Mar 16 15:31:37 crc systemd[1]: Starting Kubernetes Kubelet... Mar 16 15:31:38 crc kubenswrapper[5120]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Mar 16 15:31:38 crc kubenswrapper[5120]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Mar 16 15:31:38 crc kubenswrapper[5120]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Mar 16 15:31:38 crc kubenswrapper[5120]: Flag --register-with-taints has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Mar 16 15:31:38 crc kubenswrapper[5120]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Mar 16 15:31:38 crc kubenswrapper[5120]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.301835 5120 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.306297 5120 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.306330 5120 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.306340 5120 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.306347 5120 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.306355 5120 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.306362 5120 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.306370 5120 feature_gate.go:328] unrecognized feature gate: Example Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.306378 5120 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.306385 5120 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.306392 5120 feature_gate.go:328] unrecognized feature gate: InsightsConfig Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.306399 5120 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.306406 5120 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.306413 5120 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.306422 5120 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.306430 5120 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.306437 5120 feature_gate.go:328] unrecognized feature gate: NewOLM Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.306444 5120 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.306452 5120 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.306460 5120 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.306467 5120 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.306474 5120 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.306481 5120 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.306487 5120 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.306495 5120 feature_gate.go:328] unrecognized feature gate: SignatureStores Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.306505 5120 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.306514 5120 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.306522 5120 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.306529 5120 feature_gate.go:328] unrecognized feature gate: DualReplica Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.306537 5120 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.306544 5120 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.306551 5120 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.306559 5120 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.306566 5120 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.306574 5120 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.306583 5120 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.306591 5120 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.306598 5120 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.306605 5120 feature_gate.go:328] unrecognized feature gate: GatewayAPI Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.306643 5120 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.306651 5120 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.306659 5120 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.306666 5120 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.306673 5120 feature_gate.go:328] unrecognized feature gate: Example2 Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.306681 5120 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.306688 5120 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.306695 5120 feature_gate.go:328] unrecognized feature gate: PinnedImages Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.306702 5120 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.306709 5120 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.306716 5120 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.306723 5120 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.306730 5120 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.306738 5120 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.306745 5120 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.306751 5120 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.306785 5120 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.306792 5120 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.306799 5120 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.306806 5120 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.306813 5120 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.306820 5120 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.306828 5120 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.306835 5120 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.306843 5120 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.306851 5120 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.306859 5120 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.306867 5120 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.306940 5120 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.306949 5120 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.306956 5120 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.306965 5120 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.306972 5120 feature_gate.go:328] unrecognized feature gate: OVNObservability Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.306979 5120 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.306990 5120 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.306997 5120 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.307004 5120 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.307011 5120 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.307018 5120 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.307025 5120 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.307032 5120 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.307040 5120 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.307047 5120 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.307054 5120 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.307061 5120 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.307068 5120 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.307075 5120 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.307085 5120 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.308601 5120 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.308617 5120 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.308625 5120 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.308633 5120 feature_gate.go:328] unrecognized feature gate: PinnedImages Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.308641 5120 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.308648 5120 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.308655 5120 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.308662 5120 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.308669 5120 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.308677 5120 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.308685 5120 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.308692 5120 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.308700 5120 feature_gate.go:328] unrecognized feature gate: Example2 Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.308707 5120 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.308715 5120 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.308722 5120 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.308729 5120 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.308737 5120 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.308743 5120 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.308750 5120 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.308786 5120 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.308794 5120 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.308801 5120 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.308808 5120 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.308815 5120 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.308822 5120 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.308830 5120 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.308837 5120 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.308844 5120 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.308851 5120 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.308858 5120 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.308865 5120 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.308877 5120 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.308886 5120 feature_gate.go:328] unrecognized feature gate: OVNObservability Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.308894 5120 feature_gate.go:328] unrecognized feature gate: GatewayAPI Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.308902 5120 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.308909 5120 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.308916 5120 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.308923 5120 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.308930 5120 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.308937 5120 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.308947 5120 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.308957 5120 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.308964 5120 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.308971 5120 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.308987 5120 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.308994 5120 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.309001 5120 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.309008 5120 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.309015 5120 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.309022 5120 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.309029 5120 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.309036 5120 feature_gate.go:328] unrecognized feature gate: Example Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.309043 5120 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.309050 5120 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.309057 5120 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.309064 5120 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.309072 5120 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.309078 5120 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.309085 5120 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.309093 5120 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.309099 5120 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.309106 5120 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.309113 5120 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.309121 5120 feature_gate.go:328] unrecognized feature gate: NewOLM Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.309128 5120 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.309134 5120 feature_gate.go:328] unrecognized feature gate: InsightsConfig Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.309141 5120 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.309148 5120 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.309155 5120 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.309162 5120 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.309171 5120 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.309180 5120 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.309189 5120 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.309196 5120 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.309206 5120 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.309213 5120 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.309221 5120 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.309240 5120 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.309248 5120 feature_gate.go:328] unrecognized feature gate: DualReplica Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.309255 5120 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.309262 5120 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.309269 5120 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.309276 5120 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.309283 5120 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.309290 5120 feature_gate.go:328] unrecognized feature gate: SignatureStores Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.309443 5120 flags.go:64] FLAG: --address="0.0.0.0" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.309459 5120 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.309473 5120 flags.go:64] FLAG: --anonymous-auth="true" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.309483 5120 flags.go:64] FLAG: --application-metrics-count-limit="100" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.309494 5120 flags.go:64] FLAG: --authentication-token-webhook="false" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.309503 5120 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.309513 5120 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.309524 5120 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.309533 5120 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.309541 5120 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.309549 5120 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.309558 5120 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.309626 5120 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.309636 5120 flags.go:64] FLAG: --cgroup-root="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.309644 5120 flags.go:64] FLAG: --cgroups-per-qos="true" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.309652 5120 flags.go:64] FLAG: --client-ca-file="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.309659 5120 flags.go:64] FLAG: --cloud-config="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.309667 5120 flags.go:64] FLAG: --cloud-provider="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.309675 5120 flags.go:64] FLAG: --cluster-dns="[]" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.309687 5120 flags.go:64] FLAG: --cluster-domain="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.309695 5120 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.309703 5120 flags.go:64] FLAG: --config-dir="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.309711 5120 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.309719 5120 flags.go:64] FLAG: --container-log-max-files="5" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.309729 5120 flags.go:64] FLAG: --container-log-max-size="10Mi" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.309738 5120 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.309746 5120 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.309755 5120 flags.go:64] FLAG: --containerd-namespace="k8s.io" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.309789 5120 flags.go:64] FLAG: --contention-profiling="false" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.309798 5120 flags.go:64] FLAG: --cpu-cfs-quota="true" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.309806 5120 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.309814 5120 flags.go:64] FLAG: --cpu-manager-policy="none" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.309822 5120 flags.go:64] FLAG: --cpu-manager-policy-options="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.309832 5120 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.309841 5120 flags.go:64] FLAG: --enable-controller-attach-detach="true" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.309849 5120 flags.go:64] FLAG: --enable-debugging-handlers="true" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.309856 5120 flags.go:64] FLAG: --enable-load-reader="false" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.309864 5120 flags.go:64] FLAG: --enable-server="true" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.309872 5120 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.309891 5120 flags.go:64] FLAG: --event-burst="100" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.309899 5120 flags.go:64] FLAG: --event-qps="50" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.309907 5120 flags.go:64] FLAG: --event-storage-age-limit="default=0" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.309914 5120 flags.go:64] FLAG: --event-storage-event-limit="default=0" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.309922 5120 flags.go:64] FLAG: --eviction-hard="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.309934 5120 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.309942 5120 flags.go:64] FLAG: --eviction-minimum-reclaim="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.309949 5120 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.309958 5120 flags.go:64] FLAG: --eviction-soft="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.309965 5120 flags.go:64] FLAG: --eviction-soft-grace-period="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.309973 5120 flags.go:64] FLAG: --exit-on-lock-contention="false" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.309981 5120 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.309989 5120 flags.go:64] FLAG: --experimental-mounter-path="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.309997 5120 flags.go:64] FLAG: --fail-cgroupv1="false" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.310005 5120 flags.go:64] FLAG: --fail-swap-on="true" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.310012 5120 flags.go:64] FLAG: --feature-gates="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.310022 5120 flags.go:64] FLAG: --file-check-frequency="20s" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.310030 5120 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.310039 5120 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.310048 5120 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.310056 5120 flags.go:64] FLAG: --healthz-port="10248" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.310064 5120 flags.go:64] FLAG: --help="false" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.310072 5120 flags.go:64] FLAG: --hostname-override="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.310079 5120 flags.go:64] FLAG: --housekeeping-interval="10s" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.310087 5120 flags.go:64] FLAG: --http-check-frequency="20s" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.310095 5120 flags.go:64] FLAG: --image-credential-provider-bin-dir="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.310104 5120 flags.go:64] FLAG: --image-credential-provider-config="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.310111 5120 flags.go:64] FLAG: --image-gc-high-threshold="85" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.310119 5120 flags.go:64] FLAG: --image-gc-low-threshold="80" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.310126 5120 flags.go:64] FLAG: --image-service-endpoint="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.310134 5120 flags.go:64] FLAG: --kernel-memcg-notification="false" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.310142 5120 flags.go:64] FLAG: --kube-api-burst="100" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.310150 5120 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.310158 5120 flags.go:64] FLAG: --kube-api-qps="50" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.310165 5120 flags.go:64] FLAG: --kube-reserved="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.310173 5120 flags.go:64] FLAG: --kube-reserved-cgroup="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.310181 5120 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.310189 5120 flags.go:64] FLAG: --kubelet-cgroups="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.310197 5120 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.310204 5120 flags.go:64] FLAG: --lock-file="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.310212 5120 flags.go:64] FLAG: --log-cadvisor-usage="false" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.310219 5120 flags.go:64] FLAG: --log-flush-frequency="5s" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.310227 5120 flags.go:64] FLAG: --log-json-info-buffer-size="0" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.310240 5120 flags.go:64] FLAG: --log-json-split-stream="false" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.310248 5120 flags.go:64] FLAG: --log-text-info-buffer-size="0" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.310256 5120 flags.go:64] FLAG: --log-text-split-stream="false" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.310264 5120 flags.go:64] FLAG: --logging-format="text" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.310272 5120 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.310281 5120 flags.go:64] FLAG: --make-iptables-util-chains="true" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.310288 5120 flags.go:64] FLAG: --manifest-url="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.310296 5120 flags.go:64] FLAG: --manifest-url-header="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.310306 5120 flags.go:64] FLAG: --max-housekeeping-interval="15s" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.310315 5120 flags.go:64] FLAG: --max-open-files="1000000" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.310326 5120 flags.go:64] FLAG: --max-pods="110" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.310334 5120 flags.go:64] FLAG: --maximum-dead-containers="-1" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.310347 5120 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.310355 5120 flags.go:64] FLAG: --memory-manager-policy="None" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.310362 5120 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.310371 5120 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.310379 5120 flags.go:64] FLAG: --node-ip="192.168.126.11" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.310387 5120 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/control-plane=,node-role.kubernetes.io/master=,node.openshift.io/os_id=rhel" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.310405 5120 flags.go:64] FLAG: --node-status-max-images="50" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.310414 5120 flags.go:64] FLAG: --node-status-update-frequency="10s" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.310422 5120 flags.go:64] FLAG: --oom-score-adj="-999" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.310430 5120 flags.go:64] FLAG: --pod-cidr="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.310439 5120 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cc2b30e70040205c2536d01ae5c850be1ed2d775cf13249e50328e5085777977" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.310451 5120 flags.go:64] FLAG: --pod-manifest-path="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.310459 5120 flags.go:64] FLAG: --pod-max-pids="-1" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.310467 5120 flags.go:64] FLAG: --pods-per-core="0" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.310475 5120 flags.go:64] FLAG: --port="10250" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.310483 5120 flags.go:64] FLAG: --protect-kernel-defaults="false" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.310491 5120 flags.go:64] FLAG: --provider-id="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.310499 5120 flags.go:64] FLAG: --qos-reserved="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.310508 5120 flags.go:64] FLAG: --read-only-port="10255" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.310517 5120 flags.go:64] FLAG: --register-node="true" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.310524 5120 flags.go:64] FLAG: --register-schedulable="true" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.310533 5120 flags.go:64] FLAG: --register-with-taints="node-role.kubernetes.io/master=:NoSchedule" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.310546 5120 flags.go:64] FLAG: --registry-burst="10" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.310554 5120 flags.go:64] FLAG: --registry-qps="5" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.310562 5120 flags.go:64] FLAG: --reserved-cpus="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.310570 5120 flags.go:64] FLAG: --reserved-memory="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.310579 5120 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.310587 5120 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.310596 5120 flags.go:64] FLAG: --rotate-certificates="false" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.310604 5120 flags.go:64] FLAG: --rotate-server-certificates="false" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.310613 5120 flags.go:64] FLAG: --runonce="false" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.310621 5120 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.310632 5120 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.310641 5120 flags.go:64] FLAG: --seccomp-default="false" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.310649 5120 flags.go:64] FLAG: --serialize-image-pulls="true" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.310657 5120 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.310665 5120 flags.go:64] FLAG: --storage-driver-db="cadvisor" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.310674 5120 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.310682 5120 flags.go:64] FLAG: --storage-driver-password="root" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.310690 5120 flags.go:64] FLAG: --storage-driver-secure="false" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.310698 5120 flags.go:64] FLAG: --storage-driver-table="stats" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.310705 5120 flags.go:64] FLAG: --storage-driver-user="root" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.310713 5120 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.310721 5120 flags.go:64] FLAG: --sync-frequency="1m0s" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.310729 5120 flags.go:64] FLAG: --system-cgroups="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.310737 5120 flags.go:64] FLAG: --system-reserved="cpu=200m,ephemeral-storage=350Mi,memory=350Mi" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.310749 5120 flags.go:64] FLAG: --system-reserved-cgroup="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.310789 5120 flags.go:64] FLAG: --tls-cert-file="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.310798 5120 flags.go:64] FLAG: --tls-cipher-suites="[]" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.310827 5120 flags.go:64] FLAG: --tls-min-version="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.310834 5120 flags.go:64] FLAG: --tls-private-key-file="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.310842 5120 flags.go:64] FLAG: --topology-manager-policy="none" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.310850 5120 flags.go:64] FLAG: --topology-manager-policy-options="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.310858 5120 flags.go:64] FLAG: --topology-manager-scope="container" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.310866 5120 flags.go:64] FLAG: --v="2" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.310884 5120 flags.go:64] FLAG: --version="false" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.310894 5120 flags.go:64] FLAG: --vmodule="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.310904 5120 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.310925 5120 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.311122 5120 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.311131 5120 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.311139 5120 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.311147 5120 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.311155 5120 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.311165 5120 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.311174 5120 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.311184 5120 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.311191 5120 feature_gate.go:328] unrecognized feature gate: OVNObservability Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.311198 5120 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.311205 5120 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.311213 5120 feature_gate.go:328] unrecognized feature gate: PinnedImages Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.311220 5120 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.311226 5120 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.311233 5120 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.311240 5120 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.311248 5120 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.311255 5120 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.311262 5120 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.311269 5120 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.311276 5120 feature_gate.go:328] unrecognized feature gate: InsightsConfig Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.311284 5120 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.311291 5120 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.311298 5120 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.311305 5120 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.311313 5120 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.311320 5120 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.311327 5120 feature_gate.go:328] unrecognized feature gate: NewOLM Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.311334 5120 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.311341 5120 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.311348 5120 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.311355 5120 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.311362 5120 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.311369 5120 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.311376 5120 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.311383 5120 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.311390 5120 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.311402 5120 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.311409 5120 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.311419 5120 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.311426 5120 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.311434 5120 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.311441 5120 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.311449 5120 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.311456 5120 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.311462 5120 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.311469 5120 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.311477 5120 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.311483 5120 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.311490 5120 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.311497 5120 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.311504 5120 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.311511 5120 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.311519 5120 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.311526 5120 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.311533 5120 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.311540 5120 feature_gate.go:328] unrecognized feature gate: Example Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.311546 5120 feature_gate.go:328] unrecognized feature gate: Example2 Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.311554 5120 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.311561 5120 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.311568 5120 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.311575 5120 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.311582 5120 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.311589 5120 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.311595 5120 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.311602 5120 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.311609 5120 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.311616 5120 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.311623 5120 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.311634 5120 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.311641 5120 feature_gate.go:328] unrecognized feature gate: SignatureStores Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.311651 5120 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.311658 5120 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.311668 5120 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.311677 5120 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.311685 5120 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.311693 5120 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.311701 5120 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.311708 5120 feature_gate.go:328] unrecognized feature gate: DualReplica Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.311716 5120 feature_gate.go:328] unrecognized feature gate: GatewayAPI Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.311723 5120 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.311733 5120 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.311742 5120 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.311751 5120 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.311786 5120 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.311794 5120 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.312551 5120 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.329454 5120 server.go:530] "Kubelet version" kubeletVersion="v1.33.5" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.329869 5120 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.330020 5120 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.330037 5120 feature_gate.go:328] unrecognized feature gate: Example2 Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.330046 5120 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.330054 5120 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.330065 5120 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.330073 5120 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.330082 5120 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.330092 5120 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.330100 5120 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.330113 5120 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.330124 5120 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.330132 5120 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.330140 5120 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.330148 5120 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.330156 5120 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.330164 5120 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.330172 5120 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.330183 5120 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.330195 5120 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.330203 5120 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.330212 5120 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.330220 5120 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.330228 5120 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.330236 5120 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.330243 5120 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.330253 5120 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.330261 5120 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.330269 5120 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.330276 5120 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.330285 5120 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.330293 5120 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.330304 5120 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.330313 5120 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.330321 5120 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.330328 5120 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.330336 5120 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.330344 5120 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.330352 5120 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.330359 5120 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.330367 5120 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.330375 5120 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.330383 5120 feature_gate.go:328] unrecognized feature gate: DualReplica Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.330391 5120 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.330398 5120 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.330406 5120 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.330415 5120 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.330423 5120 feature_gate.go:328] unrecognized feature gate: PinnedImages Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.330431 5120 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.330439 5120 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.330446 5120 feature_gate.go:328] unrecognized feature gate: NewOLM Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.330454 5120 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.330462 5120 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.330470 5120 feature_gate.go:328] unrecognized feature gate: SignatureStores Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.330478 5120 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.330486 5120 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.330494 5120 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.330502 5120 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.330511 5120 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.330518 5120 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.330526 5120 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.330534 5120 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.330542 5120 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.330550 5120 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.330558 5120 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.330565 5120 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.330574 5120 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.330581 5120 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.330589 5120 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.330597 5120 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.330605 5120 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.330613 5120 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.330621 5120 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.330628 5120 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.330638 5120 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.330645 5120 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.330653 5120 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.330661 5120 feature_gate.go:328] unrecognized feature gate: GatewayAPI Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.330670 5120 feature_gate.go:328] unrecognized feature gate: Example Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.330678 5120 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.330686 5120 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.330693 5120 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.330702 5120 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.330709 5120 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.330719 5120 feature_gate.go:328] unrecognized feature gate: OVNObservability Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.330728 5120 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.330735 5120 feature_gate.go:328] unrecognized feature gate: InsightsConfig Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.330749 5120 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.331053 5120 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.331066 5120 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.331075 5120 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.331083 5120 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.331092 5120 feature_gate.go:328] unrecognized feature gate: SignatureStores Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.331100 5120 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.331108 5120 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.331115 5120 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.331123 5120 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.331130 5120 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.331139 5120 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.331147 5120 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.331155 5120 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.331163 5120 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.331170 5120 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.331178 5120 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.331186 5120 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.331194 5120 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.331202 5120 feature_gate.go:328] unrecognized feature gate: InsightsConfig Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.331209 5120 feature_gate.go:328] unrecognized feature gate: NewOLM Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.331217 5120 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.331229 5120 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.331256 5120 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.331264 5120 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.331273 5120 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.331282 5120 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.331291 5120 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.331299 5120 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.331307 5120 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.331315 5120 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.331322 5120 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.331330 5120 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.331338 5120 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.331346 5120 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.331353 5120 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.331363 5120 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.331371 5120 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.331379 5120 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.331387 5120 feature_gate.go:328] unrecognized feature gate: DualReplica Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.331394 5120 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.331402 5120 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.331410 5120 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.331418 5120 feature_gate.go:328] unrecognized feature gate: Example Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.331425 5120 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.331433 5120 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.331441 5120 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.331448 5120 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.331457 5120 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.331465 5120 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.331473 5120 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.331480 5120 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.331488 5120 feature_gate.go:328] unrecognized feature gate: OVNObservability Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.331496 5120 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.331504 5120 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.331511 5120 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.331535 5120 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.331543 5120 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.331551 5120 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.331559 5120 feature_gate.go:328] unrecognized feature gate: PinnedImages Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.331566 5120 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.331574 5120 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.331582 5120 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.331589 5120 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.331598 5120 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.331605 5120 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.331613 5120 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.331621 5120 feature_gate.go:328] unrecognized feature gate: GatewayAPI Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.331629 5120 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.331637 5120 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.331645 5120 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.331652 5120 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.331660 5120 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.331668 5120 feature_gate.go:328] unrecognized feature gate: Example2 Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.331676 5120 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.331684 5120 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.331692 5120 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.331699 5120 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.331707 5120 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.331715 5120 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.331723 5120 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.331731 5120 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.331739 5120 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.331746 5120 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.331754 5120 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.331796 5120 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.331806 5120 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.331822 5120 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.332920 5120 server.go:962] "Client rotation is on, will bootstrap in background" Mar 16 15:31:38 crc kubenswrapper[5120]: E0316 15:31:38.341797 5120 bootstrap.go:266] "Unhandled Error" err="part of the existing bootstrap client certificate in /var/lib/kubelet/kubeconfig is expired: 2025-12-03 08:27:53 +0000 UTC" logger="UnhandledError" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.347124 5120 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.347616 5120 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-client-current.pem" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.349275 5120 server.go:1019] "Starting client certificate rotation" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.349458 5120 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.349571 5120 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.387043 5120 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Mar 16 15:31:38 crc kubenswrapper[5120]: E0316 15:31:38.389853 5120 certificate_manager.go:596] "Failed while requesting a signed certificate from the control plane" err="cannot create certificate signing request: Post \"https://api-int.crc.testing:6443/apis/certificates.k8s.io/v1/certificatesigningrequests\": dial tcp 38.102.83.119:6443: connect: connection refused" logger="kubernetes.io/kube-apiserver-client-kubelet.UnhandledError" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.395634 5120 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.418427 5120 log.go:25] "Validated CRI v1 runtime API" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.478084 5120 log.go:25] "Validated CRI v1 image API" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.483081 5120 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.487686 5120 fs.go:135] Filesystem UUIDs: map[19e76f87-96b8-4794-9744-0b33dca22d5b:/dev/vda3 2026-03-16-12-58-55-00:/dev/sr0 5eb7c122-420e-4494-80ec-41664070d7b6:/dev/vda4 7B77-95E7:/dev/vda2] Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.487734 5120 fs.go:136] Filesystem partitions: map[/dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /dev/vda3:{mountpoint:/boot major:252 minor:3 fsType:ext4 blockSize:0} /dev/vda4:{mountpoint:/var major:252 minor:4 fsType:xfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /run/user/1000:{mountpoint:/run/user/1000 major:0 minor:45 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} /var/lib/etcd:{mountpoint:/var/lib/etcd major:0 minor:46 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.517581 5120 manager.go:217] Machine: {Timestamp:2026-03-16 15:31:38.514272838 +0000 UTC m=+0.668204535 CPUVendorID:AuthenticAMD NumCores:12 NumPhysicalCores:1 NumSockets:12 CpuFrequency:2799998 MemoryCapacity:33649930240 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:80bc4fba336e4ca1bc9d28a8be52a356 SystemUUID:c6072c61-a7eb-44bd-85f7-eb9fdb0e84de BootID:3cdf81b4-f597-401a-9b99-34aaa64fb798 Filesystems:[{Device:/dev/vda4 DeviceMajor:252 DeviceMinor:4 Capacity:85292941312 Type:vfs Inodes:41679680 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6545408 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16824967168 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16824963072 Type:vfs Inodes:4107657 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6729986048 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/vda3 DeviceMajor:252 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/run/user/1000 DeviceMajor:0 DeviceMinor:45 Capacity:3364990976 Type:vfs Inodes:821531 HasInodes:true} {Device:/var/lib/etcd DeviceMajor:0 DeviceMinor:46 Capacity:1073741824 Type:vfs Inodes:4107657 HasInodes:true}] DiskMap:map[252:0:{Name:vda Major:252 Minor:0 Size:214748364800 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:fa:16:3e:6c:2c:b1 Speed:0 Mtu:1500} {Name:br-int MacAddress:b2:a9:9f:57:07:84 Speed:0 Mtu:1400} {Name:ens3 MacAddress:fa:16:3e:6c:2c:b1 Speed:-1 Mtu:1500} {Name:ens7 MacAddress:fa:16:3e:dd:5e:76 Speed:-1 Mtu:1500} {Name:ens7.20 MacAddress:52:54:00:3b:e2:0f Speed:-1 Mtu:1496} {Name:ens7.21 MacAddress:52:54:00:f9:28:2e Speed:-1 Mtu:1496} {Name:ens7.22 MacAddress:52:54:00:86:c9:b9 Speed:-1 Mtu:1496} {Name:eth10 MacAddress:7a:75:2c:c1:b3:ca Speed:0 Mtu:1500} {Name:ovn-k8s-mp0 MacAddress:0a:58:0a:d9:00:02 Speed:0 Mtu:1400} {Name:ovs-system MacAddress:3e:64:eb:93:5e:aa Speed:0 Mtu:1500} {Name:tap0 MacAddress:5a:94:ef:e4:0c:ee Speed:10 Mtu:1500}] Topology:[{Id:0 Memory:33649930240 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:0 Size:16777216 Type:Unified Level:3}] SocketID:0 BookID: DrawerID:} {Id:0 Threads:[1] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:1 Size:16777216 Type:Unified Level:3}] SocketID:1 BookID: DrawerID:} {Id:0 Threads:[10] Caches:[{Id:10 Size:32768 Type:Data Level:1} {Id:10 Size:32768 Type:Instruction Level:1} {Id:10 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:10 Size:16777216 Type:Unified Level:3}] SocketID:10 BookID: DrawerID:} {Id:0 Threads:[11] Caches:[{Id:11 Size:32768 Type:Data Level:1} {Id:11 Size:32768 Type:Instruction Level:1} {Id:11 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:11 Size:16777216 Type:Unified Level:3}] SocketID:11 BookID: DrawerID:} {Id:0 Threads:[2] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:2 Size:16777216 Type:Unified Level:3}] SocketID:2 BookID: DrawerID:} {Id:0 Threads:[3] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:3 Size:16777216 Type:Unified Level:3}] SocketID:3 BookID: DrawerID:} {Id:0 Threads:[4] Caches:[{Id:4 Size:32768 Type:Data Level:1} {Id:4 Size:32768 Type:Instruction Level:1} {Id:4 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:4 Size:16777216 Type:Unified Level:3}] SocketID:4 BookID: DrawerID:} {Id:0 Threads:[5] Caches:[{Id:5 Size:32768 Type:Data Level:1} {Id:5 Size:32768 Type:Instruction Level:1} {Id:5 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:5 Size:16777216 Type:Unified Level:3}] SocketID:5 BookID: DrawerID:} {Id:0 Threads:[6] Caches:[{Id:6 Size:32768 Type:Data Level:1} {Id:6 Size:32768 Type:Instruction Level:1} {Id:6 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:6 Size:16777216 Type:Unified Level:3}] SocketID:6 BookID: DrawerID:} {Id:0 Threads:[7] Caches:[{Id:7 Size:32768 Type:Data Level:1} {Id:7 Size:32768 Type:Instruction Level:1} {Id:7 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:7 Size:16777216 Type:Unified Level:3}] SocketID:7 BookID: DrawerID:} {Id:0 Threads:[8] Caches:[{Id:8 Size:32768 Type:Data Level:1} {Id:8 Size:32768 Type:Instruction Level:1} {Id:8 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:8 Size:16777216 Type:Unified Level:3}] SocketID:8 BookID: DrawerID:} {Id:0 Threads:[9] Caches:[{Id:9 Size:32768 Type:Data Level:1} {Id:9 Size:32768 Type:Instruction Level:1} {Id:9 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:9 Size:16777216 Type:Unified Level:3}] SocketID:9 BookID: DrawerID:}] Caches:[] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.518087 5120 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.518424 5120 manager.go:233] Version: {KernelVersion:5.14.0-570.57.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20251021-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.523175 5120 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.523250 5120 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"crc","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"200m","ephemeral-storage":"350Mi","memory":"350Mi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.523571 5120 topology_manager.go:138] "Creating topology manager with none policy" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.523596 5120 container_manager_linux.go:306] "Creating device plugin manager" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.523643 5120 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.524555 5120 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.525649 5120 state_mem.go:36] "Initialized new in-memory state store" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.525984 5120 server.go:1267] "Using root directory" path="/var/lib/kubelet" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.529130 5120 kubelet.go:491] "Attempting to sync node with API server" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.529166 5120 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.529190 5120 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.529210 5120 kubelet.go:397] "Adding apiserver pod source" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.529235 5120 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.533371 5120 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.533407 5120 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Mar 16 15:31:38 crc kubenswrapper[5120]: E0316 15:31:38.535329 5120 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: Get \"https://api-int.crc.testing:6443/api/v1/services?fieldSelector=spec.clusterIP%21%3DNone&limit=500&resourceVersion=0\": dial tcp 38.102.83.119:6443: connect: connection refused" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Mar 16 15:31:38 crc kubenswrapper[5120]: E0316 15:31:38.535407 5120 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: Get \"https://api-int.crc.testing:6443/api/v1/nodes?fieldSelector=metadata.name%3Dcrc&limit=500&resourceVersion=0\": dial tcp 38.102.83.119:6443: connect: connection refused" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.536832 5120 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.536866 5120 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.542703 5120 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.5-3.rhaos4.20.gitd0ea985.el9" apiVersion="v1" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.543034 5120 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-server-current.pem" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.544063 5120 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.545459 5120 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.545508 5120 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.545527 5120 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.545549 5120 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.545567 5120 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.545583 5120 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.545603 5120 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.545619 5120 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.545638 5120 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.545665 5120 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.545747 5120 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.546398 5120 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.547615 5120 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.547649 5120 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.551140 5120 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: Get "https://api-int.crc.testing:6443/apis/storage.k8s.io/v1/csinodes/crc?resourceVersion=0": dial tcp 38.102.83.119:6443: connect: connection refused Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.575649 5120 watchdog_linux.go:99] "Systemd watchdog is not enabled" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.575779 5120 server.go:1295] "Started kubelet" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.576380 5120 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.577171 5120 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.577446 5120 server_v1.go:47] "podresources" method="list" useActivePods=true Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.578378 5120 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Mar 16 15:31:38 crc systemd[1]: Started Kubernetes Kubelet. Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.581489 5120 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.581980 5120 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.584523 5120 desired_state_of_world_populator.go:150] "Desired state populator starts to run" Mar 16 15:31:38 crc kubenswrapper[5120]: E0316 15:31:38.584662 5120 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: Get \"https://api-int.crc.testing:6443/apis/storage.k8s.io/v1/csidrivers?limit=500&resourceVersion=0\": dial tcp 38.102.83.119:6443: connect: connection refused" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.584697 5120 volume_manager.go:295] "The desired_state_of_world populator starts" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.584731 5120 volume_manager.go:297] "Starting Kubelet Volume Manager" Mar 16 15:31:38 crc kubenswrapper[5120]: E0316 15:31:38.586387 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:31:38 crc kubenswrapper[5120]: E0316 15:31:38.586882 5120 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.crc.testing:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/crc?timeout=10s\": dial tcp 38.102.83.119:6443: connect: connection refused" interval="200ms" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.587472 5120 server.go:317] "Adding debug handlers to kubelet server" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.590980 5120 factory.go:55] Registering systemd factory Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.591021 5120 factory.go:223] Registration of the systemd container factory successfully Mar 16 15:31:38 crc kubenswrapper[5120]: E0316 15:31:38.584362 5120 event.go:368] "Unable to write event (may retry after sleeping)" err="Post \"https://api-int.crc.testing:6443/api/v1/namespaces/default/events\": dial tcp 38.102.83.119:6443: connect: connection refused" event="&Event{ObjectMeta:{crc.189d5c1ad58f4cde default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:crc,UID:crc,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:31:38.575686878 +0000 UTC m=+0.729618575,LastTimestamp:2026-03-16 15:31:38.575686878 +0000 UTC m=+0.729618575,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.595131 5120 factory.go:153] Registering CRI-O factory Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.595161 5120 factory.go:223] Registration of the crio container factory successfully Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.595243 5120 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.595267 5120 factory.go:103] Registering Raw factory Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.595285 5120 manager.go:1196] Started watching for new ooms in manager Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.597267 5120 manager.go:319] Starting recovery of all containers Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.639699 5120 manager.go:324] Recovery completed Mar 16 15:31:38 crc kubenswrapper[5120]: W0316 15:31:38.651390 5120 helpers.go:245] readString: Failed to read "/sys/fs/cgroup/system.slice/crc-pullsecret.service/pids.max": read /sys/fs/cgroup/system.slice/crc-pullsecret.service/pids.max: no such device Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.654423 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="01080b46-74f1-4191-8755-5152a57b3b25" volumeName="kubernetes.io/secret/01080b46-74f1-4191-8755-5152a57b3b25-serving-cert" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.654502 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="7df94c10-441d-4386-93a6-6730fb7bcde0" volumeName="kubernetes.io/projected/7df94c10-441d-4386-93a6-6730fb7bcde0-kube-api-access-nmmzf" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.654518 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="9f71a554-e414-4bc3-96d2-674060397afe" volumeName="kubernetes.io/configmap/9f71a554-e414-4bc3-96d2-674060397afe-trusted-ca" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.654538 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="cc85e424-18b2-4924-920b-bd291a8c4b01" volumeName="kubernetes.io/empty-dir/cc85e424-18b2-4924-920b-bd291a8c4b01-utilities" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.654553 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="149b3c48-e17c-4a66-a835-d86dabf6ff13" volumeName="kubernetes.io/projected/149b3c48-e17c-4a66-a835-d86dabf6ff13-kube-api-access-wj4qr" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.654566 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="ce090a97-9ab6-4c40-a719-64ff2acd9778" volumeName="kubernetes.io/secret/ce090a97-9ab6-4c40-a719-64ff2acd9778-signing-key" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.654583 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="0dd0fbac-8c0d-4228-8faa-abbeedabf7db" volumeName="kubernetes.io/projected/0dd0fbac-8c0d-4228-8faa-abbeedabf7db-kube-api-access-q4smf" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.654598 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="b05a4c1d-fa93-4d3d-b6e5-235473e1ae2a" volumeName="kubernetes.io/secret/b05a4c1d-fa93-4d3d-b6e5-235473e1ae2a-marketplace-operator-metrics" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.654621 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="dcd10325-9ba5-4a3b-8e4a-e57e3bf210f9" volumeName="kubernetes.io/projected/dcd10325-9ba5-4a3b-8e4a-e57e3bf210f9-kube-api-access-5lcfw" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.654817 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="d565531a-ff86-4608-9d19-767de01ac31b" volumeName="kubernetes.io/secret/d565531a-ff86-4608-9d19-767de01ac31b-proxy-tls" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.654865 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="dcd10325-9ba5-4a3b-8e4a-e57e3bf210f9" volumeName="kubernetes.io/secret/dcd10325-9ba5-4a3b-8e4a-e57e3bf210f9-serving-cert" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.654889 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="2325ffef-9d5b-447f-b00e-3efc429acefe" volumeName="kubernetes.io/secret/2325ffef-9d5b-447f-b00e-3efc429acefe-serving-cert" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.654918 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="567683bd-0efc-4f21-b076-e28559628404" volumeName="kubernetes.io/empty-dir/567683bd-0efc-4f21-b076-e28559628404-tmp-dir" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.654937 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="7599e0b6-bddf-4def-b7f2-0b32206e8651" volumeName="kubernetes.io/configmap/7599e0b6-bddf-4def-b7f2-0b32206e8651-config" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.654970 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="af33e427-6803-48c2-a76a-dd9deb7cbf9a" volumeName="kubernetes.io/projected/af33e427-6803-48c2-a76a-dd9deb7cbf9a-kube-api-access-z5rsr" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.654991 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="cc85e424-18b2-4924-920b-bd291a8c4b01" volumeName="kubernetes.io/projected/cc85e424-18b2-4924-920b-bd291a8c4b01-kube-api-access-xfp5s" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.655019 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="fc8db2c7-859d-47b3-a900-2bd0c0b2973b" volumeName="kubernetes.io/configmap/fc8db2c7-859d-47b3-a900-2bd0c0b2973b-auth-proxy-config" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.655038 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="428b39f5-eb1c-4f65-b7a4-eeb6e84860cc" volumeName="kubernetes.io/configmap/428b39f5-eb1c-4f65-b7a4-eeb6e84860cc-iptables-alerter-script" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.655058 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="42a11a02-47e1-488f-b270-2679d3298b0e" volumeName="kubernetes.io/projected/42a11a02-47e1-488f-b270-2679d3298b0e-kube-api-access-qgrkj" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.655083 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="869851b9-7ffb-4af0-b166-1d8aa40a5f80" volumeName="kubernetes.io/configmap/869851b9-7ffb-4af0-b166-1d8aa40a5f80-cni-sysctl-allowlist" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.655103 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="92dfbade-90b6-4169-8c07-72cff7f2c82b" volumeName="kubernetes.io/projected/92dfbade-90b6-4169-8c07-72cff7f2c82b-kube-api-access-4g8ts" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.655131 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="af33e427-6803-48c2-a76a-dd9deb7cbf9a" volumeName="kubernetes.io/configmap/af33e427-6803-48c2-a76a-dd9deb7cbf9a-ovnkube-config" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.655154 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="18f80adb-c1c3-49ba-8ee4-932c851d3897" volumeName="kubernetes.io/projected/18f80adb-c1c3-49ba-8ee4-932c851d3897-kube-api-access-wbmqg" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.655174 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="e1d2a42d-af1d-4054-9618-ab545e0ed8b7" volumeName="kubernetes.io/secret/e1d2a42d-af1d-4054-9618-ab545e0ed8b7-proxy-tls" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.655199 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="f7648cbb-48eb-4ba8-87ec-eb096b8fa1e4" volumeName="kubernetes.io/secret/f7648cbb-48eb-4ba8-87ec-eb096b8fa1e4-metrics-certs" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.655218 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="16bdd140-dce1-464c-ab47-dd5798d1d256" volumeName="kubernetes.io/projected/16bdd140-dce1-464c-ab47-dd5798d1d256-kube-api-access-94l9h" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.655242 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="9f0bc7fcb0822a2c13eb2d22cd8c0641" volumeName="kubernetes.io/empty-dir/9f0bc7fcb0822a2c13eb2d22cd8c0641-tmp-dir" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.655263 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="c5f2bfad-70f6-4185-a3d9-81ce12720767" volumeName="kubernetes.io/configmap/c5f2bfad-70f6-4185-a3d9-81ce12720767-config" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.655299 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="301e1965-1754-483d-b6cc-bfae7038bbca" volumeName="kubernetes.io/secret/301e1965-1754-483d-b6cc-bfae7038bbca-profile-collector-cert" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.655319 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="9f71a554-e414-4bc3-96d2-674060397afe" volumeName="kubernetes.io/projected/9f71a554-e414-4bc3-96d2-674060397afe-kube-api-access-ftwb6" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.655343 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="a555ff2e-0be6-46d5-897d-863bb92ae2b3" volumeName="kubernetes.io/secret/a555ff2e-0be6-46d5-897d-863bb92ae2b3-serving-cert" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.655357 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="c491984c-7d4b-44aa-8c1e-d7974424fa47" volumeName="kubernetes.io/configmap/c491984c-7d4b-44aa-8c1e-d7974424fa47-config" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.655375 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="d19cb085-0c5b-4810-b654-ce7923221d90" volumeName="kubernetes.io/configmap/d19cb085-0c5b-4810-b654-ce7923221d90-config" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.655390 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="09cfa50b-4138-4585-a53e-64dd3ab73335" volumeName="kubernetes.io/secret/09cfa50b-4138-4585-a53e-64dd3ab73335-serving-cert" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.655408 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="0b638b8f4bb0070e40528db779baf6a2" volumeName="kubernetes.io/empty-dir/0b638b8f4bb0070e40528db779baf6a2-tmp" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.655421 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="42a11a02-47e1-488f-b270-2679d3298b0e" volumeName="kubernetes.io/secret/42a11a02-47e1-488f-b270-2679d3298b0e-control-plane-machine-set-operator-tls" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.655435 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca" volumeName="kubernetes.io/configmap/6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca-service-ca" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.655457 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="736c54fe-349c-4bb9-870a-d1c1d1c03831" volumeName="kubernetes.io/projected/736c54fe-349c-4bb9-870a-d1c1d1c03831-kube-api-access-6dmhf" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.655474 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="a208c9c2-333b-4b4a-be0d-bc32ec38a821" volumeName="kubernetes.io/projected/a208c9c2-333b-4b4a-be0d-bc32ec38a821-kube-api-access-26xrl" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.655526 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="d7e8f42f-dc0e-424b-bb56-5ec849834888" volumeName="kubernetes.io/secret/d7e8f42f-dc0e-424b-bb56-5ec849834888-serving-cert" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.655539 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="736c54fe-349c-4bb9-870a-d1c1d1c03831" volumeName="kubernetes.io/secret/736c54fe-349c-4bb9-870a-d1c1d1c03831-serving-cert" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.655558 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="6edfcf45-925b-4eff-b940-95b6fc0b85d4" volumeName="kubernetes.io/secret/6edfcf45-925b-4eff-b940-95b6fc0b85d4-v4-0-config-user-template-login" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.655648 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="f7e2c886-118e-43bb-bef1-c78134de392b" volumeName="kubernetes.io/projected/f7e2c886-118e-43bb-bef1-c78134de392b-kube-api-access-6g4lr" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.655671 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="b605f283-6f2e-42da-a838-54421690f7d0" volumeName="kubernetes.io/projected/b605f283-6f2e-42da-a838-54421690f7d0-kube-api-access-6rmnv" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.655700 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="2325ffef-9d5b-447f-b00e-3efc429acefe" volumeName="kubernetes.io/configmap/2325ffef-9d5b-447f-b00e-3efc429acefe-config" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.655717 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="34177974-8d82-49d2-a763-391d0df3bbd8" volumeName="kubernetes.io/projected/34177974-8d82-49d2-a763-391d0df3bbd8-kube-api-access-m7xz2" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.655733 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="567683bd-0efc-4f21-b076-e28559628404" volumeName="kubernetes.io/configmap/567683bd-0efc-4f21-b076-e28559628404-etcd-service-ca" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.655751 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="5ebfebf6-3ecd-458e-943f-bb25b52e2718" volumeName="kubernetes.io/projected/5ebfebf6-3ecd-458e-943f-bb25b52e2718-kube-api-access-l87hs" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.655789 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="6a9ae5f6-97bd-46ac-bafa-ca1b4452a141" volumeName="kubernetes.io/secret/6a9ae5f6-97bd-46ac-bafa-ca1b4452a141-networking-console-plugin-cert" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.655809 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="6edfcf45-925b-4eff-b940-95b6fc0b85d4" volumeName="kubernetes.io/secret/6edfcf45-925b-4eff-b940-95b6fc0b85d4-v4-0-config-system-serving-cert" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.655823 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="9e9b5059-1b3e-4067-a63d-2952cbe863af" volumeName="kubernetes.io/projected/9e9b5059-1b3e-4067-a63d-2952cbe863af-bound-sa-token" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.655862 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="7afa918d-be67-40a6-803c-d3b0ae99d815" volumeName="kubernetes.io/secret/7afa918d-be67-40a6-803c-d3b0ae99d815-serving-cert" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.655876 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="584e1f4a-8205-47d7-8efb-3afc6017c4c9" volumeName="kubernetes.io/empty-dir/584e1f4a-8205-47d7-8efb-3afc6017c4c9-utilities" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.655890 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="71c8ffbe-59c6-4e7d-aa1a-bbd315b3414a" volumeName="kubernetes.io/projected/71c8ffbe-59c6-4e7d-aa1a-bbd315b3414a-kube-api-access-ks6v2" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.655907 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="736c54fe-349c-4bb9-870a-d1c1d1c03831" volumeName="kubernetes.io/empty-dir/736c54fe-349c-4bb9-870a-d1c1d1c03831-tmp" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.655921 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="16bdd140-dce1-464c-ab47-dd5798d1d256" volumeName="kubernetes.io/secret/16bdd140-dce1-464c-ab47-dd5798d1d256-serving-cert" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.655963 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="9e9b5059-1b3e-4067-a63d-2952cbe863af" volumeName="kubernetes.io/secret/9e9b5059-1b3e-4067-a63d-2952cbe863af-installation-pull-secrets" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.655976 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="a555ff2e-0be6-46d5-897d-863bb92ae2b3" volumeName="kubernetes.io/configmap/a555ff2e-0be6-46d5-897d-863bb92ae2b3-proxy-ca-bundles" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.655990 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="dcd10325-9ba5-4a3b-8e4a-e57e3bf210f9" volumeName="kubernetes.io/configmap/dcd10325-9ba5-4a3b-8e4a-e57e3bf210f9-config" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.656051 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="149b3c48-e17c-4a66-a835-d86dabf6ff13" volumeName="kubernetes.io/empty-dir/149b3c48-e17c-4a66-a835-d86dabf6ff13-utilities" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.656067 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="2325ffef-9d5b-447f-b00e-3efc429acefe" volumeName="kubernetes.io/projected/2325ffef-9d5b-447f-b00e-3efc429acefe-kube-api-access-zg8nc" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.656084 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="6077b63e-53a2-4f96-9d56-1ce0324e4913" volumeName="kubernetes.io/empty-dir/6077b63e-53a2-4f96-9d56-1ce0324e4913-tmp-dir" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.656098 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="6edfcf45-925b-4eff-b940-95b6fc0b85d4" volumeName="kubernetes.io/configmap/6edfcf45-925b-4eff-b940-95b6fc0b85d4-v4-0-config-system-trusted-ca-bundle" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.656116 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="0effdbcf-dd7d-404d-9d48-77536d665a5d" volumeName="kubernetes.io/projected/0effdbcf-dd7d-404d-9d48-77536d665a5d-kube-api-access-mfzkj" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.656130 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="6edfcf45-925b-4eff-b940-95b6fc0b85d4" volumeName="kubernetes.io/configmap/6edfcf45-925b-4eff-b940-95b6fc0b85d4-v4-0-config-system-cliconfig" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.656144 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="81e39f7b-62e4-4fc9-992a-6535ce127a02" volumeName="kubernetes.io/projected/81e39f7b-62e4-4fc9-992a-6535ce127a02-kube-api-access-pllx6" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.656161 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="869851b9-7ffb-4af0-b166-1d8aa40a5f80" volumeName="kubernetes.io/configmap/869851b9-7ffb-4af0-b166-1d8aa40a5f80-cni-binary-copy" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.656173 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="b05a4c1d-fa93-4d3d-b6e5-235473e1ae2a" volumeName="kubernetes.io/projected/b05a4c1d-fa93-4d3d-b6e5-235473e1ae2a-kube-api-access-qqbfk" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.656190 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="2325ffef-9d5b-447f-b00e-3efc429acefe" volumeName="kubernetes.io/configmap/2325ffef-9d5b-447f-b00e-3efc429acefe-trusted-ca" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.656207 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="a208c9c2-333b-4b4a-be0d-bc32ec38a821" volumeName="kubernetes.io/secret/a208c9c2-333b-4b4a-be0d-bc32ec38a821-package-server-manager-serving-cert" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.656224 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="a52afe44-fb37-46ed-a1f8-bf39727a3cbe" volumeName="kubernetes.io/secret/a52afe44-fb37-46ed-a1f8-bf39727a3cbe-cert" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.656247 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="ce090a97-9ab6-4c40-a719-64ff2acd9778" volumeName="kubernetes.io/configmap/ce090a97-9ab6-4c40-a719-64ff2acd9778-signing-cabundle" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.656264 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="584e1f4a-8205-47d7-8efb-3afc6017c4c9" volumeName="kubernetes.io/empty-dir/584e1f4a-8205-47d7-8efb-3afc6017c4c9-catalog-content" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.656288 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="d45be74c-0d98-4d18-90e4-f7ef1b6daaf7" volumeName="kubernetes.io/empty-dir/d45be74c-0d98-4d18-90e4-f7ef1b6daaf7-tmp" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.656304 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="20ce4d18-fe25-4696-ad7c-1bd2d6200a3e" volumeName="kubernetes.io/projected/20ce4d18-fe25-4696-ad7c-1bd2d6200a3e-kube-api-access-tkdh6" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.656325 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="18f80adb-c1c3-49ba-8ee4-932c851d3897" volumeName="kubernetes.io/secret/18f80adb-c1c3-49ba-8ee4-932c851d3897-stats-auth" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.656339 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="20c5c5b4bed930554494851fe3cb2b2a" volumeName="kubernetes.io/empty-dir/20c5c5b4bed930554494851fe3cb2b2a-tmp-dir" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.656352 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="d565531a-ff86-4608-9d19-767de01ac31b" volumeName="kubernetes.io/configmap/d565531a-ff86-4608-9d19-767de01ac31b-images" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.656370 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="71c8ffbe-59c6-4e7d-aa1a-bbd315b3414a" volumeName="kubernetes.io/empty-dir/71c8ffbe-59c6-4e7d-aa1a-bbd315b3414a-catalog-content" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.657412 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="f65c0ac1-8bca-454d-a2e6-e35cb418beac" volumeName="kubernetes.io/secret/f65c0ac1-8bca-454d-a2e6-e35cb418beac-serving-cert" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.657454 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="567683bd-0efc-4f21-b076-e28559628404" volumeName="kubernetes.io/secret/567683bd-0efc-4f21-b076-e28559628404-serving-cert" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.657471 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca" volumeName="kubernetes.io/configmap/6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca-trusted-ca-bundle" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.657483 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="6edfcf45-925b-4eff-b940-95b6fc0b85d4" volumeName="kubernetes.io/secret/6edfcf45-925b-4eff-b940-95b6fc0b85d4-v4-0-config-user-template-error" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.657496 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="6ee8fbd3-1f81-4666-96da-5afc70819f1a" volumeName="kubernetes.io/secret/6ee8fbd3-1f81-4666-96da-5afc70819f1a-samples-operator-tls" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.657509 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="736c54fe-349c-4bb9-870a-d1c1d1c03831" volumeName="kubernetes.io/configmap/736c54fe-349c-4bb9-870a-d1c1d1c03831-client-ca" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.657524 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="a555ff2e-0be6-46d5-897d-863bb92ae2b3" volumeName="kubernetes.io/empty-dir/a555ff2e-0be6-46d5-897d-863bb92ae2b3-tmp" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.657536 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="b05a4c1d-fa93-4d3d-b6e5-235473e1ae2a" volumeName="kubernetes.io/configmap/b05a4c1d-fa93-4d3d-b6e5-235473e1ae2a-marketplace-trusted-ca" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.657549 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="d19cb085-0c5b-4810-b654-ce7923221d90" volumeName="kubernetes.io/configmap/d19cb085-0c5b-4810-b654-ce7923221d90-image-import-ca" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.657561 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="6edfcf45-925b-4eff-b940-95b6fc0b85d4" volumeName="kubernetes.io/secret/6edfcf45-925b-4eff-b940-95b6fc0b85d4-v4-0-config-system-session" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.657574 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="9276f8f5-2f24-48e1-ab6d-1aab0d8ec3ff" volumeName="kubernetes.io/empty-dir/9276f8f5-2f24-48e1-ab6d-1aab0d8ec3ff-catalog-content" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.657587 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="71c8ffbe-59c6-4e7d-aa1a-bbd315b3414a" volumeName="kubernetes.io/empty-dir/71c8ffbe-59c6-4e7d-aa1a-bbd315b3414a-utilities" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.657600 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="567683bd-0efc-4f21-b076-e28559628404" volumeName="kubernetes.io/configmap/567683bd-0efc-4f21-b076-e28559628404-etcd-ca" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.657612 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="6edfcf45-925b-4eff-b940-95b6fc0b85d4" volumeName="kubernetes.io/projected/6edfcf45-925b-4eff-b940-95b6fc0b85d4-kube-api-access-8nb9c" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.657625 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="9e9b5059-1b3e-4067-a63d-2952cbe863af" volumeName="kubernetes.io/empty-dir/9e9b5059-1b3e-4067-a63d-2952cbe863af-ca-trust-extracted" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.657639 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="9f0bc7fcb0822a2c13eb2d22cd8c0641" volumeName="kubernetes.io/empty-dir/9f0bc7fcb0822a2c13eb2d22cd8c0641-var-run-kubernetes" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.657651 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="cc85e424-18b2-4924-920b-bd291a8c4b01" volumeName="kubernetes.io/empty-dir/cc85e424-18b2-4924-920b-bd291a8c4b01-catalog-content" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.657663 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="d19cb085-0c5b-4810-b654-ce7923221d90" volumeName="kubernetes.io/configmap/d19cb085-0c5b-4810-b654-ce7923221d90-audit" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.657677 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="f559dfa3-3917-43a2-97f6-61ddfda10e93" volumeName="kubernetes.io/secret/f559dfa3-3917-43a2-97f6-61ddfda10e93-encryption-config" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.657689 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="f65c0ac1-8bca-454d-a2e6-e35cb418beac" volumeName="kubernetes.io/projected/f65c0ac1-8bca-454d-a2e6-e35cb418beac-kube-api-access" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.657701 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="16bdd140-dce1-464c-ab47-dd5798d1d256" volumeName="kubernetes.io/empty-dir/16bdd140-dce1-464c-ab47-dd5798d1d256-available-featuregates" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.657714 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="6077b63e-53a2-4f96-9d56-1ce0324e4913" volumeName="kubernetes.io/secret/6077b63e-53a2-4f96-9d56-1ce0324e4913-metrics-tls" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.657726 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="d7e8f42f-dc0e-424b-bb56-5ec849834888" volumeName="kubernetes.io/configmap/d7e8f42f-dc0e-424b-bb56-5ec849834888-service-ca" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.657738 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="f559dfa3-3917-43a2-97f6-61ddfda10e93" volumeName="kubernetes.io/secret/f559dfa3-3917-43a2-97f6-61ddfda10e93-serving-cert" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.657795 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="fc8db2c7-859d-47b3-a900-2bd0c0b2973b" volumeName="kubernetes.io/configmap/fc8db2c7-859d-47b3-a900-2bd0c0b2973b-config" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.657810 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="6077b63e-53a2-4f96-9d56-1ce0324e4913" volumeName="kubernetes.io/projected/6077b63e-53a2-4f96-9d56-1ce0324e4913-kube-api-access-zth6t" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.657823 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca" volumeName="kubernetes.io/secret/6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca-console-oauth-config" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.657838 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="c491984c-7d4b-44aa-8c1e-d7974424fa47" volumeName="kubernetes.io/configmap/c491984c-7d4b-44aa-8c1e-d7974424fa47-images" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.657850 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="0dd0fbac-8c0d-4228-8faa-abbeedabf7db" volumeName="kubernetes.io/secret/0dd0fbac-8c0d-4228-8faa-abbeedabf7db-webhook-certs" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.657863 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="6ee8fbd3-1f81-4666-96da-5afc70819f1a" volumeName="kubernetes.io/projected/6ee8fbd3-1f81-4666-96da-5afc70819f1a-kube-api-access-d4tqq" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.657877 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="9e9b5059-1b3e-4067-a63d-2952cbe863af" volumeName="kubernetes.io/configmap/9e9b5059-1b3e-4067-a63d-2952cbe863af-registry-certificates" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.657891 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="c491984c-7d4b-44aa-8c1e-d7974424fa47" volumeName="kubernetes.io/projected/c491984c-7d4b-44aa-8c1e-d7974424fa47-kube-api-access-9vsz9" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.657905 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="301e1965-1754-483d-b6cc-bfae7038bbca" volumeName="kubernetes.io/projected/301e1965-1754-483d-b6cc-bfae7038bbca-kube-api-access-7jjkz" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.657942 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="584e1f4a-8205-47d7-8efb-3afc6017c4c9" volumeName="kubernetes.io/projected/584e1f4a-8205-47d7-8efb-3afc6017c4c9-kube-api-access-tknt7" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.657960 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="a555ff2e-0be6-46d5-897d-863bb92ae2b3" volumeName="kubernetes.io/configmap/a555ff2e-0be6-46d5-897d-863bb92ae2b3-config" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.657974 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="c491984c-7d4b-44aa-8c1e-d7974424fa47" volumeName="kubernetes.io/secret/c491984c-7d4b-44aa-8c1e-d7974424fa47-machine-api-operator-tls" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.657987 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="869851b9-7ffb-4af0-b166-1d8aa40a5f80" volumeName="kubernetes.io/configmap/869851b9-7ffb-4af0-b166-1d8aa40a5f80-whereabouts-flatfile-configmap" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.658000 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="d19cb085-0c5b-4810-b654-ce7923221d90" volumeName="kubernetes.io/configmap/d19cb085-0c5b-4810-b654-ce7923221d90-etcd-serving-ca" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.658014 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="7fcc6409-8a0f-44c3-89e7-5aecd7610f8a" volumeName="kubernetes.io/secret/7fcc6409-8a0f-44c3-89e7-5aecd7610f8a-srv-cert" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.658029 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="a555ff2e-0be6-46d5-897d-863bb92ae2b3" volumeName="kubernetes.io/configmap/a555ff2e-0be6-46d5-897d-863bb92ae2b3-client-ca" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.658044 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="d45be74c-0d98-4d18-90e4-f7ef1b6daaf7" volumeName="kubernetes.io/secret/d45be74c-0d98-4d18-90e4-f7ef1b6daaf7-serving-cert" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.658057 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="3a14caf222afb62aaabdc47808b6f944" volumeName="kubernetes.io/empty-dir/3a14caf222afb62aaabdc47808b6f944-tmp-dir" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.658070 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="567683bd-0efc-4f21-b076-e28559628404" volumeName="kubernetes.io/secret/567683bd-0efc-4f21-b076-e28559628404-etcd-client" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.658082 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="593a3561-7760-45c5-8f91-5aaef7475d0f" volumeName="kubernetes.io/secret/593a3561-7760-45c5-8f91-5aaef7475d0f-node-bootstrap-token" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.658093 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="81e39f7b-62e4-4fc9-992a-6535ce127a02" volumeName="kubernetes.io/configmap/81e39f7b-62e4-4fc9-992a-6535ce127a02-multus-daemon-config" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.658106 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="e1d2a42d-af1d-4054-9618-ab545e0ed8b7" volumeName="kubernetes.io/configmap/e1d2a42d-af1d-4054-9618-ab545e0ed8b7-mcd-auth-proxy-config" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.658118 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="f7648cbb-48eb-4ba8-87ec-eb096b8fa1e4" volumeName="kubernetes.io/projected/f7648cbb-48eb-4ba8-87ec-eb096b8fa1e4-kube-api-access-pgx6b" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.658132 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="fc4541ce-7789-4670-bc75-5c2868e52ce0" volumeName="kubernetes.io/projected/fc4541ce-7789-4670-bc75-5c2868e52ce0-kube-api-access-8nt2j" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.658144 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="7fcc6409-8a0f-44c3-89e7-5aecd7610f8a" volumeName="kubernetes.io/projected/7fcc6409-8a0f-44c3-89e7-5aecd7610f8a-kube-api-access-ddlk9" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.658157 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="9f71a554-e414-4bc3-96d2-674060397afe" volumeName="kubernetes.io/projected/9f71a554-e414-4bc3-96d2-674060397afe-bound-sa-token" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.658169 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="b4750666-1362-4001-abd0-6f89964cc621" volumeName="kubernetes.io/configmap/b4750666-1362-4001-abd0-6f89964cc621-mcc-auth-proxy-config" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.658182 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="5ebfebf6-3ecd-458e-943f-bb25b52e2718" volumeName="kubernetes.io/configmap/5ebfebf6-3ecd-458e-943f-bb25b52e2718-serviceca" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.658195 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="af33e427-6803-48c2-a76a-dd9deb7cbf9a" volumeName="kubernetes.io/secret/af33e427-6803-48c2-a76a-dd9deb7cbf9a-ovn-node-metrics-cert" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.658209 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="fc8db2c7-859d-47b3-a900-2bd0c0b2973b" volumeName="kubernetes.io/secret/fc8db2c7-859d-47b3-a900-2bd0c0b2973b-machine-approver-tls" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.658222 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="20ce4d18-fe25-4696-ad7c-1bd2d6200a3e" volumeName="kubernetes.io/secret/20ce4d18-fe25-4696-ad7c-1bd2d6200a3e-image-registry-operator-tls" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.658239 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="567683bd-0efc-4f21-b076-e28559628404" volumeName="kubernetes.io/configmap/567683bd-0efc-4f21-b076-e28559628404-config" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.658255 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="6edfcf45-925b-4eff-b940-95b6fc0b85d4" volumeName="kubernetes.io/secret/6edfcf45-925b-4eff-b940-95b6fc0b85d4-v4-0-config-system-ocp-branding-template" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.658271 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="af33e427-6803-48c2-a76a-dd9deb7cbf9a" volumeName="kubernetes.io/configmap/af33e427-6803-48c2-a76a-dd9deb7cbf9a-env-overrides" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.658285 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="01080b46-74f1-4191-8755-5152a57b3b25" volumeName="kubernetes.io/projected/01080b46-74f1-4191-8755-5152a57b3b25-kube-api-access-w94wk" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.658298 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="6a9ae5f6-97bd-46ac-bafa-ca1b4452a141" volumeName="kubernetes.io/configmap/6a9ae5f6-97bd-46ac-bafa-ca1b4452a141-nginx-conf" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.658310 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="92dfbade-90b6-4169-8c07-72cff7f2c82b" volumeName="kubernetes.io/secret/92dfbade-90b6-4169-8c07-72cff7f2c82b-metrics-tls" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.658325 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="a555ff2e-0be6-46d5-897d-863bb92ae2b3" volumeName="kubernetes.io/projected/a555ff2e-0be6-46d5-897d-863bb92ae2b3-kube-api-access-8pskd" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.658337 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="d19cb085-0c5b-4810-b654-ce7923221d90" volumeName="kubernetes.io/projected/d19cb085-0c5b-4810-b654-ce7923221d90-kube-api-access-m5lgh" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.658352 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="dcd10325-9ba5-4a3b-8e4a-e57e3bf210f9" volumeName="kubernetes.io/configmap/dcd10325-9ba5-4a3b-8e4a-e57e3bf210f9-service-ca-bundle" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.658365 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="fc8db2c7-859d-47b3-a900-2bd0c0b2973b" volumeName="kubernetes.io/projected/fc8db2c7-859d-47b3-a900-2bd0c0b2973b-kube-api-access-hckvg" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.658381 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="593a3561-7760-45c5-8f91-5aaef7475d0f" volumeName="kubernetes.io/secret/593a3561-7760-45c5-8f91-5aaef7475d0f-certs" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.658397 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="7599e0b6-bddf-4def-b7f2-0b32206e8651" volumeName="kubernetes.io/projected/7599e0b6-bddf-4def-b7f2-0b32206e8651-kube-api-access-ptkcf" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.658411 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="94a6e063-3d1a-4d44-875d-185291448c31" volumeName="kubernetes.io/empty-dir/94a6e063-3d1a-4d44-875d-185291448c31-utilities" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.658424 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="a7a88189-c967-4640-879e-27665747f20c" volumeName="kubernetes.io/projected/a7a88189-c967-4640-879e-27665747f20c-kube-api-access-8nspp" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.658438 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="fc4541ce-7789-4670-bc75-5c2868e52ce0" volumeName="kubernetes.io/configmap/fc4541ce-7789-4670-bc75-5c2868e52ce0-ovnkube-identity-cm" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.658450 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="7df94c10-441d-4386-93a6-6730fb7bcde0" volumeName="kubernetes.io/configmap/7df94c10-441d-4386-93a6-6730fb7bcde0-env-overrides" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.658463 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="81e39f7b-62e4-4fc9-992a-6535ce127a02" volumeName="kubernetes.io/configmap/81e39f7b-62e4-4fc9-992a-6535ce127a02-cni-binary-copy" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.658475 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="fc4541ce-7789-4670-bc75-5c2868e52ce0" volumeName="kubernetes.io/configmap/fc4541ce-7789-4670-bc75-5c2868e52ce0-env-overrides" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.658487 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="7afa918d-be67-40a6-803c-d3b0ae99d815" volumeName="kubernetes.io/projected/7afa918d-be67-40a6-803c-d3b0ae99d815-kube-api-access" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.658499 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="b4750666-1362-4001-abd0-6f89964cc621" volumeName="kubernetes.io/projected/b4750666-1362-4001-abd0-6f89964cc621-kube-api-access-twvbl" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.658512 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="d19cb085-0c5b-4810-b654-ce7923221d90" volumeName="kubernetes.io/secret/d19cb085-0c5b-4810-b654-ce7923221d90-serving-cert" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.658524 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="e093be35-bb62-4843-b2e8-094545761610" volumeName="kubernetes.io/projected/e093be35-bb62-4843-b2e8-094545761610-kube-api-access-pddnv" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.658570 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="09cfa50b-4138-4585-a53e-64dd3ab73335" volumeName="kubernetes.io/configmap/09cfa50b-4138-4585-a53e-64dd3ab73335-config" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.658584 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="20ce4d18-fe25-4696-ad7c-1bd2d6200a3e" volumeName="kubernetes.io/empty-dir/20ce4d18-fe25-4696-ad7c-1bd2d6200a3e-ca-trust-extracted-pem" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.658597 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="736c54fe-349c-4bb9-870a-d1c1d1c03831" volumeName="kubernetes.io/configmap/736c54fe-349c-4bb9-870a-d1c1d1c03831-config" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.658613 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="869851b9-7ffb-4af0-b166-1d8aa40a5f80" volumeName="kubernetes.io/projected/869851b9-7ffb-4af0-b166-1d8aa40a5f80-kube-api-access-mjwtd" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.658627 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="94a6e063-3d1a-4d44-875d-185291448c31" volumeName="kubernetes.io/empty-dir/94a6e063-3d1a-4d44-875d-185291448c31-catalog-content" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.658640 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="428b39f5-eb1c-4f65-b7a4-eeb6e84860cc" volumeName="kubernetes.io/projected/428b39f5-eb1c-4f65-b7a4-eeb6e84860cc-kube-api-access-dsgwk" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.658651 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="a7a88189-c967-4640-879e-27665747f20c" volumeName="kubernetes.io/empty-dir/a7a88189-c967-4640-879e-27665747f20c-tmpfs" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.658664 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="a7a88189-c967-4640-879e-27665747f20c" volumeName="kubernetes.io/secret/a7a88189-c967-4640-879e-27665747f20c-apiservice-cert" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.658678 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="b05a4c1d-fa93-4d3d-b6e5-235473e1ae2a" volumeName="kubernetes.io/empty-dir/b05a4c1d-fa93-4d3d-b6e5-235473e1ae2a-tmp" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.658690 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="b605f283-6f2e-42da-a838-54421690f7d0" volumeName="kubernetes.io/empty-dir/b605f283-6f2e-42da-a838-54421690f7d0-utilities" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.658702 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="d19cb085-0c5b-4810-b654-ce7923221d90" volumeName="kubernetes.io/configmap/d19cb085-0c5b-4810-b654-ce7923221d90-trusted-ca-bundle" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.658715 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="f559dfa3-3917-43a2-97f6-61ddfda10e93" volumeName="kubernetes.io/projected/f559dfa3-3917-43a2-97f6-61ddfda10e93-kube-api-access-hm9x7" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.658727 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="01080b46-74f1-4191-8755-5152a57b3b25" volumeName="kubernetes.io/configmap/01080b46-74f1-4191-8755-5152a57b3b25-config" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.658740 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="31fa8943-81cc-4750-a0b7-0fa9ab5af883" volumeName="kubernetes.io/empty-dir/31fa8943-81cc-4750-a0b7-0fa9ab5af883-catalog-content" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.658754 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="c5f2bfad-70f6-4185-a3d9-81ce12720767" volumeName="kubernetes.io/projected/c5f2bfad-70f6-4185-a3d9-81ce12720767-kube-api-access" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.658791 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="d45be74c-0d98-4d18-90e4-f7ef1b6daaf7" volumeName="kubernetes.io/configmap/d45be74c-0d98-4d18-90e4-f7ef1b6daaf7-config" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.658807 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="dcd10325-9ba5-4a3b-8e4a-e57e3bf210f9" volumeName="kubernetes.io/configmap/dcd10325-9ba5-4a3b-8e4a-e57e3bf210f9-trusted-ca-bundle" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.658824 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="7afa918d-be67-40a6-803c-d3b0ae99d815" volumeName="kubernetes.io/configmap/7afa918d-be67-40a6-803c-d3b0ae99d815-config" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.658843 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="31fa8943-81cc-4750-a0b7-0fa9ab5af883" volumeName="kubernetes.io/projected/31fa8943-81cc-4750-a0b7-0fa9ab5af883-kube-api-access-grwfz" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.658857 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="6edfcf45-925b-4eff-b940-95b6fc0b85d4" volumeName="kubernetes.io/secret/6edfcf45-925b-4eff-b940-95b6fc0b85d4-v4-0-config-system-router-certs" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.658870 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="6edfcf45-925b-4eff-b940-95b6fc0b85d4" volumeName="kubernetes.io/secret/6edfcf45-925b-4eff-b940-95b6fc0b85d4-v4-0-config-user-idp-0-file-data" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.658883 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="af41de71-79cf-4590-bbe9-9e8b848862cb" volumeName="kubernetes.io/projected/af41de71-79cf-4590-bbe9-9e8b848862cb-kube-api-access-d7cps" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.658896 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="d45be74c-0d98-4d18-90e4-f7ef1b6daaf7" volumeName="kubernetes.io/projected/d45be74c-0d98-4d18-90e4-f7ef1b6daaf7-kube-api-access-dztfv" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.658908 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="d565531a-ff86-4608-9d19-767de01ac31b" volumeName="kubernetes.io/projected/d565531a-ff86-4608-9d19-767de01ac31b-kube-api-access-99zj9" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.658921 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="09cfa50b-4138-4585-a53e-64dd3ab73335" volumeName="kubernetes.io/projected/09cfa50b-4138-4585-a53e-64dd3ab73335-kube-api-access-zsb9b" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.658933 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="92dfbade-90b6-4169-8c07-72cff7f2c82b" volumeName="kubernetes.io/empty-dir/92dfbade-90b6-4169-8c07-72cff7f2c82b-tmp-dir" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.658946 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="b605f283-6f2e-42da-a838-54421690f7d0" volumeName="kubernetes.io/empty-dir/b605f283-6f2e-42da-a838-54421690f7d0-catalog-content" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.658959 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="c5f2bfad-70f6-4185-a3d9-81ce12720767" volumeName="kubernetes.io/empty-dir/c5f2bfad-70f6-4185-a3d9-81ce12720767-tmp-dir" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.658972 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="f7e2c886-118e-43bb-bef1-c78134de392b" volumeName="kubernetes.io/empty-dir/f7e2c886-118e-43bb-bef1-c78134de392b-tmp-dir" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.658985 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="31fa8943-81cc-4750-a0b7-0fa9ab5af883" volumeName="kubernetes.io/empty-dir/31fa8943-81cc-4750-a0b7-0fa9ab5af883-utilities" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.658997 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="593a3561-7760-45c5-8f91-5aaef7475d0f" volumeName="kubernetes.io/projected/593a3561-7760-45c5-8f91-5aaef7475d0f-kube-api-access-sbc2l" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.659010 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="9276f8f5-2f24-48e1-ab6d-1aab0d8ec3ff" volumeName="kubernetes.io/projected/9276f8f5-2f24-48e1-ab6d-1aab0d8ec3ff-kube-api-access-xxfcv" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.659026 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="6edfcf45-925b-4eff-b940-95b6fc0b85d4" volumeName="kubernetes.io/configmap/6edfcf45-925b-4eff-b940-95b6fc0b85d4-v4-0-config-system-service-ca" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.659042 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="a52afe44-fb37-46ed-a1f8-bf39727a3cbe" volumeName="kubernetes.io/projected/a52afe44-fb37-46ed-a1f8-bf39727a3cbe-kube-api-access-rzt4w" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.659074 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="af33e427-6803-48c2-a76a-dd9deb7cbf9a" volumeName="kubernetes.io/configmap/af33e427-6803-48c2-a76a-dd9deb7cbf9a-ovnkube-script-lib" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.659092 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="ce090a97-9ab6-4c40-a719-64ff2acd9778" volumeName="kubernetes.io/projected/ce090a97-9ab6-4c40-a719-64ff2acd9778-kube-api-access-xnxbn" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.659108 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="7afa918d-be67-40a6-803c-d3b0ae99d815" volumeName="kubernetes.io/empty-dir/7afa918d-be67-40a6-803c-d3b0ae99d815-tmp" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.659123 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="9e9b5059-1b3e-4067-a63d-2952cbe863af" volumeName="kubernetes.io/projected/9e9b5059-1b3e-4067-a63d-2952cbe863af-kube-api-access-ws8zz" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.659135 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="e1d2a42d-af1d-4054-9618-ab545e0ed8b7" volumeName="kubernetes.io/projected/e1d2a42d-af1d-4054-9618-ab545e0ed8b7-kube-api-access-9z4sw" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.659147 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="18f80adb-c1c3-49ba-8ee4-932c851d3897" volumeName="kubernetes.io/configmap/18f80adb-c1c3-49ba-8ee4-932c851d3897-service-ca-bundle" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.659161 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca" volumeName="kubernetes.io/projected/6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca-kube-api-access-l9stx" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.659180 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca" volumeName="kubernetes.io/secret/6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca-console-serving-cert" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.659195 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="d7e8f42f-dc0e-424b-bb56-5ec849834888" volumeName="kubernetes.io/projected/d7e8f42f-dc0e-424b-bb56-5ec849834888-kube-api-access" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.659208 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="20ce4d18-fe25-4696-ad7c-1bd2d6200a3e" volumeName="kubernetes.io/empty-dir/20ce4d18-fe25-4696-ad7c-1bd2d6200a3e-tmp" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.659220 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="3a14caf222afb62aaabdc47808b6f944" volumeName="kubernetes.io/empty-dir/3a14caf222afb62aaabdc47808b6f944-ca-bundle-dir" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.659233 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="f559dfa3-3917-43a2-97f6-61ddfda10e93" volumeName="kubernetes.io/configmap/f559dfa3-3917-43a2-97f6-61ddfda10e93-audit-policies" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.659244 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="f65c0ac1-8bca-454d-a2e6-e35cb418beac" volumeName="kubernetes.io/empty-dir/f65c0ac1-8bca-454d-a2e6-e35cb418beac-tmp-dir" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.659256 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="567683bd-0efc-4f21-b076-e28559628404" volumeName="kubernetes.io/projected/567683bd-0efc-4f21-b076-e28559628404-kube-api-access-m26jq" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.659271 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="6edfcf45-925b-4eff-b940-95b6fc0b85d4" volumeName="kubernetes.io/secret/6edfcf45-925b-4eff-b940-95b6fc0b85d4-v4-0-config-user-template-provider-selection" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.659284 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="9e9b5059-1b3e-4067-a63d-2952cbe863af" volumeName="kubernetes.io/projected/9e9b5059-1b3e-4067-a63d-2952cbe863af-registry-tls" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.659299 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="d565531a-ff86-4608-9d19-767de01ac31b" volumeName="kubernetes.io/configmap/d565531a-ff86-4608-9d19-767de01ac31b-auth-proxy-config" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.659312 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="7fcc6409-8a0f-44c3-89e7-5aecd7610f8a" volumeName="kubernetes.io/secret/7fcc6409-8a0f-44c3-89e7-5aecd7610f8a-profile-collector-cert" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.659325 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="9276f8f5-2f24-48e1-ab6d-1aab0d8ec3ff" volumeName="kubernetes.io/empty-dir/9276f8f5-2f24-48e1-ab6d-1aab0d8ec3ff-utilities" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.659339 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="9e9b5059-1b3e-4067-a63d-2952cbe863af" volumeName="kubernetes.io/configmap/9e9b5059-1b3e-4067-a63d-2952cbe863af-trusted-ca" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.659351 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="9f71a554-e414-4bc3-96d2-674060397afe" volumeName="kubernetes.io/secret/9f71a554-e414-4bc3-96d2-674060397afe-metrics-tls" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.659365 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="f559dfa3-3917-43a2-97f6-61ddfda10e93" volumeName="kubernetes.io/configmap/f559dfa3-3917-43a2-97f6-61ddfda10e93-trusted-ca-bundle" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.659377 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="17b87002-b798-480a-8e17-83053d698239" volumeName="kubernetes.io/projected/17b87002-b798-480a-8e17-83053d698239-kube-api-access-gwt8b" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.659389 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="20ce4d18-fe25-4696-ad7c-1bd2d6200a3e" volumeName="kubernetes.io/projected/20ce4d18-fe25-4696-ad7c-1bd2d6200a3e-bound-sa-token" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.659402 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="34177974-8d82-49d2-a763-391d0df3bbd8" volumeName="kubernetes.io/secret/34177974-8d82-49d2-a763-391d0df3bbd8-metrics-tls" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.659415 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="6edfcf45-925b-4eff-b940-95b6fc0b85d4" volumeName="kubernetes.io/configmap/6edfcf45-925b-4eff-b940-95b6fc0b85d4-audit-policies" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.659428 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="9f0bc7fcb0822a2c13eb2d22cd8c0641" volumeName="kubernetes.io/empty-dir/9f0bc7fcb0822a2c13eb2d22cd8c0641-ca-trust-dir" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.659440 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="18f80adb-c1c3-49ba-8ee4-932c851d3897" volumeName="kubernetes.io/secret/18f80adb-c1c3-49ba-8ee4-932c851d3897-default-certificate" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.659452 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="7df94c10-441d-4386-93a6-6730fb7bcde0" volumeName="kubernetes.io/configmap/7df94c10-441d-4386-93a6-6730fb7bcde0-ovnkube-config" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.659463 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="7fcc6409-8a0f-44c3-89e7-5aecd7610f8a" volumeName="kubernetes.io/empty-dir/7fcc6409-8a0f-44c3-89e7-5aecd7610f8a-tmpfs" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.659475 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="f559dfa3-3917-43a2-97f6-61ddfda10e93" volumeName="kubernetes.io/configmap/f559dfa3-3917-43a2-97f6-61ddfda10e93-etcd-serving-ca" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.659488 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="18f80adb-c1c3-49ba-8ee4-932c851d3897" volumeName="kubernetes.io/secret/18f80adb-c1c3-49ba-8ee4-932c851d3897-metrics-certs" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.659499 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="301e1965-1754-483d-b6cc-bfae7038bbca" volumeName="kubernetes.io/secret/301e1965-1754-483d-b6cc-bfae7038bbca-srv-cert" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.659513 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="92dfbade-90b6-4169-8c07-72cff7f2c82b" volumeName="kubernetes.io/configmap/92dfbade-90b6-4169-8c07-72cff7f2c82b-config-volume" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.659559 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="d19cb085-0c5b-4810-b654-ce7923221d90" volumeName="kubernetes.io/secret/d19cb085-0c5b-4810-b654-ce7923221d90-etcd-client" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.659571 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca" volumeName="kubernetes.io/configmap/6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca-console-config" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.659583 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="a7a88189-c967-4640-879e-27665747f20c" volumeName="kubernetes.io/secret/a7a88189-c967-4640-879e-27665747f20c-webhook-cert" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.659596 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="20ce4d18-fe25-4696-ad7c-1bd2d6200a3e" volumeName="kubernetes.io/configmap/20ce4d18-fe25-4696-ad7c-1bd2d6200a3e-trusted-ca" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.659608 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="c5f2bfad-70f6-4185-a3d9-81ce12720767" volumeName="kubernetes.io/secret/c5f2bfad-70f6-4185-a3d9-81ce12720767-serving-cert" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.659620 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="d19cb085-0c5b-4810-b654-ce7923221d90" volumeName="kubernetes.io/secret/d19cb085-0c5b-4810-b654-ce7923221d90-encryption-config" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.659633 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="f65c0ac1-8bca-454d-a2e6-e35cb418beac" volumeName="kubernetes.io/configmap/f65c0ac1-8bca-454d-a2e6-e35cb418beac-config" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.659647 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="301e1965-1754-483d-b6cc-bfae7038bbca" volumeName="kubernetes.io/empty-dir/301e1965-1754-483d-b6cc-bfae7038bbca-tmpfs" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.659660 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca" volumeName="kubernetes.io/configmap/6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca-oauth-serving-cert" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.659673 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="94a6e063-3d1a-4d44-875d-185291448c31" volumeName="kubernetes.io/projected/94a6e063-3d1a-4d44-875d-185291448c31-kube-api-access-4hb7m" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.659687 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="9e9b5059-1b3e-4067-a63d-2952cbe863af" volumeName="kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.659894 5120 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.661433 5120 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.662427 5120 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.662489 5120 status_manager.go:230] "Starting to sync pod status with apiserver" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.662527 5120 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.662541 5120 kubelet.go:2451] "Starting kubelet main sync loop" Mar 16 15:31:38 crc kubenswrapper[5120]: E0316 15:31:38.662707 5120 kubelet.go:2475] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.662997 5120 reconstruct.go:144] "Volume is marked device as uncertain and added into the actual state" volumeName="kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" deviceMountPath="/var/lib/kubelet/plugins/kubernetes.io/csi/kubevirt.io.hostpath-provisioner/b1264ac67579ad07e7e9003054d44fe40dd55285a4b2f7dc74e48be1aee0868a/globalmount" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.663028 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="fc4541ce-7789-4670-bc75-5c2868e52ce0" volumeName="kubernetes.io/secret/fc4541ce-7789-4670-bc75-5c2868e52ce0-webhook-cert" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.663046 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="7df94c10-441d-4386-93a6-6730fb7bcde0" volumeName="kubernetes.io/secret/7df94c10-441d-4386-93a6-6730fb7bcde0-ovn-control-plane-metrics-cert" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.663063 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="149b3c48-e17c-4a66-a835-d86dabf6ff13" volumeName="kubernetes.io/empty-dir/149b3c48-e17c-4a66-a835-d86dabf6ff13-catalog-content" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.663079 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="7599e0b6-bddf-4def-b7f2-0b32206e8651" volumeName="kubernetes.io/secret/7599e0b6-bddf-4def-b7f2-0b32206e8651-serving-cert" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.663092 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="b4750666-1362-4001-abd0-6f89964cc621" volumeName="kubernetes.io/secret/b4750666-1362-4001-abd0-6f89964cc621-proxy-tls" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.663104 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="f559dfa3-3917-43a2-97f6-61ddfda10e93" volumeName="kubernetes.io/secret/f559dfa3-3917-43a2-97f6-61ddfda10e93-etcd-client" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.663118 5120 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="f863fff9-286a-45fa-b8f0-8a86994b8440" volumeName="kubernetes.io/projected/f863fff9-286a-45fa-b8f0-8a86994b8440-kube-api-access-l7w75" seLinuxMountContext="" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.663129 5120 reconstruct.go:97] "Volume reconstruction finished" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.663136 5120 reconciler.go:26] "Reconciler: start to sync state" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.664552 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.664587 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.664601 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:31:38 crc kubenswrapper[5120]: E0316 15:31:38.664906 5120 reflector.go:200] "Failed to watch" err="failed to list *v1.RuntimeClass: Get \"https://api-int.crc.testing:6443/apis/node.k8s.io/v1/runtimeclasses?limit=500&resourceVersion=0\": dial tcp 38.102.83.119:6443: connect: connection refused" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.667539 5120 cpu_manager.go:222] "Starting CPU manager" policy="none" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.667591 5120 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.667622 5120 state_mem.go:36] "Initialized new in-memory state store" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.675293 5120 policy_none.go:49] "None policy: Start" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.675343 5120 memory_manager.go:186] "Starting memorymanager" policy="None" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.675367 5120 state_mem.go:35] "Initializing new in-memory state store" Mar 16 15:31:38 crc kubenswrapper[5120]: E0316 15:31:38.687155 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.716059 5120 manager.go:341] "Starting Device Plugin manager" Mar 16 15:31:38 crc kubenswrapper[5120]: E0316 15:31:38.716361 5120 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.716388 5120 server.go:85] "Starting device plugin registration server" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.716975 5120 eviction_manager.go:189] "Eviction manager: starting control loop" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.716999 5120 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.717419 5120 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.717524 5120 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.717542 5120 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Mar 16 15:31:38 crc kubenswrapper[5120]: E0316 15:31:38.721213 5120 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Mar 16 15:31:38 crc kubenswrapper[5120]: E0316 15:31:38.721322 5120 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"crc\" not found" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.762980 5120 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-crc","openshift-etcd/etcd-crc","openshift-kube-apiserver/kube-apiserver-crc","openshift-kube-controller-manager/kube-controller-manager-crc","openshift-kube-scheduler/openshift-kube-scheduler-crc"] Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.763125 5120 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.763666 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.763697 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.763707 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.764298 5120 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.764680 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-crc" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.764733 5120 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.764685 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.764867 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.764876 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.765315 5120 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.765528 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.765564 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.765575 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.765706 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.765739 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.765769 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.765960 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/etcd-crc" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.766003 5120 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.766653 5120 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.766703 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/kube-apiserver-crc" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.766730 5120 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.767061 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.767101 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.767114 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.767276 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.767317 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.767327 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.767289 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.767383 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.767392 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.767914 5120 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.768011 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/kube-controller-manager-crc" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.768046 5120 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.768437 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.768454 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.768470 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.768479 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.768492 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.768507 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.769390 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler/openshift-kube-scheduler-crc" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.769428 5120 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.770603 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.770630 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.770642 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:31:38 crc kubenswrapper[5120]: E0316 15:31:38.787980 5120 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.crc.testing:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/crc?timeout=10s\": dial tcp 38.102.83.119:6443: connect: connection refused" interval="400ms" Mar 16 15:31:38 crc kubenswrapper[5120]: E0316 15:31:38.795120 5120 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"crc\" not found" node="crc" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.817343 5120 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 15:31:38 crc kubenswrapper[5120]: E0316 15:31:38.819496 5120 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"crc\" not found" node="crc" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.820002 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.820046 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.820058 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.820080 5120 kubelet_node_status.go:78] "Attempting to register node" node="crc" Mar 16 15:31:38 crc kubenswrapper[5120]: E0316 15:31:38.820583 5120 kubelet_node_status.go:110] "Unable to register node with API server" err="Post \"https://api-int.crc.testing:6443/api/v1/nodes\": dial tcp 38.102.83.119:6443: connect: connection refused" node="crc" Mar 16 15:31:38 crc kubenswrapper[5120]: E0316 15:31:38.847512 5120 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"crc\" not found" node="crc" Mar 16 15:31:38 crc kubenswrapper[5120]: E0316 15:31:38.858510 5120 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"crc\" not found" node="crc" Mar 16 15:31:38 crc kubenswrapper[5120]: E0316 15:31:38.863468 5120 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"crc\" not found" node="crc" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.864532 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4e08c320b1e9e2405e6e0107bdf7eeb4-etc-kube\") pod \"kube-rbac-proxy-crio-crc\" (UID: \"4e08c320b1e9e2405e6e0107bdf7eeb4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-crc" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.864584 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/20c5c5b4bed930554494851fe3cb2b2a-resource-dir\") pod \"etcd-crc\" (UID: \"20c5c5b4bed930554494851fe3cb2b2a\") " pod="openshift-etcd/etcd-crc" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.864651 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/20c5c5b4bed930554494851fe3cb2b2a-cert-dir\") pod \"etcd-crc\" (UID: \"20c5c5b4bed930554494851fe3cb2b2a\") " pod="openshift-etcd/etcd-crc" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.864749 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/3a14caf222afb62aaabdc47808b6f944-resource-dir\") pod \"kube-apiserver-crc\" (UID: \"3a14caf222afb62aaabdc47808b6f944\") " pod="openshift-kube-apiserver/kube-apiserver-crc" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.864808 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/9f0bc7fcb0822a2c13eb2d22cd8c0641-cert-dir\") pod \"kube-controller-manager-crc\" (UID: \"9f0bc7fcb0822a2c13eb2d22cd8c0641\") " pod="openshift-kube-controller-manager/kube-controller-manager-crc" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.864983 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0b638b8f4bb0070e40528db779baf6a2-tmp\") pod \"openshift-kube-scheduler-crc\" (UID: \"0b638b8f4bb0070e40528db779baf6a2\") " pod="openshift-kube-scheduler/openshift-kube-scheduler-crc" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.865006 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4e08c320b1e9e2405e6e0107bdf7eeb4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-crc\" (UID: \"4e08c320b1e9e2405e6e0107bdf7eeb4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-crc" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.865025 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"static-pod-dir\" (UniqueName: \"kubernetes.io/host-path/20c5c5b4bed930554494851fe3cb2b2a-static-pod-dir\") pod \"etcd-crc\" (UID: \"20c5c5b4bed930554494851fe3cb2b2a\") " pod="openshift-etcd/etcd-crc" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.865040 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-dir\" (UniqueName: \"kubernetes.io/host-path/20c5c5b4bed930554494851fe3cb2b2a-data-dir\") pod \"etcd-crc\" (UID: \"20c5c5b4bed930554494851fe3cb2b2a\") " pod="openshift-etcd/etcd-crc" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.865055 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-dir\" (UniqueName: \"kubernetes.io/host-path/20c5c5b4bed930554494851fe3cb2b2a-log-dir\") pod \"etcd-crc\" (UID: \"20c5c5b4bed930554494851fe3cb2b2a\") " pod="openshift-etcd/etcd-crc" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.865070 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/3a14caf222afb62aaabdc47808b6f944-cert-dir\") pod \"kube-apiserver-crc\" (UID: \"3a14caf222afb62aaabdc47808b6f944\") " pod="openshift-kube-apiserver/kube-apiserver-crc" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.865086 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a14caf222afb62aaabdc47808b6f944-tmp-dir\") pod \"kube-apiserver-crc\" (UID: \"3a14caf222afb62aaabdc47808b6f944\") " pod="openshift-kube-apiserver/kube-apiserver-crc" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.865123 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"usr-local-bin\" (UniqueName: \"kubernetes.io/host-path/20c5c5b4bed930554494851fe3cb2b2a-usr-local-bin\") pod \"etcd-crc\" (UID: \"20c5c5b4bed930554494851fe3cb2b2a\") " pod="openshift-etcd/etcd-crc" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.865156 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etcd-auto-backup-dir\" (UniqueName: \"kubernetes.io/host-path/20c5c5b4bed930554494851fe3cb2b2a-etcd-auto-backup-dir\") pod \"etcd-crc\" (UID: \"20c5c5b4bed930554494851fe3cb2b2a\") " pod="openshift-etcd/etcd-crc" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.865179 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-bundle-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a14caf222afb62aaabdc47808b6f944-ca-bundle-dir\") pod \"kube-apiserver-crc\" (UID: \"3a14caf222afb62aaabdc47808b6f944\") " pod="openshift-kube-apiserver/kube-apiserver-crc" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.865339 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/9f0bc7fcb0822a2c13eb2d22cd8c0641-resource-dir\") pod \"kube-controller-manager-crc\" (UID: \"9f0bc7fcb0822a2c13eb2d22cd8c0641\") " pod="openshift-kube-controller-manager/kube-controller-manager-crc" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.865424 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9f0bc7fcb0822a2c13eb2d22cd8c0641-tmp-dir\") pod \"kube-controller-manager-crc\" (UID: \"9f0bc7fcb0822a2c13eb2d22cd8c0641\") " pod="openshift-kube-controller-manager/kube-controller-manager-crc" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.865486 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a14caf222afb62aaabdc47808b6f944-tmp-dir\") pod \"kube-apiserver-crc\" (UID: \"3a14caf222afb62aaabdc47808b6f944\") " pod="openshift-kube-apiserver/kube-apiserver-crc" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.865534 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-bundle-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a14caf222afb62aaabdc47808b6f944-ca-bundle-dir\") pod \"kube-apiserver-crc\" (UID: \"3a14caf222afb62aaabdc47808b6f944\") " pod="openshift-kube-apiserver/kube-apiserver-crc" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.865565 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-dir\" (UniqueName: \"kubernetes.io/empty-dir/9f0bc7fcb0822a2c13eb2d22cd8c0641-ca-trust-dir\") pod \"kube-controller-manager-crc\" (UID: \"9f0bc7fcb0822a2c13eb2d22cd8c0641\") " pod="openshift-kube-controller-manager/kube-controller-manager-crc" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.865633 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-run-kubernetes\" (UniqueName: \"kubernetes.io/empty-dir/9f0bc7fcb0822a2c13eb2d22cd8c0641-var-run-kubernetes\") pod \"kube-controller-manager-crc\" (UID: \"9f0bc7fcb0822a2c13eb2d22cd8c0641\") " pod="openshift-kube-controller-manager/kube-controller-manager-crc" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.865672 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/0b638b8f4bb0070e40528db779baf6a2-resource-dir\") pod \"openshift-kube-scheduler-crc\" (UID: \"0b638b8f4bb0070e40528db779baf6a2\") " pod="openshift-kube-scheduler/openshift-kube-scheduler-crc" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.865711 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/20c5c5b4bed930554494851fe3cb2b2a-tmp-dir\") pod \"etcd-crc\" (UID: \"20c5c5b4bed930554494851fe3cb2b2a\") " pod="openshift-etcd/etcd-crc" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.865747 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/3a14caf222afb62aaabdc47808b6f944-audit-dir\") pod \"kube-apiserver-crc\" (UID: \"3a14caf222afb62aaabdc47808b6f944\") " pod="openshift-kube-apiserver/kube-apiserver-crc" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.865802 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/0b638b8f4bb0070e40528db779baf6a2-cert-dir\") pod \"openshift-kube-scheduler-crc\" (UID: \"0b638b8f4bb0070e40528db779baf6a2\") " pod="openshift-kube-scheduler/openshift-kube-scheduler-crc" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.865810 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-run-kubernetes\" (UniqueName: \"kubernetes.io/empty-dir/9f0bc7fcb0822a2c13eb2d22cd8c0641-var-run-kubernetes\") pod \"kube-controller-manager-crc\" (UID: \"9f0bc7fcb0822a2c13eb2d22cd8c0641\") " pod="openshift-kube-controller-manager/kube-controller-manager-crc" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.865916 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0b638b8f4bb0070e40528db779baf6a2-tmp\") pod \"openshift-kube-scheduler-crc\" (UID: \"0b638b8f4bb0070e40528db779baf6a2\") " pod="openshift-kube-scheduler/openshift-kube-scheduler-crc" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.866151 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9f0bc7fcb0822a2c13eb2d22cd8c0641-tmp-dir\") pod \"kube-controller-manager-crc\" (UID: \"9f0bc7fcb0822a2c13eb2d22cd8c0641\") " pod="openshift-kube-controller-manager/kube-controller-manager-crc" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.866170 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-dir\" (UniqueName: \"kubernetes.io/empty-dir/9f0bc7fcb0822a2c13eb2d22cd8c0641-ca-trust-dir\") pod \"kube-controller-manager-crc\" (UID: \"9f0bc7fcb0822a2c13eb2d22cd8c0641\") " pod="openshift-kube-controller-manager/kube-controller-manager-crc" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.867694 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/20c5c5b4bed930554494851fe3cb2b2a-tmp-dir\") pod \"etcd-crc\" (UID: \"20c5c5b4bed930554494851fe3cb2b2a\") " pod="openshift-etcd/etcd-crc" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.967431 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/0b638b8f4bb0070e40528db779baf6a2-resource-dir\") pod \"openshift-kube-scheduler-crc\" (UID: \"0b638b8f4bb0070e40528db779baf6a2\") " pod="openshift-kube-scheduler/openshift-kube-scheduler-crc" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.967521 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/3a14caf222afb62aaabdc47808b6f944-audit-dir\") pod \"kube-apiserver-crc\" (UID: \"3a14caf222afb62aaabdc47808b6f944\") " pod="openshift-kube-apiserver/kube-apiserver-crc" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.967555 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/0b638b8f4bb0070e40528db779baf6a2-cert-dir\") pod \"openshift-kube-scheduler-crc\" (UID: \"0b638b8f4bb0070e40528db779baf6a2\") " pod="openshift-kube-scheduler/openshift-kube-scheduler-crc" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.967570 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/0b638b8f4bb0070e40528db779baf6a2-resource-dir\") pod \"openshift-kube-scheduler-crc\" (UID: \"0b638b8f4bb0070e40528db779baf6a2\") " pod="openshift-kube-scheduler/openshift-kube-scheduler-crc" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.967587 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4e08c320b1e9e2405e6e0107bdf7eeb4-etc-kube\") pod \"kube-rbac-proxy-crio-crc\" (UID: \"4e08c320b1e9e2405e6e0107bdf7eeb4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-crc" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.967652 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4e08c320b1e9e2405e6e0107bdf7eeb4-etc-kube\") pod \"kube-rbac-proxy-crio-crc\" (UID: \"4e08c320b1e9e2405e6e0107bdf7eeb4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-crc" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.967665 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/20c5c5b4bed930554494851fe3cb2b2a-resource-dir\") pod \"etcd-crc\" (UID: \"20c5c5b4bed930554494851fe3cb2b2a\") " pod="openshift-etcd/etcd-crc" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.967664 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/3a14caf222afb62aaabdc47808b6f944-audit-dir\") pod \"kube-apiserver-crc\" (UID: \"3a14caf222afb62aaabdc47808b6f944\") " pod="openshift-kube-apiserver/kube-apiserver-crc" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.967693 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/20c5c5b4bed930554494851fe3cb2b2a-resource-dir\") pod \"etcd-crc\" (UID: \"20c5c5b4bed930554494851fe3cb2b2a\") " pod="openshift-etcd/etcd-crc" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.967735 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/0b638b8f4bb0070e40528db779baf6a2-cert-dir\") pod \"openshift-kube-scheduler-crc\" (UID: \"0b638b8f4bb0070e40528db779baf6a2\") " pod="openshift-kube-scheduler/openshift-kube-scheduler-crc" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.967815 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/20c5c5b4bed930554494851fe3cb2b2a-cert-dir\") pod \"etcd-crc\" (UID: \"20c5c5b4bed930554494851fe3cb2b2a\") " pod="openshift-etcd/etcd-crc" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.967853 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/3a14caf222afb62aaabdc47808b6f944-resource-dir\") pod \"kube-apiserver-crc\" (UID: \"3a14caf222afb62aaabdc47808b6f944\") " pod="openshift-kube-apiserver/kube-apiserver-crc" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.967877 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/9f0bc7fcb0822a2c13eb2d22cd8c0641-cert-dir\") pod \"kube-controller-manager-crc\" (UID: \"9f0bc7fcb0822a2c13eb2d22cd8c0641\") " pod="openshift-kube-controller-manager/kube-controller-manager-crc" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.967934 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/9f0bc7fcb0822a2c13eb2d22cd8c0641-cert-dir\") pod \"kube-controller-manager-crc\" (UID: \"9f0bc7fcb0822a2c13eb2d22cd8c0641\") " pod="openshift-kube-controller-manager/kube-controller-manager-crc" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.967970 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4e08c320b1e9e2405e6e0107bdf7eeb4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-crc\" (UID: \"4e08c320b1e9e2405e6e0107bdf7eeb4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-crc" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.967975 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/20c5c5b4bed930554494851fe3cb2b2a-cert-dir\") pod \"etcd-crc\" (UID: \"20c5c5b4bed930554494851fe3cb2b2a\") " pod="openshift-etcd/etcd-crc" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.968002 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"static-pod-dir\" (UniqueName: \"kubernetes.io/host-path/20c5c5b4bed930554494851fe3cb2b2a-static-pod-dir\") pod \"etcd-crc\" (UID: \"20c5c5b4bed930554494851fe3cb2b2a\") " pod="openshift-etcd/etcd-crc" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.968033 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-dir\" (UniqueName: \"kubernetes.io/host-path/20c5c5b4bed930554494851fe3cb2b2a-data-dir\") pod \"etcd-crc\" (UID: \"20c5c5b4bed930554494851fe3cb2b2a\") " pod="openshift-etcd/etcd-crc" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.968054 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4e08c320b1e9e2405e6e0107bdf7eeb4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-crc\" (UID: \"4e08c320b1e9e2405e6e0107bdf7eeb4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-crc" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.968063 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-dir\" (UniqueName: \"kubernetes.io/host-path/20c5c5b4bed930554494851fe3cb2b2a-log-dir\") pod \"etcd-crc\" (UID: \"20c5c5b4bed930554494851fe3cb2b2a\") " pod="openshift-etcd/etcd-crc" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.968091 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-dir\" (UniqueName: \"kubernetes.io/host-path/20c5c5b4bed930554494851fe3cb2b2a-log-dir\") pod \"etcd-crc\" (UID: \"20c5c5b4bed930554494851fe3cb2b2a\") " pod="openshift-etcd/etcd-crc" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.968094 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/3a14caf222afb62aaabdc47808b6f944-cert-dir\") pod \"kube-apiserver-crc\" (UID: \"3a14caf222afb62aaabdc47808b6f944\") " pod="openshift-kube-apiserver/kube-apiserver-crc" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.968091 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"static-pod-dir\" (UniqueName: \"kubernetes.io/host-path/20c5c5b4bed930554494851fe3cb2b2a-static-pod-dir\") pod \"etcd-crc\" (UID: \"20c5c5b4bed930554494851fe3cb2b2a\") " pod="openshift-etcd/etcd-crc" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.968062 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/3a14caf222afb62aaabdc47808b6f944-resource-dir\") pod \"kube-apiserver-crc\" (UID: \"3a14caf222afb62aaabdc47808b6f944\") " pod="openshift-kube-apiserver/kube-apiserver-crc" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.968119 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/3a14caf222afb62aaabdc47808b6f944-cert-dir\") pod \"kube-apiserver-crc\" (UID: \"3a14caf222afb62aaabdc47808b6f944\") " pod="openshift-kube-apiserver/kube-apiserver-crc" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.968095 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-dir\" (UniqueName: \"kubernetes.io/host-path/20c5c5b4bed930554494851fe3cb2b2a-data-dir\") pod \"etcd-crc\" (UID: \"20c5c5b4bed930554494851fe3cb2b2a\") " pod="openshift-etcd/etcd-crc" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.968129 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"usr-local-bin\" (UniqueName: \"kubernetes.io/host-path/20c5c5b4bed930554494851fe3cb2b2a-usr-local-bin\") pod \"etcd-crc\" (UID: \"20c5c5b4bed930554494851fe3cb2b2a\") " pod="openshift-etcd/etcd-crc" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.968151 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"usr-local-bin\" (UniqueName: \"kubernetes.io/host-path/20c5c5b4bed930554494851fe3cb2b2a-usr-local-bin\") pod \"etcd-crc\" (UID: \"20c5c5b4bed930554494851fe3cb2b2a\") " pod="openshift-etcd/etcd-crc" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.968159 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etcd-auto-backup-dir\" (UniqueName: \"kubernetes.io/host-path/20c5c5b4bed930554494851fe3cb2b2a-etcd-auto-backup-dir\") pod \"etcd-crc\" (UID: \"20c5c5b4bed930554494851fe3cb2b2a\") " pod="openshift-etcd/etcd-crc" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.968190 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/9f0bc7fcb0822a2c13eb2d22cd8c0641-resource-dir\") pod \"kube-controller-manager-crc\" (UID: \"9f0bc7fcb0822a2c13eb2d22cd8c0641\") " pod="openshift-kube-controller-manager/kube-controller-manager-crc" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.968212 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etcd-auto-backup-dir\" (UniqueName: \"kubernetes.io/host-path/20c5c5b4bed930554494851fe3cb2b2a-etcd-auto-backup-dir\") pod \"etcd-crc\" (UID: \"20c5c5b4bed930554494851fe3cb2b2a\") " pod="openshift-etcd/etcd-crc" Mar 16 15:31:38 crc kubenswrapper[5120]: I0316 15:31:38.968303 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/9f0bc7fcb0822a2c13eb2d22cd8c0641-resource-dir\") pod \"kube-controller-manager-crc\" (UID: \"9f0bc7fcb0822a2c13eb2d22cd8c0641\") " pod="openshift-kube-controller-manager/kube-controller-manager-crc" Mar 16 15:31:39 crc kubenswrapper[5120]: I0316 15:31:39.021112 5120 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 15:31:39 crc kubenswrapper[5120]: I0316 15:31:39.022014 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:31:39 crc kubenswrapper[5120]: I0316 15:31:39.022060 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:31:39 crc kubenswrapper[5120]: I0316 15:31:39.022075 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:31:39 crc kubenswrapper[5120]: I0316 15:31:39.022102 5120 kubelet_node_status.go:78] "Attempting to register node" node="crc" Mar 16 15:31:39 crc kubenswrapper[5120]: E0316 15:31:39.022596 5120 kubelet_node_status.go:110] "Unable to register node with API server" err="Post \"https://api-int.crc.testing:6443/api/v1/nodes\": dial tcp 38.102.83.119:6443: connect: connection refused" node="crc" Mar 16 15:31:39 crc kubenswrapper[5120]: I0316 15:31:39.096298 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-crc" Mar 16 15:31:39 crc kubenswrapper[5120]: I0316 15:31:39.121062 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/etcd-crc" Mar 16 15:31:39 crc kubenswrapper[5120]: W0316 15:31:39.145918 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e08c320b1e9e2405e6e0107bdf7eeb4.slice/crio-87cc21e206f6b12c9a00667f67e4fdb2a1ac122bce875277aa7cf7e8eb916486 WatchSource:0}: Error finding container 87cc21e206f6b12c9a00667f67e4fdb2a1ac122bce875277aa7cf7e8eb916486: Status 404 returned error can't find the container with id 87cc21e206f6b12c9a00667f67e4fdb2a1ac122bce875277aa7cf7e8eb916486 Mar 16 15:31:39 crc kubenswrapper[5120]: I0316 15:31:39.148271 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/kube-apiserver-crc" Mar 16 15:31:39 crc kubenswrapper[5120]: I0316 15:31:39.153337 5120 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Mar 16 15:31:39 crc kubenswrapper[5120]: W0316 15:31:39.155382 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20c5c5b4bed930554494851fe3cb2b2a.slice/crio-dc89d721818bbb17366d6be5871fafd597c17a90308134045de4ded0a6bdf5b7 WatchSource:0}: Error finding container dc89d721818bbb17366d6be5871fafd597c17a90308134045de4ded0a6bdf5b7: Status 404 returned error can't find the container with id dc89d721818bbb17366d6be5871fafd597c17a90308134045de4ded0a6bdf5b7 Mar 16 15:31:39 crc kubenswrapper[5120]: I0316 15:31:39.159437 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/kube-controller-manager-crc" Mar 16 15:31:39 crc kubenswrapper[5120]: I0316 15:31:39.165177 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler/openshift-kube-scheduler-crc" Mar 16 15:31:39 crc kubenswrapper[5120]: W0316 15:31:39.182006 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f0bc7fcb0822a2c13eb2d22cd8c0641.slice/crio-7849edbbb0642f8a7125ab033df37cf90621419e3fb20a1a856b741338a8166e WatchSource:0}: Error finding container 7849edbbb0642f8a7125ab033df37cf90621419e3fb20a1a856b741338a8166e: Status 404 returned error can't find the container with id 7849edbbb0642f8a7125ab033df37cf90621419e3fb20a1a856b741338a8166e Mar 16 15:31:39 crc kubenswrapper[5120]: W0316 15:31:39.183024 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a14caf222afb62aaabdc47808b6f944.slice/crio-29decac87470b86a68080dbdd98f5a08b124b821ed1e287c6c58ba4b0b19c6cf WatchSource:0}: Error finding container 29decac87470b86a68080dbdd98f5a08b124b821ed1e287c6c58ba4b0b19c6cf: Status 404 returned error can't find the container with id 29decac87470b86a68080dbdd98f5a08b124b821ed1e287c6c58ba4b0b19c6cf Mar 16 15:31:39 crc kubenswrapper[5120]: E0316 15:31:39.188686 5120 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.crc.testing:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/crc?timeout=10s\": dial tcp 38.102.83.119:6443: connect: connection refused" interval="800ms" Mar 16 15:31:39 crc kubenswrapper[5120]: E0316 15:31:39.376540 5120 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: Get \"https://api-int.crc.testing:6443/api/v1/services?fieldSelector=spec.clusterIP%21%3DNone&limit=500&resourceVersion=0\": dial tcp 38.102.83.119:6443: connect: connection refused" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Mar 16 15:31:39 crc kubenswrapper[5120]: I0316 15:31:39.423389 5120 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 15:31:39 crc kubenswrapper[5120]: I0316 15:31:39.424453 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:31:39 crc kubenswrapper[5120]: I0316 15:31:39.424486 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:31:39 crc kubenswrapper[5120]: I0316 15:31:39.424496 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:31:39 crc kubenswrapper[5120]: I0316 15:31:39.424517 5120 kubelet_node_status.go:78] "Attempting to register node" node="crc" Mar 16 15:31:39 crc kubenswrapper[5120]: E0316 15:31:39.424975 5120 kubelet_node_status.go:110] "Unable to register node with API server" err="Post \"https://api-int.crc.testing:6443/api/v1/nodes\": dial tcp 38.102.83.119:6443: connect: connection refused" node="crc" Mar 16 15:31:39 crc kubenswrapper[5120]: E0316 15:31:39.502443 5120 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: Get \"https://api-int.crc.testing:6443/api/v1/nodes?fieldSelector=metadata.name%3Dcrc&limit=500&resourceVersion=0\": dial tcp 38.102.83.119:6443: connect: connection refused" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Mar 16 15:31:39 crc kubenswrapper[5120]: E0316 15:31:39.542741 5120 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: Get \"https://api-int.crc.testing:6443/apis/storage.k8s.io/v1/csidrivers?limit=500&resourceVersion=0\": dial tcp 38.102.83.119:6443: connect: connection refused" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Mar 16 15:31:39 crc kubenswrapper[5120]: I0316 15:31:39.552540 5120 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: Get "https://api-int.crc.testing:6443/apis/storage.k8s.io/v1/csinodes/crc?resourceVersion=0": dial tcp 38.102.83.119:6443: connect: connection refused Mar 16 15:31:39 crc kubenswrapper[5120]: E0316 15:31:39.648853 5120 reflector.go:200] "Failed to watch" err="failed to list *v1.RuntimeClass: Get \"https://api-int.crc.testing:6443/apis/node.k8s.io/v1/runtimeclasses?limit=500&resourceVersion=0\": dial tcp 38.102.83.119:6443: connect: connection refused" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" Mar 16 15:31:39 crc kubenswrapper[5120]: I0316 15:31:39.670077 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/etcd-crc" event={"ID":"20c5c5b4bed930554494851fe3cb2b2a","Type":"ContainerStarted","Data":"dc89d721818bbb17366d6be5871fafd597c17a90308134045de4ded0a6bdf5b7"} Mar 16 15:31:39 crc kubenswrapper[5120]: I0316 15:31:39.671124 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-crc" event={"ID":"4e08c320b1e9e2405e6e0107bdf7eeb4","Type":"ContainerStarted","Data":"87cc21e206f6b12c9a00667f67e4fdb2a1ac122bce875277aa7cf7e8eb916486"} Mar 16 15:31:39 crc kubenswrapper[5120]: I0316 15:31:39.672060 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler/openshift-kube-scheduler-crc" event={"ID":"0b638b8f4bb0070e40528db779baf6a2","Type":"ContainerStarted","Data":"e629568ec4bee56d44a372aaced44cff30eae6c9bb4520724eb436ba7837c676"} Mar 16 15:31:39 crc kubenswrapper[5120]: I0316 15:31:39.673313 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/kube-controller-manager-crc" event={"ID":"9f0bc7fcb0822a2c13eb2d22cd8c0641","Type":"ContainerStarted","Data":"7849edbbb0642f8a7125ab033df37cf90621419e3fb20a1a856b741338a8166e"} Mar 16 15:31:39 crc kubenswrapper[5120]: I0316 15:31:39.674423 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-crc" event={"ID":"3a14caf222afb62aaabdc47808b6f944","Type":"ContainerStarted","Data":"29decac87470b86a68080dbdd98f5a08b124b821ed1e287c6c58ba4b0b19c6cf"} Mar 16 15:31:39 crc kubenswrapper[5120]: E0316 15:31:39.990197 5120 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.crc.testing:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/crc?timeout=10s\": dial tcp 38.102.83.119:6443: connect: connection refused" interval="1.6s" Mar 16 15:31:40 crc kubenswrapper[5120]: I0316 15:31:40.225844 5120 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 15:31:40 crc kubenswrapper[5120]: I0316 15:31:40.228415 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:31:40 crc kubenswrapper[5120]: I0316 15:31:40.228495 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:31:40 crc kubenswrapper[5120]: I0316 15:31:40.228518 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:31:40 crc kubenswrapper[5120]: I0316 15:31:40.228564 5120 kubelet_node_status.go:78] "Attempting to register node" node="crc" Mar 16 15:31:40 crc kubenswrapper[5120]: E0316 15:31:40.229291 5120 kubelet_node_status.go:110] "Unable to register node with API server" err="Post \"https://api-int.crc.testing:6443/api/v1/nodes\": dial tcp 38.102.83.119:6443: connect: connection refused" node="crc" Mar 16 15:31:40 crc kubenswrapper[5120]: I0316 15:31:40.394507 5120 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Mar 16 15:31:40 crc kubenswrapper[5120]: E0316 15:31:40.396481 5120 certificate_manager.go:596] "Failed while requesting a signed certificate from the control plane" err="cannot create certificate signing request: Post \"https://api-int.crc.testing:6443/apis/certificates.k8s.io/v1/certificatesigningrequests\": dial tcp 38.102.83.119:6443: connect: connection refused" logger="kubernetes.io/kube-apiserver-client-kubelet.UnhandledError" Mar 16 15:31:40 crc kubenswrapper[5120]: I0316 15:31:40.552419 5120 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: Get "https://api-int.crc.testing:6443/apis/storage.k8s.io/v1/csinodes/crc?resourceVersion=0": dial tcp 38.102.83.119:6443: connect: connection refused Mar 16 15:31:40 crc kubenswrapper[5120]: I0316 15:31:40.677200 5120 generic.go:358] "Generic (PLEG): container finished" podID="4e08c320b1e9e2405e6e0107bdf7eeb4" containerID="f29b9a70f88e43eb9974d1df5623a1fa5d9a8dedde8afbfc2bf5d7f591119754" exitCode=0 Mar 16 15:31:40 crc kubenswrapper[5120]: I0316 15:31:40.677274 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-crc" event={"ID":"4e08c320b1e9e2405e6e0107bdf7eeb4","Type":"ContainerDied","Data":"f29b9a70f88e43eb9974d1df5623a1fa5d9a8dedde8afbfc2bf5d7f591119754"} Mar 16 15:31:40 crc kubenswrapper[5120]: I0316 15:31:40.677353 5120 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 15:31:40 crc kubenswrapper[5120]: I0316 15:31:40.677878 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:31:40 crc kubenswrapper[5120]: I0316 15:31:40.677908 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:31:40 crc kubenswrapper[5120]: I0316 15:31:40.677918 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:31:40 crc kubenswrapper[5120]: E0316 15:31:40.678063 5120 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"crc\" not found" node="crc" Mar 16 15:31:40 crc kubenswrapper[5120]: I0316 15:31:40.678494 5120 generic.go:358] "Generic (PLEG): container finished" podID="0b638b8f4bb0070e40528db779baf6a2" containerID="1babd9d24839cdec527b6a8a3199e79c9873019d142145631c20071402b9e07b" exitCode=0 Mar 16 15:31:40 crc kubenswrapper[5120]: I0316 15:31:40.678535 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler/openshift-kube-scheduler-crc" event={"ID":"0b638b8f4bb0070e40528db779baf6a2","Type":"ContainerDied","Data":"1babd9d24839cdec527b6a8a3199e79c9873019d142145631c20071402b9e07b"} Mar 16 15:31:40 crc kubenswrapper[5120]: I0316 15:31:40.678703 5120 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 15:31:40 crc kubenswrapper[5120]: I0316 15:31:40.679781 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:31:40 crc kubenswrapper[5120]: I0316 15:31:40.679824 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:31:40 crc kubenswrapper[5120]: I0316 15:31:40.679837 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:31:40 crc kubenswrapper[5120]: E0316 15:31:40.680111 5120 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"crc\" not found" node="crc" Mar 16 15:31:40 crc kubenswrapper[5120]: I0316 15:31:40.681418 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/kube-controller-manager-crc" event={"ID":"9f0bc7fcb0822a2c13eb2d22cd8c0641","Type":"ContainerStarted","Data":"a967ad0a608deaf189b263aa37305db49ec4582e4473cc85876c69611bf94859"} Mar 16 15:31:40 crc kubenswrapper[5120]: I0316 15:31:40.681443 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/kube-controller-manager-crc" event={"ID":"9f0bc7fcb0822a2c13eb2d22cd8c0641","Type":"ContainerStarted","Data":"7504f5643c014a761ba3788ec0c344d41885c45fe4371d4a1c8d206eb7462303"} Mar 16 15:31:40 crc kubenswrapper[5120]: I0316 15:31:40.682522 5120 generic.go:358] "Generic (PLEG): container finished" podID="3a14caf222afb62aaabdc47808b6f944" containerID="b85427f55ef682dd2d839958175c21c7ee85dae9155481cb4532b8d60f907179" exitCode=0 Mar 16 15:31:40 crc kubenswrapper[5120]: I0316 15:31:40.682580 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-crc" event={"ID":"3a14caf222afb62aaabdc47808b6f944","Type":"ContainerDied","Data":"b85427f55ef682dd2d839958175c21c7ee85dae9155481cb4532b8d60f907179"} Mar 16 15:31:40 crc kubenswrapper[5120]: I0316 15:31:40.682693 5120 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 15:31:40 crc kubenswrapper[5120]: I0316 15:31:40.683175 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:31:40 crc kubenswrapper[5120]: I0316 15:31:40.683205 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:31:40 crc kubenswrapper[5120]: I0316 15:31:40.683215 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:31:40 crc kubenswrapper[5120]: E0316 15:31:40.683363 5120 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"crc\" not found" node="crc" Mar 16 15:31:40 crc kubenswrapper[5120]: I0316 15:31:40.683878 5120 generic.go:358] "Generic (PLEG): container finished" podID="20c5c5b4bed930554494851fe3cb2b2a" containerID="c354f90b6dbeb20f25a62d5ca94758bd3ff83a3540a04512e0e38546047ce163" exitCode=0 Mar 16 15:31:40 crc kubenswrapper[5120]: I0316 15:31:40.683900 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/etcd-crc" event={"ID":"20c5c5b4bed930554494851fe3cb2b2a","Type":"ContainerDied","Data":"c354f90b6dbeb20f25a62d5ca94758bd3ff83a3540a04512e0e38546047ce163"} Mar 16 15:31:40 crc kubenswrapper[5120]: I0316 15:31:40.684014 5120 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 15:31:40 crc kubenswrapper[5120]: I0316 15:31:40.684451 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:31:40 crc kubenswrapper[5120]: I0316 15:31:40.684474 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:31:40 crc kubenswrapper[5120]: I0316 15:31:40.684484 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:31:40 crc kubenswrapper[5120]: E0316 15:31:40.684665 5120 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"crc\" not found" node="crc" Mar 16 15:31:40 crc kubenswrapper[5120]: I0316 15:31:40.685333 5120 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 15:31:40 crc kubenswrapper[5120]: I0316 15:31:40.686288 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:31:40 crc kubenswrapper[5120]: I0316 15:31:40.686340 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:31:40 crc kubenswrapper[5120]: I0316 15:31:40.686355 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:31:41 crc kubenswrapper[5120]: E0316 15:31:41.300293 5120 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: Get \"https://api-int.crc.testing:6443/api/v1/nodes?fieldSelector=metadata.name%3Dcrc&limit=500&resourceVersion=0\": dial tcp 38.102.83.119:6443: connect: connection refused" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Mar 16 15:31:41 crc kubenswrapper[5120]: I0316 15:31:41.552175 5120 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: Get "https://api-int.crc.testing:6443/apis/storage.k8s.io/v1/csinodes/crc?resourceVersion=0": dial tcp 38.102.83.119:6443: connect: connection refused Mar 16 15:31:41 crc kubenswrapper[5120]: E0316 15:31:41.592086 5120 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.crc.testing:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/crc?timeout=10s\": dial tcp 38.102.83.119:6443: connect: connection refused" interval="3.2s" Mar 16 15:31:41 crc kubenswrapper[5120]: I0316 15:31:41.687345 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler/openshift-kube-scheduler-crc" event={"ID":"0b638b8f4bb0070e40528db779baf6a2","Type":"ContainerStarted","Data":"4a50a05848f60742e019ce9e1bf49eea184f5b902104fdffb5fdadf58dba96c5"} Mar 16 15:31:41 crc kubenswrapper[5120]: I0316 15:31:41.687395 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler/openshift-kube-scheduler-crc" event={"ID":"0b638b8f4bb0070e40528db779baf6a2","Type":"ContainerStarted","Data":"38e68a2bfa842d6a1eccbc4776fe556a03f1dc2daf3d9113332ac776691012aa"} Mar 16 15:31:41 crc kubenswrapper[5120]: I0316 15:31:41.687409 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler/openshift-kube-scheduler-crc" event={"ID":"0b638b8f4bb0070e40528db779baf6a2","Type":"ContainerStarted","Data":"da7bbd2b17a31792a198b13e91d00d2abf8aca649a814a8a545399060a71dc48"} Mar 16 15:31:41 crc kubenswrapper[5120]: I0316 15:31:41.687552 5120 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 15:31:41 crc kubenswrapper[5120]: I0316 15:31:41.688173 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:31:41 crc kubenswrapper[5120]: I0316 15:31:41.688206 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:31:41 crc kubenswrapper[5120]: I0316 15:31:41.688218 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:31:41 crc kubenswrapper[5120]: E0316 15:31:41.688398 5120 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"crc\" not found" node="crc" Mar 16 15:31:41 crc kubenswrapper[5120]: I0316 15:31:41.690235 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/kube-controller-manager-crc" event={"ID":"9f0bc7fcb0822a2c13eb2d22cd8c0641","Type":"ContainerStarted","Data":"7b881cb757e8a98a2bfe4eaba13851ed363266c8ca4431adae747bcc7a432d6f"} Mar 16 15:31:41 crc kubenswrapper[5120]: I0316 15:31:41.690267 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/kube-controller-manager-crc" event={"ID":"9f0bc7fcb0822a2c13eb2d22cd8c0641","Type":"ContainerStarted","Data":"089b049fab9a81fee365aca65e87bbcba69fdb197579238170db8ea568e894e7"} Mar 16 15:31:41 crc kubenswrapper[5120]: I0316 15:31:41.690366 5120 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 15:31:41 crc kubenswrapper[5120]: I0316 15:31:41.691014 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:31:41 crc kubenswrapper[5120]: I0316 15:31:41.691038 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:31:41 crc kubenswrapper[5120]: I0316 15:31:41.691050 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:31:41 crc kubenswrapper[5120]: E0316 15:31:41.691193 5120 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"crc\" not found" node="crc" Mar 16 15:31:41 crc kubenswrapper[5120]: I0316 15:31:41.694111 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-crc" event={"ID":"3a14caf222afb62aaabdc47808b6f944","Type":"ContainerStarted","Data":"2927b83983005f4c3d99da754665655d8138a8e829cf2b9274040dfbec74fab7"} Mar 16 15:31:41 crc kubenswrapper[5120]: I0316 15:31:41.694141 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-crc" event={"ID":"3a14caf222afb62aaabdc47808b6f944","Type":"ContainerStarted","Data":"28d3d4773246e29999a9a1edc877e703ed6476a59e6aef47ac34c6a3991c767a"} Mar 16 15:31:41 crc kubenswrapper[5120]: I0316 15:31:41.694154 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-crc" event={"ID":"3a14caf222afb62aaabdc47808b6f944","Type":"ContainerStarted","Data":"508f48da0745e92959e2d1557a5130e812920972548cfb726debf24c10a91ceb"} Mar 16 15:31:41 crc kubenswrapper[5120]: I0316 15:31:41.695432 5120 generic.go:358] "Generic (PLEG): container finished" podID="20c5c5b4bed930554494851fe3cb2b2a" containerID="8ddb1a120ac261ba2c1f857a551235412dcfed490e8524a7d3fc53d4568ba54b" exitCode=0 Mar 16 15:31:41 crc kubenswrapper[5120]: I0316 15:31:41.695484 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/etcd-crc" event={"ID":"20c5c5b4bed930554494851fe3cb2b2a","Type":"ContainerDied","Data":"8ddb1a120ac261ba2c1f857a551235412dcfed490e8524a7d3fc53d4568ba54b"} Mar 16 15:31:41 crc kubenswrapper[5120]: I0316 15:31:41.695601 5120 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 15:31:41 crc kubenswrapper[5120]: I0316 15:31:41.696123 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:31:41 crc kubenswrapper[5120]: I0316 15:31:41.696152 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:31:41 crc kubenswrapper[5120]: I0316 15:31:41.696163 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:31:41 crc kubenswrapper[5120]: E0316 15:31:41.696341 5120 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"crc\" not found" node="crc" Mar 16 15:31:41 crc kubenswrapper[5120]: I0316 15:31:41.698353 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-crc" event={"ID":"4e08c320b1e9e2405e6e0107bdf7eeb4","Type":"ContainerStarted","Data":"d9489b47395eac8078038aa9b5cf79964b0730a908fae78a1e451f5e298d904b"} Mar 16 15:31:41 crc kubenswrapper[5120]: I0316 15:31:41.698448 5120 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 15:31:41 crc kubenswrapper[5120]: I0316 15:31:41.699137 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:31:41 crc kubenswrapper[5120]: I0316 15:31:41.699176 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:31:41 crc kubenswrapper[5120]: I0316 15:31:41.699186 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:31:41 crc kubenswrapper[5120]: E0316 15:31:41.699405 5120 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"crc\" not found" node="crc" Mar 16 15:31:41 crc kubenswrapper[5120]: E0316 15:31:41.755575 5120 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: Get \"https://api-int.crc.testing:6443/api/v1/services?fieldSelector=spec.clusterIP%21%3DNone&limit=500&resourceVersion=0\": dial tcp 38.102.83.119:6443: connect: connection refused" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Mar 16 15:31:41 crc kubenswrapper[5120]: I0316 15:31:41.830870 5120 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 15:31:41 crc kubenswrapper[5120]: I0316 15:31:41.833305 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:31:41 crc kubenswrapper[5120]: I0316 15:31:41.833402 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:31:41 crc kubenswrapper[5120]: I0316 15:31:41.833423 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:31:41 crc kubenswrapper[5120]: I0316 15:31:41.833458 5120 kubelet_node_status.go:78] "Attempting to register node" node="crc" Mar 16 15:31:41 crc kubenswrapper[5120]: E0316 15:31:41.834287 5120 kubelet_node_status.go:110] "Unable to register node with API server" err="Post \"https://api-int.crc.testing:6443/api/v1/nodes\": dial tcp 38.102.83.119:6443: connect: connection refused" node="crc" Mar 16 15:31:42 crc kubenswrapper[5120]: E0316 15:31:42.018642 5120 reflector.go:200] "Failed to watch" err="failed to list *v1.RuntimeClass: Get \"https://api-int.crc.testing:6443/apis/node.k8s.io/v1/runtimeclasses?limit=500&resourceVersion=0\": dial tcp 38.102.83.119:6443: connect: connection refused" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" Mar 16 15:31:42 crc kubenswrapper[5120]: I0316 15:31:42.706415 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-crc" event={"ID":"3a14caf222afb62aaabdc47808b6f944","Type":"ContainerStarted","Data":"302a5e28a1d8e89b0354c6586e3251d5f6b206cad5950d866e84ad6b560851ad"} Mar 16 15:31:42 crc kubenswrapper[5120]: I0316 15:31:42.706495 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-crc" event={"ID":"3a14caf222afb62aaabdc47808b6f944","Type":"ContainerStarted","Data":"93d46439f5f39d1e67f6df04e1bfc9dfc0f6d7fcdf6fbe4cce94455dd460c163"} Mar 16 15:31:42 crc kubenswrapper[5120]: I0316 15:31:42.706652 5120 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 15:31:42 crc kubenswrapper[5120]: I0316 15:31:42.707842 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:31:42 crc kubenswrapper[5120]: I0316 15:31:42.707919 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:31:42 crc kubenswrapper[5120]: I0316 15:31:42.707948 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:31:42 crc kubenswrapper[5120]: E0316 15:31:42.708522 5120 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"crc\" not found" node="crc" Mar 16 15:31:42 crc kubenswrapper[5120]: I0316 15:31:42.710069 5120 generic.go:358] "Generic (PLEG): container finished" podID="20c5c5b4bed930554494851fe3cb2b2a" containerID="8286e76226838b95f57c216d021c120eb867e6991c697ec6cede61970ccab703" exitCode=0 Mar 16 15:31:42 crc kubenswrapper[5120]: I0316 15:31:42.710303 5120 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 15:31:42 crc kubenswrapper[5120]: I0316 15:31:42.710354 5120 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Mar 16 15:31:42 crc kubenswrapper[5120]: I0316 15:31:42.710399 5120 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 15:31:42 crc kubenswrapper[5120]: I0316 15:31:42.710417 5120 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 15:31:42 crc kubenswrapper[5120]: I0316 15:31:42.710307 5120 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 15:31:42 crc kubenswrapper[5120]: I0316 15:31:42.710326 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/etcd-crc" event={"ID":"20c5c5b4bed930554494851fe3cb2b2a","Type":"ContainerDied","Data":"8286e76226838b95f57c216d021c120eb867e6991c697ec6cede61970ccab703"} Mar 16 15:31:42 crc kubenswrapper[5120]: I0316 15:31:42.711267 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:31:42 crc kubenswrapper[5120]: I0316 15:31:42.711302 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:31:42 crc kubenswrapper[5120]: I0316 15:31:42.711313 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:31:42 crc kubenswrapper[5120]: I0316 15:31:42.711386 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:31:42 crc kubenswrapper[5120]: I0316 15:31:42.711421 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:31:42 crc kubenswrapper[5120]: I0316 15:31:42.711441 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:31:42 crc kubenswrapper[5120]: I0316 15:31:42.711461 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:31:42 crc kubenswrapper[5120]: I0316 15:31:42.711470 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:31:42 crc kubenswrapper[5120]: I0316 15:31:42.711498 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:31:42 crc kubenswrapper[5120]: I0316 15:31:42.711396 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:31:42 crc kubenswrapper[5120]: I0316 15:31:42.711583 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:31:42 crc kubenswrapper[5120]: I0316 15:31:42.711607 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:31:42 crc kubenswrapper[5120]: E0316 15:31:42.711616 5120 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"crc\" not found" node="crc" Mar 16 15:31:42 crc kubenswrapper[5120]: E0316 15:31:42.711920 5120 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"crc\" not found" node="crc" Mar 16 15:31:42 crc kubenswrapper[5120]: E0316 15:31:42.712050 5120 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"crc\" not found" node="crc" Mar 16 15:31:42 crc kubenswrapper[5120]: E0316 15:31:42.712367 5120 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"crc\" not found" node="crc" Mar 16 15:31:43 crc kubenswrapper[5120]: I0316 15:31:43.530410 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-kube-apiserver/kube-apiserver-crc" Mar 16 15:31:43 crc kubenswrapper[5120]: I0316 15:31:43.719424 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/etcd-crc" event={"ID":"20c5c5b4bed930554494851fe3cb2b2a","Type":"ContainerStarted","Data":"f48cd7f620741373f776ce8314bdaf2ff4145d9170a8c294eea39c769c3ebd2a"} Mar 16 15:31:43 crc kubenswrapper[5120]: I0316 15:31:43.719494 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/etcd-crc" event={"ID":"20c5c5b4bed930554494851fe3cb2b2a","Type":"ContainerStarted","Data":"da5bbbf51b1e614b75c1543034114f2e1e9f8fc1efd7d6923496dd445194cb22"} Mar 16 15:31:43 crc kubenswrapper[5120]: I0316 15:31:43.719512 5120 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Mar 16 15:31:43 crc kubenswrapper[5120]: I0316 15:31:43.719572 5120 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 15:31:43 crc kubenswrapper[5120]: I0316 15:31:43.719513 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/etcd-crc" event={"ID":"20c5c5b4bed930554494851fe3cb2b2a","Type":"ContainerStarted","Data":"f85d3d869320f76bbbd1bf2ac6b7a3ac9a62d2bfad7fee06123b78ce62f50406"} Mar 16 15:31:43 crc kubenswrapper[5120]: I0316 15:31:43.719669 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/etcd-crc" event={"ID":"20c5c5b4bed930554494851fe3cb2b2a","Type":"ContainerStarted","Data":"12c707c6a49d9d6d8c45539c70ce5d61ce3c69e71abcbc95c0f2725b475b28ca"} Mar 16 15:31:43 crc kubenswrapper[5120]: I0316 15:31:43.720124 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:31:43 crc kubenswrapper[5120]: I0316 15:31:43.720164 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:31:43 crc kubenswrapper[5120]: I0316 15:31:43.720177 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:31:43 crc kubenswrapper[5120]: E0316 15:31:43.720637 5120 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"crc\" not found" node="crc" Mar 16 15:31:43 crc kubenswrapper[5120]: I0316 15:31:43.916413 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-kube-controller-manager/kube-controller-manager-crc" Mar 16 15:31:43 crc kubenswrapper[5120]: I0316 15:31:43.916667 5120 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 15:31:43 crc kubenswrapper[5120]: I0316 15:31:43.917930 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:31:43 crc kubenswrapper[5120]: I0316 15:31:43.917990 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:31:43 crc kubenswrapper[5120]: I0316 15:31:43.918009 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:31:43 crc kubenswrapper[5120]: E0316 15:31:43.918466 5120 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"crc\" not found" node="crc" Mar 16 15:31:44 crc kubenswrapper[5120]: I0316 15:31:44.100258 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-kube-controller-manager/kube-controller-manager-crc" Mar 16 15:31:44 crc kubenswrapper[5120]: I0316 15:31:44.112867 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-kube-controller-manager/kube-controller-manager-crc" Mar 16 15:31:44 crc kubenswrapper[5120]: I0316 15:31:44.382284 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-kube-scheduler/openshift-kube-scheduler-crc" Mar 16 15:31:44 crc kubenswrapper[5120]: I0316 15:31:44.382638 5120 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 15:31:44 crc kubenswrapper[5120]: I0316 15:31:44.383751 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:31:44 crc kubenswrapper[5120]: I0316 15:31:44.383809 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:31:44 crc kubenswrapper[5120]: I0316 15:31:44.383821 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:31:44 crc kubenswrapper[5120]: E0316 15:31:44.384154 5120 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"crc\" not found" node="crc" Mar 16 15:31:44 crc kubenswrapper[5120]: I0316 15:31:44.598148 5120 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Mar 16 15:31:44 crc kubenswrapper[5120]: I0316 15:31:44.725421 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/etcd-crc" event={"ID":"20c5c5b4bed930554494851fe3cb2b2a","Type":"ContainerStarted","Data":"632e67eb05383c65bb6faab55bac99af4275f8c6791f8f05ce627da856d54de8"} Mar 16 15:31:44 crc kubenswrapper[5120]: I0316 15:31:44.725508 5120 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Mar 16 15:31:44 crc kubenswrapper[5120]: I0316 15:31:44.725548 5120 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 15:31:44 crc kubenswrapper[5120]: I0316 15:31:44.725580 5120 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 15:31:44 crc kubenswrapper[5120]: I0316 15:31:44.725593 5120 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 15:31:44 crc kubenswrapper[5120]: I0316 15:31:44.725677 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-kube-controller-manager/kube-controller-manager-crc" Mar 16 15:31:44 crc kubenswrapper[5120]: I0316 15:31:44.726170 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:31:44 crc kubenswrapper[5120]: I0316 15:31:44.726228 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:31:44 crc kubenswrapper[5120]: I0316 15:31:44.726253 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:31:44 crc kubenswrapper[5120]: I0316 15:31:44.726265 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:31:44 crc kubenswrapper[5120]: I0316 15:31:44.726282 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:31:44 crc kubenswrapper[5120]: I0316 15:31:44.726290 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:31:44 crc kubenswrapper[5120]: I0316 15:31:44.726296 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:31:44 crc kubenswrapper[5120]: I0316 15:31:44.726341 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:31:44 crc kubenswrapper[5120]: I0316 15:31:44.726361 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:31:44 crc kubenswrapper[5120]: E0316 15:31:44.726923 5120 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"crc\" not found" node="crc" Mar 16 15:31:44 crc kubenswrapper[5120]: E0316 15:31:44.726954 5120 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"crc\" not found" node="crc" Mar 16 15:31:44 crc kubenswrapper[5120]: E0316 15:31:44.727081 5120 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"crc\" not found" node="crc" Mar 16 15:31:45 crc kubenswrapper[5120]: I0316 15:31:45.035192 5120 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 15:31:45 crc kubenswrapper[5120]: I0316 15:31:45.036273 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:31:45 crc kubenswrapper[5120]: I0316 15:31:45.036333 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:31:45 crc kubenswrapper[5120]: I0316 15:31:45.036352 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:31:45 crc kubenswrapper[5120]: I0316 15:31:45.036387 5120 kubelet_node_status.go:78] "Attempting to register node" node="crc" Mar 16 15:31:45 crc kubenswrapper[5120]: I0316 15:31:45.575723 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-etcd/etcd-crc" Mar 16 15:31:45 crc kubenswrapper[5120]: I0316 15:31:45.698941 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-kube-apiserver/kube-apiserver-crc" Mar 16 15:31:45 crc kubenswrapper[5120]: I0316 15:31:45.729349 5120 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 15:31:45 crc kubenswrapper[5120]: I0316 15:31:45.729524 5120 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 15:31:45 crc kubenswrapper[5120]: I0316 15:31:45.729655 5120 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 15:31:45 crc kubenswrapper[5120]: I0316 15:31:45.732158 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:31:45 crc kubenswrapper[5120]: I0316 15:31:45.732213 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:31:45 crc kubenswrapper[5120]: I0316 15:31:45.732252 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:31:45 crc kubenswrapper[5120]: I0316 15:31:45.732277 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:31:45 crc kubenswrapper[5120]: I0316 15:31:45.732290 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:31:45 crc kubenswrapper[5120]: I0316 15:31:45.732320 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:31:45 crc kubenswrapper[5120]: I0316 15:31:45.732175 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:31:45 crc kubenswrapper[5120]: I0316 15:31:45.732388 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:31:45 crc kubenswrapper[5120]: I0316 15:31:45.732409 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:31:45 crc kubenswrapper[5120]: E0316 15:31:45.733690 5120 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"crc\" not found" node="crc" Mar 16 15:31:45 crc kubenswrapper[5120]: E0316 15:31:45.735276 5120 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"crc\" not found" node="crc" Mar 16 15:31:45 crc kubenswrapper[5120]: E0316 15:31:45.738147 5120 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"crc\" not found" node="crc" Mar 16 15:31:46 crc kubenswrapper[5120]: I0316 15:31:46.732540 5120 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 15:31:46 crc kubenswrapper[5120]: I0316 15:31:46.733544 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:31:46 crc kubenswrapper[5120]: I0316 15:31:46.733618 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:31:46 crc kubenswrapper[5120]: I0316 15:31:46.733638 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:31:46 crc kubenswrapper[5120]: E0316 15:31:46.734406 5120 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"crc\" not found" node="crc" Mar 16 15:31:46 crc kubenswrapper[5120]: I0316 15:31:46.894854 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-kube-apiserver/kube-apiserver-crc" Mar 16 15:31:46 crc kubenswrapper[5120]: I0316 15:31:46.895168 5120 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 15:31:46 crc kubenswrapper[5120]: I0316 15:31:46.896134 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:31:46 crc kubenswrapper[5120]: I0316 15:31:46.896204 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:31:46 crc kubenswrapper[5120]: I0316 15:31:46.896231 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:31:46 crc kubenswrapper[5120]: E0316 15:31:46.897049 5120 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"crc\" not found" node="crc" Mar 16 15:31:47 crc kubenswrapper[5120]: I0316 15:31:47.766479 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-etcd/etcd-crc" Mar 16 15:31:47 crc kubenswrapper[5120]: I0316 15:31:47.766858 5120 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 15:31:47 crc kubenswrapper[5120]: I0316 15:31:47.767834 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:31:47 crc kubenswrapper[5120]: I0316 15:31:47.767933 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:31:47 crc kubenswrapper[5120]: I0316 15:31:47.767956 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:31:47 crc kubenswrapper[5120]: E0316 15:31:47.768649 5120 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"crc\" not found" node="crc" Mar 16 15:31:48 crc kubenswrapper[5120]: E0316 15:31:48.721622 5120 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"crc\" not found" Mar 16 15:31:49 crc kubenswrapper[5120]: I0316 15:31:49.591114 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-kube-controller-manager/kube-controller-manager-crc" Mar 16 15:31:49 crc kubenswrapper[5120]: I0316 15:31:49.591395 5120 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 15:31:49 crc kubenswrapper[5120]: I0316 15:31:49.592402 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:31:49 crc kubenswrapper[5120]: I0316 15:31:49.592455 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:31:49 crc kubenswrapper[5120]: I0316 15:31:49.592475 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:31:49 crc kubenswrapper[5120]: E0316 15:31:49.593186 5120 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"crc\" not found" node="crc" Mar 16 15:31:49 crc kubenswrapper[5120]: I0316 15:31:49.597226 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-kube-controller-manager/kube-controller-manager-crc" Mar 16 15:31:49 crc kubenswrapper[5120]: I0316 15:31:49.740074 5120 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 15:31:49 crc kubenswrapper[5120]: I0316 15:31:49.740942 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:31:49 crc kubenswrapper[5120]: I0316 15:31:49.740996 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:31:49 crc kubenswrapper[5120]: I0316 15:31:49.741021 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:31:49 crc kubenswrapper[5120]: E0316 15:31:49.741511 5120 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"crc\" not found" node="crc" Mar 16 15:31:52 crc kubenswrapper[5120]: I0316 15:31:52.553406 5120 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: Get "https://api-int.crc.testing:6443/apis/storage.k8s.io/v1/csinodes/crc?resourceVersion=0": net/http: TLS handshake timeout Mar 16 15:31:52 crc kubenswrapper[5120]: I0316 15:31:52.591924 5120 patch_prober.go:28] interesting pod/kube-controller-manager-crc container/cluster-policy-controller namespace/openshift-kube-controller-manager: Startup probe status=failure output="Get \"https://localhost:10357/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" start-of-body= Mar 16 15:31:52 crc kubenswrapper[5120]: I0316 15:31:52.592004 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-kube-controller-manager/kube-controller-manager-crc" podUID="9f0bc7fcb0822a2c13eb2d22cd8c0641" containerName="cluster-policy-controller" probeResult="failure" output="Get \"https://localhost:10357/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Mar 16 15:31:52 crc kubenswrapper[5120]: I0316 15:31:52.731511 5120 trace.go:236] Trace[1941220639]: "Reflector ListAndWatch" name:k8s.io/client-go/informers/factory.go:160 (16-Mar-2026 15:31:42.729) (total time: 10001ms): Mar 16 15:31:52 crc kubenswrapper[5120]: Trace[1941220639]: ---"Objects listed" error:Get "https://api-int.crc.testing:6443/apis/storage.k8s.io/v1/csidrivers?limit=500&resourceVersion=0": net/http: TLS handshake timeout 10001ms (15:31:52.731) Mar 16 15:31:52 crc kubenswrapper[5120]: Trace[1941220639]: [10.001765628s] [10.001765628s] END Mar 16 15:31:52 crc kubenswrapper[5120]: E0316 15:31:52.731558 5120 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: Get \"https://api-int.crc.testing:6443/apis/storage.k8s.io/v1/csidrivers?limit=500&resourceVersion=0\": net/http: TLS handshake timeout" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Mar 16 15:31:53 crc kubenswrapper[5120]: I0316 15:31:53.462874 5120 patch_prober.go:28] interesting pod/kube-apiserver-crc container/kube-apiserver namespace/openshift-kube-apiserver: Startup probe status=failure output="HTTP probe failed with statuscode: 403" start-of-body={"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/livez\"","reason":"Forbidden","details":{},"code":403} Mar 16 15:31:53 crc kubenswrapper[5120]: I0316 15:31:53.462986 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-kube-apiserver/kube-apiserver-crc" podUID="3a14caf222afb62aaabdc47808b6f944" containerName="kube-apiserver" probeResult="failure" output="HTTP probe failed with statuscode: 403" Mar 16 15:31:53 crc kubenswrapper[5120]: I0316 15:31:53.473607 5120 patch_prober.go:28] interesting pod/kube-apiserver-crc container/kube-apiserver namespace/openshift-kube-apiserver: Startup probe status=failure output="HTTP probe failed with statuscode: 403" start-of-body={"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/livez\"","reason":"Forbidden","details":{},"code":403} Mar 16 15:31:53 crc kubenswrapper[5120]: I0316 15:31:53.473686 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-kube-apiserver/kube-apiserver-crc" podUID="3a14caf222afb62aaabdc47808b6f944" containerName="kube-apiserver" probeResult="failure" output="HTTP probe failed with statuscode: 403" Mar 16 15:31:54 crc kubenswrapper[5120]: E0316 15:31:54.793746 5120 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.crc.testing:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/crc?timeout=10s\": context deadline exceeded" interval="6.4s" Mar 16 15:31:56 crc kubenswrapper[5120]: I0316 15:31:56.911142 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-kube-apiserver/kube-apiserver-crc" Mar 16 15:31:56 crc kubenswrapper[5120]: I0316 15:31:56.911360 5120 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 15:31:56 crc kubenswrapper[5120]: I0316 15:31:56.912131 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:31:56 crc kubenswrapper[5120]: I0316 15:31:56.912194 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:31:56 crc kubenswrapper[5120]: I0316 15:31:56.912209 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:31:56 crc kubenswrapper[5120]: E0316 15:31:56.912586 5120 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"crc\" not found" node="crc" Mar 16 15:31:56 crc kubenswrapper[5120]: I0316 15:31:56.920813 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-kube-apiserver/kube-apiserver-crc" Mar 16 15:31:57 crc kubenswrapper[5120]: I0316 15:31:57.759456 5120 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Mar 16 15:31:57 crc kubenswrapper[5120]: I0316 15:31:57.759544 5120 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 15:31:57 crc kubenswrapper[5120]: I0316 15:31:57.760575 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:31:57 crc kubenswrapper[5120]: I0316 15:31:57.760644 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:31:57 crc kubenswrapper[5120]: I0316 15:31:57.760665 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:31:57 crc kubenswrapper[5120]: E0316 15:31:57.761313 5120 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"crc\" not found" node="crc" Mar 16 15:31:57 crc kubenswrapper[5120]: I0316 15:31:57.811023 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-etcd/etcd-crc" Mar 16 15:31:57 crc kubenswrapper[5120]: I0316 15:31:57.811322 5120 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 15:31:57 crc kubenswrapper[5120]: I0316 15:31:57.812142 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:31:57 crc kubenswrapper[5120]: I0316 15:31:57.812200 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:31:57 crc kubenswrapper[5120]: I0316 15:31:57.812215 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:31:57 crc kubenswrapper[5120]: E0316 15:31:57.812620 5120 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"crc\" not found" node="crc" Mar 16 15:31:57 crc kubenswrapper[5120]: I0316 15:31:57.825923 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-etcd/etcd-crc" Mar 16 15:31:58 crc kubenswrapper[5120]: I0316 15:31:58.469799 5120 trace.go:236] Trace[860102262]: "Reflector ListAndWatch" name:k8s.io/client-go/informers/factory.go:160 (16-Mar-2026 15:31:46.310) (total time: 12159ms): Mar 16 15:31:58 crc kubenswrapper[5120]: Trace[860102262]: ---"Objects listed" error:services is forbidden: User "system:anonymous" cannot list resource "services" in API group "" at the cluster scope 12159ms (15:31:58.469) Mar 16 15:31:58 crc kubenswrapper[5120]: Trace[860102262]: [12.15928099s] [12.15928099s] END Mar 16 15:31:58 crc kubenswrapper[5120]: E0316 15:31:58.469836 5120 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Mar 16 15:31:58 crc kubenswrapper[5120]: I0316 15:31:58.469848 5120 trace.go:236] Trace[1377888758]: "Reflector ListAndWatch" name:k8s.io/client-go/informers/factory.go:160 (16-Mar-2026 15:31:47.417) (total time: 11052ms): Mar 16 15:31:58 crc kubenswrapper[5120]: Trace[1377888758]: ---"Objects listed" error:runtimeclasses.node.k8s.io is forbidden: User "system:anonymous" cannot list resource "runtimeclasses" in API group "node.k8s.io" at the cluster scope 11052ms (15:31:58.469) Mar 16 15:31:58 crc kubenswrapper[5120]: Trace[1377888758]: [11.052315055s] [11.052315055s] END Mar 16 15:31:58 crc kubenswrapper[5120]: E0316 15:31:58.469885 5120 reflector.go:200] "Failed to watch" err="failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" Mar 16 15:31:58 crc kubenswrapper[5120]: I0316 15:31:58.469819 5120 trace.go:236] Trace[254890456]: "Reflector ListAndWatch" name:k8s.io/client-go/informers/factory.go:160 (16-Mar-2026 15:31:46.000) (total time: 12469ms): Mar 16 15:31:58 crc kubenswrapper[5120]: Trace[254890456]: ---"Objects listed" error:nodes "crc" is forbidden: User "system:anonymous" cannot list resource "nodes" in API group "" at the cluster scope 12469ms (15:31:58.469) Mar 16 15:31:58 crc kubenswrapper[5120]: Trace[254890456]: [12.469493287s] [12.469493287s] END Mar 16 15:31:58 crc kubenswrapper[5120]: E0316 15:31:58.470839 5120 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"crc\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Mar 16 15:31:58 crc kubenswrapper[5120]: E0316 15:31:58.470789 5120 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"crc\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="crc" Mar 16 15:31:58 crc kubenswrapper[5120]: E0316 15:31:58.472847 5120 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{crc.189d5c1ad58f4cde default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:crc,UID:crc,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:31:38.575686878 +0000 UTC m=+0.729618575,LastTimestamp:2026-03-16 15:31:38.575686878 +0000 UTC m=+0.729618575,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 15:31:58 crc kubenswrapper[5120]: E0316 15:31:58.474477 5120 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{crc.189d5c1adadb876d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:crc,UID:crc,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node crc status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:31:38.664568685 +0000 UTC m=+0.818500342,LastTimestamp:2026-03-16 15:31:38.664568685 +0000 UTC m=+0.818500342,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 15:31:58 crc kubenswrapper[5120]: E0316 15:31:58.479520 5120 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{crc.189d5c1adadbecea default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:crc,UID:crc,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node crc status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:31:38.664594666 +0000 UTC m=+0.818526323,LastTimestamp:2026-03-16 15:31:38.664594666 +0000 UTC m=+0.818526323,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 15:31:58 crc kubenswrapper[5120]: I0316 15:31:58.489287 5120 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Mar 16 15:31:58 crc kubenswrapper[5120]: E0316 15:31:58.489926 5120 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{crc.189d5c1adadc1922 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:crc,UID:crc,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node crc status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:31:38.664605986 +0000 UTC m=+0.818537653,LastTimestamp:2026-03-16 15:31:38.664605986 +0000 UTC m=+0.818537653,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 15:31:58 crc kubenswrapper[5120]: E0316 15:31:58.494732 5120 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{crc.189d5c1ade1bd250 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:crc,UID:crc,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeAllocatableEnforced,Message:Updated Node Allocatable limit across pods,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:31:38.719113808 +0000 UTC m=+0.873045465,LastTimestamp:2026-03-16 15:31:38.719113808 +0000 UTC m=+0.873045465,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 15:31:58 crc kubenswrapper[5120]: I0316 15:31:58.503388 5120 patch_prober.go:28] interesting pod/kube-apiserver-crc container/kube-apiserver-check-endpoints namespace/openshift-kube-apiserver: Liveness probe status=failure output="Get \"https://192.168.126.11:17697/healthz\": read tcp 192.168.126.11:58458->192.168.126.11:17697: read: connection reset by peer" start-of-body= Mar 16 15:31:58 crc kubenswrapper[5120]: I0316 15:31:58.503604 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-kube-apiserver/kube-apiserver-crc" podUID="3a14caf222afb62aaabdc47808b6f944" containerName="kube-apiserver-check-endpoints" probeResult="failure" output="Get \"https://192.168.126.11:17697/healthz\": read tcp 192.168.126.11:58458->192.168.126.11:17697: read: connection reset by peer" Mar 16 15:31:58 crc kubenswrapper[5120]: I0316 15:31:58.503426 5120 patch_prober.go:28] interesting pod/kube-apiserver-crc container/kube-apiserver-check-endpoints namespace/openshift-kube-apiserver: Readiness probe status=failure output="Get \"https://192.168.126.11:17697/healthz\": read tcp 192.168.126.11:36214->192.168.126.11:17697: read: connection reset by peer" start-of-body= Mar 16 15:31:58 crc kubenswrapper[5120]: I0316 15:31:58.503908 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-kube-apiserver/kube-apiserver-crc" podUID="3a14caf222afb62aaabdc47808b6f944" containerName="kube-apiserver-check-endpoints" probeResult="failure" output="Get \"https://192.168.126.11:17697/healthz\": read tcp 192.168.126.11:36214->192.168.126.11:17697: read: connection reset by peer" Mar 16 15:31:58 crc kubenswrapper[5120]: I0316 15:31:58.504312 5120 patch_prober.go:28] interesting pod/kube-apiserver-crc container/kube-apiserver-check-endpoints namespace/openshift-kube-apiserver: Readiness probe status=failure output="Get \"https://192.168.126.11:17697/healthz\": dial tcp 192.168.126.11:17697: connect: connection refused" start-of-body= Mar 16 15:31:58 crc kubenswrapper[5120]: I0316 15:31:58.504365 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-kube-apiserver/kube-apiserver-crc" podUID="3a14caf222afb62aaabdc47808b6f944" containerName="kube-apiserver-check-endpoints" probeResult="failure" output="Get \"https://192.168.126.11:17697/healthz\": dial tcp 192.168.126.11:17697: connect: connection refused" Mar 16 15:31:58 crc kubenswrapper[5120]: E0316 15:31:58.507264 5120 event.go:359] "Server rejected event (will not retry!)" err="events \"crc.189d5c1adadb876d\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{crc.189d5c1adadb876d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:crc,UID:crc,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node crc status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:31:38.664568685 +0000 UTC m=+0.818500342,LastTimestamp:2026-03-16 15:31:38.763683236 +0000 UTC m=+0.917614893,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 15:31:58 crc kubenswrapper[5120]: E0316 15:31:58.512052 5120 event.go:359] "Server rejected event (will not retry!)" err="events \"crc.189d5c1adadbecea\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{crc.189d5c1adadbecea default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:crc,UID:crc,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node crc status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:31:38.664594666 +0000 UTC m=+0.818526323,LastTimestamp:2026-03-16 15:31:38.763701847 +0000 UTC m=+0.917633504,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 15:31:58 crc kubenswrapper[5120]: E0316 15:31:58.517748 5120 event.go:359] "Server rejected event (will not retry!)" err="events \"crc.189d5c1adadc1922\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{crc.189d5c1adadc1922 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:crc,UID:crc,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node crc status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:31:38.664605986 +0000 UTC m=+0.818537653,LastTimestamp:2026-03-16 15:31:38.763711267 +0000 UTC m=+0.917642924,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 15:31:58 crc kubenswrapper[5120]: E0316 15:31:58.524653 5120 event.go:359] "Server rejected event (will not retry!)" err="events \"crc.189d5c1adadb876d\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{crc.189d5c1adadb876d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:crc,UID:crc,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node crc status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:31:38.664568685 +0000 UTC m=+0.818500342,LastTimestamp:2026-03-16 15:31:38.764860597 +0000 UTC m=+0.918792254,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 15:31:58 crc kubenswrapper[5120]: E0316 15:31:58.529829 5120 event.go:359] "Server rejected event (will not retry!)" err="events \"crc.189d5c1adadbecea\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{crc.189d5c1adadbecea default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:crc,UID:crc,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node crc status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:31:38.664594666 +0000 UTC m=+0.818526323,LastTimestamp:2026-03-16 15:31:38.764872358 +0000 UTC m=+0.918804015,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 15:31:58 crc kubenswrapper[5120]: E0316 15:31:58.534875 5120 event.go:359] "Server rejected event (will not retry!)" err="events \"crc.189d5c1adadc1922\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{crc.189d5c1adadc1922 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:crc,UID:crc,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node crc status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:31:38.664605986 +0000 UTC m=+0.818537653,LastTimestamp:2026-03-16 15:31:38.764880848 +0000 UTC m=+0.918812505,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 15:31:58 crc kubenswrapper[5120]: E0316 15:31:58.542018 5120 event.go:359] "Server rejected event (will not retry!)" err="events \"crc.189d5c1adadb876d\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{crc.189d5c1adadb876d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:crc,UID:crc,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node crc status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:31:38.664568685 +0000 UTC m=+0.818500342,LastTimestamp:2026-03-16 15:31:38.76555323 +0000 UTC m=+0.919484887,Count:4,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 15:31:58 crc kubenswrapper[5120]: E0316 15:31:58.547200 5120 event.go:359] "Server rejected event (will not retry!)" err="events \"crc.189d5c1adadbecea\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{crc.189d5c1adadbecea default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:crc,UID:crc,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node crc status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:31:38.664594666 +0000 UTC m=+0.818526323,LastTimestamp:2026-03-16 15:31:38.765570071 +0000 UTC m=+0.919501718,Count:4,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 15:31:58 crc kubenswrapper[5120]: E0316 15:31:58.551988 5120 event.go:359] "Server rejected event (will not retry!)" err="events \"crc.189d5c1adadc1922\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{crc.189d5c1adadc1922 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:crc,UID:crc,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node crc status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:31:38.664605986 +0000 UTC m=+0.818537653,LastTimestamp:2026-03-16 15:31:38.765580611 +0000 UTC m=+0.919512268,Count:4,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 15:31:58 crc kubenswrapper[5120]: I0316 15:31:58.556854 5120 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "crc" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Mar 16 15:31:58 crc kubenswrapper[5120]: E0316 15:31:58.556874 5120 event.go:359] "Server rejected event (will not retry!)" err="events \"crc.189d5c1adadb876d\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{crc.189d5c1adadb876d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:crc,UID:crc,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node crc status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:31:38.664568685 +0000 UTC m=+0.818500342,LastTimestamp:2026-03-16 15:31:38.765726436 +0000 UTC m=+0.919658103,Count:5,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 15:31:58 crc kubenswrapper[5120]: E0316 15:31:58.563892 5120 event.go:359] "Server rejected event (will not retry!)" err="events \"crc.189d5c1adadbecea\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{crc.189d5c1adadbecea default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:crc,UID:crc,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node crc status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:31:38.664594666 +0000 UTC m=+0.818526323,LastTimestamp:2026-03-16 15:31:38.765747537 +0000 UTC m=+0.919679204,Count:5,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 15:31:58 crc kubenswrapper[5120]: E0316 15:31:58.568439 5120 event.go:359] "Server rejected event (will not retry!)" err="events \"crc.189d5c1adadc1922\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{crc.189d5c1adadc1922 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:crc,UID:crc,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node crc status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:31:38.664605986 +0000 UTC m=+0.818537653,LastTimestamp:2026-03-16 15:31:38.765775888 +0000 UTC m=+0.919707555,Count:5,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 15:31:58 crc kubenswrapper[5120]: E0316 15:31:58.572790 5120 event.go:359] "Server rejected event (will not retry!)" err="events \"crc.189d5c1adadb876d\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{crc.189d5c1adadb876d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:crc,UID:crc,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node crc status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:31:38.664568685 +0000 UTC m=+0.818500342,LastTimestamp:2026-03-16 15:31:38.767081253 +0000 UTC m=+0.921012920,Count:6,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 15:31:58 crc kubenswrapper[5120]: E0316 15:31:58.578367 5120 event.go:359] "Server rejected event (will not retry!)" err="events \"crc.189d5c1adadbecea\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{crc.189d5c1adadbecea default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:crc,UID:crc,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node crc status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:31:38.664594666 +0000 UTC m=+0.818526323,LastTimestamp:2026-03-16 15:31:38.767108974 +0000 UTC m=+0.921040641,Count:6,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 15:31:58 crc kubenswrapper[5120]: E0316 15:31:58.586074 5120 event.go:359] "Server rejected event (will not retry!)" err="events \"crc.189d5c1adadc1922\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{crc.189d5c1adadc1922 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:crc,UID:crc,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node crc status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:31:38.664605986 +0000 UTC m=+0.818537653,LastTimestamp:2026-03-16 15:31:38.767228308 +0000 UTC m=+0.921159975,Count:6,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 15:31:58 crc kubenswrapper[5120]: E0316 15:31:58.590655 5120 event.go:359] "Server rejected event (will not retry!)" err="events \"crc.189d5c1adadb876d\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{crc.189d5c1adadb876d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:crc,UID:crc,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node crc status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:31:38.664568685 +0000 UTC m=+0.818500342,LastTimestamp:2026-03-16 15:31:38.767309791 +0000 UTC m=+0.921241448,Count:7,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 15:31:58 crc kubenswrapper[5120]: E0316 15:31:58.596419 5120 event.go:359] "Server rejected event (will not retry!)" err="events \"crc.189d5c1adadbecea\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{crc.189d5c1adadbecea default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:crc,UID:crc,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node crc status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:31:38.664594666 +0000 UTC m=+0.818526323,LastTimestamp:2026-03-16 15:31:38.767322801 +0000 UTC m=+0.921254458,Count:7,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 15:31:58 crc kubenswrapper[5120]: E0316 15:31:58.603723 5120 event.go:359] "Server rejected event (will not retry!)" err="events \"crc.189d5c1adadc1922\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{crc.189d5c1adadc1922 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:crc,UID:crc,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node crc status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:31:38.664605986 +0000 UTC m=+0.818537653,LastTimestamp:2026-03-16 15:31:38.767331482 +0000 UTC m=+0.921263139,Count:7,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 15:31:58 crc kubenswrapper[5120]: E0316 15:31:58.611393 5120 event.go:359] "Server rejected event (will not retry!)" err="events \"crc.189d5c1adadb876d\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{crc.189d5c1adadb876d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:crc,UID:crc,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node crc status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:31:38.664568685 +0000 UTC m=+0.818500342,LastTimestamp:2026-03-16 15:31:38.767374743 +0000 UTC m=+0.921306400,Count:8,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 15:31:58 crc kubenswrapper[5120]: E0316 15:31:58.616265 5120 event.go:359] "Server rejected event (will not retry!)" err="events \"crc.189d5c1adadbecea\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{crc.189d5c1adadbecea default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:crc,UID:crc,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node crc status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:31:38.664594666 +0000 UTC m=+0.818526323,LastTimestamp:2026-03-16 15:31:38.767388114 +0000 UTC m=+0.921319771,Count:8,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 15:31:58 crc kubenswrapper[5120]: E0316 15:31:58.621402 5120 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-crc.189d5c1af808c071 openshift-machine-config-operator 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-crc,UID:4e08c320b1e9e2405e6e0107bdf7eeb4,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:Pulled,Message:Container image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\" already present on machine,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:31:39.154071665 +0000 UTC m=+1.308003362,LastTimestamp:2026-03-16 15:31:39.154071665 +0000 UTC m=+1.308003362,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 15:31:58 crc kubenswrapper[5120]: E0316 15:31:58.629840 5120 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-etcd\"" event="&Event{ObjectMeta:{etcd-crc.189d5c1af8ce8340 openshift-etcd 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-etcd,Name:etcd-crc,UID:20c5c5b4bed930554494851fe3cb2b2a,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:Pulled,Message:Container image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\" already present on machine,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:31:39.167032128 +0000 UTC m=+1.320963815,LastTimestamp:2026-03-16 15:31:39.167032128 +0000 UTC m=+1.320963815,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 15:31:58 crc kubenswrapper[5120]: E0316 15:31:58.635861 5120 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-controller-manager\"" event="&Event{ObjectMeta:{kube-controller-manager-crc.189d5c1af9f83e4a openshift-kube-controller-manager 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-controller-manager,Name:kube-controller-manager-crc,UID:9f0bc7fcb0822a2c13eb2d22cd8c0641,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-controller-manager},},Reason:Pulled,Message:Container image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\" already present on machine,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:31:39.186544202 +0000 UTC m=+1.340475869,LastTimestamp:2026-03-16 15:31:39.186544202 +0000 UTC m=+1.340475869,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 15:31:58 crc kubenswrapper[5120]: E0316 15:31:58.641466 5120 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-apiserver\"" event="&Event{ObjectMeta:{kube-apiserver-crc.189d5c1af9f9ac71 openshift-kube-apiserver 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-apiserver,Name:kube-apiserver-crc,UID:3a14caf222afb62aaabdc47808b6f944,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:Pulled,Message:Container image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\" already present on machine,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:31:39.186637937 +0000 UTC m=+1.340569634,LastTimestamp:2026-03-16 15:31:39.186637937 +0000 UTC m=+1.340569634,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 15:31:58 crc kubenswrapper[5120]: E0316 15:31:58.648165 5120 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-scheduler\"" event="&Event{ObjectMeta:{openshift-kube-scheduler-crc.189d5c1afa23ceb4 openshift-kube-scheduler 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-scheduler,Name:openshift-kube-scheduler-crc,UID:0b638b8f4bb0070e40528db779baf6a2,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{wait-for-host-port},},Reason:Pulled,Message:Container image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\" already present on machine,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:31:39.18939922 +0000 UTC m=+1.343330877,LastTimestamp:2026-03-16 15:31:39.18939922 +0000 UTC m=+1.343330877,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 15:31:58 crc kubenswrapper[5120]: E0316 15:31:58.657075 5120 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-scheduler\"" event="&Event{ObjectMeta:{openshift-kube-scheduler-crc.189d5c1b1f8392a6 openshift-kube-scheduler 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-scheduler,Name:openshift-kube-scheduler-crc,UID:0b638b8f4bb0070e40528db779baf6a2,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{wait-for-host-port},},Reason:Created,Message:Created container: wait-for-host-port,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:31:39.816432294 +0000 UTC m=+1.970363951,LastTimestamp:2026-03-16 15:31:39.816432294 +0000 UTC m=+1.970363951,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 15:31:58 crc kubenswrapper[5120]: E0316 15:31:58.665292 5120 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-etcd\"" event="&Event{ObjectMeta:{etcd-crc.189d5c1b1f8f57a7 openshift-etcd 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-etcd,Name:etcd-crc,UID:20c5c5b4bed930554494851fe3cb2b2a,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:Created,Message:Created container: setup,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:31:39.817203623 +0000 UTC m=+1.971135280,LastTimestamp:2026-03-16 15:31:39.817203623 +0000 UTC m=+1.971135280,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 15:31:58 crc kubenswrapper[5120]: E0316 15:31:58.670532 5120 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-apiserver\"" event="&Event{ObjectMeta:{kube-apiserver-crc.189d5c1b1f90ed56 openshift-kube-apiserver 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-apiserver,Name:kube-apiserver-crc,UID:3a14caf222afb62aaabdc47808b6f944,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:Created,Message:Created container: setup,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:31:39.817307478 +0000 UTC m=+1.971239135,LastTimestamp:2026-03-16 15:31:39.817307478 +0000 UTC m=+1.971239135,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 15:31:58 crc kubenswrapper[5120]: E0316 15:31:58.675934 5120 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-crc.189d5c1b1f92bc69 openshift-machine-config-operator 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-crc,UID:4e08c320b1e9e2405e6e0107bdf7eeb4,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:Created,Message:Created container: setup,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:31:39.817426025 +0000 UTC m=+1.971357682,LastTimestamp:2026-03-16 15:31:39.817426025 +0000 UTC m=+1.971357682,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 15:31:58 crc kubenswrapper[5120]: E0316 15:31:58.680425 5120 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-controller-manager\"" event="&Event{ObjectMeta:{kube-controller-manager-crc.189d5c1b1f930864 openshift-kube-controller-manager 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-controller-manager,Name:kube-controller-manager-crc,UID:9f0bc7fcb0822a2c13eb2d22cd8c0641,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-controller-manager},},Reason:Created,Message:Created container: kube-controller-manager,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:31:39.817445476 +0000 UTC m=+1.971377143,LastTimestamp:2026-03-16 15:31:39.817445476 +0000 UTC m=+1.971377143,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 15:31:58 crc kubenswrapper[5120]: E0316 15:31:58.683531 5120 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-scheduler\"" event="&Event{ObjectMeta:{openshift-kube-scheduler-crc.189d5c1b202e421f openshift-kube-scheduler 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-scheduler,Name:openshift-kube-scheduler-crc,UID:0b638b8f4bb0070e40528db779baf6a2,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{wait-for-host-port},},Reason:Started,Message:Started container wait-for-host-port,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:31:39.827618335 +0000 UTC m=+1.981549982,LastTimestamp:2026-03-16 15:31:39.827618335 +0000 UTC m=+1.981549982,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 15:31:58 crc kubenswrapper[5120]: E0316 15:31:58.687455 5120 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-controller-manager\"" event="&Event{ObjectMeta:{kube-controller-manager-crc.189d5c1b20378236 openshift-kube-controller-manager 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-controller-manager,Name:kube-controller-manager-crc,UID:9f0bc7fcb0822a2c13eb2d22cd8c0641,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-controller-manager},},Reason:Started,Message:Started container kube-controller-manager,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:31:39.828224566 +0000 UTC m=+1.982156233,LastTimestamp:2026-03-16 15:31:39.828224566 +0000 UTC m=+1.982156233,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 15:31:58 crc kubenswrapper[5120]: E0316 15:31:58.688411 5120 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-apiserver\"" event="&Event{ObjectMeta:{kube-apiserver-crc.189d5c1b20482a6a openshift-kube-apiserver 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-apiserver,Name:kube-apiserver-crc,UID:3a14caf222afb62aaabdc47808b6f944,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:Started,Message:Started container setup,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:31:39.829316202 +0000 UTC m=+1.983247859,LastTimestamp:2026-03-16 15:31:39.829316202 +0000 UTC m=+1.983247859,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 15:31:58 crc kubenswrapper[5120]: E0316 15:31:58.693462 5120 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-crc.189d5c1b204ac75b openshift-machine-config-operator 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-crc,UID:4e08c320b1e9e2405e6e0107bdf7eeb4,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:Started,Message:Started container setup,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:31:39.829487451 +0000 UTC m=+1.983419108,LastTimestamp:2026-03-16 15:31:39.829487451 +0000 UTC m=+1.983419108,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 15:31:58 crc kubenswrapper[5120]: E0316 15:31:58.698421 5120 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-controller-manager\"" event="&Event{ObjectMeta:{kube-controller-manager-crc.189d5c1b204c4a68 openshift-kube-controller-manager 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-controller-manager,Name:kube-controller-manager-crc,UID:9f0bc7fcb0822a2c13eb2d22cd8c0641,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{cluster-policy-controller},},Reason:Pulled,Message:Container image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7c6a47106effd9e9a41131e2bf6c832b80cd77b3439334f760b35b0729f2fb00\" already present on machine,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:31:39.829586536 +0000 UTC m=+1.983518193,LastTimestamp:2026-03-16 15:31:39.829586536 +0000 UTC m=+1.983518193,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 15:31:58 crc kubenswrapper[5120]: E0316 15:31:58.705271 5120 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-etcd\"" event="&Event{ObjectMeta:{etcd-crc.189d5c1b2053ceb0 openshift-etcd 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-etcd,Name:etcd-crc,UID:20c5c5b4bed930554494851fe3cb2b2a,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:Started,Message:Started container setup,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:31:39.830079152 +0000 UTC m=+1.984010809,LastTimestamp:2026-03-16 15:31:39.830079152 +0000 UTC m=+1.984010809,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 15:31:58 crc kubenswrapper[5120]: E0316 15:31:58.710967 5120 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-controller-manager\"" event="&Event{ObjectMeta:{kube-controller-manager-crc.189d5c1b3607ee58 openshift-kube-controller-manager 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-controller-manager,Name:kube-controller-manager-crc,UID:9f0bc7fcb0822a2c13eb2d22cd8c0641,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{cluster-policy-controller},},Reason:Created,Message:Created container: cluster-policy-controller,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:31:40.194205272 +0000 UTC m=+2.348136969,LastTimestamp:2026-03-16 15:31:40.194205272 +0000 UTC m=+2.348136969,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 15:31:58 crc kubenswrapper[5120]: E0316 15:31:58.716639 5120 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-controller-manager\"" event="&Event{ObjectMeta:{kube-controller-manager-crc.189d5c1b36b34ae9 openshift-kube-controller-manager 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-controller-manager,Name:kube-controller-manager-crc,UID:9f0bc7fcb0822a2c13eb2d22cd8c0641,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{cluster-policy-controller},},Reason:Started,Message:Started container cluster-policy-controller,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:31:40.205435625 +0000 UTC m=+2.359367282,LastTimestamp:2026-03-16 15:31:40.205435625 +0000 UTC m=+2.359367282,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 15:31:58 crc kubenswrapper[5120]: E0316 15:31:58.721888 5120 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"crc\" not found" Mar 16 15:31:58 crc kubenswrapper[5120]: E0316 15:31:58.725806 5120 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-controller-manager\"" event="&Event{ObjectMeta:{kube-controller-manager-crc.189d5c1b36ccb2c4 openshift-kube-controller-manager 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-controller-manager,Name:kube-controller-manager-crc,UID:9f0bc7fcb0822a2c13eb2d22cd8c0641,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-controller-manager-cert-syncer},},Reason:Pulled,Message:Container image \"quay.io/crcont/openshift-crc-cluster-kube-controller-manager-operator@sha256:f69b9cc9b9cfde726109a9e12b80a3eefa472d7e29159df0fbc7143c48983cd6\" already present on machine,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:31:40.207100612 +0000 UTC m=+2.361032309,LastTimestamp:2026-03-16 15:31:40.207100612 +0000 UTC m=+2.361032309,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 15:31:58 crc kubenswrapper[5120]: E0316 15:31:58.733328 5120 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-crc.189d5c1b52efdc8e openshift-machine-config-operator 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-crc,UID:4e08c320b1e9e2405e6e0107bdf7eeb4,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-rbac-proxy-crio},},Reason:Pulled,Message:Container image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\" already present on machine,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:31:40.679167118 +0000 UTC m=+2.833098775,LastTimestamp:2026-03-16 15:31:40.679167118 +0000 UTC m=+2.833098775,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 15:31:58 crc kubenswrapper[5120]: E0316 15:31:58.738055 5120 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-scheduler\"" event="&Event{ObjectMeta:{openshift-kube-scheduler-crc.189d5c1b530f6add openshift-kube-scheduler 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-scheduler,Name:openshift-kube-scheduler-crc,UID:0b638b8f4bb0070e40528db779baf6a2,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-scheduler},},Reason:Pulled,Message:Container image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\" already present on machine,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:31:40.681235165 +0000 UTC m=+2.835166822,LastTimestamp:2026-03-16 15:31:40.681235165 +0000 UTC m=+2.835166822,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 15:31:58 crc kubenswrapper[5120]: E0316 15:31:58.743381 5120 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-controller-manager\"" event="&Event{ObjectMeta:{kube-controller-manager-crc.189d5c1b5348eb79 openshift-kube-controller-manager 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-controller-manager,Name:kube-controller-manager-crc,UID:9f0bc7fcb0822a2c13eb2d22cd8c0641,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-controller-manager-cert-syncer},},Reason:Created,Message:Created container: kube-controller-manager-cert-syncer,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:31:40.685003641 +0000 UTC m=+2.838935298,LastTimestamp:2026-03-16 15:31:40.685003641 +0000 UTC m=+2.838935298,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 15:31:58 crc kubenswrapper[5120]: E0316 15:31:58.750583 5120 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-apiserver\"" event="&Event{ObjectMeta:{kube-apiserver-crc.189d5c1b534c5fee openshift-kube-apiserver 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-apiserver,Name:kube-apiserver-crc,UID:3a14caf222afb62aaabdc47808b6f944,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-apiserver},},Reason:Pulled,Message:Container image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\" already present on machine,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:31:40.685230062 +0000 UTC m=+2.839161719,LastTimestamp:2026-03-16 15:31:40.685230062 +0000 UTC m=+2.839161719,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 15:31:58 crc kubenswrapper[5120]: E0316 15:31:58.756379 5120 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-etcd\"" event="&Event{ObjectMeta:{etcd-crc.189d5c1b5381efdb openshift-etcd 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-etcd,Name:etcd-crc,UID:20c5c5b4bed930554494851fe3cb2b2a,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{etcd-ensure-env-vars},},Reason:Pulled,Message:Container image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\" already present on machine,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:31:40.688740315 +0000 UTC m=+2.842671972,LastTimestamp:2026-03-16 15:31:40.688740315 +0000 UTC m=+2.842671972,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 15:31:58 crc kubenswrapper[5120]: I0316 15:31:58.763713 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_kube-apiserver-crc_3a14caf222afb62aaabdc47808b6f944/kube-apiserver-check-endpoints/0.log" Mar 16 15:31:58 crc kubenswrapper[5120]: E0316 15:31:58.764232 5120 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-controller-manager\"" event="&Event{ObjectMeta:{kube-controller-manager-crc.189d5c1b54519fa7 openshift-kube-controller-manager 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-controller-manager,Name:kube-controller-manager-crc,UID:9f0bc7fcb0822a2c13eb2d22cd8c0641,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-controller-manager-cert-syncer},},Reason:Started,Message:Started container kube-controller-manager-cert-syncer,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:31:40.702351271 +0000 UTC m=+2.856282928,LastTimestamp:2026-03-16 15:31:40.702351271 +0000 UTC m=+2.856282928,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 15:31:58 crc kubenswrapper[5120]: I0316 15:31:58.766104 5120 generic.go:358] "Generic (PLEG): container finished" podID="3a14caf222afb62aaabdc47808b6f944" containerID="302a5e28a1d8e89b0354c6586e3251d5f6b206cad5950d866e84ad6b560851ad" exitCode=255 Mar 16 15:31:58 crc kubenswrapper[5120]: I0316 15:31:58.766191 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-crc" event={"ID":"3a14caf222afb62aaabdc47808b6f944","Type":"ContainerDied","Data":"302a5e28a1d8e89b0354c6586e3251d5f6b206cad5950d866e84ad6b560851ad"} Mar 16 15:31:58 crc kubenswrapper[5120]: I0316 15:31:58.766362 5120 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 15:31:58 crc kubenswrapper[5120]: I0316 15:31:58.766398 5120 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 15:31:58 crc kubenswrapper[5120]: I0316 15:31:58.767197 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:31:58 crc kubenswrapper[5120]: I0316 15:31:58.767231 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:31:58 crc kubenswrapper[5120]: I0316 15:31:58.767232 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:31:58 crc kubenswrapper[5120]: I0316 15:31:58.767267 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:31:58 crc kubenswrapper[5120]: I0316 15:31:58.767281 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:31:58 crc kubenswrapper[5120]: I0316 15:31:58.767244 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:31:58 crc kubenswrapper[5120]: E0316 15:31:58.767708 5120 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"crc\" not found" node="crc" Mar 16 15:31:58 crc kubenswrapper[5120]: I0316 15:31:58.768030 5120 scope.go:117] "RemoveContainer" containerID="302a5e28a1d8e89b0354c6586e3251d5f6b206cad5950d866e84ad6b560851ad" Mar 16 15:31:58 crc kubenswrapper[5120]: E0316 15:31:58.768091 5120 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"crc\" not found" node="crc" Mar 16 15:31:58 crc kubenswrapper[5120]: E0316 15:31:58.771648 5120 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-controller-manager\"" event="&Event{ObjectMeta:{kube-controller-manager-crc.189d5c1b545c5476 openshift-kube-controller-manager 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-controller-manager,Name:kube-controller-manager-crc,UID:9f0bc7fcb0822a2c13eb2d22cd8c0641,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-controller-manager-recovery-controller},},Reason:Pulled,Message:Container image \"quay.io/crcont/openshift-crc-cluster-kube-controller-manager-operator@sha256:f69b9cc9b9cfde726109a9e12b80a3eefa472d7e29159df0fbc7143c48983cd6\" already present on machine,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:31:40.703052918 +0000 UTC m=+2.856984575,LastTimestamp:2026-03-16 15:31:40.703052918 +0000 UTC m=+2.856984575,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 15:31:58 crc kubenswrapper[5120]: E0316 15:31:58.779746 5120 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-scheduler\"" event="&Event{ObjectMeta:{openshift-kube-scheduler-crc.189d5c1b63f1f060 openshift-kube-scheduler 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-scheduler,Name:openshift-kube-scheduler-crc,UID:0b638b8f4bb0070e40528db779baf6a2,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-scheduler},},Reason:Created,Message:Created container: kube-scheduler,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:31:40.964515936 +0000 UTC m=+3.118447593,LastTimestamp:2026-03-16 15:31:40.964515936 +0000 UTC m=+3.118447593,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 15:31:58 crc kubenswrapper[5120]: E0316 15:31:58.782395 5120 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-etcd\"" event="&Event{ObjectMeta:{etcd-crc.189d5c1b63f99761 openshift-etcd 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-etcd,Name:etcd-crc,UID:20c5c5b4bed930554494851fe3cb2b2a,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{etcd-ensure-env-vars},},Reason:Created,Message:Created container: etcd-ensure-env-vars,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:31:40.965017441 +0000 UTC m=+3.118949098,LastTimestamp:2026-03-16 15:31:40.965017441 +0000 UTC m=+3.118949098,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 15:31:58 crc kubenswrapper[5120]: E0316 15:31:58.789189 5120 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-crc.189d5c1b63fb08d0 openshift-machine-config-operator 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-crc,UID:4e08c320b1e9e2405e6e0107bdf7eeb4,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-rbac-proxy-crio},},Reason:Created,Message:Created container: kube-rbac-proxy-crio,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:31:40.965112016 +0000 UTC m=+3.119043673,LastTimestamp:2026-03-16 15:31:40.965112016 +0000 UTC m=+3.119043673,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 15:31:58 crc kubenswrapper[5120]: E0316 15:31:58.795860 5120 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-apiserver\"" event="&Event{ObjectMeta:{kube-apiserver-crc.189d5c1b63fe8c1d openshift-kube-apiserver 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-apiserver,Name:kube-apiserver-crc,UID:3a14caf222afb62aaabdc47808b6f944,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-apiserver},},Reason:Created,Message:Created container: kube-apiserver,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:31:40.965342237 +0000 UTC m=+3.119273894,LastTimestamp:2026-03-16 15:31:40.965342237 +0000 UTC m=+3.119273894,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 15:31:58 crc kubenswrapper[5120]: E0316 15:31:58.804928 5120 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-controller-manager\"" event="&Event{ObjectMeta:{kube-controller-manager-crc.189d5c1b6405a26d openshift-kube-controller-manager 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-controller-manager,Name:kube-controller-manager-crc,UID:9f0bc7fcb0822a2c13eb2d22cd8c0641,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-controller-manager-recovery-controller},},Reason:Created,Message:Created container: kube-controller-manager-recovery-controller,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:31:40.965806701 +0000 UTC m=+3.119738358,LastTimestamp:2026-03-16 15:31:40.965806701 +0000 UTC m=+3.119738358,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 15:31:58 crc kubenswrapper[5120]: E0316 15:31:58.811088 5120 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-scheduler\"" event="&Event{ObjectMeta:{openshift-kube-scheduler-crc.189d5c1b64e42dbd openshift-kube-scheduler 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-scheduler,Name:openshift-kube-scheduler-crc,UID:0b638b8f4bb0070e40528db779baf6a2,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-scheduler},},Reason:Started,Message:Started container kube-scheduler,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:31:40.980391357 +0000 UTC m=+3.134323024,LastTimestamp:2026-03-16 15:31:40.980391357 +0000 UTC m=+3.134323024,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 15:31:58 crc kubenswrapper[5120]: E0316 15:31:58.815242 5120 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-scheduler\"" event="&Event{ObjectMeta:{openshift-kube-scheduler-crc.189d5c1b64f5c6a7 openshift-kube-scheduler 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-scheduler,Name:openshift-kube-scheduler-crc,UID:0b638b8f4bb0070e40528db779baf6a2,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-scheduler-cert-syncer},},Reason:Pulled,Message:Container image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e504172345491d90bbbf1e7e45488e73073f4c6d7c2355245871051596fc85db\" already present on machine,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:31:40.981544615 +0000 UTC m=+3.135476272,LastTimestamp:2026-03-16 15:31:40.981544615 +0000 UTC m=+3.135476272,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 15:31:58 crc kubenswrapper[5120]: E0316 15:31:58.820392 5120 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-apiserver\"" event="&Event{ObjectMeta:{kube-apiserver-crc.189d5c1b65347297 openshift-kube-apiserver 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-apiserver,Name:kube-apiserver-crc,UID:3a14caf222afb62aaabdc47808b6f944,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-apiserver},},Reason:Started,Message:Started container kube-apiserver,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:31:40.985651863 +0000 UTC m=+3.139583520,LastTimestamp:2026-03-16 15:31:40.985651863 +0000 UTC m=+3.139583520,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 15:31:58 crc kubenswrapper[5120]: E0316 15:31:58.824511 5120 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-crc.189d5c1b653594cc openshift-machine-config-operator 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-crc,UID:4e08c320b1e9e2405e6e0107bdf7eeb4,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-rbac-proxy-crio},},Reason:Started,Message:Started container kube-rbac-proxy-crio,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:31:40.985726156 +0000 UTC m=+3.139657813,LastTimestamp:2026-03-16 15:31:40.985726156 +0000 UTC m=+3.139657813,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 15:31:58 crc kubenswrapper[5120]: E0316 15:31:58.829439 5120 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-apiserver\"" event="&Event{ObjectMeta:{kube-apiserver-crc.189d5c1b65409292 openshift-kube-apiserver 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-apiserver,Name:kube-apiserver-crc,UID:3a14caf222afb62aaabdc47808b6f944,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-apiserver-cert-syncer},},Reason:Pulled,Message:Container image \"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\" already present on machine,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:31:40.986446482 +0000 UTC m=+3.140378139,LastTimestamp:2026-03-16 15:31:40.986446482 +0000 UTC m=+3.140378139,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 15:31:58 crc kubenswrapper[5120]: E0316 15:31:58.835086 5120 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-controller-manager\"" event="&Event{ObjectMeta:{kube-controller-manager-crc.189d5c1b654fb86d openshift-kube-controller-manager 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-controller-manager,Name:kube-controller-manager-crc,UID:9f0bc7fcb0822a2c13eb2d22cd8c0641,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-controller-manager-recovery-controller},},Reason:Started,Message:Started container kube-controller-manager-recovery-controller,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:31:40.987439213 +0000 UTC m=+3.141370870,LastTimestamp:2026-03-16 15:31:40.987439213 +0000 UTC m=+3.141370870,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 15:31:58 crc kubenswrapper[5120]: E0316 15:31:58.840495 5120 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-etcd\"" event="&Event{ObjectMeta:{etcd-crc.189d5c1b6703d6d6 openshift-etcd 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-etcd,Name:etcd-crc,UID:20c5c5b4bed930554494851fe3cb2b2a,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{etcd-ensure-env-vars},},Reason:Started,Message:Started container etcd-ensure-env-vars,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:31:41.016020694 +0000 UTC m=+3.169952351,LastTimestamp:2026-03-16 15:31:41.016020694 +0000 UTC m=+3.169952351,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 15:31:58 crc kubenswrapper[5120]: E0316 15:31:58.845421 5120 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-scheduler\"" event="&Event{ObjectMeta:{openshift-kube-scheduler-crc.189d5c1b720b5623 openshift-kube-scheduler 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-scheduler,Name:openshift-kube-scheduler-crc,UID:0b638b8f4bb0070e40528db779baf6a2,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-scheduler-cert-syncer},},Reason:Created,Message:Created container: kube-scheduler-cert-syncer,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:31:41.201061411 +0000 UTC m=+3.354993068,LastTimestamp:2026-03-16 15:31:41.201061411 +0000 UTC m=+3.354993068,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 15:31:58 crc kubenswrapper[5120]: E0316 15:31:58.850486 5120 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-apiserver\"" event="&Event{ObjectMeta:{kube-apiserver-crc.189d5c1b7230f8cd openshift-kube-apiserver 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-apiserver,Name:kube-apiserver-crc,UID:3a14caf222afb62aaabdc47808b6f944,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-apiserver-cert-syncer},},Reason:Created,Message:Created container: kube-apiserver-cert-syncer,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:31:41.203527885 +0000 UTC m=+3.357459552,LastTimestamp:2026-03-16 15:31:41.203527885 +0000 UTC m=+3.357459552,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 15:31:58 crc kubenswrapper[5120]: E0316 15:31:58.855692 5120 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-scheduler\"" event="&Event{ObjectMeta:{openshift-kube-scheduler-crc.189d5c1b72b9e4f6 openshift-kube-scheduler 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-scheduler,Name:openshift-kube-scheduler-crc,UID:0b638b8f4bb0070e40528db779baf6a2,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-scheduler-cert-syncer},},Reason:Started,Message:Started container kube-scheduler-cert-syncer,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:31:41.212501238 +0000 UTC m=+3.366432895,LastTimestamp:2026-03-16 15:31:41.212501238 +0000 UTC m=+3.366432895,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 15:31:58 crc kubenswrapper[5120]: E0316 15:31:58.860232 5120 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-scheduler\"" event="&Event{ObjectMeta:{openshift-kube-scheduler-crc.189d5c1b72d59841 openshift-kube-scheduler 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-scheduler,Name:openshift-kube-scheduler-crc,UID:0b638b8f4bb0070e40528db779baf6a2,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-scheduler-recovery-controller},},Reason:Pulled,Message:Container image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e504172345491d90bbbf1e7e45488e73073f4c6d7c2355245871051596fc85db\" already present on machine,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:31:41.214316609 +0000 UTC m=+3.368248266,LastTimestamp:2026-03-16 15:31:41.214316609 +0000 UTC m=+3.368248266,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 15:31:58 crc kubenswrapper[5120]: E0316 15:31:58.863874 5120 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-apiserver\"" event="&Event{ObjectMeta:{kube-apiserver-crc.189d5c1b72f8abd0 openshift-kube-apiserver 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-apiserver,Name:kube-apiserver-crc,UID:3a14caf222afb62aaabdc47808b6f944,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-apiserver-cert-syncer},},Reason:Started,Message:Started container kube-apiserver-cert-syncer,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:31:41.216615376 +0000 UTC m=+3.370547023,LastTimestamp:2026-03-16 15:31:41.216615376 +0000 UTC m=+3.370547023,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 15:31:58 crc kubenswrapper[5120]: E0316 15:31:58.868674 5120 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-apiserver\"" event="&Event{ObjectMeta:{kube-apiserver-crc.189d5c1b731c7a22 openshift-kube-apiserver 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-apiserver,Name:kube-apiserver-crc,UID:3a14caf222afb62aaabdc47808b6f944,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-apiserver-cert-regeneration-controller},},Reason:Pulled,Message:Container image \"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\" already present on machine,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:31:41.218961954 +0000 UTC m=+3.372893601,LastTimestamp:2026-03-16 15:31:41.218961954 +0000 UTC m=+3.372893601,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 15:31:58 crc kubenswrapper[5120]: E0316 15:31:58.873804 5120 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-apiserver\"" event="&Event{ObjectMeta:{kube-apiserver-crc.189d5c1b8184654c openshift-kube-apiserver 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-apiserver,Name:kube-apiserver-crc,UID:3a14caf222afb62aaabdc47808b6f944,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-apiserver-cert-regeneration-controller},},Reason:Created,Message:Created container: kube-apiserver-cert-regeneration-controller,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:31:41.460653388 +0000 UTC m=+3.614585045,LastTimestamp:2026-03-16 15:31:41.460653388 +0000 UTC m=+3.614585045,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 15:31:58 crc kubenswrapper[5120]: E0316 15:31:58.878942 5120 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-scheduler\"" event="&Event{ObjectMeta:{openshift-kube-scheduler-crc.189d5c1b81a0443a openshift-kube-scheduler 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-scheduler,Name:openshift-kube-scheduler-crc,UID:0b638b8f4bb0070e40528db779baf6a2,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-scheduler-recovery-controller},},Reason:Created,Message:Created container: kube-scheduler-recovery-controller,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:31:41.46247993 +0000 UTC m=+3.616411587,LastTimestamp:2026-03-16 15:31:41.46247993 +0000 UTC m=+3.616411587,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 15:31:58 crc kubenswrapper[5120]: E0316 15:31:58.885406 5120 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-apiserver\"" event="&Event{ObjectMeta:{kube-apiserver-crc.189d5c1b8286b84a openshift-kube-apiserver 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-apiserver,Name:kube-apiserver-crc,UID:3a14caf222afb62aaabdc47808b6f944,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-apiserver-cert-regeneration-controller},},Reason:Started,Message:Started container kube-apiserver-cert-regeneration-controller,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:31:41.477582922 +0000 UTC m=+3.631514579,LastTimestamp:2026-03-16 15:31:41.477582922 +0000 UTC m=+3.631514579,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 15:31:58 crc kubenswrapper[5120]: E0316 15:31:58.889691 5120 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-scheduler\"" event="&Event{ObjectMeta:{openshift-kube-scheduler-crc.189d5c1b82981390 openshift-kube-scheduler 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-scheduler,Name:openshift-kube-scheduler-crc,UID:0b638b8f4bb0070e40528db779baf6a2,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-scheduler-recovery-controller},},Reason:Started,Message:Started container kube-scheduler-recovery-controller,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:31:41.4787204 +0000 UTC m=+3.632652057,LastTimestamp:2026-03-16 15:31:41.4787204 +0000 UTC m=+3.632652057,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 15:31:58 crc kubenswrapper[5120]: E0316 15:31:58.894141 5120 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-apiserver\"" event="&Event{ObjectMeta:{kube-apiserver-crc.189d5c1b82993bca openshift-kube-apiserver 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-apiserver,Name:kube-apiserver-crc,UID:3a14caf222afb62aaabdc47808b6f944,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-apiserver-insecure-readyz},},Reason:Pulled,Message:Container image \"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\" already present on machine,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:31:41.478796234 +0000 UTC m=+3.632727891,LastTimestamp:2026-03-16 15:31:41.478796234 +0000 UTC m=+3.632727891,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 15:31:58 crc kubenswrapper[5120]: E0316 15:31:58.899548 5120 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-etcd\"" event="&Event{ObjectMeta:{etcd-crc.189d5c1b8f9dfd88 openshift-etcd 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-etcd,Name:etcd-crc,UID:20c5c5b4bed930554494851fe3cb2b2a,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{etcd-resources-copy},},Reason:Pulled,Message:Container image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\" already present on machine,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:31:41.697211784 +0000 UTC m=+3.851143451,LastTimestamp:2026-03-16 15:31:41.697211784 +0000 UTC m=+3.851143451,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 15:31:58 crc kubenswrapper[5120]: E0316 15:31:58.903870 5120 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-apiserver\"" event="&Event{ObjectMeta:{kube-apiserver-crc.189d5c1b8fb09403 openshift-kube-apiserver 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-apiserver,Name:kube-apiserver-crc,UID:3a14caf222afb62aaabdc47808b6f944,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-apiserver-insecure-readyz},},Reason:Created,Message:Created container: kube-apiserver-insecure-readyz,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:31:41.698429955 +0000 UTC m=+3.852361612,LastTimestamp:2026-03-16 15:31:41.698429955 +0000 UTC m=+3.852361612,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 15:31:58 crc kubenswrapper[5120]: E0316 15:31:58.909884 5120 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-apiserver\"" event="&Event{ObjectMeta:{kube-apiserver-crc.189d5c1b913d4a25 openshift-kube-apiserver 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-apiserver,Name:kube-apiserver-crc,UID:3a14caf222afb62aaabdc47808b6f944,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-apiserver-insecure-readyz},},Reason:Started,Message:Started container kube-apiserver-insecure-readyz,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:31:41.724428837 +0000 UTC m=+3.878360504,LastTimestamp:2026-03-16 15:31:41.724428837 +0000 UTC m=+3.878360504,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 15:31:58 crc kubenswrapper[5120]: E0316 15:31:58.914583 5120 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-apiserver\"" event="&Event{ObjectMeta:{kube-apiserver-crc.189d5c1b914b53d7 openshift-kube-apiserver 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-apiserver,Name:kube-apiserver-crc,UID:3a14caf222afb62aaabdc47808b6f944,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-apiserver-check-endpoints},},Reason:Pulled,Message:Container image \"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\" already present on machine,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:31:41.725348823 +0000 UTC m=+3.879280480,LastTimestamp:2026-03-16 15:31:41.725348823 +0000 UTC m=+3.879280480,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 15:31:58 crc kubenswrapper[5120]: E0316 15:31:58.920105 5120 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-etcd\"" event="&Event{ObjectMeta:{etcd-crc.189d5c1b9e42ea8e openshift-etcd 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-etcd,Name:etcd-crc,UID:20c5c5b4bed930554494851fe3cb2b2a,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{etcd-resources-copy},},Reason:Created,Message:Created container: etcd-resources-copy,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:31:41.94290139 +0000 UTC m=+4.096833047,LastTimestamp:2026-03-16 15:31:41.94290139 +0000 UTC m=+4.096833047,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 15:31:58 crc kubenswrapper[5120]: E0316 15:31:58.925568 5120 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-apiserver\"" event="&Event{ObjectMeta:{kube-apiserver-crc.189d5c1b9e71dc46 openshift-kube-apiserver 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-apiserver,Name:kube-apiserver-crc,UID:3a14caf222afb62aaabdc47808b6f944,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-apiserver-check-endpoints},},Reason:Created,Message:Created container: kube-apiserver-check-endpoints,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:31:41.945977926 +0000 UTC m=+4.099909583,LastTimestamp:2026-03-16 15:31:41.945977926 +0000 UTC m=+4.099909583,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 15:31:58 crc kubenswrapper[5120]: E0316 15:31:58.930376 5120 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-etcd\"" event="&Event{ObjectMeta:{etcd-crc.189d5c1b9f0d9450 openshift-etcd 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-etcd,Name:etcd-crc,UID:20c5c5b4bed930554494851fe3cb2b2a,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{etcd-resources-copy},},Reason:Started,Message:Started container etcd-resources-copy,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:31:41.95618312 +0000 UTC m=+4.110114777,LastTimestamp:2026-03-16 15:31:41.95618312 +0000 UTC m=+4.110114777,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 15:31:58 crc kubenswrapper[5120]: E0316 15:31:58.930939 5120 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Mar 16 15:31:58 crc kubenswrapper[5120]: E0316 15:31:58.934417 5120 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-apiserver\"" event="&Event{ObjectMeta:{kube-apiserver-crc.189d5c1b9f14a9c3 openshift-kube-apiserver 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-apiserver,Name:kube-apiserver-crc,UID:3a14caf222afb62aaabdc47808b6f944,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-apiserver-check-endpoints},},Reason:Started,Message:Started container kube-apiserver-check-endpoints,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:31:41.956647363 +0000 UTC m=+4.110579020,LastTimestamp:2026-03-16 15:31:41.956647363 +0000 UTC m=+4.110579020,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 15:31:58 crc kubenswrapper[5120]: E0316 15:31:58.938632 5120 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-etcd\"" event="&Event{ObjectMeta:{etcd-crc.189d5c1bcc2fa941 openshift-etcd 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-etcd,Name:etcd-crc,UID:20c5c5b4bed930554494851fe3cb2b2a,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{etcdctl},},Reason:Pulled,Message:Container image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\" already present on machine,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:31:42.713391425 +0000 UTC m=+4.867323122,LastTimestamp:2026-03-16 15:31:42.713391425 +0000 UTC m=+4.867323122,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 15:31:58 crc kubenswrapper[5120]: E0316 15:31:58.943966 5120 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-etcd\"" event="&Event{ObjectMeta:{etcd-crc.189d5c1bda877641 openshift-etcd 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-etcd,Name:etcd-crc,UID:20c5c5b4bed930554494851fe3cb2b2a,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{etcdctl},},Reason:Created,Message:Created container: etcdctl,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:31:42.954026561 +0000 UTC m=+5.107958218,LastTimestamp:2026-03-16 15:31:42.954026561 +0000 UTC m=+5.107958218,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 15:31:58 crc kubenswrapper[5120]: E0316 15:31:58.948531 5120 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-etcd\"" event="&Event{ObjectMeta:{etcd-crc.189d5c1bdb68e18b openshift-etcd 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-etcd,Name:etcd-crc,UID:20c5c5b4bed930554494851fe3cb2b2a,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{etcdctl},},Reason:Started,Message:Started container etcdctl,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:31:42.968799627 +0000 UTC m=+5.122731304,LastTimestamp:2026-03-16 15:31:42.968799627 +0000 UTC m=+5.122731304,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 15:31:58 crc kubenswrapper[5120]: E0316 15:31:58.955706 5120 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-etcd\"" event="&Event{ObjectMeta:{etcd-crc.189d5c1bdb7a10a2 openshift-etcd 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-etcd,Name:etcd-crc,UID:20c5c5b4bed930554494851fe3cb2b2a,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{etcd},},Reason:Pulled,Message:Container image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\" already present on machine,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:31:42.969925794 +0000 UTC m=+5.123857471,LastTimestamp:2026-03-16 15:31:42.969925794 +0000 UTC m=+5.123857471,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 15:31:58 crc kubenswrapper[5120]: E0316 15:31:58.963806 5120 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-etcd\"" event="&Event{ObjectMeta:{etcd-crc.189d5c1be93c27c2 openshift-etcd 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-etcd,Name:etcd-crc,UID:20c5c5b4bed930554494851fe3cb2b2a,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{etcd},},Reason:Created,Message:Created container: etcd,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:31:43.200749506 +0000 UTC m=+5.354681183,LastTimestamp:2026-03-16 15:31:43.200749506 +0000 UTC m=+5.354681183,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 15:31:58 crc kubenswrapper[5120]: E0316 15:31:58.970240 5120 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-etcd\"" event="&Event{ObjectMeta:{etcd-crc.189d5c1bea0482e5 openshift-etcd 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-etcd,Name:etcd-crc,UID:20c5c5b4bed930554494851fe3cb2b2a,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{etcd},},Reason:Started,Message:Started container etcd,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:31:43.213880037 +0000 UTC m=+5.367811694,LastTimestamp:2026-03-16 15:31:43.213880037 +0000 UTC m=+5.367811694,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 15:31:58 crc kubenswrapper[5120]: E0316 15:31:58.976036 5120 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-etcd\"" event="&Event{ObjectMeta:{etcd-crc.189d5c1bea15c750 openshift-etcd 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-etcd,Name:etcd-crc,UID:20c5c5b4bed930554494851fe3cb2b2a,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{etcd-metrics},},Reason:Pulled,Message:Container image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\" already present on machine,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:31:43.215011664 +0000 UTC m=+5.368943321,LastTimestamp:2026-03-16 15:31:43.215011664 +0000 UTC m=+5.368943321,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 15:31:58 crc kubenswrapper[5120]: E0316 15:31:58.981903 5120 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-etcd\"" event="&Event{ObjectMeta:{etcd-crc.189d5c1bf58d242b openshift-etcd 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-etcd,Name:etcd-crc,UID:20c5c5b4bed930554494851fe3cb2b2a,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{etcd-metrics},},Reason:Created,Message:Created container: etcd-metrics,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:31:43.407383595 +0000 UTC m=+5.561315262,LastTimestamp:2026-03-16 15:31:43.407383595 +0000 UTC m=+5.561315262,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 15:31:58 crc kubenswrapper[5120]: E0316 15:31:58.986295 5120 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-etcd\"" event="&Event{ObjectMeta:{etcd-crc.189d5c1bf696edbd openshift-etcd 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-etcd,Name:etcd-crc,UID:20c5c5b4bed930554494851fe3cb2b2a,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{etcd-metrics},},Reason:Started,Message:Started container etcd-metrics,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:31:43.424802237 +0000 UTC m=+5.578733904,LastTimestamp:2026-03-16 15:31:43.424802237 +0000 UTC m=+5.578733904,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 15:31:58 crc kubenswrapper[5120]: E0316 15:31:58.991232 5120 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-etcd\"" event="&Event{ObjectMeta:{etcd-crc.189d5c1bf6abc859 openshift-etcd 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-etcd,Name:etcd-crc,UID:20c5c5b4bed930554494851fe3cb2b2a,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{etcd-readyz},},Reason:Pulled,Message:Container image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf05b9b2ba66351a6c59f4259fb377f62237a00af3b4f0b95f64409e2f25770e\" already present on machine,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:31:43.426168921 +0000 UTC m=+5.580100618,LastTimestamp:2026-03-16 15:31:43.426168921 +0000 UTC m=+5.580100618,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 15:31:58 crc kubenswrapper[5120]: E0316 15:31:58.996180 5120 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-etcd\"" event="&Event{ObjectMeta:{etcd-crc.189d5c1c028c8607 openshift-etcd 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-etcd,Name:etcd-crc,UID:20c5c5b4bed930554494851fe3cb2b2a,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{etcd-readyz},},Reason:Created,Message:Created container: etcd-readyz,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:31:43.625446919 +0000 UTC m=+5.779378586,LastTimestamp:2026-03-16 15:31:43.625446919 +0000 UTC m=+5.779378586,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 15:31:59 crc kubenswrapper[5120]: E0316 15:31:59.001905 5120 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-etcd\"" event="&Event{ObjectMeta:{etcd-crc.189d5c1c0335ccc5 openshift-etcd 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-etcd,Name:etcd-crc,UID:20c5c5b4bed930554494851fe3cb2b2a,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{etcd-readyz},},Reason:Started,Message:Started container etcd-readyz,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:31:43.636540613 +0000 UTC m=+5.790472270,LastTimestamp:2026-03-16 15:31:43.636540613 +0000 UTC m=+5.790472270,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 15:31:59 crc kubenswrapper[5120]: E0316 15:31:59.005860 5120 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-etcd\"" event="&Event{ObjectMeta:{etcd-crc.189d5c1c03483738 openshift-etcd 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-etcd,Name:etcd-crc,UID:20c5c5b4bed930554494851fe3cb2b2a,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{etcd-rev},},Reason:Pulled,Message:Container image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf05b9b2ba66351a6c59f4259fb377f62237a00af3b4f0b95f64409e2f25770e\" already present on machine,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:31:43.637747512 +0000 UTC m=+5.791679159,LastTimestamp:2026-03-16 15:31:43.637747512 +0000 UTC m=+5.791679159,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 15:31:59 crc kubenswrapper[5120]: E0316 15:31:59.010425 5120 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-etcd\"" event="&Event{ObjectMeta:{etcd-crc.189d5c1c1164240e openshift-etcd 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-etcd,Name:etcd-crc,UID:20c5c5b4bed930554494851fe3cb2b2a,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{etcd-rev},},Reason:Created,Message:Created container: etcd-rev,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:31:43.874458638 +0000 UTC m=+6.028390335,LastTimestamp:2026-03-16 15:31:43.874458638 +0000 UTC m=+6.028390335,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 15:31:59 crc kubenswrapper[5120]: E0316 15:31:59.015400 5120 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-etcd\"" event="&Event{ObjectMeta:{etcd-crc.189d5c1c1287ff84 openshift-etcd 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-etcd,Name:etcd-crc,UID:20c5c5b4bed930554494851fe3cb2b2a,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{etcd-rev},},Reason:Started,Message:Started container etcd-rev,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:31:43.893585796 +0000 UTC m=+6.047517493,LastTimestamp:2026-03-16 15:31:43.893585796 +0000 UTC m=+6.047517493,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 15:31:59 crc kubenswrapper[5120]: E0316 15:31:59.023228 5120 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-controller-manager\"" event=< Mar 16 15:31:59 crc kubenswrapper[5120]: &Event{ObjectMeta:{kube-controller-manager-crc.189d5c1e18fefbd1 openshift-kube-controller-manager 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-controller-manager,Name:kube-controller-manager-crc,UID:9f0bc7fcb0822a2c13eb2d22cd8c0641,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{cluster-policy-controller},},Reason:ProbeError,Message:Startup probe error: Get "https://localhost:10357/healthz": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) Mar 16 15:31:59 crc kubenswrapper[5120]: body: Mar 16 15:31:59 crc kubenswrapper[5120]: ,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:31:52.591981521 +0000 UTC m=+14.745913188,LastTimestamp:2026-03-16 15:31:52.591981521 +0000 UTC m=+14.745913188,Count:1,Type:Warning,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,} Mar 16 15:31:59 crc kubenswrapper[5120]: > Mar 16 15:31:59 crc kubenswrapper[5120]: E0316 15:31:59.028996 5120 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-controller-manager\"" event="&Event{ObjectMeta:{kube-controller-manager-crc.189d5c1e19002b57 openshift-kube-controller-manager 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-controller-manager,Name:kube-controller-manager-crc,UID:9f0bc7fcb0822a2c13eb2d22cd8c0641,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{cluster-policy-controller},},Reason:Unhealthy,Message:Startup probe failed: Get \"https://localhost:10357/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers),Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:31:52.592059223 +0000 UTC m=+14.745990890,LastTimestamp:2026-03-16 15:31:52.592059223 +0000 UTC m=+14.745990890,Count:1,Type:Warning,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 15:31:59 crc kubenswrapper[5120]: E0316 15:31:59.033521 5120 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-apiserver\"" event=< Mar 16 15:31:59 crc kubenswrapper[5120]: &Event{ObjectMeta:{kube-apiserver-crc.189d5c1e4ce8bea6 openshift-kube-apiserver 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-apiserver,Name:kube-apiserver-crc,UID:3a14caf222afb62aaabdc47808b6f944,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-apiserver},},Reason:ProbeError,Message:Startup probe error: HTTP probe failed with statuscode: 403 Mar 16 15:31:59 crc kubenswrapper[5120]: body: {"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/livez\"","reason":"Forbidden","details":{},"code":403} Mar 16 15:31:59 crc kubenswrapper[5120]: Mar 16 15:31:59 crc kubenswrapper[5120]: ,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:31:53.462939302 +0000 UTC m=+15.616871009,LastTimestamp:2026-03-16 15:31:53.462939302 +0000 UTC m=+15.616871009,Count:1,Type:Warning,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,} Mar 16 15:31:59 crc kubenswrapper[5120]: > Mar 16 15:31:59 crc kubenswrapper[5120]: E0316 15:31:59.038396 5120 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-apiserver\"" event="&Event{ObjectMeta:{kube-apiserver-crc.189d5c1e4cea1708 openshift-kube-apiserver 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-apiserver,Name:kube-apiserver-crc,UID:3a14caf222afb62aaabdc47808b6f944,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-apiserver},},Reason:Unhealthy,Message:Startup probe failed: HTTP probe failed with statuscode: 403,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:31:53.463027464 +0000 UTC m=+15.616959161,LastTimestamp:2026-03-16 15:31:53.463027464 +0000 UTC m=+15.616959161,Count:1,Type:Warning,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 15:31:59 crc kubenswrapper[5120]: E0316 15:31:59.044611 5120 event.go:359] "Server rejected event (will not retry!)" err="events \"kube-apiserver-crc.189d5c1e4ce8bea6\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"openshift-kube-apiserver\"" event=< Mar 16 15:31:59 crc kubenswrapper[5120]: &Event{ObjectMeta:{kube-apiserver-crc.189d5c1e4ce8bea6 openshift-kube-apiserver 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-apiserver,Name:kube-apiserver-crc,UID:3a14caf222afb62aaabdc47808b6f944,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-apiserver},},Reason:ProbeError,Message:Startup probe error: HTTP probe failed with statuscode: 403 Mar 16 15:31:59 crc kubenswrapper[5120]: body: {"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/livez\"","reason":"Forbidden","details":{},"code":403} Mar 16 15:31:59 crc kubenswrapper[5120]: Mar 16 15:31:59 crc kubenswrapper[5120]: ,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:31:53.462939302 +0000 UTC m=+15.616871009,LastTimestamp:2026-03-16 15:31:53.473659632 +0000 UTC m=+15.627591309,Count:2,Type:Warning,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,} Mar 16 15:31:59 crc kubenswrapper[5120]: > Mar 16 15:31:59 crc kubenswrapper[5120]: E0316 15:31:59.049875 5120 event.go:359] "Server rejected event (will not retry!)" err="events \"kube-apiserver-crc.189d5c1e4cea1708\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"openshift-kube-apiserver\"" event="&Event{ObjectMeta:{kube-apiserver-crc.189d5c1e4cea1708 openshift-kube-apiserver 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-apiserver,Name:kube-apiserver-crc,UID:3a14caf222afb62aaabdc47808b6f944,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-apiserver},},Reason:Unhealthy,Message:Startup probe failed: HTTP probe failed with statuscode: 403,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:31:53.463027464 +0000 UTC m=+15.616959161,LastTimestamp:2026-03-16 15:31:53.473715363 +0000 UTC m=+15.627647040,Count:2,Type:Warning,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 15:31:59 crc kubenswrapper[5120]: E0316 15:31:59.055135 5120 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-apiserver\"" event=< Mar 16 15:31:59 crc kubenswrapper[5120]: &Event{ObjectMeta:{kube-apiserver-crc.189d5c1f795aa7ed openshift-kube-apiserver 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-apiserver,Name:kube-apiserver-crc,UID:3a14caf222afb62aaabdc47808b6f944,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-apiserver-check-endpoints},},Reason:ProbeError,Message:Liveness probe error: Get "https://192.168.126.11:17697/healthz": read tcp 192.168.126.11:58458->192.168.126.11:17697: read: connection reset by peer Mar 16 15:31:59 crc kubenswrapper[5120]: body: Mar 16 15:31:59 crc kubenswrapper[5120]: ,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:31:58.503569389 +0000 UTC m=+20.657501066,LastTimestamp:2026-03-16 15:31:58.503569389 +0000 UTC m=+20.657501066,Count:1,Type:Warning,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,} Mar 16 15:31:59 crc kubenswrapper[5120]: > Mar 16 15:31:59 crc kubenswrapper[5120]: E0316 15:31:59.059183 5120 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-apiserver\"" event="&Event{ObjectMeta:{kube-apiserver-crc.189d5c1f795cfc95 openshift-kube-apiserver 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-apiserver,Name:kube-apiserver-crc,UID:3a14caf222afb62aaabdc47808b6f944,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-apiserver-check-endpoints},},Reason:Unhealthy,Message:Liveness probe failed: Get \"https://192.168.126.11:17697/healthz\": read tcp 192.168.126.11:58458->192.168.126.11:17697: read: connection reset by peer,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:31:58.503722133 +0000 UTC m=+20.657653810,LastTimestamp:2026-03-16 15:31:58.503722133 +0000 UTC m=+20.657653810,Count:1,Type:Warning,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 15:31:59 crc kubenswrapper[5120]: E0316 15:31:59.064304 5120 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-apiserver\"" event=< Mar 16 15:31:59 crc kubenswrapper[5120]: &Event{ObjectMeta:{kube-apiserver-crc.189d5c1f795f9cf1 openshift-kube-apiserver 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-apiserver,Name:kube-apiserver-crc,UID:3a14caf222afb62aaabdc47808b6f944,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-apiserver-check-endpoints},},Reason:ProbeError,Message:Readiness probe error: Get "https://192.168.126.11:17697/healthz": read tcp 192.168.126.11:36214->192.168.126.11:17697: read: connection reset by peer Mar 16 15:31:59 crc kubenswrapper[5120]: body: Mar 16 15:31:59 crc kubenswrapper[5120]: ,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:31:58.503894257 +0000 UTC m=+20.657825954,LastTimestamp:2026-03-16 15:31:58.503894257 +0000 UTC m=+20.657825954,Count:1,Type:Warning,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,} Mar 16 15:31:59 crc kubenswrapper[5120]: > Mar 16 15:31:59 crc kubenswrapper[5120]: E0316 15:31:59.070465 5120 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-apiserver\"" event="&Event{ObjectMeta:{kube-apiserver-crc.189d5c1f79619217 openshift-kube-apiserver 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-apiserver,Name:kube-apiserver-crc,UID:3a14caf222afb62aaabdc47808b6f944,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-apiserver-check-endpoints},},Reason:Unhealthy,Message:Readiness probe failed: Get \"https://192.168.126.11:17697/healthz\": read tcp 192.168.126.11:36214->192.168.126.11:17697: read: connection reset by peer,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:31:58.504022551 +0000 UTC m=+20.657954228,LastTimestamp:2026-03-16 15:31:58.504022551 +0000 UTC m=+20.657954228,Count:1,Type:Warning,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 15:31:59 crc kubenswrapper[5120]: E0316 15:31:59.074982 5120 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-apiserver\"" event=< Mar 16 15:31:59 crc kubenswrapper[5120]: &Event{ObjectMeta:{kube-apiserver-crc.189d5c1f79667952 openshift-kube-apiserver 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-apiserver,Name:kube-apiserver-crc,UID:3a14caf222afb62aaabdc47808b6f944,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-apiserver-check-endpoints},},Reason:ProbeError,Message:Readiness probe error: Get "https://192.168.126.11:17697/healthz": dial tcp 192.168.126.11:17697: connect: connection refused Mar 16 15:31:59 crc kubenswrapper[5120]: body: Mar 16 15:31:59 crc kubenswrapper[5120]: ,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:31:58.50434389 +0000 UTC m=+20.658275557,LastTimestamp:2026-03-16 15:31:58.50434389 +0000 UTC m=+20.658275557,Count:1,Type:Warning,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,} Mar 16 15:31:59 crc kubenswrapper[5120]: > Mar 16 15:31:59 crc kubenswrapper[5120]: E0316 15:31:59.080597 5120 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-apiserver\"" event="&Event{ObjectMeta:{kube-apiserver-crc.189d5c1f79672317 openshift-kube-apiserver 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-apiserver,Name:kube-apiserver-crc,UID:3a14caf222afb62aaabdc47808b6f944,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-apiserver-check-endpoints},},Reason:Unhealthy,Message:Readiness probe failed: Get \"https://192.168.126.11:17697/healthz\": dial tcp 192.168.126.11:17697: connect: connection refused,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:31:58.504387351 +0000 UTC m=+20.658319018,LastTimestamp:2026-03-16 15:31:58.504387351 +0000 UTC m=+20.658319018,Count:1,Type:Warning,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 15:31:59 crc kubenswrapper[5120]: E0316 15:31:59.086679 5120 event.go:359] "Server rejected event (will not retry!)" err="events \"kube-apiserver-crc.189d5c1b914b53d7\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"openshift-kube-apiserver\"" event="&Event{ObjectMeta:{kube-apiserver-crc.189d5c1b914b53d7 openshift-kube-apiserver 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-apiserver,Name:kube-apiserver-crc,UID:3a14caf222afb62aaabdc47808b6f944,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-apiserver-check-endpoints},},Reason:Pulled,Message:Container image \"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\" already present on machine,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:31:41.725348823 +0000 UTC m=+3.879280480,LastTimestamp:2026-03-16 15:31:58.769080792 +0000 UTC m=+20.923012459,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 15:31:59 crc kubenswrapper[5120]: E0316 15:31:59.091286 5120 event.go:359] "Server rejected event (will not retry!)" err="events \"kube-apiserver-crc.189d5c1b9e71dc46\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"openshift-kube-apiserver\"" event="&Event{ObjectMeta:{kube-apiserver-crc.189d5c1b9e71dc46 openshift-kube-apiserver 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-apiserver,Name:kube-apiserver-crc,UID:3a14caf222afb62aaabdc47808b6f944,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-apiserver-check-endpoints},},Reason:Created,Message:Created container: kube-apiserver-check-endpoints,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:31:41.945977926 +0000 UTC m=+4.099909583,LastTimestamp:2026-03-16 15:31:58.975196847 +0000 UTC m=+21.129128514,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 15:31:59 crc kubenswrapper[5120]: E0316 15:31:59.096071 5120 event.go:359] "Server rejected event (will not retry!)" err="events \"kube-apiserver-crc.189d5c1b9f14a9c3\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"openshift-kube-apiserver\"" event="&Event{ObjectMeta:{kube-apiserver-crc.189d5c1b9f14a9c3 openshift-kube-apiserver 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-apiserver,Name:kube-apiserver-crc,UID:3a14caf222afb62aaabdc47808b6f944,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-apiserver-check-endpoints},},Reason:Started,Message:Started container kube-apiserver-check-endpoints,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:31:41.956647363 +0000 UTC m=+4.110579020,LastTimestamp:2026-03-16 15:31:58.985336971 +0000 UTC m=+21.139268638,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 15:31:59 crc kubenswrapper[5120]: I0316 15:31:59.556219 5120 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "crc" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Mar 16 15:31:59 crc kubenswrapper[5120]: I0316 15:31:59.594710 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-kube-controller-manager/kube-controller-manager-crc" Mar 16 15:31:59 crc kubenswrapper[5120]: I0316 15:31:59.594935 5120 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 15:31:59 crc kubenswrapper[5120]: I0316 15:31:59.598942 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:31:59 crc kubenswrapper[5120]: I0316 15:31:59.598978 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:31:59 crc kubenswrapper[5120]: I0316 15:31:59.598987 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:31:59 crc kubenswrapper[5120]: E0316 15:31:59.599323 5120 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"crc\" not found" node="crc" Mar 16 15:31:59 crc kubenswrapper[5120]: I0316 15:31:59.599891 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-kube-controller-manager/kube-controller-manager-crc" Mar 16 15:31:59 crc kubenswrapper[5120]: I0316 15:31:59.771026 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_kube-apiserver-crc_3a14caf222afb62aaabdc47808b6f944/kube-apiserver-check-endpoints/1.log" Mar 16 15:31:59 crc kubenswrapper[5120]: I0316 15:31:59.771487 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_kube-apiserver-crc_3a14caf222afb62aaabdc47808b6f944/kube-apiserver-check-endpoints/0.log" Mar 16 15:31:59 crc kubenswrapper[5120]: I0316 15:31:59.772745 5120 generic.go:358] "Generic (PLEG): container finished" podID="3a14caf222afb62aaabdc47808b6f944" containerID="3091f35b2fa10347fdad42936109c50f90d8ed7cf3ef43a897522e8cd8069db1" exitCode=255 Mar 16 15:31:59 crc kubenswrapper[5120]: I0316 15:31:59.772779 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-crc" event={"ID":"3a14caf222afb62aaabdc47808b6f944","Type":"ContainerDied","Data":"3091f35b2fa10347fdad42936109c50f90d8ed7cf3ef43a897522e8cd8069db1"} Mar 16 15:31:59 crc kubenswrapper[5120]: I0316 15:31:59.772834 5120 scope.go:117] "RemoveContainer" containerID="302a5e28a1d8e89b0354c6586e3251d5f6b206cad5950d866e84ad6b560851ad" Mar 16 15:31:59 crc kubenswrapper[5120]: I0316 15:31:59.772944 5120 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 15:31:59 crc kubenswrapper[5120]: I0316 15:31:59.772994 5120 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 15:31:59 crc kubenswrapper[5120]: I0316 15:31:59.773419 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:31:59 crc kubenswrapper[5120]: I0316 15:31:59.773451 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:31:59 crc kubenswrapper[5120]: I0316 15:31:59.773461 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:31:59 crc kubenswrapper[5120]: I0316 15:31:59.773468 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:31:59 crc kubenswrapper[5120]: I0316 15:31:59.773488 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:31:59 crc kubenswrapper[5120]: I0316 15:31:59.773498 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:31:59 crc kubenswrapper[5120]: E0316 15:31:59.773736 5120 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"crc\" not found" node="crc" Mar 16 15:31:59 crc kubenswrapper[5120]: E0316 15:31:59.774011 5120 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"crc\" not found" node="crc" Mar 16 15:31:59 crc kubenswrapper[5120]: I0316 15:31:59.774239 5120 scope.go:117] "RemoveContainer" containerID="3091f35b2fa10347fdad42936109c50f90d8ed7cf3ef43a897522e8cd8069db1" Mar 16 15:31:59 crc kubenswrapper[5120]: E0316 15:31:59.774448 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-apiserver-check-endpoints\" with CrashLoopBackOff: \"back-off 10s restarting failed container=kube-apiserver-check-endpoints pod=kube-apiserver-crc_openshift-kube-apiserver(3a14caf222afb62aaabdc47808b6f944)\"" pod="openshift-kube-apiserver/kube-apiserver-crc" podUID="3a14caf222afb62aaabdc47808b6f944" Mar 16 15:31:59 crc kubenswrapper[5120]: E0316 15:31:59.778273 5120 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-apiserver\"" event="&Event{ObjectMeta:{kube-apiserver-crc.189d5c1fc519e31d openshift-kube-apiserver 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-apiserver,Name:kube-apiserver-crc,UID:3a14caf222afb62aaabdc47808b6f944,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-apiserver-check-endpoints},},Reason:BackOff,Message:Back-off restarting failed container kube-apiserver-check-endpoints in pod kube-apiserver-crc_openshift-kube-apiserver(3a14caf222afb62aaabdc47808b6f944),Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:31:59.774393117 +0000 UTC m=+21.928324774,LastTimestamp:2026-03-16 15:31:59.774393117 +0000 UTC m=+21.928324774,Count:1,Type:Warning,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 15:32:00 crc kubenswrapper[5120]: I0316 15:32:00.558121 5120 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "crc" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Mar 16 15:32:00 crc kubenswrapper[5120]: I0316 15:32:00.778237 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_kube-apiserver-crc_3a14caf222afb62aaabdc47808b6f944/kube-apiserver-check-endpoints/1.log" Mar 16 15:32:01 crc kubenswrapper[5120]: E0316 15:32:01.200371 5120 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"crc\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="7s" Mar 16 15:32:01 crc kubenswrapper[5120]: I0316 15:32:01.556338 5120 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "crc" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Mar 16 15:32:02 crc kubenswrapper[5120]: I0316 15:32:02.559990 5120 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "crc" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Mar 16 15:32:03 crc kubenswrapper[5120]: I0316 15:32:03.558450 5120 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "crc" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Mar 16 15:32:04 crc kubenswrapper[5120]: I0316 15:32:04.557846 5120 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "crc" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Mar 16 15:32:04 crc kubenswrapper[5120]: I0316 15:32:04.871683 5120 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 15:32:04 crc kubenswrapper[5120]: I0316 15:32:04.872699 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:32:04 crc kubenswrapper[5120]: I0316 15:32:04.872744 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:32:04 crc kubenswrapper[5120]: I0316 15:32:04.872771 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:32:04 crc kubenswrapper[5120]: I0316 15:32:04.872791 5120 kubelet_node_status.go:78] "Attempting to register node" node="crc" Mar 16 15:32:04 crc kubenswrapper[5120]: E0316 15:32:04.885390 5120 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"crc\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="crc" Mar 16 15:32:04 crc kubenswrapper[5120]: E0316 15:32:04.946978 5120 reflector.go:200] "Failed to watch" err="failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" Mar 16 15:32:05 crc kubenswrapper[5120]: E0316 15:32:05.505948 5120 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Mar 16 15:32:05 crc kubenswrapper[5120]: I0316 15:32:05.553752 5120 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "crc" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Mar 16 15:32:05 crc kubenswrapper[5120]: E0316 15:32:05.785184 5120 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Mar 16 15:32:06 crc kubenswrapper[5120]: I0316 15:32:06.559032 5120 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "crc" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Mar 16 15:32:07 crc kubenswrapper[5120]: I0316 15:32:07.560028 5120 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "crc" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Mar 16 15:32:08 crc kubenswrapper[5120]: I0316 15:32:08.087197 5120 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-kube-apiserver/kube-apiserver-crc" Mar 16 15:32:08 crc kubenswrapper[5120]: I0316 15:32:08.087395 5120 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 15:32:08 crc kubenswrapper[5120]: I0316 15:32:08.088213 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:32:08 crc kubenswrapper[5120]: I0316 15:32:08.088267 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:32:08 crc kubenswrapper[5120]: I0316 15:32:08.088281 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:32:08 crc kubenswrapper[5120]: E0316 15:32:08.088675 5120 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"crc\" not found" node="crc" Mar 16 15:32:08 crc kubenswrapper[5120]: I0316 15:32:08.089015 5120 scope.go:117] "RemoveContainer" containerID="3091f35b2fa10347fdad42936109c50f90d8ed7cf3ef43a897522e8cd8069db1" Mar 16 15:32:08 crc kubenswrapper[5120]: E0316 15:32:08.089233 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-apiserver-check-endpoints\" with CrashLoopBackOff: \"back-off 10s restarting failed container=kube-apiserver-check-endpoints pod=kube-apiserver-crc_openshift-kube-apiserver(3a14caf222afb62aaabdc47808b6f944)\"" pod="openshift-kube-apiserver/kube-apiserver-crc" podUID="3a14caf222afb62aaabdc47808b6f944" Mar 16 15:32:08 crc kubenswrapper[5120]: E0316 15:32:08.096902 5120 event.go:359] "Server rejected event (will not retry!)" err="events \"kube-apiserver-crc.189d5c1fc519e31d\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"openshift-kube-apiserver\"" event="&Event{ObjectMeta:{kube-apiserver-crc.189d5c1fc519e31d openshift-kube-apiserver 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-apiserver,Name:kube-apiserver-crc,UID:3a14caf222afb62aaabdc47808b6f944,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-apiserver-check-endpoints},},Reason:BackOff,Message:Back-off restarting failed container kube-apiserver-check-endpoints in pod kube-apiserver-crc_openshift-kube-apiserver(3a14caf222afb62aaabdc47808b6f944),Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:31:59.774393117 +0000 UTC m=+21.928324774,LastTimestamp:2026-03-16 15:32:08.089197826 +0000 UTC m=+30.243129493,Count:2,Type:Warning,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 15:32:08 crc kubenswrapper[5120]: E0316 15:32:08.208522 5120 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"crc\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="7s" Mar 16 15:32:08 crc kubenswrapper[5120]: I0316 15:32:08.504384 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-kube-apiserver/kube-apiserver-crc" Mar 16 15:32:08 crc kubenswrapper[5120]: I0316 15:32:08.556396 5120 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "crc" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Mar 16 15:32:08 crc kubenswrapper[5120]: E0316 15:32:08.722223 5120 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"crc\" not found" Mar 16 15:32:08 crc kubenswrapper[5120]: I0316 15:32:08.800612 5120 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 15:32:08 crc kubenswrapper[5120]: I0316 15:32:08.801387 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:32:08 crc kubenswrapper[5120]: I0316 15:32:08.801456 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:32:08 crc kubenswrapper[5120]: I0316 15:32:08.801483 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:32:08 crc kubenswrapper[5120]: E0316 15:32:08.802146 5120 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"crc\" not found" node="crc" Mar 16 15:32:08 crc kubenswrapper[5120]: I0316 15:32:08.802633 5120 scope.go:117] "RemoveContainer" containerID="3091f35b2fa10347fdad42936109c50f90d8ed7cf3ef43a897522e8cd8069db1" Mar 16 15:32:08 crc kubenswrapper[5120]: E0316 15:32:08.802986 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-apiserver-check-endpoints\" with CrashLoopBackOff: \"back-off 10s restarting failed container=kube-apiserver-check-endpoints pod=kube-apiserver-crc_openshift-kube-apiserver(3a14caf222afb62aaabdc47808b6f944)\"" pod="openshift-kube-apiserver/kube-apiserver-crc" podUID="3a14caf222afb62aaabdc47808b6f944" Mar 16 15:32:08 crc kubenswrapper[5120]: E0316 15:32:08.809364 5120 event.go:359] "Server rejected event (will not retry!)" err="events \"kube-apiserver-crc.189d5c1fc519e31d\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"openshift-kube-apiserver\"" event="&Event{ObjectMeta:{kube-apiserver-crc.189d5c1fc519e31d openshift-kube-apiserver 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-apiserver,Name:kube-apiserver-crc,UID:3a14caf222afb62aaabdc47808b6f944,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-apiserver-check-endpoints},},Reason:BackOff,Message:Back-off restarting failed container kube-apiserver-check-endpoints in pod kube-apiserver-crc_openshift-kube-apiserver(3a14caf222afb62aaabdc47808b6f944),Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:31:59.774393117 +0000 UTC m=+21.928324774,LastTimestamp:2026-03-16 15:32:08.802934884 +0000 UTC m=+30.956866571,Count:3,Type:Warning,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 15:32:09 crc kubenswrapper[5120]: I0316 15:32:09.559649 5120 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "crc" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Mar 16 15:32:10 crc kubenswrapper[5120]: E0316 15:32:10.301868 5120 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"crc\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Mar 16 15:32:10 crc kubenswrapper[5120]: I0316 15:32:10.560570 5120 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "crc" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Mar 16 15:32:11 crc kubenswrapper[5120]: I0316 15:32:11.558519 5120 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "crc" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Mar 16 15:32:11 crc kubenswrapper[5120]: I0316 15:32:11.885510 5120 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 15:32:11 crc kubenswrapper[5120]: I0316 15:32:11.886750 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:32:11 crc kubenswrapper[5120]: I0316 15:32:11.886848 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:32:11 crc kubenswrapper[5120]: I0316 15:32:11.886867 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:32:11 crc kubenswrapper[5120]: I0316 15:32:11.886901 5120 kubelet_node_status.go:78] "Attempting to register node" node="crc" Mar 16 15:32:11 crc kubenswrapper[5120]: E0316 15:32:11.903824 5120 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"crc\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="crc" Mar 16 15:32:12 crc kubenswrapper[5120]: I0316 15:32:12.560091 5120 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "crc" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Mar 16 15:32:13 crc kubenswrapper[5120]: I0316 15:32:13.559727 5120 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "crc" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Mar 16 15:32:14 crc kubenswrapper[5120]: I0316 15:32:14.559498 5120 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "crc" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Mar 16 15:32:15 crc kubenswrapper[5120]: E0316 15:32:15.217270 5120 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"crc\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="7s" Mar 16 15:32:15 crc kubenswrapper[5120]: I0316 15:32:15.559926 5120 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "crc" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Mar 16 15:32:16 crc kubenswrapper[5120]: I0316 15:32:16.558018 5120 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "crc" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Mar 16 15:32:17 crc kubenswrapper[5120]: I0316 15:32:17.559705 5120 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "crc" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Mar 16 15:32:18 crc kubenswrapper[5120]: I0316 15:32:18.560098 5120 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "crc" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Mar 16 15:32:18 crc kubenswrapper[5120]: E0316 15:32:18.723200 5120 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"crc\" not found" Mar 16 15:32:18 crc kubenswrapper[5120]: I0316 15:32:18.904260 5120 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 15:32:18 crc kubenswrapper[5120]: I0316 15:32:18.905443 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:32:18 crc kubenswrapper[5120]: I0316 15:32:18.905524 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:32:18 crc kubenswrapper[5120]: I0316 15:32:18.905544 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:32:18 crc kubenswrapper[5120]: I0316 15:32:18.905578 5120 kubelet_node_status.go:78] "Attempting to register node" node="crc" Mar 16 15:32:18 crc kubenswrapper[5120]: E0316 15:32:18.918325 5120 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"crc\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="crc" Mar 16 15:32:19 crc kubenswrapper[5120]: E0316 15:32:19.191467 5120 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Mar 16 15:32:19 crc kubenswrapper[5120]: I0316 15:32:19.558923 5120 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "crc" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Mar 16 15:32:20 crc kubenswrapper[5120]: I0316 15:32:20.559080 5120 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "crc" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Mar 16 15:32:20 crc kubenswrapper[5120]: I0316 15:32:20.663627 5120 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 15:32:20 crc kubenswrapper[5120]: I0316 15:32:20.664681 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:32:20 crc kubenswrapper[5120]: I0316 15:32:20.664750 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:32:20 crc kubenswrapper[5120]: I0316 15:32:20.664815 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:32:20 crc kubenswrapper[5120]: E0316 15:32:20.665527 5120 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"crc\" not found" node="crc" Mar 16 15:32:20 crc kubenswrapper[5120]: I0316 15:32:20.666075 5120 scope.go:117] "RemoveContainer" containerID="3091f35b2fa10347fdad42936109c50f90d8ed7cf3ef43a897522e8cd8069db1" Mar 16 15:32:20 crc kubenswrapper[5120]: E0316 15:32:20.678747 5120 event.go:359] "Server rejected event (will not retry!)" err="events \"kube-apiserver-crc.189d5c1b914b53d7\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"openshift-kube-apiserver\"" event="&Event{ObjectMeta:{kube-apiserver-crc.189d5c1b914b53d7 openshift-kube-apiserver 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-apiserver,Name:kube-apiserver-crc,UID:3a14caf222afb62aaabdc47808b6f944,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-apiserver-check-endpoints},},Reason:Pulled,Message:Container image \"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\" already present on machine,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:31:41.725348823 +0000 UTC m=+3.879280480,LastTimestamp:2026-03-16 15:32:20.668407485 +0000 UTC m=+42.822339182,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 15:32:20 crc kubenswrapper[5120]: E0316 15:32:20.882445 5120 event.go:359] "Server rejected event (will not retry!)" err="events \"kube-apiserver-crc.189d5c1b9e71dc46\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"openshift-kube-apiserver\"" event="&Event{ObjectMeta:{kube-apiserver-crc.189d5c1b9e71dc46 openshift-kube-apiserver 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-apiserver,Name:kube-apiserver-crc,UID:3a14caf222afb62aaabdc47808b6f944,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-apiserver-check-endpoints},},Reason:Created,Message:Created container: kube-apiserver-check-endpoints,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:31:41.945977926 +0000 UTC m=+4.099909583,LastTimestamp:2026-03-16 15:32:20.877253194 +0000 UTC m=+43.031184841,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 15:32:20 crc kubenswrapper[5120]: E0316 15:32:20.893682 5120 event.go:359] "Server rejected event (will not retry!)" err="events \"kube-apiserver-crc.189d5c1b9f14a9c3\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"openshift-kube-apiserver\"" event="&Event{ObjectMeta:{kube-apiserver-crc.189d5c1b9f14a9c3 openshift-kube-apiserver 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-apiserver,Name:kube-apiserver-crc,UID:3a14caf222afb62aaabdc47808b6f944,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-apiserver-check-endpoints},},Reason:Started,Message:Started container kube-apiserver-check-endpoints,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:31:41.956647363 +0000 UTC m=+4.110579020,LastTimestamp:2026-03-16 15:32:20.887896852 +0000 UTC m=+43.041828509,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 15:32:21 crc kubenswrapper[5120]: I0316 15:32:21.560022 5120 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "crc" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Mar 16 15:32:21 crc kubenswrapper[5120]: I0316 15:32:21.837117 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_kube-apiserver-crc_3a14caf222afb62aaabdc47808b6f944/kube-apiserver-check-endpoints/1.log" Mar 16 15:32:21 crc kubenswrapper[5120]: I0316 15:32:21.839229 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-crc" event={"ID":"3a14caf222afb62aaabdc47808b6f944","Type":"ContainerStarted","Data":"35e69f457a6e412bd82461108cf315f79810a6c72a91e0d83765a5e275c83ef8"} Mar 16 15:32:21 crc kubenswrapper[5120]: I0316 15:32:21.839585 5120 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 15:32:21 crc kubenswrapper[5120]: I0316 15:32:21.841380 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:32:21 crc kubenswrapper[5120]: I0316 15:32:21.841418 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:32:21 crc kubenswrapper[5120]: I0316 15:32:21.841427 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:32:21 crc kubenswrapper[5120]: E0316 15:32:21.841727 5120 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"crc\" not found" node="crc" Mar 16 15:32:22 crc kubenswrapper[5120]: E0316 15:32:22.224743 5120 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"crc\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="7s" Mar 16 15:32:22 crc kubenswrapper[5120]: I0316 15:32:22.558857 5120 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "crc" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Mar 16 15:32:22 crc kubenswrapper[5120]: I0316 15:32:22.844134 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_kube-apiserver-crc_3a14caf222afb62aaabdc47808b6f944/kube-apiserver-check-endpoints/2.log" Mar 16 15:32:22 crc kubenswrapper[5120]: I0316 15:32:22.844825 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_kube-apiserver-crc_3a14caf222afb62aaabdc47808b6f944/kube-apiserver-check-endpoints/1.log" Mar 16 15:32:22 crc kubenswrapper[5120]: I0316 15:32:22.846448 5120 generic.go:358] "Generic (PLEG): container finished" podID="3a14caf222afb62aaabdc47808b6f944" containerID="35e69f457a6e412bd82461108cf315f79810a6c72a91e0d83765a5e275c83ef8" exitCode=255 Mar 16 15:32:22 crc kubenswrapper[5120]: I0316 15:32:22.846482 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-crc" event={"ID":"3a14caf222afb62aaabdc47808b6f944","Type":"ContainerDied","Data":"35e69f457a6e412bd82461108cf315f79810a6c72a91e0d83765a5e275c83ef8"} Mar 16 15:32:22 crc kubenswrapper[5120]: I0316 15:32:22.846513 5120 scope.go:117] "RemoveContainer" containerID="3091f35b2fa10347fdad42936109c50f90d8ed7cf3ef43a897522e8cd8069db1" Mar 16 15:32:22 crc kubenswrapper[5120]: I0316 15:32:22.846821 5120 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 15:32:22 crc kubenswrapper[5120]: I0316 15:32:22.847751 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:32:22 crc kubenswrapper[5120]: I0316 15:32:22.847852 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:32:22 crc kubenswrapper[5120]: I0316 15:32:22.847878 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:32:22 crc kubenswrapper[5120]: E0316 15:32:22.848731 5120 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"crc\" not found" node="crc" Mar 16 15:32:22 crc kubenswrapper[5120]: I0316 15:32:22.849160 5120 scope.go:117] "RemoveContainer" containerID="35e69f457a6e412bd82461108cf315f79810a6c72a91e0d83765a5e275c83ef8" Mar 16 15:32:22 crc kubenswrapper[5120]: E0316 15:32:22.849509 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-apiserver-check-endpoints\" with CrashLoopBackOff: \"back-off 20s restarting failed container=kube-apiserver-check-endpoints pod=kube-apiserver-crc_openshift-kube-apiserver(3a14caf222afb62aaabdc47808b6f944)\"" pod="openshift-kube-apiserver/kube-apiserver-crc" podUID="3a14caf222afb62aaabdc47808b6f944" Mar 16 15:32:22 crc kubenswrapper[5120]: E0316 15:32:22.857220 5120 event.go:359] "Server rejected event (will not retry!)" err="events \"kube-apiserver-crc.189d5c1fc519e31d\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"openshift-kube-apiserver\"" event="&Event{ObjectMeta:{kube-apiserver-crc.189d5c1fc519e31d openshift-kube-apiserver 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-apiserver,Name:kube-apiserver-crc,UID:3a14caf222afb62aaabdc47808b6f944,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-apiserver-check-endpoints},},Reason:BackOff,Message:Back-off restarting failed container kube-apiserver-check-endpoints in pod kube-apiserver-crc_openshift-kube-apiserver(3a14caf222afb62aaabdc47808b6f944),Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:31:59.774393117 +0000 UTC m=+21.928324774,LastTimestamp:2026-03-16 15:32:22.849450095 +0000 UTC m=+45.003381792,Count:4,Type:Warning,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 15:32:23 crc kubenswrapper[5120]: E0316 15:32:23.205466 5120 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Mar 16 15:32:23 crc kubenswrapper[5120]: I0316 15:32:23.559816 5120 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "crc" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Mar 16 15:32:23 crc kubenswrapper[5120]: I0316 15:32:23.852064 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_kube-apiserver-crc_3a14caf222afb62aaabdc47808b6f944/kube-apiserver-check-endpoints/2.log" Mar 16 15:32:24 crc kubenswrapper[5120]: I0316 15:32:24.562446 5120 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "crc" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Mar 16 15:32:25 crc kubenswrapper[5120]: I0316 15:32:25.558688 5120 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "crc" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Mar 16 15:32:25 crc kubenswrapper[5120]: I0316 15:32:25.919264 5120 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 15:32:25 crc kubenswrapper[5120]: I0316 15:32:25.920658 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:32:25 crc kubenswrapper[5120]: I0316 15:32:25.920714 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:32:25 crc kubenswrapper[5120]: I0316 15:32:25.920732 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:32:25 crc kubenswrapper[5120]: I0316 15:32:25.920822 5120 kubelet_node_status.go:78] "Attempting to register node" node="crc" Mar 16 15:32:25 crc kubenswrapper[5120]: E0316 15:32:25.929664 5120 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"crc\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="crc" Mar 16 15:32:26 crc kubenswrapper[5120]: I0316 15:32:26.556028 5120 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "crc" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Mar 16 15:32:27 crc kubenswrapper[5120]: I0316 15:32:27.558449 5120 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "crc" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Mar 16 15:32:28 crc kubenswrapper[5120]: I0316 15:32:28.087905 5120 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-kube-apiserver/kube-apiserver-crc" Mar 16 15:32:28 crc kubenswrapper[5120]: I0316 15:32:28.088218 5120 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 15:32:28 crc kubenswrapper[5120]: I0316 15:32:28.089575 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:32:28 crc kubenswrapper[5120]: I0316 15:32:28.089635 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:32:28 crc kubenswrapper[5120]: I0316 15:32:28.089654 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:32:28 crc kubenswrapper[5120]: E0316 15:32:28.090182 5120 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"crc\" not found" node="crc" Mar 16 15:32:28 crc kubenswrapper[5120]: I0316 15:32:28.090527 5120 scope.go:117] "RemoveContainer" containerID="35e69f457a6e412bd82461108cf315f79810a6c72a91e0d83765a5e275c83ef8" Mar 16 15:32:28 crc kubenswrapper[5120]: E0316 15:32:28.090857 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-apiserver-check-endpoints\" with CrashLoopBackOff: \"back-off 20s restarting failed container=kube-apiserver-check-endpoints pod=kube-apiserver-crc_openshift-kube-apiserver(3a14caf222afb62aaabdc47808b6f944)\"" pod="openshift-kube-apiserver/kube-apiserver-crc" podUID="3a14caf222afb62aaabdc47808b6f944" Mar 16 15:32:28 crc kubenswrapper[5120]: E0316 15:32:28.096461 5120 event.go:359] "Server rejected event (will not retry!)" err="events \"kube-apiserver-crc.189d5c1fc519e31d\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"openshift-kube-apiserver\"" event="&Event{ObjectMeta:{kube-apiserver-crc.189d5c1fc519e31d openshift-kube-apiserver 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-apiserver,Name:kube-apiserver-crc,UID:3a14caf222afb62aaabdc47808b6f944,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-apiserver-check-endpoints},},Reason:BackOff,Message:Back-off restarting failed container kube-apiserver-check-endpoints in pod kube-apiserver-crc_openshift-kube-apiserver(3a14caf222afb62aaabdc47808b6f944),Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:31:59.774393117 +0000 UTC m=+21.928324774,LastTimestamp:2026-03-16 15:32:28.090809904 +0000 UTC m=+50.244741601,Count:5,Type:Warning,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 15:32:28 crc kubenswrapper[5120]: I0316 15:32:28.560474 5120 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "crc" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Mar 16 15:32:28 crc kubenswrapper[5120]: E0316 15:32:28.723498 5120 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"crc\" not found" Mar 16 15:32:29 crc kubenswrapper[5120]: E0316 15:32:29.233703 5120 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"crc\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="7s" Mar 16 15:32:29 crc kubenswrapper[5120]: I0316 15:32:29.553019 5120 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "crc" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Mar 16 15:32:29 crc kubenswrapper[5120]: E0316 15:32:29.553143 5120 reflector.go:200] "Failed to watch" err="failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" Mar 16 15:32:30 crc kubenswrapper[5120]: I0316 15:32:30.556320 5120 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "crc" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Mar 16 15:32:31 crc kubenswrapper[5120]: I0316 15:32:31.560731 5120 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "crc" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Mar 16 15:32:31 crc kubenswrapper[5120]: I0316 15:32:31.840806 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-kube-apiserver/kube-apiserver-crc" Mar 16 15:32:31 crc kubenswrapper[5120]: I0316 15:32:31.841039 5120 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 15:32:31 crc kubenswrapper[5120]: I0316 15:32:31.841920 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:32:31 crc kubenswrapper[5120]: I0316 15:32:31.842001 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:32:31 crc kubenswrapper[5120]: I0316 15:32:31.842047 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:32:31 crc kubenswrapper[5120]: E0316 15:32:31.842423 5120 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"crc\" not found" node="crc" Mar 16 15:32:31 crc kubenswrapper[5120]: I0316 15:32:31.842620 5120 scope.go:117] "RemoveContainer" containerID="35e69f457a6e412bd82461108cf315f79810a6c72a91e0d83765a5e275c83ef8" Mar 16 15:32:31 crc kubenswrapper[5120]: E0316 15:32:31.842808 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-apiserver-check-endpoints\" with CrashLoopBackOff: \"back-off 20s restarting failed container=kube-apiserver-check-endpoints pod=kube-apiserver-crc_openshift-kube-apiserver(3a14caf222afb62aaabdc47808b6f944)\"" pod="openshift-kube-apiserver/kube-apiserver-crc" podUID="3a14caf222afb62aaabdc47808b6f944" Mar 16 15:32:31 crc kubenswrapper[5120]: E0316 15:32:31.849992 5120 event.go:359] "Server rejected event (will not retry!)" err="events \"kube-apiserver-crc.189d5c1fc519e31d\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"openshift-kube-apiserver\"" event="&Event{ObjectMeta:{kube-apiserver-crc.189d5c1fc519e31d openshift-kube-apiserver 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-apiserver,Name:kube-apiserver-crc,UID:3a14caf222afb62aaabdc47808b6f944,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-apiserver-check-endpoints},},Reason:BackOff,Message:Back-off restarting failed container kube-apiserver-check-endpoints in pod kube-apiserver-crc_openshift-kube-apiserver(3a14caf222afb62aaabdc47808b6f944),Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:31:59.774393117 +0000 UTC m=+21.928324774,LastTimestamp:2026-03-16 15:32:31.842777249 +0000 UTC m=+53.996708906,Count:6,Type:Warning,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 15:32:32 crc kubenswrapper[5120]: I0316 15:32:32.557783 5120 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "crc" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Mar 16 15:32:32 crc kubenswrapper[5120]: I0316 15:32:32.929786 5120 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 15:32:32 crc kubenswrapper[5120]: I0316 15:32:32.931937 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:32:32 crc kubenswrapper[5120]: I0316 15:32:32.932001 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:32:32 crc kubenswrapper[5120]: I0316 15:32:32.932021 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:32:32 crc kubenswrapper[5120]: I0316 15:32:32.932055 5120 kubelet_node_status.go:78] "Attempting to register node" node="crc" Mar 16 15:32:32 crc kubenswrapper[5120]: E0316 15:32:32.943615 5120 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"crc\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="crc" Mar 16 15:32:33 crc kubenswrapper[5120]: I0316 15:32:33.559503 5120 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "crc" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Mar 16 15:32:34 crc kubenswrapper[5120]: I0316 15:32:34.389939 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-kube-scheduler/openshift-kube-scheduler-crc" Mar 16 15:32:34 crc kubenswrapper[5120]: I0316 15:32:34.390364 5120 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 15:32:34 crc kubenswrapper[5120]: I0316 15:32:34.391338 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:32:34 crc kubenswrapper[5120]: I0316 15:32:34.391417 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:32:34 crc kubenswrapper[5120]: I0316 15:32:34.391445 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:32:34 crc kubenswrapper[5120]: E0316 15:32:34.392068 5120 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"crc\" not found" node="crc" Mar 16 15:32:34 crc kubenswrapper[5120]: I0316 15:32:34.559402 5120 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "crc" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Mar 16 15:32:35 crc kubenswrapper[5120]: E0316 15:32:35.132384 5120 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"crc\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Mar 16 15:32:35 crc kubenswrapper[5120]: I0316 15:32:35.559484 5120 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "crc" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Mar 16 15:32:36 crc kubenswrapper[5120]: E0316 15:32:36.239975 5120 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"crc\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="7s" Mar 16 15:32:36 crc kubenswrapper[5120]: I0316 15:32:36.560008 5120 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "crc" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Mar 16 15:32:37 crc kubenswrapper[5120]: I0316 15:32:37.556808 5120 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "crc" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Mar 16 15:32:38 crc kubenswrapper[5120]: I0316 15:32:38.559540 5120 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "crc" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Mar 16 15:32:38 crc kubenswrapper[5120]: E0316 15:32:38.724390 5120 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"crc\" not found" Mar 16 15:32:39 crc kubenswrapper[5120]: I0316 15:32:39.560031 5120 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "crc" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Mar 16 15:32:39 crc kubenswrapper[5120]: I0316 15:32:39.944220 5120 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 15:32:39 crc kubenswrapper[5120]: I0316 15:32:39.945683 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:32:39 crc kubenswrapper[5120]: I0316 15:32:39.945819 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:32:39 crc kubenswrapper[5120]: I0316 15:32:39.945840 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:32:39 crc kubenswrapper[5120]: I0316 15:32:39.945979 5120 kubelet_node_status.go:78] "Attempting to register node" node="crc" Mar 16 15:32:39 crc kubenswrapper[5120]: E0316 15:32:39.955709 5120 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"crc\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="crc" Mar 16 15:32:40 crc kubenswrapper[5120]: I0316 15:32:40.559269 5120 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "crc" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Mar 16 15:32:41 crc kubenswrapper[5120]: I0316 15:32:41.560136 5120 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "crc" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Mar 16 15:32:42 crc kubenswrapper[5120]: I0316 15:32:42.557951 5120 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "crc" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Mar 16 15:32:43 crc kubenswrapper[5120]: E0316 15:32:43.248416 5120 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"crc\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="7s" Mar 16 15:32:43 crc kubenswrapper[5120]: I0316 15:32:43.556208 5120 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "crc" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Mar 16 15:32:43 crc kubenswrapper[5120]: I0316 15:32:43.812788 5120 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-j64z9" Mar 16 15:32:43 crc kubenswrapper[5120]: I0316 15:32:43.821367 5120 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-j64z9" Mar 16 15:32:43 crc kubenswrapper[5120]: I0316 15:32:43.918296 5120 reconstruct.go:205] "DevicePaths of reconstructed volumes updated" Mar 16 15:32:44 crc kubenswrapper[5120]: I0316 15:32:44.349260 5120 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Mar 16 15:32:44 crc kubenswrapper[5120]: I0316 15:32:44.823318 5120 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2026-04-15 15:27:43 +0000 UTC" deadline="2026-04-10 18:56:18.665403094 +0000 UTC" Mar 16 15:32:44 crc kubenswrapper[5120]: I0316 15:32:44.823414 5120 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="603h23m33.841996599s" Mar 16 15:32:46 crc kubenswrapper[5120]: I0316 15:32:46.663606 5120 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 15:32:46 crc kubenswrapper[5120]: I0316 15:32:46.664502 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:32:46 crc kubenswrapper[5120]: I0316 15:32:46.664566 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:32:46 crc kubenswrapper[5120]: I0316 15:32:46.664583 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:32:46 crc kubenswrapper[5120]: E0316 15:32:46.665140 5120 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"crc\" not found" node="crc" Mar 16 15:32:46 crc kubenswrapper[5120]: I0316 15:32:46.665458 5120 scope.go:117] "RemoveContainer" containerID="35e69f457a6e412bd82461108cf315f79810a6c72a91e0d83765a5e275c83ef8" Mar 16 15:32:46 crc kubenswrapper[5120]: I0316 15:32:46.922048 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_kube-apiserver-crc_3a14caf222afb62aaabdc47808b6f944/kube-apiserver-check-endpoints/2.log" Mar 16 15:32:46 crc kubenswrapper[5120]: I0316 15:32:46.924909 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-crc" event={"ID":"3a14caf222afb62aaabdc47808b6f944","Type":"ContainerStarted","Data":"2e9f531a9c0fc8cf5222ce7e135c4f37d008306df727f84312cc5d7d2c740ac6"} Mar 16 15:32:46 crc kubenswrapper[5120]: I0316 15:32:46.925116 5120 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 15:32:46 crc kubenswrapper[5120]: I0316 15:32:46.925812 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:32:46 crc kubenswrapper[5120]: I0316 15:32:46.925887 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:32:46 crc kubenswrapper[5120]: I0316 15:32:46.925914 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:32:46 crc kubenswrapper[5120]: E0316 15:32:46.926791 5120 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"crc\" not found" node="crc" Mar 16 15:32:46 crc kubenswrapper[5120]: I0316 15:32:46.956250 5120 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 15:32:46 crc kubenswrapper[5120]: I0316 15:32:46.957576 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:32:46 crc kubenswrapper[5120]: I0316 15:32:46.957625 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:32:46 crc kubenswrapper[5120]: I0316 15:32:46.957636 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:32:46 crc kubenswrapper[5120]: I0316 15:32:46.957749 5120 kubelet_node_status.go:78] "Attempting to register node" node="crc" Mar 16 15:32:46 crc kubenswrapper[5120]: I0316 15:32:46.966847 5120 kubelet_node_status.go:127] "Node was previously registered" node="crc" Mar 16 15:32:46 crc kubenswrapper[5120]: I0316 15:32:46.967220 5120 kubelet_node_status.go:81] "Successfully registered node" node="crc" Mar 16 15:32:46 crc kubenswrapper[5120]: E0316 15:32:46.967251 5120 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"crc\": node \"crc\" not found" Mar 16 15:32:46 crc kubenswrapper[5120]: I0316 15:32:46.970699 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:32:46 crc kubenswrapper[5120]: I0316 15:32:46.970753 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:32:46 crc kubenswrapper[5120]: I0316 15:32:46.970811 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:32:46 crc kubenswrapper[5120]: I0316 15:32:46.970842 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 15:32:46 crc kubenswrapper[5120]: I0316 15:32:46.970866 5120 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T15:32:46Z","lastTransitionTime":"2026-03-16T15:32:46Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 15:32:46 crc kubenswrapper[5120]: E0316 15:32:46.986171 5120 kubelet_node_status.go:597] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"allocatable\\\":{\\\"cpu\\\":\\\"11800m\\\",\\\"ephemeral-storage\\\":\\\"76396645454\\\",\\\"memory\\\":\\\"32400460Ki\\\"},\\\"capacity\\\":{\\\"cpu\\\":\\\"12\\\",\\\"ephemeral-storage\\\":\\\"83293888Ki\\\",\\\"memory\\\":\\\"32861260Ki\\\"},\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T15:32:46Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T15:32:46Z\\\",\\\"message\\\":\\\"kubelet has sufficient memory available\\\",\\\"reason\\\":\\\"KubeletHasSufficientMemory\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T15:32:46Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T15:32:46Z\\\",\\\"message\\\":\\\"kubelet has no disk pressure\\\",\\\"reason\\\":\\\"KubeletHasNoDiskPressure\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T15:32:46Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T15:32:46Z\\\",\\\"message\\\":\\\"kubelet has sufficient PID available\\\",\\\"reason\\\":\\\"KubeletHasSufficientPID\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T15:32:46Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T15:32:46Z\\\",\\\"message\\\":\\\"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?\\\",\\\"reason\\\":\\\"KubeletNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7c8a088031661d94022418e93fb63744c38e1c4cff93ea3b95c096a290c2b7a3\\\"],\\\"sizeBytes\\\":2981840865},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\"],\\\"sizeBytes\\\":1641503854},{\\\"names\\\":[\\\"registry.redhat.io/redhat/redhat-operator-index@sha256:286bb0beab328954b0a86b7f066fd5a843b462d6acb2812df7ec788015cd32d4\\\",\\\"registry.redhat.io/redhat/redhat-operator-index@sha256:be02784ed82978c399102be1c6c9f2ca441be4d984e0fd7100c155dd4417ebbf\\\",\\\"registry.redhat.io/redhat/redhat-operator-index:v4.20\\\"],\\\"sizeBytes\\\":1597684406},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:85f1323d589d7af13b096b1f9b438b9dfe08f3fab37534e2780e6490a665bf05\\\"],\\\"sizeBytes\\\":1261384762},{\\\"names\\\":[\\\"registry.redhat.io/redhat/community-operator-index@sha256:0d50962980a5aeecae2d99c98913fb0f46940164e41de0af2ba0e3dafe0d9017\\\",\\\"registry.redhat.io/redhat/community-operator-index@sha256:8d607fb6cc75ca36bca1e0a9c5bea5d1919b75db20733df69c64c8a10ee8083d\\\",\\\"registry.redhat.io/redhat/community-operator-index:v4.20\\\"],\\\"sizeBytes\\\":1224304325},{\\\"names\\\":[\\\"registry.redhat.io/redhat/certified-operator-index@sha256:541db5b20a3d2199602b3b5ac80f09ea31498034e9ae3841238b03a39150f0d7\\\",\\\"registry.redhat.io/redhat/certified-operator-index@sha256:a4c5df55584cba56f00004a090923a5c6de2071add5eb1672a5e20aa646aad8c\\\",\\\"registry.redhat.io/redhat/certified-operator-index:v4.20\\\"],\\\"sizeBytes\\\":1126957757},{\\\"names\\\":[\\\"registry.redhat.io/redhat/redhat-marketplace-index@sha256:b1c859067d6b7b785ab4977ed7137c5b3bb257234f7d7737a1d2836cef1576b5\\\",\\\"registry.redhat.io/redhat/redhat-marketplace-index@sha256:df08951924aa23b2333436a1d04b2dba56c366bb4f09d39ae3aedb980e4fb909\\\",\\\"registry.redhat.io/redhat/redhat-marketplace-index:v4.20\\\"],\\\"sizeBytes\\\":1079537324},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9414357f9345a841e0565265700ecc6637f846c83bd5908dbb7b306432465115\\\"],\\\"sizeBytes\\\":1052707833},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8d1a1e4abe0326c3af89e9eaa4b7449dd2d5b6f9403c677e19b00b24947b1df9\\\"],\\\"sizeBytes\\\":989392005},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b2b1fc3d5bb4944cbd5b23b87566d7ba24b1b66f5a0465f76bcc05023191cc47\\\"],\\\"sizeBytes\\\":971668163},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:be2edaed22535093bdb486afe5960ff4f3b0bd96f88dc1753b584cc28184a0b0\\\"],\\\"sizeBytes\\\":969078739},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7e3d6c8802ae53d6aecf38aa7b560d7892193806bdeb3d7c1637fac77c47fd1f\\\"],\\\"sizeBytes\\\":876488654},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\"],\\\"sizeBytes\\\":847332502},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:36c4867005702f0c4cbfcfa33f18a98596a6c9b1340b633c85ccef84a0c4f889\\\"],\\\"sizeBytes\\\":769516783},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1b55c029f731ebbde3c5580eef98a588264f4d6a8ae667805c9521dd1ecf1d5d\\\"],\\\"sizeBytes\\\":721591926},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf05b9b2ba66351a6c59f4259fb377f62237a00af3b4f0b95f64409e2f25770e\\\"],\\\"sizeBytes\\\":646867625},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a8581a82ba5c8343a743aa302c4848249d8c32a9f2cd10fa68d89d835a1bdf8b\\\"],\\\"sizeBytes\\\":638910445},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ae245c97fc463e876c3024efb806fa8f4efb13b3f06f1bdd3e7e1447f5a5dce4\\\"],\\\"sizeBytes\\\":617699779},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d4926e304011637ca9df370a193896d685f0f3ffabbec234ec827abdbeb083f9\\\"],\\\"sizeBytes\\\":607756695},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5c5d7468f6838b6a714482e62ea956659212f3415ec8f69989f75eb6d8744a6e\\\"],\\\"sizeBytes\\\":584721741},{\\\"names\\\":[\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\\\"],\\\"sizeBytes\\\":545674969},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:574d49b89604b8e8103abf57feee77812fe8cf441eafc17fdff95d57ca80645e\\\"],\\\"sizeBytes\\\":542463064},{\\\"names\\\":[\\\"quay.io/crcont/openshift-crc-cluster-kube-controller-manager-operator@sha256:f69b9cc9b9cfde726109a9e12b80a3eefa472d7e29159df0fbc7143c48983cd6\\\"],\\\"sizeBytes\\\":539380592},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9506bdcf97d5200cf2cf4cdf110aebafdd141a24f6589bf1e1cfe27bb7fc1ed2\\\"],\\\"sizeBytes\\\":533027808},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\"],\\\"sizeBytes\\\":528200501},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5a2a7b3c2f1598189d8880e6aa15ab11a65b201f25012f77ba41e7487a60729a\\\"],\\\"sizeBytes\\\":527774342},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e5e8108294b086fdb797365e5a46badba9b3d866bdcddc8460a51e05a253753d\\\"],\\\"sizeBytes\\\":526632426},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5827f6ae3beb4853192e02cc18890467bd251b33070f36f9a105991e7e6d3c9b\\\"],\\\"sizeBytes\\\":522490210},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:66c8fe5d45ff249643dae75185dd2787ea1b0ae87d5699a8222149c07689557c\\\"],\\\"sizeBytes\\\":520141094},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:baf975b6944f2844860c440636e0d4b80b2fdc473d30f32ae7d6989f2fc2b135\\\"],\\\"sizeBytes\\\":519815758},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:765cf9c3ebf4df049ebc022beaaf52f52852cf89fb802034536ad91dd45db807\\\"],\\\"sizeBytes\\\":519539350},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:52e442bc8198ac925caff87ddd35b3107b7375d5afc9c2eb041ca4e79db72c6f\\\"],\\\"sizeBytes\\\":518690683},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:43b0e0b7e1955ee905e48799a62f50b8a8df553190415ce1f5550375c2507ca5\\\"],\\\"sizeBytes\\\":518251952},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:977a316fa3598eb575a4477dafc09bbf06fad21c4ec2867052225d74f2a9f366\\\"],\\\"sizeBytes\\\":511136541},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e504172345491d90bbbf1e7e45488e73073f4c6d7c2355245871051596fc85db\\\"],\\\"sizeBytes\\\":510122097},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dbd8603d717c26901bcf9731b1e0392ae4bc08a270ed1eeb45839e44bed9607d\\\"],\\\"sizeBytes\\\":508941917},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7c6a47106effd9e9a41131e2bf6c832b80cd77b3439334f760b35b0729f2fb00\\\"],\\\"sizeBytes\\\":508318343},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7a726c68cebc9b08edd734a8bae5150ae5950f7734fe9b9c2a6e0d06f21cc095\\\"],\\\"sizeBytes\\\":498380948},{\\\"names\\\":[\\\"quay.io/crcont/ocp-release@sha256:82501261b9c63012ba3b83fe4d6703c0af5eb9c9151670eb90ae480b9507d761\\\"],\\\"sizeBytes\\\":497232440},{\\\"names\\\":[\\\"registry.redhat.io/openshift4/ose-csi-external-provisioner@sha256:4e4239621caed0b0d9132d167403631e9af86be9a395977f013e201ead281bb4\\\",\\\"registry.redhat.io/openshift4/ose-csi-external-provisioner@sha256:c0b1bec73fdb6853eb3bd9e9733aee2d760ca09a33cfd94adf9ab7b706e83fa9\\\",\\\"registry.redhat.io/openshift4/ose-csi-external-provisioner:latest\\\"],\\\"sizeBytes\\\":491224335},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b0f7abf2f97afd1127d9245d764338c6047bac1711b2cee43112570a85946360\\\"],\\\"sizeBytes\\\":490381192},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:21b12ff0c81c1d535e7c31aff3a73b1e9ca763e5f88037f59ade0dfab6ed8946\\\"],\\\"sizeBytes\\\":482632652},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:036ed6efe4cb5f5b90ee7f9ef5297c8591b8d67aa36b3c58b4fc5417622a140c\\\"],\\\"sizeBytes\\\":477561861},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0fe5a041a2b99d736e82f1b4a6cd9792c5e23ded475e9f0742cd19234070f989\\\"],\\\"sizeBytes\\\":475327956},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dcb03ccba25366bbdf74cbab6738e7ef1f97f62760886ec445a40cdf29b60418\\\"],\\\"sizeBytes\\\":475137830},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2599f32933f5fea6066ede54ad8f6150adb7bd9067892f251d5913121d5c630d\\\"],\\\"sizeBytes\\\":472771950},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:651bbe9d418f49c2c889d731df67cf5d88dff59dc03f5a1b5d4c8bb3ae001f1a\\\"],\\\"sizeBytes\\\":469976318},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4fe612a1572df462d6a4b664a10bc2e6cad239648acbf8c0303f8fca5d2596c0\\\"],\\\"sizeBytes\\\":468393024},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a5bb05344dd2296077f5066e908ede0eea23f5a12fb78ef86a9513c88d3faaca\\\"],\\\"sizeBytes\\\":464375011},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\"],\\\"sizeBytes\\\":462844959}],\\\"nodeInfo\\\":{\\\"bootID\\\":\\\"3cdf81b4-f597-401a-9b99-34aaa64fb798\\\",\\\"systemUUID\\\":\\\"c6072c61-a7eb-44bd-85f7-eb9fdb0e84de\\\"}}}\" for node \"crc\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/node?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 15:32:46 crc kubenswrapper[5120]: I0316 15:32:46.996286 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:32:46 crc kubenswrapper[5120]: I0316 15:32:46.996328 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:32:46 crc kubenswrapper[5120]: I0316 15:32:46.996338 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:32:46 crc kubenswrapper[5120]: I0316 15:32:46.996354 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 15:32:46 crc kubenswrapper[5120]: I0316 15:32:46.996364 5120 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T15:32:46Z","lastTransitionTime":"2026-03-16T15:32:46Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 15:32:47 crc kubenswrapper[5120]: E0316 15:32:47.005048 5120 kubelet_node_status.go:597] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"allocatable\\\":{\\\"cpu\\\":\\\"11800m\\\",\\\"ephemeral-storage\\\":\\\"76396645454\\\",\\\"memory\\\":\\\"32400460Ki\\\"},\\\"capacity\\\":{\\\"cpu\\\":\\\"12\\\",\\\"ephemeral-storage\\\":\\\"83293888Ki\\\",\\\"memory\\\":\\\"32861260Ki\\\"},\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T15:32:46Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T15:32:46Z\\\",\\\"message\\\":\\\"kubelet has sufficient memory available\\\",\\\"reason\\\":\\\"KubeletHasSufficientMemory\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T15:32:46Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T15:32:46Z\\\",\\\"message\\\":\\\"kubelet has no disk pressure\\\",\\\"reason\\\":\\\"KubeletHasNoDiskPressure\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T15:32:46Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T15:32:46Z\\\",\\\"message\\\":\\\"kubelet has sufficient PID available\\\",\\\"reason\\\":\\\"KubeletHasSufficientPID\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T15:32:46Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T15:32:46Z\\\",\\\"message\\\":\\\"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?\\\",\\\"reason\\\":\\\"KubeletNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7c8a088031661d94022418e93fb63744c38e1c4cff93ea3b95c096a290c2b7a3\\\"],\\\"sizeBytes\\\":2981840865},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\"],\\\"sizeBytes\\\":1641503854},{\\\"names\\\":[\\\"registry.redhat.io/redhat/redhat-operator-index@sha256:286bb0beab328954b0a86b7f066fd5a843b462d6acb2812df7ec788015cd32d4\\\",\\\"registry.redhat.io/redhat/redhat-operator-index@sha256:be02784ed82978c399102be1c6c9f2ca441be4d984e0fd7100c155dd4417ebbf\\\",\\\"registry.redhat.io/redhat/redhat-operator-index:v4.20\\\"],\\\"sizeBytes\\\":1597684406},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:85f1323d589d7af13b096b1f9b438b9dfe08f3fab37534e2780e6490a665bf05\\\"],\\\"sizeBytes\\\":1261384762},{\\\"names\\\":[\\\"registry.redhat.io/redhat/community-operator-index@sha256:0d50962980a5aeecae2d99c98913fb0f46940164e41de0af2ba0e3dafe0d9017\\\",\\\"registry.redhat.io/redhat/community-operator-index@sha256:8d607fb6cc75ca36bca1e0a9c5bea5d1919b75db20733df69c64c8a10ee8083d\\\",\\\"registry.redhat.io/redhat/community-operator-index:v4.20\\\"],\\\"sizeBytes\\\":1224304325},{\\\"names\\\":[\\\"registry.redhat.io/redhat/certified-operator-index@sha256:541db5b20a3d2199602b3b5ac80f09ea31498034e9ae3841238b03a39150f0d7\\\",\\\"registry.redhat.io/redhat/certified-operator-index@sha256:a4c5df55584cba56f00004a090923a5c6de2071add5eb1672a5e20aa646aad8c\\\",\\\"registry.redhat.io/redhat/certified-operator-index:v4.20\\\"],\\\"sizeBytes\\\":1126957757},{\\\"names\\\":[\\\"registry.redhat.io/redhat/redhat-marketplace-index@sha256:b1c859067d6b7b785ab4977ed7137c5b3bb257234f7d7737a1d2836cef1576b5\\\",\\\"registry.redhat.io/redhat/redhat-marketplace-index@sha256:df08951924aa23b2333436a1d04b2dba56c366bb4f09d39ae3aedb980e4fb909\\\",\\\"registry.redhat.io/redhat/redhat-marketplace-index:v4.20\\\"],\\\"sizeBytes\\\":1079537324},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9414357f9345a841e0565265700ecc6637f846c83bd5908dbb7b306432465115\\\"],\\\"sizeBytes\\\":1052707833},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8d1a1e4abe0326c3af89e9eaa4b7449dd2d5b6f9403c677e19b00b24947b1df9\\\"],\\\"sizeBytes\\\":989392005},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b2b1fc3d5bb4944cbd5b23b87566d7ba24b1b66f5a0465f76bcc05023191cc47\\\"],\\\"sizeBytes\\\":971668163},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:be2edaed22535093bdb486afe5960ff4f3b0bd96f88dc1753b584cc28184a0b0\\\"],\\\"sizeBytes\\\":969078739},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7e3d6c8802ae53d6aecf38aa7b560d7892193806bdeb3d7c1637fac77c47fd1f\\\"],\\\"sizeBytes\\\":876488654},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\"],\\\"sizeBytes\\\":847332502},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:36c4867005702f0c4cbfcfa33f18a98596a6c9b1340b633c85ccef84a0c4f889\\\"],\\\"sizeBytes\\\":769516783},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1b55c029f731ebbde3c5580eef98a588264f4d6a8ae667805c9521dd1ecf1d5d\\\"],\\\"sizeBytes\\\":721591926},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf05b9b2ba66351a6c59f4259fb377f62237a00af3b4f0b95f64409e2f25770e\\\"],\\\"sizeBytes\\\":646867625},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a8581a82ba5c8343a743aa302c4848249d8c32a9f2cd10fa68d89d835a1bdf8b\\\"],\\\"sizeBytes\\\":638910445},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ae245c97fc463e876c3024efb806fa8f4efb13b3f06f1bdd3e7e1447f5a5dce4\\\"],\\\"sizeBytes\\\":617699779},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d4926e304011637ca9df370a193896d685f0f3ffabbec234ec827abdbeb083f9\\\"],\\\"sizeBytes\\\":607756695},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5c5d7468f6838b6a714482e62ea956659212f3415ec8f69989f75eb6d8744a6e\\\"],\\\"sizeBytes\\\":584721741},{\\\"names\\\":[\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\\\"],\\\"sizeBytes\\\":545674969},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:574d49b89604b8e8103abf57feee77812fe8cf441eafc17fdff95d57ca80645e\\\"],\\\"sizeBytes\\\":542463064},{\\\"names\\\":[\\\"quay.io/crcont/openshift-crc-cluster-kube-controller-manager-operator@sha256:f69b9cc9b9cfde726109a9e12b80a3eefa472d7e29159df0fbc7143c48983cd6\\\"],\\\"sizeBytes\\\":539380592},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9506bdcf97d5200cf2cf4cdf110aebafdd141a24f6589bf1e1cfe27bb7fc1ed2\\\"],\\\"sizeBytes\\\":533027808},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\"],\\\"sizeBytes\\\":528200501},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5a2a7b3c2f1598189d8880e6aa15ab11a65b201f25012f77ba41e7487a60729a\\\"],\\\"sizeBytes\\\":527774342},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e5e8108294b086fdb797365e5a46badba9b3d866bdcddc8460a51e05a253753d\\\"],\\\"sizeBytes\\\":526632426},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5827f6ae3beb4853192e02cc18890467bd251b33070f36f9a105991e7e6d3c9b\\\"],\\\"sizeBytes\\\":522490210},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:66c8fe5d45ff249643dae75185dd2787ea1b0ae87d5699a8222149c07689557c\\\"],\\\"sizeBytes\\\":520141094},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:baf975b6944f2844860c440636e0d4b80b2fdc473d30f32ae7d6989f2fc2b135\\\"],\\\"sizeBytes\\\":519815758},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:765cf9c3ebf4df049ebc022beaaf52f52852cf89fb802034536ad91dd45db807\\\"],\\\"sizeBytes\\\":519539350},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:52e442bc8198ac925caff87ddd35b3107b7375d5afc9c2eb041ca4e79db72c6f\\\"],\\\"sizeBytes\\\":518690683},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:43b0e0b7e1955ee905e48799a62f50b8a8df553190415ce1f5550375c2507ca5\\\"],\\\"sizeBytes\\\":518251952},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:977a316fa3598eb575a4477dafc09bbf06fad21c4ec2867052225d74f2a9f366\\\"],\\\"sizeBytes\\\":511136541},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e504172345491d90bbbf1e7e45488e73073f4c6d7c2355245871051596fc85db\\\"],\\\"sizeBytes\\\":510122097},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dbd8603d717c26901bcf9731b1e0392ae4bc08a270ed1eeb45839e44bed9607d\\\"],\\\"sizeBytes\\\":508941917},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7c6a47106effd9e9a41131e2bf6c832b80cd77b3439334f760b35b0729f2fb00\\\"],\\\"sizeBytes\\\":508318343},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7a726c68cebc9b08edd734a8bae5150ae5950f7734fe9b9c2a6e0d06f21cc095\\\"],\\\"sizeBytes\\\":498380948},{\\\"names\\\":[\\\"quay.io/crcont/ocp-release@sha256:82501261b9c63012ba3b83fe4d6703c0af5eb9c9151670eb90ae480b9507d761\\\"],\\\"sizeBytes\\\":497232440},{\\\"names\\\":[\\\"registry.redhat.io/openshift4/ose-csi-external-provisioner@sha256:4e4239621caed0b0d9132d167403631e9af86be9a395977f013e201ead281bb4\\\",\\\"registry.redhat.io/openshift4/ose-csi-external-provisioner@sha256:c0b1bec73fdb6853eb3bd9e9733aee2d760ca09a33cfd94adf9ab7b706e83fa9\\\",\\\"registry.redhat.io/openshift4/ose-csi-external-provisioner:latest\\\"],\\\"sizeBytes\\\":491224335},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b0f7abf2f97afd1127d9245d764338c6047bac1711b2cee43112570a85946360\\\"],\\\"sizeBytes\\\":490381192},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:21b12ff0c81c1d535e7c31aff3a73b1e9ca763e5f88037f59ade0dfab6ed8946\\\"],\\\"sizeBytes\\\":482632652},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:036ed6efe4cb5f5b90ee7f9ef5297c8591b8d67aa36b3c58b4fc5417622a140c\\\"],\\\"sizeBytes\\\":477561861},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0fe5a041a2b99d736e82f1b4a6cd9792c5e23ded475e9f0742cd19234070f989\\\"],\\\"sizeBytes\\\":475327956},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dcb03ccba25366bbdf74cbab6738e7ef1f97f62760886ec445a40cdf29b60418\\\"],\\\"sizeBytes\\\":475137830},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2599f32933f5fea6066ede54ad8f6150adb7bd9067892f251d5913121d5c630d\\\"],\\\"sizeBytes\\\":472771950},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:651bbe9d418f49c2c889d731df67cf5d88dff59dc03f5a1b5d4c8bb3ae001f1a\\\"],\\\"sizeBytes\\\":469976318},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4fe612a1572df462d6a4b664a10bc2e6cad239648acbf8c0303f8fca5d2596c0\\\"],\\\"sizeBytes\\\":468393024},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a5bb05344dd2296077f5066e908ede0eea23f5a12fb78ef86a9513c88d3faaca\\\"],\\\"sizeBytes\\\":464375011},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\"],\\\"sizeBytes\\\":462844959}],\\\"nodeInfo\\\":{\\\"bootID\\\":\\\"3cdf81b4-f597-401a-9b99-34aaa64fb798\\\",\\\"systemUUID\\\":\\\"c6072c61-a7eb-44bd-85f7-eb9fdb0e84de\\\"}}}\" for node \"crc\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/node?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 15:32:47 crc kubenswrapper[5120]: I0316 15:32:47.012235 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:32:47 crc kubenswrapper[5120]: I0316 15:32:47.012286 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:32:47 crc kubenswrapper[5120]: I0316 15:32:47.012300 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:32:47 crc kubenswrapper[5120]: I0316 15:32:47.012319 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 15:32:47 crc kubenswrapper[5120]: I0316 15:32:47.012331 5120 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T15:32:47Z","lastTransitionTime":"2026-03-16T15:32:47Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 15:32:47 crc kubenswrapper[5120]: E0316 15:32:47.025616 5120 kubelet_node_status.go:597] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"allocatable\\\":{\\\"cpu\\\":\\\"11800m\\\",\\\"ephemeral-storage\\\":\\\"76396645454\\\",\\\"memory\\\":\\\"32400460Ki\\\"},\\\"capacity\\\":{\\\"cpu\\\":\\\"12\\\",\\\"ephemeral-storage\\\":\\\"83293888Ki\\\",\\\"memory\\\":\\\"32861260Ki\\\"},\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T15:32:47Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T15:32:47Z\\\",\\\"message\\\":\\\"kubelet has sufficient memory available\\\",\\\"reason\\\":\\\"KubeletHasSufficientMemory\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T15:32:47Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T15:32:47Z\\\",\\\"message\\\":\\\"kubelet has no disk pressure\\\",\\\"reason\\\":\\\"KubeletHasNoDiskPressure\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T15:32:47Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T15:32:47Z\\\",\\\"message\\\":\\\"kubelet has sufficient PID available\\\",\\\"reason\\\":\\\"KubeletHasSufficientPID\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T15:32:47Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T15:32:47Z\\\",\\\"message\\\":\\\"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?\\\",\\\"reason\\\":\\\"KubeletNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7c8a088031661d94022418e93fb63744c38e1c4cff93ea3b95c096a290c2b7a3\\\"],\\\"sizeBytes\\\":2981840865},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\"],\\\"sizeBytes\\\":1641503854},{\\\"names\\\":[\\\"registry.redhat.io/redhat/redhat-operator-index@sha256:286bb0beab328954b0a86b7f066fd5a843b462d6acb2812df7ec788015cd32d4\\\",\\\"registry.redhat.io/redhat/redhat-operator-index@sha256:be02784ed82978c399102be1c6c9f2ca441be4d984e0fd7100c155dd4417ebbf\\\",\\\"registry.redhat.io/redhat/redhat-operator-index:v4.20\\\"],\\\"sizeBytes\\\":1597684406},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:85f1323d589d7af13b096b1f9b438b9dfe08f3fab37534e2780e6490a665bf05\\\"],\\\"sizeBytes\\\":1261384762},{\\\"names\\\":[\\\"registry.redhat.io/redhat/community-operator-index@sha256:0d50962980a5aeecae2d99c98913fb0f46940164e41de0af2ba0e3dafe0d9017\\\",\\\"registry.redhat.io/redhat/community-operator-index@sha256:8d607fb6cc75ca36bca1e0a9c5bea5d1919b75db20733df69c64c8a10ee8083d\\\",\\\"registry.redhat.io/redhat/community-operator-index:v4.20\\\"],\\\"sizeBytes\\\":1224304325},{\\\"names\\\":[\\\"registry.redhat.io/redhat/certified-operator-index@sha256:541db5b20a3d2199602b3b5ac80f09ea31498034e9ae3841238b03a39150f0d7\\\",\\\"registry.redhat.io/redhat/certified-operator-index@sha256:a4c5df55584cba56f00004a090923a5c6de2071add5eb1672a5e20aa646aad8c\\\",\\\"registry.redhat.io/redhat/certified-operator-index:v4.20\\\"],\\\"sizeBytes\\\":1126957757},{\\\"names\\\":[\\\"registry.redhat.io/redhat/redhat-marketplace-index@sha256:b1c859067d6b7b785ab4977ed7137c5b3bb257234f7d7737a1d2836cef1576b5\\\",\\\"registry.redhat.io/redhat/redhat-marketplace-index@sha256:df08951924aa23b2333436a1d04b2dba56c366bb4f09d39ae3aedb980e4fb909\\\",\\\"registry.redhat.io/redhat/redhat-marketplace-index:v4.20\\\"],\\\"sizeBytes\\\":1079537324},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9414357f9345a841e0565265700ecc6637f846c83bd5908dbb7b306432465115\\\"],\\\"sizeBytes\\\":1052707833},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8d1a1e4abe0326c3af89e9eaa4b7449dd2d5b6f9403c677e19b00b24947b1df9\\\"],\\\"sizeBytes\\\":989392005},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b2b1fc3d5bb4944cbd5b23b87566d7ba24b1b66f5a0465f76bcc05023191cc47\\\"],\\\"sizeBytes\\\":971668163},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:be2edaed22535093bdb486afe5960ff4f3b0bd96f88dc1753b584cc28184a0b0\\\"],\\\"sizeBytes\\\":969078739},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7e3d6c8802ae53d6aecf38aa7b560d7892193806bdeb3d7c1637fac77c47fd1f\\\"],\\\"sizeBytes\\\":876488654},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\"],\\\"sizeBytes\\\":847332502},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:36c4867005702f0c4cbfcfa33f18a98596a6c9b1340b633c85ccef84a0c4f889\\\"],\\\"sizeBytes\\\":769516783},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1b55c029f731ebbde3c5580eef98a588264f4d6a8ae667805c9521dd1ecf1d5d\\\"],\\\"sizeBytes\\\":721591926},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf05b9b2ba66351a6c59f4259fb377f62237a00af3b4f0b95f64409e2f25770e\\\"],\\\"sizeBytes\\\":646867625},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a8581a82ba5c8343a743aa302c4848249d8c32a9f2cd10fa68d89d835a1bdf8b\\\"],\\\"sizeBytes\\\":638910445},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ae245c97fc463e876c3024efb806fa8f4efb13b3f06f1bdd3e7e1447f5a5dce4\\\"],\\\"sizeBytes\\\":617699779},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d4926e304011637ca9df370a193896d685f0f3ffabbec234ec827abdbeb083f9\\\"],\\\"sizeBytes\\\":607756695},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5c5d7468f6838b6a714482e62ea956659212f3415ec8f69989f75eb6d8744a6e\\\"],\\\"sizeBytes\\\":584721741},{\\\"names\\\":[\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\\\"],\\\"sizeBytes\\\":545674969},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:574d49b89604b8e8103abf57feee77812fe8cf441eafc17fdff95d57ca80645e\\\"],\\\"sizeBytes\\\":542463064},{\\\"names\\\":[\\\"quay.io/crcont/openshift-crc-cluster-kube-controller-manager-operator@sha256:f69b9cc9b9cfde726109a9e12b80a3eefa472d7e29159df0fbc7143c48983cd6\\\"],\\\"sizeBytes\\\":539380592},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9506bdcf97d5200cf2cf4cdf110aebafdd141a24f6589bf1e1cfe27bb7fc1ed2\\\"],\\\"sizeBytes\\\":533027808},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\"],\\\"sizeBytes\\\":528200501},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5a2a7b3c2f1598189d8880e6aa15ab11a65b201f25012f77ba41e7487a60729a\\\"],\\\"sizeBytes\\\":527774342},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e5e8108294b086fdb797365e5a46badba9b3d866bdcddc8460a51e05a253753d\\\"],\\\"sizeBytes\\\":526632426},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5827f6ae3beb4853192e02cc18890467bd251b33070f36f9a105991e7e6d3c9b\\\"],\\\"sizeBytes\\\":522490210},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:66c8fe5d45ff249643dae75185dd2787ea1b0ae87d5699a8222149c07689557c\\\"],\\\"sizeBytes\\\":520141094},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:baf975b6944f2844860c440636e0d4b80b2fdc473d30f32ae7d6989f2fc2b135\\\"],\\\"sizeBytes\\\":519815758},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:765cf9c3ebf4df049ebc022beaaf52f52852cf89fb802034536ad91dd45db807\\\"],\\\"sizeBytes\\\":519539350},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:52e442bc8198ac925caff87ddd35b3107b7375d5afc9c2eb041ca4e79db72c6f\\\"],\\\"sizeBytes\\\":518690683},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:43b0e0b7e1955ee905e48799a62f50b8a8df553190415ce1f5550375c2507ca5\\\"],\\\"sizeBytes\\\":518251952},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:977a316fa3598eb575a4477dafc09bbf06fad21c4ec2867052225d74f2a9f366\\\"],\\\"sizeBytes\\\":511136541},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e504172345491d90bbbf1e7e45488e73073f4c6d7c2355245871051596fc85db\\\"],\\\"sizeBytes\\\":510122097},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dbd8603d717c26901bcf9731b1e0392ae4bc08a270ed1eeb45839e44bed9607d\\\"],\\\"sizeBytes\\\":508941917},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7c6a47106effd9e9a41131e2bf6c832b80cd77b3439334f760b35b0729f2fb00\\\"],\\\"sizeBytes\\\":508318343},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7a726c68cebc9b08edd734a8bae5150ae5950f7734fe9b9c2a6e0d06f21cc095\\\"],\\\"sizeBytes\\\":498380948},{\\\"names\\\":[\\\"quay.io/crcont/ocp-release@sha256:82501261b9c63012ba3b83fe4d6703c0af5eb9c9151670eb90ae480b9507d761\\\"],\\\"sizeBytes\\\":497232440},{\\\"names\\\":[\\\"registry.redhat.io/openshift4/ose-csi-external-provisioner@sha256:4e4239621caed0b0d9132d167403631e9af86be9a395977f013e201ead281bb4\\\",\\\"registry.redhat.io/openshift4/ose-csi-external-provisioner@sha256:c0b1bec73fdb6853eb3bd9e9733aee2d760ca09a33cfd94adf9ab7b706e83fa9\\\",\\\"registry.redhat.io/openshift4/ose-csi-external-provisioner:latest\\\"],\\\"sizeBytes\\\":491224335},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b0f7abf2f97afd1127d9245d764338c6047bac1711b2cee43112570a85946360\\\"],\\\"sizeBytes\\\":490381192},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:21b12ff0c81c1d535e7c31aff3a73b1e9ca763e5f88037f59ade0dfab6ed8946\\\"],\\\"sizeBytes\\\":482632652},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:036ed6efe4cb5f5b90ee7f9ef5297c8591b8d67aa36b3c58b4fc5417622a140c\\\"],\\\"sizeBytes\\\":477561861},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0fe5a041a2b99d736e82f1b4a6cd9792c5e23ded475e9f0742cd19234070f989\\\"],\\\"sizeBytes\\\":475327956},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dcb03ccba25366bbdf74cbab6738e7ef1f97f62760886ec445a40cdf29b60418\\\"],\\\"sizeBytes\\\":475137830},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2599f32933f5fea6066ede54ad8f6150adb7bd9067892f251d5913121d5c630d\\\"],\\\"sizeBytes\\\":472771950},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:651bbe9d418f49c2c889d731df67cf5d88dff59dc03f5a1b5d4c8bb3ae001f1a\\\"],\\\"sizeBytes\\\":469976318},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4fe612a1572df462d6a4b664a10bc2e6cad239648acbf8c0303f8fca5d2596c0\\\"],\\\"sizeBytes\\\":468393024},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a5bb05344dd2296077f5066e908ede0eea23f5a12fb78ef86a9513c88d3faaca\\\"],\\\"sizeBytes\\\":464375011},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\"],\\\"sizeBytes\\\":462844959}],\\\"nodeInfo\\\":{\\\"bootID\\\":\\\"3cdf81b4-f597-401a-9b99-34aaa64fb798\\\",\\\"systemUUID\\\":\\\"c6072c61-a7eb-44bd-85f7-eb9fdb0e84de\\\"}}}\" for node \"crc\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/node?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 15:32:47 crc kubenswrapper[5120]: I0316 15:32:47.032736 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:32:47 crc kubenswrapper[5120]: I0316 15:32:47.032787 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:32:47 crc kubenswrapper[5120]: I0316 15:32:47.032798 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:32:47 crc kubenswrapper[5120]: I0316 15:32:47.032812 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 15:32:47 crc kubenswrapper[5120]: I0316 15:32:47.032821 5120 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T15:32:47Z","lastTransitionTime":"2026-03-16T15:32:47Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 15:32:47 crc kubenswrapper[5120]: E0316 15:32:47.041662 5120 kubelet_node_status.go:597] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"allocatable\\\":{\\\"cpu\\\":\\\"11800m\\\",\\\"ephemeral-storage\\\":\\\"76396645454\\\",\\\"memory\\\":\\\"32400460Ki\\\"},\\\"capacity\\\":{\\\"cpu\\\":\\\"12\\\",\\\"ephemeral-storage\\\":\\\"83293888Ki\\\",\\\"memory\\\":\\\"32861260Ki\\\"},\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T15:32:47Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T15:32:47Z\\\",\\\"message\\\":\\\"kubelet has sufficient memory available\\\",\\\"reason\\\":\\\"KubeletHasSufficientMemory\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T15:32:47Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T15:32:47Z\\\",\\\"message\\\":\\\"kubelet has no disk pressure\\\",\\\"reason\\\":\\\"KubeletHasNoDiskPressure\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T15:32:47Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T15:32:47Z\\\",\\\"message\\\":\\\"kubelet has sufficient PID available\\\",\\\"reason\\\":\\\"KubeletHasSufficientPID\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T15:32:47Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T15:32:47Z\\\",\\\"message\\\":\\\"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?\\\",\\\"reason\\\":\\\"KubeletNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7c8a088031661d94022418e93fb63744c38e1c4cff93ea3b95c096a290c2b7a3\\\"],\\\"sizeBytes\\\":2981840865},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\"],\\\"sizeBytes\\\":1641503854},{\\\"names\\\":[\\\"registry.redhat.io/redhat/redhat-operator-index@sha256:286bb0beab328954b0a86b7f066fd5a843b462d6acb2812df7ec788015cd32d4\\\",\\\"registry.redhat.io/redhat/redhat-operator-index@sha256:be02784ed82978c399102be1c6c9f2ca441be4d984e0fd7100c155dd4417ebbf\\\",\\\"registry.redhat.io/redhat/redhat-operator-index:v4.20\\\"],\\\"sizeBytes\\\":1597684406},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:85f1323d589d7af13b096b1f9b438b9dfe08f3fab37534e2780e6490a665bf05\\\"],\\\"sizeBytes\\\":1261384762},{\\\"names\\\":[\\\"registry.redhat.io/redhat/community-operator-index@sha256:0d50962980a5aeecae2d99c98913fb0f46940164e41de0af2ba0e3dafe0d9017\\\",\\\"registry.redhat.io/redhat/community-operator-index@sha256:8d607fb6cc75ca36bca1e0a9c5bea5d1919b75db20733df69c64c8a10ee8083d\\\",\\\"registry.redhat.io/redhat/community-operator-index:v4.20\\\"],\\\"sizeBytes\\\":1224304325},{\\\"names\\\":[\\\"registry.redhat.io/redhat/certified-operator-index@sha256:541db5b20a3d2199602b3b5ac80f09ea31498034e9ae3841238b03a39150f0d7\\\",\\\"registry.redhat.io/redhat/certified-operator-index@sha256:a4c5df55584cba56f00004a090923a5c6de2071add5eb1672a5e20aa646aad8c\\\",\\\"registry.redhat.io/redhat/certified-operator-index:v4.20\\\"],\\\"sizeBytes\\\":1126957757},{\\\"names\\\":[\\\"registry.redhat.io/redhat/redhat-marketplace-index@sha256:b1c859067d6b7b785ab4977ed7137c5b3bb257234f7d7737a1d2836cef1576b5\\\",\\\"registry.redhat.io/redhat/redhat-marketplace-index@sha256:df08951924aa23b2333436a1d04b2dba56c366bb4f09d39ae3aedb980e4fb909\\\",\\\"registry.redhat.io/redhat/redhat-marketplace-index:v4.20\\\"],\\\"sizeBytes\\\":1079537324},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9414357f9345a841e0565265700ecc6637f846c83bd5908dbb7b306432465115\\\"],\\\"sizeBytes\\\":1052707833},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8d1a1e4abe0326c3af89e9eaa4b7449dd2d5b6f9403c677e19b00b24947b1df9\\\"],\\\"sizeBytes\\\":989392005},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b2b1fc3d5bb4944cbd5b23b87566d7ba24b1b66f5a0465f76bcc05023191cc47\\\"],\\\"sizeBytes\\\":971668163},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:be2edaed22535093bdb486afe5960ff4f3b0bd96f88dc1753b584cc28184a0b0\\\"],\\\"sizeBytes\\\":969078739},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7e3d6c8802ae53d6aecf38aa7b560d7892193806bdeb3d7c1637fac77c47fd1f\\\"],\\\"sizeBytes\\\":876488654},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\"],\\\"sizeBytes\\\":847332502},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:36c4867005702f0c4cbfcfa33f18a98596a6c9b1340b633c85ccef84a0c4f889\\\"],\\\"sizeBytes\\\":769516783},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1b55c029f731ebbde3c5580eef98a588264f4d6a8ae667805c9521dd1ecf1d5d\\\"],\\\"sizeBytes\\\":721591926},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf05b9b2ba66351a6c59f4259fb377f62237a00af3b4f0b95f64409e2f25770e\\\"],\\\"sizeBytes\\\":646867625},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a8581a82ba5c8343a743aa302c4848249d8c32a9f2cd10fa68d89d835a1bdf8b\\\"],\\\"sizeBytes\\\":638910445},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ae245c97fc463e876c3024efb806fa8f4efb13b3f06f1bdd3e7e1447f5a5dce4\\\"],\\\"sizeBytes\\\":617699779},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d4926e304011637ca9df370a193896d685f0f3ffabbec234ec827abdbeb083f9\\\"],\\\"sizeBytes\\\":607756695},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5c5d7468f6838b6a714482e62ea956659212f3415ec8f69989f75eb6d8744a6e\\\"],\\\"sizeBytes\\\":584721741},{\\\"names\\\":[\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\\\"],\\\"sizeBytes\\\":545674969},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:574d49b89604b8e8103abf57feee77812fe8cf441eafc17fdff95d57ca80645e\\\"],\\\"sizeBytes\\\":542463064},{\\\"names\\\":[\\\"quay.io/crcont/openshift-crc-cluster-kube-controller-manager-operator@sha256:f69b9cc9b9cfde726109a9e12b80a3eefa472d7e29159df0fbc7143c48983cd6\\\"],\\\"sizeBytes\\\":539380592},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9506bdcf97d5200cf2cf4cdf110aebafdd141a24f6589bf1e1cfe27bb7fc1ed2\\\"],\\\"sizeBytes\\\":533027808},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\"],\\\"sizeBytes\\\":528200501},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5a2a7b3c2f1598189d8880e6aa15ab11a65b201f25012f77ba41e7487a60729a\\\"],\\\"sizeBytes\\\":527774342},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e5e8108294b086fdb797365e5a46badba9b3d866bdcddc8460a51e05a253753d\\\"],\\\"sizeBytes\\\":526632426},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5827f6ae3beb4853192e02cc18890467bd251b33070f36f9a105991e7e6d3c9b\\\"],\\\"sizeBytes\\\":522490210},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:66c8fe5d45ff249643dae75185dd2787ea1b0ae87d5699a8222149c07689557c\\\"],\\\"sizeBytes\\\":520141094},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:baf975b6944f2844860c440636e0d4b80b2fdc473d30f32ae7d6989f2fc2b135\\\"],\\\"sizeBytes\\\":519815758},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:765cf9c3ebf4df049ebc022beaaf52f52852cf89fb802034536ad91dd45db807\\\"],\\\"sizeBytes\\\":519539350},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:52e442bc8198ac925caff87ddd35b3107b7375d5afc9c2eb041ca4e79db72c6f\\\"],\\\"sizeBytes\\\":518690683},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:43b0e0b7e1955ee905e48799a62f50b8a8df553190415ce1f5550375c2507ca5\\\"],\\\"sizeBytes\\\":518251952},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:977a316fa3598eb575a4477dafc09bbf06fad21c4ec2867052225d74f2a9f366\\\"],\\\"sizeBytes\\\":511136541},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e504172345491d90bbbf1e7e45488e73073f4c6d7c2355245871051596fc85db\\\"],\\\"sizeBytes\\\":510122097},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dbd8603d717c26901bcf9731b1e0392ae4bc08a270ed1eeb45839e44bed9607d\\\"],\\\"sizeBytes\\\":508941917},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7c6a47106effd9e9a41131e2bf6c832b80cd77b3439334f760b35b0729f2fb00\\\"],\\\"sizeBytes\\\":508318343},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7a726c68cebc9b08edd734a8bae5150ae5950f7734fe9b9c2a6e0d06f21cc095\\\"],\\\"sizeBytes\\\":498380948},{\\\"names\\\":[\\\"quay.io/crcont/ocp-release@sha256:82501261b9c63012ba3b83fe4d6703c0af5eb9c9151670eb90ae480b9507d761\\\"],\\\"sizeBytes\\\":497232440},{\\\"names\\\":[\\\"registry.redhat.io/openshift4/ose-csi-external-provisioner@sha256:4e4239621caed0b0d9132d167403631e9af86be9a395977f013e201ead281bb4\\\",\\\"registry.redhat.io/openshift4/ose-csi-external-provisioner@sha256:c0b1bec73fdb6853eb3bd9e9733aee2d760ca09a33cfd94adf9ab7b706e83fa9\\\",\\\"registry.redhat.io/openshift4/ose-csi-external-provisioner:latest\\\"],\\\"sizeBytes\\\":491224335},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b0f7abf2f97afd1127d9245d764338c6047bac1711b2cee43112570a85946360\\\"],\\\"sizeBytes\\\":490381192},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:21b12ff0c81c1d535e7c31aff3a73b1e9ca763e5f88037f59ade0dfab6ed8946\\\"],\\\"sizeBytes\\\":482632652},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:036ed6efe4cb5f5b90ee7f9ef5297c8591b8d67aa36b3c58b4fc5417622a140c\\\"],\\\"sizeBytes\\\":477561861},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0fe5a041a2b99d736e82f1b4a6cd9792c5e23ded475e9f0742cd19234070f989\\\"],\\\"sizeBytes\\\":475327956},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dcb03ccba25366bbdf74cbab6738e7ef1f97f62760886ec445a40cdf29b60418\\\"],\\\"sizeBytes\\\":475137830},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2599f32933f5fea6066ede54ad8f6150adb7bd9067892f251d5913121d5c630d\\\"],\\\"sizeBytes\\\":472771950},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:651bbe9d418f49c2c889d731df67cf5d88dff59dc03f5a1b5d4c8bb3ae001f1a\\\"],\\\"sizeBytes\\\":469976318},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4fe612a1572df462d6a4b664a10bc2e6cad239648acbf8c0303f8fca5d2596c0\\\"],\\\"sizeBytes\\\":468393024},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a5bb05344dd2296077f5066e908ede0eea23f5a12fb78ef86a9513c88d3faaca\\\"],\\\"sizeBytes\\\":464375011},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\"],\\\"sizeBytes\\\":462844959}],\\\"nodeInfo\\\":{\\\"bootID\\\":\\\"3cdf81b4-f597-401a-9b99-34aaa64fb798\\\",\\\"systemUUID\\\":\\\"c6072c61-a7eb-44bd-85f7-eb9fdb0e84de\\\"}}}\" for node \"crc\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/node?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 15:32:47 crc kubenswrapper[5120]: E0316 15:32:47.041878 5120 kubelet_node_status.go:584] "Unable to update node status" err="update node status exceeds retry count" Mar 16 15:32:47 crc kubenswrapper[5120]: E0316 15:32:47.041913 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:47 crc kubenswrapper[5120]: E0316 15:32:47.142819 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:47 crc kubenswrapper[5120]: E0316 15:32:47.243403 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:47 crc kubenswrapper[5120]: E0316 15:32:47.344031 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:47 crc kubenswrapper[5120]: E0316 15:32:47.445172 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:47 crc kubenswrapper[5120]: E0316 15:32:47.545488 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:47 crc kubenswrapper[5120]: E0316 15:32:47.645792 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:47 crc kubenswrapper[5120]: I0316 15:32:47.663104 5120 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 15:32:47 crc kubenswrapper[5120]: I0316 15:32:47.663960 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:32:47 crc kubenswrapper[5120]: I0316 15:32:47.664000 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:32:47 crc kubenswrapper[5120]: I0316 15:32:47.664010 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:32:47 crc kubenswrapper[5120]: E0316 15:32:47.664386 5120 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"crc\" not found" node="crc" Mar 16 15:32:47 crc kubenswrapper[5120]: E0316 15:32:47.745892 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:47 crc kubenswrapper[5120]: E0316 15:32:47.846372 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:47 crc kubenswrapper[5120]: I0316 15:32:47.929567 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_kube-apiserver-crc_3a14caf222afb62aaabdc47808b6f944/kube-apiserver-check-endpoints/3.log" Mar 16 15:32:47 crc kubenswrapper[5120]: I0316 15:32:47.930333 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_kube-apiserver-crc_3a14caf222afb62aaabdc47808b6f944/kube-apiserver-check-endpoints/2.log" Mar 16 15:32:47 crc kubenswrapper[5120]: I0316 15:32:47.932468 5120 generic.go:358] "Generic (PLEG): container finished" podID="3a14caf222afb62aaabdc47808b6f944" containerID="2e9f531a9c0fc8cf5222ce7e135c4f37d008306df727f84312cc5d7d2c740ac6" exitCode=255 Mar 16 15:32:47 crc kubenswrapper[5120]: I0316 15:32:47.932536 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-crc" event={"ID":"3a14caf222afb62aaabdc47808b6f944","Type":"ContainerDied","Data":"2e9f531a9c0fc8cf5222ce7e135c4f37d008306df727f84312cc5d7d2c740ac6"} Mar 16 15:32:47 crc kubenswrapper[5120]: I0316 15:32:47.932573 5120 scope.go:117] "RemoveContainer" containerID="35e69f457a6e412bd82461108cf315f79810a6c72a91e0d83765a5e275c83ef8" Mar 16 15:32:47 crc kubenswrapper[5120]: I0316 15:32:47.932855 5120 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 15:32:47 crc kubenswrapper[5120]: I0316 15:32:47.933550 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:32:47 crc kubenswrapper[5120]: I0316 15:32:47.933600 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:32:47 crc kubenswrapper[5120]: I0316 15:32:47.933618 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:32:47 crc kubenswrapper[5120]: E0316 15:32:47.934254 5120 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"crc\" not found" node="crc" Mar 16 15:32:47 crc kubenswrapper[5120]: I0316 15:32:47.934590 5120 scope.go:117] "RemoveContainer" containerID="2e9f531a9c0fc8cf5222ce7e135c4f37d008306df727f84312cc5d7d2c740ac6" Mar 16 15:32:47 crc kubenswrapper[5120]: E0316 15:32:47.934983 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-apiserver-check-endpoints\" with CrashLoopBackOff: \"back-off 40s restarting failed container=kube-apiserver-check-endpoints pod=kube-apiserver-crc_openshift-kube-apiserver(3a14caf222afb62aaabdc47808b6f944)\"" pod="openshift-kube-apiserver/kube-apiserver-crc" podUID="3a14caf222afb62aaabdc47808b6f944" Mar 16 15:32:47 crc kubenswrapper[5120]: E0316 15:32:47.946526 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:48 crc kubenswrapper[5120]: E0316 15:32:48.047541 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:48 crc kubenswrapper[5120]: I0316 15:32:48.087655 5120 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-kube-apiserver/kube-apiserver-crc" Mar 16 15:32:48 crc kubenswrapper[5120]: E0316 15:32:48.147921 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:48 crc kubenswrapper[5120]: E0316 15:32:48.248749 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:48 crc kubenswrapper[5120]: E0316 15:32:48.349710 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:48 crc kubenswrapper[5120]: E0316 15:32:48.450299 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:48 crc kubenswrapper[5120]: E0316 15:32:48.550896 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:48 crc kubenswrapper[5120]: E0316 15:32:48.651858 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:48 crc kubenswrapper[5120]: E0316 15:32:48.725443 5120 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"crc\" not found" Mar 16 15:32:48 crc kubenswrapper[5120]: E0316 15:32:48.751992 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:48 crc kubenswrapper[5120]: E0316 15:32:48.852120 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:48 crc kubenswrapper[5120]: I0316 15:32:48.936821 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_kube-apiserver-crc_3a14caf222afb62aaabdc47808b6f944/kube-apiserver-check-endpoints/3.log" Mar 16 15:32:48 crc kubenswrapper[5120]: I0316 15:32:48.938887 5120 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 15:32:48 crc kubenswrapper[5120]: I0316 15:32:48.939701 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:32:48 crc kubenswrapper[5120]: I0316 15:32:48.939729 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:32:48 crc kubenswrapper[5120]: I0316 15:32:48.939738 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:32:48 crc kubenswrapper[5120]: E0316 15:32:48.940080 5120 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"crc\" not found" node="crc" Mar 16 15:32:48 crc kubenswrapper[5120]: I0316 15:32:48.940266 5120 scope.go:117] "RemoveContainer" containerID="2e9f531a9c0fc8cf5222ce7e135c4f37d008306df727f84312cc5d7d2c740ac6" Mar 16 15:32:48 crc kubenswrapper[5120]: E0316 15:32:48.940427 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-apiserver-check-endpoints\" with CrashLoopBackOff: \"back-off 40s restarting failed container=kube-apiserver-check-endpoints pod=kube-apiserver-crc_openshift-kube-apiserver(3a14caf222afb62aaabdc47808b6f944)\"" pod="openshift-kube-apiserver/kube-apiserver-crc" podUID="3a14caf222afb62aaabdc47808b6f944" Mar 16 15:32:48 crc kubenswrapper[5120]: E0316 15:32:48.952554 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:49 crc kubenswrapper[5120]: E0316 15:32:49.053615 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:49 crc kubenswrapper[5120]: E0316 15:32:49.154808 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:49 crc kubenswrapper[5120]: E0316 15:32:49.255171 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:49 crc kubenswrapper[5120]: E0316 15:32:49.355815 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:49 crc kubenswrapper[5120]: E0316 15:32:49.456674 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:49 crc kubenswrapper[5120]: E0316 15:32:49.557958 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:49 crc kubenswrapper[5120]: E0316 15:32:49.658934 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:49 crc kubenswrapper[5120]: E0316 15:32:49.759571 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:49 crc kubenswrapper[5120]: E0316 15:32:49.860216 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:49 crc kubenswrapper[5120]: E0316 15:32:49.960496 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:49 crc kubenswrapper[5120]: I0316 15:32:49.980143 5120 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Mar 16 15:32:50 crc kubenswrapper[5120]: E0316 15:32:50.061304 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:50 crc kubenswrapper[5120]: E0316 15:32:50.162249 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:50 crc kubenswrapper[5120]: E0316 15:32:50.262652 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:50 crc kubenswrapper[5120]: E0316 15:32:50.363617 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:50 crc kubenswrapper[5120]: E0316 15:32:50.463944 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:50 crc kubenswrapper[5120]: E0316 15:32:50.564234 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:50 crc kubenswrapper[5120]: E0316 15:32:50.664513 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:50 crc kubenswrapper[5120]: E0316 15:32:50.765333 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:50 crc kubenswrapper[5120]: E0316 15:32:50.866176 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:50 crc kubenswrapper[5120]: E0316 15:32:50.966792 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:51 crc kubenswrapper[5120]: E0316 15:32:51.067564 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:51 crc kubenswrapper[5120]: E0316 15:32:51.168713 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:51 crc kubenswrapper[5120]: E0316 15:32:51.269712 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:51 crc kubenswrapper[5120]: E0316 15:32:51.370113 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:51 crc kubenswrapper[5120]: E0316 15:32:51.470511 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:51 crc kubenswrapper[5120]: E0316 15:32:51.571656 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:51 crc kubenswrapper[5120]: E0316 15:32:51.672835 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:51 crc kubenswrapper[5120]: E0316 15:32:51.773677 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:51 crc kubenswrapper[5120]: E0316 15:32:51.874214 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:51 crc kubenswrapper[5120]: E0316 15:32:51.975148 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:52 crc kubenswrapper[5120]: E0316 15:32:52.075877 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:52 crc kubenswrapper[5120]: E0316 15:32:52.176392 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:52 crc kubenswrapper[5120]: E0316 15:32:52.276682 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:52 crc kubenswrapper[5120]: E0316 15:32:52.377790 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:52 crc kubenswrapper[5120]: E0316 15:32:52.478115 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:52 crc kubenswrapper[5120]: E0316 15:32:52.579333 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:52 crc kubenswrapper[5120]: E0316 15:32:52.680133 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:52 crc kubenswrapper[5120]: E0316 15:32:52.780836 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:52 crc kubenswrapper[5120]: E0316 15:32:52.881561 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:52 crc kubenswrapper[5120]: E0316 15:32:52.981988 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:53 crc kubenswrapper[5120]: E0316 15:32:53.082475 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:53 crc kubenswrapper[5120]: E0316 15:32:53.182625 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:53 crc kubenswrapper[5120]: E0316 15:32:53.283772 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:53 crc kubenswrapper[5120]: E0316 15:32:53.384786 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:53 crc kubenswrapper[5120]: E0316 15:32:53.485297 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:53 crc kubenswrapper[5120]: E0316 15:32:53.585743 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:53 crc kubenswrapper[5120]: E0316 15:32:53.686548 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:53 crc kubenswrapper[5120]: E0316 15:32:53.787386 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:53 crc kubenswrapper[5120]: E0316 15:32:53.887619 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:53 crc kubenswrapper[5120]: E0316 15:32:53.988592 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:54 crc kubenswrapper[5120]: E0316 15:32:54.089712 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:54 crc kubenswrapper[5120]: E0316 15:32:54.190469 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:54 crc kubenswrapper[5120]: E0316 15:32:54.290819 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:54 crc kubenswrapper[5120]: E0316 15:32:54.391737 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:54 crc kubenswrapper[5120]: E0316 15:32:54.492098 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:54 crc kubenswrapper[5120]: E0316 15:32:54.592855 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:54 crc kubenswrapper[5120]: E0316 15:32:54.693997 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:54 crc kubenswrapper[5120]: E0316 15:32:54.794450 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:54 crc kubenswrapper[5120]: E0316 15:32:54.894966 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:54 crc kubenswrapper[5120]: E0316 15:32:54.996047 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:55 crc kubenswrapper[5120]: E0316 15:32:55.096511 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:55 crc kubenswrapper[5120]: E0316 15:32:55.197219 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:55 crc kubenswrapper[5120]: E0316 15:32:55.297391 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:55 crc kubenswrapper[5120]: E0316 15:32:55.398054 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:55 crc kubenswrapper[5120]: E0316 15:32:55.498140 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:55 crc kubenswrapper[5120]: E0316 15:32:55.598574 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:55 crc kubenswrapper[5120]: E0316 15:32:55.699294 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:55 crc kubenswrapper[5120]: E0316 15:32:55.799585 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:55 crc kubenswrapper[5120]: E0316 15:32:55.900424 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:56 crc kubenswrapper[5120]: E0316 15:32:56.001511 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:56 crc kubenswrapper[5120]: E0316 15:32:56.101895 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:56 crc kubenswrapper[5120]: E0316 15:32:56.202284 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:56 crc kubenswrapper[5120]: E0316 15:32:56.302672 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:56 crc kubenswrapper[5120]: E0316 15:32:56.403261 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:56 crc kubenswrapper[5120]: E0316 15:32:56.503784 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:56 crc kubenswrapper[5120]: E0316 15:32:56.604366 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:56 crc kubenswrapper[5120]: E0316 15:32:56.705051 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:56 crc kubenswrapper[5120]: E0316 15:32:56.805844 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:56 crc kubenswrapper[5120]: E0316 15:32:56.906854 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:56 crc kubenswrapper[5120]: I0316 15:32:56.926266 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-kube-apiserver/kube-apiserver-crc" Mar 16 15:32:56 crc kubenswrapper[5120]: I0316 15:32:56.926610 5120 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 15:32:56 crc kubenswrapper[5120]: I0316 15:32:56.927914 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:32:56 crc kubenswrapper[5120]: I0316 15:32:56.928001 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:32:56 crc kubenswrapper[5120]: I0316 15:32:56.928021 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:32:56 crc kubenswrapper[5120]: E0316 15:32:56.928714 5120 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"crc\" not found" node="crc" Mar 16 15:32:56 crc kubenswrapper[5120]: I0316 15:32:56.929154 5120 scope.go:117] "RemoveContainer" containerID="2e9f531a9c0fc8cf5222ce7e135c4f37d008306df727f84312cc5d7d2c740ac6" Mar 16 15:32:56 crc kubenswrapper[5120]: E0316 15:32:56.929454 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-apiserver-check-endpoints\" with CrashLoopBackOff: \"back-off 40s restarting failed container=kube-apiserver-check-endpoints pod=kube-apiserver-crc_openshift-kube-apiserver(3a14caf222afb62aaabdc47808b6f944)\"" pod="openshift-kube-apiserver/kube-apiserver-crc" podUID="3a14caf222afb62aaabdc47808b6f944" Mar 16 15:32:57 crc kubenswrapper[5120]: E0316 15:32:57.007737 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:57 crc kubenswrapper[5120]: E0316 15:32:57.108282 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:57 crc kubenswrapper[5120]: E0316 15:32:57.208476 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:57 crc kubenswrapper[5120]: E0316 15:32:57.309261 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:57 crc kubenswrapper[5120]: E0316 15:32:57.334516 5120 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"crc\": node \"crc\" not found" Mar 16 15:32:57 crc kubenswrapper[5120]: I0316 15:32:57.339847 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:32:57 crc kubenswrapper[5120]: I0316 15:32:57.339911 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:32:57 crc kubenswrapper[5120]: I0316 15:32:57.339934 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:32:57 crc kubenswrapper[5120]: I0316 15:32:57.339981 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 15:32:57 crc kubenswrapper[5120]: I0316 15:32:57.340085 5120 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T15:32:57Z","lastTransitionTime":"2026-03-16T15:32:57Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 15:32:57 crc kubenswrapper[5120]: E0316 15:32:57.356350 5120 kubelet_node_status.go:597] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"allocatable\\\":{\\\"cpu\\\":\\\"11800m\\\",\\\"ephemeral-storage\\\":\\\"76396645454\\\",\\\"memory\\\":\\\"32400460Ki\\\"},\\\"capacity\\\":{\\\"cpu\\\":\\\"12\\\",\\\"ephemeral-storage\\\":\\\"83293888Ki\\\",\\\"memory\\\":\\\"32861260Ki\\\"},\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T15:32:57Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T15:32:57Z\\\",\\\"message\\\":\\\"kubelet has sufficient memory available\\\",\\\"reason\\\":\\\"KubeletHasSufficientMemory\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T15:32:57Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T15:32:57Z\\\",\\\"message\\\":\\\"kubelet has no disk pressure\\\",\\\"reason\\\":\\\"KubeletHasNoDiskPressure\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T15:32:57Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T15:32:57Z\\\",\\\"message\\\":\\\"kubelet has sufficient PID available\\\",\\\"reason\\\":\\\"KubeletHasSufficientPID\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T15:32:57Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T15:32:57Z\\\",\\\"message\\\":\\\"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?\\\",\\\"reason\\\":\\\"KubeletNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7c8a088031661d94022418e93fb63744c38e1c4cff93ea3b95c096a290c2b7a3\\\"],\\\"sizeBytes\\\":2981840865},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\"],\\\"sizeBytes\\\":1641503854},{\\\"names\\\":[\\\"registry.redhat.io/redhat/redhat-operator-index@sha256:286bb0beab328954b0a86b7f066fd5a843b462d6acb2812df7ec788015cd32d4\\\",\\\"registry.redhat.io/redhat/redhat-operator-index@sha256:be02784ed82978c399102be1c6c9f2ca441be4d984e0fd7100c155dd4417ebbf\\\",\\\"registry.redhat.io/redhat/redhat-operator-index:v4.20\\\"],\\\"sizeBytes\\\":1597684406},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:85f1323d589d7af13b096b1f9b438b9dfe08f3fab37534e2780e6490a665bf05\\\"],\\\"sizeBytes\\\":1261384762},{\\\"names\\\":[\\\"registry.redhat.io/redhat/community-operator-index@sha256:0d50962980a5aeecae2d99c98913fb0f46940164e41de0af2ba0e3dafe0d9017\\\",\\\"registry.redhat.io/redhat/community-operator-index@sha256:8d607fb6cc75ca36bca1e0a9c5bea5d1919b75db20733df69c64c8a10ee8083d\\\",\\\"registry.redhat.io/redhat/community-operator-index:v4.20\\\"],\\\"sizeBytes\\\":1224304325},{\\\"names\\\":[\\\"registry.redhat.io/redhat/certified-operator-index@sha256:541db5b20a3d2199602b3b5ac80f09ea31498034e9ae3841238b03a39150f0d7\\\",\\\"registry.redhat.io/redhat/certified-operator-index@sha256:a4c5df55584cba56f00004a090923a5c6de2071add5eb1672a5e20aa646aad8c\\\",\\\"registry.redhat.io/redhat/certified-operator-index:v4.20\\\"],\\\"sizeBytes\\\":1126957757},{\\\"names\\\":[\\\"registry.redhat.io/redhat/redhat-marketplace-index@sha256:b1c859067d6b7b785ab4977ed7137c5b3bb257234f7d7737a1d2836cef1576b5\\\",\\\"registry.redhat.io/redhat/redhat-marketplace-index@sha256:df08951924aa23b2333436a1d04b2dba56c366bb4f09d39ae3aedb980e4fb909\\\",\\\"registry.redhat.io/redhat/redhat-marketplace-index:v4.20\\\"],\\\"sizeBytes\\\":1079537324},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9414357f9345a841e0565265700ecc6637f846c83bd5908dbb7b306432465115\\\"],\\\"sizeBytes\\\":1052707833},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8d1a1e4abe0326c3af89e9eaa4b7449dd2d5b6f9403c677e19b00b24947b1df9\\\"],\\\"sizeBytes\\\":989392005},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b2b1fc3d5bb4944cbd5b23b87566d7ba24b1b66f5a0465f76bcc05023191cc47\\\"],\\\"sizeBytes\\\":971668163},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:be2edaed22535093bdb486afe5960ff4f3b0bd96f88dc1753b584cc28184a0b0\\\"],\\\"sizeBytes\\\":969078739},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7e3d6c8802ae53d6aecf38aa7b560d7892193806bdeb3d7c1637fac77c47fd1f\\\"],\\\"sizeBytes\\\":876488654},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\"],\\\"sizeBytes\\\":847332502},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:36c4867005702f0c4cbfcfa33f18a98596a6c9b1340b633c85ccef84a0c4f889\\\"],\\\"sizeBytes\\\":769516783},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1b55c029f731ebbde3c5580eef98a588264f4d6a8ae667805c9521dd1ecf1d5d\\\"],\\\"sizeBytes\\\":721591926},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf05b9b2ba66351a6c59f4259fb377f62237a00af3b4f0b95f64409e2f25770e\\\"],\\\"sizeBytes\\\":646867625},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a8581a82ba5c8343a743aa302c4848249d8c32a9f2cd10fa68d89d835a1bdf8b\\\"],\\\"sizeBytes\\\":638910445},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ae245c97fc463e876c3024efb806fa8f4efb13b3f06f1bdd3e7e1447f5a5dce4\\\"],\\\"sizeBytes\\\":617699779},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d4926e304011637ca9df370a193896d685f0f3ffabbec234ec827abdbeb083f9\\\"],\\\"sizeBytes\\\":607756695},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5c5d7468f6838b6a714482e62ea956659212f3415ec8f69989f75eb6d8744a6e\\\"],\\\"sizeBytes\\\":584721741},{\\\"names\\\":[\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\\\"],\\\"sizeBytes\\\":545674969},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:574d49b89604b8e8103abf57feee77812fe8cf441eafc17fdff95d57ca80645e\\\"],\\\"sizeBytes\\\":542463064},{\\\"names\\\":[\\\"quay.io/crcont/openshift-crc-cluster-kube-controller-manager-operator@sha256:f69b9cc9b9cfde726109a9e12b80a3eefa472d7e29159df0fbc7143c48983cd6\\\"],\\\"sizeBytes\\\":539380592},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9506bdcf97d5200cf2cf4cdf110aebafdd141a24f6589bf1e1cfe27bb7fc1ed2\\\"],\\\"sizeBytes\\\":533027808},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\"],\\\"sizeBytes\\\":528200501},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5a2a7b3c2f1598189d8880e6aa15ab11a65b201f25012f77ba41e7487a60729a\\\"],\\\"sizeBytes\\\":527774342},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e5e8108294b086fdb797365e5a46badba9b3d866bdcddc8460a51e05a253753d\\\"],\\\"sizeBytes\\\":526632426},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5827f6ae3beb4853192e02cc18890467bd251b33070f36f9a105991e7e6d3c9b\\\"],\\\"sizeBytes\\\":522490210},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:66c8fe5d45ff249643dae75185dd2787ea1b0ae87d5699a8222149c07689557c\\\"],\\\"sizeBytes\\\":520141094},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:baf975b6944f2844860c440636e0d4b80b2fdc473d30f32ae7d6989f2fc2b135\\\"],\\\"sizeBytes\\\":519815758},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:765cf9c3ebf4df049ebc022beaaf52f52852cf89fb802034536ad91dd45db807\\\"],\\\"sizeBytes\\\":519539350},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:52e442bc8198ac925caff87ddd35b3107b7375d5afc9c2eb041ca4e79db72c6f\\\"],\\\"sizeBytes\\\":518690683},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:43b0e0b7e1955ee905e48799a62f50b8a8df553190415ce1f5550375c2507ca5\\\"],\\\"sizeBytes\\\":518251952},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:977a316fa3598eb575a4477dafc09bbf06fad21c4ec2867052225d74f2a9f366\\\"],\\\"sizeBytes\\\":511136541},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e504172345491d90bbbf1e7e45488e73073f4c6d7c2355245871051596fc85db\\\"],\\\"sizeBytes\\\":510122097},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dbd8603d717c26901bcf9731b1e0392ae4bc08a270ed1eeb45839e44bed9607d\\\"],\\\"sizeBytes\\\":508941917},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7c6a47106effd9e9a41131e2bf6c832b80cd77b3439334f760b35b0729f2fb00\\\"],\\\"sizeBytes\\\":508318343},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7a726c68cebc9b08edd734a8bae5150ae5950f7734fe9b9c2a6e0d06f21cc095\\\"],\\\"sizeBytes\\\":498380948},{\\\"names\\\":[\\\"quay.io/crcont/ocp-release@sha256:82501261b9c63012ba3b83fe4d6703c0af5eb9c9151670eb90ae480b9507d761\\\"],\\\"sizeBytes\\\":497232440},{\\\"names\\\":[\\\"registry.redhat.io/openshift4/ose-csi-external-provisioner@sha256:4e4239621caed0b0d9132d167403631e9af86be9a395977f013e201ead281bb4\\\",\\\"registry.redhat.io/openshift4/ose-csi-external-provisioner@sha256:c0b1bec73fdb6853eb3bd9e9733aee2d760ca09a33cfd94adf9ab7b706e83fa9\\\",\\\"registry.redhat.io/openshift4/ose-csi-external-provisioner:latest\\\"],\\\"sizeBytes\\\":491224335},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b0f7abf2f97afd1127d9245d764338c6047bac1711b2cee43112570a85946360\\\"],\\\"sizeBytes\\\":490381192},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:21b12ff0c81c1d535e7c31aff3a73b1e9ca763e5f88037f59ade0dfab6ed8946\\\"],\\\"sizeBytes\\\":482632652},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:036ed6efe4cb5f5b90ee7f9ef5297c8591b8d67aa36b3c58b4fc5417622a140c\\\"],\\\"sizeBytes\\\":477561861},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0fe5a041a2b99d736e82f1b4a6cd9792c5e23ded475e9f0742cd19234070f989\\\"],\\\"sizeBytes\\\":475327956},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dcb03ccba25366bbdf74cbab6738e7ef1f97f62760886ec445a40cdf29b60418\\\"],\\\"sizeBytes\\\":475137830},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2599f32933f5fea6066ede54ad8f6150adb7bd9067892f251d5913121d5c630d\\\"],\\\"sizeBytes\\\":472771950},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:651bbe9d418f49c2c889d731df67cf5d88dff59dc03f5a1b5d4c8bb3ae001f1a\\\"],\\\"sizeBytes\\\":469976318},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4fe612a1572df462d6a4b664a10bc2e6cad239648acbf8c0303f8fca5d2596c0\\\"],\\\"sizeBytes\\\":468393024},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a5bb05344dd2296077f5066e908ede0eea23f5a12fb78ef86a9513c88d3faaca\\\"],\\\"sizeBytes\\\":464375011},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\"],\\\"sizeBytes\\\":462844959}],\\\"nodeInfo\\\":{\\\"bootID\\\":\\\"3cdf81b4-f597-401a-9b99-34aaa64fb798\\\",\\\"systemUUID\\\":\\\"c6072c61-a7eb-44bd-85f7-eb9fdb0e84de\\\"}}}\" for node \"crc\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/node?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 15:32:57 crc kubenswrapper[5120]: I0316 15:32:57.361783 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:32:57 crc kubenswrapper[5120]: I0316 15:32:57.361849 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:32:57 crc kubenswrapper[5120]: I0316 15:32:57.361872 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:32:57 crc kubenswrapper[5120]: I0316 15:32:57.361897 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 15:32:57 crc kubenswrapper[5120]: I0316 15:32:57.361915 5120 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T15:32:57Z","lastTransitionTime":"2026-03-16T15:32:57Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 15:32:57 crc kubenswrapper[5120]: E0316 15:32:57.376522 5120 kubelet_node_status.go:597] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"allocatable\\\":{\\\"cpu\\\":\\\"11800m\\\",\\\"ephemeral-storage\\\":\\\"76396645454\\\",\\\"memory\\\":\\\"32400460Ki\\\"},\\\"capacity\\\":{\\\"cpu\\\":\\\"12\\\",\\\"ephemeral-storage\\\":\\\"83293888Ki\\\",\\\"memory\\\":\\\"32861260Ki\\\"},\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T15:32:57Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T15:32:57Z\\\",\\\"message\\\":\\\"kubelet has sufficient memory available\\\",\\\"reason\\\":\\\"KubeletHasSufficientMemory\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T15:32:57Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T15:32:57Z\\\",\\\"message\\\":\\\"kubelet has no disk pressure\\\",\\\"reason\\\":\\\"KubeletHasNoDiskPressure\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T15:32:57Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T15:32:57Z\\\",\\\"message\\\":\\\"kubelet has sufficient PID available\\\",\\\"reason\\\":\\\"KubeletHasSufficientPID\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T15:32:57Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T15:32:57Z\\\",\\\"message\\\":\\\"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?\\\",\\\"reason\\\":\\\"KubeletNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7c8a088031661d94022418e93fb63744c38e1c4cff93ea3b95c096a290c2b7a3\\\"],\\\"sizeBytes\\\":2981840865},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\"],\\\"sizeBytes\\\":1641503854},{\\\"names\\\":[\\\"registry.redhat.io/redhat/redhat-operator-index@sha256:286bb0beab328954b0a86b7f066fd5a843b462d6acb2812df7ec788015cd32d4\\\",\\\"registry.redhat.io/redhat/redhat-operator-index@sha256:be02784ed82978c399102be1c6c9f2ca441be4d984e0fd7100c155dd4417ebbf\\\",\\\"registry.redhat.io/redhat/redhat-operator-index:v4.20\\\"],\\\"sizeBytes\\\":1597684406},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:85f1323d589d7af13b096b1f9b438b9dfe08f3fab37534e2780e6490a665bf05\\\"],\\\"sizeBytes\\\":1261384762},{\\\"names\\\":[\\\"registry.redhat.io/redhat/community-operator-index@sha256:0d50962980a5aeecae2d99c98913fb0f46940164e41de0af2ba0e3dafe0d9017\\\",\\\"registry.redhat.io/redhat/community-operator-index@sha256:8d607fb6cc75ca36bca1e0a9c5bea5d1919b75db20733df69c64c8a10ee8083d\\\",\\\"registry.redhat.io/redhat/community-operator-index:v4.20\\\"],\\\"sizeBytes\\\":1224304325},{\\\"names\\\":[\\\"registry.redhat.io/redhat/certified-operator-index@sha256:541db5b20a3d2199602b3b5ac80f09ea31498034e9ae3841238b03a39150f0d7\\\",\\\"registry.redhat.io/redhat/certified-operator-index@sha256:a4c5df55584cba56f00004a090923a5c6de2071add5eb1672a5e20aa646aad8c\\\",\\\"registry.redhat.io/redhat/certified-operator-index:v4.20\\\"],\\\"sizeBytes\\\":1126957757},{\\\"names\\\":[\\\"registry.redhat.io/redhat/redhat-marketplace-index@sha256:b1c859067d6b7b785ab4977ed7137c5b3bb257234f7d7737a1d2836cef1576b5\\\",\\\"registry.redhat.io/redhat/redhat-marketplace-index@sha256:df08951924aa23b2333436a1d04b2dba56c366bb4f09d39ae3aedb980e4fb909\\\",\\\"registry.redhat.io/redhat/redhat-marketplace-index:v4.20\\\"],\\\"sizeBytes\\\":1079537324},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9414357f9345a841e0565265700ecc6637f846c83bd5908dbb7b306432465115\\\"],\\\"sizeBytes\\\":1052707833},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8d1a1e4abe0326c3af89e9eaa4b7449dd2d5b6f9403c677e19b00b24947b1df9\\\"],\\\"sizeBytes\\\":989392005},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b2b1fc3d5bb4944cbd5b23b87566d7ba24b1b66f5a0465f76bcc05023191cc47\\\"],\\\"sizeBytes\\\":971668163},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:be2edaed22535093bdb486afe5960ff4f3b0bd96f88dc1753b584cc28184a0b0\\\"],\\\"sizeBytes\\\":969078739},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7e3d6c8802ae53d6aecf38aa7b560d7892193806bdeb3d7c1637fac77c47fd1f\\\"],\\\"sizeBytes\\\":876488654},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\"],\\\"sizeBytes\\\":847332502},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:36c4867005702f0c4cbfcfa33f18a98596a6c9b1340b633c85ccef84a0c4f889\\\"],\\\"sizeBytes\\\":769516783},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1b55c029f731ebbde3c5580eef98a588264f4d6a8ae667805c9521dd1ecf1d5d\\\"],\\\"sizeBytes\\\":721591926},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf05b9b2ba66351a6c59f4259fb377f62237a00af3b4f0b95f64409e2f25770e\\\"],\\\"sizeBytes\\\":646867625},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a8581a82ba5c8343a743aa302c4848249d8c32a9f2cd10fa68d89d835a1bdf8b\\\"],\\\"sizeBytes\\\":638910445},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ae245c97fc463e876c3024efb806fa8f4efb13b3f06f1bdd3e7e1447f5a5dce4\\\"],\\\"sizeBytes\\\":617699779},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d4926e304011637ca9df370a193896d685f0f3ffabbec234ec827abdbeb083f9\\\"],\\\"sizeBytes\\\":607756695},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5c5d7468f6838b6a714482e62ea956659212f3415ec8f69989f75eb6d8744a6e\\\"],\\\"sizeBytes\\\":584721741},{\\\"names\\\":[\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\\\"],\\\"sizeBytes\\\":545674969},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:574d49b89604b8e8103abf57feee77812fe8cf441eafc17fdff95d57ca80645e\\\"],\\\"sizeBytes\\\":542463064},{\\\"names\\\":[\\\"quay.io/crcont/openshift-crc-cluster-kube-controller-manager-operator@sha256:f69b9cc9b9cfde726109a9e12b80a3eefa472d7e29159df0fbc7143c48983cd6\\\"],\\\"sizeBytes\\\":539380592},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9506bdcf97d5200cf2cf4cdf110aebafdd141a24f6589bf1e1cfe27bb7fc1ed2\\\"],\\\"sizeBytes\\\":533027808},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\"],\\\"sizeBytes\\\":528200501},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5a2a7b3c2f1598189d8880e6aa15ab11a65b201f25012f77ba41e7487a60729a\\\"],\\\"sizeBytes\\\":527774342},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e5e8108294b086fdb797365e5a46badba9b3d866bdcddc8460a51e05a253753d\\\"],\\\"sizeBytes\\\":526632426},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5827f6ae3beb4853192e02cc18890467bd251b33070f36f9a105991e7e6d3c9b\\\"],\\\"sizeBytes\\\":522490210},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:66c8fe5d45ff249643dae75185dd2787ea1b0ae87d5699a8222149c07689557c\\\"],\\\"sizeBytes\\\":520141094},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:baf975b6944f2844860c440636e0d4b80b2fdc473d30f32ae7d6989f2fc2b135\\\"],\\\"sizeBytes\\\":519815758},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:765cf9c3ebf4df049ebc022beaaf52f52852cf89fb802034536ad91dd45db807\\\"],\\\"sizeBytes\\\":519539350},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:52e442bc8198ac925caff87ddd35b3107b7375d5afc9c2eb041ca4e79db72c6f\\\"],\\\"sizeBytes\\\":518690683},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:43b0e0b7e1955ee905e48799a62f50b8a8df553190415ce1f5550375c2507ca5\\\"],\\\"sizeBytes\\\":518251952},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:977a316fa3598eb575a4477dafc09bbf06fad21c4ec2867052225d74f2a9f366\\\"],\\\"sizeBytes\\\":511136541},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e504172345491d90bbbf1e7e45488e73073f4c6d7c2355245871051596fc85db\\\"],\\\"sizeBytes\\\":510122097},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dbd8603d717c26901bcf9731b1e0392ae4bc08a270ed1eeb45839e44bed9607d\\\"],\\\"sizeBytes\\\":508941917},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7c6a47106effd9e9a41131e2bf6c832b80cd77b3439334f760b35b0729f2fb00\\\"],\\\"sizeBytes\\\":508318343},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7a726c68cebc9b08edd734a8bae5150ae5950f7734fe9b9c2a6e0d06f21cc095\\\"],\\\"sizeBytes\\\":498380948},{\\\"names\\\":[\\\"quay.io/crcont/ocp-release@sha256:82501261b9c63012ba3b83fe4d6703c0af5eb9c9151670eb90ae480b9507d761\\\"],\\\"sizeBytes\\\":497232440},{\\\"names\\\":[\\\"registry.redhat.io/openshift4/ose-csi-external-provisioner@sha256:4e4239621caed0b0d9132d167403631e9af86be9a395977f013e201ead281bb4\\\",\\\"registry.redhat.io/openshift4/ose-csi-external-provisioner@sha256:c0b1bec73fdb6853eb3bd9e9733aee2d760ca09a33cfd94adf9ab7b706e83fa9\\\",\\\"registry.redhat.io/openshift4/ose-csi-external-provisioner:latest\\\"],\\\"sizeBytes\\\":491224335},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b0f7abf2f97afd1127d9245d764338c6047bac1711b2cee43112570a85946360\\\"],\\\"sizeBytes\\\":490381192},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:21b12ff0c81c1d535e7c31aff3a73b1e9ca763e5f88037f59ade0dfab6ed8946\\\"],\\\"sizeBytes\\\":482632652},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:036ed6efe4cb5f5b90ee7f9ef5297c8591b8d67aa36b3c58b4fc5417622a140c\\\"],\\\"sizeBytes\\\":477561861},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0fe5a041a2b99d736e82f1b4a6cd9792c5e23ded475e9f0742cd19234070f989\\\"],\\\"sizeBytes\\\":475327956},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dcb03ccba25366bbdf74cbab6738e7ef1f97f62760886ec445a40cdf29b60418\\\"],\\\"sizeBytes\\\":475137830},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2599f32933f5fea6066ede54ad8f6150adb7bd9067892f251d5913121d5c630d\\\"],\\\"sizeBytes\\\":472771950},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:651bbe9d418f49c2c889d731df67cf5d88dff59dc03f5a1b5d4c8bb3ae001f1a\\\"],\\\"sizeBytes\\\":469976318},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4fe612a1572df462d6a4b664a10bc2e6cad239648acbf8c0303f8fca5d2596c0\\\"],\\\"sizeBytes\\\":468393024},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a5bb05344dd2296077f5066e908ede0eea23f5a12fb78ef86a9513c88d3faaca\\\"],\\\"sizeBytes\\\":464375011},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\"],\\\"sizeBytes\\\":462844959}],\\\"nodeInfo\\\":{\\\"bootID\\\":\\\"3cdf81b4-f597-401a-9b99-34aaa64fb798\\\",\\\"systemUUID\\\":\\\"c6072c61-a7eb-44bd-85f7-eb9fdb0e84de\\\"}}}\" for node \"crc\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/node?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 15:32:57 crc kubenswrapper[5120]: I0316 15:32:57.383220 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:32:57 crc kubenswrapper[5120]: I0316 15:32:57.383288 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:32:57 crc kubenswrapper[5120]: I0316 15:32:57.383359 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:32:57 crc kubenswrapper[5120]: I0316 15:32:57.383466 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 15:32:57 crc kubenswrapper[5120]: I0316 15:32:57.383520 5120 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T15:32:57Z","lastTransitionTime":"2026-03-16T15:32:57Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 15:32:57 crc kubenswrapper[5120]: E0316 15:32:57.400211 5120 kubelet_node_status.go:597] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"allocatable\\\":{\\\"cpu\\\":\\\"11800m\\\",\\\"ephemeral-storage\\\":\\\"76396645454\\\",\\\"memory\\\":\\\"32400460Ki\\\"},\\\"capacity\\\":{\\\"cpu\\\":\\\"12\\\",\\\"ephemeral-storage\\\":\\\"83293888Ki\\\",\\\"memory\\\":\\\"32861260Ki\\\"},\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T15:32:57Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T15:32:57Z\\\",\\\"message\\\":\\\"kubelet has sufficient memory available\\\",\\\"reason\\\":\\\"KubeletHasSufficientMemory\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T15:32:57Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T15:32:57Z\\\",\\\"message\\\":\\\"kubelet has no disk pressure\\\",\\\"reason\\\":\\\"KubeletHasNoDiskPressure\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T15:32:57Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T15:32:57Z\\\",\\\"message\\\":\\\"kubelet has sufficient PID available\\\",\\\"reason\\\":\\\"KubeletHasSufficientPID\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T15:32:57Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T15:32:57Z\\\",\\\"message\\\":\\\"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?\\\",\\\"reason\\\":\\\"KubeletNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7c8a088031661d94022418e93fb63744c38e1c4cff93ea3b95c096a290c2b7a3\\\"],\\\"sizeBytes\\\":2981840865},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\"],\\\"sizeBytes\\\":1641503854},{\\\"names\\\":[\\\"registry.redhat.io/redhat/redhat-operator-index@sha256:286bb0beab328954b0a86b7f066fd5a843b462d6acb2812df7ec788015cd32d4\\\",\\\"registry.redhat.io/redhat/redhat-operator-index@sha256:be02784ed82978c399102be1c6c9f2ca441be4d984e0fd7100c155dd4417ebbf\\\",\\\"registry.redhat.io/redhat/redhat-operator-index:v4.20\\\"],\\\"sizeBytes\\\":1597684406},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:85f1323d589d7af13b096b1f9b438b9dfe08f3fab37534e2780e6490a665bf05\\\"],\\\"sizeBytes\\\":1261384762},{\\\"names\\\":[\\\"registry.redhat.io/redhat/community-operator-index@sha256:0d50962980a5aeecae2d99c98913fb0f46940164e41de0af2ba0e3dafe0d9017\\\",\\\"registry.redhat.io/redhat/community-operator-index@sha256:8d607fb6cc75ca36bca1e0a9c5bea5d1919b75db20733df69c64c8a10ee8083d\\\",\\\"registry.redhat.io/redhat/community-operator-index:v4.20\\\"],\\\"sizeBytes\\\":1224304325},{\\\"names\\\":[\\\"registry.redhat.io/redhat/certified-operator-index@sha256:541db5b20a3d2199602b3b5ac80f09ea31498034e9ae3841238b03a39150f0d7\\\",\\\"registry.redhat.io/redhat/certified-operator-index@sha256:a4c5df55584cba56f00004a090923a5c6de2071add5eb1672a5e20aa646aad8c\\\",\\\"registry.redhat.io/redhat/certified-operator-index:v4.20\\\"],\\\"sizeBytes\\\":1126957757},{\\\"names\\\":[\\\"registry.redhat.io/redhat/redhat-marketplace-index@sha256:b1c859067d6b7b785ab4977ed7137c5b3bb257234f7d7737a1d2836cef1576b5\\\",\\\"registry.redhat.io/redhat/redhat-marketplace-index@sha256:df08951924aa23b2333436a1d04b2dba56c366bb4f09d39ae3aedb980e4fb909\\\",\\\"registry.redhat.io/redhat/redhat-marketplace-index:v4.20\\\"],\\\"sizeBytes\\\":1079537324},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9414357f9345a841e0565265700ecc6637f846c83bd5908dbb7b306432465115\\\"],\\\"sizeBytes\\\":1052707833},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8d1a1e4abe0326c3af89e9eaa4b7449dd2d5b6f9403c677e19b00b24947b1df9\\\"],\\\"sizeBytes\\\":989392005},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b2b1fc3d5bb4944cbd5b23b87566d7ba24b1b66f5a0465f76bcc05023191cc47\\\"],\\\"sizeBytes\\\":971668163},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:be2edaed22535093bdb486afe5960ff4f3b0bd96f88dc1753b584cc28184a0b0\\\"],\\\"sizeBytes\\\":969078739},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7e3d6c8802ae53d6aecf38aa7b560d7892193806bdeb3d7c1637fac77c47fd1f\\\"],\\\"sizeBytes\\\":876488654},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\"],\\\"sizeBytes\\\":847332502},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:36c4867005702f0c4cbfcfa33f18a98596a6c9b1340b633c85ccef84a0c4f889\\\"],\\\"sizeBytes\\\":769516783},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1b55c029f731ebbde3c5580eef98a588264f4d6a8ae667805c9521dd1ecf1d5d\\\"],\\\"sizeBytes\\\":721591926},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf05b9b2ba66351a6c59f4259fb377f62237a00af3b4f0b95f64409e2f25770e\\\"],\\\"sizeBytes\\\":646867625},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a8581a82ba5c8343a743aa302c4848249d8c32a9f2cd10fa68d89d835a1bdf8b\\\"],\\\"sizeBytes\\\":638910445},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ae245c97fc463e876c3024efb806fa8f4efb13b3f06f1bdd3e7e1447f5a5dce4\\\"],\\\"sizeBytes\\\":617699779},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d4926e304011637ca9df370a193896d685f0f3ffabbec234ec827abdbeb083f9\\\"],\\\"sizeBytes\\\":607756695},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5c5d7468f6838b6a714482e62ea956659212f3415ec8f69989f75eb6d8744a6e\\\"],\\\"sizeBytes\\\":584721741},{\\\"names\\\":[\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\\\"],\\\"sizeBytes\\\":545674969},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:574d49b89604b8e8103abf57feee77812fe8cf441eafc17fdff95d57ca80645e\\\"],\\\"sizeBytes\\\":542463064},{\\\"names\\\":[\\\"quay.io/crcont/openshift-crc-cluster-kube-controller-manager-operator@sha256:f69b9cc9b9cfde726109a9e12b80a3eefa472d7e29159df0fbc7143c48983cd6\\\"],\\\"sizeBytes\\\":539380592},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9506bdcf97d5200cf2cf4cdf110aebafdd141a24f6589bf1e1cfe27bb7fc1ed2\\\"],\\\"sizeBytes\\\":533027808},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\"],\\\"sizeBytes\\\":528200501},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5a2a7b3c2f1598189d8880e6aa15ab11a65b201f25012f77ba41e7487a60729a\\\"],\\\"sizeBytes\\\":527774342},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e5e8108294b086fdb797365e5a46badba9b3d866bdcddc8460a51e05a253753d\\\"],\\\"sizeBytes\\\":526632426},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5827f6ae3beb4853192e02cc18890467bd251b33070f36f9a105991e7e6d3c9b\\\"],\\\"sizeBytes\\\":522490210},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:66c8fe5d45ff249643dae75185dd2787ea1b0ae87d5699a8222149c07689557c\\\"],\\\"sizeBytes\\\":520141094},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:baf975b6944f2844860c440636e0d4b80b2fdc473d30f32ae7d6989f2fc2b135\\\"],\\\"sizeBytes\\\":519815758},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:765cf9c3ebf4df049ebc022beaaf52f52852cf89fb802034536ad91dd45db807\\\"],\\\"sizeBytes\\\":519539350},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:52e442bc8198ac925caff87ddd35b3107b7375d5afc9c2eb041ca4e79db72c6f\\\"],\\\"sizeBytes\\\":518690683},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:43b0e0b7e1955ee905e48799a62f50b8a8df553190415ce1f5550375c2507ca5\\\"],\\\"sizeBytes\\\":518251952},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:977a316fa3598eb575a4477dafc09bbf06fad21c4ec2867052225d74f2a9f366\\\"],\\\"sizeBytes\\\":511136541},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e504172345491d90bbbf1e7e45488e73073f4c6d7c2355245871051596fc85db\\\"],\\\"sizeBytes\\\":510122097},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dbd8603d717c26901bcf9731b1e0392ae4bc08a270ed1eeb45839e44bed9607d\\\"],\\\"sizeBytes\\\":508941917},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7c6a47106effd9e9a41131e2bf6c832b80cd77b3439334f760b35b0729f2fb00\\\"],\\\"sizeBytes\\\":508318343},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7a726c68cebc9b08edd734a8bae5150ae5950f7734fe9b9c2a6e0d06f21cc095\\\"],\\\"sizeBytes\\\":498380948},{\\\"names\\\":[\\\"quay.io/crcont/ocp-release@sha256:82501261b9c63012ba3b83fe4d6703c0af5eb9c9151670eb90ae480b9507d761\\\"],\\\"sizeBytes\\\":497232440},{\\\"names\\\":[\\\"registry.redhat.io/openshift4/ose-csi-external-provisioner@sha256:4e4239621caed0b0d9132d167403631e9af86be9a395977f013e201ead281bb4\\\",\\\"registry.redhat.io/openshift4/ose-csi-external-provisioner@sha256:c0b1bec73fdb6853eb3bd9e9733aee2d760ca09a33cfd94adf9ab7b706e83fa9\\\",\\\"registry.redhat.io/openshift4/ose-csi-external-provisioner:latest\\\"],\\\"sizeBytes\\\":491224335},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b0f7abf2f97afd1127d9245d764338c6047bac1711b2cee43112570a85946360\\\"],\\\"sizeBytes\\\":490381192},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:21b12ff0c81c1d535e7c31aff3a73b1e9ca763e5f88037f59ade0dfab6ed8946\\\"],\\\"sizeBytes\\\":482632652},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:036ed6efe4cb5f5b90ee7f9ef5297c8591b8d67aa36b3c58b4fc5417622a140c\\\"],\\\"sizeBytes\\\":477561861},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0fe5a041a2b99d736e82f1b4a6cd9792c5e23ded475e9f0742cd19234070f989\\\"],\\\"sizeBytes\\\":475327956},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dcb03ccba25366bbdf74cbab6738e7ef1f97f62760886ec445a40cdf29b60418\\\"],\\\"sizeBytes\\\":475137830},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2599f32933f5fea6066ede54ad8f6150adb7bd9067892f251d5913121d5c630d\\\"],\\\"sizeBytes\\\":472771950},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:651bbe9d418f49c2c889d731df67cf5d88dff59dc03f5a1b5d4c8bb3ae001f1a\\\"],\\\"sizeBytes\\\":469976318},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4fe612a1572df462d6a4b664a10bc2e6cad239648acbf8c0303f8fca5d2596c0\\\"],\\\"sizeBytes\\\":468393024},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a5bb05344dd2296077f5066e908ede0eea23f5a12fb78ef86a9513c88d3faaca\\\"],\\\"sizeBytes\\\":464375011},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\"],\\\"sizeBytes\\\":462844959}],\\\"nodeInfo\\\":{\\\"bootID\\\":\\\"3cdf81b4-f597-401a-9b99-34aaa64fb798\\\",\\\"systemUUID\\\":\\\"c6072c61-a7eb-44bd-85f7-eb9fdb0e84de\\\"}}}\" for node \"crc\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/node?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 15:32:57 crc kubenswrapper[5120]: I0316 15:32:57.405394 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:32:57 crc kubenswrapper[5120]: I0316 15:32:57.405456 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:32:57 crc kubenswrapper[5120]: I0316 15:32:57.405493 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:32:57 crc kubenswrapper[5120]: I0316 15:32:57.405538 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 15:32:57 crc kubenswrapper[5120]: I0316 15:32:57.405567 5120 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T15:32:57Z","lastTransitionTime":"2026-03-16T15:32:57Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 15:32:57 crc kubenswrapper[5120]: E0316 15:32:57.421316 5120 kubelet_node_status.go:597] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"allocatable\\\":{\\\"cpu\\\":\\\"11800m\\\",\\\"ephemeral-storage\\\":\\\"76396645454\\\",\\\"memory\\\":\\\"32400460Ki\\\"},\\\"capacity\\\":{\\\"cpu\\\":\\\"12\\\",\\\"ephemeral-storage\\\":\\\"83293888Ki\\\",\\\"memory\\\":\\\"32861260Ki\\\"},\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T15:32:57Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T15:32:57Z\\\",\\\"message\\\":\\\"kubelet has sufficient memory available\\\",\\\"reason\\\":\\\"KubeletHasSufficientMemory\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T15:32:57Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T15:32:57Z\\\",\\\"message\\\":\\\"kubelet has no disk pressure\\\",\\\"reason\\\":\\\"KubeletHasNoDiskPressure\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T15:32:57Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T15:32:57Z\\\",\\\"message\\\":\\\"kubelet has sufficient PID available\\\",\\\"reason\\\":\\\"KubeletHasSufficientPID\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T15:32:57Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T15:32:57Z\\\",\\\"message\\\":\\\"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?\\\",\\\"reason\\\":\\\"KubeletNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7c8a088031661d94022418e93fb63744c38e1c4cff93ea3b95c096a290c2b7a3\\\"],\\\"sizeBytes\\\":2981840865},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\"],\\\"sizeBytes\\\":1641503854},{\\\"names\\\":[\\\"registry.redhat.io/redhat/redhat-operator-index@sha256:286bb0beab328954b0a86b7f066fd5a843b462d6acb2812df7ec788015cd32d4\\\",\\\"registry.redhat.io/redhat/redhat-operator-index@sha256:be02784ed82978c399102be1c6c9f2ca441be4d984e0fd7100c155dd4417ebbf\\\",\\\"registry.redhat.io/redhat/redhat-operator-index:v4.20\\\"],\\\"sizeBytes\\\":1597684406},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:85f1323d589d7af13b096b1f9b438b9dfe08f3fab37534e2780e6490a665bf05\\\"],\\\"sizeBytes\\\":1261384762},{\\\"names\\\":[\\\"registry.redhat.io/redhat/community-operator-index@sha256:0d50962980a5aeecae2d99c98913fb0f46940164e41de0af2ba0e3dafe0d9017\\\",\\\"registry.redhat.io/redhat/community-operator-index@sha256:8d607fb6cc75ca36bca1e0a9c5bea5d1919b75db20733df69c64c8a10ee8083d\\\",\\\"registry.redhat.io/redhat/community-operator-index:v4.20\\\"],\\\"sizeBytes\\\":1224304325},{\\\"names\\\":[\\\"registry.redhat.io/redhat/certified-operator-index@sha256:541db5b20a3d2199602b3b5ac80f09ea31498034e9ae3841238b03a39150f0d7\\\",\\\"registry.redhat.io/redhat/certified-operator-index@sha256:a4c5df55584cba56f00004a090923a5c6de2071add5eb1672a5e20aa646aad8c\\\",\\\"registry.redhat.io/redhat/certified-operator-index:v4.20\\\"],\\\"sizeBytes\\\":1126957757},{\\\"names\\\":[\\\"registry.redhat.io/redhat/redhat-marketplace-index@sha256:b1c859067d6b7b785ab4977ed7137c5b3bb257234f7d7737a1d2836cef1576b5\\\",\\\"registry.redhat.io/redhat/redhat-marketplace-index@sha256:df08951924aa23b2333436a1d04b2dba56c366bb4f09d39ae3aedb980e4fb909\\\",\\\"registry.redhat.io/redhat/redhat-marketplace-index:v4.20\\\"],\\\"sizeBytes\\\":1079537324},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9414357f9345a841e0565265700ecc6637f846c83bd5908dbb7b306432465115\\\"],\\\"sizeBytes\\\":1052707833},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8d1a1e4abe0326c3af89e9eaa4b7449dd2d5b6f9403c677e19b00b24947b1df9\\\"],\\\"sizeBytes\\\":989392005},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b2b1fc3d5bb4944cbd5b23b87566d7ba24b1b66f5a0465f76bcc05023191cc47\\\"],\\\"sizeBytes\\\":971668163},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:be2edaed22535093bdb486afe5960ff4f3b0bd96f88dc1753b584cc28184a0b0\\\"],\\\"sizeBytes\\\":969078739},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7e3d6c8802ae53d6aecf38aa7b560d7892193806bdeb3d7c1637fac77c47fd1f\\\"],\\\"sizeBytes\\\":876488654},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\"],\\\"sizeBytes\\\":847332502},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:36c4867005702f0c4cbfcfa33f18a98596a6c9b1340b633c85ccef84a0c4f889\\\"],\\\"sizeBytes\\\":769516783},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1b55c029f731ebbde3c5580eef98a588264f4d6a8ae667805c9521dd1ecf1d5d\\\"],\\\"sizeBytes\\\":721591926},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf05b9b2ba66351a6c59f4259fb377f62237a00af3b4f0b95f64409e2f25770e\\\"],\\\"sizeBytes\\\":646867625},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a8581a82ba5c8343a743aa302c4848249d8c32a9f2cd10fa68d89d835a1bdf8b\\\"],\\\"sizeBytes\\\":638910445},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ae245c97fc463e876c3024efb806fa8f4efb13b3f06f1bdd3e7e1447f5a5dce4\\\"],\\\"sizeBytes\\\":617699779},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d4926e304011637ca9df370a193896d685f0f3ffabbec234ec827abdbeb083f9\\\"],\\\"sizeBytes\\\":607756695},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5c5d7468f6838b6a714482e62ea956659212f3415ec8f69989f75eb6d8744a6e\\\"],\\\"sizeBytes\\\":584721741},{\\\"names\\\":[\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\\\"],\\\"sizeBytes\\\":545674969},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:574d49b89604b8e8103abf57feee77812fe8cf441eafc17fdff95d57ca80645e\\\"],\\\"sizeBytes\\\":542463064},{\\\"names\\\":[\\\"quay.io/crcont/openshift-crc-cluster-kube-controller-manager-operator@sha256:f69b9cc9b9cfde726109a9e12b80a3eefa472d7e29159df0fbc7143c48983cd6\\\"],\\\"sizeBytes\\\":539380592},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9506bdcf97d5200cf2cf4cdf110aebafdd141a24f6589bf1e1cfe27bb7fc1ed2\\\"],\\\"sizeBytes\\\":533027808},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\"],\\\"sizeBytes\\\":528200501},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5a2a7b3c2f1598189d8880e6aa15ab11a65b201f25012f77ba41e7487a60729a\\\"],\\\"sizeBytes\\\":527774342},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e5e8108294b086fdb797365e5a46badba9b3d866bdcddc8460a51e05a253753d\\\"],\\\"sizeBytes\\\":526632426},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5827f6ae3beb4853192e02cc18890467bd251b33070f36f9a105991e7e6d3c9b\\\"],\\\"sizeBytes\\\":522490210},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:66c8fe5d45ff249643dae75185dd2787ea1b0ae87d5699a8222149c07689557c\\\"],\\\"sizeBytes\\\":520141094},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:baf975b6944f2844860c440636e0d4b80b2fdc473d30f32ae7d6989f2fc2b135\\\"],\\\"sizeBytes\\\":519815758},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:765cf9c3ebf4df049ebc022beaaf52f52852cf89fb802034536ad91dd45db807\\\"],\\\"sizeBytes\\\":519539350},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:52e442bc8198ac925caff87ddd35b3107b7375d5afc9c2eb041ca4e79db72c6f\\\"],\\\"sizeBytes\\\":518690683},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:43b0e0b7e1955ee905e48799a62f50b8a8df553190415ce1f5550375c2507ca5\\\"],\\\"sizeBytes\\\":518251952},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:977a316fa3598eb575a4477dafc09bbf06fad21c4ec2867052225d74f2a9f366\\\"],\\\"sizeBytes\\\":511136541},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e504172345491d90bbbf1e7e45488e73073f4c6d7c2355245871051596fc85db\\\"],\\\"sizeBytes\\\":510122097},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dbd8603d717c26901bcf9731b1e0392ae4bc08a270ed1eeb45839e44bed9607d\\\"],\\\"sizeBytes\\\":508941917},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7c6a47106effd9e9a41131e2bf6c832b80cd77b3439334f760b35b0729f2fb00\\\"],\\\"sizeBytes\\\":508318343},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7a726c68cebc9b08edd734a8bae5150ae5950f7734fe9b9c2a6e0d06f21cc095\\\"],\\\"sizeBytes\\\":498380948},{\\\"names\\\":[\\\"quay.io/crcont/ocp-release@sha256:82501261b9c63012ba3b83fe4d6703c0af5eb9c9151670eb90ae480b9507d761\\\"],\\\"sizeBytes\\\":497232440},{\\\"names\\\":[\\\"registry.redhat.io/openshift4/ose-csi-external-provisioner@sha256:4e4239621caed0b0d9132d167403631e9af86be9a395977f013e201ead281bb4\\\",\\\"registry.redhat.io/openshift4/ose-csi-external-provisioner@sha256:c0b1bec73fdb6853eb3bd9e9733aee2d760ca09a33cfd94adf9ab7b706e83fa9\\\",\\\"registry.redhat.io/openshift4/ose-csi-external-provisioner:latest\\\"],\\\"sizeBytes\\\":491224335},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b0f7abf2f97afd1127d9245d764338c6047bac1711b2cee43112570a85946360\\\"],\\\"sizeBytes\\\":490381192},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:21b12ff0c81c1d535e7c31aff3a73b1e9ca763e5f88037f59ade0dfab6ed8946\\\"],\\\"sizeBytes\\\":482632652},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:036ed6efe4cb5f5b90ee7f9ef5297c8591b8d67aa36b3c58b4fc5417622a140c\\\"],\\\"sizeBytes\\\":477561861},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0fe5a041a2b99d736e82f1b4a6cd9792c5e23ded475e9f0742cd19234070f989\\\"],\\\"sizeBytes\\\":475327956},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dcb03ccba25366bbdf74cbab6738e7ef1f97f62760886ec445a40cdf29b60418\\\"],\\\"sizeBytes\\\":475137830},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2599f32933f5fea6066ede54ad8f6150adb7bd9067892f251d5913121d5c630d\\\"],\\\"sizeBytes\\\":472771950},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:651bbe9d418f49c2c889d731df67cf5d88dff59dc03f5a1b5d4c8bb3ae001f1a\\\"],\\\"sizeBytes\\\":469976318},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4fe612a1572df462d6a4b664a10bc2e6cad239648acbf8c0303f8fca5d2596c0\\\"],\\\"sizeBytes\\\":468393024},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a5bb05344dd2296077f5066e908ede0eea23f5a12fb78ef86a9513c88d3faaca\\\"],\\\"sizeBytes\\\":464375011},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\"],\\\"sizeBytes\\\":462844959}],\\\"nodeInfo\\\":{\\\"bootID\\\":\\\"3cdf81b4-f597-401a-9b99-34aaa64fb798\\\",\\\"systemUUID\\\":\\\"c6072c61-a7eb-44bd-85f7-eb9fdb0e84de\\\"}}}\" for node \"crc\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/node?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 15:32:57 crc kubenswrapper[5120]: E0316 15:32:57.421604 5120 kubelet_node_status.go:584] "Unable to update node status" err="update node status exceeds retry count" Mar 16 15:32:57 crc kubenswrapper[5120]: E0316 15:32:57.421646 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:57 crc kubenswrapper[5120]: E0316 15:32:57.522095 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:57 crc kubenswrapper[5120]: E0316 15:32:57.622517 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:57 crc kubenswrapper[5120]: E0316 15:32:57.722694 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:57 crc kubenswrapper[5120]: E0316 15:32:57.823244 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:57 crc kubenswrapper[5120]: E0316 15:32:57.924008 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:58 crc kubenswrapper[5120]: E0316 15:32:58.024984 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:58 crc kubenswrapper[5120]: E0316 15:32:58.125530 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:58 crc kubenswrapper[5120]: E0316 15:32:58.226019 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:58 crc kubenswrapper[5120]: E0316 15:32:58.326865 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:58 crc kubenswrapper[5120]: E0316 15:32:58.427628 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:58 crc kubenswrapper[5120]: E0316 15:32:58.528200 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:58 crc kubenswrapper[5120]: E0316 15:32:58.628834 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:58 crc kubenswrapper[5120]: E0316 15:32:58.725840 5120 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"crc\" not found" Mar 16 15:32:58 crc kubenswrapper[5120]: E0316 15:32:58.728925 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:58 crc kubenswrapper[5120]: E0316 15:32:58.829452 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:58 crc kubenswrapper[5120]: E0316 15:32:58.930148 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:59 crc kubenswrapper[5120]: E0316 15:32:59.031147 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:59 crc kubenswrapper[5120]: E0316 15:32:59.131256 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:59 crc kubenswrapper[5120]: E0316 15:32:59.231420 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:59 crc kubenswrapper[5120]: E0316 15:32:59.332235 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:59 crc kubenswrapper[5120]: E0316 15:32:59.432694 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:59 crc kubenswrapper[5120]: E0316 15:32:59.533244 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:59 crc kubenswrapper[5120]: E0316 15:32:59.634297 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:59 crc kubenswrapper[5120]: E0316 15:32:59.735338 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:59 crc kubenswrapper[5120]: E0316 15:32:59.835962 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:32:59 crc kubenswrapper[5120]: E0316 15:32:59.936807 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:00 crc kubenswrapper[5120]: E0316 15:33:00.037577 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:00 crc kubenswrapper[5120]: E0316 15:33:00.138030 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:00 crc kubenswrapper[5120]: E0316 15:33:00.239117 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:00 crc kubenswrapper[5120]: E0316 15:33:00.339433 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:00 crc kubenswrapper[5120]: E0316 15:33:00.439785 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:00 crc kubenswrapper[5120]: E0316 15:33:00.540189 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:00 crc kubenswrapper[5120]: I0316 15:33:00.628704 5120 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Mar 16 15:33:00 crc kubenswrapper[5120]: E0316 15:33:00.641698 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:00 crc kubenswrapper[5120]: E0316 15:33:00.742492 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:00 crc kubenswrapper[5120]: E0316 15:33:00.843128 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:00 crc kubenswrapper[5120]: E0316 15:33:00.943532 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:01 crc kubenswrapper[5120]: E0316 15:33:01.043646 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:01 crc kubenswrapper[5120]: E0316 15:33:01.144824 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:01 crc kubenswrapper[5120]: E0316 15:33:01.245255 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:01 crc kubenswrapper[5120]: E0316 15:33:01.345684 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:01 crc kubenswrapper[5120]: E0316 15:33:01.446449 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:01 crc kubenswrapper[5120]: E0316 15:33:01.547416 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:01 crc kubenswrapper[5120]: E0316 15:33:01.648667 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:01 crc kubenswrapper[5120]: E0316 15:33:01.749430 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:01 crc kubenswrapper[5120]: E0316 15:33:01.850934 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:01 crc kubenswrapper[5120]: E0316 15:33:01.951579 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:02 crc kubenswrapper[5120]: E0316 15:33:02.052651 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:02 crc kubenswrapper[5120]: E0316 15:33:02.153387 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:02 crc kubenswrapper[5120]: E0316 15:33:02.254042 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:02 crc kubenswrapper[5120]: E0316 15:33:02.354381 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:02 crc kubenswrapper[5120]: E0316 15:33:02.454939 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:02 crc kubenswrapper[5120]: E0316 15:33:02.555669 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:02 crc kubenswrapper[5120]: E0316 15:33:02.656806 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:02 crc kubenswrapper[5120]: E0316 15:33:02.757680 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:02 crc kubenswrapper[5120]: E0316 15:33:02.857923 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:02 crc kubenswrapper[5120]: E0316 15:33:02.958497 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:03 crc kubenswrapper[5120]: E0316 15:33:03.059418 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:03 crc kubenswrapper[5120]: E0316 15:33:03.160019 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:03 crc kubenswrapper[5120]: E0316 15:33:03.260296 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:03 crc kubenswrapper[5120]: E0316 15:33:03.360887 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:03 crc kubenswrapper[5120]: E0316 15:33:03.461601 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:03 crc kubenswrapper[5120]: E0316 15:33:03.561799 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:03 crc kubenswrapper[5120]: E0316 15:33:03.662796 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:03 crc kubenswrapper[5120]: E0316 15:33:03.762934 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:03 crc kubenswrapper[5120]: E0316 15:33:03.863265 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:03 crc kubenswrapper[5120]: E0316 15:33:03.963567 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:04 crc kubenswrapper[5120]: E0316 15:33:04.064681 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:04 crc kubenswrapper[5120]: E0316 15:33:04.165408 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:04 crc kubenswrapper[5120]: E0316 15:33:04.266149 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:04 crc kubenswrapper[5120]: E0316 15:33:04.366842 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:04 crc kubenswrapper[5120]: E0316 15:33:04.467969 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:04 crc kubenswrapper[5120]: E0316 15:33:04.568838 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:04 crc kubenswrapper[5120]: E0316 15:33:04.669787 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:04 crc kubenswrapper[5120]: E0316 15:33:04.770279 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:04 crc kubenswrapper[5120]: E0316 15:33:04.870921 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:04 crc kubenswrapper[5120]: E0316 15:33:04.972134 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:05 crc kubenswrapper[5120]: E0316 15:33:05.072850 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:05 crc kubenswrapper[5120]: E0316 15:33:05.173221 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:05 crc kubenswrapper[5120]: E0316 15:33:05.273620 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:05 crc kubenswrapper[5120]: E0316 15:33:05.374864 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:05 crc kubenswrapper[5120]: E0316 15:33:05.475431 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:05 crc kubenswrapper[5120]: E0316 15:33:05.576099 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:05 crc kubenswrapper[5120]: E0316 15:33:05.676389 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:05 crc kubenswrapper[5120]: E0316 15:33:05.777390 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:05 crc kubenswrapper[5120]: E0316 15:33:05.878009 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:05 crc kubenswrapper[5120]: E0316 15:33:05.978743 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:06 crc kubenswrapper[5120]: E0316 15:33:06.079134 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:06 crc kubenswrapper[5120]: E0316 15:33:06.180182 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:06 crc kubenswrapper[5120]: E0316 15:33:06.280680 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:06 crc kubenswrapper[5120]: E0316 15:33:06.381088 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:06 crc kubenswrapper[5120]: E0316 15:33:06.481405 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:06 crc kubenswrapper[5120]: E0316 15:33:06.582088 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:06 crc kubenswrapper[5120]: E0316 15:33:06.682619 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:06 crc kubenswrapper[5120]: E0316 15:33:06.783134 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:06 crc kubenswrapper[5120]: E0316 15:33:06.884293 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:06 crc kubenswrapper[5120]: E0316 15:33:06.985015 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:07 crc kubenswrapper[5120]: E0316 15:33:07.086121 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:07 crc kubenswrapper[5120]: E0316 15:33:07.186245 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:07 crc kubenswrapper[5120]: E0316 15:33:07.286534 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:07 crc kubenswrapper[5120]: E0316 15:33:07.387048 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:07 crc kubenswrapper[5120]: E0316 15:33:07.487662 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:07 crc kubenswrapper[5120]: E0316 15:33:07.587867 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:07 crc kubenswrapper[5120]: I0316 15:33:07.663325 5120 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 15:33:07 crc kubenswrapper[5120]: I0316 15:33:07.665244 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:33:07 crc kubenswrapper[5120]: I0316 15:33:07.665279 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:33:07 crc kubenswrapper[5120]: I0316 15:33:07.665292 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:33:07 crc kubenswrapper[5120]: E0316 15:33:07.665681 5120 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"crc\" not found" node="crc" Mar 16 15:33:07 crc kubenswrapper[5120]: I0316 15:33:07.665921 5120 scope.go:117] "RemoveContainer" containerID="2e9f531a9c0fc8cf5222ce7e135c4f37d008306df727f84312cc5d7d2c740ac6" Mar 16 15:33:07 crc kubenswrapper[5120]: E0316 15:33:07.666093 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-apiserver-check-endpoints\" with CrashLoopBackOff: \"back-off 40s restarting failed container=kube-apiserver-check-endpoints pod=kube-apiserver-crc_openshift-kube-apiserver(3a14caf222afb62aaabdc47808b6f944)\"" pod="openshift-kube-apiserver/kube-apiserver-crc" podUID="3a14caf222afb62aaabdc47808b6f944" Mar 16 15:33:07 crc kubenswrapper[5120]: E0316 15:33:07.688541 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:07 crc kubenswrapper[5120]: E0316 15:33:07.725749 5120 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"crc\": node \"crc\" not found" Mar 16 15:33:07 crc kubenswrapper[5120]: I0316 15:33:07.730430 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:33:07 crc kubenswrapper[5120]: I0316 15:33:07.730701 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:33:07 crc kubenswrapper[5120]: I0316 15:33:07.731017 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:33:07 crc kubenswrapper[5120]: I0316 15:33:07.731308 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 15:33:07 crc kubenswrapper[5120]: I0316 15:33:07.731505 5120 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T15:33:07Z","lastTransitionTime":"2026-03-16T15:33:07Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 15:33:07 crc kubenswrapper[5120]: E0316 15:33:07.744308 5120 kubelet_node_status.go:597] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"allocatable\\\":{\\\"cpu\\\":\\\"11800m\\\",\\\"ephemeral-storage\\\":\\\"76396645454\\\",\\\"memory\\\":\\\"32400460Ki\\\"},\\\"capacity\\\":{\\\"cpu\\\":\\\"12\\\",\\\"ephemeral-storage\\\":\\\"83293888Ki\\\",\\\"memory\\\":\\\"32861260Ki\\\"},\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T15:33:07Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T15:33:07Z\\\",\\\"message\\\":\\\"kubelet has sufficient memory available\\\",\\\"reason\\\":\\\"KubeletHasSufficientMemory\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T15:33:07Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T15:33:07Z\\\",\\\"message\\\":\\\"kubelet has no disk pressure\\\",\\\"reason\\\":\\\"KubeletHasNoDiskPressure\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T15:33:07Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T15:33:07Z\\\",\\\"message\\\":\\\"kubelet has sufficient PID available\\\",\\\"reason\\\":\\\"KubeletHasSufficientPID\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T15:33:07Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T15:33:07Z\\\",\\\"message\\\":\\\"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?\\\",\\\"reason\\\":\\\"KubeletNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7c8a088031661d94022418e93fb63744c38e1c4cff93ea3b95c096a290c2b7a3\\\"],\\\"sizeBytes\\\":2981840865},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\"],\\\"sizeBytes\\\":1641503854},{\\\"names\\\":[\\\"registry.redhat.io/redhat/redhat-operator-index@sha256:286bb0beab328954b0a86b7f066fd5a843b462d6acb2812df7ec788015cd32d4\\\",\\\"registry.redhat.io/redhat/redhat-operator-index@sha256:be02784ed82978c399102be1c6c9f2ca441be4d984e0fd7100c155dd4417ebbf\\\",\\\"registry.redhat.io/redhat/redhat-operator-index:v4.20\\\"],\\\"sizeBytes\\\":1597684406},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:85f1323d589d7af13b096b1f9b438b9dfe08f3fab37534e2780e6490a665bf05\\\"],\\\"sizeBytes\\\":1261384762},{\\\"names\\\":[\\\"registry.redhat.io/redhat/community-operator-index@sha256:0d50962980a5aeecae2d99c98913fb0f46940164e41de0af2ba0e3dafe0d9017\\\",\\\"registry.redhat.io/redhat/community-operator-index@sha256:8d607fb6cc75ca36bca1e0a9c5bea5d1919b75db20733df69c64c8a10ee8083d\\\",\\\"registry.redhat.io/redhat/community-operator-index:v4.20\\\"],\\\"sizeBytes\\\":1224304325},{\\\"names\\\":[\\\"registry.redhat.io/redhat/certified-operator-index@sha256:541db5b20a3d2199602b3b5ac80f09ea31498034e9ae3841238b03a39150f0d7\\\",\\\"registry.redhat.io/redhat/certified-operator-index@sha256:a4c5df55584cba56f00004a090923a5c6de2071add5eb1672a5e20aa646aad8c\\\",\\\"registry.redhat.io/redhat/certified-operator-index:v4.20\\\"],\\\"sizeBytes\\\":1126957757},{\\\"names\\\":[\\\"registry.redhat.io/redhat/redhat-marketplace-index@sha256:b1c859067d6b7b785ab4977ed7137c5b3bb257234f7d7737a1d2836cef1576b5\\\",\\\"registry.redhat.io/redhat/redhat-marketplace-index@sha256:df08951924aa23b2333436a1d04b2dba56c366bb4f09d39ae3aedb980e4fb909\\\",\\\"registry.redhat.io/redhat/redhat-marketplace-index:v4.20\\\"],\\\"sizeBytes\\\":1079537324},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9414357f9345a841e0565265700ecc6637f846c83bd5908dbb7b306432465115\\\"],\\\"sizeBytes\\\":1052707833},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8d1a1e4abe0326c3af89e9eaa4b7449dd2d5b6f9403c677e19b00b24947b1df9\\\"],\\\"sizeBytes\\\":989392005},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b2b1fc3d5bb4944cbd5b23b87566d7ba24b1b66f5a0465f76bcc05023191cc47\\\"],\\\"sizeBytes\\\":971668163},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:be2edaed22535093bdb486afe5960ff4f3b0bd96f88dc1753b584cc28184a0b0\\\"],\\\"sizeBytes\\\":969078739},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7e3d6c8802ae53d6aecf38aa7b560d7892193806bdeb3d7c1637fac77c47fd1f\\\"],\\\"sizeBytes\\\":876488654},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\"],\\\"sizeBytes\\\":847332502},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:36c4867005702f0c4cbfcfa33f18a98596a6c9b1340b633c85ccef84a0c4f889\\\"],\\\"sizeBytes\\\":769516783},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1b55c029f731ebbde3c5580eef98a588264f4d6a8ae667805c9521dd1ecf1d5d\\\"],\\\"sizeBytes\\\":721591926},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf05b9b2ba66351a6c59f4259fb377f62237a00af3b4f0b95f64409e2f25770e\\\"],\\\"sizeBytes\\\":646867625},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a8581a82ba5c8343a743aa302c4848249d8c32a9f2cd10fa68d89d835a1bdf8b\\\"],\\\"sizeBytes\\\":638910445},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ae245c97fc463e876c3024efb806fa8f4efb13b3f06f1bdd3e7e1447f5a5dce4\\\"],\\\"sizeBytes\\\":617699779},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d4926e304011637ca9df370a193896d685f0f3ffabbec234ec827abdbeb083f9\\\"],\\\"sizeBytes\\\":607756695},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5c5d7468f6838b6a714482e62ea956659212f3415ec8f69989f75eb6d8744a6e\\\"],\\\"sizeBytes\\\":584721741},{\\\"names\\\":[\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\\\"],\\\"sizeBytes\\\":545674969},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:574d49b89604b8e8103abf57feee77812fe8cf441eafc17fdff95d57ca80645e\\\"],\\\"sizeBytes\\\":542463064},{\\\"names\\\":[\\\"quay.io/crcont/openshift-crc-cluster-kube-controller-manager-operator@sha256:f69b9cc9b9cfde726109a9e12b80a3eefa472d7e29159df0fbc7143c48983cd6\\\"],\\\"sizeBytes\\\":539380592},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9506bdcf97d5200cf2cf4cdf110aebafdd141a24f6589bf1e1cfe27bb7fc1ed2\\\"],\\\"sizeBytes\\\":533027808},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\"],\\\"sizeBytes\\\":528200501},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5a2a7b3c2f1598189d8880e6aa15ab11a65b201f25012f77ba41e7487a60729a\\\"],\\\"sizeBytes\\\":527774342},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e5e8108294b086fdb797365e5a46badba9b3d866bdcddc8460a51e05a253753d\\\"],\\\"sizeBytes\\\":526632426},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5827f6ae3beb4853192e02cc18890467bd251b33070f36f9a105991e7e6d3c9b\\\"],\\\"sizeBytes\\\":522490210},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:66c8fe5d45ff249643dae75185dd2787ea1b0ae87d5699a8222149c07689557c\\\"],\\\"sizeBytes\\\":520141094},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:baf975b6944f2844860c440636e0d4b80b2fdc473d30f32ae7d6989f2fc2b135\\\"],\\\"sizeBytes\\\":519815758},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:765cf9c3ebf4df049ebc022beaaf52f52852cf89fb802034536ad91dd45db807\\\"],\\\"sizeBytes\\\":519539350},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:52e442bc8198ac925caff87ddd35b3107b7375d5afc9c2eb041ca4e79db72c6f\\\"],\\\"sizeBytes\\\":518690683},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:43b0e0b7e1955ee905e48799a62f50b8a8df553190415ce1f5550375c2507ca5\\\"],\\\"sizeBytes\\\":518251952},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:977a316fa3598eb575a4477dafc09bbf06fad21c4ec2867052225d74f2a9f366\\\"],\\\"sizeBytes\\\":511136541},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e504172345491d90bbbf1e7e45488e73073f4c6d7c2355245871051596fc85db\\\"],\\\"sizeBytes\\\":510122097},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dbd8603d717c26901bcf9731b1e0392ae4bc08a270ed1eeb45839e44bed9607d\\\"],\\\"sizeBytes\\\":508941917},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7c6a47106effd9e9a41131e2bf6c832b80cd77b3439334f760b35b0729f2fb00\\\"],\\\"sizeBytes\\\":508318343},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7a726c68cebc9b08edd734a8bae5150ae5950f7734fe9b9c2a6e0d06f21cc095\\\"],\\\"sizeBytes\\\":498380948},{\\\"names\\\":[\\\"quay.io/crcont/ocp-release@sha256:82501261b9c63012ba3b83fe4d6703c0af5eb9c9151670eb90ae480b9507d761\\\"],\\\"sizeBytes\\\":497232440},{\\\"names\\\":[\\\"registry.redhat.io/openshift4/ose-csi-external-provisioner@sha256:4e4239621caed0b0d9132d167403631e9af86be9a395977f013e201ead281bb4\\\",\\\"registry.redhat.io/openshift4/ose-csi-external-provisioner@sha256:c0b1bec73fdb6853eb3bd9e9733aee2d760ca09a33cfd94adf9ab7b706e83fa9\\\",\\\"registry.redhat.io/openshift4/ose-csi-external-provisioner:latest\\\"],\\\"sizeBytes\\\":491224335},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b0f7abf2f97afd1127d9245d764338c6047bac1711b2cee43112570a85946360\\\"],\\\"sizeBytes\\\":490381192},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:21b12ff0c81c1d535e7c31aff3a73b1e9ca763e5f88037f59ade0dfab6ed8946\\\"],\\\"sizeBytes\\\":482632652},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:036ed6efe4cb5f5b90ee7f9ef5297c8591b8d67aa36b3c58b4fc5417622a140c\\\"],\\\"sizeBytes\\\":477561861},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0fe5a041a2b99d736e82f1b4a6cd9792c5e23ded475e9f0742cd19234070f989\\\"],\\\"sizeBytes\\\":475327956},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dcb03ccba25366bbdf74cbab6738e7ef1f97f62760886ec445a40cdf29b60418\\\"],\\\"sizeBytes\\\":475137830},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2599f32933f5fea6066ede54ad8f6150adb7bd9067892f251d5913121d5c630d\\\"],\\\"sizeBytes\\\":472771950},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:651bbe9d418f49c2c889d731df67cf5d88dff59dc03f5a1b5d4c8bb3ae001f1a\\\"],\\\"sizeBytes\\\":469976318},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4fe612a1572df462d6a4b664a10bc2e6cad239648acbf8c0303f8fca5d2596c0\\\"],\\\"sizeBytes\\\":468393024},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a5bb05344dd2296077f5066e908ede0eea23f5a12fb78ef86a9513c88d3faaca\\\"],\\\"sizeBytes\\\":464375011},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\"],\\\"sizeBytes\\\":462844959}],\\\"nodeInfo\\\":{\\\"bootID\\\":\\\"3cdf81b4-f597-401a-9b99-34aaa64fb798\\\",\\\"systemUUID\\\":\\\"c6072c61-a7eb-44bd-85f7-eb9fdb0e84de\\\"}}}\" for node \"crc\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/node?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 15:33:07 crc kubenswrapper[5120]: I0316 15:33:07.748434 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:33:07 crc kubenswrapper[5120]: I0316 15:33:07.748467 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:33:07 crc kubenswrapper[5120]: I0316 15:33:07.748475 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:33:07 crc kubenswrapper[5120]: I0316 15:33:07.748488 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 15:33:07 crc kubenswrapper[5120]: I0316 15:33:07.748498 5120 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T15:33:07Z","lastTransitionTime":"2026-03-16T15:33:07Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 15:33:07 crc kubenswrapper[5120]: E0316 15:33:07.759916 5120 kubelet_node_status.go:597] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"allocatable\\\":{\\\"cpu\\\":\\\"11800m\\\",\\\"ephemeral-storage\\\":\\\"76396645454\\\",\\\"memory\\\":\\\"32400460Ki\\\"},\\\"capacity\\\":{\\\"cpu\\\":\\\"12\\\",\\\"ephemeral-storage\\\":\\\"83293888Ki\\\",\\\"memory\\\":\\\"32861260Ki\\\"},\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T15:33:07Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T15:33:07Z\\\",\\\"message\\\":\\\"kubelet has sufficient memory available\\\",\\\"reason\\\":\\\"KubeletHasSufficientMemory\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T15:33:07Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T15:33:07Z\\\",\\\"message\\\":\\\"kubelet has no disk pressure\\\",\\\"reason\\\":\\\"KubeletHasNoDiskPressure\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T15:33:07Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T15:33:07Z\\\",\\\"message\\\":\\\"kubelet has sufficient PID available\\\",\\\"reason\\\":\\\"KubeletHasSufficientPID\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T15:33:07Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T15:33:07Z\\\",\\\"message\\\":\\\"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?\\\",\\\"reason\\\":\\\"KubeletNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7c8a088031661d94022418e93fb63744c38e1c4cff93ea3b95c096a290c2b7a3\\\"],\\\"sizeBytes\\\":2981840865},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\"],\\\"sizeBytes\\\":1641503854},{\\\"names\\\":[\\\"registry.redhat.io/redhat/redhat-operator-index@sha256:286bb0beab328954b0a86b7f066fd5a843b462d6acb2812df7ec788015cd32d4\\\",\\\"registry.redhat.io/redhat/redhat-operator-index@sha256:be02784ed82978c399102be1c6c9f2ca441be4d984e0fd7100c155dd4417ebbf\\\",\\\"registry.redhat.io/redhat/redhat-operator-index:v4.20\\\"],\\\"sizeBytes\\\":1597684406},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:85f1323d589d7af13b096b1f9b438b9dfe08f3fab37534e2780e6490a665bf05\\\"],\\\"sizeBytes\\\":1261384762},{\\\"names\\\":[\\\"registry.redhat.io/redhat/community-operator-index@sha256:0d50962980a5aeecae2d99c98913fb0f46940164e41de0af2ba0e3dafe0d9017\\\",\\\"registry.redhat.io/redhat/community-operator-index@sha256:8d607fb6cc75ca36bca1e0a9c5bea5d1919b75db20733df69c64c8a10ee8083d\\\",\\\"registry.redhat.io/redhat/community-operator-index:v4.20\\\"],\\\"sizeBytes\\\":1224304325},{\\\"names\\\":[\\\"registry.redhat.io/redhat/certified-operator-index@sha256:541db5b20a3d2199602b3b5ac80f09ea31498034e9ae3841238b03a39150f0d7\\\",\\\"registry.redhat.io/redhat/certified-operator-index@sha256:a4c5df55584cba56f00004a090923a5c6de2071add5eb1672a5e20aa646aad8c\\\",\\\"registry.redhat.io/redhat/certified-operator-index:v4.20\\\"],\\\"sizeBytes\\\":1126957757},{\\\"names\\\":[\\\"registry.redhat.io/redhat/redhat-marketplace-index@sha256:b1c859067d6b7b785ab4977ed7137c5b3bb257234f7d7737a1d2836cef1576b5\\\",\\\"registry.redhat.io/redhat/redhat-marketplace-index@sha256:df08951924aa23b2333436a1d04b2dba56c366bb4f09d39ae3aedb980e4fb909\\\",\\\"registry.redhat.io/redhat/redhat-marketplace-index:v4.20\\\"],\\\"sizeBytes\\\":1079537324},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9414357f9345a841e0565265700ecc6637f846c83bd5908dbb7b306432465115\\\"],\\\"sizeBytes\\\":1052707833},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8d1a1e4abe0326c3af89e9eaa4b7449dd2d5b6f9403c677e19b00b24947b1df9\\\"],\\\"sizeBytes\\\":989392005},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b2b1fc3d5bb4944cbd5b23b87566d7ba24b1b66f5a0465f76bcc05023191cc47\\\"],\\\"sizeBytes\\\":971668163},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:be2edaed22535093bdb486afe5960ff4f3b0bd96f88dc1753b584cc28184a0b0\\\"],\\\"sizeBytes\\\":969078739},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7e3d6c8802ae53d6aecf38aa7b560d7892193806bdeb3d7c1637fac77c47fd1f\\\"],\\\"sizeBytes\\\":876488654},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\"],\\\"sizeBytes\\\":847332502},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:36c4867005702f0c4cbfcfa33f18a98596a6c9b1340b633c85ccef84a0c4f889\\\"],\\\"sizeBytes\\\":769516783},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1b55c029f731ebbde3c5580eef98a588264f4d6a8ae667805c9521dd1ecf1d5d\\\"],\\\"sizeBytes\\\":721591926},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf05b9b2ba66351a6c59f4259fb377f62237a00af3b4f0b95f64409e2f25770e\\\"],\\\"sizeBytes\\\":646867625},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a8581a82ba5c8343a743aa302c4848249d8c32a9f2cd10fa68d89d835a1bdf8b\\\"],\\\"sizeBytes\\\":638910445},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ae245c97fc463e876c3024efb806fa8f4efb13b3f06f1bdd3e7e1447f5a5dce4\\\"],\\\"sizeBytes\\\":617699779},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d4926e304011637ca9df370a193896d685f0f3ffabbec234ec827abdbeb083f9\\\"],\\\"sizeBytes\\\":607756695},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5c5d7468f6838b6a714482e62ea956659212f3415ec8f69989f75eb6d8744a6e\\\"],\\\"sizeBytes\\\":584721741},{\\\"names\\\":[\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\\\"],\\\"sizeBytes\\\":545674969},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:574d49b89604b8e8103abf57feee77812fe8cf441eafc17fdff95d57ca80645e\\\"],\\\"sizeBytes\\\":542463064},{\\\"names\\\":[\\\"quay.io/crcont/openshift-crc-cluster-kube-controller-manager-operator@sha256:f69b9cc9b9cfde726109a9e12b80a3eefa472d7e29159df0fbc7143c48983cd6\\\"],\\\"sizeBytes\\\":539380592},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9506bdcf97d5200cf2cf4cdf110aebafdd141a24f6589bf1e1cfe27bb7fc1ed2\\\"],\\\"sizeBytes\\\":533027808},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\"],\\\"sizeBytes\\\":528200501},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5a2a7b3c2f1598189d8880e6aa15ab11a65b201f25012f77ba41e7487a60729a\\\"],\\\"sizeBytes\\\":527774342},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e5e8108294b086fdb797365e5a46badba9b3d866bdcddc8460a51e05a253753d\\\"],\\\"sizeBytes\\\":526632426},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5827f6ae3beb4853192e02cc18890467bd251b33070f36f9a105991e7e6d3c9b\\\"],\\\"sizeBytes\\\":522490210},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:66c8fe5d45ff249643dae75185dd2787ea1b0ae87d5699a8222149c07689557c\\\"],\\\"sizeBytes\\\":520141094},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:baf975b6944f2844860c440636e0d4b80b2fdc473d30f32ae7d6989f2fc2b135\\\"],\\\"sizeBytes\\\":519815758},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:765cf9c3ebf4df049ebc022beaaf52f52852cf89fb802034536ad91dd45db807\\\"],\\\"sizeBytes\\\":519539350},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:52e442bc8198ac925caff87ddd35b3107b7375d5afc9c2eb041ca4e79db72c6f\\\"],\\\"sizeBytes\\\":518690683},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:43b0e0b7e1955ee905e48799a62f50b8a8df553190415ce1f5550375c2507ca5\\\"],\\\"sizeBytes\\\":518251952},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:977a316fa3598eb575a4477dafc09bbf06fad21c4ec2867052225d74f2a9f366\\\"],\\\"sizeBytes\\\":511136541},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e504172345491d90bbbf1e7e45488e73073f4c6d7c2355245871051596fc85db\\\"],\\\"sizeBytes\\\":510122097},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dbd8603d717c26901bcf9731b1e0392ae4bc08a270ed1eeb45839e44bed9607d\\\"],\\\"sizeBytes\\\":508941917},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7c6a47106effd9e9a41131e2bf6c832b80cd77b3439334f760b35b0729f2fb00\\\"],\\\"sizeBytes\\\":508318343},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7a726c68cebc9b08edd734a8bae5150ae5950f7734fe9b9c2a6e0d06f21cc095\\\"],\\\"sizeBytes\\\":498380948},{\\\"names\\\":[\\\"quay.io/crcont/ocp-release@sha256:82501261b9c63012ba3b83fe4d6703c0af5eb9c9151670eb90ae480b9507d761\\\"],\\\"sizeBytes\\\":497232440},{\\\"names\\\":[\\\"registry.redhat.io/openshift4/ose-csi-external-provisioner@sha256:4e4239621caed0b0d9132d167403631e9af86be9a395977f013e201ead281bb4\\\",\\\"registry.redhat.io/openshift4/ose-csi-external-provisioner@sha256:c0b1bec73fdb6853eb3bd9e9733aee2d760ca09a33cfd94adf9ab7b706e83fa9\\\",\\\"registry.redhat.io/openshift4/ose-csi-external-provisioner:latest\\\"],\\\"sizeBytes\\\":491224335},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b0f7abf2f97afd1127d9245d764338c6047bac1711b2cee43112570a85946360\\\"],\\\"sizeBytes\\\":490381192},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:21b12ff0c81c1d535e7c31aff3a73b1e9ca763e5f88037f59ade0dfab6ed8946\\\"],\\\"sizeBytes\\\":482632652},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:036ed6efe4cb5f5b90ee7f9ef5297c8591b8d67aa36b3c58b4fc5417622a140c\\\"],\\\"sizeBytes\\\":477561861},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0fe5a041a2b99d736e82f1b4a6cd9792c5e23ded475e9f0742cd19234070f989\\\"],\\\"sizeBytes\\\":475327956},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dcb03ccba25366bbdf74cbab6738e7ef1f97f62760886ec445a40cdf29b60418\\\"],\\\"sizeBytes\\\":475137830},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2599f32933f5fea6066ede54ad8f6150adb7bd9067892f251d5913121d5c630d\\\"],\\\"sizeBytes\\\":472771950},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:651bbe9d418f49c2c889d731df67cf5d88dff59dc03f5a1b5d4c8bb3ae001f1a\\\"],\\\"sizeBytes\\\":469976318},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4fe612a1572df462d6a4b664a10bc2e6cad239648acbf8c0303f8fca5d2596c0\\\"],\\\"sizeBytes\\\":468393024},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a5bb05344dd2296077f5066e908ede0eea23f5a12fb78ef86a9513c88d3faaca\\\"],\\\"sizeBytes\\\":464375011},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\"],\\\"sizeBytes\\\":462844959}],\\\"nodeInfo\\\":{\\\"bootID\\\":\\\"3cdf81b4-f597-401a-9b99-34aaa64fb798\\\",\\\"systemUUID\\\":\\\"c6072c61-a7eb-44bd-85f7-eb9fdb0e84de\\\"}}}\" for node \"crc\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/node?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 15:33:07 crc kubenswrapper[5120]: I0316 15:33:07.764439 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:33:07 crc kubenswrapper[5120]: I0316 15:33:07.764652 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:33:07 crc kubenswrapper[5120]: I0316 15:33:07.764808 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:33:07 crc kubenswrapper[5120]: I0316 15:33:07.764956 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 15:33:07 crc kubenswrapper[5120]: I0316 15:33:07.765122 5120 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T15:33:07Z","lastTransitionTime":"2026-03-16T15:33:07Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 15:33:07 crc kubenswrapper[5120]: E0316 15:33:07.775786 5120 kubelet_node_status.go:597] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"allocatable\\\":{\\\"cpu\\\":\\\"11800m\\\",\\\"ephemeral-storage\\\":\\\"76396645454\\\",\\\"memory\\\":\\\"32400460Ki\\\"},\\\"capacity\\\":{\\\"cpu\\\":\\\"12\\\",\\\"ephemeral-storage\\\":\\\"83293888Ki\\\",\\\"memory\\\":\\\"32861260Ki\\\"},\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T15:33:07Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T15:33:07Z\\\",\\\"message\\\":\\\"kubelet has sufficient memory available\\\",\\\"reason\\\":\\\"KubeletHasSufficientMemory\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T15:33:07Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T15:33:07Z\\\",\\\"message\\\":\\\"kubelet has no disk pressure\\\",\\\"reason\\\":\\\"KubeletHasNoDiskPressure\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T15:33:07Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T15:33:07Z\\\",\\\"message\\\":\\\"kubelet has sufficient PID available\\\",\\\"reason\\\":\\\"KubeletHasSufficientPID\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T15:33:07Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T15:33:07Z\\\",\\\"message\\\":\\\"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?\\\",\\\"reason\\\":\\\"KubeletNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7c8a088031661d94022418e93fb63744c38e1c4cff93ea3b95c096a290c2b7a3\\\"],\\\"sizeBytes\\\":2981840865},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\"],\\\"sizeBytes\\\":1641503854},{\\\"names\\\":[\\\"registry.redhat.io/redhat/redhat-operator-index@sha256:286bb0beab328954b0a86b7f066fd5a843b462d6acb2812df7ec788015cd32d4\\\",\\\"registry.redhat.io/redhat/redhat-operator-index@sha256:be02784ed82978c399102be1c6c9f2ca441be4d984e0fd7100c155dd4417ebbf\\\",\\\"registry.redhat.io/redhat/redhat-operator-index:v4.20\\\"],\\\"sizeBytes\\\":1597684406},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:85f1323d589d7af13b096b1f9b438b9dfe08f3fab37534e2780e6490a665bf05\\\"],\\\"sizeBytes\\\":1261384762},{\\\"names\\\":[\\\"registry.redhat.io/redhat/community-operator-index@sha256:0d50962980a5aeecae2d99c98913fb0f46940164e41de0af2ba0e3dafe0d9017\\\",\\\"registry.redhat.io/redhat/community-operator-index@sha256:8d607fb6cc75ca36bca1e0a9c5bea5d1919b75db20733df69c64c8a10ee8083d\\\",\\\"registry.redhat.io/redhat/community-operator-index:v4.20\\\"],\\\"sizeBytes\\\":1224304325},{\\\"names\\\":[\\\"registry.redhat.io/redhat/certified-operator-index@sha256:541db5b20a3d2199602b3b5ac80f09ea31498034e9ae3841238b03a39150f0d7\\\",\\\"registry.redhat.io/redhat/certified-operator-index@sha256:a4c5df55584cba56f00004a090923a5c6de2071add5eb1672a5e20aa646aad8c\\\",\\\"registry.redhat.io/redhat/certified-operator-index:v4.20\\\"],\\\"sizeBytes\\\":1126957757},{\\\"names\\\":[\\\"registry.redhat.io/redhat/redhat-marketplace-index@sha256:b1c859067d6b7b785ab4977ed7137c5b3bb257234f7d7737a1d2836cef1576b5\\\",\\\"registry.redhat.io/redhat/redhat-marketplace-index@sha256:df08951924aa23b2333436a1d04b2dba56c366bb4f09d39ae3aedb980e4fb909\\\",\\\"registry.redhat.io/redhat/redhat-marketplace-index:v4.20\\\"],\\\"sizeBytes\\\":1079537324},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9414357f9345a841e0565265700ecc6637f846c83bd5908dbb7b306432465115\\\"],\\\"sizeBytes\\\":1052707833},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8d1a1e4abe0326c3af89e9eaa4b7449dd2d5b6f9403c677e19b00b24947b1df9\\\"],\\\"sizeBytes\\\":989392005},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b2b1fc3d5bb4944cbd5b23b87566d7ba24b1b66f5a0465f76bcc05023191cc47\\\"],\\\"sizeBytes\\\":971668163},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:be2edaed22535093bdb486afe5960ff4f3b0bd96f88dc1753b584cc28184a0b0\\\"],\\\"sizeBytes\\\":969078739},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7e3d6c8802ae53d6aecf38aa7b560d7892193806bdeb3d7c1637fac77c47fd1f\\\"],\\\"sizeBytes\\\":876488654},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\"],\\\"sizeBytes\\\":847332502},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:36c4867005702f0c4cbfcfa33f18a98596a6c9b1340b633c85ccef84a0c4f889\\\"],\\\"sizeBytes\\\":769516783},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1b55c029f731ebbde3c5580eef98a588264f4d6a8ae667805c9521dd1ecf1d5d\\\"],\\\"sizeBytes\\\":721591926},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf05b9b2ba66351a6c59f4259fb377f62237a00af3b4f0b95f64409e2f25770e\\\"],\\\"sizeBytes\\\":646867625},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a8581a82ba5c8343a743aa302c4848249d8c32a9f2cd10fa68d89d835a1bdf8b\\\"],\\\"sizeBytes\\\":638910445},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ae245c97fc463e876c3024efb806fa8f4efb13b3f06f1bdd3e7e1447f5a5dce4\\\"],\\\"sizeBytes\\\":617699779},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d4926e304011637ca9df370a193896d685f0f3ffabbec234ec827abdbeb083f9\\\"],\\\"sizeBytes\\\":607756695},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5c5d7468f6838b6a714482e62ea956659212f3415ec8f69989f75eb6d8744a6e\\\"],\\\"sizeBytes\\\":584721741},{\\\"names\\\":[\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\\\"],\\\"sizeBytes\\\":545674969},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:574d49b89604b8e8103abf57feee77812fe8cf441eafc17fdff95d57ca80645e\\\"],\\\"sizeBytes\\\":542463064},{\\\"names\\\":[\\\"quay.io/crcont/openshift-crc-cluster-kube-controller-manager-operator@sha256:f69b9cc9b9cfde726109a9e12b80a3eefa472d7e29159df0fbc7143c48983cd6\\\"],\\\"sizeBytes\\\":539380592},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9506bdcf97d5200cf2cf4cdf110aebafdd141a24f6589bf1e1cfe27bb7fc1ed2\\\"],\\\"sizeBytes\\\":533027808},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\"],\\\"sizeBytes\\\":528200501},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5a2a7b3c2f1598189d8880e6aa15ab11a65b201f25012f77ba41e7487a60729a\\\"],\\\"sizeBytes\\\":527774342},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e5e8108294b086fdb797365e5a46badba9b3d866bdcddc8460a51e05a253753d\\\"],\\\"sizeBytes\\\":526632426},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5827f6ae3beb4853192e02cc18890467bd251b33070f36f9a105991e7e6d3c9b\\\"],\\\"sizeBytes\\\":522490210},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:66c8fe5d45ff249643dae75185dd2787ea1b0ae87d5699a8222149c07689557c\\\"],\\\"sizeBytes\\\":520141094},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:baf975b6944f2844860c440636e0d4b80b2fdc473d30f32ae7d6989f2fc2b135\\\"],\\\"sizeBytes\\\":519815758},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:765cf9c3ebf4df049ebc022beaaf52f52852cf89fb802034536ad91dd45db807\\\"],\\\"sizeBytes\\\":519539350},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:52e442bc8198ac925caff87ddd35b3107b7375d5afc9c2eb041ca4e79db72c6f\\\"],\\\"sizeBytes\\\":518690683},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:43b0e0b7e1955ee905e48799a62f50b8a8df553190415ce1f5550375c2507ca5\\\"],\\\"sizeBytes\\\":518251952},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:977a316fa3598eb575a4477dafc09bbf06fad21c4ec2867052225d74f2a9f366\\\"],\\\"sizeBytes\\\":511136541},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e504172345491d90bbbf1e7e45488e73073f4c6d7c2355245871051596fc85db\\\"],\\\"sizeBytes\\\":510122097},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dbd8603d717c26901bcf9731b1e0392ae4bc08a270ed1eeb45839e44bed9607d\\\"],\\\"sizeBytes\\\":508941917},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7c6a47106effd9e9a41131e2bf6c832b80cd77b3439334f760b35b0729f2fb00\\\"],\\\"sizeBytes\\\":508318343},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7a726c68cebc9b08edd734a8bae5150ae5950f7734fe9b9c2a6e0d06f21cc095\\\"],\\\"sizeBytes\\\":498380948},{\\\"names\\\":[\\\"quay.io/crcont/ocp-release@sha256:82501261b9c63012ba3b83fe4d6703c0af5eb9c9151670eb90ae480b9507d761\\\"],\\\"sizeBytes\\\":497232440},{\\\"names\\\":[\\\"registry.redhat.io/openshift4/ose-csi-external-provisioner@sha256:4e4239621caed0b0d9132d167403631e9af86be9a395977f013e201ead281bb4\\\",\\\"registry.redhat.io/openshift4/ose-csi-external-provisioner@sha256:c0b1bec73fdb6853eb3bd9e9733aee2d760ca09a33cfd94adf9ab7b706e83fa9\\\",\\\"registry.redhat.io/openshift4/ose-csi-external-provisioner:latest\\\"],\\\"sizeBytes\\\":491224335},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b0f7abf2f97afd1127d9245d764338c6047bac1711b2cee43112570a85946360\\\"],\\\"sizeBytes\\\":490381192},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:21b12ff0c81c1d535e7c31aff3a73b1e9ca763e5f88037f59ade0dfab6ed8946\\\"],\\\"sizeBytes\\\":482632652},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:036ed6efe4cb5f5b90ee7f9ef5297c8591b8d67aa36b3c58b4fc5417622a140c\\\"],\\\"sizeBytes\\\":477561861},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0fe5a041a2b99d736e82f1b4a6cd9792c5e23ded475e9f0742cd19234070f989\\\"],\\\"sizeBytes\\\":475327956},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dcb03ccba25366bbdf74cbab6738e7ef1f97f62760886ec445a40cdf29b60418\\\"],\\\"sizeBytes\\\":475137830},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2599f32933f5fea6066ede54ad8f6150adb7bd9067892f251d5913121d5c630d\\\"],\\\"sizeBytes\\\":472771950},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:651bbe9d418f49c2c889d731df67cf5d88dff59dc03f5a1b5d4c8bb3ae001f1a\\\"],\\\"sizeBytes\\\":469976318},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4fe612a1572df462d6a4b664a10bc2e6cad239648acbf8c0303f8fca5d2596c0\\\"],\\\"sizeBytes\\\":468393024},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a5bb05344dd2296077f5066e908ede0eea23f5a12fb78ef86a9513c88d3faaca\\\"],\\\"sizeBytes\\\":464375011},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\"],\\\"sizeBytes\\\":462844959}],\\\"nodeInfo\\\":{\\\"bootID\\\":\\\"3cdf81b4-f597-401a-9b99-34aaa64fb798\\\",\\\"systemUUID\\\":\\\"c6072c61-a7eb-44bd-85f7-eb9fdb0e84de\\\"}}}\" for node \"crc\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/node?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 15:33:07 crc kubenswrapper[5120]: I0316 15:33:07.779071 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:33:07 crc kubenswrapper[5120]: I0316 15:33:07.779098 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:33:07 crc kubenswrapper[5120]: I0316 15:33:07.779109 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:33:07 crc kubenswrapper[5120]: I0316 15:33:07.779124 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 15:33:07 crc kubenswrapper[5120]: I0316 15:33:07.779134 5120 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T15:33:07Z","lastTransitionTime":"2026-03-16T15:33:07Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 15:33:07 crc kubenswrapper[5120]: E0316 15:33:07.793422 5120 kubelet_node_status.go:597] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"allocatable\\\":{\\\"cpu\\\":\\\"11800m\\\",\\\"ephemeral-storage\\\":\\\"76396645454\\\",\\\"memory\\\":\\\"32400460Ki\\\"},\\\"capacity\\\":{\\\"cpu\\\":\\\"12\\\",\\\"ephemeral-storage\\\":\\\"83293888Ki\\\",\\\"memory\\\":\\\"32861260Ki\\\"},\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T15:33:07Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T15:33:07Z\\\",\\\"message\\\":\\\"kubelet has sufficient memory available\\\",\\\"reason\\\":\\\"KubeletHasSufficientMemory\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T15:33:07Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T15:33:07Z\\\",\\\"message\\\":\\\"kubelet has no disk pressure\\\",\\\"reason\\\":\\\"KubeletHasNoDiskPressure\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T15:33:07Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T15:33:07Z\\\",\\\"message\\\":\\\"kubelet has sufficient PID available\\\",\\\"reason\\\":\\\"KubeletHasSufficientPID\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T15:33:07Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T15:33:07Z\\\",\\\"message\\\":\\\"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?\\\",\\\"reason\\\":\\\"KubeletNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7c8a088031661d94022418e93fb63744c38e1c4cff93ea3b95c096a290c2b7a3\\\"],\\\"sizeBytes\\\":2981840865},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\"],\\\"sizeBytes\\\":1641503854},{\\\"names\\\":[\\\"registry.redhat.io/redhat/redhat-operator-index@sha256:286bb0beab328954b0a86b7f066fd5a843b462d6acb2812df7ec788015cd32d4\\\",\\\"registry.redhat.io/redhat/redhat-operator-index@sha256:be02784ed82978c399102be1c6c9f2ca441be4d984e0fd7100c155dd4417ebbf\\\",\\\"registry.redhat.io/redhat/redhat-operator-index:v4.20\\\"],\\\"sizeBytes\\\":1597684406},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:85f1323d589d7af13b096b1f9b438b9dfe08f3fab37534e2780e6490a665bf05\\\"],\\\"sizeBytes\\\":1261384762},{\\\"names\\\":[\\\"registry.redhat.io/redhat/community-operator-index@sha256:0d50962980a5aeecae2d99c98913fb0f46940164e41de0af2ba0e3dafe0d9017\\\",\\\"registry.redhat.io/redhat/community-operator-index@sha256:8d607fb6cc75ca36bca1e0a9c5bea5d1919b75db20733df69c64c8a10ee8083d\\\",\\\"registry.redhat.io/redhat/community-operator-index:v4.20\\\"],\\\"sizeBytes\\\":1224304325},{\\\"names\\\":[\\\"registry.redhat.io/redhat/certified-operator-index@sha256:541db5b20a3d2199602b3b5ac80f09ea31498034e9ae3841238b03a39150f0d7\\\",\\\"registry.redhat.io/redhat/certified-operator-index@sha256:a4c5df55584cba56f00004a090923a5c6de2071add5eb1672a5e20aa646aad8c\\\",\\\"registry.redhat.io/redhat/certified-operator-index:v4.20\\\"],\\\"sizeBytes\\\":1126957757},{\\\"names\\\":[\\\"registry.redhat.io/redhat/redhat-marketplace-index@sha256:b1c859067d6b7b785ab4977ed7137c5b3bb257234f7d7737a1d2836cef1576b5\\\",\\\"registry.redhat.io/redhat/redhat-marketplace-index@sha256:df08951924aa23b2333436a1d04b2dba56c366bb4f09d39ae3aedb980e4fb909\\\",\\\"registry.redhat.io/redhat/redhat-marketplace-index:v4.20\\\"],\\\"sizeBytes\\\":1079537324},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9414357f9345a841e0565265700ecc6637f846c83bd5908dbb7b306432465115\\\"],\\\"sizeBytes\\\":1052707833},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8d1a1e4abe0326c3af89e9eaa4b7449dd2d5b6f9403c677e19b00b24947b1df9\\\"],\\\"sizeBytes\\\":989392005},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b2b1fc3d5bb4944cbd5b23b87566d7ba24b1b66f5a0465f76bcc05023191cc47\\\"],\\\"sizeBytes\\\":971668163},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:be2edaed22535093bdb486afe5960ff4f3b0bd96f88dc1753b584cc28184a0b0\\\"],\\\"sizeBytes\\\":969078739},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7e3d6c8802ae53d6aecf38aa7b560d7892193806bdeb3d7c1637fac77c47fd1f\\\"],\\\"sizeBytes\\\":876488654},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\"],\\\"sizeBytes\\\":847332502},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:36c4867005702f0c4cbfcfa33f18a98596a6c9b1340b633c85ccef84a0c4f889\\\"],\\\"sizeBytes\\\":769516783},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1b55c029f731ebbde3c5580eef98a588264f4d6a8ae667805c9521dd1ecf1d5d\\\"],\\\"sizeBytes\\\":721591926},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf05b9b2ba66351a6c59f4259fb377f62237a00af3b4f0b95f64409e2f25770e\\\"],\\\"sizeBytes\\\":646867625},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a8581a82ba5c8343a743aa302c4848249d8c32a9f2cd10fa68d89d835a1bdf8b\\\"],\\\"sizeBytes\\\":638910445},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ae245c97fc463e876c3024efb806fa8f4efb13b3f06f1bdd3e7e1447f5a5dce4\\\"],\\\"sizeBytes\\\":617699779},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d4926e304011637ca9df370a193896d685f0f3ffabbec234ec827abdbeb083f9\\\"],\\\"sizeBytes\\\":607756695},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5c5d7468f6838b6a714482e62ea956659212f3415ec8f69989f75eb6d8744a6e\\\"],\\\"sizeBytes\\\":584721741},{\\\"names\\\":[\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\\\"],\\\"sizeBytes\\\":545674969},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:574d49b89604b8e8103abf57feee77812fe8cf441eafc17fdff95d57ca80645e\\\"],\\\"sizeBytes\\\":542463064},{\\\"names\\\":[\\\"quay.io/crcont/openshift-crc-cluster-kube-controller-manager-operator@sha256:f69b9cc9b9cfde726109a9e12b80a3eefa472d7e29159df0fbc7143c48983cd6\\\"],\\\"sizeBytes\\\":539380592},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9506bdcf97d5200cf2cf4cdf110aebafdd141a24f6589bf1e1cfe27bb7fc1ed2\\\"],\\\"sizeBytes\\\":533027808},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\"],\\\"sizeBytes\\\":528200501},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5a2a7b3c2f1598189d8880e6aa15ab11a65b201f25012f77ba41e7487a60729a\\\"],\\\"sizeBytes\\\":527774342},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e5e8108294b086fdb797365e5a46badba9b3d866bdcddc8460a51e05a253753d\\\"],\\\"sizeBytes\\\":526632426},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5827f6ae3beb4853192e02cc18890467bd251b33070f36f9a105991e7e6d3c9b\\\"],\\\"sizeBytes\\\":522490210},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:66c8fe5d45ff249643dae75185dd2787ea1b0ae87d5699a8222149c07689557c\\\"],\\\"sizeBytes\\\":520141094},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:baf975b6944f2844860c440636e0d4b80b2fdc473d30f32ae7d6989f2fc2b135\\\"],\\\"sizeBytes\\\":519815758},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:765cf9c3ebf4df049ebc022beaaf52f52852cf89fb802034536ad91dd45db807\\\"],\\\"sizeBytes\\\":519539350},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:52e442bc8198ac925caff87ddd35b3107b7375d5afc9c2eb041ca4e79db72c6f\\\"],\\\"sizeBytes\\\":518690683},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:43b0e0b7e1955ee905e48799a62f50b8a8df553190415ce1f5550375c2507ca5\\\"],\\\"sizeBytes\\\":518251952},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:977a316fa3598eb575a4477dafc09bbf06fad21c4ec2867052225d74f2a9f366\\\"],\\\"sizeBytes\\\":511136541},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e504172345491d90bbbf1e7e45488e73073f4c6d7c2355245871051596fc85db\\\"],\\\"sizeBytes\\\":510122097},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dbd8603d717c26901bcf9731b1e0392ae4bc08a270ed1eeb45839e44bed9607d\\\"],\\\"sizeBytes\\\":508941917},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7c6a47106effd9e9a41131e2bf6c832b80cd77b3439334f760b35b0729f2fb00\\\"],\\\"sizeBytes\\\":508318343},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7a726c68cebc9b08edd734a8bae5150ae5950f7734fe9b9c2a6e0d06f21cc095\\\"],\\\"sizeBytes\\\":498380948},{\\\"names\\\":[\\\"quay.io/crcont/ocp-release@sha256:82501261b9c63012ba3b83fe4d6703c0af5eb9c9151670eb90ae480b9507d761\\\"],\\\"sizeBytes\\\":497232440},{\\\"names\\\":[\\\"registry.redhat.io/openshift4/ose-csi-external-provisioner@sha256:4e4239621caed0b0d9132d167403631e9af86be9a395977f013e201ead281bb4\\\",\\\"registry.redhat.io/openshift4/ose-csi-external-provisioner@sha256:c0b1bec73fdb6853eb3bd9e9733aee2d760ca09a33cfd94adf9ab7b706e83fa9\\\",\\\"registry.redhat.io/openshift4/ose-csi-external-provisioner:latest\\\"],\\\"sizeBytes\\\":491224335},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b0f7abf2f97afd1127d9245d764338c6047bac1711b2cee43112570a85946360\\\"],\\\"sizeBytes\\\":490381192},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:21b12ff0c81c1d535e7c31aff3a73b1e9ca763e5f88037f59ade0dfab6ed8946\\\"],\\\"sizeBytes\\\":482632652},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:036ed6efe4cb5f5b90ee7f9ef5297c8591b8d67aa36b3c58b4fc5417622a140c\\\"],\\\"sizeBytes\\\":477561861},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0fe5a041a2b99d736e82f1b4a6cd9792c5e23ded475e9f0742cd19234070f989\\\"],\\\"sizeBytes\\\":475327956},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dcb03ccba25366bbdf74cbab6738e7ef1f97f62760886ec445a40cdf29b60418\\\"],\\\"sizeBytes\\\":475137830},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2599f32933f5fea6066ede54ad8f6150adb7bd9067892f251d5913121d5c630d\\\"],\\\"sizeBytes\\\":472771950},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:651bbe9d418f49c2c889d731df67cf5d88dff59dc03f5a1b5d4c8bb3ae001f1a\\\"],\\\"sizeBytes\\\":469976318},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4fe612a1572df462d6a4b664a10bc2e6cad239648acbf8c0303f8fca5d2596c0\\\"],\\\"sizeBytes\\\":468393024},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a5bb05344dd2296077f5066e908ede0eea23f5a12fb78ef86a9513c88d3faaca\\\"],\\\"sizeBytes\\\":464375011},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\"],\\\"sizeBytes\\\":462844959}],\\\"nodeInfo\\\":{\\\"bootID\\\":\\\"3cdf81b4-f597-401a-9b99-34aaa64fb798\\\",\\\"systemUUID\\\":\\\"c6072c61-a7eb-44bd-85f7-eb9fdb0e84de\\\"}}}\" for node \"crc\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/node?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 15:33:07 crc kubenswrapper[5120]: E0316 15:33:07.793557 5120 kubelet_node_status.go:584] "Unable to update node status" err="update node status exceeds retry count" Mar 16 15:33:07 crc kubenswrapper[5120]: E0316 15:33:07.793573 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:07 crc kubenswrapper[5120]: E0316 15:33:07.893849 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:07 crc kubenswrapper[5120]: E0316 15:33:07.994359 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:08 crc kubenswrapper[5120]: E0316 15:33:08.094830 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:08 crc kubenswrapper[5120]: E0316 15:33:08.195519 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:08 crc kubenswrapper[5120]: E0316 15:33:08.295635 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:08 crc kubenswrapper[5120]: E0316 15:33:08.396599 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:08 crc kubenswrapper[5120]: E0316 15:33:08.497067 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:08 crc kubenswrapper[5120]: E0316 15:33:08.598228 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:08 crc kubenswrapper[5120]: E0316 15:33:08.699054 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:08 crc kubenswrapper[5120]: E0316 15:33:08.726532 5120 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"crc\" not found" Mar 16 15:33:08 crc kubenswrapper[5120]: E0316 15:33:08.799595 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:08 crc kubenswrapper[5120]: E0316 15:33:08.900689 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:09 crc kubenswrapper[5120]: E0316 15:33:09.001617 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:09 crc kubenswrapper[5120]: E0316 15:33:09.102680 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:09 crc kubenswrapper[5120]: E0316 15:33:09.203420 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:09 crc kubenswrapper[5120]: E0316 15:33:09.304287 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:09 crc kubenswrapper[5120]: E0316 15:33:09.405247 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:09 crc kubenswrapper[5120]: E0316 15:33:09.506113 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:09 crc kubenswrapper[5120]: E0316 15:33:09.606868 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:09 crc kubenswrapper[5120]: E0316 15:33:09.707709 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:09 crc kubenswrapper[5120]: E0316 15:33:09.808467 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:09 crc kubenswrapper[5120]: E0316 15:33:09.909538 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:10 crc kubenswrapper[5120]: E0316 15:33:10.010458 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:10 crc kubenswrapper[5120]: E0316 15:33:10.111006 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:10 crc kubenswrapper[5120]: E0316 15:33:10.212134 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:10 crc kubenswrapper[5120]: E0316 15:33:10.313160 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:10 crc kubenswrapper[5120]: E0316 15:33:10.413845 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:10 crc kubenswrapper[5120]: E0316 15:33:10.513971 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:10 crc kubenswrapper[5120]: E0316 15:33:10.614157 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:10 crc kubenswrapper[5120]: E0316 15:33:10.714925 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:10 crc kubenswrapper[5120]: E0316 15:33:10.815305 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:10 crc kubenswrapper[5120]: E0316 15:33:10.916499 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:11 crc kubenswrapper[5120]: E0316 15:33:11.017687 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:11 crc kubenswrapper[5120]: E0316 15:33:11.118097 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:11 crc kubenswrapper[5120]: E0316 15:33:11.219166 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:11 crc kubenswrapper[5120]: E0316 15:33:11.319300 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:11 crc kubenswrapper[5120]: E0316 15:33:11.419598 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:11 crc kubenswrapper[5120]: E0316 15:33:11.520080 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:11 crc kubenswrapper[5120]: E0316 15:33:11.620232 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:11 crc kubenswrapper[5120]: E0316 15:33:11.721407 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:11 crc kubenswrapper[5120]: E0316 15:33:11.822005 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:11 crc kubenswrapper[5120]: E0316 15:33:11.922736 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:12 crc kubenswrapper[5120]: E0316 15:33:12.023295 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:12 crc kubenswrapper[5120]: E0316 15:33:12.124199 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:12 crc kubenswrapper[5120]: E0316 15:33:12.224283 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:12 crc kubenswrapper[5120]: E0316 15:33:12.325250 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:12 crc kubenswrapper[5120]: E0316 15:33:12.425829 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:12 crc kubenswrapper[5120]: E0316 15:33:12.526212 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:12 crc kubenswrapper[5120]: E0316 15:33:12.627150 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:12 crc kubenswrapper[5120]: E0316 15:33:12.727992 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:12 crc kubenswrapper[5120]: E0316 15:33:12.828371 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:12 crc kubenswrapper[5120]: E0316 15:33:12.929198 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:13 crc kubenswrapper[5120]: E0316 15:33:13.029788 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:13 crc kubenswrapper[5120]: E0316 15:33:13.130231 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:13 crc kubenswrapper[5120]: E0316 15:33:13.230358 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:13 crc kubenswrapper[5120]: E0316 15:33:13.331364 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:13 crc kubenswrapper[5120]: E0316 15:33:13.431537 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:13 crc kubenswrapper[5120]: E0316 15:33:13.531852 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:13 crc kubenswrapper[5120]: E0316 15:33:13.632921 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:13 crc kubenswrapper[5120]: I0316 15:33:13.663864 5120 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 15:33:13 crc kubenswrapper[5120]: I0316 15:33:13.665728 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:33:13 crc kubenswrapper[5120]: I0316 15:33:13.665835 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:33:13 crc kubenswrapper[5120]: I0316 15:33:13.665856 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:33:13 crc kubenswrapper[5120]: E0316 15:33:13.666697 5120 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"crc\" not found" node="crc" Mar 16 15:33:13 crc kubenswrapper[5120]: E0316 15:33:13.733619 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:13 crc kubenswrapper[5120]: E0316 15:33:13.834470 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:13 crc kubenswrapper[5120]: E0316 15:33:13.934741 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:14 crc kubenswrapper[5120]: E0316 15:33:14.035654 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:14 crc kubenswrapper[5120]: E0316 15:33:14.136359 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:14 crc kubenswrapper[5120]: E0316 15:33:14.237505 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:14 crc kubenswrapper[5120]: E0316 15:33:14.337915 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:14 crc kubenswrapper[5120]: E0316 15:33:14.438196 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:14 crc kubenswrapper[5120]: E0316 15:33:14.539107 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:14 crc kubenswrapper[5120]: E0316 15:33:14.639998 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:14 crc kubenswrapper[5120]: E0316 15:33:14.740793 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:14 crc kubenswrapper[5120]: E0316 15:33:14.841239 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:14 crc kubenswrapper[5120]: E0316 15:33:14.941416 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:15 crc kubenswrapper[5120]: E0316 15:33:15.042395 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:15 crc kubenswrapper[5120]: E0316 15:33:15.143121 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:15 crc kubenswrapper[5120]: E0316 15:33:15.244106 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:15 crc kubenswrapper[5120]: E0316 15:33:15.344927 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:15 crc kubenswrapper[5120]: E0316 15:33:15.446061 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:15 crc kubenswrapper[5120]: E0316 15:33:15.547207 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:15 crc kubenswrapper[5120]: E0316 15:33:15.647428 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:15 crc kubenswrapper[5120]: E0316 15:33:15.747991 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:15 crc kubenswrapper[5120]: E0316 15:33:15.848127 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:15 crc kubenswrapper[5120]: E0316 15:33:15.948286 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:16 crc kubenswrapper[5120]: E0316 15:33:16.049457 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:16 crc kubenswrapper[5120]: E0316 15:33:16.150440 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:16 crc kubenswrapper[5120]: E0316 15:33:16.251273 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:16 crc kubenswrapper[5120]: E0316 15:33:16.352150 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:16 crc kubenswrapper[5120]: E0316 15:33:16.452620 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:16 crc kubenswrapper[5120]: E0316 15:33:16.553121 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:16 crc kubenswrapper[5120]: E0316 15:33:16.653227 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:16 crc kubenswrapper[5120]: E0316 15:33:16.754353 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:16 crc kubenswrapper[5120]: E0316 15:33:16.855221 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:16 crc kubenswrapper[5120]: E0316 15:33:16.956114 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:17 crc kubenswrapper[5120]: E0316 15:33:17.057584 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:17 crc kubenswrapper[5120]: E0316 15:33:17.158495 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:17 crc kubenswrapper[5120]: E0316 15:33:17.259647 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:17 crc kubenswrapper[5120]: E0316 15:33:17.361008 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:17 crc kubenswrapper[5120]: E0316 15:33:17.461221 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:17 crc kubenswrapper[5120]: E0316 15:33:17.562046 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:17 crc kubenswrapper[5120]: E0316 15:33:17.663528 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:17 crc kubenswrapper[5120]: E0316 15:33:17.764196 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:17 crc kubenswrapper[5120]: E0316 15:33:17.804025 5120 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"crc\": node \"crc\" not found" Mar 16 15:33:17 crc kubenswrapper[5120]: I0316 15:33:17.809600 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:33:17 crc kubenswrapper[5120]: I0316 15:33:17.809932 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:33:17 crc kubenswrapper[5120]: I0316 15:33:17.810091 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:33:17 crc kubenswrapper[5120]: I0316 15:33:17.810264 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 15:33:17 crc kubenswrapper[5120]: I0316 15:33:17.810491 5120 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T15:33:17Z","lastTransitionTime":"2026-03-16T15:33:17Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 15:33:17 crc kubenswrapper[5120]: E0316 15:33:17.826147 5120 kubelet_node_status.go:597] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"allocatable\\\":{\\\"cpu\\\":\\\"11800m\\\",\\\"ephemeral-storage\\\":\\\"76396645454\\\",\\\"memory\\\":\\\"32400460Ki\\\"},\\\"capacity\\\":{\\\"cpu\\\":\\\"12\\\",\\\"ephemeral-storage\\\":\\\"83293888Ki\\\",\\\"memory\\\":\\\"32861260Ki\\\"},\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T15:33:17Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T15:33:17Z\\\",\\\"message\\\":\\\"kubelet has sufficient memory available\\\",\\\"reason\\\":\\\"KubeletHasSufficientMemory\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T15:33:17Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T15:33:17Z\\\",\\\"message\\\":\\\"kubelet has no disk pressure\\\",\\\"reason\\\":\\\"KubeletHasNoDiskPressure\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T15:33:17Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T15:33:17Z\\\",\\\"message\\\":\\\"kubelet has sufficient PID available\\\",\\\"reason\\\":\\\"KubeletHasSufficientPID\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T15:33:17Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T15:33:17Z\\\",\\\"message\\\":\\\"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?\\\",\\\"reason\\\":\\\"KubeletNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7c8a088031661d94022418e93fb63744c38e1c4cff93ea3b95c096a290c2b7a3\\\"],\\\"sizeBytes\\\":2981840865},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\"],\\\"sizeBytes\\\":1641503854},{\\\"names\\\":[\\\"registry.redhat.io/redhat/redhat-operator-index@sha256:286bb0beab328954b0a86b7f066fd5a843b462d6acb2812df7ec788015cd32d4\\\",\\\"registry.redhat.io/redhat/redhat-operator-index@sha256:be02784ed82978c399102be1c6c9f2ca441be4d984e0fd7100c155dd4417ebbf\\\",\\\"registry.redhat.io/redhat/redhat-operator-index:v4.20\\\"],\\\"sizeBytes\\\":1597684406},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:85f1323d589d7af13b096b1f9b438b9dfe08f3fab37534e2780e6490a665bf05\\\"],\\\"sizeBytes\\\":1261384762},{\\\"names\\\":[\\\"registry.redhat.io/redhat/community-operator-index@sha256:0d50962980a5aeecae2d99c98913fb0f46940164e41de0af2ba0e3dafe0d9017\\\",\\\"registry.redhat.io/redhat/community-operator-index@sha256:8d607fb6cc75ca36bca1e0a9c5bea5d1919b75db20733df69c64c8a10ee8083d\\\",\\\"registry.redhat.io/redhat/community-operator-index:v4.20\\\"],\\\"sizeBytes\\\":1224304325},{\\\"names\\\":[\\\"registry.redhat.io/redhat/certified-operator-index@sha256:541db5b20a3d2199602b3b5ac80f09ea31498034e9ae3841238b03a39150f0d7\\\",\\\"registry.redhat.io/redhat/certified-operator-index@sha256:a4c5df55584cba56f00004a090923a5c6de2071add5eb1672a5e20aa646aad8c\\\",\\\"registry.redhat.io/redhat/certified-operator-index:v4.20\\\"],\\\"sizeBytes\\\":1126957757},{\\\"names\\\":[\\\"registry.redhat.io/redhat/redhat-marketplace-index@sha256:b1c859067d6b7b785ab4977ed7137c5b3bb257234f7d7737a1d2836cef1576b5\\\",\\\"registry.redhat.io/redhat/redhat-marketplace-index@sha256:df08951924aa23b2333436a1d04b2dba56c366bb4f09d39ae3aedb980e4fb909\\\",\\\"registry.redhat.io/redhat/redhat-marketplace-index:v4.20\\\"],\\\"sizeBytes\\\":1079537324},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9414357f9345a841e0565265700ecc6637f846c83bd5908dbb7b306432465115\\\"],\\\"sizeBytes\\\":1052707833},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8d1a1e4abe0326c3af89e9eaa4b7449dd2d5b6f9403c677e19b00b24947b1df9\\\"],\\\"sizeBytes\\\":989392005},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b2b1fc3d5bb4944cbd5b23b87566d7ba24b1b66f5a0465f76bcc05023191cc47\\\"],\\\"sizeBytes\\\":971668163},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:be2edaed22535093bdb486afe5960ff4f3b0bd96f88dc1753b584cc28184a0b0\\\"],\\\"sizeBytes\\\":969078739},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7e3d6c8802ae53d6aecf38aa7b560d7892193806bdeb3d7c1637fac77c47fd1f\\\"],\\\"sizeBytes\\\":876488654},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\"],\\\"sizeBytes\\\":847332502},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:36c4867005702f0c4cbfcfa33f18a98596a6c9b1340b633c85ccef84a0c4f889\\\"],\\\"sizeBytes\\\":769516783},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1b55c029f731ebbde3c5580eef98a588264f4d6a8ae667805c9521dd1ecf1d5d\\\"],\\\"sizeBytes\\\":721591926},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf05b9b2ba66351a6c59f4259fb377f62237a00af3b4f0b95f64409e2f25770e\\\"],\\\"sizeBytes\\\":646867625},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a8581a82ba5c8343a743aa302c4848249d8c32a9f2cd10fa68d89d835a1bdf8b\\\"],\\\"sizeBytes\\\":638910445},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ae245c97fc463e876c3024efb806fa8f4efb13b3f06f1bdd3e7e1447f5a5dce4\\\"],\\\"sizeBytes\\\":617699779},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d4926e304011637ca9df370a193896d685f0f3ffabbec234ec827abdbeb083f9\\\"],\\\"sizeBytes\\\":607756695},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5c5d7468f6838b6a714482e62ea956659212f3415ec8f69989f75eb6d8744a6e\\\"],\\\"sizeBytes\\\":584721741},{\\\"names\\\":[\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\\\"],\\\"sizeBytes\\\":545674969},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:574d49b89604b8e8103abf57feee77812fe8cf441eafc17fdff95d57ca80645e\\\"],\\\"sizeBytes\\\":542463064},{\\\"names\\\":[\\\"quay.io/crcont/openshift-crc-cluster-kube-controller-manager-operator@sha256:f69b9cc9b9cfde726109a9e12b80a3eefa472d7e29159df0fbc7143c48983cd6\\\"],\\\"sizeBytes\\\":539380592},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9506bdcf97d5200cf2cf4cdf110aebafdd141a24f6589bf1e1cfe27bb7fc1ed2\\\"],\\\"sizeBytes\\\":533027808},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\"],\\\"sizeBytes\\\":528200501},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5a2a7b3c2f1598189d8880e6aa15ab11a65b201f25012f77ba41e7487a60729a\\\"],\\\"sizeBytes\\\":527774342},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e5e8108294b086fdb797365e5a46badba9b3d866bdcddc8460a51e05a253753d\\\"],\\\"sizeBytes\\\":526632426},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5827f6ae3beb4853192e02cc18890467bd251b33070f36f9a105991e7e6d3c9b\\\"],\\\"sizeBytes\\\":522490210},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:66c8fe5d45ff249643dae75185dd2787ea1b0ae87d5699a8222149c07689557c\\\"],\\\"sizeBytes\\\":520141094},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:baf975b6944f2844860c440636e0d4b80b2fdc473d30f32ae7d6989f2fc2b135\\\"],\\\"sizeBytes\\\":519815758},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:765cf9c3ebf4df049ebc022beaaf52f52852cf89fb802034536ad91dd45db807\\\"],\\\"sizeBytes\\\":519539350},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:52e442bc8198ac925caff87ddd35b3107b7375d5afc9c2eb041ca4e79db72c6f\\\"],\\\"sizeBytes\\\":518690683},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:43b0e0b7e1955ee905e48799a62f50b8a8df553190415ce1f5550375c2507ca5\\\"],\\\"sizeBytes\\\":518251952},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:977a316fa3598eb575a4477dafc09bbf06fad21c4ec2867052225d74f2a9f366\\\"],\\\"sizeBytes\\\":511136541},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e504172345491d90bbbf1e7e45488e73073f4c6d7c2355245871051596fc85db\\\"],\\\"sizeBytes\\\":510122097},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dbd8603d717c26901bcf9731b1e0392ae4bc08a270ed1eeb45839e44bed9607d\\\"],\\\"sizeBytes\\\":508941917},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7c6a47106effd9e9a41131e2bf6c832b80cd77b3439334f760b35b0729f2fb00\\\"],\\\"sizeBytes\\\":508318343},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7a726c68cebc9b08edd734a8bae5150ae5950f7734fe9b9c2a6e0d06f21cc095\\\"],\\\"sizeBytes\\\":498380948},{\\\"names\\\":[\\\"quay.io/crcont/ocp-release@sha256:82501261b9c63012ba3b83fe4d6703c0af5eb9c9151670eb90ae480b9507d761\\\"],\\\"sizeBytes\\\":497232440},{\\\"names\\\":[\\\"registry.redhat.io/openshift4/ose-csi-external-provisioner@sha256:4e4239621caed0b0d9132d167403631e9af86be9a395977f013e201ead281bb4\\\",\\\"registry.redhat.io/openshift4/ose-csi-external-provisioner@sha256:c0b1bec73fdb6853eb3bd9e9733aee2d760ca09a33cfd94adf9ab7b706e83fa9\\\",\\\"registry.redhat.io/openshift4/ose-csi-external-provisioner:latest\\\"],\\\"sizeBytes\\\":491224335},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b0f7abf2f97afd1127d9245d764338c6047bac1711b2cee43112570a85946360\\\"],\\\"sizeBytes\\\":490381192},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:21b12ff0c81c1d535e7c31aff3a73b1e9ca763e5f88037f59ade0dfab6ed8946\\\"],\\\"sizeBytes\\\":482632652},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:036ed6efe4cb5f5b90ee7f9ef5297c8591b8d67aa36b3c58b4fc5417622a140c\\\"],\\\"sizeBytes\\\":477561861},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0fe5a041a2b99d736e82f1b4a6cd9792c5e23ded475e9f0742cd19234070f989\\\"],\\\"sizeBytes\\\":475327956},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dcb03ccba25366bbdf74cbab6738e7ef1f97f62760886ec445a40cdf29b60418\\\"],\\\"sizeBytes\\\":475137830},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2599f32933f5fea6066ede54ad8f6150adb7bd9067892f251d5913121d5c630d\\\"],\\\"sizeBytes\\\":472771950},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:651bbe9d418f49c2c889d731df67cf5d88dff59dc03f5a1b5d4c8bb3ae001f1a\\\"],\\\"sizeBytes\\\":469976318},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4fe612a1572df462d6a4b664a10bc2e6cad239648acbf8c0303f8fca5d2596c0\\\"],\\\"sizeBytes\\\":468393024},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a5bb05344dd2296077f5066e908ede0eea23f5a12fb78ef86a9513c88d3faaca\\\"],\\\"sizeBytes\\\":464375011},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\"],\\\"sizeBytes\\\":462844959}],\\\"nodeInfo\\\":{\\\"bootID\\\":\\\"3cdf81b4-f597-401a-9b99-34aaa64fb798\\\",\\\"systemUUID\\\":\\\"c6072c61-a7eb-44bd-85f7-eb9fdb0e84de\\\"}}}\" for node \"crc\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/node?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 15:33:17 crc kubenswrapper[5120]: I0316 15:33:17.830704 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:33:17 crc kubenswrapper[5120]: I0316 15:33:17.830989 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:33:17 crc kubenswrapper[5120]: I0316 15:33:17.831152 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:33:17 crc kubenswrapper[5120]: I0316 15:33:17.831312 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 15:33:17 crc kubenswrapper[5120]: I0316 15:33:17.831455 5120 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T15:33:17Z","lastTransitionTime":"2026-03-16T15:33:17Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 15:33:17 crc kubenswrapper[5120]: E0316 15:33:17.853298 5120 kubelet_node_status.go:597] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"allocatable\\\":{\\\"cpu\\\":\\\"11800m\\\",\\\"ephemeral-storage\\\":\\\"76396645454\\\",\\\"memory\\\":\\\"32400460Ki\\\"},\\\"capacity\\\":{\\\"cpu\\\":\\\"12\\\",\\\"ephemeral-storage\\\":\\\"83293888Ki\\\",\\\"memory\\\":\\\"32861260Ki\\\"},\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T15:33:17Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T15:33:17Z\\\",\\\"message\\\":\\\"kubelet has sufficient memory available\\\",\\\"reason\\\":\\\"KubeletHasSufficientMemory\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T15:33:17Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T15:33:17Z\\\",\\\"message\\\":\\\"kubelet has no disk pressure\\\",\\\"reason\\\":\\\"KubeletHasNoDiskPressure\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T15:33:17Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T15:33:17Z\\\",\\\"message\\\":\\\"kubelet has sufficient PID available\\\",\\\"reason\\\":\\\"KubeletHasSufficientPID\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T15:33:17Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T15:33:17Z\\\",\\\"message\\\":\\\"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?\\\",\\\"reason\\\":\\\"KubeletNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7c8a088031661d94022418e93fb63744c38e1c4cff93ea3b95c096a290c2b7a3\\\"],\\\"sizeBytes\\\":2981840865},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\"],\\\"sizeBytes\\\":1641503854},{\\\"names\\\":[\\\"registry.redhat.io/redhat/redhat-operator-index@sha256:286bb0beab328954b0a86b7f066fd5a843b462d6acb2812df7ec788015cd32d4\\\",\\\"registry.redhat.io/redhat/redhat-operator-index@sha256:be02784ed82978c399102be1c6c9f2ca441be4d984e0fd7100c155dd4417ebbf\\\",\\\"registry.redhat.io/redhat/redhat-operator-index:v4.20\\\"],\\\"sizeBytes\\\":1597684406},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:85f1323d589d7af13b096b1f9b438b9dfe08f3fab37534e2780e6490a665bf05\\\"],\\\"sizeBytes\\\":1261384762},{\\\"names\\\":[\\\"registry.redhat.io/redhat/community-operator-index@sha256:0d50962980a5aeecae2d99c98913fb0f46940164e41de0af2ba0e3dafe0d9017\\\",\\\"registry.redhat.io/redhat/community-operator-index@sha256:8d607fb6cc75ca36bca1e0a9c5bea5d1919b75db20733df69c64c8a10ee8083d\\\",\\\"registry.redhat.io/redhat/community-operator-index:v4.20\\\"],\\\"sizeBytes\\\":1224304325},{\\\"names\\\":[\\\"registry.redhat.io/redhat/certified-operator-index@sha256:541db5b20a3d2199602b3b5ac80f09ea31498034e9ae3841238b03a39150f0d7\\\",\\\"registry.redhat.io/redhat/certified-operator-index@sha256:a4c5df55584cba56f00004a090923a5c6de2071add5eb1672a5e20aa646aad8c\\\",\\\"registry.redhat.io/redhat/certified-operator-index:v4.20\\\"],\\\"sizeBytes\\\":1126957757},{\\\"names\\\":[\\\"registry.redhat.io/redhat/redhat-marketplace-index@sha256:b1c859067d6b7b785ab4977ed7137c5b3bb257234f7d7737a1d2836cef1576b5\\\",\\\"registry.redhat.io/redhat/redhat-marketplace-index@sha256:df08951924aa23b2333436a1d04b2dba56c366bb4f09d39ae3aedb980e4fb909\\\",\\\"registry.redhat.io/redhat/redhat-marketplace-index:v4.20\\\"],\\\"sizeBytes\\\":1079537324},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9414357f9345a841e0565265700ecc6637f846c83bd5908dbb7b306432465115\\\"],\\\"sizeBytes\\\":1052707833},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8d1a1e4abe0326c3af89e9eaa4b7449dd2d5b6f9403c677e19b00b24947b1df9\\\"],\\\"sizeBytes\\\":989392005},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b2b1fc3d5bb4944cbd5b23b87566d7ba24b1b66f5a0465f76bcc05023191cc47\\\"],\\\"sizeBytes\\\":971668163},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:be2edaed22535093bdb486afe5960ff4f3b0bd96f88dc1753b584cc28184a0b0\\\"],\\\"sizeBytes\\\":969078739},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7e3d6c8802ae53d6aecf38aa7b560d7892193806bdeb3d7c1637fac77c47fd1f\\\"],\\\"sizeBytes\\\":876488654},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\"],\\\"sizeBytes\\\":847332502},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:36c4867005702f0c4cbfcfa33f18a98596a6c9b1340b633c85ccef84a0c4f889\\\"],\\\"sizeBytes\\\":769516783},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1b55c029f731ebbde3c5580eef98a588264f4d6a8ae667805c9521dd1ecf1d5d\\\"],\\\"sizeBytes\\\":721591926},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf05b9b2ba66351a6c59f4259fb377f62237a00af3b4f0b95f64409e2f25770e\\\"],\\\"sizeBytes\\\":646867625},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a8581a82ba5c8343a743aa302c4848249d8c32a9f2cd10fa68d89d835a1bdf8b\\\"],\\\"sizeBytes\\\":638910445},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ae245c97fc463e876c3024efb806fa8f4efb13b3f06f1bdd3e7e1447f5a5dce4\\\"],\\\"sizeBytes\\\":617699779},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d4926e304011637ca9df370a193896d685f0f3ffabbec234ec827abdbeb083f9\\\"],\\\"sizeBytes\\\":607756695},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5c5d7468f6838b6a714482e62ea956659212f3415ec8f69989f75eb6d8744a6e\\\"],\\\"sizeBytes\\\":584721741},{\\\"names\\\":[\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\\\"],\\\"sizeBytes\\\":545674969},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:574d49b89604b8e8103abf57feee77812fe8cf441eafc17fdff95d57ca80645e\\\"],\\\"sizeBytes\\\":542463064},{\\\"names\\\":[\\\"quay.io/crcont/openshift-crc-cluster-kube-controller-manager-operator@sha256:f69b9cc9b9cfde726109a9e12b80a3eefa472d7e29159df0fbc7143c48983cd6\\\"],\\\"sizeBytes\\\":539380592},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9506bdcf97d5200cf2cf4cdf110aebafdd141a24f6589bf1e1cfe27bb7fc1ed2\\\"],\\\"sizeBytes\\\":533027808},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\"],\\\"sizeBytes\\\":528200501},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5a2a7b3c2f1598189d8880e6aa15ab11a65b201f25012f77ba41e7487a60729a\\\"],\\\"sizeBytes\\\":527774342},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e5e8108294b086fdb797365e5a46badba9b3d866bdcddc8460a51e05a253753d\\\"],\\\"sizeBytes\\\":526632426},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5827f6ae3beb4853192e02cc18890467bd251b33070f36f9a105991e7e6d3c9b\\\"],\\\"sizeBytes\\\":522490210},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:66c8fe5d45ff249643dae75185dd2787ea1b0ae87d5699a8222149c07689557c\\\"],\\\"sizeBytes\\\":520141094},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:baf975b6944f2844860c440636e0d4b80b2fdc473d30f32ae7d6989f2fc2b135\\\"],\\\"sizeBytes\\\":519815758},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:765cf9c3ebf4df049ebc022beaaf52f52852cf89fb802034536ad91dd45db807\\\"],\\\"sizeBytes\\\":519539350},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:52e442bc8198ac925caff87ddd35b3107b7375d5afc9c2eb041ca4e79db72c6f\\\"],\\\"sizeBytes\\\":518690683},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:43b0e0b7e1955ee905e48799a62f50b8a8df553190415ce1f5550375c2507ca5\\\"],\\\"sizeBytes\\\":518251952},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:977a316fa3598eb575a4477dafc09bbf06fad21c4ec2867052225d74f2a9f366\\\"],\\\"sizeBytes\\\":511136541},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e504172345491d90bbbf1e7e45488e73073f4c6d7c2355245871051596fc85db\\\"],\\\"sizeBytes\\\":510122097},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dbd8603d717c26901bcf9731b1e0392ae4bc08a270ed1eeb45839e44bed9607d\\\"],\\\"sizeBytes\\\":508941917},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7c6a47106effd9e9a41131e2bf6c832b80cd77b3439334f760b35b0729f2fb00\\\"],\\\"sizeBytes\\\":508318343},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7a726c68cebc9b08edd734a8bae5150ae5950f7734fe9b9c2a6e0d06f21cc095\\\"],\\\"sizeBytes\\\":498380948},{\\\"names\\\":[\\\"quay.io/crcont/ocp-release@sha256:82501261b9c63012ba3b83fe4d6703c0af5eb9c9151670eb90ae480b9507d761\\\"],\\\"sizeBytes\\\":497232440},{\\\"names\\\":[\\\"registry.redhat.io/openshift4/ose-csi-external-provisioner@sha256:4e4239621caed0b0d9132d167403631e9af86be9a395977f013e201ead281bb4\\\",\\\"registry.redhat.io/openshift4/ose-csi-external-provisioner@sha256:c0b1bec73fdb6853eb3bd9e9733aee2d760ca09a33cfd94adf9ab7b706e83fa9\\\",\\\"registry.redhat.io/openshift4/ose-csi-external-provisioner:latest\\\"],\\\"sizeBytes\\\":491224335},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b0f7abf2f97afd1127d9245d764338c6047bac1711b2cee43112570a85946360\\\"],\\\"sizeBytes\\\":490381192},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:21b12ff0c81c1d535e7c31aff3a73b1e9ca763e5f88037f59ade0dfab6ed8946\\\"],\\\"sizeBytes\\\":482632652},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:036ed6efe4cb5f5b90ee7f9ef5297c8591b8d67aa36b3c58b4fc5417622a140c\\\"],\\\"sizeBytes\\\":477561861},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0fe5a041a2b99d736e82f1b4a6cd9792c5e23ded475e9f0742cd19234070f989\\\"],\\\"sizeBytes\\\":475327956},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dcb03ccba25366bbdf74cbab6738e7ef1f97f62760886ec445a40cdf29b60418\\\"],\\\"sizeBytes\\\":475137830},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2599f32933f5fea6066ede54ad8f6150adb7bd9067892f251d5913121d5c630d\\\"],\\\"sizeBytes\\\":472771950},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:651bbe9d418f49c2c889d731df67cf5d88dff59dc03f5a1b5d4c8bb3ae001f1a\\\"],\\\"sizeBytes\\\":469976318},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4fe612a1572df462d6a4b664a10bc2e6cad239648acbf8c0303f8fca5d2596c0\\\"],\\\"sizeBytes\\\":468393024},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a5bb05344dd2296077f5066e908ede0eea23f5a12fb78ef86a9513c88d3faaca\\\"],\\\"sizeBytes\\\":464375011},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\"],\\\"sizeBytes\\\":462844959}],\\\"nodeInfo\\\":{\\\"bootID\\\":\\\"3cdf81b4-f597-401a-9b99-34aaa64fb798\\\",\\\"systemUUID\\\":\\\"c6072c61-a7eb-44bd-85f7-eb9fdb0e84de\\\"}}}\" for node \"crc\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/node?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 15:33:17 crc kubenswrapper[5120]: I0316 15:33:17.858944 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:33:17 crc kubenswrapper[5120]: I0316 15:33:17.859175 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:33:17 crc kubenswrapper[5120]: I0316 15:33:17.859312 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:33:17 crc kubenswrapper[5120]: I0316 15:33:17.859446 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 15:33:17 crc kubenswrapper[5120]: I0316 15:33:17.859581 5120 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T15:33:17Z","lastTransitionTime":"2026-03-16T15:33:17Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 15:33:17 crc kubenswrapper[5120]: E0316 15:33:17.878579 5120 kubelet_node_status.go:597] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"allocatable\\\":{\\\"cpu\\\":\\\"11800m\\\",\\\"ephemeral-storage\\\":\\\"76396645454\\\",\\\"memory\\\":\\\"32400460Ki\\\"},\\\"capacity\\\":{\\\"cpu\\\":\\\"12\\\",\\\"ephemeral-storage\\\":\\\"83293888Ki\\\",\\\"memory\\\":\\\"32861260Ki\\\"},\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T15:33:17Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T15:33:17Z\\\",\\\"message\\\":\\\"kubelet has sufficient memory available\\\",\\\"reason\\\":\\\"KubeletHasSufficientMemory\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T15:33:17Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T15:33:17Z\\\",\\\"message\\\":\\\"kubelet has no disk pressure\\\",\\\"reason\\\":\\\"KubeletHasNoDiskPressure\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T15:33:17Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T15:33:17Z\\\",\\\"message\\\":\\\"kubelet has sufficient PID available\\\",\\\"reason\\\":\\\"KubeletHasSufficientPID\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T15:33:17Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T15:33:17Z\\\",\\\"message\\\":\\\"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?\\\",\\\"reason\\\":\\\"KubeletNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7c8a088031661d94022418e93fb63744c38e1c4cff93ea3b95c096a290c2b7a3\\\"],\\\"sizeBytes\\\":2981840865},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\"],\\\"sizeBytes\\\":1641503854},{\\\"names\\\":[\\\"registry.redhat.io/redhat/redhat-operator-index@sha256:286bb0beab328954b0a86b7f066fd5a843b462d6acb2812df7ec788015cd32d4\\\",\\\"registry.redhat.io/redhat/redhat-operator-index@sha256:be02784ed82978c399102be1c6c9f2ca441be4d984e0fd7100c155dd4417ebbf\\\",\\\"registry.redhat.io/redhat/redhat-operator-index:v4.20\\\"],\\\"sizeBytes\\\":1597684406},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:85f1323d589d7af13b096b1f9b438b9dfe08f3fab37534e2780e6490a665bf05\\\"],\\\"sizeBytes\\\":1261384762},{\\\"names\\\":[\\\"registry.redhat.io/redhat/community-operator-index@sha256:0d50962980a5aeecae2d99c98913fb0f46940164e41de0af2ba0e3dafe0d9017\\\",\\\"registry.redhat.io/redhat/community-operator-index@sha256:8d607fb6cc75ca36bca1e0a9c5bea5d1919b75db20733df69c64c8a10ee8083d\\\",\\\"registry.redhat.io/redhat/community-operator-index:v4.20\\\"],\\\"sizeBytes\\\":1224304325},{\\\"names\\\":[\\\"registry.redhat.io/redhat/certified-operator-index@sha256:541db5b20a3d2199602b3b5ac80f09ea31498034e9ae3841238b03a39150f0d7\\\",\\\"registry.redhat.io/redhat/certified-operator-index@sha256:a4c5df55584cba56f00004a090923a5c6de2071add5eb1672a5e20aa646aad8c\\\",\\\"registry.redhat.io/redhat/certified-operator-index:v4.20\\\"],\\\"sizeBytes\\\":1126957757},{\\\"names\\\":[\\\"registry.redhat.io/redhat/redhat-marketplace-index@sha256:b1c859067d6b7b785ab4977ed7137c5b3bb257234f7d7737a1d2836cef1576b5\\\",\\\"registry.redhat.io/redhat/redhat-marketplace-index@sha256:df08951924aa23b2333436a1d04b2dba56c366bb4f09d39ae3aedb980e4fb909\\\",\\\"registry.redhat.io/redhat/redhat-marketplace-index:v4.20\\\"],\\\"sizeBytes\\\":1079537324},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9414357f9345a841e0565265700ecc6637f846c83bd5908dbb7b306432465115\\\"],\\\"sizeBytes\\\":1052707833},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8d1a1e4abe0326c3af89e9eaa4b7449dd2d5b6f9403c677e19b00b24947b1df9\\\"],\\\"sizeBytes\\\":989392005},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b2b1fc3d5bb4944cbd5b23b87566d7ba24b1b66f5a0465f76bcc05023191cc47\\\"],\\\"sizeBytes\\\":971668163},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:be2edaed22535093bdb486afe5960ff4f3b0bd96f88dc1753b584cc28184a0b0\\\"],\\\"sizeBytes\\\":969078739},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7e3d6c8802ae53d6aecf38aa7b560d7892193806bdeb3d7c1637fac77c47fd1f\\\"],\\\"sizeBytes\\\":876488654},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\"],\\\"sizeBytes\\\":847332502},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:36c4867005702f0c4cbfcfa33f18a98596a6c9b1340b633c85ccef84a0c4f889\\\"],\\\"sizeBytes\\\":769516783},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1b55c029f731ebbde3c5580eef98a588264f4d6a8ae667805c9521dd1ecf1d5d\\\"],\\\"sizeBytes\\\":721591926},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf05b9b2ba66351a6c59f4259fb377f62237a00af3b4f0b95f64409e2f25770e\\\"],\\\"sizeBytes\\\":646867625},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a8581a82ba5c8343a743aa302c4848249d8c32a9f2cd10fa68d89d835a1bdf8b\\\"],\\\"sizeBytes\\\":638910445},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ae245c97fc463e876c3024efb806fa8f4efb13b3f06f1bdd3e7e1447f5a5dce4\\\"],\\\"sizeBytes\\\":617699779},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d4926e304011637ca9df370a193896d685f0f3ffabbec234ec827abdbeb083f9\\\"],\\\"sizeBytes\\\":607756695},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5c5d7468f6838b6a714482e62ea956659212f3415ec8f69989f75eb6d8744a6e\\\"],\\\"sizeBytes\\\":584721741},{\\\"names\\\":[\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\\\"],\\\"sizeBytes\\\":545674969},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:574d49b89604b8e8103abf57feee77812fe8cf441eafc17fdff95d57ca80645e\\\"],\\\"sizeBytes\\\":542463064},{\\\"names\\\":[\\\"quay.io/crcont/openshift-crc-cluster-kube-controller-manager-operator@sha256:f69b9cc9b9cfde726109a9e12b80a3eefa472d7e29159df0fbc7143c48983cd6\\\"],\\\"sizeBytes\\\":539380592},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9506bdcf97d5200cf2cf4cdf110aebafdd141a24f6589bf1e1cfe27bb7fc1ed2\\\"],\\\"sizeBytes\\\":533027808},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\"],\\\"sizeBytes\\\":528200501},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5a2a7b3c2f1598189d8880e6aa15ab11a65b201f25012f77ba41e7487a60729a\\\"],\\\"sizeBytes\\\":527774342},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e5e8108294b086fdb797365e5a46badba9b3d866bdcddc8460a51e05a253753d\\\"],\\\"sizeBytes\\\":526632426},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5827f6ae3beb4853192e02cc18890467bd251b33070f36f9a105991e7e6d3c9b\\\"],\\\"sizeBytes\\\":522490210},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:66c8fe5d45ff249643dae75185dd2787ea1b0ae87d5699a8222149c07689557c\\\"],\\\"sizeBytes\\\":520141094},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:baf975b6944f2844860c440636e0d4b80b2fdc473d30f32ae7d6989f2fc2b135\\\"],\\\"sizeBytes\\\":519815758},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:765cf9c3ebf4df049ebc022beaaf52f52852cf89fb802034536ad91dd45db807\\\"],\\\"sizeBytes\\\":519539350},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:52e442bc8198ac925caff87ddd35b3107b7375d5afc9c2eb041ca4e79db72c6f\\\"],\\\"sizeBytes\\\":518690683},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:43b0e0b7e1955ee905e48799a62f50b8a8df553190415ce1f5550375c2507ca5\\\"],\\\"sizeBytes\\\":518251952},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:977a316fa3598eb575a4477dafc09bbf06fad21c4ec2867052225d74f2a9f366\\\"],\\\"sizeBytes\\\":511136541},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e504172345491d90bbbf1e7e45488e73073f4c6d7c2355245871051596fc85db\\\"],\\\"sizeBytes\\\":510122097},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dbd8603d717c26901bcf9731b1e0392ae4bc08a270ed1eeb45839e44bed9607d\\\"],\\\"sizeBytes\\\":508941917},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7c6a47106effd9e9a41131e2bf6c832b80cd77b3439334f760b35b0729f2fb00\\\"],\\\"sizeBytes\\\":508318343},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7a726c68cebc9b08edd734a8bae5150ae5950f7734fe9b9c2a6e0d06f21cc095\\\"],\\\"sizeBytes\\\":498380948},{\\\"names\\\":[\\\"quay.io/crcont/ocp-release@sha256:82501261b9c63012ba3b83fe4d6703c0af5eb9c9151670eb90ae480b9507d761\\\"],\\\"sizeBytes\\\":497232440},{\\\"names\\\":[\\\"registry.redhat.io/openshift4/ose-csi-external-provisioner@sha256:4e4239621caed0b0d9132d167403631e9af86be9a395977f013e201ead281bb4\\\",\\\"registry.redhat.io/openshift4/ose-csi-external-provisioner@sha256:c0b1bec73fdb6853eb3bd9e9733aee2d760ca09a33cfd94adf9ab7b706e83fa9\\\",\\\"registry.redhat.io/openshift4/ose-csi-external-provisioner:latest\\\"],\\\"sizeBytes\\\":491224335},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b0f7abf2f97afd1127d9245d764338c6047bac1711b2cee43112570a85946360\\\"],\\\"sizeBytes\\\":490381192},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:21b12ff0c81c1d535e7c31aff3a73b1e9ca763e5f88037f59ade0dfab6ed8946\\\"],\\\"sizeBytes\\\":482632652},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:036ed6efe4cb5f5b90ee7f9ef5297c8591b8d67aa36b3c58b4fc5417622a140c\\\"],\\\"sizeBytes\\\":477561861},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0fe5a041a2b99d736e82f1b4a6cd9792c5e23ded475e9f0742cd19234070f989\\\"],\\\"sizeBytes\\\":475327956},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dcb03ccba25366bbdf74cbab6738e7ef1f97f62760886ec445a40cdf29b60418\\\"],\\\"sizeBytes\\\":475137830},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2599f32933f5fea6066ede54ad8f6150adb7bd9067892f251d5913121d5c630d\\\"],\\\"sizeBytes\\\":472771950},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:651bbe9d418f49c2c889d731df67cf5d88dff59dc03f5a1b5d4c8bb3ae001f1a\\\"],\\\"sizeBytes\\\":469976318},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4fe612a1572df462d6a4b664a10bc2e6cad239648acbf8c0303f8fca5d2596c0\\\"],\\\"sizeBytes\\\":468393024},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a5bb05344dd2296077f5066e908ede0eea23f5a12fb78ef86a9513c88d3faaca\\\"],\\\"sizeBytes\\\":464375011},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\"],\\\"sizeBytes\\\":462844959}],\\\"nodeInfo\\\":{\\\"bootID\\\":\\\"3cdf81b4-f597-401a-9b99-34aaa64fb798\\\",\\\"systemUUID\\\":\\\"c6072c61-a7eb-44bd-85f7-eb9fdb0e84de\\\"}}}\" for node \"crc\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/node?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 15:33:17 crc kubenswrapper[5120]: I0316 15:33:17.883016 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:33:17 crc kubenswrapper[5120]: I0316 15:33:17.883394 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:33:17 crc kubenswrapper[5120]: I0316 15:33:17.883589 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:33:17 crc kubenswrapper[5120]: I0316 15:33:17.883969 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 15:33:17 crc kubenswrapper[5120]: I0316 15:33:17.884123 5120 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T15:33:17Z","lastTransitionTime":"2026-03-16T15:33:17Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 15:33:17 crc kubenswrapper[5120]: E0316 15:33:17.900421 5120 kubelet_node_status.go:597] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"allocatable\\\":{\\\"cpu\\\":\\\"11800m\\\",\\\"ephemeral-storage\\\":\\\"76396645454\\\",\\\"memory\\\":\\\"32400460Ki\\\"},\\\"capacity\\\":{\\\"cpu\\\":\\\"12\\\",\\\"ephemeral-storage\\\":\\\"83293888Ki\\\",\\\"memory\\\":\\\"32861260Ki\\\"},\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T15:33:17Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T15:33:17Z\\\",\\\"message\\\":\\\"kubelet has sufficient memory available\\\",\\\"reason\\\":\\\"KubeletHasSufficientMemory\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T15:33:17Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T15:33:17Z\\\",\\\"message\\\":\\\"kubelet has no disk pressure\\\",\\\"reason\\\":\\\"KubeletHasNoDiskPressure\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T15:33:17Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T15:33:17Z\\\",\\\"message\\\":\\\"kubelet has sufficient PID available\\\",\\\"reason\\\":\\\"KubeletHasSufficientPID\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T15:33:17Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T15:33:17Z\\\",\\\"message\\\":\\\"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?\\\",\\\"reason\\\":\\\"KubeletNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7c8a088031661d94022418e93fb63744c38e1c4cff93ea3b95c096a290c2b7a3\\\"],\\\"sizeBytes\\\":2981840865},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\"],\\\"sizeBytes\\\":1641503854},{\\\"names\\\":[\\\"registry.redhat.io/redhat/redhat-operator-index@sha256:286bb0beab328954b0a86b7f066fd5a843b462d6acb2812df7ec788015cd32d4\\\",\\\"registry.redhat.io/redhat/redhat-operator-index@sha256:be02784ed82978c399102be1c6c9f2ca441be4d984e0fd7100c155dd4417ebbf\\\",\\\"registry.redhat.io/redhat/redhat-operator-index:v4.20\\\"],\\\"sizeBytes\\\":1597684406},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:85f1323d589d7af13b096b1f9b438b9dfe08f3fab37534e2780e6490a665bf05\\\"],\\\"sizeBytes\\\":1261384762},{\\\"names\\\":[\\\"registry.redhat.io/redhat/community-operator-index@sha256:0d50962980a5aeecae2d99c98913fb0f46940164e41de0af2ba0e3dafe0d9017\\\",\\\"registry.redhat.io/redhat/community-operator-index@sha256:8d607fb6cc75ca36bca1e0a9c5bea5d1919b75db20733df69c64c8a10ee8083d\\\",\\\"registry.redhat.io/redhat/community-operator-index:v4.20\\\"],\\\"sizeBytes\\\":1224304325},{\\\"names\\\":[\\\"registry.redhat.io/redhat/certified-operator-index@sha256:541db5b20a3d2199602b3b5ac80f09ea31498034e9ae3841238b03a39150f0d7\\\",\\\"registry.redhat.io/redhat/certified-operator-index@sha256:a4c5df55584cba56f00004a090923a5c6de2071add5eb1672a5e20aa646aad8c\\\",\\\"registry.redhat.io/redhat/certified-operator-index:v4.20\\\"],\\\"sizeBytes\\\":1126957757},{\\\"names\\\":[\\\"registry.redhat.io/redhat/redhat-marketplace-index@sha256:b1c859067d6b7b785ab4977ed7137c5b3bb257234f7d7737a1d2836cef1576b5\\\",\\\"registry.redhat.io/redhat/redhat-marketplace-index@sha256:df08951924aa23b2333436a1d04b2dba56c366bb4f09d39ae3aedb980e4fb909\\\",\\\"registry.redhat.io/redhat/redhat-marketplace-index:v4.20\\\"],\\\"sizeBytes\\\":1079537324},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9414357f9345a841e0565265700ecc6637f846c83bd5908dbb7b306432465115\\\"],\\\"sizeBytes\\\":1052707833},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8d1a1e4abe0326c3af89e9eaa4b7449dd2d5b6f9403c677e19b00b24947b1df9\\\"],\\\"sizeBytes\\\":989392005},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b2b1fc3d5bb4944cbd5b23b87566d7ba24b1b66f5a0465f76bcc05023191cc47\\\"],\\\"sizeBytes\\\":971668163},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:be2edaed22535093bdb486afe5960ff4f3b0bd96f88dc1753b584cc28184a0b0\\\"],\\\"sizeBytes\\\":969078739},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7e3d6c8802ae53d6aecf38aa7b560d7892193806bdeb3d7c1637fac77c47fd1f\\\"],\\\"sizeBytes\\\":876488654},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\"],\\\"sizeBytes\\\":847332502},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:36c4867005702f0c4cbfcfa33f18a98596a6c9b1340b633c85ccef84a0c4f889\\\"],\\\"sizeBytes\\\":769516783},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1b55c029f731ebbde3c5580eef98a588264f4d6a8ae667805c9521dd1ecf1d5d\\\"],\\\"sizeBytes\\\":721591926},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf05b9b2ba66351a6c59f4259fb377f62237a00af3b4f0b95f64409e2f25770e\\\"],\\\"sizeBytes\\\":646867625},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a8581a82ba5c8343a743aa302c4848249d8c32a9f2cd10fa68d89d835a1bdf8b\\\"],\\\"sizeBytes\\\":638910445},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ae245c97fc463e876c3024efb806fa8f4efb13b3f06f1bdd3e7e1447f5a5dce4\\\"],\\\"sizeBytes\\\":617699779},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d4926e304011637ca9df370a193896d685f0f3ffabbec234ec827abdbeb083f9\\\"],\\\"sizeBytes\\\":607756695},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5c5d7468f6838b6a714482e62ea956659212f3415ec8f69989f75eb6d8744a6e\\\"],\\\"sizeBytes\\\":584721741},{\\\"names\\\":[\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\\\"],\\\"sizeBytes\\\":545674969},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:574d49b89604b8e8103abf57feee77812fe8cf441eafc17fdff95d57ca80645e\\\"],\\\"sizeBytes\\\":542463064},{\\\"names\\\":[\\\"quay.io/crcont/openshift-crc-cluster-kube-controller-manager-operator@sha256:f69b9cc9b9cfde726109a9e12b80a3eefa472d7e29159df0fbc7143c48983cd6\\\"],\\\"sizeBytes\\\":539380592},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9506bdcf97d5200cf2cf4cdf110aebafdd141a24f6589bf1e1cfe27bb7fc1ed2\\\"],\\\"sizeBytes\\\":533027808},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\"],\\\"sizeBytes\\\":528200501},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5a2a7b3c2f1598189d8880e6aa15ab11a65b201f25012f77ba41e7487a60729a\\\"],\\\"sizeBytes\\\":527774342},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e5e8108294b086fdb797365e5a46badba9b3d866bdcddc8460a51e05a253753d\\\"],\\\"sizeBytes\\\":526632426},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5827f6ae3beb4853192e02cc18890467bd251b33070f36f9a105991e7e6d3c9b\\\"],\\\"sizeBytes\\\":522490210},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:66c8fe5d45ff249643dae75185dd2787ea1b0ae87d5699a8222149c07689557c\\\"],\\\"sizeBytes\\\":520141094},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:baf975b6944f2844860c440636e0d4b80b2fdc473d30f32ae7d6989f2fc2b135\\\"],\\\"sizeBytes\\\":519815758},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:765cf9c3ebf4df049ebc022beaaf52f52852cf89fb802034536ad91dd45db807\\\"],\\\"sizeBytes\\\":519539350},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:52e442bc8198ac925caff87ddd35b3107b7375d5afc9c2eb041ca4e79db72c6f\\\"],\\\"sizeBytes\\\":518690683},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:43b0e0b7e1955ee905e48799a62f50b8a8df553190415ce1f5550375c2507ca5\\\"],\\\"sizeBytes\\\":518251952},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:977a316fa3598eb575a4477dafc09bbf06fad21c4ec2867052225d74f2a9f366\\\"],\\\"sizeBytes\\\":511136541},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e504172345491d90bbbf1e7e45488e73073f4c6d7c2355245871051596fc85db\\\"],\\\"sizeBytes\\\":510122097},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dbd8603d717c26901bcf9731b1e0392ae4bc08a270ed1eeb45839e44bed9607d\\\"],\\\"sizeBytes\\\":508941917},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7c6a47106effd9e9a41131e2bf6c832b80cd77b3439334f760b35b0729f2fb00\\\"],\\\"sizeBytes\\\":508318343},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7a726c68cebc9b08edd734a8bae5150ae5950f7734fe9b9c2a6e0d06f21cc095\\\"],\\\"sizeBytes\\\":498380948},{\\\"names\\\":[\\\"quay.io/crcont/ocp-release@sha256:82501261b9c63012ba3b83fe4d6703c0af5eb9c9151670eb90ae480b9507d761\\\"],\\\"sizeBytes\\\":497232440},{\\\"names\\\":[\\\"registry.redhat.io/openshift4/ose-csi-external-provisioner@sha256:4e4239621caed0b0d9132d167403631e9af86be9a395977f013e201ead281bb4\\\",\\\"registry.redhat.io/openshift4/ose-csi-external-provisioner@sha256:c0b1bec73fdb6853eb3bd9e9733aee2d760ca09a33cfd94adf9ab7b706e83fa9\\\",\\\"registry.redhat.io/openshift4/ose-csi-external-provisioner:latest\\\"],\\\"sizeBytes\\\":491224335},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b0f7abf2f97afd1127d9245d764338c6047bac1711b2cee43112570a85946360\\\"],\\\"sizeBytes\\\":490381192},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:21b12ff0c81c1d535e7c31aff3a73b1e9ca763e5f88037f59ade0dfab6ed8946\\\"],\\\"sizeBytes\\\":482632652},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:036ed6efe4cb5f5b90ee7f9ef5297c8591b8d67aa36b3c58b4fc5417622a140c\\\"],\\\"sizeBytes\\\":477561861},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0fe5a041a2b99d736e82f1b4a6cd9792c5e23ded475e9f0742cd19234070f989\\\"],\\\"sizeBytes\\\":475327956},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dcb03ccba25366bbdf74cbab6738e7ef1f97f62760886ec445a40cdf29b60418\\\"],\\\"sizeBytes\\\":475137830},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2599f32933f5fea6066ede54ad8f6150adb7bd9067892f251d5913121d5c630d\\\"],\\\"sizeBytes\\\":472771950},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:651bbe9d418f49c2c889d731df67cf5d88dff59dc03f5a1b5d4c8bb3ae001f1a\\\"],\\\"sizeBytes\\\":469976318},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4fe612a1572df462d6a4b664a10bc2e6cad239648acbf8c0303f8fca5d2596c0\\\"],\\\"sizeBytes\\\":468393024},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a5bb05344dd2296077f5066e908ede0eea23f5a12fb78ef86a9513c88d3faaca\\\"],\\\"sizeBytes\\\":464375011},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\"],\\\"sizeBytes\\\":462844959}],\\\"nodeInfo\\\":{\\\"bootID\\\":\\\"3cdf81b4-f597-401a-9b99-34aaa64fb798\\\",\\\"systemUUID\\\":\\\"c6072c61-a7eb-44bd-85f7-eb9fdb0e84de\\\"}}}\" for node \"crc\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/node?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 15:33:17 crc kubenswrapper[5120]: E0316 15:33:17.901031 5120 kubelet_node_status.go:584] "Unable to update node status" err="update node status exceeds retry count" Mar 16 15:33:17 crc kubenswrapper[5120]: E0316 15:33:17.901201 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:18 crc kubenswrapper[5120]: E0316 15:33:18.002378 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:18 crc kubenswrapper[5120]: E0316 15:33:18.102995 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:18 crc kubenswrapper[5120]: E0316 15:33:18.203163 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:18 crc kubenswrapper[5120]: E0316 15:33:18.303513 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:18 crc kubenswrapper[5120]: E0316 15:33:18.404415 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:18 crc kubenswrapper[5120]: E0316 15:33:18.505570 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:18 crc kubenswrapper[5120]: E0316 15:33:18.606882 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:18 crc kubenswrapper[5120]: E0316 15:33:18.707587 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:18 crc kubenswrapper[5120]: E0316 15:33:18.727043 5120 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"crc\" not found" Mar 16 15:33:18 crc kubenswrapper[5120]: E0316 15:33:18.807940 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:18 crc kubenswrapper[5120]: E0316 15:33:18.908323 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:19 crc kubenswrapper[5120]: E0316 15:33:19.009326 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:19 crc kubenswrapper[5120]: E0316 15:33:19.110053 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:19 crc kubenswrapper[5120]: E0316 15:33:19.210859 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:19 crc kubenswrapper[5120]: E0316 15:33:19.311799 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:19 crc kubenswrapper[5120]: E0316 15:33:19.413090 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:19 crc kubenswrapper[5120]: E0316 15:33:19.513943 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:19 crc kubenswrapper[5120]: E0316 15:33:19.614879 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:19 crc kubenswrapper[5120]: E0316 15:33:19.715305 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:19 crc kubenswrapper[5120]: E0316 15:33:19.816106 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:19 crc kubenswrapper[5120]: E0316 15:33:19.917563 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:20 crc kubenswrapper[5120]: E0316 15:33:20.018584 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:20 crc kubenswrapper[5120]: E0316 15:33:20.119578 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:20 crc kubenswrapper[5120]: E0316 15:33:20.220534 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:20 crc kubenswrapper[5120]: E0316 15:33:20.321658 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:20 crc kubenswrapper[5120]: E0316 15:33:20.422039 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:20 crc kubenswrapper[5120]: E0316 15:33:20.523013 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:20 crc kubenswrapper[5120]: E0316 15:33:20.623965 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:20 crc kubenswrapper[5120]: I0316 15:33:20.722555 5120 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Mar 16 15:33:20 crc kubenswrapper[5120]: E0316 15:33:20.724278 5120 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 15:33:20 crc kubenswrapper[5120]: I0316 15:33:20.786778 5120 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Mar 16 15:33:20 crc kubenswrapper[5120]: I0316 15:33:20.825781 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:33:20 crc kubenswrapper[5120]: I0316 15:33:20.825857 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:33:20 crc kubenswrapper[5120]: I0316 15:33:20.825875 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:33:20 crc kubenswrapper[5120]: I0316 15:33:20.825897 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 15:33:20 crc kubenswrapper[5120]: I0316 15:33:20.825911 5120 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T15:33:20Z","lastTransitionTime":"2026-03-16T15:33:20Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 15:33:20 crc kubenswrapper[5120]: I0316 15:33:20.884709 5120 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-kube-controller-manager/kube-controller-manager-crc" Mar 16 15:33:20 crc kubenswrapper[5120]: I0316 15:33:20.898976 5120 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-kube-scheduler/openshift-kube-scheduler-crc" Mar 16 15:33:20 crc kubenswrapper[5120]: I0316 15:33:20.927663 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:33:20 crc kubenswrapper[5120]: I0316 15:33:20.927710 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:33:20 crc kubenswrapper[5120]: I0316 15:33:20.927724 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:33:20 crc kubenswrapper[5120]: I0316 15:33:20.927746 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 15:33:20 crc kubenswrapper[5120]: I0316 15:33:20.927783 5120 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T15:33:20Z","lastTransitionTime":"2026-03-16T15:33:20Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.000629 5120 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-crc" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.029699 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.029796 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.029816 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.029842 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.029862 5120 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T15:33:21Z","lastTransitionTime":"2026-03-16T15:33:21Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.102092 5120 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-etcd/etcd-crc" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.133109 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.133171 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.133185 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.133204 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.133217 5120 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T15:33:21Z","lastTransitionTime":"2026-03-16T15:33:21Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.205009 5120 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-kube-apiserver/kube-apiserver-crc" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.236068 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.236132 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.236153 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.236178 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.236196 5120 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T15:33:21Z","lastTransitionTime":"2026-03-16T15:33:21Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.338341 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.338397 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.338415 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.338440 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.338459 5120 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T15:33:21Z","lastTransitionTime":"2026-03-16T15:33:21Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.440660 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.440738 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.440802 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.440836 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.440863 5120 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T15:33:21Z","lastTransitionTime":"2026-03-16T15:33:21Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.543603 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.543664 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.543683 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.543712 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.543731 5120 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T15:33:21Z","lastTransitionTime":"2026-03-16T15:33:21Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.590293 5120 apiserver.go:52] "Watching apiserver" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.598265 5120 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.600667 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-crc","openshift-machine-config-operator/machine-config-daemon-7bf76","openshift-multus/multus-v822j","openshift-network-console/networking-console-plugin-5ff7774fd9-nljh6","openshift-network-node-identity/network-node-identity-dgvkt","openshift-network-operator/network-operator-7bdcf4f5bd-7fjxv","openshift-ovn-kubernetes/ovnkube-node-zwk29","openshift-dns/node-resolver-jsv7k","openshift-network-diagnostics/network-check-source-5bb8f5cd97-xdvz5","openshift-network-operator/iptables-alerter-5jnd7","openshift-etcd/etcd-crc","openshift-image-registry/node-ca-7sp2j","openshift-kube-apiserver/kube-apiserver-crc","openshift-kube-scheduler/openshift-kube-scheduler-crc","openshift-multus/network-metrics-daemon-xr8r2","openshift-kube-controller-manager/kube-controller-manager-crc","openshift-multus/multus-additional-cni-plugins-qqjfh","openshift-network-diagnostics/network-check-target-fhkjl","openshift-ovn-kubernetes/ovnkube-control-plane-57b78d8988-hbs9k"] Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.606459 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/network-operator-7bdcf4f5bd-7fjxv" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.606481 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-5bb8f5cd97-xdvz5" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.606751 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fhkjl" Mar 16 15:33:21 crc kubenswrapper[5120]: E0316 15:33:21.607877 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-source-5bb8f5cd97-xdvz5" podUID="f863fff9-286a-45fa-b8f0-8a86994b8440" Mar 16 15:33:21 crc kubenswrapper[5120]: E0316 15:33:21.608092 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fhkjl" podUID="17b87002-b798-480a-8e17-83053d698239" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.608884 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"metrics-tls\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.609300 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.609746 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-node-identity/network-node-identity-dgvkt" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.610251 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.611067 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-5jnd7" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.613541 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-node-identity\"/\"ovnkube-identity-cm\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.613740 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-node-identity\"/\"kube-root-ca.crt\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.613877 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-node-identity\"/\"openshift-service-ca.crt\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.613917 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-node-identity\"/\"env-overrides\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.613980 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-node-identity\"/\"network-node-identity-cert\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.614006 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.618608 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xr8r2" Mar 16 15:33:21 crc kubenswrapper[5120]: E0316 15:33:21.618889 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xr8r2" podUID="4464728a-4869-4476-83de-cb34577ace7f" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.624388 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zwk29" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.626231 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.627486 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.627797 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.627851 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.628275 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.628519 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.628783 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-l2v2m\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.631443 5120 status_manager.go:919] "Failed to update status for pod" pod="openshift-network-operator/network-operator-7bdcf4f5bd-7fjxv" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"34177974-8d82-49d2-a763-391d0df3bbd8\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-03-16T15:33:21Z\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"message\\\":\\\"containers with unready status: [network-operator]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-03-16T15:33:21Z\\\",\\\"message\\\":\\\"containers with unready status: [network-operator]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a8581a82ba5c8343a743aa302c4848249d8c32a9f2cd10fa68d89d835a1bdf8b\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"exitCode\\\":137,\\\"finishedAt\\\":null,\\\"message\\\":\\\"The container could not be located when the pod was deleted. The container used to be Running\\\",\\\"reason\\\":\\\"ContainerStatusUnknown\\\",\\\"startedAt\\\":null}},\\\"name\\\":\\\"network-operator\\\",\\\"ready\\\":false,\\\"restartCount\\\":5,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes\\\",\\\"name\\\":\\\"host-etc-kube\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/serving-cert\\\",\\\"name\\\":\\\"metrics-tls\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-m7xz2\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}]}}\" for pod \"openshift-network-operator\"/\"network-operator-7bdcf4f5bd-7fjxv\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.631956 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5ff7774fd9-nljh6" Mar 16 15:33:21 crc kubenswrapper[5120]: E0316 15:33:21.632072 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-console/networking-console-plugin-5ff7774fd9-nljh6" podUID="6a9ae5f6-97bd-46ac-bafa-ca1b4452a141" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.632150 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jsv7k" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.635871 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-v822j" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.637245 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.638238 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.639985 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-control-plane-57b78d8988-hbs9k" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.640086 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-tk7bt\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.640688 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.640744 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-g6kgg\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.642000 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.642299 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.642371 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.642927 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-control-plane-metrics-cert\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.644208 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-control-plane-dockercfg-nl8tp\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.645612 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.645654 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.645668 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.645687 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.645703 5120 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T15:33:21Z","lastTransitionTime":"2026-03-16T15:33:21Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.649262 5120 status_manager.go:919] "Failed to update status for pod" pod="openshift-network-operator/network-operator-7bdcf4f5bd-7fjxv" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"34177974-8d82-49d2-a763-391d0df3bbd8\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-03-16T15:33:21Z\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"message\\\":\\\"containers with unready status: [network-operator]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-03-16T15:33:21Z\\\",\\\"message\\\":\\\"containers with unready status: [network-operator]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a8581a82ba5c8343a743aa302c4848249d8c32a9f2cd10fa68d89d835a1bdf8b\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"exitCode\\\":137,\\\"finishedAt\\\":null,\\\"message\\\":\\\"The container could not be located when the pod was deleted. The container used to be Running\\\",\\\"reason\\\":\\\"ContainerStatusUnknown\\\",\\\"startedAt\\\":null}},\\\"name\\\":\\\"network-operator\\\",\\\"ready\\\":false,\\\"restartCount\\\":5,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes\\\",\\\"name\\\":\\\"host-etc-kube\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/serving-cert\\\",\\\"name\\\":\\\"metrics-tls\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-m7xz2\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}]}}\" for pod \"openshift-network-operator\"/\"network-operator-7bdcf4f5bd-7fjxv\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.649324 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7sp2j" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.651933 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.652708 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-qqjfh" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.654229 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.654269 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.654312 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-machine-config-operator\"/\"kube-rbac-proxy\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.654349 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.654445 5120 scope.go:117] "RemoveContainer" containerID="2e9f531a9c0fc8cf5222ce7e135c4f37d008306df727f84312cc5d7d2c740ac6" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.654602 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-machine-config-operator\"/\"proxy-tls\"" Mar 16 15:33:21 crc kubenswrapper[5120]: E0316 15:33:21.654733 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-apiserver-check-endpoints\" with CrashLoopBackOff: \"back-off 40s restarting failed container=kube-apiserver-check-endpoints pod=kube-apiserver-crc_openshift-kube-apiserver(3a14caf222afb62aaabdc47808b6f944)\"" pod="openshift-kube-apiserver/kube-apiserver-crc" podUID="3a14caf222afb62aaabdc47808b6f944" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.654933 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-machine-config-operator\"/\"machine-config-daemon-dockercfg-w9nzh\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.654948 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-machine-config-operator\"/\"openshift-service-ca.crt\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.655080 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-tjs74\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.655393 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-machine-config-operator\"/\"kube-root-ca.crt\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.659950 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.660592 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-nwglk\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.660673 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.665977 5120 status_manager.go:919] "Failed to update status for pod" pod="openshift-network-diagnostics/network-check-source-5bb8f5cd97-xdvz5" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"f863fff9-286a-45fa-b8f0-8a86994b8440\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-03-16T15:33:21Z\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"message\\\":\\\"containers with unready status: [check-endpoints]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-03-16T15:33:21Z\\\",\\\"message\\\":\\\"containers with unready status: [check-endpoints]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a8581a82ba5c8343a743aa302c4848249d8c32a9f2cd10fa68d89d835a1bdf8b\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"exitCode\\\":137,\\\"finishedAt\\\":null,\\\"message\\\":\\\"The container could not be located when the pod was deleted. The container used to be Running\\\",\\\"reason\\\":\\\"ContainerStatusUnknown\\\",\\\"startedAt\\\":null}},\\\"name\\\":\\\"check-endpoints\\\",\\\"ready\\\":false,\\\"restartCount\\\":4,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-l7w75\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"podIP\\\":null,\\\"podIPs\\\":null}}\" for pod \"openshift-network-diagnostics\"/\"network-check-source-5bb8f5cd97-xdvz5\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.677919 5120 status_manager.go:919] "Failed to update status for pod" pod="openshift-network-diagnostics/network-check-target-fhkjl" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"17b87002-b798-480a-8e17-83053d698239\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-03-16T15:33:21Z\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"message\\\":\\\"containers with unready status: [network-check-target-container]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-03-16T15:33:21Z\\\",\\\"message\\\":\\\"containers with unready status: [network-check-target-container]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a8581a82ba5c8343a743aa302c4848249d8c32a9f2cd10fa68d89d835a1bdf8b\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"exitCode\\\":137,\\\"finishedAt\\\":null,\\\"message\\\":\\\"The container could not be located when the pod was deleted. The container used to be Running\\\",\\\"reason\\\":\\\"ContainerStatusUnknown\\\",\\\"startedAt\\\":null}},\\\"name\\\":\\\"network-check-target-container\\\",\\\"ready\\\":false,\\\"restartCount\\\":4,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-gwt8b\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"podIP\\\":null,\\\"podIPs\\\":null}}\" for pod \"openshift-network-diagnostics\"/\"network-check-target-fhkjl\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.686235 5120 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.692112 5120 status_manager.go:919] "Failed to update status for pod" pod="openshift-network-node-identity/network-node-identity-dgvkt" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"fc4541ce-7789-4670-bc75-5c2868e52ce0\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-03-16T15:33:21Z\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"message\\\":\\\"containers with unready status: [webhook approver]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-03-16T15:33:21Z\\\",\\\"message\\\":\\\"containers with unready status: [webhook approver]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"exitCode\\\":137,\\\"finishedAt\\\":null,\\\"message\\\":\\\"The container could not be located when the pod was deleted. The container used to be Running\\\",\\\"reason\\\":\\\"ContainerStatusUnknown\\\",\\\"startedAt\\\":null}},\\\"name\\\":\\\"approver\\\",\\\"ready\\\":false,\\\"restartCount\\\":6,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/ovnkube-identity-config\\\",\\\"name\\\":\\\"ovnkube-identity-cm\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-8nt2j\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"exitCode\\\":137,\\\"finishedAt\\\":null,\\\"message\\\":\\\"The container could not be located when the pod was deleted. The container used to be Running\\\",\\\"reason\\\":\\\"ContainerStatusUnknown\\\",\\\"startedAt\\\":null}},\\\"name\\\":\\\"webhook\\\",\\\"ready\\\":false,\\\"restartCount\\\":4,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/webhook-cert/\\\",\\\"name\\\":\\\"webhook-cert\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/ovnkube-identity-config\\\",\\\"name\\\":\\\"ovnkube-identity-cm\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-8nt2j\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}]}}\" for pod \"openshift-network-node-identity\"/\"network-node-identity-dgvkt\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.700349 5120 status_manager.go:919] "Failed to update status for pod" pod="openshift-network-operator/iptables-alerter-5jnd7" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"428b39f5-eb1c-4f65-b7a4-eeb6e84860cc\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-03-16T15:33:21Z\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"message\\\":\\\"containers with unready status: [iptables-alerter]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-03-16T15:33:21Z\\\",\\\"message\\\":\\\"containers with unready status: [iptables-alerter]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5c5d7468f6838b6a714482e62ea956659212f3415ec8f69989f75eb6d8744a6e\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"exitCode\\\":137,\\\"finishedAt\\\":null,\\\"message\\\":\\\"The container could not be located when the pod was deleted. The container used to be Running\\\",\\\"reason\\\":\\\"ContainerStatusUnknown\\\",\\\"startedAt\\\":null}},\\\"name\\\":\\\"iptables-alerter\\\",\\\"ready\\\":false,\\\"restartCount\\\":4,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/iptables-alerter\\\",\\\"name\\\":\\\"iptables-alerter-script\\\"},{\\\"mountPath\\\":\\\"/host\\\",\\\"name\\\":\\\"host-slash\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-dsgwk\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}]}}\" for pod \"openshift-network-operator\"/\"iptables-alerter-5jnd7\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.708576 5120 status_manager.go:919] "Failed to update status for pod" pod="openshift-multus/network-metrics-daemon-xr8r2" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"4464728a-4869-4476-83de-cb34577ace7f\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T15:33:21Z\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T15:33:21Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T15:33:21Z\\\",\\\"message\\\":\\\"containers with unready status: [network-metrics-daemon kube-rbac-proxy]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T15:33:21Z\\\",\\\"message\\\":\\\"containers with unready status: [network-metrics-daemon kube-rbac-proxy]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/metrics\\\",\\\"name\\\":\\\"metrics-certs\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-ftfg9\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:49b34ce0d25eec7a6077f4bf21bf7d4e64e598d28785a20b9ee3594423b7de14\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"network-metrics-daemon\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-ftfg9\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T15:33:21Z\\\"}}\" for pod \"openshift-multus\"/\"network-metrics-daemon-xr8r2\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.724890 5120 status_manager.go:919] "Failed to update status for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zwk29" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"1ba0f093-ad5c-4a99-bfc2-8439162d5b72\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T15:33:21Z\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T15:33:21Z\\\",\\\"message\\\":\\\"containers with incomplete status: [kubecfg-setup]\\\",\\\"reason\\\":\\\"ContainersNotInitialized\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T15:33:21Z\\\",\\\"message\\\":\\\"containers with unready status: [ovn-controller ovn-acl-logging kube-rbac-proxy-node kube-rbac-proxy-ovn-metrics northd nbdb sbdb ovnkube-controller]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T15:33:21Z\\\",\\\"message\\\":\\\"containers with unready status: [ovn-controller ovn-acl-logging kube-rbac-proxy-node kube-rbac-proxy-ovn-metrics northd nbdb sbdb ovnkube-controller]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy-node\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/pki/tls/metrics-cert\\\",\\\"name\\\":\\\"ovn-node-metrics-cert\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-tjz24\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy-ovn-metrics\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/pki/tls/metrics-cert\\\",\\\"name\\\":\\\"ovn-node-metrics-cert\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-tjz24\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"nbdb\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-tjz24\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"northd\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/ovn\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-tjz24\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"ovn-acl-logging\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn/\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-tjz24\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"ovn-controller\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/run/openvswitch\\\",\\\"name\\\":\\\"run-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/etc/openvswitch\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/lib/openvswitch\\\",\\\"name\\\":\\\"var-lib-openvswitch\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn/\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/dev/log\\\",\\\"name\\\":\\\"log-socket\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-tjz24\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"ovnkube-controller\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/var/lib/kubelet\\\",\\\"name\\\":\\\"host-kubelet\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/systemd/system\\\",\\\"name\\\":\\\"systemd-units\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/host\\\",\\\"name\\\":\\\"host-slash\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/run/ovn-kubernetes/\\\",\\\"name\\\":\\\"host-run-ovn-kubernetes\\\"},{\\\"mountPath\\\":\\\"/run/netns\\\",\\\"name\\\":\\\"host-run-netns\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/run/systemd/private\\\",\\\"name\\\":\\\"run-systemd\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/cni-bin-dir\\\",\\\"name\\\":\\\"host-cni-bin\\\"},{\\\"mountPath\\\":\\\"/etc/cni/net.d\\\",\\\"name\\\":\\\"host-cni-netd\\\"},{\\\"mountPath\\\":\\\"/var/lib/cni/networks/ovn-k8s-cni-overlay\\\",\\\"name\\\":\\\"host-var-lib-cni-networks-ovn-kubernetes\\\"},{\\\"mountPath\\\":\\\"/run/openvswitch\\\",\\\"name\\\":\\\"run-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/log/ovnkube/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/etc/openvswitch\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/lib/openvswitch\\\",\\\"name\\\":\\\"var-lib-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovnkube-config/\\\",\\\"name\\\":\\\"ovnkube-config\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-tjz24\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"sbdb\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-tjz24\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"initContainerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kubecfg-setup\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-tjz24\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T15:33:21Z\\\"}}\" for pod \"openshift-ovn-kubernetes\"/\"ovnkube-node-zwk29\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.731200 5120 status_manager.go:919] "Failed to update status for pod" pod="openshift-dns/node-resolver-jsv7k" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"236824b8-2653-4916-ae64-5ff75a7d6178\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T15:33:21Z\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T15:33:21Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T15:33:21Z\\\",\\\"message\\\":\\\"containers with unready status: [dns-node-resolver]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T15:33:21Z\\\",\\\"message\\\":\\\"containers with unready status: [dns-node-resolver]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5c5d7468f6838b6a714482e62ea956659212f3415ec8f69989f75eb6d8744a6e\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"dns-node-resolver\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/hosts\\\",\\\"name\\\":\\\"hosts-file\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-5jkmj\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T15:33:21Z\\\"}}\" for pod \"openshift-dns\"/\"node-resolver-jsv7k\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.739205 5120 status_manager.go:919] "Failed to update status for pod" pod="openshift-multus/multus-v822j" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"ac55471d-4e42-475f-a082-50f611571482\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T15:33:21Z\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T15:33:21Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T15:33:21Z\\\",\\\"message\\\":\\\"containers with unready status: [kube-multus]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T15:33:21Z\\\",\\\"message\\\":\\\"containers with unready status: [kube-multus]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:85f1323d589d7af13b096b1f9b438b9dfe08f3fab37534e2780e6490a665bf05\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-multus\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\"},{\\\"mountPath\\\":\\\"/host/etc/cni/net.d\\\",\\\"name\\\":\\\"system-cni-dir\\\"},{\\\"mountPath\\\":\\\"/host/run/multus/cni/net.d\\\",\\\"name\\\":\\\"multus-cni-dir\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/run/multus\\\",\\\"name\\\":\\\"multus-socket-dir-parent\\\"},{\\\"mountPath\\\":\\\"/run/k8s.cni.cncf.io\\\",\\\"name\\\":\\\"host-run-k8s-cni-cncf-io\\\"},{\\\"mountPath\\\":\\\"/run/netns\\\",\\\"name\\\":\\\"host-run-netns\\\"},{\\\"mountPath\\\":\\\"/var/lib/cni/bin\\\",\\\"name\\\":\\\"host-var-lib-cni-bin\\\"},{\\\"mountPath\\\":\\\"/var/lib/cni/multus\\\",\\\"name\\\":\\\"host-var-lib-cni-multus\\\"},{\\\"mountPath\\\":\\\"/var/lib/kubelet\\\",\\\"name\\\":\\\"host-var-lib-kubelet\\\"},{\\\"mountPath\\\":\\\"/hostroot\\\",\\\"name\\\":\\\"hostroot\\\"},{\\\"mountPath\\\":\\\"/etc/cni/multus/net.d\\\",\\\"name\\\":\\\"multus-conf-dir\\\"},{\\\"mountPath\\\":\\\"/etc/cni/net.d/multus.d\\\",\\\"name\\\":\\\"multus-daemon-config\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/cni/multus/certs\\\",\\\"name\\\":\\\"host-run-multus-certs\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes\\\",\\\"name\\\":\\\"etc-kubernetes\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-lhmdx\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T15:33:21Z\\\"}}\" for pod \"openshift-multus\"/\"multus-v822j\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.747870 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.747913 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.747925 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.747943 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.747957 5120 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T15:33:21Z","lastTransitionTime":"2026-03-16T15:33:21Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.750706 5120 status_manager.go:919] "Failed to update status for pod" pod="openshift-kube-apiserver/kube-apiserver-crc" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"22864c11-0263-4519-b00f-08aec3cacee5\\\"},\\\"status\\\":{\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T15:31:40Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T15:31:40Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T15:31:38Z\\\",\\\"message\\\":\\\"containers with unready status: [kube-apiserver-check-endpoints]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T15:31:38Z\\\",\\\"message\\\":\\\"containers with unready status: [kube-apiserver-check-endpoints]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T15:31:38Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"265m\\\",\\\"memory\\\":\\\"1Gi\\\"},\\\"containerID\\\":\\\"cri-o://508f48da0745e92959e2d1557a5130e812920972548cfb726debf24c10a91ceb\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-apiserver\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"265m\\\",\\\"memory\\\":\\\"1Gi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T15:31:40Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/var/log/kube-apiserver\\\",\\\"name\\\":\\\"audit-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"},{\\\"mountPath\\\":\\\"/etc/pki/ca-trust/extracted/pem\\\",\\\"name\\\":\\\"ca-bundle-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://2927b83983005f4c3d99da754665655d8138a8e829cf2b9274040dfbec74fab7\\\",\\\"image\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\\\",\\\"imageID\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-apiserver-cert-regeneration-controller\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T15:31:41Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://28d3d4773246e29999a9a1edc877e703ed6476a59e6aef47ac34c6a3991c767a\\\",\\\"image\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\\\",\\\"imageID\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-apiserver-cert-syncer\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T15:31:41Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://2e9f531a9c0fc8cf5222ce7e135c4f37d008306df727f84312cc5d7d2c740ac6\\\",\\\"image\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\\\",\\\"imageID\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://2e9f531a9c0fc8cf5222ce7e135c4f37d008306df727f84312cc5d7d2c740ac6\\\",\\\"exitCode\\\":255,\\\"finishedAt\\\":\\\"2026-03-16T15:32:47Z\\\",\\\"message\\\":\\\"vvar.go:172] \\\\\\\"Feature gate default state\\\\\\\" feature=\\\\\\\"WatchListClient\\\\\\\" enabled=false\\\\nW0316 15:32:47.249777 1 builder.go:272] unable to get owner reference (falling back to namespace): pods \\\\\\\"kube-apiserver-crc\\\\\\\" not found\\\\nI0316 15:32:47.249946 1 builder.go:304] check-endpoints version v0.0.0-unknown-c3d9642-c3d9642\\\\nI0316 15:32:47.250658 1 dynamic_serving_content.go:116] \\\\\\\"Loaded a new cert/key pair\\\\\\\" name=\\\\\\\"serving-cert::/tmp/serving-cert-1207003317/tls.crt::/tmp/serving-cert-1207003317/tls.key\\\\\\\"\\\\nI0316 15:32:47.712697 1 requestheader_controller.go:255] Loaded a new request header values for RequestHeaderAuthRequestController\\\\nI0316 15:32:47.714834 1 maxinflight.go:139] \\\\\\\"Initialized nonMutatingChan\\\\\\\" len=400\\\\nI0316 15:32:47.714856 1 maxinflight.go:145] \\\\\\\"Initialized mutatingChan\\\\\\\" len=200\\\\nI0316 15:32:47.714887 1 maxinflight.go:116] \\\\\\\"Set denominator for readonly requests\\\\\\\" limit=400\\\\nI0316 15:32:47.714895 1 maxinflight.go:120] \\\\\\\"Set denominator for mutating requests\\\\\\\" limit=200\\\\nI0316 15:32:47.719070 1 secure_serving.go:57] Forcing use of http/1.1 only\\\\nW0316 15:32:47.719093 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected.\\\\nW0316 15:32:47.719099 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected.\\\\nW0316 15:32:47.719104 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_GCM_SHA256' detected.\\\\nI0316 15:32:47.719107 1 genericapiserver.go:546] MuxAndDiscoveryComplete has all endpoints registered and discovery information is complete\\\\nW0316 15:32:47.719109 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_GCM_SHA384' detected.\\\\nW0316 15:32:47.719127 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_CBC_SHA' detected.\\\\nW0316 15:32:47.719132 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_CBC_SHA' detected.\\\\nF0316 15:32:47.720697 1 cmd.go:182] pods \\\\\\\"kube-apiserver-crc\\\\\\\" not found\\\\n\\\",\\\"reason\\\":\\\"Error\\\",\\\"startedAt\\\":\\\"2026-03-16T15:32:46Z\\\"}},\\\"name\\\":\\\"kube-apiserver-check-endpoints\\\",\\\"ready\\\":false,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":3,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"message\\\":\\\"back-off 40s restarting failed container=kube-apiserver-check-endpoints pod=kube-apiserver-crc_openshift-kube-apiserver(3a14caf222afb62aaabdc47808b6f944)\\\",\\\"reason\\\":\\\"CrashLoopBackOff\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://93d46439f5f39d1e67f6df04e1bfc9dfc0f6d7fcdf6fbe4cce94455dd460c163\\\",\\\"image\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\\\",\\\"imageID\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-apiserver-insecure-readyz\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T15:31:41Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}}}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"initContainerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://b85427f55ef682dd2d839958175c21c7ee85dae9155481cb4532b8d60f907179\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"setup\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://b85427f55ef682dd2d839958175c21c7ee85dae9155481cb4532b8d60f907179\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-03-16T15:31:39Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-03-16T15:31:39Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/log/kube-apiserver\\\",\\\"name\\\":\\\"audit-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"}]}],\\\"phase\\\":\\\"Running\\\",\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T15:31:38Z\\\"}}\" for pod \"openshift-kube-apiserver\"/\"kube-apiserver-crc\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.756824 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-import-ca\" (UniqueName: \"kubernetes.io/configmap/d19cb085-0c5b-4810-b654-ce7923221d90-image-import-ca\") pod \"d19cb085-0c5b-4810-b654-ce7923221d90\" (UID: \"d19cb085-0c5b-4810-b654-ce7923221d90\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.756871 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9f71a554-e414-4bc3-96d2-674060397afe-metrics-tls\") pod \"9f71a554-e414-4bc3-96d2-674060397afe\" (UID: \"9f71a554-e414-4bc3-96d2-674060397afe\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.756903 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7599e0b6-bddf-4def-b7f2-0b32206e8651-config\") pod \"7599e0b6-bddf-4def-b7f2-0b32206e8651\" (UID: \"7599e0b6-bddf-4def-b7f2-0b32206e8651\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.756933 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"control-plane-machine-set-operator-tls\" (UniqueName: \"kubernetes.io/secret/42a11a02-47e1-488f-b270-2679d3298b0e-control-plane-machine-set-operator-tls\") pod \"42a11a02-47e1-488f-b270-2679d3298b0e\" (UID: \"42a11a02-47e1-488f-b270-2679d3298b0e\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.757042 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dztfv\" (UniqueName: \"kubernetes.io/projected/d45be74c-0d98-4d18-90e4-f7ef1b6daaf7-kube-api-access-dztfv\") pod \"d45be74c-0d98-4d18-90e4-f7ef1b6daaf7\" (UID: \"d45be74c-0d98-4d18-90e4-f7ef1b6daaf7\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.757076 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etcd-client\" (UniqueName: \"kubernetes.io/secret/d19cb085-0c5b-4810-b654-ce7923221d90-etcd-client\") pod \"d19cb085-0c5b-4810-b654-ce7923221d90\" (UID: \"d19cb085-0c5b-4810-b654-ce7923221d90\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.757100 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d45be74c-0d98-4d18-90e4-f7ef1b6daaf7-config\") pod \"d45be74c-0d98-4d18-90e4-f7ef1b6daaf7\" (UID: \"d45be74c-0d98-4d18-90e4-f7ef1b6daaf7\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.757120 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/92dfbade-90b6-4169-8c07-72cff7f2c82b-config-volume\") pod \"92dfbade-90b6-4169-8c07-72cff7f2c82b\" (UID: \"92dfbade-90b6-4169-8c07-72cff7f2c82b\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.757142 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/584e1f4a-8205-47d7-8efb-3afc6017c4c9-utilities\") pod \"584e1f4a-8205-47d7-8efb-3afc6017c4c9\" (UID: \"584e1f4a-8205-47d7-8efb-3afc6017c4c9\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.757162 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/dcd10325-9ba5-4a3b-8e4a-e57e3bf210f9-config\") pod \"dcd10325-9ba5-4a3b-8e4a-e57e3bf210f9\" (UID: \"dcd10325-9ba5-4a3b-8e4a-e57e3bf210f9\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.757210 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xnxbn\" (UniqueName: \"kubernetes.io/projected/ce090a97-9ab6-4c40-a719-64ff2acd9778-kube-api-access-xnxbn\") pod \"ce090a97-9ab6-4c40-a719-64ff2acd9778\" (UID: \"ce090a97-9ab6-4c40-a719-64ff2acd9778\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.757236 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c5f2bfad-70f6-4185-a3d9-81ce12720767-serving-cert\") pod \"c5f2bfad-70f6-4185-a3d9-81ce12720767\" (UID: \"c5f2bfad-70f6-4185-a3d9-81ce12720767\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.757255 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5lcfw\" (UniqueName: \"kubernetes.io/projected/dcd10325-9ba5-4a3b-8e4a-e57e3bf210f9-kube-api-access-5lcfw\") pod \"dcd10325-9ba5-4a3b-8e4a-e57e3bf210f9\" (UID: \"dcd10325-9ba5-4a3b-8e4a-e57e3bf210f9\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.757275 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ks6v2\" (UniqueName: \"kubernetes.io/projected/71c8ffbe-59c6-4e7d-aa1a-bbd315b3414a-kube-api-access-ks6v2\") pod \"71c8ffbe-59c6-4e7d-aa1a-bbd315b3414a\" (UID: \"71c8ffbe-59c6-4e7d-aa1a-bbd315b3414a\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.757295 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8pskd\" (UniqueName: \"kubernetes.io/projected/a555ff2e-0be6-46d5-897d-863bb92ae2b3-kube-api-access-8pskd\") pod \"a555ff2e-0be6-46d5-897d-863bb92ae2b3\" (UID: \"a555ff2e-0be6-46d5-897d-863bb92ae2b3\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.757315 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7df94c10-441d-4386-93a6-6730fb7bcde0-env-overrides\") pod \"7df94c10-441d-4386-93a6-6730fb7bcde0\" (UID: \"7df94c10-441d-4386-93a6-6730fb7bcde0\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.757338 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7afa918d-be67-40a6-803c-d3b0ae99d815-tmp\") pod \"7afa918d-be67-40a6-803c-d3b0ae99d815\" (UID: \"7afa918d-be67-40a6-803c-d3b0ae99d815\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.757360 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etcd-client\" (UniqueName: \"kubernetes.io/secret/f559dfa3-3917-43a2-97f6-61ddfda10e93-etcd-client\") pod \"f559dfa3-3917-43a2-97f6-61ddfda10e93\" (UID: \"f559dfa3-3917-43a2-97f6-61ddfda10e93\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.757380 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/ce090a97-9ab6-4c40-a719-64ff2acd9778-signing-cabundle\") pod \"ce090a97-9ab6-4c40-a719-64ff2acd9778\" (UID: \"ce090a97-9ab6-4c40-a719-64ff2acd9778\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.757401 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etcd-ca\" (UniqueName: \"kubernetes.io/configmap/567683bd-0efc-4f21-b076-e28559628404-etcd-ca\") pod \"567683bd-0efc-4f21-b076-e28559628404\" (UID: \"567683bd-0efc-4f21-b076-e28559628404\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.757420 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/09cfa50b-4138-4585-a53e-64dd3ab73335-config\") pod \"09cfa50b-4138-4585-a53e-64dd3ab73335\" (UID: \"09cfa50b-4138-4585-a53e-64dd3ab73335\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.757464 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9z4sw\" (UniqueName: \"kubernetes.io/projected/e1d2a42d-af1d-4054-9618-ab545e0ed8b7-kube-api-access-9z4sw\") pod \"e1d2a42d-af1d-4054-9618-ab545e0ed8b7\" (UID: \"e1d2a42d-af1d-4054-9618-ab545e0ed8b7\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.757487 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d45be74c-0d98-4d18-90e4-f7ef1b6daaf7-tmp\") pod \"d45be74c-0d98-4d18-90e4-f7ef1b6daaf7\" (UID: \"d45be74c-0d98-4d18-90e4-f7ef1b6daaf7\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.757512 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/869851b9-7ffb-4af0-b166-1d8aa40a5f80-whereabouts-flatfile-configmap\") pod \"869851b9-7ffb-4af0-b166-1d8aa40a5f80\" (UID: \"869851b9-7ffb-4af0-b166-1d8aa40a5f80\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.757538 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mjwtd\" (UniqueName: \"kubernetes.io/projected/869851b9-7ffb-4af0-b166-1d8aa40a5f80-kube-api-access-mjwtd\") pod \"869851b9-7ffb-4af0-b166-1d8aa40a5f80\" (UID: \"869851b9-7ffb-4af0-b166-1d8aa40a5f80\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.757564 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d45be74c-0d98-4d18-90e4-f7ef1b6daaf7-kube-api-access-dztfv" (OuterVolumeSpecName: "kube-api-access-dztfv") pod "d45be74c-0d98-4d18-90e4-f7ef1b6daaf7" (UID: "d45be74c-0d98-4d18-90e4-f7ef1b6daaf7"). InnerVolumeSpecName "kube-api-access-dztfv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.757739 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f71a554-e414-4bc3-96d2-674060397afe-metrics-tls" (OuterVolumeSpecName: "metrics-tls") pod "9f71a554-e414-4bc3-96d2-674060397afe" (UID: "9f71a554-e414-4bc3-96d2-674060397afe"). InnerVolumeSpecName "metrics-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.758165 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a555ff2e-0be6-46d5-897d-863bb92ae2b3-kube-api-access-8pskd" (OuterVolumeSpecName: "kube-api-access-8pskd") pod "a555ff2e-0be6-46d5-897d-863bb92ae2b3" (UID: "a555ff2e-0be6-46d5-897d-863bb92ae2b3"). InnerVolumeSpecName "kube-api-access-8pskd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.758243 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/584e1f4a-8205-47d7-8efb-3afc6017c4c9-utilities" (OuterVolumeSpecName: "utilities") pod "584e1f4a-8205-47d7-8efb-3afc6017c4c9" (UID: "584e1f4a-8205-47d7-8efb-3afc6017c4c9"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.758429 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d19cb085-0c5b-4810-b654-ce7923221d90-etcd-client" (OuterVolumeSpecName: "etcd-client") pod "d19cb085-0c5b-4810-b654-ce7923221d90" (UID: "d19cb085-0c5b-4810-b654-ce7923221d90"). InnerVolumeSpecName "etcd-client". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.758506 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d45be74c-0d98-4d18-90e4-f7ef1b6daaf7-config" (OuterVolumeSpecName: "config") pod "d45be74c-0d98-4d18-90e4-f7ef1b6daaf7" (UID: "d45be74c-0d98-4d18-90e4-f7ef1b6daaf7"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.758606 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/31fa8943-81cc-4750-a0b7-0fa9ab5af883-catalog-content\") pod \"31fa8943-81cc-4750-a0b7-0fa9ab5af883\" (UID: \"31fa8943-81cc-4750-a0b7-0fa9ab5af883\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.758630 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etcd-serving-ca\" (UniqueName: \"kubernetes.io/configmap/f559dfa3-3917-43a2-97f6-61ddfda10e93-etcd-serving-ca\") pod \"f559dfa3-3917-43a2-97f6-61ddfda10e93\" (UID: \"f559dfa3-3917-43a2-97f6-61ddfda10e93\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.758652 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/18f80adb-c1c3-49ba-8ee4-932c851d3897-metrics-certs\") pod \"18f80adb-c1c3-49ba-8ee4-932c851d3897\" (UID: \"18f80adb-c1c3-49ba-8ee4-932c851d3897\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.758666 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce090a97-9ab6-4c40-a719-64ff2acd9778-kube-api-access-xnxbn" (OuterVolumeSpecName: "kube-api-access-xnxbn") pod "ce090a97-9ab6-4c40-a719-64ff2acd9778" (UID: "ce090a97-9ab6-4c40-a719-64ff2acd9778"). InnerVolumeSpecName "kube-api-access-xnxbn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.758675 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/869851b9-7ffb-4af0-b166-1d8aa40a5f80-cni-binary-copy\") pod \"869851b9-7ffb-4af0-b166-1d8aa40a5f80\" (UID: \"869851b9-7ffb-4af0-b166-1d8aa40a5f80\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.759075 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7df94c10-441d-4386-93a6-6730fb7bcde0-env-overrides" (OuterVolumeSpecName: "env-overrides") pod "7df94c10-441d-4386-93a6-6730fb7bcde0" (UID: "7df94c10-441d-4386-93a6-6730fb7bcde0"). InnerVolumeSpecName "env-overrides". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.759102 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/09cfa50b-4138-4585-a53e-64dd3ab73335-config" (OuterVolumeSpecName: "config") pod "09cfa50b-4138-4585-a53e-64dd3ab73335" (UID: "09cfa50b-4138-4585-a53e-64dd3ab73335"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.759156 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f559dfa3-3917-43a2-97f6-61ddfda10e93-etcd-client" (OuterVolumeSpecName: "etcd-client") pod "f559dfa3-3917-43a2-97f6-61ddfda10e93" (UID: "f559dfa3-3917-43a2-97f6-61ddfda10e93"). InnerVolumeSpecName "etcd-client". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.759350 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etcd-service-ca\" (UniqueName: \"kubernetes.io/configmap/567683bd-0efc-4f21-b076-e28559628404-etcd-service-ca\") pod \"567683bd-0efc-4f21-b076-e28559628404\" (UID: \"567683bd-0efc-4f21-b076-e28559628404\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.759343 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92dfbade-90b6-4169-8c07-72cff7f2c82b-config-volume" (OuterVolumeSpecName: "config-volume") pod "92dfbade-90b6-4169-8c07-72cff7f2c82b" (UID: "92dfbade-90b6-4169-8c07-72cff7f2c82b"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.759373 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ftwb6\" (UniqueName: \"kubernetes.io/projected/9f71a554-e414-4bc3-96d2-674060397afe-kube-api-access-ftwb6\") pod \"9f71a554-e414-4bc3-96d2-674060397afe\" (UID: \"9f71a554-e414-4bc3-96d2-674060397afe\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.759388 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9e9b5059-1b3e-4067-a63d-2952cbe863af-bound-sa-token\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.759408 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6077b63e-53a2-4f96-9d56-1ce0324e4913-tmp-dir\") pod \"6077b63e-53a2-4f96-9d56-1ce0324e4913\" (UID: \"6077b63e-53a2-4f96-9d56-1ce0324e4913\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.759425 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/cc85e424-18b2-4924-920b-bd291a8c4b01-catalog-content\") pod \"cc85e424-18b2-4924-920b-bd291a8c4b01\" (UID: \"cc85e424-18b2-4924-920b-bd291a8c4b01\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.759439 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/92dfbade-90b6-4169-8c07-72cff7f2c82b-tmp-dir\") pod \"92dfbade-90b6-4169-8c07-72cff7f2c82b\" (UID: \"92dfbade-90b6-4169-8c07-72cff7f2c82b\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.759456 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7599e0b6-bddf-4def-b7f2-0b32206e8651-serving-cert\") pod \"7599e0b6-bddf-4def-b7f2-0b32206e8651\" (UID: \"7599e0b6-bddf-4def-b7f2-0b32206e8651\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.759453 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7afa918d-be67-40a6-803c-d3b0ae99d815-tmp" (OuterVolumeSpecName: "tmp") pod "7afa918d-be67-40a6-803c-d3b0ae99d815" (UID: "7afa918d-be67-40a6-803c-d3b0ae99d815"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.759471 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce090a97-9ab6-4c40-a719-64ff2acd9778-signing-cabundle" (OuterVolumeSpecName: "signing-cabundle") pod "ce090a97-9ab6-4c40-a719-64ff2acd9778" (UID: "ce090a97-9ab6-4c40-a719-64ff2acd9778"). InnerVolumeSpecName "signing-cabundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.759481 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d565531a-ff86-4608-9d19-767de01ac31b-proxy-tls\") pod \"d565531a-ff86-4608-9d19-767de01ac31b\" (UID: \"d565531a-ff86-4608-9d19-767de01ac31b\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.759500 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tkdh6\" (UniqueName: \"kubernetes.io/projected/20ce4d18-fe25-4696-ad7c-1bd2d6200a3e-kube-api-access-tkdh6\") pod \"20ce4d18-fe25-4696-ad7c-1bd2d6200a3e\" (UID: \"20ce4d18-fe25-4696-ad7c-1bd2d6200a3e\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.759517 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/c5f2bfad-70f6-4185-a3d9-81ce12720767-kube-api-access\") pod \"c5f2bfad-70f6-4185-a3d9-81ce12720767\" (UID: \"c5f2bfad-70f6-4185-a3d9-81ce12720767\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.759533 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca-console-config\") pod \"6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca\" (UID: \"6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.759548 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wbmqg\" (UniqueName: \"kubernetes.io/projected/18f80adb-c1c3-49ba-8ee4-932c851d3897-kube-api-access-wbmqg\") pod \"18f80adb-c1c3-49ba-8ee4-932c851d3897\" (UID: \"18f80adb-c1c3-49ba-8ee4-932c851d3897\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.759563 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c5f2bfad-70f6-4185-a3d9-81ce12720767-config\") pod \"c5f2bfad-70f6-4185-a3d9-81ce12720767\" (UID: \"c5f2bfad-70f6-4185-a3d9-81ce12720767\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.759578 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a555ff2e-0be6-46d5-897d-863bb92ae2b3-serving-cert\") pod \"a555ff2e-0be6-46d5-897d-863bb92ae2b3\" (UID: \"a555ff2e-0be6-46d5-897d-863bb92ae2b3\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.759593 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"v4-0-config-user-template-login\" (UniqueName: \"kubernetes.io/secret/6edfcf45-925b-4eff-b940-95b6fc0b85d4-v4-0-config-user-template-login\") pod \"6edfcf45-925b-4eff-b940-95b6fc0b85d4\" (UID: \"6edfcf45-925b-4eff-b940-95b6fc0b85d4\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.759610 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ptkcf\" (UniqueName: \"kubernetes.io/projected/7599e0b6-bddf-4def-b7f2-0b32206e8651-kube-api-access-ptkcf\") pod \"7599e0b6-bddf-4def-b7f2-0b32206e8651\" (UID: \"7599e0b6-bddf-4def-b7f2-0b32206e8651\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.759627 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9e9b5059-1b3e-4067-a63d-2952cbe863af-registry-tls\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.759643 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/ce090a97-9ab6-4c40-a719-64ff2acd9778-signing-key\") pod \"ce090a97-9ab6-4c40-a719-64ff2acd9778\" (UID: \"ce090a97-9ab6-4c40-a719-64ff2acd9778\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.759661 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tmpfs\" (UniqueName: \"kubernetes.io/empty-dir/7fcc6409-8a0f-44c3-89e7-5aecd7610f8a-tmpfs\") pod \"7fcc6409-8a0f-44c3-89e7-5aecd7610f8a\" (UID: \"7fcc6409-8a0f-44c3-89e7-5aecd7610f8a\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.759677 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/cc85e424-18b2-4924-920b-bd291a8c4b01-utilities\") pod \"cc85e424-18b2-4924-920b-bd291a8c4b01\" (UID: \"cc85e424-18b2-4924-920b-bd291a8c4b01\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.759751 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/16bdd140-dce1-464c-ab47-dd5798d1d256-serving-cert\") pod \"16bdd140-dce1-464c-ab47-dd5798d1d256\" (UID: \"16bdd140-dce1-464c-ab47-dd5798d1d256\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.759783 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q4smf\" (UniqueName: \"kubernetes.io/projected/0dd0fbac-8c0d-4228-8faa-abbeedabf7db-kube-api-access-q4smf\") pod \"0dd0fbac-8c0d-4228-8faa-abbeedabf7db\" (UID: \"0dd0fbac-8c0d-4228-8faa-abbeedabf7db\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.759798 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/567683bd-0efc-4f21-b076-e28559628404-tmp-dir\") pod \"567683bd-0efc-4f21-b076-e28559628404\" (UID: \"567683bd-0efc-4f21-b076-e28559628404\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.759814 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"webhook-certs\" (UniqueName: \"kubernetes.io/secret/0dd0fbac-8c0d-4228-8faa-abbeedabf7db-webhook-certs\") pod \"0dd0fbac-8c0d-4228-8faa-abbeedabf7db\" (UID: \"0dd0fbac-8c0d-4228-8faa-abbeedabf7db\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.759830 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"v4-0-config-system-ocp-branding-template\" (UniqueName: \"kubernetes.io/secret/6edfcf45-925b-4eff-b940-95b6fc0b85d4-v4-0-config-system-ocp-branding-template\") pod \"6edfcf45-925b-4eff-b940-95b6fc0b85d4\" (UID: \"6edfcf45-925b-4eff-b940-95b6fc0b85d4\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.759840 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92dfbade-90b6-4169-8c07-72cff7f2c82b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "92dfbade-90b6-4169-8c07-72cff7f2c82b" (UID: "92dfbade-90b6-4169-8c07-72cff7f2c82b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.759894 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/869851b9-7ffb-4af0-b166-1d8aa40a5f80-kube-api-access-mjwtd" (OuterVolumeSpecName: "kube-api-access-mjwtd") pod "869851b9-7ffb-4af0-b166-1d8aa40a5f80" (UID: "869851b9-7ffb-4af0-b166-1d8aa40a5f80"). InnerVolumeSpecName "kube-api-access-mjwtd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.759923 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7599e0b6-bddf-4def-b7f2-0b32206e8651-config" (OuterVolumeSpecName: "config") pod "7599e0b6-bddf-4def-b7f2-0b32206e8651" (UID: "7599e0b6-bddf-4def-b7f2-0b32206e8651"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.759965 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71c8ffbe-59c6-4e7d-aa1a-bbd315b3414a-kube-api-access-ks6v2" (OuterVolumeSpecName: "kube-api-access-ks6v2") pod "71c8ffbe-59c6-4e7d-aa1a-bbd315b3414a" (UID: "71c8ffbe-59c6-4e7d-aa1a-bbd315b3414a"). InnerVolumeSpecName "kube-api-access-ks6v2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.759926 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/94a6e063-3d1a-4d44-875d-185291448c31-catalog-content\") pod \"94a6e063-3d1a-4d44-875d-185291448c31\" (UID: \"94a6e063-3d1a-4d44-875d-185291448c31\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.760028 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d19cb085-0c5b-4810-b654-ce7923221d90-trusted-ca-bundle\") pod \"d19cb085-0c5b-4810-b654-ce7923221d90\" (UID: \"d19cb085-0c5b-4810-b654-ce7923221d90\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.760047 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z5rsr\" (UniqueName: \"kubernetes.io/projected/af33e427-6803-48c2-a76a-dd9deb7cbf9a-kube-api-access-z5rsr\") pod \"af33e427-6803-48c2-a76a-dd9deb7cbf9a\" (UID: \"af33e427-6803-48c2-a76a-dd9deb7cbf9a\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.760065 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c491984c-7d4b-44aa-8c1e-d7974424fa47-config\") pod \"c491984c-7d4b-44aa-8c1e-d7974424fa47\" (UID: \"c491984c-7d4b-44aa-8c1e-d7974424fa47\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.760324 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hckvg\" (UniqueName: \"kubernetes.io/projected/fc8db2c7-859d-47b3-a900-2bd0c0b2973b-kube-api-access-hckvg\") pod \"fc8db2c7-859d-47b3-a900-2bd0c0b2973b\" (UID: \"fc8db2c7-859d-47b3-a900-2bd0c0b2973b\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.760353 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/20ce4d18-fe25-4696-ad7c-1bd2d6200a3e-trusted-ca\") pod \"20ce4d18-fe25-4696-ad7c-1bd2d6200a3e\" (UID: \"20ce4d18-fe25-4696-ad7c-1bd2d6200a3e\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.760371 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/81e39f7b-62e4-4fc9-992a-6535ce127a02-cni-binary-copy\") pod \"81e39f7b-62e4-4fc9-992a-6535ce127a02\" (UID: \"81e39f7b-62e4-4fc9-992a-6535ce127a02\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.760388 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"profile-collector-cert\" (UniqueName: \"kubernetes.io/secret/7fcc6409-8a0f-44c3-89e7-5aecd7610f8a-profile-collector-cert\") pod \"7fcc6409-8a0f-44c3-89e7-5aecd7610f8a\" (UID: \"7fcc6409-8a0f-44c3-89e7-5aecd7610f8a\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.760405 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nmmzf\" (UniqueName: \"kubernetes.io/projected/7df94c10-441d-4386-93a6-6730fb7bcde0-kube-api-access-nmmzf\") pod \"7df94c10-441d-4386-93a6-6730fb7bcde0\" (UID: \"7df94c10-441d-4386-93a6-6730fb7bcde0\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.760421 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"marketplace-operator-metrics\" (UniqueName: \"kubernetes.io/secret/b05a4c1d-fa93-4d3d-b6e5-235473e1ae2a-marketplace-operator-metrics\") pod \"b05a4c1d-fa93-4d3d-b6e5-235473e1ae2a\" (UID: \"b05a4c1d-fa93-4d3d-b6e5-235473e1ae2a\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.760437 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l87hs\" (UniqueName: \"kubernetes.io/projected/5ebfebf6-3ecd-458e-943f-bb25b52e2718-kube-api-access-l87hs\") pod \"5ebfebf6-3ecd-458e-943f-bb25b52e2718\" (UID: \"5ebfebf6-3ecd-458e-943f-bb25b52e2718\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.760455 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/71c8ffbe-59c6-4e7d-aa1a-bbd315b3414a-catalog-content\") pod \"71c8ffbe-59c6-4e7d-aa1a-bbd315b3414a\" (UID: \"71c8ffbe-59c6-4e7d-aa1a-bbd315b3414a\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.760473 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"machine-api-operator-tls\" (UniqueName: \"kubernetes.io/secret/c491984c-7d4b-44aa-8c1e-d7974424fa47-machine-api-operator-tls\") pod \"c491984c-7d4b-44aa-8c1e-d7974424fa47\" (UID: \"c491984c-7d4b-44aa-8c1e-d7974424fa47\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.760572 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/567683bd-0efc-4f21-b076-e28559628404-config\") pod \"567683bd-0efc-4f21-b076-e28559628404\" (UID: \"567683bd-0efc-4f21-b076-e28559628404\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.760664 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rzt4w\" (UniqueName: \"kubernetes.io/projected/a52afe44-fb37-46ed-a1f8-bf39727a3cbe-kube-api-access-rzt4w\") pod \"a52afe44-fb37-46ed-a1f8-bf39727a3cbe\" (UID: \"a52afe44-fb37-46ed-a1f8-bf39727a3cbe\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.760811 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e1d2a42d-af1d-4054-9618-ab545e0ed8b7-proxy-tls\") pod \"e1d2a42d-af1d-4054-9618-ab545e0ed8b7\" (UID: \"e1d2a42d-af1d-4054-9618-ab545e0ed8b7\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.760829 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m5lgh\" (UniqueName: \"kubernetes.io/projected/d19cb085-0c5b-4810-b654-ce7923221d90-kube-api-access-m5lgh\") pod \"d19cb085-0c5b-4810-b654-ce7923221d90\" (UID: \"d19cb085-0c5b-4810-b654-ce7923221d90\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.760844 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d7cps\" (UniqueName: \"kubernetes.io/projected/af41de71-79cf-4590-bbe9-9e8b848862cb-kube-api-access-d7cps\") pod \"af41de71-79cf-4590-bbe9-9e8b848862cb\" (UID: \"af41de71-79cf-4590-bbe9-9e8b848862cb\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.760860 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9e9b5059-1b3e-4067-a63d-2952cbe863af-registry-certificates\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.760876 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/18f80adb-c1c3-49ba-8ee4-932c851d3897-stats-auth\") pod \"18f80adb-c1c3-49ba-8ee4-932c851d3897\" (UID: \"18f80adb-c1c3-49ba-8ee4-932c851d3897\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.760890 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/567683bd-0efc-4f21-b076-e28559628404-serving-cert\") pod \"567683bd-0efc-4f21-b076-e28559628404\" (UID: \"567683bd-0efc-4f21-b076-e28559628404\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.760909 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/a555ff2e-0be6-46d5-897d-863bb92ae2b3-client-ca\") pod \"a555ff2e-0be6-46d5-897d-863bb92ae2b3\" (UID: \"a555ff2e-0be6-46d5-897d-863bb92ae2b3\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.760925 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ws8zz\" (UniqueName: \"kubernetes.io/projected/9e9b5059-1b3e-4067-a63d-2952cbe863af-kube-api-access-ws8zz\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.760947 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/f65c0ac1-8bca-454d-a2e6-e35cb418beac-kube-api-access\") pod \"f65c0ac1-8bca-454d-a2e6-e35cb418beac\" (UID: \"f65c0ac1-8bca-454d-a2e6-e35cb418beac\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.760972 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7afa918d-be67-40a6-803c-d3b0ae99d815-config\") pod \"7afa918d-be67-40a6-803c-d3b0ae99d815\" (UID: \"7afa918d-be67-40a6-803c-d3b0ae99d815\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.760994 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca-console-oauth-config\") pod \"6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca\" (UID: \"6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.761012 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/584e1f4a-8205-47d7-8efb-3afc6017c4c9-catalog-content\") pod \"584e1f4a-8205-47d7-8efb-3afc6017c4c9\" (UID: \"584e1f4a-8205-47d7-8efb-3afc6017c4c9\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.761030 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f65c0ac1-8bca-454d-a2e6-e35cb418beac-serving-cert\") pod \"f65c0ac1-8bca-454d-a2e6-e35cb418beac\" (UID: \"f65c0ac1-8bca-454d-a2e6-e35cb418beac\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.761104 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etcd-serving-ca\" (UniqueName: \"kubernetes.io/configmap/d19cb085-0c5b-4810-b654-ce7923221d90-etcd-serving-ca\") pod \"d19cb085-0c5b-4810-b654-ce7923221d90\" (UID: \"d19cb085-0c5b-4810-b654-ce7923221d90\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.761129 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9f71a554-e414-4bc3-96d2-674060397afe-bound-sa-token\") pod \"9f71a554-e414-4bc3-96d2-674060397afe\" (UID: \"9f71a554-e414-4bc3-96d2-674060397afe\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.761372 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qgrkj\" (UniqueName: \"kubernetes.io/projected/42a11a02-47e1-488f-b270-2679d3298b0e-kube-api-access-qgrkj\") pod \"42a11a02-47e1-488f-b270-2679d3298b0e\" (UID: \"42a11a02-47e1-488f-b270-2679d3298b0e\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.761398 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"encryption-config\" (UniqueName: \"kubernetes.io/secret/f559dfa3-3917-43a2-97f6-61ddfda10e93-encryption-config\") pod \"f559dfa3-3917-43a2-97f6-61ddfda10e93\" (UID: \"f559dfa3-3917-43a2-97f6-61ddfda10e93\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.761439 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zth6t\" (UniqueName: \"kubernetes.io/projected/6077b63e-53a2-4f96-9d56-1ce0324e4913-kube-api-access-zth6t\") pod \"6077b63e-53a2-4f96-9d56-1ce0324e4913\" (UID: \"6077b63e-53a2-4f96-9d56-1ce0324e4913\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.761464 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7jjkz\" (UniqueName: \"kubernetes.io/projected/301e1965-1754-483d-b6cc-bfae7038bbca-kube-api-access-7jjkz\") pod \"301e1965-1754-483d-b6cc-bfae7038bbca\" (UID: \"301e1965-1754-483d-b6cc-bfae7038bbca\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.761488 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xfp5s\" (UniqueName: \"kubernetes.io/projected/cc85e424-18b2-4924-920b-bd291a8c4b01-kube-api-access-xfp5s\") pod \"cc85e424-18b2-4924-920b-bd291a8c4b01\" (UID: \"cc85e424-18b2-4924-920b-bd291a8c4b01\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.761514 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/fc8db2c7-859d-47b3-a900-2bd0c0b2973b-auth-proxy-config\") pod \"fc8db2c7-859d-47b3-a900-2bd0c0b2973b\" (UID: \"fc8db2c7-859d-47b3-a900-2bd0c0b2973b\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.761536 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/869851b9-7ffb-4af0-b166-1d8aa40a5f80-cni-sysctl-allowlist\") pod \"869851b9-7ffb-4af0-b166-1d8aa40a5f80\" (UID: \"869851b9-7ffb-4af0-b166-1d8aa40a5f80\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.761586 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/01080b46-74f1-4191-8755-5152a57b3b25-serving-cert\") pod \"01080b46-74f1-4191-8755-5152a57b3b25\" (UID: \"01080b46-74f1-4191-8755-5152a57b3b25\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.761608 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f65c0ac1-8bca-454d-a2e6-e35cb418beac-config\") pod \"f65c0ac1-8bca-454d-a2e6-e35cb418beac\" (UID: \"f65c0ac1-8bca-454d-a2e6-e35cb418beac\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.761696 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9e9b5059-1b3e-4067-a63d-2952cbe863af-installation-pull-secrets\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.761721 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca-trusted-ca-bundle\") pod \"6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca\" (UID: \"6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.761782 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c5f2bfad-70f6-4185-a3d9-81ce12720767-tmp-dir\") pod \"c5f2bfad-70f6-4185-a3d9-81ce12720767\" (UID: \"c5f2bfad-70f6-4185-a3d9-81ce12720767\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.761801 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4hb7m\" (UniqueName: \"kubernetes.io/projected/94a6e063-3d1a-4d44-875d-185291448c31-kube-api-access-4hb7m\") pod \"94a6e063-3d1a-4d44-875d-185291448c31\" (UID: \"94a6e063-3d1a-4d44-875d-185291448c31\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.762698 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a555ff2e-0be6-46d5-897d-863bb92ae2b3-config\") pod \"a555ff2e-0be6-46d5-897d-863bb92ae2b3\" (UID: \"a555ff2e-0be6-46d5-897d-863bb92ae2b3\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.763057 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"v4-0-config-user-template-provider-selection\" (UniqueName: \"kubernetes.io/secret/6edfcf45-925b-4eff-b940-95b6fc0b85d4-v4-0-config-user-template-provider-selection\") pod \"6edfcf45-925b-4eff-b940-95b6fc0b85d4\" (UID: \"6edfcf45-925b-4eff-b940-95b6fc0b85d4\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.763089 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9e9b5059-1b3e-4067-a63d-2952cbe863af-ca-trust-extracted\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.763115 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sbc2l\" (UniqueName: \"kubernetes.io/projected/593a3561-7760-45c5-8f91-5aaef7475d0f-kube-api-access-sbc2l\") pod \"593a3561-7760-45c5-8f91-5aaef7475d0f\" (UID: \"593a3561-7760-45c5-8f91-5aaef7475d0f\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.763140 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/9276f8f5-2f24-48e1-ab6d-1aab0d8ec3ff-catalog-content\") pod \"9276f8f5-2f24-48e1-ab6d-1aab0d8ec3ff\" (UID: \"9276f8f5-2f24-48e1-ab6d-1aab0d8ec3ff\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.763167 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-twvbl\" (UniqueName: \"kubernetes.io/projected/b4750666-1362-4001-abd0-6f89964cc621-kube-api-access-twvbl\") pod \"b4750666-1362-4001-abd0-6f89964cc621\" (UID: \"b4750666-1362-4001-abd0-6f89964cc621\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.763194 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"v4-0-config-system-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6edfcf45-925b-4eff-b940-95b6fc0b85d4-v4-0-config-system-trusted-ca-bundle\") pod \"6edfcf45-925b-4eff-b940-95b6fc0b85d4\" (UID: \"6edfcf45-925b-4eff-b940-95b6fc0b85d4\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.763228 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5ebfebf6-3ecd-458e-943f-bb25b52e2718-serviceca\") pod \"5ebfebf6-3ecd-458e-943f-bb25b52e2718\" (UID: \"5ebfebf6-3ecd-458e-943f-bb25b52e2718\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.763265 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zsb9b\" (UniqueName: \"kubernetes.io/projected/09cfa50b-4138-4585-a53e-64dd3ab73335-kube-api-access-zsb9b\") pod \"09cfa50b-4138-4585-a53e-64dd3ab73335\" (UID: \"09cfa50b-4138-4585-a53e-64dd3ab73335\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.763291 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/31fa8943-81cc-4750-a0b7-0fa9ab5af883-utilities\") pod \"31fa8943-81cc-4750-a0b7-0fa9ab5af883\" (UID: \"31fa8943-81cc-4750-a0b7-0fa9ab5af883\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.763316 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m26jq\" (UniqueName: \"kubernetes.io/projected/567683bd-0efc-4f21-b076-e28559628404-kube-api-access-m26jq\") pod \"567683bd-0efc-4f21-b076-e28559628404\" (UID: \"567683bd-0efc-4f21-b076-e28559628404\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.763337 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"encryption-config\" (UniqueName: \"kubernetes.io/secret/d19cb085-0c5b-4810-b654-ce7923221d90-encryption-config\") pod \"d19cb085-0c5b-4810-b654-ce7923221d90\" (UID: \"d19cb085-0c5b-4810-b654-ce7923221d90\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.763362 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b4750666-1362-4001-abd0-6f89964cc621-proxy-tls\") pod \"b4750666-1362-4001-abd0-6f89964cc621\" (UID: \"b4750666-1362-4001-abd0-6f89964cc621\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.763387 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2325ffef-9d5b-447f-b00e-3efc429acefe-serving-cert\") pod \"2325ffef-9d5b-447f-b00e-3efc429acefe\" (UID: \"2325ffef-9d5b-447f-b00e-3efc429acefe\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.763412 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6g4lr\" (UniqueName: \"kubernetes.io/projected/f7e2c886-118e-43bb-bef1-c78134de392b-kube-api-access-6g4lr\") pod \"f7e2c886-118e-43bb-bef1-c78134de392b\" (UID: \"f7e2c886-118e-43bb-bef1-c78134de392b\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.763437 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9e9b5059-1b3e-4067-a63d-2952cbe863af-trusted-ca\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.763461 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/736c54fe-349c-4bb9-870a-d1c1d1c03831-serving-cert\") pod \"736c54fe-349c-4bb9-870a-d1c1d1c03831\" (UID: \"736c54fe-349c-4bb9-870a-d1c1d1c03831\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.763485 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2325ffef-9d5b-447f-b00e-3efc429acefe-trusted-ca\") pod \"2325ffef-9d5b-447f-b00e-3efc429acefe\" (UID: \"2325ffef-9d5b-447f-b00e-3efc429acefe\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.763508 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a555ff2e-0be6-46d5-897d-863bb92ae2b3-tmp\") pod \"a555ff2e-0be6-46d5-897d-863bb92ae2b3\" (UID: \"a555ff2e-0be6-46d5-897d-863bb92ae2b3\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.763530 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"v4-0-config-system-session\" (UniqueName: \"kubernetes.io/secret/6edfcf45-925b-4eff-b940-95b6fc0b85d4-v4-0-config-system-session\") pod \"6edfcf45-925b-4eff-b940-95b6fc0b85d4\" (UID: \"6edfcf45-925b-4eff-b940-95b6fc0b85d4\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.763554 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/92dfbade-90b6-4169-8c07-72cff7f2c82b-metrics-tls\") pod \"92dfbade-90b6-4169-8c07-72cff7f2c82b\" (UID: \"92dfbade-90b6-4169-8c07-72cff7f2c82b\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.763579 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"node-bootstrap-token\" (UniqueName: \"kubernetes.io/secret/593a3561-7760-45c5-8f91-5aaef7475d0f-node-bootstrap-token\") pod \"593a3561-7760-45c5-8f91-5aaef7475d0f\" (UID: \"593a3561-7760-45c5-8f91-5aaef7475d0f\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.763600 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/af33e427-6803-48c2-a76a-dd9deb7cbf9a-env-overrides\") pod \"af33e427-6803-48c2-a76a-dd9deb7cbf9a\" (UID: \"af33e427-6803-48c2-a76a-dd9deb7cbf9a\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.763626 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"v4-0-config-system-service-ca\" (UniqueName: \"kubernetes.io/configmap/6edfcf45-925b-4eff-b940-95b6fc0b85d4-v4-0-config-system-service-ca\") pod \"6edfcf45-925b-4eff-b940-95b6fc0b85d4\" (UID: \"6edfcf45-925b-4eff-b940-95b6fc0b85d4\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.763648 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f65c0ac1-8bca-454d-a2e6-e35cb418beac-tmp-dir\") pod \"f65c0ac1-8bca-454d-a2e6-e35cb418beac\" (UID: \"f65c0ac1-8bca-454d-a2e6-e35cb418beac\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.763677 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7df94c10-441d-4386-93a6-6730fb7bcde0-ovnkube-config\") pod \"7df94c10-441d-4386-93a6-6730fb7bcde0\" (UID: \"7df94c10-441d-4386-93a6-6730fb7bcde0\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.763703 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d7e8f42f-dc0e-424b-bb56-5ec849834888-serving-cert\") pod \"d7e8f42f-dc0e-424b-bb56-5ec849834888\" (UID: \"d7e8f42f-dc0e-424b-bb56-5ec849834888\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.763731 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qqbfk\" (UniqueName: \"kubernetes.io/projected/b05a4c1d-fa93-4d3d-b6e5-235473e1ae2a-kube-api-access-qqbfk\") pod \"b05a4c1d-fa93-4d3d-b6e5-235473e1ae2a\" (UID: \"b05a4c1d-fa93-4d3d-b6e5-235473e1ae2a\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.763772 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"images\" (UniqueName: \"kubernetes.io/configmap/d565531a-ff86-4608-9d19-767de01ac31b-images\") pod \"d565531a-ff86-4608-9d19-767de01ac31b\" (UID: \"d565531a-ff86-4608-9d19-767de01ac31b\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.763801 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ddlk9\" (UniqueName: \"kubernetes.io/projected/7fcc6409-8a0f-44c3-89e7-5aecd7610f8a-kube-api-access-ddlk9\") pod \"7fcc6409-8a0f-44c3-89e7-5aecd7610f8a\" (UID: \"7fcc6409-8a0f-44c3-89e7-5aecd7610f8a\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.763827 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-99zj9\" (UniqueName: \"kubernetes.io/projected/d565531a-ff86-4608-9d19-767de01ac31b-kube-api-access-99zj9\") pod \"d565531a-ff86-4608-9d19-767de01ac31b\" (UID: \"d565531a-ff86-4608-9d19-767de01ac31b\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.763858 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7afa918d-be67-40a6-803c-d3b0ae99d815-serving-cert\") pod \"7afa918d-be67-40a6-803c-d3b0ae99d815\" (UID: \"7afa918d-be67-40a6-803c-d3b0ae99d815\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.763883 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/a555ff2e-0be6-46d5-897d-863bb92ae2b3-proxy-ca-bundles\") pod \"a555ff2e-0be6-46d5-897d-863bb92ae2b3\" (UID: \"a555ff2e-0be6-46d5-897d-863bb92ae2b3\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.763911 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zg8nc\" (UniqueName: \"kubernetes.io/projected/2325ffef-9d5b-447f-b00e-3efc429acefe-kube-api-access-zg8nc\") pod \"2325ffef-9d5b-447f-b00e-3efc429acefe\" (UID: \"2325ffef-9d5b-447f-b00e-3efc429acefe\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.763938 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mfzkj\" (UniqueName: \"kubernetes.io/projected/0effdbcf-dd7d-404d-9d48-77536d665a5d-kube-api-access-mfzkj\") pod \"0effdbcf-dd7d-404d-9d48-77536d665a5d\" (UID: \"0effdbcf-dd7d-404d-9d48-77536d665a5d\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.763962 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8nb9c\" (UniqueName: \"kubernetes.io/projected/6edfcf45-925b-4eff-b940-95b6fc0b85d4-kube-api-access-8nb9c\") pod \"6edfcf45-925b-4eff-b940-95b6fc0b85d4\" (UID: \"6edfcf45-925b-4eff-b940-95b6fc0b85d4\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.763987 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/94a6e063-3d1a-4d44-875d-185291448c31-utilities\") pod \"94a6e063-3d1a-4d44-875d-185291448c31\" (UID: \"94a6e063-3d1a-4d44-875d-185291448c31\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.764017 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"package-server-manager-serving-cert\" (UniqueName: \"kubernetes.io/secret/a208c9c2-333b-4b4a-be0d-bc32ec38a821-package-server-manager-serving-cert\") pod \"a208c9c2-333b-4b4a-be0d-bc32ec38a821\" (UID: \"a208c9c2-333b-4b4a-be0d-bc32ec38a821\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.764044 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"mcc-auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/b4750666-1362-4001-abd0-6f89964cc621-mcc-auth-proxy-config\") pod \"b4750666-1362-4001-abd0-6f89964cc621\" (UID: \"b4750666-1362-4001-abd0-6f89964cc621\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.764071 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d19cb085-0c5b-4810-b654-ce7923221d90-serving-cert\") pod \"d19cb085-0c5b-4810-b654-ce7923221d90\" (UID: \"d19cb085-0c5b-4810-b654-ce7923221d90\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.764096 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-grwfz\" (UniqueName: \"kubernetes.io/projected/31fa8943-81cc-4750-a0b7-0fa9ab5af883-kube-api-access-grwfz\") pod \"31fa8943-81cc-4750-a0b7-0fa9ab5af883\" (UID: \"31fa8943-81cc-4750-a0b7-0fa9ab5af883\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.764121 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca-oauth-serving-cert\") pod \"6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca\" (UID: \"6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.764144 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"images\" (UniqueName: \"kubernetes.io/configmap/c491984c-7d4b-44aa-8c1e-d7974424fa47-images\") pod \"c491984c-7d4b-44aa-8c1e-d7974424fa47\" (UID: \"c491984c-7d4b-44aa-8c1e-d7974424fa47\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.764167 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d19cb085-0c5b-4810-b654-ce7923221d90-config\") pod \"d19cb085-0c5b-4810-b654-ce7923221d90\" (UID: \"d19cb085-0c5b-4810-b654-ce7923221d90\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.764193 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-26xrl\" (UniqueName: \"kubernetes.io/projected/a208c9c2-333b-4b4a-be0d-bc32ec38a821-kube-api-access-26xrl\") pod \"a208c9c2-333b-4b4a-be0d-bc32ec38a821\" (UID: \"a208c9c2-333b-4b4a-be0d-bc32ec38a821\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.764220 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pllx6\" (UniqueName: \"kubernetes.io/projected/81e39f7b-62e4-4fc9-992a-6535ce127a02-kube-api-access-pllx6\") pod \"81e39f7b-62e4-4fc9-992a-6535ce127a02\" (UID: \"81e39f7b-62e4-4fc9-992a-6535ce127a02\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.764247 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/71c8ffbe-59c6-4e7d-aa1a-bbd315b3414a-utilities\") pod \"71c8ffbe-59c6-4e7d-aa1a-bbd315b3414a\" (UID: \"71c8ffbe-59c6-4e7d-aa1a-bbd315b3414a\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.764273 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"v4-0-config-user-idp-0-file-data\" (UniqueName: \"kubernetes.io/secret/6edfcf45-925b-4eff-b940-95b6fc0b85d4-v4-0-config-user-idp-0-file-data\") pod \"6edfcf45-925b-4eff-b940-95b6fc0b85d4\" (UID: \"6edfcf45-925b-4eff-b940-95b6fc0b85d4\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.764298 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etcd-client\" (UniqueName: \"kubernetes.io/secret/567683bd-0efc-4f21-b076-e28559628404-etcd-client\") pod \"567683bd-0efc-4f21-b076-e28559628404\" (UID: \"567683bd-0efc-4f21-b076-e28559628404\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.764321 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/7afa918d-be67-40a6-803c-d3b0ae99d815-kube-api-access\") pod \"7afa918d-be67-40a6-803c-d3b0ae99d815\" (UID: \"7afa918d-be67-40a6-803c-d3b0ae99d815\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.765177 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tmpfs\" (UniqueName: \"kubernetes.io/empty-dir/a7a88189-c967-4640-879e-27665747f20c-tmpfs\") pod \"a7a88189-c967-4640-879e-27665747f20c\" (UID: \"a7a88189-c967-4640-879e-27665747f20c\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.765206 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"audit-policies\" (UniqueName: \"kubernetes.io/configmap/f559dfa3-3917-43a2-97f6-61ddfda10e93-audit-policies\") pod \"f559dfa3-3917-43a2-97f6-61ddfda10e93\" (UID: \"f559dfa3-3917-43a2-97f6-61ddfda10e93\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.765229 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f7648cbb-48eb-4ba8-87ec-eb096b8fa1e4-metrics-certs\") pod \"f7648cbb-48eb-4ba8-87ec-eb096b8fa1e4\" (UID: \"f7648cbb-48eb-4ba8-87ec-eb096b8fa1e4\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.765313 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-94l9h\" (UniqueName: \"kubernetes.io/projected/16bdd140-dce1-464c-ab47-dd5798d1d256-kube-api-access-94l9h\") pod \"16bdd140-dce1-464c-ab47-dd5798d1d256\" (UID: \"16bdd140-dce1-464c-ab47-dd5798d1d256\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.765338 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/09cfa50b-4138-4585-a53e-64dd3ab73335-serving-cert\") pod \"09cfa50b-4138-4585-a53e-64dd3ab73335\" (UID: \"09cfa50b-4138-4585-a53e-64dd3ab73335\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.765358 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/736c54fe-349c-4bb9-870a-d1c1d1c03831-tmp\") pod \"736c54fe-349c-4bb9-870a-d1c1d1c03831\" (UID: \"736c54fe-349c-4bb9-870a-d1c1d1c03831\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.765381 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dcd10325-9ba5-4a3b-8e4a-e57e3bf210f9-service-ca-bundle\") pod \"dcd10325-9ba5-4a3b-8e4a-e57e3bf210f9\" (UID: \"dcd10325-9ba5-4a3b-8e4a-e57e3bf210f9\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.765399 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18f80adb-c1c3-49ba-8ee4-932c851d3897-service-ca-bundle\") pod \"18f80adb-c1c3-49ba-8ee4-932c851d3897\" (UID: \"18f80adb-c1c3-49ba-8ee4-932c851d3897\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.765435 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tmpfs\" (UniqueName: \"kubernetes.io/empty-dir/301e1965-1754-483d-b6cc-bfae7038bbca-tmpfs\") pod \"301e1965-1754-483d-b6cc-bfae7038bbca\" (UID: \"301e1965-1754-483d-b6cc-bfae7038bbca\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.765453 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6077b63e-53a2-4f96-9d56-1ce0324e4913-metrics-tls\") pod \"6077b63e-53a2-4f96-9d56-1ce0324e4913\" (UID: \"6077b63e-53a2-4f96-9d56-1ce0324e4913\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.765472 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tknt7\" (UniqueName: \"kubernetes.io/projected/584e1f4a-8205-47d7-8efb-3afc6017c4c9-kube-api-access-tknt7\") pod \"584e1f4a-8205-47d7-8efb-3afc6017c4c9\" (UID: \"584e1f4a-8205-47d7-8efb-3afc6017c4c9\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.765492 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/149b3c48-e17c-4a66-a835-d86dabf6ff13-utilities\") pod \"149b3c48-e17c-4a66-a835-d86dabf6ff13\" (UID: \"149b3c48-e17c-4a66-a835-d86dabf6ff13\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.765509 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/af33e427-6803-48c2-a76a-dd9deb7cbf9a-ovn-node-metrics-cert\") pod \"af33e427-6803-48c2-a76a-dd9deb7cbf9a\" (UID: \"af33e427-6803-48c2-a76a-dd9deb7cbf9a\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.765526 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"certs\" (UniqueName: \"kubernetes.io/secret/593a3561-7760-45c5-8f91-5aaef7475d0f-certs\") pod \"593a3561-7760-45c5-8f91-5aaef7475d0f\" (UID: \"593a3561-7760-45c5-8f91-5aaef7475d0f\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.765549 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l9stx\" (UniqueName: \"kubernetes.io/projected/6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca-kube-api-access-l9stx\") pod \"6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca\" (UID: \"6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.765570 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/d7e8f42f-dc0e-424b-bb56-5ec849834888-kube-api-access\") pod \"d7e8f42f-dc0e-424b-bb56-5ec849834888\" (UID: \"d7e8f42f-dc0e-424b-bb56-5ec849834888\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.765588 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca-service-ca\") pod \"6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca\" (UID: \"6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.765606 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"v4-0-config-system-cliconfig\" (UniqueName: \"kubernetes.io/configmap/6edfcf45-925b-4eff-b940-95b6fc0b85d4-v4-0-config-system-cliconfig\") pod \"6edfcf45-925b-4eff-b940-95b6fc0b85d4\" (UID: \"6edfcf45-925b-4eff-b940-95b6fc0b85d4\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.765627 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d4tqq\" (UniqueName: \"kubernetes.io/projected/6ee8fbd3-1f81-4666-96da-5afc70819f1a-kube-api-access-d4tqq\") pod \"6ee8fbd3-1f81-4666-96da-5afc70819f1a\" (UID: \"6ee8fbd3-1f81-4666-96da-5afc70819f1a\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.765646 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wj4qr\" (UniqueName: \"kubernetes.io/projected/149b3c48-e17c-4a66-a835-d86dabf6ff13-kube-api-access-wj4qr\") pod \"149b3c48-e17c-4a66-a835-d86dabf6ff13\" (UID: \"149b3c48-e17c-4a66-a835-d86dabf6ff13\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.765663 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/af33e427-6803-48c2-a76a-dd9deb7cbf9a-ovnkube-config\") pod \"af33e427-6803-48c2-a76a-dd9deb7cbf9a\" (UID: \"af33e427-6803-48c2-a76a-dd9deb7cbf9a\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.765689 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/149b3c48-e17c-4a66-a835-d86dabf6ff13-catalog-content\") pod \"149b3c48-e17c-4a66-a835-d86dabf6ff13\" (UID: \"149b3c48-e17c-4a66-a835-d86dabf6ff13\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.765708 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2325ffef-9d5b-447f-b00e-3efc429acefe-config\") pod \"2325ffef-9d5b-447f-b00e-3efc429acefe\" (UID: \"2325ffef-9d5b-447f-b00e-3efc429acefe\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.765727 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6ee8fbd3-1f81-4666-96da-5afc70819f1a-samples-operator-tls\") pod \"6ee8fbd3-1f81-4666-96da-5afc70819f1a\" (UID: \"6ee8fbd3-1f81-4666-96da-5afc70819f1a\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.765746 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/af33e427-6803-48c2-a76a-dd9deb7cbf9a-ovnkube-script-lib\") pod \"af33e427-6803-48c2-a76a-dd9deb7cbf9a\" (UID: \"af33e427-6803-48c2-a76a-dd9deb7cbf9a\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.765779 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"profile-collector-cert\" (UniqueName: \"kubernetes.io/secret/301e1965-1754-483d-b6cc-bfae7038bbca-profile-collector-cert\") pod \"301e1965-1754-483d-b6cc-bfae7038bbca\" (UID: \"301e1965-1754-483d-b6cc-bfae7038bbca\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.765798 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"marketplace-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b05a4c1d-fa93-4d3d-b6e5-235473e1ae2a-marketplace-trusted-ca\") pod \"b05a4c1d-fa93-4d3d-b6e5-235473e1ae2a\" (UID: \"b05a4c1d-fa93-4d3d-b6e5-235473e1ae2a\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.762699 5120 status_manager.go:919] "Failed to update status for pod" pod="openshift-kube-controller-manager/kube-controller-manager-crc" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"3041be07-9bde-45b0-b1f5-f3354d72eb4c\\\"},\\\"status\\\":{\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T15:31:41Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T15:31:38Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T15:31:59Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T15:31:59Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T15:31:38Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"200Mi\\\"},\\\"containerID\\\":\\\"cri-o://a967ad0a608deaf189b263aa37305db49ec4582e4473cc85876c69611bf94859\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7c6a47106effd9e9a41131e2bf6c832b80cd77b3439334f760b35b0729f2fb00\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7c6a47106effd9e9a41131e2bf6c832b80cd77b3439334f760b35b0729f2fb00\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"cluster-policy-controller\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"200Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T15:31:40Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"},{\\\"mountPath\\\":\\\"/etc/pki/ca-trust/extracted/pem\\\",\\\"name\\\":\\\"ca-trust-dir\\\"},{\\\"mountPath\\\":\\\"/var/run/kubernetes\\\",\\\"name\\\":\\\"var-run-kubernetes\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"60m\\\",\\\"memory\\\":\\\"200Mi\\\"},\\\"containerID\\\":\\\"cri-o://7504f5643c014a761ba3788ec0c344d41885c45fe4371d4a1c8d206eb7462303\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-controller-manager\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"60m\\\",\\\"memory\\\":\\\"200Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T15:31:39Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://089b049fab9a81fee365aca65e87bbcba69fdb197579238170db8ea568e894e7\\\",\\\"image\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-controller-manager-operator@sha256:f69b9cc9b9cfde726109a9e12b80a3eefa472d7e29159df0fbc7143c48983cd6\\\",\\\"imageID\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-controller-manager-operator@sha256:f69b9cc9b9cfde726109a9e12b80a3eefa472d7e29159df0fbc7143c48983cd6\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-controller-manager-cert-syncer\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T15:31:40Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"},{\\\"mountPath\\\":\\\"/etc/pki/ca-trust/extracted/pem\\\",\\\"name\\\":\\\"ca-trust-dir\\\"},{\\\"mountPath\\\":\\\"/var/run/kubernetes\\\",\\\"name\\\":\\\"var-run-kubernetes\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://7b881cb757e8a98a2bfe4eaba13851ed363266c8ca4431adae747bcc7a432d6f\\\",\\\"image\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-controller-manager-operator@sha256:f69b9cc9b9cfde726109a9e12b80a3eefa472d7e29159df0fbc7143c48983cd6\\\",\\\"imageID\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-controller-manager-operator@sha256:f69b9cc9b9cfde726109a9e12b80a3eefa472d7e29159df0fbc7143c48983cd6\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-controller-manager-recovery-controller\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T15:31:40Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"},{\\\"mountPath\\\":\\\"/etc/pki/ca-trust/extracted/pem\\\",\\\"name\\\":\\\"ca-trust-dir\\\"},{\\\"mountPath\\\":\\\"/var/run/kubernetes\\\",\\\"name\\\":\\\"var-run-kubernetes\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"phase\\\":\\\"Running\\\",\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T15:31:38Z\\\"}}\" for pod \"openshift-kube-controller-manager\"/\"kube-controller-manager-crc\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.760173 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dcd10325-9ba5-4a3b-8e4a-e57e3bf210f9-config" (OuterVolumeSpecName: "config") pod "dcd10325-9ba5-4a3b-8e4a-e57e3bf210f9" (UID: "dcd10325-9ba5-4a3b-8e4a-e57e3bf210f9"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.760236 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d19cb085-0c5b-4810-b654-ce7923221d90-image-import-ca" (OuterVolumeSpecName: "image-import-ca") pod "d19cb085-0c5b-4810-b654-ce7923221d90" (UID: "d19cb085-0c5b-4810-b654-ce7923221d90"). InnerVolumeSpecName "image-import-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.760546 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/42a11a02-47e1-488f-b270-2679d3298b0e-control-plane-machine-set-operator-tls" (OuterVolumeSpecName: "control-plane-machine-set-operator-tls") pod "42a11a02-47e1-488f-b270-2679d3298b0e" (UID: "42a11a02-47e1-488f-b270-2679d3298b0e"). InnerVolumeSpecName "control-plane-machine-set-operator-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.760673 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c5f2bfad-70f6-4185-a3d9-81ce12720767-serving-cert" (OuterVolumeSpecName: "serving-cert") pod "c5f2bfad-70f6-4185-a3d9-81ce12720767" (UID: "c5f2bfad-70f6-4185-a3d9-81ce12720767"). InnerVolumeSpecName "serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.766342 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f71a554-e414-4bc3-96d2-674060397afe-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "9f71a554-e414-4bc3-96d2-674060397afe" (UID: "9f71a554-e414-4bc3-96d2-674060397afe"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.760678 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5f2bfad-70f6-4185-a3d9-81ce12720767-kube-api-access" (OuterVolumeSpecName: "kube-api-access") pod "c5f2bfad-70f6-4185-a3d9-81ce12720767" (UID: "c5f2bfad-70f6-4185-a3d9-81ce12720767"). InnerVolumeSpecName "kube-api-access". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.760914 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc85e424-18b2-4924-920b-bd291a8c4b01-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "cc85e424-18b2-4924-920b-bd291a8c4b01" (UID: "cc85e424-18b2-4924-920b-bd291a8c4b01"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.766405 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c491984c-7d4b-44aa-8c1e-d7974424fa47-machine-api-operator-tls" (OuterVolumeSpecName: "machine-api-operator-tls") pod "c491984c-7d4b-44aa-8c1e-d7974424fa47" (UID: "c491984c-7d4b-44aa-8c1e-d7974424fa47"). InnerVolumeSpecName "machine-api-operator-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.760907 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/869851b9-7ffb-4af0-b166-1d8aa40a5f80-whereabouts-flatfile-configmap" (OuterVolumeSpecName: "whereabouts-flatfile-configmap") pod "869851b9-7ffb-4af0-b166-1d8aa40a5f80" (UID: "869851b9-7ffb-4af0-b166-1d8aa40a5f80"). InnerVolumeSpecName "whereabouts-flatfile-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.761193 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f71a554-e414-4bc3-96d2-674060397afe-kube-api-access-ftwb6" (OuterVolumeSpecName: "kube-api-access-ftwb6") pod "9f71a554-e414-4bc3-96d2-674060397afe" (UID: "9f71a554-e414-4bc3-96d2-674060397afe"). InnerVolumeSpecName "kube-api-access-ftwb6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.761437 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6077b63e-53a2-4f96-9d56-1ce0324e4913-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "6077b63e-53a2-4f96-9d56-1ce0324e4913" (UID: "6077b63e-53a2-4f96-9d56-1ce0324e4913"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.761640 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7fcc6409-8a0f-44c3-89e7-5aecd7610f8a-profile-collector-cert" (OuterVolumeSpecName: "profile-collector-cert") pod "7fcc6409-8a0f-44c3-89e7-5aecd7610f8a" (UID: "7fcc6409-8a0f-44c3-89e7-5aecd7610f8a"). InnerVolumeSpecName "profile-collector-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.761748 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d565531a-ff86-4608-9d19-767de01ac31b-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "d565531a-ff86-4608-9d19-767de01ac31b" (UID: "d565531a-ff86-4608-9d19-767de01ac31b"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.761725 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7fcc6409-8a0f-44c3-89e7-5aecd7610f8a-tmpfs" (OuterVolumeSpecName: "tmpfs") pod "7fcc6409-8a0f-44c3-89e7-5aecd7610f8a" (UID: "7fcc6409-8a0f-44c3-89e7-5aecd7610f8a"). InnerVolumeSpecName "tmpfs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.761831 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dcd10325-9ba5-4a3b-8e4a-e57e3bf210f9-kube-api-access-5lcfw" (OuterVolumeSpecName: "kube-api-access-5lcfw") pod "dcd10325-9ba5-4a3b-8e4a-e57e3bf210f9" (UID: "dcd10325-9ba5-4a3b-8e4a-e57e3bf210f9"). InnerVolumeSpecName "kube-api-access-5lcfw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.762285 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1d2a42d-af1d-4054-9618-ab545e0ed8b7-kube-api-access-9z4sw" (OuterVolumeSpecName: "kube-api-access-9z4sw") pod "e1d2a42d-af1d-4054-9618-ab545e0ed8b7" (UID: "e1d2a42d-af1d-4054-9618-ab545e0ed8b7"). InnerVolumeSpecName "kube-api-access-9z4sw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.762286 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0dd0fbac-8c0d-4228-8faa-abbeedabf7db-webhook-certs" (OuterVolumeSpecName: "webhook-certs") pod "0dd0fbac-8c0d-4228-8faa-abbeedabf7db" (UID: "0dd0fbac-8c0d-4228-8faa-abbeedabf7db"). InnerVolumeSpecName "webhook-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.762444 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af33e427-6803-48c2-a76a-dd9deb7cbf9a-kube-api-access-z5rsr" (OuterVolumeSpecName: "kube-api-access-z5rsr") pod "af33e427-6803-48c2-a76a-dd9deb7cbf9a" (UID: "af33e427-6803-48c2-a76a-dd9deb7cbf9a"). InnerVolumeSpecName "kube-api-access-z5rsr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.762557 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7599e0b6-bddf-4def-b7f2-0b32206e8651-kube-api-access-ptkcf" (OuterVolumeSpecName: "kube-api-access-ptkcf") pod "7599e0b6-bddf-4def-b7f2-0b32206e8651" (UID: "7599e0b6-bddf-4def-b7f2-0b32206e8651"). InnerVolumeSpecName "kube-api-access-ptkcf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.762572 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18f80adb-c1c3-49ba-8ee4-932c851d3897-kube-api-access-wbmqg" (OuterVolumeSpecName: "kube-api-access-wbmqg") pod "18f80adb-c1c3-49ba-8ee4-932c851d3897" (UID: "18f80adb-c1c3-49ba-8ee4-932c851d3897"). InnerVolumeSpecName "kube-api-access-wbmqg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.762575 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/869851b9-7ffb-4af0-b166-1d8aa40a5f80-cni-binary-copy" (OuterVolumeSpecName: "cni-binary-copy") pod "869851b9-7ffb-4af0-b166-1d8aa40a5f80" (UID: "869851b9-7ffb-4af0-b166-1d8aa40a5f80"). InnerVolumeSpecName "cni-binary-copy". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.762792 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc8db2c7-859d-47b3-a900-2bd0c0b2973b-kube-api-access-hckvg" (OuterVolumeSpecName: "kube-api-access-hckvg") pod "fc8db2c7-859d-47b3-a900-2bd0c0b2973b" (UID: "fc8db2c7-859d-47b3-a900-2bd0c0b2973b"). InnerVolumeSpecName "kube-api-access-hckvg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.762812 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18f80adb-c1c3-49ba-8ee4-932c851d3897-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "18f80adb-c1c3-49ba-8ee4-932c851d3897" (UID: "18f80adb-c1c3-49ba-8ee4-932c851d3897"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.762915 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/584e1f4a-8205-47d7-8efb-3afc6017c4c9-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "584e1f4a-8205-47d7-8efb-3afc6017c4c9" (UID: "584e1f4a-8205-47d7-8efb-3afc6017c4c9"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.762907 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/20ce4d18-fe25-4696-ad7c-1bd2d6200a3e-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "20ce4d18-fe25-4696-ad7c-1bd2d6200a3e" (UID: "20ce4d18-fe25-4696-ad7c-1bd2d6200a3e"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.763077 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a555ff2e-0be6-46d5-897d-863bb92ae2b3-serving-cert" (OuterVolumeSpecName: "serving-cert") pod "a555ff2e-0be6-46d5-897d-863bb92ae2b3" (UID: "a555ff2e-0be6-46d5-897d-863bb92ae2b3"). InnerVolumeSpecName "serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.763187 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f65c0ac1-8bca-454d-a2e6-e35cb418beac-serving-cert" (OuterVolumeSpecName: "serving-cert") pod "f65c0ac1-8bca-454d-a2e6-e35cb418beac" (UID: "f65c0ac1-8bca-454d-a2e6-e35cb418beac"). InnerVolumeSpecName "serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.763320 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc85e424-18b2-4924-920b-bd291a8c4b01-kube-api-access-xfp5s" (OuterVolumeSpecName: "kube-api-access-xfp5s") pod "cc85e424-18b2-4924-920b-bd291a8c4b01" (UID: "cc85e424-18b2-4924-920b-bd291a8c4b01"). InnerVolumeSpecName "kube-api-access-xfp5s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.763640 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7df94c10-441d-4386-93a6-6730fb7bcde0-kube-api-access-nmmzf" (OuterVolumeSpecName: "kube-api-access-nmmzf") pod "7df94c10-441d-4386-93a6-6730fb7bcde0" (UID: "7df94c10-441d-4386-93a6-6730fb7bcde0"). InnerVolumeSpecName "kube-api-access-nmmzf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.763751 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18f80adb-c1c3-49ba-8ee4-932c851d3897-stats-auth" (OuterVolumeSpecName: "stats-auth") pod "18f80adb-c1c3-49ba-8ee4-932c851d3897" (UID: "18f80adb-c1c3-49ba-8ee4-932c851d3897"). InnerVolumeSpecName "stats-auth". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.763848 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0dd0fbac-8c0d-4228-8faa-abbeedabf7db-kube-api-access-q4smf" (OuterVolumeSpecName: "kube-api-access-q4smf") pod "0dd0fbac-8c0d-4228-8faa-abbeedabf7db" (UID: "0dd0fbac-8c0d-4228-8faa-abbeedabf7db"). InnerVolumeSpecName "kube-api-access-q4smf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.763872 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/301e1965-1754-483d-b6cc-bfae7038bbca-kube-api-access-7jjkz" (OuterVolumeSpecName: "kube-api-access-7jjkz") pod "301e1965-1754-483d-b6cc-bfae7038bbca" (UID: "301e1965-1754-483d-b6cc-bfae7038bbca"). InnerVolumeSpecName "kube-api-access-7jjkz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.763992 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20ce4d18-fe25-4696-ad7c-1bd2d6200a3e-kube-api-access-tkdh6" (OuterVolumeSpecName: "kube-api-access-tkdh6") pod "20ce4d18-fe25-4696-ad7c-1bd2d6200a3e" (UID: "20ce4d18-fe25-4696-ad7c-1bd2d6200a3e"). InnerVolumeSpecName "kube-api-access-tkdh6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.764185 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f559dfa3-3917-43a2-97f6-61ddfda10e93-encryption-config" (OuterVolumeSpecName: "encryption-config") pod "f559dfa3-3917-43a2-97f6-61ddfda10e93" (UID: "f559dfa3-3917-43a2-97f6-61ddfda10e93"). InnerVolumeSpecName "encryption-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.764240 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e9b5059-1b3e-4067-a63d-2952cbe863af-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.764017 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/16bdd140-dce1-464c-ab47-dd5798d1d256-serving-cert" (OuterVolumeSpecName: "serving-cert") pod "16bdd140-dce1-464c-ab47-dd5798d1d256" (UID: "16bdd140-dce1-464c-ab47-dd5798d1d256"). InnerVolumeSpecName "serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.764345 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d45be74c-0d98-4d18-90e4-f7ef1b6daaf7-tmp" (OuterVolumeSpecName: "tmp") pod "d45be74c-0d98-4d18-90e4-f7ef1b6daaf7" (UID: "d45be74c-0d98-4d18-90e4-f7ef1b6daaf7"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.764306 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc85e424-18b2-4924-920b-bd291a8c4b01-utilities" (OuterVolumeSpecName: "utilities") pod "cc85e424-18b2-4924-920b-bd291a8c4b01" (UID: "cc85e424-18b2-4924-920b-bd291a8c4b01"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.764773 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c491984c-7d4b-44aa-8c1e-d7974424fa47-config" (OuterVolumeSpecName: "config") pod "c491984c-7d4b-44aa-8c1e-d7974424fa47" (UID: "c491984c-7d4b-44aa-8c1e-d7974424fa47"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.764801 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7afa918d-be67-40a6-803c-d3b0ae99d815-kube-api-access" (OuterVolumeSpecName: "kube-api-access") pod "7afa918d-be67-40a6-803c-d3b0ae99d815" (UID: "7afa918d-be67-40a6-803c-d3b0ae99d815"). InnerVolumeSpecName "kube-api-access". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.764851 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/567683bd-0efc-4f21-b076-e28559628404-etcd-ca" (OuterVolumeSpecName: "etcd-ca") pod "567683bd-0efc-4f21-b076-e28559628404" (UID: "567683bd-0efc-4f21-b076-e28559628404"). InnerVolumeSpecName "etcd-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.765082 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/567683bd-0efc-4f21-b076-e28559628404-etcd-service-ca" (OuterVolumeSpecName: "etcd-service-ca") pod "567683bd-0efc-4f21-b076-e28559628404" (UID: "567683bd-0efc-4f21-b076-e28559628404"). InnerVolumeSpecName "etcd-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.765141 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f559dfa3-3917-43a2-97f6-61ddfda10e93-etcd-serving-ca" (OuterVolumeSpecName: "etcd-serving-ca") pod "f559dfa3-3917-43a2-97f6-61ddfda10e93" (UID: "f559dfa3-3917-43a2-97f6-61ddfda10e93"). InnerVolumeSpecName "etcd-serving-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.765037 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b05a4c1d-fa93-4d3d-b6e5-235473e1ae2a-marketplace-operator-metrics" (OuterVolumeSpecName: "marketplace-operator-metrics") pod "b05a4c1d-fa93-4d3d-b6e5-235473e1ae2a" (UID: "b05a4c1d-fa93-4d3d-b6e5-235473e1ae2a"). InnerVolumeSpecName "marketplace-operator-metrics". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.765626 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94a6e063-3d1a-4d44-875d-185291448c31-kube-api-access-4hb7m" (OuterVolumeSpecName: "kube-api-access-4hb7m") pod "94a6e063-3d1a-4d44-875d-185291448c31" (UID: "94a6e063-3d1a-4d44-875d-185291448c31"). InnerVolumeSpecName "kube-api-access-4hb7m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.765658 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/01080b46-74f1-4191-8755-5152a57b3b25-serving-cert" (OuterVolumeSpecName: "serving-cert") pod "01080b46-74f1-4191-8755-5152a57b3b25" (UID: "01080b46-74f1-4191-8755-5152a57b3b25"). InnerVolumeSpecName "serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.765805 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce090a97-9ab6-4c40-a719-64ff2acd9778-signing-key" (OuterVolumeSpecName: "signing-key") pod "ce090a97-9ab6-4c40-a719-64ff2acd9778" (UID: "ce090a97-9ab6-4c40-a719-64ff2acd9778"). InnerVolumeSpecName "signing-key". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.765938 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/567683bd-0efc-4f21-b076-e28559628404-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "567683bd-0efc-4f21-b076-e28559628404" (UID: "567683bd-0efc-4f21-b076-e28559628404"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.766189 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6077b63e-53a2-4f96-9d56-1ce0324e4913-kube-api-access-zth6t" (OuterVolumeSpecName: "kube-api-access-zth6t") pod "6077b63e-53a2-4f96-9d56-1ce0324e4913" (UID: "6077b63e-53a2-4f96-9d56-1ce0324e4913"). InnerVolumeSpecName "kube-api-access-zth6t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.766241 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ebfebf6-3ecd-458e-943f-bb25b52e2718-kube-api-access-l87hs" (OuterVolumeSpecName: "kube-api-access-l87hs") pod "5ebfebf6-3ecd-458e-943f-bb25b52e2718" (UID: "5ebfebf6-3ecd-458e-943f-bb25b52e2718"). InnerVolumeSpecName "kube-api-access-l87hs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.766421 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42a11a02-47e1-488f-b270-2679d3298b0e-kube-api-access-qgrkj" (OuterVolumeSpecName: "kube-api-access-qgrkj") pod "42a11a02-47e1-488f-b270-2679d3298b0e" (UID: "42a11a02-47e1-488f-b270-2679d3298b0e"). InnerVolumeSpecName "kube-api-access-qgrkj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.766523 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/81e39f7b-62e4-4fc9-992a-6535ce127a02-cni-binary-copy" (OuterVolumeSpecName: "cni-binary-copy") pod "81e39f7b-62e4-4fc9-992a-6535ce127a02" (UID: "81e39f7b-62e4-4fc9-992a-6535ce127a02"). InnerVolumeSpecName "cni-binary-copy". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.766811 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d19cb085-0c5b-4810-b654-ce7923221d90-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "d19cb085-0c5b-4810-b654-ce7923221d90" (UID: "d19cb085-0c5b-4810-b654-ce7923221d90"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.767275 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c5f2bfad-70f6-4185-a3d9-81ce12720767-config" (OuterVolumeSpecName: "config") pod "c5f2bfad-70f6-4185-a3d9-81ce12720767" (UID: "c5f2bfad-70f6-4185-a3d9-81ce12720767"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.767355 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7599e0b6-bddf-4def-b7f2-0b32206e8651-serving-cert" (OuterVolumeSpecName: "serving-cert") pod "7599e0b6-bddf-4def-b7f2-0b32206e8651" (UID: "7599e0b6-bddf-4def-b7f2-0b32206e8651"). InnerVolumeSpecName "serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.767367 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e9b5059-1b3e-4067-a63d-2952cbe863af-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.767495 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/af33e427-6803-48c2-a76a-dd9deb7cbf9a-env-overrides" (OuterVolumeSpecName: "env-overrides") pod "af33e427-6803-48c2-a76a-dd9deb7cbf9a" (UID: "af33e427-6803-48c2-a76a-dd9deb7cbf9a"). InnerVolumeSpecName "env-overrides". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.767849 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/567683bd-0efc-4f21-b076-e28559628404-serving-cert" (OuterVolumeSpecName: "serving-cert") pod "567683bd-0efc-4f21-b076-e28559628404" (UID: "567683bd-0efc-4f21-b076-e28559628404"). InnerVolumeSpecName "serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.767874 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d7e8f42f-dc0e-424b-bb56-5ec849834888-serving-cert" (OuterVolumeSpecName: "serving-cert") pod "d7e8f42f-dc0e-424b-bb56-5ec849834888" (UID: "d7e8f42f-dc0e-424b-bb56-5ec849834888"). InnerVolumeSpecName "serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.767895 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e9b5059-1b3e-4067-a63d-2952cbe863af-kube-api-access-ws8zz" (OuterVolumeSpecName: "kube-api-access-ws8zz") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af"). InnerVolumeSpecName "kube-api-access-ws8zz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.767926 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b05a4c1d-fa93-4d3d-b6e5-235473e1ae2a-kube-api-access-qqbfk" (OuterVolumeSpecName: "kube-api-access-qqbfk") pod "b05a4c1d-fa93-4d3d-b6e5-235473e1ae2a" (UID: "b05a4c1d-fa93-4d3d-b6e5-235473e1ae2a"). InnerVolumeSpecName "kube-api-access-qqbfk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.767942 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7e2c886-118e-43bb-bef1-c78134de392b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f7e2c886-118e-43bb-bef1-c78134de392b" (UID: "f7e2c886-118e-43bb-bef1-c78134de392b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.767573 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6edfcf45-925b-4eff-b940-95b6fc0b85d4-v4-0-config-system-ocp-branding-template" (OuterVolumeSpecName: "v4-0-config-system-ocp-branding-template") pod "6edfcf45-925b-4eff-b940-95b6fc0b85d4" (UID: "6edfcf45-925b-4eff-b940-95b6fc0b85d4"). InnerVolumeSpecName "v4-0-config-system-ocp-branding-template". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.768379 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f65c0ac1-8bca-454d-a2e6-e35cb418beac-config" (OuterVolumeSpecName: "config") pod "f65c0ac1-8bca-454d-a2e6-e35cb418beac" (UID: "f65c0ac1-8bca-454d-a2e6-e35cb418beac"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.768473 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f65c0ac1-8bca-454d-a2e6-e35cb418beac-kube-api-access" (OuterVolumeSpecName: "kube-api-access") pod "f65c0ac1-8bca-454d-a2e6-e35cb418beac" (UID: "f65c0ac1-8bca-454d-a2e6-e35cb418beac"). InnerVolumeSpecName "kube-api-access". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.768572 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e1d2a42d-af1d-4054-9618-ab545e0ed8b7-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "e1d2a42d-af1d-4054-9618-ab545e0ed8b7" (UID: "e1d2a42d-af1d-4054-9618-ab545e0ed8b7"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.769008 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca" (UID: "6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.769136 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2325ffef-9d5b-447f-b00e-3efc429acefe-kube-api-access-zg8nc" (OuterVolumeSpecName: "kube-api-access-zg8nc") pod "2325ffef-9d5b-447f-b00e-3efc429acefe" (UID: "2325ffef-9d5b-447f-b00e-3efc429acefe"). InnerVolumeSpecName "kube-api-access-zg8nc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.769151 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b4750666-1362-4001-abd0-6f89964cc621-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "b4750666-1362-4001-abd0-6f89964cc621" (UID: "b4750666-1362-4001-abd0-6f89964cc621"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.769353 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d565531a-ff86-4608-9d19-767de01ac31b-images" (OuterVolumeSpecName: "images") pod "d565531a-ff86-4608-9d19-767de01ac31b" (UID: "d565531a-ff86-4608-9d19-767de01ac31b"). InnerVolumeSpecName "images". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.769151 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d19cb085-0c5b-4810-b654-ce7923221d90-etcd-serving-ca" (OuterVolumeSpecName: "etcd-serving-ca") pod "d19cb085-0c5b-4810-b654-ce7923221d90" (UID: "d19cb085-0c5b-4810-b654-ce7923221d90"). InnerVolumeSpecName "etcd-serving-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.769202 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d565531a-ff86-4608-9d19-767de01ac31b-kube-api-access-99zj9" (OuterVolumeSpecName: "kube-api-access-99zj9") pod "d565531a-ff86-4608-9d19-767de01ac31b" (UID: "d565531a-ff86-4608-9d19-767de01ac31b"). InnerVolumeSpecName "kube-api-access-99zj9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.769677 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7fcc6409-8a0f-44c3-89e7-5aecd7610f8a-kube-api-access-ddlk9" (OuterVolumeSpecName: "kube-api-access-ddlk9") pod "7fcc6409-8a0f-44c3-89e7-5aecd7610f8a" (UID: "7fcc6409-8a0f-44c3-89e7-5aecd7610f8a"). InnerVolumeSpecName "kube-api-access-ddlk9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.769693 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a555ff2e-0be6-46d5-897d-863bb92ae2b3-client-ca" (OuterVolumeSpecName: "client-ca") pod "a555ff2e-0be6-46d5-897d-863bb92ae2b3" (UID: "a555ff2e-0be6-46d5-897d-863bb92ae2b3"). InnerVolumeSpecName "client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.769879 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2325ffef-9d5b-447f-b00e-3efc429acefe-serving-cert" (OuterVolumeSpecName: "serving-cert") pod "2325ffef-9d5b-447f-b00e-3efc429acefe" (UID: "2325ffef-9d5b-447f-b00e-3efc429acefe"). InnerVolumeSpecName "serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.770246 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc8db2c7-859d-47b3-a900-2bd0c0b2973b-auth-proxy-config" (OuterVolumeSpecName: "auth-proxy-config") pod "fc8db2c7-859d-47b3-a900-2bd0c0b2973b" (UID: "fc8db2c7-859d-47b3-a900-2bd0c0b2973b"). InnerVolumeSpecName "auth-proxy-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.770262 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca" (UID: "6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.770288 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f559dfa3-3917-43a2-97f6-61ddfda10e93-audit-policies" (OuterVolumeSpecName: "audit-policies") pod "f559dfa3-3917-43a2-97f6-61ddfda10e93" (UID: "f559dfa3-3917-43a2-97f6-61ddfda10e93"). InnerVolumeSpecName "audit-policies". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.770374 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e9b5059-1b3e-4067-a63d-2952cbe863af-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.770295 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b4750666-1362-4001-abd0-6f89964cc621-mcc-auth-proxy-config" (OuterVolumeSpecName: "mcc-auth-proxy-config") pod "b4750666-1362-4001-abd0-6f89964cc621" (UID: "b4750666-1362-4001-abd0-6f89964cc621"). InnerVolumeSpecName "mcc-auth-proxy-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.770440 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6edfcf45-925b-4eff-b940-95b6fc0b85d4-v4-0-config-system-service-ca" (OuterVolumeSpecName: "v4-0-config-system-service-ca") pod "6edfcf45-925b-4eff-b940-95b6fc0b85d4" (UID: "6edfcf45-925b-4eff-b940-95b6fc0b85d4"). InnerVolumeSpecName "v4-0-config-system-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.771026 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c491984c-7d4b-44aa-8c1e-d7974424fa47-images" (OuterVolumeSpecName: "images") pod "c491984c-7d4b-44aa-8c1e-d7974424fa47" (UID: "c491984c-7d4b-44aa-8c1e-d7974424fa47"). InnerVolumeSpecName "images". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.771091 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a555ff2e-0be6-46d5-897d-863bb92ae2b3-proxy-ca-bundles" (OuterVolumeSpecName: "proxy-ca-bundles") pod "a555ff2e-0be6-46d5-897d-863bb92ae2b3" (UID: "a555ff2e-0be6-46d5-897d-863bb92ae2b3"). InnerVolumeSpecName "proxy-ca-bundles". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.771189 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a52afe44-fb37-46ed-a1f8-bf39727a3cbe-kube-api-access-rzt4w" (OuterVolumeSpecName: "kube-api-access-rzt4w") pod "a52afe44-fb37-46ed-a1f8-bf39727a3cbe" (UID: "a52afe44-fb37-46ed-a1f8-bf39727a3cbe"). InnerVolumeSpecName "kube-api-access-rzt4w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.772359 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e9b5059-1b3e-4067-a63d-2952cbe863af-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.772368 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6edfcf45-925b-4eff-b940-95b6fc0b85d4-v4-0-config-user-template-login" (OuterVolumeSpecName: "v4-0-config-user-template-login") pod "6edfcf45-925b-4eff-b940-95b6fc0b85d4" (UID: "6edfcf45-925b-4eff-b940-95b6fc0b85d4"). InnerVolumeSpecName "v4-0-config-user-template-login". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.772403 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/869851b9-7ffb-4af0-b166-1d8aa40a5f80-cni-sysctl-allowlist" (OuterVolumeSpecName: "cni-sysctl-allowlist") pod "869851b9-7ffb-4af0-b166-1d8aa40a5f80" (UID: "869851b9-7ffb-4af0-b166-1d8aa40a5f80"). InnerVolumeSpecName "cni-sysctl-allowlist". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.772468 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5f2bfad-70f6-4185-a3d9-81ce12720767-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c5f2bfad-70f6-4185-a3d9-81ce12720767" (UID: "c5f2bfad-70f6-4185-a3d9-81ce12720767"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.772483 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6edfcf45-925b-4eff-b940-95b6fc0b85d4-v4-0-config-user-template-provider-selection" (OuterVolumeSpecName: "v4-0-config-user-template-provider-selection") pod "6edfcf45-925b-4eff-b940-95b6fc0b85d4" (UID: "6edfcf45-925b-4eff-b940-95b6fc0b85d4"). InnerVolumeSpecName "v4-0-config-user-template-provider-selection". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.772662 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f65c0ac1-8bca-454d-a2e6-e35cb418beac-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f65c0ac1-8bca-454d-a2e6-e35cb418beac" (UID: "f65c0ac1-8bca-454d-a2e6-e35cb418beac"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.772811 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/567683bd-0efc-4f21-b076-e28559628404-etcd-client" (OuterVolumeSpecName: "etcd-client") pod "567683bd-0efc-4f21-b076-e28559628404" (UID: "567683bd-0efc-4f21-b076-e28559628404"). InnerVolumeSpecName "etcd-client". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.772910 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/301e1965-1754-483d-b6cc-bfae7038bbca-profile-collector-cert" (OuterVolumeSpecName: "profile-collector-cert") pod "301e1965-1754-483d-b6cc-bfae7038bbca" (UID: "301e1965-1754-483d-b6cc-bfae7038bbca"). InnerVolumeSpecName "profile-collector-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.772923 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a208c9c2-333b-4b4a-be0d-bc32ec38a821-package-server-manager-serving-cert" (OuterVolumeSpecName: "package-server-manager-serving-cert") pod "a208c9c2-333b-4b4a-be0d-bc32ec38a821" (UID: "a208c9c2-333b-4b4a-be0d-bc32ec38a821"). InnerVolumeSpecName "package-server-manager-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.773235 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7afa918d-be67-40a6-803c-d3b0ae99d815-serving-cert" (OuterVolumeSpecName: "serving-cert") pod "7afa918d-be67-40a6-803c-d3b0ae99d815" (UID: "7afa918d-be67-40a6-803c-d3b0ae99d815"). InnerVolumeSpecName "serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.773359 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/149b3c48-e17c-4a66-a835-d86dabf6ff13-kube-api-access-wj4qr" (OuterVolumeSpecName: "kube-api-access-wj4qr") pod "149b3c48-e17c-4a66-a835-d86dabf6ff13" (UID: "149b3c48-e17c-4a66-a835-d86dabf6ff13"). InnerVolumeSpecName "kube-api-access-wj4qr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.773617 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/593a3561-7760-45c5-8f91-5aaef7475d0f-node-bootstrap-token" (OuterVolumeSpecName: "node-bootstrap-token") pod "593a3561-7760-45c5-8f91-5aaef7475d0f" (UID: "593a3561-7760-45c5-8f91-5aaef7475d0f"). InnerVolumeSpecName "node-bootstrap-token". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.765818 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f7e2c886-118e-43bb-bef1-c78134de392b-tmp-dir\") pod \"f7e2c886-118e-43bb-bef1-c78134de392b\" (UID: \"f7e2c886-118e-43bb-bef1-c78134de392b\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.773667 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"v4-0-config-user-template-error\" (UniqueName: \"kubernetes.io/secret/6edfcf45-925b-4eff-b940-95b6fc0b85d4-v4-0-config-user-template-error\") pod \"6edfcf45-925b-4eff-b940-95b6fc0b85d4\" (UID: \"6edfcf45-925b-4eff-b940-95b6fc0b85d4\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.773725 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/d565531a-ff86-4608-9d19-767de01ac31b-auth-proxy-config\") pod \"d565531a-ff86-4608-9d19-767de01ac31b\" (UID: \"d565531a-ff86-4608-9d19-767de01ac31b\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.773747 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w94wk\" (UniqueName: \"kubernetes.io/projected/01080b46-74f1-4191-8755-5152a57b3b25-kube-api-access-w94wk\") pod \"01080b46-74f1-4191-8755-5152a57b3b25\" (UID: \"01080b46-74f1-4191-8755-5152a57b3b25\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.773789 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/b605f283-6f2e-42da-a838-54421690f7d0-utilities\") pod \"b605f283-6f2e-42da-a838-54421690f7d0\" (UID: \"b605f283-6f2e-42da-a838-54421690f7d0\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.773855 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94a6e063-3d1a-4d44-875d-185291448c31-utilities" (OuterVolumeSpecName: "utilities") pod "94a6e063-3d1a-4d44-875d-185291448c31" (UID: "94a6e063-3d1a-4d44-875d-185291448c31"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.773907 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7df94c10-441d-4386-93a6-6730fb7bcde0-ovnkube-config" (OuterVolumeSpecName: "ovnkube-config") pod "7df94c10-441d-4386-93a6-6730fb7bcde0" (UID: "7df94c10-441d-4386-93a6-6730fb7bcde0"). InnerVolumeSpecName "ovnkube-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.774006 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d19cb085-0c5b-4810-b654-ce7923221d90-kube-api-access-m5lgh" (OuterVolumeSpecName: "kube-api-access-m5lgh") pod "d19cb085-0c5b-4810-b654-ce7923221d90" (UID: "d19cb085-0c5b-4810-b654-ce7923221d90"). InnerVolumeSpecName "kube-api-access-m5lgh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.774090 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/567683bd-0efc-4f21-b076-e28559628404-kube-api-access-m26jq" (OuterVolumeSpecName: "kube-api-access-m26jq") pod "567683bd-0efc-4f21-b076-e28559628404" (UID: "567683bd-0efc-4f21-b076-e28559628404"). InnerVolumeSpecName "kube-api-access-m26jq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.774403 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.774554 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9f71a554-e414-4bc3-96d2-674060397afe-trusted-ca\") pod \"9f71a554-e414-4bc3-96d2-674060397afe\" (UID: \"9f71a554-e414-4bc3-96d2-674060397afe\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.774564 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca-kube-api-access-l9stx" (OuterVolumeSpecName: "kube-api-access-l9stx") pod "6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca" (UID: "6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca"). InnerVolumeSpecName "kube-api-access-l9stx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.774583 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a52afe44-fb37-46ed-a1f8-bf39727a3cbe-cert\") pod \"a52afe44-fb37-46ed-a1f8-bf39727a3cbe\" (UID: \"a52afe44-fb37-46ed-a1f8-bf39727a3cbe\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.774607 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"srv-cert\" (UniqueName: \"kubernetes.io/secret/7fcc6409-8a0f-44c3-89e7-5aecd7610f8a-srv-cert\") pod \"7fcc6409-8a0f-44c3-89e7-5aecd7610f8a\" (UID: \"7fcc6409-8a0f-44c3-89e7-5aecd7610f8a\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.774629 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/736c54fe-349c-4bb9-870a-d1c1d1c03831-config\") pod \"736c54fe-349c-4bb9-870a-d1c1d1c03831\" (UID: \"736c54fe-349c-4bb9-870a-d1c1d1c03831\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.774654 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/01080b46-74f1-4191-8755-5152a57b3b25-config\") pod \"01080b46-74f1-4191-8755-5152a57b3b25\" (UID: \"01080b46-74f1-4191-8755-5152a57b3b25\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.774678 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca-console-serving-cert\") pod \"6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca\" (UID: \"6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.774668 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6077b63e-53a2-4f96-9d56-1ce0324e4913-metrics-tls" (OuterVolumeSpecName: "metrics-tls") pod "6077b63e-53a2-4f96-9d56-1ce0324e4913" (UID: "6077b63e-53a2-4f96-9d56-1ce0324e4913"). InnerVolumeSpecName "metrics-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: E0316 15:33:21.774699 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 15:33:22.274675948 +0000 UTC m=+104.428607605 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.774769 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f559dfa3-3917-43a2-97f6-61ddfda10e93-trusted-ca-bundle\") pod \"f559dfa3-3917-43a2-97f6-61ddfda10e93\" (UID: \"f559dfa3-3917-43a2-97f6-61ddfda10e93\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.774797 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"available-featuregates\" (UniqueName: \"kubernetes.io/empty-dir/16bdd140-dce1-464c-ab47-dd5798d1d256-available-featuregates\") pod \"16bdd140-dce1-464c-ab47-dd5798d1d256\" (UID: \"16bdd140-dce1-464c-ab47-dd5798d1d256\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.774826 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/81e39f7b-62e4-4fc9-992a-6535ce127a02-multus-daemon-config\") pod \"81e39f7b-62e4-4fc9-992a-6535ce127a02\" (UID: \"81e39f7b-62e4-4fc9-992a-6535ce127a02\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.774830 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d19cb085-0c5b-4810-b654-ce7923221d90-config" (OuterVolumeSpecName: "config") pod "d19cb085-0c5b-4810-b654-ce7923221d90" (UID: "d19cb085-0c5b-4810-b654-ce7923221d90"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.774853 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"mcd-auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/e1d2a42d-af1d-4054-9618-ab545e0ed8b7-mcd-auth-proxy-config\") pod \"e1d2a42d-af1d-4054-9618-ab545e0ed8b7\" (UID: \"e1d2a42d-af1d-4054-9618-ab545e0ed8b7\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.774884 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"machine-approver-tls\" (UniqueName: \"kubernetes.io/secret/fc8db2c7-859d-47b3-a900-2bd0c0b2973b-machine-approver-tls\") pod \"fc8db2c7-859d-47b3-a900-2bd0c0b2973b\" (UID: \"fc8db2c7-859d-47b3-a900-2bd0c0b2973b\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.774913 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/9276f8f5-2f24-48e1-ab6d-1aab0d8ec3ff-utilities\") pod \"9276f8f5-2f24-48e1-ab6d-1aab0d8ec3ff\" (UID: \"9276f8f5-2f24-48e1-ab6d-1aab0d8ec3ff\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.774939 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"audit-policies\" (UniqueName: \"kubernetes.io/configmap/6edfcf45-925b-4eff-b940-95b6fc0b85d4-audit-policies\") pod \"6edfcf45-925b-4eff-b940-95b6fc0b85d4\" (UID: \"6edfcf45-925b-4eff-b940-95b6fc0b85d4\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.774966 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4g8ts\" (UniqueName: \"kubernetes.io/projected/92dfbade-90b6-4169-8c07-72cff7f2c82b-kube-api-access-4g8ts\") pod \"92dfbade-90b6-4169-8c07-72cff7f2c82b\" (UID: \"92dfbade-90b6-4169-8c07-72cff7f2c82b\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.774989 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/736c54fe-349c-4bb9-870a-d1c1d1c03831-client-ca\") pod \"736c54fe-349c-4bb9-870a-d1c1d1c03831\" (UID: \"736c54fe-349c-4bb9-870a-d1c1d1c03831\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.775013 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d7e8f42f-dc0e-424b-bb56-5ec849834888-service-ca\") pod \"d7e8f42f-dc0e-424b-bb56-5ec849834888\" (UID: \"d7e8f42f-dc0e-424b-bb56-5ec849834888\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.775039 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8nspp\" (UniqueName: \"kubernetes.io/projected/a7a88189-c967-4640-879e-27665747f20c-kube-api-access-8nspp\") pod \"a7a88189-c967-4640-879e-27665747f20c\" (UID: \"a7a88189-c967-4640-879e-27665747f20c\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.775064 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted-pem\" (UniqueName: \"kubernetes.io/empty-dir/20ce4d18-fe25-4696-ad7c-1bd2d6200a3e-ca-trust-extracted-pem\") pod \"20ce4d18-fe25-4696-ad7c-1bd2d6200a3e\" (UID: \"20ce4d18-fe25-4696-ad7c-1bd2d6200a3e\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.775082 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7fcc6409-8a0f-44c3-89e7-5aecd7610f8a-srv-cert" (OuterVolumeSpecName: "srv-cert") pod "7fcc6409-8a0f-44c3-89e7-5aecd7610f8a" (UID: "7fcc6409-8a0f-44c3-89e7-5aecd7610f8a"). InnerVolumeSpecName "srv-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.775087 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b05a4c1d-fa93-4d3d-b6e5-235473e1ae2a-tmp\") pod \"b05a4c1d-fa93-4d3d-b6e5-235473e1ae2a\" (UID: \"b05a4c1d-fa93-4d3d-b6e5-235473e1ae2a\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.775127 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xxfcv\" (UniqueName: \"kubernetes.io/projected/9276f8f5-2f24-48e1-ab6d-1aab0d8ec3ff-kube-api-access-xxfcv\") pod \"9276f8f5-2f24-48e1-ab6d-1aab0d8ec3ff\" (UID: \"9276f8f5-2f24-48e1-ab6d-1aab0d8ec3ff\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.775152 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/18f80adb-c1c3-49ba-8ee4-932c851d3897-default-certificate\") pod \"18f80adb-c1c3-49ba-8ee4-932c851d3897\" (UID: \"18f80adb-c1c3-49ba-8ee4-932c851d3897\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.775190 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/dcd10325-9ba5-4a3b-8e4a-e57e3bf210f9-serving-cert\") pod \"dcd10325-9ba5-4a3b-8e4a-e57e3bf210f9\" (UID: \"dcd10325-9ba5-4a3b-8e4a-e57e3bf210f9\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.775220 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6dmhf\" (UniqueName: \"kubernetes.io/projected/736c54fe-349c-4bb9-870a-d1c1d1c03831-kube-api-access-6dmhf\") pod \"736c54fe-349c-4bb9-870a-d1c1d1c03831\" (UID: \"736c54fe-349c-4bb9-870a-d1c1d1c03831\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.775242 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6rmnv\" (UniqueName: \"kubernetes.io/projected/b605f283-6f2e-42da-a838-54421690f7d0-kube-api-access-6rmnv\") pod \"b605f283-6f2e-42da-a838-54421690f7d0\" (UID: \"b605f283-6f2e-42da-a838-54421690f7d0\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.775265 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"v4-0-config-system-router-certs\" (UniqueName: \"kubernetes.io/secret/6edfcf45-925b-4eff-b940-95b6fc0b85d4-v4-0-config-system-router-certs\") pod \"6edfcf45-925b-4eff-b940-95b6fc0b85d4\" (UID: \"6edfcf45-925b-4eff-b940-95b6fc0b85d4\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.775286 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a7a88189-c967-4640-879e-27665747f20c-webhook-cert\") pod \"a7a88189-c967-4640-879e-27665747f20c\" (UID: \"a7a88189-c967-4640-879e-27665747f20c\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.775376 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fc8db2c7-859d-47b3-a900-2bd0c0b2973b-config\") pod \"fc8db2c7-859d-47b3-a900-2bd0c0b2973b\" (UID: \"fc8db2c7-859d-47b3-a900-2bd0c0b2973b\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.775396 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pddnv\" (UniqueName: \"kubernetes.io/projected/e093be35-bb62-4843-b2e8-094545761610-kube-api-access-pddnv\") pod \"e093be35-bb62-4843-b2e8-094545761610\" (UID: \"e093be35-bb62-4843-b2e8-094545761610\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.775414 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dcd10325-9ba5-4a3b-8e4a-e57e3bf210f9-trusted-ca-bundle\") pod \"dcd10325-9ba5-4a3b-8e4a-e57e3bf210f9\" (UID: \"dcd10325-9ba5-4a3b-8e4a-e57e3bf210f9\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.775430 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/20ce4d18-fe25-4696-ad7c-1bd2d6200a3e-bound-sa-token\") pod \"20ce4d18-fe25-4696-ad7c-1bd2d6200a3e\" (UID: \"20ce4d18-fe25-4696-ad7c-1bd2d6200a3e\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.775447 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"srv-cert\" (UniqueName: \"kubernetes.io/secret/301e1965-1754-483d-b6cc-bfae7038bbca-srv-cert\") pod \"301e1965-1754-483d-b6cc-bfae7038bbca\" (UID: \"301e1965-1754-483d-b6cc-bfae7038bbca\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.775465 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9vsz9\" (UniqueName: \"kubernetes.io/projected/c491984c-7d4b-44aa-8c1e-d7974424fa47-kube-api-access-9vsz9\") pod \"c491984c-7d4b-44aa-8c1e-d7974424fa47\" (UID: \"c491984c-7d4b-44aa-8c1e-d7974424fa47\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.775483 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d45be74c-0d98-4d18-90e4-f7ef1b6daaf7-serving-cert\") pod \"d45be74c-0d98-4d18-90e4-f7ef1b6daaf7\" (UID: \"d45be74c-0d98-4d18-90e4-f7ef1b6daaf7\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.775486 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f71a554-e414-4bc3-96d2-674060397afe-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "9f71a554-e414-4bc3-96d2-674060397afe" (UID: "9f71a554-e414-4bc3-96d2-674060397afe"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.775500 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pgx6b\" (UniqueName: \"kubernetes.io/projected/f7648cbb-48eb-4ba8-87ec-eb096b8fa1e4-kube-api-access-pgx6b\") pod \"f7648cbb-48eb-4ba8-87ec-eb096b8fa1e4\" (UID: \"f7648cbb-48eb-4ba8-87ec-eb096b8fa1e4\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.775518 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/b605f283-6f2e-42da-a838-54421690f7d0-catalog-content\") pod \"b605f283-6f2e-42da-a838-54421690f7d0\" (UID: \"b605f283-6f2e-42da-a838-54421690f7d0\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.775536 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovn-control-plane-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7df94c10-441d-4386-93a6-6730fb7bcde0-ovn-control-plane-metrics-cert\") pod \"7df94c10-441d-4386-93a6-6730fb7bcde0\" (UID: \"7df94c10-441d-4386-93a6-6730fb7bcde0\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.775553 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a7a88189-c967-4640-879e-27665747f20c-apiservice-cert\") pod \"a7a88189-c967-4640-879e-27665747f20c\" (UID: \"a7a88189-c967-4640-879e-27665747f20c\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.775569 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/20ce4d18-fe25-4696-ad7c-1bd2d6200a3e-tmp\") pod \"20ce4d18-fe25-4696-ad7c-1bd2d6200a3e\" (UID: \"20ce4d18-fe25-4696-ad7c-1bd2d6200a3e\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.775584 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"audit\" (UniqueName: \"kubernetes.io/configmap/d19cb085-0c5b-4810-b654-ce7923221d90-audit\") pod \"d19cb085-0c5b-4810-b654-ce7923221d90\" (UID: \"d19cb085-0c5b-4810-b654-ce7923221d90\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.775600 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f559dfa3-3917-43a2-97f6-61ddfda10e93-serving-cert\") pod \"f559dfa3-3917-43a2-97f6-61ddfda10e93\" (UID: \"f559dfa3-3917-43a2-97f6-61ddfda10e93\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.775618 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-operator-tls\" (UniqueName: \"kubernetes.io/secret/20ce4d18-fe25-4696-ad7c-1bd2d6200a3e-image-registry-operator-tls\") pod \"20ce4d18-fe25-4696-ad7c-1bd2d6200a3e\" (UID: \"20ce4d18-fe25-4696-ad7c-1bd2d6200a3e\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.775635 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hm9x7\" (UniqueName: \"kubernetes.io/projected/f559dfa3-3917-43a2-97f6-61ddfda10e93-kube-api-access-hm9x7\") pod \"f559dfa3-3917-43a2-97f6-61ddfda10e93\" (UID: \"f559dfa3-3917-43a2-97f6-61ddfda10e93\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.775657 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"v4-0-config-system-serving-cert\" (UniqueName: \"kubernetes.io/secret/6edfcf45-925b-4eff-b940-95b6fc0b85d4-v4-0-config-system-serving-cert\") pod \"6edfcf45-925b-4eff-b940-95b6fc0b85d4\" (UID: \"6edfcf45-925b-4eff-b940-95b6fc0b85d4\") " Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.775734 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8nt2j\" (UniqueName: \"kubernetes.io/projected/fc4541ce-7789-4670-bc75-5c2868e52ce0-kube-api-access-8nt2j\") pod \"network-node-identity-dgvkt\" (UID: \"fc4541ce-7789-4670-bc75-5c2868e52ce0\") " pod="openshift-network-node-identity/network-node-identity-dgvkt" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.775771 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6a9ae5f6-97bd-46ac-bafa-ca1b4452a141-nginx-conf\") pod \"networking-console-plugin-5ff7774fd9-nljh6\" (UID: \"6a9ae5f6-97bd-46ac-bafa-ca1b4452a141\") " pod="openshift-network-console/networking-console-plugin-5ff7774fd9-nljh6" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.775792 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l7w75\" (UniqueName: \"kubernetes.io/projected/f863fff9-286a-45fa-b8f0-8a86994b8440-kube-api-access-l7w75\") pod \"network-check-source-5bb8f5cd97-xdvz5\" (UID: \"f863fff9-286a-45fa-b8f0-8a86994b8440\") " pod="openshift-network-diagnostics/network-check-source-5bb8f5cd97-xdvz5" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.775813 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e2275cb4-4905-4d66-a87e-8010120db2bd-proxy-tls\") pod \"machine-config-daemon-7bf76\" (UID: \"e2275cb4-4905-4d66-a87e-8010120db2bd\") " pod="openshift-machine-config-operator/machine-config-daemon-7bf76" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.775836 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/fc4541ce-7789-4670-bc75-5c2868e52ce0-env-overrides\") pod \"network-node-identity-dgvkt\" (UID: \"fc4541ce-7789-4670-bc75-5c2868e52ce0\") " pod="openshift-network-node-identity/network-node-identity-dgvkt" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.775855 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2b62d686-4b05-42c7-b806-9e2caf8c34e8-system-cni-dir\") pod \"multus-additional-cni-plugins-qqjfh\" (UID: \"2b62d686-4b05-42c7-b806-9e2caf8c34e8\") " pod="openshift-multus/multus-additional-cni-plugins-qqjfh" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.775871 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2b62d686-4b05-42c7-b806-9e2caf8c34e8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qqjfh\" (UID: \"2b62d686-4b05-42c7-b806-9e2caf8c34e8\") " pod="openshift-multus/multus-additional-cni-plugins-qqjfh" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.775888 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1ba0f093-ad5c-4a99-bfc2-8439162d5b72-host-slash\") pod \"ovnkube-node-zwk29\" (UID: \"1ba0f093-ad5c-4a99-bfc2-8439162d5b72\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwk29" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.775903 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1ba0f093-ad5c-4a99-bfc2-8439162d5b72-ovnkube-script-lib\") pod \"ovnkube-node-zwk29\" (UID: \"1ba0f093-ad5c-4a99-bfc2-8439162d5b72\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwk29" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.775919 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8e29c57a-87ae-4f7a-82f5-867e05ccf280-ovnkube-config\") pod \"ovnkube-control-plane-57b78d8988-hbs9k\" (UID: \"8e29c57a-87ae-4f7a-82f5-867e05ccf280\") " pod="openshift-ovn-kubernetes/ovnkube-control-plane-57b78d8988-hbs9k" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.775935 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1ba0f093-ad5c-4a99-bfc2-8439162d5b72-run-openvswitch\") pod \"ovnkube-node-zwk29\" (UID: \"1ba0f093-ad5c-4a99-bfc2-8439162d5b72\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwk29" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.775955 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1ba0f093-ad5c-4a99-bfc2-8439162d5b72-host-run-netns\") pod \"ovnkube-node-zwk29\" (UID: \"1ba0f093-ad5c-4a99-bfc2-8439162d5b72\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwk29" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.776449 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/236824b8-2653-4916-ae64-5ff75a7d6178-hosts-file\") pod \"node-resolver-jsv7k\" (UID: \"236824b8-2653-4916-ae64-5ff75a7d6178\") " pod="openshift-dns/node-resolver-jsv7k" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.776470 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ac55471d-4e42-475f-a082-50f611571482-cni-binary-copy\") pod \"multus-v822j\" (UID: \"ac55471d-4e42-475f-a082-50f611571482\") " pod="openshift-multus/multus-v822j" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.776489 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ac55471d-4e42-475f-a082-50f611571482-host-run-k8s-cni-cncf-io\") pod \"multus-v822j\" (UID: \"ac55471d-4e42-475f-a082-50f611571482\") " pod="openshift-multus/multus-v822j" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.776505 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac55471d-4e42-475f-a082-50f611571482-host-var-lib-kubelet\") pod \"multus-v822j\" (UID: \"ac55471d-4e42-475f-a082-50f611571482\") " pod="openshift-multus/multus-v822j" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.776521 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"mcd-auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/e2275cb4-4905-4d66-a87e-8010120db2bd-mcd-auth-proxy-config\") pod \"machine-config-daemon-7bf76\" (UID: \"e2275cb4-4905-4d66-a87e-8010120db2bd\") " pod="openshift-machine-config-operator/machine-config-daemon-7bf76" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.776544 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2b62d686-4b05-42c7-b806-9e2caf8c34e8-cni-binary-copy\") pod \"multus-additional-cni-plugins-qqjfh\" (UID: \"2b62d686-4b05-42c7-b806-9e2caf8c34e8\") " pod="openshift-multus/multus-additional-cni-plugins-qqjfh" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.776560 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1ba0f093-ad5c-4a99-bfc2-8439162d5b72-log-socket\") pod \"ovnkube-node-zwk29\" (UID: \"1ba0f093-ad5c-4a99-bfc2-8439162d5b72\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwk29" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.776577 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1ba0f093-ad5c-4a99-bfc2-8439162d5b72-host-run-ovn-kubernetes\") pod \"ovnkube-node-zwk29\" (UID: \"1ba0f093-ad5c-4a99-bfc2-8439162d5b72\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwk29" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.776595 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1ba0f093-ad5c-4a99-bfc2-8439162d5b72-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zwk29\" (UID: \"1ba0f093-ad5c-4a99-bfc2-8439162d5b72\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwk29" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.776614 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1ba0f093-ad5c-4a99-bfc2-8439162d5b72-env-overrides\") pod \"ovnkube-node-zwk29\" (UID: \"1ba0f093-ad5c-4a99-bfc2-8439162d5b72\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwk29" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.776631 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jkmj\" (UniqueName: \"kubernetes.io/projected/236824b8-2653-4916-ae64-5ff75a7d6178-kube-api-access-5jkmj\") pod \"node-resolver-jsv7k\" (UID: \"236824b8-2653-4916-ae64-5ff75a7d6178\") " pod="openshift-dns/node-resolver-jsv7k" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.776646 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ac55471d-4e42-475f-a082-50f611571482-host-var-lib-cni-bin\") pod \"multus-v822j\" (UID: \"ac55471d-4e42-475f-a082-50f611571482\") " pod="openshift-multus/multus-v822j" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.776666 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2b62d686-4b05-42c7-b806-9e2caf8c34e8-os-release\") pod \"multus-additional-cni-plugins-qqjfh\" (UID: \"2b62d686-4b05-42c7-b806-9e2caf8c34e8\") " pod="openshift-multus/multus-additional-cni-plugins-qqjfh" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.776685 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ac55471d-4e42-475f-a082-50f611571482-system-cni-dir\") pod \"multus-v822j\" (UID: \"ac55471d-4e42-475f-a082-50f611571482\") " pod="openshift-multus/multus-v822j" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.776703 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhmdx\" (UniqueName: \"kubernetes.io/projected/ac55471d-4e42-475f-a082-50f611571482-kube-api-access-lhmdx\") pod \"multus-v822j\" (UID: \"ac55471d-4e42-475f-a082-50f611571482\") " pod="openshift-multus/multus-v822j" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.776719 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4464728a-4869-4476-83de-cb34577ace7f-metrics-certs\") pod \"network-metrics-daemon-xr8r2\" (UID: \"4464728a-4869-4476-83de-cb34577ace7f\") " pod="openshift-multus/network-metrics-daemon-xr8r2" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.776739 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftfg9\" (UniqueName: \"kubernetes.io/projected/4464728a-4869-4476-83de-cb34577ace7f-kube-api-access-ftfg9\") pod \"network-metrics-daemon-xr8r2\" (UID: \"4464728a-4869-4476-83de-cb34577ace7f\") " pod="openshift-multus/network-metrics-daemon-xr8r2" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.776824 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2b62d686-4b05-42c7-b806-9e2caf8c34e8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qqjfh\" (UID: \"2b62d686-4b05-42c7-b806-9e2caf8c34e8\") " pod="openshift-multus/multus-additional-cni-plugins-qqjfh" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.776842 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ac55471d-4e42-475f-a082-50f611571482-cnibin\") pod \"multus-v822j\" (UID: \"ac55471d-4e42-475f-a082-50f611571482\") " pod="openshift-multus/multus-v822j" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.778290 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-etc-kube\" (UniqueName: \"kubernetes.io/host-path/34177974-8d82-49d2-a763-391d0df3bbd8-host-etc-kube\") pod \"network-operator-7bdcf4f5bd-7fjxv\" (UID: \"34177974-8d82-49d2-a763-391d0df3bbd8\") " pod="openshift-network-operator/network-operator-7bdcf4f5bd-7fjxv" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.778369 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/34177974-8d82-49d2-a763-391d0df3bbd8-metrics-tls\") pod \"network-operator-7bdcf4f5bd-7fjxv\" (UID: \"34177974-8d82-49d2-a763-391d0df3bbd8\") " pod="openshift-network-operator/network-operator-7bdcf4f5bd-7fjxv" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.778400 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/428b39f5-eb1c-4f65-b7a4-eeb6e84860cc-host-slash\") pod \"iptables-alerter-5jnd7\" (UID: \"428b39f5-eb1c-4f65-b7a4-eeb6e84860cc\") " pod="openshift-network-operator/iptables-alerter-5jnd7" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.778426 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ac55471d-4e42-475f-a082-50f611571482-host-run-netns\") pod \"multus-v822j\" (UID: \"ac55471d-4e42-475f-a082-50f611571482\") " pod="openshift-multus/multus-v822j" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.778451 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6fd3bcf4-5dd2-45e2-b8a8-a83c8b02903f-serviceca\") pod \"node-ca-7sp2j\" (UID: \"6fd3bcf4-5dd2-45e2-b8a8-a83c8b02903f\") " pod="openshift-image-registry/node-ca-7sp2j" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.778474 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1ba0f093-ad5c-4a99-bfc2-8439162d5b72-node-log\") pod \"ovnkube-node-zwk29\" (UID: \"1ba0f093-ad5c-4a99-bfc2-8439162d5b72\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwk29" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.778505 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2b62d686-4b05-42c7-b806-9e2caf8c34e8-cnibin\") pod \"multus-additional-cni-plugins-qqjfh\" (UID: \"2b62d686-4b05-42c7-b806-9e2caf8c34e8\") " pod="openshift-multus/multus-additional-cni-plugins-qqjfh" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.778531 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1ba0f093-ad5c-4a99-bfc2-8439162d5b72-ovn-node-metrics-cert\") pod \"ovnkube-node-zwk29\" (UID: \"1ba0f093-ad5c-4a99-bfc2-8439162d5b72\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwk29" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.778554 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/236824b8-2653-4916-ae64-5ff75a7d6178-tmp-dir\") pod \"node-resolver-jsv7k\" (UID: \"236824b8-2653-4916-ae64-5ff75a7d6178\") " pod="openshift-dns/node-resolver-jsv7k" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.778579 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-control-plane-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8e29c57a-87ae-4f7a-82f5-867e05ccf280-ovn-control-plane-metrics-cert\") pod \"ovnkube-control-plane-57b78d8988-hbs9k\" (UID: \"8e29c57a-87ae-4f7a-82f5-867e05ccf280\") " pod="openshift-ovn-kubernetes/ovnkube-control-plane-57b78d8988-hbs9k" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.778612 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7cgz\" (UniqueName: \"kubernetes.io/projected/2b62d686-4b05-42c7-b806-9e2caf8c34e8-kube-api-access-p7cgz\") pod \"multus-additional-cni-plugins-qqjfh\" (UID: \"2b62d686-4b05-42c7-b806-9e2caf8c34e8\") " pod="openshift-multus/multus-additional-cni-plugins-qqjfh" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.778634 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1ba0f093-ad5c-4a99-bfc2-8439162d5b72-var-lib-openvswitch\") pod \"ovnkube-node-zwk29\" (UID: \"1ba0f093-ad5c-4a99-bfc2-8439162d5b72\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwk29" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.778656 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjz24\" (UniqueName: \"kubernetes.io/projected/1ba0f093-ad5c-4a99-bfc2-8439162d5b72-kube-api-access-tjz24\") pod \"ovnkube-node-zwk29\" (UID: \"1ba0f093-ad5c-4a99-bfc2-8439162d5b72\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwk29" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.778683 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/428b39f5-eb1c-4f65-b7a4-eeb6e84860cc-iptables-alerter-script\") pod \"iptables-alerter-5jnd7\" (UID: \"428b39f5-eb1c-4f65-b7a4-eeb6e84860cc\") " pod="openshift-network-operator/iptables-alerter-5jnd7" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.778706 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ac55471d-4e42-475f-a082-50f611571482-multus-cni-dir\") pod \"multus-v822j\" (UID: \"ac55471d-4e42-475f-a082-50f611571482\") " pod="openshift-multus/multus-v822j" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.778728 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ac55471d-4e42-475f-a082-50f611571482-os-release\") pod \"multus-v822j\" (UID: \"ac55471d-4e42-475f-a082-50f611571482\") " pod="openshift-multus/multus-v822j" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.778749 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ac55471d-4e42-475f-a082-50f611571482-multus-socket-dir-parent\") pod \"multus-v822j\" (UID: \"ac55471d-4e42-475f-a082-50f611571482\") " pod="openshift-multus/multus-v822j" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.778814 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fc4541ce-7789-4670-bc75-5c2868e52ce0-webhook-cert\") pod \"network-node-identity-dgvkt\" (UID: \"fc4541ce-7789-4670-bc75-5c2868e52ce0\") " pod="openshift-network-node-identity/network-node-identity-dgvkt" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.779111 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/fc4541ce-7789-4670-bc75-5c2868e52ce0-env-overrides\") pod \"network-node-identity-dgvkt\" (UID: \"fc4541ce-7789-4670-bc75-5c2868e52ce0\") " pod="openshift-network-node-identity/network-node-identity-dgvkt" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.775630 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca" (UID: "6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.775641 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b05a4c1d-fa93-4d3d-b6e5-235473e1ae2a-tmp" (OuterVolumeSpecName: "tmp") pod "b05a4c1d-fa93-4d3d-b6e5-235473e1ae2a" (UID: "b05a4c1d-fa93-4d3d-b6e5-235473e1ae2a"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.779207 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81e39f7b-62e4-4fc9-992a-6535ce127a02-kube-api-access-pllx6" (OuterVolumeSpecName: "kube-api-access-pllx6") pod "81e39f7b-62e4-4fc9-992a-6535ce127a02" (UID: "81e39f7b-62e4-4fc9-992a-6535ce127a02"). InnerVolumeSpecName "kube-api-access-pllx6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.775664 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a52afe44-fb37-46ed-a1f8-bf39727a3cbe-cert" (OuterVolumeSpecName: "cert") pod "a52afe44-fb37-46ed-a1f8-bf39727a3cbe" (UID: "a52afe44-fb37-46ed-a1f8-bf39727a3cbe"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.775980 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20ce4d18-fe25-4696-ad7c-1bd2d6200a3e-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "20ce4d18-fe25-4696-ad7c-1bd2d6200a3e" (UID: "20ce4d18-fe25-4696-ad7c-1bd2d6200a3e"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.776052 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e9b5059-1b3e-4067-a63d-2952cbe863af-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.776156 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/567683bd-0efc-4f21-b076-e28559628404-config" (OuterVolumeSpecName: "config") pod "567683bd-0efc-4f21-b076-e28559628404" (UID: "567683bd-0efc-4f21-b076-e28559628404"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: E0316 15:33:21.776185 5120 configmap.go:193] Couldn't get configMap openshift-network-console/networking-console-plugin: object "openshift-network-console"/"networking-console-plugin" not registered Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.779326 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4750666-1362-4001-abd0-6f89964cc621-kube-api-access-twvbl" (OuterVolumeSpecName: "kube-api-access-twvbl") pod "b4750666-1362-4001-abd0-6f89964cc621" (UID: "b4750666-1362-4001-abd0-6f89964cc621"). InnerVolumeSpecName "kube-api-access-twvbl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: E0316 15:33:21.779414 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6a9ae5f6-97bd-46ac-bafa-ca1b4452a141-nginx-conf podName:6a9ae5f6-97bd-46ac-bafa-ca1b4452a141 nodeName:}" failed. No retries permitted until 2026-03-16 15:33:22.279390517 +0000 UTC m=+104.433322174 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "nginx-conf" (UniqueName: "kubernetes.io/configmap/6a9ae5f6-97bd-46ac-bafa-ca1b4452a141-nginx-conf") pod "networking-console-plugin-5ff7774fd9-nljh6" (UID: "6a9ae5f6-97bd-46ac-bafa-ca1b4452a141") : object "openshift-network-console"/"networking-console-plugin" not registered Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.779597 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71c8ffbe-59c6-4e7d-aa1a-bbd315b3414a-utilities" (OuterVolumeSpecName: "utilities") pod "71c8ffbe-59c6-4e7d-aa1a-bbd315b3414a" (UID: "71c8ffbe-59c6-4e7d-aa1a-bbd315b3414a"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.779640 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1ba0f093-ad5c-4a99-bfc2-8439162d5b72-run-systemd\") pod \"ovnkube-node-zwk29\" (UID: \"1ba0f093-ad5c-4a99-bfc2-8439162d5b72\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwk29" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.779678 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m7xz2\" (UniqueName: \"kubernetes.io/projected/34177974-8d82-49d2-a763-391d0df3bbd8-kube-api-access-m7xz2\") pod \"network-operator-7bdcf4f5bd-7fjxv\" (UID: \"34177974-8d82-49d2-a763-391d0df3bbd8\") " pod="openshift-network-operator/network-operator-7bdcf4f5bd-7fjxv" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.779685 5120 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.779711 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gwt8b\" (UniqueName: \"kubernetes.io/projected/17b87002-b798-480a-8e17-83053d698239-kube-api-access-gwt8b\") pod \"network-check-target-fhkjl\" (UID: \"17b87002-b798-480a-8e17-83053d698239\") " pod="openshift-network-diagnostics/network-check-target-fhkjl" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.779738 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9hvt\" (UniqueName: \"kubernetes.io/projected/8e29c57a-87ae-4f7a-82f5-867e05ccf280-kube-api-access-b9hvt\") pod \"ovnkube-control-plane-57b78d8988-hbs9k\" (UID: \"8e29c57a-87ae-4f7a-82f5-867e05ccf280\") " pod="openshift-ovn-kubernetes/ovnkube-control-plane-57b78d8988-hbs9k" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.780213 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ac55471d-4e42-475f-a082-50f611571482-host-run-multus-certs\") pod \"multus-v822j\" (UID: \"ac55471d-4e42-475f-a082-50f611571482\") " pod="openshift-multus/multus-v822j" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.780242 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac55471d-4e42-475f-a082-50f611571482-etc-kubernetes\") pod \"multus-v822j\" (UID: \"ac55471d-4e42-475f-a082-50f611571482\") " pod="openshift-multus/multus-v822j" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.780259 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/af33e427-6803-48c2-a76a-dd9deb7cbf9a-ovn-node-metrics-cert" (OuterVolumeSpecName: "ovn-node-metrics-cert") pod "af33e427-6803-48c2-a76a-dd9deb7cbf9a" (UID: "af33e427-6803-48c2-a76a-dd9deb7cbf9a"). InnerVolumeSpecName "ovn-node-metrics-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.780273 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6a9ae5f6-97bd-46ac-bafa-ca1b4452a141-networking-console-plugin-cert\") pod \"networking-console-plugin-5ff7774fd9-nljh6\" (UID: \"6a9ae5f6-97bd-46ac-bafa-ca1b4452a141\") " pod="openshift-network-console/networking-console-plugin-5ff7774fd9-nljh6" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.780302 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1ba0f093-ad5c-4a99-bfc2-8439162d5b72-etc-openvswitch\") pod \"ovnkube-node-zwk29\" (UID: \"1ba0f093-ad5c-4a99-bfc2-8439162d5b72\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwk29" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.780366 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18f80adb-c1c3-49ba-8ee4-932c851d3897-service-ca-bundle" (OuterVolumeSpecName: "service-ca-bundle") pod "18f80adb-c1c3-49ba-8ee4-932c851d3897" (UID: "18f80adb-c1c3-49ba-8ee4-932c851d3897"). InnerVolumeSpecName "service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.780396 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16bdd140-dce1-464c-ab47-dd5798d1d256-kube-api-access-94l9h" (OuterVolumeSpecName: "kube-api-access-94l9h") pod "16bdd140-dce1-464c-ab47-dd5798d1d256" (UID: "16bdd140-dce1-464c-ab47-dd5798d1d256"). InnerVolumeSpecName "kube-api-access-94l9h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.780589 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1ba0f093-ad5c-4a99-bfc2-8439162d5b72-run-ovn\") pod \"ovnkube-node-zwk29\" (UID: \"1ba0f093-ad5c-4a99-bfc2-8439162d5b72\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwk29" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.780650 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1ba0f093-ad5c-4a99-bfc2-8439162d5b72-host-cni-netd\") pod \"ovnkube-node-zwk29\" (UID: \"1ba0f093-ad5c-4a99-bfc2-8439162d5b72\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwk29" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.780730 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwj94\" (UniqueName: \"kubernetes.io/projected/6fd3bcf4-5dd2-45e2-b8a8-a83c8b02903f-kube-api-access-rwj94\") pod \"node-ca-7sp2j\" (UID: \"6fd3bcf4-5dd2-45e2-b8a8-a83c8b02903f\") " pod="openshift-image-registry/node-ca-7sp2j" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.780776 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbscd\" (UniqueName: \"kubernetes.io/projected/e2275cb4-4905-4d66-a87e-8010120db2bd-kube-api-access-lbscd\") pod \"machine-config-daemon-7bf76\" (UID: \"e2275cb4-4905-4d66-a87e-8010120db2bd\") " pod="openshift-machine-config-operator/machine-config-daemon-7bf76" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.780808 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2b62d686-4b05-42c7-b806-9e2caf8c34e8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qqjfh\" (UID: \"2b62d686-4b05-42c7-b806-9e2caf8c34e8\") " pod="openshift-multus/multus-additional-cni-plugins-qqjfh" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.780833 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1ba0f093-ad5c-4a99-bfc2-8439162d5b72-ovnkube-config\") pod \"ovnkube-node-zwk29\" (UID: \"1ba0f093-ad5c-4a99-bfc2-8439162d5b72\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwk29" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.780861 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dsgwk\" (UniqueName: \"kubernetes.io/projected/428b39f5-eb1c-4f65-b7a4-eeb6e84860cc-kube-api-access-dsgwk\") pod \"iptables-alerter-5jnd7\" (UID: \"428b39f5-eb1c-4f65-b7a4-eeb6e84860cc\") " pod="openshift-network-operator/iptables-alerter-5jnd7" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.780885 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ac55471d-4e42-475f-a082-50f611571482-host-var-lib-cni-multus\") pod \"multus-v822j\" (UID: \"ac55471d-4e42-475f-a082-50f611571482\") " pod="openshift-multus/multus-v822j" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.780908 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ac55471d-4e42-475f-a082-50f611571482-multus-conf-dir\") pod \"multus-v822j\" (UID: \"ac55471d-4e42-475f-a082-50f611571482\") " pod="openshift-multus/multus-v822j" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.780930 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rootfs\" (UniqueName: \"kubernetes.io/host-path/e2275cb4-4905-4d66-a87e-8010120db2bd-rootfs\") pod \"machine-config-daemon-7bf76\" (UID: \"e2275cb4-4905-4d66-a87e-8010120db2bd\") " pod="openshift-machine-config-operator/machine-config-daemon-7bf76" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.780961 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8e29c57a-87ae-4f7a-82f5-867e05ccf280-env-overrides\") pod \"ovnkube-control-plane-57b78d8988-hbs9k\" (UID: \"8e29c57a-87ae-4f7a-82f5-867e05ccf280\") " pod="openshift-ovn-kubernetes/ovnkube-control-plane-57b78d8988-hbs9k" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.780993 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ac55471d-4e42-475f-a082-50f611571482-hostroot\") pod \"multus-v822j\" (UID: \"ac55471d-4e42-475f-a082-50f611571482\") " pod="openshift-multus/multus-v822j" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.781086 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6edfcf45-925b-4eff-b940-95b6fc0b85d4-v4-0-config-system-session" (OuterVolumeSpecName: "v4-0-config-system-session") pod "6edfcf45-925b-4eff-b940-95b6fc0b85d4" (UID: "6edfcf45-925b-4eff-b940-95b6fc0b85d4"). InnerVolumeSpecName "v4-0-config-system-session". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.781130 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ac55471d-4e42-475f-a082-50f611571482-multus-daemon-config\") pod \"multus-v822j\" (UID: \"ac55471d-4e42-475f-a082-50f611571482\") " pod="openshift-multus/multus-v822j" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.781174 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-identity-cm\" (UniqueName: \"kubernetes.io/configmap/fc4541ce-7789-4670-bc75-5c2868e52ce0-ovnkube-identity-cm\") pod \"network-node-identity-dgvkt\" (UID: \"fc4541ce-7789-4670-bc75-5c2868e52ce0\") " pod="openshift-network-node-identity/network-node-identity-dgvkt" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.781215 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6edfcf45-925b-4eff-b940-95b6fc0b85d4-audit-policies" (OuterVolumeSpecName: "audit-policies") pod "6edfcf45-925b-4eff-b940-95b6fc0b85d4" (UID: "6edfcf45-925b-4eff-b940-95b6fc0b85d4"). InnerVolumeSpecName "audit-policies". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.781156 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f559dfa3-3917-43a2-97f6-61ddfda10e93-serving-cert" (OuterVolumeSpecName: "serving-cert") pod "f559dfa3-3917-43a2-97f6-61ddfda10e93" (UID: "f559dfa3-3917-43a2-97f6-61ddfda10e93"). InnerVolumeSpecName "serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.781235 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7afa918d-be67-40a6-803c-d3b0ae99d815-config" (OuterVolumeSpecName: "config") pod "7afa918d-be67-40a6-803c-d3b0ae99d815" (UID: "7afa918d-be67-40a6-803c-d3b0ae99d815"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.781669 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7648cbb-48eb-4ba8-87ec-eb096b8fa1e4-kube-api-access-pgx6b" (OuterVolumeSpecName: "kube-api-access-pgx6b") pod "f7648cbb-48eb-4ba8-87ec-eb096b8fa1e4" (UID: "f7648cbb-48eb-4ba8-87ec-eb096b8fa1e4"). InnerVolumeSpecName "kube-api-access-pgx6b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.781702 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9276f8f5-2f24-48e1-ab6d-1aab0d8ec3ff-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "9276f8f5-2f24-48e1-ab6d-1aab0d8ec3ff" (UID: "9276f8f5-2f24-48e1-ab6d-1aab0d8ec3ff"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.781730 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7a88189-c967-4640-879e-27665747f20c-tmpfs" (OuterVolumeSpecName: "tmpfs") pod "a7a88189-c967-4640-879e-27665747f20c" (UID: "a7a88189-c967-4640-879e-27665747f20c"). InnerVolumeSpecName "tmpfs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.776251 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a208c9c2-333b-4b4a-be0d-bc32ec38a821-kube-api-access-26xrl" (OuterVolumeSpecName: "kube-api-access-26xrl") pod "a208c9c2-333b-4b4a-be0d-bc32ec38a821" (UID: "a208c9c2-333b-4b4a-be0d-bc32ec38a821"). InnerVolumeSpecName "kube-api-access-26xrl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.776271 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7e2c886-118e-43bb-bef1-c78134de392b-kube-api-access-6g4lr" (OuterVolumeSpecName: "kube-api-access-6g4lr") pod "f7e2c886-118e-43bb-bef1-c78134de392b" (UID: "f7e2c886-118e-43bb-bef1-c78134de392b"). InnerVolumeSpecName "kube-api-access-6g4lr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.776364 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/593a3561-7760-45c5-8f91-5aaef7475d0f-kube-api-access-sbc2l" (OuterVolumeSpecName: "kube-api-access-sbc2l") pod "593a3561-7760-45c5-8f91-5aaef7475d0f" (UID: "593a3561-7760-45c5-8f91-5aaef7475d0f"). InnerVolumeSpecName "kube-api-access-sbc2l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.781923 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a555ff2e-0be6-46d5-897d-863bb92ae2b3-tmp" (OuterVolumeSpecName: "tmp") pod "a555ff2e-0be6-46d5-897d-863bb92ae2b3" (UID: "a555ff2e-0be6-46d5-897d-863bb92ae2b3"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.776391 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d45be74c-0d98-4d18-90e4-f7ef1b6daaf7-serving-cert" (OuterVolumeSpecName: "serving-cert") pod "d45be74c-0d98-4d18-90e4-f7ef1b6daaf7" (UID: "d45be74c-0d98-4d18-90e4-f7ef1b6daaf7"). InnerVolumeSpecName "serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.776597 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/01080b46-74f1-4191-8755-5152a57b3b25-config" (OuterVolumeSpecName: "config") pod "01080b46-74f1-4191-8755-5152a57b3b25" (UID: "01080b46-74f1-4191-8755-5152a57b3b25"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.776908 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e1d2a42d-af1d-4054-9618-ab545e0ed8b7-mcd-auth-proxy-config" (OuterVolumeSpecName: "mcd-auth-proxy-config") pod "e1d2a42d-af1d-4054-9618-ab545e0ed8b7" (UID: "e1d2a42d-af1d-4054-9618-ab545e0ed8b7"). InnerVolumeSpecName "mcd-auth-proxy-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.776984 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc8db2c7-859d-47b3-a900-2bd0c0b2973b-machine-approver-tls" (OuterVolumeSpecName: "machine-approver-tls") pod "fc8db2c7-859d-47b3-a900-2bd0c0b2973b" (UID: "fc8db2c7-859d-47b3-a900-2bd0c0b2973b"). InnerVolumeSpecName "machine-approver-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.777185 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f559dfa3-3917-43a2-97f6-61ddfda10e93-kube-api-access-hm9x7" (OuterVolumeSpecName: "kube-api-access-hm9x7") pod "f559dfa3-3917-43a2-97f6-61ddfda10e93" (UID: "f559dfa3-3917-43a2-97f6-61ddfda10e93"). InnerVolumeSpecName "kube-api-access-hm9x7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.777238 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/20ce4d18-fe25-4696-ad7c-1bd2d6200a3e-image-registry-operator-tls" (OuterVolumeSpecName: "image-registry-operator-tls") pod "20ce4d18-fe25-4696-ad7c-1bd2d6200a3e" (UID: "20ce4d18-fe25-4696-ad7c-1bd2d6200a3e"). InnerVolumeSpecName "image-registry-operator-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.777350 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f7648cbb-48eb-4ba8-87ec-eb096b8fa1e4-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "f7648cbb-48eb-4ba8-87ec-eb096b8fa1e4" (UID: "f7648cbb-48eb-4ba8-87ec-eb096b8fa1e4"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.777897 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af41de71-79cf-4590-bbe9-9e8b848862cb-kube-api-access-d7cps" (OuterVolumeSpecName: "kube-api-access-d7cps") pod "af41de71-79cf-4590-bbe9-9e8b848862cb" (UID: "af41de71-79cf-4590-bbe9-9e8b848862cb"). InnerVolumeSpecName "kube-api-access-d7cps". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.777968 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/736c54fe-349c-4bb9-870a-d1c1d1c03831-tmp" (OuterVolumeSpecName: "tmp") pod "736c54fe-349c-4bb9-870a-d1c1d1c03831" (UID: "736c54fe-349c-4bb9-870a-d1c1d1c03831"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.778158 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18f80adb-c1c3-49ba-8ee4-932c851d3897-default-certificate" (OuterVolumeSpecName: "default-certificate") pod "18f80adb-c1c3-49ba-8ee4-932c851d3897" (UID: "18f80adb-c1c3-49ba-8ee4-932c851d3897"). InnerVolumeSpecName "default-certificate". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.778229 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0effdbcf-dd7d-404d-9d48-77536d665a5d-kube-api-access-mfzkj" (OuterVolumeSpecName: "kube-api-access-mfzkj") pod "0effdbcf-dd7d-404d-9d48-77536d665a5d" (UID: "0effdbcf-dd7d-404d-9d48-77536d665a5d"). InnerVolumeSpecName "kube-api-access-mfzkj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.778235 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9276f8f5-2f24-48e1-ab6d-1aab0d8ec3ff-utilities" (OuterVolumeSpecName: "utilities") pod "9276f8f5-2f24-48e1-ab6d-1aab0d8ec3ff" (UID: "9276f8f5-2f24-48e1-ab6d-1aab0d8ec3ff"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.778387 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20ce4d18-fe25-4696-ad7c-1bd2d6200a3e-tmp" (OuterVolumeSpecName: "tmp") pod "20ce4d18-fe25-4696-ad7c-1bd2d6200a3e" (UID: "20ce4d18-fe25-4696-ad7c-1bd2d6200a3e"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.781991 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6edfcf45-925b-4eff-b940-95b6fc0b85d4-kube-api-access-8nb9c" (OuterVolumeSpecName: "kube-api-access-8nb9c") pod "6edfcf45-925b-4eff-b940-95b6fc0b85d4" (UID: "6edfcf45-925b-4eff-b940-95b6fc0b85d4"). InnerVolumeSpecName "kube-api-access-8nb9c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.778407 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c491984c-7d4b-44aa-8c1e-d7974424fa47-kube-api-access-9vsz9" (OuterVolumeSpecName: "kube-api-access-9vsz9") pod "c491984c-7d4b-44aa-8c1e-d7974424fa47" (UID: "c491984c-7d4b-44aa-8c1e-d7974424fa47"). InnerVolumeSpecName "kube-api-access-9vsz9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.778369 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/736c54fe-349c-4bb9-870a-d1c1d1c03831-serving-cert" (OuterVolumeSpecName: "serving-cert") pod "736c54fe-349c-4bb9-870a-d1c1d1c03831" (UID: "736c54fe-349c-4bb9-870a-d1c1d1c03831"). InnerVolumeSpecName "serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.778804 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d19cb085-0c5b-4810-b654-ce7923221d90-audit" (OuterVolumeSpecName: "audit") pod "d19cb085-0c5b-4810-b654-ce7923221d90" (UID: "d19cb085-0c5b-4810-b654-ce7923221d90"). InnerVolumeSpecName "audit". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.778937 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92dfbade-90b6-4169-8c07-72cff7f2c82b-kube-api-access-4g8ts" (OuterVolumeSpecName: "kube-api-access-4g8ts") pod "92dfbade-90b6-4169-8c07-72cff7f2c82b" (UID: "92dfbade-90b6-4169-8c07-72cff7f2c82b"). InnerVolumeSpecName "kube-api-access-4g8ts". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.782017 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7df94c10-441d-4386-93a6-6730fb7bcde0-ovn-control-plane-metrics-cert" (OuterVolumeSpecName: "ovn-control-plane-metrics-cert") pod "7df94c10-441d-4386-93a6-6730fb7bcde0" (UID: "7df94c10-441d-4386-93a6-6730fb7bcde0"). InnerVolumeSpecName "ovn-control-plane-metrics-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.782075 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7a88189-c967-4640-879e-27665747f20c-kube-api-access-8nspp" (OuterVolumeSpecName: "kube-api-access-8nspp") pod "a7a88189-c967-4640-879e-27665747f20c" (UID: "a7a88189-c967-4640-879e-27665747f20c"). InnerVolumeSpecName "kube-api-access-8nspp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.782198 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6edfcf45-925b-4eff-b940-95b6fc0b85d4-v4-0-config-system-cliconfig" (OuterVolumeSpecName: "v4-0-config-system-cliconfig") pod "6edfcf45-925b-4eff-b940-95b6fc0b85d4" (UID: "6edfcf45-925b-4eff-b940-95b6fc0b85d4"). InnerVolumeSpecName "v4-0-config-system-cliconfig". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: E0316 15:33:21.782378 5120 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: object "openshift-network-console"/"networking-console-plugin-cert" not registered Mar 16 15:33:21 crc kubenswrapper[5120]: E0316 15:33:21.782444 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a9ae5f6-97bd-46ac-bafa-ca1b4452a141-networking-console-plugin-cert podName:6a9ae5f6-97bd-46ac-bafa-ca1b4452a141 nodeName:}" failed. No retries permitted until 2026-03-16 15:33:22.282426289 +0000 UTC m=+104.436357956 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6a9ae5f6-97bd-46ac-bafa-ca1b4452a141-networking-console-plugin-cert") pod "networking-console-plugin-5ff7774fd9-nljh6" (UID: "6a9ae5f6-97bd-46ac-bafa-ca1b4452a141") : object "openshift-network-console"/"networking-console-plugin-cert" not registered Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.782740 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1ba0f093-ad5c-4a99-bfc2-8439162d5b72-systemd-units\") pod \"ovnkube-node-zwk29\" (UID: \"1ba0f093-ad5c-4a99-bfc2-8439162d5b72\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwk29" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.782796 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1ba0f093-ad5c-4a99-bfc2-8439162d5b72-host-cni-bin\") pod \"ovnkube-node-zwk29\" (UID: \"1ba0f093-ad5c-4a99-bfc2-8439162d5b72\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwk29" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.782857 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1ba0f093-ad5c-4a99-bfc2-8439162d5b72-host-kubelet\") pod \"ovnkube-node-zwk29\" (UID: \"1ba0f093-ad5c-4a99-bfc2-8439162d5b72\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwk29" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.782890 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6fd3bcf4-5dd2-45e2-b8a8-a83c8b02903f-host\") pod \"node-ca-7sp2j\" (UID: \"6fd3bcf4-5dd2-45e2-b8a8-a83c8b02903f\") " pod="openshift-image-registry/node-ca-7sp2j" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.783192 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/af33e427-6803-48c2-a76a-dd9deb7cbf9a-ovnkube-script-lib" (OuterVolumeSpecName: "ovnkube-script-lib") pod "af33e427-6803-48c2-a76a-dd9deb7cbf9a" (UID: "af33e427-6803-48c2-a76a-dd9deb7cbf9a"). InnerVolumeSpecName "ovnkube-script-lib". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.783236 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6edfcf45-925b-4eff-b940-95b6fc0b85d4-v4-0-config-system-trusted-ca-bundle" (OuterVolumeSpecName: "v4-0-config-system-trusted-ca-bundle") pod "6edfcf45-925b-4eff-b940-95b6fc0b85d4" (UID: "6edfcf45-925b-4eff-b940-95b6fc0b85d4"). InnerVolumeSpecName "v4-0-config-system-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.783266 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/af33e427-6803-48c2-a76a-dd9deb7cbf9a-ovnkube-config" (OuterVolumeSpecName: "ovnkube-config") pod "af33e427-6803-48c2-a76a-dd9deb7cbf9a" (UID: "af33e427-6803-48c2-a76a-dd9deb7cbf9a"). InnerVolumeSpecName "ovnkube-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.783882 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-identity-cm\" (UniqueName: \"kubernetes.io/configmap/fc4541ce-7789-4670-bc75-5c2868e52ce0-ovnkube-identity-cm\") pod \"network-node-identity-dgvkt\" (UID: \"fc4541ce-7789-4670-bc75-5c2868e52ce0\") " pod="openshift-network-node-identity/network-node-identity-dgvkt" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.784066 5120 status_manager.go:919] "Failed to update status for pod" pod="openshift-kube-scheduler/openshift-kube-scheduler-crc" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"ac5d00db-28e5-4c02-9d6f-d302d82e052e\\\"},\\\"status\\\":{\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T15:31:40Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T15:31:40Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T15:32:34Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T15:32:34Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T15:31:38Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"15m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://da7bbd2b17a31792a198b13e91d00d2abf8aca649a814a8a545399060a71dc48\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-scheduler\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"15m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T15:31:40Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://38e68a2bfa842d6a1eccbc4776fe556a03f1dc2daf3d9113332ac776691012aa\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e504172345491d90bbbf1e7e45488e73073f4c6d7c2355245871051596fc85db\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e504172345491d90bbbf1e7e45488e73073f4c6d7c2355245871051596fc85db\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-scheduler-cert-syncer\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T15:31:41Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://4a50a05848f60742e019ce9e1bf49eea184f5b902104fdffb5fdadf58dba96c5\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e504172345491d90bbbf1e7e45488e73073f4c6d7c2355245871051596fc85db\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e504172345491d90bbbf1e7e45488e73073f4c6d7c2355245871051596fc85db\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-scheduler-recovery-controller\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T15:31:41Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"initContainerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"15m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://1babd9d24839cdec527b6a8a3199e79c9873019d142145631c20071402b9e07b\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"wait-for-host-port\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"15m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://1babd9d24839cdec527b6a8a3199e79c9873019d142145631c20071402b9e07b\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-03-16T15:31:39Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-03-16T15:31:39Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}}}],\\\"phase\\\":\\\"Running\\\",\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T15:31:38Z\\\"}}\" for pod \"openshift-kube-scheduler\"/\"openshift-kube-scheduler-crc\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.784503 5120 reconciler_common.go:299] "Volume detached for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6077b63e-53a2-4f96-9d56-1ce0324e4913-metrics-tls\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.784523 5120 reconciler_common.go:299] "Volume detached for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/af33e427-6803-48c2-a76a-dd9deb7cbf9a-ovn-node-metrics-cert\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.784537 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l9stx\" (UniqueName: \"kubernetes.io/projected/6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca-kube-api-access-l9stx\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.784551 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wj4qr\" (UniqueName: \"kubernetes.io/projected/149b3c48-e17c-4a66-a835-d86dabf6ff13-kube-api-access-wj4qr\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.784563 5120 reconciler_common.go:299] "Volume detached for volume \"profile-collector-cert\" (UniqueName: \"kubernetes.io/secret/301e1965-1754-483d-b6cc-bfae7038bbca-profile-collector-cert\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.784574 5120 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f7e2c886-118e-43bb-bef1-c78134de392b-tmp-dir\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.784587 5120 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9f71a554-e414-4bc3-96d2-674060397afe-trusted-ca\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.784598 5120 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a52afe44-fb37-46ed-a1f8-bf39727a3cbe-cert\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.784610 5120 reconciler_common.go:299] "Volume detached for volume \"srv-cert\" (UniqueName: \"kubernetes.io/secret/7fcc6409-8a0f-44c3-89e7-5aecd7610f8a-srv-cert\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.784623 5120 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca-console-serving-cert\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.784637 5120 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b05a4c1d-fa93-4d3d-b6e5-235473e1ae2a-tmp\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.784649 5120 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/20ce4d18-fe25-4696-ad7c-1bd2d6200a3e-bound-sa-token\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.784661 5120 reconciler_common.go:299] "Volume detached for volume \"image-import-ca\" (UniqueName: \"kubernetes.io/configmap/d19cb085-0c5b-4810-b654-ce7923221d90-image-import-ca\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.784672 5120 reconciler_common.go:299] "Volume detached for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9f71a554-e414-4bc3-96d2-674060397afe-metrics-tls\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.784683 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7599e0b6-bddf-4def-b7f2-0b32206e8651-config\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.784696 5120 reconciler_common.go:299] "Volume detached for volume \"control-plane-machine-set-operator-tls\" (UniqueName: \"kubernetes.io/secret/42a11a02-47e1-488f-b270-2679d3298b0e-control-plane-machine-set-operator-tls\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.784708 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dztfv\" (UniqueName: \"kubernetes.io/projected/d45be74c-0d98-4d18-90e4-f7ef1b6daaf7-kube-api-access-dztfv\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.784720 5120 reconciler_common.go:299] "Volume detached for volume \"etcd-client\" (UniqueName: \"kubernetes.io/secret/d19cb085-0c5b-4810-b654-ce7923221d90-etcd-client\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.784739 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d45be74c-0d98-4d18-90e4-f7ef1b6daaf7-config\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.784752 5120 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/92dfbade-90b6-4169-8c07-72cff7f2c82b-config-volume\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.784789 5120 reconciler_common.go:299] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/584e1f4a-8205-47d7-8efb-3afc6017c4c9-utilities\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.784803 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/dcd10325-9ba5-4a3b-8e4a-e57e3bf210f9-config\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.784812 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xnxbn\" (UniqueName: \"kubernetes.io/projected/ce090a97-9ab6-4c40-a719-64ff2acd9778-kube-api-access-xnxbn\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.784822 5120 reconciler_common.go:299] "Volume detached for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c5f2bfad-70f6-4185-a3d9-81ce12720767-serving-cert\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.784831 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5lcfw\" (UniqueName: \"kubernetes.io/projected/dcd10325-9ba5-4a3b-8e4a-e57e3bf210f9-kube-api-access-5lcfw\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.784842 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ks6v2\" (UniqueName: \"kubernetes.io/projected/71c8ffbe-59c6-4e7d-aa1a-bbd315b3414a-kube-api-access-ks6v2\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.784852 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8pskd\" (UniqueName: \"kubernetes.io/projected/a555ff2e-0be6-46d5-897d-863bb92ae2b3-kube-api-access-8pskd\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.784860 5120 reconciler_common.go:299] "Volume detached for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7df94c10-441d-4386-93a6-6730fb7bcde0-env-overrides\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.784868 5120 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7afa918d-be67-40a6-803c-d3b0ae99d815-tmp\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.784875 5120 reconciler_common.go:299] "Volume detached for volume \"etcd-client\" (UniqueName: \"kubernetes.io/secret/f559dfa3-3917-43a2-97f6-61ddfda10e93-etcd-client\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.784883 5120 reconciler_common.go:299] "Volume detached for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/ce090a97-9ab6-4c40-a719-64ff2acd9778-signing-cabundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.784913 5120 reconciler_common.go:299] "Volume detached for volume \"etcd-ca\" (UniqueName: \"kubernetes.io/configmap/567683bd-0efc-4f21-b076-e28559628404-etcd-ca\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.784922 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/09cfa50b-4138-4585-a53e-64dd3ab73335-config\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.784930 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9z4sw\" (UniqueName: \"kubernetes.io/projected/e1d2a42d-af1d-4054-9618-ab545e0ed8b7-kube-api-access-9z4sw\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.784939 5120 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d45be74c-0d98-4d18-90e4-f7ef1b6daaf7-tmp\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.784947 5120 reconciler_common.go:299] "Volume detached for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/869851b9-7ffb-4af0-b166-1d8aa40a5f80-whereabouts-flatfile-configmap\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.785024 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mjwtd\" (UniqueName: \"kubernetes.io/projected/869851b9-7ffb-4af0-b166-1d8aa40a5f80-kube-api-access-mjwtd\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.785035 5120 reconciler_common.go:299] "Volume detached for volume \"etcd-serving-ca\" (UniqueName: \"kubernetes.io/configmap/f559dfa3-3917-43a2-97f6-61ddfda10e93-etcd-serving-ca\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.785044 5120 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/18f80adb-c1c3-49ba-8ee4-932c851d3897-metrics-certs\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.785052 5120 reconciler_common.go:299] "Volume detached for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/869851b9-7ffb-4af0-b166-1d8aa40a5f80-cni-binary-copy\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.785060 5120 reconciler_common.go:299] "Volume detached for volume \"etcd-service-ca\" (UniqueName: \"kubernetes.io/configmap/567683bd-0efc-4f21-b076-e28559628404-etcd-service-ca\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.785069 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ftwb6\" (UniqueName: \"kubernetes.io/projected/9f71a554-e414-4bc3-96d2-674060397afe-kube-api-access-ftwb6\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.785077 5120 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9e9b5059-1b3e-4067-a63d-2952cbe863af-bound-sa-token\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.785086 5120 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6077b63e-53a2-4f96-9d56-1ce0324e4913-tmp-dir\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.785094 5120 reconciler_common.go:299] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/cc85e424-18b2-4924-920b-bd291a8c4b01-catalog-content\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.785102 5120 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/92dfbade-90b6-4169-8c07-72cff7f2c82b-tmp-dir\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.785110 5120 reconciler_common.go:299] "Volume detached for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7599e0b6-bddf-4def-b7f2-0b32206e8651-serving-cert\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.785118 5120 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d565531a-ff86-4608-9d19-767de01ac31b-proxy-tls\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.785127 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tkdh6\" (UniqueName: \"kubernetes.io/projected/20ce4d18-fe25-4696-ad7c-1bd2d6200a3e-kube-api-access-tkdh6\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.785136 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/c5f2bfad-70f6-4185-a3d9-81ce12720767-kube-api-access\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.785145 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wbmqg\" (UniqueName: \"kubernetes.io/projected/18f80adb-c1c3-49ba-8ee4-932c851d3897-kube-api-access-wbmqg\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.785153 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c5f2bfad-70f6-4185-a3d9-81ce12720767-config\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.785161 5120 reconciler_common.go:299] "Volume detached for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a555ff2e-0be6-46d5-897d-863bb92ae2b3-serving-cert\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.785169 5120 reconciler_common.go:299] "Volume detached for volume \"v4-0-config-user-template-login\" (UniqueName: \"kubernetes.io/secret/6edfcf45-925b-4eff-b940-95b6fc0b85d4-v4-0-config-user-template-login\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.785178 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ptkcf\" (UniqueName: \"kubernetes.io/projected/7599e0b6-bddf-4def-b7f2-0b32206e8651-kube-api-access-ptkcf\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.785186 5120 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9e9b5059-1b3e-4067-a63d-2952cbe863af-registry-tls\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.785194 5120 reconciler_common.go:299] "Volume detached for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/ce090a97-9ab6-4c40-a719-64ff2acd9778-signing-key\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.785205 5120 reconciler_common.go:299] "Volume detached for volume \"tmpfs\" (UniqueName: \"kubernetes.io/empty-dir/7fcc6409-8a0f-44c3-89e7-5aecd7610f8a-tmpfs\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.785213 5120 reconciler_common.go:299] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/cc85e424-18b2-4924-920b-bd291a8c4b01-utilities\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.785221 5120 reconciler_common.go:299] "Volume detached for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/16bdd140-dce1-464c-ab47-dd5798d1d256-serving-cert\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.785253 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q4smf\" (UniqueName: \"kubernetes.io/projected/0dd0fbac-8c0d-4228-8faa-abbeedabf7db-kube-api-access-q4smf\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.785262 5120 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/567683bd-0efc-4f21-b076-e28559628404-tmp-dir\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.785270 5120 reconciler_common.go:299] "Volume detached for volume \"webhook-certs\" (UniqueName: \"kubernetes.io/secret/0dd0fbac-8c0d-4228-8faa-abbeedabf7db-webhook-certs\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.785279 5120 reconciler_common.go:299] "Volume detached for volume \"v4-0-config-system-ocp-branding-template\" (UniqueName: \"kubernetes.io/secret/6edfcf45-925b-4eff-b940-95b6fc0b85d4-v4-0-config-system-ocp-branding-template\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.785978 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dcd10325-9ba5-4a3b-8e4a-e57e3bf210f9-service-ca-bundle" (OuterVolumeSpecName: "service-ca-bundle") pod "dcd10325-9ba5-4a3b-8e4a-e57e3bf210f9" (UID: "dcd10325-9ba5-4a3b-8e4a-e57e3bf210f9"). InnerVolumeSpecName "service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.786068 5120 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d19cb085-0c5b-4810-b654-ce7923221d90-trusted-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.786081 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z5rsr\" (UniqueName: \"kubernetes.io/projected/af33e427-6803-48c2-a76a-dd9deb7cbf9a-kube-api-access-z5rsr\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.786091 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c491984c-7d4b-44aa-8c1e-d7974424fa47-config\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.786100 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hckvg\" (UniqueName: \"kubernetes.io/projected/fc8db2c7-859d-47b3-a900-2bd0c0b2973b-kube-api-access-hckvg\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.786108 5120 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/20ce4d18-fe25-4696-ad7c-1bd2d6200a3e-trusted-ca\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.786118 5120 reconciler_common.go:299] "Volume detached for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/81e39f7b-62e4-4fc9-992a-6535ce127a02-cni-binary-copy\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.786127 5120 reconciler_common.go:299] "Volume detached for volume \"profile-collector-cert\" (UniqueName: \"kubernetes.io/secret/7fcc6409-8a0f-44c3-89e7-5aecd7610f8a-profile-collector-cert\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.786136 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nmmzf\" (UniqueName: \"kubernetes.io/projected/7df94c10-441d-4386-93a6-6730fb7bcde0-kube-api-access-nmmzf\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.786145 5120 reconciler_common.go:299] "Volume detached for volume \"marketplace-operator-metrics\" (UniqueName: \"kubernetes.io/secret/b05a4c1d-fa93-4d3d-b6e5-235473e1ae2a-marketplace-operator-metrics\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.786154 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l87hs\" (UniqueName: \"kubernetes.io/projected/5ebfebf6-3ecd-458e-943f-bb25b52e2718-kube-api-access-l87hs\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.786163 5120 reconciler_common.go:299] "Volume detached for volume \"machine-api-operator-tls\" (UniqueName: \"kubernetes.io/secret/c491984c-7d4b-44aa-8c1e-d7974424fa47-machine-api-operator-tls\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.786171 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/567683bd-0efc-4f21-b076-e28559628404-config\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.786180 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rzt4w\" (UniqueName: \"kubernetes.io/projected/a52afe44-fb37-46ed-a1f8-bf39727a3cbe-kube-api-access-rzt4w\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.786188 5120 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e1d2a42d-af1d-4054-9618-ab545e0ed8b7-proxy-tls\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.786196 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m5lgh\" (UniqueName: \"kubernetes.io/projected/d19cb085-0c5b-4810-b654-ce7923221d90-kube-api-access-m5lgh\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.786206 5120 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9e9b5059-1b3e-4067-a63d-2952cbe863af-registry-certificates\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.786214 5120 reconciler_common.go:299] "Volume detached for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/18f80adb-c1c3-49ba-8ee4-932c851d3897-stats-auth\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.786223 5120 reconciler_common.go:299] "Volume detached for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/567683bd-0efc-4f21-b076-e28559628404-serving-cert\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.786232 5120 reconciler_common.go:299] "Volume detached for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/a555ff2e-0be6-46d5-897d-863bb92ae2b3-client-ca\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.786241 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ws8zz\" (UniqueName: \"kubernetes.io/projected/9e9b5059-1b3e-4067-a63d-2952cbe863af-kube-api-access-ws8zz\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.786250 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/f65c0ac1-8bca-454d-a2e6-e35cb418beac-kube-api-access\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.786259 5120 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca-console-oauth-config\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.786267 5120 reconciler_common.go:299] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/584e1f4a-8205-47d7-8efb-3afc6017c4c9-catalog-content\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.786275 5120 reconciler_common.go:299] "Volume detached for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f65c0ac1-8bca-454d-a2e6-e35cb418beac-serving-cert\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.786283 5120 reconciler_common.go:299] "Volume detached for volume \"etcd-serving-ca\" (UniqueName: \"kubernetes.io/configmap/d19cb085-0c5b-4810-b654-ce7923221d90-etcd-serving-ca\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.786288 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/301e1965-1754-483d-b6cc-bfae7038bbca-tmpfs" (OuterVolumeSpecName: "tmpfs") pod "301e1965-1754-483d-b6cc-bfae7038bbca" (UID: "301e1965-1754-483d-b6cc-bfae7038bbca"). InnerVolumeSpecName "tmpfs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.786293 5120 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9f71a554-e414-4bc3-96d2-674060397afe-bound-sa-token\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.786328 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qgrkj\" (UniqueName: \"kubernetes.io/projected/42a11a02-47e1-488f-b270-2679d3298b0e-kube-api-access-qgrkj\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.786340 5120 reconciler_common.go:299] "Volume detached for volume \"encryption-config\" (UniqueName: \"kubernetes.io/secret/f559dfa3-3917-43a2-97f6-61ddfda10e93-encryption-config\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.786527 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b05a4c1d-fa93-4d3d-b6e5-235473e1ae2a-marketplace-trusted-ca" (OuterVolumeSpecName: "marketplace-trusted-ca") pod "b05a4c1d-fa93-4d3d-b6e5-235473e1ae2a" (UID: "b05a4c1d-fa93-4d3d-b6e5-235473e1ae2a"). InnerVolumeSpecName "marketplace-trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.786546 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zth6t\" (UniqueName: \"kubernetes.io/projected/6077b63e-53a2-4f96-9d56-1ce0324e4913-kube-api-access-zth6t\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.786560 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7jjkz\" (UniqueName: \"kubernetes.io/projected/301e1965-1754-483d-b6cc-bfae7038bbca-kube-api-access-7jjkz\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.786570 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xfp5s\" (UniqueName: \"kubernetes.io/projected/cc85e424-18b2-4924-920b-bd291a8c4b01-kube-api-access-xfp5s\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.786538 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09cfa50b-4138-4585-a53e-64dd3ab73335-kube-api-access-zsb9b" (OuterVolumeSpecName: "kube-api-access-zsb9b") pod "09cfa50b-4138-4585-a53e-64dd3ab73335" (UID: "09cfa50b-4138-4585-a53e-64dd3ab73335"). InnerVolumeSpecName "kube-api-access-zsb9b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.786578 5120 reconciler_common.go:299] "Volume detached for volume \"auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/fc8db2c7-859d-47b3-a900-2bd0c0b2973b-auth-proxy-config\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.786558 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/09cfa50b-4138-4585-a53e-64dd3ab73335-serving-cert" (OuterVolumeSpecName: "serving-cert") pod "09cfa50b-4138-4585-a53e-64dd3ab73335" (UID: "09cfa50b-4138-4585-a53e-64dd3ab73335"). InnerVolumeSpecName "serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.786586 5120 reconciler_common.go:299] "Volume detached for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/869851b9-7ffb-4af0-b166-1d8aa40a5f80-cni-sysctl-allowlist\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.786595 5120 reconciler_common.go:299] "Volume detached for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/01080b46-74f1-4191-8755-5152a57b3b25-serving-cert\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.786603 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f65c0ac1-8bca-454d-a2e6-e35cb418beac-config\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.786611 5120 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9e9b5059-1b3e-4067-a63d-2952cbe863af-installation-pull-secrets\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.786619 5120 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca-trusted-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.786628 5120 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c5f2bfad-70f6-4185-a3d9-81ce12720767-tmp-dir\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.786637 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4hb7m\" (UniqueName: \"kubernetes.io/projected/94a6e063-3d1a-4d44-875d-185291448c31-kube-api-access-4hb7m\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.786646 5120 reconciler_common.go:299] "Volume detached for volume \"v4-0-config-user-template-provider-selection\" (UniqueName: \"kubernetes.io/secret/6edfcf45-925b-4eff-b940-95b6fc0b85d4-v4-0-config-user-template-provider-selection\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.786656 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-twvbl\" (UniqueName: \"kubernetes.io/projected/b4750666-1362-4001-abd0-6f89964cc621-kube-api-access-twvbl\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.786665 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m26jq\" (UniqueName: \"kubernetes.io/projected/567683bd-0efc-4f21-b076-e28559628404-kube-api-access-m26jq\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.786673 5120 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b4750666-1362-4001-abd0-6f89964cc621-proxy-tls\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.786680 5120 reconciler_common.go:299] "Volume detached for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2325ffef-9d5b-447f-b00e-3efc429acefe-serving-cert\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.786688 5120 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9e9b5059-1b3e-4067-a63d-2952cbe863af-trusted-ca\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.786697 5120 reconciler_common.go:299] "Volume detached for volume \"node-bootstrap-token\" (UniqueName: \"kubernetes.io/secret/593a3561-7760-45c5-8f91-5aaef7475d0f-node-bootstrap-token\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.786705 5120 reconciler_common.go:299] "Volume detached for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/af33e427-6803-48c2-a76a-dd9deb7cbf9a-env-overrides\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.786712 5120 reconciler_common.go:299] "Volume detached for volume \"v4-0-config-system-service-ca\" (UniqueName: \"kubernetes.io/configmap/6edfcf45-925b-4eff-b940-95b6fc0b85d4-v4-0-config-system-service-ca\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.786720 5120 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f65c0ac1-8bca-454d-a2e6-e35cb418beac-tmp-dir\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.786729 5120 reconciler_common.go:299] "Volume detached for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7df94c10-441d-4386-93a6-6730fb7bcde0-ovnkube-config\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.786737 5120 reconciler_common.go:299] "Volume detached for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d7e8f42f-dc0e-424b-bb56-5ec849834888-serving-cert\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.786745 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qqbfk\" (UniqueName: \"kubernetes.io/projected/b05a4c1d-fa93-4d3d-b6e5-235473e1ae2a-kube-api-access-qqbfk\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.786767 5120 reconciler_common.go:299] "Volume detached for volume \"images\" (UniqueName: \"kubernetes.io/configmap/d565531a-ff86-4608-9d19-767de01ac31b-images\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.786776 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ddlk9\" (UniqueName: \"kubernetes.io/projected/7fcc6409-8a0f-44c3-89e7-5aecd7610f8a-kube-api-access-ddlk9\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.787143 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-99zj9\" (UniqueName: \"kubernetes.io/projected/d565531a-ff86-4608-9d19-767de01ac31b-kube-api-access-99zj9\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.787155 5120 reconciler_common.go:299] "Volume detached for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7afa918d-be67-40a6-803c-d3b0ae99d815-serving-cert\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.787164 5120 reconciler_common.go:299] "Volume detached for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/a555ff2e-0be6-46d5-897d-863bb92ae2b3-proxy-ca-bundles\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.787172 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zg8nc\" (UniqueName: \"kubernetes.io/projected/2325ffef-9d5b-447f-b00e-3efc429acefe-kube-api-access-zg8nc\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.787183 5120 reconciler_common.go:299] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/94a6e063-3d1a-4d44-875d-185291448c31-utilities\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.787191 5120 reconciler_common.go:299] "Volume detached for volume \"package-server-manager-serving-cert\" (UniqueName: \"kubernetes.io/secret/a208c9c2-333b-4b4a-be0d-bc32ec38a821-package-server-manager-serving-cert\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.787201 5120 reconciler_common.go:299] "Volume detached for volume \"mcc-auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/b4750666-1362-4001-abd0-6f89964cc621-mcc-auth-proxy-config\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.787211 5120 reconciler_common.go:299] "Volume detached for volume \"images\" (UniqueName: \"kubernetes.io/configmap/c491984c-7d4b-44aa-8c1e-d7974424fa47-images\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.787219 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d19cb085-0c5b-4810-b654-ce7923221d90-config\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.787227 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pllx6\" (UniqueName: \"kubernetes.io/projected/81e39f7b-62e4-4fc9-992a-6535ce127a02-kube-api-access-pllx6\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.787235 5120 reconciler_common.go:299] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/71c8ffbe-59c6-4e7d-aa1a-bbd315b3414a-utilities\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.787243 5120 reconciler_common.go:299] "Volume detached for volume \"etcd-client\" (UniqueName: \"kubernetes.io/secret/567683bd-0efc-4f21-b076-e28559628404-etcd-client\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.787251 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/7afa918d-be67-40a6-803c-d3b0ae99d815-kube-api-access\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.787259 5120 reconciler_common.go:299] "Volume detached for volume \"audit-policies\" (UniqueName: \"kubernetes.io/configmap/f559dfa3-3917-43a2-97f6-61ddfda10e93-audit-policies\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.787830 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92dfbade-90b6-4169-8c07-72cff7f2c82b-metrics-tls" (OuterVolumeSpecName: "metrics-tls") pod "92dfbade-90b6-4169-8c07-72cff7f2c82b" (UID: "92dfbade-90b6-4169-8c07-72cff7f2c82b"). InnerVolumeSpecName "metrics-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.790874 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/428b39f5-eb1c-4f65-b7a4-eeb6e84860cc-iptables-alerter-script\") pod \"iptables-alerter-5jnd7\" (UID: \"428b39f5-eb1c-4f65-b7a4-eeb6e84860cc\") " pod="openshift-network-operator/iptables-alerter-5jnd7" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.796743 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/593a3561-7760-45c5-8f91-5aaef7475d0f-certs" (OuterVolumeSpecName: "certs") pod "593a3561-7760-45c5-8f91-5aaef7475d0f" (UID: "593a3561-7760-45c5-8f91-5aaef7475d0f"). InnerVolumeSpecName "certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.796918 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31fa8943-81cc-4750-a0b7-0fa9ab5af883-kube-api-access-grwfz" (OuterVolumeSpecName: "kube-api-access-grwfz") pod "31fa8943-81cc-4750-a0b7-0fa9ab5af883" (UID: "31fa8943-81cc-4750-a0b7-0fa9ab5af883"). InnerVolumeSpecName "kube-api-access-grwfz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.796938 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7e8f42f-dc0e-424b-bb56-5ec849834888-kube-api-access" (OuterVolumeSpecName: "kube-api-access") pod "d7e8f42f-dc0e-424b-bb56-5ec849834888" (UID: "d7e8f42f-dc0e-424b-bb56-5ec849834888"). InnerVolumeSpecName "kube-api-access". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.796967 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d19cb085-0c5b-4810-b654-ce7923221d90-encryption-config" (OuterVolumeSpecName: "encryption-config") pod "d19cb085-0c5b-4810-b654-ce7923221d90" (UID: "d19cb085-0c5b-4810-b654-ce7923221d90"). InnerVolumeSpecName "encryption-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.797278 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/584e1f4a-8205-47d7-8efb-3afc6017c4c9-kube-api-access-tknt7" (OuterVolumeSpecName: "kube-api-access-tknt7") pod "584e1f4a-8205-47d7-8efb-3afc6017c4c9" (UID: "584e1f4a-8205-47d7-8efb-3afc6017c4c9"). InnerVolumeSpecName "kube-api-access-tknt7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.797625 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31fa8943-81cc-4750-a0b7-0fa9ab5af883-utilities" (OuterVolumeSpecName: "utilities") pod "31fa8943-81cc-4750-a0b7-0fa9ab5af883" (UID: "31fa8943-81cc-4750-a0b7-0fa9ab5af883"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.797631 5120 status_manager.go:919] "Failed to update status for pod" pod="openshift-ovn-kubernetes/ovnkube-control-plane-57b78d8988-hbs9k" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"8e29c57a-87ae-4f7a-82f5-867e05ccf280\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T15:33:21Z\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T15:33:21Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T15:33:21Z\\\",\\\"message\\\":\\\"containers with unready status: [kube-rbac-proxy ovnkube-cluster-manager]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T15:33:21Z\\\",\\\"message\\\":\\\"containers with unready status: [kube-rbac-proxy ovnkube-cluster-manager]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/pki/tls/metrics-cert\\\",\\\"name\\\":\\\"ovn-control-plane-metrics-cert\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-b9hvt\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"ovnkube-cluster-manager\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/run/ovnkube-config/\\\",\\\"name\\\":\\\"ovnkube-config\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-b9hvt\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T15:33:21Z\\\"}}\" for pod \"openshift-ovn-kubernetes\"/\"ovnkube-control-plane-57b78d8988-hbs9k\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.797843 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01080b46-74f1-4191-8755-5152a57b3b25-kube-api-access-w94wk" (OuterVolumeSpecName: "kube-api-access-w94wk") pod "01080b46-74f1-4191-8755-5152a57b3b25" (UID: "01080b46-74f1-4191-8755-5152a57b3b25"). InnerVolumeSpecName "kube-api-access-w94wk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: E0316 15:33:21.797847 5120 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Mar 16 15:33:21 crc kubenswrapper[5120]: E0316 15:33:21.797879 5120 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Mar 16 15:33:21 crc kubenswrapper[5120]: E0316 15:33:21.797893 5120 projected.go:194] Error preparing data for projected volume kube-api-access-l7w75 for pod openshift-network-diagnostics/network-check-source-5bb8f5cd97-xdvz5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Mar 16 15:33:21 crc kubenswrapper[5120]: E0316 15:33:21.798000 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f863fff9-286a-45fa-b8f0-8a86994b8440-kube-api-access-l7w75 podName:f863fff9-286a-45fa-b8f0-8a86994b8440 nodeName:}" failed. No retries permitted until 2026-03-16 15:33:22.297978942 +0000 UTC m=+104.451910599 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-l7w75" (UniqueName: "kubernetes.io/projected/f863fff9-286a-45fa-b8f0-8a86994b8440-kube-api-access-l7w75") pod "network-check-source-5bb8f5cd97-xdvz5" (UID: "f863fff9-286a-45fa-b8f0-8a86994b8440") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.798358 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/149b3c48-e17c-4a66-a835-d86dabf6ff13-utilities" (OuterVolumeSpecName: "utilities") pod "149b3c48-e17c-4a66-a835-d86dabf6ff13" (UID: "149b3c48-e17c-4a66-a835-d86dabf6ff13"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: E0316 15:33:21.798400 5120 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Mar 16 15:33:21 crc kubenswrapper[5120]: E0316 15:33:21.798420 5120 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Mar 16 15:33:21 crc kubenswrapper[5120]: E0316 15:33:21.798467 5120 projected.go:194] Error preparing data for projected volume kube-api-access-gwt8b for pod openshift-network-diagnostics/network-check-target-fhkjl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Mar 16 15:33:21 crc kubenswrapper[5120]: E0316 15:33:21.798542 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/17b87002-b798-480a-8e17-83053d698239-kube-api-access-gwt8b podName:17b87002-b798-480a-8e17-83053d698239 nodeName:}" failed. No retries permitted until 2026-03-16 15:33:22.298521656 +0000 UTC m=+104.452453313 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-gwt8b" (UniqueName: "kubernetes.io/projected/17b87002-b798-480a-8e17-83053d698239-kube-api-access-gwt8b") pod "network-check-target-fhkjl" (UID: "17b87002-b798-480a-8e17-83053d698239") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.798855 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fc4541ce-7789-4670-bc75-5c2868e52ce0-webhook-cert\") pod \"network-node-identity-dgvkt\" (UID: \"fc4541ce-7789-4670-bc75-5c2868e52ce0\") " pod="openshift-network-node-identity/network-node-identity-dgvkt" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.798966 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b605f283-6f2e-42da-a838-54421690f7d0-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "b605f283-6f2e-42da-a838-54421690f7d0" (UID: "b605f283-6f2e-42da-a838-54421690f7d0"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.799306 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b605f283-6f2e-42da-a838-54421690f7d0-utilities" (OuterVolumeSpecName: "utilities") pod "b605f283-6f2e-42da-a838-54421690f7d0" (UID: "b605f283-6f2e-42da-a838-54421690f7d0"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.799887 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16bdd140-dce1-464c-ab47-dd5798d1d256-available-featuregates" (OuterVolumeSpecName: "available-featuregates") pod "16bdd140-dce1-464c-ab47-dd5798d1d256" (UID: "16bdd140-dce1-464c-ab47-dd5798d1d256"). InnerVolumeSpecName "available-featuregates". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.802507 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dsgwk\" (UniqueName: \"kubernetes.io/projected/428b39f5-eb1c-4f65-b7a4-eeb6e84860cc-kube-api-access-dsgwk\") pod \"iptables-alerter-5jnd7\" (UID: \"428b39f5-eb1c-4f65-b7a4-eeb6e84860cc\") " pod="openshift-network-operator/iptables-alerter-5jnd7" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.802568 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/34177974-8d82-49d2-a763-391d0df3bbd8-metrics-tls\") pod \"network-operator-7bdcf4f5bd-7fjxv\" (UID: \"34177974-8d82-49d2-a763-391d0df3bbd8\") " pod="openshift-network-operator/network-operator-7bdcf4f5bd-7fjxv" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.803948 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8nt2j\" (UniqueName: \"kubernetes.io/projected/fc4541ce-7789-4670-bc75-5c2868e52ce0-kube-api-access-8nt2j\") pod \"network-node-identity-dgvkt\" (UID: \"fc4541ce-7789-4670-bc75-5c2868e52ce0\") " pod="openshift-network-node-identity/network-node-identity-dgvkt" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.804617 5120 status_manager.go:919] "Failed to update status for pod" pod="openshift-image-registry/node-ca-7sp2j" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"6fd3bcf4-5dd2-45e2-b8a8-a83c8b02903f\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T15:33:21Z\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T15:33:21Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T15:33:21Z\\\",\\\"message\\\":\\\"containers with unready status: [node-ca]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T15:33:21Z\\\",\\\"message\\\":\\\"containers with unready status: [node-ca]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dcb03ccba25366bbdf74cbab6738e7ef1f97f62760886ec445a40cdf29b60418\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"node-ca\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/tmp/serviceca\\\",\\\"name\\\":\\\"serviceca\\\"},{\\\"mountPath\\\":\\\"/etc/docker/certs.d\\\",\\\"name\\\":\\\"host\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-rwj94\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T15:33:21Z\\\"}}\" for pod \"openshift-image-registry\"/\"node-ca-7sp2j\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.804873 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b605f283-6f2e-42da-a838-54421690f7d0-kube-api-access-6rmnv" (OuterVolumeSpecName: "kube-api-access-6rmnv") pod "b605f283-6f2e-42da-a838-54421690f7d0" (UID: "b605f283-6f2e-42da-a838-54421690f7d0"). InnerVolumeSpecName "kube-api-access-6rmnv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.804928 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ebfebf6-3ecd-458e-943f-bb25b52e2718-serviceca" (OuterVolumeSpecName: "serviceca") pod "5ebfebf6-3ecd-458e-943f-bb25b52e2718" (UID: "5ebfebf6-3ecd-458e-943f-bb25b52e2718"). InnerVolumeSpecName "serviceca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.805143 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d565531a-ff86-4608-9d19-767de01ac31b-auth-proxy-config" (OuterVolumeSpecName: "auth-proxy-config") pod "d565531a-ff86-4608-9d19-767de01ac31b" (UID: "d565531a-ff86-4608-9d19-767de01ac31b"). InnerVolumeSpecName "auth-proxy-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.805402 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca-console-config" (OuterVolumeSpecName: "console-config") pod "6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca" (UID: "6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.805506 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d19cb085-0c5b-4810-b654-ce7923221d90-serving-cert" (OuterVolumeSpecName: "serving-cert") pod "d19cb085-0c5b-4810-b654-ce7923221d90" (UID: "d19cb085-0c5b-4810-b654-ce7923221d90"). InnerVolumeSpecName "serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.805735 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7xz2\" (UniqueName: \"kubernetes.io/projected/34177974-8d82-49d2-a763-391d0df3bbd8-kube-api-access-m7xz2\") pod \"network-operator-7bdcf4f5bd-7fjxv\" (UID: \"34177974-8d82-49d2-a763-391d0df3bbd8\") " pod="openshift-network-operator/network-operator-7bdcf4f5bd-7fjxv" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.805794 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9276f8f5-2f24-48e1-ab6d-1aab0d8ec3ff-kube-api-access-xxfcv" (OuterVolumeSpecName: "kube-api-access-xxfcv") pod "9276f8f5-2f24-48e1-ab6d-1aab0d8ec3ff" (UID: "9276f8f5-2f24-48e1-ab6d-1aab0d8ec3ff"). InnerVolumeSpecName "kube-api-access-xxfcv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.805924 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7a88189-c967-4640-879e-27665747f20c-apiservice-cert" (OuterVolumeSpecName: "apiservice-cert") pod "a7a88189-c967-4640-879e-27665747f20c" (UID: "a7a88189-c967-4640-879e-27665747f20c"). InnerVolumeSpecName "apiservice-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.805957 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dcd10325-9ba5-4a3b-8e4a-e57e3bf210f9-serving-cert" (OuterVolumeSpecName: "serving-cert") pod "dcd10325-9ba5-4a3b-8e4a-e57e3bf210f9" (UID: "dcd10325-9ba5-4a3b-8e4a-e57e3bf210f9"). InnerVolumeSpecName "serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.806236 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/81e39f7b-62e4-4fc9-992a-6535ce127a02-multus-daemon-config" (OuterVolumeSpecName: "multus-daemon-config") pod "81e39f7b-62e4-4fc9-992a-6535ce127a02" (UID: "81e39f7b-62e4-4fc9-992a-6535ce127a02"). InnerVolumeSpecName "multus-daemon-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.806678 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/736c54fe-349c-4bb9-870a-d1c1d1c03831-kube-api-access-6dmhf" (OuterVolumeSpecName: "kube-api-access-6dmhf") pod "736c54fe-349c-4bb9-870a-d1c1d1c03831" (UID: "736c54fe-349c-4bb9-870a-d1c1d1c03831"). InnerVolumeSpecName "kube-api-access-6dmhf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.806843 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7a88189-c967-4640-879e-27665747f20c-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "a7a88189-c967-4640-879e-27665747f20c" (UID: "a7a88189-c967-4640-879e-27665747f20c"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.809748 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/149b3c48-e17c-4a66-a835-d86dabf6ff13-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "149b3c48-e17c-4a66-a835-d86dabf6ff13" (UID: "149b3c48-e17c-4a66-a835-d86dabf6ff13"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.811233 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f559dfa3-3917-43a2-97f6-61ddfda10e93-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "f559dfa3-3917-43a2-97f6-61ddfda10e93" (UID: "f559dfa3-3917-43a2-97f6-61ddfda10e93"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.811813 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/301e1965-1754-483d-b6cc-bfae7038bbca-srv-cert" (OuterVolumeSpecName: "srv-cert") pod "301e1965-1754-483d-b6cc-bfae7038bbca" (UID: "301e1965-1754-483d-b6cc-bfae7038bbca"). InnerVolumeSpecName "srv-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.811877 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a555ff2e-0be6-46d5-897d-863bb92ae2b3-config" (OuterVolumeSpecName: "config") pod "a555ff2e-0be6-46d5-897d-863bb92ae2b3" (UID: "a555ff2e-0be6-46d5-897d-863bb92ae2b3"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.811889 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ee8fbd3-1f81-4666-96da-5afc70819f1a-samples-operator-tls" (OuterVolumeSpecName: "samples-operator-tls") pod "6ee8fbd3-1f81-4666-96da-5afc70819f1a" (UID: "6ee8fbd3-1f81-4666-96da-5afc70819f1a"). InnerVolumeSpecName "samples-operator-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.812578 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/736c54fe-349c-4bb9-870a-d1c1d1c03831-client-ca" (OuterVolumeSpecName: "client-ca") pod "736c54fe-349c-4bb9-870a-d1c1d1c03831" (UID: "736c54fe-349c-4bb9-870a-d1c1d1c03831"). InnerVolumeSpecName "client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.812752 5120 status_manager.go:919] "Failed to update status for pod" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"e2275cb4-4905-4d66-a87e-8010120db2bd\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T15:33:21Z\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T15:33:21Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T15:33:21Z\\\",\\\"message\\\":\\\"containers with unready status: [machine-config-daemon kube-rbac-proxy]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T15:33:21Z\\\",\\\"message\\\":\\\"containers with unready status: [machine-config-daemon kube-rbac-proxy]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/tls/private\\\",\\\"name\\\":\\\"proxy-tls\\\"},{\\\"mountPath\\\":\\\"/etc/kube-rbac-proxy\\\",\\\"name\\\":\\\"mcd-auth-proxy-config\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-lbscd\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9414357f9345a841e0565265700ecc6637f846c83bd5908dbb7b306432465115\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"machine-config-daemon\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/rootfs\\\",\\\"name\\\":\\\"rootfs\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-lbscd\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T15:33:21Z\\\"}}\" for pod \"openshift-machine-config-operator\"/\"machine-config-daemon-7bf76\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.813054 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2325ffef-9d5b-447f-b00e-3efc429acefe-config" (OuterVolumeSpecName: "config") pod "2325ffef-9d5b-447f-b00e-3efc429acefe" (UID: "2325ffef-9d5b-447f-b00e-3efc429acefe"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.813556 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2325ffef-9d5b-447f-b00e-3efc429acefe-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "2325ffef-9d5b-447f-b00e-3efc429acefe" (UID: "2325ffef-9d5b-447f-b00e-3efc429acefe"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.813606 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6edfcf45-925b-4eff-b940-95b6fc0b85d4-v4-0-config-user-idp-0-file-data" (OuterVolumeSpecName: "v4-0-config-user-idp-0-file-data") pod "6edfcf45-925b-4eff-b940-95b6fc0b85d4" (UID: "6edfcf45-925b-4eff-b940-95b6fc0b85d4"). InnerVolumeSpecName "v4-0-config-user-idp-0-file-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.813629 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d7e8f42f-dc0e-424b-bb56-5ec849834888-service-ca" (OuterVolumeSpecName: "service-ca") pod "d7e8f42f-dc0e-424b-bb56-5ec849834888" (UID: "d7e8f42f-dc0e-424b-bb56-5ec849834888"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.813822 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6edfcf45-925b-4eff-b940-95b6fc0b85d4-v4-0-config-user-template-error" (OuterVolumeSpecName: "v4-0-config-user-template-error") pod "6edfcf45-925b-4eff-b940-95b6fc0b85d4" (UID: "6edfcf45-925b-4eff-b940-95b6fc0b85d4"). InnerVolumeSpecName "v4-0-config-user-template-error". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.814153 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc8db2c7-859d-47b3-a900-2bd0c0b2973b-config" (OuterVolumeSpecName: "config") pod "fc8db2c7-859d-47b3-a900-2bd0c0b2973b" (UID: "fc8db2c7-859d-47b3-a900-2bd0c0b2973b"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.814167 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e093be35-bb62-4843-b2e8-094545761610-kube-api-access-pddnv" (OuterVolumeSpecName: "kube-api-access-pddnv") pod "e093be35-bb62-4843-b2e8-094545761610" (UID: "e093be35-bb62-4843-b2e8-094545761610"). InnerVolumeSpecName "kube-api-access-pddnv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.814510 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6edfcf45-925b-4eff-b940-95b6fc0b85d4-v4-0-config-system-serving-cert" (OuterVolumeSpecName: "v4-0-config-system-serving-cert") pod "6edfcf45-925b-4eff-b940-95b6fc0b85d4" (UID: "6edfcf45-925b-4eff-b940-95b6fc0b85d4"). InnerVolumeSpecName "v4-0-config-system-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.814542 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20ce4d18-fe25-4696-ad7c-1bd2d6200a3e-ca-trust-extracted-pem" (OuterVolumeSpecName: "ca-trust-extracted-pem") pod "20ce4d18-fe25-4696-ad7c-1bd2d6200a3e" (UID: "20ce4d18-fe25-4696-ad7c-1bd2d6200a3e"). InnerVolumeSpecName "ca-trust-extracted-pem". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.814718 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca" (UID: "6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.814839 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6edfcf45-925b-4eff-b940-95b6fc0b85d4-v4-0-config-system-router-certs" (OuterVolumeSpecName: "v4-0-config-system-router-certs") pod "6edfcf45-925b-4eff-b940-95b6fc0b85d4" (UID: "6edfcf45-925b-4eff-b940-95b6fc0b85d4"). InnerVolumeSpecName "v4-0-config-system-router-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.814984 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/736c54fe-349c-4bb9-870a-d1c1d1c03831-config" (OuterVolumeSpecName: "config") pod "736c54fe-349c-4bb9-870a-d1c1d1c03831" (UID: "736c54fe-349c-4bb9-870a-d1c1d1c03831"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.815174 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ee8fbd3-1f81-4666-96da-5afc70819f1a-kube-api-access-d4tqq" (OuterVolumeSpecName: "kube-api-access-d4tqq") pod "6ee8fbd3-1f81-4666-96da-5afc70819f1a" (UID: "6ee8fbd3-1f81-4666-96da-5afc70819f1a"). InnerVolumeSpecName "kube-api-access-d4tqq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.815282 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dcd10325-9ba5-4a3b-8e4a-e57e3bf210f9-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "dcd10325-9ba5-4a3b-8e4a-e57e3bf210f9" (UID: "dcd10325-9ba5-4a3b-8e4a-e57e3bf210f9"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.815344 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca-service-ca" (OuterVolumeSpecName: "service-ca") pod "6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca" (UID: "6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.819704 5120 status_manager.go:919] "Failed to update status for pod" pod="openshift-network-diagnostics/network-check-target-fhkjl" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"17b87002-b798-480a-8e17-83053d698239\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-03-16T15:33:21Z\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"message\\\":\\\"containers with unready status: [network-check-target-container]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-03-16T15:33:21Z\\\",\\\"message\\\":\\\"containers with unready status: [network-check-target-container]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a8581a82ba5c8343a743aa302c4848249d8c32a9f2cd10fa68d89d835a1bdf8b\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"exitCode\\\":137,\\\"finishedAt\\\":null,\\\"message\\\":\\\"The container could not be located when the pod was deleted. The container used to be Running\\\",\\\"reason\\\":\\\"ContainerStatusUnknown\\\",\\\"startedAt\\\":null}},\\\"name\\\":\\\"network-check-target-container\\\",\\\"ready\\\":false,\\\"restartCount\\\":4,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-gwt8b\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"podIP\\\":null,\\\"podIPs\\\":null}}\" for pod \"openshift-network-diagnostics\"/\"network-check-target-fhkjl\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.822607 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e9b5059-1b3e-4067-a63d-2952cbe863af-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.827736 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31fa8943-81cc-4750-a0b7-0fa9ab5af883-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "31fa8943-81cc-4750-a0b7-0fa9ab5af883" (UID: "31fa8943-81cc-4750-a0b7-0fa9ab5af883"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.827337 5120 status_manager.go:919] "Failed to update status for pod" pod="openshift-network-console/networking-console-plugin-5ff7774fd9-nljh6" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"6a9ae5f6-97bd-46ac-bafa-ca1b4452a141\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-03-16T15:33:21Z\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"message\\\":\\\"containers with unready status: [networking-console-plugin]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-03-16T15:33:21Z\\\",\\\"message\\\":\\\"containers with unready status: [networking-console-plugin]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:fbdfe828b092b23e6d4480daf3e0216aada6debaf1ef1b314a0a31e73ebf13c4\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"exitCode\\\":137,\\\"finishedAt\\\":null,\\\"message\\\":\\\"The container could not be located when the pod was deleted. The container used to be Running\\\",\\\"reason\\\":\\\"ContainerStatusUnknown\\\",\\\"startedAt\\\":null}},\\\"name\\\":\\\"networking-console-plugin\\\",\\\"ready\\\":false,\\\"restartCount\\\":4,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/cert\\\",\\\"name\\\":\\\"networking-console-plugin-cert\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/nginx/nginx.conf\\\",\\\"name\\\":\\\"nginx-conf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"podIP\\\":null,\\\"podIPs\\\":null}}\" for pod \"openshift-network-console\"/\"networking-console-plugin-5ff7774fd9-nljh6\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.837400 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71c8ffbe-59c6-4e7d-aa1a-bbd315b3414a-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "71c8ffbe-59c6-4e7d-aa1a-bbd315b3414a" (UID: "71c8ffbe-59c6-4e7d-aa1a-bbd315b3414a"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.840937 5120 status_manager.go:919] "Failed to update status for pod" pod="openshift-multus/multus-additional-cni-plugins-qqjfh" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"2b62d686-4b05-42c7-b806-9e2caf8c34e8\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T15:33:21Z\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T15:33:21Z\\\",\\\"message\\\":\\\"containers with incomplete status: [egress-router-binary-copy cni-plugins bond-cni-plugin routeoverride-cni whereabouts-cni-bincopy whereabouts-cni]\\\",\\\"reason\\\":\\\"ContainersNotInitialized\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T15:33:21Z\\\",\\\"message\\\":\\\"containers with unready status: [kube-multus-additional-cni-plugins]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T15:33:21Z\\\",\\\"message\\\":\\\"containers with unready status: [kube-multus-additional-cni-plugins]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:85f1323d589d7af13b096b1f9b438b9dfe08f3fab37534e2780e6490a665bf05\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-multus-additional-cni-plugins\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-p7cgz\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"initContainerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5a2a7b3c2f1598189d8880e6aa15ab11a65b201f25012f77ba41e7487a60729a\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"egress-router-binary-copy\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-p7cgz\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1b55c029f731ebbde3c5580eef98a588264f4d6a8ae667805c9521dd1ecf1d5d\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"cni-plugins\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/host/etc/cni/tuning/\\\",\\\"name\\\":\\\"tuning-conf-dir\\\"},{\\\"mountPath\\\":\\\"/sysctls\\\",\\\"name\\\":\\\"cni-sysctl-allowlist\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-p7cgz\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6efa070ceb93cc5fc2e76eab6d9c96ac3c4f8812085d0b6eb6e3f513b5bac782\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"bond-cni-plugin\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-p7cgz\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c3454e762466e22e2a893650b9781823558bc6fdfda2aa4188aff3cb819014c4\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"routeoverride-cni\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-p7cgz\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:be2edaed22535093bdb486afe5960ff4f3b0bd96f88dc1753b584cc28184a0b0\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"whereabouts-cni-bincopy\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-p7cgz\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:be2edaed22535093bdb486afe5960ff4f3b0bd96f88dc1753b584cc28184a0b0\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"whereabouts-cni\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/cni/net.d\\\",\\\"name\\\":\\\"system-cni-dir\\\"},{\\\"mountPath\\\":\\\"/etc/whereabouts/config\\\",\\\"name\\\":\\\"whereabouts-flatfile-configmap\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-p7cgz\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T15:33:21Z\\\"}}\" for pod \"openshift-multus\"/\"multus-additional-cni-plugins-qqjfh\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.845377 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94a6e063-3d1a-4d44-875d-185291448c31-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "94a6e063-3d1a-4d44-875d-185291448c31" (UID: "94a6e063-3d1a-4d44-875d-185291448c31"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.849636 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.849674 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.849684 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.849697 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.849706 5120 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T15:33:21Z","lastTransitionTime":"2026-03-16T15:33:21Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.856786 5120 status_manager.go:919] "Failed to update status for pod" pod="openshift-etcd/etcd-crc" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"f4ac37c6-4285-4105-9c4a-74b435774eeb\\\"},\\\"status\\\":{\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T15:31:40Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T15:31:42Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T15:31:57Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T15:31:57Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T15:31:38Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"300m\\\",\\\"memory\\\":\\\"600Mi\\\"},\\\"containerID\\\":\\\"cri-o://f85d3d869320f76bbbd1bf2ac6b7a3ac9a62d2bfad7fee06123b78ce62f50406\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"etcd\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"300m\\\",\\\"memory\\\":\\\"600Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T15:31:43Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/manifests\\\",\\\"name\\\":\\\"static-pod-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/var/lib/etcd/\\\",\\\"name\\\":\\\"data-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"40m\\\",\\\"memory\\\":\\\"200Mi\\\"},\\\"containerID\\\":\\\"cri-o://da5bbbf51b1e614b75c1543034114f2e1e9f8fc1efd7d6923496dd445194cb22\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"etcd-metrics\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"40m\\\",\\\"memory\\\":\\\"200Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T15:31:43Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/var/lib/etcd/\\\",\\\"name\\\":\\\"data-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://f48cd7f620741373f776ce8314bdaf2ff4145d9170a8c294eea39c769c3ebd2a\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf05b9b2ba66351a6c59f4259fb377f62237a00af3b4f0b95f64409e2f25770e\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf05b9b2ba66351a6c59f4259fb377f62237a00af3b4f0b95f64409e2f25770e\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"etcd-readyz\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T15:31:43Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/log/etcd/\\\",\\\"name\\\":\\\"log-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://632e67eb05383c65bb6faab55bac99af4275f8c6791f8f05ce627da856d54de8\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf05b9b2ba66351a6c59f4259fb377f62237a00af3b4f0b95f64409e2f25770e\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf05b9b2ba66351a6c59f4259fb377f62237a00af3b4f0b95f64409e2f25770e\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"etcd-rev\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T15:31:43Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/lib/etcd\\\",\\\"name\\\":\\\"data-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"60Mi\\\"},\\\"containerID\\\":\\\"cri-o://12c707c6a49d9d6d8c45539c70ce5d61ce3c69e71abcbc95c0f2725b475b28ca\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"etcdctl\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"60Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T15:31:42Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/manifests\\\",\\\"name\\\":\\\"static-pod-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/var/lib/etcd/\\\",\\\"name\\\":\\\"data-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"initContainerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://c354f90b6dbeb20f25a62d5ca94758bd3ff83a3540a04512e0e38546047ce163\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"setup\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://c354f90b6dbeb20f25a62d5ca94758bd3ff83a3540a04512e0e38546047ce163\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-03-16T15:31:39Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-03-16T15:31:39Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/log/etcd\\\",\\\"name\\\":\\\"log-dir\\\"},{\\\"mountPath\\\":\\\"/var/lib/etcd-auto-backup\\\",\\\"name\\\":\\\"etcd-auto-backup-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"60Mi\\\"},\\\"containerID\\\":\\\"cri-o://8ddb1a120ac261ba2c1f857a551235412dcfed490e8524a7d3fc53d4568ba54b\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"etcd-ensure-env-vars\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"60Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://8ddb1a120ac261ba2c1f857a551235412dcfed490e8524a7d3fc53d4568ba54b\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-03-16T15:31:40Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-03-16T15:31:40Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}}},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"60Mi\\\"},\\\"containerID\\\":\\\"cri-o://8286e76226838b95f57c216d021c120eb867e6991c697ec6cede61970ccab703\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"etcd-resources-copy\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"60Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://8286e76226838b95f57c216d021c120eb867e6991c697ec6cede61970ccab703\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-03-16T15:31:41Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-03-16T15:31:41Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/usr/local/bin\\\",\\\"name\\\":\\\"usr-local-bin\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"}]}],\\\"phase\\\":\\\"Running\\\",\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T15:31:38Z\\\"}}\" for pod \"openshift-etcd\"/\"etcd-crc\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.868600 5120 status_manager.go:919] "Failed to update status for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zwk29" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"1ba0f093-ad5c-4a99-bfc2-8439162d5b72\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T15:33:21Z\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T15:33:21Z\\\",\\\"message\\\":\\\"containers with incomplete status: [kubecfg-setup]\\\",\\\"reason\\\":\\\"ContainersNotInitialized\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T15:33:21Z\\\",\\\"message\\\":\\\"containers with unready status: [ovn-controller ovn-acl-logging kube-rbac-proxy-node kube-rbac-proxy-ovn-metrics northd nbdb sbdb ovnkube-controller]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T15:33:21Z\\\",\\\"message\\\":\\\"containers with unready status: [ovn-controller ovn-acl-logging kube-rbac-proxy-node kube-rbac-proxy-ovn-metrics northd nbdb sbdb ovnkube-controller]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy-node\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/pki/tls/metrics-cert\\\",\\\"name\\\":\\\"ovn-node-metrics-cert\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-tjz24\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy-ovn-metrics\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/pki/tls/metrics-cert\\\",\\\"name\\\":\\\"ovn-node-metrics-cert\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-tjz24\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"nbdb\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-tjz24\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"northd\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/ovn\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-tjz24\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"ovn-acl-logging\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn/\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-tjz24\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"ovn-controller\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/run/openvswitch\\\",\\\"name\\\":\\\"run-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/etc/openvswitch\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/lib/openvswitch\\\",\\\"name\\\":\\\"var-lib-openvswitch\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn/\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/dev/log\\\",\\\"name\\\":\\\"log-socket\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-tjz24\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"ovnkube-controller\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/var/lib/kubelet\\\",\\\"name\\\":\\\"host-kubelet\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/systemd/system\\\",\\\"name\\\":\\\"systemd-units\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/host\\\",\\\"name\\\":\\\"host-slash\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/run/ovn-kubernetes/\\\",\\\"name\\\":\\\"host-run-ovn-kubernetes\\\"},{\\\"mountPath\\\":\\\"/run/netns\\\",\\\"name\\\":\\\"host-run-netns\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/run/systemd/private\\\",\\\"name\\\":\\\"run-systemd\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/cni-bin-dir\\\",\\\"name\\\":\\\"host-cni-bin\\\"},{\\\"mountPath\\\":\\\"/etc/cni/net.d\\\",\\\"name\\\":\\\"host-cni-netd\\\"},{\\\"mountPath\\\":\\\"/var/lib/cni/networks/ovn-k8s-cni-overlay\\\",\\\"name\\\":\\\"host-var-lib-cni-networks-ovn-kubernetes\\\"},{\\\"mountPath\\\":\\\"/run/openvswitch\\\",\\\"name\\\":\\\"run-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/log/ovnkube/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/etc/openvswitch\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/lib/openvswitch\\\",\\\"name\\\":\\\"var-lib-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovnkube-config/\\\",\\\"name\\\":\\\"ovnkube-config\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-tjz24\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"sbdb\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-tjz24\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"initContainerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kubecfg-setup\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-tjz24\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T15:33:21Z\\\"}}\" for pod \"openshift-ovn-kubernetes\"/\"ovnkube-node-zwk29\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.875420 5120 status_manager.go:919] "Failed to update status for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-crc" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"46c89231-6195-48ad-9cb3-cc3df8128dad\\\"},\\\"status\\\":{\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T15:31:40Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T15:31:40Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T15:31:41Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T15:31:41Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T15:31:38Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"20m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://d9489b47395eac8078038aa9b5cf79964b0730a908fae78a1e451f5e298d904b\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy-crio\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"20m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T15:31:40Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes\\\",\\\"name\\\":\\\"etc-kube\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/lib/kubelet\\\",\\\"name\\\":\\\"var-lib-kubelet\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"initContainerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://f29b9a70f88e43eb9974d1df5623a1fa5d9a8dedde8afbfc2bf5d7f591119754\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"setup\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://f29b9a70f88e43eb9974d1df5623a1fa5d9a8dedde8afbfc2bf5d7f591119754\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-03-16T15:31:39Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-03-16T15:31:39Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var\\\",\\\"name\\\":\\\"var-lib-kubelet\\\"}]}],\\\"phase\\\":\\\"Running\\\",\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T15:31:38Z\\\"}}\" for pod \"openshift-machine-config-operator\"/\"kube-rbac-proxy-crio-crc\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.883863 5120 status_manager.go:919] "Failed to update status for pod" pod="openshift-network-operator/network-operator-7bdcf4f5bd-7fjxv" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"34177974-8d82-49d2-a763-391d0df3bbd8\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-03-16T15:33:21Z\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"message\\\":\\\"containers with unready status: [network-operator]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-03-16T15:33:21Z\\\",\\\"message\\\":\\\"containers with unready status: [network-operator]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a8581a82ba5c8343a743aa302c4848249d8c32a9f2cd10fa68d89d835a1bdf8b\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"exitCode\\\":137,\\\"finishedAt\\\":null,\\\"message\\\":\\\"The container could not be located when the pod was deleted. The container used to be Running\\\",\\\"reason\\\":\\\"ContainerStatusUnknown\\\",\\\"startedAt\\\":null}},\\\"name\\\":\\\"network-operator\\\",\\\"ready\\\":false,\\\"restartCount\\\":5,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes\\\",\\\"name\\\":\\\"host-etc-kube\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/serving-cert\\\",\\\"name\\\":\\\"metrics-tls\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-m7xz2\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}]}}\" for pod \"openshift-network-operator\"/\"network-operator-7bdcf4f5bd-7fjxv\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.888204 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2b62d686-4b05-42c7-b806-9e2caf8c34e8-cnibin\") pod \"multus-additional-cni-plugins-qqjfh\" (UID: \"2b62d686-4b05-42c7-b806-9e2caf8c34e8\") " pod="openshift-multus/multus-additional-cni-plugins-qqjfh" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.888234 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1ba0f093-ad5c-4a99-bfc2-8439162d5b72-ovn-node-metrics-cert\") pod \"ovnkube-node-zwk29\" (UID: \"1ba0f093-ad5c-4a99-bfc2-8439162d5b72\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwk29" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.888252 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/236824b8-2653-4916-ae64-5ff75a7d6178-tmp-dir\") pod \"node-resolver-jsv7k\" (UID: \"236824b8-2653-4916-ae64-5ff75a7d6178\") " pod="openshift-dns/node-resolver-jsv7k" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.888269 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-control-plane-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8e29c57a-87ae-4f7a-82f5-867e05ccf280-ovn-control-plane-metrics-cert\") pod \"ovnkube-control-plane-57b78d8988-hbs9k\" (UID: \"8e29c57a-87ae-4f7a-82f5-867e05ccf280\") " pod="openshift-ovn-kubernetes/ovnkube-control-plane-57b78d8988-hbs9k" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.888288 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p7cgz\" (UniqueName: \"kubernetes.io/projected/2b62d686-4b05-42c7-b806-9e2caf8c34e8-kube-api-access-p7cgz\") pod \"multus-additional-cni-plugins-qqjfh\" (UID: \"2b62d686-4b05-42c7-b806-9e2caf8c34e8\") " pod="openshift-multus/multus-additional-cni-plugins-qqjfh" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.888303 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1ba0f093-ad5c-4a99-bfc2-8439162d5b72-var-lib-openvswitch\") pod \"ovnkube-node-zwk29\" (UID: \"1ba0f093-ad5c-4a99-bfc2-8439162d5b72\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwk29" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.888409 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2b62d686-4b05-42c7-b806-9e2caf8c34e8-cnibin\") pod \"multus-additional-cni-plugins-qqjfh\" (UID: \"2b62d686-4b05-42c7-b806-9e2caf8c34e8\") " pod="openshift-multus/multus-additional-cni-plugins-qqjfh" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.888521 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tjz24\" (UniqueName: \"kubernetes.io/projected/1ba0f093-ad5c-4a99-bfc2-8439162d5b72-kube-api-access-tjz24\") pod \"ovnkube-node-zwk29\" (UID: \"1ba0f093-ad5c-4a99-bfc2-8439162d5b72\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwk29" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.888544 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ac55471d-4e42-475f-a082-50f611571482-multus-cni-dir\") pod \"multus-v822j\" (UID: \"ac55471d-4e42-475f-a082-50f611571482\") " pod="openshift-multus/multus-v822j" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.888557 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ac55471d-4e42-475f-a082-50f611571482-os-release\") pod \"multus-v822j\" (UID: \"ac55471d-4e42-475f-a082-50f611571482\") " pod="openshift-multus/multus-v822j" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.888571 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ac55471d-4e42-475f-a082-50f611571482-multus-socket-dir-parent\") pod \"multus-v822j\" (UID: \"ac55471d-4e42-475f-a082-50f611571482\") " pod="openshift-multus/multus-v822j" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.888586 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1ba0f093-ad5c-4a99-bfc2-8439162d5b72-run-systemd\") pod \"ovnkube-node-zwk29\" (UID: \"1ba0f093-ad5c-4a99-bfc2-8439162d5b72\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwk29" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.888609 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b9hvt\" (UniqueName: \"kubernetes.io/projected/8e29c57a-87ae-4f7a-82f5-867e05ccf280-kube-api-access-b9hvt\") pod \"ovnkube-control-plane-57b78d8988-hbs9k\" (UID: \"8e29c57a-87ae-4f7a-82f5-867e05ccf280\") " pod="openshift-ovn-kubernetes/ovnkube-control-plane-57b78d8988-hbs9k" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.888619 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/236824b8-2653-4916-ae64-5ff75a7d6178-tmp-dir\") pod \"node-resolver-jsv7k\" (UID: \"236824b8-2653-4916-ae64-5ff75a7d6178\") " pod="openshift-dns/node-resolver-jsv7k" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.888626 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ac55471d-4e42-475f-a082-50f611571482-host-run-multus-certs\") pod \"multus-v822j\" (UID: \"ac55471d-4e42-475f-a082-50f611571482\") " pod="openshift-multus/multus-v822j" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.888642 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac55471d-4e42-475f-a082-50f611571482-etc-kubernetes\") pod \"multus-v822j\" (UID: \"ac55471d-4e42-475f-a082-50f611571482\") " pod="openshift-multus/multus-v822j" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.888664 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1ba0f093-ad5c-4a99-bfc2-8439162d5b72-etc-openvswitch\") pod \"ovnkube-node-zwk29\" (UID: \"1ba0f093-ad5c-4a99-bfc2-8439162d5b72\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwk29" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.888680 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1ba0f093-ad5c-4a99-bfc2-8439162d5b72-run-ovn\") pod \"ovnkube-node-zwk29\" (UID: \"1ba0f093-ad5c-4a99-bfc2-8439162d5b72\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwk29" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.888688 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ac55471d-4e42-475f-a082-50f611571482-os-release\") pod \"multus-v822j\" (UID: \"ac55471d-4e42-475f-a082-50f611571482\") " pod="openshift-multus/multus-v822j" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.888696 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1ba0f093-ad5c-4a99-bfc2-8439162d5b72-host-cni-netd\") pod \"ovnkube-node-zwk29\" (UID: \"1ba0f093-ad5c-4a99-bfc2-8439162d5b72\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwk29" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.888712 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1ba0f093-ad5c-4a99-bfc2-8439162d5b72-var-lib-openvswitch\") pod \"ovnkube-node-zwk29\" (UID: \"1ba0f093-ad5c-4a99-bfc2-8439162d5b72\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwk29" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.888712 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rwj94\" (UniqueName: \"kubernetes.io/projected/6fd3bcf4-5dd2-45e2-b8a8-a83c8b02903f-kube-api-access-rwj94\") pod \"node-ca-7sp2j\" (UID: \"6fd3bcf4-5dd2-45e2-b8a8-a83c8b02903f\") " pod="openshift-image-registry/node-ca-7sp2j" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.888737 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lbscd\" (UniqueName: \"kubernetes.io/projected/e2275cb4-4905-4d66-a87e-8010120db2bd-kube-api-access-lbscd\") pod \"machine-config-daemon-7bf76\" (UID: \"e2275cb4-4905-4d66-a87e-8010120db2bd\") " pod="openshift-machine-config-operator/machine-config-daemon-7bf76" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.888776 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2b62d686-4b05-42c7-b806-9e2caf8c34e8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qqjfh\" (UID: \"2b62d686-4b05-42c7-b806-9e2caf8c34e8\") " pod="openshift-multus/multus-additional-cni-plugins-qqjfh" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.888792 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1ba0f093-ad5c-4a99-bfc2-8439162d5b72-ovnkube-config\") pod \"ovnkube-node-zwk29\" (UID: \"1ba0f093-ad5c-4a99-bfc2-8439162d5b72\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwk29" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.888809 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ac55471d-4e42-475f-a082-50f611571482-host-var-lib-cni-multus\") pod \"multus-v822j\" (UID: \"ac55471d-4e42-475f-a082-50f611571482\") " pod="openshift-multus/multus-v822j" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.888824 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ac55471d-4e42-475f-a082-50f611571482-multus-conf-dir\") pod \"multus-v822j\" (UID: \"ac55471d-4e42-475f-a082-50f611571482\") " pod="openshift-multus/multus-v822j" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.888840 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rootfs\" (UniqueName: \"kubernetes.io/host-path/e2275cb4-4905-4d66-a87e-8010120db2bd-rootfs\") pod \"machine-config-daemon-7bf76\" (UID: \"e2275cb4-4905-4d66-a87e-8010120db2bd\") " pod="openshift-machine-config-operator/machine-config-daemon-7bf76" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.888858 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8e29c57a-87ae-4f7a-82f5-867e05ccf280-env-overrides\") pod \"ovnkube-control-plane-57b78d8988-hbs9k\" (UID: \"8e29c57a-87ae-4f7a-82f5-867e05ccf280\") " pod="openshift-ovn-kubernetes/ovnkube-control-plane-57b78d8988-hbs9k" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.888878 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ac55471d-4e42-475f-a082-50f611571482-hostroot\") pod \"multus-v822j\" (UID: \"ac55471d-4e42-475f-a082-50f611571482\") " pod="openshift-multus/multus-v822j" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.888960 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ac55471d-4e42-475f-a082-50f611571482-multus-conf-dir\") pod \"multus-v822j\" (UID: \"ac55471d-4e42-475f-a082-50f611571482\") " pod="openshift-multus/multus-v822j" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.889086 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ac55471d-4e42-475f-a082-50f611571482-host-var-lib-cni-multus\") pod \"multus-v822j\" (UID: \"ac55471d-4e42-475f-a082-50f611571482\") " pod="openshift-multus/multus-v822j" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.889095 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1ba0f093-ad5c-4a99-bfc2-8439162d5b72-run-systemd\") pod \"ovnkube-node-zwk29\" (UID: \"1ba0f093-ad5c-4a99-bfc2-8439162d5b72\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwk29" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.889122 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rootfs\" (UniqueName: \"kubernetes.io/host-path/e2275cb4-4905-4d66-a87e-8010120db2bd-rootfs\") pod \"machine-config-daemon-7bf76\" (UID: \"e2275cb4-4905-4d66-a87e-8010120db2bd\") " pod="openshift-machine-config-operator/machine-config-daemon-7bf76" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.889433 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1ba0f093-ad5c-4a99-bfc2-8439162d5b72-etc-openvswitch\") pod \"ovnkube-node-zwk29\" (UID: \"1ba0f093-ad5c-4a99-bfc2-8439162d5b72\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwk29" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.889481 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ac55471d-4e42-475f-a082-50f611571482-host-run-multus-certs\") pod \"multus-v822j\" (UID: \"ac55471d-4e42-475f-a082-50f611571482\") " pod="openshift-multus/multus-v822j" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.889493 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8e29c57a-87ae-4f7a-82f5-867e05ccf280-env-overrides\") pod \"ovnkube-control-plane-57b78d8988-hbs9k\" (UID: \"8e29c57a-87ae-4f7a-82f5-867e05ccf280\") " pod="openshift-ovn-kubernetes/ovnkube-control-plane-57b78d8988-hbs9k" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.889512 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac55471d-4e42-475f-a082-50f611571482-etc-kubernetes\") pod \"multus-v822j\" (UID: \"ac55471d-4e42-475f-a082-50f611571482\") " pod="openshift-multus/multus-v822j" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.889543 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1ba0f093-ad5c-4a99-bfc2-8439162d5b72-host-cni-netd\") pod \"ovnkube-node-zwk29\" (UID: \"1ba0f093-ad5c-4a99-bfc2-8439162d5b72\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwk29" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.889551 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ac55471d-4e42-475f-a082-50f611571482-multus-daemon-config\") pod \"multus-v822j\" (UID: \"ac55471d-4e42-475f-a082-50f611571482\") " pod="openshift-multus/multus-v822j" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.889577 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1ba0f093-ad5c-4a99-bfc2-8439162d5b72-run-ovn\") pod \"ovnkube-node-zwk29\" (UID: \"1ba0f093-ad5c-4a99-bfc2-8439162d5b72\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwk29" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.889581 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1ba0f093-ad5c-4a99-bfc2-8439162d5b72-systemd-units\") pod \"ovnkube-node-zwk29\" (UID: \"1ba0f093-ad5c-4a99-bfc2-8439162d5b72\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwk29" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.889602 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1ba0f093-ad5c-4a99-bfc2-8439162d5b72-host-cni-bin\") pod \"ovnkube-node-zwk29\" (UID: \"1ba0f093-ad5c-4a99-bfc2-8439162d5b72\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwk29" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.889625 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1ba0f093-ad5c-4a99-bfc2-8439162d5b72-host-kubelet\") pod \"ovnkube-node-zwk29\" (UID: \"1ba0f093-ad5c-4a99-bfc2-8439162d5b72\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwk29" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.889663 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1ba0f093-ad5c-4a99-bfc2-8439162d5b72-host-kubelet\") pod \"ovnkube-node-zwk29\" (UID: \"1ba0f093-ad5c-4a99-bfc2-8439162d5b72\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwk29" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.889696 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1ba0f093-ad5c-4a99-bfc2-8439162d5b72-systemd-units\") pod \"ovnkube-node-zwk29\" (UID: \"1ba0f093-ad5c-4a99-bfc2-8439162d5b72\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwk29" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.889726 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1ba0f093-ad5c-4a99-bfc2-8439162d5b72-host-cni-bin\") pod \"ovnkube-node-zwk29\" (UID: \"1ba0f093-ad5c-4a99-bfc2-8439162d5b72\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwk29" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.889842 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6fd3bcf4-5dd2-45e2-b8a8-a83c8b02903f-host\") pod \"node-ca-7sp2j\" (UID: \"6fd3bcf4-5dd2-45e2-b8a8-a83c8b02903f\") " pod="openshift-image-registry/node-ca-7sp2j" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.889861 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1ba0f093-ad5c-4a99-bfc2-8439162d5b72-ovnkube-config\") pod \"ovnkube-node-zwk29\" (UID: \"1ba0f093-ad5c-4a99-bfc2-8439162d5b72\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwk29" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.889877 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6fd3bcf4-5dd2-45e2-b8a8-a83c8b02903f-host\") pod \"node-ca-7sp2j\" (UID: \"6fd3bcf4-5dd2-45e2-b8a8-a83c8b02903f\") " pod="openshift-image-registry/node-ca-7sp2j" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.889898 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ac55471d-4e42-475f-a082-50f611571482-multus-cni-dir\") pod \"multus-v822j\" (UID: \"ac55471d-4e42-475f-a082-50f611571482\") " pod="openshift-multus/multus-v822j" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.889840 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ac55471d-4e42-475f-a082-50f611571482-hostroot\") pod \"multus-v822j\" (UID: \"ac55471d-4e42-475f-a082-50f611571482\") " pod="openshift-multus/multus-v822j" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.889936 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e2275cb4-4905-4d66-a87e-8010120db2bd-proxy-tls\") pod \"machine-config-daemon-7bf76\" (UID: \"e2275cb4-4905-4d66-a87e-8010120db2bd\") " pod="openshift-machine-config-operator/machine-config-daemon-7bf76" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.889978 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ac55471d-4e42-475f-a082-50f611571482-multus-socket-dir-parent\") pod \"multus-v822j\" (UID: \"ac55471d-4e42-475f-a082-50f611571482\") " pod="openshift-multus/multus-v822j" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.889988 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2b62d686-4b05-42c7-b806-9e2caf8c34e8-system-cni-dir\") pod \"multus-additional-cni-plugins-qqjfh\" (UID: \"2b62d686-4b05-42c7-b806-9e2caf8c34e8\") " pod="openshift-multus/multus-additional-cni-plugins-qqjfh" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.890043 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2b62d686-4b05-42c7-b806-9e2caf8c34e8-system-cni-dir\") pod \"multus-additional-cni-plugins-qqjfh\" (UID: \"2b62d686-4b05-42c7-b806-9e2caf8c34e8\") " pod="openshift-multus/multus-additional-cni-plugins-qqjfh" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.890064 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2b62d686-4b05-42c7-b806-9e2caf8c34e8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qqjfh\" (UID: \"2b62d686-4b05-42c7-b806-9e2caf8c34e8\") " pod="openshift-multus/multus-additional-cni-plugins-qqjfh" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.890098 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1ba0f093-ad5c-4a99-bfc2-8439162d5b72-host-slash\") pod \"ovnkube-node-zwk29\" (UID: \"1ba0f093-ad5c-4a99-bfc2-8439162d5b72\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwk29" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.890121 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1ba0f093-ad5c-4a99-bfc2-8439162d5b72-ovnkube-script-lib\") pod \"ovnkube-node-zwk29\" (UID: \"1ba0f093-ad5c-4a99-bfc2-8439162d5b72\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwk29" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.890144 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8e29c57a-87ae-4f7a-82f5-867e05ccf280-ovnkube-config\") pod \"ovnkube-control-plane-57b78d8988-hbs9k\" (UID: \"8e29c57a-87ae-4f7a-82f5-867e05ccf280\") " pod="openshift-ovn-kubernetes/ovnkube-control-plane-57b78d8988-hbs9k" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.890167 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1ba0f093-ad5c-4a99-bfc2-8439162d5b72-run-openvswitch\") pod \"ovnkube-node-zwk29\" (UID: \"1ba0f093-ad5c-4a99-bfc2-8439162d5b72\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwk29" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.890209 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1ba0f093-ad5c-4a99-bfc2-8439162d5b72-host-run-netns\") pod \"ovnkube-node-zwk29\" (UID: \"1ba0f093-ad5c-4a99-bfc2-8439162d5b72\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwk29" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.890244 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/236824b8-2653-4916-ae64-5ff75a7d6178-hosts-file\") pod \"node-resolver-jsv7k\" (UID: \"236824b8-2653-4916-ae64-5ff75a7d6178\") " pod="openshift-dns/node-resolver-jsv7k" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.890257 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1ba0f093-ad5c-4a99-bfc2-8439162d5b72-run-openvswitch\") pod \"ovnkube-node-zwk29\" (UID: \"1ba0f093-ad5c-4a99-bfc2-8439162d5b72\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwk29" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.890267 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ac55471d-4e42-475f-a082-50f611571482-cni-binary-copy\") pod \"multus-v822j\" (UID: \"ac55471d-4e42-475f-a082-50f611571482\") " pod="openshift-multus/multus-v822j" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.890300 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ac55471d-4e42-475f-a082-50f611571482-host-run-k8s-cni-cncf-io\") pod \"multus-v822j\" (UID: \"ac55471d-4e42-475f-a082-50f611571482\") " pod="openshift-multus/multus-v822j" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.890326 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac55471d-4e42-475f-a082-50f611571482-host-var-lib-kubelet\") pod \"multus-v822j\" (UID: \"ac55471d-4e42-475f-a082-50f611571482\") " pod="openshift-multus/multus-v822j" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.890378 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"mcd-auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/e2275cb4-4905-4d66-a87e-8010120db2bd-mcd-auth-proxy-config\") pod \"machine-config-daemon-7bf76\" (UID: \"e2275cb4-4905-4d66-a87e-8010120db2bd\") " pod="openshift-machine-config-operator/machine-config-daemon-7bf76" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.890391 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ac55471d-4e42-475f-a082-50f611571482-multus-daemon-config\") pod \"multus-v822j\" (UID: \"ac55471d-4e42-475f-a082-50f611571482\") " pod="openshift-multus/multus-v822j" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.890429 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2b62d686-4b05-42c7-b806-9e2caf8c34e8-cni-binary-copy\") pod \"multus-additional-cni-plugins-qqjfh\" (UID: \"2b62d686-4b05-42c7-b806-9e2caf8c34e8\") " pod="openshift-multus/multus-additional-cni-plugins-qqjfh" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.890454 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ac55471d-4e42-475f-a082-50f611571482-host-run-k8s-cni-cncf-io\") pod \"multus-v822j\" (UID: \"ac55471d-4e42-475f-a082-50f611571482\") " pod="openshift-multus/multus-v822j" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.890493 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac55471d-4e42-475f-a082-50f611571482-host-var-lib-kubelet\") pod \"multus-v822j\" (UID: \"ac55471d-4e42-475f-a082-50f611571482\") " pod="openshift-multus/multus-v822j" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.890458 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1ba0f093-ad5c-4a99-bfc2-8439162d5b72-log-socket\") pod \"ovnkube-node-zwk29\" (UID: \"1ba0f093-ad5c-4a99-bfc2-8439162d5b72\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwk29" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.890845 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2b62d686-4b05-42c7-b806-9e2caf8c34e8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qqjfh\" (UID: \"2b62d686-4b05-42c7-b806-9e2caf8c34e8\") " pod="openshift-multus/multus-additional-cni-plugins-qqjfh" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.891163 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ac55471d-4e42-475f-a082-50f611571482-cni-binary-copy\") pod \"multus-v822j\" (UID: \"ac55471d-4e42-475f-a082-50f611571482\") " pod="openshift-multus/multus-v822j" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.891365 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1ba0f093-ad5c-4a99-bfc2-8439162d5b72-log-socket\") pod \"ovnkube-node-zwk29\" (UID: \"1ba0f093-ad5c-4a99-bfc2-8439162d5b72\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwk29" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.891403 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1ba0f093-ad5c-4a99-bfc2-8439162d5b72-host-slash\") pod \"ovnkube-node-zwk29\" (UID: \"1ba0f093-ad5c-4a99-bfc2-8439162d5b72\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwk29" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.891498 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1ba0f093-ad5c-4a99-bfc2-8439162d5b72-host-run-netns\") pod \"ovnkube-node-zwk29\" (UID: \"1ba0f093-ad5c-4a99-bfc2-8439162d5b72\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwk29" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.891549 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/236824b8-2653-4916-ae64-5ff75a7d6178-hosts-file\") pod \"node-resolver-jsv7k\" (UID: \"236824b8-2653-4916-ae64-5ff75a7d6178\") " pod="openshift-dns/node-resolver-jsv7k" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.891576 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1ba0f093-ad5c-4a99-bfc2-8439162d5b72-host-run-ovn-kubernetes\") pod \"ovnkube-node-zwk29\" (UID: \"1ba0f093-ad5c-4a99-bfc2-8439162d5b72\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwk29" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.891603 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1ba0f093-ad5c-4a99-bfc2-8439162d5b72-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zwk29\" (UID: \"1ba0f093-ad5c-4a99-bfc2-8439162d5b72\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwk29" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.891625 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1ba0f093-ad5c-4a99-bfc2-8439162d5b72-env-overrides\") pod \"ovnkube-node-zwk29\" (UID: \"1ba0f093-ad5c-4a99-bfc2-8439162d5b72\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwk29" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.891646 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5jkmj\" (UniqueName: \"kubernetes.io/projected/236824b8-2653-4916-ae64-5ff75a7d6178-kube-api-access-5jkmj\") pod \"node-resolver-jsv7k\" (UID: \"236824b8-2653-4916-ae64-5ff75a7d6178\") " pod="openshift-dns/node-resolver-jsv7k" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.891668 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ac55471d-4e42-475f-a082-50f611571482-host-var-lib-cni-bin\") pod \"multus-v822j\" (UID: \"ac55471d-4e42-475f-a082-50f611571482\") " pod="openshift-multus/multus-v822j" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.891691 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2b62d686-4b05-42c7-b806-9e2caf8c34e8-os-release\") pod \"multus-additional-cni-plugins-qqjfh\" (UID: \"2b62d686-4b05-42c7-b806-9e2caf8c34e8\") " pod="openshift-multus/multus-additional-cni-plugins-qqjfh" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.891712 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ac55471d-4e42-475f-a082-50f611571482-system-cni-dir\") pod \"multus-v822j\" (UID: \"ac55471d-4e42-475f-a082-50f611571482\") " pod="openshift-multus/multus-v822j" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.891733 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lhmdx\" (UniqueName: \"kubernetes.io/projected/ac55471d-4e42-475f-a082-50f611571482-kube-api-access-lhmdx\") pod \"multus-v822j\" (UID: \"ac55471d-4e42-475f-a082-50f611571482\") " pod="openshift-multus/multus-v822j" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.891775 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4464728a-4869-4476-83de-cb34577ace7f-metrics-certs\") pod \"network-metrics-daemon-xr8r2\" (UID: \"4464728a-4869-4476-83de-cb34577ace7f\") " pod="openshift-multus/network-metrics-daemon-xr8r2" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.891804 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ftfg9\" (UniqueName: \"kubernetes.io/projected/4464728a-4869-4476-83de-cb34577ace7f-kube-api-access-ftfg9\") pod \"network-metrics-daemon-xr8r2\" (UID: \"4464728a-4869-4476-83de-cb34577ace7f\") " pod="openshift-multus/network-metrics-daemon-xr8r2" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.891826 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2b62d686-4b05-42c7-b806-9e2caf8c34e8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qqjfh\" (UID: \"2b62d686-4b05-42c7-b806-9e2caf8c34e8\") " pod="openshift-multus/multus-additional-cni-plugins-qqjfh" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.891846 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ac55471d-4e42-475f-a082-50f611571482-cnibin\") pod \"multus-v822j\" (UID: \"ac55471d-4e42-475f-a082-50f611571482\") " pod="openshift-multus/multus-v822j" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.891868 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-etc-kube\" (UniqueName: \"kubernetes.io/host-path/34177974-8d82-49d2-a763-391d0df3bbd8-host-etc-kube\") pod \"network-operator-7bdcf4f5bd-7fjxv\" (UID: \"34177974-8d82-49d2-a763-391d0df3bbd8\") " pod="openshift-network-operator/network-operator-7bdcf4f5bd-7fjxv" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.891894 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/428b39f5-eb1c-4f65-b7a4-eeb6e84860cc-host-slash\") pod \"iptables-alerter-5jnd7\" (UID: \"428b39f5-eb1c-4f65-b7a4-eeb6e84860cc\") " pod="openshift-network-operator/iptables-alerter-5jnd7" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.891916 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ac55471d-4e42-475f-a082-50f611571482-host-run-netns\") pod \"multus-v822j\" (UID: \"ac55471d-4e42-475f-a082-50f611571482\") " pod="openshift-multus/multus-v822j" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.891929 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8e29c57a-87ae-4f7a-82f5-867e05ccf280-ovnkube-config\") pod \"ovnkube-control-plane-57b78d8988-hbs9k\" (UID: \"8e29c57a-87ae-4f7a-82f5-867e05ccf280\") " pod="openshift-ovn-kubernetes/ovnkube-control-plane-57b78d8988-hbs9k" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.891937 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6fd3bcf4-5dd2-45e2-b8a8-a83c8b02903f-serviceca\") pod \"node-ca-7sp2j\" (UID: \"6fd3bcf4-5dd2-45e2-b8a8-a83c8b02903f\") " pod="openshift-image-registry/node-ca-7sp2j" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.891958 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1ba0f093-ad5c-4a99-bfc2-8439162d5b72-node-log\") pod \"ovnkube-node-zwk29\" (UID: \"1ba0f093-ad5c-4a99-bfc2-8439162d5b72\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwk29" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.892029 5120 reconciler_common.go:299] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/9276f8f5-2f24-48e1-ab6d-1aab0d8ec3ff-catalog-content\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.892045 5120 reconciler_common.go:299] "Volume detached for volume \"v4-0-config-system-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6edfcf45-925b-4eff-b940-95b6fc0b85d4-v4-0-config-system-trusted-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.892060 5120 reconciler_common.go:299] "Volume detached for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5ebfebf6-3ecd-458e-943f-bb25b52e2718-serviceca\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.892074 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zsb9b\" (UniqueName: \"kubernetes.io/projected/09cfa50b-4138-4585-a53e-64dd3ab73335-kube-api-access-zsb9b\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.892086 5120 reconciler_common.go:299] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/31fa8943-81cc-4750-a0b7-0fa9ab5af883-utilities\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.892099 5120 reconciler_common.go:299] "Volume detached for volume \"encryption-config\" (UniqueName: \"kubernetes.io/secret/d19cb085-0c5b-4810-b654-ce7923221d90-encryption-config\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.892111 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6g4lr\" (UniqueName: \"kubernetes.io/projected/f7e2c886-118e-43bb-bef1-c78134de392b-kube-api-access-6g4lr\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.892122 5120 reconciler_common.go:299] "Volume detached for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/736c54fe-349c-4bb9-870a-d1c1d1c03831-serving-cert\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.892134 5120 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2325ffef-9d5b-447f-b00e-3efc429acefe-trusted-ca\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.892146 5120 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a555ff2e-0be6-46d5-897d-863bb92ae2b3-tmp\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.892159 5120 reconciler_common.go:299] "Volume detached for volume \"v4-0-config-system-session\" (UniqueName: \"kubernetes.io/secret/6edfcf45-925b-4eff-b940-95b6fc0b85d4-v4-0-config-system-session\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.892171 5120 reconciler_common.go:299] "Volume detached for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/92dfbade-90b6-4169-8c07-72cff7f2c82b-metrics-tls\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.892183 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mfzkj\" (UniqueName: \"kubernetes.io/projected/0effdbcf-dd7d-404d-9d48-77536d665a5d-kube-api-access-mfzkj\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.892195 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8nb9c\" (UniqueName: \"kubernetes.io/projected/6edfcf45-925b-4eff-b940-95b6fc0b85d4-kube-api-access-8nb9c\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.892712 5120 reconciler_common.go:299] "Volume detached for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d19cb085-0c5b-4810-b654-ce7923221d90-serving-cert\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.892729 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-grwfz\" (UniqueName: \"kubernetes.io/projected/31fa8943-81cc-4750-a0b7-0fa9ab5af883-kube-api-access-grwfz\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.892743 5120 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca-oauth-serving-cert\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.892772 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-26xrl\" (UniqueName: \"kubernetes.io/projected/a208c9c2-333b-4b4a-be0d-bc32ec38a821-kube-api-access-26xrl\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.892785 5120 reconciler_common.go:299] "Volume detached for volume \"v4-0-config-user-idp-0-file-data\" (UniqueName: \"kubernetes.io/secret/6edfcf45-925b-4eff-b940-95b6fc0b85d4-v4-0-config-user-idp-0-file-data\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.892796 5120 reconciler_common.go:299] "Volume detached for volume \"tmpfs\" (UniqueName: \"kubernetes.io/empty-dir/a7a88189-c967-4640-879e-27665747f20c-tmpfs\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.892809 5120 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f7648cbb-48eb-4ba8-87ec-eb096b8fa1e4-metrics-certs\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.892822 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-94l9h\" (UniqueName: \"kubernetes.io/projected/16bdd140-dce1-464c-ab47-dd5798d1d256-kube-api-access-94l9h\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.892835 5120 reconciler_common.go:299] "Volume detached for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/09cfa50b-4138-4585-a53e-64dd3ab73335-serving-cert\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.892846 5120 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/736c54fe-349c-4bb9-870a-d1c1d1c03831-tmp\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.892857 5120 reconciler_common.go:299] "Volume detached for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dcd10325-9ba5-4a3b-8e4a-e57e3bf210f9-service-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.892868 5120 reconciler_common.go:299] "Volume detached for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18f80adb-c1c3-49ba-8ee4-932c851d3897-service-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.892879 5120 reconciler_common.go:299] "Volume detached for volume \"tmpfs\" (UniqueName: \"kubernetes.io/empty-dir/301e1965-1754-483d-b6cc-bfae7038bbca-tmpfs\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.892891 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tknt7\" (UniqueName: \"kubernetes.io/projected/584e1f4a-8205-47d7-8efb-3afc6017c4c9-kube-api-access-tknt7\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.892903 5120 reconciler_common.go:299] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/149b3c48-e17c-4a66-a835-d86dabf6ff13-utilities\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.892913 5120 reconciler_common.go:299] "Volume detached for volume \"certs\" (UniqueName: \"kubernetes.io/secret/593a3561-7760-45c5-8f91-5aaef7475d0f-certs\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.892924 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/d7e8f42f-dc0e-424b-bb56-5ec849834888-kube-api-access\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.892935 5120 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca-service-ca\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.892949 5120 reconciler_common.go:299] "Volume detached for volume \"v4-0-config-system-cliconfig\" (UniqueName: \"kubernetes.io/configmap/6edfcf45-925b-4eff-b940-95b6fc0b85d4-v4-0-config-system-cliconfig\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.892962 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d4tqq\" (UniqueName: \"kubernetes.io/projected/6ee8fbd3-1f81-4666-96da-5afc70819f1a-kube-api-access-d4tqq\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.892975 5120 reconciler_common.go:299] "Volume detached for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/af33e427-6803-48c2-a76a-dd9deb7cbf9a-ovnkube-config\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.892987 5120 reconciler_common.go:299] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/149b3c48-e17c-4a66-a835-d86dabf6ff13-catalog-content\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.892990 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/428b39f5-eb1c-4f65-b7a4-eeb6e84860cc-host-slash\") pod \"iptables-alerter-5jnd7\" (UID: \"428b39f5-eb1c-4f65-b7a4-eeb6e84860cc\") " pod="openshift-network-operator/iptables-alerter-5jnd7" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.893026 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2325ffef-9d5b-447f-b00e-3efc429acefe-config\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.893062 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ac55471d-4e42-475f-a082-50f611571482-host-run-netns\") pod \"multus-v822j\" (UID: \"ac55471d-4e42-475f-a082-50f611571482\") " pod="openshift-multus/multus-v822j" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.893064 5120 reconciler_common.go:299] "Volume detached for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6ee8fbd3-1f81-4666-96da-5afc70819f1a-samples-operator-tls\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.893087 5120 reconciler_common.go:299] "Volume detached for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/af33e427-6803-48c2-a76a-dd9deb7cbf9a-ovnkube-script-lib\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.893099 5120 reconciler_common.go:299] "Volume detached for volume \"marketplace-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b05a4c1d-fa93-4d3d-b6e5-235473e1ae2a-marketplace-trusted-ca\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.893111 5120 reconciler_common.go:299] "Volume detached for volume \"v4-0-config-user-template-error\" (UniqueName: \"kubernetes.io/secret/6edfcf45-925b-4eff-b940-95b6fc0b85d4-v4-0-config-user-template-error\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.893124 5120 reconciler_common.go:299] "Volume detached for volume \"auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/d565531a-ff86-4608-9d19-767de01ac31b-auth-proxy-config\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.893137 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w94wk\" (UniqueName: \"kubernetes.io/projected/01080b46-74f1-4191-8755-5152a57b3b25-kube-api-access-w94wk\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.893150 5120 reconciler_common.go:299] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/b605f283-6f2e-42da-a838-54421690f7d0-utilities\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.893162 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/736c54fe-349c-4bb9-870a-d1c1d1c03831-config\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.893172 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/01080b46-74f1-4191-8755-5152a57b3b25-config\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.893183 5120 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f559dfa3-3917-43a2-97f6-61ddfda10e93-trusted-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.893194 5120 reconciler_common.go:299] "Volume detached for volume \"available-featuregates\" (UniqueName: \"kubernetes.io/empty-dir/16bdd140-dce1-464c-ab47-dd5798d1d256-available-featuregates\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.893197 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-etc-kube\" (UniqueName: \"kubernetes.io/host-path/34177974-8d82-49d2-a763-391d0df3bbd8-host-etc-kube\") pod \"network-operator-7bdcf4f5bd-7fjxv\" (UID: \"34177974-8d82-49d2-a763-391d0df3bbd8\") " pod="openshift-network-operator/network-operator-7bdcf4f5bd-7fjxv" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.893206 5120 reconciler_common.go:299] "Volume detached for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/81e39f7b-62e4-4fc9-992a-6535ce127a02-multus-daemon-config\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.893222 5120 reconciler_common.go:299] "Volume detached for volume \"mcd-auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/e1d2a42d-af1d-4054-9618-ab545e0ed8b7-mcd-auth-proxy-config\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.893237 5120 reconciler_common.go:299] "Volume detached for volume \"machine-approver-tls\" (UniqueName: \"kubernetes.io/secret/fc8db2c7-859d-47b3-a900-2bd0c0b2973b-machine-approver-tls\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.893241 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1ba0f093-ad5c-4a99-bfc2-8439162d5b72-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zwk29\" (UID: \"1ba0f093-ad5c-4a99-bfc2-8439162d5b72\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwk29" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.893249 5120 reconciler_common.go:299] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/9276f8f5-2f24-48e1-ab6d-1aab0d8ec3ff-utilities\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.893261 5120 reconciler_common.go:299] "Volume detached for volume \"audit-policies\" (UniqueName: \"kubernetes.io/configmap/6edfcf45-925b-4eff-b940-95b6fc0b85d4-audit-policies\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.893266 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1ba0f093-ad5c-4a99-bfc2-8439162d5b72-host-run-ovn-kubernetes\") pod \"ovnkube-node-zwk29\" (UID: \"1ba0f093-ad5c-4a99-bfc2-8439162d5b72\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwk29" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.893272 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4g8ts\" (UniqueName: \"kubernetes.io/projected/92dfbade-90b6-4169-8c07-72cff7f2c82b-kube-api-access-4g8ts\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.893285 5120 reconciler_common.go:299] "Volume detached for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/736c54fe-349c-4bb9-870a-d1c1d1c03831-client-ca\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.893296 5120 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d7e8f42f-dc0e-424b-bb56-5ec849834888-service-ca\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.893307 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8nspp\" (UniqueName: \"kubernetes.io/projected/a7a88189-c967-4640-879e-27665747f20c-kube-api-access-8nspp\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.893319 5120 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted-pem\" (UniqueName: \"kubernetes.io/empty-dir/20ce4d18-fe25-4696-ad7c-1bd2d6200a3e-ca-trust-extracted-pem\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.893329 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xxfcv\" (UniqueName: \"kubernetes.io/projected/9276f8f5-2f24-48e1-ab6d-1aab0d8ec3ff-kube-api-access-xxfcv\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.893342 5120 reconciler_common.go:299] "Volume detached for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/18f80adb-c1c3-49ba-8ee4-932c851d3897-default-certificate\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.893355 5120 reconciler_common.go:299] "Volume detached for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/dcd10325-9ba5-4a3b-8e4a-e57e3bf210f9-serving-cert\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.893366 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6dmhf\" (UniqueName: \"kubernetes.io/projected/736c54fe-349c-4bb9-870a-d1c1d1c03831-kube-api-access-6dmhf\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.893378 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6rmnv\" (UniqueName: \"kubernetes.io/projected/b605f283-6f2e-42da-a838-54421690f7d0-kube-api-access-6rmnv\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.893391 5120 reconciler_common.go:299] "Volume detached for volume \"v4-0-config-system-router-certs\" (UniqueName: \"kubernetes.io/secret/6edfcf45-925b-4eff-b940-95b6fc0b85d4-v4-0-config-system-router-certs\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.893402 5120 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a7a88189-c967-4640-879e-27665747f20c-webhook-cert\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.893414 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fc8db2c7-859d-47b3-a900-2bd0c0b2973b-config\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.893427 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pddnv\" (UniqueName: \"kubernetes.io/projected/e093be35-bb62-4843-b2e8-094545761610-kube-api-access-pddnv\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.893440 5120 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dcd10325-9ba5-4a3b-8e4a-e57e3bf210f9-trusted-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.893443 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ac55471d-4e42-475f-a082-50f611571482-host-var-lib-cni-bin\") pod \"multus-v822j\" (UID: \"ac55471d-4e42-475f-a082-50f611571482\") " pod="openshift-multus/multus-v822j" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.893451 5120 reconciler_common.go:299] "Volume detached for volume \"srv-cert\" (UniqueName: \"kubernetes.io/secret/301e1965-1754-483d-b6cc-bfae7038bbca-srv-cert\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.893462 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9vsz9\" (UniqueName: \"kubernetes.io/projected/c491984c-7d4b-44aa-8c1e-d7974424fa47-kube-api-access-9vsz9\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.893476 5120 reconciler_common.go:299] "Volume detached for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d45be74c-0d98-4d18-90e4-f7ef1b6daaf7-serving-cert\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.893486 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pgx6b\" (UniqueName: \"kubernetes.io/projected/f7648cbb-48eb-4ba8-87ec-eb096b8fa1e4-kube-api-access-pgx6b\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.893497 5120 reconciler_common.go:299] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/b605f283-6f2e-42da-a838-54421690f7d0-catalog-content\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.893511 5120 reconciler_common.go:299] "Volume detached for volume \"ovn-control-plane-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7df94c10-441d-4386-93a6-6730fb7bcde0-ovn-control-plane-metrics-cert\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.893524 5120 reconciler_common.go:299] "Volume detached for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a7a88189-c967-4640-879e-27665747f20c-apiservice-cert\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.893535 5120 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/20ce4d18-fe25-4696-ad7c-1bd2d6200a3e-tmp\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.893546 5120 reconciler_common.go:299] "Volume detached for volume \"audit\" (UniqueName: \"kubernetes.io/configmap/d19cb085-0c5b-4810-b654-ce7923221d90-audit\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.893556 5120 reconciler_common.go:299] "Volume detached for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f559dfa3-3917-43a2-97f6-61ddfda10e93-serving-cert\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.893567 5120 reconciler_common.go:299] "Volume detached for volume \"image-registry-operator-tls\" (UniqueName: \"kubernetes.io/secret/20ce4d18-fe25-4696-ad7c-1bd2d6200a3e-image-registry-operator-tls\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.893578 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hm9x7\" (UniqueName: \"kubernetes.io/projected/f559dfa3-3917-43a2-97f6-61ddfda10e93-kube-api-access-hm9x7\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.893589 5120 reconciler_common.go:299] "Volume detached for volume \"v4-0-config-system-serving-cert\" (UniqueName: \"kubernetes.io/secret/6edfcf45-925b-4eff-b940-95b6fc0b85d4-v4-0-config-system-serving-cert\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.893601 5120 reconciler_common.go:299] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/31fa8943-81cc-4750-a0b7-0fa9ab5af883-catalog-content\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.893617 5120 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca-console-config\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.893628 5120 reconciler_common.go:299] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/94a6e063-3d1a-4d44-875d-185291448c31-catalog-content\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.893640 5120 reconciler_common.go:299] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/71c8ffbe-59c6-4e7d-aa1a-bbd315b3414a-catalog-content\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.893652 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d7cps\" (UniqueName: \"kubernetes.io/projected/af41de71-79cf-4590-bbe9-9e8b848862cb-kube-api-access-d7cps\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.893664 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7afa918d-be67-40a6-803c-d3b0ae99d815-config\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.893677 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a555ff2e-0be6-46d5-897d-863bb92ae2b3-config\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.893690 5120 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9e9b5059-1b3e-4067-a63d-2952cbe863af-ca-trust-extracted\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.893701 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sbc2l\" (UniqueName: \"kubernetes.io/projected/593a3561-7760-45c5-8f91-5aaef7475d0f-kube-api-access-sbc2l\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.893511 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2b62d686-4b05-42c7-b806-9e2caf8c34e8-os-release\") pod \"multus-additional-cni-plugins-qqjfh\" (UID: \"2b62d686-4b05-42c7-b806-9e2caf8c34e8\") " pod="openshift-multus/multus-additional-cni-plugins-qqjfh" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.892946 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"mcd-auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/e2275cb4-4905-4d66-a87e-8010120db2bd-mcd-auth-proxy-config\") pod \"machine-config-daemon-7bf76\" (UID: \"e2275cb4-4905-4d66-a87e-8010120db2bd\") " pod="openshift-machine-config-operator/machine-config-daemon-7bf76" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.893411 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1ba0f093-ad5c-4a99-bfc2-8439162d5b72-ovnkube-script-lib\") pod \"ovnkube-node-zwk29\" (UID: \"1ba0f093-ad5c-4a99-bfc2-8439162d5b72\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwk29" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.893927 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2b62d686-4b05-42c7-b806-9e2caf8c34e8-cni-binary-copy\") pod \"multus-additional-cni-plugins-qqjfh\" (UID: \"2b62d686-4b05-42c7-b806-9e2caf8c34e8\") " pod="openshift-multus/multus-additional-cni-plugins-qqjfh" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.893995 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ac55471d-4e42-475f-a082-50f611571482-cnibin\") pod \"multus-v822j\" (UID: \"ac55471d-4e42-475f-a082-50f611571482\") " pod="openshift-multus/multus-v822j" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.894049 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6fd3bcf4-5dd2-45e2-b8a8-a83c8b02903f-serviceca\") pod \"node-ca-7sp2j\" (UID: \"6fd3bcf4-5dd2-45e2-b8a8-a83c8b02903f\") " pod="openshift-image-registry/node-ca-7sp2j" Mar 16 15:33:21 crc kubenswrapper[5120]: E0316 15:33:21.894099 5120 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.894107 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1ba0f093-ad5c-4a99-bfc2-8439162d5b72-node-log\") pod \"ovnkube-node-zwk29\" (UID: \"1ba0f093-ad5c-4a99-bfc2-8439162d5b72\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwk29" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.894147 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2b62d686-4b05-42c7-b806-9e2caf8c34e8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qqjfh\" (UID: \"2b62d686-4b05-42c7-b806-9e2caf8c34e8\") " pod="openshift-multus/multus-additional-cni-plugins-qqjfh" Mar 16 15:33:21 crc kubenswrapper[5120]: E0316 15:33:21.894175 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4464728a-4869-4476-83de-cb34577ace7f-metrics-certs podName:4464728a-4869-4476-83de-cb34577ace7f nodeName:}" failed. No retries permitted until 2026-03-16 15:33:22.394155926 +0000 UTC m=+104.548087583 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4464728a-4869-4476-83de-cb34577ace7f-metrics-certs") pod "network-metrics-daemon-xr8r2" (UID: "4464728a-4869-4476-83de-cb34577ace7f") : object "openshift-multus"/"metrics-daemon-secret" not registered Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.894292 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1ba0f093-ad5c-4a99-bfc2-8439162d5b72-ovn-node-metrics-cert\") pod \"ovnkube-node-zwk29\" (UID: \"1ba0f093-ad5c-4a99-bfc2-8439162d5b72\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwk29" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.894357 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ac55471d-4e42-475f-a082-50f611571482-system-cni-dir\") pod \"multus-v822j\" (UID: \"ac55471d-4e42-475f-a082-50f611571482\") " pod="openshift-multus/multus-v822j" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.895090 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1ba0f093-ad5c-4a99-bfc2-8439162d5b72-env-overrides\") pod \"ovnkube-node-zwk29\" (UID: \"1ba0f093-ad5c-4a99-bfc2-8439162d5b72\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwk29" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.899258 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e2275cb4-4905-4d66-a87e-8010120db2bd-proxy-tls\") pod \"machine-config-daemon-7bf76\" (UID: \"e2275cb4-4905-4d66-a87e-8010120db2bd\") " pod="openshift-machine-config-operator/machine-config-daemon-7bf76" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.904079 5120 status_manager.go:919] "Failed to update status for pod" pod="openshift-network-diagnostics/network-check-source-5bb8f5cd97-xdvz5" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"f863fff9-286a-45fa-b8f0-8a86994b8440\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-03-16T15:33:21Z\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"message\\\":\\\"containers with unready status: [check-endpoints]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-03-16T15:33:21Z\\\",\\\"message\\\":\\\"containers with unready status: [check-endpoints]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a8581a82ba5c8343a743aa302c4848249d8c32a9f2cd10fa68d89d835a1bdf8b\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"exitCode\\\":137,\\\"finishedAt\\\":null,\\\"message\\\":\\\"The container could not be located when the pod was deleted. The container used to be Running\\\",\\\"reason\\\":\\\"ContainerStatusUnknown\\\",\\\"startedAt\\\":null}},\\\"name\\\":\\\"check-endpoints\\\",\\\"ready\\\":false,\\\"restartCount\\\":4,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-l7w75\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"podIP\\\":null,\\\"podIPs\\\":null}}\" for pod \"openshift-network-diagnostics\"/\"network-check-source-5bb8f5cd97-xdvz5\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.907034 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwj94\" (UniqueName: \"kubernetes.io/projected/6fd3bcf4-5dd2-45e2-b8a8-a83c8b02903f-kube-api-access-rwj94\") pod \"node-ca-7sp2j\" (UID: \"6fd3bcf4-5dd2-45e2-b8a8-a83c8b02903f\") " pod="openshift-image-registry/node-ca-7sp2j" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.908328 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-control-plane-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8e29c57a-87ae-4f7a-82f5-867e05ccf280-ovn-control-plane-metrics-cert\") pod \"ovnkube-control-plane-57b78d8988-hbs9k\" (UID: \"8e29c57a-87ae-4f7a-82f5-867e05ccf280\") " pod="openshift-ovn-kubernetes/ovnkube-control-plane-57b78d8988-hbs9k" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.910907 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2b62d686-4b05-42c7-b806-9e2caf8c34e8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qqjfh\" (UID: \"2b62d686-4b05-42c7-b806-9e2caf8c34e8\") " pod="openshift-multus/multus-additional-cni-plugins-qqjfh" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.912537 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhmdx\" (UniqueName: \"kubernetes.io/projected/ac55471d-4e42-475f-a082-50f611571482-kube-api-access-lhmdx\") pod \"multus-v822j\" (UID: \"ac55471d-4e42-475f-a082-50f611571482\") " pod="openshift-multus/multus-v822j" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.913643 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9hvt\" (UniqueName: \"kubernetes.io/projected/8e29c57a-87ae-4f7a-82f5-867e05ccf280-kube-api-access-b9hvt\") pod \"ovnkube-control-plane-57b78d8988-hbs9k\" (UID: \"8e29c57a-87ae-4f7a-82f5-867e05ccf280\") " pod="openshift-ovn-kubernetes/ovnkube-control-plane-57b78d8988-hbs9k" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.913838 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7cgz\" (UniqueName: \"kubernetes.io/projected/2b62d686-4b05-42c7-b806-9e2caf8c34e8-kube-api-access-p7cgz\") pod \"multus-additional-cni-plugins-qqjfh\" (UID: \"2b62d686-4b05-42c7-b806-9e2caf8c34e8\") " pod="openshift-multus/multus-additional-cni-plugins-qqjfh" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.914171 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftfg9\" (UniqueName: \"kubernetes.io/projected/4464728a-4869-4476-83de-cb34577ace7f-kube-api-access-ftfg9\") pod \"network-metrics-daemon-xr8r2\" (UID: \"4464728a-4869-4476-83de-cb34577ace7f\") " pod="openshift-multus/network-metrics-daemon-xr8r2" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.914713 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjz24\" (UniqueName: \"kubernetes.io/projected/1ba0f093-ad5c-4a99-bfc2-8439162d5b72-kube-api-access-tjz24\") pod \"ovnkube-node-zwk29\" (UID: \"1ba0f093-ad5c-4a99-bfc2-8439162d5b72\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwk29" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.915233 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jkmj\" (UniqueName: \"kubernetes.io/projected/236824b8-2653-4916-ae64-5ff75a7d6178-kube-api-access-5jkmj\") pod \"node-resolver-jsv7k\" (UID: \"236824b8-2653-4916-ae64-5ff75a7d6178\") " pod="openshift-dns/node-resolver-jsv7k" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.916032 5120 status_manager.go:919] "Failed to update status for pod" pod="openshift-network-node-identity/network-node-identity-dgvkt" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"fc4541ce-7789-4670-bc75-5c2868e52ce0\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-03-16T15:33:21Z\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"message\\\":\\\"containers with unready status: [webhook approver]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-03-16T15:33:21Z\\\",\\\"message\\\":\\\"containers with unready status: [webhook approver]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"exitCode\\\":137,\\\"finishedAt\\\":null,\\\"message\\\":\\\"The container could not be located when the pod was deleted. The container used to be Running\\\",\\\"reason\\\":\\\"ContainerStatusUnknown\\\",\\\"startedAt\\\":null}},\\\"name\\\":\\\"approver\\\",\\\"ready\\\":false,\\\"restartCount\\\":6,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/ovnkube-identity-config\\\",\\\"name\\\":\\\"ovnkube-identity-cm\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-8nt2j\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"exitCode\\\":137,\\\"finishedAt\\\":null,\\\"message\\\":\\\"The container could not be located when the pod was deleted. The container used to be Running\\\",\\\"reason\\\":\\\"ContainerStatusUnknown\\\",\\\"startedAt\\\":null}},\\\"name\\\":\\\"webhook\\\",\\\"ready\\\":false,\\\"restartCount\\\":4,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/webhook-cert/\\\",\\\"name\\\":\\\"webhook-cert\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/ovnkube-identity-config\\\",\\\"name\\\":\\\"ovnkube-identity-cm\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-8nt2j\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}]}}\" for pod \"openshift-network-node-identity\"/\"network-node-identity-dgvkt\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.916532 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbscd\" (UniqueName: \"kubernetes.io/projected/e2275cb4-4905-4d66-a87e-8010120db2bd-kube-api-access-lbscd\") pod \"machine-config-daemon-7bf76\" (UID: \"e2275cb4-4905-4d66-a87e-8010120db2bd\") " pod="openshift-machine-config-operator/machine-config-daemon-7bf76" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.924639 5120 status_manager.go:919] "Failed to update status for pod" pod="openshift-network-operator/iptables-alerter-5jnd7" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"428b39f5-eb1c-4f65-b7a4-eeb6e84860cc\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-03-16T15:33:21Z\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"message\\\":\\\"containers with unready status: [iptables-alerter]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-03-16T15:33:21Z\\\",\\\"message\\\":\\\"containers with unready status: [iptables-alerter]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5c5d7468f6838b6a714482e62ea956659212f3415ec8f69989f75eb6d8744a6e\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"exitCode\\\":137,\\\"finishedAt\\\":null,\\\"message\\\":\\\"The container could not be located when the pod was deleted. The container used to be Running\\\",\\\"reason\\\":\\\"ContainerStatusUnknown\\\",\\\"startedAt\\\":null}},\\\"name\\\":\\\"iptables-alerter\\\",\\\"ready\\\":false,\\\"restartCount\\\":4,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/iptables-alerter\\\",\\\"name\\\":\\\"iptables-alerter-script\\\"},{\\\"mountPath\\\":\\\"/host\\\",\\\"name\\\":\\\"host-slash\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-dsgwk\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}]}}\" for pod \"openshift-network-operator\"/\"iptables-alerter-5jnd7\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.931610 5120 status_manager.go:919] "Failed to update status for pod" pod="openshift-multus/network-metrics-daemon-xr8r2" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"4464728a-4869-4476-83de-cb34577ace7f\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T15:33:21Z\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T15:33:21Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T15:33:21Z\\\",\\\"message\\\":\\\"containers with unready status: [network-metrics-daemon kube-rbac-proxy]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T15:33:21Z\\\",\\\"message\\\":\\\"containers with unready status: [network-metrics-daemon kube-rbac-proxy]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/metrics\\\",\\\"name\\\":\\\"metrics-certs\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-ftfg9\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:49b34ce0d25eec7a6077f4bf21bf7d4e64e598d28785a20b9ee3594423b7de14\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"network-metrics-daemon\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-ftfg9\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T15:33:21Z\\\"}}\" for pod \"openshift-multus\"/\"network-metrics-daemon-xr8r2\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.932735 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/network-operator-7bdcf4f5bd-7fjxv" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.950858 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-node-identity/network-node-identity-dgvkt" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.952495 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.952598 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.952633 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.952663 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.952687 5120 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T15:33:21Z","lastTransitionTime":"2026-03-16T15:33:21Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.960667 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-5jnd7" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.974360 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zwk29" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.980461 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jsv7k" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.986048 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-v822j" Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.993549 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-control-plane-57b78d8988-hbs9k" Mar 16 15:33:21 crc kubenswrapper[5120]: W0316 15:33:21.997623 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ba0f093_ad5c_4a99_bfc2_8439162d5b72.slice/crio-48123e8cbf9bdda73365e4b314bad0a1a6faf6d072d7091b4d9ca2dc60e33f1d WatchSource:0}: Error finding container 48123e8cbf9bdda73365e4b314bad0a1a6faf6d072d7091b4d9ca2dc60e33f1d: Status 404 returned error can't find the container with id 48123e8cbf9bdda73365e4b314bad0a1a6faf6d072d7091b4d9ca2dc60e33f1d Mar 16 15:33:21 crc kubenswrapper[5120]: I0316 15:33:21.999902 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7sp2j" Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.006987 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.013271 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-qqjfh" Mar 16 15:33:22 crc kubenswrapper[5120]: W0316 15:33:22.015228 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod236824b8_2653_4916_ae64_5ff75a7d6178.slice/crio-7df5d1ac0cd0c6d143dba7bf0480d4e2599bf4828d6bdd60a58eba164c6502f3 WatchSource:0}: Error finding container 7df5d1ac0cd0c6d143dba7bf0480d4e2599bf4828d6bdd60a58eba164c6502f3: Status 404 returned error can't find the container with id 7df5d1ac0cd0c6d143dba7bf0480d4e2599bf4828d6bdd60a58eba164c6502f3 Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.022523 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jsv7k" event={"ID":"236824b8-2653-4916-ae64-5ff75a7d6178","Type":"ContainerStarted","Data":"7df5d1ac0cd0c6d143dba7bf0480d4e2599bf4828d6bdd60a58eba164c6502f3"} Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.023834 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zwk29" event={"ID":"1ba0f093-ad5c-4a99-bfc2-8439162d5b72","Type":"ContainerStarted","Data":"48123e8cbf9bdda73365e4b314bad0a1a6faf6d072d7091b4d9ca2dc60e33f1d"} Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.024447 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-node-identity/network-node-identity-dgvkt" event={"ID":"fc4541ce-7789-4670-bc75-5c2868e52ce0","Type":"ContainerStarted","Data":"f14f78d2df85698e367cd9aeaf5ac5c919ba97169752382a18f84da83ebd9dbb"} Mar 16 15:33:22 crc kubenswrapper[5120]: W0316 15:33:22.025080 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac55471d_4e42_475f_a082_50f611571482.slice/crio-ff0a04f12f280d7f01e7a7c53f2060962b54254d4ff77f83ab57aeae315cba53 WatchSource:0}: Error finding container ff0a04f12f280d7f01e7a7c53f2060962b54254d4ff77f83ab57aeae315cba53: Status 404 returned error can't find the container with id ff0a04f12f280d7f01e7a7c53f2060962b54254d4ff77f83ab57aeae315cba53 Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.025436 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-5jnd7" event={"ID":"428b39f5-eb1c-4f65-b7a4-eeb6e84860cc","Type":"ContainerStarted","Data":"dbda224b64be2fa0796ed09172a01b41b1315451eec4d7c54a1eb70448627643"} Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.027047 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/network-operator-7bdcf4f5bd-7fjxv" event={"ID":"34177974-8d82-49d2-a763-391d0df3bbd8","Type":"ContainerStarted","Data":"1e919dab6ded363b719fd48354b34d0f990abaa2f208ceb9afacbef05a7ef9ed"} Mar 16 15:33:22 crc kubenswrapper[5120]: W0316 15:33:22.042034 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fd3bcf4_5dd2_45e2_b8a8_a83c8b02903f.slice/crio-e9173c86f51fc90570716add66f84eb2377cc0ec073145824944a43fb4ebc2ec WatchSource:0}: Error finding container e9173c86f51fc90570716add66f84eb2377cc0ec073145824944a43fb4ebc2ec: Status 404 returned error can't find the container with id e9173c86f51fc90570716add66f84eb2377cc0ec073145824944a43fb4ebc2ec Mar 16 15:33:22 crc kubenswrapper[5120]: W0316 15:33:22.045642 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e29c57a_87ae_4f7a_82f5_867e05ccf280.slice/crio-386a28725142690bbe9f5cd09cf7aa4a587746430cfa53ce544b9de1d72cc5d7 WatchSource:0}: Error finding container 386a28725142690bbe9f5cd09cf7aa4a587746430cfa53ce544b9de1d72cc5d7: Status 404 returned error can't find the container with id 386a28725142690bbe9f5cd09cf7aa4a587746430cfa53ce544b9de1d72cc5d7 Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.054037 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.054104 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.054116 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.054133 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.054145 5120 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T15:33:22Z","lastTransitionTime":"2026-03-16T15:33:22Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.159001 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.159033 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.159044 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.159062 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.159072 5120 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T15:33:22Z","lastTransitionTime":"2026-03-16T15:33:22Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.261967 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.262006 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.262020 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.262038 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.262048 5120 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T15:33:22Z","lastTransitionTime":"2026-03-16T15:33:22Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.297270 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.297359 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6a9ae5f6-97bd-46ac-bafa-ca1b4452a141-networking-console-plugin-cert\") pod \"networking-console-plugin-5ff7774fd9-nljh6\" (UID: \"6a9ae5f6-97bd-46ac-bafa-ca1b4452a141\") " pod="openshift-network-console/networking-console-plugin-5ff7774fd9-nljh6" Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.297388 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6a9ae5f6-97bd-46ac-bafa-ca1b4452a141-nginx-conf\") pod \"networking-console-plugin-5ff7774fd9-nljh6\" (UID: \"6a9ae5f6-97bd-46ac-bafa-ca1b4452a141\") " pod="openshift-network-console/networking-console-plugin-5ff7774fd9-nljh6" Mar 16 15:33:22 crc kubenswrapper[5120]: E0316 15:33:22.297476 5120 configmap.go:193] Couldn't get configMap openshift-network-console/networking-console-plugin: object "openshift-network-console"/"networking-console-plugin" not registered Mar 16 15:33:22 crc kubenswrapper[5120]: E0316 15:33:22.297523 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6a9ae5f6-97bd-46ac-bafa-ca1b4452a141-nginx-conf podName:6a9ae5f6-97bd-46ac-bafa-ca1b4452a141 nodeName:}" failed. No retries permitted until 2026-03-16 15:33:23.29751026 +0000 UTC m=+105.451441917 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "nginx-conf" (UniqueName: "kubernetes.io/configmap/6a9ae5f6-97bd-46ac-bafa-ca1b4452a141-nginx-conf") pod "networking-console-plugin-5ff7774fd9-nljh6" (UID: "6a9ae5f6-97bd-46ac-bafa-ca1b4452a141") : object "openshift-network-console"/"networking-console-plugin" not registered Mar 16 15:33:22 crc kubenswrapper[5120]: E0316 15:33:22.297722 5120 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: object "openshift-network-console"/"networking-console-plugin-cert" not registered Mar 16 15:33:22 crc kubenswrapper[5120]: E0316 15:33:22.297844 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a9ae5f6-97bd-46ac-bafa-ca1b4452a141-networking-console-plugin-cert podName:6a9ae5f6-97bd-46ac-bafa-ca1b4452a141 nodeName:}" failed. No retries permitted until 2026-03-16 15:33:23.297822698 +0000 UTC m=+105.451754345 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6a9ae5f6-97bd-46ac-bafa-ca1b4452a141-networking-console-plugin-cert") pod "networking-console-plugin-5ff7774fd9-nljh6" (UID: "6a9ae5f6-97bd-46ac-bafa-ca1b4452a141") : object "openshift-network-console"/"networking-console-plugin-cert" not registered Mar 16 15:33:22 crc kubenswrapper[5120]: E0316 15:33:22.297884 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 15:33:23.297852279 +0000 UTC m=+105.451783946 (durationBeforeRetry 1s). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.364082 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.364115 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.364125 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.364139 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.364149 5120 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T15:33:22Z","lastTransitionTime":"2026-03-16T15:33:22Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.398516 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4464728a-4869-4476-83de-cb34577ace7f-metrics-certs\") pod \"network-metrics-daemon-xr8r2\" (UID: \"4464728a-4869-4476-83de-cb34577ace7f\") " pod="openshift-multus/network-metrics-daemon-xr8r2" Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.398569 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gwt8b\" (UniqueName: \"kubernetes.io/projected/17b87002-b798-480a-8e17-83053d698239-kube-api-access-gwt8b\") pod \"network-check-target-fhkjl\" (UID: \"17b87002-b798-480a-8e17-83053d698239\") " pod="openshift-network-diagnostics/network-check-target-fhkjl" Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.398610 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l7w75\" (UniqueName: \"kubernetes.io/projected/f863fff9-286a-45fa-b8f0-8a86994b8440-kube-api-access-l7w75\") pod \"network-check-source-5bb8f5cd97-xdvz5\" (UID: \"f863fff9-286a-45fa-b8f0-8a86994b8440\") " pod="openshift-network-diagnostics/network-check-source-5bb8f5cd97-xdvz5" Mar 16 15:33:22 crc kubenswrapper[5120]: E0316 15:33:22.398714 5120 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Mar 16 15:33:22 crc kubenswrapper[5120]: E0316 15:33:22.398727 5120 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Mar 16 15:33:22 crc kubenswrapper[5120]: E0316 15:33:22.398738 5120 projected.go:194] Error preparing data for projected volume kube-api-access-l7w75 for pod openshift-network-diagnostics/network-check-source-5bb8f5cd97-xdvz5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Mar 16 15:33:22 crc kubenswrapper[5120]: E0316 15:33:22.398794 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f863fff9-286a-45fa-b8f0-8a86994b8440-kube-api-access-l7w75 podName:f863fff9-286a-45fa-b8f0-8a86994b8440 nodeName:}" failed. No retries permitted until 2026-03-16 15:33:23.398781372 +0000 UTC m=+105.552713029 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-l7w75" (UniqueName: "kubernetes.io/projected/f863fff9-286a-45fa-b8f0-8a86994b8440-kube-api-access-l7w75") pod "network-check-source-5bb8f5cd97-xdvz5" (UID: "f863fff9-286a-45fa-b8f0-8a86994b8440") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Mar 16 15:33:22 crc kubenswrapper[5120]: E0316 15:33:22.398840 5120 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Mar 16 15:33:22 crc kubenswrapper[5120]: E0316 15:33:22.398860 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4464728a-4869-4476-83de-cb34577ace7f-metrics-certs podName:4464728a-4869-4476-83de-cb34577ace7f nodeName:}" failed. No retries permitted until 2026-03-16 15:33:23.398854514 +0000 UTC m=+105.552786171 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4464728a-4869-4476-83de-cb34577ace7f-metrics-certs") pod "network-metrics-daemon-xr8r2" (UID: "4464728a-4869-4476-83de-cb34577ace7f") : object "openshift-multus"/"metrics-daemon-secret" not registered Mar 16 15:33:22 crc kubenswrapper[5120]: E0316 15:33:22.398898 5120 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Mar 16 15:33:22 crc kubenswrapper[5120]: E0316 15:33:22.398907 5120 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Mar 16 15:33:22 crc kubenswrapper[5120]: E0316 15:33:22.398914 5120 projected.go:194] Error preparing data for projected volume kube-api-access-gwt8b for pod openshift-network-diagnostics/network-check-target-fhkjl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Mar 16 15:33:22 crc kubenswrapper[5120]: E0316 15:33:22.398932 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/17b87002-b798-480a-8e17-83053d698239-kube-api-access-gwt8b podName:17b87002-b798-480a-8e17-83053d698239 nodeName:}" failed. No retries permitted until 2026-03-16 15:33:23.398927306 +0000 UTC m=+105.552858963 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-gwt8b" (UniqueName: "kubernetes.io/projected/17b87002-b798-480a-8e17-83053d698239-kube-api-access-gwt8b") pod "network-check-target-fhkjl" (UID: "17b87002-b798-480a-8e17-83053d698239") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.465513 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.465560 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.465572 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.465590 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.465602 5120 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T15:33:22Z","lastTransitionTime":"2026-03-16T15:33:22Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.567917 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.567955 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.567964 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.567976 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.567986 5120 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T15:33:22Z","lastTransitionTime":"2026-03-16T15:33:22Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.666505 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="01080b46-74f1-4191-8755-5152a57b3b25" path="/var/lib/kubelet/pods/01080b46-74f1-4191-8755-5152a57b3b25/volumes" Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.667482 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="09cfa50b-4138-4585-a53e-64dd3ab73335" path="/var/lib/kubelet/pods/09cfa50b-4138-4585-a53e-64dd3ab73335/volumes" Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.670422 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.670475 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.670493 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.670515 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.670534 5120 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T15:33:22Z","lastTransitionTime":"2026-03-16T15:33:22Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.670727 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0dd0fbac-8c0d-4228-8faa-abbeedabf7db" path="/var/lib/kubelet/pods/0dd0fbac-8c0d-4228-8faa-abbeedabf7db/volumes" Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.672975 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0effdbcf-dd7d-404d-9d48-77536d665a5d" path="/var/lib/kubelet/pods/0effdbcf-dd7d-404d-9d48-77536d665a5d/volumes" Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.676652 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="149b3c48-e17c-4a66-a835-d86dabf6ff13" path="/var/lib/kubelet/pods/149b3c48-e17c-4a66-a835-d86dabf6ff13/volumes" Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.682966 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="16bdd140-dce1-464c-ab47-dd5798d1d256" path="/var/lib/kubelet/pods/16bdd140-dce1-464c-ab47-dd5798d1d256/volumes" Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.684151 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="18f80adb-c1c3-49ba-8ee4-932c851d3897" path="/var/lib/kubelet/pods/18f80adb-c1c3-49ba-8ee4-932c851d3897/volumes" Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.685593 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="20ce4d18-fe25-4696-ad7c-1bd2d6200a3e" path="/var/lib/kubelet/pods/20ce4d18-fe25-4696-ad7c-1bd2d6200a3e/volumes" Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.686537 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2325ffef-9d5b-447f-b00e-3efc429acefe" path="/var/lib/kubelet/pods/2325ffef-9d5b-447f-b00e-3efc429acefe/volumes" Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.688156 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="301e1965-1754-483d-b6cc-bfae7038bbca" path="/var/lib/kubelet/pods/301e1965-1754-483d-b6cc-bfae7038bbca/volumes" Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.691272 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="31fa8943-81cc-4750-a0b7-0fa9ab5af883" path="/var/lib/kubelet/pods/31fa8943-81cc-4750-a0b7-0fa9ab5af883/volumes" Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.692998 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="42a11a02-47e1-488f-b270-2679d3298b0e" path="/var/lib/kubelet/pods/42a11a02-47e1-488f-b270-2679d3298b0e/volumes" Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.694423 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="567683bd-0efc-4f21-b076-e28559628404" path="/var/lib/kubelet/pods/567683bd-0efc-4f21-b076-e28559628404/volumes" Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.699917 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="584e1f4a-8205-47d7-8efb-3afc6017c4c9" path="/var/lib/kubelet/pods/584e1f4a-8205-47d7-8efb-3afc6017c4c9/volumes" Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.700501 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="593a3561-7760-45c5-8f91-5aaef7475d0f" path="/var/lib/kubelet/pods/593a3561-7760-45c5-8f91-5aaef7475d0f/volumes" Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.702697 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ebfebf6-3ecd-458e-943f-bb25b52e2718" path="/var/lib/kubelet/pods/5ebfebf6-3ecd-458e-943f-bb25b52e2718/volumes" Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.703394 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6077b63e-53a2-4f96-9d56-1ce0324e4913" path="/var/lib/kubelet/pods/6077b63e-53a2-4f96-9d56-1ce0324e4913/volumes" Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.705954 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca" path="/var/lib/kubelet/pods/6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca/volumes" Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.707697 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6edfcf45-925b-4eff-b940-95b6fc0b85d4" path="/var/lib/kubelet/pods/6edfcf45-925b-4eff-b940-95b6fc0b85d4/volumes" Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.709823 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ee8fbd3-1f81-4666-96da-5afc70819f1a" path="/var/lib/kubelet/pods/6ee8fbd3-1f81-4666-96da-5afc70819f1a/volumes" Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.710846 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="71c8ffbe-59c6-4e7d-aa1a-bbd315b3414a" path="/var/lib/kubelet/pods/71c8ffbe-59c6-4e7d-aa1a-bbd315b3414a/volumes" Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.714299 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="736c54fe-349c-4bb9-870a-d1c1d1c03831" path="/var/lib/kubelet/pods/736c54fe-349c-4bb9-870a-d1c1d1c03831/volumes" Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.715959 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7599e0b6-bddf-4def-b7f2-0b32206e8651" path="/var/lib/kubelet/pods/7599e0b6-bddf-4def-b7f2-0b32206e8651/volumes" Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.718462 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7afa918d-be67-40a6-803c-d3b0ae99d815" path="/var/lib/kubelet/pods/7afa918d-be67-40a6-803c-d3b0ae99d815/volumes" Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.719562 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7df94c10-441d-4386-93a6-6730fb7bcde0" path="/var/lib/kubelet/pods/7df94c10-441d-4386-93a6-6730fb7bcde0/volumes" Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.721158 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7fcc6409-8a0f-44c3-89e7-5aecd7610f8a" path="/var/lib/kubelet/pods/7fcc6409-8a0f-44c3-89e7-5aecd7610f8a/volumes" Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.723167 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="81e39f7b-62e4-4fc9-992a-6535ce127a02" path="/var/lib/kubelet/pods/81e39f7b-62e4-4fc9-992a-6535ce127a02/volumes" Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.724414 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="869851b9-7ffb-4af0-b166-1d8aa40a5f80" path="/var/lib/kubelet/pods/869851b9-7ffb-4af0-b166-1d8aa40a5f80/volumes" Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.726853 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9276f8f5-2f24-48e1-ab6d-1aab0d8ec3ff" path="/var/lib/kubelet/pods/9276f8f5-2f24-48e1-ab6d-1aab0d8ec3ff/volumes" Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.727382 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="92dfbade-90b6-4169-8c07-72cff7f2c82b" path="/var/lib/kubelet/pods/92dfbade-90b6-4169-8c07-72cff7f2c82b/volumes" Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.730306 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94a6e063-3d1a-4d44-875d-185291448c31" path="/var/lib/kubelet/pods/94a6e063-3d1a-4d44-875d-185291448c31/volumes" Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.731578 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f71a554-e414-4bc3-96d2-674060397afe" path="/var/lib/kubelet/pods/9f71a554-e414-4bc3-96d2-674060397afe/volumes" Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.733904 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a208c9c2-333b-4b4a-be0d-bc32ec38a821" path="/var/lib/kubelet/pods/a208c9c2-333b-4b4a-be0d-bc32ec38a821/volumes" Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.736832 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a52afe44-fb37-46ed-a1f8-bf39727a3cbe" path="/var/lib/kubelet/pods/a52afe44-fb37-46ed-a1f8-bf39727a3cbe/volumes" Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.737453 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a555ff2e-0be6-46d5-897d-863bb92ae2b3" path="/var/lib/kubelet/pods/a555ff2e-0be6-46d5-897d-863bb92ae2b3/volumes" Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.738415 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a7a88189-c967-4640-879e-27665747f20c" path="/var/lib/kubelet/pods/a7a88189-c967-4640-879e-27665747f20c/volumes" Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.739482 5120 kubelet_volumes.go:152] "Cleaned up orphaned volume subpath from pod" podUID="af33e427-6803-48c2-a76a-dd9deb7cbf9a" path="/var/lib/kubelet/pods/af33e427-6803-48c2-a76a-dd9deb7cbf9a/volume-subpaths/run-systemd/ovnkube-controller/6" Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.739719 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="af33e427-6803-48c2-a76a-dd9deb7cbf9a" path="/var/lib/kubelet/pods/af33e427-6803-48c2-a76a-dd9deb7cbf9a/volumes" Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.744177 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="af41de71-79cf-4590-bbe9-9e8b848862cb" path="/var/lib/kubelet/pods/af41de71-79cf-4590-bbe9-9e8b848862cb/volumes" Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.746081 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b05a4c1d-fa93-4d3d-b6e5-235473e1ae2a" path="/var/lib/kubelet/pods/b05a4c1d-fa93-4d3d-b6e5-235473e1ae2a/volumes" Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.747720 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b4750666-1362-4001-abd0-6f89964cc621" path="/var/lib/kubelet/pods/b4750666-1362-4001-abd0-6f89964cc621/volumes" Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.748968 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b605f283-6f2e-42da-a838-54421690f7d0" path="/var/lib/kubelet/pods/b605f283-6f2e-42da-a838-54421690f7d0/volumes" Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.749480 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c491984c-7d4b-44aa-8c1e-d7974424fa47" path="/var/lib/kubelet/pods/c491984c-7d4b-44aa-8c1e-d7974424fa47/volumes" Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.751582 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c5f2bfad-70f6-4185-a3d9-81ce12720767" path="/var/lib/kubelet/pods/c5f2bfad-70f6-4185-a3d9-81ce12720767/volumes" Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.752394 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc85e424-18b2-4924-920b-bd291a8c4b01" path="/var/lib/kubelet/pods/cc85e424-18b2-4924-920b-bd291a8c4b01/volumes" Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.753360 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce090a97-9ab6-4c40-a719-64ff2acd9778" path="/var/lib/kubelet/pods/ce090a97-9ab6-4c40-a719-64ff2acd9778/volumes" Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.755238 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d19cb085-0c5b-4810-b654-ce7923221d90" path="/var/lib/kubelet/pods/d19cb085-0c5b-4810-b654-ce7923221d90/volumes" Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.757087 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d45be74c-0d98-4d18-90e4-f7ef1b6daaf7" path="/var/lib/kubelet/pods/d45be74c-0d98-4d18-90e4-f7ef1b6daaf7/volumes" Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.758249 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d565531a-ff86-4608-9d19-767de01ac31b" path="/var/lib/kubelet/pods/d565531a-ff86-4608-9d19-767de01ac31b/volumes" Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.759628 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d7e8f42f-dc0e-424b-bb56-5ec849834888" path="/var/lib/kubelet/pods/d7e8f42f-dc0e-424b-bb56-5ec849834888/volumes" Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.760470 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dcd10325-9ba5-4a3b-8e4a-e57e3bf210f9" path="/var/lib/kubelet/pods/dcd10325-9ba5-4a3b-8e4a-e57e3bf210f9/volumes" Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.762240 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e093be35-bb62-4843-b2e8-094545761610" path="/var/lib/kubelet/pods/e093be35-bb62-4843-b2e8-094545761610/volumes" Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.763096 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e1d2a42d-af1d-4054-9618-ab545e0ed8b7" path="/var/lib/kubelet/pods/e1d2a42d-af1d-4054-9618-ab545e0ed8b7/volumes" Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.764354 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f559dfa3-3917-43a2-97f6-61ddfda10e93" path="/var/lib/kubelet/pods/f559dfa3-3917-43a2-97f6-61ddfda10e93/volumes" Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.765997 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f65c0ac1-8bca-454d-a2e6-e35cb418beac" path="/var/lib/kubelet/pods/f65c0ac1-8bca-454d-a2e6-e35cb418beac/volumes" Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.767101 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f7648cbb-48eb-4ba8-87ec-eb096b8fa1e4" path="/var/lib/kubelet/pods/f7648cbb-48eb-4ba8-87ec-eb096b8fa1e4/volumes" Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.767953 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f7e2c886-118e-43bb-bef1-c78134de392b" path="/var/lib/kubelet/pods/f7e2c886-118e-43bb-bef1-c78134de392b/volumes" Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.770529 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc8db2c7-859d-47b3-a900-2bd0c0b2973b" path="/var/lib/kubelet/pods/fc8db2c7-859d-47b3-a900-2bd0c0b2973b/volumes" Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.771500 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-5bb8f5cd97-xdvz5" Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.771549 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fhkjl" Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.771556 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xr8r2" Mar 16 15:33:22 crc kubenswrapper[5120]: E0316 15:33:22.771644 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-source-5bb8f5cd97-xdvz5" podUID="f863fff9-286a-45fa-b8f0-8a86994b8440" Mar 16 15:33:22 crc kubenswrapper[5120]: E0316 15:33:22.771719 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fhkjl" podUID="17b87002-b798-480a-8e17-83053d698239" Mar 16 15:33:22 crc kubenswrapper[5120]: E0316 15:33:22.771833 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xr8r2" podUID="4464728a-4869-4476-83de-cb34577ace7f" Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.771892 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5ff7774fd9-nljh6" Mar 16 15:33:22 crc kubenswrapper[5120]: E0316 15:33:22.772015 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-console/networking-console-plugin-5ff7774fd9-nljh6" podUID="6a9ae5f6-97bd-46ac-bafa-ca1b4452a141" Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.773117 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.773144 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.773155 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.773169 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.773179 5120 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T15:33:22Z","lastTransitionTime":"2026-03-16T15:33:22Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.875997 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.876047 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.876060 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.876077 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.876089 5120 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T15:33:22Z","lastTransitionTime":"2026-03-16T15:33:22Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.978611 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.978670 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.978689 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.978710 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 15:33:22 crc kubenswrapper[5120]: I0316 15:33:22.978725 5120 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T15:33:22Z","lastTransitionTime":"2026-03-16T15:33:22Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 15:33:23 crc kubenswrapper[5120]: I0316 15:33:23.039444 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/network-operator-7bdcf4f5bd-7fjxv" event={"ID":"34177974-8d82-49d2-a763-391d0df3bbd8","Type":"ContainerStarted","Data":"5f4143771d2f61367b52eaa71a7f6fcc744d2c5ef3f692bcfc58f4ac883cedde"} Mar 16 15:33:23 crc kubenswrapper[5120]: I0316 15:33:23.041853 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" event={"ID":"e2275cb4-4905-4d66-a87e-8010120db2bd","Type":"ContainerStarted","Data":"1e34524f573163516a0c5e63c9d8963cba678bd04553bcf755c603465de633dd"} Mar 16 15:33:23 crc kubenswrapper[5120]: I0316 15:33:23.041906 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" event={"ID":"e2275cb4-4905-4d66-a87e-8010120db2bd","Type":"ContainerStarted","Data":"918b5e16649d3658eed82cd6bd90691a9be4a2e395ae1cb2cac748c3eee9124d"} Mar 16 15:33:23 crc kubenswrapper[5120]: I0316 15:33:23.041917 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" event={"ID":"e2275cb4-4905-4d66-a87e-8010120db2bd","Type":"ContainerStarted","Data":"ec513944dc6d1efde0dfe17056aa1e2193a1b817ffafa62aa1fa01b0ac67b831"} Mar 16 15:33:23 crc kubenswrapper[5120]: I0316 15:33:23.044772 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-v822j" event={"ID":"ac55471d-4e42-475f-a082-50f611571482","Type":"ContainerStarted","Data":"ac6f302a9d165da7336a546eec904a1e65d980e0309b292a120714327c5c39d1"} Mar 16 15:33:23 crc kubenswrapper[5120]: I0316 15:33:23.044825 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-v822j" event={"ID":"ac55471d-4e42-475f-a082-50f611571482","Type":"ContainerStarted","Data":"ff0a04f12f280d7f01e7a7c53f2060962b54254d4ff77f83ab57aeae315cba53"} Mar 16 15:33:23 crc kubenswrapper[5120]: I0316 15:33:23.046474 5120 generic.go:358] "Generic (PLEG): container finished" podID="1ba0f093-ad5c-4a99-bfc2-8439162d5b72" containerID="81e6b73c323d06c39e01b26252333e0cee1a950fd893b1d6870d20cb51871bfb" exitCode=0 Mar 16 15:33:23 crc kubenswrapper[5120]: I0316 15:33:23.046580 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zwk29" event={"ID":"1ba0f093-ad5c-4a99-bfc2-8439162d5b72","Type":"ContainerDied","Data":"81e6b73c323d06c39e01b26252333e0cee1a950fd893b1d6870d20cb51871bfb"} Mar 16 15:33:23 crc kubenswrapper[5120]: I0316 15:33:23.049881 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7sp2j" event={"ID":"6fd3bcf4-5dd2-45e2-b8a8-a83c8b02903f","Type":"ContainerStarted","Data":"45399328d15b4cf066c7839d67c793888a6e91ebcfb9143f6b902465fd099f7e"} Mar 16 15:33:23 crc kubenswrapper[5120]: I0316 15:33:23.049930 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7sp2j" event={"ID":"6fd3bcf4-5dd2-45e2-b8a8-a83c8b02903f","Type":"ContainerStarted","Data":"e9173c86f51fc90570716add66f84eb2377cc0ec073145824944a43fb4ebc2ec"} Mar 16 15:33:23 crc kubenswrapper[5120]: I0316 15:33:23.053029 5120 generic.go:358] "Generic (PLEG): container finished" podID="2b62d686-4b05-42c7-b806-9e2caf8c34e8" containerID="8c8f9cc451e3c95b22effefc3b5eb0e8f4751530648434849250c41f1da7e92c" exitCode=0 Mar 16 15:33:23 crc kubenswrapper[5120]: I0316 15:33:23.053096 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qqjfh" event={"ID":"2b62d686-4b05-42c7-b806-9e2caf8c34e8","Type":"ContainerDied","Data":"8c8f9cc451e3c95b22effefc3b5eb0e8f4751530648434849250c41f1da7e92c"} Mar 16 15:33:23 crc kubenswrapper[5120]: I0316 15:33:23.053114 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qqjfh" event={"ID":"2b62d686-4b05-42c7-b806-9e2caf8c34e8","Type":"ContainerStarted","Data":"b736ce7900f0ebb516412b1a6e57373e6f8454a17739f601a41fa5fd03031e1a"} Mar 16 15:33:23 crc kubenswrapper[5120]: I0316 15:33:23.055983 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jsv7k" event={"ID":"236824b8-2653-4916-ae64-5ff75a7d6178","Type":"ContainerStarted","Data":"3495c31a232e94b04692a73fa38e7e43e5f818cc26d0aa7fbc55b3b8995efdcc"} Mar 16 15:33:23 crc kubenswrapper[5120]: I0316 15:33:23.057677 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-node-identity/network-node-identity-dgvkt" event={"ID":"fc4541ce-7789-4670-bc75-5c2868e52ce0","Type":"ContainerStarted","Data":"4900adb57efe0e603811366f9ba496fd5cab84c021186beddc5d75ecd523021a"} Mar 16 15:33:23 crc kubenswrapper[5120]: I0316 15:33:23.057701 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-node-identity/network-node-identity-dgvkt" event={"ID":"fc4541ce-7789-4670-bc75-5c2868e52ce0","Type":"ContainerStarted","Data":"f153426944bb42f9ac3fd40df2668f1d89b3cbc410b361017d9403417a9c8f03"} Mar 16 15:33:23 crc kubenswrapper[5120]: I0316 15:33:23.059392 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-control-plane-57b78d8988-hbs9k" event={"ID":"8e29c57a-87ae-4f7a-82f5-867e05ccf280","Type":"ContainerStarted","Data":"3837f4e4459e4db9b445cceb8460bbb08ec502cdb8bf44bd11d2dbcc5317fb21"} Mar 16 15:33:23 crc kubenswrapper[5120]: I0316 15:33:23.059416 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-control-plane-57b78d8988-hbs9k" event={"ID":"8e29c57a-87ae-4f7a-82f5-867e05ccf280","Type":"ContainerStarted","Data":"5009c491b8f92f9ca29a95cf32a3d4eb3c55910a35bafbdb72ab55ccc93496c1"} Mar 16 15:33:23 crc kubenswrapper[5120]: I0316 15:33:23.059425 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-control-plane-57b78d8988-hbs9k" event={"ID":"8e29c57a-87ae-4f7a-82f5-867e05ccf280","Type":"ContainerStarted","Data":"386a28725142690bbe9f5cd09cf7aa4a587746430cfa53ce544b9de1d72cc5d7"} Mar 16 15:33:23 crc kubenswrapper[5120]: I0316 15:33:23.080643 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:33:23 crc kubenswrapper[5120]: I0316 15:33:23.080670 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:33:23 crc kubenswrapper[5120]: I0316 15:33:23.080698 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:33:23 crc kubenswrapper[5120]: I0316 15:33:23.080710 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 15:33:23 crc kubenswrapper[5120]: I0316 15:33:23.080719 5120 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T15:33:23Z","lastTransitionTime":"2026-03-16T15:33:23Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 15:33:23 crc kubenswrapper[5120]: I0316 15:33:23.183157 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:33:23 crc kubenswrapper[5120]: I0316 15:33:23.183253 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:33:23 crc kubenswrapper[5120]: I0316 15:33:23.183267 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:33:23 crc kubenswrapper[5120]: I0316 15:33:23.183285 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 15:33:23 crc kubenswrapper[5120]: I0316 15:33:23.183300 5120 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T15:33:23Z","lastTransitionTime":"2026-03-16T15:33:23Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 15:33:23 crc kubenswrapper[5120]: I0316 15:33:23.190928 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-scheduler/openshift-kube-scheduler-crc" podStartSLOduration=3.190907313 podStartE2EDuration="3.190907313s" podCreationTimestamp="2026-03-16 15:33:20 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:33:23.189003981 +0000 UTC m=+105.342935648" watchObservedRunningTime="2026-03-16 15:33:23.190907313 +0000 UTC m=+105.344838970" Mar 16 15:33:23 crc kubenswrapper[5120]: I0316 15:33:23.191061 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-controller-manager/kube-controller-manager-crc" podStartSLOduration=3.191056667 podStartE2EDuration="3.191056667s" podCreationTimestamp="2026-03-16 15:33:20 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:33:23.175205537 +0000 UTC m=+105.329137194" watchObservedRunningTime="2026-03-16 15:33:23.191056667 +0000 UTC m=+105.344988324" Mar 16 15:33:23 crc kubenswrapper[5120]: I0316 15:33:23.291293 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:33:23 crc kubenswrapper[5120]: I0316 15:33:23.291328 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:33:23 crc kubenswrapper[5120]: I0316 15:33:23.291336 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:33:23 crc kubenswrapper[5120]: I0316 15:33:23.291351 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 15:33:23 crc kubenswrapper[5120]: I0316 15:33:23.291360 5120 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T15:33:23Z","lastTransitionTime":"2026-03-16T15:33:23Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 15:33:23 crc kubenswrapper[5120]: I0316 15:33:23.313721 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 15:33:23 crc kubenswrapper[5120]: I0316 15:33:23.313844 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6a9ae5f6-97bd-46ac-bafa-ca1b4452a141-networking-console-plugin-cert\") pod \"networking-console-plugin-5ff7774fd9-nljh6\" (UID: \"6a9ae5f6-97bd-46ac-bafa-ca1b4452a141\") " pod="openshift-network-console/networking-console-plugin-5ff7774fd9-nljh6" Mar 16 15:33:23 crc kubenswrapper[5120]: E0316 15:33:23.313889 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 15:33:25.313863205 +0000 UTC m=+107.467794862 (durationBeforeRetry 2s). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:23 crc kubenswrapper[5120]: E0316 15:33:23.313937 5120 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: object "openshift-network-console"/"networking-console-plugin-cert" not registered Mar 16 15:33:23 crc kubenswrapper[5120]: I0316 15:33:23.313972 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6a9ae5f6-97bd-46ac-bafa-ca1b4452a141-nginx-conf\") pod \"networking-console-plugin-5ff7774fd9-nljh6\" (UID: \"6a9ae5f6-97bd-46ac-bafa-ca1b4452a141\") " pod="openshift-network-console/networking-console-plugin-5ff7774fd9-nljh6" Mar 16 15:33:23 crc kubenswrapper[5120]: E0316 15:33:23.313994 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a9ae5f6-97bd-46ac-bafa-ca1b4452a141-networking-console-plugin-cert podName:6a9ae5f6-97bd-46ac-bafa-ca1b4452a141 nodeName:}" failed. No retries permitted until 2026-03-16 15:33:25.313979339 +0000 UTC m=+107.467910996 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6a9ae5f6-97bd-46ac-bafa-ca1b4452a141-networking-console-plugin-cert") pod "networking-console-plugin-5ff7774fd9-nljh6" (UID: "6a9ae5f6-97bd-46ac-bafa-ca1b4452a141") : object "openshift-network-console"/"networking-console-plugin-cert" not registered Mar 16 15:33:23 crc kubenswrapper[5120]: E0316 15:33:23.314033 5120 configmap.go:193] Couldn't get configMap openshift-network-console/networking-console-plugin: object "openshift-network-console"/"networking-console-plugin" not registered Mar 16 15:33:23 crc kubenswrapper[5120]: E0316 15:33:23.314081 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6a9ae5f6-97bd-46ac-bafa-ca1b4452a141-nginx-conf podName:6a9ae5f6-97bd-46ac-bafa-ca1b4452a141 nodeName:}" failed. No retries permitted until 2026-03-16 15:33:25.314072911 +0000 UTC m=+107.468004658 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "nginx-conf" (UniqueName: "kubernetes.io/configmap/6a9ae5f6-97bd-46ac-bafa-ca1b4452a141-nginx-conf") pod "networking-console-plugin-5ff7774fd9-nljh6" (UID: "6a9ae5f6-97bd-46ac-bafa-ca1b4452a141") : object "openshift-network-console"/"networking-console-plugin" not registered Mar 16 15:33:23 crc kubenswrapper[5120]: I0316 15:33:23.361781 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-etcd/etcd-crc" podStartSLOduration=2.361745047 podStartE2EDuration="2.361745047s" podCreationTimestamp="2026-03-16 15:33:21 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:33:23.335157064 +0000 UTC m=+105.489088731" watchObservedRunningTime="2026-03-16 15:33:23.361745047 +0000 UTC m=+105.515676704" Mar 16 15:33:23 crc kubenswrapper[5120]: I0316 15:33:23.402036 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:33:23 crc kubenswrapper[5120]: I0316 15:33:23.402090 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:33:23 crc kubenswrapper[5120]: I0316 15:33:23.402103 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:33:23 crc kubenswrapper[5120]: I0316 15:33:23.402121 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 15:33:23 crc kubenswrapper[5120]: I0316 15:33:23.402137 5120 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T15:33:23Z","lastTransitionTime":"2026-03-16T15:33:23Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 15:33:23 crc kubenswrapper[5120]: I0316 15:33:23.410840 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-crc" podStartSLOduration=2.410822961 podStartE2EDuration="2.410822961s" podCreationTimestamp="2026-03-16 15:33:21 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:33:23.375519281 +0000 UTC m=+105.529450948" watchObservedRunningTime="2026-03-16 15:33:23.410822961 +0000 UTC m=+105.564754618" Mar 16 15:33:23 crc kubenswrapper[5120]: I0316 15:33:23.419254 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l7w75\" (UniqueName: \"kubernetes.io/projected/f863fff9-286a-45fa-b8f0-8a86994b8440-kube-api-access-l7w75\") pod \"network-check-source-5bb8f5cd97-xdvz5\" (UID: \"f863fff9-286a-45fa-b8f0-8a86994b8440\") " pod="openshift-network-diagnostics/network-check-source-5bb8f5cd97-xdvz5" Mar 16 15:33:23 crc kubenswrapper[5120]: I0316 15:33:23.419612 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4464728a-4869-4476-83de-cb34577ace7f-metrics-certs\") pod \"network-metrics-daemon-xr8r2\" (UID: \"4464728a-4869-4476-83de-cb34577ace7f\") " pod="openshift-multus/network-metrics-daemon-xr8r2" Mar 16 15:33:23 crc kubenswrapper[5120]: I0316 15:33:23.419639 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gwt8b\" (UniqueName: \"kubernetes.io/projected/17b87002-b798-480a-8e17-83053d698239-kube-api-access-gwt8b\") pod \"network-check-target-fhkjl\" (UID: \"17b87002-b798-480a-8e17-83053d698239\") " pod="openshift-network-diagnostics/network-check-target-fhkjl" Mar 16 15:33:23 crc kubenswrapper[5120]: E0316 15:33:23.419776 5120 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Mar 16 15:33:23 crc kubenswrapper[5120]: E0316 15:33:23.419792 5120 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Mar 16 15:33:23 crc kubenswrapper[5120]: E0316 15:33:23.419802 5120 projected.go:194] Error preparing data for projected volume kube-api-access-gwt8b for pod openshift-network-diagnostics/network-check-target-fhkjl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Mar 16 15:33:23 crc kubenswrapper[5120]: E0316 15:33:23.419868 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/17b87002-b798-480a-8e17-83053d698239-kube-api-access-gwt8b podName:17b87002-b798-480a-8e17-83053d698239 nodeName:}" failed. No retries permitted until 2026-03-16 15:33:25.419854446 +0000 UTC m=+107.573786103 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-gwt8b" (UniqueName: "kubernetes.io/projected/17b87002-b798-480a-8e17-83053d698239-kube-api-access-gwt8b") pod "network-check-target-fhkjl" (UID: "17b87002-b798-480a-8e17-83053d698239") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Mar 16 15:33:23 crc kubenswrapper[5120]: E0316 15:33:23.420173 5120 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Mar 16 15:33:23 crc kubenswrapper[5120]: E0316 15:33:23.420188 5120 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Mar 16 15:33:23 crc kubenswrapper[5120]: E0316 15:33:23.420195 5120 projected.go:194] Error preparing data for projected volume kube-api-access-l7w75 for pod openshift-network-diagnostics/network-check-source-5bb8f5cd97-xdvz5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Mar 16 15:33:23 crc kubenswrapper[5120]: E0316 15:33:23.420219 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f863fff9-286a-45fa-b8f0-8a86994b8440-kube-api-access-l7w75 podName:f863fff9-286a-45fa-b8f0-8a86994b8440 nodeName:}" failed. No retries permitted until 2026-03-16 15:33:25.420212646 +0000 UTC m=+107.574144303 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-l7w75" (UniqueName: "kubernetes.io/projected/f863fff9-286a-45fa-b8f0-8a86994b8440-kube-api-access-l7w75") pod "network-check-source-5bb8f5cd97-xdvz5" (UID: "f863fff9-286a-45fa-b8f0-8a86994b8440") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Mar 16 15:33:23 crc kubenswrapper[5120]: E0316 15:33:23.420257 5120 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Mar 16 15:33:23 crc kubenswrapper[5120]: E0316 15:33:23.420277 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4464728a-4869-4476-83de-cb34577ace7f-metrics-certs podName:4464728a-4869-4476-83de-cb34577ace7f nodeName:}" failed. No retries permitted until 2026-03-16 15:33:25.420271128 +0000 UTC m=+107.574202785 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4464728a-4869-4476-83de-cb34577ace7f-metrics-certs") pod "network-metrics-daemon-xr8r2" (UID: "4464728a-4869-4476-83de-cb34577ace7f") : object "openshift-multus"/"metrics-daemon-secret" not registered Mar 16 15:33:23 crc kubenswrapper[5120]: I0316 15:33:23.501834 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-jsv7k" podStartSLOduration=84.501818554 podStartE2EDuration="1m24.501818554s" podCreationTimestamp="2026-03-16 15:31:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:33:23.50129709 +0000 UTC m=+105.655228747" watchObservedRunningTime="2026-03-16 15:33:23.501818554 +0000 UTC m=+105.655750211" Mar 16 15:33:23 crc kubenswrapper[5120]: I0316 15:33:23.504689 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:33:23 crc kubenswrapper[5120]: I0316 15:33:23.504733 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:33:23 crc kubenswrapper[5120]: I0316 15:33:23.504745 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:33:23 crc kubenswrapper[5120]: I0316 15:33:23.504775 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 15:33:23 crc kubenswrapper[5120]: I0316 15:33:23.504786 5120 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T15:33:23Z","lastTransitionTime":"2026-03-16T15:33:23Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 15:33:23 crc kubenswrapper[5120]: I0316 15:33:23.519675 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-v822j" podStartSLOduration=84.519658219 podStartE2EDuration="1m24.519658219s" podCreationTimestamp="2026-03-16 15:31:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:33:23.519482055 +0000 UTC m=+105.673413702" watchObservedRunningTime="2026-03-16 15:33:23.519658219 +0000 UTC m=+105.673589876" Mar 16 15:33:23 crc kubenswrapper[5120]: I0316 15:33:23.543836 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-7sp2j" podStartSLOduration=84.543817266 podStartE2EDuration="1m24.543817266s" podCreationTimestamp="2026-03-16 15:31:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:33:23.543017113 +0000 UTC m=+105.696948780" watchObservedRunningTime="2026-03-16 15:33:23.543817266 +0000 UTC m=+105.697748923" Mar 16 15:33:23 crc kubenswrapper[5120]: I0316 15:33:23.544164 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-control-plane-57b78d8988-hbs9k" podStartSLOduration=84.544159495 podStartE2EDuration="1m24.544159495s" podCreationTimestamp="2026-03-16 15:31:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:33:23.533291289 +0000 UTC m=+105.687222946" watchObservedRunningTime="2026-03-16 15:33:23.544159495 +0000 UTC m=+105.698091142" Mar 16 15:33:23 crc kubenswrapper[5120]: I0316 15:33:23.557191 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podStartSLOduration=84.557175738 podStartE2EDuration="1m24.557175738s" podCreationTimestamp="2026-03-16 15:31:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:33:23.556389197 +0000 UTC m=+105.710320864" watchObservedRunningTime="2026-03-16 15:33:23.557175738 +0000 UTC m=+105.711107395" Mar 16 15:33:23 crc kubenswrapper[5120]: I0316 15:33:23.607110 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:33:23 crc kubenswrapper[5120]: I0316 15:33:23.607151 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:33:23 crc kubenswrapper[5120]: I0316 15:33:23.607160 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:33:23 crc kubenswrapper[5120]: I0316 15:33:23.607174 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 15:33:23 crc kubenswrapper[5120]: I0316 15:33:23.607183 5120 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T15:33:23Z","lastTransitionTime":"2026-03-16T15:33:23Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 15:33:23 crc kubenswrapper[5120]: I0316 15:33:23.710991 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:33:23 crc kubenswrapper[5120]: I0316 15:33:23.711043 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:33:23 crc kubenswrapper[5120]: I0316 15:33:23.711055 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:33:23 crc kubenswrapper[5120]: I0316 15:33:23.711074 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 15:33:23 crc kubenswrapper[5120]: I0316 15:33:23.711086 5120 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T15:33:23Z","lastTransitionTime":"2026-03-16T15:33:23Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 15:33:23 crc kubenswrapper[5120]: I0316 15:33:23.813035 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:33:23 crc kubenswrapper[5120]: I0316 15:33:23.813074 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:33:23 crc kubenswrapper[5120]: I0316 15:33:23.813083 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:33:23 crc kubenswrapper[5120]: I0316 15:33:23.813096 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 15:33:23 crc kubenswrapper[5120]: I0316 15:33:23.813106 5120 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T15:33:23Z","lastTransitionTime":"2026-03-16T15:33:23Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 15:33:23 crc kubenswrapper[5120]: I0316 15:33:23.915000 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:33:23 crc kubenswrapper[5120]: I0316 15:33:23.915034 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:33:23 crc kubenswrapper[5120]: I0316 15:33:23.915044 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:33:23 crc kubenswrapper[5120]: I0316 15:33:23.915058 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 15:33:23 crc kubenswrapper[5120]: I0316 15:33:23.915069 5120 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T15:33:23Z","lastTransitionTime":"2026-03-16T15:33:23Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 15:33:24 crc kubenswrapper[5120]: I0316 15:33:24.016341 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:33:24 crc kubenswrapper[5120]: I0316 15:33:24.016955 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:33:24 crc kubenswrapper[5120]: I0316 15:33:24.016966 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:33:24 crc kubenswrapper[5120]: I0316 15:33:24.016981 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 15:33:24 crc kubenswrapper[5120]: I0316 15:33:24.016991 5120 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T15:33:24Z","lastTransitionTime":"2026-03-16T15:33:24Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 15:33:24 crc kubenswrapper[5120]: I0316 15:33:24.065717 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qqjfh" event={"ID":"2b62d686-4b05-42c7-b806-9e2caf8c34e8","Type":"ContainerStarted","Data":"be67cf6d7a1df7edd2bcb645f19093ce8bcd6cabb5e97bda8f791ef03743c40f"} Mar 16 15:33:24 crc kubenswrapper[5120]: I0316 15:33:24.069363 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zwk29" event={"ID":"1ba0f093-ad5c-4a99-bfc2-8439162d5b72","Type":"ContainerStarted","Data":"5e1ff7f5cff66589f32172b6a241d38d3d4bd6f3362edb816884ba90b9bc0653"} Mar 16 15:33:24 crc kubenswrapper[5120]: I0316 15:33:24.069389 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zwk29" event={"ID":"1ba0f093-ad5c-4a99-bfc2-8439162d5b72","Type":"ContainerStarted","Data":"d51409051329a3bd8d7f9c4219c81a54f53669f0495718e78d7501a4ef44fd2a"} Mar 16 15:33:24 crc kubenswrapper[5120]: I0316 15:33:24.069398 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zwk29" event={"ID":"1ba0f093-ad5c-4a99-bfc2-8439162d5b72","Type":"ContainerStarted","Data":"f78d3044e1cfdeec2ea5aef2775d8bfadb77ebf6f76a7bf2e6876d1888766e1d"} Mar 16 15:33:24 crc kubenswrapper[5120]: I0316 15:33:24.118711 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:33:24 crc kubenswrapper[5120]: I0316 15:33:24.118740 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:33:24 crc kubenswrapper[5120]: I0316 15:33:24.118748 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:33:24 crc kubenswrapper[5120]: I0316 15:33:24.118779 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 15:33:24 crc kubenswrapper[5120]: I0316 15:33:24.118788 5120 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T15:33:24Z","lastTransitionTime":"2026-03-16T15:33:24Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 15:33:24 crc kubenswrapper[5120]: I0316 15:33:24.220532 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:33:24 crc kubenswrapper[5120]: I0316 15:33:24.220573 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:33:24 crc kubenswrapper[5120]: I0316 15:33:24.220582 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:33:24 crc kubenswrapper[5120]: I0316 15:33:24.220610 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 15:33:24 crc kubenswrapper[5120]: I0316 15:33:24.220623 5120 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T15:33:24Z","lastTransitionTime":"2026-03-16T15:33:24Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 15:33:24 crc kubenswrapper[5120]: I0316 15:33:24.322374 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:33:24 crc kubenswrapper[5120]: I0316 15:33:24.322424 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:33:24 crc kubenswrapper[5120]: I0316 15:33:24.322436 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:33:24 crc kubenswrapper[5120]: I0316 15:33:24.322449 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 15:33:24 crc kubenswrapper[5120]: I0316 15:33:24.322460 5120 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T15:33:24Z","lastTransitionTime":"2026-03-16T15:33:24Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 15:33:24 crc kubenswrapper[5120]: I0316 15:33:24.425218 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:33:24 crc kubenswrapper[5120]: I0316 15:33:24.425290 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:33:24 crc kubenswrapper[5120]: I0316 15:33:24.425303 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:33:24 crc kubenswrapper[5120]: I0316 15:33:24.425321 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 15:33:24 crc kubenswrapper[5120]: I0316 15:33:24.425361 5120 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T15:33:24Z","lastTransitionTime":"2026-03-16T15:33:24Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 15:33:24 crc kubenswrapper[5120]: I0316 15:33:24.527888 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:33:24 crc kubenswrapper[5120]: I0316 15:33:24.527933 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:33:24 crc kubenswrapper[5120]: I0316 15:33:24.527942 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:33:24 crc kubenswrapper[5120]: I0316 15:33:24.527957 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 15:33:24 crc kubenswrapper[5120]: I0316 15:33:24.527976 5120 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T15:33:24Z","lastTransitionTime":"2026-03-16T15:33:24Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 15:33:24 crc kubenswrapper[5120]: I0316 15:33:24.630143 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:33:24 crc kubenswrapper[5120]: I0316 15:33:24.630209 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:33:24 crc kubenswrapper[5120]: I0316 15:33:24.630227 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:33:24 crc kubenswrapper[5120]: I0316 15:33:24.630251 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 15:33:24 crc kubenswrapper[5120]: I0316 15:33:24.630284 5120 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T15:33:24Z","lastTransitionTime":"2026-03-16T15:33:24Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 15:33:24 crc kubenswrapper[5120]: I0316 15:33:24.663987 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xr8r2" Mar 16 15:33:24 crc kubenswrapper[5120]: I0316 15:33:24.664201 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5ff7774fd9-nljh6" Mar 16 15:33:24 crc kubenswrapper[5120]: E0316 15:33:24.664313 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-console/networking-console-plugin-5ff7774fd9-nljh6" podUID="6a9ae5f6-97bd-46ac-bafa-ca1b4452a141" Mar 16 15:33:24 crc kubenswrapper[5120]: E0316 15:33:24.664200 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xr8r2" podUID="4464728a-4869-4476-83de-cb34577ace7f" Mar 16 15:33:24 crc kubenswrapper[5120]: I0316 15:33:24.664365 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fhkjl" Mar 16 15:33:24 crc kubenswrapper[5120]: E0316 15:33:24.664421 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fhkjl" podUID="17b87002-b798-480a-8e17-83053d698239" Mar 16 15:33:24 crc kubenswrapper[5120]: I0316 15:33:24.664446 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-5bb8f5cd97-xdvz5" Mar 16 15:33:24 crc kubenswrapper[5120]: E0316 15:33:24.664500 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-source-5bb8f5cd97-xdvz5" podUID="f863fff9-286a-45fa-b8f0-8a86994b8440" Mar 16 15:33:24 crc kubenswrapper[5120]: I0316 15:33:24.732009 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:33:24 crc kubenswrapper[5120]: I0316 15:33:24.732047 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:33:24 crc kubenswrapper[5120]: I0316 15:33:24.732056 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:33:24 crc kubenswrapper[5120]: I0316 15:33:24.732068 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 15:33:24 crc kubenswrapper[5120]: I0316 15:33:24.732076 5120 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T15:33:24Z","lastTransitionTime":"2026-03-16T15:33:24Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 15:33:24 crc kubenswrapper[5120]: I0316 15:33:24.834999 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:33:24 crc kubenswrapper[5120]: I0316 15:33:24.835083 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:33:24 crc kubenswrapper[5120]: I0316 15:33:24.835105 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:33:24 crc kubenswrapper[5120]: I0316 15:33:24.835133 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 15:33:24 crc kubenswrapper[5120]: I0316 15:33:24.835152 5120 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T15:33:24Z","lastTransitionTime":"2026-03-16T15:33:24Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 15:33:24 crc kubenswrapper[5120]: I0316 15:33:24.937599 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:33:24 crc kubenswrapper[5120]: I0316 15:33:24.937654 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:33:24 crc kubenswrapper[5120]: I0316 15:33:24.937666 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:33:24 crc kubenswrapper[5120]: I0316 15:33:24.937684 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 15:33:24 crc kubenswrapper[5120]: I0316 15:33:24.937696 5120 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T15:33:24Z","lastTransitionTime":"2026-03-16T15:33:24Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 15:33:25 crc kubenswrapper[5120]: I0316 15:33:25.040135 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:33:25 crc kubenswrapper[5120]: I0316 15:33:25.040211 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:33:25 crc kubenswrapper[5120]: I0316 15:33:25.040232 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:33:25 crc kubenswrapper[5120]: I0316 15:33:25.040257 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 15:33:25 crc kubenswrapper[5120]: I0316 15:33:25.040277 5120 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T15:33:25Z","lastTransitionTime":"2026-03-16T15:33:25Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 15:33:25 crc kubenswrapper[5120]: I0316 15:33:25.076729 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zwk29" event={"ID":"1ba0f093-ad5c-4a99-bfc2-8439162d5b72","Type":"ContainerStarted","Data":"0f97c48af6799e1c6b2f3be9772b7af91dc410d9e22b47214000397e5aa4863e"} Mar 16 15:33:25 crc kubenswrapper[5120]: I0316 15:33:25.076787 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zwk29" event={"ID":"1ba0f093-ad5c-4a99-bfc2-8439162d5b72","Type":"ContainerStarted","Data":"e2097aa0c8d162defaeaf9622b03c7fa67f6ca6fe08e2f39b2067dc0355e5ec3"} Mar 16 15:33:25 crc kubenswrapper[5120]: I0316 15:33:25.076797 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zwk29" event={"ID":"1ba0f093-ad5c-4a99-bfc2-8439162d5b72","Type":"ContainerStarted","Data":"556c5f7552cef130952b14c75e576e515a6625b30229eebc4f6c2c030631302b"} Mar 16 15:33:25 crc kubenswrapper[5120]: I0316 15:33:25.079146 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-5jnd7" event={"ID":"428b39f5-eb1c-4f65-b7a4-eeb6e84860cc","Type":"ContainerStarted","Data":"bb076ca4690a856189bd3ec76df30637422407e91b95e107761a9b416daa8846"} Mar 16 15:33:25 crc kubenswrapper[5120]: I0316 15:33:25.082192 5120 generic.go:358] "Generic (PLEG): container finished" podID="2b62d686-4b05-42c7-b806-9e2caf8c34e8" containerID="be67cf6d7a1df7edd2bcb645f19093ce8bcd6cabb5e97bda8f791ef03743c40f" exitCode=0 Mar 16 15:33:25 crc kubenswrapper[5120]: I0316 15:33:25.082284 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qqjfh" event={"ID":"2b62d686-4b05-42c7-b806-9e2caf8c34e8","Type":"ContainerDied","Data":"be67cf6d7a1df7edd2bcb645f19093ce8bcd6cabb5e97bda8f791ef03743c40f"} Mar 16 15:33:25 crc kubenswrapper[5120]: I0316 15:33:25.142863 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:33:25 crc kubenswrapper[5120]: I0316 15:33:25.142901 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:33:25 crc kubenswrapper[5120]: I0316 15:33:25.142909 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:33:25 crc kubenswrapper[5120]: I0316 15:33:25.142921 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 15:33:25 crc kubenswrapper[5120]: I0316 15:33:25.142930 5120 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T15:33:25Z","lastTransitionTime":"2026-03-16T15:33:25Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 15:33:25 crc kubenswrapper[5120]: I0316 15:33:25.244745 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:33:25 crc kubenswrapper[5120]: I0316 15:33:25.244839 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:33:25 crc kubenswrapper[5120]: I0316 15:33:25.244856 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:33:25 crc kubenswrapper[5120]: I0316 15:33:25.244888 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 15:33:25 crc kubenswrapper[5120]: I0316 15:33:25.244903 5120 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T15:33:25Z","lastTransitionTime":"2026-03-16T15:33:25Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 15:33:25 crc kubenswrapper[5120]: I0316 15:33:25.343664 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 15:33:25 crc kubenswrapper[5120]: E0316 15:33:25.343877 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 15:33:29.343846921 +0000 UTC m=+111.497778578 (durationBeforeRetry 4s). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:25 crc kubenswrapper[5120]: I0316 15:33:25.343931 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6a9ae5f6-97bd-46ac-bafa-ca1b4452a141-nginx-conf\") pod \"networking-console-plugin-5ff7774fd9-nljh6\" (UID: \"6a9ae5f6-97bd-46ac-bafa-ca1b4452a141\") " pod="openshift-network-console/networking-console-plugin-5ff7774fd9-nljh6" Mar 16 15:33:25 crc kubenswrapper[5120]: E0316 15:33:25.344068 5120 configmap.go:193] Couldn't get configMap openshift-network-console/networking-console-plugin: object "openshift-network-console"/"networking-console-plugin" not registered Mar 16 15:33:25 crc kubenswrapper[5120]: I0316 15:33:25.344091 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6a9ae5f6-97bd-46ac-bafa-ca1b4452a141-networking-console-plugin-cert\") pod \"networking-console-plugin-5ff7774fd9-nljh6\" (UID: \"6a9ae5f6-97bd-46ac-bafa-ca1b4452a141\") " pod="openshift-network-console/networking-console-plugin-5ff7774fd9-nljh6" Mar 16 15:33:25 crc kubenswrapper[5120]: E0316 15:33:25.344138 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6a9ae5f6-97bd-46ac-bafa-ca1b4452a141-nginx-conf podName:6a9ae5f6-97bd-46ac-bafa-ca1b4452a141 nodeName:}" failed. No retries permitted until 2026-03-16 15:33:29.34411861 +0000 UTC m=+111.498050277 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "nginx-conf" (UniqueName: "kubernetes.io/configmap/6a9ae5f6-97bd-46ac-bafa-ca1b4452a141-nginx-conf") pod "networking-console-plugin-5ff7774fd9-nljh6" (UID: "6a9ae5f6-97bd-46ac-bafa-ca1b4452a141") : object "openshift-network-console"/"networking-console-plugin" not registered Mar 16 15:33:25 crc kubenswrapper[5120]: E0316 15:33:25.344210 5120 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: object "openshift-network-console"/"networking-console-plugin-cert" not registered Mar 16 15:33:25 crc kubenswrapper[5120]: E0316 15:33:25.344263 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a9ae5f6-97bd-46ac-bafa-ca1b4452a141-networking-console-plugin-cert podName:6a9ae5f6-97bd-46ac-bafa-ca1b4452a141 nodeName:}" failed. No retries permitted until 2026-03-16 15:33:29.344251123 +0000 UTC m=+111.498182830 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6a9ae5f6-97bd-46ac-bafa-ca1b4452a141-networking-console-plugin-cert") pod "networking-console-plugin-5ff7774fd9-nljh6" (UID: "6a9ae5f6-97bd-46ac-bafa-ca1b4452a141") : object "openshift-network-console"/"networking-console-plugin-cert" not registered Mar 16 15:33:25 crc kubenswrapper[5120]: I0316 15:33:25.346684 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:33:25 crc kubenswrapper[5120]: I0316 15:33:25.346743 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:33:25 crc kubenswrapper[5120]: I0316 15:33:25.346825 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:33:25 crc kubenswrapper[5120]: I0316 15:33:25.346844 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 15:33:25 crc kubenswrapper[5120]: I0316 15:33:25.346853 5120 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T15:33:25Z","lastTransitionTime":"2026-03-16T15:33:25Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 15:33:25 crc kubenswrapper[5120]: I0316 15:33:25.445308 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4464728a-4869-4476-83de-cb34577ace7f-metrics-certs\") pod \"network-metrics-daemon-xr8r2\" (UID: \"4464728a-4869-4476-83de-cb34577ace7f\") " pod="openshift-multus/network-metrics-daemon-xr8r2" Mar 16 15:33:25 crc kubenswrapper[5120]: I0316 15:33:25.445356 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gwt8b\" (UniqueName: \"kubernetes.io/projected/17b87002-b798-480a-8e17-83053d698239-kube-api-access-gwt8b\") pod \"network-check-target-fhkjl\" (UID: \"17b87002-b798-480a-8e17-83053d698239\") " pod="openshift-network-diagnostics/network-check-target-fhkjl" Mar 16 15:33:25 crc kubenswrapper[5120]: I0316 15:33:25.445394 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l7w75\" (UniqueName: \"kubernetes.io/projected/f863fff9-286a-45fa-b8f0-8a86994b8440-kube-api-access-l7w75\") pod \"network-check-source-5bb8f5cd97-xdvz5\" (UID: \"f863fff9-286a-45fa-b8f0-8a86994b8440\") " pod="openshift-network-diagnostics/network-check-source-5bb8f5cd97-xdvz5" Mar 16 15:33:25 crc kubenswrapper[5120]: E0316 15:33:25.445498 5120 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Mar 16 15:33:25 crc kubenswrapper[5120]: E0316 15:33:25.445513 5120 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Mar 16 15:33:25 crc kubenswrapper[5120]: E0316 15:33:25.445522 5120 projected.go:194] Error preparing data for projected volume kube-api-access-l7w75 for pod openshift-network-diagnostics/network-check-source-5bb8f5cd97-xdvz5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Mar 16 15:33:25 crc kubenswrapper[5120]: E0316 15:33:25.445523 5120 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Mar 16 15:33:25 crc kubenswrapper[5120]: E0316 15:33:25.445575 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f863fff9-286a-45fa-b8f0-8a86994b8440-kube-api-access-l7w75 podName:f863fff9-286a-45fa-b8f0-8a86994b8440 nodeName:}" failed. No retries permitted until 2026-03-16 15:33:29.445561736 +0000 UTC m=+111.599493393 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-l7w75" (UniqueName: "kubernetes.io/projected/f863fff9-286a-45fa-b8f0-8a86994b8440-kube-api-access-l7w75") pod "network-check-source-5bb8f5cd97-xdvz5" (UID: "f863fff9-286a-45fa-b8f0-8a86994b8440") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Mar 16 15:33:25 crc kubenswrapper[5120]: E0316 15:33:25.445600 5120 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Mar 16 15:33:25 crc kubenswrapper[5120]: E0316 15:33:25.445632 5120 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Mar 16 15:33:25 crc kubenswrapper[5120]: E0316 15:33:25.445643 5120 projected.go:194] Error preparing data for projected volume kube-api-access-gwt8b for pod openshift-network-diagnostics/network-check-target-fhkjl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Mar 16 15:33:25 crc kubenswrapper[5120]: E0316 15:33:25.445687 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4464728a-4869-4476-83de-cb34577ace7f-metrics-certs podName:4464728a-4869-4476-83de-cb34577ace7f nodeName:}" failed. No retries permitted until 2026-03-16 15:33:29.445661269 +0000 UTC m=+111.599592936 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4464728a-4869-4476-83de-cb34577ace7f-metrics-certs") pod "network-metrics-daemon-xr8r2" (UID: "4464728a-4869-4476-83de-cb34577ace7f") : object "openshift-multus"/"metrics-daemon-secret" not registered Mar 16 15:33:25 crc kubenswrapper[5120]: E0316 15:33:25.445744 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/17b87002-b798-480a-8e17-83053d698239-kube-api-access-gwt8b podName:17b87002-b798-480a-8e17-83053d698239 nodeName:}" failed. No retries permitted until 2026-03-16 15:33:29.445734111 +0000 UTC m=+111.599665778 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-gwt8b" (UniqueName: "kubernetes.io/projected/17b87002-b798-480a-8e17-83053d698239-kube-api-access-gwt8b") pod "network-check-target-fhkjl" (UID: "17b87002-b798-480a-8e17-83053d698239") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Mar 16 15:33:25 crc kubenswrapper[5120]: I0316 15:33:25.448163 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:33:25 crc kubenswrapper[5120]: I0316 15:33:25.448200 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:33:25 crc kubenswrapper[5120]: I0316 15:33:25.448210 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:33:25 crc kubenswrapper[5120]: I0316 15:33:25.448222 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 15:33:25 crc kubenswrapper[5120]: I0316 15:33:25.448232 5120 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T15:33:25Z","lastTransitionTime":"2026-03-16T15:33:25Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 15:33:25 crc kubenswrapper[5120]: I0316 15:33:25.550565 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:33:25 crc kubenswrapper[5120]: I0316 15:33:25.550615 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:33:25 crc kubenswrapper[5120]: I0316 15:33:25.550628 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:33:25 crc kubenswrapper[5120]: I0316 15:33:25.550646 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 15:33:25 crc kubenswrapper[5120]: I0316 15:33:25.550658 5120 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T15:33:25Z","lastTransitionTime":"2026-03-16T15:33:25Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 15:33:25 crc kubenswrapper[5120]: I0316 15:33:25.652895 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:33:25 crc kubenswrapper[5120]: I0316 15:33:25.652947 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:33:25 crc kubenswrapper[5120]: I0316 15:33:25.652959 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:33:25 crc kubenswrapper[5120]: I0316 15:33:25.652979 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 15:33:25 crc kubenswrapper[5120]: I0316 15:33:25.652993 5120 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T15:33:25Z","lastTransitionTime":"2026-03-16T15:33:25Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 15:33:25 crc kubenswrapper[5120]: I0316 15:33:25.755594 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:33:25 crc kubenswrapper[5120]: I0316 15:33:25.755664 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:33:25 crc kubenswrapper[5120]: I0316 15:33:25.755685 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:33:25 crc kubenswrapper[5120]: I0316 15:33:25.755710 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 15:33:25 crc kubenswrapper[5120]: I0316 15:33:25.755728 5120 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T15:33:25Z","lastTransitionTime":"2026-03-16T15:33:25Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 15:33:25 crc kubenswrapper[5120]: I0316 15:33:25.857808 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:33:25 crc kubenswrapper[5120]: I0316 15:33:25.857862 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:33:25 crc kubenswrapper[5120]: I0316 15:33:25.857878 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:33:25 crc kubenswrapper[5120]: I0316 15:33:25.857902 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 15:33:25 crc kubenswrapper[5120]: I0316 15:33:25.857918 5120 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T15:33:25Z","lastTransitionTime":"2026-03-16T15:33:25Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 15:33:25 crc kubenswrapper[5120]: I0316 15:33:25.960377 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:33:25 crc kubenswrapper[5120]: I0316 15:33:25.960419 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:33:25 crc kubenswrapper[5120]: I0316 15:33:25.960432 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:33:25 crc kubenswrapper[5120]: I0316 15:33:25.960445 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 15:33:25 crc kubenswrapper[5120]: I0316 15:33:25.960455 5120 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T15:33:25Z","lastTransitionTime":"2026-03-16T15:33:25Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 15:33:26 crc kubenswrapper[5120]: I0316 15:33:26.062450 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:33:26 crc kubenswrapper[5120]: I0316 15:33:26.062522 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:33:26 crc kubenswrapper[5120]: I0316 15:33:26.062547 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:33:26 crc kubenswrapper[5120]: I0316 15:33:26.062576 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 15:33:26 crc kubenswrapper[5120]: I0316 15:33:26.062597 5120 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T15:33:26Z","lastTransitionTime":"2026-03-16T15:33:26Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 15:33:26 crc kubenswrapper[5120]: I0316 15:33:26.087108 5120 generic.go:358] "Generic (PLEG): container finished" podID="2b62d686-4b05-42c7-b806-9e2caf8c34e8" containerID="2a94ef44a50fc0495a30e1f60ac9b42884df77de80b12a5b726b515f391da3c2" exitCode=0 Mar 16 15:33:26 crc kubenswrapper[5120]: I0316 15:33:26.087199 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qqjfh" event={"ID":"2b62d686-4b05-42c7-b806-9e2caf8c34e8","Type":"ContainerDied","Data":"2a94ef44a50fc0495a30e1f60ac9b42884df77de80b12a5b726b515f391da3c2"} Mar 16 15:33:26 crc kubenswrapper[5120]: I0316 15:33:26.165199 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:33:26 crc kubenswrapper[5120]: I0316 15:33:26.165242 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:33:26 crc kubenswrapper[5120]: I0316 15:33:26.165251 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:33:26 crc kubenswrapper[5120]: I0316 15:33:26.165266 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 15:33:26 crc kubenswrapper[5120]: I0316 15:33:26.165276 5120 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T15:33:26Z","lastTransitionTime":"2026-03-16T15:33:26Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 15:33:26 crc kubenswrapper[5120]: I0316 15:33:26.267468 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:33:26 crc kubenswrapper[5120]: I0316 15:33:26.267516 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:33:26 crc kubenswrapper[5120]: I0316 15:33:26.267534 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:33:26 crc kubenswrapper[5120]: I0316 15:33:26.267554 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 15:33:26 crc kubenswrapper[5120]: I0316 15:33:26.267569 5120 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T15:33:26Z","lastTransitionTime":"2026-03-16T15:33:26Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 15:33:26 crc kubenswrapper[5120]: I0316 15:33:26.373024 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:33:26 crc kubenswrapper[5120]: I0316 15:33:26.373470 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:33:26 crc kubenswrapper[5120]: I0316 15:33:26.373489 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:33:26 crc kubenswrapper[5120]: I0316 15:33:26.373513 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 15:33:26 crc kubenswrapper[5120]: I0316 15:33:26.373532 5120 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T15:33:26Z","lastTransitionTime":"2026-03-16T15:33:26Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 15:33:26 crc kubenswrapper[5120]: I0316 15:33:26.475492 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:33:26 crc kubenswrapper[5120]: I0316 15:33:26.475547 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:33:26 crc kubenswrapper[5120]: I0316 15:33:26.475563 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:33:26 crc kubenswrapper[5120]: I0316 15:33:26.475582 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 15:33:26 crc kubenswrapper[5120]: I0316 15:33:26.475598 5120 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T15:33:26Z","lastTransitionTime":"2026-03-16T15:33:26Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 15:33:26 crc kubenswrapper[5120]: I0316 15:33:26.577522 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:33:26 crc kubenswrapper[5120]: I0316 15:33:26.577592 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:33:26 crc kubenswrapper[5120]: I0316 15:33:26.577618 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:33:26 crc kubenswrapper[5120]: I0316 15:33:26.577662 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 15:33:26 crc kubenswrapper[5120]: I0316 15:33:26.577686 5120 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T15:33:26Z","lastTransitionTime":"2026-03-16T15:33:26Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 15:33:26 crc kubenswrapper[5120]: I0316 15:33:26.663352 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-5bb8f5cd97-xdvz5" Mar 16 15:33:26 crc kubenswrapper[5120]: I0316 15:33:26.663391 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fhkjl" Mar 16 15:33:26 crc kubenswrapper[5120]: I0316 15:33:26.663405 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xr8r2" Mar 16 15:33:26 crc kubenswrapper[5120]: I0316 15:33:26.663515 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5ff7774fd9-nljh6" Mar 16 15:33:26 crc kubenswrapper[5120]: E0316 15:33:26.663534 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-source-5bb8f5cd97-xdvz5" podUID="f863fff9-286a-45fa-b8f0-8a86994b8440" Mar 16 15:33:26 crc kubenswrapper[5120]: E0316 15:33:26.663655 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fhkjl" podUID="17b87002-b798-480a-8e17-83053d698239" Mar 16 15:33:26 crc kubenswrapper[5120]: E0316 15:33:26.663821 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-console/networking-console-plugin-5ff7774fd9-nljh6" podUID="6a9ae5f6-97bd-46ac-bafa-ca1b4452a141" Mar 16 15:33:26 crc kubenswrapper[5120]: E0316 15:33:26.663989 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xr8r2" podUID="4464728a-4869-4476-83de-cb34577ace7f" Mar 16 15:33:26 crc kubenswrapper[5120]: I0316 15:33:26.680222 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:33:26 crc kubenswrapper[5120]: I0316 15:33:26.680312 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:33:26 crc kubenswrapper[5120]: I0316 15:33:26.680373 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:33:26 crc kubenswrapper[5120]: I0316 15:33:26.680400 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 15:33:26 crc kubenswrapper[5120]: I0316 15:33:26.680459 5120 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T15:33:26Z","lastTransitionTime":"2026-03-16T15:33:26Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 15:33:26 crc kubenswrapper[5120]: I0316 15:33:26.782669 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:33:26 crc kubenswrapper[5120]: I0316 15:33:26.782719 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:33:26 crc kubenswrapper[5120]: I0316 15:33:26.782744 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:33:26 crc kubenswrapper[5120]: I0316 15:33:26.782799 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 15:33:26 crc kubenswrapper[5120]: I0316 15:33:26.782817 5120 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T15:33:26Z","lastTransitionTime":"2026-03-16T15:33:26Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 15:33:26 crc kubenswrapper[5120]: I0316 15:33:26.885030 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:33:26 crc kubenswrapper[5120]: I0316 15:33:26.885092 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:33:26 crc kubenswrapper[5120]: I0316 15:33:26.885111 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:33:26 crc kubenswrapper[5120]: I0316 15:33:26.885138 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 15:33:26 crc kubenswrapper[5120]: I0316 15:33:26.885157 5120 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T15:33:26Z","lastTransitionTime":"2026-03-16T15:33:26Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 15:33:26 crc kubenswrapper[5120]: I0316 15:33:26.987493 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:33:26 crc kubenswrapper[5120]: I0316 15:33:26.987553 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:33:26 crc kubenswrapper[5120]: I0316 15:33:26.987571 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:33:26 crc kubenswrapper[5120]: I0316 15:33:26.987594 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 15:33:26 crc kubenswrapper[5120]: I0316 15:33:26.987611 5120 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T15:33:26Z","lastTransitionTime":"2026-03-16T15:33:26Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 15:33:27 crc kubenswrapper[5120]: I0316 15:33:27.089487 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:33:27 crc kubenswrapper[5120]: I0316 15:33:27.089559 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:33:27 crc kubenswrapper[5120]: I0316 15:33:27.089578 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:33:27 crc kubenswrapper[5120]: I0316 15:33:27.089602 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 15:33:27 crc kubenswrapper[5120]: I0316 15:33:27.089620 5120 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T15:33:27Z","lastTransitionTime":"2026-03-16T15:33:27Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 15:33:27 crc kubenswrapper[5120]: I0316 15:33:27.103478 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zwk29" event={"ID":"1ba0f093-ad5c-4a99-bfc2-8439162d5b72","Type":"ContainerStarted","Data":"31bd6609f0a26c6471b5cc968812bd56971cd57f918766fe4ede24149b12679c"} Mar 16 15:33:27 crc kubenswrapper[5120]: I0316 15:33:27.107225 5120 generic.go:358] "Generic (PLEG): container finished" podID="2b62d686-4b05-42c7-b806-9e2caf8c34e8" containerID="7f58ee83b4d61ae7a8647802ee4a8ce3d51a16c1a8deea3ded9a854a7541b7d7" exitCode=0 Mar 16 15:33:27 crc kubenswrapper[5120]: I0316 15:33:27.107332 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qqjfh" event={"ID":"2b62d686-4b05-42c7-b806-9e2caf8c34e8","Type":"ContainerDied","Data":"7f58ee83b4d61ae7a8647802ee4a8ce3d51a16c1a8deea3ded9a854a7541b7d7"} Mar 16 15:33:27 crc kubenswrapper[5120]: I0316 15:33:27.193642 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:33:27 crc kubenswrapper[5120]: I0316 15:33:27.193806 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:33:27 crc kubenswrapper[5120]: I0316 15:33:27.193842 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:33:27 crc kubenswrapper[5120]: I0316 15:33:27.193877 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 15:33:27 crc kubenswrapper[5120]: I0316 15:33:27.193901 5120 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T15:33:27Z","lastTransitionTime":"2026-03-16T15:33:27Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 15:33:27 crc kubenswrapper[5120]: I0316 15:33:27.296491 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:33:27 crc kubenswrapper[5120]: I0316 15:33:27.296561 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:33:27 crc kubenswrapper[5120]: I0316 15:33:27.296580 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:33:27 crc kubenswrapper[5120]: I0316 15:33:27.296605 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 15:33:27 crc kubenswrapper[5120]: I0316 15:33:27.296622 5120 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T15:33:27Z","lastTransitionTime":"2026-03-16T15:33:27Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 15:33:27 crc kubenswrapper[5120]: I0316 15:33:27.398685 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:33:27 crc kubenswrapper[5120]: I0316 15:33:27.398718 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:33:27 crc kubenswrapper[5120]: I0316 15:33:27.398727 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:33:27 crc kubenswrapper[5120]: I0316 15:33:27.398739 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 15:33:27 crc kubenswrapper[5120]: I0316 15:33:27.398750 5120 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T15:33:27Z","lastTransitionTime":"2026-03-16T15:33:27Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 15:33:27 crc kubenswrapper[5120]: I0316 15:33:27.502239 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:33:27 crc kubenswrapper[5120]: I0316 15:33:27.502306 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:33:27 crc kubenswrapper[5120]: I0316 15:33:27.502326 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:33:27 crc kubenswrapper[5120]: I0316 15:33:27.502350 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 15:33:27 crc kubenswrapper[5120]: I0316 15:33:27.502365 5120 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T15:33:27Z","lastTransitionTime":"2026-03-16T15:33:27Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 15:33:27 crc kubenswrapper[5120]: I0316 15:33:27.605976 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:33:27 crc kubenswrapper[5120]: I0316 15:33:27.606042 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:33:27 crc kubenswrapper[5120]: I0316 15:33:27.606060 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:33:27 crc kubenswrapper[5120]: I0316 15:33:27.606086 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 15:33:27 crc kubenswrapper[5120]: I0316 15:33:27.606103 5120 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T15:33:27Z","lastTransitionTime":"2026-03-16T15:33:27Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 15:33:27 crc kubenswrapper[5120]: I0316 15:33:27.709345 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:33:27 crc kubenswrapper[5120]: I0316 15:33:27.709410 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:33:27 crc kubenswrapper[5120]: I0316 15:33:27.709431 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:33:27 crc kubenswrapper[5120]: I0316 15:33:27.709460 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 15:33:27 crc kubenswrapper[5120]: I0316 15:33:27.709480 5120 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T15:33:27Z","lastTransitionTime":"2026-03-16T15:33:27Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 15:33:27 crc kubenswrapper[5120]: I0316 15:33:27.812488 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:33:27 crc kubenswrapper[5120]: I0316 15:33:27.813246 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:33:27 crc kubenswrapper[5120]: I0316 15:33:27.813288 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:33:27 crc kubenswrapper[5120]: I0316 15:33:27.813322 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 15:33:27 crc kubenswrapper[5120]: I0316 15:33:27.813346 5120 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T15:33:27Z","lastTransitionTime":"2026-03-16T15:33:27Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 15:33:27 crc kubenswrapper[5120]: I0316 15:33:27.915676 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:33:27 crc kubenswrapper[5120]: I0316 15:33:27.915733 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:33:27 crc kubenswrapper[5120]: I0316 15:33:27.915751 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:33:27 crc kubenswrapper[5120]: I0316 15:33:27.915810 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 15:33:27 crc kubenswrapper[5120]: I0316 15:33:27.915828 5120 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T15:33:27Z","lastTransitionTime":"2026-03-16T15:33:27Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 15:33:27 crc kubenswrapper[5120]: I0316 15:33:27.996975 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:33:27 crc kubenswrapper[5120]: I0316 15:33:27.997055 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:33:27 crc kubenswrapper[5120]: I0316 15:33:27.997074 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:33:27 crc kubenswrapper[5120]: I0316 15:33:27.997100 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 15:33:27 crc kubenswrapper[5120]: I0316 15:33:27.997120 5120 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T15:33:27Z","lastTransitionTime":"2026-03-16T15:33:27Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 15:33:28 crc kubenswrapper[5120]: I0316 15:33:28.019378 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 15:33:28 crc kubenswrapper[5120]: I0316 15:33:28.019452 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 15:33:28 crc kubenswrapper[5120]: I0316 15:33:28.019471 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 15:33:28 crc kubenswrapper[5120]: I0316 15:33:28.019508 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 15:33:28 crc kubenswrapper[5120]: I0316 15:33:28.019526 5120 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T15:33:28Z","lastTransitionTime":"2026-03-16T15:33:28Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 15:33:28 crc kubenswrapper[5120]: I0316 15:33:28.066243 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-version/cluster-version-operator-7c9b9cfd6-2sbjs"] Mar 16 15:33:28 crc kubenswrapper[5120]: I0316 15:33:28.074790 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-version/cluster-version-operator-7c9b9cfd6-2sbjs" Mar 16 15:33:28 crc kubenswrapper[5120]: I0316 15:33:28.078578 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-version\"/\"cluster-version-operator-serving-cert\"" Mar 16 15:33:28 crc kubenswrapper[5120]: I0316 15:33:28.080124 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-version\"/\"openshift-service-ca.crt\"" Mar 16 15:33:28 crc kubenswrapper[5120]: I0316 15:33:28.080157 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-version\"/\"kube-root-ca.crt\"" Mar 16 15:33:28 crc kubenswrapper[5120]: I0316 15:33:28.080533 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-version\"/\"default-dockercfg-hqpm5\"" Mar 16 15:33:28 crc kubenswrapper[5120]: I0316 15:33:28.115878 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qqjfh" event={"ID":"2b62d686-4b05-42c7-b806-9e2caf8c34e8","Type":"ContainerStarted","Data":"a5f64ab7d11cf8fb6d781ec3781efc25b0a13d9a51426306d57fd039bf7cb57c"} Mar 16 15:33:28 crc kubenswrapper[5120]: I0316 15:33:28.177141 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-ssl-certs\" (UniqueName: \"kubernetes.io/host-path/db9d10b7-b746-491d-891b-6a43b70ef618-etc-ssl-certs\") pod \"cluster-version-operator-7c9b9cfd6-2sbjs\" (UID: \"db9d10b7-b746-491d-891b-6a43b70ef618\") " pod="openshift-cluster-version/cluster-version-operator-7c9b9cfd6-2sbjs" Mar 16 15:33:28 crc kubenswrapper[5120]: I0316 15:33:28.177212 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/db9d10b7-b746-491d-891b-6a43b70ef618-service-ca\") pod \"cluster-version-operator-7c9b9cfd6-2sbjs\" (UID: \"db9d10b7-b746-491d-891b-6a43b70ef618\") " pod="openshift-cluster-version/cluster-version-operator-7c9b9cfd6-2sbjs" Mar 16 15:33:28 crc kubenswrapper[5120]: I0316 15:33:28.177370 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/db9d10b7-b746-491d-891b-6a43b70ef618-serving-cert\") pod \"cluster-version-operator-7c9b9cfd6-2sbjs\" (UID: \"db9d10b7-b746-491d-891b-6a43b70ef618\") " pod="openshift-cluster-version/cluster-version-operator-7c9b9cfd6-2sbjs" Mar 16 15:33:28 crc kubenswrapper[5120]: I0316 15:33:28.177549 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/db9d10b7-b746-491d-891b-6a43b70ef618-kube-api-access\") pod \"cluster-version-operator-7c9b9cfd6-2sbjs\" (UID: \"db9d10b7-b746-491d-891b-6a43b70ef618\") " pod="openshift-cluster-version/cluster-version-operator-7c9b9cfd6-2sbjs" Mar 16 15:33:28 crc kubenswrapper[5120]: I0316 15:33:28.177916 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-cvo-updatepayloads\" (UniqueName: \"kubernetes.io/host-path/db9d10b7-b746-491d-891b-6a43b70ef618-etc-cvo-updatepayloads\") pod \"cluster-version-operator-7c9b9cfd6-2sbjs\" (UID: \"db9d10b7-b746-491d-891b-6a43b70ef618\") " pod="openshift-cluster-version/cluster-version-operator-7c9b9cfd6-2sbjs" Mar 16 15:33:28 crc kubenswrapper[5120]: I0316 15:33:28.279431 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-cvo-updatepayloads\" (UniqueName: \"kubernetes.io/host-path/db9d10b7-b746-491d-891b-6a43b70ef618-etc-cvo-updatepayloads\") pod \"cluster-version-operator-7c9b9cfd6-2sbjs\" (UID: \"db9d10b7-b746-491d-891b-6a43b70ef618\") " pod="openshift-cluster-version/cluster-version-operator-7c9b9cfd6-2sbjs" Mar 16 15:33:28 crc kubenswrapper[5120]: I0316 15:33:28.279565 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-ssl-certs\" (UniqueName: \"kubernetes.io/host-path/db9d10b7-b746-491d-891b-6a43b70ef618-etc-ssl-certs\") pod \"cluster-version-operator-7c9b9cfd6-2sbjs\" (UID: \"db9d10b7-b746-491d-891b-6a43b70ef618\") " pod="openshift-cluster-version/cluster-version-operator-7c9b9cfd6-2sbjs" Mar 16 15:33:28 crc kubenswrapper[5120]: I0316 15:33:28.279601 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-cvo-updatepayloads\" (UniqueName: \"kubernetes.io/host-path/db9d10b7-b746-491d-891b-6a43b70ef618-etc-cvo-updatepayloads\") pod \"cluster-version-operator-7c9b9cfd6-2sbjs\" (UID: \"db9d10b7-b746-491d-891b-6a43b70ef618\") " pod="openshift-cluster-version/cluster-version-operator-7c9b9cfd6-2sbjs" Mar 16 15:33:28 crc kubenswrapper[5120]: I0316 15:33:28.279604 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/db9d10b7-b746-491d-891b-6a43b70ef618-service-ca\") pod \"cluster-version-operator-7c9b9cfd6-2sbjs\" (UID: \"db9d10b7-b746-491d-891b-6a43b70ef618\") " pod="openshift-cluster-version/cluster-version-operator-7c9b9cfd6-2sbjs" Mar 16 15:33:28 crc kubenswrapper[5120]: I0316 15:33:28.279746 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-ssl-certs\" (UniqueName: \"kubernetes.io/host-path/db9d10b7-b746-491d-891b-6a43b70ef618-etc-ssl-certs\") pod \"cluster-version-operator-7c9b9cfd6-2sbjs\" (UID: \"db9d10b7-b746-491d-891b-6a43b70ef618\") " pod="openshift-cluster-version/cluster-version-operator-7c9b9cfd6-2sbjs" Mar 16 15:33:28 crc kubenswrapper[5120]: I0316 15:33:28.280827 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/db9d10b7-b746-491d-891b-6a43b70ef618-serving-cert\") pod \"cluster-version-operator-7c9b9cfd6-2sbjs\" (UID: \"db9d10b7-b746-491d-891b-6a43b70ef618\") " pod="openshift-cluster-version/cluster-version-operator-7c9b9cfd6-2sbjs" Mar 16 15:33:28 crc kubenswrapper[5120]: I0316 15:33:28.280915 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/db9d10b7-b746-491d-891b-6a43b70ef618-kube-api-access\") pod \"cluster-version-operator-7c9b9cfd6-2sbjs\" (UID: \"db9d10b7-b746-491d-891b-6a43b70ef618\") " pod="openshift-cluster-version/cluster-version-operator-7c9b9cfd6-2sbjs" Mar 16 15:33:28 crc kubenswrapper[5120]: I0316 15:33:28.281410 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/db9d10b7-b746-491d-891b-6a43b70ef618-service-ca\") pod \"cluster-version-operator-7c9b9cfd6-2sbjs\" (UID: \"db9d10b7-b746-491d-891b-6a43b70ef618\") " pod="openshift-cluster-version/cluster-version-operator-7c9b9cfd6-2sbjs" Mar 16 15:33:28 crc kubenswrapper[5120]: I0316 15:33:28.291523 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/db9d10b7-b746-491d-891b-6a43b70ef618-serving-cert\") pod \"cluster-version-operator-7c9b9cfd6-2sbjs\" (UID: \"db9d10b7-b746-491d-891b-6a43b70ef618\") " pod="openshift-cluster-version/cluster-version-operator-7c9b9cfd6-2sbjs" Mar 16 15:33:28 crc kubenswrapper[5120]: I0316 15:33:28.311502 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/db9d10b7-b746-491d-891b-6a43b70ef618-kube-api-access\") pod \"cluster-version-operator-7c9b9cfd6-2sbjs\" (UID: \"db9d10b7-b746-491d-891b-6a43b70ef618\") " pod="openshift-cluster-version/cluster-version-operator-7c9b9cfd6-2sbjs" Mar 16 15:33:28 crc kubenswrapper[5120]: I0316 15:33:28.394980 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-version/cluster-version-operator-7c9b9cfd6-2sbjs" Mar 16 15:33:28 crc kubenswrapper[5120]: W0316 15:33:28.419333 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb9d10b7_b746_491d_891b_6a43b70ef618.slice/crio-37c910a2b68d40c303786f019ce3de075d42ec61ff9ee198976c5ee232eafc90 WatchSource:0}: Error finding container 37c910a2b68d40c303786f019ce3de075d42ec61ff9ee198976c5ee232eafc90: Status 404 returned error can't find the container with id 37c910a2b68d40c303786f019ce3de075d42ec61ff9ee198976c5ee232eafc90 Mar 16 15:33:28 crc kubenswrapper[5120]: I0316 15:33:28.665677 5120 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Mar 16 15:33:28 crc kubenswrapper[5120]: I0316 15:33:28.665951 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-5bb8f5cd97-xdvz5" Mar 16 15:33:28 crc kubenswrapper[5120]: I0316 15:33:28.666104 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fhkjl" Mar 16 15:33:28 crc kubenswrapper[5120]: I0316 15:33:28.666163 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xr8r2" Mar 16 15:33:28 crc kubenswrapper[5120]: E0316 15:33:28.666158 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-source-5bb8f5cd97-xdvz5" podUID="f863fff9-286a-45fa-b8f0-8a86994b8440" Mar 16 15:33:28 crc kubenswrapper[5120]: E0316 15:33:28.666280 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xr8r2" podUID="4464728a-4869-4476-83de-cb34577ace7f" Mar 16 15:33:28 crc kubenswrapper[5120]: I0316 15:33:28.666289 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5ff7774fd9-nljh6" Mar 16 15:33:28 crc kubenswrapper[5120]: E0316 15:33:28.666417 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fhkjl" podUID="17b87002-b798-480a-8e17-83053d698239" Mar 16 15:33:28 crc kubenswrapper[5120]: E0316 15:33:28.666521 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-console/networking-console-plugin-5ff7774fd9-nljh6" podUID="6a9ae5f6-97bd-46ac-bafa-ca1b4452a141" Mar 16 15:33:28 crc kubenswrapper[5120]: I0316 15:33:28.676190 5120 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Mar 16 15:33:29 crc kubenswrapper[5120]: I0316 15:33:29.125465 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zwk29" event={"ID":"1ba0f093-ad5c-4a99-bfc2-8439162d5b72","Type":"ContainerStarted","Data":"95c59ce10d5cb44ed144db2fabe3f00638cada4e2996ac5ae763b853f6252c53"} Mar 16 15:33:29 crc kubenswrapper[5120]: I0316 15:33:29.125954 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zwk29" Mar 16 15:33:29 crc kubenswrapper[5120]: I0316 15:33:29.125981 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zwk29" Mar 16 15:33:29 crc kubenswrapper[5120]: I0316 15:33:29.125999 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zwk29" Mar 16 15:33:29 crc kubenswrapper[5120]: I0316 15:33:29.129458 5120 generic.go:358] "Generic (PLEG): container finished" podID="2b62d686-4b05-42c7-b806-9e2caf8c34e8" containerID="a5f64ab7d11cf8fb6d781ec3781efc25b0a13d9a51426306d57fd039bf7cb57c" exitCode=0 Mar 16 15:33:29 crc kubenswrapper[5120]: I0316 15:33:29.129531 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qqjfh" event={"ID":"2b62d686-4b05-42c7-b806-9e2caf8c34e8","Type":"ContainerDied","Data":"a5f64ab7d11cf8fb6d781ec3781efc25b0a13d9a51426306d57fd039bf7cb57c"} Mar 16 15:33:29 crc kubenswrapper[5120]: I0316 15:33:29.131273 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-version/cluster-version-operator-7c9b9cfd6-2sbjs" event={"ID":"db9d10b7-b746-491d-891b-6a43b70ef618","Type":"ContainerStarted","Data":"785bc8c6f16bd7235ae4f595274667e49a175547a17f9380bf249ceb72fc6f4f"} Mar 16 15:33:29 crc kubenswrapper[5120]: I0316 15:33:29.131349 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-version/cluster-version-operator-7c9b9cfd6-2sbjs" event={"ID":"db9d10b7-b746-491d-891b-6a43b70ef618","Type":"ContainerStarted","Data":"37c910a2b68d40c303786f019ce3de075d42ec61ff9ee198976c5ee232eafc90"} Mar 16 15:33:29 crc kubenswrapper[5120]: I0316 15:33:29.166090 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zwk29" Mar 16 15:33:29 crc kubenswrapper[5120]: I0316 15:33:29.166903 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zwk29" Mar 16 15:33:29 crc kubenswrapper[5120]: I0316 15:33:29.170873 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-zwk29" podStartSLOduration=90.170852993 podStartE2EDuration="1m30.170852993s" podCreationTimestamp="2026-03-16 15:31:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:33:29.169335262 +0000 UTC m=+111.323266969" watchObservedRunningTime="2026-03-16 15:33:29.170852993 +0000 UTC m=+111.324784660" Mar 16 15:33:29 crc kubenswrapper[5120]: I0316 15:33:29.268380 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-version/cluster-version-operator-7c9b9cfd6-2sbjs" podStartSLOduration=90.268362433 podStartE2EDuration="1m30.268362433s" podCreationTimestamp="2026-03-16 15:31:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:33:29.186711764 +0000 UTC m=+111.340643461" watchObservedRunningTime="2026-03-16 15:33:29.268362433 +0000 UTC m=+111.422294090" Mar 16 15:33:29 crc kubenswrapper[5120]: I0316 15:33:29.400981 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 15:33:29 crc kubenswrapper[5120]: E0316 15:33:29.401190 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 15:33:37.401165503 +0000 UTC m=+119.555097160 (durationBeforeRetry 8s). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:29 crc kubenswrapper[5120]: I0316 15:33:29.401290 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6a9ae5f6-97bd-46ac-bafa-ca1b4452a141-networking-console-plugin-cert\") pod \"networking-console-plugin-5ff7774fd9-nljh6\" (UID: \"6a9ae5f6-97bd-46ac-bafa-ca1b4452a141\") " pod="openshift-network-console/networking-console-plugin-5ff7774fd9-nljh6" Mar 16 15:33:29 crc kubenswrapper[5120]: I0316 15:33:29.401340 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6a9ae5f6-97bd-46ac-bafa-ca1b4452a141-nginx-conf\") pod \"networking-console-plugin-5ff7774fd9-nljh6\" (UID: \"6a9ae5f6-97bd-46ac-bafa-ca1b4452a141\") " pod="openshift-network-console/networking-console-plugin-5ff7774fd9-nljh6" Mar 16 15:33:29 crc kubenswrapper[5120]: E0316 15:33:29.401454 5120 configmap.go:193] Couldn't get configMap openshift-network-console/networking-console-plugin: object "openshift-network-console"/"networking-console-plugin" not registered Mar 16 15:33:29 crc kubenswrapper[5120]: E0316 15:33:29.401465 5120 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: object "openshift-network-console"/"networking-console-plugin-cert" not registered Mar 16 15:33:29 crc kubenswrapper[5120]: E0316 15:33:29.401497 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6a9ae5f6-97bd-46ac-bafa-ca1b4452a141-nginx-conf podName:6a9ae5f6-97bd-46ac-bafa-ca1b4452a141 nodeName:}" failed. No retries permitted until 2026-03-16 15:33:37.401491143 +0000 UTC m=+119.555422800 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "nginx-conf" (UniqueName: "kubernetes.io/configmap/6a9ae5f6-97bd-46ac-bafa-ca1b4452a141-nginx-conf") pod "networking-console-plugin-5ff7774fd9-nljh6" (UID: "6a9ae5f6-97bd-46ac-bafa-ca1b4452a141") : object "openshift-network-console"/"networking-console-plugin" not registered Mar 16 15:33:29 crc kubenswrapper[5120]: E0316 15:33:29.401526 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a9ae5f6-97bd-46ac-bafa-ca1b4452a141-networking-console-plugin-cert podName:6a9ae5f6-97bd-46ac-bafa-ca1b4452a141 nodeName:}" failed. No retries permitted until 2026-03-16 15:33:37.401512383 +0000 UTC m=+119.555444040 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6a9ae5f6-97bd-46ac-bafa-ca1b4452a141-networking-console-plugin-cert") pod "networking-console-plugin-5ff7774fd9-nljh6" (UID: "6a9ae5f6-97bd-46ac-bafa-ca1b4452a141") : object "openshift-network-console"/"networking-console-plugin-cert" not registered Mar 16 15:33:29 crc kubenswrapper[5120]: I0316 15:33:29.502225 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l7w75\" (UniqueName: \"kubernetes.io/projected/f863fff9-286a-45fa-b8f0-8a86994b8440-kube-api-access-l7w75\") pod \"network-check-source-5bb8f5cd97-xdvz5\" (UID: \"f863fff9-286a-45fa-b8f0-8a86994b8440\") " pod="openshift-network-diagnostics/network-check-source-5bb8f5cd97-xdvz5" Mar 16 15:33:29 crc kubenswrapper[5120]: I0316 15:33:29.502295 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4464728a-4869-4476-83de-cb34577ace7f-metrics-certs\") pod \"network-metrics-daemon-xr8r2\" (UID: \"4464728a-4869-4476-83de-cb34577ace7f\") " pod="openshift-multus/network-metrics-daemon-xr8r2" Mar 16 15:33:29 crc kubenswrapper[5120]: I0316 15:33:29.502338 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gwt8b\" (UniqueName: \"kubernetes.io/projected/17b87002-b798-480a-8e17-83053d698239-kube-api-access-gwt8b\") pod \"network-check-target-fhkjl\" (UID: \"17b87002-b798-480a-8e17-83053d698239\") " pod="openshift-network-diagnostics/network-check-target-fhkjl" Mar 16 15:33:29 crc kubenswrapper[5120]: E0316 15:33:29.502469 5120 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Mar 16 15:33:29 crc kubenswrapper[5120]: E0316 15:33:29.502481 5120 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Mar 16 15:33:29 crc kubenswrapper[5120]: E0316 15:33:29.502509 5120 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Mar 16 15:33:29 crc kubenswrapper[5120]: E0316 15:33:29.502523 5120 projected.go:194] Error preparing data for projected volume kube-api-access-gwt8b for pod openshift-network-diagnostics/network-check-target-fhkjl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Mar 16 15:33:29 crc kubenswrapper[5120]: E0316 15:33:29.502532 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4464728a-4869-4476-83de-cb34577ace7f-metrics-certs podName:4464728a-4869-4476-83de-cb34577ace7f nodeName:}" failed. No retries permitted until 2026-03-16 15:33:37.502516928 +0000 UTC m=+119.656448585 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4464728a-4869-4476-83de-cb34577ace7f-metrics-certs") pod "network-metrics-daemon-xr8r2" (UID: "4464728a-4869-4476-83de-cb34577ace7f") : object "openshift-multus"/"metrics-daemon-secret" not registered Mar 16 15:33:29 crc kubenswrapper[5120]: E0316 15:33:29.502566 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/17b87002-b798-480a-8e17-83053d698239-kube-api-access-gwt8b podName:17b87002-b798-480a-8e17-83053d698239 nodeName:}" failed. No retries permitted until 2026-03-16 15:33:37.502551439 +0000 UTC m=+119.656483116 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-gwt8b" (UniqueName: "kubernetes.io/projected/17b87002-b798-480a-8e17-83053d698239-kube-api-access-gwt8b") pod "network-check-target-fhkjl" (UID: "17b87002-b798-480a-8e17-83053d698239") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Mar 16 15:33:29 crc kubenswrapper[5120]: E0316 15:33:29.502464 5120 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Mar 16 15:33:29 crc kubenswrapper[5120]: E0316 15:33:29.502590 5120 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Mar 16 15:33:29 crc kubenswrapper[5120]: E0316 15:33:29.502600 5120 projected.go:194] Error preparing data for projected volume kube-api-access-l7w75 for pod openshift-network-diagnostics/network-check-source-5bb8f5cd97-xdvz5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Mar 16 15:33:29 crc kubenswrapper[5120]: E0316 15:33:29.502631 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f863fff9-286a-45fa-b8f0-8a86994b8440-kube-api-access-l7w75 podName:f863fff9-286a-45fa-b8f0-8a86994b8440 nodeName:}" failed. No retries permitted until 2026-03-16 15:33:37.502622851 +0000 UTC m=+119.656554528 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-l7w75" (UniqueName: "kubernetes.io/projected/f863fff9-286a-45fa-b8f0-8a86994b8440-kube-api-access-l7w75") pod "network-check-source-5bb8f5cd97-xdvz5" (UID: "f863fff9-286a-45fa-b8f0-8a86994b8440") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Mar 16 15:33:30 crc kubenswrapper[5120]: I0316 15:33:30.138175 5120 generic.go:358] "Generic (PLEG): container finished" podID="2b62d686-4b05-42c7-b806-9e2caf8c34e8" containerID="55a14625bd103d541ec3ec9a488e1912f27862a5240c64335e73869041dd8f06" exitCode=0 Mar 16 15:33:30 crc kubenswrapper[5120]: I0316 15:33:30.138245 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qqjfh" event={"ID":"2b62d686-4b05-42c7-b806-9e2caf8c34e8","Type":"ContainerDied","Data":"55a14625bd103d541ec3ec9a488e1912f27862a5240c64335e73869041dd8f06"} Mar 16 15:33:30 crc kubenswrapper[5120]: I0316 15:33:30.663108 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-5bb8f5cd97-xdvz5" Mar 16 15:33:30 crc kubenswrapper[5120]: I0316 15:33:30.663209 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5ff7774fd9-nljh6" Mar 16 15:33:30 crc kubenswrapper[5120]: I0316 15:33:30.663210 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fhkjl" Mar 16 15:33:30 crc kubenswrapper[5120]: I0316 15:33:30.663124 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xr8r2" Mar 16 15:33:30 crc kubenswrapper[5120]: E0316 15:33:30.663327 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-source-5bb8f5cd97-xdvz5" podUID="f863fff9-286a-45fa-b8f0-8a86994b8440" Mar 16 15:33:30 crc kubenswrapper[5120]: E0316 15:33:30.663451 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-console/networking-console-plugin-5ff7774fd9-nljh6" podUID="6a9ae5f6-97bd-46ac-bafa-ca1b4452a141" Mar 16 15:33:30 crc kubenswrapper[5120]: E0316 15:33:30.663488 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xr8r2" podUID="4464728a-4869-4476-83de-cb34577ace7f" Mar 16 15:33:30 crc kubenswrapper[5120]: E0316 15:33:30.663579 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fhkjl" podUID="17b87002-b798-480a-8e17-83053d698239" Mar 16 15:33:31 crc kubenswrapper[5120]: I0316 15:33:31.147323 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qqjfh" event={"ID":"2b62d686-4b05-42c7-b806-9e2caf8c34e8","Type":"ContainerStarted","Data":"8ca4e78c45314cc6efccbaa2a21125468e30313c4392efb643f831045ec627e7"} Mar 16 15:33:31 crc kubenswrapper[5120]: I0316 15:33:31.174388 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-qqjfh" podStartSLOduration=92.174366601 podStartE2EDuration="1m32.174366601s" podCreationTimestamp="2026-03-16 15:31:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:33:31.173584199 +0000 UTC m=+113.327515886" watchObservedRunningTime="2026-03-16 15:33:31.174366601 +0000 UTC m=+113.328298278" Mar 16 15:33:31 crc kubenswrapper[5120]: I0316 15:33:31.349057 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xr8r2"] Mar 16 15:33:31 crc kubenswrapper[5120]: I0316 15:33:31.349163 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xr8r2" Mar 16 15:33:31 crc kubenswrapper[5120]: E0316 15:33:31.349248 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xr8r2" podUID="4464728a-4869-4476-83de-cb34577ace7f" Mar 16 15:33:32 crc kubenswrapper[5120]: I0316 15:33:32.663303 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xr8r2" Mar 16 15:33:32 crc kubenswrapper[5120]: E0316 15:33:32.663558 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xr8r2" podUID="4464728a-4869-4476-83de-cb34577ace7f" Mar 16 15:33:32 crc kubenswrapper[5120]: I0316 15:33:32.663652 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-5bb8f5cd97-xdvz5" Mar 16 15:33:32 crc kubenswrapper[5120]: I0316 15:33:32.663686 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5ff7774fd9-nljh6" Mar 16 15:33:32 crc kubenswrapper[5120]: I0316 15:33:32.663749 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fhkjl" Mar 16 15:33:32 crc kubenswrapper[5120]: E0316 15:33:32.664234 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-console/networking-console-plugin-5ff7774fd9-nljh6" podUID="6a9ae5f6-97bd-46ac-bafa-ca1b4452a141" Mar 16 15:33:32 crc kubenswrapper[5120]: E0316 15:33:32.664411 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fhkjl" podUID="17b87002-b798-480a-8e17-83053d698239" Mar 16 15:33:32 crc kubenswrapper[5120]: E0316 15:33:32.664582 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-source-5bb8f5cd97-xdvz5" podUID="f863fff9-286a-45fa-b8f0-8a86994b8440" Mar 16 15:33:34 crc kubenswrapper[5120]: I0316 15:33:34.663585 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-5bb8f5cd97-xdvz5" Mar 16 15:33:34 crc kubenswrapper[5120]: I0316 15:33:34.663669 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fhkjl" Mar 16 15:33:34 crc kubenswrapper[5120]: I0316 15:33:34.663612 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xr8r2" Mar 16 15:33:34 crc kubenswrapper[5120]: I0316 15:33:34.663612 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5ff7774fd9-nljh6" Mar 16 15:33:34 crc kubenswrapper[5120]: E0316 15:33:34.663918 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-source-5bb8f5cd97-xdvz5" podUID="f863fff9-286a-45fa-b8f0-8a86994b8440" Mar 16 15:33:34 crc kubenswrapper[5120]: E0316 15:33:34.664042 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fhkjl" podUID="17b87002-b798-480a-8e17-83053d698239" Mar 16 15:33:34 crc kubenswrapper[5120]: E0316 15:33:34.664155 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xr8r2" podUID="4464728a-4869-4476-83de-cb34577ace7f" Mar 16 15:33:34 crc kubenswrapper[5120]: E0316 15:33:34.664323 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-console/networking-console-plugin-5ff7774fd9-nljh6" podUID="6a9ae5f6-97bd-46ac-bafa-ca1b4452a141" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.108205 5120 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeReady" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.108361 5120 kubelet_node_status.go:550] "Fast updating node status as it just became ready" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.155119 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-apiserver/apiserver-9ddfb9f55-22m28"] Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.166488 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-machine-api/machine-api-operator-755bb95488-5t49b"] Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.167217 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-apiserver/apiserver-9ddfb9f55-22m28" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.171803 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-machine-approver/machine-approver-54c688565-ckfb5"] Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.172558 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-api/machine-api-operator-755bb95488-5t49b" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.184399 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-route-controller-manager/route-controller-manager-776cdc94d6-b9gn7"] Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.186171 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-machine-approver/machine-approver-54c688565-ckfb5" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.189723 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-authentication-operator/authentication-operator-7f5c659b84-p5kbj"] Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.192360 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-apiserver\"/\"audit-1\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.192354 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-apiserver\"/\"openshift-service-ca.crt\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.192701 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-apiserver\"/\"etcd-serving-ca\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.193601 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-apiserver\"/\"encryption-config-1\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.195155 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-apiserver\"/\"image-import-ca\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.196259 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-apiserver\"/\"config\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.197447 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-machine-api\"/\"machine-api-operator-images\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.198372 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-apiserver\"/\"serving-cert\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.199073 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-route-controller-manager/route-controller-manager-776cdc94d6-b9gn7" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.200559 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-machine-api\"/\"openshift-service-ca.crt\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.218838 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-machine-api\"/\"machine-api-operator-tls\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.219053 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-apiserver\"/\"kube-root-ca.crt\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.219159 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-machine-api\"/\"kube-root-ca.crt\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.219263 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-apiserver\"/\"etcd-client\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.219357 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-machine-api\"/\"machine-api-operator-dockercfg-6n5ln\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.219458 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-machine-api\"/\"kube-rbac-proxy\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.219552 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-apiserver\"/\"openshift-apiserver-sa-dockercfg-4zqgh\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.224998 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-machine-approver\"/\"openshift-service-ca.crt\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.225205 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-machine-approver\"/\"kube-root-ca.crt\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.225217 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-machine-approver\"/\"machine-approver-tls\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.225283 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-machine-approver\"/\"machine-approver-sa-dockercfg-wzhvk\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.225328 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-machine-approver\"/\"kube-rbac-proxy\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.225412 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-machine-approver\"/\"machine-approver-config\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.225414 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-apiserver\"/\"trusted-ca-bundle\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.226579 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-67c89758df-lx5p5"] Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.227542 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-authentication-operator/authentication-operator-7f5c659b84-p5kbj" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.229326 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-66587d64c8-blgcz"] Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.230968 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-route-controller-manager\"/\"openshift-service-ca.crt\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.231202 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-route-controller-manager\"/\"config\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.231506 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-route-controller-manager\"/\"serving-cert\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.231619 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-route-controller-manager\"/\"client-ca\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.231739 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-authentication-operator\"/\"authentication-operator-dockercfg-6tbpn\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.231834 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-route-controller-manager\"/\"kube-root-ca.crt\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.231873 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-authentication-operator\"/\"openshift-service-ca.crt\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.231929 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-authentication-operator\"/\"service-ca-bundle\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.231644 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-route-controller-manager\"/\"route-controller-manager-sa-dockercfg-mmcpt\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.232089 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns-operator/dns-operator-799b87ffcd-8kwxr"] Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.232175 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-authentication-operator\"/\"serving-cert\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.232205 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-67c89758df-lx5p5" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.232226 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-authentication-operator\"/\"authentication-operator-config\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.232719 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-66587d64c8-blgcz" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.233274 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-authentication-operator\"/\"kube-root-ca.crt\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.234437 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-apiserver-operator/kube-apiserver-operator-575994946d-mdbz9"] Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.234730 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns-operator/dns-operator-799b87ffcd-8kwxr" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.238156 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.238412 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-kl6m8\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.239028 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-oauth-apiserver/apiserver-8596bd845d-jb8bk"] Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.240252 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.244652 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.245013 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns-operator\"/\"openshift-service-ca.crt\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.245142 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.245301 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.245435 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-6w67b\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.245591 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.245866 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-authentication-operator\"/\"trusted-ca-bundle\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.246104 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns-operator\"/\"metrics-tls\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.246287 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns-operator\"/\"kube-root-ca.crt\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.246439 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns-operator\"/\"dns-operator-dockercfg-wbbsn\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.247065 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-etcd-operator/etcd-operator-69b85846b6-s4s6j"] Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.247180 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver-operator/kube-apiserver-operator-575994946d-mdbz9" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.247243 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-oauth-apiserver/apiserver-8596bd845d-jb8bk" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.250683 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-operator/ingress-operator-6b9cb4dbcf-pdp25"] Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.250881 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-etcd-operator/etcd-operator-69b85846b6-s4s6j" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.251098 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.259235 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-oauth-apiserver\"/\"etcd-serving-ca\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.259414 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-apiserver-operator\"/\"kube-apiserver-operator-config\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.259724 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-oauth-apiserver\"/\"trusted-ca-bundle\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.261120 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-54f497555d-sz9k8"] Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.269399 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-oauth-apiserver\"/\"openshift-service-ca.crt\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.276448 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-operator/ingress-operator-6b9cb4dbcf-pdp25" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.278791 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-etcd-operator\"/\"etcd-service-ca-bundle\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.279045 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-oauth-apiserver\"/\"oauth-apiserver-sa-dockercfg-qqw4z\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.279145 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-etcd-operator\"/\"etcd-operator-dockercfg-4vdnc\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.279380 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-apiserver-operator\"/\"kube-apiserver-operator-serving-cert\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.279591 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-etcd-operator\"/\"etcd-client\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.281996 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-etcd-operator\"/\"etcd-ca-bundle\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.282350 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-etcd-operator\"/\"kube-root-ca.crt\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.283911 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-apiserver-operator\"/\"kube-root-ca.crt\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.284128 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-oauth-apiserver\"/\"kube-root-ca.crt\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.286473 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit\" (UniqueName: \"kubernetes.io/configmap/098dce05-a301-4e1c-b150-5209c633e233-audit\") pod \"apiserver-9ddfb9f55-22m28\" (UID: \"098dce05-a301-4e1c-b150-5209c633e233\") " pod="openshift-apiserver/apiserver-9ddfb9f55-22m28" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.286528 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-import-ca\" (UniqueName: \"kubernetes.io/configmap/098dce05-a301-4e1c-b150-5209c633e233-image-import-ca\") pod \"apiserver-9ddfb9f55-22m28\" (UID: \"098dce05-a301-4e1c-b150-5209c633e233\") " pod="openshift-apiserver/apiserver-9ddfb9f55-22m28" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.286555 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4frbb\" (UniqueName: \"kubernetes.io/projected/098dce05-a301-4e1c-b150-5209c633e233-kube-api-access-4frbb\") pod \"apiserver-9ddfb9f55-22m28\" (UID: \"098dce05-a301-4e1c-b150-5209c633e233\") " pod="openshift-apiserver/apiserver-9ddfb9f55-22m28" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.286589 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8j57\" (UniqueName: \"kubernetes.io/projected/7eb05cf0-76db-4ea6-bc76-478fe60fb0f1-kube-api-access-v8j57\") pod \"machine-approver-54c688565-ckfb5\" (UID: \"7eb05cf0-76db-4ea6-bc76-478fe60fb0f1\") " pod="openshift-cluster-machine-approver/machine-approver-54c688565-ckfb5" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.286609 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/098dce05-a301-4e1c-b150-5209c633e233-serving-cert\") pod \"apiserver-9ddfb9f55-22m28\" (UID: \"098dce05-a301-4e1c-b150-5209c633e233\") " pod="openshift-apiserver/apiserver-9ddfb9f55-22m28" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.286677 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"encryption-config\" (UniqueName: \"kubernetes.io/secret/098dce05-a301-4e1c-b150-5209c633e233-encryption-config\") pod \"apiserver-9ddfb9f55-22m28\" (UID: \"098dce05-a301-4e1c-b150-5209c633e233\") " pod="openshift-apiserver/apiserver-9ddfb9f55-22m28" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.286710 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"machine-approver-tls\" (UniqueName: \"kubernetes.io/secret/7eb05cf0-76db-4ea6-bc76-478fe60fb0f1-machine-approver-tls\") pod \"machine-approver-54c688565-ckfb5\" (UID: \"7eb05cf0-76db-4ea6-bc76-478fe60fb0f1\") " pod="openshift-cluster-machine-approver/machine-approver-54c688565-ckfb5" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.286733 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/94a5c5c7-67a9-4631-bdee-296422d882c4-tmp\") pod \"route-controller-manager-776cdc94d6-b9gn7\" (UID: \"94a5c5c7-67a9-4631-bdee-296422d882c4\") " pod="openshift-route-controller-manager/route-controller-manager-776cdc94d6-b9gn7" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.286753 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/098dce05-a301-4e1c-b150-5209c633e233-config\") pod \"apiserver-9ddfb9f55-22m28\" (UID: \"098dce05-a301-4e1c-b150-5209c633e233\") " pod="openshift-apiserver/apiserver-9ddfb9f55-22m28" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.286790 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"images\" (UniqueName: \"kubernetes.io/configmap/c86a3068-6ba1-40ef-9774-6a9efa5e0db6-images\") pod \"machine-api-operator-755bb95488-5t49b\" (UID: \"c86a3068-6ba1-40ef-9774-6a9efa5e0db6\") " pod="openshift-machine-api/machine-api-operator-755bb95488-5t49b" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.286811 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/94a5c5c7-67a9-4631-bdee-296422d882c4-client-ca\") pod \"route-controller-manager-776cdc94d6-b9gn7\" (UID: \"94a5c5c7-67a9-4631-bdee-296422d882c4\") " pod="openshift-route-controller-manager/route-controller-manager-776cdc94d6-b9gn7" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.286830 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etcd-client\" (UniqueName: \"kubernetes.io/secret/098dce05-a301-4e1c-b150-5209c633e233-etcd-client\") pod \"apiserver-9ddfb9f55-22m28\" (UID: \"098dce05-a301-4e1c-b150-5209c633e233\") " pod="openshift-apiserver/apiserver-9ddfb9f55-22m28" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.286936 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etcd-serving-ca\" (UniqueName: \"kubernetes.io/configmap/098dce05-a301-4e1c-b150-5209c633e233-etcd-serving-ca\") pod \"apiserver-9ddfb9f55-22m28\" (UID: \"098dce05-a301-4e1c-b150-5209c633e233\") " pod="openshift-apiserver/apiserver-9ddfb9f55-22m28" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.286964 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7eb05cf0-76db-4ea6-bc76-478fe60fb0f1-config\") pod \"machine-approver-54c688565-ckfb5\" (UID: \"7eb05cf0-76db-4ea6-bc76-478fe60fb0f1\") " pod="openshift-cluster-machine-approver/machine-approver-54c688565-ckfb5" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.286995 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grknn\" (UniqueName: \"kubernetes.io/projected/c86a3068-6ba1-40ef-9774-6a9efa5e0db6-kube-api-access-grknn\") pod \"machine-api-operator-755bb95488-5t49b\" (UID: \"c86a3068-6ba1-40ef-9774-6a9efa5e0db6\") " pod="openshift-machine-api/machine-api-operator-755bb95488-5t49b" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.287023 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/098dce05-a301-4e1c-b150-5209c633e233-trusted-ca-bundle\") pod \"apiserver-9ddfb9f55-22m28\" (UID: \"098dce05-a301-4e1c-b150-5209c633e233\") " pod="openshift-apiserver/apiserver-9ddfb9f55-22m28" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.287049 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/94a5c5c7-67a9-4631-bdee-296422d882c4-serving-cert\") pod \"route-controller-manager-776cdc94d6-b9gn7\" (UID: \"94a5c5c7-67a9-4631-bdee-296422d882c4\") " pod="openshift-route-controller-manager/route-controller-manager-776cdc94d6-b9gn7" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.287079 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"machine-api-operator-tls\" (UniqueName: \"kubernetes.io/secret/c86a3068-6ba1-40ef-9774-6a9efa5e0db6-machine-api-operator-tls\") pod \"machine-api-operator-755bb95488-5t49b\" (UID: \"c86a3068-6ba1-40ef-9774-6a9efa5e0db6\") " pod="openshift-machine-api/machine-api-operator-755bb95488-5t49b" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.287117 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-pullsecrets\" (UniqueName: \"kubernetes.io/host-path/098dce05-a301-4e1c-b150-5209c633e233-node-pullsecrets\") pod \"apiserver-9ddfb9f55-22m28\" (UID: \"098dce05-a301-4e1c-b150-5209c633e233\") " pod="openshift-apiserver/apiserver-9ddfb9f55-22m28" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.287137 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/7eb05cf0-76db-4ea6-bc76-478fe60fb0f1-auth-proxy-config\") pod \"machine-approver-54c688565-ckfb5\" (UID: \"7eb05cf0-76db-4ea6-bc76-478fe60fb0f1\") " pod="openshift-cluster-machine-approver/machine-approver-54c688565-ckfb5" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.287156 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nq9w4\" (UniqueName: \"kubernetes.io/projected/94a5c5c7-67a9-4631-bdee-296422d882c4-kube-api-access-nq9w4\") pod \"route-controller-manager-776cdc94d6-b9gn7\" (UID: \"94a5c5c7-67a9-4631-bdee-296422d882c4\") " pod="openshift-route-controller-manager/route-controller-manager-776cdc94d6-b9gn7" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.287302 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/94a5c5c7-67a9-4631-bdee-296422d882c4-config\") pod \"route-controller-manager-776cdc94d6-b9gn7\" (UID: \"94a5c5c7-67a9-4631-bdee-296422d882c4\") " pod="openshift-route-controller-manager/route-controller-manager-776cdc94d6-b9gn7" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.287360 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/098dce05-a301-4e1c-b150-5209c633e233-audit-dir\") pod \"apiserver-9ddfb9f55-22m28\" (UID: \"098dce05-a301-4e1c-b150-5209c633e233\") " pod="openshift-apiserver/apiserver-9ddfb9f55-22m28" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.287385 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c86a3068-6ba1-40ef-9774-6a9efa5e0db6-config\") pod \"machine-api-operator-755bb95488-5t49b\" (UID: \"c86a3068-6ba1-40ef-9774-6a9efa5e0db6\") " pod="openshift-machine-api/machine-api-operator-755bb95488-5t49b" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.269412 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-etcd-operator\"/\"openshift-service-ca.crt\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.288449 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-oauth-apiserver\"/\"audit-1\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.288499 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-oauth-apiserver\"/\"encryption-config-1\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.289794 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-oauth-apiserver\"/\"etcd-client\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.290800 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-etcd-operator\"/\"etcd-operator-config\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.291501 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-etcd-operator\"/\"etcd-operator-serving-cert\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.296272 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-apiserver-operator\"/\"kube-apiserver-operator-dockercfg-bf7fj\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.297422 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-oauth-apiserver\"/\"serving-cert\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.297828 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-operator\"/\"openshift-service-ca.crt\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.298292 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-operator\"/\"kube-root-ca.crt\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.298979 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/machine-config-operator-67c9d58cbb-wmklh"] Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.299133 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-operator\"/\"metrics-tls\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.299228 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-54f497555d-sz9k8" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.317235 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-operator\"/\"ingress-operator-dockercfg-74nwh\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.321039 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-admission-controller-69db94689b-6bcfh"] Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.321332 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/machine-config-operator-67c9d58cbb-wmklh" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.324563 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-64d44f6ddf-4pm87"] Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.324787 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-admission-controller-69db94689b-6bcfh" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.327260 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-scheduler-operator\"/\"kube-root-ca.crt\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.327378 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.327490 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-scheduler-operator\"/\"kube-scheduler-operator-serving-cert\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.327999 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-scheduler-operator\"/\"openshift-kube-scheduler-operator-config\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.328278 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-machine-config-operator\"/\"machine-config-operator-dockercfg-sw6nc\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.329032 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-operator\"/\"trusted-ca\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.329307 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-scheduler-operator\"/\"openshift-kube-scheduler-operator-dockercfg-2wbn2\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.329951 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-machine-config-operator\"/\"mco-proxy-tls\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.330178 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-machine-config-operator\"/\"machine-config-operator-images\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.330849 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ac-dockercfg-gj7jx\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.331086 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-admission-controller-secret\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.331199 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-apiserver-operator/openshift-apiserver-operator-846cbfc458-rjvhc"] Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.331345 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64d44f6ddf-4pm87" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.334248 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.334620 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-8dkm8\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.336642 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.337059 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.337250 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.337367 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.337399 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.337486 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.337515 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/machine-config-controller-f9cdd68f7-ljkbj"] Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.337787 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-apiserver-operator/openshift-apiserver-operator-846cbfc458-rjvhc" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.339538 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-apiserver-operator\"/\"openshift-apiserver-operator-config\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.340690 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565b79b866-2n6k5"] Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.340948 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/machine-config-controller-f9cdd68f7-ljkbj" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.343076 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-apiserver-operator\"/\"openshift-service-ca.crt\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.343458 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-apiserver-operator\"/\"kube-root-ca.crt\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.344024 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.344331 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-apiserver-operator\"/\"openshift-apiserver-operator-serving-cert\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.344635 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-apiserver-operator\"/\"openshift-apiserver-operator-dockercfg-6c46w\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.344726 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-machine-config-operator\"/\"machine-config-controller-dockercfg-xnj77\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.349154 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565b79b866-2n6k5" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.349163 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-machine-config-operator\"/\"mcc-proxy-tls\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.349284 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6b564684c8-8tt42"] Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.361079 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-controller-manager-operator/kube-controller-manager-operator-69d5f845f8-6nn27"] Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.361358 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6b564684c8-8tt42" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.364300 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-747b44746d-pjv44"] Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.364674 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager-operator/kube-controller-manager-operator-69d5f845f8-6nn27" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.367831 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-68cf44c8b8-rsmpr"] Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.368109 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-747b44746d-pjv44" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.371156 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/cluster-image-registry-operator-86c45576b9-bl65j"] Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.371404 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-68cf44c8b8-rsmpr" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.374945 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-controller-manager-operator/openshift-controller-manager-operator-686468bdd5-vrbxt"] Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.375149 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/cluster-image-registry-operator-86c45576b9-bl65j" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.381742 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-config-operator/openshift-config-operator-5777786469-b8t64"] Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.382483 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-controller-manager-operator/openshift-controller-manager-operator-686468bdd5-vrbxt" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.385248 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-controller-manager/controller-manager-65b6cccf98-pbcg9"] Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.385520 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-config-operator/openshift-config-operator-5777786469-b8t64" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.387856 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit\" (UniqueName: \"kubernetes.io/configmap/098dce05-a301-4e1c-b150-5209c633e233-audit\") pod \"apiserver-9ddfb9f55-22m28\" (UID: \"098dce05-a301-4e1c-b150-5209c633e233\") " pod="openshift-apiserver/apiserver-9ddfb9f55-22m28" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.387888 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-import-ca\" (UniqueName: \"kubernetes.io/configmap/098dce05-a301-4e1c-b150-5209c633e233-image-import-ca\") pod \"apiserver-9ddfb9f55-22m28\" (UID: \"098dce05-a301-4e1c-b150-5209c633e233\") " pod="openshift-apiserver/apiserver-9ddfb9f55-22m28" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.387916 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-866fcbc849-btql4"] Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.388881 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit\" (UniqueName: \"kubernetes.io/configmap/098dce05-a301-4e1c-b150-5209c633e233-audit\") pod \"apiserver-9ddfb9f55-22m28\" (UID: \"098dce05-a301-4e1c-b150-5209c633e233\") " pod="openshift-apiserver/apiserver-9ddfb9f55-22m28" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.389779 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-import-ca\" (UniqueName: \"kubernetes.io/configmap/098dce05-a301-4e1c-b150-5209c633e233-image-import-ca\") pod \"apiserver-9ddfb9f55-22m28\" (UID: \"098dce05-a301-4e1c-b150-5209c633e233\") " pod="openshift-apiserver/apiserver-9ddfb9f55-22m28" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.390342 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.387919 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4frbb\" (UniqueName: \"kubernetes.io/projected/098dce05-a301-4e1c-b150-5209c633e233-kube-api-access-4frbb\") pod \"apiserver-9ddfb9f55-22m28\" (UID: \"098dce05-a301-4e1c-b150-5209c633e233\") " pod="openshift-apiserver/apiserver-9ddfb9f55-22m28" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.390668 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6528b019-774e-4298-abe6-69f062f0a13e-trusted-ca\") pod \"image-registry-66587d64c8-blgcz\" (UID: \"6528b019-774e-4298-abe6-69f062f0a13e\") " pod="openshift-image-registry/image-registry-66587d64c8-blgcz" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.390699 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5e748192-041e-48ef-92ab-ec90d6d23d98-serving-cert\") pod \"authentication-operator-7f5c659b84-p5kbj\" (UID: \"5e748192-041e-48ef-92ab-ec90d6d23d98\") " pod="openshift-authentication-operator/authentication-operator-7f5c659b84-p5kbj" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.390778 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/e8637b4d-e12e-4c41-adc5-649e5bab46ad-audit-dir\") pod \"apiserver-8596bd845d-jb8bk\" (UID: \"e8637b4d-e12e-4c41-adc5-649e5bab46ad\") " pod="openshift-oauth-apiserver/apiserver-8596bd845d-jb8bk" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.390839 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qt7j\" (UniqueName: \"kubernetes.io/projected/e8637b4d-e12e-4c41-adc5-649e5bab46ad-kube-api-access-4qt7j\") pod \"apiserver-8596bd845d-jb8bk\" (UID: \"e8637b4d-e12e-4c41-adc5-649e5bab46ad\") " pod="openshift-oauth-apiserver/apiserver-8596bd845d-jb8bk" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.390881 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v8j57\" (UniqueName: \"kubernetes.io/projected/7eb05cf0-76db-4ea6-bc76-478fe60fb0f1-kube-api-access-v8j57\") pod \"machine-approver-54c688565-ckfb5\" (UID: \"7eb05cf0-76db-4ea6-bc76-478fe60fb0f1\") " pod="openshift-cluster-machine-approver/machine-approver-54c688565-ckfb5" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.390939 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6528b019-774e-4298-abe6-69f062f0a13e-installation-pull-secrets\") pod \"image-registry-66587d64c8-blgcz\" (UID: \"6528b019-774e-4298-abe6-69f062f0a13e\") " pod="openshift-image-registry/image-registry-66587d64c8-blgcz" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.390974 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/098dce05-a301-4e1c-b150-5209c633e233-serving-cert\") pod \"apiserver-9ddfb9f55-22m28\" (UID: \"098dce05-a301-4e1c-b150-5209c633e233\") " pod="openshift-apiserver/apiserver-9ddfb9f55-22m28" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.391027 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"encryption-config\" (UniqueName: \"kubernetes.io/secret/098dce05-a301-4e1c-b150-5209c633e233-encryption-config\") pod \"apiserver-9ddfb9f55-22m28\" (UID: \"098dce05-a301-4e1c-b150-5209c633e233\") " pod="openshift-apiserver/apiserver-9ddfb9f55-22m28" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.391056 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-policies\" (UniqueName: \"kubernetes.io/configmap/e8637b4d-e12e-4c41-adc5-649e5bab46ad-audit-policies\") pod \"apiserver-8596bd845d-jb8bk\" (UID: \"e8637b4d-e12e-4c41-adc5-649e5bab46ad\") " pod="openshift-oauth-apiserver/apiserver-8596bd845d-jb8bk" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.391119 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8637b4d-e12e-4c41-adc5-649e5bab46ad-trusted-ca-bundle\") pod \"apiserver-8596bd845d-jb8bk\" (UID: \"e8637b4d-e12e-4c41-adc5-649e5bab46ad\") " pod="openshift-oauth-apiserver/apiserver-8596bd845d-jb8bk" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.391179 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fde0e777-f937-4372-a51d-3df2383352f0-bound-sa-token\") pod \"ingress-operator-6b9cb4dbcf-pdp25\" (UID: \"fde0e777-f937-4372-a51d-3df2383352f0\") " pod="openshift-ingress-operator/ingress-operator-6b9cb4dbcf-pdp25" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.391219 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/e1875c3d-c889-4161-8c25-c73abc4a8468-kube-api-access\") pod \"kube-apiserver-operator-575994946d-mdbz9\" (UID: \"e1875c3d-c889-4161-8c25-c73abc4a8468\") " pod="openshift-kube-apiserver-operator/kube-apiserver-operator-575994946d-mdbz9" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.391195 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-866fcbc849-btql4" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.391369 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-controller-manager/controller-manager-65b6cccf98-pbcg9" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.391298 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"machine-approver-tls\" (UniqueName: \"kubernetes.io/secret/7eb05cf0-76db-4ea6-bc76-478fe60fb0f1-machine-approver-tls\") pod \"machine-approver-54c688565-ckfb5\" (UID: \"7eb05cf0-76db-4ea6-bc76-478fe60fb0f1\") " pod="openshift-cluster-machine-approver/machine-approver-54c688565-ckfb5" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.391626 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6528b019-774e-4298-abe6-69f062f0a13e-registry-certificates\") pod \"image-registry-66587d64c8-blgcz\" (UID: \"6528b019-774e-4298-abe6-69f062f0a13e\") " pod="openshift-image-registry/image-registry-66587d64c8-blgcz" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.391856 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etcd-service-ca\" (UniqueName: \"kubernetes.io/configmap/e19b119f-2b96-4aba-a3bf-86ba4acd33f5-etcd-service-ca\") pod \"etcd-operator-69b85846b6-s4s6j\" (UID: \"e19b119f-2b96-4aba-a3bf-86ba4acd33f5\") " pod="openshift-etcd-operator/etcd-operator-69b85846b6-s4s6j" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.391079 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/marketplace-operator-547dbd544d-gp852"] Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.392573 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/94a5c5c7-67a9-4631-bdee-296422d882c4-tmp\") pod \"route-controller-manager-776cdc94d6-b9gn7\" (UID: \"94a5c5c7-67a9-4631-bdee-296422d882c4\") " pod="openshift-route-controller-manager/route-controller-manager-776cdc94d6-b9gn7" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.392610 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fde0e777-f937-4372-a51d-3df2383352f0-trusted-ca\") pod \"ingress-operator-6b9cb4dbcf-pdp25\" (UID: \"fde0e777-f937-4372-a51d-3df2383352f0\") " pod="openshift-ingress-operator/ingress-operator-6b9cb4dbcf-pdp25" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.392646 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffvbt\" (UniqueName: \"kubernetes.io/projected/3c8912a1-f2fb-407e-878f-1e6614a30688-kube-api-access-ffvbt\") pod \"console-operator-67c89758df-lx5p5\" (UID: \"3c8912a1-f2fb-407e-878f-1e6614a30688\") " pod="openshift-console-operator/console-operator-67c89758df-lx5p5" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.392706 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/098dce05-a301-4e1c-b150-5209c633e233-config\") pod \"apiserver-9ddfb9f55-22m28\" (UID: \"098dce05-a301-4e1c-b150-5209c633e233\") " pod="openshift-apiserver/apiserver-9ddfb9f55-22m28" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.392732 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dltk8\" (UniqueName: \"kubernetes.io/projected/6528b019-774e-4298-abe6-69f062f0a13e-kube-api-access-dltk8\") pod \"image-registry-66587d64c8-blgcz\" (UID: \"6528b019-774e-4298-abe6-69f062f0a13e\") " pod="openshift-image-registry/image-registry-66587d64c8-blgcz" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.392749 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e19b119f-2b96-4aba-a3bf-86ba4acd33f5-tmp-dir\") pod \"etcd-operator-69b85846b6-s4s6j\" (UID: \"e19b119f-2b96-4aba-a3bf-86ba4acd33f5\") " pod="openshift-etcd-operator/etcd-operator-69b85846b6-s4s6j" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.392798 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e1875c3d-c889-4161-8c25-c73abc4a8468-serving-cert\") pod \"kube-apiserver-operator-575994946d-mdbz9\" (UID: \"e1875c3d-c889-4161-8c25-c73abc4a8468\") " pod="openshift-kube-apiserver-operator/kube-apiserver-operator-575994946d-mdbz9" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.392827 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"images\" (UniqueName: \"kubernetes.io/configmap/c86a3068-6ba1-40ef-9774-6a9efa5e0db6-images\") pod \"machine-api-operator-755bb95488-5t49b\" (UID: \"c86a3068-6ba1-40ef-9774-6a9efa5e0db6\") " pod="openshift-machine-api/machine-api-operator-755bb95488-5t49b" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.392846 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/94a5c5c7-67a9-4631-bdee-296422d882c4-client-ca\") pod \"route-controller-manager-776cdc94d6-b9gn7\" (UID: \"94a5c5c7-67a9-4631-bdee-296422d882c4\") " pod="openshift-route-controller-manager/route-controller-manager-776cdc94d6-b9gn7" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.392910 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etcd-client\" (UniqueName: \"kubernetes.io/secret/098dce05-a301-4e1c-b150-5209c633e233-etcd-client\") pod \"apiserver-9ddfb9f55-22m28\" (UID: \"098dce05-a301-4e1c-b150-5209c633e233\") " pod="openshift-apiserver/apiserver-9ddfb9f55-22m28" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.392931 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etcd-serving-ca\" (UniqueName: \"kubernetes.io/configmap/098dce05-a301-4e1c-b150-5209c633e233-etcd-serving-ca\") pod \"apiserver-9ddfb9f55-22m28\" (UID: \"098dce05-a301-4e1c-b150-5209c633e233\") " pod="openshift-apiserver/apiserver-9ddfb9f55-22m28" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.392952 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7eb05cf0-76db-4ea6-bc76-478fe60fb0f1-config\") pod \"machine-approver-54c688565-ckfb5\" (UID: \"7eb05cf0-76db-4ea6-bc76-478fe60fb0f1\") " pod="openshift-cluster-machine-approver/machine-approver-54c688565-ckfb5" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.392970 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-grknn\" (UniqueName: \"kubernetes.io/projected/c86a3068-6ba1-40ef-9774-6a9efa5e0db6-kube-api-access-grknn\") pod \"machine-api-operator-755bb95488-5t49b\" (UID: \"c86a3068-6ba1-40ef-9774-6a9efa5e0db6\") " pod="openshift-machine-api/machine-api-operator-755bb95488-5t49b" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.392986 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b1044723-f3d1-4042-a1fc-56c73404b448-tmp-dir\") pod \"dns-operator-799b87ffcd-8kwxr\" (UID: \"b1044723-f3d1-4042-a1fc-56c73404b448\") " pod="openshift-dns-operator/dns-operator-799b87ffcd-8kwxr" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.393002 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e1875c3d-c889-4161-8c25-c73abc4a8468-config\") pod \"kube-apiserver-operator-575994946d-mdbz9\" (UID: \"e1875c3d-c889-4161-8c25-c73abc4a8468\") " pod="openshift-kube-apiserver-operator/kube-apiserver-operator-575994946d-mdbz9" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.393023 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/098dce05-a301-4e1c-b150-5209c633e233-trusted-ca-bundle\") pod \"apiserver-9ddfb9f55-22m28\" (UID: \"098dce05-a301-4e1c-b150-5209c633e233\") " pod="openshift-apiserver/apiserver-9ddfb9f55-22m28" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.393039 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3c8912a1-f2fb-407e-878f-1e6614a30688-serving-cert\") pod \"console-operator-67c89758df-lx5p5\" (UID: \"3c8912a1-f2fb-407e-878f-1e6614a30688\") " pod="openshift-console-operator/console-operator-67c89758df-lx5p5" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.393056 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3c8912a1-f2fb-407e-878f-1e6614a30688-trusted-ca\") pod \"console-operator-67c89758df-lx5p5\" (UID: \"3c8912a1-f2fb-407e-878f-1e6614a30688\") " pod="openshift-console-operator/console-operator-67c89758df-lx5p5" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.393085 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/94a5c5c7-67a9-4631-bdee-296422d882c4-serving-cert\") pod \"route-controller-manager-776cdc94d6-b9gn7\" (UID: \"94a5c5c7-67a9-4631-bdee-296422d882c4\") " pod="openshift-route-controller-manager/route-controller-manager-776cdc94d6-b9gn7" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.393105 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"machine-api-operator-tls\" (UniqueName: \"kubernetes.io/secret/c86a3068-6ba1-40ef-9774-6a9efa5e0db6-machine-api-operator-tls\") pod \"machine-api-operator-755bb95488-5t49b\" (UID: \"c86a3068-6ba1-40ef-9774-6a9efa5e0db6\") " pod="openshift-machine-api/machine-api-operator-755bb95488-5t49b" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.393122 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6528b019-774e-4298-abe6-69f062f0a13e-registry-tls\") pod \"image-registry-66587d64c8-blgcz\" (UID: \"6528b019-774e-4298-abe6-69f062f0a13e\") " pod="openshift-image-registry/image-registry-66587d64c8-blgcz" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.393138 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6528b019-774e-4298-abe6-69f062f0a13e-ca-trust-extracted\") pod \"image-registry-66587d64c8-blgcz\" (UID: \"6528b019-774e-4298-abe6-69f062f0a13e\") " pod="openshift-image-registry/image-registry-66587d64c8-blgcz" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.393152 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e19b119f-2b96-4aba-a3bf-86ba4acd33f5-config\") pod \"etcd-operator-69b85846b6-s4s6j\" (UID: \"e19b119f-2b96-4aba-a3bf-86ba4acd33f5\") " pod="openshift-etcd-operator/etcd-operator-69b85846b6-s4s6j" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.393167 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e1875c3d-c889-4161-8c25-c73abc4a8468-tmp-dir\") pod \"kube-apiserver-operator-575994946d-mdbz9\" (UID: \"e1875c3d-c889-4161-8c25-c73abc4a8468\") " pod="openshift-kube-apiserver-operator/kube-apiserver-operator-575994946d-mdbz9" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.393201 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-pullsecrets\" (UniqueName: \"kubernetes.io/host-path/098dce05-a301-4e1c-b150-5209c633e233-node-pullsecrets\") pod \"apiserver-9ddfb9f55-22m28\" (UID: \"098dce05-a301-4e1c-b150-5209c633e233\") " pod="openshift-apiserver/apiserver-9ddfb9f55-22m28" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.393217 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fde0e777-f937-4372-a51d-3df2383352f0-metrics-tls\") pod \"ingress-operator-6b9cb4dbcf-pdp25\" (UID: \"fde0e777-f937-4372-a51d-3df2383352f0\") " pod="openshift-ingress-operator/ingress-operator-6b9cb4dbcf-pdp25" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.393237 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/7eb05cf0-76db-4ea6-bc76-478fe60fb0f1-auth-proxy-config\") pod \"machine-approver-54c688565-ckfb5\" (UID: \"7eb05cf0-76db-4ea6-bc76-478fe60fb0f1\") " pod="openshift-cluster-machine-approver/machine-approver-54c688565-ckfb5" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.393252 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e19b119f-2b96-4aba-a3bf-86ba4acd33f5-serving-cert\") pod \"etcd-operator-69b85846b6-s4s6j\" (UID: \"e19b119f-2b96-4aba-a3bf-86ba4acd33f5\") " pod="openshift-etcd-operator/etcd-operator-69b85846b6-s4s6j" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.393271 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nq9w4\" (UniqueName: \"kubernetes.io/projected/94a5c5c7-67a9-4631-bdee-296422d882c4-kube-api-access-nq9w4\") pod \"route-controller-manager-776cdc94d6-b9gn7\" (UID: \"94a5c5c7-67a9-4631-bdee-296422d882c4\") " pod="openshift-route-controller-manager/route-controller-manager-776cdc94d6-b9gn7" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.393286 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etcd-client\" (UniqueName: \"kubernetes.io/secret/e8637b4d-e12e-4c41-adc5-649e5bab46ad-etcd-client\") pod \"apiserver-8596bd845d-jb8bk\" (UID: \"e8637b4d-e12e-4c41-adc5-649e5bab46ad\") " pod="openshift-oauth-apiserver/apiserver-8596bd845d-jb8bk" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.393308 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etcd-serving-ca\" (UniqueName: \"kubernetes.io/configmap/e8637b4d-e12e-4c41-adc5-649e5bab46ad-etcd-serving-ca\") pod \"apiserver-8596bd845d-jb8bk\" (UID: \"e8637b4d-e12e-4c41-adc5-649e5bab46ad\") " pod="openshift-oauth-apiserver/apiserver-8596bd845d-jb8bk" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.393325 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"encryption-config\" (UniqueName: \"kubernetes.io/secret/e8637b4d-e12e-4c41-adc5-649e5bab46ad-encryption-config\") pod \"apiserver-8596bd845d-jb8bk\" (UID: \"e8637b4d-e12e-4c41-adc5-649e5bab46ad\") " pod="openshift-oauth-apiserver/apiserver-8596bd845d-jb8bk" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.393343 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e748192-041e-48ef-92ab-ec90d6d23d98-service-ca-bundle\") pod \"authentication-operator-7f5c659b84-p5kbj\" (UID: \"5e748192-041e-48ef-92ab-ec90d6d23d98\") " pod="openshift-authentication-operator/authentication-operator-7f5c659b84-p5kbj" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.393357 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etcd-client\" (UniqueName: \"kubernetes.io/secret/e19b119f-2b96-4aba-a3bf-86ba4acd33f5-etcd-client\") pod \"etcd-operator-69b85846b6-s4s6j\" (UID: \"e19b119f-2b96-4aba-a3bf-86ba4acd33f5\") " pod="openshift-etcd-operator/etcd-operator-69b85846b6-s4s6j" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.393382 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e8637b4d-e12e-4c41-adc5-649e5bab46ad-serving-cert\") pod \"apiserver-8596bd845d-jb8bk\" (UID: \"e8637b4d-e12e-4c41-adc5-649e5bab46ad\") " pod="openshift-oauth-apiserver/apiserver-8596bd845d-jb8bk" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.393405 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/94a5c5c7-67a9-4631-bdee-296422d882c4-config\") pod \"route-controller-manager-776cdc94d6-b9gn7\" (UID: \"94a5c5c7-67a9-4631-bdee-296422d882c4\") " pod="openshift-route-controller-manager/route-controller-manager-776cdc94d6-b9gn7" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.393423 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3c8912a1-f2fb-407e-878f-1e6614a30688-config\") pod \"console-operator-67c89758df-lx5p5\" (UID: \"3c8912a1-f2fb-407e-878f-1e6614a30688\") " pod="openshift-console-operator/console-operator-67c89758df-lx5p5" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.393448 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etcd-ca\" (UniqueName: \"kubernetes.io/configmap/e19b119f-2b96-4aba-a3bf-86ba4acd33f5-etcd-ca\") pod \"etcd-operator-69b85846b6-s4s6j\" (UID: \"e19b119f-2b96-4aba-a3bf-86ba4acd33f5\") " pod="openshift-etcd-operator/etcd-operator-69b85846b6-s4s6j" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.393465 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4glg\" (UniqueName: \"kubernetes.io/projected/b1044723-f3d1-4042-a1fc-56c73404b448-kube-api-access-z4glg\") pod \"dns-operator-799b87ffcd-8kwxr\" (UID: \"b1044723-f3d1-4042-a1fc-56c73404b448\") " pod="openshift-dns-operator/dns-operator-799b87ffcd-8kwxr" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.393485 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6528b019-774e-4298-abe6-69f062f0a13e-bound-sa-token\") pod \"image-registry-66587d64c8-blgcz\" (UID: \"6528b019-774e-4298-abe6-69f062f0a13e\") " pod="openshift-image-registry/image-registry-66587d64c8-blgcz" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.393504 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4f7f\" (UniqueName: \"kubernetes.io/projected/fde0e777-f937-4372-a51d-3df2383352f0-kube-api-access-l4f7f\") pod \"ingress-operator-6b9cb4dbcf-pdp25\" (UID: \"fde0e777-f937-4372-a51d-3df2383352f0\") " pod="openshift-ingress-operator/ingress-operator-6b9cb4dbcf-pdp25" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.393520 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ht6hg\" (UniqueName: \"kubernetes.io/projected/5e748192-041e-48ef-92ab-ec90d6d23d98-kube-api-access-ht6hg\") pod \"authentication-operator-7f5c659b84-p5kbj\" (UID: \"5e748192-041e-48ef-92ab-ec90d6d23d98\") " pod="openshift-authentication-operator/authentication-operator-7f5c659b84-p5kbj" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.393544 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-66587d64c8-blgcz\" (UID: \"6528b019-774e-4298-abe6-69f062f0a13e\") " pod="openshift-image-registry/image-registry-66587d64c8-blgcz" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.393561 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5e748192-041e-48ef-92ab-ec90d6d23d98-config\") pod \"authentication-operator-7f5c659b84-p5kbj\" (UID: \"5e748192-041e-48ef-92ab-ec90d6d23d98\") " pod="openshift-authentication-operator/authentication-operator-7f5c659b84-p5kbj" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.393577 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e748192-041e-48ef-92ab-ec90d6d23d98-trusted-ca-bundle\") pod \"authentication-operator-7f5c659b84-p5kbj\" (UID: \"5e748192-041e-48ef-92ab-ec90d6d23d98\") " pod="openshift-authentication-operator/authentication-operator-7f5c659b84-p5kbj" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.393606 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b1044723-f3d1-4042-a1fc-56c73404b448-metrics-tls\") pod \"dns-operator-799b87ffcd-8kwxr\" (UID: \"b1044723-f3d1-4042-a1fc-56c73404b448\") " pod="openshift-dns-operator/dns-operator-799b87ffcd-8kwxr" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.393622 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9c7g\" (UniqueName: \"kubernetes.io/projected/e19b119f-2b96-4aba-a3bf-86ba4acd33f5-kube-api-access-z9c7g\") pod \"etcd-operator-69b85846b6-s4s6j\" (UID: \"e19b119f-2b96-4aba-a3bf-86ba4acd33f5\") " pod="openshift-etcd-operator/etcd-operator-69b85846b6-s4s6j" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.393650 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/098dce05-a301-4e1c-b150-5209c633e233-audit-dir\") pod \"apiserver-9ddfb9f55-22m28\" (UID: \"098dce05-a301-4e1c-b150-5209c633e233\") " pod="openshift-apiserver/apiserver-9ddfb9f55-22m28" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.393674 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c86a3068-6ba1-40ef-9774-6a9efa5e0db6-config\") pod \"machine-api-operator-755bb95488-5t49b\" (UID: \"c86a3068-6ba1-40ef-9774-6a9efa5e0db6\") " pod="openshift-machine-api/machine-api-operator-755bb95488-5t49b" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.394413 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/94a5c5c7-67a9-4631-bdee-296422d882c4-tmp\") pod \"route-controller-manager-776cdc94d6-b9gn7\" (UID: \"94a5c5c7-67a9-4631-bdee-296422d882c4\") " pod="openshift-route-controller-manager/route-controller-manager-776cdc94d6-b9gn7" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.394506 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c86a3068-6ba1-40ef-9774-6a9efa5e0db6-config\") pod \"machine-api-operator-755bb95488-5t49b\" (UID: \"c86a3068-6ba1-40ef-9774-6a9efa5e0db6\") " pod="openshift-machine-api/machine-api-operator-755bb95488-5t49b" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.394964 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/098dce05-a301-4e1c-b150-5209c633e233-config\") pod \"apiserver-9ddfb9f55-22m28\" (UID: \"098dce05-a301-4e1c-b150-5209c633e233\") " pod="openshift-apiserver/apiserver-9ddfb9f55-22m28" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.395384 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"images\" (UniqueName: \"kubernetes.io/configmap/c86a3068-6ba1-40ef-9774-6a9efa5e0db6-images\") pod \"machine-api-operator-755bb95488-5t49b\" (UID: \"c86a3068-6ba1-40ef-9774-6a9efa5e0db6\") " pod="openshift-machine-api/machine-api-operator-755bb95488-5t49b" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.395407 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/7eb05cf0-76db-4ea6-bc76-478fe60fb0f1-auth-proxy-config\") pod \"machine-approver-54c688565-ckfb5\" (UID: \"7eb05cf0-76db-4ea6-bc76-478fe60fb0f1\") " pod="openshift-cluster-machine-approver/machine-approver-54c688565-ckfb5" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.395473 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-pullsecrets\" (UniqueName: \"kubernetes.io/host-path/098dce05-a301-4e1c-b150-5209c633e233-node-pullsecrets\") pod \"apiserver-9ddfb9f55-22m28\" (UID: \"098dce05-a301-4e1c-b150-5209c633e233\") " pod="openshift-apiserver/apiserver-9ddfb9f55-22m28" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.395606 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/098dce05-a301-4e1c-b150-5209c633e233-audit-dir\") pod \"apiserver-9ddfb9f55-22m28\" (UID: \"098dce05-a301-4e1c-b150-5209c633e233\") " pod="openshift-apiserver/apiserver-9ddfb9f55-22m28" Mar 16 15:33:35 crc kubenswrapper[5120]: E0316 15:33:35.395852 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName: nodeName:}" failed. No retries permitted until 2026-03-16 15:33:35.895838384 +0000 UTC m=+118.049770041 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "image-registry-66587d64c8-blgcz" (UID: "6528b019-774e-4298-abe6-69f062f0a13e") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.395863 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etcd-serving-ca\" (UniqueName: \"kubernetes.io/configmap/098dce05-a301-4e1c-b150-5209c633e233-etcd-serving-ca\") pod \"apiserver-9ddfb9f55-22m28\" (UID: \"098dce05-a301-4e1c-b150-5209c633e233\") " pod="openshift-apiserver/apiserver-9ddfb9f55-22m28" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.396397 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7eb05cf0-76db-4ea6-bc76-478fe60fb0f1-config\") pod \"machine-approver-54c688565-ckfb5\" (UID: \"7eb05cf0-76db-4ea6-bc76-478fe60fb0f1\") " pod="openshift-cluster-machine-approver/machine-approver-54c688565-ckfb5" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.396703 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/098dce05-a301-4e1c-b150-5209c633e233-trusted-ca-bundle\") pod \"apiserver-9ddfb9f55-22m28\" (UID: \"098dce05-a301-4e1c-b150-5209c633e233\") " pod="openshift-apiserver/apiserver-9ddfb9f55-22m28" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.399380 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etcd-client\" (UniqueName: \"kubernetes.io/secret/098dce05-a301-4e1c-b150-5209c633e233-etcd-client\") pod \"apiserver-9ddfb9f55-22m28\" (UID: \"098dce05-a301-4e1c-b150-5209c633e233\") " pod="openshift-apiserver/apiserver-9ddfb9f55-22m28" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.399482 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/94a5c5c7-67a9-4631-bdee-296422d882c4-client-ca\") pod \"route-controller-manager-776cdc94d6-b9gn7\" (UID: \"94a5c5c7-67a9-4631-bdee-296422d882c4\") " pod="openshift-route-controller-manager/route-controller-manager-776cdc94d6-b9gn7" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.399618 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"encryption-config\" (UniqueName: \"kubernetes.io/secret/098dce05-a301-4e1c-b150-5209c633e233-encryption-config\") pod \"apiserver-9ddfb9f55-22m28\" (UID: \"098dce05-a301-4e1c-b150-5209c633e233\") " pod="openshift-apiserver/apiserver-9ddfb9f55-22m28" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.400520 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/098dce05-a301-4e1c-b150-5209c633e233-serving-cert\") pod \"apiserver-9ddfb9f55-22m28\" (UID: \"098dce05-a301-4e1c-b150-5209c633e233\") " pod="openshift-apiserver/apiserver-9ddfb9f55-22m28" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.400948 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"machine-api-operator-tls\" (UniqueName: \"kubernetes.io/secret/c86a3068-6ba1-40ef-9774-6a9efa5e0db6-machine-api-operator-tls\") pod \"machine-api-operator-755bb95488-5t49b\" (UID: \"c86a3068-6ba1-40ef-9774-6a9efa5e0db6\") " pod="openshift-machine-api/machine-api-operator-755bb95488-5t49b" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.401272 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/94a5c5c7-67a9-4631-bdee-296422d882c4-config\") pod \"route-controller-manager-776cdc94d6-b9gn7\" (UID: \"94a5c5c7-67a9-4631-bdee-296422d882c4\") " pod="openshift-route-controller-manager/route-controller-manager-776cdc94d6-b9gn7" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.402626 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-operator-lifecycle-manager/catalog-operator-75ff9f647d-x5d5w"] Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.411643 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"machine-approver-tls\" (UniqueName: \"kubernetes.io/secret/7eb05cf0-76db-4ea6-bc76-478fe60fb0f1-machine-approver-tls\") pod \"machine-approver-54c688565-ckfb5\" (UID: \"7eb05cf0-76db-4ea6-bc76-478fe60fb0f1\") " pod="openshift-cluster-machine-approver/machine-approver-54c688565-ckfb5" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.411808 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/marketplace-operator-547dbd544d-gp852" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.413650 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/94a5c5c7-67a9-4631-bdee-296422d882c4-serving-cert\") pod \"route-controller-manager-776cdc94d6-b9gn7\" (UID: \"94a5c5c7-67a9-4631-bdee-296422d882c4\") " pod="openshift-route-controller-manager/route-controller-manager-776cdc94d6-b9gn7" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.414675 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.425165 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-machine-api/control-plane-machine-set-operator-75ffdb6fcd-htqkp"] Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.425827 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/catalog-operator-75ff9f647d-x5d5w" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.427797 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-authentication/oauth-openshift-66458b6674-fvnvr"] Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.428171 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-api/control-plane-machine-set-operator-75ffdb6fcd-htqkp" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.429857 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.430228 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-apiserver/apiserver-9ddfb9f55-22m28"] Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.430249 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-machine-api/machine-api-operator-755bb95488-5t49b"] Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.430261 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-operator-lifecycle-manager/package-server-manager-77f986bd66-wknnz"] Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.431006 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-authentication/oauth-openshift-66458b6674-fvnvr" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.432606 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-operator-lifecycle-manager/packageserver-7d4fc7d867-bzv6d"] Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.432777 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/package-server-manager-77f986bd66-wknnz" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.435169 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-operator-lifecycle-manager/olm-operator-5cdf44d969-chq5d"] Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.435218 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/packageserver-7d4fc7d867-bzv6d" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.437600 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-67c89758df-lx5p5"] Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.437620 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-authentication-operator/authentication-operator-7f5c659b84-p5kbj"] Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.437630 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-operator/ingress-operator-6b9cb4dbcf-pdp25"] Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.437640 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns-operator/dns-operator-799b87ffcd-8kwxr"] Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.437651 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29561250-7npz6"] Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.438242 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/olm-operator-5cdf44d969-chq5d" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.440317 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-54f497555d-sz9k8"] Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.440337 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6b564684c8-8tt42"] Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.440347 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-route-controller-manager/route-controller-manager-776cdc94d6-b9gn7"] Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.440358 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-74545575db-s2zdg"] Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.440398 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29561250-7npz6" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.445319 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5b9c976747-547pw"] Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.445614 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-74545575db-s2zdg" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.448241 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["hostpath-provisioner/csi-hostpathplugin-sqjrv"] Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.448634 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5b9c976747-547pw" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.449628 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-2h6bs\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.451273 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-9x6jk"] Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.451370 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="hostpath-provisioner/csi-hostpathplugin-sqjrv" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.454040 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-controller-manager/controller-manager-65b6cccf98-pbcg9"] Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.454062 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-machine-config-operator/machine-config-operator-67c9d58cbb-wmklh"] Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.454073 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565b79b866-2n6k5"] Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.454081 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-apiserver-operator/kube-apiserver-operator-575994946d-mdbz9"] Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.454090 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-64d44f6ddf-4pm87"] Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.454097 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-controller-manager-operator/kube-controller-manager-operator-69d5f845f8-6nn27"] Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.454104 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-oauth-apiserver/apiserver-8596bd845d-jb8bk"] Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.454112 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/cluster-image-registry-operator-86c45576b9-bl65j"] Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.454119 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-config-operator/openshift-config-operator-5777786469-b8t64"] Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.454127 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operator-lifecycle-manager/package-server-manager-77f986bd66-wknnz"] Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.454137 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-66587d64c8-blgcz"] Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.454148 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-multus/cni-sysctl-allowlist-ds-95s4s"] Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.454232 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9x6jk" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.456312 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-c58l9"] Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.456450 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/cni-sysctl-allowlist-ds-95s4s" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.458887 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-866fcbc849-btql4"] Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.458905 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operator-lifecycle-manager/catalog-operator-75ff9f647d-x5d5w"] Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.458914 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-apiserver-operator/openshift-apiserver-operator-846cbfc458-rjvhc"] Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.458924 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/machine-config-server-cgkjl"] Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.459016 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-c58l9" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.461317 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-747b44746d-pjv44"] Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.461336 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/marketplace-operator-547dbd544d-gp852"] Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.461344 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-machine-config-operator/machine-config-controller-f9cdd68f7-ljkbj"] Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.461353 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operator-lifecycle-manager/olm-operator-5cdf44d969-chq5d"] Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.461361 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/multus-admission-controller-69db94689b-6bcfh"] Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.461369 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-controller-manager-operator/openshift-controller-manager-operator-686468bdd5-vrbxt"] Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.461376 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operator-lifecycle-manager/packageserver-7d4fc7d867-bzv6d"] Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.461384 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-9x6jk"] Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.461409 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["hostpath-provisioner/csi-hostpathplugin-sqjrv"] Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.461416 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-etcd-operator/etcd-operator-69b85846b6-s4s6j"] Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.461423 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5b9c976747-547pw"] Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.461431 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-authentication/oauth-openshift-66458b6674-fvnvr"] Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.461442 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-74545575db-s2zdg"] Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.461458 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/machine-config-server-cgkjl" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.461475 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-c58l9"] Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.461483 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-machine-api/control-plane-machine-set-operator-75ffdb6fcd-htqkp"] Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.461492 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29561250-7npz6"] Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.469040 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.489396 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.494846 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.494949 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etcd-client\" (UniqueName: \"kubernetes.io/secret/e8637b4d-e12e-4c41-adc5-649e5bab46ad-etcd-client\") pod \"apiserver-8596bd845d-jb8bk\" (UID: \"e8637b4d-e12e-4c41-adc5-649e5bab46ad\") " pod="openshift-oauth-apiserver/apiserver-8596bd845d-jb8bk" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.494981 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etcd-serving-ca\" (UniqueName: \"kubernetes.io/configmap/e8637b4d-e12e-4c41-adc5-649e5bab46ad-etcd-serving-ca\") pod \"apiserver-8596bd845d-jb8bk\" (UID: \"e8637b4d-e12e-4c41-adc5-649e5bab46ad\") " pod="openshift-oauth-apiserver/apiserver-8596bd845d-jb8bk" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.495006 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"encryption-config\" (UniqueName: \"kubernetes.io/secret/e8637b4d-e12e-4c41-adc5-649e5bab46ad-encryption-config\") pod \"apiserver-8596bd845d-jb8bk\" (UID: \"e8637b4d-e12e-4c41-adc5-649e5bab46ad\") " pod="openshift-oauth-apiserver/apiserver-8596bd845d-jb8bk" Mar 16 15:33:35 crc kubenswrapper[5120]: E0316 15:33:35.495043 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 15:33:35.99501532 +0000 UTC m=+118.148946977 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.495116 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e748192-041e-48ef-92ab-ec90d6d23d98-service-ca-bundle\") pod \"authentication-operator-7f5c659b84-p5kbj\" (UID: \"5e748192-041e-48ef-92ab-ec90d6d23d98\") " pod="openshift-authentication-operator/authentication-operator-7f5c659b84-p5kbj" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.495150 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etcd-client\" (UniqueName: \"kubernetes.io/secret/e19b119f-2b96-4aba-a3bf-86ba4acd33f5-etcd-client\") pod \"etcd-operator-69b85846b6-s4s6j\" (UID: \"e19b119f-2b96-4aba-a3bf-86ba4acd33f5\") " pod="openshift-etcd-operator/etcd-operator-69b85846b6-s4s6j" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.495188 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e8637b4d-e12e-4c41-adc5-649e5bab46ad-serving-cert\") pod \"apiserver-8596bd845d-jb8bk\" (UID: \"e8637b4d-e12e-4c41-adc5-649e5bab46ad\") " pod="openshift-oauth-apiserver/apiserver-8596bd845d-jb8bk" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.495217 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3c8912a1-f2fb-407e-878f-1e6614a30688-config\") pod \"console-operator-67c89758df-lx5p5\" (UID: \"3c8912a1-f2fb-407e-878f-1e6614a30688\") " pod="openshift-console-operator/console-operator-67c89758df-lx5p5" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.495248 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etcd-ca\" (UniqueName: \"kubernetes.io/configmap/e19b119f-2b96-4aba-a3bf-86ba4acd33f5-etcd-ca\") pod \"etcd-operator-69b85846b6-s4s6j\" (UID: \"e19b119f-2b96-4aba-a3bf-86ba4acd33f5\") " pod="openshift-etcd-operator/etcd-operator-69b85846b6-s4s6j" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.495274 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z4glg\" (UniqueName: \"kubernetes.io/projected/b1044723-f3d1-4042-a1fc-56c73404b448-kube-api-access-z4glg\") pod \"dns-operator-799b87ffcd-8kwxr\" (UID: \"b1044723-f3d1-4042-a1fc-56c73404b448\") " pod="openshift-dns-operator/dns-operator-799b87ffcd-8kwxr" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.495301 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6528b019-774e-4298-abe6-69f062f0a13e-bound-sa-token\") pod \"image-registry-66587d64c8-blgcz\" (UID: \"6528b019-774e-4298-abe6-69f062f0a13e\") " pod="openshift-image-registry/image-registry-66587d64c8-blgcz" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.495516 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l4f7f\" (UniqueName: \"kubernetes.io/projected/fde0e777-f937-4372-a51d-3df2383352f0-kube-api-access-l4f7f\") pod \"ingress-operator-6b9cb4dbcf-pdp25\" (UID: \"fde0e777-f937-4372-a51d-3df2383352f0\") " pod="openshift-ingress-operator/ingress-operator-6b9cb4dbcf-pdp25" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.495567 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ht6hg\" (UniqueName: \"kubernetes.io/projected/5e748192-041e-48ef-92ab-ec90d6d23d98-kube-api-access-ht6hg\") pod \"authentication-operator-7f5c659b84-p5kbj\" (UID: \"5e748192-041e-48ef-92ab-ec90d6d23d98\") " pod="openshift-authentication-operator/authentication-operator-7f5c659b84-p5kbj" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.495600 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-66587d64c8-blgcz\" (UID: \"6528b019-774e-4298-abe6-69f062f0a13e\") " pod="openshift-image-registry/image-registry-66587d64c8-blgcz" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.495625 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5e748192-041e-48ef-92ab-ec90d6d23d98-config\") pod \"authentication-operator-7f5c659b84-p5kbj\" (UID: \"5e748192-041e-48ef-92ab-ec90d6d23d98\") " pod="openshift-authentication-operator/authentication-operator-7f5c659b84-p5kbj" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.495649 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e748192-041e-48ef-92ab-ec90d6d23d98-trusted-ca-bundle\") pod \"authentication-operator-7f5c659b84-p5kbj\" (UID: \"5e748192-041e-48ef-92ab-ec90d6d23d98\") " pod="openshift-authentication-operator/authentication-operator-7f5c659b84-p5kbj" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.495689 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b1044723-f3d1-4042-a1fc-56c73404b448-metrics-tls\") pod \"dns-operator-799b87ffcd-8kwxr\" (UID: \"b1044723-f3d1-4042-a1fc-56c73404b448\") " pod="openshift-dns-operator/dns-operator-799b87ffcd-8kwxr" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.495714 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z9c7g\" (UniqueName: \"kubernetes.io/projected/e19b119f-2b96-4aba-a3bf-86ba4acd33f5-kube-api-access-z9c7g\") pod \"etcd-operator-69b85846b6-s4s6j\" (UID: \"e19b119f-2b96-4aba-a3bf-86ba4acd33f5\") " pod="openshift-etcd-operator/etcd-operator-69b85846b6-s4s6j" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.495804 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6528b019-774e-4298-abe6-69f062f0a13e-trusted-ca\") pod \"image-registry-66587d64c8-blgcz\" (UID: \"6528b019-774e-4298-abe6-69f062f0a13e\") " pod="openshift-image-registry/image-registry-66587d64c8-blgcz" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.495832 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5e748192-041e-48ef-92ab-ec90d6d23d98-serving-cert\") pod \"authentication-operator-7f5c659b84-p5kbj\" (UID: \"5e748192-041e-48ef-92ab-ec90d6d23d98\") " pod="openshift-authentication-operator/authentication-operator-7f5c659b84-p5kbj" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.495872 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/e8637b4d-e12e-4c41-adc5-649e5bab46ad-audit-dir\") pod \"apiserver-8596bd845d-jb8bk\" (UID: \"e8637b4d-e12e-4c41-adc5-649e5bab46ad\") " pod="openshift-oauth-apiserver/apiserver-8596bd845d-jb8bk" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.495899 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4qt7j\" (UniqueName: \"kubernetes.io/projected/e8637b4d-e12e-4c41-adc5-649e5bab46ad-kube-api-access-4qt7j\") pod \"apiserver-8596bd845d-jb8bk\" (UID: \"e8637b4d-e12e-4c41-adc5-649e5bab46ad\") " pod="openshift-oauth-apiserver/apiserver-8596bd845d-jb8bk" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.495914 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e748192-041e-48ef-92ab-ec90d6d23d98-service-ca-bundle\") pod \"authentication-operator-7f5c659b84-p5kbj\" (UID: \"5e748192-041e-48ef-92ab-ec90d6d23d98\") " pod="openshift-authentication-operator/authentication-operator-7f5c659b84-p5kbj" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.495930 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6528b019-774e-4298-abe6-69f062f0a13e-installation-pull-secrets\") pod \"image-registry-66587d64c8-blgcz\" (UID: \"6528b019-774e-4298-abe6-69f062f0a13e\") " pod="openshift-image-registry/image-registry-66587d64c8-blgcz" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.495958 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-policies\" (UniqueName: \"kubernetes.io/configmap/e8637b4d-e12e-4c41-adc5-649e5bab46ad-audit-policies\") pod \"apiserver-8596bd845d-jb8bk\" (UID: \"e8637b4d-e12e-4c41-adc5-649e5bab46ad\") " pod="openshift-oauth-apiserver/apiserver-8596bd845d-jb8bk" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.495983 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8637b4d-e12e-4c41-adc5-649e5bab46ad-trusted-ca-bundle\") pod \"apiserver-8596bd845d-jb8bk\" (UID: \"e8637b4d-e12e-4c41-adc5-649e5bab46ad\") " pod="openshift-oauth-apiserver/apiserver-8596bd845d-jb8bk" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.496012 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fde0e777-f937-4372-a51d-3df2383352f0-bound-sa-token\") pod \"ingress-operator-6b9cb4dbcf-pdp25\" (UID: \"fde0e777-f937-4372-a51d-3df2383352f0\") " pod="openshift-ingress-operator/ingress-operator-6b9cb4dbcf-pdp25" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.496036 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/e1875c3d-c889-4161-8c25-c73abc4a8468-kube-api-access\") pod \"kube-apiserver-operator-575994946d-mdbz9\" (UID: \"e1875c3d-c889-4161-8c25-c73abc4a8468\") " pod="openshift-kube-apiserver-operator/kube-apiserver-operator-575994946d-mdbz9" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.496066 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/e8637b4d-e12e-4c41-adc5-649e5bab46ad-audit-dir\") pod \"apiserver-8596bd845d-jb8bk\" (UID: \"e8637b4d-e12e-4c41-adc5-649e5bab46ad\") " pod="openshift-oauth-apiserver/apiserver-8596bd845d-jb8bk" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.496075 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6528b019-774e-4298-abe6-69f062f0a13e-registry-certificates\") pod \"image-registry-66587d64c8-blgcz\" (UID: \"6528b019-774e-4298-abe6-69f062f0a13e\") " pod="openshift-image-registry/image-registry-66587d64c8-blgcz" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.496130 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etcd-ca\" (UniqueName: \"kubernetes.io/configmap/e19b119f-2b96-4aba-a3bf-86ba4acd33f5-etcd-ca\") pod \"etcd-operator-69b85846b6-s4s6j\" (UID: \"e19b119f-2b96-4aba-a3bf-86ba4acd33f5\") " pod="openshift-etcd-operator/etcd-operator-69b85846b6-s4s6j" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.496137 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etcd-service-ca\" (UniqueName: \"kubernetes.io/configmap/e19b119f-2b96-4aba-a3bf-86ba4acd33f5-etcd-service-ca\") pod \"etcd-operator-69b85846b6-s4s6j\" (UID: \"e19b119f-2b96-4aba-a3bf-86ba4acd33f5\") " pod="openshift-etcd-operator/etcd-operator-69b85846b6-s4s6j" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.496189 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fde0e777-f937-4372-a51d-3df2383352f0-trusted-ca\") pod \"ingress-operator-6b9cb4dbcf-pdp25\" (UID: \"fde0e777-f937-4372-a51d-3df2383352f0\") " pod="openshift-ingress-operator/ingress-operator-6b9cb4dbcf-pdp25" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.496221 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ffvbt\" (UniqueName: \"kubernetes.io/projected/3c8912a1-f2fb-407e-878f-1e6614a30688-kube-api-access-ffvbt\") pod \"console-operator-67c89758df-lx5p5\" (UID: \"3c8912a1-f2fb-407e-878f-1e6614a30688\") " pod="openshift-console-operator/console-operator-67c89758df-lx5p5" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.496248 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dltk8\" (UniqueName: \"kubernetes.io/projected/6528b019-774e-4298-abe6-69f062f0a13e-kube-api-access-dltk8\") pod \"image-registry-66587d64c8-blgcz\" (UID: \"6528b019-774e-4298-abe6-69f062f0a13e\") " pod="openshift-image-registry/image-registry-66587d64c8-blgcz" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.496277 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e19b119f-2b96-4aba-a3bf-86ba4acd33f5-tmp-dir\") pod \"etcd-operator-69b85846b6-s4s6j\" (UID: \"e19b119f-2b96-4aba-a3bf-86ba4acd33f5\") " pod="openshift-etcd-operator/etcd-operator-69b85846b6-s4s6j" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.496309 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e1875c3d-c889-4161-8c25-c73abc4a8468-serving-cert\") pod \"kube-apiserver-operator-575994946d-mdbz9\" (UID: \"e1875c3d-c889-4161-8c25-c73abc4a8468\") " pod="openshift-kube-apiserver-operator/kube-apiserver-operator-575994946d-mdbz9" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.496347 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b1044723-f3d1-4042-a1fc-56c73404b448-tmp-dir\") pod \"dns-operator-799b87ffcd-8kwxr\" (UID: \"b1044723-f3d1-4042-a1fc-56c73404b448\") " pod="openshift-dns-operator/dns-operator-799b87ffcd-8kwxr" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.496381 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e1875c3d-c889-4161-8c25-c73abc4a8468-config\") pod \"kube-apiserver-operator-575994946d-mdbz9\" (UID: \"e1875c3d-c889-4161-8c25-c73abc4a8468\") " pod="openshift-kube-apiserver-operator/kube-apiserver-operator-575994946d-mdbz9" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.496411 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3c8912a1-f2fb-407e-878f-1e6614a30688-serving-cert\") pod \"console-operator-67c89758df-lx5p5\" (UID: \"3c8912a1-f2fb-407e-878f-1e6614a30688\") " pod="openshift-console-operator/console-operator-67c89758df-lx5p5" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.496418 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3c8912a1-f2fb-407e-878f-1e6614a30688-config\") pod \"console-operator-67c89758df-lx5p5\" (UID: \"3c8912a1-f2fb-407e-878f-1e6614a30688\") " pod="openshift-console-operator/console-operator-67c89758df-lx5p5" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.496432 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3c8912a1-f2fb-407e-878f-1e6614a30688-trusted-ca\") pod \"console-operator-67c89758df-lx5p5\" (UID: \"3c8912a1-f2fb-407e-878f-1e6614a30688\") " pod="openshift-console-operator/console-operator-67c89758df-lx5p5" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.496495 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6528b019-774e-4298-abe6-69f062f0a13e-registry-tls\") pod \"image-registry-66587d64c8-blgcz\" (UID: \"6528b019-774e-4298-abe6-69f062f0a13e\") " pod="openshift-image-registry/image-registry-66587d64c8-blgcz" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.496520 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6528b019-774e-4298-abe6-69f062f0a13e-ca-trust-extracted\") pod \"image-registry-66587d64c8-blgcz\" (UID: \"6528b019-774e-4298-abe6-69f062f0a13e\") " pod="openshift-image-registry/image-registry-66587d64c8-blgcz" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.496539 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e19b119f-2b96-4aba-a3bf-86ba4acd33f5-config\") pod \"etcd-operator-69b85846b6-s4s6j\" (UID: \"e19b119f-2b96-4aba-a3bf-86ba4acd33f5\") " pod="openshift-etcd-operator/etcd-operator-69b85846b6-s4s6j" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.496557 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e1875c3d-c889-4161-8c25-c73abc4a8468-tmp-dir\") pod \"kube-apiserver-operator-575994946d-mdbz9\" (UID: \"e1875c3d-c889-4161-8c25-c73abc4a8468\") " pod="openshift-kube-apiserver-operator/kube-apiserver-operator-575994946d-mdbz9" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.496595 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fde0e777-f937-4372-a51d-3df2383352f0-metrics-tls\") pod \"ingress-operator-6b9cb4dbcf-pdp25\" (UID: \"fde0e777-f937-4372-a51d-3df2383352f0\") " pod="openshift-ingress-operator/ingress-operator-6b9cb4dbcf-pdp25" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.496614 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e19b119f-2b96-4aba-a3bf-86ba4acd33f5-serving-cert\") pod \"etcd-operator-69b85846b6-s4s6j\" (UID: \"e19b119f-2b96-4aba-a3bf-86ba4acd33f5\") " pod="openshift-etcd-operator/etcd-operator-69b85846b6-s4s6j" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.497363 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e19b119f-2b96-4aba-a3bf-86ba4acd33f5-config\") pod \"etcd-operator-69b85846b6-s4s6j\" (UID: \"e19b119f-2b96-4aba-a3bf-86ba4acd33f5\") " pod="openshift-etcd-operator/etcd-operator-69b85846b6-s4s6j" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.497538 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3c8912a1-f2fb-407e-878f-1e6614a30688-trusted-ca\") pod \"console-operator-67c89758df-lx5p5\" (UID: \"3c8912a1-f2fb-407e-878f-1e6614a30688\") " pod="openshift-console-operator/console-operator-67c89758df-lx5p5" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.498996 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e1875c3d-c889-4161-8c25-c73abc4a8468-config\") pod \"kube-apiserver-operator-575994946d-mdbz9\" (UID: \"e1875c3d-c889-4161-8c25-c73abc4a8468\") " pod="openshift-kube-apiserver-operator/kube-apiserver-operator-575994946d-mdbz9" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.499138 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etcd-client\" (UniqueName: \"kubernetes.io/secret/e8637b4d-e12e-4c41-adc5-649e5bab46ad-etcd-client\") pod \"apiserver-8596bd845d-jb8bk\" (UID: \"e8637b4d-e12e-4c41-adc5-649e5bab46ad\") " pod="openshift-oauth-apiserver/apiserver-8596bd845d-jb8bk" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.499205 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e8637b4d-e12e-4c41-adc5-649e5bab46ad-serving-cert\") pod \"apiserver-8596bd845d-jb8bk\" (UID: \"e8637b4d-e12e-4c41-adc5-649e5bab46ad\") " pod="openshift-oauth-apiserver/apiserver-8596bd845d-jb8bk" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.499204 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6528b019-774e-4298-abe6-69f062f0a13e-registry-certificates\") pod \"image-registry-66587d64c8-blgcz\" (UID: \"6528b019-774e-4298-abe6-69f062f0a13e\") " pod="openshift-image-registry/image-registry-66587d64c8-blgcz" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.499253 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6528b019-774e-4298-abe6-69f062f0a13e-trusted-ca\") pod \"image-registry-66587d64c8-blgcz\" (UID: \"6528b019-774e-4298-abe6-69f062f0a13e\") " pod="openshift-image-registry/image-registry-66587d64c8-blgcz" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.499351 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"encryption-config\" (UniqueName: \"kubernetes.io/secret/e8637b4d-e12e-4c41-adc5-649e5bab46ad-encryption-config\") pod \"apiserver-8596bd845d-jb8bk\" (UID: \"e8637b4d-e12e-4c41-adc5-649e5bab46ad\") " pod="openshift-oauth-apiserver/apiserver-8596bd845d-jb8bk" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.500090 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e748192-041e-48ef-92ab-ec90d6d23d98-trusted-ca-bundle\") pod \"authentication-operator-7f5c659b84-p5kbj\" (UID: \"5e748192-041e-48ef-92ab-ec90d6d23d98\") " pod="openshift-authentication-operator/authentication-operator-7f5c659b84-p5kbj" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.500167 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etcd-client\" (UniqueName: \"kubernetes.io/secret/e19b119f-2b96-4aba-a3bf-86ba4acd33f5-etcd-client\") pod \"etcd-operator-69b85846b6-s4s6j\" (UID: \"e19b119f-2b96-4aba-a3bf-86ba4acd33f5\") " pod="openshift-etcd-operator/etcd-operator-69b85846b6-s4s6j" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.500320 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5e748192-041e-48ef-92ab-ec90d6d23d98-config\") pod \"authentication-operator-7f5c659b84-p5kbj\" (UID: \"5e748192-041e-48ef-92ab-ec90d6d23d98\") " pod="openshift-authentication-operator/authentication-operator-7f5c659b84-p5kbj" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.500446 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b1044723-f3d1-4042-a1fc-56c73404b448-metrics-tls\") pod \"dns-operator-799b87ffcd-8kwxr\" (UID: \"b1044723-f3d1-4042-a1fc-56c73404b448\") " pod="openshift-dns-operator/dns-operator-799b87ffcd-8kwxr" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.496012 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etcd-serving-ca\" (UniqueName: \"kubernetes.io/configmap/e8637b4d-e12e-4c41-adc5-649e5bab46ad-etcd-serving-ca\") pod \"apiserver-8596bd845d-jb8bk\" (UID: \"e8637b4d-e12e-4c41-adc5-649e5bab46ad\") " pod="openshift-oauth-apiserver/apiserver-8596bd845d-jb8bk" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.500653 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-policies\" (UniqueName: \"kubernetes.io/configmap/e8637b4d-e12e-4c41-adc5-649e5bab46ad-audit-policies\") pod \"apiserver-8596bd845d-jb8bk\" (UID: \"e8637b4d-e12e-4c41-adc5-649e5bab46ad\") " pod="openshift-oauth-apiserver/apiserver-8596bd845d-jb8bk" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.500715 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fde0e777-f937-4372-a51d-3df2383352f0-trusted-ca\") pod \"ingress-operator-6b9cb4dbcf-pdp25\" (UID: \"fde0e777-f937-4372-a51d-3df2383352f0\") " pod="openshift-ingress-operator/ingress-operator-6b9cb4dbcf-pdp25" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.500744 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8637b4d-e12e-4c41-adc5-649e5bab46ad-trusted-ca-bundle\") pod \"apiserver-8596bd845d-jb8bk\" (UID: \"e8637b4d-e12e-4c41-adc5-649e5bab46ad\") " pod="openshift-oauth-apiserver/apiserver-8596bd845d-jb8bk" Mar 16 15:33:35 crc kubenswrapper[5120]: E0316 15:33:35.500998 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName: nodeName:}" failed. No retries permitted until 2026-03-16 15:33:36.000983972 +0000 UTC m=+118.154915619 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "image-registry-66587d64c8-blgcz" (UID: "6528b019-774e-4298-abe6-69f062f0a13e") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.501169 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b1044723-f3d1-4042-a1fc-56c73404b448-tmp-dir\") pod \"dns-operator-799b87ffcd-8kwxr\" (UID: \"b1044723-f3d1-4042-a1fc-56c73404b448\") " pod="openshift-dns-operator/dns-operator-799b87ffcd-8kwxr" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.501471 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6528b019-774e-4298-abe6-69f062f0a13e-registry-tls\") pod \"image-registry-66587d64c8-blgcz\" (UID: \"6528b019-774e-4298-abe6-69f062f0a13e\") " pod="openshift-image-registry/image-registry-66587d64c8-blgcz" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.501474 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e19b119f-2b96-4aba-a3bf-86ba4acd33f5-tmp-dir\") pod \"etcd-operator-69b85846b6-s4s6j\" (UID: \"e19b119f-2b96-4aba-a3bf-86ba4acd33f5\") " pod="openshift-etcd-operator/etcd-operator-69b85846b6-s4s6j" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.501628 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6528b019-774e-4298-abe6-69f062f0a13e-ca-trust-extracted\") pod \"image-registry-66587d64c8-blgcz\" (UID: \"6528b019-774e-4298-abe6-69f062f0a13e\") " pod="openshift-image-registry/image-registry-66587d64c8-blgcz" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.501799 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e1875c3d-c889-4161-8c25-c73abc4a8468-serving-cert\") pod \"kube-apiserver-operator-575994946d-mdbz9\" (UID: \"e1875c3d-c889-4161-8c25-c73abc4a8468\") " pod="openshift-kube-apiserver-operator/kube-apiserver-operator-575994946d-mdbz9" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.502220 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e1875c3d-c889-4161-8c25-c73abc4a8468-tmp-dir\") pod \"kube-apiserver-operator-575994946d-mdbz9\" (UID: \"e1875c3d-c889-4161-8c25-c73abc4a8468\") " pod="openshift-kube-apiserver-operator/kube-apiserver-operator-575994946d-mdbz9" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.502254 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etcd-service-ca\" (UniqueName: \"kubernetes.io/configmap/e19b119f-2b96-4aba-a3bf-86ba4acd33f5-etcd-service-ca\") pod \"etcd-operator-69b85846b6-s4s6j\" (UID: \"e19b119f-2b96-4aba-a3bf-86ba4acd33f5\") " pod="openshift-etcd-operator/etcd-operator-69b85846b6-s4s6j" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.503824 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6528b019-774e-4298-abe6-69f062f0a13e-installation-pull-secrets\") pod \"image-registry-66587d64c8-blgcz\" (UID: \"6528b019-774e-4298-abe6-69f062f0a13e\") " pod="openshift-image-registry/image-registry-66587d64c8-blgcz" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.504380 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fde0e777-f937-4372-a51d-3df2383352f0-metrics-tls\") pod \"ingress-operator-6b9cb4dbcf-pdp25\" (UID: \"fde0e777-f937-4372-a51d-3df2383352f0\") " pod="openshift-ingress-operator/ingress-operator-6b9cb4dbcf-pdp25" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.505433 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5e748192-041e-48ef-92ab-ec90d6d23d98-serving-cert\") pod \"authentication-operator-7f5c659b84-p5kbj\" (UID: \"5e748192-041e-48ef-92ab-ec90d6d23d98\") " pod="openshift-authentication-operator/authentication-operator-7f5c659b84-p5kbj" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.505857 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3c8912a1-f2fb-407e-878f-1e6614a30688-serving-cert\") pod \"console-operator-67c89758df-lx5p5\" (UID: \"3c8912a1-f2fb-407e-878f-1e6614a30688\") " pod="openshift-console-operator/console-operator-67c89758df-lx5p5" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.509415 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-jmhxf\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.510881 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e19b119f-2b96-4aba-a3bf-86ba4acd33f5-serving-cert\") pod \"etcd-operator-69b85846b6-s4s6j\" (UID: \"e19b119f-2b96-4aba-a3bf-86ba4acd33f5\") " pod="openshift-etcd-operator/etcd-operator-69b85846b6-s4s6j" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.529250 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.549443 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.569171 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-controller-manager-operator\"/\"kube-controller-manager-operator-serving-cert\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.589400 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-controller-manager-operator\"/\"kube-controller-manager-operator-dockercfg-tnfx9\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.598092 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 15:33:35 crc kubenswrapper[5120]: E0316 15:33:35.598524 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 15:33:36.098490152 +0000 UTC m=+118.252421819 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.599002 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-66587d64c8-blgcz\" (UID: \"6528b019-774e-4298-abe6-69f062f0a13e\") " pod="openshift-image-registry/image-registry-66587d64c8-blgcz" Mar 16 15:33:35 crc kubenswrapper[5120]: E0316 15:33:35.599439 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName: nodeName:}" failed. No retries permitted until 2026-03-16 15:33:36.099432057 +0000 UTC m=+118.253363714 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "image-registry-66587d64c8-blgcz" (UID: "6528b019-774e-4298-abe6-69f062f0a13e") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.609670 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-controller-manager-operator\"/\"kube-controller-manager-operator-config\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.629373 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-controller-manager-operator\"/\"kube-root-ca.crt\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.649298 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-mdwwj\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.689225 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-kw8fx\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.699572 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 15:33:35 crc kubenswrapper[5120]: E0316 15:33:35.699742 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 15:33:36.199716144 +0000 UTC m=+118.353647811 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.700227 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-66587d64c8-blgcz\" (UID: \"6528b019-774e-4298-abe6-69f062f0a13e\") " pod="openshift-image-registry/image-registry-66587d64c8-blgcz" Mar 16 15:33:35 crc kubenswrapper[5120]: E0316 15:33:35.700597 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName: nodeName:}" failed. No retries permitted until 2026-03-16 15:33:36.200582897 +0000 UTC m=+118.354514554 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "image-registry-66587d64c8-blgcz" (UID: "6528b019-774e-4298-abe6-69f062f0a13e") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.708466 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.730290 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.749427 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-certs-default\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.769416 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.789195 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.801666 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 15:33:35 crc kubenswrapper[5120]: E0316 15:33:35.801873 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 15:33:36.301833839 +0000 UTC m=+118.455765526 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.802085 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-66587d64c8-blgcz\" (UID: \"6528b019-774e-4298-abe6-69f062f0a13e\") " pod="openshift-image-registry/image-registry-66587d64c8-blgcz" Mar 16 15:33:35 crc kubenswrapper[5120]: E0316 15:33:35.802510 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName: nodeName:}" failed. No retries permitted until 2026-03-16 15:33:36.302494497 +0000 UTC m=+118.456426194 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "image-registry-66587d64c8-blgcz" (UID: "6528b019-774e-4298-abe6-69f062f0a13e") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.809604 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.829088 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"cluster-image-registry-operator-dockercfg-ntnd7\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.849696 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-operator-tls\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.869799 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-controller-manager-operator\"/\"openshift-service-ca.crt\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.889061 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-controller-manager-operator\"/\"openshift-controller-manager-operator-serving-cert\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.903213 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 15:33:35 crc kubenswrapper[5120]: E0316 15:33:35.903455 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 15:33:36.40341837 +0000 UTC m=+118.557350057 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.903810 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-66587d64c8-blgcz\" (UID: \"6528b019-774e-4298-abe6-69f062f0a13e\") " pod="openshift-image-registry/image-registry-66587d64c8-blgcz" Mar 16 15:33:35 crc kubenswrapper[5120]: E0316 15:33:35.904101 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName: nodeName:}" failed. No retries permitted until 2026-03-16 15:33:36.404087919 +0000 UTC m=+118.558019576 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "image-registry-66587d64c8-blgcz" (UID: "6528b019-774e-4298-abe6-69f062f0a13e") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.909555 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-controller-manager-operator\"/\"openshift-controller-manager-operator-config\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.929488 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-controller-manager-operator\"/\"kube-root-ca.crt\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.950145 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-controller-manager-operator\"/\"openshift-controller-manager-operator-dockercfg-jcmfj\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.969965 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-config-operator\"/\"kube-root-ca.crt\"" Mar 16 15:33:35 crc kubenswrapper[5120]: I0316 15:33:35.989604 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-config-operator\"/\"openshift-config-operator-dockercfg-sjn6s\"" Mar 16 15:33:36 crc kubenswrapper[5120]: I0316 15:33:36.005125 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 15:33:36 crc kubenswrapper[5120]: E0316 15:33:36.005519 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 15:33:36.505475534 +0000 UTC m=+118.659407231 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:36 crc kubenswrapper[5120]: I0316 15:33:36.010818 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-config-operator\"/\"config-operator-serving-cert\"" Mar 16 15:33:36 crc kubenswrapper[5120]: I0316 15:33:36.030189 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-config-operator\"/\"openshift-service-ca.crt\"" Mar 16 15:33:36 crc kubenswrapper[5120]: I0316 15:33:36.076202 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4frbb\" (UniqueName: \"kubernetes.io/projected/098dce05-a301-4e1c-b150-5209c633e233-kube-api-access-4frbb\") pod \"apiserver-9ddfb9f55-22m28\" (UID: \"098dce05-a301-4e1c-b150-5209c633e233\") " pod="openshift-apiserver/apiserver-9ddfb9f55-22m28" Mar 16 15:33:36 crc kubenswrapper[5120]: I0316 15:33:36.090129 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Mar 16 15:33:36 crc kubenswrapper[5120]: I0316 15:33:36.090176 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8j57\" (UniqueName: \"kubernetes.io/projected/7eb05cf0-76db-4ea6-bc76-478fe60fb0f1-kube-api-access-v8j57\") pod \"machine-approver-54c688565-ckfb5\" (UID: \"7eb05cf0-76db-4ea6-bc76-478fe60fb0f1\") " pod="openshift-cluster-machine-approver/machine-approver-54c688565-ckfb5" Mar 16 15:33:36 crc kubenswrapper[5120]: I0316 15:33:36.105989 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-66587d64c8-blgcz\" (UID: \"6528b019-774e-4298-abe6-69f062f0a13e\") " pod="openshift-image-registry/image-registry-66587d64c8-blgcz" Mar 16 15:33:36 crc kubenswrapper[5120]: E0316 15:33:36.106335 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName: nodeName:}" failed. No retries permitted until 2026-03-16 15:33:36.606317495 +0000 UTC m=+118.760249152 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "image-registry-66587d64c8-blgcz" (UID: "6528b019-774e-4298-abe6-69f062f0a13e") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:36 crc kubenswrapper[5120]: I0316 15:33:36.109588 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-controller-manager\"/\"config\"" Mar 16 15:33:36 crc kubenswrapper[5120]: I0316 15:33:36.118819 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-apiserver/apiserver-9ddfb9f55-22m28" Mar 16 15:33:36 crc kubenswrapper[5120]: I0316 15:33:36.130315 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-controller-manager\"/\"openshift-controller-manager-sa-dockercfg-djmfg\"" Mar 16 15:33:36 crc kubenswrapper[5120]: I0316 15:33:36.134817 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-machine-approver/machine-approver-54c688565-ckfb5" Mar 16 15:33:36 crc kubenswrapper[5120]: I0316 15:33:36.150232 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-controller-manager\"/\"serving-cert\"" Mar 16 15:33:36 crc kubenswrapper[5120]: W0316 15:33:36.154031 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7eb05cf0_76db_4ea6_bc76_478fe60fb0f1.slice/crio-ef5abd2ebe94d26fd49988638dcc539b11ce933b81fc4462edc03c3523a0ce54 WatchSource:0}: Error finding container ef5abd2ebe94d26fd49988638dcc539b11ce933b81fc4462edc03c3523a0ce54: Status 404 returned error can't find the container with id ef5abd2ebe94d26fd49988638dcc539b11ce933b81fc4462edc03c3523a0ce54 Mar 16 15:33:36 crc kubenswrapper[5120]: I0316 15:33:36.169258 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-machine-approver/machine-approver-54c688565-ckfb5" event={"ID":"7eb05cf0-76db-4ea6-bc76-478fe60fb0f1","Type":"ContainerStarted","Data":"ef5abd2ebe94d26fd49988638dcc539b11ce933b81fc4462edc03c3523a0ce54"} Mar 16 15:33:36 crc kubenswrapper[5120]: I0316 15:33:36.170139 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-controller-manager\"/\"client-ca\"" Mar 16 15:33:36 crc kubenswrapper[5120]: I0316 15:33:36.211439 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 15:33:36 crc kubenswrapper[5120]: E0316 15:33:36.211681 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 15:33:36.711619757 +0000 UTC m=+118.865551454 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:36 crc kubenswrapper[5120]: I0316 15:33:36.211868 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-66587d64c8-blgcz\" (UID: \"6528b019-774e-4298-abe6-69f062f0a13e\") " pod="openshift-image-registry/image-registry-66587d64c8-blgcz" Mar 16 15:33:36 crc kubenswrapper[5120]: I0316 15:33:36.213601 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-controller-manager\"/\"kube-root-ca.crt\"" Mar 16 15:33:36 crc kubenswrapper[5120]: I0316 15:33:36.213628 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-controller-manager\"/\"openshift-global-ca\"" Mar 16 15:33:36 crc kubenswrapper[5120]: E0316 15:33:36.215618 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName: nodeName:}" failed. No retries permitted until 2026-03-16 15:33:36.715600525 +0000 UTC m=+118.869532182 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "image-registry-66587d64c8-blgcz" (UID: "6528b019-774e-4298-abe6-69f062f0a13e") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:36 crc kubenswrapper[5120]: I0316 15:33:36.229736 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-controller-manager\"/\"openshift-service-ca.crt\"" Mar 16 15:33:36 crc kubenswrapper[5120]: I0316 15:33:36.251111 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Mar 16 15:33:36 crc kubenswrapper[5120]: I0316 15:33:36.270807 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-kknhg\"" Mar 16 15:33:36 crc kubenswrapper[5120]: I0316 15:33:36.306991 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-grknn\" (UniqueName: \"kubernetes.io/projected/c86a3068-6ba1-40ef-9774-6a9efa5e0db6-kube-api-access-grknn\") pod \"machine-api-operator-755bb95488-5t49b\" (UID: \"c86a3068-6ba1-40ef-9774-6a9efa5e0db6\") " pod="openshift-machine-api/machine-api-operator-755bb95488-5t49b" Mar 16 15:33:36 crc kubenswrapper[5120]: I0316 15:33:36.313697 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 15:33:36 crc kubenswrapper[5120]: E0316 15:33:36.313947 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 15:33:36.813909957 +0000 UTC m=+118.967841644 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:36 crc kubenswrapper[5120]: I0316 15:33:36.314170 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-66587d64c8-blgcz\" (UID: \"6528b019-774e-4298-abe6-69f062f0a13e\") " pod="openshift-image-registry/image-registry-66587d64c8-blgcz" Mar 16 15:33:36 crc kubenswrapper[5120]: E0316 15:33:36.314806 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName: nodeName:}" failed. No retries permitted until 2026-03-16 15:33:36.814788742 +0000 UTC m=+118.968720429 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "image-registry-66587d64c8-blgcz" (UID: "6528b019-774e-4298-abe6-69f062f0a13e") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:36 crc kubenswrapper[5120]: I0316 15:33:36.329456 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Mar 16 15:33:36 crc kubenswrapper[5120]: I0316 15:33:36.331237 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nq9w4\" (UniqueName: \"kubernetes.io/projected/94a5c5c7-67a9-4631-bdee-296422d882c4-kube-api-access-nq9w4\") pod \"route-controller-manager-776cdc94d6-b9gn7\" (UID: \"94a5c5c7-67a9-4631-bdee-296422d882c4\") " pod="openshift-route-controller-manager/route-controller-manager-776cdc94d6-b9gn7" Mar 16 15:33:36 crc kubenswrapper[5120]: I0316 15:33:36.350195 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"marketplace-operator-metrics\"" Mar 16 15:33:36 crc kubenswrapper[5120]: I0316 15:33:36.369290 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"marketplace-operator-dockercfg-2cfkp\"" Mar 16 15:33:36 crc kubenswrapper[5120]: I0316 15:33:36.390649 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-apiserver/apiserver-9ddfb9f55-22m28"] Mar 16 15:33:36 crc kubenswrapper[5120]: I0316 15:33:36.396144 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"marketplace-trusted-ca\"" Mar 16 15:33:36 crc kubenswrapper[5120]: I0316 15:33:36.410776 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Mar 16 15:33:36 crc kubenswrapper[5120]: I0316 15:33:36.415630 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 15:33:36 crc kubenswrapper[5120]: E0316 15:33:36.415829 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 15:33:36.915808377 +0000 UTC m=+119.069740034 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:36 crc kubenswrapper[5120]: I0316 15:33:36.416309 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-66587d64c8-blgcz\" (UID: \"6528b019-774e-4298-abe6-69f062f0a13e\") " pod="openshift-image-registry/image-registry-66587d64c8-blgcz" Mar 16 15:33:36 crc kubenswrapper[5120]: E0316 15:33:36.416879 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName: nodeName:}" failed. No retries permitted until 2026-03-16 15:33:36.916812315 +0000 UTC m=+119.070744012 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "image-registry-66587d64c8-blgcz" (UID: "6528b019-774e-4298-abe6-69f062f0a13e") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:36 crc kubenswrapper[5120]: I0316 15:33:36.425108 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-api/machine-api-operator-755bb95488-5t49b" Mar 16 15:33:36 crc kubenswrapper[5120]: I0316 15:33:36.427571 5120 request.go:752] "Waited before sending request" delay="1.00138717s" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://api-int.crc.testing:6443/api/v1/namespaces/openshift-operator-lifecycle-manager/secrets?fieldSelector=metadata.name%3Dolm-operator-serviceaccount-dockercfg-4gqzj&limit=500&resourceVersion=0" Mar 16 15:33:36 crc kubenswrapper[5120]: I0316 15:33:36.429026 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operator-lifecycle-manager\"/\"olm-operator-serviceaccount-dockercfg-4gqzj\"" Mar 16 15:33:36 crc kubenswrapper[5120]: I0316 15:33:36.448213 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-route-controller-manager/route-controller-manager-776cdc94d6-b9gn7" Mar 16 15:33:36 crc kubenswrapper[5120]: I0316 15:33:36.450730 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operator-lifecycle-manager\"/\"catalog-operator-serving-cert\"" Mar 16 15:33:36 crc kubenswrapper[5120]: I0316 15:33:36.471144 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operator-lifecycle-manager\"/\"pprof-cert\"" Mar 16 15:33:36 crc kubenswrapper[5120]: I0316 15:33:36.490269 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operator-lifecycle-manager\"/\"kube-root-ca.crt\"" Mar 16 15:33:36 crc kubenswrapper[5120]: I0316 15:33:36.510522 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operator-lifecycle-manager\"/\"openshift-service-ca.crt\"" Mar 16 15:33:36 crc kubenswrapper[5120]: I0316 15:33:36.517560 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 15:33:36 crc kubenswrapper[5120]: E0316 15:33:36.517821 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 15:33:37.017750868 +0000 UTC m=+119.171682545 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:36 crc kubenswrapper[5120]: I0316 15:33:36.550262 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-machine-api\"/\"control-plane-machine-set-operator-tls\"" Mar 16 15:33:36 crc kubenswrapper[5120]: I0316 15:33:36.572295 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-machine-api\"/\"control-plane-machine-set-operator-dockercfg-gnx66\"" Mar 16 15:33:36 crc kubenswrapper[5120]: I0316 15:33:36.589962 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-authentication\"/\"v4-0-config-system-serving-cert\"" Mar 16 15:33:36 crc kubenswrapper[5120]: I0316 15:33:36.609595 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-authentication\"/\"v4-0-config-system-session\"" Mar 16 15:33:36 crc kubenswrapper[5120]: I0316 15:33:36.618939 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-66587d64c8-blgcz\" (UID: \"6528b019-774e-4298-abe6-69f062f0a13e\") " pod="openshift-image-registry/image-registry-66587d64c8-blgcz" Mar 16 15:33:36 crc kubenswrapper[5120]: E0316 15:33:36.619327 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName: nodeName:}" failed. No retries permitted until 2026-03-16 15:33:37.119312749 +0000 UTC m=+119.273244426 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "image-registry-66587d64c8-blgcz" (UID: "6528b019-774e-4298-abe6-69f062f0a13e") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:36 crc kubenswrapper[5120]: I0316 15:33:36.629999 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-authentication\"/\"v4-0-config-user-template-provider-selection\"" Mar 16 15:33:36 crc kubenswrapper[5120]: I0316 15:33:36.639298 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-machine-api/machine-api-operator-755bb95488-5t49b"] Mar 16 15:33:36 crc kubenswrapper[5120]: I0316 15:33:36.649063 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-authentication\"/\"v4-0-config-system-router-certs\"" Mar 16 15:33:36 crc kubenswrapper[5120]: W0316 15:33:36.660689 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc86a3068_6ba1_40ef_9774_6a9efa5e0db6.slice/crio-7d8a2ea4855cdae47720e5158ae61a915f037bf235580dc897da3a53233200d3 WatchSource:0}: Error finding container 7d8a2ea4855cdae47720e5158ae61a915f037bf235580dc897da3a53233200d3: Status 404 returned error can't find the container with id 7d8a2ea4855cdae47720e5158ae61a915f037bf235580dc897da3a53233200d3 Mar 16 15:33:36 crc kubenswrapper[5120]: I0316 15:33:36.662741 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5ff7774fd9-nljh6" Mar 16 15:33:36 crc kubenswrapper[5120]: I0316 15:33:36.662989 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fhkjl" Mar 16 15:33:36 crc kubenswrapper[5120]: I0316 15:33:36.663232 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-5bb8f5cd97-xdvz5" Mar 16 15:33:36 crc kubenswrapper[5120]: I0316 15:33:36.663407 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xr8r2" Mar 16 15:33:36 crc kubenswrapper[5120]: I0316 15:33:36.663662 5120 scope.go:117] "RemoveContainer" containerID="2e9f531a9c0fc8cf5222ce7e135c4f37d008306df727f84312cc5d7d2c740ac6" Mar 16 15:33:36 crc kubenswrapper[5120]: I0316 15:33:36.683855 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-route-controller-manager/route-controller-manager-776cdc94d6-b9gn7"] Mar 16 15:33:36 crc kubenswrapper[5120]: I0316 15:33:36.692087 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-authentication\"/\"v4-0-config-system-ocp-branding-template\"" Mar 16 15:33:36 crc kubenswrapper[5120]: I0316 15:33:36.695815 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-authentication\"/\"v4-0-config-system-trusted-ca-bundle\"" Mar 16 15:33:36 crc kubenswrapper[5120]: W0316 15:33:36.709061 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94a5c5c7_67a9_4631_bdee_296422d882c4.slice/crio-f42249e5e7876f42dd08bc331815f54d4096faa8a145e3142d11756be8f66f23 WatchSource:0}: Error finding container f42249e5e7876f42dd08bc331815f54d4096faa8a145e3142d11756be8f66f23: Status 404 returned error can't find the container with id f42249e5e7876f42dd08bc331815f54d4096faa8a145e3142d11756be8f66f23 Mar 16 15:33:36 crc kubenswrapper[5120]: I0316 15:33:36.713885 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-authentication\"/\"v4-0-config-user-template-error\"" Mar 16 15:33:36 crc kubenswrapper[5120]: I0316 15:33:36.719958 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 15:33:36 crc kubenswrapper[5120]: E0316 15:33:36.720546 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 15:33:37.2205207 +0000 UTC m=+119.374452377 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:36 crc kubenswrapper[5120]: I0316 15:33:36.729595 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-authentication\"/\"v4-0-config-user-template-login\"" Mar 16 15:33:36 crc kubenswrapper[5120]: I0316 15:33:36.749480 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-authentication\"/\"v4-0-config-system-service-ca\"" Mar 16 15:33:36 crc kubenswrapper[5120]: I0316 15:33:36.770271 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-authentication\"/\"v4-0-config-user-idp-0-file-data\"" Mar 16 15:33:36 crc kubenswrapper[5120]: I0316 15:33:36.790271 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-authentication\"/\"oauth-openshift-dockercfg-d2bf2\"" Mar 16 15:33:36 crc kubenswrapper[5120]: I0316 15:33:36.809850 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-authentication\"/\"v4-0-config-system-cliconfig\"" Mar 16 15:33:36 crc kubenswrapper[5120]: I0316 15:33:36.821248 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-66587d64c8-blgcz\" (UID: \"6528b019-774e-4298-abe6-69f062f0a13e\") " pod="openshift-image-registry/image-registry-66587d64c8-blgcz" Mar 16 15:33:36 crc kubenswrapper[5120]: E0316 15:33:36.821588 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName: nodeName:}" failed. No retries permitted until 2026-03-16 15:33:37.321576247 +0000 UTC m=+119.475507904 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "image-registry-66587d64c8-blgcz" (UID: "6528b019-774e-4298-abe6-69f062f0a13e") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:36 crc kubenswrapper[5120]: I0316 15:33:36.830723 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-authentication\"/\"kube-root-ca.crt\"" Mar 16 15:33:36 crc kubenswrapper[5120]: I0316 15:33:36.851369 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-authentication\"/\"audit\"" Mar 16 15:33:36 crc kubenswrapper[5120]: I0316 15:33:36.870206 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-authentication\"/\"openshift-service-ca.crt\"" Mar 16 15:33:36 crc kubenswrapper[5120]: I0316 15:33:36.889913 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operator-lifecycle-manager\"/\"package-server-manager-serving-cert\"" Mar 16 15:33:36 crc kubenswrapper[5120]: I0316 15:33:36.909398 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operator-lifecycle-manager\"/\"packageserver-service-cert\"" Mar 16 15:33:36 crc kubenswrapper[5120]: I0316 15:33:36.922717 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 15:33:36 crc kubenswrapper[5120]: E0316 15:33:36.922958 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 15:33:37.422935341 +0000 UTC m=+119.576866998 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:36 crc kubenswrapper[5120]: I0316 15:33:36.929984 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operator-lifecycle-manager\"/\"olm-operator-serving-cert\"" Mar 16 15:33:36 crc kubenswrapper[5120]: I0316 15:33:36.949943 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operator-lifecycle-manager\"/\"collect-profiles-dockercfg-vfqp6\"" Mar 16 15:33:36 crc kubenswrapper[5120]: I0316 15:33:36.970007 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operator-lifecycle-manager\"/\"collect-profiles-config\"" Mar 16 15:33:36 crc kubenswrapper[5120]: I0316 15:33:36.989847 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.010031 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-bgxvm\"" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.024726 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-66587d64c8-blgcz\" (UID: \"6528b019-774e-4298-abe6-69f062f0a13e\") " pod="openshift-image-registry/image-registry-66587d64c8-blgcz" Mar 16 15:33:37 crc kubenswrapper[5120]: E0316 15:33:37.025269 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName: nodeName:}" failed. No retries permitted until 2026-03-16 15:33:37.525243482 +0000 UTC m=+119.679175159 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "image-registry-66587d64c8-blgcz" (UID: "6528b019-774e-4298-abe6-69f062f0a13e") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.030426 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.050112 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.070209 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.090488 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.109976 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.125645 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 15:33:37 crc kubenswrapper[5120]: E0316 15:33:37.125932 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 15:33:37.625894638 +0000 UTC m=+119.779826335 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.130990 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.151462 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.170801 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-bjqfd\"" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.176059 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-route-controller-manager/route-controller-manager-776cdc94d6-b9gn7" event={"ID":"94a5c5c7-67a9-4631-bdee-296422d882c4","Type":"ContainerStarted","Data":"92a812faef174e48906c0daae6eb0df825de8d49f1ad9abaa9267aaac7ea19c9"} Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.176142 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-route-controller-manager/route-controller-manager-776cdc94d6-b9gn7" event={"ID":"94a5c5c7-67a9-4631-bdee-296422d882c4","Type":"ContainerStarted","Data":"f42249e5e7876f42dd08bc331815f54d4096faa8a145e3142d11756be8f66f23"} Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.176385 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-route-controller-manager/route-controller-manager-776cdc94d6-b9gn7" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.178221 5120 generic.go:358] "Generic (PLEG): container finished" podID="098dce05-a301-4e1c-b150-5209c633e233" containerID="28ef092ac68a0085c8c29800508470c0a771f64cf56204e60d8816e020249369" exitCode=0 Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.178268 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-apiserver/apiserver-9ddfb9f55-22m28" event={"ID":"098dce05-a301-4e1c-b150-5209c633e233","Type":"ContainerDied","Data":"28ef092ac68a0085c8c29800508470c0a771f64cf56204e60d8816e020249369"} Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.178304 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-apiserver/apiserver-9ddfb9f55-22m28" event={"ID":"098dce05-a301-4e1c-b150-5209c633e233","Type":"ContainerStarted","Data":"60fc625b7d3631e197619a7c98b1167927b26de942e904d08ff71562314f5a68"} Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.179127 5120 patch_prober.go:28] interesting pod/route-controller-manager-776cdc94d6-b9gn7 container/route-controller-manager namespace/openshift-route-controller-manager: Readiness probe status=failure output="Get \"https://10.217.0.7:8443/healthz\": dial tcp 10.217.0.7:8443: connect: connection refused" start-of-body= Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.179225 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-route-controller-manager/route-controller-manager-776cdc94d6-b9gn7" podUID="94a5c5c7-67a9-4631-bdee-296422d882c4" containerName="route-controller-manager" probeResult="failure" output="Get \"https://10.217.0.7:8443/healthz\": dial tcp 10.217.0.7:8443: connect: connection refused" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.182536 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-api/machine-api-operator-755bb95488-5t49b" event={"ID":"c86a3068-6ba1-40ef-9774-6a9efa5e0db6","Type":"ContainerStarted","Data":"7a1a7517a9572bd6b73b7b75fe10a75e8a6dcdae1cc8733e15d9f5f56e3bebdf"} Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.182582 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-api/machine-api-operator-755bb95488-5t49b" event={"ID":"c86a3068-6ba1-40ef-9774-6a9efa5e0db6","Type":"ContainerStarted","Data":"dbc6eb8718201e7e0d2e3c7731628fbc5c6390fbd3b1f32895ade1d484404ba5"} Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.182601 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-api/machine-api-operator-755bb95488-5t49b" event={"ID":"c86a3068-6ba1-40ef-9774-6a9efa5e0db6","Type":"ContainerStarted","Data":"7d8a2ea4855cdae47720e5158ae61a915f037bf235580dc897da3a53233200d3"} Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.185585 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_kube-apiserver-crc_3a14caf222afb62aaabdc47808b6f944/kube-apiserver-check-endpoints/3.log" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.190132 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-crc" event={"ID":"3a14caf222afb62aaabdc47808b6f944","Type":"ContainerStarted","Data":"3f2b9043857355dd12ad0ca2395ba7e066dc75d7974ef24c8ccde5468b617654"} Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.190632 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-kube-apiserver/kube-apiserver-crc" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.192571 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-machine-approver/machine-approver-54c688565-ckfb5" event={"ID":"7eb05cf0-76db-4ea6-bc76-478fe60fb0f1","Type":"ContainerStarted","Data":"c1521c1ef38d49ede5e165807ac86fb180cff8f28026d72777a10b5522162522"} Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.192608 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-machine-approver/machine-approver-54c688565-ckfb5" event={"ID":"7eb05cf0-76db-4ea6-bc76-478fe60fb0f1","Type":"ContainerStarted","Data":"2f125ed67585c7614f4d778a6aa54f0a2d18a47b73a681e771fb75c0bbe92d67"} Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.193336 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"hostpath-provisioner\"/\"openshift-service-ca.crt\"" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.211712 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"hostpath-provisioner\"/\"kube-root-ca.crt\"" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.227164 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-66587d64c8-blgcz\" (UID: \"6528b019-774e-4298-abe6-69f062f0a13e\") " pod="openshift-image-registry/image-registry-66587d64c8-blgcz" Mar 16 15:33:37 crc kubenswrapper[5120]: E0316 15:33:37.227782 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName: nodeName:}" failed. No retries permitted until 2026-03-16 15:33:37.727731436 +0000 UTC m=+119.881663103 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "image-registry-66587d64c8-blgcz" (UID: "6528b019-774e-4298-abe6-69f062f0a13e") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.230963 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"hostpath-provisioner\"/\"csi-hostpath-provisioner-sa-dockercfg-7dcws\"" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.250051 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-kpvmz\"" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.271633 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.290664 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.310807 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-sysctl-allowlist\"" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.327667 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 15:33:37 crc kubenswrapper[5120]: E0316 15:33:37.327960 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 15:33:37.82793105 +0000 UTC m=+119.981862717 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.330135 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.351344 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.370557 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.390590 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-9pgs7\"" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.409646 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-machine-config-operator\"/\"machine-config-server-dockercfg-dzw6b\"" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.428966 5120 request.go:752] "Waited before sending request" delay="1.967249732s" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://api-int.crc.testing:6443/api/v1/namespaces/openshift-machine-config-operator/secrets?fieldSelector=metadata.name%3Dnode-bootstrapper-token&limit=500&resourceVersion=0" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.429724 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6a9ae5f6-97bd-46ac-bafa-ca1b4452a141-nginx-conf\") pod \"networking-console-plugin-5ff7774fd9-nljh6\" (UID: \"6a9ae5f6-97bd-46ac-bafa-ca1b4452a141\") " pod="openshift-network-console/networking-console-plugin-5ff7774fd9-nljh6" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.429833 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-66587d64c8-blgcz\" (UID: \"6528b019-774e-4298-abe6-69f062f0a13e\") " pod="openshift-image-registry/image-registry-66587d64c8-blgcz" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.429909 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6a9ae5f6-97bd-46ac-bafa-ca1b4452a141-networking-console-plugin-cert\") pod \"networking-console-plugin-5ff7774fd9-nljh6\" (UID: \"6a9ae5f6-97bd-46ac-bafa-ca1b4452a141\") " pod="openshift-network-console/networking-console-plugin-5ff7774fd9-nljh6" Mar 16 15:33:37 crc kubenswrapper[5120]: E0316 15:33:37.430456 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName: nodeName:}" failed. No retries permitted until 2026-03-16 15:33:37.930434306 +0000 UTC m=+120.084366003 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "image-registry-66587d64c8-blgcz" (UID: "6528b019-774e-4298-abe6-69f062f0a13e") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.431266 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-machine-config-operator\"/\"node-bootstrapper-token\"" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.450258 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-machine-config-operator\"/\"machine-config-server-tls\"" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.495707 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4glg\" (UniqueName: \"kubernetes.io/projected/b1044723-f3d1-4042-a1fc-56c73404b448-kube-api-access-z4glg\") pod \"dns-operator-799b87ffcd-8kwxr\" (UID: \"b1044723-f3d1-4042-a1fc-56c73404b448\") " pod="openshift-dns-operator/dns-operator-799b87ffcd-8kwxr" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.504542 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ht6hg\" (UniqueName: \"kubernetes.io/projected/5e748192-041e-48ef-92ab-ec90d6d23d98-kube-api-access-ht6hg\") pod \"authentication-operator-7f5c659b84-p5kbj\" (UID: \"5e748192-041e-48ef-92ab-ec90d6d23d98\") " pod="openshift-authentication-operator/authentication-operator-7f5c659b84-p5kbj" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.531205 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.531339 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gwt8b\" (UniqueName: \"kubernetes.io/projected/17b87002-b798-480a-8e17-83053d698239-kube-api-access-gwt8b\") pod \"network-check-target-fhkjl\" (UID: \"17b87002-b798-480a-8e17-83053d698239\") " pod="openshift-network-diagnostics/network-check-target-fhkjl" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.531383 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4464728a-4869-4476-83de-cb34577ace7f-metrics-certs\") pod \"network-metrics-daemon-xr8r2\" (UID: \"4464728a-4869-4476-83de-cb34577ace7f\") " pod="openshift-multus/network-metrics-daemon-xr8r2" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.531420 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l7w75\" (UniqueName: \"kubernetes.io/projected/f863fff9-286a-45fa-b8f0-8a86994b8440-kube-api-access-l7w75\") pod \"network-check-source-5bb8f5cd97-xdvz5\" (UID: \"f863fff9-286a-45fa-b8f0-8a86994b8440\") " pod="openshift-network-diagnostics/network-check-source-5bb8f5cd97-xdvz5" Mar 16 15:33:37 crc kubenswrapper[5120]: E0316 15:33:37.531598 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 15:33:38.031582155 +0000 UTC m=+120.185513812 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.533333 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9c7g\" (UniqueName: \"kubernetes.io/projected/e19b119f-2b96-4aba-a3bf-86ba4acd33f5-kube-api-access-z9c7g\") pod \"etcd-operator-69b85846b6-s4s6j\" (UID: \"e19b119f-2b96-4aba-a3bf-86ba4acd33f5\") " pod="openshift-etcd-operator/etcd-operator-69b85846b6-s4s6j" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.551513 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dltk8\" (UniqueName: \"kubernetes.io/projected/6528b019-774e-4298-abe6-69f062f0a13e-kube-api-access-dltk8\") pod \"image-registry-66587d64c8-blgcz\" (UID: \"6528b019-774e-4298-abe6-69f062f0a13e\") " pod="openshift-image-registry/image-registry-66587d64c8-blgcz" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.565416 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4f7f\" (UniqueName: \"kubernetes.io/projected/fde0e777-f937-4372-a51d-3df2383352f0-kube-api-access-l4f7f\") pod \"ingress-operator-6b9cb4dbcf-pdp25\" (UID: \"fde0e777-f937-4372-a51d-3df2383352f0\") " pod="openshift-ingress-operator/ingress-operator-6b9cb4dbcf-pdp25" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.586786 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qt7j\" (UniqueName: \"kubernetes.io/projected/e8637b4d-e12e-4c41-adc5-649e5bab46ad-kube-api-access-4qt7j\") pod \"apiserver-8596bd845d-jb8bk\" (UID: \"e8637b4d-e12e-4c41-adc5-649e5bab46ad\") " pod="openshift-oauth-apiserver/apiserver-8596bd845d-jb8bk" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.604206 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6528b019-774e-4298-abe6-69f062f0a13e-bound-sa-token\") pod \"image-registry-66587d64c8-blgcz\" (UID: \"6528b019-774e-4298-abe6-69f062f0a13e\") " pod="openshift-image-registry/image-registry-66587d64c8-blgcz" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.626204 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fde0e777-f937-4372-a51d-3df2383352f0-bound-sa-token\") pod \"ingress-operator-6b9cb4dbcf-pdp25\" (UID: \"fde0e777-f937-4372-a51d-3df2383352f0\") " pod="openshift-ingress-operator/ingress-operator-6b9cb4dbcf-pdp25" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.632695 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-66587d64c8-blgcz\" (UID: \"6528b019-774e-4298-abe6-69f062f0a13e\") " pod="openshift-image-registry/image-registry-66587d64c8-blgcz" Mar 16 15:33:37 crc kubenswrapper[5120]: E0316 15:33:37.633098 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName: nodeName:}" failed. No retries permitted until 2026-03-16 15:33:38.133083445 +0000 UTC m=+120.287015102 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "image-registry-66587d64c8-blgcz" (UID: "6528b019-774e-4298-abe6-69f062f0a13e") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.645301 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/e1875c3d-c889-4161-8c25-c73abc4a8468-kube-api-access\") pod \"kube-apiserver-operator-575994946d-mdbz9\" (UID: \"e1875c3d-c889-4161-8c25-c73abc4a8468\") " pod="openshift-kube-apiserver-operator/kube-apiserver-operator-575994946d-mdbz9" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.662630 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffvbt\" (UniqueName: \"kubernetes.io/projected/3c8912a1-f2fb-407e-878f-1e6614a30688-kube-api-access-ffvbt\") pod \"console-operator-67c89758df-lx5p5\" (UID: \"3c8912a1-f2fb-407e-878f-1e6614a30688\") " pod="openshift-console-operator/console-operator-67c89758df-lx5p5" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.686902 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-authentication-operator/authentication-operator-7f5c659b84-p5kbj" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.710706 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.719947 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-67c89758df-lx5p5" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.721875 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6a9ae5f6-97bd-46ac-bafa-ca1b4452a141-nginx-conf\") pod \"networking-console-plugin-5ff7774fd9-nljh6\" (UID: \"6a9ae5f6-97bd-46ac-bafa-ca1b4452a141\") " pod="openshift-network-console/networking-console-plugin-5ff7774fd9-nljh6" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.730098 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.734263 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.734415 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/716f37d9-f29d-4bc1-87a1-94364fee0605-oauth-serving-cert\") pod \"console-64d44f6ddf-4pm87\" (UID: \"716f37d9-f29d-4bc1-87a1-94364fee0605\") " pod="openshift-console/console-64d44f6ddf-4pm87" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.734444 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/f66781c9-aef5-4298-9f8a-b7f217906ed7-proxy-ca-bundles\") pod \"controller-manager-65b6cccf98-pbcg9\" (UID: \"f66781c9-aef5-4298-9f8a-b7f217906ed7\") " pod="openshift-controller-manager/controller-manager-65b6cccf98-pbcg9" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.734461 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rlzcx\" (UniqueName: \"kubernetes.io/projected/2b813265-fb01-4449-804c-7cae0739518d-kube-api-access-rlzcx\") pod \"machine-config-controller-f9cdd68f7-ljkbj\" (UID: \"2b813265-fb01-4449-804c-7cae0739518d\") " pod="openshift-machine-config-operator/machine-config-controller-f9cdd68f7-ljkbj" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.734477 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-system-serving-cert\" (UniqueName: \"kubernetes.io/secret/83701ed7-4bc7-455c-a179-b460d641b3bf-v4-0-config-system-serving-cert\") pod \"oauth-openshift-66458b6674-fvnvr\" (UID: \"83701ed7-4bc7-455c-a179-b460d641b3bf\") " pod="openshift-authentication/oauth-openshift-66458b6674-fvnvr" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.734507 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"available-featuregates\" (UniqueName: \"kubernetes.io/empty-dir/92936655-647a-450f-a122-ff876adae5d3-available-featuregates\") pod \"openshift-config-operator-5777786469-b8t64\" (UID: \"92936655-647a-450f-a122-ff876adae5d3\") " pod="openshift-config-operator/openshift-config-operator-5777786469-b8t64" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.734522 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d8d90bff-3ac2-4cff-aaa4-7072a4811400-proxy-tls\") pod \"machine-config-operator-67c9d58cbb-wmklh\" (UID: \"d8d90bff-3ac2-4cff-aaa4-7072a4811400\") " pod="openshift-machine-config-operator/machine-config-operator-67c9d58cbb-wmklh" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.734581 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted-pem\" (UniqueName: \"kubernetes.io/empty-dir/694287b7-37ad-49df-b06d-71eea425d072-ca-trust-extracted-pem\") pod \"cluster-image-registry-operator-86c45576b9-bl65j\" (UID: \"694287b7-37ad-49df-b06d-71eea425d072\") " pod="openshift-image-registry/cluster-image-registry-operator-86c45576b9-bl65j" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.734596 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5fl25\" (UniqueName: \"kubernetes.io/projected/d9daa888-94fa-4afc-85a2-81b9dc9a5d3c-kube-api-access-5fl25\") pod \"cluster-samples-operator-6b564684c8-8tt42\" (UID: \"d9daa888-94fa-4afc-85a2-81b9dc9a5d3c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6b564684c8-8tt42" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.734614 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-user-template-error\" (UniqueName: \"kubernetes.io/secret/83701ed7-4bc7-455c-a179-b460d641b3bf-v4-0-config-user-template-error\") pod \"oauth-openshift-66458b6674-fvnvr\" (UID: \"83701ed7-4bc7-455c-a179-b460d641b3bf\") " pod="openshift-authentication/oauth-openshift-66458b6674-fvnvr" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.734633 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgmmk\" (UniqueName: \"kubernetes.io/projected/b064c090-1362-427c-b805-d2808c01b58c-kube-api-access-tgmmk\") pod \"downloads-747b44746d-pjv44\" (UID: \"b064c090-1362-427c-b805-d2808c01b58c\") " pod="openshift-console/downloads-747b44746d-pjv44" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.734649 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"images\" (UniqueName: \"kubernetes.io/configmap/d8d90bff-3ac2-4cff-aaa4-7072a4811400-images\") pod \"machine-config-operator-67c9d58cbb-wmklh\" (UID: \"d8d90bff-3ac2-4cff-aaa4-7072a4811400\") " pod="openshift-machine-config-operator/machine-config-operator-67c9d58cbb-wmklh" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.734684 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22znc\" (UniqueName: \"kubernetes.io/projected/d8d90bff-3ac2-4cff-aaa4-7072a4811400-kube-api-access-22znc\") pod \"machine-config-operator-67c9d58cbb-wmklh\" (UID: \"d8d90bff-3ac2-4cff-aaa4-7072a4811400\") " pod="openshift-machine-config-operator/machine-config-operator-67c9d58cbb-wmklh" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.734699 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/96908d53-e612-462c-b9d5-2f10f220508b-tmp\") pod \"openshift-kube-scheduler-operator-54f497555d-sz9k8\" (UID: \"96908d53-e612-462c-b9d5-2f10f220508b\") " pod="openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-54f497555d-sz9k8" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.734724 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdn8d\" (UniqueName: \"kubernetes.io/projected/f66781c9-aef5-4298-9f8a-b7f217906ed7-kube-api-access-fdn8d\") pod \"controller-manager-65b6cccf98-pbcg9\" (UID: \"f66781c9-aef5-4298-9f8a-b7f217906ed7\") " pod="openshift-controller-manager/controller-manager-65b6cccf98-pbcg9" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.734738 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-user-template-provider-selection\" (UniqueName: \"kubernetes.io/secret/83701ed7-4bc7-455c-a179-b460d641b3bf-v4-0-config-user-template-provider-selection\") pod \"oauth-openshift-66458b6674-fvnvr\" (UID: \"83701ed7-4bc7-455c-a179-b460d641b3bf\") " pod="openshift-authentication/oauth-openshift-66458b6674-fvnvr" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.734768 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/d8d90bff-3ac2-4cff-aaa4-7072a4811400-auth-proxy-config\") pod \"machine-config-operator-67c9d58cbb-wmklh\" (UID: \"d8d90bff-3ac2-4cff-aaa4-7072a4811400\") " pod="openshift-machine-config-operator/machine-config-operator-67c9d58cbb-wmklh" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.734784 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b94b756-5f20-4937-a8a7-11471f916640-metrics-certs\") pod \"router-default-68cf44c8b8-rsmpr\" (UID: \"5b94b756-5f20-4937-a8a7-11471f916640\") " pod="openshift-ingress/router-default-68cf44c8b8-rsmpr" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.734798 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/694287b7-37ad-49df-b06d-71eea425d072-tmp\") pod \"cluster-image-registry-operator-86c45576b9-bl65j\" (UID: \"694287b7-37ad-49df-b06d-71eea425d072\") " pod="openshift-image-registry/cluster-image-registry-operator-86c45576b9-bl65j" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.734813 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a0b763d7-65d4-41e1-9880-8f80e9686189-tmp\") pod \"marketplace-operator-547dbd544d-gp852\" (UID: \"a0b763d7-65d4-41e1-9880-8f80e9686189\") " pod="openshift-marketplace/marketplace-operator-547dbd544d-gp852" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.734830 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zpmn\" (UniqueName: \"kubernetes.io/projected/3b41e06b-0932-41d2-947a-e38b1ff52ec3-kube-api-access-9zpmn\") pod \"control-plane-machine-set-operator-75ffdb6fcd-htqkp\" (UID: \"3b41e06b-0932-41d2-947a-e38b1ff52ec3\") " pod="openshift-machine-api/control-plane-machine-set-operator-75ffdb6fcd-htqkp" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.734845 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4b360ef1-cdf6-4d35-9354-4fc46c0cc916-serving-cert\") pod \"openshift-apiserver-operator-846cbfc458-rjvhc\" (UID: \"4b360ef1-cdf6-4d35-9354-4fc46c0cc916\") " pod="openshift-apiserver-operator/openshift-apiserver-operator-846cbfc458-rjvhc" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.734869 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/716f37d9-f29d-4bc1-87a1-94364fee0605-console-serving-cert\") pod \"console-64d44f6ddf-4pm87\" (UID: \"716f37d9-f29d-4bc1-87a1-94364fee0605\") " pod="openshift-console/console-64d44f6ddf-4pm87" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.734884 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-certs\" (UniqueName: \"kubernetes.io/secret/52bf262d-dc00-4318-af10-68291a53ce29-webhook-certs\") pod \"multus-admission-controller-69db94689b-6bcfh\" (UID: \"52bf262d-dc00-4318-af10-68291a53ce29\") " pod="openshift-multus/multus-admission-controller-69db94689b-6bcfh" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.734921 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v79qt\" (UniqueName: \"kubernetes.io/projected/1e9a53b6-6bbb-4477-af7b-3d98acfc8f1d-kube-api-access-v79qt\") pod \"openshift-controller-manager-operator-686468bdd5-vrbxt\" (UID: \"1e9a53b6-6bbb-4477-af7b-3d98acfc8f1d\") " pod="openshift-controller-manager-operator/openshift-controller-manager-operator-686468bdd5-vrbxt" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.734938 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-user-idp-0-file-data\" (UniqueName: \"kubernetes.io/secret/83701ed7-4bc7-455c-a179-b460d641b3bf-v4-0-config-user-idp-0-file-data\") pod \"oauth-openshift-66458b6674-fvnvr\" (UID: \"83701ed7-4bc7-455c-a179-b460d641b3bf\") " pod="openshift-authentication/oauth-openshift-66458b6674-fvnvr" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.734953 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/96908d53-e612-462c-b9d5-2f10f220508b-serving-cert\") pod \"openshift-kube-scheduler-operator-54f497555d-sz9k8\" (UID: \"96908d53-e612-462c-b9d5-2f10f220508b\") " pod="openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-54f497555d-sz9k8" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.734979 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4b360ef1-cdf6-4d35-9354-4fc46c0cc916-config\") pod \"openshift-apiserver-operator-846cbfc458-rjvhc\" (UID: \"4b360ef1-cdf6-4d35-9354-4fc46c0cc916\") " pod="openshift-apiserver-operator/openshift-apiserver-operator-846cbfc458-rjvhc" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.734999 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7w9wk\" (UniqueName: \"kubernetes.io/projected/52bf262d-dc00-4318-af10-68291a53ce29-kube-api-access-7w9wk\") pod \"multus-admission-controller-69db94689b-6bcfh\" (UID: \"52bf262d-dc00-4318-af10-68291a53ce29\") " pod="openshift-multus/multus-admission-controller-69db94689b-6bcfh" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.735051 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b94b756-5f20-4937-a8a7-11471f916640-service-ca-bundle\") pod \"router-default-68cf44c8b8-rsmpr\" (UID: \"5b94b756-5f20-4937-a8a7-11471f916640\") " pod="openshift-ingress/router-default-68cf44c8b8-rsmpr" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.735080 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"marketplace-operator-metrics\" (UniqueName: \"kubernetes.io/secret/a0b763d7-65d4-41e1-9880-8f80e9686189-marketplace-operator-metrics\") pod \"marketplace-operator-547dbd544d-gp852\" (UID: \"a0b763d7-65d4-41e1-9880-8f80e9686189\") " pod="openshift-marketplace/marketplace-operator-547dbd544d-gp852" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.735099 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjlg7\" (UniqueName: \"kubernetes.io/projected/716f37d9-f29d-4bc1-87a1-94364fee0605-kube-api-access-jjlg7\") pod \"console-64d44f6ddf-4pm87\" (UID: \"716f37d9-f29d-4bc1-87a1-94364fee0605\") " pod="openshift-console/console-64d44f6ddf-4pm87" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.735113 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/2b813265-fb01-4449-804c-7cae0739518d-proxy-tls\") pod \"machine-config-controller-f9cdd68f7-ljkbj\" (UID: \"2b813265-fb01-4449-804c-7cae0739518d\") " pod="openshift-machine-config-operator/machine-config-controller-f9cdd68f7-ljkbj" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.735132 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"mcc-auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/2b813265-fb01-4449-804c-7cae0739518d-mcc-auth-proxy-config\") pod \"machine-config-controller-f9cdd68f7-ljkbj\" (UID: \"2b813265-fb01-4449-804c-7cae0739518d\") " pod="openshift-machine-config-operator/machine-config-controller-f9cdd68f7-ljkbj" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.735147 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/5b94b756-5f20-4937-a8a7-11471f916640-default-certificate\") pod \"router-default-68cf44c8b8-rsmpr\" (UID: \"5b94b756-5f20-4937-a8a7-11471f916640\") " pod="openshift-ingress/router-default-68cf44c8b8-rsmpr" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.735165 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1e9a53b6-6bbb-4477-af7b-3d98acfc8f1d-config\") pod \"openshift-controller-manager-operator-686468bdd5-vrbxt\" (UID: \"1e9a53b6-6bbb-4477-af7b-3d98acfc8f1d\") " pod="openshift-controller-manager-operator/openshift-controller-manager-operator-686468bdd5-vrbxt" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.735180 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-system-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83701ed7-4bc7-455c-a179-b460d641b3bf-v4-0-config-system-trusted-ca-bundle\") pod \"oauth-openshift-66458b6674-fvnvr\" (UID: \"83701ed7-4bc7-455c-a179-b460d641b3bf\") " pod="openshift-authentication/oauth-openshift-66458b6674-fvnvr" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.735196 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/694287b7-37ad-49df-b06d-71eea425d072-bound-sa-token\") pod \"cluster-image-registry-operator-86c45576b9-bl65j\" (UID: \"694287b7-37ad-49df-b06d-71eea425d072\") " pod="openshift-image-registry/cluster-image-registry-operator-86c45576b9-bl65j" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.735210 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vww8n\" (UniqueName: \"kubernetes.io/projected/d76e98d2-9b74-4e20-9b51-60099ccf5d9c-kube-api-access-vww8n\") pod \"kube-storage-version-migrator-operator-565b79b866-2n6k5\" (UID: \"d76e98d2-9b74-4e20-9b51-60099ccf5d9c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565b79b866-2n6k5" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.735227 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-system-cliconfig\" (UniqueName: \"kubernetes.io/configmap/83701ed7-4bc7-455c-a179-b460d641b3bf-v4-0-config-system-cliconfig\") pod \"oauth-openshift-66458b6674-fvnvr\" (UID: \"83701ed7-4bc7-455c-a179-b460d641b3bf\") " pod="openshift-authentication/oauth-openshift-66458b6674-fvnvr" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.735260 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"marketplace-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a0b763d7-65d4-41e1-9880-8f80e9686189-marketplace-trusted-ca\") pod \"marketplace-operator-547dbd544d-gp852\" (UID: \"a0b763d7-65d4-41e1-9880-8f80e9686189\") " pod="openshift-marketplace/marketplace-operator-547dbd544d-gp852" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.735275 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d76e98d2-9b74-4e20-9b51-60099ccf5d9c-serving-cert\") pod \"kube-storage-version-migrator-operator-565b79b866-2n6k5\" (UID: \"d76e98d2-9b74-4e20-9b51-60099ccf5d9c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565b79b866-2n6k5" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.735290 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/83701ed7-4bc7-455c-a179-b460d641b3bf-audit-dir\") pod \"oauth-openshift-66458b6674-fvnvr\" (UID: \"83701ed7-4bc7-455c-a179-b460d641b3bf\") " pod="openshift-authentication/oauth-openshift-66458b6674-fvnvr" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.735307 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/50822c67-9654-449a-869f-cf28fb1fff4d-serving-cert\") pod \"kube-controller-manager-operator-69d5f845f8-6nn27\" (UID: \"50822c67-9654-449a-869f-cf28fb1fff4d\") " pod="openshift-kube-controller-manager-operator/kube-controller-manager-operator-69d5f845f8-6nn27" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.735321 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/92936655-647a-450f-a122-ff876adae5d3-serving-cert\") pod \"openshift-config-operator-5777786469-b8t64\" (UID: \"92936655-647a-450f-a122-ff876adae5d3\") " pod="openshift-config-operator/openshift-config-operator-5777786469-b8t64" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.735348 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"profile-collector-cert\" (UniqueName: \"kubernetes.io/secret/7f53cb77-0d21-4cd7-81c0-d003500184f1-profile-collector-cert\") pod \"catalog-operator-75ff9f647d-x5d5w\" (UID: \"7f53cb77-0d21-4cd7-81c0-d003500184f1\") " pod="openshift-operator-lifecycle-manager/catalog-operator-75ff9f647d-x5d5w" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.735364 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/716f37d9-f29d-4bc1-87a1-94364fee0605-console-config\") pod \"console-64d44f6ddf-4pm87\" (UID: \"716f37d9-f29d-4bc1-87a1-94364fee0605\") " pod="openshift-console/console-64d44f6ddf-4pm87" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.735404 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-system-session\" (UniqueName: \"kubernetes.io/secret/83701ed7-4bc7-455c-a179-b460d641b3bf-v4-0-config-system-session\") pod \"oauth-openshift-66458b6674-fvnvr\" (UID: \"83701ed7-4bc7-455c-a179-b460d641b3bf\") " pod="openshift-authentication/oauth-openshift-66458b6674-fvnvr" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.735423 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9s7z5\" (UniqueName: \"kubernetes.io/projected/83701ed7-4bc7-455c-a179-b460d641b3bf-kube-api-access-9s7z5\") pod \"oauth-openshift-66458b6674-fvnvr\" (UID: \"83701ed7-4bc7-455c-a179-b460d641b3bf\") " pod="openshift-authentication/oauth-openshift-66458b6674-fvnvr" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.735488 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/716f37d9-f29d-4bc1-87a1-94364fee0605-trusted-ca-bundle\") pod \"console-64d44f6ddf-4pm87\" (UID: \"716f37d9-f29d-4bc1-87a1-94364fee0605\") " pod="openshift-console/console-64d44f6ddf-4pm87" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.735514 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/5b94b756-5f20-4937-a8a7-11471f916640-stats-auth\") pod \"router-default-68cf44c8b8-rsmpr\" (UID: \"5b94b756-5f20-4937-a8a7-11471f916640\") " pod="openshift-ingress/router-default-68cf44c8b8-rsmpr" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.735529 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-user-template-login\" (UniqueName: \"kubernetes.io/secret/83701ed7-4bc7-455c-a179-b460d641b3bf-v4-0-config-user-template-login\") pod \"oauth-openshift-66458b6674-fvnvr\" (UID: \"83701ed7-4bc7-455c-a179-b460d641b3bf\") " pod="openshift-authentication/oauth-openshift-66458b6674-fvnvr" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.735547 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/50822c67-9654-449a-869f-cf28fb1fff4d-kube-api-access\") pod \"kube-controller-manager-operator-69d5f845f8-6nn27\" (UID: \"50822c67-9654-449a-869f-cf28fb1fff4d\") " pod="openshift-kube-controller-manager-operator/kube-controller-manager-operator-69d5f845f8-6nn27" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.735574 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/50822c67-9654-449a-869f-cf28fb1fff4d-config\") pod \"kube-controller-manager-operator-69d5f845f8-6nn27\" (UID: \"50822c67-9654-449a-869f-cf28fb1fff4d\") " pod="openshift-kube-controller-manager-operator/kube-controller-manager-operator-69d5f845f8-6nn27" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.735590 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-system-router-certs\" (UniqueName: \"kubernetes.io/secret/83701ed7-4bc7-455c-a179-b460d641b3bf-v4-0-config-system-router-certs\") pod \"oauth-openshift-66458b6674-fvnvr\" (UID: \"83701ed7-4bc7-455c-a179-b460d641b3bf\") " pod="openshift-authentication/oauth-openshift-66458b6674-fvnvr" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.735610 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f66781c9-aef5-4298-9f8a-b7f217906ed7-serving-cert\") pod \"controller-manager-65b6cccf98-pbcg9\" (UID: \"f66781c9-aef5-4298-9f8a-b7f217906ed7\") " pod="openshift-controller-manager/controller-manager-65b6cccf98-pbcg9" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.735625 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-policies\" (UniqueName: \"kubernetes.io/configmap/83701ed7-4bc7-455c-a179-b460d641b3bf-audit-policies\") pod \"oauth-openshift-66458b6674-fvnvr\" (UID: \"83701ed7-4bc7-455c-a179-b460d641b3bf\") " pod="openshift-authentication/oauth-openshift-66458b6674-fvnvr" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.735655 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1e9a53b6-6bbb-4477-af7b-3d98acfc8f1d-serving-cert\") pod \"openshift-controller-manager-operator-686468bdd5-vrbxt\" (UID: \"1e9a53b6-6bbb-4477-af7b-3d98acfc8f1d\") " pod="openshift-controller-manager-operator/openshift-controller-manager-operator-686468bdd5-vrbxt" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.735701 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/694287b7-37ad-49df-b06d-71eea425d072-trusted-ca\") pod \"cluster-image-registry-operator-86c45576b9-bl65j\" (UID: \"694287b7-37ad-49df-b06d-71eea425d072\") " pod="openshift-image-registry/cluster-image-registry-operator-86c45576b9-bl65j" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.735730 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/50822c67-9654-449a-869f-cf28fb1fff4d-tmp-dir\") pod \"kube-controller-manager-operator-69d5f845f8-6nn27\" (UID: \"50822c67-9654-449a-869f-cf28fb1fff4d\") " pod="openshift-kube-controller-manager-operator/kube-controller-manager-operator-69d5f845f8-6nn27" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.735819 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/f66781c9-aef5-4298-9f8a-b7f217906ed7-client-ca\") pod \"controller-manager-65b6cccf98-pbcg9\" (UID: \"f66781c9-aef5-4298-9f8a-b7f217906ed7\") " pod="openshift-controller-manager/controller-manager-65b6cccf98-pbcg9" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.735839 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-system-ocp-branding-template\" (UniqueName: \"kubernetes.io/secret/83701ed7-4bc7-455c-a179-b460d641b3bf-v4-0-config-system-ocp-branding-template\") pod \"oauth-openshift-66458b6674-fvnvr\" (UID: \"83701ed7-4bc7-455c-a179-b460d641b3bf\") " pod="openshift-authentication/oauth-openshift-66458b6674-fvnvr" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.735857 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmpfs\" (UniqueName: \"kubernetes.io/empty-dir/7f53cb77-0d21-4cd7-81c0-d003500184f1-tmpfs\") pod \"catalog-operator-75ff9f647d-x5d5w\" (UID: \"7f53cb77-0d21-4cd7-81c0-d003500184f1\") " pod="openshift-operator-lifecycle-manager/catalog-operator-75ff9f647d-x5d5w" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.735875 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"control-plane-machine-set-operator-tls\" (UniqueName: \"kubernetes.io/secret/3b41e06b-0932-41d2-947a-e38b1ff52ec3-control-plane-machine-set-operator-tls\") pod \"control-plane-machine-set-operator-75ffdb6fcd-htqkp\" (UID: \"3b41e06b-0932-41d2-947a-e38b1ff52ec3\") " pod="openshift-machine-api/control-plane-machine-set-operator-75ffdb6fcd-htqkp" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.735905 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rm4gf\" (UniqueName: \"kubernetes.io/projected/92936655-647a-450f-a122-ff876adae5d3-kube-api-access-rm4gf\") pod \"openshift-config-operator-5777786469-b8t64\" (UID: \"92936655-647a-450f-a122-ff876adae5d3\") " pod="openshift-config-operator/openshift-config-operator-5777786469-b8t64" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.735931 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/716f37d9-f29d-4bc1-87a1-94364fee0605-service-ca\") pod \"console-64d44f6ddf-4pm87\" (UID: \"716f37d9-f29d-4bc1-87a1-94364fee0605\") " pod="openshift-console/console-64d44f6ddf-4pm87" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.735946 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d9daa888-94fa-4afc-85a2-81b9dc9a5d3c-samples-operator-tls\") pod \"cluster-samples-operator-6b564684c8-8tt42\" (UID: \"d9daa888-94fa-4afc-85a2-81b9dc9a5d3c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6b564684c8-8tt42" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.735962 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-system-service-ca\" (UniqueName: \"kubernetes.io/configmap/83701ed7-4bc7-455c-a179-b460d641b3bf-v4-0-config-system-service-ca\") pod \"oauth-openshift-66458b6674-fvnvr\" (UID: \"83701ed7-4bc7-455c-a179-b460d641b3bf\") " pod="openshift-authentication/oauth-openshift-66458b6674-fvnvr" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.735988 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vd49s\" (UniqueName: \"kubernetes.io/projected/694287b7-37ad-49df-b06d-71eea425d072-kube-api-access-vd49s\") pod \"cluster-image-registry-operator-86c45576b9-bl65j\" (UID: \"694287b7-37ad-49df-b06d-71eea425d072\") " pod="openshift-image-registry/cluster-image-registry-operator-86c45576b9-bl65j" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.736003 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9v6n\" (UniqueName: \"kubernetes.io/projected/a0b763d7-65d4-41e1-9880-8f80e9686189-kube-api-access-f9v6n\") pod \"marketplace-operator-547dbd544d-gp852\" (UID: \"a0b763d7-65d4-41e1-9880-8f80e9686189\") " pod="openshift-marketplace/marketplace-operator-547dbd544d-gp852" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.736019 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqzxh\" (UniqueName: \"kubernetes.io/projected/5b94b756-5f20-4937-a8a7-11471f916640-kube-api-access-hqzxh\") pod \"router-default-68cf44c8b8-rsmpr\" (UID: \"5b94b756-5f20-4937-a8a7-11471f916640\") " pod="openshift-ingress/router-default-68cf44c8b8-rsmpr" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.736068 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89688\" (UniqueName: \"kubernetes.io/projected/7f53cb77-0d21-4cd7-81c0-d003500184f1-kube-api-access-89688\") pod \"catalog-operator-75ff9f647d-x5d5w\" (UID: \"7f53cb77-0d21-4cd7-81c0-d003500184f1\") " pod="openshift-operator-lifecycle-manager/catalog-operator-75ff9f647d-x5d5w" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.736084 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/716f37d9-f29d-4bc1-87a1-94364fee0605-console-oauth-config\") pod \"console-64d44f6ddf-4pm87\" (UID: \"716f37d9-f29d-4bc1-87a1-94364fee0605\") " pod="openshift-console/console-64d44f6ddf-4pm87" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.736155 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zb5ln\" (UniqueName: \"kubernetes.io/projected/4b360ef1-cdf6-4d35-9354-4fc46c0cc916-kube-api-access-zb5ln\") pod \"openshift-apiserver-operator-846cbfc458-rjvhc\" (UID: \"4b360ef1-cdf6-4d35-9354-4fc46c0cc916\") " pod="openshift-apiserver-operator/openshift-apiserver-operator-846cbfc458-rjvhc" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.736176 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/96908d53-e612-462c-b9d5-2f10f220508b-kube-api-access\") pod \"openshift-kube-scheduler-operator-54f497555d-sz9k8\" (UID: \"96908d53-e612-462c-b9d5-2f10f220508b\") " pod="openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-54f497555d-sz9k8" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.736209 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rs7v2\" (UniqueName: \"kubernetes.io/projected/fce4951f-be1c-4a0b-a8f8-0111e10df5da-kube-api-access-rs7v2\") pod \"migrator-866fcbc849-btql4\" (UID: \"fce4951f-be1c-4a0b-a8f8-0111e10df5da\") " pod="openshift-kube-storage-version-migrator/migrator-866fcbc849-btql4" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.736258 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/96908d53-e612-462c-b9d5-2f10f220508b-config\") pod \"openshift-kube-scheduler-operator-54f497555d-sz9k8\" (UID: \"96908d53-e612-462c-b9d5-2f10f220508b\") " pod="openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-54f497555d-sz9k8" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.736292 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-operator-tls\" (UniqueName: \"kubernetes.io/secret/694287b7-37ad-49df-b06d-71eea425d072-image-registry-operator-tls\") pod \"cluster-image-registry-operator-86c45576b9-bl65j\" (UID: \"694287b7-37ad-49df-b06d-71eea425d072\") " pod="openshift-image-registry/cluster-image-registry-operator-86c45576b9-bl65j" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.736344 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f66781c9-aef5-4298-9f8a-b7f217906ed7-config\") pod \"controller-manager-65b6cccf98-pbcg9\" (UID: \"f66781c9-aef5-4298-9f8a-b7f217906ed7\") " pod="openshift-controller-manager/controller-manager-65b6cccf98-pbcg9" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.736360 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"srv-cert\" (UniqueName: \"kubernetes.io/secret/7f53cb77-0d21-4cd7-81c0-d003500184f1-srv-cert\") pod \"catalog-operator-75ff9f647d-x5d5w\" (UID: \"7f53cb77-0d21-4cd7-81c0-d003500184f1\") " pod="openshift-operator-lifecycle-manager/catalog-operator-75ff9f647d-x5d5w" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.736375 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d76e98d2-9b74-4e20-9b51-60099ccf5d9c-config\") pod \"kube-storage-version-migrator-operator-565b79b866-2n6k5\" (UID: \"d76e98d2-9b74-4e20-9b51-60099ccf5d9c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565b79b866-2n6k5" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.736414 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1e9a53b6-6bbb-4477-af7b-3d98acfc8f1d-tmp\") pod \"openshift-controller-manager-operator-686468bdd5-vrbxt\" (UID: \"1e9a53b6-6bbb-4477-af7b-3d98acfc8f1d\") " pod="openshift-controller-manager-operator/openshift-controller-manager-operator-686468bdd5-vrbxt" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.736430 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f66781c9-aef5-4298-9f8a-b7f217906ed7-tmp\") pod \"controller-manager-65b6cccf98-pbcg9\" (UID: \"f66781c9-aef5-4298-9f8a-b7f217906ed7\") " pod="openshift-controller-manager/controller-manager-65b6cccf98-pbcg9" Mar 16 15:33:37 crc kubenswrapper[5120]: E0316 15:33:37.736534 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 15:33:38.236511025 +0000 UTC m=+120.390442682 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.744233 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns-operator/dns-operator-799b87ffcd-8kwxr" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.747462 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6a9ae5f6-97bd-46ac-bafa-ca1b4452a141-networking-console-plugin-cert\") pod \"networking-console-plugin-5ff7774fd9-nljh6\" (UID: \"6a9ae5f6-97bd-46ac-bafa-ca1b4452a141\") " pod="openshift-network-console/networking-console-plugin-5ff7774fd9-nljh6" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.750105 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.766080 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-oauth-apiserver/apiserver-8596bd845d-jb8bk" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.768987 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-etcd-operator/etcd-operator-69b85846b6-s4s6j" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.773130 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.773488 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver-operator/kube-apiserver-operator-575994946d-mdbz9" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.779181 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-operator/ingress-operator-6b9cb4dbcf-pdp25" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.781712 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwt8b\" (UniqueName: \"kubernetes.io/projected/17b87002-b798-480a-8e17-83053d698239-kube-api-access-gwt8b\") pod \"network-check-target-fhkjl\" (UID: \"17b87002-b798-480a-8e17-83053d698239\") " pod="openshift-network-diagnostics/network-check-target-fhkjl" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.782292 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7w75\" (UniqueName: \"kubernetes.io/projected/f863fff9-286a-45fa-b8f0-8a86994b8440-kube-api-access-l7w75\") pod \"network-check-source-5bb8f5cd97-xdvz5\" (UID: \"f863fff9-286a-45fa-b8f0-8a86994b8440\") " pod="openshift-network-diagnostics/network-check-source-5bb8f5cd97-xdvz5" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.798413 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-t8n29\"" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.805974 5120 ???:1] "http: TLS handshake error from 192.168.126.11:57362: no serving certificate available for the kubelet" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.809947 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.814808 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4464728a-4869-4476-83de-cb34577ace7f-metrics-certs\") pod \"network-metrics-daemon-xr8r2\" (UID: \"4464728a-4869-4476-83de-cb34577ace7f\") " pod="openshift-multus/network-metrics-daemon-xr8r2" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.837615 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2b3d1db6-fcdf-4574-9e43-093e46cc3e0d-config-volume\") pod \"dns-default-9x6jk\" (UID: \"2b3d1db6-fcdf-4574-9e43-093e46cc3e0d\") " pod="openshift-dns/dns-default-9x6jk" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.837654 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/96908d53-e612-462c-b9d5-2f10f220508b-config\") pod \"openshift-kube-scheduler-operator-54f497555d-sz9k8\" (UID: \"96908d53-e612-462c-b9d5-2f10f220508b\") " pod="openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-54f497555d-sz9k8" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.837676 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-operator-tls\" (UniqueName: \"kubernetes.io/secret/694287b7-37ad-49df-b06d-71eea425d072-image-registry-operator-tls\") pod \"cluster-image-registry-operator-86c45576b9-bl65j\" (UID: \"694287b7-37ad-49df-b06d-71eea425d072\") " pod="openshift-image-registry/cluster-image-registry-operator-86c45576b9-bl65j" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.837697 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f66781c9-aef5-4298-9f8a-b7f217906ed7-config\") pod \"controller-manager-65b6cccf98-pbcg9\" (UID: \"f66781c9-aef5-4298-9f8a-b7f217906ed7\") " pod="openshift-controller-manager/controller-manager-65b6cccf98-pbcg9" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.837713 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"profile-collector-cert\" (UniqueName: \"kubernetes.io/secret/312c6c51-28c3-4d23-aa61-e01c5f36e0c9-profile-collector-cert\") pod \"olm-operator-5cdf44d969-chq5d\" (UID: \"312c6c51-28c3-4d23-aa61-e01c5f36e0c9\") " pod="openshift-operator-lifecycle-manager/olm-operator-5cdf44d969-chq5d" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.837728 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certs\" (UniqueName: \"kubernetes.io/secret/273dfc12-0182-4c0a-aa12-ab20f5c251cb-certs\") pod \"machine-config-server-cgkjl\" (UID: \"273dfc12-0182-4c0a-aa12-ab20f5c251cb\") " pod="openshift-machine-config-operator/machine-config-server-cgkjl" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.837745 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znjq8\" (UniqueName: \"kubernetes.io/projected/273dfc12-0182-4c0a-aa12-ab20f5c251cb-kube-api-access-znjq8\") pod \"machine-config-server-cgkjl\" (UID: \"273dfc12-0182-4c0a-aa12-ab20f5c251cb\") " pod="openshift-machine-config-operator/machine-config-server-cgkjl" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.837826 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"srv-cert\" (UniqueName: \"kubernetes.io/secret/7f53cb77-0d21-4cd7-81c0-d003500184f1-srv-cert\") pod \"catalog-operator-75ff9f647d-x5d5w\" (UID: \"7f53cb77-0d21-4cd7-81c0-d003500184f1\") " pod="openshift-operator-lifecycle-manager/catalog-operator-75ff9f647d-x5d5w" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.837845 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d76e98d2-9b74-4e20-9b51-60099ccf5d9c-config\") pod \"kube-storage-version-migrator-operator-565b79b866-2n6k5\" (UID: \"d76e98d2-9b74-4e20-9b51-60099ccf5d9c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565b79b866-2n6k5" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.837863 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1e9a53b6-6bbb-4477-af7b-3d98acfc8f1d-tmp\") pod \"openshift-controller-manager-operator-686468bdd5-vrbxt\" (UID: \"1e9a53b6-6bbb-4477-af7b-3d98acfc8f1d\") " pod="openshift-controller-manager-operator/openshift-controller-manager-operator-686468bdd5-vrbxt" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.837891 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f66781c9-aef5-4298-9f8a-b7f217906ed7-tmp\") pod \"controller-manager-65b6cccf98-pbcg9\" (UID: \"f66781c9-aef5-4298-9f8a-b7f217906ed7\") " pod="openshift-controller-manager/controller-manager-65b6cccf98-pbcg9" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.837907 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/716f37d9-f29d-4bc1-87a1-94364fee0605-oauth-serving-cert\") pod \"console-64d44f6ddf-4pm87\" (UID: \"716f37d9-f29d-4bc1-87a1-94364fee0605\") " pod="openshift-console/console-64d44f6ddf-4pm87" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.837923 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftl7r\" (UniqueName: \"kubernetes.io/projected/13808f6a-ec1e-4977-91af-50af631b3ef4-kube-api-access-ftl7r\") pod \"packageserver-7d4fc7d867-bzv6d\" (UID: \"13808f6a-ec1e-4977-91af-50af631b3ef4\") " pod="openshift-operator-lifecycle-manager/packageserver-7d4fc7d867-bzv6d" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.837939 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/f66781c9-aef5-4298-9f8a-b7f217906ed7-proxy-ca-bundles\") pod \"controller-manager-65b6cccf98-pbcg9\" (UID: \"f66781c9-aef5-4298-9f8a-b7f217906ed7\") " pod="openshift-controller-manager/controller-manager-65b6cccf98-pbcg9" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.837957 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rlzcx\" (UniqueName: \"kubernetes.io/projected/2b813265-fb01-4449-804c-7cae0739518d-kube-api-access-rlzcx\") pod \"machine-config-controller-f9cdd68f7-ljkbj\" (UID: \"2b813265-fb01-4449-804c-7cae0739518d\") " pod="openshift-machine-config-operator/machine-config-controller-f9cdd68f7-ljkbj" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.837972 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"v4-0-config-system-serving-cert\" (UniqueName: \"kubernetes.io/secret/83701ed7-4bc7-455c-a179-b460d641b3bf-v4-0-config-system-serving-cert\") pod \"oauth-openshift-66458b6674-fvnvr\" (UID: \"83701ed7-4bc7-455c-a179-b460d641b3bf\") " pod="openshift-authentication/oauth-openshift-66458b6674-fvnvr" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.837987 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"srv-cert\" (UniqueName: \"kubernetes.io/secret/312c6c51-28c3-4d23-aa61-e01c5f36e0c9-srv-cert\") pod \"olm-operator-5cdf44d969-chq5d\" (UID: \"312c6c51-28c3-4d23-aa61-e01c5f36e0c9\") " pod="openshift-operator-lifecycle-manager/olm-operator-5cdf44d969-chq5d" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.838007 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"available-featuregates\" (UniqueName: \"kubernetes.io/empty-dir/92936655-647a-450f-a122-ff876adae5d3-available-featuregates\") pod \"openshift-config-operator-5777786469-b8t64\" (UID: \"92936655-647a-450f-a122-ff876adae5d3\") " pod="openshift-config-operator/openshift-config-operator-5777786469-b8t64" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.838032 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d8d90bff-3ac2-4cff-aaa4-7072a4811400-proxy-tls\") pod \"machine-config-operator-67c9d58cbb-wmklh\" (UID: \"d8d90bff-3ac2-4cff-aaa4-7072a4811400\") " pod="openshift-machine-config-operator/machine-config-operator-67c9d58cbb-wmklh" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.838046 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ncgnt\" (UniqueName: \"kubernetes.io/projected/2b3d1db6-fcdf-4574-9e43-093e46cc3e0d-kube-api-access-ncgnt\") pod \"dns-default-9x6jk\" (UID: \"2b3d1db6-fcdf-4574-9e43-093e46cc3e0d\") " pod="openshift-dns/dns-default-9x6jk" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.838060 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmpfs\" (UniqueName: \"kubernetes.io/empty-dir/13808f6a-ec1e-4977-91af-50af631b3ef4-tmpfs\") pod \"packageserver-7d4fc7d867-bzv6d\" (UID: \"13808f6a-ec1e-4977-91af-50af631b3ef4\") " pod="openshift-operator-lifecycle-manager/packageserver-7d4fc7d867-bzv6d" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.838079 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted-pem\" (UniqueName: \"kubernetes.io/empty-dir/694287b7-37ad-49df-b06d-71eea425d072-ca-trust-extracted-pem\") pod \"cluster-image-registry-operator-86c45576b9-bl65j\" (UID: \"694287b7-37ad-49df-b06d-71eea425d072\") " pod="openshift-image-registry/cluster-image-registry-operator-86c45576b9-bl65j" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.838095 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5fl25\" (UniqueName: \"kubernetes.io/projected/d9daa888-94fa-4afc-85a2-81b9dc9a5d3c-kube-api-access-5fl25\") pod \"cluster-samples-operator-6b564684c8-8tt42\" (UID: \"d9daa888-94fa-4afc-85a2-81b9dc9a5d3c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6b564684c8-8tt42" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.838112 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"v4-0-config-user-template-error\" (UniqueName: \"kubernetes.io/secret/83701ed7-4bc7-455c-a179-b460d641b3bf-v4-0-config-user-template-error\") pod \"oauth-openshift-66458b6674-fvnvr\" (UID: \"83701ed7-4bc7-455c-a179-b460d641b3bf\") " pod="openshift-authentication/oauth-openshift-66458b6674-fvnvr" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.838131 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-bootstrap-token\" (UniqueName: \"kubernetes.io/secret/273dfc12-0182-4c0a-aa12-ab20f5c251cb-node-bootstrap-token\") pod \"machine-config-server-cgkjl\" (UID: \"273dfc12-0182-4c0a-aa12-ab20f5c251cb\") " pod="openshift-machine-config-operator/machine-config-server-cgkjl" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.838159 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tgmmk\" (UniqueName: \"kubernetes.io/projected/b064c090-1362-427c-b805-d2808c01b58c-kube-api-access-tgmmk\") pod \"downloads-747b44746d-pjv44\" (UID: \"b064c090-1362-427c-b805-d2808c01b58c\") " pod="openshift-console/downloads-747b44746d-pjv44" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.838176 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"images\" (UniqueName: \"kubernetes.io/configmap/d8d90bff-3ac2-4cff-aaa4-7072a4811400-images\") pod \"machine-config-operator-67c9d58cbb-wmklh\" (UID: \"d8d90bff-3ac2-4cff-aaa4-7072a4811400\") " pod="openshift-machine-config-operator/machine-config-operator-67c9d58cbb-wmklh" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.838193 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-22znc\" (UniqueName: \"kubernetes.io/projected/d8d90bff-3ac2-4cff-aaa4-7072a4811400-kube-api-access-22znc\") pod \"machine-config-operator-67c9d58cbb-wmklh\" (UID: \"d8d90bff-3ac2-4cff-aaa4-7072a4811400\") " pod="openshift-machine-config-operator/machine-config-operator-67c9d58cbb-wmklh" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.838208 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/96908d53-e612-462c-b9d5-2f10f220508b-tmp\") pod \"openshift-kube-scheduler-operator-54f497555d-sz9k8\" (UID: \"96908d53-e612-462c-b9d5-2f10f220508b\") " pod="openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-54f497555d-sz9k8" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.838225 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"package-server-manager-serving-cert\" (UniqueName: \"kubernetes.io/secret/042810cc-b42e-4229-9c69-ab3eb1baab28-package-server-manager-serving-cert\") pod \"package-server-manager-77f986bd66-wknnz\" (UID: \"042810cc-b42e-4229-9c69-ab3eb1baab28\") " pod="openshift-operator-lifecycle-manager/package-server-manager-77f986bd66-wknnz" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.838243 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fdn8d\" (UniqueName: \"kubernetes.io/projected/f66781c9-aef5-4298-9f8a-b7f217906ed7-kube-api-access-fdn8d\") pod \"controller-manager-65b6cccf98-pbcg9\" (UID: \"f66781c9-aef5-4298-9f8a-b7f217906ed7\") " pod="openshift-controller-manager/controller-manager-65b6cccf98-pbcg9" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.838259 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"v4-0-config-user-template-provider-selection\" (UniqueName: \"kubernetes.io/secret/83701ed7-4bc7-455c-a179-b460d641b3bf-v4-0-config-user-template-provider-selection\") pod \"oauth-openshift-66458b6674-fvnvr\" (UID: \"83701ed7-4bc7-455c-a179-b460d641b3bf\") " pod="openshift-authentication/oauth-openshift-66458b6674-fvnvr" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.838274 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/d8d90bff-3ac2-4cff-aaa4-7072a4811400-auth-proxy-config\") pod \"machine-config-operator-67c9d58cbb-wmklh\" (UID: \"d8d90bff-3ac2-4cff-aaa4-7072a4811400\") " pod="openshift-machine-config-operator/machine-config-operator-67c9d58cbb-wmklh" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.838290 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"csi-data-dir\" (UniqueName: \"kubernetes.io/host-path/9293198c-313b-43df-bd83-75eb148a1c77-csi-data-dir\") pod \"csi-hostpathplugin-sqjrv\" (UID: \"9293198c-313b-43df-bd83-75eb148a1c77\") " pod="hostpath-provisioner/csi-hostpathplugin-sqjrv" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.838315 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b94b756-5f20-4937-a8a7-11471f916640-metrics-certs\") pod \"router-default-68cf44c8b8-rsmpr\" (UID: \"5b94b756-5f20-4937-a8a7-11471f916640\") " pod="openshift-ingress/router-default-68cf44c8b8-rsmpr" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.838331 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/694287b7-37ad-49df-b06d-71eea425d072-tmp\") pod \"cluster-image-registry-operator-86c45576b9-bl65j\" (UID: \"694287b7-37ad-49df-b06d-71eea425d072\") " pod="openshift-image-registry/cluster-image-registry-operator-86c45576b9-bl65j" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.838346 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a0b763d7-65d4-41e1-9880-8f80e9686189-tmp\") pod \"marketplace-operator-547dbd544d-gp852\" (UID: \"a0b763d7-65d4-41e1-9880-8f80e9686189\") " pod="openshift-marketplace/marketplace-operator-547dbd544d-gp852" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.838362 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9zpmn\" (UniqueName: \"kubernetes.io/projected/3b41e06b-0932-41d2-947a-e38b1ff52ec3-kube-api-access-9zpmn\") pod \"control-plane-machine-set-operator-75ffdb6fcd-htqkp\" (UID: \"3b41e06b-0932-41d2-947a-e38b1ff52ec3\") " pod="openshift-machine-api/control-plane-machine-set-operator-75ffdb6fcd-htqkp" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.838378 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4b360ef1-cdf6-4d35-9354-4fc46c0cc916-serving-cert\") pod \"openshift-apiserver-operator-846cbfc458-rjvhc\" (UID: \"4b360ef1-cdf6-4d35-9354-4fc46c0cc916\") " pod="openshift-apiserver-operator/openshift-apiserver-operator-846cbfc458-rjvhc" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.838394 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-dir\" (UniqueName: \"kubernetes.io/host-path/9293198c-313b-43df-bd83-75eb148a1c77-plugins-dir\") pod \"csi-hostpathplugin-sqjrv\" (UID: \"9293198c-313b-43df-bd83-75eb148a1c77\") " pod="hostpath-provisioner/csi-hostpathplugin-sqjrv" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.838412 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/716f37d9-f29d-4bc1-87a1-94364fee0605-console-serving-cert\") pod \"console-64d44f6ddf-4pm87\" (UID: \"716f37d9-f29d-4bc1-87a1-94364fee0605\") " pod="openshift-console/console-64d44f6ddf-4pm87" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.838428 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-certs\" (UniqueName: \"kubernetes.io/secret/52bf262d-dc00-4318-af10-68291a53ce29-webhook-certs\") pod \"multus-admission-controller-69db94689b-6bcfh\" (UID: \"52bf262d-dc00-4318-af10-68291a53ce29\") " pod="openshift-multus/multus-admission-controller-69db94689b-6bcfh" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.838444 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7prtv\" (UniqueName: \"kubernetes.io/projected/deae033b-c4b8-462c-b29b-5115eb40a94b-kube-api-access-7prtv\") pod \"collect-profiles-29561250-7npz6\" (UID: \"deae033b-c4b8-462c-b29b-5115eb40a94b\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561250-7npz6" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.838461 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v79qt\" (UniqueName: \"kubernetes.io/projected/1e9a53b6-6bbb-4477-af7b-3d98acfc8f1d-kube-api-access-v79qt\") pod \"openshift-controller-manager-operator-686468bdd5-vrbxt\" (UID: \"1e9a53b6-6bbb-4477-af7b-3d98acfc8f1d\") " pod="openshift-controller-manager-operator/openshift-controller-manager-operator-686468bdd5-vrbxt" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.838476 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"v4-0-config-user-idp-0-file-data\" (UniqueName: \"kubernetes.io/secret/83701ed7-4bc7-455c-a179-b460d641b3bf-v4-0-config-user-idp-0-file-data\") pod \"oauth-openshift-66458b6674-fvnvr\" (UID: \"83701ed7-4bc7-455c-a179-b460d641b3bf\") " pod="openshift-authentication/oauth-openshift-66458b6674-fvnvr" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.838493 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/96908d53-e612-462c-b9d5-2f10f220508b-serving-cert\") pod \"openshift-kube-scheduler-operator-54f497555d-sz9k8\" (UID: \"96908d53-e612-462c-b9d5-2f10f220508b\") " pod="openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-54f497555d-sz9k8" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.838509 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9293198c-313b-43df-bd83-75eb148a1c77-socket-dir\") pod \"csi-hostpathplugin-sqjrv\" (UID: \"9293198c-313b-43df-bd83-75eb148a1c77\") " pod="hostpath-provisioner/csi-hostpathplugin-sqjrv" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.838536 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ready\" (UniqueName: \"kubernetes.io/empty-dir/6f966d74-f323-4f45-9fbb-8160d73b7770-ready\") pod \"cni-sysctl-allowlist-ds-95s4s\" (UID: \"6f966d74-f323-4f45-9fbb-8160d73b7770\") " pod="openshift-multus/cni-sysctl-allowlist-ds-95s4s" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.838553 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4b360ef1-cdf6-4d35-9354-4fc46c0cc916-config\") pod \"openshift-apiserver-operator-846cbfc458-rjvhc\" (UID: \"4b360ef1-cdf6-4d35-9354-4fc46c0cc916\") " pod="openshift-apiserver-operator/openshift-apiserver-operator-846cbfc458-rjvhc" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.838568 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7w9wk\" (UniqueName: \"kubernetes.io/projected/52bf262d-dc00-4318-af10-68291a53ce29-kube-api-access-7w9wk\") pod \"multus-admission-controller-69db94689b-6bcfh\" (UID: \"52bf262d-dc00-4318-af10-68291a53ce29\") " pod="openshift-multus/multus-admission-controller-69db94689b-6bcfh" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.838588 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b94b756-5f20-4937-a8a7-11471f916640-service-ca-bundle\") pod \"router-default-68cf44c8b8-rsmpr\" (UID: \"5b94b756-5f20-4937-a8a7-11471f916640\") " pod="openshift-ingress/router-default-68cf44c8b8-rsmpr" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.838605 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"marketplace-operator-metrics\" (UniqueName: \"kubernetes.io/secret/a0b763d7-65d4-41e1-9880-8f80e9686189-marketplace-operator-metrics\") pod \"marketplace-operator-547dbd544d-gp852\" (UID: \"a0b763d7-65d4-41e1-9880-8f80e9686189\") " pod="openshift-marketplace/marketplace-operator-547dbd544d-gp852" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.838623 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jjlg7\" (UniqueName: \"kubernetes.io/projected/716f37d9-f29d-4bc1-87a1-94364fee0605-kube-api-access-jjlg7\") pod \"console-64d44f6ddf-4pm87\" (UID: \"716f37d9-f29d-4bc1-87a1-94364fee0605\") " pod="openshift-console/console-64d44f6ddf-4pm87" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.838639 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/2b813265-fb01-4449-804c-7cae0739518d-proxy-tls\") pod \"machine-config-controller-f9cdd68f7-ljkbj\" (UID: \"2b813265-fb01-4449-804c-7cae0739518d\") " pod="openshift-machine-config-operator/machine-config-controller-f9cdd68f7-ljkbj" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.838653 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26887\" (UniqueName: \"kubernetes.io/projected/9293198c-313b-43df-bd83-75eb148a1c77-kube-api-access-26887\") pod \"csi-hostpathplugin-sqjrv\" (UID: \"9293198c-313b-43df-bd83-75eb148a1c77\") " pod="hostpath-provisioner/csi-hostpathplugin-sqjrv" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.838669 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a789838a-6c8b-4672-a5d7-decb77a7e217-cert\") pod \"ingress-canary-c58l9\" (UID: \"a789838a-6c8b-4672-a5d7-decb77a7e217\") " pod="openshift-ingress-canary/ingress-canary-c58l9" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.838683 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6f966d74-f323-4f45-9fbb-8160d73b7770-cni-sysctl-allowlist\") pod \"cni-sysctl-allowlist-ds-95s4s\" (UID: \"6f966d74-f323-4f45-9fbb-8160d73b7770\") " pod="openshift-multus/cni-sysctl-allowlist-ds-95s4s" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.838714 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jn8mx\" (UniqueName: \"kubernetes.io/projected/6f966d74-f323-4f45-9fbb-8160d73b7770-kube-api-access-jn8mx\") pod \"cni-sysctl-allowlist-ds-95s4s\" (UID: \"6f966d74-f323-4f45-9fbb-8160d73b7770\") " pod="openshift-multus/cni-sysctl-allowlist-ds-95s4s" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.838733 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"mcc-auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/2b813265-fb01-4449-804c-7cae0739518d-mcc-auth-proxy-config\") pod \"machine-config-controller-f9cdd68f7-ljkbj\" (UID: \"2b813265-fb01-4449-804c-7cae0739518d\") " pod="openshift-machine-config-operator/machine-config-controller-f9cdd68f7-ljkbj" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.838749 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/5b94b756-5f20-4937-a8a7-11471f916640-default-certificate\") pod \"router-default-68cf44c8b8-rsmpr\" (UID: \"5b94b756-5f20-4937-a8a7-11471f916640\") " pod="openshift-ingress/router-default-68cf44c8b8-rsmpr" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.838784 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1e9a53b6-6bbb-4477-af7b-3d98acfc8f1d-config\") pod \"openshift-controller-manager-operator-686468bdd5-vrbxt\" (UID: \"1e9a53b6-6bbb-4477-af7b-3d98acfc8f1d\") " pod="openshift-controller-manager-operator/openshift-controller-manager-operator-686468bdd5-vrbxt" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.838801 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"v4-0-config-system-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83701ed7-4bc7-455c-a179-b460d641b3bf-v4-0-config-system-trusted-ca-bundle\") pod \"oauth-openshift-66458b6674-fvnvr\" (UID: \"83701ed7-4bc7-455c-a179-b460d641b3bf\") " pod="openshift-authentication/oauth-openshift-66458b6674-fvnvr" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.838817 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/694287b7-37ad-49df-b06d-71eea425d072-bound-sa-token\") pod \"cluster-image-registry-operator-86c45576b9-bl65j\" (UID: \"694287b7-37ad-49df-b06d-71eea425d072\") " pod="openshift-image-registry/cluster-image-registry-operator-86c45576b9-bl65j" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.838834 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vww8n\" (UniqueName: \"kubernetes.io/projected/d76e98d2-9b74-4e20-9b51-60099ccf5d9c-kube-api-access-vww8n\") pod \"kube-storage-version-migrator-operator-565b79b866-2n6k5\" (UID: \"d76e98d2-9b74-4e20-9b51-60099ccf5d9c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565b79b866-2n6k5" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.838852 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"v4-0-config-system-cliconfig\" (UniqueName: \"kubernetes.io/configmap/83701ed7-4bc7-455c-a179-b460d641b3bf-v4-0-config-system-cliconfig\") pod \"oauth-openshift-66458b6674-fvnvr\" (UID: \"83701ed7-4bc7-455c-a179-b460d641b3bf\") " pod="openshift-authentication/oauth-openshift-66458b6674-fvnvr" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.838871 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"marketplace-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a0b763d7-65d4-41e1-9880-8f80e9686189-marketplace-trusted-ca\") pod \"marketplace-operator-547dbd544d-gp852\" (UID: \"a0b763d7-65d4-41e1-9880-8f80e9686189\") " pod="openshift-marketplace/marketplace-operator-547dbd544d-gp852" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.839064 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d76e98d2-9b74-4e20-9b51-60099ccf5d9c-serving-cert\") pod \"kube-storage-version-migrator-operator-565b79b866-2n6k5\" (UID: \"d76e98d2-9b74-4e20-9b51-60099ccf5d9c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565b79b866-2n6k5" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.839103 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/83701ed7-4bc7-455c-a179-b460d641b3bf-audit-dir\") pod \"oauth-openshift-66458b6674-fvnvr\" (UID: \"83701ed7-4bc7-455c-a179-b460d641b3bf\") " pod="openshift-authentication/oauth-openshift-66458b6674-fvnvr" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.839132 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/50822c67-9654-449a-869f-cf28fb1fff4d-serving-cert\") pod \"kube-controller-manager-operator-69d5f845f8-6nn27\" (UID: \"50822c67-9654-449a-869f-cf28fb1fff4d\") " pod="openshift-kube-controller-manager-operator/kube-controller-manager-operator-69d5f845f8-6nn27" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.839150 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/92936655-647a-450f-a122-ff876adae5d3-serving-cert\") pod \"openshift-config-operator-5777786469-b8t64\" (UID: \"92936655-647a-450f-a122-ff876adae5d3\") " pod="openshift-config-operator/openshift-config-operator-5777786469-b8t64" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.839172 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/deae033b-c4b8-462c-b29b-5115eb40a94b-config-volume\") pod \"collect-profiles-29561250-7npz6\" (UID: \"deae033b-c4b8-462c-b29b-5115eb40a94b\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561250-7npz6" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.839197 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"profile-collector-cert\" (UniqueName: \"kubernetes.io/secret/7f53cb77-0d21-4cd7-81c0-d003500184f1-profile-collector-cert\") pod \"catalog-operator-75ff9f647d-x5d5w\" (UID: \"7f53cb77-0d21-4cd7-81c0-d003500184f1\") " pod="openshift-operator-lifecycle-manager/catalog-operator-75ff9f647d-x5d5w" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.839219 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/716f37d9-f29d-4bc1-87a1-94364fee0605-console-config\") pod \"console-64d44f6ddf-4pm87\" (UID: \"716f37d9-f29d-4bc1-87a1-94364fee0605\") " pod="openshift-console/console-64d44f6ddf-4pm87" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.839235 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rd2qh\" (UniqueName: \"kubernetes.io/projected/fc938b44-173b-4a97-b756-31525f6878f4-kube-api-access-rd2qh\") pod \"service-ca-74545575db-s2zdg\" (UID: \"fc938b44-173b-4a97-b756-31525f6878f4\") " pod="openshift-service-ca/service-ca-74545575db-s2zdg" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.839278 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"v4-0-config-system-session\" (UniqueName: \"kubernetes.io/secret/83701ed7-4bc7-455c-a179-b460d641b3bf-v4-0-config-system-session\") pod \"oauth-openshift-66458b6674-fvnvr\" (UID: \"83701ed7-4bc7-455c-a179-b460d641b3bf\") " pod="openshift-authentication/oauth-openshift-66458b6674-fvnvr" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.839296 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b3d1db6-fcdf-4574-9e43-093e46cc3e0d-tmp-dir\") pod \"dns-default-9x6jk\" (UID: \"2b3d1db6-fcdf-4574-9e43-093e46cc3e0d\") " pod="openshift-dns/dns-default-9x6jk" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.839316 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9s7z5\" (UniqueName: \"kubernetes.io/projected/83701ed7-4bc7-455c-a179-b460d641b3bf-kube-api-access-9s7z5\") pod \"oauth-openshift-66458b6674-fvnvr\" (UID: \"83701ed7-4bc7-455c-a179-b460d641b3bf\") " pod="openshift-authentication/oauth-openshift-66458b6674-fvnvr" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.839332 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9293198c-313b-43df-bd83-75eb148a1c77-registration-dir\") pod \"csi-hostpathplugin-sqjrv\" (UID: \"9293198c-313b-43df-bd83-75eb148a1c77\") " pod="hostpath-provisioner/csi-hostpathplugin-sqjrv" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.839348 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/13808f6a-ec1e-4977-91af-50af631b3ef4-apiservice-cert\") pod \"packageserver-7d4fc7d867-bzv6d\" (UID: \"13808f6a-ec1e-4977-91af-50af631b3ef4\") " pod="openshift-operator-lifecycle-manager/packageserver-7d4fc7d867-bzv6d" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.839381 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6f966d74-f323-4f45-9fbb-8160d73b7770-tuning-conf-dir\") pod \"cni-sysctl-allowlist-ds-95s4s\" (UID: \"6f966d74-f323-4f45-9fbb-8160d73b7770\") " pod="openshift-multus/cni-sysctl-allowlist-ds-95s4s" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.839413 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/716f37d9-f29d-4bc1-87a1-94364fee0605-trusted-ca-bundle\") pod \"console-64d44f6ddf-4pm87\" (UID: \"716f37d9-f29d-4bc1-87a1-94364fee0605\") " pod="openshift-console/console-64d44f6ddf-4pm87" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.839436 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/5b94b756-5f20-4937-a8a7-11471f916640-stats-auth\") pod \"router-default-68cf44c8b8-rsmpr\" (UID: \"5b94b756-5f20-4937-a8a7-11471f916640\") " pod="openshift-ingress/router-default-68cf44c8b8-rsmpr" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.839454 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"v4-0-config-user-template-login\" (UniqueName: \"kubernetes.io/secret/83701ed7-4bc7-455c-a179-b460d641b3bf-v4-0-config-user-template-login\") pod \"oauth-openshift-66458b6674-fvnvr\" (UID: \"83701ed7-4bc7-455c-a179-b460d641b3bf\") " pod="openshift-authentication/oauth-openshift-66458b6674-fvnvr" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.839470 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"mountpoint-dir\" (UniqueName: \"kubernetes.io/host-path/9293198c-313b-43df-bd83-75eb148a1c77-mountpoint-dir\") pod \"csi-hostpathplugin-sqjrv\" (UID: \"9293198c-313b-43df-bd83-75eb148a1c77\") " pod="hostpath-provisioner/csi-hostpathplugin-sqjrv" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.839485 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/deae033b-c4b8-462c-b29b-5115eb40a94b-secret-volume\") pod \"collect-profiles-29561250-7npz6\" (UID: \"deae033b-c4b8-462c-b29b-5115eb40a94b\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561250-7npz6" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.839500 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/768b8055-2c6c-42ba-b005-64fabfc45402-config\") pod \"service-ca-operator-5b9c976747-547pw\" (UID: \"768b8055-2c6c-42ba-b005-64fabfc45402\") " pod="openshift-service-ca-operator/service-ca-operator-5b9c976747-547pw" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.839523 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/50822c67-9654-449a-869f-cf28fb1fff4d-kube-api-access\") pod \"kube-controller-manager-operator-69d5f845f8-6nn27\" (UID: \"50822c67-9654-449a-869f-cf28fb1fff4d\") " pod="openshift-kube-controller-manager-operator/kube-controller-manager-operator-69d5f845f8-6nn27" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.839544 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/50822c67-9654-449a-869f-cf28fb1fff4d-config\") pod \"kube-controller-manager-operator-69d5f845f8-6nn27\" (UID: \"50822c67-9654-449a-869f-cf28fb1fff4d\") " pod="openshift-kube-controller-manager-operator/kube-controller-manager-operator-69d5f845f8-6nn27" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.839559 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"v4-0-config-system-router-certs\" (UniqueName: \"kubernetes.io/secret/83701ed7-4bc7-455c-a179-b460d641b3bf-v4-0-config-system-router-certs\") pod \"oauth-openshift-66458b6674-fvnvr\" (UID: \"83701ed7-4bc7-455c-a179-b460d641b3bf\") " pod="openshift-authentication/oauth-openshift-66458b6674-fvnvr" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.839576 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmnwg\" (UniqueName: \"kubernetes.io/projected/312c6c51-28c3-4d23-aa61-e01c5f36e0c9-kube-api-access-cmnwg\") pod \"olm-operator-5cdf44d969-chq5d\" (UID: \"312c6c51-28c3-4d23-aa61-e01c5f36e0c9\") " pod="openshift-operator-lifecycle-manager/olm-operator-5cdf44d969-chq5d" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.839599 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zzp5\" (UniqueName: \"kubernetes.io/projected/a789838a-6c8b-4672-a5d7-decb77a7e217-kube-api-access-6zzp5\") pod \"ingress-canary-c58l9\" (UID: \"a789838a-6c8b-4672-a5d7-decb77a7e217\") " pod="openshift-ingress-canary/ingress-canary-c58l9" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.839643 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f66781c9-aef5-4298-9f8a-b7f217906ed7-serving-cert\") pod \"controller-manager-65b6cccf98-pbcg9\" (UID: \"f66781c9-aef5-4298-9f8a-b7f217906ed7\") " pod="openshift-controller-manager/controller-manager-65b6cccf98-pbcg9" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.839662 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-policies\" (UniqueName: \"kubernetes.io/configmap/83701ed7-4bc7-455c-a179-b460d641b3bf-audit-policies\") pod \"oauth-openshift-66458b6674-fvnvr\" (UID: \"83701ed7-4bc7-455c-a179-b460d641b3bf\") " pod="openshift-authentication/oauth-openshift-66458b6674-fvnvr" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.839691 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1e9a53b6-6bbb-4477-af7b-3d98acfc8f1d-serving-cert\") pod \"openshift-controller-manager-operator-686468bdd5-vrbxt\" (UID: \"1e9a53b6-6bbb-4477-af7b-3d98acfc8f1d\") " pod="openshift-controller-manager-operator/openshift-controller-manager-operator-686468bdd5-vrbxt" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.839720 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/694287b7-37ad-49df-b06d-71eea425d072-trusted-ca\") pod \"cluster-image-registry-operator-86c45576b9-bl65j\" (UID: \"694287b7-37ad-49df-b06d-71eea425d072\") " pod="openshift-image-registry/cluster-image-registry-operator-86c45576b9-bl65j" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.839741 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/768b8055-2c6c-42ba-b005-64fabfc45402-serving-cert\") pod \"service-ca-operator-5b9c976747-547pw\" (UID: \"768b8055-2c6c-42ba-b005-64fabfc45402\") " pod="openshift-service-ca-operator/service-ca-operator-5b9c976747-547pw" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.839770 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbfmn\" (UniqueName: \"kubernetes.io/projected/768b8055-2c6c-42ba-b005-64fabfc45402-kube-api-access-nbfmn\") pod \"service-ca-operator-5b9c976747-547pw\" (UID: \"768b8055-2c6c-42ba-b005-64fabfc45402\") " pod="openshift-service-ca-operator/service-ca-operator-5b9c976747-547pw" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.839792 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/50822c67-9654-449a-869f-cf28fb1fff4d-tmp-dir\") pod \"kube-controller-manager-operator-69d5f845f8-6nn27\" (UID: \"50822c67-9654-449a-869f-cf28fb1fff4d\") " pod="openshift-kube-controller-manager-operator/kube-controller-manager-operator-69d5f845f8-6nn27" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.839813 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/f66781c9-aef5-4298-9f8a-b7f217906ed7-client-ca\") pod \"controller-manager-65b6cccf98-pbcg9\" (UID: \"f66781c9-aef5-4298-9f8a-b7f217906ed7\") " pod="openshift-controller-manager/controller-manager-65b6cccf98-pbcg9" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.839832 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"v4-0-config-system-ocp-branding-template\" (UniqueName: \"kubernetes.io/secret/83701ed7-4bc7-455c-a179-b460d641b3bf-v4-0-config-system-ocp-branding-template\") pod \"oauth-openshift-66458b6674-fvnvr\" (UID: \"83701ed7-4bc7-455c-a179-b460d641b3bf\") " pod="openshift-authentication/oauth-openshift-66458b6674-fvnvr" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.839958 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/fc938b44-173b-4a97-b756-31525f6878f4-signing-key\") pod \"service-ca-74545575db-s2zdg\" (UID: \"fc938b44-173b-4a97-b756-31525f6878f4\") " pod="openshift-service-ca/service-ca-74545575db-s2zdg" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.839991 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmpfs\" (UniqueName: \"kubernetes.io/empty-dir/7f53cb77-0d21-4cd7-81c0-d003500184f1-tmpfs\") pod \"catalog-operator-75ff9f647d-x5d5w\" (UID: \"7f53cb77-0d21-4cd7-81c0-d003500184f1\") " pod="openshift-operator-lifecycle-manager/catalog-operator-75ff9f647d-x5d5w" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.840009 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"control-plane-machine-set-operator-tls\" (UniqueName: \"kubernetes.io/secret/3b41e06b-0932-41d2-947a-e38b1ff52ec3-control-plane-machine-set-operator-tls\") pod \"control-plane-machine-set-operator-75ffdb6fcd-htqkp\" (UID: \"3b41e06b-0932-41d2-947a-e38b1ff52ec3\") " pod="openshift-machine-api/control-plane-machine-set-operator-75ffdb6fcd-htqkp" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.840067 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rm4gf\" (UniqueName: \"kubernetes.io/projected/92936655-647a-450f-a122-ff876adae5d3-kube-api-access-rm4gf\") pod \"openshift-config-operator-5777786469-b8t64\" (UID: \"92936655-647a-450f-a122-ff876adae5d3\") " pod="openshift-config-operator/openshift-config-operator-5777786469-b8t64" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.840088 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/716f37d9-f29d-4bc1-87a1-94364fee0605-service-ca\") pod \"console-64d44f6ddf-4pm87\" (UID: \"716f37d9-f29d-4bc1-87a1-94364fee0605\") " pod="openshift-console/console-64d44f6ddf-4pm87" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.840109 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d9daa888-94fa-4afc-85a2-81b9dc9a5d3c-samples-operator-tls\") pod \"cluster-samples-operator-6b564684c8-8tt42\" (UID: \"d9daa888-94fa-4afc-85a2-81b9dc9a5d3c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6b564684c8-8tt42" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.840126 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"v4-0-config-system-service-ca\" (UniqueName: \"kubernetes.io/configmap/83701ed7-4bc7-455c-a179-b460d641b3bf-v4-0-config-system-service-ca\") pod \"oauth-openshift-66458b6674-fvnvr\" (UID: \"83701ed7-4bc7-455c-a179-b460d641b3bf\") " pod="openshift-authentication/oauth-openshift-66458b6674-fvnvr" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.840147 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vd49s\" (UniqueName: \"kubernetes.io/projected/694287b7-37ad-49df-b06d-71eea425d072-kube-api-access-vd49s\") pod \"cluster-image-registry-operator-86c45576b9-bl65j\" (UID: \"694287b7-37ad-49df-b06d-71eea425d072\") " pod="openshift-image-registry/cluster-image-registry-operator-86c45576b9-bl65j" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.840164 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmpfs\" (UniqueName: \"kubernetes.io/empty-dir/312c6c51-28c3-4d23-aa61-e01c5f36e0c9-tmpfs\") pod \"olm-operator-5cdf44d969-chq5d\" (UID: \"312c6c51-28c3-4d23-aa61-e01c5f36e0c9\") " pod="openshift-operator-lifecycle-manager/olm-operator-5cdf44d969-chq5d" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.840188 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-66587d64c8-blgcz\" (UID: \"6528b019-774e-4298-abe6-69f062f0a13e\") " pod="openshift-image-registry/image-registry-66587d64c8-blgcz" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.841195 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"images\" (UniqueName: \"kubernetes.io/configmap/d8d90bff-3ac2-4cff-aaa4-7072a4811400-images\") pod \"machine-config-operator-67c9d58cbb-wmklh\" (UID: \"d8d90bff-3ac2-4cff-aaa4-7072a4811400\") " pod="openshift-machine-config-operator/machine-config-operator-67c9d58cbb-wmklh" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.841278 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/f66781c9-aef5-4298-9f8a-b7f217906ed7-proxy-ca-bundles\") pod \"controller-manager-65b6cccf98-pbcg9\" (UID: \"f66781c9-aef5-4298-9f8a-b7f217906ed7\") " pod="openshift-controller-manager/controller-manager-65b6cccf98-pbcg9" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.841586 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f9v6n\" (UniqueName: \"kubernetes.io/projected/a0b763d7-65d4-41e1-9880-8f80e9686189-kube-api-access-f9v6n\") pod \"marketplace-operator-547dbd544d-gp852\" (UID: \"a0b763d7-65d4-41e1-9880-8f80e9686189\") " pod="openshift-marketplace/marketplace-operator-547dbd544d-gp852" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.841611 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hqzxh\" (UniqueName: \"kubernetes.io/projected/5b94b756-5f20-4937-a8a7-11471f916640-kube-api-access-hqzxh\") pod \"router-default-68cf44c8b8-rsmpr\" (UID: \"5b94b756-5f20-4937-a8a7-11471f916640\") " pod="openshift-ingress/router-default-68cf44c8b8-rsmpr" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.841629 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/13808f6a-ec1e-4977-91af-50af631b3ef4-webhook-cert\") pod \"packageserver-7d4fc7d867-bzv6d\" (UID: \"13808f6a-ec1e-4977-91af-50af631b3ef4\") " pod="openshift-operator-lifecycle-manager/packageserver-7d4fc7d867-bzv6d" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.841611 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/83701ed7-4bc7-455c-a179-b460d641b3bf-audit-dir\") pod \"oauth-openshift-66458b6674-fvnvr\" (UID: \"83701ed7-4bc7-455c-a179-b460d641b3bf\") " pod="openshift-authentication/oauth-openshift-66458b6674-fvnvr" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.841662 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-89688\" (UniqueName: \"kubernetes.io/projected/7f53cb77-0d21-4cd7-81c0-d003500184f1-kube-api-access-89688\") pod \"catalog-operator-75ff9f647d-x5d5w\" (UID: \"7f53cb77-0d21-4cd7-81c0-d003500184f1\") " pod="openshift-operator-lifecycle-manager/catalog-operator-75ff9f647d-x5d5w" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.841681 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/716f37d9-f29d-4bc1-87a1-94364fee0605-console-oauth-config\") pod \"console-64d44f6ddf-4pm87\" (UID: \"716f37d9-f29d-4bc1-87a1-94364fee0605\") " pod="openshift-console/console-64d44f6ddf-4pm87" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.841704 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zb5ln\" (UniqueName: \"kubernetes.io/projected/4b360ef1-cdf6-4d35-9354-4fc46c0cc916-kube-api-access-zb5ln\") pod \"openshift-apiserver-operator-846cbfc458-rjvhc\" (UID: \"4b360ef1-cdf6-4d35-9354-4fc46c0cc916\") " pod="openshift-apiserver-operator/openshift-apiserver-operator-846cbfc458-rjvhc" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.841723 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/fc938b44-173b-4a97-b756-31525f6878f4-signing-cabundle\") pod \"service-ca-74545575db-s2zdg\" (UID: \"fc938b44-173b-4a97-b756-31525f6878f4\") " pod="openshift-service-ca/service-ca-74545575db-s2zdg" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.841751 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/96908d53-e612-462c-b9d5-2f10f220508b-kube-api-access\") pod \"openshift-kube-scheduler-operator-54f497555d-sz9k8\" (UID: \"96908d53-e612-462c-b9d5-2f10f220508b\") " pod="openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-54f497555d-sz9k8" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.841800 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2b3d1db6-fcdf-4574-9e43-093e46cc3e0d-metrics-tls\") pod \"dns-default-9x6jk\" (UID: \"2b3d1db6-fcdf-4574-9e43-093e46cc3e0d\") " pod="openshift-dns/dns-default-9x6jk" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.841819 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qcxs\" (UniqueName: \"kubernetes.io/projected/042810cc-b42e-4229-9c69-ab3eb1baab28-kube-api-access-6qcxs\") pod \"package-server-manager-77f986bd66-wknnz\" (UID: \"042810cc-b42e-4229-9c69-ab3eb1baab28\") " pod="openshift-operator-lifecycle-manager/package-server-manager-77f986bd66-wknnz" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.841856 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rs7v2\" (UniqueName: \"kubernetes.io/projected/fce4951f-be1c-4a0b-a8f8-0111e10df5da-kube-api-access-rs7v2\") pod \"migrator-866fcbc849-btql4\" (UID: \"fce4951f-be1c-4a0b-a8f8-0111e10df5da\") " pod="openshift-kube-storage-version-migrator/migrator-866fcbc849-btql4" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.841967 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/694287b7-37ad-49df-b06d-71eea425d072-tmp\") pod \"cluster-image-registry-operator-86c45576b9-bl65j\" (UID: \"694287b7-37ad-49df-b06d-71eea425d072\") " pod="openshift-image-registry/cluster-image-registry-operator-86c45576b9-bl65j" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.842859 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b94b756-5f20-4937-a8a7-11471f916640-service-ca-bundle\") pod \"router-default-68cf44c8b8-rsmpr\" (UID: \"5b94b756-5f20-4937-a8a7-11471f916640\") " pod="openshift-ingress/router-default-68cf44c8b8-rsmpr" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.843157 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/96908d53-e612-462c-b9d5-2f10f220508b-config\") pod \"openshift-kube-scheduler-operator-54f497555d-sz9k8\" (UID: \"96908d53-e612-462c-b9d5-2f10f220508b\") " pod="openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-54f497555d-sz9k8" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.843458 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1e9a53b6-6bbb-4477-af7b-3d98acfc8f1d-tmp\") pod \"openshift-controller-manager-operator-686468bdd5-vrbxt\" (UID: \"1e9a53b6-6bbb-4477-af7b-3d98acfc8f1d\") " pod="openshift-controller-manager-operator/openshift-controller-manager-operator-686468bdd5-vrbxt" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.844383 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/5b94b756-5f20-4937-a8a7-11471f916640-default-certificate\") pod \"router-default-68cf44c8b8-rsmpr\" (UID: \"5b94b756-5f20-4937-a8a7-11471f916640\") " pod="openshift-ingress/router-default-68cf44c8b8-rsmpr" Mar 16 15:33:37 crc kubenswrapper[5120]: E0316 15:33:37.846046 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName: nodeName:}" failed. No retries permitted until 2026-03-16 15:33:38.346029072 +0000 UTC m=+120.499960729 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "image-registry-66587d64c8-blgcz" (UID: "6528b019-774e-4298-abe6-69f062f0a13e") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.846357 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/694287b7-37ad-49df-b06d-71eea425d072-trusted-ca\") pod \"cluster-image-registry-operator-86c45576b9-bl65j\" (UID: \"694287b7-37ad-49df-b06d-71eea425d072\") " pod="openshift-image-registry/cluster-image-registry-operator-86c45576b9-bl65j" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.846568 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"marketplace-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a0b763d7-65d4-41e1-9880-8f80e9686189-marketplace-trusted-ca\") pod \"marketplace-operator-547dbd544d-gp852\" (UID: \"a0b763d7-65d4-41e1-9880-8f80e9686189\") " pod="openshift-marketplace/marketplace-operator-547dbd544d-gp852" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.846863 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a0b763d7-65d4-41e1-9880-8f80e9686189-tmp\") pod \"marketplace-operator-547dbd544d-gp852\" (UID: \"a0b763d7-65d4-41e1-9880-8f80e9686189\") " pod="openshift-marketplace/marketplace-operator-547dbd544d-gp852" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.846923 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted-pem\" (UniqueName: \"kubernetes.io/empty-dir/694287b7-37ad-49df-b06d-71eea425d072-ca-trust-extracted-pem\") pod \"cluster-image-registry-operator-86c45576b9-bl65j\" (UID: \"694287b7-37ad-49df-b06d-71eea425d072\") " pod="openshift-image-registry/cluster-image-registry-operator-86c45576b9-bl65j" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.847025 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"available-featuregates\" (UniqueName: \"kubernetes.io/empty-dir/92936655-647a-450f-a122-ff876adae5d3-available-featuregates\") pod \"openshift-config-operator-5777786469-b8t64\" (UID: \"92936655-647a-450f-a122-ff876adae5d3\") " pod="openshift-config-operator/openshift-config-operator-5777786469-b8t64" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.847165 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/716f37d9-f29d-4bc1-87a1-94364fee0605-trusted-ca-bundle\") pod \"console-64d44f6ddf-4pm87\" (UID: \"716f37d9-f29d-4bc1-87a1-94364fee0605\") " pod="openshift-console/console-64d44f6ddf-4pm87" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.847509 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"srv-cert\" (UniqueName: \"kubernetes.io/secret/7f53cb77-0d21-4cd7-81c0-d003500184f1-srv-cert\") pod \"catalog-operator-75ff9f647d-x5d5w\" (UID: \"7f53cb77-0d21-4cd7-81c0-d003500184f1\") " pod="openshift-operator-lifecycle-manager/catalog-operator-75ff9f647d-x5d5w" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.847580 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/716f37d9-f29d-4bc1-87a1-94364fee0605-console-config\") pod \"console-64d44f6ddf-4pm87\" (UID: \"716f37d9-f29d-4bc1-87a1-94364fee0605\") " pod="openshift-console/console-64d44f6ddf-4pm87" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.848070 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"v4-0-config-system-service-ca\" (UniqueName: \"kubernetes.io/configmap/83701ed7-4bc7-455c-a179-b460d641b3bf-v4-0-config-system-service-ca\") pod \"oauth-openshift-66458b6674-fvnvr\" (UID: \"83701ed7-4bc7-455c-a179-b460d641b3bf\") " pod="openshift-authentication/oauth-openshift-66458b6674-fvnvr" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.848156 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f66781c9-aef5-4298-9f8a-b7f217906ed7-tmp\") pod \"controller-manager-65b6cccf98-pbcg9\" (UID: \"f66781c9-aef5-4298-9f8a-b7f217906ed7\") " pod="openshift-controller-manager/controller-manager-65b6cccf98-pbcg9" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.849303 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f66781c9-aef5-4298-9f8a-b7f217906ed7-config\") pod \"controller-manager-65b6cccf98-pbcg9\" (UID: \"f66781c9-aef5-4298-9f8a-b7f217906ed7\") " pod="openshift-controller-manager/controller-manager-65b6cccf98-pbcg9" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.849547 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d8d90bff-3ac2-4cff-aaa4-7072a4811400-proxy-tls\") pod \"machine-config-operator-67c9d58cbb-wmklh\" (UID: \"d8d90bff-3ac2-4cff-aaa4-7072a4811400\") " pod="openshift-machine-config-operator/machine-config-operator-67c9d58cbb-wmklh" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.850892 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"marketplace-operator-metrics\" (UniqueName: \"kubernetes.io/secret/a0b763d7-65d4-41e1-9880-8f80e9686189-marketplace-operator-metrics\") pod \"marketplace-operator-547dbd544d-gp852\" (UID: \"a0b763d7-65d4-41e1-9880-8f80e9686189\") " pod="openshift-marketplace/marketplace-operator-547dbd544d-gp852" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.851113 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/50822c67-9654-449a-869f-cf28fb1fff4d-serving-cert\") pod \"kube-controller-manager-operator-69d5f845f8-6nn27\" (UID: \"50822c67-9654-449a-869f-cf28fb1fff4d\") " pod="openshift-kube-controller-manager-operator/kube-controller-manager-operator-69d5f845f8-6nn27" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.851282 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"v4-0-config-system-serving-cert\" (UniqueName: \"kubernetes.io/secret/83701ed7-4bc7-455c-a179-b460d641b3bf-v4-0-config-system-serving-cert\") pod \"oauth-openshift-66458b6674-fvnvr\" (UID: \"83701ed7-4bc7-455c-a179-b460d641b3bf\") " pod="openshift-authentication/oauth-openshift-66458b6674-fvnvr" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.851447 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"v4-0-config-user-template-error\" (UniqueName: \"kubernetes.io/secret/83701ed7-4bc7-455c-a179-b460d641b3bf-v4-0-config-user-template-error\") pod \"oauth-openshift-66458b6674-fvnvr\" (UID: \"83701ed7-4bc7-455c-a179-b460d641b3bf\") " pod="openshift-authentication/oauth-openshift-66458b6674-fvnvr" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.851483 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"v4-0-config-system-session\" (UniqueName: \"kubernetes.io/secret/83701ed7-4bc7-455c-a179-b460d641b3bf-v4-0-config-system-session\") pod \"oauth-openshift-66458b6674-fvnvr\" (UID: \"83701ed7-4bc7-455c-a179-b460d641b3bf\") " pod="openshift-authentication/oauth-openshift-66458b6674-fvnvr" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.851887 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-operator-tls\" (UniqueName: \"kubernetes.io/secret/694287b7-37ad-49df-b06d-71eea425d072-image-registry-operator-tls\") pod \"cluster-image-registry-operator-86c45576b9-bl65j\" (UID: \"694287b7-37ad-49df-b06d-71eea425d072\") " pod="openshift-image-registry/cluster-image-registry-operator-86c45576b9-bl65j" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.853538 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4b360ef1-cdf6-4d35-9354-4fc46c0cc916-serving-cert\") pod \"openshift-apiserver-operator-846cbfc458-rjvhc\" (UID: \"4b360ef1-cdf6-4d35-9354-4fc46c0cc916\") " pod="openshift-apiserver-operator/openshift-apiserver-operator-846cbfc458-rjvhc" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.853971 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/5b94b756-5f20-4937-a8a7-11471f916640-stats-auth\") pod \"router-default-68cf44c8b8-rsmpr\" (UID: \"5b94b756-5f20-4937-a8a7-11471f916640\") " pod="openshift-ingress/router-default-68cf44c8b8-rsmpr" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.854026 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/716f37d9-f29d-4bc1-87a1-94364fee0605-console-serving-cert\") pod \"console-64d44f6ddf-4pm87\" (UID: \"716f37d9-f29d-4bc1-87a1-94364fee0605\") " pod="openshift-console/console-64d44f6ddf-4pm87" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.854666 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d76e98d2-9b74-4e20-9b51-60099ccf5d9c-config\") pod \"kube-storage-version-migrator-operator-565b79b866-2n6k5\" (UID: \"d76e98d2-9b74-4e20-9b51-60099ccf5d9c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565b79b866-2n6k5" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.855888 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/716f37d9-f29d-4bc1-87a1-94364fee0605-service-ca\") pod \"console-64d44f6ddf-4pm87\" (UID: \"716f37d9-f29d-4bc1-87a1-94364fee0605\") " pod="openshift-console/console-64d44f6ddf-4pm87" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.856158 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmpfs\" (UniqueName: \"kubernetes.io/empty-dir/7f53cb77-0d21-4cd7-81c0-d003500184f1-tmpfs\") pod \"catalog-operator-75ff9f647d-x5d5w\" (UID: \"7f53cb77-0d21-4cd7-81c0-d003500184f1\") " pod="openshift-operator-lifecycle-manager/catalog-operator-75ff9f647d-x5d5w" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.856922 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/d8d90bff-3ac2-4cff-aaa4-7072a4811400-auth-proxy-config\") pod \"machine-config-operator-67c9d58cbb-wmklh\" (UID: \"d8d90bff-3ac2-4cff-aaa4-7072a4811400\") " pod="openshift-machine-config-operator/machine-config-operator-67c9d58cbb-wmklh" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.857040 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"v4-0-config-user-template-provider-selection\" (UniqueName: \"kubernetes.io/secret/83701ed7-4bc7-455c-a179-b460d641b3bf-v4-0-config-user-template-provider-selection\") pod \"oauth-openshift-66458b6674-fvnvr\" (UID: \"83701ed7-4bc7-455c-a179-b460d641b3bf\") " pod="openshift-authentication/oauth-openshift-66458b6674-fvnvr" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.857066 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/716f37d9-f29d-4bc1-87a1-94364fee0605-console-oauth-config\") pod \"console-64d44f6ddf-4pm87\" (UID: \"716f37d9-f29d-4bc1-87a1-94364fee0605\") " pod="openshift-console/console-64d44f6ddf-4pm87" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.857262 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/716f37d9-f29d-4bc1-87a1-94364fee0605-oauth-serving-cert\") pod \"console-64d44f6ddf-4pm87\" (UID: \"716f37d9-f29d-4bc1-87a1-94364fee0605\") " pod="openshift-console/console-64d44f6ddf-4pm87" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.857288 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/50822c67-9654-449a-869f-cf28fb1fff4d-tmp-dir\") pod \"kube-controller-manager-operator-69d5f845f8-6nn27\" (UID: \"50822c67-9654-449a-869f-cf28fb1fff4d\") " pod="openshift-kube-controller-manager-operator/kube-controller-manager-operator-69d5f845f8-6nn27" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.857528 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/96908d53-e612-462c-b9d5-2f10f220508b-tmp\") pod \"openshift-kube-scheduler-operator-54f497555d-sz9k8\" (UID: \"96908d53-e612-462c-b9d5-2f10f220508b\") " pod="openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-54f497555d-sz9k8" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.857696 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4b360ef1-cdf6-4d35-9354-4fc46c0cc916-config\") pod \"openshift-apiserver-operator-846cbfc458-rjvhc\" (UID: \"4b360ef1-cdf6-4d35-9354-4fc46c0cc916\") " pod="openshift-apiserver-operator/openshift-apiserver-operator-846cbfc458-rjvhc" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.857777 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/50822c67-9654-449a-869f-cf28fb1fff4d-config\") pod \"kube-controller-manager-operator-69d5f845f8-6nn27\" (UID: \"50822c67-9654-449a-869f-cf28fb1fff4d\") " pod="openshift-kube-controller-manager-operator/kube-controller-manager-operator-69d5f845f8-6nn27" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.857930 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-policies\" (UniqueName: \"kubernetes.io/configmap/83701ed7-4bc7-455c-a179-b460d641b3bf-audit-policies\") pod \"oauth-openshift-66458b6674-fvnvr\" (UID: \"83701ed7-4bc7-455c-a179-b460d641b3bf\") " pod="openshift-authentication/oauth-openshift-66458b6674-fvnvr" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.858399 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"mcc-auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/2b813265-fb01-4449-804c-7cae0739518d-mcc-auth-proxy-config\") pod \"machine-config-controller-f9cdd68f7-ljkbj\" (UID: \"2b813265-fb01-4449-804c-7cae0739518d\") " pod="openshift-machine-config-operator/machine-config-controller-f9cdd68f7-ljkbj" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.859363 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/f66781c9-aef5-4298-9f8a-b7f217906ed7-client-ca\") pod \"controller-manager-65b6cccf98-pbcg9\" (UID: \"f66781c9-aef5-4298-9f8a-b7f217906ed7\") " pod="openshift-controller-manager/controller-manager-65b6cccf98-pbcg9" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.859414 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1e9a53b6-6bbb-4477-af7b-3d98acfc8f1d-config\") pod \"openshift-controller-manager-operator-686468bdd5-vrbxt\" (UID: \"1e9a53b6-6bbb-4477-af7b-3d98acfc8f1d\") " pod="openshift-controller-manager-operator/openshift-controller-manager-operator-686468bdd5-vrbxt" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.860114 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"v4-0-config-system-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83701ed7-4bc7-455c-a179-b460d641b3bf-v4-0-config-system-trusted-ca-bundle\") pod \"oauth-openshift-66458b6674-fvnvr\" (UID: \"83701ed7-4bc7-455c-a179-b460d641b3bf\") " pod="openshift-authentication/oauth-openshift-66458b6674-fvnvr" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.861852 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/2b813265-fb01-4449-804c-7cae0739518d-proxy-tls\") pod \"machine-config-controller-f9cdd68f7-ljkbj\" (UID: \"2b813265-fb01-4449-804c-7cae0739518d\") " pod="openshift-machine-config-operator/machine-config-controller-f9cdd68f7-ljkbj" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.862731 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/96908d53-e612-462c-b9d5-2f10f220508b-serving-cert\") pod \"openshift-kube-scheduler-operator-54f497555d-sz9k8\" (UID: \"96908d53-e612-462c-b9d5-2f10f220508b\") " pod="openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-54f497555d-sz9k8" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.864172 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1e9a53b6-6bbb-4477-af7b-3d98acfc8f1d-serving-cert\") pod \"openshift-controller-manager-operator-686468bdd5-vrbxt\" (UID: \"1e9a53b6-6bbb-4477-af7b-3d98acfc8f1d\") " pod="openshift-controller-manager-operator/openshift-controller-manager-operator-686468bdd5-vrbxt" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.870093 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"v4-0-config-system-cliconfig\" (UniqueName: \"kubernetes.io/configmap/83701ed7-4bc7-455c-a179-b460d641b3bf-v4-0-config-system-cliconfig\") pod \"oauth-openshift-66458b6674-fvnvr\" (UID: \"83701ed7-4bc7-455c-a179-b460d641b3bf\") " pod="openshift-authentication/oauth-openshift-66458b6674-fvnvr" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.870369 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-certs\" (UniqueName: \"kubernetes.io/secret/52bf262d-dc00-4318-af10-68291a53ce29-webhook-certs\") pod \"multus-admission-controller-69db94689b-6bcfh\" (UID: \"52bf262d-dc00-4318-af10-68291a53ce29\") " pod="openshift-multus/multus-admission-controller-69db94689b-6bcfh" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.872590 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b94b756-5f20-4937-a8a7-11471f916640-metrics-certs\") pod \"router-default-68cf44c8b8-rsmpr\" (UID: \"5b94b756-5f20-4937-a8a7-11471f916640\") " pod="openshift-ingress/router-default-68cf44c8b8-rsmpr" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.872977 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"profile-collector-cert\" (UniqueName: \"kubernetes.io/secret/7f53cb77-0d21-4cd7-81c0-d003500184f1-profile-collector-cert\") pod \"catalog-operator-75ff9f647d-x5d5w\" (UID: \"7f53cb77-0d21-4cd7-81c0-d003500184f1\") " pod="openshift-operator-lifecycle-manager/catalog-operator-75ff9f647d-x5d5w" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.872985 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/92936655-647a-450f-a122-ff876adae5d3-serving-cert\") pod \"openshift-config-operator-5777786469-b8t64\" (UID: \"92936655-647a-450f-a122-ff876adae5d3\") " pod="openshift-config-operator/openshift-config-operator-5777786469-b8t64" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.873676 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"v4-0-config-user-template-login\" (UniqueName: \"kubernetes.io/secret/83701ed7-4bc7-455c-a179-b460d641b3bf-v4-0-config-user-template-login\") pod \"oauth-openshift-66458b6674-fvnvr\" (UID: \"83701ed7-4bc7-455c-a179-b460d641b3bf\") " pod="openshift-authentication/oauth-openshift-66458b6674-fvnvr" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.875968 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f66781c9-aef5-4298-9f8a-b7f217906ed7-serving-cert\") pod \"controller-manager-65b6cccf98-pbcg9\" (UID: \"f66781c9-aef5-4298-9f8a-b7f217906ed7\") " pod="openshift-controller-manager/controller-manager-65b6cccf98-pbcg9" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.879316 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d76e98d2-9b74-4e20-9b51-60099ccf5d9c-serving-cert\") pod \"kube-storage-version-migrator-operator-565b79b866-2n6k5\" (UID: \"d76e98d2-9b74-4e20-9b51-60099ccf5d9c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565b79b866-2n6k5" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.880155 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v79qt\" (UniqueName: \"kubernetes.io/projected/1e9a53b6-6bbb-4477-af7b-3d98acfc8f1d-kube-api-access-v79qt\") pod \"openshift-controller-manager-operator-686468bdd5-vrbxt\" (UID: \"1e9a53b6-6bbb-4477-af7b-3d98acfc8f1d\") " pod="openshift-controller-manager-operator/openshift-controller-manager-operator-686468bdd5-vrbxt" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.882532 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"control-plane-machine-set-operator-tls\" (UniqueName: \"kubernetes.io/secret/3b41e06b-0932-41d2-947a-e38b1ff52ec3-control-plane-machine-set-operator-tls\") pod \"control-plane-machine-set-operator-75ffdb6fcd-htqkp\" (UID: \"3b41e06b-0932-41d2-947a-e38b1ff52ec3\") " pod="openshift-machine-api/control-plane-machine-set-operator-75ffdb6fcd-htqkp" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.883115 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"v4-0-config-system-ocp-branding-template\" (UniqueName: \"kubernetes.io/secret/83701ed7-4bc7-455c-a179-b460d641b3bf-v4-0-config-system-ocp-branding-template\") pod \"oauth-openshift-66458b6674-fvnvr\" (UID: \"83701ed7-4bc7-455c-a179-b460d641b3bf\") " pod="openshift-authentication/oauth-openshift-66458b6674-fvnvr" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.883701 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"v4-0-config-system-router-certs\" (UniqueName: \"kubernetes.io/secret/83701ed7-4bc7-455c-a179-b460d641b3bf-v4-0-config-system-router-certs\") pod \"oauth-openshift-66458b6674-fvnvr\" (UID: \"83701ed7-4bc7-455c-a179-b460d641b3bf\") " pod="openshift-authentication/oauth-openshift-66458b6674-fvnvr" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.884261 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d9daa888-94fa-4afc-85a2-81b9dc9a5d3c-samples-operator-tls\") pod \"cluster-samples-operator-6b564684c8-8tt42\" (UID: \"d9daa888-94fa-4afc-85a2-81b9dc9a5d3c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6b564684c8-8tt42" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.903612 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5ff7774fd9-nljh6" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.904048 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"v4-0-config-user-idp-0-file-data\" (UniqueName: \"kubernetes.io/secret/83701ed7-4bc7-455c-a179-b460d641b3bf-v4-0-config-user-idp-0-file-data\") pod \"oauth-openshift-66458b6674-fvnvr\" (UID: \"83701ed7-4bc7-455c-a179-b460d641b3bf\") " pod="openshift-authentication/oauth-openshift-66458b6674-fvnvr" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.904678 5120 ???:1] "http: TLS handshake error from 192.168.126.11:57366: no serving certificate available for the kubelet" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.911142 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fhkjl" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.922141 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xr8r2" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.923355 5120 ???:1] "http: TLS handshake error from 192.168.126.11:57380: no serving certificate available for the kubelet" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.929745 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9v6n\" (UniqueName: \"kubernetes.io/projected/a0b763d7-65d4-41e1-9880-8f80e9686189-kube-api-access-f9v6n\") pod \"marketplace-operator-547dbd544d-gp852\" (UID: \"a0b763d7-65d4-41e1-9880-8f80e9686189\") " pod="openshift-marketplace/marketplace-operator-547dbd544d-gp852" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.932496 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vd49s\" (UniqueName: \"kubernetes.io/projected/694287b7-37ad-49df-b06d-71eea425d072-kube-api-access-vd49s\") pod \"cluster-image-registry-operator-86c45576b9-bl65j\" (UID: \"694287b7-37ad-49df-b06d-71eea425d072\") " pod="openshift-image-registry/cluster-image-registry-operator-86c45576b9-bl65j" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.940520 5120 ???:1] "http: TLS handshake error from 192.168.126.11:57386: no serving certificate available for the kubelet" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.943390 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.943480 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-bootstrap-token\" (UniqueName: \"kubernetes.io/secret/273dfc12-0182-4c0a-aa12-ab20f5c251cb-node-bootstrap-token\") pod \"machine-config-server-cgkjl\" (UID: \"273dfc12-0182-4c0a-aa12-ab20f5c251cb\") " pod="openshift-machine-config-operator/machine-config-server-cgkjl" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.943508 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"package-server-manager-serving-cert\" (UniqueName: \"kubernetes.io/secret/042810cc-b42e-4229-9c69-ab3eb1baab28-package-server-manager-serving-cert\") pod \"package-server-manager-77f986bd66-wknnz\" (UID: \"042810cc-b42e-4229-9c69-ab3eb1baab28\") " pod="openshift-operator-lifecycle-manager/package-server-manager-77f986bd66-wknnz" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.943530 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"csi-data-dir\" (UniqueName: \"kubernetes.io/host-path/9293198c-313b-43df-bd83-75eb148a1c77-csi-data-dir\") pod \"csi-hostpathplugin-sqjrv\" (UID: \"9293198c-313b-43df-bd83-75eb148a1c77\") " pod="hostpath-provisioner/csi-hostpathplugin-sqjrv" Mar 16 15:33:37 crc kubenswrapper[5120]: E0316 15:33:37.943566 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 15:33:38.443551213 +0000 UTC m=+120.597482870 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.943599 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugins-dir\" (UniqueName: \"kubernetes.io/host-path/9293198c-313b-43df-bd83-75eb148a1c77-plugins-dir\") pod \"csi-hostpathplugin-sqjrv\" (UID: \"9293198c-313b-43df-bd83-75eb148a1c77\") " pod="hostpath-provisioner/csi-hostpathplugin-sqjrv" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.943607 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"csi-data-dir\" (UniqueName: \"kubernetes.io/host-path/9293198c-313b-43df-bd83-75eb148a1c77-csi-data-dir\") pod \"csi-hostpathplugin-sqjrv\" (UID: \"9293198c-313b-43df-bd83-75eb148a1c77\") " pod="hostpath-provisioner/csi-hostpathplugin-sqjrv" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.943625 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7prtv\" (UniqueName: \"kubernetes.io/projected/deae033b-c4b8-462c-b29b-5115eb40a94b-kube-api-access-7prtv\") pod \"collect-profiles-29561250-7npz6\" (UID: \"deae033b-c4b8-462c-b29b-5115eb40a94b\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561250-7npz6" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.943643 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9293198c-313b-43df-bd83-75eb148a1c77-socket-dir\") pod \"csi-hostpathplugin-sqjrv\" (UID: \"9293198c-313b-43df-bd83-75eb148a1c77\") " pod="hostpath-provisioner/csi-hostpathplugin-sqjrv" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.943659 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ready\" (UniqueName: \"kubernetes.io/empty-dir/6f966d74-f323-4f45-9fbb-8160d73b7770-ready\") pod \"cni-sysctl-allowlist-ds-95s4s\" (UID: \"6f966d74-f323-4f45-9fbb-8160d73b7770\") " pod="openshift-multus/cni-sysctl-allowlist-ds-95s4s" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.943683 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-26887\" (UniqueName: \"kubernetes.io/projected/9293198c-313b-43df-bd83-75eb148a1c77-kube-api-access-26887\") pod \"csi-hostpathplugin-sqjrv\" (UID: \"9293198c-313b-43df-bd83-75eb148a1c77\") " pod="hostpath-provisioner/csi-hostpathplugin-sqjrv" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.943698 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a789838a-6c8b-4672-a5d7-decb77a7e217-cert\") pod \"ingress-canary-c58l9\" (UID: \"a789838a-6c8b-4672-a5d7-decb77a7e217\") " pod="openshift-ingress-canary/ingress-canary-c58l9" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.943713 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6f966d74-f323-4f45-9fbb-8160d73b7770-cni-sysctl-allowlist\") pod \"cni-sysctl-allowlist-ds-95s4s\" (UID: \"6f966d74-f323-4f45-9fbb-8160d73b7770\") " pod="openshift-multus/cni-sysctl-allowlist-ds-95s4s" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.943727 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jn8mx\" (UniqueName: \"kubernetes.io/projected/6f966d74-f323-4f45-9fbb-8160d73b7770-kube-api-access-jn8mx\") pod \"cni-sysctl-allowlist-ds-95s4s\" (UID: \"6f966d74-f323-4f45-9fbb-8160d73b7770\") " pod="openshift-multus/cni-sysctl-allowlist-ds-95s4s" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.943781 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/deae033b-c4b8-462c-b29b-5115eb40a94b-config-volume\") pod \"collect-profiles-29561250-7npz6\" (UID: \"deae033b-c4b8-462c-b29b-5115eb40a94b\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561250-7npz6" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.943800 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rd2qh\" (UniqueName: \"kubernetes.io/projected/fc938b44-173b-4a97-b756-31525f6878f4-kube-api-access-rd2qh\") pod \"service-ca-74545575db-s2zdg\" (UID: \"fc938b44-173b-4a97-b756-31525f6878f4\") " pod="openshift-service-ca/service-ca-74545575db-s2zdg" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.943820 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b3d1db6-fcdf-4574-9e43-093e46cc3e0d-tmp-dir\") pod \"dns-default-9x6jk\" (UID: \"2b3d1db6-fcdf-4574-9e43-093e46cc3e0d\") " pod="openshift-dns/dns-default-9x6jk" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.943835 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9293198c-313b-43df-bd83-75eb148a1c77-registration-dir\") pod \"csi-hostpathplugin-sqjrv\" (UID: \"9293198c-313b-43df-bd83-75eb148a1c77\") " pod="hostpath-provisioner/csi-hostpathplugin-sqjrv" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.943852 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/13808f6a-ec1e-4977-91af-50af631b3ef4-apiservice-cert\") pod \"packageserver-7d4fc7d867-bzv6d\" (UID: \"13808f6a-ec1e-4977-91af-50af631b3ef4\") " pod="openshift-operator-lifecycle-manager/packageserver-7d4fc7d867-bzv6d" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.943872 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6f966d74-f323-4f45-9fbb-8160d73b7770-tuning-conf-dir\") pod \"cni-sysctl-allowlist-ds-95s4s\" (UID: \"6f966d74-f323-4f45-9fbb-8160d73b7770\") " pod="openshift-multus/cni-sysctl-allowlist-ds-95s4s" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.943893 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"mountpoint-dir\" (UniqueName: \"kubernetes.io/host-path/9293198c-313b-43df-bd83-75eb148a1c77-mountpoint-dir\") pod \"csi-hostpathplugin-sqjrv\" (UID: \"9293198c-313b-43df-bd83-75eb148a1c77\") " pod="hostpath-provisioner/csi-hostpathplugin-sqjrv" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.943908 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/deae033b-c4b8-462c-b29b-5115eb40a94b-secret-volume\") pod \"collect-profiles-29561250-7npz6\" (UID: \"deae033b-c4b8-462c-b29b-5115eb40a94b\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561250-7npz6" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.943924 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/768b8055-2c6c-42ba-b005-64fabfc45402-config\") pod \"service-ca-operator-5b9c976747-547pw\" (UID: \"768b8055-2c6c-42ba-b005-64fabfc45402\") " pod="openshift-service-ca-operator/service-ca-operator-5b9c976747-547pw" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.943945 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cmnwg\" (UniqueName: \"kubernetes.io/projected/312c6c51-28c3-4d23-aa61-e01c5f36e0c9-kube-api-access-cmnwg\") pod \"olm-operator-5cdf44d969-chq5d\" (UID: \"312c6c51-28c3-4d23-aa61-e01c5f36e0c9\") " pod="openshift-operator-lifecycle-manager/olm-operator-5cdf44d969-chq5d" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.943960 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6zzp5\" (UniqueName: \"kubernetes.io/projected/a789838a-6c8b-4672-a5d7-decb77a7e217-kube-api-access-6zzp5\") pod \"ingress-canary-c58l9\" (UID: \"a789838a-6c8b-4672-a5d7-decb77a7e217\") " pod="openshift-ingress-canary/ingress-canary-c58l9" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.943994 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/768b8055-2c6c-42ba-b005-64fabfc45402-serving-cert\") pod \"service-ca-operator-5b9c976747-547pw\" (UID: \"768b8055-2c6c-42ba-b005-64fabfc45402\") " pod="openshift-service-ca-operator/service-ca-operator-5b9c976747-547pw" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.944010 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nbfmn\" (UniqueName: \"kubernetes.io/projected/768b8055-2c6c-42ba-b005-64fabfc45402-kube-api-access-nbfmn\") pod \"service-ca-operator-5b9c976747-547pw\" (UID: \"768b8055-2c6c-42ba-b005-64fabfc45402\") " pod="openshift-service-ca-operator/service-ca-operator-5b9c976747-547pw" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.944031 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/fc938b44-173b-4a97-b756-31525f6878f4-signing-key\") pod \"service-ca-74545575db-s2zdg\" (UID: \"fc938b44-173b-4a97-b756-31525f6878f4\") " pod="openshift-service-ca/service-ca-74545575db-s2zdg" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.944057 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmpfs\" (UniqueName: \"kubernetes.io/empty-dir/312c6c51-28c3-4d23-aa61-e01c5f36e0c9-tmpfs\") pod \"olm-operator-5cdf44d969-chq5d\" (UID: \"312c6c51-28c3-4d23-aa61-e01c5f36e0c9\") " pod="openshift-operator-lifecycle-manager/olm-operator-5cdf44d969-chq5d" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.946385 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-66587d64c8-blgcz\" (UID: \"6528b019-774e-4298-abe6-69f062f0a13e\") " pod="openshift-image-registry/image-registry-66587d64c8-blgcz" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.946423 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/13808f6a-ec1e-4977-91af-50af631b3ef4-webhook-cert\") pod \"packageserver-7d4fc7d867-bzv6d\" (UID: \"13808f6a-ec1e-4977-91af-50af631b3ef4\") " pod="openshift-operator-lifecycle-manager/packageserver-7d4fc7d867-bzv6d" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.946454 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/fc938b44-173b-4a97-b756-31525f6878f4-signing-cabundle\") pod \"service-ca-74545575db-s2zdg\" (UID: \"fc938b44-173b-4a97-b756-31525f6878f4\") " pod="openshift-service-ca/service-ca-74545575db-s2zdg" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.946477 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2b3d1db6-fcdf-4574-9e43-093e46cc3e0d-metrics-tls\") pod \"dns-default-9x6jk\" (UID: \"2b3d1db6-fcdf-4574-9e43-093e46cc3e0d\") " pod="openshift-dns/dns-default-9x6jk" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.947518 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-dir\" (UniqueName: \"kubernetes.io/host-path/9293198c-313b-43df-bd83-75eb148a1c77-plugins-dir\") pod \"csi-hostpathplugin-sqjrv\" (UID: \"9293198c-313b-43df-bd83-75eb148a1c77\") " pod="hostpath-provisioner/csi-hostpathplugin-sqjrv" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.947717 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-5bb8f5cd97-xdvz5" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.948549 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9293198c-313b-43df-bd83-75eb148a1c77-socket-dir\") pod \"csi-hostpathplugin-sqjrv\" (UID: \"9293198c-313b-43df-bd83-75eb148a1c77\") " pod="hostpath-provisioner/csi-hostpathplugin-sqjrv" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.948956 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ready\" (UniqueName: \"kubernetes.io/empty-dir/6f966d74-f323-4f45-9fbb-8160d73b7770-ready\") pod \"cni-sysctl-allowlist-ds-95s4s\" (UID: \"6f966d74-f323-4f45-9fbb-8160d73b7770\") " pod="openshift-multus/cni-sysctl-allowlist-ds-95s4s" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.949038 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"package-server-manager-serving-cert\" (UniqueName: \"kubernetes.io/secret/042810cc-b42e-4229-9c69-ab3eb1baab28-package-server-manager-serving-cert\") pod \"package-server-manager-77f986bd66-wknnz\" (UID: \"042810cc-b42e-4229-9c69-ab3eb1baab28\") " pod="openshift-operator-lifecycle-manager/package-server-manager-77f986bd66-wknnz" Mar 16 15:33:37 crc kubenswrapper[5120]: E0316 15:33:37.949102 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName: nodeName:}" failed. No retries permitted until 2026-03-16 15:33:38.449090423 +0000 UTC m=+120.603022080 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "image-registry-66587d64c8-blgcz" (UID: "6528b019-774e-4298-abe6-69f062f0a13e") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.949139 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9293198c-313b-43df-bd83-75eb148a1c77-registration-dir\") pod \"csi-hostpathplugin-sqjrv\" (UID: \"9293198c-313b-43df-bd83-75eb148a1c77\") " pod="hostpath-provisioner/csi-hostpathplugin-sqjrv" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.949616 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"mountpoint-dir\" (UniqueName: \"kubernetes.io/host-path/9293198c-313b-43df-bd83-75eb148a1c77-mountpoint-dir\") pod \"csi-hostpathplugin-sqjrv\" (UID: \"9293198c-313b-43df-bd83-75eb148a1c77\") " pod="hostpath-provisioner/csi-hostpathplugin-sqjrv" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.949664 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmpfs\" (UniqueName: \"kubernetes.io/empty-dir/312c6c51-28c3-4d23-aa61-e01c5f36e0c9-tmpfs\") pod \"olm-operator-5cdf44d969-chq5d\" (UID: \"312c6c51-28c3-4d23-aa61-e01c5f36e0c9\") " pod="openshift-operator-lifecycle-manager/olm-operator-5cdf44d969-chq5d" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.949697 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6f966d74-f323-4f45-9fbb-8160d73b7770-tuning-conf-dir\") pod \"cni-sysctl-allowlist-ds-95s4s\" (UID: \"6f966d74-f323-4f45-9fbb-8160d73b7770\") " pod="openshift-multus/cni-sysctl-allowlist-ds-95s4s" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.950179 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6qcxs\" (UniqueName: \"kubernetes.io/projected/042810cc-b42e-4229-9c69-ab3eb1baab28-kube-api-access-6qcxs\") pod \"package-server-manager-77f986bd66-wknnz\" (UID: \"042810cc-b42e-4229-9c69-ab3eb1baab28\") " pod="openshift-operator-lifecycle-manager/package-server-manager-77f986bd66-wknnz" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.950506 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2b3d1db6-fcdf-4574-9e43-093e46cc3e0d-config-volume\") pod \"dns-default-9x6jk\" (UID: \"2b3d1db6-fcdf-4574-9e43-093e46cc3e0d\") " pod="openshift-dns/dns-default-9x6jk" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.950563 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"profile-collector-cert\" (UniqueName: \"kubernetes.io/secret/312c6c51-28c3-4d23-aa61-e01c5f36e0c9-profile-collector-cert\") pod \"olm-operator-5cdf44d969-chq5d\" (UID: \"312c6c51-28c3-4d23-aa61-e01c5f36e0c9\") " pod="openshift-operator-lifecycle-manager/olm-operator-5cdf44d969-chq5d" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.950584 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"certs\" (UniqueName: \"kubernetes.io/secret/273dfc12-0182-4c0a-aa12-ab20f5c251cb-certs\") pod \"machine-config-server-cgkjl\" (UID: \"273dfc12-0182-4c0a-aa12-ab20f5c251cb\") " pod="openshift-machine-config-operator/machine-config-server-cgkjl" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.950608 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-znjq8\" (UniqueName: \"kubernetes.io/projected/273dfc12-0182-4c0a-aa12-ab20f5c251cb-kube-api-access-znjq8\") pod \"machine-config-server-cgkjl\" (UID: \"273dfc12-0182-4c0a-aa12-ab20f5c251cb\") " pod="openshift-machine-config-operator/machine-config-server-cgkjl" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.950616 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6f966d74-f323-4f45-9fbb-8160d73b7770-cni-sysctl-allowlist\") pod \"cni-sysctl-allowlist-ds-95s4s\" (UID: \"6f966d74-f323-4f45-9fbb-8160d73b7770\") " pod="openshift-multus/cni-sysctl-allowlist-ds-95s4s" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.950644 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ftl7r\" (UniqueName: \"kubernetes.io/projected/13808f6a-ec1e-4977-91af-50af631b3ef4-kube-api-access-ftl7r\") pod \"packageserver-7d4fc7d867-bzv6d\" (UID: \"13808f6a-ec1e-4977-91af-50af631b3ef4\") " pod="openshift-operator-lifecycle-manager/packageserver-7d4fc7d867-bzv6d" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.950673 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/fc938b44-173b-4a97-b756-31525f6878f4-signing-cabundle\") pod \"service-ca-74545575db-s2zdg\" (UID: \"fc938b44-173b-4a97-b756-31525f6878f4\") " pod="openshift-service-ca/service-ca-74545575db-s2zdg" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.951179 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b3d1db6-fcdf-4574-9e43-093e46cc3e0d-tmp-dir\") pod \"dns-default-9x6jk\" (UID: \"2b3d1db6-fcdf-4574-9e43-093e46cc3e0d\") " pod="openshift-dns/dns-default-9x6jk" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.951285 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"srv-cert\" (UniqueName: \"kubernetes.io/secret/312c6c51-28c3-4d23-aa61-e01c5f36e0c9-srv-cert\") pod \"olm-operator-5cdf44d969-chq5d\" (UID: \"312c6c51-28c3-4d23-aa61-e01c5f36e0c9\") " pod="openshift-operator-lifecycle-manager/olm-operator-5cdf44d969-chq5d" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.951331 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ncgnt\" (UniqueName: \"kubernetes.io/projected/2b3d1db6-fcdf-4574-9e43-093e46cc3e0d-kube-api-access-ncgnt\") pod \"dns-default-9x6jk\" (UID: \"2b3d1db6-fcdf-4574-9e43-093e46cc3e0d\") " pod="openshift-dns/dns-default-9x6jk" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.951353 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmpfs\" (UniqueName: \"kubernetes.io/empty-dir/13808f6a-ec1e-4977-91af-50af631b3ef4-tmpfs\") pod \"packageserver-7d4fc7d867-bzv6d\" (UID: \"13808f6a-ec1e-4977-91af-50af631b3ef4\") " pod="openshift-operator-lifecycle-manager/packageserver-7d4fc7d867-bzv6d" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.951704 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmpfs\" (UniqueName: \"kubernetes.io/empty-dir/13808f6a-ec1e-4977-91af-50af631b3ef4-tmpfs\") pod \"packageserver-7d4fc7d867-bzv6d\" (UID: \"13808f6a-ec1e-4977-91af-50af631b3ef4\") " pod="openshift-operator-lifecycle-manager/packageserver-7d4fc7d867-bzv6d" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.952097 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/768b8055-2c6c-42ba-b005-64fabfc45402-config\") pod \"service-ca-operator-5b9c976747-547pw\" (UID: \"768b8055-2c6c-42ba-b005-64fabfc45402\") " pod="openshift-service-ca-operator/service-ca-operator-5b9c976747-547pw" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.952775 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2b3d1db6-fcdf-4574-9e43-093e46cc3e0d-config-volume\") pod \"dns-default-9x6jk\" (UID: \"2b3d1db6-fcdf-4574-9e43-093e46cc3e0d\") " pod="openshift-dns/dns-default-9x6jk" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.955392 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-controller-manager-operator/openshift-controller-manager-operator-686468bdd5-vrbxt" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.955750 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/13808f6a-ec1e-4977-91af-50af631b3ef4-apiservice-cert\") pod \"packageserver-7d4fc7d867-bzv6d\" (UID: \"13808f6a-ec1e-4977-91af-50af631b3ef4\") " pod="openshift-operator-lifecycle-manager/packageserver-7d4fc7d867-bzv6d" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.956115 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/13808f6a-ec1e-4977-91af-50af631b3ef4-webhook-cert\") pod \"packageserver-7d4fc7d867-bzv6d\" (UID: \"13808f6a-ec1e-4977-91af-50af631b3ef4\") " pod="openshift-operator-lifecycle-manager/packageserver-7d4fc7d867-bzv6d" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.957597 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-bootstrap-token\" (UniqueName: \"kubernetes.io/secret/273dfc12-0182-4c0a-aa12-ab20f5c251cb-node-bootstrap-token\") pod \"machine-config-server-cgkjl\" (UID: \"273dfc12-0182-4c0a-aa12-ab20f5c251cb\") " pod="openshift-machine-config-operator/machine-config-server-cgkjl" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.959221 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/deae033b-c4b8-462c-b29b-5115eb40a94b-config-volume\") pod \"collect-profiles-29561250-7npz6\" (UID: \"deae033b-c4b8-462c-b29b-5115eb40a94b\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561250-7npz6" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.961308 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/768b8055-2c6c-42ba-b005-64fabfc45402-serving-cert\") pod \"service-ca-operator-5b9c976747-547pw\" (UID: \"768b8055-2c6c-42ba-b005-64fabfc45402\") " pod="openshift-service-ca-operator/service-ca-operator-5b9c976747-547pw" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.962925 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2b3d1db6-fcdf-4574-9e43-093e46cc3e0d-metrics-tls\") pod \"dns-default-9x6jk\" (UID: \"2b3d1db6-fcdf-4574-9e43-093e46cc3e0d\") " pod="openshift-dns/dns-default-9x6jk" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.964326 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"srv-cert\" (UniqueName: \"kubernetes.io/secret/312c6c51-28c3-4d23-aa61-e01c5f36e0c9-srv-cert\") pod \"olm-operator-5cdf44d969-chq5d\" (UID: \"312c6c51-28c3-4d23-aa61-e01c5f36e0c9\") " pod="openshift-operator-lifecycle-manager/olm-operator-5cdf44d969-chq5d" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.964966 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/deae033b-c4b8-462c-b29b-5115eb40a94b-secret-volume\") pod \"collect-profiles-29561250-7npz6\" (UID: \"deae033b-c4b8-462c-b29b-5115eb40a94b\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561250-7npz6" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.966288 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certs\" (UniqueName: \"kubernetes.io/secret/273dfc12-0182-4c0a-aa12-ab20f5c251cb-certs\") pod \"machine-config-server-cgkjl\" (UID: \"273dfc12-0182-4c0a-aa12-ab20f5c251cb\") " pod="openshift-machine-config-operator/machine-config-server-cgkjl" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.967502 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/fc938b44-173b-4a97-b756-31525f6878f4-signing-key\") pod \"service-ca-74545575db-s2zdg\" (UID: \"fc938b44-173b-4a97-b756-31525f6878f4\") " pod="openshift-service-ca/service-ca-74545575db-s2zdg" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.967687 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a789838a-6c8b-4672-a5d7-decb77a7e217-cert\") pod \"ingress-canary-c58l9\" (UID: \"a789838a-6c8b-4672-a5d7-decb77a7e217\") " pod="openshift-ingress-canary/ingress-canary-c58l9" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.971104 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"profile-collector-cert\" (UniqueName: \"kubernetes.io/secret/312c6c51-28c3-4d23-aa61-e01c5f36e0c9-profile-collector-cert\") pod \"olm-operator-5cdf44d969-chq5d\" (UID: \"312c6c51-28c3-4d23-aa61-e01c5f36e0c9\") " pod="openshift-operator-lifecycle-manager/olm-operator-5cdf44d969-chq5d" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.971655 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zpmn\" (UniqueName: \"kubernetes.io/projected/3b41e06b-0932-41d2-947a-e38b1ff52ec3-kube-api-access-9zpmn\") pod \"control-plane-machine-set-operator-75ffdb6fcd-htqkp\" (UID: \"3b41e06b-0932-41d2-947a-e38b1ff52ec3\") " pod="openshift-machine-api/control-plane-machine-set-operator-75ffdb6fcd-htqkp" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.972675 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rs7v2\" (UniqueName: \"kubernetes.io/projected/fce4951f-be1c-4a0b-a8f8-0111e10df5da-kube-api-access-rs7v2\") pod \"migrator-866fcbc849-btql4\" (UID: \"fce4951f-be1c-4a0b-a8f8-0111e10df5da\") " pod="openshift-kube-storage-version-migrator/migrator-866fcbc849-btql4" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.983860 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjlg7\" (UniqueName: \"kubernetes.io/projected/716f37d9-f29d-4bc1-87a1-94364fee0605-kube-api-access-jjlg7\") pod \"console-64d44f6ddf-4pm87\" (UID: \"716f37d9-f29d-4bc1-87a1-94364fee0605\") " pod="openshift-console/console-64d44f6ddf-4pm87" Mar 16 15:33:37 crc kubenswrapper[5120]: I0316 15:33:37.985748 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/marketplace-operator-547dbd544d-gp852" Mar 16 15:33:38 crc kubenswrapper[5120]: I0316 15:33:38.007189 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-api/control-plane-machine-set-operator-75ffdb6fcd-htqkp" Mar 16 15:33:38 crc kubenswrapper[5120]: I0316 15:33:38.008511 5120 ???:1] "http: TLS handshake error from 192.168.126.11:57398: no serving certificate available for the kubelet" Mar 16 15:33:38 crc kubenswrapper[5120]: I0316 15:33:38.010870 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zb5ln\" (UniqueName: \"kubernetes.io/projected/4b360ef1-cdf6-4d35-9354-4fc46c0cc916-kube-api-access-zb5ln\") pod \"openshift-apiserver-operator-846cbfc458-rjvhc\" (UID: \"4b360ef1-cdf6-4d35-9354-4fc46c0cc916\") " pod="openshift-apiserver-operator/openshift-apiserver-operator-846cbfc458-rjvhc" Mar 16 15:33:38 crc kubenswrapper[5120]: I0316 15:33:38.030983 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rlzcx\" (UniqueName: \"kubernetes.io/projected/2b813265-fb01-4449-804c-7cae0739518d-kube-api-access-rlzcx\") pod \"machine-config-controller-f9cdd68f7-ljkbj\" (UID: \"2b813265-fb01-4449-804c-7cae0739518d\") " pod="openshift-machine-config-operator/machine-config-controller-f9cdd68f7-ljkbj" Mar 16 15:33:38 crc kubenswrapper[5120]: I0316 15:33:38.052020 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 15:33:38 crc kubenswrapper[5120]: E0316 15:33:38.052391 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 15:33:38.55233067 +0000 UTC m=+120.706262327 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:38 crc kubenswrapper[5120]: I0316 15:33:38.052787 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-66587d64c8-blgcz\" (UID: \"6528b019-774e-4298-abe6-69f062f0a13e\") " pod="openshift-image-registry/image-registry-66587d64c8-blgcz" Mar 16 15:33:38 crc kubenswrapper[5120]: E0316 15:33:38.053396 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName: nodeName:}" failed. No retries permitted until 2026-03-16 15:33:38.553376398 +0000 UTC m=+120.707308255 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "image-registry-66587d64c8-blgcz" (UID: "6528b019-774e-4298-abe6-69f062f0a13e") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:38 crc kubenswrapper[5120]: I0316 15:33:38.056056 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqzxh\" (UniqueName: \"kubernetes.io/projected/5b94b756-5f20-4937-a8a7-11471f916640-kube-api-access-hqzxh\") pod \"router-default-68cf44c8b8-rsmpr\" (UID: \"5b94b756-5f20-4937-a8a7-11471f916640\") " pod="openshift-ingress/router-default-68cf44c8b8-rsmpr" Mar 16 15:33:38 crc kubenswrapper[5120]: I0316 15:33:38.079024 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgmmk\" (UniqueName: \"kubernetes.io/projected/b064c090-1362-427c-b805-d2808c01b58c-kube-api-access-tgmmk\") pod \"downloads-747b44746d-pjv44\" (UID: \"b064c090-1362-427c-b805-d2808c01b58c\") " pod="openshift-console/downloads-747b44746d-pjv44" Mar 16 15:33:38 crc kubenswrapper[5120]: I0316 15:33:38.095349 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9s7z5\" (UniqueName: \"kubernetes.io/projected/83701ed7-4bc7-455c-a179-b460d641b3bf-kube-api-access-9s7z5\") pod \"oauth-openshift-66458b6674-fvnvr\" (UID: \"83701ed7-4bc7-455c-a179-b460d641b3bf\") " pod="openshift-authentication/oauth-openshift-66458b6674-fvnvr" Mar 16 15:33:38 crc kubenswrapper[5120]: I0316 15:33:38.107854 5120 ???:1] "http: TLS handshake error from 192.168.126.11:57400: no serving certificate available for the kubelet" Mar 16 15:33:38 crc kubenswrapper[5120]: I0316 15:33:38.113588 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-89688\" (UniqueName: \"kubernetes.io/projected/7f53cb77-0d21-4cd7-81c0-d003500184f1-kube-api-access-89688\") pod \"catalog-operator-75ff9f647d-x5d5w\" (UID: \"7f53cb77-0d21-4cd7-81c0-d003500184f1\") " pod="openshift-operator-lifecycle-manager/catalog-operator-75ff9f647d-x5d5w" Mar 16 15:33:38 crc kubenswrapper[5120]: I0316 15:33:38.124848 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5fl25\" (UniqueName: \"kubernetes.io/projected/d9daa888-94fa-4afc-85a2-81b9dc9a5d3c-kube-api-access-5fl25\") pod \"cluster-samples-operator-6b564684c8-8tt42\" (UID: \"d9daa888-94fa-4afc-85a2-81b9dc9a5d3c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6b564684c8-8tt42" Mar 16 15:33:38 crc kubenswrapper[5120]: I0316 15:33:38.144774 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64d44f6ddf-4pm87" Mar 16 15:33:38 crc kubenswrapper[5120]: I0316 15:33:38.152171 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/96908d53-e612-462c-b9d5-2f10f220508b-kube-api-access\") pod \"openshift-kube-scheduler-operator-54f497555d-sz9k8\" (UID: \"96908d53-e612-462c-b9d5-2f10f220508b\") " pod="openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-54f497555d-sz9k8" Mar 16 15:33:38 crc kubenswrapper[5120]: I0316 15:33:38.154224 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-apiserver-operator/openshift-apiserver-operator-846cbfc458-rjvhc" Mar 16 15:33:38 crc kubenswrapper[5120]: I0316 15:33:38.154329 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 15:33:38 crc kubenswrapper[5120]: E0316 15:33:38.154715 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 15:33:38.654698792 +0000 UTC m=+120.808630449 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:38 crc kubenswrapper[5120]: I0316 15:33:38.164212 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/machine-config-controller-f9cdd68f7-ljkbj" Mar 16 15:33:38 crc kubenswrapper[5120]: I0316 15:33:38.170690 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rm4gf\" (UniqueName: \"kubernetes.io/projected/92936655-647a-450f-a122-ff876adae5d3-kube-api-access-rm4gf\") pod \"openshift-config-operator-5777786469-b8t64\" (UID: \"92936655-647a-450f-a122-ff876adae5d3\") " pod="openshift-config-operator/openshift-config-operator-5777786469-b8t64" Mar 16 15:33:38 crc kubenswrapper[5120]: I0316 15:33:38.182533 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6b564684c8-8tt42" Mar 16 15:33:38 crc kubenswrapper[5120]: I0316 15:33:38.197014 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdn8d\" (UniqueName: \"kubernetes.io/projected/f66781c9-aef5-4298-9f8a-b7f217906ed7-kube-api-access-fdn8d\") pod \"controller-manager-65b6cccf98-pbcg9\" (UID: \"f66781c9-aef5-4298-9f8a-b7f217906ed7\") " pod="openshift-controller-manager/controller-manager-65b6cccf98-pbcg9" Mar 16 15:33:38 crc kubenswrapper[5120]: I0316 15:33:38.218424 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-apiserver/apiserver-9ddfb9f55-22m28" event={"ID":"098dce05-a301-4e1c-b150-5209c633e233","Type":"ContainerStarted","Data":"2a369c5249a5ee9ec108c9058d036234516ac9223303a5826b4aee873697a282"} Mar 16 15:33:38 crc kubenswrapper[5120]: I0316 15:33:38.218485 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-apiserver/apiserver-9ddfb9f55-22m28" event={"ID":"098dce05-a301-4e1c-b150-5209c633e233","Type":"ContainerStarted","Data":"83aa87833b7fbeb8e16732708a5648463082a4dfa2fda561b90a1d2dea5ff4f6"} Mar 16 15:33:38 crc kubenswrapper[5120]: I0316 15:33:38.229164 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-route-controller-manager/route-controller-manager-776cdc94d6-b9gn7" Mar 16 15:33:38 crc kubenswrapper[5120]: I0316 15:33:38.240445 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-747b44746d-pjv44" Mar 16 15:33:38 crc kubenswrapper[5120]: I0316 15:33:38.241196 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-68cf44c8b8-rsmpr" Mar 16 15:33:38 crc kubenswrapper[5120]: I0316 15:33:38.247732 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/50822c67-9654-449a-869f-cf28fb1fff4d-kube-api-access\") pod \"kube-controller-manager-operator-69d5f845f8-6nn27\" (UID: \"50822c67-9654-449a-869f-cf28fb1fff4d\") " pod="openshift-kube-controller-manager-operator/kube-controller-manager-operator-69d5f845f8-6nn27" Mar 16 15:33:38 crc kubenswrapper[5120]: I0316 15:33:38.247828 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vww8n\" (UniqueName: \"kubernetes.io/projected/d76e98d2-9b74-4e20-9b51-60099ccf5d9c-kube-api-access-vww8n\") pod \"kube-storage-version-migrator-operator-565b79b866-2n6k5\" (UID: \"d76e98d2-9b74-4e20-9b51-60099ccf5d9c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565b79b866-2n6k5" Mar 16 15:33:38 crc kubenswrapper[5120]: I0316 15:33:38.251960 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7w9wk\" (UniqueName: \"kubernetes.io/projected/52bf262d-dc00-4318-af10-68291a53ce29-kube-api-access-7w9wk\") pod \"multus-admission-controller-69db94689b-6bcfh\" (UID: \"52bf262d-dc00-4318-af10-68291a53ce29\") " pod="openshift-multus/multus-admission-controller-69db94689b-6bcfh" Mar 16 15:33:38 crc kubenswrapper[5120]: I0316 15:33:38.255923 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-66587d64c8-blgcz\" (UID: \"6528b019-774e-4298-abe6-69f062f0a13e\") " pod="openshift-image-registry/image-registry-66587d64c8-blgcz" Mar 16 15:33:38 crc kubenswrapper[5120]: E0316 15:33:38.256254 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName: nodeName:}" failed. No retries permitted until 2026-03-16 15:33:38.756240362 +0000 UTC m=+120.910172019 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "image-registry-66587d64c8-blgcz" (UID: "6528b019-774e-4298-abe6-69f062f0a13e") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:38 crc kubenswrapper[5120]: I0316 15:33:38.263191 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-config-operator/openshift-config-operator-5777786469-b8t64" Mar 16 15:33:38 crc kubenswrapper[5120]: I0316 15:33:38.271211 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-866fcbc849-btql4" Mar 16 15:33:38 crc kubenswrapper[5120]: I0316 15:33:38.276741 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/694287b7-37ad-49df-b06d-71eea425d072-bound-sa-token\") pod \"cluster-image-registry-operator-86c45576b9-bl65j\" (UID: \"694287b7-37ad-49df-b06d-71eea425d072\") " pod="openshift-image-registry/cluster-image-registry-operator-86c45576b9-bl65j" Mar 16 15:33:38 crc kubenswrapper[5120]: I0316 15:33:38.283043 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-controller-manager/controller-manager-65b6cccf98-pbcg9" Mar 16 15:33:38 crc kubenswrapper[5120]: I0316 15:33:38.293268 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-22znc\" (UniqueName: \"kubernetes.io/projected/d8d90bff-3ac2-4cff-aaa4-7072a4811400-kube-api-access-22znc\") pod \"machine-config-operator-67c9d58cbb-wmklh\" (UID: \"d8d90bff-3ac2-4cff-aaa4-7072a4811400\") " pod="openshift-machine-config-operator/machine-config-operator-67c9d58cbb-wmklh" Mar 16 15:33:38 crc kubenswrapper[5120]: I0316 15:33:38.293658 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/catalog-operator-75ff9f647d-x5d5w" Mar 16 15:33:38 crc kubenswrapper[5120]: I0316 15:33:38.315843 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-authentication/oauth-openshift-66458b6674-fvnvr" Mar 16 15:33:38 crc kubenswrapper[5120]: I0316 15:33:38.334533 5120 ???:1] "http: TLS handshake error from 192.168.126.11:57404: no serving certificate available for the kubelet" Mar 16 15:33:38 crc kubenswrapper[5120]: I0316 15:33:38.346546 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-26887\" (UniqueName: \"kubernetes.io/projected/9293198c-313b-43df-bd83-75eb148a1c77-kube-api-access-26887\") pod \"csi-hostpathplugin-sqjrv\" (UID: \"9293198c-313b-43df-bd83-75eb148a1c77\") " pod="hostpath-provisioner/csi-hostpathplugin-sqjrv" Mar 16 15:33:38 crc kubenswrapper[5120]: I0316 15:33:38.347293 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-authentication-operator/authentication-operator-7f5c659b84-p5kbj"] Mar 16 15:33:38 crc kubenswrapper[5120]: I0316 15:33:38.356967 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 15:33:38 crc kubenswrapper[5120]: I0316 15:33:38.357466 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7prtv\" (UniqueName: \"kubernetes.io/projected/deae033b-c4b8-462c-b29b-5115eb40a94b-kube-api-access-7prtv\") pod \"collect-profiles-29561250-7npz6\" (UID: \"deae033b-c4b8-462c-b29b-5115eb40a94b\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561250-7npz6" Mar 16 15:33:38 crc kubenswrapper[5120]: E0316 15:33:38.357542 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 15:33:38.857525635 +0000 UTC m=+121.011457292 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:38 crc kubenswrapper[5120]: I0316 15:33:38.362021 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns-operator/dns-operator-799b87ffcd-8kwxr"] Mar 16 15:33:38 crc kubenswrapper[5120]: I0316 15:33:38.365699 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbfmn\" (UniqueName: \"kubernetes.io/projected/768b8055-2c6c-42ba-b005-64fabfc45402-kube-api-access-nbfmn\") pod \"service-ca-operator-5b9c976747-547pw\" (UID: \"768b8055-2c6c-42ba-b005-64fabfc45402\") " pod="openshift-service-ca-operator/service-ca-operator-5b9c976747-547pw" Mar 16 15:33:38 crc kubenswrapper[5120]: I0316 15:33:38.367532 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5b9c976747-547pw" Mar 16 15:33:38 crc kubenswrapper[5120]: I0316 15:33:38.385293 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-54f497555d-sz9k8" Mar 16 15:33:38 crc kubenswrapper[5120]: I0316 15:33:38.386226 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmnwg\" (UniqueName: \"kubernetes.io/projected/312c6c51-28c3-4d23-aa61-e01c5f36e0c9-kube-api-access-cmnwg\") pod \"olm-operator-5cdf44d969-chq5d\" (UID: \"312c6c51-28c3-4d23-aa61-e01c5f36e0c9\") " pod="openshift-operator-lifecycle-manager/olm-operator-5cdf44d969-chq5d" Mar 16 15:33:38 crc kubenswrapper[5120]: I0316 15:33:38.394317 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="hostpath-provisioner/csi-hostpathplugin-sqjrv" Mar 16 15:33:38 crc kubenswrapper[5120]: I0316 15:33:38.395952 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/machine-config-operator-67c9d58cbb-wmklh" Mar 16 15:33:38 crc kubenswrapper[5120]: I0316 15:33:38.417146 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zzp5\" (UniqueName: \"kubernetes.io/projected/a789838a-6c8b-4672-a5d7-decb77a7e217-kube-api-access-6zzp5\") pod \"ingress-canary-c58l9\" (UID: \"a789838a-6c8b-4672-a5d7-decb77a7e217\") " pod="openshift-ingress-canary/ingress-canary-c58l9" Mar 16 15:33:38 crc kubenswrapper[5120]: I0316 15:33:38.417653 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-c58l9" Mar 16 15:33:38 crc kubenswrapper[5120]: I0316 15:33:38.432074 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rd2qh\" (UniqueName: \"kubernetes.io/projected/fc938b44-173b-4a97-b756-31525f6878f4-kube-api-access-rd2qh\") pod \"service-ca-74545575db-s2zdg\" (UID: \"fc938b44-173b-4a97-b756-31525f6878f4\") " pod="openshift-service-ca/service-ca-74545575db-s2zdg" Mar 16 15:33:38 crc kubenswrapper[5120]: I0316 15:33:38.432688 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-admission-controller-69db94689b-6bcfh" Mar 16 15:33:38 crc kubenswrapper[5120]: I0316 15:33:38.446263 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftl7r\" (UniqueName: \"kubernetes.io/projected/13808f6a-ec1e-4977-91af-50af631b3ef4-kube-api-access-ftl7r\") pod \"packageserver-7d4fc7d867-bzv6d\" (UID: \"13808f6a-ec1e-4977-91af-50af631b3ef4\") " pod="openshift-operator-lifecycle-manager/packageserver-7d4fc7d867-bzv6d" Mar 16 15:33:38 crc kubenswrapper[5120]: I0316 15:33:38.458560 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-66587d64c8-blgcz\" (UID: \"6528b019-774e-4298-abe6-69f062f0a13e\") " pod="openshift-image-registry/image-registry-66587d64c8-blgcz" Mar 16 15:33:38 crc kubenswrapper[5120]: E0316 15:33:38.458909 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName: nodeName:}" failed. No retries permitted until 2026-03-16 15:33:38.95889396 +0000 UTC m=+121.112825617 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "image-registry-66587d64c8-blgcz" (UID: "6528b019-774e-4298-abe6-69f062f0a13e") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:38 crc kubenswrapper[5120]: I0316 15:33:38.471439 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565b79b866-2n6k5" Mar 16 15:33:38 crc kubenswrapper[5120]: I0316 15:33:38.481895 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-67c89758df-lx5p5"] Mar 16 15:33:38 crc kubenswrapper[5120]: I0316 15:33:38.487750 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-znjq8\" (UniqueName: \"kubernetes.io/projected/273dfc12-0182-4c0a-aa12-ab20f5c251cb-kube-api-access-znjq8\") pod \"machine-config-server-cgkjl\" (UID: \"273dfc12-0182-4c0a-aa12-ab20f5c251cb\") " pod="openshift-machine-config-operator/machine-config-server-cgkjl" Mar 16 15:33:38 crc kubenswrapper[5120]: I0316 15:33:38.491430 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager-operator/kube-controller-manager-operator-69d5f845f8-6nn27" Mar 16 15:33:38 crc kubenswrapper[5120]: I0316 15:33:38.491858 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jn8mx\" (UniqueName: \"kubernetes.io/projected/6f966d74-f323-4f45-9fbb-8160d73b7770-kube-api-access-jn8mx\") pod \"cni-sysctl-allowlist-ds-95s4s\" (UID: \"6f966d74-f323-4f45-9fbb-8160d73b7770\") " pod="openshift-multus/cni-sysctl-allowlist-ds-95s4s" Mar 16 15:33:38 crc kubenswrapper[5120]: I0316 15:33:38.494078 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-oauth-apiserver/apiserver-8596bd845d-jb8bk"] Mar 16 15:33:38 crc kubenswrapper[5120]: I0316 15:33:38.501117 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-etcd-operator/etcd-operator-69b85846b6-s4s6j"] Mar 16 15:33:38 crc kubenswrapper[5120]: I0316 15:33:38.504844 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ncgnt\" (UniqueName: \"kubernetes.io/projected/2b3d1db6-fcdf-4574-9e43-093e46cc3e0d-kube-api-access-ncgnt\") pod \"dns-default-9x6jk\" (UID: \"2b3d1db6-fcdf-4574-9e43-093e46cc3e0d\") " pod="openshift-dns/dns-default-9x6jk" Mar 16 15:33:38 crc kubenswrapper[5120]: I0316 15:33:38.528620 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qcxs\" (UniqueName: \"kubernetes.io/projected/042810cc-b42e-4229-9c69-ab3eb1baab28-kube-api-access-6qcxs\") pod \"package-server-manager-77f986bd66-wknnz\" (UID: \"042810cc-b42e-4229-9c69-ab3eb1baab28\") " pod="openshift-operator-lifecycle-manager/package-server-manager-77f986bd66-wknnz" Mar 16 15:33:38 crc kubenswrapper[5120]: I0316 15:33:38.559553 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 15:33:38 crc kubenswrapper[5120]: E0316 15:33:38.559871 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 15:33:39.059855155 +0000 UTC m=+121.213786802 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:38 crc kubenswrapper[5120]: I0316 15:33:38.571857 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"cluster-image-registry-operator-dockercfg-ntnd7\"" Mar 16 15:33:38 crc kubenswrapper[5120]: I0316 15:33:38.574123 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/cluster-image-registry-operator-86c45576b9-bl65j" Mar 16 15:33:38 crc kubenswrapper[5120]: I0316 15:33:38.624319 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/package-server-manager-77f986bd66-wknnz" Mar 16 15:33:38 crc kubenswrapper[5120]: I0316 15:33:38.635327 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/packageserver-7d4fc7d867-bzv6d" Mar 16 15:33:38 crc kubenswrapper[5120]: I0316 15:33:38.644205 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/olm-operator-5cdf44d969-chq5d" Mar 16 15:33:38 crc kubenswrapper[5120]: I0316 15:33:38.662906 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-66587d64c8-blgcz\" (UID: \"6528b019-774e-4298-abe6-69f062f0a13e\") " pod="openshift-image-registry/image-registry-66587d64c8-blgcz" Mar 16 15:33:38 crc kubenswrapper[5120]: E0316 15:33:38.663311 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName: nodeName:}" failed. No retries permitted until 2026-03-16 15:33:39.163288746 +0000 UTC m=+121.317220403 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "image-registry-66587d64c8-blgcz" (UID: "6528b019-774e-4298-abe6-69f062f0a13e") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:38 crc kubenswrapper[5120]: I0316 15:33:38.675306 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operator-lifecycle-manager\"/\"collect-profiles-dockercfg-vfqp6\"" Mar 16 15:33:38 crc kubenswrapper[5120]: I0316 15:33:38.675548 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29561250-7npz6" Mar 16 15:33:38 crc kubenswrapper[5120]: I0316 15:33:38.692075 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-bgxvm\"" Mar 16 15:33:38 crc kubenswrapper[5120]: I0316 15:33:38.701738 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-74545575db-s2zdg" Mar 16 15:33:38 crc kubenswrapper[5120]: I0316 15:33:38.702444 5120 ???:1] "http: TLS handshake error from 192.168.126.11:57416: no serving certificate available for the kubelet" Mar 16 15:33:38 crc kubenswrapper[5120]: I0316 15:33:38.710693 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/cni-sysctl-allowlist-ds-95s4s" Mar 16 15:33:38 crc kubenswrapper[5120]: I0316 15:33:38.729995 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-kpvmz\"" Mar 16 15:33:38 crc kubenswrapper[5120]: I0316 15:33:38.732777 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9x6jk" Mar 16 15:33:38 crc kubenswrapper[5120]: I0316 15:33:38.765070 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 15:33:38 crc kubenswrapper[5120]: E0316 15:33:38.765677 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 15:33:39.265656009 +0000 UTC m=+121.419587666 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:38 crc kubenswrapper[5120]: I0316 15:33:38.774854 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-machine-config-operator\"/\"machine-config-server-dockercfg-dzw6b\"" Mar 16 15:33:38 crc kubenswrapper[5120]: I0316 15:33:38.778298 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/machine-config-server-cgkjl" Mar 16 15:33:38 crc kubenswrapper[5120]: I0316 15:33:38.843101 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-apiserver/apiserver-9ddfb9f55-22m28" podStartSLOduration=99.843087273 podStartE2EDuration="1m39.843087273s" podCreationTimestamp="2026-03-16 15:31:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:33:38.842408394 +0000 UTC m=+120.996340051" watchObservedRunningTime="2026-03-16 15:33:38.843087273 +0000 UTC m=+120.997018930" Mar 16 15:33:38 crc kubenswrapper[5120]: I0316 15:33:38.867587 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-66587d64c8-blgcz\" (UID: \"6528b019-774e-4298-abe6-69f062f0a13e\") " pod="openshift-image-registry/image-registry-66587d64c8-blgcz" Mar 16 15:33:38 crc kubenswrapper[5120]: E0316 15:33:38.868016 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName: nodeName:}" failed. No retries permitted until 2026-03-16 15:33:39.36798915 +0000 UTC m=+121.521920807 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "image-registry-66587d64c8-blgcz" (UID: "6528b019-774e-4298-abe6-69f062f0a13e") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:38 crc kubenswrapper[5120]: I0316 15:33:38.968833 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 15:33:38 crc kubenswrapper[5120]: E0316 15:33:38.969679 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 15:33:39.469646633 +0000 UTC m=+121.623578300 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:38 crc kubenswrapper[5120]: I0316 15:33:38.970212 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-66587d64c8-blgcz\" (UID: \"6528b019-774e-4298-abe6-69f062f0a13e\") " pod="openshift-image-registry/image-registry-66587d64c8-blgcz" Mar 16 15:33:38 crc kubenswrapper[5120]: E0316 15:33:38.970773 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName: nodeName:}" failed. No retries permitted until 2026-03-16 15:33:39.470741443 +0000 UTC m=+121.624673100 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "image-registry-66587d64c8-blgcz" (UID: "6528b019-774e-4298-abe6-69f062f0a13e") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:39 crc kubenswrapper[5120]: I0316 15:33:39.077516 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 15:33:39 crc kubenswrapper[5120]: E0316 15:33:39.077971 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 15:33:39.577946717 +0000 UTC m=+121.731878374 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:39 crc kubenswrapper[5120]: I0316 15:33:39.182370 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-66587d64c8-blgcz\" (UID: \"6528b019-774e-4298-abe6-69f062f0a13e\") " pod="openshift-image-registry/image-registry-66587d64c8-blgcz" Mar 16 15:33:39 crc kubenswrapper[5120]: E0316 15:33:39.182914 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName: nodeName:}" failed. No retries permitted until 2026-03-16 15:33:39.68289668 +0000 UTC m=+121.836828337 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "image-registry-66587d64c8-blgcz" (UID: "6528b019-774e-4298-abe6-69f062f0a13e") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:39 crc kubenswrapper[5120]: I0316 15:33:39.226649 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-server-cgkjl" event={"ID":"273dfc12-0182-4c0a-aa12-ab20f5c251cb","Type":"ContainerStarted","Data":"cff1639720df7f64043ae413163e93d92f22315c8e056ab4cd7c1310193d8eb5"} Mar 16 15:33:39 crc kubenswrapper[5120]: I0316 15:33:39.236130 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-etcd-operator/etcd-operator-69b85846b6-s4s6j" event={"ID":"e19b119f-2b96-4aba-a3bf-86ba4acd33f5","Type":"ContainerStarted","Data":"26c060da02a07d847be67103c6a9cf181c17eaf31df8b275305157795a59b076"} Mar 16 15:33:39 crc kubenswrapper[5120]: I0316 15:33:39.240132 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns-operator/dns-operator-799b87ffcd-8kwxr" event={"ID":"b1044723-f3d1-4042-a1fc-56c73404b448","Type":"ContainerStarted","Data":"d8444a920d2737ddcd33ce609b899b4099d1f77cf50129e037a43ee6dc08d918"} Mar 16 15:33:39 crc kubenswrapper[5120]: I0316 15:33:39.242238 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-67c89758df-lx5p5" event={"ID":"3c8912a1-f2fb-407e-878f-1e6614a30688","Type":"ContainerStarted","Data":"2d8596d90ba2d992eb8116b8881c7f27ba0cfa9d40a4d51a67649c8509205486"} Mar 16 15:33:39 crc kubenswrapper[5120]: I0316 15:33:39.245723 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-authentication-operator/authentication-operator-7f5c659b84-p5kbj" event={"ID":"5e748192-041e-48ef-92ab-ec90d6d23d98","Type":"ContainerStarted","Data":"31414a5d5d8b9c35c1872888062a268ae8e6509e3a17e53eb69c84802d09e022"} Mar 16 15:33:39 crc kubenswrapper[5120]: I0316 15:33:39.261417 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-oauth-apiserver/apiserver-8596bd845d-jb8bk" event={"ID":"e8637b4d-e12e-4c41-adc5-649e5bab46ad","Type":"ContainerStarted","Data":"9149c6283190a1731890f3de734c96323a5ef41416665f4cd1713bb11aa747c0"} Mar 16 15:33:39 crc kubenswrapper[5120]: I0316 15:33:39.262391 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/cni-sysctl-allowlist-ds-95s4s" event={"ID":"6f966d74-f323-4f45-9fbb-8160d73b7770","Type":"ContainerStarted","Data":"e52cbfb1b9ac4886c5912675638926270fc8461fc691d555577169b48ae48bfc"} Mar 16 15:33:39 crc kubenswrapper[5120]: I0316 15:33:39.268201 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-68cf44c8b8-rsmpr" event={"ID":"5b94b756-5f20-4937-a8a7-11471f916640","Type":"ContainerStarted","Data":"cb7398196088a030bb36ce6f4bd2bc4a1ab4dbd0be4ab49c2a6e0e0083440199"} Mar 16 15:33:39 crc kubenswrapper[5120]: I0316 15:33:39.268255 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-68cf44c8b8-rsmpr" event={"ID":"5b94b756-5f20-4937-a8a7-11471f916640","Type":"ContainerStarted","Data":"4600371d9cb6a7835e1c20a23441b903bb0963cca5a10b0fb08b1beb7744e10c"} Mar 16 15:33:39 crc kubenswrapper[5120]: I0316 15:33:39.268433 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-apiserver/kube-apiserver-crc" podStartSLOduration=18.268416154 podStartE2EDuration="18.268416154s" podCreationTimestamp="2026-03-16 15:33:21 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:33:39.266110741 +0000 UTC m=+121.420042398" watchObservedRunningTime="2026-03-16 15:33:39.268416154 +0000 UTC m=+121.422347811" Mar 16 15:33:39 crc kubenswrapper[5120]: I0316 15:33:39.283766 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 15:33:39 crc kubenswrapper[5120]: E0316 15:33:39.283946 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 15:33:39.783921976 +0000 UTC m=+121.937853633 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:39 crc kubenswrapper[5120]: I0316 15:33:39.284012 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-66587d64c8-blgcz\" (UID: \"6528b019-774e-4298-abe6-69f062f0a13e\") " pod="openshift-image-registry/image-registry-66587d64c8-blgcz" Mar 16 15:33:39 crc kubenswrapper[5120]: E0316 15:33:39.284397 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName: nodeName:}" failed. No retries permitted until 2026-03-16 15:33:39.784388608 +0000 UTC m=+121.938320265 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "image-registry-66587d64c8-blgcz" (UID: "6528b019-774e-4298-abe6-69f062f0a13e") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:39 crc kubenswrapper[5120]: I0316 15:33:39.381326 5120 ???:1] "http: TLS handshake error from 192.168.126.11:57422: no serving certificate available for the kubelet" Mar 16 15:33:39 crc kubenswrapper[5120]: I0316 15:33:39.385079 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 15:33:39 crc kubenswrapper[5120]: E0316 15:33:39.385199 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 15:33:39.885168577 +0000 UTC m=+122.039100234 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:39 crc kubenswrapper[5120]: I0316 15:33:39.386141 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-66587d64c8-blgcz\" (UID: \"6528b019-774e-4298-abe6-69f062f0a13e\") " pod="openshift-image-registry/image-registry-66587d64c8-blgcz" Mar 16 15:33:39 crc kubenswrapper[5120]: E0316 15:33:39.386909 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName: nodeName:}" failed. No retries permitted until 2026-03-16 15:33:39.886878274 +0000 UTC m=+122.040810141 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "image-registry-66587d64c8-blgcz" (UID: "6528b019-774e-4298-abe6-69f062f0a13e") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:39 crc kubenswrapper[5120]: E0316 15:33:39.446112 5120 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b94b756_5f20_4937_a8a7_11471f916640.slice/crio-conmon-cb7398196088a030bb36ce6f4bd2bc4a1ab4dbd0be4ab49c2a6e0e0083440199.scope\": RecentStats: unable to find data in memory cache]" Mar 16 15:33:39 crc kubenswrapper[5120]: I0316 15:33:39.477481 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-machine-approver/machine-approver-54c688565-ckfb5" podStartSLOduration=100.477468046 podStartE2EDuration="1m40.477468046s" podCreationTimestamp="2026-03-16 15:31:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:33:39.475587475 +0000 UTC m=+121.629519132" watchObservedRunningTime="2026-03-16 15:33:39.477468046 +0000 UTC m=+121.631399703" Mar 16 15:33:39 crc kubenswrapper[5120]: I0316 15:33:39.487653 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 15:33:39 crc kubenswrapper[5120]: E0316 15:33:39.490644 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 15:33:39.990624224 +0000 UTC m=+122.144555881 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:39 crc kubenswrapper[5120]: I0316 15:33:39.601028 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-66587d64c8-blgcz\" (UID: \"6528b019-774e-4298-abe6-69f062f0a13e\") " pod="openshift-image-registry/image-registry-66587d64c8-blgcz" Mar 16 15:33:39 crc kubenswrapper[5120]: E0316 15:33:39.601883 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName: nodeName:}" failed. No retries permitted until 2026-03-16 15:33:40.101864508 +0000 UTC m=+122.255796165 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "image-registry-66587d64c8-blgcz" (UID: "6528b019-774e-4298-abe6-69f062f0a13e") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:39 crc kubenswrapper[5120]: I0316 15:33:39.702424 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 15:33:39 crc kubenswrapper[5120]: E0316 15:33:39.704720 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 15:33:40.204678032 +0000 UTC m=+122.358609689 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:39 crc kubenswrapper[5120]: I0316 15:33:39.802935 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-apiserver-operator/kube-apiserver-operator-575994946d-mdbz9"] Mar 16 15:33:39 crc kubenswrapper[5120]: I0316 15:33:39.805017 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-66587d64c8-blgcz\" (UID: \"6528b019-774e-4298-abe6-69f062f0a13e\") " pod="openshift-image-registry/image-registry-66587d64c8-blgcz" Mar 16 15:33:39 crc kubenswrapper[5120]: E0316 15:33:39.805395 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName: nodeName:}" failed. No retries permitted until 2026-03-16 15:33:40.305380379 +0000 UTC m=+122.459312036 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "image-registry-66587d64c8-blgcz" (UID: "6528b019-774e-4298-abe6-69f062f0a13e") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:39 crc kubenswrapper[5120]: I0316 15:33:39.860620 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-operator/ingress-operator-6b9cb4dbcf-pdp25"] Mar 16 15:33:39 crc kubenswrapper[5120]: W0316 15:33:39.891206 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfde0e777_f937_4372_a51d_3df2383352f0.slice/crio-82d99202fcf1e78a2d744afd0e143cb6414184c308f8d145a7b37b1efa486f0b WatchSource:0}: Error finding container 82d99202fcf1e78a2d744afd0e143cb6414184c308f8d145a7b37b1efa486f0b: Status 404 returned error can't find the container with id 82d99202fcf1e78a2d744afd0e143cb6414184c308f8d145a7b37b1efa486f0b Mar 16 15:33:39 crc kubenswrapper[5120]: I0316 15:33:39.905466 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 15:33:39 crc kubenswrapper[5120]: E0316 15:33:39.905571 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 15:33:40.405548402 +0000 UTC m=+122.559480059 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:39 crc kubenswrapper[5120]: I0316 15:33:39.905920 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-66587d64c8-blgcz\" (UID: \"6528b019-774e-4298-abe6-69f062f0a13e\") " pod="openshift-image-registry/image-registry-66587d64c8-blgcz" Mar 16 15:33:39 crc kubenswrapper[5120]: E0316 15:33:39.906388 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName: nodeName:}" failed. No retries permitted until 2026-03-16 15:33:40.406366764 +0000 UTC m=+122.560298481 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "image-registry-66587d64c8-blgcz" (UID: "6528b019-774e-4298-abe6-69f062f0a13e") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:40 crc kubenswrapper[5120]: I0316 15:33:40.006637 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 15:33:40 crc kubenswrapper[5120]: E0316 15:33:40.007090 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 15:33:40.507067561 +0000 UTC m=+122.660999218 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:40 crc kubenswrapper[5120]: I0316 15:33:40.045916 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5b9c976747-547pw"] Mar 16 15:33:40 crc kubenswrapper[5120]: I0316 15:33:40.061417 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/multus-admission-controller-69db94689b-6bcfh"] Mar 16 15:33:40 crc kubenswrapper[5120]: I0316 15:33:40.087258 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-64d44f6ddf-4pm87"] Mar 16 15:33:40 crc kubenswrapper[5120]: I0316 15:33:40.093815 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-authentication/oauth-openshift-66458b6674-fvnvr"] Mar 16 15:33:40 crc kubenswrapper[5120]: W0316 15:33:40.099281 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod768b8055_2c6c_42ba_b005_64fabfc45402.slice/crio-2cb7cc0ccce6befddbf93dd290b3239f9b490ae89afc7906cc71b8bcffa188bf WatchSource:0}: Error finding container 2cb7cc0ccce6befddbf93dd290b3239f9b490ae89afc7906cc71b8bcffa188bf: Status 404 returned error can't find the container with id 2cb7cc0ccce6befddbf93dd290b3239f9b490ae89afc7906cc71b8bcffa188bf Mar 16 15:33:40 crc kubenswrapper[5120]: I0316 15:33:40.107625 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-66587d64c8-blgcz\" (UID: \"6528b019-774e-4298-abe6-69f062f0a13e\") " pod="openshift-image-registry/image-registry-66587d64c8-blgcz" Mar 16 15:33:40 crc kubenswrapper[5120]: E0316 15:33:40.109154 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName: nodeName:}" failed. No retries permitted until 2026-03-16 15:33:40.609140566 +0000 UTC m=+122.763072223 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "image-registry-66587d64c8-blgcz" (UID: "6528b019-774e-4298-abe6-69f062f0a13e") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:40 crc kubenswrapper[5120]: W0316 15:33:40.114710 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf863fff9_286a_45fa_b8f0_8a86994b8440.slice/crio-2bc7b56148e67a81772314f55afb975b04ee1967c31d142a7888a9eae08e4fdb WatchSource:0}: Error finding container 2bc7b56148e67a81772314f55afb975b04ee1967c31d142a7888a9eae08e4fdb: Status 404 returned error can't find the container with id 2bc7b56148e67a81772314f55afb975b04ee1967c31d142a7888a9eae08e4fdb Mar 16 15:33:40 crc kubenswrapper[5120]: I0316 15:33:40.176663 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-route-controller-manager/route-controller-manager-776cdc94d6-b9gn7" podStartSLOduration=100.17664609 podStartE2EDuration="1m40.17664609s" podCreationTimestamp="2026-03-16 15:32:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:33:40.17555851 +0000 UTC m=+122.329490177" watchObservedRunningTime="2026-03-16 15:33:40.17664609 +0000 UTC m=+122.330577747" Mar 16 15:33:40 crc kubenswrapper[5120]: I0316 15:33:40.196184 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-866fcbc849-btql4"] Mar 16 15:33:40 crc kubenswrapper[5120]: I0316 15:33:40.226930 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-config-operator/openshift-config-operator-5777786469-b8t64"] Mar 16 15:33:40 crc kubenswrapper[5120]: I0316 15:33:40.238018 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 15:33:40 crc kubenswrapper[5120]: E0316 15:33:40.238518 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 15:33:40.738498801 +0000 UTC m=+122.892430458 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:40 crc kubenswrapper[5120]: I0316 15:33:40.244044 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-68cf44c8b8-rsmpr" Mar 16 15:33:40 crc kubenswrapper[5120]: I0316 15:33:40.246269 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-apiserver-operator/openshift-apiserver-operator-846cbfc458-rjvhc"] Mar 16 15:33:40 crc kubenswrapper[5120]: I0316 15:33:40.249969 5120 patch_prober.go:28] interesting pod/router-default-68cf44c8b8-rsmpr container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Mar 16 15:33:40 crc kubenswrapper[5120]: [-]has-synced failed: reason withheld Mar 16 15:33:40 crc kubenswrapper[5120]: [+]process-running ok Mar 16 15:33:40 crc kubenswrapper[5120]: healthz check failed Mar 16 15:33:40 crc kubenswrapper[5120]: I0316 15:33:40.250052 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-68cf44c8b8-rsmpr" podUID="5b94b756-5f20-4937-a8a7-11471f916640" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Mar 16 15:33:40 crc kubenswrapper[5120]: I0316 15:33:40.266376 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-machine-api/control-plane-machine-set-operator-75ffdb6fcd-htqkp"] Mar 16 15:33:40 crc kubenswrapper[5120]: I0316 15:33:40.266417 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-54f497555d-sz9k8"] Mar 16 15:33:40 crc kubenswrapper[5120]: I0316 15:33:40.294357 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-controller-manager-operator/openshift-controller-manager-operator-686468bdd5-vrbxt"] Mar 16 15:33:40 crc kubenswrapper[5120]: I0316 15:33:40.294405 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-multus/cni-sysctl-allowlist-ds-95s4s" Mar 16 15:33:40 crc kubenswrapper[5120]: I0316 15:33:40.294419 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/cni-sysctl-allowlist-ds-95s4s" event={"ID":"6f966d74-f323-4f45-9fbb-8160d73b7770","Type":"ContainerStarted","Data":"608acba293e4ec2584154dbd4574825f128737103e0ed75e45e1396d200d2099"} Mar 16 15:33:40 crc kubenswrapper[5120]: I0316 15:33:40.297826 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-authentication/oauth-openshift-66458b6674-fvnvr" event={"ID":"83701ed7-4bc7-455c-a179-b460d641b3bf","Type":"ContainerStarted","Data":"f1970738ff8f9ca942a6276d28ecf9c757785aa9039e860b5bae65be5fcfa638"} Mar 16 15:33:40 crc kubenswrapper[5120]: I0316 15:33:40.301231 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/marketplace-operator-547dbd544d-gp852"] Mar 16 15:33:40 crc kubenswrapper[5120]: I0316 15:33:40.304322 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-5bb8f5cd97-xdvz5" event={"ID":"f863fff9-286a-45fa-b8f0-8a86994b8440","Type":"ContainerStarted","Data":"2bc7b56148e67a81772314f55afb975b04ee1967c31d142a7888a9eae08e4fdb"} Mar 16 15:33:40 crc kubenswrapper[5120]: W0316 15:33:40.312408 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b360ef1_cdf6_4d35_9354_4fc46c0cc916.slice/crio-434a34ca3cf670093cbd747db91e3e847089e7e401d7e8d7c164b6ab82466162 WatchSource:0}: Error finding container 434a34ca3cf670093cbd747db91e3e847089e7e401d7e8d7c164b6ab82466162: Status 404 returned error can't find the container with id 434a34ca3cf670093cbd747db91e3e847089e7e401d7e8d7c164b6ab82466162 Mar 16 15:33:40 crc kubenswrapper[5120]: I0316 15:33:40.314085 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns-operator/dns-operator-799b87ffcd-8kwxr" event={"ID":"b1044723-f3d1-4042-a1fc-56c73404b448","Type":"ContainerStarted","Data":"b26462cfd1a72f102e6182817d27aa784cc7214071bb75c26a8ba33249002711"} Mar 16 15:33:40 crc kubenswrapper[5120]: I0316 15:33:40.314126 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns-operator/dns-operator-799b87ffcd-8kwxr" event={"ID":"b1044723-f3d1-4042-a1fc-56c73404b448","Type":"ContainerStarted","Data":"2a124a6b24bbaa5b74f20ae5608cfc9d54c1ed90fec85723bcb70882751a4c77"} Mar 16 15:33:40 crc kubenswrapper[5120]: I0316 15:33:40.319857 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-machine-config-operator/machine-config-controller-f9cdd68f7-ljkbj"] Mar 16 15:33:40 crc kubenswrapper[5120]: I0316 15:33:40.325261 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-multus/cni-sysctl-allowlist-ds-95s4s" Mar 16 15:33:40 crc kubenswrapper[5120]: I0316 15:33:40.327303 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-controller-manager/controller-manager-65b6cccf98-pbcg9"] Mar 16 15:33:40 crc kubenswrapper[5120]: I0316 15:33:40.333061 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-67c89758df-lx5p5" event={"ID":"3c8912a1-f2fb-407e-878f-1e6614a30688","Type":"ContainerStarted","Data":"f3a746b7543abe53cb2e019de9ee087da42b099c1492606bea11fd3a1223bc0c"} Mar 16 15:33:40 crc kubenswrapper[5120]: I0316 15:33:40.333108 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-67c89758df-lx5p5" Mar 16 15:33:40 crc kubenswrapper[5120]: I0316 15:33:40.334827 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xr8r2"] Mar 16 15:33:40 crc kubenswrapper[5120]: I0316 15:33:40.336657 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6b564684c8-8tt42"] Mar 16 15:33:40 crc kubenswrapper[5120]: I0316 15:33:40.343084 5120 patch_prober.go:28] interesting pod/console-operator-67c89758df-lx5p5 container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.217.0.9:8443/readyz\": dial tcp 10.217.0.9:8443: connect: connection refused" start-of-body= Mar 16 15:33:40 crc kubenswrapper[5120]: I0316 15:33:40.343971 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-67c89758df-lx5p5" podUID="3c8912a1-f2fb-407e-878f-1e6614a30688" containerName="console-operator" probeResult="failure" output="Get \"https://10.217.0.9:8443/readyz\": dial tcp 10.217.0.9:8443: connect: connection refused" Mar 16 15:33:40 crc kubenswrapper[5120]: I0316 15:33:40.344308 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5b9c976747-547pw" event={"ID":"768b8055-2c6c-42ba-b005-64fabfc45402","Type":"ContainerStarted","Data":"2cb7cc0ccce6befddbf93dd290b3239f9b490ae89afc7906cc71b8bcffa188bf"} Mar 16 15:33:40 crc kubenswrapper[5120]: I0316 15:33:40.346142 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operator-lifecycle-manager/catalog-operator-75ff9f647d-x5d5w"] Mar 16 15:33:40 crc kubenswrapper[5120]: I0316 15:33:40.346737 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-66587d64c8-blgcz\" (UID: \"6528b019-774e-4298-abe6-69f062f0a13e\") " pod="openshift-image-registry/image-registry-66587d64c8-blgcz" Mar 16 15:33:40 crc kubenswrapper[5120]: E0316 15:33:40.347061 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName: nodeName:}" failed. No retries permitted until 2026-03-16 15:33:40.847047072 +0000 UTC m=+123.000978729 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "image-registry-66587d64c8-blgcz" (UID: "6528b019-774e-4298-abe6-69f062f0a13e") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:40 crc kubenswrapper[5120]: I0316 15:33:40.354300 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-machine-config-operator/machine-config-operator-67c9d58cbb-wmklh"] Mar 16 15:33:40 crc kubenswrapper[5120]: I0316 15:33:40.361180 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/cluster-image-registry-operator-86c45576b9-bl65j"] Mar 16 15:33:40 crc kubenswrapper[5120]: W0316 15:33:40.361671 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0b763d7_65d4_41e1_9880_8f80e9686189.slice/crio-f1e0b42f2488e0cd5e6e39a33b82dc01fe5b3ce212a644ecd465c90879061e89 WatchSource:0}: Error finding container f1e0b42f2488e0cd5e6e39a33b82dc01fe5b3ce212a644ecd465c90879061e89: Status 404 returned error can't find the container with id f1e0b42f2488e0cd5e6e39a33b82dc01fe5b3ce212a644ecd465c90879061e89 Mar 16 15:33:40 crc kubenswrapper[5120]: I0316 15:33:40.364585 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-5ff7774fd9-nljh6" event={"ID":"6a9ae5f6-97bd-46ac-bafa-ca1b4452a141","Type":"ContainerStarted","Data":"75d0c1a900ae881e2550cef7d215f747ca82ea3e9ac5bae0c94caa79c48d9207"} Mar 16 15:33:40 crc kubenswrapper[5120]: I0316 15:33:40.364620 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-5ff7774fd9-nljh6" event={"ID":"6a9ae5f6-97bd-46ac-bafa-ca1b4452a141","Type":"ContainerStarted","Data":"f01659d1dc0288e8639f8c1f31c5f018005239fc359c8f85ace6761eb90f697d"} Mar 16 15:33:40 crc kubenswrapper[5120]: I0316 15:33:40.378050 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-747b44746d-pjv44"] Mar 16 15:33:40 crc kubenswrapper[5120]: I0316 15:33:40.379085 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-server-cgkjl" event={"ID":"273dfc12-0182-4c0a-aa12-ab20f5c251cb","Type":"ContainerStarted","Data":"80b38552a3457af767a951b0c037aa9a6d2517f6cb2582977037be7b7b5ad418"} Mar 16 15:33:40 crc kubenswrapper[5120]: I0316 15:33:40.381630 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565b79b866-2n6k5"] Mar 16 15:33:40 crc kubenswrapper[5120]: I0316 15:33:40.388462 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-api/machine-api-operator-755bb95488-5t49b" podStartSLOduration=101.388443678 podStartE2EDuration="1m41.388443678s" podCreationTimestamp="2026-03-16 15:31:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:33:40.375461714 +0000 UTC m=+122.529393371" watchObservedRunningTime="2026-03-16 15:33:40.388443678 +0000 UTC m=+122.542375335" Mar 16 15:33:40 crc kubenswrapper[5120]: I0316 15:33:40.408421 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/router-default-68cf44c8b8-rsmpr" podStartSLOduration=101.40840551 podStartE2EDuration="1m41.40840551s" podCreationTimestamp="2026-03-16 15:31:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:33:40.406968831 +0000 UTC m=+122.560900498" watchObservedRunningTime="2026-03-16 15:33:40.40840551 +0000 UTC m=+122.562337167" Mar 16 15:33:40 crc kubenswrapper[5120]: I0316 15:33:40.435338 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-etcd-operator/etcd-operator-69b85846b6-s4s6j" event={"ID":"e19b119f-2b96-4aba-a3bf-86ba4acd33f5","Type":"ContainerStarted","Data":"64a8e70d8c2a15bba74cbe81b71973eb8ec8b29678ddbe647546d789d9ee10eb"} Mar 16 15:33:40 crc kubenswrapper[5120]: I0316 15:33:40.448117 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 15:33:40 crc kubenswrapper[5120]: E0316 15:33:40.451852 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 15:33:40.951739108 +0000 UTC m=+123.105670765 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:40 crc kubenswrapper[5120]: I0316 15:33:40.452171 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-authentication-operator/authentication-operator-7f5c659b84-p5kbj" event={"ID":"5e748192-041e-48ef-92ab-ec90d6d23d98","Type":"ContainerStarted","Data":"2627c81974374bd47eae711360d98e1cb075f0722821510c201a8d1e8bb71933"} Mar 16 15:33:40 crc kubenswrapper[5120]: I0316 15:33:40.453704 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64d44f6ddf-4pm87" event={"ID":"716f37d9-f29d-4bc1-87a1-94364fee0605","Type":"ContainerStarted","Data":"ab36437f478238f2e90a9d5c82e66ee0ecab20e72de8bcc2a5ad47765cffcc04"} Mar 16 15:33:40 crc kubenswrapper[5120]: I0316 15:33:40.458425 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-operator/ingress-operator-6b9cb4dbcf-pdp25" event={"ID":"fde0e777-f937-4372-a51d-3df2383352f0","Type":"ContainerStarted","Data":"ba7cb3dea460f7a41b59f4501ca0cdb0b573786edcd7facf8fafea758079fbaf"} Mar 16 15:33:40 crc kubenswrapper[5120]: I0316 15:33:40.458468 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-operator/ingress-operator-6b9cb4dbcf-pdp25" event={"ID":"fde0e777-f937-4372-a51d-3df2383352f0","Type":"ContainerStarted","Data":"82d99202fcf1e78a2d744afd0e143cb6414184c308f8d145a7b37b1efa486f0b"} Mar 16 15:33:40 crc kubenswrapper[5120]: I0316 15:33:40.465841 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["hostpath-provisioner/csi-hostpathplugin-sqjrv"] Mar 16 15:33:40 crc kubenswrapper[5120]: I0316 15:33:40.486876 5120 generic.go:358] "Generic (PLEG): container finished" podID="e8637b4d-e12e-4c41-adc5-649e5bab46ad" containerID="07fad55752d2f303af742a4082067f05917554b0a7b742c95046ce584b929914" exitCode=0 Mar 16 15:33:40 crc kubenswrapper[5120]: I0316 15:33:40.519296 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/cni-sysctl-allowlist-ds-95s4s" podStartSLOduration=5.519279454 podStartE2EDuration="5.519279454s" podCreationTimestamp="2026-03-16 15:33:35 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:33:40.516996431 +0000 UTC m=+122.670928088" watchObservedRunningTime="2026-03-16 15:33:40.519279454 +0000 UTC m=+122.673211111" Mar 16 15:33:40 crc kubenswrapper[5120]: I0316 15:33:40.535507 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-oauth-apiserver/apiserver-8596bd845d-jb8bk" event={"ID":"e8637b4d-e12e-4c41-adc5-649e5bab46ad","Type":"ContainerDied","Data":"07fad55752d2f303af742a4082067f05917554b0a7b742c95046ce584b929914"} Mar 16 15:33:40 crc kubenswrapper[5120]: I0316 15:33:40.545498 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-admission-controller-69db94689b-6bcfh" event={"ID":"52bf262d-dc00-4318-af10-68291a53ce29","Type":"ContainerStarted","Data":"6e6b7dca00536fe75a7a7f274aa91e47f65e170953d0217b6dc76afffd0834ef"} Mar 16 15:33:40 crc kubenswrapper[5120]: I0316 15:33:40.551260 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-66587d64c8-blgcz\" (UID: \"6528b019-774e-4298-abe6-69f062f0a13e\") " pod="openshift-image-registry/image-registry-66587d64c8-blgcz" Mar 16 15:33:40 crc kubenswrapper[5120]: E0316 15:33:40.552194 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName: nodeName:}" failed. No retries permitted until 2026-03-16 15:33:41.052174997 +0000 UTC m=+123.206106654 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "image-registry-66587d64c8-blgcz" (UID: "6528b019-774e-4298-abe6-69f062f0a13e") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:40 crc kubenswrapper[5120]: I0316 15:33:40.561049 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver-operator/kube-apiserver-operator-575994946d-mdbz9" event={"ID":"e1875c3d-c889-4161-8c25-c73abc4a8468","Type":"ContainerStarted","Data":"62f05abb23f2c38e5ba0c23b40678394b683b91ddd6efa4c0f3c0a34e895b38d"} Mar 16 15:33:40 crc kubenswrapper[5120]: I0316 15:33:40.564278 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console-operator/console-operator-67c89758df-lx5p5" podStartSLOduration=101.564260676 podStartE2EDuration="1m41.564260676s" podCreationTimestamp="2026-03-16 15:31:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:33:40.56294259 +0000 UTC m=+122.716874257" watchObservedRunningTime="2026-03-16 15:33:40.564260676 +0000 UTC m=+122.718192343" Mar 16 15:33:40 crc kubenswrapper[5120]: I0316 15:33:40.620055 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns-operator/dns-operator-799b87ffcd-8kwxr" podStartSLOduration=101.619999671 podStartE2EDuration="1m41.619999671s" podCreationTimestamp="2026-03-16 15:31:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:33:40.587339104 +0000 UTC m=+122.741270771" watchObservedRunningTime="2026-03-16 15:33:40.619999671 +0000 UTC m=+122.773931358" Mar 16 15:33:40 crc kubenswrapper[5120]: I0316 15:33:40.627705 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-etcd-operator/etcd-operator-69b85846b6-s4s6j" podStartSLOduration=101.627671679 podStartE2EDuration="1m41.627671679s" podCreationTimestamp="2026-03-16 15:31:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:33:40.621334178 +0000 UTC m=+122.775265835" watchObservedRunningTime="2026-03-16 15:33:40.627671679 +0000 UTC m=+122.781603336" Mar 16 15:33:40 crc kubenswrapper[5120]: I0316 15:33:40.630658 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29561250-7npz6"] Mar 16 15:33:40 crc kubenswrapper[5120]: I0316 15:33:40.654911 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 15:33:40 crc kubenswrapper[5120]: E0316 15:33:40.656494 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 15:33:41.156471943 +0000 UTC m=+123.310403600 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:40 crc kubenswrapper[5120]: I0316 15:33:40.663901 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/machine-config-server-cgkjl" podStartSLOduration=5.663887184 podStartE2EDuration="5.663887184s" podCreationTimestamp="2026-03-16 15:33:35 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:33:40.661589102 +0000 UTC m=+122.815520759" watchObservedRunningTime="2026-03-16 15:33:40.663887184 +0000 UTC m=+122.817818841" Mar 16 15:33:40 crc kubenswrapper[5120]: I0316 15:33:40.711780 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-authentication-operator/authentication-operator-7f5c659b84-p5kbj" podStartSLOduration=101.711741844 podStartE2EDuration="1m41.711741844s" podCreationTimestamp="2026-03-16 15:31:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:33:40.70899854 +0000 UTC m=+122.862930197" watchObservedRunningTime="2026-03-16 15:33:40.711741844 +0000 UTC m=+122.865673501" Mar 16 15:33:40 crc kubenswrapper[5120]: I0316 15:33:40.714729 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-controller-manager-operator/kube-controller-manager-operator-69d5f845f8-6nn27"] Mar 16 15:33:40 crc kubenswrapper[5120]: I0316 15:33:40.714792 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-c58l9"] Mar 16 15:33:40 crc kubenswrapper[5120]: I0316 15:33:40.714803 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-9x6jk"] Mar 16 15:33:40 crc kubenswrapper[5120]: I0316 15:33:40.714815 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-multus/cni-sysctl-allowlist-ds-95s4s"] Mar 16 15:33:40 crc kubenswrapper[5120]: I0316 15:33:40.733825 5120 ???:1] "http: TLS handshake error from 192.168.126.11:57428: no serving certificate available for the kubelet" Mar 16 15:33:40 crc kubenswrapper[5120]: I0316 15:33:40.752641 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-apiserver-operator/kube-apiserver-operator-575994946d-mdbz9" podStartSLOduration=101.752612896 podStartE2EDuration="1m41.752612896s" podCreationTimestamp="2026-03-16 15:31:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:33:40.751268359 +0000 UTC m=+122.905200016" watchObservedRunningTime="2026-03-16 15:33:40.752612896 +0000 UTC m=+122.906544553" Mar 16 15:33:40 crc kubenswrapper[5120]: I0316 15:33:40.766617 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-74545575db-s2zdg"] Mar 16 15:33:40 crc kubenswrapper[5120]: I0316 15:33:40.767721 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-66587d64c8-blgcz\" (UID: \"6528b019-774e-4298-abe6-69f062f0a13e\") " pod="openshift-image-registry/image-registry-66587d64c8-blgcz" Mar 16 15:33:40 crc kubenswrapper[5120]: E0316 15:33:40.768015 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName: nodeName:}" failed. No retries permitted until 2026-03-16 15:33:41.268002034 +0000 UTC m=+123.421933691 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "image-registry-66587d64c8-blgcz" (UID: "6528b019-774e-4298-abe6-69f062f0a13e") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:40 crc kubenswrapper[5120]: I0316 15:33:40.787690 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operator-lifecycle-manager/olm-operator-5cdf44d969-chq5d"] Mar 16 15:33:40 crc kubenswrapper[5120]: I0316 15:33:40.790226 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operator-lifecycle-manager/package-server-manager-77f986bd66-wknnz"] Mar 16 15:33:40 crc kubenswrapper[5120]: I0316 15:33:40.810689 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operator-lifecycle-manager/packageserver-7d4fc7d867-bzv6d"] Mar 16 15:33:40 crc kubenswrapper[5120]: I0316 15:33:40.869884 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 15:33:40 crc kubenswrapper[5120]: E0316 15:33:40.870433 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 15:33:41.370073669 +0000 UTC m=+123.524005326 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:40 crc kubenswrapper[5120]: W0316 15:33:40.931962 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50822c67_9654_449a_869f_cf28fb1fff4d.slice/crio-e9fbfae0d1a96f2077ddab1d85e10a195f38f211528db88a3726c4d489c82bf0 WatchSource:0}: Error finding container e9fbfae0d1a96f2077ddab1d85e10a195f38f211528db88a3726c4d489c82bf0: Status 404 returned error can't find the container with id e9fbfae0d1a96f2077ddab1d85e10a195f38f211528db88a3726c4d489c82bf0 Mar 16 15:33:40 crc kubenswrapper[5120]: W0316 15:33:40.943547 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod042810cc_b42e_4229_9c69_ab3eb1baab28.slice/crio-86623794f59bc6d506cf86ca356ac8784ca9142999be8eb30ac3cb5bba150e0d WatchSource:0}: Error finding container 86623794f59bc6d506cf86ca356ac8784ca9142999be8eb30ac3cb5bba150e0d: Status 404 returned error can't find the container with id 86623794f59bc6d506cf86ca356ac8784ca9142999be8eb30ac3cb5bba150e0d Mar 16 15:33:40 crc kubenswrapper[5120]: I0316 15:33:40.970789 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-66587d64c8-blgcz\" (UID: \"6528b019-774e-4298-abe6-69f062f0a13e\") " pod="openshift-image-registry/image-registry-66587d64c8-blgcz" Mar 16 15:33:40 crc kubenswrapper[5120]: E0316 15:33:40.971156 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName: nodeName:}" failed. No retries permitted until 2026-03-16 15:33:41.471143966 +0000 UTC m=+123.625075623 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "image-registry-66587d64c8-blgcz" (UID: "6528b019-774e-4298-abe6-69f062f0a13e") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:40 crc kubenswrapper[5120]: W0316 15:33:40.971979 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13808f6a_ec1e_4977_91af_50af631b3ef4.slice/crio-6842de3f1890fc3926899c94827e8f27aa7aa811d6a3f8f81c5261b758710ba6 WatchSource:0}: Error finding container 6842de3f1890fc3926899c94827e8f27aa7aa811d6a3f8f81c5261b758710ba6: Status 404 returned error can't find the container with id 6842de3f1890fc3926899c94827e8f27aa7aa811d6a3f8f81c5261b758710ba6 Mar 16 15:33:41 crc kubenswrapper[5120]: I0316 15:33:41.071494 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 15:33:41 crc kubenswrapper[5120]: E0316 15:33:41.072230 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 15:33:41.572213213 +0000 UTC m=+123.726144870 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:41 crc kubenswrapper[5120]: I0316 15:33:41.118955 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-apiserver/apiserver-9ddfb9f55-22m28" Mar 16 15:33:41 crc kubenswrapper[5120]: I0316 15:33:41.118996 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-apiserver/apiserver-9ddfb9f55-22m28" Mar 16 15:33:41 crc kubenswrapper[5120]: I0316 15:33:41.133345 5120 patch_prober.go:28] interesting pod/apiserver-9ddfb9f55-22m28 container/openshift-apiserver namespace/openshift-apiserver: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[+]ping ok Mar 16 15:33:41 crc kubenswrapper[5120]: [+]log ok Mar 16 15:33:41 crc kubenswrapper[5120]: [+]etcd ok Mar 16 15:33:41 crc kubenswrapper[5120]: [+]poststarthook/start-apiserver-admission-initializer ok Mar 16 15:33:41 crc kubenswrapper[5120]: [+]poststarthook/generic-apiserver-start-informers ok Mar 16 15:33:41 crc kubenswrapper[5120]: [+]poststarthook/max-in-flight-filter ok Mar 16 15:33:41 crc kubenswrapper[5120]: [+]poststarthook/storage-object-count-tracker-hook ok Mar 16 15:33:41 crc kubenswrapper[5120]: [+]poststarthook/image.openshift.io-apiserver-caches ok Mar 16 15:33:41 crc kubenswrapper[5120]: [-]poststarthook/authorization.openshift.io-bootstrapclusterroles failed: reason withheld Mar 16 15:33:41 crc kubenswrapper[5120]: [-]poststarthook/authorization.openshift.io-ensurenodebootstrap-sa failed: reason withheld Mar 16 15:33:41 crc kubenswrapper[5120]: [+]poststarthook/project.openshift.io-projectcache ok Mar 16 15:33:41 crc kubenswrapper[5120]: [+]poststarthook/project.openshift.io-projectauthorizationcache ok Mar 16 15:33:41 crc kubenswrapper[5120]: [+]poststarthook/openshift.io-startinformers ok Mar 16 15:33:41 crc kubenswrapper[5120]: [+]poststarthook/openshift.io-restmapperupdater ok Mar 16 15:33:41 crc kubenswrapper[5120]: [+]poststarthook/quota.openshift.io-clusterquotamapping ok Mar 16 15:33:41 crc kubenswrapper[5120]: livez check failed Mar 16 15:33:41 crc kubenswrapper[5120]: I0316 15:33:41.133423 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-apiserver/apiserver-9ddfb9f55-22m28" podUID="098dce05-a301-4e1c-b150-5209c633e233" containerName="openshift-apiserver" probeResult="failure" output="HTTP probe failed with statuscode: 500" Mar 16 15:33:41 crc kubenswrapper[5120]: I0316 15:33:41.174509 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-66587d64c8-blgcz\" (UID: \"6528b019-774e-4298-abe6-69f062f0a13e\") " pod="openshift-image-registry/image-registry-66587d64c8-blgcz" Mar 16 15:33:41 crc kubenswrapper[5120]: E0316 15:33:41.175434 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName: nodeName:}" failed. No retries permitted until 2026-03-16 15:33:41.675402468 +0000 UTC m=+123.829334125 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "image-registry-66587d64c8-blgcz" (UID: "6528b019-774e-4298-abe6-69f062f0a13e") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:41 crc kubenswrapper[5120]: I0316 15:33:41.249005 5120 patch_prober.go:28] interesting pod/router-default-68cf44c8b8-rsmpr container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Mar 16 15:33:41 crc kubenswrapper[5120]: [-]has-synced failed: reason withheld Mar 16 15:33:41 crc kubenswrapper[5120]: [+]process-running ok Mar 16 15:33:41 crc kubenswrapper[5120]: healthz check failed Mar 16 15:33:41 crc kubenswrapper[5120]: I0316 15:33:41.249077 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-68cf44c8b8-rsmpr" podUID="5b94b756-5f20-4937-a8a7-11471f916640" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Mar 16 15:33:41 crc kubenswrapper[5120]: I0316 15:33:41.289290 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 15:33:41 crc kubenswrapper[5120]: E0316 15:33:41.289665 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 15:33:41.789637232 +0000 UTC m=+123.943568889 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:41 crc kubenswrapper[5120]: I0316 15:33:41.390770 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-66587d64c8-blgcz\" (UID: \"6528b019-774e-4298-abe6-69f062f0a13e\") " pod="openshift-image-registry/image-registry-66587d64c8-blgcz" Mar 16 15:33:41 crc kubenswrapper[5120]: E0316 15:33:41.391489 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName: nodeName:}" failed. No retries permitted until 2026-03-16 15:33:41.891477161 +0000 UTC m=+124.045408818 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "image-registry-66587d64c8-blgcz" (UID: "6528b019-774e-4298-abe6-69f062f0a13e") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:41 crc kubenswrapper[5120]: I0316 15:33:41.493332 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 15:33:41 crc kubenswrapper[5120]: E0316 15:33:41.493539 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 15:33:41.993511354 +0000 UTC m=+124.147443001 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:41 crc kubenswrapper[5120]: I0316 15:33:41.494922 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-66587d64c8-blgcz\" (UID: \"6528b019-774e-4298-abe6-69f062f0a13e\") " pod="openshift-image-registry/image-registry-66587d64c8-blgcz" Mar 16 15:33:41 crc kubenswrapper[5120]: E0316 15:33:41.495254 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName: nodeName:}" failed. No retries permitted until 2026-03-16 15:33:41.995239241 +0000 UTC m=+124.149170908 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "image-registry-66587d64c8-blgcz" (UID: "6528b019-774e-4298-abe6-69f062f0a13e") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:41 crc kubenswrapper[5120]: I0316 15:33:41.593049 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-c58l9" event={"ID":"a789838a-6c8b-4672-a5d7-decb77a7e217","Type":"ContainerStarted","Data":"543ec6e1339645a098e7c1c2c4945a42dc221e14dcf316fc633eea3482bda9d4"} Mar 16 15:33:41 crc kubenswrapper[5120]: I0316 15:33:41.596161 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 15:33:41 crc kubenswrapper[5120]: E0316 15:33:41.596510 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 15:33:42.096494723 +0000 UTC m=+124.250426380 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:41 crc kubenswrapper[5120]: I0316 15:33:41.624342 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-controller-f9cdd68f7-ljkbj" event={"ID":"2b813265-fb01-4449-804c-7cae0739518d","Type":"ContainerStarted","Data":"9eb6e190d861b6fac681c94cffb87860fa6c3bf42e1c1b92e966ccc6799337b1"} Mar 16 15:33:41 crc kubenswrapper[5120]: I0316 15:33:41.624388 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-controller-f9cdd68f7-ljkbj" event={"ID":"2b813265-fb01-4449-804c-7cae0739518d","Type":"ContainerStarted","Data":"9aa3f184e8538978ccc1fd9a4c3440687ca5d614f09157f0630d5c911b0cbe6b"} Mar 16 15:33:41 crc kubenswrapper[5120]: I0316 15:33:41.645447 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/marketplace-operator-547dbd544d-gp852" event={"ID":"a0b763d7-65d4-41e1-9880-8f80e9686189","Type":"ContainerStarted","Data":"f1e0b42f2488e0cd5e6e39a33b82dc01fe5b3ce212a644ecd465c90879061e89"} Mar 16 15:33:41 crc kubenswrapper[5120]: I0316 15:33:41.654607 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-operator-67c9d58cbb-wmklh" event={"ID":"d8d90bff-3ac2-4cff-aaa4-7072a4811400","Type":"ContainerStarted","Data":"c8fc6de930a286248791f9eb60c0cf8f7efe4d659ec7d6f7c6edbaa6ad5d41f8"} Mar 16 15:33:41 crc kubenswrapper[5120]: I0316 15:33:41.654650 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-operator-67c9d58cbb-wmklh" event={"ID":"d8d90bff-3ac2-4cff-aaa4-7072a4811400","Type":"ContainerStarted","Data":"a907bb51ad172de8ce9bea85af8efad16eb5e8e196323bac7480e1780552d9d8"} Mar 16 15:33:41 crc kubenswrapper[5120]: I0316 15:33:41.660297 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/packageserver-7d4fc7d867-bzv6d" event={"ID":"13808f6a-ec1e-4977-91af-50af631b3ef4","Type":"ContainerStarted","Data":"6842de3f1890fc3926899c94827e8f27aa7aa811d6a3f8f81c5261b758710ba6"} Mar 16 15:33:41 crc kubenswrapper[5120]: I0316 15:33:41.667144 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-api/control-plane-machine-set-operator-75ffdb6fcd-htqkp" event={"ID":"3b41e06b-0932-41d2-947a-e38b1ff52ec3","Type":"ContainerStarted","Data":"53a366a1ba79ca2edc61b0b01cd76f538e2baffa21283f5a778467bbc3fb5258"} Mar 16 15:33:41 crc kubenswrapper[5120]: I0316 15:33:41.667211 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-api/control-plane-machine-set-operator-75ffdb6fcd-htqkp" event={"ID":"3b41e06b-0932-41d2-947a-e38b1ff52ec3","Type":"ContainerStarted","Data":"53ef07dfd29694532d077ca0f58a1a677a90118954668579da4a91c81df97b1a"} Mar 16 15:33:41 crc kubenswrapper[5120]: I0316 15:33:41.668670 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xr8r2" event={"ID":"4464728a-4869-4476-83de-cb34577ace7f","Type":"ContainerStarted","Data":"6f3c65166d1703313455e2539188e7561f0c67e9eeedc1c0690b744a98ec1c40"} Mar 16 15:33:41 crc kubenswrapper[5120]: I0316 15:33:41.673481 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64d44f6ddf-4pm87" event={"ID":"716f37d9-f29d-4bc1-87a1-94364fee0605","Type":"ContainerStarted","Data":"816e8162c69862c276ab6e2e6bc3e1a4471bbdbe2bcdca902571ac0b76dd7688"} Mar 16 15:33:41 crc kubenswrapper[5120]: I0316 15:33:41.691377 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-operator/ingress-operator-6b9cb4dbcf-pdp25" event={"ID":"fde0e777-f937-4372-a51d-3df2383352f0","Type":"ContainerStarted","Data":"38b867088b8443d8f61299b4379706c0e9c5940539ef01b5387c2c934caf6b33"} Mar 16 15:33:41 crc kubenswrapper[5120]: I0316 15:33:41.693772 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-api/control-plane-machine-set-operator-75ffdb6fcd-htqkp" podStartSLOduration=102.693738137 podStartE2EDuration="1m42.693738137s" podCreationTimestamp="2026-03-16 15:31:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:33:41.692901163 +0000 UTC m=+123.846832820" watchObservedRunningTime="2026-03-16 15:33:41.693738137 +0000 UTC m=+123.847669794" Mar 16 15:33:41 crc kubenswrapper[5120]: I0316 15:33:41.693868 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/package-server-manager-77f986bd66-wknnz" event={"ID":"042810cc-b42e-4229-9c69-ab3eb1baab28","Type":"ContainerStarted","Data":"86623794f59bc6d506cf86ca356ac8784ca9142999be8eb30ac3cb5bba150e0d"} Mar 16 15:33:41 crc kubenswrapper[5120]: I0316 15:33:41.699479 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager-operator/kube-controller-manager-operator-69d5f845f8-6nn27" event={"ID":"50822c67-9654-449a-869f-cf28fb1fff4d","Type":"ContainerStarted","Data":"e9fbfae0d1a96f2077ddab1d85e10a195f38f211528db88a3726c4d489c82bf0"} Mar 16 15:33:41 crc kubenswrapper[5120]: I0316 15:33:41.699881 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-66587d64c8-blgcz\" (UID: \"6528b019-774e-4298-abe6-69f062f0a13e\") " pod="openshift-image-registry/image-registry-66587d64c8-blgcz" Mar 16 15:33:41 crc kubenswrapper[5120]: E0316 15:33:41.701680 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName: nodeName:}" failed. No retries permitted until 2026-03-16 15:33:42.201667611 +0000 UTC m=+124.355599268 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "image-registry-66587d64c8-blgcz" (UID: "6528b019-774e-4298-abe6-69f062f0a13e") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:41 crc kubenswrapper[5120]: I0316 15:33:41.719846 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-authentication/oauth-openshift-66458b6674-fvnvr" event={"ID":"83701ed7-4bc7-455c-a179-b460d641b3bf","Type":"ContainerStarted","Data":"b7a7c03608a0f8c2cc117c69e798b09696b92b94698dabfd1713d625dfe85ff0"} Mar 16 15:33:41 crc kubenswrapper[5120]: I0316 15:33:41.720819 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-authentication/oauth-openshift-66458b6674-fvnvr" Mar 16 15:33:41 crc kubenswrapper[5120]: I0316 15:33:41.724564 5120 patch_prober.go:28] interesting pod/oauth-openshift-66458b6674-fvnvr container/oauth-openshift namespace/openshift-authentication: Readiness probe status=failure output="Get \"https://10.217.0.39:6443/healthz\": dial tcp 10.217.0.39:6443: connect: connection refused" start-of-body= Mar 16 15:33:41 crc kubenswrapper[5120]: I0316 15:33:41.724636 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-authentication/oauth-openshift-66458b6674-fvnvr" podUID="83701ed7-4bc7-455c-a179-b460d641b3bf" containerName="oauth-openshift" probeResult="failure" output="Get \"https://10.217.0.39:6443/healthz\": dial tcp 10.217.0.39:6443: connect: connection refused" Mar 16 15:33:41 crc kubenswrapper[5120]: I0316 15:33:41.731343 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-5bb8f5cd97-xdvz5" event={"ID":"f863fff9-286a-45fa-b8f0-8a86994b8440","Type":"ContainerStarted","Data":"cebc49428ee799881b4ba1bbeed515aa169165c5e872be8542b2be669192bd2a"} Mar 16 15:33:41 crc kubenswrapper[5120]: I0316 15:33:41.749472 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-controller-manager-operator/openshift-controller-manager-operator-686468bdd5-vrbxt" event={"ID":"1e9a53b6-6bbb-4477-af7b-3d98acfc8f1d","Type":"ContainerStarted","Data":"f0819d09e304910ca1de887b7c07bd8509d729b12ee0551a92ec94e94d10341a"} Mar 16 15:33:41 crc kubenswrapper[5120]: I0316 15:33:41.749533 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-controller-manager-operator/openshift-controller-manager-operator-686468bdd5-vrbxt" event={"ID":"1e9a53b6-6bbb-4477-af7b-3d98acfc8f1d","Type":"ContainerStarted","Data":"fe814e69d5ac4cc8956c7b753123a17800bf5841b3bca0c5c60b93218cc31c85"} Mar 16 15:33:41 crc kubenswrapper[5120]: I0316 15:33:41.762104 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-64d44f6ddf-4pm87" podStartSLOduration=102.762089265 podStartE2EDuration="1m42.762089265s" podCreationTimestamp="2026-03-16 15:31:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:33:41.732685655 +0000 UTC m=+123.886617312" watchObservedRunningTime="2026-03-16 15:33:41.762089265 +0000 UTC m=+123.916020922" Mar 16 15:33:41 crc kubenswrapper[5120]: I0316 15:33:41.762813 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-operator/ingress-operator-6b9cb4dbcf-pdp25" podStartSLOduration=102.762807284 podStartE2EDuration="1m42.762807284s" podCreationTimestamp="2026-03-16 15:31:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:33:41.761377115 +0000 UTC m=+123.915308772" watchObservedRunningTime="2026-03-16 15:33:41.762807284 +0000 UTC m=+123.916738941" Mar 16 15:33:41 crc kubenswrapper[5120]: I0316 15:33:41.763952 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5b9c976747-547pw" event={"ID":"768b8055-2c6c-42ba-b005-64fabfc45402","Type":"ContainerStarted","Data":"e8e74a1102bfc6efec1cbef85cbcabf6f9c81de76a627c7add6f54909bed21ac"} Mar 16 15:33:41 crc kubenswrapper[5120]: I0316 15:33:41.807223 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 15:33:41 crc kubenswrapper[5120]: E0316 15:33:41.808991 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 15:33:42.308970648 +0000 UTC m=+124.462902305 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:41 crc kubenswrapper[5120]: I0316 15:33:41.817385 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-controller-manager-operator/openshift-controller-manager-operator-686468bdd5-vrbxt" podStartSLOduration=102.817369227 podStartE2EDuration="1m42.817369227s" podCreationTimestamp="2026-03-16 15:31:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:33:41.815501786 +0000 UTC m=+123.969433443" watchObservedRunningTime="2026-03-16 15:33:41.817369227 +0000 UTC m=+123.971300884" Mar 16 15:33:41 crc kubenswrapper[5120]: I0316 15:33:41.832981 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/collect-profiles-29561250-7npz6" event={"ID":"deae033b-c4b8-462c-b29b-5115eb40a94b","Type":"ContainerStarted","Data":"22ed09d62da22cb440c642195a099f756946e5b8357dcb718accf232fd48e409"} Mar 16 15:33:41 crc kubenswrapper[5120]: I0316 15:33:41.856994 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-747b44746d-pjv44" event={"ID":"b064c090-1362-427c-b805-d2808c01b58c","Type":"ContainerStarted","Data":"e66266eac8cafafca06e84380c1f4cf5f11eeef5362eb4fd3f29b40750fc9c9b"} Mar 16 15:33:41 crc kubenswrapper[5120]: I0316 15:33:41.861528 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-controller-manager/controller-manager-65b6cccf98-pbcg9" event={"ID":"f66781c9-aef5-4298-9f8a-b7f217906ed7","Type":"ContainerStarted","Data":"935eabc4eebdb497d532085ac37b1d87c7e7d19ccc6db78442977759dc0bce80"} Mar 16 15:33:41 crc kubenswrapper[5120]: I0316 15:33:41.863237 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6b564684c8-8tt42" event={"ID":"d9daa888-94fa-4afc-85a2-81b9dc9a5d3c","Type":"ContainerStarted","Data":"eee927994dc9d652141de2e97c2af0f7b40ab5e954ef7f482b18b822f6d6d6d0"} Mar 16 15:33:41 crc kubenswrapper[5120]: I0316 15:33:41.864733 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/olm-operator-5cdf44d969-chq5d" event={"ID":"312c6c51-28c3-4d23-aa61-e01c5f36e0c9","Type":"ContainerStarted","Data":"b0b1f09c323a31dbf22cba89761ee1dcfd520f2d96022c7f1aa1e31a8f478341"} Mar 16 15:33:41 crc kubenswrapper[5120]: I0316 15:33:41.877373 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5b9c976747-547pw" podStartSLOduration=101.877353447 podStartE2EDuration="1m41.877353447s" podCreationTimestamp="2026-03-16 15:32:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:33:41.876048642 +0000 UTC m=+124.029980299" watchObservedRunningTime="2026-03-16 15:33:41.877353447 +0000 UTC m=+124.031285104" Mar 16 15:33:41 crc kubenswrapper[5120]: I0316 15:33:41.877841 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-authentication/oauth-openshift-66458b6674-fvnvr" podStartSLOduration=102.8778354 podStartE2EDuration="1m42.8778354s" podCreationTimestamp="2026-03-16 15:31:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:33:41.857228541 +0000 UTC m=+124.011160188" watchObservedRunningTime="2026-03-16 15:33:41.8778354 +0000 UTC m=+124.031767047" Mar 16 15:33:41 crc kubenswrapper[5120]: I0316 15:33:41.901001 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/catalog-operator-75ff9f647d-x5d5w" event={"ID":"7f53cb77-0d21-4cd7-81c0-d003500184f1","Type":"ContainerStarted","Data":"da11350f6070a39444a8c122a21b4dbc810e4f7706575e065d133c1eb9083bde"} Mar 16 15:33:41 crc kubenswrapper[5120]: I0316 15:33:41.908721 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-66587d64c8-blgcz\" (UID: \"6528b019-774e-4298-abe6-69f062f0a13e\") " pod="openshift-image-registry/image-registry-66587d64c8-blgcz" Mar 16 15:33:41 crc kubenswrapper[5120]: E0316 15:33:41.909129 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName: nodeName:}" failed. No retries permitted until 2026-03-16 15:33:42.409117031 +0000 UTC m=+124.563048688 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "image-registry-66587d64c8-blgcz" (UID: "6528b019-774e-4298-abe6-69f062f0a13e") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:41 crc kubenswrapper[5120]: I0316 15:33:41.919584 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-config-operator/openshift-config-operator-5777786469-b8t64" event={"ID":"92936655-647a-450f-a122-ff876adae5d3","Type":"ContainerStarted","Data":"2208b3443c08635991c9d40380c2ae682ffe85aefc3be3c61abc29b275795568"} Mar 16 15:33:41 crc kubenswrapper[5120]: I0316 15:33:41.971230 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-admission-controller-69db94689b-6bcfh" event={"ID":"52bf262d-dc00-4318-af10-68291a53ce29","Type":"ContainerStarted","Data":"d5d4e7002d3e6476baf191a86ec4cef4482dbd53113424ef3c33e3d2540dc3b3"} Mar 16 15:33:41 crc kubenswrapper[5120]: I0316 15:33:41.978898 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver-operator/kube-apiserver-operator-575994946d-mdbz9" event={"ID":"e1875c3d-c889-4161-8c25-c73abc4a8468","Type":"ContainerStarted","Data":"885217ca748417c86f18a6393b4b89be42404de896150d85abb924abdf3af04a"} Mar 16 15:33:42 crc kubenswrapper[5120]: I0316 15:33:42.002613 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9x6jk" event={"ID":"2b3d1db6-fcdf-4574-9e43-093e46cc3e0d","Type":"ContainerStarted","Data":"2c8548035762e11137acb656c21a9c8c7ce031087aa965c359d87113d83b02b2"} Mar 16 15:33:42 crc kubenswrapper[5120]: I0316 15:33:42.009731 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 15:33:42 crc kubenswrapper[5120]: E0316 15:33:42.010142 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 15:33:42.509824438 +0000 UTC m=+124.663756095 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:42 crc kubenswrapper[5120]: I0316 15:33:42.010886 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-66587d64c8-blgcz\" (UID: \"6528b019-774e-4298-abe6-69f062f0a13e\") " pod="openshift-image-registry/image-registry-66587d64c8-blgcz" Mar 16 15:33:42 crc kubenswrapper[5120]: E0316 15:33:42.011378 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName: nodeName:}" failed. No retries permitted until 2026-03-16 15:33:42.5113695 +0000 UTC m=+124.665301157 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "image-registry-66587d64c8-blgcz" (UID: "6528b019-774e-4298-abe6-69f062f0a13e") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:42 crc kubenswrapper[5120]: I0316 15:33:42.015930 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-866fcbc849-btql4" event={"ID":"fce4951f-be1c-4a0b-a8f8-0111e10df5da","Type":"ContainerStarted","Data":"3d42c72b10a2b3ebed2801d62864b13f09f0e6d09f15d1c3898dce685e7c6938"} Mar 16 15:33:42 crc kubenswrapper[5120]: I0316 15:33:42.015991 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-866fcbc849-btql4" event={"ID":"fce4951f-be1c-4a0b-a8f8-0111e10df5da","Type":"ContainerStarted","Data":"b80d1e0d9c56df75cdc9af442f04d7885b4e2465da29a041780cc32a40916e82"} Mar 16 15:33:42 crc kubenswrapper[5120]: I0316 15:33:42.019059 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-54f497555d-sz9k8" event={"ID":"96908d53-e612-462c-b9d5-2f10f220508b","Type":"ContainerStarted","Data":"faade0e036d400c45498060fd1c495da070418064c0dc077d631cceed341b902"} Mar 16 15:33:42 crc kubenswrapper[5120]: I0316 15:33:42.019092 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-54f497555d-sz9k8" event={"ID":"96908d53-e612-462c-b9d5-2f10f220508b","Type":"ContainerStarted","Data":"0b806b1c33391b0db6740deae135d77051432d0babfbcc57184645abc7cced44"} Mar 16 15:33:42 crc kubenswrapper[5120]: I0316 15:33:42.036022 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-54f497555d-sz9k8" podStartSLOduration=103.036008709 podStartE2EDuration="1m43.036008709s" podCreationTimestamp="2026-03-16 15:31:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:33:42.034118478 +0000 UTC m=+124.188050135" watchObservedRunningTime="2026-03-16 15:33:42.036008709 +0000 UTC m=+124.189940366" Mar 16 15:33:42 crc kubenswrapper[5120]: I0316 15:33:42.065175 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/cluster-image-registry-operator-86c45576b9-bl65j" event={"ID":"694287b7-37ad-49df-b06d-71eea425d072","Type":"ContainerStarted","Data":"63328d7f0b995fdf5c56497c3c607d4e0297dcc9032691139f52297b725d0ae5"} Mar 16 15:33:42 crc kubenswrapper[5120]: I0316 15:33:42.105771 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/cluster-image-registry-operator-86c45576b9-bl65j" podStartSLOduration=103.105743375 podStartE2EDuration="1m43.105743375s" podCreationTimestamp="2026-03-16 15:31:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:33:42.105632292 +0000 UTC m=+124.259563949" watchObservedRunningTime="2026-03-16 15:33:42.105743375 +0000 UTC m=+124.259675032" Mar 16 15:33:42 crc kubenswrapper[5120]: I0316 15:33:42.112150 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 15:33:42 crc kubenswrapper[5120]: E0316 15:33:42.113679 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 15:33:42.613658581 +0000 UTC m=+124.767590248 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:42 crc kubenswrapper[5120]: I0316 15:33:42.141882 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565b79b866-2n6k5" event={"ID":"d76e98d2-9b74-4e20-9b51-60099ccf5d9c","Type":"ContainerStarted","Data":"8aec32386d05d833c6cd4921f0d8a88ea16c7309d44276533880f7b61e1ea0bd"} Mar 16 15:33:42 crc kubenswrapper[5120]: I0316 15:33:42.142395 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565b79b866-2n6k5" event={"ID":"d76e98d2-9b74-4e20-9b51-60099ccf5d9c","Type":"ContainerStarted","Data":"6ed333199394bff973cfcc3a327fa90a0da51e7804fe88173d79316141d3ec95"} Mar 16 15:33:42 crc kubenswrapper[5120]: I0316 15:33:42.158703 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="hostpath-provisioner/csi-hostpathplugin-sqjrv" event={"ID":"9293198c-313b-43df-bd83-75eb148a1c77","Type":"ContainerStarted","Data":"c331f452cf91d86e714863b94b10921374b0b2e6d7576f4aac42244e40ef2079"} Mar 16 15:33:42 crc kubenswrapper[5120]: I0316 15:33:42.166359 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-74545575db-s2zdg" event={"ID":"fc938b44-173b-4a97-b756-31525f6878f4","Type":"ContainerStarted","Data":"2af9f29aef88c74b36df8aedcd7f627d590d9c45b16c5caa0665217108335941"} Mar 16 15:33:42 crc kubenswrapper[5120]: I0316 15:33:42.166573 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565b79b866-2n6k5" podStartSLOduration=103.166559998 podStartE2EDuration="1m43.166559998s" podCreationTimestamp="2026-03-16 15:31:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:33:42.163289489 +0000 UTC m=+124.317221166" watchObservedRunningTime="2026-03-16 15:33:42.166559998 +0000 UTC m=+124.320491655" Mar 16 15:33:42 crc kubenswrapper[5120]: I0316 15:33:42.175318 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-apiserver-operator/openshift-apiserver-operator-846cbfc458-rjvhc" event={"ID":"4b360ef1-cdf6-4d35-9354-4fc46c0cc916","Type":"ContainerStarted","Data":"110345bddd488a8ee2399396dd971372d0295f59cc03df78c475ae3a94610503"} Mar 16 15:33:42 crc kubenswrapper[5120]: I0316 15:33:42.175368 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-apiserver-operator/openshift-apiserver-operator-846cbfc458-rjvhc" event={"ID":"4b360ef1-cdf6-4d35-9354-4fc46c0cc916","Type":"ContainerStarted","Data":"434a34ca3cf670093cbd747db91e3e847089e7e401d7e8d7c164b6ab82466162"} Mar 16 15:33:42 crc kubenswrapper[5120]: I0316 15:33:42.196817 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-apiserver-operator/openshift-apiserver-operator-846cbfc458-rjvhc" podStartSLOduration=103.19680089 podStartE2EDuration="1m43.19680089s" podCreationTimestamp="2026-03-16 15:31:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:33:42.195157626 +0000 UTC m=+124.349089283" watchObservedRunningTime="2026-03-16 15:33:42.19680089 +0000 UTC m=+124.350732547" Mar 16 15:33:42 crc kubenswrapper[5120]: I0316 15:33:42.214144 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-66587d64c8-blgcz\" (UID: \"6528b019-774e-4298-abe6-69f062f0a13e\") " pod="openshift-image-registry/image-registry-66587d64c8-blgcz" Mar 16 15:33:42 crc kubenswrapper[5120]: E0316 15:33:42.215900 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName: nodeName:}" failed. No retries permitted until 2026-03-16 15:33:42.715886039 +0000 UTC m=+124.869817696 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "image-registry-66587d64c8-blgcz" (UID: "6528b019-774e-4298-abe6-69f062f0a13e") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:42 crc kubenswrapper[5120]: I0316 15:33:42.236662 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-fhkjl" event={"ID":"17b87002-b798-480a-8e17-83053d698239","Type":"ContainerStarted","Data":"9767ced7cbfeb6b827c82200436ed6abc604d063b85f419ef2ae1adb962442e1"} Mar 16 15:33:42 crc kubenswrapper[5120]: I0316 15:33:42.236703 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-fhkjl" event={"ID":"17b87002-b798-480a-8e17-83053d698239","Type":"ContainerStarted","Data":"2c144ffd60503c14434c8b71eb241b950987475073eca951ed18e1ca6bef28cb"} Mar 16 15:33:42 crc kubenswrapper[5120]: I0316 15:33:42.241358 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-fhkjl" Mar 16 15:33:42 crc kubenswrapper[5120]: I0316 15:33:42.250729 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-67c89758df-lx5p5" Mar 16 15:33:42 crc kubenswrapper[5120]: I0316 15:33:42.254685 5120 patch_prober.go:28] interesting pod/router-default-68cf44c8b8-rsmpr container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Mar 16 15:33:42 crc kubenswrapper[5120]: [-]has-synced failed: reason withheld Mar 16 15:33:42 crc kubenswrapper[5120]: [+]process-running ok Mar 16 15:33:42 crc kubenswrapper[5120]: healthz check failed Mar 16 15:33:42 crc kubenswrapper[5120]: I0316 15:33:42.254729 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-68cf44c8b8-rsmpr" podUID="5b94b756-5f20-4937-a8a7-11471f916640" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Mar 16 15:33:42 crc kubenswrapper[5120]: I0316 15:33:42.315614 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 15:33:42 crc kubenswrapper[5120]: E0316 15:33:42.317466 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 15:33:42.817444409 +0000 UTC m=+124.971376066 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:42 crc kubenswrapper[5120]: I0316 15:33:42.317719 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-66587d64c8-blgcz\" (UID: \"6528b019-774e-4298-abe6-69f062f0a13e\") " pod="openshift-image-registry/image-registry-66587d64c8-blgcz" Mar 16 15:33:42 crc kubenswrapper[5120]: E0316 15:33:42.320819 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName: nodeName:}" failed. No retries permitted until 2026-03-16 15:33:42.820803281 +0000 UTC m=+124.974734938 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "image-registry-66587d64c8-blgcz" (UID: "6528b019-774e-4298-abe6-69f062f0a13e") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:42 crc kubenswrapper[5120]: I0316 15:33:42.424515 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 15:33:42 crc kubenswrapper[5120]: E0316 15:33:42.425179 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 15:33:42.925165027 +0000 UTC m=+125.079096684 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:42 crc kubenswrapper[5120]: I0316 15:33:42.528635 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-66587d64c8-blgcz\" (UID: \"6528b019-774e-4298-abe6-69f062f0a13e\") " pod="openshift-image-registry/image-registry-66587d64c8-blgcz" Mar 16 15:33:42 crc kubenswrapper[5120]: E0316 15:33:42.529043 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName: nodeName:}" failed. No retries permitted until 2026-03-16 15:33:43.02902901 +0000 UTC m=+125.182960667 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "image-registry-66587d64c8-blgcz" (UID: "6528b019-774e-4298-abe6-69f062f0a13e") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:42 crc kubenswrapper[5120]: I0316 15:33:42.629618 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 15:33:42 crc kubenswrapper[5120]: E0316 15:33:42.629999 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 15:33:43.129965163 +0000 UTC m=+125.283896820 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:42 crc kubenswrapper[5120]: I0316 15:33:42.630243 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-66587d64c8-blgcz\" (UID: \"6528b019-774e-4298-abe6-69f062f0a13e\") " pod="openshift-image-registry/image-registry-66587d64c8-blgcz" Mar 16 15:33:42 crc kubenswrapper[5120]: E0316 15:33:42.630627 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName: nodeName:}" failed. No retries permitted until 2026-03-16 15:33:43.130613041 +0000 UTC m=+125.284544698 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "image-registry-66587d64c8-blgcz" (UID: "6528b019-774e-4298-abe6-69f062f0a13e") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:42 crc kubenswrapper[5120]: I0316 15:33:42.731129 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 15:33:42 crc kubenswrapper[5120]: E0316 15:33:42.731534 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 15:33:43.231519494 +0000 UTC m=+125.385451141 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:42 crc kubenswrapper[5120]: I0316 15:33:42.836122 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-66587d64c8-blgcz\" (UID: \"6528b019-774e-4298-abe6-69f062f0a13e\") " pod="openshift-image-registry/image-registry-66587d64c8-blgcz" Mar 16 15:33:42 crc kubenswrapper[5120]: E0316 15:33:42.836412 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName: nodeName:}" failed. No retries permitted until 2026-03-16 15:33:43.336400625 +0000 UTC m=+125.490332282 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "image-registry-66587d64c8-blgcz" (UID: "6528b019-774e-4298-abe6-69f062f0a13e") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:42 crc kubenswrapper[5120]: I0316 15:33:42.937644 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 15:33:42 crc kubenswrapper[5120]: E0316 15:33:42.938035 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 15:33:43.438018307 +0000 UTC m=+125.591949964 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:43 crc kubenswrapper[5120]: I0316 15:33:43.039345 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-66587d64c8-blgcz\" (UID: \"6528b019-774e-4298-abe6-69f062f0a13e\") " pod="openshift-image-registry/image-registry-66587d64c8-blgcz" Mar 16 15:33:43 crc kubenswrapper[5120]: E0316 15:33:43.039701 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName: nodeName:}" failed. No retries permitted until 2026-03-16 15:33:43.53967826 +0000 UTC m=+125.693609917 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "image-registry-66587d64c8-blgcz" (UID: "6528b019-774e-4298-abe6-69f062f0a13e") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:43 crc kubenswrapper[5120]: I0316 15:33:43.140988 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 15:33:43 crc kubenswrapper[5120]: E0316 15:33:43.141203 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 15:33:43.641165469 +0000 UTC m=+125.795097126 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:43 crc kubenswrapper[5120]: I0316 15:33:43.141780 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-66587d64c8-blgcz\" (UID: \"6528b019-774e-4298-abe6-69f062f0a13e\") " pod="openshift-image-registry/image-registry-66587d64c8-blgcz" Mar 16 15:33:43 crc kubenswrapper[5120]: E0316 15:33:43.142108 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName: nodeName:}" failed. No retries permitted until 2026-03-16 15:33:43.642100014 +0000 UTC m=+125.796031671 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "image-registry-66587d64c8-blgcz" (UID: "6528b019-774e-4298-abe6-69f062f0a13e") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:43 crc kubenswrapper[5120]: I0316 15:33:43.242596 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 15:33:43 crc kubenswrapper[5120]: E0316 15:33:43.242801 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 15:33:43.74277347 +0000 UTC m=+125.896705127 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:43 crc kubenswrapper[5120]: I0316 15:33:43.242985 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-66587d64c8-blgcz\" (UID: \"6528b019-774e-4298-abe6-69f062f0a13e\") " pod="openshift-image-registry/image-registry-66587d64c8-blgcz" Mar 16 15:33:43 crc kubenswrapper[5120]: E0316 15:33:43.243373 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName: nodeName:}" failed. No retries permitted until 2026-03-16 15:33:43.743354487 +0000 UTC m=+125.897286144 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "image-registry-66587d64c8-blgcz" (UID: "6528b019-774e-4298-abe6-69f062f0a13e") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:43 crc kubenswrapper[5120]: I0316 15:33:43.245175 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-866fcbc849-btql4" event={"ID":"fce4951f-be1c-4a0b-a8f8-0111e10df5da","Type":"ContainerStarted","Data":"310db06b0a2ee592599db20897875f38e7d5872344901c542262e99f1338b9e4"} Mar 16 15:33:43 crc kubenswrapper[5120]: I0316 15:33:43.246798 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/cluster-image-registry-operator-86c45576b9-bl65j" event={"ID":"694287b7-37ad-49df-b06d-71eea425d072","Type":"ContainerStarted","Data":"0e538506b3342599f640170994b2dc9bf8674672f37e3f2ef85ea9a7d7a7ace4"} Mar 16 15:33:43 crc kubenswrapper[5120]: I0316 15:33:43.248029 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-74545575db-s2zdg" event={"ID":"fc938b44-173b-4a97-b756-31525f6878f4","Type":"ContainerStarted","Data":"1fafa0625bcefd19da972bb89d7bf760d04d3161c2ba5c8854ccaa9bdce452b2"} Mar 16 15:33:43 crc kubenswrapper[5120]: I0316 15:33:43.248714 5120 patch_prober.go:28] interesting pod/router-default-68cf44c8b8-rsmpr container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Mar 16 15:33:43 crc kubenswrapper[5120]: [-]has-synced failed: reason withheld Mar 16 15:33:43 crc kubenswrapper[5120]: [+]process-running ok Mar 16 15:33:43 crc kubenswrapper[5120]: healthz check failed Mar 16 15:33:43 crc kubenswrapper[5120]: I0316 15:33:43.248763 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-68cf44c8b8-rsmpr" podUID="5b94b756-5f20-4937-a8a7-11471f916640" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Mar 16 15:33:43 crc kubenswrapper[5120]: I0316 15:33:43.249076 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-c58l9" event={"ID":"a789838a-6c8b-4672-a5d7-decb77a7e217","Type":"ContainerStarted","Data":"0a612e2b542045dd9df2d080ae2ecacd8bc82653694d28591f81227957134852"} Mar 16 15:33:43 crc kubenswrapper[5120]: I0316 15:33:43.251284 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-controller-f9cdd68f7-ljkbj" event={"ID":"2b813265-fb01-4449-804c-7cae0739518d","Type":"ContainerStarted","Data":"b56235d6888e6fd58ead113039788b1bfb4e741c214a22533421de7c978e668f"} Mar 16 15:33:43 crc kubenswrapper[5120]: I0316 15:33:43.252664 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/marketplace-operator-547dbd544d-gp852" event={"ID":"a0b763d7-65d4-41e1-9880-8f80e9686189","Type":"ContainerStarted","Data":"0c33d76eb2d5ce3e65e693dbd6ef8dc3118bfcdd1cd6f0be9ce39935423c32e6"} Mar 16 15:33:43 crc kubenswrapper[5120]: I0316 15:33:43.253260 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-marketplace/marketplace-operator-547dbd544d-gp852" Mar 16 15:33:43 crc kubenswrapper[5120]: I0316 15:33:43.254531 5120 patch_prober.go:28] interesting pod/marketplace-operator-547dbd544d-gp852 container/marketplace-operator namespace/openshift-marketplace: Readiness probe status=failure output="Get \"http://10.217.0.27:8080/healthz\": dial tcp 10.217.0.27:8080: connect: connection refused" start-of-body= Mar 16 15:33:43 crc kubenswrapper[5120]: I0316 15:33:43.254567 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-marketplace/marketplace-operator-547dbd544d-gp852" podUID="a0b763d7-65d4-41e1-9880-8f80e9686189" containerName="marketplace-operator" probeResult="failure" output="Get \"http://10.217.0.27:8080/healthz\": dial tcp 10.217.0.27:8080: connect: connection refused" Mar 16 15:33:43 crc kubenswrapper[5120]: I0316 15:33:43.259130 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-operator-67c9d58cbb-wmklh" event={"ID":"d8d90bff-3ac2-4cff-aaa4-7072a4811400","Type":"ContainerStarted","Data":"417dfcb4ee197ef2c0d8937a839bf6c1b31ac2759ef50583d84378916b2cb73c"} Mar 16 15:33:43 crc kubenswrapper[5120]: I0316 15:33:43.271446 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/packageserver-7d4fc7d867-bzv6d" event={"ID":"13808f6a-ec1e-4977-91af-50af631b3ef4","Type":"ContainerStarted","Data":"1717364314af645aa1390727088061a57d758234c0d5f7bb5842f357f60ee1df"} Mar 16 15:33:43 crc kubenswrapper[5120]: I0316 15:33:43.272533 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operator-lifecycle-manager/packageserver-7d4fc7d867-bzv6d" Mar 16 15:33:43 crc kubenswrapper[5120]: I0316 15:33:43.273644 5120 patch_prober.go:28] interesting pod/packageserver-7d4fc7d867-bzv6d container/packageserver namespace/openshift-operator-lifecycle-manager: Readiness probe status=failure output="Get \"https://10.217.0.29:5443/healthz\": dial tcp 10.217.0.29:5443: connect: connection refused" start-of-body= Mar 16 15:33:43 crc kubenswrapper[5120]: I0316 15:33:43.273680 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-operator-lifecycle-manager/packageserver-7d4fc7d867-bzv6d" podUID="13808f6a-ec1e-4977-91af-50af631b3ef4" containerName="packageserver" probeResult="failure" output="Get \"https://10.217.0.29:5443/healthz\": dial tcp 10.217.0.29:5443: connect: connection refused" Mar 16 15:33:43 crc kubenswrapper[5120]: I0316 15:33:43.278221 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xr8r2" event={"ID":"4464728a-4869-4476-83de-cb34577ace7f","Type":"ContainerStarted","Data":"617b119fa6e70623ddf713e7a06696ffdf99b713c8b04a27e31ca6e7417093bc"} Mar 16 15:33:43 crc kubenswrapper[5120]: I0316 15:33:43.278293 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xr8r2" event={"ID":"4464728a-4869-4476-83de-cb34577ace7f","Type":"ContainerStarted","Data":"5d60735144cbd8b8a58212588f54431e2006035e9136081b7ae377fbff0c798d"} Mar 16 15:33:43 crc kubenswrapper[5120]: I0316 15:33:43.283938 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/package-server-manager-77f986bd66-wknnz" event={"ID":"042810cc-b42e-4229-9c69-ab3eb1baab28","Type":"ContainerStarted","Data":"592e9b70c12791e86d9fc52f1b0b1660e7599799cded2972557b6a2467ea48ac"} Mar 16 15:33:43 crc kubenswrapper[5120]: I0316 15:33:43.284004 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/package-server-manager-77f986bd66-wknnz" event={"ID":"042810cc-b42e-4229-9c69-ab3eb1baab28","Type":"ContainerStarted","Data":"29fce6243359ad7c5f60ddae4b47dc4bf9372617f888a52371653f881450ced0"} Mar 16 15:33:43 crc kubenswrapper[5120]: I0316 15:33:43.284269 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-866fcbc849-btql4" podStartSLOduration=104.284256748 podStartE2EDuration="1m44.284256748s" podCreationTimestamp="2026-03-16 15:31:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:33:43.265266032 +0000 UTC m=+125.419197689" watchObservedRunningTime="2026-03-16 15:33:43.284256748 +0000 UTC m=+125.438188405" Mar 16 15:33:43 crc kubenswrapper[5120]: I0316 15:33:43.284307 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operator-lifecycle-manager/package-server-manager-77f986bd66-wknnz" Mar 16 15:33:43 crc kubenswrapper[5120]: I0316 15:33:43.285522 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-c58l9" podStartSLOduration=8.285517473 podStartE2EDuration="8.285517473s" podCreationTimestamp="2026-03-16 15:33:35 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:33:43.283850537 +0000 UTC m=+125.437782194" watchObservedRunningTime="2026-03-16 15:33:43.285517473 +0000 UTC m=+125.439449130" Mar 16 15:33:43 crc kubenswrapper[5120]: I0316 15:33:43.296446 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager-operator/kube-controller-manager-operator-69d5f845f8-6nn27" event={"ID":"50822c67-9654-449a-869f-cf28fb1fff4d","Type":"ContainerStarted","Data":"335c294802b7a9a97743a579fd2862919fb54858a49546ebfb5a6644078c01fe"} Mar 16 15:33:43 crc kubenswrapper[5120]: I0316 15:33:43.301145 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-oauth-apiserver/apiserver-8596bd845d-jb8bk" event={"ID":"e8637b4d-e12e-4c41-adc5-649e5bab46ad","Type":"ContainerStarted","Data":"10091b2ad4121acee2c4eb229bb9557a2445bf7c48e7ffd8bc31a53e3dbb6801"} Mar 16 15:33:43 crc kubenswrapper[5120]: I0316 15:33:43.303014 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/collect-profiles-29561250-7npz6" event={"ID":"deae033b-c4b8-462c-b29b-5115eb40a94b","Type":"ContainerStarted","Data":"5495fdca7ff98e7d65c6e9fa4a7e7a415f3fe957b30dba968a778b5194847078"} Mar 16 15:33:43 crc kubenswrapper[5120]: I0316 15:33:43.304145 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-747b44746d-pjv44" event={"ID":"b064c090-1362-427c-b805-d2808c01b58c","Type":"ContainerStarted","Data":"65945912ede768c3615627c45814b5cc576ea83232a5a40370fa49f11ca3edbf"} Mar 16 15:33:43 crc kubenswrapper[5120]: I0316 15:33:43.304196 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-747b44746d-pjv44" Mar 16 15:33:43 crc kubenswrapper[5120]: I0316 15:33:43.307871 5120 patch_prober.go:28] interesting pod/downloads-747b44746d-pjv44 container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.217.0.37:8080/\": dial tcp 10.217.0.37:8080: connect: connection refused" start-of-body= Mar 16 15:33:43 crc kubenswrapper[5120]: I0316 15:33:43.307922 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-747b44746d-pjv44" podUID="b064c090-1362-427c-b805-d2808c01b58c" containerName="download-server" probeResult="failure" output="Get \"http://10.217.0.37:8080/\": dial tcp 10.217.0.37:8080: connect: connection refused" Mar 16 15:33:43 crc kubenswrapper[5120]: I0316 15:33:43.320190 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-controller-manager/controller-manager-65b6cccf98-pbcg9" event={"ID":"f66781c9-aef5-4298-9f8a-b7f217906ed7","Type":"ContainerStarted","Data":"bd404a00b5bf827a50672a875e79a5ad0a50295e84bba99fe6601c1295819ac6"} Mar 16 15:33:43 crc kubenswrapper[5120]: I0316 15:33:43.320685 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-controller-manager/controller-manager-65b6cccf98-pbcg9" Mar 16 15:33:43 crc kubenswrapper[5120]: I0316 15:33:43.321730 5120 patch_prober.go:28] interesting pod/controller-manager-65b6cccf98-pbcg9 container/controller-manager namespace/openshift-controller-manager: Readiness probe status=failure output="Get \"https://10.217.0.19:8443/healthz\": dial tcp 10.217.0.19:8443: connect: connection refused" start-of-body= Mar 16 15:33:43 crc kubenswrapper[5120]: I0316 15:33:43.321790 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-controller-manager/controller-manager-65b6cccf98-pbcg9" podUID="f66781c9-aef5-4298-9f8a-b7f217906ed7" containerName="controller-manager" probeResult="failure" output="Get \"https://10.217.0.19:8443/healthz\": dial tcp 10.217.0.19:8443: connect: connection refused" Mar 16 15:33:43 crc kubenswrapper[5120]: I0316 15:33:43.324045 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6b564684c8-8tt42" event={"ID":"d9daa888-94fa-4afc-85a2-81b9dc9a5d3c","Type":"ContainerStarted","Data":"ed21361c107d01f986080624d48ffc48abe01057a258e69b39375bc47b385619"} Mar 16 15:33:43 crc kubenswrapper[5120]: I0316 15:33:43.324116 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6b564684c8-8tt42" event={"ID":"d9daa888-94fa-4afc-85a2-81b9dc9a5d3c","Type":"ContainerStarted","Data":"5ff7472fbfa82d11f0760ccec256d37a8f02da385b5721c9e6c6dc47943281cd"} Mar 16 15:33:43 crc kubenswrapper[5120]: I0316 15:33:43.331114 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/olm-operator-5cdf44d969-chq5d" event={"ID":"312c6c51-28c3-4d23-aa61-e01c5f36e0c9","Type":"ContainerStarted","Data":"dcaafaf5085feaf5659c389de32320402642c3b176d881ed875c089dbe858374"} Mar 16 15:33:43 crc kubenswrapper[5120]: I0316 15:33:43.331995 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operator-lifecycle-manager/olm-operator-5cdf44d969-chq5d" Mar 16 15:33:43 crc kubenswrapper[5120]: I0316 15:33:43.345476 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/catalog-operator-75ff9f647d-x5d5w" event={"ID":"7f53cb77-0d21-4cd7-81c0-d003500184f1","Type":"ContainerStarted","Data":"af160f46b56e7465ca7930c0926d2c81d89bc4d73fe0c22293a02940de9f414f"} Mar 16 15:33:43 crc kubenswrapper[5120]: I0316 15:33:43.346449 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operator-lifecycle-manager/catalog-operator-75ff9f647d-x5d5w" Mar 16 15:33:43 crc kubenswrapper[5120]: I0316 15:33:43.347781 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 15:33:43 crc kubenswrapper[5120]: E0316 15:33:43.348348 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 15:33:43.848314119 +0000 UTC m=+126.002245786 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:43 crc kubenswrapper[5120]: I0316 15:33:43.358985 5120 patch_prober.go:28] interesting pod/olm-operator-5cdf44d969-chq5d container/olm-operator namespace/openshift-operator-lifecycle-manager: Readiness probe status=failure output="Get \"https://10.217.0.35:8443/healthz\": dial tcp 10.217.0.35:8443: connect: connection refused" start-of-body= Mar 16 15:33:43 crc kubenswrapper[5120]: I0316 15:33:43.359067 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-operator-lifecycle-manager/olm-operator-5cdf44d969-chq5d" podUID="312c6c51-28c3-4d23-aa61-e01c5f36e0c9" containerName="olm-operator" probeResult="failure" output="Get \"https://10.217.0.35:8443/healthz\": dial tcp 10.217.0.35:8443: connect: connection refused" Mar 16 15:33:43 crc kubenswrapper[5120]: I0316 15:33:43.360570 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-66587d64c8-blgcz\" (UID: \"6528b019-774e-4298-abe6-69f062f0a13e\") " pod="openshift-image-registry/image-registry-66587d64c8-blgcz" Mar 16 15:33:43 crc kubenswrapper[5120]: I0316 15:33:43.361301 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca/service-ca-74545575db-s2zdg" podStartSLOduration=103.361285172 podStartE2EDuration="1m43.361285172s" podCreationTimestamp="2026-03-16 15:32:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:33:43.31599851 +0000 UTC m=+125.469930167" watchObservedRunningTime="2026-03-16 15:33:43.361285172 +0000 UTC m=+125.515216829" Mar 16 15:33:43 crc kubenswrapper[5120]: I0316 15:33:43.368311 5120 generic.go:358] "Generic (PLEG): container finished" podID="92936655-647a-450f-a122-ff876adae5d3" containerID="2357753b456c64f7d5dee433934998c148e5d08534c972e23304d5dc88758b1c" exitCode=0 Mar 16 15:33:43 crc kubenswrapper[5120]: I0316 15:33:43.368416 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-config-operator/openshift-config-operator-5777786469-b8t64" event={"ID":"92936655-647a-450f-a122-ff876adae5d3","Type":"ContainerDied","Data":"2357753b456c64f7d5dee433934998c148e5d08534c972e23304d5dc88758b1c"} Mar 16 15:33:43 crc kubenswrapper[5120]: I0316 15:33:43.377403 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-admission-controller-69db94689b-6bcfh" event={"ID":"52bf262d-dc00-4318-af10-68291a53ce29","Type":"ContainerStarted","Data":"81bbe34ac1f9ca0a2cce0b92ea0652e1a91d08f3c444d1d107ca3c0796b6ed54"} Mar 16 15:33:43 crc kubenswrapper[5120]: I0316 15:33:43.379516 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/machine-config-controller-f9cdd68f7-ljkbj" podStartSLOduration=104.379491167 podStartE2EDuration="1m44.379491167s" podCreationTimestamp="2026-03-16 15:31:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:33:43.346787967 +0000 UTC m=+125.500719624" watchObservedRunningTime="2026-03-16 15:33:43.379491167 +0000 UTC m=+125.533422824" Mar 16 15:33:43 crc kubenswrapper[5120]: E0316 15:33:43.386924 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName: nodeName:}" failed. No retries permitted until 2026-03-16 15:33:43.886905168 +0000 UTC m=+126.040836825 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "image-registry-66587d64c8-blgcz" (UID: "6528b019-774e-4298-abe6-69f062f0a13e") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:43 crc kubenswrapper[5120]: I0316 15:33:43.392865 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operator-lifecycle-manager/catalog-operator-75ff9f647d-x5d5w" Mar 16 15:33:43 crc kubenswrapper[5120]: I0316 15:33:43.430974 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9x6jk" event={"ID":"2b3d1db6-fcdf-4574-9e43-093e46cc3e0d","Type":"ContainerStarted","Data":"4302aa6a46754d82523ca33c31c509f4ef2433f2e1382ab3b9cbdf391bd5726d"} Mar 16 15:33:43 crc kubenswrapper[5120]: I0316 15:33:43.431029 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9x6jk" event={"ID":"2b3d1db6-fcdf-4574-9e43-093e46cc3e0d","Type":"ContainerStarted","Data":"a602e51fe0511e817d51e123f8d4fb3cb9dcff238f01519cd2fa542ff7f44334"} Mar 16 15:33:43 crc kubenswrapper[5120]: I0316 15:33:43.432349 5120 ???:1] "http: TLS handshake error from 192.168.126.11:57432: no serving certificate available for the kubelet" Mar 16 15:33:43 crc kubenswrapper[5120]: I0316 15:33:43.433808 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/marketplace-operator-547dbd544d-gp852" podStartSLOduration=104.433798623 podStartE2EDuration="1m44.433798623s" podCreationTimestamp="2026-03-16 15:31:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:33:43.433574716 +0000 UTC m=+125.587506373" watchObservedRunningTime="2026-03-16 15:33:43.433798623 +0000 UTC m=+125.587730280" Mar 16 15:33:43 crc kubenswrapper[5120]: I0316 15:33:43.442018 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-multus/cni-sysctl-allowlist-ds-95s4s" podUID="6f966d74-f323-4f45-9fbb-8160d73b7770" containerName="kube-multus-additional-cni-plugins" containerID="cri-o://608acba293e4ec2584154dbd4574825f128737103e0ed75e45e1396d200d2099" gracePeriod=30 Mar 16 15:33:43 crc kubenswrapper[5120]: I0316 15:33:43.442123 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-9x6jk" Mar 16 15:33:43 crc kubenswrapper[5120]: I0316 15:33:43.458563 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/machine-config-operator-67c9d58cbb-wmklh" podStartSLOduration=104.458546345 podStartE2EDuration="1m44.458546345s" podCreationTimestamp="2026-03-16 15:31:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:33:43.457625141 +0000 UTC m=+125.611556808" watchObservedRunningTime="2026-03-16 15:33:43.458546345 +0000 UTC m=+125.612478002" Mar 16 15:33:43 crc kubenswrapper[5120]: I0316 15:33:43.462784 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 15:33:43 crc kubenswrapper[5120]: E0316 15:33:43.463506 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 15:33:43.96348969 +0000 UTC m=+126.117421347 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:43 crc kubenswrapper[5120]: I0316 15:33:43.538472 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-controller-manager/controller-manager-65b6cccf98-pbcg9" podStartSLOduration=104.538452677 podStartE2EDuration="1m44.538452677s" podCreationTimestamp="2026-03-16 15:31:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:33:43.494594565 +0000 UTC m=+125.648526212" watchObservedRunningTime="2026-03-16 15:33:43.538452677 +0000 UTC m=+125.692384334" Mar 16 15:33:43 crc kubenswrapper[5120]: I0316 15:33:43.565393 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-66587d64c8-blgcz\" (UID: \"6528b019-774e-4298-abe6-69f062f0a13e\") " pod="openshift-image-registry/image-registry-66587d64c8-blgcz" Mar 16 15:33:43 crc kubenswrapper[5120]: E0316 15:33:43.568210 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName: nodeName:}" failed. No retries permitted until 2026-03-16 15:33:44.068185646 +0000 UTC m=+126.222117373 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "image-registry-66587d64c8-blgcz" (UID: "6528b019-774e-4298-abe6-69f062f0a13e") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:43 crc kubenswrapper[5120]: I0316 15:33:43.570060 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operator-lifecycle-manager/olm-operator-5cdf44d969-chq5d" podStartSLOduration=103.570045256 podStartE2EDuration="1m43.570045256s" podCreationTimestamp="2026-03-16 15:32:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:33:43.540541044 +0000 UTC m=+125.694472701" watchObservedRunningTime="2026-03-16 15:33:43.570045256 +0000 UTC m=+125.723976923" Mar 16 15:33:43 crc kubenswrapper[5120]: I0316 15:33:43.577651 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/downloads-747b44746d-pjv44" podStartSLOduration=104.577630062 podStartE2EDuration="1m44.577630062s" podCreationTimestamp="2026-03-16 15:31:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:33:43.569147811 +0000 UTC m=+125.723079468" watchObservedRunningTime="2026-03-16 15:33:43.577630062 +0000 UTC m=+125.731561719" Mar 16 15:33:43 crc kubenswrapper[5120]: I0316 15:33:43.600084 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operator-lifecycle-manager/catalog-operator-75ff9f647d-x5d5w" podStartSLOduration=103.600069132 podStartE2EDuration="1m43.600069132s" podCreationTimestamp="2026-03-16 15:32:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:33:43.594961254 +0000 UTC m=+125.748892911" watchObservedRunningTime="2026-03-16 15:33:43.600069132 +0000 UTC m=+125.754000789" Mar 16 15:33:43 crc kubenswrapper[5120]: I0316 15:33:43.621251 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operator-lifecycle-manager/collect-profiles-29561250-7npz6" podStartSLOduration=103.621234077 podStartE2EDuration="1m43.621234077s" podCreationTimestamp="2026-03-16 15:32:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:33:43.620528418 +0000 UTC m=+125.774460075" watchObservedRunningTime="2026-03-16 15:33:43.621234077 +0000 UTC m=+125.775165734" Mar 16 15:33:43 crc kubenswrapper[5120]: I0316 15:33:43.667716 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 15:33:43 crc kubenswrapper[5120]: E0316 15:33:43.668125 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 15:33:44.168107902 +0000 UTC m=+126.322039559 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:43 crc kubenswrapper[5120]: I0316 15:33:43.683902 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-6b564684c8-8tt42" podStartSLOduration=104.6838872 podStartE2EDuration="1m44.6838872s" podCreationTimestamp="2026-03-16 15:31:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:33:43.683007227 +0000 UTC m=+125.836938884" watchObservedRunningTime="2026-03-16 15:33:43.6838872 +0000 UTC m=+125.837818847" Mar 16 15:33:43 crc kubenswrapper[5120]: I0316 15:33:43.740344 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-xr8r2" podStartSLOduration=104.740328034 podStartE2EDuration="1m44.740328034s" podCreationTimestamp="2026-03-16 15:31:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:33:43.718709767 +0000 UTC m=+125.872641414" watchObservedRunningTime="2026-03-16 15:33:43.740328034 +0000 UTC m=+125.894259681" Mar 16 15:33:43 crc kubenswrapper[5120]: I0316 15:33:43.741127 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-controller-manager-operator/kube-controller-manager-operator-69d5f845f8-6nn27" podStartSLOduration=104.741122986 podStartE2EDuration="1m44.741122986s" podCreationTimestamp="2026-03-16 15:31:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:33:43.739694847 +0000 UTC m=+125.893626504" watchObservedRunningTime="2026-03-16 15:33:43.741122986 +0000 UTC m=+125.895054643" Mar 16 15:33:43 crc kubenswrapper[5120]: I0316 15:33:43.765264 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-admission-controller-69db94689b-6bcfh" podStartSLOduration=104.765246782 podStartE2EDuration="1m44.765246782s" podCreationTimestamp="2026-03-16 15:31:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:33:43.765227341 +0000 UTC m=+125.919158988" watchObservedRunningTime="2026-03-16 15:33:43.765246782 +0000 UTC m=+125.919178439" Mar 16 15:33:43 crc kubenswrapper[5120]: I0316 15:33:43.769599 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-66587d64c8-blgcz\" (UID: \"6528b019-774e-4298-abe6-69f062f0a13e\") " pod="openshift-image-registry/image-registry-66587d64c8-blgcz" Mar 16 15:33:43 crc kubenswrapper[5120]: E0316 15:33:43.770245 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName: nodeName:}" failed. No retries permitted until 2026-03-16 15:33:44.270232477 +0000 UTC m=+126.424164134 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "image-registry-66587d64c8-blgcz" (UID: "6528b019-774e-4298-abe6-69f062f0a13e") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:43 crc kubenswrapper[5120]: I0316 15:33:43.799479 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operator-lifecycle-manager/package-server-manager-77f986bd66-wknnz" podStartSLOduration=103.799461272 podStartE2EDuration="1m43.799461272s" podCreationTimestamp="2026-03-16 15:32:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:33:43.799441602 +0000 UTC m=+125.953373249" watchObservedRunningTime="2026-03-16 15:33:43.799461272 +0000 UTC m=+125.953392929" Mar 16 15:33:43 crc kubenswrapper[5120]: I0316 15:33:43.864793 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-oauth-apiserver/apiserver-8596bd845d-jb8bk" podStartSLOduration=104.864752636 podStartE2EDuration="1m44.864752636s" podCreationTimestamp="2026-03-16 15:31:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:33:43.838078701 +0000 UTC m=+125.992010348" watchObservedRunningTime="2026-03-16 15:33:43.864752636 +0000 UTC m=+126.018684293" Mar 16 15:33:43 crc kubenswrapper[5120]: I0316 15:33:43.874539 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 15:33:43 crc kubenswrapper[5120]: E0316 15:33:43.875018 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 15:33:44.375000815 +0000 UTC m=+126.528932462 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:43 crc kubenswrapper[5120]: I0316 15:33:43.894656 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operator-lifecycle-manager/packageserver-7d4fc7d867-bzv6d" podStartSLOduration=103.894637529 podStartE2EDuration="1m43.894637529s" podCreationTimestamp="2026-03-16 15:32:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:33:43.86746204 +0000 UTC m=+126.021393697" watchObservedRunningTime="2026-03-16 15:33:43.894637529 +0000 UTC m=+126.048569186" Mar 16 15:33:43 crc kubenswrapper[5120]: I0316 15:33:43.895740 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-9x6jk" podStartSLOduration=8.895734058 podStartE2EDuration="8.895734058s" podCreationTimestamp="2026-03-16 15:33:35 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:33:43.893627771 +0000 UTC m=+126.047559428" watchObservedRunningTime="2026-03-16 15:33:43.895734058 +0000 UTC m=+126.049665715" Mar 16 15:33:43 crc kubenswrapper[5120]: I0316 15:33:43.976652 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-66587d64c8-blgcz\" (UID: \"6528b019-774e-4298-abe6-69f062f0a13e\") " pod="openshift-image-registry/image-registry-66587d64c8-blgcz" Mar 16 15:33:43 crc kubenswrapper[5120]: E0316 15:33:43.977104 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName: nodeName:}" failed. No retries permitted until 2026-03-16 15:33:44.4770879 +0000 UTC m=+126.631019557 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "image-registry-66587d64c8-blgcz" (UID: "6528b019-774e-4298-abe6-69f062f0a13e") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:43 crc kubenswrapper[5120]: I0316 15:33:43.978794 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-authentication/oauth-openshift-66458b6674-fvnvr" Mar 16 15:33:44 crc kubenswrapper[5120]: I0316 15:33:44.078529 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 15:33:44 crc kubenswrapper[5120]: E0316 15:33:44.078719 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 15:33:44.578692871 +0000 UTC m=+126.732624528 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:44 crc kubenswrapper[5120]: I0316 15:33:44.080888 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-66587d64c8-blgcz\" (UID: \"6528b019-774e-4298-abe6-69f062f0a13e\") " pod="openshift-image-registry/image-registry-66587d64c8-blgcz" Mar 16 15:33:44 crc kubenswrapper[5120]: E0316 15:33:44.081195 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName: nodeName:}" failed. No retries permitted until 2026-03-16 15:33:44.581183379 +0000 UTC m=+126.735115036 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "image-registry-66587d64c8-blgcz" (UID: "6528b019-774e-4298-abe6-69f062f0a13e") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:44 crc kubenswrapper[5120]: I0316 15:33:44.182522 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 15:33:44 crc kubenswrapper[5120]: E0316 15:33:44.183330 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 15:33:44.683313025 +0000 UTC m=+126.837244682 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:44 crc kubenswrapper[5120]: I0316 15:33:44.246123 5120 patch_prober.go:28] interesting pod/router-default-68cf44c8b8-rsmpr container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Mar 16 15:33:44 crc kubenswrapper[5120]: [-]has-synced failed: reason withheld Mar 16 15:33:44 crc kubenswrapper[5120]: [+]process-running ok Mar 16 15:33:44 crc kubenswrapper[5120]: healthz check failed Mar 16 15:33:44 crc kubenswrapper[5120]: I0316 15:33:44.246391 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-68cf44c8b8-rsmpr" podUID="5b94b756-5f20-4937-a8a7-11471f916640" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Mar 16 15:33:44 crc kubenswrapper[5120]: I0316 15:33:44.284684 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-66587d64c8-blgcz\" (UID: \"6528b019-774e-4298-abe6-69f062f0a13e\") " pod="openshift-image-registry/image-registry-66587d64c8-blgcz" Mar 16 15:33:44 crc kubenswrapper[5120]: E0316 15:33:44.285056 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName: nodeName:}" failed. No retries permitted until 2026-03-16 15:33:44.785044661 +0000 UTC m=+126.938976318 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "image-registry-66587d64c8-blgcz" (UID: "6528b019-774e-4298-abe6-69f062f0a13e") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:44 crc kubenswrapper[5120]: I0316 15:33:44.385867 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 15:33:44 crc kubenswrapper[5120]: E0316 15:33:44.386142 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 15:33:44.886121688 +0000 UTC m=+127.040053345 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:44 crc kubenswrapper[5120]: I0316 15:33:44.448143 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-config-operator/openshift-config-operator-5777786469-b8t64" event={"ID":"92936655-647a-450f-a122-ff876adae5d3","Type":"ContainerStarted","Data":"bc58219ce0fd06f54d3517a9e851ac2f4559154619364aadfcb45ca631efb132"} Mar 16 15:33:44 crc kubenswrapper[5120]: I0316 15:33:44.449004 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-config-operator/openshift-config-operator-5777786469-b8t64" Mar 16 15:33:44 crc kubenswrapper[5120]: I0316 15:33:44.451635 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="hostpath-provisioner/csi-hostpathplugin-sqjrv" event={"ID":"9293198c-313b-43df-bd83-75eb148a1c77","Type":"ContainerStarted","Data":"f7c521bb03e102daeeb92cc390b9c0b5b66702a6c4b9d18e352ee70b10bd1dde"} Mar 16 15:33:44 crc kubenswrapper[5120]: I0316 15:33:44.455806 5120 patch_prober.go:28] interesting pod/marketplace-operator-547dbd544d-gp852 container/marketplace-operator namespace/openshift-marketplace: Readiness probe status=failure output="Get \"http://10.217.0.27:8080/healthz\": dial tcp 10.217.0.27:8080: connect: connection refused" start-of-body= Mar 16 15:33:44 crc kubenswrapper[5120]: I0316 15:33:44.456027 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-marketplace/marketplace-operator-547dbd544d-gp852" podUID="a0b763d7-65d4-41e1-9880-8f80e9686189" containerName="marketplace-operator" probeResult="failure" output="Get \"http://10.217.0.27:8080/healthz\": dial tcp 10.217.0.27:8080: connect: connection refused" Mar 16 15:33:44 crc kubenswrapper[5120]: I0316 15:33:44.457362 5120 patch_prober.go:28] interesting pod/downloads-747b44746d-pjv44 container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.217.0.37:8080/\": dial tcp 10.217.0.37:8080: connect: connection refused" start-of-body= Mar 16 15:33:44 crc kubenswrapper[5120]: I0316 15:33:44.458105 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-747b44746d-pjv44" podUID="b064c090-1362-427c-b805-d2808c01b58c" containerName="download-server" probeResult="failure" output="Get \"http://10.217.0.37:8080/\": dial tcp 10.217.0.37:8080: connect: connection refused" Mar 16 15:33:44 crc kubenswrapper[5120]: I0316 15:33:44.477814 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-config-operator/openshift-config-operator-5777786469-b8t64" podStartSLOduration=105.477795739 podStartE2EDuration="1m45.477795739s" podCreationTimestamp="2026-03-16 15:31:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:33:44.475553689 +0000 UTC m=+126.629485356" watchObservedRunningTime="2026-03-16 15:33:44.477795739 +0000 UTC m=+126.631727396" Mar 16 15:33:44 crc kubenswrapper[5120]: I0316 15:33:44.486931 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-66587d64c8-blgcz\" (UID: \"6528b019-774e-4298-abe6-69f062f0a13e\") " pod="openshift-image-registry/image-registry-66587d64c8-blgcz" Mar 16 15:33:44 crc kubenswrapper[5120]: E0316 15:33:44.487257 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName: nodeName:}" failed. No retries permitted until 2026-03-16 15:33:44.987246156 +0000 UTC m=+127.141177803 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "image-registry-66587d64c8-blgcz" (UID: "6528b019-774e-4298-abe6-69f062f0a13e") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:44 crc kubenswrapper[5120]: I0316 15:33:44.544349 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operator-lifecycle-manager/olm-operator-5cdf44d969-chq5d" Mar 16 15:33:44 crc kubenswrapper[5120]: I0316 15:33:44.593079 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 15:33:44 crc kubenswrapper[5120]: E0316 15:33:44.599085 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 15:33:45.099061706 +0000 UTC m=+127.252993373 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:44 crc kubenswrapper[5120]: I0316 15:33:44.687163 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-controller-manager/controller-manager-65b6cccf98-pbcg9" Mar 16 15:33:44 crc kubenswrapper[5120]: I0316 15:33:44.697398 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-66587d64c8-blgcz\" (UID: \"6528b019-774e-4298-abe6-69f062f0a13e\") " pod="openshift-image-registry/image-registry-66587d64c8-blgcz" Mar 16 15:33:44 crc kubenswrapper[5120]: E0316 15:33:44.697732 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName: nodeName:}" failed. No retries permitted until 2026-03-16 15:33:45.197720397 +0000 UTC m=+127.351652054 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "image-registry-66587d64c8-blgcz" (UID: "6528b019-774e-4298-abe6-69f062f0a13e") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:44 crc kubenswrapper[5120]: I0316 15:33:44.798857 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 15:33:44 crc kubenswrapper[5120]: E0316 15:33:44.799078 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 15:33:45.299041062 +0000 UTC m=+127.452972719 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:44 crc kubenswrapper[5120]: I0316 15:33:44.804374 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/certified-operators-zz5g5"] Mar 16 15:33:44 crc kubenswrapper[5120]: I0316 15:33:44.817530 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-zz5g5" Mar 16 15:33:44 crc kubenswrapper[5120]: I0316 15:33:44.820778 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"certified-operators-dockercfg-7cl8d\"" Mar 16 15:33:44 crc kubenswrapper[5120]: I0316 15:33:44.828414 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/certified-operators-zz5g5"] Mar 16 15:33:44 crc kubenswrapper[5120]: I0316 15:33:44.900258 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-66587d64c8-blgcz\" (UID: \"6528b019-774e-4298-abe6-69f062f0a13e\") " pod="openshift-image-registry/image-registry-66587d64c8-blgcz" Mar 16 15:33:44 crc kubenswrapper[5120]: I0316 15:33:44.900321 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/f4f60942-f576-4e00-88be-a52a1e6d91ec-catalog-content\") pod \"certified-operators-zz5g5\" (UID: \"f4f60942-f576-4e00-88be-a52a1e6d91ec\") " pod="openshift-marketplace/certified-operators-zz5g5" Mar 16 15:33:44 crc kubenswrapper[5120]: I0316 15:33:44.900353 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpxkd\" (UniqueName: \"kubernetes.io/projected/f4f60942-f576-4e00-88be-a52a1e6d91ec-kube-api-access-bpxkd\") pod \"certified-operators-zz5g5\" (UID: \"f4f60942-f576-4e00-88be-a52a1e6d91ec\") " pod="openshift-marketplace/certified-operators-zz5g5" Mar 16 15:33:44 crc kubenswrapper[5120]: I0316 15:33:44.900452 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/f4f60942-f576-4e00-88be-a52a1e6d91ec-utilities\") pod \"certified-operators-zz5g5\" (UID: \"f4f60942-f576-4e00-88be-a52a1e6d91ec\") " pod="openshift-marketplace/certified-operators-zz5g5" Mar 16 15:33:44 crc kubenswrapper[5120]: E0316 15:33:44.900707 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName: nodeName:}" failed. No retries permitted until 2026-03-16 15:33:45.400689294 +0000 UTC m=+127.554620951 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "image-registry-66587d64c8-blgcz" (UID: "6528b019-774e-4298-abe6-69f062f0a13e") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:44 crc kubenswrapper[5120]: I0316 15:33:44.995409 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/community-operators-bzrbr"] Mar 16 15:33:44 crc kubenswrapper[5120]: I0316 15:33:44.999352 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-bzrbr" Mar 16 15:33:45 crc kubenswrapper[5120]: I0316 15:33:45.001129 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 15:33:45 crc kubenswrapper[5120]: I0316 15:33:45.001260 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"community-operators-dockercfg-vrd5f\"" Mar 16 15:33:45 crc kubenswrapper[5120]: E0316 15:33:45.001275 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 15:33:45.501256468 +0000 UTC m=+127.655188125 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:45 crc kubenswrapper[5120]: I0316 15:33:45.001579 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/f4f60942-f576-4e00-88be-a52a1e6d91ec-utilities\") pod \"certified-operators-zz5g5\" (UID: \"f4f60942-f576-4e00-88be-a52a1e6d91ec\") " pod="openshift-marketplace/certified-operators-zz5g5" Mar 16 15:33:45 crc kubenswrapper[5120]: I0316 15:33:45.001627 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-66587d64c8-blgcz\" (UID: \"6528b019-774e-4298-abe6-69f062f0a13e\") " pod="openshift-image-registry/image-registry-66587d64c8-blgcz" Mar 16 15:33:45 crc kubenswrapper[5120]: I0316 15:33:45.001793 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/f4f60942-f576-4e00-88be-a52a1e6d91ec-catalog-content\") pod \"certified-operators-zz5g5\" (UID: \"f4f60942-f576-4e00-88be-a52a1e6d91ec\") " pod="openshift-marketplace/certified-operators-zz5g5" Mar 16 15:33:45 crc kubenswrapper[5120]: I0316 15:33:45.001843 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bpxkd\" (UniqueName: \"kubernetes.io/projected/f4f60942-f576-4e00-88be-a52a1e6d91ec-kube-api-access-bpxkd\") pod \"certified-operators-zz5g5\" (UID: \"f4f60942-f576-4e00-88be-a52a1e6d91ec\") " pod="openshift-marketplace/certified-operators-zz5g5" Mar 16 15:33:45 crc kubenswrapper[5120]: E0316 15:33:45.001903 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName: nodeName:}" failed. No retries permitted until 2026-03-16 15:33:45.501891594 +0000 UTC m=+127.655823251 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "image-registry-66587d64c8-blgcz" (UID: "6528b019-774e-4298-abe6-69f062f0a13e") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:45 crc kubenswrapper[5120]: I0316 15:33:45.002048 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/f4f60942-f576-4e00-88be-a52a1e6d91ec-utilities\") pod \"certified-operators-zz5g5\" (UID: \"f4f60942-f576-4e00-88be-a52a1e6d91ec\") " pod="openshift-marketplace/certified-operators-zz5g5" Mar 16 15:33:45 crc kubenswrapper[5120]: I0316 15:33:45.002111 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/f4f60942-f576-4e00-88be-a52a1e6d91ec-catalog-content\") pod \"certified-operators-zz5g5\" (UID: \"f4f60942-f576-4e00-88be-a52a1e6d91ec\") " pod="openshift-marketplace/certified-operators-zz5g5" Mar 16 15:33:45 crc kubenswrapper[5120]: I0316 15:33:45.016114 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/community-operators-bzrbr"] Mar 16 15:33:45 crc kubenswrapper[5120]: I0316 15:33:45.041328 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpxkd\" (UniqueName: \"kubernetes.io/projected/f4f60942-f576-4e00-88be-a52a1e6d91ec-kube-api-access-bpxkd\") pod \"certified-operators-zz5g5\" (UID: \"f4f60942-f576-4e00-88be-a52a1e6d91ec\") " pod="openshift-marketplace/certified-operators-zz5g5" Mar 16 15:33:45 crc kubenswrapper[5120]: I0316 15:33:45.103467 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 15:33:45 crc kubenswrapper[5120]: I0316 15:33:45.103677 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7k84n\" (UniqueName: \"kubernetes.io/projected/3529f46e-85a5-437e-8773-68d7dc6b6f9c-kube-api-access-7k84n\") pod \"community-operators-bzrbr\" (UID: \"3529f46e-85a5-437e-8773-68d7dc6b6f9c\") " pod="openshift-marketplace/community-operators-bzrbr" Mar 16 15:33:45 crc kubenswrapper[5120]: I0316 15:33:45.103706 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/3529f46e-85a5-437e-8773-68d7dc6b6f9c-utilities\") pod \"community-operators-bzrbr\" (UID: \"3529f46e-85a5-437e-8773-68d7dc6b6f9c\") " pod="openshift-marketplace/community-operators-bzrbr" Mar 16 15:33:45 crc kubenswrapper[5120]: I0316 15:33:45.103808 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/3529f46e-85a5-437e-8773-68d7dc6b6f9c-catalog-content\") pod \"community-operators-bzrbr\" (UID: \"3529f46e-85a5-437e-8773-68d7dc6b6f9c\") " pod="openshift-marketplace/community-operators-bzrbr" Mar 16 15:33:45 crc kubenswrapper[5120]: E0316 15:33:45.103910 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 15:33:45.603895047 +0000 UTC m=+127.757826694 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:45 crc kubenswrapper[5120]: I0316 15:33:45.131324 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-zz5g5" Mar 16 15:33:45 crc kubenswrapper[5120]: I0316 15:33:45.192440 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/certified-operators-n4gbm"] Mar 16 15:33:45 crc kubenswrapper[5120]: I0316 15:33:45.204710 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-scheduler/revision-pruner-6-crc"] Mar 16 15:33:45 crc kubenswrapper[5120]: I0316 15:33:45.204930 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-n4gbm" Mar 16 15:33:45 crc kubenswrapper[5120]: I0316 15:33:45.205484 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/3529f46e-85a5-437e-8773-68d7dc6b6f9c-catalog-content\") pod \"community-operators-bzrbr\" (UID: \"3529f46e-85a5-437e-8773-68d7dc6b6f9c\") " pod="openshift-marketplace/community-operators-bzrbr" Mar 16 15:33:45 crc kubenswrapper[5120]: I0316 15:33:45.205970 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7k84n\" (UniqueName: \"kubernetes.io/projected/3529f46e-85a5-437e-8773-68d7dc6b6f9c-kube-api-access-7k84n\") pod \"community-operators-bzrbr\" (UID: \"3529f46e-85a5-437e-8773-68d7dc6b6f9c\") " pod="openshift-marketplace/community-operators-bzrbr" Mar 16 15:33:45 crc kubenswrapper[5120]: I0316 15:33:45.206195 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/3529f46e-85a5-437e-8773-68d7dc6b6f9c-utilities\") pod \"community-operators-bzrbr\" (UID: \"3529f46e-85a5-437e-8773-68d7dc6b6f9c\") " pod="openshift-marketplace/community-operators-bzrbr" Mar 16 15:33:45 crc kubenswrapper[5120]: I0316 15:33:45.206220 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-66587d64c8-blgcz\" (UID: \"6528b019-774e-4298-abe6-69f062f0a13e\") " pod="openshift-image-registry/image-registry-66587d64c8-blgcz" Mar 16 15:33:45 crc kubenswrapper[5120]: E0316 15:33:45.206487 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName: nodeName:}" failed. No retries permitted until 2026-03-16 15:33:45.706475996 +0000 UTC m=+127.860407653 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "image-registry-66587d64c8-blgcz" (UID: "6528b019-774e-4298-abe6-69f062f0a13e") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:45 crc kubenswrapper[5120]: I0316 15:33:45.205912 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/3529f46e-85a5-437e-8773-68d7dc6b6f9c-catalog-content\") pod \"community-operators-bzrbr\" (UID: \"3529f46e-85a5-437e-8773-68d7dc6b6f9c\") " pod="openshift-marketplace/community-operators-bzrbr" Mar 16 15:33:45 crc kubenswrapper[5120]: I0316 15:33:45.207005 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/3529f46e-85a5-437e-8773-68d7dc6b6f9c-utilities\") pod \"community-operators-bzrbr\" (UID: \"3529f46e-85a5-437e-8773-68d7dc6b6f9c\") " pod="openshift-marketplace/community-operators-bzrbr" Mar 16 15:33:45 crc kubenswrapper[5120]: I0316 15:33:45.207938 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-scheduler/revision-pruner-6-crc"] Mar 16 15:33:45 crc kubenswrapper[5120]: I0316 15:33:45.207964 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/certified-operators-n4gbm"] Mar 16 15:33:45 crc kubenswrapper[5120]: I0316 15:33:45.208044 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler/revision-pruner-6-crc" Mar 16 15:33:45 crc kubenswrapper[5120]: I0316 15:33:45.212269 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-scheduler\"/\"installer-sa-dockercfg-qpkss\"" Mar 16 15:33:45 crc kubenswrapper[5120]: I0316 15:33:45.214492 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-scheduler\"/\"kube-root-ca.crt\"" Mar 16 15:33:45 crc kubenswrapper[5120]: I0316 15:33:45.233449 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7k84n\" (UniqueName: \"kubernetes.io/projected/3529f46e-85a5-437e-8773-68d7dc6b6f9c-kube-api-access-7k84n\") pod \"community-operators-bzrbr\" (UID: \"3529f46e-85a5-437e-8773-68d7dc6b6f9c\") " pod="openshift-marketplace/community-operators-bzrbr" Mar 16 15:33:45 crc kubenswrapper[5120]: I0316 15:33:45.245609 5120 patch_prober.go:28] interesting pod/router-default-68cf44c8b8-rsmpr container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Mar 16 15:33:45 crc kubenswrapper[5120]: [-]has-synced failed: reason withheld Mar 16 15:33:45 crc kubenswrapper[5120]: [+]process-running ok Mar 16 15:33:45 crc kubenswrapper[5120]: healthz check failed Mar 16 15:33:45 crc kubenswrapper[5120]: I0316 15:33:45.245988 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-68cf44c8b8-rsmpr" podUID="5b94b756-5f20-4937-a8a7-11471f916640" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Mar 16 15:33:45 crc kubenswrapper[5120]: I0316 15:33:45.310368 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 15:33:45 crc kubenswrapper[5120]: I0316 15:33:45.310489 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/523268a8-a14f-458e-bfe1-0a2ff7692fe4-kubelet-dir\") pod \"revision-pruner-6-crc\" (UID: \"523268a8-a14f-458e-bfe1-0a2ff7692fe4\") " pod="openshift-kube-scheduler/revision-pruner-6-crc" Mar 16 15:33:45 crc kubenswrapper[5120]: I0316 15:33:45.310520 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/523268a8-a14f-458e-bfe1-0a2ff7692fe4-kube-api-access\") pod \"revision-pruner-6-crc\" (UID: \"523268a8-a14f-458e-bfe1-0a2ff7692fe4\") " pod="openshift-kube-scheduler/revision-pruner-6-crc" Mar 16 15:33:45 crc kubenswrapper[5120]: I0316 15:33:45.310541 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/5910a375-22bc-4049-9165-8ce8298a85ba-utilities\") pod \"certified-operators-n4gbm\" (UID: \"5910a375-22bc-4049-9165-8ce8298a85ba\") " pod="openshift-marketplace/certified-operators-n4gbm" Mar 16 15:33:45 crc kubenswrapper[5120]: I0316 15:33:45.310614 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9g7z\" (UniqueName: \"kubernetes.io/projected/5910a375-22bc-4049-9165-8ce8298a85ba-kube-api-access-q9g7z\") pod \"certified-operators-n4gbm\" (UID: \"5910a375-22bc-4049-9165-8ce8298a85ba\") " pod="openshift-marketplace/certified-operators-n4gbm" Mar 16 15:33:45 crc kubenswrapper[5120]: I0316 15:33:45.310635 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/5910a375-22bc-4049-9165-8ce8298a85ba-catalog-content\") pod \"certified-operators-n4gbm\" (UID: \"5910a375-22bc-4049-9165-8ce8298a85ba\") " pod="openshift-marketplace/certified-operators-n4gbm" Mar 16 15:33:45 crc kubenswrapper[5120]: E0316 15:33:45.310723 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 15:33:45.810708559 +0000 UTC m=+127.964640216 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:45 crc kubenswrapper[5120]: I0316 15:33:45.312589 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-bzrbr" Mar 16 15:33:45 crc kubenswrapper[5120]: I0316 15:33:45.393889 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/community-operators-gb62c"] Mar 16 15:33:45 crc kubenswrapper[5120]: I0316 15:33:45.411666 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/523268a8-a14f-458e-bfe1-0a2ff7692fe4-kubelet-dir\") pod \"revision-pruner-6-crc\" (UID: \"523268a8-a14f-458e-bfe1-0a2ff7692fe4\") " pod="openshift-kube-scheduler/revision-pruner-6-crc" Mar 16 15:33:45 crc kubenswrapper[5120]: I0316 15:33:45.411707 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/523268a8-a14f-458e-bfe1-0a2ff7692fe4-kube-api-access\") pod \"revision-pruner-6-crc\" (UID: \"523268a8-a14f-458e-bfe1-0a2ff7692fe4\") " pod="openshift-kube-scheduler/revision-pruner-6-crc" Mar 16 15:33:45 crc kubenswrapper[5120]: I0316 15:33:45.411818 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/523268a8-a14f-458e-bfe1-0a2ff7692fe4-kubelet-dir\") pod \"revision-pruner-6-crc\" (UID: \"523268a8-a14f-458e-bfe1-0a2ff7692fe4\") " pod="openshift-kube-scheduler/revision-pruner-6-crc" Mar 16 15:33:45 crc kubenswrapper[5120]: I0316 15:33:45.411957 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/5910a375-22bc-4049-9165-8ce8298a85ba-utilities\") pod \"certified-operators-n4gbm\" (UID: \"5910a375-22bc-4049-9165-8ce8298a85ba\") " pod="openshift-marketplace/certified-operators-n4gbm" Mar 16 15:33:45 crc kubenswrapper[5120]: I0316 15:33:45.412004 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-66587d64c8-blgcz\" (UID: \"6528b019-774e-4298-abe6-69f062f0a13e\") " pod="openshift-image-registry/image-registry-66587d64c8-blgcz" Mar 16 15:33:45 crc kubenswrapper[5120]: I0316 15:33:45.412188 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q9g7z\" (UniqueName: \"kubernetes.io/projected/5910a375-22bc-4049-9165-8ce8298a85ba-kube-api-access-q9g7z\") pod \"certified-operators-n4gbm\" (UID: \"5910a375-22bc-4049-9165-8ce8298a85ba\") " pod="openshift-marketplace/certified-operators-n4gbm" Mar 16 15:33:45 crc kubenswrapper[5120]: I0316 15:33:45.412230 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/5910a375-22bc-4049-9165-8ce8298a85ba-catalog-content\") pod \"certified-operators-n4gbm\" (UID: \"5910a375-22bc-4049-9165-8ce8298a85ba\") " pod="openshift-marketplace/certified-operators-n4gbm" Mar 16 15:33:45 crc kubenswrapper[5120]: I0316 15:33:45.412383 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/5910a375-22bc-4049-9165-8ce8298a85ba-utilities\") pod \"certified-operators-n4gbm\" (UID: \"5910a375-22bc-4049-9165-8ce8298a85ba\") " pod="openshift-marketplace/certified-operators-n4gbm" Mar 16 15:33:45 crc kubenswrapper[5120]: I0316 15:33:45.412591 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/5910a375-22bc-4049-9165-8ce8298a85ba-catalog-content\") pod \"certified-operators-n4gbm\" (UID: \"5910a375-22bc-4049-9165-8ce8298a85ba\") " pod="openshift-marketplace/certified-operators-n4gbm" Mar 16 15:33:45 crc kubenswrapper[5120]: E0316 15:33:45.412633 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName: nodeName:}" failed. No retries permitted until 2026-03-16 15:33:45.912608769 +0000 UTC m=+128.066540426 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "image-registry-66587d64c8-blgcz" (UID: "6528b019-774e-4298-abe6-69f062f0a13e") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:45 crc kubenswrapper[5120]: I0316 15:33:45.412939 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/community-operators-gb62c"] Mar 16 15:33:45 crc kubenswrapper[5120]: I0316 15:33:45.413081 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-gb62c" Mar 16 15:33:45 crc kubenswrapper[5120]: I0316 15:33:45.431363 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/523268a8-a14f-458e-bfe1-0a2ff7692fe4-kube-api-access\") pod \"revision-pruner-6-crc\" (UID: \"523268a8-a14f-458e-bfe1-0a2ff7692fe4\") " pod="openshift-kube-scheduler/revision-pruner-6-crc" Mar 16 15:33:45 crc kubenswrapper[5120]: I0316 15:33:45.442305 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9g7z\" (UniqueName: \"kubernetes.io/projected/5910a375-22bc-4049-9165-8ce8298a85ba-kube-api-access-q9g7z\") pod \"certified-operators-n4gbm\" (UID: \"5910a375-22bc-4049-9165-8ce8298a85ba\") " pod="openshift-marketplace/certified-operators-n4gbm" Mar 16 15:33:45 crc kubenswrapper[5120]: I0316 15:33:45.454818 5120 patch_prober.go:28] interesting pod/packageserver-7d4fc7d867-bzv6d container/packageserver namespace/openshift-operator-lifecycle-manager: Readiness probe status=failure output="Get \"https://10.217.0.29:5443/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" start-of-body= Mar 16 15:33:45 crc kubenswrapper[5120]: I0316 15:33:45.454863 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-operator-lifecycle-manager/packageserver-7d4fc7d867-bzv6d" podUID="13808f6a-ec1e-4977-91af-50af631b3ef4" containerName="packageserver" probeResult="failure" output="Get \"https://10.217.0.29:5443/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Mar 16 15:33:45 crc kubenswrapper[5120]: I0316 15:33:45.470344 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/marketplace-operator-547dbd544d-gp852" Mar 16 15:33:45 crc kubenswrapper[5120]: I0316 15:33:45.515783 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 15:33:45 crc kubenswrapper[5120]: I0316 15:33:45.516194 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/2bb55bd0-43ba-4f30-93ad-aca0a4a74d04-catalog-content\") pod \"community-operators-gb62c\" (UID: \"2bb55bd0-43ba-4f30-93ad-aca0a4a74d04\") " pod="openshift-marketplace/community-operators-gb62c" Mar 16 15:33:45 crc kubenswrapper[5120]: I0316 15:33:45.516248 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tm624\" (UniqueName: \"kubernetes.io/projected/2bb55bd0-43ba-4f30-93ad-aca0a4a74d04-kube-api-access-tm624\") pod \"community-operators-gb62c\" (UID: \"2bb55bd0-43ba-4f30-93ad-aca0a4a74d04\") " pod="openshift-marketplace/community-operators-gb62c" Mar 16 15:33:45 crc kubenswrapper[5120]: I0316 15:33:45.516272 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/2bb55bd0-43ba-4f30-93ad-aca0a4a74d04-utilities\") pod \"community-operators-gb62c\" (UID: \"2bb55bd0-43ba-4f30-93ad-aca0a4a74d04\") " pod="openshift-marketplace/community-operators-gb62c" Mar 16 15:33:45 crc kubenswrapper[5120]: E0316 15:33:45.521944 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 15:33:46.021902849 +0000 UTC m=+128.175834496 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:45 crc kubenswrapper[5120]: I0316 15:33:45.551980 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operator-lifecycle-manager/packageserver-7d4fc7d867-bzv6d" Mar 16 15:33:45 crc kubenswrapper[5120]: I0316 15:33:45.573975 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler/revision-pruner-6-crc" Mar 16 15:33:45 crc kubenswrapper[5120]: I0316 15:33:45.575129 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-n4gbm" Mar 16 15:33:45 crc kubenswrapper[5120]: I0316 15:33:45.617506 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/community-operators-bzrbr"] Mar 16 15:33:45 crc kubenswrapper[5120]: I0316 15:33:45.618139 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/2bb55bd0-43ba-4f30-93ad-aca0a4a74d04-catalog-content\") pod \"community-operators-gb62c\" (UID: \"2bb55bd0-43ba-4f30-93ad-aca0a4a74d04\") " pod="openshift-marketplace/community-operators-gb62c" Mar 16 15:33:45 crc kubenswrapper[5120]: I0316 15:33:45.618182 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-66587d64c8-blgcz\" (UID: \"6528b019-774e-4298-abe6-69f062f0a13e\") " pod="openshift-image-registry/image-registry-66587d64c8-blgcz" Mar 16 15:33:45 crc kubenswrapper[5120]: I0316 15:33:45.618338 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tm624\" (UniqueName: \"kubernetes.io/projected/2bb55bd0-43ba-4f30-93ad-aca0a4a74d04-kube-api-access-tm624\") pod \"community-operators-gb62c\" (UID: \"2bb55bd0-43ba-4f30-93ad-aca0a4a74d04\") " pod="openshift-marketplace/community-operators-gb62c" Mar 16 15:33:45 crc kubenswrapper[5120]: I0316 15:33:45.618384 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/2bb55bd0-43ba-4f30-93ad-aca0a4a74d04-utilities\") pod \"community-operators-gb62c\" (UID: \"2bb55bd0-43ba-4f30-93ad-aca0a4a74d04\") " pod="openshift-marketplace/community-operators-gb62c" Mar 16 15:33:45 crc kubenswrapper[5120]: I0316 15:33:45.620393 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/2bb55bd0-43ba-4f30-93ad-aca0a4a74d04-utilities\") pod \"community-operators-gb62c\" (UID: \"2bb55bd0-43ba-4f30-93ad-aca0a4a74d04\") " pod="openshift-marketplace/community-operators-gb62c" Mar 16 15:33:45 crc kubenswrapper[5120]: I0316 15:33:45.621266 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/2bb55bd0-43ba-4f30-93ad-aca0a4a74d04-catalog-content\") pod \"community-operators-gb62c\" (UID: \"2bb55bd0-43ba-4f30-93ad-aca0a4a74d04\") " pod="openshift-marketplace/community-operators-gb62c" Mar 16 15:33:45 crc kubenswrapper[5120]: E0316 15:33:45.621517 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName: nodeName:}" failed. No retries permitted until 2026-03-16 15:33:46.121504187 +0000 UTC m=+128.275435834 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "image-registry-66587d64c8-blgcz" (UID: "6528b019-774e-4298-abe6-69f062f0a13e") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:45 crc kubenswrapper[5120]: I0316 15:33:45.644185 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tm624\" (UniqueName: \"kubernetes.io/projected/2bb55bd0-43ba-4f30-93ad-aca0a4a74d04-kube-api-access-tm624\") pod \"community-operators-gb62c\" (UID: \"2bb55bd0-43ba-4f30-93ad-aca0a4a74d04\") " pod="openshift-marketplace/community-operators-gb62c" Mar 16 15:33:45 crc kubenswrapper[5120]: I0316 15:33:45.646599 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/certified-operators-zz5g5"] Mar 16 15:33:45 crc kubenswrapper[5120]: W0316 15:33:45.658973 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4f60942_f576_4e00_88be_a52a1e6d91ec.slice/crio-053f0557679a73a5fa807dbaa6ebbbb6bd3a25c695a6a3cc5dfc2e0b9b9be974 WatchSource:0}: Error finding container 053f0557679a73a5fa807dbaa6ebbbb6bd3a25c695a6a3cc5dfc2e0b9b9be974: Status 404 returned error can't find the container with id 053f0557679a73a5fa807dbaa6ebbbb6bd3a25c695a6a3cc5dfc2e0b9b9be974 Mar 16 15:33:45 crc kubenswrapper[5120]: I0316 15:33:45.721709 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 15:33:45 crc kubenswrapper[5120]: E0316 15:33:45.722038 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 15:33:46.222021649 +0000 UTC m=+128.375953296 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:45 crc kubenswrapper[5120]: I0316 15:33:45.739099 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-gb62c" Mar 16 15:33:45 crc kubenswrapper[5120]: I0316 15:33:45.823885 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-66587d64c8-blgcz\" (UID: \"6528b019-774e-4298-abe6-69f062f0a13e\") " pod="openshift-image-registry/image-registry-66587d64c8-blgcz" Mar 16 15:33:45 crc kubenswrapper[5120]: E0316 15:33:45.824193 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName: nodeName:}" failed. No retries permitted until 2026-03-16 15:33:46.324181176 +0000 UTC m=+128.478112833 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "image-registry-66587d64c8-blgcz" (UID: "6528b019-774e-4298-abe6-69f062f0a13e") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:45 crc kubenswrapper[5120]: I0316 15:33:45.834792 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-scheduler/revision-pruner-6-crc"] Mar 16 15:33:45 crc kubenswrapper[5120]: I0316 15:33:45.877299 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/certified-operators-n4gbm"] Mar 16 15:33:45 crc kubenswrapper[5120]: W0316 15:33:45.880314 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod523268a8_a14f_458e_bfe1_0a2ff7692fe4.slice/crio-c83fb3d879d340b3b6e7df47234723c8c8224c2371764b2e24e797e027b77a37 WatchSource:0}: Error finding container c83fb3d879d340b3b6e7df47234723c8c8224c2371764b2e24e797e027b77a37: Status 404 returned error can't find the container with id c83fb3d879d340b3b6e7df47234723c8c8224c2371764b2e24e797e027b77a37 Mar 16 15:33:45 crc kubenswrapper[5120]: I0316 15:33:45.924579 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 15:33:45 crc kubenswrapper[5120]: E0316 15:33:45.924937 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 15:33:46.424921534 +0000 UTC m=+128.578853191 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:46 crc kubenswrapper[5120]: I0316 15:33:46.026276 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-66587d64c8-blgcz\" (UID: \"6528b019-774e-4298-abe6-69f062f0a13e\") " pod="openshift-image-registry/image-registry-66587d64c8-blgcz" Mar 16 15:33:46 crc kubenswrapper[5120]: E0316 15:33:46.026745 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName: nodeName:}" failed. No retries permitted until 2026-03-16 15:33:46.526728941 +0000 UTC m=+128.680660588 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "image-registry-66587d64c8-blgcz" (UID: "6528b019-774e-4298-abe6-69f062f0a13e") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:46 crc kubenswrapper[5120]: I0316 15:33:46.125229 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-apiserver/apiserver-9ddfb9f55-22m28" Mar 16 15:33:46 crc kubenswrapper[5120]: I0316 15:33:46.128843 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 15:33:46 crc kubenswrapper[5120]: E0316 15:33:46.129188 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 15:33:46.629174926 +0000 UTC m=+128.783106583 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:46 crc kubenswrapper[5120]: I0316 15:33:46.137250 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-apiserver/apiserver-9ddfb9f55-22m28" Mar 16 15:33:46 crc kubenswrapper[5120]: I0316 15:33:46.151799 5120 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/kubevirt.io.hostpath-provisioner-reg.sock" Mar 16 15:33:46 crc kubenswrapper[5120]: I0316 15:33:46.184681 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/community-operators-gb62c"] Mar 16 15:33:46 crc kubenswrapper[5120]: I0316 15:33:46.230021 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-66587d64c8-blgcz\" (UID: \"6528b019-774e-4298-abe6-69f062f0a13e\") " pod="openshift-image-registry/image-registry-66587d64c8-blgcz" Mar 16 15:33:46 crc kubenswrapper[5120]: E0316 15:33:46.230502 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName: nodeName:}" failed. No retries permitted until 2026-03-16 15:33:46.730481459 +0000 UTC m=+128.884413116 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "image-registry-66587d64c8-blgcz" (UID: "6528b019-774e-4298-abe6-69f062f0a13e") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:46 crc kubenswrapper[5120]: W0316 15:33:46.231352 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bb55bd0_43ba_4f30_93ad_aca0a4a74d04.slice/crio-299009d1e56d832d1c4197855e4a4bef32278601d78b888d7384ba6e06c5c438 WatchSource:0}: Error finding container 299009d1e56d832d1c4197855e4a4bef32278601d78b888d7384ba6e06c5c438: Status 404 returned error can't find the container with id 299009d1e56d832d1c4197855e4a4bef32278601d78b888d7384ba6e06c5c438 Mar 16 15:33:46 crc kubenswrapper[5120]: I0316 15:33:46.244662 5120 patch_prober.go:28] interesting pod/router-default-68cf44c8b8-rsmpr container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Mar 16 15:33:46 crc kubenswrapper[5120]: [-]has-synced failed: reason withheld Mar 16 15:33:46 crc kubenswrapper[5120]: [+]process-running ok Mar 16 15:33:46 crc kubenswrapper[5120]: healthz check failed Mar 16 15:33:46 crc kubenswrapper[5120]: I0316 15:33:46.244717 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-68cf44c8b8-rsmpr" podUID="5b94b756-5f20-4937-a8a7-11471f916640" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Mar 16 15:33:46 crc kubenswrapper[5120]: I0316 15:33:46.331152 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 15:33:46 crc kubenswrapper[5120]: E0316 15:33:46.331231 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 15:33:46.831211857 +0000 UTC m=+128.985143504 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:46 crc kubenswrapper[5120]: I0316 15:33:46.331376 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-66587d64c8-blgcz\" (UID: \"6528b019-774e-4298-abe6-69f062f0a13e\") " pod="openshift-image-registry/image-registry-66587d64c8-blgcz" Mar 16 15:33:46 crc kubenswrapper[5120]: E0316 15:33:46.331630 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName: nodeName:}" failed. No retries permitted until 2026-03-16 15:33:46.831623158 +0000 UTC m=+128.985554815 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "image-registry-66587d64c8-blgcz" (UID: "6528b019-774e-4298-abe6-69f062f0a13e") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:46 crc kubenswrapper[5120]: I0316 15:33:46.432170 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 15:33:46 crc kubenswrapper[5120]: E0316 15:33:46.432736 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 15:33:46.932719336 +0000 UTC m=+129.086650993 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:46 crc kubenswrapper[5120]: I0316 15:33:46.479709 5120 generic.go:358] "Generic (PLEG): container finished" podID="f4f60942-f576-4e00-88be-a52a1e6d91ec" containerID="23b0b8c596d1f298796996f263987f64f27049dd856b880489f8b6e2e14d76c0" exitCode=0 Mar 16 15:33:46 crc kubenswrapper[5120]: I0316 15:33:46.479843 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-zz5g5" event={"ID":"f4f60942-f576-4e00-88be-a52a1e6d91ec","Type":"ContainerDied","Data":"23b0b8c596d1f298796996f263987f64f27049dd856b880489f8b6e2e14d76c0"} Mar 16 15:33:46 crc kubenswrapper[5120]: I0316 15:33:46.479880 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-zz5g5" event={"ID":"f4f60942-f576-4e00-88be-a52a1e6d91ec","Type":"ContainerStarted","Data":"053f0557679a73a5fa807dbaa6ebbbb6bd3a25c695a6a3cc5dfc2e0b9b9be974"} Mar 16 15:33:46 crc kubenswrapper[5120]: I0316 15:33:46.485609 5120 generic.go:358] "Generic (PLEG): container finished" podID="5910a375-22bc-4049-9165-8ce8298a85ba" containerID="991d5d4f40e4b9da9b51d6af7cd0a2bfe39c338925d1d9c4ab2a000b2c752d5d" exitCode=0 Mar 16 15:33:46 crc kubenswrapper[5120]: I0316 15:33:46.485667 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-n4gbm" event={"ID":"5910a375-22bc-4049-9165-8ce8298a85ba","Type":"ContainerDied","Data":"991d5d4f40e4b9da9b51d6af7cd0a2bfe39c338925d1d9c4ab2a000b2c752d5d"} Mar 16 15:33:46 crc kubenswrapper[5120]: I0316 15:33:46.485693 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-n4gbm" event={"ID":"5910a375-22bc-4049-9165-8ce8298a85ba","Type":"ContainerStarted","Data":"399e87aad69d30ec2b32b4ace45904f15f34d206d6137b991d0690ab4a9220c9"} Mar 16 15:33:46 crc kubenswrapper[5120]: I0316 15:33:46.491031 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler/revision-pruner-6-crc" event={"ID":"523268a8-a14f-458e-bfe1-0a2ff7692fe4","Type":"ContainerStarted","Data":"02de581133e3fda7d898c6797ab6f9beaf1d26391c89f285d842912ae65faeea"} Mar 16 15:33:46 crc kubenswrapper[5120]: I0316 15:33:46.491066 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler/revision-pruner-6-crc" event={"ID":"523268a8-a14f-458e-bfe1-0a2ff7692fe4","Type":"ContainerStarted","Data":"c83fb3d879d340b3b6e7df47234723c8c8224c2371764b2e24e797e027b77a37"} Mar 16 15:33:46 crc kubenswrapper[5120]: I0316 15:33:46.493578 5120 generic.go:358] "Generic (PLEG): container finished" podID="2bb55bd0-43ba-4f30-93ad-aca0a4a74d04" containerID="74c0189abe9dce906c512bee04cb5fd8eee2275074fd9f8bb5b160f3c9cc5168" exitCode=0 Mar 16 15:33:46 crc kubenswrapper[5120]: I0316 15:33:46.493643 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-gb62c" event={"ID":"2bb55bd0-43ba-4f30-93ad-aca0a4a74d04","Type":"ContainerDied","Data":"74c0189abe9dce906c512bee04cb5fd8eee2275074fd9f8bb5b160f3c9cc5168"} Mar 16 15:33:46 crc kubenswrapper[5120]: I0316 15:33:46.493662 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-gb62c" event={"ID":"2bb55bd0-43ba-4f30-93ad-aca0a4a74d04","Type":"ContainerStarted","Data":"299009d1e56d832d1c4197855e4a4bef32278601d78b888d7384ba6e06c5c438"} Mar 16 15:33:46 crc kubenswrapper[5120]: I0316 15:33:46.495954 5120 generic.go:358] "Generic (PLEG): container finished" podID="3529f46e-85a5-437e-8773-68d7dc6b6f9c" containerID="5c8edf0e26b0ca818e5402e1b37865e0cb7a3fc2b052245c2580b3bd617be6a6" exitCode=0 Mar 16 15:33:46 crc kubenswrapper[5120]: I0316 15:33:46.496036 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-bzrbr" event={"ID":"3529f46e-85a5-437e-8773-68d7dc6b6f9c","Type":"ContainerDied","Data":"5c8edf0e26b0ca818e5402e1b37865e0cb7a3fc2b052245c2580b3bd617be6a6"} Mar 16 15:33:46 crc kubenswrapper[5120]: I0316 15:33:46.496053 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-bzrbr" event={"ID":"3529f46e-85a5-437e-8773-68d7dc6b6f9c","Type":"ContainerStarted","Data":"30323d331e62364cf94d1f649d83bb0c4ea1642fb55c0b3f90c28a24126269da"} Mar 16 15:33:46 crc kubenswrapper[5120]: I0316 15:33:46.499991 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="hostpath-provisioner/csi-hostpathplugin-sqjrv" event={"ID":"9293198c-313b-43df-bd83-75eb148a1c77","Type":"ContainerStarted","Data":"da8505a38b3b23557c3602330e718532f82787efa46c05cfa433b2fcb2def748"} Mar 16 15:33:46 crc kubenswrapper[5120]: I0316 15:33:46.500051 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="hostpath-provisioner/csi-hostpathplugin-sqjrv" event={"ID":"9293198c-313b-43df-bd83-75eb148a1c77","Type":"ContainerStarted","Data":"0a39c2c56cc437e4db74aedfefff6d25ed4e228dd3302a186750fb7fd5791667"} Mar 16 15:33:46 crc kubenswrapper[5120]: I0316 15:33:46.511688 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-config-operator/openshift-config-operator-5777786469-b8t64" Mar 16 15:33:46 crc kubenswrapper[5120]: I0316 15:33:46.535045 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-66587d64c8-blgcz\" (UID: \"6528b019-774e-4298-abe6-69f062f0a13e\") " pod="openshift-image-registry/image-registry-66587d64c8-blgcz" Mar 16 15:33:46 crc kubenswrapper[5120]: E0316 15:33:46.536513 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName: nodeName:}" failed. No retries permitted until 2026-03-16 15:33:47.036501848 +0000 UTC m=+129.190433505 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "image-registry-66587d64c8-blgcz" (UID: "6528b019-774e-4298-abe6-69f062f0a13e") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:46 crc kubenswrapper[5120]: I0316 15:33:46.569447 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-scheduler/revision-pruner-6-crc" podStartSLOduration=1.569434282 podStartE2EDuration="1.569434282s" podCreationTimestamp="2026-03-16 15:33:45 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:33:46.555775541 +0000 UTC m=+128.709707188" watchObservedRunningTime="2026-03-16 15:33:46.569434282 +0000 UTC m=+128.723365939" Mar 16 15:33:46 crc kubenswrapper[5120]: I0316 15:33:46.635733 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 15:33:46 crc kubenswrapper[5120]: E0316 15:33:46.635931 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 15:33:47.135900889 +0000 UTC m=+129.289832546 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:46 crc kubenswrapper[5120]: I0316 15:33:46.636213 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-66587d64c8-blgcz\" (UID: \"6528b019-774e-4298-abe6-69f062f0a13e\") " pod="openshift-image-registry/image-registry-66587d64c8-blgcz" Mar 16 15:33:46 crc kubenswrapper[5120]: E0316 15:33:46.641049 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName: nodeName:}" failed. No retries permitted until 2026-03-16 15:33:47.141033838 +0000 UTC m=+129.294965495 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "image-registry-66587d64c8-blgcz" (UID: "6528b019-774e-4298-abe6-69f062f0a13e") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:46 crc kubenswrapper[5120]: I0316 15:33:46.737214 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 15:33:46 crc kubenswrapper[5120]: E0316 15:33:46.737445 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 15:33:47.237428639 +0000 UTC m=+129.391360296 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 15:33:46 crc kubenswrapper[5120]: I0316 15:33:46.789367 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-marketplace-p8tsg"] Mar 16 15:33:46 crc kubenswrapper[5120]: I0316 15:33:46.795846 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-p8tsg" Mar 16 15:33:46 crc kubenswrapper[5120]: I0316 15:33:46.798221 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"redhat-marketplace-dockercfg-gg4w7\"" Mar 16 15:33:46 crc kubenswrapper[5120]: I0316 15:33:46.804133 5120 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/kubevirt.io.hostpath-provisioner-reg.sock","Timestamp":"2026-03-16T15:33:46.151821841Z","UUID":"d54a98f5-000a-4938-9da5-f5c2f8e98be2","Handler":null,"Name":"","Endpoint":""} Mar 16 15:33:46 crc kubenswrapper[5120]: I0316 15:33:46.808628 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-p8tsg"] Mar 16 15:33:46 crc kubenswrapper[5120]: I0316 15:33:46.823356 5120 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: kubevirt.io.hostpath-provisioner endpoint: /var/lib/kubelet/plugins/csi-hostpath/csi.sock versions: 1.0.0 Mar 16 15:33:46 crc kubenswrapper[5120]: I0316 15:33:46.823391 5120 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: kubevirt.io.hostpath-provisioner at endpoint: /var/lib/kubelet/plugins/csi-hostpath/csi.sock Mar 16 15:33:46 crc kubenswrapper[5120]: I0316 15:33:46.839501 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/888cb38a-98cf-4897-95ec-879b29e12656-utilities\") pod \"redhat-marketplace-p8tsg\" (UID: \"888cb38a-98cf-4897-95ec-879b29e12656\") " pod="openshift-marketplace/redhat-marketplace-p8tsg" Mar 16 15:33:46 crc kubenswrapper[5120]: I0316 15:33:46.839545 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-66587d64c8-blgcz\" (UID: \"6528b019-774e-4298-abe6-69f062f0a13e\") " pod="openshift-image-registry/image-registry-66587d64c8-blgcz" Mar 16 15:33:46 crc kubenswrapper[5120]: I0316 15:33:46.839634 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbp2s\" (UniqueName: \"kubernetes.io/projected/888cb38a-98cf-4897-95ec-879b29e12656-kube-api-access-jbp2s\") pod \"redhat-marketplace-p8tsg\" (UID: \"888cb38a-98cf-4897-95ec-879b29e12656\") " pod="openshift-marketplace/redhat-marketplace-p8tsg" Mar 16 15:33:46 crc kubenswrapper[5120]: I0316 15:33:46.839709 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/888cb38a-98cf-4897-95ec-879b29e12656-catalog-content\") pod \"redhat-marketplace-p8tsg\" (UID: \"888cb38a-98cf-4897-95ec-879b29e12656\") " pod="openshift-marketplace/redhat-marketplace-p8tsg" Mar 16 15:33:46 crc kubenswrapper[5120]: I0316 15:33:46.845048 5120 csi_attacher.go:373] kubernetes.io/csi: attacher.MountDevice STAGE_UNSTAGE_VOLUME capability not set. Skipping MountDevice... Mar 16 15:33:46 crc kubenswrapper[5120]: I0316 15:33:46.845336 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-66587d64c8-blgcz\" (UID: \"6528b019-774e-4298-abe6-69f062f0a13e\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/kubevirt.io.hostpath-provisioner/b1264ac67579ad07e7e9003054d44fe40dd55285a4b2f7dc74e48be1aee0868a/globalmount\"" pod="openshift-image-registry/image-registry-66587d64c8-blgcz" Mar 16 15:33:46 crc kubenswrapper[5120]: I0316 15:33:46.874225 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-66587d64c8-blgcz\" (UID: \"6528b019-774e-4298-abe6-69f062f0a13e\") " pod="openshift-image-registry/image-registry-66587d64c8-blgcz" Mar 16 15:33:46 crc kubenswrapper[5120]: I0316 15:33:46.941336 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 15:33:46 crc kubenswrapper[5120]: I0316 15:33:46.941486 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jbp2s\" (UniqueName: \"kubernetes.io/projected/888cb38a-98cf-4897-95ec-879b29e12656-kube-api-access-jbp2s\") pod \"redhat-marketplace-p8tsg\" (UID: \"888cb38a-98cf-4897-95ec-879b29e12656\") " pod="openshift-marketplace/redhat-marketplace-p8tsg" Mar 16 15:33:46 crc kubenswrapper[5120]: I0316 15:33:46.941515 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/888cb38a-98cf-4897-95ec-879b29e12656-catalog-content\") pod \"redhat-marketplace-p8tsg\" (UID: \"888cb38a-98cf-4897-95ec-879b29e12656\") " pod="openshift-marketplace/redhat-marketplace-p8tsg" Mar 16 15:33:46 crc kubenswrapper[5120]: I0316 15:33:46.941564 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/888cb38a-98cf-4897-95ec-879b29e12656-utilities\") pod \"redhat-marketplace-p8tsg\" (UID: \"888cb38a-98cf-4897-95ec-879b29e12656\") " pod="openshift-marketplace/redhat-marketplace-p8tsg" Mar 16 15:33:46 crc kubenswrapper[5120]: I0316 15:33:46.941997 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/888cb38a-98cf-4897-95ec-879b29e12656-utilities\") pod \"redhat-marketplace-p8tsg\" (UID: \"888cb38a-98cf-4897-95ec-879b29e12656\") " pod="openshift-marketplace/redhat-marketplace-p8tsg" Mar 16 15:33:46 crc kubenswrapper[5120]: I0316 15:33:46.942129 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/888cb38a-98cf-4897-95ec-879b29e12656-catalog-content\") pod \"redhat-marketplace-p8tsg\" (UID: \"888cb38a-98cf-4897-95ec-879b29e12656\") " pod="openshift-marketplace/redhat-marketplace-p8tsg" Mar 16 15:33:46 crc kubenswrapper[5120]: I0316 15:33:46.962427 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbp2s\" (UniqueName: \"kubernetes.io/projected/888cb38a-98cf-4897-95ec-879b29e12656-kube-api-access-jbp2s\") pod \"redhat-marketplace-p8tsg\" (UID: \"888cb38a-98cf-4897-95ec-879b29e12656\") " pod="openshift-marketplace/redhat-marketplace-p8tsg" Mar 16 15:33:46 crc kubenswrapper[5120]: I0316 15:33:46.963552 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (OuterVolumeSpecName: "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af"). InnerVolumeSpecName "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2". PluginName "kubernetes.io/csi", VolumeGIDValue "" Mar 16 15:33:47 crc kubenswrapper[5120]: I0316 15:33:47.036175 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-6w67b\"" Mar 16 15:33:47 crc kubenswrapper[5120]: I0316 15:33:47.042397 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-66587d64c8-blgcz" Mar 16 15:33:47 crc kubenswrapper[5120]: I0316 15:33:47.108226 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-p8tsg" Mar 16 15:33:47 crc kubenswrapper[5120]: I0316 15:33:47.208833 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-marketplace-kr7pv"] Mar 16 15:33:47 crc kubenswrapper[5120]: I0316 15:33:47.220907 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-kr7pv"] Mar 16 15:33:47 crc kubenswrapper[5120]: I0316 15:33:47.221076 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-kr7pv" Mar 16 15:33:47 crc kubenswrapper[5120]: I0316 15:33:47.245984 5120 patch_prober.go:28] interesting pod/router-default-68cf44c8b8-rsmpr container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Mar 16 15:33:47 crc kubenswrapper[5120]: [-]has-synced failed: reason withheld Mar 16 15:33:47 crc kubenswrapper[5120]: [+]process-running ok Mar 16 15:33:47 crc kubenswrapper[5120]: healthz check failed Mar 16 15:33:47 crc kubenswrapper[5120]: I0316 15:33:47.246053 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-68cf44c8b8-rsmpr" podUID="5b94b756-5f20-4937-a8a7-11471f916640" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Mar 16 15:33:47 crc kubenswrapper[5120]: I0316 15:33:47.248801 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-66587d64c8-blgcz"] Mar 16 15:33:47 crc kubenswrapper[5120]: W0316 15:33:47.260621 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6528b019_774e_4298_abe6_69f062f0a13e.slice/crio-19f38470c842ed8e187b17ebda11af781453146a7f757939663cf2b6eeea77cd WatchSource:0}: Error finding container 19f38470c842ed8e187b17ebda11af781453146a7f757939663cf2b6eeea77cd: Status 404 returned error can't find the container with id 19f38470c842ed8e187b17ebda11af781453146a7f757939663cf2b6eeea77cd Mar 16 15:33:47 crc kubenswrapper[5120]: I0316 15:33:47.307070 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-p8tsg"] Mar 16 15:33:47 crc kubenswrapper[5120]: W0316 15:33:47.310013 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod888cb38a_98cf_4897_95ec_879b29e12656.slice/crio-380ed2b4ac06f829ce72b12c047f37171259582803342cf657d551ce7735590b WatchSource:0}: Error finding container 380ed2b4ac06f829ce72b12c047f37171259582803342cf657d551ce7735590b: Status 404 returned error can't find the container with id 380ed2b4ac06f829ce72b12c047f37171259582803342cf657d551ce7735590b Mar 16 15:33:47 crc kubenswrapper[5120]: I0316 15:33:47.345242 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/b89af808-d797-4840-9969-8f4eb5dc9157-catalog-content\") pod \"redhat-marketplace-kr7pv\" (UID: \"b89af808-d797-4840-9969-8f4eb5dc9157\") " pod="openshift-marketplace/redhat-marketplace-kr7pv" Mar 16 15:33:47 crc kubenswrapper[5120]: I0316 15:33:47.345412 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/b89af808-d797-4840-9969-8f4eb5dc9157-utilities\") pod \"redhat-marketplace-kr7pv\" (UID: \"b89af808-d797-4840-9969-8f4eb5dc9157\") " pod="openshift-marketplace/redhat-marketplace-kr7pv" Mar 16 15:33:47 crc kubenswrapper[5120]: I0316 15:33:47.345622 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b92k4\" (UniqueName: \"kubernetes.io/projected/b89af808-d797-4840-9969-8f4eb5dc9157-kube-api-access-b92k4\") pod \"redhat-marketplace-kr7pv\" (UID: \"b89af808-d797-4840-9969-8f4eb5dc9157\") " pod="openshift-marketplace/redhat-marketplace-kr7pv" Mar 16 15:33:47 crc kubenswrapper[5120]: I0316 15:33:47.447175 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/b89af808-d797-4840-9969-8f4eb5dc9157-catalog-content\") pod \"redhat-marketplace-kr7pv\" (UID: \"b89af808-d797-4840-9969-8f4eb5dc9157\") " pod="openshift-marketplace/redhat-marketplace-kr7pv" Mar 16 15:33:47 crc kubenswrapper[5120]: I0316 15:33:47.447328 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/b89af808-d797-4840-9969-8f4eb5dc9157-utilities\") pod \"redhat-marketplace-kr7pv\" (UID: \"b89af808-d797-4840-9969-8f4eb5dc9157\") " pod="openshift-marketplace/redhat-marketplace-kr7pv" Mar 16 15:33:47 crc kubenswrapper[5120]: I0316 15:33:47.447533 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b92k4\" (UniqueName: \"kubernetes.io/projected/b89af808-d797-4840-9969-8f4eb5dc9157-kube-api-access-b92k4\") pod \"redhat-marketplace-kr7pv\" (UID: \"b89af808-d797-4840-9969-8f4eb5dc9157\") " pod="openshift-marketplace/redhat-marketplace-kr7pv" Mar 16 15:33:47 crc kubenswrapper[5120]: I0316 15:33:47.448508 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/b89af808-d797-4840-9969-8f4eb5dc9157-utilities\") pod \"redhat-marketplace-kr7pv\" (UID: \"b89af808-d797-4840-9969-8f4eb5dc9157\") " pod="openshift-marketplace/redhat-marketplace-kr7pv" Mar 16 15:33:47 crc kubenswrapper[5120]: I0316 15:33:47.448562 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/b89af808-d797-4840-9969-8f4eb5dc9157-catalog-content\") pod \"redhat-marketplace-kr7pv\" (UID: \"b89af808-d797-4840-9969-8f4eb5dc9157\") " pod="openshift-marketplace/redhat-marketplace-kr7pv" Mar 16 15:33:47 crc kubenswrapper[5120]: I0316 15:33:47.469615 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b92k4\" (UniqueName: \"kubernetes.io/projected/b89af808-d797-4840-9969-8f4eb5dc9157-kube-api-access-b92k4\") pod \"redhat-marketplace-kr7pv\" (UID: \"b89af808-d797-4840-9969-8f4eb5dc9157\") " pod="openshift-marketplace/redhat-marketplace-kr7pv" Mar 16 15:33:47 crc kubenswrapper[5120]: I0316 15:33:47.507511 5120 generic.go:358] "Generic (PLEG): container finished" podID="deae033b-c4b8-462c-b29b-5115eb40a94b" containerID="5495fdca7ff98e7d65c6e9fa4a7e7a415f3fe957b30dba968a778b5194847078" exitCode=0 Mar 16 15:33:47 crc kubenswrapper[5120]: I0316 15:33:47.507634 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/collect-profiles-29561250-7npz6" event={"ID":"deae033b-c4b8-462c-b29b-5115eb40a94b","Type":"ContainerDied","Data":"5495fdca7ff98e7d65c6e9fa4a7e7a415f3fe957b30dba968a778b5194847078"} Mar 16 15:33:47 crc kubenswrapper[5120]: I0316 15:33:47.510737 5120 generic.go:358] "Generic (PLEG): container finished" podID="523268a8-a14f-458e-bfe1-0a2ff7692fe4" containerID="02de581133e3fda7d898c6797ab6f9beaf1d26391c89f285d842912ae65faeea" exitCode=0 Mar 16 15:33:47 crc kubenswrapper[5120]: I0316 15:33:47.510825 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler/revision-pruner-6-crc" event={"ID":"523268a8-a14f-458e-bfe1-0a2ff7692fe4","Type":"ContainerDied","Data":"02de581133e3fda7d898c6797ab6f9beaf1d26391c89f285d842912ae65faeea"} Mar 16 15:33:47 crc kubenswrapper[5120]: I0316 15:33:47.512018 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-p8tsg" event={"ID":"888cb38a-98cf-4897-95ec-879b29e12656","Type":"ContainerStarted","Data":"380ed2b4ac06f829ce72b12c047f37171259582803342cf657d551ce7735590b"} Mar 16 15:33:47 crc kubenswrapper[5120]: I0316 15:33:47.515001 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="hostpath-provisioner/csi-hostpathplugin-sqjrv" event={"ID":"9293198c-313b-43df-bd83-75eb148a1c77","Type":"ContainerStarted","Data":"218abd9715ffd356ec782d3519ae8c3075b081139b8773eb41ac216b6ae947c5"} Mar 16 15:33:47 crc kubenswrapper[5120]: I0316 15:33:47.516260 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-66587d64c8-blgcz" event={"ID":"6528b019-774e-4298-abe6-69f062f0a13e","Type":"ContainerStarted","Data":"19f38470c842ed8e187b17ebda11af781453146a7f757939663cf2b6eeea77cd"} Mar 16 15:33:47 crc kubenswrapper[5120]: I0316 15:33:47.534870 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-kr7pv" Mar 16 15:33:47 crc kubenswrapper[5120]: I0316 15:33:47.589387 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="hostpath-provisioner/csi-hostpathplugin-sqjrv" podStartSLOduration=12.589366665 podStartE2EDuration="12.589366665s" podCreationTimestamp="2026-03-16 15:33:35 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:33:47.588342327 +0000 UTC m=+129.742273984" watchObservedRunningTime="2026-03-16 15:33:47.589366665 +0000 UTC m=+129.743298332" Mar 16 15:33:47 crc kubenswrapper[5120]: I0316 15:33:47.767401 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-oauth-apiserver/apiserver-8596bd845d-jb8bk" Mar 16 15:33:47 crc kubenswrapper[5120]: I0316 15:33:47.767462 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-oauth-apiserver/apiserver-8596bd845d-jb8bk" Mar 16 15:33:47 crc kubenswrapper[5120]: I0316 15:33:47.777538 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-oauth-apiserver/apiserver-8596bd845d-jb8bk" Mar 16 15:33:47 crc kubenswrapper[5120]: I0316 15:33:47.983169 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-apiserver/revision-pruner-11-crc"] Mar 16 15:33:48 crc kubenswrapper[5120]: I0316 15:33:48.008088 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-apiserver/revision-pruner-11-crc"] Mar 16 15:33:48 crc kubenswrapper[5120]: I0316 15:33:48.008159 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-operators-5d9tn"] Mar 16 15:33:48 crc kubenswrapper[5120]: I0316 15:33:48.008267 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/revision-pruner-11-crc" Mar 16 15:33:48 crc kubenswrapper[5120]: I0316 15:33:48.011028 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-apiserver\"/\"kube-root-ca.crt\"" Mar 16 15:33:48 crc kubenswrapper[5120]: I0316 15:33:48.011360 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-apiserver\"/\"installer-sa-dockercfg-bqqnb\"" Mar 16 15:33:48 crc kubenswrapper[5120]: I0316 15:33:48.021016 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-5d9tn"] Mar 16 15:33:48 crc kubenswrapper[5120]: I0316 15:33:48.021288 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-5d9tn" Mar 16 15:33:48 crc kubenswrapper[5120]: I0316 15:33:48.023451 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"redhat-operators-dockercfg-9gxlh\"" Mar 16 15:33:48 crc kubenswrapper[5120]: I0316 15:33:48.046373 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-kr7pv"] Mar 16 15:33:48 crc kubenswrapper[5120]: I0316 15:33:48.056281 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/4c3b2ef6-2781-4d23-97e9-52393ac08bd5-kube-api-access\") pod \"revision-pruner-11-crc\" (UID: \"4c3b2ef6-2781-4d23-97e9-52393ac08bd5\") " pod="openshift-kube-apiserver/revision-pruner-11-crc" Mar 16 15:33:48 crc kubenswrapper[5120]: I0316 15:33:48.056335 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4c3b2ef6-2781-4d23-97e9-52393ac08bd5-kubelet-dir\") pod \"revision-pruner-11-crc\" (UID: \"4c3b2ef6-2781-4d23-97e9-52393ac08bd5\") " pod="openshift-kube-apiserver/revision-pruner-11-crc" Mar 16 15:33:48 crc kubenswrapper[5120]: I0316 15:33:48.145698 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-64d44f6ddf-4pm87" Mar 16 15:33:48 crc kubenswrapper[5120]: I0316 15:33:48.145809 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-64d44f6ddf-4pm87" Mar 16 15:33:48 crc kubenswrapper[5120]: I0316 15:33:48.147028 5120 patch_prober.go:28] interesting pod/console-64d44f6ddf-4pm87 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.217.0.21:8443/health\": dial tcp 10.217.0.21:8443: connect: connection refused" start-of-body= Mar 16 15:33:48 crc kubenswrapper[5120]: I0316 15:33:48.147083 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-64d44f6ddf-4pm87" podUID="716f37d9-f29d-4bc1-87a1-94364fee0605" containerName="console" probeResult="failure" output="Get \"https://10.217.0.21:8443/health\": dial tcp 10.217.0.21:8443: connect: connection refused" Mar 16 15:33:48 crc kubenswrapper[5120]: I0316 15:33:48.158118 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/fe2f5127-13d1-4799-9af9-bb0736bf53e9-catalog-content\") pod \"redhat-operators-5d9tn\" (UID: \"fe2f5127-13d1-4799-9af9-bb0736bf53e9\") " pod="openshift-marketplace/redhat-operators-5d9tn" Mar 16 15:33:48 crc kubenswrapper[5120]: I0316 15:33:48.158186 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/fe2f5127-13d1-4799-9af9-bb0736bf53e9-utilities\") pod \"redhat-operators-5d9tn\" (UID: \"fe2f5127-13d1-4799-9af9-bb0736bf53e9\") " pod="openshift-marketplace/redhat-operators-5d9tn" Mar 16 15:33:48 crc kubenswrapper[5120]: I0316 15:33:48.158230 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8fhlq\" (UniqueName: \"kubernetes.io/projected/fe2f5127-13d1-4799-9af9-bb0736bf53e9-kube-api-access-8fhlq\") pod \"redhat-operators-5d9tn\" (UID: \"fe2f5127-13d1-4799-9af9-bb0736bf53e9\") " pod="openshift-marketplace/redhat-operators-5d9tn" Mar 16 15:33:48 crc kubenswrapper[5120]: I0316 15:33:48.158305 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/4c3b2ef6-2781-4d23-97e9-52393ac08bd5-kube-api-access\") pod \"revision-pruner-11-crc\" (UID: \"4c3b2ef6-2781-4d23-97e9-52393ac08bd5\") " pod="openshift-kube-apiserver/revision-pruner-11-crc" Mar 16 15:33:48 crc kubenswrapper[5120]: I0316 15:33:48.158379 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4c3b2ef6-2781-4d23-97e9-52393ac08bd5-kubelet-dir\") pod \"revision-pruner-11-crc\" (UID: \"4c3b2ef6-2781-4d23-97e9-52393ac08bd5\") " pod="openshift-kube-apiserver/revision-pruner-11-crc" Mar 16 15:33:48 crc kubenswrapper[5120]: I0316 15:33:48.158546 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4c3b2ef6-2781-4d23-97e9-52393ac08bd5-kubelet-dir\") pod \"revision-pruner-11-crc\" (UID: \"4c3b2ef6-2781-4d23-97e9-52393ac08bd5\") " pod="openshift-kube-apiserver/revision-pruner-11-crc" Mar 16 15:33:48 crc kubenswrapper[5120]: I0316 15:33:48.186531 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/4c3b2ef6-2781-4d23-97e9-52393ac08bd5-kube-api-access\") pod \"revision-pruner-11-crc\" (UID: \"4c3b2ef6-2781-4d23-97e9-52393ac08bd5\") " pod="openshift-kube-apiserver/revision-pruner-11-crc" Mar 16 15:33:48 crc kubenswrapper[5120]: I0316 15:33:48.224689 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-kube-apiserver/kube-apiserver-crc" Mar 16 15:33:48 crc kubenswrapper[5120]: I0316 15:33:48.241585 5120 patch_prober.go:28] interesting pod/downloads-747b44746d-pjv44 container/download-server namespace/openshift-console: Liveness probe status=failure output="Get \"http://10.217.0.37:8080/\": dial tcp 10.217.0.37:8080: connect: connection refused" start-of-body= Mar 16 15:33:48 crc kubenswrapper[5120]: I0316 15:33:48.241644 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-console/downloads-747b44746d-pjv44" podUID="b064c090-1362-427c-b805-d2808c01b58c" containerName="download-server" probeResult="failure" output="Get \"http://10.217.0.37:8080/\": dial tcp 10.217.0.37:8080: connect: connection refused" Mar 16 15:33:48 crc kubenswrapper[5120]: I0316 15:33:48.249351 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-68cf44c8b8-rsmpr" Mar 16 15:33:48 crc kubenswrapper[5120]: I0316 15:33:48.252866 5120 patch_prober.go:28] interesting pod/router-default-68cf44c8b8-rsmpr container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Mar 16 15:33:48 crc kubenswrapper[5120]: [-]has-synced failed: reason withheld Mar 16 15:33:48 crc kubenswrapper[5120]: [+]process-running ok Mar 16 15:33:48 crc kubenswrapper[5120]: healthz check failed Mar 16 15:33:48 crc kubenswrapper[5120]: I0316 15:33:48.252931 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-68cf44c8b8-rsmpr" podUID="5b94b756-5f20-4937-a8a7-11471f916640" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Mar 16 15:33:48 crc kubenswrapper[5120]: I0316 15:33:48.259788 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/fe2f5127-13d1-4799-9af9-bb0736bf53e9-utilities\") pod \"redhat-operators-5d9tn\" (UID: \"fe2f5127-13d1-4799-9af9-bb0736bf53e9\") " pod="openshift-marketplace/redhat-operators-5d9tn" Mar 16 15:33:48 crc kubenswrapper[5120]: I0316 15:33:48.259830 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8fhlq\" (UniqueName: \"kubernetes.io/projected/fe2f5127-13d1-4799-9af9-bb0736bf53e9-kube-api-access-8fhlq\") pod \"redhat-operators-5d9tn\" (UID: \"fe2f5127-13d1-4799-9af9-bb0736bf53e9\") " pod="openshift-marketplace/redhat-operators-5d9tn" Mar 16 15:33:48 crc kubenswrapper[5120]: I0316 15:33:48.259948 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/fe2f5127-13d1-4799-9af9-bb0736bf53e9-catalog-content\") pod \"redhat-operators-5d9tn\" (UID: \"fe2f5127-13d1-4799-9af9-bb0736bf53e9\") " pod="openshift-marketplace/redhat-operators-5d9tn" Mar 16 15:33:48 crc kubenswrapper[5120]: I0316 15:33:48.260789 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/fe2f5127-13d1-4799-9af9-bb0736bf53e9-catalog-content\") pod \"redhat-operators-5d9tn\" (UID: \"fe2f5127-13d1-4799-9af9-bb0736bf53e9\") " pod="openshift-marketplace/redhat-operators-5d9tn" Mar 16 15:33:48 crc kubenswrapper[5120]: I0316 15:33:48.261112 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/fe2f5127-13d1-4799-9af9-bb0736bf53e9-utilities\") pod \"redhat-operators-5d9tn\" (UID: \"fe2f5127-13d1-4799-9af9-bb0736bf53e9\") " pod="openshift-marketplace/redhat-operators-5d9tn" Mar 16 15:33:48 crc kubenswrapper[5120]: I0316 15:33:48.284398 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fhlq\" (UniqueName: \"kubernetes.io/projected/fe2f5127-13d1-4799-9af9-bb0736bf53e9-kube-api-access-8fhlq\") pod \"redhat-operators-5d9tn\" (UID: \"fe2f5127-13d1-4799-9af9-bb0736bf53e9\") " pod="openshift-marketplace/redhat-operators-5d9tn" Mar 16 15:33:48 crc kubenswrapper[5120]: I0316 15:33:48.335061 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/revision-pruner-11-crc" Mar 16 15:33:48 crc kubenswrapper[5120]: I0316 15:33:48.392046 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-5d9tn" Mar 16 15:33:48 crc kubenswrapper[5120]: I0316 15:33:48.393044 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-operators-dd7qh"] Mar 16 15:33:48 crc kubenswrapper[5120]: I0316 15:33:48.396840 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-dd7qh" Mar 16 15:33:48 crc kubenswrapper[5120]: I0316 15:33:48.409137 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-dd7qh"] Mar 16 15:33:48 crc kubenswrapper[5120]: I0316 15:33:48.462490 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/b7d10a42-60a3-4313-8631-37995e78f48e-catalog-content\") pod \"redhat-operators-dd7qh\" (UID: \"b7d10a42-60a3-4313-8631-37995e78f48e\") " pod="openshift-marketplace/redhat-operators-dd7qh" Mar 16 15:33:48 crc kubenswrapper[5120]: I0316 15:33:48.462554 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/b7d10a42-60a3-4313-8631-37995e78f48e-utilities\") pod \"redhat-operators-dd7qh\" (UID: \"b7d10a42-60a3-4313-8631-37995e78f48e\") " pod="openshift-marketplace/redhat-operators-dd7qh" Mar 16 15:33:48 crc kubenswrapper[5120]: I0316 15:33:48.462585 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvr4c\" (UniqueName: \"kubernetes.io/projected/b7d10a42-60a3-4313-8631-37995e78f48e-kube-api-access-gvr4c\") pod \"redhat-operators-dd7qh\" (UID: \"b7d10a42-60a3-4313-8631-37995e78f48e\") " pod="openshift-marketplace/redhat-operators-dd7qh" Mar 16 15:33:48 crc kubenswrapper[5120]: I0316 15:33:48.524752 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-66587d64c8-blgcz" event={"ID":"6528b019-774e-4298-abe6-69f062f0a13e","Type":"ContainerStarted","Data":"6d07bbca2cddcefa55f8046e3397dea658e5b5b01d6b9aecf7123fce038b5a2f"} Mar 16 15:33:48 crc kubenswrapper[5120]: I0316 15:33:48.525004 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-66587d64c8-blgcz" Mar 16 15:33:48 crc kubenswrapper[5120]: I0316 15:33:48.531082 5120 generic.go:358] "Generic (PLEG): container finished" podID="888cb38a-98cf-4897-95ec-879b29e12656" containerID="0483bfd4f388a657a681b159d62f9df53ed2409425c73220a847784b904d04cd" exitCode=0 Mar 16 15:33:48 crc kubenswrapper[5120]: I0316 15:33:48.531623 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-p8tsg" event={"ID":"888cb38a-98cf-4897-95ec-879b29e12656","Type":"ContainerDied","Data":"0483bfd4f388a657a681b159d62f9df53ed2409425c73220a847784b904d04cd"} Mar 16 15:33:48 crc kubenswrapper[5120]: I0316 15:33:48.535317 5120 generic.go:358] "Generic (PLEG): container finished" podID="b89af808-d797-4840-9969-8f4eb5dc9157" containerID="1cea664a8bbed57215d87d905c766dd54f9e28fd22481686d17a842859e917de" exitCode=0 Mar 16 15:33:48 crc kubenswrapper[5120]: I0316 15:33:48.535586 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-kr7pv" event={"ID":"b89af808-d797-4840-9969-8f4eb5dc9157","Type":"ContainerDied","Data":"1cea664a8bbed57215d87d905c766dd54f9e28fd22481686d17a842859e917de"} Mar 16 15:33:48 crc kubenswrapper[5120]: I0316 15:33:48.535616 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-kr7pv" event={"ID":"b89af808-d797-4840-9969-8f4eb5dc9157","Type":"ContainerStarted","Data":"e0b64d08a1608420e59672495a6790137315f7c22543cbf9920a76446cf0e15d"} Mar 16 15:33:48 crc kubenswrapper[5120]: I0316 15:33:48.543245 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-oauth-apiserver/apiserver-8596bd845d-jb8bk" Mar 16 15:33:48 crc kubenswrapper[5120]: I0316 15:33:48.546995 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-66587d64c8-blgcz" podStartSLOduration=109.546978683 podStartE2EDuration="1m49.546978683s" podCreationTimestamp="2026-03-16 15:31:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:33:48.540124428 +0000 UTC m=+130.694056085" watchObservedRunningTime="2026-03-16 15:33:48.546978683 +0000 UTC m=+130.700910340" Mar 16 15:33:48 crc kubenswrapper[5120]: I0316 15:33:48.564193 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/b7d10a42-60a3-4313-8631-37995e78f48e-catalog-content\") pod \"redhat-operators-dd7qh\" (UID: \"b7d10a42-60a3-4313-8631-37995e78f48e\") " pod="openshift-marketplace/redhat-operators-dd7qh" Mar 16 15:33:48 crc kubenswrapper[5120]: I0316 15:33:48.564251 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/b7d10a42-60a3-4313-8631-37995e78f48e-utilities\") pod \"redhat-operators-dd7qh\" (UID: \"b7d10a42-60a3-4313-8631-37995e78f48e\") " pod="openshift-marketplace/redhat-operators-dd7qh" Mar 16 15:33:48 crc kubenswrapper[5120]: I0316 15:33:48.564287 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gvr4c\" (UniqueName: \"kubernetes.io/projected/b7d10a42-60a3-4313-8631-37995e78f48e-kube-api-access-gvr4c\") pod \"redhat-operators-dd7qh\" (UID: \"b7d10a42-60a3-4313-8631-37995e78f48e\") " pod="openshift-marketplace/redhat-operators-dd7qh" Mar 16 15:33:48 crc kubenswrapper[5120]: I0316 15:33:48.565196 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/b7d10a42-60a3-4313-8631-37995e78f48e-catalog-content\") pod \"redhat-operators-dd7qh\" (UID: \"b7d10a42-60a3-4313-8631-37995e78f48e\") " pod="openshift-marketplace/redhat-operators-dd7qh" Mar 16 15:33:48 crc kubenswrapper[5120]: I0316 15:33:48.565814 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/b7d10a42-60a3-4313-8631-37995e78f48e-utilities\") pod \"redhat-operators-dd7qh\" (UID: \"b7d10a42-60a3-4313-8631-37995e78f48e\") " pod="openshift-marketplace/redhat-operators-dd7qh" Mar 16 15:33:48 crc kubenswrapper[5120]: I0316 15:33:48.600233 5120 ???:1] "http: TLS handshake error from 192.168.126.11:60778: no serving certificate available for the kubelet" Mar 16 15:33:48 crc kubenswrapper[5120]: I0316 15:33:48.607298 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvr4c\" (UniqueName: \"kubernetes.io/projected/b7d10a42-60a3-4313-8631-37995e78f48e-kube-api-access-gvr4c\") pod \"redhat-operators-dd7qh\" (UID: \"b7d10a42-60a3-4313-8631-37995e78f48e\") " pod="openshift-marketplace/redhat-operators-dd7qh" Mar 16 15:33:48 crc kubenswrapper[5120]: I0316 15:33:48.695978 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9e9b5059-1b3e-4067-a63d-2952cbe863af" path="/var/lib/kubelet/pods/9e9b5059-1b3e-4067-a63d-2952cbe863af/volumes" Mar 16 15:33:48 crc kubenswrapper[5120]: I0316 15:33:48.711703 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-dd7qh" Mar 16 15:33:48 crc kubenswrapper[5120]: I0316 15:33:48.821709 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-apiserver/revision-pruner-11-crc"] Mar 16 15:33:48 crc kubenswrapper[5120]: I0316 15:33:48.864788 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29561250-7npz6" Mar 16 15:33:48 crc kubenswrapper[5120]: I0316 15:33:48.877095 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler/revision-pruner-6-crc" Mar 16 15:33:48 crc kubenswrapper[5120]: I0316 15:33:48.935124 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-5d9tn"] Mar 16 15:33:48 crc kubenswrapper[5120]: W0316 15:33:48.948168 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe2f5127_13d1_4799_9af9_bb0736bf53e9.slice/crio-d4dd69e1a1f58aea64f0fee305708169aff7de31b62d88e303a5eb72f0ab3ea1 WatchSource:0}: Error finding container d4dd69e1a1f58aea64f0fee305708169aff7de31b62d88e303a5eb72f0ab3ea1: Status 404 returned error can't find the container with id d4dd69e1a1f58aea64f0fee305708169aff7de31b62d88e303a5eb72f0ab3ea1 Mar 16 15:33:48 crc kubenswrapper[5120]: I0316 15:33:48.969100 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7prtv\" (UniqueName: \"kubernetes.io/projected/deae033b-c4b8-462c-b29b-5115eb40a94b-kube-api-access-7prtv\") pod \"deae033b-c4b8-462c-b29b-5115eb40a94b\" (UID: \"deae033b-c4b8-462c-b29b-5115eb40a94b\") " Mar 16 15:33:48 crc kubenswrapper[5120]: I0316 15:33:48.969187 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/523268a8-a14f-458e-bfe1-0a2ff7692fe4-kubelet-dir\") pod \"523268a8-a14f-458e-bfe1-0a2ff7692fe4\" (UID: \"523268a8-a14f-458e-bfe1-0a2ff7692fe4\") " Mar 16 15:33:48 crc kubenswrapper[5120]: I0316 15:33:48.969254 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/deae033b-c4b8-462c-b29b-5115eb40a94b-config-volume\") pod \"deae033b-c4b8-462c-b29b-5115eb40a94b\" (UID: \"deae033b-c4b8-462c-b29b-5115eb40a94b\") " Mar 16 15:33:48 crc kubenswrapper[5120]: I0316 15:33:48.969274 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/deae033b-c4b8-462c-b29b-5115eb40a94b-secret-volume\") pod \"deae033b-c4b8-462c-b29b-5115eb40a94b\" (UID: \"deae033b-c4b8-462c-b29b-5115eb40a94b\") " Mar 16 15:33:48 crc kubenswrapper[5120]: I0316 15:33:48.969356 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/523268a8-a14f-458e-bfe1-0a2ff7692fe4-kube-api-access\") pod \"523268a8-a14f-458e-bfe1-0a2ff7692fe4\" (UID: \"523268a8-a14f-458e-bfe1-0a2ff7692fe4\") " Mar 16 15:33:48 crc kubenswrapper[5120]: I0316 15:33:48.974851 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/deae033b-c4b8-462c-b29b-5115eb40a94b-config-volume" (OuterVolumeSpecName: "config-volume") pod "deae033b-c4b8-462c-b29b-5115eb40a94b" (UID: "deae033b-c4b8-462c-b29b-5115eb40a94b"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:33:48 crc kubenswrapper[5120]: I0316 15:33:48.974914 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/523268a8-a14f-458e-bfe1-0a2ff7692fe4-kubelet-dir" (OuterVolumeSpecName: "kubelet-dir") pod "523268a8-a14f-458e-bfe1-0a2ff7692fe4" (UID: "523268a8-a14f-458e-bfe1-0a2ff7692fe4"). InnerVolumeSpecName "kubelet-dir". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 15:33:48 crc kubenswrapper[5120]: I0316 15:33:48.981211 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/deae033b-c4b8-462c-b29b-5115eb40a94b-kube-api-access-7prtv" (OuterVolumeSpecName: "kube-api-access-7prtv") pod "deae033b-c4b8-462c-b29b-5115eb40a94b" (UID: "deae033b-c4b8-462c-b29b-5115eb40a94b"). InnerVolumeSpecName "kube-api-access-7prtv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:33:48 crc kubenswrapper[5120]: I0316 15:33:48.986039 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/deae033b-c4b8-462c-b29b-5115eb40a94b-secret-volume" (OuterVolumeSpecName: "secret-volume") pod "deae033b-c4b8-462c-b29b-5115eb40a94b" (UID: "deae033b-c4b8-462c-b29b-5115eb40a94b"). InnerVolumeSpecName "secret-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:33:49 crc kubenswrapper[5120]: I0316 15:33:49.001151 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/523268a8-a14f-458e-bfe1-0a2ff7692fe4-kube-api-access" (OuterVolumeSpecName: "kube-api-access") pod "523268a8-a14f-458e-bfe1-0a2ff7692fe4" (UID: "523268a8-a14f-458e-bfe1-0a2ff7692fe4"). InnerVolumeSpecName "kube-api-access". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:33:49 crc kubenswrapper[5120]: I0316 15:33:49.070457 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/523268a8-a14f-458e-bfe1-0a2ff7692fe4-kube-api-access\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:49 crc kubenswrapper[5120]: I0316 15:33:49.070693 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7prtv\" (UniqueName: \"kubernetes.io/projected/deae033b-c4b8-462c-b29b-5115eb40a94b-kube-api-access-7prtv\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:49 crc kubenswrapper[5120]: I0316 15:33:49.070705 5120 reconciler_common.go:299] "Volume detached for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/523268a8-a14f-458e-bfe1-0a2ff7692fe4-kubelet-dir\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:49 crc kubenswrapper[5120]: I0316 15:33:49.070713 5120 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/deae033b-c4b8-462c-b29b-5115eb40a94b-config-volume\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:49 crc kubenswrapper[5120]: I0316 15:33:49.070721 5120 reconciler_common.go:299] "Volume detached for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/deae033b-c4b8-462c-b29b-5115eb40a94b-secret-volume\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:49 crc kubenswrapper[5120]: I0316 15:33:49.143175 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-dd7qh"] Mar 16 15:33:49 crc kubenswrapper[5120]: I0316 15:33:49.247037 5120 patch_prober.go:28] interesting pod/router-default-68cf44c8b8-rsmpr container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Mar 16 15:33:49 crc kubenswrapper[5120]: [-]has-synced failed: reason withheld Mar 16 15:33:49 crc kubenswrapper[5120]: [+]process-running ok Mar 16 15:33:49 crc kubenswrapper[5120]: healthz check failed Mar 16 15:33:49 crc kubenswrapper[5120]: I0316 15:33:49.247090 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-68cf44c8b8-rsmpr" podUID="5b94b756-5f20-4937-a8a7-11471f916640" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Mar 16 15:33:49 crc kubenswrapper[5120]: I0316 15:33:49.545133 5120 generic.go:358] "Generic (PLEG): container finished" podID="fe2f5127-13d1-4799-9af9-bb0736bf53e9" containerID="bbf794824a8a7fe70907e087568412be254430cb5993f40d5190f1e3e6c22cea" exitCode=0 Mar 16 15:33:49 crc kubenswrapper[5120]: I0316 15:33:49.545619 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-5d9tn" event={"ID":"fe2f5127-13d1-4799-9af9-bb0736bf53e9","Type":"ContainerDied","Data":"bbf794824a8a7fe70907e087568412be254430cb5993f40d5190f1e3e6c22cea"} Mar 16 15:33:49 crc kubenswrapper[5120]: I0316 15:33:49.545651 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-5d9tn" event={"ID":"fe2f5127-13d1-4799-9af9-bb0736bf53e9","Type":"ContainerStarted","Data":"d4dd69e1a1f58aea64f0fee305708169aff7de31b62d88e303a5eb72f0ab3ea1"} Mar 16 15:33:49 crc kubenswrapper[5120]: I0316 15:33:49.548855 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/revision-pruner-11-crc" event={"ID":"4c3b2ef6-2781-4d23-97e9-52393ac08bd5","Type":"ContainerStarted","Data":"067174aff6775fd909be67f402aebc85f227871bf8f0d17874c2f2075459c853"} Mar 16 15:33:49 crc kubenswrapper[5120]: I0316 15:33:49.548881 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/revision-pruner-11-crc" event={"ID":"4c3b2ef6-2781-4d23-97e9-52393ac08bd5","Type":"ContainerStarted","Data":"10d3d0ce5fe10e486c94ab2221b0092e2230fc2fd3d40eaeedc0f51d9fffc3e8"} Mar 16 15:33:49 crc kubenswrapper[5120]: I0316 15:33:49.556155 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/collect-profiles-29561250-7npz6" event={"ID":"deae033b-c4b8-462c-b29b-5115eb40a94b","Type":"ContainerDied","Data":"22ed09d62da22cb440c642195a099f756946e5b8357dcb718accf232fd48e409"} Mar 16 15:33:49 crc kubenswrapper[5120]: I0316 15:33:49.556188 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="22ed09d62da22cb440c642195a099f756946e5b8357dcb718accf232fd48e409" Mar 16 15:33:49 crc kubenswrapper[5120]: I0316 15:33:49.556254 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29561250-7npz6" Mar 16 15:33:49 crc kubenswrapper[5120]: I0316 15:33:49.571741 5120 generic.go:358] "Generic (PLEG): container finished" podID="b7d10a42-60a3-4313-8631-37995e78f48e" containerID="ea8ab535c44f522d667d632476d333a9b4d562d70fb771e0546c40abc6f40d9c" exitCode=0 Mar 16 15:33:49 crc kubenswrapper[5120]: I0316 15:33:49.571847 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-dd7qh" event={"ID":"b7d10a42-60a3-4313-8631-37995e78f48e","Type":"ContainerDied","Data":"ea8ab535c44f522d667d632476d333a9b4d562d70fb771e0546c40abc6f40d9c"} Mar 16 15:33:49 crc kubenswrapper[5120]: I0316 15:33:49.571869 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-dd7qh" event={"ID":"b7d10a42-60a3-4313-8631-37995e78f48e","Type":"ContainerStarted","Data":"db85a21782a4e094dac2a322bfa910e80114063d7ddb185adbcd28494a97bc8b"} Mar 16 15:33:49 crc kubenswrapper[5120]: I0316 15:33:49.579636 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler/revision-pruner-6-crc" event={"ID":"523268a8-a14f-458e-bfe1-0a2ff7692fe4","Type":"ContainerDied","Data":"c83fb3d879d340b3b6e7df47234723c8c8224c2371764b2e24e797e027b77a37"} Mar 16 15:33:49 crc kubenswrapper[5120]: I0316 15:33:49.579680 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c83fb3d879d340b3b6e7df47234723c8c8224c2371764b2e24e797e027b77a37" Mar 16 15:33:49 crc kubenswrapper[5120]: I0316 15:33:49.579877 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler/revision-pruner-6-crc" Mar 16 15:33:49 crc kubenswrapper[5120]: E0316 15:33:49.584889 5120 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7d10a42_60a3_4313_8631_37995e78f48e.slice/crio-conmon-ea8ab535c44f522d667d632476d333a9b4d562d70fb771e0546c40abc6f40d9c.scope\": RecentStats: unable to find data in memory cache]" Mar 16 15:33:49 crc kubenswrapper[5120]: I0316 15:33:49.585414 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-apiserver/revision-pruner-11-crc" podStartSLOduration=2.585397479 podStartE2EDuration="2.585397479s" podCreationTimestamp="2026-03-16 15:33:47 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:33:49.577983188 +0000 UTC m=+131.731914845" watchObservedRunningTime="2026-03-16 15:33:49.585397479 +0000 UTC m=+131.739329136" Mar 16 15:33:50 crc kubenswrapper[5120]: I0316 15:33:50.247640 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-68cf44c8b8-rsmpr" Mar 16 15:33:50 crc kubenswrapper[5120]: I0316 15:33:50.254086 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-68cf44c8b8-rsmpr" Mar 16 15:33:50 crc kubenswrapper[5120]: E0316 15:33:50.301130 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="608acba293e4ec2584154dbd4574825f128737103e0ed75e45e1396d200d2099" cmd=["/bin/bash","-c","test -f /ready/ready"] Mar 16 15:33:50 crc kubenswrapper[5120]: E0316 15:33:50.302623 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="608acba293e4ec2584154dbd4574825f128737103e0ed75e45e1396d200d2099" cmd=["/bin/bash","-c","test -f /ready/ready"] Mar 16 15:33:50 crc kubenswrapper[5120]: E0316 15:33:50.305883 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="608acba293e4ec2584154dbd4574825f128737103e0ed75e45e1396d200d2099" cmd=["/bin/bash","-c","test -f /ready/ready"] Mar 16 15:33:50 crc kubenswrapper[5120]: E0316 15:33:50.305920 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openshift-multus/cni-sysctl-allowlist-ds-95s4s" podUID="6f966d74-f323-4f45-9fbb-8160d73b7770" containerName="kube-multus-additional-cni-plugins" probeResult="unknown" Mar 16 15:33:50 crc kubenswrapper[5120]: I0316 15:33:50.605441 5120 generic.go:358] "Generic (PLEG): container finished" podID="4c3b2ef6-2781-4d23-97e9-52393ac08bd5" containerID="067174aff6775fd909be67f402aebc85f227871bf8f0d17874c2f2075459c853" exitCode=0 Mar 16 15:33:50 crc kubenswrapper[5120]: I0316 15:33:50.605486 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/revision-pruner-11-crc" event={"ID":"4c3b2ef6-2781-4d23-97e9-52393ac08bd5","Type":"ContainerDied","Data":"067174aff6775fd909be67f402aebc85f227871bf8f0d17874c2f2075459c853"} Mar 16 15:33:51 crc kubenswrapper[5120]: I0316 15:33:51.951444 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/revision-pruner-11-crc" Mar 16 15:33:52 crc kubenswrapper[5120]: I0316 15:33:52.021275 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/4c3b2ef6-2781-4d23-97e9-52393ac08bd5-kube-api-access\") pod \"4c3b2ef6-2781-4d23-97e9-52393ac08bd5\" (UID: \"4c3b2ef6-2781-4d23-97e9-52393ac08bd5\") " Mar 16 15:33:52 crc kubenswrapper[5120]: I0316 15:33:52.021375 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4c3b2ef6-2781-4d23-97e9-52393ac08bd5-kubelet-dir\") pod \"4c3b2ef6-2781-4d23-97e9-52393ac08bd5\" (UID: \"4c3b2ef6-2781-4d23-97e9-52393ac08bd5\") " Mar 16 15:33:52 crc kubenswrapper[5120]: I0316 15:33:52.021699 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/4c3b2ef6-2781-4d23-97e9-52393ac08bd5-kubelet-dir" (OuterVolumeSpecName: "kubelet-dir") pod "4c3b2ef6-2781-4d23-97e9-52393ac08bd5" (UID: "4c3b2ef6-2781-4d23-97e9-52393ac08bd5"). InnerVolumeSpecName "kubelet-dir". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 15:33:52 crc kubenswrapper[5120]: I0316 15:33:52.040622 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c3b2ef6-2781-4d23-97e9-52393ac08bd5-kube-api-access" (OuterVolumeSpecName: "kube-api-access") pod "4c3b2ef6-2781-4d23-97e9-52393ac08bd5" (UID: "4c3b2ef6-2781-4d23-97e9-52393ac08bd5"). InnerVolumeSpecName "kube-api-access". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:33:52 crc kubenswrapper[5120]: I0316 15:33:52.122548 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/4c3b2ef6-2781-4d23-97e9-52393ac08bd5-kube-api-access\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:52 crc kubenswrapper[5120]: I0316 15:33:52.122604 5120 reconciler_common.go:299] "Volume detached for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4c3b2ef6-2781-4d23-97e9-52393ac08bd5-kubelet-dir\") on node \"crc\" DevicePath \"\"" Mar 16 15:33:52 crc kubenswrapper[5120]: I0316 15:33:52.620925 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/revision-pruner-11-crc" event={"ID":"4c3b2ef6-2781-4d23-97e9-52393ac08bd5","Type":"ContainerDied","Data":"10d3d0ce5fe10e486c94ab2221b0092e2230fc2fd3d40eaeedc0f51d9fffc3e8"} Mar 16 15:33:52 crc kubenswrapper[5120]: I0316 15:33:52.621192 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="10d3d0ce5fe10e486c94ab2221b0092e2230fc2fd3d40eaeedc0f51d9fffc3e8" Mar 16 15:33:52 crc kubenswrapper[5120]: I0316 15:33:52.621263 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/revision-pruner-11-crc" Mar 16 15:33:54 crc kubenswrapper[5120]: I0316 15:33:54.458247 5120 patch_prober.go:28] interesting pod/downloads-747b44746d-pjv44 container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.217.0.37:8080/\": dial tcp 10.217.0.37:8080: connect: connection refused" start-of-body= Mar 16 15:33:54 crc kubenswrapper[5120]: I0316 15:33:54.458390 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-747b44746d-pjv44" podUID="b064c090-1362-427c-b805-d2808c01b58c" containerName="download-server" probeResult="failure" output="Get \"http://10.217.0.37:8080/\": dial tcp 10.217.0.37:8080: connect: connection refused" Mar 16 15:33:54 crc kubenswrapper[5120]: I0316 15:33:54.469834 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-9x6jk" Mar 16 15:33:58 crc kubenswrapper[5120]: I0316 15:33:58.151624 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-64d44f6ddf-4pm87" Mar 16 15:33:58 crc kubenswrapper[5120]: I0316 15:33:58.159124 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-64d44f6ddf-4pm87" Mar 16 15:33:58 crc kubenswrapper[5120]: I0316 15:33:58.882078 5120 ???:1] "http: TLS handshake error from 192.168.126.11:42824: no serving certificate available for the kubelet" Mar 16 15:34:00 crc kubenswrapper[5120]: I0316 15:34:00.141936 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-infra/auto-csr-approver-29561254-gtc86"] Mar 16 15:34:00 crc kubenswrapper[5120]: I0316 15:34:00.143557 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="523268a8-a14f-458e-bfe1-0a2ff7692fe4" containerName="pruner" Mar 16 15:34:00 crc kubenswrapper[5120]: I0316 15:34:00.143601 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="523268a8-a14f-458e-bfe1-0a2ff7692fe4" containerName="pruner" Mar 16 15:34:00 crc kubenswrapper[5120]: I0316 15:34:00.143628 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="deae033b-c4b8-462c-b29b-5115eb40a94b" containerName="collect-profiles" Mar 16 15:34:00 crc kubenswrapper[5120]: I0316 15:34:00.143642 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="deae033b-c4b8-462c-b29b-5115eb40a94b" containerName="collect-profiles" Mar 16 15:34:00 crc kubenswrapper[5120]: I0316 15:34:00.143679 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c3b2ef6-2781-4d23-97e9-52393ac08bd5" containerName="pruner" Mar 16 15:34:00 crc kubenswrapper[5120]: I0316 15:34:00.143692 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c3b2ef6-2781-4d23-97e9-52393ac08bd5" containerName="pruner" Mar 16 15:34:00 crc kubenswrapper[5120]: I0316 15:34:00.143956 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="deae033b-c4b8-462c-b29b-5115eb40a94b" containerName="collect-profiles" Mar 16 15:34:00 crc kubenswrapper[5120]: I0316 15:34:00.143995 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="523268a8-a14f-458e-bfe1-0a2ff7692fe4" containerName="pruner" Mar 16 15:34:00 crc kubenswrapper[5120]: I0316 15:34:00.144018 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="4c3b2ef6-2781-4d23-97e9-52393ac08bd5" containerName="pruner" Mar 16 15:34:00 crc kubenswrapper[5120]: E0316 15:34:00.297591 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="608acba293e4ec2584154dbd4574825f128737103e0ed75e45e1396d200d2099" cmd=["/bin/bash","-c","test -f /ready/ready"] Mar 16 15:34:00 crc kubenswrapper[5120]: E0316 15:34:00.298874 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="608acba293e4ec2584154dbd4574825f128737103e0ed75e45e1396d200d2099" cmd=["/bin/bash","-c","test -f /ready/ready"] Mar 16 15:34:00 crc kubenswrapper[5120]: E0316 15:34:00.300614 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="608acba293e4ec2584154dbd4574825f128737103e0ed75e45e1396d200d2099" cmd=["/bin/bash","-c","test -f /ready/ready"] Mar 16 15:34:00 crc kubenswrapper[5120]: E0316 15:34:00.300648 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openshift-multus/cni-sysctl-allowlist-ds-95s4s" podUID="6f966d74-f323-4f45-9fbb-8160d73b7770" containerName="kube-multus-additional-cni-plugins" probeResult="unknown" Mar 16 15:34:01 crc kubenswrapper[5120]: I0316 15:34:01.085124 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561254-gtc86" Mar 16 15:34:01 crc kubenswrapper[5120]: I0316 15:34:01.087627 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"kube-root-ca.crt\"" Mar 16 15:34:01 crc kubenswrapper[5120]: I0316 15:34:01.087888 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-infra\"/\"csr-approver-sa-dockercfg-x2nsz\"" Mar 16 15:34:01 crc kubenswrapper[5120]: I0316 15:34:01.090216 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"openshift-service-ca.crt\"" Mar 16 15:34:01 crc kubenswrapper[5120]: I0316 15:34:01.091581 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561254-gtc86"] Mar 16 15:34:01 crc kubenswrapper[5120]: I0316 15:34:01.152126 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jw8c5\" (UniqueName: \"kubernetes.io/projected/7ecb3681-0da8-4d4a-9634-ce236c5ac399-kube-api-access-jw8c5\") pod \"auto-csr-approver-29561254-gtc86\" (UID: \"7ecb3681-0da8-4d4a-9634-ce236c5ac399\") " pod="openshift-infra/auto-csr-approver-29561254-gtc86" Mar 16 15:34:01 crc kubenswrapper[5120]: I0316 15:34:01.172496 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zwk29" Mar 16 15:34:01 crc kubenswrapper[5120]: I0316 15:34:01.253898 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jw8c5\" (UniqueName: \"kubernetes.io/projected/7ecb3681-0da8-4d4a-9634-ce236c5ac399-kube-api-access-jw8c5\") pod \"auto-csr-approver-29561254-gtc86\" (UID: \"7ecb3681-0da8-4d4a-9634-ce236c5ac399\") " pod="openshift-infra/auto-csr-approver-29561254-gtc86" Mar 16 15:34:01 crc kubenswrapper[5120]: I0316 15:34:01.284646 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jw8c5\" (UniqueName: \"kubernetes.io/projected/7ecb3681-0da8-4d4a-9634-ce236c5ac399-kube-api-access-jw8c5\") pod \"auto-csr-approver-29561254-gtc86\" (UID: \"7ecb3681-0da8-4d4a-9634-ce236c5ac399\") " pod="openshift-infra/auto-csr-approver-29561254-gtc86" Mar 16 15:34:01 crc kubenswrapper[5120]: I0316 15:34:01.410324 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561254-gtc86" Mar 16 15:34:04 crc kubenswrapper[5120]: I0316 15:34:04.459501 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-747b44746d-pjv44" Mar 16 15:34:06 crc kubenswrapper[5120]: I0316 15:34:06.887534 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561254-gtc86"] Mar 16 15:34:07 crc kubenswrapper[5120]: I0316 15:34:07.731932 5120 generic.go:358] "Generic (PLEG): container finished" podID="f4f60942-f576-4e00-88be-a52a1e6d91ec" containerID="5cc155a31319f541cc86641a84cb4674b6e7d5b414450d7d9729471b86ea6e35" exitCode=0 Mar 16 15:34:07 crc kubenswrapper[5120]: I0316 15:34:07.732417 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-zz5g5" event={"ID":"f4f60942-f576-4e00-88be-a52a1e6d91ec","Type":"ContainerDied","Data":"5cc155a31319f541cc86641a84cb4674b6e7d5b414450d7d9729471b86ea6e35"} Mar 16 15:34:07 crc kubenswrapper[5120]: I0316 15:34:07.736339 5120 generic.go:358] "Generic (PLEG): container finished" podID="b7d10a42-60a3-4313-8631-37995e78f48e" containerID="05959ed51ed2ce34710e33ba22c11a750abd26a2b70e1daae112530b1902698b" exitCode=0 Mar 16 15:34:07 crc kubenswrapper[5120]: I0316 15:34:07.736507 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-dd7qh" event={"ID":"b7d10a42-60a3-4313-8631-37995e78f48e","Type":"ContainerDied","Data":"05959ed51ed2ce34710e33ba22c11a750abd26a2b70e1daae112530b1902698b"} Mar 16 15:34:07 crc kubenswrapper[5120]: I0316 15:34:07.739510 5120 generic.go:358] "Generic (PLEG): container finished" podID="5910a375-22bc-4049-9165-8ce8298a85ba" containerID="aee1da055214132d486e073bb087dae294caeb7695b21806d12241f4b78d8193" exitCode=0 Mar 16 15:34:07 crc kubenswrapper[5120]: I0316 15:34:07.739578 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-n4gbm" event={"ID":"5910a375-22bc-4049-9165-8ce8298a85ba","Type":"ContainerDied","Data":"aee1da055214132d486e073bb087dae294caeb7695b21806d12241f4b78d8193"} Mar 16 15:34:07 crc kubenswrapper[5120]: I0316 15:34:07.744211 5120 generic.go:358] "Generic (PLEG): container finished" podID="888cb38a-98cf-4897-95ec-879b29e12656" containerID="636f69b826e8a1b02f5a1e1f62d52cbc3942ba757b7dad4d3b5cef4c8e194bd9" exitCode=0 Mar 16 15:34:07 crc kubenswrapper[5120]: I0316 15:34:07.744333 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-p8tsg" event={"ID":"888cb38a-98cf-4897-95ec-879b29e12656","Type":"ContainerDied","Data":"636f69b826e8a1b02f5a1e1f62d52cbc3942ba757b7dad4d3b5cef4c8e194bd9"} Mar 16 15:34:07 crc kubenswrapper[5120]: I0316 15:34:07.748568 5120 generic.go:358] "Generic (PLEG): container finished" podID="2bb55bd0-43ba-4f30-93ad-aca0a4a74d04" containerID="c4c5f487500bf582de84a0bdf55493047e57c34c41701a9320d18031da479b61" exitCode=0 Mar 16 15:34:07 crc kubenswrapper[5120]: I0316 15:34:07.748653 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-gb62c" event={"ID":"2bb55bd0-43ba-4f30-93ad-aca0a4a74d04","Type":"ContainerDied","Data":"c4c5f487500bf582de84a0bdf55493047e57c34c41701a9320d18031da479b61"} Mar 16 15:34:07 crc kubenswrapper[5120]: I0316 15:34:07.751163 5120 generic.go:358] "Generic (PLEG): container finished" podID="3529f46e-85a5-437e-8773-68d7dc6b6f9c" containerID="0b517684787596dcbe5b47aace272045cd395ad0503ad6178951f64602d580d0" exitCode=0 Mar 16 15:34:07 crc kubenswrapper[5120]: I0316 15:34:07.751446 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-bzrbr" event={"ID":"3529f46e-85a5-437e-8773-68d7dc6b6f9c","Type":"ContainerDied","Data":"0b517684787596dcbe5b47aace272045cd395ad0503ad6178951f64602d580d0"} Mar 16 15:34:07 crc kubenswrapper[5120]: I0316 15:34:07.755355 5120 generic.go:358] "Generic (PLEG): container finished" podID="fe2f5127-13d1-4799-9af9-bb0736bf53e9" containerID="b226c5cc203dc21a88be61a51b78e67fb266dfced6386f5e8b2a824c055b6424" exitCode=0 Mar 16 15:34:07 crc kubenswrapper[5120]: I0316 15:34:07.755501 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-5d9tn" event={"ID":"fe2f5127-13d1-4799-9af9-bb0736bf53e9","Type":"ContainerDied","Data":"b226c5cc203dc21a88be61a51b78e67fb266dfced6386f5e8b2a824c055b6424"} Mar 16 15:34:07 crc kubenswrapper[5120]: I0316 15:34:07.760003 5120 generic.go:358] "Generic (PLEG): container finished" podID="b89af808-d797-4840-9969-8f4eb5dc9157" containerID="db8dd005b0cc159bca25ce00405579d1829a3dbd1d925c20a9ae887fd7088c96" exitCode=0 Mar 16 15:34:07 crc kubenswrapper[5120]: I0316 15:34:07.760149 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-kr7pv" event={"ID":"b89af808-d797-4840-9969-8f4eb5dc9157","Type":"ContainerDied","Data":"db8dd005b0cc159bca25ce00405579d1829a3dbd1d925c20a9ae887fd7088c96"} Mar 16 15:34:07 crc kubenswrapper[5120]: I0316 15:34:07.762421 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561254-gtc86" event={"ID":"7ecb3681-0da8-4d4a-9634-ce236c5ac399","Type":"ContainerStarted","Data":"04979c1ac014d70ce830acf1a4c19a852f9fb8563da4520e103d14d141c1efd5"} Mar 16 15:34:08 crc kubenswrapper[5120]: I0316 15:34:08.769339 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-zz5g5" event={"ID":"f4f60942-f576-4e00-88be-a52a1e6d91ec","Type":"ContainerStarted","Data":"7460b0cb98ad635cff620c80660536aff790b2158c84428354a77cb54c999c04"} Mar 16 15:34:08 crc kubenswrapper[5120]: I0316 15:34:08.774339 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-dd7qh" event={"ID":"b7d10a42-60a3-4313-8631-37995e78f48e","Type":"ContainerStarted","Data":"1a6b68bc46b54e0be57f7409fcc1625f7dde6a5557c8756b54f2a49e75e0b57a"} Mar 16 15:34:08 crc kubenswrapper[5120]: I0316 15:34:08.778600 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-n4gbm" event={"ID":"5910a375-22bc-4049-9165-8ce8298a85ba","Type":"ContainerStarted","Data":"7d5832c9a40562c7f064e11be96d9aeb058ebff3cefffc040df5bb9ad0093218"} Mar 16 15:34:08 crc kubenswrapper[5120]: I0316 15:34:08.784084 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-p8tsg" event={"ID":"888cb38a-98cf-4897-95ec-879b29e12656","Type":"ContainerStarted","Data":"6d93225931be81d0a8775a2594501f3ebc57ce59fb959d0cf4ce0575233ccef0"} Mar 16 15:34:08 crc kubenswrapper[5120]: I0316 15:34:08.788531 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-bzrbr" event={"ID":"3529f46e-85a5-437e-8773-68d7dc6b6f9c","Type":"ContainerStarted","Data":"3d7dda4dbf9df13b317ca3762ba9297714e949ba042e4438903d54125ca9d6cb"} Mar 16 15:34:09 crc kubenswrapper[5120]: I0316 15:34:09.021724 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/certified-operators-zz5g5" podStartSLOduration=4.978256351 podStartE2EDuration="25.02169792s" podCreationTimestamp="2026-03-16 15:33:44 +0000 UTC" firstStartedPulling="2026-03-16 15:33:46.480752592 +0000 UTC m=+128.634684249" lastFinishedPulling="2026-03-16 15:34:06.524194161 +0000 UTC m=+148.678125818" observedRunningTime="2026-03-16 15:34:09.021394182 +0000 UTC m=+151.175325859" watchObservedRunningTime="2026-03-16 15:34:09.02169792 +0000 UTC m=+151.175629607" Mar 16 15:34:09 crc kubenswrapper[5120]: I0316 15:34:09.042650 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/redhat-marketplace-p8tsg" podStartSLOduration=5.049989769 podStartE2EDuration="23.042626466s" podCreationTimestamp="2026-03-16 15:33:46 +0000 UTC" firstStartedPulling="2026-03-16 15:33:48.532318665 +0000 UTC m=+130.686250322" lastFinishedPulling="2026-03-16 15:34:06.524955362 +0000 UTC m=+148.678887019" observedRunningTime="2026-03-16 15:34:09.035549641 +0000 UTC m=+151.189481308" watchObservedRunningTime="2026-03-16 15:34:09.042626466 +0000 UTC m=+151.196558153" Mar 16 15:34:09 crc kubenswrapper[5120]: I0316 15:34:09.054069 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/redhat-operators-dd7qh" podStartSLOduration=4.104362172 podStartE2EDuration="21.05404311s" podCreationTimestamp="2026-03-16 15:33:48 +0000 UTC" firstStartedPulling="2026-03-16 15:33:49.573205517 +0000 UTC m=+131.727137164" lastFinishedPulling="2026-03-16 15:34:06.522886445 +0000 UTC m=+148.676818102" observedRunningTime="2026-03-16 15:34:09.051987943 +0000 UTC m=+151.205919600" watchObservedRunningTime="2026-03-16 15:34:09.05404311 +0000 UTC m=+151.207974777" Mar 16 15:34:09 crc kubenswrapper[5120]: I0316 15:34:09.079986 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/certified-operators-n4gbm" podStartSLOduration=4.042411544 podStartE2EDuration="24.079966553s" podCreationTimestamp="2026-03-16 15:33:45 +0000 UTC" firstStartedPulling="2026-03-16 15:33:46.486528909 +0000 UTC m=+128.640460566" lastFinishedPulling="2026-03-16 15:34:06.524083918 +0000 UTC m=+148.678015575" observedRunningTime="2026-03-16 15:34:09.075423219 +0000 UTC m=+151.229354886" watchObservedRunningTime="2026-03-16 15:34:09.079966553 +0000 UTC m=+151.233898210" Mar 16 15:34:09 crc kubenswrapper[5120]: I0316 15:34:09.590371 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-66587d64c8-blgcz" Mar 16 15:34:09 crc kubenswrapper[5120]: I0316 15:34:09.798221 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-gb62c" event={"ID":"2bb55bd0-43ba-4f30-93ad-aca0a4a74d04","Type":"ContainerStarted","Data":"8581a4810d0fc7e1a7f6d82c72b3865d0e5d20f5b0be361b55d0a23064ff00bd"} Mar 16 15:34:09 crc kubenswrapper[5120]: I0316 15:34:09.801628 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-5d9tn" event={"ID":"fe2f5127-13d1-4799-9af9-bb0736bf53e9","Type":"ContainerStarted","Data":"afbaab0478d915cc2c2f1def4a4e2a2a0ebbdfd4bffeafa5625973c57f92aa86"} Mar 16 15:34:09 crc kubenswrapper[5120]: I0316 15:34:09.803584 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-kr7pv" event={"ID":"b89af808-d797-4840-9969-8f4eb5dc9157","Type":"ContainerStarted","Data":"acc2b9c510b41395c2d3a4065832dac473b4071a305247728589144e70a36bd4"} Mar 16 15:34:09 crc kubenswrapper[5120]: I0316 15:34:09.818891 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/community-operators-gb62c" podStartSLOduration=4.728181603 podStartE2EDuration="24.818875027s" podCreationTimestamp="2026-03-16 15:33:45 +0000 UTC" firstStartedPulling="2026-03-16 15:33:46.494158226 +0000 UTC m=+128.648089883" lastFinishedPulling="2026-03-16 15:34:06.58485165 +0000 UTC m=+148.738783307" observedRunningTime="2026-03-16 15:34:09.816400668 +0000 UTC m=+151.970332355" watchObservedRunningTime="2026-03-16 15:34:09.818875027 +0000 UTC m=+151.972806684" Mar 16 15:34:09 crc kubenswrapper[5120]: I0316 15:34:09.834074 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/redhat-marketplace-kr7pv" podStartSLOduration=4.865622904 podStartE2EDuration="22.834056135s" podCreationTimestamp="2026-03-16 15:33:47 +0000 UTC" firstStartedPulling="2026-03-16 15:33:48.536218912 +0000 UTC m=+130.690150569" lastFinishedPulling="2026-03-16 15:34:06.504652143 +0000 UTC m=+148.658583800" observedRunningTime="2026-03-16 15:34:09.830547728 +0000 UTC m=+151.984479385" watchObservedRunningTime="2026-03-16 15:34:09.834056135 +0000 UTC m=+151.987987792" Mar 16 15:34:09 crc kubenswrapper[5120]: I0316 15:34:09.847520 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/community-operators-bzrbr" podStartSLOduration=5.813101639 podStartE2EDuration="25.847502925s" podCreationTimestamp="2026-03-16 15:33:44 +0000 UTC" firstStartedPulling="2026-03-16 15:33:46.49651062 +0000 UTC m=+128.650442277" lastFinishedPulling="2026-03-16 15:34:06.530911906 +0000 UTC m=+148.684843563" observedRunningTime="2026-03-16 15:34:09.846700533 +0000 UTC m=+152.000632190" watchObservedRunningTime="2026-03-16 15:34:09.847502925 +0000 UTC m=+152.001434582" Mar 16 15:34:09 crc kubenswrapper[5120]: I0316 15:34:09.860742 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/redhat-operators-5d9tn" podStartSLOduration=5.855735818 podStartE2EDuration="22.860719479s" podCreationTimestamp="2026-03-16 15:33:47 +0000 UTC" firstStartedPulling="2026-03-16 15:33:49.546499501 +0000 UTC m=+131.700431158" lastFinishedPulling="2026-03-16 15:34:06.551483162 +0000 UTC m=+148.705414819" observedRunningTime="2026-03-16 15:34:09.85895235 +0000 UTC m=+152.012884007" watchObservedRunningTime="2026-03-16 15:34:09.860719479 +0000 UTC m=+152.014651156" Mar 16 15:34:10 crc kubenswrapper[5120]: E0316 15:34:10.298273 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="608acba293e4ec2584154dbd4574825f128737103e0ed75e45e1396d200d2099" cmd=["/bin/bash","-c","test -f /ready/ready"] Mar 16 15:34:10 crc kubenswrapper[5120]: E0316 15:34:10.305503 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="608acba293e4ec2584154dbd4574825f128737103e0ed75e45e1396d200d2099" cmd=["/bin/bash","-c","test -f /ready/ready"] Mar 16 15:34:10 crc kubenswrapper[5120]: E0316 15:34:10.310721 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="608acba293e4ec2584154dbd4574825f128737103e0ed75e45e1396d200d2099" cmd=["/bin/bash","-c","test -f /ready/ready"] Mar 16 15:34:10 crc kubenswrapper[5120]: E0316 15:34:10.310806 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openshift-multus/cni-sysctl-allowlist-ds-95s4s" podUID="6f966d74-f323-4f45-9fbb-8160d73b7770" containerName="kube-multus-additional-cni-plugins" probeResult="unknown" Mar 16 15:34:12 crc kubenswrapper[5120]: I0316 15:34:12.828412 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561254-gtc86" event={"ID":"7ecb3681-0da8-4d4a-9634-ce236c5ac399","Type":"ContainerStarted","Data":"4daa17fb3a50b05591503f3f5efe464b1d42bb81c3e84c0a500cbfa5bcb45d24"} Mar 16 15:34:12 crc kubenswrapper[5120]: I0316 15:34:12.841852 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-infra/auto-csr-approver-29561254-gtc86" podStartSLOduration=7.5609907849999995 podStartE2EDuration="12.841837362s" podCreationTimestamp="2026-03-16 15:34:00 +0000 UTC" firstStartedPulling="2026-03-16 15:34:06.925324474 +0000 UTC m=+149.079256131" lastFinishedPulling="2026-03-16 15:34:12.206171051 +0000 UTC m=+154.360102708" observedRunningTime="2026-03-16 15:34:12.84030253 +0000 UTC m=+154.994234187" watchObservedRunningTime="2026-03-16 15:34:12.841837362 +0000 UTC m=+154.995769019" Mar 16 15:34:13 crc kubenswrapper[5120]: I0316 15:34:13.120874 5120 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-88kl8" Mar 16 15:34:13 crc kubenswrapper[5120]: I0316 15:34:13.131116 5120 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-88kl8" Mar 16 15:34:13 crc kubenswrapper[5120]: I0316 15:34:13.440232 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-fhkjl" Mar 16 15:34:13 crc kubenswrapper[5120]: I0316 15:34:13.574397 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_cni-sysctl-allowlist-ds-95s4s_6f966d74-f323-4f45-9fbb-8160d73b7770/kube-multus-additional-cni-plugins/0.log" Mar 16 15:34:13 crc kubenswrapper[5120]: I0316 15:34:13.574476 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-multus/cni-sysctl-allowlist-ds-95s4s" Mar 16 15:34:13 crc kubenswrapper[5120]: I0316 15:34:13.731865 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6f966d74-f323-4f45-9fbb-8160d73b7770-tuning-conf-dir\") pod \"6f966d74-f323-4f45-9fbb-8160d73b7770\" (UID: \"6f966d74-f323-4f45-9fbb-8160d73b7770\") " Mar 16 15:34:13 crc kubenswrapper[5120]: I0316 15:34:13.731943 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jn8mx\" (UniqueName: \"kubernetes.io/projected/6f966d74-f323-4f45-9fbb-8160d73b7770-kube-api-access-jn8mx\") pod \"6f966d74-f323-4f45-9fbb-8160d73b7770\" (UID: \"6f966d74-f323-4f45-9fbb-8160d73b7770\") " Mar 16 15:34:13 crc kubenswrapper[5120]: I0316 15:34:13.731976 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6f966d74-f323-4f45-9fbb-8160d73b7770-cni-sysctl-allowlist\") pod \"6f966d74-f323-4f45-9fbb-8160d73b7770\" (UID: \"6f966d74-f323-4f45-9fbb-8160d73b7770\") " Mar 16 15:34:13 crc kubenswrapper[5120]: I0316 15:34:13.731970 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/6f966d74-f323-4f45-9fbb-8160d73b7770-tuning-conf-dir" (OuterVolumeSpecName: "tuning-conf-dir") pod "6f966d74-f323-4f45-9fbb-8160d73b7770" (UID: "6f966d74-f323-4f45-9fbb-8160d73b7770"). InnerVolumeSpecName "tuning-conf-dir". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 15:34:13 crc kubenswrapper[5120]: I0316 15:34:13.732064 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ready\" (UniqueName: \"kubernetes.io/empty-dir/6f966d74-f323-4f45-9fbb-8160d73b7770-ready\") pod \"6f966d74-f323-4f45-9fbb-8160d73b7770\" (UID: \"6f966d74-f323-4f45-9fbb-8160d73b7770\") " Mar 16 15:34:13 crc kubenswrapper[5120]: I0316 15:34:13.732305 5120 reconciler_common.go:299] "Volume detached for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6f966d74-f323-4f45-9fbb-8160d73b7770-tuning-conf-dir\") on node \"crc\" DevicePath \"\"" Mar 16 15:34:13 crc kubenswrapper[5120]: I0316 15:34:13.732604 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f966d74-f323-4f45-9fbb-8160d73b7770-ready" (OuterVolumeSpecName: "ready") pod "6f966d74-f323-4f45-9fbb-8160d73b7770" (UID: "6f966d74-f323-4f45-9fbb-8160d73b7770"). InnerVolumeSpecName "ready". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:34:13 crc kubenswrapper[5120]: I0316 15:34:13.733041 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f966d74-f323-4f45-9fbb-8160d73b7770-cni-sysctl-allowlist" (OuterVolumeSpecName: "cni-sysctl-allowlist") pod "6f966d74-f323-4f45-9fbb-8160d73b7770" (UID: "6f966d74-f323-4f45-9fbb-8160d73b7770"). InnerVolumeSpecName "cni-sysctl-allowlist". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:34:13 crc kubenswrapper[5120]: I0316 15:34:13.738191 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f966d74-f323-4f45-9fbb-8160d73b7770-kube-api-access-jn8mx" (OuterVolumeSpecName: "kube-api-access-jn8mx") pod "6f966d74-f323-4f45-9fbb-8160d73b7770" (UID: "6f966d74-f323-4f45-9fbb-8160d73b7770"). InnerVolumeSpecName "kube-api-access-jn8mx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:34:13 crc kubenswrapper[5120]: I0316 15:34:13.833210 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jn8mx\" (UniqueName: \"kubernetes.io/projected/6f966d74-f323-4f45-9fbb-8160d73b7770-kube-api-access-jn8mx\") on node \"crc\" DevicePath \"\"" Mar 16 15:34:13 crc kubenswrapper[5120]: I0316 15:34:13.833244 5120 reconciler_common.go:299] "Volume detached for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6f966d74-f323-4f45-9fbb-8160d73b7770-cni-sysctl-allowlist\") on node \"crc\" DevicePath \"\"" Mar 16 15:34:13 crc kubenswrapper[5120]: I0316 15:34:13.833253 5120 reconciler_common.go:299] "Volume detached for volume \"ready\" (UniqueName: \"kubernetes.io/empty-dir/6f966d74-f323-4f45-9fbb-8160d73b7770-ready\") on node \"crc\" DevicePath \"\"" Mar 16 15:34:13 crc kubenswrapper[5120]: I0316 15:34:13.836091 5120 generic.go:358] "Generic (PLEG): container finished" podID="7ecb3681-0da8-4d4a-9634-ce236c5ac399" containerID="4daa17fb3a50b05591503f3f5efe464b1d42bb81c3e84c0a500cbfa5bcb45d24" exitCode=0 Mar 16 15:34:13 crc kubenswrapper[5120]: I0316 15:34:13.836222 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561254-gtc86" event={"ID":"7ecb3681-0da8-4d4a-9634-ce236c5ac399","Type":"ContainerDied","Data":"4daa17fb3a50b05591503f3f5efe464b1d42bb81c3e84c0a500cbfa5bcb45d24"} Mar 16 15:34:13 crc kubenswrapper[5120]: I0316 15:34:13.837647 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_cni-sysctl-allowlist-ds-95s4s_6f966d74-f323-4f45-9fbb-8160d73b7770/kube-multus-additional-cni-plugins/0.log" Mar 16 15:34:13 crc kubenswrapper[5120]: I0316 15:34:13.837702 5120 generic.go:358] "Generic (PLEG): container finished" podID="6f966d74-f323-4f45-9fbb-8160d73b7770" containerID="608acba293e4ec2584154dbd4574825f128737103e0ed75e45e1396d200d2099" exitCode=137 Mar 16 15:34:13 crc kubenswrapper[5120]: I0316 15:34:13.837796 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/cni-sysctl-allowlist-ds-95s4s" event={"ID":"6f966d74-f323-4f45-9fbb-8160d73b7770","Type":"ContainerDied","Data":"608acba293e4ec2584154dbd4574825f128737103e0ed75e45e1396d200d2099"} Mar 16 15:34:13 crc kubenswrapper[5120]: I0316 15:34:13.837835 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/cni-sysctl-allowlist-ds-95s4s" event={"ID":"6f966d74-f323-4f45-9fbb-8160d73b7770","Type":"ContainerDied","Data":"e52cbfb1b9ac4886c5912675638926270fc8461fc691d555577169b48ae48bfc"} Mar 16 15:34:13 crc kubenswrapper[5120]: I0316 15:34:13.837844 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-multus/cni-sysctl-allowlist-ds-95s4s" Mar 16 15:34:13 crc kubenswrapper[5120]: I0316 15:34:13.837858 5120 scope.go:117] "RemoveContainer" containerID="608acba293e4ec2584154dbd4574825f128737103e0ed75e45e1396d200d2099" Mar 16 15:34:13 crc kubenswrapper[5120]: I0316 15:34:13.855673 5120 scope.go:117] "RemoveContainer" containerID="608acba293e4ec2584154dbd4574825f128737103e0ed75e45e1396d200d2099" Mar 16 15:34:13 crc kubenswrapper[5120]: E0316 15:34:13.857617 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"608acba293e4ec2584154dbd4574825f128737103e0ed75e45e1396d200d2099\": container with ID starting with 608acba293e4ec2584154dbd4574825f128737103e0ed75e45e1396d200d2099 not found: ID does not exist" containerID="608acba293e4ec2584154dbd4574825f128737103e0ed75e45e1396d200d2099" Mar 16 15:34:13 crc kubenswrapper[5120]: I0316 15:34:13.857671 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"608acba293e4ec2584154dbd4574825f128737103e0ed75e45e1396d200d2099"} err="failed to get container status \"608acba293e4ec2584154dbd4574825f128737103e0ed75e45e1396d200d2099\": rpc error: code = NotFound desc = could not find container \"608acba293e4ec2584154dbd4574825f128737103e0ed75e45e1396d200d2099\": container with ID starting with 608acba293e4ec2584154dbd4574825f128737103e0ed75e45e1396d200d2099 not found: ID does not exist" Mar 16 15:34:13 crc kubenswrapper[5120]: I0316 15:34:13.863580 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-multus/cni-sysctl-allowlist-ds-95s4s"] Mar 16 15:34:13 crc kubenswrapper[5120]: I0316 15:34:13.869719 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-multus/cni-sysctl-allowlist-ds-95s4s"] Mar 16 15:34:14 crc kubenswrapper[5120]: I0316 15:34:14.132264 5120 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2026-04-15 15:29:13 +0000 UTC" deadline="2026-04-06 21:55:13.765941762 +0000 UTC" Mar 16 15:34:14 crc kubenswrapper[5120]: I0316 15:34:14.132320 5120 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="510h20m59.633624922s" Mar 16 15:34:14 crc kubenswrapper[5120]: I0316 15:34:14.460054 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operator-lifecycle-manager/package-server-manager-77f986bd66-wknnz" Mar 16 15:34:14 crc kubenswrapper[5120]: I0316 15:34:14.671067 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f966d74-f323-4f45-9fbb-8160d73b7770" path="/var/lib/kubelet/pods/6f966d74-f323-4f45-9fbb-8160d73b7770/volumes" Mar 16 15:34:15 crc kubenswrapper[5120]: I0316 15:34:15.083697 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561254-gtc86" Mar 16 15:34:15 crc kubenswrapper[5120]: I0316 15:34:15.131814 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/certified-operators-zz5g5" Mar 16 15:34:15 crc kubenswrapper[5120]: I0316 15:34:15.131862 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-marketplace/certified-operators-zz5g5" Mar 16 15:34:15 crc kubenswrapper[5120]: I0316 15:34:15.132706 5120 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2026-04-15 15:29:13 +0000 UTC" deadline="2026-04-12 13:38:40.322699584 +0000 UTC" Mar 16 15:34:15 crc kubenswrapper[5120]: I0316 15:34:15.132737 5120 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="646h4m25.189966022s" Mar 16 15:34:15 crc kubenswrapper[5120]: I0316 15:34:15.156109 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jw8c5\" (UniqueName: \"kubernetes.io/projected/7ecb3681-0da8-4d4a-9634-ce236c5ac399-kube-api-access-jw8c5\") pod \"7ecb3681-0da8-4d4a-9634-ce236c5ac399\" (UID: \"7ecb3681-0da8-4d4a-9634-ce236c5ac399\") " Mar 16 15:34:15 crc kubenswrapper[5120]: I0316 15:34:15.175159 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ecb3681-0da8-4d4a-9634-ce236c5ac399-kube-api-access-jw8c5" (OuterVolumeSpecName: "kube-api-access-jw8c5") pod "7ecb3681-0da8-4d4a-9634-ce236c5ac399" (UID: "7ecb3681-0da8-4d4a-9634-ce236c5ac399"). InnerVolumeSpecName "kube-api-access-jw8c5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:34:15 crc kubenswrapper[5120]: I0316 15:34:15.257186 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jw8c5\" (UniqueName: \"kubernetes.io/projected/7ecb3681-0da8-4d4a-9634-ce236c5ac399-kube-api-access-jw8c5\") on node \"crc\" DevicePath \"\"" Mar 16 15:34:15 crc kubenswrapper[5120]: I0316 15:34:15.313974 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/community-operators-bzrbr" Mar 16 15:34:15 crc kubenswrapper[5120]: I0316 15:34:15.314021 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-marketplace/community-operators-bzrbr" Mar 16 15:34:15 crc kubenswrapper[5120]: I0316 15:34:15.575967 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-marketplace/certified-operators-n4gbm" Mar 16 15:34:15 crc kubenswrapper[5120]: I0316 15:34:15.576019 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/certified-operators-n4gbm" Mar 16 15:34:15 crc kubenswrapper[5120]: I0316 15:34:15.740454 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-marketplace/community-operators-gb62c" Mar 16 15:34:15 crc kubenswrapper[5120]: I0316 15:34:15.740513 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/community-operators-gb62c" Mar 16 15:34:15 crc kubenswrapper[5120]: I0316 15:34:15.771824 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/community-operators-bzrbr" Mar 16 15:34:15 crc kubenswrapper[5120]: I0316 15:34:15.772625 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/certified-operators-zz5g5" Mar 16 15:34:15 crc kubenswrapper[5120]: I0316 15:34:15.775300 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/certified-operators-n4gbm" Mar 16 15:34:15 crc kubenswrapper[5120]: I0316 15:34:15.778832 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/community-operators-gb62c" Mar 16 15:34:15 crc kubenswrapper[5120]: I0316 15:34:15.857319 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561254-gtc86" Mar 16 15:34:15 crc kubenswrapper[5120]: I0316 15:34:15.857445 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561254-gtc86" event={"ID":"7ecb3681-0da8-4d4a-9634-ce236c5ac399","Type":"ContainerDied","Data":"04979c1ac014d70ce830acf1a4c19a852f9fb8563da4520e103d14d141c1efd5"} Mar 16 15:34:15 crc kubenswrapper[5120]: I0316 15:34:15.857508 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="04979c1ac014d70ce830acf1a4c19a852f9fb8563da4520e103d14d141c1efd5" Mar 16 15:34:15 crc kubenswrapper[5120]: I0316 15:34:15.901798 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/certified-operators-zz5g5" Mar 16 15:34:15 crc kubenswrapper[5120]: I0316 15:34:15.906082 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/certified-operators-n4gbm" Mar 16 15:34:15 crc kubenswrapper[5120]: I0316 15:34:15.911078 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/community-operators-gb62c" Mar 16 15:34:15 crc kubenswrapper[5120]: I0316 15:34:15.914521 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/community-operators-bzrbr" Mar 16 15:34:17 crc kubenswrapper[5120]: I0316 15:34:17.108682 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-marketplace-p8tsg" Mar 16 15:34:17 crc kubenswrapper[5120]: I0316 15:34:17.109085 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-marketplace/redhat-marketplace-p8tsg" Mar 16 15:34:17 crc kubenswrapper[5120]: I0316 15:34:17.151969 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-marketplace-p8tsg" Mar 16 15:34:17 crc kubenswrapper[5120]: I0316 15:34:17.535128 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-marketplace/redhat-marketplace-kr7pv" Mar 16 15:34:17 crc kubenswrapper[5120]: I0316 15:34:17.536190 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-marketplace-kr7pv" Mar 16 15:34:17 crc kubenswrapper[5120]: I0316 15:34:17.570473 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-marketplace-kr7pv" Mar 16 15:34:17 crc kubenswrapper[5120]: I0316 15:34:17.921344 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-marketplace-p8tsg" Mar 16 15:34:17 crc kubenswrapper[5120]: I0316 15:34:17.922630 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-marketplace-kr7pv" Mar 16 15:34:17 crc kubenswrapper[5120]: I0316 15:34:17.966296 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/community-operators-gb62c"] Mar 16 15:34:17 crc kubenswrapper[5120]: I0316 15:34:17.966527 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-marketplace/community-operators-gb62c" podUID="2bb55bd0-43ba-4f30-93ad-aca0a4a74d04" containerName="registry-server" containerID="cri-o://8581a4810d0fc7e1a7f6d82c72b3865d0e5d20f5b0be361b55d0a23064ff00bd" gracePeriod=2 Mar 16 15:34:18 crc kubenswrapper[5120]: I0316 15:34:18.163530 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/certified-operators-n4gbm"] Mar 16 15:34:18 crc kubenswrapper[5120]: I0316 15:34:18.163886 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-marketplace/certified-operators-n4gbm" podUID="5910a375-22bc-4049-9165-8ce8298a85ba" containerName="registry-server" containerID="cri-o://7d5832c9a40562c7f064e11be96d9aeb058ebff3cefffc040df5bb9ad0093218" gracePeriod=2 Mar 16 15:34:18 crc kubenswrapper[5120]: I0316 15:34:18.393451 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-operators-5d9tn" Mar 16 15:34:18 crc kubenswrapper[5120]: I0316 15:34:18.394950 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-marketplace/redhat-operators-5d9tn" Mar 16 15:34:18 crc kubenswrapper[5120]: I0316 15:34:18.463037 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-operators-5d9tn" Mar 16 15:34:18 crc kubenswrapper[5120]: I0316 15:34:18.513839 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-n4gbm" Mar 16 15:34:18 crc kubenswrapper[5120]: I0316 15:34:18.606940 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/5910a375-22bc-4049-9165-8ce8298a85ba-catalog-content\") pod \"5910a375-22bc-4049-9165-8ce8298a85ba\" (UID: \"5910a375-22bc-4049-9165-8ce8298a85ba\") " Mar 16 15:34:18 crc kubenswrapper[5120]: I0316 15:34:18.607058 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/5910a375-22bc-4049-9165-8ce8298a85ba-utilities\") pod \"5910a375-22bc-4049-9165-8ce8298a85ba\" (UID: \"5910a375-22bc-4049-9165-8ce8298a85ba\") " Mar 16 15:34:18 crc kubenswrapper[5120]: I0316 15:34:18.607130 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q9g7z\" (UniqueName: \"kubernetes.io/projected/5910a375-22bc-4049-9165-8ce8298a85ba-kube-api-access-q9g7z\") pod \"5910a375-22bc-4049-9165-8ce8298a85ba\" (UID: \"5910a375-22bc-4049-9165-8ce8298a85ba\") " Mar 16 15:34:18 crc kubenswrapper[5120]: I0316 15:34:18.608003 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5910a375-22bc-4049-9165-8ce8298a85ba-utilities" (OuterVolumeSpecName: "utilities") pod "5910a375-22bc-4049-9165-8ce8298a85ba" (UID: "5910a375-22bc-4049-9165-8ce8298a85ba"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:34:18 crc kubenswrapper[5120]: I0316 15:34:18.614586 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5910a375-22bc-4049-9165-8ce8298a85ba-kube-api-access-q9g7z" (OuterVolumeSpecName: "kube-api-access-q9g7z") pod "5910a375-22bc-4049-9165-8ce8298a85ba" (UID: "5910a375-22bc-4049-9165-8ce8298a85ba"). InnerVolumeSpecName "kube-api-access-q9g7z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:34:18 crc kubenswrapper[5120]: I0316 15:34:18.639186 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5910a375-22bc-4049-9165-8ce8298a85ba-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "5910a375-22bc-4049-9165-8ce8298a85ba" (UID: "5910a375-22bc-4049-9165-8ce8298a85ba"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:34:18 crc kubenswrapper[5120]: I0316 15:34:18.710438 5120 reconciler_common.go:299] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/5910a375-22bc-4049-9165-8ce8298a85ba-catalog-content\") on node \"crc\" DevicePath \"\"" Mar 16 15:34:18 crc kubenswrapper[5120]: I0316 15:34:18.710468 5120 reconciler_common.go:299] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/5910a375-22bc-4049-9165-8ce8298a85ba-utilities\") on node \"crc\" DevicePath \"\"" Mar 16 15:34:18 crc kubenswrapper[5120]: I0316 15:34:18.710479 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q9g7z\" (UniqueName: \"kubernetes.io/projected/5910a375-22bc-4049-9165-8ce8298a85ba-kube-api-access-q9g7z\") on node \"crc\" DevicePath \"\"" Mar 16 15:34:18 crc kubenswrapper[5120]: I0316 15:34:18.712638 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-marketplace/redhat-operators-dd7qh" Mar 16 15:34:18 crc kubenswrapper[5120]: I0316 15:34:18.714805 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-operators-dd7qh" Mar 16 15:34:18 crc kubenswrapper[5120]: I0316 15:34:18.769317 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-operators-dd7qh" Mar 16 15:34:18 crc kubenswrapper[5120]: I0316 15:34:18.776414 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-gb62c" Mar 16 15:34:18 crc kubenswrapper[5120]: I0316 15:34:18.817361 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/2bb55bd0-43ba-4f30-93ad-aca0a4a74d04-catalog-content\") pod \"2bb55bd0-43ba-4f30-93ad-aca0a4a74d04\" (UID: \"2bb55bd0-43ba-4f30-93ad-aca0a4a74d04\") " Mar 16 15:34:18 crc kubenswrapper[5120]: I0316 15:34:18.817402 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/2bb55bd0-43ba-4f30-93ad-aca0a4a74d04-utilities\") pod \"2bb55bd0-43ba-4f30-93ad-aca0a4a74d04\" (UID: \"2bb55bd0-43ba-4f30-93ad-aca0a4a74d04\") " Mar 16 15:34:18 crc kubenswrapper[5120]: I0316 15:34:18.817495 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tm624\" (UniqueName: \"kubernetes.io/projected/2bb55bd0-43ba-4f30-93ad-aca0a4a74d04-kube-api-access-tm624\") pod \"2bb55bd0-43ba-4f30-93ad-aca0a4a74d04\" (UID: \"2bb55bd0-43ba-4f30-93ad-aca0a4a74d04\") " Mar 16 15:34:18 crc kubenswrapper[5120]: I0316 15:34:18.818367 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2bb55bd0-43ba-4f30-93ad-aca0a4a74d04-utilities" (OuterVolumeSpecName: "utilities") pod "2bb55bd0-43ba-4f30-93ad-aca0a4a74d04" (UID: "2bb55bd0-43ba-4f30-93ad-aca0a4a74d04"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:34:18 crc kubenswrapper[5120]: I0316 15:34:18.821605 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2bb55bd0-43ba-4f30-93ad-aca0a4a74d04-kube-api-access-tm624" (OuterVolumeSpecName: "kube-api-access-tm624") pod "2bb55bd0-43ba-4f30-93ad-aca0a4a74d04" (UID: "2bb55bd0-43ba-4f30-93ad-aca0a4a74d04"). InnerVolumeSpecName "kube-api-access-tm624". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:34:18 crc kubenswrapper[5120]: I0316 15:34:18.863051 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2bb55bd0-43ba-4f30-93ad-aca0a4a74d04-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "2bb55bd0-43ba-4f30-93ad-aca0a4a74d04" (UID: "2bb55bd0-43ba-4f30-93ad-aca0a4a74d04"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:34:18 crc kubenswrapper[5120]: I0316 15:34:18.874365 5120 generic.go:358] "Generic (PLEG): container finished" podID="5910a375-22bc-4049-9165-8ce8298a85ba" containerID="7d5832c9a40562c7f064e11be96d9aeb058ebff3cefffc040df5bb9ad0093218" exitCode=0 Mar 16 15:34:18 crc kubenswrapper[5120]: I0316 15:34:18.874450 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-n4gbm" event={"ID":"5910a375-22bc-4049-9165-8ce8298a85ba","Type":"ContainerDied","Data":"7d5832c9a40562c7f064e11be96d9aeb058ebff3cefffc040df5bb9ad0093218"} Mar 16 15:34:18 crc kubenswrapper[5120]: I0316 15:34:18.874468 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-n4gbm" Mar 16 15:34:18 crc kubenswrapper[5120]: I0316 15:34:18.874495 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-n4gbm" event={"ID":"5910a375-22bc-4049-9165-8ce8298a85ba","Type":"ContainerDied","Data":"399e87aad69d30ec2b32b4ace45904f15f34d206d6137b991d0690ab4a9220c9"} Mar 16 15:34:18 crc kubenswrapper[5120]: I0316 15:34:18.874518 5120 scope.go:117] "RemoveContainer" containerID="7d5832c9a40562c7f064e11be96d9aeb058ebff3cefffc040df5bb9ad0093218" Mar 16 15:34:18 crc kubenswrapper[5120]: I0316 15:34:18.876581 5120 generic.go:358] "Generic (PLEG): container finished" podID="2bb55bd0-43ba-4f30-93ad-aca0a4a74d04" containerID="8581a4810d0fc7e1a7f6d82c72b3865d0e5d20f5b0be361b55d0a23064ff00bd" exitCode=0 Mar 16 15:34:18 crc kubenswrapper[5120]: I0316 15:34:18.876643 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-gb62c" event={"ID":"2bb55bd0-43ba-4f30-93ad-aca0a4a74d04","Type":"ContainerDied","Data":"8581a4810d0fc7e1a7f6d82c72b3865d0e5d20f5b0be361b55d0a23064ff00bd"} Mar 16 15:34:18 crc kubenswrapper[5120]: I0316 15:34:18.876677 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-gb62c" event={"ID":"2bb55bd0-43ba-4f30-93ad-aca0a4a74d04","Type":"ContainerDied","Data":"299009d1e56d832d1c4197855e4a4bef32278601d78b888d7384ba6e06c5c438"} Mar 16 15:34:18 crc kubenswrapper[5120]: I0316 15:34:18.876695 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-gb62c" Mar 16 15:34:18 crc kubenswrapper[5120]: I0316 15:34:18.890812 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/certified-operators-n4gbm"] Mar 16 15:34:18 crc kubenswrapper[5120]: I0316 15:34:18.892886 5120 scope.go:117] "RemoveContainer" containerID="aee1da055214132d486e073bb087dae294caeb7695b21806d12241f4b78d8193" Mar 16 15:34:18 crc kubenswrapper[5120]: I0316 15:34:18.894855 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/certified-operators-n4gbm"] Mar 16 15:34:18 crc kubenswrapper[5120]: I0316 15:34:18.910889 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/community-operators-gb62c"] Mar 16 15:34:18 crc kubenswrapper[5120]: I0316 15:34:18.915613 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/community-operators-gb62c"] Mar 16 15:34:18 crc kubenswrapper[5120]: I0316 15:34:18.917152 5120 scope.go:117] "RemoveContainer" containerID="991d5d4f40e4b9da9b51d6af7cd0a2bfe39c338925d1d9c4ab2a000b2c752d5d" Mar 16 15:34:18 crc kubenswrapper[5120]: I0316 15:34:18.918390 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tm624\" (UniqueName: \"kubernetes.io/projected/2bb55bd0-43ba-4f30-93ad-aca0a4a74d04-kube-api-access-tm624\") on node \"crc\" DevicePath \"\"" Mar 16 15:34:18 crc kubenswrapper[5120]: I0316 15:34:18.918414 5120 reconciler_common.go:299] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/2bb55bd0-43ba-4f30-93ad-aca0a4a74d04-catalog-content\") on node \"crc\" DevicePath \"\"" Mar 16 15:34:18 crc kubenswrapper[5120]: I0316 15:34:18.918423 5120 reconciler_common.go:299] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/2bb55bd0-43ba-4f30-93ad-aca0a4a74d04-utilities\") on node \"crc\" DevicePath \"\"" Mar 16 15:34:18 crc kubenswrapper[5120]: I0316 15:34:18.918929 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-operators-5d9tn" Mar 16 15:34:18 crc kubenswrapper[5120]: I0316 15:34:18.918975 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-operators-dd7qh" Mar 16 15:34:18 crc kubenswrapper[5120]: I0316 15:34:18.936442 5120 scope.go:117] "RemoveContainer" containerID="7d5832c9a40562c7f064e11be96d9aeb058ebff3cefffc040df5bb9ad0093218" Mar 16 15:34:18 crc kubenswrapper[5120]: E0316 15:34:18.936897 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d5832c9a40562c7f064e11be96d9aeb058ebff3cefffc040df5bb9ad0093218\": container with ID starting with 7d5832c9a40562c7f064e11be96d9aeb058ebff3cefffc040df5bb9ad0093218 not found: ID does not exist" containerID="7d5832c9a40562c7f064e11be96d9aeb058ebff3cefffc040df5bb9ad0093218" Mar 16 15:34:18 crc kubenswrapper[5120]: I0316 15:34:18.936943 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d5832c9a40562c7f064e11be96d9aeb058ebff3cefffc040df5bb9ad0093218"} err="failed to get container status \"7d5832c9a40562c7f064e11be96d9aeb058ebff3cefffc040df5bb9ad0093218\": rpc error: code = NotFound desc = could not find container \"7d5832c9a40562c7f064e11be96d9aeb058ebff3cefffc040df5bb9ad0093218\": container with ID starting with 7d5832c9a40562c7f064e11be96d9aeb058ebff3cefffc040df5bb9ad0093218 not found: ID does not exist" Mar 16 15:34:18 crc kubenswrapper[5120]: I0316 15:34:18.936967 5120 scope.go:117] "RemoveContainer" containerID="aee1da055214132d486e073bb087dae294caeb7695b21806d12241f4b78d8193" Mar 16 15:34:18 crc kubenswrapper[5120]: E0316 15:34:18.937219 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aee1da055214132d486e073bb087dae294caeb7695b21806d12241f4b78d8193\": container with ID starting with aee1da055214132d486e073bb087dae294caeb7695b21806d12241f4b78d8193 not found: ID does not exist" containerID="aee1da055214132d486e073bb087dae294caeb7695b21806d12241f4b78d8193" Mar 16 15:34:18 crc kubenswrapper[5120]: I0316 15:34:18.937247 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aee1da055214132d486e073bb087dae294caeb7695b21806d12241f4b78d8193"} err="failed to get container status \"aee1da055214132d486e073bb087dae294caeb7695b21806d12241f4b78d8193\": rpc error: code = NotFound desc = could not find container \"aee1da055214132d486e073bb087dae294caeb7695b21806d12241f4b78d8193\": container with ID starting with aee1da055214132d486e073bb087dae294caeb7695b21806d12241f4b78d8193 not found: ID does not exist" Mar 16 15:34:18 crc kubenswrapper[5120]: I0316 15:34:18.937268 5120 scope.go:117] "RemoveContainer" containerID="991d5d4f40e4b9da9b51d6af7cd0a2bfe39c338925d1d9c4ab2a000b2c752d5d" Mar 16 15:34:18 crc kubenswrapper[5120]: E0316 15:34:18.937555 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"991d5d4f40e4b9da9b51d6af7cd0a2bfe39c338925d1d9c4ab2a000b2c752d5d\": container with ID starting with 991d5d4f40e4b9da9b51d6af7cd0a2bfe39c338925d1d9c4ab2a000b2c752d5d not found: ID does not exist" containerID="991d5d4f40e4b9da9b51d6af7cd0a2bfe39c338925d1d9c4ab2a000b2c752d5d" Mar 16 15:34:18 crc kubenswrapper[5120]: I0316 15:34:18.937578 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"991d5d4f40e4b9da9b51d6af7cd0a2bfe39c338925d1d9c4ab2a000b2c752d5d"} err="failed to get container status \"991d5d4f40e4b9da9b51d6af7cd0a2bfe39c338925d1d9c4ab2a000b2c752d5d\": rpc error: code = NotFound desc = could not find container \"991d5d4f40e4b9da9b51d6af7cd0a2bfe39c338925d1d9c4ab2a000b2c752d5d\": container with ID starting with 991d5d4f40e4b9da9b51d6af7cd0a2bfe39c338925d1d9c4ab2a000b2c752d5d not found: ID does not exist" Mar 16 15:34:18 crc kubenswrapper[5120]: I0316 15:34:18.937596 5120 scope.go:117] "RemoveContainer" containerID="8581a4810d0fc7e1a7f6d82c72b3865d0e5d20f5b0be361b55d0a23064ff00bd" Mar 16 15:34:18 crc kubenswrapper[5120]: I0316 15:34:18.957327 5120 scope.go:117] "RemoveContainer" containerID="c4c5f487500bf582de84a0bdf55493047e57c34c41701a9320d18031da479b61" Mar 16 15:34:18 crc kubenswrapper[5120]: I0316 15:34:18.972554 5120 scope.go:117] "RemoveContainer" containerID="74c0189abe9dce906c512bee04cb5fd8eee2275074fd9f8bb5b160f3c9cc5168" Mar 16 15:34:18 crc kubenswrapper[5120]: I0316 15:34:18.989507 5120 scope.go:117] "RemoveContainer" containerID="8581a4810d0fc7e1a7f6d82c72b3865d0e5d20f5b0be361b55d0a23064ff00bd" Mar 16 15:34:18 crc kubenswrapper[5120]: E0316 15:34:18.990824 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8581a4810d0fc7e1a7f6d82c72b3865d0e5d20f5b0be361b55d0a23064ff00bd\": container with ID starting with 8581a4810d0fc7e1a7f6d82c72b3865d0e5d20f5b0be361b55d0a23064ff00bd not found: ID does not exist" containerID="8581a4810d0fc7e1a7f6d82c72b3865d0e5d20f5b0be361b55d0a23064ff00bd" Mar 16 15:34:18 crc kubenswrapper[5120]: I0316 15:34:18.990890 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8581a4810d0fc7e1a7f6d82c72b3865d0e5d20f5b0be361b55d0a23064ff00bd"} err="failed to get container status \"8581a4810d0fc7e1a7f6d82c72b3865d0e5d20f5b0be361b55d0a23064ff00bd\": rpc error: code = NotFound desc = could not find container \"8581a4810d0fc7e1a7f6d82c72b3865d0e5d20f5b0be361b55d0a23064ff00bd\": container with ID starting with 8581a4810d0fc7e1a7f6d82c72b3865d0e5d20f5b0be361b55d0a23064ff00bd not found: ID does not exist" Mar 16 15:34:18 crc kubenswrapper[5120]: I0316 15:34:18.990917 5120 scope.go:117] "RemoveContainer" containerID="c4c5f487500bf582de84a0bdf55493047e57c34c41701a9320d18031da479b61" Mar 16 15:34:18 crc kubenswrapper[5120]: E0316 15:34:18.991245 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c4c5f487500bf582de84a0bdf55493047e57c34c41701a9320d18031da479b61\": container with ID starting with c4c5f487500bf582de84a0bdf55493047e57c34c41701a9320d18031da479b61 not found: ID does not exist" containerID="c4c5f487500bf582de84a0bdf55493047e57c34c41701a9320d18031da479b61" Mar 16 15:34:18 crc kubenswrapper[5120]: I0316 15:34:18.991266 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4c5f487500bf582de84a0bdf55493047e57c34c41701a9320d18031da479b61"} err="failed to get container status \"c4c5f487500bf582de84a0bdf55493047e57c34c41701a9320d18031da479b61\": rpc error: code = NotFound desc = could not find container \"c4c5f487500bf582de84a0bdf55493047e57c34c41701a9320d18031da479b61\": container with ID starting with c4c5f487500bf582de84a0bdf55493047e57c34c41701a9320d18031da479b61 not found: ID does not exist" Mar 16 15:34:18 crc kubenswrapper[5120]: I0316 15:34:18.991282 5120 scope.go:117] "RemoveContainer" containerID="74c0189abe9dce906c512bee04cb5fd8eee2275074fd9f8bb5b160f3c9cc5168" Mar 16 15:34:18 crc kubenswrapper[5120]: E0316 15:34:18.991517 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"74c0189abe9dce906c512bee04cb5fd8eee2275074fd9f8bb5b160f3c9cc5168\": container with ID starting with 74c0189abe9dce906c512bee04cb5fd8eee2275074fd9f8bb5b160f3c9cc5168 not found: ID does not exist" containerID="74c0189abe9dce906c512bee04cb5fd8eee2275074fd9f8bb5b160f3c9cc5168" Mar 16 15:34:18 crc kubenswrapper[5120]: I0316 15:34:18.991540 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74c0189abe9dce906c512bee04cb5fd8eee2275074fd9f8bb5b160f3c9cc5168"} err="failed to get container status \"74c0189abe9dce906c512bee04cb5fd8eee2275074fd9f8bb5b160f3c9cc5168\": rpc error: code = NotFound desc = could not find container \"74c0189abe9dce906c512bee04cb5fd8eee2275074fd9f8bb5b160f3c9cc5168\": container with ID starting with 74c0189abe9dce906c512bee04cb5fd8eee2275074fd9f8bb5b160f3c9cc5168 not found: ID does not exist" Mar 16 15:34:19 crc kubenswrapper[5120]: I0316 15:34:19.364048 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-authentication/oauth-openshift-66458b6674-fvnvr"] Mar 16 15:34:20 crc kubenswrapper[5120]: I0316 15:34:20.363568 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-marketplace-kr7pv"] Mar 16 15:34:20 crc kubenswrapper[5120]: I0316 15:34:20.669536 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2bb55bd0-43ba-4f30-93ad-aca0a4a74d04" path="/var/lib/kubelet/pods/2bb55bd0-43ba-4f30-93ad-aca0a4a74d04/volumes" Mar 16 15:34:20 crc kubenswrapper[5120]: I0316 15:34:20.670141 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5910a375-22bc-4049-9165-8ce8298a85ba" path="/var/lib/kubelet/pods/5910a375-22bc-4049-9165-8ce8298a85ba/volumes" Mar 16 15:34:20 crc kubenswrapper[5120]: I0316 15:34:20.888781 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-marketplace/redhat-marketplace-kr7pv" podUID="b89af808-d797-4840-9969-8f4eb5dc9157" containerName="registry-server" containerID="cri-o://acc2b9c510b41395c2d3a4065832dac473b4071a305247728589144e70a36bd4" gracePeriod=2 Mar 16 15:34:21 crc kubenswrapper[5120]: I0316 15:34:21.189382 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-kr7pv" Mar 16 15:34:21 crc kubenswrapper[5120]: I0316 15:34:21.248267 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/b89af808-d797-4840-9969-8f4eb5dc9157-utilities\") pod \"b89af808-d797-4840-9969-8f4eb5dc9157\" (UID: \"b89af808-d797-4840-9969-8f4eb5dc9157\") " Mar 16 15:34:21 crc kubenswrapper[5120]: I0316 15:34:21.248317 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/b89af808-d797-4840-9969-8f4eb5dc9157-catalog-content\") pod \"b89af808-d797-4840-9969-8f4eb5dc9157\" (UID: \"b89af808-d797-4840-9969-8f4eb5dc9157\") " Mar 16 15:34:21 crc kubenswrapper[5120]: I0316 15:34:21.248500 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b92k4\" (UniqueName: \"kubernetes.io/projected/b89af808-d797-4840-9969-8f4eb5dc9157-kube-api-access-b92k4\") pod \"b89af808-d797-4840-9969-8f4eb5dc9157\" (UID: \"b89af808-d797-4840-9969-8f4eb5dc9157\") " Mar 16 15:34:21 crc kubenswrapper[5120]: I0316 15:34:21.249150 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b89af808-d797-4840-9969-8f4eb5dc9157-utilities" (OuterVolumeSpecName: "utilities") pod "b89af808-d797-4840-9969-8f4eb5dc9157" (UID: "b89af808-d797-4840-9969-8f4eb5dc9157"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:34:21 crc kubenswrapper[5120]: I0316 15:34:21.256155 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b89af808-d797-4840-9969-8f4eb5dc9157-kube-api-access-b92k4" (OuterVolumeSpecName: "kube-api-access-b92k4") pod "b89af808-d797-4840-9969-8f4eb5dc9157" (UID: "b89af808-d797-4840-9969-8f4eb5dc9157"). InnerVolumeSpecName "kube-api-access-b92k4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:34:21 crc kubenswrapper[5120]: I0316 15:34:21.263175 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b89af808-d797-4840-9969-8f4eb5dc9157-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "b89af808-d797-4840-9969-8f4eb5dc9157" (UID: "b89af808-d797-4840-9969-8f4eb5dc9157"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:34:21 crc kubenswrapper[5120]: I0316 15:34:21.349898 5120 reconciler_common.go:299] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/b89af808-d797-4840-9969-8f4eb5dc9157-utilities\") on node \"crc\" DevicePath \"\"" Mar 16 15:34:21 crc kubenswrapper[5120]: I0316 15:34:21.349931 5120 reconciler_common.go:299] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/b89af808-d797-4840-9969-8f4eb5dc9157-catalog-content\") on node \"crc\" DevicePath \"\"" Mar 16 15:34:21 crc kubenswrapper[5120]: I0316 15:34:21.349944 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b92k4\" (UniqueName: \"kubernetes.io/projected/b89af808-d797-4840-9969-8f4eb5dc9157-kube-api-access-b92k4\") on node \"crc\" DevicePath \"\"" Mar 16 15:34:21 crc kubenswrapper[5120]: I0316 15:34:21.896408 5120 generic.go:358] "Generic (PLEG): container finished" podID="b89af808-d797-4840-9969-8f4eb5dc9157" containerID="acc2b9c510b41395c2d3a4065832dac473b4071a305247728589144e70a36bd4" exitCode=0 Mar 16 15:34:21 crc kubenswrapper[5120]: I0316 15:34:21.896497 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-kr7pv" event={"ID":"b89af808-d797-4840-9969-8f4eb5dc9157","Type":"ContainerDied","Data":"acc2b9c510b41395c2d3a4065832dac473b4071a305247728589144e70a36bd4"} Mar 16 15:34:21 crc kubenswrapper[5120]: I0316 15:34:21.896555 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-kr7pv" event={"ID":"b89af808-d797-4840-9969-8f4eb5dc9157","Type":"ContainerDied","Data":"e0b64d08a1608420e59672495a6790137315f7c22543cbf9920a76446cf0e15d"} Mar 16 15:34:21 crc kubenswrapper[5120]: I0316 15:34:21.896570 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-kr7pv" Mar 16 15:34:21 crc kubenswrapper[5120]: I0316 15:34:21.896575 5120 scope.go:117] "RemoveContainer" containerID="acc2b9c510b41395c2d3a4065832dac473b4071a305247728589144e70a36bd4" Mar 16 15:34:21 crc kubenswrapper[5120]: I0316 15:34:21.924466 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-marketplace-kr7pv"] Mar 16 15:34:21 crc kubenswrapper[5120]: I0316 15:34:21.925533 5120 scope.go:117] "RemoveContainer" containerID="db8dd005b0cc159bca25ce00405579d1829a3dbd1d925c20a9ae887fd7088c96" Mar 16 15:34:21 crc kubenswrapper[5120]: I0316 15:34:21.979568 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/redhat-marketplace-kr7pv"] Mar 16 15:34:21 crc kubenswrapper[5120]: I0316 15:34:21.998817 5120 scope.go:117] "RemoveContainer" containerID="1cea664a8bbed57215d87d905c766dd54f9e28fd22481686d17a842859e917de" Mar 16 15:34:22 crc kubenswrapper[5120]: I0316 15:34:22.012334 5120 scope.go:117] "RemoveContainer" containerID="acc2b9c510b41395c2d3a4065832dac473b4071a305247728589144e70a36bd4" Mar 16 15:34:22 crc kubenswrapper[5120]: E0316 15:34:22.012841 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"acc2b9c510b41395c2d3a4065832dac473b4071a305247728589144e70a36bd4\": container with ID starting with acc2b9c510b41395c2d3a4065832dac473b4071a305247728589144e70a36bd4 not found: ID does not exist" containerID="acc2b9c510b41395c2d3a4065832dac473b4071a305247728589144e70a36bd4" Mar 16 15:34:22 crc kubenswrapper[5120]: I0316 15:34:22.012953 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"acc2b9c510b41395c2d3a4065832dac473b4071a305247728589144e70a36bd4"} err="failed to get container status \"acc2b9c510b41395c2d3a4065832dac473b4071a305247728589144e70a36bd4\": rpc error: code = NotFound desc = could not find container \"acc2b9c510b41395c2d3a4065832dac473b4071a305247728589144e70a36bd4\": container with ID starting with acc2b9c510b41395c2d3a4065832dac473b4071a305247728589144e70a36bd4 not found: ID does not exist" Mar 16 15:34:22 crc kubenswrapper[5120]: I0316 15:34:22.013040 5120 scope.go:117] "RemoveContainer" containerID="db8dd005b0cc159bca25ce00405579d1829a3dbd1d925c20a9ae887fd7088c96" Mar 16 15:34:22 crc kubenswrapper[5120]: E0316 15:34:22.013563 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db8dd005b0cc159bca25ce00405579d1829a3dbd1d925c20a9ae887fd7088c96\": container with ID starting with db8dd005b0cc159bca25ce00405579d1829a3dbd1d925c20a9ae887fd7088c96 not found: ID does not exist" containerID="db8dd005b0cc159bca25ce00405579d1829a3dbd1d925c20a9ae887fd7088c96" Mar 16 15:34:22 crc kubenswrapper[5120]: I0316 15:34:22.013624 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db8dd005b0cc159bca25ce00405579d1829a3dbd1d925c20a9ae887fd7088c96"} err="failed to get container status \"db8dd005b0cc159bca25ce00405579d1829a3dbd1d925c20a9ae887fd7088c96\": rpc error: code = NotFound desc = could not find container \"db8dd005b0cc159bca25ce00405579d1829a3dbd1d925c20a9ae887fd7088c96\": container with ID starting with db8dd005b0cc159bca25ce00405579d1829a3dbd1d925c20a9ae887fd7088c96 not found: ID does not exist" Mar 16 15:34:22 crc kubenswrapper[5120]: I0316 15:34:22.013652 5120 scope.go:117] "RemoveContainer" containerID="1cea664a8bbed57215d87d905c766dd54f9e28fd22481686d17a842859e917de" Mar 16 15:34:22 crc kubenswrapper[5120]: E0316 15:34:22.013945 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1cea664a8bbed57215d87d905c766dd54f9e28fd22481686d17a842859e917de\": container with ID starting with 1cea664a8bbed57215d87d905c766dd54f9e28fd22481686d17a842859e917de not found: ID does not exist" containerID="1cea664a8bbed57215d87d905c766dd54f9e28fd22481686d17a842859e917de" Mar 16 15:34:22 crc kubenswrapper[5120]: I0316 15:34:22.013979 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1cea664a8bbed57215d87d905c766dd54f9e28fd22481686d17a842859e917de"} err="failed to get container status \"1cea664a8bbed57215d87d905c766dd54f9e28fd22481686d17a842859e917de\": rpc error: code = NotFound desc = could not find container \"1cea664a8bbed57215d87d905c766dd54f9e28fd22481686d17a842859e917de\": container with ID starting with 1cea664a8bbed57215d87d905c766dd54f9e28fd22481686d17a842859e917de not found: ID does not exist" Mar 16 15:34:22 crc kubenswrapper[5120]: I0316 15:34:22.670928 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b89af808-d797-4840-9969-8f4eb5dc9157" path="/var/lib/kubelet/pods/b89af808-d797-4840-9969-8f4eb5dc9157/volumes" Mar 16 15:34:22 crc kubenswrapper[5120]: I0316 15:34:22.765583 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-operators-dd7qh"] Mar 16 15:34:22 crc kubenswrapper[5120]: I0316 15:34:22.766047 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-marketplace/redhat-operators-dd7qh" podUID="b7d10a42-60a3-4313-8631-37995e78f48e" containerName="registry-server" containerID="cri-o://1a6b68bc46b54e0be57f7409fcc1625f7dde6a5557c8756b54f2a49e75e0b57a" gracePeriod=2 Mar 16 15:34:22 crc kubenswrapper[5120]: I0316 15:34:22.904120 5120 generic.go:358] "Generic (PLEG): container finished" podID="b7d10a42-60a3-4313-8631-37995e78f48e" containerID="1a6b68bc46b54e0be57f7409fcc1625f7dde6a5557c8756b54f2a49e75e0b57a" exitCode=0 Mar 16 15:34:22 crc kubenswrapper[5120]: I0316 15:34:22.904157 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-dd7qh" event={"ID":"b7d10a42-60a3-4313-8631-37995e78f48e","Type":"ContainerDied","Data":"1a6b68bc46b54e0be57f7409fcc1625f7dde6a5557c8756b54f2a49e75e0b57a"} Mar 16 15:34:23 crc kubenswrapper[5120]: I0316 15:34:23.111042 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-dd7qh" Mar 16 15:34:23 crc kubenswrapper[5120]: I0316 15:34:23.189453 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/b7d10a42-60a3-4313-8631-37995e78f48e-utilities\") pod \"b7d10a42-60a3-4313-8631-37995e78f48e\" (UID: \"b7d10a42-60a3-4313-8631-37995e78f48e\") " Mar 16 15:34:23 crc kubenswrapper[5120]: I0316 15:34:23.189540 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gvr4c\" (UniqueName: \"kubernetes.io/projected/b7d10a42-60a3-4313-8631-37995e78f48e-kube-api-access-gvr4c\") pod \"b7d10a42-60a3-4313-8631-37995e78f48e\" (UID: \"b7d10a42-60a3-4313-8631-37995e78f48e\") " Mar 16 15:34:23 crc kubenswrapper[5120]: I0316 15:34:23.189600 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/b7d10a42-60a3-4313-8631-37995e78f48e-catalog-content\") pod \"b7d10a42-60a3-4313-8631-37995e78f48e\" (UID: \"b7d10a42-60a3-4313-8631-37995e78f48e\") " Mar 16 15:34:23 crc kubenswrapper[5120]: I0316 15:34:23.190615 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b7d10a42-60a3-4313-8631-37995e78f48e-utilities" (OuterVolumeSpecName: "utilities") pod "b7d10a42-60a3-4313-8631-37995e78f48e" (UID: "b7d10a42-60a3-4313-8631-37995e78f48e"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:34:23 crc kubenswrapper[5120]: I0316 15:34:23.194935 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7d10a42-60a3-4313-8631-37995e78f48e-kube-api-access-gvr4c" (OuterVolumeSpecName: "kube-api-access-gvr4c") pod "b7d10a42-60a3-4313-8631-37995e78f48e" (UID: "b7d10a42-60a3-4313-8631-37995e78f48e"). InnerVolumeSpecName "kube-api-access-gvr4c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:34:23 crc kubenswrapper[5120]: I0316 15:34:23.195255 5120 reconciler_common.go:299] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/b7d10a42-60a3-4313-8631-37995e78f48e-utilities\") on node \"crc\" DevicePath \"\"" Mar 16 15:34:23 crc kubenswrapper[5120]: I0316 15:34:23.195303 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gvr4c\" (UniqueName: \"kubernetes.io/projected/b7d10a42-60a3-4313-8631-37995e78f48e-kube-api-access-gvr4c\") on node \"crc\" DevicePath \"\"" Mar 16 15:34:23 crc kubenswrapper[5120]: I0316 15:34:23.293094 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b7d10a42-60a3-4313-8631-37995e78f48e-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "b7d10a42-60a3-4313-8631-37995e78f48e" (UID: "b7d10a42-60a3-4313-8631-37995e78f48e"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:34:23 crc kubenswrapper[5120]: I0316 15:34:23.296301 5120 reconciler_common.go:299] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/b7d10a42-60a3-4313-8631-37995e78f48e-catalog-content\") on node \"crc\" DevicePath \"\"" Mar 16 15:34:23 crc kubenswrapper[5120]: I0316 15:34:23.912197 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-dd7qh" event={"ID":"b7d10a42-60a3-4313-8631-37995e78f48e","Type":"ContainerDied","Data":"db85a21782a4e094dac2a322bfa910e80114063d7ddb185adbcd28494a97bc8b"} Mar 16 15:34:23 crc kubenswrapper[5120]: I0316 15:34:23.912247 5120 scope.go:117] "RemoveContainer" containerID="1a6b68bc46b54e0be57f7409fcc1625f7dde6a5557c8756b54f2a49e75e0b57a" Mar 16 15:34:23 crc kubenswrapper[5120]: I0316 15:34:23.912250 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-dd7qh" Mar 16 15:34:23 crc kubenswrapper[5120]: I0316 15:34:23.928746 5120 scope.go:117] "RemoveContainer" containerID="05959ed51ed2ce34710e33ba22c11a750abd26a2b70e1daae112530b1902698b" Mar 16 15:34:23 crc kubenswrapper[5120]: I0316 15:34:23.944101 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-operators-dd7qh"] Mar 16 15:34:23 crc kubenswrapper[5120]: I0316 15:34:23.945497 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/redhat-operators-dd7qh"] Mar 16 15:34:23 crc kubenswrapper[5120]: I0316 15:34:23.966723 5120 scope.go:117] "RemoveContainer" containerID="ea8ab535c44f522d667d632476d333a9b4d562d70fb771e0546c40abc6f40d9c" Mar 16 15:34:23 crc kubenswrapper[5120]: I0316 15:34:23.980765 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-apiserver/revision-pruner-12-crc"] Mar 16 15:34:23 crc kubenswrapper[5120]: I0316 15:34:23.981262 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b89af808-d797-4840-9969-8f4eb5dc9157" containerName="extract-content" Mar 16 15:34:23 crc kubenswrapper[5120]: I0316 15:34:23.981279 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="b89af808-d797-4840-9969-8f4eb5dc9157" containerName="extract-content" Mar 16 15:34:23 crc kubenswrapper[5120]: I0316 15:34:23.981289 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5910a375-22bc-4049-9165-8ce8298a85ba" containerName="extract-content" Mar 16 15:34:23 crc kubenswrapper[5120]: I0316 15:34:23.981295 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="5910a375-22bc-4049-9165-8ce8298a85ba" containerName="extract-content" Mar 16 15:34:23 crc kubenswrapper[5120]: I0316 15:34:23.981307 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7d10a42-60a3-4313-8631-37995e78f48e" containerName="extract-utilities" Mar 16 15:34:23 crc kubenswrapper[5120]: I0316 15:34:23.981314 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7d10a42-60a3-4313-8631-37995e78f48e" containerName="extract-utilities" Mar 16 15:34:23 crc kubenswrapper[5120]: I0316 15:34:23.981322 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7d10a42-60a3-4313-8631-37995e78f48e" containerName="registry-server" Mar 16 15:34:23 crc kubenswrapper[5120]: I0316 15:34:23.981327 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7d10a42-60a3-4313-8631-37995e78f48e" containerName="registry-server" Mar 16 15:34:23 crc kubenswrapper[5120]: I0316 15:34:23.981335 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b89af808-d797-4840-9969-8f4eb5dc9157" containerName="extract-utilities" Mar 16 15:34:23 crc kubenswrapper[5120]: I0316 15:34:23.981340 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="b89af808-d797-4840-9969-8f4eb5dc9157" containerName="extract-utilities" Mar 16 15:34:23 crc kubenswrapper[5120]: I0316 15:34:23.981355 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2bb55bd0-43ba-4f30-93ad-aca0a4a74d04" containerName="extract-content" Mar 16 15:34:23 crc kubenswrapper[5120]: I0316 15:34:23.981360 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bb55bd0-43ba-4f30-93ad-aca0a4a74d04" containerName="extract-content" Mar 16 15:34:23 crc kubenswrapper[5120]: I0316 15:34:23.981367 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2bb55bd0-43ba-4f30-93ad-aca0a4a74d04" containerName="registry-server" Mar 16 15:34:23 crc kubenswrapper[5120]: I0316 15:34:23.981372 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bb55bd0-43ba-4f30-93ad-aca0a4a74d04" containerName="registry-server" Mar 16 15:34:23 crc kubenswrapper[5120]: I0316 15:34:23.981383 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2bb55bd0-43ba-4f30-93ad-aca0a4a74d04" containerName="extract-utilities" Mar 16 15:34:23 crc kubenswrapper[5120]: I0316 15:34:23.981388 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bb55bd0-43ba-4f30-93ad-aca0a4a74d04" containerName="extract-utilities" Mar 16 15:34:23 crc kubenswrapper[5120]: I0316 15:34:23.981398 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ecb3681-0da8-4d4a-9634-ce236c5ac399" containerName="oc" Mar 16 15:34:23 crc kubenswrapper[5120]: I0316 15:34:23.981405 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ecb3681-0da8-4d4a-9634-ce236c5ac399" containerName="oc" Mar 16 15:34:23 crc kubenswrapper[5120]: I0316 15:34:23.981413 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7d10a42-60a3-4313-8631-37995e78f48e" containerName="extract-content" Mar 16 15:34:23 crc kubenswrapper[5120]: I0316 15:34:23.981419 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7d10a42-60a3-4313-8631-37995e78f48e" containerName="extract-content" Mar 16 15:34:23 crc kubenswrapper[5120]: I0316 15:34:23.981425 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b89af808-d797-4840-9969-8f4eb5dc9157" containerName="registry-server" Mar 16 15:34:23 crc kubenswrapper[5120]: I0316 15:34:23.981431 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="b89af808-d797-4840-9969-8f4eb5dc9157" containerName="registry-server" Mar 16 15:34:23 crc kubenswrapper[5120]: I0316 15:34:23.981440 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5910a375-22bc-4049-9165-8ce8298a85ba" containerName="registry-server" Mar 16 15:34:23 crc kubenswrapper[5120]: I0316 15:34:23.981446 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="5910a375-22bc-4049-9165-8ce8298a85ba" containerName="registry-server" Mar 16 15:34:23 crc kubenswrapper[5120]: I0316 15:34:23.981454 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f966d74-f323-4f45-9fbb-8160d73b7770" containerName="kube-multus-additional-cni-plugins" Mar 16 15:34:23 crc kubenswrapper[5120]: I0316 15:34:23.981461 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f966d74-f323-4f45-9fbb-8160d73b7770" containerName="kube-multus-additional-cni-plugins" Mar 16 15:34:23 crc kubenswrapper[5120]: I0316 15:34:23.981470 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5910a375-22bc-4049-9165-8ce8298a85ba" containerName="extract-utilities" Mar 16 15:34:23 crc kubenswrapper[5120]: I0316 15:34:23.981475 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="5910a375-22bc-4049-9165-8ce8298a85ba" containerName="extract-utilities" Mar 16 15:34:23 crc kubenswrapper[5120]: I0316 15:34:23.981549 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="b89af808-d797-4840-9969-8f4eb5dc9157" containerName="registry-server" Mar 16 15:34:23 crc kubenswrapper[5120]: I0316 15:34:23.981559 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="2bb55bd0-43ba-4f30-93ad-aca0a4a74d04" containerName="registry-server" Mar 16 15:34:23 crc kubenswrapper[5120]: I0316 15:34:23.981569 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="b7d10a42-60a3-4313-8631-37995e78f48e" containerName="registry-server" Mar 16 15:34:23 crc kubenswrapper[5120]: I0316 15:34:23.981578 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7ecb3681-0da8-4d4a-9634-ce236c5ac399" containerName="oc" Mar 16 15:34:23 crc kubenswrapper[5120]: I0316 15:34:23.981585 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="5910a375-22bc-4049-9165-8ce8298a85ba" containerName="registry-server" Mar 16 15:34:23 crc kubenswrapper[5120]: I0316 15:34:23.981592 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="6f966d74-f323-4f45-9fbb-8160d73b7770" containerName="kube-multus-additional-cni-plugins" Mar 16 15:34:24 crc kubenswrapper[5120]: I0316 15:34:24.003927 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-apiserver/revision-pruner-12-crc"] Mar 16 15:34:24 crc kubenswrapper[5120]: I0316 15:34:24.004077 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/revision-pruner-12-crc" Mar 16 15:34:24 crc kubenswrapper[5120]: I0316 15:34:24.006412 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-apiserver\"/\"kube-root-ca.crt\"" Mar 16 15:34:24 crc kubenswrapper[5120]: I0316 15:34:24.006598 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-apiserver\"/\"installer-sa-dockercfg-bqqnb\"" Mar 16 15:34:24 crc kubenswrapper[5120]: I0316 15:34:24.103613 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/f07c6aa3-a5d5-4f67-985c-c248d18ba7b5-kube-api-access\") pod \"revision-pruner-12-crc\" (UID: \"f07c6aa3-a5d5-4f67-985c-c248d18ba7b5\") " pod="openshift-kube-apiserver/revision-pruner-12-crc" Mar 16 15:34:24 crc kubenswrapper[5120]: I0316 15:34:24.104002 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f07c6aa3-a5d5-4f67-985c-c248d18ba7b5-kubelet-dir\") pod \"revision-pruner-12-crc\" (UID: \"f07c6aa3-a5d5-4f67-985c-c248d18ba7b5\") " pod="openshift-kube-apiserver/revision-pruner-12-crc" Mar 16 15:34:24 crc kubenswrapper[5120]: I0316 15:34:24.205651 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/f07c6aa3-a5d5-4f67-985c-c248d18ba7b5-kube-api-access\") pod \"revision-pruner-12-crc\" (UID: \"f07c6aa3-a5d5-4f67-985c-c248d18ba7b5\") " pod="openshift-kube-apiserver/revision-pruner-12-crc" Mar 16 15:34:24 crc kubenswrapper[5120]: I0316 15:34:24.205727 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f07c6aa3-a5d5-4f67-985c-c248d18ba7b5-kubelet-dir\") pod \"revision-pruner-12-crc\" (UID: \"f07c6aa3-a5d5-4f67-985c-c248d18ba7b5\") " pod="openshift-kube-apiserver/revision-pruner-12-crc" Mar 16 15:34:24 crc kubenswrapper[5120]: I0316 15:34:24.205916 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f07c6aa3-a5d5-4f67-985c-c248d18ba7b5-kubelet-dir\") pod \"revision-pruner-12-crc\" (UID: \"f07c6aa3-a5d5-4f67-985c-c248d18ba7b5\") " pod="openshift-kube-apiserver/revision-pruner-12-crc" Mar 16 15:34:24 crc kubenswrapper[5120]: I0316 15:34:24.222843 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/f07c6aa3-a5d5-4f67-985c-c248d18ba7b5-kube-api-access\") pod \"revision-pruner-12-crc\" (UID: \"f07c6aa3-a5d5-4f67-985c-c248d18ba7b5\") " pod="openshift-kube-apiserver/revision-pruner-12-crc" Mar 16 15:34:24 crc kubenswrapper[5120]: I0316 15:34:24.323950 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/revision-pruner-12-crc" Mar 16 15:34:24 crc kubenswrapper[5120]: I0316 15:34:24.486484 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-apiserver/revision-pruner-12-crc"] Mar 16 15:34:24 crc kubenswrapper[5120]: W0316 15:34:24.497654 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podf07c6aa3_a5d5_4f67_985c_c248d18ba7b5.slice/crio-902a2c54fe3e55c712e986ec79caa3447261b9ac74418b3389a4878d47024cf6 WatchSource:0}: Error finding container 902a2c54fe3e55c712e986ec79caa3447261b9ac74418b3389a4878d47024cf6: Status 404 returned error can't find the container with id 902a2c54fe3e55c712e986ec79caa3447261b9ac74418b3389a4878d47024cf6 Mar 16 15:34:24 crc kubenswrapper[5120]: I0316 15:34:24.682403 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b7d10a42-60a3-4313-8631-37995e78f48e" path="/var/lib/kubelet/pods/b7d10a42-60a3-4313-8631-37995e78f48e/volumes" Mar 16 15:34:24 crc kubenswrapper[5120]: I0316 15:34:24.920481 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/revision-pruner-12-crc" event={"ID":"f07c6aa3-a5d5-4f67-985c-c248d18ba7b5","Type":"ContainerStarted","Data":"1ee2b991383729f204a4cda425d69ee246f39a945ff968545a183e7a8ee01612"} Mar 16 15:34:24 crc kubenswrapper[5120]: I0316 15:34:24.920543 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/revision-pruner-12-crc" event={"ID":"f07c6aa3-a5d5-4f67-985c-c248d18ba7b5","Type":"ContainerStarted","Data":"902a2c54fe3e55c712e986ec79caa3447261b9ac74418b3389a4878d47024cf6"} Mar 16 15:34:24 crc kubenswrapper[5120]: I0316 15:34:24.940471 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-apiserver/revision-pruner-12-crc" podStartSLOduration=1.940447058 podStartE2EDuration="1.940447058s" podCreationTimestamp="2026-03-16 15:34:23 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:34:24.939387499 +0000 UTC m=+167.093319196" watchObservedRunningTime="2026-03-16 15:34:24.940447058 +0000 UTC m=+167.094378755" Mar 16 15:34:25 crc kubenswrapper[5120]: I0316 15:34:25.928044 5120 generic.go:358] "Generic (PLEG): container finished" podID="f07c6aa3-a5d5-4f67-985c-c248d18ba7b5" containerID="1ee2b991383729f204a4cda425d69ee246f39a945ff968545a183e7a8ee01612" exitCode=0 Mar 16 15:34:25 crc kubenswrapper[5120]: I0316 15:34:25.928092 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/revision-pruner-12-crc" event={"ID":"f07c6aa3-a5d5-4f67-985c-c248d18ba7b5","Type":"ContainerDied","Data":"1ee2b991383729f204a4cda425d69ee246f39a945ff968545a183e7a8ee01612"} Mar 16 15:34:27 crc kubenswrapper[5120]: I0316 15:34:27.134685 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/revision-pruner-12-crc" Mar 16 15:34:27 crc kubenswrapper[5120]: I0316 15:34:27.238833 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/f07c6aa3-a5d5-4f67-985c-c248d18ba7b5-kube-api-access\") pod \"f07c6aa3-a5d5-4f67-985c-c248d18ba7b5\" (UID: \"f07c6aa3-a5d5-4f67-985c-c248d18ba7b5\") " Mar 16 15:34:27 crc kubenswrapper[5120]: I0316 15:34:27.238939 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f07c6aa3-a5d5-4f67-985c-c248d18ba7b5-kubelet-dir\") pod \"f07c6aa3-a5d5-4f67-985c-c248d18ba7b5\" (UID: \"f07c6aa3-a5d5-4f67-985c-c248d18ba7b5\") " Mar 16 15:34:27 crc kubenswrapper[5120]: I0316 15:34:27.239016 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/f07c6aa3-a5d5-4f67-985c-c248d18ba7b5-kubelet-dir" (OuterVolumeSpecName: "kubelet-dir") pod "f07c6aa3-a5d5-4f67-985c-c248d18ba7b5" (UID: "f07c6aa3-a5d5-4f67-985c-c248d18ba7b5"). InnerVolumeSpecName "kubelet-dir". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 15:34:27 crc kubenswrapper[5120]: I0316 15:34:27.239234 5120 reconciler_common.go:299] "Volume detached for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f07c6aa3-a5d5-4f67-985c-c248d18ba7b5-kubelet-dir\") on node \"crc\" DevicePath \"\"" Mar 16 15:34:27 crc kubenswrapper[5120]: I0316 15:34:27.245034 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f07c6aa3-a5d5-4f67-985c-c248d18ba7b5-kube-api-access" (OuterVolumeSpecName: "kube-api-access") pod "f07c6aa3-a5d5-4f67-985c-c248d18ba7b5" (UID: "f07c6aa3-a5d5-4f67-985c-c248d18ba7b5"). InnerVolumeSpecName "kube-api-access". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:34:27 crc kubenswrapper[5120]: I0316 15:34:27.340058 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/f07c6aa3-a5d5-4f67-985c-c248d18ba7b5-kube-api-access\") on node \"crc\" DevicePath \"\"" Mar 16 15:34:27 crc kubenswrapper[5120]: I0316 15:34:27.939422 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/revision-pruner-12-crc" event={"ID":"f07c6aa3-a5d5-4f67-985c-c248d18ba7b5","Type":"ContainerDied","Data":"902a2c54fe3e55c712e986ec79caa3447261b9ac74418b3389a4878d47024cf6"} Mar 16 15:34:27 crc kubenswrapper[5120]: I0316 15:34:27.939460 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="902a2c54fe3e55c712e986ec79caa3447261b9ac74418b3389a4878d47024cf6" Mar 16 15:34:27 crc kubenswrapper[5120]: I0316 15:34:27.939533 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/revision-pruner-12-crc" Mar 16 15:34:32 crc kubenswrapper[5120]: I0316 15:34:32.180977 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-apiserver/installer-12-crc"] Mar 16 15:34:32 crc kubenswrapper[5120]: I0316 15:34:32.182204 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f07c6aa3-a5d5-4f67-985c-c248d18ba7b5" containerName="pruner" Mar 16 15:34:32 crc kubenswrapper[5120]: I0316 15:34:32.182226 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f07c6aa3-a5d5-4f67-985c-c248d18ba7b5" containerName="pruner" Mar 16 15:34:32 crc kubenswrapper[5120]: I0316 15:34:32.182368 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f07c6aa3-a5d5-4f67-985c-c248d18ba7b5" containerName="pruner" Mar 16 15:34:32 crc kubenswrapper[5120]: I0316 15:34:32.187970 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/installer-12-crc" Mar 16 15:34:32 crc kubenswrapper[5120]: I0316 15:34:32.190052 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-apiserver\"/\"kube-root-ca.crt\"" Mar 16 15:34:32 crc kubenswrapper[5120]: I0316 15:34:32.190863 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-apiserver\"/\"installer-sa-dockercfg-bqqnb\"" Mar 16 15:34:32 crc kubenswrapper[5120]: I0316 15:34:32.191932 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-apiserver/installer-12-crc"] Mar 16 15:34:32 crc kubenswrapper[5120]: I0316 15:34:32.298884 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/01b7113a-6a9e-45f9-ab3a-bbf513f83e0a-var-lock\") pod \"installer-12-crc\" (UID: \"01b7113a-6a9e-45f9-ab3a-bbf513f83e0a\") " pod="openshift-kube-apiserver/installer-12-crc" Mar 16 15:34:32 crc kubenswrapper[5120]: I0316 15:34:32.299021 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/01b7113a-6a9e-45f9-ab3a-bbf513f83e0a-kube-api-access\") pod \"installer-12-crc\" (UID: \"01b7113a-6a9e-45f9-ab3a-bbf513f83e0a\") " pod="openshift-kube-apiserver/installer-12-crc" Mar 16 15:34:32 crc kubenswrapper[5120]: I0316 15:34:32.299097 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/01b7113a-6a9e-45f9-ab3a-bbf513f83e0a-kubelet-dir\") pod \"installer-12-crc\" (UID: \"01b7113a-6a9e-45f9-ab3a-bbf513f83e0a\") " pod="openshift-kube-apiserver/installer-12-crc" Mar 16 15:34:32 crc kubenswrapper[5120]: I0316 15:34:32.400073 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/01b7113a-6a9e-45f9-ab3a-bbf513f83e0a-kubelet-dir\") pod \"installer-12-crc\" (UID: \"01b7113a-6a9e-45f9-ab3a-bbf513f83e0a\") " pod="openshift-kube-apiserver/installer-12-crc" Mar 16 15:34:32 crc kubenswrapper[5120]: I0316 15:34:32.400172 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/01b7113a-6a9e-45f9-ab3a-bbf513f83e0a-var-lock\") pod \"installer-12-crc\" (UID: \"01b7113a-6a9e-45f9-ab3a-bbf513f83e0a\") " pod="openshift-kube-apiserver/installer-12-crc" Mar 16 15:34:32 crc kubenswrapper[5120]: I0316 15:34:32.400197 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/01b7113a-6a9e-45f9-ab3a-bbf513f83e0a-kubelet-dir\") pod \"installer-12-crc\" (UID: \"01b7113a-6a9e-45f9-ab3a-bbf513f83e0a\") " pod="openshift-kube-apiserver/installer-12-crc" Mar 16 15:34:32 crc kubenswrapper[5120]: I0316 15:34:32.400234 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/01b7113a-6a9e-45f9-ab3a-bbf513f83e0a-kube-api-access\") pod \"installer-12-crc\" (UID: \"01b7113a-6a9e-45f9-ab3a-bbf513f83e0a\") " pod="openshift-kube-apiserver/installer-12-crc" Mar 16 15:34:32 crc kubenswrapper[5120]: I0316 15:34:32.400309 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/01b7113a-6a9e-45f9-ab3a-bbf513f83e0a-var-lock\") pod \"installer-12-crc\" (UID: \"01b7113a-6a9e-45f9-ab3a-bbf513f83e0a\") " pod="openshift-kube-apiserver/installer-12-crc" Mar 16 15:34:32 crc kubenswrapper[5120]: I0316 15:34:32.429137 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/01b7113a-6a9e-45f9-ab3a-bbf513f83e0a-kube-api-access\") pod \"installer-12-crc\" (UID: \"01b7113a-6a9e-45f9-ab3a-bbf513f83e0a\") " pod="openshift-kube-apiserver/installer-12-crc" Mar 16 15:34:32 crc kubenswrapper[5120]: I0316 15:34:32.512498 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/installer-12-crc" Mar 16 15:34:32 crc kubenswrapper[5120]: I0316 15:34:32.713781 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-apiserver/installer-12-crc"] Mar 16 15:34:32 crc kubenswrapper[5120]: I0316 15:34:32.967626 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/installer-12-crc" event={"ID":"01b7113a-6a9e-45f9-ab3a-bbf513f83e0a","Type":"ContainerStarted","Data":"35170cfeff3b73982f409700b12eb142e31cb34c36b340a9ee24bd63660fa4ea"} Mar 16 15:34:33 crc kubenswrapper[5120]: I0316 15:34:33.976247 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/installer-12-crc" event={"ID":"01b7113a-6a9e-45f9-ab3a-bbf513f83e0a","Type":"ContainerStarted","Data":"9525bd9b1df306f86781c5c5427ca51fdb32a6994da02f312fbbb50b87df9b57"} Mar 16 15:34:34 crc kubenswrapper[5120]: I0316 15:34:34.000132 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-apiserver/installer-12-crc" podStartSLOduration=2.0000952 podStartE2EDuration="2.0000952s" podCreationTimestamp="2026-03-16 15:34:32 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:34:33.998068154 +0000 UTC m=+176.151999811" watchObservedRunningTime="2026-03-16 15:34:34.0000952 +0000 UTC m=+176.154026887" Mar 16 15:34:44 crc kubenswrapper[5120]: I0316 15:34:44.401220 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-authentication/oauth-openshift-66458b6674-fvnvr" podUID="83701ed7-4bc7-455c-a179-b460d641b3bf" containerName="oauth-openshift" containerID="cri-o://b7a7c03608a0f8c2cc117c69e798b09696b92b94698dabfd1713d625dfe85ff0" gracePeriod=15 Mar 16 15:34:44 crc kubenswrapper[5120]: I0316 15:34:44.800862 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-authentication/oauth-openshift-66458b6674-fvnvr" Mar 16 15:34:44 crc kubenswrapper[5120]: I0316 15:34:44.851628 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-authentication/oauth-openshift-dd58bbf49-wdb2p"] Mar 16 15:34:44 crc kubenswrapper[5120]: I0316 15:34:44.853299 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83701ed7-4bc7-455c-a179-b460d641b3bf" containerName="oauth-openshift" Mar 16 15:34:44 crc kubenswrapper[5120]: I0316 15:34:44.853326 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="83701ed7-4bc7-455c-a179-b460d641b3bf" containerName="oauth-openshift" Mar 16 15:34:44 crc kubenswrapper[5120]: I0316 15:34:44.854503 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="83701ed7-4bc7-455c-a179-b460d641b3bf" containerName="oauth-openshift" Mar 16 15:34:44 crc kubenswrapper[5120]: I0316 15:34:44.874279 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-authentication/oauth-openshift-dd58bbf49-wdb2p" Mar 16 15:34:44 crc kubenswrapper[5120]: I0316 15:34:44.877158 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-authentication/oauth-openshift-dd58bbf49-wdb2p"] Mar 16 15:34:44 crc kubenswrapper[5120]: I0316 15:34:44.896680 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"v4-0-config-system-session\" (UniqueName: \"kubernetes.io/secret/83701ed7-4bc7-455c-a179-b460d641b3bf-v4-0-config-system-session\") pod \"83701ed7-4bc7-455c-a179-b460d641b3bf\" (UID: \"83701ed7-4bc7-455c-a179-b460d641b3bf\") " Mar 16 15:34:44 crc kubenswrapper[5120]: I0316 15:34:44.896730 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"v4-0-config-system-service-ca\" (UniqueName: \"kubernetes.io/configmap/83701ed7-4bc7-455c-a179-b460d641b3bf-v4-0-config-system-service-ca\") pod \"83701ed7-4bc7-455c-a179-b460d641b3bf\" (UID: \"83701ed7-4bc7-455c-a179-b460d641b3bf\") " Mar 16 15:34:44 crc kubenswrapper[5120]: I0316 15:34:44.896790 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"v4-0-config-system-serving-cert\" (UniqueName: \"kubernetes.io/secret/83701ed7-4bc7-455c-a179-b460d641b3bf-v4-0-config-system-serving-cert\") pod \"83701ed7-4bc7-455c-a179-b460d641b3bf\" (UID: \"83701ed7-4bc7-455c-a179-b460d641b3bf\") " Mar 16 15:34:44 crc kubenswrapper[5120]: I0316 15:34:44.896827 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/83701ed7-4bc7-455c-a179-b460d641b3bf-audit-dir\") pod \"83701ed7-4bc7-455c-a179-b460d641b3bf\" (UID: \"83701ed7-4bc7-455c-a179-b460d641b3bf\") " Mar 16 15:34:44 crc kubenswrapper[5120]: I0316 15:34:44.896912 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"v4-0-config-user-template-login\" (UniqueName: \"kubernetes.io/secret/83701ed7-4bc7-455c-a179-b460d641b3bf-v4-0-config-user-template-login\") pod \"83701ed7-4bc7-455c-a179-b460d641b3bf\" (UID: \"83701ed7-4bc7-455c-a179-b460d641b3bf\") " Mar 16 15:34:44 crc kubenswrapper[5120]: I0316 15:34:44.896982 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"v4-0-config-system-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83701ed7-4bc7-455c-a179-b460d641b3bf-v4-0-config-system-trusted-ca-bundle\") pod \"83701ed7-4bc7-455c-a179-b460d641b3bf\" (UID: \"83701ed7-4bc7-455c-a179-b460d641b3bf\") " Mar 16 15:34:44 crc kubenswrapper[5120]: I0316 15:34:44.897006 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"v4-0-config-system-cliconfig\" (UniqueName: \"kubernetes.io/configmap/83701ed7-4bc7-455c-a179-b460d641b3bf-v4-0-config-system-cliconfig\") pod \"83701ed7-4bc7-455c-a179-b460d641b3bf\" (UID: \"83701ed7-4bc7-455c-a179-b460d641b3bf\") " Mar 16 15:34:44 crc kubenswrapper[5120]: I0316 15:34:44.897033 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9s7z5\" (UniqueName: \"kubernetes.io/projected/83701ed7-4bc7-455c-a179-b460d641b3bf-kube-api-access-9s7z5\") pod \"83701ed7-4bc7-455c-a179-b460d641b3bf\" (UID: \"83701ed7-4bc7-455c-a179-b460d641b3bf\") " Mar 16 15:34:44 crc kubenswrapper[5120]: I0316 15:34:44.897071 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"v4-0-config-user-idp-0-file-data\" (UniqueName: \"kubernetes.io/secret/83701ed7-4bc7-455c-a179-b460d641b3bf-v4-0-config-user-idp-0-file-data\") pod \"83701ed7-4bc7-455c-a179-b460d641b3bf\" (UID: \"83701ed7-4bc7-455c-a179-b460d641b3bf\") " Mar 16 15:34:44 crc kubenswrapper[5120]: I0316 15:34:44.897102 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"v4-0-config-system-router-certs\" (UniqueName: \"kubernetes.io/secret/83701ed7-4bc7-455c-a179-b460d641b3bf-v4-0-config-system-router-certs\") pod \"83701ed7-4bc7-455c-a179-b460d641b3bf\" (UID: \"83701ed7-4bc7-455c-a179-b460d641b3bf\") " Mar 16 15:34:44 crc kubenswrapper[5120]: I0316 15:34:44.897126 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"v4-0-config-system-ocp-branding-template\" (UniqueName: \"kubernetes.io/secret/83701ed7-4bc7-455c-a179-b460d641b3bf-v4-0-config-system-ocp-branding-template\") pod \"83701ed7-4bc7-455c-a179-b460d641b3bf\" (UID: \"83701ed7-4bc7-455c-a179-b460d641b3bf\") " Mar 16 15:34:44 crc kubenswrapper[5120]: I0316 15:34:44.897160 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"v4-0-config-user-template-error\" (UniqueName: \"kubernetes.io/secret/83701ed7-4bc7-455c-a179-b460d641b3bf-v4-0-config-user-template-error\") pod \"83701ed7-4bc7-455c-a179-b460d641b3bf\" (UID: \"83701ed7-4bc7-455c-a179-b460d641b3bf\") " Mar 16 15:34:44 crc kubenswrapper[5120]: I0316 15:34:44.897201 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"v4-0-config-user-template-provider-selection\" (UniqueName: \"kubernetes.io/secret/83701ed7-4bc7-455c-a179-b460d641b3bf-v4-0-config-user-template-provider-selection\") pod \"83701ed7-4bc7-455c-a179-b460d641b3bf\" (UID: \"83701ed7-4bc7-455c-a179-b460d641b3bf\") " Mar 16 15:34:44 crc kubenswrapper[5120]: I0316 15:34:44.897229 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"audit-policies\" (UniqueName: \"kubernetes.io/configmap/83701ed7-4bc7-455c-a179-b460d641b3bf-audit-policies\") pod \"83701ed7-4bc7-455c-a179-b460d641b3bf\" (UID: \"83701ed7-4bc7-455c-a179-b460d641b3bf\") " Mar 16 15:34:44 crc kubenswrapper[5120]: I0316 15:34:44.897370 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-system-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/808be0cf-299b-4841-86a5-48b87d795b80-v4-0-config-system-trusted-ca-bundle\") pod \"oauth-openshift-dd58bbf49-wdb2p\" (UID: \"808be0cf-299b-4841-86a5-48b87d795b80\") " pod="openshift-authentication/oauth-openshift-dd58bbf49-wdb2p" Mar 16 15:34:44 crc kubenswrapper[5120]: I0316 15:34:44.897411 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-system-ocp-branding-template\" (UniqueName: \"kubernetes.io/secret/808be0cf-299b-4841-86a5-48b87d795b80-v4-0-config-system-ocp-branding-template\") pod \"oauth-openshift-dd58bbf49-wdb2p\" (UID: \"808be0cf-299b-4841-86a5-48b87d795b80\") " pod="openshift-authentication/oauth-openshift-dd58bbf49-wdb2p" Mar 16 15:34:44 crc kubenswrapper[5120]: I0316 15:34:44.897459 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/808be0cf-299b-4841-86a5-48b87d795b80-audit-dir\") pod \"oauth-openshift-dd58bbf49-wdb2p\" (UID: \"808be0cf-299b-4841-86a5-48b87d795b80\") " pod="openshift-authentication/oauth-openshift-dd58bbf49-wdb2p" Mar 16 15:34:44 crc kubenswrapper[5120]: I0316 15:34:44.897482 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-user-template-login\" (UniqueName: \"kubernetes.io/secret/808be0cf-299b-4841-86a5-48b87d795b80-v4-0-config-user-template-login\") pod \"oauth-openshift-dd58bbf49-wdb2p\" (UID: \"808be0cf-299b-4841-86a5-48b87d795b80\") " pod="openshift-authentication/oauth-openshift-dd58bbf49-wdb2p" Mar 16 15:34:44 crc kubenswrapper[5120]: I0316 15:34:44.897525 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-system-router-certs\" (UniqueName: \"kubernetes.io/secret/808be0cf-299b-4841-86a5-48b87d795b80-v4-0-config-system-router-certs\") pod \"oauth-openshift-dd58bbf49-wdb2p\" (UID: \"808be0cf-299b-4841-86a5-48b87d795b80\") " pod="openshift-authentication/oauth-openshift-dd58bbf49-wdb2p" Mar 16 15:34:44 crc kubenswrapper[5120]: I0316 15:34:44.897557 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-policies\" (UniqueName: \"kubernetes.io/configmap/808be0cf-299b-4841-86a5-48b87d795b80-audit-policies\") pod \"oauth-openshift-dd58bbf49-wdb2p\" (UID: \"808be0cf-299b-4841-86a5-48b87d795b80\") " pod="openshift-authentication/oauth-openshift-dd58bbf49-wdb2p" Mar 16 15:34:44 crc kubenswrapper[5120]: I0316 15:34:44.897594 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-user-idp-0-file-data\" (UniqueName: \"kubernetes.io/secret/808be0cf-299b-4841-86a5-48b87d795b80-v4-0-config-user-idp-0-file-data\") pod \"oauth-openshift-dd58bbf49-wdb2p\" (UID: \"808be0cf-299b-4841-86a5-48b87d795b80\") " pod="openshift-authentication/oauth-openshift-dd58bbf49-wdb2p" Mar 16 15:34:44 crc kubenswrapper[5120]: I0316 15:34:44.897618 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6ql2\" (UniqueName: \"kubernetes.io/projected/808be0cf-299b-4841-86a5-48b87d795b80-kube-api-access-k6ql2\") pod \"oauth-openshift-dd58bbf49-wdb2p\" (UID: \"808be0cf-299b-4841-86a5-48b87d795b80\") " pod="openshift-authentication/oauth-openshift-dd58bbf49-wdb2p" Mar 16 15:34:44 crc kubenswrapper[5120]: I0316 15:34:44.897698 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-system-session\" (UniqueName: \"kubernetes.io/secret/808be0cf-299b-4841-86a5-48b87d795b80-v4-0-config-system-session\") pod \"oauth-openshift-dd58bbf49-wdb2p\" (UID: \"808be0cf-299b-4841-86a5-48b87d795b80\") " pod="openshift-authentication/oauth-openshift-dd58bbf49-wdb2p" Mar 16 15:34:44 crc kubenswrapper[5120]: I0316 15:34:44.897725 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-user-template-error\" (UniqueName: \"kubernetes.io/secret/808be0cf-299b-4841-86a5-48b87d795b80-v4-0-config-user-template-error\") pod \"oauth-openshift-dd58bbf49-wdb2p\" (UID: \"808be0cf-299b-4841-86a5-48b87d795b80\") " pod="openshift-authentication/oauth-openshift-dd58bbf49-wdb2p" Mar 16 15:34:44 crc kubenswrapper[5120]: I0316 15:34:44.897751 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-system-cliconfig\" (UniqueName: \"kubernetes.io/configmap/808be0cf-299b-4841-86a5-48b87d795b80-v4-0-config-system-cliconfig\") pod \"oauth-openshift-dd58bbf49-wdb2p\" (UID: \"808be0cf-299b-4841-86a5-48b87d795b80\") " pod="openshift-authentication/oauth-openshift-dd58bbf49-wdb2p" Mar 16 15:34:44 crc kubenswrapper[5120]: I0316 15:34:44.897805 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-user-template-provider-selection\" (UniqueName: \"kubernetes.io/secret/808be0cf-299b-4841-86a5-48b87d795b80-v4-0-config-user-template-provider-selection\") pod \"oauth-openshift-dd58bbf49-wdb2p\" (UID: \"808be0cf-299b-4841-86a5-48b87d795b80\") " pod="openshift-authentication/oauth-openshift-dd58bbf49-wdb2p" Mar 16 15:34:44 crc kubenswrapper[5120]: I0316 15:34:44.897844 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-system-serving-cert\" (UniqueName: \"kubernetes.io/secret/808be0cf-299b-4841-86a5-48b87d795b80-v4-0-config-system-serving-cert\") pod \"oauth-openshift-dd58bbf49-wdb2p\" (UID: \"808be0cf-299b-4841-86a5-48b87d795b80\") " pod="openshift-authentication/oauth-openshift-dd58bbf49-wdb2p" Mar 16 15:34:44 crc kubenswrapper[5120]: I0316 15:34:44.897913 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-system-service-ca\" (UniqueName: \"kubernetes.io/configmap/808be0cf-299b-4841-86a5-48b87d795b80-v4-0-config-system-service-ca\") pod \"oauth-openshift-dd58bbf49-wdb2p\" (UID: \"808be0cf-299b-4841-86a5-48b87d795b80\") " pod="openshift-authentication/oauth-openshift-dd58bbf49-wdb2p" Mar 16 15:34:44 crc kubenswrapper[5120]: I0316 15:34:44.906957 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/83701ed7-4bc7-455c-a179-b460d641b3bf-v4-0-config-system-cliconfig" (OuterVolumeSpecName: "v4-0-config-system-cliconfig") pod "83701ed7-4bc7-455c-a179-b460d641b3bf" (UID: "83701ed7-4bc7-455c-a179-b460d641b3bf"). InnerVolumeSpecName "v4-0-config-system-cliconfig". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:34:44 crc kubenswrapper[5120]: I0316 15:34:44.907196 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/83701ed7-4bc7-455c-a179-b460d641b3bf-audit-dir" (OuterVolumeSpecName: "audit-dir") pod "83701ed7-4bc7-455c-a179-b460d641b3bf" (UID: "83701ed7-4bc7-455c-a179-b460d641b3bf"). InnerVolumeSpecName "audit-dir". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 15:34:44 crc kubenswrapper[5120]: I0316 15:34:44.909674 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/83701ed7-4bc7-455c-a179-b460d641b3bf-v4-0-config-system-service-ca" (OuterVolumeSpecName: "v4-0-config-system-service-ca") pod "83701ed7-4bc7-455c-a179-b460d641b3bf" (UID: "83701ed7-4bc7-455c-a179-b460d641b3bf"). InnerVolumeSpecName "v4-0-config-system-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:34:44 crc kubenswrapper[5120]: I0316 15:34:44.921548 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/83701ed7-4bc7-455c-a179-b460d641b3bf-v4-0-config-system-ocp-branding-template" (OuterVolumeSpecName: "v4-0-config-system-ocp-branding-template") pod "83701ed7-4bc7-455c-a179-b460d641b3bf" (UID: "83701ed7-4bc7-455c-a179-b460d641b3bf"). InnerVolumeSpecName "v4-0-config-system-ocp-branding-template". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:34:44 crc kubenswrapper[5120]: I0316 15:34:44.924076 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/83701ed7-4bc7-455c-a179-b460d641b3bf-audit-policies" (OuterVolumeSpecName: "audit-policies") pod "83701ed7-4bc7-455c-a179-b460d641b3bf" (UID: "83701ed7-4bc7-455c-a179-b460d641b3bf"). InnerVolumeSpecName "audit-policies". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:34:44 crc kubenswrapper[5120]: I0316 15:34:44.928366 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/83701ed7-4bc7-455c-a179-b460d641b3bf-v4-0-config-system-trusted-ca-bundle" (OuterVolumeSpecName: "v4-0-config-system-trusted-ca-bundle") pod "83701ed7-4bc7-455c-a179-b460d641b3bf" (UID: "83701ed7-4bc7-455c-a179-b460d641b3bf"). InnerVolumeSpecName "v4-0-config-system-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:34:44 crc kubenswrapper[5120]: I0316 15:34:44.929006 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/83701ed7-4bc7-455c-a179-b460d641b3bf-v4-0-config-user-template-provider-selection" (OuterVolumeSpecName: "v4-0-config-user-template-provider-selection") pod "83701ed7-4bc7-455c-a179-b460d641b3bf" (UID: "83701ed7-4bc7-455c-a179-b460d641b3bf"). InnerVolumeSpecName "v4-0-config-user-template-provider-selection". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:34:44 crc kubenswrapper[5120]: I0316 15:34:44.929025 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83701ed7-4bc7-455c-a179-b460d641b3bf-kube-api-access-9s7z5" (OuterVolumeSpecName: "kube-api-access-9s7z5") pod "83701ed7-4bc7-455c-a179-b460d641b3bf" (UID: "83701ed7-4bc7-455c-a179-b460d641b3bf"). InnerVolumeSpecName "kube-api-access-9s7z5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:34:44 crc kubenswrapper[5120]: I0316 15:34:44.929034 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/83701ed7-4bc7-455c-a179-b460d641b3bf-v4-0-config-user-template-login" (OuterVolumeSpecName: "v4-0-config-user-template-login") pod "83701ed7-4bc7-455c-a179-b460d641b3bf" (UID: "83701ed7-4bc7-455c-a179-b460d641b3bf"). InnerVolumeSpecName "v4-0-config-user-template-login". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:34:44 crc kubenswrapper[5120]: I0316 15:34:44.929282 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/83701ed7-4bc7-455c-a179-b460d641b3bf-v4-0-config-user-template-error" (OuterVolumeSpecName: "v4-0-config-user-template-error") pod "83701ed7-4bc7-455c-a179-b460d641b3bf" (UID: "83701ed7-4bc7-455c-a179-b460d641b3bf"). InnerVolumeSpecName "v4-0-config-user-template-error". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:34:44 crc kubenswrapper[5120]: I0316 15:34:44.929612 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/83701ed7-4bc7-455c-a179-b460d641b3bf-v4-0-config-system-router-certs" (OuterVolumeSpecName: "v4-0-config-system-router-certs") pod "83701ed7-4bc7-455c-a179-b460d641b3bf" (UID: "83701ed7-4bc7-455c-a179-b460d641b3bf"). InnerVolumeSpecName "v4-0-config-system-router-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:34:44 crc kubenswrapper[5120]: I0316 15:34:44.929657 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/83701ed7-4bc7-455c-a179-b460d641b3bf-v4-0-config-user-idp-0-file-data" (OuterVolumeSpecName: "v4-0-config-user-idp-0-file-data") pod "83701ed7-4bc7-455c-a179-b460d641b3bf" (UID: "83701ed7-4bc7-455c-a179-b460d641b3bf"). InnerVolumeSpecName "v4-0-config-user-idp-0-file-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:34:44 crc kubenswrapper[5120]: I0316 15:34:44.929729 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/83701ed7-4bc7-455c-a179-b460d641b3bf-v4-0-config-system-session" (OuterVolumeSpecName: "v4-0-config-system-session") pod "83701ed7-4bc7-455c-a179-b460d641b3bf" (UID: "83701ed7-4bc7-455c-a179-b460d641b3bf"). InnerVolumeSpecName "v4-0-config-system-session". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:34:44 crc kubenswrapper[5120]: I0316 15:34:44.929718 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/83701ed7-4bc7-455c-a179-b460d641b3bf-v4-0-config-system-serving-cert" (OuterVolumeSpecName: "v4-0-config-system-serving-cert") pod "83701ed7-4bc7-455c-a179-b460d641b3bf" (UID: "83701ed7-4bc7-455c-a179-b460d641b3bf"). InnerVolumeSpecName "v4-0-config-system-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:34:44 crc kubenswrapper[5120]: I0316 15:34:44.998643 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-policies\" (UniqueName: \"kubernetes.io/configmap/808be0cf-299b-4841-86a5-48b87d795b80-audit-policies\") pod \"oauth-openshift-dd58bbf49-wdb2p\" (UID: \"808be0cf-299b-4841-86a5-48b87d795b80\") " pod="openshift-authentication/oauth-openshift-dd58bbf49-wdb2p" Mar 16 15:34:44 crc kubenswrapper[5120]: I0316 15:34:44.998686 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"v4-0-config-user-idp-0-file-data\" (UniqueName: \"kubernetes.io/secret/808be0cf-299b-4841-86a5-48b87d795b80-v4-0-config-user-idp-0-file-data\") pod \"oauth-openshift-dd58bbf49-wdb2p\" (UID: \"808be0cf-299b-4841-86a5-48b87d795b80\") " pod="openshift-authentication/oauth-openshift-dd58bbf49-wdb2p" Mar 16 15:34:44 crc kubenswrapper[5120]: I0316 15:34:44.998705 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k6ql2\" (UniqueName: \"kubernetes.io/projected/808be0cf-299b-4841-86a5-48b87d795b80-kube-api-access-k6ql2\") pod \"oauth-openshift-dd58bbf49-wdb2p\" (UID: \"808be0cf-299b-4841-86a5-48b87d795b80\") " pod="openshift-authentication/oauth-openshift-dd58bbf49-wdb2p" Mar 16 15:34:44 crc kubenswrapper[5120]: I0316 15:34:44.998740 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"v4-0-config-system-session\" (UniqueName: \"kubernetes.io/secret/808be0cf-299b-4841-86a5-48b87d795b80-v4-0-config-system-session\") pod \"oauth-openshift-dd58bbf49-wdb2p\" (UID: \"808be0cf-299b-4841-86a5-48b87d795b80\") " pod="openshift-authentication/oauth-openshift-dd58bbf49-wdb2p" Mar 16 15:34:44 crc kubenswrapper[5120]: I0316 15:34:44.999051 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"v4-0-config-user-template-error\" (UniqueName: \"kubernetes.io/secret/808be0cf-299b-4841-86a5-48b87d795b80-v4-0-config-user-template-error\") pod \"oauth-openshift-dd58bbf49-wdb2p\" (UID: \"808be0cf-299b-4841-86a5-48b87d795b80\") " pod="openshift-authentication/oauth-openshift-dd58bbf49-wdb2p" Mar 16 15:34:44 crc kubenswrapper[5120]: I0316 15:34:44.999094 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"v4-0-config-system-cliconfig\" (UniqueName: \"kubernetes.io/configmap/808be0cf-299b-4841-86a5-48b87d795b80-v4-0-config-system-cliconfig\") pod \"oauth-openshift-dd58bbf49-wdb2p\" (UID: \"808be0cf-299b-4841-86a5-48b87d795b80\") " pod="openshift-authentication/oauth-openshift-dd58bbf49-wdb2p" Mar 16 15:34:44 crc kubenswrapper[5120]: I0316 15:34:44.999118 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"v4-0-config-user-template-provider-selection\" (UniqueName: \"kubernetes.io/secret/808be0cf-299b-4841-86a5-48b87d795b80-v4-0-config-user-template-provider-selection\") pod \"oauth-openshift-dd58bbf49-wdb2p\" (UID: \"808be0cf-299b-4841-86a5-48b87d795b80\") " pod="openshift-authentication/oauth-openshift-dd58bbf49-wdb2p" Mar 16 15:34:44 crc kubenswrapper[5120]: I0316 15:34:44.999153 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"v4-0-config-system-serving-cert\" (UniqueName: \"kubernetes.io/secret/808be0cf-299b-4841-86a5-48b87d795b80-v4-0-config-system-serving-cert\") pod \"oauth-openshift-dd58bbf49-wdb2p\" (UID: \"808be0cf-299b-4841-86a5-48b87d795b80\") " pod="openshift-authentication/oauth-openshift-dd58bbf49-wdb2p" Mar 16 15:34:44 crc kubenswrapper[5120]: I0316 15:34:44.999194 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"v4-0-config-system-service-ca\" (UniqueName: \"kubernetes.io/configmap/808be0cf-299b-4841-86a5-48b87d795b80-v4-0-config-system-service-ca\") pod \"oauth-openshift-dd58bbf49-wdb2p\" (UID: \"808be0cf-299b-4841-86a5-48b87d795b80\") " pod="openshift-authentication/oauth-openshift-dd58bbf49-wdb2p" Mar 16 15:34:44 crc kubenswrapper[5120]: I0316 15:34:44.999215 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"v4-0-config-system-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/808be0cf-299b-4841-86a5-48b87d795b80-v4-0-config-system-trusted-ca-bundle\") pod \"oauth-openshift-dd58bbf49-wdb2p\" (UID: \"808be0cf-299b-4841-86a5-48b87d795b80\") " pod="openshift-authentication/oauth-openshift-dd58bbf49-wdb2p" Mar 16 15:34:44 crc kubenswrapper[5120]: I0316 15:34:44.999241 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"v4-0-config-system-ocp-branding-template\" (UniqueName: \"kubernetes.io/secret/808be0cf-299b-4841-86a5-48b87d795b80-v4-0-config-system-ocp-branding-template\") pod \"oauth-openshift-dd58bbf49-wdb2p\" (UID: \"808be0cf-299b-4841-86a5-48b87d795b80\") " pod="openshift-authentication/oauth-openshift-dd58bbf49-wdb2p" Mar 16 15:34:44 crc kubenswrapper[5120]: I0316 15:34:44.999281 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/808be0cf-299b-4841-86a5-48b87d795b80-audit-dir\") pod \"oauth-openshift-dd58bbf49-wdb2p\" (UID: \"808be0cf-299b-4841-86a5-48b87d795b80\") " pod="openshift-authentication/oauth-openshift-dd58bbf49-wdb2p" Mar 16 15:34:44 crc kubenswrapper[5120]: I0316 15:34:44.999304 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"v4-0-config-user-template-login\" (UniqueName: \"kubernetes.io/secret/808be0cf-299b-4841-86a5-48b87d795b80-v4-0-config-user-template-login\") pod \"oauth-openshift-dd58bbf49-wdb2p\" (UID: \"808be0cf-299b-4841-86a5-48b87d795b80\") " pod="openshift-authentication/oauth-openshift-dd58bbf49-wdb2p" Mar 16 15:34:44 crc kubenswrapper[5120]: I0316 15:34:44.999340 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"v4-0-config-system-router-certs\" (UniqueName: \"kubernetes.io/secret/808be0cf-299b-4841-86a5-48b87d795b80-v4-0-config-system-router-certs\") pod \"oauth-openshift-dd58bbf49-wdb2p\" (UID: \"808be0cf-299b-4841-86a5-48b87d795b80\") " pod="openshift-authentication/oauth-openshift-dd58bbf49-wdb2p" Mar 16 15:34:44 crc kubenswrapper[5120]: I0316 15:34:44.999389 5120 reconciler_common.go:299] "Volume detached for volume \"v4-0-config-user-template-login\" (UniqueName: \"kubernetes.io/secret/83701ed7-4bc7-455c-a179-b460d641b3bf-v4-0-config-user-template-login\") on node \"crc\" DevicePath \"\"" Mar 16 15:34:44 crc kubenswrapper[5120]: I0316 15:34:44.999403 5120 reconciler_common.go:299] "Volume detached for volume \"v4-0-config-system-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83701ed7-4bc7-455c-a179-b460d641b3bf-v4-0-config-system-trusted-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:34:44 crc kubenswrapper[5120]: I0316 15:34:44.999418 5120 reconciler_common.go:299] "Volume detached for volume \"v4-0-config-system-cliconfig\" (UniqueName: \"kubernetes.io/configmap/83701ed7-4bc7-455c-a179-b460d641b3bf-v4-0-config-system-cliconfig\") on node \"crc\" DevicePath \"\"" Mar 16 15:34:44 crc kubenswrapper[5120]: I0316 15:34:44.999430 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9s7z5\" (UniqueName: \"kubernetes.io/projected/83701ed7-4bc7-455c-a179-b460d641b3bf-kube-api-access-9s7z5\") on node \"crc\" DevicePath \"\"" Mar 16 15:34:44 crc kubenswrapper[5120]: I0316 15:34:44.999442 5120 reconciler_common.go:299] "Volume detached for volume \"v4-0-config-user-idp-0-file-data\" (UniqueName: \"kubernetes.io/secret/83701ed7-4bc7-455c-a179-b460d641b3bf-v4-0-config-user-idp-0-file-data\") on node \"crc\" DevicePath \"\"" Mar 16 15:34:44 crc kubenswrapper[5120]: I0316 15:34:44.999452 5120 reconciler_common.go:299] "Volume detached for volume \"v4-0-config-system-router-certs\" (UniqueName: \"kubernetes.io/secret/83701ed7-4bc7-455c-a179-b460d641b3bf-v4-0-config-system-router-certs\") on node \"crc\" DevicePath \"\"" Mar 16 15:34:44 crc kubenswrapper[5120]: I0316 15:34:44.999462 5120 reconciler_common.go:299] "Volume detached for volume \"v4-0-config-system-ocp-branding-template\" (UniqueName: \"kubernetes.io/secret/83701ed7-4bc7-455c-a179-b460d641b3bf-v4-0-config-system-ocp-branding-template\") on node \"crc\" DevicePath \"\"" Mar 16 15:34:44 crc kubenswrapper[5120]: I0316 15:34:44.999473 5120 reconciler_common.go:299] "Volume detached for volume \"v4-0-config-user-template-error\" (UniqueName: \"kubernetes.io/secret/83701ed7-4bc7-455c-a179-b460d641b3bf-v4-0-config-user-template-error\") on node \"crc\" DevicePath \"\"" Mar 16 15:34:44 crc kubenswrapper[5120]: I0316 15:34:44.999487 5120 reconciler_common.go:299] "Volume detached for volume \"v4-0-config-user-template-provider-selection\" (UniqueName: \"kubernetes.io/secret/83701ed7-4bc7-455c-a179-b460d641b3bf-v4-0-config-user-template-provider-selection\") on node \"crc\" DevicePath \"\"" Mar 16 15:34:44 crc kubenswrapper[5120]: I0316 15:34:44.999499 5120 reconciler_common.go:299] "Volume detached for volume \"audit-policies\" (UniqueName: \"kubernetes.io/configmap/83701ed7-4bc7-455c-a179-b460d641b3bf-audit-policies\") on node \"crc\" DevicePath \"\"" Mar 16 15:34:44 crc kubenswrapper[5120]: I0316 15:34:44.999510 5120 reconciler_common.go:299] "Volume detached for volume \"v4-0-config-system-session\" (UniqueName: \"kubernetes.io/secret/83701ed7-4bc7-455c-a179-b460d641b3bf-v4-0-config-system-session\") on node \"crc\" DevicePath \"\"" Mar 16 15:34:44 crc kubenswrapper[5120]: I0316 15:34:44.999521 5120 reconciler_common.go:299] "Volume detached for volume \"v4-0-config-system-service-ca\" (UniqueName: \"kubernetes.io/configmap/83701ed7-4bc7-455c-a179-b460d641b3bf-v4-0-config-system-service-ca\") on node \"crc\" DevicePath \"\"" Mar 16 15:34:44 crc kubenswrapper[5120]: I0316 15:34:44.999531 5120 reconciler_common.go:299] "Volume detached for volume \"v4-0-config-system-serving-cert\" (UniqueName: \"kubernetes.io/secret/83701ed7-4bc7-455c-a179-b460d641b3bf-v4-0-config-system-serving-cert\") on node \"crc\" DevicePath \"\"" Mar 16 15:34:44 crc kubenswrapper[5120]: I0316 15:34:44.999543 5120 reconciler_common.go:299] "Volume detached for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/83701ed7-4bc7-455c-a179-b460d641b3bf-audit-dir\") on node \"crc\" DevicePath \"\"" Mar 16 15:34:45 crc kubenswrapper[5120]: I0316 15:34:44.999949 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/808be0cf-299b-4841-86a5-48b87d795b80-audit-dir\") pod \"oauth-openshift-dd58bbf49-wdb2p\" (UID: \"808be0cf-299b-4841-86a5-48b87d795b80\") " pod="openshift-authentication/oauth-openshift-dd58bbf49-wdb2p" Mar 16 15:34:45 crc kubenswrapper[5120]: I0316 15:34:45.000069 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-policies\" (UniqueName: \"kubernetes.io/configmap/808be0cf-299b-4841-86a5-48b87d795b80-audit-policies\") pod \"oauth-openshift-dd58bbf49-wdb2p\" (UID: \"808be0cf-299b-4841-86a5-48b87d795b80\") " pod="openshift-authentication/oauth-openshift-dd58bbf49-wdb2p" Mar 16 15:34:45 crc kubenswrapper[5120]: I0316 15:34:45.000216 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"v4-0-config-system-service-ca\" (UniqueName: \"kubernetes.io/configmap/808be0cf-299b-4841-86a5-48b87d795b80-v4-0-config-system-service-ca\") pod \"oauth-openshift-dd58bbf49-wdb2p\" (UID: \"808be0cf-299b-4841-86a5-48b87d795b80\") " pod="openshift-authentication/oauth-openshift-dd58bbf49-wdb2p" Mar 16 15:34:45 crc kubenswrapper[5120]: I0316 15:34:45.000798 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"v4-0-config-system-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/808be0cf-299b-4841-86a5-48b87d795b80-v4-0-config-system-trusted-ca-bundle\") pod \"oauth-openshift-dd58bbf49-wdb2p\" (UID: \"808be0cf-299b-4841-86a5-48b87d795b80\") " pod="openshift-authentication/oauth-openshift-dd58bbf49-wdb2p" Mar 16 15:34:45 crc kubenswrapper[5120]: I0316 15:34:45.001944 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"v4-0-config-system-cliconfig\" (UniqueName: \"kubernetes.io/configmap/808be0cf-299b-4841-86a5-48b87d795b80-v4-0-config-system-cliconfig\") pod \"oauth-openshift-dd58bbf49-wdb2p\" (UID: \"808be0cf-299b-4841-86a5-48b87d795b80\") " pod="openshift-authentication/oauth-openshift-dd58bbf49-wdb2p" Mar 16 15:34:45 crc kubenswrapper[5120]: I0316 15:34:45.002500 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"v4-0-config-system-router-certs\" (UniqueName: \"kubernetes.io/secret/808be0cf-299b-4841-86a5-48b87d795b80-v4-0-config-system-router-certs\") pod \"oauth-openshift-dd58bbf49-wdb2p\" (UID: \"808be0cf-299b-4841-86a5-48b87d795b80\") " pod="openshift-authentication/oauth-openshift-dd58bbf49-wdb2p" Mar 16 15:34:45 crc kubenswrapper[5120]: I0316 15:34:45.002500 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"v4-0-config-system-session\" (UniqueName: \"kubernetes.io/secret/808be0cf-299b-4841-86a5-48b87d795b80-v4-0-config-system-session\") pod \"oauth-openshift-dd58bbf49-wdb2p\" (UID: \"808be0cf-299b-4841-86a5-48b87d795b80\") " pod="openshift-authentication/oauth-openshift-dd58bbf49-wdb2p" Mar 16 15:34:45 crc kubenswrapper[5120]: I0316 15:34:45.002771 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"v4-0-config-user-idp-0-file-data\" (UniqueName: \"kubernetes.io/secret/808be0cf-299b-4841-86a5-48b87d795b80-v4-0-config-user-idp-0-file-data\") pod \"oauth-openshift-dd58bbf49-wdb2p\" (UID: \"808be0cf-299b-4841-86a5-48b87d795b80\") " pod="openshift-authentication/oauth-openshift-dd58bbf49-wdb2p" Mar 16 15:34:45 crc kubenswrapper[5120]: I0316 15:34:45.004170 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"v4-0-config-user-template-provider-selection\" (UniqueName: \"kubernetes.io/secret/808be0cf-299b-4841-86a5-48b87d795b80-v4-0-config-user-template-provider-selection\") pod \"oauth-openshift-dd58bbf49-wdb2p\" (UID: \"808be0cf-299b-4841-86a5-48b87d795b80\") " pod="openshift-authentication/oauth-openshift-dd58bbf49-wdb2p" Mar 16 15:34:45 crc kubenswrapper[5120]: I0316 15:34:45.004840 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"v4-0-config-system-serving-cert\" (UniqueName: \"kubernetes.io/secret/808be0cf-299b-4841-86a5-48b87d795b80-v4-0-config-system-serving-cert\") pod \"oauth-openshift-dd58bbf49-wdb2p\" (UID: \"808be0cf-299b-4841-86a5-48b87d795b80\") " pod="openshift-authentication/oauth-openshift-dd58bbf49-wdb2p" Mar 16 15:34:45 crc kubenswrapper[5120]: I0316 15:34:45.005242 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"v4-0-config-user-template-login\" (UniqueName: \"kubernetes.io/secret/808be0cf-299b-4841-86a5-48b87d795b80-v4-0-config-user-template-login\") pod \"oauth-openshift-dd58bbf49-wdb2p\" (UID: \"808be0cf-299b-4841-86a5-48b87d795b80\") " pod="openshift-authentication/oauth-openshift-dd58bbf49-wdb2p" Mar 16 15:34:45 crc kubenswrapper[5120]: I0316 15:34:45.005638 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"v4-0-config-system-ocp-branding-template\" (UniqueName: \"kubernetes.io/secret/808be0cf-299b-4841-86a5-48b87d795b80-v4-0-config-system-ocp-branding-template\") pod \"oauth-openshift-dd58bbf49-wdb2p\" (UID: \"808be0cf-299b-4841-86a5-48b87d795b80\") " pod="openshift-authentication/oauth-openshift-dd58bbf49-wdb2p" Mar 16 15:34:45 crc kubenswrapper[5120]: I0316 15:34:45.006050 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"v4-0-config-user-template-error\" (UniqueName: \"kubernetes.io/secret/808be0cf-299b-4841-86a5-48b87d795b80-v4-0-config-user-template-error\") pod \"oauth-openshift-dd58bbf49-wdb2p\" (UID: \"808be0cf-299b-4841-86a5-48b87d795b80\") " pod="openshift-authentication/oauth-openshift-dd58bbf49-wdb2p" Mar 16 15:34:45 crc kubenswrapper[5120]: I0316 15:34:45.017254 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6ql2\" (UniqueName: \"kubernetes.io/projected/808be0cf-299b-4841-86a5-48b87d795b80-kube-api-access-k6ql2\") pod \"oauth-openshift-dd58bbf49-wdb2p\" (UID: \"808be0cf-299b-4841-86a5-48b87d795b80\") " pod="openshift-authentication/oauth-openshift-dd58bbf49-wdb2p" Mar 16 15:34:45 crc kubenswrapper[5120]: I0316 15:34:45.042089 5120 generic.go:358] "Generic (PLEG): container finished" podID="83701ed7-4bc7-455c-a179-b460d641b3bf" containerID="b7a7c03608a0f8c2cc117c69e798b09696b92b94698dabfd1713d625dfe85ff0" exitCode=0 Mar 16 15:34:45 crc kubenswrapper[5120]: I0316 15:34:45.042280 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-authentication/oauth-openshift-66458b6674-fvnvr" Mar 16 15:34:45 crc kubenswrapper[5120]: I0316 15:34:45.042143 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-authentication/oauth-openshift-66458b6674-fvnvr" event={"ID":"83701ed7-4bc7-455c-a179-b460d641b3bf","Type":"ContainerDied","Data":"b7a7c03608a0f8c2cc117c69e798b09696b92b94698dabfd1713d625dfe85ff0"} Mar 16 15:34:45 crc kubenswrapper[5120]: I0316 15:34:45.042368 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-authentication/oauth-openshift-66458b6674-fvnvr" event={"ID":"83701ed7-4bc7-455c-a179-b460d641b3bf","Type":"ContainerDied","Data":"f1970738ff8f9ca942a6276d28ecf9c757785aa9039e860b5bae65be5fcfa638"} Mar 16 15:34:45 crc kubenswrapper[5120]: I0316 15:34:45.042424 5120 scope.go:117] "RemoveContainer" containerID="b7a7c03608a0f8c2cc117c69e798b09696b92b94698dabfd1713d625dfe85ff0" Mar 16 15:34:45 crc kubenswrapper[5120]: I0316 15:34:45.060881 5120 scope.go:117] "RemoveContainer" containerID="b7a7c03608a0f8c2cc117c69e798b09696b92b94698dabfd1713d625dfe85ff0" Mar 16 15:34:45 crc kubenswrapper[5120]: E0316 15:34:45.061208 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b7a7c03608a0f8c2cc117c69e798b09696b92b94698dabfd1713d625dfe85ff0\": container with ID starting with b7a7c03608a0f8c2cc117c69e798b09696b92b94698dabfd1713d625dfe85ff0 not found: ID does not exist" containerID="b7a7c03608a0f8c2cc117c69e798b09696b92b94698dabfd1713d625dfe85ff0" Mar 16 15:34:45 crc kubenswrapper[5120]: I0316 15:34:45.061249 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7a7c03608a0f8c2cc117c69e798b09696b92b94698dabfd1713d625dfe85ff0"} err="failed to get container status \"b7a7c03608a0f8c2cc117c69e798b09696b92b94698dabfd1713d625dfe85ff0\": rpc error: code = NotFound desc = could not find container \"b7a7c03608a0f8c2cc117c69e798b09696b92b94698dabfd1713d625dfe85ff0\": container with ID starting with b7a7c03608a0f8c2cc117c69e798b09696b92b94698dabfd1713d625dfe85ff0 not found: ID does not exist" Mar 16 15:34:45 crc kubenswrapper[5120]: I0316 15:34:45.085700 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-authentication/oauth-openshift-66458b6674-fvnvr"] Mar 16 15:34:45 crc kubenswrapper[5120]: I0316 15:34:45.090436 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-authentication/oauth-openshift-66458b6674-fvnvr"] Mar 16 15:34:45 crc kubenswrapper[5120]: I0316 15:34:45.247523 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-authentication/oauth-openshift-dd58bbf49-wdb2p" Mar 16 15:34:45 crc kubenswrapper[5120]: I0316 15:34:45.449564 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-authentication/oauth-openshift-dd58bbf49-wdb2p"] Mar 16 15:34:46 crc kubenswrapper[5120]: I0316 15:34:46.052819 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-authentication/oauth-openshift-dd58bbf49-wdb2p" event={"ID":"808be0cf-299b-4841-86a5-48b87d795b80","Type":"ContainerStarted","Data":"2fff674b39ca561609e09e26050d2ec36278a59abc7aca6effbaa5cc59a2201e"} Mar 16 15:34:46 crc kubenswrapper[5120]: I0316 15:34:46.052897 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-authentication/oauth-openshift-dd58bbf49-wdb2p" event={"ID":"808be0cf-299b-4841-86a5-48b87d795b80","Type":"ContainerStarted","Data":"c104ec6faab8911170cfeeac02637758cdb8b3712b3fe25cb75af0f7d3c8a75f"} Mar 16 15:34:46 crc kubenswrapper[5120]: I0316 15:34:46.053399 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-authentication/oauth-openshift-dd58bbf49-wdb2p" Mar 16 15:34:46 crc kubenswrapper[5120]: I0316 15:34:46.078309 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-authentication/oauth-openshift-dd58bbf49-wdb2p" podStartSLOduration=27.078291445 podStartE2EDuration="27.078291445s" podCreationTimestamp="2026-03-16 15:34:19 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:34:46.076188596 +0000 UTC m=+188.230120253" watchObservedRunningTime="2026-03-16 15:34:46.078291445 +0000 UTC m=+188.232223102" Mar 16 15:34:46 crc kubenswrapper[5120]: I0316 15:34:46.434033 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-authentication/oauth-openshift-dd58bbf49-wdb2p" Mar 16 15:34:46 crc kubenswrapper[5120]: I0316 15:34:46.670785 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="83701ed7-4bc7-455c-a179-b460d641b3bf" path="/var/lib/kubelet/pods/83701ed7-4bc7-455c-a179-b460d641b3bf/volumes" Mar 16 15:35:11 crc kubenswrapper[5120]: I0316 15:35:11.335266 5120 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-kube-apiserver/kube-apiserver-startup-monitor-crc"] Mar 16 15:35:11 crc kubenswrapper[5120]: I0316 15:35:11.352596 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-crc" Mar 16 15:35:11 crc kubenswrapper[5120]: I0316 15:35:11.367934 5120 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-crc" Mar 16 15:35:11 crc kubenswrapper[5120]: I0316 15:35:11.381254 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-apiserver/kube-apiserver-startup-monitor-crc"] Mar 16 15:35:11 crc kubenswrapper[5120]: I0316 15:35:11.396671 5120 kubelet.go:2547] "SyncLoop REMOVE" source="file" pods=["openshift-kube-apiserver/kube-apiserver-crc"] Mar 16 15:35:11 crc kubenswrapper[5120]: I0316 15:35:11.397336 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-kube-apiserver/kube-apiserver-crc" podUID="3a14caf222afb62aaabdc47808b6f944" containerName="kube-apiserver" containerID="cri-o://508f48da0745e92959e2d1557a5130e812920972548cfb726debf24c10a91ceb" gracePeriod=15 Mar 16 15:35:11 crc kubenswrapper[5120]: I0316 15:35:11.397576 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-kube-apiserver/kube-apiserver-crc" podUID="3a14caf222afb62aaabdc47808b6f944" containerName="kube-apiserver-check-endpoints" containerID="cri-o://3f2b9043857355dd12ad0ca2395ba7e066dc75d7974ef24c8ccde5468b617654" gracePeriod=15 Mar 16 15:35:11 crc kubenswrapper[5120]: I0316 15:35:11.397677 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-kube-apiserver/kube-apiserver-crc" podUID="3a14caf222afb62aaabdc47808b6f944" containerName="kube-apiserver-insecure-readyz" containerID="cri-o://93d46439f5f39d1e67f6df04e1bfc9dfc0f6d7fcdf6fbe4cce94455dd460c163" gracePeriod=15 Mar 16 15:35:11 crc kubenswrapper[5120]: I0316 15:35:11.397810 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-kube-apiserver/kube-apiserver-crc" podUID="3a14caf222afb62aaabdc47808b6f944" containerName="kube-apiserver-cert-regeneration-controller" containerID="cri-o://2927b83983005f4c3d99da754665655d8138a8e829cf2b9274040dfbec74fab7" gracePeriod=15 Mar 16 15:35:11 crc kubenswrapper[5120]: I0316 15:35:11.397910 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-kube-apiserver/kube-apiserver-crc" podUID="3a14caf222afb62aaabdc47808b6f944" containerName="kube-apiserver-cert-syncer" containerID="cri-o://28d3d4773246e29999a9a1edc877e703ed6476a59e6aef47ac34c6a3991c767a" gracePeriod=15 Mar 16 15:35:11 crc kubenswrapper[5120]: I0316 15:35:11.401281 5120 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-kube-apiserver/kube-apiserver-crc"] Mar 16 15:35:11 crc kubenswrapper[5120]: I0316 15:35:11.402322 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a14caf222afb62aaabdc47808b6f944" containerName="kube-apiserver-cert-syncer" Mar 16 15:35:11 crc kubenswrapper[5120]: I0316 15:35:11.402353 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a14caf222afb62aaabdc47808b6f944" containerName="kube-apiserver-cert-syncer" Mar 16 15:35:11 crc kubenswrapper[5120]: I0316 15:35:11.402379 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a14caf222afb62aaabdc47808b6f944" containerName="kube-apiserver-check-endpoints" Mar 16 15:35:11 crc kubenswrapper[5120]: I0316 15:35:11.402393 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a14caf222afb62aaabdc47808b6f944" containerName="kube-apiserver-check-endpoints" Mar 16 15:35:11 crc kubenswrapper[5120]: I0316 15:35:11.402415 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a14caf222afb62aaabdc47808b6f944" containerName="kube-apiserver-check-endpoints" Mar 16 15:35:11 crc kubenswrapper[5120]: I0316 15:35:11.402427 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a14caf222afb62aaabdc47808b6f944" containerName="kube-apiserver-check-endpoints" Mar 16 15:35:11 crc kubenswrapper[5120]: I0316 15:35:11.402448 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a14caf222afb62aaabdc47808b6f944" containerName="kube-apiserver-cert-regeneration-controller" Mar 16 15:35:11 crc kubenswrapper[5120]: I0316 15:35:11.402461 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a14caf222afb62aaabdc47808b6f944" containerName="kube-apiserver-cert-regeneration-controller" Mar 16 15:35:11 crc kubenswrapper[5120]: I0316 15:35:11.402490 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a14caf222afb62aaabdc47808b6f944" containerName="kube-apiserver-check-endpoints" Mar 16 15:35:11 crc kubenswrapper[5120]: I0316 15:35:11.402502 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a14caf222afb62aaabdc47808b6f944" containerName="kube-apiserver-check-endpoints" Mar 16 15:35:11 crc kubenswrapper[5120]: I0316 15:35:11.402528 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a14caf222afb62aaabdc47808b6f944" containerName="kube-apiserver" Mar 16 15:35:11 crc kubenswrapper[5120]: I0316 15:35:11.402542 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a14caf222afb62aaabdc47808b6f944" containerName="kube-apiserver" Mar 16 15:35:11 crc kubenswrapper[5120]: I0316 15:35:11.402570 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a14caf222afb62aaabdc47808b6f944" containerName="setup" Mar 16 15:35:11 crc kubenswrapper[5120]: I0316 15:35:11.402586 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a14caf222afb62aaabdc47808b6f944" containerName="setup" Mar 16 15:35:11 crc kubenswrapper[5120]: I0316 15:35:11.402618 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a14caf222afb62aaabdc47808b6f944" containerName="kube-apiserver-insecure-readyz" Mar 16 15:35:11 crc kubenswrapper[5120]: I0316 15:35:11.402635 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a14caf222afb62aaabdc47808b6f944" containerName="kube-apiserver-insecure-readyz" Mar 16 15:35:11 crc kubenswrapper[5120]: I0316 15:35:11.402852 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="3a14caf222afb62aaabdc47808b6f944" containerName="kube-apiserver" Mar 16 15:35:11 crc kubenswrapper[5120]: I0316 15:35:11.402879 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="3a14caf222afb62aaabdc47808b6f944" containerName="kube-apiserver-check-endpoints" Mar 16 15:35:11 crc kubenswrapper[5120]: I0316 15:35:11.402894 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="3a14caf222afb62aaabdc47808b6f944" containerName="kube-apiserver-check-endpoints" Mar 16 15:35:11 crc kubenswrapper[5120]: I0316 15:35:11.402908 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="3a14caf222afb62aaabdc47808b6f944" containerName="kube-apiserver-insecure-readyz" Mar 16 15:35:11 crc kubenswrapper[5120]: I0316 15:35:11.402923 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="3a14caf222afb62aaabdc47808b6f944" containerName="kube-apiserver-cert-syncer" Mar 16 15:35:11 crc kubenswrapper[5120]: I0316 15:35:11.402940 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="3a14caf222afb62aaabdc47808b6f944" containerName="kube-apiserver-cert-regeneration-controller" Mar 16 15:35:11 crc kubenswrapper[5120]: I0316 15:35:11.402963 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="3a14caf222afb62aaabdc47808b6f944" containerName="kube-apiserver-check-endpoints" Mar 16 15:35:11 crc kubenswrapper[5120]: I0316 15:35:11.402981 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="3a14caf222afb62aaabdc47808b6f944" containerName="kube-apiserver-check-endpoints" Mar 16 15:35:11 crc kubenswrapper[5120]: I0316 15:35:11.403196 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a14caf222afb62aaabdc47808b6f944" containerName="kube-apiserver-check-endpoints" Mar 16 15:35:11 crc kubenswrapper[5120]: I0316 15:35:11.403211 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a14caf222afb62aaabdc47808b6f944" containerName="kube-apiserver-check-endpoints" Mar 16 15:35:11 crc kubenswrapper[5120]: I0316 15:35:11.403243 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a14caf222afb62aaabdc47808b6f944" containerName="kube-apiserver-check-endpoints" Mar 16 15:35:11 crc kubenswrapper[5120]: I0316 15:35:11.403255 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a14caf222afb62aaabdc47808b6f944" containerName="kube-apiserver-check-endpoints" Mar 16 15:35:11 crc kubenswrapper[5120]: I0316 15:35:11.403435 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="3a14caf222afb62aaabdc47808b6f944" containerName="kube-apiserver-check-endpoints" Mar 16 15:35:11 crc kubenswrapper[5120]: I0316 15:35:11.405906 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-log\" (UniqueName: \"kubernetes.io/host-path/f7dbc7e1ee9c187a863ef9b473fad27b-var-log\") pod \"kube-apiserver-startup-monitor-crc\" (UID: \"f7dbc7e1ee9c187a863ef9b473fad27b\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-crc" Mar 16 15:35:11 crc kubenswrapper[5120]: I0316 15:35:11.406930 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/f7dbc7e1ee9c187a863ef9b473fad27b-var-lock\") pod \"kube-apiserver-startup-monitor-crc\" (UID: \"f7dbc7e1ee9c187a863ef9b473fad27b\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-crc" Mar 16 15:35:11 crc kubenswrapper[5120]: I0316 15:35:11.407014 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/f7dbc7e1ee9c187a863ef9b473fad27b-resource-dir\") pod \"kube-apiserver-startup-monitor-crc\" (UID: \"f7dbc7e1ee9c187a863ef9b473fad27b\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-crc" Mar 16 15:35:11 crc kubenswrapper[5120]: I0316 15:35:11.407557 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pod-resource-dir\" (UniqueName: \"kubernetes.io/host-path/f7dbc7e1ee9c187a863ef9b473fad27b-pod-resource-dir\") pod \"kube-apiserver-startup-monitor-crc\" (UID: \"f7dbc7e1ee9c187a863ef9b473fad27b\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-crc" Mar 16 15:35:11 crc kubenswrapper[5120]: I0316 15:35:11.407609 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/host-path/f7dbc7e1ee9c187a863ef9b473fad27b-manifests\") pod \"kube-apiserver-startup-monitor-crc\" (UID: \"f7dbc7e1ee9c187a863ef9b473fad27b\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-crc" Mar 16 15:35:11 crc kubenswrapper[5120]: I0316 15:35:11.512441 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/57755cc5f99000cc11e193051474d4e2-resource-dir\") pod \"kube-apiserver-crc\" (UID: \"57755cc5f99000cc11e193051474d4e2\") " pod="openshift-kube-apiserver/kube-apiserver-crc" Mar 16 15:35:11 crc kubenswrapper[5120]: I0316 15:35:11.512876 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/57755cc5f99000cc11e193051474d4e2-audit-dir\") pod \"kube-apiserver-crc\" (UID: \"57755cc5f99000cc11e193051474d4e2\") " pod="openshift-kube-apiserver/kube-apiserver-crc" Mar 16 15:35:11 crc kubenswrapper[5120]: I0316 15:35:11.512961 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-log\" (UniqueName: \"kubernetes.io/host-path/f7dbc7e1ee9c187a863ef9b473fad27b-var-log\") pod \"kube-apiserver-startup-monitor-crc\" (UID: \"f7dbc7e1ee9c187a863ef9b473fad27b\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-crc" Mar 16 15:35:11 crc kubenswrapper[5120]: I0316 15:35:11.513020 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/f7dbc7e1ee9c187a863ef9b473fad27b-var-lock\") pod \"kube-apiserver-startup-monitor-crc\" (UID: \"f7dbc7e1ee9c187a863ef9b473fad27b\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-crc" Mar 16 15:35:11 crc kubenswrapper[5120]: I0316 15:35:11.513051 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/57755cc5f99000cc11e193051474d4e2-cert-dir\") pod \"kube-apiserver-crc\" (UID: \"57755cc5f99000cc11e193051474d4e2\") " pod="openshift-kube-apiserver/kube-apiserver-crc" Mar 16 15:35:11 crc kubenswrapper[5120]: I0316 15:35:11.513171 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-bundle-dir\" (UniqueName: \"kubernetes.io/empty-dir/57755cc5f99000cc11e193051474d4e2-ca-bundle-dir\") pod \"kube-apiserver-crc\" (UID: \"57755cc5f99000cc11e193051474d4e2\") " pod="openshift-kube-apiserver/kube-apiserver-crc" Mar 16 15:35:11 crc kubenswrapper[5120]: I0316 15:35:11.513221 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/f7dbc7e1ee9c187a863ef9b473fad27b-resource-dir\") pod \"kube-apiserver-startup-monitor-crc\" (UID: \"f7dbc7e1ee9c187a863ef9b473fad27b\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-crc" Mar 16 15:35:11 crc kubenswrapper[5120]: I0316 15:35:11.513301 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pod-resource-dir\" (UniqueName: \"kubernetes.io/host-path/f7dbc7e1ee9c187a863ef9b473fad27b-pod-resource-dir\") pod \"kube-apiserver-startup-monitor-crc\" (UID: \"f7dbc7e1ee9c187a863ef9b473fad27b\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-crc" Mar 16 15:35:11 crc kubenswrapper[5120]: I0316 15:35:11.513341 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/host-path/f7dbc7e1ee9c187a863ef9b473fad27b-manifests\") pod \"kube-apiserver-startup-monitor-crc\" (UID: \"f7dbc7e1ee9c187a863ef9b473fad27b\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-crc" Mar 16 15:35:11 crc kubenswrapper[5120]: I0316 15:35:11.513398 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/57755cc5f99000cc11e193051474d4e2-tmp-dir\") pod \"kube-apiserver-crc\" (UID: \"57755cc5f99000cc11e193051474d4e2\") " pod="openshift-kube-apiserver/kube-apiserver-crc" Mar 16 15:35:11 crc kubenswrapper[5120]: I0316 15:35:11.513551 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-log\" (UniqueName: \"kubernetes.io/host-path/f7dbc7e1ee9c187a863ef9b473fad27b-var-log\") pod \"kube-apiserver-startup-monitor-crc\" (UID: \"f7dbc7e1ee9c187a863ef9b473fad27b\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-crc" Mar 16 15:35:11 crc kubenswrapper[5120]: I0316 15:35:11.513602 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/f7dbc7e1ee9c187a863ef9b473fad27b-var-lock\") pod \"kube-apiserver-startup-monitor-crc\" (UID: \"f7dbc7e1ee9c187a863ef9b473fad27b\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-crc" Mar 16 15:35:11 crc kubenswrapper[5120]: I0316 15:35:11.513655 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/f7dbc7e1ee9c187a863ef9b473fad27b-resource-dir\") pod \"kube-apiserver-startup-monitor-crc\" (UID: \"f7dbc7e1ee9c187a863ef9b473fad27b\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-crc" Mar 16 15:35:11 crc kubenswrapper[5120]: I0316 15:35:11.513695 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pod-resource-dir\" (UniqueName: \"kubernetes.io/host-path/f7dbc7e1ee9c187a863ef9b473fad27b-pod-resource-dir\") pod \"kube-apiserver-startup-monitor-crc\" (UID: \"f7dbc7e1ee9c187a863ef9b473fad27b\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-crc" Mar 16 15:35:11 crc kubenswrapper[5120]: I0316 15:35:11.513739 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/host-path/f7dbc7e1ee9c187a863ef9b473fad27b-manifests\") pod \"kube-apiserver-startup-monitor-crc\" (UID: \"f7dbc7e1ee9c187a863ef9b473fad27b\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-crc" Mar 16 15:35:11 crc kubenswrapper[5120]: I0316 15:35:11.614491 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/57755cc5f99000cc11e193051474d4e2-resource-dir\") pod \"kube-apiserver-crc\" (UID: \"57755cc5f99000cc11e193051474d4e2\") " pod="openshift-kube-apiserver/kube-apiserver-crc" Mar 16 15:35:11 crc kubenswrapper[5120]: I0316 15:35:11.614555 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/57755cc5f99000cc11e193051474d4e2-audit-dir\") pod \"kube-apiserver-crc\" (UID: \"57755cc5f99000cc11e193051474d4e2\") " pod="openshift-kube-apiserver/kube-apiserver-crc" Mar 16 15:35:11 crc kubenswrapper[5120]: I0316 15:35:11.614651 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/57755cc5f99000cc11e193051474d4e2-audit-dir\") pod \"kube-apiserver-crc\" (UID: \"57755cc5f99000cc11e193051474d4e2\") " pod="openshift-kube-apiserver/kube-apiserver-crc" Mar 16 15:35:11 crc kubenswrapper[5120]: I0316 15:35:11.614687 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/57755cc5f99000cc11e193051474d4e2-cert-dir\") pod \"kube-apiserver-crc\" (UID: \"57755cc5f99000cc11e193051474d4e2\") " pod="openshift-kube-apiserver/kube-apiserver-crc" Mar 16 15:35:11 crc kubenswrapper[5120]: I0316 15:35:11.614818 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/57755cc5f99000cc11e193051474d4e2-cert-dir\") pod \"kube-apiserver-crc\" (UID: \"57755cc5f99000cc11e193051474d4e2\") " pod="openshift-kube-apiserver/kube-apiserver-crc" Mar 16 15:35:11 crc kubenswrapper[5120]: I0316 15:35:11.614879 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-bundle-dir\" (UniqueName: \"kubernetes.io/empty-dir/57755cc5f99000cc11e193051474d4e2-ca-bundle-dir\") pod \"kube-apiserver-crc\" (UID: \"57755cc5f99000cc11e193051474d4e2\") " pod="openshift-kube-apiserver/kube-apiserver-crc" Mar 16 15:35:11 crc kubenswrapper[5120]: I0316 15:35:11.615249 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/57755cc5f99000cc11e193051474d4e2-tmp-dir\") pod \"kube-apiserver-crc\" (UID: \"57755cc5f99000cc11e193051474d4e2\") " pod="openshift-kube-apiserver/kube-apiserver-crc" Mar 16 15:35:11 crc kubenswrapper[5120]: I0316 15:35:11.615384 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/57755cc5f99000cc11e193051474d4e2-resource-dir\") pod \"kube-apiserver-crc\" (UID: \"57755cc5f99000cc11e193051474d4e2\") " pod="openshift-kube-apiserver/kube-apiserver-crc" Mar 16 15:35:11 crc kubenswrapper[5120]: I0316 15:35:11.615546 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-bundle-dir\" (UniqueName: \"kubernetes.io/empty-dir/57755cc5f99000cc11e193051474d4e2-ca-bundle-dir\") pod \"kube-apiserver-crc\" (UID: \"57755cc5f99000cc11e193051474d4e2\") " pod="openshift-kube-apiserver/kube-apiserver-crc" Mar 16 15:35:11 crc kubenswrapper[5120]: I0316 15:35:11.615826 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/57755cc5f99000cc11e193051474d4e2-tmp-dir\") pod \"kube-apiserver-crc\" (UID: \"57755cc5f99000cc11e193051474d4e2\") " pod="openshift-kube-apiserver/kube-apiserver-crc" Mar 16 15:35:11 crc kubenswrapper[5120]: I0316 15:35:11.679189 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-crc" Mar 16 15:35:11 crc kubenswrapper[5120]: E0316 15:35:11.712568 5120 event.go:368] "Unable to write event (may retry after sleeping)" err="Post \"https://api-int.crc.testing:6443/api/v1/namespaces/openshift-kube-apiserver/events\": dial tcp 38.102.83.119:6443: connect: connection refused" event="&Event{ObjectMeta:{kube-apiserver-startup-monitor-crc.189d5c4c7572dab9 openshift-kube-apiserver 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-apiserver,Name:kube-apiserver-startup-monitor-crc,UID:f7dbc7e1ee9c187a863ef9b473fad27b,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{startup-monitor},},Reason:Pulled,Message:Container image \"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\" already present on machine,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:35:11.711574713 +0000 UTC m=+213.865506370,LastTimestamp:2026-03-16 15:35:11.711574713 +0000 UTC m=+213.865506370,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 15:35:11 crc kubenswrapper[5120]: I0316 15:35:11.912975 5120 patch_prober.go:28] interesting pod/kube-apiserver-crc container/kube-apiserver namespace/openshift-kube-apiserver: Readiness probe status=failure output="Get \"https://192.168.126.11:6443/readyz\": dial tcp 192.168.126.11:6443: connect: connection refused" start-of-body= Mar 16 15:35:11 crc kubenswrapper[5120]: I0316 15:35:11.913050 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-kube-apiserver/kube-apiserver-crc" podUID="3a14caf222afb62aaabdc47808b6f944" containerName="kube-apiserver" probeResult="failure" output="Get \"https://192.168.126.11:6443/readyz\": dial tcp 192.168.126.11:6443: connect: connection refused" Mar 16 15:35:12 crc kubenswrapper[5120]: I0316 15:35:12.223050 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_kube-apiserver-crc_3a14caf222afb62aaabdc47808b6f944/kube-apiserver-check-endpoints/3.log" Mar 16 15:35:12 crc kubenswrapper[5120]: I0316 15:35:12.225067 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_kube-apiserver-crc_3a14caf222afb62aaabdc47808b6f944/kube-apiserver-cert-syncer/0.log" Mar 16 15:35:12 crc kubenswrapper[5120]: I0316 15:35:12.226023 5120 generic.go:358] "Generic (PLEG): container finished" podID="3a14caf222afb62aaabdc47808b6f944" containerID="3f2b9043857355dd12ad0ca2395ba7e066dc75d7974ef24c8ccde5468b617654" exitCode=0 Mar 16 15:35:12 crc kubenswrapper[5120]: I0316 15:35:12.226073 5120 generic.go:358] "Generic (PLEG): container finished" podID="3a14caf222afb62aaabdc47808b6f944" containerID="93d46439f5f39d1e67f6df04e1bfc9dfc0f6d7fcdf6fbe4cce94455dd460c163" exitCode=0 Mar 16 15:35:12 crc kubenswrapper[5120]: I0316 15:35:12.226091 5120 generic.go:358] "Generic (PLEG): container finished" podID="3a14caf222afb62aaabdc47808b6f944" containerID="2927b83983005f4c3d99da754665655d8138a8e829cf2b9274040dfbec74fab7" exitCode=0 Mar 16 15:35:12 crc kubenswrapper[5120]: I0316 15:35:12.226109 5120 generic.go:358] "Generic (PLEG): container finished" podID="3a14caf222afb62aaabdc47808b6f944" containerID="28d3d4773246e29999a9a1edc877e703ed6476a59e6aef47ac34c6a3991c767a" exitCode=2 Mar 16 15:35:12 crc kubenswrapper[5120]: I0316 15:35:12.226141 5120 scope.go:117] "RemoveContainer" containerID="2e9f531a9c0fc8cf5222ce7e135c4f37d008306df727f84312cc5d7d2c740ac6" Mar 16 15:35:12 crc kubenswrapper[5120]: I0316 15:35:12.247849 5120 generic.go:358] "Generic (PLEG): container finished" podID="01b7113a-6a9e-45f9-ab3a-bbf513f83e0a" containerID="9525bd9b1df306f86781c5c5427ca51fdb32a6994da02f312fbbb50b87df9b57" exitCode=0 Mar 16 15:35:12 crc kubenswrapper[5120]: I0316 15:35:12.247944 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/installer-12-crc" event={"ID":"01b7113a-6a9e-45f9-ab3a-bbf513f83e0a","Type":"ContainerDied","Data":"9525bd9b1df306f86781c5c5427ca51fdb32a6994da02f312fbbb50b87df9b57"} Mar 16 15:35:12 crc kubenswrapper[5120]: I0316 15:35:12.248900 5120 status_manager.go:895] "Failed to get status for pod" podUID="3a14caf222afb62aaabdc47808b6f944" pod="openshift-kube-apiserver/kube-apiserver-crc" err="Get \"https://api-int.crc.testing:6443/api/v1/namespaces/openshift-kube-apiserver/pods/kube-apiserver-crc\": dial tcp 38.102.83.119:6443: connect: connection refused" Mar 16 15:35:12 crc kubenswrapper[5120]: I0316 15:35:12.249242 5120 status_manager.go:895] "Failed to get status for pod" podUID="f7dbc7e1ee9c187a863ef9b473fad27b" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-crc" err="Get \"https://api-int.crc.testing:6443/api/v1/namespaces/openshift-kube-apiserver/pods/kube-apiserver-startup-monitor-crc\": dial tcp 38.102.83.119:6443: connect: connection refused" Mar 16 15:35:12 crc kubenswrapper[5120]: I0316 15:35:12.249680 5120 status_manager.go:895] "Failed to get status for pod" podUID="01b7113a-6a9e-45f9-ab3a-bbf513f83e0a" pod="openshift-kube-apiserver/installer-12-crc" err="Get \"https://api-int.crc.testing:6443/api/v1/namespaces/openshift-kube-apiserver/pods/installer-12-crc\": dial tcp 38.102.83.119:6443: connect: connection refused" Mar 16 15:35:12 crc kubenswrapper[5120]: I0316 15:35:12.250585 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-crc" event={"ID":"f7dbc7e1ee9c187a863ef9b473fad27b","Type":"ContainerStarted","Data":"994025f80c53555a31b86b46214226b6430e599bfe1ed84444168cefdf25050e"} Mar 16 15:35:12 crc kubenswrapper[5120]: I0316 15:35:12.250627 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-crc" event={"ID":"f7dbc7e1ee9c187a863ef9b473fad27b","Type":"ContainerStarted","Data":"3410dfa9e1b3bcf8b337e51e5030a08a79923d66ff10ded64c556841ac23921c"} Mar 16 15:35:12 crc kubenswrapper[5120]: I0316 15:35:12.251924 5120 status_manager.go:895] "Failed to get status for pod" podUID="3a14caf222afb62aaabdc47808b6f944" pod="openshift-kube-apiserver/kube-apiserver-crc" err="Get \"https://api-int.crc.testing:6443/api/v1/namespaces/openshift-kube-apiserver/pods/kube-apiserver-crc\": dial tcp 38.102.83.119:6443: connect: connection refused" Mar 16 15:35:12 crc kubenswrapper[5120]: I0316 15:35:12.252311 5120 status_manager.go:895] "Failed to get status for pod" podUID="f7dbc7e1ee9c187a863ef9b473fad27b" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-crc" err="Get \"https://api-int.crc.testing:6443/api/v1/namespaces/openshift-kube-apiserver/pods/kube-apiserver-startup-monitor-crc\": dial tcp 38.102.83.119:6443: connect: connection refused" Mar 16 15:35:12 crc kubenswrapper[5120]: I0316 15:35:12.252694 5120 status_manager.go:895] "Failed to get status for pod" podUID="01b7113a-6a9e-45f9-ab3a-bbf513f83e0a" pod="openshift-kube-apiserver/installer-12-crc" err="Get \"https://api-int.crc.testing:6443/api/v1/namespaces/openshift-kube-apiserver/pods/installer-12-crc\": dial tcp 38.102.83.119:6443: connect: connection refused" Mar 16 15:35:12 crc kubenswrapper[5120]: E0316 15:35:12.670204 5120 desired_state_of_world_populator.go:305] "Error processing volume" err="error processing PVC openshift-image-registry/crc-image-registry-storage: failed to fetch PVC from API server: Get \"https://api-int.crc.testing:6443/api/v1/namespaces/openshift-image-registry/persistentvolumeclaims/crc-image-registry-storage\": dial tcp 38.102.83.119:6443: connect: connection refused" pod="openshift-image-registry/image-registry-66587d64c8-blgcz" volumeName="registry-storage" Mar 16 15:35:12 crc kubenswrapper[5120]: E0316 15:35:12.852397 5120 controller.go:195] "Failed to update lease" err="Put \"https://api-int.crc.testing:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/crc?timeout=10s\": dial tcp 38.102.83.119:6443: connect: connection refused" Mar 16 15:35:12 crc kubenswrapper[5120]: E0316 15:35:12.853792 5120 controller.go:195] "Failed to update lease" err="Put \"https://api-int.crc.testing:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/crc?timeout=10s\": dial tcp 38.102.83.119:6443: connect: connection refused" Mar 16 15:35:12 crc kubenswrapper[5120]: E0316 15:35:12.854337 5120 controller.go:195] "Failed to update lease" err="Put \"https://api-int.crc.testing:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/crc?timeout=10s\": dial tcp 38.102.83.119:6443: connect: connection refused" Mar 16 15:35:12 crc kubenswrapper[5120]: E0316 15:35:12.854967 5120 controller.go:195] "Failed to update lease" err="Put \"https://api-int.crc.testing:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/crc?timeout=10s\": dial tcp 38.102.83.119:6443: connect: connection refused" Mar 16 15:35:12 crc kubenswrapper[5120]: E0316 15:35:12.855550 5120 controller.go:195] "Failed to update lease" err="Put \"https://api-int.crc.testing:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/crc?timeout=10s\": dial tcp 38.102.83.119:6443: connect: connection refused" Mar 16 15:35:12 crc kubenswrapper[5120]: I0316 15:35:12.855600 5120 controller.go:115] "failed to update lease using latest lease, fallback to ensure lease" err="failed 5 attempts to update lease" Mar 16 15:35:12 crc kubenswrapper[5120]: E0316 15:35:12.856174 5120 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.crc.testing:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/crc?timeout=10s\": dial tcp 38.102.83.119:6443: connect: connection refused" interval="200ms" Mar 16 15:35:13 crc kubenswrapper[5120]: E0316 15:35:13.057063 5120 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.crc.testing:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/crc?timeout=10s\": dial tcp 38.102.83.119:6443: connect: connection refused" interval="400ms" Mar 16 15:35:13 crc kubenswrapper[5120]: I0316 15:35:13.260205 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_kube-apiserver-crc_3a14caf222afb62aaabdc47808b6f944/kube-apiserver-cert-syncer/0.log" Mar 16 15:35:13 crc kubenswrapper[5120]: E0316 15:35:13.467517 5120 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.crc.testing:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/crc?timeout=10s\": dial tcp 38.102.83.119:6443: connect: connection refused" interval="800ms" Mar 16 15:35:13 crc kubenswrapper[5120]: I0316 15:35:13.611789 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/installer-12-crc" Mar 16 15:35:13 crc kubenswrapper[5120]: I0316 15:35:13.612372 5120 status_manager.go:895] "Failed to get status for pod" podUID="01b7113a-6a9e-45f9-ab3a-bbf513f83e0a" pod="openshift-kube-apiserver/installer-12-crc" err="Get \"https://api-int.crc.testing:6443/api/v1/namespaces/openshift-kube-apiserver/pods/installer-12-crc\": dial tcp 38.102.83.119:6443: connect: connection refused" Mar 16 15:35:13 crc kubenswrapper[5120]: I0316 15:35:13.612707 5120 status_manager.go:895] "Failed to get status for pod" podUID="f7dbc7e1ee9c187a863ef9b473fad27b" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-crc" err="Get \"https://api-int.crc.testing:6443/api/v1/namespaces/openshift-kube-apiserver/pods/kube-apiserver-startup-monitor-crc\": dial tcp 38.102.83.119:6443: connect: connection refused" Mar 16 15:35:13 crc kubenswrapper[5120]: I0316 15:35:13.761476 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/01b7113a-6a9e-45f9-ab3a-bbf513f83e0a-kubelet-dir\") pod \"01b7113a-6a9e-45f9-ab3a-bbf513f83e0a\" (UID: \"01b7113a-6a9e-45f9-ab3a-bbf513f83e0a\") " Mar 16 15:35:13 crc kubenswrapper[5120]: I0316 15:35:13.761540 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/01b7113a-6a9e-45f9-ab3a-bbf513f83e0a-kube-api-access\") pod \"01b7113a-6a9e-45f9-ab3a-bbf513f83e0a\" (UID: \"01b7113a-6a9e-45f9-ab3a-bbf513f83e0a\") " Mar 16 15:35:13 crc kubenswrapper[5120]: I0316 15:35:13.761584 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/01b7113a-6a9e-45f9-ab3a-bbf513f83e0a-var-lock\") pod \"01b7113a-6a9e-45f9-ab3a-bbf513f83e0a\" (UID: \"01b7113a-6a9e-45f9-ab3a-bbf513f83e0a\") " Mar 16 15:35:13 crc kubenswrapper[5120]: I0316 15:35:13.761671 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/01b7113a-6a9e-45f9-ab3a-bbf513f83e0a-kubelet-dir" (OuterVolumeSpecName: "kubelet-dir") pod "01b7113a-6a9e-45f9-ab3a-bbf513f83e0a" (UID: "01b7113a-6a9e-45f9-ab3a-bbf513f83e0a"). InnerVolumeSpecName "kubelet-dir". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 15:35:13 crc kubenswrapper[5120]: I0316 15:35:13.761716 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/01b7113a-6a9e-45f9-ab3a-bbf513f83e0a-var-lock" (OuterVolumeSpecName: "var-lock") pod "01b7113a-6a9e-45f9-ab3a-bbf513f83e0a" (UID: "01b7113a-6a9e-45f9-ab3a-bbf513f83e0a"). InnerVolumeSpecName "var-lock". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 15:35:13 crc kubenswrapper[5120]: I0316 15:35:13.762516 5120 reconciler_common.go:299] "Volume detached for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/01b7113a-6a9e-45f9-ab3a-bbf513f83e0a-var-lock\") on node \"crc\" DevicePath \"\"" Mar 16 15:35:13 crc kubenswrapper[5120]: I0316 15:35:13.762554 5120 reconciler_common.go:299] "Volume detached for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/01b7113a-6a9e-45f9-ab3a-bbf513f83e0a-kubelet-dir\") on node \"crc\" DevicePath \"\"" Mar 16 15:35:13 crc kubenswrapper[5120]: I0316 15:35:13.769453 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01b7113a-6a9e-45f9-ab3a-bbf513f83e0a-kube-api-access" (OuterVolumeSpecName: "kube-api-access") pod "01b7113a-6a9e-45f9-ab3a-bbf513f83e0a" (UID: "01b7113a-6a9e-45f9-ab3a-bbf513f83e0a"). InnerVolumeSpecName "kube-api-access". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:35:13 crc kubenswrapper[5120]: I0316 15:35:13.790116 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_kube-apiserver-crc_3a14caf222afb62aaabdc47808b6f944/kube-apiserver-cert-syncer/0.log" Mar 16 15:35:13 crc kubenswrapper[5120]: I0316 15:35:13.790836 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/kube-apiserver-crc" Mar 16 15:35:13 crc kubenswrapper[5120]: I0316 15:35:13.791810 5120 status_manager.go:895] "Failed to get status for pod" podUID="01b7113a-6a9e-45f9-ab3a-bbf513f83e0a" pod="openshift-kube-apiserver/installer-12-crc" err="Get \"https://api-int.crc.testing:6443/api/v1/namespaces/openshift-kube-apiserver/pods/installer-12-crc\": dial tcp 38.102.83.119:6443: connect: connection refused" Mar 16 15:35:13 crc kubenswrapper[5120]: I0316 15:35:13.792228 5120 status_manager.go:895] "Failed to get status for pod" podUID="3a14caf222afb62aaabdc47808b6f944" pod="openshift-kube-apiserver/kube-apiserver-crc" err="Get \"https://api-int.crc.testing:6443/api/v1/namespaces/openshift-kube-apiserver/pods/kube-apiserver-crc\": dial tcp 38.102.83.119:6443: connect: connection refused" Mar 16 15:35:13 crc kubenswrapper[5120]: I0316 15:35:13.792631 5120 status_manager.go:895] "Failed to get status for pod" podUID="f7dbc7e1ee9c187a863ef9b473fad27b" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-crc" err="Get \"https://api-int.crc.testing:6443/api/v1/namespaces/openshift-kube-apiserver/pods/kube-apiserver-startup-monitor-crc\": dial tcp 38.102.83.119:6443: connect: connection refused" Mar 16 15:35:13 crc kubenswrapper[5120]: I0316 15:35:13.863499 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/01b7113a-6a9e-45f9-ab3a-bbf513f83e0a-kube-api-access\") on node \"crc\" DevicePath \"\"" Mar 16 15:35:13 crc kubenswrapper[5120]: I0316 15:35:13.965432 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a14caf222afb62aaabdc47808b6f944-tmp-dir\") pod \"3a14caf222afb62aaabdc47808b6f944\" (UID: \"3a14caf222afb62aaabdc47808b6f944\") " Mar 16 15:35:13 crc kubenswrapper[5120]: I0316 15:35:13.965501 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/3a14caf222afb62aaabdc47808b6f944-audit-dir\") pod \"3a14caf222afb62aaabdc47808b6f944\" (UID: \"3a14caf222afb62aaabdc47808b6f944\") " Mar 16 15:35:13 crc kubenswrapper[5120]: I0316 15:35:13.965591 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/3a14caf222afb62aaabdc47808b6f944-cert-dir\") pod \"3a14caf222afb62aaabdc47808b6f944\" (UID: \"3a14caf222afb62aaabdc47808b6f944\") " Mar 16 15:35:13 crc kubenswrapper[5120]: I0316 15:35:13.965636 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/3a14caf222afb62aaabdc47808b6f944-resource-dir\") pod \"3a14caf222afb62aaabdc47808b6f944\" (UID: \"3a14caf222afb62aaabdc47808b6f944\") " Mar 16 15:35:13 crc kubenswrapper[5120]: I0316 15:35:13.965708 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/3a14caf222afb62aaabdc47808b6f944-cert-dir" (OuterVolumeSpecName: "cert-dir") pod "3a14caf222afb62aaabdc47808b6f944" (UID: "3a14caf222afb62aaabdc47808b6f944"). InnerVolumeSpecName "cert-dir". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 15:35:13 crc kubenswrapper[5120]: I0316 15:35:13.965720 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-bundle-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a14caf222afb62aaabdc47808b6f944-ca-bundle-dir\") pod \"3a14caf222afb62aaabdc47808b6f944\" (UID: \"3a14caf222afb62aaabdc47808b6f944\") " Mar 16 15:35:13 crc kubenswrapper[5120]: I0316 15:35:13.965738 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/3a14caf222afb62aaabdc47808b6f944-audit-dir" (OuterVolumeSpecName: "audit-dir") pod "3a14caf222afb62aaabdc47808b6f944" (UID: "3a14caf222afb62aaabdc47808b6f944"). InnerVolumeSpecName "audit-dir". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 15:35:13 crc kubenswrapper[5120]: I0316 15:35:13.965890 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/3a14caf222afb62aaabdc47808b6f944-resource-dir" (OuterVolumeSpecName: "resource-dir") pod "3a14caf222afb62aaabdc47808b6f944" (UID: "3a14caf222afb62aaabdc47808b6f944"). InnerVolumeSpecName "resource-dir". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 15:35:13 crc kubenswrapper[5120]: I0316 15:35:13.966413 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a14caf222afb62aaabdc47808b6f944-ca-bundle-dir" (OuterVolumeSpecName: "ca-bundle-dir") pod "3a14caf222afb62aaabdc47808b6f944" (UID: "3a14caf222afb62aaabdc47808b6f944"). InnerVolumeSpecName "ca-bundle-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:35:13 crc kubenswrapper[5120]: I0316 15:35:13.966663 5120 reconciler_common.go:299] "Volume detached for volume \"ca-bundle-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a14caf222afb62aaabdc47808b6f944-ca-bundle-dir\") on node \"crc\" DevicePath \"\"" Mar 16 15:35:13 crc kubenswrapper[5120]: I0316 15:35:13.966703 5120 reconciler_common.go:299] "Volume detached for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/3a14caf222afb62aaabdc47808b6f944-audit-dir\") on node \"crc\" DevicePath \"\"" Mar 16 15:35:13 crc kubenswrapper[5120]: I0316 15:35:13.966724 5120 reconciler_common.go:299] "Volume detached for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/3a14caf222afb62aaabdc47808b6f944-cert-dir\") on node \"crc\" DevicePath \"\"" Mar 16 15:35:13 crc kubenswrapper[5120]: I0316 15:35:13.966741 5120 reconciler_common.go:299] "Volume detached for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/3a14caf222afb62aaabdc47808b6f944-resource-dir\") on node \"crc\" DevicePath \"\"" Mar 16 15:35:13 crc kubenswrapper[5120]: I0316 15:35:13.969099 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a14caf222afb62aaabdc47808b6f944-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "3a14caf222afb62aaabdc47808b6f944" (UID: "3a14caf222afb62aaabdc47808b6f944"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:35:14 crc kubenswrapper[5120]: I0316 15:35:14.068576 5120 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a14caf222afb62aaabdc47808b6f944-tmp-dir\") on node \"crc\" DevicePath \"\"" Mar 16 15:35:14 crc kubenswrapper[5120]: E0316 15:35:14.269087 5120 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.crc.testing:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/crc?timeout=10s\": dial tcp 38.102.83.119:6443: connect: connection refused" interval="1.6s" Mar 16 15:35:14 crc kubenswrapper[5120]: I0316 15:35:14.270237 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/installer-12-crc" Mar 16 15:35:14 crc kubenswrapper[5120]: I0316 15:35:14.270224 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/installer-12-crc" event={"ID":"01b7113a-6a9e-45f9-ab3a-bbf513f83e0a","Type":"ContainerDied","Data":"35170cfeff3b73982f409700b12eb142e31cb34c36b340a9ee24bd63660fa4ea"} Mar 16 15:35:14 crc kubenswrapper[5120]: I0316 15:35:14.270390 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="35170cfeff3b73982f409700b12eb142e31cb34c36b340a9ee24bd63660fa4ea" Mar 16 15:35:14 crc kubenswrapper[5120]: I0316 15:35:14.275885 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_kube-apiserver-crc_3a14caf222afb62aaabdc47808b6f944/kube-apiserver-cert-syncer/0.log" Mar 16 15:35:14 crc kubenswrapper[5120]: I0316 15:35:14.277154 5120 generic.go:358] "Generic (PLEG): container finished" podID="3a14caf222afb62aaabdc47808b6f944" containerID="508f48da0745e92959e2d1557a5130e812920972548cfb726debf24c10a91ceb" exitCode=0 Mar 16 15:35:14 crc kubenswrapper[5120]: I0316 15:35:14.277234 5120 scope.go:117] "RemoveContainer" containerID="3f2b9043857355dd12ad0ca2395ba7e066dc75d7974ef24c8ccde5468b617654" Mar 16 15:35:14 crc kubenswrapper[5120]: I0316 15:35:14.277367 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/kube-apiserver-crc" Mar 16 15:35:14 crc kubenswrapper[5120]: I0316 15:35:14.290036 5120 status_manager.go:895] "Failed to get status for pod" podUID="3a14caf222afb62aaabdc47808b6f944" pod="openshift-kube-apiserver/kube-apiserver-crc" err="Get \"https://api-int.crc.testing:6443/api/v1/namespaces/openshift-kube-apiserver/pods/kube-apiserver-crc\": dial tcp 38.102.83.119:6443: connect: connection refused" Mar 16 15:35:14 crc kubenswrapper[5120]: I0316 15:35:14.291179 5120 status_manager.go:895] "Failed to get status for pod" podUID="f7dbc7e1ee9c187a863ef9b473fad27b" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-crc" err="Get \"https://api-int.crc.testing:6443/api/v1/namespaces/openshift-kube-apiserver/pods/kube-apiserver-startup-monitor-crc\": dial tcp 38.102.83.119:6443: connect: connection refused" Mar 16 15:35:14 crc kubenswrapper[5120]: I0316 15:35:14.291644 5120 status_manager.go:895] "Failed to get status for pod" podUID="01b7113a-6a9e-45f9-ab3a-bbf513f83e0a" pod="openshift-kube-apiserver/installer-12-crc" err="Get \"https://api-int.crc.testing:6443/api/v1/namespaces/openshift-kube-apiserver/pods/installer-12-crc\": dial tcp 38.102.83.119:6443: connect: connection refused" Mar 16 15:35:14 crc kubenswrapper[5120]: I0316 15:35:14.301649 5120 scope.go:117] "RemoveContainer" containerID="93d46439f5f39d1e67f6df04e1bfc9dfc0f6d7fcdf6fbe4cce94455dd460c163" Mar 16 15:35:14 crc kubenswrapper[5120]: I0316 15:35:14.307484 5120 status_manager.go:895] "Failed to get status for pod" podUID="3a14caf222afb62aaabdc47808b6f944" pod="openshift-kube-apiserver/kube-apiserver-crc" err="Get \"https://api-int.crc.testing:6443/api/v1/namespaces/openshift-kube-apiserver/pods/kube-apiserver-crc\": dial tcp 38.102.83.119:6443: connect: connection refused" Mar 16 15:35:14 crc kubenswrapper[5120]: I0316 15:35:14.307954 5120 status_manager.go:895] "Failed to get status for pod" podUID="f7dbc7e1ee9c187a863ef9b473fad27b" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-crc" err="Get \"https://api-int.crc.testing:6443/api/v1/namespaces/openshift-kube-apiserver/pods/kube-apiserver-startup-monitor-crc\": dial tcp 38.102.83.119:6443: connect: connection refused" Mar 16 15:35:14 crc kubenswrapper[5120]: I0316 15:35:14.308563 5120 status_manager.go:895] "Failed to get status for pod" podUID="01b7113a-6a9e-45f9-ab3a-bbf513f83e0a" pod="openshift-kube-apiserver/installer-12-crc" err="Get \"https://api-int.crc.testing:6443/api/v1/namespaces/openshift-kube-apiserver/pods/installer-12-crc\": dial tcp 38.102.83.119:6443: connect: connection refused" Mar 16 15:35:14 crc kubenswrapper[5120]: I0316 15:35:14.327613 5120 scope.go:117] "RemoveContainer" containerID="2927b83983005f4c3d99da754665655d8138a8e829cf2b9274040dfbec74fab7" Mar 16 15:35:14 crc kubenswrapper[5120]: I0316 15:35:14.346079 5120 scope.go:117] "RemoveContainer" containerID="28d3d4773246e29999a9a1edc877e703ed6476a59e6aef47ac34c6a3991c767a" Mar 16 15:35:14 crc kubenswrapper[5120]: I0316 15:35:14.369960 5120 scope.go:117] "RemoveContainer" containerID="508f48da0745e92959e2d1557a5130e812920972548cfb726debf24c10a91ceb" Mar 16 15:35:14 crc kubenswrapper[5120]: I0316 15:35:14.393892 5120 scope.go:117] "RemoveContainer" containerID="b85427f55ef682dd2d839958175c21c7ee85dae9155481cb4532b8d60f907179" Mar 16 15:35:14 crc kubenswrapper[5120]: I0316 15:35:14.461949 5120 scope.go:117] "RemoveContainer" containerID="3f2b9043857355dd12ad0ca2395ba7e066dc75d7974ef24c8ccde5468b617654" Mar 16 15:35:14 crc kubenswrapper[5120]: E0316 15:35:14.462563 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f2b9043857355dd12ad0ca2395ba7e066dc75d7974ef24c8ccde5468b617654\": container with ID starting with 3f2b9043857355dd12ad0ca2395ba7e066dc75d7974ef24c8ccde5468b617654 not found: ID does not exist" containerID="3f2b9043857355dd12ad0ca2395ba7e066dc75d7974ef24c8ccde5468b617654" Mar 16 15:35:14 crc kubenswrapper[5120]: I0316 15:35:14.462633 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f2b9043857355dd12ad0ca2395ba7e066dc75d7974ef24c8ccde5468b617654"} err="failed to get container status \"3f2b9043857355dd12ad0ca2395ba7e066dc75d7974ef24c8ccde5468b617654\": rpc error: code = NotFound desc = could not find container \"3f2b9043857355dd12ad0ca2395ba7e066dc75d7974ef24c8ccde5468b617654\": container with ID starting with 3f2b9043857355dd12ad0ca2395ba7e066dc75d7974ef24c8ccde5468b617654 not found: ID does not exist" Mar 16 15:35:14 crc kubenswrapper[5120]: I0316 15:35:14.462747 5120 scope.go:117] "RemoveContainer" containerID="93d46439f5f39d1e67f6df04e1bfc9dfc0f6d7fcdf6fbe4cce94455dd460c163" Mar 16 15:35:14 crc kubenswrapper[5120]: E0316 15:35:14.463334 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93d46439f5f39d1e67f6df04e1bfc9dfc0f6d7fcdf6fbe4cce94455dd460c163\": container with ID starting with 93d46439f5f39d1e67f6df04e1bfc9dfc0f6d7fcdf6fbe4cce94455dd460c163 not found: ID does not exist" containerID="93d46439f5f39d1e67f6df04e1bfc9dfc0f6d7fcdf6fbe4cce94455dd460c163" Mar 16 15:35:14 crc kubenswrapper[5120]: I0316 15:35:14.463371 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93d46439f5f39d1e67f6df04e1bfc9dfc0f6d7fcdf6fbe4cce94455dd460c163"} err="failed to get container status \"93d46439f5f39d1e67f6df04e1bfc9dfc0f6d7fcdf6fbe4cce94455dd460c163\": rpc error: code = NotFound desc = could not find container \"93d46439f5f39d1e67f6df04e1bfc9dfc0f6d7fcdf6fbe4cce94455dd460c163\": container with ID starting with 93d46439f5f39d1e67f6df04e1bfc9dfc0f6d7fcdf6fbe4cce94455dd460c163 not found: ID does not exist" Mar 16 15:35:14 crc kubenswrapper[5120]: I0316 15:35:14.463398 5120 scope.go:117] "RemoveContainer" containerID="2927b83983005f4c3d99da754665655d8138a8e829cf2b9274040dfbec74fab7" Mar 16 15:35:14 crc kubenswrapper[5120]: E0316 15:35:14.463819 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2927b83983005f4c3d99da754665655d8138a8e829cf2b9274040dfbec74fab7\": container with ID starting with 2927b83983005f4c3d99da754665655d8138a8e829cf2b9274040dfbec74fab7 not found: ID does not exist" containerID="2927b83983005f4c3d99da754665655d8138a8e829cf2b9274040dfbec74fab7" Mar 16 15:35:14 crc kubenswrapper[5120]: I0316 15:35:14.463884 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2927b83983005f4c3d99da754665655d8138a8e829cf2b9274040dfbec74fab7"} err="failed to get container status \"2927b83983005f4c3d99da754665655d8138a8e829cf2b9274040dfbec74fab7\": rpc error: code = NotFound desc = could not find container \"2927b83983005f4c3d99da754665655d8138a8e829cf2b9274040dfbec74fab7\": container with ID starting with 2927b83983005f4c3d99da754665655d8138a8e829cf2b9274040dfbec74fab7 not found: ID does not exist" Mar 16 15:35:14 crc kubenswrapper[5120]: I0316 15:35:14.463907 5120 scope.go:117] "RemoveContainer" containerID="28d3d4773246e29999a9a1edc877e703ed6476a59e6aef47ac34c6a3991c767a" Mar 16 15:35:14 crc kubenswrapper[5120]: E0316 15:35:14.464279 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"28d3d4773246e29999a9a1edc877e703ed6476a59e6aef47ac34c6a3991c767a\": container with ID starting with 28d3d4773246e29999a9a1edc877e703ed6476a59e6aef47ac34c6a3991c767a not found: ID does not exist" containerID="28d3d4773246e29999a9a1edc877e703ed6476a59e6aef47ac34c6a3991c767a" Mar 16 15:35:14 crc kubenswrapper[5120]: I0316 15:35:14.464308 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28d3d4773246e29999a9a1edc877e703ed6476a59e6aef47ac34c6a3991c767a"} err="failed to get container status \"28d3d4773246e29999a9a1edc877e703ed6476a59e6aef47ac34c6a3991c767a\": rpc error: code = NotFound desc = could not find container \"28d3d4773246e29999a9a1edc877e703ed6476a59e6aef47ac34c6a3991c767a\": container with ID starting with 28d3d4773246e29999a9a1edc877e703ed6476a59e6aef47ac34c6a3991c767a not found: ID does not exist" Mar 16 15:35:14 crc kubenswrapper[5120]: I0316 15:35:14.464324 5120 scope.go:117] "RemoveContainer" containerID="508f48da0745e92959e2d1557a5130e812920972548cfb726debf24c10a91ceb" Mar 16 15:35:14 crc kubenswrapper[5120]: E0316 15:35:14.464672 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"508f48da0745e92959e2d1557a5130e812920972548cfb726debf24c10a91ceb\": container with ID starting with 508f48da0745e92959e2d1557a5130e812920972548cfb726debf24c10a91ceb not found: ID does not exist" containerID="508f48da0745e92959e2d1557a5130e812920972548cfb726debf24c10a91ceb" Mar 16 15:35:14 crc kubenswrapper[5120]: I0316 15:35:14.464722 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"508f48da0745e92959e2d1557a5130e812920972548cfb726debf24c10a91ceb"} err="failed to get container status \"508f48da0745e92959e2d1557a5130e812920972548cfb726debf24c10a91ceb\": rpc error: code = NotFound desc = could not find container \"508f48da0745e92959e2d1557a5130e812920972548cfb726debf24c10a91ceb\": container with ID starting with 508f48da0745e92959e2d1557a5130e812920972548cfb726debf24c10a91ceb not found: ID does not exist" Mar 16 15:35:14 crc kubenswrapper[5120]: I0316 15:35:14.464752 5120 scope.go:117] "RemoveContainer" containerID="b85427f55ef682dd2d839958175c21c7ee85dae9155481cb4532b8d60f907179" Mar 16 15:35:14 crc kubenswrapper[5120]: E0316 15:35:14.465122 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b85427f55ef682dd2d839958175c21c7ee85dae9155481cb4532b8d60f907179\": container with ID starting with b85427f55ef682dd2d839958175c21c7ee85dae9155481cb4532b8d60f907179 not found: ID does not exist" containerID="b85427f55ef682dd2d839958175c21c7ee85dae9155481cb4532b8d60f907179" Mar 16 15:35:14 crc kubenswrapper[5120]: I0316 15:35:14.465150 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b85427f55ef682dd2d839958175c21c7ee85dae9155481cb4532b8d60f907179"} err="failed to get container status \"b85427f55ef682dd2d839958175c21c7ee85dae9155481cb4532b8d60f907179\": rpc error: code = NotFound desc = could not find container \"b85427f55ef682dd2d839958175c21c7ee85dae9155481cb4532b8d60f907179\": container with ID starting with b85427f55ef682dd2d839958175c21c7ee85dae9155481cb4532b8d60f907179 not found: ID does not exist" Mar 16 15:35:14 crc kubenswrapper[5120]: I0316 15:35:14.674062 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3a14caf222afb62aaabdc47808b6f944" path="/var/lib/kubelet/pods/3a14caf222afb62aaabdc47808b6f944/volumes" Mar 16 15:35:15 crc kubenswrapper[5120]: E0316 15:35:15.870784 5120 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.crc.testing:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/crc?timeout=10s\": dial tcp 38.102.83.119:6443: connect: connection refused" interval="3.2s" Mar 16 15:35:18 crc kubenswrapper[5120]: I0316 15:35:18.670477 5120 status_manager.go:895] "Failed to get status for pod" podUID="01b7113a-6a9e-45f9-ab3a-bbf513f83e0a" pod="openshift-kube-apiserver/installer-12-crc" err="Get \"https://api-int.crc.testing:6443/api/v1/namespaces/openshift-kube-apiserver/pods/installer-12-crc\": dial tcp 38.102.83.119:6443: connect: connection refused" Mar 16 15:35:18 crc kubenswrapper[5120]: I0316 15:35:18.671452 5120 status_manager.go:895] "Failed to get status for pod" podUID="f7dbc7e1ee9c187a863ef9b473fad27b" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-crc" err="Get \"https://api-int.crc.testing:6443/api/v1/namespaces/openshift-kube-apiserver/pods/kube-apiserver-startup-monitor-crc\": dial tcp 38.102.83.119:6443: connect: connection refused" Mar 16 15:35:19 crc kubenswrapper[5120]: E0316 15:35:19.072048 5120 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.crc.testing:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/crc?timeout=10s\": dial tcp 38.102.83.119:6443: connect: connection refused" interval="6.4s" Mar 16 15:35:20 crc kubenswrapper[5120]: E0316 15:35:20.990563 5120 event.go:368] "Unable to write event (may retry after sleeping)" err="Post \"https://api-int.crc.testing:6443/api/v1/namespaces/openshift-kube-apiserver/events\": dial tcp 38.102.83.119:6443: connect: connection refused" event="&Event{ObjectMeta:{kube-apiserver-startup-monitor-crc.189d5c4c7572dab9 openshift-kube-apiserver 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-apiserver,Name:kube-apiserver-startup-monitor-crc,UID:f7dbc7e1ee9c187a863ef9b473fad27b,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{startup-monitor},},Reason:Pulled,Message:Container image \"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\" already present on machine,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 15:35:11.711574713 +0000 UTC m=+213.865506370,LastTimestamp:2026-03-16 15:35:11.711574713 +0000 UTC m=+213.865506370,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 15:35:22 crc kubenswrapper[5120]: I0316 15:35:22.007909 5120 patch_prober.go:28] interesting pod/machine-config-daemon-7bf76 container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 15:35:22 crc kubenswrapper[5120]: I0316 15:35:22.008073 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 15:35:22 crc kubenswrapper[5120]: I0316 15:35:22.670823 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/kube-apiserver-crc" Mar 16 15:35:22 crc kubenswrapper[5120]: I0316 15:35:22.671854 5120 status_manager.go:895] "Failed to get status for pod" podUID="f7dbc7e1ee9c187a863ef9b473fad27b" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-crc" err="Get \"https://api-int.crc.testing:6443/api/v1/namespaces/openshift-kube-apiserver/pods/kube-apiserver-startup-monitor-crc\": dial tcp 38.102.83.119:6443: connect: connection refused" Mar 16 15:35:22 crc kubenswrapper[5120]: I0316 15:35:22.672405 5120 status_manager.go:895] "Failed to get status for pod" podUID="01b7113a-6a9e-45f9-ab3a-bbf513f83e0a" pod="openshift-kube-apiserver/installer-12-crc" err="Get \"https://api-int.crc.testing:6443/api/v1/namespaces/openshift-kube-apiserver/pods/installer-12-crc\": dial tcp 38.102.83.119:6443: connect: connection refused" Mar 16 15:35:22 crc kubenswrapper[5120]: I0316 15:35:22.694693 5120 kubelet.go:3323] "Trying to delete pod" pod="openshift-kube-apiserver/kube-apiserver-crc" podUID="22864c11-0263-4519-b00f-08aec3cacee5" Mar 16 15:35:22 crc kubenswrapper[5120]: I0316 15:35:22.694728 5120 mirror_client.go:130] "Deleting a mirror pod" pod="openshift-kube-apiserver/kube-apiserver-crc" podUID="22864c11-0263-4519-b00f-08aec3cacee5" Mar 16 15:35:22 crc kubenswrapper[5120]: E0316 15:35:22.695239 5120 mirror_client.go:138] "Failed deleting a mirror pod" err="Delete \"https://api-int.crc.testing:6443/api/v1/namespaces/openshift-kube-apiserver/pods/kube-apiserver-crc\": dial tcp 38.102.83.119:6443: connect: connection refused" pod="openshift-kube-apiserver/kube-apiserver-crc" Mar 16 15:35:22 crc kubenswrapper[5120]: I0316 15:35:22.695655 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/kube-apiserver-crc" Mar 16 15:35:22 crc kubenswrapper[5120]: W0316 15:35:22.721385 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57755cc5f99000cc11e193051474d4e2.slice/crio-4402c38586117461a0456132bbe2af628e06242ebc4e625ede4c172d62f5d6bc WatchSource:0}: Error finding container 4402c38586117461a0456132bbe2af628e06242ebc4e625ede4c172d62f5d6bc: Status 404 returned error can't find the container with id 4402c38586117461a0456132bbe2af628e06242ebc4e625ede4c172d62f5d6bc Mar 16 15:35:23 crc kubenswrapper[5120]: I0316 15:35:23.342802 5120 generic.go:358] "Generic (PLEG): container finished" podID="57755cc5f99000cc11e193051474d4e2" containerID="25f6c0aaa5d1e2283141866bad102686f9cc69899bac94f0ebdab2a0a7203ba6" exitCode=0 Mar 16 15:35:23 crc kubenswrapper[5120]: I0316 15:35:23.343023 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-crc" event={"ID":"57755cc5f99000cc11e193051474d4e2","Type":"ContainerDied","Data":"25f6c0aaa5d1e2283141866bad102686f9cc69899bac94f0ebdab2a0a7203ba6"} Mar 16 15:35:23 crc kubenswrapper[5120]: I0316 15:35:23.343337 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-crc" event={"ID":"57755cc5f99000cc11e193051474d4e2","Type":"ContainerStarted","Data":"4402c38586117461a0456132bbe2af628e06242ebc4e625ede4c172d62f5d6bc"} Mar 16 15:35:23 crc kubenswrapper[5120]: I0316 15:35:23.343797 5120 kubelet.go:3323] "Trying to delete pod" pod="openshift-kube-apiserver/kube-apiserver-crc" podUID="22864c11-0263-4519-b00f-08aec3cacee5" Mar 16 15:35:23 crc kubenswrapper[5120]: I0316 15:35:23.343821 5120 mirror_client.go:130] "Deleting a mirror pod" pod="openshift-kube-apiserver/kube-apiserver-crc" podUID="22864c11-0263-4519-b00f-08aec3cacee5" Mar 16 15:35:23 crc kubenswrapper[5120]: I0316 15:35:23.344167 5120 status_manager.go:895] "Failed to get status for pod" podUID="01b7113a-6a9e-45f9-ab3a-bbf513f83e0a" pod="openshift-kube-apiserver/installer-12-crc" err="Get \"https://api-int.crc.testing:6443/api/v1/namespaces/openshift-kube-apiserver/pods/installer-12-crc\": dial tcp 38.102.83.119:6443: connect: connection refused" Mar 16 15:35:23 crc kubenswrapper[5120]: E0316 15:35:23.344236 5120 mirror_client.go:138] "Failed deleting a mirror pod" err="Delete \"https://api-int.crc.testing:6443/api/v1/namespaces/openshift-kube-apiserver/pods/kube-apiserver-crc\": dial tcp 38.102.83.119:6443: connect: connection refused" pod="openshift-kube-apiserver/kube-apiserver-crc" Mar 16 15:35:23 crc kubenswrapper[5120]: I0316 15:35:23.344352 5120 status_manager.go:895] "Failed to get status for pod" podUID="f7dbc7e1ee9c187a863ef9b473fad27b" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-crc" err="Get \"https://api-int.crc.testing:6443/api/v1/namespaces/openshift-kube-apiserver/pods/kube-apiserver-startup-monitor-crc\": dial tcp 38.102.83.119:6443: connect: connection refused" Mar 16 15:35:24 crc kubenswrapper[5120]: I0316 15:35:24.371236 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-crc_9f0bc7fcb0822a2c13eb2d22cd8c0641/kube-controller-manager/0.log" Mar 16 15:35:24 crc kubenswrapper[5120]: I0316 15:35:24.371535 5120 generic.go:358] "Generic (PLEG): container finished" podID="9f0bc7fcb0822a2c13eb2d22cd8c0641" containerID="7504f5643c014a761ba3788ec0c344d41885c45fe4371d4a1c8d206eb7462303" exitCode=1 Mar 16 15:35:24 crc kubenswrapper[5120]: I0316 15:35:24.371639 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/kube-controller-manager-crc" event={"ID":"9f0bc7fcb0822a2c13eb2d22cd8c0641","Type":"ContainerDied","Data":"7504f5643c014a761ba3788ec0c344d41885c45fe4371d4a1c8d206eb7462303"} Mar 16 15:35:24 crc kubenswrapper[5120]: I0316 15:35:24.372195 5120 scope.go:117] "RemoveContainer" containerID="7504f5643c014a761ba3788ec0c344d41885c45fe4371d4a1c8d206eb7462303" Mar 16 15:35:24 crc kubenswrapper[5120]: I0316 15:35:24.375511 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-crc" event={"ID":"57755cc5f99000cc11e193051474d4e2","Type":"ContainerStarted","Data":"b5a4c54b85c043b011160e47b3a01d41bfe8e7b65bfcd6dfa63e3ef294b75420"} Mar 16 15:35:24 crc kubenswrapper[5120]: I0316 15:35:24.375553 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-crc" event={"ID":"57755cc5f99000cc11e193051474d4e2","Type":"ContainerStarted","Data":"24336007c64b9f215e37c43bb90284609f956d7d58169e33c7d986c673717cf3"} Mar 16 15:35:24 crc kubenswrapper[5120]: I0316 15:35:24.375571 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-crc" event={"ID":"57755cc5f99000cc11e193051474d4e2","Type":"ContainerStarted","Data":"1f01274ab1ba26f0f1ff872fb28e02a4235a4501c4496120a2b3075f3c2c585b"} Mar 16 15:35:24 crc kubenswrapper[5120]: I0316 15:35:24.375581 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-crc" event={"ID":"57755cc5f99000cc11e193051474d4e2","Type":"ContainerStarted","Data":"1dd6b8a6b1d96d91e5b2236b24be81546a41afd48073080e9a27a03201664d31"} Mar 16 15:35:25 crc kubenswrapper[5120]: I0316 15:35:25.385783 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-crc_9f0bc7fcb0822a2c13eb2d22cd8c0641/kube-controller-manager/0.log" Mar 16 15:35:25 crc kubenswrapper[5120]: I0316 15:35:25.386154 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/kube-controller-manager-crc" event={"ID":"9f0bc7fcb0822a2c13eb2d22cd8c0641","Type":"ContainerStarted","Data":"5cfb0a089ba9efa2f6c2a82a4daa81311b9d4d148aaee6da1b451f07a125f24d"} Mar 16 15:35:25 crc kubenswrapper[5120]: I0316 15:35:25.389720 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-crc" event={"ID":"57755cc5f99000cc11e193051474d4e2","Type":"ContainerStarted","Data":"1f8c0ba12b5d47d644350163a8b817ae98e89b4f1339cf251ae2ecf27d7ce0ea"} Mar 16 15:35:25 crc kubenswrapper[5120]: I0316 15:35:25.389828 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-kube-apiserver/kube-apiserver-crc" Mar 16 15:35:25 crc kubenswrapper[5120]: I0316 15:35:25.389861 5120 kubelet.go:3323] "Trying to delete pod" pod="openshift-kube-apiserver/kube-apiserver-crc" podUID="22864c11-0263-4519-b00f-08aec3cacee5" Mar 16 15:35:25 crc kubenswrapper[5120]: I0316 15:35:25.389878 5120 mirror_client.go:130] "Deleting a mirror pod" pod="openshift-kube-apiserver/kube-apiserver-crc" podUID="22864c11-0263-4519-b00f-08aec3cacee5" Mar 16 15:35:27 crc kubenswrapper[5120]: I0316 15:35:27.696377 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-kube-apiserver/kube-apiserver-crc" Mar 16 15:35:27 crc kubenswrapper[5120]: I0316 15:35:27.696707 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-kube-apiserver/kube-apiserver-crc" Mar 16 15:35:27 crc kubenswrapper[5120]: I0316 15:35:27.706229 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-kube-apiserver/kube-apiserver-crc" Mar 16 15:35:29 crc kubenswrapper[5120]: I0316 15:35:29.591754 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-kube-controller-manager/kube-controller-manager-crc" Mar 16 15:35:30 crc kubenswrapper[5120]: I0316 15:35:30.399334 5120 kubelet.go:3329] "Deleted mirror pod as it didn't match the static Pod" pod="openshift-kube-apiserver/kube-apiserver-crc" Mar 16 15:35:30 crc kubenswrapper[5120]: I0316 15:35:30.399372 5120 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-kube-apiserver/kube-apiserver-crc" Mar 16 15:35:30 crc kubenswrapper[5120]: I0316 15:35:30.447711 5120 kubelet.go:3323] "Trying to delete pod" pod="openshift-kube-apiserver/kube-apiserver-crc" podUID="22864c11-0263-4519-b00f-08aec3cacee5" Mar 16 15:35:30 crc kubenswrapper[5120]: I0316 15:35:30.447787 5120 mirror_client.go:130] "Deleting a mirror pod" pod="openshift-kube-apiserver/kube-apiserver-crc" podUID="22864c11-0263-4519-b00f-08aec3cacee5" Mar 16 15:35:30 crc kubenswrapper[5120]: I0316 15:35:30.452358 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-kube-apiserver/kube-apiserver-crc" Mar 16 15:35:30 crc kubenswrapper[5120]: I0316 15:35:30.455402 5120 status_manager.go:905] "Pod was deleted and then recreated, skipping status update" pod="openshift-kube-apiserver/kube-apiserver-crc" oldPodUID="57755cc5f99000cc11e193051474d4e2" podUID="937d3f41-8369-4996-ac01-82480eed29c2" Mar 16 15:35:31 crc kubenswrapper[5120]: I0316 15:35:31.453219 5120 kubelet.go:3323] "Trying to delete pod" pod="openshift-kube-apiserver/kube-apiserver-crc" podUID="22864c11-0263-4519-b00f-08aec3cacee5" Mar 16 15:35:31 crc kubenswrapper[5120]: I0316 15:35:31.453674 5120 mirror_client.go:130] "Deleting a mirror pod" pod="openshift-kube-apiserver/kube-apiserver-crc" podUID="22864c11-0263-4519-b00f-08aec3cacee5" Mar 16 15:35:34 crc kubenswrapper[5120]: I0316 15:35:34.100235 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-kube-controller-manager/kube-controller-manager-crc" Mar 16 15:35:34 crc kubenswrapper[5120]: I0316 15:35:34.110996 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-kube-controller-manager/kube-controller-manager-crc" Mar 16 15:35:34 crc kubenswrapper[5120]: I0316 15:35:34.488633 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-kube-controller-manager/kube-controller-manager-crc" Mar 16 15:35:37 crc kubenswrapper[5120]: I0316 15:35:37.684328 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-apiserver-operator\"/\"openshift-apiserver-operator-dockercfg-6c46w\"" Mar 16 15:35:37 crc kubenswrapper[5120]: I0316 15:35:37.728074 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-authentication\"/\"v4-0-config-system-session\"" Mar 16 15:35:38 crc kubenswrapper[5120]: I0316 15:35:38.700449 5120 status_manager.go:905] "Pod was deleted and then recreated, skipping status update" pod="openshift-kube-apiserver/kube-apiserver-crc" oldPodUID="57755cc5f99000cc11e193051474d4e2" podUID="937d3f41-8369-4996-ac01-82480eed29c2" Mar 16 15:35:38 crc kubenswrapper[5120]: I0316 15:35:38.757422 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-controller-manager\"/\"client-ca\"" Mar 16 15:35:38 crc kubenswrapper[5120]: I0316 15:35:38.938128 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Mar 16 15:35:39 crc kubenswrapper[5120]: I0316 15:35:39.185801 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-config-operator\"/\"openshift-config-operator-dockercfg-sjn6s\"" Mar 16 15:35:39 crc kubenswrapper[5120]: I0316 15:35:39.574348 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Mar 16 15:35:39 crc kubenswrapper[5120]: I0316 15:35:39.735179 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-scheduler-operator\"/\"openshift-kube-scheduler-operator-config\"" Mar 16 15:35:40 crc kubenswrapper[5120]: I0316 15:35:40.517292 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-scheduler-operator\"/\"kube-root-ca.crt\"" Mar 16 15:35:40 crc kubenswrapper[5120]: I0316 15:35:40.684318 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Mar 16 15:35:40 crc kubenswrapper[5120]: I0316 15:35:40.811005 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-authentication-operator\"/\"serving-cert\"" Mar 16 15:35:40 crc kubenswrapper[5120]: I0316 15:35:40.939381 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Mar 16 15:35:41 crc kubenswrapper[5120]: I0316 15:35:41.506981 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-machine-config-operator\"/\"machine-config-operator-dockercfg-sw6nc\"" Mar 16 15:35:41 crc kubenswrapper[5120]: I0316 15:35:41.835847 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Mar 16 15:35:42 crc kubenswrapper[5120]: I0316 15:35:42.174977 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Mar 16 15:35:42 crc kubenswrapper[5120]: I0316 15:35:42.496968 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-apiserver-operator\"/\"openshift-apiserver-operator-serving-cert\"" Mar 16 15:35:42 crc kubenswrapper[5120]: I0316 15:35:42.520434 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Mar 16 15:35:42 crc kubenswrapper[5120]: I0316 15:35:42.573088 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-oauth-apiserver\"/\"trusted-ca-bundle\"" Mar 16 15:35:42 crc kubenswrapper[5120]: I0316 15:35:42.587699 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Mar 16 15:35:42 crc kubenswrapper[5120]: I0316 15:35:42.698817 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-machine-api\"/\"kube-root-ca.crt\"" Mar 16 15:35:42 crc kubenswrapper[5120]: I0316 15:35:42.825169 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-apiserver-operator\"/\"kube-apiserver-operator-dockercfg-bf7fj\"" Mar 16 15:35:42 crc kubenswrapper[5120]: I0316 15:35:42.979082 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-machine-approver\"/\"machine-approver-config\"" Mar 16 15:35:43 crc kubenswrapper[5120]: I0316 15:35:43.182927 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-tk7bt\"" Mar 16 15:35:43 crc kubenswrapper[5120]: I0316 15:35:43.223512 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Mar 16 15:35:43 crc kubenswrapper[5120]: I0316 15:35:43.257168 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-apiserver-operator\"/\"kube-apiserver-operator-config\"" Mar 16 15:35:43 crc kubenswrapper[5120]: I0316 15:35:43.438453 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-apiserver\"/\"image-import-ca\"" Mar 16 15:35:43 crc kubenswrapper[5120]: I0316 15:35:43.505942 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-oauth-apiserver\"/\"openshift-service-ca.crt\"" Mar 16 15:35:43 crc kubenswrapper[5120]: I0316 15:35:43.653932 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-operator\"/\"metrics-tls\"" Mar 16 15:35:43 crc kubenswrapper[5120]: I0316 15:35:43.738153 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-authentication-operator\"/\"authentication-operator-dockercfg-6tbpn\"" Mar 16 15:35:43 crc kubenswrapper[5120]: I0316 15:35:43.830240 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-admission-controller-secret\"" Mar 16 15:35:43 crc kubenswrapper[5120]: I0316 15:35:43.920748 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-tjs74\"" Mar 16 15:35:44 crc kubenswrapper[5120]: I0316 15:35:44.014703 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Mar 16 15:35:44 crc kubenswrapper[5120]: I0316 15:35:44.033285 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-apiserver-operator\"/\"openshift-apiserver-operator-config\"" Mar 16 15:35:44 crc kubenswrapper[5120]: I0316 15:35:44.035229 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Mar 16 15:35:44 crc kubenswrapper[5120]: I0316 15:35:44.107316 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-machine-config-operator\"/\"openshift-service-ca.crt\"" Mar 16 15:35:44 crc kubenswrapper[5120]: I0316 15:35:44.116537 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-apiserver\"/\"openshift-service-ca.crt\"" Mar 16 15:35:44 crc kubenswrapper[5120]: I0316 15:35:44.158485 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-version\"/\"openshift-service-ca.crt\"" Mar 16 15:35:44 crc kubenswrapper[5120]: I0316 15:35:44.285522 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operator-lifecycle-manager\"/\"packageserver-service-cert\"" Mar 16 15:35:44 crc kubenswrapper[5120]: I0316 15:35:44.519582 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-machine-config-operator\"/\"mcc-proxy-tls\"" Mar 16 15:35:44 crc kubenswrapper[5120]: I0316 15:35:44.727065 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-t8n29\"" Mar 16 15:35:44 crc kubenswrapper[5120]: I0316 15:35:44.864505 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operator-lifecycle-manager\"/\"catalog-operator-serving-cert\"" Mar 16 15:35:45 crc kubenswrapper[5120]: I0316 15:35:45.104618 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-controller-manager\"/\"kube-root-ca.crt\"" Mar 16 15:35:45 crc kubenswrapper[5120]: I0316 15:35:45.191515 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-apiserver\"/\"serving-cert\"" Mar 16 15:35:45 crc kubenswrapper[5120]: I0316 15:35:45.508003 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-machine-approver\"/\"machine-approver-sa-dockercfg-wzhvk\"" Mar 16 15:35:45 crc kubenswrapper[5120]: I0316 15:35:45.908931 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-etcd-operator\"/\"kube-root-ca.crt\"" Mar 16 15:35:45 crc kubenswrapper[5120]: I0316 15:35:45.935134 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-authentication-operator\"/\"authentication-operator-config\"" Mar 16 15:35:45 crc kubenswrapper[5120]: I0316 15:35:45.938933 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-etcd-operator\"/\"openshift-service-ca.crt\"" Mar 16 15:35:46 crc kubenswrapper[5120]: I0316 15:35:46.244897 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-route-controller-manager\"/\"client-ca\"" Mar 16 15:35:46 crc kubenswrapper[5120]: I0316 15:35:46.254524 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-route-controller-manager\"/\"route-controller-manager-sa-dockercfg-mmcpt\"" Mar 16 15:35:46 crc kubenswrapper[5120]: I0316 15:35:46.376349 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-machine-api\"/\"machine-api-operator-dockercfg-6n5ln\"" Mar 16 15:35:46 crc kubenswrapper[5120]: I0316 15:35:46.531128 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-apiserver\"/\"etcd-client\"" Mar 16 15:35:46 crc kubenswrapper[5120]: I0316 15:35:46.560079 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-nwglk\"" Mar 16 15:35:46 crc kubenswrapper[5120]: I0316 15:35:46.617152 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Mar 16 15:35:46 crc kubenswrapper[5120]: I0316 15:35:46.703208 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-controller-manager-operator\"/\"kube-controller-manager-operator-dockercfg-tnfx9\"" Mar 16 15:35:46 crc kubenswrapper[5120]: I0316 15:35:46.720210 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-node-identity\"/\"ovnkube-identity-cm\"" Mar 16 15:35:46 crc kubenswrapper[5120]: I0316 15:35:46.727041 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Mar 16 15:35:46 crc kubenswrapper[5120]: I0316 15:35:46.763249 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Mar 16 15:35:46 crc kubenswrapper[5120]: I0316 15:35:46.784529 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-controller-manager\"/\"openshift-service-ca.crt\"" Mar 16 15:35:47 crc kubenswrapper[5120]: I0316 15:35:47.086588 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-controller-manager-operator\"/\"kube-controller-manager-operator-serving-cert\"" Mar 16 15:35:47 crc kubenswrapper[5120]: I0316 15:35:47.166381 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-authentication\"/\"v4-0-config-system-router-certs\"" Mar 16 15:35:47 crc kubenswrapper[5120]: I0316 15:35:47.257927 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-controller-manager\"/\"openshift-controller-manager-sa-dockercfg-djmfg\"" Mar 16 15:35:47 crc kubenswrapper[5120]: I0316 15:35:47.264271 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-apiserver-operator\"/\"openshift-service-ca.crt\"" Mar 16 15:35:47 crc kubenswrapper[5120]: I0316 15:35:47.277598 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-scheduler-operator\"/\"kube-scheduler-operator-serving-cert\"" Mar 16 15:35:47 crc kubenswrapper[5120]: I0316 15:35:47.287905 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-controller-manager-operator\"/\"kube-root-ca.crt\"" Mar 16 15:35:47 crc kubenswrapper[5120]: I0316 15:35:47.322510 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-etcd-operator\"/\"etcd-operator-dockercfg-4vdnc\"" Mar 16 15:35:47 crc kubenswrapper[5120]: I0316 15:35:47.353944 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-apiserver\"/\"encryption-config-1\"" Mar 16 15:35:47 crc kubenswrapper[5120]: I0316 15:35:47.603687 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-operator\"/\"kube-root-ca.crt\"" Mar 16 15:35:47 crc kubenswrapper[5120]: I0316 15:35:47.628381 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-config-operator\"/\"openshift-service-ca.crt\"" Mar 16 15:35:47 crc kubenswrapper[5120]: I0316 15:35:47.642810 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-l2v2m\"" Mar 16 15:35:47 crc kubenswrapper[5120]: I0316 15:35:47.704152 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-2h6bs\"" Mar 16 15:35:47 crc kubenswrapper[5120]: I0316 15:35:47.766555 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-control-plane-metrics-cert\"" Mar 16 15:35:47 crc kubenswrapper[5120]: I0316 15:35:47.775631 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-authentication\"/\"v4-0-config-user-template-login\"" Mar 16 15:35:47 crc kubenswrapper[5120]: I0316 15:35:47.808002 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-authentication-operator\"/\"kube-root-ca.crt\"" Mar 16 15:35:47 crc kubenswrapper[5120]: I0316 15:35:47.906055 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-config-operator\"/\"kube-root-ca.crt\"" Mar 16 15:35:47 crc kubenswrapper[5120]: I0316 15:35:47.915874 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-operator\"/\"openshift-service-ca.crt\"" Mar 16 15:35:47 crc kubenswrapper[5120]: I0316 15:35:47.943882 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Mar 16 15:35:47 crc kubenswrapper[5120]: I0316 15:35:47.944883 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"hostpath-provisioner\"/\"kube-root-ca.crt\"" Mar 16 15:35:47 crc kubenswrapper[5120]: I0316 15:35:47.950979 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-authentication-operator\"/\"trusted-ca-bundle\"" Mar 16 15:35:47 crc kubenswrapper[5120]: I0316 15:35:47.971724 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-kknhg\"" Mar 16 15:35:48 crc kubenswrapper[5120]: I0316 15:35:48.159000 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-machine-approver\"/\"kube-root-ca.crt\"" Mar 16 15:35:48 crc kubenswrapper[5120]: I0316 15:35:48.161922 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-kw8fx\"" Mar 16 15:35:48 crc kubenswrapper[5120]: I0316 15:35:48.175571 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-machine-approver\"/\"openshift-service-ca.crt\"" Mar 16 15:35:48 crc kubenswrapper[5120]: I0316 15:35:48.220207 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-route-controller-manager\"/\"serving-cert\"" Mar 16 15:35:48 crc kubenswrapper[5120]: I0316 15:35:48.237040 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-machine-config-operator\"/\"machine-config-controller-dockercfg-xnj77\"" Mar 16 15:35:48 crc kubenswrapper[5120]: I0316 15:35:48.248722 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"metrics-tls\"" Mar 16 15:35:48 crc kubenswrapper[5120]: I0316 15:35:48.251253 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-controller-manager-operator\"/\"openshift-controller-manager-operator-dockercfg-jcmfj\"" Mar 16 15:35:48 crc kubenswrapper[5120]: I0316 15:35:48.286618 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operator-lifecycle-manager\"/\"package-server-manager-serving-cert\"" Mar 16 15:35:48 crc kubenswrapper[5120]: I0316 15:35:48.320576 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Mar 16 15:35:48 crc kubenswrapper[5120]: I0316 15:35:48.407355 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-machine-config-operator\"/\"mco-proxy-tls\"" Mar 16 15:35:48 crc kubenswrapper[5120]: I0316 15:35:48.417924 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Mar 16 15:35:48 crc kubenswrapper[5120]: I0316 15:35:48.497093 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Mar 16 15:35:48 crc kubenswrapper[5120]: I0316 15:35:48.506448 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns-operator\"/\"metrics-tls\"" Mar 16 15:35:48 crc kubenswrapper[5120]: I0316 15:35:48.506734 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Mar 16 15:35:48 crc kubenswrapper[5120]: I0316 15:35:48.537130 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-machine-config-operator\"/\"node-bootstrapper-token\"" Mar 16 15:35:48 crc kubenswrapper[5120]: I0316 15:35:48.588304 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-controller-manager-operator\"/\"openshift-service-ca.crt\"" Mar 16 15:35:48 crc kubenswrapper[5120]: I0316 15:35:48.590274 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Mar 16 15:35:48 crc kubenswrapper[5120]: I0316 15:35:48.609741 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-machine-config-operator\"/\"kube-root-ca.crt\"" Mar 16 15:35:48 crc kubenswrapper[5120]: I0316 15:35:48.670374 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Mar 16 15:35:48 crc kubenswrapper[5120]: I0316 15:35:48.671206 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-machine-api\"/\"control-plane-machine-set-operator-tls\"" Mar 16 15:35:48 crc kubenswrapper[5120]: I0316 15:35:48.837804 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"marketplace-operator-metrics\"" Mar 16 15:35:48 crc kubenswrapper[5120]: I0316 15:35:48.901578 5120 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Mar 16 15:35:48 crc kubenswrapper[5120]: I0316 15:35:48.922183 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-mdwwj\"" Mar 16 15:35:48 crc kubenswrapper[5120]: I0316 15:35:48.922509 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Mar 16 15:35:48 crc kubenswrapper[5120]: I0316 15:35:48.929299 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-operator\"/\"ingress-operator-dockercfg-74nwh\"" Mar 16 15:35:48 crc kubenswrapper[5120]: I0316 15:35:48.945110 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns-operator\"/\"openshift-service-ca.crt\"" Mar 16 15:35:49 crc kubenswrapper[5120]: I0316 15:35:49.004968 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Mar 16 15:35:49 crc kubenswrapper[5120]: I0316 15:35:49.027975 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-etcd-operator\"/\"etcd-service-ca-bundle\"" Mar 16 15:35:49 crc kubenswrapper[5120]: I0316 15:35:49.096272 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-node-identity\"/\"env-overrides\"" Mar 16 15:35:49 crc kubenswrapper[5120]: I0316 15:35:49.141699 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Mar 16 15:35:49 crc kubenswrapper[5120]: I0316 15:35:49.230849 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-authentication\"/\"audit\"" Mar 16 15:35:49 crc kubenswrapper[5120]: I0316 15:35:49.237297 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-etcd-operator\"/\"etcd-client\"" Mar 16 15:35:49 crc kubenswrapper[5120]: I0316 15:35:49.392385 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operator-lifecycle-manager\"/\"olm-operator-serving-cert\"" Mar 16 15:35:49 crc kubenswrapper[5120]: I0316 15:35:49.601256 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-jmhxf\"" Mar 16 15:35:49 crc kubenswrapper[5120]: I0316 15:35:49.604651 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Mar 16 15:35:49 crc kubenswrapper[5120]: I0316 15:35:49.616925 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-oauth-apiserver\"/\"oauth-apiserver-sa-dockercfg-qqw4z\"" Mar 16 15:35:49 crc kubenswrapper[5120]: I0316 15:35:49.633260 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Mar 16 15:35:49 crc kubenswrapper[5120]: I0316 15:35:49.688985 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Mar 16 15:35:49 crc kubenswrapper[5120]: I0316 15:35:49.798291 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-machine-api\"/\"control-plane-machine-set-operator-dockercfg-gnx66\"" Mar 16 15:35:49 crc kubenswrapper[5120]: I0316 15:35:49.812471 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-oauth-apiserver\"/\"encryption-config-1\"" Mar 16 15:35:49 crc kubenswrapper[5120]: I0316 15:35:49.884750 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-etcd-operator\"/\"etcd-ca-bundle\"" Mar 16 15:35:49 crc kubenswrapper[5120]: I0316 15:35:49.926004 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-operator-tls\"" Mar 16 15:35:49 crc kubenswrapper[5120]: I0316 15:35:49.973496 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Mar 16 15:35:49 crc kubenswrapper[5120]: I0316 15:35:49.982318 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-authentication\"/\"oauth-openshift-dockercfg-d2bf2\"" Mar 16 15:35:50 crc kubenswrapper[5120]: I0316 15:35:50.102498 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-authentication-operator\"/\"openshift-service-ca.crt\"" Mar 16 15:35:50 crc kubenswrapper[5120]: I0316 15:35:50.139885 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Mar 16 15:35:50 crc kubenswrapper[5120]: I0316 15:35:50.182140 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-g6kgg\"" Mar 16 15:35:50 crc kubenswrapper[5120]: I0316 15:35:50.222088 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Mar 16 15:35:50 crc kubenswrapper[5120]: I0316 15:35:50.252230 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-controller-manager\"/\"config\"" Mar 16 15:35:50 crc kubenswrapper[5120]: I0316 15:35:50.313616 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Mar 16 15:35:50 crc kubenswrapper[5120]: I0316 15:35:50.356361 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-authentication\"/\"v4-0-config-user-template-error\"" Mar 16 15:35:50 crc kubenswrapper[5120]: I0316 15:35:50.360732 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-authentication-operator\"/\"service-ca-bundle\"" Mar 16 15:35:50 crc kubenswrapper[5120]: I0316 15:35:50.397709 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-machine-approver\"/\"kube-rbac-proxy\"" Mar 16 15:35:50 crc kubenswrapper[5120]: I0316 15:35:50.428209 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-kl6m8\"" Mar 16 15:35:50 crc kubenswrapper[5120]: I0316 15:35:50.555470 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-9pgs7\"" Mar 16 15:35:50 crc kubenswrapper[5120]: I0316 15:35:50.564194 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Mar 16 15:35:50 crc kubenswrapper[5120]: I0316 15:35:50.615783 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Mar 16 15:35:50 crc kubenswrapper[5120]: I0316 15:35:50.688123 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Mar 16 15:35:50 crc kubenswrapper[5120]: I0316 15:35:50.695536 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Mar 16 15:35:50 crc kubenswrapper[5120]: I0316 15:35:50.843026 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-authentication\"/\"v4-0-config-user-template-provider-selection\"" Mar 16 15:35:50 crc kubenswrapper[5120]: I0316 15:35:50.846675 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operator-lifecycle-manager\"/\"olm-operator-serviceaccount-dockercfg-4gqzj\"" Mar 16 15:35:50 crc kubenswrapper[5120]: I0316 15:35:50.860338 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-machine-config-operator\"/\"machine-config-operator-images\"" Mar 16 15:35:50 crc kubenswrapper[5120]: I0316 15:35:50.877299 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns-operator\"/\"kube-root-ca.crt\"" Mar 16 15:35:50 crc kubenswrapper[5120]: I0316 15:35:50.914468 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-machine-api\"/\"machine-api-operator-tls\"" Mar 16 15:35:51 crc kubenswrapper[5120]: I0316 15:35:51.032502 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-controller-manager-operator\"/\"openshift-controller-manager-operator-config\"" Mar 16 15:35:51 crc kubenswrapper[5120]: I0316 15:35:51.032960 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-controller-manager-operator\"/\"openshift-controller-manager-operator-serving-cert\"" Mar 16 15:35:51 crc kubenswrapper[5120]: I0316 15:35:51.066385 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operator-lifecycle-manager\"/\"pprof-cert\"" Mar 16 15:35:51 crc kubenswrapper[5120]: I0316 15:35:51.208996 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"marketplace-operator-dockercfg-2cfkp\"" Mar 16 15:35:51 crc kubenswrapper[5120]: I0316 15:35:51.304362 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operator-lifecycle-manager\"/\"openshift-service-ca.crt\"" Mar 16 15:35:51 crc kubenswrapper[5120]: I0316 15:35:51.409911 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Mar 16 15:35:51 crc kubenswrapper[5120]: I0316 15:35:51.427783 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-machine-approver\"/\"machine-approver-tls\"" Mar 16 15:35:51 crc kubenswrapper[5120]: I0316 15:35:51.450345 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Mar 16 15:35:51 crc kubenswrapper[5120]: I0316 15:35:51.483245 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Mar 16 15:35:51 crc kubenswrapper[5120]: I0316 15:35:51.518207 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-kpvmz\"" Mar 16 15:35:51 crc kubenswrapper[5120]: I0316 15:35:51.552236 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-control-plane-dockercfg-nl8tp\"" Mar 16 15:35:51 crc kubenswrapper[5120]: I0316 15:35:51.664542 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Mar 16 15:35:51 crc kubenswrapper[5120]: I0316 15:35:51.669138 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-apiserver\"/\"audit-1\"" Mar 16 15:35:51 crc kubenswrapper[5120]: I0316 15:35:51.677904 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-etcd-operator\"/\"etcd-operator-config\"" Mar 16 15:35:51 crc kubenswrapper[5120]: I0316 15:35:51.718012 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Mar 16 15:35:51 crc kubenswrapper[5120]: I0316 15:35:51.791250 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Mar 16 15:35:51 crc kubenswrapper[5120]: I0316 15:35:51.814641 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-authentication\"/\"kube-root-ca.crt\"" Mar 16 15:35:51 crc kubenswrapper[5120]: I0316 15:35:51.868927 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Mar 16 15:35:51 crc kubenswrapper[5120]: I0316 15:35:51.911073 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-authentication\"/\"v4-0-config-user-idp-0-file-data\"" Mar 16 15:35:52 crc kubenswrapper[5120]: I0316 15:35:52.008328 5120 patch_prober.go:28] interesting pod/machine-config-daemon-7bf76 container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 15:35:52 crc kubenswrapper[5120]: I0316 15:35:52.008831 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 15:35:52 crc kubenswrapper[5120]: I0316 15:35:52.024341 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-apiserver\"/\"etcd-serving-ca\"" Mar 16 15:35:52 crc kubenswrapper[5120]: I0316 15:35:52.068798 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Mar 16 15:35:52 crc kubenswrapper[5120]: I0316 15:35:52.170891 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Mar 16 15:35:52 crc kubenswrapper[5120]: I0316 15:35:52.312867 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Mar 16 15:35:52 crc kubenswrapper[5120]: I0316 15:35:52.335581 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Mar 16 15:35:52 crc kubenswrapper[5120]: I0316 15:35:52.564546 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-6w67b\"" Mar 16 15:35:52 crc kubenswrapper[5120]: I0316 15:35:52.635383 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Mar 16 15:35:52 crc kubenswrapper[5120]: I0316 15:35:52.697890 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Mar 16 15:35:52 crc kubenswrapper[5120]: I0316 15:35:52.753444 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-controller-manager\"/\"openshift-global-ca\"" Mar 16 15:35:52 crc kubenswrapper[5120]: I0316 15:35:52.796802 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-node-identity\"/\"kube-root-ca.crt\"" Mar 16 15:35:52 crc kubenswrapper[5120]: I0316 15:35:52.828158 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-apiserver-operator\"/\"kube-root-ca.crt\"" Mar 16 15:35:52 crc kubenswrapper[5120]: I0316 15:35:52.876199 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-certs-default\"" Mar 16 15:35:52 crc kubenswrapper[5120]: I0316 15:35:52.878827 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-config-operator\"/\"config-operator-serving-cert\"" Mar 16 15:35:52 crc kubenswrapper[5120]: I0316 15:35:52.879619 5120 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Mar 16 15:35:52 crc kubenswrapper[5120]: I0316 15:35:52.902799 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-controller-manager\"/\"serving-cert\"" Mar 16 15:35:52 crc kubenswrapper[5120]: I0316 15:35:52.929664 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-machine-config-operator\"/\"machine-config-server-dockercfg-dzw6b\"" Mar 16 15:35:52 crc kubenswrapper[5120]: I0316 15:35:52.938426 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-node-identity\"/\"openshift-service-ca.crt\"" Mar 16 15:35:52 crc kubenswrapper[5120]: I0316 15:35:52.978404 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-route-controller-manager\"/\"kube-root-ca.crt\"" Mar 16 15:35:53 crc kubenswrapper[5120]: I0316 15:35:53.070345 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-oauth-apiserver\"/\"etcd-client\"" Mar 16 15:35:53 crc kubenswrapper[5120]: I0316 15:35:53.174593 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-oauth-apiserver\"/\"serving-cert\"" Mar 16 15:35:53 crc kubenswrapper[5120]: I0316 15:35:53.223055 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-machine-api\"/\"kube-rbac-proxy\"" Mar 16 15:35:53 crc kubenswrapper[5120]: I0316 15:35:53.242830 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"marketplace-trusted-ca\"" Mar 16 15:35:53 crc kubenswrapper[5120]: I0316 15:35:53.468470 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Mar 16 15:35:53 crc kubenswrapper[5120]: I0316 15:35:53.475047 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Mar 16 15:35:53 crc kubenswrapper[5120]: I0316 15:35:53.564870 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-operator\"/\"trusted-ca\"" Mar 16 15:35:53 crc kubenswrapper[5120]: I0316 15:35:53.689392 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Mar 16 15:35:53 crc kubenswrapper[5120]: I0316 15:35:53.740654 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Mar 16 15:35:53 crc kubenswrapper[5120]: I0316 15:35:53.870877 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Mar 16 15:35:53 crc kubenswrapper[5120]: I0316 15:35:53.900632 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-authentication\"/\"v4-0-config-system-cliconfig\"" Mar 16 15:35:53 crc kubenswrapper[5120]: I0316 15:35:53.920835 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-oauth-apiserver\"/\"etcd-serving-ca\"" Mar 16 15:35:53 crc kubenswrapper[5120]: I0316 15:35:53.990474 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-machine-config-operator\"/\"machine-config-server-tls\"" Mar 16 15:35:54 crc kubenswrapper[5120]: I0316 15:35:54.012341 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-bjqfd\"" Mar 16 15:35:54 crc kubenswrapper[5120]: I0316 15:35:54.052861 5120 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Mar 16 15:35:54 crc kubenswrapper[5120]: I0316 15:35:54.064953 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"hostpath-provisioner\"/\"csi-hostpath-provisioner-sa-dockercfg-7dcws\"" Mar 16 15:35:54 crc kubenswrapper[5120]: I0316 15:35:54.099116 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Mar 16 15:35:54 crc kubenswrapper[5120]: I0316 15:35:54.283726 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-authentication\"/\"v4-0-config-system-serving-cert\"" Mar 16 15:35:54 crc kubenswrapper[5120]: I0316 15:35:54.501578 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-route-controller-manager\"/\"openshift-service-ca.crt\"" Mar 16 15:35:54 crc kubenswrapper[5120]: I0316 15:35:54.524819 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-authentication\"/\"openshift-service-ca.crt\"" Mar 16 15:35:54 crc kubenswrapper[5120]: I0316 15:35:54.537706 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Mar 16 15:35:54 crc kubenswrapper[5120]: I0316 15:35:54.620720 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Mar 16 15:35:54 crc kubenswrapper[5120]: I0316 15:35:54.674371 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Mar 16 15:35:54 crc kubenswrapper[5120]: I0316 15:35:54.703497 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Mar 16 15:35:54 crc kubenswrapper[5120]: I0316 15:35:54.777164 5120 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Mar 16 15:35:54 crc kubenswrapper[5120]: I0316 15:35:54.781180 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-crc" podStartSLOduration=43.781160036 podStartE2EDuration="43.781160036s" podCreationTimestamp="2026-03-16 15:35:11 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:35:29.979375766 +0000 UTC m=+232.133307423" watchObservedRunningTime="2026-03-16 15:35:54.781160036 +0000 UTC m=+256.935091733" Mar 16 15:35:54 crc kubenswrapper[5120]: I0316 15:35:54.786973 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-kube-apiserver/kube-apiserver-crc"] Mar 16 15:35:54 crc kubenswrapper[5120]: I0316 15:35:54.787047 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-apiserver/kube-apiserver-crc"] Mar 16 15:35:54 crc kubenswrapper[5120]: I0316 15:35:54.795185 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-kube-apiserver/kube-apiserver-crc" Mar 16 15:35:54 crc kubenswrapper[5120]: I0316 15:35:54.805198 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ac-dockercfg-gj7jx\"" Mar 16 15:35:54 crc kubenswrapper[5120]: I0316 15:35:54.818441 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-apiserver/kube-apiserver-crc" podStartSLOduration=24.818414303 podStartE2EDuration="24.818414303s" podCreationTimestamp="2026-03-16 15:35:30 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:35:54.812014787 +0000 UTC m=+256.965946484" watchObservedRunningTime="2026-03-16 15:35:54.818414303 +0000 UTC m=+256.972346000" Mar 16 15:35:54 crc kubenswrapper[5120]: I0316 15:35:54.894993 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-apiserver-operator\"/\"kube-root-ca.crt\"" Mar 16 15:35:54 crc kubenswrapper[5120]: I0316 15:35:54.962748 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Mar 16 15:35:55 crc kubenswrapper[5120]: I0316 15:35:55.004477 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-authentication\"/\"v4-0-config-system-trusted-ca-bundle\"" Mar 16 15:35:55 crc kubenswrapper[5120]: I0316 15:35:55.044820 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-machine-api\"/\"openshift-service-ca.crt\"" Mar 16 15:35:55 crc kubenswrapper[5120]: I0316 15:35:55.045070 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-scheduler-operator\"/\"openshift-kube-scheduler-operator-dockercfg-2wbn2\"" Mar 16 15:35:55 crc kubenswrapper[5120]: I0316 15:35:55.176318 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-etcd-operator\"/\"etcd-operator-serving-cert\"" Mar 16 15:35:55 crc kubenswrapper[5120]: I0316 15:35:55.198546 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-version\"/\"kube-root-ca.crt\"" Mar 16 15:35:55 crc kubenswrapper[5120]: I0316 15:35:55.253234 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Mar 16 15:35:55 crc kubenswrapper[5120]: I0316 15:35:55.363733 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"certified-operators-dockercfg-7cl8d\"" Mar 16 15:35:55 crc kubenswrapper[5120]: I0316 15:35:55.462048 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-version\"/\"cluster-version-operator-serving-cert\"" Mar 16 15:35:55 crc kubenswrapper[5120]: I0316 15:35:55.471731 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-controller-manager-operator\"/\"kube-controller-manager-operator-config\"" Mar 16 15:35:55 crc kubenswrapper[5120]: I0316 15:35:55.487225 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Mar 16 15:35:55 crc kubenswrapper[5120]: I0316 15:35:55.561673 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operator-lifecycle-manager\"/\"kube-root-ca.crt\"" Mar 16 15:35:55 crc kubenswrapper[5120]: I0316 15:35:55.727162 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Mar 16 15:35:55 crc kubenswrapper[5120]: I0316 15:35:55.790470 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-version\"/\"default-dockercfg-hqpm5\"" Mar 16 15:35:56 crc kubenswrapper[5120]: I0316 15:35:56.019105 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-authentication\"/\"v4-0-config-system-ocp-branding-template\"" Mar 16 15:35:56 crc kubenswrapper[5120]: I0316 15:35:56.046018 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-machine-api\"/\"machine-api-operator-images\"" Mar 16 15:35:56 crc kubenswrapper[5120]: I0316 15:35:56.137194 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Mar 16 15:35:56 crc kubenswrapper[5120]: I0316 15:35:56.148460 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"hostpath-provisioner\"/\"openshift-service-ca.crt\"" Mar 16 15:35:56 crc kubenswrapper[5120]: I0316 15:35:56.197625 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-node-identity\"/\"network-node-identity-cert\"" Mar 16 15:35:56 crc kubenswrapper[5120]: I0316 15:35:56.216649 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Mar 16 15:35:56 crc kubenswrapper[5120]: I0316 15:35:56.322773 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns-operator\"/\"dns-operator-dockercfg-wbbsn\"" Mar 16 15:35:56 crc kubenswrapper[5120]: I0316 15:35:56.333480 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"redhat-operators-dockercfg-9gxlh\"" Mar 16 15:35:56 crc kubenswrapper[5120]: I0316 15:35:56.362892 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-oauth-apiserver\"/\"audit-1\"" Mar 16 15:35:56 crc kubenswrapper[5120]: I0316 15:35:56.399444 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"cluster-image-registry-operator-dockercfg-ntnd7\"" Mar 16 15:35:56 crc kubenswrapper[5120]: I0316 15:35:56.420159 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-controller-manager-operator\"/\"kube-root-ca.crt\"" Mar 16 15:35:56 crc kubenswrapper[5120]: I0316 15:35:56.596783 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-machine-config-operator\"/\"proxy-tls\"" Mar 16 15:35:56 crc kubenswrapper[5120]: I0316 15:35:56.820176 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-machine-config-operator\"/\"kube-rbac-proxy\"" Mar 16 15:35:56 crc kubenswrapper[5120]: I0316 15:35:56.875038 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Mar 16 15:35:56 crc kubenswrapper[5120]: I0316 15:35:56.899322 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-authentication\"/\"v4-0-config-system-service-ca\"" Mar 16 15:35:57 crc kubenswrapper[5120]: I0316 15:35:57.031455 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-route-controller-manager\"/\"config\"" Mar 16 15:35:57 crc kubenswrapper[5120]: I0316 15:35:57.218927 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-machine-config-operator\"/\"machine-config-daemon-dockercfg-w9nzh\"" Mar 16 15:35:57 crc kubenswrapper[5120]: I0316 15:35:57.254907 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Mar 16 15:35:57 crc kubenswrapper[5120]: I0316 15:35:57.573255 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-8dkm8\"" Mar 16 15:35:57 crc kubenswrapper[5120]: I0316 15:35:57.684401 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"redhat-marketplace-dockercfg-gg4w7\"" Mar 16 15:35:57 crc kubenswrapper[5120]: I0316 15:35:57.685830 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"community-operators-dockercfg-vrd5f\"" Mar 16 15:35:57 crc kubenswrapper[5120]: I0316 15:35:57.831962 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-bgxvm\"" Mar 16 15:35:57 crc kubenswrapper[5120]: I0316 15:35:57.952302 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-apiserver-operator\"/\"kube-apiserver-operator-serving-cert\"" Mar 16 15:35:58 crc kubenswrapper[5120]: I0316 15:35:58.309638 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-apiserver\"/\"kube-root-ca.crt\"" Mar 16 15:35:58 crc kubenswrapper[5120]: I0316 15:35:58.368830 5120 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Mar 16 15:35:58 crc kubenswrapper[5120]: I0316 15:35:58.478003 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-apiserver\"/\"openshift-apiserver-sa-dockercfg-4zqgh\"" Mar 16 15:35:58 crc kubenswrapper[5120]: I0316 15:35:58.651009 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Mar 16 15:35:58 crc kubenswrapper[5120]: I0316 15:35:58.768056 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Mar 16 15:35:59 crc kubenswrapper[5120]: I0316 15:35:59.010575 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Mar 16 15:35:59 crc kubenswrapper[5120]: I0316 15:35:59.051896 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Mar 16 15:35:59 crc kubenswrapper[5120]: I0316 15:35:59.921816 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-oauth-apiserver\"/\"kube-root-ca.crt\"" Mar 16 15:36:00 crc kubenswrapper[5120]: I0316 15:36:00.113407 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-apiserver\"/\"config\"" Mar 16 15:36:00 crc kubenswrapper[5120]: I0316 15:36:00.156244 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-infra/auto-csr-approver-29561256-ttmqg"] Mar 16 15:36:00 crc kubenswrapper[5120]: I0316 15:36:00.156946 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01b7113a-6a9e-45f9-ab3a-bbf513f83e0a" containerName="installer" Mar 16 15:36:00 crc kubenswrapper[5120]: I0316 15:36:00.156971 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="01b7113a-6a9e-45f9-ab3a-bbf513f83e0a" containerName="installer" Mar 16 15:36:00 crc kubenswrapper[5120]: I0316 15:36:00.157092 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="01b7113a-6a9e-45f9-ab3a-bbf513f83e0a" containerName="installer" Mar 16 15:36:00 crc kubenswrapper[5120]: I0316 15:36:00.167426 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561256-ttmqg"] Mar 16 15:36:00 crc kubenswrapper[5120]: I0316 15:36:00.167571 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561256-ttmqg" Mar 16 15:36:00 crc kubenswrapper[5120]: I0316 15:36:00.170504 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"openshift-service-ca.crt\"" Mar 16 15:36:00 crc kubenswrapper[5120]: I0316 15:36:00.170823 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-infra\"/\"csr-approver-sa-dockercfg-x2nsz\"" Mar 16 15:36:00 crc kubenswrapper[5120]: I0316 15:36:00.171009 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"kube-root-ca.crt\"" Mar 16 15:36:00 crc kubenswrapper[5120]: I0316 15:36:00.256409 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbjr5\" (UniqueName: \"kubernetes.io/projected/58fd4e88-9c10-43f9-87f9-13b8faa0efc6-kube-api-access-jbjr5\") pod \"auto-csr-approver-29561256-ttmqg\" (UID: \"58fd4e88-9c10-43f9-87f9-13b8faa0efc6\") " pod="openshift-infra/auto-csr-approver-29561256-ttmqg" Mar 16 15:36:00 crc kubenswrapper[5120]: I0316 15:36:00.357106 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jbjr5\" (UniqueName: \"kubernetes.io/projected/58fd4e88-9c10-43f9-87f9-13b8faa0efc6-kube-api-access-jbjr5\") pod \"auto-csr-approver-29561256-ttmqg\" (UID: \"58fd4e88-9c10-43f9-87f9-13b8faa0efc6\") " pod="openshift-infra/auto-csr-approver-29561256-ttmqg" Mar 16 15:36:00 crc kubenswrapper[5120]: I0316 15:36:00.377259 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbjr5\" (UniqueName: \"kubernetes.io/projected/58fd4e88-9c10-43f9-87f9-13b8faa0efc6-kube-api-access-jbjr5\") pod \"auto-csr-approver-29561256-ttmqg\" (UID: \"58fd4e88-9c10-43f9-87f9-13b8faa0efc6\") " pod="openshift-infra/auto-csr-approver-29561256-ttmqg" Mar 16 15:36:00 crc kubenswrapper[5120]: I0316 15:36:00.488145 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561256-ttmqg" Mar 16 15:36:00 crc kubenswrapper[5120]: I0316 15:36:00.567364 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-apiserver\"/\"trusted-ca-bundle\"" Mar 16 15:36:00 crc kubenswrapper[5120]: I0316 15:36:00.671806 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561256-ttmqg"] Mar 16 15:36:00 crc kubenswrapper[5120]: I0316 15:36:00.682717 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561256-ttmqg" event={"ID":"58fd4e88-9c10-43f9-87f9-13b8faa0efc6","Type":"ContainerStarted","Data":"63629abb2121f38a6fa430a6051a351b75bacb3ae029a4233c4cb1d5577c0069"} Mar 16 15:36:02 crc kubenswrapper[5120]: I0316 15:36:02.703795 5120 generic.go:358] "Generic (PLEG): container finished" podID="58fd4e88-9c10-43f9-87f9-13b8faa0efc6" containerID="df1b25bf24c5b6a72c448cb0d1073fd0f0bf3202fb900a79d2e12cf2be8b18f6" exitCode=0 Mar 16 15:36:02 crc kubenswrapper[5120]: I0316 15:36:02.703866 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561256-ttmqg" event={"ID":"58fd4e88-9c10-43f9-87f9-13b8faa0efc6","Type":"ContainerDied","Data":"df1b25bf24c5b6a72c448cb0d1073fd0f0bf3202fb900a79d2e12cf2be8b18f6"} Mar 16 15:36:04 crc kubenswrapper[5120]: I0316 15:36:04.027510 5120 kubelet.go:2547] "SyncLoop REMOVE" source="file" pods=["openshift-kube-apiserver/kube-apiserver-startup-monitor-crc"] Mar 16 15:36:04 crc kubenswrapper[5120]: I0316 15:36:04.028030 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-crc" podUID="f7dbc7e1ee9c187a863ef9b473fad27b" containerName="startup-monitor" containerID="cri-o://994025f80c53555a31b86b46214226b6430e599bfe1ed84444168cefdf25050e" gracePeriod=5 Mar 16 15:36:04 crc kubenswrapper[5120]: I0316 15:36:04.058355 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561256-ttmqg" Mar 16 15:36:04 crc kubenswrapper[5120]: I0316 15:36:04.212104 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jbjr5\" (UniqueName: \"kubernetes.io/projected/58fd4e88-9c10-43f9-87f9-13b8faa0efc6-kube-api-access-jbjr5\") pod \"58fd4e88-9c10-43f9-87f9-13b8faa0efc6\" (UID: \"58fd4e88-9c10-43f9-87f9-13b8faa0efc6\") " Mar 16 15:36:04 crc kubenswrapper[5120]: I0316 15:36:04.221787 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58fd4e88-9c10-43f9-87f9-13b8faa0efc6-kube-api-access-jbjr5" (OuterVolumeSpecName: "kube-api-access-jbjr5") pod "58fd4e88-9c10-43f9-87f9-13b8faa0efc6" (UID: "58fd4e88-9c10-43f9-87f9-13b8faa0efc6"). InnerVolumeSpecName "kube-api-access-jbjr5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:36:04 crc kubenswrapper[5120]: I0316 15:36:04.314164 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jbjr5\" (UniqueName: \"kubernetes.io/projected/58fd4e88-9c10-43f9-87f9-13b8faa0efc6-kube-api-access-jbjr5\") on node \"crc\" DevicePath \"\"" Mar 16 15:36:04 crc kubenswrapper[5120]: I0316 15:36:04.717318 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561256-ttmqg" event={"ID":"58fd4e88-9c10-43f9-87f9-13b8faa0efc6","Type":"ContainerDied","Data":"63629abb2121f38a6fa430a6051a351b75bacb3ae029a4233c4cb1d5577c0069"} Mar 16 15:36:04 crc kubenswrapper[5120]: I0316 15:36:04.717362 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561256-ttmqg" Mar 16 15:36:04 crc kubenswrapper[5120]: I0316 15:36:04.717371 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="63629abb2121f38a6fa430a6051a351b75bacb3ae029a4233c4cb1d5577c0069" Mar 16 15:36:09 crc kubenswrapper[5120]: I0316 15:36:09.626322 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_kube-apiserver-startup-monitor-crc_f7dbc7e1ee9c187a863ef9b473fad27b/startup-monitor/0.log" Mar 16 15:36:09 crc kubenswrapper[5120]: I0316 15:36:09.626911 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-crc" Mar 16 15:36:09 crc kubenswrapper[5120]: I0316 15:36:09.753148 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_kube-apiserver-startup-monitor-crc_f7dbc7e1ee9c187a863ef9b473fad27b/startup-monitor/0.log" Mar 16 15:36:09 crc kubenswrapper[5120]: I0316 15:36:09.753191 5120 generic.go:358] "Generic (PLEG): container finished" podID="f7dbc7e1ee9c187a863ef9b473fad27b" containerID="994025f80c53555a31b86b46214226b6430e599bfe1ed84444168cefdf25050e" exitCode=137 Mar 16 15:36:09 crc kubenswrapper[5120]: I0316 15:36:09.753266 5120 scope.go:117] "RemoveContainer" containerID="994025f80c53555a31b86b46214226b6430e599bfe1ed84444168cefdf25050e" Mar 16 15:36:09 crc kubenswrapper[5120]: I0316 15:36:09.753379 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-crc" Mar 16 15:36:09 crc kubenswrapper[5120]: I0316 15:36:09.774206 5120 scope.go:117] "RemoveContainer" containerID="994025f80c53555a31b86b46214226b6430e599bfe1ed84444168cefdf25050e" Mar 16 15:36:09 crc kubenswrapper[5120]: E0316 15:36:09.774701 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"994025f80c53555a31b86b46214226b6430e599bfe1ed84444168cefdf25050e\": container with ID starting with 994025f80c53555a31b86b46214226b6430e599bfe1ed84444168cefdf25050e not found: ID does not exist" containerID="994025f80c53555a31b86b46214226b6430e599bfe1ed84444168cefdf25050e" Mar 16 15:36:09 crc kubenswrapper[5120]: I0316 15:36:09.774735 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"994025f80c53555a31b86b46214226b6430e599bfe1ed84444168cefdf25050e"} err="failed to get container status \"994025f80c53555a31b86b46214226b6430e599bfe1ed84444168cefdf25050e\": rpc error: code = NotFound desc = could not find container \"994025f80c53555a31b86b46214226b6430e599bfe1ed84444168cefdf25050e\": container with ID starting with 994025f80c53555a31b86b46214226b6430e599bfe1ed84444168cefdf25050e not found: ID does not exist" Mar 16 15:36:09 crc kubenswrapper[5120]: I0316 15:36:09.784280 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pod-resource-dir\" (UniqueName: \"kubernetes.io/host-path/f7dbc7e1ee9c187a863ef9b473fad27b-pod-resource-dir\") pod \"f7dbc7e1ee9c187a863ef9b473fad27b\" (UID: \"f7dbc7e1ee9c187a863ef9b473fad27b\") " Mar 16 15:36:09 crc kubenswrapper[5120]: I0316 15:36:09.784344 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"var-log\" (UniqueName: \"kubernetes.io/host-path/f7dbc7e1ee9c187a863ef9b473fad27b-var-log\") pod \"f7dbc7e1ee9c187a863ef9b473fad27b\" (UID: \"f7dbc7e1ee9c187a863ef9b473fad27b\") " Mar 16 15:36:09 crc kubenswrapper[5120]: I0316 15:36:09.784472 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/host-path/f7dbc7e1ee9c187a863ef9b473fad27b-manifests\") pod \"f7dbc7e1ee9c187a863ef9b473fad27b\" (UID: \"f7dbc7e1ee9c187a863ef9b473fad27b\") " Mar 16 15:36:09 crc kubenswrapper[5120]: I0316 15:36:09.784520 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/f7dbc7e1ee9c187a863ef9b473fad27b-resource-dir\") pod \"f7dbc7e1ee9c187a863ef9b473fad27b\" (UID: \"f7dbc7e1ee9c187a863ef9b473fad27b\") " Mar 16 15:36:09 crc kubenswrapper[5120]: I0316 15:36:09.784617 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/f7dbc7e1ee9c187a863ef9b473fad27b-var-lock\") pod \"f7dbc7e1ee9c187a863ef9b473fad27b\" (UID: \"f7dbc7e1ee9c187a863ef9b473fad27b\") " Mar 16 15:36:09 crc kubenswrapper[5120]: I0316 15:36:09.784727 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/f7dbc7e1ee9c187a863ef9b473fad27b-var-log" (OuterVolumeSpecName: "var-log") pod "f7dbc7e1ee9c187a863ef9b473fad27b" (UID: "f7dbc7e1ee9c187a863ef9b473fad27b"). InnerVolumeSpecName "var-log". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 15:36:09 crc kubenswrapper[5120]: I0316 15:36:09.784804 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/f7dbc7e1ee9c187a863ef9b473fad27b-var-lock" (OuterVolumeSpecName: "var-lock") pod "f7dbc7e1ee9c187a863ef9b473fad27b" (UID: "f7dbc7e1ee9c187a863ef9b473fad27b"). InnerVolumeSpecName "var-lock". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 15:36:09 crc kubenswrapper[5120]: I0316 15:36:09.784936 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/f7dbc7e1ee9c187a863ef9b473fad27b-manifests" (OuterVolumeSpecName: "manifests") pod "f7dbc7e1ee9c187a863ef9b473fad27b" (UID: "f7dbc7e1ee9c187a863ef9b473fad27b"). InnerVolumeSpecName "manifests". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 15:36:09 crc kubenswrapper[5120]: I0316 15:36:09.784958 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/f7dbc7e1ee9c187a863ef9b473fad27b-resource-dir" (OuterVolumeSpecName: "resource-dir") pod "f7dbc7e1ee9c187a863ef9b473fad27b" (UID: "f7dbc7e1ee9c187a863ef9b473fad27b"). InnerVolumeSpecName "resource-dir". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 15:36:09 crc kubenswrapper[5120]: I0316 15:36:09.785362 5120 reconciler_common.go:299] "Volume detached for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/f7dbc7e1ee9c187a863ef9b473fad27b-var-lock\") on node \"crc\" DevicePath \"\"" Mar 16 15:36:09 crc kubenswrapper[5120]: I0316 15:36:09.785385 5120 reconciler_common.go:299] "Volume detached for volume \"var-log\" (UniqueName: \"kubernetes.io/host-path/f7dbc7e1ee9c187a863ef9b473fad27b-var-log\") on node \"crc\" DevicePath \"\"" Mar 16 15:36:09 crc kubenswrapper[5120]: I0316 15:36:09.785405 5120 reconciler_common.go:299] "Volume detached for volume \"manifests\" (UniqueName: \"kubernetes.io/host-path/f7dbc7e1ee9c187a863ef9b473fad27b-manifests\") on node \"crc\" DevicePath \"\"" Mar 16 15:36:09 crc kubenswrapper[5120]: I0316 15:36:09.785421 5120 reconciler_common.go:299] "Volume detached for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/f7dbc7e1ee9c187a863ef9b473fad27b-resource-dir\") on node \"crc\" DevicePath \"\"" Mar 16 15:36:09 crc kubenswrapper[5120]: I0316 15:36:09.796318 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/f7dbc7e1ee9c187a863ef9b473fad27b-pod-resource-dir" (OuterVolumeSpecName: "pod-resource-dir") pod "f7dbc7e1ee9c187a863ef9b473fad27b" (UID: "f7dbc7e1ee9c187a863ef9b473fad27b"). InnerVolumeSpecName "pod-resource-dir". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 15:36:09 crc kubenswrapper[5120]: I0316 15:36:09.886306 5120 reconciler_common.go:299] "Volume detached for volume \"pod-resource-dir\" (UniqueName: \"kubernetes.io/host-path/f7dbc7e1ee9c187a863ef9b473fad27b-pod-resource-dir\") on node \"crc\" DevicePath \"\"" Mar 16 15:36:10 crc kubenswrapper[5120]: I0316 15:36:10.670899 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f7dbc7e1ee9c187a863ef9b473fad27b" path="/var/lib/kubelet/pods/f7dbc7e1ee9c187a863ef9b473fad27b/volumes" Mar 16 15:36:10 crc kubenswrapper[5120]: I0316 15:36:10.671965 5120 mirror_client.go:130] "Deleting a mirror pod" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-crc" podUID="" Mar 16 15:36:10 crc kubenswrapper[5120]: I0316 15:36:10.680949 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-kube-apiserver/kube-apiserver-startup-monitor-crc"] Mar 16 15:36:10 crc kubenswrapper[5120]: I0316 15:36:10.680995 5120 kubelet.go:2759] "Unable to find pod for mirror pod, skipping" mirrorPod="openshift-kube-apiserver/kube-apiserver-startup-monitor-crc" mirrorPodUID="183fa97a-722d-4a66-aa67-33879687a29a" Mar 16 15:36:10 crc kubenswrapper[5120]: I0316 15:36:10.684464 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-kube-apiserver/kube-apiserver-startup-monitor-crc"] Mar 16 15:36:10 crc kubenswrapper[5120]: I0316 15:36:10.684502 5120 kubelet.go:2784] "Unable to find pod for mirror pod, skipping" mirrorPod="openshift-kube-apiserver/kube-apiserver-startup-monitor-crc" mirrorPodUID="183fa97a-722d-4a66-aa67-33879687a29a" Mar 16 15:36:15 crc kubenswrapper[5120]: I0316 15:36:15.468001 5120 patch_prober.go:28] interesting pod/marketplace-operator-547dbd544d-gp852 container/marketplace-operator namespace/openshift-marketplace: Readiness probe status=failure output="Get \"http://10.217.0.27:8080/healthz\": dial tcp 10.217.0.27:8080: connect: connection refused" start-of-body= Mar 16 15:36:15 crc kubenswrapper[5120]: I0316 15:36:15.468342 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-marketplace/marketplace-operator-547dbd544d-gp852" podUID="a0b763d7-65d4-41e1-9880-8f80e9686189" containerName="marketplace-operator" probeResult="failure" output="Get \"http://10.217.0.27:8080/healthz\": dial tcp 10.217.0.27:8080: connect: connection refused" Mar 16 15:36:15 crc kubenswrapper[5120]: I0316 15:36:15.791858 5120 generic.go:358] "Generic (PLEG): container finished" podID="a0b763d7-65d4-41e1-9880-8f80e9686189" containerID="0c33d76eb2d5ce3e65e693dbd6ef8dc3118bfcdd1cd6f0be9ce39935423c32e6" exitCode=0 Mar 16 15:36:15 crc kubenswrapper[5120]: I0316 15:36:15.791974 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/marketplace-operator-547dbd544d-gp852" event={"ID":"a0b763d7-65d4-41e1-9880-8f80e9686189","Type":"ContainerDied","Data":"0c33d76eb2d5ce3e65e693dbd6ef8dc3118bfcdd1cd6f0be9ce39935423c32e6"} Mar 16 15:36:15 crc kubenswrapper[5120]: I0316 15:36:15.792411 5120 scope.go:117] "RemoveContainer" containerID="0c33d76eb2d5ce3e65e693dbd6ef8dc3118bfcdd1cd6f0be9ce39935423c32e6" Mar 16 15:36:16 crc kubenswrapper[5120]: I0316 15:36:16.798399 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/marketplace-operator-547dbd544d-gp852" event={"ID":"a0b763d7-65d4-41e1-9880-8f80e9686189","Type":"ContainerStarted","Data":"b290fa074131590a8c67ec37d076e49585b240607eb405eea8f8db741f6c6119"} Mar 16 15:36:16 crc kubenswrapper[5120]: I0316 15:36:16.799832 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-marketplace/marketplace-operator-547dbd544d-gp852" Mar 16 15:36:16 crc kubenswrapper[5120]: I0316 15:36:16.802350 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/marketplace-operator-547dbd544d-gp852" Mar 16 15:36:22 crc kubenswrapper[5120]: I0316 15:36:22.008519 5120 patch_prober.go:28] interesting pod/machine-config-daemon-7bf76 container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 15:36:22 crc kubenswrapper[5120]: I0316 15:36:22.008580 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 15:36:22 crc kubenswrapper[5120]: I0316 15:36:22.008621 5120 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" Mar 16 15:36:22 crc kubenswrapper[5120]: I0316 15:36:22.009155 5120 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="machine-config-daemon" containerStatusID={"Type":"cri-o","ID":"918b5e16649d3658eed82cd6bd90691a9be4a2e395ae1cb2cac748c3eee9124d"} pod="openshift-machine-config-operator/machine-config-daemon-7bf76" containerMessage="Container machine-config-daemon failed liveness probe, will be restarted" Mar 16 15:36:22 crc kubenswrapper[5120]: I0316 15:36:22.009208 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" containerID="cri-o://918b5e16649d3658eed82cd6bd90691a9be4a2e395ae1cb2cac748c3eee9124d" gracePeriod=600 Mar 16 15:36:22 crc kubenswrapper[5120]: I0316 15:36:22.836817 5120 generic.go:358] "Generic (PLEG): container finished" podID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerID="918b5e16649d3658eed82cd6bd90691a9be4a2e395ae1cb2cac748c3eee9124d" exitCode=0 Mar 16 15:36:22 crc kubenswrapper[5120]: I0316 15:36:22.836971 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" event={"ID":"e2275cb4-4905-4d66-a87e-8010120db2bd","Type":"ContainerDied","Data":"918b5e16649d3658eed82cd6bd90691a9be4a2e395ae1cb2cac748c3eee9124d"} Mar 16 15:36:22 crc kubenswrapper[5120]: I0316 15:36:22.837365 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" event={"ID":"e2275cb4-4905-4d66-a87e-8010120db2bd","Type":"ContainerStarted","Data":"4730db759297f0a075089df3a65417a9e171e80454e4c218ce5ff9ad42541d2c"} Mar 16 15:36:25 crc kubenswrapper[5120]: I0316 15:36:25.809329 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-controller-manager/controller-manager-65b6cccf98-pbcg9"] Mar 16 15:36:25 crc kubenswrapper[5120]: I0316 15:36:25.810229 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-controller-manager/controller-manager-65b6cccf98-pbcg9" podUID="f66781c9-aef5-4298-9f8a-b7f217906ed7" containerName="controller-manager" containerID="cri-o://bd404a00b5bf827a50672a875e79a5ad0a50295e84bba99fe6601c1295819ac6" gracePeriod=30 Mar 16 15:36:25 crc kubenswrapper[5120]: I0316 15:36:25.831877 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-route-controller-manager/route-controller-manager-776cdc94d6-b9gn7"] Mar 16 15:36:25 crc kubenswrapper[5120]: I0316 15:36:25.832239 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-route-controller-manager/route-controller-manager-776cdc94d6-b9gn7" podUID="94a5c5c7-67a9-4631-bdee-296422d882c4" containerName="route-controller-manager" containerID="cri-o://92a812faef174e48906c0daae6eb0df825de8d49f1ad9abaa9267aaac7ea19c9" gracePeriod=30 Mar 16 15:36:26 crc kubenswrapper[5120]: I0316 15:36:26.247087 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-route-controller-manager/route-controller-manager-776cdc94d6-b9gn7" Mar 16 15:36:26 crc kubenswrapper[5120]: I0316 15:36:26.252027 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-controller-manager/controller-manager-65b6cccf98-pbcg9" Mar 16 15:36:26 crc kubenswrapper[5120]: I0316 15:36:26.270236 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-route-controller-manager/route-controller-manager-665d558945-zjfpw"] Mar 16 15:36:26 crc kubenswrapper[5120]: I0316 15:36:26.270740 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94a5c5c7-67a9-4631-bdee-296422d882c4" containerName="route-controller-manager" Mar 16 15:36:26 crc kubenswrapper[5120]: I0316 15:36:26.270797 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="94a5c5c7-67a9-4631-bdee-296422d882c4" containerName="route-controller-manager" Mar 16 15:36:26 crc kubenswrapper[5120]: I0316 15:36:26.270811 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f66781c9-aef5-4298-9f8a-b7f217906ed7" containerName="controller-manager" Mar 16 15:36:26 crc kubenswrapper[5120]: I0316 15:36:26.270816 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f66781c9-aef5-4298-9f8a-b7f217906ed7" containerName="controller-manager" Mar 16 15:36:26 crc kubenswrapper[5120]: I0316 15:36:26.270829 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7dbc7e1ee9c187a863ef9b473fad27b" containerName="startup-monitor" Mar 16 15:36:26 crc kubenswrapper[5120]: I0316 15:36:26.270835 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7dbc7e1ee9c187a863ef9b473fad27b" containerName="startup-monitor" Mar 16 15:36:26 crc kubenswrapper[5120]: I0316 15:36:26.270845 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58fd4e88-9c10-43f9-87f9-13b8faa0efc6" containerName="oc" Mar 16 15:36:26 crc kubenswrapper[5120]: I0316 15:36:26.270850 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="58fd4e88-9c10-43f9-87f9-13b8faa0efc6" containerName="oc" Mar 16 15:36:26 crc kubenswrapper[5120]: I0316 15:36:26.270956 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="94a5c5c7-67a9-4631-bdee-296422d882c4" containerName="route-controller-manager" Mar 16 15:36:26 crc kubenswrapper[5120]: I0316 15:36:26.270970 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="58fd4e88-9c10-43f9-87f9-13b8faa0efc6" containerName="oc" Mar 16 15:36:26 crc kubenswrapper[5120]: I0316 15:36:26.270978 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f66781c9-aef5-4298-9f8a-b7f217906ed7" containerName="controller-manager" Mar 16 15:36:26 crc kubenswrapper[5120]: I0316 15:36:26.270987 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f7dbc7e1ee9c187a863ef9b473fad27b" containerName="startup-monitor" Mar 16 15:36:26 crc kubenswrapper[5120]: I0316 15:36:26.279008 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-route-controller-manager/route-controller-manager-665d558945-zjfpw" Mar 16 15:36:26 crc kubenswrapper[5120]: I0316 15:36:26.281880 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-route-controller-manager/route-controller-manager-665d558945-zjfpw"] Mar 16 15:36:26 crc kubenswrapper[5120]: I0316 15:36:26.300216 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-controller-manager/controller-manager-f9b686f9-h6xzg"] Mar 16 15:36:26 crc kubenswrapper[5120]: I0316 15:36:26.303220 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-controller-manager/controller-manager-f9b686f9-h6xzg"] Mar 16 15:36:26 crc kubenswrapper[5120]: I0316 15:36:26.303306 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-controller-manager/controller-manager-f9b686f9-h6xzg" Mar 16 15:36:26 crc kubenswrapper[5120]: I0316 15:36:26.413580 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f66781c9-aef5-4298-9f8a-b7f217906ed7-serving-cert\") pod \"f66781c9-aef5-4298-9f8a-b7f217906ed7\" (UID: \"f66781c9-aef5-4298-9f8a-b7f217906ed7\") " Mar 16 15:36:26 crc kubenswrapper[5120]: I0316 15:36:26.413663 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/94a5c5c7-67a9-4631-bdee-296422d882c4-config\") pod \"94a5c5c7-67a9-4631-bdee-296422d882c4\" (UID: \"94a5c5c7-67a9-4631-bdee-296422d882c4\") " Mar 16 15:36:26 crc kubenswrapper[5120]: I0316 15:36:26.413705 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f66781c9-aef5-4298-9f8a-b7f217906ed7-tmp\") pod \"f66781c9-aef5-4298-9f8a-b7f217906ed7\" (UID: \"f66781c9-aef5-4298-9f8a-b7f217906ed7\") " Mar 16 15:36:26 crc kubenswrapper[5120]: I0316 15:36:26.413722 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/94a5c5c7-67a9-4631-bdee-296422d882c4-serving-cert\") pod \"94a5c5c7-67a9-4631-bdee-296422d882c4\" (UID: \"94a5c5c7-67a9-4631-bdee-296422d882c4\") " Mar 16 15:36:26 crc kubenswrapper[5120]: I0316 15:36:26.413739 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nq9w4\" (UniqueName: \"kubernetes.io/projected/94a5c5c7-67a9-4631-bdee-296422d882c4-kube-api-access-nq9w4\") pod \"94a5c5c7-67a9-4631-bdee-296422d882c4\" (UID: \"94a5c5c7-67a9-4631-bdee-296422d882c4\") " Mar 16 15:36:26 crc kubenswrapper[5120]: I0316 15:36:26.413779 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/f66781c9-aef5-4298-9f8a-b7f217906ed7-proxy-ca-bundles\") pod \"f66781c9-aef5-4298-9f8a-b7f217906ed7\" (UID: \"f66781c9-aef5-4298-9f8a-b7f217906ed7\") " Mar 16 15:36:26 crc kubenswrapper[5120]: I0316 15:36:26.413820 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/94a5c5c7-67a9-4631-bdee-296422d882c4-client-ca\") pod \"94a5c5c7-67a9-4631-bdee-296422d882c4\" (UID: \"94a5c5c7-67a9-4631-bdee-296422d882c4\") " Mar 16 15:36:26 crc kubenswrapper[5120]: I0316 15:36:26.413859 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f66781c9-aef5-4298-9f8a-b7f217906ed7-config\") pod \"f66781c9-aef5-4298-9f8a-b7f217906ed7\" (UID: \"f66781c9-aef5-4298-9f8a-b7f217906ed7\") " Mar 16 15:36:26 crc kubenswrapper[5120]: I0316 15:36:26.413877 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/94a5c5c7-67a9-4631-bdee-296422d882c4-tmp\") pod \"94a5c5c7-67a9-4631-bdee-296422d882c4\" (UID: \"94a5c5c7-67a9-4631-bdee-296422d882c4\") " Mar 16 15:36:26 crc kubenswrapper[5120]: I0316 15:36:26.413894 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/f66781c9-aef5-4298-9f8a-b7f217906ed7-client-ca\") pod \"f66781c9-aef5-4298-9f8a-b7f217906ed7\" (UID: \"f66781c9-aef5-4298-9f8a-b7f217906ed7\") " Mar 16 15:36:26 crc kubenswrapper[5120]: I0316 15:36:26.413923 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fdn8d\" (UniqueName: \"kubernetes.io/projected/f66781c9-aef5-4298-9f8a-b7f217906ed7-kube-api-access-fdn8d\") pod \"f66781c9-aef5-4298-9f8a-b7f217906ed7\" (UID: \"f66781c9-aef5-4298-9f8a-b7f217906ed7\") " Mar 16 15:36:26 crc kubenswrapper[5120]: I0316 15:36:26.414346 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f66781c9-aef5-4298-9f8a-b7f217906ed7-tmp" (OuterVolumeSpecName: "tmp") pod "f66781c9-aef5-4298-9f8a-b7f217906ed7" (UID: "f66781c9-aef5-4298-9f8a-b7f217906ed7"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:36:26 crc kubenswrapper[5120]: I0316 15:36:26.414808 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/94a5c5c7-67a9-4631-bdee-296422d882c4-client-ca" (OuterVolumeSpecName: "client-ca") pod "94a5c5c7-67a9-4631-bdee-296422d882c4" (UID: "94a5c5c7-67a9-4631-bdee-296422d882c4"). InnerVolumeSpecName "client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:36:26 crc kubenswrapper[5120]: I0316 15:36:26.415008 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f66781c9-aef5-4298-9f8a-b7f217906ed7-proxy-ca-bundles" (OuterVolumeSpecName: "proxy-ca-bundles") pod "f66781c9-aef5-4298-9f8a-b7f217906ed7" (UID: "f66781c9-aef5-4298-9f8a-b7f217906ed7"). InnerVolumeSpecName "proxy-ca-bundles". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:36:26 crc kubenswrapper[5120]: I0316 15:36:26.415034 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94a5c5c7-67a9-4631-bdee-296422d882c4-tmp" (OuterVolumeSpecName: "tmp") pod "94a5c5c7-67a9-4631-bdee-296422d882c4" (UID: "94a5c5c7-67a9-4631-bdee-296422d882c4"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:36:26 crc kubenswrapper[5120]: I0316 15:36:26.415220 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f66781c9-aef5-4298-9f8a-b7f217906ed7-client-ca" (OuterVolumeSpecName: "client-ca") pod "f66781c9-aef5-4298-9f8a-b7f217906ed7" (UID: "f66781c9-aef5-4298-9f8a-b7f217906ed7"). InnerVolumeSpecName "client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:36:26 crc kubenswrapper[5120]: I0316 15:36:26.415205 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f66781c9-aef5-4298-9f8a-b7f217906ed7-config" (OuterVolumeSpecName: "config") pod "f66781c9-aef5-4298-9f8a-b7f217906ed7" (UID: "f66781c9-aef5-4298-9f8a-b7f217906ed7"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:36:26 crc kubenswrapper[5120]: I0316 15:36:26.415333 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/94a5c5c7-67a9-4631-bdee-296422d882c4-config" (OuterVolumeSpecName: "config") pod "94a5c5c7-67a9-4631-bdee-296422d882c4" (UID: "94a5c5c7-67a9-4631-bdee-296422d882c4"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:36:26 crc kubenswrapper[5120]: I0316 15:36:26.415404 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/970668fb-4299-4094-b9a8-8e86555fe520-serving-cert\") pod \"route-controller-manager-665d558945-zjfpw\" (UID: \"970668fb-4299-4094-b9a8-8e86555fe520\") " pod="openshift-route-controller-manager/route-controller-manager-665d558945-zjfpw" Mar 16 15:36:26 crc kubenswrapper[5120]: I0316 15:36:26.415490 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/18252234-4dd9-4818-b6cb-862f9f67f15b-tmp\") pod \"controller-manager-f9b686f9-h6xzg\" (UID: \"18252234-4dd9-4818-b6cb-862f9f67f15b\") " pod="openshift-controller-manager/controller-manager-f9b686f9-h6xzg" Mar 16 15:36:26 crc kubenswrapper[5120]: I0316 15:36:26.415513 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/18252234-4dd9-4818-b6cb-862f9f67f15b-client-ca\") pod \"controller-manager-f9b686f9-h6xzg\" (UID: \"18252234-4dd9-4818-b6cb-862f9f67f15b\") " pod="openshift-controller-manager/controller-manager-f9b686f9-h6xzg" Mar 16 15:36:26 crc kubenswrapper[5120]: I0316 15:36:26.415538 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/970668fb-4299-4094-b9a8-8e86555fe520-config\") pod \"route-controller-manager-665d558945-zjfpw\" (UID: \"970668fb-4299-4094-b9a8-8e86555fe520\") " pod="openshift-route-controller-manager/route-controller-manager-665d558945-zjfpw" Mar 16 15:36:26 crc kubenswrapper[5120]: I0316 15:36:26.415554 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/18252234-4dd9-4818-b6cb-862f9f67f15b-serving-cert\") pod \"controller-manager-f9b686f9-h6xzg\" (UID: \"18252234-4dd9-4818-b6cb-862f9f67f15b\") " pod="openshift-controller-manager/controller-manager-f9b686f9-h6xzg" Mar 16 15:36:26 crc kubenswrapper[5120]: I0316 15:36:26.415619 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/970668fb-4299-4094-b9a8-8e86555fe520-client-ca\") pod \"route-controller-manager-665d558945-zjfpw\" (UID: \"970668fb-4299-4094-b9a8-8e86555fe520\") " pod="openshift-route-controller-manager/route-controller-manager-665d558945-zjfpw" Mar 16 15:36:26 crc kubenswrapper[5120]: I0316 15:36:26.415679 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqvrf\" (UniqueName: \"kubernetes.io/projected/970668fb-4299-4094-b9a8-8e86555fe520-kube-api-access-wqvrf\") pod \"route-controller-manager-665d558945-zjfpw\" (UID: \"970668fb-4299-4094-b9a8-8e86555fe520\") " pod="openshift-route-controller-manager/route-controller-manager-665d558945-zjfpw" Mar 16 15:36:26 crc kubenswrapper[5120]: I0316 15:36:26.415716 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ww78l\" (UniqueName: \"kubernetes.io/projected/18252234-4dd9-4818-b6cb-862f9f67f15b-kube-api-access-ww78l\") pod \"controller-manager-f9b686f9-h6xzg\" (UID: \"18252234-4dd9-4818-b6cb-862f9f67f15b\") " pod="openshift-controller-manager/controller-manager-f9b686f9-h6xzg" Mar 16 15:36:26 crc kubenswrapper[5120]: I0316 15:36:26.415862 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/18252234-4dd9-4818-b6cb-862f9f67f15b-config\") pod \"controller-manager-f9b686f9-h6xzg\" (UID: \"18252234-4dd9-4818-b6cb-862f9f67f15b\") " pod="openshift-controller-manager/controller-manager-f9b686f9-h6xzg" Mar 16 15:36:26 crc kubenswrapper[5120]: I0316 15:36:26.415884 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/18252234-4dd9-4818-b6cb-862f9f67f15b-proxy-ca-bundles\") pod \"controller-manager-f9b686f9-h6xzg\" (UID: \"18252234-4dd9-4818-b6cb-862f9f67f15b\") " pod="openshift-controller-manager/controller-manager-f9b686f9-h6xzg" Mar 16 15:36:26 crc kubenswrapper[5120]: I0316 15:36:26.415957 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/970668fb-4299-4094-b9a8-8e86555fe520-tmp\") pod \"route-controller-manager-665d558945-zjfpw\" (UID: \"970668fb-4299-4094-b9a8-8e86555fe520\") " pod="openshift-route-controller-manager/route-controller-manager-665d558945-zjfpw" Mar 16 15:36:26 crc kubenswrapper[5120]: I0316 15:36:26.416035 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f66781c9-aef5-4298-9f8a-b7f217906ed7-config\") on node \"crc\" DevicePath \"\"" Mar 16 15:36:26 crc kubenswrapper[5120]: I0316 15:36:26.416051 5120 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/94a5c5c7-67a9-4631-bdee-296422d882c4-tmp\") on node \"crc\" DevicePath \"\"" Mar 16 15:36:26 crc kubenswrapper[5120]: I0316 15:36:26.416059 5120 reconciler_common.go:299] "Volume detached for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/f66781c9-aef5-4298-9f8a-b7f217906ed7-client-ca\") on node \"crc\" DevicePath \"\"" Mar 16 15:36:26 crc kubenswrapper[5120]: I0316 15:36:26.416069 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/94a5c5c7-67a9-4631-bdee-296422d882c4-config\") on node \"crc\" DevicePath \"\"" Mar 16 15:36:26 crc kubenswrapper[5120]: I0316 15:36:26.416093 5120 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f66781c9-aef5-4298-9f8a-b7f217906ed7-tmp\") on node \"crc\" DevicePath \"\"" Mar 16 15:36:26 crc kubenswrapper[5120]: I0316 15:36:26.416100 5120 reconciler_common.go:299] "Volume detached for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/f66781c9-aef5-4298-9f8a-b7f217906ed7-proxy-ca-bundles\") on node \"crc\" DevicePath \"\"" Mar 16 15:36:26 crc kubenswrapper[5120]: I0316 15:36:26.416108 5120 reconciler_common.go:299] "Volume detached for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/94a5c5c7-67a9-4631-bdee-296422d882c4-client-ca\") on node \"crc\" DevicePath \"\"" Mar 16 15:36:26 crc kubenswrapper[5120]: I0316 15:36:26.423971 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f66781c9-aef5-4298-9f8a-b7f217906ed7-serving-cert" (OuterVolumeSpecName: "serving-cert") pod "f66781c9-aef5-4298-9f8a-b7f217906ed7" (UID: "f66781c9-aef5-4298-9f8a-b7f217906ed7"). InnerVolumeSpecName "serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:36:26 crc kubenswrapper[5120]: I0316 15:36:26.424030 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f66781c9-aef5-4298-9f8a-b7f217906ed7-kube-api-access-fdn8d" (OuterVolumeSpecName: "kube-api-access-fdn8d") pod "f66781c9-aef5-4298-9f8a-b7f217906ed7" (UID: "f66781c9-aef5-4298-9f8a-b7f217906ed7"). InnerVolumeSpecName "kube-api-access-fdn8d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:36:26 crc kubenswrapper[5120]: I0316 15:36:26.424256 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/94a5c5c7-67a9-4631-bdee-296422d882c4-serving-cert" (OuterVolumeSpecName: "serving-cert") pod "94a5c5c7-67a9-4631-bdee-296422d882c4" (UID: "94a5c5c7-67a9-4631-bdee-296422d882c4"). InnerVolumeSpecName "serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:36:26 crc kubenswrapper[5120]: I0316 15:36:26.424430 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94a5c5c7-67a9-4631-bdee-296422d882c4-kube-api-access-nq9w4" (OuterVolumeSpecName: "kube-api-access-nq9w4") pod "94a5c5c7-67a9-4631-bdee-296422d882c4" (UID: "94a5c5c7-67a9-4631-bdee-296422d882c4"). InnerVolumeSpecName "kube-api-access-nq9w4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:36:26 crc kubenswrapper[5120]: I0316 15:36:26.517660 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ww78l\" (UniqueName: \"kubernetes.io/projected/18252234-4dd9-4818-b6cb-862f9f67f15b-kube-api-access-ww78l\") pod \"controller-manager-f9b686f9-h6xzg\" (UID: \"18252234-4dd9-4818-b6cb-862f9f67f15b\") " pod="openshift-controller-manager/controller-manager-f9b686f9-h6xzg" Mar 16 15:36:26 crc kubenswrapper[5120]: I0316 15:36:26.517798 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/18252234-4dd9-4818-b6cb-862f9f67f15b-config\") pod \"controller-manager-f9b686f9-h6xzg\" (UID: \"18252234-4dd9-4818-b6cb-862f9f67f15b\") " pod="openshift-controller-manager/controller-manager-f9b686f9-h6xzg" Mar 16 15:36:26 crc kubenswrapper[5120]: I0316 15:36:26.517848 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/18252234-4dd9-4818-b6cb-862f9f67f15b-proxy-ca-bundles\") pod \"controller-manager-f9b686f9-h6xzg\" (UID: \"18252234-4dd9-4818-b6cb-862f9f67f15b\") " pod="openshift-controller-manager/controller-manager-f9b686f9-h6xzg" Mar 16 15:36:26 crc kubenswrapper[5120]: I0316 15:36:26.517961 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/970668fb-4299-4094-b9a8-8e86555fe520-tmp\") pod \"route-controller-manager-665d558945-zjfpw\" (UID: \"970668fb-4299-4094-b9a8-8e86555fe520\") " pod="openshift-route-controller-manager/route-controller-manager-665d558945-zjfpw" Mar 16 15:36:26 crc kubenswrapper[5120]: I0316 15:36:26.518025 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/970668fb-4299-4094-b9a8-8e86555fe520-serving-cert\") pod \"route-controller-manager-665d558945-zjfpw\" (UID: \"970668fb-4299-4094-b9a8-8e86555fe520\") " pod="openshift-route-controller-manager/route-controller-manager-665d558945-zjfpw" Mar 16 15:36:26 crc kubenswrapper[5120]: I0316 15:36:26.518123 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/18252234-4dd9-4818-b6cb-862f9f67f15b-tmp\") pod \"controller-manager-f9b686f9-h6xzg\" (UID: \"18252234-4dd9-4818-b6cb-862f9f67f15b\") " pod="openshift-controller-manager/controller-manager-f9b686f9-h6xzg" Mar 16 15:36:26 crc kubenswrapper[5120]: I0316 15:36:26.518167 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/18252234-4dd9-4818-b6cb-862f9f67f15b-client-ca\") pod \"controller-manager-f9b686f9-h6xzg\" (UID: \"18252234-4dd9-4818-b6cb-862f9f67f15b\") " pod="openshift-controller-manager/controller-manager-f9b686f9-h6xzg" Mar 16 15:36:26 crc kubenswrapper[5120]: I0316 15:36:26.518235 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/970668fb-4299-4094-b9a8-8e86555fe520-config\") pod \"route-controller-manager-665d558945-zjfpw\" (UID: \"970668fb-4299-4094-b9a8-8e86555fe520\") " pod="openshift-route-controller-manager/route-controller-manager-665d558945-zjfpw" Mar 16 15:36:26 crc kubenswrapper[5120]: I0316 15:36:26.518281 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/18252234-4dd9-4818-b6cb-862f9f67f15b-serving-cert\") pod \"controller-manager-f9b686f9-h6xzg\" (UID: \"18252234-4dd9-4818-b6cb-862f9f67f15b\") " pod="openshift-controller-manager/controller-manager-f9b686f9-h6xzg" Mar 16 15:36:26 crc kubenswrapper[5120]: I0316 15:36:26.518354 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/970668fb-4299-4094-b9a8-8e86555fe520-client-ca\") pod \"route-controller-manager-665d558945-zjfpw\" (UID: \"970668fb-4299-4094-b9a8-8e86555fe520\") " pod="openshift-route-controller-manager/route-controller-manager-665d558945-zjfpw" Mar 16 15:36:26 crc kubenswrapper[5120]: I0316 15:36:26.518402 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wqvrf\" (UniqueName: \"kubernetes.io/projected/970668fb-4299-4094-b9a8-8e86555fe520-kube-api-access-wqvrf\") pod \"route-controller-manager-665d558945-zjfpw\" (UID: \"970668fb-4299-4094-b9a8-8e86555fe520\") " pod="openshift-route-controller-manager/route-controller-manager-665d558945-zjfpw" Mar 16 15:36:26 crc kubenswrapper[5120]: I0316 15:36:26.518544 5120 reconciler_common.go:299] "Volume detached for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/94a5c5c7-67a9-4631-bdee-296422d882c4-serving-cert\") on node \"crc\" DevicePath \"\"" Mar 16 15:36:26 crc kubenswrapper[5120]: I0316 15:36:26.518585 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nq9w4\" (UniqueName: \"kubernetes.io/projected/94a5c5c7-67a9-4631-bdee-296422d882c4-kube-api-access-nq9w4\") on node \"crc\" DevicePath \"\"" Mar 16 15:36:26 crc kubenswrapper[5120]: I0316 15:36:26.518614 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fdn8d\" (UniqueName: \"kubernetes.io/projected/f66781c9-aef5-4298-9f8a-b7f217906ed7-kube-api-access-fdn8d\") on node \"crc\" DevicePath \"\"" Mar 16 15:36:26 crc kubenswrapper[5120]: I0316 15:36:26.518640 5120 reconciler_common.go:299] "Volume detached for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f66781c9-aef5-4298-9f8a-b7f217906ed7-serving-cert\") on node \"crc\" DevicePath \"\"" Mar 16 15:36:26 crc kubenswrapper[5120]: I0316 15:36:26.519818 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/18252234-4dd9-4818-b6cb-862f9f67f15b-tmp\") pod \"controller-manager-f9b686f9-h6xzg\" (UID: \"18252234-4dd9-4818-b6cb-862f9f67f15b\") " pod="openshift-controller-manager/controller-manager-f9b686f9-h6xzg" Mar 16 15:36:26 crc kubenswrapper[5120]: I0316 15:36:26.520082 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/18252234-4dd9-4818-b6cb-862f9f67f15b-proxy-ca-bundles\") pod \"controller-manager-f9b686f9-h6xzg\" (UID: \"18252234-4dd9-4818-b6cb-862f9f67f15b\") " pod="openshift-controller-manager/controller-manager-f9b686f9-h6xzg" Mar 16 15:36:26 crc kubenswrapper[5120]: I0316 15:36:26.520680 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/970668fb-4299-4094-b9a8-8e86555fe520-client-ca\") pod \"route-controller-manager-665d558945-zjfpw\" (UID: \"970668fb-4299-4094-b9a8-8e86555fe520\") " pod="openshift-route-controller-manager/route-controller-manager-665d558945-zjfpw" Mar 16 15:36:26 crc kubenswrapper[5120]: I0316 15:36:26.521039 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/970668fb-4299-4094-b9a8-8e86555fe520-config\") pod \"route-controller-manager-665d558945-zjfpw\" (UID: \"970668fb-4299-4094-b9a8-8e86555fe520\") " pod="openshift-route-controller-manager/route-controller-manager-665d558945-zjfpw" Mar 16 15:36:26 crc kubenswrapper[5120]: I0316 15:36:26.521217 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/18252234-4dd9-4818-b6cb-862f9f67f15b-config\") pod \"controller-manager-f9b686f9-h6xzg\" (UID: \"18252234-4dd9-4818-b6cb-862f9f67f15b\") " pod="openshift-controller-manager/controller-manager-f9b686f9-h6xzg" Mar 16 15:36:26 crc kubenswrapper[5120]: I0316 15:36:26.521816 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/18252234-4dd9-4818-b6cb-862f9f67f15b-client-ca\") pod \"controller-manager-f9b686f9-h6xzg\" (UID: \"18252234-4dd9-4818-b6cb-862f9f67f15b\") " pod="openshift-controller-manager/controller-manager-f9b686f9-h6xzg" Mar 16 15:36:26 crc kubenswrapper[5120]: I0316 15:36:26.522037 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/970668fb-4299-4094-b9a8-8e86555fe520-tmp\") pod \"route-controller-manager-665d558945-zjfpw\" (UID: \"970668fb-4299-4094-b9a8-8e86555fe520\") " pod="openshift-route-controller-manager/route-controller-manager-665d558945-zjfpw" Mar 16 15:36:26 crc kubenswrapper[5120]: I0316 15:36:26.524353 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/18252234-4dd9-4818-b6cb-862f9f67f15b-serving-cert\") pod \"controller-manager-f9b686f9-h6xzg\" (UID: \"18252234-4dd9-4818-b6cb-862f9f67f15b\") " pod="openshift-controller-manager/controller-manager-f9b686f9-h6xzg" Mar 16 15:36:26 crc kubenswrapper[5120]: I0316 15:36:26.524609 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/970668fb-4299-4094-b9a8-8e86555fe520-serving-cert\") pod \"route-controller-manager-665d558945-zjfpw\" (UID: \"970668fb-4299-4094-b9a8-8e86555fe520\") " pod="openshift-route-controller-manager/route-controller-manager-665d558945-zjfpw" Mar 16 15:36:26 crc kubenswrapper[5120]: I0316 15:36:26.537222 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ww78l\" (UniqueName: \"kubernetes.io/projected/18252234-4dd9-4818-b6cb-862f9f67f15b-kube-api-access-ww78l\") pod \"controller-manager-f9b686f9-h6xzg\" (UID: \"18252234-4dd9-4818-b6cb-862f9f67f15b\") " pod="openshift-controller-manager/controller-manager-f9b686f9-h6xzg" Mar 16 15:36:26 crc kubenswrapper[5120]: I0316 15:36:26.537317 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqvrf\" (UniqueName: \"kubernetes.io/projected/970668fb-4299-4094-b9a8-8e86555fe520-kube-api-access-wqvrf\") pod \"route-controller-manager-665d558945-zjfpw\" (UID: \"970668fb-4299-4094-b9a8-8e86555fe520\") " pod="openshift-route-controller-manager/route-controller-manager-665d558945-zjfpw" Mar 16 15:36:26 crc kubenswrapper[5120]: I0316 15:36:26.639806 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-route-controller-manager/route-controller-manager-665d558945-zjfpw" Mar 16 15:36:26 crc kubenswrapper[5120]: I0316 15:36:26.643930 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-controller-manager/controller-manager-f9b686f9-h6xzg" Mar 16 15:36:26 crc kubenswrapper[5120]: I0316 15:36:26.860252 5120 generic.go:358] "Generic (PLEG): container finished" podID="f66781c9-aef5-4298-9f8a-b7f217906ed7" containerID="bd404a00b5bf827a50672a875e79a5ad0a50295e84bba99fe6601c1295819ac6" exitCode=0 Mar 16 15:36:26 crc kubenswrapper[5120]: I0316 15:36:26.860351 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-controller-manager/controller-manager-65b6cccf98-pbcg9" Mar 16 15:36:26 crc kubenswrapper[5120]: I0316 15:36:26.860360 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-controller-manager/controller-manager-65b6cccf98-pbcg9" event={"ID":"f66781c9-aef5-4298-9f8a-b7f217906ed7","Type":"ContainerDied","Data":"bd404a00b5bf827a50672a875e79a5ad0a50295e84bba99fe6601c1295819ac6"} Mar 16 15:36:26 crc kubenswrapper[5120]: I0316 15:36:26.860389 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-controller-manager/controller-manager-65b6cccf98-pbcg9" event={"ID":"f66781c9-aef5-4298-9f8a-b7f217906ed7","Type":"ContainerDied","Data":"935eabc4eebdb497d532085ac37b1d87c7e7d19ccc6db78442977759dc0bce80"} Mar 16 15:36:26 crc kubenswrapper[5120]: I0316 15:36:26.860428 5120 scope.go:117] "RemoveContainer" containerID="bd404a00b5bf827a50672a875e79a5ad0a50295e84bba99fe6601c1295819ac6" Mar 16 15:36:26 crc kubenswrapper[5120]: I0316 15:36:26.862353 5120 generic.go:358] "Generic (PLEG): container finished" podID="94a5c5c7-67a9-4631-bdee-296422d882c4" containerID="92a812faef174e48906c0daae6eb0df825de8d49f1ad9abaa9267aaac7ea19c9" exitCode=0 Mar 16 15:36:26 crc kubenswrapper[5120]: I0316 15:36:26.862425 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-route-controller-manager/route-controller-manager-776cdc94d6-b9gn7" Mar 16 15:36:26 crc kubenswrapper[5120]: I0316 15:36:26.862430 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-route-controller-manager/route-controller-manager-776cdc94d6-b9gn7" event={"ID":"94a5c5c7-67a9-4631-bdee-296422d882c4","Type":"ContainerDied","Data":"92a812faef174e48906c0daae6eb0df825de8d49f1ad9abaa9267aaac7ea19c9"} Mar 16 15:36:26 crc kubenswrapper[5120]: I0316 15:36:26.862472 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-route-controller-manager/route-controller-manager-776cdc94d6-b9gn7" event={"ID":"94a5c5c7-67a9-4631-bdee-296422d882c4","Type":"ContainerDied","Data":"f42249e5e7876f42dd08bc331815f54d4096faa8a145e3142d11756be8f66f23"} Mar 16 15:36:26 crc kubenswrapper[5120]: I0316 15:36:26.865060 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-route-controller-manager/route-controller-manager-665d558945-zjfpw"] Mar 16 15:36:26 crc kubenswrapper[5120]: W0316 15:36:26.869225 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod970668fb_4299_4094_b9a8_8e86555fe520.slice/crio-93c32f61045836e724abc893257ffc195d98c07a2e3401ba7ec2c4013521cd49 WatchSource:0}: Error finding container 93c32f61045836e724abc893257ffc195d98c07a2e3401ba7ec2c4013521cd49: Status 404 returned error can't find the container with id 93c32f61045836e724abc893257ffc195d98c07a2e3401ba7ec2c4013521cd49 Mar 16 15:36:26 crc kubenswrapper[5120]: I0316 15:36:26.878114 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-controller-manager/controller-manager-65b6cccf98-pbcg9"] Mar 16 15:36:26 crc kubenswrapper[5120]: I0316 15:36:26.881872 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-controller-manager/controller-manager-65b6cccf98-pbcg9"] Mar 16 15:36:26 crc kubenswrapper[5120]: I0316 15:36:26.882457 5120 scope.go:117] "RemoveContainer" containerID="bd404a00b5bf827a50672a875e79a5ad0a50295e84bba99fe6601c1295819ac6" Mar 16 15:36:26 crc kubenswrapper[5120]: E0316 15:36:26.882896 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd404a00b5bf827a50672a875e79a5ad0a50295e84bba99fe6601c1295819ac6\": container with ID starting with bd404a00b5bf827a50672a875e79a5ad0a50295e84bba99fe6601c1295819ac6 not found: ID does not exist" containerID="bd404a00b5bf827a50672a875e79a5ad0a50295e84bba99fe6601c1295819ac6" Mar 16 15:36:26 crc kubenswrapper[5120]: I0316 15:36:26.882930 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd404a00b5bf827a50672a875e79a5ad0a50295e84bba99fe6601c1295819ac6"} err="failed to get container status \"bd404a00b5bf827a50672a875e79a5ad0a50295e84bba99fe6601c1295819ac6\": rpc error: code = NotFound desc = could not find container \"bd404a00b5bf827a50672a875e79a5ad0a50295e84bba99fe6601c1295819ac6\": container with ID starting with bd404a00b5bf827a50672a875e79a5ad0a50295e84bba99fe6601c1295819ac6 not found: ID does not exist" Mar 16 15:36:26 crc kubenswrapper[5120]: I0316 15:36:26.882954 5120 scope.go:117] "RemoveContainer" containerID="92a812faef174e48906c0daae6eb0df825de8d49f1ad9abaa9267aaac7ea19c9" Mar 16 15:36:26 crc kubenswrapper[5120]: I0316 15:36:26.893463 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-route-controller-manager/route-controller-manager-776cdc94d6-b9gn7"] Mar 16 15:36:26 crc kubenswrapper[5120]: I0316 15:36:26.897053 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-route-controller-manager/route-controller-manager-776cdc94d6-b9gn7"] Mar 16 15:36:26 crc kubenswrapper[5120]: I0316 15:36:26.900464 5120 scope.go:117] "RemoveContainer" containerID="92a812faef174e48906c0daae6eb0df825de8d49f1ad9abaa9267aaac7ea19c9" Mar 16 15:36:26 crc kubenswrapper[5120]: E0316 15:36:26.900906 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"92a812faef174e48906c0daae6eb0df825de8d49f1ad9abaa9267aaac7ea19c9\": container with ID starting with 92a812faef174e48906c0daae6eb0df825de8d49f1ad9abaa9267aaac7ea19c9 not found: ID does not exist" containerID="92a812faef174e48906c0daae6eb0df825de8d49f1ad9abaa9267aaac7ea19c9" Mar 16 15:36:26 crc kubenswrapper[5120]: I0316 15:36:26.900943 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92a812faef174e48906c0daae6eb0df825de8d49f1ad9abaa9267aaac7ea19c9"} err="failed to get container status \"92a812faef174e48906c0daae6eb0df825de8d49f1ad9abaa9267aaac7ea19c9\": rpc error: code = NotFound desc = could not find container \"92a812faef174e48906c0daae6eb0df825de8d49f1ad9abaa9267aaac7ea19c9\": container with ID starting with 92a812faef174e48906c0daae6eb0df825de8d49f1ad9abaa9267aaac7ea19c9 not found: ID does not exist" Mar 16 15:36:26 crc kubenswrapper[5120]: W0316 15:36:26.903815 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18252234_4dd9_4818_b6cb_862f9f67f15b.slice/crio-d57c88d7cc86e4474fe5bf2e6347b208b3625d8d8816f09cc3ad926c031805d2 WatchSource:0}: Error finding container d57c88d7cc86e4474fe5bf2e6347b208b3625d8d8816f09cc3ad926c031805d2: Status 404 returned error can't find the container with id d57c88d7cc86e4474fe5bf2e6347b208b3625d8d8816f09cc3ad926c031805d2 Mar 16 15:36:26 crc kubenswrapper[5120]: I0316 15:36:26.928823 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-controller-manager/controller-manager-f9b686f9-h6xzg"] Mar 16 15:36:27 crc kubenswrapper[5120]: I0316 15:36:27.871908 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-route-controller-manager/route-controller-manager-665d558945-zjfpw" event={"ID":"970668fb-4299-4094-b9a8-8e86555fe520","Type":"ContainerStarted","Data":"1202d4b853528cd87b5cddd982f74f24d5d63562da269d2dd5e6fd101179b88f"} Mar 16 15:36:27 crc kubenswrapper[5120]: I0316 15:36:27.872367 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-route-controller-manager/route-controller-manager-665d558945-zjfpw" event={"ID":"970668fb-4299-4094-b9a8-8e86555fe520","Type":"ContainerStarted","Data":"93c32f61045836e724abc893257ffc195d98c07a2e3401ba7ec2c4013521cd49"} Mar 16 15:36:27 crc kubenswrapper[5120]: I0316 15:36:27.872531 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-route-controller-manager/route-controller-manager-665d558945-zjfpw" Mar 16 15:36:27 crc kubenswrapper[5120]: I0316 15:36:27.877683 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-controller-manager/controller-manager-f9b686f9-h6xzg" event={"ID":"18252234-4dd9-4818-b6cb-862f9f67f15b","Type":"ContainerStarted","Data":"cfe539ae262e0df93896223a3ee2ab5312f55f17659238e5eb8233c2b0e0ef9b"} Mar 16 15:36:27 crc kubenswrapper[5120]: I0316 15:36:27.877731 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-controller-manager/controller-manager-f9b686f9-h6xzg" event={"ID":"18252234-4dd9-4818-b6cb-862f9f67f15b","Type":"ContainerStarted","Data":"d57c88d7cc86e4474fe5bf2e6347b208b3625d8d8816f09cc3ad926c031805d2"} Mar 16 15:36:27 crc kubenswrapper[5120]: I0316 15:36:27.881059 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-controller-manager/controller-manager-f9b686f9-h6xzg" Mar 16 15:36:27 crc kubenswrapper[5120]: I0316 15:36:27.889072 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-controller-manager/controller-manager-f9b686f9-h6xzg" Mar 16 15:36:27 crc kubenswrapper[5120]: I0316 15:36:27.899996 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-route-controller-manager/route-controller-manager-665d558945-zjfpw" podStartSLOduration=1.899978474 podStartE2EDuration="1.899978474s" podCreationTimestamp="2026-03-16 15:36:26 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:36:27.895310065 +0000 UTC m=+290.049241732" watchObservedRunningTime="2026-03-16 15:36:27.899978474 +0000 UTC m=+290.053910141" Mar 16 15:36:27 crc kubenswrapper[5120]: I0316 15:36:27.908033 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-route-controller-manager/route-controller-manager-665d558945-zjfpw" Mar 16 15:36:27 crc kubenswrapper[5120]: I0316 15:36:27.921006 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-controller-manager/controller-manager-f9b686f9-h6xzg" podStartSLOduration=1.920981679 podStartE2EDuration="1.920981679s" podCreationTimestamp="2026-03-16 15:36:26 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:36:27.91741274 +0000 UTC m=+290.071344427" watchObservedRunningTime="2026-03-16 15:36:27.920981679 +0000 UTC m=+290.074913346" Mar 16 15:36:28 crc kubenswrapper[5120]: I0316 15:36:28.669842 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94a5c5c7-67a9-4631-bdee-296422d882c4" path="/var/lib/kubelet/pods/94a5c5c7-67a9-4631-bdee-296422d882c4/volumes" Mar 16 15:36:28 crc kubenswrapper[5120]: I0316 15:36:28.670691 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f66781c9-aef5-4298-9f8a-b7f217906ed7" path="/var/lib/kubelet/pods/f66781c9-aef5-4298-9f8a-b7f217906ed7/volumes" Mar 16 15:36:35 crc kubenswrapper[5120]: I0316 15:36:35.034335 5120 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Mar 16 15:36:38 crc kubenswrapper[5120]: I0316 15:36:38.823647 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-crc_9f0bc7fcb0822a2c13eb2d22cd8c0641/kube-controller-manager/0.log" Mar 16 15:36:38 crc kubenswrapper[5120]: I0316 15:36:38.826045 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-crc_9f0bc7fcb0822a2c13eb2d22cd8c0641/kube-controller-manager/0.log" Mar 16 15:37:05 crc kubenswrapper[5120]: I0316 15:37:05.829063 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-route-controller-manager/route-controller-manager-665d558945-zjfpw"] Mar 16 15:37:05 crc kubenswrapper[5120]: I0316 15:37:05.829974 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-route-controller-manager/route-controller-manager-665d558945-zjfpw" podUID="970668fb-4299-4094-b9a8-8e86555fe520" containerName="route-controller-manager" containerID="cri-o://1202d4b853528cd87b5cddd982f74f24d5d63562da269d2dd5e6fd101179b88f" gracePeriod=30 Mar 16 15:37:06 crc kubenswrapper[5120]: I0316 15:37:06.118936 5120 generic.go:358] "Generic (PLEG): container finished" podID="970668fb-4299-4094-b9a8-8e86555fe520" containerID="1202d4b853528cd87b5cddd982f74f24d5d63562da269d2dd5e6fd101179b88f" exitCode=0 Mar 16 15:37:06 crc kubenswrapper[5120]: I0316 15:37:06.119003 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-route-controller-manager/route-controller-manager-665d558945-zjfpw" event={"ID":"970668fb-4299-4094-b9a8-8e86555fe520","Type":"ContainerDied","Data":"1202d4b853528cd87b5cddd982f74f24d5d63562da269d2dd5e6fd101179b88f"} Mar 16 15:37:06 crc kubenswrapper[5120]: I0316 15:37:06.256194 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-route-controller-manager/route-controller-manager-665d558945-zjfpw" Mar 16 15:37:06 crc kubenswrapper[5120]: I0316 15:37:06.291715 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-route-controller-manager/route-controller-manager-7d9bcd67b5-25vdp"] Mar 16 15:37:06 crc kubenswrapper[5120]: I0316 15:37:06.292346 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="970668fb-4299-4094-b9a8-8e86555fe520" containerName="route-controller-manager" Mar 16 15:37:06 crc kubenswrapper[5120]: I0316 15:37:06.292372 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="970668fb-4299-4094-b9a8-8e86555fe520" containerName="route-controller-manager" Mar 16 15:37:06 crc kubenswrapper[5120]: I0316 15:37:06.292527 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="970668fb-4299-4094-b9a8-8e86555fe520" containerName="route-controller-manager" Mar 16 15:37:06 crc kubenswrapper[5120]: I0316 15:37:06.296693 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-route-controller-manager/route-controller-manager-7d9bcd67b5-25vdp" Mar 16 15:37:06 crc kubenswrapper[5120]: I0316 15:37:06.310385 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-route-controller-manager/route-controller-manager-7d9bcd67b5-25vdp"] Mar 16 15:37:06 crc kubenswrapper[5120]: I0316 15:37:06.360476 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/970668fb-4299-4094-b9a8-8e86555fe520-tmp\") pod \"970668fb-4299-4094-b9a8-8e86555fe520\" (UID: \"970668fb-4299-4094-b9a8-8e86555fe520\") " Mar 16 15:37:06 crc kubenswrapper[5120]: I0316 15:37:06.360532 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/970668fb-4299-4094-b9a8-8e86555fe520-serving-cert\") pod \"970668fb-4299-4094-b9a8-8e86555fe520\" (UID: \"970668fb-4299-4094-b9a8-8e86555fe520\") " Mar 16 15:37:06 crc kubenswrapper[5120]: I0316 15:37:06.360641 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/970668fb-4299-4094-b9a8-8e86555fe520-config\") pod \"970668fb-4299-4094-b9a8-8e86555fe520\" (UID: \"970668fb-4299-4094-b9a8-8e86555fe520\") " Mar 16 15:37:06 crc kubenswrapper[5120]: I0316 15:37:06.360690 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wqvrf\" (UniqueName: \"kubernetes.io/projected/970668fb-4299-4094-b9a8-8e86555fe520-kube-api-access-wqvrf\") pod \"970668fb-4299-4094-b9a8-8e86555fe520\" (UID: \"970668fb-4299-4094-b9a8-8e86555fe520\") " Mar 16 15:37:06 crc kubenswrapper[5120]: I0316 15:37:06.360884 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/970668fb-4299-4094-b9a8-8e86555fe520-client-ca\") pod \"970668fb-4299-4094-b9a8-8e86555fe520\" (UID: \"970668fb-4299-4094-b9a8-8e86555fe520\") " Mar 16 15:37:06 crc kubenswrapper[5120]: I0316 15:37:06.361051 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/970668fb-4299-4094-b9a8-8e86555fe520-tmp" (OuterVolumeSpecName: "tmp") pod "970668fb-4299-4094-b9a8-8e86555fe520" (UID: "970668fb-4299-4094-b9a8-8e86555fe520"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:37:06 crc kubenswrapper[5120]: I0316 15:37:06.361105 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/78a58290-7622-400a-9001-8aab4a2545a8-config\") pod \"route-controller-manager-7d9bcd67b5-25vdp\" (UID: \"78a58290-7622-400a-9001-8aab4a2545a8\") " pod="openshift-route-controller-manager/route-controller-manager-7d9bcd67b5-25vdp" Mar 16 15:37:06 crc kubenswrapper[5120]: I0316 15:37:06.361221 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/78a58290-7622-400a-9001-8aab4a2545a8-client-ca\") pod \"route-controller-manager-7d9bcd67b5-25vdp\" (UID: \"78a58290-7622-400a-9001-8aab4a2545a8\") " pod="openshift-route-controller-manager/route-controller-manager-7d9bcd67b5-25vdp" Mar 16 15:37:06 crc kubenswrapper[5120]: I0316 15:37:06.361305 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/78a58290-7622-400a-9001-8aab4a2545a8-serving-cert\") pod \"route-controller-manager-7d9bcd67b5-25vdp\" (UID: \"78a58290-7622-400a-9001-8aab4a2545a8\") " pod="openshift-route-controller-manager/route-controller-manager-7d9bcd67b5-25vdp" Mar 16 15:37:06 crc kubenswrapper[5120]: I0316 15:37:06.361427 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/78a58290-7622-400a-9001-8aab4a2545a8-tmp\") pod \"route-controller-manager-7d9bcd67b5-25vdp\" (UID: \"78a58290-7622-400a-9001-8aab4a2545a8\") " pod="openshift-route-controller-manager/route-controller-manager-7d9bcd67b5-25vdp" Mar 16 15:37:06 crc kubenswrapper[5120]: I0316 15:37:06.361491 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xn7fp\" (UniqueName: \"kubernetes.io/projected/78a58290-7622-400a-9001-8aab4a2545a8-kube-api-access-xn7fp\") pod \"route-controller-manager-7d9bcd67b5-25vdp\" (UID: \"78a58290-7622-400a-9001-8aab4a2545a8\") " pod="openshift-route-controller-manager/route-controller-manager-7d9bcd67b5-25vdp" Mar 16 15:37:06 crc kubenswrapper[5120]: I0316 15:37:06.361606 5120 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/970668fb-4299-4094-b9a8-8e86555fe520-tmp\") on node \"crc\" DevicePath \"\"" Mar 16 15:37:06 crc kubenswrapper[5120]: I0316 15:37:06.361651 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/970668fb-4299-4094-b9a8-8e86555fe520-config" (OuterVolumeSpecName: "config") pod "970668fb-4299-4094-b9a8-8e86555fe520" (UID: "970668fb-4299-4094-b9a8-8e86555fe520"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:37:06 crc kubenswrapper[5120]: I0316 15:37:06.361627 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/970668fb-4299-4094-b9a8-8e86555fe520-client-ca" (OuterVolumeSpecName: "client-ca") pod "970668fb-4299-4094-b9a8-8e86555fe520" (UID: "970668fb-4299-4094-b9a8-8e86555fe520"). InnerVolumeSpecName "client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:37:06 crc kubenswrapper[5120]: I0316 15:37:06.366316 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/970668fb-4299-4094-b9a8-8e86555fe520-kube-api-access-wqvrf" (OuterVolumeSpecName: "kube-api-access-wqvrf") pod "970668fb-4299-4094-b9a8-8e86555fe520" (UID: "970668fb-4299-4094-b9a8-8e86555fe520"). InnerVolumeSpecName "kube-api-access-wqvrf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:37:06 crc kubenswrapper[5120]: I0316 15:37:06.368665 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/970668fb-4299-4094-b9a8-8e86555fe520-serving-cert" (OuterVolumeSpecName: "serving-cert") pod "970668fb-4299-4094-b9a8-8e86555fe520" (UID: "970668fb-4299-4094-b9a8-8e86555fe520"). InnerVolumeSpecName "serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:37:06 crc kubenswrapper[5120]: I0316 15:37:06.463401 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xn7fp\" (UniqueName: \"kubernetes.io/projected/78a58290-7622-400a-9001-8aab4a2545a8-kube-api-access-xn7fp\") pod \"route-controller-manager-7d9bcd67b5-25vdp\" (UID: \"78a58290-7622-400a-9001-8aab4a2545a8\") " pod="openshift-route-controller-manager/route-controller-manager-7d9bcd67b5-25vdp" Mar 16 15:37:06 crc kubenswrapper[5120]: I0316 15:37:06.463545 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/78a58290-7622-400a-9001-8aab4a2545a8-config\") pod \"route-controller-manager-7d9bcd67b5-25vdp\" (UID: \"78a58290-7622-400a-9001-8aab4a2545a8\") " pod="openshift-route-controller-manager/route-controller-manager-7d9bcd67b5-25vdp" Mar 16 15:37:06 crc kubenswrapper[5120]: I0316 15:37:06.463604 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/78a58290-7622-400a-9001-8aab4a2545a8-client-ca\") pod \"route-controller-manager-7d9bcd67b5-25vdp\" (UID: \"78a58290-7622-400a-9001-8aab4a2545a8\") " pod="openshift-route-controller-manager/route-controller-manager-7d9bcd67b5-25vdp" Mar 16 15:37:06 crc kubenswrapper[5120]: I0316 15:37:06.464049 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/78a58290-7622-400a-9001-8aab4a2545a8-serving-cert\") pod \"route-controller-manager-7d9bcd67b5-25vdp\" (UID: \"78a58290-7622-400a-9001-8aab4a2545a8\") " pod="openshift-route-controller-manager/route-controller-manager-7d9bcd67b5-25vdp" Mar 16 15:37:06 crc kubenswrapper[5120]: I0316 15:37:06.464179 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/78a58290-7622-400a-9001-8aab4a2545a8-tmp\") pod \"route-controller-manager-7d9bcd67b5-25vdp\" (UID: \"78a58290-7622-400a-9001-8aab4a2545a8\") " pod="openshift-route-controller-manager/route-controller-manager-7d9bcd67b5-25vdp" Mar 16 15:37:06 crc kubenswrapper[5120]: I0316 15:37:06.464353 5120 reconciler_common.go:299] "Volume detached for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/970668fb-4299-4094-b9a8-8e86555fe520-client-ca\") on node \"crc\" DevicePath \"\"" Mar 16 15:37:06 crc kubenswrapper[5120]: I0316 15:37:06.464389 5120 reconciler_common.go:299] "Volume detached for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/970668fb-4299-4094-b9a8-8e86555fe520-serving-cert\") on node \"crc\" DevicePath \"\"" Mar 16 15:37:06 crc kubenswrapper[5120]: I0316 15:37:06.464406 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/970668fb-4299-4094-b9a8-8e86555fe520-config\") on node \"crc\" DevicePath \"\"" Mar 16 15:37:06 crc kubenswrapper[5120]: I0316 15:37:06.464419 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wqvrf\" (UniqueName: \"kubernetes.io/projected/970668fb-4299-4094-b9a8-8e86555fe520-kube-api-access-wqvrf\") on node \"crc\" DevicePath \"\"" Mar 16 15:37:06 crc kubenswrapper[5120]: I0316 15:37:06.465042 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/78a58290-7622-400a-9001-8aab4a2545a8-tmp\") pod \"route-controller-manager-7d9bcd67b5-25vdp\" (UID: \"78a58290-7622-400a-9001-8aab4a2545a8\") " pod="openshift-route-controller-manager/route-controller-manager-7d9bcd67b5-25vdp" Mar 16 15:37:06 crc kubenswrapper[5120]: I0316 15:37:06.465417 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/78a58290-7622-400a-9001-8aab4a2545a8-client-ca\") pod \"route-controller-manager-7d9bcd67b5-25vdp\" (UID: \"78a58290-7622-400a-9001-8aab4a2545a8\") " pod="openshift-route-controller-manager/route-controller-manager-7d9bcd67b5-25vdp" Mar 16 15:37:06 crc kubenswrapper[5120]: I0316 15:37:06.466144 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/78a58290-7622-400a-9001-8aab4a2545a8-config\") pod \"route-controller-manager-7d9bcd67b5-25vdp\" (UID: \"78a58290-7622-400a-9001-8aab4a2545a8\") " pod="openshift-route-controller-manager/route-controller-manager-7d9bcd67b5-25vdp" Mar 16 15:37:06 crc kubenswrapper[5120]: I0316 15:37:06.469639 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/78a58290-7622-400a-9001-8aab4a2545a8-serving-cert\") pod \"route-controller-manager-7d9bcd67b5-25vdp\" (UID: \"78a58290-7622-400a-9001-8aab4a2545a8\") " pod="openshift-route-controller-manager/route-controller-manager-7d9bcd67b5-25vdp" Mar 16 15:37:06 crc kubenswrapper[5120]: I0316 15:37:06.485040 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xn7fp\" (UniqueName: \"kubernetes.io/projected/78a58290-7622-400a-9001-8aab4a2545a8-kube-api-access-xn7fp\") pod \"route-controller-manager-7d9bcd67b5-25vdp\" (UID: \"78a58290-7622-400a-9001-8aab4a2545a8\") " pod="openshift-route-controller-manager/route-controller-manager-7d9bcd67b5-25vdp" Mar 16 15:37:06 crc kubenswrapper[5120]: I0316 15:37:06.622434 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-route-controller-manager/route-controller-manager-7d9bcd67b5-25vdp" Mar 16 15:37:07 crc kubenswrapper[5120]: I0316 15:37:07.092946 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-route-controller-manager/route-controller-manager-7d9bcd67b5-25vdp"] Mar 16 15:37:07 crc kubenswrapper[5120]: I0316 15:37:07.103474 5120 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Mar 16 15:37:07 crc kubenswrapper[5120]: I0316 15:37:07.129170 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-route-controller-manager/route-controller-manager-665d558945-zjfpw" event={"ID":"970668fb-4299-4094-b9a8-8e86555fe520","Type":"ContainerDied","Data":"93c32f61045836e724abc893257ffc195d98c07a2e3401ba7ec2c4013521cd49"} Mar 16 15:37:07 crc kubenswrapper[5120]: I0316 15:37:07.129230 5120 scope.go:117] "RemoveContainer" containerID="1202d4b853528cd87b5cddd982f74f24d5d63562da269d2dd5e6fd101179b88f" Mar 16 15:37:07 crc kubenswrapper[5120]: I0316 15:37:07.129395 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-route-controller-manager/route-controller-manager-665d558945-zjfpw" Mar 16 15:37:07 crc kubenswrapper[5120]: I0316 15:37:07.132217 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-route-controller-manager/route-controller-manager-7d9bcd67b5-25vdp" event={"ID":"78a58290-7622-400a-9001-8aab4a2545a8","Type":"ContainerStarted","Data":"a4d983a3318755cca848f6f414806963835fa942320de9327bef7e9bbb9fdf62"} Mar 16 15:37:07 crc kubenswrapper[5120]: I0316 15:37:07.150550 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-route-controller-manager/route-controller-manager-665d558945-zjfpw"] Mar 16 15:37:07 crc kubenswrapper[5120]: I0316 15:37:07.154024 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-route-controller-manager/route-controller-manager-665d558945-zjfpw"] Mar 16 15:37:08 crc kubenswrapper[5120]: I0316 15:37:08.141117 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-route-controller-manager/route-controller-manager-7d9bcd67b5-25vdp" event={"ID":"78a58290-7622-400a-9001-8aab4a2545a8","Type":"ContainerStarted","Data":"0e2433d467547fa63fa8b4a06c22a9be85b5bf9a25032f27d9f3ad674c10961b"} Mar 16 15:37:08 crc kubenswrapper[5120]: I0316 15:37:08.142143 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-route-controller-manager/route-controller-manager-7d9bcd67b5-25vdp" Mar 16 15:37:08 crc kubenswrapper[5120]: I0316 15:37:08.152873 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-route-controller-manager/route-controller-manager-7d9bcd67b5-25vdp" Mar 16 15:37:08 crc kubenswrapper[5120]: I0316 15:37:08.162563 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-route-controller-manager/route-controller-manager-7d9bcd67b5-25vdp" podStartSLOduration=3.16255031 podStartE2EDuration="3.16255031s" podCreationTimestamp="2026-03-16 15:37:05 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:37:08.159820352 +0000 UTC m=+330.313752039" watchObservedRunningTime="2026-03-16 15:37:08.16255031 +0000 UTC m=+330.316481977" Mar 16 15:37:08 crc kubenswrapper[5120]: I0316 15:37:08.676620 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="970668fb-4299-4094-b9a8-8e86555fe520" path="/var/lib/kubelet/pods/970668fb-4299-4094-b9a8-8e86555fe520/volumes" Mar 16 15:37:25 crc kubenswrapper[5120]: I0316 15:37:25.828392 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-controller-manager/controller-manager-f9b686f9-h6xzg"] Mar 16 15:37:25 crc kubenswrapper[5120]: I0316 15:37:25.829710 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-controller-manager/controller-manager-f9b686f9-h6xzg" podUID="18252234-4dd9-4818-b6cb-862f9f67f15b" containerName="controller-manager" containerID="cri-o://cfe539ae262e0df93896223a3ee2ab5312f55f17659238e5eb8233c2b0e0ef9b" gracePeriod=30 Mar 16 15:37:26 crc kubenswrapper[5120]: I0316 15:37:26.217126 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-controller-manager/controller-manager-f9b686f9-h6xzg" Mar 16 15:37:26 crc kubenswrapper[5120]: I0316 15:37:26.240365 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-controller-manager/controller-manager-569899d9c5-5m8bp"] Mar 16 15:37:26 crc kubenswrapper[5120]: I0316 15:37:26.241170 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18252234-4dd9-4818-b6cb-862f9f67f15b" containerName="controller-manager" Mar 16 15:37:26 crc kubenswrapper[5120]: I0316 15:37:26.241267 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="18252234-4dd9-4818-b6cb-862f9f67f15b" containerName="controller-manager" Mar 16 15:37:26 crc kubenswrapper[5120]: I0316 15:37:26.241435 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="18252234-4dd9-4818-b6cb-862f9f67f15b" containerName="controller-manager" Mar 16 15:37:26 crc kubenswrapper[5120]: I0316 15:37:26.255266 5120 generic.go:358] "Generic (PLEG): container finished" podID="18252234-4dd9-4818-b6cb-862f9f67f15b" containerID="cfe539ae262e0df93896223a3ee2ab5312f55f17659238e5eb8233c2b0e0ef9b" exitCode=0 Mar 16 15:37:26 crc kubenswrapper[5120]: I0316 15:37:26.255857 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-controller-manager/controller-manager-f9b686f9-h6xzg" event={"ID":"18252234-4dd9-4818-b6cb-862f9f67f15b","Type":"ContainerDied","Data":"cfe539ae262e0df93896223a3ee2ab5312f55f17659238e5eb8233c2b0e0ef9b"} Mar 16 15:37:26 crc kubenswrapper[5120]: I0316 15:37:26.255889 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-controller-manager/controller-manager-f9b686f9-h6xzg" event={"ID":"18252234-4dd9-4818-b6cb-862f9f67f15b","Type":"ContainerDied","Data":"d57c88d7cc86e4474fe5bf2e6347b208b3625d8d8816f09cc3ad926c031805d2"} Mar 16 15:37:26 crc kubenswrapper[5120]: I0316 15:37:26.255907 5120 scope.go:117] "RemoveContainer" containerID="cfe539ae262e0df93896223a3ee2ab5312f55f17659238e5eb8233c2b0e0ef9b" Mar 16 15:37:26 crc kubenswrapper[5120]: I0316 15:37:26.256076 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-controller-manager/controller-manager-f9b686f9-h6xzg" Mar 16 15:37:26 crc kubenswrapper[5120]: I0316 15:37:26.256578 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-controller-manager/controller-manager-569899d9c5-5m8bp" Mar 16 15:37:26 crc kubenswrapper[5120]: I0316 15:37:26.267697 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-controller-manager/controller-manager-569899d9c5-5m8bp"] Mar 16 15:37:26 crc kubenswrapper[5120]: I0316 15:37:26.273781 5120 scope.go:117] "RemoveContainer" containerID="cfe539ae262e0df93896223a3ee2ab5312f55f17659238e5eb8233c2b0e0ef9b" Mar 16 15:37:26 crc kubenswrapper[5120]: E0316 15:37:26.274166 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cfe539ae262e0df93896223a3ee2ab5312f55f17659238e5eb8233c2b0e0ef9b\": container with ID starting with cfe539ae262e0df93896223a3ee2ab5312f55f17659238e5eb8233c2b0e0ef9b not found: ID does not exist" containerID="cfe539ae262e0df93896223a3ee2ab5312f55f17659238e5eb8233c2b0e0ef9b" Mar 16 15:37:26 crc kubenswrapper[5120]: I0316 15:37:26.274203 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfe539ae262e0df93896223a3ee2ab5312f55f17659238e5eb8233c2b0e0ef9b"} err="failed to get container status \"cfe539ae262e0df93896223a3ee2ab5312f55f17659238e5eb8233c2b0e0ef9b\": rpc error: code = NotFound desc = could not find container \"cfe539ae262e0df93896223a3ee2ab5312f55f17659238e5eb8233c2b0e0ef9b\": container with ID starting with cfe539ae262e0df93896223a3ee2ab5312f55f17659238e5eb8233c2b0e0ef9b not found: ID does not exist" Mar 16 15:37:26 crc kubenswrapper[5120]: I0316 15:37:26.331826 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/18252234-4dd9-4818-b6cb-862f9f67f15b-tmp\") pod \"18252234-4dd9-4818-b6cb-862f9f67f15b\" (UID: \"18252234-4dd9-4818-b6cb-862f9f67f15b\") " Mar 16 15:37:26 crc kubenswrapper[5120]: I0316 15:37:26.331885 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/18252234-4dd9-4818-b6cb-862f9f67f15b-proxy-ca-bundles\") pod \"18252234-4dd9-4818-b6cb-862f9f67f15b\" (UID: \"18252234-4dd9-4818-b6cb-862f9f67f15b\") " Mar 16 15:37:26 crc kubenswrapper[5120]: I0316 15:37:26.331931 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/18252234-4dd9-4818-b6cb-862f9f67f15b-serving-cert\") pod \"18252234-4dd9-4818-b6cb-862f9f67f15b\" (UID: \"18252234-4dd9-4818-b6cb-862f9f67f15b\") " Mar 16 15:37:26 crc kubenswrapper[5120]: I0316 15:37:26.331966 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/18252234-4dd9-4818-b6cb-862f9f67f15b-client-ca\") pod \"18252234-4dd9-4818-b6cb-862f9f67f15b\" (UID: \"18252234-4dd9-4818-b6cb-862f9f67f15b\") " Mar 16 15:37:26 crc kubenswrapper[5120]: I0316 15:37:26.331996 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ww78l\" (UniqueName: \"kubernetes.io/projected/18252234-4dd9-4818-b6cb-862f9f67f15b-kube-api-access-ww78l\") pod \"18252234-4dd9-4818-b6cb-862f9f67f15b\" (UID: \"18252234-4dd9-4818-b6cb-862f9f67f15b\") " Mar 16 15:37:26 crc kubenswrapper[5120]: I0316 15:37:26.332022 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/18252234-4dd9-4818-b6cb-862f9f67f15b-config\") pod \"18252234-4dd9-4818-b6cb-862f9f67f15b\" (UID: \"18252234-4dd9-4818-b6cb-862f9f67f15b\") " Mar 16 15:37:26 crc kubenswrapper[5120]: I0316 15:37:26.332982 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18252234-4dd9-4818-b6cb-862f9f67f15b-config" (OuterVolumeSpecName: "config") pod "18252234-4dd9-4818-b6cb-862f9f67f15b" (UID: "18252234-4dd9-4818-b6cb-862f9f67f15b"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:37:26 crc kubenswrapper[5120]: I0316 15:37:26.333330 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18252234-4dd9-4818-b6cb-862f9f67f15b-tmp" (OuterVolumeSpecName: "tmp") pod "18252234-4dd9-4818-b6cb-862f9f67f15b" (UID: "18252234-4dd9-4818-b6cb-862f9f67f15b"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:37:26 crc kubenswrapper[5120]: I0316 15:37:26.333422 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18252234-4dd9-4818-b6cb-862f9f67f15b-proxy-ca-bundles" (OuterVolumeSpecName: "proxy-ca-bundles") pod "18252234-4dd9-4818-b6cb-862f9f67f15b" (UID: "18252234-4dd9-4818-b6cb-862f9f67f15b"). InnerVolumeSpecName "proxy-ca-bundles". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:37:26 crc kubenswrapper[5120]: I0316 15:37:26.333835 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18252234-4dd9-4818-b6cb-862f9f67f15b-client-ca" (OuterVolumeSpecName: "client-ca") pod "18252234-4dd9-4818-b6cb-862f9f67f15b" (UID: "18252234-4dd9-4818-b6cb-862f9f67f15b"). InnerVolumeSpecName "client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:37:26 crc kubenswrapper[5120]: I0316 15:37:26.339232 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18252234-4dd9-4818-b6cb-862f9f67f15b-serving-cert" (OuterVolumeSpecName: "serving-cert") pod "18252234-4dd9-4818-b6cb-862f9f67f15b" (UID: "18252234-4dd9-4818-b6cb-862f9f67f15b"). InnerVolumeSpecName "serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:37:26 crc kubenswrapper[5120]: I0316 15:37:26.349887 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18252234-4dd9-4818-b6cb-862f9f67f15b-kube-api-access-ww78l" (OuterVolumeSpecName: "kube-api-access-ww78l") pod "18252234-4dd9-4818-b6cb-862f9f67f15b" (UID: "18252234-4dd9-4818-b6cb-862f9f67f15b"). InnerVolumeSpecName "kube-api-access-ww78l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:37:26 crc kubenswrapper[5120]: I0316 15:37:26.433548 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f7a9af76-9c5a-48fe-bd7f-f4682dbfe02c-serving-cert\") pod \"controller-manager-569899d9c5-5m8bp\" (UID: \"f7a9af76-9c5a-48fe-bd7f-f4682dbfe02c\") " pod="openshift-controller-manager/controller-manager-569899d9c5-5m8bp" Mar 16 15:37:26 crc kubenswrapper[5120]: I0316 15:37:26.433881 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f7a9af76-9c5a-48fe-bd7f-f4682dbfe02c-tmp\") pod \"controller-manager-569899d9c5-5m8bp\" (UID: \"f7a9af76-9c5a-48fe-bd7f-f4682dbfe02c\") " pod="openshift-controller-manager/controller-manager-569899d9c5-5m8bp" Mar 16 15:37:26 crc kubenswrapper[5120]: I0316 15:37:26.433906 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f7a9af76-9c5a-48fe-bd7f-f4682dbfe02c-config\") pod \"controller-manager-569899d9c5-5m8bp\" (UID: \"f7a9af76-9c5a-48fe-bd7f-f4682dbfe02c\") " pod="openshift-controller-manager/controller-manager-569899d9c5-5m8bp" Mar 16 15:37:26 crc kubenswrapper[5120]: I0316 15:37:26.433943 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/f7a9af76-9c5a-48fe-bd7f-f4682dbfe02c-client-ca\") pod \"controller-manager-569899d9c5-5m8bp\" (UID: \"f7a9af76-9c5a-48fe-bd7f-f4682dbfe02c\") " pod="openshift-controller-manager/controller-manager-569899d9c5-5m8bp" Mar 16 15:37:26 crc kubenswrapper[5120]: I0316 15:37:26.433985 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtbk8\" (UniqueName: \"kubernetes.io/projected/f7a9af76-9c5a-48fe-bd7f-f4682dbfe02c-kube-api-access-wtbk8\") pod \"controller-manager-569899d9c5-5m8bp\" (UID: \"f7a9af76-9c5a-48fe-bd7f-f4682dbfe02c\") " pod="openshift-controller-manager/controller-manager-569899d9c5-5m8bp" Mar 16 15:37:26 crc kubenswrapper[5120]: I0316 15:37:26.434034 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/f7a9af76-9c5a-48fe-bd7f-f4682dbfe02c-proxy-ca-bundles\") pod \"controller-manager-569899d9c5-5m8bp\" (UID: \"f7a9af76-9c5a-48fe-bd7f-f4682dbfe02c\") " pod="openshift-controller-manager/controller-manager-569899d9c5-5m8bp" Mar 16 15:37:26 crc kubenswrapper[5120]: I0316 15:37:26.434074 5120 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/18252234-4dd9-4818-b6cb-862f9f67f15b-tmp\") on node \"crc\" DevicePath \"\"" Mar 16 15:37:26 crc kubenswrapper[5120]: I0316 15:37:26.434087 5120 reconciler_common.go:299] "Volume detached for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/18252234-4dd9-4818-b6cb-862f9f67f15b-proxy-ca-bundles\") on node \"crc\" DevicePath \"\"" Mar 16 15:37:26 crc kubenswrapper[5120]: I0316 15:37:26.434095 5120 reconciler_common.go:299] "Volume detached for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/18252234-4dd9-4818-b6cb-862f9f67f15b-serving-cert\") on node \"crc\" DevicePath \"\"" Mar 16 15:37:26 crc kubenswrapper[5120]: I0316 15:37:26.434104 5120 reconciler_common.go:299] "Volume detached for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/18252234-4dd9-4818-b6cb-862f9f67f15b-client-ca\") on node \"crc\" DevicePath \"\"" Mar 16 15:37:26 crc kubenswrapper[5120]: I0316 15:37:26.434111 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ww78l\" (UniqueName: \"kubernetes.io/projected/18252234-4dd9-4818-b6cb-862f9f67f15b-kube-api-access-ww78l\") on node \"crc\" DevicePath \"\"" Mar 16 15:37:26 crc kubenswrapper[5120]: I0316 15:37:26.434119 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/18252234-4dd9-4818-b6cb-862f9f67f15b-config\") on node \"crc\" DevicePath \"\"" Mar 16 15:37:26 crc kubenswrapper[5120]: I0316 15:37:26.535232 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/f7a9af76-9c5a-48fe-bd7f-f4682dbfe02c-proxy-ca-bundles\") pod \"controller-manager-569899d9c5-5m8bp\" (UID: \"f7a9af76-9c5a-48fe-bd7f-f4682dbfe02c\") " pod="openshift-controller-manager/controller-manager-569899d9c5-5m8bp" Mar 16 15:37:26 crc kubenswrapper[5120]: I0316 15:37:26.535285 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f7a9af76-9c5a-48fe-bd7f-f4682dbfe02c-serving-cert\") pod \"controller-manager-569899d9c5-5m8bp\" (UID: \"f7a9af76-9c5a-48fe-bd7f-f4682dbfe02c\") " pod="openshift-controller-manager/controller-manager-569899d9c5-5m8bp" Mar 16 15:37:26 crc kubenswrapper[5120]: I0316 15:37:26.535301 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f7a9af76-9c5a-48fe-bd7f-f4682dbfe02c-tmp\") pod \"controller-manager-569899d9c5-5m8bp\" (UID: \"f7a9af76-9c5a-48fe-bd7f-f4682dbfe02c\") " pod="openshift-controller-manager/controller-manager-569899d9c5-5m8bp" Mar 16 15:37:26 crc kubenswrapper[5120]: I0316 15:37:26.535319 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f7a9af76-9c5a-48fe-bd7f-f4682dbfe02c-config\") pod \"controller-manager-569899d9c5-5m8bp\" (UID: \"f7a9af76-9c5a-48fe-bd7f-f4682dbfe02c\") " pod="openshift-controller-manager/controller-manager-569899d9c5-5m8bp" Mar 16 15:37:26 crc kubenswrapper[5120]: I0316 15:37:26.535346 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/f7a9af76-9c5a-48fe-bd7f-f4682dbfe02c-client-ca\") pod \"controller-manager-569899d9c5-5m8bp\" (UID: \"f7a9af76-9c5a-48fe-bd7f-f4682dbfe02c\") " pod="openshift-controller-manager/controller-manager-569899d9c5-5m8bp" Mar 16 15:37:26 crc kubenswrapper[5120]: I0316 15:37:26.536129 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f7a9af76-9c5a-48fe-bd7f-f4682dbfe02c-tmp\") pod \"controller-manager-569899d9c5-5m8bp\" (UID: \"f7a9af76-9c5a-48fe-bd7f-f4682dbfe02c\") " pod="openshift-controller-manager/controller-manager-569899d9c5-5m8bp" Mar 16 15:37:26 crc kubenswrapper[5120]: I0316 15:37:26.536412 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/f7a9af76-9c5a-48fe-bd7f-f4682dbfe02c-client-ca\") pod \"controller-manager-569899d9c5-5m8bp\" (UID: \"f7a9af76-9c5a-48fe-bd7f-f4682dbfe02c\") " pod="openshift-controller-manager/controller-manager-569899d9c5-5m8bp" Mar 16 15:37:26 crc kubenswrapper[5120]: I0316 15:37:26.535543 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wtbk8\" (UniqueName: \"kubernetes.io/projected/f7a9af76-9c5a-48fe-bd7f-f4682dbfe02c-kube-api-access-wtbk8\") pod \"controller-manager-569899d9c5-5m8bp\" (UID: \"f7a9af76-9c5a-48fe-bd7f-f4682dbfe02c\") " pod="openshift-controller-manager/controller-manager-569899d9c5-5m8bp" Mar 16 15:37:26 crc kubenswrapper[5120]: I0316 15:37:26.536596 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/f7a9af76-9c5a-48fe-bd7f-f4682dbfe02c-proxy-ca-bundles\") pod \"controller-manager-569899d9c5-5m8bp\" (UID: \"f7a9af76-9c5a-48fe-bd7f-f4682dbfe02c\") " pod="openshift-controller-manager/controller-manager-569899d9c5-5m8bp" Mar 16 15:37:26 crc kubenswrapper[5120]: I0316 15:37:26.537046 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f7a9af76-9c5a-48fe-bd7f-f4682dbfe02c-config\") pod \"controller-manager-569899d9c5-5m8bp\" (UID: \"f7a9af76-9c5a-48fe-bd7f-f4682dbfe02c\") " pod="openshift-controller-manager/controller-manager-569899d9c5-5m8bp" Mar 16 15:37:26 crc kubenswrapper[5120]: I0316 15:37:26.541180 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f7a9af76-9c5a-48fe-bd7f-f4682dbfe02c-serving-cert\") pod \"controller-manager-569899d9c5-5m8bp\" (UID: \"f7a9af76-9c5a-48fe-bd7f-f4682dbfe02c\") " pod="openshift-controller-manager/controller-manager-569899d9c5-5m8bp" Mar 16 15:37:26 crc kubenswrapper[5120]: I0316 15:37:26.560491 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtbk8\" (UniqueName: \"kubernetes.io/projected/f7a9af76-9c5a-48fe-bd7f-f4682dbfe02c-kube-api-access-wtbk8\") pod \"controller-manager-569899d9c5-5m8bp\" (UID: \"f7a9af76-9c5a-48fe-bd7f-f4682dbfe02c\") " pod="openshift-controller-manager/controller-manager-569899d9c5-5m8bp" Mar 16 15:37:26 crc kubenswrapper[5120]: I0316 15:37:26.569484 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-controller-manager/controller-manager-569899d9c5-5m8bp" Mar 16 15:37:26 crc kubenswrapper[5120]: I0316 15:37:26.587692 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-controller-manager/controller-manager-f9b686f9-h6xzg"] Mar 16 15:37:26 crc kubenswrapper[5120]: I0316 15:37:26.592628 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-controller-manager/controller-manager-f9b686f9-h6xzg"] Mar 16 15:37:26 crc kubenswrapper[5120]: I0316 15:37:26.684449 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="18252234-4dd9-4818-b6cb-862f9f67f15b" path="/var/lib/kubelet/pods/18252234-4dd9-4818-b6cb-862f9f67f15b/volumes" Mar 16 15:37:27 crc kubenswrapper[5120]: I0316 15:37:27.033565 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-controller-manager/controller-manager-569899d9c5-5m8bp"] Mar 16 15:37:27 crc kubenswrapper[5120]: I0316 15:37:27.264347 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-controller-manager/controller-manager-569899d9c5-5m8bp" event={"ID":"f7a9af76-9c5a-48fe-bd7f-f4682dbfe02c","Type":"ContainerStarted","Data":"72fb03d00e8919654d0ed1f56456c572342fea3c050b3b281d4984de788c176e"} Mar 16 15:37:27 crc kubenswrapper[5120]: I0316 15:37:27.264725 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-controller-manager/controller-manager-569899d9c5-5m8bp" Mar 16 15:37:27 crc kubenswrapper[5120]: I0316 15:37:27.264744 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-controller-manager/controller-manager-569899d9c5-5m8bp" event={"ID":"f7a9af76-9c5a-48fe-bd7f-f4682dbfe02c","Type":"ContainerStarted","Data":"962cda487dc678fac61c97dc4a7fb6a52b2e5b40a3424ad73571d3cbe66e7c74"} Mar 16 15:37:27 crc kubenswrapper[5120]: I0316 15:37:27.266412 5120 patch_prober.go:28] interesting pod/controller-manager-569899d9c5-5m8bp container/controller-manager namespace/openshift-controller-manager: Readiness probe status=failure output="Get \"https://10.217.0.64:8443/healthz\": dial tcp 10.217.0.64:8443: connect: connection refused" start-of-body= Mar 16 15:37:27 crc kubenswrapper[5120]: I0316 15:37:27.266508 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-controller-manager/controller-manager-569899d9c5-5m8bp" podUID="f7a9af76-9c5a-48fe-bd7f-f4682dbfe02c" containerName="controller-manager" probeResult="failure" output="Get \"https://10.217.0.64:8443/healthz\": dial tcp 10.217.0.64:8443: connect: connection refused" Mar 16 15:37:27 crc kubenswrapper[5120]: I0316 15:37:27.294803 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-controller-manager/controller-manager-569899d9c5-5m8bp" podStartSLOduration=2.294745061 podStartE2EDuration="2.294745061s" podCreationTimestamp="2026-03-16 15:37:25 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:37:27.287604346 +0000 UTC m=+349.441536083" watchObservedRunningTime="2026-03-16 15:37:27.294745061 +0000 UTC m=+349.448676748" Mar 16 15:37:28 crc kubenswrapper[5120]: I0316 15:37:28.275717 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-controller-manager/controller-manager-569899d9c5-5m8bp" Mar 16 15:37:47 crc kubenswrapper[5120]: I0316 15:37:47.529792 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/certified-operators-zz5g5"] Mar 16 15:37:47 crc kubenswrapper[5120]: I0316 15:37:47.530881 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-marketplace/certified-operators-zz5g5" podUID="f4f60942-f576-4e00-88be-a52a1e6d91ec" containerName="registry-server" containerID="cri-o://7460b0cb98ad635cff620c80660536aff790b2158c84428354a77cb54c999c04" gracePeriod=30 Mar 16 15:37:47 crc kubenswrapper[5120]: I0316 15:37:47.537445 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/community-operators-bzrbr"] Mar 16 15:37:47 crc kubenswrapper[5120]: I0316 15:37:47.537785 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-marketplace/community-operators-bzrbr" podUID="3529f46e-85a5-437e-8773-68d7dc6b6f9c" containerName="registry-server" containerID="cri-o://3d7dda4dbf9df13b317ca3762ba9297714e949ba042e4438903d54125ca9d6cb" gracePeriod=30 Mar 16 15:37:47 crc kubenswrapper[5120]: I0316 15:37:47.543584 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/marketplace-operator-547dbd544d-gp852"] Mar 16 15:37:47 crc kubenswrapper[5120]: I0316 15:37:47.543967 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-marketplace/marketplace-operator-547dbd544d-gp852" podUID="a0b763d7-65d4-41e1-9880-8f80e9686189" containerName="marketplace-operator" containerID="cri-o://b290fa074131590a8c67ec37d076e49585b240607eb405eea8f8db741f6c6119" gracePeriod=30 Mar 16 15:37:47 crc kubenswrapper[5120]: I0316 15:37:47.565577 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/marketplace-operator-547dbd544d-rt66v"] Mar 16 15:37:47 crc kubenswrapper[5120]: I0316 15:37:47.573228 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/marketplace-operator-547dbd544d-rt66v" Mar 16 15:37:47 crc kubenswrapper[5120]: I0316 15:37:47.577096 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-marketplace-p8tsg"] Mar 16 15:37:47 crc kubenswrapper[5120]: I0316 15:37:47.577435 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-marketplace/redhat-marketplace-p8tsg" podUID="888cb38a-98cf-4897-95ec-879b29e12656" containerName="registry-server" containerID="cri-o://6d93225931be81d0a8775a2594501f3ebc57ce59fb959d0cf4ce0575233ccef0" gracePeriod=30 Mar 16 15:37:47 crc kubenswrapper[5120]: I0316 15:37:47.583575 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/marketplace-operator-547dbd544d-rt66v"] Mar 16 15:37:47 crc kubenswrapper[5120]: I0316 15:37:47.589723 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-operators-5d9tn"] Mar 16 15:37:47 crc kubenswrapper[5120]: I0316 15:37:47.590078 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-marketplace/redhat-operators-5d9tn" podUID="fe2f5127-13d1-4799-9af9-bb0736bf53e9" containerName="registry-server" containerID="cri-o://afbaab0478d915cc2c2f1def4a4e2a2a0ebbdfd4bffeafa5625973c57f92aa86" gracePeriod=30 Mar 16 15:37:47 crc kubenswrapper[5120]: I0316 15:37:47.720661 5120 generic.go:358] "Generic (PLEG): container finished" podID="a0b763d7-65d4-41e1-9880-8f80e9686189" containerID="b290fa074131590a8c67ec37d076e49585b240607eb405eea8f8db741f6c6119" exitCode=0 Mar 16 15:37:47 crc kubenswrapper[5120]: I0316 15:37:47.721069 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/marketplace-operator-547dbd544d-gp852" event={"ID":"a0b763d7-65d4-41e1-9880-8f80e9686189","Type":"ContainerDied","Data":"b290fa074131590a8c67ec37d076e49585b240607eb405eea8f8db741f6c6119"} Mar 16 15:37:47 crc kubenswrapper[5120]: I0316 15:37:47.721102 5120 scope.go:117] "RemoveContainer" containerID="0c33d76eb2d5ce3e65e693dbd6ef8dc3118bfcdd1cd6f0be9ce39935423c32e6" Mar 16 15:37:47 crc kubenswrapper[5120]: I0316 15:37:47.729343 5120 generic.go:358] "Generic (PLEG): container finished" podID="f4f60942-f576-4e00-88be-a52a1e6d91ec" containerID="7460b0cb98ad635cff620c80660536aff790b2158c84428354a77cb54c999c04" exitCode=0 Mar 16 15:37:47 crc kubenswrapper[5120]: I0316 15:37:47.729489 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-zz5g5" event={"ID":"f4f60942-f576-4e00-88be-a52a1e6d91ec","Type":"ContainerDied","Data":"7460b0cb98ad635cff620c80660536aff790b2158c84428354a77cb54c999c04"} Mar 16 15:37:47 crc kubenswrapper[5120]: I0316 15:37:47.736619 5120 generic.go:358] "Generic (PLEG): container finished" podID="888cb38a-98cf-4897-95ec-879b29e12656" containerID="6d93225931be81d0a8775a2594501f3ebc57ce59fb959d0cf4ce0575233ccef0" exitCode=0 Mar 16 15:37:47 crc kubenswrapper[5120]: I0316 15:37:47.736697 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-p8tsg" event={"ID":"888cb38a-98cf-4897-95ec-879b29e12656","Type":"ContainerDied","Data":"6d93225931be81d0a8775a2594501f3ebc57ce59fb959d0cf4ce0575233ccef0"} Mar 16 15:37:47 crc kubenswrapper[5120]: I0316 15:37:47.741546 5120 generic.go:358] "Generic (PLEG): container finished" podID="3529f46e-85a5-437e-8773-68d7dc6b6f9c" containerID="3d7dda4dbf9df13b317ca3762ba9297714e949ba042e4438903d54125ca9d6cb" exitCode=0 Mar 16 15:37:47 crc kubenswrapper[5120]: I0316 15:37:47.741659 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-bzrbr" event={"ID":"3529f46e-85a5-437e-8773-68d7dc6b6f9c","Type":"ContainerDied","Data":"3d7dda4dbf9df13b317ca3762ba9297714e949ba042e4438903d54125ca9d6cb"} Mar 16 15:37:47 crc kubenswrapper[5120]: I0316 15:37:47.747445 5120 generic.go:358] "Generic (PLEG): container finished" podID="fe2f5127-13d1-4799-9af9-bb0736bf53e9" containerID="afbaab0478d915cc2c2f1def4a4e2a2a0ebbdfd4bffeafa5625973c57f92aa86" exitCode=0 Mar 16 15:37:47 crc kubenswrapper[5120]: I0316 15:37:47.747526 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-5d9tn" event={"ID":"fe2f5127-13d1-4799-9af9-bb0736bf53e9","Type":"ContainerDied","Data":"afbaab0478d915cc2c2f1def4a4e2a2a0ebbdfd4bffeafa5625973c57f92aa86"} Mar 16 15:37:47 crc kubenswrapper[5120]: I0316 15:37:47.766879 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lb85t\" (UniqueName: \"kubernetes.io/projected/970f8645-801d-4b4b-8571-a39bde23f382-kube-api-access-lb85t\") pod \"marketplace-operator-547dbd544d-rt66v\" (UID: \"970f8645-801d-4b4b-8571-a39bde23f382\") " pod="openshift-marketplace/marketplace-operator-547dbd544d-rt66v" Mar 16 15:37:47 crc kubenswrapper[5120]: I0316 15:37:47.766924 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"marketplace-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/970f8645-801d-4b4b-8571-a39bde23f382-marketplace-trusted-ca\") pod \"marketplace-operator-547dbd544d-rt66v\" (UID: \"970f8645-801d-4b4b-8571-a39bde23f382\") " pod="openshift-marketplace/marketplace-operator-547dbd544d-rt66v" Mar 16 15:37:47 crc kubenswrapper[5120]: I0316 15:37:47.766978 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/970f8645-801d-4b4b-8571-a39bde23f382-tmp\") pod \"marketplace-operator-547dbd544d-rt66v\" (UID: \"970f8645-801d-4b4b-8571-a39bde23f382\") " pod="openshift-marketplace/marketplace-operator-547dbd544d-rt66v" Mar 16 15:37:47 crc kubenswrapper[5120]: I0316 15:37:47.766998 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"marketplace-operator-metrics\" (UniqueName: \"kubernetes.io/secret/970f8645-801d-4b4b-8571-a39bde23f382-marketplace-operator-metrics\") pod \"marketplace-operator-547dbd544d-rt66v\" (UID: \"970f8645-801d-4b4b-8571-a39bde23f382\") " pod="openshift-marketplace/marketplace-operator-547dbd544d-rt66v" Mar 16 15:37:47 crc kubenswrapper[5120]: E0316 15:37:47.868224 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 6d93225931be81d0a8775a2594501f3ebc57ce59fb959d0cf4ce0575233ccef0 is running failed: container process not found" containerID="6d93225931be81d0a8775a2594501f3ebc57ce59fb959d0cf4ce0575233ccef0" cmd=["grpc_health_probe","-addr=:50051"] Mar 16 15:37:47 crc kubenswrapper[5120]: I0316 15:37:47.868257 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/970f8645-801d-4b4b-8571-a39bde23f382-tmp\") pod \"marketplace-operator-547dbd544d-rt66v\" (UID: \"970f8645-801d-4b4b-8571-a39bde23f382\") " pod="openshift-marketplace/marketplace-operator-547dbd544d-rt66v" Mar 16 15:37:47 crc kubenswrapper[5120]: I0316 15:37:47.868643 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"marketplace-operator-metrics\" (UniqueName: \"kubernetes.io/secret/970f8645-801d-4b4b-8571-a39bde23f382-marketplace-operator-metrics\") pod \"marketplace-operator-547dbd544d-rt66v\" (UID: \"970f8645-801d-4b4b-8571-a39bde23f382\") " pod="openshift-marketplace/marketplace-operator-547dbd544d-rt66v" Mar 16 15:37:47 crc kubenswrapper[5120]: I0316 15:37:47.868854 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lb85t\" (UniqueName: \"kubernetes.io/projected/970f8645-801d-4b4b-8571-a39bde23f382-kube-api-access-lb85t\") pod \"marketplace-operator-547dbd544d-rt66v\" (UID: \"970f8645-801d-4b4b-8571-a39bde23f382\") " pod="openshift-marketplace/marketplace-operator-547dbd544d-rt66v" Mar 16 15:37:47 crc kubenswrapper[5120]: I0316 15:37:47.868989 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"marketplace-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/970f8645-801d-4b4b-8571-a39bde23f382-marketplace-trusted-ca\") pod \"marketplace-operator-547dbd544d-rt66v\" (UID: \"970f8645-801d-4b4b-8571-a39bde23f382\") " pod="openshift-marketplace/marketplace-operator-547dbd544d-rt66v" Mar 16 15:37:47 crc kubenswrapper[5120]: I0316 15:37:47.869295 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/970f8645-801d-4b4b-8571-a39bde23f382-tmp\") pod \"marketplace-operator-547dbd544d-rt66v\" (UID: \"970f8645-801d-4b4b-8571-a39bde23f382\") " pod="openshift-marketplace/marketplace-operator-547dbd544d-rt66v" Mar 16 15:37:47 crc kubenswrapper[5120]: I0316 15:37:47.870322 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"marketplace-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/970f8645-801d-4b4b-8571-a39bde23f382-marketplace-trusted-ca\") pod \"marketplace-operator-547dbd544d-rt66v\" (UID: \"970f8645-801d-4b4b-8571-a39bde23f382\") " pod="openshift-marketplace/marketplace-operator-547dbd544d-rt66v" Mar 16 15:37:47 crc kubenswrapper[5120]: E0316 15:37:47.870872 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 6d93225931be81d0a8775a2594501f3ebc57ce59fb959d0cf4ce0575233ccef0 is running failed: container process not found" containerID="6d93225931be81d0a8775a2594501f3ebc57ce59fb959d0cf4ce0575233ccef0" cmd=["grpc_health_probe","-addr=:50051"] Mar 16 15:37:47 crc kubenswrapper[5120]: E0316 15:37:47.871158 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 6d93225931be81d0a8775a2594501f3ebc57ce59fb959d0cf4ce0575233ccef0 is running failed: container process not found" containerID="6d93225931be81d0a8775a2594501f3ebc57ce59fb959d0cf4ce0575233ccef0" cmd=["grpc_health_probe","-addr=:50051"] Mar 16 15:37:47 crc kubenswrapper[5120]: E0316 15:37:47.871254 5120 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 6d93225931be81d0a8775a2594501f3ebc57ce59fb959d0cf4ce0575233ccef0 is running failed: container process not found" probeType="Readiness" pod="openshift-marketplace/redhat-marketplace-p8tsg" podUID="888cb38a-98cf-4897-95ec-879b29e12656" containerName="registry-server" probeResult="unknown" Mar 16 15:37:47 crc kubenswrapper[5120]: I0316 15:37:47.875972 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"marketplace-operator-metrics\" (UniqueName: \"kubernetes.io/secret/970f8645-801d-4b4b-8571-a39bde23f382-marketplace-operator-metrics\") pod \"marketplace-operator-547dbd544d-rt66v\" (UID: \"970f8645-801d-4b4b-8571-a39bde23f382\") " pod="openshift-marketplace/marketplace-operator-547dbd544d-rt66v" Mar 16 15:37:47 crc kubenswrapper[5120]: I0316 15:37:47.886465 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lb85t\" (UniqueName: \"kubernetes.io/projected/970f8645-801d-4b4b-8571-a39bde23f382-kube-api-access-lb85t\") pod \"marketplace-operator-547dbd544d-rt66v\" (UID: \"970f8645-801d-4b4b-8571-a39bde23f382\") " pod="openshift-marketplace/marketplace-operator-547dbd544d-rt66v" Mar 16 15:37:48 crc kubenswrapper[5120]: I0316 15:37:48.024402 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/marketplace-operator-547dbd544d-rt66v" Mar 16 15:37:48 crc kubenswrapper[5120]: I0316 15:37:48.025650 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-zz5g5" Mar 16 15:37:48 crc kubenswrapper[5120]: I0316 15:37:48.070418 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/marketplace-operator-547dbd544d-gp852" Mar 16 15:37:48 crc kubenswrapper[5120]: I0316 15:37:48.107598 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-bzrbr" Mar 16 15:37:48 crc kubenswrapper[5120]: I0316 15:37:48.179265 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a0b763d7-65d4-41e1-9880-8f80e9686189-tmp\") pod \"a0b763d7-65d4-41e1-9880-8f80e9686189\" (UID: \"a0b763d7-65d4-41e1-9880-8f80e9686189\") " Mar 16 15:37:48 crc kubenswrapper[5120]: I0316 15:37:48.180135 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0b763d7-65d4-41e1-9880-8f80e9686189-tmp" (OuterVolumeSpecName: "tmp") pod "a0b763d7-65d4-41e1-9880-8f80e9686189" (UID: "a0b763d7-65d4-41e1-9880-8f80e9686189"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:37:48 crc kubenswrapper[5120]: I0316 15:37:48.180948 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a0b763d7-65d4-41e1-9880-8f80e9686189-marketplace-trusted-ca" (OuterVolumeSpecName: "marketplace-trusted-ca") pod "a0b763d7-65d4-41e1-9880-8f80e9686189" (UID: "a0b763d7-65d4-41e1-9880-8f80e9686189"). InnerVolumeSpecName "marketplace-trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:37:48 crc kubenswrapper[5120]: I0316 15:37:48.181039 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"marketplace-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a0b763d7-65d4-41e1-9880-8f80e9686189-marketplace-trusted-ca\") pod \"a0b763d7-65d4-41e1-9880-8f80e9686189\" (UID: \"a0b763d7-65d4-41e1-9880-8f80e9686189\") " Mar 16 15:37:48 crc kubenswrapper[5120]: I0316 15:37:48.181588 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/f4f60942-f576-4e00-88be-a52a1e6d91ec-utilities\") pod \"f4f60942-f576-4e00-88be-a52a1e6d91ec\" (UID: \"f4f60942-f576-4e00-88be-a52a1e6d91ec\") " Mar 16 15:37:48 crc kubenswrapper[5120]: I0316 15:37:48.182297 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/3529f46e-85a5-437e-8773-68d7dc6b6f9c-catalog-content\") pod \"3529f46e-85a5-437e-8773-68d7dc6b6f9c\" (UID: \"3529f46e-85a5-437e-8773-68d7dc6b6f9c\") " Mar 16 15:37:48 crc kubenswrapper[5120]: I0316 15:37:48.183179 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f9v6n\" (UniqueName: \"kubernetes.io/projected/a0b763d7-65d4-41e1-9880-8f80e9686189-kube-api-access-f9v6n\") pod \"a0b763d7-65d4-41e1-9880-8f80e9686189\" (UID: \"a0b763d7-65d4-41e1-9880-8f80e9686189\") " Mar 16 15:37:48 crc kubenswrapper[5120]: I0316 15:37:48.183701 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7k84n\" (UniqueName: \"kubernetes.io/projected/3529f46e-85a5-437e-8773-68d7dc6b6f9c-kube-api-access-7k84n\") pod \"3529f46e-85a5-437e-8773-68d7dc6b6f9c\" (UID: \"3529f46e-85a5-437e-8773-68d7dc6b6f9c\") " Mar 16 15:37:48 crc kubenswrapper[5120]: I0316 15:37:48.184142 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"marketplace-operator-metrics\" (UniqueName: \"kubernetes.io/secret/a0b763d7-65d4-41e1-9880-8f80e9686189-marketplace-operator-metrics\") pod \"a0b763d7-65d4-41e1-9880-8f80e9686189\" (UID: \"a0b763d7-65d4-41e1-9880-8f80e9686189\") " Mar 16 15:37:48 crc kubenswrapper[5120]: I0316 15:37:48.184521 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/3529f46e-85a5-437e-8773-68d7dc6b6f9c-utilities\") pod \"3529f46e-85a5-437e-8773-68d7dc6b6f9c\" (UID: \"3529f46e-85a5-437e-8773-68d7dc6b6f9c\") " Mar 16 15:37:48 crc kubenswrapper[5120]: I0316 15:37:48.185561 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4f60942-f576-4e00-88be-a52a1e6d91ec-utilities" (OuterVolumeSpecName: "utilities") pod "f4f60942-f576-4e00-88be-a52a1e6d91ec" (UID: "f4f60942-f576-4e00-88be-a52a1e6d91ec"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:37:48 crc kubenswrapper[5120]: I0316 15:37:48.188808 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/f4f60942-f576-4e00-88be-a52a1e6d91ec-catalog-content\") pod \"f4f60942-f576-4e00-88be-a52a1e6d91ec\" (UID: \"f4f60942-f576-4e00-88be-a52a1e6d91ec\") " Mar 16 15:37:48 crc kubenswrapper[5120]: I0316 15:37:48.188885 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bpxkd\" (UniqueName: \"kubernetes.io/projected/f4f60942-f576-4e00-88be-a52a1e6d91ec-kube-api-access-bpxkd\") pod \"f4f60942-f576-4e00-88be-a52a1e6d91ec\" (UID: \"f4f60942-f576-4e00-88be-a52a1e6d91ec\") " Mar 16 15:37:48 crc kubenswrapper[5120]: I0316 15:37:48.189368 5120 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a0b763d7-65d4-41e1-9880-8f80e9686189-tmp\") on node \"crc\" DevicePath \"\"" Mar 16 15:37:48 crc kubenswrapper[5120]: I0316 15:37:48.189386 5120 reconciler_common.go:299] "Volume detached for volume \"marketplace-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a0b763d7-65d4-41e1-9880-8f80e9686189-marketplace-trusted-ca\") on node \"crc\" DevicePath \"\"" Mar 16 15:37:48 crc kubenswrapper[5120]: I0316 15:37:48.189398 5120 reconciler_common.go:299] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/f4f60942-f576-4e00-88be-a52a1e6d91ec-utilities\") on node \"crc\" DevicePath \"\"" Mar 16 15:37:48 crc kubenswrapper[5120]: I0316 15:37:48.190742 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3529f46e-85a5-437e-8773-68d7dc6b6f9c-utilities" (OuterVolumeSpecName: "utilities") pod "3529f46e-85a5-437e-8773-68d7dc6b6f9c" (UID: "3529f46e-85a5-437e-8773-68d7dc6b6f9c"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:37:48 crc kubenswrapper[5120]: I0316 15:37:48.193677 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4f60942-f576-4e00-88be-a52a1e6d91ec-kube-api-access-bpxkd" (OuterVolumeSpecName: "kube-api-access-bpxkd") pod "f4f60942-f576-4e00-88be-a52a1e6d91ec" (UID: "f4f60942-f576-4e00-88be-a52a1e6d91ec"). InnerVolumeSpecName "kube-api-access-bpxkd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:37:48 crc kubenswrapper[5120]: I0316 15:37:48.193699 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0b763d7-65d4-41e1-9880-8f80e9686189-kube-api-access-f9v6n" (OuterVolumeSpecName: "kube-api-access-f9v6n") pod "a0b763d7-65d4-41e1-9880-8f80e9686189" (UID: "a0b763d7-65d4-41e1-9880-8f80e9686189"). InnerVolumeSpecName "kube-api-access-f9v6n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:37:48 crc kubenswrapper[5120]: I0316 15:37:48.201881 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a0b763d7-65d4-41e1-9880-8f80e9686189-marketplace-operator-metrics" (OuterVolumeSpecName: "marketplace-operator-metrics") pod "a0b763d7-65d4-41e1-9880-8f80e9686189" (UID: "a0b763d7-65d4-41e1-9880-8f80e9686189"). InnerVolumeSpecName "marketplace-operator-metrics". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:37:48 crc kubenswrapper[5120]: I0316 15:37:48.223202 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3529f46e-85a5-437e-8773-68d7dc6b6f9c-kube-api-access-7k84n" (OuterVolumeSpecName: "kube-api-access-7k84n") pod "3529f46e-85a5-437e-8773-68d7dc6b6f9c" (UID: "3529f46e-85a5-437e-8773-68d7dc6b6f9c"). InnerVolumeSpecName "kube-api-access-7k84n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:37:48 crc kubenswrapper[5120]: I0316 15:37:48.241128 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-p8tsg" Mar 16 15:37:48 crc kubenswrapper[5120]: I0316 15:37:48.242300 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3529f46e-85a5-437e-8773-68d7dc6b6f9c-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "3529f46e-85a5-437e-8773-68d7dc6b6f9c" (UID: "3529f46e-85a5-437e-8773-68d7dc6b6f9c"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:37:48 crc kubenswrapper[5120]: I0316 15:37:48.249195 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-5d9tn" Mar 16 15:37:48 crc kubenswrapper[5120]: I0316 15:37:48.251491 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4f60942-f576-4e00-88be-a52a1e6d91ec-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "f4f60942-f576-4e00-88be-a52a1e6d91ec" (UID: "f4f60942-f576-4e00-88be-a52a1e6d91ec"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:37:48 crc kubenswrapper[5120]: I0316 15:37:48.290800 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jbp2s\" (UniqueName: \"kubernetes.io/projected/888cb38a-98cf-4897-95ec-879b29e12656-kube-api-access-jbp2s\") pod \"888cb38a-98cf-4897-95ec-879b29e12656\" (UID: \"888cb38a-98cf-4897-95ec-879b29e12656\") " Mar 16 15:37:48 crc kubenswrapper[5120]: I0316 15:37:48.290891 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/fe2f5127-13d1-4799-9af9-bb0736bf53e9-catalog-content\") pod \"fe2f5127-13d1-4799-9af9-bb0736bf53e9\" (UID: \"fe2f5127-13d1-4799-9af9-bb0736bf53e9\") " Mar 16 15:37:48 crc kubenswrapper[5120]: I0316 15:37:48.290929 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/888cb38a-98cf-4897-95ec-879b29e12656-utilities\") pod \"888cb38a-98cf-4897-95ec-879b29e12656\" (UID: \"888cb38a-98cf-4897-95ec-879b29e12656\") " Mar 16 15:37:48 crc kubenswrapper[5120]: I0316 15:37:48.290986 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8fhlq\" (UniqueName: \"kubernetes.io/projected/fe2f5127-13d1-4799-9af9-bb0736bf53e9-kube-api-access-8fhlq\") pod \"fe2f5127-13d1-4799-9af9-bb0736bf53e9\" (UID: \"fe2f5127-13d1-4799-9af9-bb0736bf53e9\") " Mar 16 15:37:48 crc kubenswrapper[5120]: I0316 15:37:48.291047 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/fe2f5127-13d1-4799-9af9-bb0736bf53e9-utilities\") pod \"fe2f5127-13d1-4799-9af9-bb0736bf53e9\" (UID: \"fe2f5127-13d1-4799-9af9-bb0736bf53e9\") " Mar 16 15:37:48 crc kubenswrapper[5120]: I0316 15:37:48.291068 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/888cb38a-98cf-4897-95ec-879b29e12656-catalog-content\") pod \"888cb38a-98cf-4897-95ec-879b29e12656\" (UID: \"888cb38a-98cf-4897-95ec-879b29e12656\") " Mar 16 15:37:48 crc kubenswrapper[5120]: I0316 15:37:48.291669 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f9v6n\" (UniqueName: \"kubernetes.io/projected/a0b763d7-65d4-41e1-9880-8f80e9686189-kube-api-access-f9v6n\") on node \"crc\" DevicePath \"\"" Mar 16 15:37:48 crc kubenswrapper[5120]: I0316 15:37:48.291693 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7k84n\" (UniqueName: \"kubernetes.io/projected/3529f46e-85a5-437e-8773-68d7dc6b6f9c-kube-api-access-7k84n\") on node \"crc\" DevicePath \"\"" Mar 16 15:37:48 crc kubenswrapper[5120]: I0316 15:37:48.291704 5120 reconciler_common.go:299] "Volume detached for volume \"marketplace-operator-metrics\" (UniqueName: \"kubernetes.io/secret/a0b763d7-65d4-41e1-9880-8f80e9686189-marketplace-operator-metrics\") on node \"crc\" DevicePath \"\"" Mar 16 15:37:48 crc kubenswrapper[5120]: I0316 15:37:48.291715 5120 reconciler_common.go:299] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/3529f46e-85a5-437e-8773-68d7dc6b6f9c-utilities\") on node \"crc\" DevicePath \"\"" Mar 16 15:37:48 crc kubenswrapper[5120]: I0316 15:37:48.291728 5120 reconciler_common.go:299] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/f4f60942-f576-4e00-88be-a52a1e6d91ec-catalog-content\") on node \"crc\" DevicePath \"\"" Mar 16 15:37:48 crc kubenswrapper[5120]: I0316 15:37:48.291738 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bpxkd\" (UniqueName: \"kubernetes.io/projected/f4f60942-f576-4e00-88be-a52a1e6d91ec-kube-api-access-bpxkd\") on node \"crc\" DevicePath \"\"" Mar 16 15:37:48 crc kubenswrapper[5120]: I0316 15:37:48.291746 5120 reconciler_common.go:299] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/3529f46e-85a5-437e-8773-68d7dc6b6f9c-catalog-content\") on node \"crc\" DevicePath \"\"" Mar 16 15:37:48 crc kubenswrapper[5120]: I0316 15:37:48.298447 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/888cb38a-98cf-4897-95ec-879b29e12656-utilities" (OuterVolumeSpecName: "utilities") pod "888cb38a-98cf-4897-95ec-879b29e12656" (UID: "888cb38a-98cf-4897-95ec-879b29e12656"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:37:48 crc kubenswrapper[5120]: I0316 15:37:48.298516 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe2f5127-13d1-4799-9af9-bb0736bf53e9-utilities" (OuterVolumeSpecName: "utilities") pod "fe2f5127-13d1-4799-9af9-bb0736bf53e9" (UID: "fe2f5127-13d1-4799-9af9-bb0736bf53e9"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:37:48 crc kubenswrapper[5120]: I0316 15:37:48.299142 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe2f5127-13d1-4799-9af9-bb0736bf53e9-kube-api-access-8fhlq" (OuterVolumeSpecName: "kube-api-access-8fhlq") pod "fe2f5127-13d1-4799-9af9-bb0736bf53e9" (UID: "fe2f5127-13d1-4799-9af9-bb0736bf53e9"). InnerVolumeSpecName "kube-api-access-8fhlq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:37:48 crc kubenswrapper[5120]: I0316 15:37:48.299954 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/888cb38a-98cf-4897-95ec-879b29e12656-kube-api-access-jbp2s" (OuterVolumeSpecName: "kube-api-access-jbp2s") pod "888cb38a-98cf-4897-95ec-879b29e12656" (UID: "888cb38a-98cf-4897-95ec-879b29e12656"). InnerVolumeSpecName "kube-api-access-jbp2s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:37:48 crc kubenswrapper[5120]: I0316 15:37:48.311908 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/888cb38a-98cf-4897-95ec-879b29e12656-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "888cb38a-98cf-4897-95ec-879b29e12656" (UID: "888cb38a-98cf-4897-95ec-879b29e12656"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:37:48 crc kubenswrapper[5120]: I0316 15:37:48.392633 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8fhlq\" (UniqueName: \"kubernetes.io/projected/fe2f5127-13d1-4799-9af9-bb0736bf53e9-kube-api-access-8fhlq\") on node \"crc\" DevicePath \"\"" Mar 16 15:37:48 crc kubenswrapper[5120]: I0316 15:37:48.392664 5120 reconciler_common.go:299] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/fe2f5127-13d1-4799-9af9-bb0736bf53e9-utilities\") on node \"crc\" DevicePath \"\"" Mar 16 15:37:48 crc kubenswrapper[5120]: I0316 15:37:48.392676 5120 reconciler_common.go:299] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/888cb38a-98cf-4897-95ec-879b29e12656-catalog-content\") on node \"crc\" DevicePath \"\"" Mar 16 15:37:48 crc kubenswrapper[5120]: I0316 15:37:48.392685 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jbp2s\" (UniqueName: \"kubernetes.io/projected/888cb38a-98cf-4897-95ec-879b29e12656-kube-api-access-jbp2s\") on node \"crc\" DevicePath \"\"" Mar 16 15:37:48 crc kubenswrapper[5120]: I0316 15:37:48.392693 5120 reconciler_common.go:299] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/888cb38a-98cf-4897-95ec-879b29e12656-utilities\") on node \"crc\" DevicePath \"\"" Mar 16 15:37:48 crc kubenswrapper[5120]: I0316 15:37:48.407557 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe2f5127-13d1-4799-9af9-bb0736bf53e9-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "fe2f5127-13d1-4799-9af9-bb0736bf53e9" (UID: "fe2f5127-13d1-4799-9af9-bb0736bf53e9"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:37:48 crc kubenswrapper[5120]: I0316 15:37:48.482059 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/marketplace-operator-547dbd544d-rt66v"] Mar 16 15:37:48 crc kubenswrapper[5120]: I0316 15:37:48.493563 5120 reconciler_common.go:299] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/fe2f5127-13d1-4799-9af9-bb0736bf53e9-catalog-content\") on node \"crc\" DevicePath \"\"" Mar 16 15:37:48 crc kubenswrapper[5120]: I0316 15:37:48.755538 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/marketplace-operator-547dbd544d-gp852" Mar 16 15:37:48 crc kubenswrapper[5120]: I0316 15:37:48.755602 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/marketplace-operator-547dbd544d-gp852" event={"ID":"a0b763d7-65d4-41e1-9880-8f80e9686189","Type":"ContainerDied","Data":"f1e0b42f2488e0cd5e6e39a33b82dc01fe5b3ce212a644ecd465c90879061e89"} Mar 16 15:37:48 crc kubenswrapper[5120]: I0316 15:37:48.756077 5120 scope.go:117] "RemoveContainer" containerID="b290fa074131590a8c67ec37d076e49585b240607eb405eea8f8db741f6c6119" Mar 16 15:37:48 crc kubenswrapper[5120]: I0316 15:37:48.758228 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-zz5g5" event={"ID":"f4f60942-f576-4e00-88be-a52a1e6d91ec","Type":"ContainerDied","Data":"053f0557679a73a5fa807dbaa6ebbbb6bd3a25c695a6a3cc5dfc2e0b9b9be974"} Mar 16 15:37:48 crc kubenswrapper[5120]: I0316 15:37:48.758335 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-zz5g5" Mar 16 15:37:48 crc kubenswrapper[5120]: I0316 15:37:48.762994 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/marketplace-operator-547dbd544d-rt66v" event={"ID":"970f8645-801d-4b4b-8571-a39bde23f382","Type":"ContainerStarted","Data":"403036f23c1b41656cf9903b4bda6d006a58be9c19ed846487d5d2271d62912b"} Mar 16 15:37:48 crc kubenswrapper[5120]: I0316 15:37:48.763036 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/marketplace-operator-547dbd544d-rt66v" event={"ID":"970f8645-801d-4b4b-8571-a39bde23f382","Type":"ContainerStarted","Data":"3422e694562b4ac01cd048b544e3ac98b12f3b372c1c617eab16f1cbec45806c"} Mar 16 15:37:48 crc kubenswrapper[5120]: I0316 15:37:48.763664 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-marketplace/marketplace-operator-547dbd544d-rt66v" Mar 16 15:37:48 crc kubenswrapper[5120]: I0316 15:37:48.765067 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-p8tsg" event={"ID":"888cb38a-98cf-4897-95ec-879b29e12656","Type":"ContainerDied","Data":"380ed2b4ac06f829ce72b12c047f37171259582803342cf657d551ce7735590b"} Mar 16 15:37:48 crc kubenswrapper[5120]: I0316 15:37:48.765099 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-p8tsg" Mar 16 15:37:48 crc kubenswrapper[5120]: I0316 15:37:48.765295 5120 patch_prober.go:28] interesting pod/marketplace-operator-547dbd544d-rt66v container/marketplace-operator namespace/openshift-marketplace: Readiness probe status=failure output="Get \"http://10.217.0.65:8080/healthz\": dial tcp 10.217.0.65:8080: connect: connection refused" start-of-body= Mar 16 15:37:48 crc kubenswrapper[5120]: I0316 15:37:48.765348 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-marketplace/marketplace-operator-547dbd544d-rt66v" podUID="970f8645-801d-4b4b-8571-a39bde23f382" containerName="marketplace-operator" probeResult="failure" output="Get \"http://10.217.0.65:8080/healthz\": dial tcp 10.217.0.65:8080: connect: connection refused" Mar 16 15:37:48 crc kubenswrapper[5120]: I0316 15:37:48.767715 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-bzrbr" event={"ID":"3529f46e-85a5-437e-8773-68d7dc6b6f9c","Type":"ContainerDied","Data":"30323d331e62364cf94d1f649d83bb0c4ea1642fb55c0b3f90c28a24126269da"} Mar 16 15:37:48 crc kubenswrapper[5120]: I0316 15:37:48.767750 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-bzrbr" Mar 16 15:37:48 crc kubenswrapper[5120]: I0316 15:37:48.772819 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-5d9tn" event={"ID":"fe2f5127-13d1-4799-9af9-bb0736bf53e9","Type":"ContainerDied","Data":"d4dd69e1a1f58aea64f0fee305708169aff7de31b62d88e303a5eb72f0ab3ea1"} Mar 16 15:37:48 crc kubenswrapper[5120]: I0316 15:37:48.772961 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-5d9tn" Mar 16 15:37:48 crc kubenswrapper[5120]: I0316 15:37:48.785607 5120 scope.go:117] "RemoveContainer" containerID="7460b0cb98ad635cff620c80660536aff790b2158c84428354a77cb54c999c04" Mar 16 15:37:48 crc kubenswrapper[5120]: I0316 15:37:48.786515 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/certified-operators-zz5g5"] Mar 16 15:37:48 crc kubenswrapper[5120]: I0316 15:37:48.791104 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/certified-operators-zz5g5"] Mar 16 15:37:48 crc kubenswrapper[5120]: I0316 15:37:48.800877 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/marketplace-operator-547dbd544d-gp852"] Mar 16 15:37:48 crc kubenswrapper[5120]: I0316 15:37:48.804410 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/marketplace-operator-547dbd544d-gp852"] Mar 16 15:37:48 crc kubenswrapper[5120]: I0316 15:37:48.810104 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/marketplace-operator-547dbd544d-rt66v" podStartSLOduration=1.8100900599999998 podStartE2EDuration="1.81009006s" podCreationTimestamp="2026-03-16 15:37:47 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:37:48.79516607 +0000 UTC m=+370.949097727" watchObservedRunningTime="2026-03-16 15:37:48.81009006 +0000 UTC m=+370.964021717" Mar 16 15:37:48 crc kubenswrapper[5120]: I0316 15:37:48.810927 5120 scope.go:117] "RemoveContainer" containerID="5cc155a31319f541cc86641a84cb4674b6e7d5b414450d7d9729471b86ea6e35" Mar 16 15:37:48 crc kubenswrapper[5120]: I0316 15:37:48.819902 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/community-operators-bzrbr"] Mar 16 15:37:48 crc kubenswrapper[5120]: I0316 15:37:48.822835 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/community-operators-bzrbr"] Mar 16 15:37:48 crc kubenswrapper[5120]: I0316 15:37:48.833907 5120 scope.go:117] "RemoveContainer" containerID="23b0b8c596d1f298796996f263987f64f27049dd856b880489f8b6e2e14d76c0" Mar 16 15:37:48 crc kubenswrapper[5120]: I0316 15:37:48.835443 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-operators-5d9tn"] Mar 16 15:37:48 crc kubenswrapper[5120]: I0316 15:37:48.837939 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/redhat-operators-5d9tn"] Mar 16 15:37:48 crc kubenswrapper[5120]: I0316 15:37:48.845641 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-marketplace-p8tsg"] Mar 16 15:37:48 crc kubenswrapper[5120]: I0316 15:37:48.849119 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/redhat-marketplace-p8tsg"] Mar 16 15:37:48 crc kubenswrapper[5120]: I0316 15:37:48.851994 5120 scope.go:117] "RemoveContainer" containerID="6d93225931be81d0a8775a2594501f3ebc57ce59fb959d0cf4ce0575233ccef0" Mar 16 15:37:48 crc kubenswrapper[5120]: I0316 15:37:48.872043 5120 scope.go:117] "RemoveContainer" containerID="636f69b826e8a1b02f5a1e1f62d52cbc3942ba757b7dad4d3b5cef4c8e194bd9" Mar 16 15:37:48 crc kubenswrapper[5120]: I0316 15:37:48.899466 5120 scope.go:117] "RemoveContainer" containerID="0483bfd4f388a657a681b159d62f9df53ed2409425c73220a847784b904d04cd" Mar 16 15:37:48 crc kubenswrapper[5120]: I0316 15:37:48.914941 5120 scope.go:117] "RemoveContainer" containerID="3d7dda4dbf9df13b317ca3762ba9297714e949ba042e4438903d54125ca9d6cb" Mar 16 15:37:48 crc kubenswrapper[5120]: I0316 15:37:48.931141 5120 scope.go:117] "RemoveContainer" containerID="0b517684787596dcbe5b47aace272045cd395ad0503ad6178951f64602d580d0" Mar 16 15:37:48 crc kubenswrapper[5120]: I0316 15:37:48.947014 5120 scope.go:117] "RemoveContainer" containerID="5c8edf0e26b0ca818e5402e1b37865e0cb7a3fc2b052245c2580b3bd617be6a6" Mar 16 15:37:48 crc kubenswrapper[5120]: I0316 15:37:48.972118 5120 scope.go:117] "RemoveContainer" containerID="afbaab0478d915cc2c2f1def4a4e2a2a0ebbdfd4bffeafa5625973c57f92aa86" Mar 16 15:37:48 crc kubenswrapper[5120]: I0316 15:37:48.984626 5120 scope.go:117] "RemoveContainer" containerID="b226c5cc203dc21a88be61a51b78e67fb266dfced6386f5e8b2a824c055b6424" Mar 16 15:37:48 crc kubenswrapper[5120]: I0316 15:37:48.999521 5120 scope.go:117] "RemoveContainer" containerID="bbf794824a8a7fe70907e087568412be254430cb5993f40d5190f1e3e6c22cea" Mar 16 15:37:49 crc kubenswrapper[5120]: I0316 15:37:49.729995 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/certified-operators-klcgv"] Mar 16 15:37:49 crc kubenswrapper[5120]: I0316 15:37:49.731115 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe2f5127-13d1-4799-9af9-bb0736bf53e9" containerName="extract-content" Mar 16 15:37:49 crc kubenswrapper[5120]: I0316 15:37:49.731133 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe2f5127-13d1-4799-9af9-bb0736bf53e9" containerName="extract-content" Mar 16 15:37:49 crc kubenswrapper[5120]: I0316 15:37:49.731145 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe2f5127-13d1-4799-9af9-bb0736bf53e9" containerName="registry-server" Mar 16 15:37:49 crc kubenswrapper[5120]: I0316 15:37:49.731151 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe2f5127-13d1-4799-9af9-bb0736bf53e9" containerName="registry-server" Mar 16 15:37:49 crc kubenswrapper[5120]: I0316 15:37:49.731161 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4f60942-f576-4e00-88be-a52a1e6d91ec" containerName="extract-utilities" Mar 16 15:37:49 crc kubenswrapper[5120]: I0316 15:37:49.731168 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4f60942-f576-4e00-88be-a52a1e6d91ec" containerName="extract-utilities" Mar 16 15:37:49 crc kubenswrapper[5120]: I0316 15:37:49.731177 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe2f5127-13d1-4799-9af9-bb0736bf53e9" containerName="extract-utilities" Mar 16 15:37:49 crc kubenswrapper[5120]: I0316 15:37:49.731182 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe2f5127-13d1-4799-9af9-bb0736bf53e9" containerName="extract-utilities" Mar 16 15:37:49 crc kubenswrapper[5120]: I0316 15:37:49.731191 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0b763d7-65d4-41e1-9880-8f80e9686189" containerName="marketplace-operator" Mar 16 15:37:49 crc kubenswrapper[5120]: I0316 15:37:49.731196 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0b763d7-65d4-41e1-9880-8f80e9686189" containerName="marketplace-operator" Mar 16 15:37:49 crc kubenswrapper[5120]: I0316 15:37:49.731202 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="888cb38a-98cf-4897-95ec-879b29e12656" containerName="registry-server" Mar 16 15:37:49 crc kubenswrapper[5120]: I0316 15:37:49.731207 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="888cb38a-98cf-4897-95ec-879b29e12656" containerName="registry-server" Mar 16 15:37:49 crc kubenswrapper[5120]: I0316 15:37:49.731216 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="888cb38a-98cf-4897-95ec-879b29e12656" containerName="extract-utilities" Mar 16 15:37:49 crc kubenswrapper[5120]: I0316 15:37:49.731221 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="888cb38a-98cf-4897-95ec-879b29e12656" containerName="extract-utilities" Mar 16 15:37:49 crc kubenswrapper[5120]: I0316 15:37:49.731231 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3529f46e-85a5-437e-8773-68d7dc6b6f9c" containerName="extract-content" Mar 16 15:37:49 crc kubenswrapper[5120]: I0316 15:37:49.731235 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="3529f46e-85a5-437e-8773-68d7dc6b6f9c" containerName="extract-content" Mar 16 15:37:49 crc kubenswrapper[5120]: I0316 15:37:49.731242 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4f60942-f576-4e00-88be-a52a1e6d91ec" containerName="registry-server" Mar 16 15:37:49 crc kubenswrapper[5120]: I0316 15:37:49.731247 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4f60942-f576-4e00-88be-a52a1e6d91ec" containerName="registry-server" Mar 16 15:37:49 crc kubenswrapper[5120]: I0316 15:37:49.731253 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3529f46e-85a5-437e-8773-68d7dc6b6f9c" containerName="registry-server" Mar 16 15:37:49 crc kubenswrapper[5120]: I0316 15:37:49.731259 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="3529f46e-85a5-437e-8773-68d7dc6b6f9c" containerName="registry-server" Mar 16 15:37:49 crc kubenswrapper[5120]: I0316 15:37:49.731269 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4f60942-f576-4e00-88be-a52a1e6d91ec" containerName="extract-content" Mar 16 15:37:49 crc kubenswrapper[5120]: I0316 15:37:49.731274 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4f60942-f576-4e00-88be-a52a1e6d91ec" containerName="extract-content" Mar 16 15:37:49 crc kubenswrapper[5120]: I0316 15:37:49.731283 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3529f46e-85a5-437e-8773-68d7dc6b6f9c" containerName="extract-utilities" Mar 16 15:37:49 crc kubenswrapper[5120]: I0316 15:37:49.731289 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="3529f46e-85a5-437e-8773-68d7dc6b6f9c" containerName="extract-utilities" Mar 16 15:37:49 crc kubenswrapper[5120]: I0316 15:37:49.731298 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0b763d7-65d4-41e1-9880-8f80e9686189" containerName="marketplace-operator" Mar 16 15:37:49 crc kubenswrapper[5120]: I0316 15:37:49.731303 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0b763d7-65d4-41e1-9880-8f80e9686189" containerName="marketplace-operator" Mar 16 15:37:49 crc kubenswrapper[5120]: I0316 15:37:49.731311 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="888cb38a-98cf-4897-95ec-879b29e12656" containerName="extract-content" Mar 16 15:37:49 crc kubenswrapper[5120]: I0316 15:37:49.731316 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="888cb38a-98cf-4897-95ec-879b29e12656" containerName="extract-content" Mar 16 15:37:49 crc kubenswrapper[5120]: I0316 15:37:49.731397 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="a0b763d7-65d4-41e1-9880-8f80e9686189" containerName="marketplace-operator" Mar 16 15:37:49 crc kubenswrapper[5120]: I0316 15:37:49.731406 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="fe2f5127-13d1-4799-9af9-bb0736bf53e9" containerName="registry-server" Mar 16 15:37:49 crc kubenswrapper[5120]: I0316 15:37:49.731415 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="888cb38a-98cf-4897-95ec-879b29e12656" containerName="registry-server" Mar 16 15:37:49 crc kubenswrapper[5120]: I0316 15:37:49.731425 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="a0b763d7-65d4-41e1-9880-8f80e9686189" containerName="marketplace-operator" Mar 16 15:37:49 crc kubenswrapper[5120]: I0316 15:37:49.731434 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="3529f46e-85a5-437e-8773-68d7dc6b6f9c" containerName="registry-server" Mar 16 15:37:49 crc kubenswrapper[5120]: I0316 15:37:49.731442 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f4f60942-f576-4e00-88be-a52a1e6d91ec" containerName="registry-server" Mar 16 15:37:49 crc kubenswrapper[5120]: I0316 15:37:49.750093 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/certified-operators-klcgv"] Mar 16 15:37:49 crc kubenswrapper[5120]: I0316 15:37:49.750323 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-klcgv" Mar 16 15:37:49 crc kubenswrapper[5120]: I0316 15:37:49.753364 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"certified-operators-dockercfg-7cl8d\"" Mar 16 15:37:49 crc kubenswrapper[5120]: I0316 15:37:49.789245 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/marketplace-operator-547dbd544d-rt66v" Mar 16 15:37:49 crc kubenswrapper[5120]: I0316 15:37:49.809668 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/cb61d003-089b-4f3a-b84e-03d45c451335-utilities\") pod \"certified-operators-klcgv\" (UID: \"cb61d003-089b-4f3a-b84e-03d45c451335\") " pod="openshift-marketplace/certified-operators-klcgv" Mar 16 15:37:49 crc kubenswrapper[5120]: I0316 15:37:49.810779 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/cb61d003-089b-4f3a-b84e-03d45c451335-catalog-content\") pod \"certified-operators-klcgv\" (UID: \"cb61d003-089b-4f3a-b84e-03d45c451335\") " pod="openshift-marketplace/certified-operators-klcgv" Mar 16 15:37:49 crc kubenswrapper[5120]: I0316 15:37:49.810985 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkg7t\" (UniqueName: \"kubernetes.io/projected/cb61d003-089b-4f3a-b84e-03d45c451335-kube-api-access-fkg7t\") pod \"certified-operators-klcgv\" (UID: \"cb61d003-089b-4f3a-b84e-03d45c451335\") " pod="openshift-marketplace/certified-operators-klcgv" Mar 16 15:37:49 crc kubenswrapper[5120]: I0316 15:37:49.913517 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fkg7t\" (UniqueName: \"kubernetes.io/projected/cb61d003-089b-4f3a-b84e-03d45c451335-kube-api-access-fkg7t\") pod \"certified-operators-klcgv\" (UID: \"cb61d003-089b-4f3a-b84e-03d45c451335\") " pod="openshift-marketplace/certified-operators-klcgv" Mar 16 15:37:49 crc kubenswrapper[5120]: I0316 15:37:49.913571 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/cb61d003-089b-4f3a-b84e-03d45c451335-utilities\") pod \"certified-operators-klcgv\" (UID: \"cb61d003-089b-4f3a-b84e-03d45c451335\") " pod="openshift-marketplace/certified-operators-klcgv" Mar 16 15:37:49 crc kubenswrapper[5120]: I0316 15:37:49.913948 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/cb61d003-089b-4f3a-b84e-03d45c451335-catalog-content\") pod \"certified-operators-klcgv\" (UID: \"cb61d003-089b-4f3a-b84e-03d45c451335\") " pod="openshift-marketplace/certified-operators-klcgv" Mar 16 15:37:49 crc kubenswrapper[5120]: I0316 15:37:49.914182 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/cb61d003-089b-4f3a-b84e-03d45c451335-utilities\") pod \"certified-operators-klcgv\" (UID: \"cb61d003-089b-4f3a-b84e-03d45c451335\") " pod="openshift-marketplace/certified-operators-klcgv" Mar 16 15:37:49 crc kubenswrapper[5120]: I0316 15:37:49.914454 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/cb61d003-089b-4f3a-b84e-03d45c451335-catalog-content\") pod \"certified-operators-klcgv\" (UID: \"cb61d003-089b-4f3a-b84e-03d45c451335\") " pod="openshift-marketplace/certified-operators-klcgv" Mar 16 15:37:49 crc kubenswrapper[5120]: I0316 15:37:49.941578 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/community-operators-bgzkt"] Mar 16 15:37:49 crc kubenswrapper[5120]: I0316 15:37:49.944267 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkg7t\" (UniqueName: \"kubernetes.io/projected/cb61d003-089b-4f3a-b84e-03d45c451335-kube-api-access-fkg7t\") pod \"certified-operators-klcgv\" (UID: \"cb61d003-089b-4f3a-b84e-03d45c451335\") " pod="openshift-marketplace/certified-operators-klcgv" Mar 16 15:37:49 crc kubenswrapper[5120]: I0316 15:37:49.948670 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-bgzkt" Mar 16 15:37:49 crc kubenswrapper[5120]: I0316 15:37:49.950740 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/community-operators-bgzkt"] Mar 16 15:37:49 crc kubenswrapper[5120]: I0316 15:37:49.952174 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"community-operators-dockercfg-vrd5f\"" Mar 16 15:37:50 crc kubenswrapper[5120]: I0316 15:37:50.014839 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/0f9b752f-73c2-4fc5-b1d0-8b4edfa2b771-utilities\") pod \"community-operators-bgzkt\" (UID: \"0f9b752f-73c2-4fc5-b1d0-8b4edfa2b771\") " pod="openshift-marketplace/community-operators-bgzkt" Mar 16 15:37:50 crc kubenswrapper[5120]: I0316 15:37:50.014925 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/0f9b752f-73c2-4fc5-b1d0-8b4edfa2b771-catalog-content\") pod \"community-operators-bgzkt\" (UID: \"0f9b752f-73c2-4fc5-b1d0-8b4edfa2b771\") " pod="openshift-marketplace/community-operators-bgzkt" Mar 16 15:37:50 crc kubenswrapper[5120]: I0316 15:37:50.014990 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9n5q\" (UniqueName: \"kubernetes.io/projected/0f9b752f-73c2-4fc5-b1d0-8b4edfa2b771-kube-api-access-s9n5q\") pod \"community-operators-bgzkt\" (UID: \"0f9b752f-73c2-4fc5-b1d0-8b4edfa2b771\") " pod="openshift-marketplace/community-operators-bgzkt" Mar 16 15:37:50 crc kubenswrapper[5120]: I0316 15:37:50.068020 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-klcgv" Mar 16 15:37:50 crc kubenswrapper[5120]: I0316 15:37:50.116205 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s9n5q\" (UniqueName: \"kubernetes.io/projected/0f9b752f-73c2-4fc5-b1d0-8b4edfa2b771-kube-api-access-s9n5q\") pod \"community-operators-bgzkt\" (UID: \"0f9b752f-73c2-4fc5-b1d0-8b4edfa2b771\") " pod="openshift-marketplace/community-operators-bgzkt" Mar 16 15:37:50 crc kubenswrapper[5120]: I0316 15:37:50.116346 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/0f9b752f-73c2-4fc5-b1d0-8b4edfa2b771-utilities\") pod \"community-operators-bgzkt\" (UID: \"0f9b752f-73c2-4fc5-b1d0-8b4edfa2b771\") " pod="openshift-marketplace/community-operators-bgzkt" Mar 16 15:37:50 crc kubenswrapper[5120]: I0316 15:37:50.116428 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/0f9b752f-73c2-4fc5-b1d0-8b4edfa2b771-catalog-content\") pod \"community-operators-bgzkt\" (UID: \"0f9b752f-73c2-4fc5-b1d0-8b4edfa2b771\") " pod="openshift-marketplace/community-operators-bgzkt" Mar 16 15:37:50 crc kubenswrapper[5120]: I0316 15:37:50.117017 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/0f9b752f-73c2-4fc5-b1d0-8b4edfa2b771-utilities\") pod \"community-operators-bgzkt\" (UID: \"0f9b752f-73c2-4fc5-b1d0-8b4edfa2b771\") " pod="openshift-marketplace/community-operators-bgzkt" Mar 16 15:37:50 crc kubenswrapper[5120]: I0316 15:37:50.117078 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/0f9b752f-73c2-4fc5-b1d0-8b4edfa2b771-catalog-content\") pod \"community-operators-bgzkt\" (UID: \"0f9b752f-73c2-4fc5-b1d0-8b4edfa2b771\") " pod="openshift-marketplace/community-operators-bgzkt" Mar 16 15:37:50 crc kubenswrapper[5120]: I0316 15:37:50.140668 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9n5q\" (UniqueName: \"kubernetes.io/projected/0f9b752f-73c2-4fc5-b1d0-8b4edfa2b771-kube-api-access-s9n5q\") pod \"community-operators-bgzkt\" (UID: \"0f9b752f-73c2-4fc5-b1d0-8b4edfa2b771\") " pod="openshift-marketplace/community-operators-bgzkt" Mar 16 15:37:50 crc kubenswrapper[5120]: I0316 15:37:50.272682 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-bgzkt" Mar 16 15:37:50 crc kubenswrapper[5120]: I0316 15:37:50.461199 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/certified-operators-klcgv"] Mar 16 15:37:50 crc kubenswrapper[5120]: I0316 15:37:50.675197 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3529f46e-85a5-437e-8773-68d7dc6b6f9c" path="/var/lib/kubelet/pods/3529f46e-85a5-437e-8773-68d7dc6b6f9c/volumes" Mar 16 15:37:50 crc kubenswrapper[5120]: I0316 15:37:50.676936 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="888cb38a-98cf-4897-95ec-879b29e12656" path="/var/lib/kubelet/pods/888cb38a-98cf-4897-95ec-879b29e12656/volumes" Mar 16 15:37:50 crc kubenswrapper[5120]: I0316 15:37:50.679595 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a0b763d7-65d4-41e1-9880-8f80e9686189" path="/var/lib/kubelet/pods/a0b763d7-65d4-41e1-9880-8f80e9686189/volumes" Mar 16 15:37:50 crc kubenswrapper[5120]: I0316 15:37:50.680597 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f4f60942-f576-4e00-88be-a52a1e6d91ec" path="/var/lib/kubelet/pods/f4f60942-f576-4e00-88be-a52a1e6d91ec/volumes" Mar 16 15:37:50 crc kubenswrapper[5120]: I0316 15:37:50.681831 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe2f5127-13d1-4799-9af9-bb0736bf53e9" path="/var/lib/kubelet/pods/fe2f5127-13d1-4799-9af9-bb0736bf53e9/volumes" Mar 16 15:37:50 crc kubenswrapper[5120]: I0316 15:37:50.699083 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/community-operators-bgzkt"] Mar 16 15:37:50 crc kubenswrapper[5120]: W0316 15:37:50.703247 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f9b752f_73c2_4fc5_b1d0_8b4edfa2b771.slice/crio-11bb29412ba23534d946ad0463fc357a72120da671ea12c6f966a658d6d28a56 WatchSource:0}: Error finding container 11bb29412ba23534d946ad0463fc357a72120da671ea12c6f966a658d6d28a56: Status 404 returned error can't find the container with id 11bb29412ba23534d946ad0463fc357a72120da671ea12c6f966a658d6d28a56 Mar 16 15:37:50 crc kubenswrapper[5120]: I0316 15:37:50.792400 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-bgzkt" event={"ID":"0f9b752f-73c2-4fc5-b1d0-8b4edfa2b771","Type":"ContainerStarted","Data":"11bb29412ba23534d946ad0463fc357a72120da671ea12c6f966a658d6d28a56"} Mar 16 15:37:50 crc kubenswrapper[5120]: I0316 15:37:50.793783 5120 generic.go:358] "Generic (PLEG): container finished" podID="cb61d003-089b-4f3a-b84e-03d45c451335" containerID="66bffdea50a9c3f6c7c34ca52edc2d91768139230399e9e2fb78bc33a5eb8efe" exitCode=0 Mar 16 15:37:50 crc kubenswrapper[5120]: I0316 15:37:50.793836 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-klcgv" event={"ID":"cb61d003-089b-4f3a-b84e-03d45c451335","Type":"ContainerDied","Data":"66bffdea50a9c3f6c7c34ca52edc2d91768139230399e9e2fb78bc33a5eb8efe"} Mar 16 15:37:50 crc kubenswrapper[5120]: I0316 15:37:50.793915 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-klcgv" event={"ID":"cb61d003-089b-4f3a-b84e-03d45c451335","Type":"ContainerStarted","Data":"09a3033e76d21c365fa11cd2a98bfd11f24c4d6e543c85201826e75dad5a48bb"} Mar 16 15:37:51 crc kubenswrapper[5120]: I0316 15:37:51.804603 5120 generic.go:358] "Generic (PLEG): container finished" podID="0f9b752f-73c2-4fc5-b1d0-8b4edfa2b771" containerID="68cebc79d4d99a0d2be6e3d0a64622ecb42a5b8453fb26430283b74fe448b28d" exitCode=0 Mar 16 15:37:51 crc kubenswrapper[5120]: I0316 15:37:51.804743 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-bgzkt" event={"ID":"0f9b752f-73c2-4fc5-b1d0-8b4edfa2b771","Type":"ContainerDied","Data":"68cebc79d4d99a0d2be6e3d0a64622ecb42a5b8453fb26430283b74fe448b28d"} Mar 16 15:37:51 crc kubenswrapper[5120]: I0316 15:37:51.807367 5120 generic.go:358] "Generic (PLEG): container finished" podID="cb61d003-089b-4f3a-b84e-03d45c451335" containerID="9aac906203f7345bfd6b5b4d18f3ed790f932a9c0ac30ce40ce92396780786ec" exitCode=0 Mar 16 15:37:51 crc kubenswrapper[5120]: I0316 15:37:51.807451 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-klcgv" event={"ID":"cb61d003-089b-4f3a-b84e-03d45c451335","Type":"ContainerDied","Data":"9aac906203f7345bfd6b5b4d18f3ed790f932a9c0ac30ce40ce92396780786ec"} Mar 16 15:37:52 crc kubenswrapper[5120]: I0316 15:37:52.131595 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-marketplace-6xr7p"] Mar 16 15:37:52 crc kubenswrapper[5120]: I0316 15:37:52.142114 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-6xr7p"] Mar 16 15:37:52 crc kubenswrapper[5120]: I0316 15:37:52.142295 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-6xr7p" Mar 16 15:37:52 crc kubenswrapper[5120]: I0316 15:37:52.144159 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"redhat-marketplace-dockercfg-gg4w7\"" Mar 16 15:37:52 crc kubenswrapper[5120]: I0316 15:37:52.239611 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrcz8\" (UniqueName: \"kubernetes.io/projected/d233c35e-a24a-4f65-9bea-f280bc1e51a7-kube-api-access-zrcz8\") pod \"redhat-marketplace-6xr7p\" (UID: \"d233c35e-a24a-4f65-9bea-f280bc1e51a7\") " pod="openshift-marketplace/redhat-marketplace-6xr7p" Mar 16 15:37:52 crc kubenswrapper[5120]: I0316 15:37:52.239672 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/d233c35e-a24a-4f65-9bea-f280bc1e51a7-utilities\") pod \"redhat-marketplace-6xr7p\" (UID: \"d233c35e-a24a-4f65-9bea-f280bc1e51a7\") " pod="openshift-marketplace/redhat-marketplace-6xr7p" Mar 16 15:37:52 crc kubenswrapper[5120]: I0316 15:37:52.240040 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/d233c35e-a24a-4f65-9bea-f280bc1e51a7-catalog-content\") pod \"redhat-marketplace-6xr7p\" (UID: \"d233c35e-a24a-4f65-9bea-f280bc1e51a7\") " pod="openshift-marketplace/redhat-marketplace-6xr7p" Mar 16 15:37:52 crc kubenswrapper[5120]: I0316 15:37:52.325988 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-operators-q69b9"] Mar 16 15:37:52 crc kubenswrapper[5120]: I0316 15:37:52.330853 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-q69b9" Mar 16 15:37:52 crc kubenswrapper[5120]: I0316 15:37:52.333219 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"redhat-operators-dockercfg-9gxlh\"" Mar 16 15:37:52 crc kubenswrapper[5120]: I0316 15:37:52.336936 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-q69b9"] Mar 16 15:37:52 crc kubenswrapper[5120]: I0316 15:37:52.341469 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/05676c54-5e12-4b89-a0ad-a5f56b167117-utilities\") pod \"redhat-operators-q69b9\" (UID: \"05676c54-5e12-4b89-a0ad-a5f56b167117\") " pod="openshift-marketplace/redhat-operators-q69b9" Mar 16 15:37:52 crc kubenswrapper[5120]: I0316 15:37:52.341516 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zrcz8\" (UniqueName: \"kubernetes.io/projected/d233c35e-a24a-4f65-9bea-f280bc1e51a7-kube-api-access-zrcz8\") pod \"redhat-marketplace-6xr7p\" (UID: \"d233c35e-a24a-4f65-9bea-f280bc1e51a7\") " pod="openshift-marketplace/redhat-marketplace-6xr7p" Mar 16 15:37:52 crc kubenswrapper[5120]: I0316 15:37:52.341582 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/d233c35e-a24a-4f65-9bea-f280bc1e51a7-utilities\") pod \"redhat-marketplace-6xr7p\" (UID: \"d233c35e-a24a-4f65-9bea-f280bc1e51a7\") " pod="openshift-marketplace/redhat-marketplace-6xr7p" Mar 16 15:37:52 crc kubenswrapper[5120]: I0316 15:37:52.341710 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/05676c54-5e12-4b89-a0ad-a5f56b167117-catalog-content\") pod \"redhat-operators-q69b9\" (UID: \"05676c54-5e12-4b89-a0ad-a5f56b167117\") " pod="openshift-marketplace/redhat-operators-q69b9" Mar 16 15:37:52 crc kubenswrapper[5120]: I0316 15:37:52.341750 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mff9m\" (UniqueName: \"kubernetes.io/projected/05676c54-5e12-4b89-a0ad-a5f56b167117-kube-api-access-mff9m\") pod \"redhat-operators-q69b9\" (UID: \"05676c54-5e12-4b89-a0ad-a5f56b167117\") " pod="openshift-marketplace/redhat-operators-q69b9" Mar 16 15:37:52 crc kubenswrapper[5120]: I0316 15:37:52.341905 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/d233c35e-a24a-4f65-9bea-f280bc1e51a7-catalog-content\") pod \"redhat-marketplace-6xr7p\" (UID: \"d233c35e-a24a-4f65-9bea-f280bc1e51a7\") " pod="openshift-marketplace/redhat-marketplace-6xr7p" Mar 16 15:37:52 crc kubenswrapper[5120]: I0316 15:37:52.342164 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/d233c35e-a24a-4f65-9bea-f280bc1e51a7-utilities\") pod \"redhat-marketplace-6xr7p\" (UID: \"d233c35e-a24a-4f65-9bea-f280bc1e51a7\") " pod="openshift-marketplace/redhat-marketplace-6xr7p" Mar 16 15:37:52 crc kubenswrapper[5120]: I0316 15:37:52.348056 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/d233c35e-a24a-4f65-9bea-f280bc1e51a7-catalog-content\") pod \"redhat-marketplace-6xr7p\" (UID: \"d233c35e-a24a-4f65-9bea-f280bc1e51a7\") " pod="openshift-marketplace/redhat-marketplace-6xr7p" Mar 16 15:37:52 crc kubenswrapper[5120]: I0316 15:37:52.381979 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrcz8\" (UniqueName: \"kubernetes.io/projected/d233c35e-a24a-4f65-9bea-f280bc1e51a7-kube-api-access-zrcz8\") pod \"redhat-marketplace-6xr7p\" (UID: \"d233c35e-a24a-4f65-9bea-f280bc1e51a7\") " pod="openshift-marketplace/redhat-marketplace-6xr7p" Mar 16 15:37:52 crc kubenswrapper[5120]: I0316 15:37:52.442982 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/05676c54-5e12-4b89-a0ad-a5f56b167117-catalog-content\") pod \"redhat-operators-q69b9\" (UID: \"05676c54-5e12-4b89-a0ad-a5f56b167117\") " pod="openshift-marketplace/redhat-operators-q69b9" Mar 16 15:37:52 crc kubenswrapper[5120]: I0316 15:37:52.443021 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mff9m\" (UniqueName: \"kubernetes.io/projected/05676c54-5e12-4b89-a0ad-a5f56b167117-kube-api-access-mff9m\") pod \"redhat-operators-q69b9\" (UID: \"05676c54-5e12-4b89-a0ad-a5f56b167117\") " pod="openshift-marketplace/redhat-operators-q69b9" Mar 16 15:37:52 crc kubenswrapper[5120]: I0316 15:37:52.443092 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/05676c54-5e12-4b89-a0ad-a5f56b167117-utilities\") pod \"redhat-operators-q69b9\" (UID: \"05676c54-5e12-4b89-a0ad-a5f56b167117\") " pod="openshift-marketplace/redhat-operators-q69b9" Mar 16 15:37:52 crc kubenswrapper[5120]: I0316 15:37:52.443548 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/05676c54-5e12-4b89-a0ad-a5f56b167117-catalog-content\") pod \"redhat-operators-q69b9\" (UID: \"05676c54-5e12-4b89-a0ad-a5f56b167117\") " pod="openshift-marketplace/redhat-operators-q69b9" Mar 16 15:37:52 crc kubenswrapper[5120]: I0316 15:37:52.443572 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/05676c54-5e12-4b89-a0ad-a5f56b167117-utilities\") pod \"redhat-operators-q69b9\" (UID: \"05676c54-5e12-4b89-a0ad-a5f56b167117\") " pod="openshift-marketplace/redhat-operators-q69b9" Mar 16 15:37:52 crc kubenswrapper[5120]: I0316 15:37:52.456497 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-6xr7p" Mar 16 15:37:52 crc kubenswrapper[5120]: I0316 15:37:52.463462 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mff9m\" (UniqueName: \"kubernetes.io/projected/05676c54-5e12-4b89-a0ad-a5f56b167117-kube-api-access-mff9m\") pod \"redhat-operators-q69b9\" (UID: \"05676c54-5e12-4b89-a0ad-a5f56b167117\") " pod="openshift-marketplace/redhat-operators-q69b9" Mar 16 15:37:52 crc kubenswrapper[5120]: I0316 15:37:52.655713 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-q69b9" Mar 16 15:37:52 crc kubenswrapper[5120]: I0316 15:37:52.815390 5120 generic.go:358] "Generic (PLEG): container finished" podID="0f9b752f-73c2-4fc5-b1d0-8b4edfa2b771" containerID="fff02420dcf17d2304ce9c6ace9e4ec9706792f65930e2b431c61cba0692d6bd" exitCode=0 Mar 16 15:37:52 crc kubenswrapper[5120]: I0316 15:37:52.815467 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-bgzkt" event={"ID":"0f9b752f-73c2-4fc5-b1d0-8b4edfa2b771","Type":"ContainerDied","Data":"fff02420dcf17d2304ce9c6ace9e4ec9706792f65930e2b431c61cba0692d6bd"} Mar 16 15:37:52 crc kubenswrapper[5120]: I0316 15:37:52.824555 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-klcgv" event={"ID":"cb61d003-089b-4f3a-b84e-03d45c451335","Type":"ContainerStarted","Data":"b5378400ac79c94a2828b4a7bda327fe0cb650da37ed994fe2b1c79a0baa4261"} Mar 16 15:37:52 crc kubenswrapper[5120]: I0316 15:37:52.859124 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/certified-operators-klcgv" podStartSLOduration=3.238017441 podStartE2EDuration="3.859107201s" podCreationTimestamp="2026-03-16 15:37:49 +0000 UTC" firstStartedPulling="2026-03-16 15:37:50.794920554 +0000 UTC m=+372.948852241" lastFinishedPulling="2026-03-16 15:37:51.416010304 +0000 UTC m=+373.569942001" observedRunningTime="2026-03-16 15:37:52.856847326 +0000 UTC m=+375.010779003" watchObservedRunningTime="2026-03-16 15:37:52.859107201 +0000 UTC m=+375.013038858" Mar 16 15:37:52 crc kubenswrapper[5120]: I0316 15:37:52.895188 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-6xr7p"] Mar 16 15:37:53 crc kubenswrapper[5120]: I0316 15:37:53.067084 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-q69b9"] Mar 16 15:37:53 crc kubenswrapper[5120]: E0316 15:37:53.136172 5120 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd233c35e_a24a_4f65_9bea_f280bc1e51a7.slice/crio-conmon-f27e457212823ec38737436830e24a075de3bfc883c7297341b58a28399bf4c1.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd233c35e_a24a_4f65_9bea_f280bc1e51a7.slice/crio-f27e457212823ec38737436830e24a075de3bfc883c7297341b58a28399bf4c1.scope\": RecentStats: unable to find data in memory cache]" Mar 16 15:37:53 crc kubenswrapper[5120]: I0316 15:37:53.830706 5120 generic.go:358] "Generic (PLEG): container finished" podID="d233c35e-a24a-4f65-9bea-f280bc1e51a7" containerID="f27e457212823ec38737436830e24a075de3bfc883c7297341b58a28399bf4c1" exitCode=0 Mar 16 15:37:53 crc kubenswrapper[5120]: I0316 15:37:53.830823 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-6xr7p" event={"ID":"d233c35e-a24a-4f65-9bea-f280bc1e51a7","Type":"ContainerDied","Data":"f27e457212823ec38737436830e24a075de3bfc883c7297341b58a28399bf4c1"} Mar 16 15:37:53 crc kubenswrapper[5120]: I0316 15:37:53.830946 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-6xr7p" event={"ID":"d233c35e-a24a-4f65-9bea-f280bc1e51a7","Type":"ContainerStarted","Data":"381a8c0e19f2b3c0fc8a5b5a2607a25c0d1f81eddbb587e620b9c0ff954dcf5f"} Mar 16 15:37:53 crc kubenswrapper[5120]: I0316 15:37:53.833643 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-bgzkt" event={"ID":"0f9b752f-73c2-4fc5-b1d0-8b4edfa2b771","Type":"ContainerStarted","Data":"159ab642b2bd29f18441224ba037b7cf6b4c710551ae735b9f1199d1eb02b395"} Mar 16 15:37:53 crc kubenswrapper[5120]: I0316 15:37:53.835939 5120 generic.go:358] "Generic (PLEG): container finished" podID="05676c54-5e12-4b89-a0ad-a5f56b167117" containerID="c4baf15dd6211764d7443a703b7f0254a95f62093e3e7815c468dc1ffac80337" exitCode=0 Mar 16 15:37:53 crc kubenswrapper[5120]: I0316 15:37:53.836079 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-q69b9" event={"ID":"05676c54-5e12-4b89-a0ad-a5f56b167117","Type":"ContainerDied","Data":"c4baf15dd6211764d7443a703b7f0254a95f62093e3e7815c468dc1ffac80337"} Mar 16 15:37:53 crc kubenswrapper[5120]: I0316 15:37:53.836116 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-q69b9" event={"ID":"05676c54-5e12-4b89-a0ad-a5f56b167117","Type":"ContainerStarted","Data":"8968ade259fbabd51d3ef11c659bcce3ec81888bb0df75b5583bb8cbe5d061d7"} Mar 16 15:37:53 crc kubenswrapper[5120]: I0316 15:37:53.879241 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/community-operators-bgzkt" podStartSLOduration=4.302418825 podStartE2EDuration="4.879223631s" podCreationTimestamp="2026-03-16 15:37:49 +0000 UTC" firstStartedPulling="2026-03-16 15:37:51.805365244 +0000 UTC m=+373.959296901" lastFinishedPulling="2026-03-16 15:37:52.38217005 +0000 UTC m=+374.536101707" observedRunningTime="2026-03-16 15:37:53.878050167 +0000 UTC m=+376.031981824" watchObservedRunningTime="2026-03-16 15:37:53.879223631 +0000 UTC m=+376.033155298" Mar 16 15:37:54 crc kubenswrapper[5120]: I0316 15:37:54.843961 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-q69b9" event={"ID":"05676c54-5e12-4b89-a0ad-a5f56b167117","Type":"ContainerStarted","Data":"396f8088f26c32a035e0b5f429875248aca7ee99e349748ff90ec15c0bb43694"} Mar 16 15:37:55 crc kubenswrapper[5120]: I0316 15:37:55.862317 5120 generic.go:358] "Generic (PLEG): container finished" podID="d233c35e-a24a-4f65-9bea-f280bc1e51a7" containerID="2a2ef98ac1d704ddf771e9c58e11c3219bf4d3a3c06de1ad08d356e35d351931" exitCode=0 Mar 16 15:37:55 crc kubenswrapper[5120]: I0316 15:37:55.862893 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-6xr7p" event={"ID":"d233c35e-a24a-4f65-9bea-f280bc1e51a7","Type":"ContainerDied","Data":"2a2ef98ac1d704ddf771e9c58e11c3219bf4d3a3c06de1ad08d356e35d351931"} Mar 16 15:37:55 crc kubenswrapper[5120]: I0316 15:37:55.875917 5120 generic.go:358] "Generic (PLEG): container finished" podID="05676c54-5e12-4b89-a0ad-a5f56b167117" containerID="396f8088f26c32a035e0b5f429875248aca7ee99e349748ff90ec15c0bb43694" exitCode=0 Mar 16 15:37:55 crc kubenswrapper[5120]: I0316 15:37:55.876080 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-q69b9" event={"ID":"05676c54-5e12-4b89-a0ad-a5f56b167117","Type":"ContainerDied","Data":"396f8088f26c32a035e0b5f429875248aca7ee99e349748ff90ec15c0bb43694"} Mar 16 15:37:56 crc kubenswrapper[5120]: I0316 15:37:56.883461 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-q69b9" event={"ID":"05676c54-5e12-4b89-a0ad-a5f56b167117","Type":"ContainerStarted","Data":"18a6306e072fb085431be9118d7ce43e2d6beecf875dd19faf963c322d3251ef"} Mar 16 15:37:56 crc kubenswrapper[5120]: I0316 15:37:56.887132 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-6xr7p" event={"ID":"d233c35e-a24a-4f65-9bea-f280bc1e51a7","Type":"ContainerStarted","Data":"6a043e5aee9b196e9e728874651a35da4059889c3143eb3394fd4aff75b17254"} Mar 16 15:37:56 crc kubenswrapper[5120]: I0316 15:37:56.903959 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/redhat-operators-q69b9" podStartSLOduration=4.162664431 podStartE2EDuration="4.903940453s" podCreationTimestamp="2026-03-16 15:37:52 +0000 UTC" firstStartedPulling="2026-03-16 15:37:53.836793439 +0000 UTC m=+375.990725106" lastFinishedPulling="2026-03-16 15:37:54.578069431 +0000 UTC m=+376.732001128" observedRunningTime="2026-03-16 15:37:56.902051528 +0000 UTC m=+379.055983195" watchObservedRunningTime="2026-03-16 15:37:56.903940453 +0000 UTC m=+379.057872120" Mar 16 15:37:56 crc kubenswrapper[5120]: I0316 15:37:56.924714 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/redhat-marketplace-6xr7p" podStartSLOduration=3.97817477 podStartE2EDuration="4.92468585s" podCreationTimestamp="2026-03-16 15:37:52 +0000 UTC" firstStartedPulling="2026-03-16 15:37:53.831439575 +0000 UTC m=+375.985371232" lastFinishedPulling="2026-03-16 15:37:54.777950635 +0000 UTC m=+376.931882312" observedRunningTime="2026-03-16 15:37:56.921111347 +0000 UTC m=+379.075043014" watchObservedRunningTime="2026-03-16 15:37:56.92468585 +0000 UTC m=+379.078617547" Mar 16 15:38:00 crc kubenswrapper[5120]: I0316 15:38:00.068689 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/certified-operators-klcgv" Mar 16 15:38:00 crc kubenswrapper[5120]: I0316 15:38:00.069070 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-marketplace/certified-operators-klcgv" Mar 16 15:38:00 crc kubenswrapper[5120]: I0316 15:38:00.153327 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-infra/auto-csr-approver-29561258-hkqrm"] Mar 16 15:38:00 crc kubenswrapper[5120]: I0316 15:38:00.196269 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/certified-operators-klcgv" Mar 16 15:38:00 crc kubenswrapper[5120]: I0316 15:38:00.196298 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561258-hkqrm" Mar 16 15:38:00 crc kubenswrapper[5120]: I0316 15:38:00.196316 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561258-hkqrm"] Mar 16 15:38:00 crc kubenswrapper[5120]: I0316 15:38:00.198534 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"openshift-service-ca.crt\"" Mar 16 15:38:00 crc kubenswrapper[5120]: I0316 15:38:00.198962 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-infra\"/\"csr-approver-sa-dockercfg-x2nsz\"" Mar 16 15:38:00 crc kubenswrapper[5120]: I0316 15:38:00.202984 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"kube-root-ca.crt\"" Mar 16 15:38:00 crc kubenswrapper[5120]: I0316 15:38:00.263889 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmltz\" (UniqueName: \"kubernetes.io/projected/7b49055e-b7d0-4b5c-86c7-e975d1f4f348-kube-api-access-bmltz\") pod \"auto-csr-approver-29561258-hkqrm\" (UID: \"7b49055e-b7d0-4b5c-86c7-e975d1f4f348\") " pod="openshift-infra/auto-csr-approver-29561258-hkqrm" Mar 16 15:38:00 crc kubenswrapper[5120]: I0316 15:38:00.273606 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-marketplace/community-operators-bgzkt" Mar 16 15:38:00 crc kubenswrapper[5120]: I0316 15:38:00.273670 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/community-operators-bgzkt" Mar 16 15:38:00 crc kubenswrapper[5120]: I0316 15:38:00.308060 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/community-operators-bgzkt" Mar 16 15:38:00 crc kubenswrapper[5120]: I0316 15:38:00.364960 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bmltz\" (UniqueName: \"kubernetes.io/projected/7b49055e-b7d0-4b5c-86c7-e975d1f4f348-kube-api-access-bmltz\") pod \"auto-csr-approver-29561258-hkqrm\" (UID: \"7b49055e-b7d0-4b5c-86c7-e975d1f4f348\") " pod="openshift-infra/auto-csr-approver-29561258-hkqrm" Mar 16 15:38:00 crc kubenswrapper[5120]: I0316 15:38:00.394928 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmltz\" (UniqueName: \"kubernetes.io/projected/7b49055e-b7d0-4b5c-86c7-e975d1f4f348-kube-api-access-bmltz\") pod \"auto-csr-approver-29561258-hkqrm\" (UID: \"7b49055e-b7d0-4b5c-86c7-e975d1f4f348\") " pod="openshift-infra/auto-csr-approver-29561258-hkqrm" Mar 16 15:38:00 crc kubenswrapper[5120]: I0316 15:38:00.525460 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561258-hkqrm" Mar 16 15:38:00 crc kubenswrapper[5120]: I0316 15:38:00.972914 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/community-operators-bgzkt" Mar 16 15:38:00 crc kubenswrapper[5120]: I0316 15:38:00.977584 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561258-hkqrm"] Mar 16 15:38:00 crc kubenswrapper[5120]: I0316 15:38:00.981155 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/certified-operators-klcgv" Mar 16 15:38:00 crc kubenswrapper[5120]: W0316 15:38:00.989930 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7b49055e_b7d0_4b5c_86c7_e975d1f4f348.slice/crio-9933405e7382066733c0d622abdf2cdc05c6d6967dd597b88b6093fd06f391be WatchSource:0}: Error finding container 9933405e7382066733c0d622abdf2cdc05c6d6967dd597b88b6093fd06f391be: Status 404 returned error can't find the container with id 9933405e7382066733c0d622abdf2cdc05c6d6967dd597b88b6093fd06f391be Mar 16 15:38:01 crc kubenswrapper[5120]: I0316 15:38:01.926544 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561258-hkqrm" event={"ID":"7b49055e-b7d0-4b5c-86c7-e975d1f4f348","Type":"ContainerStarted","Data":"9933405e7382066733c0d622abdf2cdc05c6d6967dd597b88b6093fd06f391be"} Mar 16 15:38:02 crc kubenswrapper[5120]: I0316 15:38:02.457592 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-marketplace-6xr7p" Mar 16 15:38:02 crc kubenswrapper[5120]: I0316 15:38:02.457951 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-marketplace/redhat-marketplace-6xr7p" Mar 16 15:38:02 crc kubenswrapper[5120]: I0316 15:38:02.495714 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-marketplace-6xr7p" Mar 16 15:38:02 crc kubenswrapper[5120]: I0316 15:38:02.656893 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-marketplace/redhat-operators-q69b9" Mar 16 15:38:02 crc kubenswrapper[5120]: I0316 15:38:02.657005 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-operators-q69b9" Mar 16 15:38:02 crc kubenswrapper[5120]: I0316 15:38:02.706803 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-operators-q69b9" Mar 16 15:38:02 crc kubenswrapper[5120]: I0316 15:38:02.933561 5120 generic.go:358] "Generic (PLEG): container finished" podID="7b49055e-b7d0-4b5c-86c7-e975d1f4f348" containerID="da33be415161b80313a9952be399bc9304e1e8c782e55ddd77e6970418395115" exitCode=0 Mar 16 15:38:02 crc kubenswrapper[5120]: I0316 15:38:02.933705 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561258-hkqrm" event={"ID":"7b49055e-b7d0-4b5c-86c7-e975d1f4f348","Type":"ContainerDied","Data":"da33be415161b80313a9952be399bc9304e1e8c782e55ddd77e6970418395115"} Mar 16 15:38:02 crc kubenswrapper[5120]: I0316 15:38:02.969067 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-marketplace-6xr7p" Mar 16 15:38:02 crc kubenswrapper[5120]: I0316 15:38:02.980536 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-operators-q69b9" Mar 16 15:38:04 crc kubenswrapper[5120]: I0316 15:38:04.293453 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561258-hkqrm" Mar 16 15:38:04 crc kubenswrapper[5120]: I0316 15:38:04.454223 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bmltz\" (UniqueName: \"kubernetes.io/projected/7b49055e-b7d0-4b5c-86c7-e975d1f4f348-kube-api-access-bmltz\") pod \"7b49055e-b7d0-4b5c-86c7-e975d1f4f348\" (UID: \"7b49055e-b7d0-4b5c-86c7-e975d1f4f348\") " Mar 16 15:38:04 crc kubenswrapper[5120]: I0316 15:38:04.462985 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b49055e-b7d0-4b5c-86c7-e975d1f4f348-kube-api-access-bmltz" (OuterVolumeSpecName: "kube-api-access-bmltz") pod "7b49055e-b7d0-4b5c-86c7-e975d1f4f348" (UID: "7b49055e-b7d0-4b5c-86c7-e975d1f4f348"). InnerVolumeSpecName "kube-api-access-bmltz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:38:04 crc kubenswrapper[5120]: I0316 15:38:04.555851 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bmltz\" (UniqueName: \"kubernetes.io/projected/7b49055e-b7d0-4b5c-86c7-e975d1f4f348-kube-api-access-bmltz\") on node \"crc\" DevicePath \"\"" Mar 16 15:38:04 crc kubenswrapper[5120]: I0316 15:38:04.948366 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561258-hkqrm" Mar 16 15:38:04 crc kubenswrapper[5120]: I0316 15:38:04.948404 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561258-hkqrm" event={"ID":"7b49055e-b7d0-4b5c-86c7-e975d1f4f348","Type":"ContainerDied","Data":"9933405e7382066733c0d622abdf2cdc05c6d6967dd597b88b6093fd06f391be"} Mar 16 15:38:04 crc kubenswrapper[5120]: I0316 15:38:04.948444 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9933405e7382066733c0d622abdf2cdc05c6d6967dd597b88b6093fd06f391be" Mar 16 15:38:22 crc kubenswrapper[5120]: I0316 15:38:22.008283 5120 patch_prober.go:28] interesting pod/machine-config-daemon-7bf76 container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 15:38:22 crc kubenswrapper[5120]: I0316 15:38:22.009024 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 15:38:52 crc kubenswrapper[5120]: I0316 15:38:52.008122 5120 patch_prober.go:28] interesting pod/machine-config-daemon-7bf76 container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 15:38:52 crc kubenswrapper[5120]: I0316 15:38:52.008988 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 15:39:22 crc kubenswrapper[5120]: I0316 15:39:22.010475 5120 patch_prober.go:28] interesting pod/machine-config-daemon-7bf76 container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 15:39:22 crc kubenswrapper[5120]: I0316 15:39:22.011224 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 15:39:22 crc kubenswrapper[5120]: I0316 15:39:22.011292 5120 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" Mar 16 15:39:22 crc kubenswrapper[5120]: I0316 15:39:22.012146 5120 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="machine-config-daemon" containerStatusID={"Type":"cri-o","ID":"4730db759297f0a075089df3a65417a9e171e80454e4c218ce5ff9ad42541d2c"} pod="openshift-machine-config-operator/machine-config-daemon-7bf76" containerMessage="Container machine-config-daemon failed liveness probe, will be restarted" Mar 16 15:39:22 crc kubenswrapper[5120]: I0316 15:39:22.012232 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" containerID="cri-o://4730db759297f0a075089df3a65417a9e171e80454e4c218ce5ff9ad42541d2c" gracePeriod=600 Mar 16 15:39:23 crc kubenswrapper[5120]: I0316 15:39:23.050423 5120 generic.go:358] "Generic (PLEG): container finished" podID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerID="4730db759297f0a075089df3a65417a9e171e80454e4c218ce5ff9ad42541d2c" exitCode=0 Mar 16 15:39:23 crc kubenswrapper[5120]: I0316 15:39:23.050632 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" event={"ID":"e2275cb4-4905-4d66-a87e-8010120db2bd","Type":"ContainerDied","Data":"4730db759297f0a075089df3a65417a9e171e80454e4c218ce5ff9ad42541d2c"} Mar 16 15:39:23 crc kubenswrapper[5120]: I0316 15:39:23.050717 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" event={"ID":"e2275cb4-4905-4d66-a87e-8010120db2bd","Type":"ContainerStarted","Data":"fe2426202af166b77e9fd173b727bad4de2670c667b0a78fd50b1f4b1beddf6d"} Mar 16 15:39:23 crc kubenswrapper[5120]: I0316 15:39:23.050738 5120 scope.go:117] "RemoveContainer" containerID="918b5e16649d3658eed82cd6bd90691a9be4a2e395ae1cb2cac748c3eee9124d" Mar 16 15:40:00 crc kubenswrapper[5120]: I0316 15:40:00.148059 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-infra/auto-csr-approver-29561260-vphq6"] Mar 16 15:40:00 crc kubenswrapper[5120]: I0316 15:40:00.149644 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b49055e-b7d0-4b5c-86c7-e975d1f4f348" containerName="oc" Mar 16 15:40:00 crc kubenswrapper[5120]: I0316 15:40:00.149666 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b49055e-b7d0-4b5c-86c7-e975d1f4f348" containerName="oc" Mar 16 15:40:00 crc kubenswrapper[5120]: I0316 15:40:00.149874 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7b49055e-b7d0-4b5c-86c7-e975d1f4f348" containerName="oc" Mar 16 15:40:00 crc kubenswrapper[5120]: I0316 15:40:00.156986 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561260-vphq6" Mar 16 15:40:00 crc kubenswrapper[5120]: I0316 15:40:00.159401 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561260-vphq6"] Mar 16 15:40:00 crc kubenswrapper[5120]: I0316 15:40:00.160414 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"openshift-service-ca.crt\"" Mar 16 15:40:00 crc kubenswrapper[5120]: I0316 15:40:00.161805 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-infra\"/\"csr-approver-sa-dockercfg-x2nsz\"" Mar 16 15:40:00 crc kubenswrapper[5120]: I0316 15:40:00.162053 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"kube-root-ca.crt\"" Mar 16 15:40:00 crc kubenswrapper[5120]: I0316 15:40:00.287028 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gd6sr\" (UniqueName: \"kubernetes.io/projected/30f78f33-9e10-4fa0-891d-11ff38275e0a-kube-api-access-gd6sr\") pod \"auto-csr-approver-29561260-vphq6\" (UID: \"30f78f33-9e10-4fa0-891d-11ff38275e0a\") " pod="openshift-infra/auto-csr-approver-29561260-vphq6" Mar 16 15:40:00 crc kubenswrapper[5120]: I0316 15:40:00.388350 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gd6sr\" (UniqueName: \"kubernetes.io/projected/30f78f33-9e10-4fa0-891d-11ff38275e0a-kube-api-access-gd6sr\") pod \"auto-csr-approver-29561260-vphq6\" (UID: \"30f78f33-9e10-4fa0-891d-11ff38275e0a\") " pod="openshift-infra/auto-csr-approver-29561260-vphq6" Mar 16 15:40:00 crc kubenswrapper[5120]: I0316 15:40:00.423444 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gd6sr\" (UniqueName: \"kubernetes.io/projected/30f78f33-9e10-4fa0-891d-11ff38275e0a-kube-api-access-gd6sr\") pod \"auto-csr-approver-29561260-vphq6\" (UID: \"30f78f33-9e10-4fa0-891d-11ff38275e0a\") " pod="openshift-infra/auto-csr-approver-29561260-vphq6" Mar 16 15:40:00 crc kubenswrapper[5120]: I0316 15:40:00.483672 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561260-vphq6" Mar 16 15:40:00 crc kubenswrapper[5120]: I0316 15:40:00.746667 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561260-vphq6"] Mar 16 15:40:01 crc kubenswrapper[5120]: I0316 15:40:01.302287 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561260-vphq6" event={"ID":"30f78f33-9e10-4fa0-891d-11ff38275e0a","Type":"ContainerStarted","Data":"e8c8442e1b15d4c41984bf5ca0a41614e344c47e648344a71b3c5e7b536cfd9b"} Mar 16 15:40:02 crc kubenswrapper[5120]: I0316 15:40:02.313229 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561260-vphq6" event={"ID":"30f78f33-9e10-4fa0-891d-11ff38275e0a","Type":"ContainerStarted","Data":"eacaf4109f18c9b4594fb8c46d8eb3d08cad9696a9b6d42165f6c017f7d0a718"} Mar 16 15:40:02 crc kubenswrapper[5120]: I0316 15:40:02.332978 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-infra/auto-csr-approver-29561260-vphq6" podStartSLOduration=1.30182472 podStartE2EDuration="2.332951832s" podCreationTimestamp="2026-03-16 15:40:00 +0000 UTC" firstStartedPulling="2026-03-16 15:40:00.749674768 +0000 UTC m=+502.903606435" lastFinishedPulling="2026-03-16 15:40:01.78080189 +0000 UTC m=+503.934733547" observedRunningTime="2026-03-16 15:40:02.329356142 +0000 UTC m=+504.483287809" watchObservedRunningTime="2026-03-16 15:40:02.332951832 +0000 UTC m=+504.486883529" Mar 16 15:40:03 crc kubenswrapper[5120]: I0316 15:40:03.320253 5120 generic.go:358] "Generic (PLEG): container finished" podID="30f78f33-9e10-4fa0-891d-11ff38275e0a" containerID="eacaf4109f18c9b4594fb8c46d8eb3d08cad9696a9b6d42165f6c017f7d0a718" exitCode=0 Mar 16 15:40:03 crc kubenswrapper[5120]: I0316 15:40:03.321043 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561260-vphq6" event={"ID":"30f78f33-9e10-4fa0-891d-11ff38275e0a","Type":"ContainerDied","Data":"eacaf4109f18c9b4594fb8c46d8eb3d08cad9696a9b6d42165f6c017f7d0a718"} Mar 16 15:40:04 crc kubenswrapper[5120]: I0316 15:40:04.644340 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561260-vphq6" Mar 16 15:40:04 crc kubenswrapper[5120]: I0316 15:40:04.746872 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gd6sr\" (UniqueName: \"kubernetes.io/projected/30f78f33-9e10-4fa0-891d-11ff38275e0a-kube-api-access-gd6sr\") pod \"30f78f33-9e10-4fa0-891d-11ff38275e0a\" (UID: \"30f78f33-9e10-4fa0-891d-11ff38275e0a\") " Mar 16 15:40:04 crc kubenswrapper[5120]: I0316 15:40:04.753083 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30f78f33-9e10-4fa0-891d-11ff38275e0a-kube-api-access-gd6sr" (OuterVolumeSpecName: "kube-api-access-gd6sr") pod "30f78f33-9e10-4fa0-891d-11ff38275e0a" (UID: "30f78f33-9e10-4fa0-891d-11ff38275e0a"). InnerVolumeSpecName "kube-api-access-gd6sr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:40:04 crc kubenswrapper[5120]: I0316 15:40:04.847962 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gd6sr\" (UniqueName: \"kubernetes.io/projected/30f78f33-9e10-4fa0-891d-11ff38275e0a-kube-api-access-gd6sr\") on node \"crc\" DevicePath \"\"" Mar 16 15:40:05 crc kubenswrapper[5120]: I0316 15:40:05.339137 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561260-vphq6" event={"ID":"30f78f33-9e10-4fa0-891d-11ff38275e0a","Type":"ContainerDied","Data":"e8c8442e1b15d4c41984bf5ca0a41614e344c47e648344a71b3c5e7b536cfd9b"} Mar 16 15:40:05 crc kubenswrapper[5120]: I0316 15:40:05.339206 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e8c8442e1b15d4c41984bf5ca0a41614e344c47e648344a71b3c5e7b536cfd9b" Mar 16 15:40:05 crc kubenswrapper[5120]: I0316 15:40:05.339159 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561260-vphq6" Mar 16 15:40:05 crc kubenswrapper[5120]: I0316 15:40:05.400975 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-infra/auto-csr-approver-29561254-gtc86"] Mar 16 15:40:05 crc kubenswrapper[5120]: I0316 15:40:05.407308 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-infra/auto-csr-approver-29561254-gtc86"] Mar 16 15:40:06 crc kubenswrapper[5120]: I0316 15:40:06.670010 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7ecb3681-0da8-4d4a-9634-ce236c5ac399" path="/var/lib/kubelet/pods/7ecb3681-0da8-4d4a-9634-ce236c5ac399/volumes" Mar 16 15:40:39 crc kubenswrapper[5120]: I0316 15:40:39.127863 5120 scope.go:117] "RemoveContainer" containerID="4daa17fb3a50b05591503f3f5efe464b1d42bb81c3e84c0a500cbfa5bcb45d24" Mar 16 15:41:22 crc kubenswrapper[5120]: I0316 15:41:22.007830 5120 patch_prober.go:28] interesting pod/machine-config-daemon-7bf76 container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 15:41:22 crc kubenswrapper[5120]: I0316 15:41:22.008624 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 15:41:38 crc kubenswrapper[5120]: I0316 15:41:38.909435 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-crc_9f0bc7fcb0822a2c13eb2d22cd8c0641/kube-controller-manager/0.log" Mar 16 15:41:38 crc kubenswrapper[5120]: I0316 15:41:38.909707 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-crc_9f0bc7fcb0822a2c13eb2d22cd8c0641/kube-controller-manager/0.log" Mar 16 15:41:52 crc kubenswrapper[5120]: I0316 15:41:52.008536 5120 patch_prober.go:28] interesting pod/machine-config-daemon-7bf76 container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 15:41:52 crc kubenswrapper[5120]: I0316 15:41:52.009384 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 15:42:00 crc kubenswrapper[5120]: I0316 15:42:00.154223 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-infra/auto-csr-approver-29561262-627cz"] Mar 16 15:42:00 crc kubenswrapper[5120]: I0316 15:42:00.156058 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30f78f33-9e10-4fa0-891d-11ff38275e0a" containerName="oc" Mar 16 15:42:00 crc kubenswrapper[5120]: I0316 15:42:00.156113 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="30f78f33-9e10-4fa0-891d-11ff38275e0a" containerName="oc" Mar 16 15:42:00 crc kubenswrapper[5120]: I0316 15:42:00.156345 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="30f78f33-9e10-4fa0-891d-11ff38275e0a" containerName="oc" Mar 16 15:42:00 crc kubenswrapper[5120]: I0316 15:42:00.165138 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561262-627cz"] Mar 16 15:42:00 crc kubenswrapper[5120]: I0316 15:42:00.165307 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561262-627cz" Mar 16 15:42:00 crc kubenswrapper[5120]: I0316 15:42:00.168044 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-infra\"/\"csr-approver-sa-dockercfg-x2nsz\"" Mar 16 15:42:00 crc kubenswrapper[5120]: I0316 15:42:00.168593 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"kube-root-ca.crt\"" Mar 16 15:42:00 crc kubenswrapper[5120]: I0316 15:42:00.168727 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"openshift-service-ca.crt\"" Mar 16 15:42:00 crc kubenswrapper[5120]: I0316 15:42:00.329565 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwbrp\" (UniqueName: \"kubernetes.io/projected/4fa264bb-f592-4dd6-b94c-a2f559948b46-kube-api-access-rwbrp\") pod \"auto-csr-approver-29561262-627cz\" (UID: \"4fa264bb-f592-4dd6-b94c-a2f559948b46\") " pod="openshift-infra/auto-csr-approver-29561262-627cz" Mar 16 15:42:00 crc kubenswrapper[5120]: I0316 15:42:00.431789 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rwbrp\" (UniqueName: \"kubernetes.io/projected/4fa264bb-f592-4dd6-b94c-a2f559948b46-kube-api-access-rwbrp\") pod \"auto-csr-approver-29561262-627cz\" (UID: \"4fa264bb-f592-4dd6-b94c-a2f559948b46\") " pod="openshift-infra/auto-csr-approver-29561262-627cz" Mar 16 15:42:00 crc kubenswrapper[5120]: I0316 15:42:00.464619 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwbrp\" (UniqueName: \"kubernetes.io/projected/4fa264bb-f592-4dd6-b94c-a2f559948b46-kube-api-access-rwbrp\") pod \"auto-csr-approver-29561262-627cz\" (UID: \"4fa264bb-f592-4dd6-b94c-a2f559948b46\") " pod="openshift-infra/auto-csr-approver-29561262-627cz" Mar 16 15:42:00 crc kubenswrapper[5120]: I0316 15:42:00.498864 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561262-627cz" Mar 16 15:42:00 crc kubenswrapper[5120]: I0316 15:42:00.731845 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561262-627cz"] Mar 16 15:42:00 crc kubenswrapper[5120]: W0316 15:42:00.735383 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4fa264bb_f592_4dd6_b94c_a2f559948b46.slice/crio-9286575757a80adb37badb81459eac4410c1839f7b882b5274d5856b7f6726dc WatchSource:0}: Error finding container 9286575757a80adb37badb81459eac4410c1839f7b882b5274d5856b7f6726dc: Status 404 returned error can't find the container with id 9286575757a80adb37badb81459eac4410c1839f7b882b5274d5856b7f6726dc Mar 16 15:42:01 crc kubenswrapper[5120]: I0316 15:42:01.142879 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561262-627cz" event={"ID":"4fa264bb-f592-4dd6-b94c-a2f559948b46","Type":"ContainerStarted","Data":"9286575757a80adb37badb81459eac4410c1839f7b882b5274d5856b7f6726dc"} Mar 16 15:42:02 crc kubenswrapper[5120]: I0316 15:42:02.151256 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561262-627cz" event={"ID":"4fa264bb-f592-4dd6-b94c-a2f559948b46","Type":"ContainerStarted","Data":"aa2b1fb5bca9513acf0cb6c094763a4999643358b7703afb3e78e8bbe7fcef0f"} Mar 16 15:42:02 crc kubenswrapper[5120]: I0316 15:42:02.173940 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-infra/auto-csr-approver-29561262-627cz" podStartSLOduration=1.163446134 podStartE2EDuration="2.173920428s" podCreationTimestamp="2026-03-16 15:42:00 +0000 UTC" firstStartedPulling="2026-03-16 15:42:00.736714024 +0000 UTC m=+622.890645681" lastFinishedPulling="2026-03-16 15:42:01.747188308 +0000 UTC m=+623.901119975" observedRunningTime="2026-03-16 15:42:02.167555807 +0000 UTC m=+624.321487494" watchObservedRunningTime="2026-03-16 15:42:02.173920428 +0000 UTC m=+624.327852095" Mar 16 15:42:03 crc kubenswrapper[5120]: I0316 15:42:03.162856 5120 generic.go:358] "Generic (PLEG): container finished" podID="4fa264bb-f592-4dd6-b94c-a2f559948b46" containerID="aa2b1fb5bca9513acf0cb6c094763a4999643358b7703afb3e78e8bbe7fcef0f" exitCode=0 Mar 16 15:42:03 crc kubenswrapper[5120]: I0316 15:42:03.162960 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561262-627cz" event={"ID":"4fa264bb-f592-4dd6-b94c-a2f559948b46","Type":"ContainerDied","Data":"aa2b1fb5bca9513acf0cb6c094763a4999643358b7703afb3e78e8bbe7fcef0f"} Mar 16 15:42:05 crc kubenswrapper[5120]: I0316 15:42:05.221249 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561262-627cz" Mar 16 15:42:05 crc kubenswrapper[5120]: I0316 15:42:05.304294 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rwbrp\" (UniqueName: \"kubernetes.io/projected/4fa264bb-f592-4dd6-b94c-a2f559948b46-kube-api-access-rwbrp\") pod \"4fa264bb-f592-4dd6-b94c-a2f559948b46\" (UID: \"4fa264bb-f592-4dd6-b94c-a2f559948b46\") " Mar 16 15:42:05 crc kubenswrapper[5120]: I0316 15:42:05.310416 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4fa264bb-f592-4dd6-b94c-a2f559948b46-kube-api-access-rwbrp" (OuterVolumeSpecName: "kube-api-access-rwbrp") pod "4fa264bb-f592-4dd6-b94c-a2f559948b46" (UID: "4fa264bb-f592-4dd6-b94c-a2f559948b46"). InnerVolumeSpecName "kube-api-access-rwbrp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:42:05 crc kubenswrapper[5120]: I0316 15:42:05.405381 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rwbrp\" (UniqueName: \"kubernetes.io/projected/4fa264bb-f592-4dd6-b94c-a2f559948b46-kube-api-access-rwbrp\") on node \"crc\" DevicePath \"\"" Mar 16 15:42:06 crc kubenswrapper[5120]: I0316 15:42:06.185974 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561262-627cz" Mar 16 15:42:06 crc kubenswrapper[5120]: I0316 15:42:06.185985 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561262-627cz" event={"ID":"4fa264bb-f592-4dd6-b94c-a2f559948b46","Type":"ContainerDied","Data":"9286575757a80adb37badb81459eac4410c1839f7b882b5274d5856b7f6726dc"} Mar 16 15:42:06 crc kubenswrapper[5120]: I0316 15:42:06.186160 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9286575757a80adb37badb81459eac4410c1839f7b882b5274d5856b7f6726dc" Mar 16 15:42:06 crc kubenswrapper[5120]: I0316 15:42:06.303338 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-infra/auto-csr-approver-29561256-ttmqg"] Mar 16 15:42:06 crc kubenswrapper[5120]: I0316 15:42:06.310715 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-infra/auto-csr-approver-29561256-ttmqg"] Mar 16 15:42:06 crc kubenswrapper[5120]: I0316 15:42:06.677192 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="58fd4e88-9c10-43f9-87f9-13b8faa0efc6" path="/var/lib/kubelet/pods/58fd4e88-9c10-43f9-87f9-13b8faa0efc6/volumes" Mar 16 15:42:22 crc kubenswrapper[5120]: I0316 15:42:22.008118 5120 patch_prober.go:28] interesting pod/machine-config-daemon-7bf76 container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 15:42:22 crc kubenswrapper[5120]: I0316 15:42:22.009009 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 15:42:22 crc kubenswrapper[5120]: I0316 15:42:22.009122 5120 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" Mar 16 15:42:22 crc kubenswrapper[5120]: I0316 15:42:22.011227 5120 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="machine-config-daemon" containerStatusID={"Type":"cri-o","ID":"fe2426202af166b77e9fd173b727bad4de2670c667b0a78fd50b1f4b1beddf6d"} pod="openshift-machine-config-operator/machine-config-daemon-7bf76" containerMessage="Container machine-config-daemon failed liveness probe, will be restarted" Mar 16 15:42:22 crc kubenswrapper[5120]: I0316 15:42:22.011459 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" containerID="cri-o://fe2426202af166b77e9fd173b727bad4de2670c667b0a78fd50b1f4b1beddf6d" gracePeriod=600 Mar 16 15:42:22 crc kubenswrapper[5120]: I0316 15:42:22.148381 5120 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Mar 16 15:42:22 crc kubenswrapper[5120]: I0316 15:42:22.307236 5120 generic.go:358] "Generic (PLEG): container finished" podID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerID="fe2426202af166b77e9fd173b727bad4de2670c667b0a78fd50b1f4b1beddf6d" exitCode=0 Mar 16 15:42:22 crc kubenswrapper[5120]: I0316 15:42:22.307287 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" event={"ID":"e2275cb4-4905-4d66-a87e-8010120db2bd","Type":"ContainerDied","Data":"fe2426202af166b77e9fd173b727bad4de2670c667b0a78fd50b1f4b1beddf6d"} Mar 16 15:42:22 crc kubenswrapper[5120]: I0316 15:42:22.307324 5120 scope.go:117] "RemoveContainer" containerID="4730db759297f0a075089df3a65417a9e171e80454e4c218ce5ff9ad42541d2c" Mar 16 15:42:23 crc kubenswrapper[5120]: I0316 15:42:23.318324 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" event={"ID":"e2275cb4-4905-4d66-a87e-8010120db2bd","Type":"ContainerStarted","Data":"1bf0dfcc12e9da19221f7d306b83a800a04b4e40726e4b7be82e05b1ea8eae67"} Mar 16 15:42:39 crc kubenswrapper[5120]: I0316 15:42:39.234751 5120 scope.go:117] "RemoveContainer" containerID="df1b25bf24c5b6a72c448cb0d1073fd0f0bf3202fb900a79d2e12cf2be8b18f6" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.241567 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-ovn-kubernetes/ovnkube-control-plane-57b78d8988-hbs9k"] Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.243412 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-ovn-kubernetes/ovnkube-control-plane-57b78d8988-hbs9k" podUID="8e29c57a-87ae-4f7a-82f5-867e05ccf280" containerName="kube-rbac-proxy" containerID="cri-o://5009c491b8f92f9ca29a95cf32a3d4eb3c55910a35bafbdb72ab55ccc93496c1" gracePeriod=30 Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.243913 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-ovn-kubernetes/ovnkube-control-plane-57b78d8988-hbs9k" podUID="8e29c57a-87ae-4f7a-82f5-867e05ccf280" containerName="ovnkube-cluster-manager" containerID="cri-o://3837f4e4459e4db9b445cceb8460bbb08ec502cdb8bf44bd11d2dbcc5317fb21" gracePeriod=30 Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.477589 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-zwk29"] Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.478159 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-ovn-kubernetes/ovnkube-node-zwk29" podUID="1ba0f093-ad5c-4a99-bfc2-8439162d5b72" containerName="ovn-controller" containerID="cri-o://f78d3044e1cfdeec2ea5aef2775d8bfadb77ebf6f76a7bf2e6876d1888766e1d" gracePeriod=30 Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.478274 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-ovn-kubernetes/ovnkube-node-zwk29" podUID="1ba0f093-ad5c-4a99-bfc2-8439162d5b72" containerName="northd" containerID="cri-o://e2097aa0c8d162defaeaf9622b03c7fa67f6ca6fe08e2f39b2067dc0355e5ec3" gracePeriod=30 Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.478314 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-ovn-kubernetes/ovnkube-node-zwk29" podUID="1ba0f093-ad5c-4a99-bfc2-8439162d5b72" containerName="kube-rbac-proxy-ovn-metrics" containerID="cri-o://556c5f7552cef130952b14c75e576e515a6625b30229eebc4f6c2c030631302b" gracePeriod=30 Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.478303 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-ovn-kubernetes/ovnkube-node-zwk29" podUID="1ba0f093-ad5c-4a99-bfc2-8439162d5b72" containerName="nbdb" containerID="cri-o://0f97c48af6799e1c6b2f3be9772b7af91dc410d9e22b47214000397e5aa4863e" gracePeriod=30 Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.478345 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-ovn-kubernetes/ovnkube-node-zwk29" podUID="1ba0f093-ad5c-4a99-bfc2-8439162d5b72" containerName="kube-rbac-proxy-node" containerID="cri-o://5e1ff7f5cff66589f32172b6a241d38d3d4bd6f3362edb816884ba90b9bc0653" gracePeriod=30 Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.478375 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-ovn-kubernetes/ovnkube-node-zwk29" podUID="1ba0f093-ad5c-4a99-bfc2-8439162d5b72" containerName="ovn-acl-logging" containerID="cri-o://d51409051329a3bd8d7f9c4219c81a54f53669f0495718e78d7501a4ef44fd2a" gracePeriod=30 Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.478667 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-ovn-kubernetes/ovnkube-node-zwk29" podUID="1ba0f093-ad5c-4a99-bfc2-8439162d5b72" containerName="sbdb" containerID="cri-o://31bd6609f0a26c6471b5cc968812bd56971cd57f918766fe4ede24149b12679c" gracePeriod=30 Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.496034 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-control-plane-57b78d8988-hbs9k" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.504752 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-ovn-kubernetes/ovnkube-node-zwk29" podUID="1ba0f093-ad5c-4a99-bfc2-8439162d5b72" containerName="ovnkube-controller" containerID="cri-o://95c59ce10d5cb44ed144db2fabe3f00638cada4e2996ac5ae763b853f6252c53" gracePeriod=30 Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.528564 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-control-plane-97c9b6c48-zmjgb"] Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.529164 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4fa264bb-f592-4dd6-b94c-a2f559948b46" containerName="oc" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.529186 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="4fa264bb-f592-4dd6-b94c-a2f559948b46" containerName="oc" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.529195 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e29c57a-87ae-4f7a-82f5-867e05ccf280" containerName="kube-rbac-proxy" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.529202 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e29c57a-87ae-4f7a-82f5-867e05ccf280" containerName="kube-rbac-proxy" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.529209 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e29c57a-87ae-4f7a-82f5-867e05ccf280" containerName="ovnkube-cluster-manager" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.529218 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e29c57a-87ae-4f7a-82f5-867e05ccf280" containerName="ovnkube-cluster-manager" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.529327 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="8e29c57a-87ae-4f7a-82f5-867e05ccf280" containerName="kube-rbac-proxy" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.529339 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="8e29c57a-87ae-4f7a-82f5-867e05ccf280" containerName="ovnkube-cluster-manager" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.529348 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="4fa264bb-f592-4dd6-b94c-a2f559948b46" containerName="oc" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.537263 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-control-plane-97c9b6c48-zmjgb" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.580530 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8e29c57a-87ae-4f7a-82f5-867e05ccf280-env-overrides\") pod \"8e29c57a-87ae-4f7a-82f5-867e05ccf280\" (UID: \"8e29c57a-87ae-4f7a-82f5-867e05ccf280\") " Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.580619 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b9hvt\" (UniqueName: \"kubernetes.io/projected/8e29c57a-87ae-4f7a-82f5-867e05ccf280-kube-api-access-b9hvt\") pod \"8e29c57a-87ae-4f7a-82f5-867e05ccf280\" (UID: \"8e29c57a-87ae-4f7a-82f5-867e05ccf280\") " Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.580670 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovn-control-plane-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8e29c57a-87ae-4f7a-82f5-867e05ccf280-ovn-control-plane-metrics-cert\") pod \"8e29c57a-87ae-4f7a-82f5-867e05ccf280\" (UID: \"8e29c57a-87ae-4f7a-82f5-867e05ccf280\") " Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.580732 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8e29c57a-87ae-4f7a-82f5-867e05ccf280-ovnkube-config\") pod \"8e29c57a-87ae-4f7a-82f5-867e05ccf280\" (UID: \"8e29c57a-87ae-4f7a-82f5-867e05ccf280\") " Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.580938 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-control-plane-metrics-cert\" (UniqueName: \"kubernetes.io/secret/be9f94ae-da8d-4b21-9577-55246629bb86-ovn-control-plane-metrics-cert\") pod \"ovnkube-control-plane-97c9b6c48-zmjgb\" (UID: \"be9f94ae-da8d-4b21-9577-55246629bb86\") " pod="openshift-ovn-kubernetes/ovnkube-control-plane-97c9b6c48-zmjgb" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.581003 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/be9f94ae-da8d-4b21-9577-55246629bb86-env-overrides\") pod \"ovnkube-control-plane-97c9b6c48-zmjgb\" (UID: \"be9f94ae-da8d-4b21-9577-55246629bb86\") " pod="openshift-ovn-kubernetes/ovnkube-control-plane-97c9b6c48-zmjgb" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.581133 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/be9f94ae-da8d-4b21-9577-55246629bb86-ovnkube-config\") pod \"ovnkube-control-plane-97c9b6c48-zmjgb\" (UID: \"be9f94ae-da8d-4b21-9577-55246629bb86\") " pod="openshift-ovn-kubernetes/ovnkube-control-plane-97c9b6c48-zmjgb" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.581377 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8e29c57a-87ae-4f7a-82f5-867e05ccf280-env-overrides" (OuterVolumeSpecName: "env-overrides") pod "8e29c57a-87ae-4f7a-82f5-867e05ccf280" (UID: "8e29c57a-87ae-4f7a-82f5-867e05ccf280"). InnerVolumeSpecName "env-overrides". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.581416 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdmsg\" (UniqueName: \"kubernetes.io/projected/be9f94ae-da8d-4b21-9577-55246629bb86-kube-api-access-qdmsg\") pod \"ovnkube-control-plane-97c9b6c48-zmjgb\" (UID: \"be9f94ae-da8d-4b21-9577-55246629bb86\") " pod="openshift-ovn-kubernetes/ovnkube-control-plane-97c9b6c48-zmjgb" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.581380 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8e29c57a-87ae-4f7a-82f5-867e05ccf280-ovnkube-config" (OuterVolumeSpecName: "ovnkube-config") pod "8e29c57a-87ae-4f7a-82f5-867e05ccf280" (UID: "8e29c57a-87ae-4f7a-82f5-867e05ccf280"). InnerVolumeSpecName "ovnkube-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.581574 5120 reconciler_common.go:299] "Volume detached for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8e29c57a-87ae-4f7a-82f5-867e05ccf280-env-overrides\") on node \"crc\" DevicePath \"\"" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.581587 5120 reconciler_common.go:299] "Volume detached for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8e29c57a-87ae-4f7a-82f5-867e05ccf280-ovnkube-config\") on node \"crc\" DevicePath \"\"" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.592543 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e29c57a-87ae-4f7a-82f5-867e05ccf280-ovn-control-plane-metrics-cert" (OuterVolumeSpecName: "ovn-control-plane-metrics-cert") pod "8e29c57a-87ae-4f7a-82f5-867e05ccf280" (UID: "8e29c57a-87ae-4f7a-82f5-867e05ccf280"). InnerVolumeSpecName "ovn-control-plane-metrics-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.592981 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e29c57a-87ae-4f7a-82f5-867e05ccf280-kube-api-access-b9hvt" (OuterVolumeSpecName: "kube-api-access-b9hvt") pod "8e29c57a-87ae-4f7a-82f5-867e05ccf280" (UID: "8e29c57a-87ae-4f7a-82f5-867e05ccf280"). InnerVolumeSpecName "kube-api-access-b9hvt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.624635 5120 generic.go:358] "Generic (PLEG): container finished" podID="8e29c57a-87ae-4f7a-82f5-867e05ccf280" containerID="3837f4e4459e4db9b445cceb8460bbb08ec502cdb8bf44bd11d2dbcc5317fb21" exitCode=0 Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.624663 5120 generic.go:358] "Generic (PLEG): container finished" podID="8e29c57a-87ae-4f7a-82f5-867e05ccf280" containerID="5009c491b8f92f9ca29a95cf32a3d4eb3c55910a35bafbdb72ab55ccc93496c1" exitCode=0 Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.624720 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-control-plane-57b78d8988-hbs9k" event={"ID":"8e29c57a-87ae-4f7a-82f5-867e05ccf280","Type":"ContainerDied","Data":"3837f4e4459e4db9b445cceb8460bbb08ec502cdb8bf44bd11d2dbcc5317fb21"} Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.624741 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-control-plane-57b78d8988-hbs9k" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.624766 5120 scope.go:117] "RemoveContainer" containerID="3837f4e4459e4db9b445cceb8460bbb08ec502cdb8bf44bd11d2dbcc5317fb21" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.624745 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-control-plane-57b78d8988-hbs9k" event={"ID":"8e29c57a-87ae-4f7a-82f5-867e05ccf280","Type":"ContainerDied","Data":"5009c491b8f92f9ca29a95cf32a3d4eb3c55910a35bafbdb72ab55ccc93496c1"} Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.624941 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-control-plane-57b78d8988-hbs9k" event={"ID":"8e29c57a-87ae-4f7a-82f5-867e05ccf280","Type":"ContainerDied","Data":"386a28725142690bbe9f5cd09cf7aa4a587746430cfa53ce544b9de1d72cc5d7"} Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.629639 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-v822j_ac55471d-4e42-475f-a082-50f611571482/kube-multus/0.log" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.629677 5120 generic.go:358] "Generic (PLEG): container finished" podID="ac55471d-4e42-475f-a082-50f611571482" containerID="ac6f302a9d165da7336a546eec904a1e65d980e0309b292a120714327c5c39d1" exitCode=2 Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.629780 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-v822j" event={"ID":"ac55471d-4e42-475f-a082-50f611571482","Type":"ContainerDied","Data":"ac6f302a9d165da7336a546eec904a1e65d980e0309b292a120714327c5c39d1"} Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.631425 5120 scope.go:117] "RemoveContainer" containerID="ac6f302a9d165da7336a546eec904a1e65d980e0309b292a120714327c5c39d1" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.649115 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zwk29_1ba0f093-ad5c-4a99-bfc2-8439162d5b72/ovn-acl-logging/0.log" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.655321 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zwk29_1ba0f093-ad5c-4a99-bfc2-8439162d5b72/ovn-controller/0.log" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.655822 5120 generic.go:358] "Generic (PLEG): container finished" podID="1ba0f093-ad5c-4a99-bfc2-8439162d5b72" containerID="95c59ce10d5cb44ed144db2fabe3f00638cada4e2996ac5ae763b853f6252c53" exitCode=0 Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.655848 5120 generic.go:358] "Generic (PLEG): container finished" podID="1ba0f093-ad5c-4a99-bfc2-8439162d5b72" containerID="556c5f7552cef130952b14c75e576e515a6625b30229eebc4f6c2c030631302b" exitCode=0 Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.655856 5120 generic.go:358] "Generic (PLEG): container finished" podID="1ba0f093-ad5c-4a99-bfc2-8439162d5b72" containerID="5e1ff7f5cff66589f32172b6a241d38d3d4bd6f3362edb816884ba90b9bc0653" exitCode=0 Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.655864 5120 generic.go:358] "Generic (PLEG): container finished" podID="1ba0f093-ad5c-4a99-bfc2-8439162d5b72" containerID="d51409051329a3bd8d7f9c4219c81a54f53669f0495718e78d7501a4ef44fd2a" exitCode=143 Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.655873 5120 generic.go:358] "Generic (PLEG): container finished" podID="1ba0f093-ad5c-4a99-bfc2-8439162d5b72" containerID="f78d3044e1cfdeec2ea5aef2775d8bfadb77ebf6f76a7bf2e6876d1888766e1d" exitCode=143 Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.656019 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zwk29" event={"ID":"1ba0f093-ad5c-4a99-bfc2-8439162d5b72","Type":"ContainerDied","Data":"95c59ce10d5cb44ed144db2fabe3f00638cada4e2996ac5ae763b853f6252c53"} Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.656042 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zwk29" event={"ID":"1ba0f093-ad5c-4a99-bfc2-8439162d5b72","Type":"ContainerDied","Data":"556c5f7552cef130952b14c75e576e515a6625b30229eebc4f6c2c030631302b"} Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.656052 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zwk29" event={"ID":"1ba0f093-ad5c-4a99-bfc2-8439162d5b72","Type":"ContainerDied","Data":"5e1ff7f5cff66589f32172b6a241d38d3d4bd6f3362edb816884ba90b9bc0653"} Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.656059 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zwk29" event={"ID":"1ba0f093-ad5c-4a99-bfc2-8439162d5b72","Type":"ContainerDied","Data":"d51409051329a3bd8d7f9c4219c81a54f53669f0495718e78d7501a4ef44fd2a"} Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.656067 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zwk29" event={"ID":"1ba0f093-ad5c-4a99-bfc2-8439162d5b72","Type":"ContainerDied","Data":"f78d3044e1cfdeec2ea5aef2775d8bfadb77ebf6f76a7bf2e6876d1888766e1d"} Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.676641 5120 scope.go:117] "RemoveContainer" containerID="5009c491b8f92f9ca29a95cf32a3d4eb3c55910a35bafbdb72ab55ccc93496c1" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.679960 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-ovn-kubernetes/ovnkube-control-plane-57b78d8988-hbs9k"] Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.679996 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-ovn-kubernetes/ovnkube-control-plane-57b78d8988-hbs9k"] Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.682982 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/be9f94ae-da8d-4b21-9577-55246629bb86-ovnkube-config\") pod \"ovnkube-control-plane-97c9b6c48-zmjgb\" (UID: \"be9f94ae-da8d-4b21-9577-55246629bb86\") " pod="openshift-ovn-kubernetes/ovnkube-control-plane-97c9b6c48-zmjgb" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.683013 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qdmsg\" (UniqueName: \"kubernetes.io/projected/be9f94ae-da8d-4b21-9577-55246629bb86-kube-api-access-qdmsg\") pod \"ovnkube-control-plane-97c9b6c48-zmjgb\" (UID: \"be9f94ae-da8d-4b21-9577-55246629bb86\") " pod="openshift-ovn-kubernetes/ovnkube-control-plane-97c9b6c48-zmjgb" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.683057 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-control-plane-metrics-cert\" (UniqueName: \"kubernetes.io/secret/be9f94ae-da8d-4b21-9577-55246629bb86-ovn-control-plane-metrics-cert\") pod \"ovnkube-control-plane-97c9b6c48-zmjgb\" (UID: \"be9f94ae-da8d-4b21-9577-55246629bb86\") " pod="openshift-ovn-kubernetes/ovnkube-control-plane-97c9b6c48-zmjgb" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.683225 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/be9f94ae-da8d-4b21-9577-55246629bb86-env-overrides\") pod \"ovnkube-control-plane-97c9b6c48-zmjgb\" (UID: \"be9f94ae-da8d-4b21-9577-55246629bb86\") " pod="openshift-ovn-kubernetes/ovnkube-control-plane-97c9b6c48-zmjgb" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.683394 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b9hvt\" (UniqueName: \"kubernetes.io/projected/8e29c57a-87ae-4f7a-82f5-867e05ccf280-kube-api-access-b9hvt\") on node \"crc\" DevicePath \"\"" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.683417 5120 reconciler_common.go:299] "Volume detached for volume \"ovn-control-plane-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8e29c57a-87ae-4f7a-82f5-867e05ccf280-ovn-control-plane-metrics-cert\") on node \"crc\" DevicePath \"\"" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.683866 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/be9f94ae-da8d-4b21-9577-55246629bb86-env-overrides\") pod \"ovnkube-control-plane-97c9b6c48-zmjgb\" (UID: \"be9f94ae-da8d-4b21-9577-55246629bb86\") " pod="openshift-ovn-kubernetes/ovnkube-control-plane-97c9b6c48-zmjgb" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.683999 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/be9f94ae-da8d-4b21-9577-55246629bb86-ovnkube-config\") pod \"ovnkube-control-plane-97c9b6c48-zmjgb\" (UID: \"be9f94ae-da8d-4b21-9577-55246629bb86\") " pod="openshift-ovn-kubernetes/ovnkube-control-plane-97c9b6c48-zmjgb" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.688454 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-control-plane-metrics-cert\" (UniqueName: \"kubernetes.io/secret/be9f94ae-da8d-4b21-9577-55246629bb86-ovn-control-plane-metrics-cert\") pod \"ovnkube-control-plane-97c9b6c48-zmjgb\" (UID: \"be9f94ae-da8d-4b21-9577-55246629bb86\") " pod="openshift-ovn-kubernetes/ovnkube-control-plane-97c9b6c48-zmjgb" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.698640 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdmsg\" (UniqueName: \"kubernetes.io/projected/be9f94ae-da8d-4b21-9577-55246629bb86-kube-api-access-qdmsg\") pod \"ovnkube-control-plane-97c9b6c48-zmjgb\" (UID: \"be9f94ae-da8d-4b21-9577-55246629bb86\") " pod="openshift-ovn-kubernetes/ovnkube-control-plane-97c9b6c48-zmjgb" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.744044 5120 scope.go:117] "RemoveContainer" containerID="3837f4e4459e4db9b445cceb8460bbb08ec502cdb8bf44bd11d2dbcc5317fb21" Mar 16 15:42:58 crc kubenswrapper[5120]: E0316 15:42:58.744444 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3837f4e4459e4db9b445cceb8460bbb08ec502cdb8bf44bd11d2dbcc5317fb21\": container with ID starting with 3837f4e4459e4db9b445cceb8460bbb08ec502cdb8bf44bd11d2dbcc5317fb21 not found: ID does not exist" containerID="3837f4e4459e4db9b445cceb8460bbb08ec502cdb8bf44bd11d2dbcc5317fb21" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.744480 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3837f4e4459e4db9b445cceb8460bbb08ec502cdb8bf44bd11d2dbcc5317fb21"} err="failed to get container status \"3837f4e4459e4db9b445cceb8460bbb08ec502cdb8bf44bd11d2dbcc5317fb21\": rpc error: code = NotFound desc = could not find container \"3837f4e4459e4db9b445cceb8460bbb08ec502cdb8bf44bd11d2dbcc5317fb21\": container with ID starting with 3837f4e4459e4db9b445cceb8460bbb08ec502cdb8bf44bd11d2dbcc5317fb21 not found: ID does not exist" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.744504 5120 scope.go:117] "RemoveContainer" containerID="5009c491b8f92f9ca29a95cf32a3d4eb3c55910a35bafbdb72ab55ccc93496c1" Mar 16 15:42:58 crc kubenswrapper[5120]: E0316 15:42:58.744724 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5009c491b8f92f9ca29a95cf32a3d4eb3c55910a35bafbdb72ab55ccc93496c1\": container with ID starting with 5009c491b8f92f9ca29a95cf32a3d4eb3c55910a35bafbdb72ab55ccc93496c1 not found: ID does not exist" containerID="5009c491b8f92f9ca29a95cf32a3d4eb3c55910a35bafbdb72ab55ccc93496c1" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.744760 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5009c491b8f92f9ca29a95cf32a3d4eb3c55910a35bafbdb72ab55ccc93496c1"} err="failed to get container status \"5009c491b8f92f9ca29a95cf32a3d4eb3c55910a35bafbdb72ab55ccc93496c1\": rpc error: code = NotFound desc = could not find container \"5009c491b8f92f9ca29a95cf32a3d4eb3c55910a35bafbdb72ab55ccc93496c1\": container with ID starting with 5009c491b8f92f9ca29a95cf32a3d4eb3c55910a35bafbdb72ab55ccc93496c1 not found: ID does not exist" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.744777 5120 scope.go:117] "RemoveContainer" containerID="3837f4e4459e4db9b445cceb8460bbb08ec502cdb8bf44bd11d2dbcc5317fb21" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.745006 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3837f4e4459e4db9b445cceb8460bbb08ec502cdb8bf44bd11d2dbcc5317fb21"} err="failed to get container status \"3837f4e4459e4db9b445cceb8460bbb08ec502cdb8bf44bd11d2dbcc5317fb21\": rpc error: code = NotFound desc = could not find container \"3837f4e4459e4db9b445cceb8460bbb08ec502cdb8bf44bd11d2dbcc5317fb21\": container with ID starting with 3837f4e4459e4db9b445cceb8460bbb08ec502cdb8bf44bd11d2dbcc5317fb21 not found: ID does not exist" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.745036 5120 scope.go:117] "RemoveContainer" containerID="5009c491b8f92f9ca29a95cf32a3d4eb3c55910a35bafbdb72ab55ccc93496c1" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.745221 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5009c491b8f92f9ca29a95cf32a3d4eb3c55910a35bafbdb72ab55ccc93496c1"} err="failed to get container status \"5009c491b8f92f9ca29a95cf32a3d4eb3c55910a35bafbdb72ab55ccc93496c1\": rpc error: code = NotFound desc = could not find container \"5009c491b8f92f9ca29a95cf32a3d4eb3c55910a35bafbdb72ab55ccc93496c1\": container with ID starting with 5009c491b8f92f9ca29a95cf32a3d4eb3c55910a35bafbdb72ab55ccc93496c1 not found: ID does not exist" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.768529 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zwk29_1ba0f093-ad5c-4a99-bfc2-8439162d5b72/ovn-acl-logging/0.log" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.768950 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zwk29_1ba0f093-ad5c-4a99-bfc2-8439162d5b72/ovn-controller/0.log" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.769275 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zwk29" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.820928 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-w5sbz"] Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.821628 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ba0f093-ad5c-4a99-bfc2-8439162d5b72" containerName="ovn-controller" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.821648 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ba0f093-ad5c-4a99-bfc2-8439162d5b72" containerName="ovn-controller" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.821668 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ba0f093-ad5c-4a99-bfc2-8439162d5b72" containerName="sbdb" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.821676 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ba0f093-ad5c-4a99-bfc2-8439162d5b72" containerName="sbdb" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.821693 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ba0f093-ad5c-4a99-bfc2-8439162d5b72" containerName="ovnkube-controller" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.821700 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ba0f093-ad5c-4a99-bfc2-8439162d5b72" containerName="ovnkube-controller" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.821712 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ba0f093-ad5c-4a99-bfc2-8439162d5b72" containerName="kubecfg-setup" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.821719 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ba0f093-ad5c-4a99-bfc2-8439162d5b72" containerName="kubecfg-setup" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.821727 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ba0f093-ad5c-4a99-bfc2-8439162d5b72" containerName="kube-rbac-proxy-node" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.821734 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ba0f093-ad5c-4a99-bfc2-8439162d5b72" containerName="kube-rbac-proxy-node" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.821751 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ba0f093-ad5c-4a99-bfc2-8439162d5b72" containerName="northd" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.821760 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ba0f093-ad5c-4a99-bfc2-8439162d5b72" containerName="northd" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.821774 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ba0f093-ad5c-4a99-bfc2-8439162d5b72" containerName="nbdb" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.821783 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ba0f093-ad5c-4a99-bfc2-8439162d5b72" containerName="nbdb" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.821811 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ba0f093-ad5c-4a99-bfc2-8439162d5b72" containerName="ovn-acl-logging" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.821818 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ba0f093-ad5c-4a99-bfc2-8439162d5b72" containerName="ovn-acl-logging" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.821830 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ba0f093-ad5c-4a99-bfc2-8439162d5b72" containerName="kube-rbac-proxy-ovn-metrics" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.821838 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ba0f093-ad5c-4a99-bfc2-8439162d5b72" containerName="kube-rbac-proxy-ovn-metrics" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.821941 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1ba0f093-ad5c-4a99-bfc2-8439162d5b72" containerName="kube-rbac-proxy-ovn-metrics" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.821953 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1ba0f093-ad5c-4a99-bfc2-8439162d5b72" containerName="kube-rbac-proxy-node" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.822011 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1ba0f093-ad5c-4a99-bfc2-8439162d5b72" containerName="nbdb" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.822030 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1ba0f093-ad5c-4a99-bfc2-8439162d5b72" containerName="ovn-controller" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.822037 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1ba0f093-ad5c-4a99-bfc2-8439162d5b72" containerName="northd" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.822045 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1ba0f093-ad5c-4a99-bfc2-8439162d5b72" containerName="sbdb" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.822052 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1ba0f093-ad5c-4a99-bfc2-8439162d5b72" containerName="ovnkube-controller" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.822061 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1ba0f093-ad5c-4a99-bfc2-8439162d5b72" containerName="ovn-acl-logging" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.832942 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-w5sbz" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.870850 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-control-plane-97c9b6c48-zmjgb" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.886157 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1ba0f093-ad5c-4a99-bfc2-8439162d5b72-host-run-netns\") pod \"1ba0f093-ad5c-4a99-bfc2-8439162d5b72\" (UID: \"1ba0f093-ad5c-4a99-bfc2-8439162d5b72\") " Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.886449 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1ba0f093-ad5c-4a99-bfc2-8439162d5b72-log-socket\") pod \"1ba0f093-ad5c-4a99-bfc2-8439162d5b72\" (UID: \"1ba0f093-ad5c-4a99-bfc2-8439162d5b72\") " Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.886248 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/1ba0f093-ad5c-4a99-bfc2-8439162d5b72-host-run-netns" (OuterVolumeSpecName: "host-run-netns") pod "1ba0f093-ad5c-4a99-bfc2-8439162d5b72" (UID: "1ba0f093-ad5c-4a99-bfc2-8439162d5b72"). InnerVolumeSpecName "host-run-netns". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 15:42:58 crc kubenswrapper[5120]: W0316 15:42:58.886338 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe9f94ae_da8d_4b21_9577_55246629bb86.slice/crio-3a0d74b334fa15f6151569ac033749d276ebd702e5b6de73ef11d54c4a2fb976 WatchSource:0}: Error finding container 3a0d74b334fa15f6151569ac033749d276ebd702e5b6de73ef11d54c4a2fb976: Status 404 returned error can't find the container with id 3a0d74b334fa15f6151569ac033749d276ebd702e5b6de73ef11d54c4a2fb976 Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.886589 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/1ba0f093-ad5c-4a99-bfc2-8439162d5b72-log-socket" (OuterVolumeSpecName: "log-socket") pod "1ba0f093-ad5c-4a99-bfc2-8439162d5b72" (UID: "1ba0f093-ad5c-4a99-bfc2-8439162d5b72"). InnerVolumeSpecName "log-socket". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.886547 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1ba0f093-ad5c-4a99-bfc2-8439162d5b72-host-run-ovn-kubernetes\") pod \"1ba0f093-ad5c-4a99-bfc2-8439162d5b72\" (UID: \"1ba0f093-ad5c-4a99-bfc2-8439162d5b72\") " Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.886756 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1ba0f093-ad5c-4a99-bfc2-8439162d5b72-var-lib-openvswitch\") pod \"1ba0f093-ad5c-4a99-bfc2-8439162d5b72\" (UID: \"1ba0f093-ad5c-4a99-bfc2-8439162d5b72\") " Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.886889 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1ba0f093-ad5c-4a99-bfc2-8439162d5b72-run-openvswitch\") pod \"1ba0f093-ad5c-4a99-bfc2-8439162d5b72\" (UID: \"1ba0f093-ad5c-4a99-bfc2-8439162d5b72\") " Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.886977 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1ba0f093-ad5c-4a99-bfc2-8439162d5b72-host-slash\") pod \"1ba0f093-ad5c-4a99-bfc2-8439162d5b72\" (UID: \"1ba0f093-ad5c-4a99-bfc2-8439162d5b72\") " Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.886678 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/1ba0f093-ad5c-4a99-bfc2-8439162d5b72-host-run-ovn-kubernetes" (OuterVolumeSpecName: "host-run-ovn-kubernetes") pod "1ba0f093-ad5c-4a99-bfc2-8439162d5b72" (UID: "1ba0f093-ad5c-4a99-bfc2-8439162d5b72"). InnerVolumeSpecName "host-run-ovn-kubernetes". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.887037 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/1ba0f093-ad5c-4a99-bfc2-8439162d5b72-host-slash" (OuterVolumeSpecName: "host-slash") pod "1ba0f093-ad5c-4a99-bfc2-8439162d5b72" (UID: "1ba0f093-ad5c-4a99-bfc2-8439162d5b72"). InnerVolumeSpecName "host-slash". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.886823 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/1ba0f093-ad5c-4a99-bfc2-8439162d5b72-var-lib-openvswitch" (OuterVolumeSpecName: "var-lib-openvswitch") pod "1ba0f093-ad5c-4a99-bfc2-8439162d5b72" (UID: "1ba0f093-ad5c-4a99-bfc2-8439162d5b72"). InnerVolumeSpecName "var-lib-openvswitch". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.886957 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/1ba0f093-ad5c-4a99-bfc2-8439162d5b72-run-openvswitch" (OuterVolumeSpecName: "run-openvswitch") pod "1ba0f093-ad5c-4a99-bfc2-8439162d5b72" (UID: "1ba0f093-ad5c-4a99-bfc2-8439162d5b72"). InnerVolumeSpecName "run-openvswitch". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.887131 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/1ba0f093-ad5c-4a99-bfc2-8439162d5b72-host-cni-netd" (OuterVolumeSpecName: "host-cni-netd") pod "1ba0f093-ad5c-4a99-bfc2-8439162d5b72" (UID: "1ba0f093-ad5c-4a99-bfc2-8439162d5b72"). InnerVolumeSpecName "host-cni-netd". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.887045 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1ba0f093-ad5c-4a99-bfc2-8439162d5b72-host-cni-netd\") pod \"1ba0f093-ad5c-4a99-bfc2-8439162d5b72\" (UID: \"1ba0f093-ad5c-4a99-bfc2-8439162d5b72\") " Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.887319 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1ba0f093-ad5c-4a99-bfc2-8439162d5b72-ovnkube-script-lib\") pod \"1ba0f093-ad5c-4a99-bfc2-8439162d5b72\" (UID: \"1ba0f093-ad5c-4a99-bfc2-8439162d5b72\") " Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.887398 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1ba0f093-ad5c-4a99-bfc2-8439162d5b72-host-kubelet\") pod \"1ba0f093-ad5c-4a99-bfc2-8439162d5b72\" (UID: \"1ba0f093-ad5c-4a99-bfc2-8439162d5b72\") " Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.887466 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1ba0f093-ad5c-4a99-bfc2-8439162d5b72-env-overrides\") pod \"1ba0f093-ad5c-4a99-bfc2-8439162d5b72\" (UID: \"1ba0f093-ad5c-4a99-bfc2-8439162d5b72\") " Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.887534 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/1ba0f093-ad5c-4a99-bfc2-8439162d5b72-host-kubelet" (OuterVolumeSpecName: "host-kubelet") pod "1ba0f093-ad5c-4a99-bfc2-8439162d5b72" (UID: "1ba0f093-ad5c-4a99-bfc2-8439162d5b72"). InnerVolumeSpecName "host-kubelet". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.887604 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1ba0f093-ad5c-4a99-bfc2-8439162d5b72-ovn-node-metrics-cert\") pod \"1ba0f093-ad5c-4a99-bfc2-8439162d5b72\" (UID: \"1ba0f093-ad5c-4a99-bfc2-8439162d5b72\") " Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.887671 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1ba0f093-ad5c-4a99-bfc2-8439162d5b72-host-cni-bin\") pod \"1ba0f093-ad5c-4a99-bfc2-8439162d5b72\" (UID: \"1ba0f093-ad5c-4a99-bfc2-8439162d5b72\") " Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.887726 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1ba0f093-ad5c-4a99-bfc2-8439162d5b72-node-log\") pod \"1ba0f093-ad5c-4a99-bfc2-8439162d5b72\" (UID: \"1ba0f093-ad5c-4a99-bfc2-8439162d5b72\") " Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.887810 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1ba0f093-ad5c-4a99-bfc2-8439162d5b72-ovnkube-config\") pod \"1ba0f093-ad5c-4a99-bfc2-8439162d5b72\" (UID: \"1ba0f093-ad5c-4a99-bfc2-8439162d5b72\") " Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.887895 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1ba0f093-ad5c-4a99-bfc2-8439162d5b72-systemd-units\") pod \"1ba0f093-ad5c-4a99-bfc2-8439162d5b72\" (UID: \"1ba0f093-ad5c-4a99-bfc2-8439162d5b72\") " Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.887965 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1ba0f093-ad5c-4a99-bfc2-8439162d5b72-run-ovn\") pod \"1ba0f093-ad5c-4a99-bfc2-8439162d5b72\" (UID: \"1ba0f093-ad5c-4a99-bfc2-8439162d5b72\") " Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.888025 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1ba0f093-ad5c-4a99-bfc2-8439162d5b72-run-systemd\") pod \"1ba0f093-ad5c-4a99-bfc2-8439162d5b72\" (UID: \"1ba0f093-ad5c-4a99-bfc2-8439162d5b72\") " Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.888101 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1ba0f093-ad5c-4a99-bfc2-8439162d5b72-host-var-lib-cni-networks-ovn-kubernetes\") pod \"1ba0f093-ad5c-4a99-bfc2-8439162d5b72\" (UID: \"1ba0f093-ad5c-4a99-bfc2-8439162d5b72\") " Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.888163 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1ba0f093-ad5c-4a99-bfc2-8439162d5b72-etc-openvswitch\") pod \"1ba0f093-ad5c-4a99-bfc2-8439162d5b72\" (UID: \"1ba0f093-ad5c-4a99-bfc2-8439162d5b72\") " Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.887923 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ba0f093-ad5c-4a99-bfc2-8439162d5b72-env-overrides" (OuterVolumeSpecName: "env-overrides") pod "1ba0f093-ad5c-4a99-bfc2-8439162d5b72" (UID: "1ba0f093-ad5c-4a99-bfc2-8439162d5b72"). InnerVolumeSpecName "env-overrides". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.887940 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ba0f093-ad5c-4a99-bfc2-8439162d5b72-ovnkube-script-lib" (OuterVolumeSpecName: "ovnkube-script-lib") pod "1ba0f093-ad5c-4a99-bfc2-8439162d5b72" (UID: "1ba0f093-ad5c-4a99-bfc2-8439162d5b72"). InnerVolumeSpecName "ovnkube-script-lib". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.887976 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/1ba0f093-ad5c-4a99-bfc2-8439162d5b72-node-log" (OuterVolumeSpecName: "node-log") pod "1ba0f093-ad5c-4a99-bfc2-8439162d5b72" (UID: "1ba0f093-ad5c-4a99-bfc2-8439162d5b72"). InnerVolumeSpecName "node-log". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.888251 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tjz24\" (UniqueName: \"kubernetes.io/projected/1ba0f093-ad5c-4a99-bfc2-8439162d5b72-kube-api-access-tjz24\") pod \"1ba0f093-ad5c-4a99-bfc2-8439162d5b72\" (UID: \"1ba0f093-ad5c-4a99-bfc2-8439162d5b72\") " Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.888399 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/1ba0f093-ad5c-4a99-bfc2-8439162d5b72-host-var-lib-cni-networks-ovn-kubernetes" (OuterVolumeSpecName: "host-var-lib-cni-networks-ovn-kubernetes") pod "1ba0f093-ad5c-4a99-bfc2-8439162d5b72" (UID: "1ba0f093-ad5c-4a99-bfc2-8439162d5b72"). InnerVolumeSpecName "host-var-lib-cni-networks-ovn-kubernetes". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.888636 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/1ba0f093-ad5c-4a99-bfc2-8439162d5b72-systemd-units" (OuterVolumeSpecName: "systemd-units") pod "1ba0f093-ad5c-4a99-bfc2-8439162d5b72" (UID: "1ba0f093-ad5c-4a99-bfc2-8439162d5b72"). InnerVolumeSpecName "systemd-units". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.888685 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ba0f093-ad5c-4a99-bfc2-8439162d5b72-ovnkube-config" (OuterVolumeSpecName: "ovnkube-config") pod "1ba0f093-ad5c-4a99-bfc2-8439162d5b72" (UID: "1ba0f093-ad5c-4a99-bfc2-8439162d5b72"). InnerVolumeSpecName "ovnkube-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.888426 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/1ba0f093-ad5c-4a99-bfc2-8439162d5b72-run-ovn" (OuterVolumeSpecName: "run-ovn") pod "1ba0f093-ad5c-4a99-bfc2-8439162d5b72" (UID: "1ba0f093-ad5c-4a99-bfc2-8439162d5b72"). InnerVolumeSpecName "run-ovn". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.888425 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/1ba0f093-ad5c-4a99-bfc2-8439162d5b72-etc-openvswitch" (OuterVolumeSpecName: "etc-openvswitch") pod "1ba0f093-ad5c-4a99-bfc2-8439162d5b72" (UID: "1ba0f093-ad5c-4a99-bfc2-8439162d5b72"). InnerVolumeSpecName "etc-openvswitch". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.888454 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/1ba0f093-ad5c-4a99-bfc2-8439162d5b72-host-cni-bin" (OuterVolumeSpecName: "host-cni-bin") pod "1ba0f093-ad5c-4a99-bfc2-8439162d5b72" (UID: "1ba0f093-ad5c-4a99-bfc2-8439162d5b72"). InnerVolumeSpecName "host-cni-bin". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.888973 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5f71176b-7648-4f96-a413-a1ca26d412c2-host-run-netns\") pod \"ovnkube-node-w5sbz\" (UID: \"5f71176b-7648-4f96-a413-a1ca26d412c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5sbz" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.889248 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5f71176b-7648-4f96-a413-a1ca26d412c2-run-ovn\") pod \"ovnkube-node-w5sbz\" (UID: \"5f71176b-7648-4f96-a413-a1ca26d412c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5sbz" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.889368 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5f71176b-7648-4f96-a413-a1ca26d412c2-ovnkube-script-lib\") pod \"ovnkube-node-w5sbz\" (UID: \"5f71176b-7648-4f96-a413-a1ca26d412c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5sbz" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.889545 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5f71176b-7648-4f96-a413-a1ca26d412c2-run-openvswitch\") pod \"ovnkube-node-w5sbz\" (UID: \"5f71176b-7648-4f96-a413-a1ca26d412c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5sbz" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.889669 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5f71176b-7648-4f96-a413-a1ca26d412c2-node-log\") pod \"ovnkube-node-w5sbz\" (UID: \"5f71176b-7648-4f96-a413-a1ca26d412c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5sbz" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.889794 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5f71176b-7648-4f96-a413-a1ca26d412c2-host-kubelet\") pod \"ovnkube-node-w5sbz\" (UID: \"5f71176b-7648-4f96-a413-a1ca26d412c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5sbz" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.889911 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5f71176b-7648-4f96-a413-a1ca26d412c2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-w5sbz\" (UID: \"5f71176b-7648-4f96-a413-a1ca26d412c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5sbz" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.890020 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5f71176b-7648-4f96-a413-a1ca26d412c2-host-run-ovn-kubernetes\") pod \"ovnkube-node-w5sbz\" (UID: \"5f71176b-7648-4f96-a413-a1ca26d412c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5sbz" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.890118 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5f71176b-7648-4f96-a413-a1ca26d412c2-systemd-units\") pod \"ovnkube-node-w5sbz\" (UID: \"5f71176b-7648-4f96-a413-a1ca26d412c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5sbz" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.890220 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5f71176b-7648-4f96-a413-a1ca26d412c2-var-lib-openvswitch\") pod \"ovnkube-node-w5sbz\" (UID: \"5f71176b-7648-4f96-a413-a1ca26d412c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5sbz" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.890399 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5f71176b-7648-4f96-a413-a1ca26d412c2-run-systemd\") pod \"ovnkube-node-w5sbz\" (UID: \"5f71176b-7648-4f96-a413-a1ca26d412c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5sbz" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.890594 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5f71176b-7648-4f96-a413-a1ca26d412c2-ovnkube-config\") pod \"ovnkube-node-w5sbz\" (UID: \"5f71176b-7648-4f96-a413-a1ca26d412c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5sbz" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.890721 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5f71176b-7648-4f96-a413-a1ca26d412c2-log-socket\") pod \"ovnkube-node-w5sbz\" (UID: \"5f71176b-7648-4f96-a413-a1ca26d412c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5sbz" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.890849 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5f71176b-7648-4f96-a413-a1ca26d412c2-etc-openvswitch\") pod \"ovnkube-node-w5sbz\" (UID: \"5f71176b-7648-4f96-a413-a1ca26d412c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5sbz" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.890945 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5f71176b-7648-4f96-a413-a1ca26d412c2-host-cni-bin\") pod \"ovnkube-node-w5sbz\" (UID: \"5f71176b-7648-4f96-a413-a1ca26d412c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5sbz" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.891055 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkr7k\" (UniqueName: \"kubernetes.io/projected/5f71176b-7648-4f96-a413-a1ca26d412c2-kube-api-access-fkr7k\") pod \"ovnkube-node-w5sbz\" (UID: \"5f71176b-7648-4f96-a413-a1ca26d412c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5sbz" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.891149 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5f71176b-7648-4f96-a413-a1ca26d412c2-env-overrides\") pod \"ovnkube-node-w5sbz\" (UID: \"5f71176b-7648-4f96-a413-a1ca26d412c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5sbz" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.891258 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5f71176b-7648-4f96-a413-a1ca26d412c2-ovn-node-metrics-cert\") pod \"ovnkube-node-w5sbz\" (UID: \"5f71176b-7648-4f96-a413-a1ca26d412c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5sbz" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.891340 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5f71176b-7648-4f96-a413-a1ca26d412c2-host-slash\") pod \"ovnkube-node-w5sbz\" (UID: \"5f71176b-7648-4f96-a413-a1ca26d412c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5sbz" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.891460 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5f71176b-7648-4f96-a413-a1ca26d412c2-host-cni-netd\") pod \"ovnkube-node-w5sbz\" (UID: \"5f71176b-7648-4f96-a413-a1ca26d412c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5sbz" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.891557 5120 reconciler_common.go:299] "Volume detached for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1ba0f093-ad5c-4a99-bfc2-8439162d5b72-run-ovn\") on node \"crc\" DevicePath \"\"" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.891620 5120 reconciler_common.go:299] "Volume detached for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1ba0f093-ad5c-4a99-bfc2-8439162d5b72-host-var-lib-cni-networks-ovn-kubernetes\") on node \"crc\" DevicePath \"\"" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.891679 5120 reconciler_common.go:299] "Volume detached for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1ba0f093-ad5c-4a99-bfc2-8439162d5b72-etc-openvswitch\") on node \"crc\" DevicePath \"\"" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.891727 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ba0f093-ad5c-4a99-bfc2-8439162d5b72-ovn-node-metrics-cert" (OuterVolumeSpecName: "ovn-node-metrics-cert") pod "1ba0f093-ad5c-4a99-bfc2-8439162d5b72" (UID: "1ba0f093-ad5c-4a99-bfc2-8439162d5b72"). InnerVolumeSpecName "ovn-node-metrics-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.891735 5120 reconciler_common.go:299] "Volume detached for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1ba0f093-ad5c-4a99-bfc2-8439162d5b72-host-run-netns\") on node \"crc\" DevicePath \"\"" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.891777 5120 reconciler_common.go:299] "Volume detached for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1ba0f093-ad5c-4a99-bfc2-8439162d5b72-log-socket\") on node \"crc\" DevicePath \"\"" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.891789 5120 reconciler_common.go:299] "Volume detached for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1ba0f093-ad5c-4a99-bfc2-8439162d5b72-host-run-ovn-kubernetes\") on node \"crc\" DevicePath \"\"" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.891798 5120 reconciler_common.go:299] "Volume detached for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1ba0f093-ad5c-4a99-bfc2-8439162d5b72-var-lib-openvswitch\") on node \"crc\" DevicePath \"\"" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.891809 5120 reconciler_common.go:299] "Volume detached for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1ba0f093-ad5c-4a99-bfc2-8439162d5b72-run-openvswitch\") on node \"crc\" DevicePath \"\"" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.891817 5120 reconciler_common.go:299] "Volume detached for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1ba0f093-ad5c-4a99-bfc2-8439162d5b72-host-slash\") on node \"crc\" DevicePath \"\"" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.891876 5120 reconciler_common.go:299] "Volume detached for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1ba0f093-ad5c-4a99-bfc2-8439162d5b72-host-cni-netd\") on node \"crc\" DevicePath \"\"" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.891943 5120 reconciler_common.go:299] "Volume detached for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1ba0f093-ad5c-4a99-bfc2-8439162d5b72-ovnkube-script-lib\") on node \"crc\" DevicePath \"\"" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.891952 5120 reconciler_common.go:299] "Volume detached for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1ba0f093-ad5c-4a99-bfc2-8439162d5b72-host-kubelet\") on node \"crc\" DevicePath \"\"" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.891959 5120 reconciler_common.go:299] "Volume detached for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1ba0f093-ad5c-4a99-bfc2-8439162d5b72-env-overrides\") on node \"crc\" DevicePath \"\"" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.891966 5120 reconciler_common.go:299] "Volume detached for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1ba0f093-ad5c-4a99-bfc2-8439162d5b72-host-cni-bin\") on node \"crc\" DevicePath \"\"" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.891974 5120 reconciler_common.go:299] "Volume detached for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1ba0f093-ad5c-4a99-bfc2-8439162d5b72-node-log\") on node \"crc\" DevicePath \"\"" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.891981 5120 reconciler_common.go:299] "Volume detached for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1ba0f093-ad5c-4a99-bfc2-8439162d5b72-ovnkube-config\") on node \"crc\" DevicePath \"\"" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.892025 5120 reconciler_common.go:299] "Volume detached for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1ba0f093-ad5c-4a99-bfc2-8439162d5b72-systemd-units\") on node \"crc\" DevicePath \"\"" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.894676 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ba0f093-ad5c-4a99-bfc2-8439162d5b72-kube-api-access-tjz24" (OuterVolumeSpecName: "kube-api-access-tjz24") pod "1ba0f093-ad5c-4a99-bfc2-8439162d5b72" (UID: "1ba0f093-ad5c-4a99-bfc2-8439162d5b72"). InnerVolumeSpecName "kube-api-access-tjz24". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.900476 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/1ba0f093-ad5c-4a99-bfc2-8439162d5b72-run-systemd" (OuterVolumeSpecName: "run-systemd") pod "1ba0f093-ad5c-4a99-bfc2-8439162d5b72" (UID: "1ba0f093-ad5c-4a99-bfc2-8439162d5b72"). InnerVolumeSpecName "run-systemd". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 15:42:58 crc kubenswrapper[5120]: I0316 15:42:58.993532 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5f71176b-7648-4f96-a413-a1ca26d412c2-host-run-ovn-kubernetes\") pod \"ovnkube-node-w5sbz\" (UID: \"5f71176b-7648-4f96-a413-a1ca26d412c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5sbz" Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:58.994055 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5f71176b-7648-4f96-a413-a1ca26d412c2-systemd-units\") pod \"ovnkube-node-w5sbz\" (UID: \"5f71176b-7648-4f96-a413-a1ca26d412c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5sbz" Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.003592 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5f71176b-7648-4f96-a413-a1ca26d412c2-var-lib-openvswitch\") pod \"ovnkube-node-w5sbz\" (UID: \"5f71176b-7648-4f96-a413-a1ca26d412c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5sbz" Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.003694 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5f71176b-7648-4f96-a413-a1ca26d412c2-run-systemd\") pod \"ovnkube-node-w5sbz\" (UID: \"5f71176b-7648-4f96-a413-a1ca26d412c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5sbz" Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.003903 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5f71176b-7648-4f96-a413-a1ca26d412c2-var-lib-openvswitch\") pod \"ovnkube-node-w5sbz\" (UID: \"5f71176b-7648-4f96-a413-a1ca26d412c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5sbz" Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.003991 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5f71176b-7648-4f96-a413-a1ca26d412c2-ovnkube-config\") pod \"ovnkube-node-w5sbz\" (UID: \"5f71176b-7648-4f96-a413-a1ca26d412c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5sbz" Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.004132 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5f71176b-7648-4f96-a413-a1ca26d412c2-run-systemd\") pod \"ovnkube-node-w5sbz\" (UID: \"5f71176b-7648-4f96-a413-a1ca26d412c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5sbz" Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.004265 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5f71176b-7648-4f96-a413-a1ca26d412c2-log-socket\") pod \"ovnkube-node-w5sbz\" (UID: \"5f71176b-7648-4f96-a413-a1ca26d412c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5sbz" Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.004372 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5f71176b-7648-4f96-a413-a1ca26d412c2-etc-openvswitch\") pod \"ovnkube-node-w5sbz\" (UID: \"5f71176b-7648-4f96-a413-a1ca26d412c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5sbz" Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.004435 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5f71176b-7648-4f96-a413-a1ca26d412c2-host-cni-bin\") pod \"ovnkube-node-w5sbz\" (UID: \"5f71176b-7648-4f96-a413-a1ca26d412c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5sbz" Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.004467 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fkr7k\" (UniqueName: \"kubernetes.io/projected/5f71176b-7648-4f96-a413-a1ca26d412c2-kube-api-access-fkr7k\") pod \"ovnkube-node-w5sbz\" (UID: \"5f71176b-7648-4f96-a413-a1ca26d412c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5sbz" Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.004526 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5f71176b-7648-4f96-a413-a1ca26d412c2-env-overrides\") pod \"ovnkube-node-w5sbz\" (UID: \"5f71176b-7648-4f96-a413-a1ca26d412c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5sbz" Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.004613 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5f71176b-7648-4f96-a413-a1ca26d412c2-ovn-node-metrics-cert\") pod \"ovnkube-node-w5sbz\" (UID: \"5f71176b-7648-4f96-a413-a1ca26d412c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5sbz" Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.004667 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5f71176b-7648-4f96-a413-a1ca26d412c2-host-slash\") pod \"ovnkube-node-w5sbz\" (UID: \"5f71176b-7648-4f96-a413-a1ca26d412c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5sbz" Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.004690 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5f71176b-7648-4f96-a413-a1ca26d412c2-host-cni-netd\") pod \"ovnkube-node-w5sbz\" (UID: \"5f71176b-7648-4f96-a413-a1ca26d412c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5sbz" Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.004757 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5f71176b-7648-4f96-a413-a1ca26d412c2-host-run-netns\") pod \"ovnkube-node-w5sbz\" (UID: \"5f71176b-7648-4f96-a413-a1ca26d412c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5sbz" Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.004822 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5f71176b-7648-4f96-a413-a1ca26d412c2-run-ovn\") pod \"ovnkube-node-w5sbz\" (UID: \"5f71176b-7648-4f96-a413-a1ca26d412c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5sbz" Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.004855 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5f71176b-7648-4f96-a413-a1ca26d412c2-ovnkube-script-lib\") pod \"ovnkube-node-w5sbz\" (UID: \"5f71176b-7648-4f96-a413-a1ca26d412c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5sbz" Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.004910 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5f71176b-7648-4f96-a413-a1ca26d412c2-run-openvswitch\") pod \"ovnkube-node-w5sbz\" (UID: \"5f71176b-7648-4f96-a413-a1ca26d412c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5sbz" Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.004083 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5f71176b-7648-4f96-a413-a1ca26d412c2-systemd-units\") pod \"ovnkube-node-w5sbz\" (UID: \"5f71176b-7648-4f96-a413-a1ca26d412c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5sbz" Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.005496 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5f71176b-7648-4f96-a413-a1ca26d412c2-log-socket\") pod \"ovnkube-node-w5sbz\" (UID: \"5f71176b-7648-4f96-a413-a1ca26d412c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5sbz" Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.004274 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5f71176b-7648-4f96-a413-a1ca26d412c2-host-run-ovn-kubernetes\") pod \"ovnkube-node-w5sbz\" (UID: \"5f71176b-7648-4f96-a413-a1ca26d412c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5sbz" Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.005572 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5f71176b-7648-4f96-a413-a1ca26d412c2-etc-openvswitch\") pod \"ovnkube-node-w5sbz\" (UID: \"5f71176b-7648-4f96-a413-a1ca26d412c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5sbz" Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.005624 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5f71176b-7648-4f96-a413-a1ca26d412c2-host-cni-bin\") pod \"ovnkube-node-w5sbz\" (UID: \"5f71176b-7648-4f96-a413-a1ca26d412c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5sbz" Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.005669 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5f71176b-7648-4f96-a413-a1ca26d412c2-node-log\") pod \"ovnkube-node-w5sbz\" (UID: \"5f71176b-7648-4f96-a413-a1ca26d412c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5sbz" Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.005731 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5f71176b-7648-4f96-a413-a1ca26d412c2-host-kubelet\") pod \"ovnkube-node-w5sbz\" (UID: \"5f71176b-7648-4f96-a413-a1ca26d412c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5sbz" Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.005806 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5f71176b-7648-4f96-a413-a1ca26d412c2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-w5sbz\" (UID: \"5f71176b-7648-4f96-a413-a1ca26d412c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5sbz" Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.005980 5120 reconciler_common.go:299] "Volume detached for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1ba0f093-ad5c-4a99-bfc2-8439162d5b72-run-systemd\") on node \"crc\" DevicePath \"\"" Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.006006 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tjz24\" (UniqueName: \"kubernetes.io/projected/1ba0f093-ad5c-4a99-bfc2-8439162d5b72-kube-api-access-tjz24\") on node \"crc\" DevicePath \"\"" Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.006026 5120 reconciler_common.go:299] "Volume detached for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1ba0f093-ad5c-4a99-bfc2-8439162d5b72-ovn-node-metrics-cert\") on node \"crc\" DevicePath \"\"" Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.006064 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5f71176b-7648-4f96-a413-a1ca26d412c2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-w5sbz\" (UID: \"5f71176b-7648-4f96-a413-a1ca26d412c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5sbz" Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.006107 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5f71176b-7648-4f96-a413-a1ca26d412c2-run-openvswitch\") pod \"ovnkube-node-w5sbz\" (UID: \"5f71176b-7648-4f96-a413-a1ca26d412c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5sbz" Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.008042 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5f71176b-7648-4f96-a413-a1ca26d412c2-env-overrides\") pod \"ovnkube-node-w5sbz\" (UID: \"5f71176b-7648-4f96-a413-a1ca26d412c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5sbz" Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.008386 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5f71176b-7648-4f96-a413-a1ca26d412c2-ovnkube-config\") pod \"ovnkube-node-w5sbz\" (UID: \"5f71176b-7648-4f96-a413-a1ca26d412c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5sbz" Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.008969 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5f71176b-7648-4f96-a413-a1ca26d412c2-ovnkube-script-lib\") pod \"ovnkube-node-w5sbz\" (UID: \"5f71176b-7648-4f96-a413-a1ca26d412c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5sbz" Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.009971 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5f71176b-7648-4f96-a413-a1ca26d412c2-node-log\") pod \"ovnkube-node-w5sbz\" (UID: \"5f71176b-7648-4f96-a413-a1ca26d412c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5sbz" Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.010044 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5f71176b-7648-4f96-a413-a1ca26d412c2-host-cni-netd\") pod \"ovnkube-node-w5sbz\" (UID: \"5f71176b-7648-4f96-a413-a1ca26d412c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5sbz" Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.010091 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5f71176b-7648-4f96-a413-a1ca26d412c2-host-run-netns\") pod \"ovnkube-node-w5sbz\" (UID: \"5f71176b-7648-4f96-a413-a1ca26d412c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5sbz" Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.010139 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5f71176b-7648-4f96-a413-a1ca26d412c2-run-ovn\") pod \"ovnkube-node-w5sbz\" (UID: \"5f71176b-7648-4f96-a413-a1ca26d412c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5sbz" Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.010194 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5f71176b-7648-4f96-a413-a1ca26d412c2-host-kubelet\") pod \"ovnkube-node-w5sbz\" (UID: \"5f71176b-7648-4f96-a413-a1ca26d412c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5sbz" Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.010245 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5f71176b-7648-4f96-a413-a1ca26d412c2-host-slash\") pod \"ovnkube-node-w5sbz\" (UID: \"5f71176b-7648-4f96-a413-a1ca26d412c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5sbz" Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.022677 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5f71176b-7648-4f96-a413-a1ca26d412c2-ovn-node-metrics-cert\") pod \"ovnkube-node-w5sbz\" (UID: \"5f71176b-7648-4f96-a413-a1ca26d412c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5sbz" Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.022688 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkr7k\" (UniqueName: \"kubernetes.io/projected/5f71176b-7648-4f96-a413-a1ca26d412c2-kube-api-access-fkr7k\") pod \"ovnkube-node-w5sbz\" (UID: \"5f71176b-7648-4f96-a413-a1ca26d412c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-w5sbz" Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.149932 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-w5sbz" Mar 16 15:42:59 crc kubenswrapper[5120]: W0316 15:42:59.166723 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f71176b_7648_4f96_a413_a1ca26d412c2.slice/crio-2c1271d0ab6cb24bc5b2d66d5cb7691187837bcf17aee267d7cf844786b07449 WatchSource:0}: Error finding container 2c1271d0ab6cb24bc5b2d66d5cb7691187837bcf17aee267d7cf844786b07449: Status 404 returned error can't find the container with id 2c1271d0ab6cb24bc5b2d66d5cb7691187837bcf17aee267d7cf844786b07449 Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.665425 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-v822j_ac55471d-4e42-475f-a082-50f611571482/kube-multus/0.log" Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.665920 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-v822j" event={"ID":"ac55471d-4e42-475f-a082-50f611571482","Type":"ContainerStarted","Data":"9e7b9cb649331cda882c21a3a9468f1a4eb2c76b2bc6d1b8b2aeccdbedf2a532"} Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.672435 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zwk29_1ba0f093-ad5c-4a99-bfc2-8439162d5b72/ovn-acl-logging/0.log" Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.672964 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zwk29_1ba0f093-ad5c-4a99-bfc2-8439162d5b72/ovn-controller/0.log" Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.673278 5120 generic.go:358] "Generic (PLEG): container finished" podID="1ba0f093-ad5c-4a99-bfc2-8439162d5b72" containerID="31bd6609f0a26c6471b5cc968812bd56971cd57f918766fe4ede24149b12679c" exitCode=0 Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.673312 5120 generic.go:358] "Generic (PLEG): container finished" podID="1ba0f093-ad5c-4a99-bfc2-8439162d5b72" containerID="0f97c48af6799e1c6b2f3be9772b7af91dc410d9e22b47214000397e5aa4863e" exitCode=0 Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.673321 5120 generic.go:358] "Generic (PLEG): container finished" podID="1ba0f093-ad5c-4a99-bfc2-8439162d5b72" containerID="e2097aa0c8d162defaeaf9622b03c7fa67f6ca6fe08e2f39b2067dc0355e5ec3" exitCode=0 Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.673374 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zwk29" event={"ID":"1ba0f093-ad5c-4a99-bfc2-8439162d5b72","Type":"ContainerDied","Data":"31bd6609f0a26c6471b5cc968812bd56971cd57f918766fe4ede24149b12679c"} Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.673462 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zwk29" event={"ID":"1ba0f093-ad5c-4a99-bfc2-8439162d5b72","Type":"ContainerDied","Data":"0f97c48af6799e1c6b2f3be9772b7af91dc410d9e22b47214000397e5aa4863e"} Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.673481 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zwk29" event={"ID":"1ba0f093-ad5c-4a99-bfc2-8439162d5b72","Type":"ContainerDied","Data":"e2097aa0c8d162defaeaf9622b03c7fa67f6ca6fe08e2f39b2067dc0355e5ec3"} Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.673491 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zwk29" event={"ID":"1ba0f093-ad5c-4a99-bfc2-8439162d5b72","Type":"ContainerDied","Data":"48123e8cbf9bdda73365e4b314bad0a1a6faf6d072d7091b4d9ca2dc60e33f1d"} Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.673491 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zwk29" Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.673540 5120 scope.go:117] "RemoveContainer" containerID="95c59ce10d5cb44ed144db2fabe3f00638cada4e2996ac5ae763b853f6252c53" Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.674953 5120 generic.go:358] "Generic (PLEG): container finished" podID="5f71176b-7648-4f96-a413-a1ca26d412c2" containerID="d0a89f595c3a07eaa616b8e4c9f315ce0ef97564dd2e321517cbed5e5411eda5" exitCode=0 Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.675008 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w5sbz" event={"ID":"5f71176b-7648-4f96-a413-a1ca26d412c2","Type":"ContainerDied","Data":"d0a89f595c3a07eaa616b8e4c9f315ce0ef97564dd2e321517cbed5e5411eda5"} Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.675038 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w5sbz" event={"ID":"5f71176b-7648-4f96-a413-a1ca26d412c2","Type":"ContainerStarted","Data":"2c1271d0ab6cb24bc5b2d66d5cb7691187837bcf17aee267d7cf844786b07449"} Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.677264 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-control-plane-97c9b6c48-zmjgb" event={"ID":"be9f94ae-da8d-4b21-9577-55246629bb86","Type":"ContainerStarted","Data":"dafbe32572be99549f598a38ff64ccbdae4aeeac877b864670ce7892675af7b3"} Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.677288 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-control-plane-97c9b6c48-zmjgb" event={"ID":"be9f94ae-da8d-4b21-9577-55246629bb86","Type":"ContainerStarted","Data":"82da6b55cb33692d4e3426f73b4359cc66c12a1c66733096a01c60e7e77f1e65"} Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.677297 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-control-plane-97c9b6c48-zmjgb" event={"ID":"be9f94ae-da8d-4b21-9577-55246629bb86","Type":"ContainerStarted","Data":"3a0d74b334fa15f6151569ac033749d276ebd702e5b6de73ef11d54c4a2fb976"} Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.692984 5120 scope.go:117] "RemoveContainer" containerID="31bd6609f0a26c6471b5cc968812bd56971cd57f918766fe4ede24149b12679c" Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.713656 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-control-plane-97c9b6c48-zmjgb" podStartSLOduration=1.713640597 podStartE2EDuration="1.713640597s" podCreationTimestamp="2026-03-16 15:42:58 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:42:59.709489003 +0000 UTC m=+681.863420660" watchObservedRunningTime="2026-03-16 15:42:59.713640597 +0000 UTC m=+681.867572264" Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.726251 5120 scope.go:117] "RemoveContainer" containerID="0f97c48af6799e1c6b2f3be9772b7af91dc410d9e22b47214000397e5aa4863e" Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.770352 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-zwk29"] Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.776073 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-zwk29"] Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.785845 5120 scope.go:117] "RemoveContainer" containerID="e2097aa0c8d162defaeaf9622b03c7fa67f6ca6fe08e2f39b2067dc0355e5ec3" Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.813868 5120 scope.go:117] "RemoveContainer" containerID="556c5f7552cef130952b14c75e576e515a6625b30229eebc4f6c2c030631302b" Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.829731 5120 scope.go:117] "RemoveContainer" containerID="5e1ff7f5cff66589f32172b6a241d38d3d4bd6f3362edb816884ba90b9bc0653" Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.843428 5120 scope.go:117] "RemoveContainer" containerID="d51409051329a3bd8d7f9c4219c81a54f53669f0495718e78d7501a4ef44fd2a" Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.857883 5120 scope.go:117] "RemoveContainer" containerID="f78d3044e1cfdeec2ea5aef2775d8bfadb77ebf6f76a7bf2e6876d1888766e1d" Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.875650 5120 scope.go:117] "RemoveContainer" containerID="81e6b73c323d06c39e01b26252333e0cee1a950fd893b1d6870d20cb51871bfb" Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.893177 5120 scope.go:117] "RemoveContainer" containerID="95c59ce10d5cb44ed144db2fabe3f00638cada4e2996ac5ae763b853f6252c53" Mar 16 15:42:59 crc kubenswrapper[5120]: E0316 15:42:59.893628 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"95c59ce10d5cb44ed144db2fabe3f00638cada4e2996ac5ae763b853f6252c53\": container with ID starting with 95c59ce10d5cb44ed144db2fabe3f00638cada4e2996ac5ae763b853f6252c53 not found: ID does not exist" containerID="95c59ce10d5cb44ed144db2fabe3f00638cada4e2996ac5ae763b853f6252c53" Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.893672 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95c59ce10d5cb44ed144db2fabe3f00638cada4e2996ac5ae763b853f6252c53"} err="failed to get container status \"95c59ce10d5cb44ed144db2fabe3f00638cada4e2996ac5ae763b853f6252c53\": rpc error: code = NotFound desc = could not find container \"95c59ce10d5cb44ed144db2fabe3f00638cada4e2996ac5ae763b853f6252c53\": container with ID starting with 95c59ce10d5cb44ed144db2fabe3f00638cada4e2996ac5ae763b853f6252c53 not found: ID does not exist" Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.893697 5120 scope.go:117] "RemoveContainer" containerID="31bd6609f0a26c6471b5cc968812bd56971cd57f918766fe4ede24149b12679c" Mar 16 15:42:59 crc kubenswrapper[5120]: E0316 15:42:59.896602 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"31bd6609f0a26c6471b5cc968812bd56971cd57f918766fe4ede24149b12679c\": container with ID starting with 31bd6609f0a26c6471b5cc968812bd56971cd57f918766fe4ede24149b12679c not found: ID does not exist" containerID="31bd6609f0a26c6471b5cc968812bd56971cd57f918766fe4ede24149b12679c" Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.896653 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31bd6609f0a26c6471b5cc968812bd56971cd57f918766fe4ede24149b12679c"} err="failed to get container status \"31bd6609f0a26c6471b5cc968812bd56971cd57f918766fe4ede24149b12679c\": rpc error: code = NotFound desc = could not find container \"31bd6609f0a26c6471b5cc968812bd56971cd57f918766fe4ede24149b12679c\": container with ID starting with 31bd6609f0a26c6471b5cc968812bd56971cd57f918766fe4ede24149b12679c not found: ID does not exist" Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.896680 5120 scope.go:117] "RemoveContainer" containerID="0f97c48af6799e1c6b2f3be9772b7af91dc410d9e22b47214000397e5aa4863e" Mar 16 15:42:59 crc kubenswrapper[5120]: E0316 15:42:59.896993 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f97c48af6799e1c6b2f3be9772b7af91dc410d9e22b47214000397e5aa4863e\": container with ID starting with 0f97c48af6799e1c6b2f3be9772b7af91dc410d9e22b47214000397e5aa4863e not found: ID does not exist" containerID="0f97c48af6799e1c6b2f3be9772b7af91dc410d9e22b47214000397e5aa4863e" Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.897020 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f97c48af6799e1c6b2f3be9772b7af91dc410d9e22b47214000397e5aa4863e"} err="failed to get container status \"0f97c48af6799e1c6b2f3be9772b7af91dc410d9e22b47214000397e5aa4863e\": rpc error: code = NotFound desc = could not find container \"0f97c48af6799e1c6b2f3be9772b7af91dc410d9e22b47214000397e5aa4863e\": container with ID starting with 0f97c48af6799e1c6b2f3be9772b7af91dc410d9e22b47214000397e5aa4863e not found: ID does not exist" Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.897032 5120 scope.go:117] "RemoveContainer" containerID="e2097aa0c8d162defaeaf9622b03c7fa67f6ca6fe08e2f39b2067dc0355e5ec3" Mar 16 15:42:59 crc kubenswrapper[5120]: E0316 15:42:59.897226 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e2097aa0c8d162defaeaf9622b03c7fa67f6ca6fe08e2f39b2067dc0355e5ec3\": container with ID starting with e2097aa0c8d162defaeaf9622b03c7fa67f6ca6fe08e2f39b2067dc0355e5ec3 not found: ID does not exist" containerID="e2097aa0c8d162defaeaf9622b03c7fa67f6ca6fe08e2f39b2067dc0355e5ec3" Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.897401 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e2097aa0c8d162defaeaf9622b03c7fa67f6ca6fe08e2f39b2067dc0355e5ec3"} err="failed to get container status \"e2097aa0c8d162defaeaf9622b03c7fa67f6ca6fe08e2f39b2067dc0355e5ec3\": rpc error: code = NotFound desc = could not find container \"e2097aa0c8d162defaeaf9622b03c7fa67f6ca6fe08e2f39b2067dc0355e5ec3\": container with ID starting with e2097aa0c8d162defaeaf9622b03c7fa67f6ca6fe08e2f39b2067dc0355e5ec3 not found: ID does not exist" Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.897426 5120 scope.go:117] "RemoveContainer" containerID="556c5f7552cef130952b14c75e576e515a6625b30229eebc4f6c2c030631302b" Mar 16 15:42:59 crc kubenswrapper[5120]: E0316 15:42:59.897675 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"556c5f7552cef130952b14c75e576e515a6625b30229eebc4f6c2c030631302b\": container with ID starting with 556c5f7552cef130952b14c75e576e515a6625b30229eebc4f6c2c030631302b not found: ID does not exist" containerID="556c5f7552cef130952b14c75e576e515a6625b30229eebc4f6c2c030631302b" Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.897713 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"556c5f7552cef130952b14c75e576e515a6625b30229eebc4f6c2c030631302b"} err="failed to get container status \"556c5f7552cef130952b14c75e576e515a6625b30229eebc4f6c2c030631302b\": rpc error: code = NotFound desc = could not find container \"556c5f7552cef130952b14c75e576e515a6625b30229eebc4f6c2c030631302b\": container with ID starting with 556c5f7552cef130952b14c75e576e515a6625b30229eebc4f6c2c030631302b not found: ID does not exist" Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.897734 5120 scope.go:117] "RemoveContainer" containerID="5e1ff7f5cff66589f32172b6a241d38d3d4bd6f3362edb816884ba90b9bc0653" Mar 16 15:42:59 crc kubenswrapper[5120]: E0316 15:42:59.897971 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5e1ff7f5cff66589f32172b6a241d38d3d4bd6f3362edb816884ba90b9bc0653\": container with ID starting with 5e1ff7f5cff66589f32172b6a241d38d3d4bd6f3362edb816884ba90b9bc0653 not found: ID does not exist" containerID="5e1ff7f5cff66589f32172b6a241d38d3d4bd6f3362edb816884ba90b9bc0653" Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.898007 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e1ff7f5cff66589f32172b6a241d38d3d4bd6f3362edb816884ba90b9bc0653"} err="failed to get container status \"5e1ff7f5cff66589f32172b6a241d38d3d4bd6f3362edb816884ba90b9bc0653\": rpc error: code = NotFound desc = could not find container \"5e1ff7f5cff66589f32172b6a241d38d3d4bd6f3362edb816884ba90b9bc0653\": container with ID starting with 5e1ff7f5cff66589f32172b6a241d38d3d4bd6f3362edb816884ba90b9bc0653 not found: ID does not exist" Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.898032 5120 scope.go:117] "RemoveContainer" containerID="d51409051329a3bd8d7f9c4219c81a54f53669f0495718e78d7501a4ef44fd2a" Mar 16 15:42:59 crc kubenswrapper[5120]: E0316 15:42:59.898396 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d51409051329a3bd8d7f9c4219c81a54f53669f0495718e78d7501a4ef44fd2a\": container with ID starting with d51409051329a3bd8d7f9c4219c81a54f53669f0495718e78d7501a4ef44fd2a not found: ID does not exist" containerID="d51409051329a3bd8d7f9c4219c81a54f53669f0495718e78d7501a4ef44fd2a" Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.898422 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d51409051329a3bd8d7f9c4219c81a54f53669f0495718e78d7501a4ef44fd2a"} err="failed to get container status \"d51409051329a3bd8d7f9c4219c81a54f53669f0495718e78d7501a4ef44fd2a\": rpc error: code = NotFound desc = could not find container \"d51409051329a3bd8d7f9c4219c81a54f53669f0495718e78d7501a4ef44fd2a\": container with ID starting with d51409051329a3bd8d7f9c4219c81a54f53669f0495718e78d7501a4ef44fd2a not found: ID does not exist" Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.898435 5120 scope.go:117] "RemoveContainer" containerID="f78d3044e1cfdeec2ea5aef2775d8bfadb77ebf6f76a7bf2e6876d1888766e1d" Mar 16 15:42:59 crc kubenswrapper[5120]: E0316 15:42:59.898644 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f78d3044e1cfdeec2ea5aef2775d8bfadb77ebf6f76a7bf2e6876d1888766e1d\": container with ID starting with f78d3044e1cfdeec2ea5aef2775d8bfadb77ebf6f76a7bf2e6876d1888766e1d not found: ID does not exist" containerID="f78d3044e1cfdeec2ea5aef2775d8bfadb77ebf6f76a7bf2e6876d1888766e1d" Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.898669 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f78d3044e1cfdeec2ea5aef2775d8bfadb77ebf6f76a7bf2e6876d1888766e1d"} err="failed to get container status \"f78d3044e1cfdeec2ea5aef2775d8bfadb77ebf6f76a7bf2e6876d1888766e1d\": rpc error: code = NotFound desc = could not find container \"f78d3044e1cfdeec2ea5aef2775d8bfadb77ebf6f76a7bf2e6876d1888766e1d\": container with ID starting with f78d3044e1cfdeec2ea5aef2775d8bfadb77ebf6f76a7bf2e6876d1888766e1d not found: ID does not exist" Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.898689 5120 scope.go:117] "RemoveContainer" containerID="81e6b73c323d06c39e01b26252333e0cee1a950fd893b1d6870d20cb51871bfb" Mar 16 15:42:59 crc kubenswrapper[5120]: E0316 15:42:59.899253 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"81e6b73c323d06c39e01b26252333e0cee1a950fd893b1d6870d20cb51871bfb\": container with ID starting with 81e6b73c323d06c39e01b26252333e0cee1a950fd893b1d6870d20cb51871bfb not found: ID does not exist" containerID="81e6b73c323d06c39e01b26252333e0cee1a950fd893b1d6870d20cb51871bfb" Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.899284 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81e6b73c323d06c39e01b26252333e0cee1a950fd893b1d6870d20cb51871bfb"} err="failed to get container status \"81e6b73c323d06c39e01b26252333e0cee1a950fd893b1d6870d20cb51871bfb\": rpc error: code = NotFound desc = could not find container \"81e6b73c323d06c39e01b26252333e0cee1a950fd893b1d6870d20cb51871bfb\": container with ID starting with 81e6b73c323d06c39e01b26252333e0cee1a950fd893b1d6870d20cb51871bfb not found: ID does not exist" Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.899303 5120 scope.go:117] "RemoveContainer" containerID="95c59ce10d5cb44ed144db2fabe3f00638cada4e2996ac5ae763b853f6252c53" Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.899633 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95c59ce10d5cb44ed144db2fabe3f00638cada4e2996ac5ae763b853f6252c53"} err="failed to get container status \"95c59ce10d5cb44ed144db2fabe3f00638cada4e2996ac5ae763b853f6252c53\": rpc error: code = NotFound desc = could not find container \"95c59ce10d5cb44ed144db2fabe3f00638cada4e2996ac5ae763b853f6252c53\": container with ID starting with 95c59ce10d5cb44ed144db2fabe3f00638cada4e2996ac5ae763b853f6252c53 not found: ID does not exist" Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.899655 5120 scope.go:117] "RemoveContainer" containerID="31bd6609f0a26c6471b5cc968812bd56971cd57f918766fe4ede24149b12679c" Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.899913 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31bd6609f0a26c6471b5cc968812bd56971cd57f918766fe4ede24149b12679c"} err="failed to get container status \"31bd6609f0a26c6471b5cc968812bd56971cd57f918766fe4ede24149b12679c\": rpc error: code = NotFound desc = could not find container \"31bd6609f0a26c6471b5cc968812bd56971cd57f918766fe4ede24149b12679c\": container with ID starting with 31bd6609f0a26c6471b5cc968812bd56971cd57f918766fe4ede24149b12679c not found: ID does not exist" Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.899934 5120 scope.go:117] "RemoveContainer" containerID="0f97c48af6799e1c6b2f3be9772b7af91dc410d9e22b47214000397e5aa4863e" Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.900140 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f97c48af6799e1c6b2f3be9772b7af91dc410d9e22b47214000397e5aa4863e"} err="failed to get container status \"0f97c48af6799e1c6b2f3be9772b7af91dc410d9e22b47214000397e5aa4863e\": rpc error: code = NotFound desc = could not find container \"0f97c48af6799e1c6b2f3be9772b7af91dc410d9e22b47214000397e5aa4863e\": container with ID starting with 0f97c48af6799e1c6b2f3be9772b7af91dc410d9e22b47214000397e5aa4863e not found: ID does not exist" Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.900161 5120 scope.go:117] "RemoveContainer" containerID="e2097aa0c8d162defaeaf9622b03c7fa67f6ca6fe08e2f39b2067dc0355e5ec3" Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.900362 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e2097aa0c8d162defaeaf9622b03c7fa67f6ca6fe08e2f39b2067dc0355e5ec3"} err="failed to get container status \"e2097aa0c8d162defaeaf9622b03c7fa67f6ca6fe08e2f39b2067dc0355e5ec3\": rpc error: code = NotFound desc = could not find container \"e2097aa0c8d162defaeaf9622b03c7fa67f6ca6fe08e2f39b2067dc0355e5ec3\": container with ID starting with e2097aa0c8d162defaeaf9622b03c7fa67f6ca6fe08e2f39b2067dc0355e5ec3 not found: ID does not exist" Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.900381 5120 scope.go:117] "RemoveContainer" containerID="556c5f7552cef130952b14c75e576e515a6625b30229eebc4f6c2c030631302b" Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.900559 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"556c5f7552cef130952b14c75e576e515a6625b30229eebc4f6c2c030631302b"} err="failed to get container status \"556c5f7552cef130952b14c75e576e515a6625b30229eebc4f6c2c030631302b\": rpc error: code = NotFound desc = could not find container \"556c5f7552cef130952b14c75e576e515a6625b30229eebc4f6c2c030631302b\": container with ID starting with 556c5f7552cef130952b14c75e576e515a6625b30229eebc4f6c2c030631302b not found: ID does not exist" Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.900583 5120 scope.go:117] "RemoveContainer" containerID="5e1ff7f5cff66589f32172b6a241d38d3d4bd6f3362edb816884ba90b9bc0653" Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.900828 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e1ff7f5cff66589f32172b6a241d38d3d4bd6f3362edb816884ba90b9bc0653"} err="failed to get container status \"5e1ff7f5cff66589f32172b6a241d38d3d4bd6f3362edb816884ba90b9bc0653\": rpc error: code = NotFound desc = could not find container \"5e1ff7f5cff66589f32172b6a241d38d3d4bd6f3362edb816884ba90b9bc0653\": container with ID starting with 5e1ff7f5cff66589f32172b6a241d38d3d4bd6f3362edb816884ba90b9bc0653 not found: ID does not exist" Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.900854 5120 scope.go:117] "RemoveContainer" containerID="d51409051329a3bd8d7f9c4219c81a54f53669f0495718e78d7501a4ef44fd2a" Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.901210 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d51409051329a3bd8d7f9c4219c81a54f53669f0495718e78d7501a4ef44fd2a"} err="failed to get container status \"d51409051329a3bd8d7f9c4219c81a54f53669f0495718e78d7501a4ef44fd2a\": rpc error: code = NotFound desc = could not find container \"d51409051329a3bd8d7f9c4219c81a54f53669f0495718e78d7501a4ef44fd2a\": container with ID starting with d51409051329a3bd8d7f9c4219c81a54f53669f0495718e78d7501a4ef44fd2a not found: ID does not exist" Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.901228 5120 scope.go:117] "RemoveContainer" containerID="f78d3044e1cfdeec2ea5aef2775d8bfadb77ebf6f76a7bf2e6876d1888766e1d" Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.901435 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f78d3044e1cfdeec2ea5aef2775d8bfadb77ebf6f76a7bf2e6876d1888766e1d"} err="failed to get container status \"f78d3044e1cfdeec2ea5aef2775d8bfadb77ebf6f76a7bf2e6876d1888766e1d\": rpc error: code = NotFound desc = could not find container \"f78d3044e1cfdeec2ea5aef2775d8bfadb77ebf6f76a7bf2e6876d1888766e1d\": container with ID starting with f78d3044e1cfdeec2ea5aef2775d8bfadb77ebf6f76a7bf2e6876d1888766e1d not found: ID does not exist" Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.901461 5120 scope.go:117] "RemoveContainer" containerID="81e6b73c323d06c39e01b26252333e0cee1a950fd893b1d6870d20cb51871bfb" Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.901668 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81e6b73c323d06c39e01b26252333e0cee1a950fd893b1d6870d20cb51871bfb"} err="failed to get container status \"81e6b73c323d06c39e01b26252333e0cee1a950fd893b1d6870d20cb51871bfb\": rpc error: code = NotFound desc = could not find container \"81e6b73c323d06c39e01b26252333e0cee1a950fd893b1d6870d20cb51871bfb\": container with ID starting with 81e6b73c323d06c39e01b26252333e0cee1a950fd893b1d6870d20cb51871bfb not found: ID does not exist" Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.901687 5120 scope.go:117] "RemoveContainer" containerID="95c59ce10d5cb44ed144db2fabe3f00638cada4e2996ac5ae763b853f6252c53" Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.901902 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95c59ce10d5cb44ed144db2fabe3f00638cada4e2996ac5ae763b853f6252c53"} err="failed to get container status \"95c59ce10d5cb44ed144db2fabe3f00638cada4e2996ac5ae763b853f6252c53\": rpc error: code = NotFound desc = could not find container \"95c59ce10d5cb44ed144db2fabe3f00638cada4e2996ac5ae763b853f6252c53\": container with ID starting with 95c59ce10d5cb44ed144db2fabe3f00638cada4e2996ac5ae763b853f6252c53 not found: ID does not exist" Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.901924 5120 scope.go:117] "RemoveContainer" containerID="31bd6609f0a26c6471b5cc968812bd56971cd57f918766fe4ede24149b12679c" Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.902121 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31bd6609f0a26c6471b5cc968812bd56971cd57f918766fe4ede24149b12679c"} err="failed to get container status \"31bd6609f0a26c6471b5cc968812bd56971cd57f918766fe4ede24149b12679c\": rpc error: code = NotFound desc = could not find container \"31bd6609f0a26c6471b5cc968812bd56971cd57f918766fe4ede24149b12679c\": container with ID starting with 31bd6609f0a26c6471b5cc968812bd56971cd57f918766fe4ede24149b12679c not found: ID does not exist" Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.902148 5120 scope.go:117] "RemoveContainer" containerID="0f97c48af6799e1c6b2f3be9772b7af91dc410d9e22b47214000397e5aa4863e" Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.902427 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f97c48af6799e1c6b2f3be9772b7af91dc410d9e22b47214000397e5aa4863e"} err="failed to get container status \"0f97c48af6799e1c6b2f3be9772b7af91dc410d9e22b47214000397e5aa4863e\": rpc error: code = NotFound desc = could not find container \"0f97c48af6799e1c6b2f3be9772b7af91dc410d9e22b47214000397e5aa4863e\": container with ID starting with 0f97c48af6799e1c6b2f3be9772b7af91dc410d9e22b47214000397e5aa4863e not found: ID does not exist" Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.902462 5120 scope.go:117] "RemoveContainer" containerID="e2097aa0c8d162defaeaf9622b03c7fa67f6ca6fe08e2f39b2067dc0355e5ec3" Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.902838 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e2097aa0c8d162defaeaf9622b03c7fa67f6ca6fe08e2f39b2067dc0355e5ec3"} err="failed to get container status \"e2097aa0c8d162defaeaf9622b03c7fa67f6ca6fe08e2f39b2067dc0355e5ec3\": rpc error: code = NotFound desc = could not find container \"e2097aa0c8d162defaeaf9622b03c7fa67f6ca6fe08e2f39b2067dc0355e5ec3\": container with ID starting with e2097aa0c8d162defaeaf9622b03c7fa67f6ca6fe08e2f39b2067dc0355e5ec3 not found: ID does not exist" Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.902862 5120 scope.go:117] "RemoveContainer" containerID="556c5f7552cef130952b14c75e576e515a6625b30229eebc4f6c2c030631302b" Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.903174 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"556c5f7552cef130952b14c75e576e515a6625b30229eebc4f6c2c030631302b"} err="failed to get container status \"556c5f7552cef130952b14c75e576e515a6625b30229eebc4f6c2c030631302b\": rpc error: code = NotFound desc = could not find container \"556c5f7552cef130952b14c75e576e515a6625b30229eebc4f6c2c030631302b\": container with ID starting with 556c5f7552cef130952b14c75e576e515a6625b30229eebc4f6c2c030631302b not found: ID does not exist" Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.903196 5120 scope.go:117] "RemoveContainer" containerID="5e1ff7f5cff66589f32172b6a241d38d3d4bd6f3362edb816884ba90b9bc0653" Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.903402 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e1ff7f5cff66589f32172b6a241d38d3d4bd6f3362edb816884ba90b9bc0653"} err="failed to get container status \"5e1ff7f5cff66589f32172b6a241d38d3d4bd6f3362edb816884ba90b9bc0653\": rpc error: code = NotFound desc = could not find container \"5e1ff7f5cff66589f32172b6a241d38d3d4bd6f3362edb816884ba90b9bc0653\": container with ID starting with 5e1ff7f5cff66589f32172b6a241d38d3d4bd6f3362edb816884ba90b9bc0653 not found: ID does not exist" Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.903421 5120 scope.go:117] "RemoveContainer" containerID="d51409051329a3bd8d7f9c4219c81a54f53669f0495718e78d7501a4ef44fd2a" Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.903707 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d51409051329a3bd8d7f9c4219c81a54f53669f0495718e78d7501a4ef44fd2a"} err="failed to get container status \"d51409051329a3bd8d7f9c4219c81a54f53669f0495718e78d7501a4ef44fd2a\": rpc error: code = NotFound desc = could not find container \"d51409051329a3bd8d7f9c4219c81a54f53669f0495718e78d7501a4ef44fd2a\": container with ID starting with d51409051329a3bd8d7f9c4219c81a54f53669f0495718e78d7501a4ef44fd2a not found: ID does not exist" Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.903777 5120 scope.go:117] "RemoveContainer" containerID="f78d3044e1cfdeec2ea5aef2775d8bfadb77ebf6f76a7bf2e6876d1888766e1d" Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.904006 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f78d3044e1cfdeec2ea5aef2775d8bfadb77ebf6f76a7bf2e6876d1888766e1d"} err="failed to get container status \"f78d3044e1cfdeec2ea5aef2775d8bfadb77ebf6f76a7bf2e6876d1888766e1d\": rpc error: code = NotFound desc = could not find container \"f78d3044e1cfdeec2ea5aef2775d8bfadb77ebf6f76a7bf2e6876d1888766e1d\": container with ID starting with f78d3044e1cfdeec2ea5aef2775d8bfadb77ebf6f76a7bf2e6876d1888766e1d not found: ID does not exist" Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.904026 5120 scope.go:117] "RemoveContainer" containerID="81e6b73c323d06c39e01b26252333e0cee1a950fd893b1d6870d20cb51871bfb" Mar 16 15:42:59 crc kubenswrapper[5120]: I0316 15:42:59.904224 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81e6b73c323d06c39e01b26252333e0cee1a950fd893b1d6870d20cb51871bfb"} err="failed to get container status \"81e6b73c323d06c39e01b26252333e0cee1a950fd893b1d6870d20cb51871bfb\": rpc error: code = NotFound desc = could not find container \"81e6b73c323d06c39e01b26252333e0cee1a950fd893b1d6870d20cb51871bfb\": container with ID starting with 81e6b73c323d06c39e01b26252333e0cee1a950fd893b1d6870d20cb51871bfb not found: ID does not exist" Mar 16 15:43:00 crc kubenswrapper[5120]: I0316 15:43:00.669265 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ba0f093-ad5c-4a99-bfc2-8439162d5b72" path="/var/lib/kubelet/pods/1ba0f093-ad5c-4a99-bfc2-8439162d5b72/volumes" Mar 16 15:43:00 crc kubenswrapper[5120]: I0316 15:43:00.670892 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8e29c57a-87ae-4f7a-82f5-867e05ccf280" path="/var/lib/kubelet/pods/8e29c57a-87ae-4f7a-82f5-867e05ccf280/volumes" Mar 16 15:43:00 crc kubenswrapper[5120]: I0316 15:43:00.687209 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w5sbz" event={"ID":"5f71176b-7648-4f96-a413-a1ca26d412c2","Type":"ContainerStarted","Data":"4754cd8b20cc2f3262a6feac7f962f4b524ec6a3cc701a03eb3eecb66fd387b5"} Mar 16 15:43:00 crc kubenswrapper[5120]: I0316 15:43:00.687252 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w5sbz" event={"ID":"5f71176b-7648-4f96-a413-a1ca26d412c2","Type":"ContainerStarted","Data":"f4c8255b01fc02e662483926eb982c49f916b4d2ff67beb38c7ab4a0bd73ace7"} Mar 16 15:43:00 crc kubenswrapper[5120]: I0316 15:43:00.687267 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w5sbz" event={"ID":"5f71176b-7648-4f96-a413-a1ca26d412c2","Type":"ContainerStarted","Data":"f6cf97ea12400e56890b6a8ca5a3fd147b99bf11739b600d9714131a42c73ea6"} Mar 16 15:43:00 crc kubenswrapper[5120]: I0316 15:43:00.687279 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w5sbz" event={"ID":"5f71176b-7648-4f96-a413-a1ca26d412c2","Type":"ContainerStarted","Data":"f74297b14f62171488fa2447b47bef1d0f51d9566c40ad2cc8b07cbb0a002875"} Mar 16 15:43:00 crc kubenswrapper[5120]: I0316 15:43:00.687290 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w5sbz" event={"ID":"5f71176b-7648-4f96-a413-a1ca26d412c2","Type":"ContainerStarted","Data":"21fd94d9de3d6bb23e624060c96e2fa5355ef26187083c36e4edfed79d307b6d"} Mar 16 15:43:00 crc kubenswrapper[5120]: I0316 15:43:00.687302 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w5sbz" event={"ID":"5f71176b-7648-4f96-a413-a1ca26d412c2","Type":"ContainerStarted","Data":"f029f4247ed29e30c719db44595980478b4198e2a012cbb054f680cfe5b097aa"} Mar 16 15:43:03 crc kubenswrapper[5120]: I0316 15:43:03.714026 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w5sbz" event={"ID":"5f71176b-7648-4f96-a413-a1ca26d412c2","Type":"ContainerStarted","Data":"c7b4c61d2358b34070e04c236872efbb0ea2baf3b8f2dfbb23ac87854b7b1942"} Mar 16 15:43:05 crc kubenswrapper[5120]: I0316 15:43:05.729636 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w5sbz" event={"ID":"5f71176b-7648-4f96-a413-a1ca26d412c2","Type":"ContainerStarted","Data":"7e3998f93916a132c74ffdd1f375084cb21b65bafae61f33b688372ea76d63f7"} Mar 16 15:43:05 crc kubenswrapper[5120]: I0316 15:43:05.730334 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-w5sbz" Mar 16 15:43:05 crc kubenswrapper[5120]: I0316 15:43:05.730359 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-w5sbz" Mar 16 15:43:05 crc kubenswrapper[5120]: I0316 15:43:05.730374 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-w5sbz" Mar 16 15:43:05 crc kubenswrapper[5120]: I0316 15:43:05.755649 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-w5sbz" podStartSLOduration=7.755633256 podStartE2EDuration="7.755633256s" podCreationTimestamp="2026-03-16 15:42:58 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:43:05.754507773 +0000 UTC m=+687.908439450" watchObservedRunningTime="2026-03-16 15:43:05.755633256 +0000 UTC m=+687.909564913" Mar 16 15:43:05 crc kubenswrapper[5120]: I0316 15:43:05.760711 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-w5sbz" Mar 16 15:43:05 crc kubenswrapper[5120]: I0316 15:43:05.760878 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-w5sbz" Mar 16 15:43:33 crc kubenswrapper[5120]: I0316 15:43:33.694053 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5d9d95bf5b-rwzmk"] Mar 16 15:43:33 crc kubenswrapper[5120]: I0316 15:43:33.706208 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d9d95bf5b-rwzmk" Mar 16 15:43:33 crc kubenswrapper[5120]: I0316 15:43:33.712255 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5d9d95bf5b-rwzmk"] Mar 16 15:43:33 crc kubenswrapper[5120]: I0316 15:43:33.813364 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkhkw\" (UniqueName: \"kubernetes.io/projected/94534b35-814d-4b1e-a806-df922019f73a-kube-api-access-xkhkw\") pod \"image-registry-5d9d95bf5b-rwzmk\" (UID: \"94534b35-814d-4b1e-a806-df922019f73a\") " pod="openshift-image-registry/image-registry-5d9d95bf5b-rwzmk" Mar 16 15:43:33 crc kubenswrapper[5120]: I0316 15:43:33.813412 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/94534b35-814d-4b1e-a806-df922019f73a-installation-pull-secrets\") pod \"image-registry-5d9d95bf5b-rwzmk\" (UID: \"94534b35-814d-4b1e-a806-df922019f73a\") " pod="openshift-image-registry/image-registry-5d9d95bf5b-rwzmk" Mar 16 15:43:33 crc kubenswrapper[5120]: I0316 15:43:33.813435 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/94534b35-814d-4b1e-a806-df922019f73a-registry-tls\") pod \"image-registry-5d9d95bf5b-rwzmk\" (UID: \"94534b35-814d-4b1e-a806-df922019f73a\") " pod="openshift-image-registry/image-registry-5d9d95bf5b-rwzmk" Mar 16 15:43:33 crc kubenswrapper[5120]: I0316 15:43:33.813454 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/94534b35-814d-4b1e-a806-df922019f73a-ca-trust-extracted\") pod \"image-registry-5d9d95bf5b-rwzmk\" (UID: \"94534b35-814d-4b1e-a806-df922019f73a\") " pod="openshift-image-registry/image-registry-5d9d95bf5b-rwzmk" Mar 16 15:43:33 crc kubenswrapper[5120]: I0316 15:43:33.813655 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/94534b35-814d-4b1e-a806-df922019f73a-bound-sa-token\") pod \"image-registry-5d9d95bf5b-rwzmk\" (UID: \"94534b35-814d-4b1e-a806-df922019f73a\") " pod="openshift-image-registry/image-registry-5d9d95bf5b-rwzmk" Mar 16 15:43:33 crc kubenswrapper[5120]: I0316 15:43:33.813770 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-5d9d95bf5b-rwzmk\" (UID: \"94534b35-814d-4b1e-a806-df922019f73a\") " pod="openshift-image-registry/image-registry-5d9d95bf5b-rwzmk" Mar 16 15:43:33 crc kubenswrapper[5120]: I0316 15:43:33.813814 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/94534b35-814d-4b1e-a806-df922019f73a-registry-certificates\") pod \"image-registry-5d9d95bf5b-rwzmk\" (UID: \"94534b35-814d-4b1e-a806-df922019f73a\") " pod="openshift-image-registry/image-registry-5d9d95bf5b-rwzmk" Mar 16 15:43:33 crc kubenswrapper[5120]: I0316 15:43:33.813837 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/94534b35-814d-4b1e-a806-df922019f73a-trusted-ca\") pod \"image-registry-5d9d95bf5b-rwzmk\" (UID: \"94534b35-814d-4b1e-a806-df922019f73a\") " pod="openshift-image-registry/image-registry-5d9d95bf5b-rwzmk" Mar 16 15:43:33 crc kubenswrapper[5120]: I0316 15:43:33.856140 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-5d9d95bf5b-rwzmk\" (UID: \"94534b35-814d-4b1e-a806-df922019f73a\") " pod="openshift-image-registry/image-registry-5d9d95bf5b-rwzmk" Mar 16 15:43:33 crc kubenswrapper[5120]: I0316 15:43:33.914971 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/94534b35-814d-4b1e-a806-df922019f73a-registry-certificates\") pod \"image-registry-5d9d95bf5b-rwzmk\" (UID: \"94534b35-814d-4b1e-a806-df922019f73a\") " pod="openshift-image-registry/image-registry-5d9d95bf5b-rwzmk" Mar 16 15:43:33 crc kubenswrapper[5120]: I0316 15:43:33.915016 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/94534b35-814d-4b1e-a806-df922019f73a-trusted-ca\") pod \"image-registry-5d9d95bf5b-rwzmk\" (UID: \"94534b35-814d-4b1e-a806-df922019f73a\") " pod="openshift-image-registry/image-registry-5d9d95bf5b-rwzmk" Mar 16 15:43:33 crc kubenswrapper[5120]: I0316 15:43:33.915077 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xkhkw\" (UniqueName: \"kubernetes.io/projected/94534b35-814d-4b1e-a806-df922019f73a-kube-api-access-xkhkw\") pod \"image-registry-5d9d95bf5b-rwzmk\" (UID: \"94534b35-814d-4b1e-a806-df922019f73a\") " pod="openshift-image-registry/image-registry-5d9d95bf5b-rwzmk" Mar 16 15:43:33 crc kubenswrapper[5120]: I0316 15:43:33.915099 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/94534b35-814d-4b1e-a806-df922019f73a-installation-pull-secrets\") pod \"image-registry-5d9d95bf5b-rwzmk\" (UID: \"94534b35-814d-4b1e-a806-df922019f73a\") " pod="openshift-image-registry/image-registry-5d9d95bf5b-rwzmk" Mar 16 15:43:33 crc kubenswrapper[5120]: I0316 15:43:33.915114 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/94534b35-814d-4b1e-a806-df922019f73a-registry-tls\") pod \"image-registry-5d9d95bf5b-rwzmk\" (UID: \"94534b35-814d-4b1e-a806-df922019f73a\") " pod="openshift-image-registry/image-registry-5d9d95bf5b-rwzmk" Mar 16 15:43:33 crc kubenswrapper[5120]: I0316 15:43:33.915132 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/94534b35-814d-4b1e-a806-df922019f73a-ca-trust-extracted\") pod \"image-registry-5d9d95bf5b-rwzmk\" (UID: \"94534b35-814d-4b1e-a806-df922019f73a\") " pod="openshift-image-registry/image-registry-5d9d95bf5b-rwzmk" Mar 16 15:43:33 crc kubenswrapper[5120]: I0316 15:43:33.915306 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/94534b35-814d-4b1e-a806-df922019f73a-bound-sa-token\") pod \"image-registry-5d9d95bf5b-rwzmk\" (UID: \"94534b35-814d-4b1e-a806-df922019f73a\") " pod="openshift-image-registry/image-registry-5d9d95bf5b-rwzmk" Mar 16 15:43:33 crc kubenswrapper[5120]: I0316 15:43:33.916038 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/94534b35-814d-4b1e-a806-df922019f73a-ca-trust-extracted\") pod \"image-registry-5d9d95bf5b-rwzmk\" (UID: \"94534b35-814d-4b1e-a806-df922019f73a\") " pod="openshift-image-registry/image-registry-5d9d95bf5b-rwzmk" Mar 16 15:43:33 crc kubenswrapper[5120]: I0316 15:43:33.916546 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/94534b35-814d-4b1e-a806-df922019f73a-trusted-ca\") pod \"image-registry-5d9d95bf5b-rwzmk\" (UID: \"94534b35-814d-4b1e-a806-df922019f73a\") " pod="openshift-image-registry/image-registry-5d9d95bf5b-rwzmk" Mar 16 15:43:33 crc kubenswrapper[5120]: I0316 15:43:33.916931 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/94534b35-814d-4b1e-a806-df922019f73a-registry-certificates\") pod \"image-registry-5d9d95bf5b-rwzmk\" (UID: \"94534b35-814d-4b1e-a806-df922019f73a\") " pod="openshift-image-registry/image-registry-5d9d95bf5b-rwzmk" Mar 16 15:43:33 crc kubenswrapper[5120]: I0316 15:43:33.922748 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/94534b35-814d-4b1e-a806-df922019f73a-registry-tls\") pod \"image-registry-5d9d95bf5b-rwzmk\" (UID: \"94534b35-814d-4b1e-a806-df922019f73a\") " pod="openshift-image-registry/image-registry-5d9d95bf5b-rwzmk" Mar 16 15:43:33 crc kubenswrapper[5120]: I0316 15:43:33.927296 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/94534b35-814d-4b1e-a806-df922019f73a-installation-pull-secrets\") pod \"image-registry-5d9d95bf5b-rwzmk\" (UID: \"94534b35-814d-4b1e-a806-df922019f73a\") " pod="openshift-image-registry/image-registry-5d9d95bf5b-rwzmk" Mar 16 15:43:33 crc kubenswrapper[5120]: I0316 15:43:33.937720 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/94534b35-814d-4b1e-a806-df922019f73a-bound-sa-token\") pod \"image-registry-5d9d95bf5b-rwzmk\" (UID: \"94534b35-814d-4b1e-a806-df922019f73a\") " pod="openshift-image-registry/image-registry-5d9d95bf5b-rwzmk" Mar 16 15:43:33 crc kubenswrapper[5120]: I0316 15:43:33.939673 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkhkw\" (UniqueName: \"kubernetes.io/projected/94534b35-814d-4b1e-a806-df922019f73a-kube-api-access-xkhkw\") pod \"image-registry-5d9d95bf5b-rwzmk\" (UID: \"94534b35-814d-4b1e-a806-df922019f73a\") " pod="openshift-image-registry/image-registry-5d9d95bf5b-rwzmk" Mar 16 15:43:34 crc kubenswrapper[5120]: I0316 15:43:34.022350 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d9d95bf5b-rwzmk" Mar 16 15:43:34 crc kubenswrapper[5120]: I0316 15:43:34.272916 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5d9d95bf5b-rwzmk"] Mar 16 15:43:34 crc kubenswrapper[5120]: I0316 15:43:34.860992 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/d1f2cf7c6f4ecb15e69cc0ed07a53b6f169b7a9d46d563b1a9827dff83d68kn"] Mar 16 15:43:34 crc kubenswrapper[5120]: I0316 15:43:34.884998 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/d1f2cf7c6f4ecb15e69cc0ed07a53b6f169b7a9d46d563b1a9827dff83d68kn" Mar 16 15:43:34 crc kubenswrapper[5120]: I0316 15:43:34.887476 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-b2ccr\"" Mar 16 15:43:34 crc kubenswrapper[5120]: I0316 15:43:34.897992 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/d1f2cf7c6f4ecb15e69cc0ed07a53b6f169b7a9d46d563b1a9827dff83d68kn"] Mar 16 15:43:34 crc kubenswrapper[5120]: I0316 15:43:34.911015 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d9d95bf5b-rwzmk" event={"ID":"94534b35-814d-4b1e-a806-df922019f73a","Type":"ContainerStarted","Data":"eb9e704015b9c49727583fec81dd51f151d8f562dda27a9c2286818a9888afa6"} Mar 16 15:43:34 crc kubenswrapper[5120]: I0316 15:43:34.911059 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d9d95bf5b-rwzmk" event={"ID":"94534b35-814d-4b1e-a806-df922019f73a","Type":"ContainerStarted","Data":"36669eea8e66b3b4aa58cde30341de5e85b94d3357784ed73a8e52dc60f879b8"} Mar 16 15:43:34 crc kubenswrapper[5120]: I0316 15:43:34.911995 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5d9d95bf5b-rwzmk" Mar 16 15:43:34 crc kubenswrapper[5120]: I0316 15:43:34.928414 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/02456ec5-b7f9-495a-90b7-990ca519212f-util\") pod \"d1f2cf7c6f4ecb15e69cc0ed07a53b6f169b7a9d46d563b1a9827dff83d68kn\" (UID: \"02456ec5-b7f9-495a-90b7-990ca519212f\") " pod="openshift-marketplace/d1f2cf7c6f4ecb15e69cc0ed07a53b6f169b7a9d46d563b1a9827dff83d68kn" Mar 16 15:43:34 crc kubenswrapper[5120]: I0316 15:43:34.928678 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5h5d\" (UniqueName: \"kubernetes.io/projected/02456ec5-b7f9-495a-90b7-990ca519212f-kube-api-access-h5h5d\") pod \"d1f2cf7c6f4ecb15e69cc0ed07a53b6f169b7a9d46d563b1a9827dff83d68kn\" (UID: \"02456ec5-b7f9-495a-90b7-990ca519212f\") " pod="openshift-marketplace/d1f2cf7c6f4ecb15e69cc0ed07a53b6f169b7a9d46d563b1a9827dff83d68kn" Mar 16 15:43:34 crc kubenswrapper[5120]: I0316 15:43:34.928784 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/02456ec5-b7f9-495a-90b7-990ca519212f-bundle\") pod \"d1f2cf7c6f4ecb15e69cc0ed07a53b6f169b7a9d46d563b1a9827dff83d68kn\" (UID: \"02456ec5-b7f9-495a-90b7-990ca519212f\") " pod="openshift-marketplace/d1f2cf7c6f4ecb15e69cc0ed07a53b6f169b7a9d46d563b1a9827dff83d68kn" Mar 16 15:43:34 crc kubenswrapper[5120]: I0316 15:43:34.938854 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5d9d95bf5b-rwzmk" podStartSLOduration=1.938833152 podStartE2EDuration="1.938833152s" podCreationTimestamp="2026-03-16 15:43:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:43:34.934958232 +0000 UTC m=+717.088889889" watchObservedRunningTime="2026-03-16 15:43:34.938833152 +0000 UTC m=+717.092764819" Mar 16 15:43:35 crc kubenswrapper[5120]: I0316 15:43:35.029784 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/02456ec5-b7f9-495a-90b7-990ca519212f-util\") pod \"d1f2cf7c6f4ecb15e69cc0ed07a53b6f169b7a9d46d563b1a9827dff83d68kn\" (UID: \"02456ec5-b7f9-495a-90b7-990ca519212f\") " pod="openshift-marketplace/d1f2cf7c6f4ecb15e69cc0ed07a53b6f169b7a9d46d563b1a9827dff83d68kn" Mar 16 15:43:35 crc kubenswrapper[5120]: I0316 15:43:35.029886 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h5h5d\" (UniqueName: \"kubernetes.io/projected/02456ec5-b7f9-495a-90b7-990ca519212f-kube-api-access-h5h5d\") pod \"d1f2cf7c6f4ecb15e69cc0ed07a53b6f169b7a9d46d563b1a9827dff83d68kn\" (UID: \"02456ec5-b7f9-495a-90b7-990ca519212f\") " pod="openshift-marketplace/d1f2cf7c6f4ecb15e69cc0ed07a53b6f169b7a9d46d563b1a9827dff83d68kn" Mar 16 15:43:35 crc kubenswrapper[5120]: I0316 15:43:35.029927 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/02456ec5-b7f9-495a-90b7-990ca519212f-bundle\") pod \"d1f2cf7c6f4ecb15e69cc0ed07a53b6f169b7a9d46d563b1a9827dff83d68kn\" (UID: \"02456ec5-b7f9-495a-90b7-990ca519212f\") " pod="openshift-marketplace/d1f2cf7c6f4ecb15e69cc0ed07a53b6f169b7a9d46d563b1a9827dff83d68kn" Mar 16 15:43:35 crc kubenswrapper[5120]: I0316 15:43:35.030572 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/02456ec5-b7f9-495a-90b7-990ca519212f-util\") pod \"d1f2cf7c6f4ecb15e69cc0ed07a53b6f169b7a9d46d563b1a9827dff83d68kn\" (UID: \"02456ec5-b7f9-495a-90b7-990ca519212f\") " pod="openshift-marketplace/d1f2cf7c6f4ecb15e69cc0ed07a53b6f169b7a9d46d563b1a9827dff83d68kn" Mar 16 15:43:35 crc kubenswrapper[5120]: I0316 15:43:35.030583 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/02456ec5-b7f9-495a-90b7-990ca519212f-bundle\") pod \"d1f2cf7c6f4ecb15e69cc0ed07a53b6f169b7a9d46d563b1a9827dff83d68kn\" (UID: \"02456ec5-b7f9-495a-90b7-990ca519212f\") " pod="openshift-marketplace/d1f2cf7c6f4ecb15e69cc0ed07a53b6f169b7a9d46d563b1a9827dff83d68kn" Mar 16 15:43:35 crc kubenswrapper[5120]: I0316 15:43:35.046915 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5h5d\" (UniqueName: \"kubernetes.io/projected/02456ec5-b7f9-495a-90b7-990ca519212f-kube-api-access-h5h5d\") pod \"d1f2cf7c6f4ecb15e69cc0ed07a53b6f169b7a9d46d563b1a9827dff83d68kn\" (UID: \"02456ec5-b7f9-495a-90b7-990ca519212f\") " pod="openshift-marketplace/d1f2cf7c6f4ecb15e69cc0ed07a53b6f169b7a9d46d563b1a9827dff83d68kn" Mar 16 15:43:35 crc kubenswrapper[5120]: I0316 15:43:35.207109 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/d1f2cf7c6f4ecb15e69cc0ed07a53b6f169b7a9d46d563b1a9827dff83d68kn" Mar 16 15:43:35 crc kubenswrapper[5120]: I0316 15:43:35.416106 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/d1f2cf7c6f4ecb15e69cc0ed07a53b6f169b7a9d46d563b1a9827dff83d68kn"] Mar 16 15:43:35 crc kubenswrapper[5120]: W0316 15:43:35.428935 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02456ec5_b7f9_495a_90b7_990ca519212f.slice/crio-f0ce8ddbf9e3197d1d5960584605bc6d7557de4ccac5c1938fbcf494d53329d0 WatchSource:0}: Error finding container f0ce8ddbf9e3197d1d5960584605bc6d7557de4ccac5c1938fbcf494d53329d0: Status 404 returned error can't find the container with id f0ce8ddbf9e3197d1d5960584605bc6d7557de4ccac5c1938fbcf494d53329d0 Mar 16 15:43:35 crc kubenswrapper[5120]: I0316 15:43:35.918132 5120 generic.go:358] "Generic (PLEG): container finished" podID="02456ec5-b7f9-495a-90b7-990ca519212f" containerID="3821f29710ae89e48dae7d4d53a324797f6319ad035fe8e794fbd23a5d8ef99a" exitCode=0 Mar 16 15:43:35 crc kubenswrapper[5120]: I0316 15:43:35.918331 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/d1f2cf7c6f4ecb15e69cc0ed07a53b6f169b7a9d46d563b1a9827dff83d68kn" event={"ID":"02456ec5-b7f9-495a-90b7-990ca519212f","Type":"ContainerDied","Data":"3821f29710ae89e48dae7d4d53a324797f6319ad035fe8e794fbd23a5d8ef99a"} Mar 16 15:43:35 crc kubenswrapper[5120]: I0316 15:43:35.918625 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/d1f2cf7c6f4ecb15e69cc0ed07a53b6f169b7a9d46d563b1a9827dff83d68kn" event={"ID":"02456ec5-b7f9-495a-90b7-990ca519212f","Type":"ContainerStarted","Data":"f0ce8ddbf9e3197d1d5960584605bc6d7557de4ccac5c1938fbcf494d53329d0"} Mar 16 15:43:37 crc kubenswrapper[5120]: I0316 15:43:37.774698 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-w5sbz" Mar 16 15:43:38 crc kubenswrapper[5120]: I0316 15:43:38.939901 5120 generic.go:358] "Generic (PLEG): container finished" podID="02456ec5-b7f9-495a-90b7-990ca519212f" containerID="73835577b4cf53b85ed0f02456e55ea95c147808dae65d93838753ea6f865aab" exitCode=0 Mar 16 15:43:38 crc kubenswrapper[5120]: I0316 15:43:38.939956 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/d1f2cf7c6f4ecb15e69cc0ed07a53b6f169b7a9d46d563b1a9827dff83d68kn" event={"ID":"02456ec5-b7f9-495a-90b7-990ca519212f","Type":"ContainerDied","Data":"73835577b4cf53b85ed0f02456e55ea95c147808dae65d93838753ea6f865aab"} Mar 16 15:43:39 crc kubenswrapper[5120]: I0316 15:43:39.949287 5120 generic.go:358] "Generic (PLEG): container finished" podID="02456ec5-b7f9-495a-90b7-990ca519212f" containerID="abe65db8eca7aa02e40f5c12b89c26963f2a3f5c04aeefe9c8eeec741f794cc6" exitCode=0 Mar 16 15:43:39 crc kubenswrapper[5120]: I0316 15:43:39.949372 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/d1f2cf7c6f4ecb15e69cc0ed07a53b6f169b7a9d46d563b1a9827dff83d68kn" event={"ID":"02456ec5-b7f9-495a-90b7-990ca519212f","Type":"ContainerDied","Data":"abe65db8eca7aa02e40f5c12b89c26963f2a3f5c04aeefe9c8eeec741f794cc6"} Mar 16 15:43:41 crc kubenswrapper[5120]: I0316 15:43:41.231013 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/d1f2cf7c6f4ecb15e69cc0ed07a53b6f169b7a9d46d563b1a9827dff83d68kn" Mar 16 15:43:41 crc kubenswrapper[5120]: I0316 15:43:41.325986 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/02456ec5-b7f9-495a-90b7-990ca519212f-bundle\") pod \"02456ec5-b7f9-495a-90b7-990ca519212f\" (UID: \"02456ec5-b7f9-495a-90b7-990ca519212f\") " Mar 16 15:43:41 crc kubenswrapper[5120]: I0316 15:43:41.326125 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/02456ec5-b7f9-495a-90b7-990ca519212f-util\") pod \"02456ec5-b7f9-495a-90b7-990ca519212f\" (UID: \"02456ec5-b7f9-495a-90b7-990ca519212f\") " Mar 16 15:43:41 crc kubenswrapper[5120]: I0316 15:43:41.326170 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h5h5d\" (UniqueName: \"kubernetes.io/projected/02456ec5-b7f9-495a-90b7-990ca519212f-kube-api-access-h5h5d\") pod \"02456ec5-b7f9-495a-90b7-990ca519212f\" (UID: \"02456ec5-b7f9-495a-90b7-990ca519212f\") " Mar 16 15:43:41 crc kubenswrapper[5120]: I0316 15:43:41.327310 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02456ec5-b7f9-495a-90b7-990ca519212f-bundle" (OuterVolumeSpecName: "bundle") pod "02456ec5-b7f9-495a-90b7-990ca519212f" (UID: "02456ec5-b7f9-495a-90b7-990ca519212f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:43:41 crc kubenswrapper[5120]: I0316 15:43:41.334992 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02456ec5-b7f9-495a-90b7-990ca519212f-kube-api-access-h5h5d" (OuterVolumeSpecName: "kube-api-access-h5h5d") pod "02456ec5-b7f9-495a-90b7-990ca519212f" (UID: "02456ec5-b7f9-495a-90b7-990ca519212f"). InnerVolumeSpecName "kube-api-access-h5h5d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:43:41 crc kubenswrapper[5120]: I0316 15:43:41.337045 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02456ec5-b7f9-495a-90b7-990ca519212f-util" (OuterVolumeSpecName: "util") pod "02456ec5-b7f9-495a-90b7-990ca519212f" (UID: "02456ec5-b7f9-495a-90b7-990ca519212f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:43:41 crc kubenswrapper[5120]: I0316 15:43:41.428208 5120 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/02456ec5-b7f9-495a-90b7-990ca519212f-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:43:41 crc kubenswrapper[5120]: I0316 15:43:41.428249 5120 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/02456ec5-b7f9-495a-90b7-990ca519212f-util\") on node \"crc\" DevicePath \"\"" Mar 16 15:43:41 crc kubenswrapper[5120]: I0316 15:43:41.428262 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h5h5d\" (UniqueName: \"kubernetes.io/projected/02456ec5-b7f9-495a-90b7-990ca519212f-kube-api-access-h5h5d\") on node \"crc\" DevicePath \"\"" Mar 16 15:43:41 crc kubenswrapper[5120]: I0316 15:43:41.972066 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/d1f2cf7c6f4ecb15e69cc0ed07a53b6f169b7a9d46d563b1a9827dff83d68kn" event={"ID":"02456ec5-b7f9-495a-90b7-990ca519212f","Type":"ContainerDied","Data":"f0ce8ddbf9e3197d1d5960584605bc6d7557de4ccac5c1938fbcf494d53329d0"} Mar 16 15:43:41 crc kubenswrapper[5120]: I0316 15:43:41.972421 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f0ce8ddbf9e3197d1d5960584605bc6d7557de4ccac5c1938fbcf494d53329d0" Mar 16 15:43:41 crc kubenswrapper[5120]: I0316 15:43:41.972175 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/d1f2cf7c6f4ecb15e69cc0ed07a53b6f169b7a9d46d563b1a9827dff83d68kn" Mar 16 15:43:46 crc kubenswrapper[5120]: I0316 15:43:46.407236 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-nmstate/nmstate-operator-54b58fcbc5-4tsgg"] Mar 16 15:43:46 crc kubenswrapper[5120]: I0316 15:43:46.408039 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02456ec5-b7f9-495a-90b7-990ca519212f" containerName="pull" Mar 16 15:43:46 crc kubenswrapper[5120]: I0316 15:43:46.408052 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="02456ec5-b7f9-495a-90b7-990ca519212f" containerName="pull" Mar 16 15:43:46 crc kubenswrapper[5120]: I0316 15:43:46.408076 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02456ec5-b7f9-495a-90b7-990ca519212f" containerName="util" Mar 16 15:43:46 crc kubenswrapper[5120]: I0316 15:43:46.408083 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="02456ec5-b7f9-495a-90b7-990ca519212f" containerName="util" Mar 16 15:43:46 crc kubenswrapper[5120]: I0316 15:43:46.408100 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02456ec5-b7f9-495a-90b7-990ca519212f" containerName="extract" Mar 16 15:43:46 crc kubenswrapper[5120]: I0316 15:43:46.408106 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="02456ec5-b7f9-495a-90b7-990ca519212f" containerName="extract" Mar 16 15:43:46 crc kubenswrapper[5120]: I0316 15:43:46.408209 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="02456ec5-b7f9-495a-90b7-990ca519212f" containerName="extract" Mar 16 15:43:46 crc kubenswrapper[5120]: I0316 15:43:46.423922 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-nmstate/nmstate-operator-54b58fcbc5-4tsgg"] Mar 16 15:43:46 crc kubenswrapper[5120]: I0316 15:43:46.424064 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-nmstate/nmstate-operator-54b58fcbc5-4tsgg" Mar 16 15:43:46 crc kubenswrapper[5120]: I0316 15:43:46.428022 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-nmstate\"/\"kube-root-ca.crt\"" Mar 16 15:43:46 crc kubenswrapper[5120]: I0316 15:43:46.428256 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-nmstate\"/\"nmstate-operator-dockercfg-dktg6\"" Mar 16 15:43:46 crc kubenswrapper[5120]: I0316 15:43:46.428349 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-nmstate\"/\"openshift-service-ca.crt\"" Mar 16 15:43:46 crc kubenswrapper[5120]: I0316 15:43:46.494354 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q48k9\" (UniqueName: \"kubernetes.io/projected/39ff1970-5f12-4437-ade6-0a03e211bae8-kube-api-access-q48k9\") pod \"nmstate-operator-54b58fcbc5-4tsgg\" (UID: \"39ff1970-5f12-4437-ade6-0a03e211bae8\") " pod="openshift-nmstate/nmstate-operator-54b58fcbc5-4tsgg" Mar 16 15:43:46 crc kubenswrapper[5120]: I0316 15:43:46.595073 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q48k9\" (UniqueName: \"kubernetes.io/projected/39ff1970-5f12-4437-ade6-0a03e211bae8-kube-api-access-q48k9\") pod \"nmstate-operator-54b58fcbc5-4tsgg\" (UID: \"39ff1970-5f12-4437-ade6-0a03e211bae8\") " pod="openshift-nmstate/nmstate-operator-54b58fcbc5-4tsgg" Mar 16 15:43:46 crc kubenswrapper[5120]: I0316 15:43:46.613854 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q48k9\" (UniqueName: \"kubernetes.io/projected/39ff1970-5f12-4437-ade6-0a03e211bae8-kube-api-access-q48k9\") pod \"nmstate-operator-54b58fcbc5-4tsgg\" (UID: \"39ff1970-5f12-4437-ade6-0a03e211bae8\") " pod="openshift-nmstate/nmstate-operator-54b58fcbc5-4tsgg" Mar 16 15:43:46 crc kubenswrapper[5120]: I0316 15:43:46.743416 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-nmstate/nmstate-operator-54b58fcbc5-4tsgg" Mar 16 15:43:47 crc kubenswrapper[5120]: I0316 15:43:47.176998 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-nmstate/nmstate-operator-54b58fcbc5-4tsgg"] Mar 16 15:43:48 crc kubenswrapper[5120]: I0316 15:43:48.017369 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-nmstate/nmstate-operator-54b58fcbc5-4tsgg" event={"ID":"39ff1970-5f12-4437-ade6-0a03e211bae8","Type":"ContainerStarted","Data":"e49b10a8fd090255514566fb6f31c3cf3ce2c4e4ccbdc227141fa328e0f6c614"} Mar 16 15:43:54 crc kubenswrapper[5120]: I0316 15:43:54.053946 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-nmstate/nmstate-operator-54b58fcbc5-4tsgg" event={"ID":"39ff1970-5f12-4437-ade6-0a03e211bae8","Type":"ContainerStarted","Data":"da684ea15d313b18c03f1a25aa6df693a09fbe62633f0aff16a4f9f7e56d423b"} Mar 16 15:43:54 crc kubenswrapper[5120]: I0316 15:43:54.054476 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-nmstate/nmstate-operator-54b58fcbc5-4tsgg" Mar 16 15:43:54 crc kubenswrapper[5120]: I0316 15:43:54.072111 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-nmstate/nmstate-operator-54b58fcbc5-4tsgg" podStartSLOduration=2.079627324 podStartE2EDuration="8.072092654s" podCreationTimestamp="2026-03-16 15:43:46 +0000 UTC" firstStartedPulling="2026-03-16 15:43:47.182517027 +0000 UTC m=+729.336448684" lastFinishedPulling="2026-03-16 15:43:53.174982367 +0000 UTC m=+735.328914014" observedRunningTime="2026-03-16 15:43:54.069284395 +0000 UTC m=+736.223216052" watchObservedRunningTime="2026-03-16 15:43:54.072092654 +0000 UTC m=+736.226024311" Mar 16 15:43:56 crc kubenswrapper[5120]: I0316 15:43:56.928626 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5d9d95bf5b-rwzmk" Mar 16 15:43:56 crc kubenswrapper[5120]: I0316 15:43:56.981234 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-66587d64c8-blgcz"] Mar 16 15:44:00 crc kubenswrapper[5120]: I0316 15:44:00.124312 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-infra/auto-csr-approver-29561264-tcqkj"] Mar 16 15:44:00 crc kubenswrapper[5120]: I0316 15:44:00.179903 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561264-tcqkj"] Mar 16 15:44:00 crc kubenswrapper[5120]: I0316 15:44:00.180077 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561264-tcqkj" Mar 16 15:44:00 crc kubenswrapper[5120]: I0316 15:44:00.182582 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-infra\"/\"csr-approver-sa-dockercfg-x2nsz\"" Mar 16 15:44:00 crc kubenswrapper[5120]: I0316 15:44:00.182588 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"kube-root-ca.crt\"" Mar 16 15:44:00 crc kubenswrapper[5120]: I0316 15:44:00.183409 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"openshift-service-ca.crt\"" Mar 16 15:44:00 crc kubenswrapper[5120]: I0316 15:44:00.360815 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4txk\" (UniqueName: \"kubernetes.io/projected/730a9c0b-5439-4fe9-b8f3-9e52ffa4a6e4-kube-api-access-f4txk\") pod \"auto-csr-approver-29561264-tcqkj\" (UID: \"730a9c0b-5439-4fe9-b8f3-9e52ffa4a6e4\") " pod="openshift-infra/auto-csr-approver-29561264-tcqkj" Mar 16 15:44:00 crc kubenswrapper[5120]: I0316 15:44:00.461679 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f4txk\" (UniqueName: \"kubernetes.io/projected/730a9c0b-5439-4fe9-b8f3-9e52ffa4a6e4-kube-api-access-f4txk\") pod \"auto-csr-approver-29561264-tcqkj\" (UID: \"730a9c0b-5439-4fe9-b8f3-9e52ffa4a6e4\") " pod="openshift-infra/auto-csr-approver-29561264-tcqkj" Mar 16 15:44:00 crc kubenswrapper[5120]: I0316 15:44:00.480568 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4txk\" (UniqueName: \"kubernetes.io/projected/730a9c0b-5439-4fe9-b8f3-9e52ffa4a6e4-kube-api-access-f4txk\") pod \"auto-csr-approver-29561264-tcqkj\" (UID: \"730a9c0b-5439-4fe9-b8f3-9e52ffa4a6e4\") " pod="openshift-infra/auto-csr-approver-29561264-tcqkj" Mar 16 15:44:00 crc kubenswrapper[5120]: I0316 15:44:00.498613 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561264-tcqkj" Mar 16 15:44:00 crc kubenswrapper[5120]: I0316 15:44:00.662239 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561264-tcqkj"] Mar 16 15:44:00 crc kubenswrapper[5120]: W0316 15:44:00.671513 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod730a9c0b_5439_4fe9_b8f3_9e52ffa4a6e4.slice/crio-f4e6335048a19748ff1682ce9da2cf21c2ca395c3095b663d207c135a710bf05 WatchSource:0}: Error finding container f4e6335048a19748ff1682ce9da2cf21c2ca395c3095b663d207c135a710bf05: Status 404 returned error can't find the container with id f4e6335048a19748ff1682ce9da2cf21c2ca395c3095b663d207c135a710bf05 Mar 16 15:44:01 crc kubenswrapper[5120]: I0316 15:44:01.091587 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561264-tcqkj" event={"ID":"730a9c0b-5439-4fe9-b8f3-9e52ffa4a6e4","Type":"ContainerStarted","Data":"f4e6335048a19748ff1682ce9da2cf21c2ca395c3095b663d207c135a710bf05"} Mar 16 15:44:03 crc kubenswrapper[5120]: I0316 15:44:03.101316 5120 generic.go:358] "Generic (PLEG): container finished" podID="730a9c0b-5439-4fe9-b8f3-9e52ffa4a6e4" containerID="62ab1858e156bd97c1135e77982c71b107d9816e6aa96ef3185c7ebe3f179f36" exitCode=0 Mar 16 15:44:03 crc kubenswrapper[5120]: I0316 15:44:03.101365 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561264-tcqkj" event={"ID":"730a9c0b-5439-4fe9-b8f3-9e52ffa4a6e4","Type":"ContainerDied","Data":"62ab1858e156bd97c1135e77982c71b107d9816e6aa96ef3185c7ebe3f179f36"} Mar 16 15:44:04 crc kubenswrapper[5120]: I0316 15:44:04.306591 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561264-tcqkj" Mar 16 15:44:04 crc kubenswrapper[5120]: I0316 15:44:04.425110 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f4txk\" (UniqueName: \"kubernetes.io/projected/730a9c0b-5439-4fe9-b8f3-9e52ffa4a6e4-kube-api-access-f4txk\") pod \"730a9c0b-5439-4fe9-b8f3-9e52ffa4a6e4\" (UID: \"730a9c0b-5439-4fe9-b8f3-9e52ffa4a6e4\") " Mar 16 15:44:04 crc kubenswrapper[5120]: I0316 15:44:04.433393 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/730a9c0b-5439-4fe9-b8f3-9e52ffa4a6e4-kube-api-access-f4txk" (OuterVolumeSpecName: "kube-api-access-f4txk") pod "730a9c0b-5439-4fe9-b8f3-9e52ffa4a6e4" (UID: "730a9c0b-5439-4fe9-b8f3-9e52ffa4a6e4"). InnerVolumeSpecName "kube-api-access-f4txk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:44:04 crc kubenswrapper[5120]: I0316 15:44:04.527232 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f4txk\" (UniqueName: \"kubernetes.io/projected/730a9c0b-5439-4fe9-b8f3-9e52ffa4a6e4-kube-api-access-f4txk\") on node \"crc\" DevicePath \"\"" Mar 16 15:44:05 crc kubenswrapper[5120]: I0316 15:44:05.063029 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-nmstate/nmstate-operator-54b58fcbc5-4tsgg" Mar 16 15:44:05 crc kubenswrapper[5120]: I0316 15:44:05.113966 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561264-tcqkj" event={"ID":"730a9c0b-5439-4fe9-b8f3-9e52ffa4a6e4","Type":"ContainerDied","Data":"f4e6335048a19748ff1682ce9da2cf21c2ca395c3095b663d207c135a710bf05"} Mar 16 15:44:05 crc kubenswrapper[5120]: I0316 15:44:05.114001 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f4e6335048a19748ff1682ce9da2cf21c2ca395c3095b663d207c135a710bf05" Mar 16 15:44:05 crc kubenswrapper[5120]: I0316 15:44:05.114085 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561264-tcqkj" Mar 16 15:44:05 crc kubenswrapper[5120]: I0316 15:44:05.372439 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-infra/auto-csr-approver-29561258-hkqrm"] Mar 16 15:44:05 crc kubenswrapper[5120]: I0316 15:44:05.378722 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-infra/auto-csr-approver-29561258-hkqrm"] Mar 16 15:44:05 crc kubenswrapper[5120]: I0316 15:44:05.889927 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-nmstate/nmstate-metrics-7f888697b-h5l4s"] Mar 16 15:44:05 crc kubenswrapper[5120]: I0316 15:44:05.890672 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="730a9c0b-5439-4fe9-b8f3-9e52ffa4a6e4" containerName="oc" Mar 16 15:44:05 crc kubenswrapper[5120]: I0316 15:44:05.890688 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="730a9c0b-5439-4fe9-b8f3-9e52ffa4a6e4" containerName="oc" Mar 16 15:44:05 crc kubenswrapper[5120]: I0316 15:44:05.890796 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="730a9c0b-5439-4fe9-b8f3-9e52ffa4a6e4" containerName="oc" Mar 16 15:44:05 crc kubenswrapper[5120]: I0316 15:44:05.896895 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-nmstate/nmstate-metrics-7f888697b-h5l4s" Mar 16 15:44:05 crc kubenswrapper[5120]: I0316 15:44:05.901309 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-nmstate\"/\"nmstate-handler-dockercfg-lnnkk\"" Mar 16 15:44:05 crc kubenswrapper[5120]: I0316 15:44:05.904489 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-nmstate/nmstate-webhook-78fdd78d8b-dtt5m"] Mar 16 15:44:05 crc kubenswrapper[5120]: I0316 15:44:05.908265 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-nmstate/nmstate-webhook-78fdd78d8b-dtt5m" Mar 16 15:44:05 crc kubenswrapper[5120]: I0316 15:44:05.910356 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-nmstate/nmstate-metrics-7f888697b-h5l4s"] Mar 16 15:44:05 crc kubenswrapper[5120]: I0316 15:44:05.914186 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-nmstate\"/\"openshift-nmstate-webhook\"" Mar 16 15:44:05 crc kubenswrapper[5120]: I0316 15:44:05.915699 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-nmstate/nmstate-webhook-78fdd78d8b-dtt5m"] Mar 16 15:44:05 crc kubenswrapper[5120]: I0316 15:44:05.926185 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-nmstate/nmstate-handler-fbxhr"] Mar 16 15:44:05 crc kubenswrapper[5120]: I0316 15:44:05.932448 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-nmstate/nmstate-handler-fbxhr" Mar 16 15:44:05 crc kubenswrapper[5120]: I0316 15:44:05.945218 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-key-pair\" (UniqueName: \"kubernetes.io/secret/c0128410-82f7-48a8-80f6-a04f53ef87d0-tls-key-pair\") pod \"nmstate-webhook-78fdd78d8b-dtt5m\" (UID: \"c0128410-82f7-48a8-80f6-a04f53ef87d0\") " pod="openshift-nmstate/nmstate-webhook-78fdd78d8b-dtt5m" Mar 16 15:44:05 crc kubenswrapper[5120]: I0316 15:44:05.945286 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ks74w\" (UniqueName: \"kubernetes.io/projected/c0128410-82f7-48a8-80f6-a04f53ef87d0-kube-api-access-ks74w\") pod \"nmstate-webhook-78fdd78d8b-dtt5m\" (UID: \"c0128410-82f7-48a8-80f6-a04f53ef87d0\") " pod="openshift-nmstate/nmstate-webhook-78fdd78d8b-dtt5m" Mar 16 15:44:05 crc kubenswrapper[5120]: I0316 15:44:05.945427 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ddmh\" (UniqueName: \"kubernetes.io/projected/f79d1780-bb33-4b14-8358-9b0ab3bb485a-kube-api-access-4ddmh\") pod \"nmstate-metrics-7f888697b-h5l4s\" (UID: \"f79d1780-bb33-4b14-8358-9b0ab3bb485a\") " pod="openshift-nmstate/nmstate-metrics-7f888697b-h5l4s" Mar 16 15:44:06 crc kubenswrapper[5120]: I0316 15:44:06.002418 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-nmstate/nmstate-console-plugin-74686bb6b4-dcsrq"] Mar 16 15:44:06 crc kubenswrapper[5120]: I0316 15:44:06.009079 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-nmstate/nmstate-console-plugin-74686bb6b4-dcsrq" Mar 16 15:44:06 crc kubenswrapper[5120]: I0316 15:44:06.010298 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-nmstate/nmstate-console-plugin-74686bb6b4-dcsrq"] Mar 16 15:44:06 crc kubenswrapper[5120]: I0316 15:44:06.011241 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-nmstate\"/\"default-dockercfg-286v6\"" Mar 16 15:44:06 crc kubenswrapper[5120]: I0316 15:44:06.011522 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-nmstate\"/\"nginx-conf\"" Mar 16 15:44:06 crc kubenswrapper[5120]: I0316 15:44:06.011667 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-nmstate\"/\"plugin-serving-cert\"" Mar 16 15:44:06 crc kubenswrapper[5120]: I0316 15:44:06.046887 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-key-pair\" (UniqueName: \"kubernetes.io/secret/c0128410-82f7-48a8-80f6-a04f53ef87d0-tls-key-pair\") pod \"nmstate-webhook-78fdd78d8b-dtt5m\" (UID: \"c0128410-82f7-48a8-80f6-a04f53ef87d0\") " pod="openshift-nmstate/nmstate-webhook-78fdd78d8b-dtt5m" Mar 16 15:44:06 crc kubenswrapper[5120]: I0316 15:44:06.046938 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nmstate-lock\" (UniqueName: \"kubernetes.io/host-path/1b84482c-adc3-4ce0-9551-deb315607bae-nmstate-lock\") pod \"nmstate-handler-fbxhr\" (UID: \"1b84482c-adc3-4ce0-9551-deb315607bae\") " pod="openshift-nmstate/nmstate-handler-fbxhr" Mar 16 15:44:06 crc kubenswrapper[5120]: I0316 15:44:06.046994 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5b76933b-fb29-4e6c-ae26-c15b23d8aa69-nginx-conf\") pod \"nmstate-console-plugin-74686bb6b4-dcsrq\" (UID: \"5b76933b-fb29-4e6c-ae26-c15b23d8aa69\") " pod="openshift-nmstate/nmstate-console-plugin-74686bb6b4-dcsrq" Mar 16 15:44:06 crc kubenswrapper[5120]: I0316 15:44:06.047020 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shlnn\" (UniqueName: \"kubernetes.io/projected/1b84482c-adc3-4ce0-9551-deb315607bae-kube-api-access-shlnn\") pod \"nmstate-handler-fbxhr\" (UID: \"1b84482c-adc3-4ce0-9551-deb315607bae\") " pod="openshift-nmstate/nmstate-handler-fbxhr" Mar 16 15:44:06 crc kubenswrapper[5120]: I0316 15:44:06.047049 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ks74w\" (UniqueName: \"kubernetes.io/projected/c0128410-82f7-48a8-80f6-a04f53ef87d0-kube-api-access-ks74w\") pod \"nmstate-webhook-78fdd78d8b-dtt5m\" (UID: \"c0128410-82f7-48a8-80f6-a04f53ef87d0\") " pod="openshift-nmstate/nmstate-webhook-78fdd78d8b-dtt5m" Mar 16 15:44:06 crc kubenswrapper[5120]: I0316 15:44:06.047070 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xlq5p\" (UniqueName: \"kubernetes.io/projected/5b76933b-fb29-4e6c-ae26-c15b23d8aa69-kube-api-access-xlq5p\") pod \"nmstate-console-plugin-74686bb6b4-dcsrq\" (UID: \"5b76933b-fb29-4e6c-ae26-c15b23d8aa69\") " pod="openshift-nmstate/nmstate-console-plugin-74686bb6b4-dcsrq" Mar 16 15:44:06 crc kubenswrapper[5120]: I0316 15:44:06.047109 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovs-socket\" (UniqueName: \"kubernetes.io/host-path/1b84482c-adc3-4ce0-9551-deb315607bae-ovs-socket\") pod \"nmstate-handler-fbxhr\" (UID: \"1b84482c-adc3-4ce0-9551-deb315607bae\") " pod="openshift-nmstate/nmstate-handler-fbxhr" Mar 16 15:44:06 crc kubenswrapper[5120]: I0316 15:44:06.047129 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4ddmh\" (UniqueName: \"kubernetes.io/projected/f79d1780-bb33-4b14-8358-9b0ab3bb485a-kube-api-access-4ddmh\") pod \"nmstate-metrics-7f888697b-h5l4s\" (UID: \"f79d1780-bb33-4b14-8358-9b0ab3bb485a\") " pod="openshift-nmstate/nmstate-metrics-7f888697b-h5l4s" Mar 16 15:44:06 crc kubenswrapper[5120]: I0316 15:44:06.047152 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/5b76933b-fb29-4e6c-ae26-c15b23d8aa69-plugin-serving-cert\") pod \"nmstate-console-plugin-74686bb6b4-dcsrq\" (UID: \"5b76933b-fb29-4e6c-ae26-c15b23d8aa69\") " pod="openshift-nmstate/nmstate-console-plugin-74686bb6b4-dcsrq" Mar 16 15:44:06 crc kubenswrapper[5120]: I0316 15:44:06.047167 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus-socket\" (UniqueName: \"kubernetes.io/host-path/1b84482c-adc3-4ce0-9551-deb315607bae-dbus-socket\") pod \"nmstate-handler-fbxhr\" (UID: \"1b84482c-adc3-4ce0-9551-deb315607bae\") " pod="openshift-nmstate/nmstate-handler-fbxhr" Mar 16 15:44:06 crc kubenswrapper[5120]: E0316 15:44:06.047290 5120 secret.go:189] Couldn't get secret openshift-nmstate/openshift-nmstate-webhook: secret "openshift-nmstate-webhook" not found Mar 16 15:44:06 crc kubenswrapper[5120]: E0316 15:44:06.047340 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0128410-82f7-48a8-80f6-a04f53ef87d0-tls-key-pair podName:c0128410-82f7-48a8-80f6-a04f53ef87d0 nodeName:}" failed. No retries permitted until 2026-03-16 15:44:06.54732225 +0000 UTC m=+748.701253907 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-key-pair" (UniqueName: "kubernetes.io/secret/c0128410-82f7-48a8-80f6-a04f53ef87d0-tls-key-pair") pod "nmstate-webhook-78fdd78d8b-dtt5m" (UID: "c0128410-82f7-48a8-80f6-a04f53ef87d0") : secret "openshift-nmstate-webhook" not found Mar 16 15:44:06 crc kubenswrapper[5120]: I0316 15:44:06.081752 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ddmh\" (UniqueName: \"kubernetes.io/projected/f79d1780-bb33-4b14-8358-9b0ab3bb485a-kube-api-access-4ddmh\") pod \"nmstate-metrics-7f888697b-h5l4s\" (UID: \"f79d1780-bb33-4b14-8358-9b0ab3bb485a\") " pod="openshift-nmstate/nmstate-metrics-7f888697b-h5l4s" Mar 16 15:44:06 crc kubenswrapper[5120]: I0316 15:44:06.085890 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ks74w\" (UniqueName: \"kubernetes.io/projected/c0128410-82f7-48a8-80f6-a04f53ef87d0-kube-api-access-ks74w\") pod \"nmstate-webhook-78fdd78d8b-dtt5m\" (UID: \"c0128410-82f7-48a8-80f6-a04f53ef87d0\") " pod="openshift-nmstate/nmstate-webhook-78fdd78d8b-dtt5m" Mar 16 15:44:06 crc kubenswrapper[5120]: I0316 15:44:06.148784 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovs-socket\" (UniqueName: \"kubernetes.io/host-path/1b84482c-adc3-4ce0-9551-deb315607bae-ovs-socket\") pod \"nmstate-handler-fbxhr\" (UID: \"1b84482c-adc3-4ce0-9551-deb315607bae\") " pod="openshift-nmstate/nmstate-handler-fbxhr" Mar 16 15:44:06 crc kubenswrapper[5120]: I0316 15:44:06.148834 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/5b76933b-fb29-4e6c-ae26-c15b23d8aa69-plugin-serving-cert\") pod \"nmstate-console-plugin-74686bb6b4-dcsrq\" (UID: \"5b76933b-fb29-4e6c-ae26-c15b23d8aa69\") " pod="openshift-nmstate/nmstate-console-plugin-74686bb6b4-dcsrq" Mar 16 15:44:06 crc kubenswrapper[5120]: I0316 15:44:06.148849 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovs-socket\" (UniqueName: \"kubernetes.io/host-path/1b84482c-adc3-4ce0-9551-deb315607bae-ovs-socket\") pod \"nmstate-handler-fbxhr\" (UID: \"1b84482c-adc3-4ce0-9551-deb315607bae\") " pod="openshift-nmstate/nmstate-handler-fbxhr" Mar 16 15:44:06 crc kubenswrapper[5120]: I0316 15:44:06.148853 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus-socket\" (UniqueName: \"kubernetes.io/host-path/1b84482c-adc3-4ce0-9551-deb315607bae-dbus-socket\") pod \"nmstate-handler-fbxhr\" (UID: \"1b84482c-adc3-4ce0-9551-deb315607bae\") " pod="openshift-nmstate/nmstate-handler-fbxhr" Mar 16 15:44:06 crc kubenswrapper[5120]: I0316 15:44:06.148920 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nmstate-lock\" (UniqueName: \"kubernetes.io/host-path/1b84482c-adc3-4ce0-9551-deb315607bae-nmstate-lock\") pod \"nmstate-handler-fbxhr\" (UID: \"1b84482c-adc3-4ce0-9551-deb315607bae\") " pod="openshift-nmstate/nmstate-handler-fbxhr" Mar 16 15:44:06 crc kubenswrapper[5120]: I0316 15:44:06.148967 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5b76933b-fb29-4e6c-ae26-c15b23d8aa69-nginx-conf\") pod \"nmstate-console-plugin-74686bb6b4-dcsrq\" (UID: \"5b76933b-fb29-4e6c-ae26-c15b23d8aa69\") " pod="openshift-nmstate/nmstate-console-plugin-74686bb6b4-dcsrq" Mar 16 15:44:06 crc kubenswrapper[5120]: I0316 15:44:06.148982 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-shlnn\" (UniqueName: \"kubernetes.io/projected/1b84482c-adc3-4ce0-9551-deb315607bae-kube-api-access-shlnn\") pod \"nmstate-handler-fbxhr\" (UID: \"1b84482c-adc3-4ce0-9551-deb315607bae\") " pod="openshift-nmstate/nmstate-handler-fbxhr" Mar 16 15:44:06 crc kubenswrapper[5120]: E0316 15:44:06.149000 5120 secret.go:189] Couldn't get secret openshift-nmstate/plugin-serving-cert: secret "plugin-serving-cert" not found Mar 16 15:44:06 crc kubenswrapper[5120]: E0316 15:44:06.149064 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b76933b-fb29-4e6c-ae26-c15b23d8aa69-plugin-serving-cert podName:5b76933b-fb29-4e6c-ae26-c15b23d8aa69 nodeName:}" failed. No retries permitted until 2026-03-16 15:44:06.649050062 +0000 UTC m=+748.802981719 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/5b76933b-fb29-4e6c-ae26-c15b23d8aa69-plugin-serving-cert") pod "nmstate-console-plugin-74686bb6b4-dcsrq" (UID: "5b76933b-fb29-4e6c-ae26-c15b23d8aa69") : secret "plugin-serving-cert" not found Mar 16 15:44:06 crc kubenswrapper[5120]: I0316 15:44:06.149078 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus-socket\" (UniqueName: \"kubernetes.io/host-path/1b84482c-adc3-4ce0-9551-deb315607bae-dbus-socket\") pod \"nmstate-handler-fbxhr\" (UID: \"1b84482c-adc3-4ce0-9551-deb315607bae\") " pod="openshift-nmstate/nmstate-handler-fbxhr" Mar 16 15:44:06 crc kubenswrapper[5120]: I0316 15:44:06.149008 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xlq5p\" (UniqueName: \"kubernetes.io/projected/5b76933b-fb29-4e6c-ae26-c15b23d8aa69-kube-api-access-xlq5p\") pod \"nmstate-console-plugin-74686bb6b4-dcsrq\" (UID: \"5b76933b-fb29-4e6c-ae26-c15b23d8aa69\") " pod="openshift-nmstate/nmstate-console-plugin-74686bb6b4-dcsrq" Mar 16 15:44:06 crc kubenswrapper[5120]: I0316 15:44:06.149067 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nmstate-lock\" (UniqueName: \"kubernetes.io/host-path/1b84482c-adc3-4ce0-9551-deb315607bae-nmstate-lock\") pod \"nmstate-handler-fbxhr\" (UID: \"1b84482c-adc3-4ce0-9551-deb315607bae\") " pod="openshift-nmstate/nmstate-handler-fbxhr" Mar 16 15:44:06 crc kubenswrapper[5120]: I0316 15:44:06.150234 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5b76933b-fb29-4e6c-ae26-c15b23d8aa69-nginx-conf\") pod \"nmstate-console-plugin-74686bb6b4-dcsrq\" (UID: \"5b76933b-fb29-4e6c-ae26-c15b23d8aa69\") " pod="openshift-nmstate/nmstate-console-plugin-74686bb6b4-dcsrq" Mar 16 15:44:06 crc kubenswrapper[5120]: I0316 15:44:06.166642 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-shlnn\" (UniqueName: \"kubernetes.io/projected/1b84482c-adc3-4ce0-9551-deb315607bae-kube-api-access-shlnn\") pod \"nmstate-handler-fbxhr\" (UID: \"1b84482c-adc3-4ce0-9551-deb315607bae\") " pod="openshift-nmstate/nmstate-handler-fbxhr" Mar 16 15:44:06 crc kubenswrapper[5120]: I0316 15:44:06.169126 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xlq5p\" (UniqueName: \"kubernetes.io/projected/5b76933b-fb29-4e6c-ae26-c15b23d8aa69-kube-api-access-xlq5p\") pod \"nmstate-console-plugin-74686bb6b4-dcsrq\" (UID: \"5b76933b-fb29-4e6c-ae26-c15b23d8aa69\") " pod="openshift-nmstate/nmstate-console-plugin-74686bb6b4-dcsrq" Mar 16 15:44:06 crc kubenswrapper[5120]: I0316 15:44:06.211055 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-fc44bd858-dnfw2"] Mar 16 15:44:06 crc kubenswrapper[5120]: I0316 15:44:06.216933 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-nmstate/nmstate-metrics-7f888697b-h5l4s" Mar 16 15:44:06 crc kubenswrapper[5120]: I0316 15:44:06.222911 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-fc44bd858-dnfw2"] Mar 16 15:44:06 crc kubenswrapper[5120]: I0316 15:44:06.223060 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fc44bd858-dnfw2" Mar 16 15:44:06 crc kubenswrapper[5120]: I0316 15:44:06.250407 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7qhc\" (UniqueName: \"kubernetes.io/projected/2080f0ed-e663-4ea5-bf25-9614ff7b7c1e-kube-api-access-p7qhc\") pod \"console-fc44bd858-dnfw2\" (UID: \"2080f0ed-e663-4ea5-bf25-9614ff7b7c1e\") " pod="openshift-console/console-fc44bd858-dnfw2" Mar 16 15:44:06 crc kubenswrapper[5120]: I0316 15:44:06.251049 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2080f0ed-e663-4ea5-bf25-9614ff7b7c1e-oauth-serving-cert\") pod \"console-fc44bd858-dnfw2\" (UID: \"2080f0ed-e663-4ea5-bf25-9614ff7b7c1e\") " pod="openshift-console/console-fc44bd858-dnfw2" Mar 16 15:44:06 crc kubenswrapper[5120]: I0316 15:44:06.251129 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2080f0ed-e663-4ea5-bf25-9614ff7b7c1e-console-serving-cert\") pod \"console-fc44bd858-dnfw2\" (UID: \"2080f0ed-e663-4ea5-bf25-9614ff7b7c1e\") " pod="openshift-console/console-fc44bd858-dnfw2" Mar 16 15:44:06 crc kubenswrapper[5120]: I0316 15:44:06.251174 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2080f0ed-e663-4ea5-bf25-9614ff7b7c1e-console-config\") pod \"console-fc44bd858-dnfw2\" (UID: \"2080f0ed-e663-4ea5-bf25-9614ff7b7c1e\") " pod="openshift-console/console-fc44bd858-dnfw2" Mar 16 15:44:06 crc kubenswrapper[5120]: I0316 15:44:06.251289 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2080f0ed-e663-4ea5-bf25-9614ff7b7c1e-trusted-ca-bundle\") pod \"console-fc44bd858-dnfw2\" (UID: \"2080f0ed-e663-4ea5-bf25-9614ff7b7c1e\") " pod="openshift-console/console-fc44bd858-dnfw2" Mar 16 15:44:06 crc kubenswrapper[5120]: I0316 15:44:06.251372 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2080f0ed-e663-4ea5-bf25-9614ff7b7c1e-console-oauth-config\") pod \"console-fc44bd858-dnfw2\" (UID: \"2080f0ed-e663-4ea5-bf25-9614ff7b7c1e\") " pod="openshift-console/console-fc44bd858-dnfw2" Mar 16 15:44:06 crc kubenswrapper[5120]: I0316 15:44:06.251397 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2080f0ed-e663-4ea5-bf25-9614ff7b7c1e-service-ca\") pod \"console-fc44bd858-dnfw2\" (UID: \"2080f0ed-e663-4ea5-bf25-9614ff7b7c1e\") " pod="openshift-console/console-fc44bd858-dnfw2" Mar 16 15:44:06 crc kubenswrapper[5120]: I0316 15:44:06.257710 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-nmstate/nmstate-handler-fbxhr" Mar 16 15:44:06 crc kubenswrapper[5120]: W0316 15:44:06.274395 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b84482c_adc3_4ce0_9551_deb315607bae.slice/crio-761264c08bd85194575f15ed6ba0f180072885e6a254c02aa80954b8d547e8f2 WatchSource:0}: Error finding container 761264c08bd85194575f15ed6ba0f180072885e6a254c02aa80954b8d547e8f2: Status 404 returned error can't find the container with id 761264c08bd85194575f15ed6ba0f180072885e6a254c02aa80954b8d547e8f2 Mar 16 15:44:06 crc kubenswrapper[5120]: I0316 15:44:06.352714 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2080f0ed-e663-4ea5-bf25-9614ff7b7c1e-oauth-serving-cert\") pod \"console-fc44bd858-dnfw2\" (UID: \"2080f0ed-e663-4ea5-bf25-9614ff7b7c1e\") " pod="openshift-console/console-fc44bd858-dnfw2" Mar 16 15:44:06 crc kubenswrapper[5120]: I0316 15:44:06.353045 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2080f0ed-e663-4ea5-bf25-9614ff7b7c1e-console-serving-cert\") pod \"console-fc44bd858-dnfw2\" (UID: \"2080f0ed-e663-4ea5-bf25-9614ff7b7c1e\") " pod="openshift-console/console-fc44bd858-dnfw2" Mar 16 15:44:06 crc kubenswrapper[5120]: I0316 15:44:06.353063 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2080f0ed-e663-4ea5-bf25-9614ff7b7c1e-console-config\") pod \"console-fc44bd858-dnfw2\" (UID: \"2080f0ed-e663-4ea5-bf25-9614ff7b7c1e\") " pod="openshift-console/console-fc44bd858-dnfw2" Mar 16 15:44:06 crc kubenswrapper[5120]: I0316 15:44:06.353081 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2080f0ed-e663-4ea5-bf25-9614ff7b7c1e-trusted-ca-bundle\") pod \"console-fc44bd858-dnfw2\" (UID: \"2080f0ed-e663-4ea5-bf25-9614ff7b7c1e\") " pod="openshift-console/console-fc44bd858-dnfw2" Mar 16 15:44:06 crc kubenswrapper[5120]: I0316 15:44:06.353112 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2080f0ed-e663-4ea5-bf25-9614ff7b7c1e-console-oauth-config\") pod \"console-fc44bd858-dnfw2\" (UID: \"2080f0ed-e663-4ea5-bf25-9614ff7b7c1e\") " pod="openshift-console/console-fc44bd858-dnfw2" Mar 16 15:44:06 crc kubenswrapper[5120]: I0316 15:44:06.353127 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2080f0ed-e663-4ea5-bf25-9614ff7b7c1e-service-ca\") pod \"console-fc44bd858-dnfw2\" (UID: \"2080f0ed-e663-4ea5-bf25-9614ff7b7c1e\") " pod="openshift-console/console-fc44bd858-dnfw2" Mar 16 15:44:06 crc kubenswrapper[5120]: I0316 15:44:06.353174 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p7qhc\" (UniqueName: \"kubernetes.io/projected/2080f0ed-e663-4ea5-bf25-9614ff7b7c1e-kube-api-access-p7qhc\") pod \"console-fc44bd858-dnfw2\" (UID: \"2080f0ed-e663-4ea5-bf25-9614ff7b7c1e\") " pod="openshift-console/console-fc44bd858-dnfw2" Mar 16 15:44:06 crc kubenswrapper[5120]: I0316 15:44:06.354288 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2080f0ed-e663-4ea5-bf25-9614ff7b7c1e-console-config\") pod \"console-fc44bd858-dnfw2\" (UID: \"2080f0ed-e663-4ea5-bf25-9614ff7b7c1e\") " pod="openshift-console/console-fc44bd858-dnfw2" Mar 16 15:44:06 crc kubenswrapper[5120]: I0316 15:44:06.354319 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2080f0ed-e663-4ea5-bf25-9614ff7b7c1e-service-ca\") pod \"console-fc44bd858-dnfw2\" (UID: \"2080f0ed-e663-4ea5-bf25-9614ff7b7c1e\") " pod="openshift-console/console-fc44bd858-dnfw2" Mar 16 15:44:06 crc kubenswrapper[5120]: I0316 15:44:06.355200 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2080f0ed-e663-4ea5-bf25-9614ff7b7c1e-trusted-ca-bundle\") pod \"console-fc44bd858-dnfw2\" (UID: \"2080f0ed-e663-4ea5-bf25-9614ff7b7c1e\") " pod="openshift-console/console-fc44bd858-dnfw2" Mar 16 15:44:06 crc kubenswrapper[5120]: I0316 15:44:06.355272 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2080f0ed-e663-4ea5-bf25-9614ff7b7c1e-oauth-serving-cert\") pod \"console-fc44bd858-dnfw2\" (UID: \"2080f0ed-e663-4ea5-bf25-9614ff7b7c1e\") " pod="openshift-console/console-fc44bd858-dnfw2" Mar 16 15:44:06 crc kubenswrapper[5120]: I0316 15:44:06.358864 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2080f0ed-e663-4ea5-bf25-9614ff7b7c1e-console-serving-cert\") pod \"console-fc44bd858-dnfw2\" (UID: \"2080f0ed-e663-4ea5-bf25-9614ff7b7c1e\") " pod="openshift-console/console-fc44bd858-dnfw2" Mar 16 15:44:06 crc kubenswrapper[5120]: I0316 15:44:06.359231 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2080f0ed-e663-4ea5-bf25-9614ff7b7c1e-console-oauth-config\") pod \"console-fc44bd858-dnfw2\" (UID: \"2080f0ed-e663-4ea5-bf25-9614ff7b7c1e\") " pod="openshift-console/console-fc44bd858-dnfw2" Mar 16 15:44:06 crc kubenswrapper[5120]: I0316 15:44:06.369073 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7qhc\" (UniqueName: \"kubernetes.io/projected/2080f0ed-e663-4ea5-bf25-9614ff7b7c1e-kube-api-access-p7qhc\") pod \"console-fc44bd858-dnfw2\" (UID: \"2080f0ed-e663-4ea5-bf25-9614ff7b7c1e\") " pod="openshift-console/console-fc44bd858-dnfw2" Mar 16 15:44:06 crc kubenswrapper[5120]: I0316 15:44:06.415487 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-nmstate/nmstate-metrics-7f888697b-h5l4s"] Mar 16 15:44:06 crc kubenswrapper[5120]: W0316 15:44:06.418882 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf79d1780_bb33_4b14_8358_9b0ab3bb485a.slice/crio-8e215cbd83304c0d8572363fff39b278d90bc937c115a762f57001c76e97882f WatchSource:0}: Error finding container 8e215cbd83304c0d8572363fff39b278d90bc937c115a762f57001c76e97882f: Status 404 returned error can't find the container with id 8e215cbd83304c0d8572363fff39b278d90bc937c115a762f57001c76e97882f Mar 16 15:44:06 crc kubenswrapper[5120]: I0316 15:44:06.555871 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-key-pair\" (UniqueName: \"kubernetes.io/secret/c0128410-82f7-48a8-80f6-a04f53ef87d0-tls-key-pair\") pod \"nmstate-webhook-78fdd78d8b-dtt5m\" (UID: \"c0128410-82f7-48a8-80f6-a04f53ef87d0\") " pod="openshift-nmstate/nmstate-webhook-78fdd78d8b-dtt5m" Mar 16 15:44:06 crc kubenswrapper[5120]: I0316 15:44:06.560611 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fc44bd858-dnfw2" Mar 16 15:44:06 crc kubenswrapper[5120]: I0316 15:44:06.561735 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-key-pair\" (UniqueName: \"kubernetes.io/secret/c0128410-82f7-48a8-80f6-a04f53ef87d0-tls-key-pair\") pod \"nmstate-webhook-78fdd78d8b-dtt5m\" (UID: \"c0128410-82f7-48a8-80f6-a04f53ef87d0\") " pod="openshift-nmstate/nmstate-webhook-78fdd78d8b-dtt5m" Mar 16 15:44:06 crc kubenswrapper[5120]: I0316 15:44:06.656637 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/5b76933b-fb29-4e6c-ae26-c15b23d8aa69-plugin-serving-cert\") pod \"nmstate-console-plugin-74686bb6b4-dcsrq\" (UID: \"5b76933b-fb29-4e6c-ae26-c15b23d8aa69\") " pod="openshift-nmstate/nmstate-console-plugin-74686bb6b4-dcsrq" Mar 16 15:44:06 crc kubenswrapper[5120]: I0316 15:44:06.664724 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/5b76933b-fb29-4e6c-ae26-c15b23d8aa69-plugin-serving-cert\") pod \"nmstate-console-plugin-74686bb6b4-dcsrq\" (UID: \"5b76933b-fb29-4e6c-ae26-c15b23d8aa69\") " pod="openshift-nmstate/nmstate-console-plugin-74686bb6b4-dcsrq" Mar 16 15:44:06 crc kubenswrapper[5120]: I0316 15:44:06.675633 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7b49055e-b7d0-4b5c-86c7-e975d1f4f348" path="/var/lib/kubelet/pods/7b49055e-b7d0-4b5c-86c7-e975d1f4f348/volumes" Mar 16 15:44:06 crc kubenswrapper[5120]: I0316 15:44:06.774366 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-fc44bd858-dnfw2"] Mar 16 15:44:06 crc kubenswrapper[5120]: W0316 15:44:06.778434 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2080f0ed_e663_4ea5_bf25_9614ff7b7c1e.slice/crio-d048c1a529285c36940a7c312ddd708a66bbf4cfbba239d94d25343d28e9c868 WatchSource:0}: Error finding container d048c1a529285c36940a7c312ddd708a66bbf4cfbba239d94d25343d28e9c868: Status 404 returned error can't find the container with id d048c1a529285c36940a7c312ddd708a66bbf4cfbba239d94d25343d28e9c868 Mar 16 15:44:06 crc kubenswrapper[5120]: I0316 15:44:06.834946 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-nmstate/nmstate-webhook-78fdd78d8b-dtt5m" Mar 16 15:44:06 crc kubenswrapper[5120]: I0316 15:44:06.926341 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-nmstate/nmstate-console-plugin-74686bb6b4-dcsrq" Mar 16 15:44:07 crc kubenswrapper[5120]: I0316 15:44:07.038536 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-nmstate/nmstate-webhook-78fdd78d8b-dtt5m"] Mar 16 15:44:07 crc kubenswrapper[5120]: W0316 15:44:07.041954 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0128410_82f7_48a8_80f6_a04f53ef87d0.slice/crio-cedaecdc8560df9cc44b4d6e38ba321d291374580dbf32a867927f8da1aa385c WatchSource:0}: Error finding container cedaecdc8560df9cc44b4d6e38ba321d291374580dbf32a867927f8da1aa385c: Status 404 returned error can't find the container with id cedaecdc8560df9cc44b4d6e38ba321d291374580dbf32a867927f8da1aa385c Mar 16 15:44:07 crc kubenswrapper[5120]: I0316 15:44:07.123103 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-nmstate/nmstate-console-plugin-74686bb6b4-dcsrq"] Mar 16 15:44:07 crc kubenswrapper[5120]: I0316 15:44:07.125779 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-nmstate/nmstate-metrics-7f888697b-h5l4s" event={"ID":"f79d1780-bb33-4b14-8358-9b0ab3bb485a","Type":"ContainerStarted","Data":"8e215cbd83304c0d8572363fff39b278d90bc937c115a762f57001c76e97882f"} Mar 16 15:44:07 crc kubenswrapper[5120]: I0316 15:44:07.127980 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-nmstate/nmstate-webhook-78fdd78d8b-dtt5m" event={"ID":"c0128410-82f7-48a8-80f6-a04f53ef87d0","Type":"ContainerStarted","Data":"cedaecdc8560df9cc44b4d6e38ba321d291374580dbf32a867927f8da1aa385c"} Mar 16 15:44:07 crc kubenswrapper[5120]: I0316 15:44:07.129302 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-nmstate/nmstate-handler-fbxhr" event={"ID":"1b84482c-adc3-4ce0-9551-deb315607bae","Type":"ContainerStarted","Data":"761264c08bd85194575f15ed6ba0f180072885e6a254c02aa80954b8d547e8f2"} Mar 16 15:44:07 crc kubenswrapper[5120]: W0316 15:44:07.130051 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b76933b_fb29_4e6c_ae26_c15b23d8aa69.slice/crio-7c68d2d9ddc1b97fb64982472f6f532e0917a3df76503ab652986c0f31702570 WatchSource:0}: Error finding container 7c68d2d9ddc1b97fb64982472f6f532e0917a3df76503ab652986c0f31702570: Status 404 returned error can't find the container with id 7c68d2d9ddc1b97fb64982472f6f532e0917a3df76503ab652986c0f31702570 Mar 16 15:44:07 crc kubenswrapper[5120]: I0316 15:44:07.130534 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fc44bd858-dnfw2" event={"ID":"2080f0ed-e663-4ea5-bf25-9614ff7b7c1e","Type":"ContainerStarted","Data":"bd8e6a60c6e6a71d9e52ee3d2a172bfb0ba26834f38cf8bb7b1812facd357c50"} Mar 16 15:44:07 crc kubenswrapper[5120]: I0316 15:44:07.130558 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fc44bd858-dnfw2" event={"ID":"2080f0ed-e663-4ea5-bf25-9614ff7b7c1e","Type":"ContainerStarted","Data":"d048c1a529285c36940a7c312ddd708a66bbf4cfbba239d94d25343d28e9c868"} Mar 16 15:44:07 crc kubenswrapper[5120]: I0316 15:44:07.158935 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-fc44bd858-dnfw2" podStartSLOduration=1.158913514 podStartE2EDuration="1.158913514s" podCreationTimestamp="2026-03-16 15:44:06 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:44:07.158525252 +0000 UTC m=+749.312456909" watchObservedRunningTime="2026-03-16 15:44:07.158913514 +0000 UTC m=+749.312845181" Mar 16 15:44:08 crc kubenswrapper[5120]: I0316 15:44:08.137127 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-nmstate/nmstate-console-plugin-74686bb6b4-dcsrq" event={"ID":"5b76933b-fb29-4e6c-ae26-c15b23d8aa69","Type":"ContainerStarted","Data":"7c68d2d9ddc1b97fb64982472f6f532e0917a3df76503ab652986c0f31702570"} Mar 16 15:44:11 crc kubenswrapper[5120]: I0316 15:44:11.161793 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-nmstate/nmstate-handler-fbxhr" event={"ID":"1b84482c-adc3-4ce0-9551-deb315607bae","Type":"ContainerStarted","Data":"d20d8efee28a5cd6b44262c18447059ed533d7c11accca50504e1f2cc52a7dcc"} Mar 16 15:44:11 crc kubenswrapper[5120]: I0316 15:44:11.164280 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-nmstate/nmstate-metrics-7f888697b-h5l4s" event={"ID":"f79d1780-bb33-4b14-8358-9b0ab3bb485a","Type":"ContainerStarted","Data":"606a303a076b8c953a65e3071260818df7b081b875b21705706b27850121fd24"} Mar 16 15:44:11 crc kubenswrapper[5120]: I0316 15:44:11.165746 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-nmstate/nmstate-webhook-78fdd78d8b-dtt5m" event={"ID":"c0128410-82f7-48a8-80f6-a04f53ef87d0","Type":"ContainerStarted","Data":"1013ed604f9be9c2e411270549464715e6af7e221f955a048a2000e387ee8f9d"} Mar 16 15:44:11 crc kubenswrapper[5120]: I0316 15:44:11.169416 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-nmstate/nmstate-handler-fbxhr" Mar 16 15:44:11 crc kubenswrapper[5120]: I0316 15:44:11.169482 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-nmstate/nmstate-webhook-78fdd78d8b-dtt5m" Mar 16 15:44:11 crc kubenswrapper[5120]: I0316 15:44:11.189069 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-nmstate/nmstate-webhook-78fdd78d8b-dtt5m" podStartSLOduration=3.120462409 podStartE2EDuration="6.189046493s" podCreationTimestamp="2026-03-16 15:44:05 +0000 UTC" firstStartedPulling="2026-03-16 15:44:07.04479469 +0000 UTC m=+749.198726347" lastFinishedPulling="2026-03-16 15:44:10.113378754 +0000 UTC m=+752.267310431" observedRunningTime="2026-03-16 15:44:11.186271784 +0000 UTC m=+753.340203461" watchObservedRunningTime="2026-03-16 15:44:11.189046493 +0000 UTC m=+753.342978150" Mar 16 15:44:11 crc kubenswrapper[5120]: I0316 15:44:11.207084 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-nmstate/nmstate-handler-fbxhr" podStartSLOduration=2.366247339 podStartE2EDuration="6.207065052s" podCreationTimestamp="2026-03-16 15:44:05 +0000 UTC" firstStartedPulling="2026-03-16 15:44:06.277422458 +0000 UTC m=+748.431354105" lastFinishedPulling="2026-03-16 15:44:10.118240161 +0000 UTC m=+752.272171818" observedRunningTime="2026-03-16 15:44:11.201489024 +0000 UTC m=+753.355420681" watchObservedRunningTime="2026-03-16 15:44:11.207065052 +0000 UTC m=+753.360996709" Mar 16 15:44:12 crc kubenswrapper[5120]: I0316 15:44:12.176045 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-nmstate/nmstate-console-plugin-74686bb6b4-dcsrq" event={"ID":"5b76933b-fb29-4e6c-ae26-c15b23d8aa69","Type":"ContainerStarted","Data":"8606f79f99861ff0d318f113f38c5ad1e5734941e38921a8a4851d9042517204"} Mar 16 15:44:12 crc kubenswrapper[5120]: I0316 15:44:12.176465 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-nmstate/nmstate-console-plugin-74686bb6b4-dcsrq" Mar 16 15:44:12 crc kubenswrapper[5120]: I0316 15:44:12.194837 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-nmstate/nmstate-console-plugin-74686bb6b4-dcsrq" podStartSLOduration=3.189645633 podStartE2EDuration="7.194817358s" podCreationTimestamp="2026-03-16 15:44:05 +0000 UTC" firstStartedPulling="2026-03-16 15:44:07.132044764 +0000 UTC m=+749.285976411" lastFinishedPulling="2026-03-16 15:44:11.137216479 +0000 UTC m=+753.291148136" observedRunningTime="2026-03-16 15:44:12.193524081 +0000 UTC m=+754.347455818" watchObservedRunningTime="2026-03-16 15:44:12.194817358 +0000 UTC m=+754.348749035" Mar 16 15:44:14 crc kubenswrapper[5120]: I0316 15:44:14.190398 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-nmstate/nmstate-metrics-7f888697b-h5l4s" event={"ID":"f79d1780-bb33-4b14-8358-9b0ab3bb485a","Type":"ContainerStarted","Data":"1527025d417509c71cf8560aec2b9e16b8a26f5ebf4f9693b95cfa2a902bc599"} Mar 16 15:44:14 crc kubenswrapper[5120]: I0316 15:44:14.216312 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-nmstate/nmstate-metrics-7f888697b-h5l4s" podStartSLOduration=2.308194641 podStartE2EDuration="9.216284319s" podCreationTimestamp="2026-03-16 15:44:05 +0000 UTC" firstStartedPulling="2026-03-16 15:44:06.421071986 +0000 UTC m=+748.575003643" lastFinishedPulling="2026-03-16 15:44:13.329161644 +0000 UTC m=+755.483093321" observedRunningTime="2026-03-16 15:44:14.212577693 +0000 UTC m=+756.366509370" watchObservedRunningTime="2026-03-16 15:44:14.216284319 +0000 UTC m=+756.370216016" Mar 16 15:44:15 crc kubenswrapper[5120]: I0316 15:44:15.198856 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-nmstate/nmstate-metrics-7f888697b-h5l4s" Mar 16 15:44:16 crc kubenswrapper[5120]: I0316 15:44:16.562021 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-fc44bd858-dnfw2" Mar 16 15:44:16 crc kubenswrapper[5120]: I0316 15:44:16.562101 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-fc44bd858-dnfw2" Mar 16 15:44:16 crc kubenswrapper[5120]: I0316 15:44:16.569705 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-fc44bd858-dnfw2" Mar 16 15:44:16 crc kubenswrapper[5120]: I0316 15:44:16.610896 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/community-operators-vvblr"] Mar 16 15:44:16 crc kubenswrapper[5120]: I0316 15:44:16.622717 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-vvblr" Mar 16 15:44:16 crc kubenswrapper[5120]: I0316 15:44:16.627947 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/community-operators-vvblr"] Mar 16 15:44:16 crc kubenswrapper[5120]: I0316 15:44:16.710106 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/6abb18b0-ec8b-4e9d-bc3f-4f313f7d2fe8-utilities\") pod \"community-operators-vvblr\" (UID: \"6abb18b0-ec8b-4e9d-bc3f-4f313f7d2fe8\") " pod="openshift-marketplace/community-operators-vvblr" Mar 16 15:44:16 crc kubenswrapper[5120]: I0316 15:44:16.710176 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/6abb18b0-ec8b-4e9d-bc3f-4f313f7d2fe8-catalog-content\") pod \"community-operators-vvblr\" (UID: \"6abb18b0-ec8b-4e9d-bc3f-4f313f7d2fe8\") " pod="openshift-marketplace/community-operators-vvblr" Mar 16 15:44:16 crc kubenswrapper[5120]: I0316 15:44:16.711115 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6q7h\" (UniqueName: \"kubernetes.io/projected/6abb18b0-ec8b-4e9d-bc3f-4f313f7d2fe8-kube-api-access-j6q7h\") pod \"community-operators-vvblr\" (UID: \"6abb18b0-ec8b-4e9d-bc3f-4f313f7d2fe8\") " pod="openshift-marketplace/community-operators-vvblr" Mar 16 15:44:16 crc kubenswrapper[5120]: I0316 15:44:16.814666 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j6q7h\" (UniqueName: \"kubernetes.io/projected/6abb18b0-ec8b-4e9d-bc3f-4f313f7d2fe8-kube-api-access-j6q7h\") pod \"community-operators-vvblr\" (UID: \"6abb18b0-ec8b-4e9d-bc3f-4f313f7d2fe8\") " pod="openshift-marketplace/community-operators-vvblr" Mar 16 15:44:16 crc kubenswrapper[5120]: I0316 15:44:16.815044 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/6abb18b0-ec8b-4e9d-bc3f-4f313f7d2fe8-utilities\") pod \"community-operators-vvblr\" (UID: \"6abb18b0-ec8b-4e9d-bc3f-4f313f7d2fe8\") " pod="openshift-marketplace/community-operators-vvblr" Mar 16 15:44:16 crc kubenswrapper[5120]: I0316 15:44:16.815134 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/6abb18b0-ec8b-4e9d-bc3f-4f313f7d2fe8-catalog-content\") pod \"community-operators-vvblr\" (UID: \"6abb18b0-ec8b-4e9d-bc3f-4f313f7d2fe8\") " pod="openshift-marketplace/community-operators-vvblr" Mar 16 15:44:16 crc kubenswrapper[5120]: I0316 15:44:16.815617 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/6abb18b0-ec8b-4e9d-bc3f-4f313f7d2fe8-utilities\") pod \"community-operators-vvblr\" (UID: \"6abb18b0-ec8b-4e9d-bc3f-4f313f7d2fe8\") " pod="openshift-marketplace/community-operators-vvblr" Mar 16 15:44:16 crc kubenswrapper[5120]: I0316 15:44:16.815656 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/6abb18b0-ec8b-4e9d-bc3f-4f313f7d2fe8-catalog-content\") pod \"community-operators-vvblr\" (UID: \"6abb18b0-ec8b-4e9d-bc3f-4f313f7d2fe8\") " pod="openshift-marketplace/community-operators-vvblr" Mar 16 15:44:16 crc kubenswrapper[5120]: I0316 15:44:16.837736 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6q7h\" (UniqueName: \"kubernetes.io/projected/6abb18b0-ec8b-4e9d-bc3f-4f313f7d2fe8-kube-api-access-j6q7h\") pod \"community-operators-vvblr\" (UID: \"6abb18b0-ec8b-4e9d-bc3f-4f313f7d2fe8\") " pod="openshift-marketplace/community-operators-vvblr" Mar 16 15:44:16 crc kubenswrapper[5120]: I0316 15:44:16.946930 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-vvblr" Mar 16 15:44:17 crc kubenswrapper[5120]: I0316 15:44:17.207609 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/community-operators-vvblr"] Mar 16 15:44:17 crc kubenswrapper[5120]: I0316 15:44:17.208704 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-nmstate/nmstate-handler-fbxhr" Mar 16 15:44:17 crc kubenswrapper[5120]: I0316 15:44:17.223250 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-fc44bd858-dnfw2" Mar 16 15:44:17 crc kubenswrapper[5120]: I0316 15:44:17.298427 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-64d44f6ddf-4pm87"] Mar 16 15:44:18 crc kubenswrapper[5120]: I0316 15:44:18.222801 5120 generic.go:358] "Generic (PLEG): container finished" podID="6abb18b0-ec8b-4e9d-bc3f-4f313f7d2fe8" containerID="f7a76dd426b3664db0bb09e12d22da85aec583237953c41a04f284384f27a4f5" exitCode=0 Mar 16 15:44:18 crc kubenswrapper[5120]: I0316 15:44:18.223274 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-vvblr" event={"ID":"6abb18b0-ec8b-4e9d-bc3f-4f313f7d2fe8","Type":"ContainerDied","Data":"f7a76dd426b3664db0bb09e12d22da85aec583237953c41a04f284384f27a4f5"} Mar 16 15:44:18 crc kubenswrapper[5120]: I0316 15:44:18.223336 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-vvblr" event={"ID":"6abb18b0-ec8b-4e9d-bc3f-4f313f7d2fe8","Type":"ContainerStarted","Data":"221920ad3025f7c7b00de67ae25c2bb620923f4c82a74ab5ddec3bc9a16b82b1"} Mar 16 15:44:19 crc kubenswrapper[5120]: I0316 15:44:19.231691 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-vvblr" event={"ID":"6abb18b0-ec8b-4e9d-bc3f-4f313f7d2fe8","Type":"ContainerStarted","Data":"da5ee10c854854eb4589fd5ca46ef0fabe1e28893f961922218b601e82116953"} Mar 16 15:44:20 crc kubenswrapper[5120]: I0316 15:44:20.244460 5120 generic.go:358] "Generic (PLEG): container finished" podID="6abb18b0-ec8b-4e9d-bc3f-4f313f7d2fe8" containerID="da5ee10c854854eb4589fd5ca46ef0fabe1e28893f961922218b601e82116953" exitCode=0 Mar 16 15:44:20 crc kubenswrapper[5120]: I0316 15:44:20.244542 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-vvblr" event={"ID":"6abb18b0-ec8b-4e9d-bc3f-4f313f7d2fe8","Type":"ContainerDied","Data":"da5ee10c854854eb4589fd5ca46ef0fabe1e28893f961922218b601e82116953"} Mar 16 15:44:21 crc kubenswrapper[5120]: I0316 15:44:21.254471 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-vvblr" event={"ID":"6abb18b0-ec8b-4e9d-bc3f-4f313f7d2fe8","Type":"ContainerStarted","Data":"956aa4aab1acfd4e4c59482485b0feb20eed76c7d547167694d8acb91dffb861"} Mar 16 15:44:21 crc kubenswrapper[5120]: I0316 15:44:21.271313 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/community-operators-vvblr" podStartSLOduration=4.537401781 podStartE2EDuration="5.271292077s" podCreationTimestamp="2026-03-16 15:44:16 +0000 UTC" firstStartedPulling="2026-03-16 15:44:18.225721294 +0000 UTC m=+760.379652981" lastFinishedPulling="2026-03-16 15:44:18.95961161 +0000 UTC m=+761.113543277" observedRunningTime="2026-03-16 15:44:21.269264609 +0000 UTC m=+763.423196276" watchObservedRunningTime="2026-03-16 15:44:21.271292077 +0000 UTC m=+763.425223734" Mar 16 15:44:22 crc kubenswrapper[5120]: I0316 15:44:22.008153 5120 patch_prober.go:28] interesting pod/machine-config-daemon-7bf76 container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 15:44:22 crc kubenswrapper[5120]: I0316 15:44:22.008244 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 15:44:22 crc kubenswrapper[5120]: I0316 15:44:22.033220 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-image-registry/image-registry-66587d64c8-blgcz" podUID="6528b019-774e-4298-abe6-69f062f0a13e" containerName="registry" containerID="cri-o://6d07bbca2cddcefa55f8046e3397dea658e5b5b01d6b9aecf7123fce038b5a2f" gracePeriod=30 Mar 16 15:44:22 crc kubenswrapper[5120]: I0316 15:44:22.185307 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-nmstate/nmstate-webhook-78fdd78d8b-dtt5m" Mar 16 15:44:22 crc kubenswrapper[5120]: I0316 15:44:22.264546 5120 generic.go:358] "Generic (PLEG): container finished" podID="6528b019-774e-4298-abe6-69f062f0a13e" containerID="6d07bbca2cddcefa55f8046e3397dea658e5b5b01d6b9aecf7123fce038b5a2f" exitCode=0 Mar 16 15:44:22 crc kubenswrapper[5120]: I0316 15:44:22.264936 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-66587d64c8-blgcz" event={"ID":"6528b019-774e-4298-abe6-69f062f0a13e","Type":"ContainerDied","Data":"6d07bbca2cddcefa55f8046e3397dea658e5b5b01d6b9aecf7123fce038b5a2f"} Mar 16 15:44:22 crc kubenswrapper[5120]: I0316 15:44:22.394843 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-66587d64c8-blgcz" Mar 16 15:44:22 crc kubenswrapper[5120]: I0316 15:44:22.497697 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6528b019-774e-4298-abe6-69f062f0a13e-trusted-ca\") pod \"6528b019-774e-4298-abe6-69f062f0a13e\" (UID: \"6528b019-774e-4298-abe6-69f062f0a13e\") " Mar 16 15:44:22 crc kubenswrapper[5120]: I0316 15:44:22.499006 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6528b019-774e-4298-abe6-69f062f0a13e-registry-tls\") pod \"6528b019-774e-4298-abe6-69f062f0a13e\" (UID: \"6528b019-774e-4298-abe6-69f062f0a13e\") " Mar 16 15:44:22 crc kubenswrapper[5120]: I0316 15:44:22.499126 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6528b019-774e-4298-abe6-69f062f0a13e-ca-trust-extracted\") pod \"6528b019-774e-4298-abe6-69f062f0a13e\" (UID: \"6528b019-774e-4298-abe6-69f062f0a13e\") " Mar 16 15:44:22 crc kubenswrapper[5120]: I0316 15:44:22.499253 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-storage\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"6528b019-774e-4298-abe6-69f062f0a13e\" (UID: \"6528b019-774e-4298-abe6-69f062f0a13e\") " Mar 16 15:44:22 crc kubenswrapper[5120]: I0316 15:44:22.499287 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dltk8\" (UniqueName: \"kubernetes.io/projected/6528b019-774e-4298-abe6-69f062f0a13e-kube-api-access-dltk8\") pod \"6528b019-774e-4298-abe6-69f062f0a13e\" (UID: \"6528b019-774e-4298-abe6-69f062f0a13e\") " Mar 16 15:44:22 crc kubenswrapper[5120]: I0316 15:44:22.499327 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6528b019-774e-4298-abe6-69f062f0a13e-bound-sa-token\") pod \"6528b019-774e-4298-abe6-69f062f0a13e\" (UID: \"6528b019-774e-4298-abe6-69f062f0a13e\") " Mar 16 15:44:22 crc kubenswrapper[5120]: I0316 15:44:22.499367 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6528b019-774e-4298-abe6-69f062f0a13e-registry-certificates\") pod \"6528b019-774e-4298-abe6-69f062f0a13e\" (UID: \"6528b019-774e-4298-abe6-69f062f0a13e\") " Mar 16 15:44:22 crc kubenswrapper[5120]: I0316 15:44:22.499478 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6528b019-774e-4298-abe6-69f062f0a13e-installation-pull-secrets\") pod \"6528b019-774e-4298-abe6-69f062f0a13e\" (UID: \"6528b019-774e-4298-abe6-69f062f0a13e\") " Mar 16 15:44:22 crc kubenswrapper[5120]: I0316 15:44:22.499861 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6528b019-774e-4298-abe6-69f062f0a13e-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "6528b019-774e-4298-abe6-69f062f0a13e" (UID: "6528b019-774e-4298-abe6-69f062f0a13e"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:44:22 crc kubenswrapper[5120]: I0316 15:44:22.500631 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6528b019-774e-4298-abe6-69f062f0a13e-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "6528b019-774e-4298-abe6-69f062f0a13e" (UID: "6528b019-774e-4298-abe6-69f062f0a13e"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:44:22 crc kubenswrapper[5120]: I0316 15:44:22.505757 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6528b019-774e-4298-abe6-69f062f0a13e-kube-api-access-dltk8" (OuterVolumeSpecName: "kube-api-access-dltk8") pod "6528b019-774e-4298-abe6-69f062f0a13e" (UID: "6528b019-774e-4298-abe6-69f062f0a13e"). InnerVolumeSpecName "kube-api-access-dltk8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:44:22 crc kubenswrapper[5120]: I0316 15:44:22.507232 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6528b019-774e-4298-abe6-69f062f0a13e-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "6528b019-774e-4298-abe6-69f062f0a13e" (UID: "6528b019-774e-4298-abe6-69f062f0a13e"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:44:22 crc kubenswrapper[5120]: I0316 15:44:22.507832 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6528b019-774e-4298-abe6-69f062f0a13e-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "6528b019-774e-4298-abe6-69f062f0a13e" (UID: "6528b019-774e-4298-abe6-69f062f0a13e"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:44:22 crc kubenswrapper[5120]: I0316 15:44:22.512038 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6528b019-774e-4298-abe6-69f062f0a13e-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "6528b019-774e-4298-abe6-69f062f0a13e" (UID: "6528b019-774e-4298-abe6-69f062f0a13e"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:44:22 crc kubenswrapper[5120]: I0316 15:44:22.519013 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6528b019-774e-4298-abe6-69f062f0a13e-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "6528b019-774e-4298-abe6-69f062f0a13e" (UID: "6528b019-774e-4298-abe6-69f062f0a13e"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:44:22 crc kubenswrapper[5120]: I0316 15:44:22.521668 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (OuterVolumeSpecName: "registry-storage") pod "6528b019-774e-4298-abe6-69f062f0a13e" (UID: "6528b019-774e-4298-abe6-69f062f0a13e"). InnerVolumeSpecName "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2". PluginName "kubernetes.io/csi", VolumeGIDValue "" Mar 16 15:44:22 crc kubenswrapper[5120]: I0316 15:44:22.600804 5120 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6528b019-774e-4298-abe6-69f062f0a13e-registry-certificates\") on node \"crc\" DevicePath \"\"" Mar 16 15:44:22 crc kubenswrapper[5120]: I0316 15:44:22.600837 5120 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6528b019-774e-4298-abe6-69f062f0a13e-installation-pull-secrets\") on node \"crc\" DevicePath \"\"" Mar 16 15:44:22 crc kubenswrapper[5120]: I0316 15:44:22.600847 5120 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6528b019-774e-4298-abe6-69f062f0a13e-trusted-ca\") on node \"crc\" DevicePath \"\"" Mar 16 15:44:22 crc kubenswrapper[5120]: I0316 15:44:22.600855 5120 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6528b019-774e-4298-abe6-69f062f0a13e-registry-tls\") on node \"crc\" DevicePath \"\"" Mar 16 15:44:22 crc kubenswrapper[5120]: I0316 15:44:22.600863 5120 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6528b019-774e-4298-abe6-69f062f0a13e-ca-trust-extracted\") on node \"crc\" DevicePath \"\"" Mar 16 15:44:22 crc kubenswrapper[5120]: I0316 15:44:22.600871 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dltk8\" (UniqueName: \"kubernetes.io/projected/6528b019-774e-4298-abe6-69f062f0a13e-kube-api-access-dltk8\") on node \"crc\" DevicePath \"\"" Mar 16 15:44:22 crc kubenswrapper[5120]: I0316 15:44:22.600878 5120 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6528b019-774e-4298-abe6-69f062f0a13e-bound-sa-token\") on node \"crc\" DevicePath \"\"" Mar 16 15:44:23 crc kubenswrapper[5120]: I0316 15:44:23.272400 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-66587d64c8-blgcz" Mar 16 15:44:23 crc kubenswrapper[5120]: I0316 15:44:23.272442 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-66587d64c8-blgcz" event={"ID":"6528b019-774e-4298-abe6-69f062f0a13e","Type":"ContainerDied","Data":"19f38470c842ed8e187b17ebda11af781453146a7f757939663cf2b6eeea77cd"} Mar 16 15:44:23 crc kubenswrapper[5120]: I0316 15:44:23.272516 5120 scope.go:117] "RemoveContainer" containerID="6d07bbca2cddcefa55f8046e3397dea658e5b5b01d6b9aecf7123fce038b5a2f" Mar 16 15:44:23 crc kubenswrapper[5120]: I0316 15:44:23.289061 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-66587d64c8-blgcz"] Mar 16 15:44:23 crc kubenswrapper[5120]: I0316 15:44:23.295477 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-66587d64c8-blgcz"] Mar 16 15:44:24 crc kubenswrapper[5120]: I0316 15:44:24.193088 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-nmstate/nmstate-console-plugin-74686bb6b4-dcsrq" Mar 16 15:44:24 crc kubenswrapper[5120]: I0316 15:44:24.672968 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6528b019-774e-4298-abe6-69f062f0a13e" path="/var/lib/kubelet/pods/6528b019-774e-4298-abe6-69f062f0a13e/volumes" Mar 16 15:44:26 crc kubenswrapper[5120]: I0316 15:44:26.208169 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-nmstate/nmstate-metrics-7f888697b-h5l4s" Mar 16 15:44:26 crc kubenswrapper[5120]: I0316 15:44:26.947490 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/community-operators-vvblr" Mar 16 15:44:26 crc kubenswrapper[5120]: I0316 15:44:26.948988 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-marketplace/community-operators-vvblr" Mar 16 15:44:27 crc kubenswrapper[5120]: I0316 15:44:27.002314 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/community-operators-vvblr" Mar 16 15:44:27 crc kubenswrapper[5120]: I0316 15:44:27.350565 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/community-operators-vvblr" Mar 16 15:44:27 crc kubenswrapper[5120]: I0316 15:44:27.386064 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/community-operators-vvblr"] Mar 16 15:44:29 crc kubenswrapper[5120]: I0316 15:44:29.326096 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-marketplace/community-operators-vvblr" podUID="6abb18b0-ec8b-4e9d-bc3f-4f313f7d2fe8" containerName="registry-server" containerID="cri-o://956aa4aab1acfd4e4c59482485b0feb20eed76c7d547167694d8acb91dffb861" gracePeriod=2 Mar 16 15:44:29 crc kubenswrapper[5120]: I0316 15:44:29.772732 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-vvblr" Mar 16 15:44:29 crc kubenswrapper[5120]: I0316 15:44:29.823940 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j6q7h\" (UniqueName: \"kubernetes.io/projected/6abb18b0-ec8b-4e9d-bc3f-4f313f7d2fe8-kube-api-access-j6q7h\") pod \"6abb18b0-ec8b-4e9d-bc3f-4f313f7d2fe8\" (UID: \"6abb18b0-ec8b-4e9d-bc3f-4f313f7d2fe8\") " Mar 16 15:44:29 crc kubenswrapper[5120]: I0316 15:44:29.824049 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/6abb18b0-ec8b-4e9d-bc3f-4f313f7d2fe8-catalog-content\") pod \"6abb18b0-ec8b-4e9d-bc3f-4f313f7d2fe8\" (UID: \"6abb18b0-ec8b-4e9d-bc3f-4f313f7d2fe8\") " Mar 16 15:44:29 crc kubenswrapper[5120]: I0316 15:44:29.824080 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/6abb18b0-ec8b-4e9d-bc3f-4f313f7d2fe8-utilities\") pod \"6abb18b0-ec8b-4e9d-bc3f-4f313f7d2fe8\" (UID: \"6abb18b0-ec8b-4e9d-bc3f-4f313f7d2fe8\") " Mar 16 15:44:29 crc kubenswrapper[5120]: I0316 15:44:29.825501 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6abb18b0-ec8b-4e9d-bc3f-4f313f7d2fe8-utilities" (OuterVolumeSpecName: "utilities") pod "6abb18b0-ec8b-4e9d-bc3f-4f313f7d2fe8" (UID: "6abb18b0-ec8b-4e9d-bc3f-4f313f7d2fe8"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:44:29 crc kubenswrapper[5120]: I0316 15:44:29.843736 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6abb18b0-ec8b-4e9d-bc3f-4f313f7d2fe8-kube-api-access-j6q7h" (OuterVolumeSpecName: "kube-api-access-j6q7h") pod "6abb18b0-ec8b-4e9d-bc3f-4f313f7d2fe8" (UID: "6abb18b0-ec8b-4e9d-bc3f-4f313f7d2fe8"). InnerVolumeSpecName "kube-api-access-j6q7h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:44:29 crc kubenswrapper[5120]: I0316 15:44:29.925521 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j6q7h\" (UniqueName: \"kubernetes.io/projected/6abb18b0-ec8b-4e9d-bc3f-4f313f7d2fe8-kube-api-access-j6q7h\") on node \"crc\" DevicePath \"\"" Mar 16 15:44:29 crc kubenswrapper[5120]: I0316 15:44:29.925782 5120 reconciler_common.go:299] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/6abb18b0-ec8b-4e9d-bc3f-4f313f7d2fe8-utilities\") on node \"crc\" DevicePath \"\"" Mar 16 15:44:30 crc kubenswrapper[5120]: I0316 15:44:30.216568 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6abb18b0-ec8b-4e9d-bc3f-4f313f7d2fe8-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "6abb18b0-ec8b-4e9d-bc3f-4f313f7d2fe8" (UID: "6abb18b0-ec8b-4e9d-bc3f-4f313f7d2fe8"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:44:30 crc kubenswrapper[5120]: I0316 15:44:30.234225 5120 reconciler_common.go:299] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/6abb18b0-ec8b-4e9d-bc3f-4f313f7d2fe8-catalog-content\") on node \"crc\" DevicePath \"\"" Mar 16 15:44:30 crc kubenswrapper[5120]: I0316 15:44:30.332593 5120 generic.go:358] "Generic (PLEG): container finished" podID="6abb18b0-ec8b-4e9d-bc3f-4f313f7d2fe8" containerID="956aa4aab1acfd4e4c59482485b0feb20eed76c7d547167694d8acb91dffb861" exitCode=0 Mar 16 15:44:30 crc kubenswrapper[5120]: I0316 15:44:30.332741 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-vvblr" Mar 16 15:44:30 crc kubenswrapper[5120]: I0316 15:44:30.332797 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-vvblr" event={"ID":"6abb18b0-ec8b-4e9d-bc3f-4f313f7d2fe8","Type":"ContainerDied","Data":"956aa4aab1acfd4e4c59482485b0feb20eed76c7d547167694d8acb91dffb861"} Mar 16 15:44:30 crc kubenswrapper[5120]: I0316 15:44:30.332893 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-vvblr" event={"ID":"6abb18b0-ec8b-4e9d-bc3f-4f313f7d2fe8","Type":"ContainerDied","Data":"221920ad3025f7c7b00de67ae25c2bb620923f4c82a74ab5ddec3bc9a16b82b1"} Mar 16 15:44:30 crc kubenswrapper[5120]: I0316 15:44:30.332943 5120 scope.go:117] "RemoveContainer" containerID="956aa4aab1acfd4e4c59482485b0feb20eed76c7d547167694d8acb91dffb861" Mar 16 15:44:30 crc kubenswrapper[5120]: I0316 15:44:30.351841 5120 scope.go:117] "RemoveContainer" containerID="da5ee10c854854eb4589fd5ca46ef0fabe1e28893f961922218b601e82116953" Mar 16 15:44:30 crc kubenswrapper[5120]: I0316 15:44:30.370845 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/community-operators-vvblr"] Mar 16 15:44:30 crc kubenswrapper[5120]: I0316 15:44:30.375697 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/community-operators-vvblr"] Mar 16 15:44:30 crc kubenswrapper[5120]: I0316 15:44:30.389362 5120 scope.go:117] "RemoveContainer" containerID="f7a76dd426b3664db0bb09e12d22da85aec583237953c41a04f284384f27a4f5" Mar 16 15:44:30 crc kubenswrapper[5120]: I0316 15:44:30.408488 5120 scope.go:117] "RemoveContainer" containerID="956aa4aab1acfd4e4c59482485b0feb20eed76c7d547167694d8acb91dffb861" Mar 16 15:44:30 crc kubenswrapper[5120]: E0316 15:44:30.408917 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"956aa4aab1acfd4e4c59482485b0feb20eed76c7d547167694d8acb91dffb861\": container with ID starting with 956aa4aab1acfd4e4c59482485b0feb20eed76c7d547167694d8acb91dffb861 not found: ID does not exist" containerID="956aa4aab1acfd4e4c59482485b0feb20eed76c7d547167694d8acb91dffb861" Mar 16 15:44:30 crc kubenswrapper[5120]: I0316 15:44:30.408962 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"956aa4aab1acfd4e4c59482485b0feb20eed76c7d547167694d8acb91dffb861"} err="failed to get container status \"956aa4aab1acfd4e4c59482485b0feb20eed76c7d547167694d8acb91dffb861\": rpc error: code = NotFound desc = could not find container \"956aa4aab1acfd4e4c59482485b0feb20eed76c7d547167694d8acb91dffb861\": container with ID starting with 956aa4aab1acfd4e4c59482485b0feb20eed76c7d547167694d8acb91dffb861 not found: ID does not exist" Mar 16 15:44:30 crc kubenswrapper[5120]: I0316 15:44:30.408987 5120 scope.go:117] "RemoveContainer" containerID="da5ee10c854854eb4589fd5ca46ef0fabe1e28893f961922218b601e82116953" Mar 16 15:44:30 crc kubenswrapper[5120]: E0316 15:44:30.409296 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da5ee10c854854eb4589fd5ca46ef0fabe1e28893f961922218b601e82116953\": container with ID starting with da5ee10c854854eb4589fd5ca46ef0fabe1e28893f961922218b601e82116953 not found: ID does not exist" containerID="da5ee10c854854eb4589fd5ca46ef0fabe1e28893f961922218b601e82116953" Mar 16 15:44:30 crc kubenswrapper[5120]: I0316 15:44:30.409329 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da5ee10c854854eb4589fd5ca46ef0fabe1e28893f961922218b601e82116953"} err="failed to get container status \"da5ee10c854854eb4589fd5ca46ef0fabe1e28893f961922218b601e82116953\": rpc error: code = NotFound desc = could not find container \"da5ee10c854854eb4589fd5ca46ef0fabe1e28893f961922218b601e82116953\": container with ID starting with da5ee10c854854eb4589fd5ca46ef0fabe1e28893f961922218b601e82116953 not found: ID does not exist" Mar 16 15:44:30 crc kubenswrapper[5120]: I0316 15:44:30.409353 5120 scope.go:117] "RemoveContainer" containerID="f7a76dd426b3664db0bb09e12d22da85aec583237953c41a04f284384f27a4f5" Mar 16 15:44:30 crc kubenswrapper[5120]: E0316 15:44:30.409788 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f7a76dd426b3664db0bb09e12d22da85aec583237953c41a04f284384f27a4f5\": container with ID starting with f7a76dd426b3664db0bb09e12d22da85aec583237953c41a04f284384f27a4f5 not found: ID does not exist" containerID="f7a76dd426b3664db0bb09e12d22da85aec583237953c41a04f284384f27a4f5" Mar 16 15:44:30 crc kubenswrapper[5120]: I0316 15:44:30.409835 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7a76dd426b3664db0bb09e12d22da85aec583237953c41a04f284384f27a4f5"} err="failed to get container status \"f7a76dd426b3664db0bb09e12d22da85aec583237953c41a04f284384f27a4f5\": rpc error: code = NotFound desc = could not find container \"f7a76dd426b3664db0bb09e12d22da85aec583237953c41a04f284384f27a4f5\": container with ID starting with f7a76dd426b3664db0bb09e12d22da85aec583237953c41a04f284384f27a4f5 not found: ID does not exist" Mar 16 15:44:30 crc kubenswrapper[5120]: I0316 15:44:30.677880 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6abb18b0-ec8b-4e9d-bc3f-4f313f7d2fe8" path="/var/lib/kubelet/pods/6abb18b0-ec8b-4e9d-bc3f-4f313f7d2fe8/volumes" Mar 16 15:44:37 crc kubenswrapper[5120]: I0316 15:44:37.625975 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/5f0d783fea323979717ec4113d968dc42dcfaeaad7ccdc94e6a93c9e91jzl5h"] Mar 16 15:44:37 crc kubenswrapper[5120]: I0316 15:44:37.627185 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6abb18b0-ec8b-4e9d-bc3f-4f313f7d2fe8" containerName="extract-utilities" Mar 16 15:44:37 crc kubenswrapper[5120]: I0316 15:44:37.627200 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="6abb18b0-ec8b-4e9d-bc3f-4f313f7d2fe8" containerName="extract-utilities" Mar 16 15:44:37 crc kubenswrapper[5120]: I0316 15:44:37.627211 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6528b019-774e-4298-abe6-69f062f0a13e" containerName="registry" Mar 16 15:44:37 crc kubenswrapper[5120]: I0316 15:44:37.627217 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="6528b019-774e-4298-abe6-69f062f0a13e" containerName="registry" Mar 16 15:44:37 crc kubenswrapper[5120]: I0316 15:44:37.627231 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6abb18b0-ec8b-4e9d-bc3f-4f313f7d2fe8" containerName="registry-server" Mar 16 15:44:37 crc kubenswrapper[5120]: I0316 15:44:37.627237 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="6abb18b0-ec8b-4e9d-bc3f-4f313f7d2fe8" containerName="registry-server" Mar 16 15:44:37 crc kubenswrapper[5120]: I0316 15:44:37.627250 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6abb18b0-ec8b-4e9d-bc3f-4f313f7d2fe8" containerName="extract-content" Mar 16 15:44:37 crc kubenswrapper[5120]: I0316 15:44:37.627256 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="6abb18b0-ec8b-4e9d-bc3f-4f313f7d2fe8" containerName="extract-content" Mar 16 15:44:37 crc kubenswrapper[5120]: I0316 15:44:37.627354 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="6528b019-774e-4298-abe6-69f062f0a13e" containerName="registry" Mar 16 15:44:37 crc kubenswrapper[5120]: I0316 15:44:37.627366 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="6abb18b0-ec8b-4e9d-bc3f-4f313f7d2fe8" containerName="registry-server" Mar 16 15:44:37 crc kubenswrapper[5120]: I0316 15:44:37.632124 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/5f0d783fea323979717ec4113d968dc42dcfaeaad7ccdc94e6a93c9e91jzl5h" Mar 16 15:44:37 crc kubenswrapper[5120]: I0316 15:44:37.634283 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-b2ccr\"" Mar 16 15:44:37 crc kubenswrapper[5120]: I0316 15:44:37.638254 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/5f0d783fea323979717ec4113d968dc42dcfaeaad7ccdc94e6a93c9e91jzl5h"] Mar 16 15:44:37 crc kubenswrapper[5120]: I0316 15:44:37.745258 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9cdb212f-7fb8-44ae-95d1-b2ea8dc09448-bundle\") pod \"5f0d783fea323979717ec4113d968dc42dcfaeaad7ccdc94e6a93c9e91jzl5h\" (UID: \"9cdb212f-7fb8-44ae-95d1-b2ea8dc09448\") " pod="openshift-marketplace/5f0d783fea323979717ec4113d968dc42dcfaeaad7ccdc94e6a93c9e91jzl5h" Mar 16 15:44:37 crc kubenswrapper[5120]: I0316 15:44:37.745365 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9bct\" (UniqueName: \"kubernetes.io/projected/9cdb212f-7fb8-44ae-95d1-b2ea8dc09448-kube-api-access-x9bct\") pod \"5f0d783fea323979717ec4113d968dc42dcfaeaad7ccdc94e6a93c9e91jzl5h\" (UID: \"9cdb212f-7fb8-44ae-95d1-b2ea8dc09448\") " pod="openshift-marketplace/5f0d783fea323979717ec4113d968dc42dcfaeaad7ccdc94e6a93c9e91jzl5h" Mar 16 15:44:37 crc kubenswrapper[5120]: I0316 15:44:37.745417 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9cdb212f-7fb8-44ae-95d1-b2ea8dc09448-util\") pod \"5f0d783fea323979717ec4113d968dc42dcfaeaad7ccdc94e6a93c9e91jzl5h\" (UID: \"9cdb212f-7fb8-44ae-95d1-b2ea8dc09448\") " pod="openshift-marketplace/5f0d783fea323979717ec4113d968dc42dcfaeaad7ccdc94e6a93c9e91jzl5h" Mar 16 15:44:37 crc kubenswrapper[5120]: I0316 15:44:37.847146 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9cdb212f-7fb8-44ae-95d1-b2ea8dc09448-bundle\") pod \"5f0d783fea323979717ec4113d968dc42dcfaeaad7ccdc94e6a93c9e91jzl5h\" (UID: \"9cdb212f-7fb8-44ae-95d1-b2ea8dc09448\") " pod="openshift-marketplace/5f0d783fea323979717ec4113d968dc42dcfaeaad7ccdc94e6a93c9e91jzl5h" Mar 16 15:44:37 crc kubenswrapper[5120]: I0316 15:44:37.847231 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x9bct\" (UniqueName: \"kubernetes.io/projected/9cdb212f-7fb8-44ae-95d1-b2ea8dc09448-kube-api-access-x9bct\") pod \"5f0d783fea323979717ec4113d968dc42dcfaeaad7ccdc94e6a93c9e91jzl5h\" (UID: \"9cdb212f-7fb8-44ae-95d1-b2ea8dc09448\") " pod="openshift-marketplace/5f0d783fea323979717ec4113d968dc42dcfaeaad7ccdc94e6a93c9e91jzl5h" Mar 16 15:44:37 crc kubenswrapper[5120]: I0316 15:44:37.847293 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9cdb212f-7fb8-44ae-95d1-b2ea8dc09448-util\") pod \"5f0d783fea323979717ec4113d968dc42dcfaeaad7ccdc94e6a93c9e91jzl5h\" (UID: \"9cdb212f-7fb8-44ae-95d1-b2ea8dc09448\") " pod="openshift-marketplace/5f0d783fea323979717ec4113d968dc42dcfaeaad7ccdc94e6a93c9e91jzl5h" Mar 16 15:44:37 crc kubenswrapper[5120]: I0316 15:44:37.847869 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9cdb212f-7fb8-44ae-95d1-b2ea8dc09448-util\") pod \"5f0d783fea323979717ec4113d968dc42dcfaeaad7ccdc94e6a93c9e91jzl5h\" (UID: \"9cdb212f-7fb8-44ae-95d1-b2ea8dc09448\") " pod="openshift-marketplace/5f0d783fea323979717ec4113d968dc42dcfaeaad7ccdc94e6a93c9e91jzl5h" Mar 16 15:44:37 crc kubenswrapper[5120]: I0316 15:44:37.847935 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9cdb212f-7fb8-44ae-95d1-b2ea8dc09448-bundle\") pod \"5f0d783fea323979717ec4113d968dc42dcfaeaad7ccdc94e6a93c9e91jzl5h\" (UID: \"9cdb212f-7fb8-44ae-95d1-b2ea8dc09448\") " pod="openshift-marketplace/5f0d783fea323979717ec4113d968dc42dcfaeaad7ccdc94e6a93c9e91jzl5h" Mar 16 15:44:37 crc kubenswrapper[5120]: I0316 15:44:37.866428 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9bct\" (UniqueName: \"kubernetes.io/projected/9cdb212f-7fb8-44ae-95d1-b2ea8dc09448-kube-api-access-x9bct\") pod \"5f0d783fea323979717ec4113d968dc42dcfaeaad7ccdc94e6a93c9e91jzl5h\" (UID: \"9cdb212f-7fb8-44ae-95d1-b2ea8dc09448\") " pod="openshift-marketplace/5f0d783fea323979717ec4113d968dc42dcfaeaad7ccdc94e6a93c9e91jzl5h" Mar 16 15:44:37 crc kubenswrapper[5120]: I0316 15:44:37.962071 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/5f0d783fea323979717ec4113d968dc42dcfaeaad7ccdc94e6a93c9e91jzl5h" Mar 16 15:44:38 crc kubenswrapper[5120]: I0316 15:44:38.154035 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/5f0d783fea323979717ec4113d968dc42dcfaeaad7ccdc94e6a93c9e91jzl5h"] Mar 16 15:44:38 crc kubenswrapper[5120]: I0316 15:44:38.382594 5120 generic.go:358] "Generic (PLEG): container finished" podID="9cdb212f-7fb8-44ae-95d1-b2ea8dc09448" containerID="4bb0c181c0ff817d30ca0c247613a718416b700e07cea53842a109e0b82c9257" exitCode=0 Mar 16 15:44:38 crc kubenswrapper[5120]: I0316 15:44:38.382643 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/5f0d783fea323979717ec4113d968dc42dcfaeaad7ccdc94e6a93c9e91jzl5h" event={"ID":"9cdb212f-7fb8-44ae-95d1-b2ea8dc09448","Type":"ContainerDied","Data":"4bb0c181c0ff817d30ca0c247613a718416b700e07cea53842a109e0b82c9257"} Mar 16 15:44:38 crc kubenswrapper[5120]: I0316 15:44:38.382690 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/5f0d783fea323979717ec4113d968dc42dcfaeaad7ccdc94e6a93c9e91jzl5h" event={"ID":"9cdb212f-7fb8-44ae-95d1-b2ea8dc09448","Type":"ContainerStarted","Data":"b47aab57a3b854674066a6ed3ab4a5ed51ecf6bcd7c6f5b39f93b34c4a987500"} Mar 16 15:44:39 crc kubenswrapper[5120]: I0316 15:44:39.384955 5120 scope.go:117] "RemoveContainer" containerID="da33be415161b80313a9952be399bc9304e1e8c782e55ddd77e6970418395115" Mar 16 15:44:39 crc kubenswrapper[5120]: I0316 15:44:39.995336 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-operators-v5ldb"] Mar 16 15:44:40 crc kubenswrapper[5120]: I0316 15:44:40.031586 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-v5ldb"] Mar 16 15:44:40 crc kubenswrapper[5120]: I0316 15:44:40.031880 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-v5ldb" Mar 16 15:44:40 crc kubenswrapper[5120]: I0316 15:44:40.082068 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/432432c1-d09c-45fe-8773-8bfbd6e38446-utilities\") pod \"redhat-operators-v5ldb\" (UID: \"432432c1-d09c-45fe-8773-8bfbd6e38446\") " pod="openshift-marketplace/redhat-operators-v5ldb" Mar 16 15:44:40 crc kubenswrapper[5120]: I0316 15:44:40.082165 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpzvm\" (UniqueName: \"kubernetes.io/projected/432432c1-d09c-45fe-8773-8bfbd6e38446-kube-api-access-kpzvm\") pod \"redhat-operators-v5ldb\" (UID: \"432432c1-d09c-45fe-8773-8bfbd6e38446\") " pod="openshift-marketplace/redhat-operators-v5ldb" Mar 16 15:44:40 crc kubenswrapper[5120]: I0316 15:44:40.082231 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/432432c1-d09c-45fe-8773-8bfbd6e38446-catalog-content\") pod \"redhat-operators-v5ldb\" (UID: \"432432c1-d09c-45fe-8773-8bfbd6e38446\") " pod="openshift-marketplace/redhat-operators-v5ldb" Mar 16 15:44:40 crc kubenswrapper[5120]: I0316 15:44:40.183429 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/432432c1-d09c-45fe-8773-8bfbd6e38446-utilities\") pod \"redhat-operators-v5ldb\" (UID: \"432432c1-d09c-45fe-8773-8bfbd6e38446\") " pod="openshift-marketplace/redhat-operators-v5ldb" Mar 16 15:44:40 crc kubenswrapper[5120]: I0316 15:44:40.183504 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kpzvm\" (UniqueName: \"kubernetes.io/projected/432432c1-d09c-45fe-8773-8bfbd6e38446-kube-api-access-kpzvm\") pod \"redhat-operators-v5ldb\" (UID: \"432432c1-d09c-45fe-8773-8bfbd6e38446\") " pod="openshift-marketplace/redhat-operators-v5ldb" Mar 16 15:44:40 crc kubenswrapper[5120]: I0316 15:44:40.183551 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/432432c1-d09c-45fe-8773-8bfbd6e38446-catalog-content\") pod \"redhat-operators-v5ldb\" (UID: \"432432c1-d09c-45fe-8773-8bfbd6e38446\") " pod="openshift-marketplace/redhat-operators-v5ldb" Mar 16 15:44:40 crc kubenswrapper[5120]: I0316 15:44:40.183954 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/432432c1-d09c-45fe-8773-8bfbd6e38446-utilities\") pod \"redhat-operators-v5ldb\" (UID: \"432432c1-d09c-45fe-8773-8bfbd6e38446\") " pod="openshift-marketplace/redhat-operators-v5ldb" Mar 16 15:44:40 crc kubenswrapper[5120]: I0316 15:44:40.184045 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/432432c1-d09c-45fe-8773-8bfbd6e38446-catalog-content\") pod \"redhat-operators-v5ldb\" (UID: \"432432c1-d09c-45fe-8773-8bfbd6e38446\") " pod="openshift-marketplace/redhat-operators-v5ldb" Mar 16 15:44:40 crc kubenswrapper[5120]: I0316 15:44:40.208038 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpzvm\" (UniqueName: \"kubernetes.io/projected/432432c1-d09c-45fe-8773-8bfbd6e38446-kube-api-access-kpzvm\") pod \"redhat-operators-v5ldb\" (UID: \"432432c1-d09c-45fe-8773-8bfbd6e38446\") " pod="openshift-marketplace/redhat-operators-v5ldb" Mar 16 15:44:40 crc kubenswrapper[5120]: I0316 15:44:40.373299 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-v5ldb" Mar 16 15:44:40 crc kubenswrapper[5120]: W0316 15:44:40.562326 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod432432c1_d09c_45fe_8773_8bfbd6e38446.slice/crio-06190b89363763d384f0f885e884b53f6d5bc491cd5c6c87cf318e796688524b WatchSource:0}: Error finding container 06190b89363763d384f0f885e884b53f6d5bc491cd5c6c87cf318e796688524b: Status 404 returned error can't find the container with id 06190b89363763d384f0f885e884b53f6d5bc491cd5c6c87cf318e796688524b Mar 16 15:44:40 crc kubenswrapper[5120]: I0316 15:44:40.573108 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-v5ldb"] Mar 16 15:44:41 crc kubenswrapper[5120]: I0316 15:44:41.401195 5120 generic.go:358] "Generic (PLEG): container finished" podID="432432c1-d09c-45fe-8773-8bfbd6e38446" containerID="8608b1628df7923aeb915a5b5deb50247be8c4f22ca56e75fea6ef332f24ed5b" exitCode=0 Mar 16 15:44:41 crc kubenswrapper[5120]: I0316 15:44:41.401402 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-v5ldb" event={"ID":"432432c1-d09c-45fe-8773-8bfbd6e38446","Type":"ContainerDied","Data":"8608b1628df7923aeb915a5b5deb50247be8c4f22ca56e75fea6ef332f24ed5b"} Mar 16 15:44:41 crc kubenswrapper[5120]: I0316 15:44:41.401432 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-v5ldb" event={"ID":"432432c1-d09c-45fe-8773-8bfbd6e38446","Type":"ContainerStarted","Data":"06190b89363763d384f0f885e884b53f6d5bc491cd5c6c87cf318e796688524b"} Mar 16 15:44:42 crc kubenswrapper[5120]: I0316 15:44:42.335376 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-console/console-64d44f6ddf-4pm87" podUID="716f37d9-f29d-4bc1-87a1-94364fee0605" containerName="console" containerID="cri-o://816e8162c69862c276ab6e2e6bc3e1a4471bbdbe2bcdca902571ac0b76dd7688" gracePeriod=15 Mar 16 15:44:42 crc kubenswrapper[5120]: I0316 15:44:42.813524 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-64d44f6ddf-4pm87_716f37d9-f29d-4bc1-87a1-94364fee0605/console/0.log" Mar 16 15:44:42 crc kubenswrapper[5120]: I0316 15:44:42.813982 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64d44f6ddf-4pm87" Mar 16 15:44:42 crc kubenswrapper[5120]: I0316 15:44:42.919065 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jjlg7\" (UniqueName: \"kubernetes.io/projected/716f37d9-f29d-4bc1-87a1-94364fee0605-kube-api-access-jjlg7\") pod \"716f37d9-f29d-4bc1-87a1-94364fee0605\" (UID: \"716f37d9-f29d-4bc1-87a1-94364fee0605\") " Mar 16 15:44:42 crc kubenswrapper[5120]: I0316 15:44:42.919213 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/716f37d9-f29d-4bc1-87a1-94364fee0605-console-config\") pod \"716f37d9-f29d-4bc1-87a1-94364fee0605\" (UID: \"716f37d9-f29d-4bc1-87a1-94364fee0605\") " Mar 16 15:44:42 crc kubenswrapper[5120]: I0316 15:44:42.919289 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/716f37d9-f29d-4bc1-87a1-94364fee0605-console-oauth-config\") pod \"716f37d9-f29d-4bc1-87a1-94364fee0605\" (UID: \"716f37d9-f29d-4bc1-87a1-94364fee0605\") " Mar 16 15:44:42 crc kubenswrapper[5120]: I0316 15:44:42.919347 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/716f37d9-f29d-4bc1-87a1-94364fee0605-service-ca\") pod \"716f37d9-f29d-4bc1-87a1-94364fee0605\" (UID: \"716f37d9-f29d-4bc1-87a1-94364fee0605\") " Mar 16 15:44:42 crc kubenswrapper[5120]: I0316 15:44:42.919433 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/716f37d9-f29d-4bc1-87a1-94364fee0605-oauth-serving-cert\") pod \"716f37d9-f29d-4bc1-87a1-94364fee0605\" (UID: \"716f37d9-f29d-4bc1-87a1-94364fee0605\") " Mar 16 15:44:42 crc kubenswrapper[5120]: I0316 15:44:42.919486 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/716f37d9-f29d-4bc1-87a1-94364fee0605-trusted-ca-bundle\") pod \"716f37d9-f29d-4bc1-87a1-94364fee0605\" (UID: \"716f37d9-f29d-4bc1-87a1-94364fee0605\") " Mar 16 15:44:42 crc kubenswrapper[5120]: I0316 15:44:42.919531 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/716f37d9-f29d-4bc1-87a1-94364fee0605-console-serving-cert\") pod \"716f37d9-f29d-4bc1-87a1-94364fee0605\" (UID: \"716f37d9-f29d-4bc1-87a1-94364fee0605\") " Mar 16 15:44:42 crc kubenswrapper[5120]: I0316 15:44:42.920091 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/716f37d9-f29d-4bc1-87a1-94364fee0605-console-config" (OuterVolumeSpecName: "console-config") pod "716f37d9-f29d-4bc1-87a1-94364fee0605" (UID: "716f37d9-f29d-4bc1-87a1-94364fee0605"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:44:42 crc kubenswrapper[5120]: I0316 15:44:42.920101 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/716f37d9-f29d-4bc1-87a1-94364fee0605-service-ca" (OuterVolumeSpecName: "service-ca") pod "716f37d9-f29d-4bc1-87a1-94364fee0605" (UID: "716f37d9-f29d-4bc1-87a1-94364fee0605"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:44:42 crc kubenswrapper[5120]: I0316 15:44:42.920407 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/716f37d9-f29d-4bc1-87a1-94364fee0605-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "716f37d9-f29d-4bc1-87a1-94364fee0605" (UID: "716f37d9-f29d-4bc1-87a1-94364fee0605"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:44:42 crc kubenswrapper[5120]: I0316 15:44:42.920878 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/716f37d9-f29d-4bc1-87a1-94364fee0605-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "716f37d9-f29d-4bc1-87a1-94364fee0605" (UID: "716f37d9-f29d-4bc1-87a1-94364fee0605"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:44:42 crc kubenswrapper[5120]: I0316 15:44:42.929525 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/716f37d9-f29d-4bc1-87a1-94364fee0605-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "716f37d9-f29d-4bc1-87a1-94364fee0605" (UID: "716f37d9-f29d-4bc1-87a1-94364fee0605"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:44:42 crc kubenswrapper[5120]: I0316 15:44:42.929772 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/716f37d9-f29d-4bc1-87a1-94364fee0605-kube-api-access-jjlg7" (OuterVolumeSpecName: "kube-api-access-jjlg7") pod "716f37d9-f29d-4bc1-87a1-94364fee0605" (UID: "716f37d9-f29d-4bc1-87a1-94364fee0605"). InnerVolumeSpecName "kube-api-access-jjlg7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:44:42 crc kubenswrapper[5120]: I0316 15:44:42.929984 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/716f37d9-f29d-4bc1-87a1-94364fee0605-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "716f37d9-f29d-4bc1-87a1-94364fee0605" (UID: "716f37d9-f29d-4bc1-87a1-94364fee0605"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:44:43 crc kubenswrapper[5120]: I0316 15:44:43.021151 5120 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/716f37d9-f29d-4bc1-87a1-94364fee0605-console-oauth-config\") on node \"crc\" DevicePath \"\"" Mar 16 15:44:43 crc kubenswrapper[5120]: I0316 15:44:43.021190 5120 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/716f37d9-f29d-4bc1-87a1-94364fee0605-service-ca\") on node \"crc\" DevicePath \"\"" Mar 16 15:44:43 crc kubenswrapper[5120]: I0316 15:44:43.021199 5120 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/716f37d9-f29d-4bc1-87a1-94364fee0605-oauth-serving-cert\") on node \"crc\" DevicePath \"\"" Mar 16 15:44:43 crc kubenswrapper[5120]: I0316 15:44:43.021207 5120 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/716f37d9-f29d-4bc1-87a1-94364fee0605-trusted-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:44:43 crc kubenswrapper[5120]: I0316 15:44:43.021217 5120 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/716f37d9-f29d-4bc1-87a1-94364fee0605-console-serving-cert\") on node \"crc\" DevicePath \"\"" Mar 16 15:44:43 crc kubenswrapper[5120]: I0316 15:44:43.021225 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jjlg7\" (UniqueName: \"kubernetes.io/projected/716f37d9-f29d-4bc1-87a1-94364fee0605-kube-api-access-jjlg7\") on node \"crc\" DevicePath \"\"" Mar 16 15:44:43 crc kubenswrapper[5120]: I0316 15:44:43.021235 5120 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/716f37d9-f29d-4bc1-87a1-94364fee0605-console-config\") on node \"crc\" DevicePath \"\"" Mar 16 15:44:43 crc kubenswrapper[5120]: I0316 15:44:43.418014 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-64d44f6ddf-4pm87_716f37d9-f29d-4bc1-87a1-94364fee0605/console/0.log" Mar 16 15:44:43 crc kubenswrapper[5120]: I0316 15:44:43.418088 5120 generic.go:358] "Generic (PLEG): container finished" podID="716f37d9-f29d-4bc1-87a1-94364fee0605" containerID="816e8162c69862c276ab6e2e6bc3e1a4471bbdbe2bcdca902571ac0b76dd7688" exitCode=2 Mar 16 15:44:43 crc kubenswrapper[5120]: I0316 15:44:43.418226 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64d44f6ddf-4pm87" Mar 16 15:44:43 crc kubenswrapper[5120]: I0316 15:44:43.418227 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64d44f6ddf-4pm87" event={"ID":"716f37d9-f29d-4bc1-87a1-94364fee0605","Type":"ContainerDied","Data":"816e8162c69862c276ab6e2e6bc3e1a4471bbdbe2bcdca902571ac0b76dd7688"} Mar 16 15:44:43 crc kubenswrapper[5120]: I0316 15:44:43.418426 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64d44f6ddf-4pm87" event={"ID":"716f37d9-f29d-4bc1-87a1-94364fee0605","Type":"ContainerDied","Data":"ab36437f478238f2e90a9d5c82e66ee0ecab20e72de8bcc2a5ad47765cffcc04"} Mar 16 15:44:43 crc kubenswrapper[5120]: I0316 15:44:43.418459 5120 scope.go:117] "RemoveContainer" containerID="816e8162c69862c276ab6e2e6bc3e1a4471bbdbe2bcdca902571ac0b76dd7688" Mar 16 15:44:43 crc kubenswrapper[5120]: I0316 15:44:43.442874 5120 scope.go:117] "RemoveContainer" containerID="816e8162c69862c276ab6e2e6bc3e1a4471bbdbe2bcdca902571ac0b76dd7688" Mar 16 15:44:43 crc kubenswrapper[5120]: E0316 15:44:43.443431 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"816e8162c69862c276ab6e2e6bc3e1a4471bbdbe2bcdca902571ac0b76dd7688\": container with ID starting with 816e8162c69862c276ab6e2e6bc3e1a4471bbdbe2bcdca902571ac0b76dd7688 not found: ID does not exist" containerID="816e8162c69862c276ab6e2e6bc3e1a4471bbdbe2bcdca902571ac0b76dd7688" Mar 16 15:44:43 crc kubenswrapper[5120]: I0316 15:44:43.443485 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"816e8162c69862c276ab6e2e6bc3e1a4471bbdbe2bcdca902571ac0b76dd7688"} err="failed to get container status \"816e8162c69862c276ab6e2e6bc3e1a4471bbdbe2bcdca902571ac0b76dd7688\": rpc error: code = NotFound desc = could not find container \"816e8162c69862c276ab6e2e6bc3e1a4471bbdbe2bcdca902571ac0b76dd7688\": container with ID starting with 816e8162c69862c276ab6e2e6bc3e1a4471bbdbe2bcdca902571ac0b76dd7688 not found: ID does not exist" Mar 16 15:44:43 crc kubenswrapper[5120]: I0316 15:44:43.463698 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-64d44f6ddf-4pm87"] Mar 16 15:44:43 crc kubenswrapper[5120]: I0316 15:44:43.468190 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-64d44f6ddf-4pm87"] Mar 16 15:44:44 crc kubenswrapper[5120]: I0316 15:44:44.672849 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="716f37d9-f29d-4bc1-87a1-94364fee0605" path="/var/lib/kubelet/pods/716f37d9-f29d-4bc1-87a1-94364fee0605/volumes" Mar 16 15:44:45 crc kubenswrapper[5120]: I0316 15:44:45.436815 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-v5ldb" event={"ID":"432432c1-d09c-45fe-8773-8bfbd6e38446","Type":"ContainerStarted","Data":"5266e4a3f6d925be9bf5a3c127c9115c82cad9aa74d8aeabe8cb77766f62eee2"} Mar 16 15:44:46 crc kubenswrapper[5120]: I0316 15:44:46.447610 5120 generic.go:358] "Generic (PLEG): container finished" podID="432432c1-d09c-45fe-8773-8bfbd6e38446" containerID="5266e4a3f6d925be9bf5a3c127c9115c82cad9aa74d8aeabe8cb77766f62eee2" exitCode=0 Mar 16 15:44:46 crc kubenswrapper[5120]: I0316 15:44:46.447815 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-v5ldb" event={"ID":"432432c1-d09c-45fe-8773-8bfbd6e38446","Type":"ContainerDied","Data":"5266e4a3f6d925be9bf5a3c127c9115c82cad9aa74d8aeabe8cb77766f62eee2"} Mar 16 15:44:46 crc kubenswrapper[5120]: I0316 15:44:46.454117 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/5f0d783fea323979717ec4113d968dc42dcfaeaad7ccdc94e6a93c9e91jzl5h" event={"ID":"9cdb212f-7fb8-44ae-95d1-b2ea8dc09448","Type":"ContainerDied","Data":"a17894397d927b7329a70cbf8a6a4d86ea6d45fc4a60b386c42d7729e4156ad2"} Mar 16 15:44:46 crc kubenswrapper[5120]: I0316 15:44:46.455720 5120 generic.go:358] "Generic (PLEG): container finished" podID="9cdb212f-7fb8-44ae-95d1-b2ea8dc09448" containerID="a17894397d927b7329a70cbf8a6a4d86ea6d45fc4a60b386c42d7729e4156ad2" exitCode=0 Mar 16 15:44:47 crc kubenswrapper[5120]: I0316 15:44:47.466186 5120 generic.go:358] "Generic (PLEG): container finished" podID="9cdb212f-7fb8-44ae-95d1-b2ea8dc09448" containerID="f3338c303308e5f1f639cde47246fa3de255807480ed3486036413d34dcd3c08" exitCode=0 Mar 16 15:44:47 crc kubenswrapper[5120]: I0316 15:44:47.466272 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/5f0d783fea323979717ec4113d968dc42dcfaeaad7ccdc94e6a93c9e91jzl5h" event={"ID":"9cdb212f-7fb8-44ae-95d1-b2ea8dc09448","Type":"ContainerDied","Data":"f3338c303308e5f1f639cde47246fa3de255807480ed3486036413d34dcd3c08"} Mar 16 15:44:47 crc kubenswrapper[5120]: I0316 15:44:47.469655 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-v5ldb" event={"ID":"432432c1-d09c-45fe-8773-8bfbd6e38446","Type":"ContainerStarted","Data":"740e80aac206ffe6966b822df00e64353855bda9346b1cfb9f2ce175871a18de"} Mar 16 15:44:47 crc kubenswrapper[5120]: I0316 15:44:47.517618 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/redhat-operators-v5ldb" podStartSLOduration=4.950415773 podStartE2EDuration="8.517600938s" podCreationTimestamp="2026-03-16 15:44:39 +0000 UTC" firstStartedPulling="2026-03-16 15:44:41.402490364 +0000 UTC m=+783.556422051" lastFinishedPulling="2026-03-16 15:44:44.969675559 +0000 UTC m=+787.123607216" observedRunningTime="2026-03-16 15:44:47.514799388 +0000 UTC m=+789.668731055" watchObservedRunningTime="2026-03-16 15:44:47.517600938 +0000 UTC m=+789.671532605" Mar 16 15:44:48 crc kubenswrapper[5120]: I0316 15:44:48.742603 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/5f0d783fea323979717ec4113d968dc42dcfaeaad7ccdc94e6a93c9e91jzl5h" Mar 16 15:44:48 crc kubenswrapper[5120]: I0316 15:44:48.808441 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9cdb212f-7fb8-44ae-95d1-b2ea8dc09448-bundle\") pod \"9cdb212f-7fb8-44ae-95d1-b2ea8dc09448\" (UID: \"9cdb212f-7fb8-44ae-95d1-b2ea8dc09448\") " Mar 16 15:44:48 crc kubenswrapper[5120]: I0316 15:44:48.808791 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9cdb212f-7fb8-44ae-95d1-b2ea8dc09448-util\") pod \"9cdb212f-7fb8-44ae-95d1-b2ea8dc09448\" (UID: \"9cdb212f-7fb8-44ae-95d1-b2ea8dc09448\") " Mar 16 15:44:48 crc kubenswrapper[5120]: I0316 15:44:48.808870 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x9bct\" (UniqueName: \"kubernetes.io/projected/9cdb212f-7fb8-44ae-95d1-b2ea8dc09448-kube-api-access-x9bct\") pod \"9cdb212f-7fb8-44ae-95d1-b2ea8dc09448\" (UID: \"9cdb212f-7fb8-44ae-95d1-b2ea8dc09448\") " Mar 16 15:44:48 crc kubenswrapper[5120]: I0316 15:44:48.809491 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9cdb212f-7fb8-44ae-95d1-b2ea8dc09448-bundle" (OuterVolumeSpecName: "bundle") pod "9cdb212f-7fb8-44ae-95d1-b2ea8dc09448" (UID: "9cdb212f-7fb8-44ae-95d1-b2ea8dc09448"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:44:48 crc kubenswrapper[5120]: I0316 15:44:48.817749 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9cdb212f-7fb8-44ae-95d1-b2ea8dc09448-kube-api-access-x9bct" (OuterVolumeSpecName: "kube-api-access-x9bct") pod "9cdb212f-7fb8-44ae-95d1-b2ea8dc09448" (UID: "9cdb212f-7fb8-44ae-95d1-b2ea8dc09448"). InnerVolumeSpecName "kube-api-access-x9bct". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:44:48 crc kubenswrapper[5120]: I0316 15:44:48.821727 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9cdb212f-7fb8-44ae-95d1-b2ea8dc09448-util" (OuterVolumeSpecName: "util") pod "9cdb212f-7fb8-44ae-95d1-b2ea8dc09448" (UID: "9cdb212f-7fb8-44ae-95d1-b2ea8dc09448"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:44:48 crc kubenswrapper[5120]: I0316 15:44:48.910315 5120 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9cdb212f-7fb8-44ae-95d1-b2ea8dc09448-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:44:48 crc kubenswrapper[5120]: I0316 15:44:48.910343 5120 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9cdb212f-7fb8-44ae-95d1-b2ea8dc09448-util\") on node \"crc\" DevicePath \"\"" Mar 16 15:44:48 crc kubenswrapper[5120]: I0316 15:44:48.910351 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x9bct\" (UniqueName: \"kubernetes.io/projected/9cdb212f-7fb8-44ae-95d1-b2ea8dc09448-kube-api-access-x9bct\") on node \"crc\" DevicePath \"\"" Mar 16 15:44:49 crc kubenswrapper[5120]: I0316 15:44:49.485257 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/5f0d783fea323979717ec4113d968dc42dcfaeaad7ccdc94e6a93c9e91jzl5h" Mar 16 15:44:49 crc kubenswrapper[5120]: I0316 15:44:49.485292 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/5f0d783fea323979717ec4113d968dc42dcfaeaad7ccdc94e6a93c9e91jzl5h" event={"ID":"9cdb212f-7fb8-44ae-95d1-b2ea8dc09448","Type":"ContainerDied","Data":"b47aab57a3b854674066a6ed3ab4a5ed51ecf6bcd7c6f5b39f93b34c4a987500"} Mar 16 15:44:49 crc kubenswrapper[5120]: I0316 15:44:49.485431 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b47aab57a3b854674066a6ed3ab4a5ed51ecf6bcd7c6f5b39f93b34c4a987500" Mar 16 15:44:50 crc kubenswrapper[5120]: I0316 15:44:50.373722 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-operators-v5ldb" Mar 16 15:44:50 crc kubenswrapper[5120]: I0316 15:44:50.373835 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-marketplace/redhat-operators-v5ldb" Mar 16 15:44:51 crc kubenswrapper[5120]: I0316 15:44:51.438252 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-marketplace/redhat-operators-v5ldb" podUID="432432c1-d09c-45fe-8773-8bfbd6e38446" containerName="registry-server" probeResult="failure" output=< Mar 16 15:44:51 crc kubenswrapper[5120]: timeout: failed to connect service ":50051" within 1s Mar 16 15:44:51 crc kubenswrapper[5120]: > Mar 16 15:44:52 crc kubenswrapper[5120]: I0316 15:44:52.007695 5120 patch_prober.go:28] interesting pod/machine-config-daemon-7bf76 container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 15:44:52 crc kubenswrapper[5120]: I0316 15:44:52.008173 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 15:44:55 crc kubenswrapper[5120]: I0316 15:44:55.467825 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/certified-operators-j69cz"] Mar 16 15:44:55 crc kubenswrapper[5120]: I0316 15:44:55.468712 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="716f37d9-f29d-4bc1-87a1-94364fee0605" containerName="console" Mar 16 15:44:55 crc kubenswrapper[5120]: I0316 15:44:55.468735 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="716f37d9-f29d-4bc1-87a1-94364fee0605" containerName="console" Mar 16 15:44:55 crc kubenswrapper[5120]: I0316 15:44:55.468755 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9cdb212f-7fb8-44ae-95d1-b2ea8dc09448" containerName="pull" Mar 16 15:44:55 crc kubenswrapper[5120]: I0316 15:44:55.468781 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9cdb212f-7fb8-44ae-95d1-b2ea8dc09448" containerName="pull" Mar 16 15:44:55 crc kubenswrapper[5120]: I0316 15:44:55.468795 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9cdb212f-7fb8-44ae-95d1-b2ea8dc09448" containerName="util" Mar 16 15:44:55 crc kubenswrapper[5120]: I0316 15:44:55.468804 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9cdb212f-7fb8-44ae-95d1-b2ea8dc09448" containerName="util" Mar 16 15:44:55 crc kubenswrapper[5120]: I0316 15:44:55.468818 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9cdb212f-7fb8-44ae-95d1-b2ea8dc09448" containerName="extract" Mar 16 15:44:55 crc kubenswrapper[5120]: I0316 15:44:55.468826 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9cdb212f-7fb8-44ae-95d1-b2ea8dc09448" containerName="extract" Mar 16 15:44:55 crc kubenswrapper[5120]: I0316 15:44:55.468965 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="716f37d9-f29d-4bc1-87a1-94364fee0605" containerName="console" Mar 16 15:44:55 crc kubenswrapper[5120]: I0316 15:44:55.468988 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="9cdb212f-7fb8-44ae-95d1-b2ea8dc09448" containerName="extract" Mar 16 15:44:55 crc kubenswrapper[5120]: I0316 15:44:55.522589 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/certified-operators-j69cz"] Mar 16 15:44:55 crc kubenswrapper[5120]: I0316 15:44:55.522794 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-j69cz" Mar 16 15:44:55 crc kubenswrapper[5120]: I0316 15:44:55.601032 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/9ffb539b-b7f1-4506-96a9-7befa1acf76c-catalog-content\") pod \"certified-operators-j69cz\" (UID: \"9ffb539b-b7f1-4506-96a9-7befa1acf76c\") " pod="openshift-marketplace/certified-operators-j69cz" Mar 16 15:44:55 crc kubenswrapper[5120]: I0316 15:44:55.601368 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/9ffb539b-b7f1-4506-96a9-7befa1acf76c-utilities\") pod \"certified-operators-j69cz\" (UID: \"9ffb539b-b7f1-4506-96a9-7befa1acf76c\") " pod="openshift-marketplace/certified-operators-j69cz" Mar 16 15:44:55 crc kubenswrapper[5120]: I0316 15:44:55.601405 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzlnp\" (UniqueName: \"kubernetes.io/projected/9ffb539b-b7f1-4506-96a9-7befa1acf76c-kube-api-access-jzlnp\") pod \"certified-operators-j69cz\" (UID: \"9ffb539b-b7f1-4506-96a9-7befa1acf76c\") " pod="openshift-marketplace/certified-operators-j69cz" Mar 16 15:44:55 crc kubenswrapper[5120]: I0316 15:44:55.702467 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/9ffb539b-b7f1-4506-96a9-7befa1acf76c-catalog-content\") pod \"certified-operators-j69cz\" (UID: \"9ffb539b-b7f1-4506-96a9-7befa1acf76c\") " pod="openshift-marketplace/certified-operators-j69cz" Mar 16 15:44:55 crc kubenswrapper[5120]: I0316 15:44:55.702530 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/9ffb539b-b7f1-4506-96a9-7befa1acf76c-utilities\") pod \"certified-operators-j69cz\" (UID: \"9ffb539b-b7f1-4506-96a9-7befa1acf76c\") " pod="openshift-marketplace/certified-operators-j69cz" Mar 16 15:44:55 crc kubenswrapper[5120]: I0316 15:44:55.702563 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jzlnp\" (UniqueName: \"kubernetes.io/projected/9ffb539b-b7f1-4506-96a9-7befa1acf76c-kube-api-access-jzlnp\") pod \"certified-operators-j69cz\" (UID: \"9ffb539b-b7f1-4506-96a9-7befa1acf76c\") " pod="openshift-marketplace/certified-operators-j69cz" Mar 16 15:44:55 crc kubenswrapper[5120]: I0316 15:44:55.703380 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/9ffb539b-b7f1-4506-96a9-7befa1acf76c-catalog-content\") pod \"certified-operators-j69cz\" (UID: \"9ffb539b-b7f1-4506-96a9-7befa1acf76c\") " pod="openshift-marketplace/certified-operators-j69cz" Mar 16 15:44:55 crc kubenswrapper[5120]: I0316 15:44:55.703516 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/9ffb539b-b7f1-4506-96a9-7befa1acf76c-utilities\") pod \"certified-operators-j69cz\" (UID: \"9ffb539b-b7f1-4506-96a9-7befa1acf76c\") " pod="openshift-marketplace/certified-operators-j69cz" Mar 16 15:44:55 crc kubenswrapper[5120]: I0316 15:44:55.735698 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzlnp\" (UniqueName: \"kubernetes.io/projected/9ffb539b-b7f1-4506-96a9-7befa1acf76c-kube-api-access-jzlnp\") pod \"certified-operators-j69cz\" (UID: \"9ffb539b-b7f1-4506-96a9-7befa1acf76c\") " pod="openshift-marketplace/certified-operators-j69cz" Mar 16 15:44:55 crc kubenswrapper[5120]: I0316 15:44:55.887096 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-j69cz" Mar 16 15:44:56 crc kubenswrapper[5120]: I0316 15:44:56.091445 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/certified-operators-j69cz"] Mar 16 15:44:56 crc kubenswrapper[5120]: I0316 15:44:56.531729 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-j69cz" event={"ID":"9ffb539b-b7f1-4506-96a9-7befa1acf76c","Type":"ContainerStarted","Data":"cc5537d3430afb17040e3919c06649e1c54e0ca5e38474d0fc8ef01cd8296715"} Mar 16 15:44:56 crc kubenswrapper[5120]: I0316 15:44:56.533155 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-j69cz" event={"ID":"9ffb539b-b7f1-4506-96a9-7befa1acf76c","Type":"ContainerStarted","Data":"df90b3b9f0aa0be3458acb709d16c8109ff2b0ce56acb6643029cca72e97b7ca"} Mar 16 15:44:57 crc kubenswrapper[5120]: I0316 15:44:57.540072 5120 generic.go:358] "Generic (PLEG): container finished" podID="9ffb539b-b7f1-4506-96a9-7befa1acf76c" containerID="cc5537d3430afb17040e3919c06649e1c54e0ca5e38474d0fc8ef01cd8296715" exitCode=0 Mar 16 15:44:57 crc kubenswrapper[5120]: I0316 15:44:57.540194 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-j69cz" event={"ID":"9ffb539b-b7f1-4506-96a9-7befa1acf76c","Type":"ContainerDied","Data":"cc5537d3430afb17040e3919c06649e1c54e0ca5e38474d0fc8ef01cd8296715"} Mar 16 15:44:58 crc kubenswrapper[5120]: I0316 15:44:58.548781 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-j69cz" event={"ID":"9ffb539b-b7f1-4506-96a9-7befa1acf76c","Type":"ContainerStarted","Data":"00606bf282dae1390db515357be7f7073feff247181a53883351873da95e2013"} Mar 16 15:44:59 crc kubenswrapper[5120]: I0316 15:44:59.555839 5120 generic.go:358] "Generic (PLEG): container finished" podID="9ffb539b-b7f1-4506-96a9-7befa1acf76c" containerID="00606bf282dae1390db515357be7f7073feff247181a53883351873da95e2013" exitCode=0 Mar 16 15:44:59 crc kubenswrapper[5120]: I0316 15:44:59.555944 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-j69cz" event={"ID":"9ffb539b-b7f1-4506-96a9-7befa1acf76c","Type":"ContainerDied","Data":"00606bf282dae1390db515357be7f7073feff247181a53883351873da95e2013"} Mar 16 15:45:00 crc kubenswrapper[5120]: I0316 15:45:00.161299 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29561265-qt4pj"] Mar 16 15:45:00 crc kubenswrapper[5120]: I0316 15:45:00.169223 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29561265-qt4pj" Mar 16 15:45:00 crc kubenswrapper[5120]: I0316 15:45:00.171223 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operator-lifecycle-manager\"/\"collect-profiles-config\"" Mar 16 15:45:00 crc kubenswrapper[5120]: I0316 15:45:00.171260 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operator-lifecycle-manager\"/\"collect-profiles-dockercfg-vfqp6\"" Mar 16 15:45:00 crc kubenswrapper[5120]: I0316 15:45:00.176705 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29561265-qt4pj"] Mar 16 15:45:00 crc kubenswrapper[5120]: I0316 15:45:00.269025 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2stb5\" (UniqueName: \"kubernetes.io/projected/d78869ec-ceb9-4dda-b1cb-3f03d505a647-kube-api-access-2stb5\") pod \"collect-profiles-29561265-qt4pj\" (UID: \"d78869ec-ceb9-4dda-b1cb-3f03d505a647\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561265-qt4pj" Mar 16 15:45:00 crc kubenswrapper[5120]: I0316 15:45:00.269095 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/d78869ec-ceb9-4dda-b1cb-3f03d505a647-secret-volume\") pod \"collect-profiles-29561265-qt4pj\" (UID: \"d78869ec-ceb9-4dda-b1cb-3f03d505a647\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561265-qt4pj" Mar 16 15:45:00 crc kubenswrapper[5120]: I0316 15:45:00.269162 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d78869ec-ceb9-4dda-b1cb-3f03d505a647-config-volume\") pod \"collect-profiles-29561265-qt4pj\" (UID: \"d78869ec-ceb9-4dda-b1cb-3f03d505a647\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561265-qt4pj" Mar 16 15:45:00 crc kubenswrapper[5120]: I0316 15:45:00.299947 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["metallb-system/metallb-operator-controller-manager-646b4d4dc-sshj9"] Mar 16 15:45:00 crc kubenswrapper[5120]: I0316 15:45:00.304325 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="metallb-system/metallb-operator-controller-manager-646b4d4dc-sshj9" Mar 16 15:45:00 crc kubenswrapper[5120]: I0316 15:45:00.306372 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"metallb-system\"/\"metallb-operator-webhook-server-cert\"" Mar 16 15:45:00 crc kubenswrapper[5120]: I0316 15:45:00.306592 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"metallb-system\"/\"manager-account-dockercfg-tbmq6\"" Mar 16 15:45:00 crc kubenswrapper[5120]: I0316 15:45:00.306782 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"metallb-system\"/\"metallb-operator-controller-manager-service-cert\"" Mar 16 15:45:00 crc kubenswrapper[5120]: I0316 15:45:00.306938 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"metallb-system\"/\"openshift-service-ca.crt\"" Mar 16 15:45:00 crc kubenswrapper[5120]: I0316 15:45:00.307151 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"metallb-system\"/\"kube-root-ca.crt\"" Mar 16 15:45:00 crc kubenswrapper[5120]: I0316 15:45:00.310207 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["metallb-system/metallb-operator-controller-manager-646b4d4dc-sshj9"] Mar 16 15:45:00 crc kubenswrapper[5120]: I0316 15:45:00.370880 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2stb5\" (UniqueName: \"kubernetes.io/projected/d78869ec-ceb9-4dda-b1cb-3f03d505a647-kube-api-access-2stb5\") pod \"collect-profiles-29561265-qt4pj\" (UID: \"d78869ec-ceb9-4dda-b1cb-3f03d505a647\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561265-qt4pj" Mar 16 15:45:00 crc kubenswrapper[5120]: I0316 15:45:00.370982 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/d78869ec-ceb9-4dda-b1cb-3f03d505a647-secret-volume\") pod \"collect-profiles-29561265-qt4pj\" (UID: \"d78869ec-ceb9-4dda-b1cb-3f03d505a647\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561265-qt4pj" Mar 16 15:45:00 crc kubenswrapper[5120]: I0316 15:45:00.371036 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d78869ec-ceb9-4dda-b1cb-3f03d505a647-config-volume\") pod \"collect-profiles-29561265-qt4pj\" (UID: \"d78869ec-ceb9-4dda-b1cb-3f03d505a647\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561265-qt4pj" Mar 16 15:45:00 crc kubenswrapper[5120]: I0316 15:45:00.372051 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d78869ec-ceb9-4dda-b1cb-3f03d505a647-config-volume\") pod \"collect-profiles-29561265-qt4pj\" (UID: \"d78869ec-ceb9-4dda-b1cb-3f03d505a647\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561265-qt4pj" Mar 16 15:45:00 crc kubenswrapper[5120]: I0316 15:45:00.391385 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/d78869ec-ceb9-4dda-b1cb-3f03d505a647-secret-volume\") pod \"collect-profiles-29561265-qt4pj\" (UID: \"d78869ec-ceb9-4dda-b1cb-3f03d505a647\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561265-qt4pj" Mar 16 15:45:00 crc kubenswrapper[5120]: I0316 15:45:00.396911 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2stb5\" (UniqueName: \"kubernetes.io/projected/d78869ec-ceb9-4dda-b1cb-3f03d505a647-kube-api-access-2stb5\") pod \"collect-profiles-29561265-qt4pj\" (UID: \"d78869ec-ceb9-4dda-b1cb-3f03d505a647\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561265-qt4pj" Mar 16 15:45:00 crc kubenswrapper[5120]: I0316 15:45:00.419475 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-operators-v5ldb" Mar 16 15:45:00 crc kubenswrapper[5120]: I0316 15:45:00.461478 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-operators-v5ldb" Mar 16 15:45:00 crc kubenswrapper[5120]: I0316 15:45:00.472442 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bdee5404-16e7-4f56-9dd8-c894470335f0-apiservice-cert\") pod \"metallb-operator-controller-manager-646b4d4dc-sshj9\" (UID: \"bdee5404-16e7-4f56-9dd8-c894470335f0\") " pod="metallb-system/metallb-operator-controller-manager-646b4d4dc-sshj9" Mar 16 15:45:00 crc kubenswrapper[5120]: I0316 15:45:00.472480 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bdee5404-16e7-4f56-9dd8-c894470335f0-webhook-cert\") pod \"metallb-operator-controller-manager-646b4d4dc-sshj9\" (UID: \"bdee5404-16e7-4f56-9dd8-c894470335f0\") " pod="metallb-system/metallb-operator-controller-manager-646b4d4dc-sshj9" Mar 16 15:45:00 crc kubenswrapper[5120]: I0316 15:45:00.472552 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67k7q\" (UniqueName: \"kubernetes.io/projected/bdee5404-16e7-4f56-9dd8-c894470335f0-kube-api-access-67k7q\") pod \"metallb-operator-controller-manager-646b4d4dc-sshj9\" (UID: \"bdee5404-16e7-4f56-9dd8-c894470335f0\") " pod="metallb-system/metallb-operator-controller-manager-646b4d4dc-sshj9" Mar 16 15:45:00 crc kubenswrapper[5120]: I0316 15:45:00.485745 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29561265-qt4pj" Mar 16 15:45:00 crc kubenswrapper[5120]: I0316 15:45:00.571770 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-j69cz" event={"ID":"9ffb539b-b7f1-4506-96a9-7befa1acf76c","Type":"ContainerStarted","Data":"cd6dff4e70534cfcc41dc3ddc3e6d522420fec69b9f7977653a52a5e2e440d31"} Mar 16 15:45:00 crc kubenswrapper[5120]: I0316 15:45:00.573564 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-67k7q\" (UniqueName: \"kubernetes.io/projected/bdee5404-16e7-4f56-9dd8-c894470335f0-kube-api-access-67k7q\") pod \"metallb-operator-controller-manager-646b4d4dc-sshj9\" (UID: \"bdee5404-16e7-4f56-9dd8-c894470335f0\") " pod="metallb-system/metallb-operator-controller-manager-646b4d4dc-sshj9" Mar 16 15:45:00 crc kubenswrapper[5120]: I0316 15:45:00.573658 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bdee5404-16e7-4f56-9dd8-c894470335f0-apiservice-cert\") pod \"metallb-operator-controller-manager-646b4d4dc-sshj9\" (UID: \"bdee5404-16e7-4f56-9dd8-c894470335f0\") " pod="metallb-system/metallb-operator-controller-manager-646b4d4dc-sshj9" Mar 16 15:45:00 crc kubenswrapper[5120]: I0316 15:45:00.573694 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bdee5404-16e7-4f56-9dd8-c894470335f0-webhook-cert\") pod \"metallb-operator-controller-manager-646b4d4dc-sshj9\" (UID: \"bdee5404-16e7-4f56-9dd8-c894470335f0\") " pod="metallb-system/metallb-operator-controller-manager-646b4d4dc-sshj9" Mar 16 15:45:00 crc kubenswrapper[5120]: I0316 15:45:00.578641 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bdee5404-16e7-4f56-9dd8-c894470335f0-apiservice-cert\") pod \"metallb-operator-controller-manager-646b4d4dc-sshj9\" (UID: \"bdee5404-16e7-4f56-9dd8-c894470335f0\") " pod="metallb-system/metallb-operator-controller-manager-646b4d4dc-sshj9" Mar 16 15:45:00 crc kubenswrapper[5120]: I0316 15:45:00.582453 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bdee5404-16e7-4f56-9dd8-c894470335f0-webhook-cert\") pod \"metallb-operator-controller-manager-646b4d4dc-sshj9\" (UID: \"bdee5404-16e7-4f56-9dd8-c894470335f0\") " pod="metallb-system/metallb-operator-controller-manager-646b4d4dc-sshj9" Mar 16 15:45:00 crc kubenswrapper[5120]: I0316 15:45:00.596840 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-67k7q\" (UniqueName: \"kubernetes.io/projected/bdee5404-16e7-4f56-9dd8-c894470335f0-kube-api-access-67k7q\") pod \"metallb-operator-controller-manager-646b4d4dc-sshj9\" (UID: \"bdee5404-16e7-4f56-9dd8-c894470335f0\") " pod="metallb-system/metallb-operator-controller-manager-646b4d4dc-sshj9" Mar 16 15:45:00 crc kubenswrapper[5120]: I0316 15:45:00.603402 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/certified-operators-j69cz" podStartSLOduration=4.868884092 podStartE2EDuration="5.603381437s" podCreationTimestamp="2026-03-16 15:44:55 +0000 UTC" firstStartedPulling="2026-03-16 15:44:57.540991169 +0000 UTC m=+799.694922826" lastFinishedPulling="2026-03-16 15:44:58.275488514 +0000 UTC m=+800.429420171" observedRunningTime="2026-03-16 15:45:00.599692794 +0000 UTC m=+802.753624461" watchObservedRunningTime="2026-03-16 15:45:00.603381437 +0000 UTC m=+802.757313094" Mar 16 15:45:00 crc kubenswrapper[5120]: I0316 15:45:00.622398 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="metallb-system/metallb-operator-controller-manager-646b4d4dc-sshj9" Mar 16 15:45:00 crc kubenswrapper[5120]: I0316 15:45:00.754068 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["metallb-system/metallb-operator-webhook-server-5cc9c9d8fc-q6ts6"] Mar 16 15:45:00 crc kubenswrapper[5120]: I0316 15:45:00.767627 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="metallb-system/metallb-operator-webhook-server-5cc9c9d8fc-q6ts6" Mar 16 15:45:00 crc kubenswrapper[5120]: I0316 15:45:00.769279 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["metallb-system/metallb-operator-webhook-server-5cc9c9d8fc-q6ts6"] Mar 16 15:45:00 crc kubenswrapper[5120]: I0316 15:45:00.772185 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"metallb-system\"/\"metallb-webhook-cert\"" Mar 16 15:45:00 crc kubenswrapper[5120]: I0316 15:45:00.772354 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"metallb-system\"/\"controller-dockercfg-vx5pz\"" Mar 16 15:45:00 crc kubenswrapper[5120]: I0316 15:45:00.772491 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"metallb-system\"/\"metallb-operator-webhook-server-service-cert\"" Mar 16 15:45:00 crc kubenswrapper[5120]: I0316 15:45:00.818573 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29561265-qt4pj"] Mar 16 15:45:00 crc kubenswrapper[5120]: I0316 15:45:00.883342 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b78f2b18-8b3b-4ee9-be57-670a88f38fc0-apiservice-cert\") pod \"metallb-operator-webhook-server-5cc9c9d8fc-q6ts6\" (UID: \"b78f2b18-8b3b-4ee9-be57-670a88f38fc0\") " pod="metallb-system/metallb-operator-webhook-server-5cc9c9d8fc-q6ts6" Mar 16 15:45:00 crc kubenswrapper[5120]: I0316 15:45:00.883393 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7c4n6\" (UniqueName: \"kubernetes.io/projected/b78f2b18-8b3b-4ee9-be57-670a88f38fc0-kube-api-access-7c4n6\") pod \"metallb-operator-webhook-server-5cc9c9d8fc-q6ts6\" (UID: \"b78f2b18-8b3b-4ee9-be57-670a88f38fc0\") " pod="metallb-system/metallb-operator-webhook-server-5cc9c9d8fc-q6ts6" Mar 16 15:45:00 crc kubenswrapper[5120]: I0316 15:45:00.883469 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b78f2b18-8b3b-4ee9-be57-670a88f38fc0-webhook-cert\") pod \"metallb-operator-webhook-server-5cc9c9d8fc-q6ts6\" (UID: \"b78f2b18-8b3b-4ee9-be57-670a88f38fc0\") " pod="metallb-system/metallb-operator-webhook-server-5cc9c9d8fc-q6ts6" Mar 16 15:45:00 crc kubenswrapper[5120]: I0316 15:45:00.965560 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["metallb-system/metallb-operator-controller-manager-646b4d4dc-sshj9"] Mar 16 15:45:00 crc kubenswrapper[5120]: I0316 15:45:00.985741 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b78f2b18-8b3b-4ee9-be57-670a88f38fc0-webhook-cert\") pod \"metallb-operator-webhook-server-5cc9c9d8fc-q6ts6\" (UID: \"b78f2b18-8b3b-4ee9-be57-670a88f38fc0\") " pod="metallb-system/metallb-operator-webhook-server-5cc9c9d8fc-q6ts6" Mar 16 15:45:00 crc kubenswrapper[5120]: I0316 15:45:00.986175 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b78f2b18-8b3b-4ee9-be57-670a88f38fc0-apiservice-cert\") pod \"metallb-operator-webhook-server-5cc9c9d8fc-q6ts6\" (UID: \"b78f2b18-8b3b-4ee9-be57-670a88f38fc0\") " pod="metallb-system/metallb-operator-webhook-server-5cc9c9d8fc-q6ts6" Mar 16 15:45:00 crc kubenswrapper[5120]: I0316 15:45:00.986216 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7c4n6\" (UniqueName: \"kubernetes.io/projected/b78f2b18-8b3b-4ee9-be57-670a88f38fc0-kube-api-access-7c4n6\") pod \"metallb-operator-webhook-server-5cc9c9d8fc-q6ts6\" (UID: \"b78f2b18-8b3b-4ee9-be57-670a88f38fc0\") " pod="metallb-system/metallb-operator-webhook-server-5cc9c9d8fc-q6ts6" Mar 16 15:45:00 crc kubenswrapper[5120]: W0316 15:45:00.988593 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdee5404_16e7_4f56_9dd8_c894470335f0.slice/crio-30e424f87f8554b904fb5a46ad872b1e65808a8b7df14c421bc9e9bde74c66fb WatchSource:0}: Error finding container 30e424f87f8554b904fb5a46ad872b1e65808a8b7df14c421bc9e9bde74c66fb: Status 404 returned error can't find the container with id 30e424f87f8554b904fb5a46ad872b1e65808a8b7df14c421bc9e9bde74c66fb Mar 16 15:45:00 crc kubenswrapper[5120]: I0316 15:45:00.991818 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b78f2b18-8b3b-4ee9-be57-670a88f38fc0-webhook-cert\") pod \"metallb-operator-webhook-server-5cc9c9d8fc-q6ts6\" (UID: \"b78f2b18-8b3b-4ee9-be57-670a88f38fc0\") " pod="metallb-system/metallb-operator-webhook-server-5cc9c9d8fc-q6ts6" Mar 16 15:45:00 crc kubenswrapper[5120]: I0316 15:45:00.998385 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b78f2b18-8b3b-4ee9-be57-670a88f38fc0-apiservice-cert\") pod \"metallb-operator-webhook-server-5cc9c9d8fc-q6ts6\" (UID: \"b78f2b18-8b3b-4ee9-be57-670a88f38fc0\") " pod="metallb-system/metallb-operator-webhook-server-5cc9c9d8fc-q6ts6" Mar 16 15:45:01 crc kubenswrapper[5120]: I0316 15:45:01.005202 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7c4n6\" (UniqueName: \"kubernetes.io/projected/b78f2b18-8b3b-4ee9-be57-670a88f38fc0-kube-api-access-7c4n6\") pod \"metallb-operator-webhook-server-5cc9c9d8fc-q6ts6\" (UID: \"b78f2b18-8b3b-4ee9-be57-670a88f38fc0\") " pod="metallb-system/metallb-operator-webhook-server-5cc9c9d8fc-q6ts6" Mar 16 15:45:01 crc kubenswrapper[5120]: I0316 15:45:01.097459 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="metallb-system/metallb-operator-webhook-server-5cc9c9d8fc-q6ts6" Mar 16 15:45:01 crc kubenswrapper[5120]: I0316 15:45:01.577944 5120 generic.go:358] "Generic (PLEG): container finished" podID="d78869ec-ceb9-4dda-b1cb-3f03d505a647" containerID="f21b7fd2ffaaa426e057b3f52813d44d88d29e2685857615b0312b38381ba9de" exitCode=0 Mar 16 15:45:01 crc kubenswrapper[5120]: I0316 15:45:01.578135 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/collect-profiles-29561265-qt4pj" event={"ID":"d78869ec-ceb9-4dda-b1cb-3f03d505a647","Type":"ContainerDied","Data":"f21b7fd2ffaaa426e057b3f52813d44d88d29e2685857615b0312b38381ba9de"} Mar 16 15:45:01 crc kubenswrapper[5120]: I0316 15:45:01.578283 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/collect-profiles-29561265-qt4pj" event={"ID":"d78869ec-ceb9-4dda-b1cb-3f03d505a647","Type":"ContainerStarted","Data":"6bfa07ee11cf2026a3bb653bedb185522a30ed5752cb7c7708f4c2643c59f510"} Mar 16 15:45:01 crc kubenswrapper[5120]: I0316 15:45:01.580462 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="metallb-system/metallb-operator-controller-manager-646b4d4dc-sshj9" event={"ID":"bdee5404-16e7-4f56-9dd8-c894470335f0","Type":"ContainerStarted","Data":"30e424f87f8554b904fb5a46ad872b1e65808a8b7df14c421bc9e9bde74c66fb"} Mar 16 15:45:01 crc kubenswrapper[5120]: I0316 15:45:01.665633 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["metallb-system/metallb-operator-webhook-server-5cc9c9d8fc-q6ts6"] Mar 16 15:45:01 crc kubenswrapper[5120]: W0316 15:45:01.669168 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb78f2b18_8b3b_4ee9_be57_670a88f38fc0.slice/crio-659b4410ea1e57a14f031fcc365f2c6f595730ceb61eccf9d6695dc48189f7d6 WatchSource:0}: Error finding container 659b4410ea1e57a14f031fcc365f2c6f595730ceb61eccf9d6695dc48189f7d6: Status 404 returned error can't find the container with id 659b4410ea1e57a14f031fcc365f2c6f595730ceb61eccf9d6695dc48189f7d6 Mar 16 15:45:02 crc kubenswrapper[5120]: I0316 15:45:02.585391 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="metallb-system/metallb-operator-webhook-server-5cc9c9d8fc-q6ts6" event={"ID":"b78f2b18-8b3b-4ee9-be57-670a88f38fc0","Type":"ContainerStarted","Data":"659b4410ea1e57a14f031fcc365f2c6f595730ceb61eccf9d6695dc48189f7d6"} Mar 16 15:45:02 crc kubenswrapper[5120]: I0316 15:45:02.877957 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29561265-qt4pj" Mar 16 15:45:03 crc kubenswrapper[5120]: I0316 15:45:03.018412 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/d78869ec-ceb9-4dda-b1cb-3f03d505a647-secret-volume\") pod \"d78869ec-ceb9-4dda-b1cb-3f03d505a647\" (UID: \"d78869ec-ceb9-4dda-b1cb-3f03d505a647\") " Mar 16 15:45:03 crc kubenswrapper[5120]: I0316 15:45:03.018460 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d78869ec-ceb9-4dda-b1cb-3f03d505a647-config-volume\") pod \"d78869ec-ceb9-4dda-b1cb-3f03d505a647\" (UID: \"d78869ec-ceb9-4dda-b1cb-3f03d505a647\") " Mar 16 15:45:03 crc kubenswrapper[5120]: I0316 15:45:03.018497 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2stb5\" (UniqueName: \"kubernetes.io/projected/d78869ec-ceb9-4dda-b1cb-3f03d505a647-kube-api-access-2stb5\") pod \"d78869ec-ceb9-4dda-b1cb-3f03d505a647\" (UID: \"d78869ec-ceb9-4dda-b1cb-3f03d505a647\") " Mar 16 15:45:03 crc kubenswrapper[5120]: I0316 15:45:03.019635 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d78869ec-ceb9-4dda-b1cb-3f03d505a647-config-volume" (OuterVolumeSpecName: "config-volume") pod "d78869ec-ceb9-4dda-b1cb-3f03d505a647" (UID: "d78869ec-ceb9-4dda-b1cb-3f03d505a647"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:45:03 crc kubenswrapper[5120]: I0316 15:45:03.051384 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d78869ec-ceb9-4dda-b1cb-3f03d505a647-secret-volume" (OuterVolumeSpecName: "secret-volume") pod "d78869ec-ceb9-4dda-b1cb-3f03d505a647" (UID: "d78869ec-ceb9-4dda-b1cb-3f03d505a647"). InnerVolumeSpecName "secret-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:45:03 crc kubenswrapper[5120]: I0316 15:45:03.055362 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d78869ec-ceb9-4dda-b1cb-3f03d505a647-kube-api-access-2stb5" (OuterVolumeSpecName: "kube-api-access-2stb5") pod "d78869ec-ceb9-4dda-b1cb-3f03d505a647" (UID: "d78869ec-ceb9-4dda-b1cb-3f03d505a647"). InnerVolumeSpecName "kube-api-access-2stb5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:45:03 crc kubenswrapper[5120]: I0316 15:45:03.120291 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2stb5\" (UniqueName: \"kubernetes.io/projected/d78869ec-ceb9-4dda-b1cb-3f03d505a647-kube-api-access-2stb5\") on node \"crc\" DevicePath \"\"" Mar 16 15:45:03 crc kubenswrapper[5120]: I0316 15:45:03.120334 5120 reconciler_common.go:299] "Volume detached for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/d78869ec-ceb9-4dda-b1cb-3f03d505a647-secret-volume\") on node \"crc\" DevicePath \"\"" Mar 16 15:45:03 crc kubenswrapper[5120]: I0316 15:45:03.120346 5120 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d78869ec-ceb9-4dda-b1cb-3f03d505a647-config-volume\") on node \"crc\" DevicePath \"\"" Mar 16 15:45:03 crc kubenswrapper[5120]: I0316 15:45:03.594811 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/collect-profiles-29561265-qt4pj" event={"ID":"d78869ec-ceb9-4dda-b1cb-3f03d505a647","Type":"ContainerDied","Data":"6bfa07ee11cf2026a3bb653bedb185522a30ed5752cb7c7708f4c2643c59f510"} Mar 16 15:45:03 crc kubenswrapper[5120]: I0316 15:45:03.594881 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6bfa07ee11cf2026a3bb653bedb185522a30ed5752cb7c7708f4c2643c59f510" Mar 16 15:45:03 crc kubenswrapper[5120]: I0316 15:45:03.594985 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29561265-qt4pj" Mar 16 15:45:04 crc kubenswrapper[5120]: I0316 15:45:04.055610 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-operators-v5ldb"] Mar 16 15:45:04 crc kubenswrapper[5120]: I0316 15:45:04.055975 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-marketplace/redhat-operators-v5ldb" podUID="432432c1-d09c-45fe-8773-8bfbd6e38446" containerName="registry-server" containerID="cri-o://740e80aac206ffe6966b822df00e64353855bda9346b1cfb9f2ce175871a18de" gracePeriod=2 Mar 16 15:45:04 crc kubenswrapper[5120]: I0316 15:45:04.607600 5120 generic.go:358] "Generic (PLEG): container finished" podID="432432c1-d09c-45fe-8773-8bfbd6e38446" containerID="740e80aac206ffe6966b822df00e64353855bda9346b1cfb9f2ce175871a18de" exitCode=0 Mar 16 15:45:04 crc kubenswrapper[5120]: I0316 15:45:04.607810 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-v5ldb" event={"ID":"432432c1-d09c-45fe-8773-8bfbd6e38446","Type":"ContainerDied","Data":"740e80aac206ffe6966b822df00e64353855bda9346b1cfb9f2ce175871a18de"} Mar 16 15:45:05 crc kubenswrapper[5120]: I0316 15:45:05.275197 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-v5ldb" Mar 16 15:45:05 crc kubenswrapper[5120]: I0316 15:45:05.448410 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/432432c1-d09c-45fe-8773-8bfbd6e38446-catalog-content\") pod \"432432c1-d09c-45fe-8773-8bfbd6e38446\" (UID: \"432432c1-d09c-45fe-8773-8bfbd6e38446\") " Mar 16 15:45:05 crc kubenswrapper[5120]: I0316 15:45:05.448844 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/432432c1-d09c-45fe-8773-8bfbd6e38446-utilities\") pod \"432432c1-d09c-45fe-8773-8bfbd6e38446\" (UID: \"432432c1-d09c-45fe-8773-8bfbd6e38446\") " Mar 16 15:45:05 crc kubenswrapper[5120]: I0316 15:45:05.448889 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kpzvm\" (UniqueName: \"kubernetes.io/projected/432432c1-d09c-45fe-8773-8bfbd6e38446-kube-api-access-kpzvm\") pod \"432432c1-d09c-45fe-8773-8bfbd6e38446\" (UID: \"432432c1-d09c-45fe-8773-8bfbd6e38446\") " Mar 16 15:45:05 crc kubenswrapper[5120]: I0316 15:45:05.449880 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/432432c1-d09c-45fe-8773-8bfbd6e38446-utilities" (OuterVolumeSpecName: "utilities") pod "432432c1-d09c-45fe-8773-8bfbd6e38446" (UID: "432432c1-d09c-45fe-8773-8bfbd6e38446"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:45:05 crc kubenswrapper[5120]: I0316 15:45:05.472940 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/432432c1-d09c-45fe-8773-8bfbd6e38446-kube-api-access-kpzvm" (OuterVolumeSpecName: "kube-api-access-kpzvm") pod "432432c1-d09c-45fe-8773-8bfbd6e38446" (UID: "432432c1-d09c-45fe-8773-8bfbd6e38446"). InnerVolumeSpecName "kube-api-access-kpzvm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:45:05 crc kubenswrapper[5120]: I0316 15:45:05.550448 5120 reconciler_common.go:299] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/432432c1-d09c-45fe-8773-8bfbd6e38446-utilities\") on node \"crc\" DevicePath \"\"" Mar 16 15:45:05 crc kubenswrapper[5120]: I0316 15:45:05.550486 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kpzvm\" (UniqueName: \"kubernetes.io/projected/432432c1-d09c-45fe-8773-8bfbd6e38446-kube-api-access-kpzvm\") on node \"crc\" DevicePath \"\"" Mar 16 15:45:05 crc kubenswrapper[5120]: I0316 15:45:05.554020 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/432432c1-d09c-45fe-8773-8bfbd6e38446-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "432432c1-d09c-45fe-8773-8bfbd6e38446" (UID: "432432c1-d09c-45fe-8773-8bfbd6e38446"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:45:05 crc kubenswrapper[5120]: I0316 15:45:05.616624 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="metallb-system/metallb-operator-controller-manager-646b4d4dc-sshj9" event={"ID":"bdee5404-16e7-4f56-9dd8-c894470335f0","Type":"ContainerStarted","Data":"6d5f271e3bd2ade4030a2d19f80599691dbcdd3e7e4df94c16ec13e402591153"} Mar 16 15:45:05 crc kubenswrapper[5120]: I0316 15:45:05.616873 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="metallb-system/metallb-operator-controller-manager-646b4d4dc-sshj9" Mar 16 15:45:05 crc kubenswrapper[5120]: I0316 15:45:05.618493 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-v5ldb" Mar 16 15:45:05 crc kubenswrapper[5120]: I0316 15:45:05.618513 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-v5ldb" event={"ID":"432432c1-d09c-45fe-8773-8bfbd6e38446","Type":"ContainerDied","Data":"06190b89363763d384f0f885e884b53f6d5bc491cd5c6c87cf318e796688524b"} Mar 16 15:45:05 crc kubenswrapper[5120]: I0316 15:45:05.618559 5120 scope.go:117] "RemoveContainer" containerID="740e80aac206ffe6966b822df00e64353855bda9346b1cfb9f2ce175871a18de" Mar 16 15:45:05 crc kubenswrapper[5120]: I0316 15:45:05.645387 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="metallb-system/metallb-operator-controller-manager-646b4d4dc-sshj9" podStartSLOduration=1.526967832 podStartE2EDuration="5.645359954s" podCreationTimestamp="2026-03-16 15:45:00 +0000 UTC" firstStartedPulling="2026-03-16 15:45:00.998442255 +0000 UTC m=+803.152373912" lastFinishedPulling="2026-03-16 15:45:05.116834377 +0000 UTC m=+807.270766034" observedRunningTime="2026-03-16 15:45:05.640834026 +0000 UTC m=+807.794765683" watchObservedRunningTime="2026-03-16 15:45:05.645359954 +0000 UTC m=+807.799291611" Mar 16 15:45:05 crc kubenswrapper[5120]: I0316 15:45:05.651666 5120 reconciler_common.go:299] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/432432c1-d09c-45fe-8773-8bfbd6e38446-catalog-content\") on node \"crc\" DevicePath \"\"" Mar 16 15:45:05 crc kubenswrapper[5120]: I0316 15:45:05.658919 5120 scope.go:117] "RemoveContainer" containerID="5266e4a3f6d925be9bf5a3c127c9115c82cad9aa74d8aeabe8cb77766f62eee2" Mar 16 15:45:05 crc kubenswrapper[5120]: I0316 15:45:05.669180 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-operators-v5ldb"] Mar 16 15:45:05 crc kubenswrapper[5120]: I0316 15:45:05.672481 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/redhat-operators-v5ldb"] Mar 16 15:45:05 crc kubenswrapper[5120]: I0316 15:45:05.698158 5120 scope.go:117] "RemoveContainer" containerID="8608b1628df7923aeb915a5b5deb50247be8c4f22ca56e75fea6ef332f24ed5b" Mar 16 15:45:05 crc kubenswrapper[5120]: I0316 15:45:05.889514 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-marketplace/certified-operators-j69cz" Mar 16 15:45:05 crc kubenswrapper[5120]: I0316 15:45:05.889564 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/certified-operators-j69cz" Mar 16 15:45:05 crc kubenswrapper[5120]: I0316 15:45:05.939877 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/certified-operators-j69cz" Mar 16 15:45:06 crc kubenswrapper[5120]: I0316 15:45:06.660624 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/certified-operators-j69cz" Mar 16 15:45:06 crc kubenswrapper[5120]: I0316 15:45:06.671833 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="432432c1-d09c-45fe-8773-8bfbd6e38446" path="/var/lib/kubelet/pods/432432c1-d09c-45fe-8773-8bfbd6e38446/volumes" Mar 16 15:45:08 crc kubenswrapper[5120]: I0316 15:45:08.475529 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/certified-operators-j69cz"] Mar 16 15:45:08 crc kubenswrapper[5120]: I0316 15:45:08.644221 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-marketplace/certified-operators-j69cz" podUID="9ffb539b-b7f1-4506-96a9-7befa1acf76c" containerName="registry-server" containerID="cri-o://cd6dff4e70534cfcc41dc3ddc3e6d522420fec69b9f7977653a52a5e2e440d31" gracePeriod=2 Mar 16 15:45:09 crc kubenswrapper[5120]: I0316 15:45:09.037574 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-j69cz" Mar 16 15:45:09 crc kubenswrapper[5120]: I0316 15:45:09.096752 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/9ffb539b-b7f1-4506-96a9-7befa1acf76c-catalog-content\") pod \"9ffb539b-b7f1-4506-96a9-7befa1acf76c\" (UID: \"9ffb539b-b7f1-4506-96a9-7befa1acf76c\") " Mar 16 15:45:09 crc kubenswrapper[5120]: I0316 15:45:09.097182 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/9ffb539b-b7f1-4506-96a9-7befa1acf76c-utilities\") pod \"9ffb539b-b7f1-4506-96a9-7befa1acf76c\" (UID: \"9ffb539b-b7f1-4506-96a9-7befa1acf76c\") " Mar 16 15:45:09 crc kubenswrapper[5120]: I0316 15:45:09.097257 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jzlnp\" (UniqueName: \"kubernetes.io/projected/9ffb539b-b7f1-4506-96a9-7befa1acf76c-kube-api-access-jzlnp\") pod \"9ffb539b-b7f1-4506-96a9-7befa1acf76c\" (UID: \"9ffb539b-b7f1-4506-96a9-7befa1acf76c\") " Mar 16 15:45:09 crc kubenswrapper[5120]: I0316 15:45:09.099389 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ffb539b-b7f1-4506-96a9-7befa1acf76c-utilities" (OuterVolumeSpecName: "utilities") pod "9ffb539b-b7f1-4506-96a9-7befa1acf76c" (UID: "9ffb539b-b7f1-4506-96a9-7befa1acf76c"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:45:09 crc kubenswrapper[5120]: I0316 15:45:09.103772 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ffb539b-b7f1-4506-96a9-7befa1acf76c-kube-api-access-jzlnp" (OuterVolumeSpecName: "kube-api-access-jzlnp") pod "9ffb539b-b7f1-4506-96a9-7befa1acf76c" (UID: "9ffb539b-b7f1-4506-96a9-7befa1acf76c"). InnerVolumeSpecName "kube-api-access-jzlnp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:45:09 crc kubenswrapper[5120]: I0316 15:45:09.130264 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ffb539b-b7f1-4506-96a9-7befa1acf76c-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "9ffb539b-b7f1-4506-96a9-7befa1acf76c" (UID: "9ffb539b-b7f1-4506-96a9-7befa1acf76c"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:45:09 crc kubenswrapper[5120]: I0316 15:45:09.198877 5120 reconciler_common.go:299] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/9ffb539b-b7f1-4506-96a9-7befa1acf76c-catalog-content\") on node \"crc\" DevicePath \"\"" Mar 16 15:45:09 crc kubenswrapper[5120]: I0316 15:45:09.198906 5120 reconciler_common.go:299] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/9ffb539b-b7f1-4506-96a9-7befa1acf76c-utilities\") on node \"crc\" DevicePath \"\"" Mar 16 15:45:09 crc kubenswrapper[5120]: I0316 15:45:09.198919 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jzlnp\" (UniqueName: \"kubernetes.io/projected/9ffb539b-b7f1-4506-96a9-7befa1acf76c-kube-api-access-jzlnp\") on node \"crc\" DevicePath \"\"" Mar 16 15:45:09 crc kubenswrapper[5120]: I0316 15:45:09.653359 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="metallb-system/metallb-operator-webhook-server-5cc9c9d8fc-q6ts6" event={"ID":"b78f2b18-8b3b-4ee9-be57-670a88f38fc0","Type":"ContainerStarted","Data":"097e64eedd9ccc3428b4c0227b7b68b89c7360fd1bc162b9dfb5cff2bc520c35"} Mar 16 15:45:09 crc kubenswrapper[5120]: I0316 15:45:09.654167 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="metallb-system/metallb-operator-webhook-server-5cc9c9d8fc-q6ts6" Mar 16 15:45:09 crc kubenswrapper[5120]: I0316 15:45:09.656440 5120 generic.go:358] "Generic (PLEG): container finished" podID="9ffb539b-b7f1-4506-96a9-7befa1acf76c" containerID="cd6dff4e70534cfcc41dc3ddc3e6d522420fec69b9f7977653a52a5e2e440d31" exitCode=0 Mar 16 15:45:09 crc kubenswrapper[5120]: I0316 15:45:09.656503 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-j69cz" event={"ID":"9ffb539b-b7f1-4506-96a9-7befa1acf76c","Type":"ContainerDied","Data":"cd6dff4e70534cfcc41dc3ddc3e6d522420fec69b9f7977653a52a5e2e440d31"} Mar 16 15:45:09 crc kubenswrapper[5120]: I0316 15:45:09.656587 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-j69cz" event={"ID":"9ffb539b-b7f1-4506-96a9-7befa1acf76c","Type":"ContainerDied","Data":"df90b3b9f0aa0be3458acb709d16c8109ff2b0ce56acb6643029cca72e97b7ca"} Mar 16 15:45:09 crc kubenswrapper[5120]: I0316 15:45:09.656607 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-j69cz" Mar 16 15:45:09 crc kubenswrapper[5120]: I0316 15:45:09.656632 5120 scope.go:117] "RemoveContainer" containerID="cd6dff4e70534cfcc41dc3ddc3e6d522420fec69b9f7977653a52a5e2e440d31" Mar 16 15:45:09 crc kubenswrapper[5120]: I0316 15:45:09.677517 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="metallb-system/metallb-operator-webhook-server-5cc9c9d8fc-q6ts6" podStartSLOduration=2.714528731 podStartE2EDuration="9.67749621s" podCreationTimestamp="2026-03-16 15:45:00 +0000 UTC" firstStartedPulling="2026-03-16 15:45:01.673065608 +0000 UTC m=+803.826997265" lastFinishedPulling="2026-03-16 15:45:08.636033077 +0000 UTC m=+810.789964744" observedRunningTime="2026-03-16 15:45:09.673377754 +0000 UTC m=+811.827309421" watchObservedRunningTime="2026-03-16 15:45:09.67749621 +0000 UTC m=+811.831427877" Mar 16 15:45:09 crc kubenswrapper[5120]: I0316 15:45:09.684276 5120 scope.go:117] "RemoveContainer" containerID="00606bf282dae1390db515357be7f7073feff247181a53883351873da95e2013" Mar 16 15:45:09 crc kubenswrapper[5120]: I0316 15:45:09.692988 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/certified-operators-j69cz"] Mar 16 15:45:09 crc kubenswrapper[5120]: I0316 15:45:09.698807 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/certified-operators-j69cz"] Mar 16 15:45:09 crc kubenswrapper[5120]: I0316 15:45:09.714631 5120 scope.go:117] "RemoveContainer" containerID="cc5537d3430afb17040e3919c06649e1c54e0ca5e38474d0fc8ef01cd8296715" Mar 16 15:45:09 crc kubenswrapper[5120]: I0316 15:45:09.731970 5120 scope.go:117] "RemoveContainer" containerID="cd6dff4e70534cfcc41dc3ddc3e6d522420fec69b9f7977653a52a5e2e440d31" Mar 16 15:45:09 crc kubenswrapper[5120]: E0316 15:45:09.732281 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd6dff4e70534cfcc41dc3ddc3e6d522420fec69b9f7977653a52a5e2e440d31\": container with ID starting with cd6dff4e70534cfcc41dc3ddc3e6d522420fec69b9f7977653a52a5e2e440d31 not found: ID does not exist" containerID="cd6dff4e70534cfcc41dc3ddc3e6d522420fec69b9f7977653a52a5e2e440d31" Mar 16 15:45:09 crc kubenswrapper[5120]: I0316 15:45:09.732311 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd6dff4e70534cfcc41dc3ddc3e6d522420fec69b9f7977653a52a5e2e440d31"} err="failed to get container status \"cd6dff4e70534cfcc41dc3ddc3e6d522420fec69b9f7977653a52a5e2e440d31\": rpc error: code = NotFound desc = could not find container \"cd6dff4e70534cfcc41dc3ddc3e6d522420fec69b9f7977653a52a5e2e440d31\": container with ID starting with cd6dff4e70534cfcc41dc3ddc3e6d522420fec69b9f7977653a52a5e2e440d31 not found: ID does not exist" Mar 16 15:45:09 crc kubenswrapper[5120]: I0316 15:45:09.732334 5120 scope.go:117] "RemoveContainer" containerID="00606bf282dae1390db515357be7f7073feff247181a53883351873da95e2013" Mar 16 15:45:09 crc kubenswrapper[5120]: E0316 15:45:09.732891 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"00606bf282dae1390db515357be7f7073feff247181a53883351873da95e2013\": container with ID starting with 00606bf282dae1390db515357be7f7073feff247181a53883351873da95e2013 not found: ID does not exist" containerID="00606bf282dae1390db515357be7f7073feff247181a53883351873da95e2013" Mar 16 15:45:09 crc kubenswrapper[5120]: I0316 15:45:09.732983 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00606bf282dae1390db515357be7f7073feff247181a53883351873da95e2013"} err="failed to get container status \"00606bf282dae1390db515357be7f7073feff247181a53883351873da95e2013\": rpc error: code = NotFound desc = could not find container \"00606bf282dae1390db515357be7f7073feff247181a53883351873da95e2013\": container with ID starting with 00606bf282dae1390db515357be7f7073feff247181a53883351873da95e2013 not found: ID does not exist" Mar 16 15:45:09 crc kubenswrapper[5120]: I0316 15:45:09.733003 5120 scope.go:117] "RemoveContainer" containerID="cc5537d3430afb17040e3919c06649e1c54e0ca5e38474d0fc8ef01cd8296715" Mar 16 15:45:09 crc kubenswrapper[5120]: E0316 15:45:09.733255 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc5537d3430afb17040e3919c06649e1c54e0ca5e38474d0fc8ef01cd8296715\": container with ID starting with cc5537d3430afb17040e3919c06649e1c54e0ca5e38474d0fc8ef01cd8296715 not found: ID does not exist" containerID="cc5537d3430afb17040e3919c06649e1c54e0ca5e38474d0fc8ef01cd8296715" Mar 16 15:45:09 crc kubenswrapper[5120]: I0316 15:45:09.733275 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc5537d3430afb17040e3919c06649e1c54e0ca5e38474d0fc8ef01cd8296715"} err="failed to get container status \"cc5537d3430afb17040e3919c06649e1c54e0ca5e38474d0fc8ef01cd8296715\": rpc error: code = NotFound desc = could not find container \"cc5537d3430afb17040e3919c06649e1c54e0ca5e38474d0fc8ef01cd8296715\": container with ID starting with cc5537d3430afb17040e3919c06649e1c54e0ca5e38474d0fc8ef01cd8296715 not found: ID does not exist" Mar 16 15:45:10 crc kubenswrapper[5120]: I0316 15:45:10.671924 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ffb539b-b7f1-4506-96a9-7befa1acf76c" path="/var/lib/kubelet/pods/9ffb539b-b7f1-4506-96a9-7befa1acf76c/volumes" Mar 16 15:45:21 crc kubenswrapper[5120]: I0316 15:45:21.674099 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="metallb-system/metallb-operator-webhook-server-5cc9c9d8fc-q6ts6" Mar 16 15:45:22 crc kubenswrapper[5120]: I0316 15:45:22.007648 5120 patch_prober.go:28] interesting pod/machine-config-daemon-7bf76 container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 15:45:22 crc kubenswrapper[5120]: I0316 15:45:22.007721 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 15:45:22 crc kubenswrapper[5120]: I0316 15:45:22.007783 5120 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" Mar 16 15:45:22 crc kubenswrapper[5120]: I0316 15:45:22.008561 5120 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="machine-config-daemon" containerStatusID={"Type":"cri-o","ID":"1bf0dfcc12e9da19221f7d306b83a800a04b4e40726e4b7be82e05b1ea8eae67"} pod="openshift-machine-config-operator/machine-config-daemon-7bf76" containerMessage="Container machine-config-daemon failed liveness probe, will be restarted" Mar 16 15:45:22 crc kubenswrapper[5120]: I0316 15:45:22.008640 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" containerID="cri-o://1bf0dfcc12e9da19221f7d306b83a800a04b4e40726e4b7be82e05b1ea8eae67" gracePeriod=600 Mar 16 15:45:22 crc kubenswrapper[5120]: I0316 15:45:22.743368 5120 generic.go:358] "Generic (PLEG): container finished" podID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerID="1bf0dfcc12e9da19221f7d306b83a800a04b4e40726e4b7be82e05b1ea8eae67" exitCode=0 Mar 16 15:45:22 crc kubenswrapper[5120]: I0316 15:45:22.743453 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" event={"ID":"e2275cb4-4905-4d66-a87e-8010120db2bd","Type":"ContainerDied","Data":"1bf0dfcc12e9da19221f7d306b83a800a04b4e40726e4b7be82e05b1ea8eae67"} Mar 16 15:45:22 crc kubenswrapper[5120]: I0316 15:45:22.744130 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" event={"ID":"e2275cb4-4905-4d66-a87e-8010120db2bd","Type":"ContainerStarted","Data":"e1e28417e12c0a346fcffba9bba0a6be96d15547a0645d8497bdebb5b0646fd1"} Mar 16 15:45:22 crc kubenswrapper[5120]: I0316 15:45:22.744157 5120 scope.go:117] "RemoveContainer" containerID="fe2426202af166b77e9fd173b727bad4de2670c667b0a78fd50b1f4b1beddf6d" Mar 16 15:45:36 crc kubenswrapper[5120]: I0316 15:45:36.627803 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="metallb-system/metallb-operator-controller-manager-646b4d4dc-sshj9" Mar 16 15:45:37 crc kubenswrapper[5120]: I0316 15:45:37.544339 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["metallb-system/controller-774d88f846-jzlz8"] Mar 16 15:45:37 crc kubenswrapper[5120]: I0316 15:45:37.545016 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ffb539b-b7f1-4506-96a9-7befa1acf76c" containerName="extract-utilities" Mar 16 15:45:37 crc kubenswrapper[5120]: I0316 15:45:37.545035 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ffb539b-b7f1-4506-96a9-7befa1acf76c" containerName="extract-utilities" Mar 16 15:45:37 crc kubenswrapper[5120]: I0316 15:45:37.545050 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ffb539b-b7f1-4506-96a9-7befa1acf76c" containerName="extract-content" Mar 16 15:45:37 crc kubenswrapper[5120]: I0316 15:45:37.545057 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ffb539b-b7f1-4506-96a9-7befa1acf76c" containerName="extract-content" Mar 16 15:45:37 crc kubenswrapper[5120]: I0316 15:45:37.545069 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="432432c1-d09c-45fe-8773-8bfbd6e38446" containerName="registry-server" Mar 16 15:45:37 crc kubenswrapper[5120]: I0316 15:45:37.545075 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="432432c1-d09c-45fe-8773-8bfbd6e38446" containerName="registry-server" Mar 16 15:45:37 crc kubenswrapper[5120]: I0316 15:45:37.545084 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d78869ec-ceb9-4dda-b1cb-3f03d505a647" containerName="collect-profiles" Mar 16 15:45:37 crc kubenswrapper[5120]: I0316 15:45:37.545089 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="d78869ec-ceb9-4dda-b1cb-3f03d505a647" containerName="collect-profiles" Mar 16 15:45:37 crc kubenswrapper[5120]: I0316 15:45:37.545106 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="432432c1-d09c-45fe-8773-8bfbd6e38446" containerName="extract-utilities" Mar 16 15:45:37 crc kubenswrapper[5120]: I0316 15:45:37.545113 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="432432c1-d09c-45fe-8773-8bfbd6e38446" containerName="extract-utilities" Mar 16 15:45:37 crc kubenswrapper[5120]: I0316 15:45:37.545120 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="432432c1-d09c-45fe-8773-8bfbd6e38446" containerName="extract-content" Mar 16 15:45:37 crc kubenswrapper[5120]: I0316 15:45:37.545125 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="432432c1-d09c-45fe-8773-8bfbd6e38446" containerName="extract-content" Mar 16 15:45:37 crc kubenswrapper[5120]: I0316 15:45:37.545139 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ffb539b-b7f1-4506-96a9-7befa1acf76c" containerName="registry-server" Mar 16 15:45:37 crc kubenswrapper[5120]: I0316 15:45:37.545144 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ffb539b-b7f1-4506-96a9-7befa1acf76c" containerName="registry-server" Mar 16 15:45:37 crc kubenswrapper[5120]: I0316 15:45:37.545235 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="9ffb539b-b7f1-4506-96a9-7befa1acf76c" containerName="registry-server" Mar 16 15:45:37 crc kubenswrapper[5120]: I0316 15:45:37.545248 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="d78869ec-ceb9-4dda-b1cb-3f03d505a647" containerName="collect-profiles" Mar 16 15:45:37 crc kubenswrapper[5120]: I0316 15:45:37.545258 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="432432c1-d09c-45fe-8773-8bfbd6e38446" containerName="registry-server" Mar 16 15:45:37 crc kubenswrapper[5120]: I0316 15:45:37.549842 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["metallb-system/speaker-xfrqk"] Mar 16 15:45:37 crc kubenswrapper[5120]: I0316 15:45:37.551431 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="metallb-system/controller-774d88f846-jzlz8" Mar 16 15:45:37 crc kubenswrapper[5120]: I0316 15:45:37.553454 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"metallb-system\"/\"controller-certs-secret\"" Mar 16 15:45:37 crc kubenswrapper[5120]: I0316 15:45:37.554308 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="metallb-system/speaker-xfrqk" Mar 16 15:45:37 crc kubenswrapper[5120]: I0316 15:45:37.555971 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"metallb-system\"/\"metallb-memberlist\"" Mar 16 15:45:37 crc kubenswrapper[5120]: I0316 15:45:37.556738 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"metallb-system\"/\"speaker-dockercfg-669rp\"" Mar 16 15:45:37 crc kubenswrapper[5120]: I0316 15:45:37.556785 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"metallb-system\"/\"speaker-certs-secret\"" Mar 16 15:45:37 crc kubenswrapper[5120]: I0316 15:45:37.558968 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"metallb-system\"/\"metallb-excludel2\"" Mar 16 15:45:37 crc kubenswrapper[5120]: I0316 15:45:37.572037 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["metallb-system/controller-774d88f846-jzlz8"] Mar 16 15:45:37 crc kubenswrapper[5120]: I0316 15:45:37.621963 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metallb-excludel2\" (UniqueName: \"kubernetes.io/configmap/797c0fde-13ff-46ed-9e0e-1520d90c8e8e-metallb-excludel2\") pod \"speaker-xfrqk\" (UID: \"797c0fde-13ff-46ed-9e0e-1520d90c8e8e\") " pod="metallb-system/speaker-xfrqk" Mar 16 15:45:37 crc kubenswrapper[5120]: I0316 15:45:37.622027 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"memberlist\" (UniqueName: \"kubernetes.io/secret/797c0fde-13ff-46ed-9e0e-1520d90c8e8e-memberlist\") pod \"speaker-xfrqk\" (UID: \"797c0fde-13ff-46ed-9e0e-1520d90c8e8e\") " pod="metallb-system/speaker-xfrqk" Mar 16 15:45:37 crc kubenswrapper[5120]: I0316 15:45:37.622173 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/797c0fde-13ff-46ed-9e0e-1520d90c8e8e-metrics-certs\") pod \"speaker-xfrqk\" (UID: \"797c0fde-13ff-46ed-9e0e-1520d90c8e8e\") " pod="metallb-system/speaker-xfrqk" Mar 16 15:45:37 crc kubenswrapper[5120]: I0316 15:45:37.622227 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6s4x\" (UniqueName: \"kubernetes.io/projected/62b0a03e-1f8d-4040-a322-38ea66f4b6d8-kube-api-access-k6s4x\") pod \"controller-774d88f846-jzlz8\" (UID: \"62b0a03e-1f8d-4040-a322-38ea66f4b6d8\") " pod="metallb-system/controller-774d88f846-jzlz8" Mar 16 15:45:37 crc kubenswrapper[5120]: I0316 15:45:37.622337 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/62b0a03e-1f8d-4040-a322-38ea66f4b6d8-cert\") pod \"controller-774d88f846-jzlz8\" (UID: \"62b0a03e-1f8d-4040-a322-38ea66f4b6d8\") " pod="metallb-system/controller-774d88f846-jzlz8" Mar 16 15:45:37 crc kubenswrapper[5120]: I0316 15:45:37.622407 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/62b0a03e-1f8d-4040-a322-38ea66f4b6d8-metrics-certs\") pod \"controller-774d88f846-jzlz8\" (UID: \"62b0a03e-1f8d-4040-a322-38ea66f4b6d8\") " pod="metallb-system/controller-774d88f846-jzlz8" Mar 16 15:45:37 crc kubenswrapper[5120]: I0316 15:45:37.622539 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6c7bn\" (UniqueName: \"kubernetes.io/projected/797c0fde-13ff-46ed-9e0e-1520d90c8e8e-kube-api-access-6c7bn\") pod \"speaker-xfrqk\" (UID: \"797c0fde-13ff-46ed-9e0e-1520d90c8e8e\") " pod="metallb-system/speaker-xfrqk" Mar 16 15:45:37 crc kubenswrapper[5120]: I0316 15:45:37.723663 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"memberlist\" (UniqueName: \"kubernetes.io/secret/797c0fde-13ff-46ed-9e0e-1520d90c8e8e-memberlist\") pod \"speaker-xfrqk\" (UID: \"797c0fde-13ff-46ed-9e0e-1520d90c8e8e\") " pod="metallb-system/speaker-xfrqk" Mar 16 15:45:37 crc kubenswrapper[5120]: I0316 15:45:37.723837 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/797c0fde-13ff-46ed-9e0e-1520d90c8e8e-metrics-certs\") pod \"speaker-xfrqk\" (UID: \"797c0fde-13ff-46ed-9e0e-1520d90c8e8e\") " pod="metallb-system/speaker-xfrqk" Mar 16 15:45:37 crc kubenswrapper[5120]: I0316 15:45:37.723901 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k6s4x\" (UniqueName: \"kubernetes.io/projected/62b0a03e-1f8d-4040-a322-38ea66f4b6d8-kube-api-access-k6s4x\") pod \"controller-774d88f846-jzlz8\" (UID: \"62b0a03e-1f8d-4040-a322-38ea66f4b6d8\") " pod="metallb-system/controller-774d88f846-jzlz8" Mar 16 15:45:37 crc kubenswrapper[5120]: E0316 15:45:37.723909 5120 secret.go:189] Couldn't get secret metallb-system/metallb-memberlist: secret "metallb-memberlist" not found Mar 16 15:45:37 crc kubenswrapper[5120]: E0316 15:45:37.724036 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/797c0fde-13ff-46ed-9e0e-1520d90c8e8e-memberlist podName:797c0fde-13ff-46ed-9e0e-1520d90c8e8e nodeName:}" failed. No retries permitted until 2026-03-16 15:45:38.224011052 +0000 UTC m=+840.377942869 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "memberlist" (UniqueName: "kubernetes.io/secret/797c0fde-13ff-46ed-9e0e-1520d90c8e8e-memberlist") pod "speaker-xfrqk" (UID: "797c0fde-13ff-46ed-9e0e-1520d90c8e8e") : secret "metallb-memberlist" not found Mar 16 15:45:37 crc kubenswrapper[5120]: I0316 15:45:37.724070 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/62b0a03e-1f8d-4040-a322-38ea66f4b6d8-cert\") pod \"controller-774d88f846-jzlz8\" (UID: \"62b0a03e-1f8d-4040-a322-38ea66f4b6d8\") " pod="metallb-system/controller-774d88f846-jzlz8" Mar 16 15:45:37 crc kubenswrapper[5120]: I0316 15:45:37.724216 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/62b0a03e-1f8d-4040-a322-38ea66f4b6d8-metrics-certs\") pod \"controller-774d88f846-jzlz8\" (UID: \"62b0a03e-1f8d-4040-a322-38ea66f4b6d8\") " pod="metallb-system/controller-774d88f846-jzlz8" Mar 16 15:45:37 crc kubenswrapper[5120]: I0316 15:45:37.724294 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6c7bn\" (UniqueName: \"kubernetes.io/projected/797c0fde-13ff-46ed-9e0e-1520d90c8e8e-kube-api-access-6c7bn\") pod \"speaker-xfrqk\" (UID: \"797c0fde-13ff-46ed-9e0e-1520d90c8e8e\") " pod="metallb-system/speaker-xfrqk" Mar 16 15:45:37 crc kubenswrapper[5120]: I0316 15:45:37.724411 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metallb-excludel2\" (UniqueName: \"kubernetes.io/configmap/797c0fde-13ff-46ed-9e0e-1520d90c8e8e-metallb-excludel2\") pod \"speaker-xfrqk\" (UID: \"797c0fde-13ff-46ed-9e0e-1520d90c8e8e\") " pod="metallb-system/speaker-xfrqk" Mar 16 15:45:37 crc kubenswrapper[5120]: E0316 15:45:37.724537 5120 secret.go:189] Couldn't get secret metallb-system/controller-certs-secret: secret "controller-certs-secret" not found Mar 16 15:45:37 crc kubenswrapper[5120]: E0316 15:45:37.724570 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62b0a03e-1f8d-4040-a322-38ea66f4b6d8-metrics-certs podName:62b0a03e-1f8d-4040-a322-38ea66f4b6d8 nodeName:}" failed. No retries permitted until 2026-03-16 15:45:38.224560118 +0000 UTC m=+840.378491785 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/62b0a03e-1f8d-4040-a322-38ea66f4b6d8-metrics-certs") pod "controller-774d88f846-jzlz8" (UID: "62b0a03e-1f8d-4040-a322-38ea66f4b6d8") : secret "controller-certs-secret" not found Mar 16 15:45:37 crc kubenswrapper[5120]: I0316 15:45:37.725602 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metallb-excludel2\" (UniqueName: \"kubernetes.io/configmap/797c0fde-13ff-46ed-9e0e-1520d90c8e8e-metallb-excludel2\") pod \"speaker-xfrqk\" (UID: \"797c0fde-13ff-46ed-9e0e-1520d90c8e8e\") " pod="metallb-system/speaker-xfrqk" Mar 16 15:45:37 crc kubenswrapper[5120]: I0316 15:45:37.731445 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/797c0fde-13ff-46ed-9e0e-1520d90c8e8e-metrics-certs\") pod \"speaker-xfrqk\" (UID: \"797c0fde-13ff-46ed-9e0e-1520d90c8e8e\") " pod="metallb-system/speaker-xfrqk" Mar 16 15:45:37 crc kubenswrapper[5120]: I0316 15:45:37.741358 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/62b0a03e-1f8d-4040-a322-38ea66f4b6d8-cert\") pod \"controller-774d88f846-jzlz8\" (UID: \"62b0a03e-1f8d-4040-a322-38ea66f4b6d8\") " pod="metallb-system/controller-774d88f846-jzlz8" Mar 16 15:45:37 crc kubenswrapper[5120]: I0316 15:45:37.770455 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6c7bn\" (UniqueName: \"kubernetes.io/projected/797c0fde-13ff-46ed-9e0e-1520d90c8e8e-kube-api-access-6c7bn\") pod \"speaker-xfrqk\" (UID: \"797c0fde-13ff-46ed-9e0e-1520d90c8e8e\") " pod="metallb-system/speaker-xfrqk" Mar 16 15:45:37 crc kubenswrapper[5120]: I0316 15:45:37.770477 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6s4x\" (UniqueName: \"kubernetes.io/projected/62b0a03e-1f8d-4040-a322-38ea66f4b6d8-kube-api-access-k6s4x\") pod \"controller-774d88f846-jzlz8\" (UID: \"62b0a03e-1f8d-4040-a322-38ea66f4b6d8\") " pod="metallb-system/controller-774d88f846-jzlz8" Mar 16 15:45:38 crc kubenswrapper[5120]: I0316 15:45:38.230845 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/62b0a03e-1f8d-4040-a322-38ea66f4b6d8-metrics-certs\") pod \"controller-774d88f846-jzlz8\" (UID: \"62b0a03e-1f8d-4040-a322-38ea66f4b6d8\") " pod="metallb-system/controller-774d88f846-jzlz8" Mar 16 15:45:38 crc kubenswrapper[5120]: I0316 15:45:38.231115 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"memberlist\" (UniqueName: \"kubernetes.io/secret/797c0fde-13ff-46ed-9e0e-1520d90c8e8e-memberlist\") pod \"speaker-xfrqk\" (UID: \"797c0fde-13ff-46ed-9e0e-1520d90c8e8e\") " pod="metallb-system/speaker-xfrqk" Mar 16 15:45:38 crc kubenswrapper[5120]: E0316 15:45:38.231358 5120 secret.go:189] Couldn't get secret metallb-system/metallb-memberlist: secret "metallb-memberlist" not found Mar 16 15:45:38 crc kubenswrapper[5120]: E0316 15:45:38.231506 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/797c0fde-13ff-46ed-9e0e-1520d90c8e8e-memberlist podName:797c0fde-13ff-46ed-9e0e-1520d90c8e8e nodeName:}" failed. No retries permitted until 2026-03-16 15:45:39.231475265 +0000 UTC m=+841.385406962 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "memberlist" (UniqueName: "kubernetes.io/secret/797c0fde-13ff-46ed-9e0e-1520d90c8e8e-memberlist") pod "speaker-xfrqk" (UID: "797c0fde-13ff-46ed-9e0e-1520d90c8e8e") : secret "metallb-memberlist" not found Mar 16 15:45:38 crc kubenswrapper[5120]: I0316 15:45:38.234609 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/62b0a03e-1f8d-4040-a322-38ea66f4b6d8-metrics-certs\") pod \"controller-774d88f846-jzlz8\" (UID: \"62b0a03e-1f8d-4040-a322-38ea66f4b6d8\") " pod="metallb-system/controller-774d88f846-jzlz8" Mar 16 15:45:38 crc kubenswrapper[5120]: I0316 15:45:38.470418 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="metallb-system/controller-774d88f846-jzlz8" Mar 16 15:45:38 crc kubenswrapper[5120]: I0316 15:45:38.928922 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["metallb-system/controller-774d88f846-jzlz8"] Mar 16 15:45:39 crc kubenswrapper[5120]: I0316 15:45:39.249970 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"memberlist\" (UniqueName: \"kubernetes.io/secret/797c0fde-13ff-46ed-9e0e-1520d90c8e8e-memberlist\") pod \"speaker-xfrqk\" (UID: \"797c0fde-13ff-46ed-9e0e-1520d90c8e8e\") " pod="metallb-system/speaker-xfrqk" Mar 16 15:45:39 crc kubenswrapper[5120]: I0316 15:45:39.258646 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"memberlist\" (UniqueName: \"kubernetes.io/secret/797c0fde-13ff-46ed-9e0e-1520d90c8e8e-memberlist\") pod \"speaker-xfrqk\" (UID: \"797c0fde-13ff-46ed-9e0e-1520d90c8e8e\") " pod="metallb-system/speaker-xfrqk" Mar 16 15:45:39 crc kubenswrapper[5120]: I0316 15:45:39.431811 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"metallb-system\"/\"speaker-dockercfg-669rp\"" Mar 16 15:45:39 crc kubenswrapper[5120]: I0316 15:45:39.440255 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="metallb-system/speaker-xfrqk" Mar 16 15:45:39 crc kubenswrapper[5120]: W0316 15:45:39.459606 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod797c0fde_13ff_46ed_9e0e_1520d90c8e8e.slice/crio-40b3a3d528e3ac258fa73ce4d8ecea6781b0c50d45e5332a6f55faaa69ab0581 WatchSource:0}: Error finding container 40b3a3d528e3ac258fa73ce4d8ecea6781b0c50d45e5332a6f55faaa69ab0581: Status 404 returned error can't find the container with id 40b3a3d528e3ac258fa73ce4d8ecea6781b0c50d45e5332a6f55faaa69ab0581 Mar 16 15:45:39 crc kubenswrapper[5120]: I0316 15:45:39.860465 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="metallb-system/speaker-xfrqk" event={"ID":"797c0fde-13ff-46ed-9e0e-1520d90c8e8e","Type":"ContainerStarted","Data":"a2edc1fb1b2f787768acf40becd220e78f613ed2b234b8197f3dd41167cec79a"} Mar 16 15:45:39 crc kubenswrapper[5120]: I0316 15:45:39.860534 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="metallb-system/speaker-xfrqk" event={"ID":"797c0fde-13ff-46ed-9e0e-1520d90c8e8e","Type":"ContainerStarted","Data":"40b3a3d528e3ac258fa73ce4d8ecea6781b0c50d45e5332a6f55faaa69ab0581"} Mar 16 15:45:39 crc kubenswrapper[5120]: I0316 15:45:39.863086 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="metallb-system/controller-774d88f846-jzlz8" event={"ID":"62b0a03e-1f8d-4040-a322-38ea66f4b6d8","Type":"ContainerStarted","Data":"2fa58d476864258d0577356615d4cc5ee20e77c225a74c4ee2ad80338407a2d5"} Mar 16 15:45:39 crc kubenswrapper[5120]: I0316 15:45:39.863142 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="metallb-system/controller-774d88f846-jzlz8" event={"ID":"62b0a03e-1f8d-4040-a322-38ea66f4b6d8","Type":"ContainerStarted","Data":"0851028f2405926f19b54ac559d698f96527c9d67a445e45eeac67058545da64"} Mar 16 15:45:39 crc kubenswrapper[5120]: I0316 15:45:39.863155 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="metallb-system/controller-774d88f846-jzlz8" event={"ID":"62b0a03e-1f8d-4040-a322-38ea66f4b6d8","Type":"ContainerStarted","Data":"48bfe38b7090ed875d718d9c7912219caef48f6857b6e483ccd6b2d8d3c29e95"} Mar 16 15:45:39 crc kubenswrapper[5120]: I0316 15:45:39.863202 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="metallb-system/controller-774d88f846-jzlz8" Mar 16 15:45:39 crc kubenswrapper[5120]: I0316 15:45:39.877979 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="metallb-system/controller-774d88f846-jzlz8" podStartSLOduration=2.877964444 podStartE2EDuration="2.877964444s" podCreationTimestamp="2026-03-16 15:45:37 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:45:39.877385258 +0000 UTC m=+842.031316935" watchObservedRunningTime="2026-03-16 15:45:39.877964444 +0000 UTC m=+842.031896091" Mar 16 15:45:40 crc kubenswrapper[5120]: I0316 15:45:40.871666 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="metallb-system/speaker-xfrqk" event={"ID":"797c0fde-13ff-46ed-9e0e-1520d90c8e8e","Type":"ContainerStarted","Data":"b78856444cf89d7efa2f1c36b0ea7ad367bf554c6b0b52fd91c238f8114386aa"} Mar 16 15:45:40 crc kubenswrapper[5120]: I0316 15:45:40.871965 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="metallb-system/speaker-xfrqk" Mar 16 15:45:40 crc kubenswrapper[5120]: I0316 15:45:40.889118 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="metallb-system/speaker-xfrqk" podStartSLOduration=3.889101512 podStartE2EDuration="3.889101512s" podCreationTimestamp="2026-03-16 15:45:37 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:45:40.887669451 +0000 UTC m=+843.041601108" watchObservedRunningTime="2026-03-16 15:45:40.889101512 +0000 UTC m=+843.043033169" Mar 16 15:45:50 crc kubenswrapper[5120]: I0316 15:45:50.879890 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="metallb-system/controller-774d88f846-jzlz8" Mar 16 15:45:51 crc kubenswrapper[5120]: I0316 15:45:51.881613 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="metallb-system/speaker-xfrqk" Mar 16 15:45:53 crc kubenswrapper[5120]: I0316 15:45:53.309689 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/925ad1f05bf386dc21bdfe2f8249c1fbfd04a404dec7a7fb6362d758e5ndmlk"] Mar 16 15:45:53 crc kubenswrapper[5120]: I0316 15:45:53.341364 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/925ad1f05bf386dc21bdfe2f8249c1fbfd04a404dec7a7fb6362d758e5ndmlk"] Mar 16 15:45:53 crc kubenswrapper[5120]: I0316 15:45:53.341567 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/925ad1f05bf386dc21bdfe2f8249c1fbfd04a404dec7a7fb6362d758e5ndmlk" Mar 16 15:45:53 crc kubenswrapper[5120]: I0316 15:45:53.344527 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-b2ccr\"" Mar 16 15:45:53 crc kubenswrapper[5120]: I0316 15:45:53.450712 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7m5qb\" (UniqueName: \"kubernetes.io/projected/13031077-4428-4288-80ef-4098c9c4e353-kube-api-access-7m5qb\") pod \"925ad1f05bf386dc21bdfe2f8249c1fbfd04a404dec7a7fb6362d758e5ndmlk\" (UID: \"13031077-4428-4288-80ef-4098c9c4e353\") " pod="openshift-marketplace/925ad1f05bf386dc21bdfe2f8249c1fbfd04a404dec7a7fb6362d758e5ndmlk" Mar 16 15:45:53 crc kubenswrapper[5120]: I0316 15:45:53.451114 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/13031077-4428-4288-80ef-4098c9c4e353-bundle\") pod \"925ad1f05bf386dc21bdfe2f8249c1fbfd04a404dec7a7fb6362d758e5ndmlk\" (UID: \"13031077-4428-4288-80ef-4098c9c4e353\") " pod="openshift-marketplace/925ad1f05bf386dc21bdfe2f8249c1fbfd04a404dec7a7fb6362d758e5ndmlk" Mar 16 15:45:53 crc kubenswrapper[5120]: I0316 15:45:53.451214 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/13031077-4428-4288-80ef-4098c9c4e353-util\") pod \"925ad1f05bf386dc21bdfe2f8249c1fbfd04a404dec7a7fb6362d758e5ndmlk\" (UID: \"13031077-4428-4288-80ef-4098c9c4e353\") " pod="openshift-marketplace/925ad1f05bf386dc21bdfe2f8249c1fbfd04a404dec7a7fb6362d758e5ndmlk" Mar 16 15:45:53 crc kubenswrapper[5120]: I0316 15:45:53.552446 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7m5qb\" (UniqueName: \"kubernetes.io/projected/13031077-4428-4288-80ef-4098c9c4e353-kube-api-access-7m5qb\") pod \"925ad1f05bf386dc21bdfe2f8249c1fbfd04a404dec7a7fb6362d758e5ndmlk\" (UID: \"13031077-4428-4288-80ef-4098c9c4e353\") " pod="openshift-marketplace/925ad1f05bf386dc21bdfe2f8249c1fbfd04a404dec7a7fb6362d758e5ndmlk" Mar 16 15:45:53 crc kubenswrapper[5120]: I0316 15:45:53.552551 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/13031077-4428-4288-80ef-4098c9c4e353-bundle\") pod \"925ad1f05bf386dc21bdfe2f8249c1fbfd04a404dec7a7fb6362d758e5ndmlk\" (UID: \"13031077-4428-4288-80ef-4098c9c4e353\") " pod="openshift-marketplace/925ad1f05bf386dc21bdfe2f8249c1fbfd04a404dec7a7fb6362d758e5ndmlk" Mar 16 15:45:53 crc kubenswrapper[5120]: I0316 15:45:53.552727 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/13031077-4428-4288-80ef-4098c9c4e353-util\") pod \"925ad1f05bf386dc21bdfe2f8249c1fbfd04a404dec7a7fb6362d758e5ndmlk\" (UID: \"13031077-4428-4288-80ef-4098c9c4e353\") " pod="openshift-marketplace/925ad1f05bf386dc21bdfe2f8249c1fbfd04a404dec7a7fb6362d758e5ndmlk" Mar 16 15:45:53 crc kubenswrapper[5120]: I0316 15:45:53.553020 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/13031077-4428-4288-80ef-4098c9c4e353-bundle\") pod \"925ad1f05bf386dc21bdfe2f8249c1fbfd04a404dec7a7fb6362d758e5ndmlk\" (UID: \"13031077-4428-4288-80ef-4098c9c4e353\") " pod="openshift-marketplace/925ad1f05bf386dc21bdfe2f8249c1fbfd04a404dec7a7fb6362d758e5ndmlk" Mar 16 15:45:53 crc kubenswrapper[5120]: I0316 15:45:53.553488 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/13031077-4428-4288-80ef-4098c9c4e353-util\") pod \"925ad1f05bf386dc21bdfe2f8249c1fbfd04a404dec7a7fb6362d758e5ndmlk\" (UID: \"13031077-4428-4288-80ef-4098c9c4e353\") " pod="openshift-marketplace/925ad1f05bf386dc21bdfe2f8249c1fbfd04a404dec7a7fb6362d758e5ndmlk" Mar 16 15:45:53 crc kubenswrapper[5120]: I0316 15:45:53.578719 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7m5qb\" (UniqueName: \"kubernetes.io/projected/13031077-4428-4288-80ef-4098c9c4e353-kube-api-access-7m5qb\") pod \"925ad1f05bf386dc21bdfe2f8249c1fbfd04a404dec7a7fb6362d758e5ndmlk\" (UID: \"13031077-4428-4288-80ef-4098c9c4e353\") " pod="openshift-marketplace/925ad1f05bf386dc21bdfe2f8249c1fbfd04a404dec7a7fb6362d758e5ndmlk" Mar 16 15:45:53 crc kubenswrapper[5120]: I0316 15:45:53.656298 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/925ad1f05bf386dc21bdfe2f8249c1fbfd04a404dec7a7fb6362d758e5ndmlk" Mar 16 15:45:53 crc kubenswrapper[5120]: I0316 15:45:53.968876 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/925ad1f05bf386dc21bdfe2f8249c1fbfd04a404dec7a7fb6362d758e5ndmlk"] Mar 16 15:45:54 crc kubenswrapper[5120]: I0316 15:45:54.964082 5120 generic.go:358] "Generic (PLEG): container finished" podID="13031077-4428-4288-80ef-4098c9c4e353" containerID="263fd072011c129db91bfb23ba3833185e78baaa6e775cc13030042aff6ea9ac" exitCode=0 Mar 16 15:45:54 crc kubenswrapper[5120]: I0316 15:45:54.965347 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/925ad1f05bf386dc21bdfe2f8249c1fbfd04a404dec7a7fb6362d758e5ndmlk" event={"ID":"13031077-4428-4288-80ef-4098c9c4e353","Type":"ContainerDied","Data":"263fd072011c129db91bfb23ba3833185e78baaa6e775cc13030042aff6ea9ac"} Mar 16 15:45:54 crc kubenswrapper[5120]: I0316 15:45:54.967125 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/925ad1f05bf386dc21bdfe2f8249c1fbfd04a404dec7a7fb6362d758e5ndmlk" event={"ID":"13031077-4428-4288-80ef-4098c9c4e353","Type":"ContainerStarted","Data":"4ff2625c69934620784a970d1e41db190d4c21bc6be5805b306f26eb25aa8037"} Mar 16 15:45:57 crc kubenswrapper[5120]: I0316 15:45:57.991131 5120 generic.go:358] "Generic (PLEG): container finished" podID="13031077-4428-4288-80ef-4098c9c4e353" containerID="ee6c14c414eb63660514ec44679a0994a458e8234bff00892729d86dab0e1527" exitCode=0 Mar 16 15:45:57 crc kubenswrapper[5120]: I0316 15:45:57.991484 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/925ad1f05bf386dc21bdfe2f8249c1fbfd04a404dec7a7fb6362d758e5ndmlk" event={"ID":"13031077-4428-4288-80ef-4098c9c4e353","Type":"ContainerDied","Data":"ee6c14c414eb63660514ec44679a0994a458e8234bff00892729d86dab0e1527"} Mar 16 15:45:59 crc kubenswrapper[5120]: I0316 15:45:59.002606 5120 generic.go:358] "Generic (PLEG): container finished" podID="13031077-4428-4288-80ef-4098c9c4e353" containerID="d48f7a90d94a92f8975888036591eb59f70ec60d7d7411687dd54e40fee16d49" exitCode=0 Mar 16 15:45:59 crc kubenswrapper[5120]: I0316 15:45:59.002648 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/925ad1f05bf386dc21bdfe2f8249c1fbfd04a404dec7a7fb6362d758e5ndmlk" event={"ID":"13031077-4428-4288-80ef-4098c9c4e353","Type":"ContainerDied","Data":"d48f7a90d94a92f8975888036591eb59f70ec60d7d7411687dd54e40fee16d49"} Mar 16 15:46:00 crc kubenswrapper[5120]: I0316 15:46:00.174222 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-infra/auto-csr-approver-29561266-4l68r"] Mar 16 15:46:00 crc kubenswrapper[5120]: I0316 15:46:00.184459 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561266-4l68r" Mar 16 15:46:00 crc kubenswrapper[5120]: I0316 15:46:00.185523 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561266-4l68r"] Mar 16 15:46:00 crc kubenswrapper[5120]: I0316 15:46:00.188031 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"kube-root-ca.crt\"" Mar 16 15:46:00 crc kubenswrapper[5120]: I0316 15:46:00.188881 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"openshift-service-ca.crt\"" Mar 16 15:46:00 crc kubenswrapper[5120]: I0316 15:46:00.189225 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-infra\"/\"csr-approver-sa-dockercfg-x2nsz\"" Mar 16 15:46:00 crc kubenswrapper[5120]: I0316 15:46:00.247073 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbgvn\" (UniqueName: \"kubernetes.io/projected/c2d9d021-ff4d-4bcc-832b-fffe8f95ee2a-kube-api-access-hbgvn\") pod \"auto-csr-approver-29561266-4l68r\" (UID: \"c2d9d021-ff4d-4bcc-832b-fffe8f95ee2a\") " pod="openshift-infra/auto-csr-approver-29561266-4l68r" Mar 16 15:46:00 crc kubenswrapper[5120]: I0316 15:46:00.336199 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/925ad1f05bf386dc21bdfe2f8249c1fbfd04a404dec7a7fb6362d758e5ndmlk" Mar 16 15:46:00 crc kubenswrapper[5120]: I0316 15:46:00.347717 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hbgvn\" (UniqueName: \"kubernetes.io/projected/c2d9d021-ff4d-4bcc-832b-fffe8f95ee2a-kube-api-access-hbgvn\") pod \"auto-csr-approver-29561266-4l68r\" (UID: \"c2d9d021-ff4d-4bcc-832b-fffe8f95ee2a\") " pod="openshift-infra/auto-csr-approver-29561266-4l68r" Mar 16 15:46:00 crc kubenswrapper[5120]: I0316 15:46:00.376298 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbgvn\" (UniqueName: \"kubernetes.io/projected/c2d9d021-ff4d-4bcc-832b-fffe8f95ee2a-kube-api-access-hbgvn\") pod \"auto-csr-approver-29561266-4l68r\" (UID: \"c2d9d021-ff4d-4bcc-832b-fffe8f95ee2a\") " pod="openshift-infra/auto-csr-approver-29561266-4l68r" Mar 16 15:46:00 crc kubenswrapper[5120]: I0316 15:46:00.448736 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7m5qb\" (UniqueName: \"kubernetes.io/projected/13031077-4428-4288-80ef-4098c9c4e353-kube-api-access-7m5qb\") pod \"13031077-4428-4288-80ef-4098c9c4e353\" (UID: \"13031077-4428-4288-80ef-4098c9c4e353\") " Mar 16 15:46:00 crc kubenswrapper[5120]: I0316 15:46:00.448908 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/13031077-4428-4288-80ef-4098c9c4e353-util\") pod \"13031077-4428-4288-80ef-4098c9c4e353\" (UID: \"13031077-4428-4288-80ef-4098c9c4e353\") " Mar 16 15:46:00 crc kubenswrapper[5120]: I0316 15:46:00.448971 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/13031077-4428-4288-80ef-4098c9c4e353-bundle\") pod \"13031077-4428-4288-80ef-4098c9c4e353\" (UID: \"13031077-4428-4288-80ef-4098c9c4e353\") " Mar 16 15:46:00 crc kubenswrapper[5120]: I0316 15:46:00.450411 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13031077-4428-4288-80ef-4098c9c4e353-bundle" (OuterVolumeSpecName: "bundle") pod "13031077-4428-4288-80ef-4098c9c4e353" (UID: "13031077-4428-4288-80ef-4098c9c4e353"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:46:00 crc kubenswrapper[5120]: I0316 15:46:00.452434 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13031077-4428-4288-80ef-4098c9c4e353-kube-api-access-7m5qb" (OuterVolumeSpecName: "kube-api-access-7m5qb") pod "13031077-4428-4288-80ef-4098c9c4e353" (UID: "13031077-4428-4288-80ef-4098c9c4e353"). InnerVolumeSpecName "kube-api-access-7m5qb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:46:00 crc kubenswrapper[5120]: I0316 15:46:00.469153 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13031077-4428-4288-80ef-4098c9c4e353-util" (OuterVolumeSpecName: "util") pod "13031077-4428-4288-80ef-4098c9c4e353" (UID: "13031077-4428-4288-80ef-4098c9c4e353"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:46:00 crc kubenswrapper[5120]: I0316 15:46:00.506077 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561266-4l68r" Mar 16 15:46:00 crc kubenswrapper[5120]: I0316 15:46:00.550561 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7m5qb\" (UniqueName: \"kubernetes.io/projected/13031077-4428-4288-80ef-4098c9c4e353-kube-api-access-7m5qb\") on node \"crc\" DevicePath \"\"" Mar 16 15:46:00 crc kubenswrapper[5120]: I0316 15:46:00.550597 5120 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/13031077-4428-4288-80ef-4098c9c4e353-util\") on node \"crc\" DevicePath \"\"" Mar 16 15:46:00 crc kubenswrapper[5120]: I0316 15:46:00.550606 5120 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/13031077-4428-4288-80ef-4098c9c4e353-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:46:00 crc kubenswrapper[5120]: I0316 15:46:00.760962 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561266-4l68r"] Mar 16 15:46:00 crc kubenswrapper[5120]: W0316 15:46:00.774959 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc2d9d021_ff4d_4bcc_832b_fffe8f95ee2a.slice/crio-09d280e289c4ba0f42eb29904fccf582ae54b685e0171f00ab6ebf57e99f5f11 WatchSource:0}: Error finding container 09d280e289c4ba0f42eb29904fccf582ae54b685e0171f00ab6ebf57e99f5f11: Status 404 returned error can't find the container with id 09d280e289c4ba0f42eb29904fccf582ae54b685e0171f00ab6ebf57e99f5f11 Mar 16 15:46:01 crc kubenswrapper[5120]: I0316 15:46:01.021362 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/925ad1f05bf386dc21bdfe2f8249c1fbfd04a404dec7a7fb6362d758e5ndmlk" Mar 16 15:46:01 crc kubenswrapper[5120]: I0316 15:46:01.021374 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/925ad1f05bf386dc21bdfe2f8249c1fbfd04a404dec7a7fb6362d758e5ndmlk" event={"ID":"13031077-4428-4288-80ef-4098c9c4e353","Type":"ContainerDied","Data":"4ff2625c69934620784a970d1e41db190d4c21bc6be5805b306f26eb25aa8037"} Mar 16 15:46:01 crc kubenswrapper[5120]: I0316 15:46:01.021451 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4ff2625c69934620784a970d1e41db190d4c21bc6be5805b306f26eb25aa8037" Mar 16 15:46:01 crc kubenswrapper[5120]: I0316 15:46:01.023083 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561266-4l68r" event={"ID":"c2d9d021-ff4d-4bcc-832b-fffe8f95ee2a","Type":"ContainerStarted","Data":"09d280e289c4ba0f42eb29904fccf582ae54b685e0171f00ab6ebf57e99f5f11"} Mar 16 15:46:03 crc kubenswrapper[5120]: I0316 15:46:03.042887 5120 generic.go:358] "Generic (PLEG): container finished" podID="c2d9d021-ff4d-4bcc-832b-fffe8f95ee2a" containerID="d80be422f49090c9a88c2c8e79c07b9e48e823ee5b308766ae089a0f7b831bad" exitCode=0 Mar 16 15:46:03 crc kubenswrapper[5120]: I0316 15:46:03.042993 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561266-4l68r" event={"ID":"c2d9d021-ff4d-4bcc-832b-fffe8f95ee2a","Type":"ContainerDied","Data":"d80be422f49090c9a88c2c8e79c07b9e48e823ee5b308766ae089a0f7b831bad"} Mar 16 15:46:03 crc kubenswrapper[5120]: I0316 15:46:03.048168 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-frr-k8s/frr-k8s-s6nw6"] Mar 16 15:46:03 crc kubenswrapper[5120]: I0316 15:46:03.049347 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13031077-4428-4288-80ef-4098c9c4e353" containerName="pull" Mar 16 15:46:03 crc kubenswrapper[5120]: I0316 15:46:03.049384 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="13031077-4428-4288-80ef-4098c9c4e353" containerName="pull" Mar 16 15:46:03 crc kubenswrapper[5120]: I0316 15:46:03.049415 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13031077-4428-4288-80ef-4098c9c4e353" containerName="util" Mar 16 15:46:03 crc kubenswrapper[5120]: I0316 15:46:03.049428 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="13031077-4428-4288-80ef-4098c9c4e353" containerName="util" Mar 16 15:46:03 crc kubenswrapper[5120]: I0316 15:46:03.049459 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13031077-4428-4288-80ef-4098c9c4e353" containerName="extract" Mar 16 15:46:03 crc kubenswrapper[5120]: I0316 15:46:03.049474 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="13031077-4428-4288-80ef-4098c9c4e353" containerName="extract" Mar 16 15:46:03 crc kubenswrapper[5120]: I0316 15:46:03.049676 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="13031077-4428-4288-80ef-4098c9c4e353" containerName="extract" Mar 16 15:46:03 crc kubenswrapper[5120]: I0316 15:46:03.062165 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-frr-k8s/frr-k8s-s6nw6" Mar 16 15:46:03 crc kubenswrapper[5120]: I0316 15:46:03.065325 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-frr-k8s\"/\"openshift-service-ca.crt\"" Mar 16 15:46:03 crc kubenswrapper[5120]: I0316 15:46:03.065569 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-frr-k8s\"/\"kube-root-ca.crt\"" Mar 16 15:46:03 crc kubenswrapper[5120]: I0316 15:46:03.068722 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-frr-k8s\"/\"frr-k8s-certs-secret\"" Mar 16 15:46:03 crc kubenswrapper[5120]: I0316 15:46:03.068728 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-frr-k8s\"/\"env-overrides\"" Mar 16 15:46:03 crc kubenswrapper[5120]: I0316 15:46:03.068735 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-frr-k8s\"/\"frr-startup\"" Mar 16 15:46:03 crc kubenswrapper[5120]: I0316 15:46:03.078076 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-frr-k8s\"/\"frr-k8s-daemon-dockercfg-rs5zb\"" Mar 16 15:46:03 crc kubenswrapper[5120]: I0316 15:46:03.190165 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/884b547f-f858-453d-8d9d-54adc1749bd1-metrics-certs\") pod \"frr-k8s-s6nw6\" (UID: \"884b547f-f858-453d-8d9d-54adc1749bd1\") " pod="openshift-frr-k8s/frr-k8s-s6nw6" Mar 16 15:46:03 crc kubenswrapper[5120]: I0316 15:46:03.190215 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmw2j\" (UniqueName: \"kubernetes.io/projected/884b547f-f858-453d-8d9d-54adc1749bd1-kube-api-access-pmw2j\") pod \"frr-k8s-s6nw6\" (UID: \"884b547f-f858-453d-8d9d-54adc1749bd1\") " pod="openshift-frr-k8s/frr-k8s-s6nw6" Mar 16 15:46:03 crc kubenswrapper[5120]: I0316 15:46:03.190254 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"frr-sockets\" (UniqueName: \"kubernetes.io/empty-dir/884b547f-f858-453d-8d9d-54adc1749bd1-frr-sockets\") pod \"frr-k8s-s6nw6\" (UID: \"884b547f-f858-453d-8d9d-54adc1749bd1\") " pod="openshift-frr-k8s/frr-k8s-s6nw6" Mar 16 15:46:03 crc kubenswrapper[5120]: I0316 15:46:03.190282 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics\" (UniqueName: \"kubernetes.io/empty-dir/884b547f-f858-453d-8d9d-54adc1749bd1-metrics\") pod \"frr-k8s-s6nw6\" (UID: \"884b547f-f858-453d-8d9d-54adc1749bd1\") " pod="openshift-frr-k8s/frr-k8s-s6nw6" Mar 16 15:46:03 crc kubenswrapper[5120]: I0316 15:46:03.190395 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"frr-status\" (UniqueName: \"kubernetes.io/empty-dir/884b547f-f858-453d-8d9d-54adc1749bd1-frr-status\") pod \"frr-k8s-s6nw6\" (UID: \"884b547f-f858-453d-8d9d-54adc1749bd1\") " pod="openshift-frr-k8s/frr-k8s-s6nw6" Mar 16 15:46:03 crc kubenswrapper[5120]: I0316 15:46:03.190474 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"frr-conf\" (UniqueName: \"kubernetes.io/empty-dir/884b547f-f858-453d-8d9d-54adc1749bd1-frr-conf\") pod \"frr-k8s-s6nw6\" (UID: \"884b547f-f858-453d-8d9d-54adc1749bd1\") " pod="openshift-frr-k8s/frr-k8s-s6nw6" Mar 16 15:46:03 crc kubenswrapper[5120]: I0316 15:46:03.190503 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"reloader\" (UniqueName: \"kubernetes.io/empty-dir/884b547f-f858-453d-8d9d-54adc1749bd1-reloader\") pod \"frr-k8s-s6nw6\" (UID: \"884b547f-f858-453d-8d9d-54adc1749bd1\") " pod="openshift-frr-k8s/frr-k8s-s6nw6" Mar 16 15:46:03 crc kubenswrapper[5120]: I0316 15:46:03.190546 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"frr-startup\" (UniqueName: \"kubernetes.io/configmap/884b547f-f858-453d-8d9d-54adc1749bd1-frr-startup\") pod \"frr-k8s-s6nw6\" (UID: \"884b547f-f858-453d-8d9d-54adc1749bd1\") " pod="openshift-frr-k8s/frr-k8s-s6nw6" Mar 16 15:46:03 crc kubenswrapper[5120]: I0316 15:46:03.292309 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"frr-status\" (UniqueName: \"kubernetes.io/empty-dir/884b547f-f858-453d-8d9d-54adc1749bd1-frr-status\") pod \"frr-k8s-s6nw6\" (UID: \"884b547f-f858-453d-8d9d-54adc1749bd1\") " pod="openshift-frr-k8s/frr-k8s-s6nw6" Mar 16 15:46:03 crc kubenswrapper[5120]: I0316 15:46:03.292358 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"frr-conf\" (UniqueName: \"kubernetes.io/empty-dir/884b547f-f858-453d-8d9d-54adc1749bd1-frr-conf\") pod \"frr-k8s-s6nw6\" (UID: \"884b547f-f858-453d-8d9d-54adc1749bd1\") " pod="openshift-frr-k8s/frr-k8s-s6nw6" Mar 16 15:46:03 crc kubenswrapper[5120]: I0316 15:46:03.292376 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"reloader\" (UniqueName: \"kubernetes.io/empty-dir/884b547f-f858-453d-8d9d-54adc1749bd1-reloader\") pod \"frr-k8s-s6nw6\" (UID: \"884b547f-f858-453d-8d9d-54adc1749bd1\") " pod="openshift-frr-k8s/frr-k8s-s6nw6" Mar 16 15:46:03 crc kubenswrapper[5120]: I0316 15:46:03.292396 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"frr-startup\" (UniqueName: \"kubernetes.io/configmap/884b547f-f858-453d-8d9d-54adc1749bd1-frr-startup\") pod \"frr-k8s-s6nw6\" (UID: \"884b547f-f858-453d-8d9d-54adc1749bd1\") " pod="openshift-frr-k8s/frr-k8s-s6nw6" Mar 16 15:46:03 crc kubenswrapper[5120]: I0316 15:46:03.292474 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/884b547f-f858-453d-8d9d-54adc1749bd1-metrics-certs\") pod \"frr-k8s-s6nw6\" (UID: \"884b547f-f858-453d-8d9d-54adc1749bd1\") " pod="openshift-frr-k8s/frr-k8s-s6nw6" Mar 16 15:46:03 crc kubenswrapper[5120]: I0316 15:46:03.292494 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pmw2j\" (UniqueName: \"kubernetes.io/projected/884b547f-f858-453d-8d9d-54adc1749bd1-kube-api-access-pmw2j\") pod \"frr-k8s-s6nw6\" (UID: \"884b547f-f858-453d-8d9d-54adc1749bd1\") " pod="openshift-frr-k8s/frr-k8s-s6nw6" Mar 16 15:46:03 crc kubenswrapper[5120]: I0316 15:46:03.292519 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"frr-sockets\" (UniqueName: \"kubernetes.io/empty-dir/884b547f-f858-453d-8d9d-54adc1749bd1-frr-sockets\") pod \"frr-k8s-s6nw6\" (UID: \"884b547f-f858-453d-8d9d-54adc1749bd1\") " pod="openshift-frr-k8s/frr-k8s-s6nw6" Mar 16 15:46:03 crc kubenswrapper[5120]: I0316 15:46:03.292544 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics\" (UniqueName: \"kubernetes.io/empty-dir/884b547f-f858-453d-8d9d-54adc1749bd1-metrics\") pod \"frr-k8s-s6nw6\" (UID: \"884b547f-f858-453d-8d9d-54adc1749bd1\") " pod="openshift-frr-k8s/frr-k8s-s6nw6" Mar 16 15:46:03 crc kubenswrapper[5120]: I0316 15:46:03.292994 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics\" (UniqueName: \"kubernetes.io/empty-dir/884b547f-f858-453d-8d9d-54adc1749bd1-metrics\") pod \"frr-k8s-s6nw6\" (UID: \"884b547f-f858-453d-8d9d-54adc1749bd1\") " pod="openshift-frr-k8s/frr-k8s-s6nw6" Mar 16 15:46:03 crc kubenswrapper[5120]: E0316 15:46:03.293002 5120 secret.go:189] Couldn't get secret openshift-frr-k8s/frr-k8s-certs-secret: secret "frr-k8s-certs-secret" not found Mar 16 15:46:03 crc kubenswrapper[5120]: E0316 15:46:03.293082 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/884b547f-f858-453d-8d9d-54adc1749bd1-metrics-certs podName:884b547f-f858-453d-8d9d-54adc1749bd1 nodeName:}" failed. No retries permitted until 2026-03-16 15:46:03.793063985 +0000 UTC m=+865.946995632 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/884b547f-f858-453d-8d9d-54adc1749bd1-metrics-certs") pod "frr-k8s-s6nw6" (UID: "884b547f-f858-453d-8d9d-54adc1749bd1") : secret "frr-k8s-certs-secret" not found Mar 16 15:46:03 crc kubenswrapper[5120]: I0316 15:46:03.293246 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"frr-conf\" (UniqueName: \"kubernetes.io/empty-dir/884b547f-f858-453d-8d9d-54adc1749bd1-frr-conf\") pod \"frr-k8s-s6nw6\" (UID: \"884b547f-f858-453d-8d9d-54adc1749bd1\") " pod="openshift-frr-k8s/frr-k8s-s6nw6" Mar 16 15:46:03 crc kubenswrapper[5120]: I0316 15:46:03.293332 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"frr-sockets\" (UniqueName: \"kubernetes.io/empty-dir/884b547f-f858-453d-8d9d-54adc1749bd1-frr-sockets\") pod \"frr-k8s-s6nw6\" (UID: \"884b547f-f858-453d-8d9d-54adc1749bd1\") " pod="openshift-frr-k8s/frr-k8s-s6nw6" Mar 16 15:46:03 crc kubenswrapper[5120]: I0316 15:46:03.293449 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"frr-status\" (UniqueName: \"kubernetes.io/empty-dir/884b547f-f858-453d-8d9d-54adc1749bd1-frr-status\") pod \"frr-k8s-s6nw6\" (UID: \"884b547f-f858-453d-8d9d-54adc1749bd1\") " pod="openshift-frr-k8s/frr-k8s-s6nw6" Mar 16 15:46:03 crc kubenswrapper[5120]: I0316 15:46:03.293604 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"reloader\" (UniqueName: \"kubernetes.io/empty-dir/884b547f-f858-453d-8d9d-54adc1749bd1-reloader\") pod \"frr-k8s-s6nw6\" (UID: \"884b547f-f858-453d-8d9d-54adc1749bd1\") " pod="openshift-frr-k8s/frr-k8s-s6nw6" Mar 16 15:46:03 crc kubenswrapper[5120]: I0316 15:46:03.294037 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"frr-startup\" (UniqueName: \"kubernetes.io/configmap/884b547f-f858-453d-8d9d-54adc1749bd1-frr-startup\") pod \"frr-k8s-s6nw6\" (UID: \"884b547f-f858-453d-8d9d-54adc1749bd1\") " pod="openshift-frr-k8s/frr-k8s-s6nw6" Mar 16 15:46:03 crc kubenswrapper[5120]: I0316 15:46:03.323928 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmw2j\" (UniqueName: \"kubernetes.io/projected/884b547f-f858-453d-8d9d-54adc1749bd1-kube-api-access-pmw2j\") pod \"frr-k8s-s6nw6\" (UID: \"884b547f-f858-453d-8d9d-54adc1749bd1\") " pod="openshift-frr-k8s/frr-k8s-s6nw6" Mar 16 15:46:03 crc kubenswrapper[5120]: I0316 15:46:03.800262 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/884b547f-f858-453d-8d9d-54adc1749bd1-metrics-certs\") pod \"frr-k8s-s6nw6\" (UID: \"884b547f-f858-453d-8d9d-54adc1749bd1\") " pod="openshift-frr-k8s/frr-k8s-s6nw6" Mar 16 15:46:03 crc kubenswrapper[5120]: I0316 15:46:03.808427 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/884b547f-f858-453d-8d9d-54adc1749bd1-metrics-certs\") pod \"frr-k8s-s6nw6\" (UID: \"884b547f-f858-453d-8d9d-54adc1749bd1\") " pod="openshift-frr-k8s/frr-k8s-s6nw6" Mar 16 15:46:03 crc kubenswrapper[5120]: I0316 15:46:03.978033 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-frr-k8s/frr-k8s-s6nw6" Mar 16 15:46:04 crc kubenswrapper[5120]: I0316 15:46:04.276831 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561266-4l68r" Mar 16 15:46:04 crc kubenswrapper[5120]: I0316 15:46:04.409975 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hbgvn\" (UniqueName: \"kubernetes.io/projected/c2d9d021-ff4d-4bcc-832b-fffe8f95ee2a-kube-api-access-hbgvn\") pod \"c2d9d021-ff4d-4bcc-832b-fffe8f95ee2a\" (UID: \"c2d9d021-ff4d-4bcc-832b-fffe8f95ee2a\") " Mar 16 15:46:04 crc kubenswrapper[5120]: I0316 15:46:04.418946 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2d9d021-ff4d-4bcc-832b-fffe8f95ee2a-kube-api-access-hbgvn" (OuterVolumeSpecName: "kube-api-access-hbgvn") pod "c2d9d021-ff4d-4bcc-832b-fffe8f95ee2a" (UID: "c2d9d021-ff4d-4bcc-832b-fffe8f95ee2a"). InnerVolumeSpecName "kube-api-access-hbgvn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:46:04 crc kubenswrapper[5120]: I0316 15:46:04.425364 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-frr-k8s/frr-k8s-webhook-server-bc5694f79-47fjz"] Mar 16 15:46:04 crc kubenswrapper[5120]: I0316 15:46:04.425948 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2d9d021-ff4d-4bcc-832b-fffe8f95ee2a" containerName="oc" Mar 16 15:46:04 crc kubenswrapper[5120]: I0316 15:46:04.425967 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2d9d021-ff4d-4bcc-832b-fffe8f95ee2a" containerName="oc" Mar 16 15:46:04 crc kubenswrapper[5120]: I0316 15:46:04.426057 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c2d9d021-ff4d-4bcc-832b-fffe8f95ee2a" containerName="oc" Mar 16 15:46:04 crc kubenswrapper[5120]: I0316 15:46:04.429343 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-frr-k8s/frr-k8s-webhook-server-bc5694f79-47fjz" Mar 16 15:46:04 crc kubenswrapper[5120]: I0316 15:46:04.431317 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-frr-k8s\"/\"frr-k8s-webhook-server-cert\"" Mar 16 15:46:04 crc kubenswrapper[5120]: I0316 15:46:04.512213 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8jsz\" (UniqueName: \"kubernetes.io/projected/a80f41a5-51f7-4d5d-a264-947ef736b918-kube-api-access-s8jsz\") pod \"frr-k8s-webhook-server-bc5694f79-47fjz\" (UID: \"a80f41a5-51f7-4d5d-a264-947ef736b918\") " pod="openshift-frr-k8s/frr-k8s-webhook-server-bc5694f79-47fjz" Mar 16 15:46:04 crc kubenswrapper[5120]: I0316 15:46:04.512421 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a80f41a5-51f7-4d5d-a264-947ef736b918-cert\") pod \"frr-k8s-webhook-server-bc5694f79-47fjz\" (UID: \"a80f41a5-51f7-4d5d-a264-947ef736b918\") " pod="openshift-frr-k8s/frr-k8s-webhook-server-bc5694f79-47fjz" Mar 16 15:46:04 crc kubenswrapper[5120]: I0316 15:46:04.512512 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hbgvn\" (UniqueName: \"kubernetes.io/projected/c2d9d021-ff4d-4bcc-832b-fffe8f95ee2a-kube-api-access-hbgvn\") on node \"crc\" DevicePath \"\"" Mar 16 15:46:04 crc kubenswrapper[5120]: I0316 15:46:04.613791 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a80f41a5-51f7-4d5d-a264-947ef736b918-cert\") pod \"frr-k8s-webhook-server-bc5694f79-47fjz\" (UID: \"a80f41a5-51f7-4d5d-a264-947ef736b918\") " pod="openshift-frr-k8s/frr-k8s-webhook-server-bc5694f79-47fjz" Mar 16 15:46:04 crc kubenswrapper[5120]: I0316 15:46:04.614073 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s8jsz\" (UniqueName: \"kubernetes.io/projected/a80f41a5-51f7-4d5d-a264-947ef736b918-kube-api-access-s8jsz\") pod \"frr-k8s-webhook-server-bc5694f79-47fjz\" (UID: \"a80f41a5-51f7-4d5d-a264-947ef736b918\") " pod="openshift-frr-k8s/frr-k8s-webhook-server-bc5694f79-47fjz" Mar 16 15:46:04 crc kubenswrapper[5120]: I0316 15:46:04.617232 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a80f41a5-51f7-4d5d-a264-947ef736b918-cert\") pod \"frr-k8s-webhook-server-bc5694f79-47fjz\" (UID: \"a80f41a5-51f7-4d5d-a264-947ef736b918\") " pod="openshift-frr-k8s/frr-k8s-webhook-server-bc5694f79-47fjz" Mar 16 15:46:04 crc kubenswrapper[5120]: I0316 15:46:04.632106 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8jsz\" (UniqueName: \"kubernetes.io/projected/a80f41a5-51f7-4d5d-a264-947ef736b918-kube-api-access-s8jsz\") pod \"frr-k8s-webhook-server-bc5694f79-47fjz\" (UID: \"a80f41a5-51f7-4d5d-a264-947ef736b918\") " pod="openshift-frr-k8s/frr-k8s-webhook-server-bc5694f79-47fjz" Mar 16 15:46:04 crc kubenswrapper[5120]: I0316 15:46:04.749994 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-frr-k8s/frr-k8s-webhook-server-bc5694f79-47fjz" Mar 16 15:46:05 crc kubenswrapper[5120]: I0316 15:46:05.059830 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561266-4l68r" event={"ID":"c2d9d021-ff4d-4bcc-832b-fffe8f95ee2a","Type":"ContainerDied","Data":"09d280e289c4ba0f42eb29904fccf582ae54b685e0171f00ab6ebf57e99f5f11"} Mar 16 15:46:05 crc kubenswrapper[5120]: I0316 15:46:05.060104 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="09d280e289c4ba0f42eb29904fccf582ae54b685e0171f00ab6ebf57e99f5f11" Mar 16 15:46:05 crc kubenswrapper[5120]: I0316 15:46:05.059849 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561266-4l68r" Mar 16 15:46:05 crc kubenswrapper[5120]: I0316 15:46:05.061588 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-frr-k8s/frr-k8s-webhook-server-bc5694f79-47fjz" event={"ID":"a80f41a5-51f7-4d5d-a264-947ef736b918","Type":"ContainerStarted","Data":"b1bbd9e17dddac0f7a79857b3d5fdc7c4c0d31d6501579379bd4554e8b237fe4"} Mar 16 15:46:05 crc kubenswrapper[5120]: I0316 15:46:05.063083 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-frr-k8s/frr-k8s-s6nw6" event={"ID":"884b547f-f858-453d-8d9d-54adc1749bd1","Type":"ContainerStarted","Data":"2bbe3561950601718b08454c97f237913ccfa754e3a392fef9a7080936c7471c"} Mar 16 15:46:05 crc kubenswrapper[5120]: I0316 15:46:05.329348 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-infra/auto-csr-approver-29561260-vphq6"] Mar 16 15:46:05 crc kubenswrapper[5120]: I0316 15:46:05.335915 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-infra/auto-csr-approver-29561260-vphq6"] Mar 16 15:46:06 crc kubenswrapper[5120]: I0316 15:46:06.341529 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-7f6f97fb86-9gspf"] Mar 16 15:46:06 crc kubenswrapper[5120]: I0316 15:46:06.346062 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-7f6f97fb86-9gspf" Mar 16 15:46:06 crc kubenswrapper[5120]: I0316 15:46:06.349242 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Mar 16 15:46:06 crc kubenswrapper[5120]: I0316 15:46:06.349365 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-nx7km\"" Mar 16 15:46:06 crc kubenswrapper[5120]: I0316 15:46:06.349255 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Mar 16 15:46:06 crc kubenswrapper[5120]: I0316 15:46:06.356660 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-7f6f97fb86-9gspf"] Mar 16 15:46:06 crc kubenswrapper[5120]: I0316 15:46:06.444136 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aa982d2d-021c-4059-a923-0f99fb2e9359-tmp\") pod \"cert-manager-operator-controller-manager-7f6f97fb86-9gspf\" (UID: \"aa982d2d-021c-4059-a923-0f99fb2e9359\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7f6f97fb86-9gspf" Mar 16 15:46:06 crc kubenswrapper[5120]: I0316 15:46:06.444234 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7cpz4\" (UniqueName: \"kubernetes.io/projected/aa982d2d-021c-4059-a923-0f99fb2e9359-kube-api-access-7cpz4\") pod \"cert-manager-operator-controller-manager-7f6f97fb86-9gspf\" (UID: \"aa982d2d-021c-4059-a923-0f99fb2e9359\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7f6f97fb86-9gspf" Mar 16 15:46:06 crc kubenswrapper[5120]: I0316 15:46:06.544979 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aa982d2d-021c-4059-a923-0f99fb2e9359-tmp\") pod \"cert-manager-operator-controller-manager-7f6f97fb86-9gspf\" (UID: \"aa982d2d-021c-4059-a923-0f99fb2e9359\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7f6f97fb86-9gspf" Mar 16 15:46:06 crc kubenswrapper[5120]: I0316 15:46:06.545080 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7cpz4\" (UniqueName: \"kubernetes.io/projected/aa982d2d-021c-4059-a923-0f99fb2e9359-kube-api-access-7cpz4\") pod \"cert-manager-operator-controller-manager-7f6f97fb86-9gspf\" (UID: \"aa982d2d-021c-4059-a923-0f99fb2e9359\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7f6f97fb86-9gspf" Mar 16 15:46:06 crc kubenswrapper[5120]: I0316 15:46:06.545866 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aa982d2d-021c-4059-a923-0f99fb2e9359-tmp\") pod \"cert-manager-operator-controller-manager-7f6f97fb86-9gspf\" (UID: \"aa982d2d-021c-4059-a923-0f99fb2e9359\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7f6f97fb86-9gspf" Mar 16 15:46:06 crc kubenswrapper[5120]: I0316 15:46:06.585739 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7cpz4\" (UniqueName: \"kubernetes.io/projected/aa982d2d-021c-4059-a923-0f99fb2e9359-kube-api-access-7cpz4\") pod \"cert-manager-operator-controller-manager-7f6f97fb86-9gspf\" (UID: \"aa982d2d-021c-4059-a923-0f99fb2e9359\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7f6f97fb86-9gspf" Mar 16 15:46:06 crc kubenswrapper[5120]: I0316 15:46:06.674460 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="30f78f33-9e10-4fa0-891d-11ff38275e0a" path="/var/lib/kubelet/pods/30f78f33-9e10-4fa0-891d-11ff38275e0a/volumes" Mar 16 15:46:06 crc kubenswrapper[5120]: I0316 15:46:06.722209 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-7f6f97fb86-9gspf" Mar 16 15:46:07 crc kubenswrapper[5120]: I0316 15:46:07.018386 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-7f6f97fb86-9gspf"] Mar 16 15:46:07 crc kubenswrapper[5120]: W0316 15:46:07.041172 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa982d2d_021c_4059_a923_0f99fb2e9359.slice/crio-6aac5af8f9cbfcd83bbc9fee95f60998c92e009238e69e8ddf5ed88930ed25de WatchSource:0}: Error finding container 6aac5af8f9cbfcd83bbc9fee95f60998c92e009238e69e8ddf5ed88930ed25de: Status 404 returned error can't find the container with id 6aac5af8f9cbfcd83bbc9fee95f60998c92e009238e69e8ddf5ed88930ed25de Mar 16 15:46:07 crc kubenswrapper[5120]: I0316 15:46:07.087236 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-7f6f97fb86-9gspf" event={"ID":"aa982d2d-021c-4059-a923-0f99fb2e9359","Type":"ContainerStarted","Data":"6aac5af8f9cbfcd83bbc9fee95f60998c92e009238e69e8ddf5ed88930ed25de"} Mar 16 15:46:07 crc kubenswrapper[5120]: E0316 15:46:07.660689 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=731913 actualBytes=10240 Mar 16 15:46:14 crc kubenswrapper[5120]: I0316 15:46:14.169043 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-frr-k8s/frr-k8s-webhook-server-bc5694f79-47fjz" event={"ID":"a80f41a5-51f7-4d5d-a264-947ef736b918","Type":"ContainerStarted","Data":"516bbf1586a54ee432c4f5cbe308591afa7e7c0ef5abca38b5daf8f534f43b6b"} Mar 16 15:46:14 crc kubenswrapper[5120]: I0316 15:46:14.170137 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-frr-k8s/frr-k8s-webhook-server-bc5694f79-47fjz" Mar 16 15:46:14 crc kubenswrapper[5120]: I0316 15:46:14.171888 5120 generic.go:358] "Generic (PLEG): container finished" podID="884b547f-f858-453d-8d9d-54adc1749bd1" containerID="a2cd0c48c1b7a3890da27e3ac5e491f3b6ce98136ed258f29539dd0aa9026857" exitCode=0 Mar 16 15:46:14 crc kubenswrapper[5120]: I0316 15:46:14.171945 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-frr-k8s/frr-k8s-s6nw6" event={"ID":"884b547f-f858-453d-8d9d-54adc1749bd1","Type":"ContainerDied","Data":"a2cd0c48c1b7a3890da27e3ac5e491f3b6ce98136ed258f29539dd0aa9026857"} Mar 16 15:46:14 crc kubenswrapper[5120]: I0316 15:46:14.174302 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-7f6f97fb86-9gspf" event={"ID":"aa982d2d-021c-4059-a923-0f99fb2e9359","Type":"ContainerStarted","Data":"3332331a351cd6ddcd73b8905ae51337275afcd5c208c9fcd49b3011856cfd37"} Mar 16 15:46:14 crc kubenswrapper[5120]: I0316 15:46:14.183375 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-frr-k8s/frr-k8s-webhook-server-bc5694f79-47fjz" podStartSLOduration=1.77431052 podStartE2EDuration="10.183360943s" podCreationTimestamp="2026-03-16 15:46:04 +0000 UTC" firstStartedPulling="2026-03-16 15:46:04.774923222 +0000 UTC m=+866.928854889" lastFinishedPulling="2026-03-16 15:46:13.183973655 +0000 UTC m=+875.337905312" observedRunningTime="2026-03-16 15:46:14.183220249 +0000 UTC m=+876.337151906" watchObservedRunningTime="2026-03-16 15:46:14.183360943 +0000 UTC m=+876.337292600" Mar 16 15:46:14 crc kubenswrapper[5120]: I0316 15:46:14.202249 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-7f6f97fb86-9gspf" podStartSLOduration=2.102571567 podStartE2EDuration="8.202235321s" podCreationTimestamp="2026-03-16 15:46:06 +0000 UTC" firstStartedPulling="2026-03-16 15:46:07.051729582 +0000 UTC m=+869.205661239" lastFinishedPulling="2026-03-16 15:46:13.151393336 +0000 UTC m=+875.305324993" observedRunningTime="2026-03-16 15:46:14.201167083 +0000 UTC m=+876.355098730" watchObservedRunningTime="2026-03-16 15:46:14.202235321 +0000 UTC m=+876.356166978" Mar 16 15:46:15 crc kubenswrapper[5120]: I0316 15:46:15.181489 5120 generic.go:358] "Generic (PLEG): container finished" podID="884b547f-f858-453d-8d9d-54adc1749bd1" containerID="9b42a82e322b19f5c27305c3206c41f58b3fabe87eaa7f58cebdfdc82fb43554" exitCode=0 Mar 16 15:46:15 crc kubenswrapper[5120]: I0316 15:46:15.181566 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-frr-k8s/frr-k8s-s6nw6" event={"ID":"884b547f-f858-453d-8d9d-54adc1749bd1","Type":"ContainerDied","Data":"9b42a82e322b19f5c27305c3206c41f58b3fabe87eaa7f58cebdfdc82fb43554"} Mar 16 15:46:16 crc kubenswrapper[5120]: I0316 15:46:16.192199 5120 generic.go:358] "Generic (PLEG): container finished" podID="884b547f-f858-453d-8d9d-54adc1749bd1" containerID="229c470fc82dade20586d0bfdedad9904ee6f0ce6588c30f8c9fb90ccc8778ea" exitCode=0 Mar 16 15:46:16 crc kubenswrapper[5120]: I0316 15:46:16.192336 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-frr-k8s/frr-k8s-s6nw6" event={"ID":"884b547f-f858-453d-8d9d-54adc1749bd1","Type":"ContainerDied","Data":"229c470fc82dade20586d0bfdedad9904ee6f0ce6588c30f8c9fb90ccc8778ea"} Mar 16 15:46:17 crc kubenswrapper[5120]: I0316 15:46:17.202991 5120 generic.go:358] "Generic (PLEG): container finished" podID="884b547f-f858-453d-8d9d-54adc1749bd1" containerID="763b08324c689a0bad49d427723c3b621419936b83539e115d0ce7ed9d8014e0" exitCode=0 Mar 16 15:46:17 crc kubenswrapper[5120]: I0316 15:46:17.203698 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-frr-k8s/frr-k8s-s6nw6" event={"ID":"884b547f-f858-453d-8d9d-54adc1749bd1","Type":"ContainerDied","Data":"763b08324c689a0bad49d427723c3b621419936b83539e115d0ce7ed9d8014e0"} Mar 16 15:46:17 crc kubenswrapper[5120]: I0316 15:46:17.828564 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-597b96b99b-8mqkn"] Mar 16 15:46:18 crc kubenswrapper[5120]: I0316 15:46:18.477525 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-597b96b99b-8mqkn"] Mar 16 15:46:18 crc kubenswrapper[5120]: I0316 15:46:18.477696 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-597b96b99b-8mqkn" Mar 16 15:46:18 crc kubenswrapper[5120]: I0316 15:46:18.479821 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Mar 16 15:46:18 crc kubenswrapper[5120]: I0316 15:46:18.479834 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-mcvq9\"" Mar 16 15:46:18 crc kubenswrapper[5120]: I0316 15:46:18.490198 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Mar 16 15:46:18 crc kubenswrapper[5120]: I0316 15:46:18.601568 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3371b452-79cc-4573-a16f-fb885f37946a-bound-sa-token\") pod \"cert-manager-webhook-597b96b99b-8mqkn\" (UID: \"3371b452-79cc-4573-a16f-fb885f37946a\") " pod="cert-manager/cert-manager-webhook-597b96b99b-8mqkn" Mar 16 15:46:18 crc kubenswrapper[5120]: I0316 15:46:18.601684 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xsmnp\" (UniqueName: \"kubernetes.io/projected/3371b452-79cc-4573-a16f-fb885f37946a-kube-api-access-xsmnp\") pod \"cert-manager-webhook-597b96b99b-8mqkn\" (UID: \"3371b452-79cc-4573-a16f-fb885f37946a\") " pod="cert-manager/cert-manager-webhook-597b96b99b-8mqkn" Mar 16 15:46:18 crc kubenswrapper[5120]: I0316 15:46:18.702520 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xsmnp\" (UniqueName: \"kubernetes.io/projected/3371b452-79cc-4573-a16f-fb885f37946a-kube-api-access-xsmnp\") pod \"cert-manager-webhook-597b96b99b-8mqkn\" (UID: \"3371b452-79cc-4573-a16f-fb885f37946a\") " pod="cert-manager/cert-manager-webhook-597b96b99b-8mqkn" Mar 16 15:46:18 crc kubenswrapper[5120]: I0316 15:46:18.702596 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3371b452-79cc-4573-a16f-fb885f37946a-bound-sa-token\") pod \"cert-manager-webhook-597b96b99b-8mqkn\" (UID: \"3371b452-79cc-4573-a16f-fb885f37946a\") " pod="cert-manager/cert-manager-webhook-597b96b99b-8mqkn" Mar 16 15:46:18 crc kubenswrapper[5120]: I0316 15:46:18.723872 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3371b452-79cc-4573-a16f-fb885f37946a-bound-sa-token\") pod \"cert-manager-webhook-597b96b99b-8mqkn\" (UID: \"3371b452-79cc-4573-a16f-fb885f37946a\") " pod="cert-manager/cert-manager-webhook-597b96b99b-8mqkn" Mar 16 15:46:18 crc kubenswrapper[5120]: I0316 15:46:18.727501 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xsmnp\" (UniqueName: \"kubernetes.io/projected/3371b452-79cc-4573-a16f-fb885f37946a-kube-api-access-xsmnp\") pod \"cert-manager-webhook-597b96b99b-8mqkn\" (UID: \"3371b452-79cc-4573-a16f-fb885f37946a\") " pod="cert-manager/cert-manager-webhook-597b96b99b-8mqkn" Mar 16 15:46:18 crc kubenswrapper[5120]: I0316 15:46:18.792814 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-597b96b99b-8mqkn" Mar 16 15:46:19 crc kubenswrapper[5120]: I0316 15:46:19.195659 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-597b96b99b-8mqkn"] Mar 16 15:46:19 crc kubenswrapper[5120]: I0316 15:46:19.222450 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-frr-k8s/frr-k8s-s6nw6" event={"ID":"884b547f-f858-453d-8d9d-54adc1749bd1","Type":"ContainerStarted","Data":"d425855816ad9ee61c353f9070510fbbda42d049ac74fdd7cba39ad6ccd940ca"} Mar 16 15:46:19 crc kubenswrapper[5120]: I0316 15:46:19.222489 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-frr-k8s/frr-k8s-s6nw6" event={"ID":"884b547f-f858-453d-8d9d-54adc1749bd1","Type":"ContainerStarted","Data":"16074c896ff2789c3f92b6a3efcedd10d6912173bd1cfd604b9744094900640f"} Mar 16 15:46:19 crc kubenswrapper[5120]: I0316 15:46:19.222501 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-frr-k8s/frr-k8s-s6nw6" event={"ID":"884b547f-f858-453d-8d9d-54adc1749bd1","Type":"ContainerStarted","Data":"97ee3892fbb27f6f44fa87fc3487cf86796c84caefb61ed8d9866c2e0f487174"} Mar 16 15:46:19 crc kubenswrapper[5120]: I0316 15:46:19.222512 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-frr-k8s/frr-k8s-s6nw6" event={"ID":"884b547f-f858-453d-8d9d-54adc1749bd1","Type":"ContainerStarted","Data":"e24abad1fff8aa66eaeb4c73be46ab3b90b528c650250a1e99d4e4939ed9b256"} Mar 16 15:46:20 crc kubenswrapper[5120]: I0316 15:46:20.232001 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-frr-k8s/frr-k8s-s6nw6" event={"ID":"884b547f-f858-453d-8d9d-54adc1749bd1","Type":"ContainerStarted","Data":"7c4cf2211bcd515db6e72e683e70a6768dde7f3ab9bff38a38e4712fc76d59f4"} Mar 16 15:46:20 crc kubenswrapper[5120]: I0316 15:46:20.233069 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-597b96b99b-8mqkn" event={"ID":"3371b452-79cc-4573-a16f-fb885f37946a","Type":"ContainerStarted","Data":"04ae3e2e025a924e23b6cdbbca4d4ec7cf36425e9f279d2ece4b3b125f36f5d5"} Mar 16 15:46:20 crc kubenswrapper[5120]: I0316 15:46:20.782821 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-8966b78d4-gv9vk"] Mar 16 15:46:20 crc kubenswrapper[5120]: I0316 15:46:20.790000 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-8966b78d4-gv9vk"] Mar 16 15:46:20 crc kubenswrapper[5120]: I0316 15:46:20.790106 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-8966b78d4-gv9vk" Mar 16 15:46:20 crc kubenswrapper[5120]: I0316 15:46:20.792278 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-7m9q4\"" Mar 16 15:46:20 crc kubenswrapper[5120]: I0316 15:46:20.835621 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjzdg\" (UniqueName: \"kubernetes.io/projected/2e8a8519-57b7-4e2b-a654-54129ca2213b-kube-api-access-kjzdg\") pod \"cert-manager-cainjector-8966b78d4-gv9vk\" (UID: \"2e8a8519-57b7-4e2b-a654-54129ca2213b\") " pod="cert-manager/cert-manager-cainjector-8966b78d4-gv9vk" Mar 16 15:46:20 crc kubenswrapper[5120]: I0316 15:46:20.835792 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2e8a8519-57b7-4e2b-a654-54129ca2213b-bound-sa-token\") pod \"cert-manager-cainjector-8966b78d4-gv9vk\" (UID: \"2e8a8519-57b7-4e2b-a654-54129ca2213b\") " pod="cert-manager/cert-manager-cainjector-8966b78d4-gv9vk" Mar 16 15:46:20 crc kubenswrapper[5120]: I0316 15:46:20.936893 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2e8a8519-57b7-4e2b-a654-54129ca2213b-bound-sa-token\") pod \"cert-manager-cainjector-8966b78d4-gv9vk\" (UID: \"2e8a8519-57b7-4e2b-a654-54129ca2213b\") " pod="cert-manager/cert-manager-cainjector-8966b78d4-gv9vk" Mar 16 15:46:20 crc kubenswrapper[5120]: I0316 15:46:20.937009 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kjzdg\" (UniqueName: \"kubernetes.io/projected/2e8a8519-57b7-4e2b-a654-54129ca2213b-kube-api-access-kjzdg\") pod \"cert-manager-cainjector-8966b78d4-gv9vk\" (UID: \"2e8a8519-57b7-4e2b-a654-54129ca2213b\") " pod="cert-manager/cert-manager-cainjector-8966b78d4-gv9vk" Mar 16 15:46:20 crc kubenswrapper[5120]: I0316 15:46:20.958521 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2e8a8519-57b7-4e2b-a654-54129ca2213b-bound-sa-token\") pod \"cert-manager-cainjector-8966b78d4-gv9vk\" (UID: \"2e8a8519-57b7-4e2b-a654-54129ca2213b\") " pod="cert-manager/cert-manager-cainjector-8966b78d4-gv9vk" Mar 16 15:46:20 crc kubenswrapper[5120]: I0316 15:46:20.958944 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjzdg\" (UniqueName: \"kubernetes.io/projected/2e8a8519-57b7-4e2b-a654-54129ca2213b-kube-api-access-kjzdg\") pod \"cert-manager-cainjector-8966b78d4-gv9vk\" (UID: \"2e8a8519-57b7-4e2b-a654-54129ca2213b\") " pod="cert-manager/cert-manager-cainjector-8966b78d4-gv9vk" Mar 16 15:46:21 crc kubenswrapper[5120]: I0316 15:46:21.107241 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-8966b78d4-gv9vk" Mar 16 15:46:21 crc kubenswrapper[5120]: I0316 15:46:21.250610 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-frr-k8s/frr-k8s-s6nw6" event={"ID":"884b547f-f858-453d-8d9d-54adc1749bd1","Type":"ContainerStarted","Data":"be21cb686e1fc9824887198641c11acf82c048a48bb70eb5274bea6de1db78dc"} Mar 16 15:46:21 crc kubenswrapper[5120]: I0316 15:46:21.252857 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-frr-k8s/frr-k8s-s6nw6" event={"ID":"884b547f-f858-453d-8d9d-54adc1749bd1","Type":"ContainerStarted","Data":"26a378960eccf4f34804dc58b4d169277ad4050b980b4e3fda19943a05766011"} Mar 16 15:46:21 crc kubenswrapper[5120]: I0316 15:46:21.252911 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-frr-k8s/frr-k8s-s6nw6" Mar 16 15:46:21 crc kubenswrapper[5120]: I0316 15:46:21.279480 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-frr-k8s/frr-k8s-s6nw6" podStartSLOduration=9.200330113 podStartE2EDuration="18.279444186s" podCreationTimestamp="2026-03-16 15:46:03 +0000 UTC" firstStartedPulling="2026-03-16 15:46:04.105944471 +0000 UTC m=+866.259876138" lastFinishedPulling="2026-03-16 15:46:13.185058544 +0000 UTC m=+875.338990211" observedRunningTime="2026-03-16 15:46:21.27241761 +0000 UTC m=+883.426349287" watchObservedRunningTime="2026-03-16 15:46:21.279444186 +0000 UTC m=+883.433375873" Mar 16 15:46:21 crc kubenswrapper[5120]: I0316 15:46:21.507947 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-8966b78d4-gv9vk"] Mar 16 15:46:21 crc kubenswrapper[5120]: W0316 15:46:21.511864 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2e8a8519_57b7_4e2b_a654_54129ca2213b.slice/crio-9f2a6267300cb40d4f5d8f8f595618b856611b71f8772868f0a15b84e789f90b WatchSource:0}: Error finding container 9f2a6267300cb40d4f5d8f8f595618b856611b71f8772868f0a15b84e789f90b: Status 404 returned error can't find the container with id 9f2a6267300cb40d4f5d8f8f595618b856611b71f8772868f0a15b84e789f90b Mar 16 15:46:22 crc kubenswrapper[5120]: I0316 15:46:22.268036 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-8966b78d4-gv9vk" event={"ID":"2e8a8519-57b7-4e2b-a654-54129ca2213b","Type":"ContainerStarted","Data":"9f2a6267300cb40d4f5d8f8f595618b856611b71f8772868f0a15b84e789f90b"} Mar 16 15:46:23 crc kubenswrapper[5120]: I0316 15:46:23.978650 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-frr-k8s/frr-k8s-s6nw6" Mar 16 15:46:24 crc kubenswrapper[5120]: I0316 15:46:24.019023 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-frr-k8s/frr-k8s-s6nw6" Mar 16 15:46:24 crc kubenswrapper[5120]: I0316 15:46:24.280805 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-597b96b99b-8mqkn" event={"ID":"3371b452-79cc-4573-a16f-fb885f37946a","Type":"ContainerStarted","Data":"9c04339324f0e0e520bf9754091317c661b1144654a050399ea3e1d269a5bc29"} Mar 16 15:46:24 crc kubenswrapper[5120]: I0316 15:46:24.281105 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-597b96b99b-8mqkn" Mar 16 15:46:24 crc kubenswrapper[5120]: I0316 15:46:24.283475 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-8966b78d4-gv9vk" event={"ID":"2e8a8519-57b7-4e2b-a654-54129ca2213b","Type":"ContainerStarted","Data":"55e292a0538006c6ef21d6ec6df23c281a31e9b94c26f74628a95de837fcdfb2"} Mar 16 15:46:24 crc kubenswrapper[5120]: I0316 15:46:24.295787 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-597b96b99b-8mqkn" podStartSLOduration=2.444247786 podStartE2EDuration="7.295750877s" podCreationTimestamp="2026-03-16 15:46:17 +0000 UTC" firstStartedPulling="2026-03-16 15:46:19.220437481 +0000 UTC m=+881.374369138" lastFinishedPulling="2026-03-16 15:46:24.071940572 +0000 UTC m=+886.225872229" observedRunningTime="2026-03-16 15:46:24.294132995 +0000 UTC m=+886.448064652" watchObservedRunningTime="2026-03-16 15:46:24.295750877 +0000 UTC m=+886.449682524" Mar 16 15:46:24 crc kubenswrapper[5120]: I0316 15:46:24.335868 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-8966b78d4-gv9vk" podStartSLOduration=1.7584986150000002 podStartE2EDuration="4.335851496s" podCreationTimestamp="2026-03-16 15:46:20 +0000 UTC" firstStartedPulling="2026-03-16 15:46:21.513983493 +0000 UTC m=+883.667915150" lastFinishedPulling="2026-03-16 15:46:24.091336374 +0000 UTC m=+886.245268031" observedRunningTime="2026-03-16 15:46:24.333120194 +0000 UTC m=+886.487051851" watchObservedRunningTime="2026-03-16 15:46:24.335851496 +0000 UTC m=+886.489783153" Mar 16 15:46:26 crc kubenswrapper[5120]: I0316 15:46:26.199071 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-frr-k8s/frr-k8s-webhook-server-bc5694f79-47fjz" Mar 16 15:46:26 crc kubenswrapper[5120]: I0316 15:46:26.292026 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-marketplace-tztg5"] Mar 16 15:46:26 crc kubenswrapper[5120]: I0316 15:46:26.302965 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-tztg5" Mar 16 15:46:26 crc kubenswrapper[5120]: I0316 15:46:26.303403 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-tztg5"] Mar 16 15:46:26 crc kubenswrapper[5120]: I0316 15:46:26.421463 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xdhz\" (UniqueName: \"kubernetes.io/projected/c367d6e3-c3c1-4a9f-8d5f-11a66d9aaa36-kube-api-access-2xdhz\") pod \"redhat-marketplace-tztg5\" (UID: \"c367d6e3-c3c1-4a9f-8d5f-11a66d9aaa36\") " pod="openshift-marketplace/redhat-marketplace-tztg5" Mar 16 15:46:26 crc kubenswrapper[5120]: I0316 15:46:26.421547 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/c367d6e3-c3c1-4a9f-8d5f-11a66d9aaa36-utilities\") pod \"redhat-marketplace-tztg5\" (UID: \"c367d6e3-c3c1-4a9f-8d5f-11a66d9aaa36\") " pod="openshift-marketplace/redhat-marketplace-tztg5" Mar 16 15:46:26 crc kubenswrapper[5120]: I0316 15:46:26.421601 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/c367d6e3-c3c1-4a9f-8d5f-11a66d9aaa36-catalog-content\") pod \"redhat-marketplace-tztg5\" (UID: \"c367d6e3-c3c1-4a9f-8d5f-11a66d9aaa36\") " pod="openshift-marketplace/redhat-marketplace-tztg5" Mar 16 15:46:26 crc kubenswrapper[5120]: I0316 15:46:26.523341 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2xdhz\" (UniqueName: \"kubernetes.io/projected/c367d6e3-c3c1-4a9f-8d5f-11a66d9aaa36-kube-api-access-2xdhz\") pod \"redhat-marketplace-tztg5\" (UID: \"c367d6e3-c3c1-4a9f-8d5f-11a66d9aaa36\") " pod="openshift-marketplace/redhat-marketplace-tztg5" Mar 16 15:46:26 crc kubenswrapper[5120]: I0316 15:46:26.523725 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/c367d6e3-c3c1-4a9f-8d5f-11a66d9aaa36-utilities\") pod \"redhat-marketplace-tztg5\" (UID: \"c367d6e3-c3c1-4a9f-8d5f-11a66d9aaa36\") " pod="openshift-marketplace/redhat-marketplace-tztg5" Mar 16 15:46:26 crc kubenswrapper[5120]: I0316 15:46:26.524122 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/c367d6e3-c3c1-4a9f-8d5f-11a66d9aaa36-utilities\") pod \"redhat-marketplace-tztg5\" (UID: \"c367d6e3-c3c1-4a9f-8d5f-11a66d9aaa36\") " pod="openshift-marketplace/redhat-marketplace-tztg5" Mar 16 15:46:26 crc kubenswrapper[5120]: I0316 15:46:26.524166 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/c367d6e3-c3c1-4a9f-8d5f-11a66d9aaa36-catalog-content\") pod \"redhat-marketplace-tztg5\" (UID: \"c367d6e3-c3c1-4a9f-8d5f-11a66d9aaa36\") " pod="openshift-marketplace/redhat-marketplace-tztg5" Mar 16 15:46:26 crc kubenswrapper[5120]: I0316 15:46:26.524164 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/c367d6e3-c3c1-4a9f-8d5f-11a66d9aaa36-catalog-content\") pod \"redhat-marketplace-tztg5\" (UID: \"c367d6e3-c3c1-4a9f-8d5f-11a66d9aaa36\") " pod="openshift-marketplace/redhat-marketplace-tztg5" Mar 16 15:46:26 crc kubenswrapper[5120]: I0316 15:46:26.544012 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xdhz\" (UniqueName: \"kubernetes.io/projected/c367d6e3-c3c1-4a9f-8d5f-11a66d9aaa36-kube-api-access-2xdhz\") pod \"redhat-marketplace-tztg5\" (UID: \"c367d6e3-c3c1-4a9f-8d5f-11a66d9aaa36\") " pod="openshift-marketplace/redhat-marketplace-tztg5" Mar 16 15:46:26 crc kubenswrapper[5120]: I0316 15:46:26.620479 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-tztg5" Mar 16 15:46:26 crc kubenswrapper[5120]: I0316 15:46:26.742259 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-759f64656b-r4522"] Mar 16 15:46:26 crc kubenswrapper[5120]: I0316 15:46:26.748455 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-759f64656b-r4522" Mar 16 15:46:26 crc kubenswrapper[5120]: I0316 15:46:26.751126 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-p7wzx\"" Mar 16 15:46:26 crc kubenswrapper[5120]: I0316 15:46:26.758472 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-759f64656b-r4522"] Mar 16 15:46:26 crc kubenswrapper[5120]: I0316 15:46:26.826953 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2bc8ef1b-920f-4da9-b11d-182fa58ffc20-bound-sa-token\") pod \"cert-manager-759f64656b-r4522\" (UID: \"2bc8ef1b-920f-4da9-b11d-182fa58ffc20\") " pod="cert-manager/cert-manager-759f64656b-r4522" Mar 16 15:46:26 crc kubenswrapper[5120]: I0316 15:46:26.827015 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4sbck\" (UniqueName: \"kubernetes.io/projected/2bc8ef1b-920f-4da9-b11d-182fa58ffc20-kube-api-access-4sbck\") pod \"cert-manager-759f64656b-r4522\" (UID: \"2bc8ef1b-920f-4da9-b11d-182fa58ffc20\") " pod="cert-manager/cert-manager-759f64656b-r4522" Mar 16 15:46:26 crc kubenswrapper[5120]: I0316 15:46:26.927894 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2bc8ef1b-920f-4da9-b11d-182fa58ffc20-bound-sa-token\") pod \"cert-manager-759f64656b-r4522\" (UID: \"2bc8ef1b-920f-4da9-b11d-182fa58ffc20\") " pod="cert-manager/cert-manager-759f64656b-r4522" Mar 16 15:46:26 crc kubenswrapper[5120]: I0316 15:46:26.927948 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4sbck\" (UniqueName: \"kubernetes.io/projected/2bc8ef1b-920f-4da9-b11d-182fa58ffc20-kube-api-access-4sbck\") pod \"cert-manager-759f64656b-r4522\" (UID: \"2bc8ef1b-920f-4da9-b11d-182fa58ffc20\") " pod="cert-manager/cert-manager-759f64656b-r4522" Mar 16 15:46:26 crc kubenswrapper[5120]: I0316 15:46:26.944978 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2bc8ef1b-920f-4da9-b11d-182fa58ffc20-bound-sa-token\") pod \"cert-manager-759f64656b-r4522\" (UID: \"2bc8ef1b-920f-4da9-b11d-182fa58ffc20\") " pod="cert-manager/cert-manager-759f64656b-r4522" Mar 16 15:46:26 crc kubenswrapper[5120]: I0316 15:46:26.946366 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4sbck\" (UniqueName: \"kubernetes.io/projected/2bc8ef1b-920f-4da9-b11d-182fa58ffc20-kube-api-access-4sbck\") pod \"cert-manager-759f64656b-r4522\" (UID: \"2bc8ef1b-920f-4da9-b11d-182fa58ffc20\") " pod="cert-manager/cert-manager-759f64656b-r4522" Mar 16 15:46:27 crc kubenswrapper[5120]: I0316 15:46:27.061120 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-tztg5"] Mar 16 15:46:27 crc kubenswrapper[5120]: W0316 15:46:27.072336 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc367d6e3_c3c1_4a9f_8d5f_11a66d9aaa36.slice/crio-597a0662394ddb841e830ad7e1ece960e13bdf4b82e8aaa5afcda8fd1a6de05b WatchSource:0}: Error finding container 597a0662394ddb841e830ad7e1ece960e13bdf4b82e8aaa5afcda8fd1a6de05b: Status 404 returned error can't find the container with id 597a0662394ddb841e830ad7e1ece960e13bdf4b82e8aaa5afcda8fd1a6de05b Mar 16 15:46:27 crc kubenswrapper[5120]: I0316 15:46:27.079115 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-759f64656b-r4522" Mar 16 15:46:27 crc kubenswrapper[5120]: I0316 15:46:27.286533 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-759f64656b-r4522"] Mar 16 15:46:27 crc kubenswrapper[5120]: I0316 15:46:27.306239 5120 generic.go:358] "Generic (PLEG): container finished" podID="c367d6e3-c3c1-4a9f-8d5f-11a66d9aaa36" containerID="487a9fd9d4f246fb76589e080fdd6881dae948defd75130d65f6347162d38d10" exitCode=0 Mar 16 15:46:27 crc kubenswrapper[5120]: I0316 15:46:27.306374 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-tztg5" event={"ID":"c367d6e3-c3c1-4a9f-8d5f-11a66d9aaa36","Type":"ContainerDied","Data":"487a9fd9d4f246fb76589e080fdd6881dae948defd75130d65f6347162d38d10"} Mar 16 15:46:27 crc kubenswrapper[5120]: I0316 15:46:27.306409 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-tztg5" event={"ID":"c367d6e3-c3c1-4a9f-8d5f-11a66d9aaa36","Type":"ContainerStarted","Data":"597a0662394ddb841e830ad7e1ece960e13bdf4b82e8aaa5afcda8fd1a6de05b"} Mar 16 15:46:27 crc kubenswrapper[5120]: W0316 15:46:27.313912 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2bc8ef1b_920f_4da9_b11d_182fa58ffc20.slice/crio-a86b57faba5f581730c1cd088a66c9ee97a7d098ccb2b951e4cb5f21191312f5 WatchSource:0}: Error finding container a86b57faba5f581730c1cd088a66c9ee97a7d098ccb2b951e4cb5f21191312f5: Status 404 returned error can't find the container with id a86b57faba5f581730c1cd088a66c9ee97a7d098ccb2b951e4cb5f21191312f5 Mar 16 15:46:28 crc kubenswrapper[5120]: I0316 15:46:28.319022 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-tztg5" event={"ID":"c367d6e3-c3c1-4a9f-8d5f-11a66d9aaa36","Type":"ContainerDied","Data":"6b972b4c8653d57cf7c7ecbe75d5086c1d8998a5cfadb96d2e4625411c339bc5"} Mar 16 15:46:28 crc kubenswrapper[5120]: I0316 15:46:28.318840 5120 generic.go:358] "Generic (PLEG): container finished" podID="c367d6e3-c3c1-4a9f-8d5f-11a66d9aaa36" containerID="6b972b4c8653d57cf7c7ecbe75d5086c1d8998a5cfadb96d2e4625411c339bc5" exitCode=0 Mar 16 15:46:28 crc kubenswrapper[5120]: I0316 15:46:28.321615 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-759f64656b-r4522" event={"ID":"2bc8ef1b-920f-4da9-b11d-182fa58ffc20","Type":"ContainerStarted","Data":"5b92e41f9e0cf6eb827829be8a9d6e8458f837c56670b45d14f5cf0aa52412c5"} Mar 16 15:46:28 crc kubenswrapper[5120]: I0316 15:46:28.321673 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-759f64656b-r4522" event={"ID":"2bc8ef1b-920f-4da9-b11d-182fa58ffc20","Type":"ContainerStarted","Data":"a86b57faba5f581730c1cd088a66c9ee97a7d098ccb2b951e4cb5f21191312f5"} Mar 16 15:46:28 crc kubenswrapper[5120]: I0316 15:46:28.369567 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-759f64656b-r4522" podStartSLOduration=2.3695352 podStartE2EDuration="2.3695352s" podCreationTimestamp="2026-03-16 15:46:26 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:46:28.360969064 +0000 UTC m=+890.514900731" watchObservedRunningTime="2026-03-16 15:46:28.3695352 +0000 UTC m=+890.523466897" Mar 16 15:46:29 crc kubenswrapper[5120]: I0316 15:46:29.327997 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-tztg5" event={"ID":"c367d6e3-c3c1-4a9f-8d5f-11a66d9aaa36","Type":"ContainerStarted","Data":"b828de1013dba1fb82f72801e2d56d902eff234163384c1e83fd73967376ed2b"} Mar 16 15:46:29 crc kubenswrapper[5120]: I0316 15:46:29.345227 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/redhat-marketplace-tztg5" podStartSLOduration=2.69132366 podStartE2EDuration="3.345204612s" podCreationTimestamp="2026-03-16 15:46:26 +0000 UTC" firstStartedPulling="2026-03-16 15:46:27.307625802 +0000 UTC m=+889.461557499" lastFinishedPulling="2026-03-16 15:46:27.961506764 +0000 UTC m=+890.115438451" observedRunningTime="2026-03-16 15:46:29.341059723 +0000 UTC m=+891.494991390" watchObservedRunningTime="2026-03-16 15:46:29.345204612 +0000 UTC m=+891.499136269" Mar 16 15:46:30 crc kubenswrapper[5120]: I0316 15:46:30.291804 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-597b96b99b-8mqkn" Mar 16 15:46:32 crc kubenswrapper[5120]: I0316 15:46:32.657007 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-operators/openstack-operator-index-jh545"] Mar 16 15:46:32 crc kubenswrapper[5120]: I0316 15:46:32.679621 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/openstack-operator-index-jh545" Mar 16 15:46:32 crc kubenswrapper[5120]: I0316 15:46:32.684030 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-operators\"/\"kube-root-ca.crt\"" Mar 16 15:46:32 crc kubenswrapper[5120]: I0316 15:46:32.685396 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-operators\"/\"openshift-service-ca.crt\"" Mar 16 15:46:32 crc kubenswrapper[5120]: I0316 15:46:32.685700 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-operators\"/\"openstack-operator-index-dockercfg-snw5l\"" Mar 16 15:46:32 crc kubenswrapper[5120]: I0316 15:46:32.693937 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/openstack-operator-index-jh545"] Mar 16 15:46:32 crc kubenswrapper[5120]: I0316 15:46:32.816038 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggwkc\" (UniqueName: \"kubernetes.io/projected/97a21562-64ab-44ad-9785-606dc59bba45-kube-api-access-ggwkc\") pod \"openstack-operator-index-jh545\" (UID: \"97a21562-64ab-44ad-9785-606dc59bba45\") " pod="openstack-operators/openstack-operator-index-jh545" Mar 16 15:46:32 crc kubenswrapper[5120]: I0316 15:46:32.916951 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ggwkc\" (UniqueName: \"kubernetes.io/projected/97a21562-64ab-44ad-9785-606dc59bba45-kube-api-access-ggwkc\") pod \"openstack-operator-index-jh545\" (UID: \"97a21562-64ab-44ad-9785-606dc59bba45\") " pod="openstack-operators/openstack-operator-index-jh545" Mar 16 15:46:32 crc kubenswrapper[5120]: I0316 15:46:32.949383 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggwkc\" (UniqueName: \"kubernetes.io/projected/97a21562-64ab-44ad-9785-606dc59bba45-kube-api-access-ggwkc\") pod \"openstack-operator-index-jh545\" (UID: \"97a21562-64ab-44ad-9785-606dc59bba45\") " pod="openstack-operators/openstack-operator-index-jh545" Mar 16 15:46:33 crc kubenswrapper[5120]: I0316 15:46:33.002045 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/openstack-operator-index-jh545" Mar 16 15:46:33 crc kubenswrapper[5120]: I0316 15:46:33.255104 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/openstack-operator-index-jh545"] Mar 16 15:46:33 crc kubenswrapper[5120]: W0316 15:46:33.266025 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97a21562_64ab_44ad_9785_606dc59bba45.slice/crio-d5417d95598d4afce3ca9029beff26fb3400694d8f281e4b68efb656fd3b3b77 WatchSource:0}: Error finding container d5417d95598d4afce3ca9029beff26fb3400694d8f281e4b68efb656fd3b3b77: Status 404 returned error can't find the container with id d5417d95598d4afce3ca9029beff26fb3400694d8f281e4b68efb656fd3b3b77 Mar 16 15:46:33 crc kubenswrapper[5120]: I0316 15:46:33.353517 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/openstack-operator-index-jh545" event={"ID":"97a21562-64ab-44ad-9785-606dc59bba45","Type":"ContainerStarted","Data":"d5417d95598d4afce3ca9029beff26fb3400694d8f281e4b68efb656fd3b3b77"} Mar 16 15:46:34 crc kubenswrapper[5120]: I0316 15:46:34.286198 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-frr-k8s/frr-k8s-s6nw6" Mar 16 15:46:36 crc kubenswrapper[5120]: I0316 15:46:36.008119 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/openstack-operator-index-jh545"] Mar 16 15:46:36 crc kubenswrapper[5120]: I0316 15:46:36.621738 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-marketplace/redhat-marketplace-tztg5" Mar 16 15:46:36 crc kubenswrapper[5120]: I0316 15:46:36.621808 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-operators/openstack-operator-index-2h9ct"] Mar 16 15:46:36 crc kubenswrapper[5120]: I0316 15:46:36.693269 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/openstack-operator-index-2h9ct"] Mar 16 15:46:36 crc kubenswrapper[5120]: I0316 15:46:36.693338 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/openstack-operator-index-2h9ct" Mar 16 15:46:36 crc kubenswrapper[5120]: I0316 15:46:36.693429 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-marketplace-tztg5" Mar 16 15:46:36 crc kubenswrapper[5120]: I0316 15:46:36.708715 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-marketplace-tztg5" Mar 16 15:46:36 crc kubenswrapper[5120]: I0316 15:46:36.871486 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbgsh\" (UniqueName: \"kubernetes.io/projected/127fb533-a6f7-4dc2-85d9-69ec57116fe9-kube-api-access-wbgsh\") pod \"openstack-operator-index-2h9ct\" (UID: \"127fb533-a6f7-4dc2-85d9-69ec57116fe9\") " pod="openstack-operators/openstack-operator-index-2h9ct" Mar 16 15:46:36 crc kubenswrapper[5120]: I0316 15:46:36.974807 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wbgsh\" (UniqueName: \"kubernetes.io/projected/127fb533-a6f7-4dc2-85d9-69ec57116fe9-kube-api-access-wbgsh\") pod \"openstack-operator-index-2h9ct\" (UID: \"127fb533-a6f7-4dc2-85d9-69ec57116fe9\") " pod="openstack-operators/openstack-operator-index-2h9ct" Mar 16 15:46:37 crc kubenswrapper[5120]: I0316 15:46:37.003024 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbgsh\" (UniqueName: \"kubernetes.io/projected/127fb533-a6f7-4dc2-85d9-69ec57116fe9-kube-api-access-wbgsh\") pod \"openstack-operator-index-2h9ct\" (UID: \"127fb533-a6f7-4dc2-85d9-69ec57116fe9\") " pod="openstack-operators/openstack-operator-index-2h9ct" Mar 16 15:46:37 crc kubenswrapper[5120]: I0316 15:46:37.014596 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/openstack-operator-index-2h9ct" Mar 16 15:46:37 crc kubenswrapper[5120]: I0316 15:46:37.447181 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-marketplace-tztg5" Mar 16 15:46:39 crc kubenswrapper[5120]: I0316 15:46:39.601004 5120 scope.go:117] "RemoveContainer" containerID="eacaf4109f18c9b4594fb8c46d8eb3d08cad9696a9b6d42165f6c017f7d0a718" Mar 16 15:46:40 crc kubenswrapper[5120]: I0316 15:46:40.812686 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-marketplace-tztg5"] Mar 16 15:46:40 crc kubenswrapper[5120]: I0316 15:46:40.814110 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-marketplace/redhat-marketplace-tztg5" podUID="c367d6e3-c3c1-4a9f-8d5f-11a66d9aaa36" containerName="registry-server" containerID="cri-o://b828de1013dba1fb82f72801e2d56d902eff234163384c1e83fd73967376ed2b" gracePeriod=2 Mar 16 15:46:41 crc kubenswrapper[5120]: I0316 15:46:41.436553 5120 generic.go:358] "Generic (PLEG): container finished" podID="c367d6e3-c3c1-4a9f-8d5f-11a66d9aaa36" containerID="b828de1013dba1fb82f72801e2d56d902eff234163384c1e83fd73967376ed2b" exitCode=0 Mar 16 15:46:41 crc kubenswrapper[5120]: I0316 15:46:41.436647 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-tztg5" event={"ID":"c367d6e3-c3c1-4a9f-8d5f-11a66d9aaa36","Type":"ContainerDied","Data":"b828de1013dba1fb82f72801e2d56d902eff234163384c1e83fd73967376ed2b"} Mar 16 15:46:41 crc kubenswrapper[5120]: I0316 15:46:41.578637 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-v822j_ac55471d-4e42-475f-a082-50f611571482/kube-multus/0.log" Mar 16 15:46:41 crc kubenswrapper[5120]: I0316 15:46:41.581600 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-crc_9f0bc7fcb0822a2c13eb2d22cd8c0641/kube-controller-manager/0.log" Mar 16 15:46:41 crc kubenswrapper[5120]: I0316 15:46:41.582104 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-v822j_ac55471d-4e42-475f-a082-50f611571482/kube-multus/0.log" Mar 16 15:46:41 crc kubenswrapper[5120]: I0316 15:46:41.589434 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-crc_9f0bc7fcb0822a2c13eb2d22cd8c0641/kube-controller-manager/0.log" Mar 16 15:46:41 crc kubenswrapper[5120]: I0316 15:46:41.606549 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-tztg5" Mar 16 15:46:41 crc kubenswrapper[5120]: I0316 15:46:41.651517 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/c367d6e3-c3c1-4a9f-8d5f-11a66d9aaa36-utilities\") pod \"c367d6e3-c3c1-4a9f-8d5f-11a66d9aaa36\" (UID: \"c367d6e3-c3c1-4a9f-8d5f-11a66d9aaa36\") " Mar 16 15:46:41 crc kubenswrapper[5120]: I0316 15:46:41.651834 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2xdhz\" (UniqueName: \"kubernetes.io/projected/c367d6e3-c3c1-4a9f-8d5f-11a66d9aaa36-kube-api-access-2xdhz\") pod \"c367d6e3-c3c1-4a9f-8d5f-11a66d9aaa36\" (UID: \"c367d6e3-c3c1-4a9f-8d5f-11a66d9aaa36\") " Mar 16 15:46:41 crc kubenswrapper[5120]: I0316 15:46:41.651855 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/c367d6e3-c3c1-4a9f-8d5f-11a66d9aaa36-catalog-content\") pod \"c367d6e3-c3c1-4a9f-8d5f-11a66d9aaa36\" (UID: \"c367d6e3-c3c1-4a9f-8d5f-11a66d9aaa36\") " Mar 16 15:46:41 crc kubenswrapper[5120]: I0316 15:46:41.656195 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c367d6e3-c3c1-4a9f-8d5f-11a66d9aaa36-utilities" (OuterVolumeSpecName: "utilities") pod "c367d6e3-c3c1-4a9f-8d5f-11a66d9aaa36" (UID: "c367d6e3-c3c1-4a9f-8d5f-11a66d9aaa36"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:46:41 crc kubenswrapper[5120]: I0316 15:46:41.664904 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c367d6e3-c3c1-4a9f-8d5f-11a66d9aaa36-kube-api-access-2xdhz" (OuterVolumeSpecName: "kube-api-access-2xdhz") pod "c367d6e3-c3c1-4a9f-8d5f-11a66d9aaa36" (UID: "c367d6e3-c3c1-4a9f-8d5f-11a66d9aaa36"). InnerVolumeSpecName "kube-api-access-2xdhz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:46:41 crc kubenswrapper[5120]: I0316 15:46:41.670311 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c367d6e3-c3c1-4a9f-8d5f-11a66d9aaa36-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "c367d6e3-c3c1-4a9f-8d5f-11a66d9aaa36" (UID: "c367d6e3-c3c1-4a9f-8d5f-11a66d9aaa36"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:46:41 crc kubenswrapper[5120]: I0316 15:46:41.753614 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2xdhz\" (UniqueName: \"kubernetes.io/projected/c367d6e3-c3c1-4a9f-8d5f-11a66d9aaa36-kube-api-access-2xdhz\") on node \"crc\" DevicePath \"\"" Mar 16 15:46:41 crc kubenswrapper[5120]: I0316 15:46:41.753655 5120 reconciler_common.go:299] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/c367d6e3-c3c1-4a9f-8d5f-11a66d9aaa36-catalog-content\") on node \"crc\" DevicePath \"\"" Mar 16 15:46:41 crc kubenswrapper[5120]: I0316 15:46:41.753668 5120 reconciler_common.go:299] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/c367d6e3-c3c1-4a9f-8d5f-11a66d9aaa36-utilities\") on node \"crc\" DevicePath \"\"" Mar 16 15:46:41 crc kubenswrapper[5120]: I0316 15:46:41.858633 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/openstack-operator-index-2h9ct"] Mar 16 15:46:42 crc kubenswrapper[5120]: I0316 15:46:42.444781 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/openstack-operator-index-jh545" event={"ID":"97a21562-64ab-44ad-9785-606dc59bba45","Type":"ContainerStarted","Data":"462c7e4abd8c6071903cc7f5c60c128b5abac8603ea74c18f8494a211934d4f6"} Mar 16 15:46:42 crc kubenswrapper[5120]: I0316 15:46:42.444929 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-operators/openstack-operator-index-jh545" podUID="97a21562-64ab-44ad-9785-606dc59bba45" containerName="registry-server" containerID="cri-o://462c7e4abd8c6071903cc7f5c60c128b5abac8603ea74c18f8494a211934d4f6" gracePeriod=2 Mar 16 15:46:42 crc kubenswrapper[5120]: I0316 15:46:42.446792 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-tztg5" event={"ID":"c367d6e3-c3c1-4a9f-8d5f-11a66d9aaa36","Type":"ContainerDied","Data":"597a0662394ddb841e830ad7e1ece960e13bdf4b82e8aaa5afcda8fd1a6de05b"} Mar 16 15:46:42 crc kubenswrapper[5120]: I0316 15:46:42.446829 5120 scope.go:117] "RemoveContainer" containerID="b828de1013dba1fb82f72801e2d56d902eff234163384c1e83fd73967376ed2b" Mar 16 15:46:42 crc kubenswrapper[5120]: I0316 15:46:42.446953 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-tztg5" Mar 16 15:46:42 crc kubenswrapper[5120]: I0316 15:46:42.455745 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/openstack-operator-index-2h9ct" event={"ID":"127fb533-a6f7-4dc2-85d9-69ec57116fe9","Type":"ContainerStarted","Data":"dcba91ad39b6dfd662ae03a856088f8f5420d024f50f3640b70fc37496f3d1cd"} Mar 16 15:46:42 crc kubenswrapper[5120]: I0316 15:46:42.467174 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/openstack-operator-index-jh545" podStartSLOduration=2.200540393 podStartE2EDuration="10.467154039s" podCreationTimestamp="2026-03-16 15:46:32 +0000 UTC" firstStartedPulling="2026-03-16 15:46:33.268165484 +0000 UTC m=+895.422097151" lastFinishedPulling="2026-03-16 15:46:41.53477914 +0000 UTC m=+903.688710797" observedRunningTime="2026-03-16 15:46:42.463953445 +0000 UTC m=+904.617885102" watchObservedRunningTime="2026-03-16 15:46:42.467154039 +0000 UTC m=+904.621085696" Mar 16 15:46:42 crc kubenswrapper[5120]: I0316 15:46:42.478876 5120 scope.go:117] "RemoveContainer" containerID="6b972b4c8653d57cf7c7ecbe75d5086c1d8998a5cfadb96d2e4625411c339bc5" Mar 16 15:46:42 crc kubenswrapper[5120]: I0316 15:46:42.483148 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-marketplace-tztg5"] Mar 16 15:46:42 crc kubenswrapper[5120]: I0316 15:46:42.493054 5120 scope.go:117] "RemoveContainer" containerID="487a9fd9d4f246fb76589e080fdd6881dae948defd75130d65f6347162d38d10" Mar 16 15:46:42 crc kubenswrapper[5120]: I0316 15:46:42.499413 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/redhat-marketplace-tztg5"] Mar 16 15:46:42 crc kubenswrapper[5120]: I0316 15:46:42.670195 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c367d6e3-c3c1-4a9f-8d5f-11a66d9aaa36" path="/var/lib/kubelet/pods/c367d6e3-c3c1-4a9f-8d5f-11a66d9aaa36/volumes" Mar 16 15:46:43 crc kubenswrapper[5120]: I0316 15:46:43.003227 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-operators/openstack-operator-index-jh545" Mar 16 15:46:43 crc kubenswrapper[5120]: I0316 15:46:43.464038 5120 generic.go:358] "Generic (PLEG): container finished" podID="97a21562-64ab-44ad-9785-606dc59bba45" containerID="462c7e4abd8c6071903cc7f5c60c128b5abac8603ea74c18f8494a211934d4f6" exitCode=0 Mar 16 15:46:43 crc kubenswrapper[5120]: I0316 15:46:43.464166 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/openstack-operator-index-jh545" event={"ID":"97a21562-64ab-44ad-9785-606dc59bba45","Type":"ContainerDied","Data":"462c7e4abd8c6071903cc7f5c60c128b5abac8603ea74c18f8494a211934d4f6"} Mar 16 15:46:44 crc kubenswrapper[5120]: I0316 15:46:44.131605 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/openstack-operator-index-jh545" Mar 16 15:46:44 crc kubenswrapper[5120]: I0316 15:46:44.192046 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ggwkc\" (UniqueName: \"kubernetes.io/projected/97a21562-64ab-44ad-9785-606dc59bba45-kube-api-access-ggwkc\") pod \"97a21562-64ab-44ad-9785-606dc59bba45\" (UID: \"97a21562-64ab-44ad-9785-606dc59bba45\") " Mar 16 15:46:44 crc kubenswrapper[5120]: I0316 15:46:44.203965 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97a21562-64ab-44ad-9785-606dc59bba45-kube-api-access-ggwkc" (OuterVolumeSpecName: "kube-api-access-ggwkc") pod "97a21562-64ab-44ad-9785-606dc59bba45" (UID: "97a21562-64ab-44ad-9785-606dc59bba45"). InnerVolumeSpecName "kube-api-access-ggwkc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:46:44 crc kubenswrapper[5120]: I0316 15:46:44.293559 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ggwkc\" (UniqueName: \"kubernetes.io/projected/97a21562-64ab-44ad-9785-606dc59bba45-kube-api-access-ggwkc\") on node \"crc\" DevicePath \"\"" Mar 16 15:46:44 crc kubenswrapper[5120]: I0316 15:46:44.476263 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/openstack-operator-index-2h9ct" event={"ID":"127fb533-a6f7-4dc2-85d9-69ec57116fe9","Type":"ContainerStarted","Data":"354866e7009f17f044d6646ccb1748c884509fad24b122da4aef3b09d4134ba1"} Mar 16 15:46:44 crc kubenswrapper[5120]: I0316 15:46:44.479297 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/openstack-operator-index-jh545" event={"ID":"97a21562-64ab-44ad-9785-606dc59bba45","Type":"ContainerDied","Data":"d5417d95598d4afce3ca9029beff26fb3400694d8f281e4b68efb656fd3b3b77"} Mar 16 15:46:44 crc kubenswrapper[5120]: I0316 15:46:44.479700 5120 scope.go:117] "RemoveContainer" containerID="462c7e4abd8c6071903cc7f5c60c128b5abac8603ea74c18f8494a211934d4f6" Mar 16 15:46:44 crc kubenswrapper[5120]: I0316 15:46:44.479307 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/openstack-operator-index-jh545" Mar 16 15:46:44 crc kubenswrapper[5120]: I0316 15:46:44.511894 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/openstack-operator-index-2h9ct" podStartSLOduration=6.532187856 podStartE2EDuration="8.511862087s" podCreationTimestamp="2026-03-16 15:46:36 +0000 UTC" firstStartedPulling="2026-03-16 15:46:41.861990953 +0000 UTC m=+904.015922600" lastFinishedPulling="2026-03-16 15:46:43.841665134 +0000 UTC m=+905.995596831" observedRunningTime="2026-03-16 15:46:44.501103753 +0000 UTC m=+906.655035500" watchObservedRunningTime="2026-03-16 15:46:44.511862087 +0000 UTC m=+906.665793784" Mar 16 15:46:44 crc kubenswrapper[5120]: I0316 15:46:44.526460 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/openstack-operator-index-jh545"] Mar 16 15:46:44 crc kubenswrapper[5120]: I0316 15:46:44.531941 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-operators/openstack-operator-index-jh545"] Mar 16 15:46:44 crc kubenswrapper[5120]: I0316 15:46:44.671953 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="97a21562-64ab-44ad-9785-606dc59bba45" path="/var/lib/kubelet/pods/97a21562-64ab-44ad-9785-606dc59bba45/volumes" Mar 16 15:46:47 crc kubenswrapper[5120]: I0316 15:46:47.016116 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-operators/openstack-operator-index-2h9ct" Mar 16 15:46:47 crc kubenswrapper[5120]: I0316 15:46:47.016516 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-operators/openstack-operator-index-2h9ct" Mar 16 15:46:47 crc kubenswrapper[5120]: I0316 15:46:47.065952 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-operators/openstack-operator-index-2h9ct" Mar 16 15:46:57 crc kubenswrapper[5120]: I0316 15:46:57.540817 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/openstack-operator-index-2h9ct" Mar 16 15:47:01 crc kubenswrapper[5120]: I0316 15:47:01.458782 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-operators/607560efed3261fb385ad992f9f23627ac0d364289331c8dba808cbffbv5qh8"] Mar 16 15:47:01 crc kubenswrapper[5120]: I0316 15:47:01.460047 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c367d6e3-c3c1-4a9f-8d5f-11a66d9aaa36" containerName="registry-server" Mar 16 15:47:01 crc kubenswrapper[5120]: I0316 15:47:01.460063 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c367d6e3-c3c1-4a9f-8d5f-11a66d9aaa36" containerName="registry-server" Mar 16 15:47:01 crc kubenswrapper[5120]: I0316 15:47:01.460075 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c367d6e3-c3c1-4a9f-8d5f-11a66d9aaa36" containerName="extract-content" Mar 16 15:47:01 crc kubenswrapper[5120]: I0316 15:47:01.460080 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c367d6e3-c3c1-4a9f-8d5f-11a66d9aaa36" containerName="extract-content" Mar 16 15:47:01 crc kubenswrapper[5120]: I0316 15:47:01.460104 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97a21562-64ab-44ad-9785-606dc59bba45" containerName="registry-server" Mar 16 15:47:01 crc kubenswrapper[5120]: I0316 15:47:01.460110 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="97a21562-64ab-44ad-9785-606dc59bba45" containerName="registry-server" Mar 16 15:47:01 crc kubenswrapper[5120]: I0316 15:47:01.460119 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c367d6e3-c3c1-4a9f-8d5f-11a66d9aaa36" containerName="extract-utilities" Mar 16 15:47:01 crc kubenswrapper[5120]: I0316 15:47:01.460124 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c367d6e3-c3c1-4a9f-8d5f-11a66d9aaa36" containerName="extract-utilities" Mar 16 15:47:01 crc kubenswrapper[5120]: I0316 15:47:01.460238 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="97a21562-64ab-44ad-9785-606dc59bba45" containerName="registry-server" Mar 16 15:47:01 crc kubenswrapper[5120]: I0316 15:47:01.460253 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c367d6e3-c3c1-4a9f-8d5f-11a66d9aaa36" containerName="registry-server" Mar 16 15:47:01 crc kubenswrapper[5120]: I0316 15:47:01.470988 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/607560efed3261fb385ad992f9f23627ac0d364289331c8dba808cbffbv5qh8" Mar 16 15:47:01 crc kubenswrapper[5120]: I0316 15:47:01.472718 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/607560efed3261fb385ad992f9f23627ac0d364289331c8dba808cbffbv5qh8"] Mar 16 15:47:01 crc kubenswrapper[5120]: I0316 15:47:01.474173 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-operators\"/\"default-dockercfg-rmzsx\"" Mar 16 15:47:01 crc kubenswrapper[5120]: I0316 15:47:01.553649 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2t7pl\" (UniqueName: \"kubernetes.io/projected/f2af4f6b-db98-46dc-9c06-b98d428f8634-kube-api-access-2t7pl\") pod \"607560efed3261fb385ad992f9f23627ac0d364289331c8dba808cbffbv5qh8\" (UID: \"f2af4f6b-db98-46dc-9c06-b98d428f8634\") " pod="openstack-operators/607560efed3261fb385ad992f9f23627ac0d364289331c8dba808cbffbv5qh8" Mar 16 15:47:01 crc kubenswrapper[5120]: I0316 15:47:01.553696 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f2af4f6b-db98-46dc-9c06-b98d428f8634-bundle\") pod \"607560efed3261fb385ad992f9f23627ac0d364289331c8dba808cbffbv5qh8\" (UID: \"f2af4f6b-db98-46dc-9c06-b98d428f8634\") " pod="openstack-operators/607560efed3261fb385ad992f9f23627ac0d364289331c8dba808cbffbv5qh8" Mar 16 15:47:01 crc kubenswrapper[5120]: I0316 15:47:01.553733 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f2af4f6b-db98-46dc-9c06-b98d428f8634-util\") pod \"607560efed3261fb385ad992f9f23627ac0d364289331c8dba808cbffbv5qh8\" (UID: \"f2af4f6b-db98-46dc-9c06-b98d428f8634\") " pod="openstack-operators/607560efed3261fb385ad992f9f23627ac0d364289331c8dba808cbffbv5qh8" Mar 16 15:47:01 crc kubenswrapper[5120]: I0316 15:47:01.655845 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f2af4f6b-db98-46dc-9c06-b98d428f8634-util\") pod \"607560efed3261fb385ad992f9f23627ac0d364289331c8dba808cbffbv5qh8\" (UID: \"f2af4f6b-db98-46dc-9c06-b98d428f8634\") " pod="openstack-operators/607560efed3261fb385ad992f9f23627ac0d364289331c8dba808cbffbv5qh8" Mar 16 15:47:01 crc kubenswrapper[5120]: I0316 15:47:01.656001 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2t7pl\" (UniqueName: \"kubernetes.io/projected/f2af4f6b-db98-46dc-9c06-b98d428f8634-kube-api-access-2t7pl\") pod \"607560efed3261fb385ad992f9f23627ac0d364289331c8dba808cbffbv5qh8\" (UID: \"f2af4f6b-db98-46dc-9c06-b98d428f8634\") " pod="openstack-operators/607560efed3261fb385ad992f9f23627ac0d364289331c8dba808cbffbv5qh8" Mar 16 15:47:01 crc kubenswrapper[5120]: I0316 15:47:01.656053 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f2af4f6b-db98-46dc-9c06-b98d428f8634-bundle\") pod \"607560efed3261fb385ad992f9f23627ac0d364289331c8dba808cbffbv5qh8\" (UID: \"f2af4f6b-db98-46dc-9c06-b98d428f8634\") " pod="openstack-operators/607560efed3261fb385ad992f9f23627ac0d364289331c8dba808cbffbv5qh8" Mar 16 15:47:01 crc kubenswrapper[5120]: I0316 15:47:01.656650 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f2af4f6b-db98-46dc-9c06-b98d428f8634-util\") pod \"607560efed3261fb385ad992f9f23627ac0d364289331c8dba808cbffbv5qh8\" (UID: \"f2af4f6b-db98-46dc-9c06-b98d428f8634\") " pod="openstack-operators/607560efed3261fb385ad992f9f23627ac0d364289331c8dba808cbffbv5qh8" Mar 16 15:47:01 crc kubenswrapper[5120]: I0316 15:47:01.656656 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f2af4f6b-db98-46dc-9c06-b98d428f8634-bundle\") pod \"607560efed3261fb385ad992f9f23627ac0d364289331c8dba808cbffbv5qh8\" (UID: \"f2af4f6b-db98-46dc-9c06-b98d428f8634\") " pod="openstack-operators/607560efed3261fb385ad992f9f23627ac0d364289331c8dba808cbffbv5qh8" Mar 16 15:47:01 crc kubenswrapper[5120]: I0316 15:47:01.681937 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2t7pl\" (UniqueName: \"kubernetes.io/projected/f2af4f6b-db98-46dc-9c06-b98d428f8634-kube-api-access-2t7pl\") pod \"607560efed3261fb385ad992f9f23627ac0d364289331c8dba808cbffbv5qh8\" (UID: \"f2af4f6b-db98-46dc-9c06-b98d428f8634\") " pod="openstack-operators/607560efed3261fb385ad992f9f23627ac0d364289331c8dba808cbffbv5qh8" Mar 16 15:47:01 crc kubenswrapper[5120]: I0316 15:47:01.821732 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/607560efed3261fb385ad992f9f23627ac0d364289331c8dba808cbffbv5qh8" Mar 16 15:47:02 crc kubenswrapper[5120]: I0316 15:47:02.265310 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/607560efed3261fb385ad992f9f23627ac0d364289331c8dba808cbffbv5qh8"] Mar 16 15:47:02 crc kubenswrapper[5120]: I0316 15:47:02.613862 5120 generic.go:358] "Generic (PLEG): container finished" podID="f2af4f6b-db98-46dc-9c06-b98d428f8634" containerID="e4b54519a942b0acd62bf145b92412e8a4c692cf34fe45afb09efb514f012f3e" exitCode=0 Mar 16 15:47:02 crc kubenswrapper[5120]: I0316 15:47:02.613944 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/607560efed3261fb385ad992f9f23627ac0d364289331c8dba808cbffbv5qh8" event={"ID":"f2af4f6b-db98-46dc-9c06-b98d428f8634","Type":"ContainerDied","Data":"e4b54519a942b0acd62bf145b92412e8a4c692cf34fe45afb09efb514f012f3e"} Mar 16 15:47:02 crc kubenswrapper[5120]: I0316 15:47:02.614321 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/607560efed3261fb385ad992f9f23627ac0d364289331c8dba808cbffbv5qh8" event={"ID":"f2af4f6b-db98-46dc-9c06-b98d428f8634","Type":"ContainerStarted","Data":"3deed8ec1fc1e593a0c932ea76836a10659c3c6a45dfd299e9863cabb43d9254"} Mar 16 15:47:03 crc kubenswrapper[5120]: I0316 15:47:03.624308 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/607560efed3261fb385ad992f9f23627ac0d364289331c8dba808cbffbv5qh8" event={"ID":"f2af4f6b-db98-46dc-9c06-b98d428f8634","Type":"ContainerStarted","Data":"aad637e4276cefe545d7e8f3c34770be29be04929f56649a5820a9eb16f8d0ce"} Mar 16 15:47:05 crc kubenswrapper[5120]: I0316 15:47:05.485460 5120 generic.go:358] "Generic (PLEG): container finished" podID="f2af4f6b-db98-46dc-9c06-b98d428f8634" containerID="aad637e4276cefe545d7e8f3c34770be29be04929f56649a5820a9eb16f8d0ce" exitCode=0 Mar 16 15:47:05 crc kubenswrapper[5120]: I0316 15:47:05.485534 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/607560efed3261fb385ad992f9f23627ac0d364289331c8dba808cbffbv5qh8" event={"ID":"f2af4f6b-db98-46dc-9c06-b98d428f8634","Type":"ContainerDied","Data":"aad637e4276cefe545d7e8f3c34770be29be04929f56649a5820a9eb16f8d0ce"} Mar 16 15:47:06 crc kubenswrapper[5120]: I0316 15:47:06.495095 5120 generic.go:358] "Generic (PLEG): container finished" podID="f2af4f6b-db98-46dc-9c06-b98d428f8634" containerID="4f9d40eab8b3939295ef3c4ed0e738b3259920fdbf943eaefe6566dbe5b8bbc6" exitCode=0 Mar 16 15:47:06 crc kubenswrapper[5120]: I0316 15:47:06.495205 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/607560efed3261fb385ad992f9f23627ac0d364289331c8dba808cbffbv5qh8" event={"ID":"f2af4f6b-db98-46dc-9c06-b98d428f8634","Type":"ContainerDied","Data":"4f9d40eab8b3939295ef3c4ed0e738b3259920fdbf943eaefe6566dbe5b8bbc6"} Mar 16 15:47:07 crc kubenswrapper[5120]: E0316 15:47:07.588926 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=780793 actualBytes=10240 Mar 16 15:47:07 crc kubenswrapper[5120]: I0316 15:47:07.798324 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/607560efed3261fb385ad992f9f23627ac0d364289331c8dba808cbffbv5qh8" Mar 16 15:47:07 crc kubenswrapper[5120]: I0316 15:47:07.897412 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f2af4f6b-db98-46dc-9c06-b98d428f8634-bundle\") pod \"f2af4f6b-db98-46dc-9c06-b98d428f8634\" (UID: \"f2af4f6b-db98-46dc-9c06-b98d428f8634\") " Mar 16 15:47:07 crc kubenswrapper[5120]: I0316 15:47:07.897516 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f2af4f6b-db98-46dc-9c06-b98d428f8634-util\") pod \"f2af4f6b-db98-46dc-9c06-b98d428f8634\" (UID: \"f2af4f6b-db98-46dc-9c06-b98d428f8634\") " Mar 16 15:47:07 crc kubenswrapper[5120]: I0316 15:47:07.897578 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2t7pl\" (UniqueName: \"kubernetes.io/projected/f2af4f6b-db98-46dc-9c06-b98d428f8634-kube-api-access-2t7pl\") pod \"f2af4f6b-db98-46dc-9c06-b98d428f8634\" (UID: \"f2af4f6b-db98-46dc-9c06-b98d428f8634\") " Mar 16 15:47:07 crc kubenswrapper[5120]: I0316 15:47:07.899293 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2af4f6b-db98-46dc-9c06-b98d428f8634-bundle" (OuterVolumeSpecName: "bundle") pod "f2af4f6b-db98-46dc-9c06-b98d428f8634" (UID: "f2af4f6b-db98-46dc-9c06-b98d428f8634"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:47:07 crc kubenswrapper[5120]: I0316 15:47:07.905443 5120 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f2af4f6b-db98-46dc-9c06-b98d428f8634-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:47:07 crc kubenswrapper[5120]: I0316 15:47:07.907068 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2af4f6b-db98-46dc-9c06-b98d428f8634-util" (OuterVolumeSpecName: "util") pod "f2af4f6b-db98-46dc-9c06-b98d428f8634" (UID: "f2af4f6b-db98-46dc-9c06-b98d428f8634"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:47:07 crc kubenswrapper[5120]: I0316 15:47:07.907910 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2af4f6b-db98-46dc-9c06-b98d428f8634-kube-api-access-2t7pl" (OuterVolumeSpecName: "kube-api-access-2t7pl") pod "f2af4f6b-db98-46dc-9c06-b98d428f8634" (UID: "f2af4f6b-db98-46dc-9c06-b98d428f8634"). InnerVolumeSpecName "kube-api-access-2t7pl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:47:08 crc kubenswrapper[5120]: I0316 15:47:08.006386 5120 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f2af4f6b-db98-46dc-9c06-b98d428f8634-util\") on node \"crc\" DevicePath \"\"" Mar 16 15:47:08 crc kubenswrapper[5120]: I0316 15:47:08.006419 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2t7pl\" (UniqueName: \"kubernetes.io/projected/f2af4f6b-db98-46dc-9c06-b98d428f8634-kube-api-access-2t7pl\") on node \"crc\" DevicePath \"\"" Mar 16 15:47:08 crc kubenswrapper[5120]: I0316 15:47:08.514661 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/607560efed3261fb385ad992f9f23627ac0d364289331c8dba808cbffbv5qh8" event={"ID":"f2af4f6b-db98-46dc-9c06-b98d428f8634","Type":"ContainerDied","Data":"3deed8ec1fc1e593a0c932ea76836a10659c3c6a45dfd299e9863cabb43d9254"} Mar 16 15:47:08 crc kubenswrapper[5120]: I0316 15:47:08.514712 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3deed8ec1fc1e593a0c932ea76836a10659c3c6a45dfd299e9863cabb43d9254" Mar 16 15:47:08 crc kubenswrapper[5120]: I0316 15:47:08.514735 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/607560efed3261fb385ad992f9f23627ac0d364289331c8dba808cbffbv5qh8" Mar 16 15:47:13 crc kubenswrapper[5120]: I0316 15:47:13.403620 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-operators/openstack-operator-controller-init-7b76cc8c59-hmnw9"] Mar 16 15:47:13 crc kubenswrapper[5120]: I0316 15:47:13.406348 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2af4f6b-db98-46dc-9c06-b98d428f8634" containerName="util" Mar 16 15:47:13 crc kubenswrapper[5120]: I0316 15:47:13.406375 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2af4f6b-db98-46dc-9c06-b98d428f8634" containerName="util" Mar 16 15:47:13 crc kubenswrapper[5120]: I0316 15:47:13.406394 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2af4f6b-db98-46dc-9c06-b98d428f8634" containerName="extract" Mar 16 15:47:13 crc kubenswrapper[5120]: I0316 15:47:13.406402 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2af4f6b-db98-46dc-9c06-b98d428f8634" containerName="extract" Mar 16 15:47:13 crc kubenswrapper[5120]: I0316 15:47:13.406432 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2af4f6b-db98-46dc-9c06-b98d428f8634" containerName="pull" Mar 16 15:47:13 crc kubenswrapper[5120]: I0316 15:47:13.406441 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2af4f6b-db98-46dc-9c06-b98d428f8634" containerName="pull" Mar 16 15:47:13 crc kubenswrapper[5120]: I0316 15:47:13.406565 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f2af4f6b-db98-46dc-9c06-b98d428f8634" containerName="extract" Mar 16 15:47:13 crc kubenswrapper[5120]: I0316 15:47:13.432464 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/openstack-operator-controller-init-7b76cc8c59-hmnw9"] Mar 16 15:47:13 crc kubenswrapper[5120]: I0316 15:47:13.432638 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/openstack-operator-controller-init-7b76cc8c59-hmnw9" Mar 16 15:47:13 crc kubenswrapper[5120]: I0316 15:47:13.436415 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-operators\"/\"openstack-operator-controller-init-dockercfg-b86qs\"" Mar 16 15:47:13 crc kubenswrapper[5120]: I0316 15:47:13.505496 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ns6ts\" (UniqueName: \"kubernetes.io/projected/78743df2-449e-44ab-91f1-ac48af33b657-kube-api-access-ns6ts\") pod \"openstack-operator-controller-init-7b76cc8c59-hmnw9\" (UID: \"78743df2-449e-44ab-91f1-ac48af33b657\") " pod="openstack-operators/openstack-operator-controller-init-7b76cc8c59-hmnw9" Mar 16 15:47:13 crc kubenswrapper[5120]: I0316 15:47:13.606871 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ns6ts\" (UniqueName: \"kubernetes.io/projected/78743df2-449e-44ab-91f1-ac48af33b657-kube-api-access-ns6ts\") pod \"openstack-operator-controller-init-7b76cc8c59-hmnw9\" (UID: \"78743df2-449e-44ab-91f1-ac48af33b657\") " pod="openstack-operators/openstack-operator-controller-init-7b76cc8c59-hmnw9" Mar 16 15:47:13 crc kubenswrapper[5120]: I0316 15:47:13.641182 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ns6ts\" (UniqueName: \"kubernetes.io/projected/78743df2-449e-44ab-91f1-ac48af33b657-kube-api-access-ns6ts\") pod \"openstack-operator-controller-init-7b76cc8c59-hmnw9\" (UID: \"78743df2-449e-44ab-91f1-ac48af33b657\") " pod="openstack-operators/openstack-operator-controller-init-7b76cc8c59-hmnw9" Mar 16 15:47:13 crc kubenswrapper[5120]: I0316 15:47:13.752056 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/openstack-operator-controller-init-7b76cc8c59-hmnw9" Mar 16 15:47:14 crc kubenswrapper[5120]: I0316 15:47:14.166784 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/openstack-operator-controller-init-7b76cc8c59-hmnw9"] Mar 16 15:47:14 crc kubenswrapper[5120]: I0316 15:47:14.559536 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/openstack-operator-controller-init-7b76cc8c59-hmnw9" event={"ID":"78743df2-449e-44ab-91f1-ac48af33b657","Type":"ContainerStarted","Data":"9edbd09f095ddf07c1f52982d24af7fc6c53f533aa861533061cb4e92ad5ee14"} Mar 16 15:47:19 crc kubenswrapper[5120]: I0316 15:47:19.602253 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/openstack-operator-controller-init-7b76cc8c59-hmnw9" event={"ID":"78743df2-449e-44ab-91f1-ac48af33b657","Type":"ContainerStarted","Data":"e2579a5f5422a476f71f7cbdd4956f87e25a1665768e12a05d68434c8a974b9f"} Mar 16 15:47:19 crc kubenswrapper[5120]: I0316 15:47:19.602719 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-operators/openstack-operator-controller-init-7b76cc8c59-hmnw9" Mar 16 15:47:19 crc kubenswrapper[5120]: I0316 15:47:19.640557 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/openstack-operator-controller-init-7b76cc8c59-hmnw9" podStartSLOduration=1.589840196 podStartE2EDuration="6.640540822s" podCreationTimestamp="2026-03-16 15:47:13 +0000 UTC" firstStartedPulling="2026-03-16 15:47:14.172652079 +0000 UTC m=+936.326583736" lastFinishedPulling="2026-03-16 15:47:19.223352705 +0000 UTC m=+941.377284362" observedRunningTime="2026-03-16 15:47:19.634811081 +0000 UTC m=+941.788742738" watchObservedRunningTime="2026-03-16 15:47:19.640540822 +0000 UTC m=+941.794472479" Mar 16 15:47:22 crc kubenswrapper[5120]: I0316 15:47:22.008477 5120 patch_prober.go:28] interesting pod/machine-config-daemon-7bf76 container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 15:47:22 crc kubenswrapper[5120]: I0316 15:47:22.008864 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 15:47:30 crc kubenswrapper[5120]: I0316 15:47:30.612172 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/openstack-operator-controller-init-7b76cc8c59-hmnw9" Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.264560 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-operators/barbican-operator-controller-manager-848cfb5779-68smv"] Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.295210 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-operators/cinder-operator-controller-manager-55bc8cdcc4-sbtk9"] Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.295456 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/barbican-operator-controller-manager-848cfb5779-68smv" Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.297380 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-operators\"/\"barbican-operator-controller-manager-dockercfg-6gc6s\"" Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.299302 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-operators/designate-operator-controller-manager-7cf89c67bb-cjd7x"] Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.299512 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/cinder-operator-controller-manager-55bc8cdcc4-sbtk9" Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.303955 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/barbican-operator-controller-manager-848cfb5779-68smv"] Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.304045 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/designate-operator-controller-manager-7cf89c67bb-cjd7x"] Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.304117 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/cinder-operator-controller-manager-55bc8cdcc4-sbtk9"] Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.304587 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/designate-operator-controller-manager-7cf89c67bb-cjd7x" Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.313337 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-operators\"/\"cinder-operator-controller-manager-dockercfg-gqdkn\"" Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.314142 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-operators\"/\"designate-operator-controller-manager-dockercfg-vqctq\"" Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.339200 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-operators/heat-operator-controller-manager-79975d4c95-n2zm7"] Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.343625 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/heat-operator-controller-manager-79975d4c95-n2zm7" Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.346167 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-operators\"/\"heat-operator-controller-manager-dockercfg-fsxrn\"" Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.346184 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-operators/glance-operator-controller-manager-58d9bbd8cc-vhvn5"] Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.353238 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/heat-operator-controller-manager-79975d4c95-n2zm7"] Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.353377 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/glance-operator-controller-manager-58d9bbd8cc-vhvn5" Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.374223 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-operators\"/\"glance-operator-controller-manager-dockercfg-lmkrn\"" Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.386941 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/glance-operator-controller-manager-58d9bbd8cc-vhvn5"] Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.401790 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vhrs\" (UniqueName: \"kubernetes.io/projected/ed2165fd-95f2-40f7-a860-70b81d6ab977-kube-api-access-7vhrs\") pod \"cinder-operator-controller-manager-55bc8cdcc4-sbtk9\" (UID: \"ed2165fd-95f2-40f7-a860-70b81d6ab977\") " pod="openstack-operators/cinder-operator-controller-manager-55bc8cdcc4-sbtk9" Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.401952 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-operators/horizon-operator-controller-manager-5bf9fb4564-qzsbr"] Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.416660 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/horizon-operator-controller-manager-5bf9fb4564-qzsbr" Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.423520 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-operators\"/\"horizon-operator-controller-manager-dockercfg-7jlk5\"" Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.433284 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/horizon-operator-controller-manager-5bf9fb4564-qzsbr"] Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.440487 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-operators/infra-operator-controller-manager-76f8b7ddbd-nvwr5"] Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.448341 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/infra-operator-controller-manager-76f8b7ddbd-nvwr5" Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.455088 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-operators\"/\"infra-operator-controller-manager-dockercfg-j8swp\"" Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.455320 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-operators\"/\"infra-operator-webhook-server-cert\"" Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.475252 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/infra-operator-controller-manager-76f8b7ddbd-nvwr5"] Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.493718 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-operators/ironic-operator-controller-manager-997698bf9-6zvjn"] Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.503627 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/ironic-operator-controller-manager-997698bf9-6zvjn" Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.505424 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfbdn\" (UniqueName: \"kubernetes.io/projected/f62d5d6a-d638-4968-902f-8eb726c039c1-kube-api-access-lfbdn\") pod \"barbican-operator-controller-manager-848cfb5779-68smv\" (UID: \"f62d5d6a-d638-4968-902f-8eb726c039c1\") " pod="openstack-operators/barbican-operator-controller-manager-848cfb5779-68smv" Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.505538 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7vhrs\" (UniqueName: \"kubernetes.io/projected/ed2165fd-95f2-40f7-a860-70b81d6ab977-kube-api-access-7vhrs\") pod \"cinder-operator-controller-manager-55bc8cdcc4-sbtk9\" (UID: \"ed2165fd-95f2-40f7-a860-70b81d6ab977\") " pod="openstack-operators/cinder-operator-controller-manager-55bc8cdcc4-sbtk9" Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.505590 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56pwc\" (UniqueName: \"kubernetes.io/projected/e918c50c-96eb-4da3-9b1d-fc31e3582816-kube-api-access-56pwc\") pod \"glance-operator-controller-manager-58d9bbd8cc-vhvn5\" (UID: \"e918c50c-96eb-4da3-9b1d-fc31e3582816\") " pod="openstack-operators/glance-operator-controller-manager-58d9bbd8cc-vhvn5" Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.505615 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5n68\" (UniqueName: \"kubernetes.io/projected/2fc99f04-8366-4f00-9ce1-d0e4faf1d0a3-kube-api-access-r5n68\") pod \"designate-operator-controller-manager-7cf89c67bb-cjd7x\" (UID: \"2fc99f04-8366-4f00-9ce1-d0e4faf1d0a3\") " pod="openstack-operators/designate-operator-controller-manager-7cf89c67bb-cjd7x" Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.505685 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgwqr\" (UniqueName: \"kubernetes.io/projected/42478fad-5a61-4cc1-94cc-ac00bdf30f24-kube-api-access-fgwqr\") pod \"ironic-operator-controller-manager-997698bf9-6zvjn\" (UID: \"42478fad-5a61-4cc1-94cc-ac00bdf30f24\") " pod="openstack-operators/ironic-operator-controller-manager-997698bf9-6zvjn" Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.505716 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdhx5\" (UniqueName: \"kubernetes.io/projected/4752ce4e-0b7c-43d7-99dc-b8633f7a2cd7-kube-api-access-cdhx5\") pod \"heat-operator-controller-manager-79975d4c95-n2zm7\" (UID: \"4752ce4e-0b7c-43d7-99dc-b8633f7a2cd7\") " pod="openstack-operators/heat-operator-controller-manager-79975d4c95-n2zm7" Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.506162 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-operators/keystone-operator-controller-manager-6f5b9fd59-rhjb2"] Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.507174 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-operators\"/\"ironic-operator-controller-manager-dockercfg-pfpwq\"" Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.512070 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/keystone-operator-controller-manager-6f5b9fd59-rhjb2" Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.513584 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/ironic-operator-controller-manager-997698bf9-6zvjn"] Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.515196 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-operators\"/\"keystone-operator-controller-manager-dockercfg-8fdr7\"" Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.532240 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/keystone-operator-controller-manager-6f5b9fd59-rhjb2"] Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.536590 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vhrs\" (UniqueName: \"kubernetes.io/projected/ed2165fd-95f2-40f7-a860-70b81d6ab977-kube-api-access-7vhrs\") pod \"cinder-operator-controller-manager-55bc8cdcc4-sbtk9\" (UID: \"ed2165fd-95f2-40f7-a860-70b81d6ab977\") " pod="openstack-operators/cinder-operator-controller-manager-55bc8cdcc4-sbtk9" Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.549524 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-operators/manila-operator-controller-manager-7d6d87b867-xkrnl"] Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.563448 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/manila-operator-controller-manager-7d6d87b867-xkrnl" Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.564590 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/manila-operator-controller-manager-7d6d87b867-xkrnl"] Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.570506 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-operators/mariadb-operator-controller-manager-5748db694b-nk2nc"] Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.570639 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-operators\"/\"manila-operator-controller-manager-dockercfg-9vjqq\"" Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.578873 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-operators/neutron-operator-controller-manager-75c6f4bc76-mbnvj"] Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.579735 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/mariadb-operator-controller-manager-5748db694b-nk2nc" Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.583544 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-operators\"/\"mariadb-operator-controller-manager-dockercfg-fqczl\"" Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.583558 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/neutron-operator-controller-manager-75c6f4bc76-mbnvj" Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.585278 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/mariadb-operator-controller-manager-5748db694b-nk2nc"] Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.586152 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-operators\"/\"neutron-operator-controller-manager-dockercfg-2kctm\"" Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.590224 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/neutron-operator-controller-manager-75c6f4bc76-mbnvj"] Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.594361 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-operators/nova-operator-controller-manager-785d77464d-j7x9r"] Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.601193 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-operators/octavia-operator-controller-manager-7b89675745-5vg74"] Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.602335 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/nova-operator-controller-manager-785d77464d-j7x9r" Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.606599 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/nova-operator-controller-manager-785d77464d-j7x9r"] Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.606937 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/octavia-operator-controller-manager-7b89675745-5vg74" Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.607373 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lfbdn\" (UniqueName: \"kubernetes.io/projected/f62d5d6a-d638-4968-902f-8eb726c039c1-kube-api-access-lfbdn\") pod \"barbican-operator-controller-manager-848cfb5779-68smv\" (UID: \"f62d5d6a-d638-4968-902f-8eb726c039c1\") " pod="openstack-operators/barbican-operator-controller-manager-848cfb5779-68smv" Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.608310 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8km49\" (UniqueName: \"kubernetes.io/projected/e6b6caa5-b1c3-4ad6-8b0e-0358400bb03b-kube-api-access-8km49\") pod \"horizon-operator-controller-manager-5bf9fb4564-qzsbr\" (UID: \"e6b6caa5-b1c3-4ad6-8b0e-0358400bb03b\") " pod="openstack-operators/horizon-operator-controller-manager-5bf9fb4564-qzsbr" Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.608454 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-56pwc\" (UniqueName: \"kubernetes.io/projected/e918c50c-96eb-4da3-9b1d-fc31e3582816-kube-api-access-56pwc\") pod \"glance-operator-controller-manager-58d9bbd8cc-vhvn5\" (UID: \"e918c50c-96eb-4da3-9b1d-fc31e3582816\") " pod="openstack-operators/glance-operator-controller-manager-58d9bbd8cc-vhvn5" Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.608535 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r5n68\" (UniqueName: \"kubernetes.io/projected/2fc99f04-8366-4f00-9ce1-d0e4faf1d0a3-kube-api-access-r5n68\") pod \"designate-operator-controller-manager-7cf89c67bb-cjd7x\" (UID: \"2fc99f04-8366-4f00-9ce1-d0e4faf1d0a3\") " pod="openstack-operators/designate-operator-controller-manager-7cf89c67bb-cjd7x" Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.608641 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fgwqr\" (UniqueName: \"kubernetes.io/projected/42478fad-5a61-4cc1-94cc-ac00bdf30f24-kube-api-access-fgwqr\") pod \"ironic-operator-controller-manager-997698bf9-6zvjn\" (UID: \"42478fad-5a61-4cc1-94cc-ac00bdf30f24\") " pod="openstack-operators/ironic-operator-controller-manager-997698bf9-6zvjn" Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.608717 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cdhx5\" (UniqueName: \"kubernetes.io/projected/4752ce4e-0b7c-43d7-99dc-b8633f7a2cd7-kube-api-access-cdhx5\") pod \"heat-operator-controller-manager-79975d4c95-n2zm7\" (UID: \"4752ce4e-0b7c-43d7-99dc-b8633f7a2cd7\") " pod="openstack-operators/heat-operator-controller-manager-79975d4c95-n2zm7" Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.608825 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/797f2c96-18c7-400b-a46d-795da852b08e-cert\") pod \"infra-operator-controller-manager-76f8b7ddbd-nvwr5\" (UID: \"797f2c96-18c7-400b-a46d-795da852b08e\") " pod="openstack-operators/infra-operator-controller-manager-76f8b7ddbd-nvwr5" Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.608911 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4pfq8\" (UniqueName: \"kubernetes.io/projected/797f2c96-18c7-400b-a46d-795da852b08e-kube-api-access-4pfq8\") pod \"infra-operator-controller-manager-76f8b7ddbd-nvwr5\" (UID: \"797f2c96-18c7-400b-a46d-795da852b08e\") " pod="openstack-operators/infra-operator-controller-manager-76f8b7ddbd-nvwr5" Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.609189 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/octavia-operator-controller-manager-7b89675745-5vg74"] Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.612419 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-operators\"/\"nova-operator-controller-manager-dockercfg-vhj2q\"" Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.612923 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-operators\"/\"octavia-operator-controller-manager-dockercfg-8ls9r\"" Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.613049 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-operators/openstack-baremetal-operator-controller-manager-6b6ddbc599g848w"] Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.620277 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/openstack-baremetal-operator-controller-manager-6b6ddbc599g848w" Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.624830 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-operators\"/\"openstack-baremetal-operator-controller-manager-dockercfg-rsbxb\"" Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.625349 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-operators\"/\"openstack-baremetal-operator-webhook-server-cert\"" Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.628385 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/cinder-operator-controller-manager-55bc8cdcc4-sbtk9" Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.629496 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/openstack-baremetal-operator-controller-manager-6b6ddbc599g848w"] Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.633682 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-56pwc\" (UniqueName: \"kubernetes.io/projected/e918c50c-96eb-4da3-9b1d-fc31e3582816-kube-api-access-56pwc\") pod \"glance-operator-controller-manager-58d9bbd8cc-vhvn5\" (UID: \"e918c50c-96eb-4da3-9b1d-fc31e3582816\") " pod="openstack-operators/glance-operator-controller-manager-58d9bbd8cc-vhvn5" Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.635803 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgwqr\" (UniqueName: \"kubernetes.io/projected/42478fad-5a61-4cc1-94cc-ac00bdf30f24-kube-api-access-fgwqr\") pod \"ironic-operator-controller-manager-997698bf9-6zvjn\" (UID: \"42478fad-5a61-4cc1-94cc-ac00bdf30f24\") " pod="openstack-operators/ironic-operator-controller-manager-997698bf9-6zvjn" Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.635870 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-operators/ovn-operator-controller-manager-6fb6cd45c4-ln28h"] Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.640295 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5n68\" (UniqueName: \"kubernetes.io/projected/2fc99f04-8366-4f00-9ce1-d0e4faf1d0a3-kube-api-access-r5n68\") pod \"designate-operator-controller-manager-7cf89c67bb-cjd7x\" (UID: \"2fc99f04-8366-4f00-9ce1-d0e4faf1d0a3\") " pod="openstack-operators/designate-operator-controller-manager-7cf89c67bb-cjd7x" Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.643565 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/ovn-operator-controller-manager-6fb6cd45c4-ln28h" Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.645990 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-operators\"/\"ovn-operator-controller-manager-dockercfg-v6nl5\"" Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.658808 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/ovn-operator-controller-manager-6fb6cd45c4-ln28h"] Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.666859 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdhx5\" (UniqueName: \"kubernetes.io/projected/4752ce4e-0b7c-43d7-99dc-b8633f7a2cd7-kube-api-access-cdhx5\") pod \"heat-operator-controller-manager-79975d4c95-n2zm7\" (UID: \"4752ce4e-0b7c-43d7-99dc-b8633f7a2cd7\") " pod="openstack-operators/heat-operator-controller-manager-79975d4c95-n2zm7" Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.669768 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-operators/placement-operator-controller-manager-57fdd4b4cf-v5f9b"] Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.676955 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/heat-operator-controller-manager-79975d4c95-n2zm7" Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.678289 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-operators/swift-operator-controller-manager-5d89b4d5d5-9zvm4"] Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.678499 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/placement-operator-controller-manager-57fdd4b4cf-v5f9b" Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.682668 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfbdn\" (UniqueName: \"kubernetes.io/projected/f62d5d6a-d638-4968-902f-8eb726c039c1-kube-api-access-lfbdn\") pod \"barbican-operator-controller-manager-848cfb5779-68smv\" (UID: \"f62d5d6a-d638-4968-902f-8eb726c039c1\") " pod="openstack-operators/barbican-operator-controller-manager-848cfb5779-68smv" Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.703768 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-operators\"/\"placement-operator-controller-manager-dockercfg-lznpf\"" Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.707035 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/swift-operator-controller-manager-5d89b4d5d5-9zvm4"] Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.707247 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/swift-operator-controller-manager-5d89b4d5d5-9zvm4" Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.709002 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-operators\"/\"swift-operator-controller-manager-dockercfg-dm688\"" Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.710210 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mg8fr\" (UniqueName: \"kubernetes.io/projected/32fa740c-28b3-42a7-8ab5-6d159c237bf8-kube-api-access-mg8fr\") pod \"neutron-operator-controller-manager-75c6f4bc76-mbnvj\" (UID: \"32fa740c-28b3-42a7-8ab5-6d159c237bf8\") " pod="openstack-operators/neutron-operator-controller-manager-75c6f4bc76-mbnvj" Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.710689 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8643ed10-e4fd-4b97-ae36-c4b581cdef1b-cert\") pod \"openstack-baremetal-operator-controller-manager-6b6ddbc599g848w\" (UID: \"8643ed10-e4fd-4b97-ae36-c4b581cdef1b\") " pod="openstack-operators/openstack-baremetal-operator-controller-manager-6b6ddbc599g848w" Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.710745 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rn2d\" (UniqueName: \"kubernetes.io/projected/66faede0-c074-49ca-8bf9-9b5777b02edf-kube-api-access-4rn2d\") pod \"nova-operator-controller-manager-785d77464d-j7x9r\" (UID: \"66faede0-c074-49ca-8bf9-9b5777b02edf\") " pod="openstack-operators/nova-operator-controller-manager-785d77464d-j7x9r" Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.710819 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smqps\" (UniqueName: \"kubernetes.io/projected/bbc9f690-e60b-4c8a-b84a-2d8a3ca2001f-kube-api-access-smqps\") pod \"octavia-operator-controller-manager-7b89675745-5vg74\" (UID: \"bbc9f690-e60b-4c8a-b84a-2d8a3ca2001f\") " pod="openstack-operators/octavia-operator-controller-manager-7b89675745-5vg74" Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.710856 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/797f2c96-18c7-400b-a46d-795da852b08e-cert\") pod \"infra-operator-controller-manager-76f8b7ddbd-nvwr5\" (UID: \"797f2c96-18c7-400b-a46d-795da852b08e\") " pod="openstack-operators/infra-operator-controller-manager-76f8b7ddbd-nvwr5" Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.710906 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4pfq8\" (UniqueName: \"kubernetes.io/projected/797f2c96-18c7-400b-a46d-795da852b08e-kube-api-access-4pfq8\") pod \"infra-operator-controller-manager-76f8b7ddbd-nvwr5\" (UID: \"797f2c96-18c7-400b-a46d-795da852b08e\") " pod="openstack-operators/infra-operator-controller-manager-76f8b7ddbd-nvwr5" Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.710959 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xv4m6\" (UniqueName: \"kubernetes.io/projected/eed7b084-3ca6-41c0-847f-19929fb52c41-kube-api-access-xv4m6\") pod \"manila-operator-controller-manager-7d6d87b867-xkrnl\" (UID: \"eed7b084-3ca6-41c0-847f-19929fb52c41\") " pod="openstack-operators/manila-operator-controller-manager-7d6d87b867-xkrnl" Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.710984 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtdv8\" (UniqueName: \"kubernetes.io/projected/8a11dd5a-29d6-4791-849c-97b08acb5b4e-kube-api-access-dtdv8\") pod \"mariadb-operator-controller-manager-5748db694b-nk2nc\" (UID: \"8a11dd5a-29d6-4791-849c-97b08acb5b4e\") " pod="openstack-operators/mariadb-operator-controller-manager-5748db694b-nk2nc" Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.711027 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jck5\" (UniqueName: \"kubernetes.io/projected/e46d1032-1fff-4f99-baa0-487aee0eb1bd-kube-api-access-8jck5\") pod \"swift-operator-controller-manager-5d89b4d5d5-9zvm4\" (UID: \"e46d1032-1fff-4f99-baa0-487aee0eb1bd\") " pod="openstack-operators/swift-operator-controller-manager-5d89b4d5d5-9zvm4" Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.711076 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cs5gv\" (UniqueName: \"kubernetes.io/projected/f5403564-ecbf-4103-89b6-530a8381c664-kube-api-access-cs5gv\") pod \"keystone-operator-controller-manager-6f5b9fd59-rhjb2\" (UID: \"f5403564-ecbf-4103-89b6-530a8381c664\") " pod="openstack-operators/keystone-operator-controller-manager-6f5b9fd59-rhjb2" Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.711220 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8km49\" (UniqueName: \"kubernetes.io/projected/e6b6caa5-b1c3-4ad6-8b0e-0358400bb03b-kube-api-access-8km49\") pod \"horizon-operator-controller-manager-5bf9fb4564-qzsbr\" (UID: \"e6b6caa5-b1c3-4ad6-8b0e-0358400bb03b\") " pod="openstack-operators/horizon-operator-controller-manager-5bf9fb4564-qzsbr" Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.711296 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99snw\" (UniqueName: \"kubernetes.io/projected/8643ed10-e4fd-4b97-ae36-c4b581cdef1b-kube-api-access-99snw\") pod \"openstack-baremetal-operator-controller-manager-6b6ddbc599g848w\" (UID: \"8643ed10-e4fd-4b97-ae36-c4b581cdef1b\") " pod="openstack-operators/openstack-baremetal-operator-controller-manager-6b6ddbc599g848w" Mar 16 15:47:47 crc kubenswrapper[5120]: E0316 15:47:47.712353 5120 secret.go:189] Couldn't get secret openstack-operators/infra-operator-webhook-server-cert: secret "infra-operator-webhook-server-cert" not found Mar 16 15:47:47 crc kubenswrapper[5120]: E0316 15:47:47.712463 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/797f2c96-18c7-400b-a46d-795da852b08e-cert podName:797f2c96-18c7-400b-a46d-795da852b08e nodeName:}" failed. No retries permitted until 2026-03-16 15:47:48.212409827 +0000 UTC m=+970.366341484 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/797f2c96-18c7-400b-a46d-795da852b08e-cert") pod "infra-operator-controller-manager-76f8b7ddbd-nvwr5" (UID: "797f2c96-18c7-400b-a46d-795da852b08e") : secret "infra-operator-webhook-server-cert" not found Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.720641 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/placement-operator-controller-manager-57fdd4b4cf-v5f9b"] Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.729517 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4pfq8\" (UniqueName: \"kubernetes.io/projected/797f2c96-18c7-400b-a46d-795da852b08e-kube-api-access-4pfq8\") pod \"infra-operator-controller-manager-76f8b7ddbd-nvwr5\" (UID: \"797f2c96-18c7-400b-a46d-795da852b08e\") " pod="openstack-operators/infra-operator-controller-manager-76f8b7ddbd-nvwr5" Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.732323 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8km49\" (UniqueName: \"kubernetes.io/projected/e6b6caa5-b1c3-4ad6-8b0e-0358400bb03b-kube-api-access-8km49\") pod \"horizon-operator-controller-manager-5bf9fb4564-qzsbr\" (UID: \"e6b6caa5-b1c3-4ad6-8b0e-0358400bb03b\") " pod="openstack-operators/horizon-operator-controller-manager-5bf9fb4564-qzsbr" Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.734066 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/glance-operator-controller-manager-58d9bbd8cc-vhvn5" Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.735842 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-operators/telemetry-operator-controller-manager-f5cf7fcb7-cmrwq"] Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.748340 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/telemetry-operator-controller-manager-f5cf7fcb7-cmrwq"] Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.748519 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/telemetry-operator-controller-manager-f5cf7fcb7-cmrwq" Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.752570 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-operators\"/\"telemetry-operator-controller-manager-dockercfg-w88sr\"" Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.759568 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/horizon-operator-controller-manager-5bf9fb4564-qzsbr" Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.792431 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-operators/test-operator-controller-manager-74d567479f-cbkr4"] Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.814334 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-99snw\" (UniqueName: \"kubernetes.io/projected/8643ed10-e4fd-4b97-ae36-c4b581cdef1b-kube-api-access-99snw\") pod \"openstack-baremetal-operator-controller-manager-6b6ddbc599g848w\" (UID: \"8643ed10-e4fd-4b97-ae36-c4b581cdef1b\") " pod="openstack-operators/openstack-baremetal-operator-controller-manager-6b6ddbc599g848w" Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.814366 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mg8fr\" (UniqueName: \"kubernetes.io/projected/32fa740c-28b3-42a7-8ab5-6d159c237bf8-kube-api-access-mg8fr\") pod \"neutron-operator-controller-manager-75c6f4bc76-mbnvj\" (UID: \"32fa740c-28b3-42a7-8ab5-6d159c237bf8\") " pod="openstack-operators/neutron-operator-controller-manager-75c6f4bc76-mbnvj" Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.814384 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8643ed10-e4fd-4b97-ae36-c4b581cdef1b-cert\") pod \"openstack-baremetal-operator-controller-manager-6b6ddbc599g848w\" (UID: \"8643ed10-e4fd-4b97-ae36-c4b581cdef1b\") " pod="openstack-operators/openstack-baremetal-operator-controller-manager-6b6ddbc599g848w" Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.814400 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4rn2d\" (UniqueName: \"kubernetes.io/projected/66faede0-c074-49ca-8bf9-9b5777b02edf-kube-api-access-4rn2d\") pod \"nova-operator-controller-manager-785d77464d-j7x9r\" (UID: \"66faede0-c074-49ca-8bf9-9b5777b02edf\") " pod="openstack-operators/nova-operator-controller-manager-785d77464d-j7x9r" Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.814424 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-smqps\" (UniqueName: \"kubernetes.io/projected/bbc9f690-e60b-4c8a-b84a-2d8a3ca2001f-kube-api-access-smqps\") pod \"octavia-operator-controller-manager-7b89675745-5vg74\" (UID: \"bbc9f690-e60b-4c8a-b84a-2d8a3ca2001f\") " pod="openstack-operators/octavia-operator-controller-manager-7b89675745-5vg74" Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.814458 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zscs\" (UniqueName: \"kubernetes.io/projected/201aeec6-1404-4b8d-8cf7-4d2550cc9898-kube-api-access-8zscs\") pod \"telemetry-operator-controller-manager-f5cf7fcb7-cmrwq\" (UID: \"201aeec6-1404-4b8d-8cf7-4d2550cc9898\") " pod="openstack-operators/telemetry-operator-controller-manager-f5cf7fcb7-cmrwq" Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.814478 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66hqt\" (UniqueName: \"kubernetes.io/projected/8e6d8ae5-f5be-4b12-8401-54dcc86da579-kube-api-access-66hqt\") pod \"ovn-operator-controller-manager-6fb6cd45c4-ln28h\" (UID: \"8e6d8ae5-f5be-4b12-8401-54dcc86da579\") " pod="openstack-operators/ovn-operator-controller-manager-6fb6cd45c4-ln28h" Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.814506 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xv4m6\" (UniqueName: \"kubernetes.io/projected/eed7b084-3ca6-41c0-847f-19929fb52c41-kube-api-access-xv4m6\") pod \"manila-operator-controller-manager-7d6d87b867-xkrnl\" (UID: \"eed7b084-3ca6-41c0-847f-19929fb52c41\") " pod="openstack-operators/manila-operator-controller-manager-7d6d87b867-xkrnl" Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.814522 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dtdv8\" (UniqueName: \"kubernetes.io/projected/8a11dd5a-29d6-4791-849c-97b08acb5b4e-kube-api-access-dtdv8\") pod \"mariadb-operator-controller-manager-5748db694b-nk2nc\" (UID: \"8a11dd5a-29d6-4791-849c-97b08acb5b4e\") " pod="openstack-operators/mariadb-operator-controller-manager-5748db694b-nk2nc" Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.814557 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8jck5\" (UniqueName: \"kubernetes.io/projected/e46d1032-1fff-4f99-baa0-487aee0eb1bd-kube-api-access-8jck5\") pod \"swift-operator-controller-manager-5d89b4d5d5-9zvm4\" (UID: \"e46d1032-1fff-4f99-baa0-487aee0eb1bd\") " pod="openstack-operators/swift-operator-controller-manager-5d89b4d5d5-9zvm4" Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.814579 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cs5gv\" (UniqueName: \"kubernetes.io/projected/f5403564-ecbf-4103-89b6-530a8381c664-kube-api-access-cs5gv\") pod \"keystone-operator-controller-manager-6f5b9fd59-rhjb2\" (UID: \"f5403564-ecbf-4103-89b6-530a8381c664\") " pod="openstack-operators/keystone-operator-controller-manager-6f5b9fd59-rhjb2" Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.814605 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lt64k\" (UniqueName: \"kubernetes.io/projected/3b105271-39d9-4339-a315-3aa161a54b31-kube-api-access-lt64k\") pod \"placement-operator-controller-manager-57fdd4b4cf-v5f9b\" (UID: \"3b105271-39d9-4339-a315-3aa161a54b31\") " pod="openstack-operators/placement-operator-controller-manager-57fdd4b4cf-v5f9b" Mar 16 15:47:47 crc kubenswrapper[5120]: E0316 15:47:47.814898 5120 secret.go:189] Couldn't get secret openstack-operators/openstack-baremetal-operator-webhook-server-cert: secret "openstack-baremetal-operator-webhook-server-cert" not found Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.825229 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/ironic-operator-controller-manager-997698bf9-6zvjn" Mar 16 15:47:47 crc kubenswrapper[5120]: E0316 15:47:47.830041 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8643ed10-e4fd-4b97-ae36-c4b581cdef1b-cert podName:8643ed10-e4fd-4b97-ae36-c4b581cdef1b nodeName:}" failed. No retries permitted until 2026-03-16 15:47:48.33000648 +0000 UTC m=+970.483938127 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8643ed10-e4fd-4b97-ae36-c4b581cdef1b-cert") pod "openstack-baremetal-operator-controller-manager-6b6ddbc599g848w" (UID: "8643ed10-e4fd-4b97-ae36-c4b581cdef1b") : secret "openstack-baremetal-operator-webhook-server-cert" not found Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.832879 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/test-operator-controller-manager-74d567479f-cbkr4"] Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.833019 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/test-operator-controller-manager-74d567479f-cbkr4" Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.838396 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-operators\"/\"test-operator-controller-manager-dockercfg-tjldg\"" Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.840036 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cs5gv\" (UniqueName: \"kubernetes.io/projected/f5403564-ecbf-4103-89b6-530a8381c664-kube-api-access-cs5gv\") pod \"keystone-operator-controller-manager-6f5b9fd59-rhjb2\" (UID: \"f5403564-ecbf-4103-89b6-530a8381c664\") " pod="openstack-operators/keystone-operator-controller-manager-6f5b9fd59-rhjb2" Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.846059 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-99snw\" (UniqueName: \"kubernetes.io/projected/8643ed10-e4fd-4b97-ae36-c4b581cdef1b-kube-api-access-99snw\") pod \"openstack-baremetal-operator-controller-manager-6b6ddbc599g848w\" (UID: \"8643ed10-e4fd-4b97-ae36-c4b581cdef1b\") " pod="openstack-operators/openstack-baremetal-operator-controller-manager-6b6ddbc599g848w" Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.855284 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mg8fr\" (UniqueName: \"kubernetes.io/projected/32fa740c-28b3-42a7-8ab5-6d159c237bf8-kube-api-access-mg8fr\") pod \"neutron-operator-controller-manager-75c6f4bc76-mbnvj\" (UID: \"32fa740c-28b3-42a7-8ab5-6d159c237bf8\") " pod="openstack-operators/neutron-operator-controller-manager-75c6f4bc76-mbnvj" Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.857888 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xv4m6\" (UniqueName: \"kubernetes.io/projected/eed7b084-3ca6-41c0-847f-19929fb52c41-kube-api-access-xv4m6\") pod \"manila-operator-controller-manager-7d6d87b867-xkrnl\" (UID: \"eed7b084-3ca6-41c0-847f-19929fb52c41\") " pod="openstack-operators/manila-operator-controller-manager-7d6d87b867-xkrnl" Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.858042 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-operators/watcher-operator-controller-manager-65d578856c-7khnv"] Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.859212 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-smqps\" (UniqueName: \"kubernetes.io/projected/bbc9f690-e60b-4c8a-b84a-2d8a3ca2001f-kube-api-access-smqps\") pod \"octavia-operator-controller-manager-7b89675745-5vg74\" (UID: \"bbc9f690-e60b-4c8a-b84a-2d8a3ca2001f\") " pod="openstack-operators/octavia-operator-controller-manager-7b89675745-5vg74" Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.865182 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/watcher-operator-controller-manager-65d578856c-7khnv" Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.865638 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rn2d\" (UniqueName: \"kubernetes.io/projected/66faede0-c074-49ca-8bf9-9b5777b02edf-kube-api-access-4rn2d\") pod \"nova-operator-controller-manager-785d77464d-j7x9r\" (UID: \"66faede0-c074-49ca-8bf9-9b5777b02edf\") " pod="openstack-operators/nova-operator-controller-manager-785d77464d-j7x9r" Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.866671 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtdv8\" (UniqueName: \"kubernetes.io/projected/8a11dd5a-29d6-4791-849c-97b08acb5b4e-kube-api-access-dtdv8\") pod \"mariadb-operator-controller-manager-5748db694b-nk2nc\" (UID: \"8a11dd5a-29d6-4791-849c-97b08acb5b4e\") " pod="openstack-operators/mariadb-operator-controller-manager-5748db694b-nk2nc" Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.867478 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-operators\"/\"watcher-operator-controller-manager-dockercfg-znd7t\"" Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.868572 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jck5\" (UniqueName: \"kubernetes.io/projected/e46d1032-1fff-4f99-baa0-487aee0eb1bd-kube-api-access-8jck5\") pod \"swift-operator-controller-manager-5d89b4d5d5-9zvm4\" (UID: \"e46d1032-1fff-4f99-baa0-487aee0eb1bd\") " pod="openstack-operators/swift-operator-controller-manager-5d89b4d5d5-9zvm4" Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.883009 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/watcher-operator-controller-manager-65d578856c-7khnv"] Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.888736 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/manila-operator-controller-manager-7d6d87b867-xkrnl" Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.905030 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/mariadb-operator-controller-manager-5748db694b-nk2nc" Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.915388 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/barbican-operator-controller-manager-848cfb5779-68smv" Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.915551 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lt64k\" (UniqueName: \"kubernetes.io/projected/3b105271-39d9-4339-a315-3aa161a54b31-kube-api-access-lt64k\") pod \"placement-operator-controller-manager-57fdd4b4cf-v5f9b\" (UID: \"3b105271-39d9-4339-a315-3aa161a54b31\") " pod="openstack-operators/placement-operator-controller-manager-57fdd4b4cf-v5f9b" Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.915601 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8688\" (UniqueName: \"kubernetes.io/projected/ef52f45c-ba73-4607-8b03-f13fce9806bd-kube-api-access-m8688\") pod \"test-operator-controller-manager-74d567479f-cbkr4\" (UID: \"ef52f45c-ba73-4607-8b03-f13fce9806bd\") " pod="openstack-operators/test-operator-controller-manager-74d567479f-cbkr4" Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.915657 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjp8x\" (UniqueName: \"kubernetes.io/projected/4af61d68-498f-4c1a-812d-91089029f784-kube-api-access-kjp8x\") pod \"watcher-operator-controller-manager-65d578856c-7khnv\" (UID: \"4af61d68-498f-4c1a-812d-91089029f784\") " pod="openstack-operators/watcher-operator-controller-manager-65d578856c-7khnv" Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.915725 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8zscs\" (UniqueName: \"kubernetes.io/projected/201aeec6-1404-4b8d-8cf7-4d2550cc9898-kube-api-access-8zscs\") pod \"telemetry-operator-controller-manager-f5cf7fcb7-cmrwq\" (UID: \"201aeec6-1404-4b8d-8cf7-4d2550cc9898\") " pod="openstack-operators/telemetry-operator-controller-manager-f5cf7fcb7-cmrwq" Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.915748 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-66hqt\" (UniqueName: \"kubernetes.io/projected/8e6d8ae5-f5be-4b12-8401-54dcc86da579-kube-api-access-66hqt\") pod \"ovn-operator-controller-manager-6fb6cd45c4-ln28h\" (UID: \"8e6d8ae5-f5be-4b12-8401-54dcc86da579\") " pod="openstack-operators/ovn-operator-controller-manager-6fb6cd45c4-ln28h" Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.921740 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/neutron-operator-controller-manager-75c6f4bc76-mbnvj" Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.930646 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/nova-operator-controller-manager-785d77464d-j7x9r" Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.934538 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-66hqt\" (UniqueName: \"kubernetes.io/projected/8e6d8ae5-f5be-4b12-8401-54dcc86da579-kube-api-access-66hqt\") pod \"ovn-operator-controller-manager-6fb6cd45c4-ln28h\" (UID: \"8e6d8ae5-f5be-4b12-8401-54dcc86da579\") " pod="openstack-operators/ovn-operator-controller-manager-6fb6cd45c4-ln28h" Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.935673 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zscs\" (UniqueName: \"kubernetes.io/projected/201aeec6-1404-4b8d-8cf7-4d2550cc9898-kube-api-access-8zscs\") pod \"telemetry-operator-controller-manager-f5cf7fcb7-cmrwq\" (UID: \"201aeec6-1404-4b8d-8cf7-4d2550cc9898\") " pod="openstack-operators/telemetry-operator-controller-manager-f5cf7fcb7-cmrwq" Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.940375 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/designate-operator-controller-manager-7cf89c67bb-cjd7x" Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.943127 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lt64k\" (UniqueName: \"kubernetes.io/projected/3b105271-39d9-4339-a315-3aa161a54b31-kube-api-access-lt64k\") pod \"placement-operator-controller-manager-57fdd4b4cf-v5f9b\" (UID: \"3b105271-39d9-4339-a315-3aa161a54b31\") " pod="openstack-operators/placement-operator-controller-manager-57fdd4b4cf-v5f9b" Mar 16 15:47:47 crc kubenswrapper[5120]: I0316 15:47:47.986938 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-operators/openstack-operator-controller-manager-5fbcdbcf94-6sdhq"] Mar 16 15:47:48 crc kubenswrapper[5120]: I0316 15:47:48.003875 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/openstack-operator-controller-manager-5fbcdbcf94-6sdhq"] Mar 16 15:47:48 crc kubenswrapper[5120]: I0316 15:47:48.003999 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/openstack-operator-controller-manager-5fbcdbcf94-6sdhq" Mar 16 15:47:48 crc kubenswrapper[5120]: I0316 15:47:48.007993 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-operators\"/\"webhook-server-cert\"" Mar 16 15:47:48 crc kubenswrapper[5120]: I0316 15:47:48.008021 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-operators\"/\"metrics-server-cert\"" Mar 16 15:47:48 crc kubenswrapper[5120]: I0316 15:47:48.008844 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-operators\"/\"openstack-operator-controller-manager-dockercfg-gvl2d\"" Mar 16 15:47:48 crc kubenswrapper[5120]: I0316 15:47:48.019040 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kjp8x\" (UniqueName: \"kubernetes.io/projected/4af61d68-498f-4c1a-812d-91089029f784-kube-api-access-kjp8x\") pod \"watcher-operator-controller-manager-65d578856c-7khnv\" (UID: \"4af61d68-498f-4c1a-812d-91089029f784\") " pod="openstack-operators/watcher-operator-controller-manager-65d578856c-7khnv" Mar 16 15:47:48 crc kubenswrapper[5120]: I0316 15:47:48.019198 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m8688\" (UniqueName: \"kubernetes.io/projected/ef52f45c-ba73-4607-8b03-f13fce9806bd-kube-api-access-m8688\") pod \"test-operator-controller-manager-74d567479f-cbkr4\" (UID: \"ef52f45c-ba73-4607-8b03-f13fce9806bd\") " pod="openstack-operators/test-operator-controller-manager-74d567479f-cbkr4" Mar 16 15:47:48 crc kubenswrapper[5120]: I0316 15:47:48.043449 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/octavia-operator-controller-manager-7b89675745-5vg74" Mar 16 15:47:48 crc kubenswrapper[5120]: I0316 15:47:48.056622 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8688\" (UniqueName: \"kubernetes.io/projected/ef52f45c-ba73-4607-8b03-f13fce9806bd-kube-api-access-m8688\") pod \"test-operator-controller-manager-74d567479f-cbkr4\" (UID: \"ef52f45c-ba73-4607-8b03-f13fce9806bd\") " pod="openstack-operators/test-operator-controller-manager-74d567479f-cbkr4" Mar 16 15:47:48 crc kubenswrapper[5120]: I0316 15:47:48.059662 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjp8x\" (UniqueName: \"kubernetes.io/projected/4af61d68-498f-4c1a-812d-91089029f784-kube-api-access-kjp8x\") pod \"watcher-operator-controller-manager-65d578856c-7khnv\" (UID: \"4af61d68-498f-4c1a-812d-91089029f784\") " pod="openstack-operators/watcher-operator-controller-manager-65d578856c-7khnv" Mar 16 15:47:48 crc kubenswrapper[5120]: I0316 15:47:48.071262 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/ovn-operator-controller-manager-6fb6cd45c4-ln28h" Mar 16 15:47:48 crc kubenswrapper[5120]: I0316 15:47:48.076356 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-operators/rabbitmq-cluster-operator-manager-85d9b55b6-tfl54"] Mar 16 15:47:48 crc kubenswrapper[5120]: I0316 15:47:48.086880 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/placement-operator-controller-manager-57fdd4b4cf-v5f9b" Mar 16 15:47:48 crc kubenswrapper[5120]: I0316 15:47:48.093565 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/rabbitmq-cluster-operator-manager-85d9b55b6-tfl54"] Mar 16 15:47:48 crc kubenswrapper[5120]: I0316 15:47:48.093695 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/rabbitmq-cluster-operator-manager-85d9b55b6-tfl54" Mar 16 15:47:48 crc kubenswrapper[5120]: I0316 15:47:48.095869 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-operators\"/\"rabbitmq-cluster-operator-controller-manager-dockercfg-lnjgt\"" Mar 16 15:47:48 crc kubenswrapper[5120]: I0316 15:47:48.117961 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/swift-operator-controller-manager-5d89b4d5d5-9zvm4" Mar 16 15:47:48 crc kubenswrapper[5120]: I0316 15:47:48.119882 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4b4v\" (UniqueName: \"kubernetes.io/projected/91595c8f-09e8-4cdd-8054-1f46eafa27ad-kube-api-access-s4b4v\") pod \"openstack-operator-controller-manager-5fbcdbcf94-6sdhq\" (UID: \"91595c8f-09e8-4cdd-8054-1f46eafa27ad\") " pod="openstack-operators/openstack-operator-controller-manager-5fbcdbcf94-6sdhq" Mar 16 15:47:48 crc kubenswrapper[5120]: I0316 15:47:48.119987 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/91595c8f-09e8-4cdd-8054-1f46eafa27ad-metrics-certs\") pod \"openstack-operator-controller-manager-5fbcdbcf94-6sdhq\" (UID: \"91595c8f-09e8-4cdd-8054-1f46eafa27ad\") " pod="openstack-operators/openstack-operator-controller-manager-5fbcdbcf94-6sdhq" Mar 16 15:47:48 crc kubenswrapper[5120]: I0316 15:47:48.120008 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-certs\" (UniqueName: \"kubernetes.io/secret/91595c8f-09e8-4cdd-8054-1f46eafa27ad-webhook-certs\") pod \"openstack-operator-controller-manager-5fbcdbcf94-6sdhq\" (UID: \"91595c8f-09e8-4cdd-8054-1f46eafa27ad\") " pod="openstack-operators/openstack-operator-controller-manager-5fbcdbcf94-6sdhq" Mar 16 15:47:48 crc kubenswrapper[5120]: I0316 15:47:48.138111 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/keystone-operator-controller-manager-6f5b9fd59-rhjb2" Mar 16 15:47:48 crc kubenswrapper[5120]: I0316 15:47:48.170968 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/telemetry-operator-controller-manager-f5cf7fcb7-cmrwq" Mar 16 15:47:48 crc kubenswrapper[5120]: I0316 15:47:48.223040 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7w8n\" (UniqueName: \"kubernetes.io/projected/d2d3e713-eefd-44fd-8784-1f4f54155d8f-kube-api-access-n7w8n\") pod \"rabbitmq-cluster-operator-manager-85d9b55b6-tfl54\" (UID: \"d2d3e713-eefd-44fd-8784-1f4f54155d8f\") " pod="openstack-operators/rabbitmq-cluster-operator-manager-85d9b55b6-tfl54" Mar 16 15:47:48 crc kubenswrapper[5120]: I0316 15:47:48.223100 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s4b4v\" (UniqueName: \"kubernetes.io/projected/91595c8f-09e8-4cdd-8054-1f46eafa27ad-kube-api-access-s4b4v\") pod \"openstack-operator-controller-manager-5fbcdbcf94-6sdhq\" (UID: \"91595c8f-09e8-4cdd-8054-1f46eafa27ad\") " pod="openstack-operators/openstack-operator-controller-manager-5fbcdbcf94-6sdhq" Mar 16 15:47:48 crc kubenswrapper[5120]: I0316 15:47:48.223129 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/797f2c96-18c7-400b-a46d-795da852b08e-cert\") pod \"infra-operator-controller-manager-76f8b7ddbd-nvwr5\" (UID: \"797f2c96-18c7-400b-a46d-795da852b08e\") " pod="openstack-operators/infra-operator-controller-manager-76f8b7ddbd-nvwr5" Mar 16 15:47:48 crc kubenswrapper[5120]: I0316 15:47:48.223181 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/91595c8f-09e8-4cdd-8054-1f46eafa27ad-metrics-certs\") pod \"openstack-operator-controller-manager-5fbcdbcf94-6sdhq\" (UID: \"91595c8f-09e8-4cdd-8054-1f46eafa27ad\") " pod="openstack-operators/openstack-operator-controller-manager-5fbcdbcf94-6sdhq" Mar 16 15:47:48 crc kubenswrapper[5120]: I0316 15:47:48.223199 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-certs\" (UniqueName: \"kubernetes.io/secret/91595c8f-09e8-4cdd-8054-1f46eafa27ad-webhook-certs\") pod \"openstack-operator-controller-manager-5fbcdbcf94-6sdhq\" (UID: \"91595c8f-09e8-4cdd-8054-1f46eafa27ad\") " pod="openstack-operators/openstack-operator-controller-manager-5fbcdbcf94-6sdhq" Mar 16 15:47:48 crc kubenswrapper[5120]: E0316 15:47:48.223314 5120 secret.go:189] Couldn't get secret openstack-operators/webhook-server-cert: secret "webhook-server-cert" not found Mar 16 15:47:48 crc kubenswrapper[5120]: E0316 15:47:48.223363 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91595c8f-09e8-4cdd-8054-1f46eafa27ad-webhook-certs podName:91595c8f-09e8-4cdd-8054-1f46eafa27ad nodeName:}" failed. No retries permitted until 2026-03-16 15:47:48.723349498 +0000 UTC m=+970.877281155 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-certs" (UniqueName: "kubernetes.io/secret/91595c8f-09e8-4cdd-8054-1f46eafa27ad-webhook-certs") pod "openstack-operator-controller-manager-5fbcdbcf94-6sdhq" (UID: "91595c8f-09e8-4cdd-8054-1f46eafa27ad") : secret "webhook-server-cert" not found Mar 16 15:47:48 crc kubenswrapper[5120]: E0316 15:47:48.223741 5120 secret.go:189] Couldn't get secret openstack-operators/infra-operator-webhook-server-cert: secret "infra-operator-webhook-server-cert" not found Mar 16 15:47:48 crc kubenswrapper[5120]: E0316 15:47:48.223785 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/797f2c96-18c7-400b-a46d-795da852b08e-cert podName:797f2c96-18c7-400b-a46d-795da852b08e nodeName:}" failed. No retries permitted until 2026-03-16 15:47:49.22377767 +0000 UTC m=+971.377709327 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/797f2c96-18c7-400b-a46d-795da852b08e-cert") pod "infra-operator-controller-manager-76f8b7ddbd-nvwr5" (UID: "797f2c96-18c7-400b-a46d-795da852b08e") : secret "infra-operator-webhook-server-cert" not found Mar 16 15:47:48 crc kubenswrapper[5120]: E0316 15:47:48.223819 5120 secret.go:189] Couldn't get secret openstack-operators/metrics-server-cert: secret "metrics-server-cert" not found Mar 16 15:47:48 crc kubenswrapper[5120]: E0316 15:47:48.223837 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91595c8f-09e8-4cdd-8054-1f46eafa27ad-metrics-certs podName:91595c8f-09e8-4cdd-8054-1f46eafa27ad nodeName:}" failed. No retries permitted until 2026-03-16 15:47:48.723831102 +0000 UTC m=+970.877762759 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/91595c8f-09e8-4cdd-8054-1f46eafa27ad-metrics-certs") pod "openstack-operator-controller-manager-5fbcdbcf94-6sdhq" (UID: "91595c8f-09e8-4cdd-8054-1f46eafa27ad") : secret "metrics-server-cert" not found Mar 16 15:47:48 crc kubenswrapper[5120]: I0316 15:47:48.248978 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/test-operator-controller-manager-74d567479f-cbkr4" Mar 16 15:47:48 crc kubenswrapper[5120]: I0316 15:47:48.250254 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4b4v\" (UniqueName: \"kubernetes.io/projected/91595c8f-09e8-4cdd-8054-1f46eafa27ad-kube-api-access-s4b4v\") pod \"openstack-operator-controller-manager-5fbcdbcf94-6sdhq\" (UID: \"91595c8f-09e8-4cdd-8054-1f46eafa27ad\") " pod="openstack-operators/openstack-operator-controller-manager-5fbcdbcf94-6sdhq" Mar 16 15:47:48 crc kubenswrapper[5120]: I0316 15:47:48.277425 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/watcher-operator-controller-manager-65d578856c-7khnv" Mar 16 15:47:48 crc kubenswrapper[5120]: I0316 15:47:48.308669 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/cinder-operator-controller-manager-55bc8cdcc4-sbtk9"] Mar 16 15:47:48 crc kubenswrapper[5120]: I0316 15:47:48.325178 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n7w8n\" (UniqueName: \"kubernetes.io/projected/d2d3e713-eefd-44fd-8784-1f4f54155d8f-kube-api-access-n7w8n\") pod \"rabbitmq-cluster-operator-manager-85d9b55b6-tfl54\" (UID: \"d2d3e713-eefd-44fd-8784-1f4f54155d8f\") " pod="openstack-operators/rabbitmq-cluster-operator-manager-85d9b55b6-tfl54" Mar 16 15:47:48 crc kubenswrapper[5120]: I0316 15:47:48.358626 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7w8n\" (UniqueName: \"kubernetes.io/projected/d2d3e713-eefd-44fd-8784-1f4f54155d8f-kube-api-access-n7w8n\") pod \"rabbitmq-cluster-operator-manager-85d9b55b6-tfl54\" (UID: \"d2d3e713-eefd-44fd-8784-1f4f54155d8f\") " pod="openstack-operators/rabbitmq-cluster-operator-manager-85d9b55b6-tfl54" Mar 16 15:47:48 crc kubenswrapper[5120]: I0316 15:47:48.367235 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/heat-operator-controller-manager-79975d4c95-n2zm7"] Mar 16 15:47:48 crc kubenswrapper[5120]: I0316 15:47:48.419498 5120 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Mar 16 15:47:48 crc kubenswrapper[5120]: I0316 15:47:48.427479 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8643ed10-e4fd-4b97-ae36-c4b581cdef1b-cert\") pod \"openstack-baremetal-operator-controller-manager-6b6ddbc599g848w\" (UID: \"8643ed10-e4fd-4b97-ae36-c4b581cdef1b\") " pod="openstack-operators/openstack-baremetal-operator-controller-manager-6b6ddbc599g848w" Mar 16 15:47:48 crc kubenswrapper[5120]: E0316 15:47:48.427707 5120 secret.go:189] Couldn't get secret openstack-operators/openstack-baremetal-operator-webhook-server-cert: secret "openstack-baremetal-operator-webhook-server-cert" not found Mar 16 15:47:48 crc kubenswrapper[5120]: E0316 15:47:48.427832 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8643ed10-e4fd-4b97-ae36-c4b581cdef1b-cert podName:8643ed10-e4fd-4b97-ae36-c4b581cdef1b nodeName:}" failed. No retries permitted until 2026-03-16 15:47:49.427801452 +0000 UTC m=+971.581733109 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8643ed10-e4fd-4b97-ae36-c4b581cdef1b-cert") pod "openstack-baremetal-operator-controller-manager-6b6ddbc599g848w" (UID: "8643ed10-e4fd-4b97-ae36-c4b581cdef1b") : secret "openstack-baremetal-operator-webhook-server-cert" not found Mar 16 15:47:48 crc kubenswrapper[5120]: I0316 15:47:48.450845 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/rabbitmq-cluster-operator-manager-85d9b55b6-tfl54" Mar 16 15:47:48 crc kubenswrapper[5120]: I0316 15:47:48.482842 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/glance-operator-controller-manager-58d9bbd8cc-vhvn5"] Mar 16 15:47:48 crc kubenswrapper[5120]: W0316 15:47:48.695372 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6b6caa5_b1c3_4ad6_8b0e_0358400bb03b.slice/crio-681045361cf2bd7776417547f46c5f5295f10747e02d69d32618c7cea73269e9 WatchSource:0}: Error finding container 681045361cf2bd7776417547f46c5f5295f10747e02d69d32618c7cea73269e9: Status 404 returned error can't find the container with id 681045361cf2bd7776417547f46c5f5295f10747e02d69d32618c7cea73269e9 Mar 16 15:47:48 crc kubenswrapper[5120]: I0316 15:47:48.698163 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/horizon-operator-controller-manager-5bf9fb4564-qzsbr"] Mar 16 15:47:48 crc kubenswrapper[5120]: I0316 15:47:48.704587 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/ironic-operator-controller-manager-997698bf9-6zvjn"] Mar 16 15:47:48 crc kubenswrapper[5120]: W0316 15:47:48.705063 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42478fad_5a61_4cc1_94cc_ac00bdf30f24.slice/crio-545c25b4bd71069314f7c505f3b97b07e5fb19339460a2edd1f8c97143cc0e39 WatchSource:0}: Error finding container 545c25b4bd71069314f7c505f3b97b07e5fb19339460a2edd1f8c97143cc0e39: Status 404 returned error can't find the container with id 545c25b4bd71069314f7c505f3b97b07e5fb19339460a2edd1f8c97143cc0e39 Mar 16 15:47:48 crc kubenswrapper[5120]: I0316 15:47:48.732661 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/91595c8f-09e8-4cdd-8054-1f46eafa27ad-metrics-certs\") pod \"openstack-operator-controller-manager-5fbcdbcf94-6sdhq\" (UID: \"91595c8f-09e8-4cdd-8054-1f46eafa27ad\") " pod="openstack-operators/openstack-operator-controller-manager-5fbcdbcf94-6sdhq" Mar 16 15:47:48 crc kubenswrapper[5120]: I0316 15:47:48.732701 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-certs\" (UniqueName: \"kubernetes.io/secret/91595c8f-09e8-4cdd-8054-1f46eafa27ad-webhook-certs\") pod \"openstack-operator-controller-manager-5fbcdbcf94-6sdhq\" (UID: \"91595c8f-09e8-4cdd-8054-1f46eafa27ad\") " pod="openstack-operators/openstack-operator-controller-manager-5fbcdbcf94-6sdhq" Mar 16 15:47:48 crc kubenswrapper[5120]: E0316 15:47:48.732854 5120 secret.go:189] Couldn't get secret openstack-operators/webhook-server-cert: secret "webhook-server-cert" not found Mar 16 15:47:48 crc kubenswrapper[5120]: E0316 15:47:48.732870 5120 secret.go:189] Couldn't get secret openstack-operators/metrics-server-cert: secret "metrics-server-cert" not found Mar 16 15:47:48 crc kubenswrapper[5120]: E0316 15:47:48.732909 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91595c8f-09e8-4cdd-8054-1f46eafa27ad-webhook-certs podName:91595c8f-09e8-4cdd-8054-1f46eafa27ad nodeName:}" failed. No retries permitted until 2026-03-16 15:47:49.732893082 +0000 UTC m=+971.886824729 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "webhook-certs" (UniqueName: "kubernetes.io/secret/91595c8f-09e8-4cdd-8054-1f46eafa27ad-webhook-certs") pod "openstack-operator-controller-manager-5fbcdbcf94-6sdhq" (UID: "91595c8f-09e8-4cdd-8054-1f46eafa27ad") : secret "webhook-server-cert" not found Mar 16 15:47:48 crc kubenswrapper[5120]: E0316 15:47:48.732937 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91595c8f-09e8-4cdd-8054-1f46eafa27ad-metrics-certs podName:91595c8f-09e8-4cdd-8054-1f46eafa27ad nodeName:}" failed. No retries permitted until 2026-03-16 15:47:49.732917853 +0000 UTC m=+971.886849510 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/91595c8f-09e8-4cdd-8054-1f46eafa27ad-metrics-certs") pod "openstack-operator-controller-manager-5fbcdbcf94-6sdhq" (UID: "91595c8f-09e8-4cdd-8054-1f46eafa27ad") : secret "metrics-server-cert" not found Mar 16 15:47:48 crc kubenswrapper[5120]: I0316 15:47:48.789073 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/heat-operator-controller-manager-79975d4c95-n2zm7" event={"ID":"4752ce4e-0b7c-43d7-99dc-b8633f7a2cd7","Type":"ContainerStarted","Data":"bf2ee9740d6b929f56124ffc33b886b74d45f262be402b3a97e3f8b00857b5d3"} Mar 16 15:47:48 crc kubenswrapper[5120]: I0316 15:47:48.790609 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/horizon-operator-controller-manager-5bf9fb4564-qzsbr" event={"ID":"e6b6caa5-b1c3-4ad6-8b0e-0358400bb03b","Type":"ContainerStarted","Data":"681045361cf2bd7776417547f46c5f5295f10747e02d69d32618c7cea73269e9"} Mar 16 15:47:48 crc kubenswrapper[5120]: I0316 15:47:48.791851 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/ironic-operator-controller-manager-997698bf9-6zvjn" event={"ID":"42478fad-5a61-4cc1-94cc-ac00bdf30f24","Type":"ContainerStarted","Data":"545c25b4bd71069314f7c505f3b97b07e5fb19339460a2edd1f8c97143cc0e39"} Mar 16 15:47:48 crc kubenswrapper[5120]: I0316 15:47:48.794387 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/glance-operator-controller-manager-58d9bbd8cc-vhvn5" event={"ID":"e918c50c-96eb-4da3-9b1d-fc31e3582816","Type":"ContainerStarted","Data":"44a430d5312f4f57dd649d4462be3d3fee00a98efe90aa7767592c017e596086"} Mar 16 15:47:48 crc kubenswrapper[5120]: I0316 15:47:48.795179 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/cinder-operator-controller-manager-55bc8cdcc4-sbtk9" event={"ID":"ed2165fd-95f2-40f7-a860-70b81d6ab977","Type":"ContainerStarted","Data":"cbd4bf9f0cccc3aecc250d1354d4c968f4f001fd9909303867737ec83c096096"} Mar 16 15:47:49 crc kubenswrapper[5120]: I0316 15:47:49.123033 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/ovn-operator-controller-manager-6fb6cd45c4-ln28h"] Mar 16 15:47:49 crc kubenswrapper[5120]: I0316 15:47:49.150876 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/mariadb-operator-controller-manager-5748db694b-nk2nc"] Mar 16 15:47:49 crc kubenswrapper[5120]: I0316 15:47:49.156803 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/octavia-operator-controller-manager-7b89675745-5vg74"] Mar 16 15:47:49 crc kubenswrapper[5120]: W0316 15:47:49.167740 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e6d8ae5_f5be_4b12_8401_54dcc86da579.slice/crio-56599aa87b3a9bc6916c774c8b5f27046fdc5e9f4783776b7ad3c54a151544d7 WatchSource:0}: Error finding container 56599aa87b3a9bc6916c774c8b5f27046fdc5e9f4783776b7ad3c54a151544d7: Status 404 returned error can't find the container with id 56599aa87b3a9bc6916c774c8b5f27046fdc5e9f4783776b7ad3c54a151544d7 Mar 16 15:47:49 crc kubenswrapper[5120]: I0316 15:47:49.177340 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/barbican-operator-controller-manager-848cfb5779-68smv"] Mar 16 15:47:49 crc kubenswrapper[5120]: W0316 15:47:49.182872 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a11dd5a_29d6_4791_849c_97b08acb5b4e.slice/crio-2454e6b8acfc7b9ad975c65192640929a5bc95fc0db435db64262f23e2fa54a5 WatchSource:0}: Error finding container 2454e6b8acfc7b9ad975c65192640929a5bc95fc0db435db64262f23e2fa54a5: Status 404 returned error can't find the container with id 2454e6b8acfc7b9ad975c65192640929a5bc95fc0db435db64262f23e2fa54a5 Mar 16 15:47:49 crc kubenswrapper[5120]: I0316 15:47:49.189816 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/neutron-operator-controller-manager-75c6f4bc76-mbnvj"] Mar 16 15:47:49 crc kubenswrapper[5120]: I0316 15:47:49.195853 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/nova-operator-controller-manager-785d77464d-j7x9r"] Mar 16 15:47:49 crc kubenswrapper[5120]: I0316 15:47:49.198828 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/designate-operator-controller-manager-7cf89c67bb-cjd7x"] Mar 16 15:47:49 crc kubenswrapper[5120]: W0316 15:47:49.201937 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66faede0_c074_49ca_8bf9_9b5777b02edf.slice/crio-fdd83c623323d47d6c12084e96b5399673c400dd89d5e5f9462d315d12e68de5 WatchSource:0}: Error finding container fdd83c623323d47d6c12084e96b5399673c400dd89d5e5f9462d315d12e68de5: Status 404 returned error can't find the container with id fdd83c623323d47d6c12084e96b5399673c400dd89d5e5f9462d315d12e68de5 Mar 16 15:47:49 crc kubenswrapper[5120]: I0316 15:47:49.203245 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/telemetry-operator-controller-manager-f5cf7fcb7-cmrwq"] Mar 16 15:47:49 crc kubenswrapper[5120]: I0316 15:47:49.207913 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/manila-operator-controller-manager-7d6d87b867-xkrnl"] Mar 16 15:47:49 crc kubenswrapper[5120]: I0316 15:47:49.213193 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/swift-operator-controller-manager-5d89b4d5d5-9zvm4"] Mar 16 15:47:49 crc kubenswrapper[5120]: I0316 15:47:49.215907 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/placement-operator-controller-manager-57fdd4b4cf-v5f9b"] Mar 16 15:47:49 crc kubenswrapper[5120]: W0316 15:47:49.218914 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod201aeec6_1404_4b8d_8cf7_4d2550cc9898.slice/crio-ce80cbc9343ba751c736405a94a36293106ae3b35b4508daa447d140f9a64302 WatchSource:0}: Error finding container ce80cbc9343ba751c736405a94a36293106ae3b35b4508daa447d140f9a64302: Status 404 returned error can't find the container with id ce80cbc9343ba751c736405a94a36293106ae3b35b4508daa447d140f9a64302 Mar 16 15:47:49 crc kubenswrapper[5120]: I0316 15:47:49.219516 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/test-operator-controller-manager-74d567479f-cbkr4"] Mar 16 15:47:49 crc kubenswrapper[5120]: I0316 15:47:49.224534 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/keystone-operator-controller-manager-6f5b9fd59-rhjb2"] Mar 16 15:47:49 crc kubenswrapper[5120]: I0316 15:47:49.228596 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/rabbitmq-cluster-operator-manager-85d9b55b6-tfl54"] Mar 16 15:47:49 crc kubenswrapper[5120]: I0316 15:47:49.232538 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/watcher-operator-controller-manager-65d578856c-7khnv"] Mar 16 15:47:49 crc kubenswrapper[5120]: I0316 15:47:49.238128 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/797f2c96-18c7-400b-a46d-795da852b08e-cert\") pod \"infra-operator-controller-manager-76f8b7ddbd-nvwr5\" (UID: \"797f2c96-18c7-400b-a46d-795da852b08e\") " pod="openstack-operators/infra-operator-controller-manager-76f8b7ddbd-nvwr5" Mar 16 15:47:49 crc kubenswrapper[5120]: E0316 15:47:49.238301 5120 secret.go:189] Couldn't get secret openstack-operators/infra-operator-webhook-server-cert: secret "infra-operator-webhook-server-cert" not found Mar 16 15:47:49 crc kubenswrapper[5120]: E0316 15:47:49.238346 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/797f2c96-18c7-400b-a46d-795da852b08e-cert podName:797f2c96-18c7-400b-a46d-795da852b08e nodeName:}" failed. No retries permitted until 2026-03-16 15:47:51.238331197 +0000 UTC m=+973.392262854 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/797f2c96-18c7-400b-a46d-795da852b08e-cert") pod "infra-operator-controller-manager-76f8b7ddbd-nvwr5" (UID: "797f2c96-18c7-400b-a46d-795da852b08e") : secret "infra-operator-webhook-server-cert" not found Mar 16 15:47:49 crc kubenswrapper[5120]: E0316 15:47:49.238420 5120 kuberuntime_manager.go:1358] "Unhandled Error" err="container &Container{Name:manager,Image:quay.io/openstack-k8s-operators/barbican-operator@sha256:7562d3e09bdac17f447f4523c5bd784c5f5ab5ca9cb2370a03b86126d6d7301d,Command:[/manager],Args:[--leader-elect --health-probe-bind-address=:8081 --metrics-bind-address=127.0.0.1:8080],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:LEASE_DURATION,Value:30,ValueFrom:nil,},EnvVar{Name:RENEW_DEADLINE,Value:20,ValueFrom:nil,},EnvVar{Name:RETRY_PERIOD,Value:5,ValueFrom:nil,},EnvVar{Name:ENABLE_WEBHOOKS,Value:false,ValueFrom:nil,},EnvVar{Name:METRICS_CERTS,Value:false,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{cpu: {{500 -3} {} 500m DecimalSI},memory: {{536870912 0} {} BinarySI},},Requests:ResourceList{cpu: {{10 -3} {} 10m DecimalSI},memory: {{268435456 0} {} BinarySI},},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kube-api-access-lfbdn,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/healthz,Port:{0 8081 },Host:,Scheme:HTTP,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:15,TimeoutSeconds:1,PeriodSeconds:20,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},ReadinessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/readyz,Port:{0 8081 },Host:,Scheme:HTTP,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:5,TimeoutSeconds:1,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[MKNOD],},Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod barbican-operator-controller-manager-848cfb5779-68smv_openstack-operators(f62d5d6a-d638-4968-902f-8eb726c039c1): ErrImagePull: pull QPS exceeded" logger="UnhandledError" Mar 16 15:47:49 crc kubenswrapper[5120]: E0316 15:47:49.240025 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ErrImagePull: \"pull QPS exceeded\"" pod="openstack-operators/barbican-operator-controller-manager-848cfb5779-68smv" podUID="f62d5d6a-d638-4968-902f-8eb726c039c1" Mar 16 15:47:49 crc kubenswrapper[5120]: E0316 15:47:49.241005 5120 kuberuntime_manager.go:1358] "Unhandled Error" err="container &Container{Name:manager,Image:quay.io/openstack-k8s-operators/designate-operator@sha256:12841b27173f5f1beeb83112e057c8753f4cf411f583fba4f0610fac0f60b7ad,Command:[/manager],Args:[--leader-elect --health-probe-bind-address=:8081 --metrics-bind-address=127.0.0.1:8080],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:LEASE_DURATION,Value:30,ValueFrom:nil,},EnvVar{Name:RENEW_DEADLINE,Value:20,ValueFrom:nil,},EnvVar{Name:RETRY_PERIOD,Value:5,ValueFrom:nil,},EnvVar{Name:ENABLE_WEBHOOKS,Value:false,ValueFrom:nil,},EnvVar{Name:METRICS_CERTS,Value:false,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{cpu: {{500 -3} {} 500m DecimalSI},memory: {{536870912 0} {} BinarySI},},Requests:ResourceList{cpu: {{10 -3} {} 10m DecimalSI},memory: {{268435456 0} {} BinarySI},},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kube-api-access-r5n68,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/healthz,Port:{0 8081 },Host:,Scheme:HTTP,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:15,TimeoutSeconds:1,PeriodSeconds:20,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},ReadinessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/readyz,Port:{0 8081 },Host:,Scheme:HTTP,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:5,TimeoutSeconds:1,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[MKNOD],},Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod designate-operator-controller-manager-7cf89c67bb-cjd7x_openstack-operators(2fc99f04-8366-4f00-9ce1-d0e4faf1d0a3): ErrImagePull: pull QPS exceeded" logger="UnhandledError" Mar 16 15:47:49 crc kubenswrapper[5120]: E0316 15:47:49.242074 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ErrImagePull: \"pull QPS exceeded\"" pod="openstack-operators/designate-operator-controller-manager-7cf89c67bb-cjd7x" podUID="2fc99f04-8366-4f00-9ce1-d0e4faf1d0a3" Mar 16 15:47:49 crc kubenswrapper[5120]: E0316 15:47:49.249951 5120 kuberuntime_manager.go:1358] "Unhandled Error" err="container &Container{Name:manager,Image:quay.io/openstack-k8s-operators/swift-operator@sha256:866844c5b88e1e0518ceb7490cac9d093da3fb8b2f27ba7bd9bd89f946b9ee6e,Command:[/manager],Args:[--leader-elect --health-probe-bind-address=:8081 --metrics-bind-address=127.0.0.1:8080],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:LEASE_DURATION,Value:30,ValueFrom:nil,},EnvVar{Name:RENEW_DEADLINE,Value:20,ValueFrom:nil,},EnvVar{Name:RETRY_PERIOD,Value:5,ValueFrom:nil,},EnvVar{Name:ENABLE_WEBHOOKS,Value:false,ValueFrom:nil,},EnvVar{Name:METRICS_CERTS,Value:false,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{cpu: {{500 -3} {} 500m DecimalSI},memory: {{536870912 0} {} BinarySI},},Requests:ResourceList{cpu: {{10 -3} {} 10m DecimalSI},memory: {{268435456 0} {} BinarySI},},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kube-api-access-8jck5,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/healthz,Port:{0 8081 },Host:,Scheme:HTTP,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:15,TimeoutSeconds:1,PeriodSeconds:20,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},ReadinessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/readyz,Port:{0 8081 },Host:,Scheme:HTTP,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:5,TimeoutSeconds:1,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:nil,SELinuxOptions:nil,RunAsUser:*1000660000,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod swift-operator-controller-manager-5d89b4d5d5-9zvm4_openstack-operators(e46d1032-1fff-4f99-baa0-487aee0eb1bd): ErrImagePull: pull QPS exceeded" logger="UnhandledError" Mar 16 15:47:49 crc kubenswrapper[5120]: E0316 15:47:49.250466 5120 kuberuntime_manager.go:1358] "Unhandled Error" err="container &Container{Name:manager,Image:quay.io/openstack-k8s-operators/test-operator@sha256:43bd420bc05b4789243740bc75f61e10c7aac7883fc2f82b2d4d50085bc96c42,Command:[/manager],Args:[--leader-elect --health-probe-bind-address=:8081 --metrics-bind-address=127.0.0.1:8080],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:LEASE_DURATION,Value:30,ValueFrom:nil,},EnvVar{Name:RENEW_DEADLINE,Value:20,ValueFrom:nil,},EnvVar{Name:RETRY_PERIOD,Value:5,ValueFrom:nil,},EnvVar{Name:ENABLE_WEBHOOKS,Value:false,ValueFrom:nil,},EnvVar{Name:METRICS_CERTS,Value:false,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{cpu: {{500 -3} {} 500m DecimalSI},memory: {{536870912 0} {} BinarySI},},Requests:ResourceList{cpu: {{10 -3} {} 10m DecimalSI},memory: {{268435456 0} {} BinarySI},},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kube-api-access-m8688,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/healthz,Port:{0 8081 },Host:,Scheme:HTTP,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:15,TimeoutSeconds:1,PeriodSeconds:20,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},ReadinessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/readyz,Port:{0 8081 },Host:,Scheme:HTTP,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:5,TimeoutSeconds:1,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[MKNOD],},Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod test-operator-controller-manager-74d567479f-cbkr4_openstack-operators(ef52f45c-ba73-4607-8b03-f13fce9806bd): ErrImagePull: pull QPS exceeded" logger="UnhandledError" Mar 16 15:47:49 crc kubenswrapper[5120]: E0316 15:47:49.251152 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ErrImagePull: \"pull QPS exceeded\"" pod="openstack-operators/swift-operator-controller-manager-5d89b4d5d5-9zvm4" podUID="e46d1032-1fff-4f99-baa0-487aee0eb1bd" Mar 16 15:47:49 crc kubenswrapper[5120]: E0316 15:47:49.252817 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ErrImagePull: \"pull QPS exceeded\"" pod="openstack-operators/test-operator-controller-manager-74d567479f-cbkr4" podUID="ef52f45c-ba73-4607-8b03-f13fce9806bd" Mar 16 15:47:49 crc kubenswrapper[5120]: E0316 15:47:49.253049 5120 kuberuntime_manager.go:1358] "Unhandled Error" err="container &Container{Name:manager,Image:quay.io/openstack-k8s-operators/placement-operator@sha256:c8743a6661d118b0e5ba3eb110643358a8a3237dc75984a8f9829880b55a1622,Command:[/manager],Args:[--leader-elect --health-probe-bind-address=:8081 --metrics-bind-address=127.0.0.1:8080],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:LEASE_DURATION,Value:30,ValueFrom:nil,},EnvVar{Name:RENEW_DEADLINE,Value:20,ValueFrom:nil,},EnvVar{Name:RETRY_PERIOD,Value:5,ValueFrom:nil,},EnvVar{Name:ENABLE_WEBHOOKS,Value:false,ValueFrom:nil,},EnvVar{Name:METRICS_CERTS,Value:false,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{cpu: {{500 -3} {} 500m DecimalSI},memory: {{536870912 0} {} BinarySI},},Requests:ResourceList{cpu: {{10 -3} {} 10m DecimalSI},memory: {{268435456 0} {} BinarySI},},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kube-api-access-lt64k,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/healthz,Port:{0 8081 },Host:,Scheme:HTTP,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:15,TimeoutSeconds:1,PeriodSeconds:20,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},ReadinessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/readyz,Port:{0 8081 },Host:,Scheme:HTTP,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:5,TimeoutSeconds:1,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[MKNOD],},Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod placement-operator-controller-manager-57fdd4b4cf-v5f9b_openstack-operators(3b105271-39d9-4339-a315-3aa161a54b31): ErrImagePull: pull QPS exceeded" logger="UnhandledError" Mar 16 15:47:49 crc kubenswrapper[5120]: E0316 15:47:49.254334 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ErrImagePull: \"pull QPS exceeded\"" pod="openstack-operators/placement-operator-controller-manager-57fdd4b4cf-v5f9b" podUID="3b105271-39d9-4339-a315-3aa161a54b31" Mar 16 15:47:49 crc kubenswrapper[5120]: E0316 15:47:49.254782 5120 kuberuntime_manager.go:1358] "Unhandled Error" err="container &Container{Name:manager,Image:quay.io/openstack-k8s-operators/watcher-operator@sha256:d9c55e8c6304a0e32289b5e8c69a87ea59b9968918a5c85b7c384633df82c807,Command:[/manager],Args:[--leader-elect --health-probe-bind-address=:8081 --metrics-bind-address=127.0.0.1:8080],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:LEASE_DURATION,Value:30,ValueFrom:nil,},EnvVar{Name:RENEW_DEADLINE,Value:20,ValueFrom:nil,},EnvVar{Name:RETRY_PERIOD,Value:5,ValueFrom:nil,},EnvVar{Name:ENABLE_WEBHOOKS,Value:false,ValueFrom:nil,},EnvVar{Name:METRICS_CERTS,Value:false,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{cpu: {{500 -3} {} 500m DecimalSI},memory: {{536870912 0} {} BinarySI},},Requests:ResourceList{cpu: {{10 -3} {} 10m DecimalSI},memory: {{268435456 0} {} BinarySI},},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kube-api-access-kjp8x,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/healthz,Port:{0 8081 },Host:,Scheme:HTTP,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:15,TimeoutSeconds:1,PeriodSeconds:20,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},ReadinessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/readyz,Port:{0 8081 },Host:,Scheme:HTTP,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:5,TimeoutSeconds:1,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[MKNOD],},Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod watcher-operator-controller-manager-65d578856c-7khnv_openstack-operators(4af61d68-498f-4c1a-812d-91089029f784): ErrImagePull: pull QPS exceeded" logger="UnhandledError" Mar 16 15:47:49 crc kubenswrapper[5120]: E0316 15:47:49.256946 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ErrImagePull: \"pull QPS exceeded\"" pod="openstack-operators/watcher-operator-controller-manager-65d578856c-7khnv" podUID="4af61d68-498f-4c1a-812d-91089029f784" Mar 16 15:47:49 crc kubenswrapper[5120]: I0316 15:47:49.443461 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8643ed10-e4fd-4b97-ae36-c4b581cdef1b-cert\") pod \"openstack-baremetal-operator-controller-manager-6b6ddbc599g848w\" (UID: \"8643ed10-e4fd-4b97-ae36-c4b581cdef1b\") " pod="openstack-operators/openstack-baremetal-operator-controller-manager-6b6ddbc599g848w" Mar 16 15:47:49 crc kubenswrapper[5120]: E0316 15:47:49.443713 5120 secret.go:189] Couldn't get secret openstack-operators/openstack-baremetal-operator-webhook-server-cert: secret "openstack-baremetal-operator-webhook-server-cert" not found Mar 16 15:47:49 crc kubenswrapper[5120]: E0316 15:47:49.443805 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8643ed10-e4fd-4b97-ae36-c4b581cdef1b-cert podName:8643ed10-e4fd-4b97-ae36-c4b581cdef1b nodeName:}" failed. No retries permitted until 2026-03-16 15:47:51.443786748 +0000 UTC m=+973.597718405 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8643ed10-e4fd-4b97-ae36-c4b581cdef1b-cert") pod "openstack-baremetal-operator-controller-manager-6b6ddbc599g848w" (UID: "8643ed10-e4fd-4b97-ae36-c4b581cdef1b") : secret "openstack-baremetal-operator-webhook-server-cert" not found Mar 16 15:47:49 crc kubenswrapper[5120]: I0316 15:47:49.749816 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/91595c8f-09e8-4cdd-8054-1f46eafa27ad-metrics-certs\") pod \"openstack-operator-controller-manager-5fbcdbcf94-6sdhq\" (UID: \"91595c8f-09e8-4cdd-8054-1f46eafa27ad\") " pod="openstack-operators/openstack-operator-controller-manager-5fbcdbcf94-6sdhq" Mar 16 15:47:49 crc kubenswrapper[5120]: I0316 15:47:49.749860 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-certs\" (UniqueName: \"kubernetes.io/secret/91595c8f-09e8-4cdd-8054-1f46eafa27ad-webhook-certs\") pod \"openstack-operator-controller-manager-5fbcdbcf94-6sdhq\" (UID: \"91595c8f-09e8-4cdd-8054-1f46eafa27ad\") " pod="openstack-operators/openstack-operator-controller-manager-5fbcdbcf94-6sdhq" Mar 16 15:47:49 crc kubenswrapper[5120]: E0316 15:47:49.749987 5120 secret.go:189] Couldn't get secret openstack-operators/metrics-server-cert: secret "metrics-server-cert" not found Mar 16 15:47:49 crc kubenswrapper[5120]: E0316 15:47:49.750060 5120 secret.go:189] Couldn't get secret openstack-operators/webhook-server-cert: secret "webhook-server-cert" not found Mar 16 15:47:49 crc kubenswrapper[5120]: E0316 15:47:49.750076 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91595c8f-09e8-4cdd-8054-1f46eafa27ad-metrics-certs podName:91595c8f-09e8-4cdd-8054-1f46eafa27ad nodeName:}" failed. No retries permitted until 2026-03-16 15:47:51.750055939 +0000 UTC m=+973.903987596 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/91595c8f-09e8-4cdd-8054-1f46eafa27ad-metrics-certs") pod "openstack-operator-controller-manager-5fbcdbcf94-6sdhq" (UID: "91595c8f-09e8-4cdd-8054-1f46eafa27ad") : secret "metrics-server-cert" not found Mar 16 15:47:49 crc kubenswrapper[5120]: E0316 15:47:49.750127 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91595c8f-09e8-4cdd-8054-1f46eafa27ad-webhook-certs podName:91595c8f-09e8-4cdd-8054-1f46eafa27ad nodeName:}" failed. No retries permitted until 2026-03-16 15:47:51.75011055 +0000 UTC m=+973.904042207 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "webhook-certs" (UniqueName: "kubernetes.io/secret/91595c8f-09e8-4cdd-8054-1f46eafa27ad-webhook-certs") pod "openstack-operator-controller-manager-5fbcdbcf94-6sdhq" (UID: "91595c8f-09e8-4cdd-8054-1f46eafa27ad") : secret "webhook-server-cert" not found Mar 16 15:47:49 crc kubenswrapper[5120]: I0316 15:47:49.838422 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/placement-operator-controller-manager-57fdd4b4cf-v5f9b" event={"ID":"3b105271-39d9-4339-a315-3aa161a54b31","Type":"ContainerStarted","Data":"8edf5b4a743a276bed8bf2749cc12c9ab11438630047bceca05dc5c4bd78adb2"} Mar 16 15:47:49 crc kubenswrapper[5120]: E0316 15:47:49.848357 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openstack-k8s-operators/placement-operator@sha256:c8743a6661d118b0e5ba3eb110643358a8a3237dc75984a8f9829880b55a1622\\\": ErrImagePull: pull QPS exceeded\"" pod="openstack-operators/placement-operator-controller-manager-57fdd4b4cf-v5f9b" podUID="3b105271-39d9-4339-a315-3aa161a54b31" Mar 16 15:47:49 crc kubenswrapper[5120]: I0316 15:47:49.853640 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/barbican-operator-controller-manager-848cfb5779-68smv" event={"ID":"f62d5d6a-d638-4968-902f-8eb726c039c1","Type":"ContainerStarted","Data":"522c446690fd42ec82c1ca2942d82d990c4b0391447951f5c911037075bdbd03"} Mar 16 15:47:49 crc kubenswrapper[5120]: E0316 15:47:49.867137 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openstack-k8s-operators/barbican-operator@sha256:7562d3e09bdac17f447f4523c5bd784c5f5ab5ca9cb2370a03b86126d6d7301d\\\": ErrImagePull: pull QPS exceeded\"" pod="openstack-operators/barbican-operator-controller-manager-848cfb5779-68smv" podUID="f62d5d6a-d638-4968-902f-8eb726c039c1" Mar 16 15:47:49 crc kubenswrapper[5120]: I0316 15:47:49.877997 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/watcher-operator-controller-manager-65d578856c-7khnv" event={"ID":"4af61d68-498f-4c1a-812d-91089029f784","Type":"ContainerStarted","Data":"817c663018600ca8c6faf5d2c26fcef8a76bf369884318e57f65aee17ee9504c"} Mar 16 15:47:49 crc kubenswrapper[5120]: E0316 15:47:49.883269 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openstack-k8s-operators/watcher-operator@sha256:d9c55e8c6304a0e32289b5e8c69a87ea59b9968918a5c85b7c384633df82c807\\\": ErrImagePull: pull QPS exceeded\"" pod="openstack-operators/watcher-operator-controller-manager-65d578856c-7khnv" podUID="4af61d68-498f-4c1a-812d-91089029f784" Mar 16 15:47:49 crc kubenswrapper[5120]: I0316 15:47:49.891930 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/ovn-operator-controller-manager-6fb6cd45c4-ln28h" event={"ID":"8e6d8ae5-f5be-4b12-8401-54dcc86da579","Type":"ContainerStarted","Data":"56599aa87b3a9bc6916c774c8b5f27046fdc5e9f4783776b7ad3c54a151544d7"} Mar 16 15:47:49 crc kubenswrapper[5120]: I0316 15:47:49.922019 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/keystone-operator-controller-manager-6f5b9fd59-rhjb2" event={"ID":"f5403564-ecbf-4103-89b6-530a8381c664","Type":"ContainerStarted","Data":"52dde25e8f39d2053edceb14a9f064c45f15efded30e00f99cc0fc07aad7bd95"} Mar 16 15:47:49 crc kubenswrapper[5120]: I0316 15:47:49.927978 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/designate-operator-controller-manager-7cf89c67bb-cjd7x" event={"ID":"2fc99f04-8366-4f00-9ce1-d0e4faf1d0a3","Type":"ContainerStarted","Data":"dcb50bfe2d0388f0111daeb30e2e78bfd90f9a2eec21d8e408012ff507eb2aa5"} Mar 16 15:47:49 crc kubenswrapper[5120]: E0316 15:47:49.929226 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openstack-k8s-operators/designate-operator@sha256:12841b27173f5f1beeb83112e057c8753f4cf411f583fba4f0610fac0f60b7ad\\\": ErrImagePull: pull QPS exceeded\"" pod="openstack-operators/designate-operator-controller-manager-7cf89c67bb-cjd7x" podUID="2fc99f04-8366-4f00-9ce1-d0e4faf1d0a3" Mar 16 15:47:49 crc kubenswrapper[5120]: I0316 15:47:49.930860 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/rabbitmq-cluster-operator-manager-85d9b55b6-tfl54" event={"ID":"d2d3e713-eefd-44fd-8784-1f4f54155d8f","Type":"ContainerStarted","Data":"73deefd200ddec3b0dc5bfcb298d2fd1754d8338fd22adb946b46760d44eb2bf"} Mar 16 15:47:49 crc kubenswrapper[5120]: I0316 15:47:49.936050 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/swift-operator-controller-manager-5d89b4d5d5-9zvm4" event={"ID":"e46d1032-1fff-4f99-baa0-487aee0eb1bd","Type":"ContainerStarted","Data":"0d760b2b65c23df04b67266bafde4c6fe1cedb49a76ccedf6fed08ae1beddee5"} Mar 16 15:47:49 crc kubenswrapper[5120]: E0316 15:47:49.937175 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openstack-k8s-operators/swift-operator@sha256:866844c5b88e1e0518ceb7490cac9d093da3fb8b2f27ba7bd9bd89f946b9ee6e\\\": ErrImagePull: pull QPS exceeded\"" pod="openstack-operators/swift-operator-controller-manager-5d89b4d5d5-9zvm4" podUID="e46d1032-1fff-4f99-baa0-487aee0eb1bd" Mar 16 15:47:49 crc kubenswrapper[5120]: I0316 15:47:49.937753 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/test-operator-controller-manager-74d567479f-cbkr4" event={"ID":"ef52f45c-ba73-4607-8b03-f13fce9806bd","Type":"ContainerStarted","Data":"7eb9ccba69cf3dc32a377e309ea490bb46cad62e4d3a52460f3bd5b47d5c9eb2"} Mar 16 15:47:49 crc kubenswrapper[5120]: E0316 15:47:49.938913 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openstack-k8s-operators/test-operator@sha256:43bd420bc05b4789243740bc75f61e10c7aac7883fc2f82b2d4d50085bc96c42\\\": ErrImagePull: pull QPS exceeded\"" pod="openstack-operators/test-operator-controller-manager-74d567479f-cbkr4" podUID="ef52f45c-ba73-4607-8b03-f13fce9806bd" Mar 16 15:47:49 crc kubenswrapper[5120]: I0316 15:47:49.939270 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/nova-operator-controller-manager-785d77464d-j7x9r" event={"ID":"66faede0-c074-49ca-8bf9-9b5777b02edf","Type":"ContainerStarted","Data":"fdd83c623323d47d6c12084e96b5399673c400dd89d5e5f9462d315d12e68de5"} Mar 16 15:47:49 crc kubenswrapper[5120]: I0316 15:47:49.940017 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/neutron-operator-controller-manager-75c6f4bc76-mbnvj" event={"ID":"32fa740c-28b3-42a7-8ab5-6d159c237bf8","Type":"ContainerStarted","Data":"d5a3de0ce2103896651c778fde51206149a1bb9af78ce2c45706df5784e980e5"} Mar 16 15:47:49 crc kubenswrapper[5120]: I0316 15:47:49.940929 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/manila-operator-controller-manager-7d6d87b867-xkrnl" event={"ID":"eed7b084-3ca6-41c0-847f-19929fb52c41","Type":"ContainerStarted","Data":"9fd4e81cb0f9c38cb33b3f2e4b7678f945fae53b7bc009c56ac74dc4b4e8f52c"} Mar 16 15:47:49 crc kubenswrapper[5120]: I0316 15:47:49.941946 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/mariadb-operator-controller-manager-5748db694b-nk2nc" event={"ID":"8a11dd5a-29d6-4791-849c-97b08acb5b4e","Type":"ContainerStarted","Data":"2454e6b8acfc7b9ad975c65192640929a5bc95fc0db435db64262f23e2fa54a5"} Mar 16 15:47:49 crc kubenswrapper[5120]: I0316 15:47:49.942858 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/telemetry-operator-controller-manager-f5cf7fcb7-cmrwq" event={"ID":"201aeec6-1404-4b8d-8cf7-4d2550cc9898","Type":"ContainerStarted","Data":"ce80cbc9343ba751c736405a94a36293106ae3b35b4508daa447d140f9a64302"} Mar 16 15:47:49 crc kubenswrapper[5120]: I0316 15:47:49.943733 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/octavia-operator-controller-manager-7b89675745-5vg74" event={"ID":"bbc9f690-e60b-4c8a-b84a-2d8a3ca2001f","Type":"ContainerStarted","Data":"02484f610112a0728af17724d02530d79267237bccb0649395aabae0858e39c3"} Mar 16 15:47:50 crc kubenswrapper[5120]: E0316 15:47:50.967260 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openstack-k8s-operators/barbican-operator@sha256:7562d3e09bdac17f447f4523c5bd784c5f5ab5ca9cb2370a03b86126d6d7301d\\\": ErrImagePull: pull QPS exceeded\"" pod="openstack-operators/barbican-operator-controller-manager-848cfb5779-68smv" podUID="f62d5d6a-d638-4968-902f-8eb726c039c1" Mar 16 15:47:50 crc kubenswrapper[5120]: E0316 15:47:50.967416 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openstack-k8s-operators/designate-operator@sha256:12841b27173f5f1beeb83112e057c8753f4cf411f583fba4f0610fac0f60b7ad\\\": ErrImagePull: pull QPS exceeded\"" pod="openstack-operators/designate-operator-controller-manager-7cf89c67bb-cjd7x" podUID="2fc99f04-8366-4f00-9ce1-d0e4faf1d0a3" Mar 16 15:47:50 crc kubenswrapper[5120]: E0316 15:47:50.968067 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openstack-k8s-operators/test-operator@sha256:43bd420bc05b4789243740bc75f61e10c7aac7883fc2f82b2d4d50085bc96c42\\\": ErrImagePull: pull QPS exceeded\"" pod="openstack-operators/test-operator-controller-manager-74d567479f-cbkr4" podUID="ef52f45c-ba73-4607-8b03-f13fce9806bd" Mar 16 15:47:50 crc kubenswrapper[5120]: E0316 15:47:50.968338 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openstack-k8s-operators/swift-operator@sha256:866844c5b88e1e0518ceb7490cac9d093da3fb8b2f27ba7bd9bd89f946b9ee6e\\\": ErrImagePull: pull QPS exceeded\"" pod="openstack-operators/swift-operator-controller-manager-5d89b4d5d5-9zvm4" podUID="e46d1032-1fff-4f99-baa0-487aee0eb1bd" Mar 16 15:47:50 crc kubenswrapper[5120]: E0316 15:47:50.969020 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openstack-k8s-operators/watcher-operator@sha256:d9c55e8c6304a0e32289b5e8c69a87ea59b9968918a5c85b7c384633df82c807\\\": ErrImagePull: pull QPS exceeded\"" pod="openstack-operators/watcher-operator-controller-manager-65d578856c-7khnv" podUID="4af61d68-498f-4c1a-812d-91089029f784" Mar 16 15:47:50 crc kubenswrapper[5120]: E0316 15:47:50.971276 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openstack-k8s-operators/placement-operator@sha256:c8743a6661d118b0e5ba3eb110643358a8a3237dc75984a8f9829880b55a1622\\\": ErrImagePull: pull QPS exceeded\"" pod="openstack-operators/placement-operator-controller-manager-57fdd4b4cf-v5f9b" podUID="3b105271-39d9-4339-a315-3aa161a54b31" Mar 16 15:47:51 crc kubenswrapper[5120]: I0316 15:47:51.279090 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/797f2c96-18c7-400b-a46d-795da852b08e-cert\") pod \"infra-operator-controller-manager-76f8b7ddbd-nvwr5\" (UID: \"797f2c96-18c7-400b-a46d-795da852b08e\") " pod="openstack-operators/infra-operator-controller-manager-76f8b7ddbd-nvwr5" Mar 16 15:47:51 crc kubenswrapper[5120]: E0316 15:47:51.279265 5120 secret.go:189] Couldn't get secret openstack-operators/infra-operator-webhook-server-cert: secret "infra-operator-webhook-server-cert" not found Mar 16 15:47:51 crc kubenswrapper[5120]: E0316 15:47:51.279412 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/797f2c96-18c7-400b-a46d-795da852b08e-cert podName:797f2c96-18c7-400b-a46d-795da852b08e nodeName:}" failed. No retries permitted until 2026-03-16 15:47:55.279396389 +0000 UTC m=+977.433328036 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/797f2c96-18c7-400b-a46d-795da852b08e-cert") pod "infra-operator-controller-manager-76f8b7ddbd-nvwr5" (UID: "797f2c96-18c7-400b-a46d-795da852b08e") : secret "infra-operator-webhook-server-cert" not found Mar 16 15:47:51 crc kubenswrapper[5120]: I0316 15:47:51.481444 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8643ed10-e4fd-4b97-ae36-c4b581cdef1b-cert\") pod \"openstack-baremetal-operator-controller-manager-6b6ddbc599g848w\" (UID: \"8643ed10-e4fd-4b97-ae36-c4b581cdef1b\") " pod="openstack-operators/openstack-baremetal-operator-controller-manager-6b6ddbc599g848w" Mar 16 15:47:51 crc kubenswrapper[5120]: E0316 15:47:51.481648 5120 secret.go:189] Couldn't get secret openstack-operators/openstack-baremetal-operator-webhook-server-cert: secret "openstack-baremetal-operator-webhook-server-cert" not found Mar 16 15:47:51 crc kubenswrapper[5120]: E0316 15:47:51.481698 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8643ed10-e4fd-4b97-ae36-c4b581cdef1b-cert podName:8643ed10-e4fd-4b97-ae36-c4b581cdef1b nodeName:}" failed. No retries permitted until 2026-03-16 15:47:55.481685125 +0000 UTC m=+977.635616782 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8643ed10-e4fd-4b97-ae36-c4b581cdef1b-cert") pod "openstack-baremetal-operator-controller-manager-6b6ddbc599g848w" (UID: "8643ed10-e4fd-4b97-ae36-c4b581cdef1b") : secret "openstack-baremetal-operator-webhook-server-cert" not found Mar 16 15:47:51 crc kubenswrapper[5120]: I0316 15:47:51.789542 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/91595c8f-09e8-4cdd-8054-1f46eafa27ad-metrics-certs\") pod \"openstack-operator-controller-manager-5fbcdbcf94-6sdhq\" (UID: \"91595c8f-09e8-4cdd-8054-1f46eafa27ad\") " pod="openstack-operators/openstack-operator-controller-manager-5fbcdbcf94-6sdhq" Mar 16 15:47:51 crc kubenswrapper[5120]: I0316 15:47:51.790100 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-certs\" (UniqueName: \"kubernetes.io/secret/91595c8f-09e8-4cdd-8054-1f46eafa27ad-webhook-certs\") pod \"openstack-operator-controller-manager-5fbcdbcf94-6sdhq\" (UID: \"91595c8f-09e8-4cdd-8054-1f46eafa27ad\") " pod="openstack-operators/openstack-operator-controller-manager-5fbcdbcf94-6sdhq" Mar 16 15:47:51 crc kubenswrapper[5120]: E0316 15:47:51.789725 5120 secret.go:189] Couldn't get secret openstack-operators/metrics-server-cert: secret "metrics-server-cert" not found Mar 16 15:47:51 crc kubenswrapper[5120]: E0316 15:47:51.790297 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91595c8f-09e8-4cdd-8054-1f46eafa27ad-metrics-certs podName:91595c8f-09e8-4cdd-8054-1f46eafa27ad nodeName:}" failed. No retries permitted until 2026-03-16 15:47:55.790268728 +0000 UTC m=+977.944200385 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/91595c8f-09e8-4cdd-8054-1f46eafa27ad-metrics-certs") pod "openstack-operator-controller-manager-5fbcdbcf94-6sdhq" (UID: "91595c8f-09e8-4cdd-8054-1f46eafa27ad") : secret "metrics-server-cert" not found Mar 16 15:47:51 crc kubenswrapper[5120]: E0316 15:47:51.790153 5120 secret.go:189] Couldn't get secret openstack-operators/webhook-server-cert: secret "webhook-server-cert" not found Mar 16 15:47:51 crc kubenswrapper[5120]: E0316 15:47:51.790392 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91595c8f-09e8-4cdd-8054-1f46eafa27ad-webhook-certs podName:91595c8f-09e8-4cdd-8054-1f46eafa27ad nodeName:}" failed. No retries permitted until 2026-03-16 15:47:55.79036892 +0000 UTC m=+977.944300577 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "webhook-certs" (UniqueName: "kubernetes.io/secret/91595c8f-09e8-4cdd-8054-1f46eafa27ad-webhook-certs") pod "openstack-operator-controller-manager-5fbcdbcf94-6sdhq" (UID: "91595c8f-09e8-4cdd-8054-1f46eafa27ad") : secret "webhook-server-cert" not found Mar 16 15:47:52 crc kubenswrapper[5120]: I0316 15:47:52.008017 5120 patch_prober.go:28] interesting pod/machine-config-daemon-7bf76 container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 15:47:52 crc kubenswrapper[5120]: I0316 15:47:52.008077 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 15:47:55 crc kubenswrapper[5120]: I0316 15:47:55.347067 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/797f2c96-18c7-400b-a46d-795da852b08e-cert\") pod \"infra-operator-controller-manager-76f8b7ddbd-nvwr5\" (UID: \"797f2c96-18c7-400b-a46d-795da852b08e\") " pod="openstack-operators/infra-operator-controller-manager-76f8b7ddbd-nvwr5" Mar 16 15:47:55 crc kubenswrapper[5120]: E0316 15:47:55.347272 5120 secret.go:189] Couldn't get secret openstack-operators/infra-operator-webhook-server-cert: secret "infra-operator-webhook-server-cert" not found Mar 16 15:47:55 crc kubenswrapper[5120]: E0316 15:47:55.347660 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/797f2c96-18c7-400b-a46d-795da852b08e-cert podName:797f2c96-18c7-400b-a46d-795da852b08e nodeName:}" failed. No retries permitted until 2026-03-16 15:48:03.347638056 +0000 UTC m=+985.501569723 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/797f2c96-18c7-400b-a46d-795da852b08e-cert") pod "infra-operator-controller-manager-76f8b7ddbd-nvwr5" (UID: "797f2c96-18c7-400b-a46d-795da852b08e") : secret "infra-operator-webhook-server-cert" not found Mar 16 15:47:55 crc kubenswrapper[5120]: I0316 15:47:55.551410 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8643ed10-e4fd-4b97-ae36-c4b581cdef1b-cert\") pod \"openstack-baremetal-operator-controller-manager-6b6ddbc599g848w\" (UID: \"8643ed10-e4fd-4b97-ae36-c4b581cdef1b\") " pod="openstack-operators/openstack-baremetal-operator-controller-manager-6b6ddbc599g848w" Mar 16 15:47:55 crc kubenswrapper[5120]: E0316 15:47:55.551569 5120 secret.go:189] Couldn't get secret openstack-operators/openstack-baremetal-operator-webhook-server-cert: secret "openstack-baremetal-operator-webhook-server-cert" not found Mar 16 15:47:55 crc kubenswrapper[5120]: E0316 15:47:55.551680 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8643ed10-e4fd-4b97-ae36-c4b581cdef1b-cert podName:8643ed10-e4fd-4b97-ae36-c4b581cdef1b nodeName:}" failed. No retries permitted until 2026-03-16 15:48:03.551663597 +0000 UTC m=+985.705595254 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8643ed10-e4fd-4b97-ae36-c4b581cdef1b-cert") pod "openstack-baremetal-operator-controller-manager-6b6ddbc599g848w" (UID: "8643ed10-e4fd-4b97-ae36-c4b581cdef1b") : secret "openstack-baremetal-operator-webhook-server-cert" not found Mar 16 15:47:55 crc kubenswrapper[5120]: I0316 15:47:55.855550 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/91595c8f-09e8-4cdd-8054-1f46eafa27ad-metrics-certs\") pod \"openstack-operator-controller-manager-5fbcdbcf94-6sdhq\" (UID: \"91595c8f-09e8-4cdd-8054-1f46eafa27ad\") " pod="openstack-operators/openstack-operator-controller-manager-5fbcdbcf94-6sdhq" Mar 16 15:47:55 crc kubenswrapper[5120]: I0316 15:47:55.855623 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-certs\" (UniqueName: \"kubernetes.io/secret/91595c8f-09e8-4cdd-8054-1f46eafa27ad-webhook-certs\") pod \"openstack-operator-controller-manager-5fbcdbcf94-6sdhq\" (UID: \"91595c8f-09e8-4cdd-8054-1f46eafa27ad\") " pod="openstack-operators/openstack-operator-controller-manager-5fbcdbcf94-6sdhq" Mar 16 15:47:55 crc kubenswrapper[5120]: E0316 15:47:55.855753 5120 secret.go:189] Couldn't get secret openstack-operators/metrics-server-cert: secret "metrics-server-cert" not found Mar 16 15:47:55 crc kubenswrapper[5120]: E0316 15:47:55.855840 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91595c8f-09e8-4cdd-8054-1f46eafa27ad-metrics-certs podName:91595c8f-09e8-4cdd-8054-1f46eafa27ad nodeName:}" failed. No retries permitted until 2026-03-16 15:48:03.855819693 +0000 UTC m=+986.009751350 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/91595c8f-09e8-4cdd-8054-1f46eafa27ad-metrics-certs") pod "openstack-operator-controller-manager-5fbcdbcf94-6sdhq" (UID: "91595c8f-09e8-4cdd-8054-1f46eafa27ad") : secret "metrics-server-cert" not found Mar 16 15:47:55 crc kubenswrapper[5120]: E0316 15:47:55.855882 5120 secret.go:189] Couldn't get secret openstack-operators/webhook-server-cert: secret "webhook-server-cert" not found Mar 16 15:47:55 crc kubenswrapper[5120]: E0316 15:47:55.855965 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91595c8f-09e8-4cdd-8054-1f46eafa27ad-webhook-certs podName:91595c8f-09e8-4cdd-8054-1f46eafa27ad nodeName:}" failed. No retries permitted until 2026-03-16 15:48:03.855948946 +0000 UTC m=+986.009880603 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "webhook-certs" (UniqueName: "kubernetes.io/secret/91595c8f-09e8-4cdd-8054-1f46eafa27ad-webhook-certs") pod "openstack-operator-controller-manager-5fbcdbcf94-6sdhq" (UID: "91595c8f-09e8-4cdd-8054-1f46eafa27ad") : secret "webhook-server-cert" not found Mar 16 15:48:00 crc kubenswrapper[5120]: I0316 15:48:00.125837 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-infra/auto-csr-approver-29561268-lkp5k"] Mar 16 15:48:00 crc kubenswrapper[5120]: I0316 15:48:00.200663 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561268-lkp5k"] Mar 16 15:48:00 crc kubenswrapper[5120]: I0316 15:48:00.200834 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561268-lkp5k" Mar 16 15:48:00 crc kubenswrapper[5120]: I0316 15:48:00.203424 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-infra\"/\"csr-approver-sa-dockercfg-x2nsz\"" Mar 16 15:48:00 crc kubenswrapper[5120]: I0316 15:48:00.204032 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"openshift-service-ca.crt\"" Mar 16 15:48:00 crc kubenswrapper[5120]: I0316 15:48:00.204069 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"kube-root-ca.crt\"" Mar 16 15:48:00 crc kubenswrapper[5120]: I0316 15:48:00.329026 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xc24\" (UniqueName: \"kubernetes.io/projected/84ee794e-ebaa-4097-8cad-384c073a2d2e-kube-api-access-4xc24\") pod \"auto-csr-approver-29561268-lkp5k\" (UID: \"84ee794e-ebaa-4097-8cad-384c073a2d2e\") " pod="openshift-infra/auto-csr-approver-29561268-lkp5k" Mar 16 15:48:00 crc kubenswrapper[5120]: I0316 15:48:00.431394 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4xc24\" (UniqueName: \"kubernetes.io/projected/84ee794e-ebaa-4097-8cad-384c073a2d2e-kube-api-access-4xc24\") pod \"auto-csr-approver-29561268-lkp5k\" (UID: \"84ee794e-ebaa-4097-8cad-384c073a2d2e\") " pod="openshift-infra/auto-csr-approver-29561268-lkp5k" Mar 16 15:48:00 crc kubenswrapper[5120]: I0316 15:48:00.459896 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xc24\" (UniqueName: \"kubernetes.io/projected/84ee794e-ebaa-4097-8cad-384c073a2d2e-kube-api-access-4xc24\") pod \"auto-csr-approver-29561268-lkp5k\" (UID: \"84ee794e-ebaa-4097-8cad-384c073a2d2e\") " pod="openshift-infra/auto-csr-approver-29561268-lkp5k" Mar 16 15:48:00 crc kubenswrapper[5120]: I0316 15:48:00.521079 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561268-lkp5k" Mar 16 15:48:03 crc kubenswrapper[5120]: I0316 15:48:03.385719 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/797f2c96-18c7-400b-a46d-795da852b08e-cert\") pod \"infra-operator-controller-manager-76f8b7ddbd-nvwr5\" (UID: \"797f2c96-18c7-400b-a46d-795da852b08e\") " pod="openstack-operators/infra-operator-controller-manager-76f8b7ddbd-nvwr5" Mar 16 15:48:03 crc kubenswrapper[5120]: E0316 15:48:03.386359 5120 secret.go:189] Couldn't get secret openstack-operators/infra-operator-webhook-server-cert: secret "infra-operator-webhook-server-cert" not found Mar 16 15:48:03 crc kubenswrapper[5120]: E0316 15:48:03.386446 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/797f2c96-18c7-400b-a46d-795da852b08e-cert podName:797f2c96-18c7-400b-a46d-795da852b08e nodeName:}" failed. No retries permitted until 2026-03-16 15:48:19.386428849 +0000 UTC m=+1001.540360506 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/797f2c96-18c7-400b-a46d-795da852b08e-cert") pod "infra-operator-controller-manager-76f8b7ddbd-nvwr5" (UID: "797f2c96-18c7-400b-a46d-795da852b08e") : secret "infra-operator-webhook-server-cert" not found Mar 16 15:48:03 crc kubenswrapper[5120]: I0316 15:48:03.588813 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8643ed10-e4fd-4b97-ae36-c4b581cdef1b-cert\") pod \"openstack-baremetal-operator-controller-manager-6b6ddbc599g848w\" (UID: \"8643ed10-e4fd-4b97-ae36-c4b581cdef1b\") " pod="openstack-operators/openstack-baremetal-operator-controller-manager-6b6ddbc599g848w" Mar 16 15:48:03 crc kubenswrapper[5120]: I0316 15:48:03.599696 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8643ed10-e4fd-4b97-ae36-c4b581cdef1b-cert\") pod \"openstack-baremetal-operator-controller-manager-6b6ddbc599g848w\" (UID: \"8643ed10-e4fd-4b97-ae36-c4b581cdef1b\") " pod="openstack-operators/openstack-baremetal-operator-controller-manager-6b6ddbc599g848w" Mar 16 15:48:03 crc kubenswrapper[5120]: I0316 15:48:03.653634 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/openstack-baremetal-operator-controller-manager-6b6ddbc599g848w" Mar 16 15:48:03 crc kubenswrapper[5120]: I0316 15:48:03.742825 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561268-lkp5k"] Mar 16 15:48:03 crc kubenswrapper[5120]: I0316 15:48:03.893580 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/91595c8f-09e8-4cdd-8054-1f46eafa27ad-metrics-certs\") pod \"openstack-operator-controller-manager-5fbcdbcf94-6sdhq\" (UID: \"91595c8f-09e8-4cdd-8054-1f46eafa27ad\") " pod="openstack-operators/openstack-operator-controller-manager-5fbcdbcf94-6sdhq" Mar 16 15:48:03 crc kubenswrapper[5120]: I0316 15:48:03.893625 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-certs\" (UniqueName: \"kubernetes.io/secret/91595c8f-09e8-4cdd-8054-1f46eafa27ad-webhook-certs\") pod \"openstack-operator-controller-manager-5fbcdbcf94-6sdhq\" (UID: \"91595c8f-09e8-4cdd-8054-1f46eafa27ad\") " pod="openstack-operators/openstack-operator-controller-manager-5fbcdbcf94-6sdhq" Mar 16 15:48:03 crc kubenswrapper[5120]: E0316 15:48:03.893780 5120 secret.go:189] Couldn't get secret openstack-operators/webhook-server-cert: secret "webhook-server-cert" not found Mar 16 15:48:03 crc kubenswrapper[5120]: E0316 15:48:03.893855 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91595c8f-09e8-4cdd-8054-1f46eafa27ad-webhook-certs podName:91595c8f-09e8-4cdd-8054-1f46eafa27ad nodeName:}" failed. No retries permitted until 2026-03-16 15:48:19.893836174 +0000 UTC m=+1002.047767831 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "webhook-certs" (UniqueName: "kubernetes.io/secret/91595c8f-09e8-4cdd-8054-1f46eafa27ad-webhook-certs") pod "openstack-operator-controller-manager-5fbcdbcf94-6sdhq" (UID: "91595c8f-09e8-4cdd-8054-1f46eafa27ad") : secret "webhook-server-cert" not found Mar 16 15:48:03 crc kubenswrapper[5120]: I0316 15:48:03.903546 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/91595c8f-09e8-4cdd-8054-1f46eafa27ad-metrics-certs\") pod \"openstack-operator-controller-manager-5fbcdbcf94-6sdhq\" (UID: \"91595c8f-09e8-4cdd-8054-1f46eafa27ad\") " pod="openstack-operators/openstack-operator-controller-manager-5fbcdbcf94-6sdhq" Mar 16 15:48:04 crc kubenswrapper[5120]: I0316 15:48:04.091555 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/mariadb-operator-controller-manager-5748db694b-nk2nc" event={"ID":"8a11dd5a-29d6-4791-849c-97b08acb5b4e","Type":"ContainerStarted","Data":"1de87f8609842e9f047525b572c69ce524ffb562d47c0be7de1674db25e09051"} Mar 16 15:48:04 crc kubenswrapper[5120]: I0316 15:48:04.092891 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-operators/mariadb-operator-controller-manager-5748db694b-nk2nc" Mar 16 15:48:04 crc kubenswrapper[5120]: I0316 15:48:04.106079 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/telemetry-operator-controller-manager-f5cf7fcb7-cmrwq" event={"ID":"201aeec6-1404-4b8d-8cf7-4d2550cc9898","Type":"ContainerStarted","Data":"9400626ed96f9196ac2177fe5b97b2f99a23d54b8aba032cd07a65b4fa62261b"} Mar 16 15:48:04 crc kubenswrapper[5120]: I0316 15:48:04.106713 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-operators/telemetry-operator-controller-manager-f5cf7fcb7-cmrwq" Mar 16 15:48:04 crc kubenswrapper[5120]: I0316 15:48:04.113018 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/octavia-operator-controller-manager-7b89675745-5vg74" event={"ID":"bbc9f690-e60b-4c8a-b84a-2d8a3ca2001f","Type":"ContainerStarted","Data":"4dcde05605706042f7e10545568428ec80e8abcb93a4246f1298c6443f160ec6"} Mar 16 15:48:04 crc kubenswrapper[5120]: I0316 15:48:04.114892 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-operators/octavia-operator-controller-manager-7b89675745-5vg74" Mar 16 15:48:04 crc kubenswrapper[5120]: I0316 15:48:04.132051 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/cinder-operator-controller-manager-55bc8cdcc4-sbtk9" event={"ID":"ed2165fd-95f2-40f7-a860-70b81d6ab977","Type":"ContainerStarted","Data":"5e696788c3a844d4ec752d5af523e578b1132a27c237c44a42ed0f439f974a09"} Mar 16 15:48:04 crc kubenswrapper[5120]: I0316 15:48:04.132699 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-operators/cinder-operator-controller-manager-55bc8cdcc4-sbtk9" Mar 16 15:48:04 crc kubenswrapper[5120]: I0316 15:48:04.153661 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/ovn-operator-controller-manager-6fb6cd45c4-ln28h" event={"ID":"8e6d8ae5-f5be-4b12-8401-54dcc86da579","Type":"ContainerStarted","Data":"c9f555dc35319e5a738060a949804e12a57019848919f048fb0a5dd0a7b73fc6"} Mar 16 15:48:04 crc kubenswrapper[5120]: I0316 15:48:04.154440 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-operators/ovn-operator-controller-manager-6fb6cd45c4-ln28h" Mar 16 15:48:04 crc kubenswrapper[5120]: I0316 15:48:04.170056 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/heat-operator-controller-manager-79975d4c95-n2zm7" event={"ID":"4752ce4e-0b7c-43d7-99dc-b8633f7a2cd7","Type":"ContainerStarted","Data":"cd5dbf07e769c93af8e2f9b7a8af06cf9287e9e82f2b76fb7904536eefed6823"} Mar 16 15:48:04 crc kubenswrapper[5120]: I0316 15:48:04.170853 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-operators/heat-operator-controller-manager-79975d4c95-n2zm7" Mar 16 15:48:04 crc kubenswrapper[5120]: I0316 15:48:04.188329 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/mariadb-operator-controller-manager-5748db694b-nk2nc" podStartSLOduration=3.194502876 podStartE2EDuration="17.18830718s" podCreationTimestamp="2026-03-16 15:47:47 +0000 UTC" firstStartedPulling="2026-03-16 15:47:49.197258284 +0000 UTC m=+971.351189941" lastFinishedPulling="2026-03-16 15:48:03.191062578 +0000 UTC m=+985.344994245" observedRunningTime="2026-03-16 15:48:04.172949342 +0000 UTC m=+986.326880999" watchObservedRunningTime="2026-03-16 15:48:04.18830718 +0000 UTC m=+986.342238837" Mar 16 15:48:04 crc kubenswrapper[5120]: I0316 15:48:04.234117 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/keystone-operator-controller-manager-6f5b9fd59-rhjb2" event={"ID":"f5403564-ecbf-4103-89b6-530a8381c664","Type":"ContainerStarted","Data":"74b759d17c7d6bc10253b03d120e87e3c039046a6d9f3afc93394d3573e3b4bb"} Mar 16 15:48:04 crc kubenswrapper[5120]: I0316 15:48:04.234875 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-operators/keystone-operator-controller-manager-6f5b9fd59-rhjb2" Mar 16 15:48:04 crc kubenswrapper[5120]: I0316 15:48:04.237081 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/horizon-operator-controller-manager-5bf9fb4564-qzsbr" event={"ID":"e6b6caa5-b1c3-4ad6-8b0e-0358400bb03b","Type":"ContainerStarted","Data":"163918bdf98d1c1c3ca79246758fb544bcb919c9ecb8c47189928bbe3245b4d6"} Mar 16 15:48:04 crc kubenswrapper[5120]: I0316 15:48:04.237765 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-operators/horizon-operator-controller-manager-5bf9fb4564-qzsbr" Mar 16 15:48:04 crc kubenswrapper[5120]: I0316 15:48:04.254244 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/rabbitmq-cluster-operator-manager-85d9b55b6-tfl54" event={"ID":"d2d3e713-eefd-44fd-8784-1f4f54155d8f","Type":"ContainerStarted","Data":"ba2d7e8fb80dd5f1cea3845025bb460e85d914e39fff650768c91d758e0cb42f"} Mar 16 15:48:04 crc kubenswrapper[5120]: I0316 15:48:04.262070 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/ironic-operator-controller-manager-997698bf9-6zvjn" event={"ID":"42478fad-5a61-4cc1-94cc-ac00bdf30f24","Type":"ContainerStarted","Data":"636f4788fa12f348f3f6e38ef9f3f32d17f195054394d6d4eac0b62afd8629f5"} Mar 16 15:48:04 crc kubenswrapper[5120]: I0316 15:48:04.262801 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-operators/ironic-operator-controller-manager-997698bf9-6zvjn" Mar 16 15:48:04 crc kubenswrapper[5120]: I0316 15:48:04.279072 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/glance-operator-controller-manager-58d9bbd8cc-vhvn5" event={"ID":"e918c50c-96eb-4da3-9b1d-fc31e3582816","Type":"ContainerStarted","Data":"2bea00861ef023a301ed304c08762de77012ab04460a060088be7e7f197b34d7"} Mar 16 15:48:04 crc kubenswrapper[5120]: I0316 15:48:04.279118 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-operators/glance-operator-controller-manager-58d9bbd8cc-vhvn5" Mar 16 15:48:04 crc kubenswrapper[5120]: I0316 15:48:04.293065 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/nova-operator-controller-manager-785d77464d-j7x9r" event={"ID":"66faede0-c074-49ca-8bf9-9b5777b02edf","Type":"ContainerStarted","Data":"3d5c918342f57ab22227d88adb1cfa9c0d01d92b66766ac6cdb7212a18358892"} Mar 16 15:48:04 crc kubenswrapper[5120]: I0316 15:48:04.293878 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-operators/nova-operator-controller-manager-785d77464d-j7x9r" Mar 16 15:48:04 crc kubenswrapper[5120]: I0316 15:48:04.315049 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561268-lkp5k" event={"ID":"84ee794e-ebaa-4097-8cad-384c073a2d2e","Type":"ContainerStarted","Data":"204f16f5574ade05a069703dc195b4afab125e9d9c2f7c2a1df7ca9dccadfc91"} Mar 16 15:48:04 crc kubenswrapper[5120]: I0316 15:48:04.318954 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/openstack-baremetal-operator-controller-manager-6b6ddbc599g848w"] Mar 16 15:48:04 crc kubenswrapper[5120]: I0316 15:48:04.321257 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/neutron-operator-controller-manager-75c6f4bc76-mbnvj" event={"ID":"32fa740c-28b3-42a7-8ab5-6d159c237bf8","Type":"ContainerStarted","Data":"8187984f8e77140a5f3d80b9a1039d239792a6246d38550200214f8daab0f7ca"} Mar 16 15:48:04 crc kubenswrapper[5120]: I0316 15:48:04.321598 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/telemetry-operator-controller-manager-f5cf7fcb7-cmrwq" podStartSLOduration=3.379412706 podStartE2EDuration="17.321588298s" podCreationTimestamp="2026-03-16 15:47:47 +0000 UTC" firstStartedPulling="2026-03-16 15:47:49.228808386 +0000 UTC m=+971.382740043" lastFinishedPulling="2026-03-16 15:48:03.170983968 +0000 UTC m=+985.324915635" observedRunningTime="2026-03-16 15:48:04.303567715 +0000 UTC m=+986.457499382" watchObservedRunningTime="2026-03-16 15:48:04.321588298 +0000 UTC m=+986.475519955" Mar 16 15:48:04 crc kubenswrapper[5120]: I0316 15:48:04.321888 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-operators/neutron-operator-controller-manager-75c6f4bc76-mbnvj" Mar 16 15:48:04 crc kubenswrapper[5120]: I0316 15:48:04.369490 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/manila-operator-controller-manager-7d6d87b867-xkrnl" event={"ID":"eed7b084-3ca6-41c0-847f-19929fb52c41","Type":"ContainerStarted","Data":"76b28721686f76aade4349039a79bd66bf48c80868031b23a4b84de5420eca6a"} Mar 16 15:48:04 crc kubenswrapper[5120]: I0316 15:48:04.370211 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-operators/manila-operator-controller-manager-7d6d87b867-xkrnl" Mar 16 15:48:04 crc kubenswrapper[5120]: I0316 15:48:04.481939 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/octavia-operator-controller-manager-7b89675745-5vg74" podStartSLOduration=3.490339504 podStartE2EDuration="17.481925241s" podCreationTimestamp="2026-03-16 15:47:47 +0000 UTC" firstStartedPulling="2026-03-16 15:47:49.199682648 +0000 UTC m=+971.353614305" lastFinishedPulling="2026-03-16 15:48:03.191268345 +0000 UTC m=+985.345200042" observedRunningTime="2026-03-16 15:48:04.480745509 +0000 UTC m=+986.634677166" watchObservedRunningTime="2026-03-16 15:48:04.481925241 +0000 UTC m=+986.635856898" Mar 16 15:48:04 crc kubenswrapper[5120]: I0316 15:48:04.484857 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/heat-operator-controller-manager-79975d4c95-n2zm7" podStartSLOduration=2.733495222 podStartE2EDuration="17.484846093s" podCreationTimestamp="2026-03-16 15:47:47 +0000 UTC" firstStartedPulling="2026-03-16 15:47:48.419689259 +0000 UTC m=+970.573620916" lastFinishedPulling="2026-03-16 15:48:03.17104012 +0000 UTC m=+985.324971787" observedRunningTime="2026-03-16 15:48:04.38761805 +0000 UTC m=+986.541549707" watchObservedRunningTime="2026-03-16 15:48:04.484846093 +0000 UTC m=+986.638777750" Mar 16 15:48:04 crc kubenswrapper[5120]: I0316 15:48:04.613534 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/cinder-operator-controller-manager-55bc8cdcc4-sbtk9" podStartSLOduration=3.493817723 podStartE2EDuration="17.613502151s" podCreationTimestamp="2026-03-16 15:47:47 +0000 UTC" firstStartedPulling="2026-03-16 15:47:48.432251291 +0000 UTC m=+970.586182948" lastFinishedPulling="2026-03-16 15:48:02.551935719 +0000 UTC m=+984.705867376" observedRunningTime="2026-03-16 15:48:04.555550175 +0000 UTC m=+986.709481832" watchObservedRunningTime="2026-03-16 15:48:04.613502151 +0000 UTC m=+986.767433808" Mar 16 15:48:04 crc kubenswrapper[5120]: I0316 15:48:04.651539 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/keystone-operator-controller-manager-6f5b9fd59-rhjb2" podStartSLOduration=3.647182983 podStartE2EDuration="17.651503992s" podCreationTimestamp="2026-03-16 15:47:47 +0000 UTC" firstStartedPulling="2026-03-16 15:47:49.224337938 +0000 UTC m=+971.378269595" lastFinishedPulling="2026-03-16 15:48:03.228658937 +0000 UTC m=+985.382590604" observedRunningTime="2026-03-16 15:48:04.642307935 +0000 UTC m=+986.796239592" watchObservedRunningTime="2026-03-16 15:48:04.651503992 +0000 UTC m=+986.805435649" Mar 16 15:48:04 crc kubenswrapper[5120]: I0316 15:48:04.653920 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/ovn-operator-controller-manager-6fb6cd45c4-ln28h" podStartSLOduration=3.679131617 podStartE2EDuration="17.653913959s" podCreationTimestamp="2026-03-16 15:47:47 +0000 UTC" firstStartedPulling="2026-03-16 15:47:49.196160565 +0000 UTC m=+971.350092222" lastFinishedPulling="2026-03-16 15:48:03.170942897 +0000 UTC m=+985.324874564" observedRunningTime="2026-03-16 15:48:04.615024374 +0000 UTC m=+986.768956031" watchObservedRunningTime="2026-03-16 15:48:04.653913959 +0000 UTC m=+986.807845616" Mar 16 15:48:04 crc kubenswrapper[5120]: I0316 15:48:04.675459 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/ironic-operator-controller-manager-997698bf9-6zvjn" podStartSLOduration=3.8325367740000003 podStartE2EDuration="17.67544572s" podCreationTimestamp="2026-03-16 15:47:47 +0000 UTC" firstStartedPulling="2026-03-16 15:47:48.709054983 +0000 UTC m=+970.862986640" lastFinishedPulling="2026-03-16 15:48:02.551963929 +0000 UTC m=+984.705895586" observedRunningTime="2026-03-16 15:48:04.670829051 +0000 UTC m=+986.824760708" watchObservedRunningTime="2026-03-16 15:48:04.67544572 +0000 UTC m=+986.829377377" Mar 16 15:48:04 crc kubenswrapper[5120]: I0316 15:48:04.712073 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/rabbitmq-cluster-operator-manager-85d9b55b6-tfl54" podStartSLOduration=2.707170154 podStartE2EDuration="16.712059081s" podCreationTimestamp="2026-03-16 15:47:48 +0000 UTC" firstStartedPulling="2026-03-16 15:47:49.23805991 +0000 UTC m=+971.391991567" lastFinishedPulling="2026-03-16 15:48:03.242948837 +0000 UTC m=+985.396880494" observedRunningTime="2026-03-16 15:48:04.708391009 +0000 UTC m=+986.862322666" watchObservedRunningTime="2026-03-16 15:48:04.712059081 +0000 UTC m=+986.865990738" Mar 16 15:48:04 crc kubenswrapper[5120]: I0316 15:48:04.744317 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/nova-operator-controller-manager-785d77464d-j7x9r" podStartSLOduration=3.717974431 podStartE2EDuration="17.744290091s" podCreationTimestamp="2026-03-16 15:47:47 +0000 UTC" firstStartedPulling="2026-03-16 15:47:49.216533413 +0000 UTC m=+971.370465070" lastFinishedPulling="2026-03-16 15:48:03.242849053 +0000 UTC m=+985.396780730" observedRunningTime="2026-03-16 15:48:04.73854235 +0000 UTC m=+986.892474027" watchObservedRunningTime="2026-03-16 15:48:04.744290091 +0000 UTC m=+986.898221748" Mar 16 15:48:04 crc kubenswrapper[5120]: I0316 15:48:04.767222 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/neutron-operator-controller-manager-75c6f4bc76-mbnvj" podStartSLOduration=3.835179703 podStartE2EDuration="17.767200499s" podCreationTimestamp="2026-03-16 15:47:47 +0000 UTC" firstStartedPulling="2026-03-16 15:47:49.220562499 +0000 UTC m=+971.374494156" lastFinishedPulling="2026-03-16 15:48:03.152583255 +0000 UTC m=+985.306514952" observedRunningTime="2026-03-16 15:48:04.765558584 +0000 UTC m=+986.919490261" watchObservedRunningTime="2026-03-16 15:48:04.767200499 +0000 UTC m=+986.921132156" Mar 16 15:48:04 crc kubenswrapper[5120]: I0316 15:48:04.783346 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/manila-operator-controller-manager-7d6d87b867-xkrnl" podStartSLOduration=3.8205879449999998 podStartE2EDuration="17.78333204s" podCreationTimestamp="2026-03-16 15:47:47 +0000 UTC" firstStartedPulling="2026-03-16 15:47:49.228255612 +0000 UTC m=+971.382187269" lastFinishedPulling="2026-03-16 15:48:03.190999697 +0000 UTC m=+985.344931364" observedRunningTime="2026-03-16 15:48:04.780714247 +0000 UTC m=+986.934645904" watchObservedRunningTime="2026-03-16 15:48:04.78333204 +0000 UTC m=+986.937263697" Mar 16 15:48:04 crc kubenswrapper[5120]: I0316 15:48:04.844228 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/horizon-operator-controller-manager-5bf9fb4564-qzsbr" podStartSLOduration=3.387291849 podStartE2EDuration="17.844213678s" podCreationTimestamp="2026-03-16 15:47:47 +0000 UTC" firstStartedPulling="2026-03-16 15:47:48.697782196 +0000 UTC m=+970.851713843" lastFinishedPulling="2026-03-16 15:48:03.154704005 +0000 UTC m=+985.308635672" observedRunningTime="2026-03-16 15:48:04.841138522 +0000 UTC m=+986.995070179" watchObservedRunningTime="2026-03-16 15:48:04.844213678 +0000 UTC m=+986.998145335" Mar 16 15:48:04 crc kubenswrapper[5120]: I0316 15:48:04.847861 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/glance-operator-controller-manager-58d9bbd8cc-vhvn5" podStartSLOduration=3.20995413 podStartE2EDuration="17.84785128s" podCreationTimestamp="2026-03-16 15:47:47 +0000 UTC" firstStartedPulling="2026-03-16 15:47:48.514693275 +0000 UTC m=+970.668624932" lastFinishedPulling="2026-03-16 15:48:03.152590415 +0000 UTC m=+985.306522082" observedRunningTime="2026-03-16 15:48:04.814261653 +0000 UTC m=+986.968193310" watchObservedRunningTime="2026-03-16 15:48:04.84785128 +0000 UTC m=+987.001782937" Mar 16 15:48:05 crc kubenswrapper[5120]: I0316 15:48:05.382949 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/openstack-baremetal-operator-controller-manager-6b6ddbc599g848w" event={"ID":"8643ed10-e4fd-4b97-ae36-c4b581cdef1b","Type":"ContainerStarted","Data":"2815432f0b822e87afdfa332f825a21eff527b5290ed2f089d9cf540302312bc"} Mar 16 15:48:08 crc kubenswrapper[5120]: I0316 15:48:08.083671 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/manila-operator-controller-manager-7d6d87b867-xkrnl" Mar 16 15:48:08 crc kubenswrapper[5120]: I0316 15:48:08.086969 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/mariadb-operator-controller-manager-5748db694b-nk2nc" Mar 16 15:48:08 crc kubenswrapper[5120]: I0316 15:48:08.087368 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/keystone-operator-controller-manager-6f5b9fd59-rhjb2" Mar 16 15:48:08 crc kubenswrapper[5120]: I0316 15:48:08.087656 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/cinder-operator-controller-manager-55bc8cdcc4-sbtk9" Mar 16 15:48:08 crc kubenswrapper[5120]: I0316 15:48:08.089585 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/ironic-operator-controller-manager-997698bf9-6zvjn" Mar 16 15:48:08 crc kubenswrapper[5120]: I0316 15:48:08.089639 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/nova-operator-controller-manager-785d77464d-j7x9r" Mar 16 15:48:08 crc kubenswrapper[5120]: I0316 15:48:08.093132 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/ovn-operator-controller-manager-6fb6cd45c4-ln28h" Mar 16 15:48:08 crc kubenswrapper[5120]: I0316 15:48:08.096212 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/telemetry-operator-controller-manager-f5cf7fcb7-cmrwq" Mar 16 15:48:08 crc kubenswrapper[5120]: I0316 15:48:08.096256 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/horizon-operator-controller-manager-5bf9fb4564-qzsbr" Mar 16 15:48:08 crc kubenswrapper[5120]: I0316 15:48:08.099826 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/neutron-operator-controller-manager-75c6f4bc76-mbnvj" Mar 16 15:48:08 crc kubenswrapper[5120]: I0316 15:48:08.099911 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/heat-operator-controller-manager-79975d4c95-n2zm7" Mar 16 15:48:09 crc kubenswrapper[5120]: E0316 15:48:09.478400 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1147230 actualBytes=10240 Mar 16 15:48:11 crc kubenswrapper[5120]: I0316 15:48:11.095024 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561268-lkp5k" event={"ID":"84ee794e-ebaa-4097-8cad-384c073a2d2e","Type":"ContainerStarted","Data":"c6e88f8b1a915c86c4e97784263497ed84ab31ee4f26b9026a67cd537114ca43"} Mar 16 15:48:11 crc kubenswrapper[5120]: I0316 15:48:11.114532 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-infra/auto-csr-approver-29561268-lkp5k" podStartSLOduration=5.121054501 podStartE2EDuration="11.114509734s" podCreationTimestamp="2026-03-16 15:48:00 +0000 UTC" firstStartedPulling="2026-03-16 15:48:03.778184288 +0000 UTC m=+985.932115945" lastFinishedPulling="2026-03-16 15:48:09.771639511 +0000 UTC m=+991.925571178" observedRunningTime="2026-03-16 15:48:11.106357898 +0000 UTC m=+993.260289555" watchObservedRunningTime="2026-03-16 15:48:11.114509734 +0000 UTC m=+993.268441411" Mar 16 15:48:12 crc kubenswrapper[5120]: I0316 15:48:12.109693 5120 generic.go:358] "Generic (PLEG): container finished" podID="84ee794e-ebaa-4097-8cad-384c073a2d2e" containerID="c6e88f8b1a915c86c4e97784263497ed84ab31ee4f26b9026a67cd537114ca43" exitCode=0 Mar 16 15:48:12 crc kubenswrapper[5120]: I0316 15:48:12.110148 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561268-lkp5k" event={"ID":"84ee794e-ebaa-4097-8cad-384c073a2d2e","Type":"ContainerDied","Data":"c6e88f8b1a915c86c4e97784263497ed84ab31ee4f26b9026a67cd537114ca43"} Mar 16 15:48:14 crc kubenswrapper[5120]: I0316 15:48:14.833132 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561268-lkp5k" Mar 16 15:48:14 crc kubenswrapper[5120]: I0316 15:48:14.925314 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4xc24\" (UniqueName: \"kubernetes.io/projected/84ee794e-ebaa-4097-8cad-384c073a2d2e-kube-api-access-4xc24\") pod \"84ee794e-ebaa-4097-8cad-384c073a2d2e\" (UID: \"84ee794e-ebaa-4097-8cad-384c073a2d2e\") " Mar 16 15:48:14 crc kubenswrapper[5120]: I0316 15:48:14.935653 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84ee794e-ebaa-4097-8cad-384c073a2d2e-kube-api-access-4xc24" (OuterVolumeSpecName: "kube-api-access-4xc24") pod "84ee794e-ebaa-4097-8cad-384c073a2d2e" (UID: "84ee794e-ebaa-4097-8cad-384c073a2d2e"). InnerVolumeSpecName "kube-api-access-4xc24". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:48:15 crc kubenswrapper[5120]: I0316 15:48:15.026393 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4xc24\" (UniqueName: \"kubernetes.io/projected/84ee794e-ebaa-4097-8cad-384c073a2d2e-kube-api-access-4xc24\") on node \"crc\" DevicePath \"\"" Mar 16 15:48:15 crc kubenswrapper[5120]: I0316 15:48:15.136093 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/designate-operator-controller-manager-7cf89c67bb-cjd7x" event={"ID":"2fc99f04-8366-4f00-9ce1-d0e4faf1d0a3","Type":"ContainerStarted","Data":"1c41db9773336db87d587462f8cb97f5de96f1b4f579e3d8052b9a13bad57ded"} Mar 16 15:48:15 crc kubenswrapper[5120]: I0316 15:48:15.136373 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-operators/designate-operator-controller-manager-7cf89c67bb-cjd7x" Mar 16 15:48:15 crc kubenswrapper[5120]: I0316 15:48:15.140169 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561268-lkp5k" Mar 16 15:48:15 crc kubenswrapper[5120]: I0316 15:48:15.140166 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561268-lkp5k" event={"ID":"84ee794e-ebaa-4097-8cad-384c073a2d2e","Type":"ContainerDied","Data":"204f16f5574ade05a069703dc195b4afab125e9d9c2f7c2a1df7ca9dccadfc91"} Mar 16 15:48:15 crc kubenswrapper[5120]: I0316 15:48:15.140288 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="204f16f5574ade05a069703dc195b4afab125e9d9c2f7c2a1df7ca9dccadfc91" Mar 16 15:48:15 crc kubenswrapper[5120]: I0316 15:48:15.386876 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/glance-operator-controller-manager-58d9bbd8cc-vhvn5" Mar 16 15:48:15 crc kubenswrapper[5120]: I0316 15:48:15.387244 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/octavia-operator-controller-manager-7b89675745-5vg74" Mar 16 15:48:15 crc kubenswrapper[5120]: I0316 15:48:15.410594 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/designate-operator-controller-manager-7cf89c67bb-cjd7x" podStartSLOduration=2.86224166 podStartE2EDuration="28.410574145s" podCreationTimestamp="2026-03-16 15:47:47 +0000 UTC" firstStartedPulling="2026-03-16 15:47:49.240222108 +0000 UTC m=+971.394153765" lastFinishedPulling="2026-03-16 15:48:14.788554593 +0000 UTC m=+996.942486250" observedRunningTime="2026-03-16 15:48:15.151480557 +0000 UTC m=+997.305412234" watchObservedRunningTime="2026-03-16 15:48:15.410574145 +0000 UTC m=+997.564505812" Mar 16 15:48:15 crc kubenswrapper[5120]: I0316 15:48:15.881243 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-infra/auto-csr-approver-29561262-627cz"] Mar 16 15:48:15 crc kubenswrapper[5120]: I0316 15:48:15.885518 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-infra/auto-csr-approver-29561262-627cz"] Mar 16 15:48:16 crc kubenswrapper[5120]: I0316 15:48:16.149678 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/watcher-operator-controller-manager-65d578856c-7khnv" event={"ID":"4af61d68-498f-4c1a-812d-91089029f784","Type":"ContainerStarted","Data":"4919118b0391f6ba7ac4b1d16b3d5a87d7e6ebefe0bbe46b8922f1b0014f0282"} Mar 16 15:48:16 crc kubenswrapper[5120]: I0316 15:48:16.150067 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-operators/watcher-operator-controller-manager-65d578856c-7khnv" Mar 16 15:48:16 crc kubenswrapper[5120]: I0316 15:48:16.152215 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/swift-operator-controller-manager-5d89b4d5d5-9zvm4" event={"ID":"e46d1032-1fff-4f99-baa0-487aee0eb1bd","Type":"ContainerStarted","Data":"4bb0ceb90fb71a7a432b2d87618203e4ea86bcff6d9cef86f4573b133139af02"} Mar 16 15:48:16 crc kubenswrapper[5120]: I0316 15:48:16.152532 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-operators/swift-operator-controller-manager-5d89b4d5d5-9zvm4" Mar 16 15:48:16 crc kubenswrapper[5120]: I0316 15:48:16.154605 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/test-operator-controller-manager-74d567479f-cbkr4" event={"ID":"ef52f45c-ba73-4607-8b03-f13fce9806bd","Type":"ContainerStarted","Data":"8a7d9c15b46652c24e31619db72ffcdd6edc32a99198a149ff7e231290a729b8"} Mar 16 15:48:16 crc kubenswrapper[5120]: I0316 15:48:16.154832 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-operators/test-operator-controller-manager-74d567479f-cbkr4" Mar 16 15:48:16 crc kubenswrapper[5120]: I0316 15:48:16.157183 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/placement-operator-controller-manager-57fdd4b4cf-v5f9b" event={"ID":"3b105271-39d9-4339-a315-3aa161a54b31","Type":"ContainerStarted","Data":"3da52e15c02df0a82c598ff490b54b787b7fe711f2a17e60e6ee0f883e895fa1"} Mar 16 15:48:16 crc kubenswrapper[5120]: I0316 15:48:16.157435 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-operators/placement-operator-controller-manager-57fdd4b4cf-v5f9b" Mar 16 15:48:16 crc kubenswrapper[5120]: I0316 15:48:16.159198 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/barbican-operator-controller-manager-848cfb5779-68smv" event={"ID":"f62d5d6a-d638-4968-902f-8eb726c039c1","Type":"ContainerStarted","Data":"cb53f78efe333f796357e348cca82be325147af2149d1fc52ec920cb98e13edc"} Mar 16 15:48:16 crc kubenswrapper[5120]: I0316 15:48:16.159608 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-operators/barbican-operator-controller-manager-848cfb5779-68smv" Mar 16 15:48:16 crc kubenswrapper[5120]: I0316 15:48:16.160770 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/openstack-baremetal-operator-controller-manager-6b6ddbc599g848w" event={"ID":"8643ed10-e4fd-4b97-ae36-c4b581cdef1b","Type":"ContainerStarted","Data":"d36ab310f9eb32a43a7c5c1b874115c89e446170f7a4f5b94c195832631225ab"} Mar 16 15:48:16 crc kubenswrapper[5120]: I0316 15:48:16.160977 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-operators/openstack-baremetal-operator-controller-manager-6b6ddbc599g848w" Mar 16 15:48:16 crc kubenswrapper[5120]: I0316 15:48:16.168108 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/watcher-operator-controller-manager-65d578856c-7khnv" podStartSLOduration=3.598299193 podStartE2EDuration="29.168092018s" podCreationTimestamp="2026-03-16 15:47:47 +0000 UTC" firstStartedPulling="2026-03-16 15:47:49.254679509 +0000 UTC m=+971.408611156" lastFinishedPulling="2026-03-16 15:48:14.824472324 +0000 UTC m=+996.978403981" observedRunningTime="2026-03-16 15:48:16.166168624 +0000 UTC m=+998.320100301" watchObservedRunningTime="2026-03-16 15:48:16.168092018 +0000 UTC m=+998.322023665" Mar 16 15:48:16 crc kubenswrapper[5120]: I0316 15:48:16.183713 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/barbican-operator-controller-manager-848cfb5779-68smv" podStartSLOduration=3.598690048 podStartE2EDuration="29.183699023s" podCreationTimestamp="2026-03-16 15:47:47 +0000 UTC" firstStartedPulling="2026-03-16 15:47:49.238279286 +0000 UTC m=+971.392210943" lastFinishedPulling="2026-03-16 15:48:14.823288261 +0000 UTC m=+996.977219918" observedRunningTime="2026-03-16 15:48:16.178836307 +0000 UTC m=+998.332767964" watchObservedRunningTime="2026-03-16 15:48:16.183699023 +0000 UTC m=+998.337630680" Mar 16 15:48:16 crc kubenswrapper[5120]: I0316 15:48:16.195167 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/placement-operator-controller-manager-57fdd4b4cf-v5f9b" podStartSLOduration=3.572210698 podStartE2EDuration="29.195151513s" podCreationTimestamp="2026-03-16 15:47:47 +0000 UTC" firstStartedPulling="2026-03-16 15:47:49.252897032 +0000 UTC m=+971.406828689" lastFinishedPulling="2026-03-16 15:48:14.875837847 +0000 UTC m=+997.029769504" observedRunningTime="2026-03-16 15:48:16.192904791 +0000 UTC m=+998.346836448" watchObservedRunningTime="2026-03-16 15:48:16.195151513 +0000 UTC m=+998.349083170" Mar 16 15:48:16 crc kubenswrapper[5120]: I0316 15:48:16.267208 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/openstack-baremetal-operator-controller-manager-6b6ddbc599g848w" podStartSLOduration=18.86656973 podStartE2EDuration="29.267190473s" podCreationTimestamp="2026-03-16 15:47:47 +0000 UTC" firstStartedPulling="2026-03-16 15:48:04.398868814 +0000 UTC m=+986.552800471" lastFinishedPulling="2026-03-16 15:48:14.799489557 +0000 UTC m=+996.953421214" observedRunningTime="2026-03-16 15:48:16.254407066 +0000 UTC m=+998.408338723" watchObservedRunningTime="2026-03-16 15:48:16.267190473 +0000 UTC m=+998.421122130" Mar 16 15:48:16 crc kubenswrapper[5120]: I0316 15:48:16.268039 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/swift-operator-controller-manager-5d89b4d5d5-9zvm4" podStartSLOduration=3.718699538 podStartE2EDuration="29.268034366s" podCreationTimestamp="2026-03-16 15:47:47 +0000 UTC" firstStartedPulling="2026-03-16 15:47:49.249627435 +0000 UTC m=+971.403559092" lastFinishedPulling="2026-03-16 15:48:14.798962253 +0000 UTC m=+996.952893920" observedRunningTime="2026-03-16 15:48:16.225258483 +0000 UTC m=+998.379190140" watchObservedRunningTime="2026-03-16 15:48:16.268034366 +0000 UTC m=+998.421966023" Mar 16 15:48:16 crc kubenswrapper[5120]: I0316 15:48:16.281032 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/test-operator-controller-manager-74d567479f-cbkr4" podStartSLOduration=3.705720676 podStartE2EDuration="29.281016768s" podCreationTimestamp="2026-03-16 15:47:47 +0000 UTC" firstStartedPulling="2026-03-16 15:47:49.250382966 +0000 UTC m=+971.404314623" lastFinishedPulling="2026-03-16 15:48:14.825679058 +0000 UTC m=+996.979610715" observedRunningTime="2026-03-16 15:48:16.274690292 +0000 UTC m=+998.428621949" watchObservedRunningTime="2026-03-16 15:48:16.281016768 +0000 UTC m=+998.434948425" Mar 16 15:48:16 crc kubenswrapper[5120]: I0316 15:48:16.686597 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4fa264bb-f592-4dd6-b94c-a2f559948b46" path="/var/lib/kubelet/pods/4fa264bb-f592-4dd6-b94c-a2f559948b46/volumes" Mar 16 15:48:19 crc kubenswrapper[5120]: I0316 15:48:19.485795 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/797f2c96-18c7-400b-a46d-795da852b08e-cert\") pod \"infra-operator-controller-manager-76f8b7ddbd-nvwr5\" (UID: \"797f2c96-18c7-400b-a46d-795da852b08e\") " pod="openstack-operators/infra-operator-controller-manager-76f8b7ddbd-nvwr5" Mar 16 15:48:19 crc kubenswrapper[5120]: I0316 15:48:19.496385 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/797f2c96-18c7-400b-a46d-795da852b08e-cert\") pod \"infra-operator-controller-manager-76f8b7ddbd-nvwr5\" (UID: \"797f2c96-18c7-400b-a46d-795da852b08e\") " pod="openstack-operators/infra-operator-controller-manager-76f8b7ddbd-nvwr5" Mar 16 15:48:19 crc kubenswrapper[5120]: I0316 15:48:19.580743 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/infra-operator-controller-manager-76f8b7ddbd-nvwr5" Mar 16 15:48:19 crc kubenswrapper[5120]: I0316 15:48:19.993727 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-certs\" (UniqueName: \"kubernetes.io/secret/91595c8f-09e8-4cdd-8054-1f46eafa27ad-webhook-certs\") pod \"openstack-operator-controller-manager-5fbcdbcf94-6sdhq\" (UID: \"91595c8f-09e8-4cdd-8054-1f46eafa27ad\") " pod="openstack-operators/openstack-operator-controller-manager-5fbcdbcf94-6sdhq" Mar 16 15:48:20 crc kubenswrapper[5120]: I0316 15:48:20.000589 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-certs\" (UniqueName: \"kubernetes.io/secret/91595c8f-09e8-4cdd-8054-1f46eafa27ad-webhook-certs\") pod \"openstack-operator-controller-manager-5fbcdbcf94-6sdhq\" (UID: \"91595c8f-09e8-4cdd-8054-1f46eafa27ad\") " pod="openstack-operators/openstack-operator-controller-manager-5fbcdbcf94-6sdhq" Mar 16 15:48:20 crc kubenswrapper[5120]: W0316 15:48:20.015353 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod797f2c96_18c7_400b_a46d_795da852b08e.slice/crio-eaee89cd90f5cc97e0e0d9cd0209e20337d8b08c1fbfb8cba737180bd1e95f71 WatchSource:0}: Error finding container eaee89cd90f5cc97e0e0d9cd0209e20337d8b08c1fbfb8cba737180bd1e95f71: Status 404 returned error can't find the container with id eaee89cd90f5cc97e0e0d9cd0209e20337d8b08c1fbfb8cba737180bd1e95f71 Mar 16 15:48:20 crc kubenswrapper[5120]: I0316 15:48:20.016558 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/infra-operator-controller-manager-76f8b7ddbd-nvwr5"] Mar 16 15:48:20 crc kubenswrapper[5120]: I0316 15:48:20.173307 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/openstack-operator-controller-manager-5fbcdbcf94-6sdhq" Mar 16 15:48:20 crc kubenswrapper[5120]: I0316 15:48:20.189133 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/infra-operator-controller-manager-76f8b7ddbd-nvwr5" event={"ID":"797f2c96-18c7-400b-a46d-795da852b08e","Type":"ContainerStarted","Data":"eaee89cd90f5cc97e0e0d9cd0209e20337d8b08c1fbfb8cba737180bd1e95f71"} Mar 16 15:48:20 crc kubenswrapper[5120]: I0316 15:48:20.696354 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/openstack-operator-controller-manager-5fbcdbcf94-6sdhq"] Mar 16 15:48:20 crc kubenswrapper[5120]: W0316 15:48:20.699315 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91595c8f_09e8_4cdd_8054_1f46eafa27ad.slice/crio-2beeb9b3dcf6824db4b6a6f45dbeae34b2a92712bfcb8b97843444e8f6b02c65 WatchSource:0}: Error finding container 2beeb9b3dcf6824db4b6a6f45dbeae34b2a92712bfcb8b97843444e8f6b02c65: Status 404 returned error can't find the container with id 2beeb9b3dcf6824db4b6a6f45dbeae34b2a92712bfcb8b97843444e8f6b02c65 Mar 16 15:48:21 crc kubenswrapper[5120]: I0316 15:48:21.196981 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/openstack-operator-controller-manager-5fbcdbcf94-6sdhq" event={"ID":"91595c8f-09e8-4cdd-8054-1f46eafa27ad","Type":"ContainerStarted","Data":"c39c9fd812f20b679694300a29617b4f4b1a9a67c1c9ef8f9aff5b2909489a26"} Mar 16 15:48:21 crc kubenswrapper[5120]: I0316 15:48:21.197020 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/openstack-operator-controller-manager-5fbcdbcf94-6sdhq" event={"ID":"91595c8f-09e8-4cdd-8054-1f46eafa27ad","Type":"ContainerStarted","Data":"2beeb9b3dcf6824db4b6a6f45dbeae34b2a92712bfcb8b97843444e8f6b02c65"} Mar 16 15:48:21 crc kubenswrapper[5120]: I0316 15:48:21.234843 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/openstack-operator-controller-manager-5fbcdbcf94-6sdhq" podStartSLOduration=34.234820618 podStartE2EDuration="34.234820618s" podCreationTimestamp="2026-03-16 15:47:47 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:48:21.232044841 +0000 UTC m=+1003.385976508" watchObservedRunningTime="2026-03-16 15:48:21.234820618 +0000 UTC m=+1003.388752275" Mar 16 15:48:22 crc kubenswrapper[5120]: I0316 15:48:22.010823 5120 patch_prober.go:28] interesting pod/machine-config-daemon-7bf76 container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 15:48:22 crc kubenswrapper[5120]: I0316 15:48:22.011129 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 15:48:22 crc kubenswrapper[5120]: I0316 15:48:22.011172 5120 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" Mar 16 15:48:22 crc kubenswrapper[5120]: I0316 15:48:22.011665 5120 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="machine-config-daemon" containerStatusID={"Type":"cri-o","ID":"e1e28417e12c0a346fcffba9bba0a6be96d15547a0645d8497bdebb5b0646fd1"} pod="openshift-machine-config-operator/machine-config-daemon-7bf76" containerMessage="Container machine-config-daemon failed liveness probe, will be restarted" Mar 16 15:48:22 crc kubenswrapper[5120]: I0316 15:48:22.011709 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" containerID="cri-o://e1e28417e12c0a346fcffba9bba0a6be96d15547a0645d8497bdebb5b0646fd1" gracePeriod=600 Mar 16 15:48:22 crc kubenswrapper[5120]: E0316 15:48:22.087286 5120 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2275cb4_4905_4d66_a87e_8010120db2bd.slice/crio-e1e28417e12c0a346fcffba9bba0a6be96d15547a0645d8497bdebb5b0646fd1.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2275cb4_4905_4d66_a87e_8010120db2bd.slice/crio-conmon-e1e28417e12c0a346fcffba9bba0a6be96d15547a0645d8497bdebb5b0646fd1.scope\": RecentStats: unable to find data in memory cache]" Mar 16 15:48:22 crc kubenswrapper[5120]: I0316 15:48:22.211560 5120 generic.go:358] "Generic (PLEG): container finished" podID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerID="e1e28417e12c0a346fcffba9bba0a6be96d15547a0645d8497bdebb5b0646fd1" exitCode=0 Mar 16 15:48:22 crc kubenswrapper[5120]: I0316 15:48:22.211770 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" event={"ID":"e2275cb4-4905-4d66-a87e-8010120db2bd","Type":"ContainerDied","Data":"e1e28417e12c0a346fcffba9bba0a6be96d15547a0645d8497bdebb5b0646fd1"} Mar 16 15:48:22 crc kubenswrapper[5120]: I0316 15:48:22.211929 5120 scope.go:117] "RemoveContainer" containerID="1bf0dfcc12e9da19221f7d306b83a800a04b4e40726e4b7be82e05b1ea8eae67" Mar 16 15:48:22 crc kubenswrapper[5120]: I0316 15:48:22.212717 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-operators/openstack-operator-controller-manager-5fbcdbcf94-6sdhq" Mar 16 15:48:23 crc kubenswrapper[5120]: I0316 15:48:23.221226 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" event={"ID":"e2275cb4-4905-4d66-a87e-8010120db2bd","Type":"ContainerStarted","Data":"e5df06dc2963ff3db6fb23d78ab01fc36b1dd04900daea5fc6d49cd8c5fe5c61"} Mar 16 15:48:23 crc kubenswrapper[5120]: I0316 15:48:23.222730 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/infra-operator-controller-manager-76f8b7ddbd-nvwr5" event={"ID":"797f2c96-18c7-400b-a46d-795da852b08e","Type":"ContainerStarted","Data":"2dd1536f1978caea4100bb4567e6b33537548bb68086b77cbfee09af8ba09f6b"} Mar 16 15:48:23 crc kubenswrapper[5120]: I0316 15:48:23.222905 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-operators/infra-operator-controller-manager-76f8b7ddbd-nvwr5" Mar 16 15:48:23 crc kubenswrapper[5120]: I0316 15:48:23.266867 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/infra-operator-controller-manager-76f8b7ddbd-nvwr5" podStartSLOduration=34.154943239 podStartE2EDuration="36.266842997s" podCreationTimestamp="2026-03-16 15:47:47 +0000 UTC" firstStartedPulling="2026-03-16 15:48:20.017888168 +0000 UTC m=+1002.171819825" lastFinishedPulling="2026-03-16 15:48:22.129787926 +0000 UTC m=+1004.283719583" observedRunningTime="2026-03-16 15:48:23.26015125 +0000 UTC m=+1005.414082897" watchObservedRunningTime="2026-03-16 15:48:23.266842997 +0000 UTC m=+1005.420774694" Mar 16 15:48:26 crc kubenswrapper[5120]: I0316 15:48:26.167115 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/designate-operator-controller-manager-7cf89c67bb-cjd7x" Mar 16 15:48:27 crc kubenswrapper[5120]: I0316 15:48:27.171383 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/barbican-operator-controller-manager-848cfb5779-68smv" Mar 16 15:48:27 crc kubenswrapper[5120]: I0316 15:48:27.175997 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/swift-operator-controller-manager-5d89b4d5d5-9zvm4" Mar 16 15:48:27 crc kubenswrapper[5120]: I0316 15:48:27.176185 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/placement-operator-controller-manager-57fdd4b4cf-v5f9b" Mar 16 15:48:27 crc kubenswrapper[5120]: I0316 15:48:27.176252 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/test-operator-controller-manager-74d567479f-cbkr4" Mar 16 15:48:27 crc kubenswrapper[5120]: I0316 15:48:27.176346 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/watcher-operator-controller-manager-65d578856c-7khnv" Mar 16 15:48:27 crc kubenswrapper[5120]: I0316 15:48:27.177835 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/openstack-baremetal-operator-controller-manager-6b6ddbc599g848w" Mar 16 15:48:33 crc kubenswrapper[5120]: I0316 15:48:33.229601 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/openstack-operator-controller-manager-5fbcdbcf94-6sdhq" Mar 16 15:48:34 crc kubenswrapper[5120]: I0316 15:48:34.235512 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/infra-operator-controller-manager-76f8b7ddbd-nvwr5" Mar 16 15:48:41 crc kubenswrapper[5120]: I0316 15:48:41.074335 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["crc-storage/crc-storage-crc-rrfwd"] Mar 16 15:48:41 crc kubenswrapper[5120]: I0316 15:48:41.075491 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84ee794e-ebaa-4097-8cad-384c073a2d2e" containerName="oc" Mar 16 15:48:41 crc kubenswrapper[5120]: I0316 15:48:41.075503 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="84ee794e-ebaa-4097-8cad-384c073a2d2e" containerName="oc" Mar 16 15:48:41 crc kubenswrapper[5120]: I0316 15:48:41.075632 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="84ee794e-ebaa-4097-8cad-384c073a2d2e" containerName="oc" Mar 16 15:48:41 crc kubenswrapper[5120]: I0316 15:48:41.081823 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-rrfwd" Mar 16 15:48:41 crc kubenswrapper[5120]: I0316 15:48:41.084190 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"crc-storage\"" Mar 16 15:48:41 crc kubenswrapper[5120]: I0316 15:48:41.084485 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"openshift-service-ca.crt\"" Mar 16 15:48:41 crc kubenswrapper[5120]: I0316 15:48:41.084662 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"crc-storage\"/\"crc-storage-dockercfg-s2tht\"" Mar 16 15:48:41 crc kubenswrapper[5120]: I0316 15:48:41.084849 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"kube-root-ca.crt\"" Mar 16 15:48:41 crc kubenswrapper[5120]: I0316 15:48:41.089597 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-rrfwd"] Mar 16 15:48:41 crc kubenswrapper[5120]: I0316 15:48:41.112576 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89nrq\" (UniqueName: \"kubernetes.io/projected/94e1cfaa-2a2d-4ca0-9f1f-608089448dea-kube-api-access-89nrq\") pod \"crc-storage-crc-rrfwd\" (UID: \"94e1cfaa-2a2d-4ca0-9f1f-608089448dea\") " pod="crc-storage/crc-storage-crc-rrfwd" Mar 16 15:48:41 crc kubenswrapper[5120]: I0316 15:48:41.112640 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/94e1cfaa-2a2d-4ca0-9f1f-608089448dea-node-mnt\") pod \"crc-storage-crc-rrfwd\" (UID: \"94e1cfaa-2a2d-4ca0-9f1f-608089448dea\") " pod="crc-storage/crc-storage-crc-rrfwd" Mar 16 15:48:41 crc kubenswrapper[5120]: I0316 15:48:41.112696 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/94e1cfaa-2a2d-4ca0-9f1f-608089448dea-crc-storage\") pod \"crc-storage-crc-rrfwd\" (UID: \"94e1cfaa-2a2d-4ca0-9f1f-608089448dea\") " pod="crc-storage/crc-storage-crc-rrfwd" Mar 16 15:48:41 crc kubenswrapper[5120]: I0316 15:48:41.213727 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-89nrq\" (UniqueName: \"kubernetes.io/projected/94e1cfaa-2a2d-4ca0-9f1f-608089448dea-kube-api-access-89nrq\") pod \"crc-storage-crc-rrfwd\" (UID: \"94e1cfaa-2a2d-4ca0-9f1f-608089448dea\") " pod="crc-storage/crc-storage-crc-rrfwd" Mar 16 15:48:41 crc kubenswrapper[5120]: I0316 15:48:41.214066 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/94e1cfaa-2a2d-4ca0-9f1f-608089448dea-node-mnt\") pod \"crc-storage-crc-rrfwd\" (UID: \"94e1cfaa-2a2d-4ca0-9f1f-608089448dea\") " pod="crc-storage/crc-storage-crc-rrfwd" Mar 16 15:48:41 crc kubenswrapper[5120]: I0316 15:48:41.214106 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/94e1cfaa-2a2d-4ca0-9f1f-608089448dea-crc-storage\") pod \"crc-storage-crc-rrfwd\" (UID: \"94e1cfaa-2a2d-4ca0-9f1f-608089448dea\") " pod="crc-storage/crc-storage-crc-rrfwd" Mar 16 15:48:41 crc kubenswrapper[5120]: I0316 15:48:41.214955 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/94e1cfaa-2a2d-4ca0-9f1f-608089448dea-crc-storage\") pod \"crc-storage-crc-rrfwd\" (UID: \"94e1cfaa-2a2d-4ca0-9f1f-608089448dea\") " pod="crc-storage/crc-storage-crc-rrfwd" Mar 16 15:48:41 crc kubenswrapper[5120]: I0316 15:48:41.215483 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/94e1cfaa-2a2d-4ca0-9f1f-608089448dea-node-mnt\") pod \"crc-storage-crc-rrfwd\" (UID: \"94e1cfaa-2a2d-4ca0-9f1f-608089448dea\") " pod="crc-storage/crc-storage-crc-rrfwd" Mar 16 15:48:41 crc kubenswrapper[5120]: I0316 15:48:41.238683 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-89nrq\" (UniqueName: \"kubernetes.io/projected/94e1cfaa-2a2d-4ca0-9f1f-608089448dea-kube-api-access-89nrq\") pod \"crc-storage-crc-rrfwd\" (UID: \"94e1cfaa-2a2d-4ca0-9f1f-608089448dea\") " pod="crc-storage/crc-storage-crc-rrfwd" Mar 16 15:48:41 crc kubenswrapper[5120]: I0316 15:48:41.403856 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-rrfwd" Mar 16 15:48:41 crc kubenswrapper[5120]: I0316 15:48:41.472371 5120 scope.go:117] "RemoveContainer" containerID="aa2b1fb5bca9513acf0cb6c094763a4999643358b7703afb3e78e8bbe7fcef0f" Mar 16 15:48:41 crc kubenswrapper[5120]: I0316 15:48:41.667583 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-rrfwd"] Mar 16 15:48:41 crc kubenswrapper[5120]: W0316 15:48:41.679809 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod94e1cfaa_2a2d_4ca0_9f1f_608089448dea.slice/crio-aab13826c3d98e08f7a739d3df740aaea2e9995eb5625bf401851933d36bcf2f WatchSource:0}: Error finding container aab13826c3d98e08f7a739d3df740aaea2e9995eb5625bf401851933d36bcf2f: Status 404 returned error can't find the container with id aab13826c3d98e08f7a739d3df740aaea2e9995eb5625bf401851933d36bcf2f Mar 16 15:48:42 crc kubenswrapper[5120]: I0316 15:48:42.384921 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-rrfwd" event={"ID":"94e1cfaa-2a2d-4ca0-9f1f-608089448dea","Type":"ContainerStarted","Data":"aab13826c3d98e08f7a739d3df740aaea2e9995eb5625bf401851933d36bcf2f"} Mar 16 15:48:43 crc kubenswrapper[5120]: I0316 15:48:43.394019 5120 generic.go:358] "Generic (PLEG): container finished" podID="94e1cfaa-2a2d-4ca0-9f1f-608089448dea" containerID="65b8f8294c2f4cce23696de5ead69c2b76ed3f72df2fb7301e81f9a30c54c5dd" exitCode=0 Mar 16 15:48:43 crc kubenswrapper[5120]: I0316 15:48:43.394068 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-rrfwd" event={"ID":"94e1cfaa-2a2d-4ca0-9f1f-608089448dea","Type":"ContainerDied","Data":"65b8f8294c2f4cce23696de5ead69c2b76ed3f72df2fb7301e81f9a30c54c5dd"} Mar 16 15:48:44 crc kubenswrapper[5120]: I0316 15:48:44.784057 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-rrfwd" Mar 16 15:48:44 crc kubenswrapper[5120]: I0316 15:48:44.872102 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/94e1cfaa-2a2d-4ca0-9f1f-608089448dea-node-mnt\") pod \"94e1cfaa-2a2d-4ca0-9f1f-608089448dea\" (UID: \"94e1cfaa-2a2d-4ca0-9f1f-608089448dea\") " Mar 16 15:48:44 crc kubenswrapper[5120]: I0316 15:48:44.872180 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/94e1cfaa-2a2d-4ca0-9f1f-608089448dea-node-mnt" (OuterVolumeSpecName: "node-mnt") pod "94e1cfaa-2a2d-4ca0-9f1f-608089448dea" (UID: "94e1cfaa-2a2d-4ca0-9f1f-608089448dea"). InnerVolumeSpecName "node-mnt". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 15:48:44 crc kubenswrapper[5120]: I0316 15:48:44.872208 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/94e1cfaa-2a2d-4ca0-9f1f-608089448dea-crc-storage\") pod \"94e1cfaa-2a2d-4ca0-9f1f-608089448dea\" (UID: \"94e1cfaa-2a2d-4ca0-9f1f-608089448dea\") " Mar 16 15:48:44 crc kubenswrapper[5120]: I0316 15:48:44.872317 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-89nrq\" (UniqueName: \"kubernetes.io/projected/94e1cfaa-2a2d-4ca0-9f1f-608089448dea-kube-api-access-89nrq\") pod \"94e1cfaa-2a2d-4ca0-9f1f-608089448dea\" (UID: \"94e1cfaa-2a2d-4ca0-9f1f-608089448dea\") " Mar 16 15:48:44 crc kubenswrapper[5120]: I0316 15:48:44.873077 5120 reconciler_common.go:299] "Volume detached for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/94e1cfaa-2a2d-4ca0-9f1f-608089448dea-node-mnt\") on node \"crc\" DevicePath \"\"" Mar 16 15:48:44 crc kubenswrapper[5120]: I0316 15:48:44.878353 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94e1cfaa-2a2d-4ca0-9f1f-608089448dea-kube-api-access-89nrq" (OuterVolumeSpecName: "kube-api-access-89nrq") pod "94e1cfaa-2a2d-4ca0-9f1f-608089448dea" (UID: "94e1cfaa-2a2d-4ca0-9f1f-608089448dea"). InnerVolumeSpecName "kube-api-access-89nrq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:48:44 crc kubenswrapper[5120]: I0316 15:48:44.889036 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/94e1cfaa-2a2d-4ca0-9f1f-608089448dea-crc-storage" (OuterVolumeSpecName: "crc-storage") pod "94e1cfaa-2a2d-4ca0-9f1f-608089448dea" (UID: "94e1cfaa-2a2d-4ca0-9f1f-608089448dea"). InnerVolumeSpecName "crc-storage". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:48:44 crc kubenswrapper[5120]: I0316 15:48:44.974845 5120 reconciler_common.go:299] "Volume detached for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/94e1cfaa-2a2d-4ca0-9f1f-608089448dea-crc-storage\") on node \"crc\" DevicePath \"\"" Mar 16 15:48:44 crc kubenswrapper[5120]: I0316 15:48:44.974897 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-89nrq\" (UniqueName: \"kubernetes.io/projected/94e1cfaa-2a2d-4ca0-9f1f-608089448dea-kube-api-access-89nrq\") on node \"crc\" DevicePath \"\"" Mar 16 15:48:45 crc kubenswrapper[5120]: I0316 15:48:45.413133 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-rrfwd" Mar 16 15:48:45 crc kubenswrapper[5120]: I0316 15:48:45.413217 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-rrfwd" event={"ID":"94e1cfaa-2a2d-4ca0-9f1f-608089448dea","Type":"ContainerDied","Data":"aab13826c3d98e08f7a739d3df740aaea2e9995eb5625bf401851933d36bcf2f"} Mar 16 15:48:45 crc kubenswrapper[5120]: I0316 15:48:45.413257 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="aab13826c3d98e08f7a739d3df740aaea2e9995eb5625bf401851933d36bcf2f" Mar 16 15:48:48 crc kubenswrapper[5120]: I0316 15:48:48.136637 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["crc-storage/crc-storage-crc-rrfwd"] Mar 16 15:48:48 crc kubenswrapper[5120]: I0316 15:48:48.141989 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["crc-storage/crc-storage-crc-rrfwd"] Mar 16 15:48:48 crc kubenswrapper[5120]: I0316 15:48:48.255507 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["crc-storage/crc-storage-crc-gwzcf"] Mar 16 15:48:48 crc kubenswrapper[5120]: I0316 15:48:48.257338 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94e1cfaa-2a2d-4ca0-9f1f-608089448dea" containerName="storage" Mar 16 15:48:48 crc kubenswrapper[5120]: I0316 15:48:48.257370 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="94e1cfaa-2a2d-4ca0-9f1f-608089448dea" containerName="storage" Mar 16 15:48:48 crc kubenswrapper[5120]: I0316 15:48:48.257631 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="94e1cfaa-2a2d-4ca0-9f1f-608089448dea" containerName="storage" Mar 16 15:48:48 crc kubenswrapper[5120]: I0316 15:48:48.324268 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-gwzcf"] Mar 16 15:48:48 crc kubenswrapper[5120]: I0316 15:48:48.324453 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-gwzcf" Mar 16 15:48:48 crc kubenswrapper[5120]: I0316 15:48:48.326495 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"crc-storage\"" Mar 16 15:48:48 crc kubenswrapper[5120]: I0316 15:48:48.327173 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"openshift-service-ca.crt\"" Mar 16 15:48:48 crc kubenswrapper[5120]: I0316 15:48:48.327390 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"crc-storage\"/\"crc-storage-dockercfg-s2tht\"" Mar 16 15:48:48 crc kubenswrapper[5120]: I0316 15:48:48.330124 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"kube-root-ca.crt\"" Mar 16 15:48:48 crc kubenswrapper[5120]: I0316 15:48:48.424743 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/0aca7ef2-1df2-4dd5-b2f4-c067874f36a2-crc-storage\") pod \"crc-storage-crc-gwzcf\" (UID: \"0aca7ef2-1df2-4dd5-b2f4-c067874f36a2\") " pod="crc-storage/crc-storage-crc-gwzcf" Mar 16 15:48:48 crc kubenswrapper[5120]: I0316 15:48:48.425128 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58z8r\" (UniqueName: \"kubernetes.io/projected/0aca7ef2-1df2-4dd5-b2f4-c067874f36a2-kube-api-access-58z8r\") pod \"crc-storage-crc-gwzcf\" (UID: \"0aca7ef2-1df2-4dd5-b2f4-c067874f36a2\") " pod="crc-storage/crc-storage-crc-gwzcf" Mar 16 15:48:48 crc kubenswrapper[5120]: I0316 15:48:48.425384 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/0aca7ef2-1df2-4dd5-b2f4-c067874f36a2-node-mnt\") pod \"crc-storage-crc-gwzcf\" (UID: \"0aca7ef2-1df2-4dd5-b2f4-c067874f36a2\") " pod="crc-storage/crc-storage-crc-gwzcf" Mar 16 15:48:48 crc kubenswrapper[5120]: I0316 15:48:48.526724 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/0aca7ef2-1df2-4dd5-b2f4-c067874f36a2-node-mnt\") pod \"crc-storage-crc-gwzcf\" (UID: \"0aca7ef2-1df2-4dd5-b2f4-c067874f36a2\") " pod="crc-storage/crc-storage-crc-gwzcf" Mar 16 15:48:48 crc kubenswrapper[5120]: I0316 15:48:48.526858 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/0aca7ef2-1df2-4dd5-b2f4-c067874f36a2-crc-storage\") pod \"crc-storage-crc-gwzcf\" (UID: \"0aca7ef2-1df2-4dd5-b2f4-c067874f36a2\") " pod="crc-storage/crc-storage-crc-gwzcf" Mar 16 15:48:48 crc kubenswrapper[5120]: I0316 15:48:48.526915 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-58z8r\" (UniqueName: \"kubernetes.io/projected/0aca7ef2-1df2-4dd5-b2f4-c067874f36a2-kube-api-access-58z8r\") pod \"crc-storage-crc-gwzcf\" (UID: \"0aca7ef2-1df2-4dd5-b2f4-c067874f36a2\") " pod="crc-storage/crc-storage-crc-gwzcf" Mar 16 15:48:48 crc kubenswrapper[5120]: I0316 15:48:48.527582 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/0aca7ef2-1df2-4dd5-b2f4-c067874f36a2-node-mnt\") pod \"crc-storage-crc-gwzcf\" (UID: \"0aca7ef2-1df2-4dd5-b2f4-c067874f36a2\") " pod="crc-storage/crc-storage-crc-gwzcf" Mar 16 15:48:48 crc kubenswrapper[5120]: I0316 15:48:48.529739 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/0aca7ef2-1df2-4dd5-b2f4-c067874f36a2-crc-storage\") pod \"crc-storage-crc-gwzcf\" (UID: \"0aca7ef2-1df2-4dd5-b2f4-c067874f36a2\") " pod="crc-storage/crc-storage-crc-gwzcf" Mar 16 15:48:48 crc kubenswrapper[5120]: I0316 15:48:48.559890 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-58z8r\" (UniqueName: \"kubernetes.io/projected/0aca7ef2-1df2-4dd5-b2f4-c067874f36a2-kube-api-access-58z8r\") pod \"crc-storage-crc-gwzcf\" (UID: \"0aca7ef2-1df2-4dd5-b2f4-c067874f36a2\") " pod="crc-storage/crc-storage-crc-gwzcf" Mar 16 15:48:48 crc kubenswrapper[5120]: I0316 15:48:48.662034 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-gwzcf" Mar 16 15:48:48 crc kubenswrapper[5120]: I0316 15:48:48.683575 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94e1cfaa-2a2d-4ca0-9f1f-608089448dea" path="/var/lib/kubelet/pods/94e1cfaa-2a2d-4ca0-9f1f-608089448dea/volumes" Mar 16 15:48:49 crc kubenswrapper[5120]: I0316 15:48:49.242403 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-gwzcf"] Mar 16 15:48:49 crc kubenswrapper[5120]: I0316 15:48:49.444650 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-gwzcf" event={"ID":"0aca7ef2-1df2-4dd5-b2f4-c067874f36a2","Type":"ContainerStarted","Data":"93df3bd35d0c346a884bfc355f95f90f205e9558fbe7b3861eb67a5f0680e862"} Mar 16 15:48:50 crc kubenswrapper[5120]: I0316 15:48:50.455530 5120 generic.go:358] "Generic (PLEG): container finished" podID="0aca7ef2-1df2-4dd5-b2f4-c067874f36a2" containerID="3280982dc357d74ede0d29ab9151dec78861cc38d1b28fdd36ccf0f638f3325e" exitCode=0 Mar 16 15:48:50 crc kubenswrapper[5120]: I0316 15:48:50.455640 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-gwzcf" event={"ID":"0aca7ef2-1df2-4dd5-b2f4-c067874f36a2","Type":"ContainerDied","Data":"3280982dc357d74ede0d29ab9151dec78861cc38d1b28fdd36ccf0f638f3325e"} Mar 16 15:48:51 crc kubenswrapper[5120]: I0316 15:48:51.830272 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-gwzcf" Mar 16 15:48:51 crc kubenswrapper[5120]: I0316 15:48:51.882207 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/0aca7ef2-1df2-4dd5-b2f4-c067874f36a2-crc-storage\") pod \"0aca7ef2-1df2-4dd5-b2f4-c067874f36a2\" (UID: \"0aca7ef2-1df2-4dd5-b2f4-c067874f36a2\") " Mar 16 15:48:51 crc kubenswrapper[5120]: I0316 15:48:51.882420 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/0aca7ef2-1df2-4dd5-b2f4-c067874f36a2-node-mnt\") pod \"0aca7ef2-1df2-4dd5-b2f4-c067874f36a2\" (UID: \"0aca7ef2-1df2-4dd5-b2f4-c067874f36a2\") " Mar 16 15:48:51 crc kubenswrapper[5120]: I0316 15:48:51.882457 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-58z8r\" (UniqueName: \"kubernetes.io/projected/0aca7ef2-1df2-4dd5-b2f4-c067874f36a2-kube-api-access-58z8r\") pod \"0aca7ef2-1df2-4dd5-b2f4-c067874f36a2\" (UID: \"0aca7ef2-1df2-4dd5-b2f4-c067874f36a2\") " Mar 16 15:48:51 crc kubenswrapper[5120]: I0316 15:48:51.882492 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/0aca7ef2-1df2-4dd5-b2f4-c067874f36a2-node-mnt" (OuterVolumeSpecName: "node-mnt") pod "0aca7ef2-1df2-4dd5-b2f4-c067874f36a2" (UID: "0aca7ef2-1df2-4dd5-b2f4-c067874f36a2"). InnerVolumeSpecName "node-mnt". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 15:48:51 crc kubenswrapper[5120]: I0316 15:48:51.882746 5120 reconciler_common.go:299] "Volume detached for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/0aca7ef2-1df2-4dd5-b2f4-c067874f36a2-node-mnt\") on node \"crc\" DevicePath \"\"" Mar 16 15:48:51 crc kubenswrapper[5120]: I0316 15:48:51.890016 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0aca7ef2-1df2-4dd5-b2f4-c067874f36a2-kube-api-access-58z8r" (OuterVolumeSpecName: "kube-api-access-58z8r") pod "0aca7ef2-1df2-4dd5-b2f4-c067874f36a2" (UID: "0aca7ef2-1df2-4dd5-b2f4-c067874f36a2"). InnerVolumeSpecName "kube-api-access-58z8r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:48:51 crc kubenswrapper[5120]: I0316 15:48:51.907857 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0aca7ef2-1df2-4dd5-b2f4-c067874f36a2-crc-storage" (OuterVolumeSpecName: "crc-storage") pod "0aca7ef2-1df2-4dd5-b2f4-c067874f36a2" (UID: "0aca7ef2-1df2-4dd5-b2f4-c067874f36a2"). InnerVolumeSpecName "crc-storage". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:48:51 crc kubenswrapper[5120]: I0316 15:48:51.983882 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-58z8r\" (UniqueName: \"kubernetes.io/projected/0aca7ef2-1df2-4dd5-b2f4-c067874f36a2-kube-api-access-58z8r\") on node \"crc\" DevicePath \"\"" Mar 16 15:48:51 crc kubenswrapper[5120]: I0316 15:48:51.983921 5120 reconciler_common.go:299] "Volume detached for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/0aca7ef2-1df2-4dd5-b2f4-c067874f36a2-crc-storage\") on node \"crc\" DevicePath \"\"" Mar 16 15:48:52 crc kubenswrapper[5120]: I0316 15:48:52.476924 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-gwzcf" Mar 16 15:48:52 crc kubenswrapper[5120]: I0316 15:48:52.477003 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-gwzcf" event={"ID":"0aca7ef2-1df2-4dd5-b2f4-c067874f36a2","Type":"ContainerDied","Data":"93df3bd35d0c346a884bfc355f95f90f205e9558fbe7b3861eb67a5f0680e862"} Mar 16 15:48:52 crc kubenswrapper[5120]: I0316 15:48:52.477377 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="93df3bd35d0c346a884bfc355f95f90f205e9558fbe7b3861eb67a5f0680e862" Mar 16 15:48:52 crc kubenswrapper[5120]: E0316 15:48:52.630767 5120 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0aca7ef2_1df2_4dd5_b2f4_c067874f36a2.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0aca7ef2_1df2_4dd5_b2f4_c067874f36a2.slice/crio-93df3bd35d0c346a884bfc355f95f90f205e9558fbe7b3861eb67a5f0680e862\": RecentStats: unable to find data in memory cache]" Mar 16 15:48:55 crc kubenswrapper[5120]: I0316 15:48:55.224007 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-58748b8b69-49q6v"] Mar 16 15:48:55 crc kubenswrapper[5120]: I0316 15:48:55.225258 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0aca7ef2-1df2-4dd5-b2f4-c067874f36a2" containerName="storage" Mar 16 15:48:55 crc kubenswrapper[5120]: I0316 15:48:55.225276 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="0aca7ef2-1df2-4dd5-b2f4-c067874f36a2" containerName="storage" Mar 16 15:48:55 crc kubenswrapper[5120]: I0316 15:48:55.225408 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="0aca7ef2-1df2-4dd5-b2f4-c067874f36a2" containerName="storage" Mar 16 15:48:55 crc kubenswrapper[5120]: I0316 15:48:55.235817 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58748b8b69-49q6v" Mar 16 15:48:55 crc kubenswrapper[5120]: I0316 15:48:55.239314 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"dnsmasq\"" Mar 16 15:48:55 crc kubenswrapper[5120]: I0316 15:48:55.239384 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dnsmasq-dnsmasq-dockercfg-txtz4\"" Mar 16 15:48:55 crc kubenswrapper[5120]: I0316 15:48:55.239488 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"kube-root-ca.crt\"" Mar 16 15:48:55 crc kubenswrapper[5120]: I0316 15:48:55.239595 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openshift-service-ca.crt\"" Mar 16 15:48:55 crc kubenswrapper[5120]: I0316 15:48:55.248581 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-58748b8b69-49q6v"] Mar 16 15:48:55 crc kubenswrapper[5120]: I0316 15:48:55.278941 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-tpgs2"] Mar 16 15:48:55 crc kubenswrapper[5120]: I0316 15:48:55.288086 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-tpgs2" Mar 16 15:48:55 crc kubenswrapper[5120]: I0316 15:48:55.289362 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-tpgs2"] Mar 16 15:48:55 crc kubenswrapper[5120]: I0316 15:48:55.290383 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"dnsmasq-svc\"" Mar 16 15:48:55 crc kubenswrapper[5120]: I0316 15:48:55.336506 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cd214905-94a1-43b8-8966-734672c54a00-config\") pod \"dnsmasq-dnsmasq-58748b8b69-49q6v\" (UID: \"cd214905-94a1-43b8-8966-734672c54a00\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58748b8b69-49q6v" Mar 16 15:48:55 crc kubenswrapper[5120]: I0316 15:48:55.336550 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wx9rm\" (UniqueName: \"kubernetes.io/projected/cd214905-94a1-43b8-8966-734672c54a00-kube-api-access-wx9rm\") pod \"dnsmasq-dnsmasq-58748b8b69-49q6v\" (UID: \"cd214905-94a1-43b8-8966-734672c54a00\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58748b8b69-49q6v" Mar 16 15:48:55 crc kubenswrapper[5120]: I0316 15:48:55.437570 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wx9rm\" (UniqueName: \"kubernetes.io/projected/cd214905-94a1-43b8-8966-734672c54a00-kube-api-access-wx9rm\") pod \"dnsmasq-dnsmasq-58748b8b69-49q6v\" (UID: \"cd214905-94a1-43b8-8966-734672c54a00\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58748b8b69-49q6v" Mar 16 15:48:55 crc kubenswrapper[5120]: I0316 15:48:55.437666 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/66fbf6ad-9a00-472a-9848-6647d7eff53d-config\") pod \"dnsmasq-dnsmasq-79dcd846c5-tpgs2\" (UID: \"66fbf6ad-9a00-472a-9848-6647d7eff53d\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-tpgs2" Mar 16 15:48:55 crc kubenswrapper[5120]: I0316 15:48:55.437711 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/66fbf6ad-9a00-472a-9848-6647d7eff53d-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-79dcd846c5-tpgs2\" (UID: \"66fbf6ad-9a00-472a-9848-6647d7eff53d\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-tpgs2" Mar 16 15:48:55 crc kubenswrapper[5120]: I0316 15:48:55.437748 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbtgn\" (UniqueName: \"kubernetes.io/projected/66fbf6ad-9a00-472a-9848-6647d7eff53d-kube-api-access-tbtgn\") pod \"dnsmasq-dnsmasq-79dcd846c5-tpgs2\" (UID: \"66fbf6ad-9a00-472a-9848-6647d7eff53d\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-tpgs2" Mar 16 15:48:55 crc kubenswrapper[5120]: I0316 15:48:55.438036 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cd214905-94a1-43b8-8966-734672c54a00-config\") pod \"dnsmasq-dnsmasq-58748b8b69-49q6v\" (UID: \"cd214905-94a1-43b8-8966-734672c54a00\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58748b8b69-49q6v" Mar 16 15:48:55 crc kubenswrapper[5120]: I0316 15:48:55.439200 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cd214905-94a1-43b8-8966-734672c54a00-config\") pod \"dnsmasq-dnsmasq-58748b8b69-49q6v\" (UID: \"cd214905-94a1-43b8-8966-734672c54a00\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58748b8b69-49q6v" Mar 16 15:48:55 crc kubenswrapper[5120]: I0316 15:48:55.466675 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wx9rm\" (UniqueName: \"kubernetes.io/projected/cd214905-94a1-43b8-8966-734672c54a00-kube-api-access-wx9rm\") pod \"dnsmasq-dnsmasq-58748b8b69-49q6v\" (UID: \"cd214905-94a1-43b8-8966-734672c54a00\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58748b8b69-49q6v" Mar 16 15:48:55 crc kubenswrapper[5120]: I0316 15:48:55.539002 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tbtgn\" (UniqueName: \"kubernetes.io/projected/66fbf6ad-9a00-472a-9848-6647d7eff53d-kube-api-access-tbtgn\") pod \"dnsmasq-dnsmasq-79dcd846c5-tpgs2\" (UID: \"66fbf6ad-9a00-472a-9848-6647d7eff53d\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-tpgs2" Mar 16 15:48:55 crc kubenswrapper[5120]: I0316 15:48:55.539127 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/66fbf6ad-9a00-472a-9848-6647d7eff53d-config\") pod \"dnsmasq-dnsmasq-79dcd846c5-tpgs2\" (UID: \"66fbf6ad-9a00-472a-9848-6647d7eff53d\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-tpgs2" Mar 16 15:48:55 crc kubenswrapper[5120]: I0316 15:48:55.539164 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/66fbf6ad-9a00-472a-9848-6647d7eff53d-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-79dcd846c5-tpgs2\" (UID: \"66fbf6ad-9a00-472a-9848-6647d7eff53d\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-tpgs2" Mar 16 15:48:55 crc kubenswrapper[5120]: I0316 15:48:55.540414 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/66fbf6ad-9a00-472a-9848-6647d7eff53d-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-79dcd846c5-tpgs2\" (UID: \"66fbf6ad-9a00-472a-9848-6647d7eff53d\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-tpgs2" Mar 16 15:48:55 crc kubenswrapper[5120]: I0316 15:48:55.541016 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/66fbf6ad-9a00-472a-9848-6647d7eff53d-config\") pod \"dnsmasq-dnsmasq-79dcd846c5-tpgs2\" (UID: \"66fbf6ad-9a00-472a-9848-6647d7eff53d\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-tpgs2" Mar 16 15:48:55 crc kubenswrapper[5120]: I0316 15:48:55.558951 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58748b8b69-49q6v" Mar 16 15:48:55 crc kubenswrapper[5120]: I0316 15:48:55.567913 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbtgn\" (UniqueName: \"kubernetes.io/projected/66fbf6ad-9a00-472a-9848-6647d7eff53d-kube-api-access-tbtgn\") pod \"dnsmasq-dnsmasq-79dcd846c5-tpgs2\" (UID: \"66fbf6ad-9a00-472a-9848-6647d7eff53d\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-tpgs2" Mar 16 15:48:55 crc kubenswrapper[5120]: I0316 15:48:55.610561 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-tpgs2" Mar 16 15:48:56 crc kubenswrapper[5120]: I0316 15:48:56.046160 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-58748b8b69-49q6v"] Mar 16 15:48:56 crc kubenswrapper[5120]: I0316 15:48:56.108142 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-tpgs2"] Mar 16 15:48:56 crc kubenswrapper[5120]: W0316 15:48:56.117539 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod66fbf6ad_9a00_472a_9848_6647d7eff53d.slice/crio-c1e3bb1aceeee6a643b5c22033b359492919af5e6c7413176f23f17ba279bc1c WatchSource:0}: Error finding container c1e3bb1aceeee6a643b5c22033b359492919af5e6c7413176f23f17ba279bc1c: Status 404 returned error can't find the container with id c1e3bb1aceeee6a643b5c22033b359492919af5e6c7413176f23f17ba279bc1c Mar 16 15:48:56 crc kubenswrapper[5120]: I0316 15:48:56.505150 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58748b8b69-49q6v" event={"ID":"cd214905-94a1-43b8-8966-734672c54a00","Type":"ContainerStarted","Data":"2d11e7f3d9f16cc5b78e119dc0b051f19011b6ab39a8ad4cab323dfe75890c23"} Mar 16 15:48:56 crc kubenswrapper[5120]: I0316 15:48:56.506801 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-tpgs2" event={"ID":"66fbf6ad-9a00-472a-9848-6647d7eff53d","Type":"ContainerStarted","Data":"c1e3bb1aceeee6a643b5c22033b359492919af5e6c7413176f23f17ba279bc1c"} Mar 16 15:49:06 crc kubenswrapper[5120]: I0316 15:49:06.212045 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 15:49:06 crc kubenswrapper[5120]: I0316 15:49:06.395847 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 15:49:06 crc kubenswrapper[5120]: I0316 15:49:06.396004 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 15:49:06 crc kubenswrapper[5120]: I0316 15:49:06.399917 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-plugins-conf\"" Mar 16 15:49:06 crc kubenswrapper[5120]: I0316 15:49:06.400012 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-config-data\"" Mar 16 15:49:06 crc kubenswrapper[5120]: I0316 15:49:06.400176 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-erlang-cookie\"" Mar 16 15:49:06 crc kubenswrapper[5120]: I0316 15:49:06.400504 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-default-user\"" Mar 16 15:49:06 crc kubenswrapper[5120]: I0316 15:49:06.400655 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-server-dockercfg-pzpnl\"" Mar 16 15:49:06 crc kubenswrapper[5120]: I0316 15:49:06.400802 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-rabbitmq-svc\"" Mar 16 15:49:06 crc kubenswrapper[5120]: I0316 15:49:06.402266 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-server-conf\"" Mar 16 15:49:06 crc kubenswrapper[5120]: I0316 15:49:06.454411 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 15:49:06 crc kubenswrapper[5120]: I0316 15:49:06.474875 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 15:49:06 crc kubenswrapper[5120]: I0316 15:49:06.475020 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 15:49:06 crc kubenswrapper[5120]: I0316 15:49:06.477367 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-cell1-plugins-conf\"" Mar 16 15:49:06 crc kubenswrapper[5120]: I0316 15:49:06.477722 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-cell1-server-dockercfg-lfvn5\"" Mar 16 15:49:06 crc kubenswrapper[5120]: I0316 15:49:06.477733 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-cell1-config-data\"" Mar 16 15:49:06 crc kubenswrapper[5120]: I0316 15:49:06.477733 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-cell1-erlang-cookie\"" Mar 16 15:49:06 crc kubenswrapper[5120]: I0316 15:49:06.477952 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-cell1-default-user\"" Mar 16 15:49:06 crc kubenswrapper[5120]: I0316 15:49:06.478252 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-cell1-server-conf\"" Mar 16 15:49:06 crc kubenswrapper[5120]: I0316 15:49:06.478839 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-rabbitmq-cell1-svc\"" Mar 16 15:49:06 crc kubenswrapper[5120]: I0316 15:49:06.521146 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/36a1c719-e302-4df3-99c5-5025d99c8c19-rabbitmq-erlang-cookie\") pod \"rabbitmq-cell1-server-0\" (UID: \"36a1c719-e302-4df3-99c5-5025d99c8c19\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 15:49:06 crc kubenswrapper[5120]: I0316 15:49:06.521196 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/39704fdb-36c4-41fe-8c13-35a3abb56c36-server-conf\") pod \"rabbitmq-server-0\" (UID: \"39704fdb-36c4-41fe-8c13-35a3abb56c36\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 15:49:06 crc kubenswrapper[5120]: I0316 15:49:06.521221 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/39704fdb-36c4-41fe-8c13-35a3abb56c36-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"39704fdb-36c4-41fe-8c13-35a3abb56c36\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 15:49:06 crc kubenswrapper[5120]: I0316 15:49:06.521243 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/39704fdb-36c4-41fe-8c13-35a3abb56c36-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"39704fdb-36c4-41fe-8c13-35a3abb56c36\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 15:49:06 crc kubenswrapper[5120]: I0316 15:49:06.521264 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/39704fdb-36c4-41fe-8c13-35a3abb56c36-pod-info\") pod \"rabbitmq-server-0\" (UID: \"39704fdb-36c4-41fe-8c13-35a3abb56c36\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 15:49:06 crc kubenswrapper[5120]: I0316 15:49:06.521289 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmhsd\" (UniqueName: \"kubernetes.io/projected/36a1c719-e302-4df3-99c5-5025d99c8c19-kube-api-access-hmhsd\") pod \"rabbitmq-cell1-server-0\" (UID: \"36a1c719-e302-4df3-99c5-5025d99c8c19\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 15:49:06 crc kubenswrapper[5120]: I0316 15:49:06.521306 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/36a1c719-e302-4df3-99c5-5025d99c8c19-config-data\") pod \"rabbitmq-cell1-server-0\" (UID: \"36a1c719-e302-4df3-99c5-5025d99c8c19\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 15:49:06 crc kubenswrapper[5120]: I0316 15:49:06.521332 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/36a1c719-e302-4df3-99c5-5025d99c8c19-rabbitmq-plugins\") pod \"rabbitmq-cell1-server-0\" (UID: \"36a1c719-e302-4df3-99c5-5025d99c8c19\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 15:49:06 crc kubenswrapper[5120]: I0316 15:49:06.521347 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/39704fdb-36c4-41fe-8c13-35a3abb56c36-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"39704fdb-36c4-41fe-8c13-35a3abb56c36\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 15:49:06 crc kubenswrapper[5120]: I0316 15:49:06.521373 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/39704fdb-36c4-41fe-8c13-35a3abb56c36-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"39704fdb-36c4-41fe-8c13-35a3abb56c36\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 15:49:06 crc kubenswrapper[5120]: I0316 15:49:06.521401 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"rabbitmq-server-0\" (UID: \"39704fdb-36c4-41fe-8c13-35a3abb56c36\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 15:49:06 crc kubenswrapper[5120]: I0316 15:49:06.521418 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/36a1c719-e302-4df3-99c5-5025d99c8c19-rabbitmq-confd\") pod \"rabbitmq-cell1-server-0\" (UID: \"36a1c719-e302-4df3-99c5-5025d99c8c19\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 15:49:06 crc kubenswrapper[5120]: I0316 15:49:06.521435 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/36a1c719-e302-4df3-99c5-5025d99c8c19-erlang-cookie-secret\") pod \"rabbitmq-cell1-server-0\" (UID: \"36a1c719-e302-4df3-99c5-5025d99c8c19\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 15:49:06 crc kubenswrapper[5120]: I0316 15:49:06.521474 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/36a1c719-e302-4df3-99c5-5025d99c8c19-pod-info\") pod \"rabbitmq-cell1-server-0\" (UID: \"36a1c719-e302-4df3-99c5-5025d99c8c19\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 15:49:06 crc kubenswrapper[5120]: I0316 15:49:06.521489 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/36a1c719-e302-4df3-99c5-5025d99c8c19-rabbitmq-tls\") pod \"rabbitmq-cell1-server-0\" (UID: \"36a1c719-e302-4df3-99c5-5025d99c8c19\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 15:49:06 crc kubenswrapper[5120]: I0316 15:49:06.521507 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/36a1c719-e302-4df3-99c5-5025d99c8c19-server-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"36a1c719-e302-4df3-99c5-5025d99c8c19\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 15:49:06 crc kubenswrapper[5120]: I0316 15:49:06.521523 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/39704fdb-36c4-41fe-8c13-35a3abb56c36-rabbitmq-tls\") pod \"rabbitmq-server-0\" (UID: \"39704fdb-36c4-41fe-8c13-35a3abb56c36\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 15:49:06 crc kubenswrapper[5120]: I0316 15:49:06.521539 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dw8vt\" (UniqueName: \"kubernetes.io/projected/39704fdb-36c4-41fe-8c13-35a3abb56c36-kube-api-access-dw8vt\") pod \"rabbitmq-server-0\" (UID: \"39704fdb-36c4-41fe-8c13-35a3abb56c36\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 15:49:06 crc kubenswrapper[5120]: I0316 15:49:06.521563 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/39704fdb-36c4-41fe-8c13-35a3abb56c36-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"39704fdb-36c4-41fe-8c13-35a3abb56c36\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 15:49:06 crc kubenswrapper[5120]: I0316 15:49:06.521649 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/36a1c719-e302-4df3-99c5-5025d99c8c19-plugins-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"36a1c719-e302-4df3-99c5-5025d99c8c19\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 15:49:06 crc kubenswrapper[5120]: I0316 15:49:06.521835 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"36a1c719-e302-4df3-99c5-5025d99c8c19\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 15:49:06 crc kubenswrapper[5120]: I0316 15:49:06.521876 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/39704fdb-36c4-41fe-8c13-35a3abb56c36-config-data\") pod \"rabbitmq-server-0\" (UID: \"39704fdb-36c4-41fe-8c13-35a3abb56c36\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 15:49:06 crc kubenswrapper[5120]: I0316 15:49:06.623507 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/36a1c719-e302-4df3-99c5-5025d99c8c19-plugins-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"36a1c719-e302-4df3-99c5-5025d99c8c19\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 15:49:06 crc kubenswrapper[5120]: I0316 15:49:06.623549 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"36a1c719-e302-4df3-99c5-5025d99c8c19\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 15:49:06 crc kubenswrapper[5120]: I0316 15:49:06.623573 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/39704fdb-36c4-41fe-8c13-35a3abb56c36-config-data\") pod \"rabbitmq-server-0\" (UID: \"39704fdb-36c4-41fe-8c13-35a3abb56c36\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 15:49:06 crc kubenswrapper[5120]: I0316 15:49:06.623749 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/36a1c719-e302-4df3-99c5-5025d99c8c19-rabbitmq-erlang-cookie\") pod \"rabbitmq-cell1-server-0\" (UID: \"36a1c719-e302-4df3-99c5-5025d99c8c19\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 15:49:06 crc kubenswrapper[5120]: I0316 15:49:06.623830 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/39704fdb-36c4-41fe-8c13-35a3abb56c36-server-conf\") pod \"rabbitmq-server-0\" (UID: \"39704fdb-36c4-41fe-8c13-35a3abb56c36\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 15:49:06 crc kubenswrapper[5120]: I0316 15:49:06.623863 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/39704fdb-36c4-41fe-8c13-35a3abb56c36-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"39704fdb-36c4-41fe-8c13-35a3abb56c36\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 15:49:06 crc kubenswrapper[5120]: I0316 15:49:06.623896 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/39704fdb-36c4-41fe-8c13-35a3abb56c36-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"39704fdb-36c4-41fe-8c13-35a3abb56c36\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 15:49:06 crc kubenswrapper[5120]: I0316 15:49:06.623920 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/39704fdb-36c4-41fe-8c13-35a3abb56c36-pod-info\") pod \"rabbitmq-server-0\" (UID: \"39704fdb-36c4-41fe-8c13-35a3abb56c36\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 15:49:06 crc kubenswrapper[5120]: I0316 15:49:06.623972 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hmhsd\" (UniqueName: \"kubernetes.io/projected/36a1c719-e302-4df3-99c5-5025d99c8c19-kube-api-access-hmhsd\") pod \"rabbitmq-cell1-server-0\" (UID: \"36a1c719-e302-4df3-99c5-5025d99c8c19\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 15:49:06 crc kubenswrapper[5120]: I0316 15:49:06.623969 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"36a1c719-e302-4df3-99c5-5025d99c8c19\") device mount path \"/mnt/openstack/pv01\"" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 15:49:06 crc kubenswrapper[5120]: I0316 15:49:06.623994 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/36a1c719-e302-4df3-99c5-5025d99c8c19-config-data\") pod \"rabbitmq-cell1-server-0\" (UID: \"36a1c719-e302-4df3-99c5-5025d99c8c19\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 15:49:06 crc kubenswrapper[5120]: I0316 15:49:06.624050 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/36a1c719-e302-4df3-99c5-5025d99c8c19-rabbitmq-plugins\") pod \"rabbitmq-cell1-server-0\" (UID: \"36a1c719-e302-4df3-99c5-5025d99c8c19\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 15:49:06 crc kubenswrapper[5120]: I0316 15:49:06.624067 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/39704fdb-36c4-41fe-8c13-35a3abb56c36-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"39704fdb-36c4-41fe-8c13-35a3abb56c36\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 15:49:06 crc kubenswrapper[5120]: I0316 15:49:06.624081 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/39704fdb-36c4-41fe-8c13-35a3abb56c36-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"39704fdb-36c4-41fe-8c13-35a3abb56c36\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 15:49:06 crc kubenswrapper[5120]: I0316 15:49:06.624101 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"rabbitmq-server-0\" (UID: \"39704fdb-36c4-41fe-8c13-35a3abb56c36\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 15:49:06 crc kubenswrapper[5120]: I0316 15:49:06.624120 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/36a1c719-e302-4df3-99c5-5025d99c8c19-rabbitmq-confd\") pod \"rabbitmq-cell1-server-0\" (UID: \"36a1c719-e302-4df3-99c5-5025d99c8c19\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 15:49:06 crc kubenswrapper[5120]: I0316 15:49:06.624144 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/36a1c719-e302-4df3-99c5-5025d99c8c19-erlang-cookie-secret\") pod \"rabbitmq-cell1-server-0\" (UID: \"36a1c719-e302-4df3-99c5-5025d99c8c19\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 15:49:06 crc kubenswrapper[5120]: I0316 15:49:06.624220 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/36a1c719-e302-4df3-99c5-5025d99c8c19-pod-info\") pod \"rabbitmq-cell1-server-0\" (UID: \"36a1c719-e302-4df3-99c5-5025d99c8c19\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 15:49:06 crc kubenswrapper[5120]: I0316 15:49:06.624235 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/36a1c719-e302-4df3-99c5-5025d99c8c19-rabbitmq-tls\") pod \"rabbitmq-cell1-server-0\" (UID: \"36a1c719-e302-4df3-99c5-5025d99c8c19\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 15:49:06 crc kubenswrapper[5120]: I0316 15:49:06.624252 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/36a1c719-e302-4df3-99c5-5025d99c8c19-server-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"36a1c719-e302-4df3-99c5-5025d99c8c19\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 15:49:06 crc kubenswrapper[5120]: I0316 15:49:06.624270 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/39704fdb-36c4-41fe-8c13-35a3abb56c36-rabbitmq-tls\") pod \"rabbitmq-server-0\" (UID: \"39704fdb-36c4-41fe-8c13-35a3abb56c36\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 15:49:06 crc kubenswrapper[5120]: I0316 15:49:06.624284 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dw8vt\" (UniqueName: \"kubernetes.io/projected/39704fdb-36c4-41fe-8c13-35a3abb56c36-kube-api-access-dw8vt\") pod \"rabbitmq-server-0\" (UID: \"39704fdb-36c4-41fe-8c13-35a3abb56c36\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 15:49:06 crc kubenswrapper[5120]: I0316 15:49:06.624320 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/39704fdb-36c4-41fe-8c13-35a3abb56c36-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"39704fdb-36c4-41fe-8c13-35a3abb56c36\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 15:49:06 crc kubenswrapper[5120]: I0316 15:49:06.624360 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/39704fdb-36c4-41fe-8c13-35a3abb56c36-config-data\") pod \"rabbitmq-server-0\" (UID: \"39704fdb-36c4-41fe-8c13-35a3abb56c36\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 15:49:06 crc kubenswrapper[5120]: I0316 15:49:06.624361 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/36a1c719-e302-4df3-99c5-5025d99c8c19-plugins-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"36a1c719-e302-4df3-99c5-5025d99c8c19\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 15:49:06 crc kubenswrapper[5120]: I0316 15:49:06.624627 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/36a1c719-e302-4df3-99c5-5025d99c8c19-rabbitmq-erlang-cookie\") pod \"rabbitmq-cell1-server-0\" (UID: \"36a1c719-e302-4df3-99c5-5025d99c8c19\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 15:49:06 crc kubenswrapper[5120]: I0316 15:49:06.624992 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/39704fdb-36c4-41fe-8c13-35a3abb56c36-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"39704fdb-36c4-41fe-8c13-35a3abb56c36\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 15:49:06 crc kubenswrapper[5120]: I0316 15:49:06.625230 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/39704fdb-36c4-41fe-8c13-35a3abb56c36-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"39704fdb-36c4-41fe-8c13-35a3abb56c36\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 15:49:06 crc kubenswrapper[5120]: I0316 15:49:06.625613 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/39704fdb-36c4-41fe-8c13-35a3abb56c36-server-conf\") pod \"rabbitmq-server-0\" (UID: \"39704fdb-36c4-41fe-8c13-35a3abb56c36\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 15:49:06 crc kubenswrapper[5120]: I0316 15:49:06.626403 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/36a1c719-e302-4df3-99c5-5025d99c8c19-config-data\") pod \"rabbitmq-cell1-server-0\" (UID: \"36a1c719-e302-4df3-99c5-5025d99c8c19\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 15:49:06 crc kubenswrapper[5120]: I0316 15:49:06.626626 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/36a1c719-e302-4df3-99c5-5025d99c8c19-rabbitmq-plugins\") pod \"rabbitmq-cell1-server-0\" (UID: \"36a1c719-e302-4df3-99c5-5025d99c8c19\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 15:49:06 crc kubenswrapper[5120]: I0316 15:49:06.627855 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/36a1c719-e302-4df3-99c5-5025d99c8c19-server-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"36a1c719-e302-4df3-99c5-5025d99c8c19\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 15:49:06 crc kubenswrapper[5120]: I0316 15:49:06.630556 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/39704fdb-36c4-41fe-8c13-35a3abb56c36-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"39704fdb-36c4-41fe-8c13-35a3abb56c36\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 15:49:06 crc kubenswrapper[5120]: I0316 15:49:06.631054 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/36a1c719-e302-4df3-99c5-5025d99c8c19-pod-info\") pod \"rabbitmq-cell1-server-0\" (UID: \"36a1c719-e302-4df3-99c5-5025d99c8c19\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 15:49:06 crc kubenswrapper[5120]: I0316 15:49:06.631445 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/36a1c719-e302-4df3-99c5-5025d99c8c19-rabbitmq-confd\") pod \"rabbitmq-cell1-server-0\" (UID: \"36a1c719-e302-4df3-99c5-5025d99c8c19\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 15:49:06 crc kubenswrapper[5120]: I0316 15:49:06.631566 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"rabbitmq-server-0\" (UID: \"39704fdb-36c4-41fe-8c13-35a3abb56c36\") device mount path \"/mnt/openstack/pv08\"" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 15:49:06 crc kubenswrapper[5120]: I0316 15:49:06.633736 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/36a1c719-e302-4df3-99c5-5025d99c8c19-rabbitmq-tls\") pod \"rabbitmq-cell1-server-0\" (UID: \"36a1c719-e302-4df3-99c5-5025d99c8c19\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 15:49:06 crc kubenswrapper[5120]: I0316 15:49:06.633951 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/39704fdb-36c4-41fe-8c13-35a3abb56c36-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"39704fdb-36c4-41fe-8c13-35a3abb56c36\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 15:49:06 crc kubenswrapper[5120]: I0316 15:49:06.634323 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/39704fdb-36c4-41fe-8c13-35a3abb56c36-pod-info\") pod \"rabbitmq-server-0\" (UID: \"39704fdb-36c4-41fe-8c13-35a3abb56c36\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 15:49:06 crc kubenswrapper[5120]: I0316 15:49:06.634328 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/36a1c719-e302-4df3-99c5-5025d99c8c19-erlang-cookie-secret\") pod \"rabbitmq-cell1-server-0\" (UID: \"36a1c719-e302-4df3-99c5-5025d99c8c19\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 15:49:06 crc kubenswrapper[5120]: I0316 15:49:06.638247 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/39704fdb-36c4-41fe-8c13-35a3abb56c36-rabbitmq-tls\") pod \"rabbitmq-server-0\" (UID: \"39704fdb-36c4-41fe-8c13-35a3abb56c36\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 15:49:06 crc kubenswrapper[5120]: I0316 15:49:06.641949 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmhsd\" (UniqueName: \"kubernetes.io/projected/36a1c719-e302-4df3-99c5-5025d99c8c19-kube-api-access-hmhsd\") pod \"rabbitmq-cell1-server-0\" (UID: \"36a1c719-e302-4df3-99c5-5025d99c8c19\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 15:49:06 crc kubenswrapper[5120]: I0316 15:49:06.652721 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/39704fdb-36c4-41fe-8c13-35a3abb56c36-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"39704fdb-36c4-41fe-8c13-35a3abb56c36\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 15:49:06 crc kubenswrapper[5120]: I0316 15:49:06.655872 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"rabbitmq-server-0\" (UID: \"39704fdb-36c4-41fe-8c13-35a3abb56c36\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 15:49:06 crc kubenswrapper[5120]: I0316 15:49:06.656346 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dw8vt\" (UniqueName: \"kubernetes.io/projected/39704fdb-36c4-41fe-8c13-35a3abb56c36-kube-api-access-dw8vt\") pod \"rabbitmq-server-0\" (UID: \"39704fdb-36c4-41fe-8c13-35a3abb56c36\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 15:49:06 crc kubenswrapper[5120]: I0316 15:49:06.672374 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"36a1c719-e302-4df3-99c5-5025d99c8c19\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 15:49:06 crc kubenswrapper[5120]: I0316 15:49:06.723162 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 15:49:06 crc kubenswrapper[5120]: I0316 15:49:06.812031 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 15:49:07 crc kubenswrapper[5120]: E0316 15:49:07.791635 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1234077 actualBytes=10240 Mar 16 15:49:07 crc kubenswrapper[5120]: I0316 15:49:07.822835 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 15:49:07 crc kubenswrapper[5120]: I0316 15:49:07.895408 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 15:49:07 crc kubenswrapper[5120]: I0316 15:49:07.895550 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 15:49:07 crc kubenswrapper[5120]: I0316 15:49:07.898501 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-galera-openstack-svc\"" Mar 16 15:49:07 crc kubenswrapper[5120]: I0316 15:49:07.900388 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-scripts\"" Mar 16 15:49:07 crc kubenswrapper[5120]: I0316 15:49:07.900570 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-config-data\"" Mar 16 15:49:07 crc kubenswrapper[5120]: I0316 15:49:07.900715 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"galera-openstack-dockercfg-xmxrl\"" Mar 16 15:49:07 crc kubenswrapper[5120]: I0316 15:49:07.906727 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"combined-ca-bundle\"" Mar 16 15:49:07 crc kubenswrapper[5120]: I0316 15:49:07.957184 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/c95ad7ed-1944-4285-9138-0d4b954aa727-config-data-default\") pod \"openstack-galera-0\" (UID: \"c95ad7ed-1944-4285-9138-0d4b954aa727\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 15:49:07 crc kubenswrapper[5120]: I0316 15:49:07.957234 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c95ad7ed-1944-4285-9138-0d4b954aa727-operator-scripts\") pod \"openstack-galera-0\" (UID: \"c95ad7ed-1944-4285-9138-0d4b954aa727\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 15:49:07 crc kubenswrapper[5120]: I0316 15:49:07.957288 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/c95ad7ed-1944-4285-9138-0d4b954aa727-kolla-config\") pod \"openstack-galera-0\" (UID: \"c95ad7ed-1944-4285-9138-0d4b954aa727\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 15:49:07 crc kubenswrapper[5120]: I0316 15:49:07.957390 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zsjnj\" (UniqueName: \"kubernetes.io/projected/c95ad7ed-1944-4285-9138-0d4b954aa727-kube-api-access-zsjnj\") pod \"openstack-galera-0\" (UID: \"c95ad7ed-1944-4285-9138-0d4b954aa727\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 15:49:07 crc kubenswrapper[5120]: I0316 15:49:07.957510 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c95ad7ed-1944-4285-9138-0d4b954aa727-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"c95ad7ed-1944-4285-9138-0d4b954aa727\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 15:49:07 crc kubenswrapper[5120]: I0316 15:49:07.957794 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/c95ad7ed-1944-4285-9138-0d4b954aa727-config-data-generated\") pod \"openstack-galera-0\" (UID: \"c95ad7ed-1944-4285-9138-0d4b954aa727\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 15:49:07 crc kubenswrapper[5120]: I0316 15:49:07.957857 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/c95ad7ed-1944-4285-9138-0d4b954aa727-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"c95ad7ed-1944-4285-9138-0d4b954aa727\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 15:49:07 crc kubenswrapper[5120]: I0316 15:49:07.957907 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"openstack-galera-0\" (UID: \"c95ad7ed-1944-4285-9138-0d4b954aa727\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 15:49:08 crc kubenswrapper[5120]: I0316 15:49:08.059299 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/c95ad7ed-1944-4285-9138-0d4b954aa727-config-data-generated\") pod \"openstack-galera-0\" (UID: \"c95ad7ed-1944-4285-9138-0d4b954aa727\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 15:49:08 crc kubenswrapper[5120]: I0316 15:49:08.059370 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/c95ad7ed-1944-4285-9138-0d4b954aa727-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"c95ad7ed-1944-4285-9138-0d4b954aa727\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 15:49:08 crc kubenswrapper[5120]: I0316 15:49:08.059411 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"openstack-galera-0\" (UID: \"c95ad7ed-1944-4285-9138-0d4b954aa727\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 15:49:08 crc kubenswrapper[5120]: I0316 15:49:08.059460 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/c95ad7ed-1944-4285-9138-0d4b954aa727-config-data-default\") pod \"openstack-galera-0\" (UID: \"c95ad7ed-1944-4285-9138-0d4b954aa727\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 15:49:08 crc kubenswrapper[5120]: I0316 15:49:08.059490 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c95ad7ed-1944-4285-9138-0d4b954aa727-operator-scripts\") pod \"openstack-galera-0\" (UID: \"c95ad7ed-1944-4285-9138-0d4b954aa727\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 15:49:08 crc kubenswrapper[5120]: I0316 15:49:08.059542 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/c95ad7ed-1944-4285-9138-0d4b954aa727-kolla-config\") pod \"openstack-galera-0\" (UID: \"c95ad7ed-1944-4285-9138-0d4b954aa727\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 15:49:08 crc kubenswrapper[5120]: I0316 15:49:08.059571 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zsjnj\" (UniqueName: \"kubernetes.io/projected/c95ad7ed-1944-4285-9138-0d4b954aa727-kube-api-access-zsjnj\") pod \"openstack-galera-0\" (UID: \"c95ad7ed-1944-4285-9138-0d4b954aa727\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 15:49:08 crc kubenswrapper[5120]: I0316 15:49:08.059623 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c95ad7ed-1944-4285-9138-0d4b954aa727-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"c95ad7ed-1944-4285-9138-0d4b954aa727\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 15:49:08 crc kubenswrapper[5120]: I0316 15:49:08.059672 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/c95ad7ed-1944-4285-9138-0d4b954aa727-config-data-generated\") pod \"openstack-galera-0\" (UID: \"c95ad7ed-1944-4285-9138-0d4b954aa727\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 15:49:08 crc kubenswrapper[5120]: I0316 15:49:08.060398 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/c95ad7ed-1944-4285-9138-0d4b954aa727-config-data-default\") pod \"openstack-galera-0\" (UID: \"c95ad7ed-1944-4285-9138-0d4b954aa727\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 15:49:08 crc kubenswrapper[5120]: I0316 15:49:08.061522 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"openstack-galera-0\" (UID: \"c95ad7ed-1944-4285-9138-0d4b954aa727\") device mount path \"/mnt/openstack/pv04\"" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 15:49:08 crc kubenswrapper[5120]: I0316 15:49:08.062000 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/c95ad7ed-1944-4285-9138-0d4b954aa727-kolla-config\") pod \"openstack-galera-0\" (UID: \"c95ad7ed-1944-4285-9138-0d4b954aa727\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 15:49:08 crc kubenswrapper[5120]: I0316 15:49:08.063658 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c95ad7ed-1944-4285-9138-0d4b954aa727-operator-scripts\") pod \"openstack-galera-0\" (UID: \"c95ad7ed-1944-4285-9138-0d4b954aa727\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 15:49:08 crc kubenswrapper[5120]: I0316 15:49:08.066532 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c95ad7ed-1944-4285-9138-0d4b954aa727-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"c95ad7ed-1944-4285-9138-0d4b954aa727\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 15:49:08 crc kubenswrapper[5120]: I0316 15:49:08.067322 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/c95ad7ed-1944-4285-9138-0d4b954aa727-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"c95ad7ed-1944-4285-9138-0d4b954aa727\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 15:49:08 crc kubenswrapper[5120]: I0316 15:49:08.090071 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zsjnj\" (UniqueName: \"kubernetes.io/projected/c95ad7ed-1944-4285-9138-0d4b954aa727-kube-api-access-zsjnj\") pod \"openstack-galera-0\" (UID: \"c95ad7ed-1944-4285-9138-0d4b954aa727\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 15:49:08 crc kubenswrapper[5120]: I0316 15:49:08.092820 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"openstack-galera-0\" (UID: \"c95ad7ed-1944-4285-9138-0d4b954aa727\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 15:49:08 crc kubenswrapper[5120]: I0316 15:49:08.221944 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 15:49:09 crc kubenswrapper[5120]: I0316 15:49:09.150905 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 15:49:09 crc kubenswrapper[5120]: I0316 15:49:09.163455 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 15:49:09 crc kubenswrapper[5120]: I0316 15:49:09.163589 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 15:49:09 crc kubenswrapper[5120]: I0316 15:49:09.165997 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-galera-openstack-cell1-svc\"" Mar 16 15:49:09 crc kubenswrapper[5120]: I0316 15:49:09.167354 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-cell1-config-data\"" Mar 16 15:49:09 crc kubenswrapper[5120]: I0316 15:49:09.167495 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-cell1-scripts\"" Mar 16 15:49:09 crc kubenswrapper[5120]: I0316 15:49:09.167807 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"galera-openstack-cell1-dockercfg-7bz8k\"" Mar 16 15:49:09 crc kubenswrapper[5120]: I0316 15:49:09.276155 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7cg4\" (UniqueName: \"kubernetes.io/projected/14486849-fbb1-4cc9-8aa3-714e263c55fb-kube-api-access-p7cg4\") pod \"openstack-cell1-galera-0\" (UID: \"14486849-fbb1-4cc9-8aa3-714e263c55fb\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 15:49:09 crc kubenswrapper[5120]: I0316 15:49:09.276206 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/14486849-fbb1-4cc9-8aa3-714e263c55fb-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"14486849-fbb1-4cc9-8aa3-714e263c55fb\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 15:49:09 crc kubenswrapper[5120]: I0316 15:49:09.276345 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/14486849-fbb1-4cc9-8aa3-714e263c55fb-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"14486849-fbb1-4cc9-8aa3-714e263c55fb\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 15:49:09 crc kubenswrapper[5120]: I0316 15:49:09.276429 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/14486849-fbb1-4cc9-8aa3-714e263c55fb-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"14486849-fbb1-4cc9-8aa3-714e263c55fb\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 15:49:09 crc kubenswrapper[5120]: I0316 15:49:09.276470 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/14486849-fbb1-4cc9-8aa3-714e263c55fb-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"14486849-fbb1-4cc9-8aa3-714e263c55fb\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 15:49:09 crc kubenswrapper[5120]: I0316 15:49:09.276593 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"openstack-cell1-galera-0\" (UID: \"14486849-fbb1-4cc9-8aa3-714e263c55fb\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 15:49:09 crc kubenswrapper[5120]: I0316 15:49:09.276676 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/14486849-fbb1-4cc9-8aa3-714e263c55fb-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"14486849-fbb1-4cc9-8aa3-714e263c55fb\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 15:49:09 crc kubenswrapper[5120]: I0316 15:49:09.276733 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/14486849-fbb1-4cc9-8aa3-714e263c55fb-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"14486849-fbb1-4cc9-8aa3-714e263c55fb\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 15:49:09 crc kubenswrapper[5120]: I0316 15:49:09.294272 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 15:49:09 crc kubenswrapper[5120]: I0316 15:49:09.301090 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Mar 16 15:49:09 crc kubenswrapper[5120]: I0316 15:49:09.307976 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"memcached-config-data\"" Mar 16 15:49:09 crc kubenswrapper[5120]: I0316 15:49:09.307988 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"memcached-memcached-dockercfg-l8bff\"" Mar 16 15:49:09 crc kubenswrapper[5120]: I0316 15:49:09.309900 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-memcached-svc\"" Mar 16 15:49:09 crc kubenswrapper[5120]: I0316 15:49:09.322045 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 15:49:09 crc kubenswrapper[5120]: I0316 15:49:09.377589 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/14486849-fbb1-4cc9-8aa3-714e263c55fb-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"14486849-fbb1-4cc9-8aa3-714e263c55fb\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 15:49:09 crc kubenswrapper[5120]: I0316 15:49:09.377638 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/90534d56-28ff-4983-b8ea-be83259ce64d-kolla-config\") pod \"memcached-0\" (UID: \"90534d56-28ff-4983-b8ea-be83259ce64d\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 15:49:09 crc kubenswrapper[5120]: I0316 15:49:09.377658 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/90534d56-28ff-4983-b8ea-be83259ce64d-config-data\") pod \"memcached-0\" (UID: \"90534d56-28ff-4983-b8ea-be83259ce64d\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 15:49:09 crc kubenswrapper[5120]: I0316 15:49:09.377716 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p7cg4\" (UniqueName: \"kubernetes.io/projected/14486849-fbb1-4cc9-8aa3-714e263c55fb-kube-api-access-p7cg4\") pod \"openstack-cell1-galera-0\" (UID: \"14486849-fbb1-4cc9-8aa3-714e263c55fb\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 15:49:09 crc kubenswrapper[5120]: I0316 15:49:09.377736 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/14486849-fbb1-4cc9-8aa3-714e263c55fb-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"14486849-fbb1-4cc9-8aa3-714e263c55fb\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 15:49:09 crc kubenswrapper[5120]: I0316 15:49:09.377783 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/14486849-fbb1-4cc9-8aa3-714e263c55fb-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"14486849-fbb1-4cc9-8aa3-714e263c55fb\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 15:49:09 crc kubenswrapper[5120]: I0316 15:49:09.377813 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/14486849-fbb1-4cc9-8aa3-714e263c55fb-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"14486849-fbb1-4cc9-8aa3-714e263c55fb\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 15:49:09 crc kubenswrapper[5120]: I0316 15:49:09.377836 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/90534d56-28ff-4983-b8ea-be83259ce64d-memcached-tls-certs\") pod \"memcached-0\" (UID: \"90534d56-28ff-4983-b8ea-be83259ce64d\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 15:49:09 crc kubenswrapper[5120]: I0316 15:49:09.377857 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/14486849-fbb1-4cc9-8aa3-714e263c55fb-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"14486849-fbb1-4cc9-8aa3-714e263c55fb\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 15:49:09 crc kubenswrapper[5120]: I0316 15:49:09.377887 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxddx\" (UniqueName: \"kubernetes.io/projected/90534d56-28ff-4983-b8ea-be83259ce64d-kube-api-access-mxddx\") pod \"memcached-0\" (UID: \"90534d56-28ff-4983-b8ea-be83259ce64d\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 15:49:09 crc kubenswrapper[5120]: I0316 15:49:09.377911 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"openstack-cell1-galera-0\" (UID: \"14486849-fbb1-4cc9-8aa3-714e263c55fb\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 15:49:09 crc kubenswrapper[5120]: I0316 15:49:09.377926 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/90534d56-28ff-4983-b8ea-be83259ce64d-combined-ca-bundle\") pod \"memcached-0\" (UID: \"90534d56-28ff-4983-b8ea-be83259ce64d\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 15:49:09 crc kubenswrapper[5120]: I0316 15:49:09.377954 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/14486849-fbb1-4cc9-8aa3-714e263c55fb-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"14486849-fbb1-4cc9-8aa3-714e263c55fb\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 15:49:09 crc kubenswrapper[5120]: I0316 15:49:09.379246 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/14486849-fbb1-4cc9-8aa3-714e263c55fb-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"14486849-fbb1-4cc9-8aa3-714e263c55fb\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 15:49:09 crc kubenswrapper[5120]: I0316 15:49:09.379454 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/14486849-fbb1-4cc9-8aa3-714e263c55fb-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"14486849-fbb1-4cc9-8aa3-714e263c55fb\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 15:49:09 crc kubenswrapper[5120]: I0316 15:49:09.379933 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"openstack-cell1-galera-0\" (UID: \"14486849-fbb1-4cc9-8aa3-714e263c55fb\") device mount path \"/mnt/openstack/pv12\"" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 15:49:09 crc kubenswrapper[5120]: I0316 15:49:09.380379 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/14486849-fbb1-4cc9-8aa3-714e263c55fb-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"14486849-fbb1-4cc9-8aa3-714e263c55fb\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 15:49:09 crc kubenswrapper[5120]: I0316 15:49:09.384614 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/14486849-fbb1-4cc9-8aa3-714e263c55fb-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"14486849-fbb1-4cc9-8aa3-714e263c55fb\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 15:49:09 crc kubenswrapper[5120]: I0316 15:49:09.384838 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/14486849-fbb1-4cc9-8aa3-714e263c55fb-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"14486849-fbb1-4cc9-8aa3-714e263c55fb\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 15:49:09 crc kubenswrapper[5120]: I0316 15:49:09.391867 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/14486849-fbb1-4cc9-8aa3-714e263c55fb-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"14486849-fbb1-4cc9-8aa3-714e263c55fb\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 15:49:09 crc kubenswrapper[5120]: I0316 15:49:09.395621 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7cg4\" (UniqueName: \"kubernetes.io/projected/14486849-fbb1-4cc9-8aa3-714e263c55fb-kube-api-access-p7cg4\") pod \"openstack-cell1-galera-0\" (UID: \"14486849-fbb1-4cc9-8aa3-714e263c55fb\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 15:49:09 crc kubenswrapper[5120]: I0316 15:49:09.401633 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"openstack-cell1-galera-0\" (UID: \"14486849-fbb1-4cc9-8aa3-714e263c55fb\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 15:49:09 crc kubenswrapper[5120]: I0316 15:49:09.478126 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 15:49:09 crc kubenswrapper[5120]: I0316 15:49:09.479461 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/90534d56-28ff-4983-b8ea-be83259ce64d-memcached-tls-certs\") pod \"memcached-0\" (UID: \"90534d56-28ff-4983-b8ea-be83259ce64d\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 15:49:09 crc kubenswrapper[5120]: I0316 15:49:09.479514 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mxddx\" (UniqueName: \"kubernetes.io/projected/90534d56-28ff-4983-b8ea-be83259ce64d-kube-api-access-mxddx\") pod \"memcached-0\" (UID: \"90534d56-28ff-4983-b8ea-be83259ce64d\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 15:49:09 crc kubenswrapper[5120]: I0316 15:49:09.479534 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/90534d56-28ff-4983-b8ea-be83259ce64d-combined-ca-bundle\") pod \"memcached-0\" (UID: \"90534d56-28ff-4983-b8ea-be83259ce64d\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 15:49:09 crc kubenswrapper[5120]: I0316 15:49:09.479576 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/90534d56-28ff-4983-b8ea-be83259ce64d-kolla-config\") pod \"memcached-0\" (UID: \"90534d56-28ff-4983-b8ea-be83259ce64d\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 15:49:09 crc kubenswrapper[5120]: I0316 15:49:09.479593 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/90534d56-28ff-4983-b8ea-be83259ce64d-config-data\") pod \"memcached-0\" (UID: \"90534d56-28ff-4983-b8ea-be83259ce64d\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 15:49:09 crc kubenswrapper[5120]: I0316 15:49:09.480355 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/90534d56-28ff-4983-b8ea-be83259ce64d-config-data\") pod \"memcached-0\" (UID: \"90534d56-28ff-4983-b8ea-be83259ce64d\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 15:49:09 crc kubenswrapper[5120]: I0316 15:49:09.480539 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/90534d56-28ff-4983-b8ea-be83259ce64d-kolla-config\") pod \"memcached-0\" (UID: \"90534d56-28ff-4983-b8ea-be83259ce64d\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 15:49:09 crc kubenswrapper[5120]: I0316 15:49:09.483284 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/90534d56-28ff-4983-b8ea-be83259ce64d-combined-ca-bundle\") pod \"memcached-0\" (UID: \"90534d56-28ff-4983-b8ea-be83259ce64d\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 15:49:09 crc kubenswrapper[5120]: I0316 15:49:09.483945 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/90534d56-28ff-4983-b8ea-be83259ce64d-memcached-tls-certs\") pod \"memcached-0\" (UID: \"90534d56-28ff-4983-b8ea-be83259ce64d\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 15:49:09 crc kubenswrapper[5120]: I0316 15:49:09.494320 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxddx\" (UniqueName: \"kubernetes.io/projected/90534d56-28ff-4983-b8ea-be83259ce64d-kube-api-access-mxddx\") pod \"memcached-0\" (UID: \"90534d56-28ff-4983-b8ea-be83259ce64d\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 15:49:09 crc kubenswrapper[5120]: I0316 15:49:09.618852 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Mar 16 15:49:09 crc kubenswrapper[5120]: I0316 15:49:09.991532 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 15:49:10 crc kubenswrapper[5120]: W0316 15:49:10.011045 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39704fdb_36c4_41fe_8c13_35a3abb56c36.slice/crio-08e9d220be08c78853179ffc3de22d9096fe16e5752598b66ae55a1717adfb01 WatchSource:0}: Error finding container 08e9d220be08c78853179ffc3de22d9096fe16e5752598b66ae55a1717adfb01: Status 404 returned error can't find the container with id 08e9d220be08c78853179ffc3de22d9096fe16e5752598b66ae55a1717adfb01 Mar 16 15:49:10 crc kubenswrapper[5120]: I0316 15:49:10.015218 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 15:49:10 crc kubenswrapper[5120]: I0316 15:49:10.098686 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 15:49:10 crc kubenswrapper[5120]: I0316 15:49:10.112270 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 15:49:10 crc kubenswrapper[5120]: W0316 15:49:10.117988 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc95ad7ed_1944_4285_9138_0d4b954aa727.slice/crio-0791fd8d2f627e49ecf936921dadd0893d1de3fc774a289889bce63ea4bbcdf8 WatchSource:0}: Error finding container 0791fd8d2f627e49ecf936921dadd0893d1de3fc774a289889bce63ea4bbcdf8: Status 404 returned error can't find the container with id 0791fd8d2f627e49ecf936921dadd0893d1de3fc774a289889bce63ea4bbcdf8 Mar 16 15:49:10 crc kubenswrapper[5120]: W0316 15:49:10.118506 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36a1c719_e302_4df3_99c5_5025d99c8c19.slice/crio-0fc45789c6f9b438e93f839e5b4c471c1653680d1bc219aa8c8708aa9bbc71ee WatchSource:0}: Error finding container 0fc45789c6f9b438e93f839e5b4c471c1653680d1bc219aa8c8708aa9bbc71ee: Status 404 returned error can't find the container with id 0fc45789c6f9b438e93f839e5b4c471c1653680d1bc219aa8c8708aa9bbc71ee Mar 16 15:49:10 crc kubenswrapper[5120]: I0316 15:49:10.279136 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 15:49:10 crc kubenswrapper[5120]: W0316 15:49:10.291933 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod90534d56_28ff_4983_b8ea_be83259ce64d.slice/crio-97d3d59ff745a33f7c7ce3d0202811e858cf720ad2d2b4c36ffefb6755dc6d9d WatchSource:0}: Error finding container 97d3d59ff745a33f7c7ce3d0202811e858cf720ad2d2b4c36ffefb6755dc6d9d: Status 404 returned error can't find the container with id 97d3d59ff745a33f7c7ce3d0202811e858cf720ad2d2b4c36ffefb6755dc6d9d Mar 16 15:49:10 crc kubenswrapper[5120]: I0316 15:49:10.639490 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"14486849-fbb1-4cc9-8aa3-714e263c55fb","Type":"ContainerStarted","Data":"67b6cc78be5822ca9fa08b0e577299a67bea362b9914d26f394d0aea31ccd13a"} Mar 16 15:49:10 crc kubenswrapper[5120]: I0316 15:49:10.646240 5120 generic.go:358] "Generic (PLEG): container finished" podID="66fbf6ad-9a00-472a-9848-6647d7eff53d" containerID="c08bd21cdf559fd8bd8dfde54dc018682d6bee5a6647b5bcd803c76a8384bb6f" exitCode=0 Mar 16 15:49:10 crc kubenswrapper[5120]: I0316 15:49:10.646321 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-tpgs2" event={"ID":"66fbf6ad-9a00-472a-9848-6647d7eff53d","Type":"ContainerDied","Data":"c08bd21cdf559fd8bd8dfde54dc018682d6bee5a6647b5bcd803c76a8384bb6f"} Mar 16 15:49:10 crc kubenswrapper[5120]: I0316 15:49:10.653335 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"c95ad7ed-1944-4285-9138-0d4b954aa727","Type":"ContainerStarted","Data":"0791fd8d2f627e49ecf936921dadd0893d1de3fc774a289889bce63ea4bbcdf8"} Mar 16 15:49:10 crc kubenswrapper[5120]: I0316 15:49:10.662477 5120 generic.go:358] "Generic (PLEG): container finished" podID="cd214905-94a1-43b8-8966-734672c54a00" containerID="36eef28b51e96a5a5700cb67b84171650673a5cd6985fab9246f887617ff7acd" exitCode=0 Mar 16 15:49:10 crc kubenswrapper[5120]: I0316 15:49:10.662586 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58748b8b69-49q6v" event={"ID":"cd214905-94a1-43b8-8966-734672c54a00","Type":"ContainerDied","Data":"36eef28b51e96a5a5700cb67b84171650673a5cd6985fab9246f887617ff7acd"} Mar 16 15:49:10 crc kubenswrapper[5120]: I0316 15:49:10.706650 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"39704fdb-36c4-41fe-8c13-35a3abb56c36","Type":"ContainerStarted","Data":"08e9d220be08c78853179ffc3de22d9096fe16e5752598b66ae55a1717adfb01"} Mar 16 15:49:10 crc kubenswrapper[5120]: I0316 15:49:10.706835 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"90534d56-28ff-4983-b8ea-be83259ce64d","Type":"ContainerStarted","Data":"97d3d59ff745a33f7c7ce3d0202811e858cf720ad2d2b4c36ffefb6755dc6d9d"} Mar 16 15:49:10 crc kubenswrapper[5120]: I0316 15:49:10.712920 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"36a1c719-e302-4df3-99c5-5025d99c8c19","Type":"ContainerStarted","Data":"0fc45789c6f9b438e93f839e5b4c471c1653680d1bc219aa8c8708aa9bbc71ee"} Mar 16 15:49:11 crc kubenswrapper[5120]: I0316 15:49:11.694474 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 15:49:11 crc kubenswrapper[5120]: I0316 15:49:11.708249 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 15:49:11 crc kubenswrapper[5120]: I0316 15:49:11.708367 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 15:49:11 crc kubenswrapper[5120]: I0316 15:49:11.713686 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"telemetry-ceilometer-dockercfg-w249d\"" Mar 16 15:49:11 crc kubenswrapper[5120]: I0316 15:49:11.727401 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n84vz\" (UniqueName: \"kubernetes.io/projected/7d8e526d-4a8a-465b-bff3-9de49218452e-kube-api-access-n84vz\") pod \"kube-state-metrics-0\" (UID: \"7d8e526d-4a8a-465b-bff3-9de49218452e\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 15:49:11 crc kubenswrapper[5120]: I0316 15:49:11.739966 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58748b8b69-49q6v" event={"ID":"cd214905-94a1-43b8-8966-734672c54a00","Type":"ContainerStarted","Data":"4f7bc0b428cfc39c10b0885c5eee43a99b74cf4ef9b0beb6d088cc5f6fd4d573"} Mar 16 15:49:11 crc kubenswrapper[5120]: I0316 15:49:11.740043 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58748b8b69-49q6v" Mar 16 15:49:11 crc kubenswrapper[5120]: I0316 15:49:11.746546 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-tpgs2" event={"ID":"66fbf6ad-9a00-472a-9848-6647d7eff53d","Type":"ContainerStarted","Data":"ddfb58932facd381fc415079117e6d43753a8137f61cd47075a60abcf3bb8769"} Mar 16 15:49:11 crc kubenswrapper[5120]: I0316 15:49:11.746639 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-tpgs2" Mar 16 15:49:11 crc kubenswrapper[5120]: I0316 15:49:11.786046 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58748b8b69-49q6v" podStartSLOduration=3.145917194 podStartE2EDuration="16.786027952s" podCreationTimestamp="2026-03-16 15:48:55 +0000 UTC" firstStartedPulling="2026-03-16 15:48:56.04883412 +0000 UTC m=+1038.202765797" lastFinishedPulling="2026-03-16 15:49:09.688944898 +0000 UTC m=+1051.842876555" observedRunningTime="2026-03-16 15:49:11.761399975 +0000 UTC m=+1053.915331632" watchObservedRunningTime="2026-03-16 15:49:11.786027952 +0000 UTC m=+1053.939959609" Mar 16 15:49:11 crc kubenswrapper[5120]: I0316 15:49:11.786457 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-tpgs2" podStartSLOduration=3.160957104 podStartE2EDuration="16.786452874s" podCreationTimestamp="2026-03-16 15:48:55 +0000 UTC" firstStartedPulling="2026-03-16 15:48:56.126143607 +0000 UTC m=+1038.280075274" lastFinishedPulling="2026-03-16 15:49:09.751639387 +0000 UTC m=+1051.905571044" observedRunningTime="2026-03-16 15:49:11.784454158 +0000 UTC m=+1053.938385815" watchObservedRunningTime="2026-03-16 15:49:11.786452874 +0000 UTC m=+1053.940384531" Mar 16 15:49:11 crc kubenswrapper[5120]: I0316 15:49:11.829036 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n84vz\" (UniqueName: \"kubernetes.io/projected/7d8e526d-4a8a-465b-bff3-9de49218452e-kube-api-access-n84vz\") pod \"kube-state-metrics-0\" (UID: \"7d8e526d-4a8a-465b-bff3-9de49218452e\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 15:49:11 crc kubenswrapper[5120]: I0316 15:49:11.850121 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n84vz\" (UniqueName: \"kubernetes.io/projected/7d8e526d-4a8a-465b-bff3-9de49218452e-kube-api-access-n84vz\") pod \"kube-state-metrics-0\" (UID: \"7d8e526d-4a8a-465b-bff3-9de49218452e\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 15:49:12 crc kubenswrapper[5120]: I0316 15:49:12.035658 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 15:49:12 crc kubenswrapper[5120]: I0316 15:49:12.498590 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 15:49:14 crc kubenswrapper[5120]: W0316 15:49:14.264316 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7d8e526d_4a8a_465b_bff3_9de49218452e.slice/crio-ca996dbc39852f350f4b70bb10612ae49ec53cd462a9bd87bed21dbbaeeb34b8 WatchSource:0}: Error finding container ca996dbc39852f350f4b70bb10612ae49ec53cd462a9bd87bed21dbbaeeb34b8: Status 404 returned error can't find the container with id ca996dbc39852f350f4b70bb10612ae49ec53cd462a9bd87bed21dbbaeeb34b8 Mar 16 15:49:14 crc kubenswrapper[5120]: I0316 15:49:14.773210 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"7d8e526d-4a8a-465b-bff3-9de49218452e","Type":"ContainerStarted","Data":"ca996dbc39852f350f4b70bb10612ae49ec53cd462a9bd87bed21dbbaeeb34b8"} Mar 16 15:49:16 crc kubenswrapper[5120]: I0316 15:49:16.581670 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 15:49:16 crc kubenswrapper[5120]: I0316 15:49:16.593429 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 15:49:16 crc kubenswrapper[5120]: I0316 15:49:16.593567 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 15:49:16 crc kubenswrapper[5120]: I0316 15:49:16.596215 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ovncluster-ovndbcluster-nb-dockercfg-phqk8\"" Mar 16 15:49:16 crc kubenswrapper[5120]: I0316 15:49:16.597277 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ovn-metrics\"" Mar 16 15:49:16 crc kubenswrapper[5120]: I0316 15:49:16.597783 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovndbcluster-nb-config\"" Mar 16 15:49:16 crc kubenswrapper[5120]: I0316 15:49:16.598002 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovndbcluster-nb-scripts\"" Mar 16 15:49:16 crc kubenswrapper[5120]: I0316 15:49:16.598474 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ovndbcluster-nb-ovndbs\"" Mar 16 15:49:16 crc kubenswrapper[5120]: I0316 15:49:16.711265 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/a7b8bb1c-b58a-43a6-8457-88a025588f1e-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"a7b8bb1c-b58a-43a6-8457-88a025588f1e\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 15:49:16 crc kubenswrapper[5120]: I0316 15:49:16.711341 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/a7b8bb1c-b58a-43a6-8457-88a025588f1e-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"a7b8bb1c-b58a-43a6-8457-88a025588f1e\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 15:49:16 crc kubenswrapper[5120]: I0316 15:49:16.711361 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/a7b8bb1c-b58a-43a6-8457-88a025588f1e-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"a7b8bb1c-b58a-43a6-8457-88a025588f1e\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 15:49:16 crc kubenswrapper[5120]: I0316 15:49:16.711431 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5w62m\" (UniqueName: \"kubernetes.io/projected/a7b8bb1c-b58a-43a6-8457-88a025588f1e-kube-api-access-5w62m\") pod \"ovsdbserver-nb-0\" (UID: \"a7b8bb1c-b58a-43a6-8457-88a025588f1e\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 15:49:16 crc kubenswrapper[5120]: I0316 15:49:16.711537 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage15-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage15-crc\") pod \"ovsdbserver-nb-0\" (UID: \"a7b8bb1c-b58a-43a6-8457-88a025588f1e\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 15:49:16 crc kubenswrapper[5120]: I0316 15:49:16.711620 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/a7b8bb1c-b58a-43a6-8457-88a025588f1e-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"a7b8bb1c-b58a-43a6-8457-88a025588f1e\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 15:49:16 crc kubenswrapper[5120]: I0316 15:49:16.711755 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a7b8bb1c-b58a-43a6-8457-88a025588f1e-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"a7b8bb1c-b58a-43a6-8457-88a025588f1e\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 15:49:16 crc kubenswrapper[5120]: I0316 15:49:16.711825 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a7b8bb1c-b58a-43a6-8457-88a025588f1e-config\") pod \"ovsdbserver-nb-0\" (UID: \"a7b8bb1c-b58a-43a6-8457-88a025588f1e\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 15:49:16 crc kubenswrapper[5120]: I0316 15:49:16.813954 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/a7b8bb1c-b58a-43a6-8457-88a025588f1e-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"a7b8bb1c-b58a-43a6-8457-88a025588f1e\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 15:49:16 crc kubenswrapper[5120]: I0316 15:49:16.814166 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a7b8bb1c-b58a-43a6-8457-88a025588f1e-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"a7b8bb1c-b58a-43a6-8457-88a025588f1e\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 15:49:16 crc kubenswrapper[5120]: I0316 15:49:16.814271 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a7b8bb1c-b58a-43a6-8457-88a025588f1e-config\") pod \"ovsdbserver-nb-0\" (UID: \"a7b8bb1c-b58a-43a6-8457-88a025588f1e\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 15:49:16 crc kubenswrapper[5120]: I0316 15:49:16.814349 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/a7b8bb1c-b58a-43a6-8457-88a025588f1e-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"a7b8bb1c-b58a-43a6-8457-88a025588f1e\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 15:49:16 crc kubenswrapper[5120]: I0316 15:49:16.814467 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/a7b8bb1c-b58a-43a6-8457-88a025588f1e-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"a7b8bb1c-b58a-43a6-8457-88a025588f1e\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 15:49:16 crc kubenswrapper[5120]: I0316 15:49:16.814485 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/a7b8bb1c-b58a-43a6-8457-88a025588f1e-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"a7b8bb1c-b58a-43a6-8457-88a025588f1e\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 15:49:16 crc kubenswrapper[5120]: I0316 15:49:16.814523 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5w62m\" (UniqueName: \"kubernetes.io/projected/a7b8bb1c-b58a-43a6-8457-88a025588f1e-kube-api-access-5w62m\") pod \"ovsdbserver-nb-0\" (UID: \"a7b8bb1c-b58a-43a6-8457-88a025588f1e\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 15:49:16 crc kubenswrapper[5120]: I0316 15:49:16.814577 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage15-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage15-crc\") pod \"ovsdbserver-nb-0\" (UID: \"a7b8bb1c-b58a-43a6-8457-88a025588f1e\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 15:49:16 crc kubenswrapper[5120]: I0316 15:49:16.814952 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage15-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage15-crc\") pod \"ovsdbserver-nb-0\" (UID: \"a7b8bb1c-b58a-43a6-8457-88a025588f1e\") device mount path \"/mnt/openstack/pv15\"" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 15:49:16 crc kubenswrapper[5120]: I0316 15:49:16.815022 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/a7b8bb1c-b58a-43a6-8457-88a025588f1e-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"a7b8bb1c-b58a-43a6-8457-88a025588f1e\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 15:49:16 crc kubenswrapper[5120]: I0316 15:49:16.815600 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/a7b8bb1c-b58a-43a6-8457-88a025588f1e-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"a7b8bb1c-b58a-43a6-8457-88a025588f1e\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 15:49:16 crc kubenswrapper[5120]: I0316 15:49:16.816965 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a7b8bb1c-b58a-43a6-8457-88a025588f1e-config\") pod \"ovsdbserver-nb-0\" (UID: \"a7b8bb1c-b58a-43a6-8457-88a025588f1e\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 15:49:16 crc kubenswrapper[5120]: I0316 15:49:16.819389 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a7b8bb1c-b58a-43a6-8457-88a025588f1e-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"a7b8bb1c-b58a-43a6-8457-88a025588f1e\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 15:49:16 crc kubenswrapper[5120]: I0316 15:49:16.821872 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/a7b8bb1c-b58a-43a6-8457-88a025588f1e-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"a7b8bb1c-b58a-43a6-8457-88a025588f1e\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 15:49:16 crc kubenswrapper[5120]: I0316 15:49:16.825467 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/a7b8bb1c-b58a-43a6-8457-88a025588f1e-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"a7b8bb1c-b58a-43a6-8457-88a025588f1e\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 15:49:16 crc kubenswrapper[5120]: I0316 15:49:16.843264 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage15-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage15-crc\") pod \"ovsdbserver-nb-0\" (UID: \"a7b8bb1c-b58a-43a6-8457-88a025588f1e\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 15:49:16 crc kubenswrapper[5120]: I0316 15:49:16.844265 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5w62m\" (UniqueName: \"kubernetes.io/projected/a7b8bb1c-b58a-43a6-8457-88a025588f1e-kube-api-access-5w62m\") pod \"ovsdbserver-nb-0\" (UID: \"a7b8bb1c-b58a-43a6-8457-88a025588f1e\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 15:49:17 crc kubenswrapper[5120]: I0316 15:49:17.129420 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 15:49:17 crc kubenswrapper[5120]: I0316 15:49:17.286208 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 15:49:17 crc kubenswrapper[5120]: I0316 15:49:17.310185 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 15:49:17 crc kubenswrapper[5120]: I0316 15:49:17.310334 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 15:49:17 crc kubenswrapper[5120]: I0316 15:49:17.312986 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ovndbcluster-sb-ovndbs\"" Mar 16 15:49:17 crc kubenswrapper[5120]: I0316 15:49:17.314463 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovndbcluster-sb-config\"" Mar 16 15:49:17 crc kubenswrapper[5120]: I0316 15:49:17.314679 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovndbcluster-sb-scripts\"" Mar 16 15:49:17 crc kubenswrapper[5120]: I0316 15:49:17.319664 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ovncluster-ovndbcluster-sb-dockercfg-rjh5m\"" Mar 16 15:49:17 crc kubenswrapper[5120]: I0316 15:49:17.425049 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/d32a00a6-9028-411d-9f59-0b48c01c5eb2-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"d32a00a6-9028-411d-9f59-0b48c01c5eb2\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 15:49:17 crc kubenswrapper[5120]: I0316 15:49:17.425152 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d32a00a6-9028-411d-9f59-0b48c01c5eb2-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"d32a00a6-9028-411d-9f59-0b48c01c5eb2\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 15:49:17 crc kubenswrapper[5120]: I0316 15:49:17.425191 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d32a00a6-9028-411d-9f59-0b48c01c5eb2-config\") pod \"ovsdbserver-sb-0\" (UID: \"d32a00a6-9028-411d-9f59-0b48c01c5eb2\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 15:49:17 crc kubenswrapper[5120]: I0316 15:49:17.425252 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"ovsdbserver-sb-0\" (UID: \"d32a00a6-9028-411d-9f59-0b48c01c5eb2\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 15:49:17 crc kubenswrapper[5120]: I0316 15:49:17.425276 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/d32a00a6-9028-411d-9f59-0b48c01c5eb2-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"d32a00a6-9028-411d-9f59-0b48c01c5eb2\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 15:49:17 crc kubenswrapper[5120]: I0316 15:49:17.425382 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/d32a00a6-9028-411d-9f59-0b48c01c5eb2-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"d32a00a6-9028-411d-9f59-0b48c01c5eb2\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 15:49:17 crc kubenswrapper[5120]: I0316 15:49:17.425481 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/d32a00a6-9028-411d-9f59-0b48c01c5eb2-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"d32a00a6-9028-411d-9f59-0b48c01c5eb2\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 15:49:17 crc kubenswrapper[5120]: I0316 15:49:17.425538 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5kjcg\" (UniqueName: \"kubernetes.io/projected/d32a00a6-9028-411d-9f59-0b48c01c5eb2-kube-api-access-5kjcg\") pod \"ovsdbserver-sb-0\" (UID: \"d32a00a6-9028-411d-9f59-0b48c01c5eb2\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 15:49:17 crc kubenswrapper[5120]: I0316 15:49:17.527131 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/d32a00a6-9028-411d-9f59-0b48c01c5eb2-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"d32a00a6-9028-411d-9f59-0b48c01c5eb2\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 15:49:17 crc kubenswrapper[5120]: I0316 15:49:17.527213 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d32a00a6-9028-411d-9f59-0b48c01c5eb2-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"d32a00a6-9028-411d-9f59-0b48c01c5eb2\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 15:49:17 crc kubenswrapper[5120]: I0316 15:49:17.527251 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d32a00a6-9028-411d-9f59-0b48c01c5eb2-config\") pod \"ovsdbserver-sb-0\" (UID: \"d32a00a6-9028-411d-9f59-0b48c01c5eb2\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 15:49:17 crc kubenswrapper[5120]: I0316 15:49:17.527316 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"ovsdbserver-sb-0\" (UID: \"d32a00a6-9028-411d-9f59-0b48c01c5eb2\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 15:49:17 crc kubenswrapper[5120]: I0316 15:49:17.527339 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/d32a00a6-9028-411d-9f59-0b48c01c5eb2-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"d32a00a6-9028-411d-9f59-0b48c01c5eb2\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 15:49:17 crc kubenswrapper[5120]: I0316 15:49:17.527374 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/d32a00a6-9028-411d-9f59-0b48c01c5eb2-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"d32a00a6-9028-411d-9f59-0b48c01c5eb2\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 15:49:17 crc kubenswrapper[5120]: I0316 15:49:17.527421 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/d32a00a6-9028-411d-9f59-0b48c01c5eb2-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"d32a00a6-9028-411d-9f59-0b48c01c5eb2\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 15:49:17 crc kubenswrapper[5120]: I0316 15:49:17.527459 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5kjcg\" (UniqueName: \"kubernetes.io/projected/d32a00a6-9028-411d-9f59-0b48c01c5eb2-kube-api-access-5kjcg\") pod \"ovsdbserver-sb-0\" (UID: \"d32a00a6-9028-411d-9f59-0b48c01c5eb2\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 15:49:17 crc kubenswrapper[5120]: I0316 15:49:17.527742 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"ovsdbserver-sb-0\" (UID: \"d32a00a6-9028-411d-9f59-0b48c01c5eb2\") device mount path \"/mnt/openstack/pv05\"" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 15:49:17 crc kubenswrapper[5120]: I0316 15:49:17.528086 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/d32a00a6-9028-411d-9f59-0b48c01c5eb2-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"d32a00a6-9028-411d-9f59-0b48c01c5eb2\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 15:49:17 crc kubenswrapper[5120]: I0316 15:49:17.528856 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d32a00a6-9028-411d-9f59-0b48c01c5eb2-config\") pod \"ovsdbserver-sb-0\" (UID: \"d32a00a6-9028-411d-9f59-0b48c01c5eb2\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 15:49:17 crc kubenswrapper[5120]: I0316 15:49:17.530898 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/d32a00a6-9028-411d-9f59-0b48c01c5eb2-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"d32a00a6-9028-411d-9f59-0b48c01c5eb2\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 15:49:17 crc kubenswrapper[5120]: I0316 15:49:17.533385 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/d32a00a6-9028-411d-9f59-0b48c01c5eb2-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"d32a00a6-9028-411d-9f59-0b48c01c5eb2\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 15:49:17 crc kubenswrapper[5120]: I0316 15:49:17.536666 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d32a00a6-9028-411d-9f59-0b48c01c5eb2-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"d32a00a6-9028-411d-9f59-0b48c01c5eb2\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 15:49:17 crc kubenswrapper[5120]: I0316 15:49:17.539634 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/d32a00a6-9028-411d-9f59-0b48c01c5eb2-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"d32a00a6-9028-411d-9f59-0b48c01c5eb2\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 15:49:17 crc kubenswrapper[5120]: I0316 15:49:17.547594 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5kjcg\" (UniqueName: \"kubernetes.io/projected/d32a00a6-9028-411d-9f59-0b48c01c5eb2-kube-api-access-5kjcg\") pod \"ovsdbserver-sb-0\" (UID: \"d32a00a6-9028-411d-9f59-0b48c01c5eb2\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 15:49:17 crc kubenswrapper[5120]: I0316 15:49:17.549558 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"ovsdbserver-sb-0\" (UID: \"d32a00a6-9028-411d-9f59-0b48c01c5eb2\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 15:49:17 crc kubenswrapper[5120]: I0316 15:49:17.634940 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 15:49:17 crc kubenswrapper[5120]: I0316 15:49:17.758973 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-tpgs2" Mar 16 15:49:17 crc kubenswrapper[5120]: I0316 15:49:17.760887 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58748b8b69-49q6v" Mar 16 15:49:17 crc kubenswrapper[5120]: I0316 15:49:17.831096 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"14486849-fbb1-4cc9-8aa3-714e263c55fb","Type":"ContainerStarted","Data":"dd00c43884637f26ac704813dd8249e89882ce975df6ce57039509ecaf37e98d"} Mar 16 15:49:17 crc kubenswrapper[5120]: I0316 15:49:17.833941 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"c95ad7ed-1944-4285-9138-0d4b954aa727","Type":"ContainerStarted","Data":"5e8cdc5b4230c00c1992f86f19b7c3329acc7b0ca62fb691c31aa39678e05f32"} Mar 16 15:49:17 crc kubenswrapper[5120]: I0316 15:49:17.837023 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"90534d56-28ff-4983-b8ea-be83259ce64d","Type":"ContainerStarted","Data":"fabcc54b602bf9faf9dc99913094ea0b2e649eaa684c0270cf178d6a7993957a"} Mar 16 15:49:17 crc kubenswrapper[5120]: I0316 15:49:17.838021 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/memcached-0" Mar 16 15:49:17 crc kubenswrapper[5120]: I0316 15:49:17.857302 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-58748b8b69-49q6v"] Mar 16 15:49:17 crc kubenswrapper[5120]: I0316 15:49:17.857809 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58748b8b69-49q6v" podUID="cd214905-94a1-43b8-8966-734672c54a00" containerName="dnsmasq-dns" containerID="cri-o://4f7bc0b428cfc39c10b0885c5eee43a99b74cf4ef9b0beb6d088cc5f6fd4d573" gracePeriod=10 Mar 16 15:49:17 crc kubenswrapper[5120]: I0316 15:49:17.886883 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 15:49:17 crc kubenswrapper[5120]: I0316 15:49:17.903915 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/memcached-0" podStartSLOduration=2.654523413 podStartE2EDuration="8.903900007s" podCreationTimestamp="2026-03-16 15:49:09 +0000 UTC" firstStartedPulling="2026-03-16 15:49:10.295735426 +0000 UTC m=+1052.449667093" lastFinishedPulling="2026-03-16 15:49:16.54511203 +0000 UTC m=+1058.699043687" observedRunningTime="2026-03-16 15:49:17.892218511 +0000 UTC m=+1060.046150168" watchObservedRunningTime="2026-03-16 15:49:17.903900007 +0000 UTC m=+1060.057831664" Mar 16 15:49:18 crc kubenswrapper[5120]: I0316 15:49:18.601354 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 15:49:18 crc kubenswrapper[5120]: W0316 15:49:18.613064 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd32a00a6_9028_411d_9f59_0b48c01c5eb2.slice/crio-02a930630690d3bf3f9c44d2bd7bff09c0841b922520a2c6a9808167d7904eab WatchSource:0}: Error finding container 02a930630690d3bf3f9c44d2bd7bff09c0841b922520a2c6a9808167d7904eab: Status 404 returned error can't find the container with id 02a930630690d3bf3f9c44d2bd7bff09c0841b922520a2c6a9808167d7904eab Mar 16 15:49:18 crc kubenswrapper[5120]: I0316 15:49:18.674507 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58748b8b69-49q6v" Mar 16 15:49:18 crc kubenswrapper[5120]: I0316 15:49:18.765421 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wx9rm\" (UniqueName: \"kubernetes.io/projected/cd214905-94a1-43b8-8966-734672c54a00-kube-api-access-wx9rm\") pod \"cd214905-94a1-43b8-8966-734672c54a00\" (UID: \"cd214905-94a1-43b8-8966-734672c54a00\") " Mar 16 15:49:18 crc kubenswrapper[5120]: I0316 15:49:18.765942 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cd214905-94a1-43b8-8966-734672c54a00-config\") pod \"cd214905-94a1-43b8-8966-734672c54a00\" (UID: \"cd214905-94a1-43b8-8966-734672c54a00\") " Mar 16 15:49:18 crc kubenswrapper[5120]: I0316 15:49:18.781726 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd214905-94a1-43b8-8966-734672c54a00-kube-api-access-wx9rm" (OuterVolumeSpecName: "kube-api-access-wx9rm") pod "cd214905-94a1-43b8-8966-734672c54a00" (UID: "cd214905-94a1-43b8-8966-734672c54a00"). InnerVolumeSpecName "kube-api-access-wx9rm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:49:18 crc kubenswrapper[5120]: I0316 15:49:18.820265 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd214905-94a1-43b8-8966-734672c54a00-config" (OuterVolumeSpecName: "config") pod "cd214905-94a1-43b8-8966-734672c54a00" (UID: "cd214905-94a1-43b8-8966-734672c54a00"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:49:18 crc kubenswrapper[5120]: I0316 15:49:18.861622 5120 generic.go:358] "Generic (PLEG): container finished" podID="cd214905-94a1-43b8-8966-734672c54a00" containerID="4f7bc0b428cfc39c10b0885c5eee43a99b74cf4ef9b0beb6d088cc5f6fd4d573" exitCode=0 Mar 16 15:49:18 crc kubenswrapper[5120]: I0316 15:49:18.861771 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58748b8b69-49q6v" event={"ID":"cd214905-94a1-43b8-8966-734672c54a00","Type":"ContainerDied","Data":"4f7bc0b428cfc39c10b0885c5eee43a99b74cf4ef9b0beb6d088cc5f6fd4d573"} Mar 16 15:49:18 crc kubenswrapper[5120]: I0316 15:49:18.861809 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58748b8b69-49q6v" event={"ID":"cd214905-94a1-43b8-8966-734672c54a00","Type":"ContainerDied","Data":"2d11e7f3d9f16cc5b78e119dc0b051f19011b6ab39a8ad4cab323dfe75890c23"} Mar 16 15:49:18 crc kubenswrapper[5120]: I0316 15:49:18.861834 5120 scope.go:117] "RemoveContainer" containerID="4f7bc0b428cfc39c10b0885c5eee43a99b74cf4ef9b0beb6d088cc5f6fd4d573" Mar 16 15:49:18 crc kubenswrapper[5120]: I0316 15:49:18.861920 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58748b8b69-49q6v" Mar 16 15:49:18 crc kubenswrapper[5120]: I0316 15:49:18.870101 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cd214905-94a1-43b8-8966-734672c54a00-config\") on node \"crc\" DevicePath \"\"" Mar 16 15:49:18 crc kubenswrapper[5120]: I0316 15:49:18.870132 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wx9rm\" (UniqueName: \"kubernetes.io/projected/cd214905-94a1-43b8-8966-734672c54a00-kube-api-access-wx9rm\") on node \"crc\" DevicePath \"\"" Mar 16 15:49:18 crc kubenswrapper[5120]: I0316 15:49:18.871862 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"39704fdb-36c4-41fe-8c13-35a3abb56c36","Type":"ContainerStarted","Data":"8970debe191db64e238196677dc31c851eca165e847dd7c77e1bae7f6b09f591"} Mar 16 15:49:18 crc kubenswrapper[5120]: I0316 15:49:18.875944 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"36a1c719-e302-4df3-99c5-5025d99c8c19","Type":"ContainerStarted","Data":"b893f38e517ffdf9d92dd3de8d1b52ba2598e907c05bc8d1dd50838721c10b45"} Mar 16 15:49:18 crc kubenswrapper[5120]: I0316 15:49:18.878748 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"d32a00a6-9028-411d-9f59-0b48c01c5eb2","Type":"ContainerStarted","Data":"02a930630690d3bf3f9c44d2bd7bff09c0841b922520a2c6a9808167d7904eab"} Mar 16 15:49:18 crc kubenswrapper[5120]: I0316 15:49:18.881423 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"a7b8bb1c-b58a-43a6-8457-88a025588f1e","Type":"ContainerStarted","Data":"04482ea4f7f3b4622fa7a76cf37d317c1dc4a2a4747b43b85d8e2b3c3f52a0e1"} Mar 16 15:49:18 crc kubenswrapper[5120]: I0316 15:49:18.888917 5120 scope.go:117] "RemoveContainer" containerID="36eef28b51e96a5a5700cb67b84171650673a5cd6985fab9246f887617ff7acd" Mar 16 15:49:18 crc kubenswrapper[5120]: I0316 15:49:18.912548 5120 scope.go:117] "RemoveContainer" containerID="4f7bc0b428cfc39c10b0885c5eee43a99b74cf4ef9b0beb6d088cc5f6fd4d573" Mar 16 15:49:18 crc kubenswrapper[5120]: E0316 15:49:18.912976 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f7bc0b428cfc39c10b0885c5eee43a99b74cf4ef9b0beb6d088cc5f6fd4d573\": container with ID starting with 4f7bc0b428cfc39c10b0885c5eee43a99b74cf4ef9b0beb6d088cc5f6fd4d573 not found: ID does not exist" containerID="4f7bc0b428cfc39c10b0885c5eee43a99b74cf4ef9b0beb6d088cc5f6fd4d573" Mar 16 15:49:18 crc kubenswrapper[5120]: I0316 15:49:18.913043 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f7bc0b428cfc39c10b0885c5eee43a99b74cf4ef9b0beb6d088cc5f6fd4d573"} err="failed to get container status \"4f7bc0b428cfc39c10b0885c5eee43a99b74cf4ef9b0beb6d088cc5f6fd4d573\": rpc error: code = NotFound desc = could not find container \"4f7bc0b428cfc39c10b0885c5eee43a99b74cf4ef9b0beb6d088cc5f6fd4d573\": container with ID starting with 4f7bc0b428cfc39c10b0885c5eee43a99b74cf4ef9b0beb6d088cc5f6fd4d573 not found: ID does not exist" Mar 16 15:49:18 crc kubenswrapper[5120]: I0316 15:49:18.913069 5120 scope.go:117] "RemoveContainer" containerID="36eef28b51e96a5a5700cb67b84171650673a5cd6985fab9246f887617ff7acd" Mar 16 15:49:18 crc kubenswrapper[5120]: E0316 15:49:18.913286 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"36eef28b51e96a5a5700cb67b84171650673a5cd6985fab9246f887617ff7acd\": container with ID starting with 36eef28b51e96a5a5700cb67b84171650673a5cd6985fab9246f887617ff7acd not found: ID does not exist" containerID="36eef28b51e96a5a5700cb67b84171650673a5cd6985fab9246f887617ff7acd" Mar 16 15:49:18 crc kubenswrapper[5120]: I0316 15:49:18.913308 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36eef28b51e96a5a5700cb67b84171650673a5cd6985fab9246f887617ff7acd"} err="failed to get container status \"36eef28b51e96a5a5700cb67b84171650673a5cd6985fab9246f887617ff7acd\": rpc error: code = NotFound desc = could not find container \"36eef28b51e96a5a5700cb67b84171650673a5cd6985fab9246f887617ff7acd\": container with ID starting with 36eef28b51e96a5a5700cb67b84171650673a5cd6985fab9246f887617ff7acd not found: ID does not exist" Mar 16 15:49:18 crc kubenswrapper[5120]: I0316 15:49:18.944309 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-58748b8b69-49q6v"] Mar 16 15:49:18 crc kubenswrapper[5120]: I0316 15:49:18.950921 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-58748b8b69-49q6v"] Mar 16 15:49:19 crc kubenswrapper[5120]: I0316 15:49:19.892234 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"7d8e526d-4a8a-465b-bff3-9de49218452e","Type":"ContainerStarted","Data":"70a678e8063eded984b5edcf3f21f9ef1c8fe3556a19f741ac5b0c1afded2ad9"} Mar 16 15:49:19 crc kubenswrapper[5120]: I0316 15:49:19.892578 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 15:49:19 crc kubenswrapper[5120]: I0316 15:49:19.912815 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/kube-state-metrics-0" podStartSLOduration=4.527756657 podStartE2EDuration="8.91279677s" podCreationTimestamp="2026-03-16 15:49:11 +0000 UTC" firstStartedPulling="2026-03-16 15:49:14.268511048 +0000 UTC m=+1056.422442705" lastFinishedPulling="2026-03-16 15:49:18.653551161 +0000 UTC m=+1060.807482818" observedRunningTime="2026-03-16 15:49:19.911551936 +0000 UTC m=+1062.065483593" watchObservedRunningTime="2026-03-16 15:49:19.91279677 +0000 UTC m=+1062.066728427" Mar 16 15:49:20 crc kubenswrapper[5120]: I0316 15:49:20.673804 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cd214905-94a1-43b8-8966-734672c54a00" path="/var/lib/kubelet/pods/cd214905-94a1-43b8-8966-734672c54a00/volumes" Mar 16 15:49:20 crc kubenswrapper[5120]: I0316 15:49:20.902705 5120 generic.go:358] "Generic (PLEG): container finished" podID="14486849-fbb1-4cc9-8aa3-714e263c55fb" containerID="dd00c43884637f26ac704813dd8249e89882ce975df6ce57039509ecaf37e98d" exitCode=0 Mar 16 15:49:20 crc kubenswrapper[5120]: I0316 15:49:20.902825 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"14486849-fbb1-4cc9-8aa3-714e263c55fb","Type":"ContainerDied","Data":"dd00c43884637f26ac704813dd8249e89882ce975df6ce57039509ecaf37e98d"} Mar 16 15:49:20 crc kubenswrapper[5120]: I0316 15:49:20.905032 5120 generic.go:358] "Generic (PLEG): container finished" podID="c95ad7ed-1944-4285-9138-0d4b954aa727" containerID="5e8cdc5b4230c00c1992f86f19b7c3329acc7b0ca62fb691c31aa39678e05f32" exitCode=0 Mar 16 15:49:20 crc kubenswrapper[5120]: I0316 15:49:20.905246 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"c95ad7ed-1944-4285-9138-0d4b954aa727","Type":"ContainerDied","Data":"5e8cdc5b4230c00c1992f86f19b7c3329acc7b0ca62fb691c31aa39678e05f32"} Mar 16 15:49:22 crc kubenswrapper[5120]: I0316 15:49:22.927542 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"d32a00a6-9028-411d-9f59-0b48c01c5eb2","Type":"ContainerStarted","Data":"648e7c7f54f433de39969c9d1bdd3b5463c4d4f0f019533353a14b1c5740b449"} Mar 16 15:49:22 crc kubenswrapper[5120]: I0316 15:49:22.930591 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"a7b8bb1c-b58a-43a6-8457-88a025588f1e","Type":"ContainerStarted","Data":"a69581666e94e68483b687690686147a201582a36041881db8d8c5e135d82930"} Mar 16 15:49:22 crc kubenswrapper[5120]: I0316 15:49:22.933165 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"14486849-fbb1-4cc9-8aa3-714e263c55fb","Type":"ContainerStarted","Data":"c81a76400410e2a94d4a9a4471ca9bca3df111d1c0d2c832dcdc03fb0fca2ae5"} Mar 16 15:49:22 crc kubenswrapper[5120]: I0316 15:49:22.936373 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"c95ad7ed-1944-4285-9138-0d4b954aa727","Type":"ContainerStarted","Data":"09392570662a59fc70e23951bc67499bff758e9ff6016774b3bbe8dfd1cae387"} Mar 16 15:49:22 crc kubenswrapper[5120]: I0316 15:49:22.957944 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstack-cell1-galera-0" podStartSLOduration=8.369407438 podStartE2EDuration="14.957925553s" podCreationTimestamp="2026-03-16 15:49:08 +0000 UTC" firstStartedPulling="2026-03-16 15:49:10.010140348 +0000 UTC m=+1052.164071995" lastFinishedPulling="2026-03-16 15:49:16.598658453 +0000 UTC m=+1058.752590110" observedRunningTime="2026-03-16 15:49:22.955143065 +0000 UTC m=+1065.109074722" watchObservedRunningTime="2026-03-16 15:49:22.957925553 +0000 UTC m=+1065.111857210" Mar 16 15:49:22 crc kubenswrapper[5120]: I0316 15:49:22.977572 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstack-galera-0" podStartSLOduration=10.551365544 podStartE2EDuration="16.97755719s" podCreationTimestamp="2026-03-16 15:49:06 +0000 UTC" firstStartedPulling="2026-03-16 15:49:10.120000064 +0000 UTC m=+1052.273931721" lastFinishedPulling="2026-03-16 15:49:16.5461917 +0000 UTC m=+1058.700123367" observedRunningTime="2026-03-16 15:49:22.975076881 +0000 UTC m=+1065.129008538" watchObservedRunningTime="2026-03-16 15:49:22.97755719 +0000 UTC m=+1065.131488847" Mar 16 15:49:24 crc kubenswrapper[5120]: I0316 15:49:24.895941 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/memcached-0" Mar 16 15:49:25 crc kubenswrapper[5120]: I0316 15:49:25.961422 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"d32a00a6-9028-411d-9f59-0b48c01c5eb2","Type":"ContainerStarted","Data":"8c55763fcf264ceeed4d09a515d899986858a78501aa64cc228e9e4494fd465a"} Mar 16 15:49:25 crc kubenswrapper[5120]: I0316 15:49:25.963785 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"a7b8bb1c-b58a-43a6-8457-88a025588f1e","Type":"ContainerStarted","Data":"4e2796b01696c028bbde53b67d3871a746b22ba854168fabf827f2607ee9fe5c"} Mar 16 15:49:25 crc kubenswrapper[5120]: I0316 15:49:25.982425 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podStartSLOduration=3.449115566 podStartE2EDuration="9.982404499s" podCreationTimestamp="2026-03-16 15:49:16 +0000 UTC" firstStartedPulling="2026-03-16 15:49:18.616568449 +0000 UTC m=+1060.770500106" lastFinishedPulling="2026-03-16 15:49:25.149857382 +0000 UTC m=+1067.303789039" observedRunningTime="2026-03-16 15:49:25.975533007 +0000 UTC m=+1068.129464664" watchObservedRunningTime="2026-03-16 15:49:25.982404499 +0000 UTC m=+1068.136336156" Mar 16 15:49:25 crc kubenswrapper[5120]: I0316 15:49:25.997601 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podStartSLOduration=3.965968005 podStartE2EDuration="10.997577182s" podCreationTimestamp="2026-03-16 15:49:15 +0000 UTC" firstStartedPulling="2026-03-16 15:49:18.10728566 +0000 UTC m=+1060.261217317" lastFinishedPulling="2026-03-16 15:49:25.138894837 +0000 UTC m=+1067.292826494" observedRunningTime="2026-03-16 15:49:25.995194415 +0000 UTC m=+1068.149126082" watchObservedRunningTime="2026-03-16 15:49:25.997577182 +0000 UTC m=+1068.151508839" Mar 16 15:49:26 crc kubenswrapper[5120]: I0316 15:49:26.129942 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 15:49:26 crc kubenswrapper[5120]: I0316 15:49:26.172601 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 15:49:26 crc kubenswrapper[5120]: I0316 15:49:26.636105 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 15:49:26 crc kubenswrapper[5120]: I0316 15:49:26.678161 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 15:49:26 crc kubenswrapper[5120]: I0316 15:49:26.972332 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 15:49:26 crc kubenswrapper[5120]: I0316 15:49:26.972372 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 15:49:27 crc kubenswrapper[5120]: I0316 15:49:27.012701 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 15:49:27 crc kubenswrapper[5120]: I0316 15:49:27.020996 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 15:49:27 crc kubenswrapper[5120]: I0316 15:49:27.255717 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 15:49:27 crc kubenswrapper[5120]: I0316 15:49:27.257224 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd214905-94a1-43b8-8966-734672c54a00" containerName="init" Mar 16 15:49:27 crc kubenswrapper[5120]: I0316 15:49:27.257250 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd214905-94a1-43b8-8966-734672c54a00" containerName="init" Mar 16 15:49:27 crc kubenswrapper[5120]: I0316 15:49:27.257271 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd214905-94a1-43b8-8966-734672c54a00" containerName="dnsmasq-dns" Mar 16 15:49:27 crc kubenswrapper[5120]: I0316 15:49:27.257279 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd214905-94a1-43b8-8966-734672c54a00" containerName="dnsmasq-dns" Mar 16 15:49:27 crc kubenswrapper[5120]: I0316 15:49:27.257487 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="cd214905-94a1-43b8-8966-734672c54a00" containerName="dnsmasq-dns" Mar 16 15:49:27 crc kubenswrapper[5120]: I0316 15:49:27.263122 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 15:49:27 crc kubenswrapper[5120]: I0316 15:49:27.264176 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 15:49:27 crc kubenswrapper[5120]: I0316 15:49:27.265199 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovnnorthd-scripts\"" Mar 16 15:49:27 crc kubenswrapper[5120]: I0316 15:49:27.265930 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovnnorthd-config\"" Mar 16 15:49:27 crc kubenswrapper[5120]: I0316 15:49:27.265947 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ovnnorthd-ovndbs\"" Mar 16 15:49:27 crc kubenswrapper[5120]: I0316 15:49:27.266072 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ovnnorthd-ovnnorthd-dockercfg-tfhwg\"" Mar 16 15:49:27 crc kubenswrapper[5120]: I0316 15:49:27.421498 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/6ac49efe-dc8a-47b2-9432-afb41c69ebff-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"6ac49efe-dc8a-47b2-9432-afb41c69ebff\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 15:49:27 crc kubenswrapper[5120]: I0316 15:49:27.421613 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6ac49efe-dc8a-47b2-9432-afb41c69ebff-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"6ac49efe-dc8a-47b2-9432-afb41c69ebff\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 15:49:27 crc kubenswrapper[5120]: I0316 15:49:27.421642 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/6ac49efe-dc8a-47b2-9432-afb41c69ebff-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"6ac49efe-dc8a-47b2-9432-afb41c69ebff\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 15:49:27 crc kubenswrapper[5120]: I0316 15:49:27.421691 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6ac49efe-dc8a-47b2-9432-afb41c69ebff-config\") pod \"ovn-northd-0\" (UID: \"6ac49efe-dc8a-47b2-9432-afb41c69ebff\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 15:49:27 crc kubenswrapper[5120]: I0316 15:49:27.421750 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/6ac49efe-dc8a-47b2-9432-afb41c69ebff-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"6ac49efe-dc8a-47b2-9432-afb41c69ebff\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 15:49:27 crc kubenswrapper[5120]: I0316 15:49:27.422509 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/6ac49efe-dc8a-47b2-9432-afb41c69ebff-scripts\") pod \"ovn-northd-0\" (UID: \"6ac49efe-dc8a-47b2-9432-afb41c69ebff\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 15:49:27 crc kubenswrapper[5120]: I0316 15:49:27.422549 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6lrgt\" (UniqueName: \"kubernetes.io/projected/6ac49efe-dc8a-47b2-9432-afb41c69ebff-kube-api-access-6lrgt\") pod \"ovn-northd-0\" (UID: \"6ac49efe-dc8a-47b2-9432-afb41c69ebff\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 15:49:27 crc kubenswrapper[5120]: I0316 15:49:27.524405 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/6ac49efe-dc8a-47b2-9432-afb41c69ebff-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"6ac49efe-dc8a-47b2-9432-afb41c69ebff\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 15:49:27 crc kubenswrapper[5120]: I0316 15:49:27.524493 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6ac49efe-dc8a-47b2-9432-afb41c69ebff-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"6ac49efe-dc8a-47b2-9432-afb41c69ebff\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 15:49:27 crc kubenswrapper[5120]: I0316 15:49:27.524513 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/6ac49efe-dc8a-47b2-9432-afb41c69ebff-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"6ac49efe-dc8a-47b2-9432-afb41c69ebff\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 15:49:27 crc kubenswrapper[5120]: I0316 15:49:27.524550 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6ac49efe-dc8a-47b2-9432-afb41c69ebff-config\") pod \"ovn-northd-0\" (UID: \"6ac49efe-dc8a-47b2-9432-afb41c69ebff\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 15:49:27 crc kubenswrapper[5120]: I0316 15:49:27.524565 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/6ac49efe-dc8a-47b2-9432-afb41c69ebff-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"6ac49efe-dc8a-47b2-9432-afb41c69ebff\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 15:49:27 crc kubenswrapper[5120]: I0316 15:49:27.524609 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/6ac49efe-dc8a-47b2-9432-afb41c69ebff-scripts\") pod \"ovn-northd-0\" (UID: \"6ac49efe-dc8a-47b2-9432-afb41c69ebff\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 15:49:27 crc kubenswrapper[5120]: I0316 15:49:27.524637 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6lrgt\" (UniqueName: \"kubernetes.io/projected/6ac49efe-dc8a-47b2-9432-afb41c69ebff-kube-api-access-6lrgt\") pod \"ovn-northd-0\" (UID: \"6ac49efe-dc8a-47b2-9432-afb41c69ebff\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 15:49:27 crc kubenswrapper[5120]: I0316 15:49:27.525305 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/6ac49efe-dc8a-47b2-9432-afb41c69ebff-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"6ac49efe-dc8a-47b2-9432-afb41c69ebff\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 15:49:27 crc kubenswrapper[5120]: I0316 15:49:27.525749 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6ac49efe-dc8a-47b2-9432-afb41c69ebff-config\") pod \"ovn-northd-0\" (UID: \"6ac49efe-dc8a-47b2-9432-afb41c69ebff\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 15:49:27 crc kubenswrapper[5120]: I0316 15:49:27.525797 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/6ac49efe-dc8a-47b2-9432-afb41c69ebff-scripts\") pod \"ovn-northd-0\" (UID: \"6ac49efe-dc8a-47b2-9432-afb41c69ebff\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 15:49:27 crc kubenswrapper[5120]: I0316 15:49:27.530626 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6ac49efe-dc8a-47b2-9432-afb41c69ebff-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"6ac49efe-dc8a-47b2-9432-afb41c69ebff\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 15:49:27 crc kubenswrapper[5120]: I0316 15:49:27.530998 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/6ac49efe-dc8a-47b2-9432-afb41c69ebff-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"6ac49efe-dc8a-47b2-9432-afb41c69ebff\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 15:49:27 crc kubenswrapper[5120]: I0316 15:49:27.545888 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/6ac49efe-dc8a-47b2-9432-afb41c69ebff-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"6ac49efe-dc8a-47b2-9432-afb41c69ebff\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 15:49:27 crc kubenswrapper[5120]: I0316 15:49:27.546638 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6lrgt\" (UniqueName: \"kubernetes.io/projected/6ac49efe-dc8a-47b2-9432-afb41c69ebff-kube-api-access-6lrgt\") pod \"ovn-northd-0\" (UID: \"6ac49efe-dc8a-47b2-9432-afb41c69ebff\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 15:49:27 crc kubenswrapper[5120]: I0316 15:49:27.582379 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 15:49:28 crc kubenswrapper[5120]: I0316 15:49:28.030233 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 15:49:28 crc kubenswrapper[5120]: W0316 15:49:28.039230 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6ac49efe_dc8a_47b2_9432_afb41c69ebff.slice/crio-27b62e5f00c34b47dbdd5ede6a2eec64a340cb9cc5333de3f39ec1efa1cc93a5 WatchSource:0}: Error finding container 27b62e5f00c34b47dbdd5ede6a2eec64a340cb9cc5333de3f39ec1efa1cc93a5: Status 404 returned error can't find the container with id 27b62e5f00c34b47dbdd5ede6a2eec64a340cb9cc5333de3f39ec1efa1cc93a5 Mar 16 15:49:28 crc kubenswrapper[5120]: I0316 15:49:28.222340 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 15:49:28 crc kubenswrapper[5120]: I0316 15:49:28.223336 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 15:49:28 crc kubenswrapper[5120]: I0316 15:49:28.990360 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"6ac49efe-dc8a-47b2-9432-afb41c69ebff","Type":"ContainerStarted","Data":"27b62e5f00c34b47dbdd5ede6a2eec64a340cb9cc5333de3f39ec1efa1cc93a5"} Mar 16 15:49:29 crc kubenswrapper[5120]: I0316 15:49:29.478867 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 15:49:29 crc kubenswrapper[5120]: I0316 15:49:29.479502 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 15:49:29 crc kubenswrapper[5120]: I0316 15:49:29.571685 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 15:49:30 crc kubenswrapper[5120]: I0316 15:49:30.087137 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 15:49:30 crc kubenswrapper[5120]: I0316 15:49:30.805601 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 15:49:30 crc kubenswrapper[5120]: I0316 15:49:30.910111 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 15:49:30 crc kubenswrapper[5120]: I0316 15:49:30.917019 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/openstack-galera-0" podUID="c95ad7ed-1944-4285-9138-0d4b954aa727" containerName="galera" probeResult="failure" output=< Mar 16 15:49:30 crc kubenswrapper[5120]: wsrep_local_state_comment (Joined) differs from Synced Mar 16 15:49:30 crc kubenswrapper[5120]: > Mar 16 15:49:33 crc kubenswrapper[5120]: I0316 15:49:33.131787 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 15:49:33 crc kubenswrapper[5120]: I0316 15:49:33.176480 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 15:49:33 crc kubenswrapper[5120]: I0316 15:49:33.176728 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Mar 16 15:49:33 crc kubenswrapper[5120]: I0316 15:49:33.179578 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"swift-conf\"" Mar 16 15:49:33 crc kubenswrapper[5120]: I0316 15:49:33.179750 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"swift-ring-files\"" Mar 16 15:49:33 crc kubenswrapper[5120]: I0316 15:49:33.179796 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"swift-swift-dockercfg-g79cm\"" Mar 16 15:49:33 crc kubenswrapper[5120]: I0316 15:49:33.179942 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"swift-storage-config-data\"" Mar 16 15:49:33 crc kubenswrapper[5120]: I0316 15:49:33.360733 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/672accec-238b-4e18-9b15-5ff8429d4256-etc-swift\") pod \"swift-storage-0\" (UID: \"672accec-238b-4e18-9b15-5ff8429d4256\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 15:49:33 crc kubenswrapper[5120]: I0316 15:49:33.360882 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage07-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") pod \"swift-storage-0\" (UID: \"672accec-238b-4e18-9b15-5ff8429d4256\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 15:49:33 crc kubenswrapper[5120]: I0316 15:49:33.360911 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/672accec-238b-4e18-9b15-5ff8429d4256-cache\") pod \"swift-storage-0\" (UID: \"672accec-238b-4e18-9b15-5ff8429d4256\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 15:49:33 crc kubenswrapper[5120]: I0316 15:49:33.360929 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/672accec-238b-4e18-9b15-5ff8429d4256-combined-ca-bundle\") pod \"swift-storage-0\" (UID: \"672accec-238b-4e18-9b15-5ff8429d4256\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 15:49:33 crc kubenswrapper[5120]: I0316 15:49:33.360972 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/672accec-238b-4e18-9b15-5ff8429d4256-lock\") pod \"swift-storage-0\" (UID: \"672accec-238b-4e18-9b15-5ff8429d4256\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 15:49:33 crc kubenswrapper[5120]: I0316 15:49:33.361051 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzsjs\" (UniqueName: \"kubernetes.io/projected/672accec-238b-4e18-9b15-5ff8429d4256-kube-api-access-tzsjs\") pod \"swift-storage-0\" (UID: \"672accec-238b-4e18-9b15-5ff8429d4256\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 15:49:33 crc kubenswrapper[5120]: I0316 15:49:33.462676 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/672accec-238b-4e18-9b15-5ff8429d4256-lock\") pod \"swift-storage-0\" (UID: \"672accec-238b-4e18-9b15-5ff8429d4256\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 15:49:33 crc kubenswrapper[5120]: I0316 15:49:33.462894 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tzsjs\" (UniqueName: \"kubernetes.io/projected/672accec-238b-4e18-9b15-5ff8429d4256-kube-api-access-tzsjs\") pod \"swift-storage-0\" (UID: \"672accec-238b-4e18-9b15-5ff8429d4256\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 15:49:33 crc kubenswrapper[5120]: I0316 15:49:33.462968 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/672accec-238b-4e18-9b15-5ff8429d4256-etc-swift\") pod \"swift-storage-0\" (UID: \"672accec-238b-4e18-9b15-5ff8429d4256\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 15:49:33 crc kubenswrapper[5120]: I0316 15:49:33.463147 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage07-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") pod \"swift-storage-0\" (UID: \"672accec-238b-4e18-9b15-5ff8429d4256\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 15:49:33 crc kubenswrapper[5120]: I0316 15:49:33.463177 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/672accec-238b-4e18-9b15-5ff8429d4256-cache\") pod \"swift-storage-0\" (UID: \"672accec-238b-4e18-9b15-5ff8429d4256\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 15:49:33 crc kubenswrapper[5120]: I0316 15:49:33.463199 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/672accec-238b-4e18-9b15-5ff8429d4256-combined-ca-bundle\") pod \"swift-storage-0\" (UID: \"672accec-238b-4e18-9b15-5ff8429d4256\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 15:49:33 crc kubenswrapper[5120]: I0316 15:49:33.463253 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/672accec-238b-4e18-9b15-5ff8429d4256-lock\") pod \"swift-storage-0\" (UID: \"672accec-238b-4e18-9b15-5ff8429d4256\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 15:49:33 crc kubenswrapper[5120]: E0316 15:49:33.463262 5120 projected.go:289] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Mar 16 15:49:33 crc kubenswrapper[5120]: E0316 15:49:33.463284 5120 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Mar 16 15:49:33 crc kubenswrapper[5120]: E0316 15:49:33.463345 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/672accec-238b-4e18-9b15-5ff8429d4256-etc-swift podName:672accec-238b-4e18-9b15-5ff8429d4256 nodeName:}" failed. No retries permitted until 2026-03-16 15:49:33.963327439 +0000 UTC m=+1076.117259096 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/672accec-238b-4e18-9b15-5ff8429d4256-etc-swift") pod "swift-storage-0" (UID: "672accec-238b-4e18-9b15-5ff8429d4256") : configmap "swift-ring-files" not found Mar 16 15:49:33 crc kubenswrapper[5120]: I0316 15:49:33.463584 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage07-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") pod \"swift-storage-0\" (UID: \"672accec-238b-4e18-9b15-5ff8429d4256\") device mount path \"/mnt/openstack/pv07\"" pod="openstack-kuttl-tests/swift-storage-0" Mar 16 15:49:33 crc kubenswrapper[5120]: I0316 15:49:33.463883 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/672accec-238b-4e18-9b15-5ff8429d4256-cache\") pod \"swift-storage-0\" (UID: \"672accec-238b-4e18-9b15-5ff8429d4256\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 15:49:33 crc kubenswrapper[5120]: I0316 15:49:33.471709 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/672accec-238b-4e18-9b15-5ff8429d4256-combined-ca-bundle\") pod \"swift-storage-0\" (UID: \"672accec-238b-4e18-9b15-5ff8429d4256\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 15:49:33 crc kubenswrapper[5120]: I0316 15:49:33.479162 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzsjs\" (UniqueName: \"kubernetes.io/projected/672accec-238b-4e18-9b15-5ff8429d4256-kube-api-access-tzsjs\") pod \"swift-storage-0\" (UID: \"672accec-238b-4e18-9b15-5ff8429d4256\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 15:49:33 crc kubenswrapper[5120]: I0316 15:49:33.487934 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage07-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") pod \"swift-storage-0\" (UID: \"672accec-238b-4e18-9b15-5ff8429d4256\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 15:49:33 crc kubenswrapper[5120]: I0316 15:49:33.578249 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-crwwq"] Mar 16 15:49:33 crc kubenswrapper[5120]: I0316 15:49:33.588216 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-crwwq" Mar 16 15:49:33 crc kubenswrapper[5120]: I0316 15:49:33.588917 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-crwwq"] Mar 16 15:49:33 crc kubenswrapper[5120]: I0316 15:49:33.592568 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"swift-ring-scripts\"" Mar 16 15:49:33 crc kubenswrapper[5120]: I0316 15:49:33.593008 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"swift-ring-config-data\"" Mar 16 15:49:33 crc kubenswrapper[5120]: I0316 15:49:33.593097 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"swift-proxy-config-data\"" Mar 16 15:49:33 crc kubenswrapper[5120]: I0316 15:49:33.768542 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/598fa73c-5fdc-41e2-9d7d-f3494dc37c79-combined-ca-bundle\") pod \"swift-ring-rebalance-crwwq\" (UID: \"598fa73c-5fdc-41e2-9d7d-f3494dc37c79\") " pod="openstack-kuttl-tests/swift-ring-rebalance-crwwq" Mar 16 15:49:33 crc kubenswrapper[5120]: I0316 15:49:33.768604 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/598fa73c-5fdc-41e2-9d7d-f3494dc37c79-scripts\") pod \"swift-ring-rebalance-crwwq\" (UID: \"598fa73c-5fdc-41e2-9d7d-f3494dc37c79\") " pod="openstack-kuttl-tests/swift-ring-rebalance-crwwq" Mar 16 15:49:33 crc kubenswrapper[5120]: I0316 15:49:33.768623 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5k69\" (UniqueName: \"kubernetes.io/projected/598fa73c-5fdc-41e2-9d7d-f3494dc37c79-kube-api-access-p5k69\") pod \"swift-ring-rebalance-crwwq\" (UID: \"598fa73c-5fdc-41e2-9d7d-f3494dc37c79\") " pod="openstack-kuttl-tests/swift-ring-rebalance-crwwq" Mar 16 15:49:33 crc kubenswrapper[5120]: I0316 15:49:33.768658 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/598fa73c-5fdc-41e2-9d7d-f3494dc37c79-ring-data-devices\") pod \"swift-ring-rebalance-crwwq\" (UID: \"598fa73c-5fdc-41e2-9d7d-f3494dc37c79\") " pod="openstack-kuttl-tests/swift-ring-rebalance-crwwq" Mar 16 15:49:33 crc kubenswrapper[5120]: I0316 15:49:33.768674 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/598fa73c-5fdc-41e2-9d7d-f3494dc37c79-dispersionconf\") pod \"swift-ring-rebalance-crwwq\" (UID: \"598fa73c-5fdc-41e2-9d7d-f3494dc37c79\") " pod="openstack-kuttl-tests/swift-ring-rebalance-crwwq" Mar 16 15:49:33 crc kubenswrapper[5120]: I0316 15:49:33.768812 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/598fa73c-5fdc-41e2-9d7d-f3494dc37c79-etc-swift\") pod \"swift-ring-rebalance-crwwq\" (UID: \"598fa73c-5fdc-41e2-9d7d-f3494dc37c79\") " pod="openstack-kuttl-tests/swift-ring-rebalance-crwwq" Mar 16 15:49:33 crc kubenswrapper[5120]: I0316 15:49:33.768831 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/598fa73c-5fdc-41e2-9d7d-f3494dc37c79-swiftconf\") pod \"swift-ring-rebalance-crwwq\" (UID: \"598fa73c-5fdc-41e2-9d7d-f3494dc37c79\") " pod="openstack-kuttl-tests/swift-ring-rebalance-crwwq" Mar 16 15:49:33 crc kubenswrapper[5120]: I0316 15:49:33.870698 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/598fa73c-5fdc-41e2-9d7d-f3494dc37c79-combined-ca-bundle\") pod \"swift-ring-rebalance-crwwq\" (UID: \"598fa73c-5fdc-41e2-9d7d-f3494dc37c79\") " pod="openstack-kuttl-tests/swift-ring-rebalance-crwwq" Mar 16 15:49:33 crc kubenswrapper[5120]: I0316 15:49:33.870798 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/598fa73c-5fdc-41e2-9d7d-f3494dc37c79-scripts\") pod \"swift-ring-rebalance-crwwq\" (UID: \"598fa73c-5fdc-41e2-9d7d-f3494dc37c79\") " pod="openstack-kuttl-tests/swift-ring-rebalance-crwwq" Mar 16 15:49:33 crc kubenswrapper[5120]: I0316 15:49:33.870823 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p5k69\" (UniqueName: \"kubernetes.io/projected/598fa73c-5fdc-41e2-9d7d-f3494dc37c79-kube-api-access-p5k69\") pod \"swift-ring-rebalance-crwwq\" (UID: \"598fa73c-5fdc-41e2-9d7d-f3494dc37c79\") " pod="openstack-kuttl-tests/swift-ring-rebalance-crwwq" Mar 16 15:49:33 crc kubenswrapper[5120]: I0316 15:49:33.870856 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/598fa73c-5fdc-41e2-9d7d-f3494dc37c79-ring-data-devices\") pod \"swift-ring-rebalance-crwwq\" (UID: \"598fa73c-5fdc-41e2-9d7d-f3494dc37c79\") " pod="openstack-kuttl-tests/swift-ring-rebalance-crwwq" Mar 16 15:49:33 crc kubenswrapper[5120]: I0316 15:49:33.870879 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/598fa73c-5fdc-41e2-9d7d-f3494dc37c79-dispersionconf\") pod \"swift-ring-rebalance-crwwq\" (UID: \"598fa73c-5fdc-41e2-9d7d-f3494dc37c79\") " pod="openstack-kuttl-tests/swift-ring-rebalance-crwwq" Mar 16 15:49:33 crc kubenswrapper[5120]: I0316 15:49:33.870957 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/598fa73c-5fdc-41e2-9d7d-f3494dc37c79-etc-swift\") pod \"swift-ring-rebalance-crwwq\" (UID: \"598fa73c-5fdc-41e2-9d7d-f3494dc37c79\") " pod="openstack-kuttl-tests/swift-ring-rebalance-crwwq" Mar 16 15:49:33 crc kubenswrapper[5120]: I0316 15:49:33.870983 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/598fa73c-5fdc-41e2-9d7d-f3494dc37c79-swiftconf\") pod \"swift-ring-rebalance-crwwq\" (UID: \"598fa73c-5fdc-41e2-9d7d-f3494dc37c79\") " pod="openstack-kuttl-tests/swift-ring-rebalance-crwwq" Mar 16 15:49:33 crc kubenswrapper[5120]: I0316 15:49:33.872166 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/598fa73c-5fdc-41e2-9d7d-f3494dc37c79-etc-swift\") pod \"swift-ring-rebalance-crwwq\" (UID: \"598fa73c-5fdc-41e2-9d7d-f3494dc37c79\") " pod="openstack-kuttl-tests/swift-ring-rebalance-crwwq" Mar 16 15:49:33 crc kubenswrapper[5120]: I0316 15:49:33.872470 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/598fa73c-5fdc-41e2-9d7d-f3494dc37c79-ring-data-devices\") pod \"swift-ring-rebalance-crwwq\" (UID: \"598fa73c-5fdc-41e2-9d7d-f3494dc37c79\") " pod="openstack-kuttl-tests/swift-ring-rebalance-crwwq" Mar 16 15:49:33 crc kubenswrapper[5120]: I0316 15:49:33.872538 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/598fa73c-5fdc-41e2-9d7d-f3494dc37c79-scripts\") pod \"swift-ring-rebalance-crwwq\" (UID: \"598fa73c-5fdc-41e2-9d7d-f3494dc37c79\") " pod="openstack-kuttl-tests/swift-ring-rebalance-crwwq" Mar 16 15:49:33 crc kubenswrapper[5120]: I0316 15:49:33.875180 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/598fa73c-5fdc-41e2-9d7d-f3494dc37c79-swiftconf\") pod \"swift-ring-rebalance-crwwq\" (UID: \"598fa73c-5fdc-41e2-9d7d-f3494dc37c79\") " pod="openstack-kuttl-tests/swift-ring-rebalance-crwwq" Mar 16 15:49:33 crc kubenswrapper[5120]: I0316 15:49:33.878135 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/598fa73c-5fdc-41e2-9d7d-f3494dc37c79-dispersionconf\") pod \"swift-ring-rebalance-crwwq\" (UID: \"598fa73c-5fdc-41e2-9d7d-f3494dc37c79\") " pod="openstack-kuttl-tests/swift-ring-rebalance-crwwq" Mar 16 15:49:33 crc kubenswrapper[5120]: I0316 15:49:33.878323 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/598fa73c-5fdc-41e2-9d7d-f3494dc37c79-combined-ca-bundle\") pod \"swift-ring-rebalance-crwwq\" (UID: \"598fa73c-5fdc-41e2-9d7d-f3494dc37c79\") " pod="openstack-kuttl-tests/swift-ring-rebalance-crwwq" Mar 16 15:49:33 crc kubenswrapper[5120]: I0316 15:49:33.886361 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5k69\" (UniqueName: \"kubernetes.io/projected/598fa73c-5fdc-41e2-9d7d-f3494dc37c79-kube-api-access-p5k69\") pod \"swift-ring-rebalance-crwwq\" (UID: \"598fa73c-5fdc-41e2-9d7d-f3494dc37c79\") " pod="openstack-kuttl-tests/swift-ring-rebalance-crwwq" Mar 16 15:49:33 crc kubenswrapper[5120]: I0316 15:49:33.929314 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-crwwq" Mar 16 15:49:33 crc kubenswrapper[5120]: I0316 15:49:33.972371 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/672accec-238b-4e18-9b15-5ff8429d4256-etc-swift\") pod \"swift-storage-0\" (UID: \"672accec-238b-4e18-9b15-5ff8429d4256\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 15:49:33 crc kubenswrapper[5120]: E0316 15:49:33.972589 5120 projected.go:289] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Mar 16 15:49:33 crc kubenswrapper[5120]: E0316 15:49:33.972624 5120 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Mar 16 15:49:33 crc kubenswrapper[5120]: E0316 15:49:33.972691 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/672accec-238b-4e18-9b15-5ff8429d4256-etc-swift podName:672accec-238b-4e18-9b15-5ff8429d4256 nodeName:}" failed. No retries permitted until 2026-03-16 15:49:34.972671389 +0000 UTC m=+1077.126603036 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/672accec-238b-4e18-9b15-5ff8429d4256-etc-swift") pod "swift-storage-0" (UID: "672accec-238b-4e18-9b15-5ff8429d4256") : configmap "swift-ring-files" not found Mar 16 15:49:34 crc kubenswrapper[5120]: I0316 15:49:34.040751 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"6ac49efe-dc8a-47b2-9432-afb41c69ebff","Type":"ContainerStarted","Data":"e5f97b4f3579c3f23b60ed73671c3bb6855051e5aa3db9096db0d9f0c8c645c8"} Mar 16 15:49:34 crc kubenswrapper[5120]: I0316 15:49:34.040822 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"6ac49efe-dc8a-47b2-9432-afb41c69ebff","Type":"ContainerStarted","Data":"387a7e18b82c50f51c96a48a6b0e06ca0ff7ee666aa82162ae48b3f8a16f6166"} Mar 16 15:49:34 crc kubenswrapper[5120]: I0316 15:49:34.040926 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 15:49:34 crc kubenswrapper[5120]: I0316 15:49:34.064262 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovn-northd-0" podStartSLOduration=1.615324381 podStartE2EDuration="7.064243554s" podCreationTimestamp="2026-03-16 15:49:27 +0000 UTC" firstStartedPulling="2026-03-16 15:49:28.042245513 +0000 UTC m=+1070.196177170" lastFinishedPulling="2026-03-16 15:49:33.491164686 +0000 UTC m=+1075.645096343" observedRunningTime="2026-03-16 15:49:34.061510458 +0000 UTC m=+1076.215442125" watchObservedRunningTime="2026-03-16 15:49:34.064243554 +0000 UTC m=+1076.218175211" Mar 16 15:49:34 crc kubenswrapper[5120]: I0316 15:49:34.395463 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-crwwq"] Mar 16 15:49:34 crc kubenswrapper[5120]: I0316 15:49:34.989790 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/672accec-238b-4e18-9b15-5ff8429d4256-etc-swift\") pod \"swift-storage-0\" (UID: \"672accec-238b-4e18-9b15-5ff8429d4256\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 15:49:34 crc kubenswrapper[5120]: E0316 15:49:34.989995 5120 projected.go:289] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Mar 16 15:49:34 crc kubenswrapper[5120]: E0316 15:49:34.990199 5120 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Mar 16 15:49:34 crc kubenswrapper[5120]: E0316 15:49:34.990272 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/672accec-238b-4e18-9b15-5ff8429d4256-etc-swift podName:672accec-238b-4e18-9b15-5ff8429d4256 nodeName:}" failed. No retries permitted until 2026-03-16 15:49:36.990252926 +0000 UTC m=+1079.144184593 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/672accec-238b-4e18-9b15-5ff8429d4256-etc-swift") pod "swift-storage-0" (UID: "672accec-238b-4e18-9b15-5ff8429d4256") : configmap "swift-ring-files" not found Mar 16 15:49:35 crc kubenswrapper[5120]: I0316 15:49:35.050357 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-crwwq" event={"ID":"598fa73c-5fdc-41e2-9d7d-f3494dc37c79","Type":"ContainerStarted","Data":"54582d89f455f5059226b55ec7720124760202712c7b2987274d39cf6329a03a"} Mar 16 15:49:37 crc kubenswrapper[5120]: I0316 15:49:37.031790 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/672accec-238b-4e18-9b15-5ff8429d4256-etc-swift\") pod \"swift-storage-0\" (UID: \"672accec-238b-4e18-9b15-5ff8429d4256\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 15:49:37 crc kubenswrapper[5120]: E0316 15:49:37.032020 5120 projected.go:289] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Mar 16 15:49:37 crc kubenswrapper[5120]: E0316 15:49:37.032222 5120 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Mar 16 15:49:37 crc kubenswrapper[5120]: E0316 15:49:37.032291 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/672accec-238b-4e18-9b15-5ff8429d4256-etc-swift podName:672accec-238b-4e18-9b15-5ff8429d4256 nodeName:}" failed. No retries permitted until 2026-03-16 15:49:41.032271725 +0000 UTC m=+1083.186203382 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/672accec-238b-4e18-9b15-5ff8429d4256-etc-swift") pod "swift-storage-0" (UID: "672accec-238b-4e18-9b15-5ff8429d4256") : configmap "swift-ring-files" not found Mar 16 15:49:38 crc kubenswrapper[5120]: I0316 15:49:38.080719 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-crwwq" event={"ID":"598fa73c-5fdc-41e2-9d7d-f3494dc37c79","Type":"ContainerStarted","Data":"53bfc98ae96bd02dd4b590c7c9eac982590f422687bb9e9d20a74394998b120f"} Mar 16 15:49:38 crc kubenswrapper[5120]: I0316 15:49:38.102050 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/swift-ring-rebalance-crwwq" podStartSLOduration=2.216091277 podStartE2EDuration="5.102027818s" podCreationTimestamp="2026-03-16 15:49:33 +0000 UTC" firstStartedPulling="2026-03-16 15:49:34.399149966 +0000 UTC m=+1076.553081623" lastFinishedPulling="2026-03-16 15:49:37.285086507 +0000 UTC m=+1079.439018164" observedRunningTime="2026-03-16 15:49:38.094596341 +0000 UTC m=+1080.248527998" watchObservedRunningTime="2026-03-16 15:49:38.102027818 +0000 UTC m=+1080.255959485" Mar 16 15:49:38 crc kubenswrapper[5120]: I0316 15:49:38.232731 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/root-account-create-update-psv7c"] Mar 16 15:49:38 crc kubenswrapper[5120]: I0316 15:49:38.241841 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-psv7c" Mar 16 15:49:38 crc kubenswrapper[5120]: I0316 15:49:38.246000 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"openstack-cell1-mariadb-root-db-secret\"" Mar 16 15:49:38 crc kubenswrapper[5120]: I0316 15:49:38.246906 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-psv7c"] Mar 16 15:49:38 crc kubenswrapper[5120]: I0316 15:49:38.354039 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/4e601b1d-1ad1-4ee9-b14b-0dc98d2a36c7-operator-scripts\") pod \"root-account-create-update-psv7c\" (UID: \"4e601b1d-1ad1-4ee9-b14b-0dc98d2a36c7\") " pod="openstack-kuttl-tests/root-account-create-update-psv7c" Mar 16 15:49:38 crc kubenswrapper[5120]: I0316 15:49:38.354190 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqjpc\" (UniqueName: \"kubernetes.io/projected/4e601b1d-1ad1-4ee9-b14b-0dc98d2a36c7-kube-api-access-pqjpc\") pod \"root-account-create-update-psv7c\" (UID: \"4e601b1d-1ad1-4ee9-b14b-0dc98d2a36c7\") " pod="openstack-kuttl-tests/root-account-create-update-psv7c" Mar 16 15:49:38 crc kubenswrapper[5120]: I0316 15:49:38.455488 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pqjpc\" (UniqueName: \"kubernetes.io/projected/4e601b1d-1ad1-4ee9-b14b-0dc98d2a36c7-kube-api-access-pqjpc\") pod \"root-account-create-update-psv7c\" (UID: \"4e601b1d-1ad1-4ee9-b14b-0dc98d2a36c7\") " pod="openstack-kuttl-tests/root-account-create-update-psv7c" Mar 16 15:49:38 crc kubenswrapper[5120]: I0316 15:49:38.455549 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/4e601b1d-1ad1-4ee9-b14b-0dc98d2a36c7-operator-scripts\") pod \"root-account-create-update-psv7c\" (UID: \"4e601b1d-1ad1-4ee9-b14b-0dc98d2a36c7\") " pod="openstack-kuttl-tests/root-account-create-update-psv7c" Mar 16 15:49:38 crc kubenswrapper[5120]: I0316 15:49:38.456452 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/4e601b1d-1ad1-4ee9-b14b-0dc98d2a36c7-operator-scripts\") pod \"root-account-create-update-psv7c\" (UID: \"4e601b1d-1ad1-4ee9-b14b-0dc98d2a36c7\") " pod="openstack-kuttl-tests/root-account-create-update-psv7c" Mar 16 15:49:38 crc kubenswrapper[5120]: I0316 15:49:38.477152 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqjpc\" (UniqueName: \"kubernetes.io/projected/4e601b1d-1ad1-4ee9-b14b-0dc98d2a36c7-kube-api-access-pqjpc\") pod \"root-account-create-update-psv7c\" (UID: \"4e601b1d-1ad1-4ee9-b14b-0dc98d2a36c7\") " pod="openstack-kuttl-tests/root-account-create-update-psv7c" Mar 16 15:49:38 crc kubenswrapper[5120]: I0316 15:49:38.558288 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-psv7c" Mar 16 15:49:39 crc kubenswrapper[5120]: I0316 15:49:39.000088 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-psv7c"] Mar 16 15:49:39 crc kubenswrapper[5120]: W0316 15:49:39.005562 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4e601b1d_1ad1_4ee9_b14b_0dc98d2a36c7.slice/crio-70346005bdb3d81e046541c9458222fbcb2df5cdc41509c80c58b781dbb347db WatchSource:0}: Error finding container 70346005bdb3d81e046541c9458222fbcb2df5cdc41509c80c58b781dbb347db: Status 404 returned error can't find the container with id 70346005bdb3d81e046541c9458222fbcb2df5cdc41509c80c58b781dbb347db Mar 16 15:49:39 crc kubenswrapper[5120]: I0316 15:49:39.014203 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"openstack-cell1-mariadb-root-db-secret\"" Mar 16 15:49:39 crc kubenswrapper[5120]: I0316 15:49:39.087792 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-psv7c" event={"ID":"4e601b1d-1ad1-4ee9-b14b-0dc98d2a36c7","Type":"ContainerStarted","Data":"70346005bdb3d81e046541c9458222fbcb2df5cdc41509c80c58b781dbb347db"} Mar 16 15:49:40 crc kubenswrapper[5120]: I0316 15:49:40.097728 5120 generic.go:358] "Generic (PLEG): container finished" podID="4e601b1d-1ad1-4ee9-b14b-0dc98d2a36c7" containerID="21a6731c9cc7f5b6a4b7f93045c6fa21596e01cbb0fdcb88466c03991a106a12" exitCode=0 Mar 16 15:49:40 crc kubenswrapper[5120]: I0316 15:49:40.097921 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-psv7c" event={"ID":"4e601b1d-1ad1-4ee9-b14b-0dc98d2a36c7","Type":"ContainerDied","Data":"21a6731c9cc7f5b6a4b7f93045c6fa21596e01cbb0fdcb88466c03991a106a12"} Mar 16 15:49:40 crc kubenswrapper[5120]: I0316 15:49:40.922755 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 15:49:41 crc kubenswrapper[5120]: I0316 15:49:41.112553 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/672accec-238b-4e18-9b15-5ff8429d4256-etc-swift\") pod \"swift-storage-0\" (UID: \"672accec-238b-4e18-9b15-5ff8429d4256\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 15:49:41 crc kubenswrapper[5120]: E0316 15:49:41.113128 5120 projected.go:289] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Mar 16 15:49:41 crc kubenswrapper[5120]: E0316 15:49:41.113145 5120 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Mar 16 15:49:41 crc kubenswrapper[5120]: E0316 15:49:41.113198 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/672accec-238b-4e18-9b15-5ff8429d4256-etc-swift podName:672accec-238b-4e18-9b15-5ff8429d4256 nodeName:}" failed. No retries permitted until 2026-03-16 15:49:49.113181193 +0000 UTC m=+1091.267112850 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/672accec-238b-4e18-9b15-5ff8429d4256-etc-swift") pod "swift-storage-0" (UID: "672accec-238b-4e18-9b15-5ff8429d4256") : configmap "swift-ring-files" not found Mar 16 15:49:41 crc kubenswrapper[5120]: I0316 15:49:41.476879 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-psv7c" Mar 16 15:49:41 crc kubenswrapper[5120]: I0316 15:49:41.518018 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pqjpc\" (UniqueName: \"kubernetes.io/projected/4e601b1d-1ad1-4ee9-b14b-0dc98d2a36c7-kube-api-access-pqjpc\") pod \"4e601b1d-1ad1-4ee9-b14b-0dc98d2a36c7\" (UID: \"4e601b1d-1ad1-4ee9-b14b-0dc98d2a36c7\") " Mar 16 15:49:41 crc kubenswrapper[5120]: I0316 15:49:41.518071 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/4e601b1d-1ad1-4ee9-b14b-0dc98d2a36c7-operator-scripts\") pod \"4e601b1d-1ad1-4ee9-b14b-0dc98d2a36c7\" (UID: \"4e601b1d-1ad1-4ee9-b14b-0dc98d2a36c7\") " Mar 16 15:49:41 crc kubenswrapper[5120]: I0316 15:49:41.518939 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4e601b1d-1ad1-4ee9-b14b-0dc98d2a36c7-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "4e601b1d-1ad1-4ee9-b14b-0dc98d2a36c7" (UID: "4e601b1d-1ad1-4ee9-b14b-0dc98d2a36c7"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:49:41 crc kubenswrapper[5120]: I0316 15:49:41.527819 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e601b1d-1ad1-4ee9-b14b-0dc98d2a36c7-kube-api-access-pqjpc" (OuterVolumeSpecName: "kube-api-access-pqjpc") pod "4e601b1d-1ad1-4ee9-b14b-0dc98d2a36c7" (UID: "4e601b1d-1ad1-4ee9-b14b-0dc98d2a36c7"). InnerVolumeSpecName "kube-api-access-pqjpc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:49:41 crc kubenswrapper[5120]: I0316 15:49:41.619588 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pqjpc\" (UniqueName: \"kubernetes.io/projected/4e601b1d-1ad1-4ee9-b14b-0dc98d2a36c7-kube-api-access-pqjpc\") on node \"crc\" DevicePath \"\"" Mar 16 15:49:41 crc kubenswrapper[5120]: I0316 15:49:41.619839 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/4e601b1d-1ad1-4ee9-b14b-0dc98d2a36c7-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 15:49:42 crc kubenswrapper[5120]: I0316 15:49:42.138020 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-psv7c" event={"ID":"4e601b1d-1ad1-4ee9-b14b-0dc98d2a36c7","Type":"ContainerDied","Data":"70346005bdb3d81e046541c9458222fbcb2df5cdc41509c80c58b781dbb347db"} Mar 16 15:49:42 crc kubenswrapper[5120]: I0316 15:49:42.138381 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="70346005bdb3d81e046541c9458222fbcb2df5cdc41509c80c58b781dbb347db" Mar 16 15:49:42 crc kubenswrapper[5120]: I0316 15:49:42.138107 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-psv7c" Mar 16 15:49:44 crc kubenswrapper[5120]: I0316 15:49:44.159090 5120 generic.go:358] "Generic (PLEG): container finished" podID="598fa73c-5fdc-41e2-9d7d-f3494dc37c79" containerID="53bfc98ae96bd02dd4b590c7c9eac982590f422687bb9e9d20a74394998b120f" exitCode=0 Mar 16 15:49:44 crc kubenswrapper[5120]: I0316 15:49:44.159244 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-crwwq" event={"ID":"598fa73c-5fdc-41e2-9d7d-f3494dc37c79","Type":"ContainerDied","Data":"53bfc98ae96bd02dd4b590c7c9eac982590f422687bb9e9d20a74394998b120f"} Mar 16 15:49:45 crc kubenswrapper[5120]: I0316 15:49:45.053936 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-db-create-bdx4h"] Mar 16 15:49:45 crc kubenswrapper[5120]: I0316 15:49:45.056575 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e601b1d-1ad1-4ee9-b14b-0dc98d2a36c7" containerName="mariadb-account-create-update" Mar 16 15:49:45 crc kubenswrapper[5120]: I0316 15:49:45.056615 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e601b1d-1ad1-4ee9-b14b-0dc98d2a36c7" containerName="mariadb-account-create-update" Mar 16 15:49:45 crc kubenswrapper[5120]: I0316 15:49:45.056891 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="4e601b1d-1ad1-4ee9-b14b-0dc98d2a36c7" containerName="mariadb-account-create-update" Mar 16 15:49:45 crc kubenswrapper[5120]: I0316 15:49:45.069839 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-db-create-bdx4h"] Mar 16 15:49:45 crc kubenswrapper[5120]: I0316 15:49:45.070022 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-create-bdx4h" Mar 16 15:49:45 crc kubenswrapper[5120]: I0316 15:49:45.147984 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-3f2f-account-create-update-dvkp2"] Mar 16 15:49:45 crc kubenswrapper[5120]: I0316 15:49:45.157942 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 15:49:45 crc kubenswrapper[5120]: I0316 15:49:45.157982 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-3f2f-account-create-update-dvkp2"] Mar 16 15:49:45 crc kubenswrapper[5120]: I0316 15:49:45.158124 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-3f2f-account-create-update-dvkp2" Mar 16 15:49:45 crc kubenswrapper[5120]: I0316 15:49:45.160939 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-db-secret\"" Mar 16 15:49:45 crc kubenswrapper[5120]: I0316 15:49:45.189011 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8978t\" (UniqueName: \"kubernetes.io/projected/7a468626-4b34-4bf0-a716-4900c7cb0a1a-kube-api-access-8978t\") pod \"glance-db-create-bdx4h\" (UID: \"7a468626-4b34-4bf0-a716-4900c7cb0a1a\") " pod="openstack-kuttl-tests/glance-db-create-bdx4h" Mar 16 15:49:45 crc kubenswrapper[5120]: I0316 15:49:45.189118 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/7a468626-4b34-4bf0-a716-4900c7cb0a1a-operator-scripts\") pod \"glance-db-create-bdx4h\" (UID: \"7a468626-4b34-4bf0-a716-4900c7cb0a1a\") " pod="openstack-kuttl-tests/glance-db-create-bdx4h" Mar 16 15:49:45 crc kubenswrapper[5120]: I0316 15:49:45.290288 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8978t\" (UniqueName: \"kubernetes.io/projected/7a468626-4b34-4bf0-a716-4900c7cb0a1a-kube-api-access-8978t\") pod \"glance-db-create-bdx4h\" (UID: \"7a468626-4b34-4bf0-a716-4900c7cb0a1a\") " pod="openstack-kuttl-tests/glance-db-create-bdx4h" Mar 16 15:49:45 crc kubenswrapper[5120]: I0316 15:49:45.290377 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/881255d7-a4d0-4d7c-a467-fe8ed96fc94d-operator-scripts\") pod \"glance-3f2f-account-create-update-dvkp2\" (UID: \"881255d7-a4d0-4d7c-a467-fe8ed96fc94d\") " pod="openstack-kuttl-tests/glance-3f2f-account-create-update-dvkp2" Mar 16 15:49:45 crc kubenswrapper[5120]: I0316 15:49:45.290432 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2ltm\" (UniqueName: \"kubernetes.io/projected/881255d7-a4d0-4d7c-a467-fe8ed96fc94d-kube-api-access-s2ltm\") pod \"glance-3f2f-account-create-update-dvkp2\" (UID: \"881255d7-a4d0-4d7c-a467-fe8ed96fc94d\") " pod="openstack-kuttl-tests/glance-3f2f-account-create-update-dvkp2" Mar 16 15:49:45 crc kubenswrapper[5120]: I0316 15:49:45.290486 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/7a468626-4b34-4bf0-a716-4900c7cb0a1a-operator-scripts\") pod \"glance-db-create-bdx4h\" (UID: \"7a468626-4b34-4bf0-a716-4900c7cb0a1a\") " pod="openstack-kuttl-tests/glance-db-create-bdx4h" Mar 16 15:49:45 crc kubenswrapper[5120]: I0316 15:49:45.291157 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/7a468626-4b34-4bf0-a716-4900c7cb0a1a-operator-scripts\") pod \"glance-db-create-bdx4h\" (UID: \"7a468626-4b34-4bf0-a716-4900c7cb0a1a\") " pod="openstack-kuttl-tests/glance-db-create-bdx4h" Mar 16 15:49:45 crc kubenswrapper[5120]: I0316 15:49:45.310270 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8978t\" (UniqueName: \"kubernetes.io/projected/7a468626-4b34-4bf0-a716-4900c7cb0a1a-kube-api-access-8978t\") pod \"glance-db-create-bdx4h\" (UID: \"7a468626-4b34-4bf0-a716-4900c7cb0a1a\") " pod="openstack-kuttl-tests/glance-db-create-bdx4h" Mar 16 15:49:45 crc kubenswrapper[5120]: I0316 15:49:45.390205 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-create-bdx4h" Mar 16 15:49:45 crc kubenswrapper[5120]: I0316 15:49:45.392120 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/881255d7-a4d0-4d7c-a467-fe8ed96fc94d-operator-scripts\") pod \"glance-3f2f-account-create-update-dvkp2\" (UID: \"881255d7-a4d0-4d7c-a467-fe8ed96fc94d\") " pod="openstack-kuttl-tests/glance-3f2f-account-create-update-dvkp2" Mar 16 15:49:45 crc kubenswrapper[5120]: I0316 15:49:45.392200 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s2ltm\" (UniqueName: \"kubernetes.io/projected/881255d7-a4d0-4d7c-a467-fe8ed96fc94d-kube-api-access-s2ltm\") pod \"glance-3f2f-account-create-update-dvkp2\" (UID: \"881255d7-a4d0-4d7c-a467-fe8ed96fc94d\") " pod="openstack-kuttl-tests/glance-3f2f-account-create-update-dvkp2" Mar 16 15:49:45 crc kubenswrapper[5120]: I0316 15:49:45.392936 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/881255d7-a4d0-4d7c-a467-fe8ed96fc94d-operator-scripts\") pod \"glance-3f2f-account-create-update-dvkp2\" (UID: \"881255d7-a4d0-4d7c-a467-fe8ed96fc94d\") " pod="openstack-kuttl-tests/glance-3f2f-account-create-update-dvkp2" Mar 16 15:49:45 crc kubenswrapper[5120]: I0316 15:49:45.408671 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2ltm\" (UniqueName: \"kubernetes.io/projected/881255d7-a4d0-4d7c-a467-fe8ed96fc94d-kube-api-access-s2ltm\") pod \"glance-3f2f-account-create-update-dvkp2\" (UID: \"881255d7-a4d0-4d7c-a467-fe8ed96fc94d\") " pod="openstack-kuttl-tests/glance-3f2f-account-create-update-dvkp2" Mar 16 15:49:45 crc kubenswrapper[5120]: I0316 15:49:45.473133 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-3f2f-account-create-update-dvkp2" Mar 16 15:49:45 crc kubenswrapper[5120]: I0316 15:49:45.601363 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-crwwq" Mar 16 15:49:45 crc kubenswrapper[5120]: I0316 15:49:45.696397 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/598fa73c-5fdc-41e2-9d7d-f3494dc37c79-ring-data-devices\") pod \"598fa73c-5fdc-41e2-9d7d-f3494dc37c79\" (UID: \"598fa73c-5fdc-41e2-9d7d-f3494dc37c79\") " Mar 16 15:49:45 crc kubenswrapper[5120]: I0316 15:49:45.696467 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/598fa73c-5fdc-41e2-9d7d-f3494dc37c79-combined-ca-bundle\") pod \"598fa73c-5fdc-41e2-9d7d-f3494dc37c79\" (UID: \"598fa73c-5fdc-41e2-9d7d-f3494dc37c79\") " Mar 16 15:49:45 crc kubenswrapper[5120]: I0316 15:49:45.696686 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/598fa73c-5fdc-41e2-9d7d-f3494dc37c79-swiftconf\") pod \"598fa73c-5fdc-41e2-9d7d-f3494dc37c79\" (UID: \"598fa73c-5fdc-41e2-9d7d-f3494dc37c79\") " Mar 16 15:49:45 crc kubenswrapper[5120]: I0316 15:49:45.696732 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/598fa73c-5fdc-41e2-9d7d-f3494dc37c79-etc-swift\") pod \"598fa73c-5fdc-41e2-9d7d-f3494dc37c79\" (UID: \"598fa73c-5fdc-41e2-9d7d-f3494dc37c79\") " Mar 16 15:49:45 crc kubenswrapper[5120]: I0316 15:49:45.696774 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/598fa73c-5fdc-41e2-9d7d-f3494dc37c79-scripts\") pod \"598fa73c-5fdc-41e2-9d7d-f3494dc37c79\" (UID: \"598fa73c-5fdc-41e2-9d7d-f3494dc37c79\") " Mar 16 15:49:45 crc kubenswrapper[5120]: I0316 15:49:45.696802 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/598fa73c-5fdc-41e2-9d7d-f3494dc37c79-dispersionconf\") pod \"598fa73c-5fdc-41e2-9d7d-f3494dc37c79\" (UID: \"598fa73c-5fdc-41e2-9d7d-f3494dc37c79\") " Mar 16 15:49:45 crc kubenswrapper[5120]: I0316 15:49:45.696903 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p5k69\" (UniqueName: \"kubernetes.io/projected/598fa73c-5fdc-41e2-9d7d-f3494dc37c79-kube-api-access-p5k69\") pod \"598fa73c-5fdc-41e2-9d7d-f3494dc37c79\" (UID: \"598fa73c-5fdc-41e2-9d7d-f3494dc37c79\") " Mar 16 15:49:45 crc kubenswrapper[5120]: I0316 15:49:45.698379 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/598fa73c-5fdc-41e2-9d7d-f3494dc37c79-etc-swift" (OuterVolumeSpecName: "etc-swift") pod "598fa73c-5fdc-41e2-9d7d-f3494dc37c79" (UID: "598fa73c-5fdc-41e2-9d7d-f3494dc37c79"). InnerVolumeSpecName "etc-swift". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:49:45 crc kubenswrapper[5120]: I0316 15:49:45.699374 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/598fa73c-5fdc-41e2-9d7d-f3494dc37c79-ring-data-devices" (OuterVolumeSpecName: "ring-data-devices") pod "598fa73c-5fdc-41e2-9d7d-f3494dc37c79" (UID: "598fa73c-5fdc-41e2-9d7d-f3494dc37c79"). InnerVolumeSpecName "ring-data-devices". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:49:45 crc kubenswrapper[5120]: I0316 15:49:45.701562 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/598fa73c-5fdc-41e2-9d7d-f3494dc37c79-kube-api-access-p5k69" (OuterVolumeSpecName: "kube-api-access-p5k69") pod "598fa73c-5fdc-41e2-9d7d-f3494dc37c79" (UID: "598fa73c-5fdc-41e2-9d7d-f3494dc37c79"). InnerVolumeSpecName "kube-api-access-p5k69". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:49:45 crc kubenswrapper[5120]: I0316 15:49:45.706561 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/598fa73c-5fdc-41e2-9d7d-f3494dc37c79-dispersionconf" (OuterVolumeSpecName: "dispersionconf") pod "598fa73c-5fdc-41e2-9d7d-f3494dc37c79" (UID: "598fa73c-5fdc-41e2-9d7d-f3494dc37c79"). InnerVolumeSpecName "dispersionconf". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:49:45 crc kubenswrapper[5120]: I0316 15:49:45.722643 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/598fa73c-5fdc-41e2-9d7d-f3494dc37c79-scripts" (OuterVolumeSpecName: "scripts") pod "598fa73c-5fdc-41e2-9d7d-f3494dc37c79" (UID: "598fa73c-5fdc-41e2-9d7d-f3494dc37c79"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:49:45 crc kubenswrapper[5120]: I0316 15:49:45.728576 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/598fa73c-5fdc-41e2-9d7d-f3494dc37c79-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "598fa73c-5fdc-41e2-9d7d-f3494dc37c79" (UID: "598fa73c-5fdc-41e2-9d7d-f3494dc37c79"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:49:45 crc kubenswrapper[5120]: I0316 15:49:45.729862 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/598fa73c-5fdc-41e2-9d7d-f3494dc37c79-swiftconf" (OuterVolumeSpecName: "swiftconf") pod "598fa73c-5fdc-41e2-9d7d-f3494dc37c79" (UID: "598fa73c-5fdc-41e2-9d7d-f3494dc37c79"). InnerVolumeSpecName "swiftconf". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:49:45 crc kubenswrapper[5120]: I0316 15:49:45.799270 5120 reconciler_common.go:299] "Volume detached for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/598fa73c-5fdc-41e2-9d7d-f3494dc37c79-etc-swift\") on node \"crc\" DevicePath \"\"" Mar 16 15:49:45 crc kubenswrapper[5120]: I0316 15:49:45.799299 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/598fa73c-5fdc-41e2-9d7d-f3494dc37c79-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 15:49:45 crc kubenswrapper[5120]: I0316 15:49:45.799308 5120 reconciler_common.go:299] "Volume detached for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/598fa73c-5fdc-41e2-9d7d-f3494dc37c79-dispersionconf\") on node \"crc\" DevicePath \"\"" Mar 16 15:49:45 crc kubenswrapper[5120]: I0316 15:49:45.799322 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p5k69\" (UniqueName: \"kubernetes.io/projected/598fa73c-5fdc-41e2-9d7d-f3494dc37c79-kube-api-access-p5k69\") on node \"crc\" DevicePath \"\"" Mar 16 15:49:45 crc kubenswrapper[5120]: I0316 15:49:45.799330 5120 reconciler_common.go:299] "Volume detached for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/598fa73c-5fdc-41e2-9d7d-f3494dc37c79-ring-data-devices\") on node \"crc\" DevicePath \"\"" Mar 16 15:49:45 crc kubenswrapper[5120]: I0316 15:49:45.799338 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/598fa73c-5fdc-41e2-9d7d-f3494dc37c79-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:49:45 crc kubenswrapper[5120]: I0316 15:49:45.799348 5120 reconciler_common.go:299] "Volume detached for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/598fa73c-5fdc-41e2-9d7d-f3494dc37c79-swiftconf\") on node \"crc\" DevicePath \"\"" Mar 16 15:49:45 crc kubenswrapper[5120]: W0316 15:49:45.913281 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7a468626_4b34_4bf0_a716_4900c7cb0a1a.slice/crio-ed2fbec39fc2fbe58f4cae2e0cc43fb888f90e7b3414de7c43e6c8d308760553 WatchSource:0}: Error finding container ed2fbec39fc2fbe58f4cae2e0cc43fb888f90e7b3414de7c43e6c8d308760553: Status 404 returned error can't find the container with id ed2fbec39fc2fbe58f4cae2e0cc43fb888f90e7b3414de7c43e6c8d308760553 Mar 16 15:49:45 crc kubenswrapper[5120]: I0316 15:49:45.921692 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-db-create-bdx4h"] Mar 16 15:49:45 crc kubenswrapper[5120]: I0316 15:49:45.998480 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-3f2f-account-create-update-dvkp2"] Mar 16 15:49:46 crc kubenswrapper[5120]: W0316 15:49:46.009132 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod881255d7_a4d0_4d7c_a467_fe8ed96fc94d.slice/crio-317e2f49447d4039776ce3fd904663f5dde2c05b367ee25a2c648a14daaab9a3 WatchSource:0}: Error finding container 317e2f49447d4039776ce3fd904663f5dde2c05b367ee25a2c648a14daaab9a3: Status 404 returned error can't find the container with id 317e2f49447d4039776ce3fd904663f5dde2c05b367ee25a2c648a14daaab9a3 Mar 16 15:49:46 crc kubenswrapper[5120]: I0316 15:49:46.175633 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-crwwq" event={"ID":"598fa73c-5fdc-41e2-9d7d-f3494dc37c79","Type":"ContainerDied","Data":"54582d89f455f5059226b55ec7720124760202712c7b2987274d39cf6329a03a"} Mar 16 15:49:46 crc kubenswrapper[5120]: I0316 15:49:46.175681 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-crwwq" Mar 16 15:49:46 crc kubenswrapper[5120]: I0316 15:49:46.175707 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="54582d89f455f5059226b55ec7720124760202712c7b2987274d39cf6329a03a" Mar 16 15:49:46 crc kubenswrapper[5120]: I0316 15:49:46.177972 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-create-bdx4h" event={"ID":"7a468626-4b34-4bf0-a716-4900c7cb0a1a","Type":"ContainerStarted","Data":"ed2fbec39fc2fbe58f4cae2e0cc43fb888f90e7b3414de7c43e6c8d308760553"} Mar 16 15:49:46 crc kubenswrapper[5120]: I0316 15:49:46.178937 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-3f2f-account-create-update-dvkp2" event={"ID":"881255d7-a4d0-4d7c-a467-fe8ed96fc94d","Type":"ContainerStarted","Data":"317e2f49447d4039776ce3fd904663f5dde2c05b367ee25a2c648a14daaab9a3"} Mar 16 15:49:46 crc kubenswrapper[5120]: I0316 15:49:46.796922 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-psv7c"] Mar 16 15:49:46 crc kubenswrapper[5120]: I0316 15:49:46.805126 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-psv7c"] Mar 16 15:49:46 crc kubenswrapper[5120]: I0316 15:49:46.882165 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/root-account-create-update-k9tph"] Mar 16 15:49:46 crc kubenswrapper[5120]: I0316 15:49:46.883384 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="598fa73c-5fdc-41e2-9d7d-f3494dc37c79" containerName="swift-ring-rebalance" Mar 16 15:49:46 crc kubenswrapper[5120]: I0316 15:49:46.883415 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="598fa73c-5fdc-41e2-9d7d-f3494dc37c79" containerName="swift-ring-rebalance" Mar 16 15:49:46 crc kubenswrapper[5120]: I0316 15:49:46.883588 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="598fa73c-5fdc-41e2-9d7d-f3494dc37c79" containerName="swift-ring-rebalance" Mar 16 15:49:46 crc kubenswrapper[5120]: I0316 15:49:46.887596 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-k9tph" Mar 16 15:49:46 crc kubenswrapper[5120]: I0316 15:49:46.888607 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-k9tph"] Mar 16 15:49:46 crc kubenswrapper[5120]: I0316 15:49:46.889381 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"openstack-mariadb-root-db-secret\"" Mar 16 15:49:47 crc kubenswrapper[5120]: I0316 15:49:47.019660 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xp2d\" (UniqueName: \"kubernetes.io/projected/cc6757c4-4a63-4db6-b3d6-2a42f658123f-kube-api-access-4xp2d\") pod \"root-account-create-update-k9tph\" (UID: \"cc6757c4-4a63-4db6-b3d6-2a42f658123f\") " pod="openstack-kuttl-tests/root-account-create-update-k9tph" Mar 16 15:49:47 crc kubenswrapper[5120]: I0316 15:49:47.019740 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/cc6757c4-4a63-4db6-b3d6-2a42f658123f-operator-scripts\") pod \"root-account-create-update-k9tph\" (UID: \"cc6757c4-4a63-4db6-b3d6-2a42f658123f\") " pod="openstack-kuttl-tests/root-account-create-update-k9tph" Mar 16 15:49:47 crc kubenswrapper[5120]: I0316 15:49:47.121130 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4xp2d\" (UniqueName: \"kubernetes.io/projected/cc6757c4-4a63-4db6-b3d6-2a42f658123f-kube-api-access-4xp2d\") pod \"root-account-create-update-k9tph\" (UID: \"cc6757c4-4a63-4db6-b3d6-2a42f658123f\") " pod="openstack-kuttl-tests/root-account-create-update-k9tph" Mar 16 15:49:47 crc kubenswrapper[5120]: I0316 15:49:47.121209 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/cc6757c4-4a63-4db6-b3d6-2a42f658123f-operator-scripts\") pod \"root-account-create-update-k9tph\" (UID: \"cc6757c4-4a63-4db6-b3d6-2a42f658123f\") " pod="openstack-kuttl-tests/root-account-create-update-k9tph" Mar 16 15:49:47 crc kubenswrapper[5120]: I0316 15:49:47.122419 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/cc6757c4-4a63-4db6-b3d6-2a42f658123f-operator-scripts\") pod \"root-account-create-update-k9tph\" (UID: \"cc6757c4-4a63-4db6-b3d6-2a42f658123f\") " pod="openstack-kuttl-tests/root-account-create-update-k9tph" Mar 16 15:49:47 crc kubenswrapper[5120]: I0316 15:49:47.139611 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xp2d\" (UniqueName: \"kubernetes.io/projected/cc6757c4-4a63-4db6-b3d6-2a42f658123f-kube-api-access-4xp2d\") pod \"root-account-create-update-k9tph\" (UID: \"cc6757c4-4a63-4db6-b3d6-2a42f658123f\") " pod="openstack-kuttl-tests/root-account-create-update-k9tph" Mar 16 15:49:47 crc kubenswrapper[5120]: I0316 15:49:47.186975 5120 generic.go:358] "Generic (PLEG): container finished" podID="7a468626-4b34-4bf0-a716-4900c7cb0a1a" containerID="f29c5599a5a10d75930b34202418a4e4dfdaf9eb0e035a7f633eb4e29115c475" exitCode=0 Mar 16 15:49:47 crc kubenswrapper[5120]: I0316 15:49:47.187117 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-create-bdx4h" event={"ID":"7a468626-4b34-4bf0-a716-4900c7cb0a1a","Type":"ContainerDied","Data":"f29c5599a5a10d75930b34202418a4e4dfdaf9eb0e035a7f633eb4e29115c475"} Mar 16 15:49:47 crc kubenswrapper[5120]: I0316 15:49:47.190601 5120 generic.go:358] "Generic (PLEG): container finished" podID="881255d7-a4d0-4d7c-a467-fe8ed96fc94d" containerID="9cf1ff52e34d9a421706bbb6fd9916b0326245bd31c5fb1be6446abbe00739e8" exitCode=0 Mar 16 15:49:47 crc kubenswrapper[5120]: I0316 15:49:47.190646 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-3f2f-account-create-update-dvkp2" event={"ID":"881255d7-a4d0-4d7c-a467-fe8ed96fc94d","Type":"ContainerDied","Data":"9cf1ff52e34d9a421706bbb6fd9916b0326245bd31c5fb1be6446abbe00739e8"} Mar 16 15:49:47 crc kubenswrapper[5120]: I0316 15:49:47.218128 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-k9tph" Mar 16 15:49:47 crc kubenswrapper[5120]: I0316 15:49:47.681103 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-k9tph"] Mar 16 15:49:48 crc kubenswrapper[5120]: I0316 15:49:48.213642 5120 generic.go:358] "Generic (PLEG): container finished" podID="cc6757c4-4a63-4db6-b3d6-2a42f658123f" containerID="5606f9ec875e826c528e4fb65ff5fd31bd80a651340c3947f06162b79757ac0e" exitCode=0 Mar 16 15:49:48 crc kubenswrapper[5120]: I0316 15:49:48.213817 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-k9tph" event={"ID":"cc6757c4-4a63-4db6-b3d6-2a42f658123f","Type":"ContainerDied","Data":"5606f9ec875e826c528e4fb65ff5fd31bd80a651340c3947f06162b79757ac0e"} Mar 16 15:49:48 crc kubenswrapper[5120]: I0316 15:49:48.214562 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-k9tph" event={"ID":"cc6757c4-4a63-4db6-b3d6-2a42f658123f","Type":"ContainerStarted","Data":"b1c7d242c1291b4dc919732b0e495bdb6ba4ab0381067e623ae933c4c253605a"} Mar 16 15:49:48 crc kubenswrapper[5120]: I0316 15:49:48.682369 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4e601b1d-1ad1-4ee9-b14b-0dc98d2a36c7" path="/var/lib/kubelet/pods/4e601b1d-1ad1-4ee9-b14b-0dc98d2a36c7/volumes" Mar 16 15:49:48 crc kubenswrapper[5120]: I0316 15:49:48.729451 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-create-bdx4h" Mar 16 15:49:48 crc kubenswrapper[5120]: I0316 15:49:48.735014 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-3f2f-account-create-update-dvkp2" Mar 16 15:49:48 crc kubenswrapper[5120]: I0316 15:49:48.854328 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8978t\" (UniqueName: \"kubernetes.io/projected/7a468626-4b34-4bf0-a716-4900c7cb0a1a-kube-api-access-8978t\") pod \"7a468626-4b34-4bf0-a716-4900c7cb0a1a\" (UID: \"7a468626-4b34-4bf0-a716-4900c7cb0a1a\") " Mar 16 15:49:48 crc kubenswrapper[5120]: I0316 15:49:48.854438 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/7a468626-4b34-4bf0-a716-4900c7cb0a1a-operator-scripts\") pod \"7a468626-4b34-4bf0-a716-4900c7cb0a1a\" (UID: \"7a468626-4b34-4bf0-a716-4900c7cb0a1a\") " Mar 16 15:49:48 crc kubenswrapper[5120]: I0316 15:49:48.854535 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/881255d7-a4d0-4d7c-a467-fe8ed96fc94d-operator-scripts\") pod \"881255d7-a4d0-4d7c-a467-fe8ed96fc94d\" (UID: \"881255d7-a4d0-4d7c-a467-fe8ed96fc94d\") " Mar 16 15:49:48 crc kubenswrapper[5120]: I0316 15:49:48.854590 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s2ltm\" (UniqueName: \"kubernetes.io/projected/881255d7-a4d0-4d7c-a467-fe8ed96fc94d-kube-api-access-s2ltm\") pod \"881255d7-a4d0-4d7c-a467-fe8ed96fc94d\" (UID: \"881255d7-a4d0-4d7c-a467-fe8ed96fc94d\") " Mar 16 15:49:48 crc kubenswrapper[5120]: I0316 15:49:48.855446 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/881255d7-a4d0-4d7c-a467-fe8ed96fc94d-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "881255d7-a4d0-4d7c-a467-fe8ed96fc94d" (UID: "881255d7-a4d0-4d7c-a467-fe8ed96fc94d"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:49:48 crc kubenswrapper[5120]: I0316 15:49:48.856203 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7a468626-4b34-4bf0-a716-4900c7cb0a1a-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "7a468626-4b34-4bf0-a716-4900c7cb0a1a" (UID: "7a468626-4b34-4bf0-a716-4900c7cb0a1a"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:49:48 crc kubenswrapper[5120]: I0316 15:49:48.861398 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a468626-4b34-4bf0-a716-4900c7cb0a1a-kube-api-access-8978t" (OuterVolumeSpecName: "kube-api-access-8978t") pod "7a468626-4b34-4bf0-a716-4900c7cb0a1a" (UID: "7a468626-4b34-4bf0-a716-4900c7cb0a1a"). InnerVolumeSpecName "kube-api-access-8978t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:49:48 crc kubenswrapper[5120]: I0316 15:49:48.861681 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/881255d7-a4d0-4d7c-a467-fe8ed96fc94d-kube-api-access-s2ltm" (OuterVolumeSpecName: "kube-api-access-s2ltm") pod "881255d7-a4d0-4d7c-a467-fe8ed96fc94d" (UID: "881255d7-a4d0-4d7c-a467-fe8ed96fc94d"). InnerVolumeSpecName "kube-api-access-s2ltm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:49:48 crc kubenswrapper[5120]: I0316 15:49:48.957552 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/881255d7-a4d0-4d7c-a467-fe8ed96fc94d-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 15:49:48 crc kubenswrapper[5120]: I0316 15:49:48.957600 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s2ltm\" (UniqueName: \"kubernetes.io/projected/881255d7-a4d0-4d7c-a467-fe8ed96fc94d-kube-api-access-s2ltm\") on node \"crc\" DevicePath \"\"" Mar 16 15:49:48 crc kubenswrapper[5120]: I0316 15:49:48.957621 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8978t\" (UniqueName: \"kubernetes.io/projected/7a468626-4b34-4bf0-a716-4900c7cb0a1a-kube-api-access-8978t\") on node \"crc\" DevicePath \"\"" Mar 16 15:49:48 crc kubenswrapper[5120]: I0316 15:49:48.957641 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/7a468626-4b34-4bf0-a716-4900c7cb0a1a-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 15:49:49 crc kubenswrapper[5120]: I0316 15:49:49.160023 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/672accec-238b-4e18-9b15-5ff8429d4256-etc-swift\") pod \"swift-storage-0\" (UID: \"672accec-238b-4e18-9b15-5ff8429d4256\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 15:49:49 crc kubenswrapper[5120]: I0316 15:49:49.167938 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/672accec-238b-4e18-9b15-5ff8429d4256-etc-swift\") pod \"swift-storage-0\" (UID: \"672accec-238b-4e18-9b15-5ff8429d4256\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 15:49:49 crc kubenswrapper[5120]: I0316 15:49:49.224528 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-create-bdx4h" event={"ID":"7a468626-4b34-4bf0-a716-4900c7cb0a1a","Type":"ContainerDied","Data":"ed2fbec39fc2fbe58f4cae2e0cc43fb888f90e7b3414de7c43e6c8d308760553"} Mar 16 15:49:49 crc kubenswrapper[5120]: I0316 15:49:49.224549 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-create-bdx4h" Mar 16 15:49:49 crc kubenswrapper[5120]: I0316 15:49:49.224580 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ed2fbec39fc2fbe58f4cae2e0cc43fb888f90e7b3414de7c43e6c8d308760553" Mar 16 15:49:49 crc kubenswrapper[5120]: I0316 15:49:49.227094 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-3f2f-account-create-update-dvkp2" Mar 16 15:49:49 crc kubenswrapper[5120]: I0316 15:49:49.227128 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-3f2f-account-create-update-dvkp2" event={"ID":"881255d7-a4d0-4d7c-a467-fe8ed96fc94d","Type":"ContainerDied","Data":"317e2f49447d4039776ce3fd904663f5dde2c05b367ee25a2c648a14daaab9a3"} Mar 16 15:49:49 crc kubenswrapper[5120]: I0316 15:49:49.227146 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="317e2f49447d4039776ce3fd904663f5dde2c05b367ee25a2c648a14daaab9a3" Mar 16 15:49:49 crc kubenswrapper[5120]: I0316 15:49:49.396892 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Mar 16 15:49:49 crc kubenswrapper[5120]: I0316 15:49:49.562592 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-k9tph" Mar 16 15:49:49 crc kubenswrapper[5120]: I0316 15:49:49.673932 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/cc6757c4-4a63-4db6-b3d6-2a42f658123f-operator-scripts\") pod \"cc6757c4-4a63-4db6-b3d6-2a42f658123f\" (UID: \"cc6757c4-4a63-4db6-b3d6-2a42f658123f\") " Mar 16 15:49:49 crc kubenswrapper[5120]: I0316 15:49:49.674058 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4xp2d\" (UniqueName: \"kubernetes.io/projected/cc6757c4-4a63-4db6-b3d6-2a42f658123f-kube-api-access-4xp2d\") pod \"cc6757c4-4a63-4db6-b3d6-2a42f658123f\" (UID: \"cc6757c4-4a63-4db6-b3d6-2a42f658123f\") " Mar 16 15:49:49 crc kubenswrapper[5120]: I0316 15:49:49.675422 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc6757c4-4a63-4db6-b3d6-2a42f658123f-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "cc6757c4-4a63-4db6-b3d6-2a42f658123f" (UID: "cc6757c4-4a63-4db6-b3d6-2a42f658123f"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:49:49 crc kubenswrapper[5120]: I0316 15:49:49.678339 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc6757c4-4a63-4db6-b3d6-2a42f658123f-kube-api-access-4xp2d" (OuterVolumeSpecName: "kube-api-access-4xp2d") pod "cc6757c4-4a63-4db6-b3d6-2a42f658123f" (UID: "cc6757c4-4a63-4db6-b3d6-2a42f658123f"). InnerVolumeSpecName "kube-api-access-4xp2d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:49:49 crc kubenswrapper[5120]: I0316 15:49:49.777320 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/cc6757c4-4a63-4db6-b3d6-2a42f658123f-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 15:49:49 crc kubenswrapper[5120]: I0316 15:49:49.777368 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4xp2d\" (UniqueName: \"kubernetes.io/projected/cc6757c4-4a63-4db6-b3d6-2a42f658123f-kube-api-access-4xp2d\") on node \"crc\" DevicePath \"\"" Mar 16 15:49:49 crc kubenswrapper[5120]: I0316 15:49:49.884005 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 15:49:49 crc kubenswrapper[5120]: W0316 15:49:49.927587 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod672accec_238b_4e18_9b15_5ff8429d4256.slice/crio-1ac0de8d51240f93133081de7eb9bb268a3b8161a7e62aecd5b75835a35939b6 WatchSource:0}: Error finding container 1ac0de8d51240f93133081de7eb9bb268a3b8161a7e62aecd5b75835a35939b6: Status 404 returned error can't find the container with id 1ac0de8d51240f93133081de7eb9bb268a3b8161a7e62aecd5b75835a35939b6 Mar 16 15:49:50 crc kubenswrapper[5120]: I0316 15:49:50.245934 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-k9tph" Mar 16 15:49:50 crc kubenswrapper[5120]: I0316 15:49:50.246007 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-k9tph" event={"ID":"cc6757c4-4a63-4db6-b3d6-2a42f658123f","Type":"ContainerDied","Data":"b1c7d242c1291b4dc919732b0e495bdb6ba4ab0381067e623ae933c4c253605a"} Mar 16 15:49:50 crc kubenswrapper[5120]: I0316 15:49:50.246067 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b1c7d242c1291b4dc919732b0e495bdb6ba4ab0381067e623ae933c4c253605a" Mar 16 15:49:50 crc kubenswrapper[5120]: I0316 15:49:50.249092 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"672accec-238b-4e18-9b15-5ff8429d4256","Type":"ContainerStarted","Data":"1ac0de8d51240f93133081de7eb9bb268a3b8161a7e62aecd5b75835a35939b6"} Mar 16 15:49:50 crc kubenswrapper[5120]: I0316 15:49:50.251385 5120 generic.go:358] "Generic (PLEG): container finished" podID="39704fdb-36c4-41fe-8c13-35a3abb56c36" containerID="8970debe191db64e238196677dc31c851eca165e847dd7c77e1bae7f6b09f591" exitCode=0 Mar 16 15:49:50 crc kubenswrapper[5120]: I0316 15:49:50.251528 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"39704fdb-36c4-41fe-8c13-35a3abb56c36","Type":"ContainerDied","Data":"8970debe191db64e238196677dc31c851eca165e847dd7c77e1bae7f6b09f591"} Mar 16 15:49:50 crc kubenswrapper[5120]: I0316 15:49:50.260820 5120 generic.go:358] "Generic (PLEG): container finished" podID="36a1c719-e302-4df3-99c5-5025d99c8c19" containerID="b893f38e517ffdf9d92dd3de8d1b52ba2598e907c05bc8d1dd50838721c10b45" exitCode=0 Mar 16 15:49:50 crc kubenswrapper[5120]: I0316 15:49:50.260916 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"36a1c719-e302-4df3-99c5-5025d99c8c19","Type":"ContainerDied","Data":"b893f38e517ffdf9d92dd3de8d1b52ba2598e907c05bc8d1dd50838721c10b45"} Mar 16 15:49:50 crc kubenswrapper[5120]: I0316 15:49:50.302245 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-db-sync-5fw99"] Mar 16 15:49:50 crc kubenswrapper[5120]: I0316 15:49:50.309656 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="881255d7-a4d0-4d7c-a467-fe8ed96fc94d" containerName="mariadb-account-create-update" Mar 16 15:49:50 crc kubenswrapper[5120]: I0316 15:49:50.309896 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="881255d7-a4d0-4d7c-a467-fe8ed96fc94d" containerName="mariadb-account-create-update" Mar 16 15:49:50 crc kubenswrapper[5120]: I0316 15:49:50.310002 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc6757c4-4a63-4db6-b3d6-2a42f658123f" containerName="mariadb-account-create-update" Mar 16 15:49:50 crc kubenswrapper[5120]: I0316 15:49:50.310053 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc6757c4-4a63-4db6-b3d6-2a42f658123f" containerName="mariadb-account-create-update" Mar 16 15:49:50 crc kubenswrapper[5120]: I0316 15:49:50.310108 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a468626-4b34-4bf0-a716-4900c7cb0a1a" containerName="mariadb-database-create" Mar 16 15:49:50 crc kubenswrapper[5120]: I0316 15:49:50.310154 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a468626-4b34-4bf0-a716-4900c7cb0a1a" containerName="mariadb-database-create" Mar 16 15:49:50 crc kubenswrapper[5120]: I0316 15:49:50.310382 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7a468626-4b34-4bf0-a716-4900c7cb0a1a" containerName="mariadb-database-create" Mar 16 15:49:50 crc kubenswrapper[5120]: I0316 15:49:50.310442 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="cc6757c4-4a63-4db6-b3d6-2a42f658123f" containerName="mariadb-account-create-update" Mar 16 15:49:50 crc kubenswrapper[5120]: I0316 15:49:50.310506 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="881255d7-a4d0-4d7c-a467-fe8ed96fc94d" containerName="mariadb-account-create-update" Mar 16 15:49:50 crc kubenswrapper[5120]: I0316 15:49:50.326921 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-5fw99"] Mar 16 15:49:50 crc kubenswrapper[5120]: I0316 15:49:50.327074 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-5fw99" Mar 16 15:49:50 crc kubenswrapper[5120]: I0316 15:49:50.330715 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-config-data\"" Mar 16 15:49:50 crc kubenswrapper[5120]: I0316 15:49:50.330881 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-glance-dockercfg-478kn\"" Mar 16 15:49:50 crc kubenswrapper[5120]: I0316 15:49:50.493200 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e43da138-d989-4c49-aeea-5a251a21f2d4-combined-ca-bundle\") pod \"glance-db-sync-5fw99\" (UID: \"e43da138-d989-4c49-aeea-5a251a21f2d4\") " pod="openstack-kuttl-tests/glance-db-sync-5fw99" Mar 16 15:49:50 crc kubenswrapper[5120]: I0316 15:49:50.493644 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e43da138-d989-4c49-aeea-5a251a21f2d4-config-data\") pod \"glance-db-sync-5fw99\" (UID: \"e43da138-d989-4c49-aeea-5a251a21f2d4\") " pod="openstack-kuttl-tests/glance-db-sync-5fw99" Mar 16 15:49:50 crc kubenswrapper[5120]: I0316 15:49:50.493728 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/e43da138-d989-4c49-aeea-5a251a21f2d4-db-sync-config-data\") pod \"glance-db-sync-5fw99\" (UID: \"e43da138-d989-4c49-aeea-5a251a21f2d4\") " pod="openstack-kuttl-tests/glance-db-sync-5fw99" Mar 16 15:49:50 crc kubenswrapper[5120]: I0316 15:49:50.493795 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6s5j\" (UniqueName: \"kubernetes.io/projected/e43da138-d989-4c49-aeea-5a251a21f2d4-kube-api-access-f6s5j\") pod \"glance-db-sync-5fw99\" (UID: \"e43da138-d989-4c49-aeea-5a251a21f2d4\") " pod="openstack-kuttl-tests/glance-db-sync-5fw99" Mar 16 15:49:50 crc kubenswrapper[5120]: I0316 15:49:50.595075 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e43da138-d989-4c49-aeea-5a251a21f2d4-config-data\") pod \"glance-db-sync-5fw99\" (UID: \"e43da138-d989-4c49-aeea-5a251a21f2d4\") " pod="openstack-kuttl-tests/glance-db-sync-5fw99" Mar 16 15:49:50 crc kubenswrapper[5120]: I0316 15:49:50.595380 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/e43da138-d989-4c49-aeea-5a251a21f2d4-db-sync-config-data\") pod \"glance-db-sync-5fw99\" (UID: \"e43da138-d989-4c49-aeea-5a251a21f2d4\") " pod="openstack-kuttl-tests/glance-db-sync-5fw99" Mar 16 15:49:50 crc kubenswrapper[5120]: I0316 15:49:50.595470 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f6s5j\" (UniqueName: \"kubernetes.io/projected/e43da138-d989-4c49-aeea-5a251a21f2d4-kube-api-access-f6s5j\") pod \"glance-db-sync-5fw99\" (UID: \"e43da138-d989-4c49-aeea-5a251a21f2d4\") " pod="openstack-kuttl-tests/glance-db-sync-5fw99" Mar 16 15:49:50 crc kubenswrapper[5120]: I0316 15:49:50.595580 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e43da138-d989-4c49-aeea-5a251a21f2d4-combined-ca-bundle\") pod \"glance-db-sync-5fw99\" (UID: \"e43da138-d989-4c49-aeea-5a251a21f2d4\") " pod="openstack-kuttl-tests/glance-db-sync-5fw99" Mar 16 15:49:50 crc kubenswrapper[5120]: I0316 15:49:50.600649 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e43da138-d989-4c49-aeea-5a251a21f2d4-config-data\") pod \"glance-db-sync-5fw99\" (UID: \"e43da138-d989-4c49-aeea-5a251a21f2d4\") " pod="openstack-kuttl-tests/glance-db-sync-5fw99" Mar 16 15:49:50 crc kubenswrapper[5120]: I0316 15:49:50.601096 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/e43da138-d989-4c49-aeea-5a251a21f2d4-db-sync-config-data\") pod \"glance-db-sync-5fw99\" (UID: \"e43da138-d989-4c49-aeea-5a251a21f2d4\") " pod="openstack-kuttl-tests/glance-db-sync-5fw99" Mar 16 15:49:50 crc kubenswrapper[5120]: I0316 15:49:50.603384 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e43da138-d989-4c49-aeea-5a251a21f2d4-combined-ca-bundle\") pod \"glance-db-sync-5fw99\" (UID: \"e43da138-d989-4c49-aeea-5a251a21f2d4\") " pod="openstack-kuttl-tests/glance-db-sync-5fw99" Mar 16 15:49:50 crc kubenswrapper[5120]: I0316 15:49:50.615905 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6s5j\" (UniqueName: \"kubernetes.io/projected/e43da138-d989-4c49-aeea-5a251a21f2d4-kube-api-access-f6s5j\") pod \"glance-db-sync-5fw99\" (UID: \"e43da138-d989-4c49-aeea-5a251a21f2d4\") " pod="openstack-kuttl-tests/glance-db-sync-5fw99" Mar 16 15:49:50 crc kubenswrapper[5120]: I0316 15:49:50.693995 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-5fw99" Mar 16 15:49:50 crc kubenswrapper[5120]: I0316 15:49:50.738405 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-db-create-q5hqz"] Mar 16 15:49:50 crc kubenswrapper[5120]: I0316 15:49:50.777417 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-db-create-q5hqz"] Mar 16 15:49:50 crc kubenswrapper[5120]: I0316 15:49:50.777555 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-create-q5hqz" Mar 16 15:49:50 crc kubenswrapper[5120]: I0316 15:49:50.872495 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-236f-account-create-update-8b5q5"] Mar 16 15:49:50 crc kubenswrapper[5120]: I0316 15:49:50.879477 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-236f-account-create-update-8b5q5" Mar 16 15:49:50 crc kubenswrapper[5120]: I0316 15:49:50.881788 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-db-secret\"" Mar 16 15:49:50 crc kubenswrapper[5120]: I0316 15:49:50.893842 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-236f-account-create-update-8b5q5"] Mar 16 15:49:50 crc kubenswrapper[5120]: I0316 15:49:50.900275 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2f195b64-2183-4e0f-8db8-7bab4ad019f7-operator-scripts\") pod \"keystone-db-create-q5hqz\" (UID: \"2f195b64-2183-4e0f-8db8-7bab4ad019f7\") " pod="openstack-kuttl-tests/keystone-db-create-q5hqz" Mar 16 15:49:50 crc kubenswrapper[5120]: I0316 15:49:50.900354 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qtg5\" (UniqueName: \"kubernetes.io/projected/2f195b64-2183-4e0f-8db8-7bab4ad019f7-kube-api-access-4qtg5\") pod \"keystone-db-create-q5hqz\" (UID: \"2f195b64-2183-4e0f-8db8-7bab4ad019f7\") " pod="openstack-kuttl-tests/keystone-db-create-q5hqz" Mar 16 15:49:50 crc kubenswrapper[5120]: I0316 15:49:50.956808 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-db-create-c24qt"] Mar 16 15:49:50 crc kubenswrapper[5120]: I0316 15:49:50.972598 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-create-c24qt" Mar 16 15:49:50 crc kubenswrapper[5120]: I0316 15:49:50.976168 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-db-create-c24qt"] Mar 16 15:49:50 crc kubenswrapper[5120]: I0316 15:49:50.992624 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-a347-account-create-update-f9f46"] Mar 16 15:49:50 crc kubenswrapper[5120]: I0316 15:49:50.998000 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-a347-account-create-update-f9f46" Mar 16 15:49:51 crc kubenswrapper[5120]: I0316 15:49:51.001362 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-db-secret\"" Mar 16 15:49:51 crc kubenswrapper[5120]: I0316 15:49:51.001854 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/05e1d6eb-b3dc-45fd-9ae7-6636f015529b-operator-scripts\") pod \"keystone-236f-account-create-update-8b5q5\" (UID: \"05e1d6eb-b3dc-45fd-9ae7-6636f015529b\") " pod="openstack-kuttl-tests/keystone-236f-account-create-update-8b5q5" Mar 16 15:49:51 crc kubenswrapper[5120]: I0316 15:49:51.001925 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2f195b64-2183-4e0f-8db8-7bab4ad019f7-operator-scripts\") pod \"keystone-db-create-q5hqz\" (UID: \"2f195b64-2183-4e0f-8db8-7bab4ad019f7\") " pod="openstack-kuttl-tests/keystone-db-create-q5hqz" Mar 16 15:49:51 crc kubenswrapper[5120]: I0316 15:49:51.002001 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4qtg5\" (UniqueName: \"kubernetes.io/projected/2f195b64-2183-4e0f-8db8-7bab4ad019f7-kube-api-access-4qtg5\") pod \"keystone-db-create-q5hqz\" (UID: \"2f195b64-2183-4e0f-8db8-7bab4ad019f7\") " pod="openstack-kuttl-tests/keystone-db-create-q5hqz" Mar 16 15:49:51 crc kubenswrapper[5120]: I0316 15:49:51.002035 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4lvww\" (UniqueName: \"kubernetes.io/projected/05e1d6eb-b3dc-45fd-9ae7-6636f015529b-kube-api-access-4lvww\") pod \"keystone-236f-account-create-update-8b5q5\" (UID: \"05e1d6eb-b3dc-45fd-9ae7-6636f015529b\") " pod="openstack-kuttl-tests/keystone-236f-account-create-update-8b5q5" Mar 16 15:49:51 crc kubenswrapper[5120]: I0316 15:49:51.002927 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2f195b64-2183-4e0f-8db8-7bab4ad019f7-operator-scripts\") pod \"keystone-db-create-q5hqz\" (UID: \"2f195b64-2183-4e0f-8db8-7bab4ad019f7\") " pod="openstack-kuttl-tests/keystone-db-create-q5hqz" Mar 16 15:49:51 crc kubenswrapper[5120]: I0316 15:49:51.005701 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-a347-account-create-update-f9f46"] Mar 16 15:49:51 crc kubenswrapper[5120]: I0316 15:49:51.025019 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qtg5\" (UniqueName: \"kubernetes.io/projected/2f195b64-2183-4e0f-8db8-7bab4ad019f7-kube-api-access-4qtg5\") pod \"keystone-db-create-q5hqz\" (UID: \"2f195b64-2183-4e0f-8db8-7bab4ad019f7\") " pod="openstack-kuttl-tests/keystone-db-create-q5hqz" Mar 16 15:49:51 crc kubenswrapper[5120]: I0316 15:49:51.103386 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/05e1d6eb-b3dc-45fd-9ae7-6636f015529b-operator-scripts\") pod \"keystone-236f-account-create-update-8b5q5\" (UID: \"05e1d6eb-b3dc-45fd-9ae7-6636f015529b\") " pod="openstack-kuttl-tests/keystone-236f-account-create-update-8b5q5" Mar 16 15:49:51 crc kubenswrapper[5120]: I0316 15:49:51.103435 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8hsp\" (UniqueName: \"kubernetes.io/projected/31a295e6-d052-4010-9008-4b44ccf0b7b7-kube-api-access-j8hsp\") pod \"placement-db-create-c24qt\" (UID: \"31a295e6-d052-4010-9008-4b44ccf0b7b7\") " pod="openstack-kuttl-tests/placement-db-create-c24qt" Mar 16 15:49:51 crc kubenswrapper[5120]: I0316 15:49:51.103471 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/31a295e6-d052-4010-9008-4b44ccf0b7b7-operator-scripts\") pod \"placement-db-create-c24qt\" (UID: \"31a295e6-d052-4010-9008-4b44ccf0b7b7\") " pod="openstack-kuttl-tests/placement-db-create-c24qt" Mar 16 15:49:51 crc kubenswrapper[5120]: I0316 15:49:51.103493 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/575d87bf-ce91-4a4d-8e07-ef31e31f6d59-operator-scripts\") pod \"placement-a347-account-create-update-f9f46\" (UID: \"575d87bf-ce91-4a4d-8e07-ef31e31f6d59\") " pod="openstack-kuttl-tests/placement-a347-account-create-update-f9f46" Mar 16 15:49:51 crc kubenswrapper[5120]: I0316 15:49:51.103533 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2m5n9\" (UniqueName: \"kubernetes.io/projected/575d87bf-ce91-4a4d-8e07-ef31e31f6d59-kube-api-access-2m5n9\") pod \"placement-a347-account-create-update-f9f46\" (UID: \"575d87bf-ce91-4a4d-8e07-ef31e31f6d59\") " pod="openstack-kuttl-tests/placement-a347-account-create-update-f9f46" Mar 16 15:49:51 crc kubenswrapper[5120]: I0316 15:49:51.103583 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4lvww\" (UniqueName: \"kubernetes.io/projected/05e1d6eb-b3dc-45fd-9ae7-6636f015529b-kube-api-access-4lvww\") pod \"keystone-236f-account-create-update-8b5q5\" (UID: \"05e1d6eb-b3dc-45fd-9ae7-6636f015529b\") " pod="openstack-kuttl-tests/keystone-236f-account-create-update-8b5q5" Mar 16 15:49:51 crc kubenswrapper[5120]: I0316 15:49:51.104466 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/05e1d6eb-b3dc-45fd-9ae7-6636f015529b-operator-scripts\") pod \"keystone-236f-account-create-update-8b5q5\" (UID: \"05e1d6eb-b3dc-45fd-9ae7-6636f015529b\") " pod="openstack-kuttl-tests/keystone-236f-account-create-update-8b5q5" Mar 16 15:49:51 crc kubenswrapper[5120]: I0316 15:49:51.104565 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-create-q5hqz" Mar 16 15:49:51 crc kubenswrapper[5120]: I0316 15:49:51.120422 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4lvww\" (UniqueName: \"kubernetes.io/projected/05e1d6eb-b3dc-45fd-9ae7-6636f015529b-kube-api-access-4lvww\") pod \"keystone-236f-account-create-update-8b5q5\" (UID: \"05e1d6eb-b3dc-45fd-9ae7-6636f015529b\") " pod="openstack-kuttl-tests/keystone-236f-account-create-update-8b5q5" Mar 16 15:49:51 crc kubenswrapper[5120]: I0316 15:49:51.205064 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j8hsp\" (UniqueName: \"kubernetes.io/projected/31a295e6-d052-4010-9008-4b44ccf0b7b7-kube-api-access-j8hsp\") pod \"placement-db-create-c24qt\" (UID: \"31a295e6-d052-4010-9008-4b44ccf0b7b7\") " pod="openstack-kuttl-tests/placement-db-create-c24qt" Mar 16 15:49:51 crc kubenswrapper[5120]: I0316 15:49:51.205422 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/31a295e6-d052-4010-9008-4b44ccf0b7b7-operator-scripts\") pod \"placement-db-create-c24qt\" (UID: \"31a295e6-d052-4010-9008-4b44ccf0b7b7\") " pod="openstack-kuttl-tests/placement-db-create-c24qt" Mar 16 15:49:51 crc kubenswrapper[5120]: I0316 15:49:51.205453 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/575d87bf-ce91-4a4d-8e07-ef31e31f6d59-operator-scripts\") pod \"placement-a347-account-create-update-f9f46\" (UID: \"575d87bf-ce91-4a4d-8e07-ef31e31f6d59\") " pod="openstack-kuttl-tests/placement-a347-account-create-update-f9f46" Mar 16 15:49:51 crc kubenswrapper[5120]: I0316 15:49:51.205512 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2m5n9\" (UniqueName: \"kubernetes.io/projected/575d87bf-ce91-4a4d-8e07-ef31e31f6d59-kube-api-access-2m5n9\") pod \"placement-a347-account-create-update-f9f46\" (UID: \"575d87bf-ce91-4a4d-8e07-ef31e31f6d59\") " pod="openstack-kuttl-tests/placement-a347-account-create-update-f9f46" Mar 16 15:49:51 crc kubenswrapper[5120]: I0316 15:49:51.206604 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/31a295e6-d052-4010-9008-4b44ccf0b7b7-operator-scripts\") pod \"placement-db-create-c24qt\" (UID: \"31a295e6-d052-4010-9008-4b44ccf0b7b7\") " pod="openstack-kuttl-tests/placement-db-create-c24qt" Mar 16 15:49:51 crc kubenswrapper[5120]: I0316 15:49:51.206604 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/575d87bf-ce91-4a4d-8e07-ef31e31f6d59-operator-scripts\") pod \"placement-a347-account-create-update-f9f46\" (UID: \"575d87bf-ce91-4a4d-8e07-ef31e31f6d59\") " pod="openstack-kuttl-tests/placement-a347-account-create-update-f9f46" Mar 16 15:49:51 crc kubenswrapper[5120]: I0316 15:49:51.206718 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-236f-account-create-update-8b5q5" Mar 16 15:49:51 crc kubenswrapper[5120]: I0316 15:49:51.226297 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-5fw99"] Mar 16 15:49:51 crc kubenswrapper[5120]: I0316 15:49:51.233603 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8hsp\" (UniqueName: \"kubernetes.io/projected/31a295e6-d052-4010-9008-4b44ccf0b7b7-kube-api-access-j8hsp\") pod \"placement-db-create-c24qt\" (UID: \"31a295e6-d052-4010-9008-4b44ccf0b7b7\") " pod="openstack-kuttl-tests/placement-db-create-c24qt" Mar 16 15:49:51 crc kubenswrapper[5120]: I0316 15:49:51.235352 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2m5n9\" (UniqueName: \"kubernetes.io/projected/575d87bf-ce91-4a4d-8e07-ef31e31f6d59-kube-api-access-2m5n9\") pod \"placement-a347-account-create-update-f9f46\" (UID: \"575d87bf-ce91-4a4d-8e07-ef31e31f6d59\") " pod="openstack-kuttl-tests/placement-a347-account-create-update-f9f46" Mar 16 15:49:51 crc kubenswrapper[5120]: I0316 15:49:51.285160 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"39704fdb-36c4-41fe-8c13-35a3abb56c36","Type":"ContainerStarted","Data":"0a03aa8f3a904e42190911fb4d58ece9e870ad8d6392509fc8eb0208c1ebf2c3"} Mar 16 15:49:51 crc kubenswrapper[5120]: I0316 15:49:51.285463 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 15:49:51 crc kubenswrapper[5120]: I0316 15:49:51.290398 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"36a1c719-e302-4df3-99c5-5025d99c8c19","Type":"ContainerStarted","Data":"37ba1a2f076b719c766f791299c9142e02bcefab3e8f0c9206394edcdfa4ce9b"} Mar 16 15:49:51 crc kubenswrapper[5120]: I0316 15:49:51.290716 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 15:49:51 crc kubenswrapper[5120]: I0316 15:49:51.300290 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-create-c24qt" Mar 16 15:49:51 crc kubenswrapper[5120]: I0316 15:49:51.312943 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/rabbitmq-server-0" podStartSLOduration=39.777175189 podStartE2EDuration="46.312927182s" podCreationTimestamp="2026-03-16 15:49:05 +0000 UTC" firstStartedPulling="2026-03-16 15:49:10.016543647 +0000 UTC m=+1052.170475314" lastFinishedPulling="2026-03-16 15:49:16.55229562 +0000 UTC m=+1058.706227307" observedRunningTime="2026-03-16 15:49:51.30460575 +0000 UTC m=+1093.458537407" watchObservedRunningTime="2026-03-16 15:49:51.312927182 +0000 UTC m=+1093.466858839" Mar 16 15:49:51 crc kubenswrapper[5120]: I0316 15:49:51.325237 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-a347-account-create-update-f9f46" Mar 16 15:49:51 crc kubenswrapper[5120]: I0316 15:49:51.333613 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" podStartSLOduration=39.912469804 podStartE2EDuration="46.333593929s" podCreationTimestamp="2026-03-16 15:49:05 +0000 UTC" firstStartedPulling="2026-03-16 15:49:10.12310427 +0000 UTC m=+1052.277035927" lastFinishedPulling="2026-03-16 15:49:16.544228395 +0000 UTC m=+1058.698160052" observedRunningTime="2026-03-16 15:49:51.329437433 +0000 UTC m=+1093.483369090" watchObservedRunningTime="2026-03-16 15:49:51.333593929 +0000 UTC m=+1093.487525586" Mar 16 15:49:51 crc kubenswrapper[5120]: W0316 15:49:51.497410 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode43da138_d989_4c49_aeea_5a251a21f2d4.slice/crio-188a47e77cd4bb7ff248f6d0ea53a035f99c78e170e78b4d0650031f2889b775 WatchSource:0}: Error finding container 188a47e77cd4bb7ff248f6d0ea53a035f99c78e170e78b4d0650031f2889b775: Status 404 returned error can't find the container with id 188a47e77cd4bb7ff248f6d0ea53a035f99c78e170e78b4d0650031f2889b775 Mar 16 15:49:51 crc kubenswrapper[5120]: I0316 15:49:51.572404 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-db-create-q5hqz"] Mar 16 15:49:51 crc kubenswrapper[5120]: I0316 15:49:51.992065 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-a347-account-create-update-f9f46"] Mar 16 15:49:52 crc kubenswrapper[5120]: I0316 15:49:52.084185 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-db-create-c24qt"] Mar 16 15:49:52 crc kubenswrapper[5120]: I0316 15:49:52.090118 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-236f-account-create-update-8b5q5"] Mar 16 15:49:52 crc kubenswrapper[5120]: W0316 15:49:52.093791 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod05e1d6eb_b3dc_45fd_9ae7_6636f015529b.slice/crio-1ae50ae5c336b361d5bed7976db5a09249d78a9d6f339c7ede72f5a625778216 WatchSource:0}: Error finding container 1ae50ae5c336b361d5bed7976db5a09249d78a9d6f339c7ede72f5a625778216: Status 404 returned error can't find the container with id 1ae50ae5c336b361d5bed7976db5a09249d78a9d6f339c7ede72f5a625778216 Mar 16 15:49:52 crc kubenswrapper[5120]: I0316 15:49:52.305819 5120 generic.go:358] "Generic (PLEG): container finished" podID="2f195b64-2183-4e0f-8db8-7bab4ad019f7" containerID="36f12ace0178f89b4b80cc54afc9fc1b1261f010245624360b90ccddecc32be1" exitCode=0 Mar 16 15:49:52 crc kubenswrapper[5120]: I0316 15:49:52.306019 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-create-q5hqz" event={"ID":"2f195b64-2183-4e0f-8db8-7bab4ad019f7","Type":"ContainerDied","Data":"36f12ace0178f89b4b80cc54afc9fc1b1261f010245624360b90ccddecc32be1"} Mar 16 15:49:52 crc kubenswrapper[5120]: I0316 15:49:52.306247 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-create-q5hqz" event={"ID":"2f195b64-2183-4e0f-8db8-7bab4ad019f7","Type":"ContainerStarted","Data":"856ab3c57a778ef4aa58fb7d153aadaab6d6a16c867adb7f9c0f77f3a2a4184a"} Mar 16 15:49:52 crc kubenswrapper[5120]: I0316 15:49:52.314237 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-a347-account-create-update-f9f46" event={"ID":"575d87bf-ce91-4a4d-8e07-ef31e31f6d59","Type":"ContainerStarted","Data":"fa4fe22876a79d9265e5ced2af3e9955f7429586398083a0f32a4c12a8e27a3c"} Mar 16 15:49:52 crc kubenswrapper[5120]: I0316 15:49:52.314293 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-a347-account-create-update-f9f46" event={"ID":"575d87bf-ce91-4a4d-8e07-ef31e31f6d59","Type":"ContainerStarted","Data":"6d6ec5476181902078a85e470ed6dc614e38dc19eaaff0e5e44fba73c80e472f"} Mar 16 15:49:52 crc kubenswrapper[5120]: I0316 15:49:52.316249 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-236f-account-create-update-8b5q5" event={"ID":"05e1d6eb-b3dc-45fd-9ae7-6636f015529b","Type":"ContainerStarted","Data":"1ae50ae5c336b361d5bed7976db5a09249d78a9d6f339c7ede72f5a625778216"} Mar 16 15:49:52 crc kubenswrapper[5120]: I0316 15:49:52.337365 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"672accec-238b-4e18-9b15-5ff8429d4256","Type":"ContainerStarted","Data":"a8d2135db021dc89abaf23da0be3ef286287bc8d9e97e08f5bd37833a8d66250"} Mar 16 15:49:52 crc kubenswrapper[5120]: I0316 15:49:52.337423 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"672accec-238b-4e18-9b15-5ff8429d4256","Type":"ContainerStarted","Data":"97dd887c89b765ba273f5c85c867a679982fd142722154b57ea21c9d6404dbd7"} Mar 16 15:49:52 crc kubenswrapper[5120]: I0316 15:49:52.343417 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-a347-account-create-update-f9f46" podStartSLOduration=2.34339891 podStartE2EDuration="2.34339891s" podCreationTimestamp="2026-03-16 15:49:50 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:49:52.341180648 +0000 UTC m=+1094.495112305" watchObservedRunningTime="2026-03-16 15:49:52.34339891 +0000 UTC m=+1094.497330567" Mar 16 15:49:52 crc kubenswrapper[5120]: I0316 15:49:52.355203 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-create-c24qt" event={"ID":"31a295e6-d052-4010-9008-4b44ccf0b7b7","Type":"ContainerStarted","Data":"3d739f5ece3e4d8b445b6a718f2a49a3360548904e459a91317cddacb2613465"} Mar 16 15:49:52 crc kubenswrapper[5120]: I0316 15:49:52.364722 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-5fw99" event={"ID":"e43da138-d989-4c49-aeea-5a251a21f2d4","Type":"ContainerStarted","Data":"188a47e77cd4bb7ff248f6d0ea53a035f99c78e170e78b4d0650031f2889b775"} Mar 16 15:49:52 crc kubenswrapper[5120]: I0316 15:49:52.396095 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-db-create-c24qt" podStartSLOduration=2.396049919 podStartE2EDuration="2.396049919s" podCreationTimestamp="2026-03-16 15:49:50 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:49:52.373437718 +0000 UTC m=+1094.527369395" watchObservedRunningTime="2026-03-16 15:49:52.396049919 +0000 UTC m=+1094.549981576" Mar 16 15:49:53 crc kubenswrapper[5120]: I0316 15:49:53.400517 5120 generic.go:358] "Generic (PLEG): container finished" podID="575d87bf-ce91-4a4d-8e07-ef31e31f6d59" containerID="fa4fe22876a79d9265e5ced2af3e9955f7429586398083a0f32a4c12a8e27a3c" exitCode=0 Mar 16 15:49:53 crc kubenswrapper[5120]: I0316 15:49:53.401168 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-a347-account-create-update-f9f46" event={"ID":"575d87bf-ce91-4a4d-8e07-ef31e31f6d59","Type":"ContainerDied","Data":"fa4fe22876a79d9265e5ced2af3e9955f7429586398083a0f32a4c12a8e27a3c"} Mar 16 15:49:53 crc kubenswrapper[5120]: I0316 15:49:53.405073 5120 generic.go:358] "Generic (PLEG): container finished" podID="05e1d6eb-b3dc-45fd-9ae7-6636f015529b" containerID="f0dc8466f57f937e327fdd03b4e6dbfc53917746f482b8eb30bd9a309d510854" exitCode=0 Mar 16 15:49:53 crc kubenswrapper[5120]: I0316 15:49:53.405151 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-236f-account-create-update-8b5q5" event={"ID":"05e1d6eb-b3dc-45fd-9ae7-6636f015529b","Type":"ContainerDied","Data":"f0dc8466f57f937e327fdd03b4e6dbfc53917746f482b8eb30bd9a309d510854"} Mar 16 15:49:53 crc kubenswrapper[5120]: I0316 15:49:53.411845 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"672accec-238b-4e18-9b15-5ff8429d4256","Type":"ContainerStarted","Data":"22134ed61214cfcb4b62b61c2c8b66351c620a2ab55a0217bf762503e825f4b9"} Mar 16 15:49:53 crc kubenswrapper[5120]: I0316 15:49:53.411882 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"672accec-238b-4e18-9b15-5ff8429d4256","Type":"ContainerStarted","Data":"14ee402c6747f1b4b78b0a77b1edcb405e0f0a750a426e1880c2fc7730c5aeb0"} Mar 16 15:49:53 crc kubenswrapper[5120]: I0316 15:49:53.417295 5120 generic.go:358] "Generic (PLEG): container finished" podID="31a295e6-d052-4010-9008-4b44ccf0b7b7" containerID="e43f613a2f274b391d9bbcfbacc3662551b361db98c2e94b5ccf405de7985ddf" exitCode=0 Mar 16 15:49:53 crc kubenswrapper[5120]: I0316 15:49:53.417369 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-create-c24qt" event={"ID":"31a295e6-d052-4010-9008-4b44ccf0b7b7","Type":"ContainerDied","Data":"e43f613a2f274b391d9bbcfbacc3662551b361db98c2e94b5ccf405de7985ddf"} Mar 16 15:49:53 crc kubenswrapper[5120]: I0316 15:49:53.870611 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-create-q5hqz" Mar 16 15:49:53 crc kubenswrapper[5120]: I0316 15:49:53.951452 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4qtg5\" (UniqueName: \"kubernetes.io/projected/2f195b64-2183-4e0f-8db8-7bab4ad019f7-kube-api-access-4qtg5\") pod \"2f195b64-2183-4e0f-8db8-7bab4ad019f7\" (UID: \"2f195b64-2183-4e0f-8db8-7bab4ad019f7\") " Mar 16 15:49:53 crc kubenswrapper[5120]: I0316 15:49:53.951715 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2f195b64-2183-4e0f-8db8-7bab4ad019f7-operator-scripts\") pod \"2f195b64-2183-4e0f-8db8-7bab4ad019f7\" (UID: \"2f195b64-2183-4e0f-8db8-7bab4ad019f7\") " Mar 16 15:49:53 crc kubenswrapper[5120]: I0316 15:49:53.952384 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2f195b64-2183-4e0f-8db8-7bab4ad019f7-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "2f195b64-2183-4e0f-8db8-7bab4ad019f7" (UID: "2f195b64-2183-4e0f-8db8-7bab4ad019f7"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:49:53 crc kubenswrapper[5120]: I0316 15:49:53.958985 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f195b64-2183-4e0f-8db8-7bab4ad019f7-kube-api-access-4qtg5" (OuterVolumeSpecName: "kube-api-access-4qtg5") pod "2f195b64-2183-4e0f-8db8-7bab4ad019f7" (UID: "2f195b64-2183-4e0f-8db8-7bab4ad019f7"). InnerVolumeSpecName "kube-api-access-4qtg5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:49:54 crc kubenswrapper[5120]: I0316 15:49:54.053305 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2f195b64-2183-4e0f-8db8-7bab4ad019f7-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 15:49:54 crc kubenswrapper[5120]: I0316 15:49:54.053349 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4qtg5\" (UniqueName: \"kubernetes.io/projected/2f195b64-2183-4e0f-8db8-7bab4ad019f7-kube-api-access-4qtg5\") on node \"crc\" DevicePath \"\"" Mar 16 15:49:54 crc kubenswrapper[5120]: I0316 15:49:54.433179 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-create-q5hqz" Mar 16 15:49:54 crc kubenswrapper[5120]: I0316 15:49:54.433182 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-create-q5hqz" event={"ID":"2f195b64-2183-4e0f-8db8-7bab4ad019f7","Type":"ContainerDied","Data":"856ab3c57a778ef4aa58fb7d153aadaab6d6a16c867adb7f9c0f77f3a2a4184a"} Mar 16 15:49:54 crc kubenswrapper[5120]: I0316 15:49:54.433364 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="856ab3c57a778ef4aa58fb7d153aadaab6d6a16c867adb7f9c0f77f3a2a4184a" Mar 16 15:49:54 crc kubenswrapper[5120]: I0316 15:49:54.438274 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"672accec-238b-4e18-9b15-5ff8429d4256","Type":"ContainerStarted","Data":"fde5fb0b2c5ff4c6662d21de92b6d87f0744f43da51dab65466b8402c59efc3c"} Mar 16 15:49:54 crc kubenswrapper[5120]: I0316 15:49:54.438319 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"672accec-238b-4e18-9b15-5ff8429d4256","Type":"ContainerStarted","Data":"f6516b04c93b8952f5f103daeb13d907ded489f3bf8112a5226b3b9e7a344640"} Mar 16 15:49:54 crc kubenswrapper[5120]: I0316 15:49:54.438328 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"672accec-238b-4e18-9b15-5ff8429d4256","Type":"ContainerStarted","Data":"11022888adb543c6c9abb0c148040b363e988e74354acd6f81b3a4527faccc7e"} Mar 16 15:49:54 crc kubenswrapper[5120]: I0316 15:49:54.438338 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"672accec-238b-4e18-9b15-5ff8429d4256","Type":"ContainerStarted","Data":"01e871b86564712e3514085f671a2977bc7b524764ad870692c415d42dab6faa"} Mar 16 15:49:54 crc kubenswrapper[5120]: I0316 15:49:54.824195 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-236f-account-create-update-8b5q5" Mar 16 15:49:54 crc kubenswrapper[5120]: I0316 15:49:54.935017 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-a347-account-create-update-f9f46" Mar 16 15:49:54 crc kubenswrapper[5120]: I0316 15:49:54.941276 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-create-c24qt" Mar 16 15:49:55 crc kubenswrapper[5120]: I0316 15:49:54.968748 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/05e1d6eb-b3dc-45fd-9ae7-6636f015529b-operator-scripts\") pod \"05e1d6eb-b3dc-45fd-9ae7-6636f015529b\" (UID: \"05e1d6eb-b3dc-45fd-9ae7-6636f015529b\") " Mar 16 15:49:55 crc kubenswrapper[5120]: I0316 15:49:54.968954 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4lvww\" (UniqueName: \"kubernetes.io/projected/05e1d6eb-b3dc-45fd-9ae7-6636f015529b-kube-api-access-4lvww\") pod \"05e1d6eb-b3dc-45fd-9ae7-6636f015529b\" (UID: \"05e1d6eb-b3dc-45fd-9ae7-6636f015529b\") " Mar 16 15:49:55 crc kubenswrapper[5120]: I0316 15:49:54.969737 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/05e1d6eb-b3dc-45fd-9ae7-6636f015529b-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "05e1d6eb-b3dc-45fd-9ae7-6636f015529b" (UID: "05e1d6eb-b3dc-45fd-9ae7-6636f015529b"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:49:55 crc kubenswrapper[5120]: I0316 15:49:54.987613 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05e1d6eb-b3dc-45fd-9ae7-6636f015529b-kube-api-access-4lvww" (OuterVolumeSpecName: "kube-api-access-4lvww") pod "05e1d6eb-b3dc-45fd-9ae7-6636f015529b" (UID: "05e1d6eb-b3dc-45fd-9ae7-6636f015529b"). InnerVolumeSpecName "kube-api-access-4lvww". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:49:55 crc kubenswrapper[5120]: I0316 15:49:55.070591 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2m5n9\" (UniqueName: \"kubernetes.io/projected/575d87bf-ce91-4a4d-8e07-ef31e31f6d59-kube-api-access-2m5n9\") pod \"575d87bf-ce91-4a4d-8e07-ef31e31f6d59\" (UID: \"575d87bf-ce91-4a4d-8e07-ef31e31f6d59\") " Mar 16 15:49:55 crc kubenswrapper[5120]: I0316 15:49:55.070844 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/31a295e6-d052-4010-9008-4b44ccf0b7b7-operator-scripts\") pod \"31a295e6-d052-4010-9008-4b44ccf0b7b7\" (UID: \"31a295e6-d052-4010-9008-4b44ccf0b7b7\") " Mar 16 15:49:55 crc kubenswrapper[5120]: I0316 15:49:55.070890 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j8hsp\" (UniqueName: \"kubernetes.io/projected/31a295e6-d052-4010-9008-4b44ccf0b7b7-kube-api-access-j8hsp\") pod \"31a295e6-d052-4010-9008-4b44ccf0b7b7\" (UID: \"31a295e6-d052-4010-9008-4b44ccf0b7b7\") " Mar 16 15:49:55 crc kubenswrapper[5120]: I0316 15:49:55.070958 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/575d87bf-ce91-4a4d-8e07-ef31e31f6d59-operator-scripts\") pod \"575d87bf-ce91-4a4d-8e07-ef31e31f6d59\" (UID: \"575d87bf-ce91-4a4d-8e07-ef31e31f6d59\") " Mar 16 15:49:55 crc kubenswrapper[5120]: I0316 15:49:55.071209 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/05e1d6eb-b3dc-45fd-9ae7-6636f015529b-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 15:49:55 crc kubenswrapper[5120]: I0316 15:49:55.071221 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4lvww\" (UniqueName: \"kubernetes.io/projected/05e1d6eb-b3dc-45fd-9ae7-6636f015529b-kube-api-access-4lvww\") on node \"crc\" DevicePath \"\"" Mar 16 15:49:55 crc kubenswrapper[5120]: I0316 15:49:55.071428 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31a295e6-d052-4010-9008-4b44ccf0b7b7-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "31a295e6-d052-4010-9008-4b44ccf0b7b7" (UID: "31a295e6-d052-4010-9008-4b44ccf0b7b7"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:49:55 crc kubenswrapper[5120]: I0316 15:49:55.071530 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/575d87bf-ce91-4a4d-8e07-ef31e31f6d59-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "575d87bf-ce91-4a4d-8e07-ef31e31f6d59" (UID: "575d87bf-ce91-4a4d-8e07-ef31e31f6d59"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:49:55 crc kubenswrapper[5120]: I0316 15:49:55.074841 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31a295e6-d052-4010-9008-4b44ccf0b7b7-kube-api-access-j8hsp" (OuterVolumeSpecName: "kube-api-access-j8hsp") pod "31a295e6-d052-4010-9008-4b44ccf0b7b7" (UID: "31a295e6-d052-4010-9008-4b44ccf0b7b7"). InnerVolumeSpecName "kube-api-access-j8hsp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:49:55 crc kubenswrapper[5120]: I0316 15:49:55.075539 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/575d87bf-ce91-4a4d-8e07-ef31e31f6d59-kube-api-access-2m5n9" (OuterVolumeSpecName: "kube-api-access-2m5n9") pod "575d87bf-ce91-4a4d-8e07-ef31e31f6d59" (UID: "575d87bf-ce91-4a4d-8e07-ef31e31f6d59"). InnerVolumeSpecName "kube-api-access-2m5n9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:49:55 crc kubenswrapper[5120]: I0316 15:49:55.173140 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2m5n9\" (UniqueName: \"kubernetes.io/projected/575d87bf-ce91-4a4d-8e07-ef31e31f6d59-kube-api-access-2m5n9\") on node \"crc\" DevicePath \"\"" Mar 16 15:49:55 crc kubenswrapper[5120]: I0316 15:49:55.173219 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/31a295e6-d052-4010-9008-4b44ccf0b7b7-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 15:49:55 crc kubenswrapper[5120]: I0316 15:49:55.173230 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j8hsp\" (UniqueName: \"kubernetes.io/projected/31a295e6-d052-4010-9008-4b44ccf0b7b7-kube-api-access-j8hsp\") on node \"crc\" DevicePath \"\"" Mar 16 15:49:55 crc kubenswrapper[5120]: I0316 15:49:55.173261 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/575d87bf-ce91-4a4d-8e07-ef31e31f6d59-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 15:49:55 crc kubenswrapper[5120]: I0316 15:49:55.447005 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-a347-account-create-update-f9f46" event={"ID":"575d87bf-ce91-4a4d-8e07-ef31e31f6d59","Type":"ContainerDied","Data":"6d6ec5476181902078a85e470ed6dc614e38dc19eaaff0e5e44fba73c80e472f"} Mar 16 15:49:55 crc kubenswrapper[5120]: I0316 15:49:55.447076 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6d6ec5476181902078a85e470ed6dc614e38dc19eaaff0e5e44fba73c80e472f" Mar 16 15:49:55 crc kubenswrapper[5120]: I0316 15:49:55.447016 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-a347-account-create-update-f9f46" Mar 16 15:49:55 crc kubenswrapper[5120]: I0316 15:49:55.448628 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-236f-account-create-update-8b5q5" Mar 16 15:49:55 crc kubenswrapper[5120]: I0316 15:49:55.448661 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-236f-account-create-update-8b5q5" event={"ID":"05e1d6eb-b3dc-45fd-9ae7-6636f015529b","Type":"ContainerDied","Data":"1ae50ae5c336b361d5bed7976db5a09249d78a9d6f339c7ede72f5a625778216"} Mar 16 15:49:55 crc kubenswrapper[5120]: I0316 15:49:55.448712 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1ae50ae5c336b361d5bed7976db5a09249d78a9d6f339c7ede72f5a625778216" Mar 16 15:49:55 crc kubenswrapper[5120]: I0316 15:49:55.450601 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-create-c24qt" Mar 16 15:49:55 crc kubenswrapper[5120]: I0316 15:49:55.450698 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-create-c24qt" event={"ID":"31a295e6-d052-4010-9008-4b44ccf0b7b7","Type":"ContainerDied","Data":"3d739f5ece3e4d8b445b6a718f2a49a3360548904e459a91317cddacb2613465"} Mar 16 15:49:55 crc kubenswrapper[5120]: I0316 15:49:55.450737 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3d739f5ece3e4d8b445b6a718f2a49a3360548904e459a91317cddacb2613465" Mar 16 15:49:56 crc kubenswrapper[5120]: I0316 15:49:56.485659 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"672accec-238b-4e18-9b15-5ff8429d4256","Type":"ContainerStarted","Data":"67a31541ab497c672f2f7e36c23db3fced2a193b78fad102ca2c5246637f56e2"} Mar 16 15:49:56 crc kubenswrapper[5120]: I0316 15:49:56.485985 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"672accec-238b-4e18-9b15-5ff8429d4256","Type":"ContainerStarted","Data":"7686efc897f2d8fd462eac4cd5a266038ea5acac3f9365c2ddb297ab7f93415f"} Mar 16 15:49:56 crc kubenswrapper[5120]: I0316 15:49:56.485998 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"672accec-238b-4e18-9b15-5ff8429d4256","Type":"ContainerStarted","Data":"17d850bf7250355a2f26abed4c26bbd9dedcc1528a02f7aac5161667c10e607e"} Mar 16 15:49:56 crc kubenswrapper[5120]: I0316 15:49:56.486007 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"672accec-238b-4e18-9b15-5ff8429d4256","Type":"ContainerStarted","Data":"cde5f856ff99ea7ad37f794396a9dc9df7fc578241b167685629e114bff612a5"} Mar 16 15:49:56 crc kubenswrapper[5120]: I0316 15:49:56.486016 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"672accec-238b-4e18-9b15-5ff8429d4256","Type":"ContainerStarted","Data":"a7e88337bf9943de6762af63123d82ed7ecb5b08d43e604821d3c16b565ebd37"} Mar 16 15:49:57 crc kubenswrapper[5120]: I0316 15:49:57.497989 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"672accec-238b-4e18-9b15-5ff8429d4256","Type":"ContainerStarted","Data":"72332479aa958fc5e61ccf2b6d8d70f6451c35955b231f405b209ee03cac68de"} Mar 16 15:49:57 crc kubenswrapper[5120]: I0316 15:49:57.498058 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"672accec-238b-4e18-9b15-5ff8429d4256","Type":"ContainerStarted","Data":"f5c2fd82b6ea338f7d6c9db503db6e0feda2486b4d73e345ab3733d653dc087e"} Mar 16 15:49:57 crc kubenswrapper[5120]: I0316 15:49:57.791881 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/swift-storage-0" podStartSLOduration=20.229177093 podStartE2EDuration="25.79186381s" podCreationTimestamp="2026-03-16 15:49:32 +0000 UTC" firstStartedPulling="2026-03-16 15:49:49.931924215 +0000 UTC m=+1092.085855882" lastFinishedPulling="2026-03-16 15:49:55.494610942 +0000 UTC m=+1097.648542599" observedRunningTime="2026-03-16 15:49:57.546505555 +0000 UTC m=+1099.700437212" watchObservedRunningTime="2026-03-16 15:49:57.79186381 +0000 UTC m=+1099.945795467" Mar 16 15:49:57 crc kubenswrapper[5120]: I0316 15:49:57.795118 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-7f4777f8f-pg9tl"] Mar 16 15:49:57 crc kubenswrapper[5120]: I0316 15:49:57.796337 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31a295e6-d052-4010-9008-4b44ccf0b7b7" containerName="mariadb-database-create" Mar 16 15:49:57 crc kubenswrapper[5120]: I0316 15:49:57.796362 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="31a295e6-d052-4010-9008-4b44ccf0b7b7" containerName="mariadb-database-create" Mar 16 15:49:57 crc kubenswrapper[5120]: I0316 15:49:57.796399 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="575d87bf-ce91-4a4d-8e07-ef31e31f6d59" containerName="mariadb-account-create-update" Mar 16 15:49:57 crc kubenswrapper[5120]: I0316 15:49:57.796408 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="575d87bf-ce91-4a4d-8e07-ef31e31f6d59" containerName="mariadb-account-create-update" Mar 16 15:49:57 crc kubenswrapper[5120]: I0316 15:49:57.796435 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f195b64-2183-4e0f-8db8-7bab4ad019f7" containerName="mariadb-database-create" Mar 16 15:49:57 crc kubenswrapper[5120]: I0316 15:49:57.796443 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f195b64-2183-4e0f-8db8-7bab4ad019f7" containerName="mariadb-database-create" Mar 16 15:49:57 crc kubenswrapper[5120]: I0316 15:49:57.796464 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05e1d6eb-b3dc-45fd-9ae7-6636f015529b" containerName="mariadb-account-create-update" Mar 16 15:49:57 crc kubenswrapper[5120]: I0316 15:49:57.796472 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="05e1d6eb-b3dc-45fd-9ae7-6636f015529b" containerName="mariadb-account-create-update" Mar 16 15:49:57 crc kubenswrapper[5120]: I0316 15:49:57.796662 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="2f195b64-2183-4e0f-8db8-7bab4ad019f7" containerName="mariadb-database-create" Mar 16 15:49:57 crc kubenswrapper[5120]: I0316 15:49:57.796681 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="05e1d6eb-b3dc-45fd-9ae7-6636f015529b" containerName="mariadb-account-create-update" Mar 16 15:49:57 crc kubenswrapper[5120]: I0316 15:49:57.796703 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="575d87bf-ce91-4a4d-8e07-ef31e31f6d59" containerName="mariadb-account-create-update" Mar 16 15:49:57 crc kubenswrapper[5120]: I0316 15:49:57.796718 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="31a295e6-d052-4010-9008-4b44ccf0b7b7" containerName="mariadb-database-create" Mar 16 15:49:57 crc kubenswrapper[5120]: I0316 15:49:57.810050 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7f4777f8f-pg9tl" Mar 16 15:49:57 crc kubenswrapper[5120]: I0316 15:49:57.813908 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"dns-swift-storage-0\"" Mar 16 15:49:57 crc kubenswrapper[5120]: I0316 15:49:57.814995 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-7f4777f8f-pg9tl"] Mar 16 15:49:57 crc kubenswrapper[5120]: I0316 15:49:57.916994 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/afb802db-bd6c-476b-bd76-920d192fc44b-dns-swift-storage-0\") pod \"dnsmasq-dnsmasq-7f4777f8f-pg9tl\" (UID: \"afb802db-bd6c-476b-bd76-920d192fc44b\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7f4777f8f-pg9tl" Mar 16 15:49:57 crc kubenswrapper[5120]: I0316 15:49:57.917101 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xs8r\" (UniqueName: \"kubernetes.io/projected/afb802db-bd6c-476b-bd76-920d192fc44b-kube-api-access-7xs8r\") pod \"dnsmasq-dnsmasq-7f4777f8f-pg9tl\" (UID: \"afb802db-bd6c-476b-bd76-920d192fc44b\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7f4777f8f-pg9tl" Mar 16 15:49:57 crc kubenswrapper[5120]: I0316 15:49:57.917287 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/afb802db-bd6c-476b-bd76-920d192fc44b-config\") pod \"dnsmasq-dnsmasq-7f4777f8f-pg9tl\" (UID: \"afb802db-bd6c-476b-bd76-920d192fc44b\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7f4777f8f-pg9tl" Mar 16 15:49:57 crc kubenswrapper[5120]: I0316 15:49:57.917568 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/afb802db-bd6c-476b-bd76-920d192fc44b-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-7f4777f8f-pg9tl\" (UID: \"afb802db-bd6c-476b-bd76-920d192fc44b\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7f4777f8f-pg9tl" Mar 16 15:49:58 crc kubenswrapper[5120]: I0316 15:49:58.019266 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/afb802db-bd6c-476b-bd76-920d192fc44b-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-7f4777f8f-pg9tl\" (UID: \"afb802db-bd6c-476b-bd76-920d192fc44b\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7f4777f8f-pg9tl" Mar 16 15:49:58 crc kubenswrapper[5120]: I0316 15:49:58.019399 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/afb802db-bd6c-476b-bd76-920d192fc44b-dns-swift-storage-0\") pod \"dnsmasq-dnsmasq-7f4777f8f-pg9tl\" (UID: \"afb802db-bd6c-476b-bd76-920d192fc44b\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7f4777f8f-pg9tl" Mar 16 15:49:58 crc kubenswrapper[5120]: I0316 15:49:58.020277 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/afb802db-bd6c-476b-bd76-920d192fc44b-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-7f4777f8f-pg9tl\" (UID: \"afb802db-bd6c-476b-bd76-920d192fc44b\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7f4777f8f-pg9tl" Mar 16 15:49:58 crc kubenswrapper[5120]: I0316 15:49:58.020329 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/afb802db-bd6c-476b-bd76-920d192fc44b-dns-swift-storage-0\") pod \"dnsmasq-dnsmasq-7f4777f8f-pg9tl\" (UID: \"afb802db-bd6c-476b-bd76-920d192fc44b\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7f4777f8f-pg9tl" Mar 16 15:49:58 crc kubenswrapper[5120]: I0316 15:49:58.020413 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7xs8r\" (UniqueName: \"kubernetes.io/projected/afb802db-bd6c-476b-bd76-920d192fc44b-kube-api-access-7xs8r\") pod \"dnsmasq-dnsmasq-7f4777f8f-pg9tl\" (UID: \"afb802db-bd6c-476b-bd76-920d192fc44b\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7f4777f8f-pg9tl" Mar 16 15:49:58 crc kubenswrapper[5120]: I0316 15:49:58.020478 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/afb802db-bd6c-476b-bd76-920d192fc44b-config\") pod \"dnsmasq-dnsmasq-7f4777f8f-pg9tl\" (UID: \"afb802db-bd6c-476b-bd76-920d192fc44b\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7f4777f8f-pg9tl" Mar 16 15:49:58 crc kubenswrapper[5120]: I0316 15:49:58.021139 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/afb802db-bd6c-476b-bd76-920d192fc44b-config\") pod \"dnsmasq-dnsmasq-7f4777f8f-pg9tl\" (UID: \"afb802db-bd6c-476b-bd76-920d192fc44b\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7f4777f8f-pg9tl" Mar 16 15:49:58 crc kubenswrapper[5120]: I0316 15:49:58.056665 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xs8r\" (UniqueName: \"kubernetes.io/projected/afb802db-bd6c-476b-bd76-920d192fc44b-kube-api-access-7xs8r\") pod \"dnsmasq-dnsmasq-7f4777f8f-pg9tl\" (UID: \"afb802db-bd6c-476b-bd76-920d192fc44b\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7f4777f8f-pg9tl" Mar 16 15:49:58 crc kubenswrapper[5120]: I0316 15:49:58.141698 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7f4777f8f-pg9tl" Mar 16 15:50:00 crc kubenswrapper[5120]: I0316 15:50:00.136886 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-infra/auto-csr-approver-29561270-5sfpd"] Mar 16 15:50:00 crc kubenswrapper[5120]: I0316 15:50:00.219073 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561270-5sfpd"] Mar 16 15:50:00 crc kubenswrapper[5120]: I0316 15:50:00.219225 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561270-5sfpd" Mar 16 15:50:00 crc kubenswrapper[5120]: I0316 15:50:00.221480 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"openshift-service-ca.crt\"" Mar 16 15:50:00 crc kubenswrapper[5120]: I0316 15:50:00.221539 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"kube-root-ca.crt\"" Mar 16 15:50:00 crc kubenswrapper[5120]: I0316 15:50:00.222714 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-infra\"/\"csr-approver-sa-dockercfg-x2nsz\"" Mar 16 15:50:00 crc kubenswrapper[5120]: I0316 15:50:00.368262 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4l26s\" (UniqueName: \"kubernetes.io/projected/110f0814-5d86-4605-aa7c-3d0687c4af18-kube-api-access-4l26s\") pod \"auto-csr-approver-29561270-5sfpd\" (UID: \"110f0814-5d86-4605-aa7c-3d0687c4af18\") " pod="openshift-infra/auto-csr-approver-29561270-5sfpd" Mar 16 15:50:00 crc kubenswrapper[5120]: I0316 15:50:00.470301 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4l26s\" (UniqueName: \"kubernetes.io/projected/110f0814-5d86-4605-aa7c-3d0687c4af18-kube-api-access-4l26s\") pod \"auto-csr-approver-29561270-5sfpd\" (UID: \"110f0814-5d86-4605-aa7c-3d0687c4af18\") " pod="openshift-infra/auto-csr-approver-29561270-5sfpd" Mar 16 15:50:00 crc kubenswrapper[5120]: I0316 15:50:00.493739 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4l26s\" (UniqueName: \"kubernetes.io/projected/110f0814-5d86-4605-aa7c-3d0687c4af18-kube-api-access-4l26s\") pod \"auto-csr-approver-29561270-5sfpd\" (UID: \"110f0814-5d86-4605-aa7c-3d0687c4af18\") " pod="openshift-infra/auto-csr-approver-29561270-5sfpd" Mar 16 15:50:00 crc kubenswrapper[5120]: I0316 15:50:00.549612 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561270-5sfpd" Mar 16 15:50:02 crc kubenswrapper[5120]: I0316 15:50:02.370964 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 15:50:02 crc kubenswrapper[5120]: I0316 15:50:02.371346 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 15:50:04 crc kubenswrapper[5120]: I0316 15:50:04.028422 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-db-create-p6nst"] Mar 16 15:50:04 crc kubenswrapper[5120]: I0316 15:50:04.044177 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-create-p6nst" Mar 16 15:50:04 crc kubenswrapper[5120]: I0316 15:50:04.097896 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-db-create-p6nst"] Mar 16 15:50:04 crc kubenswrapper[5120]: I0316 15:50:04.192476 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-7f4777f8f-pg9tl"] Mar 16 15:50:04 crc kubenswrapper[5120]: I0316 15:50:04.224553 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561270-5sfpd"] Mar 16 15:50:04 crc kubenswrapper[5120]: I0316 15:50:04.253598 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/cbc99c4f-184e-4c10-9e60-9a981761ecf2-operator-scripts\") pod \"cinder-db-create-p6nst\" (UID: \"cbc99c4f-184e-4c10-9e60-9a981761ecf2\") " pod="openstack-kuttl-tests/cinder-db-create-p6nst" Mar 16 15:50:04 crc kubenswrapper[5120]: I0316 15:50:04.253720 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7fkkj\" (UniqueName: \"kubernetes.io/projected/cbc99c4f-184e-4c10-9e60-9a981761ecf2-kube-api-access-7fkkj\") pod \"cinder-db-create-p6nst\" (UID: \"cbc99c4f-184e-4c10-9e60-9a981761ecf2\") " pod="openstack-kuttl-tests/cinder-db-create-p6nst" Mar 16 15:50:04 crc kubenswrapper[5120]: I0316 15:50:04.261565 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-dd94-account-create-update-p7t46"] Mar 16 15:50:04 crc kubenswrapper[5120]: I0316 15:50:04.286898 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-dd94-account-create-update-p7t46" Mar 16 15:50:04 crc kubenswrapper[5120]: I0316 15:50:04.295816 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-dd94-account-create-update-p7t46"] Mar 16 15:50:04 crc kubenswrapper[5120]: I0316 15:50:04.296865 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-db-secret\"" Mar 16 15:50:04 crc kubenswrapper[5120]: I0316 15:50:04.305638 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-db-create-7xtvp"] Mar 16 15:50:04 crc kubenswrapper[5120]: I0316 15:50:04.327052 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-create-7xtvp" Mar 16 15:50:04 crc kubenswrapper[5120]: I0316 15:50:04.326920 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-db-create-7xtvp"] Mar 16 15:50:04 crc kubenswrapper[5120]: I0316 15:50:04.358489 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45b9t\" (UniqueName: \"kubernetes.io/projected/c7b4af2e-c6d2-4479-a926-27a52b3a973e-kube-api-access-45b9t\") pod \"neutron-db-create-7xtvp\" (UID: \"c7b4af2e-c6d2-4479-a926-27a52b3a973e\") " pod="openstack-kuttl-tests/neutron-db-create-7xtvp" Mar 16 15:50:04 crc kubenswrapper[5120]: I0316 15:50:04.358528 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/57766802-1c47-4741-850a-82f768369d23-operator-scripts\") pod \"cinder-dd94-account-create-update-p7t46\" (UID: \"57766802-1c47-4741-850a-82f768369d23\") " pod="openstack-kuttl-tests/cinder-dd94-account-create-update-p7t46" Mar 16 15:50:04 crc kubenswrapper[5120]: I0316 15:50:04.358554 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7fkkj\" (UniqueName: \"kubernetes.io/projected/cbc99c4f-184e-4c10-9e60-9a981761ecf2-kube-api-access-7fkkj\") pod \"cinder-db-create-p6nst\" (UID: \"cbc99c4f-184e-4c10-9e60-9a981761ecf2\") " pod="openstack-kuttl-tests/cinder-db-create-p6nst" Mar 16 15:50:04 crc kubenswrapper[5120]: I0316 15:50:04.358611 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c7b4af2e-c6d2-4479-a926-27a52b3a973e-operator-scripts\") pod \"neutron-db-create-7xtvp\" (UID: \"c7b4af2e-c6d2-4479-a926-27a52b3a973e\") " pod="openstack-kuttl-tests/neutron-db-create-7xtvp" Mar 16 15:50:04 crc kubenswrapper[5120]: I0316 15:50:04.358661 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmt7q\" (UniqueName: \"kubernetes.io/projected/57766802-1c47-4741-850a-82f768369d23-kube-api-access-mmt7q\") pod \"cinder-dd94-account-create-update-p7t46\" (UID: \"57766802-1c47-4741-850a-82f768369d23\") " pod="openstack-kuttl-tests/cinder-dd94-account-create-update-p7t46" Mar 16 15:50:04 crc kubenswrapper[5120]: I0316 15:50:04.358688 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/cbc99c4f-184e-4c10-9e60-9a981761ecf2-operator-scripts\") pod \"cinder-db-create-p6nst\" (UID: \"cbc99c4f-184e-4c10-9e60-9a981761ecf2\") " pod="openstack-kuttl-tests/cinder-db-create-p6nst" Mar 16 15:50:04 crc kubenswrapper[5120]: I0316 15:50:04.359315 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/cbc99c4f-184e-4c10-9e60-9a981761ecf2-operator-scripts\") pod \"cinder-db-create-p6nst\" (UID: \"cbc99c4f-184e-4c10-9e60-9a981761ecf2\") " pod="openstack-kuttl-tests/cinder-db-create-p6nst" Mar 16 15:50:04 crc kubenswrapper[5120]: I0316 15:50:04.394007 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-db-create-w4dbt"] Mar 16 15:50:04 crc kubenswrapper[5120]: I0316 15:50:04.398856 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7fkkj\" (UniqueName: \"kubernetes.io/projected/cbc99c4f-184e-4c10-9e60-9a981761ecf2-kube-api-access-7fkkj\") pod \"cinder-db-create-p6nst\" (UID: \"cbc99c4f-184e-4c10-9e60-9a981761ecf2\") " pod="openstack-kuttl-tests/cinder-db-create-p6nst" Mar 16 15:50:04 crc kubenswrapper[5120]: I0316 15:50:04.400808 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-create-w4dbt" Mar 16 15:50:04 crc kubenswrapper[5120]: I0316 15:50:04.409596 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-db-create-w4dbt"] Mar 16 15:50:04 crc kubenswrapper[5120]: I0316 15:50:04.461352 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c7b4af2e-c6d2-4479-a926-27a52b3a973e-operator-scripts\") pod \"neutron-db-create-7xtvp\" (UID: \"c7b4af2e-c6d2-4479-a926-27a52b3a973e\") " pod="openstack-kuttl-tests/neutron-db-create-7xtvp" Mar 16 15:50:04 crc kubenswrapper[5120]: I0316 15:50:04.461429 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lw45b\" (UniqueName: \"kubernetes.io/projected/1c96ec30-a61d-4920-b08d-06fd9c5c538c-kube-api-access-lw45b\") pod \"barbican-db-create-w4dbt\" (UID: \"1c96ec30-a61d-4920-b08d-06fd9c5c538c\") " pod="openstack-kuttl-tests/barbican-db-create-w4dbt" Mar 16 15:50:04 crc kubenswrapper[5120]: I0316 15:50:04.461477 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mmt7q\" (UniqueName: \"kubernetes.io/projected/57766802-1c47-4741-850a-82f768369d23-kube-api-access-mmt7q\") pod \"cinder-dd94-account-create-update-p7t46\" (UID: \"57766802-1c47-4741-850a-82f768369d23\") " pod="openstack-kuttl-tests/cinder-dd94-account-create-update-p7t46" Mar 16 15:50:04 crc kubenswrapper[5120]: I0316 15:50:04.461557 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/1c96ec30-a61d-4920-b08d-06fd9c5c538c-operator-scripts\") pod \"barbican-db-create-w4dbt\" (UID: \"1c96ec30-a61d-4920-b08d-06fd9c5c538c\") " pod="openstack-kuttl-tests/barbican-db-create-w4dbt" Mar 16 15:50:04 crc kubenswrapper[5120]: I0316 15:50:04.461593 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-45b9t\" (UniqueName: \"kubernetes.io/projected/c7b4af2e-c6d2-4479-a926-27a52b3a973e-kube-api-access-45b9t\") pod \"neutron-db-create-7xtvp\" (UID: \"c7b4af2e-c6d2-4479-a926-27a52b3a973e\") " pod="openstack-kuttl-tests/neutron-db-create-7xtvp" Mar 16 15:50:04 crc kubenswrapper[5120]: I0316 15:50:04.461614 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/57766802-1c47-4741-850a-82f768369d23-operator-scripts\") pod \"cinder-dd94-account-create-update-p7t46\" (UID: \"57766802-1c47-4741-850a-82f768369d23\") " pod="openstack-kuttl-tests/cinder-dd94-account-create-update-p7t46" Mar 16 15:50:04 crc kubenswrapper[5120]: I0316 15:50:04.462385 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-x2qcd"] Mar 16 15:50:04 crc kubenswrapper[5120]: I0316 15:50:04.462447 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/57766802-1c47-4741-850a-82f768369d23-operator-scripts\") pod \"cinder-dd94-account-create-update-p7t46\" (UID: \"57766802-1c47-4741-850a-82f768369d23\") " pod="openstack-kuttl-tests/cinder-dd94-account-create-update-p7t46" Mar 16 15:50:04 crc kubenswrapper[5120]: I0316 15:50:04.463007 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c7b4af2e-c6d2-4479-a926-27a52b3a973e-operator-scripts\") pod \"neutron-db-create-7xtvp\" (UID: \"c7b4af2e-c6d2-4479-a926-27a52b3a973e\") " pod="openstack-kuttl-tests/neutron-db-create-7xtvp" Mar 16 15:50:04 crc kubenswrapper[5120]: I0316 15:50:04.482991 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-x2qcd"] Mar 16 15:50:04 crc kubenswrapper[5120]: I0316 15:50:04.483099 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-x2qcd" Mar 16 15:50:04 crc kubenswrapper[5120]: I0316 15:50:04.487936 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmt7q\" (UniqueName: \"kubernetes.io/projected/57766802-1c47-4741-850a-82f768369d23-kube-api-access-mmt7q\") pod \"cinder-dd94-account-create-update-p7t46\" (UID: \"57766802-1c47-4741-850a-82f768369d23\") " pod="openstack-kuttl-tests/cinder-dd94-account-create-update-p7t46" Mar 16 15:50:04 crc kubenswrapper[5120]: I0316 15:50:04.488347 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-scripts\"" Mar 16 15:50:04 crc kubenswrapper[5120]: I0316 15:50:04.488595 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone\"" Mar 16 15:50:04 crc kubenswrapper[5120]: I0316 15:50:04.488738 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-45b9t\" (UniqueName: \"kubernetes.io/projected/c7b4af2e-c6d2-4479-a926-27a52b3a973e-kube-api-access-45b9t\") pod \"neutron-db-create-7xtvp\" (UID: \"c7b4af2e-c6d2-4479-a926-27a52b3a973e\") " pod="openstack-kuttl-tests/neutron-db-create-7xtvp" Mar 16 15:50:04 crc kubenswrapper[5120]: I0316 15:50:04.489579 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-config-data\"" Mar 16 15:50:04 crc kubenswrapper[5120]: I0316 15:50:04.509883 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-9a70-account-create-update-s95ff"] Mar 16 15:50:04 crc kubenswrapper[5120]: I0316 15:50:04.523355 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-keystone-dockercfg-qznbk\"" Mar 16 15:50:04 crc kubenswrapper[5120]: I0316 15:50:04.529388 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-9a70-account-create-update-s95ff"] Mar 16 15:50:04 crc kubenswrapper[5120]: I0316 15:50:04.529534 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-9a70-account-create-update-s95ff" Mar 16 15:50:04 crc kubenswrapper[5120]: I0316 15:50:04.531930 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-db-secret\"" Mar 16 15:50:04 crc kubenswrapper[5120]: I0316 15:50:04.562727 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khklm\" (UniqueName: \"kubernetes.io/projected/3ab9ab45-8904-421a-a38b-8fbd13cf84a6-kube-api-access-khklm\") pod \"barbican-9a70-account-create-update-s95ff\" (UID: \"3ab9ab45-8904-421a-a38b-8fbd13cf84a6\") " pod="openstack-kuttl-tests/barbican-9a70-account-create-update-s95ff" Mar 16 15:50:04 crc kubenswrapper[5120]: I0316 15:50:04.562886 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/1c96ec30-a61d-4920-b08d-06fd9c5c538c-operator-scripts\") pod \"barbican-db-create-w4dbt\" (UID: \"1c96ec30-a61d-4920-b08d-06fd9c5c538c\") " pod="openstack-kuttl-tests/barbican-db-create-w4dbt" Mar 16 15:50:04 crc kubenswrapper[5120]: I0316 15:50:04.562922 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/62a03637-2221-40d9-a921-f87cc0f5a487-config-data\") pod \"keystone-db-sync-x2qcd\" (UID: \"62a03637-2221-40d9-a921-f87cc0f5a487\") " pod="openstack-kuttl-tests/keystone-db-sync-x2qcd" Mar 16 15:50:04 crc kubenswrapper[5120]: I0316 15:50:04.562942 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t76ll\" (UniqueName: \"kubernetes.io/projected/62a03637-2221-40d9-a921-f87cc0f5a487-kube-api-access-t76ll\") pod \"keystone-db-sync-x2qcd\" (UID: \"62a03637-2221-40d9-a921-f87cc0f5a487\") " pod="openstack-kuttl-tests/keystone-db-sync-x2qcd" Mar 16 15:50:04 crc kubenswrapper[5120]: I0316 15:50:04.563005 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3ab9ab45-8904-421a-a38b-8fbd13cf84a6-operator-scripts\") pod \"barbican-9a70-account-create-update-s95ff\" (UID: \"3ab9ab45-8904-421a-a38b-8fbd13cf84a6\") " pod="openstack-kuttl-tests/barbican-9a70-account-create-update-s95ff" Mar 16 15:50:04 crc kubenswrapper[5120]: I0316 15:50:04.563064 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/62a03637-2221-40d9-a921-f87cc0f5a487-combined-ca-bundle\") pod \"keystone-db-sync-x2qcd\" (UID: \"62a03637-2221-40d9-a921-f87cc0f5a487\") " pod="openstack-kuttl-tests/keystone-db-sync-x2qcd" Mar 16 15:50:04 crc kubenswrapper[5120]: I0316 15:50:04.563111 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lw45b\" (UniqueName: \"kubernetes.io/projected/1c96ec30-a61d-4920-b08d-06fd9c5c538c-kube-api-access-lw45b\") pod \"barbican-db-create-w4dbt\" (UID: \"1c96ec30-a61d-4920-b08d-06fd9c5c538c\") " pod="openstack-kuttl-tests/barbican-db-create-w4dbt" Mar 16 15:50:04 crc kubenswrapper[5120]: I0316 15:50:04.565415 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/1c96ec30-a61d-4920-b08d-06fd9c5c538c-operator-scripts\") pod \"barbican-db-create-w4dbt\" (UID: \"1c96ec30-a61d-4920-b08d-06fd9c5c538c\") " pod="openstack-kuttl-tests/barbican-db-create-w4dbt" Mar 16 15:50:04 crc kubenswrapper[5120]: I0316 15:50:04.566125 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7f4777f8f-pg9tl" event={"ID":"afb802db-bd6c-476b-bd76-920d192fc44b","Type":"ContainerStarted","Data":"c556e6934d85df90712d6571249db5e46f77a3b74dcb100f59cd696fc2a02ed7"} Mar 16 15:50:04 crc kubenswrapper[5120]: I0316 15:50:04.572682 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561270-5sfpd" event={"ID":"110f0814-5d86-4605-aa7c-3d0687c4af18","Type":"ContainerStarted","Data":"f2603f679d5e3a0beab93cb43c5175f4c18360beaba8ce5a851dfb95f90cbee0"} Mar 16 15:50:04 crc kubenswrapper[5120]: I0316 15:50:04.587807 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-a8cd-account-create-update-vd2sd"] Mar 16 15:50:04 crc kubenswrapper[5120]: I0316 15:50:04.599157 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-a8cd-account-create-update-vd2sd" Mar 16 15:50:04 crc kubenswrapper[5120]: I0316 15:50:04.600814 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-db-secret\"" Mar 16 15:50:04 crc kubenswrapper[5120]: I0316 15:50:04.605138 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-a8cd-account-create-update-vd2sd"] Mar 16 15:50:04 crc kubenswrapper[5120]: I0316 15:50:04.609364 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-dd94-account-create-update-p7t46" Mar 16 15:50:04 crc kubenswrapper[5120]: I0316 15:50:04.615211 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lw45b\" (UniqueName: \"kubernetes.io/projected/1c96ec30-a61d-4920-b08d-06fd9c5c538c-kube-api-access-lw45b\") pod \"barbican-db-create-w4dbt\" (UID: \"1c96ec30-a61d-4920-b08d-06fd9c5c538c\") " pod="openstack-kuttl-tests/barbican-db-create-w4dbt" Mar 16 15:50:04 crc kubenswrapper[5120]: I0316 15:50:04.664570 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-create-7xtvp" Mar 16 15:50:04 crc kubenswrapper[5120]: I0316 15:50:04.665263 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-khklm\" (UniqueName: \"kubernetes.io/projected/3ab9ab45-8904-421a-a38b-8fbd13cf84a6-kube-api-access-khklm\") pod \"barbican-9a70-account-create-update-s95ff\" (UID: \"3ab9ab45-8904-421a-a38b-8fbd13cf84a6\") " pod="openstack-kuttl-tests/barbican-9a70-account-create-update-s95ff" Mar 16 15:50:04 crc kubenswrapper[5120]: I0316 15:50:04.665320 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/62a03637-2221-40d9-a921-f87cc0f5a487-config-data\") pod \"keystone-db-sync-x2qcd\" (UID: \"62a03637-2221-40d9-a921-f87cc0f5a487\") " pod="openstack-kuttl-tests/keystone-db-sync-x2qcd" Mar 16 15:50:04 crc kubenswrapper[5120]: I0316 15:50:04.665343 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgwbd\" (UniqueName: \"kubernetes.io/projected/afd7061f-762c-4876-986c-64076eda9b0f-kube-api-access-xgwbd\") pod \"neutron-a8cd-account-create-update-vd2sd\" (UID: \"afd7061f-762c-4876-986c-64076eda9b0f\") " pod="openstack-kuttl-tests/neutron-a8cd-account-create-update-vd2sd" Mar 16 15:50:04 crc kubenswrapper[5120]: I0316 15:50:04.665365 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t76ll\" (UniqueName: \"kubernetes.io/projected/62a03637-2221-40d9-a921-f87cc0f5a487-kube-api-access-t76ll\") pod \"keystone-db-sync-x2qcd\" (UID: \"62a03637-2221-40d9-a921-f87cc0f5a487\") " pod="openstack-kuttl-tests/keystone-db-sync-x2qcd" Mar 16 15:50:04 crc kubenswrapper[5120]: I0316 15:50:04.665395 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/afd7061f-762c-4876-986c-64076eda9b0f-operator-scripts\") pod \"neutron-a8cd-account-create-update-vd2sd\" (UID: \"afd7061f-762c-4876-986c-64076eda9b0f\") " pod="openstack-kuttl-tests/neutron-a8cd-account-create-update-vd2sd" Mar 16 15:50:04 crc kubenswrapper[5120]: I0316 15:50:04.665433 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3ab9ab45-8904-421a-a38b-8fbd13cf84a6-operator-scripts\") pod \"barbican-9a70-account-create-update-s95ff\" (UID: \"3ab9ab45-8904-421a-a38b-8fbd13cf84a6\") " pod="openstack-kuttl-tests/barbican-9a70-account-create-update-s95ff" Mar 16 15:50:04 crc kubenswrapper[5120]: I0316 15:50:04.665485 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/62a03637-2221-40d9-a921-f87cc0f5a487-combined-ca-bundle\") pod \"keystone-db-sync-x2qcd\" (UID: \"62a03637-2221-40d9-a921-f87cc0f5a487\") " pod="openstack-kuttl-tests/keystone-db-sync-x2qcd" Mar 16 15:50:04 crc kubenswrapper[5120]: I0316 15:50:04.668178 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3ab9ab45-8904-421a-a38b-8fbd13cf84a6-operator-scripts\") pod \"barbican-9a70-account-create-update-s95ff\" (UID: \"3ab9ab45-8904-421a-a38b-8fbd13cf84a6\") " pod="openstack-kuttl-tests/barbican-9a70-account-create-update-s95ff" Mar 16 15:50:04 crc kubenswrapper[5120]: I0316 15:50:04.670587 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/62a03637-2221-40d9-a921-f87cc0f5a487-config-data\") pod \"keystone-db-sync-x2qcd\" (UID: \"62a03637-2221-40d9-a921-f87cc0f5a487\") " pod="openstack-kuttl-tests/keystone-db-sync-x2qcd" Mar 16 15:50:04 crc kubenswrapper[5120]: I0316 15:50:04.670963 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/62a03637-2221-40d9-a921-f87cc0f5a487-combined-ca-bundle\") pod \"keystone-db-sync-x2qcd\" (UID: \"62a03637-2221-40d9-a921-f87cc0f5a487\") " pod="openstack-kuttl-tests/keystone-db-sync-x2qcd" Mar 16 15:50:04 crc kubenswrapper[5120]: I0316 15:50:04.683475 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t76ll\" (UniqueName: \"kubernetes.io/projected/62a03637-2221-40d9-a921-f87cc0f5a487-kube-api-access-t76ll\") pod \"keystone-db-sync-x2qcd\" (UID: \"62a03637-2221-40d9-a921-f87cc0f5a487\") " pod="openstack-kuttl-tests/keystone-db-sync-x2qcd" Mar 16 15:50:04 crc kubenswrapper[5120]: I0316 15:50:04.683948 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-khklm\" (UniqueName: \"kubernetes.io/projected/3ab9ab45-8904-421a-a38b-8fbd13cf84a6-kube-api-access-khklm\") pod \"barbican-9a70-account-create-update-s95ff\" (UID: \"3ab9ab45-8904-421a-a38b-8fbd13cf84a6\") " pod="openstack-kuttl-tests/barbican-9a70-account-create-update-s95ff" Mar 16 15:50:04 crc kubenswrapper[5120]: I0316 15:50:04.695032 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-create-p6nst" Mar 16 15:50:04 crc kubenswrapper[5120]: I0316 15:50:04.767202 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xgwbd\" (UniqueName: \"kubernetes.io/projected/afd7061f-762c-4876-986c-64076eda9b0f-kube-api-access-xgwbd\") pod \"neutron-a8cd-account-create-update-vd2sd\" (UID: \"afd7061f-762c-4876-986c-64076eda9b0f\") " pod="openstack-kuttl-tests/neutron-a8cd-account-create-update-vd2sd" Mar 16 15:50:04 crc kubenswrapper[5120]: I0316 15:50:04.767286 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/afd7061f-762c-4876-986c-64076eda9b0f-operator-scripts\") pod \"neutron-a8cd-account-create-update-vd2sd\" (UID: \"afd7061f-762c-4876-986c-64076eda9b0f\") " pod="openstack-kuttl-tests/neutron-a8cd-account-create-update-vd2sd" Mar 16 15:50:04 crc kubenswrapper[5120]: I0316 15:50:04.772519 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/afd7061f-762c-4876-986c-64076eda9b0f-operator-scripts\") pod \"neutron-a8cd-account-create-update-vd2sd\" (UID: \"afd7061f-762c-4876-986c-64076eda9b0f\") " pod="openstack-kuttl-tests/neutron-a8cd-account-create-update-vd2sd" Mar 16 15:50:04 crc kubenswrapper[5120]: I0316 15:50:04.800683 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-create-w4dbt" Mar 16 15:50:04 crc kubenswrapper[5120]: I0316 15:50:04.801000 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgwbd\" (UniqueName: \"kubernetes.io/projected/afd7061f-762c-4876-986c-64076eda9b0f-kube-api-access-xgwbd\") pod \"neutron-a8cd-account-create-update-vd2sd\" (UID: \"afd7061f-762c-4876-986c-64076eda9b0f\") " pod="openstack-kuttl-tests/neutron-a8cd-account-create-update-vd2sd" Mar 16 15:50:04 crc kubenswrapper[5120]: I0316 15:50:04.805303 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-x2qcd" Mar 16 15:50:04 crc kubenswrapper[5120]: I0316 15:50:04.814273 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-9a70-account-create-update-s95ff" Mar 16 15:50:04 crc kubenswrapper[5120]: I0316 15:50:04.821955 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-a8cd-account-create-update-vd2sd" Mar 16 15:50:05 crc kubenswrapper[5120]: I0316 15:50:05.153153 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-dd94-account-create-update-p7t46"] Mar 16 15:50:05 crc kubenswrapper[5120]: I0316 15:50:05.199387 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-db-create-7xtvp"] Mar 16 15:50:05 crc kubenswrapper[5120]: W0316 15:50:05.203735 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc7b4af2e_c6d2_4479_a926_27a52b3a973e.slice/crio-8060cb9b7af4dad0273caf703883edf99e49ad204cad2000fe0d912bb5b680ca WatchSource:0}: Error finding container 8060cb9b7af4dad0273caf703883edf99e49ad204cad2000fe0d912bb5b680ca: Status 404 returned error can't find the container with id 8060cb9b7af4dad0273caf703883edf99e49ad204cad2000fe0d912bb5b680ca Mar 16 15:50:05 crc kubenswrapper[5120]: I0316 15:50:05.300370 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-db-create-p6nst"] Mar 16 15:50:05 crc kubenswrapper[5120]: W0316 15:50:05.444688 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod62a03637_2221_40d9_a921_f87cc0f5a487.slice/crio-8128de271c4ba4c414a7e145ffb2a0179534dac0f947f2aa37a5cb79a4ca5434 WatchSource:0}: Error finding container 8128de271c4ba4c414a7e145ffb2a0179534dac0f947f2aa37a5cb79a4ca5434: Status 404 returned error can't find the container with id 8128de271c4ba4c414a7e145ffb2a0179534dac0f947f2aa37a5cb79a4ca5434 Mar 16 15:50:05 crc kubenswrapper[5120]: I0316 15:50:05.452813 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-db-create-w4dbt"] Mar 16 15:50:05 crc kubenswrapper[5120]: I0316 15:50:05.459840 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-a8cd-account-create-update-vd2sd"] Mar 16 15:50:05 crc kubenswrapper[5120]: I0316 15:50:05.474576 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-x2qcd"] Mar 16 15:50:05 crc kubenswrapper[5120]: I0316 15:50:05.584041 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-5fw99" event={"ID":"e43da138-d989-4c49-aeea-5a251a21f2d4","Type":"ContainerStarted","Data":"f2942ec6513e0750e6f7f0e379854065920c969d38fe7e164e35408445d59a9e"} Mar 16 15:50:05 crc kubenswrapper[5120]: I0316 15:50:05.587319 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-a8cd-account-create-update-vd2sd" event={"ID":"afd7061f-762c-4876-986c-64076eda9b0f","Type":"ContainerStarted","Data":"ef88ed6526ad4ff74fba9438241e618ff501d39b38a374eb10081dfe35cf2636"} Mar 16 15:50:05 crc kubenswrapper[5120]: I0316 15:50:05.591060 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-x2qcd" event={"ID":"62a03637-2221-40d9-a921-f87cc0f5a487","Type":"ContainerStarted","Data":"8128de271c4ba4c414a7e145ffb2a0179534dac0f947f2aa37a5cb79a4ca5434"} Mar 16 15:50:05 crc kubenswrapper[5120]: I0316 15:50:05.595899 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-create-p6nst" event={"ID":"cbc99c4f-184e-4c10-9e60-9a981761ecf2","Type":"ContainerStarted","Data":"bbef71805042a9e9dc316eaae0ede1249d7a5da9b07a113eb6992b51b435de25"} Mar 16 15:50:05 crc kubenswrapper[5120]: I0316 15:50:05.595949 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-create-p6nst" event={"ID":"cbc99c4f-184e-4c10-9e60-9a981761ecf2","Type":"ContainerStarted","Data":"b2e031fd547b59c53bab1f84710e1b73ba3c8b2d2e94ab99cfdab89c01879b7f"} Mar 16 15:50:05 crc kubenswrapper[5120]: I0316 15:50:05.598576 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-create-7xtvp" event={"ID":"c7b4af2e-c6d2-4479-a926-27a52b3a973e","Type":"ContainerStarted","Data":"439e67e27b13a415aa8d79b126fd7cca0830c0126cf161a6cc7daee8d018f7c1"} Mar 16 15:50:05 crc kubenswrapper[5120]: I0316 15:50:05.598602 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-create-7xtvp" event={"ID":"c7b4af2e-c6d2-4479-a926-27a52b3a973e","Type":"ContainerStarted","Data":"8060cb9b7af4dad0273caf703883edf99e49ad204cad2000fe0d912bb5b680ca"} Mar 16 15:50:05 crc kubenswrapper[5120]: I0316 15:50:05.609903 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-9a70-account-create-update-s95ff"] Mar 16 15:50:05 crc kubenswrapper[5120]: I0316 15:50:05.615504 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-db-sync-5fw99" podStartSLOduration=3.543991791 podStartE2EDuration="15.615485559s" podCreationTimestamp="2026-03-16 15:49:50 +0000 UTC" firstStartedPulling="2026-03-16 15:49:51.524879025 +0000 UTC m=+1093.678810682" lastFinishedPulling="2026-03-16 15:50:03.596372793 +0000 UTC m=+1105.750304450" observedRunningTime="2026-03-16 15:50:05.603488501 +0000 UTC m=+1107.757420148" watchObservedRunningTime="2026-03-16 15:50:05.615485559 +0000 UTC m=+1107.769417216" Mar 16 15:50:05 crc kubenswrapper[5120]: I0316 15:50:05.616220 5120 generic.go:358] "Generic (PLEG): container finished" podID="afb802db-bd6c-476b-bd76-920d192fc44b" containerID="f1238c63bf0f9a5efd118309a63e821aae5fde493554c16e95b6ff2c8b187299" exitCode=0 Mar 16 15:50:05 crc kubenswrapper[5120]: I0316 15:50:05.616313 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7f4777f8f-pg9tl" event={"ID":"afb802db-bd6c-476b-bd76-920d192fc44b","Type":"ContainerDied","Data":"f1238c63bf0f9a5efd118309a63e821aae5fde493554c16e95b6ff2c8b187299"} Mar 16 15:50:05 crc kubenswrapper[5120]: I0316 15:50:05.623048 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-create-w4dbt" event={"ID":"1c96ec30-a61d-4920-b08d-06fd9c5c538c","Type":"ContainerStarted","Data":"ffd055e44e1bd482961c7c0d4044f3adac968b2aa01d88eaffcfda5002d041a0"} Mar 16 15:50:05 crc kubenswrapper[5120]: I0316 15:50:05.626442 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-db-create-p6nst" podStartSLOduration=2.626424253 podStartE2EDuration="2.626424253s" podCreationTimestamp="2026-03-16 15:50:03 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:50:05.617300352 +0000 UTC m=+1107.771232009" watchObservedRunningTime="2026-03-16 15:50:05.626424253 +0000 UTC m=+1107.780355910" Mar 16 15:50:05 crc kubenswrapper[5120]: I0316 15:50:05.626741 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-dd94-account-create-update-p7t46" event={"ID":"57766802-1c47-4741-850a-82f768369d23","Type":"ContainerStarted","Data":"0be872b6fbd5bb7ac8e55aece0b6d7374b692b4e86df832d3e8672300235303d"} Mar 16 15:50:05 crc kubenswrapper[5120]: I0316 15:50:05.626804 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-dd94-account-create-update-p7t46" event={"ID":"57766802-1c47-4741-850a-82f768369d23","Type":"ContainerStarted","Data":"e4f31fee75323dfb61d7bab2b32bdb74520f584887cb0a89e75247f517d0715d"} Mar 16 15:50:05 crc kubenswrapper[5120]: I0316 15:50:05.656267 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-db-create-7xtvp" podStartSLOduration=1.656250006 podStartE2EDuration="1.656250006s" podCreationTimestamp="2026-03-16 15:50:04 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:50:05.639427605 +0000 UTC m=+1107.793359262" watchObservedRunningTime="2026-03-16 15:50:05.656250006 +0000 UTC m=+1107.810181653" Mar 16 15:50:05 crc kubenswrapper[5120]: I0316 15:50:05.682647 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-dd94-account-create-update-p7t46" podStartSLOduration=1.682628528 podStartE2EDuration="1.682628528s" podCreationTimestamp="2026-03-16 15:50:04 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:50:05.668682494 +0000 UTC m=+1107.822614151" watchObservedRunningTime="2026-03-16 15:50:05.682628528 +0000 UTC m=+1107.836560175" Mar 16 15:50:06 crc kubenswrapper[5120]: I0316 15:50:06.637472 5120 generic.go:358] "Generic (PLEG): container finished" podID="110f0814-5d86-4605-aa7c-3d0687c4af18" containerID="92e3ffc74a9c0a82f9f83e8955ea6c9346517e8756f498aead0b817359fef97a" exitCode=0 Mar 16 15:50:06 crc kubenswrapper[5120]: I0316 15:50:06.637622 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561270-5sfpd" event={"ID":"110f0814-5d86-4605-aa7c-3d0687c4af18","Type":"ContainerDied","Data":"92e3ffc74a9c0a82f9f83e8955ea6c9346517e8756f498aead0b817359fef97a"} Mar 16 15:50:06 crc kubenswrapper[5120]: I0316 15:50:06.639927 5120 generic.go:358] "Generic (PLEG): container finished" podID="3ab9ab45-8904-421a-a38b-8fbd13cf84a6" containerID="0893e18c7c5fb4c06490d8f00ba7e3dfe7560fd36add47c9c2b1f80435087e46" exitCode=0 Mar 16 15:50:06 crc kubenswrapper[5120]: I0316 15:50:06.640192 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-9a70-account-create-update-s95ff" event={"ID":"3ab9ab45-8904-421a-a38b-8fbd13cf84a6","Type":"ContainerDied","Data":"0893e18c7c5fb4c06490d8f00ba7e3dfe7560fd36add47c9c2b1f80435087e46"} Mar 16 15:50:06 crc kubenswrapper[5120]: I0316 15:50:06.640223 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-9a70-account-create-update-s95ff" event={"ID":"3ab9ab45-8904-421a-a38b-8fbd13cf84a6","Type":"ContainerStarted","Data":"bfef044aa46b86f632d9b82de00bd675a943b5e818bdbf67ff2d637cbbbf88cd"} Mar 16 15:50:06 crc kubenswrapper[5120]: I0316 15:50:06.642140 5120 generic.go:358] "Generic (PLEG): container finished" podID="afd7061f-762c-4876-986c-64076eda9b0f" containerID="a0371585cd810f039230aeb2f4cd88f3eb9d2b90a7d16e3c5d1348498ccc0e11" exitCode=0 Mar 16 15:50:06 crc kubenswrapper[5120]: I0316 15:50:06.642341 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-a8cd-account-create-update-vd2sd" event={"ID":"afd7061f-762c-4876-986c-64076eda9b0f","Type":"ContainerDied","Data":"a0371585cd810f039230aeb2f4cd88f3eb9d2b90a7d16e3c5d1348498ccc0e11"} Mar 16 15:50:06 crc kubenswrapper[5120]: I0316 15:50:06.647434 5120 generic.go:358] "Generic (PLEG): container finished" podID="cbc99c4f-184e-4c10-9e60-9a981761ecf2" containerID="bbef71805042a9e9dc316eaae0ede1249d7a5da9b07a113eb6992b51b435de25" exitCode=0 Mar 16 15:50:06 crc kubenswrapper[5120]: I0316 15:50:06.647470 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-create-p6nst" event={"ID":"cbc99c4f-184e-4c10-9e60-9a981761ecf2","Type":"ContainerDied","Data":"bbef71805042a9e9dc316eaae0ede1249d7a5da9b07a113eb6992b51b435de25"} Mar 16 15:50:06 crc kubenswrapper[5120]: I0316 15:50:06.650128 5120 generic.go:358] "Generic (PLEG): container finished" podID="c7b4af2e-c6d2-4479-a926-27a52b3a973e" containerID="439e67e27b13a415aa8d79b126fd7cca0830c0126cf161a6cc7daee8d018f7c1" exitCode=0 Mar 16 15:50:06 crc kubenswrapper[5120]: I0316 15:50:06.650162 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-create-7xtvp" event={"ID":"c7b4af2e-c6d2-4479-a926-27a52b3a973e","Type":"ContainerDied","Data":"439e67e27b13a415aa8d79b126fd7cca0830c0126cf161a6cc7daee8d018f7c1"} Mar 16 15:50:06 crc kubenswrapper[5120]: I0316 15:50:06.652481 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7f4777f8f-pg9tl" event={"ID":"afb802db-bd6c-476b-bd76-920d192fc44b","Type":"ContainerStarted","Data":"d4bb5adbd442689f0320a608562291cb71a54efb8b9cc82d6fc38cca5fe230e4"} Mar 16 15:50:06 crc kubenswrapper[5120]: I0316 15:50:06.652682 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7f4777f8f-pg9tl" Mar 16 15:50:06 crc kubenswrapper[5120]: I0316 15:50:06.654424 5120 generic.go:358] "Generic (PLEG): container finished" podID="1c96ec30-a61d-4920-b08d-06fd9c5c538c" containerID="6b226fb3c3e6a30cf01fa03c9ced6f34dd00ae13ad8e90d4f3449d551892236d" exitCode=0 Mar 16 15:50:06 crc kubenswrapper[5120]: I0316 15:50:06.654498 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-create-w4dbt" event={"ID":"1c96ec30-a61d-4920-b08d-06fd9c5c538c","Type":"ContainerDied","Data":"6b226fb3c3e6a30cf01fa03c9ced6f34dd00ae13ad8e90d4f3449d551892236d"} Mar 16 15:50:06 crc kubenswrapper[5120]: I0316 15:50:06.655824 5120 generic.go:358] "Generic (PLEG): container finished" podID="57766802-1c47-4741-850a-82f768369d23" containerID="0be872b6fbd5bb7ac8e55aece0b6d7374b692b4e86df832d3e8672300235303d" exitCode=0 Mar 16 15:50:06 crc kubenswrapper[5120]: I0316 15:50:06.656030 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-dd94-account-create-update-p7t46" event={"ID":"57766802-1c47-4741-850a-82f768369d23","Type":"ContainerDied","Data":"0be872b6fbd5bb7ac8e55aece0b6d7374b692b4e86df832d3e8672300235303d"} Mar 16 15:50:06 crc kubenswrapper[5120]: I0316 15:50:06.758995 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7f4777f8f-pg9tl" podStartSLOduration=9.758973566 podStartE2EDuration="9.758973566s" podCreationTimestamp="2026-03-16 15:49:57 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:50:06.750714885 +0000 UTC m=+1108.904646542" watchObservedRunningTime="2026-03-16 15:50:06.758973566 +0000 UTC m=+1108.912905233" Mar 16 15:50:07 crc kubenswrapper[5120]: E0316 15:50:07.994583 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1579712 actualBytes=10240 Mar 16 15:50:10 crc kubenswrapper[5120]: I0316 15:50:10.109461 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-a8cd-account-create-update-vd2sd" Mar 16 15:50:10 crc kubenswrapper[5120]: I0316 15:50:10.137564 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-9a70-account-create-update-s95ff" Mar 16 15:50:10 crc kubenswrapper[5120]: I0316 15:50:10.152167 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-dd94-account-create-update-p7t46" Mar 16 15:50:10 crc kubenswrapper[5120]: I0316 15:50:10.177226 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-create-7xtvp" Mar 16 15:50:10 crc kubenswrapper[5120]: I0316 15:50:10.182527 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xgwbd\" (UniqueName: \"kubernetes.io/projected/afd7061f-762c-4876-986c-64076eda9b0f-kube-api-access-xgwbd\") pod \"afd7061f-762c-4876-986c-64076eda9b0f\" (UID: \"afd7061f-762c-4876-986c-64076eda9b0f\") " Mar 16 15:50:10 crc kubenswrapper[5120]: I0316 15:50:10.182716 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-khklm\" (UniqueName: \"kubernetes.io/projected/3ab9ab45-8904-421a-a38b-8fbd13cf84a6-kube-api-access-khklm\") pod \"3ab9ab45-8904-421a-a38b-8fbd13cf84a6\" (UID: \"3ab9ab45-8904-421a-a38b-8fbd13cf84a6\") " Mar 16 15:50:10 crc kubenswrapper[5120]: I0316 15:50:10.183021 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/57766802-1c47-4741-850a-82f768369d23-operator-scripts\") pod \"57766802-1c47-4741-850a-82f768369d23\" (UID: \"57766802-1c47-4741-850a-82f768369d23\") " Mar 16 15:50:10 crc kubenswrapper[5120]: I0316 15:50:10.183212 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mmt7q\" (UniqueName: \"kubernetes.io/projected/57766802-1c47-4741-850a-82f768369d23-kube-api-access-mmt7q\") pod \"57766802-1c47-4741-850a-82f768369d23\" (UID: \"57766802-1c47-4741-850a-82f768369d23\") " Mar 16 15:50:10 crc kubenswrapper[5120]: I0316 15:50:10.183344 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3ab9ab45-8904-421a-a38b-8fbd13cf84a6-operator-scripts\") pod \"3ab9ab45-8904-421a-a38b-8fbd13cf84a6\" (UID: \"3ab9ab45-8904-421a-a38b-8fbd13cf84a6\") " Mar 16 15:50:10 crc kubenswrapper[5120]: I0316 15:50:10.183479 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/afd7061f-762c-4876-986c-64076eda9b0f-operator-scripts\") pod \"afd7061f-762c-4876-986c-64076eda9b0f\" (UID: \"afd7061f-762c-4876-986c-64076eda9b0f\") " Mar 16 15:50:10 crc kubenswrapper[5120]: I0316 15:50:10.184427 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3ab9ab45-8904-421a-a38b-8fbd13cf84a6-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "3ab9ab45-8904-421a-a38b-8fbd13cf84a6" (UID: "3ab9ab45-8904-421a-a38b-8fbd13cf84a6"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:50:10 crc kubenswrapper[5120]: I0316 15:50:10.184927 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/57766802-1c47-4741-850a-82f768369d23-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "57766802-1c47-4741-850a-82f768369d23" (UID: "57766802-1c47-4741-850a-82f768369d23"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:50:10 crc kubenswrapper[5120]: I0316 15:50:10.185190 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/57766802-1c47-4741-850a-82f768369d23-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 15:50:10 crc kubenswrapper[5120]: I0316 15:50:10.185286 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3ab9ab45-8904-421a-a38b-8fbd13cf84a6-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 15:50:10 crc kubenswrapper[5120]: I0316 15:50:10.185934 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/afd7061f-762c-4876-986c-64076eda9b0f-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "afd7061f-762c-4876-986c-64076eda9b0f" (UID: "afd7061f-762c-4876-986c-64076eda9b0f"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:50:10 crc kubenswrapper[5120]: I0316 15:50:10.189740 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-create-p6nst" Mar 16 15:50:10 crc kubenswrapper[5120]: I0316 15:50:10.194776 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ab9ab45-8904-421a-a38b-8fbd13cf84a6-kube-api-access-khklm" (OuterVolumeSpecName: "kube-api-access-khklm") pod "3ab9ab45-8904-421a-a38b-8fbd13cf84a6" (UID: "3ab9ab45-8904-421a-a38b-8fbd13cf84a6"). InnerVolumeSpecName "kube-api-access-khklm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:50:10 crc kubenswrapper[5120]: I0316 15:50:10.196232 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-create-w4dbt" Mar 16 15:50:10 crc kubenswrapper[5120]: I0316 15:50:10.196435 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/afd7061f-762c-4876-986c-64076eda9b0f-kube-api-access-xgwbd" (OuterVolumeSpecName: "kube-api-access-xgwbd") pod "afd7061f-762c-4876-986c-64076eda9b0f" (UID: "afd7061f-762c-4876-986c-64076eda9b0f"). InnerVolumeSpecName "kube-api-access-xgwbd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:50:10 crc kubenswrapper[5120]: I0316 15:50:10.196474 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57766802-1c47-4741-850a-82f768369d23-kube-api-access-mmt7q" (OuterVolumeSpecName: "kube-api-access-mmt7q") pod "57766802-1c47-4741-850a-82f768369d23" (UID: "57766802-1c47-4741-850a-82f768369d23"). InnerVolumeSpecName "kube-api-access-mmt7q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:50:10 crc kubenswrapper[5120]: I0316 15:50:10.207427 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561270-5sfpd" Mar 16 15:50:10 crc kubenswrapper[5120]: I0316 15:50:10.286690 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/cbc99c4f-184e-4c10-9e60-9a981761ecf2-operator-scripts\") pod \"cbc99c4f-184e-4c10-9e60-9a981761ecf2\" (UID: \"cbc99c4f-184e-4c10-9e60-9a981761ecf2\") " Mar 16 15:50:10 crc kubenswrapper[5120]: I0316 15:50:10.286779 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lw45b\" (UniqueName: \"kubernetes.io/projected/1c96ec30-a61d-4920-b08d-06fd9c5c538c-kube-api-access-lw45b\") pod \"1c96ec30-a61d-4920-b08d-06fd9c5c538c\" (UID: \"1c96ec30-a61d-4920-b08d-06fd9c5c538c\") " Mar 16 15:50:10 crc kubenswrapper[5120]: I0316 15:50:10.286804 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c7b4af2e-c6d2-4479-a926-27a52b3a973e-operator-scripts\") pod \"c7b4af2e-c6d2-4479-a926-27a52b3a973e\" (UID: \"c7b4af2e-c6d2-4479-a926-27a52b3a973e\") " Mar 16 15:50:10 crc kubenswrapper[5120]: I0316 15:50:10.286983 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/1c96ec30-a61d-4920-b08d-06fd9c5c538c-operator-scripts\") pod \"1c96ec30-a61d-4920-b08d-06fd9c5c538c\" (UID: \"1c96ec30-a61d-4920-b08d-06fd9c5c538c\") " Mar 16 15:50:10 crc kubenswrapper[5120]: I0316 15:50:10.287014 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4l26s\" (UniqueName: \"kubernetes.io/projected/110f0814-5d86-4605-aa7c-3d0687c4af18-kube-api-access-4l26s\") pod \"110f0814-5d86-4605-aa7c-3d0687c4af18\" (UID: \"110f0814-5d86-4605-aa7c-3d0687c4af18\") " Mar 16 15:50:10 crc kubenswrapper[5120]: I0316 15:50:10.287071 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7fkkj\" (UniqueName: \"kubernetes.io/projected/cbc99c4f-184e-4c10-9e60-9a981761ecf2-kube-api-access-7fkkj\") pod \"cbc99c4f-184e-4c10-9e60-9a981761ecf2\" (UID: \"cbc99c4f-184e-4c10-9e60-9a981761ecf2\") " Mar 16 15:50:10 crc kubenswrapper[5120]: I0316 15:50:10.287116 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-45b9t\" (UniqueName: \"kubernetes.io/projected/c7b4af2e-c6d2-4479-a926-27a52b3a973e-kube-api-access-45b9t\") pod \"c7b4af2e-c6d2-4479-a926-27a52b3a973e\" (UID: \"c7b4af2e-c6d2-4479-a926-27a52b3a973e\") " Mar 16 15:50:10 crc kubenswrapper[5120]: I0316 15:50:10.287522 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/afd7061f-762c-4876-986c-64076eda9b0f-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 15:50:10 crc kubenswrapper[5120]: I0316 15:50:10.287539 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xgwbd\" (UniqueName: \"kubernetes.io/projected/afd7061f-762c-4876-986c-64076eda9b0f-kube-api-access-xgwbd\") on node \"crc\" DevicePath \"\"" Mar 16 15:50:10 crc kubenswrapper[5120]: I0316 15:50:10.287549 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-khklm\" (UniqueName: \"kubernetes.io/projected/3ab9ab45-8904-421a-a38b-8fbd13cf84a6-kube-api-access-khklm\") on node \"crc\" DevicePath \"\"" Mar 16 15:50:10 crc kubenswrapper[5120]: I0316 15:50:10.287578 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mmt7q\" (UniqueName: \"kubernetes.io/projected/57766802-1c47-4741-850a-82f768369d23-kube-api-access-mmt7q\") on node \"crc\" DevicePath \"\"" Mar 16 15:50:10 crc kubenswrapper[5120]: I0316 15:50:10.288519 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c7b4af2e-c6d2-4479-a926-27a52b3a973e-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "c7b4af2e-c6d2-4479-a926-27a52b3a973e" (UID: "c7b4af2e-c6d2-4479-a926-27a52b3a973e"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:50:10 crc kubenswrapper[5120]: I0316 15:50:10.288926 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c96ec30-a61d-4920-b08d-06fd9c5c538c-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "1c96ec30-a61d-4920-b08d-06fd9c5c538c" (UID: "1c96ec30-a61d-4920-b08d-06fd9c5c538c"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:50:10 crc kubenswrapper[5120]: I0316 15:50:10.289337 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cbc99c4f-184e-4c10-9e60-9a981761ecf2-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "cbc99c4f-184e-4c10-9e60-9a981761ecf2" (UID: "cbc99c4f-184e-4c10-9e60-9a981761ecf2"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:50:10 crc kubenswrapper[5120]: I0316 15:50:10.292559 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7b4af2e-c6d2-4479-a926-27a52b3a973e-kube-api-access-45b9t" (OuterVolumeSpecName: "kube-api-access-45b9t") pod "c7b4af2e-c6d2-4479-a926-27a52b3a973e" (UID: "c7b4af2e-c6d2-4479-a926-27a52b3a973e"). InnerVolumeSpecName "kube-api-access-45b9t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:50:10 crc kubenswrapper[5120]: I0316 15:50:10.293066 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c96ec30-a61d-4920-b08d-06fd9c5c538c-kube-api-access-lw45b" (OuterVolumeSpecName: "kube-api-access-lw45b") pod "1c96ec30-a61d-4920-b08d-06fd9c5c538c" (UID: "1c96ec30-a61d-4920-b08d-06fd9c5c538c"). InnerVolumeSpecName "kube-api-access-lw45b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:50:10 crc kubenswrapper[5120]: I0316 15:50:10.293155 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cbc99c4f-184e-4c10-9e60-9a981761ecf2-kube-api-access-7fkkj" (OuterVolumeSpecName: "kube-api-access-7fkkj") pod "cbc99c4f-184e-4c10-9e60-9a981761ecf2" (UID: "cbc99c4f-184e-4c10-9e60-9a981761ecf2"). InnerVolumeSpecName "kube-api-access-7fkkj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:50:10 crc kubenswrapper[5120]: I0316 15:50:10.293239 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/110f0814-5d86-4605-aa7c-3d0687c4af18-kube-api-access-4l26s" (OuterVolumeSpecName: "kube-api-access-4l26s") pod "110f0814-5d86-4605-aa7c-3d0687c4af18" (UID: "110f0814-5d86-4605-aa7c-3d0687c4af18"). InnerVolumeSpecName "kube-api-access-4l26s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:50:10 crc kubenswrapper[5120]: I0316 15:50:10.389044 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/1c96ec30-a61d-4920-b08d-06fd9c5c538c-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 15:50:10 crc kubenswrapper[5120]: I0316 15:50:10.389090 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4l26s\" (UniqueName: \"kubernetes.io/projected/110f0814-5d86-4605-aa7c-3d0687c4af18-kube-api-access-4l26s\") on node \"crc\" DevicePath \"\"" Mar 16 15:50:10 crc kubenswrapper[5120]: I0316 15:50:10.389103 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7fkkj\" (UniqueName: \"kubernetes.io/projected/cbc99c4f-184e-4c10-9e60-9a981761ecf2-kube-api-access-7fkkj\") on node \"crc\" DevicePath \"\"" Mar 16 15:50:10 crc kubenswrapper[5120]: I0316 15:50:10.389114 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-45b9t\" (UniqueName: \"kubernetes.io/projected/c7b4af2e-c6d2-4479-a926-27a52b3a973e-kube-api-access-45b9t\") on node \"crc\" DevicePath \"\"" Mar 16 15:50:10 crc kubenswrapper[5120]: I0316 15:50:10.389125 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/cbc99c4f-184e-4c10-9e60-9a981761ecf2-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 15:50:10 crc kubenswrapper[5120]: I0316 15:50:10.389133 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lw45b\" (UniqueName: \"kubernetes.io/projected/1c96ec30-a61d-4920-b08d-06fd9c5c538c-kube-api-access-lw45b\") on node \"crc\" DevicePath \"\"" Mar 16 15:50:10 crc kubenswrapper[5120]: I0316 15:50:10.389142 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c7b4af2e-c6d2-4479-a926-27a52b3a973e-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 15:50:10 crc kubenswrapper[5120]: I0316 15:50:10.704898 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-create-p6nst" event={"ID":"cbc99c4f-184e-4c10-9e60-9a981761ecf2","Type":"ContainerDied","Data":"b2e031fd547b59c53bab1f84710e1b73ba3c8b2d2e94ab99cfdab89c01879b7f"} Mar 16 15:50:10 crc kubenswrapper[5120]: I0316 15:50:10.705221 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b2e031fd547b59c53bab1f84710e1b73ba3c8b2d2e94ab99cfdab89c01879b7f" Mar 16 15:50:10 crc kubenswrapper[5120]: I0316 15:50:10.704986 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-create-p6nst" Mar 16 15:50:10 crc kubenswrapper[5120]: I0316 15:50:10.707287 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-create-7xtvp" Mar 16 15:50:10 crc kubenswrapper[5120]: I0316 15:50:10.707292 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-create-7xtvp" event={"ID":"c7b4af2e-c6d2-4479-a926-27a52b3a973e","Type":"ContainerDied","Data":"8060cb9b7af4dad0273caf703883edf99e49ad204cad2000fe0d912bb5b680ca"} Mar 16 15:50:10 crc kubenswrapper[5120]: I0316 15:50:10.707399 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8060cb9b7af4dad0273caf703883edf99e49ad204cad2000fe0d912bb5b680ca" Mar 16 15:50:10 crc kubenswrapper[5120]: I0316 15:50:10.709728 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-create-w4dbt" event={"ID":"1c96ec30-a61d-4920-b08d-06fd9c5c538c","Type":"ContainerDied","Data":"ffd055e44e1bd482961c7c0d4044f3adac968b2aa01d88eaffcfda5002d041a0"} Mar 16 15:50:10 crc kubenswrapper[5120]: I0316 15:50:10.709912 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ffd055e44e1bd482961c7c0d4044f3adac968b2aa01d88eaffcfda5002d041a0" Mar 16 15:50:10 crc kubenswrapper[5120]: I0316 15:50:10.710332 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-create-w4dbt" Mar 16 15:50:10 crc kubenswrapper[5120]: I0316 15:50:10.712219 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-dd94-account-create-update-p7t46" event={"ID":"57766802-1c47-4741-850a-82f768369d23","Type":"ContainerDied","Data":"e4f31fee75323dfb61d7bab2b32bdb74520f584887cb0a89e75247f517d0715d"} Mar 16 15:50:10 crc kubenswrapper[5120]: I0316 15:50:10.712245 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-dd94-account-create-update-p7t46" Mar 16 15:50:10 crc kubenswrapper[5120]: I0316 15:50:10.712252 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e4f31fee75323dfb61d7bab2b32bdb74520f584887cb0a89e75247f517d0715d" Mar 16 15:50:10 crc kubenswrapper[5120]: I0316 15:50:10.714429 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561270-5sfpd" event={"ID":"110f0814-5d86-4605-aa7c-3d0687c4af18","Type":"ContainerDied","Data":"f2603f679d5e3a0beab93cb43c5175f4c18360beaba8ce5a851dfb95f90cbee0"} Mar 16 15:50:10 crc kubenswrapper[5120]: I0316 15:50:10.714456 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f2603f679d5e3a0beab93cb43c5175f4c18360beaba8ce5a851dfb95f90cbee0" Mar 16 15:50:10 crc kubenswrapper[5120]: I0316 15:50:10.714488 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561270-5sfpd" Mar 16 15:50:10 crc kubenswrapper[5120]: I0316 15:50:10.716748 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-9a70-account-create-update-s95ff" Mar 16 15:50:10 crc kubenswrapper[5120]: I0316 15:50:10.716842 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-9a70-account-create-update-s95ff" event={"ID":"3ab9ab45-8904-421a-a38b-8fbd13cf84a6","Type":"ContainerDied","Data":"bfef044aa46b86f632d9b82de00bd675a943b5e818bdbf67ff2d637cbbbf88cd"} Mar 16 15:50:10 crc kubenswrapper[5120]: I0316 15:50:10.716930 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bfef044aa46b86f632d9b82de00bd675a943b5e818bdbf67ff2d637cbbbf88cd" Mar 16 15:50:10 crc kubenswrapper[5120]: I0316 15:50:10.720447 5120 generic.go:358] "Generic (PLEG): container finished" podID="e43da138-d989-4c49-aeea-5a251a21f2d4" containerID="f2942ec6513e0750e6f7f0e379854065920c969d38fe7e164e35408445d59a9e" exitCode=0 Mar 16 15:50:10 crc kubenswrapper[5120]: I0316 15:50:10.720582 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-5fw99" event={"ID":"e43da138-d989-4c49-aeea-5a251a21f2d4","Type":"ContainerDied","Data":"f2942ec6513e0750e6f7f0e379854065920c969d38fe7e164e35408445d59a9e"} Mar 16 15:50:10 crc kubenswrapper[5120]: I0316 15:50:10.722736 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-a8cd-account-create-update-vd2sd" Mar 16 15:50:10 crc kubenswrapper[5120]: I0316 15:50:10.725925 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-a8cd-account-create-update-vd2sd" event={"ID":"afd7061f-762c-4876-986c-64076eda9b0f","Type":"ContainerDied","Data":"ef88ed6526ad4ff74fba9438241e618ff501d39b38a374eb10081dfe35cf2636"} Mar 16 15:50:10 crc kubenswrapper[5120]: I0316 15:50:10.725964 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ef88ed6526ad4ff74fba9438241e618ff501d39b38a374eb10081dfe35cf2636" Mar 16 15:50:10 crc kubenswrapper[5120]: I0316 15:50:10.728064 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-x2qcd" event={"ID":"62a03637-2221-40d9-a921-f87cc0f5a487","Type":"ContainerStarted","Data":"061a2976be3df2e673ad197fc049e6d15f35955932edbe49dff3a84b1b51d30f"} Mar 16 15:50:10 crc kubenswrapper[5120]: I0316 15:50:10.773998 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-db-sync-x2qcd" podStartSLOduration=2.227726903 podStartE2EDuration="6.773980959s" podCreationTimestamp="2026-03-16 15:50:04 +0000 UTC" firstStartedPulling="2026-03-16 15:50:05.446882835 +0000 UTC m=+1107.600814492" lastFinishedPulling="2026-03-16 15:50:09.993136891 +0000 UTC m=+1112.147068548" observedRunningTime="2026-03-16 15:50:10.768309148 +0000 UTC m=+1112.922240825" watchObservedRunningTime="2026-03-16 15:50:10.773980959 +0000 UTC m=+1112.927912616" Mar 16 15:50:11 crc kubenswrapper[5120]: I0316 15:50:11.302978 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-infra/auto-csr-approver-29561264-tcqkj"] Mar 16 15:50:11 crc kubenswrapper[5120]: I0316 15:50:11.311945 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-infra/auto-csr-approver-29561264-tcqkj"] Mar 16 15:50:12 crc kubenswrapper[5120]: I0316 15:50:12.195003 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-5fw99" Mar 16 15:50:12 crc kubenswrapper[5120]: I0316 15:50:12.223048 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e43da138-d989-4c49-aeea-5a251a21f2d4-config-data\") pod \"e43da138-d989-4c49-aeea-5a251a21f2d4\" (UID: \"e43da138-d989-4c49-aeea-5a251a21f2d4\") " Mar 16 15:50:12 crc kubenswrapper[5120]: I0316 15:50:12.223198 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e43da138-d989-4c49-aeea-5a251a21f2d4-combined-ca-bundle\") pod \"e43da138-d989-4c49-aeea-5a251a21f2d4\" (UID: \"e43da138-d989-4c49-aeea-5a251a21f2d4\") " Mar 16 15:50:12 crc kubenswrapper[5120]: I0316 15:50:12.224526 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/e43da138-d989-4c49-aeea-5a251a21f2d4-db-sync-config-data\") pod \"e43da138-d989-4c49-aeea-5a251a21f2d4\" (UID: \"e43da138-d989-4c49-aeea-5a251a21f2d4\") " Mar 16 15:50:12 crc kubenswrapper[5120]: I0316 15:50:12.224597 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f6s5j\" (UniqueName: \"kubernetes.io/projected/e43da138-d989-4c49-aeea-5a251a21f2d4-kube-api-access-f6s5j\") pod \"e43da138-d989-4c49-aeea-5a251a21f2d4\" (UID: \"e43da138-d989-4c49-aeea-5a251a21f2d4\") " Mar 16 15:50:12 crc kubenswrapper[5120]: I0316 15:50:12.235104 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e43da138-d989-4c49-aeea-5a251a21f2d4-db-sync-config-data" (OuterVolumeSpecName: "db-sync-config-data") pod "e43da138-d989-4c49-aeea-5a251a21f2d4" (UID: "e43da138-d989-4c49-aeea-5a251a21f2d4"). InnerVolumeSpecName "db-sync-config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:50:12 crc kubenswrapper[5120]: I0316 15:50:12.235159 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e43da138-d989-4c49-aeea-5a251a21f2d4-kube-api-access-f6s5j" (OuterVolumeSpecName: "kube-api-access-f6s5j") pod "e43da138-d989-4c49-aeea-5a251a21f2d4" (UID: "e43da138-d989-4c49-aeea-5a251a21f2d4"). InnerVolumeSpecName "kube-api-access-f6s5j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:50:12 crc kubenswrapper[5120]: I0316 15:50:12.264515 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e43da138-d989-4c49-aeea-5a251a21f2d4-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e43da138-d989-4c49-aeea-5a251a21f2d4" (UID: "e43da138-d989-4c49-aeea-5a251a21f2d4"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:50:12 crc kubenswrapper[5120]: I0316 15:50:12.279160 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e43da138-d989-4c49-aeea-5a251a21f2d4-config-data" (OuterVolumeSpecName: "config-data") pod "e43da138-d989-4c49-aeea-5a251a21f2d4" (UID: "e43da138-d989-4c49-aeea-5a251a21f2d4"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:50:12 crc kubenswrapper[5120]: I0316 15:50:12.332830 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e43da138-d989-4c49-aeea-5a251a21f2d4-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 15:50:12 crc kubenswrapper[5120]: I0316 15:50:12.333918 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e43da138-d989-4c49-aeea-5a251a21f2d4-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:50:12 crc kubenswrapper[5120]: I0316 15:50:12.333954 5120 reconciler_common.go:299] "Volume detached for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/e43da138-d989-4c49-aeea-5a251a21f2d4-db-sync-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 15:50:12 crc kubenswrapper[5120]: I0316 15:50:12.333969 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f6s5j\" (UniqueName: \"kubernetes.io/projected/e43da138-d989-4c49-aeea-5a251a21f2d4-kube-api-access-f6s5j\") on node \"crc\" DevicePath \"\"" Mar 16 15:50:12 crc kubenswrapper[5120]: I0316 15:50:12.676740 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="730a9c0b-5439-4fe9-b8f3-9e52ffa4a6e4" path="/var/lib/kubelet/pods/730a9c0b-5439-4fe9-b8f3-9e52ffa4a6e4/volumes" Mar 16 15:50:12 crc kubenswrapper[5120]: I0316 15:50:12.678654 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7f4777f8f-pg9tl" Mar 16 15:50:12 crc kubenswrapper[5120]: I0316 15:50:12.757063 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-tpgs2"] Mar 16 15:50:12 crc kubenswrapper[5120]: I0316 15:50:12.757677 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-tpgs2" podUID="66fbf6ad-9a00-472a-9848-6647d7eff53d" containerName="dnsmasq-dns" containerID="cri-o://ddfb58932facd381fc415079117e6d43753a8137f61cd47075a60abcf3bb8769" gracePeriod=10 Mar 16 15:50:12 crc kubenswrapper[5120]: I0316 15:50:12.758012 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-5fw99" event={"ID":"e43da138-d989-4c49-aeea-5a251a21f2d4","Type":"ContainerDied","Data":"188a47e77cd4bb7ff248f6d0ea53a035f99c78e170e78b4d0650031f2889b775"} Mar 16 15:50:12 crc kubenswrapper[5120]: I0316 15:50:12.758077 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="188a47e77cd4bb7ff248f6d0ea53a035f99c78e170e78b4d0650031f2889b775" Mar 16 15:50:12 crc kubenswrapper[5120]: I0316 15:50:12.758335 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-5fw99" Mar 16 15:50:13 crc kubenswrapper[5120]: I0316 15:50:13.212162 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-tpgs2" Mar 16 15:50:13 crc kubenswrapper[5120]: I0316 15:50:13.255477 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/66fbf6ad-9a00-472a-9848-6647d7eff53d-dnsmasq-svc\") pod \"66fbf6ad-9a00-472a-9848-6647d7eff53d\" (UID: \"66fbf6ad-9a00-472a-9848-6647d7eff53d\") " Mar 16 15:50:13 crc kubenswrapper[5120]: I0316 15:50:13.255603 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tbtgn\" (UniqueName: \"kubernetes.io/projected/66fbf6ad-9a00-472a-9848-6647d7eff53d-kube-api-access-tbtgn\") pod \"66fbf6ad-9a00-472a-9848-6647d7eff53d\" (UID: \"66fbf6ad-9a00-472a-9848-6647d7eff53d\") " Mar 16 15:50:13 crc kubenswrapper[5120]: I0316 15:50:13.255779 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/66fbf6ad-9a00-472a-9848-6647d7eff53d-config\") pod \"66fbf6ad-9a00-472a-9848-6647d7eff53d\" (UID: \"66fbf6ad-9a00-472a-9848-6647d7eff53d\") " Mar 16 15:50:13 crc kubenswrapper[5120]: I0316 15:50:13.264623 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66fbf6ad-9a00-472a-9848-6647d7eff53d-kube-api-access-tbtgn" (OuterVolumeSpecName: "kube-api-access-tbtgn") pod "66fbf6ad-9a00-472a-9848-6647d7eff53d" (UID: "66fbf6ad-9a00-472a-9848-6647d7eff53d"). InnerVolumeSpecName "kube-api-access-tbtgn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:50:13 crc kubenswrapper[5120]: I0316 15:50:13.296321 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/66fbf6ad-9a00-472a-9848-6647d7eff53d-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "66fbf6ad-9a00-472a-9848-6647d7eff53d" (UID: "66fbf6ad-9a00-472a-9848-6647d7eff53d"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:50:13 crc kubenswrapper[5120]: I0316 15:50:13.296805 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/66fbf6ad-9a00-472a-9848-6647d7eff53d-config" (OuterVolumeSpecName: "config") pod "66fbf6ad-9a00-472a-9848-6647d7eff53d" (UID: "66fbf6ad-9a00-472a-9848-6647d7eff53d"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:50:13 crc kubenswrapper[5120]: I0316 15:50:13.357983 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tbtgn\" (UniqueName: \"kubernetes.io/projected/66fbf6ad-9a00-472a-9848-6647d7eff53d-kube-api-access-tbtgn\") on node \"crc\" DevicePath \"\"" Mar 16 15:50:13 crc kubenswrapper[5120]: I0316 15:50:13.358013 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/66fbf6ad-9a00-472a-9848-6647d7eff53d-config\") on node \"crc\" DevicePath \"\"" Mar 16 15:50:13 crc kubenswrapper[5120]: I0316 15:50:13.358025 5120 reconciler_common.go:299] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/66fbf6ad-9a00-472a-9848-6647d7eff53d-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Mar 16 15:50:13 crc kubenswrapper[5120]: I0316 15:50:13.769026 5120 generic.go:358] "Generic (PLEG): container finished" podID="62a03637-2221-40d9-a921-f87cc0f5a487" containerID="061a2976be3df2e673ad197fc049e6d15f35955932edbe49dff3a84b1b51d30f" exitCode=0 Mar 16 15:50:13 crc kubenswrapper[5120]: I0316 15:50:13.769105 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-x2qcd" event={"ID":"62a03637-2221-40d9-a921-f87cc0f5a487","Type":"ContainerDied","Data":"061a2976be3df2e673ad197fc049e6d15f35955932edbe49dff3a84b1b51d30f"} Mar 16 15:50:13 crc kubenswrapper[5120]: I0316 15:50:13.772088 5120 generic.go:358] "Generic (PLEG): container finished" podID="66fbf6ad-9a00-472a-9848-6647d7eff53d" containerID="ddfb58932facd381fc415079117e6d43753a8137f61cd47075a60abcf3bb8769" exitCode=0 Mar 16 15:50:13 crc kubenswrapper[5120]: I0316 15:50:13.772217 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-tpgs2" event={"ID":"66fbf6ad-9a00-472a-9848-6647d7eff53d","Type":"ContainerDied","Data":"ddfb58932facd381fc415079117e6d43753a8137f61cd47075a60abcf3bb8769"} Mar 16 15:50:13 crc kubenswrapper[5120]: I0316 15:50:13.772236 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-tpgs2" event={"ID":"66fbf6ad-9a00-472a-9848-6647d7eff53d","Type":"ContainerDied","Data":"c1e3bb1aceeee6a643b5c22033b359492919af5e6c7413176f23f17ba279bc1c"} Mar 16 15:50:13 crc kubenswrapper[5120]: I0316 15:50:13.772253 5120 scope.go:117] "RemoveContainer" containerID="ddfb58932facd381fc415079117e6d43753a8137f61cd47075a60abcf3bb8769" Mar 16 15:50:13 crc kubenswrapper[5120]: I0316 15:50:13.772343 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-tpgs2" Mar 16 15:50:13 crc kubenswrapper[5120]: I0316 15:50:13.813142 5120 scope.go:117] "RemoveContainer" containerID="c08bd21cdf559fd8bd8dfde54dc018682d6bee5a6647b5bcd803c76a8384bb6f" Mar 16 15:50:13 crc kubenswrapper[5120]: I0316 15:50:13.821916 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-tpgs2"] Mar 16 15:50:13 crc kubenswrapper[5120]: I0316 15:50:13.835706 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-tpgs2"] Mar 16 15:50:13 crc kubenswrapper[5120]: I0316 15:50:13.844541 5120 scope.go:117] "RemoveContainer" containerID="ddfb58932facd381fc415079117e6d43753a8137f61cd47075a60abcf3bb8769" Mar 16 15:50:13 crc kubenswrapper[5120]: E0316 15:50:13.845086 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ddfb58932facd381fc415079117e6d43753a8137f61cd47075a60abcf3bb8769\": container with ID starting with ddfb58932facd381fc415079117e6d43753a8137f61cd47075a60abcf3bb8769 not found: ID does not exist" containerID="ddfb58932facd381fc415079117e6d43753a8137f61cd47075a60abcf3bb8769" Mar 16 15:50:13 crc kubenswrapper[5120]: I0316 15:50:13.845141 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ddfb58932facd381fc415079117e6d43753a8137f61cd47075a60abcf3bb8769"} err="failed to get container status \"ddfb58932facd381fc415079117e6d43753a8137f61cd47075a60abcf3bb8769\": rpc error: code = NotFound desc = could not find container \"ddfb58932facd381fc415079117e6d43753a8137f61cd47075a60abcf3bb8769\": container with ID starting with ddfb58932facd381fc415079117e6d43753a8137f61cd47075a60abcf3bb8769 not found: ID does not exist" Mar 16 15:50:13 crc kubenswrapper[5120]: I0316 15:50:13.845166 5120 scope.go:117] "RemoveContainer" containerID="c08bd21cdf559fd8bd8dfde54dc018682d6bee5a6647b5bcd803c76a8384bb6f" Mar 16 15:50:13 crc kubenswrapper[5120]: E0316 15:50:13.845631 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c08bd21cdf559fd8bd8dfde54dc018682d6bee5a6647b5bcd803c76a8384bb6f\": container with ID starting with c08bd21cdf559fd8bd8dfde54dc018682d6bee5a6647b5bcd803c76a8384bb6f not found: ID does not exist" containerID="c08bd21cdf559fd8bd8dfde54dc018682d6bee5a6647b5bcd803c76a8384bb6f" Mar 16 15:50:13 crc kubenswrapper[5120]: I0316 15:50:13.845702 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c08bd21cdf559fd8bd8dfde54dc018682d6bee5a6647b5bcd803c76a8384bb6f"} err="failed to get container status \"c08bd21cdf559fd8bd8dfde54dc018682d6bee5a6647b5bcd803c76a8384bb6f\": rpc error: code = NotFound desc = could not find container \"c08bd21cdf559fd8bd8dfde54dc018682d6bee5a6647b5bcd803c76a8384bb6f\": container with ID starting with c08bd21cdf559fd8bd8dfde54dc018682d6bee5a6647b5bcd803c76a8384bb6f not found: ID does not exist" Mar 16 15:50:14 crc kubenswrapper[5120]: I0316 15:50:14.672808 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="66fbf6ad-9a00-472a-9848-6647d7eff53d" path="/var/lib/kubelet/pods/66fbf6ad-9a00-472a-9848-6647d7eff53d/volumes" Mar 16 15:50:15 crc kubenswrapper[5120]: I0316 15:50:15.225639 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-x2qcd" Mar 16 15:50:15 crc kubenswrapper[5120]: I0316 15:50:15.287672 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t76ll\" (UniqueName: \"kubernetes.io/projected/62a03637-2221-40d9-a921-f87cc0f5a487-kube-api-access-t76ll\") pod \"62a03637-2221-40d9-a921-f87cc0f5a487\" (UID: \"62a03637-2221-40d9-a921-f87cc0f5a487\") " Mar 16 15:50:15 crc kubenswrapper[5120]: I0316 15:50:15.287943 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/62a03637-2221-40d9-a921-f87cc0f5a487-config-data\") pod \"62a03637-2221-40d9-a921-f87cc0f5a487\" (UID: \"62a03637-2221-40d9-a921-f87cc0f5a487\") " Mar 16 15:50:15 crc kubenswrapper[5120]: I0316 15:50:15.287972 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/62a03637-2221-40d9-a921-f87cc0f5a487-combined-ca-bundle\") pod \"62a03637-2221-40d9-a921-f87cc0f5a487\" (UID: \"62a03637-2221-40d9-a921-f87cc0f5a487\") " Mar 16 15:50:15 crc kubenswrapper[5120]: I0316 15:50:15.293234 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62a03637-2221-40d9-a921-f87cc0f5a487-kube-api-access-t76ll" (OuterVolumeSpecName: "kube-api-access-t76ll") pod "62a03637-2221-40d9-a921-f87cc0f5a487" (UID: "62a03637-2221-40d9-a921-f87cc0f5a487"). InnerVolumeSpecName "kube-api-access-t76ll". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:50:15 crc kubenswrapper[5120]: I0316 15:50:15.315400 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/62a03637-2221-40d9-a921-f87cc0f5a487-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "62a03637-2221-40d9-a921-f87cc0f5a487" (UID: "62a03637-2221-40d9-a921-f87cc0f5a487"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:50:15 crc kubenswrapper[5120]: I0316 15:50:15.330090 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/62a03637-2221-40d9-a921-f87cc0f5a487-config-data" (OuterVolumeSpecName: "config-data") pod "62a03637-2221-40d9-a921-f87cc0f5a487" (UID: "62a03637-2221-40d9-a921-f87cc0f5a487"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:50:15 crc kubenswrapper[5120]: I0316 15:50:15.390135 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/62a03637-2221-40d9-a921-f87cc0f5a487-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 15:50:15 crc kubenswrapper[5120]: I0316 15:50:15.390168 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/62a03637-2221-40d9-a921-f87cc0f5a487-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:50:15 crc kubenswrapper[5120]: I0316 15:50:15.390179 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t76ll\" (UniqueName: \"kubernetes.io/projected/62a03637-2221-40d9-a921-f87cc0f5a487-kube-api-access-t76ll\") on node \"crc\" DevicePath \"\"" Mar 16 15:50:15 crc kubenswrapper[5120]: I0316 15:50:15.796636 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-x2qcd" Mar 16 15:50:15 crc kubenswrapper[5120]: I0316 15:50:15.796649 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-x2qcd" event={"ID":"62a03637-2221-40d9-a921-f87cc0f5a487","Type":"ContainerDied","Data":"8128de271c4ba4c414a7e145ffb2a0179534dac0f947f2aa37a5cb79a4ca5434"} Mar 16 15:50:15 crc kubenswrapper[5120]: I0316 15:50:15.796721 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8128de271c4ba4c414a7e145ffb2a0179534dac0f947f2aa37a5cb79a4ca5434" Mar 16 15:50:15 crc kubenswrapper[5120]: I0316 15:50:15.909292 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-zmppx"] Mar 16 15:50:15 crc kubenswrapper[5120]: I0316 15:50:15.910194 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66fbf6ad-9a00-472a-9848-6647d7eff53d" containerName="init" Mar 16 15:50:15 crc kubenswrapper[5120]: I0316 15:50:15.910211 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="66fbf6ad-9a00-472a-9848-6647d7eff53d" containerName="init" Mar 16 15:50:15 crc kubenswrapper[5120]: I0316 15:50:15.910221 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62a03637-2221-40d9-a921-f87cc0f5a487" containerName="keystone-db-sync" Mar 16 15:50:15 crc kubenswrapper[5120]: I0316 15:50:15.910228 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="62a03637-2221-40d9-a921-f87cc0f5a487" containerName="keystone-db-sync" Mar 16 15:50:15 crc kubenswrapper[5120]: I0316 15:50:15.910238 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57766802-1c47-4741-850a-82f768369d23" containerName="mariadb-account-create-update" Mar 16 15:50:15 crc kubenswrapper[5120]: I0316 15:50:15.910244 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="57766802-1c47-4741-850a-82f768369d23" containerName="mariadb-account-create-update" Mar 16 15:50:15 crc kubenswrapper[5120]: I0316 15:50:15.910256 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="afd7061f-762c-4876-986c-64076eda9b0f" containerName="mariadb-account-create-update" Mar 16 15:50:15 crc kubenswrapper[5120]: I0316 15:50:15.910262 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="afd7061f-762c-4876-986c-64076eda9b0f" containerName="mariadb-account-create-update" Mar 16 15:50:15 crc kubenswrapper[5120]: I0316 15:50:15.910270 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66fbf6ad-9a00-472a-9848-6647d7eff53d" containerName="dnsmasq-dns" Mar 16 15:50:15 crc kubenswrapper[5120]: I0316 15:50:15.910275 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="66fbf6ad-9a00-472a-9848-6647d7eff53d" containerName="dnsmasq-dns" Mar 16 15:50:15 crc kubenswrapper[5120]: I0316 15:50:15.910300 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cbc99c4f-184e-4c10-9e60-9a981761ecf2" containerName="mariadb-database-create" Mar 16 15:50:15 crc kubenswrapper[5120]: I0316 15:50:15.910307 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="cbc99c4f-184e-4c10-9e60-9a981761ecf2" containerName="mariadb-database-create" Mar 16 15:50:15 crc kubenswrapper[5120]: I0316 15:50:15.910331 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c96ec30-a61d-4920-b08d-06fd9c5c538c" containerName="mariadb-database-create" Mar 16 15:50:15 crc kubenswrapper[5120]: I0316 15:50:15.910336 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c96ec30-a61d-4920-b08d-06fd9c5c538c" containerName="mariadb-database-create" Mar 16 15:50:15 crc kubenswrapper[5120]: I0316 15:50:15.910346 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e43da138-d989-4c49-aeea-5a251a21f2d4" containerName="glance-db-sync" Mar 16 15:50:15 crc kubenswrapper[5120]: I0316 15:50:15.910352 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e43da138-d989-4c49-aeea-5a251a21f2d4" containerName="glance-db-sync" Mar 16 15:50:15 crc kubenswrapper[5120]: I0316 15:50:15.910361 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="110f0814-5d86-4605-aa7c-3d0687c4af18" containerName="oc" Mar 16 15:50:15 crc kubenswrapper[5120]: I0316 15:50:15.910366 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="110f0814-5d86-4605-aa7c-3d0687c4af18" containerName="oc" Mar 16 15:50:15 crc kubenswrapper[5120]: I0316 15:50:15.910376 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ab9ab45-8904-421a-a38b-8fbd13cf84a6" containerName="mariadb-account-create-update" Mar 16 15:50:15 crc kubenswrapper[5120]: I0316 15:50:15.910383 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ab9ab45-8904-421a-a38b-8fbd13cf84a6" containerName="mariadb-account-create-update" Mar 16 15:50:15 crc kubenswrapper[5120]: I0316 15:50:15.910400 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7b4af2e-c6d2-4479-a926-27a52b3a973e" containerName="mariadb-database-create" Mar 16 15:50:15 crc kubenswrapper[5120]: I0316 15:50:15.910405 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7b4af2e-c6d2-4479-a926-27a52b3a973e" containerName="mariadb-database-create" Mar 16 15:50:15 crc kubenswrapper[5120]: I0316 15:50:15.910565 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e43da138-d989-4c49-aeea-5a251a21f2d4" containerName="glance-db-sync" Mar 16 15:50:15 crc kubenswrapper[5120]: I0316 15:50:15.910578 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c7b4af2e-c6d2-4479-a926-27a52b3a973e" containerName="mariadb-database-create" Mar 16 15:50:15 crc kubenswrapper[5120]: I0316 15:50:15.910587 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="cbc99c4f-184e-4c10-9e60-9a981761ecf2" containerName="mariadb-database-create" Mar 16 15:50:15 crc kubenswrapper[5120]: I0316 15:50:15.910594 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="110f0814-5d86-4605-aa7c-3d0687c4af18" containerName="oc" Mar 16 15:50:15 crc kubenswrapper[5120]: I0316 15:50:15.910601 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="57766802-1c47-4741-850a-82f768369d23" containerName="mariadb-account-create-update" Mar 16 15:50:15 crc kubenswrapper[5120]: I0316 15:50:15.910608 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1c96ec30-a61d-4920-b08d-06fd9c5c538c" containerName="mariadb-database-create" Mar 16 15:50:15 crc kubenswrapper[5120]: I0316 15:50:15.910619 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="62a03637-2221-40d9-a921-f87cc0f5a487" containerName="keystone-db-sync" Mar 16 15:50:15 crc kubenswrapper[5120]: I0316 15:50:15.910629 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="afd7061f-762c-4876-986c-64076eda9b0f" containerName="mariadb-account-create-update" Mar 16 15:50:15 crc kubenswrapper[5120]: I0316 15:50:15.910636 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="3ab9ab45-8904-421a-a38b-8fbd13cf84a6" containerName="mariadb-account-create-update" Mar 16 15:50:15 crc kubenswrapper[5120]: I0316 15:50:15.910642 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="66fbf6ad-9a00-472a-9848-6647d7eff53d" containerName="dnsmasq-dns" Mar 16 15:50:15 crc kubenswrapper[5120]: I0316 15:50:15.921405 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-zmppx" Mar 16 15:50:15 crc kubenswrapper[5120]: I0316 15:50:15.924569 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-keystone-dockercfg-qznbk\"" Mar 16 15:50:15 crc kubenswrapper[5120]: I0316 15:50:15.924712 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"osp-secret\"" Mar 16 15:50:15 crc kubenswrapper[5120]: I0316 15:50:15.924999 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-scripts\"" Mar 16 15:50:15 crc kubenswrapper[5120]: I0316 15:50:15.925158 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone\"" Mar 16 15:50:15 crc kubenswrapper[5120]: I0316 15:50:15.925249 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-config-data\"" Mar 16 15:50:15 crc kubenswrapper[5120]: I0316 15:50:15.935141 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-zmppx"] Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.002352 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/68a56393-5c21-48ab-823f-ce9d1d4cf16b-fernet-keys\") pod \"keystone-bootstrap-zmppx\" (UID: \"68a56393-5c21-48ab-823f-ce9d1d4cf16b\") " pod="openstack-kuttl-tests/keystone-bootstrap-zmppx" Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.002411 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/68a56393-5c21-48ab-823f-ce9d1d4cf16b-scripts\") pod \"keystone-bootstrap-zmppx\" (UID: \"68a56393-5c21-48ab-823f-ce9d1d4cf16b\") " pod="openstack-kuttl-tests/keystone-bootstrap-zmppx" Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.002530 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/68a56393-5c21-48ab-823f-ce9d1d4cf16b-credential-keys\") pod \"keystone-bootstrap-zmppx\" (UID: \"68a56393-5c21-48ab-823f-ce9d1d4cf16b\") " pod="openstack-kuttl-tests/keystone-bootstrap-zmppx" Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.002853 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xz4jq\" (UniqueName: \"kubernetes.io/projected/68a56393-5c21-48ab-823f-ce9d1d4cf16b-kube-api-access-xz4jq\") pod \"keystone-bootstrap-zmppx\" (UID: \"68a56393-5c21-48ab-823f-ce9d1d4cf16b\") " pod="openstack-kuttl-tests/keystone-bootstrap-zmppx" Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.002951 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/68a56393-5c21-48ab-823f-ce9d1d4cf16b-combined-ca-bundle\") pod \"keystone-bootstrap-zmppx\" (UID: \"68a56393-5c21-48ab-823f-ce9d1d4cf16b\") " pod="openstack-kuttl-tests/keystone-bootstrap-zmppx" Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.002985 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/68a56393-5c21-48ab-823f-ce9d1d4cf16b-config-data\") pod \"keystone-bootstrap-zmppx\" (UID: \"68a56393-5c21-48ab-823f-ce9d1d4cf16b\") " pod="openstack-kuttl-tests/keystone-bootstrap-zmppx" Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.059810 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-gwbbm"] Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.070875 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-gwbbm" Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.072889 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-cinder-dockercfg-sn6m9\"" Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.073423 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-config-data\"" Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.074018 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-scripts\"" Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.076266 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-gwbbm"] Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.110803 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xz4jq\" (UniqueName: \"kubernetes.io/projected/68a56393-5c21-48ab-823f-ce9d1d4cf16b-kube-api-access-xz4jq\") pod \"keystone-bootstrap-zmppx\" (UID: \"68a56393-5c21-48ab-823f-ce9d1d4cf16b\") " pod="openstack-kuttl-tests/keystone-bootstrap-zmppx" Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.111052 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/68a56393-5c21-48ab-823f-ce9d1d4cf16b-combined-ca-bundle\") pod \"keystone-bootstrap-zmppx\" (UID: \"68a56393-5c21-48ab-823f-ce9d1d4cf16b\") " pod="openstack-kuttl-tests/keystone-bootstrap-zmppx" Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.111129 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/68a56393-5c21-48ab-823f-ce9d1d4cf16b-config-data\") pod \"keystone-bootstrap-zmppx\" (UID: \"68a56393-5c21-48ab-823f-ce9d1d4cf16b\") " pod="openstack-kuttl-tests/keystone-bootstrap-zmppx" Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.111222 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/68a56393-5c21-48ab-823f-ce9d1d4cf16b-fernet-keys\") pod \"keystone-bootstrap-zmppx\" (UID: \"68a56393-5c21-48ab-823f-ce9d1d4cf16b\") " pod="openstack-kuttl-tests/keystone-bootstrap-zmppx" Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.111305 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/68a56393-5c21-48ab-823f-ce9d1d4cf16b-scripts\") pod \"keystone-bootstrap-zmppx\" (UID: \"68a56393-5c21-48ab-823f-ce9d1d4cf16b\") " pod="openstack-kuttl-tests/keystone-bootstrap-zmppx" Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.111389 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/68a56393-5c21-48ab-823f-ce9d1d4cf16b-credential-keys\") pod \"keystone-bootstrap-zmppx\" (UID: \"68a56393-5c21-48ab-823f-ce9d1d4cf16b\") " pod="openstack-kuttl-tests/keystone-bootstrap-zmppx" Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.117511 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/68a56393-5c21-48ab-823f-ce9d1d4cf16b-scripts\") pod \"keystone-bootstrap-zmppx\" (UID: \"68a56393-5c21-48ab-823f-ce9d1d4cf16b\") " pod="openstack-kuttl-tests/keystone-bootstrap-zmppx" Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.118783 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/68a56393-5c21-48ab-823f-ce9d1d4cf16b-config-data\") pod \"keystone-bootstrap-zmppx\" (UID: \"68a56393-5c21-48ab-823f-ce9d1d4cf16b\") " pod="openstack-kuttl-tests/keystone-bootstrap-zmppx" Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.120453 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/68a56393-5c21-48ab-823f-ce9d1d4cf16b-fernet-keys\") pod \"keystone-bootstrap-zmppx\" (UID: \"68a56393-5c21-48ab-823f-ce9d1d4cf16b\") " pod="openstack-kuttl-tests/keystone-bootstrap-zmppx" Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.122384 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/68a56393-5c21-48ab-823f-ce9d1d4cf16b-combined-ca-bundle\") pod \"keystone-bootstrap-zmppx\" (UID: \"68a56393-5c21-48ab-823f-ce9d1d4cf16b\") " pod="openstack-kuttl-tests/keystone-bootstrap-zmppx" Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.129308 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/68a56393-5c21-48ab-823f-ce9d1d4cf16b-credential-keys\") pod \"keystone-bootstrap-zmppx\" (UID: \"68a56393-5c21-48ab-823f-ce9d1d4cf16b\") " pod="openstack-kuttl-tests/keystone-bootstrap-zmppx" Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.141437 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xz4jq\" (UniqueName: \"kubernetes.io/projected/68a56393-5c21-48ab-823f-ce9d1d4cf16b-kube-api-access-xz4jq\") pod \"keystone-bootstrap-zmppx\" (UID: \"68a56393-5c21-48ab-823f-ce9d1d4cf16b\") " pod="openstack-kuttl-tests/keystone-bootstrap-zmppx" Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.151846 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.172920 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.177397 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.178536 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.179717 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-5h8xf"] Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.184875 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-5h8xf" Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.188878 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.194391 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-barbican-dockercfg-2gqvh\"" Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.194633 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-config-data\"" Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.196105 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-5h8xf"] Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.204900 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-htm2c"] Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.212715 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2r6j8\" (UniqueName: \"kubernetes.io/projected/2645c221-c2bd-4cd3-a073-9396a5a87708-kube-api-access-2r6j8\") pod \"cinder-db-sync-gwbbm\" (UID: \"2645c221-c2bd-4cd3-a073-9396a5a87708\") " pod="openstack-kuttl-tests/cinder-db-sync-gwbbm" Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.212798 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/2645c221-c2bd-4cd3-a073-9396a5a87708-etc-machine-id\") pod \"cinder-db-sync-gwbbm\" (UID: \"2645c221-c2bd-4cd3-a073-9396a5a87708\") " pod="openstack-kuttl-tests/cinder-db-sync-gwbbm" Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.212850 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/2645c221-c2bd-4cd3-a073-9396a5a87708-db-sync-config-data\") pod \"cinder-db-sync-gwbbm\" (UID: \"2645c221-c2bd-4cd3-a073-9396a5a87708\") " pod="openstack-kuttl-tests/cinder-db-sync-gwbbm" Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.212870 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2645c221-c2bd-4cd3-a073-9396a5a87708-scripts\") pod \"cinder-db-sync-gwbbm\" (UID: \"2645c221-c2bd-4cd3-a073-9396a5a87708\") " pod="openstack-kuttl-tests/cinder-db-sync-gwbbm" Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.212891 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2645c221-c2bd-4cd3-a073-9396a5a87708-config-data\") pod \"cinder-db-sync-gwbbm\" (UID: \"2645c221-c2bd-4cd3-a073-9396a5a87708\") " pod="openstack-kuttl-tests/cinder-db-sync-gwbbm" Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.212920 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2645c221-c2bd-4cd3-a073-9396a5a87708-combined-ca-bundle\") pod \"cinder-db-sync-gwbbm\" (UID: \"2645c221-c2bd-4cd3-a073-9396a5a87708\") " pod="openstack-kuttl-tests/cinder-db-sync-gwbbm" Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.213245 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-htm2c" Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.223519 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-httpd-config\"" Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.223856 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-neutron-dockercfg-7mftq\"" Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.223978 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-config\"" Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.234197 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-htm2c"] Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.241391 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-db-sync-h77sx"] Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.251195 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-zmppx" Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.256190 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-h77sx"] Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.256321 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-h77sx" Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.259393 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-scripts\"" Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.259611 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-placement-dockercfg-wbfvm\"" Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.266231 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-config-data\"" Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.315576 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rf5j9\" (UniqueName: \"kubernetes.io/projected/d16cf6e5-1b2b-41b7-9a80-070f44bc9a67-kube-api-access-rf5j9\") pod \"placement-db-sync-h77sx\" (UID: \"d16cf6e5-1b2b-41b7-9a80-070f44bc9a67\") " pod="openstack-kuttl-tests/placement-db-sync-h77sx" Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.315621 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/2b8e2567-77a1-4c2c-930c-785714326aba-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"2b8e2567-77a1-4c2c-930c-785714326aba\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.315663 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/e8b7845d-53d2-4fc9-af50-91a65dc3e247-db-sync-config-data\") pod \"barbican-db-sync-5h8xf\" (UID: \"e8b7845d-53d2-4fc9-af50-91a65dc3e247\") " pod="openstack-kuttl-tests/barbican-db-sync-5h8xf" Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.315691 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2b8e2567-77a1-4c2c-930c-785714326aba-config-data\") pod \"ceilometer-0\" (UID: \"2b8e2567-77a1-4c2c-930c-785714326aba\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.315723 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/2645c221-c2bd-4cd3-a073-9396a5a87708-db-sync-config-data\") pod \"cinder-db-sync-gwbbm\" (UID: \"2645c221-c2bd-4cd3-a073-9396a5a87708\") " pod="openstack-kuttl-tests/cinder-db-sync-gwbbm" Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.315827 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2645c221-c2bd-4cd3-a073-9396a5a87708-scripts\") pod \"cinder-db-sync-gwbbm\" (UID: \"2645c221-c2bd-4cd3-a073-9396a5a87708\") " pod="openstack-kuttl-tests/cinder-db-sync-gwbbm" Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.315890 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2645c221-c2bd-4cd3-a073-9396a5a87708-config-data\") pod \"cinder-db-sync-gwbbm\" (UID: \"2645c221-c2bd-4cd3-a073-9396a5a87708\") " pod="openstack-kuttl-tests/cinder-db-sync-gwbbm" Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.315931 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4e0214f5-7d2d-4b88-8096-a14ac906d637-config\") pod \"neutron-db-sync-htm2c\" (UID: \"4e0214f5-7d2d-4b88-8096-a14ac906d637\") " pod="openstack-kuttl-tests/neutron-db-sync-htm2c" Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.315957 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e8b7845d-53d2-4fc9-af50-91a65dc3e247-combined-ca-bundle\") pod \"barbican-db-sync-5h8xf\" (UID: \"e8b7845d-53d2-4fc9-af50-91a65dc3e247\") " pod="openstack-kuttl-tests/barbican-db-sync-5h8xf" Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.315991 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2645c221-c2bd-4cd3-a073-9396a5a87708-combined-ca-bundle\") pod \"cinder-db-sync-gwbbm\" (UID: \"2645c221-c2bd-4cd3-a073-9396a5a87708\") " pod="openstack-kuttl-tests/cinder-db-sync-gwbbm" Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.316034 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d16cf6e5-1b2b-41b7-9a80-070f44bc9a67-combined-ca-bundle\") pod \"placement-db-sync-h77sx\" (UID: \"d16cf6e5-1b2b-41b7-9a80-070f44bc9a67\") " pod="openstack-kuttl-tests/placement-db-sync-h77sx" Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.316120 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2b8e2567-77a1-4c2c-930c-785714326aba-run-httpd\") pod \"ceilometer-0\" (UID: \"2b8e2567-77a1-4c2c-930c-785714326aba\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.316173 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2r6j8\" (UniqueName: \"kubernetes.io/projected/2645c221-c2bd-4cd3-a073-9396a5a87708-kube-api-access-2r6j8\") pod \"cinder-db-sync-gwbbm\" (UID: \"2645c221-c2bd-4cd3-a073-9396a5a87708\") " pod="openstack-kuttl-tests/cinder-db-sync-gwbbm" Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.316190 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2b8e2567-77a1-4c2c-930c-785714326aba-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"2b8e2567-77a1-4c2c-930c-785714326aba\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.316216 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d16cf6e5-1b2b-41b7-9a80-070f44bc9a67-config-data\") pod \"placement-db-sync-h77sx\" (UID: \"d16cf6e5-1b2b-41b7-9a80-070f44bc9a67\") " pod="openstack-kuttl-tests/placement-db-sync-h77sx" Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.316244 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d16cf6e5-1b2b-41b7-9a80-070f44bc9a67-logs\") pod \"placement-db-sync-h77sx\" (UID: \"d16cf6e5-1b2b-41b7-9a80-070f44bc9a67\") " pod="openstack-kuttl-tests/placement-db-sync-h77sx" Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.316265 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d16cf6e5-1b2b-41b7-9a80-070f44bc9a67-scripts\") pod \"placement-db-sync-h77sx\" (UID: \"d16cf6e5-1b2b-41b7-9a80-070f44bc9a67\") " pod="openstack-kuttl-tests/placement-db-sync-h77sx" Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.316311 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4e0214f5-7d2d-4b88-8096-a14ac906d637-combined-ca-bundle\") pod \"neutron-db-sync-htm2c\" (UID: \"4e0214f5-7d2d-4b88-8096-a14ac906d637\") " pod="openstack-kuttl-tests/neutron-db-sync-htm2c" Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.316485 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2b8e2567-77a1-4c2c-930c-785714326aba-scripts\") pod \"ceilometer-0\" (UID: \"2b8e2567-77a1-4c2c-930c-785714326aba\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.316568 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/2645c221-c2bd-4cd3-a073-9396a5a87708-etc-machine-id\") pod \"cinder-db-sync-gwbbm\" (UID: \"2645c221-c2bd-4cd3-a073-9396a5a87708\") " pod="openstack-kuttl-tests/cinder-db-sync-gwbbm" Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.316613 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trqhp\" (UniqueName: \"kubernetes.io/projected/e8b7845d-53d2-4fc9-af50-91a65dc3e247-kube-api-access-trqhp\") pod \"barbican-db-sync-5h8xf\" (UID: \"e8b7845d-53d2-4fc9-af50-91a65dc3e247\") " pod="openstack-kuttl-tests/barbican-db-sync-5h8xf" Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.316658 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2b8e2567-77a1-4c2c-930c-785714326aba-log-httpd\") pod \"ceilometer-0\" (UID: \"2b8e2567-77a1-4c2c-930c-785714326aba\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.316721 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bbhx\" (UniqueName: \"kubernetes.io/projected/2b8e2567-77a1-4c2c-930c-785714326aba-kube-api-access-5bbhx\") pod \"ceilometer-0\" (UID: \"2b8e2567-77a1-4c2c-930c-785714326aba\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.316742 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqkxg\" (UniqueName: \"kubernetes.io/projected/4e0214f5-7d2d-4b88-8096-a14ac906d637-kube-api-access-pqkxg\") pod \"neutron-db-sync-htm2c\" (UID: \"4e0214f5-7d2d-4b88-8096-a14ac906d637\") " pod="openstack-kuttl-tests/neutron-db-sync-htm2c" Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.316986 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/2645c221-c2bd-4cd3-a073-9396a5a87708-etc-machine-id\") pod \"cinder-db-sync-gwbbm\" (UID: \"2645c221-c2bd-4cd3-a073-9396a5a87708\") " pod="openstack-kuttl-tests/cinder-db-sync-gwbbm" Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.320332 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2645c221-c2bd-4cd3-a073-9396a5a87708-config-data\") pod \"cinder-db-sync-gwbbm\" (UID: \"2645c221-c2bd-4cd3-a073-9396a5a87708\") " pod="openstack-kuttl-tests/cinder-db-sync-gwbbm" Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.323258 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2645c221-c2bd-4cd3-a073-9396a5a87708-scripts\") pod \"cinder-db-sync-gwbbm\" (UID: \"2645c221-c2bd-4cd3-a073-9396a5a87708\") " pod="openstack-kuttl-tests/cinder-db-sync-gwbbm" Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.323791 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/2645c221-c2bd-4cd3-a073-9396a5a87708-db-sync-config-data\") pod \"cinder-db-sync-gwbbm\" (UID: \"2645c221-c2bd-4cd3-a073-9396a5a87708\") " pod="openstack-kuttl-tests/cinder-db-sync-gwbbm" Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.334993 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2645c221-c2bd-4cd3-a073-9396a5a87708-combined-ca-bundle\") pod \"cinder-db-sync-gwbbm\" (UID: \"2645c221-c2bd-4cd3-a073-9396a5a87708\") " pod="openstack-kuttl-tests/cinder-db-sync-gwbbm" Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.337715 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2r6j8\" (UniqueName: \"kubernetes.io/projected/2645c221-c2bd-4cd3-a073-9396a5a87708-kube-api-access-2r6j8\") pod \"cinder-db-sync-gwbbm\" (UID: \"2645c221-c2bd-4cd3-a073-9396a5a87708\") " pod="openstack-kuttl-tests/cinder-db-sync-gwbbm" Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.385627 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-gwbbm" Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.419259 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d16cf6e5-1b2b-41b7-9a80-070f44bc9a67-combined-ca-bundle\") pod \"placement-db-sync-h77sx\" (UID: \"d16cf6e5-1b2b-41b7-9a80-070f44bc9a67\") " pod="openstack-kuttl-tests/placement-db-sync-h77sx" Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.419360 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2b8e2567-77a1-4c2c-930c-785714326aba-run-httpd\") pod \"ceilometer-0\" (UID: \"2b8e2567-77a1-4c2c-930c-785714326aba\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.419418 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2b8e2567-77a1-4c2c-930c-785714326aba-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"2b8e2567-77a1-4c2c-930c-785714326aba\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.419446 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d16cf6e5-1b2b-41b7-9a80-070f44bc9a67-config-data\") pod \"placement-db-sync-h77sx\" (UID: \"d16cf6e5-1b2b-41b7-9a80-070f44bc9a67\") " pod="openstack-kuttl-tests/placement-db-sync-h77sx" Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.419494 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d16cf6e5-1b2b-41b7-9a80-070f44bc9a67-logs\") pod \"placement-db-sync-h77sx\" (UID: \"d16cf6e5-1b2b-41b7-9a80-070f44bc9a67\") " pod="openstack-kuttl-tests/placement-db-sync-h77sx" Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.419517 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d16cf6e5-1b2b-41b7-9a80-070f44bc9a67-scripts\") pod \"placement-db-sync-h77sx\" (UID: \"d16cf6e5-1b2b-41b7-9a80-070f44bc9a67\") " pod="openstack-kuttl-tests/placement-db-sync-h77sx" Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.420145 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4e0214f5-7d2d-4b88-8096-a14ac906d637-combined-ca-bundle\") pod \"neutron-db-sync-htm2c\" (UID: \"4e0214f5-7d2d-4b88-8096-a14ac906d637\") " pod="openstack-kuttl-tests/neutron-db-sync-htm2c" Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.420220 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2b8e2567-77a1-4c2c-930c-785714326aba-scripts\") pod \"ceilometer-0\" (UID: \"2b8e2567-77a1-4c2c-930c-785714326aba\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.420257 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-trqhp\" (UniqueName: \"kubernetes.io/projected/e8b7845d-53d2-4fc9-af50-91a65dc3e247-kube-api-access-trqhp\") pod \"barbican-db-sync-5h8xf\" (UID: \"e8b7845d-53d2-4fc9-af50-91a65dc3e247\") " pod="openstack-kuttl-tests/barbican-db-sync-5h8xf" Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.420309 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2b8e2567-77a1-4c2c-930c-785714326aba-log-httpd\") pod \"ceilometer-0\" (UID: \"2b8e2567-77a1-4c2c-930c-785714326aba\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.420362 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5bbhx\" (UniqueName: \"kubernetes.io/projected/2b8e2567-77a1-4c2c-930c-785714326aba-kube-api-access-5bbhx\") pod \"ceilometer-0\" (UID: \"2b8e2567-77a1-4c2c-930c-785714326aba\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.420384 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pqkxg\" (UniqueName: \"kubernetes.io/projected/4e0214f5-7d2d-4b88-8096-a14ac906d637-kube-api-access-pqkxg\") pod \"neutron-db-sync-htm2c\" (UID: \"4e0214f5-7d2d-4b88-8096-a14ac906d637\") " pod="openstack-kuttl-tests/neutron-db-sync-htm2c" Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.420435 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rf5j9\" (UniqueName: \"kubernetes.io/projected/d16cf6e5-1b2b-41b7-9a80-070f44bc9a67-kube-api-access-rf5j9\") pod \"placement-db-sync-h77sx\" (UID: \"d16cf6e5-1b2b-41b7-9a80-070f44bc9a67\") " pod="openstack-kuttl-tests/placement-db-sync-h77sx" Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.420454 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/2b8e2567-77a1-4c2c-930c-785714326aba-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"2b8e2567-77a1-4c2c-930c-785714326aba\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.420487 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/e8b7845d-53d2-4fc9-af50-91a65dc3e247-db-sync-config-data\") pod \"barbican-db-sync-5h8xf\" (UID: \"e8b7845d-53d2-4fc9-af50-91a65dc3e247\") " pod="openstack-kuttl-tests/barbican-db-sync-5h8xf" Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.420533 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2b8e2567-77a1-4c2c-930c-785714326aba-config-data\") pod \"ceilometer-0\" (UID: \"2b8e2567-77a1-4c2c-930c-785714326aba\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.420633 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4e0214f5-7d2d-4b88-8096-a14ac906d637-config\") pod \"neutron-db-sync-htm2c\" (UID: \"4e0214f5-7d2d-4b88-8096-a14ac906d637\") " pod="openstack-kuttl-tests/neutron-db-sync-htm2c" Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.420682 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e8b7845d-53d2-4fc9-af50-91a65dc3e247-combined-ca-bundle\") pod \"barbican-db-sync-5h8xf\" (UID: \"e8b7845d-53d2-4fc9-af50-91a65dc3e247\") " pod="openstack-kuttl-tests/barbican-db-sync-5h8xf" Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.421531 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d16cf6e5-1b2b-41b7-9a80-070f44bc9a67-logs\") pod \"placement-db-sync-h77sx\" (UID: \"d16cf6e5-1b2b-41b7-9a80-070f44bc9a67\") " pod="openstack-kuttl-tests/placement-db-sync-h77sx" Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.422457 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2b8e2567-77a1-4c2c-930c-785714326aba-run-httpd\") pod \"ceilometer-0\" (UID: \"2b8e2567-77a1-4c2c-930c-785714326aba\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.425261 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2b8e2567-77a1-4c2c-930c-785714326aba-log-httpd\") pod \"ceilometer-0\" (UID: \"2b8e2567-77a1-4c2c-930c-785714326aba\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.431888 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/2b8e2567-77a1-4c2c-930c-785714326aba-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"2b8e2567-77a1-4c2c-930c-785714326aba\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.433559 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d16cf6e5-1b2b-41b7-9a80-070f44bc9a67-combined-ca-bundle\") pod \"placement-db-sync-h77sx\" (UID: \"d16cf6e5-1b2b-41b7-9a80-070f44bc9a67\") " pod="openstack-kuttl-tests/placement-db-sync-h77sx" Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.437571 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/e8b7845d-53d2-4fc9-af50-91a65dc3e247-db-sync-config-data\") pod \"barbican-db-sync-5h8xf\" (UID: \"e8b7845d-53d2-4fc9-af50-91a65dc3e247\") " pod="openstack-kuttl-tests/barbican-db-sync-5h8xf" Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.437838 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/4e0214f5-7d2d-4b88-8096-a14ac906d637-config\") pod \"neutron-db-sync-htm2c\" (UID: \"4e0214f5-7d2d-4b88-8096-a14ac906d637\") " pod="openstack-kuttl-tests/neutron-db-sync-htm2c" Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.438631 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e8b7845d-53d2-4fc9-af50-91a65dc3e247-combined-ca-bundle\") pod \"barbican-db-sync-5h8xf\" (UID: \"e8b7845d-53d2-4fc9-af50-91a65dc3e247\") " pod="openstack-kuttl-tests/barbican-db-sync-5h8xf" Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.438953 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2b8e2567-77a1-4c2c-930c-785714326aba-scripts\") pod \"ceilometer-0\" (UID: \"2b8e2567-77a1-4c2c-930c-785714326aba\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.441045 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2b8e2567-77a1-4c2c-930c-785714326aba-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"2b8e2567-77a1-4c2c-930c-785714326aba\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.446708 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-trqhp\" (UniqueName: \"kubernetes.io/projected/e8b7845d-53d2-4fc9-af50-91a65dc3e247-kube-api-access-trqhp\") pod \"barbican-db-sync-5h8xf\" (UID: \"e8b7845d-53d2-4fc9-af50-91a65dc3e247\") " pod="openstack-kuttl-tests/barbican-db-sync-5h8xf" Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.455206 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d16cf6e5-1b2b-41b7-9a80-070f44bc9a67-scripts\") pod \"placement-db-sync-h77sx\" (UID: \"d16cf6e5-1b2b-41b7-9a80-070f44bc9a67\") " pod="openstack-kuttl-tests/placement-db-sync-h77sx" Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.456155 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rf5j9\" (UniqueName: \"kubernetes.io/projected/d16cf6e5-1b2b-41b7-9a80-070f44bc9a67-kube-api-access-rf5j9\") pod \"placement-db-sync-h77sx\" (UID: \"d16cf6e5-1b2b-41b7-9a80-070f44bc9a67\") " pod="openstack-kuttl-tests/placement-db-sync-h77sx" Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.456414 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4e0214f5-7d2d-4b88-8096-a14ac906d637-combined-ca-bundle\") pod \"neutron-db-sync-htm2c\" (UID: \"4e0214f5-7d2d-4b88-8096-a14ac906d637\") " pod="openstack-kuttl-tests/neutron-db-sync-htm2c" Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.456913 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d16cf6e5-1b2b-41b7-9a80-070f44bc9a67-config-data\") pod \"placement-db-sync-h77sx\" (UID: \"d16cf6e5-1b2b-41b7-9a80-070f44bc9a67\") " pod="openstack-kuttl-tests/placement-db-sync-h77sx" Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.457804 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2b8e2567-77a1-4c2c-930c-785714326aba-config-data\") pod \"ceilometer-0\" (UID: \"2b8e2567-77a1-4c2c-930c-785714326aba\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.458187 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bbhx\" (UniqueName: \"kubernetes.io/projected/2b8e2567-77a1-4c2c-930c-785714326aba-kube-api-access-5bbhx\") pod \"ceilometer-0\" (UID: \"2b8e2567-77a1-4c2c-930c-785714326aba\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.467317 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqkxg\" (UniqueName: \"kubernetes.io/projected/4e0214f5-7d2d-4b88-8096-a14ac906d637-kube-api-access-pqkxg\") pod \"neutron-db-sync-htm2c\" (UID: \"4e0214f5-7d2d-4b88-8096-a14ac906d637\") " pod="openstack-kuttl-tests/neutron-db-sync-htm2c" Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.536363 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.552219 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-5h8xf" Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.573915 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-htm2c" Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.695801 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-h77sx" Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.754032 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-zmppx"] Mar 16 15:50:16 crc kubenswrapper[5120]: I0316 15:50:16.874697 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-gwbbm"] Mar 16 15:50:16 crc kubenswrapper[5120]: W0316 15:50:16.880084 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2645c221_c2bd_4cd3_a073_9396a5a87708.slice/crio-f1222a794831eb4415f46058f97def84b0e90d3811f6fe6528c9248213efe52f WatchSource:0}: Error finding container f1222a794831eb4415f46058f97def84b0e90d3811f6fe6528c9248213efe52f: Status 404 returned error can't find the container with id f1222a794831eb4415f46058f97def84b0e90d3811f6fe6528c9248213efe52f Mar 16 15:50:17 crc kubenswrapper[5120]: I0316 15:50:17.024898 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 15:50:17 crc kubenswrapper[5120]: I0316 15:50:17.033636 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:50:17 crc kubenswrapper[5120]: I0316 15:50:17.038944 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-public-svc\"" Mar 16 15:50:17 crc kubenswrapper[5120]: I0316 15:50:17.039075 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-scripts\"" Mar 16 15:50:17 crc kubenswrapper[5120]: I0316 15:50:17.039497 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-glance-dockercfg-478kn\"" Mar 16 15:50:17 crc kubenswrapper[5120]: I0316 15:50:17.039546 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-external-config-data\"" Mar 16 15:50:17 crc kubenswrapper[5120]: I0316 15:50:17.057487 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 15:50:17 crc kubenswrapper[5120]: I0316 15:50:17.094886 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-5h8xf"] Mar 16 15:50:17 crc kubenswrapper[5120]: I0316 15:50:17.102616 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 15:50:17 crc kubenswrapper[5120]: I0316 15:50:17.108324 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:50:17 crc kubenswrapper[5120]: I0316 15:50:17.114822 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-internal-config-data\"" Mar 16 15:50:17 crc kubenswrapper[5120]: I0316 15:50:17.115053 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-internal-svc\"" Mar 16 15:50:17 crc kubenswrapper[5120]: I0316 15:50:17.117716 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 15:50:17 crc kubenswrapper[5120]: W0316 15:50:17.118171 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2b8e2567_77a1_4c2c_930c_785714326aba.slice/crio-245402bd3d05a97af2c8fb4d974641ae742622d5c6782e77b843e77200e09aa3 WatchSource:0}: Error finding container 245402bd3d05a97af2c8fb4d974641ae742622d5c6782e77b843e77200e09aa3: Status 404 returned error can't find the container with id 245402bd3d05a97af2c8fb4d974641ae742622d5c6782e77b843e77200e09aa3 Mar 16 15:50:17 crc kubenswrapper[5120]: I0316 15:50:17.128541 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 15:50:17 crc kubenswrapper[5120]: I0316 15:50:17.142554 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/ec70b355-598e-40e4-ad36-c95b55db57d1-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"ec70b355-598e-40e4-ad36-c95b55db57d1\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:50:17 crc kubenswrapper[5120]: I0316 15:50:17.142746 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"glance-default-external-api-0\" (UID: \"ec70b355-598e-40e4-ad36-c95b55db57d1\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:50:17 crc kubenswrapper[5120]: I0316 15:50:17.142854 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6kkx\" (UniqueName: \"kubernetes.io/projected/ec70b355-598e-40e4-ad36-c95b55db57d1-kube-api-access-s6kkx\") pod \"glance-default-external-api-0\" (UID: \"ec70b355-598e-40e4-ad36-c95b55db57d1\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:50:17 crc kubenswrapper[5120]: I0316 15:50:17.142893 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ec70b355-598e-40e4-ad36-c95b55db57d1-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"ec70b355-598e-40e4-ad36-c95b55db57d1\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:50:17 crc kubenswrapper[5120]: I0316 15:50:17.143050 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ec70b355-598e-40e4-ad36-c95b55db57d1-logs\") pod \"glance-default-external-api-0\" (UID: \"ec70b355-598e-40e4-ad36-c95b55db57d1\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:50:17 crc kubenswrapper[5120]: I0316 15:50:17.143127 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ec70b355-598e-40e4-ad36-c95b55db57d1-scripts\") pod \"glance-default-external-api-0\" (UID: \"ec70b355-598e-40e4-ad36-c95b55db57d1\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:50:17 crc kubenswrapper[5120]: I0316 15:50:17.143150 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ec70b355-598e-40e4-ad36-c95b55db57d1-config-data\") pod \"glance-default-external-api-0\" (UID: \"ec70b355-598e-40e4-ad36-c95b55db57d1\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:50:17 crc kubenswrapper[5120]: I0316 15:50:17.143174 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ec70b355-598e-40e4-ad36-c95b55db57d1-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"ec70b355-598e-40e4-ad36-c95b55db57d1\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:50:17 crc kubenswrapper[5120]: I0316 15:50:17.245063 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/2a642820-eb73-4102-bfe9-865c6822493a-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"2a642820-eb73-4102-bfe9-865c6822493a\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:50:17 crc kubenswrapper[5120]: I0316 15:50:17.245114 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"glance-default-external-api-0\" (UID: \"ec70b355-598e-40e4-ad36-c95b55db57d1\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:50:17 crc kubenswrapper[5120]: I0316 15:50:17.245140 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s6kkx\" (UniqueName: \"kubernetes.io/projected/ec70b355-598e-40e4-ad36-c95b55db57d1-kube-api-access-s6kkx\") pod \"glance-default-external-api-0\" (UID: \"ec70b355-598e-40e4-ad36-c95b55db57d1\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:50:17 crc kubenswrapper[5120]: I0316 15:50:17.245161 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ec70b355-598e-40e4-ad36-c95b55db57d1-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"ec70b355-598e-40e4-ad36-c95b55db57d1\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:50:17 crc kubenswrapper[5120]: I0316 15:50:17.245193 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2a642820-eb73-4102-bfe9-865c6822493a-scripts\") pod \"glance-default-internal-api-0\" (UID: \"2a642820-eb73-4102-bfe9-865c6822493a\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:50:17 crc kubenswrapper[5120]: I0316 15:50:17.245219 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ec70b355-598e-40e4-ad36-c95b55db57d1-logs\") pod \"glance-default-external-api-0\" (UID: \"ec70b355-598e-40e4-ad36-c95b55db57d1\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:50:17 crc kubenswrapper[5120]: I0316 15:50:17.245236 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7lvcd\" (UniqueName: \"kubernetes.io/projected/2a642820-eb73-4102-bfe9-865c6822493a-kube-api-access-7lvcd\") pod \"glance-default-internal-api-0\" (UID: \"2a642820-eb73-4102-bfe9-865c6822493a\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:50:17 crc kubenswrapper[5120]: I0316 15:50:17.245261 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ec70b355-598e-40e4-ad36-c95b55db57d1-scripts\") pod \"glance-default-external-api-0\" (UID: \"ec70b355-598e-40e4-ad36-c95b55db57d1\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:50:17 crc kubenswrapper[5120]: I0316 15:50:17.245281 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ec70b355-598e-40e4-ad36-c95b55db57d1-config-data\") pod \"glance-default-external-api-0\" (UID: \"ec70b355-598e-40e4-ad36-c95b55db57d1\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:50:17 crc kubenswrapper[5120]: I0316 15:50:17.245303 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ec70b355-598e-40e4-ad36-c95b55db57d1-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"ec70b355-598e-40e4-ad36-c95b55db57d1\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:50:17 crc kubenswrapper[5120]: I0316 15:50:17.245336 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/2a642820-eb73-4102-bfe9-865c6822493a-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"2a642820-eb73-4102-bfe9-865c6822493a\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:50:17 crc kubenswrapper[5120]: I0316 15:50:17.245376 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2a642820-eb73-4102-bfe9-865c6822493a-config-data\") pod \"glance-default-internal-api-0\" (UID: \"2a642820-eb73-4102-bfe9-865c6822493a\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:50:17 crc kubenswrapper[5120]: I0316 15:50:17.245446 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/ec70b355-598e-40e4-ad36-c95b55db57d1-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"ec70b355-598e-40e4-ad36-c95b55db57d1\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:50:17 crc kubenswrapper[5120]: I0316 15:50:17.245478 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2a642820-eb73-4102-bfe9-865c6822493a-logs\") pod \"glance-default-internal-api-0\" (UID: \"2a642820-eb73-4102-bfe9-865c6822493a\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:50:17 crc kubenswrapper[5120]: I0316 15:50:17.245497 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"glance-default-internal-api-0\" (UID: \"2a642820-eb73-4102-bfe9-865c6822493a\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:50:17 crc kubenswrapper[5120]: I0316 15:50:17.245532 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2a642820-eb73-4102-bfe9-865c6822493a-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"2a642820-eb73-4102-bfe9-865c6822493a\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:50:17 crc kubenswrapper[5120]: I0316 15:50:17.246990 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/ec70b355-598e-40e4-ad36-c95b55db57d1-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"ec70b355-598e-40e4-ad36-c95b55db57d1\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:50:17 crc kubenswrapper[5120]: I0316 15:50:17.247333 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ec70b355-598e-40e4-ad36-c95b55db57d1-logs\") pod \"glance-default-external-api-0\" (UID: \"ec70b355-598e-40e4-ad36-c95b55db57d1\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:50:17 crc kubenswrapper[5120]: I0316 15:50:17.247786 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"glance-default-external-api-0\" (UID: \"ec70b355-598e-40e4-ad36-c95b55db57d1\") device mount path \"/mnt/openstack/pv13\"" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:50:17 crc kubenswrapper[5120]: I0316 15:50:17.253116 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ec70b355-598e-40e4-ad36-c95b55db57d1-config-data\") pod \"glance-default-external-api-0\" (UID: \"ec70b355-598e-40e4-ad36-c95b55db57d1\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:50:17 crc kubenswrapper[5120]: I0316 15:50:17.256623 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ec70b355-598e-40e4-ad36-c95b55db57d1-scripts\") pod \"glance-default-external-api-0\" (UID: \"ec70b355-598e-40e4-ad36-c95b55db57d1\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:50:17 crc kubenswrapper[5120]: I0316 15:50:17.258048 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ec70b355-598e-40e4-ad36-c95b55db57d1-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"ec70b355-598e-40e4-ad36-c95b55db57d1\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:50:17 crc kubenswrapper[5120]: W0316 15:50:17.261120 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4e0214f5_7d2d_4b88_8096_a14ac906d637.slice/crio-45ac714a70b089e93a7fe4d9fb1a17e9f89c9bbc10bf057ac8f901a5b5aa827b WatchSource:0}: Error finding container 45ac714a70b089e93a7fe4d9fb1a17e9f89c9bbc10bf057ac8f901a5b5aa827b: Status 404 returned error can't find the container with id 45ac714a70b089e93a7fe4d9fb1a17e9f89c9bbc10bf057ac8f901a5b5aa827b Mar 16 15:50:17 crc kubenswrapper[5120]: I0316 15:50:17.261790 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ec70b355-598e-40e4-ad36-c95b55db57d1-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"ec70b355-598e-40e4-ad36-c95b55db57d1\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:50:17 crc kubenswrapper[5120]: I0316 15:50:17.267191 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6kkx\" (UniqueName: \"kubernetes.io/projected/ec70b355-598e-40e4-ad36-c95b55db57d1-kube-api-access-s6kkx\") pod \"glance-default-external-api-0\" (UID: \"ec70b355-598e-40e4-ad36-c95b55db57d1\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:50:17 crc kubenswrapper[5120]: I0316 15:50:17.267396 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-htm2c"] Mar 16 15:50:17 crc kubenswrapper[5120]: I0316 15:50:17.283829 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"glance-default-external-api-0\" (UID: \"ec70b355-598e-40e4-ad36-c95b55db57d1\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:50:17 crc kubenswrapper[5120]: I0316 15:50:17.347405 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2a642820-eb73-4102-bfe9-865c6822493a-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"2a642820-eb73-4102-bfe9-865c6822493a\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:50:17 crc kubenswrapper[5120]: I0316 15:50:17.348372 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/2a642820-eb73-4102-bfe9-865c6822493a-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"2a642820-eb73-4102-bfe9-865c6822493a\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:50:17 crc kubenswrapper[5120]: I0316 15:50:17.348436 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2a642820-eb73-4102-bfe9-865c6822493a-scripts\") pod \"glance-default-internal-api-0\" (UID: \"2a642820-eb73-4102-bfe9-865c6822493a\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:50:17 crc kubenswrapper[5120]: I0316 15:50:17.348475 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7lvcd\" (UniqueName: \"kubernetes.io/projected/2a642820-eb73-4102-bfe9-865c6822493a-kube-api-access-7lvcd\") pod \"glance-default-internal-api-0\" (UID: \"2a642820-eb73-4102-bfe9-865c6822493a\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:50:17 crc kubenswrapper[5120]: I0316 15:50:17.348534 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/2a642820-eb73-4102-bfe9-865c6822493a-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"2a642820-eb73-4102-bfe9-865c6822493a\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:50:17 crc kubenswrapper[5120]: I0316 15:50:17.348595 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2a642820-eb73-4102-bfe9-865c6822493a-config-data\") pod \"glance-default-internal-api-0\" (UID: \"2a642820-eb73-4102-bfe9-865c6822493a\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:50:17 crc kubenswrapper[5120]: I0316 15:50:17.348631 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2a642820-eb73-4102-bfe9-865c6822493a-logs\") pod \"glance-default-internal-api-0\" (UID: \"2a642820-eb73-4102-bfe9-865c6822493a\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:50:17 crc kubenswrapper[5120]: I0316 15:50:17.348654 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"glance-default-internal-api-0\" (UID: \"2a642820-eb73-4102-bfe9-865c6822493a\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:50:17 crc kubenswrapper[5120]: I0316 15:50:17.349178 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"glance-default-internal-api-0\" (UID: \"2a642820-eb73-4102-bfe9-865c6822493a\") device mount path \"/mnt/openstack/pv09\"" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:50:17 crc kubenswrapper[5120]: I0316 15:50:17.349279 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/2a642820-eb73-4102-bfe9-865c6822493a-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"2a642820-eb73-4102-bfe9-865c6822493a\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:50:17 crc kubenswrapper[5120]: I0316 15:50:17.349516 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2a642820-eb73-4102-bfe9-865c6822493a-logs\") pod \"glance-default-internal-api-0\" (UID: \"2a642820-eb73-4102-bfe9-865c6822493a\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:50:17 crc kubenswrapper[5120]: I0316 15:50:17.352590 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2a642820-eb73-4102-bfe9-865c6822493a-scripts\") pod \"glance-default-internal-api-0\" (UID: \"2a642820-eb73-4102-bfe9-865c6822493a\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:50:17 crc kubenswrapper[5120]: I0316 15:50:17.353149 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2a642820-eb73-4102-bfe9-865c6822493a-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"2a642820-eb73-4102-bfe9-865c6822493a\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:50:17 crc kubenswrapper[5120]: I0316 15:50:17.354032 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:50:17 crc kubenswrapper[5120]: I0316 15:50:17.356989 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/2a642820-eb73-4102-bfe9-865c6822493a-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"2a642820-eb73-4102-bfe9-865c6822493a\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:50:17 crc kubenswrapper[5120]: I0316 15:50:17.362634 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2a642820-eb73-4102-bfe9-865c6822493a-config-data\") pod \"glance-default-internal-api-0\" (UID: \"2a642820-eb73-4102-bfe9-865c6822493a\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:50:17 crc kubenswrapper[5120]: I0316 15:50:17.364125 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-h77sx"] Mar 16 15:50:17 crc kubenswrapper[5120]: W0316 15:50:17.379769 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd16cf6e5_1b2b_41b7_9a80_070f44bc9a67.slice/crio-b155ef47a9bcd558e67e03840ea5484044bcf8e1411a9bb5e93a42a6911e723c WatchSource:0}: Error finding container b155ef47a9bcd558e67e03840ea5484044bcf8e1411a9bb5e93a42a6911e723c: Status 404 returned error can't find the container with id b155ef47a9bcd558e67e03840ea5484044bcf8e1411a9bb5e93a42a6911e723c Mar 16 15:50:17 crc kubenswrapper[5120]: I0316 15:50:17.379864 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7lvcd\" (UniqueName: \"kubernetes.io/projected/2a642820-eb73-4102-bfe9-865c6822493a-kube-api-access-7lvcd\") pod \"glance-default-internal-api-0\" (UID: \"2a642820-eb73-4102-bfe9-865c6822493a\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:50:17 crc kubenswrapper[5120]: I0316 15:50:17.386698 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"glance-default-internal-api-0\" (UID: \"2a642820-eb73-4102-bfe9-865c6822493a\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:50:17 crc kubenswrapper[5120]: I0316 15:50:17.431902 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:50:17 crc kubenswrapper[5120]: I0316 15:50:17.709041 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 15:50:17 crc kubenswrapper[5120]: W0316 15:50:17.711975 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2a642820_eb73_4102_bfe9_865c6822493a.slice/crio-60748abd6027d6a2a4f2ec4e6e23f4091ceb8f2497d368fdff3ecec489e5b029 WatchSource:0}: Error finding container 60748abd6027d6a2a4f2ec4e6e23f4091ceb8f2497d368fdff3ecec489e5b029: Status 404 returned error can't find the container with id 60748abd6027d6a2a4f2ec4e6e23f4091ceb8f2497d368fdff3ecec489e5b029 Mar 16 15:50:17 crc kubenswrapper[5120]: I0316 15:50:17.826932 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 15:50:17 crc kubenswrapper[5120]: I0316 15:50:17.850658 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-htm2c" event={"ID":"4e0214f5-7d2d-4b88-8096-a14ac906d637","Type":"ContainerStarted","Data":"ea54a0abff5bb10b70106fb9ae1f1ebe16eb93672332619135d2135880b47565"} Mar 16 15:50:17 crc kubenswrapper[5120]: I0316 15:50:17.850706 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-htm2c" event={"ID":"4e0214f5-7d2d-4b88-8096-a14ac906d637","Type":"ContainerStarted","Data":"45ac714a70b089e93a7fe4d9fb1a17e9f89c9bbc10bf057ac8f901a5b5aa827b"} Mar 16 15:50:17 crc kubenswrapper[5120]: I0316 15:50:17.869917 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"2b8e2567-77a1-4c2c-930c-785714326aba","Type":"ContainerStarted","Data":"245402bd3d05a97af2c8fb4d974641ae742622d5c6782e77b843e77200e09aa3"} Mar 16 15:50:17 crc kubenswrapper[5120]: I0316 15:50:17.875817 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-db-sync-htm2c" podStartSLOduration=1.875800006 podStartE2EDuration="1.875800006s" podCreationTimestamp="2026-03-16 15:50:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:50:17.867984344 +0000 UTC m=+1120.021916001" watchObservedRunningTime="2026-03-16 15:50:17.875800006 +0000 UTC m=+1120.029731663" Mar 16 15:50:17 crc kubenswrapper[5120]: I0316 15:50:17.878462 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"2a642820-eb73-4102-bfe9-865c6822493a","Type":"ContainerStarted","Data":"60748abd6027d6a2a4f2ec4e6e23f4091ceb8f2497d368fdff3ecec489e5b029"} Mar 16 15:50:17 crc kubenswrapper[5120]: I0316 15:50:17.883525 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-5h8xf" event={"ID":"e8b7845d-53d2-4fc9-af50-91a65dc3e247","Type":"ContainerStarted","Data":"6e99f7741bfde91afdc67d55ce9ba537829bd8010b0849c1f3fb19b051180104"} Mar 16 15:50:17 crc kubenswrapper[5120]: I0316 15:50:17.889386 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-gwbbm" event={"ID":"2645c221-c2bd-4cd3-a073-9396a5a87708","Type":"ContainerStarted","Data":"f1222a794831eb4415f46058f97def84b0e90d3811f6fe6528c9248213efe52f"} Mar 16 15:50:17 crc kubenswrapper[5120]: I0316 15:50:17.892554 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-zmppx" event={"ID":"68a56393-5c21-48ab-823f-ce9d1d4cf16b","Type":"ContainerStarted","Data":"0d80ee354d9050355b4730b29333e535d33a1e5da8e72bfccebead3d4b56a87f"} Mar 16 15:50:17 crc kubenswrapper[5120]: I0316 15:50:17.892602 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-zmppx" event={"ID":"68a56393-5c21-48ab-823f-ce9d1d4cf16b","Type":"ContainerStarted","Data":"c48bbfff29582743f884744e82315bad578c2ab29cf4123a3ca4aca3802503c9"} Mar 16 15:50:17 crc kubenswrapper[5120]: I0316 15:50:17.903461 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-h77sx" event={"ID":"d16cf6e5-1b2b-41b7-9a80-070f44bc9a67","Type":"ContainerStarted","Data":"b155ef47a9bcd558e67e03840ea5484044bcf8e1411a9bb5e93a42a6911e723c"} Mar 16 15:50:17 crc kubenswrapper[5120]: I0316 15:50:17.913780 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-bootstrap-zmppx" podStartSLOduration=2.913748356 podStartE2EDuration="2.913748356s" podCreationTimestamp="2026-03-16 15:50:15 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:50:17.910219304 +0000 UTC m=+1120.064150971" watchObservedRunningTime="2026-03-16 15:50:17.913748356 +0000 UTC m=+1120.067680033" Mar 16 15:50:18 crc kubenswrapper[5120]: I0316 15:50:18.923605 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"2a642820-eb73-4102-bfe9-865c6822493a","Type":"ContainerStarted","Data":"324e2c740efff3b758338eb9a0da8c93d96b9b2141512ade2f38e68f6cf860b4"} Mar 16 15:50:18 crc kubenswrapper[5120]: I0316 15:50:18.928773 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"ec70b355-598e-40e4-ad36-c95b55db57d1","Type":"ContainerStarted","Data":"e07737b61d231724091d626b2dd14e640201e0f6f84801863a7aa138852f37fc"} Mar 16 15:50:18 crc kubenswrapper[5120]: I0316 15:50:18.928815 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"ec70b355-598e-40e4-ad36-c95b55db57d1","Type":"ContainerStarted","Data":"7398bae89981eb6a3a1bc51f104a9a2657fcbefc6ce28d0b0314a90ed560ea3c"} Mar 16 15:50:19 crc kubenswrapper[5120]: I0316 15:50:19.283238 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 15:50:19 crc kubenswrapper[5120]: I0316 15:50:19.371559 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 15:50:19 crc kubenswrapper[5120]: I0316 15:50:19.418048 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 15:50:19 crc kubenswrapper[5120]: I0316 15:50:19.948878 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"2a642820-eb73-4102-bfe9-865c6822493a","Type":"ContainerStarted","Data":"9c5b7606176759ea0be9457b92fd2b2a7b80b988c286570d04be2f984f98654f"} Mar 16 15:50:19 crc kubenswrapper[5120]: I0316 15:50:19.949032 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="2a642820-eb73-4102-bfe9-865c6822493a" containerName="glance-log" containerID="cri-o://324e2c740efff3b758338eb9a0da8c93d96b9b2141512ade2f38e68f6cf860b4" gracePeriod=30 Mar 16 15:50:19 crc kubenswrapper[5120]: I0316 15:50:19.949548 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="2a642820-eb73-4102-bfe9-865c6822493a" containerName="glance-httpd" containerID="cri-o://9c5b7606176759ea0be9457b92fd2b2a7b80b988c286570d04be2f984f98654f" gracePeriod=30 Mar 16 15:50:19 crc kubenswrapper[5120]: I0316 15:50:19.973427 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-internal-api-0" podStartSLOduration=3.973409163 podStartE2EDuration="3.973409163s" podCreationTimestamp="2026-03-16 15:50:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:50:19.967530957 +0000 UTC m=+1122.121462614" watchObservedRunningTime="2026-03-16 15:50:19.973409163 +0000 UTC m=+1122.127340820" Mar 16 15:50:20 crc kubenswrapper[5120]: I0316 15:50:20.752677 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:50:20 crc kubenswrapper[5120]: I0316 15:50:20.836731 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7lvcd\" (UniqueName: \"kubernetes.io/projected/2a642820-eb73-4102-bfe9-865c6822493a-kube-api-access-7lvcd\") pod \"2a642820-eb73-4102-bfe9-865c6822493a\" (UID: \"2a642820-eb73-4102-bfe9-865c6822493a\") " Mar 16 15:50:20 crc kubenswrapper[5120]: I0316 15:50:20.836800 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"2a642820-eb73-4102-bfe9-865c6822493a\" (UID: \"2a642820-eb73-4102-bfe9-865c6822493a\") " Mar 16 15:50:20 crc kubenswrapper[5120]: I0316 15:50:20.836839 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/2a642820-eb73-4102-bfe9-865c6822493a-httpd-run\") pod \"2a642820-eb73-4102-bfe9-865c6822493a\" (UID: \"2a642820-eb73-4102-bfe9-865c6822493a\") " Mar 16 15:50:20 crc kubenswrapper[5120]: I0316 15:50:20.836878 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2a642820-eb73-4102-bfe9-865c6822493a-logs\") pod \"2a642820-eb73-4102-bfe9-865c6822493a\" (UID: \"2a642820-eb73-4102-bfe9-865c6822493a\") " Mar 16 15:50:20 crc kubenswrapper[5120]: I0316 15:50:20.836972 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/2a642820-eb73-4102-bfe9-865c6822493a-internal-tls-certs\") pod \"2a642820-eb73-4102-bfe9-865c6822493a\" (UID: \"2a642820-eb73-4102-bfe9-865c6822493a\") " Mar 16 15:50:20 crc kubenswrapper[5120]: I0316 15:50:20.837179 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2a642820-eb73-4102-bfe9-865c6822493a-config-data\") pod \"2a642820-eb73-4102-bfe9-865c6822493a\" (UID: \"2a642820-eb73-4102-bfe9-865c6822493a\") " Mar 16 15:50:20 crc kubenswrapper[5120]: I0316 15:50:20.837252 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2a642820-eb73-4102-bfe9-865c6822493a-combined-ca-bundle\") pod \"2a642820-eb73-4102-bfe9-865c6822493a\" (UID: \"2a642820-eb73-4102-bfe9-865c6822493a\") " Mar 16 15:50:20 crc kubenswrapper[5120]: I0316 15:50:20.837349 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2a642820-eb73-4102-bfe9-865c6822493a-scripts\") pod \"2a642820-eb73-4102-bfe9-865c6822493a\" (UID: \"2a642820-eb73-4102-bfe9-865c6822493a\") " Mar 16 15:50:20 crc kubenswrapper[5120]: I0316 15:50:20.839383 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a642820-eb73-4102-bfe9-865c6822493a-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "2a642820-eb73-4102-bfe9-865c6822493a" (UID: "2a642820-eb73-4102-bfe9-865c6822493a"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:50:20 crc kubenswrapper[5120]: I0316 15:50:20.839926 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a642820-eb73-4102-bfe9-865c6822493a-logs" (OuterVolumeSpecName: "logs") pod "2a642820-eb73-4102-bfe9-865c6822493a" (UID: "2a642820-eb73-4102-bfe9-865c6822493a"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:50:20 crc kubenswrapper[5120]: I0316 15:50:20.848657 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage09-crc" (OuterVolumeSpecName: "glance") pod "2a642820-eb73-4102-bfe9-865c6822493a" (UID: "2a642820-eb73-4102-bfe9-865c6822493a"). InnerVolumeSpecName "local-storage09-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 15:50:20 crc kubenswrapper[5120]: I0316 15:50:20.848679 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a642820-eb73-4102-bfe9-865c6822493a-kube-api-access-7lvcd" (OuterVolumeSpecName: "kube-api-access-7lvcd") pod "2a642820-eb73-4102-bfe9-865c6822493a" (UID: "2a642820-eb73-4102-bfe9-865c6822493a"). InnerVolumeSpecName "kube-api-access-7lvcd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:50:20 crc kubenswrapper[5120]: I0316 15:50:20.852034 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2a642820-eb73-4102-bfe9-865c6822493a-scripts" (OuterVolumeSpecName: "scripts") pod "2a642820-eb73-4102-bfe9-865c6822493a" (UID: "2a642820-eb73-4102-bfe9-865c6822493a"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:50:20 crc kubenswrapper[5120]: I0316 15:50:20.884315 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2a642820-eb73-4102-bfe9-865c6822493a-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "2a642820-eb73-4102-bfe9-865c6822493a" (UID: "2a642820-eb73-4102-bfe9-865c6822493a"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:50:20 crc kubenswrapper[5120]: I0316 15:50:20.885213 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2a642820-eb73-4102-bfe9-865c6822493a-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "2a642820-eb73-4102-bfe9-865c6822493a" (UID: "2a642820-eb73-4102-bfe9-865c6822493a"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:50:20 crc kubenswrapper[5120]: I0316 15:50:20.909990 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2a642820-eb73-4102-bfe9-865c6822493a-config-data" (OuterVolumeSpecName: "config-data") pod "2a642820-eb73-4102-bfe9-865c6822493a" (UID: "2a642820-eb73-4102-bfe9-865c6822493a"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:50:20 crc kubenswrapper[5120]: I0316 15:50:20.939943 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2a642820-eb73-4102-bfe9-865c6822493a-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:50:20 crc kubenswrapper[5120]: I0316 15:50:20.939983 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2a642820-eb73-4102-bfe9-865c6822493a-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 15:50:20 crc kubenswrapper[5120]: I0316 15:50:20.939997 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7lvcd\" (UniqueName: \"kubernetes.io/projected/2a642820-eb73-4102-bfe9-865c6822493a-kube-api-access-7lvcd\") on node \"crc\" DevicePath \"\"" Mar 16 15:50:20 crc kubenswrapper[5120]: I0316 15:50:20.940035 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") on node \"crc\" " Mar 16 15:50:20 crc kubenswrapper[5120]: I0316 15:50:20.940047 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/2a642820-eb73-4102-bfe9-865c6822493a-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 15:50:20 crc kubenswrapper[5120]: I0316 15:50:20.940054 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2a642820-eb73-4102-bfe9-865c6822493a-logs\") on node \"crc\" DevicePath \"\"" Mar 16 15:50:20 crc kubenswrapper[5120]: I0316 15:50:20.940062 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/2a642820-eb73-4102-bfe9-865c6822493a-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 15:50:20 crc kubenswrapper[5120]: I0316 15:50:20.940071 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2a642820-eb73-4102-bfe9-865c6822493a-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 15:50:20 crc kubenswrapper[5120]: I0316 15:50:20.962969 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage09-crc" (UniqueName: "kubernetes.io/local-volume/local-storage09-crc") on node "crc" Mar 16 15:50:20 crc kubenswrapper[5120]: I0316 15:50:20.970974 5120 generic.go:358] "Generic (PLEG): container finished" podID="2a642820-eb73-4102-bfe9-865c6822493a" containerID="9c5b7606176759ea0be9457b92fd2b2a7b80b988c286570d04be2f984f98654f" exitCode=143 Mar 16 15:50:20 crc kubenswrapper[5120]: I0316 15:50:20.971013 5120 generic.go:358] "Generic (PLEG): container finished" podID="2a642820-eb73-4102-bfe9-865c6822493a" containerID="324e2c740efff3b758338eb9a0da8c93d96b9b2141512ade2f38e68f6cf860b4" exitCode=143 Mar 16 15:50:20 crc kubenswrapper[5120]: I0316 15:50:20.971178 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"2a642820-eb73-4102-bfe9-865c6822493a","Type":"ContainerDied","Data":"9c5b7606176759ea0be9457b92fd2b2a7b80b988c286570d04be2f984f98654f"} Mar 16 15:50:20 crc kubenswrapper[5120]: I0316 15:50:20.971215 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"2a642820-eb73-4102-bfe9-865c6822493a","Type":"ContainerDied","Data":"324e2c740efff3b758338eb9a0da8c93d96b9b2141512ade2f38e68f6cf860b4"} Mar 16 15:50:20 crc kubenswrapper[5120]: I0316 15:50:20.971228 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"2a642820-eb73-4102-bfe9-865c6822493a","Type":"ContainerDied","Data":"60748abd6027d6a2a4f2ec4e6e23f4091ceb8f2497d368fdff3ecec489e5b029"} Mar 16 15:50:20 crc kubenswrapper[5120]: I0316 15:50:20.971249 5120 scope.go:117] "RemoveContainer" containerID="9c5b7606176759ea0be9457b92fd2b2a7b80b988c286570d04be2f984f98654f" Mar 16 15:50:20 crc kubenswrapper[5120]: I0316 15:50:20.971397 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:50:20 crc kubenswrapper[5120]: I0316 15:50:20.992989 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"ec70b355-598e-40e4-ad36-c95b55db57d1","Type":"ContainerStarted","Data":"a41fbfbef8fa5543bb33be9961863f6cedc07c1c259b686a467ac820c54f4caa"} Mar 16 15:50:20 crc kubenswrapper[5120]: I0316 15:50:20.993318 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="ec70b355-598e-40e4-ad36-c95b55db57d1" containerName="glance-log" containerID="cri-o://e07737b61d231724091d626b2dd14e640201e0f6f84801863a7aa138852f37fc" gracePeriod=30 Mar 16 15:50:20 crc kubenswrapper[5120]: I0316 15:50:20.993662 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="ec70b355-598e-40e4-ad36-c95b55db57d1" containerName="glance-httpd" containerID="cri-o://a41fbfbef8fa5543bb33be9961863f6cedc07c1c259b686a467ac820c54f4caa" gracePeriod=30 Mar 16 15:50:21 crc kubenswrapper[5120]: I0316 15:50:21.017478 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-external-api-0" podStartSLOduration=6.017461963 podStartE2EDuration="6.017461963s" podCreationTimestamp="2026-03-16 15:50:15 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:50:21.0134859 +0000 UTC m=+1123.167417557" watchObservedRunningTime="2026-03-16 15:50:21.017461963 +0000 UTC m=+1123.171393620" Mar 16 15:50:21 crc kubenswrapper[5120]: I0316 15:50:21.042486 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") on node \"crc\" DevicePath \"\"" Mar 16 15:50:21 crc kubenswrapper[5120]: I0316 15:50:21.042521 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 15:50:21 crc kubenswrapper[5120]: I0316 15:50:21.060782 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 15:50:21 crc kubenswrapper[5120]: I0316 15:50:21.078880 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 15:50:21 crc kubenswrapper[5120]: I0316 15:50:21.079869 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a642820-eb73-4102-bfe9-865c6822493a" containerName="glance-log" Mar 16 15:50:21 crc kubenswrapper[5120]: I0316 15:50:21.079888 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a642820-eb73-4102-bfe9-865c6822493a" containerName="glance-log" Mar 16 15:50:21 crc kubenswrapper[5120]: I0316 15:50:21.079914 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a642820-eb73-4102-bfe9-865c6822493a" containerName="glance-httpd" Mar 16 15:50:21 crc kubenswrapper[5120]: I0316 15:50:21.079920 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a642820-eb73-4102-bfe9-865c6822493a" containerName="glance-httpd" Mar 16 15:50:21 crc kubenswrapper[5120]: I0316 15:50:21.080089 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="2a642820-eb73-4102-bfe9-865c6822493a" containerName="glance-log" Mar 16 15:50:21 crc kubenswrapper[5120]: I0316 15:50:21.080097 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="2a642820-eb73-4102-bfe9-865c6822493a" containerName="glance-httpd" Mar 16 15:50:21 crc kubenswrapper[5120]: I0316 15:50:21.086101 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:50:21 crc kubenswrapper[5120]: I0316 15:50:21.087356 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 15:50:21 crc kubenswrapper[5120]: I0316 15:50:21.090668 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-internal-svc\"" Mar 16 15:50:21 crc kubenswrapper[5120]: I0316 15:50:21.090866 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-internal-config-data\"" Mar 16 15:50:21 crc kubenswrapper[5120]: I0316 15:50:21.245900 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4688f659-b142-43b8-af64-5a69b67d8a1f-scripts\") pod \"glance-default-internal-api-0\" (UID: \"4688f659-b142-43b8-af64-5a69b67d8a1f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:50:21 crc kubenswrapper[5120]: I0316 15:50:21.245957 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/4688f659-b142-43b8-af64-5a69b67d8a1f-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"4688f659-b142-43b8-af64-5a69b67d8a1f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:50:21 crc kubenswrapper[5120]: I0316 15:50:21.246073 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/4688f659-b142-43b8-af64-5a69b67d8a1f-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"4688f659-b142-43b8-af64-5a69b67d8a1f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:50:21 crc kubenswrapper[5120]: I0316 15:50:21.246131 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2j7jd\" (UniqueName: \"kubernetes.io/projected/4688f659-b142-43b8-af64-5a69b67d8a1f-kube-api-access-2j7jd\") pod \"glance-default-internal-api-0\" (UID: \"4688f659-b142-43b8-af64-5a69b67d8a1f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:50:21 crc kubenswrapper[5120]: I0316 15:50:21.246167 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4688f659-b142-43b8-af64-5a69b67d8a1f-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"4688f659-b142-43b8-af64-5a69b67d8a1f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:50:21 crc kubenswrapper[5120]: I0316 15:50:21.246225 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4688f659-b142-43b8-af64-5a69b67d8a1f-logs\") pod \"glance-default-internal-api-0\" (UID: \"4688f659-b142-43b8-af64-5a69b67d8a1f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:50:21 crc kubenswrapper[5120]: I0316 15:50:21.246252 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"glance-default-internal-api-0\" (UID: \"4688f659-b142-43b8-af64-5a69b67d8a1f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:50:21 crc kubenswrapper[5120]: I0316 15:50:21.246281 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4688f659-b142-43b8-af64-5a69b67d8a1f-config-data\") pod \"glance-default-internal-api-0\" (UID: \"4688f659-b142-43b8-af64-5a69b67d8a1f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:50:21 crc kubenswrapper[5120]: I0316 15:50:21.348079 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4688f659-b142-43b8-af64-5a69b67d8a1f-logs\") pod \"glance-default-internal-api-0\" (UID: \"4688f659-b142-43b8-af64-5a69b67d8a1f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:50:21 crc kubenswrapper[5120]: I0316 15:50:21.348201 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"glance-default-internal-api-0\" (UID: \"4688f659-b142-43b8-af64-5a69b67d8a1f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:50:21 crc kubenswrapper[5120]: I0316 15:50:21.348240 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4688f659-b142-43b8-af64-5a69b67d8a1f-config-data\") pod \"glance-default-internal-api-0\" (UID: \"4688f659-b142-43b8-af64-5a69b67d8a1f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:50:21 crc kubenswrapper[5120]: I0316 15:50:21.348319 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4688f659-b142-43b8-af64-5a69b67d8a1f-scripts\") pod \"glance-default-internal-api-0\" (UID: \"4688f659-b142-43b8-af64-5a69b67d8a1f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:50:21 crc kubenswrapper[5120]: I0316 15:50:21.348393 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/4688f659-b142-43b8-af64-5a69b67d8a1f-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"4688f659-b142-43b8-af64-5a69b67d8a1f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:50:21 crc kubenswrapper[5120]: I0316 15:50:21.348477 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"glance-default-internal-api-0\" (UID: \"4688f659-b142-43b8-af64-5a69b67d8a1f\") device mount path \"/mnt/openstack/pv09\"" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:50:21 crc kubenswrapper[5120]: I0316 15:50:21.348506 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/4688f659-b142-43b8-af64-5a69b67d8a1f-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"4688f659-b142-43b8-af64-5a69b67d8a1f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:50:21 crc kubenswrapper[5120]: I0316 15:50:21.348571 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2j7jd\" (UniqueName: \"kubernetes.io/projected/4688f659-b142-43b8-af64-5a69b67d8a1f-kube-api-access-2j7jd\") pod \"glance-default-internal-api-0\" (UID: \"4688f659-b142-43b8-af64-5a69b67d8a1f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:50:21 crc kubenswrapper[5120]: I0316 15:50:21.348615 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4688f659-b142-43b8-af64-5a69b67d8a1f-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"4688f659-b142-43b8-af64-5a69b67d8a1f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:50:21 crc kubenswrapper[5120]: I0316 15:50:21.348745 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4688f659-b142-43b8-af64-5a69b67d8a1f-logs\") pod \"glance-default-internal-api-0\" (UID: \"4688f659-b142-43b8-af64-5a69b67d8a1f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:50:21 crc kubenswrapper[5120]: I0316 15:50:21.349355 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/4688f659-b142-43b8-af64-5a69b67d8a1f-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"4688f659-b142-43b8-af64-5a69b67d8a1f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:50:21 crc kubenswrapper[5120]: I0316 15:50:21.354903 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4688f659-b142-43b8-af64-5a69b67d8a1f-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"4688f659-b142-43b8-af64-5a69b67d8a1f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:50:21 crc kubenswrapper[5120]: I0316 15:50:21.356056 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4688f659-b142-43b8-af64-5a69b67d8a1f-config-data\") pod \"glance-default-internal-api-0\" (UID: \"4688f659-b142-43b8-af64-5a69b67d8a1f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:50:21 crc kubenswrapper[5120]: I0316 15:50:21.356657 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/4688f659-b142-43b8-af64-5a69b67d8a1f-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"4688f659-b142-43b8-af64-5a69b67d8a1f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:50:21 crc kubenswrapper[5120]: I0316 15:50:21.363480 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4688f659-b142-43b8-af64-5a69b67d8a1f-scripts\") pod \"glance-default-internal-api-0\" (UID: \"4688f659-b142-43b8-af64-5a69b67d8a1f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:50:21 crc kubenswrapper[5120]: I0316 15:50:21.367320 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2j7jd\" (UniqueName: \"kubernetes.io/projected/4688f659-b142-43b8-af64-5a69b67d8a1f-kube-api-access-2j7jd\") pod \"glance-default-internal-api-0\" (UID: \"4688f659-b142-43b8-af64-5a69b67d8a1f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:50:21 crc kubenswrapper[5120]: I0316 15:50:21.381238 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"glance-default-internal-api-0\" (UID: \"4688f659-b142-43b8-af64-5a69b67d8a1f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:50:21 crc kubenswrapper[5120]: I0316 15:50:21.423937 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:50:22 crc kubenswrapper[5120]: I0316 15:50:22.005629 5120 generic.go:358] "Generic (PLEG): container finished" podID="ec70b355-598e-40e4-ad36-c95b55db57d1" containerID="a41fbfbef8fa5543bb33be9961863f6cedc07c1c259b686a467ac820c54f4caa" exitCode=0 Mar 16 15:50:22 crc kubenswrapper[5120]: I0316 15:50:22.005669 5120 generic.go:358] "Generic (PLEG): container finished" podID="ec70b355-598e-40e4-ad36-c95b55db57d1" containerID="e07737b61d231724091d626b2dd14e640201e0f6f84801863a7aa138852f37fc" exitCode=143 Mar 16 15:50:22 crc kubenswrapper[5120]: I0316 15:50:22.005689 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"ec70b355-598e-40e4-ad36-c95b55db57d1","Type":"ContainerDied","Data":"a41fbfbef8fa5543bb33be9961863f6cedc07c1c259b686a467ac820c54f4caa"} Mar 16 15:50:22 crc kubenswrapper[5120]: I0316 15:50:22.005749 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"ec70b355-598e-40e4-ad36-c95b55db57d1","Type":"ContainerDied","Data":"e07737b61d231724091d626b2dd14e640201e0f6f84801863a7aa138852f37fc"} Mar 16 15:50:22 crc kubenswrapper[5120]: I0316 15:50:22.007409 5120 generic.go:358] "Generic (PLEG): container finished" podID="68a56393-5c21-48ab-823f-ce9d1d4cf16b" containerID="0d80ee354d9050355b4730b29333e535d33a1e5da8e72bfccebead3d4b56a87f" exitCode=0 Mar 16 15:50:22 crc kubenswrapper[5120]: I0316 15:50:22.007678 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-zmppx" event={"ID":"68a56393-5c21-48ab-823f-ce9d1d4cf16b","Type":"ContainerDied","Data":"0d80ee354d9050355b4730b29333e535d33a1e5da8e72bfccebead3d4b56a87f"} Mar 16 15:50:22 crc kubenswrapper[5120]: I0316 15:50:22.010484 5120 patch_prober.go:28] interesting pod/machine-config-daemon-7bf76 container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 15:50:22 crc kubenswrapper[5120]: I0316 15:50:22.010567 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 15:50:22 crc kubenswrapper[5120]: I0316 15:50:22.676378 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2a642820-eb73-4102-bfe9-865c6822493a" path="/var/lib/kubelet/pods/2a642820-eb73-4102-bfe9-865c6822493a/volumes" Mar 16 15:50:32 crc kubenswrapper[5120]: I0316 15:50:32.570377 5120 scope.go:117] "RemoveContainer" containerID="324e2c740efff3b758338eb9a0da8c93d96b9b2141512ade2f38e68f6cf860b4" Mar 16 15:50:32 crc kubenswrapper[5120]: I0316 15:50:32.660852 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-zmppx" Mar 16 15:50:32 crc kubenswrapper[5120]: I0316 15:50:32.668507 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:50:32 crc kubenswrapper[5120]: I0316 15:50:32.706670 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ec70b355-598e-40e4-ad36-c95b55db57d1-scripts\") pod \"ec70b355-598e-40e4-ad36-c95b55db57d1\" (UID: \"ec70b355-598e-40e4-ad36-c95b55db57d1\") " Mar 16 15:50:32 crc kubenswrapper[5120]: I0316 15:50:32.707791 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/68a56393-5c21-48ab-823f-ce9d1d4cf16b-combined-ca-bundle\") pod \"68a56393-5c21-48ab-823f-ce9d1d4cf16b\" (UID: \"68a56393-5c21-48ab-823f-ce9d1d4cf16b\") " Mar 16 15:50:32 crc kubenswrapper[5120]: I0316 15:50:32.707861 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ec70b355-598e-40e4-ad36-c95b55db57d1-logs\") pod \"ec70b355-598e-40e4-ad36-c95b55db57d1\" (UID: \"ec70b355-598e-40e4-ad36-c95b55db57d1\") " Mar 16 15:50:32 crc kubenswrapper[5120]: I0316 15:50:32.707911 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ec70b355-598e-40e4-ad36-c95b55db57d1-public-tls-certs\") pod \"ec70b355-598e-40e4-ad36-c95b55db57d1\" (UID: \"ec70b355-598e-40e4-ad36-c95b55db57d1\") " Mar 16 15:50:32 crc kubenswrapper[5120]: I0316 15:50:32.707934 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ec70b355-598e-40e4-ad36-c95b55db57d1-config-data\") pod \"ec70b355-598e-40e4-ad36-c95b55db57d1\" (UID: \"ec70b355-598e-40e4-ad36-c95b55db57d1\") " Mar 16 15:50:32 crc kubenswrapper[5120]: I0316 15:50:32.707963 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ec70b355-598e-40e4-ad36-c95b55db57d1-combined-ca-bundle\") pod \"ec70b355-598e-40e4-ad36-c95b55db57d1\" (UID: \"ec70b355-598e-40e4-ad36-c95b55db57d1\") " Mar 16 15:50:32 crc kubenswrapper[5120]: I0316 15:50:32.716397 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec70b355-598e-40e4-ad36-c95b55db57d1-logs" (OuterVolumeSpecName: "logs") pod "ec70b355-598e-40e4-ad36-c95b55db57d1" (UID: "ec70b355-598e-40e4-ad36-c95b55db57d1"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:50:32 crc kubenswrapper[5120]: I0316 15:50:32.718165 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec70b355-598e-40e4-ad36-c95b55db57d1-scripts" (OuterVolumeSpecName: "scripts") pod "ec70b355-598e-40e4-ad36-c95b55db57d1" (UID: "ec70b355-598e-40e4-ad36-c95b55db57d1"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:50:32 crc kubenswrapper[5120]: I0316 15:50:32.740267 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec70b355-598e-40e4-ad36-c95b55db57d1-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ec70b355-598e-40e4-ad36-c95b55db57d1" (UID: "ec70b355-598e-40e4-ad36-c95b55db57d1"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:50:32 crc kubenswrapper[5120]: I0316 15:50:32.767969 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68a56393-5c21-48ab-823f-ce9d1d4cf16b-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "68a56393-5c21-48ab-823f-ce9d1d4cf16b" (UID: "68a56393-5c21-48ab-823f-ce9d1d4cf16b"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:50:32 crc kubenswrapper[5120]: I0316 15:50:32.770599 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec70b355-598e-40e4-ad36-c95b55db57d1-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "ec70b355-598e-40e4-ad36-c95b55db57d1" (UID: "ec70b355-598e-40e4-ad36-c95b55db57d1"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:50:32 crc kubenswrapper[5120]: I0316 15:50:32.781781 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec70b355-598e-40e4-ad36-c95b55db57d1-config-data" (OuterVolumeSpecName: "config-data") pod "ec70b355-598e-40e4-ad36-c95b55db57d1" (UID: "ec70b355-598e-40e4-ad36-c95b55db57d1"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:50:32 crc kubenswrapper[5120]: I0316 15:50:32.809980 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"ec70b355-598e-40e4-ad36-c95b55db57d1\" (UID: \"ec70b355-598e-40e4-ad36-c95b55db57d1\") " Mar 16 15:50:32 crc kubenswrapper[5120]: I0316 15:50:32.810062 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xz4jq\" (UniqueName: \"kubernetes.io/projected/68a56393-5c21-48ab-823f-ce9d1d4cf16b-kube-api-access-xz4jq\") pod \"68a56393-5c21-48ab-823f-ce9d1d4cf16b\" (UID: \"68a56393-5c21-48ab-823f-ce9d1d4cf16b\") " Mar 16 15:50:32 crc kubenswrapper[5120]: I0316 15:50:32.810098 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/68a56393-5c21-48ab-823f-ce9d1d4cf16b-credential-keys\") pod \"68a56393-5c21-48ab-823f-ce9d1d4cf16b\" (UID: \"68a56393-5c21-48ab-823f-ce9d1d4cf16b\") " Mar 16 15:50:32 crc kubenswrapper[5120]: I0316 15:50:32.810157 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/68a56393-5c21-48ab-823f-ce9d1d4cf16b-fernet-keys\") pod \"68a56393-5c21-48ab-823f-ce9d1d4cf16b\" (UID: \"68a56393-5c21-48ab-823f-ce9d1d4cf16b\") " Mar 16 15:50:32 crc kubenswrapper[5120]: I0316 15:50:32.810200 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s6kkx\" (UniqueName: \"kubernetes.io/projected/ec70b355-598e-40e4-ad36-c95b55db57d1-kube-api-access-s6kkx\") pod \"ec70b355-598e-40e4-ad36-c95b55db57d1\" (UID: \"ec70b355-598e-40e4-ad36-c95b55db57d1\") " Mar 16 15:50:32 crc kubenswrapper[5120]: I0316 15:50:32.810263 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/ec70b355-598e-40e4-ad36-c95b55db57d1-httpd-run\") pod \"ec70b355-598e-40e4-ad36-c95b55db57d1\" (UID: \"ec70b355-598e-40e4-ad36-c95b55db57d1\") " Mar 16 15:50:32 crc kubenswrapper[5120]: I0316 15:50:32.810483 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/68a56393-5c21-48ab-823f-ce9d1d4cf16b-config-data\") pod \"68a56393-5c21-48ab-823f-ce9d1d4cf16b\" (UID: \"68a56393-5c21-48ab-823f-ce9d1d4cf16b\") " Mar 16 15:50:32 crc kubenswrapper[5120]: I0316 15:50:32.810502 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/68a56393-5c21-48ab-823f-ce9d1d4cf16b-scripts\") pod \"68a56393-5c21-48ab-823f-ce9d1d4cf16b\" (UID: \"68a56393-5c21-48ab-823f-ce9d1d4cf16b\") " Mar 16 15:50:32 crc kubenswrapper[5120]: I0316 15:50:32.811053 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec70b355-598e-40e4-ad36-c95b55db57d1-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "ec70b355-598e-40e4-ad36-c95b55db57d1" (UID: "ec70b355-598e-40e4-ad36-c95b55db57d1"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:50:32 crc kubenswrapper[5120]: I0316 15:50:32.811292 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ec70b355-598e-40e4-ad36-c95b55db57d1-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 15:50:32 crc kubenswrapper[5120]: I0316 15:50:32.811314 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/68a56393-5c21-48ab-823f-ce9d1d4cf16b-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:50:32 crc kubenswrapper[5120]: I0316 15:50:32.811327 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ec70b355-598e-40e4-ad36-c95b55db57d1-logs\") on node \"crc\" DevicePath \"\"" Mar 16 15:50:32 crc kubenswrapper[5120]: I0316 15:50:32.811336 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ec70b355-598e-40e4-ad36-c95b55db57d1-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 15:50:32 crc kubenswrapper[5120]: I0316 15:50:32.811344 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ec70b355-598e-40e4-ad36-c95b55db57d1-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 15:50:32 crc kubenswrapper[5120]: I0316 15:50:32.811351 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ec70b355-598e-40e4-ad36-c95b55db57d1-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:50:32 crc kubenswrapper[5120]: I0316 15:50:32.814790 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage13-crc" (OuterVolumeSpecName: "glance") pod "ec70b355-598e-40e4-ad36-c95b55db57d1" (UID: "ec70b355-598e-40e4-ad36-c95b55db57d1"). InnerVolumeSpecName "local-storage13-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 15:50:32 crc kubenswrapper[5120]: I0316 15:50:32.817162 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68a56393-5c21-48ab-823f-ce9d1d4cf16b-kube-api-access-xz4jq" (OuterVolumeSpecName: "kube-api-access-xz4jq") pod "68a56393-5c21-48ab-823f-ce9d1d4cf16b" (UID: "68a56393-5c21-48ab-823f-ce9d1d4cf16b"). InnerVolumeSpecName "kube-api-access-xz4jq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:50:32 crc kubenswrapper[5120]: I0316 15:50:32.817451 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec70b355-598e-40e4-ad36-c95b55db57d1-kube-api-access-s6kkx" (OuterVolumeSpecName: "kube-api-access-s6kkx") pod "ec70b355-598e-40e4-ad36-c95b55db57d1" (UID: "ec70b355-598e-40e4-ad36-c95b55db57d1"). InnerVolumeSpecName "kube-api-access-s6kkx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:50:32 crc kubenswrapper[5120]: I0316 15:50:32.817794 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68a56393-5c21-48ab-823f-ce9d1d4cf16b-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "68a56393-5c21-48ab-823f-ce9d1d4cf16b" (UID: "68a56393-5c21-48ab-823f-ce9d1d4cf16b"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:50:32 crc kubenswrapper[5120]: I0316 15:50:32.818633 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68a56393-5c21-48ab-823f-ce9d1d4cf16b-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "68a56393-5c21-48ab-823f-ce9d1d4cf16b" (UID: "68a56393-5c21-48ab-823f-ce9d1d4cf16b"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:50:32 crc kubenswrapper[5120]: I0316 15:50:32.819594 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68a56393-5c21-48ab-823f-ce9d1d4cf16b-scripts" (OuterVolumeSpecName: "scripts") pod "68a56393-5c21-48ab-823f-ce9d1d4cf16b" (UID: "68a56393-5c21-48ab-823f-ce9d1d4cf16b"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:50:32 crc kubenswrapper[5120]: I0316 15:50:32.837956 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68a56393-5c21-48ab-823f-ce9d1d4cf16b-config-data" (OuterVolumeSpecName: "config-data") pod "68a56393-5c21-48ab-823f-ce9d1d4cf16b" (UID: "68a56393-5c21-48ab-823f-ce9d1d4cf16b"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:50:32 crc kubenswrapper[5120]: I0316 15:50:32.913229 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") on node \"crc\" " Mar 16 15:50:32 crc kubenswrapper[5120]: I0316 15:50:32.913265 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xz4jq\" (UniqueName: \"kubernetes.io/projected/68a56393-5c21-48ab-823f-ce9d1d4cf16b-kube-api-access-xz4jq\") on node \"crc\" DevicePath \"\"" Mar 16 15:50:32 crc kubenswrapper[5120]: I0316 15:50:32.913279 5120 reconciler_common.go:299] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/68a56393-5c21-48ab-823f-ce9d1d4cf16b-credential-keys\") on node \"crc\" DevicePath \"\"" Mar 16 15:50:32 crc kubenswrapper[5120]: I0316 15:50:32.913288 5120 reconciler_common.go:299] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/68a56393-5c21-48ab-823f-ce9d1d4cf16b-fernet-keys\") on node \"crc\" DevicePath \"\"" Mar 16 15:50:32 crc kubenswrapper[5120]: I0316 15:50:32.913296 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s6kkx\" (UniqueName: \"kubernetes.io/projected/ec70b355-598e-40e4-ad36-c95b55db57d1-kube-api-access-s6kkx\") on node \"crc\" DevicePath \"\"" Mar 16 15:50:32 crc kubenswrapper[5120]: I0316 15:50:32.913305 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/ec70b355-598e-40e4-ad36-c95b55db57d1-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 15:50:32 crc kubenswrapper[5120]: I0316 15:50:32.913312 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/68a56393-5c21-48ab-823f-ce9d1d4cf16b-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 15:50:32 crc kubenswrapper[5120]: I0316 15:50:32.913320 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/68a56393-5c21-48ab-823f-ce9d1d4cf16b-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 15:50:32 crc kubenswrapper[5120]: I0316 15:50:32.950978 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage13-crc" (UniqueName: "kubernetes.io/local-volume/local-storage13-crc") on node "crc" Mar 16 15:50:33 crc kubenswrapper[5120]: I0316 15:50:33.014746 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") on node \"crc\" DevicePath \"\"" Mar 16 15:50:33 crc kubenswrapper[5120]: I0316 15:50:33.129233 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:50:33 crc kubenswrapper[5120]: I0316 15:50:33.129222 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"ec70b355-598e-40e4-ad36-c95b55db57d1","Type":"ContainerDied","Data":"7398bae89981eb6a3a1bc51f104a9a2657fcbefc6ce28d0b0314a90ed560ea3c"} Mar 16 15:50:33 crc kubenswrapper[5120]: I0316 15:50:33.133373 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-zmppx" Mar 16 15:50:33 crc kubenswrapper[5120]: I0316 15:50:33.133479 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-zmppx" event={"ID":"68a56393-5c21-48ab-823f-ce9d1d4cf16b","Type":"ContainerDied","Data":"c48bbfff29582743f884744e82315bad578c2ab29cf4123a3ca4aca3802503c9"} Mar 16 15:50:33 crc kubenswrapper[5120]: I0316 15:50:33.133556 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c48bbfff29582743f884744e82315bad578c2ab29cf4123a3ca4aca3802503c9" Mar 16 15:50:33 crc kubenswrapper[5120]: I0316 15:50:33.167540 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 15:50:33 crc kubenswrapper[5120]: I0316 15:50:33.179832 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 15:50:33 crc kubenswrapper[5120]: I0316 15:50:33.186409 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 15:50:33 crc kubenswrapper[5120]: I0316 15:50:33.187326 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec70b355-598e-40e4-ad36-c95b55db57d1" containerName="glance-httpd" Mar 16 15:50:33 crc kubenswrapper[5120]: I0316 15:50:33.187343 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec70b355-598e-40e4-ad36-c95b55db57d1" containerName="glance-httpd" Mar 16 15:50:33 crc kubenswrapper[5120]: I0316 15:50:33.187355 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68a56393-5c21-48ab-823f-ce9d1d4cf16b" containerName="keystone-bootstrap" Mar 16 15:50:33 crc kubenswrapper[5120]: I0316 15:50:33.187361 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="68a56393-5c21-48ab-823f-ce9d1d4cf16b" containerName="keystone-bootstrap" Mar 16 15:50:33 crc kubenswrapper[5120]: I0316 15:50:33.187409 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec70b355-598e-40e4-ad36-c95b55db57d1" containerName="glance-log" Mar 16 15:50:33 crc kubenswrapper[5120]: I0316 15:50:33.187415 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec70b355-598e-40e4-ad36-c95b55db57d1" containerName="glance-log" Mar 16 15:50:33 crc kubenswrapper[5120]: I0316 15:50:33.187553 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ec70b355-598e-40e4-ad36-c95b55db57d1" containerName="glance-log" Mar 16 15:50:33 crc kubenswrapper[5120]: I0316 15:50:33.187571 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="68a56393-5c21-48ab-823f-ce9d1d4cf16b" containerName="keystone-bootstrap" Mar 16 15:50:33 crc kubenswrapper[5120]: I0316 15:50:33.187586 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ec70b355-598e-40e4-ad36-c95b55db57d1" containerName="glance-httpd" Mar 16 15:50:33 crc kubenswrapper[5120]: I0316 15:50:33.194103 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:50:33 crc kubenswrapper[5120]: I0316 15:50:33.196277 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-external-config-data\"" Mar 16 15:50:33 crc kubenswrapper[5120]: I0316 15:50:33.198534 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-public-svc\"" Mar 16 15:50:33 crc kubenswrapper[5120]: I0316 15:50:33.203680 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 15:50:33 crc kubenswrapper[5120]: I0316 15:50:33.320712 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/84bdc010-095b-47fa-af79-b1f91239a35a-config-data\") pod \"glance-default-external-api-0\" (UID: \"84bdc010-095b-47fa-af79-b1f91239a35a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:50:33 crc kubenswrapper[5120]: I0316 15:50:33.320778 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzj2b\" (UniqueName: \"kubernetes.io/projected/84bdc010-095b-47fa-af79-b1f91239a35a-kube-api-access-qzj2b\") pod \"glance-default-external-api-0\" (UID: \"84bdc010-095b-47fa-af79-b1f91239a35a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:50:33 crc kubenswrapper[5120]: I0316 15:50:33.320918 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/84bdc010-095b-47fa-af79-b1f91239a35a-logs\") pod \"glance-default-external-api-0\" (UID: \"84bdc010-095b-47fa-af79-b1f91239a35a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:50:33 crc kubenswrapper[5120]: I0316 15:50:33.320977 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/84bdc010-095b-47fa-af79-b1f91239a35a-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"84bdc010-095b-47fa-af79-b1f91239a35a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:50:33 crc kubenswrapper[5120]: I0316 15:50:33.321001 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/84bdc010-095b-47fa-af79-b1f91239a35a-scripts\") pod \"glance-default-external-api-0\" (UID: \"84bdc010-095b-47fa-af79-b1f91239a35a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:50:33 crc kubenswrapper[5120]: I0316 15:50:33.321028 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/84bdc010-095b-47fa-af79-b1f91239a35a-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"84bdc010-095b-47fa-af79-b1f91239a35a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:50:33 crc kubenswrapper[5120]: I0316 15:50:33.321121 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/84bdc010-095b-47fa-af79-b1f91239a35a-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"84bdc010-095b-47fa-af79-b1f91239a35a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:50:33 crc kubenswrapper[5120]: I0316 15:50:33.321225 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"glance-default-external-api-0\" (UID: \"84bdc010-095b-47fa-af79-b1f91239a35a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:50:33 crc kubenswrapper[5120]: I0316 15:50:33.423220 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/84bdc010-095b-47fa-af79-b1f91239a35a-config-data\") pod \"glance-default-external-api-0\" (UID: \"84bdc010-095b-47fa-af79-b1f91239a35a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:50:33 crc kubenswrapper[5120]: I0316 15:50:33.423281 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qzj2b\" (UniqueName: \"kubernetes.io/projected/84bdc010-095b-47fa-af79-b1f91239a35a-kube-api-access-qzj2b\") pod \"glance-default-external-api-0\" (UID: \"84bdc010-095b-47fa-af79-b1f91239a35a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:50:33 crc kubenswrapper[5120]: I0316 15:50:33.423360 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/84bdc010-095b-47fa-af79-b1f91239a35a-logs\") pod \"glance-default-external-api-0\" (UID: \"84bdc010-095b-47fa-af79-b1f91239a35a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:50:33 crc kubenswrapper[5120]: I0316 15:50:33.423561 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/84bdc010-095b-47fa-af79-b1f91239a35a-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"84bdc010-095b-47fa-af79-b1f91239a35a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:50:33 crc kubenswrapper[5120]: I0316 15:50:33.423590 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/84bdc010-095b-47fa-af79-b1f91239a35a-scripts\") pod \"glance-default-external-api-0\" (UID: \"84bdc010-095b-47fa-af79-b1f91239a35a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:50:33 crc kubenswrapper[5120]: I0316 15:50:33.423615 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/84bdc010-095b-47fa-af79-b1f91239a35a-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"84bdc010-095b-47fa-af79-b1f91239a35a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:50:33 crc kubenswrapper[5120]: I0316 15:50:33.423645 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/84bdc010-095b-47fa-af79-b1f91239a35a-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"84bdc010-095b-47fa-af79-b1f91239a35a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:50:33 crc kubenswrapper[5120]: I0316 15:50:33.423709 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"glance-default-external-api-0\" (UID: \"84bdc010-095b-47fa-af79-b1f91239a35a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:50:33 crc kubenswrapper[5120]: I0316 15:50:33.424073 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"glance-default-external-api-0\" (UID: \"84bdc010-095b-47fa-af79-b1f91239a35a\") device mount path \"/mnt/openstack/pv13\"" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:50:33 crc kubenswrapper[5120]: I0316 15:50:33.424269 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/84bdc010-095b-47fa-af79-b1f91239a35a-logs\") pod \"glance-default-external-api-0\" (UID: \"84bdc010-095b-47fa-af79-b1f91239a35a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:50:33 crc kubenswrapper[5120]: I0316 15:50:33.425485 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/84bdc010-095b-47fa-af79-b1f91239a35a-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"84bdc010-095b-47fa-af79-b1f91239a35a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:50:33 crc kubenswrapper[5120]: I0316 15:50:33.431494 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/84bdc010-095b-47fa-af79-b1f91239a35a-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"84bdc010-095b-47fa-af79-b1f91239a35a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:50:33 crc kubenswrapper[5120]: I0316 15:50:33.431915 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/84bdc010-095b-47fa-af79-b1f91239a35a-config-data\") pod \"glance-default-external-api-0\" (UID: \"84bdc010-095b-47fa-af79-b1f91239a35a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:50:33 crc kubenswrapper[5120]: I0316 15:50:33.432422 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/84bdc010-095b-47fa-af79-b1f91239a35a-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"84bdc010-095b-47fa-af79-b1f91239a35a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:50:33 crc kubenswrapper[5120]: I0316 15:50:33.432690 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/84bdc010-095b-47fa-af79-b1f91239a35a-scripts\") pod \"glance-default-external-api-0\" (UID: \"84bdc010-095b-47fa-af79-b1f91239a35a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:50:33 crc kubenswrapper[5120]: I0316 15:50:33.439907 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzj2b\" (UniqueName: \"kubernetes.io/projected/84bdc010-095b-47fa-af79-b1f91239a35a-kube-api-access-qzj2b\") pod \"glance-default-external-api-0\" (UID: \"84bdc010-095b-47fa-af79-b1f91239a35a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:50:33 crc kubenswrapper[5120]: I0316 15:50:33.448458 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"glance-default-external-api-0\" (UID: \"84bdc010-095b-47fa-af79-b1f91239a35a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:50:33 crc kubenswrapper[5120]: I0316 15:50:33.523902 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:50:33 crc kubenswrapper[5120]: I0316 15:50:33.744561 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-zmppx"] Mar 16 15:50:33 crc kubenswrapper[5120]: I0316 15:50:33.751024 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-zmppx"] Mar 16 15:50:33 crc kubenswrapper[5120]: I0316 15:50:33.843679 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-jxphs"] Mar 16 15:50:33 crc kubenswrapper[5120]: I0316 15:50:33.948623 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-jxphs"] Mar 16 15:50:33 crc kubenswrapper[5120]: I0316 15:50:33.948798 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-jxphs" Mar 16 15:50:33 crc kubenswrapper[5120]: I0316 15:50:33.950977 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-scripts\"" Mar 16 15:50:33 crc kubenswrapper[5120]: I0316 15:50:33.950979 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"osp-secret\"" Mar 16 15:50:33 crc kubenswrapper[5120]: I0316 15:50:33.952020 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-keystone-dockercfg-qznbk\"" Mar 16 15:50:33 crc kubenswrapper[5120]: I0316 15:50:33.952368 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-config-data\"" Mar 16 15:50:33 crc kubenswrapper[5120]: I0316 15:50:33.952495 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone\"" Mar 16 15:50:34 crc kubenswrapper[5120]: I0316 15:50:34.135244 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/47203a51-c1a7-433b-990b-f7744bc74071-fernet-keys\") pod \"keystone-bootstrap-jxphs\" (UID: \"47203a51-c1a7-433b-990b-f7744bc74071\") " pod="openstack-kuttl-tests/keystone-bootstrap-jxphs" Mar 16 15:50:34 crc kubenswrapper[5120]: I0316 15:50:34.135412 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/47203a51-c1a7-433b-990b-f7744bc74071-combined-ca-bundle\") pod \"keystone-bootstrap-jxphs\" (UID: \"47203a51-c1a7-433b-990b-f7744bc74071\") " pod="openstack-kuttl-tests/keystone-bootstrap-jxphs" Mar 16 15:50:34 crc kubenswrapper[5120]: I0316 15:50:34.135674 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/47203a51-c1a7-433b-990b-f7744bc74071-scripts\") pod \"keystone-bootstrap-jxphs\" (UID: \"47203a51-c1a7-433b-990b-f7744bc74071\") " pod="openstack-kuttl-tests/keystone-bootstrap-jxphs" Mar 16 15:50:34 crc kubenswrapper[5120]: I0316 15:50:34.136089 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/47203a51-c1a7-433b-990b-f7744bc74071-config-data\") pod \"keystone-bootstrap-jxphs\" (UID: \"47203a51-c1a7-433b-990b-f7744bc74071\") " pod="openstack-kuttl-tests/keystone-bootstrap-jxphs" Mar 16 15:50:34 crc kubenswrapper[5120]: I0316 15:50:34.136187 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qv26n\" (UniqueName: \"kubernetes.io/projected/47203a51-c1a7-433b-990b-f7744bc74071-kube-api-access-qv26n\") pod \"keystone-bootstrap-jxphs\" (UID: \"47203a51-c1a7-433b-990b-f7744bc74071\") " pod="openstack-kuttl-tests/keystone-bootstrap-jxphs" Mar 16 15:50:34 crc kubenswrapper[5120]: I0316 15:50:34.136331 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/47203a51-c1a7-433b-990b-f7744bc74071-credential-keys\") pod \"keystone-bootstrap-jxphs\" (UID: \"47203a51-c1a7-433b-990b-f7744bc74071\") " pod="openstack-kuttl-tests/keystone-bootstrap-jxphs" Mar 16 15:50:34 crc kubenswrapper[5120]: I0316 15:50:34.238038 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/47203a51-c1a7-433b-990b-f7744bc74071-scripts\") pod \"keystone-bootstrap-jxphs\" (UID: \"47203a51-c1a7-433b-990b-f7744bc74071\") " pod="openstack-kuttl-tests/keystone-bootstrap-jxphs" Mar 16 15:50:34 crc kubenswrapper[5120]: I0316 15:50:34.238315 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/47203a51-c1a7-433b-990b-f7744bc74071-config-data\") pod \"keystone-bootstrap-jxphs\" (UID: \"47203a51-c1a7-433b-990b-f7744bc74071\") " pod="openstack-kuttl-tests/keystone-bootstrap-jxphs" Mar 16 15:50:34 crc kubenswrapper[5120]: I0316 15:50:34.238378 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qv26n\" (UniqueName: \"kubernetes.io/projected/47203a51-c1a7-433b-990b-f7744bc74071-kube-api-access-qv26n\") pod \"keystone-bootstrap-jxphs\" (UID: \"47203a51-c1a7-433b-990b-f7744bc74071\") " pod="openstack-kuttl-tests/keystone-bootstrap-jxphs" Mar 16 15:50:34 crc kubenswrapper[5120]: I0316 15:50:34.238424 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/47203a51-c1a7-433b-990b-f7744bc74071-credential-keys\") pod \"keystone-bootstrap-jxphs\" (UID: \"47203a51-c1a7-433b-990b-f7744bc74071\") " pod="openstack-kuttl-tests/keystone-bootstrap-jxphs" Mar 16 15:50:34 crc kubenswrapper[5120]: I0316 15:50:34.238528 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/47203a51-c1a7-433b-990b-f7744bc74071-fernet-keys\") pod \"keystone-bootstrap-jxphs\" (UID: \"47203a51-c1a7-433b-990b-f7744bc74071\") " pod="openstack-kuttl-tests/keystone-bootstrap-jxphs" Mar 16 15:50:34 crc kubenswrapper[5120]: I0316 15:50:34.239110 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/47203a51-c1a7-433b-990b-f7744bc74071-combined-ca-bundle\") pod \"keystone-bootstrap-jxphs\" (UID: \"47203a51-c1a7-433b-990b-f7744bc74071\") " pod="openstack-kuttl-tests/keystone-bootstrap-jxphs" Mar 16 15:50:34 crc kubenswrapper[5120]: I0316 15:50:34.242847 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/47203a51-c1a7-433b-990b-f7744bc74071-scripts\") pod \"keystone-bootstrap-jxphs\" (UID: \"47203a51-c1a7-433b-990b-f7744bc74071\") " pod="openstack-kuttl-tests/keystone-bootstrap-jxphs" Mar 16 15:50:34 crc kubenswrapper[5120]: I0316 15:50:34.243321 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/47203a51-c1a7-433b-990b-f7744bc74071-fernet-keys\") pod \"keystone-bootstrap-jxphs\" (UID: \"47203a51-c1a7-433b-990b-f7744bc74071\") " pod="openstack-kuttl-tests/keystone-bootstrap-jxphs" Mar 16 15:50:34 crc kubenswrapper[5120]: I0316 15:50:34.245255 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/47203a51-c1a7-433b-990b-f7744bc74071-config-data\") pod \"keystone-bootstrap-jxphs\" (UID: \"47203a51-c1a7-433b-990b-f7744bc74071\") " pod="openstack-kuttl-tests/keystone-bootstrap-jxphs" Mar 16 15:50:34 crc kubenswrapper[5120]: I0316 15:50:34.246401 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/47203a51-c1a7-433b-990b-f7744bc74071-credential-keys\") pod \"keystone-bootstrap-jxphs\" (UID: \"47203a51-c1a7-433b-990b-f7744bc74071\") " pod="openstack-kuttl-tests/keystone-bootstrap-jxphs" Mar 16 15:50:34 crc kubenswrapper[5120]: I0316 15:50:34.246669 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/47203a51-c1a7-433b-990b-f7744bc74071-combined-ca-bundle\") pod \"keystone-bootstrap-jxphs\" (UID: \"47203a51-c1a7-433b-990b-f7744bc74071\") " pod="openstack-kuttl-tests/keystone-bootstrap-jxphs" Mar 16 15:50:34 crc kubenswrapper[5120]: I0316 15:50:34.255608 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qv26n\" (UniqueName: \"kubernetes.io/projected/47203a51-c1a7-433b-990b-f7744bc74071-kube-api-access-qv26n\") pod \"keystone-bootstrap-jxphs\" (UID: \"47203a51-c1a7-433b-990b-f7744bc74071\") " pod="openstack-kuttl-tests/keystone-bootstrap-jxphs" Mar 16 15:50:34 crc kubenswrapper[5120]: I0316 15:50:34.263629 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-jxphs" Mar 16 15:50:34 crc kubenswrapper[5120]: I0316 15:50:34.686634 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="68a56393-5c21-48ab-823f-ce9d1d4cf16b" path="/var/lib/kubelet/pods/68a56393-5c21-48ab-823f-ce9d1d4cf16b/volumes" Mar 16 15:50:34 crc kubenswrapper[5120]: I0316 15:50:34.688204 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec70b355-598e-40e4-ad36-c95b55db57d1" path="/var/lib/kubelet/pods/ec70b355-598e-40e4-ad36-c95b55db57d1/volumes" Mar 16 15:50:39 crc kubenswrapper[5120]: I0316 15:50:39.184815 5120 generic.go:358] "Generic (PLEG): container finished" podID="4e0214f5-7d2d-4b88-8096-a14ac906d637" containerID="ea54a0abff5bb10b70106fb9ae1f1ebe16eb93672332619135d2135880b47565" exitCode=0 Mar 16 15:50:39 crc kubenswrapper[5120]: I0316 15:50:39.184855 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-htm2c" event={"ID":"4e0214f5-7d2d-4b88-8096-a14ac906d637","Type":"ContainerDied","Data":"ea54a0abff5bb10b70106fb9ae1f1ebe16eb93672332619135d2135880b47565"} Mar 16 15:50:40 crc kubenswrapper[5120]: I0316 15:50:40.438803 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 15:50:41 crc kubenswrapper[5120]: W0316 15:50:41.155670 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4688f659_b142_43b8_af64_5a69b67d8a1f.slice/crio-29ed196fb2345425f19f46288f2d673c15c82583dee1fc6ed4f889a940028bf3 WatchSource:0}: Error finding container 29ed196fb2345425f19f46288f2d673c15c82583dee1fc6ed4f889a940028bf3: Status 404 returned error can't find the container with id 29ed196fb2345425f19f46288f2d673c15c82583dee1fc6ed4f889a940028bf3 Mar 16 15:50:41 crc kubenswrapper[5120]: I0316 15:50:41.165116 5120 scope.go:117] "RemoveContainer" containerID="9c5b7606176759ea0be9457b92fd2b2a7b80b988c286570d04be2f984f98654f" Mar 16 15:50:41 crc kubenswrapper[5120]: E0316 15:50:41.165593 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c5b7606176759ea0be9457b92fd2b2a7b80b988c286570d04be2f984f98654f\": container with ID starting with 9c5b7606176759ea0be9457b92fd2b2a7b80b988c286570d04be2f984f98654f not found: ID does not exist" containerID="9c5b7606176759ea0be9457b92fd2b2a7b80b988c286570d04be2f984f98654f" Mar 16 15:50:41 crc kubenswrapper[5120]: I0316 15:50:41.165650 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c5b7606176759ea0be9457b92fd2b2a7b80b988c286570d04be2f984f98654f"} err="failed to get container status \"9c5b7606176759ea0be9457b92fd2b2a7b80b988c286570d04be2f984f98654f\": rpc error: code = NotFound desc = could not find container \"9c5b7606176759ea0be9457b92fd2b2a7b80b988c286570d04be2f984f98654f\": container with ID starting with 9c5b7606176759ea0be9457b92fd2b2a7b80b988c286570d04be2f984f98654f not found: ID does not exist" Mar 16 15:50:41 crc kubenswrapper[5120]: I0316 15:50:41.165693 5120 scope.go:117] "RemoveContainer" containerID="324e2c740efff3b758338eb9a0da8c93d96b9b2141512ade2f38e68f6cf860b4" Mar 16 15:50:41 crc kubenswrapper[5120]: E0316 15:50:41.165980 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"324e2c740efff3b758338eb9a0da8c93d96b9b2141512ade2f38e68f6cf860b4\": container with ID starting with 324e2c740efff3b758338eb9a0da8c93d96b9b2141512ade2f38e68f6cf860b4 not found: ID does not exist" containerID="324e2c740efff3b758338eb9a0da8c93d96b9b2141512ade2f38e68f6cf860b4" Mar 16 15:50:41 crc kubenswrapper[5120]: I0316 15:50:41.166018 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"324e2c740efff3b758338eb9a0da8c93d96b9b2141512ade2f38e68f6cf860b4"} err="failed to get container status \"324e2c740efff3b758338eb9a0da8c93d96b9b2141512ade2f38e68f6cf860b4\": rpc error: code = NotFound desc = could not find container \"324e2c740efff3b758338eb9a0da8c93d96b9b2141512ade2f38e68f6cf860b4\": container with ID starting with 324e2c740efff3b758338eb9a0da8c93d96b9b2141512ade2f38e68f6cf860b4 not found: ID does not exist" Mar 16 15:50:41 crc kubenswrapper[5120]: I0316 15:50:41.166047 5120 scope.go:117] "RemoveContainer" containerID="9c5b7606176759ea0be9457b92fd2b2a7b80b988c286570d04be2f984f98654f" Mar 16 15:50:41 crc kubenswrapper[5120]: I0316 15:50:41.166336 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c5b7606176759ea0be9457b92fd2b2a7b80b988c286570d04be2f984f98654f"} err="failed to get container status \"9c5b7606176759ea0be9457b92fd2b2a7b80b988c286570d04be2f984f98654f\": rpc error: code = NotFound desc = could not find container \"9c5b7606176759ea0be9457b92fd2b2a7b80b988c286570d04be2f984f98654f\": container with ID starting with 9c5b7606176759ea0be9457b92fd2b2a7b80b988c286570d04be2f984f98654f not found: ID does not exist" Mar 16 15:50:41 crc kubenswrapper[5120]: I0316 15:50:41.166360 5120 scope.go:117] "RemoveContainer" containerID="324e2c740efff3b758338eb9a0da8c93d96b9b2141512ade2f38e68f6cf860b4" Mar 16 15:50:41 crc kubenswrapper[5120]: I0316 15:50:41.166699 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"324e2c740efff3b758338eb9a0da8c93d96b9b2141512ade2f38e68f6cf860b4"} err="failed to get container status \"324e2c740efff3b758338eb9a0da8c93d96b9b2141512ade2f38e68f6cf860b4\": rpc error: code = NotFound desc = could not find container \"324e2c740efff3b758338eb9a0da8c93d96b9b2141512ade2f38e68f6cf860b4\": container with ID starting with 324e2c740efff3b758338eb9a0da8c93d96b9b2141512ade2f38e68f6cf860b4 not found: ID does not exist" Mar 16 15:50:41 crc kubenswrapper[5120]: I0316 15:50:41.166750 5120 scope.go:117] "RemoveContainer" containerID="a41fbfbef8fa5543bb33be9961863f6cedc07c1c259b686a467ac820c54f4caa" Mar 16 15:50:41 crc kubenswrapper[5120]: I0316 15:50:41.206794 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"4688f659-b142-43b8-af64-5a69b67d8a1f","Type":"ContainerStarted","Data":"29ed196fb2345425f19f46288f2d673c15c82583dee1fc6ed4f889a940028bf3"} Mar 16 15:50:41 crc kubenswrapper[5120]: I0316 15:50:41.211068 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-htm2c" event={"ID":"4e0214f5-7d2d-4b88-8096-a14ac906d637","Type":"ContainerDied","Data":"45ac714a70b089e93a7fe4d9fb1a17e9f89c9bbc10bf057ac8f901a5b5aa827b"} Mar 16 15:50:41 crc kubenswrapper[5120]: I0316 15:50:41.211123 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="45ac714a70b089e93a7fe4d9fb1a17e9f89c9bbc10bf057ac8f901a5b5aa827b" Mar 16 15:50:41 crc kubenswrapper[5120]: I0316 15:50:41.343698 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-htm2c" Mar 16 15:50:41 crc kubenswrapper[5120]: I0316 15:50:41.422992 5120 scope.go:117] "RemoveContainer" containerID="e07737b61d231724091d626b2dd14e640201e0f6f84801863a7aa138852f37fc" Mar 16 15:50:41 crc kubenswrapper[5120]: I0316 15:50:41.457112 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4e0214f5-7d2d-4b88-8096-a14ac906d637-combined-ca-bundle\") pod \"4e0214f5-7d2d-4b88-8096-a14ac906d637\" (UID: \"4e0214f5-7d2d-4b88-8096-a14ac906d637\") " Mar 16 15:50:41 crc kubenswrapper[5120]: I0316 15:50:41.457281 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4e0214f5-7d2d-4b88-8096-a14ac906d637-config\") pod \"4e0214f5-7d2d-4b88-8096-a14ac906d637\" (UID: \"4e0214f5-7d2d-4b88-8096-a14ac906d637\") " Mar 16 15:50:41 crc kubenswrapper[5120]: I0316 15:50:41.457403 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pqkxg\" (UniqueName: \"kubernetes.io/projected/4e0214f5-7d2d-4b88-8096-a14ac906d637-kube-api-access-pqkxg\") pod \"4e0214f5-7d2d-4b88-8096-a14ac906d637\" (UID: \"4e0214f5-7d2d-4b88-8096-a14ac906d637\") " Mar 16 15:50:41 crc kubenswrapper[5120]: I0316 15:50:41.463869 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e0214f5-7d2d-4b88-8096-a14ac906d637-kube-api-access-pqkxg" (OuterVolumeSpecName: "kube-api-access-pqkxg") pod "4e0214f5-7d2d-4b88-8096-a14ac906d637" (UID: "4e0214f5-7d2d-4b88-8096-a14ac906d637"). InnerVolumeSpecName "kube-api-access-pqkxg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:50:41 crc kubenswrapper[5120]: I0316 15:50:41.493459 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4e0214f5-7d2d-4b88-8096-a14ac906d637-config" (OuterVolumeSpecName: "config") pod "4e0214f5-7d2d-4b88-8096-a14ac906d637" (UID: "4e0214f5-7d2d-4b88-8096-a14ac906d637"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:50:41 crc kubenswrapper[5120]: I0316 15:50:41.502423 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4e0214f5-7d2d-4b88-8096-a14ac906d637-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "4e0214f5-7d2d-4b88-8096-a14ac906d637" (UID: "4e0214f5-7d2d-4b88-8096-a14ac906d637"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:50:41 crc kubenswrapper[5120]: I0316 15:50:41.569027 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4e0214f5-7d2d-4b88-8096-a14ac906d637-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:50:41 crc kubenswrapper[5120]: I0316 15:50:41.569057 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/4e0214f5-7d2d-4b88-8096-a14ac906d637-config\") on node \"crc\" DevicePath \"\"" Mar 16 15:50:41 crc kubenswrapper[5120]: I0316 15:50:41.569072 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pqkxg\" (UniqueName: \"kubernetes.io/projected/4e0214f5-7d2d-4b88-8096-a14ac906d637-kube-api-access-pqkxg\") on node \"crc\" DevicePath \"\"" Mar 16 15:50:41 crc kubenswrapper[5120]: I0316 15:50:41.631366 5120 scope.go:117] "RemoveContainer" containerID="62ab1858e156bd97c1135e77982c71b107d9816e6aa96ef3185c7ebe3f179f36" Mar 16 15:50:41 crc kubenswrapper[5120]: I0316 15:50:41.695989 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 15:50:41 crc kubenswrapper[5120]: I0316 15:50:41.757242 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-jxphs"] Mar 16 15:50:41 crc kubenswrapper[5120]: W0316 15:50:41.758920 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod84bdc010_095b_47fa_af79_b1f91239a35a.slice/crio-ab9b5d49cf9f9a4f559925b73bd792496b4b283d9c61f39ade6ff7e3ce4405a2 WatchSource:0}: Error finding container ab9b5d49cf9f9a4f559925b73bd792496b4b283d9c61f39ade6ff7e3ce4405a2: Status 404 returned error can't find the container with id ab9b5d49cf9f9a4f559925b73bd792496b4b283d9c61f39ade6ff7e3ce4405a2 Mar 16 15:50:41 crc kubenswrapper[5120]: I0316 15:50:41.800632 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"osp-secret\"" Mar 16 15:50:42 crc kubenswrapper[5120]: I0316 15:50:42.249445 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"2b8e2567-77a1-4c2c-930c-785714326aba","Type":"ContainerStarted","Data":"8f3ec011338adacf108d112a9d9b0d1a3c3bf782a46642ee705a679d20e1ae51"} Mar 16 15:50:42 crc kubenswrapper[5120]: I0316 15:50:42.260370 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"84bdc010-095b-47fa-af79-b1f91239a35a","Type":"ContainerStarted","Data":"ab9b5d49cf9f9a4f559925b73bd792496b4b283d9c61f39ade6ff7e3ce4405a2"} Mar 16 15:50:42 crc kubenswrapper[5120]: I0316 15:50:42.263850 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-jxphs" event={"ID":"47203a51-c1a7-433b-990b-f7744bc74071","Type":"ContainerStarted","Data":"bd5b78c94a2af2bc120c0038a55f5b8f7c033185a2105a274d5a7009b5073efe"} Mar 16 15:50:42 crc kubenswrapper[5120]: I0316 15:50:42.263876 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-jxphs" event={"ID":"47203a51-c1a7-433b-990b-f7744bc74071","Type":"ContainerStarted","Data":"f04a8ed834124c78833d3dc12d90bf97864fb4cbf8914a48c1a4ee683bb8f801"} Mar 16 15:50:42 crc kubenswrapper[5120]: I0316 15:50:42.277338 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"4688f659-b142-43b8-af64-5a69b67d8a1f","Type":"ContainerStarted","Data":"6efab2a50dd424ff12720aea04a4d57ef0c1445fe7abbe636010918437684cf6"} Mar 16 15:50:42 crc kubenswrapper[5120]: I0316 15:50:42.283432 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-5h8xf" event={"ID":"e8b7845d-53d2-4fc9-af50-91a65dc3e247","Type":"ContainerStarted","Data":"77262c38f52838b7813b0801f188c555dac24fc52280dd4023a71f20a2bee610"} Mar 16 15:50:42 crc kubenswrapper[5120]: I0316 15:50:42.289244 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-htm2c" Mar 16 15:50:42 crc kubenswrapper[5120]: I0316 15:50:42.295409 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-h77sx" event={"ID":"d16cf6e5-1b2b-41b7-9a80-070f44bc9a67","Type":"ContainerStarted","Data":"0623ff218303a488dfd0223c2676560e8a4273890ab25b01b479732e5d7e9aaa"} Mar 16 15:50:42 crc kubenswrapper[5120]: I0316 15:50:42.298347 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-bootstrap-jxphs" podStartSLOduration=9.298329019 podStartE2EDuration="9.298329019s" podCreationTimestamp="2026-03-16 15:50:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:50:42.277858373 +0000 UTC m=+1144.431790030" watchObservedRunningTime="2026-03-16 15:50:42.298329019 +0000 UTC m=+1144.452260676" Mar 16 15:50:42 crc kubenswrapper[5120]: I0316 15:50:42.309512 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-db-sync-5h8xf" podStartSLOduration=2.180372726 podStartE2EDuration="26.309497168s" podCreationTimestamp="2026-03-16 15:50:16 +0000 UTC" firstStartedPulling="2026-03-16 15:50:17.10412483 +0000 UTC m=+1119.258056497" lastFinishedPulling="2026-03-16 15:50:41.233249282 +0000 UTC m=+1143.387180939" observedRunningTime="2026-03-16 15:50:42.304022341 +0000 UTC m=+1144.457953998" watchObservedRunningTime="2026-03-16 15:50:42.309497168 +0000 UTC m=+1144.463428825" Mar 16 15:50:42 crc kubenswrapper[5120]: I0316 15:50:42.331358 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-db-sync-h77sx" podStartSLOduration=2.490401653 podStartE2EDuration="26.331335554s" podCreationTimestamp="2026-03-16 15:50:16 +0000 UTC" firstStartedPulling="2026-03-16 15:50:17.397543292 +0000 UTC m=+1119.551474949" lastFinishedPulling="2026-03-16 15:50:41.238477193 +0000 UTC m=+1143.392408850" observedRunningTime="2026-03-16 15:50:42.324478655 +0000 UTC m=+1144.478410322" watchObservedRunningTime="2026-03-16 15:50:42.331335554 +0000 UTC m=+1144.485267211" Mar 16 15:50:42 crc kubenswrapper[5120]: I0316 15:50:42.586842 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-56d94b8cdc-8zpvc"] Mar 16 15:50:42 crc kubenswrapper[5120]: I0316 15:50:42.592680 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e0214f5-7d2d-4b88-8096-a14ac906d637" containerName="neutron-db-sync" Mar 16 15:50:42 crc kubenswrapper[5120]: I0316 15:50:42.592698 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e0214f5-7d2d-4b88-8096-a14ac906d637" containerName="neutron-db-sync" Mar 16 15:50:42 crc kubenswrapper[5120]: I0316 15:50:42.592888 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="4e0214f5-7d2d-4b88-8096-a14ac906d637" containerName="neutron-db-sync" Mar 16 15:50:42 crc kubenswrapper[5120]: I0316 15:50:42.604376 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-56d94b8cdc-8zpvc" Mar 16 15:50:42 crc kubenswrapper[5120]: I0316 15:50:42.606551 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-56d94b8cdc-8zpvc"] Mar 16 15:50:42 crc kubenswrapper[5120]: I0316 15:50:42.613075 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-neutron-ovndbs\"" Mar 16 15:50:42 crc kubenswrapper[5120]: I0316 15:50:42.613226 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-httpd-config\"" Mar 16 15:50:42 crc kubenswrapper[5120]: I0316 15:50:42.613445 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-config\"" Mar 16 15:50:42 crc kubenswrapper[5120]: I0316 15:50:42.613540 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-neutron-dockercfg-7mftq\"" Mar 16 15:50:42 crc kubenswrapper[5120]: I0316 15:50:42.693065 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvclp\" (UniqueName: \"kubernetes.io/projected/37731388-5538-4f93-90a7-8a8ffe5abcd7-kube-api-access-wvclp\") pod \"neutron-56d94b8cdc-8zpvc\" (UID: \"37731388-5538-4f93-90a7-8a8ffe5abcd7\") " pod="openstack-kuttl-tests/neutron-56d94b8cdc-8zpvc" Mar 16 15:50:42 crc kubenswrapper[5120]: I0316 15:50:42.693111 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/37731388-5538-4f93-90a7-8a8ffe5abcd7-combined-ca-bundle\") pod \"neutron-56d94b8cdc-8zpvc\" (UID: \"37731388-5538-4f93-90a7-8a8ffe5abcd7\") " pod="openstack-kuttl-tests/neutron-56d94b8cdc-8zpvc" Mar 16 15:50:42 crc kubenswrapper[5120]: I0316 15:50:42.693135 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/37731388-5538-4f93-90a7-8a8ffe5abcd7-config\") pod \"neutron-56d94b8cdc-8zpvc\" (UID: \"37731388-5538-4f93-90a7-8a8ffe5abcd7\") " pod="openstack-kuttl-tests/neutron-56d94b8cdc-8zpvc" Mar 16 15:50:42 crc kubenswrapper[5120]: I0316 15:50:42.693273 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/37731388-5538-4f93-90a7-8a8ffe5abcd7-ovndb-tls-certs\") pod \"neutron-56d94b8cdc-8zpvc\" (UID: \"37731388-5538-4f93-90a7-8a8ffe5abcd7\") " pod="openstack-kuttl-tests/neutron-56d94b8cdc-8zpvc" Mar 16 15:50:42 crc kubenswrapper[5120]: I0316 15:50:42.693376 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/37731388-5538-4f93-90a7-8a8ffe5abcd7-httpd-config\") pod \"neutron-56d94b8cdc-8zpvc\" (UID: \"37731388-5538-4f93-90a7-8a8ffe5abcd7\") " pod="openstack-kuttl-tests/neutron-56d94b8cdc-8zpvc" Mar 16 15:50:42 crc kubenswrapper[5120]: I0316 15:50:42.794960 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wvclp\" (UniqueName: \"kubernetes.io/projected/37731388-5538-4f93-90a7-8a8ffe5abcd7-kube-api-access-wvclp\") pod \"neutron-56d94b8cdc-8zpvc\" (UID: \"37731388-5538-4f93-90a7-8a8ffe5abcd7\") " pod="openstack-kuttl-tests/neutron-56d94b8cdc-8zpvc" Mar 16 15:50:42 crc kubenswrapper[5120]: I0316 15:50:42.795014 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/37731388-5538-4f93-90a7-8a8ffe5abcd7-combined-ca-bundle\") pod \"neutron-56d94b8cdc-8zpvc\" (UID: \"37731388-5538-4f93-90a7-8a8ffe5abcd7\") " pod="openstack-kuttl-tests/neutron-56d94b8cdc-8zpvc" Mar 16 15:50:42 crc kubenswrapper[5120]: I0316 15:50:42.795060 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/37731388-5538-4f93-90a7-8a8ffe5abcd7-config\") pod \"neutron-56d94b8cdc-8zpvc\" (UID: \"37731388-5538-4f93-90a7-8a8ffe5abcd7\") " pod="openstack-kuttl-tests/neutron-56d94b8cdc-8zpvc" Mar 16 15:50:42 crc kubenswrapper[5120]: I0316 15:50:42.795091 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/37731388-5538-4f93-90a7-8a8ffe5abcd7-ovndb-tls-certs\") pod \"neutron-56d94b8cdc-8zpvc\" (UID: \"37731388-5538-4f93-90a7-8a8ffe5abcd7\") " pod="openstack-kuttl-tests/neutron-56d94b8cdc-8zpvc" Mar 16 15:50:42 crc kubenswrapper[5120]: I0316 15:50:42.795126 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/37731388-5538-4f93-90a7-8a8ffe5abcd7-httpd-config\") pod \"neutron-56d94b8cdc-8zpvc\" (UID: \"37731388-5538-4f93-90a7-8a8ffe5abcd7\") " pod="openstack-kuttl-tests/neutron-56d94b8cdc-8zpvc" Mar 16 15:50:42 crc kubenswrapper[5120]: I0316 15:50:42.803618 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/37731388-5538-4f93-90a7-8a8ffe5abcd7-combined-ca-bundle\") pod \"neutron-56d94b8cdc-8zpvc\" (UID: \"37731388-5538-4f93-90a7-8a8ffe5abcd7\") " pod="openstack-kuttl-tests/neutron-56d94b8cdc-8zpvc" Mar 16 15:50:42 crc kubenswrapper[5120]: I0316 15:50:42.804260 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/37731388-5538-4f93-90a7-8a8ffe5abcd7-ovndb-tls-certs\") pod \"neutron-56d94b8cdc-8zpvc\" (UID: \"37731388-5538-4f93-90a7-8a8ffe5abcd7\") " pod="openstack-kuttl-tests/neutron-56d94b8cdc-8zpvc" Mar 16 15:50:42 crc kubenswrapper[5120]: I0316 15:50:42.807302 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/37731388-5538-4f93-90a7-8a8ffe5abcd7-config\") pod \"neutron-56d94b8cdc-8zpvc\" (UID: \"37731388-5538-4f93-90a7-8a8ffe5abcd7\") " pod="openstack-kuttl-tests/neutron-56d94b8cdc-8zpvc" Mar 16 15:50:42 crc kubenswrapper[5120]: I0316 15:50:42.812194 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvclp\" (UniqueName: \"kubernetes.io/projected/37731388-5538-4f93-90a7-8a8ffe5abcd7-kube-api-access-wvclp\") pod \"neutron-56d94b8cdc-8zpvc\" (UID: \"37731388-5538-4f93-90a7-8a8ffe5abcd7\") " pod="openstack-kuttl-tests/neutron-56d94b8cdc-8zpvc" Mar 16 15:50:42 crc kubenswrapper[5120]: I0316 15:50:42.814060 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/37731388-5538-4f93-90a7-8a8ffe5abcd7-httpd-config\") pod \"neutron-56d94b8cdc-8zpvc\" (UID: \"37731388-5538-4f93-90a7-8a8ffe5abcd7\") " pod="openstack-kuttl-tests/neutron-56d94b8cdc-8zpvc" Mar 16 15:50:42 crc kubenswrapper[5120]: I0316 15:50:42.952092 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-56d94b8cdc-8zpvc" Mar 16 15:50:43 crc kubenswrapper[5120]: I0316 15:50:43.323206 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"4688f659-b142-43b8-af64-5a69b67d8a1f","Type":"ContainerStarted","Data":"187af767aa2963715d689e6cb76167e7a0574b85afe9feff2aeaef9b6bdc8ebd"} Mar 16 15:50:43 crc kubenswrapper[5120]: I0316 15:50:43.339072 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-gwbbm" event={"ID":"2645c221-c2bd-4cd3-a073-9396a5a87708","Type":"ContainerStarted","Data":"db813feb04160a39dff817cfca02fbe3ad8df30c5a792ec7d41c63f6f169b7bd"} Mar 16 15:50:43 crc kubenswrapper[5120]: I0316 15:50:43.345354 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-internal-api-0" podStartSLOduration=22.345339436 podStartE2EDuration="22.345339436s" podCreationTimestamp="2026-03-16 15:50:21 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:50:43.343521254 +0000 UTC m=+1145.497452901" watchObservedRunningTime="2026-03-16 15:50:43.345339436 +0000 UTC m=+1145.499271093" Mar 16 15:50:43 crc kubenswrapper[5120]: I0316 15:50:43.357053 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"84bdc010-095b-47fa-af79-b1f91239a35a","Type":"ContainerStarted","Data":"3b39f68cca86722fc7d5f82cdfc477598e703c03c9b19c8972da41f9ede69798"} Mar 16 15:50:43 crc kubenswrapper[5120]: I0316 15:50:43.368284 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-db-sync-gwbbm" podStartSLOduration=2.9705426900000003 podStartE2EDuration="27.368266348s" podCreationTimestamp="2026-03-16 15:50:16 +0000 UTC" firstStartedPulling="2026-03-16 15:50:16.897167085 +0000 UTC m=+1119.051098742" lastFinishedPulling="2026-03-16 15:50:41.294890733 +0000 UTC m=+1143.448822400" observedRunningTime="2026-03-16 15:50:43.361708056 +0000 UTC m=+1145.515639713" watchObservedRunningTime="2026-03-16 15:50:43.368266348 +0000 UTC m=+1145.522198005" Mar 16 15:50:43 crc kubenswrapper[5120]: I0316 15:50:43.479280 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-56d94b8cdc-8zpvc"] Mar 16 15:50:44 crc kubenswrapper[5120]: I0316 15:50:44.366564 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-56d94b8cdc-8zpvc" event={"ID":"37731388-5538-4f93-90a7-8a8ffe5abcd7","Type":"ContainerStarted","Data":"8ad2f1ceea6abdbbcecbea620ba57dd5d40f476336ecd310d09c97e9aac94fb7"} Mar 16 15:50:44 crc kubenswrapper[5120]: I0316 15:50:44.367135 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-56d94b8cdc-8zpvc" event={"ID":"37731388-5538-4f93-90a7-8a8ffe5abcd7","Type":"ContainerStarted","Data":"d194e0860a6990a4c97de070d3cae4af2424469b57931ed8a173878c4f581016"} Mar 16 15:50:44 crc kubenswrapper[5120]: I0316 15:50:44.368473 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"84bdc010-095b-47fa-af79-b1f91239a35a","Type":"ContainerStarted","Data":"1d9c9b9eae9bd171927816b160679d4b48c3472eafea794426d88169c08e7a5f"} Mar 16 15:50:44 crc kubenswrapper[5120]: I0316 15:50:44.391199 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-external-api-0" podStartSLOduration=11.391183567 podStartE2EDuration="11.391183567s" podCreationTimestamp="2026-03-16 15:50:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:50:44.38964708 +0000 UTC m=+1146.543578737" watchObservedRunningTime="2026-03-16 15:50:44.391183567 +0000 UTC m=+1146.545115234" Mar 16 15:50:44 crc kubenswrapper[5120]: I0316 15:50:44.489058 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-7f6c9f6f6b-qv54h"] Mar 16 15:50:44 crc kubenswrapper[5120]: I0316 15:50:44.496122 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-7f6c9f6f6b-qv54h" Mar 16 15:50:44 crc kubenswrapper[5120]: I0316 15:50:44.498113 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-7f6c9f6f6b-qv54h"] Mar 16 15:50:44 crc kubenswrapper[5120]: I0316 15:50:44.498709 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-neutron-internal-svc\"" Mar 16 15:50:44 crc kubenswrapper[5120]: I0316 15:50:44.499970 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-neutron-public-svc\"" Mar 16 15:50:44 crc kubenswrapper[5120]: I0316 15:50:44.554747 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8fdf4d7a-1d6c-47e3-a8c4-e0900e78ef51-combined-ca-bundle\") pod \"neutron-7f6c9f6f6b-qv54h\" (UID: \"8fdf4d7a-1d6c-47e3-a8c4-e0900e78ef51\") " pod="openstack-kuttl-tests/neutron-7f6c9f6f6b-qv54h" Mar 16 15:50:44 crc kubenswrapper[5120]: I0316 15:50:44.554824 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/8fdf4d7a-1d6c-47e3-a8c4-e0900e78ef51-ovndb-tls-certs\") pod \"neutron-7f6c9f6f6b-qv54h\" (UID: \"8fdf4d7a-1d6c-47e3-a8c4-e0900e78ef51\") " pod="openstack-kuttl-tests/neutron-7f6c9f6f6b-qv54h" Mar 16 15:50:44 crc kubenswrapper[5120]: I0316 15:50:44.554858 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-522pm\" (UniqueName: \"kubernetes.io/projected/8fdf4d7a-1d6c-47e3-a8c4-e0900e78ef51-kube-api-access-522pm\") pod \"neutron-7f6c9f6f6b-qv54h\" (UID: \"8fdf4d7a-1d6c-47e3-a8c4-e0900e78ef51\") " pod="openstack-kuttl-tests/neutron-7f6c9f6f6b-qv54h" Mar 16 15:50:44 crc kubenswrapper[5120]: I0316 15:50:44.554876 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/8fdf4d7a-1d6c-47e3-a8c4-e0900e78ef51-httpd-config\") pod \"neutron-7f6c9f6f6b-qv54h\" (UID: \"8fdf4d7a-1d6c-47e3-a8c4-e0900e78ef51\") " pod="openstack-kuttl-tests/neutron-7f6c9f6f6b-qv54h" Mar 16 15:50:44 crc kubenswrapper[5120]: I0316 15:50:44.554913 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8fdf4d7a-1d6c-47e3-a8c4-e0900e78ef51-config\") pod \"neutron-7f6c9f6f6b-qv54h\" (UID: \"8fdf4d7a-1d6c-47e3-a8c4-e0900e78ef51\") " pod="openstack-kuttl-tests/neutron-7f6c9f6f6b-qv54h" Mar 16 15:50:44 crc kubenswrapper[5120]: I0316 15:50:44.554931 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/8fdf4d7a-1d6c-47e3-a8c4-e0900e78ef51-public-tls-certs\") pod \"neutron-7f6c9f6f6b-qv54h\" (UID: \"8fdf4d7a-1d6c-47e3-a8c4-e0900e78ef51\") " pod="openstack-kuttl-tests/neutron-7f6c9f6f6b-qv54h" Mar 16 15:50:44 crc kubenswrapper[5120]: I0316 15:50:44.555000 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/8fdf4d7a-1d6c-47e3-a8c4-e0900e78ef51-internal-tls-certs\") pod \"neutron-7f6c9f6f6b-qv54h\" (UID: \"8fdf4d7a-1d6c-47e3-a8c4-e0900e78ef51\") " pod="openstack-kuttl-tests/neutron-7f6c9f6f6b-qv54h" Mar 16 15:50:44 crc kubenswrapper[5120]: I0316 15:50:44.655885 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8fdf4d7a-1d6c-47e3-a8c4-e0900e78ef51-combined-ca-bundle\") pod \"neutron-7f6c9f6f6b-qv54h\" (UID: \"8fdf4d7a-1d6c-47e3-a8c4-e0900e78ef51\") " pod="openstack-kuttl-tests/neutron-7f6c9f6f6b-qv54h" Mar 16 15:50:44 crc kubenswrapper[5120]: I0316 15:50:44.656218 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/8fdf4d7a-1d6c-47e3-a8c4-e0900e78ef51-ovndb-tls-certs\") pod \"neutron-7f6c9f6f6b-qv54h\" (UID: \"8fdf4d7a-1d6c-47e3-a8c4-e0900e78ef51\") " pod="openstack-kuttl-tests/neutron-7f6c9f6f6b-qv54h" Mar 16 15:50:44 crc kubenswrapper[5120]: I0316 15:50:44.656249 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-522pm\" (UniqueName: \"kubernetes.io/projected/8fdf4d7a-1d6c-47e3-a8c4-e0900e78ef51-kube-api-access-522pm\") pod \"neutron-7f6c9f6f6b-qv54h\" (UID: \"8fdf4d7a-1d6c-47e3-a8c4-e0900e78ef51\") " pod="openstack-kuttl-tests/neutron-7f6c9f6f6b-qv54h" Mar 16 15:50:44 crc kubenswrapper[5120]: I0316 15:50:44.656269 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/8fdf4d7a-1d6c-47e3-a8c4-e0900e78ef51-httpd-config\") pod \"neutron-7f6c9f6f6b-qv54h\" (UID: \"8fdf4d7a-1d6c-47e3-a8c4-e0900e78ef51\") " pod="openstack-kuttl-tests/neutron-7f6c9f6f6b-qv54h" Mar 16 15:50:44 crc kubenswrapper[5120]: I0316 15:50:44.656307 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8fdf4d7a-1d6c-47e3-a8c4-e0900e78ef51-config\") pod \"neutron-7f6c9f6f6b-qv54h\" (UID: \"8fdf4d7a-1d6c-47e3-a8c4-e0900e78ef51\") " pod="openstack-kuttl-tests/neutron-7f6c9f6f6b-qv54h" Mar 16 15:50:44 crc kubenswrapper[5120]: I0316 15:50:44.656323 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/8fdf4d7a-1d6c-47e3-a8c4-e0900e78ef51-public-tls-certs\") pod \"neutron-7f6c9f6f6b-qv54h\" (UID: \"8fdf4d7a-1d6c-47e3-a8c4-e0900e78ef51\") " pod="openstack-kuttl-tests/neutron-7f6c9f6f6b-qv54h" Mar 16 15:50:44 crc kubenswrapper[5120]: I0316 15:50:44.656401 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/8fdf4d7a-1d6c-47e3-a8c4-e0900e78ef51-internal-tls-certs\") pod \"neutron-7f6c9f6f6b-qv54h\" (UID: \"8fdf4d7a-1d6c-47e3-a8c4-e0900e78ef51\") " pod="openstack-kuttl-tests/neutron-7f6c9f6f6b-qv54h" Mar 16 15:50:44 crc kubenswrapper[5120]: I0316 15:50:44.662289 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8fdf4d7a-1d6c-47e3-a8c4-e0900e78ef51-combined-ca-bundle\") pod \"neutron-7f6c9f6f6b-qv54h\" (UID: \"8fdf4d7a-1d6c-47e3-a8c4-e0900e78ef51\") " pod="openstack-kuttl-tests/neutron-7f6c9f6f6b-qv54h" Mar 16 15:50:44 crc kubenswrapper[5120]: I0316 15:50:44.670371 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/8fdf4d7a-1d6c-47e3-a8c4-e0900e78ef51-httpd-config\") pod \"neutron-7f6c9f6f6b-qv54h\" (UID: \"8fdf4d7a-1d6c-47e3-a8c4-e0900e78ef51\") " pod="openstack-kuttl-tests/neutron-7f6c9f6f6b-qv54h" Mar 16 15:50:44 crc kubenswrapper[5120]: I0316 15:50:44.672958 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/8fdf4d7a-1d6c-47e3-a8c4-e0900e78ef51-config\") pod \"neutron-7f6c9f6f6b-qv54h\" (UID: \"8fdf4d7a-1d6c-47e3-a8c4-e0900e78ef51\") " pod="openstack-kuttl-tests/neutron-7f6c9f6f6b-qv54h" Mar 16 15:50:44 crc kubenswrapper[5120]: I0316 15:50:44.675209 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/8fdf4d7a-1d6c-47e3-a8c4-e0900e78ef51-ovndb-tls-certs\") pod \"neutron-7f6c9f6f6b-qv54h\" (UID: \"8fdf4d7a-1d6c-47e3-a8c4-e0900e78ef51\") " pod="openstack-kuttl-tests/neutron-7f6c9f6f6b-qv54h" Mar 16 15:50:44 crc kubenswrapper[5120]: I0316 15:50:44.679374 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/8fdf4d7a-1d6c-47e3-a8c4-e0900e78ef51-internal-tls-certs\") pod \"neutron-7f6c9f6f6b-qv54h\" (UID: \"8fdf4d7a-1d6c-47e3-a8c4-e0900e78ef51\") " pod="openstack-kuttl-tests/neutron-7f6c9f6f6b-qv54h" Mar 16 15:50:44 crc kubenswrapper[5120]: I0316 15:50:44.683899 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/8fdf4d7a-1d6c-47e3-a8c4-e0900e78ef51-public-tls-certs\") pod \"neutron-7f6c9f6f6b-qv54h\" (UID: \"8fdf4d7a-1d6c-47e3-a8c4-e0900e78ef51\") " pod="openstack-kuttl-tests/neutron-7f6c9f6f6b-qv54h" Mar 16 15:50:44 crc kubenswrapper[5120]: I0316 15:50:44.689517 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-522pm\" (UniqueName: \"kubernetes.io/projected/8fdf4d7a-1d6c-47e3-a8c4-e0900e78ef51-kube-api-access-522pm\") pod \"neutron-7f6c9f6f6b-qv54h\" (UID: \"8fdf4d7a-1d6c-47e3-a8c4-e0900e78ef51\") " pod="openstack-kuttl-tests/neutron-7f6c9f6f6b-qv54h" Mar 16 15:50:44 crc kubenswrapper[5120]: I0316 15:50:44.813569 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-7f6c9f6f6b-qv54h" Mar 16 15:50:45 crc kubenswrapper[5120]: I0316 15:50:45.319823 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-7f6c9f6f6b-qv54h"] Mar 16 15:50:45 crc kubenswrapper[5120]: I0316 15:50:45.383310 5120 generic.go:358] "Generic (PLEG): container finished" podID="e8b7845d-53d2-4fc9-af50-91a65dc3e247" containerID="77262c38f52838b7813b0801f188c555dac24fc52280dd4023a71f20a2bee610" exitCode=0 Mar 16 15:50:45 crc kubenswrapper[5120]: I0316 15:50:45.384411 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-5h8xf" event={"ID":"e8b7845d-53d2-4fc9-af50-91a65dc3e247","Type":"ContainerDied","Data":"77262c38f52838b7813b0801f188c555dac24fc52280dd4023a71f20a2bee610"} Mar 16 15:50:45 crc kubenswrapper[5120]: I0316 15:50:45.394092 5120 generic.go:358] "Generic (PLEG): container finished" podID="d16cf6e5-1b2b-41b7-9a80-070f44bc9a67" containerID="0623ff218303a488dfd0223c2676560e8a4273890ab25b01b479732e5d7e9aaa" exitCode=0 Mar 16 15:50:45 crc kubenswrapper[5120]: I0316 15:50:45.394205 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-h77sx" event={"ID":"d16cf6e5-1b2b-41b7-9a80-070f44bc9a67","Type":"ContainerDied","Data":"0623ff218303a488dfd0223c2676560e8a4273890ab25b01b479732e5d7e9aaa"} Mar 16 15:50:45 crc kubenswrapper[5120]: I0316 15:50:45.405201 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-56d94b8cdc-8zpvc" event={"ID":"37731388-5538-4f93-90a7-8a8ffe5abcd7","Type":"ContainerStarted","Data":"0d4e2b197b0ef1ebb8a8f1d03820151293162b2dc3dad1d4bb530bd501540414"} Mar 16 15:50:45 crc kubenswrapper[5120]: I0316 15:50:45.408258 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/neutron-56d94b8cdc-8zpvc" Mar 16 15:50:45 crc kubenswrapper[5120]: I0316 15:50:45.417199 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"2b8e2567-77a1-4c2c-930c-785714326aba","Type":"ContainerStarted","Data":"739d3405378f4c1a76e93ce39cee573eed5465f23533719b6e3645831f51b9f0"} Mar 16 15:50:45 crc kubenswrapper[5120]: I0316 15:50:45.425040 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-7f6c9f6f6b-qv54h" event={"ID":"8fdf4d7a-1d6c-47e3-a8c4-e0900e78ef51","Type":"ContainerStarted","Data":"1e34796042848d51ac0ac3651832efe01f865c302cd13cfb64e0d04caeaa54e8"} Mar 16 15:50:45 crc kubenswrapper[5120]: I0316 15:50:45.452199 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-56d94b8cdc-8zpvc" podStartSLOduration=3.452180778 podStartE2EDuration="3.452180778s" podCreationTimestamp="2026-03-16 15:50:42 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:50:45.446538377 +0000 UTC m=+1147.600470034" watchObservedRunningTime="2026-03-16 15:50:45.452180778 +0000 UTC m=+1147.606112435" Mar 16 15:50:46 crc kubenswrapper[5120]: I0316 15:50:46.432000 5120 generic.go:358] "Generic (PLEG): container finished" podID="47203a51-c1a7-433b-990b-f7744bc74071" containerID="bd5b78c94a2af2bc120c0038a55f5b8f7c033185a2105a274d5a7009b5073efe" exitCode=0 Mar 16 15:50:46 crc kubenswrapper[5120]: I0316 15:50:46.432118 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-jxphs" event={"ID":"47203a51-c1a7-433b-990b-f7744bc74071","Type":"ContainerDied","Data":"bd5b78c94a2af2bc120c0038a55f5b8f7c033185a2105a274d5a7009b5073efe"} Mar 16 15:50:46 crc kubenswrapper[5120]: I0316 15:50:46.436334 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-7f6c9f6f6b-qv54h" event={"ID":"8fdf4d7a-1d6c-47e3-a8c4-e0900e78ef51","Type":"ContainerStarted","Data":"b33de3cddb1596a233d277fc122981f66f0fd8c7d985bbca12755aaf0bafe2de"} Mar 16 15:50:46 crc kubenswrapper[5120]: I0316 15:50:46.436379 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-7f6c9f6f6b-qv54h" event={"ID":"8fdf4d7a-1d6c-47e3-a8c4-e0900e78ef51","Type":"ContainerStarted","Data":"7560f268f978a4e61823149834cb56d5c6a3ab23c787810da375f01c548d3410"} Mar 16 15:50:46 crc kubenswrapper[5120]: I0316 15:50:46.477943 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-7f6c9f6f6b-qv54h" podStartSLOduration=2.477920032 podStartE2EDuration="2.477920032s" podCreationTimestamp="2026-03-16 15:50:44 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:50:46.464142192 +0000 UTC m=+1148.618073849" watchObservedRunningTime="2026-03-16 15:50:46.477920032 +0000 UTC m=+1148.631851689" Mar 16 15:50:46 crc kubenswrapper[5120]: I0316 15:50:46.980946 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-h77sx" Mar 16 15:50:46 crc kubenswrapper[5120]: I0316 15:50:46.989291 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-5h8xf" Mar 16 15:50:47 crc kubenswrapper[5120]: I0316 15:50:47.099022 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d16cf6e5-1b2b-41b7-9a80-070f44bc9a67-scripts\") pod \"d16cf6e5-1b2b-41b7-9a80-070f44bc9a67\" (UID: \"d16cf6e5-1b2b-41b7-9a80-070f44bc9a67\") " Mar 16 15:50:47 crc kubenswrapper[5120]: I0316 15:50:47.099112 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d16cf6e5-1b2b-41b7-9a80-070f44bc9a67-config-data\") pod \"d16cf6e5-1b2b-41b7-9a80-070f44bc9a67\" (UID: \"d16cf6e5-1b2b-41b7-9a80-070f44bc9a67\") " Mar 16 15:50:47 crc kubenswrapper[5120]: I0316 15:50:47.099149 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/e8b7845d-53d2-4fc9-af50-91a65dc3e247-db-sync-config-data\") pod \"e8b7845d-53d2-4fc9-af50-91a65dc3e247\" (UID: \"e8b7845d-53d2-4fc9-af50-91a65dc3e247\") " Mar 16 15:50:47 crc kubenswrapper[5120]: I0316 15:50:47.099176 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rf5j9\" (UniqueName: \"kubernetes.io/projected/d16cf6e5-1b2b-41b7-9a80-070f44bc9a67-kube-api-access-rf5j9\") pod \"d16cf6e5-1b2b-41b7-9a80-070f44bc9a67\" (UID: \"d16cf6e5-1b2b-41b7-9a80-070f44bc9a67\") " Mar 16 15:50:47 crc kubenswrapper[5120]: I0316 15:50:47.099234 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d16cf6e5-1b2b-41b7-9a80-070f44bc9a67-logs\") pod \"d16cf6e5-1b2b-41b7-9a80-070f44bc9a67\" (UID: \"d16cf6e5-1b2b-41b7-9a80-070f44bc9a67\") " Mar 16 15:50:47 crc kubenswrapper[5120]: I0316 15:50:47.099248 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-trqhp\" (UniqueName: \"kubernetes.io/projected/e8b7845d-53d2-4fc9-af50-91a65dc3e247-kube-api-access-trqhp\") pod \"e8b7845d-53d2-4fc9-af50-91a65dc3e247\" (UID: \"e8b7845d-53d2-4fc9-af50-91a65dc3e247\") " Mar 16 15:50:47 crc kubenswrapper[5120]: I0316 15:50:47.099280 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e8b7845d-53d2-4fc9-af50-91a65dc3e247-combined-ca-bundle\") pod \"e8b7845d-53d2-4fc9-af50-91a65dc3e247\" (UID: \"e8b7845d-53d2-4fc9-af50-91a65dc3e247\") " Mar 16 15:50:47 crc kubenswrapper[5120]: I0316 15:50:47.099350 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d16cf6e5-1b2b-41b7-9a80-070f44bc9a67-combined-ca-bundle\") pod \"d16cf6e5-1b2b-41b7-9a80-070f44bc9a67\" (UID: \"d16cf6e5-1b2b-41b7-9a80-070f44bc9a67\") " Mar 16 15:50:47 crc kubenswrapper[5120]: I0316 15:50:47.099998 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d16cf6e5-1b2b-41b7-9a80-070f44bc9a67-logs" (OuterVolumeSpecName: "logs") pod "d16cf6e5-1b2b-41b7-9a80-070f44bc9a67" (UID: "d16cf6e5-1b2b-41b7-9a80-070f44bc9a67"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:50:47 crc kubenswrapper[5120]: I0316 15:50:47.104924 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d16cf6e5-1b2b-41b7-9a80-070f44bc9a67-kube-api-access-rf5j9" (OuterVolumeSpecName: "kube-api-access-rf5j9") pod "d16cf6e5-1b2b-41b7-9a80-070f44bc9a67" (UID: "d16cf6e5-1b2b-41b7-9a80-070f44bc9a67"). InnerVolumeSpecName "kube-api-access-rf5j9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:50:47 crc kubenswrapper[5120]: I0316 15:50:47.105163 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d16cf6e5-1b2b-41b7-9a80-070f44bc9a67-scripts" (OuterVolumeSpecName: "scripts") pod "d16cf6e5-1b2b-41b7-9a80-070f44bc9a67" (UID: "d16cf6e5-1b2b-41b7-9a80-070f44bc9a67"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:50:47 crc kubenswrapper[5120]: I0316 15:50:47.112945 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8b7845d-53d2-4fc9-af50-91a65dc3e247-db-sync-config-data" (OuterVolumeSpecName: "db-sync-config-data") pod "e8b7845d-53d2-4fc9-af50-91a65dc3e247" (UID: "e8b7845d-53d2-4fc9-af50-91a65dc3e247"). InnerVolumeSpecName "db-sync-config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:50:47 crc kubenswrapper[5120]: I0316 15:50:47.121091 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8b7845d-53d2-4fc9-af50-91a65dc3e247-kube-api-access-trqhp" (OuterVolumeSpecName: "kube-api-access-trqhp") pod "e8b7845d-53d2-4fc9-af50-91a65dc3e247" (UID: "e8b7845d-53d2-4fc9-af50-91a65dc3e247"). InnerVolumeSpecName "kube-api-access-trqhp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:50:47 crc kubenswrapper[5120]: I0316 15:50:47.126123 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8b7845d-53d2-4fc9-af50-91a65dc3e247-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e8b7845d-53d2-4fc9-af50-91a65dc3e247" (UID: "e8b7845d-53d2-4fc9-af50-91a65dc3e247"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:50:47 crc kubenswrapper[5120]: I0316 15:50:47.126866 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d16cf6e5-1b2b-41b7-9a80-070f44bc9a67-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "d16cf6e5-1b2b-41b7-9a80-070f44bc9a67" (UID: "d16cf6e5-1b2b-41b7-9a80-070f44bc9a67"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:50:47 crc kubenswrapper[5120]: I0316 15:50:47.140323 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d16cf6e5-1b2b-41b7-9a80-070f44bc9a67-config-data" (OuterVolumeSpecName: "config-data") pod "d16cf6e5-1b2b-41b7-9a80-070f44bc9a67" (UID: "d16cf6e5-1b2b-41b7-9a80-070f44bc9a67"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:50:47 crc kubenswrapper[5120]: I0316 15:50:47.201672 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d16cf6e5-1b2b-41b7-9a80-070f44bc9a67-logs\") on node \"crc\" DevicePath \"\"" Mar 16 15:50:47 crc kubenswrapper[5120]: I0316 15:50:47.201726 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-trqhp\" (UniqueName: \"kubernetes.io/projected/e8b7845d-53d2-4fc9-af50-91a65dc3e247-kube-api-access-trqhp\") on node \"crc\" DevicePath \"\"" Mar 16 15:50:47 crc kubenswrapper[5120]: I0316 15:50:47.201741 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e8b7845d-53d2-4fc9-af50-91a65dc3e247-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:50:47 crc kubenswrapper[5120]: I0316 15:50:47.201751 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d16cf6e5-1b2b-41b7-9a80-070f44bc9a67-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:50:47 crc kubenswrapper[5120]: I0316 15:50:47.201789 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d16cf6e5-1b2b-41b7-9a80-070f44bc9a67-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 15:50:47 crc kubenswrapper[5120]: I0316 15:50:47.201797 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d16cf6e5-1b2b-41b7-9a80-070f44bc9a67-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 15:50:47 crc kubenswrapper[5120]: I0316 15:50:47.201806 5120 reconciler_common.go:299] "Volume detached for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/e8b7845d-53d2-4fc9-af50-91a65dc3e247-db-sync-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 15:50:47 crc kubenswrapper[5120]: I0316 15:50:47.201814 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rf5j9\" (UniqueName: \"kubernetes.io/projected/d16cf6e5-1b2b-41b7-9a80-070f44bc9a67-kube-api-access-rf5j9\") on node \"crc\" DevicePath \"\"" Mar 16 15:50:47 crc kubenswrapper[5120]: I0316 15:50:47.452438 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-5h8xf" event={"ID":"e8b7845d-53d2-4fc9-af50-91a65dc3e247","Type":"ContainerDied","Data":"6e99f7741bfde91afdc67d55ce9ba537829bd8010b0849c1f3fb19b051180104"} Mar 16 15:50:47 crc kubenswrapper[5120]: I0316 15:50:47.452767 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6e99f7741bfde91afdc67d55ce9ba537829bd8010b0849c1f3fb19b051180104" Mar 16 15:50:47 crc kubenswrapper[5120]: I0316 15:50:47.452826 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-5h8xf" Mar 16 15:50:47 crc kubenswrapper[5120]: I0316 15:50:47.457129 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-h77sx" Mar 16 15:50:47 crc kubenswrapper[5120]: I0316 15:50:47.457124 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-h77sx" event={"ID":"d16cf6e5-1b2b-41b7-9a80-070f44bc9a67","Type":"ContainerDied","Data":"b155ef47a9bcd558e67e03840ea5484044bcf8e1411a9bb5e93a42a6911e723c"} Mar 16 15:50:47 crc kubenswrapper[5120]: I0316 15:50:47.457445 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b155ef47a9bcd558e67e03840ea5484044bcf8e1411a9bb5e93a42a6911e723c" Mar 16 15:50:47 crc kubenswrapper[5120]: I0316 15:50:47.459037 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/neutron-7f6c9f6f6b-qv54h" Mar 16 15:50:47 crc kubenswrapper[5120]: I0316 15:50:47.615369 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-5b47d59db-lz86c"] Mar 16 15:50:47 crc kubenswrapper[5120]: I0316 15:50:47.616308 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8b7845d-53d2-4fc9-af50-91a65dc3e247" containerName="barbican-db-sync" Mar 16 15:50:47 crc kubenswrapper[5120]: I0316 15:50:47.616326 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8b7845d-53d2-4fc9-af50-91a65dc3e247" containerName="barbican-db-sync" Mar 16 15:50:47 crc kubenswrapper[5120]: I0316 15:50:47.616346 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d16cf6e5-1b2b-41b7-9a80-070f44bc9a67" containerName="placement-db-sync" Mar 16 15:50:47 crc kubenswrapper[5120]: I0316 15:50:47.616354 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="d16cf6e5-1b2b-41b7-9a80-070f44bc9a67" containerName="placement-db-sync" Mar 16 15:50:47 crc kubenswrapper[5120]: I0316 15:50:47.616516 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="d16cf6e5-1b2b-41b7-9a80-070f44bc9a67" containerName="placement-db-sync" Mar 16 15:50:47 crc kubenswrapper[5120]: I0316 15:50:47.616540 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e8b7845d-53d2-4fc9-af50-91a65dc3e247" containerName="barbican-db-sync" Mar 16 15:50:47 crc kubenswrapper[5120]: I0316 15:50:47.863271 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-5b47d59db-lz86c"] Mar 16 15:50:47 crc kubenswrapper[5120]: I0316 15:50:47.863373 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-worker-895d6468c-b4n82"] Mar 16 15:50:47 crc kubenswrapper[5120]: I0316 15:50:47.865016 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-5b47d59db-lz86c" Mar 16 15:50:47 crc kubenswrapper[5120]: I0316 15:50:47.870310 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-scripts\"" Mar 16 15:50:47 crc kubenswrapper[5120]: I0316 15:50:47.870366 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-config-data\"" Mar 16 15:50:47 crc kubenswrapper[5120]: I0316 15:50:47.870574 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-placement-internal-svc\"" Mar 16 15:50:47 crc kubenswrapper[5120]: I0316 15:50:47.870799 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-placement-dockercfg-wbfvm\"" Mar 16 15:50:47 crc kubenswrapper[5120]: I0316 15:50:47.870975 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-placement-public-svc\"" Mar 16 15:50:48 crc kubenswrapper[5120]: I0316 15:50:48.019000 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-895d6468c-b4n82"] Mar 16 15:50:48 crc kubenswrapper[5120]: I0316 15:50:48.019040 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-698fb447c8-kz5xv"] Mar 16 15:50:48 crc kubenswrapper[5120]: I0316 15:50:48.019265 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-895d6468c-b4n82" Mar 16 15:50:48 crc kubenswrapper[5120]: I0316 15:50:48.021401 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-worker-config-data\"" Mar 16 15:50:48 crc kubenswrapper[5120]: I0316 15:50:48.021889 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-config-data\"" Mar 16 15:50:48 crc kubenswrapper[5120]: I0316 15:50:48.024720 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-barbican-dockercfg-2gqvh\"" Mar 16 15:50:48 crc kubenswrapper[5120]: I0316 15:50:48.027123 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6b459d6b-d4c6-44e9-ae6f-05e060b30042-scripts\") pod \"placement-5b47d59db-lz86c\" (UID: \"6b459d6b-d4c6-44e9-ae6f-05e060b30042\") " pod="openstack-kuttl-tests/placement-5b47d59db-lz86c" Mar 16 15:50:48 crc kubenswrapper[5120]: I0316 15:50:48.027175 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6b459d6b-d4c6-44e9-ae6f-05e060b30042-internal-tls-certs\") pod \"placement-5b47d59db-lz86c\" (UID: \"6b459d6b-d4c6-44e9-ae6f-05e060b30042\") " pod="openstack-kuttl-tests/placement-5b47d59db-lz86c" Mar 16 15:50:48 crc kubenswrapper[5120]: I0316 15:50:48.027218 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6b459d6b-d4c6-44e9-ae6f-05e060b30042-combined-ca-bundle\") pod \"placement-5b47d59db-lz86c\" (UID: \"6b459d6b-d4c6-44e9-ae6f-05e060b30042\") " pod="openstack-kuttl-tests/placement-5b47d59db-lz86c" Mar 16 15:50:48 crc kubenswrapper[5120]: I0316 15:50:48.027251 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6b459d6b-d4c6-44e9-ae6f-05e060b30042-logs\") pod \"placement-5b47d59db-lz86c\" (UID: \"6b459d6b-d4c6-44e9-ae6f-05e060b30042\") " pod="openstack-kuttl-tests/placement-5b47d59db-lz86c" Mar 16 15:50:48 crc kubenswrapper[5120]: I0316 15:50:48.027289 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6b459d6b-d4c6-44e9-ae6f-05e060b30042-config-data\") pod \"placement-5b47d59db-lz86c\" (UID: \"6b459d6b-d4c6-44e9-ae6f-05e060b30042\") " pod="openstack-kuttl-tests/placement-5b47d59db-lz86c" Mar 16 15:50:48 crc kubenswrapper[5120]: I0316 15:50:48.027393 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vw649\" (UniqueName: \"kubernetes.io/projected/6b459d6b-d4c6-44e9-ae6f-05e060b30042-kube-api-access-vw649\") pod \"placement-5b47d59db-lz86c\" (UID: \"6b459d6b-d4c6-44e9-ae6f-05e060b30042\") " pod="openstack-kuttl-tests/placement-5b47d59db-lz86c" Mar 16 15:50:48 crc kubenswrapper[5120]: I0316 15:50:48.027452 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6b459d6b-d4c6-44e9-ae6f-05e060b30042-public-tls-certs\") pod \"placement-5b47d59db-lz86c\" (UID: \"6b459d6b-d4c6-44e9-ae6f-05e060b30042\") " pod="openstack-kuttl-tests/placement-5b47d59db-lz86c" Mar 16 15:50:48 crc kubenswrapper[5120]: I0316 15:50:48.129816 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6b459d6b-d4c6-44e9-ae6f-05e060b30042-scripts\") pod \"placement-5b47d59db-lz86c\" (UID: \"6b459d6b-d4c6-44e9-ae6f-05e060b30042\") " pod="openstack-kuttl-tests/placement-5b47d59db-lz86c" Mar 16 15:50:48 crc kubenswrapper[5120]: I0316 15:50:48.129872 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jv429\" (UniqueName: \"kubernetes.io/projected/ae0bb770-ecc1-4c2e-ab55-438b27b60d5c-kube-api-access-jv429\") pod \"barbican-worker-895d6468c-b4n82\" (UID: \"ae0bb770-ecc1-4c2e-ab55-438b27b60d5c\") " pod="openstack-kuttl-tests/barbican-worker-895d6468c-b4n82" Mar 16 15:50:48 crc kubenswrapper[5120]: I0316 15:50:48.129900 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6b459d6b-d4c6-44e9-ae6f-05e060b30042-internal-tls-certs\") pod \"placement-5b47d59db-lz86c\" (UID: \"6b459d6b-d4c6-44e9-ae6f-05e060b30042\") " pod="openstack-kuttl-tests/placement-5b47d59db-lz86c" Mar 16 15:50:48 crc kubenswrapper[5120]: I0316 15:50:48.129936 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6b459d6b-d4c6-44e9-ae6f-05e060b30042-combined-ca-bundle\") pod \"placement-5b47d59db-lz86c\" (UID: \"6b459d6b-d4c6-44e9-ae6f-05e060b30042\") " pod="openstack-kuttl-tests/placement-5b47d59db-lz86c" Mar 16 15:50:48 crc kubenswrapper[5120]: I0316 15:50:48.129968 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6b459d6b-d4c6-44e9-ae6f-05e060b30042-logs\") pod \"placement-5b47d59db-lz86c\" (UID: \"6b459d6b-d4c6-44e9-ae6f-05e060b30042\") " pod="openstack-kuttl-tests/placement-5b47d59db-lz86c" Mar 16 15:50:48 crc kubenswrapper[5120]: I0316 15:50:48.129993 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ae0bb770-ecc1-4c2e-ab55-438b27b60d5c-config-data\") pod \"barbican-worker-895d6468c-b4n82\" (UID: \"ae0bb770-ecc1-4c2e-ab55-438b27b60d5c\") " pod="openstack-kuttl-tests/barbican-worker-895d6468c-b4n82" Mar 16 15:50:48 crc kubenswrapper[5120]: I0316 15:50:48.130161 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6b459d6b-d4c6-44e9-ae6f-05e060b30042-config-data\") pod \"placement-5b47d59db-lz86c\" (UID: \"6b459d6b-d4c6-44e9-ae6f-05e060b30042\") " pod="openstack-kuttl-tests/placement-5b47d59db-lz86c" Mar 16 15:50:48 crc kubenswrapper[5120]: I0316 15:50:48.130291 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vw649\" (UniqueName: \"kubernetes.io/projected/6b459d6b-d4c6-44e9-ae6f-05e060b30042-kube-api-access-vw649\") pod \"placement-5b47d59db-lz86c\" (UID: \"6b459d6b-d4c6-44e9-ae6f-05e060b30042\") " pod="openstack-kuttl-tests/placement-5b47d59db-lz86c" Mar 16 15:50:48 crc kubenswrapper[5120]: I0316 15:50:48.130366 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6b459d6b-d4c6-44e9-ae6f-05e060b30042-public-tls-certs\") pod \"placement-5b47d59db-lz86c\" (UID: \"6b459d6b-d4c6-44e9-ae6f-05e060b30042\") " pod="openstack-kuttl-tests/placement-5b47d59db-lz86c" Mar 16 15:50:48 crc kubenswrapper[5120]: I0316 15:50:48.130504 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ae0bb770-ecc1-4c2e-ab55-438b27b60d5c-combined-ca-bundle\") pod \"barbican-worker-895d6468c-b4n82\" (UID: \"ae0bb770-ecc1-4c2e-ab55-438b27b60d5c\") " pod="openstack-kuttl-tests/barbican-worker-895d6468c-b4n82" Mar 16 15:50:48 crc kubenswrapper[5120]: I0316 15:50:48.130548 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6b459d6b-d4c6-44e9-ae6f-05e060b30042-logs\") pod \"placement-5b47d59db-lz86c\" (UID: \"6b459d6b-d4c6-44e9-ae6f-05e060b30042\") " pod="openstack-kuttl-tests/placement-5b47d59db-lz86c" Mar 16 15:50:48 crc kubenswrapper[5120]: I0316 15:50:48.130918 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ae0bb770-ecc1-4c2e-ab55-438b27b60d5c-logs\") pod \"barbican-worker-895d6468c-b4n82\" (UID: \"ae0bb770-ecc1-4c2e-ab55-438b27b60d5c\") " pod="openstack-kuttl-tests/barbican-worker-895d6468c-b4n82" Mar 16 15:50:48 crc kubenswrapper[5120]: I0316 15:50:48.130993 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/ae0bb770-ecc1-4c2e-ab55-438b27b60d5c-config-data-custom\") pod \"barbican-worker-895d6468c-b4n82\" (UID: \"ae0bb770-ecc1-4c2e-ab55-438b27b60d5c\") " pod="openstack-kuttl-tests/barbican-worker-895d6468c-b4n82" Mar 16 15:50:48 crc kubenswrapper[5120]: I0316 15:50:48.136532 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6b459d6b-d4c6-44e9-ae6f-05e060b30042-combined-ca-bundle\") pod \"placement-5b47d59db-lz86c\" (UID: \"6b459d6b-d4c6-44e9-ae6f-05e060b30042\") " pod="openstack-kuttl-tests/placement-5b47d59db-lz86c" Mar 16 15:50:48 crc kubenswrapper[5120]: I0316 15:50:48.136534 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6b459d6b-d4c6-44e9-ae6f-05e060b30042-public-tls-certs\") pod \"placement-5b47d59db-lz86c\" (UID: \"6b459d6b-d4c6-44e9-ae6f-05e060b30042\") " pod="openstack-kuttl-tests/placement-5b47d59db-lz86c" Mar 16 15:50:48 crc kubenswrapper[5120]: I0316 15:50:48.136833 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6b459d6b-d4c6-44e9-ae6f-05e060b30042-internal-tls-certs\") pod \"placement-5b47d59db-lz86c\" (UID: \"6b459d6b-d4c6-44e9-ae6f-05e060b30042\") " pod="openstack-kuttl-tests/placement-5b47d59db-lz86c" Mar 16 15:50:48 crc kubenswrapper[5120]: I0316 15:50:48.138276 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6b459d6b-d4c6-44e9-ae6f-05e060b30042-scripts\") pod \"placement-5b47d59db-lz86c\" (UID: \"6b459d6b-d4c6-44e9-ae6f-05e060b30042\") " pod="openstack-kuttl-tests/placement-5b47d59db-lz86c" Mar 16 15:50:48 crc kubenswrapper[5120]: I0316 15:50:48.146712 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6b459d6b-d4c6-44e9-ae6f-05e060b30042-config-data\") pod \"placement-5b47d59db-lz86c\" (UID: \"6b459d6b-d4c6-44e9-ae6f-05e060b30042\") " pod="openstack-kuttl-tests/placement-5b47d59db-lz86c" Mar 16 15:50:48 crc kubenswrapper[5120]: I0316 15:50:48.152812 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vw649\" (UniqueName: \"kubernetes.io/projected/6b459d6b-d4c6-44e9-ae6f-05e060b30042-kube-api-access-vw649\") pod \"placement-5b47d59db-lz86c\" (UID: \"6b459d6b-d4c6-44e9-ae6f-05e060b30042\") " pod="openstack-kuttl-tests/placement-5b47d59db-lz86c" Mar 16 15:50:48 crc kubenswrapper[5120]: I0316 15:50:48.187381 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-5b47d59db-lz86c" Mar 16 15:50:48 crc kubenswrapper[5120]: I0316 15:50:48.232533 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ae0bb770-ecc1-4c2e-ab55-438b27b60d5c-combined-ca-bundle\") pod \"barbican-worker-895d6468c-b4n82\" (UID: \"ae0bb770-ecc1-4c2e-ab55-438b27b60d5c\") " pod="openstack-kuttl-tests/barbican-worker-895d6468c-b4n82" Mar 16 15:50:48 crc kubenswrapper[5120]: I0316 15:50:48.232950 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ae0bb770-ecc1-4c2e-ab55-438b27b60d5c-logs\") pod \"barbican-worker-895d6468c-b4n82\" (UID: \"ae0bb770-ecc1-4c2e-ab55-438b27b60d5c\") " pod="openstack-kuttl-tests/barbican-worker-895d6468c-b4n82" Mar 16 15:50:48 crc kubenswrapper[5120]: I0316 15:50:48.232974 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/ae0bb770-ecc1-4c2e-ab55-438b27b60d5c-config-data-custom\") pod \"barbican-worker-895d6468c-b4n82\" (UID: \"ae0bb770-ecc1-4c2e-ab55-438b27b60d5c\") " pod="openstack-kuttl-tests/barbican-worker-895d6468c-b4n82" Mar 16 15:50:48 crc kubenswrapper[5120]: I0316 15:50:48.233018 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jv429\" (UniqueName: \"kubernetes.io/projected/ae0bb770-ecc1-4c2e-ab55-438b27b60d5c-kube-api-access-jv429\") pod \"barbican-worker-895d6468c-b4n82\" (UID: \"ae0bb770-ecc1-4c2e-ab55-438b27b60d5c\") " pod="openstack-kuttl-tests/barbican-worker-895d6468c-b4n82" Mar 16 15:50:48 crc kubenswrapper[5120]: I0316 15:50:48.233065 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ae0bb770-ecc1-4c2e-ab55-438b27b60d5c-config-data\") pod \"barbican-worker-895d6468c-b4n82\" (UID: \"ae0bb770-ecc1-4c2e-ab55-438b27b60d5c\") " pod="openstack-kuttl-tests/barbican-worker-895d6468c-b4n82" Mar 16 15:50:48 crc kubenswrapper[5120]: I0316 15:50:48.235342 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ae0bb770-ecc1-4c2e-ab55-438b27b60d5c-logs\") pod \"barbican-worker-895d6468c-b4n82\" (UID: \"ae0bb770-ecc1-4c2e-ab55-438b27b60d5c\") " pod="openstack-kuttl-tests/barbican-worker-895d6468c-b4n82" Mar 16 15:50:48 crc kubenswrapper[5120]: I0316 15:50:48.239287 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ae0bb770-ecc1-4c2e-ab55-438b27b60d5c-config-data\") pod \"barbican-worker-895d6468c-b4n82\" (UID: \"ae0bb770-ecc1-4c2e-ab55-438b27b60d5c\") " pod="openstack-kuttl-tests/barbican-worker-895d6468c-b4n82" Mar 16 15:50:48 crc kubenswrapper[5120]: I0316 15:50:48.241269 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ae0bb770-ecc1-4c2e-ab55-438b27b60d5c-combined-ca-bundle\") pod \"barbican-worker-895d6468c-b4n82\" (UID: \"ae0bb770-ecc1-4c2e-ab55-438b27b60d5c\") " pod="openstack-kuttl-tests/barbican-worker-895d6468c-b4n82" Mar 16 15:50:48 crc kubenswrapper[5120]: I0316 15:50:48.245259 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/ae0bb770-ecc1-4c2e-ab55-438b27b60d5c-config-data-custom\") pod \"barbican-worker-895d6468c-b4n82\" (UID: \"ae0bb770-ecc1-4c2e-ab55-438b27b60d5c\") " pod="openstack-kuttl-tests/barbican-worker-895d6468c-b4n82" Mar 16 15:50:48 crc kubenswrapper[5120]: I0316 15:50:48.255276 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jv429\" (UniqueName: \"kubernetes.io/projected/ae0bb770-ecc1-4c2e-ab55-438b27b60d5c-kube-api-access-jv429\") pod \"barbican-worker-895d6468c-b4n82\" (UID: \"ae0bb770-ecc1-4c2e-ab55-438b27b60d5c\") " pod="openstack-kuttl-tests/barbican-worker-895d6468c-b4n82" Mar 16 15:50:48 crc kubenswrapper[5120]: I0316 15:50:48.334650 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-895d6468c-b4n82" Mar 16 15:50:48 crc kubenswrapper[5120]: I0316 15:50:48.440300 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-698fb447c8-kz5xv"] Mar 16 15:50:48 crc kubenswrapper[5120]: I0316 15:50:48.440740 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-api-f5746c74d-vbhjh"] Mar 16 15:50:48 crc kubenswrapper[5120]: I0316 15:50:48.440618 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-698fb447c8-kz5xv" Mar 16 15:50:48 crc kubenswrapper[5120]: I0316 15:50:48.445196 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-keystone-listener-config-data\"" Mar 16 15:50:48 crc kubenswrapper[5120]: I0316 15:50:48.537070 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6d402989-2c1d-4b01-a058-ffd1bd6767f4-logs\") pod \"barbican-keystone-listener-698fb447c8-kz5xv\" (UID: \"6d402989-2c1d-4b01-a058-ffd1bd6767f4\") " pod="openstack-kuttl-tests/barbican-keystone-listener-698fb447c8-kz5xv" Mar 16 15:50:48 crc kubenswrapper[5120]: I0316 15:50:48.537130 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x47m8\" (UniqueName: \"kubernetes.io/projected/6d402989-2c1d-4b01-a058-ffd1bd6767f4-kube-api-access-x47m8\") pod \"barbican-keystone-listener-698fb447c8-kz5xv\" (UID: \"6d402989-2c1d-4b01-a058-ffd1bd6767f4\") " pod="openstack-kuttl-tests/barbican-keystone-listener-698fb447c8-kz5xv" Mar 16 15:50:48 crc kubenswrapper[5120]: I0316 15:50:48.537177 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/6d402989-2c1d-4b01-a058-ffd1bd6767f4-config-data-custom\") pod \"barbican-keystone-listener-698fb447c8-kz5xv\" (UID: \"6d402989-2c1d-4b01-a058-ffd1bd6767f4\") " pod="openstack-kuttl-tests/barbican-keystone-listener-698fb447c8-kz5xv" Mar 16 15:50:48 crc kubenswrapper[5120]: I0316 15:50:48.537205 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6d402989-2c1d-4b01-a058-ffd1bd6767f4-config-data\") pod \"barbican-keystone-listener-698fb447c8-kz5xv\" (UID: \"6d402989-2c1d-4b01-a058-ffd1bd6767f4\") " pod="openstack-kuttl-tests/barbican-keystone-listener-698fb447c8-kz5xv" Mar 16 15:50:48 crc kubenswrapper[5120]: I0316 15:50:48.537300 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6d402989-2c1d-4b01-a058-ffd1bd6767f4-combined-ca-bundle\") pod \"barbican-keystone-listener-698fb447c8-kz5xv\" (UID: \"6d402989-2c1d-4b01-a058-ffd1bd6767f4\") " pod="openstack-kuttl-tests/barbican-keystone-listener-698fb447c8-kz5xv" Mar 16 15:50:48 crc kubenswrapper[5120]: I0316 15:50:48.639130 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6d402989-2c1d-4b01-a058-ffd1bd6767f4-logs\") pod \"barbican-keystone-listener-698fb447c8-kz5xv\" (UID: \"6d402989-2c1d-4b01-a058-ffd1bd6767f4\") " pod="openstack-kuttl-tests/barbican-keystone-listener-698fb447c8-kz5xv" Mar 16 15:50:48 crc kubenswrapper[5120]: I0316 15:50:48.639187 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x47m8\" (UniqueName: \"kubernetes.io/projected/6d402989-2c1d-4b01-a058-ffd1bd6767f4-kube-api-access-x47m8\") pod \"barbican-keystone-listener-698fb447c8-kz5xv\" (UID: \"6d402989-2c1d-4b01-a058-ffd1bd6767f4\") " pod="openstack-kuttl-tests/barbican-keystone-listener-698fb447c8-kz5xv" Mar 16 15:50:48 crc kubenswrapper[5120]: I0316 15:50:48.639231 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/6d402989-2c1d-4b01-a058-ffd1bd6767f4-config-data-custom\") pod \"barbican-keystone-listener-698fb447c8-kz5xv\" (UID: \"6d402989-2c1d-4b01-a058-ffd1bd6767f4\") " pod="openstack-kuttl-tests/barbican-keystone-listener-698fb447c8-kz5xv" Mar 16 15:50:48 crc kubenswrapper[5120]: I0316 15:50:48.639258 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6d402989-2c1d-4b01-a058-ffd1bd6767f4-config-data\") pod \"barbican-keystone-listener-698fb447c8-kz5xv\" (UID: \"6d402989-2c1d-4b01-a058-ffd1bd6767f4\") " pod="openstack-kuttl-tests/barbican-keystone-listener-698fb447c8-kz5xv" Mar 16 15:50:48 crc kubenswrapper[5120]: I0316 15:50:48.639355 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6d402989-2c1d-4b01-a058-ffd1bd6767f4-combined-ca-bundle\") pod \"barbican-keystone-listener-698fb447c8-kz5xv\" (UID: \"6d402989-2c1d-4b01-a058-ffd1bd6767f4\") " pod="openstack-kuttl-tests/barbican-keystone-listener-698fb447c8-kz5xv" Mar 16 15:50:48 crc kubenswrapper[5120]: I0316 15:50:48.639671 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6d402989-2c1d-4b01-a058-ffd1bd6767f4-logs\") pod \"barbican-keystone-listener-698fb447c8-kz5xv\" (UID: \"6d402989-2c1d-4b01-a058-ffd1bd6767f4\") " pod="openstack-kuttl-tests/barbican-keystone-listener-698fb447c8-kz5xv" Mar 16 15:50:48 crc kubenswrapper[5120]: I0316 15:50:48.643259 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6d402989-2c1d-4b01-a058-ffd1bd6767f4-combined-ca-bundle\") pod \"barbican-keystone-listener-698fb447c8-kz5xv\" (UID: \"6d402989-2c1d-4b01-a058-ffd1bd6767f4\") " pod="openstack-kuttl-tests/barbican-keystone-listener-698fb447c8-kz5xv" Mar 16 15:50:48 crc kubenswrapper[5120]: I0316 15:50:48.644066 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/6d402989-2c1d-4b01-a058-ffd1bd6767f4-config-data-custom\") pod \"barbican-keystone-listener-698fb447c8-kz5xv\" (UID: \"6d402989-2c1d-4b01-a058-ffd1bd6767f4\") " pod="openstack-kuttl-tests/barbican-keystone-listener-698fb447c8-kz5xv" Mar 16 15:50:48 crc kubenswrapper[5120]: I0316 15:50:48.647102 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6d402989-2c1d-4b01-a058-ffd1bd6767f4-config-data\") pod \"barbican-keystone-listener-698fb447c8-kz5xv\" (UID: \"6d402989-2c1d-4b01-a058-ffd1bd6767f4\") " pod="openstack-kuttl-tests/barbican-keystone-listener-698fb447c8-kz5xv" Mar 16 15:50:48 crc kubenswrapper[5120]: I0316 15:50:48.665121 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x47m8\" (UniqueName: \"kubernetes.io/projected/6d402989-2c1d-4b01-a058-ffd1bd6767f4-kube-api-access-x47m8\") pod \"barbican-keystone-listener-698fb447c8-kz5xv\" (UID: \"6d402989-2c1d-4b01-a058-ffd1bd6767f4\") " pod="openstack-kuttl-tests/barbican-keystone-listener-698fb447c8-kz5xv" Mar 16 15:50:48 crc kubenswrapper[5120]: I0316 15:50:48.744833 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-f5746c74d-vbhjh"] Mar 16 15:50:48 crc kubenswrapper[5120]: I0316 15:50:48.745000 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-f5746c74d-vbhjh" Mar 16 15:50:48 crc kubenswrapper[5120]: I0316 15:50:48.750063 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-api-config-data\"" Mar 16 15:50:48 crc kubenswrapper[5120]: I0316 15:50:48.786288 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-698fb447c8-kz5xv" Mar 16 15:50:48 crc kubenswrapper[5120]: I0316 15:50:48.842392 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-spkhj\" (UniqueName: \"kubernetes.io/projected/fb486d50-9a5f-40e2-842a-d942a88eb350-kube-api-access-spkhj\") pod \"barbican-api-f5746c74d-vbhjh\" (UID: \"fb486d50-9a5f-40e2-842a-d942a88eb350\") " pod="openstack-kuttl-tests/barbican-api-f5746c74d-vbhjh" Mar 16 15:50:48 crc kubenswrapper[5120]: I0316 15:50:48.842529 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fb486d50-9a5f-40e2-842a-d942a88eb350-combined-ca-bundle\") pod \"barbican-api-f5746c74d-vbhjh\" (UID: \"fb486d50-9a5f-40e2-842a-d942a88eb350\") " pod="openstack-kuttl-tests/barbican-api-f5746c74d-vbhjh" Mar 16 15:50:48 crc kubenswrapper[5120]: I0316 15:50:48.842629 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/fb486d50-9a5f-40e2-842a-d942a88eb350-logs\") pod \"barbican-api-f5746c74d-vbhjh\" (UID: \"fb486d50-9a5f-40e2-842a-d942a88eb350\") " pod="openstack-kuttl-tests/barbican-api-f5746c74d-vbhjh" Mar 16 15:50:48 crc kubenswrapper[5120]: I0316 15:50:48.842688 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fb486d50-9a5f-40e2-842a-d942a88eb350-config-data\") pod \"barbican-api-f5746c74d-vbhjh\" (UID: \"fb486d50-9a5f-40e2-842a-d942a88eb350\") " pod="openstack-kuttl-tests/barbican-api-f5746c74d-vbhjh" Mar 16 15:50:48 crc kubenswrapper[5120]: I0316 15:50:48.842822 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/fb486d50-9a5f-40e2-842a-d942a88eb350-config-data-custom\") pod \"barbican-api-f5746c74d-vbhjh\" (UID: \"fb486d50-9a5f-40e2-842a-d942a88eb350\") " pod="openstack-kuttl-tests/barbican-api-f5746c74d-vbhjh" Mar 16 15:50:48 crc kubenswrapper[5120]: I0316 15:50:48.944751 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fb486d50-9a5f-40e2-842a-d942a88eb350-combined-ca-bundle\") pod \"barbican-api-f5746c74d-vbhjh\" (UID: \"fb486d50-9a5f-40e2-842a-d942a88eb350\") " pod="openstack-kuttl-tests/barbican-api-f5746c74d-vbhjh" Mar 16 15:50:48 crc kubenswrapper[5120]: I0316 15:50:48.945024 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/fb486d50-9a5f-40e2-842a-d942a88eb350-logs\") pod \"barbican-api-f5746c74d-vbhjh\" (UID: \"fb486d50-9a5f-40e2-842a-d942a88eb350\") " pod="openstack-kuttl-tests/barbican-api-f5746c74d-vbhjh" Mar 16 15:50:48 crc kubenswrapper[5120]: I0316 15:50:48.945128 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fb486d50-9a5f-40e2-842a-d942a88eb350-config-data\") pod \"barbican-api-f5746c74d-vbhjh\" (UID: \"fb486d50-9a5f-40e2-842a-d942a88eb350\") " pod="openstack-kuttl-tests/barbican-api-f5746c74d-vbhjh" Mar 16 15:50:48 crc kubenswrapper[5120]: I0316 15:50:48.945268 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/fb486d50-9a5f-40e2-842a-d942a88eb350-config-data-custom\") pod \"barbican-api-f5746c74d-vbhjh\" (UID: \"fb486d50-9a5f-40e2-842a-d942a88eb350\") " pod="openstack-kuttl-tests/barbican-api-f5746c74d-vbhjh" Mar 16 15:50:48 crc kubenswrapper[5120]: I0316 15:50:48.945411 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-spkhj\" (UniqueName: \"kubernetes.io/projected/fb486d50-9a5f-40e2-842a-d942a88eb350-kube-api-access-spkhj\") pod \"barbican-api-f5746c74d-vbhjh\" (UID: \"fb486d50-9a5f-40e2-842a-d942a88eb350\") " pod="openstack-kuttl-tests/barbican-api-f5746c74d-vbhjh" Mar 16 15:50:48 crc kubenswrapper[5120]: I0316 15:50:48.945501 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/fb486d50-9a5f-40e2-842a-d942a88eb350-logs\") pod \"barbican-api-f5746c74d-vbhjh\" (UID: \"fb486d50-9a5f-40e2-842a-d942a88eb350\") " pod="openstack-kuttl-tests/barbican-api-f5746c74d-vbhjh" Mar 16 15:50:48 crc kubenswrapper[5120]: I0316 15:50:48.949153 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fb486d50-9a5f-40e2-842a-d942a88eb350-combined-ca-bundle\") pod \"barbican-api-f5746c74d-vbhjh\" (UID: \"fb486d50-9a5f-40e2-842a-d942a88eb350\") " pod="openstack-kuttl-tests/barbican-api-f5746c74d-vbhjh" Mar 16 15:50:48 crc kubenswrapper[5120]: I0316 15:50:48.949177 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/fb486d50-9a5f-40e2-842a-d942a88eb350-config-data-custom\") pod \"barbican-api-f5746c74d-vbhjh\" (UID: \"fb486d50-9a5f-40e2-842a-d942a88eb350\") " pod="openstack-kuttl-tests/barbican-api-f5746c74d-vbhjh" Mar 16 15:50:48 crc kubenswrapper[5120]: I0316 15:50:48.950053 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fb486d50-9a5f-40e2-842a-d942a88eb350-config-data\") pod \"barbican-api-f5746c74d-vbhjh\" (UID: \"fb486d50-9a5f-40e2-842a-d942a88eb350\") " pod="openstack-kuttl-tests/barbican-api-f5746c74d-vbhjh" Mar 16 15:50:48 crc kubenswrapper[5120]: I0316 15:50:48.963168 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-spkhj\" (UniqueName: \"kubernetes.io/projected/fb486d50-9a5f-40e2-842a-d942a88eb350-kube-api-access-spkhj\") pod \"barbican-api-f5746c74d-vbhjh\" (UID: \"fb486d50-9a5f-40e2-842a-d942a88eb350\") " pod="openstack-kuttl-tests/barbican-api-f5746c74d-vbhjh" Mar 16 15:50:49 crc kubenswrapper[5120]: I0316 15:50:49.066158 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-f5746c74d-vbhjh" Mar 16 15:50:50 crc kubenswrapper[5120]: I0316 15:50:50.483312 5120 generic.go:358] "Generic (PLEG): container finished" podID="2645c221-c2bd-4cd3-a073-9396a5a87708" containerID="db813feb04160a39dff817cfca02fbe3ad8df30c5a792ec7d41c63f6f169b7bd" exitCode=0 Mar 16 15:50:50 crc kubenswrapper[5120]: I0316 15:50:50.483525 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-gwbbm" event={"ID":"2645c221-c2bd-4cd3-a073-9396a5a87708","Type":"ContainerDied","Data":"db813feb04160a39dff817cfca02fbe3ad8df30c5a792ec7d41c63f6f169b7bd"} Mar 16 15:50:50 crc kubenswrapper[5120]: I0316 15:50:50.612475 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-api-76b87c5788-h6qrd"] Mar 16 15:50:50 crc kubenswrapper[5120]: I0316 15:50:50.739095 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-76b87c5788-h6qrd"] Mar 16 15:50:50 crc kubenswrapper[5120]: I0316 15:50:50.739126 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-76b87c5788-h6qrd" Mar 16 15:50:50 crc kubenswrapper[5120]: I0316 15:50:50.743798 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-barbican-internal-svc\"" Mar 16 15:50:50 crc kubenswrapper[5120]: I0316 15:50:50.744076 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-barbican-public-svc\"" Mar 16 15:50:50 crc kubenswrapper[5120]: I0316 15:50:50.879665 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/bcd3c028-eca6-4aaf-afb4-f0887af035e8-config-data-custom\") pod \"barbican-api-76b87c5788-h6qrd\" (UID: \"bcd3c028-eca6-4aaf-afb4-f0887af035e8\") " pod="openstack-kuttl-tests/barbican-api-76b87c5788-h6qrd" Mar 16 15:50:50 crc kubenswrapper[5120]: I0316 15:50:50.879824 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bcd3c028-eca6-4aaf-afb4-f0887af035e8-combined-ca-bundle\") pod \"barbican-api-76b87c5788-h6qrd\" (UID: \"bcd3c028-eca6-4aaf-afb4-f0887af035e8\") " pod="openstack-kuttl-tests/barbican-api-76b87c5788-h6qrd" Mar 16 15:50:50 crc kubenswrapper[5120]: I0316 15:50:50.880035 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bcd3c028-eca6-4aaf-afb4-f0887af035e8-config-data\") pod \"barbican-api-76b87c5788-h6qrd\" (UID: \"bcd3c028-eca6-4aaf-afb4-f0887af035e8\") " pod="openstack-kuttl-tests/barbican-api-76b87c5788-h6qrd" Mar 16 15:50:50 crc kubenswrapper[5120]: I0316 15:50:50.880578 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jll6s\" (UniqueName: \"kubernetes.io/projected/bcd3c028-eca6-4aaf-afb4-f0887af035e8-kube-api-access-jll6s\") pod \"barbican-api-76b87c5788-h6qrd\" (UID: \"bcd3c028-eca6-4aaf-afb4-f0887af035e8\") " pod="openstack-kuttl-tests/barbican-api-76b87c5788-h6qrd" Mar 16 15:50:50 crc kubenswrapper[5120]: I0316 15:50:50.880622 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/bcd3c028-eca6-4aaf-afb4-f0887af035e8-internal-tls-certs\") pod \"barbican-api-76b87c5788-h6qrd\" (UID: \"bcd3c028-eca6-4aaf-afb4-f0887af035e8\") " pod="openstack-kuttl-tests/barbican-api-76b87c5788-h6qrd" Mar 16 15:50:50 crc kubenswrapper[5120]: I0316 15:50:50.880769 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/bcd3c028-eca6-4aaf-afb4-f0887af035e8-public-tls-certs\") pod \"barbican-api-76b87c5788-h6qrd\" (UID: \"bcd3c028-eca6-4aaf-afb4-f0887af035e8\") " pod="openstack-kuttl-tests/barbican-api-76b87c5788-h6qrd" Mar 16 15:50:50 crc kubenswrapper[5120]: I0316 15:50:50.880801 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/bcd3c028-eca6-4aaf-afb4-f0887af035e8-logs\") pod \"barbican-api-76b87c5788-h6qrd\" (UID: \"bcd3c028-eca6-4aaf-afb4-f0887af035e8\") " pod="openstack-kuttl-tests/barbican-api-76b87c5788-h6qrd" Mar 16 15:50:50 crc kubenswrapper[5120]: I0316 15:50:50.891062 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-jxphs" Mar 16 15:50:50 crc kubenswrapper[5120]: I0316 15:50:50.985112 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/47203a51-c1a7-433b-990b-f7744bc74071-fernet-keys\") pod \"47203a51-c1a7-433b-990b-f7744bc74071\" (UID: \"47203a51-c1a7-433b-990b-f7744bc74071\") " Mar 16 15:50:50 crc kubenswrapper[5120]: I0316 15:50:50.985168 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/47203a51-c1a7-433b-990b-f7744bc74071-credential-keys\") pod \"47203a51-c1a7-433b-990b-f7744bc74071\" (UID: \"47203a51-c1a7-433b-990b-f7744bc74071\") " Mar 16 15:50:50 crc kubenswrapper[5120]: I0316 15:50:50.985250 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qv26n\" (UniqueName: \"kubernetes.io/projected/47203a51-c1a7-433b-990b-f7744bc74071-kube-api-access-qv26n\") pod \"47203a51-c1a7-433b-990b-f7744bc74071\" (UID: \"47203a51-c1a7-433b-990b-f7744bc74071\") " Mar 16 15:50:50 crc kubenswrapper[5120]: I0316 15:50:50.985390 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/47203a51-c1a7-433b-990b-f7744bc74071-config-data\") pod \"47203a51-c1a7-433b-990b-f7744bc74071\" (UID: \"47203a51-c1a7-433b-990b-f7744bc74071\") " Mar 16 15:50:50 crc kubenswrapper[5120]: I0316 15:50:50.985551 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/47203a51-c1a7-433b-990b-f7744bc74071-scripts\") pod \"47203a51-c1a7-433b-990b-f7744bc74071\" (UID: \"47203a51-c1a7-433b-990b-f7744bc74071\") " Mar 16 15:50:50 crc kubenswrapper[5120]: I0316 15:50:50.985601 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/47203a51-c1a7-433b-990b-f7744bc74071-combined-ca-bundle\") pod \"47203a51-c1a7-433b-990b-f7744bc74071\" (UID: \"47203a51-c1a7-433b-990b-f7744bc74071\") " Mar 16 15:50:50 crc kubenswrapper[5120]: I0316 15:50:50.985831 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bcd3c028-eca6-4aaf-afb4-f0887af035e8-config-data\") pod \"barbican-api-76b87c5788-h6qrd\" (UID: \"bcd3c028-eca6-4aaf-afb4-f0887af035e8\") " pod="openstack-kuttl-tests/barbican-api-76b87c5788-h6qrd" Mar 16 15:50:50 crc kubenswrapper[5120]: I0316 15:50:50.985937 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jll6s\" (UniqueName: \"kubernetes.io/projected/bcd3c028-eca6-4aaf-afb4-f0887af035e8-kube-api-access-jll6s\") pod \"barbican-api-76b87c5788-h6qrd\" (UID: \"bcd3c028-eca6-4aaf-afb4-f0887af035e8\") " pod="openstack-kuttl-tests/barbican-api-76b87c5788-h6qrd" Mar 16 15:50:50 crc kubenswrapper[5120]: I0316 15:50:50.985975 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/bcd3c028-eca6-4aaf-afb4-f0887af035e8-internal-tls-certs\") pod \"barbican-api-76b87c5788-h6qrd\" (UID: \"bcd3c028-eca6-4aaf-afb4-f0887af035e8\") " pod="openstack-kuttl-tests/barbican-api-76b87c5788-h6qrd" Mar 16 15:50:50 crc kubenswrapper[5120]: I0316 15:50:50.986037 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/bcd3c028-eca6-4aaf-afb4-f0887af035e8-public-tls-certs\") pod \"barbican-api-76b87c5788-h6qrd\" (UID: \"bcd3c028-eca6-4aaf-afb4-f0887af035e8\") " pod="openstack-kuttl-tests/barbican-api-76b87c5788-h6qrd" Mar 16 15:50:50 crc kubenswrapper[5120]: I0316 15:50:50.986062 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/bcd3c028-eca6-4aaf-afb4-f0887af035e8-logs\") pod \"barbican-api-76b87c5788-h6qrd\" (UID: \"bcd3c028-eca6-4aaf-afb4-f0887af035e8\") " pod="openstack-kuttl-tests/barbican-api-76b87c5788-h6qrd" Mar 16 15:50:50 crc kubenswrapper[5120]: I0316 15:50:50.986112 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/bcd3c028-eca6-4aaf-afb4-f0887af035e8-config-data-custom\") pod \"barbican-api-76b87c5788-h6qrd\" (UID: \"bcd3c028-eca6-4aaf-afb4-f0887af035e8\") " pod="openstack-kuttl-tests/barbican-api-76b87c5788-h6qrd" Mar 16 15:50:50 crc kubenswrapper[5120]: I0316 15:50:50.986196 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bcd3c028-eca6-4aaf-afb4-f0887af035e8-combined-ca-bundle\") pod \"barbican-api-76b87c5788-h6qrd\" (UID: \"bcd3c028-eca6-4aaf-afb4-f0887af035e8\") " pod="openstack-kuttl-tests/barbican-api-76b87c5788-h6qrd" Mar 16 15:50:50 crc kubenswrapper[5120]: I0316 15:50:50.989347 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/bcd3c028-eca6-4aaf-afb4-f0887af035e8-logs\") pod \"barbican-api-76b87c5788-h6qrd\" (UID: \"bcd3c028-eca6-4aaf-afb4-f0887af035e8\") " pod="openstack-kuttl-tests/barbican-api-76b87c5788-h6qrd" Mar 16 15:50:50 crc kubenswrapper[5120]: I0316 15:50:50.996672 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/bcd3c028-eca6-4aaf-afb4-f0887af035e8-public-tls-certs\") pod \"barbican-api-76b87c5788-h6qrd\" (UID: \"bcd3c028-eca6-4aaf-afb4-f0887af035e8\") " pod="openstack-kuttl-tests/barbican-api-76b87c5788-h6qrd" Mar 16 15:50:50 crc kubenswrapper[5120]: I0316 15:50:50.998211 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bcd3c028-eca6-4aaf-afb4-f0887af035e8-combined-ca-bundle\") pod \"barbican-api-76b87c5788-h6qrd\" (UID: \"bcd3c028-eca6-4aaf-afb4-f0887af035e8\") " pod="openstack-kuttl-tests/barbican-api-76b87c5788-h6qrd" Mar 16 15:50:50 crc kubenswrapper[5120]: I0316 15:50:50.998233 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bcd3c028-eca6-4aaf-afb4-f0887af035e8-config-data\") pod \"barbican-api-76b87c5788-h6qrd\" (UID: \"bcd3c028-eca6-4aaf-afb4-f0887af035e8\") " pod="openstack-kuttl-tests/barbican-api-76b87c5788-h6qrd" Mar 16 15:50:50 crc kubenswrapper[5120]: I0316 15:50:50.998529 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/bcd3c028-eca6-4aaf-afb4-f0887af035e8-internal-tls-certs\") pod \"barbican-api-76b87c5788-h6qrd\" (UID: \"bcd3c028-eca6-4aaf-afb4-f0887af035e8\") " pod="openstack-kuttl-tests/barbican-api-76b87c5788-h6qrd" Mar 16 15:50:51 crc kubenswrapper[5120]: I0316 15:50:51.004891 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/47203a51-c1a7-433b-990b-f7744bc74071-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "47203a51-c1a7-433b-990b-f7744bc74071" (UID: "47203a51-c1a7-433b-990b-f7744bc74071"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:50:51 crc kubenswrapper[5120]: I0316 15:50:51.005411 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/bcd3c028-eca6-4aaf-afb4-f0887af035e8-config-data-custom\") pod \"barbican-api-76b87c5788-h6qrd\" (UID: \"bcd3c028-eca6-4aaf-afb4-f0887af035e8\") " pod="openstack-kuttl-tests/barbican-api-76b87c5788-h6qrd" Mar 16 15:50:51 crc kubenswrapper[5120]: I0316 15:50:51.005514 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/47203a51-c1a7-433b-990b-f7744bc74071-scripts" (OuterVolumeSpecName: "scripts") pod "47203a51-c1a7-433b-990b-f7744bc74071" (UID: "47203a51-c1a7-433b-990b-f7744bc74071"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:50:51 crc kubenswrapper[5120]: I0316 15:50:51.009670 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/47203a51-c1a7-433b-990b-f7744bc74071-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "47203a51-c1a7-433b-990b-f7744bc74071" (UID: "47203a51-c1a7-433b-990b-f7744bc74071"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:50:51 crc kubenswrapper[5120]: I0316 15:50:51.019308 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47203a51-c1a7-433b-990b-f7744bc74071-kube-api-access-qv26n" (OuterVolumeSpecName: "kube-api-access-qv26n") pod "47203a51-c1a7-433b-990b-f7744bc74071" (UID: "47203a51-c1a7-433b-990b-f7744bc74071"). InnerVolumeSpecName "kube-api-access-qv26n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:50:51 crc kubenswrapper[5120]: I0316 15:50:51.019799 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/47203a51-c1a7-433b-990b-f7744bc74071-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "47203a51-c1a7-433b-990b-f7744bc74071" (UID: "47203a51-c1a7-433b-990b-f7744bc74071"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:50:51 crc kubenswrapper[5120]: I0316 15:50:51.025415 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jll6s\" (UniqueName: \"kubernetes.io/projected/bcd3c028-eca6-4aaf-afb4-f0887af035e8-kube-api-access-jll6s\") pod \"barbican-api-76b87c5788-h6qrd\" (UID: \"bcd3c028-eca6-4aaf-afb4-f0887af035e8\") " pod="openstack-kuttl-tests/barbican-api-76b87c5788-h6qrd" Mar 16 15:50:51 crc kubenswrapper[5120]: I0316 15:50:51.045421 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/47203a51-c1a7-433b-990b-f7744bc74071-config-data" (OuterVolumeSpecName: "config-data") pod "47203a51-c1a7-433b-990b-f7744bc74071" (UID: "47203a51-c1a7-433b-990b-f7744bc74071"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:50:51 crc kubenswrapper[5120]: I0316 15:50:51.088044 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/47203a51-c1a7-433b-990b-f7744bc74071-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 15:50:51 crc kubenswrapper[5120]: I0316 15:50:51.088078 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/47203a51-c1a7-433b-990b-f7744bc74071-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 15:50:51 crc kubenswrapper[5120]: I0316 15:50:51.088087 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/47203a51-c1a7-433b-990b-f7744bc74071-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:50:51 crc kubenswrapper[5120]: I0316 15:50:51.088098 5120 reconciler_common.go:299] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/47203a51-c1a7-433b-990b-f7744bc74071-fernet-keys\") on node \"crc\" DevicePath \"\"" Mar 16 15:50:51 crc kubenswrapper[5120]: I0316 15:50:51.088106 5120 reconciler_common.go:299] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/47203a51-c1a7-433b-990b-f7744bc74071-credential-keys\") on node \"crc\" DevicePath \"\"" Mar 16 15:50:51 crc kubenswrapper[5120]: I0316 15:50:51.088114 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qv26n\" (UniqueName: \"kubernetes.io/projected/47203a51-c1a7-433b-990b-f7744bc74071-kube-api-access-qv26n\") on node \"crc\" DevicePath \"\"" Mar 16 15:50:51 crc kubenswrapper[5120]: I0316 15:50:51.213529 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-76b87c5788-h6qrd" Mar 16 15:50:51 crc kubenswrapper[5120]: W0316 15:50:51.258305 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6b459d6b_d4c6_44e9_ae6f_05e060b30042.slice/crio-31a3f7987d644deffbc21f34088a712eb5c19746f768b2196ef79e4b1db621a9 WatchSource:0}: Error finding container 31a3f7987d644deffbc21f34088a712eb5c19746f768b2196ef79e4b1db621a9: Status 404 returned error can't find the container with id 31a3f7987d644deffbc21f34088a712eb5c19746f768b2196ef79e4b1db621a9 Mar 16 15:50:51 crc kubenswrapper[5120]: I0316 15:50:51.266745 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-5b47d59db-lz86c"] Mar 16 15:50:51 crc kubenswrapper[5120]: I0316 15:50:51.371252 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-698fb447c8-kz5xv"] Mar 16 15:50:51 crc kubenswrapper[5120]: I0316 15:50:51.381394 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-f5746c74d-vbhjh"] Mar 16 15:50:51 crc kubenswrapper[5120]: I0316 15:50:51.389524 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-895d6468c-b4n82"] Mar 16 15:50:51 crc kubenswrapper[5120]: I0316 15:50:51.424125 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:50:51 crc kubenswrapper[5120]: I0316 15:50:51.424185 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:50:51 crc kubenswrapper[5120]: I0316 15:50:51.424202 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:50:51 crc kubenswrapper[5120]: I0316 15:50:51.424214 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:50:51 crc kubenswrapper[5120]: I0316 15:50:51.458731 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:50:51 crc kubenswrapper[5120]: I0316 15:50:51.474476 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:50:51 crc kubenswrapper[5120]: I0316 15:50:51.496227 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-jxphs" Mar 16 15:50:51 crc kubenswrapper[5120]: I0316 15:50:51.496269 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-jxphs" event={"ID":"47203a51-c1a7-433b-990b-f7744bc74071","Type":"ContainerDied","Data":"f04a8ed834124c78833d3dc12d90bf97864fb4cbf8914a48c1a4ee683bb8f801"} Mar 16 15:50:51 crc kubenswrapper[5120]: I0316 15:50:51.496305 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f04a8ed834124c78833d3dc12d90bf97864fb4cbf8914a48c1a4ee683bb8f801" Mar 16 15:50:51 crc kubenswrapper[5120]: I0316 15:50:51.502083 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-5b47d59db-lz86c" event={"ID":"6b459d6b-d4c6-44e9-ae6f-05e060b30042","Type":"ContainerStarted","Data":"31a3f7987d644deffbc21f34088a712eb5c19746f768b2196ef79e4b1db621a9"} Mar 16 15:50:51 crc kubenswrapper[5120]: I0316 15:50:51.669880 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-76b87c5788-h6qrd"] Mar 16 15:50:51 crc kubenswrapper[5120]: I0316 15:50:51.995486 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-57d5475c78-rsjsp"] Mar 16 15:50:51 crc kubenswrapper[5120]: I0316 15:50:51.996523 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47203a51-c1a7-433b-990b-f7744bc74071" containerName="keystone-bootstrap" Mar 16 15:50:51 crc kubenswrapper[5120]: I0316 15:50:51.996546 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="47203a51-c1a7-433b-990b-f7744bc74071" containerName="keystone-bootstrap" Mar 16 15:50:51 crc kubenswrapper[5120]: I0316 15:50:51.996727 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="47203a51-c1a7-433b-990b-f7744bc74071" containerName="keystone-bootstrap" Mar 16 15:50:52 crc kubenswrapper[5120]: I0316 15:50:52.003361 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-57d5475c78-rsjsp" Mar 16 15:50:52 crc kubenswrapper[5120]: I0316 15:50:52.006475 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-scripts\"" Mar 16 15:50:52 crc kubenswrapper[5120]: I0316 15:50:52.006646 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone\"" Mar 16 15:50:52 crc kubenswrapper[5120]: I0316 15:50:52.006830 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-keystone-public-svc\"" Mar 16 15:50:52 crc kubenswrapper[5120]: I0316 15:50:52.006994 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-keystone-internal-svc\"" Mar 16 15:50:52 crc kubenswrapper[5120]: I0316 15:50:52.007114 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-keystone-dockercfg-qznbk\"" Mar 16 15:50:52 crc kubenswrapper[5120]: I0316 15:50:52.007440 5120 patch_prober.go:28] interesting pod/machine-config-daemon-7bf76 container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 15:50:52 crc kubenswrapper[5120]: I0316 15:50:52.007475 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 15:50:52 crc kubenswrapper[5120]: I0316 15:50:52.007673 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-57d5475c78-rsjsp"] Mar 16 15:50:52 crc kubenswrapper[5120]: I0316 15:50:52.019116 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-config-data\"" Mar 16 15:50:52 crc kubenswrapper[5120]: I0316 15:50:52.104249 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/07b2313a-7b50-4c4a-b485-ef68c88e468a-scripts\") pod \"keystone-57d5475c78-rsjsp\" (UID: \"07b2313a-7b50-4c4a-b485-ef68c88e468a\") " pod="openstack-kuttl-tests/keystone-57d5475c78-rsjsp" Mar 16 15:50:52 crc kubenswrapper[5120]: I0316 15:50:52.104314 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/07b2313a-7b50-4c4a-b485-ef68c88e468a-fernet-keys\") pod \"keystone-57d5475c78-rsjsp\" (UID: \"07b2313a-7b50-4c4a-b485-ef68c88e468a\") " pod="openstack-kuttl-tests/keystone-57d5475c78-rsjsp" Mar 16 15:50:52 crc kubenswrapper[5120]: I0316 15:50:52.104369 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/07b2313a-7b50-4c4a-b485-ef68c88e468a-public-tls-certs\") pod \"keystone-57d5475c78-rsjsp\" (UID: \"07b2313a-7b50-4c4a-b485-ef68c88e468a\") " pod="openstack-kuttl-tests/keystone-57d5475c78-rsjsp" Mar 16 15:50:52 crc kubenswrapper[5120]: I0316 15:50:52.104448 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/07b2313a-7b50-4c4a-b485-ef68c88e468a-credential-keys\") pod \"keystone-57d5475c78-rsjsp\" (UID: \"07b2313a-7b50-4c4a-b485-ef68c88e468a\") " pod="openstack-kuttl-tests/keystone-57d5475c78-rsjsp" Mar 16 15:50:52 crc kubenswrapper[5120]: I0316 15:50:52.104852 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/07b2313a-7b50-4c4a-b485-ef68c88e468a-combined-ca-bundle\") pod \"keystone-57d5475c78-rsjsp\" (UID: \"07b2313a-7b50-4c4a-b485-ef68c88e468a\") " pod="openstack-kuttl-tests/keystone-57d5475c78-rsjsp" Mar 16 15:50:52 crc kubenswrapper[5120]: I0316 15:50:52.104901 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/07b2313a-7b50-4c4a-b485-ef68c88e468a-internal-tls-certs\") pod \"keystone-57d5475c78-rsjsp\" (UID: \"07b2313a-7b50-4c4a-b485-ef68c88e468a\") " pod="openstack-kuttl-tests/keystone-57d5475c78-rsjsp" Mar 16 15:50:52 crc kubenswrapper[5120]: I0316 15:50:52.104938 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/07b2313a-7b50-4c4a-b485-ef68c88e468a-config-data\") pod \"keystone-57d5475c78-rsjsp\" (UID: \"07b2313a-7b50-4c4a-b485-ef68c88e468a\") " pod="openstack-kuttl-tests/keystone-57d5475c78-rsjsp" Mar 16 15:50:52 crc kubenswrapper[5120]: I0316 15:50:52.105062 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnkpc\" (UniqueName: \"kubernetes.io/projected/07b2313a-7b50-4c4a-b485-ef68c88e468a-kube-api-access-rnkpc\") pod \"keystone-57d5475c78-rsjsp\" (UID: \"07b2313a-7b50-4c4a-b485-ef68c88e468a\") " pod="openstack-kuttl-tests/keystone-57d5475c78-rsjsp" Mar 16 15:50:52 crc kubenswrapper[5120]: I0316 15:50:52.206441 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/07b2313a-7b50-4c4a-b485-ef68c88e468a-internal-tls-certs\") pod \"keystone-57d5475c78-rsjsp\" (UID: \"07b2313a-7b50-4c4a-b485-ef68c88e468a\") " pod="openstack-kuttl-tests/keystone-57d5475c78-rsjsp" Mar 16 15:50:52 crc kubenswrapper[5120]: I0316 15:50:52.206526 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/07b2313a-7b50-4c4a-b485-ef68c88e468a-config-data\") pod \"keystone-57d5475c78-rsjsp\" (UID: \"07b2313a-7b50-4c4a-b485-ef68c88e468a\") " pod="openstack-kuttl-tests/keystone-57d5475c78-rsjsp" Mar 16 15:50:52 crc kubenswrapper[5120]: I0316 15:50:52.206587 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rnkpc\" (UniqueName: \"kubernetes.io/projected/07b2313a-7b50-4c4a-b485-ef68c88e468a-kube-api-access-rnkpc\") pod \"keystone-57d5475c78-rsjsp\" (UID: \"07b2313a-7b50-4c4a-b485-ef68c88e468a\") " pod="openstack-kuttl-tests/keystone-57d5475c78-rsjsp" Mar 16 15:50:52 crc kubenswrapper[5120]: I0316 15:50:52.206684 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/07b2313a-7b50-4c4a-b485-ef68c88e468a-scripts\") pod \"keystone-57d5475c78-rsjsp\" (UID: \"07b2313a-7b50-4c4a-b485-ef68c88e468a\") " pod="openstack-kuttl-tests/keystone-57d5475c78-rsjsp" Mar 16 15:50:52 crc kubenswrapper[5120]: I0316 15:50:52.206706 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/07b2313a-7b50-4c4a-b485-ef68c88e468a-fernet-keys\") pod \"keystone-57d5475c78-rsjsp\" (UID: \"07b2313a-7b50-4c4a-b485-ef68c88e468a\") " pod="openstack-kuttl-tests/keystone-57d5475c78-rsjsp" Mar 16 15:50:52 crc kubenswrapper[5120]: I0316 15:50:52.206772 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/07b2313a-7b50-4c4a-b485-ef68c88e468a-public-tls-certs\") pod \"keystone-57d5475c78-rsjsp\" (UID: \"07b2313a-7b50-4c4a-b485-ef68c88e468a\") " pod="openstack-kuttl-tests/keystone-57d5475c78-rsjsp" Mar 16 15:50:52 crc kubenswrapper[5120]: I0316 15:50:52.206811 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/07b2313a-7b50-4c4a-b485-ef68c88e468a-credential-keys\") pod \"keystone-57d5475c78-rsjsp\" (UID: \"07b2313a-7b50-4c4a-b485-ef68c88e468a\") " pod="openstack-kuttl-tests/keystone-57d5475c78-rsjsp" Mar 16 15:50:52 crc kubenswrapper[5120]: I0316 15:50:52.206873 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/07b2313a-7b50-4c4a-b485-ef68c88e468a-combined-ca-bundle\") pod \"keystone-57d5475c78-rsjsp\" (UID: \"07b2313a-7b50-4c4a-b485-ef68c88e468a\") " pod="openstack-kuttl-tests/keystone-57d5475c78-rsjsp" Mar 16 15:50:52 crc kubenswrapper[5120]: I0316 15:50:52.213261 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/07b2313a-7b50-4c4a-b485-ef68c88e468a-scripts\") pod \"keystone-57d5475c78-rsjsp\" (UID: \"07b2313a-7b50-4c4a-b485-ef68c88e468a\") " pod="openstack-kuttl-tests/keystone-57d5475c78-rsjsp" Mar 16 15:50:52 crc kubenswrapper[5120]: I0316 15:50:52.213336 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/07b2313a-7b50-4c4a-b485-ef68c88e468a-config-data\") pod \"keystone-57d5475c78-rsjsp\" (UID: \"07b2313a-7b50-4c4a-b485-ef68c88e468a\") " pod="openstack-kuttl-tests/keystone-57d5475c78-rsjsp" Mar 16 15:50:52 crc kubenswrapper[5120]: I0316 15:50:52.213959 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/07b2313a-7b50-4c4a-b485-ef68c88e468a-credential-keys\") pod \"keystone-57d5475c78-rsjsp\" (UID: \"07b2313a-7b50-4c4a-b485-ef68c88e468a\") " pod="openstack-kuttl-tests/keystone-57d5475c78-rsjsp" Mar 16 15:50:52 crc kubenswrapper[5120]: I0316 15:50:52.214194 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/07b2313a-7b50-4c4a-b485-ef68c88e468a-public-tls-certs\") pod \"keystone-57d5475c78-rsjsp\" (UID: \"07b2313a-7b50-4c4a-b485-ef68c88e468a\") " pod="openstack-kuttl-tests/keystone-57d5475c78-rsjsp" Mar 16 15:50:52 crc kubenswrapper[5120]: I0316 15:50:52.226203 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/07b2313a-7b50-4c4a-b485-ef68c88e468a-fernet-keys\") pod \"keystone-57d5475c78-rsjsp\" (UID: \"07b2313a-7b50-4c4a-b485-ef68c88e468a\") " pod="openstack-kuttl-tests/keystone-57d5475c78-rsjsp" Mar 16 15:50:52 crc kubenswrapper[5120]: I0316 15:50:52.226362 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/07b2313a-7b50-4c4a-b485-ef68c88e468a-internal-tls-certs\") pod \"keystone-57d5475c78-rsjsp\" (UID: \"07b2313a-7b50-4c4a-b485-ef68c88e468a\") " pod="openstack-kuttl-tests/keystone-57d5475c78-rsjsp" Mar 16 15:50:52 crc kubenswrapper[5120]: I0316 15:50:52.227127 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/07b2313a-7b50-4c4a-b485-ef68c88e468a-combined-ca-bundle\") pod \"keystone-57d5475c78-rsjsp\" (UID: \"07b2313a-7b50-4c4a-b485-ef68c88e468a\") " pod="openstack-kuttl-tests/keystone-57d5475c78-rsjsp" Mar 16 15:50:52 crc kubenswrapper[5120]: I0316 15:50:52.234951 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnkpc\" (UniqueName: \"kubernetes.io/projected/07b2313a-7b50-4c4a-b485-ef68c88e468a-kube-api-access-rnkpc\") pod \"keystone-57d5475c78-rsjsp\" (UID: \"07b2313a-7b50-4c4a-b485-ef68c88e468a\") " pod="openstack-kuttl-tests/keystone-57d5475c78-rsjsp" Mar 16 15:50:52 crc kubenswrapper[5120]: I0316 15:50:52.323825 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-57d5475c78-rsjsp" Mar 16 15:50:53 crc kubenswrapper[5120]: I0316 15:50:53.524784 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:50:53 crc kubenswrapper[5120]: I0316 15:50:53.525078 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:50:53 crc kubenswrapper[5120]: I0316 15:50:53.556493 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:50:53 crc kubenswrapper[5120]: I0316 15:50:53.558248 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:50:53 crc kubenswrapper[5120]: I0316 15:50:53.559021 5120 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Mar 16 15:50:53 crc kubenswrapper[5120]: I0316 15:50:53.570498 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:50:53 crc kubenswrapper[5120]: I0316 15:50:53.592208 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:50:53 crc kubenswrapper[5120]: W0316 15:50:53.725970 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbcd3c028_eca6_4aaf_afb4_f0887af035e8.slice/crio-278b4085784c33a3446da09fe07be6d7fbd999672e8095019efa7e49d1447c55 WatchSource:0}: Error finding container 278b4085784c33a3446da09fe07be6d7fbd999672e8095019efa7e49d1447c55: Status 404 returned error can't find the container with id 278b4085784c33a3446da09fe07be6d7fbd999672e8095019efa7e49d1447c55 Mar 16 15:50:54 crc kubenswrapper[5120]: I0316 15:50:54.030691 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-gwbbm" Mar 16 15:50:54 crc kubenswrapper[5120]: I0316 15:50:54.154040 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/2645c221-c2bd-4cd3-a073-9396a5a87708-etc-machine-id\") pod \"2645c221-c2bd-4cd3-a073-9396a5a87708\" (UID: \"2645c221-c2bd-4cd3-a073-9396a5a87708\") " Mar 16 15:50:54 crc kubenswrapper[5120]: I0316 15:50:54.154144 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/2645c221-c2bd-4cd3-a073-9396a5a87708-db-sync-config-data\") pod \"2645c221-c2bd-4cd3-a073-9396a5a87708\" (UID: \"2645c221-c2bd-4cd3-a073-9396a5a87708\") " Mar 16 15:50:54 crc kubenswrapper[5120]: I0316 15:50:54.154215 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2645c221-c2bd-4cd3-a073-9396a5a87708-scripts\") pod \"2645c221-c2bd-4cd3-a073-9396a5a87708\" (UID: \"2645c221-c2bd-4cd3-a073-9396a5a87708\") " Mar 16 15:50:54 crc kubenswrapper[5120]: I0316 15:50:54.154264 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2645c221-c2bd-4cd3-a073-9396a5a87708-combined-ca-bundle\") pod \"2645c221-c2bd-4cd3-a073-9396a5a87708\" (UID: \"2645c221-c2bd-4cd3-a073-9396a5a87708\") " Mar 16 15:50:54 crc kubenswrapper[5120]: I0316 15:50:54.154338 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2645c221-c2bd-4cd3-a073-9396a5a87708-config-data\") pod \"2645c221-c2bd-4cd3-a073-9396a5a87708\" (UID: \"2645c221-c2bd-4cd3-a073-9396a5a87708\") " Mar 16 15:50:54 crc kubenswrapper[5120]: I0316 15:50:54.154463 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2r6j8\" (UniqueName: \"kubernetes.io/projected/2645c221-c2bd-4cd3-a073-9396a5a87708-kube-api-access-2r6j8\") pod \"2645c221-c2bd-4cd3-a073-9396a5a87708\" (UID: \"2645c221-c2bd-4cd3-a073-9396a5a87708\") " Mar 16 15:50:54 crc kubenswrapper[5120]: I0316 15:50:54.155331 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/2645c221-c2bd-4cd3-a073-9396a5a87708-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "2645c221-c2bd-4cd3-a073-9396a5a87708" (UID: "2645c221-c2bd-4cd3-a073-9396a5a87708"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 15:50:54 crc kubenswrapper[5120]: I0316 15:50:54.161102 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2645c221-c2bd-4cd3-a073-9396a5a87708-db-sync-config-data" (OuterVolumeSpecName: "db-sync-config-data") pod "2645c221-c2bd-4cd3-a073-9396a5a87708" (UID: "2645c221-c2bd-4cd3-a073-9396a5a87708"). InnerVolumeSpecName "db-sync-config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:50:54 crc kubenswrapper[5120]: I0316 15:50:54.162927 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2645c221-c2bd-4cd3-a073-9396a5a87708-scripts" (OuterVolumeSpecName: "scripts") pod "2645c221-c2bd-4cd3-a073-9396a5a87708" (UID: "2645c221-c2bd-4cd3-a073-9396a5a87708"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:50:54 crc kubenswrapper[5120]: I0316 15:50:54.164116 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2645c221-c2bd-4cd3-a073-9396a5a87708-kube-api-access-2r6j8" (OuterVolumeSpecName: "kube-api-access-2r6j8") pod "2645c221-c2bd-4cd3-a073-9396a5a87708" (UID: "2645c221-c2bd-4cd3-a073-9396a5a87708"). InnerVolumeSpecName "kube-api-access-2r6j8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:50:54 crc kubenswrapper[5120]: I0316 15:50:54.188007 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2645c221-c2bd-4cd3-a073-9396a5a87708-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "2645c221-c2bd-4cd3-a073-9396a5a87708" (UID: "2645c221-c2bd-4cd3-a073-9396a5a87708"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:50:54 crc kubenswrapper[5120]: I0316 15:50:54.212391 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2645c221-c2bd-4cd3-a073-9396a5a87708-config-data" (OuterVolumeSpecName: "config-data") pod "2645c221-c2bd-4cd3-a073-9396a5a87708" (UID: "2645c221-c2bd-4cd3-a073-9396a5a87708"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:50:54 crc kubenswrapper[5120]: I0316 15:50:54.256246 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2645c221-c2bd-4cd3-a073-9396a5a87708-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 15:50:54 crc kubenswrapper[5120]: I0316 15:50:54.256369 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2645c221-c2bd-4cd3-a073-9396a5a87708-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:50:54 crc kubenswrapper[5120]: I0316 15:50:54.256433 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2645c221-c2bd-4cd3-a073-9396a5a87708-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 15:50:54 crc kubenswrapper[5120]: I0316 15:50:54.256486 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2r6j8\" (UniqueName: \"kubernetes.io/projected/2645c221-c2bd-4cd3-a073-9396a5a87708-kube-api-access-2r6j8\") on node \"crc\" DevicePath \"\"" Mar 16 15:50:54 crc kubenswrapper[5120]: I0316 15:50:54.256548 5120 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/2645c221-c2bd-4cd3-a073-9396a5a87708-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 15:50:54 crc kubenswrapper[5120]: I0316 15:50:54.256604 5120 reconciler_common.go:299] "Volume detached for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/2645c221-c2bd-4cd3-a073-9396a5a87708-db-sync-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 15:50:54 crc kubenswrapper[5120]: I0316 15:50:54.320606 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-57d5475c78-rsjsp"] Mar 16 15:50:54 crc kubenswrapper[5120]: I0316 15:50:54.538700 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-5b47d59db-lz86c" event={"ID":"6b459d6b-d4c6-44e9-ae6f-05e060b30042","Type":"ContainerStarted","Data":"114a179baefc421d90a7e2b6fb81ce44aedfdabd5862f6335d333b6d4eedf732"} Mar 16 15:50:54 crc kubenswrapper[5120]: I0316 15:50:54.538780 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-5b47d59db-lz86c" event={"ID":"6b459d6b-d4c6-44e9-ae6f-05e060b30042","Type":"ContainerStarted","Data":"253263514b37a7de242416afffbc4f1dccc4a251618796a8cd4cfed35d4d0e2a"} Mar 16 15:50:54 crc kubenswrapper[5120]: I0316 15:50:54.538857 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-5b47d59db-lz86c" Mar 16 15:50:54 crc kubenswrapper[5120]: I0316 15:50:54.538890 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-5b47d59db-lz86c" Mar 16 15:50:54 crc kubenswrapper[5120]: I0316 15:50:54.540733 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-57d5475c78-rsjsp" event={"ID":"07b2313a-7b50-4c4a-b485-ef68c88e468a","Type":"ContainerStarted","Data":"497e64e16b22008e1580d7bcf4de8aa734e1762960610ad1eee91171968fbc0a"} Mar 16 15:50:54 crc kubenswrapper[5120]: I0316 15:50:54.540781 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-57d5475c78-rsjsp" event={"ID":"07b2313a-7b50-4c4a-b485-ef68c88e468a","Type":"ContainerStarted","Data":"74ac48eab51aa4b5c8c154c6b48b3a79705b95009316b32ed6ad9a9ecc510bd4"} Mar 16 15:50:54 crc kubenswrapper[5120]: I0316 15:50:54.541208 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/keystone-57d5475c78-rsjsp" Mar 16 15:50:54 crc kubenswrapper[5120]: I0316 15:50:54.543870 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-76b87c5788-h6qrd" event={"ID":"bcd3c028-eca6-4aaf-afb4-f0887af035e8","Type":"ContainerStarted","Data":"0173ba7a44d2f4d71b00b887d464f59a9e13d78af4744e9bb2d93a6819823274"} Mar 16 15:50:54 crc kubenswrapper[5120]: I0316 15:50:54.543912 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-76b87c5788-h6qrd" event={"ID":"bcd3c028-eca6-4aaf-afb4-f0887af035e8","Type":"ContainerStarted","Data":"6ee6932cdb77d06a62649b97408355f2022176de3f511c922e65a0dae8f9c58f"} Mar 16 15:50:54 crc kubenswrapper[5120]: I0316 15:50:54.543924 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-76b87c5788-h6qrd" event={"ID":"bcd3c028-eca6-4aaf-afb4-f0887af035e8","Type":"ContainerStarted","Data":"278b4085784c33a3446da09fe07be6d7fbd999672e8095019efa7e49d1447c55"} Mar 16 15:50:54 crc kubenswrapper[5120]: I0316 15:50:54.543938 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-76b87c5788-h6qrd" Mar 16 15:50:54 crc kubenswrapper[5120]: I0316 15:50:54.543951 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-76b87c5788-h6qrd" Mar 16 15:50:54 crc kubenswrapper[5120]: I0316 15:50:54.549388 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"2b8e2567-77a1-4c2c-930c-785714326aba","Type":"ContainerStarted","Data":"152d2932cf6f6e7d6fb471b829f43f0e0ed317ec14c8f25b3517a806f58a0711"} Mar 16 15:50:54 crc kubenswrapper[5120]: I0316 15:50:54.551141 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-698fb447c8-kz5xv" event={"ID":"6d402989-2c1d-4b01-a058-ffd1bd6767f4","Type":"ContainerStarted","Data":"b85fa4a68c26908f3908435b2a41fbc8f829ecf5aa3b8f0a45ff0b72148ba114"} Mar 16 15:50:54 crc kubenswrapper[5120]: I0316 15:50:54.553010 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-f5746c74d-vbhjh" event={"ID":"fb486d50-9a5f-40e2-842a-d942a88eb350","Type":"ContainerStarted","Data":"daefa4a7acfb48f0a196312071337a06466868dcc2eea5e8d08436b7a01419bb"} Mar 16 15:50:54 crc kubenswrapper[5120]: I0316 15:50:54.553053 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-f5746c74d-vbhjh" event={"ID":"fb486d50-9a5f-40e2-842a-d942a88eb350","Type":"ContainerStarted","Data":"cc1de401132c538230618727bb825fe8bbb5a3d2d2aec30b67f541368b5a648c"} Mar 16 15:50:54 crc kubenswrapper[5120]: I0316 15:50:54.553071 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-f5746c74d-vbhjh" event={"ID":"fb486d50-9a5f-40e2-842a-d942a88eb350","Type":"ContainerStarted","Data":"d4548f85dbe7f8f4946353378e26da0961a2879207998e2689cbeef4bdeeaeb5"} Mar 16 15:50:54 crc kubenswrapper[5120]: I0316 15:50:54.553172 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-f5746c74d-vbhjh" Mar 16 15:50:54 crc kubenswrapper[5120]: I0316 15:50:54.553256 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-f5746c74d-vbhjh" Mar 16 15:50:54 crc kubenswrapper[5120]: I0316 15:50:54.555645 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-gwbbm" Mar 16 15:50:54 crc kubenswrapper[5120]: I0316 15:50:54.555644 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-gwbbm" event={"ID":"2645c221-c2bd-4cd3-a073-9396a5a87708","Type":"ContainerDied","Data":"f1222a794831eb4415f46058f97def84b0e90d3811f6fe6528c9248213efe52f"} Mar 16 15:50:54 crc kubenswrapper[5120]: I0316 15:50:54.555747 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f1222a794831eb4415f46058f97def84b0e90d3811f6fe6528c9248213efe52f" Mar 16 15:50:54 crc kubenswrapper[5120]: I0316 15:50:54.556659 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-895d6468c-b4n82" event={"ID":"ae0bb770-ecc1-4c2e-ab55-438b27b60d5c","Type":"ContainerStarted","Data":"21713cd1bf49d0ac4d34954608d654d218d8090c2011e12801ba72cb9a2877ca"} Mar 16 15:50:54 crc kubenswrapper[5120]: I0316 15:50:54.557136 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:50:54 crc kubenswrapper[5120]: I0316 15:50:54.557163 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:50:54 crc kubenswrapper[5120]: I0316 15:50:54.568994 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-5b47d59db-lz86c" podStartSLOduration=7.568976735 podStartE2EDuration="7.568976735s" podCreationTimestamp="2026-03-16 15:50:47 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:50:54.564089991 +0000 UTC m=+1156.718021648" watchObservedRunningTime="2026-03-16 15:50:54.568976735 +0000 UTC m=+1156.722908382" Mar 16 15:50:54 crc kubenswrapper[5120]: I0316 15:50:54.609861 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-api-76b87c5788-h6qrd" podStartSLOduration=4.609847014 podStartE2EDuration="4.609847014s" podCreationTimestamp="2026-03-16 15:50:50 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:50:54.609005074 +0000 UTC m=+1156.762936731" watchObservedRunningTime="2026-03-16 15:50:54.609847014 +0000 UTC m=+1156.763778671" Mar 16 15:50:54 crc kubenswrapper[5120]: I0316 15:50:54.630725 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-api-f5746c74d-vbhjh" podStartSLOduration=7.630706048 podStartE2EDuration="7.630706048s" podCreationTimestamp="2026-03-16 15:50:47 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:50:54.590243839 +0000 UTC m=+1156.744175496" watchObservedRunningTime="2026-03-16 15:50:54.630706048 +0000 UTC m=+1156.784637695" Mar 16 15:50:54 crc kubenswrapper[5120]: I0316 15:50:54.636639 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-57d5475c78-rsjsp" podStartSLOduration=3.636627515 podStartE2EDuration="3.636627515s" podCreationTimestamp="2026-03-16 15:50:51 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:50:54.630094593 +0000 UTC m=+1156.784026250" watchObservedRunningTime="2026-03-16 15:50:54.636627515 +0000 UTC m=+1156.790559172" Mar 16 15:50:55 crc kubenswrapper[5120]: I0316 15:50:55.382907 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 15:50:55 crc kubenswrapper[5120]: I0316 15:50:55.390171 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2645c221-c2bd-4cd3-a073-9396a5a87708" containerName="cinder-db-sync" Mar 16 15:50:55 crc kubenswrapper[5120]: I0316 15:50:55.390208 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="2645c221-c2bd-4cd3-a073-9396a5a87708" containerName="cinder-db-sync" Mar 16 15:50:55 crc kubenswrapper[5120]: I0316 15:50:55.390431 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="2645c221-c2bd-4cd3-a073-9396a5a87708" containerName="cinder-db-sync" Mar 16 15:50:55 crc kubenswrapper[5120]: I0316 15:50:55.401105 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 15:50:55 crc kubenswrapper[5120]: I0316 15:50:55.403934 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-scripts\"" Mar 16 15:50:55 crc kubenswrapper[5120]: I0316 15:50:55.404998 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-scheduler-config-data\"" Mar 16 15:50:55 crc kubenswrapper[5120]: I0316 15:50:55.405568 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-config-data\"" Mar 16 15:50:55 crc kubenswrapper[5120]: I0316 15:50:55.407505 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-cinder-dockercfg-sn6m9\"" Mar 16 15:50:55 crc kubenswrapper[5120]: I0316 15:50:55.412048 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 15:50:55 crc kubenswrapper[5120]: I0316 15:50:55.476178 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-md9fk\" (UniqueName: \"kubernetes.io/projected/170a65d6-484e-4797-8619-b913987e8313-kube-api-access-md9fk\") pod \"cinder-scheduler-0\" (UID: \"170a65d6-484e-4797-8619-b913987e8313\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 15:50:55 crc kubenswrapper[5120]: I0316 15:50:55.476301 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/170a65d6-484e-4797-8619-b913987e8313-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"170a65d6-484e-4797-8619-b913987e8313\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 15:50:55 crc kubenswrapper[5120]: I0316 15:50:55.476325 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/170a65d6-484e-4797-8619-b913987e8313-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"170a65d6-484e-4797-8619-b913987e8313\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 15:50:55 crc kubenswrapper[5120]: I0316 15:50:55.476383 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/170a65d6-484e-4797-8619-b913987e8313-config-data\") pod \"cinder-scheduler-0\" (UID: \"170a65d6-484e-4797-8619-b913987e8313\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 15:50:55 crc kubenswrapper[5120]: I0316 15:50:55.476412 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/170a65d6-484e-4797-8619-b913987e8313-scripts\") pod \"cinder-scheduler-0\" (UID: \"170a65d6-484e-4797-8619-b913987e8313\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 15:50:55 crc kubenswrapper[5120]: I0316 15:50:55.476438 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/170a65d6-484e-4797-8619-b913987e8313-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"170a65d6-484e-4797-8619-b913987e8313\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 15:50:55 crc kubenswrapper[5120]: I0316 15:50:55.552279 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 15:50:55 crc kubenswrapper[5120]: I0316 15:50:55.560854 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:50:55 crc kubenswrapper[5120]: I0316 15:50:55.563014 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 15:50:55 crc kubenswrapper[5120]: I0316 15:50:55.568683 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-api-config-data\"" Mar 16 15:50:55 crc kubenswrapper[5120]: I0316 15:50:55.577912 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/170a65d6-484e-4797-8619-b913987e8313-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"170a65d6-484e-4797-8619-b913987e8313\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 15:50:55 crc kubenswrapper[5120]: I0316 15:50:55.577960 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/170a65d6-484e-4797-8619-b913987e8313-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"170a65d6-484e-4797-8619-b913987e8313\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 15:50:55 crc kubenswrapper[5120]: I0316 15:50:55.578039 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/170a65d6-484e-4797-8619-b913987e8313-config-data\") pod \"cinder-scheduler-0\" (UID: \"170a65d6-484e-4797-8619-b913987e8313\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 15:50:55 crc kubenswrapper[5120]: I0316 15:50:55.578075 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/170a65d6-484e-4797-8619-b913987e8313-scripts\") pod \"cinder-scheduler-0\" (UID: \"170a65d6-484e-4797-8619-b913987e8313\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 15:50:55 crc kubenswrapper[5120]: I0316 15:50:55.578099 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/170a65d6-484e-4797-8619-b913987e8313-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"170a65d6-484e-4797-8619-b913987e8313\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 15:50:55 crc kubenswrapper[5120]: I0316 15:50:55.578154 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-md9fk\" (UniqueName: \"kubernetes.io/projected/170a65d6-484e-4797-8619-b913987e8313-kube-api-access-md9fk\") pod \"cinder-scheduler-0\" (UID: \"170a65d6-484e-4797-8619-b913987e8313\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 15:50:55 crc kubenswrapper[5120]: I0316 15:50:55.578481 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/170a65d6-484e-4797-8619-b913987e8313-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"170a65d6-484e-4797-8619-b913987e8313\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 15:50:55 crc kubenswrapper[5120]: I0316 15:50:55.588557 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/170a65d6-484e-4797-8619-b913987e8313-scripts\") pod \"cinder-scheduler-0\" (UID: \"170a65d6-484e-4797-8619-b913987e8313\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 15:50:55 crc kubenswrapper[5120]: I0316 15:50:55.589296 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/170a65d6-484e-4797-8619-b913987e8313-config-data\") pod \"cinder-scheduler-0\" (UID: \"170a65d6-484e-4797-8619-b913987e8313\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 15:50:55 crc kubenswrapper[5120]: I0316 15:50:55.600055 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/170a65d6-484e-4797-8619-b913987e8313-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"170a65d6-484e-4797-8619-b913987e8313\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 15:50:55 crc kubenswrapper[5120]: I0316 15:50:55.608602 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-md9fk\" (UniqueName: \"kubernetes.io/projected/170a65d6-484e-4797-8619-b913987e8313-kube-api-access-md9fk\") pod \"cinder-scheduler-0\" (UID: \"170a65d6-484e-4797-8619-b913987e8313\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 15:50:55 crc kubenswrapper[5120]: I0316 15:50:55.623856 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/170a65d6-484e-4797-8619-b913987e8313-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"170a65d6-484e-4797-8619-b913987e8313\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 15:50:55 crc kubenswrapper[5120]: I0316 15:50:55.681533 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzwbc\" (UniqueName: \"kubernetes.io/projected/8df7575c-428a-4f47-8bd5-de8d39829afb-kube-api-access-dzwbc\") pod \"cinder-api-0\" (UID: \"8df7575c-428a-4f47-8bd5-de8d39829afb\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:50:55 crc kubenswrapper[5120]: I0316 15:50:55.681636 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8df7575c-428a-4f47-8bd5-de8d39829afb-scripts\") pod \"cinder-api-0\" (UID: \"8df7575c-428a-4f47-8bd5-de8d39829afb\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:50:55 crc kubenswrapper[5120]: I0316 15:50:55.681752 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/8df7575c-428a-4f47-8bd5-de8d39829afb-etc-machine-id\") pod \"cinder-api-0\" (UID: \"8df7575c-428a-4f47-8bd5-de8d39829afb\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:50:55 crc kubenswrapper[5120]: I0316 15:50:55.681838 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/8df7575c-428a-4f47-8bd5-de8d39829afb-config-data-custom\") pod \"cinder-api-0\" (UID: \"8df7575c-428a-4f47-8bd5-de8d39829afb\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:50:55 crc kubenswrapper[5120]: I0316 15:50:55.681853 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8df7575c-428a-4f47-8bd5-de8d39829afb-logs\") pod \"cinder-api-0\" (UID: \"8df7575c-428a-4f47-8bd5-de8d39829afb\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:50:55 crc kubenswrapper[5120]: I0316 15:50:55.681880 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8df7575c-428a-4f47-8bd5-de8d39829afb-config-data\") pod \"cinder-api-0\" (UID: \"8df7575c-428a-4f47-8bd5-de8d39829afb\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:50:55 crc kubenswrapper[5120]: I0316 15:50:55.681988 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8df7575c-428a-4f47-8bd5-de8d39829afb-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"8df7575c-428a-4f47-8bd5-de8d39829afb\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:50:55 crc kubenswrapper[5120]: I0316 15:50:55.719335 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 15:50:55 crc kubenswrapper[5120]: I0316 15:50:55.785408 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8df7575c-428a-4f47-8bd5-de8d39829afb-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"8df7575c-428a-4f47-8bd5-de8d39829afb\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:50:55 crc kubenswrapper[5120]: I0316 15:50:55.785552 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dzwbc\" (UniqueName: \"kubernetes.io/projected/8df7575c-428a-4f47-8bd5-de8d39829afb-kube-api-access-dzwbc\") pod \"cinder-api-0\" (UID: \"8df7575c-428a-4f47-8bd5-de8d39829afb\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:50:55 crc kubenswrapper[5120]: I0316 15:50:55.785635 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8df7575c-428a-4f47-8bd5-de8d39829afb-scripts\") pod \"cinder-api-0\" (UID: \"8df7575c-428a-4f47-8bd5-de8d39829afb\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:50:55 crc kubenswrapper[5120]: I0316 15:50:55.785794 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/8df7575c-428a-4f47-8bd5-de8d39829afb-etc-machine-id\") pod \"cinder-api-0\" (UID: \"8df7575c-428a-4f47-8bd5-de8d39829afb\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:50:55 crc kubenswrapper[5120]: I0316 15:50:55.785900 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/8df7575c-428a-4f47-8bd5-de8d39829afb-config-data-custom\") pod \"cinder-api-0\" (UID: \"8df7575c-428a-4f47-8bd5-de8d39829afb\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:50:55 crc kubenswrapper[5120]: I0316 15:50:55.785909 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/8df7575c-428a-4f47-8bd5-de8d39829afb-etc-machine-id\") pod \"cinder-api-0\" (UID: \"8df7575c-428a-4f47-8bd5-de8d39829afb\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:50:55 crc kubenswrapper[5120]: I0316 15:50:55.785920 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8df7575c-428a-4f47-8bd5-de8d39829afb-logs\") pod \"cinder-api-0\" (UID: \"8df7575c-428a-4f47-8bd5-de8d39829afb\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:50:55 crc kubenswrapper[5120]: I0316 15:50:55.785983 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8df7575c-428a-4f47-8bd5-de8d39829afb-config-data\") pod \"cinder-api-0\" (UID: \"8df7575c-428a-4f47-8bd5-de8d39829afb\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:50:55 crc kubenswrapper[5120]: I0316 15:50:55.786337 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8df7575c-428a-4f47-8bd5-de8d39829afb-logs\") pod \"cinder-api-0\" (UID: \"8df7575c-428a-4f47-8bd5-de8d39829afb\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:50:55 crc kubenswrapper[5120]: I0316 15:50:55.790215 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8df7575c-428a-4f47-8bd5-de8d39829afb-scripts\") pod \"cinder-api-0\" (UID: \"8df7575c-428a-4f47-8bd5-de8d39829afb\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:50:55 crc kubenswrapper[5120]: I0316 15:50:55.790386 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8df7575c-428a-4f47-8bd5-de8d39829afb-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"8df7575c-428a-4f47-8bd5-de8d39829afb\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:50:55 crc kubenswrapper[5120]: I0316 15:50:55.790704 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/8df7575c-428a-4f47-8bd5-de8d39829afb-config-data-custom\") pod \"cinder-api-0\" (UID: \"8df7575c-428a-4f47-8bd5-de8d39829afb\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:50:55 crc kubenswrapper[5120]: I0316 15:50:55.801184 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzwbc\" (UniqueName: \"kubernetes.io/projected/8df7575c-428a-4f47-8bd5-de8d39829afb-kube-api-access-dzwbc\") pod \"cinder-api-0\" (UID: \"8df7575c-428a-4f47-8bd5-de8d39829afb\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:50:55 crc kubenswrapper[5120]: I0316 15:50:55.801783 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8df7575c-428a-4f47-8bd5-de8d39829afb-config-data\") pod \"cinder-api-0\" (UID: \"8df7575c-428a-4f47-8bd5-de8d39829afb\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:50:55 crc kubenswrapper[5120]: I0316 15:50:55.882599 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:50:56 crc kubenswrapper[5120]: I0316 15:50:56.615442 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-698fb447c8-kz5xv" event={"ID":"6d402989-2c1d-4b01-a058-ffd1bd6767f4","Type":"ContainerStarted","Data":"eb55125e5ba83542eeb562e76bcfc122823207f4d50994930918dd5526c3b0bd"} Mar 16 15:50:56 crc kubenswrapper[5120]: I0316 15:50:56.634802 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-895d6468c-b4n82" event={"ID":"ae0bb770-ecc1-4c2e-ab55-438b27b60d5c","Type":"ContainerStarted","Data":"44d53f4a0578ab4484d9ed2fed30ca03085fd85122e1e63e31abaea9ebeb9bbe"} Mar 16 15:50:56 crc kubenswrapper[5120]: I0316 15:50:56.634871 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-895d6468c-b4n82" event={"ID":"ae0bb770-ecc1-4c2e-ab55-438b27b60d5c","Type":"ContainerStarted","Data":"1d2d2134fdda0c5e0372299b027d1622da0a3a3ae78ccd4636f7f944c923063f"} Mar 16 15:50:56 crc kubenswrapper[5120]: I0316 15:50:56.662599 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 15:50:56 crc kubenswrapper[5120]: I0316 15:50:56.665487 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-worker-895d6468c-b4n82" podStartSLOduration=7.217232069 podStartE2EDuration="9.665463247s" podCreationTimestamp="2026-03-16 15:50:47 +0000 UTC" firstStartedPulling="2026-03-16 15:50:53.755163381 +0000 UTC m=+1155.909095038" lastFinishedPulling="2026-03-16 15:50:56.203394549 +0000 UTC m=+1158.357326216" observedRunningTime="2026-03-16 15:50:56.654325228 +0000 UTC m=+1158.808256905" watchObservedRunningTime="2026-03-16 15:50:56.665463247 +0000 UTC m=+1158.819394914" Mar 16 15:50:56 crc kubenswrapper[5120]: W0316 15:50:56.673917 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8df7575c_428a_4f47_8bd5_de8d39829afb.slice/crio-ccadf36e46253254780761bcc28680465c3c8ee86e45cfabda1efbf5efe07689 WatchSource:0}: Error finding container ccadf36e46253254780761bcc28680465c3c8ee86e45cfabda1efbf5efe07689: Status 404 returned error can't find the container with id ccadf36e46253254780761bcc28680465c3c8ee86e45cfabda1efbf5efe07689 Mar 16 15:50:56 crc kubenswrapper[5120]: I0316 15:50:56.707883 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 15:50:56 crc kubenswrapper[5120]: I0316 15:50:56.831819 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-f4d9ffc8d-lwp78"] Mar 16 15:50:56 crc kubenswrapper[5120]: I0316 15:50:56.851574 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-f4d9ffc8d-lwp78" Mar 16 15:50:56 crc kubenswrapper[5120]: I0316 15:50:56.859966 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-worker-c7cf47df9-t2r2b"] Mar 16 15:50:56 crc kubenswrapper[5120]: I0316 15:50:56.875070 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-c7cf47df9-t2r2b" Mar 16 15:50:56 crc kubenswrapper[5120]: I0316 15:50:56.881972 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-f4d9ffc8d-lwp78"] Mar 16 15:50:56 crc kubenswrapper[5120]: I0316 15:50:56.897948 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-c7cf47df9-t2r2b"] Mar 16 15:50:56 crc kubenswrapper[5120]: I0316 15:50:56.909003 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/e0a6dd94-0b6e-446a-924b-a39ce7582090-config-data-custom\") pod \"barbican-keystone-listener-f4d9ffc8d-lwp78\" (UID: \"e0a6dd94-0b6e-446a-924b-a39ce7582090\") " pod="openstack-kuttl-tests/barbican-keystone-listener-f4d9ffc8d-lwp78" Mar 16 15:50:56 crc kubenswrapper[5120]: I0316 15:50:56.909110 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/cb293a62-0310-4af8-8376-0b2197bda8d2-logs\") pod \"barbican-worker-c7cf47df9-t2r2b\" (UID: \"cb293a62-0310-4af8-8376-0b2197bda8d2\") " pod="openstack-kuttl-tests/barbican-worker-c7cf47df9-t2r2b" Mar 16 15:50:56 crc kubenswrapper[5120]: I0316 15:50:56.909281 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cb293a62-0310-4af8-8376-0b2197bda8d2-combined-ca-bundle\") pod \"barbican-worker-c7cf47df9-t2r2b\" (UID: \"cb293a62-0310-4af8-8376-0b2197bda8d2\") " pod="openstack-kuttl-tests/barbican-worker-c7cf47df9-t2r2b" Mar 16 15:50:56 crc kubenswrapper[5120]: I0316 15:50:56.909364 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmttj\" (UniqueName: \"kubernetes.io/projected/cb293a62-0310-4af8-8376-0b2197bda8d2-kube-api-access-zmttj\") pod \"barbican-worker-c7cf47df9-t2r2b\" (UID: \"cb293a62-0310-4af8-8376-0b2197bda8d2\") " pod="openstack-kuttl-tests/barbican-worker-c7cf47df9-t2r2b" Mar 16 15:50:56 crc kubenswrapper[5120]: I0316 15:50:56.909469 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e0a6dd94-0b6e-446a-924b-a39ce7582090-combined-ca-bundle\") pod \"barbican-keystone-listener-f4d9ffc8d-lwp78\" (UID: \"e0a6dd94-0b6e-446a-924b-a39ce7582090\") " pod="openstack-kuttl-tests/barbican-keystone-listener-f4d9ffc8d-lwp78" Mar 16 15:50:56 crc kubenswrapper[5120]: I0316 15:50:56.909513 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e0a6dd94-0b6e-446a-924b-a39ce7582090-logs\") pod \"barbican-keystone-listener-f4d9ffc8d-lwp78\" (UID: \"e0a6dd94-0b6e-446a-924b-a39ce7582090\") " pod="openstack-kuttl-tests/barbican-keystone-listener-f4d9ffc8d-lwp78" Mar 16 15:50:56 crc kubenswrapper[5120]: I0316 15:50:56.909596 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cb293a62-0310-4af8-8376-0b2197bda8d2-config-data\") pod \"barbican-worker-c7cf47df9-t2r2b\" (UID: \"cb293a62-0310-4af8-8376-0b2197bda8d2\") " pod="openstack-kuttl-tests/barbican-worker-c7cf47df9-t2r2b" Mar 16 15:50:56 crc kubenswrapper[5120]: I0316 15:50:56.909634 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e0a6dd94-0b6e-446a-924b-a39ce7582090-config-data\") pod \"barbican-keystone-listener-f4d9ffc8d-lwp78\" (UID: \"e0a6dd94-0b6e-446a-924b-a39ce7582090\") " pod="openstack-kuttl-tests/barbican-keystone-listener-f4d9ffc8d-lwp78" Mar 16 15:50:56 crc kubenswrapper[5120]: I0316 15:50:56.909671 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/cb293a62-0310-4af8-8376-0b2197bda8d2-config-data-custom\") pod \"barbican-worker-c7cf47df9-t2r2b\" (UID: \"cb293a62-0310-4af8-8376-0b2197bda8d2\") " pod="openstack-kuttl-tests/barbican-worker-c7cf47df9-t2r2b" Mar 16 15:50:56 crc kubenswrapper[5120]: I0316 15:50:56.909846 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvwlb\" (UniqueName: \"kubernetes.io/projected/e0a6dd94-0b6e-446a-924b-a39ce7582090-kube-api-access-rvwlb\") pod \"barbican-keystone-listener-f4d9ffc8d-lwp78\" (UID: \"e0a6dd94-0b6e-446a-924b-a39ce7582090\") " pod="openstack-kuttl-tests/barbican-keystone-listener-f4d9ffc8d-lwp78" Mar 16 15:50:56 crc kubenswrapper[5120]: I0316 15:50:56.999709 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-f5746c74d-vbhjh"] Mar 16 15:50:57 crc kubenswrapper[5120]: I0316 15:50:56.999946 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-f5746c74d-vbhjh" podUID="fb486d50-9a5f-40e2-842a-d942a88eb350" containerName="barbican-api-log" containerID="cri-o://cc1de401132c538230618727bb825fe8bbb5a3d2d2aec30b67f541368b5a648c" gracePeriod=30 Mar 16 15:50:57 crc kubenswrapper[5120]: I0316 15:50:57.000654 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-f5746c74d-vbhjh" podUID="fb486d50-9a5f-40e2-842a-d942a88eb350" containerName="barbican-api" containerID="cri-o://daefa4a7acfb48f0a196312071337a06466868dcc2eea5e8d08436b7a01419bb" gracePeriod=30 Mar 16 15:50:57 crc kubenswrapper[5120]: I0316 15:50:57.011644 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cb293a62-0310-4af8-8376-0b2197bda8d2-config-data\") pod \"barbican-worker-c7cf47df9-t2r2b\" (UID: \"cb293a62-0310-4af8-8376-0b2197bda8d2\") " pod="openstack-kuttl-tests/barbican-worker-c7cf47df9-t2r2b" Mar 16 15:50:57 crc kubenswrapper[5120]: I0316 15:50:57.011719 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e0a6dd94-0b6e-446a-924b-a39ce7582090-config-data\") pod \"barbican-keystone-listener-f4d9ffc8d-lwp78\" (UID: \"e0a6dd94-0b6e-446a-924b-a39ce7582090\") " pod="openstack-kuttl-tests/barbican-keystone-listener-f4d9ffc8d-lwp78" Mar 16 15:50:57 crc kubenswrapper[5120]: I0316 15:50:57.011779 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/cb293a62-0310-4af8-8376-0b2197bda8d2-config-data-custom\") pod \"barbican-worker-c7cf47df9-t2r2b\" (UID: \"cb293a62-0310-4af8-8376-0b2197bda8d2\") " pod="openstack-kuttl-tests/barbican-worker-c7cf47df9-t2r2b" Mar 16 15:50:57 crc kubenswrapper[5120]: I0316 15:50:57.012396 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rvwlb\" (UniqueName: \"kubernetes.io/projected/e0a6dd94-0b6e-446a-924b-a39ce7582090-kube-api-access-rvwlb\") pod \"barbican-keystone-listener-f4d9ffc8d-lwp78\" (UID: \"e0a6dd94-0b6e-446a-924b-a39ce7582090\") " pod="openstack-kuttl-tests/barbican-keystone-listener-f4d9ffc8d-lwp78" Mar 16 15:50:57 crc kubenswrapper[5120]: I0316 15:50:57.012506 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/e0a6dd94-0b6e-446a-924b-a39ce7582090-config-data-custom\") pod \"barbican-keystone-listener-f4d9ffc8d-lwp78\" (UID: \"e0a6dd94-0b6e-446a-924b-a39ce7582090\") " pod="openstack-kuttl-tests/barbican-keystone-listener-f4d9ffc8d-lwp78" Mar 16 15:50:57 crc kubenswrapper[5120]: I0316 15:50:57.012588 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/cb293a62-0310-4af8-8376-0b2197bda8d2-logs\") pod \"barbican-worker-c7cf47df9-t2r2b\" (UID: \"cb293a62-0310-4af8-8376-0b2197bda8d2\") " pod="openstack-kuttl-tests/barbican-worker-c7cf47df9-t2r2b" Mar 16 15:50:57 crc kubenswrapper[5120]: I0316 15:50:57.012631 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cb293a62-0310-4af8-8376-0b2197bda8d2-combined-ca-bundle\") pod \"barbican-worker-c7cf47df9-t2r2b\" (UID: \"cb293a62-0310-4af8-8376-0b2197bda8d2\") " pod="openstack-kuttl-tests/barbican-worker-c7cf47df9-t2r2b" Mar 16 15:50:57 crc kubenswrapper[5120]: I0316 15:50:57.012676 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zmttj\" (UniqueName: \"kubernetes.io/projected/cb293a62-0310-4af8-8376-0b2197bda8d2-kube-api-access-zmttj\") pod \"barbican-worker-c7cf47df9-t2r2b\" (UID: \"cb293a62-0310-4af8-8376-0b2197bda8d2\") " pod="openstack-kuttl-tests/barbican-worker-c7cf47df9-t2r2b" Mar 16 15:50:57 crc kubenswrapper[5120]: I0316 15:50:57.012786 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e0a6dd94-0b6e-446a-924b-a39ce7582090-combined-ca-bundle\") pod \"barbican-keystone-listener-f4d9ffc8d-lwp78\" (UID: \"e0a6dd94-0b6e-446a-924b-a39ce7582090\") " pod="openstack-kuttl-tests/barbican-keystone-listener-f4d9ffc8d-lwp78" Mar 16 15:50:57 crc kubenswrapper[5120]: I0316 15:50:57.012824 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e0a6dd94-0b6e-446a-924b-a39ce7582090-logs\") pod \"barbican-keystone-listener-f4d9ffc8d-lwp78\" (UID: \"e0a6dd94-0b6e-446a-924b-a39ce7582090\") " pod="openstack-kuttl-tests/barbican-keystone-listener-f4d9ffc8d-lwp78" Mar 16 15:50:57 crc kubenswrapper[5120]: I0316 15:50:57.013797 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e0a6dd94-0b6e-446a-924b-a39ce7582090-logs\") pod \"barbican-keystone-listener-f4d9ffc8d-lwp78\" (UID: \"e0a6dd94-0b6e-446a-924b-a39ce7582090\") " pod="openstack-kuttl-tests/barbican-keystone-listener-f4d9ffc8d-lwp78" Mar 16 15:50:57 crc kubenswrapper[5120]: I0316 15:50:57.017602 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-api-5f559c8896-5jgnd"] Mar 16 15:50:57 crc kubenswrapper[5120]: I0316 15:50:57.022984 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/cb293a62-0310-4af8-8376-0b2197bda8d2-logs\") pod \"barbican-worker-c7cf47df9-t2r2b\" (UID: \"cb293a62-0310-4af8-8376-0b2197bda8d2\") " pod="openstack-kuttl-tests/barbican-worker-c7cf47df9-t2r2b" Mar 16 15:50:57 crc kubenswrapper[5120]: I0316 15:50:57.034179 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e0a6dd94-0b6e-446a-924b-a39ce7582090-config-data\") pod \"barbican-keystone-listener-f4d9ffc8d-lwp78\" (UID: \"e0a6dd94-0b6e-446a-924b-a39ce7582090\") " pod="openstack-kuttl-tests/barbican-keystone-listener-f4d9ffc8d-lwp78" Mar 16 15:50:57 crc kubenswrapper[5120]: I0316 15:50:57.036155 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cb293a62-0310-4af8-8376-0b2197bda8d2-config-data\") pod \"barbican-worker-c7cf47df9-t2r2b\" (UID: \"cb293a62-0310-4af8-8376-0b2197bda8d2\") " pod="openstack-kuttl-tests/barbican-worker-c7cf47df9-t2r2b" Mar 16 15:50:57 crc kubenswrapper[5120]: I0316 15:50:57.047462 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/cb293a62-0310-4af8-8376-0b2197bda8d2-config-data-custom\") pod \"barbican-worker-c7cf47df9-t2r2b\" (UID: \"cb293a62-0310-4af8-8376-0b2197bda8d2\") " pod="openstack-kuttl-tests/barbican-worker-c7cf47df9-t2r2b" Mar 16 15:50:57 crc kubenswrapper[5120]: I0316 15:50:57.047879 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmttj\" (UniqueName: \"kubernetes.io/projected/cb293a62-0310-4af8-8376-0b2197bda8d2-kube-api-access-zmttj\") pod \"barbican-worker-c7cf47df9-t2r2b\" (UID: \"cb293a62-0310-4af8-8376-0b2197bda8d2\") " pod="openstack-kuttl-tests/barbican-worker-c7cf47df9-t2r2b" Mar 16 15:50:57 crc kubenswrapper[5120]: I0316 15:50:57.050615 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/e0a6dd94-0b6e-446a-924b-a39ce7582090-config-data-custom\") pod \"barbican-keystone-listener-f4d9ffc8d-lwp78\" (UID: \"e0a6dd94-0b6e-446a-924b-a39ce7582090\") " pod="openstack-kuttl-tests/barbican-keystone-listener-f4d9ffc8d-lwp78" Mar 16 15:50:57 crc kubenswrapper[5120]: I0316 15:50:57.052012 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvwlb\" (UniqueName: \"kubernetes.io/projected/e0a6dd94-0b6e-446a-924b-a39ce7582090-kube-api-access-rvwlb\") pod \"barbican-keystone-listener-f4d9ffc8d-lwp78\" (UID: \"e0a6dd94-0b6e-446a-924b-a39ce7582090\") " pod="openstack-kuttl-tests/barbican-keystone-listener-f4d9ffc8d-lwp78" Mar 16 15:50:57 crc kubenswrapper[5120]: I0316 15:50:57.057019 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-5f559c8896-5jgnd"] Mar 16 15:50:57 crc kubenswrapper[5120]: I0316 15:50:57.057145 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-5f559c8896-5jgnd" Mar 16 15:50:57 crc kubenswrapper[5120]: I0316 15:50:57.062371 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cb293a62-0310-4af8-8376-0b2197bda8d2-combined-ca-bundle\") pod \"barbican-worker-c7cf47df9-t2r2b\" (UID: \"cb293a62-0310-4af8-8376-0b2197bda8d2\") " pod="openstack-kuttl-tests/barbican-worker-c7cf47df9-t2r2b" Mar 16 15:50:57 crc kubenswrapper[5120]: I0316 15:50:57.070630 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e0a6dd94-0b6e-446a-924b-a39ce7582090-combined-ca-bundle\") pod \"barbican-keystone-listener-f4d9ffc8d-lwp78\" (UID: \"e0a6dd94-0b6e-446a-924b-a39ce7582090\") " pod="openstack-kuttl-tests/barbican-keystone-listener-f4d9ffc8d-lwp78" Mar 16 15:50:57 crc kubenswrapper[5120]: I0316 15:50:57.116730 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d442e64c-a236-4d12-8205-d5cf2cb95748-config-data\") pod \"barbican-api-5f559c8896-5jgnd\" (UID: \"d442e64c-a236-4d12-8205-d5cf2cb95748\") " pod="openstack-kuttl-tests/barbican-api-5f559c8896-5jgnd" Mar 16 15:50:57 crc kubenswrapper[5120]: I0316 15:50:57.116796 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/d442e64c-a236-4d12-8205-d5cf2cb95748-config-data-custom\") pod \"barbican-api-5f559c8896-5jgnd\" (UID: \"d442e64c-a236-4d12-8205-d5cf2cb95748\") " pod="openstack-kuttl-tests/barbican-api-5f559c8896-5jgnd" Mar 16 15:50:57 crc kubenswrapper[5120]: I0316 15:50:57.116817 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9555\" (UniqueName: \"kubernetes.io/projected/d442e64c-a236-4d12-8205-d5cf2cb95748-kube-api-access-q9555\") pod \"barbican-api-5f559c8896-5jgnd\" (UID: \"d442e64c-a236-4d12-8205-d5cf2cb95748\") " pod="openstack-kuttl-tests/barbican-api-5f559c8896-5jgnd" Mar 16 15:50:57 crc kubenswrapper[5120]: I0316 15:50:57.116861 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/d442e64c-a236-4d12-8205-d5cf2cb95748-internal-tls-certs\") pod \"barbican-api-5f559c8896-5jgnd\" (UID: \"d442e64c-a236-4d12-8205-d5cf2cb95748\") " pod="openstack-kuttl-tests/barbican-api-5f559c8896-5jgnd" Mar 16 15:50:57 crc kubenswrapper[5120]: I0316 15:50:57.116905 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d442e64c-a236-4d12-8205-d5cf2cb95748-logs\") pod \"barbican-api-5f559c8896-5jgnd\" (UID: \"d442e64c-a236-4d12-8205-d5cf2cb95748\") " pod="openstack-kuttl-tests/barbican-api-5f559c8896-5jgnd" Mar 16 15:50:57 crc kubenswrapper[5120]: I0316 15:50:57.116945 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d442e64c-a236-4d12-8205-d5cf2cb95748-combined-ca-bundle\") pod \"barbican-api-5f559c8896-5jgnd\" (UID: \"d442e64c-a236-4d12-8205-d5cf2cb95748\") " pod="openstack-kuttl-tests/barbican-api-5f559c8896-5jgnd" Mar 16 15:50:57 crc kubenswrapper[5120]: I0316 15:50:57.117022 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/d442e64c-a236-4d12-8205-d5cf2cb95748-public-tls-certs\") pod \"barbican-api-5f559c8896-5jgnd\" (UID: \"d442e64c-a236-4d12-8205-d5cf2cb95748\") " pod="openstack-kuttl-tests/barbican-api-5f559c8896-5jgnd" Mar 16 15:50:57 crc kubenswrapper[5120]: I0316 15:50:57.197449 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-f4d9ffc8d-lwp78" Mar 16 15:50:57 crc kubenswrapper[5120]: I0316 15:50:57.218312 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d442e64c-a236-4d12-8205-d5cf2cb95748-combined-ca-bundle\") pod \"barbican-api-5f559c8896-5jgnd\" (UID: \"d442e64c-a236-4d12-8205-d5cf2cb95748\") " pod="openstack-kuttl-tests/barbican-api-5f559c8896-5jgnd" Mar 16 15:50:57 crc kubenswrapper[5120]: I0316 15:50:57.218610 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/d442e64c-a236-4d12-8205-d5cf2cb95748-public-tls-certs\") pod \"barbican-api-5f559c8896-5jgnd\" (UID: \"d442e64c-a236-4d12-8205-d5cf2cb95748\") " pod="openstack-kuttl-tests/barbican-api-5f559c8896-5jgnd" Mar 16 15:50:57 crc kubenswrapper[5120]: I0316 15:50:57.218719 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d442e64c-a236-4d12-8205-d5cf2cb95748-config-data\") pod \"barbican-api-5f559c8896-5jgnd\" (UID: \"d442e64c-a236-4d12-8205-d5cf2cb95748\") " pod="openstack-kuttl-tests/barbican-api-5f559c8896-5jgnd" Mar 16 15:50:57 crc kubenswrapper[5120]: I0316 15:50:57.218737 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/d442e64c-a236-4d12-8205-d5cf2cb95748-config-data-custom\") pod \"barbican-api-5f559c8896-5jgnd\" (UID: \"d442e64c-a236-4d12-8205-d5cf2cb95748\") " pod="openstack-kuttl-tests/barbican-api-5f559c8896-5jgnd" Mar 16 15:50:57 crc kubenswrapper[5120]: I0316 15:50:57.218754 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q9555\" (UniqueName: \"kubernetes.io/projected/d442e64c-a236-4d12-8205-d5cf2cb95748-kube-api-access-q9555\") pod \"barbican-api-5f559c8896-5jgnd\" (UID: \"d442e64c-a236-4d12-8205-d5cf2cb95748\") " pod="openstack-kuttl-tests/barbican-api-5f559c8896-5jgnd" Mar 16 15:50:57 crc kubenswrapper[5120]: I0316 15:50:57.218819 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/d442e64c-a236-4d12-8205-d5cf2cb95748-internal-tls-certs\") pod \"barbican-api-5f559c8896-5jgnd\" (UID: \"d442e64c-a236-4d12-8205-d5cf2cb95748\") " pod="openstack-kuttl-tests/barbican-api-5f559c8896-5jgnd" Mar 16 15:50:57 crc kubenswrapper[5120]: I0316 15:50:57.218855 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d442e64c-a236-4d12-8205-d5cf2cb95748-logs\") pod \"barbican-api-5f559c8896-5jgnd\" (UID: \"d442e64c-a236-4d12-8205-d5cf2cb95748\") " pod="openstack-kuttl-tests/barbican-api-5f559c8896-5jgnd" Mar 16 15:50:57 crc kubenswrapper[5120]: I0316 15:50:57.219665 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d442e64c-a236-4d12-8205-d5cf2cb95748-logs\") pod \"barbican-api-5f559c8896-5jgnd\" (UID: \"d442e64c-a236-4d12-8205-d5cf2cb95748\") " pod="openstack-kuttl-tests/barbican-api-5f559c8896-5jgnd" Mar 16 15:50:57 crc kubenswrapper[5120]: I0316 15:50:57.224393 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-c7cf47df9-t2r2b" Mar 16 15:50:57 crc kubenswrapper[5120]: I0316 15:50:57.230448 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:50:57 crc kubenswrapper[5120]: I0316 15:50:57.230729 5120 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Mar 16 15:50:57 crc kubenswrapper[5120]: I0316 15:50:57.239315 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:50:57 crc kubenswrapper[5120]: I0316 15:50:57.246144 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/d442e64c-a236-4d12-8205-d5cf2cb95748-config-data-custom\") pod \"barbican-api-5f559c8896-5jgnd\" (UID: \"d442e64c-a236-4d12-8205-d5cf2cb95748\") " pod="openstack-kuttl-tests/barbican-api-5f559c8896-5jgnd" Mar 16 15:50:57 crc kubenswrapper[5120]: I0316 15:50:57.246863 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d442e64c-a236-4d12-8205-d5cf2cb95748-config-data\") pod \"barbican-api-5f559c8896-5jgnd\" (UID: \"d442e64c-a236-4d12-8205-d5cf2cb95748\") " pod="openstack-kuttl-tests/barbican-api-5f559c8896-5jgnd" Mar 16 15:50:57 crc kubenswrapper[5120]: I0316 15:50:57.247278 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/d442e64c-a236-4d12-8205-d5cf2cb95748-public-tls-certs\") pod \"barbican-api-5f559c8896-5jgnd\" (UID: \"d442e64c-a236-4d12-8205-d5cf2cb95748\") " pod="openstack-kuttl-tests/barbican-api-5f559c8896-5jgnd" Mar 16 15:50:57 crc kubenswrapper[5120]: I0316 15:50:57.254371 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d442e64c-a236-4d12-8205-d5cf2cb95748-combined-ca-bundle\") pod \"barbican-api-5f559c8896-5jgnd\" (UID: \"d442e64c-a236-4d12-8205-d5cf2cb95748\") " pod="openstack-kuttl-tests/barbican-api-5f559c8896-5jgnd" Mar 16 15:50:57 crc kubenswrapper[5120]: I0316 15:50:57.265348 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/d442e64c-a236-4d12-8205-d5cf2cb95748-internal-tls-certs\") pod \"barbican-api-5f559c8896-5jgnd\" (UID: \"d442e64c-a236-4d12-8205-d5cf2cb95748\") " pod="openstack-kuttl-tests/barbican-api-5f559c8896-5jgnd" Mar 16 15:50:57 crc kubenswrapper[5120]: I0316 15:50:57.266396 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9555\" (UniqueName: \"kubernetes.io/projected/d442e64c-a236-4d12-8205-d5cf2cb95748-kube-api-access-q9555\") pod \"barbican-api-5f559c8896-5jgnd\" (UID: \"d442e64c-a236-4d12-8205-d5cf2cb95748\") " pod="openstack-kuttl-tests/barbican-api-5f559c8896-5jgnd" Mar 16 15:50:57 crc kubenswrapper[5120]: I0316 15:50:57.525782 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-5f559c8896-5jgnd" Mar 16 15:50:57 crc kubenswrapper[5120]: I0316 15:50:57.670336 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"170a65d6-484e-4797-8619-b913987e8313","Type":"ContainerStarted","Data":"3c116102bcc94f2680b8dc04f457c44d7b7dee05fa921988eb8c831cf3b873af"} Mar 16 15:50:57 crc kubenswrapper[5120]: I0316 15:50:57.675778 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"8df7575c-428a-4f47-8bd5-de8d39829afb","Type":"ContainerStarted","Data":"ccadf36e46253254780761bcc28680465c3c8ee86e45cfabda1efbf5efe07689"} Mar 16 15:50:57 crc kubenswrapper[5120]: I0316 15:50:57.677649 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-698fb447c8-kz5xv" event={"ID":"6d402989-2c1d-4b01-a058-ffd1bd6767f4","Type":"ContainerStarted","Data":"5288c2bf1a6c1603d57cd8d0bfc4238671dc4383bc3651665cf2a2b3b0f2d5ab"} Mar 16 15:50:57 crc kubenswrapper[5120]: I0316 15:50:57.712774 5120 generic.go:358] "Generic (PLEG): container finished" podID="fb486d50-9a5f-40e2-842a-d942a88eb350" containerID="daefa4a7acfb48f0a196312071337a06466868dcc2eea5e8d08436b7a01419bb" exitCode=0 Mar 16 15:50:57 crc kubenswrapper[5120]: I0316 15:50:57.712803 5120 generic.go:358] "Generic (PLEG): container finished" podID="fb486d50-9a5f-40e2-842a-d942a88eb350" containerID="cc1de401132c538230618727bb825fe8bbb5a3d2d2aec30b67f541368b5a648c" exitCode=143 Mar 16 15:50:57 crc kubenswrapper[5120]: I0316 15:50:57.713773 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-f5746c74d-vbhjh" event={"ID":"fb486d50-9a5f-40e2-842a-d942a88eb350","Type":"ContainerDied","Data":"daefa4a7acfb48f0a196312071337a06466868dcc2eea5e8d08436b7a01419bb"} Mar 16 15:50:57 crc kubenswrapper[5120]: I0316 15:50:57.713799 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-f5746c74d-vbhjh" event={"ID":"fb486d50-9a5f-40e2-842a-d942a88eb350","Type":"ContainerDied","Data":"cc1de401132c538230618727bb825fe8bbb5a3d2d2aec30b67f541368b5a648c"} Mar 16 15:50:57 crc kubenswrapper[5120]: I0316 15:50:57.714703 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-keystone-listener-698fb447c8-kz5xv" podStartSLOduration=8.284608278 podStartE2EDuration="10.714669795s" podCreationTimestamp="2026-03-16 15:50:47 +0000 UTC" firstStartedPulling="2026-03-16 15:50:53.754947736 +0000 UTC m=+1155.908879393" lastFinishedPulling="2026-03-16 15:50:56.185009263 +0000 UTC m=+1158.338940910" observedRunningTime="2026-03-16 15:50:57.699233147 +0000 UTC m=+1159.853164804" watchObservedRunningTime="2026-03-16 15:50:57.714669795 +0000 UTC m=+1159.868601452" Mar 16 15:50:57 crc kubenswrapper[5120]: I0316 15:50:57.783810 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-c7cf47df9-t2r2b"] Mar 16 15:50:57 crc kubenswrapper[5120]: I0316 15:50:57.918119 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-f4d9ffc8d-lwp78"] Mar 16 15:50:57 crc kubenswrapper[5120]: W0316 15:50:57.929852 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode0a6dd94_0b6e_446a_924b_a39ce7582090.slice/crio-9dda4eaf253cd7a8b8d7355293a0fe29dc51661d44531318ea90443f5dcee802 WatchSource:0}: Error finding container 9dda4eaf253cd7a8b8d7355293a0fe29dc51661d44531318ea90443f5dcee802: Status 404 returned error can't find the container with id 9dda4eaf253cd7a8b8d7355293a0fe29dc51661d44531318ea90443f5dcee802 Mar 16 15:50:58 crc kubenswrapper[5120]: I0316 15:50:58.111075 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-f5746c74d-vbhjh" Mar 16 15:50:58 crc kubenswrapper[5120]: I0316 15:50:58.230319 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-5f559c8896-5jgnd"] Mar 16 15:50:58 crc kubenswrapper[5120]: I0316 15:50:58.253852 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-spkhj\" (UniqueName: \"kubernetes.io/projected/fb486d50-9a5f-40e2-842a-d942a88eb350-kube-api-access-spkhj\") pod \"fb486d50-9a5f-40e2-842a-d942a88eb350\" (UID: \"fb486d50-9a5f-40e2-842a-d942a88eb350\") " Mar 16 15:50:58 crc kubenswrapper[5120]: I0316 15:50:58.253907 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fb486d50-9a5f-40e2-842a-d942a88eb350-config-data\") pod \"fb486d50-9a5f-40e2-842a-d942a88eb350\" (UID: \"fb486d50-9a5f-40e2-842a-d942a88eb350\") " Mar 16 15:50:58 crc kubenswrapper[5120]: I0316 15:50:58.254691 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/fb486d50-9a5f-40e2-842a-d942a88eb350-logs\") pod \"fb486d50-9a5f-40e2-842a-d942a88eb350\" (UID: \"fb486d50-9a5f-40e2-842a-d942a88eb350\") " Mar 16 15:50:58 crc kubenswrapper[5120]: I0316 15:50:58.255301 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fb486d50-9a5f-40e2-842a-d942a88eb350-combined-ca-bundle\") pod \"fb486d50-9a5f-40e2-842a-d942a88eb350\" (UID: \"fb486d50-9a5f-40e2-842a-d942a88eb350\") " Mar 16 15:50:58 crc kubenswrapper[5120]: I0316 15:50:58.255427 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/fb486d50-9a5f-40e2-842a-d942a88eb350-config-data-custom\") pod \"fb486d50-9a5f-40e2-842a-d942a88eb350\" (UID: \"fb486d50-9a5f-40e2-842a-d942a88eb350\") " Mar 16 15:50:58 crc kubenswrapper[5120]: I0316 15:50:58.257624 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb486d50-9a5f-40e2-842a-d942a88eb350-logs" (OuterVolumeSpecName: "logs") pod "fb486d50-9a5f-40e2-842a-d942a88eb350" (UID: "fb486d50-9a5f-40e2-842a-d942a88eb350"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:50:58 crc kubenswrapper[5120]: I0316 15:50:58.267944 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb486d50-9a5f-40e2-842a-d942a88eb350-kube-api-access-spkhj" (OuterVolumeSpecName: "kube-api-access-spkhj") pod "fb486d50-9a5f-40e2-842a-d942a88eb350" (UID: "fb486d50-9a5f-40e2-842a-d942a88eb350"). InnerVolumeSpecName "kube-api-access-spkhj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:50:58 crc kubenswrapper[5120]: I0316 15:50:58.269375 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb486d50-9a5f-40e2-842a-d942a88eb350-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "fb486d50-9a5f-40e2-842a-d942a88eb350" (UID: "fb486d50-9a5f-40e2-842a-d942a88eb350"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:50:58 crc kubenswrapper[5120]: I0316 15:50:58.293424 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb486d50-9a5f-40e2-842a-d942a88eb350-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "fb486d50-9a5f-40e2-842a-d942a88eb350" (UID: "fb486d50-9a5f-40e2-842a-d942a88eb350"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:50:58 crc kubenswrapper[5120]: I0316 15:50:58.320959 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb486d50-9a5f-40e2-842a-d942a88eb350-config-data" (OuterVolumeSpecName: "config-data") pod "fb486d50-9a5f-40e2-842a-d942a88eb350" (UID: "fb486d50-9a5f-40e2-842a-d942a88eb350"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:50:58 crc kubenswrapper[5120]: I0316 15:50:58.357989 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-spkhj\" (UniqueName: \"kubernetes.io/projected/fb486d50-9a5f-40e2-842a-d942a88eb350-kube-api-access-spkhj\") on node \"crc\" DevicePath \"\"" Mar 16 15:50:58 crc kubenswrapper[5120]: I0316 15:50:58.358019 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fb486d50-9a5f-40e2-842a-d942a88eb350-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 15:50:58 crc kubenswrapper[5120]: I0316 15:50:58.358031 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/fb486d50-9a5f-40e2-842a-d942a88eb350-logs\") on node \"crc\" DevicePath \"\"" Mar 16 15:50:58 crc kubenswrapper[5120]: I0316 15:50:58.358039 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fb486d50-9a5f-40e2-842a-d942a88eb350-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:50:58 crc kubenswrapper[5120]: I0316 15:50:58.358049 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/fb486d50-9a5f-40e2-842a-d942a88eb350-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 15:50:58 crc kubenswrapper[5120]: I0316 15:50:58.744285 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-5f559c8896-5jgnd" event={"ID":"d442e64c-a236-4d12-8205-d5cf2cb95748","Type":"ContainerStarted","Data":"7173ba4274579607f73bd4022925294671ad0ce2e608f3f2ca430323887062b7"} Mar 16 15:50:58 crc kubenswrapper[5120]: I0316 15:50:58.744617 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-5f559c8896-5jgnd" event={"ID":"d442e64c-a236-4d12-8205-d5cf2cb95748","Type":"ContainerStarted","Data":"7e372a0469bc19a39329cd83e670b9d6f87fab7ad65c731f711a594fe4696311"} Mar 16 15:50:58 crc kubenswrapper[5120]: I0316 15:50:58.747984 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-c7cf47df9-t2r2b" event={"ID":"cb293a62-0310-4af8-8376-0b2197bda8d2","Type":"ContainerStarted","Data":"bf02f4cbf7ce963664b2216d2bb7afe00bfa9ca2fcfe0b5d52f4cbc656f2fe71"} Mar 16 15:50:58 crc kubenswrapper[5120]: I0316 15:50:58.748022 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-c7cf47df9-t2r2b" event={"ID":"cb293a62-0310-4af8-8376-0b2197bda8d2","Type":"ContainerStarted","Data":"2e51728a4a2b7ffe6f2728b86885001e82ac31d9b246434b98744b26f8ac045c"} Mar 16 15:50:58 crc kubenswrapper[5120]: I0316 15:50:58.757322 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-f4d9ffc8d-lwp78" event={"ID":"e0a6dd94-0b6e-446a-924b-a39ce7582090","Type":"ContainerStarted","Data":"bfc23559de2564738a88f0aeabdcc2bd4aadac83b546cb7e03c03224bc801908"} Mar 16 15:50:58 crc kubenswrapper[5120]: I0316 15:50:58.757349 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-f4d9ffc8d-lwp78" event={"ID":"e0a6dd94-0b6e-446a-924b-a39ce7582090","Type":"ContainerStarted","Data":"9dda4eaf253cd7a8b8d7355293a0fe29dc51661d44531318ea90443f5dcee802"} Mar 16 15:50:58 crc kubenswrapper[5120]: I0316 15:50:58.779152 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"8df7575c-428a-4f47-8bd5-de8d39829afb","Type":"ContainerStarted","Data":"b73b8e895c33f06b2ac0b85c8ecc9a0fa6af47233dcae10149f962311224a9c6"} Mar 16 15:50:58 crc kubenswrapper[5120]: I0316 15:50:58.782054 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-f5746c74d-vbhjh" Mar 16 15:50:58 crc kubenswrapper[5120]: I0316 15:50:58.784110 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-f5746c74d-vbhjh" event={"ID":"fb486d50-9a5f-40e2-842a-d942a88eb350","Type":"ContainerDied","Data":"d4548f85dbe7f8f4946353378e26da0961a2879207998e2689cbeef4bdeeaeb5"} Mar 16 15:50:58 crc kubenswrapper[5120]: I0316 15:50:58.784160 5120 scope.go:117] "RemoveContainer" containerID="daefa4a7acfb48f0a196312071337a06466868dcc2eea5e8d08436b7a01419bb" Mar 16 15:50:58 crc kubenswrapper[5120]: I0316 15:50:58.899421 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-f5746c74d-vbhjh"] Mar 16 15:50:58 crc kubenswrapper[5120]: I0316 15:50:58.921003 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-api-f5746c74d-vbhjh"] Mar 16 15:50:59 crc kubenswrapper[5120]: I0316 15:50:59.084636 5120 scope.go:117] "RemoveContainer" containerID="cc1de401132c538230618727bb825fe8bbb5a3d2d2aec30b67f541368b5a648c" Mar 16 15:50:59 crc kubenswrapper[5120]: I0316 15:50:59.167498 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 15:50:59 crc kubenswrapper[5120]: I0316 15:50:59.803208 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"170a65d6-484e-4797-8619-b913987e8313","Type":"ContainerStarted","Data":"84345639a1bc424d92722dabb7dc56f33c705462a655a9d14aadf5effc9aa6b0"} Mar 16 15:50:59 crc kubenswrapper[5120]: I0316 15:50:59.816058 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"8df7575c-428a-4f47-8bd5-de8d39829afb","Type":"ContainerStarted","Data":"04dca683516eb67c26daedeb081fde94a49b2417c94a1d2b3101cb0a9c46a44b"} Mar 16 15:50:59 crc kubenswrapper[5120]: I0316 15:50:59.816453 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:50:59 crc kubenswrapper[5120]: I0316 15:50:59.816535 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="8df7575c-428a-4f47-8bd5-de8d39829afb" containerName="cinder-api" containerID="cri-o://04dca683516eb67c26daedeb081fde94a49b2417c94a1d2b3101cb0a9c46a44b" gracePeriod=30 Mar 16 15:50:59 crc kubenswrapper[5120]: I0316 15:50:59.816078 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="8df7575c-428a-4f47-8bd5-de8d39829afb" containerName="cinder-api-log" containerID="cri-o://b73b8e895c33f06b2ac0b85c8ecc9a0fa6af47233dcae10149f962311224a9c6" gracePeriod=30 Mar 16 15:50:59 crc kubenswrapper[5120]: I0316 15:50:59.839394 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-5f559c8896-5jgnd" event={"ID":"d442e64c-a236-4d12-8205-d5cf2cb95748","Type":"ContainerStarted","Data":"0470cfd37685bd89173ba27c32f8e3e3b084af837af4d8097ba45194c409f65b"} Mar 16 15:50:59 crc kubenswrapper[5120]: I0316 15:50:59.841596 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-5f559c8896-5jgnd" Mar 16 15:50:59 crc kubenswrapper[5120]: I0316 15:50:59.841632 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-5f559c8896-5jgnd" Mar 16 15:50:59 crc kubenswrapper[5120]: I0316 15:50:59.842323 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-api-0" podStartSLOduration=4.842301371 podStartE2EDuration="4.842301371s" podCreationTimestamp="2026-03-16 15:50:55 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:50:59.833874295 +0000 UTC m=+1161.987805952" watchObservedRunningTime="2026-03-16 15:50:59.842301371 +0000 UTC m=+1161.996233028" Mar 16 15:50:59 crc kubenswrapper[5120]: I0316 15:50:59.850243 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-c7cf47df9-t2r2b" event={"ID":"cb293a62-0310-4af8-8376-0b2197bda8d2","Type":"ContainerStarted","Data":"354e037f289bc79961fa099797e6d89c6df4e1e5901656cb22c5c95fe04df07b"} Mar 16 15:50:59 crc kubenswrapper[5120]: I0316 15:50:59.865530 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-f4d9ffc8d-lwp78" event={"ID":"e0a6dd94-0b6e-446a-924b-a39ce7582090","Type":"ContainerStarted","Data":"d98841f9e46e61836bc62ce9a26e9ee5daf9f80796e5c5c33aaeb58a64ec8ebb"} Mar 16 15:50:59 crc kubenswrapper[5120]: I0316 15:50:59.871479 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-api-5f559c8896-5jgnd" podStartSLOduration=3.871459758 podStartE2EDuration="3.871459758s" podCreationTimestamp="2026-03-16 15:50:56 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:50:59.861021045 +0000 UTC m=+1162.014952712" watchObservedRunningTime="2026-03-16 15:50:59.871459758 +0000 UTC m=+1162.025391415" Mar 16 15:50:59 crc kubenswrapper[5120]: I0316 15:50:59.897023 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-worker-c7cf47df9-t2r2b" podStartSLOduration=3.8969986800000003 podStartE2EDuration="3.89699868s" podCreationTimestamp="2026-03-16 15:50:56 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:50:59.889011545 +0000 UTC m=+1162.042943222" watchObservedRunningTime="2026-03-16 15:50:59.89699868 +0000 UTC m=+1162.050930347" Mar 16 15:50:59 crc kubenswrapper[5120]: I0316 15:50:59.931325 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-895d6468c-b4n82"] Mar 16 15:50:59 crc kubenswrapper[5120]: I0316 15:50:59.931564 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-895d6468c-b4n82" podUID="ae0bb770-ecc1-4c2e-ab55-438b27b60d5c" containerName="barbican-worker-log" containerID="cri-o://1d2d2134fdda0c5e0372299b027d1622da0a3a3ae78ccd4636f7f944c923063f" gracePeriod=30 Mar 16 15:50:59 crc kubenswrapper[5120]: I0316 15:50:59.931972 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-895d6468c-b4n82" podUID="ae0bb770-ecc1-4c2e-ab55-438b27b60d5c" containerName="barbican-worker" containerID="cri-o://44d53f4a0578ab4484d9ed2fed30ca03085fd85122e1e63e31abaea9ebeb9bbe" gracePeriod=30 Mar 16 15:50:59 crc kubenswrapper[5120]: I0316 15:50:59.946476 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-keystone-listener-f4d9ffc8d-lwp78" podStartSLOduration=3.946454658 podStartE2EDuration="3.946454658s" podCreationTimestamp="2026-03-16 15:50:56 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:50:59.920599659 +0000 UTC m=+1162.074531336" watchObservedRunningTime="2026-03-16 15:50:59.946454658 +0000 UTC m=+1162.100386315" Mar 16 15:50:59 crc kubenswrapper[5120]: I0316 15:50:59.969155 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-698fb447c8-kz5xv"] Mar 16 15:50:59 crc kubenswrapper[5120]: I0316 15:50:59.973787 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-698fb447c8-kz5xv" podUID="6d402989-2c1d-4b01-a058-ffd1bd6767f4" containerName="barbican-keystone-listener-log" containerID="cri-o://eb55125e5ba83542eeb562e76bcfc122823207f4d50994930918dd5526c3b0bd" gracePeriod=30 Mar 16 15:50:59 crc kubenswrapper[5120]: I0316 15:50:59.974190 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-698fb447c8-kz5xv" podUID="6d402989-2c1d-4b01-a058-ffd1bd6767f4" containerName="barbican-keystone-listener" containerID="cri-o://5288c2bf1a6c1603d57cd8d0bfc4238671dc4383bc3651665cf2a2b3b0f2d5ab" gracePeriod=30 Mar 16 15:51:00 crc kubenswrapper[5120]: I0316 15:51:00.677510 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fb486d50-9a5f-40e2-842a-d942a88eb350" path="/var/lib/kubelet/pods/fb486d50-9a5f-40e2-842a-d942a88eb350/volumes" Mar 16 15:51:00 crc kubenswrapper[5120]: I0316 15:51:00.886790 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-698fb447c8-kz5xv" event={"ID":"6d402989-2c1d-4b01-a058-ffd1bd6767f4","Type":"ContainerDied","Data":"eb55125e5ba83542eeb562e76bcfc122823207f4d50994930918dd5526c3b0bd"} Mar 16 15:51:00 crc kubenswrapper[5120]: I0316 15:51:00.886750 5120 generic.go:358] "Generic (PLEG): container finished" podID="6d402989-2c1d-4b01-a058-ffd1bd6767f4" containerID="eb55125e5ba83542eeb562e76bcfc122823207f4d50994930918dd5526c3b0bd" exitCode=143 Mar 16 15:51:00 crc kubenswrapper[5120]: I0316 15:51:00.890523 5120 generic.go:358] "Generic (PLEG): container finished" podID="ae0bb770-ecc1-4c2e-ab55-438b27b60d5c" containerID="1d2d2134fdda0c5e0372299b027d1622da0a3a3ae78ccd4636f7f944c923063f" exitCode=143 Mar 16 15:51:00 crc kubenswrapper[5120]: I0316 15:51:00.890605 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-895d6468c-b4n82" event={"ID":"ae0bb770-ecc1-4c2e-ab55-438b27b60d5c","Type":"ContainerDied","Data":"1d2d2134fdda0c5e0372299b027d1622da0a3a3ae78ccd4636f7f944c923063f"} Mar 16 15:51:00 crc kubenswrapper[5120]: I0316 15:51:00.893591 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"170a65d6-484e-4797-8619-b913987e8313","Type":"ContainerStarted","Data":"c62ec55997b9dda26048360641dbb05aa6c36c603e96ead4051d147a8f2d3715"} Mar 16 15:51:00 crc kubenswrapper[5120]: I0316 15:51:00.895852 5120 generic.go:358] "Generic (PLEG): container finished" podID="8df7575c-428a-4f47-8bd5-de8d39829afb" containerID="b73b8e895c33f06b2ac0b85c8ecc9a0fa6af47233dcae10149f962311224a9c6" exitCode=143 Mar 16 15:51:00 crc kubenswrapper[5120]: I0316 15:51:00.895992 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"8df7575c-428a-4f47-8bd5-de8d39829afb","Type":"ContainerDied","Data":"b73b8e895c33f06b2ac0b85c8ecc9a0fa6af47233dcae10149f962311224a9c6"} Mar 16 15:51:00 crc kubenswrapper[5120]: I0316 15:51:00.920990 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-scheduler-0" podStartSLOduration=4.066312276 podStartE2EDuration="5.920971393s" podCreationTimestamp="2026-03-16 15:50:55 +0000 UTC" firstStartedPulling="2026-03-16 15:50:56.722208945 +0000 UTC m=+1158.876140602" lastFinishedPulling="2026-03-16 15:50:58.576868062 +0000 UTC m=+1160.730799719" observedRunningTime="2026-03-16 15:51:00.916254034 +0000 UTC m=+1163.070185691" watchObservedRunningTime="2026-03-16 15:51:00.920971393 +0000 UTC m=+1163.074903050" Mar 16 15:51:01 crc kubenswrapper[5120]: I0316 15:51:01.560961 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-698fb447c8-kz5xv" Mar 16 15:51:01 crc kubenswrapper[5120]: I0316 15:51:01.566973 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-895d6468c-b4n82" Mar 16 15:51:01 crc kubenswrapper[5120]: I0316 15:51:01.737223 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6d402989-2c1d-4b01-a058-ffd1bd6767f4-combined-ca-bundle\") pod \"6d402989-2c1d-4b01-a058-ffd1bd6767f4\" (UID: \"6d402989-2c1d-4b01-a058-ffd1bd6767f4\") " Mar 16 15:51:01 crc kubenswrapper[5120]: I0316 15:51:01.737580 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/ae0bb770-ecc1-4c2e-ab55-438b27b60d5c-config-data-custom\") pod \"ae0bb770-ecc1-4c2e-ab55-438b27b60d5c\" (UID: \"ae0bb770-ecc1-4c2e-ab55-438b27b60d5c\") " Mar 16 15:51:01 crc kubenswrapper[5120]: I0316 15:51:01.737718 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ae0bb770-ecc1-4c2e-ab55-438b27b60d5c-logs\") pod \"ae0bb770-ecc1-4c2e-ab55-438b27b60d5c\" (UID: \"ae0bb770-ecc1-4c2e-ab55-438b27b60d5c\") " Mar 16 15:51:01 crc kubenswrapper[5120]: I0316 15:51:01.737940 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/6d402989-2c1d-4b01-a058-ffd1bd6767f4-config-data-custom\") pod \"6d402989-2c1d-4b01-a058-ffd1bd6767f4\" (UID: \"6d402989-2c1d-4b01-a058-ffd1bd6767f4\") " Mar 16 15:51:01 crc kubenswrapper[5120]: I0316 15:51:01.738055 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6d402989-2c1d-4b01-a058-ffd1bd6767f4-logs\") pod \"6d402989-2c1d-4b01-a058-ffd1bd6767f4\" (UID: \"6d402989-2c1d-4b01-a058-ffd1bd6767f4\") " Mar 16 15:51:01 crc kubenswrapper[5120]: I0316 15:51:01.738136 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x47m8\" (UniqueName: \"kubernetes.io/projected/6d402989-2c1d-4b01-a058-ffd1bd6767f4-kube-api-access-x47m8\") pod \"6d402989-2c1d-4b01-a058-ffd1bd6767f4\" (UID: \"6d402989-2c1d-4b01-a058-ffd1bd6767f4\") " Mar 16 15:51:01 crc kubenswrapper[5120]: I0316 15:51:01.738225 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jv429\" (UniqueName: \"kubernetes.io/projected/ae0bb770-ecc1-4c2e-ab55-438b27b60d5c-kube-api-access-jv429\") pod \"ae0bb770-ecc1-4c2e-ab55-438b27b60d5c\" (UID: \"ae0bb770-ecc1-4c2e-ab55-438b27b60d5c\") " Mar 16 15:51:01 crc kubenswrapper[5120]: I0316 15:51:01.738305 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ae0bb770-ecc1-4c2e-ab55-438b27b60d5c-config-data\") pod \"ae0bb770-ecc1-4c2e-ab55-438b27b60d5c\" (UID: \"ae0bb770-ecc1-4c2e-ab55-438b27b60d5c\") " Mar 16 15:51:01 crc kubenswrapper[5120]: I0316 15:51:01.738410 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6d402989-2c1d-4b01-a058-ffd1bd6767f4-config-data\") pod \"6d402989-2c1d-4b01-a058-ffd1bd6767f4\" (UID: \"6d402989-2c1d-4b01-a058-ffd1bd6767f4\") " Mar 16 15:51:01 crc kubenswrapper[5120]: I0316 15:51:01.738576 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ae0bb770-ecc1-4c2e-ab55-438b27b60d5c-combined-ca-bundle\") pod \"ae0bb770-ecc1-4c2e-ab55-438b27b60d5c\" (UID: \"ae0bb770-ecc1-4c2e-ab55-438b27b60d5c\") " Mar 16 15:51:01 crc kubenswrapper[5120]: I0316 15:51:01.740180 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d402989-2c1d-4b01-a058-ffd1bd6767f4-logs" (OuterVolumeSpecName: "logs") pod "6d402989-2c1d-4b01-a058-ffd1bd6767f4" (UID: "6d402989-2c1d-4b01-a058-ffd1bd6767f4"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:51:01 crc kubenswrapper[5120]: I0316 15:51:01.740630 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae0bb770-ecc1-4c2e-ab55-438b27b60d5c-logs" (OuterVolumeSpecName: "logs") pod "ae0bb770-ecc1-4c2e-ab55-438b27b60d5c" (UID: "ae0bb770-ecc1-4c2e-ab55-438b27b60d5c"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:51:01 crc kubenswrapper[5120]: I0316 15:51:01.745252 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d402989-2c1d-4b01-a058-ffd1bd6767f4-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "6d402989-2c1d-4b01-a058-ffd1bd6767f4" (UID: "6d402989-2c1d-4b01-a058-ffd1bd6767f4"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:51:01 crc kubenswrapper[5120]: I0316 15:51:01.745912 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae0bb770-ecc1-4c2e-ab55-438b27b60d5c-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "ae0bb770-ecc1-4c2e-ab55-438b27b60d5c" (UID: "ae0bb770-ecc1-4c2e-ab55-438b27b60d5c"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:51:01 crc kubenswrapper[5120]: I0316 15:51:01.746947 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d402989-2c1d-4b01-a058-ffd1bd6767f4-kube-api-access-x47m8" (OuterVolumeSpecName: "kube-api-access-x47m8") pod "6d402989-2c1d-4b01-a058-ffd1bd6767f4" (UID: "6d402989-2c1d-4b01-a058-ffd1bd6767f4"). InnerVolumeSpecName "kube-api-access-x47m8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:51:01 crc kubenswrapper[5120]: I0316 15:51:01.750922 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae0bb770-ecc1-4c2e-ab55-438b27b60d5c-kube-api-access-jv429" (OuterVolumeSpecName: "kube-api-access-jv429") pod "ae0bb770-ecc1-4c2e-ab55-438b27b60d5c" (UID: "ae0bb770-ecc1-4c2e-ab55-438b27b60d5c"). InnerVolumeSpecName "kube-api-access-jv429". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:51:01 crc kubenswrapper[5120]: I0316 15:51:01.764439 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae0bb770-ecc1-4c2e-ab55-438b27b60d5c-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ae0bb770-ecc1-4c2e-ab55-438b27b60d5c" (UID: "ae0bb770-ecc1-4c2e-ab55-438b27b60d5c"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:51:01 crc kubenswrapper[5120]: I0316 15:51:01.765675 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d402989-2c1d-4b01-a058-ffd1bd6767f4-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "6d402989-2c1d-4b01-a058-ffd1bd6767f4" (UID: "6d402989-2c1d-4b01-a058-ffd1bd6767f4"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:51:01 crc kubenswrapper[5120]: I0316 15:51:01.788673 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae0bb770-ecc1-4c2e-ab55-438b27b60d5c-config-data" (OuterVolumeSpecName: "config-data") pod "ae0bb770-ecc1-4c2e-ab55-438b27b60d5c" (UID: "ae0bb770-ecc1-4c2e-ab55-438b27b60d5c"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:51:01 crc kubenswrapper[5120]: I0316 15:51:01.793694 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d402989-2c1d-4b01-a058-ffd1bd6767f4-config-data" (OuterVolumeSpecName: "config-data") pod "6d402989-2c1d-4b01-a058-ffd1bd6767f4" (UID: "6d402989-2c1d-4b01-a058-ffd1bd6767f4"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:51:01 crc kubenswrapper[5120]: I0316 15:51:01.842548 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ae0bb770-ecc1-4c2e-ab55-438b27b60d5c-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:51:01 crc kubenswrapper[5120]: I0316 15:51:01.842581 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6d402989-2c1d-4b01-a058-ffd1bd6767f4-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:51:01 crc kubenswrapper[5120]: I0316 15:51:01.842593 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/ae0bb770-ecc1-4c2e-ab55-438b27b60d5c-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 15:51:01 crc kubenswrapper[5120]: I0316 15:51:01.842602 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ae0bb770-ecc1-4c2e-ab55-438b27b60d5c-logs\") on node \"crc\" DevicePath \"\"" Mar 16 15:51:01 crc kubenswrapper[5120]: I0316 15:51:01.842610 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/6d402989-2c1d-4b01-a058-ffd1bd6767f4-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 15:51:01 crc kubenswrapper[5120]: I0316 15:51:01.842619 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6d402989-2c1d-4b01-a058-ffd1bd6767f4-logs\") on node \"crc\" DevicePath \"\"" Mar 16 15:51:01 crc kubenswrapper[5120]: I0316 15:51:01.842626 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x47m8\" (UniqueName: \"kubernetes.io/projected/6d402989-2c1d-4b01-a058-ffd1bd6767f4-kube-api-access-x47m8\") on node \"crc\" DevicePath \"\"" Mar 16 15:51:01 crc kubenswrapper[5120]: I0316 15:51:01.842636 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jv429\" (UniqueName: \"kubernetes.io/projected/ae0bb770-ecc1-4c2e-ab55-438b27b60d5c-kube-api-access-jv429\") on node \"crc\" DevicePath \"\"" Mar 16 15:51:01 crc kubenswrapper[5120]: I0316 15:51:01.842643 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ae0bb770-ecc1-4c2e-ab55-438b27b60d5c-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 15:51:01 crc kubenswrapper[5120]: I0316 15:51:01.842651 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6d402989-2c1d-4b01-a058-ffd1bd6767f4-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 15:51:01 crc kubenswrapper[5120]: I0316 15:51:01.915742 5120 generic.go:358] "Generic (PLEG): container finished" podID="ae0bb770-ecc1-4c2e-ab55-438b27b60d5c" containerID="44d53f4a0578ab4484d9ed2fed30ca03085fd85122e1e63e31abaea9ebeb9bbe" exitCode=0 Mar 16 15:51:01 crc kubenswrapper[5120]: I0316 15:51:01.916229 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-895d6468c-b4n82" Mar 16 15:51:01 crc kubenswrapper[5120]: I0316 15:51:01.916918 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-895d6468c-b4n82" event={"ID":"ae0bb770-ecc1-4c2e-ab55-438b27b60d5c","Type":"ContainerDied","Data":"44d53f4a0578ab4484d9ed2fed30ca03085fd85122e1e63e31abaea9ebeb9bbe"} Mar 16 15:51:01 crc kubenswrapper[5120]: I0316 15:51:01.916949 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-895d6468c-b4n82" event={"ID":"ae0bb770-ecc1-4c2e-ab55-438b27b60d5c","Type":"ContainerDied","Data":"21713cd1bf49d0ac4d34954608d654d218d8090c2011e12801ba72cb9a2877ca"} Mar 16 15:51:01 crc kubenswrapper[5120]: I0316 15:51:01.916964 5120 scope.go:117] "RemoveContainer" containerID="44d53f4a0578ab4484d9ed2fed30ca03085fd85122e1e63e31abaea9ebeb9bbe" Mar 16 15:51:01 crc kubenswrapper[5120]: I0316 15:51:01.919268 5120 generic.go:358] "Generic (PLEG): container finished" podID="6d402989-2c1d-4b01-a058-ffd1bd6767f4" containerID="5288c2bf1a6c1603d57cd8d0bfc4238671dc4383bc3651665cf2a2b3b0f2d5ab" exitCode=0 Mar 16 15:51:01 crc kubenswrapper[5120]: I0316 15:51:01.920016 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-698fb447c8-kz5xv" Mar 16 15:51:01 crc kubenswrapper[5120]: I0316 15:51:01.922934 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-698fb447c8-kz5xv" event={"ID":"6d402989-2c1d-4b01-a058-ffd1bd6767f4","Type":"ContainerDied","Data":"5288c2bf1a6c1603d57cd8d0bfc4238671dc4383bc3651665cf2a2b3b0f2d5ab"} Mar 16 15:51:01 crc kubenswrapper[5120]: I0316 15:51:01.922975 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-698fb447c8-kz5xv" event={"ID":"6d402989-2c1d-4b01-a058-ffd1bd6767f4","Type":"ContainerDied","Data":"b85fa4a68c26908f3908435b2a41fbc8f829ecf5aa3b8f0a45ff0b72148ba114"} Mar 16 15:51:01 crc kubenswrapper[5120]: I0316 15:51:01.932897 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openstack-kuttl-tests/barbican-api-76b87c5788-h6qrd" podUID="bcd3c028-eca6-4aaf-afb4-f0887af035e8" containerName="barbican-api" probeResult="failure" output="HTTP probe failed with statuscode: 500" Mar 16 15:51:01 crc kubenswrapper[5120]: I0316 15:51:01.957233 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-698fb447c8-kz5xv"] Mar 16 15:51:01 crc kubenswrapper[5120]: I0316 15:51:01.971426 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-698fb447c8-kz5xv"] Mar 16 15:51:01 crc kubenswrapper[5120]: I0316 15:51:01.984900 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-895d6468c-b4n82"] Mar 16 15:51:02 crc kubenswrapper[5120]: I0316 15:51:02.000145 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-worker-895d6468c-b4n82"] Mar 16 15:51:02 crc kubenswrapper[5120]: I0316 15:51:02.077298 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-76b87c5788-h6qrd" Mar 16 15:51:02 crc kubenswrapper[5120]: I0316 15:51:02.084201 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-76b87c5788-h6qrd" Mar 16 15:51:02 crc kubenswrapper[5120]: I0316 15:51:02.676831 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6d402989-2c1d-4b01-a058-ffd1bd6767f4" path="/var/lib/kubelet/pods/6d402989-2c1d-4b01-a058-ffd1bd6767f4/volumes" Mar 16 15:51:02 crc kubenswrapper[5120]: I0316 15:51:02.677414 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ae0bb770-ecc1-4c2e-ab55-438b27b60d5c" path="/var/lib/kubelet/pods/ae0bb770-ecc1-4c2e-ab55-438b27b60d5c/volumes" Mar 16 15:51:05 crc kubenswrapper[5120]: I0316 15:51:05.860397 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 15:51:06 crc kubenswrapper[5120]: I0316 15:51:06.014494 5120 scope.go:117] "RemoveContainer" containerID="1d2d2134fdda0c5e0372299b027d1622da0a3a3ae78ccd4636f7f944c923063f" Mar 16 15:51:06 crc kubenswrapper[5120]: I0316 15:51:06.080049 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 15:51:06 crc kubenswrapper[5120]: I0316 15:51:06.122522 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 15:51:06 crc kubenswrapper[5120]: I0316 15:51:06.515647 5120 scope.go:117] "RemoveContainer" containerID="44d53f4a0578ab4484d9ed2fed30ca03085fd85122e1e63e31abaea9ebeb9bbe" Mar 16 15:51:06 crc kubenswrapper[5120]: E0316 15:51:06.516402 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"44d53f4a0578ab4484d9ed2fed30ca03085fd85122e1e63e31abaea9ebeb9bbe\": container with ID starting with 44d53f4a0578ab4484d9ed2fed30ca03085fd85122e1e63e31abaea9ebeb9bbe not found: ID does not exist" containerID="44d53f4a0578ab4484d9ed2fed30ca03085fd85122e1e63e31abaea9ebeb9bbe" Mar 16 15:51:06 crc kubenswrapper[5120]: I0316 15:51:06.516435 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44d53f4a0578ab4484d9ed2fed30ca03085fd85122e1e63e31abaea9ebeb9bbe"} err="failed to get container status \"44d53f4a0578ab4484d9ed2fed30ca03085fd85122e1e63e31abaea9ebeb9bbe\": rpc error: code = NotFound desc = could not find container \"44d53f4a0578ab4484d9ed2fed30ca03085fd85122e1e63e31abaea9ebeb9bbe\": container with ID starting with 44d53f4a0578ab4484d9ed2fed30ca03085fd85122e1e63e31abaea9ebeb9bbe not found: ID does not exist" Mar 16 15:51:06 crc kubenswrapper[5120]: I0316 15:51:06.516455 5120 scope.go:117] "RemoveContainer" containerID="1d2d2134fdda0c5e0372299b027d1622da0a3a3ae78ccd4636f7f944c923063f" Mar 16 15:51:06 crc kubenswrapper[5120]: E0316 15:51:06.516944 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1d2d2134fdda0c5e0372299b027d1622da0a3a3ae78ccd4636f7f944c923063f\": container with ID starting with 1d2d2134fdda0c5e0372299b027d1622da0a3a3ae78ccd4636f7f944c923063f not found: ID does not exist" containerID="1d2d2134fdda0c5e0372299b027d1622da0a3a3ae78ccd4636f7f944c923063f" Mar 16 15:51:06 crc kubenswrapper[5120]: I0316 15:51:06.516966 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d2d2134fdda0c5e0372299b027d1622da0a3a3ae78ccd4636f7f944c923063f"} err="failed to get container status \"1d2d2134fdda0c5e0372299b027d1622da0a3a3ae78ccd4636f7f944c923063f\": rpc error: code = NotFound desc = could not find container \"1d2d2134fdda0c5e0372299b027d1622da0a3a3ae78ccd4636f7f944c923063f\": container with ID starting with 1d2d2134fdda0c5e0372299b027d1622da0a3a3ae78ccd4636f7f944c923063f not found: ID does not exist" Mar 16 15:51:06 crc kubenswrapper[5120]: I0316 15:51:06.516982 5120 scope.go:117] "RemoveContainer" containerID="5288c2bf1a6c1603d57cd8d0bfc4238671dc4383bc3651665cf2a2b3b0f2d5ab" Mar 16 15:51:06 crc kubenswrapper[5120]: I0316 15:51:06.576343 5120 scope.go:117] "RemoveContainer" containerID="eb55125e5ba83542eeb562e76bcfc122823207f4d50994930918dd5526c3b0bd" Mar 16 15:51:06 crc kubenswrapper[5120]: I0316 15:51:06.608397 5120 scope.go:117] "RemoveContainer" containerID="5288c2bf1a6c1603d57cd8d0bfc4238671dc4383bc3651665cf2a2b3b0f2d5ab" Mar 16 15:51:06 crc kubenswrapper[5120]: E0316 15:51:06.608806 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5288c2bf1a6c1603d57cd8d0bfc4238671dc4383bc3651665cf2a2b3b0f2d5ab\": container with ID starting with 5288c2bf1a6c1603d57cd8d0bfc4238671dc4383bc3651665cf2a2b3b0f2d5ab not found: ID does not exist" containerID="5288c2bf1a6c1603d57cd8d0bfc4238671dc4383bc3651665cf2a2b3b0f2d5ab" Mar 16 15:51:06 crc kubenswrapper[5120]: I0316 15:51:06.608985 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5288c2bf1a6c1603d57cd8d0bfc4238671dc4383bc3651665cf2a2b3b0f2d5ab"} err="failed to get container status \"5288c2bf1a6c1603d57cd8d0bfc4238671dc4383bc3651665cf2a2b3b0f2d5ab\": rpc error: code = NotFound desc = could not find container \"5288c2bf1a6c1603d57cd8d0bfc4238671dc4383bc3651665cf2a2b3b0f2d5ab\": container with ID starting with 5288c2bf1a6c1603d57cd8d0bfc4238671dc4383bc3651665cf2a2b3b0f2d5ab not found: ID does not exist" Mar 16 15:51:06 crc kubenswrapper[5120]: I0316 15:51:06.609115 5120 scope.go:117] "RemoveContainer" containerID="eb55125e5ba83542eeb562e76bcfc122823207f4d50994930918dd5526c3b0bd" Mar 16 15:51:06 crc kubenswrapper[5120]: E0316 15:51:06.610447 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb55125e5ba83542eeb562e76bcfc122823207f4d50994930918dd5526c3b0bd\": container with ID starting with eb55125e5ba83542eeb562e76bcfc122823207f4d50994930918dd5526c3b0bd not found: ID does not exist" containerID="eb55125e5ba83542eeb562e76bcfc122823207f4d50994930918dd5526c3b0bd" Mar 16 15:51:06 crc kubenswrapper[5120]: I0316 15:51:06.610493 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb55125e5ba83542eeb562e76bcfc122823207f4d50994930918dd5526c3b0bd"} err="failed to get container status \"eb55125e5ba83542eeb562e76bcfc122823207f4d50994930918dd5526c3b0bd\": rpc error: code = NotFound desc = could not find container \"eb55125e5ba83542eeb562e76bcfc122823207f4d50994930918dd5526c3b0bd\": container with ID starting with eb55125e5ba83542eeb562e76bcfc122823207f4d50994930918dd5526c3b0bd not found: ID does not exist" Mar 16 15:51:06 crc kubenswrapper[5120]: I0316 15:51:06.630908 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:51:06 crc kubenswrapper[5120]: I0316 15:51:06.972438 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="2b8e2567-77a1-4c2c-930c-785714326aba" containerName="ceilometer-central-agent" containerID="cri-o://8f3ec011338adacf108d112a9d9b0d1a3c3bf782a46642ee705a679d20e1ae51" gracePeriod=30 Mar 16 15:51:06 crc kubenswrapper[5120]: I0316 15:51:06.972635 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="2b8e2567-77a1-4c2c-930c-785714326aba" containerName="sg-core" containerID="cri-o://152d2932cf6f6e7d6fb471b829f43f0e0ed317ec14c8f25b3517a806f58a0711" gracePeriod=30 Mar 16 15:51:06 crc kubenswrapper[5120]: I0316 15:51:06.972557 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"2b8e2567-77a1-4c2c-930c-785714326aba","Type":"ContainerStarted","Data":"ba3a80ce8c793cb6bea3569ac6d1c3db9250dd3cef83610e771310c42f0bd0d0"} Mar 16 15:51:06 crc kubenswrapper[5120]: I0316 15:51:06.972656 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="2b8e2567-77a1-4c2c-930c-785714326aba" containerName="ceilometer-notification-agent" containerID="cri-o://739d3405378f4c1a76e93ce39cee573eed5465f23533719b6e3645831f51b9f0" gracePeriod=30 Mar 16 15:51:06 crc kubenswrapper[5120]: I0316 15:51:06.972727 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="170a65d6-484e-4797-8619-b913987e8313" containerName="probe" containerID="cri-o://c62ec55997b9dda26048360641dbb05aa6c36c603e96ead4051d147a8f2d3715" gracePeriod=30 Mar 16 15:51:06 crc kubenswrapper[5120]: I0316 15:51:06.972595 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="2b8e2567-77a1-4c2c-930c-785714326aba" containerName="proxy-httpd" containerID="cri-o://ba3a80ce8c793cb6bea3569ac6d1c3db9250dd3cef83610e771310c42f0bd0d0" gracePeriod=30 Mar 16 15:51:06 crc kubenswrapper[5120]: I0316 15:51:06.972660 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="170a65d6-484e-4797-8619-b913987e8313" containerName="cinder-scheduler" containerID="cri-o://84345639a1bc424d92722dabb7dc56f33c705462a655a9d14aadf5effc9aa6b0" gracePeriod=30 Mar 16 15:51:06 crc kubenswrapper[5120]: I0316 15:51:06.973004 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:51:07 crc kubenswrapper[5120]: I0316 15:51:07.002840 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=1.513948665 podStartE2EDuration="51.002741628s" podCreationTimestamp="2026-03-16 15:50:16 +0000 UTC" firstStartedPulling="2026-03-16 15:50:17.119539488 +0000 UTC m=+1119.273471145" lastFinishedPulling="2026-03-16 15:51:06.608332451 +0000 UTC m=+1168.762264108" observedRunningTime="2026-03-16 15:51:06.99724493 +0000 UTC m=+1169.151176587" watchObservedRunningTime="2026-03-16 15:51:07.002741628 +0000 UTC m=+1169.156673285" Mar 16 15:51:07 crc kubenswrapper[5120]: I0316 15:51:07.982210 5120 generic.go:358] "Generic (PLEG): container finished" podID="170a65d6-484e-4797-8619-b913987e8313" containerID="c62ec55997b9dda26048360641dbb05aa6c36c603e96ead4051d147a8f2d3715" exitCode=0 Mar 16 15:51:07 crc kubenswrapper[5120]: I0316 15:51:07.982288 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"170a65d6-484e-4797-8619-b913987e8313","Type":"ContainerDied","Data":"c62ec55997b9dda26048360641dbb05aa6c36c603e96ead4051d147a8f2d3715"} Mar 16 15:51:07 crc kubenswrapper[5120]: I0316 15:51:07.984889 5120 generic.go:358] "Generic (PLEG): container finished" podID="2b8e2567-77a1-4c2c-930c-785714326aba" containerID="ba3a80ce8c793cb6bea3569ac6d1c3db9250dd3cef83610e771310c42f0bd0d0" exitCode=0 Mar 16 15:51:07 crc kubenswrapper[5120]: I0316 15:51:07.984907 5120 generic.go:358] "Generic (PLEG): container finished" podID="2b8e2567-77a1-4c2c-930c-785714326aba" containerID="152d2932cf6f6e7d6fb471b829f43f0e0ed317ec14c8f25b3517a806f58a0711" exitCode=2 Mar 16 15:51:07 crc kubenswrapper[5120]: I0316 15:51:07.984915 5120 generic.go:358] "Generic (PLEG): container finished" podID="2b8e2567-77a1-4c2c-930c-785714326aba" containerID="8f3ec011338adacf108d112a9d9b0d1a3c3bf782a46642ee705a679d20e1ae51" exitCode=0 Mar 16 15:51:07 crc kubenswrapper[5120]: I0316 15:51:07.984999 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"2b8e2567-77a1-4c2c-930c-785714326aba","Type":"ContainerDied","Data":"ba3a80ce8c793cb6bea3569ac6d1c3db9250dd3cef83610e771310c42f0bd0d0"} Mar 16 15:51:07 crc kubenswrapper[5120]: I0316 15:51:07.985017 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"2b8e2567-77a1-4c2c-930c-785714326aba","Type":"ContainerDied","Data":"152d2932cf6f6e7d6fb471b829f43f0e0ed317ec14c8f25b3517a806f58a0711"} Mar 16 15:51:07 crc kubenswrapper[5120]: I0316 15:51:07.985028 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"2b8e2567-77a1-4c2c-930c-785714326aba","Type":"ContainerDied","Data":"8f3ec011338adacf108d112a9d9b0d1a3c3bf782a46642ee705a679d20e1ae51"} Mar 16 15:51:08 crc kubenswrapper[5120]: E0316 15:51:08.105719 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1604183 actualBytes=10240 Mar 16 15:51:08 crc kubenswrapper[5120]: I0316 15:51:08.455051 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-5f559c8896-5jgnd" Mar 16 15:51:08 crc kubenswrapper[5120]: I0316 15:51:08.508876 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-5f559c8896-5jgnd" Mar 16 15:51:08 crc kubenswrapper[5120]: I0316 15:51:08.559613 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-76b87c5788-h6qrd"] Mar 16 15:51:08 crc kubenswrapper[5120]: I0316 15:51:08.560051 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-76b87c5788-h6qrd" podUID="bcd3c028-eca6-4aaf-afb4-f0887af035e8" containerName="barbican-api" containerID="cri-o://0173ba7a44d2f4d71b00b887d464f59a9e13d78af4744e9bb2d93a6819823274" gracePeriod=30 Mar 16 15:51:08 crc kubenswrapper[5120]: I0316 15:51:08.560638 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-76b87c5788-h6qrd" podUID="bcd3c028-eca6-4aaf-afb4-f0887af035e8" containerName="barbican-api-log" containerID="cri-o://6ee6932cdb77d06a62649b97408355f2022176de3f511c922e65a0dae8f9c58f" gracePeriod=30 Mar 16 15:51:08 crc kubenswrapper[5120]: I0316 15:51:08.994861 5120 generic.go:358] "Generic (PLEG): container finished" podID="bcd3c028-eca6-4aaf-afb4-f0887af035e8" containerID="6ee6932cdb77d06a62649b97408355f2022176de3f511c922e65a0dae8f9c58f" exitCode=143 Mar 16 15:51:08 crc kubenswrapper[5120]: I0316 15:51:08.996170 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-76b87c5788-h6qrd" event={"ID":"bcd3c028-eca6-4aaf-afb4-f0887af035e8","Type":"ContainerDied","Data":"6ee6932cdb77d06a62649b97408355f2022176de3f511c922e65a0dae8f9c58f"} Mar 16 15:51:11 crc kubenswrapper[5120]: I0316 15:51:11.014802 5120 generic.go:358] "Generic (PLEG): container finished" podID="170a65d6-484e-4797-8619-b913987e8313" containerID="84345639a1bc424d92722dabb7dc56f33c705462a655a9d14aadf5effc9aa6b0" exitCode=0 Mar 16 15:51:11 crc kubenswrapper[5120]: I0316 15:51:11.014874 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"170a65d6-484e-4797-8619-b913987e8313","Type":"ContainerDied","Data":"84345639a1bc424d92722dabb7dc56f33c705462a655a9d14aadf5effc9aa6b0"} Mar 16 15:51:11 crc kubenswrapper[5120]: I0316 15:51:11.439719 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 15:51:11 crc kubenswrapper[5120]: I0316 15:51:11.476655 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/170a65d6-484e-4797-8619-b913987e8313-config-data\") pod \"170a65d6-484e-4797-8619-b913987e8313\" (UID: \"170a65d6-484e-4797-8619-b913987e8313\") " Mar 16 15:51:11 crc kubenswrapper[5120]: I0316 15:51:11.476732 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-md9fk\" (UniqueName: \"kubernetes.io/projected/170a65d6-484e-4797-8619-b913987e8313-kube-api-access-md9fk\") pod \"170a65d6-484e-4797-8619-b913987e8313\" (UID: \"170a65d6-484e-4797-8619-b913987e8313\") " Mar 16 15:51:11 crc kubenswrapper[5120]: I0316 15:51:11.476829 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/170a65d6-484e-4797-8619-b913987e8313-config-data-custom\") pod \"170a65d6-484e-4797-8619-b913987e8313\" (UID: \"170a65d6-484e-4797-8619-b913987e8313\") " Mar 16 15:51:11 crc kubenswrapper[5120]: I0316 15:51:11.476966 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/170a65d6-484e-4797-8619-b913987e8313-etc-machine-id\") pod \"170a65d6-484e-4797-8619-b913987e8313\" (UID: \"170a65d6-484e-4797-8619-b913987e8313\") " Mar 16 15:51:11 crc kubenswrapper[5120]: I0316 15:51:11.477066 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/170a65d6-484e-4797-8619-b913987e8313-combined-ca-bundle\") pod \"170a65d6-484e-4797-8619-b913987e8313\" (UID: \"170a65d6-484e-4797-8619-b913987e8313\") " Mar 16 15:51:11 crc kubenswrapper[5120]: I0316 15:51:11.477137 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/170a65d6-484e-4797-8619-b913987e8313-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "170a65d6-484e-4797-8619-b913987e8313" (UID: "170a65d6-484e-4797-8619-b913987e8313"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 15:51:11 crc kubenswrapper[5120]: I0316 15:51:11.477188 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/170a65d6-484e-4797-8619-b913987e8313-scripts\") pod \"170a65d6-484e-4797-8619-b913987e8313\" (UID: \"170a65d6-484e-4797-8619-b913987e8313\") " Mar 16 15:51:11 crc kubenswrapper[5120]: I0316 15:51:11.477924 5120 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/170a65d6-484e-4797-8619-b913987e8313-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 15:51:11 crc kubenswrapper[5120]: I0316 15:51:11.483421 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/170a65d6-484e-4797-8619-b913987e8313-kube-api-access-md9fk" (OuterVolumeSpecName: "kube-api-access-md9fk") pod "170a65d6-484e-4797-8619-b913987e8313" (UID: "170a65d6-484e-4797-8619-b913987e8313"). InnerVolumeSpecName "kube-api-access-md9fk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:51:11 crc kubenswrapper[5120]: I0316 15:51:11.483826 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/170a65d6-484e-4797-8619-b913987e8313-scripts" (OuterVolumeSpecName: "scripts") pod "170a65d6-484e-4797-8619-b913987e8313" (UID: "170a65d6-484e-4797-8619-b913987e8313"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:51:11 crc kubenswrapper[5120]: I0316 15:51:11.489610 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/170a65d6-484e-4797-8619-b913987e8313-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "170a65d6-484e-4797-8619-b913987e8313" (UID: "170a65d6-484e-4797-8619-b913987e8313"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:51:11 crc kubenswrapper[5120]: I0316 15:51:11.534897 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/170a65d6-484e-4797-8619-b913987e8313-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "170a65d6-484e-4797-8619-b913987e8313" (UID: "170a65d6-484e-4797-8619-b913987e8313"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:51:11 crc kubenswrapper[5120]: I0316 15:51:11.572225 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/170a65d6-484e-4797-8619-b913987e8313-config-data" (OuterVolumeSpecName: "config-data") pod "170a65d6-484e-4797-8619-b913987e8313" (UID: "170a65d6-484e-4797-8619-b913987e8313"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:51:11 crc kubenswrapper[5120]: I0316 15:51:11.579276 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/170a65d6-484e-4797-8619-b913987e8313-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:51:11 crc kubenswrapper[5120]: I0316 15:51:11.579307 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/170a65d6-484e-4797-8619-b913987e8313-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 15:51:11 crc kubenswrapper[5120]: I0316 15:51:11.579321 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/170a65d6-484e-4797-8619-b913987e8313-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 15:51:11 crc kubenswrapper[5120]: I0316 15:51:11.579331 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-md9fk\" (UniqueName: \"kubernetes.io/projected/170a65d6-484e-4797-8619-b913987e8313-kube-api-access-md9fk\") on node \"crc\" DevicePath \"\"" Mar 16 15:51:11 crc kubenswrapper[5120]: I0316 15:51:11.579344 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/170a65d6-484e-4797-8619-b913987e8313-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 15:51:11 crc kubenswrapper[5120]: I0316 15:51:11.704804 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-76b87c5788-h6qrd" podUID="bcd3c028-eca6-4aaf-afb4-f0887af035e8" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.0.150:9311/healthcheck\": read tcp 10.217.0.2:54602->10.217.0.150:9311: read: connection reset by peer" Mar 16 15:51:12 crc kubenswrapper[5120]: I0316 15:51:12.041241 5120 generic.go:358] "Generic (PLEG): container finished" podID="bcd3c028-eca6-4aaf-afb4-f0887af035e8" containerID="0173ba7a44d2f4d71b00b887d464f59a9e13d78af4744e9bb2d93a6819823274" exitCode=0 Mar 16 15:51:12 crc kubenswrapper[5120]: I0316 15:51:12.041288 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-76b87c5788-h6qrd" event={"ID":"bcd3c028-eca6-4aaf-afb4-f0887af035e8","Type":"ContainerDied","Data":"0173ba7a44d2f4d71b00b887d464f59a9e13d78af4744e9bb2d93a6819823274"} Mar 16 15:51:12 crc kubenswrapper[5120]: I0316 15:51:12.044596 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 15:51:12 crc kubenswrapper[5120]: I0316 15:51:12.044619 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"170a65d6-484e-4797-8619-b913987e8313","Type":"ContainerDied","Data":"3c116102bcc94f2680b8dc04f457c44d7b7dee05fa921988eb8c831cf3b873af"} Mar 16 15:51:12 crc kubenswrapper[5120]: I0316 15:51:12.044671 5120 scope.go:117] "RemoveContainer" containerID="c62ec55997b9dda26048360641dbb05aa6c36c603e96ead4051d147a8f2d3715" Mar 16 15:51:12 crc kubenswrapper[5120]: I0316 15:51:12.071284 5120 scope.go:117] "RemoveContainer" containerID="84345639a1bc424d92722dabb7dc56f33c705462a655a9d14aadf5effc9aa6b0" Mar 16 15:51:12 crc kubenswrapper[5120]: I0316 15:51:12.092613 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 15:51:12 crc kubenswrapper[5120]: I0316 15:51:12.109325 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 15:51:12 crc kubenswrapper[5120]: I0316 15:51:12.122044 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 15:51:12 crc kubenswrapper[5120]: I0316 15:51:12.123079 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d402989-2c1d-4b01-a058-ffd1bd6767f4" containerName="barbican-keystone-listener-log" Mar 16 15:51:12 crc kubenswrapper[5120]: I0316 15:51:12.123099 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d402989-2c1d-4b01-a058-ffd1bd6767f4" containerName="barbican-keystone-listener-log" Mar 16 15:51:12 crc kubenswrapper[5120]: I0316 15:51:12.123111 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d402989-2c1d-4b01-a058-ffd1bd6767f4" containerName="barbican-keystone-listener" Mar 16 15:51:12 crc kubenswrapper[5120]: I0316 15:51:12.123116 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d402989-2c1d-4b01-a058-ffd1bd6767f4" containerName="barbican-keystone-listener" Mar 16 15:51:12 crc kubenswrapper[5120]: I0316 15:51:12.123140 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb486d50-9a5f-40e2-842a-d942a88eb350" containerName="barbican-api-log" Mar 16 15:51:12 crc kubenswrapper[5120]: I0316 15:51:12.123145 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb486d50-9a5f-40e2-842a-d942a88eb350" containerName="barbican-api-log" Mar 16 15:51:12 crc kubenswrapper[5120]: I0316 15:51:12.123152 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb486d50-9a5f-40e2-842a-d942a88eb350" containerName="barbican-api" Mar 16 15:51:12 crc kubenswrapper[5120]: I0316 15:51:12.123157 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb486d50-9a5f-40e2-842a-d942a88eb350" containerName="barbican-api" Mar 16 15:51:12 crc kubenswrapper[5120]: I0316 15:51:12.123171 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="170a65d6-484e-4797-8619-b913987e8313" containerName="probe" Mar 16 15:51:12 crc kubenswrapper[5120]: I0316 15:51:12.123177 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="170a65d6-484e-4797-8619-b913987e8313" containerName="probe" Mar 16 15:51:12 crc kubenswrapper[5120]: I0316 15:51:12.123197 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae0bb770-ecc1-4c2e-ab55-438b27b60d5c" containerName="barbican-worker" Mar 16 15:51:12 crc kubenswrapper[5120]: I0316 15:51:12.123203 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae0bb770-ecc1-4c2e-ab55-438b27b60d5c" containerName="barbican-worker" Mar 16 15:51:12 crc kubenswrapper[5120]: I0316 15:51:12.123217 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae0bb770-ecc1-4c2e-ab55-438b27b60d5c" containerName="barbican-worker-log" Mar 16 15:51:12 crc kubenswrapper[5120]: I0316 15:51:12.123223 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae0bb770-ecc1-4c2e-ab55-438b27b60d5c" containerName="barbican-worker-log" Mar 16 15:51:12 crc kubenswrapper[5120]: I0316 15:51:12.123252 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="170a65d6-484e-4797-8619-b913987e8313" containerName="cinder-scheduler" Mar 16 15:51:12 crc kubenswrapper[5120]: I0316 15:51:12.123257 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="170a65d6-484e-4797-8619-b913987e8313" containerName="cinder-scheduler" Mar 16 15:51:12 crc kubenswrapper[5120]: I0316 15:51:12.123407 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ae0bb770-ecc1-4c2e-ab55-438b27b60d5c" containerName="barbican-worker" Mar 16 15:51:12 crc kubenswrapper[5120]: I0316 15:51:12.123417 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="fb486d50-9a5f-40e2-842a-d942a88eb350" containerName="barbican-api" Mar 16 15:51:12 crc kubenswrapper[5120]: I0316 15:51:12.123428 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="fb486d50-9a5f-40e2-842a-d942a88eb350" containerName="barbican-api-log" Mar 16 15:51:12 crc kubenswrapper[5120]: I0316 15:51:12.123437 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="170a65d6-484e-4797-8619-b913987e8313" containerName="probe" Mar 16 15:51:12 crc kubenswrapper[5120]: I0316 15:51:12.123447 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="6d402989-2c1d-4b01-a058-ffd1bd6767f4" containerName="barbican-keystone-listener" Mar 16 15:51:12 crc kubenswrapper[5120]: I0316 15:51:12.123454 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ae0bb770-ecc1-4c2e-ab55-438b27b60d5c" containerName="barbican-worker-log" Mar 16 15:51:12 crc kubenswrapper[5120]: I0316 15:51:12.123469 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="170a65d6-484e-4797-8619-b913987e8313" containerName="cinder-scheduler" Mar 16 15:51:12 crc kubenswrapper[5120]: I0316 15:51:12.123475 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="6d402989-2c1d-4b01-a058-ffd1bd6767f4" containerName="barbican-keystone-listener-log" Mar 16 15:51:12 crc kubenswrapper[5120]: I0316 15:51:12.127895 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 15:51:12 crc kubenswrapper[5120]: I0316 15:51:12.130030 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 15:51:12 crc kubenswrapper[5120]: I0316 15:51:12.133255 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-scheduler-config-data\"" Mar 16 15:51:12 crc kubenswrapper[5120]: I0316 15:51:12.194645 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/8d66ce1a-7d4c-4e04-92c9-f86d5ad81fcc-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"8d66ce1a-7d4c-4e04-92c9-f86d5ad81fcc\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 15:51:12 crc kubenswrapper[5120]: I0316 15:51:12.194778 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8d66ce1a-7d4c-4e04-92c9-f86d5ad81fcc-scripts\") pod \"cinder-scheduler-0\" (UID: \"8d66ce1a-7d4c-4e04-92c9-f86d5ad81fcc\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 15:51:12 crc kubenswrapper[5120]: I0316 15:51:12.194808 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/8d66ce1a-7d4c-4e04-92c9-f86d5ad81fcc-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"8d66ce1a-7d4c-4e04-92c9-f86d5ad81fcc\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 15:51:12 crc kubenswrapper[5120]: I0316 15:51:12.194843 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8d66ce1a-7d4c-4e04-92c9-f86d5ad81fcc-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"8d66ce1a-7d4c-4e04-92c9-f86d5ad81fcc\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 15:51:12 crc kubenswrapper[5120]: I0316 15:51:12.194878 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8d66ce1a-7d4c-4e04-92c9-f86d5ad81fcc-config-data\") pod \"cinder-scheduler-0\" (UID: \"8d66ce1a-7d4c-4e04-92c9-f86d5ad81fcc\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 15:51:12 crc kubenswrapper[5120]: I0316 15:51:12.194923 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dpqm4\" (UniqueName: \"kubernetes.io/projected/8d66ce1a-7d4c-4e04-92c9-f86d5ad81fcc-kube-api-access-dpqm4\") pod \"cinder-scheduler-0\" (UID: \"8d66ce1a-7d4c-4e04-92c9-f86d5ad81fcc\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 15:51:12 crc kubenswrapper[5120]: I0316 15:51:12.224865 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-76b87c5788-h6qrd" Mar 16 15:51:12 crc kubenswrapper[5120]: I0316 15:51:12.295746 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/bcd3c028-eca6-4aaf-afb4-f0887af035e8-logs\") pod \"bcd3c028-eca6-4aaf-afb4-f0887af035e8\" (UID: \"bcd3c028-eca6-4aaf-afb4-f0887af035e8\") " Mar 16 15:51:12 crc kubenswrapper[5120]: I0316 15:51:12.296160 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/bcd3c028-eca6-4aaf-afb4-f0887af035e8-config-data-custom\") pod \"bcd3c028-eca6-4aaf-afb4-f0887af035e8\" (UID: \"bcd3c028-eca6-4aaf-afb4-f0887af035e8\") " Mar 16 15:51:12 crc kubenswrapper[5120]: I0316 15:51:12.296370 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/bcd3c028-eca6-4aaf-afb4-f0887af035e8-internal-tls-certs\") pod \"bcd3c028-eca6-4aaf-afb4-f0887af035e8\" (UID: \"bcd3c028-eca6-4aaf-afb4-f0887af035e8\") " Mar 16 15:51:12 crc kubenswrapper[5120]: I0316 15:51:12.296440 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bcd3c028-eca6-4aaf-afb4-f0887af035e8-combined-ca-bundle\") pod \"bcd3c028-eca6-4aaf-afb4-f0887af035e8\" (UID: \"bcd3c028-eca6-4aaf-afb4-f0887af035e8\") " Mar 16 15:51:12 crc kubenswrapper[5120]: I0316 15:51:12.296493 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jll6s\" (UniqueName: \"kubernetes.io/projected/bcd3c028-eca6-4aaf-afb4-f0887af035e8-kube-api-access-jll6s\") pod \"bcd3c028-eca6-4aaf-afb4-f0887af035e8\" (UID: \"bcd3c028-eca6-4aaf-afb4-f0887af035e8\") " Mar 16 15:51:12 crc kubenswrapper[5120]: I0316 15:51:12.296570 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bcd3c028-eca6-4aaf-afb4-f0887af035e8-config-data\") pod \"bcd3c028-eca6-4aaf-afb4-f0887af035e8\" (UID: \"bcd3c028-eca6-4aaf-afb4-f0887af035e8\") " Mar 16 15:51:12 crc kubenswrapper[5120]: I0316 15:51:12.296589 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/bcd3c028-eca6-4aaf-afb4-f0887af035e8-public-tls-certs\") pod \"bcd3c028-eca6-4aaf-afb4-f0887af035e8\" (UID: \"bcd3c028-eca6-4aaf-afb4-f0887af035e8\") " Mar 16 15:51:12 crc kubenswrapper[5120]: I0316 15:51:12.296966 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8d66ce1a-7d4c-4e04-92c9-f86d5ad81fcc-scripts\") pod \"cinder-scheduler-0\" (UID: \"8d66ce1a-7d4c-4e04-92c9-f86d5ad81fcc\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 15:51:12 crc kubenswrapper[5120]: I0316 15:51:12.296989 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/8d66ce1a-7d4c-4e04-92c9-f86d5ad81fcc-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"8d66ce1a-7d4c-4e04-92c9-f86d5ad81fcc\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 15:51:12 crc kubenswrapper[5120]: I0316 15:51:12.297051 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8d66ce1a-7d4c-4e04-92c9-f86d5ad81fcc-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"8d66ce1a-7d4c-4e04-92c9-f86d5ad81fcc\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 15:51:12 crc kubenswrapper[5120]: I0316 15:51:12.297118 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8d66ce1a-7d4c-4e04-92c9-f86d5ad81fcc-config-data\") pod \"cinder-scheduler-0\" (UID: \"8d66ce1a-7d4c-4e04-92c9-f86d5ad81fcc\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 15:51:12 crc kubenswrapper[5120]: I0316 15:51:12.297194 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dpqm4\" (UniqueName: \"kubernetes.io/projected/8d66ce1a-7d4c-4e04-92c9-f86d5ad81fcc-kube-api-access-dpqm4\") pod \"cinder-scheduler-0\" (UID: \"8d66ce1a-7d4c-4e04-92c9-f86d5ad81fcc\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 15:51:12 crc kubenswrapper[5120]: I0316 15:51:12.297267 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/8d66ce1a-7d4c-4e04-92c9-f86d5ad81fcc-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"8d66ce1a-7d4c-4e04-92c9-f86d5ad81fcc\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 15:51:12 crc kubenswrapper[5120]: I0316 15:51:12.297493 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/8d66ce1a-7d4c-4e04-92c9-f86d5ad81fcc-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"8d66ce1a-7d4c-4e04-92c9-f86d5ad81fcc\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 15:51:12 crc kubenswrapper[5120]: I0316 15:51:12.297789 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bcd3c028-eca6-4aaf-afb4-f0887af035e8-logs" (OuterVolumeSpecName: "logs") pod "bcd3c028-eca6-4aaf-afb4-f0887af035e8" (UID: "bcd3c028-eca6-4aaf-afb4-f0887af035e8"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:51:12 crc kubenswrapper[5120]: I0316 15:51:12.302570 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bcd3c028-eca6-4aaf-afb4-f0887af035e8-kube-api-access-jll6s" (OuterVolumeSpecName: "kube-api-access-jll6s") pod "bcd3c028-eca6-4aaf-afb4-f0887af035e8" (UID: "bcd3c028-eca6-4aaf-afb4-f0887af035e8"). InnerVolumeSpecName "kube-api-access-jll6s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:51:12 crc kubenswrapper[5120]: I0316 15:51:12.303470 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8d66ce1a-7d4c-4e04-92c9-f86d5ad81fcc-config-data\") pod \"cinder-scheduler-0\" (UID: \"8d66ce1a-7d4c-4e04-92c9-f86d5ad81fcc\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 15:51:12 crc kubenswrapper[5120]: I0316 15:51:12.303718 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bcd3c028-eca6-4aaf-afb4-f0887af035e8-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "bcd3c028-eca6-4aaf-afb4-f0887af035e8" (UID: "bcd3c028-eca6-4aaf-afb4-f0887af035e8"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:51:12 crc kubenswrapper[5120]: I0316 15:51:12.309996 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8d66ce1a-7d4c-4e04-92c9-f86d5ad81fcc-scripts\") pod \"cinder-scheduler-0\" (UID: \"8d66ce1a-7d4c-4e04-92c9-f86d5ad81fcc\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 15:51:12 crc kubenswrapper[5120]: I0316 15:51:12.314610 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/8d66ce1a-7d4c-4e04-92c9-f86d5ad81fcc-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"8d66ce1a-7d4c-4e04-92c9-f86d5ad81fcc\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 15:51:12 crc kubenswrapper[5120]: I0316 15:51:12.316813 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8d66ce1a-7d4c-4e04-92c9-f86d5ad81fcc-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"8d66ce1a-7d4c-4e04-92c9-f86d5ad81fcc\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 15:51:12 crc kubenswrapper[5120]: I0316 15:51:12.320133 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dpqm4\" (UniqueName: \"kubernetes.io/projected/8d66ce1a-7d4c-4e04-92c9-f86d5ad81fcc-kube-api-access-dpqm4\") pod \"cinder-scheduler-0\" (UID: \"8d66ce1a-7d4c-4e04-92c9-f86d5ad81fcc\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 15:51:12 crc kubenswrapper[5120]: I0316 15:51:12.345933 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bcd3c028-eca6-4aaf-afb4-f0887af035e8-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "bcd3c028-eca6-4aaf-afb4-f0887af035e8" (UID: "bcd3c028-eca6-4aaf-afb4-f0887af035e8"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:51:12 crc kubenswrapper[5120]: I0316 15:51:12.353603 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bcd3c028-eca6-4aaf-afb4-f0887af035e8-config-data" (OuterVolumeSpecName: "config-data") pod "bcd3c028-eca6-4aaf-afb4-f0887af035e8" (UID: "bcd3c028-eca6-4aaf-afb4-f0887af035e8"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:51:12 crc kubenswrapper[5120]: I0316 15:51:12.354522 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bcd3c028-eca6-4aaf-afb4-f0887af035e8-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "bcd3c028-eca6-4aaf-afb4-f0887af035e8" (UID: "bcd3c028-eca6-4aaf-afb4-f0887af035e8"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:51:12 crc kubenswrapper[5120]: I0316 15:51:12.370419 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bcd3c028-eca6-4aaf-afb4-f0887af035e8-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "bcd3c028-eca6-4aaf-afb4-f0887af035e8" (UID: "bcd3c028-eca6-4aaf-afb4-f0887af035e8"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:51:12 crc kubenswrapper[5120]: I0316 15:51:12.399303 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/bcd3c028-eca6-4aaf-afb4-f0887af035e8-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 15:51:12 crc kubenswrapper[5120]: I0316 15:51:12.399332 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bcd3c028-eca6-4aaf-afb4-f0887af035e8-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:51:12 crc kubenswrapper[5120]: I0316 15:51:12.399340 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jll6s\" (UniqueName: \"kubernetes.io/projected/bcd3c028-eca6-4aaf-afb4-f0887af035e8-kube-api-access-jll6s\") on node \"crc\" DevicePath \"\"" Mar 16 15:51:12 crc kubenswrapper[5120]: I0316 15:51:12.399352 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bcd3c028-eca6-4aaf-afb4-f0887af035e8-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 15:51:12 crc kubenswrapper[5120]: I0316 15:51:12.399362 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/bcd3c028-eca6-4aaf-afb4-f0887af035e8-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 15:51:12 crc kubenswrapper[5120]: I0316 15:51:12.399371 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/bcd3c028-eca6-4aaf-afb4-f0887af035e8-logs\") on node \"crc\" DevicePath \"\"" Mar 16 15:51:12 crc kubenswrapper[5120]: I0316 15:51:12.399380 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/bcd3c028-eca6-4aaf-afb4-f0887af035e8-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 15:51:12 crc kubenswrapper[5120]: I0316 15:51:12.521218 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 15:51:12 crc kubenswrapper[5120]: I0316 15:51:12.678884 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="170a65d6-484e-4797-8619-b913987e8313" path="/var/lib/kubelet/pods/170a65d6-484e-4797-8619-b913987e8313/volumes" Mar 16 15:51:12 crc kubenswrapper[5120]: I0316 15:51:12.697705 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:51:12 crc kubenswrapper[5120]: I0316 15:51:12.806002 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2b8e2567-77a1-4c2c-930c-785714326aba-scripts\") pod \"2b8e2567-77a1-4c2c-930c-785714326aba\" (UID: \"2b8e2567-77a1-4c2c-930c-785714326aba\") " Mar 16 15:51:12 crc kubenswrapper[5120]: I0316 15:51:12.806149 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2b8e2567-77a1-4c2c-930c-785714326aba-log-httpd\") pod \"2b8e2567-77a1-4c2c-930c-785714326aba\" (UID: \"2b8e2567-77a1-4c2c-930c-785714326aba\") " Mar 16 15:51:12 crc kubenswrapper[5120]: I0316 15:51:12.806174 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/2b8e2567-77a1-4c2c-930c-785714326aba-sg-core-conf-yaml\") pod \"2b8e2567-77a1-4c2c-930c-785714326aba\" (UID: \"2b8e2567-77a1-4c2c-930c-785714326aba\") " Mar 16 15:51:12 crc kubenswrapper[5120]: I0316 15:51:12.806249 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2b8e2567-77a1-4c2c-930c-785714326aba-combined-ca-bundle\") pod \"2b8e2567-77a1-4c2c-930c-785714326aba\" (UID: \"2b8e2567-77a1-4c2c-930c-785714326aba\") " Mar 16 15:51:12 crc kubenswrapper[5120]: I0316 15:51:12.806381 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2b8e2567-77a1-4c2c-930c-785714326aba-config-data\") pod \"2b8e2567-77a1-4c2c-930c-785714326aba\" (UID: \"2b8e2567-77a1-4c2c-930c-785714326aba\") " Mar 16 15:51:12 crc kubenswrapper[5120]: I0316 15:51:12.806418 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2b8e2567-77a1-4c2c-930c-785714326aba-run-httpd\") pod \"2b8e2567-77a1-4c2c-930c-785714326aba\" (UID: \"2b8e2567-77a1-4c2c-930c-785714326aba\") " Mar 16 15:51:12 crc kubenswrapper[5120]: I0316 15:51:12.806448 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5bbhx\" (UniqueName: \"kubernetes.io/projected/2b8e2567-77a1-4c2c-930c-785714326aba-kube-api-access-5bbhx\") pod \"2b8e2567-77a1-4c2c-930c-785714326aba\" (UID: \"2b8e2567-77a1-4c2c-930c-785714326aba\") " Mar 16 15:51:12 crc kubenswrapper[5120]: I0316 15:51:12.807508 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b8e2567-77a1-4c2c-930c-785714326aba-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "2b8e2567-77a1-4c2c-930c-785714326aba" (UID: "2b8e2567-77a1-4c2c-930c-785714326aba"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:51:12 crc kubenswrapper[5120]: I0316 15:51:12.807977 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b8e2567-77a1-4c2c-930c-785714326aba-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "2b8e2567-77a1-4c2c-930c-785714326aba" (UID: "2b8e2567-77a1-4c2c-930c-785714326aba"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:51:12 crc kubenswrapper[5120]: I0316 15:51:12.812636 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b8e2567-77a1-4c2c-930c-785714326aba-kube-api-access-5bbhx" (OuterVolumeSpecName: "kube-api-access-5bbhx") pod "2b8e2567-77a1-4c2c-930c-785714326aba" (UID: "2b8e2567-77a1-4c2c-930c-785714326aba"). InnerVolumeSpecName "kube-api-access-5bbhx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:51:12 crc kubenswrapper[5120]: I0316 15:51:12.813223 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b8e2567-77a1-4c2c-930c-785714326aba-scripts" (OuterVolumeSpecName: "scripts") pod "2b8e2567-77a1-4c2c-930c-785714326aba" (UID: "2b8e2567-77a1-4c2c-930c-785714326aba"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:51:12 crc kubenswrapper[5120]: I0316 15:51:12.853472 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b8e2567-77a1-4c2c-930c-785714326aba-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "2b8e2567-77a1-4c2c-930c-785714326aba" (UID: "2b8e2567-77a1-4c2c-930c-785714326aba"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:51:12 crc kubenswrapper[5120]: I0316 15:51:12.868876 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b8e2567-77a1-4c2c-930c-785714326aba-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "2b8e2567-77a1-4c2c-930c-785714326aba" (UID: "2b8e2567-77a1-4c2c-930c-785714326aba"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:51:12 crc kubenswrapper[5120]: I0316 15:51:12.889080 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b8e2567-77a1-4c2c-930c-785714326aba-config-data" (OuterVolumeSpecName: "config-data") pod "2b8e2567-77a1-4c2c-930c-785714326aba" (UID: "2b8e2567-77a1-4c2c-930c-785714326aba"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:51:12 crc kubenswrapper[5120]: I0316 15:51:12.908390 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2b8e2567-77a1-4c2c-930c-785714326aba-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 15:51:12 crc kubenswrapper[5120]: I0316 15:51:12.908434 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2b8e2567-77a1-4c2c-930c-785714326aba-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 15:51:12 crc kubenswrapper[5120]: I0316 15:51:12.908448 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/2b8e2567-77a1-4c2c-930c-785714326aba-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 15:51:12 crc kubenswrapper[5120]: I0316 15:51:12.908459 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2b8e2567-77a1-4c2c-930c-785714326aba-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:51:12 crc kubenswrapper[5120]: I0316 15:51:12.908516 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2b8e2567-77a1-4c2c-930c-785714326aba-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 15:51:12 crc kubenswrapper[5120]: I0316 15:51:12.908529 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2b8e2567-77a1-4c2c-930c-785714326aba-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 15:51:12 crc kubenswrapper[5120]: I0316 15:51:12.908542 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5bbhx\" (UniqueName: \"kubernetes.io/projected/2b8e2567-77a1-4c2c-930c-785714326aba-kube-api-access-5bbhx\") on node \"crc\" DevicePath \"\"" Mar 16 15:51:12 crc kubenswrapper[5120]: I0316 15:51:12.974875 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 15:51:12 crc kubenswrapper[5120]: W0316 15:51:12.984171 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8d66ce1a_7d4c_4e04_92c9_f86d5ad81fcc.slice/crio-85dac730ed07fc5583d198142766432292f3f059f6ca6f8a3261fe52ec1c4dae WatchSource:0}: Error finding container 85dac730ed07fc5583d198142766432292f3f059f6ca6f8a3261fe52ec1c4dae: Status 404 returned error can't find the container with id 85dac730ed07fc5583d198142766432292f3f059f6ca6f8a3261fe52ec1c4dae Mar 16 15:51:13 crc kubenswrapper[5120]: I0316 15:51:13.061298 5120 generic.go:358] "Generic (PLEG): container finished" podID="2b8e2567-77a1-4c2c-930c-785714326aba" containerID="739d3405378f4c1a76e93ce39cee573eed5465f23533719b6e3645831f51b9f0" exitCode=0 Mar 16 15:51:13 crc kubenswrapper[5120]: I0316 15:51:13.061435 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"2b8e2567-77a1-4c2c-930c-785714326aba","Type":"ContainerDied","Data":"739d3405378f4c1a76e93ce39cee573eed5465f23533719b6e3645831f51b9f0"} Mar 16 15:51:13 crc kubenswrapper[5120]: I0316 15:51:13.061813 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"2b8e2567-77a1-4c2c-930c-785714326aba","Type":"ContainerDied","Data":"245402bd3d05a97af2c8fb4d974641ae742622d5c6782e77b843e77200e09aa3"} Mar 16 15:51:13 crc kubenswrapper[5120]: I0316 15:51:13.061834 5120 scope.go:117] "RemoveContainer" containerID="ba3a80ce8c793cb6bea3569ac6d1c3db9250dd3cef83610e771310c42f0bd0d0" Mar 16 15:51:13 crc kubenswrapper[5120]: I0316 15:51:13.061498 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:51:13 crc kubenswrapper[5120]: I0316 15:51:13.064651 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"8d66ce1a-7d4c-4e04-92c9-f86d5ad81fcc","Type":"ContainerStarted","Data":"85dac730ed07fc5583d198142766432292f3f059f6ca6f8a3261fe52ec1c4dae"} Mar 16 15:51:13 crc kubenswrapper[5120]: I0316 15:51:13.068506 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-76b87c5788-h6qrd" event={"ID":"bcd3c028-eca6-4aaf-afb4-f0887af035e8","Type":"ContainerDied","Data":"278b4085784c33a3446da09fe07be6d7fbd999672e8095019efa7e49d1447c55"} Mar 16 15:51:13 crc kubenswrapper[5120]: I0316 15:51:13.068593 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-76b87c5788-h6qrd" Mar 16 15:51:13 crc kubenswrapper[5120]: I0316 15:51:13.088083 5120 scope.go:117] "RemoveContainer" containerID="152d2932cf6f6e7d6fb471b829f43f0e0ed317ec14c8f25b3517a806f58a0711" Mar 16 15:51:13 crc kubenswrapper[5120]: I0316 15:51:13.102084 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-76b87c5788-h6qrd"] Mar 16 15:51:13 crc kubenswrapper[5120]: I0316 15:51:13.108007 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-api-76b87c5788-h6qrd"] Mar 16 15:51:13 crc kubenswrapper[5120]: I0316 15:51:13.112244 5120 scope.go:117] "RemoveContainer" containerID="739d3405378f4c1a76e93ce39cee573eed5465f23533719b6e3645831f51b9f0" Mar 16 15:51:13 crc kubenswrapper[5120]: I0316 15:51:13.117458 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 15:51:13 crc kubenswrapper[5120]: I0316 15:51:13.128935 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 15:51:13 crc kubenswrapper[5120]: I0316 15:51:13.152459 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 15:51:13 crc kubenswrapper[5120]: I0316 15:51:13.153983 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bcd3c028-eca6-4aaf-afb4-f0887af035e8" containerName="barbican-api-log" Mar 16 15:51:13 crc kubenswrapper[5120]: I0316 15:51:13.154007 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="bcd3c028-eca6-4aaf-afb4-f0887af035e8" containerName="barbican-api-log" Mar 16 15:51:13 crc kubenswrapper[5120]: I0316 15:51:13.154038 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bcd3c028-eca6-4aaf-afb4-f0887af035e8" containerName="barbican-api" Mar 16 15:51:13 crc kubenswrapper[5120]: I0316 15:51:13.154046 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="bcd3c028-eca6-4aaf-afb4-f0887af035e8" containerName="barbican-api" Mar 16 15:51:13 crc kubenswrapper[5120]: I0316 15:51:13.154062 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b8e2567-77a1-4c2c-930c-785714326aba" containerName="ceilometer-notification-agent" Mar 16 15:51:13 crc kubenswrapper[5120]: I0316 15:51:13.154072 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b8e2567-77a1-4c2c-930c-785714326aba" containerName="ceilometer-notification-agent" Mar 16 15:51:13 crc kubenswrapper[5120]: I0316 15:51:13.154086 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b8e2567-77a1-4c2c-930c-785714326aba" containerName="proxy-httpd" Mar 16 15:51:13 crc kubenswrapper[5120]: I0316 15:51:13.154092 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b8e2567-77a1-4c2c-930c-785714326aba" containerName="proxy-httpd" Mar 16 15:51:13 crc kubenswrapper[5120]: I0316 15:51:13.154133 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b8e2567-77a1-4c2c-930c-785714326aba" containerName="sg-core" Mar 16 15:51:13 crc kubenswrapper[5120]: I0316 15:51:13.154144 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b8e2567-77a1-4c2c-930c-785714326aba" containerName="sg-core" Mar 16 15:51:13 crc kubenswrapper[5120]: I0316 15:51:13.154176 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b8e2567-77a1-4c2c-930c-785714326aba" containerName="ceilometer-central-agent" Mar 16 15:51:13 crc kubenswrapper[5120]: I0316 15:51:13.154182 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b8e2567-77a1-4c2c-930c-785714326aba" containerName="ceilometer-central-agent" Mar 16 15:51:13 crc kubenswrapper[5120]: I0316 15:51:13.154340 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="2b8e2567-77a1-4c2c-930c-785714326aba" containerName="ceilometer-central-agent" Mar 16 15:51:13 crc kubenswrapper[5120]: I0316 15:51:13.154389 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="bcd3c028-eca6-4aaf-afb4-f0887af035e8" containerName="barbican-api-log" Mar 16 15:51:13 crc kubenswrapper[5120]: I0316 15:51:13.154399 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="2b8e2567-77a1-4c2c-930c-785714326aba" containerName="ceilometer-notification-agent" Mar 16 15:51:13 crc kubenswrapper[5120]: I0316 15:51:13.154409 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="2b8e2567-77a1-4c2c-930c-785714326aba" containerName="proxy-httpd" Mar 16 15:51:13 crc kubenswrapper[5120]: I0316 15:51:13.154417 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="bcd3c028-eca6-4aaf-afb4-f0887af035e8" containerName="barbican-api" Mar 16 15:51:13 crc kubenswrapper[5120]: I0316 15:51:13.154432 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="2b8e2567-77a1-4c2c-930c-785714326aba" containerName="sg-core" Mar 16 15:51:13 crc kubenswrapper[5120]: I0316 15:51:13.166632 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:51:13 crc kubenswrapper[5120]: I0316 15:51:13.171537 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 15:51:13 crc kubenswrapper[5120]: I0316 15:51:13.171716 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 15:51:13 crc kubenswrapper[5120]: I0316 15:51:13.189512 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 15:51:13 crc kubenswrapper[5120]: I0316 15:51:13.200988 5120 scope.go:117] "RemoveContainer" containerID="8f3ec011338adacf108d112a9d9b0d1a3c3bf782a46642ee705a679d20e1ae51" Mar 16 15:51:13 crc kubenswrapper[5120]: I0316 15:51:13.214578 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/69b7941a-2f2b-4bc7-a7ea-26779c6290be-run-httpd\") pod \"ceilometer-0\" (UID: \"69b7941a-2f2b-4bc7-a7ea-26779c6290be\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:51:13 crc kubenswrapper[5120]: I0316 15:51:13.214686 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/69b7941a-2f2b-4bc7-a7ea-26779c6290be-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"69b7941a-2f2b-4bc7-a7ea-26779c6290be\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:51:13 crc kubenswrapper[5120]: I0316 15:51:13.214723 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/69b7941a-2f2b-4bc7-a7ea-26779c6290be-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"69b7941a-2f2b-4bc7-a7ea-26779c6290be\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:51:13 crc kubenswrapper[5120]: I0316 15:51:13.214955 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/69b7941a-2f2b-4bc7-a7ea-26779c6290be-log-httpd\") pod \"ceilometer-0\" (UID: \"69b7941a-2f2b-4bc7-a7ea-26779c6290be\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:51:13 crc kubenswrapper[5120]: I0316 15:51:13.215136 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wl652\" (UniqueName: \"kubernetes.io/projected/69b7941a-2f2b-4bc7-a7ea-26779c6290be-kube-api-access-wl652\") pod \"ceilometer-0\" (UID: \"69b7941a-2f2b-4bc7-a7ea-26779c6290be\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:51:13 crc kubenswrapper[5120]: I0316 15:51:13.215287 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/69b7941a-2f2b-4bc7-a7ea-26779c6290be-config-data\") pod \"ceilometer-0\" (UID: \"69b7941a-2f2b-4bc7-a7ea-26779c6290be\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:51:13 crc kubenswrapper[5120]: I0316 15:51:13.215418 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/69b7941a-2f2b-4bc7-a7ea-26779c6290be-scripts\") pod \"ceilometer-0\" (UID: \"69b7941a-2f2b-4bc7-a7ea-26779c6290be\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:51:13 crc kubenswrapper[5120]: I0316 15:51:13.220352 5120 scope.go:117] "RemoveContainer" containerID="ba3a80ce8c793cb6bea3569ac6d1c3db9250dd3cef83610e771310c42f0bd0d0" Mar 16 15:51:13 crc kubenswrapper[5120]: E0316 15:51:13.221645 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba3a80ce8c793cb6bea3569ac6d1c3db9250dd3cef83610e771310c42f0bd0d0\": container with ID starting with ba3a80ce8c793cb6bea3569ac6d1c3db9250dd3cef83610e771310c42f0bd0d0 not found: ID does not exist" containerID="ba3a80ce8c793cb6bea3569ac6d1c3db9250dd3cef83610e771310c42f0bd0d0" Mar 16 15:51:13 crc kubenswrapper[5120]: I0316 15:51:13.221685 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba3a80ce8c793cb6bea3569ac6d1c3db9250dd3cef83610e771310c42f0bd0d0"} err="failed to get container status \"ba3a80ce8c793cb6bea3569ac6d1c3db9250dd3cef83610e771310c42f0bd0d0\": rpc error: code = NotFound desc = could not find container \"ba3a80ce8c793cb6bea3569ac6d1c3db9250dd3cef83610e771310c42f0bd0d0\": container with ID starting with ba3a80ce8c793cb6bea3569ac6d1c3db9250dd3cef83610e771310c42f0bd0d0 not found: ID does not exist" Mar 16 15:51:13 crc kubenswrapper[5120]: I0316 15:51:13.221710 5120 scope.go:117] "RemoveContainer" containerID="152d2932cf6f6e7d6fb471b829f43f0e0ed317ec14c8f25b3517a806f58a0711" Mar 16 15:51:13 crc kubenswrapper[5120]: E0316 15:51:13.222110 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"152d2932cf6f6e7d6fb471b829f43f0e0ed317ec14c8f25b3517a806f58a0711\": container with ID starting with 152d2932cf6f6e7d6fb471b829f43f0e0ed317ec14c8f25b3517a806f58a0711 not found: ID does not exist" containerID="152d2932cf6f6e7d6fb471b829f43f0e0ed317ec14c8f25b3517a806f58a0711" Mar 16 15:51:13 crc kubenswrapper[5120]: I0316 15:51:13.222137 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"152d2932cf6f6e7d6fb471b829f43f0e0ed317ec14c8f25b3517a806f58a0711"} err="failed to get container status \"152d2932cf6f6e7d6fb471b829f43f0e0ed317ec14c8f25b3517a806f58a0711\": rpc error: code = NotFound desc = could not find container \"152d2932cf6f6e7d6fb471b829f43f0e0ed317ec14c8f25b3517a806f58a0711\": container with ID starting with 152d2932cf6f6e7d6fb471b829f43f0e0ed317ec14c8f25b3517a806f58a0711 not found: ID does not exist" Mar 16 15:51:13 crc kubenswrapper[5120]: I0316 15:51:13.222153 5120 scope.go:117] "RemoveContainer" containerID="739d3405378f4c1a76e93ce39cee573eed5465f23533719b6e3645831f51b9f0" Mar 16 15:51:13 crc kubenswrapper[5120]: E0316 15:51:13.222424 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"739d3405378f4c1a76e93ce39cee573eed5465f23533719b6e3645831f51b9f0\": container with ID starting with 739d3405378f4c1a76e93ce39cee573eed5465f23533719b6e3645831f51b9f0 not found: ID does not exist" containerID="739d3405378f4c1a76e93ce39cee573eed5465f23533719b6e3645831f51b9f0" Mar 16 15:51:13 crc kubenswrapper[5120]: I0316 15:51:13.222445 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"739d3405378f4c1a76e93ce39cee573eed5465f23533719b6e3645831f51b9f0"} err="failed to get container status \"739d3405378f4c1a76e93ce39cee573eed5465f23533719b6e3645831f51b9f0\": rpc error: code = NotFound desc = could not find container \"739d3405378f4c1a76e93ce39cee573eed5465f23533719b6e3645831f51b9f0\": container with ID starting with 739d3405378f4c1a76e93ce39cee573eed5465f23533719b6e3645831f51b9f0 not found: ID does not exist" Mar 16 15:51:13 crc kubenswrapper[5120]: I0316 15:51:13.222458 5120 scope.go:117] "RemoveContainer" containerID="8f3ec011338adacf108d112a9d9b0d1a3c3bf782a46642ee705a679d20e1ae51" Mar 16 15:51:13 crc kubenswrapper[5120]: E0316 15:51:13.222739 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f3ec011338adacf108d112a9d9b0d1a3c3bf782a46642ee705a679d20e1ae51\": container with ID starting with 8f3ec011338adacf108d112a9d9b0d1a3c3bf782a46642ee705a679d20e1ae51 not found: ID does not exist" containerID="8f3ec011338adacf108d112a9d9b0d1a3c3bf782a46642ee705a679d20e1ae51" Mar 16 15:51:13 crc kubenswrapper[5120]: I0316 15:51:13.222906 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f3ec011338adacf108d112a9d9b0d1a3c3bf782a46642ee705a679d20e1ae51"} err="failed to get container status \"8f3ec011338adacf108d112a9d9b0d1a3c3bf782a46642ee705a679d20e1ae51\": rpc error: code = NotFound desc = could not find container \"8f3ec011338adacf108d112a9d9b0d1a3c3bf782a46642ee705a679d20e1ae51\": container with ID starting with 8f3ec011338adacf108d112a9d9b0d1a3c3bf782a46642ee705a679d20e1ae51 not found: ID does not exist" Mar 16 15:51:13 crc kubenswrapper[5120]: I0316 15:51:13.222944 5120 scope.go:117] "RemoveContainer" containerID="0173ba7a44d2f4d71b00b887d464f59a9e13d78af4744e9bb2d93a6819823274" Mar 16 15:51:13 crc kubenswrapper[5120]: I0316 15:51:13.250606 5120 scope.go:117] "RemoveContainer" containerID="6ee6932cdb77d06a62649b97408355f2022176de3f511c922e65a0dae8f9c58f" Mar 16 15:51:13 crc kubenswrapper[5120]: I0316 15:51:13.317127 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/69b7941a-2f2b-4bc7-a7ea-26779c6290be-run-httpd\") pod \"ceilometer-0\" (UID: \"69b7941a-2f2b-4bc7-a7ea-26779c6290be\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:51:13 crc kubenswrapper[5120]: I0316 15:51:13.317183 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/69b7941a-2f2b-4bc7-a7ea-26779c6290be-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"69b7941a-2f2b-4bc7-a7ea-26779c6290be\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:51:13 crc kubenswrapper[5120]: I0316 15:51:13.317227 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/69b7941a-2f2b-4bc7-a7ea-26779c6290be-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"69b7941a-2f2b-4bc7-a7ea-26779c6290be\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:51:13 crc kubenswrapper[5120]: I0316 15:51:13.317314 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/69b7941a-2f2b-4bc7-a7ea-26779c6290be-log-httpd\") pod \"ceilometer-0\" (UID: \"69b7941a-2f2b-4bc7-a7ea-26779c6290be\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:51:13 crc kubenswrapper[5120]: I0316 15:51:13.317367 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wl652\" (UniqueName: \"kubernetes.io/projected/69b7941a-2f2b-4bc7-a7ea-26779c6290be-kube-api-access-wl652\") pod \"ceilometer-0\" (UID: \"69b7941a-2f2b-4bc7-a7ea-26779c6290be\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:51:13 crc kubenswrapper[5120]: I0316 15:51:13.317410 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/69b7941a-2f2b-4bc7-a7ea-26779c6290be-config-data\") pod \"ceilometer-0\" (UID: \"69b7941a-2f2b-4bc7-a7ea-26779c6290be\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:51:13 crc kubenswrapper[5120]: I0316 15:51:13.317462 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/69b7941a-2f2b-4bc7-a7ea-26779c6290be-scripts\") pod \"ceilometer-0\" (UID: \"69b7941a-2f2b-4bc7-a7ea-26779c6290be\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:51:13 crc kubenswrapper[5120]: I0316 15:51:13.317711 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/69b7941a-2f2b-4bc7-a7ea-26779c6290be-run-httpd\") pod \"ceilometer-0\" (UID: \"69b7941a-2f2b-4bc7-a7ea-26779c6290be\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:51:13 crc kubenswrapper[5120]: I0316 15:51:13.317794 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/69b7941a-2f2b-4bc7-a7ea-26779c6290be-log-httpd\") pod \"ceilometer-0\" (UID: \"69b7941a-2f2b-4bc7-a7ea-26779c6290be\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:51:13 crc kubenswrapper[5120]: I0316 15:51:13.325076 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/69b7941a-2f2b-4bc7-a7ea-26779c6290be-config-data\") pod \"ceilometer-0\" (UID: \"69b7941a-2f2b-4bc7-a7ea-26779c6290be\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:51:13 crc kubenswrapper[5120]: I0316 15:51:13.327430 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/69b7941a-2f2b-4bc7-a7ea-26779c6290be-scripts\") pod \"ceilometer-0\" (UID: \"69b7941a-2f2b-4bc7-a7ea-26779c6290be\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:51:13 crc kubenswrapper[5120]: I0316 15:51:13.334545 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/69b7941a-2f2b-4bc7-a7ea-26779c6290be-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"69b7941a-2f2b-4bc7-a7ea-26779c6290be\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:51:13 crc kubenswrapper[5120]: I0316 15:51:13.337233 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/69b7941a-2f2b-4bc7-a7ea-26779c6290be-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"69b7941a-2f2b-4bc7-a7ea-26779c6290be\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:51:13 crc kubenswrapper[5120]: I0316 15:51:13.337645 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wl652\" (UniqueName: \"kubernetes.io/projected/69b7941a-2f2b-4bc7-a7ea-26779c6290be-kube-api-access-wl652\") pod \"ceilometer-0\" (UID: \"69b7941a-2f2b-4bc7-a7ea-26779c6290be\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:51:13 crc kubenswrapper[5120]: I0316 15:51:13.489625 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:51:13 crc kubenswrapper[5120]: I0316 15:51:13.934650 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 15:51:13 crc kubenswrapper[5120]: W0316 15:51:13.950614 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod69b7941a_2f2b_4bc7_a7ea_26779c6290be.slice/crio-d2c9e35521a49387396f1d31858f711acaf1bc5959bdaae5f8edb9152e2cade6 WatchSource:0}: Error finding container d2c9e35521a49387396f1d31858f711acaf1bc5959bdaae5f8edb9152e2cade6: Status 404 returned error can't find the container with id d2c9e35521a49387396f1d31858f711acaf1bc5959bdaae5f8edb9152e2cade6 Mar 16 15:51:14 crc kubenswrapper[5120]: I0316 15:51:14.085418 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"8d66ce1a-7d4c-4e04-92c9-f86d5ad81fcc","Type":"ContainerStarted","Data":"042e41e723df73b7e7f87e1bf90037fae0d3bd03bbc5432d058acb72b29f7255"} Mar 16 15:51:14 crc kubenswrapper[5120]: I0316 15:51:14.086616 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"69b7941a-2f2b-4bc7-a7ea-26779c6290be","Type":"ContainerStarted","Data":"d2c9e35521a49387396f1d31858f711acaf1bc5959bdaae5f8edb9152e2cade6"} Mar 16 15:51:14 crc kubenswrapper[5120]: I0316 15:51:14.688419 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b8e2567-77a1-4c2c-930c-785714326aba" path="/var/lib/kubelet/pods/2b8e2567-77a1-4c2c-930c-785714326aba/volumes" Mar 16 15:51:14 crc kubenswrapper[5120]: I0316 15:51:14.690990 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bcd3c028-eca6-4aaf-afb4-f0887af035e8" path="/var/lib/kubelet/pods/bcd3c028-eca6-4aaf-afb4-f0887af035e8/volumes" Mar 16 15:51:15 crc kubenswrapper[5120]: I0316 15:51:15.106168 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"69b7941a-2f2b-4bc7-a7ea-26779c6290be","Type":"ContainerStarted","Data":"5c47d3822ef7eca611c566b39bf21601bca85f11c46674c55009028019d21d7e"} Mar 16 15:51:15 crc kubenswrapper[5120]: I0316 15:51:15.109292 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"8d66ce1a-7d4c-4e04-92c9-f86d5ad81fcc","Type":"ContainerStarted","Data":"3f7dde81452f0221434f72a3271f62d13dc8d444913ffecdd1876e8ea04f3e0d"} Mar 16 15:51:15 crc kubenswrapper[5120]: I0316 15:51:15.127559 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-scheduler-0" podStartSLOduration=3.127528873 podStartE2EDuration="3.127528873s" podCreationTimestamp="2026-03-16 15:51:12 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:51:15.124497923 +0000 UTC m=+1177.278429590" watchObservedRunningTime="2026-03-16 15:51:15.127528873 +0000 UTC m=+1177.281460530" Mar 16 15:51:16 crc kubenswrapper[5120]: I0316 15:51:16.119089 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"69b7941a-2f2b-4bc7-a7ea-26779c6290be","Type":"ContainerStarted","Data":"71fab194b740faa6b610d32a33d4c742bd62819409add49d7708a73b2a300c04"} Mar 16 15:51:16 crc kubenswrapper[5120]: I0316 15:51:16.441543 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/neutron-56d94b8cdc-8zpvc" Mar 16 15:51:16 crc kubenswrapper[5120]: I0316 15:51:16.680547 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-7f6c9f6f6b-qv54h"] Mar 16 15:51:16 crc kubenswrapper[5120]: I0316 15:51:16.682190 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-7f6c9f6f6b-qv54h" podUID="8fdf4d7a-1d6c-47e3-a8c4-e0900e78ef51" containerName="neutron-api" containerID="cri-o://7560f268f978a4e61823149834cb56d5c6a3ab23c787810da375f01c548d3410" gracePeriod=30 Mar 16 15:51:16 crc kubenswrapper[5120]: I0316 15:51:16.682517 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-7f6c9f6f6b-qv54h" podUID="8fdf4d7a-1d6c-47e3-a8c4-e0900e78ef51" containerName="neutron-httpd" containerID="cri-o://b33de3cddb1596a233d277fc122981f66f0fd8c7d985bbca12755aaf0bafe2de" gracePeriod=30 Mar 16 15:51:16 crc kubenswrapper[5120]: I0316 15:51:16.694544 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/neutron-7f6c9f6f6b-qv54h" podUID="8fdf4d7a-1d6c-47e3-a8c4-e0900e78ef51" containerName="neutron-httpd" probeResult="failure" output="Get \"https://10.217.0.145:9696/\": read tcp 10.217.0.2:55318->10.217.0.145:9696: read: connection reset by peer" Mar 16 15:51:16 crc kubenswrapper[5120]: I0316 15:51:16.711955 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-85b4fd4946-cqqk6"] Mar 16 15:51:17 crc kubenswrapper[5120]: I0316 15:51:17.010477 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-85b4fd4946-cqqk6"] Mar 16 15:51:17 crc kubenswrapper[5120]: I0316 15:51:17.010684 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-85b4fd4946-cqqk6" Mar 16 15:51:17 crc kubenswrapper[5120]: I0316 15:51:17.085558 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-76b87c5788-h6qrd" podUID="bcd3c028-eca6-4aaf-afb4-f0887af035e8" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.0.150:9311/healthcheck\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Mar 16 15:51:17 crc kubenswrapper[5120]: I0316 15:51:17.095397 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/72332d22-b98a-420f-b6ce-66d22d70566b-public-tls-certs\") pod \"neutron-85b4fd4946-cqqk6\" (UID: \"72332d22-b98a-420f-b6ce-66d22d70566b\") " pod="openstack-kuttl-tests/neutron-85b4fd4946-cqqk6" Mar 16 15:51:17 crc kubenswrapper[5120]: I0316 15:51:17.095499 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/72332d22-b98a-420f-b6ce-66d22d70566b-combined-ca-bundle\") pod \"neutron-85b4fd4946-cqqk6\" (UID: \"72332d22-b98a-420f-b6ce-66d22d70566b\") " pod="openstack-kuttl-tests/neutron-85b4fd4946-cqqk6" Mar 16 15:51:17 crc kubenswrapper[5120]: I0316 15:51:17.095540 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/72332d22-b98a-420f-b6ce-66d22d70566b-httpd-config\") pod \"neutron-85b4fd4946-cqqk6\" (UID: \"72332d22-b98a-420f-b6ce-66d22d70566b\") " pod="openstack-kuttl-tests/neutron-85b4fd4946-cqqk6" Mar 16 15:51:17 crc kubenswrapper[5120]: I0316 15:51:17.095689 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mt5xf\" (UniqueName: \"kubernetes.io/projected/72332d22-b98a-420f-b6ce-66d22d70566b-kube-api-access-mt5xf\") pod \"neutron-85b4fd4946-cqqk6\" (UID: \"72332d22-b98a-420f-b6ce-66d22d70566b\") " pod="openstack-kuttl-tests/neutron-85b4fd4946-cqqk6" Mar 16 15:51:17 crc kubenswrapper[5120]: I0316 15:51:17.095741 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/72332d22-b98a-420f-b6ce-66d22d70566b-internal-tls-certs\") pod \"neutron-85b4fd4946-cqqk6\" (UID: \"72332d22-b98a-420f-b6ce-66d22d70566b\") " pod="openstack-kuttl-tests/neutron-85b4fd4946-cqqk6" Mar 16 15:51:17 crc kubenswrapper[5120]: I0316 15:51:17.095799 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/72332d22-b98a-420f-b6ce-66d22d70566b-ovndb-tls-certs\") pod \"neutron-85b4fd4946-cqqk6\" (UID: \"72332d22-b98a-420f-b6ce-66d22d70566b\") " pod="openstack-kuttl-tests/neutron-85b4fd4946-cqqk6" Mar 16 15:51:17 crc kubenswrapper[5120]: I0316 15:51:17.095870 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/72332d22-b98a-420f-b6ce-66d22d70566b-config\") pod \"neutron-85b4fd4946-cqqk6\" (UID: \"72332d22-b98a-420f-b6ce-66d22d70566b\") " pod="openstack-kuttl-tests/neutron-85b4fd4946-cqqk6" Mar 16 15:51:17 crc kubenswrapper[5120]: I0316 15:51:17.144394 5120 generic.go:358] "Generic (PLEG): container finished" podID="8fdf4d7a-1d6c-47e3-a8c4-e0900e78ef51" containerID="b33de3cddb1596a233d277fc122981f66f0fd8c7d985bbca12755aaf0bafe2de" exitCode=0 Mar 16 15:51:17 crc kubenswrapper[5120]: I0316 15:51:17.144813 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-7f6c9f6f6b-qv54h" event={"ID":"8fdf4d7a-1d6c-47e3-a8c4-e0900e78ef51","Type":"ContainerDied","Data":"b33de3cddb1596a233d277fc122981f66f0fd8c7d985bbca12755aaf0bafe2de"} Mar 16 15:51:17 crc kubenswrapper[5120]: I0316 15:51:17.197607 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/72332d22-b98a-420f-b6ce-66d22d70566b-public-tls-certs\") pod \"neutron-85b4fd4946-cqqk6\" (UID: \"72332d22-b98a-420f-b6ce-66d22d70566b\") " pod="openstack-kuttl-tests/neutron-85b4fd4946-cqqk6" Mar 16 15:51:17 crc kubenswrapper[5120]: I0316 15:51:17.197693 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/72332d22-b98a-420f-b6ce-66d22d70566b-combined-ca-bundle\") pod \"neutron-85b4fd4946-cqqk6\" (UID: \"72332d22-b98a-420f-b6ce-66d22d70566b\") " pod="openstack-kuttl-tests/neutron-85b4fd4946-cqqk6" Mar 16 15:51:17 crc kubenswrapper[5120]: I0316 15:51:17.197889 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/72332d22-b98a-420f-b6ce-66d22d70566b-httpd-config\") pod \"neutron-85b4fd4946-cqqk6\" (UID: \"72332d22-b98a-420f-b6ce-66d22d70566b\") " pod="openstack-kuttl-tests/neutron-85b4fd4946-cqqk6" Mar 16 15:51:17 crc kubenswrapper[5120]: I0316 15:51:17.199433 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mt5xf\" (UniqueName: \"kubernetes.io/projected/72332d22-b98a-420f-b6ce-66d22d70566b-kube-api-access-mt5xf\") pod \"neutron-85b4fd4946-cqqk6\" (UID: \"72332d22-b98a-420f-b6ce-66d22d70566b\") " pod="openstack-kuttl-tests/neutron-85b4fd4946-cqqk6" Mar 16 15:51:17 crc kubenswrapper[5120]: I0316 15:51:17.199474 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/72332d22-b98a-420f-b6ce-66d22d70566b-internal-tls-certs\") pod \"neutron-85b4fd4946-cqqk6\" (UID: \"72332d22-b98a-420f-b6ce-66d22d70566b\") " pod="openstack-kuttl-tests/neutron-85b4fd4946-cqqk6" Mar 16 15:51:17 crc kubenswrapper[5120]: I0316 15:51:17.199495 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/72332d22-b98a-420f-b6ce-66d22d70566b-ovndb-tls-certs\") pod \"neutron-85b4fd4946-cqqk6\" (UID: \"72332d22-b98a-420f-b6ce-66d22d70566b\") " pod="openstack-kuttl-tests/neutron-85b4fd4946-cqqk6" Mar 16 15:51:17 crc kubenswrapper[5120]: I0316 15:51:17.199557 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/72332d22-b98a-420f-b6ce-66d22d70566b-config\") pod \"neutron-85b4fd4946-cqqk6\" (UID: \"72332d22-b98a-420f-b6ce-66d22d70566b\") " pod="openstack-kuttl-tests/neutron-85b4fd4946-cqqk6" Mar 16 15:51:17 crc kubenswrapper[5120]: I0316 15:51:17.203861 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/72332d22-b98a-420f-b6ce-66d22d70566b-combined-ca-bundle\") pod \"neutron-85b4fd4946-cqqk6\" (UID: \"72332d22-b98a-420f-b6ce-66d22d70566b\") " pod="openstack-kuttl-tests/neutron-85b4fd4946-cqqk6" Mar 16 15:51:17 crc kubenswrapper[5120]: I0316 15:51:17.204118 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/72332d22-b98a-420f-b6ce-66d22d70566b-public-tls-certs\") pod \"neutron-85b4fd4946-cqqk6\" (UID: \"72332d22-b98a-420f-b6ce-66d22d70566b\") " pod="openstack-kuttl-tests/neutron-85b4fd4946-cqqk6" Mar 16 15:51:17 crc kubenswrapper[5120]: I0316 15:51:17.210543 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/72332d22-b98a-420f-b6ce-66d22d70566b-ovndb-tls-certs\") pod \"neutron-85b4fd4946-cqqk6\" (UID: \"72332d22-b98a-420f-b6ce-66d22d70566b\") " pod="openstack-kuttl-tests/neutron-85b4fd4946-cqqk6" Mar 16 15:51:17 crc kubenswrapper[5120]: I0316 15:51:17.230637 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mt5xf\" (UniqueName: \"kubernetes.io/projected/72332d22-b98a-420f-b6ce-66d22d70566b-kube-api-access-mt5xf\") pod \"neutron-85b4fd4946-cqqk6\" (UID: \"72332d22-b98a-420f-b6ce-66d22d70566b\") " pod="openstack-kuttl-tests/neutron-85b4fd4946-cqqk6" Mar 16 15:51:17 crc kubenswrapper[5120]: I0316 15:51:17.235656 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/72332d22-b98a-420f-b6ce-66d22d70566b-config\") pod \"neutron-85b4fd4946-cqqk6\" (UID: \"72332d22-b98a-420f-b6ce-66d22d70566b\") " pod="openstack-kuttl-tests/neutron-85b4fd4946-cqqk6" Mar 16 15:51:17 crc kubenswrapper[5120]: I0316 15:51:17.246881 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/72332d22-b98a-420f-b6ce-66d22d70566b-httpd-config\") pod \"neutron-85b4fd4946-cqqk6\" (UID: \"72332d22-b98a-420f-b6ce-66d22d70566b\") " pod="openstack-kuttl-tests/neutron-85b4fd4946-cqqk6" Mar 16 15:51:17 crc kubenswrapper[5120]: I0316 15:51:17.250416 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/72332d22-b98a-420f-b6ce-66d22d70566b-internal-tls-certs\") pod \"neutron-85b4fd4946-cqqk6\" (UID: \"72332d22-b98a-420f-b6ce-66d22d70566b\") " pod="openstack-kuttl-tests/neutron-85b4fd4946-cqqk6" Mar 16 15:51:17 crc kubenswrapper[5120]: I0316 15:51:17.332995 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-85b4fd4946-cqqk6" Mar 16 15:51:17 crc kubenswrapper[5120]: I0316 15:51:17.521325 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 15:51:17 crc kubenswrapper[5120]: I0316 15:51:17.790461 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-85b4fd4946-cqqk6"] Mar 16 15:51:17 crc kubenswrapper[5120]: W0316 15:51:17.795850 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod72332d22_b98a_420f_b6ce_66d22d70566b.slice/crio-e78311483b2de15358f397e2dfb02ed4f82236b7fc38844fad92bc904f9c3534 WatchSource:0}: Error finding container e78311483b2de15358f397e2dfb02ed4f82236b7fc38844fad92bc904f9c3534: Status 404 returned error can't find the container with id e78311483b2de15358f397e2dfb02ed4f82236b7fc38844fad92bc904f9c3534 Mar 16 15:51:18 crc kubenswrapper[5120]: I0316 15:51:18.157452 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-85b4fd4946-cqqk6" event={"ID":"72332d22-b98a-420f-b6ce-66d22d70566b","Type":"ContainerStarted","Data":"9940d1b5e7f2bb8e9549d3743c8a6e48257c84e180a8c46e9f5477a9d73d29ce"} Mar 16 15:51:18 crc kubenswrapper[5120]: I0316 15:51:18.157743 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-85b4fd4946-cqqk6" event={"ID":"72332d22-b98a-420f-b6ce-66d22d70566b","Type":"ContainerStarted","Data":"e78311483b2de15358f397e2dfb02ed4f82236b7fc38844fad92bc904f9c3534"} Mar 16 15:51:18 crc kubenswrapper[5120]: I0316 15:51:18.159987 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"69b7941a-2f2b-4bc7-a7ea-26779c6290be","Type":"ContainerStarted","Data":"251a89b692cafb8fe92540f83e5e12c7475d00c13010c6d31bab8b2657e40c4f"} Mar 16 15:51:19 crc kubenswrapper[5120]: I0316 15:51:19.171340 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-85b4fd4946-cqqk6" event={"ID":"72332d22-b98a-420f-b6ce-66d22d70566b","Type":"ContainerStarted","Data":"5f2c32a9433767dc6b404267c0200ca020edcba7ea995cde3eb8bedf0cf26bf8"} Mar 16 15:51:19 crc kubenswrapper[5120]: I0316 15:51:19.171882 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/neutron-85b4fd4946-cqqk6" Mar 16 15:51:19 crc kubenswrapper[5120]: I0316 15:51:19.210342 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-85b4fd4946-cqqk6" podStartSLOduration=3.21032077 podStartE2EDuration="3.21032077s" podCreationTimestamp="2026-03-16 15:51:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:51:19.202743523 +0000 UTC m=+1181.356675190" watchObservedRunningTime="2026-03-16 15:51:19.21032077 +0000 UTC m=+1181.364252427" Mar 16 15:51:19 crc kubenswrapper[5120]: I0316 15:51:19.658019 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-7f6c9f6f6b-qv54h" Mar 16 15:51:19 crc kubenswrapper[5120]: I0316 15:51:19.842404 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/8fdf4d7a-1d6c-47e3-a8c4-e0900e78ef51-httpd-config\") pod \"8fdf4d7a-1d6c-47e3-a8c4-e0900e78ef51\" (UID: \"8fdf4d7a-1d6c-47e3-a8c4-e0900e78ef51\") " Mar 16 15:51:19 crc kubenswrapper[5120]: I0316 15:51:19.843212 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-522pm\" (UniqueName: \"kubernetes.io/projected/8fdf4d7a-1d6c-47e3-a8c4-e0900e78ef51-kube-api-access-522pm\") pod \"8fdf4d7a-1d6c-47e3-a8c4-e0900e78ef51\" (UID: \"8fdf4d7a-1d6c-47e3-a8c4-e0900e78ef51\") " Mar 16 15:51:19 crc kubenswrapper[5120]: I0316 15:51:19.843298 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/8fdf4d7a-1d6c-47e3-a8c4-e0900e78ef51-ovndb-tls-certs\") pod \"8fdf4d7a-1d6c-47e3-a8c4-e0900e78ef51\" (UID: \"8fdf4d7a-1d6c-47e3-a8c4-e0900e78ef51\") " Mar 16 15:51:19 crc kubenswrapper[5120]: I0316 15:51:19.843323 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8fdf4d7a-1d6c-47e3-a8c4-e0900e78ef51-combined-ca-bundle\") pod \"8fdf4d7a-1d6c-47e3-a8c4-e0900e78ef51\" (UID: \"8fdf4d7a-1d6c-47e3-a8c4-e0900e78ef51\") " Mar 16 15:51:19 crc kubenswrapper[5120]: I0316 15:51:19.843367 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8fdf4d7a-1d6c-47e3-a8c4-e0900e78ef51-config\") pod \"8fdf4d7a-1d6c-47e3-a8c4-e0900e78ef51\" (UID: \"8fdf4d7a-1d6c-47e3-a8c4-e0900e78ef51\") " Mar 16 15:51:19 crc kubenswrapper[5120]: I0316 15:51:19.843653 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/8fdf4d7a-1d6c-47e3-a8c4-e0900e78ef51-public-tls-certs\") pod \"8fdf4d7a-1d6c-47e3-a8c4-e0900e78ef51\" (UID: \"8fdf4d7a-1d6c-47e3-a8c4-e0900e78ef51\") " Mar 16 15:51:19 crc kubenswrapper[5120]: I0316 15:51:19.843678 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/8fdf4d7a-1d6c-47e3-a8c4-e0900e78ef51-internal-tls-certs\") pod \"8fdf4d7a-1d6c-47e3-a8c4-e0900e78ef51\" (UID: \"8fdf4d7a-1d6c-47e3-a8c4-e0900e78ef51\") " Mar 16 15:51:19 crc kubenswrapper[5120]: I0316 15:51:19.849964 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8fdf4d7a-1d6c-47e3-a8c4-e0900e78ef51-kube-api-access-522pm" (OuterVolumeSpecName: "kube-api-access-522pm") pod "8fdf4d7a-1d6c-47e3-a8c4-e0900e78ef51" (UID: "8fdf4d7a-1d6c-47e3-a8c4-e0900e78ef51"). InnerVolumeSpecName "kube-api-access-522pm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:51:19 crc kubenswrapper[5120]: I0316 15:51:19.853945 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8fdf4d7a-1d6c-47e3-a8c4-e0900e78ef51-httpd-config" (OuterVolumeSpecName: "httpd-config") pod "8fdf4d7a-1d6c-47e3-a8c4-e0900e78ef51" (UID: "8fdf4d7a-1d6c-47e3-a8c4-e0900e78ef51"). InnerVolumeSpecName "httpd-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:51:19 crc kubenswrapper[5120]: I0316 15:51:19.928964 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8fdf4d7a-1d6c-47e3-a8c4-e0900e78ef51-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "8fdf4d7a-1d6c-47e3-a8c4-e0900e78ef51" (UID: "8fdf4d7a-1d6c-47e3-a8c4-e0900e78ef51"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:51:19 crc kubenswrapper[5120]: I0316 15:51:19.948970 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8fdf4d7a-1d6c-47e3-a8c4-e0900e78ef51-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "8fdf4d7a-1d6c-47e3-a8c4-e0900e78ef51" (UID: "8fdf4d7a-1d6c-47e3-a8c4-e0900e78ef51"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:51:19 crc kubenswrapper[5120]: I0316 15:51:19.950123 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/8fdf4d7a-1d6c-47e3-a8c4-e0900e78ef51-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 15:51:19 crc kubenswrapper[5120]: I0316 15:51:19.950142 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/8fdf4d7a-1d6c-47e3-a8c4-e0900e78ef51-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 15:51:19 crc kubenswrapper[5120]: I0316 15:51:19.950153 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/8fdf4d7a-1d6c-47e3-a8c4-e0900e78ef51-httpd-config\") on node \"crc\" DevicePath \"\"" Mar 16 15:51:19 crc kubenswrapper[5120]: I0316 15:51:19.950164 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-522pm\" (UniqueName: \"kubernetes.io/projected/8fdf4d7a-1d6c-47e3-a8c4-e0900e78ef51-kube-api-access-522pm\") on node \"crc\" DevicePath \"\"" Mar 16 15:51:19 crc kubenswrapper[5120]: I0316 15:51:19.953129 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8fdf4d7a-1d6c-47e3-a8c4-e0900e78ef51-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "8fdf4d7a-1d6c-47e3-a8c4-e0900e78ef51" (UID: "8fdf4d7a-1d6c-47e3-a8c4-e0900e78ef51"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:51:19 crc kubenswrapper[5120]: I0316 15:51:19.968991 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8fdf4d7a-1d6c-47e3-a8c4-e0900e78ef51-config" (OuterVolumeSpecName: "config") pod "8fdf4d7a-1d6c-47e3-a8c4-e0900e78ef51" (UID: "8fdf4d7a-1d6c-47e3-a8c4-e0900e78ef51"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:51:19 crc kubenswrapper[5120]: I0316 15:51:19.978777 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8fdf4d7a-1d6c-47e3-a8c4-e0900e78ef51-ovndb-tls-certs" (OuterVolumeSpecName: "ovndb-tls-certs") pod "8fdf4d7a-1d6c-47e3-a8c4-e0900e78ef51" (UID: "8fdf4d7a-1d6c-47e3-a8c4-e0900e78ef51"). InnerVolumeSpecName "ovndb-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:51:20 crc kubenswrapper[5120]: I0316 15:51:20.051737 5120 reconciler_common.go:299] "Volume detached for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/8fdf4d7a-1d6c-47e3-a8c4-e0900e78ef51-ovndb-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 15:51:20 crc kubenswrapper[5120]: I0316 15:51:20.051792 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8fdf4d7a-1d6c-47e3-a8c4-e0900e78ef51-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:51:20 crc kubenswrapper[5120]: I0316 15:51:20.051803 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/8fdf4d7a-1d6c-47e3-a8c4-e0900e78ef51-config\") on node \"crc\" DevicePath \"\"" Mar 16 15:51:20 crc kubenswrapper[5120]: I0316 15:51:20.196894 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"69b7941a-2f2b-4bc7-a7ea-26779c6290be","Type":"ContainerStarted","Data":"b385c5993c7b727c871b9b6a3fcfd8b38449eabdfcf6b0e1142912060e044b89"} Mar 16 15:51:20 crc kubenswrapper[5120]: I0316 15:51:20.196995 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:51:20 crc kubenswrapper[5120]: I0316 15:51:20.207267 5120 generic.go:358] "Generic (PLEG): container finished" podID="8fdf4d7a-1d6c-47e3-a8c4-e0900e78ef51" containerID="7560f268f978a4e61823149834cb56d5c6a3ab23c787810da375f01c548d3410" exitCode=0 Mar 16 15:51:20 crc kubenswrapper[5120]: I0316 15:51:20.207738 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-7f6c9f6f6b-qv54h" Mar 16 15:51:20 crc kubenswrapper[5120]: I0316 15:51:20.208287 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-7f6c9f6f6b-qv54h" event={"ID":"8fdf4d7a-1d6c-47e3-a8c4-e0900e78ef51","Type":"ContainerDied","Data":"7560f268f978a4e61823149834cb56d5c6a3ab23c787810da375f01c548d3410"} Mar 16 15:51:20 crc kubenswrapper[5120]: I0316 15:51:20.208346 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-7f6c9f6f6b-qv54h" event={"ID":"8fdf4d7a-1d6c-47e3-a8c4-e0900e78ef51","Type":"ContainerDied","Data":"1e34796042848d51ac0ac3651832efe01f865c302cd13cfb64e0d04caeaa54e8"} Mar 16 15:51:20 crc kubenswrapper[5120]: I0316 15:51:20.208370 5120 scope.go:117] "RemoveContainer" containerID="b33de3cddb1596a233d277fc122981f66f0fd8c7d985bbca12755aaf0bafe2de" Mar 16 15:51:20 crc kubenswrapper[5120]: I0316 15:51:20.223589 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=1.503404985 podStartE2EDuration="7.223567904s" podCreationTimestamp="2026-03-16 15:51:13 +0000 UTC" firstStartedPulling="2026-03-16 15:51:13.952998815 +0000 UTC m=+1176.106930472" lastFinishedPulling="2026-03-16 15:51:19.673161734 +0000 UTC m=+1181.827093391" observedRunningTime="2026-03-16 15:51:20.220386409 +0000 UTC m=+1182.374318076" watchObservedRunningTime="2026-03-16 15:51:20.223567904 +0000 UTC m=+1182.377499561" Mar 16 15:51:20 crc kubenswrapper[5120]: I0316 15:51:20.236962 5120 scope.go:117] "RemoveContainer" containerID="7560f268f978a4e61823149834cb56d5c6a3ab23c787810da375f01c548d3410" Mar 16 15:51:20 crc kubenswrapper[5120]: I0316 15:51:20.260873 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-7f6c9f6f6b-qv54h"] Mar 16 15:51:20 crc kubenswrapper[5120]: I0316 15:51:20.267707 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-7f6c9f6f6b-qv54h"] Mar 16 15:51:20 crc kubenswrapper[5120]: I0316 15:51:20.269990 5120 scope.go:117] "RemoveContainer" containerID="b33de3cddb1596a233d277fc122981f66f0fd8c7d985bbca12755aaf0bafe2de" Mar 16 15:51:20 crc kubenswrapper[5120]: E0316 15:51:20.270532 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b33de3cddb1596a233d277fc122981f66f0fd8c7d985bbca12755aaf0bafe2de\": container with ID starting with b33de3cddb1596a233d277fc122981f66f0fd8c7d985bbca12755aaf0bafe2de not found: ID does not exist" containerID="b33de3cddb1596a233d277fc122981f66f0fd8c7d985bbca12755aaf0bafe2de" Mar 16 15:51:20 crc kubenswrapper[5120]: I0316 15:51:20.270562 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b33de3cddb1596a233d277fc122981f66f0fd8c7d985bbca12755aaf0bafe2de"} err="failed to get container status \"b33de3cddb1596a233d277fc122981f66f0fd8c7d985bbca12755aaf0bafe2de\": rpc error: code = NotFound desc = could not find container \"b33de3cddb1596a233d277fc122981f66f0fd8c7d985bbca12755aaf0bafe2de\": container with ID starting with b33de3cddb1596a233d277fc122981f66f0fd8c7d985bbca12755aaf0bafe2de not found: ID does not exist" Mar 16 15:51:20 crc kubenswrapper[5120]: I0316 15:51:20.270580 5120 scope.go:117] "RemoveContainer" containerID="7560f268f978a4e61823149834cb56d5c6a3ab23c787810da375f01c548d3410" Mar 16 15:51:20 crc kubenswrapper[5120]: E0316 15:51:20.270886 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7560f268f978a4e61823149834cb56d5c6a3ab23c787810da375f01c548d3410\": container with ID starting with 7560f268f978a4e61823149834cb56d5c6a3ab23c787810da375f01c548d3410 not found: ID does not exist" containerID="7560f268f978a4e61823149834cb56d5c6a3ab23c787810da375f01c548d3410" Mar 16 15:51:20 crc kubenswrapper[5120]: I0316 15:51:20.270920 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7560f268f978a4e61823149834cb56d5c6a3ab23c787810da375f01c548d3410"} err="failed to get container status \"7560f268f978a4e61823149834cb56d5c6a3ab23c787810da375f01c548d3410\": rpc error: code = NotFound desc = could not find container \"7560f268f978a4e61823149834cb56d5c6a3ab23c787810da375f01c548d3410\": container with ID starting with 7560f268f978a4e61823149834cb56d5c6a3ab23c787810da375f01c548d3410 not found: ID does not exist" Mar 16 15:51:20 crc kubenswrapper[5120]: I0316 15:51:20.672465 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8fdf4d7a-1d6c-47e3-a8c4-e0900e78ef51" path="/var/lib/kubelet/pods/8fdf4d7a-1d6c-47e3-a8c4-e0900e78ef51/volumes" Mar 16 15:51:22 crc kubenswrapper[5120]: I0316 15:51:22.007851 5120 patch_prober.go:28] interesting pod/machine-config-daemon-7bf76 container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 15:51:22 crc kubenswrapper[5120]: I0316 15:51:22.008213 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 15:51:22 crc kubenswrapper[5120]: I0316 15:51:22.009025 5120 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" Mar 16 15:51:22 crc kubenswrapper[5120]: I0316 15:51:22.010022 5120 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="machine-config-daemon" containerStatusID={"Type":"cri-o","ID":"e5df06dc2963ff3db6fb23d78ab01fc36b1dd04900daea5fc6d49cd8c5fe5c61"} pod="openshift-machine-config-operator/machine-config-daemon-7bf76" containerMessage="Container machine-config-daemon failed liveness probe, will be restarted" Mar 16 15:51:22 crc kubenswrapper[5120]: I0316 15:51:22.010115 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" containerID="cri-o://e5df06dc2963ff3db6fb23d78ab01fc36b1dd04900daea5fc6d49cd8c5fe5c61" gracePeriod=600 Mar 16 15:51:22 crc kubenswrapper[5120]: I0316 15:51:22.226343 5120 generic.go:358] "Generic (PLEG): container finished" podID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerID="e5df06dc2963ff3db6fb23d78ab01fc36b1dd04900daea5fc6d49cd8c5fe5c61" exitCode=0 Mar 16 15:51:22 crc kubenswrapper[5120]: I0316 15:51:22.226414 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" event={"ID":"e2275cb4-4905-4d66-a87e-8010120db2bd","Type":"ContainerDied","Data":"e5df06dc2963ff3db6fb23d78ab01fc36b1dd04900daea5fc6d49cd8c5fe5c61"} Mar 16 15:51:22 crc kubenswrapper[5120]: I0316 15:51:22.226461 5120 scope.go:117] "RemoveContainer" containerID="e1e28417e12c0a346fcffba9bba0a6be96d15547a0645d8497bdebb5b0646fd1" Mar 16 15:51:22 crc kubenswrapper[5120]: I0316 15:51:22.730729 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 15:51:23 crc kubenswrapper[5120]: I0316 15:51:23.240608 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" event={"ID":"e2275cb4-4905-4d66-a87e-8010120db2bd","Type":"ContainerStarted","Data":"9d5e3b84b8e39e272bcdfd3629bb461cbf7fa6c81923d93bfde9f9bccbea4d36"} Mar 16 15:51:25 crc kubenswrapper[5120]: I0316 15:51:25.616407 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/placement-5b47d59db-lz86c" Mar 16 15:51:26 crc kubenswrapper[5120]: I0316 15:51:26.474173 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/placement-5b47d59db-lz86c" Mar 16 15:51:26 crc kubenswrapper[5120]: I0316 15:51:26.713828 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-7956bcf97d-p9m4c"] Mar 16 15:51:26 crc kubenswrapper[5120]: I0316 15:51:26.715141 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8fdf4d7a-1d6c-47e3-a8c4-e0900e78ef51" containerName="neutron-api" Mar 16 15:51:26 crc kubenswrapper[5120]: I0316 15:51:26.715165 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8fdf4d7a-1d6c-47e3-a8c4-e0900e78ef51" containerName="neutron-api" Mar 16 15:51:26 crc kubenswrapper[5120]: I0316 15:51:26.715195 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8fdf4d7a-1d6c-47e3-a8c4-e0900e78ef51" containerName="neutron-httpd" Mar 16 15:51:26 crc kubenswrapper[5120]: I0316 15:51:26.715204 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8fdf4d7a-1d6c-47e3-a8c4-e0900e78ef51" containerName="neutron-httpd" Mar 16 15:51:26 crc kubenswrapper[5120]: I0316 15:51:26.715377 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="8fdf4d7a-1d6c-47e3-a8c4-e0900e78ef51" containerName="neutron-api" Mar 16 15:51:26 crc kubenswrapper[5120]: I0316 15:51:26.715402 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="8fdf4d7a-1d6c-47e3-a8c4-e0900e78ef51" containerName="neutron-httpd" Mar 16 15:51:26 crc kubenswrapper[5120]: I0316 15:51:26.723354 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-7956bcf97d-p9m4c" Mar 16 15:51:26 crc kubenswrapper[5120]: I0316 15:51:26.729484 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-7956bcf97d-p9m4c"] Mar 16 15:51:26 crc kubenswrapper[5120]: I0316 15:51:26.782183 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ac8dd629-af3d-4d9c-b41a-f5b8d6d29498-public-tls-certs\") pod \"placement-7956bcf97d-p9m4c\" (UID: \"ac8dd629-af3d-4d9c-b41a-f5b8d6d29498\") " pod="openstack-kuttl-tests/placement-7956bcf97d-p9m4c" Mar 16 15:51:26 crc kubenswrapper[5120]: I0316 15:51:26.782305 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/ac8dd629-af3d-4d9c-b41a-f5b8d6d29498-internal-tls-certs\") pod \"placement-7956bcf97d-p9m4c\" (UID: \"ac8dd629-af3d-4d9c-b41a-f5b8d6d29498\") " pod="openstack-kuttl-tests/placement-7956bcf97d-p9m4c" Mar 16 15:51:26 crc kubenswrapper[5120]: I0316 15:51:26.783550 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5v64\" (UniqueName: \"kubernetes.io/projected/ac8dd629-af3d-4d9c-b41a-f5b8d6d29498-kube-api-access-m5v64\") pod \"placement-7956bcf97d-p9m4c\" (UID: \"ac8dd629-af3d-4d9c-b41a-f5b8d6d29498\") " pod="openstack-kuttl-tests/placement-7956bcf97d-p9m4c" Mar 16 15:51:26 crc kubenswrapper[5120]: I0316 15:51:26.783585 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ac8dd629-af3d-4d9c-b41a-f5b8d6d29498-logs\") pod \"placement-7956bcf97d-p9m4c\" (UID: \"ac8dd629-af3d-4d9c-b41a-f5b8d6d29498\") " pod="openstack-kuttl-tests/placement-7956bcf97d-p9m4c" Mar 16 15:51:26 crc kubenswrapper[5120]: I0316 15:51:26.783645 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ac8dd629-af3d-4d9c-b41a-f5b8d6d29498-scripts\") pod \"placement-7956bcf97d-p9m4c\" (UID: \"ac8dd629-af3d-4d9c-b41a-f5b8d6d29498\") " pod="openstack-kuttl-tests/placement-7956bcf97d-p9m4c" Mar 16 15:51:26 crc kubenswrapper[5120]: I0316 15:51:26.783662 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ac8dd629-af3d-4d9c-b41a-f5b8d6d29498-config-data\") pod \"placement-7956bcf97d-p9m4c\" (UID: \"ac8dd629-af3d-4d9c-b41a-f5b8d6d29498\") " pod="openstack-kuttl-tests/placement-7956bcf97d-p9m4c" Mar 16 15:51:26 crc kubenswrapper[5120]: I0316 15:51:26.783697 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ac8dd629-af3d-4d9c-b41a-f5b8d6d29498-combined-ca-bundle\") pod \"placement-7956bcf97d-p9m4c\" (UID: \"ac8dd629-af3d-4d9c-b41a-f5b8d6d29498\") " pod="openstack-kuttl-tests/placement-7956bcf97d-p9m4c" Mar 16 15:51:26 crc kubenswrapper[5120]: I0316 15:51:26.884810 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ac8dd629-af3d-4d9c-b41a-f5b8d6d29498-combined-ca-bundle\") pod \"placement-7956bcf97d-p9m4c\" (UID: \"ac8dd629-af3d-4d9c-b41a-f5b8d6d29498\") " pod="openstack-kuttl-tests/placement-7956bcf97d-p9m4c" Mar 16 15:51:26 crc kubenswrapper[5120]: I0316 15:51:26.884869 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ac8dd629-af3d-4d9c-b41a-f5b8d6d29498-public-tls-certs\") pod \"placement-7956bcf97d-p9m4c\" (UID: \"ac8dd629-af3d-4d9c-b41a-f5b8d6d29498\") " pod="openstack-kuttl-tests/placement-7956bcf97d-p9m4c" Mar 16 15:51:26 crc kubenswrapper[5120]: I0316 15:51:26.884948 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/ac8dd629-af3d-4d9c-b41a-f5b8d6d29498-internal-tls-certs\") pod \"placement-7956bcf97d-p9m4c\" (UID: \"ac8dd629-af3d-4d9c-b41a-f5b8d6d29498\") " pod="openstack-kuttl-tests/placement-7956bcf97d-p9m4c" Mar 16 15:51:26 crc kubenswrapper[5120]: I0316 15:51:26.885005 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m5v64\" (UniqueName: \"kubernetes.io/projected/ac8dd629-af3d-4d9c-b41a-f5b8d6d29498-kube-api-access-m5v64\") pod \"placement-7956bcf97d-p9m4c\" (UID: \"ac8dd629-af3d-4d9c-b41a-f5b8d6d29498\") " pod="openstack-kuttl-tests/placement-7956bcf97d-p9m4c" Mar 16 15:51:26 crc kubenswrapper[5120]: I0316 15:51:26.885027 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ac8dd629-af3d-4d9c-b41a-f5b8d6d29498-logs\") pod \"placement-7956bcf97d-p9m4c\" (UID: \"ac8dd629-af3d-4d9c-b41a-f5b8d6d29498\") " pod="openstack-kuttl-tests/placement-7956bcf97d-p9m4c" Mar 16 15:51:26 crc kubenswrapper[5120]: I0316 15:51:26.885061 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ac8dd629-af3d-4d9c-b41a-f5b8d6d29498-scripts\") pod \"placement-7956bcf97d-p9m4c\" (UID: \"ac8dd629-af3d-4d9c-b41a-f5b8d6d29498\") " pod="openstack-kuttl-tests/placement-7956bcf97d-p9m4c" Mar 16 15:51:26 crc kubenswrapper[5120]: I0316 15:51:26.885075 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ac8dd629-af3d-4d9c-b41a-f5b8d6d29498-config-data\") pod \"placement-7956bcf97d-p9m4c\" (UID: \"ac8dd629-af3d-4d9c-b41a-f5b8d6d29498\") " pod="openstack-kuttl-tests/placement-7956bcf97d-p9m4c" Mar 16 15:51:26 crc kubenswrapper[5120]: I0316 15:51:26.886313 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ac8dd629-af3d-4d9c-b41a-f5b8d6d29498-logs\") pod \"placement-7956bcf97d-p9m4c\" (UID: \"ac8dd629-af3d-4d9c-b41a-f5b8d6d29498\") " pod="openstack-kuttl-tests/placement-7956bcf97d-p9m4c" Mar 16 15:51:26 crc kubenswrapper[5120]: I0316 15:51:26.891504 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/ac8dd629-af3d-4d9c-b41a-f5b8d6d29498-internal-tls-certs\") pod \"placement-7956bcf97d-p9m4c\" (UID: \"ac8dd629-af3d-4d9c-b41a-f5b8d6d29498\") " pod="openstack-kuttl-tests/placement-7956bcf97d-p9m4c" Mar 16 15:51:26 crc kubenswrapper[5120]: I0316 15:51:26.892059 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ac8dd629-af3d-4d9c-b41a-f5b8d6d29498-scripts\") pod \"placement-7956bcf97d-p9m4c\" (UID: \"ac8dd629-af3d-4d9c-b41a-f5b8d6d29498\") " pod="openstack-kuttl-tests/placement-7956bcf97d-p9m4c" Mar 16 15:51:26 crc kubenswrapper[5120]: I0316 15:51:26.892354 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ac8dd629-af3d-4d9c-b41a-f5b8d6d29498-public-tls-certs\") pod \"placement-7956bcf97d-p9m4c\" (UID: \"ac8dd629-af3d-4d9c-b41a-f5b8d6d29498\") " pod="openstack-kuttl-tests/placement-7956bcf97d-p9m4c" Mar 16 15:51:26 crc kubenswrapper[5120]: I0316 15:51:26.892516 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ac8dd629-af3d-4d9c-b41a-f5b8d6d29498-config-data\") pod \"placement-7956bcf97d-p9m4c\" (UID: \"ac8dd629-af3d-4d9c-b41a-f5b8d6d29498\") " pod="openstack-kuttl-tests/placement-7956bcf97d-p9m4c" Mar 16 15:51:26 crc kubenswrapper[5120]: I0316 15:51:26.901484 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ac8dd629-af3d-4d9c-b41a-f5b8d6d29498-combined-ca-bundle\") pod \"placement-7956bcf97d-p9m4c\" (UID: \"ac8dd629-af3d-4d9c-b41a-f5b8d6d29498\") " pod="openstack-kuttl-tests/placement-7956bcf97d-p9m4c" Mar 16 15:51:26 crc kubenswrapper[5120]: I0316 15:51:26.905981 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5v64\" (UniqueName: \"kubernetes.io/projected/ac8dd629-af3d-4d9c-b41a-f5b8d6d29498-kube-api-access-m5v64\") pod \"placement-7956bcf97d-p9m4c\" (UID: \"ac8dd629-af3d-4d9c-b41a-f5b8d6d29498\") " pod="openstack-kuttl-tests/placement-7956bcf97d-p9m4c" Mar 16 15:51:27 crc kubenswrapper[5120]: I0316 15:51:27.014522 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/keystone-57d5475c78-rsjsp" Mar 16 15:51:27 crc kubenswrapper[5120]: I0316 15:51:27.048220 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-7956bcf97d-p9m4c" Mar 16 15:51:27 crc kubenswrapper[5120]: I0316 15:51:27.587159 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-7956bcf97d-p9m4c"] Mar 16 15:51:28 crc kubenswrapper[5120]: I0316 15:51:28.295966 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-7956bcf97d-p9m4c" event={"ID":"ac8dd629-af3d-4d9c-b41a-f5b8d6d29498","Type":"ContainerStarted","Data":"4dec859182aa9185489fadcae215d8674987c3f6d2fb9b2af9889aac1406c176"} Mar 16 15:51:28 crc kubenswrapper[5120]: I0316 15:51:28.296542 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-7956bcf97d-p9m4c" event={"ID":"ac8dd629-af3d-4d9c-b41a-f5b8d6d29498","Type":"ContainerStarted","Data":"847b3ef9b9ce57593d9c18b6ae192780d0c000dbacbc9f955495006d724af884"} Mar 16 15:51:28 crc kubenswrapper[5120]: I0316 15:51:28.296554 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-7956bcf97d-p9m4c" event={"ID":"ac8dd629-af3d-4d9c-b41a-f5b8d6d29498","Type":"ContainerStarted","Data":"cd09ee443eae7f2ab659ca57275ec13c522469184c1ab674e61c677fc582704a"} Mar 16 15:51:28 crc kubenswrapper[5120]: I0316 15:51:28.297700 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-7956bcf97d-p9m4c" Mar 16 15:51:28 crc kubenswrapper[5120]: I0316 15:51:28.297724 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-7956bcf97d-p9m4c" Mar 16 15:51:28 crc kubenswrapper[5120]: I0316 15:51:28.322214 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-7956bcf97d-p9m4c" podStartSLOduration=2.32218556 podStartE2EDuration="2.32218556s" podCreationTimestamp="2026-03-16 15:51:26 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:51:28.315341431 +0000 UTC m=+1190.469273088" watchObservedRunningTime="2026-03-16 15:51:28.32218556 +0000 UTC m=+1190.476117217" Mar 16 15:51:30 crc kubenswrapper[5120]: I0316 15:51:30.273976 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:51:30 crc kubenswrapper[5120]: I0316 15:51:30.323178 5120 generic.go:358] "Generic (PLEG): container finished" podID="8df7575c-428a-4f47-8bd5-de8d39829afb" containerID="04dca683516eb67c26daedeb081fde94a49b2417c94a1d2b3101cb0a9c46a44b" exitCode=137 Mar 16 15:51:30 crc kubenswrapper[5120]: I0316 15:51:30.323780 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:51:30 crc kubenswrapper[5120]: I0316 15:51:30.324205 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"8df7575c-428a-4f47-8bd5-de8d39829afb","Type":"ContainerDied","Data":"04dca683516eb67c26daedeb081fde94a49b2417c94a1d2b3101cb0a9c46a44b"} Mar 16 15:51:30 crc kubenswrapper[5120]: I0316 15:51:30.324233 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"8df7575c-428a-4f47-8bd5-de8d39829afb","Type":"ContainerDied","Data":"ccadf36e46253254780761bcc28680465c3c8ee86e45cfabda1efbf5efe07689"} Mar 16 15:51:30 crc kubenswrapper[5120]: I0316 15:51:30.324249 5120 scope.go:117] "RemoveContainer" containerID="04dca683516eb67c26daedeb081fde94a49b2417c94a1d2b3101cb0a9c46a44b" Mar 16 15:51:30 crc kubenswrapper[5120]: I0316 15:51:30.357606 5120 scope.go:117] "RemoveContainer" containerID="b73b8e895c33f06b2ac0b85c8ecc9a0fa6af47233dcae10149f962311224a9c6" Mar 16 15:51:30 crc kubenswrapper[5120]: I0316 15:51:30.368874 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8df7575c-428a-4f47-8bd5-de8d39829afb-logs\") pod \"8df7575c-428a-4f47-8bd5-de8d39829afb\" (UID: \"8df7575c-428a-4f47-8bd5-de8d39829afb\") " Mar 16 15:51:30 crc kubenswrapper[5120]: I0316 15:51:30.369013 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8df7575c-428a-4f47-8bd5-de8d39829afb-scripts\") pod \"8df7575c-428a-4f47-8bd5-de8d39829afb\" (UID: \"8df7575c-428a-4f47-8bd5-de8d39829afb\") " Mar 16 15:51:30 crc kubenswrapper[5120]: I0316 15:51:30.369044 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8df7575c-428a-4f47-8bd5-de8d39829afb-config-data\") pod \"8df7575c-428a-4f47-8bd5-de8d39829afb\" (UID: \"8df7575c-428a-4f47-8bd5-de8d39829afb\") " Mar 16 15:51:30 crc kubenswrapper[5120]: I0316 15:51:30.369104 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/8df7575c-428a-4f47-8bd5-de8d39829afb-etc-machine-id\") pod \"8df7575c-428a-4f47-8bd5-de8d39829afb\" (UID: \"8df7575c-428a-4f47-8bd5-de8d39829afb\") " Mar 16 15:51:30 crc kubenswrapper[5120]: I0316 15:51:30.369165 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8df7575c-428a-4f47-8bd5-de8d39829afb-combined-ca-bundle\") pod \"8df7575c-428a-4f47-8bd5-de8d39829afb\" (UID: \"8df7575c-428a-4f47-8bd5-de8d39829afb\") " Mar 16 15:51:30 crc kubenswrapper[5120]: I0316 15:51:30.369255 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/8df7575c-428a-4f47-8bd5-de8d39829afb-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "8df7575c-428a-4f47-8bd5-de8d39829afb" (UID: "8df7575c-428a-4f47-8bd5-de8d39829afb"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 15:51:30 crc kubenswrapper[5120]: I0316 15:51:30.369297 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dzwbc\" (UniqueName: \"kubernetes.io/projected/8df7575c-428a-4f47-8bd5-de8d39829afb-kube-api-access-dzwbc\") pod \"8df7575c-428a-4f47-8bd5-de8d39829afb\" (UID: \"8df7575c-428a-4f47-8bd5-de8d39829afb\") " Mar 16 15:51:30 crc kubenswrapper[5120]: I0316 15:51:30.369318 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/8df7575c-428a-4f47-8bd5-de8d39829afb-config-data-custom\") pod \"8df7575c-428a-4f47-8bd5-de8d39829afb\" (UID: \"8df7575c-428a-4f47-8bd5-de8d39829afb\") " Mar 16 15:51:30 crc kubenswrapper[5120]: I0316 15:51:30.369520 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8df7575c-428a-4f47-8bd5-de8d39829afb-logs" (OuterVolumeSpecName: "logs") pod "8df7575c-428a-4f47-8bd5-de8d39829afb" (UID: "8df7575c-428a-4f47-8bd5-de8d39829afb"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:51:30 crc kubenswrapper[5120]: I0316 15:51:30.369748 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8df7575c-428a-4f47-8bd5-de8d39829afb-logs\") on node \"crc\" DevicePath \"\"" Mar 16 15:51:30 crc kubenswrapper[5120]: I0316 15:51:30.369785 5120 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/8df7575c-428a-4f47-8bd5-de8d39829afb-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 15:51:30 crc kubenswrapper[5120]: I0316 15:51:30.376395 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8df7575c-428a-4f47-8bd5-de8d39829afb-kube-api-access-dzwbc" (OuterVolumeSpecName: "kube-api-access-dzwbc") pod "8df7575c-428a-4f47-8bd5-de8d39829afb" (UID: "8df7575c-428a-4f47-8bd5-de8d39829afb"). InnerVolumeSpecName "kube-api-access-dzwbc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:51:30 crc kubenswrapper[5120]: I0316 15:51:30.378030 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8df7575c-428a-4f47-8bd5-de8d39829afb-scripts" (OuterVolumeSpecName: "scripts") pod "8df7575c-428a-4f47-8bd5-de8d39829afb" (UID: "8df7575c-428a-4f47-8bd5-de8d39829afb"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:51:30 crc kubenswrapper[5120]: I0316 15:51:30.388967 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8df7575c-428a-4f47-8bd5-de8d39829afb-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "8df7575c-428a-4f47-8bd5-de8d39829afb" (UID: "8df7575c-428a-4f47-8bd5-de8d39829afb"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:51:30 crc kubenswrapper[5120]: I0316 15:51:30.389605 5120 scope.go:117] "RemoveContainer" containerID="04dca683516eb67c26daedeb081fde94a49b2417c94a1d2b3101cb0a9c46a44b" Mar 16 15:51:30 crc kubenswrapper[5120]: E0316 15:51:30.390183 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"04dca683516eb67c26daedeb081fde94a49b2417c94a1d2b3101cb0a9c46a44b\": container with ID starting with 04dca683516eb67c26daedeb081fde94a49b2417c94a1d2b3101cb0a9c46a44b not found: ID does not exist" containerID="04dca683516eb67c26daedeb081fde94a49b2417c94a1d2b3101cb0a9c46a44b" Mar 16 15:51:30 crc kubenswrapper[5120]: I0316 15:51:30.390232 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04dca683516eb67c26daedeb081fde94a49b2417c94a1d2b3101cb0a9c46a44b"} err="failed to get container status \"04dca683516eb67c26daedeb081fde94a49b2417c94a1d2b3101cb0a9c46a44b\": rpc error: code = NotFound desc = could not find container \"04dca683516eb67c26daedeb081fde94a49b2417c94a1d2b3101cb0a9c46a44b\": container with ID starting with 04dca683516eb67c26daedeb081fde94a49b2417c94a1d2b3101cb0a9c46a44b not found: ID does not exist" Mar 16 15:51:30 crc kubenswrapper[5120]: I0316 15:51:30.390255 5120 scope.go:117] "RemoveContainer" containerID="b73b8e895c33f06b2ac0b85c8ecc9a0fa6af47233dcae10149f962311224a9c6" Mar 16 15:51:30 crc kubenswrapper[5120]: E0316 15:51:30.391044 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b73b8e895c33f06b2ac0b85c8ecc9a0fa6af47233dcae10149f962311224a9c6\": container with ID starting with b73b8e895c33f06b2ac0b85c8ecc9a0fa6af47233dcae10149f962311224a9c6 not found: ID does not exist" containerID="b73b8e895c33f06b2ac0b85c8ecc9a0fa6af47233dcae10149f962311224a9c6" Mar 16 15:51:30 crc kubenswrapper[5120]: I0316 15:51:30.391073 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b73b8e895c33f06b2ac0b85c8ecc9a0fa6af47233dcae10149f962311224a9c6"} err="failed to get container status \"b73b8e895c33f06b2ac0b85c8ecc9a0fa6af47233dcae10149f962311224a9c6\": rpc error: code = NotFound desc = could not find container \"b73b8e895c33f06b2ac0b85c8ecc9a0fa6af47233dcae10149f962311224a9c6\": container with ID starting with b73b8e895c33f06b2ac0b85c8ecc9a0fa6af47233dcae10149f962311224a9c6 not found: ID does not exist" Mar 16 15:51:30 crc kubenswrapper[5120]: I0316 15:51:30.442791 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8df7575c-428a-4f47-8bd5-de8d39829afb-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "8df7575c-428a-4f47-8bd5-de8d39829afb" (UID: "8df7575c-428a-4f47-8bd5-de8d39829afb"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:51:30 crc kubenswrapper[5120]: I0316 15:51:30.471004 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8df7575c-428a-4f47-8bd5-de8d39829afb-config-data" (OuterVolumeSpecName: "config-data") pod "8df7575c-428a-4f47-8bd5-de8d39829afb" (UID: "8df7575c-428a-4f47-8bd5-de8d39829afb"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:51:30 crc kubenswrapper[5120]: I0316 15:51:30.471510 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8df7575c-428a-4f47-8bd5-de8d39829afb-config-data\") pod \"8df7575c-428a-4f47-8bd5-de8d39829afb\" (UID: \"8df7575c-428a-4f47-8bd5-de8d39829afb\") " Mar 16 15:51:30 crc kubenswrapper[5120]: W0316 15:51:30.471628 5120 empty_dir.go:511] Warning: Unmount skipped because path does not exist: /var/lib/kubelet/pods/8df7575c-428a-4f47-8bd5-de8d39829afb/volumes/kubernetes.io~secret/config-data Mar 16 15:51:30 crc kubenswrapper[5120]: I0316 15:51:30.471644 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8df7575c-428a-4f47-8bd5-de8d39829afb-config-data" (OuterVolumeSpecName: "config-data") pod "8df7575c-428a-4f47-8bd5-de8d39829afb" (UID: "8df7575c-428a-4f47-8bd5-de8d39829afb"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:51:30 crc kubenswrapper[5120]: I0316 15:51:30.472102 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8df7575c-428a-4f47-8bd5-de8d39829afb-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 15:51:30 crc kubenswrapper[5120]: I0316 15:51:30.472179 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8df7575c-428a-4f47-8bd5-de8d39829afb-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 15:51:30 crc kubenswrapper[5120]: I0316 15:51:30.472238 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8df7575c-428a-4f47-8bd5-de8d39829afb-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:51:30 crc kubenswrapper[5120]: I0316 15:51:30.472334 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dzwbc\" (UniqueName: \"kubernetes.io/projected/8df7575c-428a-4f47-8bd5-de8d39829afb-kube-api-access-dzwbc\") on node \"crc\" DevicePath \"\"" Mar 16 15:51:30 crc kubenswrapper[5120]: I0316 15:51:30.472438 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/8df7575c-428a-4f47-8bd5-de8d39829afb-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 15:51:30 crc kubenswrapper[5120]: I0316 15:51:30.673443 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 15:51:30 crc kubenswrapper[5120]: I0316 15:51:30.699668 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 15:51:30 crc kubenswrapper[5120]: I0316 15:51:30.729784 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 15:51:30 crc kubenswrapper[5120]: I0316 15:51:30.732358 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8df7575c-428a-4f47-8bd5-de8d39829afb" containerName="cinder-api-log" Mar 16 15:51:30 crc kubenswrapper[5120]: I0316 15:51:30.732399 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8df7575c-428a-4f47-8bd5-de8d39829afb" containerName="cinder-api-log" Mar 16 15:51:30 crc kubenswrapper[5120]: I0316 15:51:30.732639 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8df7575c-428a-4f47-8bd5-de8d39829afb" containerName="cinder-api" Mar 16 15:51:30 crc kubenswrapper[5120]: I0316 15:51:30.732658 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8df7575c-428a-4f47-8bd5-de8d39829afb" containerName="cinder-api" Mar 16 15:51:30 crc kubenswrapper[5120]: I0316 15:51:30.733404 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="8df7575c-428a-4f47-8bd5-de8d39829afb" containerName="cinder-api-log" Mar 16 15:51:30 crc kubenswrapper[5120]: I0316 15:51:30.733430 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="8df7575c-428a-4f47-8bd5-de8d39829afb" containerName="cinder-api" Mar 16 15:51:30 crc kubenswrapper[5120]: I0316 15:51:30.747299 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:51:30 crc kubenswrapper[5120]: I0316 15:51:30.750364 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-cinder-internal-svc\"" Mar 16 15:51:30 crc kubenswrapper[5120]: I0316 15:51:30.754191 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-cinder-public-svc\"" Mar 16 15:51:30 crc kubenswrapper[5120]: I0316 15:51:30.754439 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-api-config-data\"" Mar 16 15:51:30 crc kubenswrapper[5120]: I0316 15:51:30.756785 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 15:51:30 crc kubenswrapper[5120]: I0316 15:51:30.896972 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/4306304f-eaea-49a1-9e62-9b035dc302de-public-tls-certs\") pod \"cinder-api-0\" (UID: \"4306304f-eaea-49a1-9e62-9b035dc302de\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:51:30 crc kubenswrapper[5120]: I0316 15:51:30.897319 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4306304f-eaea-49a1-9e62-9b035dc302de-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"4306304f-eaea-49a1-9e62-9b035dc302de\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:51:30 crc kubenswrapper[5120]: I0316 15:51:30.897423 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/4306304f-eaea-49a1-9e62-9b035dc302de-etc-machine-id\") pod \"cinder-api-0\" (UID: \"4306304f-eaea-49a1-9e62-9b035dc302de\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:51:30 crc kubenswrapper[5120]: I0316 15:51:30.897529 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4306304f-eaea-49a1-9e62-9b035dc302de-config-data\") pod \"cinder-api-0\" (UID: \"4306304f-eaea-49a1-9e62-9b035dc302de\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:51:30 crc kubenswrapper[5120]: I0316 15:51:30.897651 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/4306304f-eaea-49a1-9e62-9b035dc302de-config-data-custom\") pod \"cinder-api-0\" (UID: \"4306304f-eaea-49a1-9e62-9b035dc302de\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:51:30 crc kubenswrapper[5120]: I0316 15:51:30.897754 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4306304f-eaea-49a1-9e62-9b035dc302de-scripts\") pod \"cinder-api-0\" (UID: \"4306304f-eaea-49a1-9e62-9b035dc302de\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:51:30 crc kubenswrapper[5120]: I0316 15:51:30.897853 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4306304f-eaea-49a1-9e62-9b035dc302de-logs\") pod \"cinder-api-0\" (UID: \"4306304f-eaea-49a1-9e62-9b035dc302de\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:51:30 crc kubenswrapper[5120]: I0316 15:51:30.897953 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/4306304f-eaea-49a1-9e62-9b035dc302de-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"4306304f-eaea-49a1-9e62-9b035dc302de\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:51:30 crc kubenswrapper[5120]: I0316 15:51:30.898129 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ssrsq\" (UniqueName: \"kubernetes.io/projected/4306304f-eaea-49a1-9e62-9b035dc302de-kube-api-access-ssrsq\") pod \"cinder-api-0\" (UID: \"4306304f-eaea-49a1-9e62-9b035dc302de\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:51:30 crc kubenswrapper[5120]: I0316 15:51:30.999695 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ssrsq\" (UniqueName: \"kubernetes.io/projected/4306304f-eaea-49a1-9e62-9b035dc302de-kube-api-access-ssrsq\") pod \"cinder-api-0\" (UID: \"4306304f-eaea-49a1-9e62-9b035dc302de\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:51:31 crc kubenswrapper[5120]: I0316 15:51:31.000434 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/4306304f-eaea-49a1-9e62-9b035dc302de-public-tls-certs\") pod \"cinder-api-0\" (UID: \"4306304f-eaea-49a1-9e62-9b035dc302de\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:51:31 crc kubenswrapper[5120]: I0316 15:51:31.000610 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4306304f-eaea-49a1-9e62-9b035dc302de-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"4306304f-eaea-49a1-9e62-9b035dc302de\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:51:31 crc kubenswrapper[5120]: I0316 15:51:31.000714 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/4306304f-eaea-49a1-9e62-9b035dc302de-etc-machine-id\") pod \"cinder-api-0\" (UID: \"4306304f-eaea-49a1-9e62-9b035dc302de\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:51:31 crc kubenswrapper[5120]: I0316 15:51:31.002027 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4306304f-eaea-49a1-9e62-9b035dc302de-config-data\") pod \"cinder-api-0\" (UID: \"4306304f-eaea-49a1-9e62-9b035dc302de\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:51:31 crc kubenswrapper[5120]: I0316 15:51:31.002243 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/4306304f-eaea-49a1-9e62-9b035dc302de-config-data-custom\") pod \"cinder-api-0\" (UID: \"4306304f-eaea-49a1-9e62-9b035dc302de\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:51:31 crc kubenswrapper[5120]: I0316 15:51:31.002397 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4306304f-eaea-49a1-9e62-9b035dc302de-scripts\") pod \"cinder-api-0\" (UID: \"4306304f-eaea-49a1-9e62-9b035dc302de\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:51:31 crc kubenswrapper[5120]: I0316 15:51:31.002513 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4306304f-eaea-49a1-9e62-9b035dc302de-logs\") pod \"cinder-api-0\" (UID: \"4306304f-eaea-49a1-9e62-9b035dc302de\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:51:31 crc kubenswrapper[5120]: I0316 15:51:31.000934 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/4306304f-eaea-49a1-9e62-9b035dc302de-etc-machine-id\") pod \"cinder-api-0\" (UID: \"4306304f-eaea-49a1-9e62-9b035dc302de\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:51:31 crc kubenswrapper[5120]: I0316 15:51:31.003092 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/4306304f-eaea-49a1-9e62-9b035dc302de-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"4306304f-eaea-49a1-9e62-9b035dc302de\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:51:31 crc kubenswrapper[5120]: I0316 15:51:31.003568 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4306304f-eaea-49a1-9e62-9b035dc302de-logs\") pod \"cinder-api-0\" (UID: \"4306304f-eaea-49a1-9e62-9b035dc302de\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:51:31 crc kubenswrapper[5120]: I0316 15:51:31.007113 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4306304f-eaea-49a1-9e62-9b035dc302de-scripts\") pod \"cinder-api-0\" (UID: \"4306304f-eaea-49a1-9e62-9b035dc302de\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:51:31 crc kubenswrapper[5120]: I0316 15:51:31.007242 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/4306304f-eaea-49a1-9e62-9b035dc302de-public-tls-certs\") pod \"cinder-api-0\" (UID: \"4306304f-eaea-49a1-9e62-9b035dc302de\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:51:31 crc kubenswrapper[5120]: I0316 15:51:31.008082 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4306304f-eaea-49a1-9e62-9b035dc302de-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"4306304f-eaea-49a1-9e62-9b035dc302de\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:51:31 crc kubenswrapper[5120]: I0316 15:51:31.010004 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/4306304f-eaea-49a1-9e62-9b035dc302de-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"4306304f-eaea-49a1-9e62-9b035dc302de\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:51:31 crc kubenswrapper[5120]: I0316 15:51:31.017207 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/4306304f-eaea-49a1-9e62-9b035dc302de-config-data-custom\") pod \"cinder-api-0\" (UID: \"4306304f-eaea-49a1-9e62-9b035dc302de\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:51:31 crc kubenswrapper[5120]: I0316 15:51:31.017884 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4306304f-eaea-49a1-9e62-9b035dc302de-config-data\") pod \"cinder-api-0\" (UID: \"4306304f-eaea-49a1-9e62-9b035dc302de\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:51:31 crc kubenswrapper[5120]: I0316 15:51:31.018538 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ssrsq\" (UniqueName: \"kubernetes.io/projected/4306304f-eaea-49a1-9e62-9b035dc302de-kube-api-access-ssrsq\") pod \"cinder-api-0\" (UID: \"4306304f-eaea-49a1-9e62-9b035dc302de\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:51:31 crc kubenswrapper[5120]: I0316 15:51:31.069020 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:51:31 crc kubenswrapper[5120]: I0316 15:51:31.149477 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 15:51:31 crc kubenswrapper[5120]: I0316 15:51:31.182787 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 15:51:31 crc kubenswrapper[5120]: I0316 15:51:31.182946 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Mar 16 15:51:31 crc kubenswrapper[5120]: I0316 15:51:31.186794 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"openstackclient-openstackclient-dockercfg-h7nnp\"" Mar 16 15:51:31 crc kubenswrapper[5120]: I0316 15:51:31.186822 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"openstack-config-secret\"" Mar 16 15:51:31 crc kubenswrapper[5120]: I0316 15:51:31.186994 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-config\"" Mar 16 15:51:31 crc kubenswrapper[5120]: I0316 15:51:31.308278 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdch9\" (UniqueName: \"kubernetes.io/projected/d6f8b8b2-e94a-4c67-9e6d-be16e2acbdcc-kube-api-access-pdch9\") pod \"openstackclient\" (UID: \"d6f8b8b2-e94a-4c67-9e6d-be16e2acbdcc\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 15:51:31 crc kubenswrapper[5120]: I0316 15:51:31.308483 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/d6f8b8b2-e94a-4c67-9e6d-be16e2acbdcc-openstack-config-secret\") pod \"openstackclient\" (UID: \"d6f8b8b2-e94a-4c67-9e6d-be16e2acbdcc\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 15:51:31 crc kubenswrapper[5120]: I0316 15:51:31.308711 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d6f8b8b2-e94a-4c67-9e6d-be16e2acbdcc-combined-ca-bundle\") pod \"openstackclient\" (UID: \"d6f8b8b2-e94a-4c67-9e6d-be16e2acbdcc\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 15:51:31 crc kubenswrapper[5120]: I0316 15:51:31.308796 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/d6f8b8b2-e94a-4c67-9e6d-be16e2acbdcc-openstack-config\") pod \"openstackclient\" (UID: \"d6f8b8b2-e94a-4c67-9e6d-be16e2acbdcc\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 15:51:31 crc kubenswrapper[5120]: I0316 15:51:31.412849 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d6f8b8b2-e94a-4c67-9e6d-be16e2acbdcc-combined-ca-bundle\") pod \"openstackclient\" (UID: \"d6f8b8b2-e94a-4c67-9e6d-be16e2acbdcc\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 15:51:31 crc kubenswrapper[5120]: I0316 15:51:31.412925 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/d6f8b8b2-e94a-4c67-9e6d-be16e2acbdcc-openstack-config\") pod \"openstackclient\" (UID: \"d6f8b8b2-e94a-4c67-9e6d-be16e2acbdcc\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 15:51:31 crc kubenswrapper[5120]: I0316 15:51:31.413017 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pdch9\" (UniqueName: \"kubernetes.io/projected/d6f8b8b2-e94a-4c67-9e6d-be16e2acbdcc-kube-api-access-pdch9\") pod \"openstackclient\" (UID: \"d6f8b8b2-e94a-4c67-9e6d-be16e2acbdcc\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 15:51:31 crc kubenswrapper[5120]: I0316 15:51:31.413096 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/d6f8b8b2-e94a-4c67-9e6d-be16e2acbdcc-openstack-config-secret\") pod \"openstackclient\" (UID: \"d6f8b8b2-e94a-4c67-9e6d-be16e2acbdcc\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 15:51:31 crc kubenswrapper[5120]: I0316 15:51:31.414177 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/d6f8b8b2-e94a-4c67-9e6d-be16e2acbdcc-openstack-config\") pod \"openstackclient\" (UID: \"d6f8b8b2-e94a-4c67-9e6d-be16e2acbdcc\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 15:51:31 crc kubenswrapper[5120]: I0316 15:51:31.418702 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d6f8b8b2-e94a-4c67-9e6d-be16e2acbdcc-combined-ca-bundle\") pod \"openstackclient\" (UID: \"d6f8b8b2-e94a-4c67-9e6d-be16e2acbdcc\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 15:51:31 crc kubenswrapper[5120]: I0316 15:51:31.419744 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/d6f8b8b2-e94a-4c67-9e6d-be16e2acbdcc-openstack-config-secret\") pod \"openstackclient\" (UID: \"d6f8b8b2-e94a-4c67-9e6d-be16e2acbdcc\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 15:51:31 crc kubenswrapper[5120]: I0316 15:51:31.428540 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdch9\" (UniqueName: \"kubernetes.io/projected/d6f8b8b2-e94a-4c67-9e6d-be16e2acbdcc-kube-api-access-pdch9\") pod \"openstackclient\" (UID: \"d6f8b8b2-e94a-4c67-9e6d-be16e2acbdcc\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 15:51:31 crc kubenswrapper[5120]: I0316 15:51:31.544034 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Mar 16 15:51:31 crc kubenswrapper[5120]: I0316 15:51:31.595614 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 15:51:31 crc kubenswrapper[5120]: I0316 15:51:31.986367 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 15:51:32 crc kubenswrapper[5120]: I0316 15:51:32.349856 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"4306304f-eaea-49a1-9e62-9b035dc302de","Type":"ContainerStarted","Data":"03a532e5f3aef4d39e3e05038316d64f88f3c45b80b9e445a60645d5b7d6e8f9"} Mar 16 15:51:32 crc kubenswrapper[5120]: I0316 15:51:32.351961 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstackclient" event={"ID":"d6f8b8b2-e94a-4c67-9e6d-be16e2acbdcc","Type":"ContainerStarted","Data":"347b733d96128d4e9c26dcb4b9dad3a9cbec014f1a646ce7e077de71b64f31e8"} Mar 16 15:51:32 crc kubenswrapper[5120]: I0316 15:51:32.678318 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8df7575c-428a-4f47-8bd5-de8d39829afb" path="/var/lib/kubelet/pods/8df7575c-428a-4f47-8bd5-de8d39829afb/volumes" Mar 16 15:51:33 crc kubenswrapper[5120]: I0316 15:51:33.362819 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"4306304f-eaea-49a1-9e62-9b035dc302de","Type":"ContainerStarted","Data":"1caafbafeede915ee6f4819bb0e0954a636de7eee094105d62e479295fc329c9"} Mar 16 15:51:33 crc kubenswrapper[5120]: I0316 15:51:33.363230 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:51:33 crc kubenswrapper[5120]: I0316 15:51:33.363249 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"4306304f-eaea-49a1-9e62-9b035dc302de","Type":"ContainerStarted","Data":"32dc4affff57e6164d54a3b9adc39549944d248ae17ddcbe6847bc2b8586572c"} Mar 16 15:51:33 crc kubenswrapper[5120]: I0316 15:51:33.385469 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-api-0" podStartSLOduration=3.385440799 podStartE2EDuration="3.385440799s" podCreationTimestamp="2026-03-16 15:51:30 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:51:33.37813222 +0000 UTC m=+1195.532063877" watchObservedRunningTime="2026-03-16 15:51:33.385440799 +0000 UTC m=+1195.539372456" Mar 16 15:51:34 crc kubenswrapper[5120]: I0316 15:51:34.589522 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/swift-proxy-59c794978b-lzrxq"] Mar 16 15:51:34 crc kubenswrapper[5120]: I0316 15:51:34.600919 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-59c794978b-lzrxq" Mar 16 15:51:34 crc kubenswrapper[5120]: I0316 15:51:34.603004 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-swift-public-svc\"" Mar 16 15:51:34 crc kubenswrapper[5120]: I0316 15:51:34.603182 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"swift-proxy-config-data\"" Mar 16 15:51:34 crc kubenswrapper[5120]: I0316 15:51:34.603563 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-swift-internal-svc\"" Mar 16 15:51:34 crc kubenswrapper[5120]: I0316 15:51:34.604354 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ac88284a-2f9f-4e52-8de4-1c299b94bbd1-public-tls-certs\") pod \"swift-proxy-59c794978b-lzrxq\" (UID: \"ac88284a-2f9f-4e52-8de4-1c299b94bbd1\") " pod="openstack-kuttl-tests/swift-proxy-59c794978b-lzrxq" Mar 16 15:51:34 crc kubenswrapper[5120]: I0316 15:51:34.604420 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ac88284a-2f9f-4e52-8de4-1c299b94bbd1-log-httpd\") pod \"swift-proxy-59c794978b-lzrxq\" (UID: \"ac88284a-2f9f-4e52-8de4-1c299b94bbd1\") " pod="openstack-kuttl-tests/swift-proxy-59c794978b-lzrxq" Mar 16 15:51:34 crc kubenswrapper[5120]: I0316 15:51:34.604473 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q95gf\" (UniqueName: \"kubernetes.io/projected/ac88284a-2f9f-4e52-8de4-1c299b94bbd1-kube-api-access-q95gf\") pod \"swift-proxy-59c794978b-lzrxq\" (UID: \"ac88284a-2f9f-4e52-8de4-1c299b94bbd1\") " pod="openstack-kuttl-tests/swift-proxy-59c794978b-lzrxq" Mar 16 15:51:34 crc kubenswrapper[5120]: I0316 15:51:34.604590 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ac88284a-2f9f-4e52-8de4-1c299b94bbd1-config-data\") pod \"swift-proxy-59c794978b-lzrxq\" (UID: \"ac88284a-2f9f-4e52-8de4-1c299b94bbd1\") " pod="openstack-kuttl-tests/swift-proxy-59c794978b-lzrxq" Mar 16 15:51:34 crc kubenswrapper[5120]: I0316 15:51:34.604665 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ac88284a-2f9f-4e52-8de4-1c299b94bbd1-run-httpd\") pod \"swift-proxy-59c794978b-lzrxq\" (UID: \"ac88284a-2f9f-4e52-8de4-1c299b94bbd1\") " pod="openstack-kuttl-tests/swift-proxy-59c794978b-lzrxq" Mar 16 15:51:34 crc kubenswrapper[5120]: I0316 15:51:34.604871 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/ac88284a-2f9f-4e52-8de4-1c299b94bbd1-etc-swift\") pod \"swift-proxy-59c794978b-lzrxq\" (UID: \"ac88284a-2f9f-4e52-8de4-1c299b94bbd1\") " pod="openstack-kuttl-tests/swift-proxy-59c794978b-lzrxq" Mar 16 15:51:34 crc kubenswrapper[5120]: I0316 15:51:34.604910 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/ac88284a-2f9f-4e52-8de4-1c299b94bbd1-internal-tls-certs\") pod \"swift-proxy-59c794978b-lzrxq\" (UID: \"ac88284a-2f9f-4e52-8de4-1c299b94bbd1\") " pod="openstack-kuttl-tests/swift-proxy-59c794978b-lzrxq" Mar 16 15:51:34 crc kubenswrapper[5120]: I0316 15:51:34.604996 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ac88284a-2f9f-4e52-8de4-1c299b94bbd1-combined-ca-bundle\") pod \"swift-proxy-59c794978b-lzrxq\" (UID: \"ac88284a-2f9f-4e52-8de4-1c299b94bbd1\") " pod="openstack-kuttl-tests/swift-proxy-59c794978b-lzrxq" Mar 16 15:51:34 crc kubenswrapper[5120]: I0316 15:51:34.626483 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-proxy-59c794978b-lzrxq"] Mar 16 15:51:34 crc kubenswrapper[5120]: I0316 15:51:34.706202 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ac88284a-2f9f-4e52-8de4-1c299b94bbd1-combined-ca-bundle\") pod \"swift-proxy-59c794978b-lzrxq\" (UID: \"ac88284a-2f9f-4e52-8de4-1c299b94bbd1\") " pod="openstack-kuttl-tests/swift-proxy-59c794978b-lzrxq" Mar 16 15:51:34 crc kubenswrapper[5120]: I0316 15:51:34.706269 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ac88284a-2f9f-4e52-8de4-1c299b94bbd1-public-tls-certs\") pod \"swift-proxy-59c794978b-lzrxq\" (UID: \"ac88284a-2f9f-4e52-8de4-1c299b94bbd1\") " pod="openstack-kuttl-tests/swift-proxy-59c794978b-lzrxq" Mar 16 15:51:34 crc kubenswrapper[5120]: I0316 15:51:34.706311 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ac88284a-2f9f-4e52-8de4-1c299b94bbd1-log-httpd\") pod \"swift-proxy-59c794978b-lzrxq\" (UID: \"ac88284a-2f9f-4e52-8de4-1c299b94bbd1\") " pod="openstack-kuttl-tests/swift-proxy-59c794978b-lzrxq" Mar 16 15:51:34 crc kubenswrapper[5120]: I0316 15:51:34.706352 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q95gf\" (UniqueName: \"kubernetes.io/projected/ac88284a-2f9f-4e52-8de4-1c299b94bbd1-kube-api-access-q95gf\") pod \"swift-proxy-59c794978b-lzrxq\" (UID: \"ac88284a-2f9f-4e52-8de4-1c299b94bbd1\") " pod="openstack-kuttl-tests/swift-proxy-59c794978b-lzrxq" Mar 16 15:51:34 crc kubenswrapper[5120]: I0316 15:51:34.706547 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ac88284a-2f9f-4e52-8de4-1c299b94bbd1-config-data\") pod \"swift-proxy-59c794978b-lzrxq\" (UID: \"ac88284a-2f9f-4e52-8de4-1c299b94bbd1\") " pod="openstack-kuttl-tests/swift-proxy-59c794978b-lzrxq" Mar 16 15:51:34 crc kubenswrapper[5120]: I0316 15:51:34.706644 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ac88284a-2f9f-4e52-8de4-1c299b94bbd1-run-httpd\") pod \"swift-proxy-59c794978b-lzrxq\" (UID: \"ac88284a-2f9f-4e52-8de4-1c299b94bbd1\") " pod="openstack-kuttl-tests/swift-proxy-59c794978b-lzrxq" Mar 16 15:51:34 crc kubenswrapper[5120]: I0316 15:51:34.706939 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/ac88284a-2f9f-4e52-8de4-1c299b94bbd1-etc-swift\") pod \"swift-proxy-59c794978b-lzrxq\" (UID: \"ac88284a-2f9f-4e52-8de4-1c299b94bbd1\") " pod="openstack-kuttl-tests/swift-proxy-59c794978b-lzrxq" Mar 16 15:51:34 crc kubenswrapper[5120]: I0316 15:51:34.707002 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/ac88284a-2f9f-4e52-8de4-1c299b94bbd1-internal-tls-certs\") pod \"swift-proxy-59c794978b-lzrxq\" (UID: \"ac88284a-2f9f-4e52-8de4-1c299b94bbd1\") " pod="openstack-kuttl-tests/swift-proxy-59c794978b-lzrxq" Mar 16 15:51:34 crc kubenswrapper[5120]: I0316 15:51:34.707102 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ac88284a-2f9f-4e52-8de4-1c299b94bbd1-log-httpd\") pod \"swift-proxy-59c794978b-lzrxq\" (UID: \"ac88284a-2f9f-4e52-8de4-1c299b94bbd1\") " pod="openstack-kuttl-tests/swift-proxy-59c794978b-lzrxq" Mar 16 15:51:34 crc kubenswrapper[5120]: I0316 15:51:34.707404 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ac88284a-2f9f-4e52-8de4-1c299b94bbd1-run-httpd\") pod \"swift-proxy-59c794978b-lzrxq\" (UID: \"ac88284a-2f9f-4e52-8de4-1c299b94bbd1\") " pod="openstack-kuttl-tests/swift-proxy-59c794978b-lzrxq" Mar 16 15:51:34 crc kubenswrapper[5120]: I0316 15:51:34.712889 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ac88284a-2f9f-4e52-8de4-1c299b94bbd1-public-tls-certs\") pod \"swift-proxy-59c794978b-lzrxq\" (UID: \"ac88284a-2f9f-4e52-8de4-1c299b94bbd1\") " pod="openstack-kuttl-tests/swift-proxy-59c794978b-lzrxq" Mar 16 15:51:34 crc kubenswrapper[5120]: I0316 15:51:34.715421 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/ac88284a-2f9f-4e52-8de4-1c299b94bbd1-etc-swift\") pod \"swift-proxy-59c794978b-lzrxq\" (UID: \"ac88284a-2f9f-4e52-8de4-1c299b94bbd1\") " pod="openstack-kuttl-tests/swift-proxy-59c794978b-lzrxq" Mar 16 15:51:34 crc kubenswrapper[5120]: I0316 15:51:34.717647 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ac88284a-2f9f-4e52-8de4-1c299b94bbd1-config-data\") pod \"swift-proxy-59c794978b-lzrxq\" (UID: \"ac88284a-2f9f-4e52-8de4-1c299b94bbd1\") " pod="openstack-kuttl-tests/swift-proxy-59c794978b-lzrxq" Mar 16 15:51:34 crc kubenswrapper[5120]: I0316 15:51:34.719202 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ac88284a-2f9f-4e52-8de4-1c299b94bbd1-combined-ca-bundle\") pod \"swift-proxy-59c794978b-lzrxq\" (UID: \"ac88284a-2f9f-4e52-8de4-1c299b94bbd1\") " pod="openstack-kuttl-tests/swift-proxy-59c794978b-lzrxq" Mar 16 15:51:34 crc kubenswrapper[5120]: I0316 15:51:34.719524 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/ac88284a-2f9f-4e52-8de4-1c299b94bbd1-internal-tls-certs\") pod \"swift-proxy-59c794978b-lzrxq\" (UID: \"ac88284a-2f9f-4e52-8de4-1c299b94bbd1\") " pod="openstack-kuttl-tests/swift-proxy-59c794978b-lzrxq" Mar 16 15:51:34 crc kubenswrapper[5120]: I0316 15:51:34.722342 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q95gf\" (UniqueName: \"kubernetes.io/projected/ac88284a-2f9f-4e52-8de4-1c299b94bbd1-kube-api-access-q95gf\") pod \"swift-proxy-59c794978b-lzrxq\" (UID: \"ac88284a-2f9f-4e52-8de4-1c299b94bbd1\") " pod="openstack-kuttl-tests/swift-proxy-59c794978b-lzrxq" Mar 16 15:51:34 crc kubenswrapper[5120]: I0316 15:51:34.932042 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-59c794978b-lzrxq" Mar 16 15:51:35 crc kubenswrapper[5120]: I0316 15:51:35.449945 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-proxy-59c794978b-lzrxq"] Mar 16 15:51:36 crc kubenswrapper[5120]: I0316 15:51:36.403561 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-59c794978b-lzrxq" event={"ID":"ac88284a-2f9f-4e52-8de4-1c299b94bbd1","Type":"ContainerStarted","Data":"3384af102f5e21af38f70357dde5423094a7b97015a788c7ce82b5c8ddf617b2"} Mar 16 15:51:36 crc kubenswrapper[5120]: I0316 15:51:36.404223 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/swift-proxy-59c794978b-lzrxq" Mar 16 15:51:36 crc kubenswrapper[5120]: I0316 15:51:36.404240 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/swift-proxy-59c794978b-lzrxq" Mar 16 15:51:36 crc kubenswrapper[5120]: I0316 15:51:36.404251 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-59c794978b-lzrxq" event={"ID":"ac88284a-2f9f-4e52-8de4-1c299b94bbd1","Type":"ContainerStarted","Data":"9e3ca77b7dc91937211be72bb388d6e800aa4ca62b560a55eb833bbf6b8c4ddb"} Mar 16 15:51:36 crc kubenswrapper[5120]: I0316 15:51:36.404263 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-59c794978b-lzrxq" event={"ID":"ac88284a-2f9f-4e52-8de4-1c299b94bbd1","Type":"ContainerStarted","Data":"e82a56e1024fd06cdc37863b4890f0bff6357929c7b2f4c8e0e2bfa657add9be"} Mar 16 15:51:36 crc kubenswrapper[5120]: I0316 15:51:36.439071 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/swift-proxy-59c794978b-lzrxq" podStartSLOduration=2.439048652 podStartE2EDuration="2.439048652s" podCreationTimestamp="2026-03-16 15:51:34 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:51:36.422374745 +0000 UTC m=+1198.576306402" watchObservedRunningTime="2026-03-16 15:51:36.439048652 +0000 UTC m=+1198.592980319" Mar 16 15:51:40 crc kubenswrapper[5120]: I0316 15:51:40.414879 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 15:51:40 crc kubenswrapper[5120]: I0316 15:51:40.415714 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="69b7941a-2f2b-4bc7-a7ea-26779c6290be" containerName="ceilometer-central-agent" containerID="cri-o://5c47d3822ef7eca611c566b39bf21601bca85f11c46674c55009028019d21d7e" gracePeriod=30 Mar 16 15:51:40 crc kubenswrapper[5120]: I0316 15:51:40.415800 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="69b7941a-2f2b-4bc7-a7ea-26779c6290be" containerName="proxy-httpd" containerID="cri-o://b385c5993c7b727c871b9b6a3fcfd8b38449eabdfcf6b0e1142912060e044b89" gracePeriod=30 Mar 16 15:51:40 crc kubenswrapper[5120]: I0316 15:51:40.415808 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="69b7941a-2f2b-4bc7-a7ea-26779c6290be" containerName="sg-core" containerID="cri-o://251a89b692cafb8fe92540f83e5e12c7475d00c13010c6d31bab8b2657e40c4f" gracePeriod=30 Mar 16 15:51:40 crc kubenswrapper[5120]: I0316 15:51:40.415876 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="69b7941a-2f2b-4bc7-a7ea-26779c6290be" containerName="ceilometer-notification-agent" containerID="cri-o://71fab194b740faa6b610d32a33d4c742bd62819409add49d7708a73b2a300c04" gracePeriod=30 Mar 16 15:51:40 crc kubenswrapper[5120]: I0316 15:51:40.426376 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/ceilometer-0" podUID="69b7941a-2f2b-4bc7-a7ea-26779c6290be" containerName="proxy-httpd" probeResult="failure" output="Get \"http://10.217.0.158:3000/\": EOF" Mar 16 15:51:40 crc kubenswrapper[5120]: I0316 15:51:40.587010 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 15:51:40 crc kubenswrapper[5120]: I0316 15:51:40.588976 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="84bdc010-095b-47fa-af79-b1f91239a35a" containerName="glance-log" containerID="cri-o://3b39f68cca86722fc7d5f82cdfc477598e703c03c9b19c8972da41f9ede69798" gracePeriod=30 Mar 16 15:51:40 crc kubenswrapper[5120]: I0316 15:51:40.589017 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="84bdc010-095b-47fa-af79-b1f91239a35a" containerName="glance-httpd" containerID="cri-o://1d9c9b9eae9bd171927816b160679d4b48c3472eafea794426d88169c08e7a5f" gracePeriod=30 Mar 16 15:51:41 crc kubenswrapper[5120]: I0316 15:51:41.349556 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 15:51:41 crc kubenswrapper[5120]: I0316 15:51:41.350089 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="4688f659-b142-43b8-af64-5a69b67d8a1f" containerName="glance-log" containerID="cri-o://6efab2a50dd424ff12720aea04a4d57ef0c1445fe7abbe636010918437684cf6" gracePeriod=30 Mar 16 15:51:41 crc kubenswrapper[5120]: I0316 15:51:41.350491 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="4688f659-b142-43b8-af64-5a69b67d8a1f" containerName="glance-httpd" containerID="cri-o://187af767aa2963715d689e6cb76167e7a0574b85afe9feff2aeaef9b6bdc8ebd" gracePeriod=30 Mar 16 15:51:41 crc kubenswrapper[5120]: I0316 15:51:41.459500 5120 generic.go:358] "Generic (PLEG): container finished" podID="69b7941a-2f2b-4bc7-a7ea-26779c6290be" containerID="b385c5993c7b727c871b9b6a3fcfd8b38449eabdfcf6b0e1142912060e044b89" exitCode=0 Mar 16 15:51:41 crc kubenswrapper[5120]: I0316 15:51:41.459530 5120 generic.go:358] "Generic (PLEG): container finished" podID="69b7941a-2f2b-4bc7-a7ea-26779c6290be" containerID="251a89b692cafb8fe92540f83e5e12c7475d00c13010c6d31bab8b2657e40c4f" exitCode=2 Mar 16 15:51:41 crc kubenswrapper[5120]: I0316 15:51:41.459537 5120 generic.go:358] "Generic (PLEG): container finished" podID="69b7941a-2f2b-4bc7-a7ea-26779c6290be" containerID="71fab194b740faa6b610d32a33d4c742bd62819409add49d7708a73b2a300c04" exitCode=0 Mar 16 15:51:41 crc kubenswrapper[5120]: I0316 15:51:41.459543 5120 generic.go:358] "Generic (PLEG): container finished" podID="69b7941a-2f2b-4bc7-a7ea-26779c6290be" containerID="5c47d3822ef7eca611c566b39bf21601bca85f11c46674c55009028019d21d7e" exitCode=0 Mar 16 15:51:41 crc kubenswrapper[5120]: I0316 15:51:41.459896 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"69b7941a-2f2b-4bc7-a7ea-26779c6290be","Type":"ContainerDied","Data":"b385c5993c7b727c871b9b6a3fcfd8b38449eabdfcf6b0e1142912060e044b89"} Mar 16 15:51:41 crc kubenswrapper[5120]: I0316 15:51:41.459923 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"69b7941a-2f2b-4bc7-a7ea-26779c6290be","Type":"ContainerDied","Data":"251a89b692cafb8fe92540f83e5e12c7475d00c13010c6d31bab8b2657e40c4f"} Mar 16 15:51:41 crc kubenswrapper[5120]: I0316 15:51:41.459932 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"69b7941a-2f2b-4bc7-a7ea-26779c6290be","Type":"ContainerDied","Data":"71fab194b740faa6b610d32a33d4c742bd62819409add49d7708a73b2a300c04"} Mar 16 15:51:41 crc kubenswrapper[5120]: I0316 15:51:41.459939 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"69b7941a-2f2b-4bc7-a7ea-26779c6290be","Type":"ContainerDied","Data":"5c47d3822ef7eca611c566b39bf21601bca85f11c46674c55009028019d21d7e"} Mar 16 15:51:41 crc kubenswrapper[5120]: I0316 15:51:41.464310 5120 generic.go:358] "Generic (PLEG): container finished" podID="84bdc010-095b-47fa-af79-b1f91239a35a" containerID="3b39f68cca86722fc7d5f82cdfc477598e703c03c9b19c8972da41f9ede69798" exitCode=143 Mar 16 15:51:41 crc kubenswrapper[5120]: I0316 15:51:41.464465 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"84bdc010-095b-47fa-af79-b1f91239a35a","Type":"ContainerDied","Data":"3b39f68cca86722fc7d5f82cdfc477598e703c03c9b19c8972da41f9ede69798"} Mar 16 15:51:41 crc kubenswrapper[5120]: I0316 15:51:41.569707 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-nx5h9"] Mar 16 15:51:41 crc kubenswrapper[5120]: I0316 15:51:41.599070 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-db-create-nx5h9" Mar 16 15:51:41 crc kubenswrapper[5120]: I0316 15:51:41.612457 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-nx5h9"] Mar 16 15:51:41 crc kubenswrapper[5120]: I0316 15:51:41.640432 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmg6m\" (UniqueName: \"kubernetes.io/projected/9b8a74c0-777b-4320-af58-04656d3207e0-kube-api-access-gmg6m\") pod \"nova-api-db-create-nx5h9\" (UID: \"9b8a74c0-777b-4320-af58-04656d3207e0\") " pod="openstack-kuttl-tests/nova-api-db-create-nx5h9" Mar 16 15:51:41 crc kubenswrapper[5120]: I0316 15:51:41.640465 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9b8a74c0-777b-4320-af58-04656d3207e0-operator-scripts\") pod \"nova-api-db-create-nx5h9\" (UID: \"9b8a74c0-777b-4320-af58-04656d3207e0\") " pod="openstack-kuttl-tests/nova-api-db-create-nx5h9" Mar 16 15:51:41 crc kubenswrapper[5120]: I0316 15:51:41.656807 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-2tr4g"] Mar 16 15:51:41 crc kubenswrapper[5120]: I0316 15:51:41.668203 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-db-create-2tr4g" Mar 16 15:51:41 crc kubenswrapper[5120]: I0316 15:51:41.672433 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-2tr4g"] Mar 16 15:51:41 crc kubenswrapper[5120]: I0316 15:51:41.742052 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwcw9\" (UniqueName: \"kubernetes.io/projected/8404bf6f-e511-4cfa-adbb-649eb3a9a7d9-kube-api-access-nwcw9\") pod \"nova-cell0-db-create-2tr4g\" (UID: \"8404bf6f-e511-4cfa-adbb-649eb3a9a7d9\") " pod="openstack-kuttl-tests/nova-cell0-db-create-2tr4g" Mar 16 15:51:41 crc kubenswrapper[5120]: I0316 15:51:41.742172 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8404bf6f-e511-4cfa-adbb-649eb3a9a7d9-operator-scripts\") pod \"nova-cell0-db-create-2tr4g\" (UID: \"8404bf6f-e511-4cfa-adbb-649eb3a9a7d9\") " pod="openstack-kuttl-tests/nova-cell0-db-create-2tr4g" Mar 16 15:51:41 crc kubenswrapper[5120]: I0316 15:51:41.742272 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gmg6m\" (UniqueName: \"kubernetes.io/projected/9b8a74c0-777b-4320-af58-04656d3207e0-kube-api-access-gmg6m\") pod \"nova-api-db-create-nx5h9\" (UID: \"9b8a74c0-777b-4320-af58-04656d3207e0\") " pod="openstack-kuttl-tests/nova-api-db-create-nx5h9" Mar 16 15:51:41 crc kubenswrapper[5120]: I0316 15:51:41.742294 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9b8a74c0-777b-4320-af58-04656d3207e0-operator-scripts\") pod \"nova-api-db-create-nx5h9\" (UID: \"9b8a74c0-777b-4320-af58-04656d3207e0\") " pod="openstack-kuttl-tests/nova-api-db-create-nx5h9" Mar 16 15:51:41 crc kubenswrapper[5120]: I0316 15:51:41.744608 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9b8a74c0-777b-4320-af58-04656d3207e0-operator-scripts\") pod \"nova-api-db-create-nx5h9\" (UID: \"9b8a74c0-777b-4320-af58-04656d3207e0\") " pod="openstack-kuttl-tests/nova-api-db-create-nx5h9" Mar 16 15:51:41 crc kubenswrapper[5120]: I0316 15:51:41.756447 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0e93-account-create-update-gbtp8"] Mar 16 15:51:41 crc kubenswrapper[5120]: I0316 15:51:41.765161 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0e93-account-create-update-gbtp8" Mar 16 15:51:41 crc kubenswrapper[5120]: I0316 15:51:41.765916 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmg6m\" (UniqueName: \"kubernetes.io/projected/9b8a74c0-777b-4320-af58-04656d3207e0-kube-api-access-gmg6m\") pod \"nova-api-db-create-nx5h9\" (UID: \"9b8a74c0-777b-4320-af58-04656d3207e0\") " pod="openstack-kuttl-tests/nova-api-db-create-nx5h9" Mar 16 15:51:41 crc kubenswrapper[5120]: I0316 15:51:41.770382 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-db-secret\"" Mar 16 15:51:41 crc kubenswrapper[5120]: I0316 15:51:41.776346 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-7wc99"] Mar 16 15:51:41 crc kubenswrapper[5120]: I0316 15:51:41.788064 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-db-create-7wc99" Mar 16 15:51:41 crc kubenswrapper[5120]: I0316 15:51:41.793828 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0e93-account-create-update-gbtp8"] Mar 16 15:51:41 crc kubenswrapper[5120]: I0316 15:51:41.837644 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-7wc99"] Mar 16 15:51:41 crc kubenswrapper[5120]: I0316 15:51:41.844161 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8404bf6f-e511-4cfa-adbb-649eb3a9a7d9-operator-scripts\") pod \"nova-cell0-db-create-2tr4g\" (UID: \"8404bf6f-e511-4cfa-adbb-649eb3a9a7d9\") " pod="openstack-kuttl-tests/nova-cell0-db-create-2tr4g" Mar 16 15:51:41 crc kubenswrapper[5120]: I0316 15:51:41.844223 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4mh8\" (UniqueName: \"kubernetes.io/projected/fd113a80-a8fc-4706-8aec-eb299e36d6b8-kube-api-access-r4mh8\") pod \"nova-api-0e93-account-create-update-gbtp8\" (UID: \"fd113a80-a8fc-4706-8aec-eb299e36d6b8\") " pod="openstack-kuttl-tests/nova-api-0e93-account-create-update-gbtp8" Mar 16 15:51:41 crc kubenswrapper[5120]: I0316 15:51:41.844300 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-scd5v\" (UniqueName: \"kubernetes.io/projected/0f99ca47-2940-4787-8fea-9f7b86c6b844-kube-api-access-scd5v\") pod \"nova-cell1-db-create-7wc99\" (UID: \"0f99ca47-2940-4787-8fea-9f7b86c6b844\") " pod="openstack-kuttl-tests/nova-cell1-db-create-7wc99" Mar 16 15:51:41 crc kubenswrapper[5120]: I0316 15:51:41.844363 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/fd113a80-a8fc-4706-8aec-eb299e36d6b8-operator-scripts\") pod \"nova-api-0e93-account-create-update-gbtp8\" (UID: \"fd113a80-a8fc-4706-8aec-eb299e36d6b8\") " pod="openstack-kuttl-tests/nova-api-0e93-account-create-update-gbtp8" Mar 16 15:51:41 crc kubenswrapper[5120]: I0316 15:51:41.844390 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nwcw9\" (UniqueName: \"kubernetes.io/projected/8404bf6f-e511-4cfa-adbb-649eb3a9a7d9-kube-api-access-nwcw9\") pod \"nova-cell0-db-create-2tr4g\" (UID: \"8404bf6f-e511-4cfa-adbb-649eb3a9a7d9\") " pod="openstack-kuttl-tests/nova-cell0-db-create-2tr4g" Mar 16 15:51:41 crc kubenswrapper[5120]: I0316 15:51:41.844422 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0f99ca47-2940-4787-8fea-9f7b86c6b844-operator-scripts\") pod \"nova-cell1-db-create-7wc99\" (UID: \"0f99ca47-2940-4787-8fea-9f7b86c6b844\") " pod="openstack-kuttl-tests/nova-cell1-db-create-7wc99" Mar 16 15:51:41 crc kubenswrapper[5120]: I0316 15:51:41.845553 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8404bf6f-e511-4cfa-adbb-649eb3a9a7d9-operator-scripts\") pod \"nova-cell0-db-create-2tr4g\" (UID: \"8404bf6f-e511-4cfa-adbb-649eb3a9a7d9\") " pod="openstack-kuttl-tests/nova-cell0-db-create-2tr4g" Mar 16 15:51:41 crc kubenswrapper[5120]: I0316 15:51:41.869557 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:51:41 crc kubenswrapper[5120]: I0316 15:51:41.869560 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwcw9\" (UniqueName: \"kubernetes.io/projected/8404bf6f-e511-4cfa-adbb-649eb3a9a7d9-kube-api-access-nwcw9\") pod \"nova-cell0-db-create-2tr4g\" (UID: \"8404bf6f-e511-4cfa-adbb-649eb3a9a7d9\") " pod="openstack-kuttl-tests/nova-cell0-db-create-2tr4g" Mar 16 15:51:41 crc kubenswrapper[5120]: I0316 15:51:41.948255 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-db-create-nx5h9" Mar 16 15:51:41 crc kubenswrapper[5120]: I0316 15:51:41.950561 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0f99ca47-2940-4787-8fea-9f7b86c6b844-operator-scripts\") pod \"nova-cell1-db-create-7wc99\" (UID: \"0f99ca47-2940-4787-8fea-9f7b86c6b844\") " pod="openstack-kuttl-tests/nova-cell1-db-create-7wc99" Mar 16 15:51:41 crc kubenswrapper[5120]: I0316 15:51:41.950661 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r4mh8\" (UniqueName: \"kubernetes.io/projected/fd113a80-a8fc-4706-8aec-eb299e36d6b8-kube-api-access-r4mh8\") pod \"nova-api-0e93-account-create-update-gbtp8\" (UID: \"fd113a80-a8fc-4706-8aec-eb299e36d6b8\") " pod="openstack-kuttl-tests/nova-api-0e93-account-create-update-gbtp8" Mar 16 15:51:41 crc kubenswrapper[5120]: I0316 15:51:41.950785 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-scd5v\" (UniqueName: \"kubernetes.io/projected/0f99ca47-2940-4787-8fea-9f7b86c6b844-kube-api-access-scd5v\") pod \"nova-cell1-db-create-7wc99\" (UID: \"0f99ca47-2940-4787-8fea-9f7b86c6b844\") " pod="openstack-kuttl-tests/nova-cell1-db-create-7wc99" Mar 16 15:51:41 crc kubenswrapper[5120]: I0316 15:51:41.950890 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/fd113a80-a8fc-4706-8aec-eb299e36d6b8-operator-scripts\") pod \"nova-api-0e93-account-create-update-gbtp8\" (UID: \"fd113a80-a8fc-4706-8aec-eb299e36d6b8\") " pod="openstack-kuttl-tests/nova-api-0e93-account-create-update-gbtp8" Mar 16 15:51:41 crc kubenswrapper[5120]: I0316 15:51:41.951546 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/fd113a80-a8fc-4706-8aec-eb299e36d6b8-operator-scripts\") pod \"nova-api-0e93-account-create-update-gbtp8\" (UID: \"fd113a80-a8fc-4706-8aec-eb299e36d6b8\") " pod="openstack-kuttl-tests/nova-api-0e93-account-create-update-gbtp8" Mar 16 15:51:41 crc kubenswrapper[5120]: I0316 15:51:41.952161 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0f99ca47-2940-4787-8fea-9f7b86c6b844-operator-scripts\") pod \"nova-cell1-db-create-7wc99\" (UID: \"0f99ca47-2940-4787-8fea-9f7b86c6b844\") " pod="openstack-kuttl-tests/nova-cell1-db-create-7wc99" Mar 16 15:51:41 crc kubenswrapper[5120]: I0316 15:51:41.983300 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-9b99-account-create-update-nqhst"] Mar 16 15:51:41 crc kubenswrapper[5120]: I0316 15:51:41.993244 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-scd5v\" (UniqueName: \"kubernetes.io/projected/0f99ca47-2940-4787-8fea-9f7b86c6b844-kube-api-access-scd5v\") pod \"nova-cell1-db-create-7wc99\" (UID: \"0f99ca47-2940-4787-8fea-9f7b86c6b844\") " pod="openstack-kuttl-tests/nova-cell1-db-create-7wc99" Mar 16 15:51:41 crc kubenswrapper[5120]: I0316 15:51:41.993491 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-db-create-2tr4g" Mar 16 15:51:42 crc kubenswrapper[5120]: I0316 15:51:42.002508 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4mh8\" (UniqueName: \"kubernetes.io/projected/fd113a80-a8fc-4706-8aec-eb299e36d6b8-kube-api-access-r4mh8\") pod \"nova-api-0e93-account-create-update-gbtp8\" (UID: \"fd113a80-a8fc-4706-8aec-eb299e36d6b8\") " pod="openstack-kuttl-tests/nova-api-0e93-account-create-update-gbtp8" Mar 16 15:51:42 crc kubenswrapper[5120]: I0316 15:51:42.002790 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-9b99-account-create-update-nqhst" Mar 16 15:51:42 crc kubenswrapper[5120]: I0316 15:51:42.004605 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-db-secret\"" Mar 16 15:51:42 crc kubenswrapper[5120]: I0316 15:51:42.026574 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-9b99-account-create-update-nqhst"] Mar 16 15:51:42 crc kubenswrapper[5120]: I0316 15:51:42.029606 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:51:42 crc kubenswrapper[5120]: I0316 15:51:42.053549 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/69b7941a-2f2b-4bc7-a7ea-26779c6290be-config-data\") pod \"69b7941a-2f2b-4bc7-a7ea-26779c6290be\" (UID: \"69b7941a-2f2b-4bc7-a7ea-26779c6290be\") " Mar 16 15:51:42 crc kubenswrapper[5120]: I0316 15:51:42.071072 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/69b7941a-2f2b-4bc7-a7ea-26779c6290be-sg-core-conf-yaml\") pod \"69b7941a-2f2b-4bc7-a7ea-26779c6290be\" (UID: \"69b7941a-2f2b-4bc7-a7ea-26779c6290be\") " Mar 16 15:51:42 crc kubenswrapper[5120]: I0316 15:51:42.071118 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/69b7941a-2f2b-4bc7-a7ea-26779c6290be-log-httpd\") pod \"69b7941a-2f2b-4bc7-a7ea-26779c6290be\" (UID: \"69b7941a-2f2b-4bc7-a7ea-26779c6290be\") " Mar 16 15:51:42 crc kubenswrapper[5120]: I0316 15:51:42.071211 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/69b7941a-2f2b-4bc7-a7ea-26779c6290be-run-httpd\") pod \"69b7941a-2f2b-4bc7-a7ea-26779c6290be\" (UID: \"69b7941a-2f2b-4bc7-a7ea-26779c6290be\") " Mar 16 15:51:42 crc kubenswrapper[5120]: I0316 15:51:42.071274 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wl652\" (UniqueName: \"kubernetes.io/projected/69b7941a-2f2b-4bc7-a7ea-26779c6290be-kube-api-access-wl652\") pod \"69b7941a-2f2b-4bc7-a7ea-26779c6290be\" (UID: \"69b7941a-2f2b-4bc7-a7ea-26779c6290be\") " Mar 16 15:51:42 crc kubenswrapper[5120]: I0316 15:51:42.071339 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/69b7941a-2f2b-4bc7-a7ea-26779c6290be-combined-ca-bundle\") pod \"69b7941a-2f2b-4bc7-a7ea-26779c6290be\" (UID: \"69b7941a-2f2b-4bc7-a7ea-26779c6290be\") " Mar 16 15:51:42 crc kubenswrapper[5120]: I0316 15:51:42.071391 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/69b7941a-2f2b-4bc7-a7ea-26779c6290be-scripts\") pod \"69b7941a-2f2b-4bc7-a7ea-26779c6290be\" (UID: \"69b7941a-2f2b-4bc7-a7ea-26779c6290be\") " Mar 16 15:51:42 crc kubenswrapper[5120]: I0316 15:51:42.071871 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69b7941a-2f2b-4bc7-a7ea-26779c6290be-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "69b7941a-2f2b-4bc7-a7ea-26779c6290be" (UID: "69b7941a-2f2b-4bc7-a7ea-26779c6290be"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:51:42 crc kubenswrapper[5120]: I0316 15:51:42.073963 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69b7941a-2f2b-4bc7-a7ea-26779c6290be-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "69b7941a-2f2b-4bc7-a7ea-26779c6290be" (UID: "69b7941a-2f2b-4bc7-a7ea-26779c6290be"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:51:42 crc kubenswrapper[5120]: I0316 15:51:42.075527 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69b7941a-2f2b-4bc7-a7ea-26779c6290be-kube-api-access-wl652" (OuterVolumeSpecName: "kube-api-access-wl652") pod "69b7941a-2f2b-4bc7-a7ea-26779c6290be" (UID: "69b7941a-2f2b-4bc7-a7ea-26779c6290be"). InnerVolumeSpecName "kube-api-access-wl652". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:51:42 crc kubenswrapper[5120]: I0316 15:51:42.077180 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/fe9eadc5-0f96-4232-89f0-22cbe36c1a8f-operator-scripts\") pod \"nova-cell0-9b99-account-create-update-nqhst\" (UID: \"fe9eadc5-0f96-4232-89f0-22cbe36c1a8f\") " pod="openstack-kuttl-tests/nova-cell0-9b99-account-create-update-nqhst" Mar 16 15:51:42 crc kubenswrapper[5120]: I0316 15:51:42.077209 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svpz6\" (UniqueName: \"kubernetes.io/projected/fe9eadc5-0f96-4232-89f0-22cbe36c1a8f-kube-api-access-svpz6\") pod \"nova-cell0-9b99-account-create-update-nqhst\" (UID: \"fe9eadc5-0f96-4232-89f0-22cbe36c1a8f\") " pod="openstack-kuttl-tests/nova-cell0-9b99-account-create-update-nqhst" Mar 16 15:51:42 crc kubenswrapper[5120]: I0316 15:51:42.077349 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/69b7941a-2f2b-4bc7-a7ea-26779c6290be-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 15:51:42 crc kubenswrapper[5120]: I0316 15:51:42.077360 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/69b7941a-2f2b-4bc7-a7ea-26779c6290be-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 15:51:42 crc kubenswrapper[5120]: I0316 15:51:42.077368 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wl652\" (UniqueName: \"kubernetes.io/projected/69b7941a-2f2b-4bc7-a7ea-26779c6290be-kube-api-access-wl652\") on node \"crc\" DevicePath \"\"" Mar 16 15:51:42 crc kubenswrapper[5120]: I0316 15:51:42.082875 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69b7941a-2f2b-4bc7-a7ea-26779c6290be-scripts" (OuterVolumeSpecName: "scripts") pod "69b7941a-2f2b-4bc7-a7ea-26779c6290be" (UID: "69b7941a-2f2b-4bc7-a7ea-26779c6290be"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:51:42 crc kubenswrapper[5120]: I0316 15:51:42.117838 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69b7941a-2f2b-4bc7-a7ea-26779c6290be-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "69b7941a-2f2b-4bc7-a7ea-26779c6290be" (UID: "69b7941a-2f2b-4bc7-a7ea-26779c6290be"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:51:42 crc kubenswrapper[5120]: I0316 15:51:42.135656 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0e93-account-create-update-gbtp8" Mar 16 15:51:42 crc kubenswrapper[5120]: I0316 15:51:42.148229 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-db-create-7wc99" Mar 16 15:51:42 crc kubenswrapper[5120]: I0316 15:51:42.168312 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-0a49-account-create-update-56fsd"] Mar 16 15:51:42 crc kubenswrapper[5120]: I0316 15:51:42.169733 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69b7941a-2f2b-4bc7-a7ea-26779c6290be" containerName="ceilometer-notification-agent" Mar 16 15:51:42 crc kubenswrapper[5120]: I0316 15:51:42.169753 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="69b7941a-2f2b-4bc7-a7ea-26779c6290be" containerName="ceilometer-notification-agent" Mar 16 15:51:42 crc kubenswrapper[5120]: I0316 15:51:42.169809 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69b7941a-2f2b-4bc7-a7ea-26779c6290be" containerName="proxy-httpd" Mar 16 15:51:42 crc kubenswrapper[5120]: I0316 15:51:42.169816 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="69b7941a-2f2b-4bc7-a7ea-26779c6290be" containerName="proxy-httpd" Mar 16 15:51:42 crc kubenswrapper[5120]: I0316 15:51:42.169834 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69b7941a-2f2b-4bc7-a7ea-26779c6290be" containerName="sg-core" Mar 16 15:51:42 crc kubenswrapper[5120]: I0316 15:51:42.169840 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="69b7941a-2f2b-4bc7-a7ea-26779c6290be" containerName="sg-core" Mar 16 15:51:42 crc kubenswrapper[5120]: I0316 15:51:42.169861 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69b7941a-2f2b-4bc7-a7ea-26779c6290be" containerName="ceilometer-central-agent" Mar 16 15:51:42 crc kubenswrapper[5120]: I0316 15:51:42.169869 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="69b7941a-2f2b-4bc7-a7ea-26779c6290be" containerName="ceilometer-central-agent" Mar 16 15:51:42 crc kubenswrapper[5120]: I0316 15:51:42.170053 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="69b7941a-2f2b-4bc7-a7ea-26779c6290be" containerName="ceilometer-central-agent" Mar 16 15:51:42 crc kubenswrapper[5120]: I0316 15:51:42.170071 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="69b7941a-2f2b-4bc7-a7ea-26779c6290be" containerName="sg-core" Mar 16 15:51:42 crc kubenswrapper[5120]: I0316 15:51:42.170089 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="69b7941a-2f2b-4bc7-a7ea-26779c6290be" containerName="ceilometer-notification-agent" Mar 16 15:51:42 crc kubenswrapper[5120]: I0316 15:51:42.170109 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="69b7941a-2f2b-4bc7-a7ea-26779c6290be" containerName="proxy-httpd" Mar 16 15:51:42 crc kubenswrapper[5120]: I0316 15:51:42.180017 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/fe9eadc5-0f96-4232-89f0-22cbe36c1a8f-operator-scripts\") pod \"nova-cell0-9b99-account-create-update-nqhst\" (UID: \"fe9eadc5-0f96-4232-89f0-22cbe36c1a8f\") " pod="openstack-kuttl-tests/nova-cell0-9b99-account-create-update-nqhst" Mar 16 15:51:42 crc kubenswrapper[5120]: I0316 15:51:42.180051 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-svpz6\" (UniqueName: \"kubernetes.io/projected/fe9eadc5-0f96-4232-89f0-22cbe36c1a8f-kube-api-access-svpz6\") pod \"nova-cell0-9b99-account-create-update-nqhst\" (UID: \"fe9eadc5-0f96-4232-89f0-22cbe36c1a8f\") " pod="openstack-kuttl-tests/nova-cell0-9b99-account-create-update-nqhst" Mar 16 15:51:42 crc kubenswrapper[5120]: I0316 15:51:42.180144 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/69b7941a-2f2b-4bc7-a7ea-26779c6290be-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 15:51:42 crc kubenswrapper[5120]: I0316 15:51:42.180155 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/69b7941a-2f2b-4bc7-a7ea-26779c6290be-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 15:51:42 crc kubenswrapper[5120]: I0316 15:51:42.181202 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/fe9eadc5-0f96-4232-89f0-22cbe36c1a8f-operator-scripts\") pod \"nova-cell0-9b99-account-create-update-nqhst\" (UID: \"fe9eadc5-0f96-4232-89f0-22cbe36c1a8f\") " pod="openstack-kuttl-tests/nova-cell0-9b99-account-create-update-nqhst" Mar 16 15:51:42 crc kubenswrapper[5120]: I0316 15:51:42.181587 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-0a49-account-create-update-56fsd"] Mar 16 15:51:42 crc kubenswrapper[5120]: I0316 15:51:42.181778 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-0a49-account-create-update-56fsd" Mar 16 15:51:42 crc kubenswrapper[5120]: I0316 15:51:42.184574 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-db-secret\"" Mar 16 15:51:42 crc kubenswrapper[5120]: I0316 15:51:42.206589 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-svpz6\" (UniqueName: \"kubernetes.io/projected/fe9eadc5-0f96-4232-89f0-22cbe36c1a8f-kube-api-access-svpz6\") pod \"nova-cell0-9b99-account-create-update-nqhst\" (UID: \"fe9eadc5-0f96-4232-89f0-22cbe36c1a8f\") " pod="openstack-kuttl-tests/nova-cell0-9b99-account-create-update-nqhst" Mar 16 15:51:42 crc kubenswrapper[5120]: I0316 15:51:42.250884 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69b7941a-2f2b-4bc7-a7ea-26779c6290be-config-data" (OuterVolumeSpecName: "config-data") pod "69b7941a-2f2b-4bc7-a7ea-26779c6290be" (UID: "69b7941a-2f2b-4bc7-a7ea-26779c6290be"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:51:42 crc kubenswrapper[5120]: I0316 15:51:42.260001 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69b7941a-2f2b-4bc7-a7ea-26779c6290be-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "69b7941a-2f2b-4bc7-a7ea-26779c6290be" (UID: "69b7941a-2f2b-4bc7-a7ea-26779c6290be"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:51:42 crc kubenswrapper[5120]: I0316 15:51:42.282930 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbdlz\" (UniqueName: \"kubernetes.io/projected/aa51d995-3c54-4c86-9103-bd38ca52653d-kube-api-access-cbdlz\") pod \"nova-cell1-0a49-account-create-update-56fsd\" (UID: \"aa51d995-3c54-4c86-9103-bd38ca52653d\") " pod="openstack-kuttl-tests/nova-cell1-0a49-account-create-update-56fsd" Mar 16 15:51:42 crc kubenswrapper[5120]: I0316 15:51:42.283083 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/aa51d995-3c54-4c86-9103-bd38ca52653d-operator-scripts\") pod \"nova-cell1-0a49-account-create-update-56fsd\" (UID: \"aa51d995-3c54-4c86-9103-bd38ca52653d\") " pod="openstack-kuttl-tests/nova-cell1-0a49-account-create-update-56fsd" Mar 16 15:51:42 crc kubenswrapper[5120]: I0316 15:51:42.283166 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/69b7941a-2f2b-4bc7-a7ea-26779c6290be-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:51:42 crc kubenswrapper[5120]: I0316 15:51:42.283176 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/69b7941a-2f2b-4bc7-a7ea-26779c6290be-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 15:51:42 crc kubenswrapper[5120]: I0316 15:51:42.283428 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-v822j_ac55471d-4e42-475f-a082-50f611571482/kube-multus/0.log" Mar 16 15:51:42 crc kubenswrapper[5120]: I0316 15:51:42.296604 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-v822j_ac55471d-4e42-475f-a082-50f611571482/kube-multus/0.log" Mar 16 15:51:42 crc kubenswrapper[5120]: I0316 15:51:42.310887 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-crc_9f0bc7fcb0822a2c13eb2d22cd8c0641/kube-controller-manager/0.log" Mar 16 15:51:42 crc kubenswrapper[5120]: I0316 15:51:42.313823 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-crc_9f0bc7fcb0822a2c13eb2d22cd8c0641/kube-controller-manager/0.log" Mar 16 15:51:42 crc kubenswrapper[5120]: I0316 15:51:42.384864 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/aa51d995-3c54-4c86-9103-bd38ca52653d-operator-scripts\") pod \"nova-cell1-0a49-account-create-update-56fsd\" (UID: \"aa51d995-3c54-4c86-9103-bd38ca52653d\") " pod="openstack-kuttl-tests/nova-cell1-0a49-account-create-update-56fsd" Mar 16 15:51:42 crc kubenswrapper[5120]: I0316 15:51:42.385312 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cbdlz\" (UniqueName: \"kubernetes.io/projected/aa51d995-3c54-4c86-9103-bd38ca52653d-kube-api-access-cbdlz\") pod \"nova-cell1-0a49-account-create-update-56fsd\" (UID: \"aa51d995-3c54-4c86-9103-bd38ca52653d\") " pod="openstack-kuttl-tests/nova-cell1-0a49-account-create-update-56fsd" Mar 16 15:51:42 crc kubenswrapper[5120]: I0316 15:51:42.385564 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-9b99-account-create-update-nqhst" Mar 16 15:51:42 crc kubenswrapper[5120]: I0316 15:51:42.385878 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/aa51d995-3c54-4c86-9103-bd38ca52653d-operator-scripts\") pod \"nova-cell1-0a49-account-create-update-56fsd\" (UID: \"aa51d995-3c54-4c86-9103-bd38ca52653d\") " pod="openstack-kuttl-tests/nova-cell1-0a49-account-create-update-56fsd" Mar 16 15:51:42 crc kubenswrapper[5120]: I0316 15:51:42.422598 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbdlz\" (UniqueName: \"kubernetes.io/projected/aa51d995-3c54-4c86-9103-bd38ca52653d-kube-api-access-cbdlz\") pod \"nova-cell1-0a49-account-create-update-56fsd\" (UID: \"aa51d995-3c54-4c86-9103-bd38ca52653d\") " pod="openstack-kuttl-tests/nova-cell1-0a49-account-create-update-56fsd" Mar 16 15:51:42 crc kubenswrapper[5120]: I0316 15:51:42.437299 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/swift-proxy-59c794978b-lzrxq" Mar 16 15:51:42 crc kubenswrapper[5120]: I0316 15:51:42.439941 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/swift-proxy-59c794978b-lzrxq" Mar 16 15:51:42 crc kubenswrapper[5120]: I0316 15:51:42.517013 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"69b7941a-2f2b-4bc7-a7ea-26779c6290be","Type":"ContainerDied","Data":"d2c9e35521a49387396f1d31858f711acaf1bc5959bdaae5f8edb9152e2cade6"} Mar 16 15:51:42 crc kubenswrapper[5120]: I0316 15:51:42.517065 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:51:42 crc kubenswrapper[5120]: I0316 15:51:42.517090 5120 scope.go:117] "RemoveContainer" containerID="b385c5993c7b727c871b9b6a3fcfd8b38449eabdfcf6b0e1142912060e044b89" Mar 16 15:51:42 crc kubenswrapper[5120]: I0316 15:51:42.525775 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-0a49-account-create-update-56fsd" Mar 16 15:51:42 crc kubenswrapper[5120]: I0316 15:51:42.538448 5120 generic.go:358] "Generic (PLEG): container finished" podID="4688f659-b142-43b8-af64-5a69b67d8a1f" containerID="6efab2a50dd424ff12720aea04a4d57ef0c1445fe7abbe636010918437684cf6" exitCode=143 Mar 16 15:51:42 crc kubenswrapper[5120]: I0316 15:51:42.538850 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"4688f659-b142-43b8-af64-5a69b67d8a1f","Type":"ContainerDied","Data":"6efab2a50dd424ff12720aea04a4d57ef0c1445fe7abbe636010918437684cf6"} Mar 16 15:51:42 crc kubenswrapper[5120]: I0316 15:51:42.542826 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstackclient" event={"ID":"d6f8b8b2-e94a-4c67-9e6d-be16e2acbdcc","Type":"ContainerStarted","Data":"5beb51d5bb791063b06be012ed5435a350b1e205f8fa5e3c6377d8212b33d428"} Mar 16 15:51:42 crc kubenswrapper[5120]: I0316 15:51:42.574034 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstackclient" podStartSLOduration=1.848150917 podStartE2EDuration="11.574012852s" podCreationTimestamp="2026-03-16 15:51:31 +0000 UTC" firstStartedPulling="2026-03-16 15:51:32.005091993 +0000 UTC m=+1194.159023650" lastFinishedPulling="2026-03-16 15:51:41.730953928 +0000 UTC m=+1203.884885585" observedRunningTime="2026-03-16 15:51:42.568136075 +0000 UTC m=+1204.722067732" watchObservedRunningTime="2026-03-16 15:51:42.574012852 +0000 UTC m=+1204.727944509" Mar 16 15:51:42 crc kubenswrapper[5120]: I0316 15:51:42.621223 5120 scope.go:117] "RemoveContainer" containerID="251a89b692cafb8fe92540f83e5e12c7475d00c13010c6d31bab8b2657e40c4f" Mar 16 15:51:42 crc kubenswrapper[5120]: I0316 15:51:42.640989 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 15:51:42 crc kubenswrapper[5120]: I0316 15:51:42.699097 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 15:51:42 crc kubenswrapper[5120]: I0316 15:51:42.699138 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-nx5h9"] Mar 16 15:51:42 crc kubenswrapper[5120]: I0316 15:51:42.699201 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 15:51:42 crc kubenswrapper[5120]: I0316 15:51:42.719291 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 15:51:42 crc kubenswrapper[5120]: I0316 15:51:42.719427 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:51:42 crc kubenswrapper[5120]: I0316 15:51:42.722450 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 15:51:42 crc kubenswrapper[5120]: I0316 15:51:42.722637 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 15:51:42 crc kubenswrapper[5120]: I0316 15:51:42.724444 5120 scope.go:117] "RemoveContainer" containerID="71fab194b740faa6b610d32a33d4c742bd62819409add49d7708a73b2a300c04" Mar 16 15:51:42 crc kubenswrapper[5120]: I0316 15:51:42.725059 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-2tr4g"] Mar 16 15:51:42 crc kubenswrapper[5120]: I0316 15:51:42.792680 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8jpb\" (UniqueName: \"kubernetes.io/projected/01c946cf-bde7-424b-b7ed-8dc510218e82-kube-api-access-b8jpb\") pod \"ceilometer-0\" (UID: \"01c946cf-bde7-424b-b7ed-8dc510218e82\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:51:42 crc kubenswrapper[5120]: I0316 15:51:42.792740 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/01c946cf-bde7-424b-b7ed-8dc510218e82-log-httpd\") pod \"ceilometer-0\" (UID: \"01c946cf-bde7-424b-b7ed-8dc510218e82\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:51:42 crc kubenswrapper[5120]: I0316 15:51:42.792776 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/01c946cf-bde7-424b-b7ed-8dc510218e82-scripts\") pod \"ceilometer-0\" (UID: \"01c946cf-bde7-424b-b7ed-8dc510218e82\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:51:42 crc kubenswrapper[5120]: I0316 15:51:42.792824 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/01c946cf-bde7-424b-b7ed-8dc510218e82-config-data\") pod \"ceilometer-0\" (UID: \"01c946cf-bde7-424b-b7ed-8dc510218e82\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:51:42 crc kubenswrapper[5120]: I0316 15:51:42.792838 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/01c946cf-bde7-424b-b7ed-8dc510218e82-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"01c946cf-bde7-424b-b7ed-8dc510218e82\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:51:42 crc kubenswrapper[5120]: I0316 15:51:42.792914 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/01c946cf-bde7-424b-b7ed-8dc510218e82-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"01c946cf-bde7-424b-b7ed-8dc510218e82\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:51:42 crc kubenswrapper[5120]: I0316 15:51:42.792981 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/01c946cf-bde7-424b-b7ed-8dc510218e82-run-httpd\") pod \"ceilometer-0\" (UID: \"01c946cf-bde7-424b-b7ed-8dc510218e82\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:51:42 crc kubenswrapper[5120]: I0316 15:51:42.825527 5120 scope.go:117] "RemoveContainer" containerID="5c47d3822ef7eca611c566b39bf21601bca85f11c46674c55009028019d21d7e" Mar 16 15:51:42 crc kubenswrapper[5120]: I0316 15:51:42.894681 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/01c946cf-bde7-424b-b7ed-8dc510218e82-run-httpd\") pod \"ceilometer-0\" (UID: \"01c946cf-bde7-424b-b7ed-8dc510218e82\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:51:42 crc kubenswrapper[5120]: I0316 15:51:42.894781 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b8jpb\" (UniqueName: \"kubernetes.io/projected/01c946cf-bde7-424b-b7ed-8dc510218e82-kube-api-access-b8jpb\") pod \"ceilometer-0\" (UID: \"01c946cf-bde7-424b-b7ed-8dc510218e82\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:51:42 crc kubenswrapper[5120]: I0316 15:51:42.894821 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/01c946cf-bde7-424b-b7ed-8dc510218e82-log-httpd\") pod \"ceilometer-0\" (UID: \"01c946cf-bde7-424b-b7ed-8dc510218e82\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:51:42 crc kubenswrapper[5120]: I0316 15:51:42.894841 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/01c946cf-bde7-424b-b7ed-8dc510218e82-scripts\") pod \"ceilometer-0\" (UID: \"01c946cf-bde7-424b-b7ed-8dc510218e82\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:51:42 crc kubenswrapper[5120]: I0316 15:51:42.894888 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/01c946cf-bde7-424b-b7ed-8dc510218e82-config-data\") pod \"ceilometer-0\" (UID: \"01c946cf-bde7-424b-b7ed-8dc510218e82\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:51:42 crc kubenswrapper[5120]: I0316 15:51:42.895031 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/01c946cf-bde7-424b-b7ed-8dc510218e82-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"01c946cf-bde7-424b-b7ed-8dc510218e82\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:51:42 crc kubenswrapper[5120]: I0316 15:51:42.895217 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/01c946cf-bde7-424b-b7ed-8dc510218e82-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"01c946cf-bde7-424b-b7ed-8dc510218e82\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:51:42 crc kubenswrapper[5120]: I0316 15:51:42.895920 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/01c946cf-bde7-424b-b7ed-8dc510218e82-run-httpd\") pod \"ceilometer-0\" (UID: \"01c946cf-bde7-424b-b7ed-8dc510218e82\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:51:42 crc kubenswrapper[5120]: I0316 15:51:42.896226 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/01c946cf-bde7-424b-b7ed-8dc510218e82-log-httpd\") pod \"ceilometer-0\" (UID: \"01c946cf-bde7-424b-b7ed-8dc510218e82\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:51:42 crc kubenswrapper[5120]: I0316 15:51:42.900933 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/01c946cf-bde7-424b-b7ed-8dc510218e82-scripts\") pod \"ceilometer-0\" (UID: \"01c946cf-bde7-424b-b7ed-8dc510218e82\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:51:42 crc kubenswrapper[5120]: I0316 15:51:42.901241 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/01c946cf-bde7-424b-b7ed-8dc510218e82-config-data\") pod \"ceilometer-0\" (UID: \"01c946cf-bde7-424b-b7ed-8dc510218e82\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:51:42 crc kubenswrapper[5120]: I0316 15:51:42.901258 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/01c946cf-bde7-424b-b7ed-8dc510218e82-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"01c946cf-bde7-424b-b7ed-8dc510218e82\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:51:42 crc kubenswrapper[5120]: I0316 15:51:42.902065 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/01c946cf-bde7-424b-b7ed-8dc510218e82-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"01c946cf-bde7-424b-b7ed-8dc510218e82\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:51:42 crc kubenswrapper[5120]: I0316 15:51:42.911090 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8jpb\" (UniqueName: \"kubernetes.io/projected/01c946cf-bde7-424b-b7ed-8dc510218e82-kube-api-access-b8jpb\") pod \"ceilometer-0\" (UID: \"01c946cf-bde7-424b-b7ed-8dc510218e82\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:51:42 crc kubenswrapper[5120]: I0316 15:51:42.966778 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-7wc99"] Mar 16 15:51:43 crc kubenswrapper[5120]: I0316 15:51:43.084037 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:51:43 crc kubenswrapper[5120]: I0316 15:51:43.123205 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-9b99-account-create-update-nqhst"] Mar 16 15:51:43 crc kubenswrapper[5120]: I0316 15:51:43.160537 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0e93-account-create-update-gbtp8"] Mar 16 15:51:43 crc kubenswrapper[5120]: I0316 15:51:43.336772 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-0a49-account-create-update-56fsd"] Mar 16 15:51:43 crc kubenswrapper[5120]: I0316 15:51:43.508412 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 15:51:43 crc kubenswrapper[5120]: I0316 15:51:43.560896 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-9b99-account-create-update-nqhst" event={"ID":"fe9eadc5-0f96-4232-89f0-22cbe36c1a8f","Type":"ContainerStarted","Data":"44ca4a64c687729eb62d16af5e7e27badb4c4bfe19b529f9419ce7491f5a92ca"} Mar 16 15:51:43 crc kubenswrapper[5120]: I0316 15:51:43.560938 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-9b99-account-create-update-nqhst" event={"ID":"fe9eadc5-0f96-4232-89f0-22cbe36c1a8f","Type":"ContainerStarted","Data":"094311d7c24db4d57e7ba384874d14a11a42e746b1cffa0ec31af13c35b2a1a2"} Mar 16 15:51:43 crc kubenswrapper[5120]: I0316 15:51:43.571180 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0e93-account-create-update-gbtp8" event={"ID":"fd113a80-a8fc-4706-8aec-eb299e36d6b8","Type":"ContainerStarted","Data":"6cdcdcd328eec0f5033841269234934b99e5df8450bc25eb4a989d603135a07d"} Mar 16 15:51:43 crc kubenswrapper[5120]: I0316 15:51:43.571243 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0e93-account-create-update-gbtp8" event={"ID":"fd113a80-a8fc-4706-8aec-eb299e36d6b8","Type":"ContainerStarted","Data":"95814a6e90b1a4b1ab7f59207476c24f90deee44788d2233d3f3e5bb9199c28a"} Mar 16 15:51:43 crc kubenswrapper[5120]: I0316 15:51:43.576531 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-9b99-account-create-update-nqhst" podStartSLOduration=2.576513696 podStartE2EDuration="2.576513696s" podCreationTimestamp="2026-03-16 15:51:41 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:51:43.572862721 +0000 UTC m=+1205.726794378" watchObservedRunningTime="2026-03-16 15:51:43.576513696 +0000 UTC m=+1205.730445343" Mar 16 15:51:43 crc kubenswrapper[5120]: I0316 15:51:43.582583 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-0a49-account-create-update-56fsd" event={"ID":"aa51d995-3c54-4c86-9103-bd38ca52653d","Type":"ContainerStarted","Data":"112dbba8856c446bd6abdf358759e3fe24690855ee652175b946642eee698276"} Mar 16 15:51:43 crc kubenswrapper[5120]: I0316 15:51:43.593382 5120 generic.go:358] "Generic (PLEG): container finished" podID="9b8a74c0-777b-4320-af58-04656d3207e0" containerID="be52bb163ed3add057ca7098cd985f8c3ba5b69ecf92424bbd40d24fb51fdaa3" exitCode=0 Mar 16 15:51:43 crc kubenswrapper[5120]: I0316 15:51:43.593570 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-db-create-nx5h9" event={"ID":"9b8a74c0-777b-4320-af58-04656d3207e0","Type":"ContainerDied","Data":"be52bb163ed3add057ca7098cd985f8c3ba5b69ecf92424bbd40d24fb51fdaa3"} Mar 16 15:51:43 crc kubenswrapper[5120]: I0316 15:51:43.593615 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-db-create-nx5h9" event={"ID":"9b8a74c0-777b-4320-af58-04656d3207e0","Type":"ContainerStarted","Data":"c0d954177a8964511db0bf2848b7c0aa2af20115bc4d4fb5f8a37802e0970b75"} Mar 16 15:51:43 crc kubenswrapper[5120]: I0316 15:51:43.594612 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0e93-account-create-update-gbtp8" podStartSLOduration=2.5946008259999997 podStartE2EDuration="2.594600826s" podCreationTimestamp="2026-03-16 15:51:41 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:51:43.591888933 +0000 UTC m=+1205.745820590" watchObservedRunningTime="2026-03-16 15:51:43.594600826 +0000 UTC m=+1205.748532473" Mar 16 15:51:43 crc kubenswrapper[5120]: I0316 15:51:43.600432 5120 generic.go:358] "Generic (PLEG): container finished" podID="8404bf6f-e511-4cfa-adbb-649eb3a9a7d9" containerID="bfd0553412a6b7cc899b0fe6e8ed5a6f2cdf575d9656d1ba04bf51a02d573888" exitCode=0 Mar 16 15:51:43 crc kubenswrapper[5120]: I0316 15:51:43.600672 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-db-create-2tr4g" event={"ID":"8404bf6f-e511-4cfa-adbb-649eb3a9a7d9","Type":"ContainerDied","Data":"bfd0553412a6b7cc899b0fe6e8ed5a6f2cdf575d9656d1ba04bf51a02d573888"} Mar 16 15:51:43 crc kubenswrapper[5120]: I0316 15:51:43.600701 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-db-create-2tr4g" event={"ID":"8404bf6f-e511-4cfa-adbb-649eb3a9a7d9","Type":"ContainerStarted","Data":"82a546a047211b5737f84f1af325b6491875ba7fb1fb7cbe18c662b788f0acd7"} Mar 16 15:51:43 crc kubenswrapper[5120]: I0316 15:51:43.611038 5120 generic.go:358] "Generic (PLEG): container finished" podID="0f99ca47-2940-4787-8fea-9f7b86c6b844" containerID="1c4b46f3f8f7a7cbd61606528b240ee9f66c088250fcf1c87e7d8987acf3131c" exitCode=0 Mar 16 15:51:43 crc kubenswrapper[5120]: I0316 15:51:43.611466 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-db-create-7wc99" event={"ID":"0f99ca47-2940-4787-8fea-9f7b86c6b844","Type":"ContainerDied","Data":"1c4b46f3f8f7a7cbd61606528b240ee9f66c088250fcf1c87e7d8987acf3131c"} Mar 16 15:51:43 crc kubenswrapper[5120]: I0316 15:51:43.611501 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-db-create-7wc99" event={"ID":"0f99ca47-2940-4787-8fea-9f7b86c6b844","Type":"ContainerStarted","Data":"59f55f94627d83c83a04937f8dc7f8a561c8dc1e9cc68baad393a65baaffd587"} Mar 16 15:51:43 crc kubenswrapper[5120]: I0316 15:51:43.636198 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 15:51:43 crc kubenswrapper[5120]: W0316 15:51:43.637957 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod01c946cf_bde7_424b_b7ed_8dc510218e82.slice/crio-7ef0fa25caf2c84429cbff559feadc9c67a1e53074e7554d4d97de4ce8bc0319 WatchSource:0}: Error finding container 7ef0fa25caf2c84429cbff559feadc9c67a1e53074e7554d4d97de4ce8bc0319: Status 404 returned error can't find the container with id 7ef0fa25caf2c84429cbff559feadc9c67a1e53074e7554d4d97de4ce8bc0319 Mar 16 15:51:44 crc kubenswrapper[5120]: I0316 15:51:44.198385 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:51:44 crc kubenswrapper[5120]: I0316 15:51:44.330168 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"84bdc010-095b-47fa-af79-b1f91239a35a\" (UID: \"84bdc010-095b-47fa-af79-b1f91239a35a\") " Mar 16 15:51:44 crc kubenswrapper[5120]: I0316 15:51:44.331022 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/84bdc010-095b-47fa-af79-b1f91239a35a-logs\") pod \"84bdc010-095b-47fa-af79-b1f91239a35a\" (UID: \"84bdc010-095b-47fa-af79-b1f91239a35a\") " Mar 16 15:51:44 crc kubenswrapper[5120]: I0316 15:51:44.331295 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/84bdc010-095b-47fa-af79-b1f91239a35a-public-tls-certs\") pod \"84bdc010-095b-47fa-af79-b1f91239a35a\" (UID: \"84bdc010-095b-47fa-af79-b1f91239a35a\") " Mar 16 15:51:44 crc kubenswrapper[5120]: I0316 15:51:44.331443 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/84bdc010-095b-47fa-af79-b1f91239a35a-combined-ca-bundle\") pod \"84bdc010-095b-47fa-af79-b1f91239a35a\" (UID: \"84bdc010-095b-47fa-af79-b1f91239a35a\") " Mar 16 15:51:44 crc kubenswrapper[5120]: I0316 15:51:44.331599 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qzj2b\" (UniqueName: \"kubernetes.io/projected/84bdc010-095b-47fa-af79-b1f91239a35a-kube-api-access-qzj2b\") pod \"84bdc010-095b-47fa-af79-b1f91239a35a\" (UID: \"84bdc010-095b-47fa-af79-b1f91239a35a\") " Mar 16 15:51:44 crc kubenswrapper[5120]: I0316 15:51:44.331665 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/84bdc010-095b-47fa-af79-b1f91239a35a-config-data\") pod \"84bdc010-095b-47fa-af79-b1f91239a35a\" (UID: \"84bdc010-095b-47fa-af79-b1f91239a35a\") " Mar 16 15:51:44 crc kubenswrapper[5120]: I0316 15:51:44.331734 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/84bdc010-095b-47fa-af79-b1f91239a35a-httpd-run\") pod \"84bdc010-095b-47fa-af79-b1f91239a35a\" (UID: \"84bdc010-095b-47fa-af79-b1f91239a35a\") " Mar 16 15:51:44 crc kubenswrapper[5120]: I0316 15:51:44.332368 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84bdc010-095b-47fa-af79-b1f91239a35a-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "84bdc010-095b-47fa-af79-b1f91239a35a" (UID: "84bdc010-095b-47fa-af79-b1f91239a35a"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:51:44 crc kubenswrapper[5120]: I0316 15:51:44.332526 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/84bdc010-095b-47fa-af79-b1f91239a35a-scripts\") pod \"84bdc010-095b-47fa-af79-b1f91239a35a\" (UID: \"84bdc010-095b-47fa-af79-b1f91239a35a\") " Mar 16 15:51:44 crc kubenswrapper[5120]: I0316 15:51:44.332866 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84bdc010-095b-47fa-af79-b1f91239a35a-logs" (OuterVolumeSpecName: "logs") pod "84bdc010-095b-47fa-af79-b1f91239a35a" (UID: "84bdc010-095b-47fa-af79-b1f91239a35a"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:51:44 crc kubenswrapper[5120]: I0316 15:51:44.334884 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/84bdc010-095b-47fa-af79-b1f91239a35a-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 15:51:44 crc kubenswrapper[5120]: I0316 15:51:44.335032 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/84bdc010-095b-47fa-af79-b1f91239a35a-logs\") on node \"crc\" DevicePath \"\"" Mar 16 15:51:44 crc kubenswrapper[5120]: I0316 15:51:44.335380 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage13-crc" (OuterVolumeSpecName: "glance") pod "84bdc010-095b-47fa-af79-b1f91239a35a" (UID: "84bdc010-095b-47fa-af79-b1f91239a35a"). InnerVolumeSpecName "local-storage13-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 15:51:44 crc kubenswrapper[5120]: I0316 15:51:44.337731 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84bdc010-095b-47fa-af79-b1f91239a35a-kube-api-access-qzj2b" (OuterVolumeSpecName: "kube-api-access-qzj2b") pod "84bdc010-095b-47fa-af79-b1f91239a35a" (UID: "84bdc010-095b-47fa-af79-b1f91239a35a"). InnerVolumeSpecName "kube-api-access-qzj2b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:51:44 crc kubenswrapper[5120]: I0316 15:51:44.339542 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/84bdc010-095b-47fa-af79-b1f91239a35a-scripts" (OuterVolumeSpecName: "scripts") pod "84bdc010-095b-47fa-af79-b1f91239a35a" (UID: "84bdc010-095b-47fa-af79-b1f91239a35a"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:51:44 crc kubenswrapper[5120]: I0316 15:51:44.365132 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/84bdc010-095b-47fa-af79-b1f91239a35a-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "84bdc010-095b-47fa-af79-b1f91239a35a" (UID: "84bdc010-095b-47fa-af79-b1f91239a35a"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:51:44 crc kubenswrapper[5120]: I0316 15:51:44.395612 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/84bdc010-095b-47fa-af79-b1f91239a35a-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "84bdc010-095b-47fa-af79-b1f91239a35a" (UID: "84bdc010-095b-47fa-af79-b1f91239a35a"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:51:44 crc kubenswrapper[5120]: I0316 15:51:44.405868 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/84bdc010-095b-47fa-af79-b1f91239a35a-config-data" (OuterVolumeSpecName: "config-data") pod "84bdc010-095b-47fa-af79-b1f91239a35a" (UID: "84bdc010-095b-47fa-af79-b1f91239a35a"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:51:44 crc kubenswrapper[5120]: I0316 15:51:44.439343 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/84bdc010-095b-47fa-af79-b1f91239a35a-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 15:51:44 crc kubenswrapper[5120]: I0316 15:51:44.439383 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/84bdc010-095b-47fa-af79-b1f91239a35a-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:51:44 crc kubenswrapper[5120]: I0316 15:51:44.439395 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qzj2b\" (UniqueName: \"kubernetes.io/projected/84bdc010-095b-47fa-af79-b1f91239a35a-kube-api-access-qzj2b\") on node \"crc\" DevicePath \"\"" Mar 16 15:51:44 crc kubenswrapper[5120]: I0316 15:51:44.439410 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/84bdc010-095b-47fa-af79-b1f91239a35a-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 15:51:44 crc kubenswrapper[5120]: I0316 15:51:44.439421 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/84bdc010-095b-47fa-af79-b1f91239a35a-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 15:51:44 crc kubenswrapper[5120]: I0316 15:51:44.439450 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") on node \"crc\" " Mar 16 15:51:44 crc kubenswrapper[5120]: I0316 15:51:44.462980 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage13-crc" (UniqueName: "kubernetes.io/local-volume/local-storage13-crc") on node "crc" Mar 16 15:51:44 crc kubenswrapper[5120]: I0316 15:51:44.541613 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") on node \"crc\" DevicePath \"\"" Mar 16 15:51:44 crc kubenswrapper[5120]: I0316 15:51:44.629469 5120 generic.go:358] "Generic (PLEG): container finished" podID="84bdc010-095b-47fa-af79-b1f91239a35a" containerID="1d9c9b9eae9bd171927816b160679d4b48c3472eafea794426d88169c08e7a5f" exitCode=0 Mar 16 15:51:44 crc kubenswrapper[5120]: I0316 15:51:44.629563 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"84bdc010-095b-47fa-af79-b1f91239a35a","Type":"ContainerDied","Data":"1d9c9b9eae9bd171927816b160679d4b48c3472eafea794426d88169c08e7a5f"} Mar 16 15:51:44 crc kubenswrapper[5120]: I0316 15:51:44.629595 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"84bdc010-095b-47fa-af79-b1f91239a35a","Type":"ContainerDied","Data":"ab9b5d49cf9f9a4f559925b73bd792496b4b283d9c61f39ade6ff7e3ce4405a2"} Mar 16 15:51:44 crc kubenswrapper[5120]: I0316 15:51:44.629612 5120 scope.go:117] "RemoveContainer" containerID="1d9c9b9eae9bd171927816b160679d4b48c3472eafea794426d88169c08e7a5f" Mar 16 15:51:44 crc kubenswrapper[5120]: I0316 15:51:44.629749 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:51:44 crc kubenswrapper[5120]: I0316 15:51:44.644360 5120 generic.go:358] "Generic (PLEG): container finished" podID="fe9eadc5-0f96-4232-89f0-22cbe36c1a8f" containerID="44ca4a64c687729eb62d16af5e7e27badb4c4bfe19b529f9419ce7491f5a92ca" exitCode=0 Mar 16 15:51:44 crc kubenswrapper[5120]: I0316 15:51:44.644463 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-9b99-account-create-update-nqhst" event={"ID":"fe9eadc5-0f96-4232-89f0-22cbe36c1a8f","Type":"ContainerDied","Data":"44ca4a64c687729eb62d16af5e7e27badb4c4bfe19b529f9419ce7491f5a92ca"} Mar 16 15:51:44 crc kubenswrapper[5120]: I0316 15:51:44.654833 5120 generic.go:358] "Generic (PLEG): container finished" podID="fd113a80-a8fc-4706-8aec-eb299e36d6b8" containerID="6cdcdcd328eec0f5033841269234934b99e5df8450bc25eb4a989d603135a07d" exitCode=0 Mar 16 15:51:44 crc kubenswrapper[5120]: I0316 15:51:44.655058 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0e93-account-create-update-gbtp8" event={"ID":"fd113a80-a8fc-4706-8aec-eb299e36d6b8","Type":"ContainerDied","Data":"6cdcdcd328eec0f5033841269234934b99e5df8450bc25eb4a989d603135a07d"} Mar 16 15:51:44 crc kubenswrapper[5120]: I0316 15:51:44.668520 5120 generic.go:358] "Generic (PLEG): container finished" podID="aa51d995-3c54-4c86-9103-bd38ca52653d" containerID="8963cb6ad3d59a9fc8df271576f76ce4d3cb638946306fc2113978691907e7ed" exitCode=0 Mar 16 15:51:44 crc kubenswrapper[5120]: I0316 15:51:44.684756 5120 scope.go:117] "RemoveContainer" containerID="3b39f68cca86722fc7d5f82cdfc477598e703c03c9b19c8972da41f9ede69798" Mar 16 15:51:44 crc kubenswrapper[5120]: I0316 15:51:44.693020 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="69b7941a-2f2b-4bc7-a7ea-26779c6290be" path="/var/lib/kubelet/pods/69b7941a-2f2b-4bc7-a7ea-26779c6290be/volumes" Mar 16 15:51:44 crc kubenswrapper[5120]: I0316 15:51:44.694548 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-0a49-account-create-update-56fsd" event={"ID":"aa51d995-3c54-4c86-9103-bd38ca52653d","Type":"ContainerDied","Data":"8963cb6ad3d59a9fc8df271576f76ce4d3cb638946306fc2113978691907e7ed"} Mar 16 15:51:44 crc kubenswrapper[5120]: I0316 15:51:44.703343 5120 generic.go:358] "Generic (PLEG): container finished" podID="4688f659-b142-43b8-af64-5a69b67d8a1f" containerID="187af767aa2963715d689e6cb76167e7a0574b85afe9feff2aeaef9b6bdc8ebd" exitCode=0 Mar 16 15:51:44 crc kubenswrapper[5120]: I0316 15:51:44.703429 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"4688f659-b142-43b8-af64-5a69b67d8a1f","Type":"ContainerDied","Data":"187af767aa2963715d689e6cb76167e7a0574b85afe9feff2aeaef9b6bdc8ebd"} Mar 16 15:51:44 crc kubenswrapper[5120]: I0316 15:51:44.719704 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"01c946cf-bde7-424b-b7ed-8dc510218e82","Type":"ContainerStarted","Data":"9b5cec0f91abfb22e3953f98bb1c1c586e94c05897b31c423e81d98a06635cfd"} Mar 16 15:51:44 crc kubenswrapper[5120]: I0316 15:51:44.720018 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"01c946cf-bde7-424b-b7ed-8dc510218e82","Type":"ContainerStarted","Data":"7ef0fa25caf2c84429cbff559feadc9c67a1e53074e7554d4d97de4ce8bc0319"} Mar 16 15:51:44 crc kubenswrapper[5120]: I0316 15:51:44.776951 5120 scope.go:117] "RemoveContainer" containerID="1d9c9b9eae9bd171927816b160679d4b48c3472eafea794426d88169c08e7a5f" Mar 16 15:51:44 crc kubenswrapper[5120]: E0316 15:51:44.786943 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1d9c9b9eae9bd171927816b160679d4b48c3472eafea794426d88169c08e7a5f\": container with ID starting with 1d9c9b9eae9bd171927816b160679d4b48c3472eafea794426d88169c08e7a5f not found: ID does not exist" containerID="1d9c9b9eae9bd171927816b160679d4b48c3472eafea794426d88169c08e7a5f" Mar 16 15:51:44 crc kubenswrapper[5120]: I0316 15:51:44.786990 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d9c9b9eae9bd171927816b160679d4b48c3472eafea794426d88169c08e7a5f"} err="failed to get container status \"1d9c9b9eae9bd171927816b160679d4b48c3472eafea794426d88169c08e7a5f\": rpc error: code = NotFound desc = could not find container \"1d9c9b9eae9bd171927816b160679d4b48c3472eafea794426d88169c08e7a5f\": container with ID starting with 1d9c9b9eae9bd171927816b160679d4b48c3472eafea794426d88169c08e7a5f not found: ID does not exist" Mar 16 15:51:44 crc kubenswrapper[5120]: I0316 15:51:44.787015 5120 scope.go:117] "RemoveContainer" containerID="3b39f68cca86722fc7d5f82cdfc477598e703c03c9b19c8972da41f9ede69798" Mar 16 15:51:44 crc kubenswrapper[5120]: E0316 15:51:44.801863 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b39f68cca86722fc7d5f82cdfc477598e703c03c9b19c8972da41f9ede69798\": container with ID starting with 3b39f68cca86722fc7d5f82cdfc477598e703c03c9b19c8972da41f9ede69798 not found: ID does not exist" containerID="3b39f68cca86722fc7d5f82cdfc477598e703c03c9b19c8972da41f9ede69798" Mar 16 15:51:44 crc kubenswrapper[5120]: I0316 15:51:44.801903 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b39f68cca86722fc7d5f82cdfc477598e703c03c9b19c8972da41f9ede69798"} err="failed to get container status \"3b39f68cca86722fc7d5f82cdfc477598e703c03c9b19c8972da41f9ede69798\": rpc error: code = NotFound desc = could not find container \"3b39f68cca86722fc7d5f82cdfc477598e703c03c9b19c8972da41f9ede69798\": container with ID starting with 3b39f68cca86722fc7d5f82cdfc477598e703c03c9b19c8972da41f9ede69798 not found: ID does not exist" Mar 16 15:51:44 crc kubenswrapper[5120]: I0316 15:51:44.801941 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 15:51:44 crc kubenswrapper[5120]: I0316 15:51:44.818937 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 15:51:44 crc kubenswrapper[5120]: I0316 15:51:44.839495 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 15:51:44 crc kubenswrapper[5120]: I0316 15:51:44.840877 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84bdc010-095b-47fa-af79-b1f91239a35a" containerName="glance-log" Mar 16 15:51:44 crc kubenswrapper[5120]: I0316 15:51:44.840896 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="84bdc010-095b-47fa-af79-b1f91239a35a" containerName="glance-log" Mar 16 15:51:44 crc kubenswrapper[5120]: I0316 15:51:44.840921 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84bdc010-095b-47fa-af79-b1f91239a35a" containerName="glance-httpd" Mar 16 15:51:44 crc kubenswrapper[5120]: I0316 15:51:44.840929 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="84bdc010-095b-47fa-af79-b1f91239a35a" containerName="glance-httpd" Mar 16 15:51:44 crc kubenswrapper[5120]: I0316 15:51:44.841146 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="84bdc010-095b-47fa-af79-b1f91239a35a" containerName="glance-httpd" Mar 16 15:51:44 crc kubenswrapper[5120]: I0316 15:51:44.841163 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="84bdc010-095b-47fa-af79-b1f91239a35a" containerName="glance-log" Mar 16 15:51:44 crc kubenswrapper[5120]: I0316 15:51:44.868745 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 15:51:44 crc kubenswrapper[5120]: I0316 15:51:44.868923 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:51:44 crc kubenswrapper[5120]: I0316 15:51:44.875835 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-external-config-data\"" Mar 16 15:51:44 crc kubenswrapper[5120]: I0316 15:51:44.876119 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-public-svc\"" Mar 16 15:51:44 crc kubenswrapper[5120]: I0316 15:51:44.958287 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/176eef56-bc30-4119-8af5-fa1329d63aa2-scripts\") pod \"glance-default-external-api-0\" (UID: \"176eef56-bc30-4119-8af5-fa1329d63aa2\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:51:44 crc kubenswrapper[5120]: I0316 15:51:44.958487 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/176eef56-bc30-4119-8af5-fa1329d63aa2-config-data\") pod \"glance-default-external-api-0\" (UID: \"176eef56-bc30-4119-8af5-fa1329d63aa2\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:51:44 crc kubenswrapper[5120]: I0316 15:51:44.958567 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/176eef56-bc30-4119-8af5-fa1329d63aa2-logs\") pod \"glance-default-external-api-0\" (UID: \"176eef56-bc30-4119-8af5-fa1329d63aa2\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:51:44 crc kubenswrapper[5120]: I0316 15:51:44.958658 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/176eef56-bc30-4119-8af5-fa1329d63aa2-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"176eef56-bc30-4119-8af5-fa1329d63aa2\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:51:44 crc kubenswrapper[5120]: I0316 15:51:44.958873 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"glance-default-external-api-0\" (UID: \"176eef56-bc30-4119-8af5-fa1329d63aa2\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:51:44 crc kubenswrapper[5120]: I0316 15:51:44.958913 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqwc7\" (UniqueName: \"kubernetes.io/projected/176eef56-bc30-4119-8af5-fa1329d63aa2-kube-api-access-rqwc7\") pod \"glance-default-external-api-0\" (UID: \"176eef56-bc30-4119-8af5-fa1329d63aa2\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:51:44 crc kubenswrapper[5120]: I0316 15:51:44.958935 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/176eef56-bc30-4119-8af5-fa1329d63aa2-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"176eef56-bc30-4119-8af5-fa1329d63aa2\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:51:44 crc kubenswrapper[5120]: I0316 15:51:44.959009 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/176eef56-bc30-4119-8af5-fa1329d63aa2-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"176eef56-bc30-4119-8af5-fa1329d63aa2\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:51:45 crc kubenswrapper[5120]: I0316 15:51:45.062283 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/176eef56-bc30-4119-8af5-fa1329d63aa2-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"176eef56-bc30-4119-8af5-fa1329d63aa2\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:51:45 crc kubenswrapper[5120]: I0316 15:51:45.063618 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"glance-default-external-api-0\" (UID: \"176eef56-bc30-4119-8af5-fa1329d63aa2\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:51:45 crc kubenswrapper[5120]: I0316 15:51:45.063656 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rqwc7\" (UniqueName: \"kubernetes.io/projected/176eef56-bc30-4119-8af5-fa1329d63aa2-kube-api-access-rqwc7\") pod \"glance-default-external-api-0\" (UID: \"176eef56-bc30-4119-8af5-fa1329d63aa2\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:51:45 crc kubenswrapper[5120]: I0316 15:51:45.063673 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/176eef56-bc30-4119-8af5-fa1329d63aa2-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"176eef56-bc30-4119-8af5-fa1329d63aa2\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:51:45 crc kubenswrapper[5120]: I0316 15:51:45.063787 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/176eef56-bc30-4119-8af5-fa1329d63aa2-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"176eef56-bc30-4119-8af5-fa1329d63aa2\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:51:45 crc kubenswrapper[5120]: I0316 15:51:45.063939 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/176eef56-bc30-4119-8af5-fa1329d63aa2-scripts\") pod \"glance-default-external-api-0\" (UID: \"176eef56-bc30-4119-8af5-fa1329d63aa2\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:51:45 crc kubenswrapper[5120]: I0316 15:51:45.064102 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/176eef56-bc30-4119-8af5-fa1329d63aa2-config-data\") pod \"glance-default-external-api-0\" (UID: \"176eef56-bc30-4119-8af5-fa1329d63aa2\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:51:45 crc kubenswrapper[5120]: I0316 15:51:45.064134 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/176eef56-bc30-4119-8af5-fa1329d63aa2-logs\") pod \"glance-default-external-api-0\" (UID: \"176eef56-bc30-4119-8af5-fa1329d63aa2\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:51:45 crc kubenswrapper[5120]: I0316 15:51:45.064196 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"glance-default-external-api-0\" (UID: \"176eef56-bc30-4119-8af5-fa1329d63aa2\") device mount path \"/mnt/openstack/pv13\"" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:51:45 crc kubenswrapper[5120]: I0316 15:51:45.064585 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/176eef56-bc30-4119-8af5-fa1329d63aa2-logs\") pod \"glance-default-external-api-0\" (UID: \"176eef56-bc30-4119-8af5-fa1329d63aa2\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:51:45 crc kubenswrapper[5120]: I0316 15:51:45.072164 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/176eef56-bc30-4119-8af5-fa1329d63aa2-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"176eef56-bc30-4119-8af5-fa1329d63aa2\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:51:45 crc kubenswrapper[5120]: I0316 15:51:45.073978 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/176eef56-bc30-4119-8af5-fa1329d63aa2-config-data\") pod \"glance-default-external-api-0\" (UID: \"176eef56-bc30-4119-8af5-fa1329d63aa2\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:51:45 crc kubenswrapper[5120]: I0316 15:51:45.079596 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/176eef56-bc30-4119-8af5-fa1329d63aa2-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"176eef56-bc30-4119-8af5-fa1329d63aa2\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:51:45 crc kubenswrapper[5120]: I0316 15:51:45.084275 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/176eef56-bc30-4119-8af5-fa1329d63aa2-scripts\") pod \"glance-default-external-api-0\" (UID: \"176eef56-bc30-4119-8af5-fa1329d63aa2\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:51:45 crc kubenswrapper[5120]: I0316 15:51:45.085475 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/176eef56-bc30-4119-8af5-fa1329d63aa2-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"176eef56-bc30-4119-8af5-fa1329d63aa2\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:51:45 crc kubenswrapper[5120]: I0316 15:51:45.087795 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqwc7\" (UniqueName: \"kubernetes.io/projected/176eef56-bc30-4119-8af5-fa1329d63aa2-kube-api-access-rqwc7\") pod \"glance-default-external-api-0\" (UID: \"176eef56-bc30-4119-8af5-fa1329d63aa2\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:51:45 crc kubenswrapper[5120]: I0316 15:51:45.123781 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"glance-default-external-api-0\" (UID: \"176eef56-bc30-4119-8af5-fa1329d63aa2\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:51:45 crc kubenswrapper[5120]: I0316 15:51:45.199358 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-db-create-7wc99" Mar 16 15:51:45 crc kubenswrapper[5120]: I0316 15:51:45.223445 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:51:45 crc kubenswrapper[5120]: I0316 15:51:45.269411 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0f99ca47-2940-4787-8fea-9f7b86c6b844-operator-scripts\") pod \"0f99ca47-2940-4787-8fea-9f7b86c6b844\" (UID: \"0f99ca47-2940-4787-8fea-9f7b86c6b844\") " Mar 16 15:51:45 crc kubenswrapper[5120]: I0316 15:51:45.269574 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-scd5v\" (UniqueName: \"kubernetes.io/projected/0f99ca47-2940-4787-8fea-9f7b86c6b844-kube-api-access-scd5v\") pod \"0f99ca47-2940-4787-8fea-9f7b86c6b844\" (UID: \"0f99ca47-2940-4787-8fea-9f7b86c6b844\") " Mar 16 15:51:45 crc kubenswrapper[5120]: I0316 15:51:45.270635 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f99ca47-2940-4787-8fea-9f7b86c6b844-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "0f99ca47-2940-4787-8fea-9f7b86c6b844" (UID: "0f99ca47-2940-4787-8fea-9f7b86c6b844"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:51:45 crc kubenswrapper[5120]: I0316 15:51:45.280001 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f99ca47-2940-4787-8fea-9f7b86c6b844-kube-api-access-scd5v" (OuterVolumeSpecName: "kube-api-access-scd5v") pod "0f99ca47-2940-4787-8fea-9f7b86c6b844" (UID: "0f99ca47-2940-4787-8fea-9f7b86c6b844"). InnerVolumeSpecName "kube-api-access-scd5v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:51:45 crc kubenswrapper[5120]: I0316 15:51:45.374070 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0f99ca47-2940-4787-8fea-9f7b86c6b844-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 15:51:45 crc kubenswrapper[5120]: I0316 15:51:45.374105 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-scd5v\" (UniqueName: \"kubernetes.io/projected/0f99ca47-2940-4787-8fea-9f7b86c6b844-kube-api-access-scd5v\") on node \"crc\" DevicePath \"\"" Mar 16 15:51:45 crc kubenswrapper[5120]: I0316 15:51:45.396501 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-db-create-2tr4g" Mar 16 15:51:45 crc kubenswrapper[5120]: I0316 15:51:45.482945 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nwcw9\" (UniqueName: \"kubernetes.io/projected/8404bf6f-e511-4cfa-adbb-649eb3a9a7d9-kube-api-access-nwcw9\") pod \"8404bf6f-e511-4cfa-adbb-649eb3a9a7d9\" (UID: \"8404bf6f-e511-4cfa-adbb-649eb3a9a7d9\") " Mar 16 15:51:45 crc kubenswrapper[5120]: I0316 15:51:45.483106 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8404bf6f-e511-4cfa-adbb-649eb3a9a7d9-operator-scripts\") pod \"8404bf6f-e511-4cfa-adbb-649eb3a9a7d9\" (UID: \"8404bf6f-e511-4cfa-adbb-649eb3a9a7d9\") " Mar 16 15:51:45 crc kubenswrapper[5120]: I0316 15:51:45.494939 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8404bf6f-e511-4cfa-adbb-649eb3a9a7d9-kube-api-access-nwcw9" (OuterVolumeSpecName: "kube-api-access-nwcw9") pod "8404bf6f-e511-4cfa-adbb-649eb3a9a7d9" (UID: "8404bf6f-e511-4cfa-adbb-649eb3a9a7d9"). InnerVolumeSpecName "kube-api-access-nwcw9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:51:45 crc kubenswrapper[5120]: I0316 15:51:45.501299 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8404bf6f-e511-4cfa-adbb-649eb3a9a7d9-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "8404bf6f-e511-4cfa-adbb-649eb3a9a7d9" (UID: "8404bf6f-e511-4cfa-adbb-649eb3a9a7d9"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:51:45 crc kubenswrapper[5120]: I0316 15:51:45.557140 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:51:45 crc kubenswrapper[5120]: I0316 15:51:45.567295 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-db-create-nx5h9" Mar 16 15:51:45 crc kubenswrapper[5120]: I0316 15:51:45.572607 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 15:51:45 crc kubenswrapper[5120]: W0316 15:51:45.575277 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod176eef56_bc30_4119_8af5_fa1329d63aa2.slice/crio-94ba812ca937ebb9ed509edfea340d66f9ec5dca16f4d576188e7e4f8b2d1598 WatchSource:0}: Error finding container 94ba812ca937ebb9ed509edfea340d66f9ec5dca16f4d576188e7e4f8b2d1598: Status 404 returned error can't find the container with id 94ba812ca937ebb9ed509edfea340d66f9ec5dca16f4d576188e7e4f8b2d1598 Mar 16 15:51:45 crc kubenswrapper[5120]: I0316 15:51:45.585581 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nwcw9\" (UniqueName: \"kubernetes.io/projected/8404bf6f-e511-4cfa-adbb-649eb3a9a7d9-kube-api-access-nwcw9\") on node \"crc\" DevicePath \"\"" Mar 16 15:51:45 crc kubenswrapper[5120]: I0316 15:51:45.585610 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8404bf6f-e511-4cfa-adbb-649eb3a9a7d9-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 15:51:45 crc kubenswrapper[5120]: I0316 15:51:45.686780 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/4688f659-b142-43b8-af64-5a69b67d8a1f-internal-tls-certs\") pod \"4688f659-b142-43b8-af64-5a69b67d8a1f\" (UID: \"4688f659-b142-43b8-af64-5a69b67d8a1f\") " Mar 16 15:51:45 crc kubenswrapper[5120]: I0316 15:51:45.686821 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4688f659-b142-43b8-af64-5a69b67d8a1f-logs\") pod \"4688f659-b142-43b8-af64-5a69b67d8a1f\" (UID: \"4688f659-b142-43b8-af64-5a69b67d8a1f\") " Mar 16 15:51:45 crc kubenswrapper[5120]: I0316 15:51:45.686843 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4688f659-b142-43b8-af64-5a69b67d8a1f-combined-ca-bundle\") pod \"4688f659-b142-43b8-af64-5a69b67d8a1f\" (UID: \"4688f659-b142-43b8-af64-5a69b67d8a1f\") " Mar 16 15:51:45 crc kubenswrapper[5120]: I0316 15:51:45.686916 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gmg6m\" (UniqueName: \"kubernetes.io/projected/9b8a74c0-777b-4320-af58-04656d3207e0-kube-api-access-gmg6m\") pod \"9b8a74c0-777b-4320-af58-04656d3207e0\" (UID: \"9b8a74c0-777b-4320-af58-04656d3207e0\") " Mar 16 15:51:45 crc kubenswrapper[5120]: I0316 15:51:45.686951 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/4688f659-b142-43b8-af64-5a69b67d8a1f-httpd-run\") pod \"4688f659-b142-43b8-af64-5a69b67d8a1f\" (UID: \"4688f659-b142-43b8-af64-5a69b67d8a1f\") " Mar 16 15:51:45 crc kubenswrapper[5120]: I0316 15:51:45.686973 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4688f659-b142-43b8-af64-5a69b67d8a1f-scripts\") pod \"4688f659-b142-43b8-af64-5a69b67d8a1f\" (UID: \"4688f659-b142-43b8-af64-5a69b67d8a1f\") " Mar 16 15:51:45 crc kubenswrapper[5120]: I0316 15:51:45.687108 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9b8a74c0-777b-4320-af58-04656d3207e0-operator-scripts\") pod \"9b8a74c0-777b-4320-af58-04656d3207e0\" (UID: \"9b8a74c0-777b-4320-af58-04656d3207e0\") " Mar 16 15:51:45 crc kubenswrapper[5120]: I0316 15:51:45.687134 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4688f659-b142-43b8-af64-5a69b67d8a1f-config-data\") pod \"4688f659-b142-43b8-af64-5a69b67d8a1f\" (UID: \"4688f659-b142-43b8-af64-5a69b67d8a1f\") " Mar 16 15:51:45 crc kubenswrapper[5120]: I0316 15:51:45.687210 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2j7jd\" (UniqueName: \"kubernetes.io/projected/4688f659-b142-43b8-af64-5a69b67d8a1f-kube-api-access-2j7jd\") pod \"4688f659-b142-43b8-af64-5a69b67d8a1f\" (UID: \"4688f659-b142-43b8-af64-5a69b67d8a1f\") " Mar 16 15:51:45 crc kubenswrapper[5120]: I0316 15:51:45.687249 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"4688f659-b142-43b8-af64-5a69b67d8a1f\" (UID: \"4688f659-b142-43b8-af64-5a69b67d8a1f\") " Mar 16 15:51:45 crc kubenswrapper[5120]: I0316 15:51:45.687574 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4688f659-b142-43b8-af64-5a69b67d8a1f-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "4688f659-b142-43b8-af64-5a69b67d8a1f" (UID: "4688f659-b142-43b8-af64-5a69b67d8a1f"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:51:45 crc kubenswrapper[5120]: I0316 15:51:45.687695 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4688f659-b142-43b8-af64-5a69b67d8a1f-logs" (OuterVolumeSpecName: "logs") pod "4688f659-b142-43b8-af64-5a69b67d8a1f" (UID: "4688f659-b142-43b8-af64-5a69b67d8a1f"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:51:45 crc kubenswrapper[5120]: I0316 15:51:45.687958 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9b8a74c0-777b-4320-af58-04656d3207e0-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "9b8a74c0-777b-4320-af58-04656d3207e0" (UID: "9b8a74c0-777b-4320-af58-04656d3207e0"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:51:45 crc kubenswrapper[5120]: I0316 15:51:45.692017 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4688f659-b142-43b8-af64-5a69b67d8a1f-kube-api-access-2j7jd" (OuterVolumeSpecName: "kube-api-access-2j7jd") pod "4688f659-b142-43b8-af64-5a69b67d8a1f" (UID: "4688f659-b142-43b8-af64-5a69b67d8a1f"). InnerVolumeSpecName "kube-api-access-2j7jd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:51:45 crc kubenswrapper[5120]: I0316 15:51:45.694485 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage09-crc" (OuterVolumeSpecName: "glance") pod "4688f659-b142-43b8-af64-5a69b67d8a1f" (UID: "4688f659-b142-43b8-af64-5a69b67d8a1f"). InnerVolumeSpecName "local-storage09-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 15:51:45 crc kubenswrapper[5120]: I0316 15:51:45.695629 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b8a74c0-777b-4320-af58-04656d3207e0-kube-api-access-gmg6m" (OuterVolumeSpecName: "kube-api-access-gmg6m") pod "9b8a74c0-777b-4320-af58-04656d3207e0" (UID: "9b8a74c0-777b-4320-af58-04656d3207e0"). InnerVolumeSpecName "kube-api-access-gmg6m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:51:45 crc kubenswrapper[5120]: I0316 15:51:45.700117 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4688f659-b142-43b8-af64-5a69b67d8a1f-scripts" (OuterVolumeSpecName: "scripts") pod "4688f659-b142-43b8-af64-5a69b67d8a1f" (UID: "4688f659-b142-43b8-af64-5a69b67d8a1f"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:51:45 crc kubenswrapper[5120]: I0316 15:51:45.743290 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"176eef56-bc30-4119-8af5-fa1329d63aa2","Type":"ContainerStarted","Data":"94ba812ca937ebb9ed509edfea340d66f9ec5dca16f4d576188e7e4f8b2d1598"} Mar 16 15:51:45 crc kubenswrapper[5120]: I0316 15:51:45.753255 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-db-create-nx5h9" event={"ID":"9b8a74c0-777b-4320-af58-04656d3207e0","Type":"ContainerDied","Data":"c0d954177a8964511db0bf2848b7c0aa2af20115bc4d4fb5f8a37802e0970b75"} Mar 16 15:51:45 crc kubenswrapper[5120]: I0316 15:51:45.753296 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c0d954177a8964511db0bf2848b7c0aa2af20115bc4d4fb5f8a37802e0970b75" Mar 16 15:51:45 crc kubenswrapper[5120]: I0316 15:51:45.753388 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-db-create-nx5h9" Mar 16 15:51:45 crc kubenswrapper[5120]: I0316 15:51:45.756381 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4688f659-b142-43b8-af64-5a69b67d8a1f-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "4688f659-b142-43b8-af64-5a69b67d8a1f" (UID: "4688f659-b142-43b8-af64-5a69b67d8a1f"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:51:45 crc kubenswrapper[5120]: I0316 15:51:45.757358 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4688f659-b142-43b8-af64-5a69b67d8a1f-config-data" (OuterVolumeSpecName: "config-data") pod "4688f659-b142-43b8-af64-5a69b67d8a1f" (UID: "4688f659-b142-43b8-af64-5a69b67d8a1f"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:51:45 crc kubenswrapper[5120]: I0316 15:51:45.757491 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"4688f659-b142-43b8-af64-5a69b67d8a1f","Type":"ContainerDied","Data":"29ed196fb2345425f19f46288f2d673c15c82583dee1fc6ed4f889a940028bf3"} Mar 16 15:51:45 crc kubenswrapper[5120]: I0316 15:51:45.757518 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:51:45 crc kubenswrapper[5120]: I0316 15:51:45.757533 5120 scope.go:117] "RemoveContainer" containerID="187af767aa2963715d689e6cb76167e7a0574b85afe9feff2aeaef9b6bdc8ebd" Mar 16 15:51:45 crc kubenswrapper[5120]: I0316 15:51:45.767983 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"01c946cf-bde7-424b-b7ed-8dc510218e82","Type":"ContainerStarted","Data":"0a21eb928c60a776bb0f8c3d9f7bac3e8a0194b51ac15b6b796b98639f3fc4cc"} Mar 16 15:51:45 crc kubenswrapper[5120]: I0316 15:51:45.770611 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-db-create-2tr4g" Mar 16 15:51:45 crc kubenswrapper[5120]: I0316 15:51:45.770823 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-db-create-2tr4g" event={"ID":"8404bf6f-e511-4cfa-adbb-649eb3a9a7d9","Type":"ContainerDied","Data":"82a546a047211b5737f84f1af325b6491875ba7fb1fb7cbe18c662b788f0acd7"} Mar 16 15:51:45 crc kubenswrapper[5120]: I0316 15:51:45.770968 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="82a546a047211b5737f84f1af325b6491875ba7fb1fb7cbe18c662b788f0acd7" Mar 16 15:51:45 crc kubenswrapper[5120]: I0316 15:51:45.777215 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-db-create-7wc99" Mar 16 15:51:45 crc kubenswrapper[5120]: I0316 15:51:45.777291 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-db-create-7wc99" event={"ID":"0f99ca47-2940-4787-8fea-9f7b86c6b844","Type":"ContainerDied","Data":"59f55f94627d83c83a04937f8dc7f8a561c8dc1e9cc68baad393a65baaffd587"} Mar 16 15:51:45 crc kubenswrapper[5120]: I0316 15:51:45.777337 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="59f55f94627d83c83a04937f8dc7f8a561c8dc1e9cc68baad393a65baaffd587" Mar 16 15:51:45 crc kubenswrapper[5120]: I0316 15:51:45.789405 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9b8a74c0-777b-4320-af58-04656d3207e0-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 15:51:45 crc kubenswrapper[5120]: I0316 15:51:45.789433 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4688f659-b142-43b8-af64-5a69b67d8a1f-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 15:51:45 crc kubenswrapper[5120]: I0316 15:51:45.789442 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2j7jd\" (UniqueName: \"kubernetes.io/projected/4688f659-b142-43b8-af64-5a69b67d8a1f-kube-api-access-2j7jd\") on node \"crc\" DevicePath \"\"" Mar 16 15:51:45 crc kubenswrapper[5120]: I0316 15:51:45.789460 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") on node \"crc\" " Mar 16 15:51:45 crc kubenswrapper[5120]: I0316 15:51:45.789468 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4688f659-b142-43b8-af64-5a69b67d8a1f-logs\") on node \"crc\" DevicePath \"\"" Mar 16 15:51:45 crc kubenswrapper[5120]: I0316 15:51:45.789477 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4688f659-b142-43b8-af64-5a69b67d8a1f-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:51:45 crc kubenswrapper[5120]: I0316 15:51:45.789488 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gmg6m\" (UniqueName: \"kubernetes.io/projected/9b8a74c0-777b-4320-af58-04656d3207e0-kube-api-access-gmg6m\") on node \"crc\" DevicePath \"\"" Mar 16 15:51:45 crc kubenswrapper[5120]: I0316 15:51:45.789496 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/4688f659-b142-43b8-af64-5a69b67d8a1f-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 15:51:45 crc kubenswrapper[5120]: I0316 15:51:45.789504 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4688f659-b142-43b8-af64-5a69b67d8a1f-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 15:51:45 crc kubenswrapper[5120]: I0316 15:51:45.806574 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4688f659-b142-43b8-af64-5a69b67d8a1f-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "4688f659-b142-43b8-af64-5a69b67d8a1f" (UID: "4688f659-b142-43b8-af64-5a69b67d8a1f"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:51:45 crc kubenswrapper[5120]: I0316 15:51:45.816128 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage09-crc" (UniqueName: "kubernetes.io/local-volume/local-storage09-crc") on node "crc" Mar 16 15:51:45 crc kubenswrapper[5120]: I0316 15:51:45.844599 5120 scope.go:117] "RemoveContainer" containerID="6efab2a50dd424ff12720aea04a4d57ef0c1445fe7abbe636010918437684cf6" Mar 16 15:51:45 crc kubenswrapper[5120]: I0316 15:51:45.891958 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") on node \"crc\" DevicePath \"\"" Mar 16 15:51:45 crc kubenswrapper[5120]: I0316 15:51:45.891985 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/4688f659-b142-43b8-af64-5a69b67d8a1f-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 15:51:46 crc kubenswrapper[5120]: I0316 15:51:46.087587 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-0a49-account-create-update-56fsd" Mar 16 15:51:46 crc kubenswrapper[5120]: I0316 15:51:46.164732 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 15:51:46 crc kubenswrapper[5120]: I0316 15:51:46.201221 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/aa51d995-3c54-4c86-9103-bd38ca52653d-operator-scripts\") pod \"aa51d995-3c54-4c86-9103-bd38ca52653d\" (UID: \"aa51d995-3c54-4c86-9103-bd38ca52653d\") " Mar 16 15:51:46 crc kubenswrapper[5120]: I0316 15:51:46.201410 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cbdlz\" (UniqueName: \"kubernetes.io/projected/aa51d995-3c54-4c86-9103-bd38ca52653d-kube-api-access-cbdlz\") pod \"aa51d995-3c54-4c86-9103-bd38ca52653d\" (UID: \"aa51d995-3c54-4c86-9103-bd38ca52653d\") " Mar 16 15:51:46 crc kubenswrapper[5120]: I0316 15:51:46.201981 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa51d995-3c54-4c86-9103-bd38ca52653d-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "aa51d995-3c54-4c86-9103-bd38ca52653d" (UID: "aa51d995-3c54-4c86-9103-bd38ca52653d"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:51:46 crc kubenswrapper[5120]: I0316 15:51:46.238994 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa51d995-3c54-4c86-9103-bd38ca52653d-kube-api-access-cbdlz" (OuterVolumeSpecName: "kube-api-access-cbdlz") pod "aa51d995-3c54-4c86-9103-bd38ca52653d" (UID: "aa51d995-3c54-4c86-9103-bd38ca52653d"). InnerVolumeSpecName "kube-api-access-cbdlz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:51:46 crc kubenswrapper[5120]: I0316 15:51:46.239061 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 15:51:46 crc kubenswrapper[5120]: I0316 15:51:46.247825 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 15:51:46 crc kubenswrapper[5120]: I0316 15:51:46.249090 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4688f659-b142-43b8-af64-5a69b67d8a1f" containerName="glance-httpd" Mar 16 15:51:46 crc kubenswrapper[5120]: I0316 15:51:46.249109 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="4688f659-b142-43b8-af64-5a69b67d8a1f" containerName="glance-httpd" Mar 16 15:51:46 crc kubenswrapper[5120]: I0316 15:51:46.249129 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f99ca47-2940-4787-8fea-9f7b86c6b844" containerName="mariadb-database-create" Mar 16 15:51:46 crc kubenswrapper[5120]: I0316 15:51:46.249135 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f99ca47-2940-4787-8fea-9f7b86c6b844" containerName="mariadb-database-create" Mar 16 15:51:46 crc kubenswrapper[5120]: I0316 15:51:46.249148 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8404bf6f-e511-4cfa-adbb-649eb3a9a7d9" containerName="mariadb-database-create" Mar 16 15:51:46 crc kubenswrapper[5120]: I0316 15:51:46.249154 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8404bf6f-e511-4cfa-adbb-649eb3a9a7d9" containerName="mariadb-database-create" Mar 16 15:51:46 crc kubenswrapper[5120]: I0316 15:51:46.249174 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b8a74c0-777b-4320-af58-04656d3207e0" containerName="mariadb-database-create" Mar 16 15:51:46 crc kubenswrapper[5120]: I0316 15:51:46.249179 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b8a74c0-777b-4320-af58-04656d3207e0" containerName="mariadb-database-create" Mar 16 15:51:46 crc kubenswrapper[5120]: I0316 15:51:46.249204 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4688f659-b142-43b8-af64-5a69b67d8a1f" containerName="glance-log" Mar 16 15:51:46 crc kubenswrapper[5120]: I0316 15:51:46.249209 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="4688f659-b142-43b8-af64-5a69b67d8a1f" containerName="glance-log" Mar 16 15:51:46 crc kubenswrapper[5120]: I0316 15:51:46.249228 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa51d995-3c54-4c86-9103-bd38ca52653d" containerName="mariadb-account-create-update" Mar 16 15:51:46 crc kubenswrapper[5120]: I0316 15:51:46.249234 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa51d995-3c54-4c86-9103-bd38ca52653d" containerName="mariadb-account-create-update" Mar 16 15:51:46 crc kubenswrapper[5120]: I0316 15:51:46.249376 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="8404bf6f-e511-4cfa-adbb-649eb3a9a7d9" containerName="mariadb-database-create" Mar 16 15:51:46 crc kubenswrapper[5120]: I0316 15:51:46.249391 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="4688f659-b142-43b8-af64-5a69b67d8a1f" containerName="glance-httpd" Mar 16 15:51:46 crc kubenswrapper[5120]: I0316 15:51:46.249401 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="4688f659-b142-43b8-af64-5a69b67d8a1f" containerName="glance-log" Mar 16 15:51:46 crc kubenswrapper[5120]: I0316 15:51:46.249412 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="aa51d995-3c54-4c86-9103-bd38ca52653d" containerName="mariadb-account-create-update" Mar 16 15:51:46 crc kubenswrapper[5120]: I0316 15:51:46.249424 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="9b8a74c0-777b-4320-af58-04656d3207e0" containerName="mariadb-database-create" Mar 16 15:51:46 crc kubenswrapper[5120]: I0316 15:51:46.249432 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="0f99ca47-2940-4787-8fea-9f7b86c6b844" containerName="mariadb-database-create" Mar 16 15:51:46 crc kubenswrapper[5120]: I0316 15:51:46.275605 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 15:51:46 crc kubenswrapper[5120]: I0316 15:51:46.275674 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:51:46 crc kubenswrapper[5120]: I0316 15:51:46.289442 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-internal-config-data\"" Mar 16 15:51:46 crc kubenswrapper[5120]: I0316 15:51:46.289730 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-internal-svc\"" Mar 16 15:51:46 crc kubenswrapper[5120]: I0316 15:51:46.312024 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/aa51d995-3c54-4c86-9103-bd38ca52653d-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 15:51:46 crc kubenswrapper[5120]: I0316 15:51:46.312046 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cbdlz\" (UniqueName: \"kubernetes.io/projected/aa51d995-3c54-4c86-9103-bd38ca52653d-kube-api-access-cbdlz\") on node \"crc\" DevicePath \"\"" Mar 16 15:51:46 crc kubenswrapper[5120]: I0316 15:51:46.319345 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0e93-account-create-update-gbtp8" Mar 16 15:51:46 crc kubenswrapper[5120]: I0316 15:51:46.439419 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/fd113a80-a8fc-4706-8aec-eb299e36d6b8-operator-scripts\") pod \"fd113a80-a8fc-4706-8aec-eb299e36d6b8\" (UID: \"fd113a80-a8fc-4706-8aec-eb299e36d6b8\") " Mar 16 15:51:46 crc kubenswrapper[5120]: I0316 15:51:46.439531 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r4mh8\" (UniqueName: \"kubernetes.io/projected/fd113a80-a8fc-4706-8aec-eb299e36d6b8-kube-api-access-r4mh8\") pod \"fd113a80-a8fc-4706-8aec-eb299e36d6b8\" (UID: \"fd113a80-a8fc-4706-8aec-eb299e36d6b8\") " Mar 16 15:51:46 crc kubenswrapper[5120]: I0316 15:51:46.440988 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"glance-default-internal-api-0\" (UID: \"d6734794-135c-4f4b-83b6-c64788f83f91\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:51:46 crc kubenswrapper[5120]: I0316 15:51:46.441032 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d6734794-135c-4f4b-83b6-c64788f83f91-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"d6734794-135c-4f4b-83b6-c64788f83f91\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:51:46 crc kubenswrapper[5120]: I0316 15:51:46.441059 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d6734794-135c-4f4b-83b6-c64788f83f91-config-data\") pod \"glance-default-internal-api-0\" (UID: \"d6734794-135c-4f4b-83b6-c64788f83f91\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:51:46 crc kubenswrapper[5120]: I0316 15:51:46.441093 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d6734794-135c-4f4b-83b6-c64788f83f91-scripts\") pod \"glance-default-internal-api-0\" (UID: \"d6734794-135c-4f4b-83b6-c64788f83f91\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:51:46 crc kubenswrapper[5120]: I0316 15:51:46.441293 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/d6734794-135c-4f4b-83b6-c64788f83f91-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"d6734794-135c-4f4b-83b6-c64788f83f91\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:51:46 crc kubenswrapper[5120]: I0316 15:51:46.441346 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdmzh\" (UniqueName: \"kubernetes.io/projected/d6734794-135c-4f4b-83b6-c64788f83f91-kube-api-access-kdmzh\") pod \"glance-default-internal-api-0\" (UID: \"d6734794-135c-4f4b-83b6-c64788f83f91\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:51:46 crc kubenswrapper[5120]: I0316 15:51:46.441349 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd113a80-a8fc-4706-8aec-eb299e36d6b8-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "fd113a80-a8fc-4706-8aec-eb299e36d6b8" (UID: "fd113a80-a8fc-4706-8aec-eb299e36d6b8"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:51:46 crc kubenswrapper[5120]: I0316 15:51:46.441385 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d6734794-135c-4f4b-83b6-c64788f83f91-logs\") pod \"glance-default-internal-api-0\" (UID: \"d6734794-135c-4f4b-83b6-c64788f83f91\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:51:46 crc kubenswrapper[5120]: I0316 15:51:46.441417 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/d6734794-135c-4f4b-83b6-c64788f83f91-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"d6734794-135c-4f4b-83b6-c64788f83f91\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:51:46 crc kubenswrapper[5120]: I0316 15:51:46.441865 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/fd113a80-a8fc-4706-8aec-eb299e36d6b8-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 15:51:46 crc kubenswrapper[5120]: I0316 15:51:46.444192 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-9b99-account-create-update-nqhst" Mar 16 15:51:46 crc kubenswrapper[5120]: I0316 15:51:46.454995 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd113a80-a8fc-4706-8aec-eb299e36d6b8-kube-api-access-r4mh8" (OuterVolumeSpecName: "kube-api-access-r4mh8") pod "fd113a80-a8fc-4706-8aec-eb299e36d6b8" (UID: "fd113a80-a8fc-4706-8aec-eb299e36d6b8"). InnerVolumeSpecName "kube-api-access-r4mh8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:51:46 crc kubenswrapper[5120]: I0316 15:51:46.542840 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-svpz6\" (UniqueName: \"kubernetes.io/projected/fe9eadc5-0f96-4232-89f0-22cbe36c1a8f-kube-api-access-svpz6\") pod \"fe9eadc5-0f96-4232-89f0-22cbe36c1a8f\" (UID: \"fe9eadc5-0f96-4232-89f0-22cbe36c1a8f\") " Mar 16 15:51:46 crc kubenswrapper[5120]: I0316 15:51:46.543356 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/fe9eadc5-0f96-4232-89f0-22cbe36c1a8f-operator-scripts\") pod \"fe9eadc5-0f96-4232-89f0-22cbe36c1a8f\" (UID: \"fe9eadc5-0f96-4232-89f0-22cbe36c1a8f\") " Mar 16 15:51:46 crc kubenswrapper[5120]: I0316 15:51:46.543586 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/d6734794-135c-4f4b-83b6-c64788f83f91-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"d6734794-135c-4f4b-83b6-c64788f83f91\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:51:46 crc kubenswrapper[5120]: I0316 15:51:46.543631 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kdmzh\" (UniqueName: \"kubernetes.io/projected/d6734794-135c-4f4b-83b6-c64788f83f91-kube-api-access-kdmzh\") pod \"glance-default-internal-api-0\" (UID: \"d6734794-135c-4f4b-83b6-c64788f83f91\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:51:46 crc kubenswrapper[5120]: I0316 15:51:46.543664 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d6734794-135c-4f4b-83b6-c64788f83f91-logs\") pod \"glance-default-internal-api-0\" (UID: \"d6734794-135c-4f4b-83b6-c64788f83f91\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:51:46 crc kubenswrapper[5120]: I0316 15:51:46.543682 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/d6734794-135c-4f4b-83b6-c64788f83f91-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"d6734794-135c-4f4b-83b6-c64788f83f91\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:51:46 crc kubenswrapper[5120]: I0316 15:51:46.543728 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"glance-default-internal-api-0\" (UID: \"d6734794-135c-4f4b-83b6-c64788f83f91\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:51:46 crc kubenswrapper[5120]: I0316 15:51:46.543812 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d6734794-135c-4f4b-83b6-c64788f83f91-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"d6734794-135c-4f4b-83b6-c64788f83f91\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:51:46 crc kubenswrapper[5120]: I0316 15:51:46.543840 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d6734794-135c-4f4b-83b6-c64788f83f91-config-data\") pod \"glance-default-internal-api-0\" (UID: \"d6734794-135c-4f4b-83b6-c64788f83f91\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:51:46 crc kubenswrapper[5120]: I0316 15:51:46.543865 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d6734794-135c-4f4b-83b6-c64788f83f91-scripts\") pod \"glance-default-internal-api-0\" (UID: \"d6734794-135c-4f4b-83b6-c64788f83f91\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:51:46 crc kubenswrapper[5120]: I0316 15:51:46.543968 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe9eadc5-0f96-4232-89f0-22cbe36c1a8f-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "fe9eadc5-0f96-4232-89f0-22cbe36c1a8f" (UID: "fe9eadc5-0f96-4232-89f0-22cbe36c1a8f"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:51:46 crc kubenswrapper[5120]: I0316 15:51:46.554648 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/d6734794-135c-4f4b-83b6-c64788f83f91-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"d6734794-135c-4f4b-83b6-c64788f83f91\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:51:46 crc kubenswrapper[5120]: I0316 15:51:46.554732 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"glance-default-internal-api-0\" (UID: \"d6734794-135c-4f4b-83b6-c64788f83f91\") device mount path \"/mnt/openstack/pv09\"" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:51:46 crc kubenswrapper[5120]: I0316 15:51:46.556836 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r4mh8\" (UniqueName: \"kubernetes.io/projected/fd113a80-a8fc-4706-8aec-eb299e36d6b8-kube-api-access-r4mh8\") on node \"crc\" DevicePath \"\"" Mar 16 15:51:46 crc kubenswrapper[5120]: I0316 15:51:46.557274 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d6734794-135c-4f4b-83b6-c64788f83f91-logs\") pod \"glance-default-internal-api-0\" (UID: \"d6734794-135c-4f4b-83b6-c64788f83f91\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:51:46 crc kubenswrapper[5120]: I0316 15:51:46.557321 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/fe9eadc5-0f96-4232-89f0-22cbe36c1a8f-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 15:51:46 crc kubenswrapper[5120]: I0316 15:51:46.564702 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d6734794-135c-4f4b-83b6-c64788f83f91-scripts\") pod \"glance-default-internal-api-0\" (UID: \"d6734794-135c-4f4b-83b6-c64788f83f91\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:51:46 crc kubenswrapper[5120]: I0316 15:51:46.565270 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/d6734794-135c-4f4b-83b6-c64788f83f91-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"d6734794-135c-4f4b-83b6-c64788f83f91\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:51:46 crc kubenswrapper[5120]: I0316 15:51:46.567941 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe9eadc5-0f96-4232-89f0-22cbe36c1a8f-kube-api-access-svpz6" (OuterVolumeSpecName: "kube-api-access-svpz6") pod "fe9eadc5-0f96-4232-89f0-22cbe36c1a8f" (UID: "fe9eadc5-0f96-4232-89f0-22cbe36c1a8f"). InnerVolumeSpecName "kube-api-access-svpz6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:51:46 crc kubenswrapper[5120]: I0316 15:51:46.574369 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d6734794-135c-4f4b-83b6-c64788f83f91-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"d6734794-135c-4f4b-83b6-c64788f83f91\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:51:46 crc kubenswrapper[5120]: I0316 15:51:46.577927 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d6734794-135c-4f4b-83b6-c64788f83f91-config-data\") pod \"glance-default-internal-api-0\" (UID: \"d6734794-135c-4f4b-83b6-c64788f83f91\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:51:46 crc kubenswrapper[5120]: I0316 15:51:46.578199 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdmzh\" (UniqueName: \"kubernetes.io/projected/d6734794-135c-4f4b-83b6-c64788f83f91-kube-api-access-kdmzh\") pod \"glance-default-internal-api-0\" (UID: \"d6734794-135c-4f4b-83b6-c64788f83f91\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:51:46 crc kubenswrapper[5120]: I0316 15:51:46.599186 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"glance-default-internal-api-0\" (UID: \"d6734794-135c-4f4b-83b6-c64788f83f91\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:51:46 crc kubenswrapper[5120]: I0316 15:51:46.635590 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:51:46 crc kubenswrapper[5120]: I0316 15:51:46.659577 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-svpz6\" (UniqueName: \"kubernetes.io/projected/fe9eadc5-0f96-4232-89f0-22cbe36c1a8f-kube-api-access-svpz6\") on node \"crc\" DevicePath \"\"" Mar 16 15:51:46 crc kubenswrapper[5120]: I0316 15:51:46.706595 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4688f659-b142-43b8-af64-5a69b67d8a1f" path="/var/lib/kubelet/pods/4688f659-b142-43b8-af64-5a69b67d8a1f/volumes" Mar 16 15:51:46 crc kubenswrapper[5120]: I0316 15:51:46.708066 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="84bdc010-095b-47fa-af79-b1f91239a35a" path="/var/lib/kubelet/pods/84bdc010-095b-47fa-af79-b1f91239a35a/volumes" Mar 16 15:51:46 crc kubenswrapper[5120]: I0316 15:51:46.816163 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"01c946cf-bde7-424b-b7ed-8dc510218e82","Type":"ContainerStarted","Data":"d29cf911284d05f9b70ff3294de9f59b3feb5c78440f6ffa99c9d15ba5dbce7d"} Mar 16 15:51:46 crc kubenswrapper[5120]: I0316 15:51:46.830829 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-9b99-account-create-update-nqhst" event={"ID":"fe9eadc5-0f96-4232-89f0-22cbe36c1a8f","Type":"ContainerDied","Data":"094311d7c24db4d57e7ba384874d14a11a42e746b1cffa0ec31af13c35b2a1a2"} Mar 16 15:51:46 crc kubenswrapper[5120]: I0316 15:51:46.830870 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="094311d7c24db4d57e7ba384874d14a11a42e746b1cffa0ec31af13c35b2a1a2" Mar 16 15:51:46 crc kubenswrapper[5120]: I0316 15:51:46.830955 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-9b99-account-create-update-nqhst" Mar 16 15:51:46 crc kubenswrapper[5120]: I0316 15:51:46.845104 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0e93-account-create-update-gbtp8" Mar 16 15:51:46 crc kubenswrapper[5120]: I0316 15:51:46.845239 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0e93-account-create-update-gbtp8" event={"ID":"fd113a80-a8fc-4706-8aec-eb299e36d6b8","Type":"ContainerDied","Data":"95814a6e90b1a4b1ab7f59207476c24f90deee44788d2233d3f3e5bb9199c28a"} Mar 16 15:51:46 crc kubenswrapper[5120]: I0316 15:51:46.845291 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="95814a6e90b1a4b1ab7f59207476c24f90deee44788d2233d3f3e5bb9199c28a" Mar 16 15:51:46 crc kubenswrapper[5120]: I0316 15:51:46.853540 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-0a49-account-create-update-56fsd" event={"ID":"aa51d995-3c54-4c86-9103-bd38ca52653d","Type":"ContainerDied","Data":"112dbba8856c446bd6abdf358759e3fe24690855ee652175b946642eee698276"} Mar 16 15:51:46 crc kubenswrapper[5120]: I0316 15:51:46.853573 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="112dbba8856c446bd6abdf358759e3fe24690855ee652175b946642eee698276" Mar 16 15:51:46 crc kubenswrapper[5120]: I0316 15:51:46.853641 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-0a49-account-create-update-56fsd" Mar 16 15:51:47 crc kubenswrapper[5120]: I0316 15:51:47.116714 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 15:51:47 crc kubenswrapper[5120]: W0316 15:51:47.132615 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd6734794_135c_4f4b_83b6_c64788f83f91.slice/crio-dd67c67cfb663dd796ab5e645216b4d8b8f803a6a97b11efac0281575ea7b4be WatchSource:0}: Error finding container dd67c67cfb663dd796ab5e645216b4d8b8f803a6a97b11efac0281575ea7b4be: Status 404 returned error can't find the container with id dd67c67cfb663dd796ab5e645216b4d8b8f803a6a97b11efac0281575ea7b4be Mar 16 15:51:47 crc kubenswrapper[5120]: I0316 15:51:47.864274 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"d6734794-135c-4f4b-83b6-c64788f83f91","Type":"ContainerStarted","Data":"dd67c67cfb663dd796ab5e645216b4d8b8f803a6a97b11efac0281575ea7b4be"} Mar 16 15:51:47 crc kubenswrapper[5120]: I0316 15:51:47.867833 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"176eef56-bc30-4119-8af5-fa1329d63aa2","Type":"ContainerStarted","Data":"2f65dec7986bd0522ab520af73feb24ec1981e8d8b3bd281082c4d851a61df1c"} Mar 16 15:51:48 crc kubenswrapper[5120]: I0316 15:51:48.878849 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"d6734794-135c-4f4b-83b6-c64788f83f91","Type":"ContainerStarted","Data":"89f147b51fe4fc1e87c9c591ecb0db5c3f2e8bd2acb9a6231812f956dd8c36da"} Mar 16 15:51:48 crc kubenswrapper[5120]: I0316 15:51:48.879485 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"d6734794-135c-4f4b-83b6-c64788f83f91","Type":"ContainerStarted","Data":"ebdaf82d2a1f7e9acd884bceba81a86e1a13b95df2c0fa6a630cd488d4c95e00"} Mar 16 15:51:48 crc kubenswrapper[5120]: I0316 15:51:48.882956 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"176eef56-bc30-4119-8af5-fa1329d63aa2","Type":"ContainerStarted","Data":"544dd46ceb52a8a8952e0260d5780a769952c63f2d32902979fa7e197c0a5577"} Mar 16 15:51:48 crc kubenswrapper[5120]: I0316 15:51:48.885550 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"01c946cf-bde7-424b-b7ed-8dc510218e82","Type":"ContainerStarted","Data":"337881054f4ea882866f184d95dc78f47dafb6df1019683b2ade429ae58a1e41"} Mar 16 15:51:48 crc kubenswrapper[5120]: I0316 15:51:48.885710 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="01c946cf-bde7-424b-b7ed-8dc510218e82" containerName="ceilometer-central-agent" containerID="cri-o://9b5cec0f91abfb22e3953f98bb1c1c586e94c05897b31c423e81d98a06635cfd" gracePeriod=30 Mar 16 15:51:48 crc kubenswrapper[5120]: I0316 15:51:48.885975 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:51:48 crc kubenswrapper[5120]: I0316 15:51:48.886026 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="01c946cf-bde7-424b-b7ed-8dc510218e82" containerName="proxy-httpd" containerID="cri-o://337881054f4ea882866f184d95dc78f47dafb6df1019683b2ade429ae58a1e41" gracePeriod=30 Mar 16 15:51:48 crc kubenswrapper[5120]: I0316 15:51:48.886069 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="01c946cf-bde7-424b-b7ed-8dc510218e82" containerName="sg-core" containerID="cri-o://d29cf911284d05f9b70ff3294de9f59b3feb5c78440f6ffa99c9d15ba5dbce7d" gracePeriod=30 Mar 16 15:51:48 crc kubenswrapper[5120]: I0316 15:51:48.886129 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="01c946cf-bde7-424b-b7ed-8dc510218e82" containerName="ceilometer-notification-agent" containerID="cri-o://0a21eb928c60a776bb0f8c3d9f7bac3e8a0194b51ac15b6b796b98639f3fc4cc" gracePeriod=30 Mar 16 15:51:48 crc kubenswrapper[5120]: I0316 15:51:48.902012 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-internal-api-0" podStartSLOduration=2.901999852 podStartE2EDuration="2.901999852s" podCreationTimestamp="2026-03-16 15:51:46 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:51:48.899899474 +0000 UTC m=+1211.053831131" watchObservedRunningTime="2026-03-16 15:51:48.901999852 +0000 UTC m=+1211.055931509" Mar 16 15:51:48 crc kubenswrapper[5120]: I0316 15:51:48.951961 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.159685194 podStartE2EDuration="6.951943762s" podCreationTimestamp="2026-03-16 15:51:42 +0000 UTC" firstStartedPulling="2026-03-16 15:51:43.639257842 +0000 UTC m=+1205.793189489" lastFinishedPulling="2026-03-16 15:51:48.4315164 +0000 UTC m=+1210.585448057" observedRunningTime="2026-03-16 15:51:48.9428148 +0000 UTC m=+1211.096746467" watchObservedRunningTime="2026-03-16 15:51:48.951943762 +0000 UTC m=+1211.105875419" Mar 16 15:51:48 crc kubenswrapper[5120]: I0316 15:51:48.961144 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-external-api-0" podStartSLOduration=4.961127175 podStartE2EDuration="4.961127175s" podCreationTimestamp="2026-03-16 15:51:44 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:51:48.960327117 +0000 UTC m=+1211.114258774" watchObservedRunningTime="2026-03-16 15:51:48.961127175 +0000 UTC m=+1211.115058832" Mar 16 15:51:49 crc kubenswrapper[5120]: I0316 15:51:49.900138 5120 generic.go:358] "Generic (PLEG): container finished" podID="01c946cf-bde7-424b-b7ed-8dc510218e82" containerID="337881054f4ea882866f184d95dc78f47dafb6df1019683b2ade429ae58a1e41" exitCode=0 Mar 16 15:51:49 crc kubenswrapper[5120]: I0316 15:51:49.900465 5120 generic.go:358] "Generic (PLEG): container finished" podID="01c946cf-bde7-424b-b7ed-8dc510218e82" containerID="d29cf911284d05f9b70ff3294de9f59b3feb5c78440f6ffa99c9d15ba5dbce7d" exitCode=2 Mar 16 15:51:49 crc kubenswrapper[5120]: I0316 15:51:49.900474 5120 generic.go:358] "Generic (PLEG): container finished" podID="01c946cf-bde7-424b-b7ed-8dc510218e82" containerID="0a21eb928c60a776bb0f8c3d9f7bac3e8a0194b51ac15b6b796b98639f3fc4cc" exitCode=0 Mar 16 15:51:49 crc kubenswrapper[5120]: I0316 15:51:49.901578 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"01c946cf-bde7-424b-b7ed-8dc510218e82","Type":"ContainerDied","Data":"337881054f4ea882866f184d95dc78f47dafb6df1019683b2ade429ae58a1e41"} Mar 16 15:51:49 crc kubenswrapper[5120]: I0316 15:51:49.901618 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"01c946cf-bde7-424b-b7ed-8dc510218e82","Type":"ContainerDied","Data":"d29cf911284d05f9b70ff3294de9f59b3feb5c78440f6ffa99c9d15ba5dbce7d"} Mar 16 15:51:49 crc kubenswrapper[5120]: I0316 15:51:49.901629 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"01c946cf-bde7-424b-b7ed-8dc510218e82","Type":"ContainerDied","Data":"0a21eb928c60a776bb0f8c3d9f7bac3e8a0194b51ac15b6b796b98639f3fc4cc"} Mar 16 15:51:50 crc kubenswrapper[5120]: I0316 15:51:50.223009 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/neutron-85b4fd4946-cqqk6" Mar 16 15:51:50 crc kubenswrapper[5120]: I0316 15:51:50.277955 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-56d94b8cdc-8zpvc"] Mar 16 15:51:50 crc kubenswrapper[5120]: I0316 15:51:50.278185 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-56d94b8cdc-8zpvc" podUID="37731388-5538-4f93-90a7-8a8ffe5abcd7" containerName="neutron-api" containerID="cri-o://8ad2f1ceea6abdbbcecbea620ba57dd5d40f476336ecd310d09c97e9aac94fb7" gracePeriod=30 Mar 16 15:51:50 crc kubenswrapper[5120]: I0316 15:51:50.278267 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-56d94b8cdc-8zpvc" podUID="37731388-5538-4f93-90a7-8a8ffe5abcd7" containerName="neutron-httpd" containerID="cri-o://0d4e2b197b0ef1ebb8a8f1d03820151293162b2dc3dad1d4bb530bd501540414" gracePeriod=30 Mar 16 15:51:50 crc kubenswrapper[5120]: I0316 15:51:50.909893 5120 generic.go:358] "Generic (PLEG): container finished" podID="37731388-5538-4f93-90a7-8a8ffe5abcd7" containerID="0d4e2b197b0ef1ebb8a8f1d03820151293162b2dc3dad1d4bb530bd501540414" exitCode=0 Mar 16 15:51:50 crc kubenswrapper[5120]: I0316 15:51:50.910020 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-56d94b8cdc-8zpvc" event={"ID":"37731388-5538-4f93-90a7-8a8ffe5abcd7","Type":"ContainerDied","Data":"0d4e2b197b0ef1ebb8a8f1d03820151293162b2dc3dad1d4bb530bd501540414"} Mar 16 15:51:52 crc kubenswrapper[5120]: I0316 15:51:52.295436 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-gpg9h"] Mar 16 15:51:52 crc kubenswrapper[5120]: I0316 15:51:52.296800 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe9eadc5-0f96-4232-89f0-22cbe36c1a8f" containerName="mariadb-account-create-update" Mar 16 15:51:52 crc kubenswrapper[5120]: I0316 15:51:52.296816 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe9eadc5-0f96-4232-89f0-22cbe36c1a8f" containerName="mariadb-account-create-update" Mar 16 15:51:52 crc kubenswrapper[5120]: I0316 15:51:52.296853 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd113a80-a8fc-4706-8aec-eb299e36d6b8" containerName="mariadb-account-create-update" Mar 16 15:51:52 crc kubenswrapper[5120]: I0316 15:51:52.296861 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd113a80-a8fc-4706-8aec-eb299e36d6b8" containerName="mariadb-account-create-update" Mar 16 15:51:52 crc kubenswrapper[5120]: I0316 15:51:52.297019 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="fd113a80-a8fc-4706-8aec-eb299e36d6b8" containerName="mariadb-account-create-update" Mar 16 15:51:52 crc kubenswrapper[5120]: I0316 15:51:52.297041 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="fe9eadc5-0f96-4232-89f0-22cbe36c1a8f" containerName="mariadb-account-create-update" Mar 16 15:51:52 crc kubenswrapper[5120]: I0316 15:51:52.398183 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-gpg9h"] Mar 16 15:51:52 crc kubenswrapper[5120]: I0316 15:51:52.398331 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-gpg9h" Mar 16 15:51:52 crc kubenswrapper[5120]: I0316 15:51:52.402392 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-conductor-config-data\"" Mar 16 15:51:52 crc kubenswrapper[5120]: I0316 15:51:52.402771 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-nova-dockercfg-m7cr4\"" Mar 16 15:51:52 crc kubenswrapper[5120]: I0316 15:51:52.404418 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-conductor-scripts\"" Mar 16 15:51:52 crc kubenswrapper[5120]: I0316 15:51:52.488578 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xplmv\" (UniqueName: \"kubernetes.io/projected/38fd2e9b-bc77-4f3c-be96-7059ba88891e-kube-api-access-xplmv\") pod \"nova-cell0-conductor-db-sync-gpg9h\" (UID: \"38fd2e9b-bc77-4f3c-be96-7059ba88891e\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-gpg9h" Mar 16 15:51:52 crc kubenswrapper[5120]: I0316 15:51:52.488658 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/38fd2e9b-bc77-4f3c-be96-7059ba88891e-config-data\") pod \"nova-cell0-conductor-db-sync-gpg9h\" (UID: \"38fd2e9b-bc77-4f3c-be96-7059ba88891e\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-gpg9h" Mar 16 15:51:52 crc kubenswrapper[5120]: I0316 15:51:52.488698 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/38fd2e9b-bc77-4f3c-be96-7059ba88891e-combined-ca-bundle\") pod \"nova-cell0-conductor-db-sync-gpg9h\" (UID: \"38fd2e9b-bc77-4f3c-be96-7059ba88891e\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-gpg9h" Mar 16 15:51:52 crc kubenswrapper[5120]: I0316 15:51:52.488731 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/38fd2e9b-bc77-4f3c-be96-7059ba88891e-scripts\") pod \"nova-cell0-conductor-db-sync-gpg9h\" (UID: \"38fd2e9b-bc77-4f3c-be96-7059ba88891e\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-gpg9h" Mar 16 15:51:52 crc kubenswrapper[5120]: I0316 15:51:52.590687 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xplmv\" (UniqueName: \"kubernetes.io/projected/38fd2e9b-bc77-4f3c-be96-7059ba88891e-kube-api-access-xplmv\") pod \"nova-cell0-conductor-db-sync-gpg9h\" (UID: \"38fd2e9b-bc77-4f3c-be96-7059ba88891e\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-gpg9h" Mar 16 15:51:52 crc kubenswrapper[5120]: I0316 15:51:52.591023 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/38fd2e9b-bc77-4f3c-be96-7059ba88891e-config-data\") pod \"nova-cell0-conductor-db-sync-gpg9h\" (UID: \"38fd2e9b-bc77-4f3c-be96-7059ba88891e\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-gpg9h" Mar 16 15:51:52 crc kubenswrapper[5120]: I0316 15:51:52.591117 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/38fd2e9b-bc77-4f3c-be96-7059ba88891e-combined-ca-bundle\") pod \"nova-cell0-conductor-db-sync-gpg9h\" (UID: \"38fd2e9b-bc77-4f3c-be96-7059ba88891e\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-gpg9h" Mar 16 15:51:52 crc kubenswrapper[5120]: I0316 15:51:52.591198 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/38fd2e9b-bc77-4f3c-be96-7059ba88891e-scripts\") pod \"nova-cell0-conductor-db-sync-gpg9h\" (UID: \"38fd2e9b-bc77-4f3c-be96-7059ba88891e\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-gpg9h" Mar 16 15:51:52 crc kubenswrapper[5120]: I0316 15:51:52.600841 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/38fd2e9b-bc77-4f3c-be96-7059ba88891e-combined-ca-bundle\") pod \"nova-cell0-conductor-db-sync-gpg9h\" (UID: \"38fd2e9b-bc77-4f3c-be96-7059ba88891e\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-gpg9h" Mar 16 15:51:52 crc kubenswrapper[5120]: I0316 15:51:52.601147 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/38fd2e9b-bc77-4f3c-be96-7059ba88891e-config-data\") pod \"nova-cell0-conductor-db-sync-gpg9h\" (UID: \"38fd2e9b-bc77-4f3c-be96-7059ba88891e\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-gpg9h" Mar 16 15:51:52 crc kubenswrapper[5120]: I0316 15:51:52.617824 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/38fd2e9b-bc77-4f3c-be96-7059ba88891e-scripts\") pod \"nova-cell0-conductor-db-sync-gpg9h\" (UID: \"38fd2e9b-bc77-4f3c-be96-7059ba88891e\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-gpg9h" Mar 16 15:51:52 crc kubenswrapper[5120]: I0316 15:51:52.618579 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xplmv\" (UniqueName: \"kubernetes.io/projected/38fd2e9b-bc77-4f3c-be96-7059ba88891e-kube-api-access-xplmv\") pod \"nova-cell0-conductor-db-sync-gpg9h\" (UID: \"38fd2e9b-bc77-4f3c-be96-7059ba88891e\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-gpg9h" Mar 16 15:51:52 crc kubenswrapper[5120]: I0316 15:51:52.721363 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-gpg9h" Mar 16 15:51:53 crc kubenswrapper[5120]: W0316 15:51:53.187479 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod38fd2e9b_bc77_4f3c_be96_7059ba88891e.slice/crio-e389043f7cc9f70cfd3884744e06b45c97cf30e237c2ed37198875e0628b828f WatchSource:0}: Error finding container e389043f7cc9f70cfd3884744e06b45c97cf30e237c2ed37198875e0628b828f: Status 404 returned error can't find the container with id e389043f7cc9f70cfd3884744e06b45c97cf30e237c2ed37198875e0628b828f Mar 16 15:51:53 crc kubenswrapper[5120]: I0316 15:51:53.193840 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-gpg9h"] Mar 16 15:51:53 crc kubenswrapper[5120]: I0316 15:51:53.936423 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:51:53 crc kubenswrapper[5120]: I0316 15:51:53.963895 5120 generic.go:358] "Generic (PLEG): container finished" podID="01c946cf-bde7-424b-b7ed-8dc510218e82" containerID="9b5cec0f91abfb22e3953f98bb1c1c586e94c05897b31c423e81d98a06635cfd" exitCode=0 Mar 16 15:51:53 crc kubenswrapper[5120]: I0316 15:51:53.963954 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"01c946cf-bde7-424b-b7ed-8dc510218e82","Type":"ContainerDied","Data":"9b5cec0f91abfb22e3953f98bb1c1c586e94c05897b31c423e81d98a06635cfd"} Mar 16 15:51:53 crc kubenswrapper[5120]: I0316 15:51:53.963981 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"01c946cf-bde7-424b-b7ed-8dc510218e82","Type":"ContainerDied","Data":"7ef0fa25caf2c84429cbff559feadc9c67a1e53074e7554d4d97de4ce8bc0319"} Mar 16 15:51:53 crc kubenswrapper[5120]: I0316 15:51:53.963997 5120 scope.go:117] "RemoveContainer" containerID="337881054f4ea882866f184d95dc78f47dafb6df1019683b2ade429ae58a1e41" Mar 16 15:51:53 crc kubenswrapper[5120]: I0316 15:51:53.964164 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:51:53 crc kubenswrapper[5120]: I0316 15:51:53.970284 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-gpg9h" event={"ID":"38fd2e9b-bc77-4f3c-be96-7059ba88891e","Type":"ContainerStarted","Data":"e389043f7cc9f70cfd3884744e06b45c97cf30e237c2ed37198875e0628b828f"} Mar 16 15:51:54 crc kubenswrapper[5120]: I0316 15:51:54.014637 5120 scope.go:117] "RemoveContainer" containerID="d29cf911284d05f9b70ff3294de9f59b3feb5c78440f6ffa99c9d15ba5dbce7d" Mar 16 15:51:54 crc kubenswrapper[5120]: I0316 15:51:54.040353 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/01c946cf-bde7-424b-b7ed-8dc510218e82-log-httpd\") pod \"01c946cf-bde7-424b-b7ed-8dc510218e82\" (UID: \"01c946cf-bde7-424b-b7ed-8dc510218e82\") " Mar 16 15:51:54 crc kubenswrapper[5120]: I0316 15:51:54.040439 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/01c946cf-bde7-424b-b7ed-8dc510218e82-sg-core-conf-yaml\") pod \"01c946cf-bde7-424b-b7ed-8dc510218e82\" (UID: \"01c946cf-bde7-424b-b7ed-8dc510218e82\") " Mar 16 15:51:54 crc kubenswrapper[5120]: I0316 15:51:54.040473 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/01c946cf-bde7-424b-b7ed-8dc510218e82-scripts\") pod \"01c946cf-bde7-424b-b7ed-8dc510218e82\" (UID: \"01c946cf-bde7-424b-b7ed-8dc510218e82\") " Mar 16 15:51:54 crc kubenswrapper[5120]: I0316 15:51:54.040501 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b8jpb\" (UniqueName: \"kubernetes.io/projected/01c946cf-bde7-424b-b7ed-8dc510218e82-kube-api-access-b8jpb\") pod \"01c946cf-bde7-424b-b7ed-8dc510218e82\" (UID: \"01c946cf-bde7-424b-b7ed-8dc510218e82\") " Mar 16 15:51:54 crc kubenswrapper[5120]: I0316 15:51:54.040624 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/01c946cf-bde7-424b-b7ed-8dc510218e82-combined-ca-bundle\") pod \"01c946cf-bde7-424b-b7ed-8dc510218e82\" (UID: \"01c946cf-bde7-424b-b7ed-8dc510218e82\") " Mar 16 15:51:54 crc kubenswrapper[5120]: I0316 15:51:54.040721 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/01c946cf-bde7-424b-b7ed-8dc510218e82-run-httpd\") pod \"01c946cf-bde7-424b-b7ed-8dc510218e82\" (UID: \"01c946cf-bde7-424b-b7ed-8dc510218e82\") " Mar 16 15:51:54 crc kubenswrapper[5120]: I0316 15:51:54.040826 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/01c946cf-bde7-424b-b7ed-8dc510218e82-config-data\") pod \"01c946cf-bde7-424b-b7ed-8dc510218e82\" (UID: \"01c946cf-bde7-424b-b7ed-8dc510218e82\") " Mar 16 15:51:54 crc kubenswrapper[5120]: I0316 15:51:54.042372 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01c946cf-bde7-424b-b7ed-8dc510218e82-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "01c946cf-bde7-424b-b7ed-8dc510218e82" (UID: "01c946cf-bde7-424b-b7ed-8dc510218e82"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:51:54 crc kubenswrapper[5120]: I0316 15:51:54.042719 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01c946cf-bde7-424b-b7ed-8dc510218e82-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "01c946cf-bde7-424b-b7ed-8dc510218e82" (UID: "01c946cf-bde7-424b-b7ed-8dc510218e82"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:51:54 crc kubenswrapper[5120]: I0316 15:51:54.045313 5120 scope.go:117] "RemoveContainer" containerID="0a21eb928c60a776bb0f8c3d9f7bac3e8a0194b51ac15b6b796b98639f3fc4cc" Mar 16 15:51:54 crc kubenswrapper[5120]: I0316 15:51:54.054945 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/01c946cf-bde7-424b-b7ed-8dc510218e82-scripts" (OuterVolumeSpecName: "scripts") pod "01c946cf-bde7-424b-b7ed-8dc510218e82" (UID: "01c946cf-bde7-424b-b7ed-8dc510218e82"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:51:54 crc kubenswrapper[5120]: I0316 15:51:54.064785 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01c946cf-bde7-424b-b7ed-8dc510218e82-kube-api-access-b8jpb" (OuterVolumeSpecName: "kube-api-access-b8jpb") pod "01c946cf-bde7-424b-b7ed-8dc510218e82" (UID: "01c946cf-bde7-424b-b7ed-8dc510218e82"). InnerVolumeSpecName "kube-api-access-b8jpb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:51:54 crc kubenswrapper[5120]: I0316 15:51:54.070576 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/01c946cf-bde7-424b-b7ed-8dc510218e82-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "01c946cf-bde7-424b-b7ed-8dc510218e82" (UID: "01c946cf-bde7-424b-b7ed-8dc510218e82"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:51:54 crc kubenswrapper[5120]: I0316 15:51:54.137267 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/01c946cf-bde7-424b-b7ed-8dc510218e82-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "01c946cf-bde7-424b-b7ed-8dc510218e82" (UID: "01c946cf-bde7-424b-b7ed-8dc510218e82"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:51:54 crc kubenswrapper[5120]: I0316 15:51:54.141813 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/01c946cf-bde7-424b-b7ed-8dc510218e82-config-data" (OuterVolumeSpecName: "config-data") pod "01c946cf-bde7-424b-b7ed-8dc510218e82" (UID: "01c946cf-bde7-424b-b7ed-8dc510218e82"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:51:54 crc kubenswrapper[5120]: I0316 15:51:54.142289 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/01c946cf-bde7-424b-b7ed-8dc510218e82-config-data\") pod \"01c946cf-bde7-424b-b7ed-8dc510218e82\" (UID: \"01c946cf-bde7-424b-b7ed-8dc510218e82\") " Mar 16 15:51:54 crc kubenswrapper[5120]: W0316 15:51:54.142478 5120 empty_dir.go:511] Warning: Unmount skipped because path does not exist: /var/lib/kubelet/pods/01c946cf-bde7-424b-b7ed-8dc510218e82/volumes/kubernetes.io~secret/config-data Mar 16 15:51:54 crc kubenswrapper[5120]: I0316 15:51:54.142491 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/01c946cf-bde7-424b-b7ed-8dc510218e82-config-data" (OuterVolumeSpecName: "config-data") pod "01c946cf-bde7-424b-b7ed-8dc510218e82" (UID: "01c946cf-bde7-424b-b7ed-8dc510218e82"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:51:54 crc kubenswrapper[5120]: I0316 15:51:54.143038 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/01c946cf-bde7-424b-b7ed-8dc510218e82-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:51:54 crc kubenswrapper[5120]: I0316 15:51:54.143051 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/01c946cf-bde7-424b-b7ed-8dc510218e82-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 15:51:54 crc kubenswrapper[5120]: I0316 15:51:54.143061 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/01c946cf-bde7-424b-b7ed-8dc510218e82-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 15:51:54 crc kubenswrapper[5120]: I0316 15:51:54.143069 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/01c946cf-bde7-424b-b7ed-8dc510218e82-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 15:51:54 crc kubenswrapper[5120]: I0316 15:51:54.143077 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/01c946cf-bde7-424b-b7ed-8dc510218e82-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 15:51:54 crc kubenswrapper[5120]: I0316 15:51:54.143085 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/01c946cf-bde7-424b-b7ed-8dc510218e82-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 15:51:54 crc kubenswrapper[5120]: I0316 15:51:54.143094 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b8jpb\" (UniqueName: \"kubernetes.io/projected/01c946cf-bde7-424b-b7ed-8dc510218e82-kube-api-access-b8jpb\") on node \"crc\" DevicePath \"\"" Mar 16 15:51:54 crc kubenswrapper[5120]: I0316 15:51:54.147085 5120 scope.go:117] "RemoveContainer" containerID="9b5cec0f91abfb22e3953f98bb1c1c586e94c05897b31c423e81d98a06635cfd" Mar 16 15:51:54 crc kubenswrapper[5120]: I0316 15:51:54.169274 5120 scope.go:117] "RemoveContainer" containerID="337881054f4ea882866f184d95dc78f47dafb6df1019683b2ade429ae58a1e41" Mar 16 15:51:54 crc kubenswrapper[5120]: E0316 15:51:54.169781 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"337881054f4ea882866f184d95dc78f47dafb6df1019683b2ade429ae58a1e41\": container with ID starting with 337881054f4ea882866f184d95dc78f47dafb6df1019683b2ade429ae58a1e41 not found: ID does not exist" containerID="337881054f4ea882866f184d95dc78f47dafb6df1019683b2ade429ae58a1e41" Mar 16 15:51:54 crc kubenswrapper[5120]: I0316 15:51:54.169808 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"337881054f4ea882866f184d95dc78f47dafb6df1019683b2ade429ae58a1e41"} err="failed to get container status \"337881054f4ea882866f184d95dc78f47dafb6df1019683b2ade429ae58a1e41\": rpc error: code = NotFound desc = could not find container \"337881054f4ea882866f184d95dc78f47dafb6df1019683b2ade429ae58a1e41\": container with ID starting with 337881054f4ea882866f184d95dc78f47dafb6df1019683b2ade429ae58a1e41 not found: ID does not exist" Mar 16 15:51:54 crc kubenswrapper[5120]: I0316 15:51:54.169827 5120 scope.go:117] "RemoveContainer" containerID="d29cf911284d05f9b70ff3294de9f59b3feb5c78440f6ffa99c9d15ba5dbce7d" Mar 16 15:51:54 crc kubenswrapper[5120]: E0316 15:51:54.170097 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d29cf911284d05f9b70ff3294de9f59b3feb5c78440f6ffa99c9d15ba5dbce7d\": container with ID starting with d29cf911284d05f9b70ff3294de9f59b3feb5c78440f6ffa99c9d15ba5dbce7d not found: ID does not exist" containerID="d29cf911284d05f9b70ff3294de9f59b3feb5c78440f6ffa99c9d15ba5dbce7d" Mar 16 15:51:54 crc kubenswrapper[5120]: I0316 15:51:54.170116 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d29cf911284d05f9b70ff3294de9f59b3feb5c78440f6ffa99c9d15ba5dbce7d"} err="failed to get container status \"d29cf911284d05f9b70ff3294de9f59b3feb5c78440f6ffa99c9d15ba5dbce7d\": rpc error: code = NotFound desc = could not find container \"d29cf911284d05f9b70ff3294de9f59b3feb5c78440f6ffa99c9d15ba5dbce7d\": container with ID starting with d29cf911284d05f9b70ff3294de9f59b3feb5c78440f6ffa99c9d15ba5dbce7d not found: ID does not exist" Mar 16 15:51:54 crc kubenswrapper[5120]: I0316 15:51:54.170131 5120 scope.go:117] "RemoveContainer" containerID="0a21eb928c60a776bb0f8c3d9f7bac3e8a0194b51ac15b6b796b98639f3fc4cc" Mar 16 15:51:54 crc kubenswrapper[5120]: E0316 15:51:54.170433 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a21eb928c60a776bb0f8c3d9f7bac3e8a0194b51ac15b6b796b98639f3fc4cc\": container with ID starting with 0a21eb928c60a776bb0f8c3d9f7bac3e8a0194b51ac15b6b796b98639f3fc4cc not found: ID does not exist" containerID="0a21eb928c60a776bb0f8c3d9f7bac3e8a0194b51ac15b6b796b98639f3fc4cc" Mar 16 15:51:54 crc kubenswrapper[5120]: I0316 15:51:54.170459 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a21eb928c60a776bb0f8c3d9f7bac3e8a0194b51ac15b6b796b98639f3fc4cc"} err="failed to get container status \"0a21eb928c60a776bb0f8c3d9f7bac3e8a0194b51ac15b6b796b98639f3fc4cc\": rpc error: code = NotFound desc = could not find container \"0a21eb928c60a776bb0f8c3d9f7bac3e8a0194b51ac15b6b796b98639f3fc4cc\": container with ID starting with 0a21eb928c60a776bb0f8c3d9f7bac3e8a0194b51ac15b6b796b98639f3fc4cc not found: ID does not exist" Mar 16 15:51:54 crc kubenswrapper[5120]: I0316 15:51:54.170473 5120 scope.go:117] "RemoveContainer" containerID="9b5cec0f91abfb22e3953f98bb1c1c586e94c05897b31c423e81d98a06635cfd" Mar 16 15:51:54 crc kubenswrapper[5120]: E0316 15:51:54.170716 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b5cec0f91abfb22e3953f98bb1c1c586e94c05897b31c423e81d98a06635cfd\": container with ID starting with 9b5cec0f91abfb22e3953f98bb1c1c586e94c05897b31c423e81d98a06635cfd not found: ID does not exist" containerID="9b5cec0f91abfb22e3953f98bb1c1c586e94c05897b31c423e81d98a06635cfd" Mar 16 15:51:54 crc kubenswrapper[5120]: I0316 15:51:54.170747 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b5cec0f91abfb22e3953f98bb1c1c586e94c05897b31c423e81d98a06635cfd"} err="failed to get container status \"9b5cec0f91abfb22e3953f98bb1c1c586e94c05897b31c423e81d98a06635cfd\": rpc error: code = NotFound desc = could not find container \"9b5cec0f91abfb22e3953f98bb1c1c586e94c05897b31c423e81d98a06635cfd\": container with ID starting with 9b5cec0f91abfb22e3953f98bb1c1c586e94c05897b31c423e81d98a06635cfd not found: ID does not exist" Mar 16 15:51:54 crc kubenswrapper[5120]: I0316 15:51:54.305819 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 15:51:54 crc kubenswrapper[5120]: I0316 15:51:54.314588 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 15:51:54 crc kubenswrapper[5120]: I0316 15:51:54.326495 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 15:51:54 crc kubenswrapper[5120]: I0316 15:51:54.332050 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01c946cf-bde7-424b-b7ed-8dc510218e82" containerName="proxy-httpd" Mar 16 15:51:54 crc kubenswrapper[5120]: I0316 15:51:54.332075 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="01c946cf-bde7-424b-b7ed-8dc510218e82" containerName="proxy-httpd" Mar 16 15:51:54 crc kubenswrapper[5120]: I0316 15:51:54.332096 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01c946cf-bde7-424b-b7ed-8dc510218e82" containerName="ceilometer-central-agent" Mar 16 15:51:54 crc kubenswrapper[5120]: I0316 15:51:54.332105 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="01c946cf-bde7-424b-b7ed-8dc510218e82" containerName="ceilometer-central-agent" Mar 16 15:51:54 crc kubenswrapper[5120]: I0316 15:51:54.332141 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01c946cf-bde7-424b-b7ed-8dc510218e82" containerName="sg-core" Mar 16 15:51:54 crc kubenswrapper[5120]: I0316 15:51:54.332146 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="01c946cf-bde7-424b-b7ed-8dc510218e82" containerName="sg-core" Mar 16 15:51:54 crc kubenswrapper[5120]: I0316 15:51:54.332163 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01c946cf-bde7-424b-b7ed-8dc510218e82" containerName="ceilometer-notification-agent" Mar 16 15:51:54 crc kubenswrapper[5120]: I0316 15:51:54.332170 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="01c946cf-bde7-424b-b7ed-8dc510218e82" containerName="ceilometer-notification-agent" Mar 16 15:51:54 crc kubenswrapper[5120]: I0316 15:51:54.332331 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="01c946cf-bde7-424b-b7ed-8dc510218e82" containerName="ceilometer-notification-agent" Mar 16 15:51:54 crc kubenswrapper[5120]: I0316 15:51:54.332349 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="01c946cf-bde7-424b-b7ed-8dc510218e82" containerName="sg-core" Mar 16 15:51:54 crc kubenswrapper[5120]: I0316 15:51:54.332362 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="01c946cf-bde7-424b-b7ed-8dc510218e82" containerName="ceilometer-central-agent" Mar 16 15:51:54 crc kubenswrapper[5120]: I0316 15:51:54.332369 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="01c946cf-bde7-424b-b7ed-8dc510218e82" containerName="proxy-httpd" Mar 16 15:51:54 crc kubenswrapper[5120]: I0316 15:51:54.341969 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:51:54 crc kubenswrapper[5120]: I0316 15:51:54.344957 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 15:51:54 crc kubenswrapper[5120]: I0316 15:51:54.346375 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 15:51:54 crc kubenswrapper[5120]: I0316 15:51:54.346908 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 15:51:54 crc kubenswrapper[5120]: I0316 15:51:54.447993 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/7a77c479-1665-4fd1-a627-ff873b9aa31a-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"7a77c479-1665-4fd1-a627-ff873b9aa31a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:51:54 crc kubenswrapper[5120]: I0316 15:51:54.448126 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7a77c479-1665-4fd1-a627-ff873b9aa31a-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"7a77c479-1665-4fd1-a627-ff873b9aa31a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:51:54 crc kubenswrapper[5120]: I0316 15:51:54.448163 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dz6m4\" (UniqueName: \"kubernetes.io/projected/7a77c479-1665-4fd1-a627-ff873b9aa31a-kube-api-access-dz6m4\") pod \"ceilometer-0\" (UID: \"7a77c479-1665-4fd1-a627-ff873b9aa31a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:51:54 crc kubenswrapper[5120]: I0316 15:51:54.448207 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7a77c479-1665-4fd1-a627-ff873b9aa31a-scripts\") pod \"ceilometer-0\" (UID: \"7a77c479-1665-4fd1-a627-ff873b9aa31a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:51:54 crc kubenswrapper[5120]: I0316 15:51:54.448229 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7a77c479-1665-4fd1-a627-ff873b9aa31a-log-httpd\") pod \"ceilometer-0\" (UID: \"7a77c479-1665-4fd1-a627-ff873b9aa31a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:51:54 crc kubenswrapper[5120]: I0316 15:51:54.448251 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7a77c479-1665-4fd1-a627-ff873b9aa31a-run-httpd\") pod \"ceilometer-0\" (UID: \"7a77c479-1665-4fd1-a627-ff873b9aa31a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:51:54 crc kubenswrapper[5120]: I0316 15:51:54.448301 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7a77c479-1665-4fd1-a627-ff873b9aa31a-config-data\") pod \"ceilometer-0\" (UID: \"7a77c479-1665-4fd1-a627-ff873b9aa31a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:51:54 crc kubenswrapper[5120]: I0316 15:51:54.549708 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dz6m4\" (UniqueName: \"kubernetes.io/projected/7a77c479-1665-4fd1-a627-ff873b9aa31a-kube-api-access-dz6m4\") pod \"ceilometer-0\" (UID: \"7a77c479-1665-4fd1-a627-ff873b9aa31a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:51:54 crc kubenswrapper[5120]: I0316 15:51:54.549796 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7a77c479-1665-4fd1-a627-ff873b9aa31a-scripts\") pod \"ceilometer-0\" (UID: \"7a77c479-1665-4fd1-a627-ff873b9aa31a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:51:54 crc kubenswrapper[5120]: I0316 15:51:54.549834 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7a77c479-1665-4fd1-a627-ff873b9aa31a-log-httpd\") pod \"ceilometer-0\" (UID: \"7a77c479-1665-4fd1-a627-ff873b9aa31a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:51:54 crc kubenswrapper[5120]: I0316 15:51:54.549862 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7a77c479-1665-4fd1-a627-ff873b9aa31a-run-httpd\") pod \"ceilometer-0\" (UID: \"7a77c479-1665-4fd1-a627-ff873b9aa31a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:51:54 crc kubenswrapper[5120]: I0316 15:51:54.549930 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7a77c479-1665-4fd1-a627-ff873b9aa31a-config-data\") pod \"ceilometer-0\" (UID: \"7a77c479-1665-4fd1-a627-ff873b9aa31a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:51:54 crc kubenswrapper[5120]: I0316 15:51:54.549998 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/7a77c479-1665-4fd1-a627-ff873b9aa31a-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"7a77c479-1665-4fd1-a627-ff873b9aa31a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:51:54 crc kubenswrapper[5120]: I0316 15:51:54.550072 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7a77c479-1665-4fd1-a627-ff873b9aa31a-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"7a77c479-1665-4fd1-a627-ff873b9aa31a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:51:54 crc kubenswrapper[5120]: I0316 15:51:54.551330 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7a77c479-1665-4fd1-a627-ff873b9aa31a-run-httpd\") pod \"ceilometer-0\" (UID: \"7a77c479-1665-4fd1-a627-ff873b9aa31a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:51:54 crc kubenswrapper[5120]: I0316 15:51:54.551476 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7a77c479-1665-4fd1-a627-ff873b9aa31a-log-httpd\") pod \"ceilometer-0\" (UID: \"7a77c479-1665-4fd1-a627-ff873b9aa31a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:51:54 crc kubenswrapper[5120]: I0316 15:51:54.555841 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7a77c479-1665-4fd1-a627-ff873b9aa31a-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"7a77c479-1665-4fd1-a627-ff873b9aa31a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:51:54 crc kubenswrapper[5120]: I0316 15:51:54.559017 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/7a77c479-1665-4fd1-a627-ff873b9aa31a-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"7a77c479-1665-4fd1-a627-ff873b9aa31a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:51:54 crc kubenswrapper[5120]: I0316 15:51:54.561532 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7a77c479-1665-4fd1-a627-ff873b9aa31a-scripts\") pod \"ceilometer-0\" (UID: \"7a77c479-1665-4fd1-a627-ff873b9aa31a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:51:54 crc kubenswrapper[5120]: I0316 15:51:54.561614 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7a77c479-1665-4fd1-a627-ff873b9aa31a-config-data\") pod \"ceilometer-0\" (UID: \"7a77c479-1665-4fd1-a627-ff873b9aa31a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:51:54 crc kubenswrapper[5120]: I0316 15:51:54.568325 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dz6m4\" (UniqueName: \"kubernetes.io/projected/7a77c479-1665-4fd1-a627-ff873b9aa31a-kube-api-access-dz6m4\") pod \"ceilometer-0\" (UID: \"7a77c479-1665-4fd1-a627-ff873b9aa31a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:51:54 crc kubenswrapper[5120]: I0316 15:51:54.662996 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:51:54 crc kubenswrapper[5120]: I0316 15:51:54.676930 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="01c946cf-bde7-424b-b7ed-8dc510218e82" path="/var/lib/kubelet/pods/01c946cf-bde7-424b-b7ed-8dc510218e82/volumes" Mar 16 15:51:55 crc kubenswrapper[5120]: I0316 15:51:55.145635 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 15:51:55 crc kubenswrapper[5120]: I0316 15:51:55.224454 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:51:55 crc kubenswrapper[5120]: I0316 15:51:55.224516 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:51:55 crc kubenswrapper[5120]: I0316 15:51:55.263856 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:51:55 crc kubenswrapper[5120]: I0316 15:51:55.279596 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:51:55 crc kubenswrapper[5120]: I0316 15:51:55.994124 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7a77c479-1665-4fd1-a627-ff873b9aa31a","Type":"ContainerStarted","Data":"14bc4cc1a952d84ef2ca5ceca3102744a4e0ef10b5ecc2769cef59212e7cc673"} Mar 16 15:51:55 crc kubenswrapper[5120]: I0316 15:51:55.994561 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:51:55 crc kubenswrapper[5120]: I0316 15:51:55.994582 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7a77c479-1665-4fd1-a627-ff873b9aa31a","Type":"ContainerStarted","Data":"4e4bd923e7106bf64e1c6fa08cd044d90759a331a71089ca70f54898f3609562"} Mar 16 15:51:55 crc kubenswrapper[5120]: I0316 15:51:55.994596 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:51:56 crc kubenswrapper[5120]: I0316 15:51:56.638590 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:51:56 crc kubenswrapper[5120]: I0316 15:51:56.638917 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:51:56 crc kubenswrapper[5120]: I0316 15:51:56.725782 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:51:56 crc kubenswrapper[5120]: I0316 15:51:56.725829 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:51:57 crc kubenswrapper[5120]: I0316 15:51:57.003458 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:51:57 crc kubenswrapper[5120]: I0316 15:51:57.004035 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:51:57 crc kubenswrapper[5120]: I0316 15:51:57.882050 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:51:57 crc kubenswrapper[5120]: I0316 15:51:57.889126 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:51:58 crc kubenswrapper[5120]: I0316 15:51:58.979353 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:51:58 crc kubenswrapper[5120]: I0316 15:51:58.983689 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:51:59 crc kubenswrapper[5120]: I0316 15:51:59.026886 5120 generic.go:358] "Generic (PLEG): container finished" podID="37731388-5538-4f93-90a7-8a8ffe5abcd7" containerID="8ad2f1ceea6abdbbcecbea620ba57dd5d40f476336ecd310d09c97e9aac94fb7" exitCode=0 Mar 16 15:51:59 crc kubenswrapper[5120]: I0316 15:51:59.026965 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-56d94b8cdc-8zpvc" event={"ID":"37731388-5538-4f93-90a7-8a8ffe5abcd7","Type":"ContainerDied","Data":"8ad2f1ceea6abdbbcecbea620ba57dd5d40f476336ecd310d09c97e9aac94fb7"} Mar 16 15:52:00 crc kubenswrapper[5120]: I0316 15:52:00.137136 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-infra/auto-csr-approver-29561272-5tsq4"] Mar 16 15:52:00 crc kubenswrapper[5120]: I0316 15:52:00.166235 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561272-5tsq4" Mar 16 15:52:00 crc kubenswrapper[5120]: I0316 15:52:00.169024 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-infra\"/\"csr-approver-sa-dockercfg-x2nsz\"" Mar 16 15:52:00 crc kubenswrapper[5120]: I0316 15:52:00.169058 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"openshift-service-ca.crt\"" Mar 16 15:52:00 crc kubenswrapper[5120]: I0316 15:52:00.170463 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"kube-root-ca.crt\"" Mar 16 15:52:00 crc kubenswrapper[5120]: I0316 15:52:00.171190 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561272-5tsq4"] Mar 16 15:52:00 crc kubenswrapper[5120]: I0316 15:52:00.277010 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wq2fc\" (UniqueName: \"kubernetes.io/projected/0edbd946-b6a5-446e-a5b7-c950d16a98f1-kube-api-access-wq2fc\") pod \"auto-csr-approver-29561272-5tsq4\" (UID: \"0edbd946-b6a5-446e-a5b7-c950d16a98f1\") " pod="openshift-infra/auto-csr-approver-29561272-5tsq4" Mar 16 15:52:00 crc kubenswrapper[5120]: I0316 15:52:00.345367 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/placement-7956bcf97d-p9m4c" Mar 16 15:52:00 crc kubenswrapper[5120]: I0316 15:52:00.378530 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wq2fc\" (UniqueName: \"kubernetes.io/projected/0edbd946-b6a5-446e-a5b7-c950d16a98f1-kube-api-access-wq2fc\") pod \"auto-csr-approver-29561272-5tsq4\" (UID: \"0edbd946-b6a5-446e-a5b7-c950d16a98f1\") " pod="openshift-infra/auto-csr-approver-29561272-5tsq4" Mar 16 15:52:00 crc kubenswrapper[5120]: I0316 15:52:00.406661 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wq2fc\" (UniqueName: \"kubernetes.io/projected/0edbd946-b6a5-446e-a5b7-c950d16a98f1-kube-api-access-wq2fc\") pod \"auto-csr-approver-29561272-5tsq4\" (UID: \"0edbd946-b6a5-446e-a5b7-c950d16a98f1\") " pod="openshift-infra/auto-csr-approver-29561272-5tsq4" Mar 16 15:52:00 crc kubenswrapper[5120]: I0316 15:52:00.493121 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561272-5tsq4" Mar 16 15:52:01 crc kubenswrapper[5120]: I0316 15:52:01.241636 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/placement-7956bcf97d-p9m4c" Mar 16 15:52:01 crc kubenswrapper[5120]: I0316 15:52:01.307663 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-5b47d59db-lz86c"] Mar 16 15:52:01 crc kubenswrapper[5120]: I0316 15:52:01.307958 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-5b47d59db-lz86c" podUID="6b459d6b-d4c6-44e9-ae6f-05e060b30042" containerName="placement-log" containerID="cri-o://253263514b37a7de242416afffbc4f1dccc4a251618796a8cd4cfed35d4d0e2a" gracePeriod=30 Mar 16 15:52:01 crc kubenswrapper[5120]: I0316 15:52:01.308417 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-5b47d59db-lz86c" podUID="6b459d6b-d4c6-44e9-ae6f-05e060b30042" containerName="placement-api" containerID="cri-o://114a179baefc421d90a7e2b6fb81ce44aedfdabd5862f6335d333b6d4eedf732" gracePeriod=30 Mar 16 15:52:01 crc kubenswrapper[5120]: I0316 15:52:01.657726 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 15:52:01 crc kubenswrapper[5120]: I0316 15:52:01.940816 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-56d94b8cdc-8zpvc" Mar 16 15:52:02 crc kubenswrapper[5120]: I0316 15:52:02.059927 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-gpg9h" event={"ID":"38fd2e9b-bc77-4f3c-be96-7059ba88891e","Type":"ContainerStarted","Data":"186b4e2033d4312c54f215dec67a20d5d2834f98c87348e63660f4a704ef1870"} Mar 16 15:52:02 crc kubenswrapper[5120]: I0316 15:52:02.062936 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7a77c479-1665-4fd1-a627-ff873b9aa31a","Type":"ContainerStarted","Data":"6076dd6857449ba98193200ddf7279eb51cf3d641d1fa7bdf36eb1097d5c1a38"} Mar 16 15:52:02 crc kubenswrapper[5120]: I0316 15:52:02.069080 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-56d94b8cdc-8zpvc" Mar 16 15:52:02 crc kubenswrapper[5120]: I0316 15:52:02.069097 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-56d94b8cdc-8zpvc" event={"ID":"37731388-5538-4f93-90a7-8a8ffe5abcd7","Type":"ContainerDied","Data":"d194e0860a6990a4c97de070d3cae4af2424469b57931ed8a173878c4f581016"} Mar 16 15:52:02 crc kubenswrapper[5120]: I0316 15:52:02.069141 5120 scope.go:117] "RemoveContainer" containerID="0d4e2b197b0ef1ebb8a8f1d03820151293162b2dc3dad1d4bb530bd501540414" Mar 16 15:52:02 crc kubenswrapper[5120]: I0316 15:52:02.071549 5120 generic.go:358] "Generic (PLEG): container finished" podID="6b459d6b-d4c6-44e9-ae6f-05e060b30042" containerID="253263514b37a7de242416afffbc4f1dccc4a251618796a8cd4cfed35d4d0e2a" exitCode=143 Mar 16 15:52:02 crc kubenswrapper[5120]: I0316 15:52:02.071808 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-5b47d59db-lz86c" event={"ID":"6b459d6b-d4c6-44e9-ae6f-05e060b30042","Type":"ContainerDied","Data":"253263514b37a7de242416afffbc4f1dccc4a251618796a8cd4cfed35d4d0e2a"} Mar 16 15:52:02 crc kubenswrapper[5120]: I0316 15:52:02.079776 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-gpg9h" podStartSLOduration=1.552504709 podStartE2EDuration="10.079744638s" podCreationTimestamp="2026-03-16 15:51:52 +0000 UTC" firstStartedPulling="2026-03-16 15:51:53.191561869 +0000 UTC m=+1215.345493516" lastFinishedPulling="2026-03-16 15:52:01.718801788 +0000 UTC m=+1223.872733445" observedRunningTime="2026-03-16 15:52:02.072741665 +0000 UTC m=+1224.226673342" watchObservedRunningTime="2026-03-16 15:52:02.079744638 +0000 UTC m=+1224.233676295" Mar 16 15:52:02 crc kubenswrapper[5120]: I0316 15:52:02.095043 5120 scope.go:117] "RemoveContainer" containerID="8ad2f1ceea6abdbbcecbea620ba57dd5d40f476336ecd310d09c97e9aac94fb7" Mar 16 15:52:02 crc kubenswrapper[5120]: I0316 15:52:02.120409 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wvclp\" (UniqueName: \"kubernetes.io/projected/37731388-5538-4f93-90a7-8a8ffe5abcd7-kube-api-access-wvclp\") pod \"37731388-5538-4f93-90a7-8a8ffe5abcd7\" (UID: \"37731388-5538-4f93-90a7-8a8ffe5abcd7\") " Mar 16 15:52:02 crc kubenswrapper[5120]: I0316 15:52:02.120488 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/37731388-5538-4f93-90a7-8a8ffe5abcd7-ovndb-tls-certs\") pod \"37731388-5538-4f93-90a7-8a8ffe5abcd7\" (UID: \"37731388-5538-4f93-90a7-8a8ffe5abcd7\") " Mar 16 15:52:02 crc kubenswrapper[5120]: I0316 15:52:02.120549 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/37731388-5538-4f93-90a7-8a8ffe5abcd7-combined-ca-bundle\") pod \"37731388-5538-4f93-90a7-8a8ffe5abcd7\" (UID: \"37731388-5538-4f93-90a7-8a8ffe5abcd7\") " Mar 16 15:52:02 crc kubenswrapper[5120]: I0316 15:52:02.120621 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/37731388-5538-4f93-90a7-8a8ffe5abcd7-config\") pod \"37731388-5538-4f93-90a7-8a8ffe5abcd7\" (UID: \"37731388-5538-4f93-90a7-8a8ffe5abcd7\") " Mar 16 15:52:02 crc kubenswrapper[5120]: I0316 15:52:02.120681 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/37731388-5538-4f93-90a7-8a8ffe5abcd7-httpd-config\") pod \"37731388-5538-4f93-90a7-8a8ffe5abcd7\" (UID: \"37731388-5538-4f93-90a7-8a8ffe5abcd7\") " Mar 16 15:52:02 crc kubenswrapper[5120]: I0316 15:52:02.127205 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37731388-5538-4f93-90a7-8a8ffe5abcd7-kube-api-access-wvclp" (OuterVolumeSpecName: "kube-api-access-wvclp") pod "37731388-5538-4f93-90a7-8a8ffe5abcd7" (UID: "37731388-5538-4f93-90a7-8a8ffe5abcd7"). InnerVolumeSpecName "kube-api-access-wvclp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:52:02 crc kubenswrapper[5120]: I0316 15:52:02.128216 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37731388-5538-4f93-90a7-8a8ffe5abcd7-httpd-config" (OuterVolumeSpecName: "httpd-config") pod "37731388-5538-4f93-90a7-8a8ffe5abcd7" (UID: "37731388-5538-4f93-90a7-8a8ffe5abcd7"). InnerVolumeSpecName "httpd-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:52:02 crc kubenswrapper[5120]: I0316 15:52:02.171464 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561272-5tsq4"] Mar 16 15:52:02 crc kubenswrapper[5120]: I0316 15:52:02.193916 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37731388-5538-4f93-90a7-8a8ffe5abcd7-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "37731388-5538-4f93-90a7-8a8ffe5abcd7" (UID: "37731388-5538-4f93-90a7-8a8ffe5abcd7"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:52:02 crc kubenswrapper[5120]: I0316 15:52:02.194445 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37731388-5538-4f93-90a7-8a8ffe5abcd7-config" (OuterVolumeSpecName: "config") pod "37731388-5538-4f93-90a7-8a8ffe5abcd7" (UID: "37731388-5538-4f93-90a7-8a8ffe5abcd7"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:52:02 crc kubenswrapper[5120]: I0316 15:52:02.213686 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37731388-5538-4f93-90a7-8a8ffe5abcd7-ovndb-tls-certs" (OuterVolumeSpecName: "ovndb-tls-certs") pod "37731388-5538-4f93-90a7-8a8ffe5abcd7" (UID: "37731388-5538-4f93-90a7-8a8ffe5abcd7"). InnerVolumeSpecName "ovndb-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:52:02 crc kubenswrapper[5120]: I0316 15:52:02.223913 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wvclp\" (UniqueName: \"kubernetes.io/projected/37731388-5538-4f93-90a7-8a8ffe5abcd7-kube-api-access-wvclp\") on node \"crc\" DevicePath \"\"" Mar 16 15:52:02 crc kubenswrapper[5120]: I0316 15:52:02.223961 5120 reconciler_common.go:299] "Volume detached for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/37731388-5538-4f93-90a7-8a8ffe5abcd7-ovndb-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 15:52:02 crc kubenswrapper[5120]: I0316 15:52:02.223970 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/37731388-5538-4f93-90a7-8a8ffe5abcd7-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:52:02 crc kubenswrapper[5120]: I0316 15:52:02.223978 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/37731388-5538-4f93-90a7-8a8ffe5abcd7-config\") on node \"crc\" DevicePath \"\"" Mar 16 15:52:02 crc kubenswrapper[5120]: I0316 15:52:02.223987 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/37731388-5538-4f93-90a7-8a8ffe5abcd7-httpd-config\") on node \"crc\" DevicePath \"\"" Mar 16 15:52:02 crc kubenswrapper[5120]: I0316 15:52:02.421549 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-56d94b8cdc-8zpvc"] Mar 16 15:52:02 crc kubenswrapper[5120]: I0316 15:52:02.430302 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-56d94b8cdc-8zpvc"] Mar 16 15:52:02 crc kubenswrapper[5120]: I0316 15:52:02.684597 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="37731388-5538-4f93-90a7-8a8ffe5abcd7" path="/var/lib/kubelet/pods/37731388-5538-4f93-90a7-8a8ffe5abcd7/volumes" Mar 16 15:52:03 crc kubenswrapper[5120]: I0316 15:52:03.084841 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561272-5tsq4" event={"ID":"0edbd946-b6a5-446e-a5b7-c950d16a98f1","Type":"ContainerStarted","Data":"fdb8a55998eae58fc2747c6b879af2ebbfeff39f6fd5f7d76b790121a330a135"} Mar 16 15:52:03 crc kubenswrapper[5120]: I0316 15:52:03.087597 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7a77c479-1665-4fd1-a627-ff873b9aa31a","Type":"ContainerStarted","Data":"18e4014eb40be43296c01c782b69d4e142e8033fdb49af0e7ea9cf6f6f5c05a4"} Mar 16 15:52:04 crc kubenswrapper[5120]: I0316 15:52:04.097286 5120 generic.go:358] "Generic (PLEG): container finished" podID="0edbd946-b6a5-446e-a5b7-c950d16a98f1" containerID="f7c3a2c821fd28e642a6693a5f7f5e1cf9e1862c120eb79a95cbbc3b9df57f2b" exitCode=0 Mar 16 15:52:04 crc kubenswrapper[5120]: I0316 15:52:04.097381 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561272-5tsq4" event={"ID":"0edbd946-b6a5-446e-a5b7-c950d16a98f1","Type":"ContainerDied","Data":"f7c3a2c821fd28e642a6693a5f7f5e1cf9e1862c120eb79a95cbbc3b9df57f2b"} Mar 16 15:52:04 crc kubenswrapper[5120]: I0316 15:52:04.842240 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-5b47d59db-lz86c" Mar 16 15:52:04 crc kubenswrapper[5120]: I0316 15:52:04.971667 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6b459d6b-d4c6-44e9-ae6f-05e060b30042-scripts\") pod \"6b459d6b-d4c6-44e9-ae6f-05e060b30042\" (UID: \"6b459d6b-d4c6-44e9-ae6f-05e060b30042\") " Mar 16 15:52:04 crc kubenswrapper[5120]: I0316 15:52:04.971713 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6b459d6b-d4c6-44e9-ae6f-05e060b30042-combined-ca-bundle\") pod \"6b459d6b-d4c6-44e9-ae6f-05e060b30042\" (UID: \"6b459d6b-d4c6-44e9-ae6f-05e060b30042\") " Mar 16 15:52:04 crc kubenswrapper[5120]: I0316 15:52:04.971736 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vw649\" (UniqueName: \"kubernetes.io/projected/6b459d6b-d4c6-44e9-ae6f-05e060b30042-kube-api-access-vw649\") pod \"6b459d6b-d4c6-44e9-ae6f-05e060b30042\" (UID: \"6b459d6b-d4c6-44e9-ae6f-05e060b30042\") " Mar 16 15:52:04 crc kubenswrapper[5120]: I0316 15:52:04.971809 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6b459d6b-d4c6-44e9-ae6f-05e060b30042-public-tls-certs\") pod \"6b459d6b-d4c6-44e9-ae6f-05e060b30042\" (UID: \"6b459d6b-d4c6-44e9-ae6f-05e060b30042\") " Mar 16 15:52:04 crc kubenswrapper[5120]: I0316 15:52:04.971874 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6b459d6b-d4c6-44e9-ae6f-05e060b30042-logs\") pod \"6b459d6b-d4c6-44e9-ae6f-05e060b30042\" (UID: \"6b459d6b-d4c6-44e9-ae6f-05e060b30042\") " Mar 16 15:52:04 crc kubenswrapper[5120]: I0316 15:52:04.971973 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6b459d6b-d4c6-44e9-ae6f-05e060b30042-config-data\") pod \"6b459d6b-d4c6-44e9-ae6f-05e060b30042\" (UID: \"6b459d6b-d4c6-44e9-ae6f-05e060b30042\") " Mar 16 15:52:04 crc kubenswrapper[5120]: I0316 15:52:04.972149 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6b459d6b-d4c6-44e9-ae6f-05e060b30042-internal-tls-certs\") pod \"6b459d6b-d4c6-44e9-ae6f-05e060b30042\" (UID: \"6b459d6b-d4c6-44e9-ae6f-05e060b30042\") " Mar 16 15:52:04 crc kubenswrapper[5120]: I0316 15:52:04.972380 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b459d6b-d4c6-44e9-ae6f-05e060b30042-logs" (OuterVolumeSpecName: "logs") pod "6b459d6b-d4c6-44e9-ae6f-05e060b30042" (UID: "6b459d6b-d4c6-44e9-ae6f-05e060b30042"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:52:04 crc kubenswrapper[5120]: I0316 15:52:04.972520 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6b459d6b-d4c6-44e9-ae6f-05e060b30042-logs\") on node \"crc\" DevicePath \"\"" Mar 16 15:52:04 crc kubenswrapper[5120]: I0316 15:52:04.976160 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b459d6b-d4c6-44e9-ae6f-05e060b30042-kube-api-access-vw649" (OuterVolumeSpecName: "kube-api-access-vw649") pod "6b459d6b-d4c6-44e9-ae6f-05e060b30042" (UID: "6b459d6b-d4c6-44e9-ae6f-05e060b30042"). InnerVolumeSpecName "kube-api-access-vw649". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:52:04 crc kubenswrapper[5120]: I0316 15:52:04.976264 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b459d6b-d4c6-44e9-ae6f-05e060b30042-scripts" (OuterVolumeSpecName: "scripts") pod "6b459d6b-d4c6-44e9-ae6f-05e060b30042" (UID: "6b459d6b-d4c6-44e9-ae6f-05e060b30042"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:52:05 crc kubenswrapper[5120]: I0316 15:52:05.016706 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b459d6b-d4c6-44e9-ae6f-05e060b30042-config-data" (OuterVolumeSpecName: "config-data") pod "6b459d6b-d4c6-44e9-ae6f-05e060b30042" (UID: "6b459d6b-d4c6-44e9-ae6f-05e060b30042"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:52:05 crc kubenswrapper[5120]: I0316 15:52:05.022132 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b459d6b-d4c6-44e9-ae6f-05e060b30042-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "6b459d6b-d4c6-44e9-ae6f-05e060b30042" (UID: "6b459d6b-d4c6-44e9-ae6f-05e060b30042"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:52:05 crc kubenswrapper[5120]: I0316 15:52:05.062901 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b459d6b-d4c6-44e9-ae6f-05e060b30042-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "6b459d6b-d4c6-44e9-ae6f-05e060b30042" (UID: "6b459d6b-d4c6-44e9-ae6f-05e060b30042"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:52:05 crc kubenswrapper[5120]: I0316 15:52:05.063826 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b459d6b-d4c6-44e9-ae6f-05e060b30042-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "6b459d6b-d4c6-44e9-ae6f-05e060b30042" (UID: "6b459d6b-d4c6-44e9-ae6f-05e060b30042"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:52:05 crc kubenswrapper[5120]: I0316 15:52:05.073802 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6b459d6b-d4c6-44e9-ae6f-05e060b30042-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 15:52:05 crc kubenswrapper[5120]: I0316 15:52:05.073841 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6b459d6b-d4c6-44e9-ae6f-05e060b30042-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:52:05 crc kubenswrapper[5120]: I0316 15:52:05.073854 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vw649\" (UniqueName: \"kubernetes.io/projected/6b459d6b-d4c6-44e9-ae6f-05e060b30042-kube-api-access-vw649\") on node \"crc\" DevicePath \"\"" Mar 16 15:52:05 crc kubenswrapper[5120]: I0316 15:52:05.073864 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6b459d6b-d4c6-44e9-ae6f-05e060b30042-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 15:52:05 crc kubenswrapper[5120]: I0316 15:52:05.073877 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6b459d6b-d4c6-44e9-ae6f-05e060b30042-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 15:52:05 crc kubenswrapper[5120]: I0316 15:52:05.073888 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6b459d6b-d4c6-44e9-ae6f-05e060b30042-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 15:52:05 crc kubenswrapper[5120]: I0316 15:52:05.110608 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7a77c479-1665-4fd1-a627-ff873b9aa31a","Type":"ContainerStarted","Data":"a47a3b620bff29db5774007080ba93702ac67f8132a80738091706f7cea33d35"} Mar 16 15:52:05 crc kubenswrapper[5120]: I0316 15:52:05.110735 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:52:05 crc kubenswrapper[5120]: I0316 15:52:05.110841 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="7a77c479-1665-4fd1-a627-ff873b9aa31a" containerName="proxy-httpd" containerID="cri-o://a47a3b620bff29db5774007080ba93702ac67f8132a80738091706f7cea33d35" gracePeriod=30 Mar 16 15:52:05 crc kubenswrapper[5120]: I0316 15:52:05.110864 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="7a77c479-1665-4fd1-a627-ff873b9aa31a" containerName="ceilometer-notification-agent" containerID="cri-o://6076dd6857449ba98193200ddf7279eb51cf3d641d1fa7bdf36eb1097d5c1a38" gracePeriod=30 Mar 16 15:52:05 crc kubenswrapper[5120]: I0316 15:52:05.110818 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="7a77c479-1665-4fd1-a627-ff873b9aa31a" containerName="ceilometer-central-agent" containerID="cri-o://14bc4cc1a952d84ef2ca5ceca3102744a4e0ef10b5ecc2769cef59212e7cc673" gracePeriod=30 Mar 16 15:52:05 crc kubenswrapper[5120]: I0316 15:52:05.110848 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="7a77c479-1665-4fd1-a627-ff873b9aa31a" containerName="sg-core" containerID="cri-o://18e4014eb40be43296c01c782b69d4e142e8033fdb49af0e7ea9cf6f6f5c05a4" gracePeriod=30 Mar 16 15:52:05 crc kubenswrapper[5120]: I0316 15:52:05.117605 5120 generic.go:358] "Generic (PLEG): container finished" podID="6b459d6b-d4c6-44e9-ae6f-05e060b30042" containerID="114a179baefc421d90a7e2b6fb81ce44aedfdabd5862f6335d333b6d4eedf732" exitCode=0 Mar 16 15:52:05 crc kubenswrapper[5120]: I0316 15:52:05.117932 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-5b47d59db-lz86c" Mar 16 15:52:05 crc kubenswrapper[5120]: I0316 15:52:05.118160 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-5b47d59db-lz86c" event={"ID":"6b459d6b-d4c6-44e9-ae6f-05e060b30042","Type":"ContainerDied","Data":"114a179baefc421d90a7e2b6fb81ce44aedfdabd5862f6335d333b6d4eedf732"} Mar 16 15:52:05 crc kubenswrapper[5120]: I0316 15:52:05.118229 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-5b47d59db-lz86c" event={"ID":"6b459d6b-d4c6-44e9-ae6f-05e060b30042","Type":"ContainerDied","Data":"31a3f7987d644deffbc21f34088a712eb5c19746f768b2196ef79e4b1db621a9"} Mar 16 15:52:05 crc kubenswrapper[5120]: I0316 15:52:05.118252 5120 scope.go:117] "RemoveContainer" containerID="114a179baefc421d90a7e2b6fb81ce44aedfdabd5862f6335d333b6d4eedf732" Mar 16 15:52:05 crc kubenswrapper[5120]: I0316 15:52:05.149041 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=1.9042626280000001 podStartE2EDuration="11.149016154s" podCreationTimestamp="2026-03-16 15:51:54 +0000 UTC" firstStartedPulling="2026-03-16 15:51:55.150059408 +0000 UTC m=+1217.303991065" lastFinishedPulling="2026-03-16 15:52:04.394812934 +0000 UTC m=+1226.548744591" observedRunningTime="2026-03-16 15:52:05.138858729 +0000 UTC m=+1227.292790386" watchObservedRunningTime="2026-03-16 15:52:05.149016154 +0000 UTC m=+1227.302947811" Mar 16 15:52:05 crc kubenswrapper[5120]: I0316 15:52:05.179546 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-5b47d59db-lz86c"] Mar 16 15:52:05 crc kubenswrapper[5120]: I0316 15:52:05.182278 5120 scope.go:117] "RemoveContainer" containerID="253263514b37a7de242416afffbc4f1dccc4a251618796a8cd4cfed35d4d0e2a" Mar 16 15:52:05 crc kubenswrapper[5120]: I0316 15:52:05.191572 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-5b47d59db-lz86c"] Mar 16 15:52:05 crc kubenswrapper[5120]: I0316 15:52:05.232964 5120 scope.go:117] "RemoveContainer" containerID="114a179baefc421d90a7e2b6fb81ce44aedfdabd5862f6335d333b6d4eedf732" Mar 16 15:52:05 crc kubenswrapper[5120]: E0316 15:52:05.238934 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"114a179baefc421d90a7e2b6fb81ce44aedfdabd5862f6335d333b6d4eedf732\": container with ID starting with 114a179baefc421d90a7e2b6fb81ce44aedfdabd5862f6335d333b6d4eedf732 not found: ID does not exist" containerID="114a179baefc421d90a7e2b6fb81ce44aedfdabd5862f6335d333b6d4eedf732" Mar 16 15:52:05 crc kubenswrapper[5120]: I0316 15:52:05.238966 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"114a179baefc421d90a7e2b6fb81ce44aedfdabd5862f6335d333b6d4eedf732"} err="failed to get container status \"114a179baefc421d90a7e2b6fb81ce44aedfdabd5862f6335d333b6d4eedf732\": rpc error: code = NotFound desc = could not find container \"114a179baefc421d90a7e2b6fb81ce44aedfdabd5862f6335d333b6d4eedf732\": container with ID starting with 114a179baefc421d90a7e2b6fb81ce44aedfdabd5862f6335d333b6d4eedf732 not found: ID does not exist" Mar 16 15:52:05 crc kubenswrapper[5120]: I0316 15:52:05.238986 5120 scope.go:117] "RemoveContainer" containerID="253263514b37a7de242416afffbc4f1dccc4a251618796a8cd4cfed35d4d0e2a" Mar 16 15:52:05 crc kubenswrapper[5120]: E0316 15:52:05.239389 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"253263514b37a7de242416afffbc4f1dccc4a251618796a8cd4cfed35d4d0e2a\": container with ID starting with 253263514b37a7de242416afffbc4f1dccc4a251618796a8cd4cfed35d4d0e2a not found: ID does not exist" containerID="253263514b37a7de242416afffbc4f1dccc4a251618796a8cd4cfed35d4d0e2a" Mar 16 15:52:05 crc kubenswrapper[5120]: I0316 15:52:05.239416 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"253263514b37a7de242416afffbc4f1dccc4a251618796a8cd4cfed35d4d0e2a"} err="failed to get container status \"253263514b37a7de242416afffbc4f1dccc4a251618796a8cd4cfed35d4d0e2a\": rpc error: code = NotFound desc = could not find container \"253263514b37a7de242416afffbc4f1dccc4a251618796a8cd4cfed35d4d0e2a\": container with ID starting with 253263514b37a7de242416afffbc4f1dccc4a251618796a8cd4cfed35d4d0e2a not found: ID does not exist" Mar 16 15:52:05 crc kubenswrapper[5120]: I0316 15:52:05.401787 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561272-5tsq4" Mar 16 15:52:05 crc kubenswrapper[5120]: I0316 15:52:05.480107 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wq2fc\" (UniqueName: \"kubernetes.io/projected/0edbd946-b6a5-446e-a5b7-c950d16a98f1-kube-api-access-wq2fc\") pod \"0edbd946-b6a5-446e-a5b7-c950d16a98f1\" (UID: \"0edbd946-b6a5-446e-a5b7-c950d16a98f1\") " Mar 16 15:52:05 crc kubenswrapper[5120]: I0316 15:52:05.486529 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0edbd946-b6a5-446e-a5b7-c950d16a98f1-kube-api-access-wq2fc" (OuterVolumeSpecName: "kube-api-access-wq2fc") pod "0edbd946-b6a5-446e-a5b7-c950d16a98f1" (UID: "0edbd946-b6a5-446e-a5b7-c950d16a98f1"). InnerVolumeSpecName "kube-api-access-wq2fc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:52:05 crc kubenswrapper[5120]: I0316 15:52:05.582043 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wq2fc\" (UniqueName: \"kubernetes.io/projected/0edbd946-b6a5-446e-a5b7-c950d16a98f1-kube-api-access-wq2fc\") on node \"crc\" DevicePath \"\"" Mar 16 15:52:05 crc kubenswrapper[5120]: I0316 15:52:05.837079 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:52:05 crc kubenswrapper[5120]: I0316 15:52:05.887206 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/7a77c479-1665-4fd1-a627-ff873b9aa31a-sg-core-conf-yaml\") pod \"7a77c479-1665-4fd1-a627-ff873b9aa31a\" (UID: \"7a77c479-1665-4fd1-a627-ff873b9aa31a\") " Mar 16 15:52:05 crc kubenswrapper[5120]: I0316 15:52:05.887267 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dz6m4\" (UniqueName: \"kubernetes.io/projected/7a77c479-1665-4fd1-a627-ff873b9aa31a-kube-api-access-dz6m4\") pod \"7a77c479-1665-4fd1-a627-ff873b9aa31a\" (UID: \"7a77c479-1665-4fd1-a627-ff873b9aa31a\") " Mar 16 15:52:05 crc kubenswrapper[5120]: I0316 15:52:05.887314 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7a77c479-1665-4fd1-a627-ff873b9aa31a-scripts\") pod \"7a77c479-1665-4fd1-a627-ff873b9aa31a\" (UID: \"7a77c479-1665-4fd1-a627-ff873b9aa31a\") " Mar 16 15:52:05 crc kubenswrapper[5120]: I0316 15:52:05.887342 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7a77c479-1665-4fd1-a627-ff873b9aa31a-log-httpd\") pod \"7a77c479-1665-4fd1-a627-ff873b9aa31a\" (UID: \"7a77c479-1665-4fd1-a627-ff873b9aa31a\") " Mar 16 15:52:05 crc kubenswrapper[5120]: I0316 15:52:05.887433 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7a77c479-1665-4fd1-a627-ff873b9aa31a-config-data\") pod \"7a77c479-1665-4fd1-a627-ff873b9aa31a\" (UID: \"7a77c479-1665-4fd1-a627-ff873b9aa31a\") " Mar 16 15:52:05 crc kubenswrapper[5120]: I0316 15:52:05.887526 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7a77c479-1665-4fd1-a627-ff873b9aa31a-combined-ca-bundle\") pod \"7a77c479-1665-4fd1-a627-ff873b9aa31a\" (UID: \"7a77c479-1665-4fd1-a627-ff873b9aa31a\") " Mar 16 15:52:05 crc kubenswrapper[5120]: I0316 15:52:05.887561 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7a77c479-1665-4fd1-a627-ff873b9aa31a-run-httpd\") pod \"7a77c479-1665-4fd1-a627-ff873b9aa31a\" (UID: \"7a77c479-1665-4fd1-a627-ff873b9aa31a\") " Mar 16 15:52:05 crc kubenswrapper[5120]: I0316 15:52:05.888016 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a77c479-1665-4fd1-a627-ff873b9aa31a-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "7a77c479-1665-4fd1-a627-ff873b9aa31a" (UID: "7a77c479-1665-4fd1-a627-ff873b9aa31a"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:52:05 crc kubenswrapper[5120]: I0316 15:52:05.888252 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a77c479-1665-4fd1-a627-ff873b9aa31a-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "7a77c479-1665-4fd1-a627-ff873b9aa31a" (UID: "7a77c479-1665-4fd1-a627-ff873b9aa31a"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:52:05 crc kubenswrapper[5120]: I0316 15:52:05.897937 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a77c479-1665-4fd1-a627-ff873b9aa31a-kube-api-access-dz6m4" (OuterVolumeSpecName: "kube-api-access-dz6m4") pod "7a77c479-1665-4fd1-a627-ff873b9aa31a" (UID: "7a77c479-1665-4fd1-a627-ff873b9aa31a"). InnerVolumeSpecName "kube-api-access-dz6m4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:52:05 crc kubenswrapper[5120]: I0316 15:52:05.897953 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7a77c479-1665-4fd1-a627-ff873b9aa31a-scripts" (OuterVolumeSpecName: "scripts") pod "7a77c479-1665-4fd1-a627-ff873b9aa31a" (UID: "7a77c479-1665-4fd1-a627-ff873b9aa31a"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:52:05 crc kubenswrapper[5120]: I0316 15:52:05.929228 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7a77c479-1665-4fd1-a627-ff873b9aa31a-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "7a77c479-1665-4fd1-a627-ff873b9aa31a" (UID: "7a77c479-1665-4fd1-a627-ff873b9aa31a"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:52:05 crc kubenswrapper[5120]: I0316 15:52:05.960069 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7a77c479-1665-4fd1-a627-ff873b9aa31a-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "7a77c479-1665-4fd1-a627-ff873b9aa31a" (UID: "7a77c479-1665-4fd1-a627-ff873b9aa31a"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:52:05 crc kubenswrapper[5120]: I0316 15:52:05.982741 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7a77c479-1665-4fd1-a627-ff873b9aa31a-config-data" (OuterVolumeSpecName: "config-data") pod "7a77c479-1665-4fd1-a627-ff873b9aa31a" (UID: "7a77c479-1665-4fd1-a627-ff873b9aa31a"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:52:05 crc kubenswrapper[5120]: I0316 15:52:05.989801 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7a77c479-1665-4fd1-a627-ff873b9aa31a-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 15:52:05 crc kubenswrapper[5120]: I0316 15:52:05.989832 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7a77c479-1665-4fd1-a627-ff873b9aa31a-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:52:05 crc kubenswrapper[5120]: I0316 15:52:05.989843 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7a77c479-1665-4fd1-a627-ff873b9aa31a-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 15:52:05 crc kubenswrapper[5120]: I0316 15:52:05.989850 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/7a77c479-1665-4fd1-a627-ff873b9aa31a-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 15:52:05 crc kubenswrapper[5120]: I0316 15:52:05.989858 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dz6m4\" (UniqueName: \"kubernetes.io/projected/7a77c479-1665-4fd1-a627-ff873b9aa31a-kube-api-access-dz6m4\") on node \"crc\" DevicePath \"\"" Mar 16 15:52:05 crc kubenswrapper[5120]: I0316 15:52:05.989867 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7a77c479-1665-4fd1-a627-ff873b9aa31a-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 15:52:05 crc kubenswrapper[5120]: I0316 15:52:05.989875 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7a77c479-1665-4fd1-a627-ff873b9aa31a-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 15:52:06 crc kubenswrapper[5120]: I0316 15:52:06.127880 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561272-5tsq4" event={"ID":"0edbd946-b6a5-446e-a5b7-c950d16a98f1","Type":"ContainerDied","Data":"fdb8a55998eae58fc2747c6b879af2ebbfeff39f6fd5f7d76b790121a330a135"} Mar 16 15:52:06 crc kubenswrapper[5120]: I0316 15:52:06.127938 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fdb8a55998eae58fc2747c6b879af2ebbfeff39f6fd5f7d76b790121a330a135" Mar 16 15:52:06 crc kubenswrapper[5120]: I0316 15:52:06.127895 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561272-5tsq4" Mar 16 15:52:06 crc kubenswrapper[5120]: I0316 15:52:06.130967 5120 generic.go:358] "Generic (PLEG): container finished" podID="7a77c479-1665-4fd1-a627-ff873b9aa31a" containerID="a47a3b620bff29db5774007080ba93702ac67f8132a80738091706f7cea33d35" exitCode=0 Mar 16 15:52:06 crc kubenswrapper[5120]: I0316 15:52:06.130989 5120 generic.go:358] "Generic (PLEG): container finished" podID="7a77c479-1665-4fd1-a627-ff873b9aa31a" containerID="18e4014eb40be43296c01c782b69d4e142e8033fdb49af0e7ea9cf6f6f5c05a4" exitCode=2 Mar 16 15:52:06 crc kubenswrapper[5120]: I0316 15:52:06.130995 5120 generic.go:358] "Generic (PLEG): container finished" podID="7a77c479-1665-4fd1-a627-ff873b9aa31a" containerID="6076dd6857449ba98193200ddf7279eb51cf3d641d1fa7bdf36eb1097d5c1a38" exitCode=0 Mar 16 15:52:06 crc kubenswrapper[5120]: I0316 15:52:06.131000 5120 generic.go:358] "Generic (PLEG): container finished" podID="7a77c479-1665-4fd1-a627-ff873b9aa31a" containerID="14bc4cc1a952d84ef2ca5ceca3102744a4e0ef10b5ecc2769cef59212e7cc673" exitCode=0 Mar 16 15:52:06 crc kubenswrapper[5120]: I0316 15:52:06.131112 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7a77c479-1665-4fd1-a627-ff873b9aa31a","Type":"ContainerDied","Data":"a47a3b620bff29db5774007080ba93702ac67f8132a80738091706f7cea33d35"} Mar 16 15:52:06 crc kubenswrapper[5120]: I0316 15:52:06.131136 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7a77c479-1665-4fd1-a627-ff873b9aa31a","Type":"ContainerDied","Data":"18e4014eb40be43296c01c782b69d4e142e8033fdb49af0e7ea9cf6f6f5c05a4"} Mar 16 15:52:06 crc kubenswrapper[5120]: I0316 15:52:06.131148 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7a77c479-1665-4fd1-a627-ff873b9aa31a","Type":"ContainerDied","Data":"6076dd6857449ba98193200ddf7279eb51cf3d641d1fa7bdf36eb1097d5c1a38"} Mar 16 15:52:06 crc kubenswrapper[5120]: I0316 15:52:06.131157 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7a77c479-1665-4fd1-a627-ff873b9aa31a","Type":"ContainerDied","Data":"14bc4cc1a952d84ef2ca5ceca3102744a4e0ef10b5ecc2769cef59212e7cc673"} Mar 16 15:52:06 crc kubenswrapper[5120]: I0316 15:52:06.131165 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7a77c479-1665-4fd1-a627-ff873b9aa31a","Type":"ContainerDied","Data":"4e4bd923e7106bf64e1c6fa08cd044d90759a331a71089ca70f54898f3609562"} Mar 16 15:52:06 crc kubenswrapper[5120]: I0316 15:52:06.131180 5120 scope.go:117] "RemoveContainer" containerID="a47a3b620bff29db5774007080ba93702ac67f8132a80738091706f7cea33d35" Mar 16 15:52:06 crc kubenswrapper[5120]: I0316 15:52:06.131288 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:52:06 crc kubenswrapper[5120]: I0316 15:52:06.162374 5120 scope.go:117] "RemoveContainer" containerID="18e4014eb40be43296c01c782b69d4e142e8033fdb49af0e7ea9cf6f6f5c05a4" Mar 16 15:52:06 crc kubenswrapper[5120]: I0316 15:52:06.171560 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 15:52:06 crc kubenswrapper[5120]: I0316 15:52:06.183524 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 15:52:06 crc kubenswrapper[5120]: I0316 15:52:06.193813 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 15:52:06 crc kubenswrapper[5120]: I0316 15:52:06.194752 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a77c479-1665-4fd1-a627-ff873b9aa31a" containerName="proxy-httpd" Mar 16 15:52:06 crc kubenswrapper[5120]: I0316 15:52:06.194784 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a77c479-1665-4fd1-a627-ff873b9aa31a" containerName="proxy-httpd" Mar 16 15:52:06 crc kubenswrapper[5120]: I0316 15:52:06.194802 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b459d6b-d4c6-44e9-ae6f-05e060b30042" containerName="placement-api" Mar 16 15:52:06 crc kubenswrapper[5120]: I0316 15:52:06.194809 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b459d6b-d4c6-44e9-ae6f-05e060b30042" containerName="placement-api" Mar 16 15:52:06 crc kubenswrapper[5120]: I0316 15:52:06.194821 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a77c479-1665-4fd1-a627-ff873b9aa31a" containerName="ceilometer-notification-agent" Mar 16 15:52:06 crc kubenswrapper[5120]: I0316 15:52:06.194827 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a77c479-1665-4fd1-a627-ff873b9aa31a" containerName="ceilometer-notification-agent" Mar 16 15:52:06 crc kubenswrapper[5120]: I0316 15:52:06.194842 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37731388-5538-4f93-90a7-8a8ffe5abcd7" containerName="neutron-api" Mar 16 15:52:06 crc kubenswrapper[5120]: I0316 15:52:06.194851 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="37731388-5538-4f93-90a7-8a8ffe5abcd7" containerName="neutron-api" Mar 16 15:52:06 crc kubenswrapper[5120]: I0316 15:52:06.194866 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a77c479-1665-4fd1-a627-ff873b9aa31a" containerName="sg-core" Mar 16 15:52:06 crc kubenswrapper[5120]: I0316 15:52:06.194871 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a77c479-1665-4fd1-a627-ff873b9aa31a" containerName="sg-core" Mar 16 15:52:06 crc kubenswrapper[5120]: I0316 15:52:06.194880 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0edbd946-b6a5-446e-a5b7-c950d16a98f1" containerName="oc" Mar 16 15:52:06 crc kubenswrapper[5120]: I0316 15:52:06.194887 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="0edbd946-b6a5-446e-a5b7-c950d16a98f1" containerName="oc" Mar 16 15:52:06 crc kubenswrapper[5120]: I0316 15:52:06.194905 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37731388-5538-4f93-90a7-8a8ffe5abcd7" containerName="neutron-httpd" Mar 16 15:52:06 crc kubenswrapper[5120]: I0316 15:52:06.194910 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="37731388-5538-4f93-90a7-8a8ffe5abcd7" containerName="neutron-httpd" Mar 16 15:52:06 crc kubenswrapper[5120]: I0316 15:52:06.194922 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b459d6b-d4c6-44e9-ae6f-05e060b30042" containerName="placement-log" Mar 16 15:52:06 crc kubenswrapper[5120]: I0316 15:52:06.194927 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b459d6b-d4c6-44e9-ae6f-05e060b30042" containerName="placement-log" Mar 16 15:52:06 crc kubenswrapper[5120]: I0316 15:52:06.194949 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a77c479-1665-4fd1-a627-ff873b9aa31a" containerName="ceilometer-central-agent" Mar 16 15:52:06 crc kubenswrapper[5120]: I0316 15:52:06.194954 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a77c479-1665-4fd1-a627-ff873b9aa31a" containerName="ceilometer-central-agent" Mar 16 15:52:06 crc kubenswrapper[5120]: I0316 15:52:06.195129 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="37731388-5538-4f93-90a7-8a8ffe5abcd7" containerName="neutron-api" Mar 16 15:52:06 crc kubenswrapper[5120]: I0316 15:52:06.195145 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="37731388-5538-4f93-90a7-8a8ffe5abcd7" containerName="neutron-httpd" Mar 16 15:52:06 crc kubenswrapper[5120]: I0316 15:52:06.195152 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7a77c479-1665-4fd1-a627-ff873b9aa31a" containerName="sg-core" Mar 16 15:52:06 crc kubenswrapper[5120]: I0316 15:52:06.195162 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7a77c479-1665-4fd1-a627-ff873b9aa31a" containerName="proxy-httpd" Mar 16 15:52:06 crc kubenswrapper[5120]: I0316 15:52:06.195173 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="6b459d6b-d4c6-44e9-ae6f-05e060b30042" containerName="placement-api" Mar 16 15:52:06 crc kubenswrapper[5120]: I0316 15:52:06.195181 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7a77c479-1665-4fd1-a627-ff873b9aa31a" containerName="ceilometer-notification-agent" Mar 16 15:52:06 crc kubenswrapper[5120]: I0316 15:52:06.195188 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="0edbd946-b6a5-446e-a5b7-c950d16a98f1" containerName="oc" Mar 16 15:52:06 crc kubenswrapper[5120]: I0316 15:52:06.195195 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7a77c479-1665-4fd1-a627-ff873b9aa31a" containerName="ceilometer-central-agent" Mar 16 15:52:06 crc kubenswrapper[5120]: I0316 15:52:06.195203 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="6b459d6b-d4c6-44e9-ae6f-05e060b30042" containerName="placement-log" Mar 16 15:52:06 crc kubenswrapper[5120]: I0316 15:52:06.203734 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:52:06 crc kubenswrapper[5120]: I0316 15:52:06.206510 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 15:52:06 crc kubenswrapper[5120]: I0316 15:52:06.208140 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 15:52:06 crc kubenswrapper[5120]: I0316 15:52:06.211586 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 15:52:06 crc kubenswrapper[5120]: I0316 15:52:06.212793 5120 scope.go:117] "RemoveContainer" containerID="6076dd6857449ba98193200ddf7279eb51cf3d641d1fa7bdf36eb1097d5c1a38" Mar 16 15:52:06 crc kubenswrapper[5120]: I0316 15:52:06.247085 5120 scope.go:117] "RemoveContainer" containerID="14bc4cc1a952d84ef2ca5ceca3102744a4e0ef10b5ecc2769cef59212e7cc673" Mar 16 15:52:06 crc kubenswrapper[5120]: I0316 15:52:06.268036 5120 scope.go:117] "RemoveContainer" containerID="a47a3b620bff29db5774007080ba93702ac67f8132a80738091706f7cea33d35" Mar 16 15:52:06 crc kubenswrapper[5120]: E0316 15:52:06.268425 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a47a3b620bff29db5774007080ba93702ac67f8132a80738091706f7cea33d35\": container with ID starting with a47a3b620bff29db5774007080ba93702ac67f8132a80738091706f7cea33d35 not found: ID does not exist" containerID="a47a3b620bff29db5774007080ba93702ac67f8132a80738091706f7cea33d35" Mar 16 15:52:06 crc kubenswrapper[5120]: I0316 15:52:06.268471 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a47a3b620bff29db5774007080ba93702ac67f8132a80738091706f7cea33d35"} err="failed to get container status \"a47a3b620bff29db5774007080ba93702ac67f8132a80738091706f7cea33d35\": rpc error: code = NotFound desc = could not find container \"a47a3b620bff29db5774007080ba93702ac67f8132a80738091706f7cea33d35\": container with ID starting with a47a3b620bff29db5774007080ba93702ac67f8132a80738091706f7cea33d35 not found: ID does not exist" Mar 16 15:52:06 crc kubenswrapper[5120]: I0316 15:52:06.268502 5120 scope.go:117] "RemoveContainer" containerID="18e4014eb40be43296c01c782b69d4e142e8033fdb49af0e7ea9cf6f6f5c05a4" Mar 16 15:52:06 crc kubenswrapper[5120]: E0316 15:52:06.268814 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"18e4014eb40be43296c01c782b69d4e142e8033fdb49af0e7ea9cf6f6f5c05a4\": container with ID starting with 18e4014eb40be43296c01c782b69d4e142e8033fdb49af0e7ea9cf6f6f5c05a4 not found: ID does not exist" containerID="18e4014eb40be43296c01c782b69d4e142e8033fdb49af0e7ea9cf6f6f5c05a4" Mar 16 15:52:06 crc kubenswrapper[5120]: I0316 15:52:06.268982 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18e4014eb40be43296c01c782b69d4e142e8033fdb49af0e7ea9cf6f6f5c05a4"} err="failed to get container status \"18e4014eb40be43296c01c782b69d4e142e8033fdb49af0e7ea9cf6f6f5c05a4\": rpc error: code = NotFound desc = could not find container \"18e4014eb40be43296c01c782b69d4e142e8033fdb49af0e7ea9cf6f6f5c05a4\": container with ID starting with 18e4014eb40be43296c01c782b69d4e142e8033fdb49af0e7ea9cf6f6f5c05a4 not found: ID does not exist" Mar 16 15:52:06 crc kubenswrapper[5120]: I0316 15:52:06.269108 5120 scope.go:117] "RemoveContainer" containerID="6076dd6857449ba98193200ddf7279eb51cf3d641d1fa7bdf36eb1097d5c1a38" Mar 16 15:52:06 crc kubenswrapper[5120]: E0316 15:52:06.269405 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6076dd6857449ba98193200ddf7279eb51cf3d641d1fa7bdf36eb1097d5c1a38\": container with ID starting with 6076dd6857449ba98193200ddf7279eb51cf3d641d1fa7bdf36eb1097d5c1a38 not found: ID does not exist" containerID="6076dd6857449ba98193200ddf7279eb51cf3d641d1fa7bdf36eb1097d5c1a38" Mar 16 15:52:06 crc kubenswrapper[5120]: I0316 15:52:06.269444 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6076dd6857449ba98193200ddf7279eb51cf3d641d1fa7bdf36eb1097d5c1a38"} err="failed to get container status \"6076dd6857449ba98193200ddf7279eb51cf3d641d1fa7bdf36eb1097d5c1a38\": rpc error: code = NotFound desc = could not find container \"6076dd6857449ba98193200ddf7279eb51cf3d641d1fa7bdf36eb1097d5c1a38\": container with ID starting with 6076dd6857449ba98193200ddf7279eb51cf3d641d1fa7bdf36eb1097d5c1a38 not found: ID does not exist" Mar 16 15:52:06 crc kubenswrapper[5120]: I0316 15:52:06.269468 5120 scope.go:117] "RemoveContainer" containerID="14bc4cc1a952d84ef2ca5ceca3102744a4e0ef10b5ecc2769cef59212e7cc673" Mar 16 15:52:06 crc kubenswrapper[5120]: E0316 15:52:06.269815 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"14bc4cc1a952d84ef2ca5ceca3102744a4e0ef10b5ecc2769cef59212e7cc673\": container with ID starting with 14bc4cc1a952d84ef2ca5ceca3102744a4e0ef10b5ecc2769cef59212e7cc673 not found: ID does not exist" containerID="14bc4cc1a952d84ef2ca5ceca3102744a4e0ef10b5ecc2769cef59212e7cc673" Mar 16 15:52:06 crc kubenswrapper[5120]: I0316 15:52:06.269837 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14bc4cc1a952d84ef2ca5ceca3102744a4e0ef10b5ecc2769cef59212e7cc673"} err="failed to get container status \"14bc4cc1a952d84ef2ca5ceca3102744a4e0ef10b5ecc2769cef59212e7cc673\": rpc error: code = NotFound desc = could not find container \"14bc4cc1a952d84ef2ca5ceca3102744a4e0ef10b5ecc2769cef59212e7cc673\": container with ID starting with 14bc4cc1a952d84ef2ca5ceca3102744a4e0ef10b5ecc2769cef59212e7cc673 not found: ID does not exist" Mar 16 15:52:06 crc kubenswrapper[5120]: I0316 15:52:06.269852 5120 scope.go:117] "RemoveContainer" containerID="a47a3b620bff29db5774007080ba93702ac67f8132a80738091706f7cea33d35" Mar 16 15:52:06 crc kubenswrapper[5120]: I0316 15:52:06.270133 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a47a3b620bff29db5774007080ba93702ac67f8132a80738091706f7cea33d35"} err="failed to get container status \"a47a3b620bff29db5774007080ba93702ac67f8132a80738091706f7cea33d35\": rpc error: code = NotFound desc = could not find container \"a47a3b620bff29db5774007080ba93702ac67f8132a80738091706f7cea33d35\": container with ID starting with a47a3b620bff29db5774007080ba93702ac67f8132a80738091706f7cea33d35 not found: ID does not exist" Mar 16 15:52:06 crc kubenswrapper[5120]: I0316 15:52:06.270264 5120 scope.go:117] "RemoveContainer" containerID="18e4014eb40be43296c01c782b69d4e142e8033fdb49af0e7ea9cf6f6f5c05a4" Mar 16 15:52:06 crc kubenswrapper[5120]: I0316 15:52:06.270628 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18e4014eb40be43296c01c782b69d4e142e8033fdb49af0e7ea9cf6f6f5c05a4"} err="failed to get container status \"18e4014eb40be43296c01c782b69d4e142e8033fdb49af0e7ea9cf6f6f5c05a4\": rpc error: code = NotFound desc = could not find container \"18e4014eb40be43296c01c782b69d4e142e8033fdb49af0e7ea9cf6f6f5c05a4\": container with ID starting with 18e4014eb40be43296c01c782b69d4e142e8033fdb49af0e7ea9cf6f6f5c05a4 not found: ID does not exist" Mar 16 15:52:06 crc kubenswrapper[5120]: I0316 15:52:06.270746 5120 scope.go:117] "RemoveContainer" containerID="6076dd6857449ba98193200ddf7279eb51cf3d641d1fa7bdf36eb1097d5c1a38" Mar 16 15:52:06 crc kubenswrapper[5120]: I0316 15:52:06.271193 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6076dd6857449ba98193200ddf7279eb51cf3d641d1fa7bdf36eb1097d5c1a38"} err="failed to get container status \"6076dd6857449ba98193200ddf7279eb51cf3d641d1fa7bdf36eb1097d5c1a38\": rpc error: code = NotFound desc = could not find container \"6076dd6857449ba98193200ddf7279eb51cf3d641d1fa7bdf36eb1097d5c1a38\": container with ID starting with 6076dd6857449ba98193200ddf7279eb51cf3d641d1fa7bdf36eb1097d5c1a38 not found: ID does not exist" Mar 16 15:52:06 crc kubenswrapper[5120]: I0316 15:52:06.271312 5120 scope.go:117] "RemoveContainer" containerID="14bc4cc1a952d84ef2ca5ceca3102744a4e0ef10b5ecc2769cef59212e7cc673" Mar 16 15:52:06 crc kubenswrapper[5120]: I0316 15:52:06.271614 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14bc4cc1a952d84ef2ca5ceca3102744a4e0ef10b5ecc2769cef59212e7cc673"} err="failed to get container status \"14bc4cc1a952d84ef2ca5ceca3102744a4e0ef10b5ecc2769cef59212e7cc673\": rpc error: code = NotFound desc = could not find container \"14bc4cc1a952d84ef2ca5ceca3102744a4e0ef10b5ecc2769cef59212e7cc673\": container with ID starting with 14bc4cc1a952d84ef2ca5ceca3102744a4e0ef10b5ecc2769cef59212e7cc673 not found: ID does not exist" Mar 16 15:52:06 crc kubenswrapper[5120]: I0316 15:52:06.271635 5120 scope.go:117] "RemoveContainer" containerID="a47a3b620bff29db5774007080ba93702ac67f8132a80738091706f7cea33d35" Mar 16 15:52:06 crc kubenswrapper[5120]: I0316 15:52:06.274265 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a47a3b620bff29db5774007080ba93702ac67f8132a80738091706f7cea33d35"} err="failed to get container status \"a47a3b620bff29db5774007080ba93702ac67f8132a80738091706f7cea33d35\": rpc error: code = NotFound desc = could not find container \"a47a3b620bff29db5774007080ba93702ac67f8132a80738091706f7cea33d35\": container with ID starting with a47a3b620bff29db5774007080ba93702ac67f8132a80738091706f7cea33d35 not found: ID does not exist" Mar 16 15:52:06 crc kubenswrapper[5120]: I0316 15:52:06.274300 5120 scope.go:117] "RemoveContainer" containerID="18e4014eb40be43296c01c782b69d4e142e8033fdb49af0e7ea9cf6f6f5c05a4" Mar 16 15:52:06 crc kubenswrapper[5120]: I0316 15:52:06.274731 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18e4014eb40be43296c01c782b69d4e142e8033fdb49af0e7ea9cf6f6f5c05a4"} err="failed to get container status \"18e4014eb40be43296c01c782b69d4e142e8033fdb49af0e7ea9cf6f6f5c05a4\": rpc error: code = NotFound desc = could not find container \"18e4014eb40be43296c01c782b69d4e142e8033fdb49af0e7ea9cf6f6f5c05a4\": container with ID starting with 18e4014eb40be43296c01c782b69d4e142e8033fdb49af0e7ea9cf6f6f5c05a4 not found: ID does not exist" Mar 16 15:52:06 crc kubenswrapper[5120]: I0316 15:52:06.274784 5120 scope.go:117] "RemoveContainer" containerID="6076dd6857449ba98193200ddf7279eb51cf3d641d1fa7bdf36eb1097d5c1a38" Mar 16 15:52:06 crc kubenswrapper[5120]: I0316 15:52:06.275054 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6076dd6857449ba98193200ddf7279eb51cf3d641d1fa7bdf36eb1097d5c1a38"} err="failed to get container status \"6076dd6857449ba98193200ddf7279eb51cf3d641d1fa7bdf36eb1097d5c1a38\": rpc error: code = NotFound desc = could not find container \"6076dd6857449ba98193200ddf7279eb51cf3d641d1fa7bdf36eb1097d5c1a38\": container with ID starting with 6076dd6857449ba98193200ddf7279eb51cf3d641d1fa7bdf36eb1097d5c1a38 not found: ID does not exist" Mar 16 15:52:06 crc kubenswrapper[5120]: I0316 15:52:06.275204 5120 scope.go:117] "RemoveContainer" containerID="14bc4cc1a952d84ef2ca5ceca3102744a4e0ef10b5ecc2769cef59212e7cc673" Mar 16 15:52:06 crc kubenswrapper[5120]: I0316 15:52:06.275556 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14bc4cc1a952d84ef2ca5ceca3102744a4e0ef10b5ecc2769cef59212e7cc673"} err="failed to get container status \"14bc4cc1a952d84ef2ca5ceca3102744a4e0ef10b5ecc2769cef59212e7cc673\": rpc error: code = NotFound desc = could not find container \"14bc4cc1a952d84ef2ca5ceca3102744a4e0ef10b5ecc2769cef59212e7cc673\": container with ID starting with 14bc4cc1a952d84ef2ca5ceca3102744a4e0ef10b5ecc2769cef59212e7cc673 not found: ID does not exist" Mar 16 15:52:06 crc kubenswrapper[5120]: I0316 15:52:06.275590 5120 scope.go:117] "RemoveContainer" containerID="a47a3b620bff29db5774007080ba93702ac67f8132a80738091706f7cea33d35" Mar 16 15:52:06 crc kubenswrapper[5120]: I0316 15:52:06.275874 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a47a3b620bff29db5774007080ba93702ac67f8132a80738091706f7cea33d35"} err="failed to get container status \"a47a3b620bff29db5774007080ba93702ac67f8132a80738091706f7cea33d35\": rpc error: code = NotFound desc = could not find container \"a47a3b620bff29db5774007080ba93702ac67f8132a80738091706f7cea33d35\": container with ID starting with a47a3b620bff29db5774007080ba93702ac67f8132a80738091706f7cea33d35 not found: ID does not exist" Mar 16 15:52:06 crc kubenswrapper[5120]: I0316 15:52:06.276020 5120 scope.go:117] "RemoveContainer" containerID="18e4014eb40be43296c01c782b69d4e142e8033fdb49af0e7ea9cf6f6f5c05a4" Mar 16 15:52:06 crc kubenswrapper[5120]: I0316 15:52:06.276378 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18e4014eb40be43296c01c782b69d4e142e8033fdb49af0e7ea9cf6f6f5c05a4"} err="failed to get container status \"18e4014eb40be43296c01c782b69d4e142e8033fdb49af0e7ea9cf6f6f5c05a4\": rpc error: code = NotFound desc = could not find container \"18e4014eb40be43296c01c782b69d4e142e8033fdb49af0e7ea9cf6f6f5c05a4\": container with ID starting with 18e4014eb40be43296c01c782b69d4e142e8033fdb49af0e7ea9cf6f6f5c05a4 not found: ID does not exist" Mar 16 15:52:06 crc kubenswrapper[5120]: I0316 15:52:06.276412 5120 scope.go:117] "RemoveContainer" containerID="6076dd6857449ba98193200ddf7279eb51cf3d641d1fa7bdf36eb1097d5c1a38" Mar 16 15:52:06 crc kubenswrapper[5120]: I0316 15:52:06.276664 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6076dd6857449ba98193200ddf7279eb51cf3d641d1fa7bdf36eb1097d5c1a38"} err="failed to get container status \"6076dd6857449ba98193200ddf7279eb51cf3d641d1fa7bdf36eb1097d5c1a38\": rpc error: code = NotFound desc = could not find container \"6076dd6857449ba98193200ddf7279eb51cf3d641d1fa7bdf36eb1097d5c1a38\": container with ID starting with 6076dd6857449ba98193200ddf7279eb51cf3d641d1fa7bdf36eb1097d5c1a38 not found: ID does not exist" Mar 16 15:52:06 crc kubenswrapper[5120]: I0316 15:52:06.276828 5120 scope.go:117] "RemoveContainer" containerID="14bc4cc1a952d84ef2ca5ceca3102744a4e0ef10b5ecc2769cef59212e7cc673" Mar 16 15:52:06 crc kubenswrapper[5120]: I0316 15:52:06.277272 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14bc4cc1a952d84ef2ca5ceca3102744a4e0ef10b5ecc2769cef59212e7cc673"} err="failed to get container status \"14bc4cc1a952d84ef2ca5ceca3102744a4e0ef10b5ecc2769cef59212e7cc673\": rpc error: code = NotFound desc = could not find container \"14bc4cc1a952d84ef2ca5ceca3102744a4e0ef10b5ecc2769cef59212e7cc673\": container with ID starting with 14bc4cc1a952d84ef2ca5ceca3102744a4e0ef10b5ecc2769cef59212e7cc673 not found: ID does not exist" Mar 16 15:52:06 crc kubenswrapper[5120]: I0316 15:52:06.294913 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/576e3e02-2c64-423f-8a3e-7cde05b41557-config-data\") pod \"ceilometer-0\" (UID: \"576e3e02-2c64-423f-8a3e-7cde05b41557\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:52:06 crc kubenswrapper[5120]: I0316 15:52:06.295008 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/576e3e02-2c64-423f-8a3e-7cde05b41557-scripts\") pod \"ceilometer-0\" (UID: \"576e3e02-2c64-423f-8a3e-7cde05b41557\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:52:06 crc kubenswrapper[5120]: I0316 15:52:06.295068 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/576e3e02-2c64-423f-8a3e-7cde05b41557-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"576e3e02-2c64-423f-8a3e-7cde05b41557\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:52:06 crc kubenswrapper[5120]: I0316 15:52:06.295114 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nb2j4\" (UniqueName: \"kubernetes.io/projected/576e3e02-2c64-423f-8a3e-7cde05b41557-kube-api-access-nb2j4\") pod \"ceilometer-0\" (UID: \"576e3e02-2c64-423f-8a3e-7cde05b41557\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:52:06 crc kubenswrapper[5120]: I0316 15:52:06.295157 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/576e3e02-2c64-423f-8a3e-7cde05b41557-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"576e3e02-2c64-423f-8a3e-7cde05b41557\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:52:06 crc kubenswrapper[5120]: I0316 15:52:06.295235 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/576e3e02-2c64-423f-8a3e-7cde05b41557-log-httpd\") pod \"ceilometer-0\" (UID: \"576e3e02-2c64-423f-8a3e-7cde05b41557\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:52:06 crc kubenswrapper[5120]: I0316 15:52:06.295299 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/576e3e02-2c64-423f-8a3e-7cde05b41557-run-httpd\") pod \"ceilometer-0\" (UID: \"576e3e02-2c64-423f-8a3e-7cde05b41557\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:52:06 crc kubenswrapper[5120]: I0316 15:52:06.397104 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/576e3e02-2c64-423f-8a3e-7cde05b41557-config-data\") pod \"ceilometer-0\" (UID: \"576e3e02-2c64-423f-8a3e-7cde05b41557\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:52:06 crc kubenswrapper[5120]: I0316 15:52:06.397231 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/576e3e02-2c64-423f-8a3e-7cde05b41557-scripts\") pod \"ceilometer-0\" (UID: \"576e3e02-2c64-423f-8a3e-7cde05b41557\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:52:06 crc kubenswrapper[5120]: I0316 15:52:06.397295 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/576e3e02-2c64-423f-8a3e-7cde05b41557-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"576e3e02-2c64-423f-8a3e-7cde05b41557\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:52:06 crc kubenswrapper[5120]: I0316 15:52:06.397341 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nb2j4\" (UniqueName: \"kubernetes.io/projected/576e3e02-2c64-423f-8a3e-7cde05b41557-kube-api-access-nb2j4\") pod \"ceilometer-0\" (UID: \"576e3e02-2c64-423f-8a3e-7cde05b41557\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:52:06 crc kubenswrapper[5120]: I0316 15:52:06.397590 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/576e3e02-2c64-423f-8a3e-7cde05b41557-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"576e3e02-2c64-423f-8a3e-7cde05b41557\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:52:06 crc kubenswrapper[5120]: I0316 15:52:06.398494 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/576e3e02-2c64-423f-8a3e-7cde05b41557-log-httpd\") pod \"ceilometer-0\" (UID: \"576e3e02-2c64-423f-8a3e-7cde05b41557\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:52:06 crc kubenswrapper[5120]: I0316 15:52:06.399910 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/576e3e02-2c64-423f-8a3e-7cde05b41557-log-httpd\") pod \"ceilometer-0\" (UID: \"576e3e02-2c64-423f-8a3e-7cde05b41557\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:52:06 crc kubenswrapper[5120]: I0316 15:52:06.402043 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/576e3e02-2c64-423f-8a3e-7cde05b41557-run-httpd\") pod \"ceilometer-0\" (UID: \"576e3e02-2c64-423f-8a3e-7cde05b41557\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:52:06 crc kubenswrapper[5120]: I0316 15:52:06.405109 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/576e3e02-2c64-423f-8a3e-7cde05b41557-scripts\") pod \"ceilometer-0\" (UID: \"576e3e02-2c64-423f-8a3e-7cde05b41557\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:52:06 crc kubenswrapper[5120]: I0316 15:52:06.405203 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/576e3e02-2c64-423f-8a3e-7cde05b41557-config-data\") pod \"ceilometer-0\" (UID: \"576e3e02-2c64-423f-8a3e-7cde05b41557\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:52:06 crc kubenswrapper[5120]: I0316 15:52:06.405669 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/576e3e02-2c64-423f-8a3e-7cde05b41557-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"576e3e02-2c64-423f-8a3e-7cde05b41557\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:52:06 crc kubenswrapper[5120]: I0316 15:52:06.409101 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/576e3e02-2c64-423f-8a3e-7cde05b41557-run-httpd\") pod \"ceilometer-0\" (UID: \"576e3e02-2c64-423f-8a3e-7cde05b41557\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:52:06 crc kubenswrapper[5120]: I0316 15:52:06.420859 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nb2j4\" (UniqueName: \"kubernetes.io/projected/576e3e02-2c64-423f-8a3e-7cde05b41557-kube-api-access-nb2j4\") pod \"ceilometer-0\" (UID: \"576e3e02-2c64-423f-8a3e-7cde05b41557\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:52:06 crc kubenswrapper[5120]: I0316 15:52:06.428247 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/576e3e02-2c64-423f-8a3e-7cde05b41557-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"576e3e02-2c64-423f-8a3e-7cde05b41557\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:52:06 crc kubenswrapper[5120]: I0316 15:52:06.475298 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-infra/auto-csr-approver-29561266-4l68r"] Mar 16 15:52:06 crc kubenswrapper[5120]: I0316 15:52:06.485357 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-infra/auto-csr-approver-29561266-4l68r"] Mar 16 15:52:06 crc kubenswrapper[5120]: I0316 15:52:06.536432 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:52:06 crc kubenswrapper[5120]: I0316 15:52:06.685725 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b459d6b-d4c6-44e9-ae6f-05e060b30042" path="/var/lib/kubelet/pods/6b459d6b-d4c6-44e9-ae6f-05e060b30042/volumes" Mar 16 15:52:06 crc kubenswrapper[5120]: I0316 15:52:06.687057 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7a77c479-1665-4fd1-a627-ff873b9aa31a" path="/var/lib/kubelet/pods/7a77c479-1665-4fd1-a627-ff873b9aa31a/volumes" Mar 16 15:52:06 crc kubenswrapper[5120]: I0316 15:52:06.687938 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c2d9d021-ff4d-4bcc-832b-fffe8f95ee2a" path="/var/lib/kubelet/pods/c2d9d021-ff4d-4bcc-832b-fffe8f95ee2a/volumes" Mar 16 15:52:07 crc kubenswrapper[5120]: I0316 15:52:07.058142 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 15:52:07 crc kubenswrapper[5120]: W0316 15:52:07.071098 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod576e3e02_2c64_423f_8a3e_7cde05b41557.slice/crio-06dd2e418a111fba6353560d3033b52bb0ced92ee13fa084c7297e343b4ab028 WatchSource:0}: Error finding container 06dd2e418a111fba6353560d3033b52bb0ced92ee13fa084c7297e343b4ab028: Status 404 returned error can't find the container with id 06dd2e418a111fba6353560d3033b52bb0ced92ee13fa084c7297e343b4ab028 Mar 16 15:52:07 crc kubenswrapper[5120]: I0316 15:52:07.144235 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"576e3e02-2c64-423f-8a3e-7cde05b41557","Type":"ContainerStarted","Data":"06dd2e418a111fba6353560d3033b52bb0ced92ee13fa084c7297e343b4ab028"} Mar 16 15:52:08 crc kubenswrapper[5120]: E0316 15:52:08.016942 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1605255 actualBytes=10240 Mar 16 15:52:08 crc kubenswrapper[5120]: I0316 15:52:08.157823 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"576e3e02-2c64-423f-8a3e-7cde05b41557","Type":"ContainerStarted","Data":"095d283334a88a06b2b705b78cd8933a56b348802ba05bc2795773b1360183a0"} Mar 16 15:52:09 crc kubenswrapper[5120]: I0316 15:52:09.172888 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"576e3e02-2c64-423f-8a3e-7cde05b41557","Type":"ContainerStarted","Data":"104043f9c638cfe6d20bba1a2a4b1473cdc084966f81057e04047ad434ff3c2f"} Mar 16 15:52:09 crc kubenswrapper[5120]: I0316 15:52:09.174119 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"576e3e02-2c64-423f-8a3e-7cde05b41557","Type":"ContainerStarted","Data":"0d761e4d85dee137a8a132f7414f7f53952b5762e66361dca9a22d1e4940211a"} Mar 16 15:52:12 crc kubenswrapper[5120]: I0316 15:52:12.215440 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"576e3e02-2c64-423f-8a3e-7cde05b41557","Type":"ContainerStarted","Data":"e3ce806387a91a6da3e97fc6543cd9c4dee6483f63385289d9429d20761fa7a6"} Mar 16 15:52:12 crc kubenswrapper[5120]: I0316 15:52:12.220188 5120 generic.go:358] "Generic (PLEG): container finished" podID="38fd2e9b-bc77-4f3c-be96-7059ba88891e" containerID="186b4e2033d4312c54f215dec67a20d5d2834f98c87348e63660f4a704ef1870" exitCode=0 Mar 16 15:52:12 crc kubenswrapper[5120]: I0316 15:52:12.220259 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-gpg9h" event={"ID":"38fd2e9b-bc77-4f3c-be96-7059ba88891e","Type":"ContainerDied","Data":"186b4e2033d4312c54f215dec67a20d5d2834f98c87348e63660f4a704ef1870"} Mar 16 15:52:12 crc kubenswrapper[5120]: I0316 15:52:12.260679 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.416616745 podStartE2EDuration="6.260663728s" podCreationTimestamp="2026-03-16 15:52:06 +0000 UTC" firstStartedPulling="2026-03-16 15:52:07.074036126 +0000 UTC m=+1229.227967783" lastFinishedPulling="2026-03-16 15:52:10.918083099 +0000 UTC m=+1233.072014766" observedRunningTime="2026-03-16 15:52:12.25039877 +0000 UTC m=+1234.404330457" watchObservedRunningTime="2026-03-16 15:52:12.260663728 +0000 UTC m=+1234.414595385" Mar 16 15:52:13 crc kubenswrapper[5120]: I0316 15:52:13.229970 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:52:13 crc kubenswrapper[5120]: I0316 15:52:13.614035 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-gpg9h" Mar 16 15:52:13 crc kubenswrapper[5120]: I0316 15:52:13.663315 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xplmv\" (UniqueName: \"kubernetes.io/projected/38fd2e9b-bc77-4f3c-be96-7059ba88891e-kube-api-access-xplmv\") pod \"38fd2e9b-bc77-4f3c-be96-7059ba88891e\" (UID: \"38fd2e9b-bc77-4f3c-be96-7059ba88891e\") " Mar 16 15:52:13 crc kubenswrapper[5120]: I0316 15:52:13.663424 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/38fd2e9b-bc77-4f3c-be96-7059ba88891e-config-data\") pod \"38fd2e9b-bc77-4f3c-be96-7059ba88891e\" (UID: \"38fd2e9b-bc77-4f3c-be96-7059ba88891e\") " Mar 16 15:52:13 crc kubenswrapper[5120]: I0316 15:52:13.663560 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/38fd2e9b-bc77-4f3c-be96-7059ba88891e-scripts\") pod \"38fd2e9b-bc77-4f3c-be96-7059ba88891e\" (UID: \"38fd2e9b-bc77-4f3c-be96-7059ba88891e\") " Mar 16 15:52:13 crc kubenswrapper[5120]: I0316 15:52:13.663657 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/38fd2e9b-bc77-4f3c-be96-7059ba88891e-combined-ca-bundle\") pod \"38fd2e9b-bc77-4f3c-be96-7059ba88891e\" (UID: \"38fd2e9b-bc77-4f3c-be96-7059ba88891e\") " Mar 16 15:52:13 crc kubenswrapper[5120]: I0316 15:52:13.671490 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38fd2e9b-bc77-4f3c-be96-7059ba88891e-kube-api-access-xplmv" (OuterVolumeSpecName: "kube-api-access-xplmv") pod "38fd2e9b-bc77-4f3c-be96-7059ba88891e" (UID: "38fd2e9b-bc77-4f3c-be96-7059ba88891e"). InnerVolumeSpecName "kube-api-access-xplmv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:52:13 crc kubenswrapper[5120]: I0316 15:52:13.671868 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38fd2e9b-bc77-4f3c-be96-7059ba88891e-scripts" (OuterVolumeSpecName: "scripts") pod "38fd2e9b-bc77-4f3c-be96-7059ba88891e" (UID: "38fd2e9b-bc77-4f3c-be96-7059ba88891e"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:52:13 crc kubenswrapper[5120]: I0316 15:52:13.693525 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38fd2e9b-bc77-4f3c-be96-7059ba88891e-config-data" (OuterVolumeSpecName: "config-data") pod "38fd2e9b-bc77-4f3c-be96-7059ba88891e" (UID: "38fd2e9b-bc77-4f3c-be96-7059ba88891e"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:52:13 crc kubenswrapper[5120]: I0316 15:52:13.715636 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38fd2e9b-bc77-4f3c-be96-7059ba88891e-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "38fd2e9b-bc77-4f3c-be96-7059ba88891e" (UID: "38fd2e9b-bc77-4f3c-be96-7059ba88891e"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:52:13 crc kubenswrapper[5120]: I0316 15:52:13.766462 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xplmv\" (UniqueName: \"kubernetes.io/projected/38fd2e9b-bc77-4f3c-be96-7059ba88891e-kube-api-access-xplmv\") on node \"crc\" DevicePath \"\"" Mar 16 15:52:13 crc kubenswrapper[5120]: I0316 15:52:13.766496 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/38fd2e9b-bc77-4f3c-be96-7059ba88891e-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 15:52:13 crc kubenswrapper[5120]: I0316 15:52:13.766504 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/38fd2e9b-bc77-4f3c-be96-7059ba88891e-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 15:52:13 crc kubenswrapper[5120]: I0316 15:52:13.766513 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/38fd2e9b-bc77-4f3c-be96-7059ba88891e-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:52:14 crc kubenswrapper[5120]: I0316 15:52:14.238431 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-gpg9h" Mar 16 15:52:14 crc kubenswrapper[5120]: I0316 15:52:14.238448 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-gpg9h" event={"ID":"38fd2e9b-bc77-4f3c-be96-7059ba88891e","Type":"ContainerDied","Data":"e389043f7cc9f70cfd3884744e06b45c97cf30e237c2ed37198875e0628b828f"} Mar 16 15:52:14 crc kubenswrapper[5120]: I0316 15:52:14.238658 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e389043f7cc9f70cfd3884744e06b45c97cf30e237c2ed37198875e0628b828f" Mar 16 15:52:14 crc kubenswrapper[5120]: I0316 15:52:14.366818 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 15:52:14 crc kubenswrapper[5120]: I0316 15:52:14.374027 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38fd2e9b-bc77-4f3c-be96-7059ba88891e" containerName="nova-cell0-conductor-db-sync" Mar 16 15:52:14 crc kubenswrapper[5120]: I0316 15:52:14.374073 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="38fd2e9b-bc77-4f3c-be96-7059ba88891e" containerName="nova-cell0-conductor-db-sync" Mar 16 15:52:14 crc kubenswrapper[5120]: I0316 15:52:14.374312 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="38fd2e9b-bc77-4f3c-be96-7059ba88891e" containerName="nova-cell0-conductor-db-sync" Mar 16 15:52:14 crc kubenswrapper[5120]: I0316 15:52:14.384521 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 15:52:14 crc kubenswrapper[5120]: I0316 15:52:14.385715 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 15:52:14 crc kubenswrapper[5120]: I0316 15:52:14.387364 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-nova-dockercfg-m7cr4\"" Mar 16 15:52:14 crc kubenswrapper[5120]: I0316 15:52:14.391143 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-conductor-config-data\"" Mar 16 15:52:14 crc kubenswrapper[5120]: I0316 15:52:14.478965 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thftp\" (UniqueName: \"kubernetes.io/projected/5888de0f-5da8-4605-aa27-db134fd47b31-kube-api-access-thftp\") pod \"nova-cell0-conductor-0\" (UID: \"5888de0f-5da8-4605-aa27-db134fd47b31\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 15:52:14 crc kubenswrapper[5120]: I0316 15:52:14.479494 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5888de0f-5da8-4605-aa27-db134fd47b31-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"5888de0f-5da8-4605-aa27-db134fd47b31\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 15:52:14 crc kubenswrapper[5120]: I0316 15:52:14.479634 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5888de0f-5da8-4605-aa27-db134fd47b31-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"5888de0f-5da8-4605-aa27-db134fd47b31\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 15:52:14 crc kubenswrapper[5120]: I0316 15:52:14.583364 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-thftp\" (UniqueName: \"kubernetes.io/projected/5888de0f-5da8-4605-aa27-db134fd47b31-kube-api-access-thftp\") pod \"nova-cell0-conductor-0\" (UID: \"5888de0f-5da8-4605-aa27-db134fd47b31\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 15:52:14 crc kubenswrapper[5120]: I0316 15:52:14.584434 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5888de0f-5da8-4605-aa27-db134fd47b31-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"5888de0f-5da8-4605-aa27-db134fd47b31\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 15:52:14 crc kubenswrapper[5120]: I0316 15:52:14.586169 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5888de0f-5da8-4605-aa27-db134fd47b31-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"5888de0f-5da8-4605-aa27-db134fd47b31\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 15:52:14 crc kubenswrapper[5120]: I0316 15:52:14.590410 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5888de0f-5da8-4605-aa27-db134fd47b31-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"5888de0f-5da8-4605-aa27-db134fd47b31\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 15:52:14 crc kubenswrapper[5120]: I0316 15:52:14.597689 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5888de0f-5da8-4605-aa27-db134fd47b31-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"5888de0f-5da8-4605-aa27-db134fd47b31\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 15:52:14 crc kubenswrapper[5120]: I0316 15:52:14.617444 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-thftp\" (UniqueName: \"kubernetes.io/projected/5888de0f-5da8-4605-aa27-db134fd47b31-kube-api-access-thftp\") pod \"nova-cell0-conductor-0\" (UID: \"5888de0f-5da8-4605-aa27-db134fd47b31\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 15:52:14 crc kubenswrapper[5120]: I0316 15:52:14.712085 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 15:52:15 crc kubenswrapper[5120]: I0316 15:52:15.185447 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 15:52:15 crc kubenswrapper[5120]: I0316 15:52:15.247356 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"5888de0f-5da8-4605-aa27-db134fd47b31","Type":"ContainerStarted","Data":"dbbb38ae0016789737cfd4bef731bde626c1fb8fca9c642259fe0f87e177b959"} Mar 16 15:52:16 crc kubenswrapper[5120]: I0316 15:52:16.265935 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"5888de0f-5da8-4605-aa27-db134fd47b31","Type":"ContainerStarted","Data":"5a00c8f45c647963a8510197f0acdd358ed4e08e0b3eefebcc584d2b7161253e"} Mar 16 15:52:16 crc kubenswrapper[5120]: I0316 15:52:16.266736 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 15:52:16 crc kubenswrapper[5120]: I0316 15:52:16.304953 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podStartSLOduration=2.304923386 podStartE2EDuration="2.304923386s" podCreationTimestamp="2026-03-16 15:52:14 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:52:16.29749213 +0000 UTC m=+1238.451423887" watchObservedRunningTime="2026-03-16 15:52:16.304923386 +0000 UTC m=+1238.458855073" Mar 16 15:52:22 crc kubenswrapper[5120]: I0316 15:52:22.312294 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 15:52:22 crc kubenswrapper[5120]: I0316 15:52:22.991615 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-w8jp7"] Mar 16 15:52:23 crc kubenswrapper[5120]: I0316 15:52:23.001879 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-w8jp7" Mar 16 15:52:23 crc kubenswrapper[5120]: I0316 15:52:23.005721 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-manage-scripts\"" Mar 16 15:52:23 crc kubenswrapper[5120]: I0316 15:52:23.007796 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-manage-config-data\"" Mar 16 15:52:23 crc kubenswrapper[5120]: I0316 15:52:23.010611 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-w8jp7"] Mar 16 15:52:23 crc kubenswrapper[5120]: I0316 15:52:23.092211 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f4c8d373-a29f-4b52-8e52-04dd3dfd8ebf-scripts\") pod \"nova-cell0-cell-mapping-w8jp7\" (UID: \"f4c8d373-a29f-4b52-8e52-04dd3dfd8ebf\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-w8jp7" Mar 16 15:52:23 crc kubenswrapper[5120]: I0316 15:52:23.092253 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f4c8d373-a29f-4b52-8e52-04dd3dfd8ebf-combined-ca-bundle\") pod \"nova-cell0-cell-mapping-w8jp7\" (UID: \"f4c8d373-a29f-4b52-8e52-04dd3dfd8ebf\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-w8jp7" Mar 16 15:52:23 crc kubenswrapper[5120]: I0316 15:52:23.092278 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbm6m\" (UniqueName: \"kubernetes.io/projected/f4c8d373-a29f-4b52-8e52-04dd3dfd8ebf-kube-api-access-cbm6m\") pod \"nova-cell0-cell-mapping-w8jp7\" (UID: \"f4c8d373-a29f-4b52-8e52-04dd3dfd8ebf\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-w8jp7" Mar 16 15:52:23 crc kubenswrapper[5120]: I0316 15:52:23.092373 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f4c8d373-a29f-4b52-8e52-04dd3dfd8ebf-config-data\") pod \"nova-cell0-cell-mapping-w8jp7\" (UID: \"f4c8d373-a29f-4b52-8e52-04dd3dfd8ebf\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-w8jp7" Mar 16 15:52:23 crc kubenswrapper[5120]: I0316 15:52:23.112725 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 15:52:23 crc kubenswrapper[5120]: I0316 15:52:23.120968 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 15:52:23 crc kubenswrapper[5120]: I0316 15:52:23.123642 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-novncproxy-config-data\"" Mar 16 15:52:23 crc kubenswrapper[5120]: I0316 15:52:23.127035 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 15:52:23 crc kubenswrapper[5120]: I0316 15:52:23.147161 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 15:52:23 crc kubenswrapper[5120]: I0316 15:52:23.162065 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:52:23 crc kubenswrapper[5120]: I0316 15:52:23.194258 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/df668a23-68e4-44f4-afcc-1eeed64cd2df-logs\") pod \"nova-api-0\" (UID: \"df668a23-68e4-44f4-afcc-1eeed64cd2df\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:52:23 crc kubenswrapper[5120]: I0316 15:52:23.194306 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f4c8d373-a29f-4b52-8e52-04dd3dfd8ebf-scripts\") pod \"nova-cell0-cell-mapping-w8jp7\" (UID: \"f4c8d373-a29f-4b52-8e52-04dd3dfd8ebf\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-w8jp7" Mar 16 15:52:23 crc kubenswrapper[5120]: I0316 15:52:23.194331 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f4c8d373-a29f-4b52-8e52-04dd3dfd8ebf-combined-ca-bundle\") pod \"nova-cell0-cell-mapping-w8jp7\" (UID: \"f4c8d373-a29f-4b52-8e52-04dd3dfd8ebf\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-w8jp7" Mar 16 15:52:23 crc kubenswrapper[5120]: I0316 15:52:23.194357 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cbm6m\" (UniqueName: \"kubernetes.io/projected/f4c8d373-a29f-4b52-8e52-04dd3dfd8ebf-kube-api-access-cbm6m\") pod \"nova-cell0-cell-mapping-w8jp7\" (UID: \"f4c8d373-a29f-4b52-8e52-04dd3dfd8ebf\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-w8jp7" Mar 16 15:52:23 crc kubenswrapper[5120]: I0316 15:52:23.194400 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mll67\" (UniqueName: \"kubernetes.io/projected/df668a23-68e4-44f4-afcc-1eeed64cd2df-kube-api-access-mll67\") pod \"nova-api-0\" (UID: \"df668a23-68e4-44f4-afcc-1eeed64cd2df\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:52:23 crc kubenswrapper[5120]: I0316 15:52:23.194442 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/df668a23-68e4-44f4-afcc-1eeed64cd2df-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"df668a23-68e4-44f4-afcc-1eeed64cd2df\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:52:23 crc kubenswrapper[5120]: I0316 15:52:23.194492 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f4c8d373-a29f-4b52-8e52-04dd3dfd8ebf-config-data\") pod \"nova-cell0-cell-mapping-w8jp7\" (UID: \"f4c8d373-a29f-4b52-8e52-04dd3dfd8ebf\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-w8jp7" Mar 16 15:52:23 crc kubenswrapper[5120]: I0316 15:52:23.194531 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/df668a23-68e4-44f4-afcc-1eeed64cd2df-config-data\") pod \"nova-api-0\" (UID: \"df668a23-68e4-44f4-afcc-1eeed64cd2df\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:52:23 crc kubenswrapper[5120]: I0316 15:52:23.203092 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-config-data\"" Mar 16 15:52:23 crc kubenswrapper[5120]: I0316 15:52:23.203511 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f4c8d373-a29f-4b52-8e52-04dd3dfd8ebf-combined-ca-bundle\") pod \"nova-cell0-cell-mapping-w8jp7\" (UID: \"f4c8d373-a29f-4b52-8e52-04dd3dfd8ebf\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-w8jp7" Mar 16 15:52:23 crc kubenswrapper[5120]: I0316 15:52:23.207049 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f4c8d373-a29f-4b52-8e52-04dd3dfd8ebf-scripts\") pod \"nova-cell0-cell-mapping-w8jp7\" (UID: \"f4c8d373-a29f-4b52-8e52-04dd3dfd8ebf\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-w8jp7" Mar 16 15:52:23 crc kubenswrapper[5120]: I0316 15:52:23.208810 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f4c8d373-a29f-4b52-8e52-04dd3dfd8ebf-config-data\") pod \"nova-cell0-cell-mapping-w8jp7\" (UID: \"f4c8d373-a29f-4b52-8e52-04dd3dfd8ebf\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-w8jp7" Mar 16 15:52:23 crc kubenswrapper[5120]: I0316 15:52:23.222411 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 15:52:23 crc kubenswrapper[5120]: I0316 15:52:23.242990 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 15:52:23 crc kubenswrapper[5120]: I0316 15:52:23.281821 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 15:52:23 crc kubenswrapper[5120]: I0316 15:52:23.297022 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mll67\" (UniqueName: \"kubernetes.io/projected/df668a23-68e4-44f4-afcc-1eeed64cd2df-kube-api-access-mll67\") pod \"nova-api-0\" (UID: \"df668a23-68e4-44f4-afcc-1eeed64cd2df\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:52:23 crc kubenswrapper[5120]: I0316 15:52:23.310133 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/df668a23-68e4-44f4-afcc-1eeed64cd2df-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"df668a23-68e4-44f4-afcc-1eeed64cd2df\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:52:23 crc kubenswrapper[5120]: I0316 15:52:23.310329 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hprlg\" (UniqueName: \"kubernetes.io/projected/4bdf4d32-2df6-4db1-8819-bae92ef9690d-kube-api-access-hprlg\") pod \"nova-cell1-novncproxy-0\" (UID: \"4bdf4d32-2df6-4db1-8819-bae92ef9690d\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 15:52:23 crc kubenswrapper[5120]: I0316 15:52:23.310409 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4bdf4d32-2df6-4db1-8819-bae92ef9690d-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"4bdf4d32-2df6-4db1-8819-bae92ef9690d\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 15:52:23 crc kubenswrapper[5120]: I0316 15:52:23.310542 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/df668a23-68e4-44f4-afcc-1eeed64cd2df-config-data\") pod \"nova-api-0\" (UID: \"df668a23-68e4-44f4-afcc-1eeed64cd2df\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:52:23 crc kubenswrapper[5120]: I0316 15:52:23.310638 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4bdf4d32-2df6-4db1-8819-bae92ef9690d-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"4bdf4d32-2df6-4db1-8819-bae92ef9690d\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 15:52:23 crc kubenswrapper[5120]: I0316 15:52:23.304123 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-scheduler-config-data\"" Mar 16 15:52:23 crc kubenswrapper[5120]: I0316 15:52:23.310889 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/df668a23-68e4-44f4-afcc-1eeed64cd2df-logs\") pod \"nova-api-0\" (UID: \"df668a23-68e4-44f4-afcc-1eeed64cd2df\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:52:23 crc kubenswrapper[5120]: I0316 15:52:23.297378 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbm6m\" (UniqueName: \"kubernetes.io/projected/f4c8d373-a29f-4b52-8e52-04dd3dfd8ebf-kube-api-access-cbm6m\") pod \"nova-cell0-cell-mapping-w8jp7\" (UID: \"f4c8d373-a29f-4b52-8e52-04dd3dfd8ebf\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-w8jp7" Mar 16 15:52:23 crc kubenswrapper[5120]: I0316 15:52:23.311662 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/df668a23-68e4-44f4-afcc-1eeed64cd2df-logs\") pod \"nova-api-0\" (UID: \"df668a23-68e4-44f4-afcc-1eeed64cd2df\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:52:23 crc kubenswrapper[5120]: I0316 15:52:23.319361 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/df668a23-68e4-44f4-afcc-1eeed64cd2df-config-data\") pod \"nova-api-0\" (UID: \"df668a23-68e4-44f4-afcc-1eeed64cd2df\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:52:23 crc kubenswrapper[5120]: I0316 15:52:23.332600 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/df668a23-68e4-44f4-afcc-1eeed64cd2df-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"df668a23-68e4-44f4-afcc-1eeed64cd2df\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:52:23 crc kubenswrapper[5120]: I0316 15:52:23.335114 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-w8jp7" Mar 16 15:52:23 crc kubenswrapper[5120]: I0316 15:52:23.336357 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 15:52:23 crc kubenswrapper[5120]: I0316 15:52:23.353897 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mll67\" (UniqueName: \"kubernetes.io/projected/df668a23-68e4-44f4-afcc-1eeed64cd2df-kube-api-access-mll67\") pod \"nova-api-0\" (UID: \"df668a23-68e4-44f4-afcc-1eeed64cd2df\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:52:23 crc kubenswrapper[5120]: I0316 15:52:23.418353 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:52:23 crc kubenswrapper[5120]: I0316 15:52:23.423836 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5qvb\" (UniqueName: \"kubernetes.io/projected/aba40463-9218-4b84-a98c-26f91ef97b87-kube-api-access-q5qvb\") pod \"nova-scheduler-0\" (UID: \"aba40463-9218-4b84-a98c-26f91ef97b87\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 15:52:23 crc kubenswrapper[5120]: I0316 15:52:23.423937 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/aba40463-9218-4b84-a98c-26f91ef97b87-config-data\") pod \"nova-scheduler-0\" (UID: \"aba40463-9218-4b84-a98c-26f91ef97b87\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 15:52:23 crc kubenswrapper[5120]: I0316 15:52:23.423968 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/aba40463-9218-4b84-a98c-26f91ef97b87-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"aba40463-9218-4b84-a98c-26f91ef97b87\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 15:52:23 crc kubenswrapper[5120]: I0316 15:52:23.424024 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hprlg\" (UniqueName: \"kubernetes.io/projected/4bdf4d32-2df6-4db1-8819-bae92ef9690d-kube-api-access-hprlg\") pod \"nova-cell1-novncproxy-0\" (UID: \"4bdf4d32-2df6-4db1-8819-bae92ef9690d\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 15:52:23 crc kubenswrapper[5120]: I0316 15:52:23.424042 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4bdf4d32-2df6-4db1-8819-bae92ef9690d-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"4bdf4d32-2df6-4db1-8819-bae92ef9690d\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 15:52:23 crc kubenswrapper[5120]: I0316 15:52:23.424087 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4bdf4d32-2df6-4db1-8819-bae92ef9690d-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"4bdf4d32-2df6-4db1-8819-bae92ef9690d\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 15:52:23 crc kubenswrapper[5120]: I0316 15:52:23.436369 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4bdf4d32-2df6-4db1-8819-bae92ef9690d-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"4bdf4d32-2df6-4db1-8819-bae92ef9690d\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 15:52:23 crc kubenswrapper[5120]: I0316 15:52:23.444502 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4bdf4d32-2df6-4db1-8819-bae92ef9690d-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"4bdf4d32-2df6-4db1-8819-bae92ef9690d\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 15:52:23 crc kubenswrapper[5120]: I0316 15:52:23.472142 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 15:52:23 crc kubenswrapper[5120]: I0316 15:52:23.484567 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hprlg\" (UniqueName: \"kubernetes.io/projected/4bdf4d32-2df6-4db1-8819-bae92ef9690d-kube-api-access-hprlg\") pod \"nova-cell1-novncproxy-0\" (UID: \"4bdf4d32-2df6-4db1-8819-bae92ef9690d\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 15:52:23 crc kubenswrapper[5120]: I0316 15:52:23.526940 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q5qvb\" (UniqueName: \"kubernetes.io/projected/aba40463-9218-4b84-a98c-26f91ef97b87-kube-api-access-q5qvb\") pod \"nova-scheduler-0\" (UID: \"aba40463-9218-4b84-a98c-26f91ef97b87\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 15:52:23 crc kubenswrapper[5120]: I0316 15:52:23.527060 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/aba40463-9218-4b84-a98c-26f91ef97b87-config-data\") pod \"nova-scheduler-0\" (UID: \"aba40463-9218-4b84-a98c-26f91ef97b87\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 15:52:23 crc kubenswrapper[5120]: I0316 15:52:23.527082 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/aba40463-9218-4b84-a98c-26f91ef97b87-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"aba40463-9218-4b84-a98c-26f91ef97b87\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 15:52:23 crc kubenswrapper[5120]: I0316 15:52:23.532116 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/aba40463-9218-4b84-a98c-26f91ef97b87-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"aba40463-9218-4b84-a98c-26f91ef97b87\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 15:52:23 crc kubenswrapper[5120]: I0316 15:52:23.533394 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/aba40463-9218-4b84-a98c-26f91ef97b87-config-data\") pod \"nova-scheduler-0\" (UID: \"aba40463-9218-4b84-a98c-26f91ef97b87\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 15:52:23 crc kubenswrapper[5120]: I0316 15:52:23.548075 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5qvb\" (UniqueName: \"kubernetes.io/projected/aba40463-9218-4b84-a98c-26f91ef97b87-kube-api-access-q5qvb\") pod \"nova-scheduler-0\" (UID: \"aba40463-9218-4b84-a98c-26f91ef97b87\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 15:52:23 crc kubenswrapper[5120]: I0316 15:52:23.617634 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 15:52:23 crc kubenswrapper[5120]: I0316 15:52:23.617779 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:52:23 crc kubenswrapper[5120]: I0316 15:52:23.623161 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-metadata-config-data\"" Mar 16 15:52:23 crc kubenswrapper[5120]: I0316 15:52:23.731461 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5cd8fa9c-4c5a-4f85-a943-b8f3c737c2ff-config-data\") pod \"nova-metadata-0\" (UID: \"5cd8fa9c-4c5a-4f85-a943-b8f3c737c2ff\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:52:23 crc kubenswrapper[5120]: I0316 15:52:23.731596 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5cd8fa9c-4c5a-4f85-a943-b8f3c737c2ff-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"5cd8fa9c-4c5a-4f85-a943-b8f3c737c2ff\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:52:23 crc kubenswrapper[5120]: I0316 15:52:23.732394 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhx6k\" (UniqueName: \"kubernetes.io/projected/5cd8fa9c-4c5a-4f85-a943-b8f3c737c2ff-kube-api-access-jhx6k\") pod \"nova-metadata-0\" (UID: \"5cd8fa9c-4c5a-4f85-a943-b8f3c737c2ff\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:52:23 crc kubenswrapper[5120]: I0316 15:52:23.732512 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5cd8fa9c-4c5a-4f85-a943-b8f3c737c2ff-logs\") pod \"nova-metadata-0\" (UID: \"5cd8fa9c-4c5a-4f85-a943-b8f3c737c2ff\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:52:23 crc kubenswrapper[5120]: I0316 15:52:23.738316 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 15:52:23 crc kubenswrapper[5120]: I0316 15:52:23.772848 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 15:52:23 crc kubenswrapper[5120]: I0316 15:52:23.834360 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5cd8fa9c-4c5a-4f85-a943-b8f3c737c2ff-config-data\") pod \"nova-metadata-0\" (UID: \"5cd8fa9c-4c5a-4f85-a943-b8f3c737c2ff\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:52:23 crc kubenswrapper[5120]: I0316 15:52:23.835737 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5cd8fa9c-4c5a-4f85-a943-b8f3c737c2ff-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"5cd8fa9c-4c5a-4f85-a943-b8f3c737c2ff\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:52:23 crc kubenswrapper[5120]: I0316 15:52:23.835838 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jhx6k\" (UniqueName: \"kubernetes.io/projected/5cd8fa9c-4c5a-4f85-a943-b8f3c737c2ff-kube-api-access-jhx6k\") pod \"nova-metadata-0\" (UID: \"5cd8fa9c-4c5a-4f85-a943-b8f3c737c2ff\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:52:23 crc kubenswrapper[5120]: I0316 15:52:23.836072 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5cd8fa9c-4c5a-4f85-a943-b8f3c737c2ff-logs\") pod \"nova-metadata-0\" (UID: \"5cd8fa9c-4c5a-4f85-a943-b8f3c737c2ff\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:52:23 crc kubenswrapper[5120]: I0316 15:52:23.836783 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5cd8fa9c-4c5a-4f85-a943-b8f3c737c2ff-logs\") pod \"nova-metadata-0\" (UID: \"5cd8fa9c-4c5a-4f85-a943-b8f3c737c2ff\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:52:23 crc kubenswrapper[5120]: I0316 15:52:23.840383 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5cd8fa9c-4c5a-4f85-a943-b8f3c737c2ff-config-data\") pod \"nova-metadata-0\" (UID: \"5cd8fa9c-4c5a-4f85-a943-b8f3c737c2ff\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:52:23 crc kubenswrapper[5120]: I0316 15:52:23.840726 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5cd8fa9c-4c5a-4f85-a943-b8f3c737c2ff-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"5cd8fa9c-4c5a-4f85-a943-b8f3c737c2ff\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:52:23 crc kubenswrapper[5120]: I0316 15:52:23.855380 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhx6k\" (UniqueName: \"kubernetes.io/projected/5cd8fa9c-4c5a-4f85-a943-b8f3c737c2ff-kube-api-access-jhx6k\") pod \"nova-metadata-0\" (UID: \"5cd8fa9c-4c5a-4f85-a943-b8f3c737c2ff\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:52:23 crc kubenswrapper[5120]: I0316 15:52:23.933922 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-w8jp7"] Mar 16 15:52:23 crc kubenswrapper[5120]: I0316 15:52:23.941290 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:52:24 crc kubenswrapper[5120]: I0316 15:52:24.027618 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 15:52:24 crc kubenswrapper[5120]: I0316 15:52:24.116713 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-ph2vf"] Mar 16 15:52:24 crc kubenswrapper[5120]: I0316 15:52:24.162586 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-ph2vf" Mar 16 15:52:24 crc kubenswrapper[5120]: I0316 15:52:24.171217 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-conductor-scripts\"" Mar 16 15:52:24 crc kubenswrapper[5120]: I0316 15:52:24.171944 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-conductor-config-data\"" Mar 16 15:52:24 crc kubenswrapper[5120]: I0316 15:52:24.176601 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-ph2vf"] Mar 16 15:52:24 crc kubenswrapper[5120]: I0316 15:52:24.194593 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 15:52:24 crc kubenswrapper[5120]: I0316 15:52:24.248723 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 15:52:24 crc kubenswrapper[5120]: I0316 15:52:24.268664 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2c34de88-9612-4808-9fb7-312716436225-scripts\") pod \"nova-cell1-conductor-db-sync-ph2vf\" (UID: \"2c34de88-9612-4808-9fb7-312716436225\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-ph2vf" Mar 16 15:52:24 crc kubenswrapper[5120]: I0316 15:52:24.268808 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2c34de88-9612-4808-9fb7-312716436225-combined-ca-bundle\") pod \"nova-cell1-conductor-db-sync-ph2vf\" (UID: \"2c34de88-9612-4808-9fb7-312716436225\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-ph2vf" Mar 16 15:52:24 crc kubenswrapper[5120]: I0316 15:52:24.268873 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4d5gq\" (UniqueName: \"kubernetes.io/projected/2c34de88-9612-4808-9fb7-312716436225-kube-api-access-4d5gq\") pod \"nova-cell1-conductor-db-sync-ph2vf\" (UID: \"2c34de88-9612-4808-9fb7-312716436225\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-ph2vf" Mar 16 15:52:24 crc kubenswrapper[5120]: I0316 15:52:24.268893 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2c34de88-9612-4808-9fb7-312716436225-config-data\") pod \"nova-cell1-conductor-db-sync-ph2vf\" (UID: \"2c34de88-9612-4808-9fb7-312716436225\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-ph2vf" Mar 16 15:52:24 crc kubenswrapper[5120]: I0316 15:52:24.370871 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2c34de88-9612-4808-9fb7-312716436225-combined-ca-bundle\") pod \"nova-cell1-conductor-db-sync-ph2vf\" (UID: \"2c34de88-9612-4808-9fb7-312716436225\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-ph2vf" Mar 16 15:52:24 crc kubenswrapper[5120]: I0316 15:52:24.370956 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4d5gq\" (UniqueName: \"kubernetes.io/projected/2c34de88-9612-4808-9fb7-312716436225-kube-api-access-4d5gq\") pod \"nova-cell1-conductor-db-sync-ph2vf\" (UID: \"2c34de88-9612-4808-9fb7-312716436225\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-ph2vf" Mar 16 15:52:24 crc kubenswrapper[5120]: I0316 15:52:24.370989 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2c34de88-9612-4808-9fb7-312716436225-config-data\") pod \"nova-cell1-conductor-db-sync-ph2vf\" (UID: \"2c34de88-9612-4808-9fb7-312716436225\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-ph2vf" Mar 16 15:52:24 crc kubenswrapper[5120]: I0316 15:52:24.371015 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2c34de88-9612-4808-9fb7-312716436225-scripts\") pod \"nova-cell1-conductor-db-sync-ph2vf\" (UID: \"2c34de88-9612-4808-9fb7-312716436225\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-ph2vf" Mar 16 15:52:24 crc kubenswrapper[5120]: I0316 15:52:24.385437 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2c34de88-9612-4808-9fb7-312716436225-scripts\") pod \"nova-cell1-conductor-db-sync-ph2vf\" (UID: \"2c34de88-9612-4808-9fb7-312716436225\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-ph2vf" Mar 16 15:52:24 crc kubenswrapper[5120]: I0316 15:52:24.385747 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2c34de88-9612-4808-9fb7-312716436225-config-data\") pod \"nova-cell1-conductor-db-sync-ph2vf\" (UID: \"2c34de88-9612-4808-9fb7-312716436225\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-ph2vf" Mar 16 15:52:24 crc kubenswrapper[5120]: I0316 15:52:24.385872 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2c34de88-9612-4808-9fb7-312716436225-combined-ca-bundle\") pod \"nova-cell1-conductor-db-sync-ph2vf\" (UID: \"2c34de88-9612-4808-9fb7-312716436225\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-ph2vf" Mar 16 15:52:24 crc kubenswrapper[5120]: I0316 15:52:24.390268 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4d5gq\" (UniqueName: \"kubernetes.io/projected/2c34de88-9612-4808-9fb7-312716436225-kube-api-access-4d5gq\") pod \"nova-cell1-conductor-db-sync-ph2vf\" (UID: \"2c34de88-9612-4808-9fb7-312716436225\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-ph2vf" Mar 16 15:52:24 crc kubenswrapper[5120]: I0316 15:52:24.397894 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"df668a23-68e4-44f4-afcc-1eeed64cd2df","Type":"ContainerStarted","Data":"cbc4d58da5cad7c00fe59ec1d826f3a5cb4087e958e2c8f97218d56ddebc4c87"} Mar 16 15:52:24 crc kubenswrapper[5120]: I0316 15:52:24.400412 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-w8jp7" event={"ID":"f4c8d373-a29f-4b52-8e52-04dd3dfd8ebf","Type":"ContainerStarted","Data":"07f6b36802e0bbde1b411f71d5223ef63177629d26145e6e761fc31f378099a3"} Mar 16 15:52:24 crc kubenswrapper[5120]: I0316 15:52:24.400460 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-w8jp7" event={"ID":"f4c8d373-a29f-4b52-8e52-04dd3dfd8ebf","Type":"ContainerStarted","Data":"405b629f94ce69a95fb7a00cab9f99391c787f905b598020be19e4673fd3e273"} Mar 16 15:52:24 crc kubenswrapper[5120]: I0316 15:52:24.402424 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"aba40463-9218-4b84-a98c-26f91ef97b87","Type":"ContainerStarted","Data":"aa7de5fe1b770e3e295fd6b1170e3564a9061b7c79915060287688b65a249bed"} Mar 16 15:52:24 crc kubenswrapper[5120]: I0316 15:52:24.405648 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"4bdf4d32-2df6-4db1-8819-bae92ef9690d","Type":"ContainerStarted","Data":"bd1afe2a85e91182a0bcb5031ee3daa64e4e34c63b598a1663e1b326f79e1386"} Mar 16 15:52:24 crc kubenswrapper[5120]: I0316 15:52:24.423337 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-w8jp7" podStartSLOduration=2.423320226 podStartE2EDuration="2.423320226s" podCreationTimestamp="2026-03-16 15:52:22 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:52:24.417178787 +0000 UTC m=+1246.571110444" watchObservedRunningTime="2026-03-16 15:52:24.423320226 +0000 UTC m=+1246.577251883" Mar 16 15:52:24 crc kubenswrapper[5120]: I0316 15:52:24.482684 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 15:52:24 crc kubenswrapper[5120]: W0316 15:52:24.484921 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5cd8fa9c_4c5a_4f85_a943_b8f3c737c2ff.slice/crio-fd5d3d08b914d273898aa9556977ecca6a9e16b9c65ac5f228feffebc7a77dc7 WatchSource:0}: Error finding container fd5d3d08b914d273898aa9556977ecca6a9e16b9c65ac5f228feffebc7a77dc7: Status 404 returned error can't find the container with id fd5d3d08b914d273898aa9556977ecca6a9e16b9c65ac5f228feffebc7a77dc7 Mar 16 15:52:24 crc kubenswrapper[5120]: I0316 15:52:24.496638 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-ph2vf" Mar 16 15:52:24 crc kubenswrapper[5120]: I0316 15:52:24.724366 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-ph2vf"] Mar 16 15:52:24 crc kubenswrapper[5120]: W0316 15:52:24.728115 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2c34de88_9612_4808_9fb7_312716436225.slice/crio-74ee83c7ad50756ae84fe7ff1f29cc611a6f87808d8079e98b64493cbaea073b WatchSource:0}: Error finding container 74ee83c7ad50756ae84fe7ff1f29cc611a6f87808d8079e98b64493cbaea073b: Status 404 returned error can't find the container with id 74ee83c7ad50756ae84fe7ff1f29cc611a6f87808d8079e98b64493cbaea073b Mar 16 15:52:25 crc kubenswrapper[5120]: I0316 15:52:25.431493 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-ph2vf" event={"ID":"2c34de88-9612-4808-9fb7-312716436225","Type":"ContainerStarted","Data":"a7d7ec2d67d82148a0d8f8352dba2a699544562849a7cc864810594c5756d53f"} Mar 16 15:52:25 crc kubenswrapper[5120]: I0316 15:52:25.431872 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-ph2vf" event={"ID":"2c34de88-9612-4808-9fb7-312716436225","Type":"ContainerStarted","Data":"74ee83c7ad50756ae84fe7ff1f29cc611a6f87808d8079e98b64493cbaea073b"} Mar 16 15:52:25 crc kubenswrapper[5120]: I0316 15:52:25.440672 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"5cd8fa9c-4c5a-4f85-a943-b8f3c737c2ff","Type":"ContainerStarted","Data":"fd5d3d08b914d273898aa9556977ecca6a9e16b9c65ac5f228feffebc7a77dc7"} Mar 16 15:52:25 crc kubenswrapper[5120]: I0316 15:52:25.462326 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-ph2vf" podStartSLOduration=1.462305166 podStartE2EDuration="1.462305166s" podCreationTimestamp="2026-03-16 15:52:24 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:52:25.451151547 +0000 UTC m=+1247.605083244" watchObservedRunningTime="2026-03-16 15:52:25.462305166 +0000 UTC m=+1247.616236823" Mar 16 15:52:26 crc kubenswrapper[5120]: I0316 15:52:26.747905 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 15:52:26 crc kubenswrapper[5120]: I0316 15:52:26.764730 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 15:52:27 crc kubenswrapper[5120]: I0316 15:52:27.470844 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"df668a23-68e4-44f4-afcc-1eeed64cd2df","Type":"ContainerStarted","Data":"e707de9127a64e0e7769016009983f29608dc79888c5255baba924948c601a83"} Mar 16 15:52:27 crc kubenswrapper[5120]: I0316 15:52:27.471190 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"df668a23-68e4-44f4-afcc-1eeed64cd2df","Type":"ContainerStarted","Data":"5ac8a89dfc135e6a5fb30b53215c9659c3be883386ffef84f1ebf008b87f80b6"} Mar 16 15:52:27 crc kubenswrapper[5120]: I0316 15:52:27.473865 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"5cd8fa9c-4c5a-4f85-a943-b8f3c737c2ff","Type":"ContainerStarted","Data":"a313a731c525dd1b19787a5de658b12624c60551806cbd1c01092344522ec68c"} Mar 16 15:52:27 crc kubenswrapper[5120]: I0316 15:52:27.473893 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"5cd8fa9c-4c5a-4f85-a943-b8f3c737c2ff","Type":"ContainerStarted","Data":"a1d84bb66f3463d56e26ed236913fe737e4f332a24a81b6c283709269fff0c26"} Mar 16 15:52:27 crc kubenswrapper[5120]: I0316 15:52:27.473992 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="5cd8fa9c-4c5a-4f85-a943-b8f3c737c2ff" containerName="nova-metadata-log" containerID="cri-o://a1d84bb66f3463d56e26ed236913fe737e4f332a24a81b6c283709269fff0c26" gracePeriod=30 Mar 16 15:52:27 crc kubenswrapper[5120]: I0316 15:52:27.474236 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="5cd8fa9c-4c5a-4f85-a943-b8f3c737c2ff" containerName="nova-metadata-metadata" containerID="cri-o://a313a731c525dd1b19787a5de658b12624c60551806cbd1c01092344522ec68c" gracePeriod=30 Mar 16 15:52:27 crc kubenswrapper[5120]: I0316 15:52:27.512273 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=2.241557226 podStartE2EDuration="4.512245948s" podCreationTimestamp="2026-03-16 15:52:23 +0000 UTC" firstStartedPulling="2026-03-16 15:52:24.06641405 +0000 UTC m=+1246.220345717" lastFinishedPulling="2026-03-16 15:52:26.337102762 +0000 UTC m=+1248.491034439" observedRunningTime="2026-03-16 15:52:27.487793962 +0000 UTC m=+1249.641725619" watchObservedRunningTime="2026-03-16 15:52:27.512245948 +0000 UTC m=+1249.666177605" Mar 16 15:52:27 crc kubenswrapper[5120]: I0316 15:52:27.547772 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=2.719497122 podStartE2EDuration="4.54772973s" podCreationTimestamp="2026-03-16 15:52:23 +0000 UTC" firstStartedPulling="2026-03-16 15:52:24.488249343 +0000 UTC m=+1246.642181000" lastFinishedPulling="2026-03-16 15:52:26.316481951 +0000 UTC m=+1248.470413608" observedRunningTime="2026-03-16 15:52:27.522307427 +0000 UTC m=+1249.676239104" watchObservedRunningTime="2026-03-16 15:52:27.54772973 +0000 UTC m=+1249.701661387" Mar 16 15:52:28 crc kubenswrapper[5120]: I0316 15:52:28.489542 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"aba40463-9218-4b84-a98c-26f91ef97b87","Type":"ContainerStarted","Data":"06724a84859bf281d1597e0c35110c21518005ce31218283e2d04367057d3fc6"} Mar 16 15:52:28 crc kubenswrapper[5120]: I0316 15:52:28.494827 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"4bdf4d32-2df6-4db1-8819-bae92ef9690d","Type":"ContainerStarted","Data":"bab718c240e7715476594adb89e1d45b92b2cfad75e656245dc41aa5d292445a"} Mar 16 15:52:28 crc kubenswrapper[5120]: I0316 15:52:28.495009 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podUID="4bdf4d32-2df6-4db1-8819-bae92ef9690d" containerName="nova-cell1-novncproxy-novncproxy" containerID="cri-o://bab718c240e7715476594adb89e1d45b92b2cfad75e656245dc41aa5d292445a" gracePeriod=30 Mar 16 15:52:28 crc kubenswrapper[5120]: I0316 15:52:28.506469 5120 generic.go:358] "Generic (PLEG): container finished" podID="5cd8fa9c-4c5a-4f85-a943-b8f3c737c2ff" containerID="a313a731c525dd1b19787a5de658b12624c60551806cbd1c01092344522ec68c" exitCode=0 Mar 16 15:52:28 crc kubenswrapper[5120]: I0316 15:52:28.506499 5120 generic.go:358] "Generic (PLEG): container finished" podID="5cd8fa9c-4c5a-4f85-a943-b8f3c737c2ff" containerID="a1d84bb66f3463d56e26ed236913fe737e4f332a24a81b6c283709269fff0c26" exitCode=143 Mar 16 15:52:28 crc kubenswrapper[5120]: I0316 15:52:28.506901 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"5cd8fa9c-4c5a-4f85-a943-b8f3c737c2ff","Type":"ContainerDied","Data":"a313a731c525dd1b19787a5de658b12624c60551806cbd1c01092344522ec68c"} Mar 16 15:52:28 crc kubenswrapper[5120]: I0316 15:52:28.506973 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"5cd8fa9c-4c5a-4f85-a943-b8f3c737c2ff","Type":"ContainerDied","Data":"a1d84bb66f3463d56e26ed236913fe737e4f332a24a81b6c283709269fff0c26"} Mar 16 15:52:28 crc kubenswrapper[5120]: I0316 15:52:28.506987 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"5cd8fa9c-4c5a-4f85-a943-b8f3c737c2ff","Type":"ContainerDied","Data":"fd5d3d08b914d273898aa9556977ecca6a9e16b9c65ac5f228feffebc7a77dc7"} Mar 16 15:52:28 crc kubenswrapper[5120]: I0316 15:52:28.506999 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fd5d3d08b914d273898aa9556977ecca6a9e16b9c65ac5f228feffebc7a77dc7" Mar 16 15:52:28 crc kubenswrapper[5120]: I0316 15:52:28.520557 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-scheduler-0" podStartSLOduration=1.6316474319999998 podStartE2EDuration="5.520523268s" podCreationTimestamp="2026-03-16 15:52:23 +0000 UTC" firstStartedPulling="2026-03-16 15:52:24.180636742 +0000 UTC m=+1246.334568399" lastFinishedPulling="2026-03-16 15:52:28.069512568 +0000 UTC m=+1250.223444235" observedRunningTime="2026-03-16 15:52:28.511328794 +0000 UTC m=+1250.665260451" watchObservedRunningTime="2026-03-16 15:52:28.520523268 +0000 UTC m=+1250.674454915" Mar 16 15:52:28 crc kubenswrapper[5120]: I0316 15:52:28.537594 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podStartSLOduration=1.728377477 podStartE2EDuration="5.537567659s" podCreationTimestamp="2026-03-16 15:52:23 +0000 UTC" firstStartedPulling="2026-03-16 15:52:24.256447079 +0000 UTC m=+1246.410378736" lastFinishedPulling="2026-03-16 15:52:28.065637261 +0000 UTC m=+1250.219568918" observedRunningTime="2026-03-16 15:52:28.528782747 +0000 UTC m=+1250.682714414" watchObservedRunningTime="2026-03-16 15:52:28.537567659 +0000 UTC m=+1250.691499316" Mar 16 15:52:28 crc kubenswrapper[5120]: I0316 15:52:28.540374 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:52:28 crc kubenswrapper[5120]: I0316 15:52:28.619009 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5cd8fa9c-4c5a-4f85-a943-b8f3c737c2ff-combined-ca-bundle\") pod \"5cd8fa9c-4c5a-4f85-a943-b8f3c737c2ff\" (UID: \"5cd8fa9c-4c5a-4f85-a943-b8f3c737c2ff\") " Mar 16 15:52:28 crc kubenswrapper[5120]: I0316 15:52:28.619127 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5cd8fa9c-4c5a-4f85-a943-b8f3c737c2ff-logs\") pod \"5cd8fa9c-4c5a-4f85-a943-b8f3c737c2ff\" (UID: \"5cd8fa9c-4c5a-4f85-a943-b8f3c737c2ff\") " Mar 16 15:52:28 crc kubenswrapper[5120]: I0316 15:52:28.619318 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jhx6k\" (UniqueName: \"kubernetes.io/projected/5cd8fa9c-4c5a-4f85-a943-b8f3c737c2ff-kube-api-access-jhx6k\") pod \"5cd8fa9c-4c5a-4f85-a943-b8f3c737c2ff\" (UID: \"5cd8fa9c-4c5a-4f85-a943-b8f3c737c2ff\") " Mar 16 15:52:28 crc kubenswrapper[5120]: I0316 15:52:28.619501 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5cd8fa9c-4c5a-4f85-a943-b8f3c737c2ff-logs" (OuterVolumeSpecName: "logs") pod "5cd8fa9c-4c5a-4f85-a943-b8f3c737c2ff" (UID: "5cd8fa9c-4c5a-4f85-a943-b8f3c737c2ff"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:52:28 crc kubenswrapper[5120]: I0316 15:52:28.619536 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5cd8fa9c-4c5a-4f85-a943-b8f3c737c2ff-config-data\") pod \"5cd8fa9c-4c5a-4f85-a943-b8f3c737c2ff\" (UID: \"5cd8fa9c-4c5a-4f85-a943-b8f3c737c2ff\") " Mar 16 15:52:28 crc kubenswrapper[5120]: I0316 15:52:28.619988 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5cd8fa9c-4c5a-4f85-a943-b8f3c737c2ff-logs\") on node \"crc\" DevicePath \"\"" Mar 16 15:52:28 crc kubenswrapper[5120]: I0316 15:52:28.635074 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5cd8fa9c-4c5a-4f85-a943-b8f3c737c2ff-kube-api-access-jhx6k" (OuterVolumeSpecName: "kube-api-access-jhx6k") pod "5cd8fa9c-4c5a-4f85-a943-b8f3c737c2ff" (UID: "5cd8fa9c-4c5a-4f85-a943-b8f3c737c2ff"). InnerVolumeSpecName "kube-api-access-jhx6k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:52:28 crc kubenswrapper[5120]: I0316 15:52:28.650908 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5cd8fa9c-4c5a-4f85-a943-b8f3c737c2ff-config-data" (OuterVolumeSpecName: "config-data") pod "5cd8fa9c-4c5a-4f85-a943-b8f3c737c2ff" (UID: "5cd8fa9c-4c5a-4f85-a943-b8f3c737c2ff"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:52:28 crc kubenswrapper[5120]: I0316 15:52:28.666416 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5cd8fa9c-4c5a-4f85-a943-b8f3c737c2ff-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "5cd8fa9c-4c5a-4f85-a943-b8f3c737c2ff" (UID: "5cd8fa9c-4c5a-4f85-a943-b8f3c737c2ff"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:52:28 crc kubenswrapper[5120]: I0316 15:52:28.722489 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jhx6k\" (UniqueName: \"kubernetes.io/projected/5cd8fa9c-4c5a-4f85-a943-b8f3c737c2ff-kube-api-access-jhx6k\") on node \"crc\" DevicePath \"\"" Mar 16 15:52:28 crc kubenswrapper[5120]: I0316 15:52:28.722518 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5cd8fa9c-4c5a-4f85-a943-b8f3c737c2ff-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 15:52:28 crc kubenswrapper[5120]: I0316 15:52:28.722526 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5cd8fa9c-4c5a-4f85-a943-b8f3c737c2ff-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:52:28 crc kubenswrapper[5120]: I0316 15:52:28.738910 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 15:52:28 crc kubenswrapper[5120]: I0316 15:52:28.773361 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 15:52:29 crc kubenswrapper[5120]: I0316 15:52:29.515661 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:52:29 crc kubenswrapper[5120]: I0316 15:52:29.547383 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 15:52:29 crc kubenswrapper[5120]: I0316 15:52:29.563836 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 15:52:29 crc kubenswrapper[5120]: I0316 15:52:29.583573 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 15:52:29 crc kubenswrapper[5120]: I0316 15:52:29.584801 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5cd8fa9c-4c5a-4f85-a943-b8f3c737c2ff" containerName="nova-metadata-log" Mar 16 15:52:29 crc kubenswrapper[5120]: I0316 15:52:29.584824 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="5cd8fa9c-4c5a-4f85-a943-b8f3c737c2ff" containerName="nova-metadata-log" Mar 16 15:52:29 crc kubenswrapper[5120]: I0316 15:52:29.584874 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5cd8fa9c-4c5a-4f85-a943-b8f3c737c2ff" containerName="nova-metadata-metadata" Mar 16 15:52:29 crc kubenswrapper[5120]: I0316 15:52:29.584882 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="5cd8fa9c-4c5a-4f85-a943-b8f3c737c2ff" containerName="nova-metadata-metadata" Mar 16 15:52:29 crc kubenswrapper[5120]: I0316 15:52:29.585078 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="5cd8fa9c-4c5a-4f85-a943-b8f3c737c2ff" containerName="nova-metadata-log" Mar 16 15:52:29 crc kubenswrapper[5120]: I0316 15:52:29.585100 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="5cd8fa9c-4c5a-4f85-a943-b8f3c737c2ff" containerName="nova-metadata-metadata" Mar 16 15:52:29 crc kubenswrapper[5120]: I0316 15:52:29.592304 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:52:29 crc kubenswrapper[5120]: I0316 15:52:29.597456 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 15:52:29 crc kubenswrapper[5120]: I0316 15:52:29.598855 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-metadata-internal-svc\"" Mar 16 15:52:29 crc kubenswrapper[5120]: I0316 15:52:29.601179 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-metadata-config-data\"" Mar 16 15:52:29 crc kubenswrapper[5120]: I0316 15:52:29.647303 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8eaa6732-ebd3-4742-9203-84bebd18dd15-config-data\") pod \"nova-metadata-0\" (UID: \"8eaa6732-ebd3-4742-9203-84bebd18dd15\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:52:29 crc kubenswrapper[5120]: I0316 15:52:29.647420 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8eaa6732-ebd3-4742-9203-84bebd18dd15-logs\") pod \"nova-metadata-0\" (UID: \"8eaa6732-ebd3-4742-9203-84bebd18dd15\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:52:29 crc kubenswrapper[5120]: I0316 15:52:29.647476 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8eaa6732-ebd3-4742-9203-84bebd18dd15-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"8eaa6732-ebd3-4742-9203-84bebd18dd15\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:52:29 crc kubenswrapper[5120]: I0316 15:52:29.647556 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdrxh\" (UniqueName: \"kubernetes.io/projected/8eaa6732-ebd3-4742-9203-84bebd18dd15-kube-api-access-sdrxh\") pod \"nova-metadata-0\" (UID: \"8eaa6732-ebd3-4742-9203-84bebd18dd15\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:52:29 crc kubenswrapper[5120]: I0316 15:52:29.647607 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/8eaa6732-ebd3-4742-9203-84bebd18dd15-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"8eaa6732-ebd3-4742-9203-84bebd18dd15\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:52:29 crc kubenswrapper[5120]: I0316 15:52:29.750320 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sdrxh\" (UniqueName: \"kubernetes.io/projected/8eaa6732-ebd3-4742-9203-84bebd18dd15-kube-api-access-sdrxh\") pod \"nova-metadata-0\" (UID: \"8eaa6732-ebd3-4742-9203-84bebd18dd15\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:52:29 crc kubenswrapper[5120]: I0316 15:52:29.750777 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/8eaa6732-ebd3-4742-9203-84bebd18dd15-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"8eaa6732-ebd3-4742-9203-84bebd18dd15\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:52:29 crc kubenswrapper[5120]: I0316 15:52:29.751048 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8eaa6732-ebd3-4742-9203-84bebd18dd15-config-data\") pod \"nova-metadata-0\" (UID: \"8eaa6732-ebd3-4742-9203-84bebd18dd15\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:52:29 crc kubenswrapper[5120]: I0316 15:52:29.751375 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8eaa6732-ebd3-4742-9203-84bebd18dd15-logs\") pod \"nova-metadata-0\" (UID: \"8eaa6732-ebd3-4742-9203-84bebd18dd15\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:52:29 crc kubenswrapper[5120]: I0316 15:52:29.751495 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8eaa6732-ebd3-4742-9203-84bebd18dd15-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"8eaa6732-ebd3-4742-9203-84bebd18dd15\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:52:29 crc kubenswrapper[5120]: I0316 15:52:29.751744 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8eaa6732-ebd3-4742-9203-84bebd18dd15-logs\") pod \"nova-metadata-0\" (UID: \"8eaa6732-ebd3-4742-9203-84bebd18dd15\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:52:29 crc kubenswrapper[5120]: I0316 15:52:29.755798 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/8eaa6732-ebd3-4742-9203-84bebd18dd15-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"8eaa6732-ebd3-4742-9203-84bebd18dd15\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:52:29 crc kubenswrapper[5120]: I0316 15:52:29.761080 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8eaa6732-ebd3-4742-9203-84bebd18dd15-config-data\") pod \"nova-metadata-0\" (UID: \"8eaa6732-ebd3-4742-9203-84bebd18dd15\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:52:29 crc kubenswrapper[5120]: I0316 15:52:29.763309 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8eaa6732-ebd3-4742-9203-84bebd18dd15-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"8eaa6732-ebd3-4742-9203-84bebd18dd15\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:52:29 crc kubenswrapper[5120]: I0316 15:52:29.766523 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdrxh\" (UniqueName: \"kubernetes.io/projected/8eaa6732-ebd3-4742-9203-84bebd18dd15-kube-api-access-sdrxh\") pod \"nova-metadata-0\" (UID: \"8eaa6732-ebd3-4742-9203-84bebd18dd15\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:52:29 crc kubenswrapper[5120]: I0316 15:52:29.914667 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:52:30 crc kubenswrapper[5120]: I0316 15:52:30.426015 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 15:52:30 crc kubenswrapper[5120]: W0316 15:52:30.432065 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8eaa6732_ebd3_4742_9203_84bebd18dd15.slice/crio-47e04c3f5188807bb3c471e77e5713b09c07675d26cf2e245c20e29d9f54c71f WatchSource:0}: Error finding container 47e04c3f5188807bb3c471e77e5713b09c07675d26cf2e245c20e29d9f54c71f: Status 404 returned error can't find the container with id 47e04c3f5188807bb3c471e77e5713b09c07675d26cf2e245c20e29d9f54c71f Mar 16 15:52:30 crc kubenswrapper[5120]: I0316 15:52:30.527255 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"8eaa6732-ebd3-4742-9203-84bebd18dd15","Type":"ContainerStarted","Data":"47e04c3f5188807bb3c471e77e5713b09c07675d26cf2e245c20e29d9f54c71f"} Mar 16 15:52:30 crc kubenswrapper[5120]: I0316 15:52:30.690721 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5cd8fa9c-4c5a-4f85-a943-b8f3c737c2ff" path="/var/lib/kubelet/pods/5cd8fa9c-4c5a-4f85-a943-b8f3c737c2ff/volumes" Mar 16 15:52:31 crc kubenswrapper[5120]: I0316 15:52:31.541454 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"8eaa6732-ebd3-4742-9203-84bebd18dd15","Type":"ContainerStarted","Data":"7c1bd5d391982be09e08f3f68f30e5a0cabc77bd3f3dcf9e5026528dcf2c1804"} Mar 16 15:52:31 crc kubenswrapper[5120]: I0316 15:52:31.541549 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"8eaa6732-ebd3-4742-9203-84bebd18dd15","Type":"ContainerStarted","Data":"e88ffd81a0d81e36e693104ea5aeaf43cb3b7f232a52069a4d81d78d12a9954f"} Mar 16 15:52:31 crc kubenswrapper[5120]: I0316 15:52:31.544435 5120 generic.go:358] "Generic (PLEG): container finished" podID="f4c8d373-a29f-4b52-8e52-04dd3dfd8ebf" containerID="07f6b36802e0bbde1b411f71d5223ef63177629d26145e6e761fc31f378099a3" exitCode=0 Mar 16 15:52:31 crc kubenswrapper[5120]: I0316 15:52:31.544597 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-w8jp7" event={"ID":"f4c8d373-a29f-4b52-8e52-04dd3dfd8ebf","Type":"ContainerDied","Data":"07f6b36802e0bbde1b411f71d5223ef63177629d26145e6e761fc31f378099a3"} Mar 16 15:52:31 crc kubenswrapper[5120]: I0316 15:52:31.547369 5120 generic.go:358] "Generic (PLEG): container finished" podID="2c34de88-9612-4808-9fb7-312716436225" containerID="a7d7ec2d67d82148a0d8f8352dba2a699544562849a7cc864810594c5756d53f" exitCode=0 Mar 16 15:52:31 crc kubenswrapper[5120]: I0316 15:52:31.547457 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-ph2vf" event={"ID":"2c34de88-9612-4808-9fb7-312716436225","Type":"ContainerDied","Data":"a7d7ec2d67d82148a0d8f8352dba2a699544562849a7cc864810594c5756d53f"} Mar 16 15:52:31 crc kubenswrapper[5120]: I0316 15:52:31.569664 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=2.5696342789999997 podStartE2EDuration="2.569634279s" podCreationTimestamp="2026-03-16 15:52:29 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:52:31.567729866 +0000 UTC m=+1253.721661563" watchObservedRunningTime="2026-03-16 15:52:31.569634279 +0000 UTC m=+1253.723565976" Mar 16 15:52:33 crc kubenswrapper[5120]: I0316 15:52:33.053749 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-w8jp7" Mar 16 15:52:33 crc kubenswrapper[5120]: I0316 15:52:33.059282 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-ph2vf" Mar 16 15:52:33 crc kubenswrapper[5120]: I0316 15:52:33.114958 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f4c8d373-a29f-4b52-8e52-04dd3dfd8ebf-combined-ca-bundle\") pod \"f4c8d373-a29f-4b52-8e52-04dd3dfd8ebf\" (UID: \"f4c8d373-a29f-4b52-8e52-04dd3dfd8ebf\") " Mar 16 15:52:33 crc kubenswrapper[5120]: I0316 15:52:33.115019 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f4c8d373-a29f-4b52-8e52-04dd3dfd8ebf-config-data\") pod \"f4c8d373-a29f-4b52-8e52-04dd3dfd8ebf\" (UID: \"f4c8d373-a29f-4b52-8e52-04dd3dfd8ebf\") " Mar 16 15:52:33 crc kubenswrapper[5120]: I0316 15:52:33.115102 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2c34de88-9612-4808-9fb7-312716436225-combined-ca-bundle\") pod \"2c34de88-9612-4808-9fb7-312716436225\" (UID: \"2c34de88-9612-4808-9fb7-312716436225\") " Mar 16 15:52:33 crc kubenswrapper[5120]: I0316 15:52:33.115197 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f4c8d373-a29f-4b52-8e52-04dd3dfd8ebf-scripts\") pod \"f4c8d373-a29f-4b52-8e52-04dd3dfd8ebf\" (UID: \"f4c8d373-a29f-4b52-8e52-04dd3dfd8ebf\") " Mar 16 15:52:33 crc kubenswrapper[5120]: I0316 15:52:33.115261 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4d5gq\" (UniqueName: \"kubernetes.io/projected/2c34de88-9612-4808-9fb7-312716436225-kube-api-access-4d5gq\") pod \"2c34de88-9612-4808-9fb7-312716436225\" (UID: \"2c34de88-9612-4808-9fb7-312716436225\") " Mar 16 15:52:33 crc kubenswrapper[5120]: I0316 15:52:33.115338 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cbm6m\" (UniqueName: \"kubernetes.io/projected/f4c8d373-a29f-4b52-8e52-04dd3dfd8ebf-kube-api-access-cbm6m\") pod \"f4c8d373-a29f-4b52-8e52-04dd3dfd8ebf\" (UID: \"f4c8d373-a29f-4b52-8e52-04dd3dfd8ebf\") " Mar 16 15:52:33 crc kubenswrapper[5120]: I0316 15:52:33.115409 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2c34de88-9612-4808-9fb7-312716436225-scripts\") pod \"2c34de88-9612-4808-9fb7-312716436225\" (UID: \"2c34de88-9612-4808-9fb7-312716436225\") " Mar 16 15:52:33 crc kubenswrapper[5120]: I0316 15:52:33.115512 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2c34de88-9612-4808-9fb7-312716436225-config-data\") pod \"2c34de88-9612-4808-9fb7-312716436225\" (UID: \"2c34de88-9612-4808-9fb7-312716436225\") " Mar 16 15:52:33 crc kubenswrapper[5120]: I0316 15:52:33.121085 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4c8d373-a29f-4b52-8e52-04dd3dfd8ebf-kube-api-access-cbm6m" (OuterVolumeSpecName: "kube-api-access-cbm6m") pod "f4c8d373-a29f-4b52-8e52-04dd3dfd8ebf" (UID: "f4c8d373-a29f-4b52-8e52-04dd3dfd8ebf"). InnerVolumeSpecName "kube-api-access-cbm6m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:52:33 crc kubenswrapper[5120]: I0316 15:52:33.122140 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c34de88-9612-4808-9fb7-312716436225-kube-api-access-4d5gq" (OuterVolumeSpecName: "kube-api-access-4d5gq") pod "2c34de88-9612-4808-9fb7-312716436225" (UID: "2c34de88-9612-4808-9fb7-312716436225"). InnerVolumeSpecName "kube-api-access-4d5gq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:52:33 crc kubenswrapper[5120]: I0316 15:52:33.122623 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f4c8d373-a29f-4b52-8e52-04dd3dfd8ebf-scripts" (OuterVolumeSpecName: "scripts") pod "f4c8d373-a29f-4b52-8e52-04dd3dfd8ebf" (UID: "f4c8d373-a29f-4b52-8e52-04dd3dfd8ebf"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:52:33 crc kubenswrapper[5120]: I0316 15:52:33.122987 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2c34de88-9612-4808-9fb7-312716436225-scripts" (OuterVolumeSpecName: "scripts") pod "2c34de88-9612-4808-9fb7-312716436225" (UID: "2c34de88-9612-4808-9fb7-312716436225"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:52:33 crc kubenswrapper[5120]: I0316 15:52:33.145541 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2c34de88-9612-4808-9fb7-312716436225-config-data" (OuterVolumeSpecName: "config-data") pod "2c34de88-9612-4808-9fb7-312716436225" (UID: "2c34de88-9612-4808-9fb7-312716436225"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:52:33 crc kubenswrapper[5120]: I0316 15:52:33.146835 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f4c8d373-a29f-4b52-8e52-04dd3dfd8ebf-config-data" (OuterVolumeSpecName: "config-data") pod "f4c8d373-a29f-4b52-8e52-04dd3dfd8ebf" (UID: "f4c8d373-a29f-4b52-8e52-04dd3dfd8ebf"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:52:33 crc kubenswrapper[5120]: I0316 15:52:33.147604 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2c34de88-9612-4808-9fb7-312716436225-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "2c34de88-9612-4808-9fb7-312716436225" (UID: "2c34de88-9612-4808-9fb7-312716436225"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:52:33 crc kubenswrapper[5120]: I0316 15:52:33.158899 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f4c8d373-a29f-4b52-8e52-04dd3dfd8ebf-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f4c8d373-a29f-4b52-8e52-04dd3dfd8ebf" (UID: "f4c8d373-a29f-4b52-8e52-04dd3dfd8ebf"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:52:33 crc kubenswrapper[5120]: I0316 15:52:33.216900 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2c34de88-9612-4808-9fb7-312716436225-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:52:33 crc kubenswrapper[5120]: I0316 15:52:33.216936 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f4c8d373-a29f-4b52-8e52-04dd3dfd8ebf-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 15:52:33 crc kubenswrapper[5120]: I0316 15:52:33.216946 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4d5gq\" (UniqueName: \"kubernetes.io/projected/2c34de88-9612-4808-9fb7-312716436225-kube-api-access-4d5gq\") on node \"crc\" DevicePath \"\"" Mar 16 15:52:33 crc kubenswrapper[5120]: I0316 15:52:33.216957 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cbm6m\" (UniqueName: \"kubernetes.io/projected/f4c8d373-a29f-4b52-8e52-04dd3dfd8ebf-kube-api-access-cbm6m\") on node \"crc\" DevicePath \"\"" Mar 16 15:52:33 crc kubenswrapper[5120]: I0316 15:52:33.216966 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2c34de88-9612-4808-9fb7-312716436225-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 15:52:33 crc kubenswrapper[5120]: I0316 15:52:33.216974 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2c34de88-9612-4808-9fb7-312716436225-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 15:52:33 crc kubenswrapper[5120]: I0316 15:52:33.216982 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f4c8d373-a29f-4b52-8e52-04dd3dfd8ebf-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:52:33 crc kubenswrapper[5120]: I0316 15:52:33.216989 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f4c8d373-a29f-4b52-8e52-04dd3dfd8ebf-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 15:52:33 crc kubenswrapper[5120]: I0316 15:52:33.419808 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:52:33 crc kubenswrapper[5120]: I0316 15:52:33.419879 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:52:33 crc kubenswrapper[5120]: I0316 15:52:33.574122 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-w8jp7" event={"ID":"f4c8d373-a29f-4b52-8e52-04dd3dfd8ebf","Type":"ContainerDied","Data":"405b629f94ce69a95fb7a00cab9f99391c787f905b598020be19e4673fd3e273"} Mar 16 15:52:33 crc kubenswrapper[5120]: I0316 15:52:33.574197 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="405b629f94ce69a95fb7a00cab9f99391c787f905b598020be19e4673fd3e273" Mar 16 15:52:33 crc kubenswrapper[5120]: I0316 15:52:33.574134 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-w8jp7" Mar 16 15:52:33 crc kubenswrapper[5120]: I0316 15:52:33.575878 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-ph2vf" event={"ID":"2c34de88-9612-4808-9fb7-312716436225","Type":"ContainerDied","Data":"74ee83c7ad50756ae84fe7ff1f29cc611a6f87808d8079e98b64493cbaea073b"} Mar 16 15:52:33 crc kubenswrapper[5120]: I0316 15:52:33.575945 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="74ee83c7ad50756ae84fe7ff1f29cc611a6f87808d8079e98b64493cbaea073b" Mar 16 15:52:33 crc kubenswrapper[5120]: I0316 15:52:33.575968 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-ph2vf" Mar 16 15:52:33 crc kubenswrapper[5120]: I0316 15:52:33.709163 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 15:52:33 crc kubenswrapper[5120]: I0316 15:52:33.711164 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c34de88-9612-4808-9fb7-312716436225" containerName="nova-cell1-conductor-db-sync" Mar 16 15:52:33 crc kubenswrapper[5120]: I0316 15:52:33.711201 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c34de88-9612-4808-9fb7-312716436225" containerName="nova-cell1-conductor-db-sync" Mar 16 15:52:33 crc kubenswrapper[5120]: I0316 15:52:33.711242 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4c8d373-a29f-4b52-8e52-04dd3dfd8ebf" containerName="nova-manage" Mar 16 15:52:33 crc kubenswrapper[5120]: I0316 15:52:33.711254 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4c8d373-a29f-4b52-8e52-04dd3dfd8ebf" containerName="nova-manage" Mar 16 15:52:33 crc kubenswrapper[5120]: I0316 15:52:33.711632 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="2c34de88-9612-4808-9fb7-312716436225" containerName="nova-cell1-conductor-db-sync" Mar 16 15:52:33 crc kubenswrapper[5120]: I0316 15:52:33.711689 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f4c8d373-a29f-4b52-8e52-04dd3dfd8ebf" containerName="nova-manage" Mar 16 15:52:33 crc kubenswrapper[5120]: I0316 15:52:33.783266 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 15:52:33 crc kubenswrapper[5120]: I0316 15:52:33.783305 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 15:52:33 crc kubenswrapper[5120]: I0316 15:52:33.784134 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 15:52:33 crc kubenswrapper[5120]: I0316 15:52:33.787363 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-conductor-config-data\"" Mar 16 15:52:33 crc kubenswrapper[5120]: I0316 15:52:33.809571 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 15:52:33 crc kubenswrapper[5120]: I0316 15:52:33.830004 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/387f81d1-6a19-4250-b210-26daff7cbdc9-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"387f81d1-6a19-4250-b210-26daff7cbdc9\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 15:52:33 crc kubenswrapper[5120]: I0316 15:52:33.830072 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/387f81d1-6a19-4250-b210-26daff7cbdc9-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"387f81d1-6a19-4250-b210-26daff7cbdc9\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 15:52:33 crc kubenswrapper[5120]: I0316 15:52:33.830108 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-md2pw\" (UniqueName: \"kubernetes.io/projected/387f81d1-6a19-4250-b210-26daff7cbdc9-kube-api-access-md2pw\") pod \"nova-cell1-conductor-0\" (UID: \"387f81d1-6a19-4250-b210-26daff7cbdc9\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 15:52:33 crc kubenswrapper[5120]: I0316 15:52:33.851604 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 15:52:33 crc kubenswrapper[5120]: I0316 15:52:33.874580 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 15:52:33 crc kubenswrapper[5120]: I0316 15:52:33.874844 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="df668a23-68e4-44f4-afcc-1eeed64cd2df" containerName="nova-api-log" containerID="cri-o://5ac8a89dfc135e6a5fb30b53215c9659c3be883386ffef84f1ebf008b87f80b6" gracePeriod=30 Mar 16 15:52:33 crc kubenswrapper[5120]: I0316 15:52:33.875165 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="df668a23-68e4-44f4-afcc-1eeed64cd2df" containerName="nova-api-api" containerID="cri-o://e707de9127a64e0e7769016009983f29608dc79888c5255baba924948c601a83" gracePeriod=30 Mar 16 15:52:33 crc kubenswrapper[5120]: I0316 15:52:33.880649 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="df668a23-68e4-44f4-afcc-1eeed64cd2df" containerName="nova-api-api" probeResult="failure" output="Get \"http://10.217.0.180:8774/\": EOF" Mar 16 15:52:33 crc kubenswrapper[5120]: I0316 15:52:33.880649 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="df668a23-68e4-44f4-afcc-1eeed64cd2df" containerName="nova-api-log" probeResult="failure" output="Get \"http://10.217.0.180:8774/\": EOF" Mar 16 15:52:33 crc kubenswrapper[5120]: I0316 15:52:33.887896 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 15:52:33 crc kubenswrapper[5120]: I0316 15:52:33.888119 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="8eaa6732-ebd3-4742-9203-84bebd18dd15" containerName="nova-metadata-log" containerID="cri-o://e88ffd81a0d81e36e693104ea5aeaf43cb3b7f232a52069a4d81d78d12a9954f" gracePeriod=30 Mar 16 15:52:33 crc kubenswrapper[5120]: I0316 15:52:33.888611 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="8eaa6732-ebd3-4742-9203-84bebd18dd15" containerName="nova-metadata-metadata" containerID="cri-o://7c1bd5d391982be09e08f3f68f30e5a0cabc77bd3f3dcf9e5026528dcf2c1804" gracePeriod=30 Mar 16 15:52:33 crc kubenswrapper[5120]: I0316 15:52:33.931839 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/387f81d1-6a19-4250-b210-26daff7cbdc9-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"387f81d1-6a19-4250-b210-26daff7cbdc9\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 15:52:33 crc kubenswrapper[5120]: I0316 15:52:33.932207 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/387f81d1-6a19-4250-b210-26daff7cbdc9-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"387f81d1-6a19-4250-b210-26daff7cbdc9\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 15:52:33 crc kubenswrapper[5120]: I0316 15:52:33.932281 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-md2pw\" (UniqueName: \"kubernetes.io/projected/387f81d1-6a19-4250-b210-26daff7cbdc9-kube-api-access-md2pw\") pod \"nova-cell1-conductor-0\" (UID: \"387f81d1-6a19-4250-b210-26daff7cbdc9\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 15:52:33 crc kubenswrapper[5120]: I0316 15:52:33.938559 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/387f81d1-6a19-4250-b210-26daff7cbdc9-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"387f81d1-6a19-4250-b210-26daff7cbdc9\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 15:52:33 crc kubenswrapper[5120]: I0316 15:52:33.938837 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/387f81d1-6a19-4250-b210-26daff7cbdc9-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"387f81d1-6a19-4250-b210-26daff7cbdc9\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 15:52:33 crc kubenswrapper[5120]: I0316 15:52:33.949467 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-md2pw\" (UniqueName: \"kubernetes.io/projected/387f81d1-6a19-4250-b210-26daff7cbdc9-kube-api-access-md2pw\") pod \"nova-cell1-conductor-0\" (UID: \"387f81d1-6a19-4250-b210-26daff7cbdc9\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 15:52:34 crc kubenswrapper[5120]: I0316 15:52:34.113136 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 15:52:34 crc kubenswrapper[5120]: I0316 15:52:34.539348 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 15:52:34 crc kubenswrapper[5120]: W0316 15:52:34.541134 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod387f81d1_6a19_4250_b210_26daff7cbdc9.slice/crio-c656a669f1872a248d1465c7e5854c55698b4a43a6360d01d48675278a2e6805 WatchSource:0}: Error finding container c656a669f1872a248d1465c7e5854c55698b4a43a6360d01d48675278a2e6805: Status 404 returned error can't find the container with id c656a669f1872a248d1465c7e5854c55698b4a43a6360d01d48675278a2e6805 Mar 16 15:52:34 crc kubenswrapper[5120]: I0316 15:52:34.596640 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"387f81d1-6a19-4250-b210-26daff7cbdc9","Type":"ContainerStarted","Data":"c656a669f1872a248d1465c7e5854c55698b4a43a6360d01d48675278a2e6805"} Mar 16 15:52:34 crc kubenswrapper[5120]: I0316 15:52:34.599221 5120 generic.go:358] "Generic (PLEG): container finished" podID="df668a23-68e4-44f4-afcc-1eeed64cd2df" containerID="5ac8a89dfc135e6a5fb30b53215c9659c3be883386ffef84f1ebf008b87f80b6" exitCode=143 Mar 16 15:52:34 crc kubenswrapper[5120]: I0316 15:52:34.599263 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"df668a23-68e4-44f4-afcc-1eeed64cd2df","Type":"ContainerDied","Data":"5ac8a89dfc135e6a5fb30b53215c9659c3be883386ffef84f1ebf008b87f80b6"} Mar 16 15:52:34 crc kubenswrapper[5120]: I0316 15:52:34.602814 5120 generic.go:358] "Generic (PLEG): container finished" podID="8eaa6732-ebd3-4742-9203-84bebd18dd15" containerID="7c1bd5d391982be09e08f3f68f30e5a0cabc77bd3f3dcf9e5026528dcf2c1804" exitCode=0 Mar 16 15:52:34 crc kubenswrapper[5120]: I0316 15:52:34.602843 5120 generic.go:358] "Generic (PLEG): container finished" podID="8eaa6732-ebd3-4742-9203-84bebd18dd15" containerID="e88ffd81a0d81e36e693104ea5aeaf43cb3b7f232a52069a4d81d78d12a9954f" exitCode=143 Mar 16 15:52:34 crc kubenswrapper[5120]: I0316 15:52:34.602909 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"8eaa6732-ebd3-4742-9203-84bebd18dd15","Type":"ContainerDied","Data":"7c1bd5d391982be09e08f3f68f30e5a0cabc77bd3f3dcf9e5026528dcf2c1804"} Mar 16 15:52:34 crc kubenswrapper[5120]: I0316 15:52:34.602948 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"8eaa6732-ebd3-4742-9203-84bebd18dd15","Type":"ContainerDied","Data":"e88ffd81a0d81e36e693104ea5aeaf43cb3b7f232a52069a4d81d78d12a9954f"} Mar 16 15:52:34 crc kubenswrapper[5120]: I0316 15:52:34.725046 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 15:52:35 crc kubenswrapper[5120]: I0316 15:52:35.027102 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:52:35 crc kubenswrapper[5120]: I0316 15:52:35.153450 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8eaa6732-ebd3-4742-9203-84bebd18dd15-logs\") pod \"8eaa6732-ebd3-4742-9203-84bebd18dd15\" (UID: \"8eaa6732-ebd3-4742-9203-84bebd18dd15\") " Mar 16 15:52:35 crc kubenswrapper[5120]: I0316 15:52:35.153523 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8eaa6732-ebd3-4742-9203-84bebd18dd15-combined-ca-bundle\") pod \"8eaa6732-ebd3-4742-9203-84bebd18dd15\" (UID: \"8eaa6732-ebd3-4742-9203-84bebd18dd15\") " Mar 16 15:52:35 crc kubenswrapper[5120]: I0316 15:52:35.153558 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8eaa6732-ebd3-4742-9203-84bebd18dd15-config-data\") pod \"8eaa6732-ebd3-4742-9203-84bebd18dd15\" (UID: \"8eaa6732-ebd3-4742-9203-84bebd18dd15\") " Mar 16 15:52:35 crc kubenswrapper[5120]: I0316 15:52:35.153695 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sdrxh\" (UniqueName: \"kubernetes.io/projected/8eaa6732-ebd3-4742-9203-84bebd18dd15-kube-api-access-sdrxh\") pod \"8eaa6732-ebd3-4742-9203-84bebd18dd15\" (UID: \"8eaa6732-ebd3-4742-9203-84bebd18dd15\") " Mar 16 15:52:35 crc kubenswrapper[5120]: I0316 15:52:35.153719 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/8eaa6732-ebd3-4742-9203-84bebd18dd15-nova-metadata-tls-certs\") pod \"8eaa6732-ebd3-4742-9203-84bebd18dd15\" (UID: \"8eaa6732-ebd3-4742-9203-84bebd18dd15\") " Mar 16 15:52:35 crc kubenswrapper[5120]: I0316 15:52:35.162393 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8eaa6732-ebd3-4742-9203-84bebd18dd15-kube-api-access-sdrxh" (OuterVolumeSpecName: "kube-api-access-sdrxh") pod "8eaa6732-ebd3-4742-9203-84bebd18dd15" (UID: "8eaa6732-ebd3-4742-9203-84bebd18dd15"). InnerVolumeSpecName "kube-api-access-sdrxh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:52:35 crc kubenswrapper[5120]: I0316 15:52:35.169904 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8eaa6732-ebd3-4742-9203-84bebd18dd15-logs" (OuterVolumeSpecName: "logs") pod "8eaa6732-ebd3-4742-9203-84bebd18dd15" (UID: "8eaa6732-ebd3-4742-9203-84bebd18dd15"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:52:35 crc kubenswrapper[5120]: I0316 15:52:35.208134 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8eaa6732-ebd3-4742-9203-84bebd18dd15-config-data" (OuterVolumeSpecName: "config-data") pod "8eaa6732-ebd3-4742-9203-84bebd18dd15" (UID: "8eaa6732-ebd3-4742-9203-84bebd18dd15"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:52:35 crc kubenswrapper[5120]: I0316 15:52:35.216381 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8eaa6732-ebd3-4742-9203-84bebd18dd15-nova-metadata-tls-certs" (OuterVolumeSpecName: "nova-metadata-tls-certs") pod "8eaa6732-ebd3-4742-9203-84bebd18dd15" (UID: "8eaa6732-ebd3-4742-9203-84bebd18dd15"). InnerVolumeSpecName "nova-metadata-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:52:35 crc kubenswrapper[5120]: I0316 15:52:35.235390 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8eaa6732-ebd3-4742-9203-84bebd18dd15-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "8eaa6732-ebd3-4742-9203-84bebd18dd15" (UID: "8eaa6732-ebd3-4742-9203-84bebd18dd15"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:52:35 crc kubenswrapper[5120]: I0316 15:52:35.255173 5120 reconciler_common.go:299] "Volume detached for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/8eaa6732-ebd3-4742-9203-84bebd18dd15-nova-metadata-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 15:52:35 crc kubenswrapper[5120]: I0316 15:52:35.255200 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8eaa6732-ebd3-4742-9203-84bebd18dd15-logs\") on node \"crc\" DevicePath \"\"" Mar 16 15:52:35 crc kubenswrapper[5120]: I0316 15:52:35.255210 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8eaa6732-ebd3-4742-9203-84bebd18dd15-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:52:35 crc kubenswrapper[5120]: I0316 15:52:35.255221 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8eaa6732-ebd3-4742-9203-84bebd18dd15-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 15:52:35 crc kubenswrapper[5120]: I0316 15:52:35.255231 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sdrxh\" (UniqueName: \"kubernetes.io/projected/8eaa6732-ebd3-4742-9203-84bebd18dd15-kube-api-access-sdrxh\") on node \"crc\" DevicePath \"\"" Mar 16 15:52:35 crc kubenswrapper[5120]: I0316 15:52:35.612804 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:52:35 crc kubenswrapper[5120]: I0316 15:52:35.612922 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"8eaa6732-ebd3-4742-9203-84bebd18dd15","Type":"ContainerDied","Data":"47e04c3f5188807bb3c471e77e5713b09c07675d26cf2e245c20e29d9f54c71f"} Mar 16 15:52:35 crc kubenswrapper[5120]: I0316 15:52:35.613001 5120 scope.go:117] "RemoveContainer" containerID="7c1bd5d391982be09e08f3f68f30e5a0cabc77bd3f3dcf9e5026528dcf2c1804" Mar 16 15:52:35 crc kubenswrapper[5120]: I0316 15:52:35.616289 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="aba40463-9218-4b84-a98c-26f91ef97b87" containerName="nova-scheduler-scheduler" containerID="cri-o://06724a84859bf281d1597e0c35110c21518005ce31218283e2d04367057d3fc6" gracePeriod=30 Mar 16 15:52:35 crc kubenswrapper[5120]: I0316 15:52:35.616800 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"387f81d1-6a19-4250-b210-26daff7cbdc9","Type":"ContainerStarted","Data":"6211858e25939c70614a9fad4891a628b70c8d2b4ada38adb2b8bd841a424715"} Mar 16 15:52:35 crc kubenswrapper[5120]: I0316 15:52:35.617252 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 15:52:35 crc kubenswrapper[5120]: I0316 15:52:35.648942 5120 scope.go:117] "RemoveContainer" containerID="e88ffd81a0d81e36e693104ea5aeaf43cb3b7f232a52069a4d81d78d12a9954f" Mar 16 15:52:35 crc kubenswrapper[5120]: I0316 15:52:35.649658 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podStartSLOduration=2.649642284 podStartE2EDuration="2.649642284s" podCreationTimestamp="2026-03-16 15:52:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:52:35.644874353 +0000 UTC m=+1257.798806010" watchObservedRunningTime="2026-03-16 15:52:35.649642284 +0000 UTC m=+1257.803573951" Mar 16 15:52:35 crc kubenswrapper[5120]: I0316 15:52:35.675961 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 15:52:35 crc kubenswrapper[5120]: I0316 15:52:35.690704 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 15:52:35 crc kubenswrapper[5120]: I0316 15:52:35.703288 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 15:52:35 crc kubenswrapper[5120]: I0316 15:52:35.709096 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8eaa6732-ebd3-4742-9203-84bebd18dd15" containerName="nova-metadata-metadata" Mar 16 15:52:35 crc kubenswrapper[5120]: I0316 15:52:35.709128 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8eaa6732-ebd3-4742-9203-84bebd18dd15" containerName="nova-metadata-metadata" Mar 16 15:52:35 crc kubenswrapper[5120]: I0316 15:52:35.709209 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8eaa6732-ebd3-4742-9203-84bebd18dd15" containerName="nova-metadata-log" Mar 16 15:52:35 crc kubenswrapper[5120]: I0316 15:52:35.709216 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8eaa6732-ebd3-4742-9203-84bebd18dd15" containerName="nova-metadata-log" Mar 16 15:52:35 crc kubenswrapper[5120]: I0316 15:52:35.709395 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="8eaa6732-ebd3-4742-9203-84bebd18dd15" containerName="nova-metadata-metadata" Mar 16 15:52:35 crc kubenswrapper[5120]: I0316 15:52:35.709412 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="8eaa6732-ebd3-4742-9203-84bebd18dd15" containerName="nova-metadata-log" Mar 16 15:52:35 crc kubenswrapper[5120]: I0316 15:52:35.718420 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:52:35 crc kubenswrapper[5120]: I0316 15:52:35.720899 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-metadata-config-data\"" Mar 16 15:52:35 crc kubenswrapper[5120]: I0316 15:52:35.721118 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-metadata-internal-svc\"" Mar 16 15:52:35 crc kubenswrapper[5120]: I0316 15:52:35.721175 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 15:52:35 crc kubenswrapper[5120]: I0316 15:52:35.763948 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c71e60fb-75b4-4e87-87f8-949ab6109fff-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"c71e60fb-75b4-4e87-87f8-949ab6109fff\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:52:35 crc kubenswrapper[5120]: I0316 15:52:35.764049 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4t6zm\" (UniqueName: \"kubernetes.io/projected/c71e60fb-75b4-4e87-87f8-949ab6109fff-kube-api-access-4t6zm\") pod \"nova-metadata-0\" (UID: \"c71e60fb-75b4-4e87-87f8-949ab6109fff\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:52:35 crc kubenswrapper[5120]: I0316 15:52:35.764158 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c71e60fb-75b4-4e87-87f8-949ab6109fff-config-data\") pod \"nova-metadata-0\" (UID: \"c71e60fb-75b4-4e87-87f8-949ab6109fff\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:52:35 crc kubenswrapper[5120]: I0316 15:52:35.764239 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/c71e60fb-75b4-4e87-87f8-949ab6109fff-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"c71e60fb-75b4-4e87-87f8-949ab6109fff\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:52:35 crc kubenswrapper[5120]: I0316 15:52:35.764333 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c71e60fb-75b4-4e87-87f8-949ab6109fff-logs\") pod \"nova-metadata-0\" (UID: \"c71e60fb-75b4-4e87-87f8-949ab6109fff\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:52:35 crc kubenswrapper[5120]: I0316 15:52:35.866293 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c71e60fb-75b4-4e87-87f8-949ab6109fff-config-data\") pod \"nova-metadata-0\" (UID: \"c71e60fb-75b4-4e87-87f8-949ab6109fff\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:52:35 crc kubenswrapper[5120]: I0316 15:52:35.866356 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/c71e60fb-75b4-4e87-87f8-949ab6109fff-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"c71e60fb-75b4-4e87-87f8-949ab6109fff\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:52:35 crc kubenswrapper[5120]: I0316 15:52:35.866425 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c71e60fb-75b4-4e87-87f8-949ab6109fff-logs\") pod \"nova-metadata-0\" (UID: \"c71e60fb-75b4-4e87-87f8-949ab6109fff\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:52:35 crc kubenswrapper[5120]: I0316 15:52:35.866516 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c71e60fb-75b4-4e87-87f8-949ab6109fff-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"c71e60fb-75b4-4e87-87f8-949ab6109fff\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:52:35 crc kubenswrapper[5120]: I0316 15:52:35.866598 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4t6zm\" (UniqueName: \"kubernetes.io/projected/c71e60fb-75b4-4e87-87f8-949ab6109fff-kube-api-access-4t6zm\") pod \"nova-metadata-0\" (UID: \"c71e60fb-75b4-4e87-87f8-949ab6109fff\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:52:35 crc kubenswrapper[5120]: I0316 15:52:35.867868 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c71e60fb-75b4-4e87-87f8-949ab6109fff-logs\") pod \"nova-metadata-0\" (UID: \"c71e60fb-75b4-4e87-87f8-949ab6109fff\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:52:35 crc kubenswrapper[5120]: I0316 15:52:35.871376 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c71e60fb-75b4-4e87-87f8-949ab6109fff-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"c71e60fb-75b4-4e87-87f8-949ab6109fff\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:52:35 crc kubenswrapper[5120]: I0316 15:52:35.871592 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/c71e60fb-75b4-4e87-87f8-949ab6109fff-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"c71e60fb-75b4-4e87-87f8-949ab6109fff\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:52:35 crc kubenswrapper[5120]: I0316 15:52:35.872202 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c71e60fb-75b4-4e87-87f8-949ab6109fff-config-data\") pod \"nova-metadata-0\" (UID: \"c71e60fb-75b4-4e87-87f8-949ab6109fff\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:52:35 crc kubenswrapper[5120]: I0316 15:52:35.889334 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4t6zm\" (UniqueName: \"kubernetes.io/projected/c71e60fb-75b4-4e87-87f8-949ab6109fff-kube-api-access-4t6zm\") pod \"nova-metadata-0\" (UID: \"c71e60fb-75b4-4e87-87f8-949ab6109fff\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:52:36 crc kubenswrapper[5120]: I0316 15:52:36.069353 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:52:36 crc kubenswrapper[5120]: I0316 15:52:36.559911 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 15:52:36 crc kubenswrapper[5120]: I0316 15:52:36.631996 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"c71e60fb-75b4-4e87-87f8-949ab6109fff","Type":"ContainerStarted","Data":"eab79f1cd9dedeeeda1c95259b8b870d2db4a901594cde81aa021defa2a7e12a"} Mar 16 15:52:36 crc kubenswrapper[5120]: I0316 15:52:36.687786 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8eaa6732-ebd3-4742-9203-84bebd18dd15" path="/var/lib/kubelet/pods/8eaa6732-ebd3-4742-9203-84bebd18dd15/volumes" Mar 16 15:52:37 crc kubenswrapper[5120]: I0316 15:52:37.651474 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"c71e60fb-75b4-4e87-87f8-949ab6109fff","Type":"ContainerStarted","Data":"25f72262d2ce8347e4d2db02c0e4aa8f57350ecb59f2d535a4229dd8b5d5cad5"} Mar 16 15:52:37 crc kubenswrapper[5120]: I0316 15:52:37.651952 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"c71e60fb-75b4-4e87-87f8-949ab6109fff","Type":"ContainerStarted","Data":"938c954d1b7935bb0fe0fc1de8ab80ac21886768833b5b175a924f31c5b0dbfb"} Mar 16 15:52:37 crc kubenswrapper[5120]: I0316 15:52:37.691689 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=2.691652377 podStartE2EDuration="2.691652377s" podCreationTimestamp="2026-03-16 15:52:35 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:52:37.67005678 +0000 UTC m=+1259.823988447" watchObservedRunningTime="2026-03-16 15:52:37.691652377 +0000 UTC m=+1259.845584094" Mar 16 15:52:39 crc kubenswrapper[5120]: I0316 15:52:39.674379 5120 generic.go:358] "Generic (PLEG): container finished" podID="df668a23-68e4-44f4-afcc-1eeed64cd2df" containerID="e707de9127a64e0e7769016009983f29608dc79888c5255baba924948c601a83" exitCode=0 Mar 16 15:52:39 crc kubenswrapper[5120]: I0316 15:52:39.674456 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"df668a23-68e4-44f4-afcc-1eeed64cd2df","Type":"ContainerDied","Data":"e707de9127a64e0e7769016009983f29608dc79888c5255baba924948c601a83"} Mar 16 15:52:39 crc kubenswrapper[5120]: E0316 15:52:39.683202 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 06724a84859bf281d1597e0c35110c21518005ce31218283e2d04367057d3fc6 is running failed: container process not found" containerID="06724a84859bf281d1597e0c35110c21518005ce31218283e2d04367057d3fc6" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 15:52:39 crc kubenswrapper[5120]: E0316 15:52:39.683642 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 06724a84859bf281d1597e0c35110c21518005ce31218283e2d04367057d3fc6 is running failed: container process not found" containerID="06724a84859bf281d1597e0c35110c21518005ce31218283e2d04367057d3fc6" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 15:52:39 crc kubenswrapper[5120]: E0316 15:52:39.683866 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 06724a84859bf281d1597e0c35110c21518005ce31218283e2d04367057d3fc6 is running failed: container process not found" containerID="06724a84859bf281d1597e0c35110c21518005ce31218283e2d04367057d3fc6" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 15:52:39 crc kubenswrapper[5120]: E0316 15:52:39.683922 5120 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 06724a84859bf281d1597e0c35110c21518005ce31218283e2d04367057d3fc6 is running failed: container process not found" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="aba40463-9218-4b84-a98c-26f91ef97b87" containerName="nova-scheduler-scheduler" probeResult="unknown" Mar 16 15:52:39 crc kubenswrapper[5120]: I0316 15:52:39.791123 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:52:39 crc kubenswrapper[5120]: I0316 15:52:39.949562 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mll67\" (UniqueName: \"kubernetes.io/projected/df668a23-68e4-44f4-afcc-1eeed64cd2df-kube-api-access-mll67\") pod \"df668a23-68e4-44f4-afcc-1eeed64cd2df\" (UID: \"df668a23-68e4-44f4-afcc-1eeed64cd2df\") " Mar 16 15:52:39 crc kubenswrapper[5120]: I0316 15:52:39.949649 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/df668a23-68e4-44f4-afcc-1eeed64cd2df-combined-ca-bundle\") pod \"df668a23-68e4-44f4-afcc-1eeed64cd2df\" (UID: \"df668a23-68e4-44f4-afcc-1eeed64cd2df\") " Mar 16 15:52:39 crc kubenswrapper[5120]: I0316 15:52:39.949719 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/df668a23-68e4-44f4-afcc-1eeed64cd2df-logs\") pod \"df668a23-68e4-44f4-afcc-1eeed64cd2df\" (UID: \"df668a23-68e4-44f4-afcc-1eeed64cd2df\") " Mar 16 15:52:39 crc kubenswrapper[5120]: I0316 15:52:39.949849 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/df668a23-68e4-44f4-afcc-1eeed64cd2df-config-data\") pod \"df668a23-68e4-44f4-afcc-1eeed64cd2df\" (UID: \"df668a23-68e4-44f4-afcc-1eeed64cd2df\") " Mar 16 15:52:39 crc kubenswrapper[5120]: I0316 15:52:39.950285 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df668a23-68e4-44f4-afcc-1eeed64cd2df-logs" (OuterVolumeSpecName: "logs") pod "df668a23-68e4-44f4-afcc-1eeed64cd2df" (UID: "df668a23-68e4-44f4-afcc-1eeed64cd2df"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:52:39 crc kubenswrapper[5120]: I0316 15:52:39.955428 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df668a23-68e4-44f4-afcc-1eeed64cd2df-kube-api-access-mll67" (OuterVolumeSpecName: "kube-api-access-mll67") pod "df668a23-68e4-44f4-afcc-1eeed64cd2df" (UID: "df668a23-68e4-44f4-afcc-1eeed64cd2df"). InnerVolumeSpecName "kube-api-access-mll67". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:52:39 crc kubenswrapper[5120]: I0316 15:52:39.976608 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/df668a23-68e4-44f4-afcc-1eeed64cd2df-config-data" (OuterVolumeSpecName: "config-data") pod "df668a23-68e4-44f4-afcc-1eeed64cd2df" (UID: "df668a23-68e4-44f4-afcc-1eeed64cd2df"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:52:39 crc kubenswrapper[5120]: I0316 15:52:39.986188 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/df668a23-68e4-44f4-afcc-1eeed64cd2df-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "df668a23-68e4-44f4-afcc-1eeed64cd2df" (UID: "df668a23-68e4-44f4-afcc-1eeed64cd2df"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:52:40 crc kubenswrapper[5120]: I0316 15:52:40.041225 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 15:52:40 crc kubenswrapper[5120]: I0316 15:52:40.051923 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/df668a23-68e4-44f4-afcc-1eeed64cd2df-logs\") on node \"crc\" DevicePath \"\"" Mar 16 15:52:40 crc kubenswrapper[5120]: I0316 15:52:40.051953 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/df668a23-68e4-44f4-afcc-1eeed64cd2df-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 15:52:40 crc kubenswrapper[5120]: I0316 15:52:40.051963 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mll67\" (UniqueName: \"kubernetes.io/projected/df668a23-68e4-44f4-afcc-1eeed64cd2df-kube-api-access-mll67\") on node \"crc\" DevicePath \"\"" Mar 16 15:52:40 crc kubenswrapper[5120]: I0316 15:52:40.051972 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/df668a23-68e4-44f4-afcc-1eeed64cd2df-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:52:40 crc kubenswrapper[5120]: I0316 15:52:40.153167 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q5qvb\" (UniqueName: \"kubernetes.io/projected/aba40463-9218-4b84-a98c-26f91ef97b87-kube-api-access-q5qvb\") pod \"aba40463-9218-4b84-a98c-26f91ef97b87\" (UID: \"aba40463-9218-4b84-a98c-26f91ef97b87\") " Mar 16 15:52:40 crc kubenswrapper[5120]: I0316 15:52:40.153271 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/aba40463-9218-4b84-a98c-26f91ef97b87-config-data\") pod \"aba40463-9218-4b84-a98c-26f91ef97b87\" (UID: \"aba40463-9218-4b84-a98c-26f91ef97b87\") " Mar 16 15:52:40 crc kubenswrapper[5120]: I0316 15:52:40.153351 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/aba40463-9218-4b84-a98c-26f91ef97b87-combined-ca-bundle\") pod \"aba40463-9218-4b84-a98c-26f91ef97b87\" (UID: \"aba40463-9218-4b84-a98c-26f91ef97b87\") " Mar 16 15:52:40 crc kubenswrapper[5120]: I0316 15:52:40.156508 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aba40463-9218-4b84-a98c-26f91ef97b87-kube-api-access-q5qvb" (OuterVolumeSpecName: "kube-api-access-q5qvb") pod "aba40463-9218-4b84-a98c-26f91ef97b87" (UID: "aba40463-9218-4b84-a98c-26f91ef97b87"). InnerVolumeSpecName "kube-api-access-q5qvb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:52:40 crc kubenswrapper[5120]: I0316 15:52:40.177342 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aba40463-9218-4b84-a98c-26f91ef97b87-config-data" (OuterVolumeSpecName: "config-data") pod "aba40463-9218-4b84-a98c-26f91ef97b87" (UID: "aba40463-9218-4b84-a98c-26f91ef97b87"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:52:40 crc kubenswrapper[5120]: I0316 15:52:40.180689 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aba40463-9218-4b84-a98c-26f91ef97b87-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "aba40463-9218-4b84-a98c-26f91ef97b87" (UID: "aba40463-9218-4b84-a98c-26f91ef97b87"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:52:40 crc kubenswrapper[5120]: I0316 15:52:40.255916 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/aba40463-9218-4b84-a98c-26f91ef97b87-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 15:52:40 crc kubenswrapper[5120]: I0316 15:52:40.256177 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/aba40463-9218-4b84-a98c-26f91ef97b87-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:52:40 crc kubenswrapper[5120]: I0316 15:52:40.256187 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q5qvb\" (UniqueName: \"kubernetes.io/projected/aba40463-9218-4b84-a98c-26f91ef97b87-kube-api-access-q5qvb\") on node \"crc\" DevicePath \"\"" Mar 16 15:52:40 crc kubenswrapper[5120]: I0316 15:52:40.686926 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:52:40 crc kubenswrapper[5120]: I0316 15:52:40.686963 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"df668a23-68e4-44f4-afcc-1eeed64cd2df","Type":"ContainerDied","Data":"cbc4d58da5cad7c00fe59ec1d826f3a5cb4087e958e2c8f97218d56ddebc4c87"} Mar 16 15:52:40 crc kubenswrapper[5120]: I0316 15:52:40.687958 5120 scope.go:117] "RemoveContainer" containerID="e707de9127a64e0e7769016009983f29608dc79888c5255baba924948c601a83" Mar 16 15:52:40 crc kubenswrapper[5120]: I0316 15:52:40.689509 5120 generic.go:358] "Generic (PLEG): container finished" podID="aba40463-9218-4b84-a98c-26f91ef97b87" containerID="06724a84859bf281d1597e0c35110c21518005ce31218283e2d04367057d3fc6" exitCode=0 Mar 16 15:52:40 crc kubenswrapper[5120]: I0316 15:52:40.689787 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"aba40463-9218-4b84-a98c-26f91ef97b87","Type":"ContainerDied","Data":"06724a84859bf281d1597e0c35110c21518005ce31218283e2d04367057d3fc6"} Mar 16 15:52:40 crc kubenswrapper[5120]: I0316 15:52:40.689816 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"aba40463-9218-4b84-a98c-26f91ef97b87","Type":"ContainerDied","Data":"aa7de5fe1b770e3e295fd6b1170e3564a9061b7c79915060287688b65a249bed"} Mar 16 15:52:40 crc kubenswrapper[5120]: I0316 15:52:40.690078 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 15:52:40 crc kubenswrapper[5120]: I0316 15:52:40.714864 5120 scope.go:117] "RemoveContainer" containerID="5ac8a89dfc135e6a5fb30b53215c9659c3be883386ffef84f1ebf008b87f80b6" Mar 16 15:52:40 crc kubenswrapper[5120]: I0316 15:52:40.746895 5120 scope.go:117] "RemoveContainer" containerID="06724a84859bf281d1597e0c35110c21518005ce31218283e2d04367057d3fc6" Mar 16 15:52:40 crc kubenswrapper[5120]: I0316 15:52:40.747046 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 15:52:40 crc kubenswrapper[5120]: I0316 15:52:40.753565 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 15:52:40 crc kubenswrapper[5120]: I0316 15:52:40.785028 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 15:52:40 crc kubenswrapper[5120]: I0316 15:52:40.787047 5120 scope.go:117] "RemoveContainer" containerID="06724a84859bf281d1597e0c35110c21518005ce31218283e2d04367057d3fc6" Mar 16 15:52:40 crc kubenswrapper[5120]: E0316 15:52:40.787544 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"06724a84859bf281d1597e0c35110c21518005ce31218283e2d04367057d3fc6\": container with ID starting with 06724a84859bf281d1597e0c35110c21518005ce31218283e2d04367057d3fc6 not found: ID does not exist" containerID="06724a84859bf281d1597e0c35110c21518005ce31218283e2d04367057d3fc6" Mar 16 15:52:40 crc kubenswrapper[5120]: I0316 15:52:40.787603 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"06724a84859bf281d1597e0c35110c21518005ce31218283e2d04367057d3fc6"} err="failed to get container status \"06724a84859bf281d1597e0c35110c21518005ce31218283e2d04367057d3fc6\": rpc error: code = NotFound desc = could not find container \"06724a84859bf281d1597e0c35110c21518005ce31218283e2d04367057d3fc6\": container with ID starting with 06724a84859bf281d1597e0c35110c21518005ce31218283e2d04367057d3fc6 not found: ID does not exist" Mar 16 15:52:40 crc kubenswrapper[5120]: I0316 15:52:40.808951 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 15:52:40 crc kubenswrapper[5120]: I0316 15:52:40.826471 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 15:52:40 crc kubenswrapper[5120]: I0316 15:52:40.828002 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aba40463-9218-4b84-a98c-26f91ef97b87" containerName="nova-scheduler-scheduler" Mar 16 15:52:40 crc kubenswrapper[5120]: I0316 15:52:40.828022 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="aba40463-9218-4b84-a98c-26f91ef97b87" containerName="nova-scheduler-scheduler" Mar 16 15:52:40 crc kubenswrapper[5120]: I0316 15:52:40.828041 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df668a23-68e4-44f4-afcc-1eeed64cd2df" containerName="nova-api-log" Mar 16 15:52:40 crc kubenswrapper[5120]: I0316 15:52:40.828047 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="df668a23-68e4-44f4-afcc-1eeed64cd2df" containerName="nova-api-log" Mar 16 15:52:40 crc kubenswrapper[5120]: I0316 15:52:40.828072 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df668a23-68e4-44f4-afcc-1eeed64cd2df" containerName="nova-api-api" Mar 16 15:52:40 crc kubenswrapper[5120]: I0316 15:52:40.828077 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="df668a23-68e4-44f4-afcc-1eeed64cd2df" containerName="nova-api-api" Mar 16 15:52:40 crc kubenswrapper[5120]: I0316 15:52:40.828273 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="aba40463-9218-4b84-a98c-26f91ef97b87" containerName="nova-scheduler-scheduler" Mar 16 15:52:40 crc kubenswrapper[5120]: I0316 15:52:40.828297 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="df668a23-68e4-44f4-afcc-1eeed64cd2df" containerName="nova-api-api" Mar 16 15:52:40 crc kubenswrapper[5120]: I0316 15:52:40.828307 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="df668a23-68e4-44f4-afcc-1eeed64cd2df" containerName="nova-api-log" Mar 16 15:52:40 crc kubenswrapper[5120]: I0316 15:52:40.836797 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 15:52:40 crc kubenswrapper[5120]: I0316 15:52:40.837070 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:52:40 crc kubenswrapper[5120]: I0316 15:52:40.845142 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-config-data\"" Mar 16 15:52:40 crc kubenswrapper[5120]: I0316 15:52:40.850534 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 15:52:40 crc kubenswrapper[5120]: I0316 15:52:40.850663 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 15:52:40 crc kubenswrapper[5120]: I0316 15:52:40.852619 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-scheduler-config-data\"" Mar 16 15:52:40 crc kubenswrapper[5120]: I0316 15:52:40.853282 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 15:52:40 crc kubenswrapper[5120]: I0316 15:52:40.969320 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/14708e2c-1f13-42eb-a497-936d4740e6dd-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"14708e2c-1f13-42eb-a497-936d4740e6dd\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:52:40 crc kubenswrapper[5120]: I0316 15:52:40.969375 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0fe72247-ecd0-4575-b917-8a771cf54c73-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"0fe72247-ecd0-4575-b917-8a771cf54c73\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 15:52:40 crc kubenswrapper[5120]: I0316 15:52:40.969416 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jlgh\" (UniqueName: \"kubernetes.io/projected/14708e2c-1f13-42eb-a497-936d4740e6dd-kube-api-access-4jlgh\") pod \"nova-api-0\" (UID: \"14708e2c-1f13-42eb-a497-936d4740e6dd\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:52:40 crc kubenswrapper[5120]: I0316 15:52:40.969509 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/14708e2c-1f13-42eb-a497-936d4740e6dd-config-data\") pod \"nova-api-0\" (UID: \"14708e2c-1f13-42eb-a497-936d4740e6dd\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:52:40 crc kubenswrapper[5120]: I0316 15:52:40.969547 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s67nf\" (UniqueName: \"kubernetes.io/projected/0fe72247-ecd0-4575-b917-8a771cf54c73-kube-api-access-s67nf\") pod \"nova-scheduler-0\" (UID: \"0fe72247-ecd0-4575-b917-8a771cf54c73\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 15:52:40 crc kubenswrapper[5120]: I0316 15:52:40.969695 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/14708e2c-1f13-42eb-a497-936d4740e6dd-logs\") pod \"nova-api-0\" (UID: \"14708e2c-1f13-42eb-a497-936d4740e6dd\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:52:40 crc kubenswrapper[5120]: I0316 15:52:40.970011 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0fe72247-ecd0-4575-b917-8a771cf54c73-config-data\") pod \"nova-scheduler-0\" (UID: \"0fe72247-ecd0-4575-b917-8a771cf54c73\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 15:52:41 crc kubenswrapper[5120]: I0316 15:52:41.072228 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4jlgh\" (UniqueName: \"kubernetes.io/projected/14708e2c-1f13-42eb-a497-936d4740e6dd-kube-api-access-4jlgh\") pod \"nova-api-0\" (UID: \"14708e2c-1f13-42eb-a497-936d4740e6dd\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:52:41 crc kubenswrapper[5120]: I0316 15:52:41.072515 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/14708e2c-1f13-42eb-a497-936d4740e6dd-config-data\") pod \"nova-api-0\" (UID: \"14708e2c-1f13-42eb-a497-936d4740e6dd\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:52:41 crc kubenswrapper[5120]: I0316 15:52:41.072614 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s67nf\" (UniqueName: \"kubernetes.io/projected/0fe72247-ecd0-4575-b917-8a771cf54c73-kube-api-access-s67nf\") pod \"nova-scheduler-0\" (UID: \"0fe72247-ecd0-4575-b917-8a771cf54c73\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 15:52:41 crc kubenswrapper[5120]: I0316 15:52:41.072704 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/14708e2c-1f13-42eb-a497-936d4740e6dd-logs\") pod \"nova-api-0\" (UID: \"14708e2c-1f13-42eb-a497-936d4740e6dd\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:52:41 crc kubenswrapper[5120]: I0316 15:52:41.072911 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0fe72247-ecd0-4575-b917-8a771cf54c73-config-data\") pod \"nova-scheduler-0\" (UID: \"0fe72247-ecd0-4575-b917-8a771cf54c73\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 15:52:41 crc kubenswrapper[5120]: I0316 15:52:41.073123 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/14708e2c-1f13-42eb-a497-936d4740e6dd-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"14708e2c-1f13-42eb-a497-936d4740e6dd\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:52:41 crc kubenswrapper[5120]: I0316 15:52:41.073179 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/14708e2c-1f13-42eb-a497-936d4740e6dd-logs\") pod \"nova-api-0\" (UID: \"14708e2c-1f13-42eb-a497-936d4740e6dd\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:52:41 crc kubenswrapper[5120]: I0316 15:52:41.073407 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0fe72247-ecd0-4575-b917-8a771cf54c73-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"0fe72247-ecd0-4575-b917-8a771cf54c73\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 15:52:41 crc kubenswrapper[5120]: I0316 15:52:41.077865 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0fe72247-ecd0-4575-b917-8a771cf54c73-config-data\") pod \"nova-scheduler-0\" (UID: \"0fe72247-ecd0-4575-b917-8a771cf54c73\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 15:52:41 crc kubenswrapper[5120]: I0316 15:52:41.079748 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/14708e2c-1f13-42eb-a497-936d4740e6dd-config-data\") pod \"nova-api-0\" (UID: \"14708e2c-1f13-42eb-a497-936d4740e6dd\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:52:41 crc kubenswrapper[5120]: I0316 15:52:41.080889 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/14708e2c-1f13-42eb-a497-936d4740e6dd-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"14708e2c-1f13-42eb-a497-936d4740e6dd\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:52:41 crc kubenswrapper[5120]: I0316 15:52:41.083530 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0fe72247-ecd0-4575-b917-8a771cf54c73-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"0fe72247-ecd0-4575-b917-8a771cf54c73\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 15:52:41 crc kubenswrapper[5120]: I0316 15:52:41.094695 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s67nf\" (UniqueName: \"kubernetes.io/projected/0fe72247-ecd0-4575-b917-8a771cf54c73-kube-api-access-s67nf\") pod \"nova-scheduler-0\" (UID: \"0fe72247-ecd0-4575-b917-8a771cf54c73\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 15:52:41 crc kubenswrapper[5120]: I0316 15:52:41.097031 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jlgh\" (UniqueName: \"kubernetes.io/projected/14708e2c-1f13-42eb-a497-936d4740e6dd-kube-api-access-4jlgh\") pod \"nova-api-0\" (UID: \"14708e2c-1f13-42eb-a497-936d4740e6dd\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:52:41 crc kubenswrapper[5120]: I0316 15:52:41.153406 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:52:41 crc kubenswrapper[5120]: I0316 15:52:41.167354 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 15:52:41 crc kubenswrapper[5120]: W0316 15:52:41.628818 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod14708e2c_1f13_42eb_a497_936d4740e6dd.slice/crio-f9a488602ea07f8b9c26ec638df462ef6a7e30c90acb086e5a4c9aea0c2065cd WatchSource:0}: Error finding container f9a488602ea07f8b9c26ec638df462ef6a7e30c90acb086e5a4c9aea0c2065cd: Status 404 returned error can't find the container with id f9a488602ea07f8b9c26ec638df462ef6a7e30c90acb086e5a4c9aea0c2065cd Mar 16 15:52:41 crc kubenswrapper[5120]: I0316 15:52:41.641186 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 15:52:41 crc kubenswrapper[5120]: I0316 15:52:41.664370 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 15:52:41 crc kubenswrapper[5120]: I0316 15:52:41.681591 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 15:52:41 crc kubenswrapper[5120]: I0316 15:52:41.714330 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"0fe72247-ecd0-4575-b917-8a771cf54c73","Type":"ContainerStarted","Data":"1789240b7342a55308a955f19e4eb98e03ca50c1d8c6e2b97338f54c4c5e3edf"} Mar 16 15:52:41 crc kubenswrapper[5120]: I0316 15:52:41.716347 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"14708e2c-1f13-42eb-a497-936d4740e6dd","Type":"ContainerStarted","Data":"f9a488602ea07f8b9c26ec638df462ef6a7e30c90acb086e5a4c9aea0c2065cd"} Mar 16 15:52:42 crc kubenswrapper[5120]: I0316 15:52:42.398253 5120 scope.go:117] "RemoveContainer" containerID="d80be422f49090c9a88c2c8e79c07b9e48e823ee5b308766ae089a0f7b831bad" Mar 16 15:52:42 crc kubenswrapper[5120]: I0316 15:52:42.682972 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aba40463-9218-4b84-a98c-26f91ef97b87" path="/var/lib/kubelet/pods/aba40463-9218-4b84-a98c-26f91ef97b87/volumes" Mar 16 15:52:42 crc kubenswrapper[5120]: I0316 15:52:42.684379 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="df668a23-68e4-44f4-afcc-1eeed64cd2df" path="/var/lib/kubelet/pods/df668a23-68e4-44f4-afcc-1eeed64cd2df/volumes" Mar 16 15:52:42 crc kubenswrapper[5120]: I0316 15:52:42.734653 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"0fe72247-ecd0-4575-b917-8a771cf54c73","Type":"ContainerStarted","Data":"2d7287fd3073fb997048ec5e0b4370bc45178dc7304d248e4d1e646ddf5d53c2"} Mar 16 15:52:42 crc kubenswrapper[5120]: I0316 15:52:42.754970 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"14708e2c-1f13-42eb-a497-936d4740e6dd","Type":"ContainerStarted","Data":"19433ed16699721c47bc0145ce1b7a985002a978b53eb58e34003d7952113fa0"} Mar 16 15:52:42 crc kubenswrapper[5120]: I0316 15:52:42.755029 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"14708e2c-1f13-42eb-a497-936d4740e6dd","Type":"ContainerStarted","Data":"1f4a64432fb92fcc671b7dd4b1fc066758b00a9a0acdbc7bd202be5dddf2d314"} Mar 16 15:52:42 crc kubenswrapper[5120]: I0316 15:52:42.769332 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-scheduler-0" podStartSLOduration=2.7693119 podStartE2EDuration="2.7693119s" podCreationTimestamp="2026-03-16 15:52:40 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:52:42.758320935 +0000 UTC m=+1264.912252642" watchObservedRunningTime="2026-03-16 15:52:42.7693119 +0000 UTC m=+1264.923243567" Mar 16 15:52:42 crc kubenswrapper[5120]: I0316 15:52:42.792436 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=2.792414188 podStartE2EDuration="2.792414188s" podCreationTimestamp="2026-03-16 15:52:40 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:52:42.778318558 +0000 UTC m=+1264.932250225" watchObservedRunningTime="2026-03-16 15:52:42.792414188 +0000 UTC m=+1264.946345855" Mar 16 15:52:44 crc kubenswrapper[5120]: I0316 15:52:44.249607 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:52:46 crc kubenswrapper[5120]: I0316 15:52:46.071006 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:52:46 crc kubenswrapper[5120]: I0316 15:52:46.071514 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:52:46 crc kubenswrapper[5120]: I0316 15:52:46.167479 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 15:52:47 crc kubenswrapper[5120]: I0316 15:52:47.079972 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="c71e60fb-75b4-4e87-87f8-949ab6109fff" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"https://10.217.0.186:8775/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 15:52:47 crc kubenswrapper[5120]: I0316 15:52:47.080069 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="c71e60fb-75b4-4e87-87f8-949ab6109fff" containerName="nova-metadata-log" probeResult="failure" output="Get \"https://10.217.0.186:8775/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 15:52:47 crc kubenswrapper[5120]: I0316 15:52:47.664471 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 15:52:47 crc kubenswrapper[5120]: I0316 15:52:47.665459 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/kube-state-metrics-0" podUID="7d8e526d-4a8a-465b-bff3-9de49218452e" containerName="kube-state-metrics" containerID="cri-o://70a678e8063eded984b5edcf3f21f9ef1c8fe3556a19f741ac5b0c1afded2ad9" gracePeriod=30 Mar 16 15:52:47 crc kubenswrapper[5120]: I0316 15:52:47.824925 5120 generic.go:358] "Generic (PLEG): container finished" podID="7d8e526d-4a8a-465b-bff3-9de49218452e" containerID="70a678e8063eded984b5edcf3f21f9ef1c8fe3556a19f741ac5b0c1afded2ad9" exitCode=2 Mar 16 15:52:47 crc kubenswrapper[5120]: I0316 15:52:47.825027 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"7d8e526d-4a8a-465b-bff3-9de49218452e","Type":"ContainerDied","Data":"70a678e8063eded984b5edcf3f21f9ef1c8fe3556a19f741ac5b0c1afded2ad9"} Mar 16 15:52:48 crc kubenswrapper[5120]: I0316 15:52:48.147057 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 15:52:48 crc kubenswrapper[5120]: I0316 15:52:48.264010 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n84vz\" (UniqueName: \"kubernetes.io/projected/7d8e526d-4a8a-465b-bff3-9de49218452e-kube-api-access-n84vz\") pod \"7d8e526d-4a8a-465b-bff3-9de49218452e\" (UID: \"7d8e526d-4a8a-465b-bff3-9de49218452e\") " Mar 16 15:52:48 crc kubenswrapper[5120]: I0316 15:52:48.270593 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d8e526d-4a8a-465b-bff3-9de49218452e-kube-api-access-n84vz" (OuterVolumeSpecName: "kube-api-access-n84vz") pod "7d8e526d-4a8a-465b-bff3-9de49218452e" (UID: "7d8e526d-4a8a-465b-bff3-9de49218452e"). InnerVolumeSpecName "kube-api-access-n84vz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:52:48 crc kubenswrapper[5120]: I0316 15:52:48.365779 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n84vz\" (UniqueName: \"kubernetes.io/projected/7d8e526d-4a8a-465b-bff3-9de49218452e-kube-api-access-n84vz\") on node \"crc\" DevicePath \"\"" Mar 16 15:52:48 crc kubenswrapper[5120]: I0316 15:52:48.865298 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 15:52:48 crc kubenswrapper[5120]: I0316 15:52:48.865378 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"7d8e526d-4a8a-465b-bff3-9de49218452e","Type":"ContainerDied","Data":"ca996dbc39852f350f4b70bb10612ae49ec53cd462a9bd87bed21dbbaeeb34b8"} Mar 16 15:52:48 crc kubenswrapper[5120]: I0316 15:52:48.865469 5120 scope.go:117] "RemoveContainer" containerID="70a678e8063eded984b5edcf3f21f9ef1c8fe3556a19f741ac5b0c1afded2ad9" Mar 16 15:52:48 crc kubenswrapper[5120]: I0316 15:52:48.893923 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 15:52:48 crc kubenswrapper[5120]: I0316 15:52:48.921652 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 15:52:48 crc kubenswrapper[5120]: I0316 15:52:48.935308 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 15:52:48 crc kubenswrapper[5120]: I0316 15:52:48.937298 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d8e526d-4a8a-465b-bff3-9de49218452e" containerName="kube-state-metrics" Mar 16 15:52:48 crc kubenswrapper[5120]: I0316 15:52:48.937328 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d8e526d-4a8a-465b-bff3-9de49218452e" containerName="kube-state-metrics" Mar 16 15:52:48 crc kubenswrapper[5120]: I0316 15:52:48.937649 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7d8e526d-4a8a-465b-bff3-9de49218452e" containerName="kube-state-metrics" Mar 16 15:52:48 crc kubenswrapper[5120]: I0316 15:52:48.944536 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 15:52:48 crc kubenswrapper[5120]: I0316 15:52:48.946665 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 15:52:48 crc kubenswrapper[5120]: I0316 15:52:48.948271 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-kube-state-metrics-svc\"" Mar 16 15:52:48 crc kubenswrapper[5120]: I0316 15:52:48.948332 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"kube-state-metrics-tls-config\"" Mar 16 15:52:49 crc kubenswrapper[5120]: I0316 15:52:49.080544 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55h6z\" (UniqueName: \"kubernetes.io/projected/ae15ab63-33c1-4085-809f-5b1b4086b95b-kube-api-access-55h6z\") pod \"kube-state-metrics-0\" (UID: \"ae15ab63-33c1-4085-809f-5b1b4086b95b\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 15:52:49 crc kubenswrapper[5120]: I0316 15:52:49.080626 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ae15ab63-33c1-4085-809f-5b1b4086b95b-combined-ca-bundle\") pod \"kube-state-metrics-0\" (UID: \"ae15ab63-33c1-4085-809f-5b1b4086b95b\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 15:52:49 crc kubenswrapper[5120]: I0316 15:52:49.080690 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/ae15ab63-33c1-4085-809f-5b1b4086b95b-kube-state-metrics-tls-certs\") pod \"kube-state-metrics-0\" (UID: \"ae15ab63-33c1-4085-809f-5b1b4086b95b\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 15:52:49 crc kubenswrapper[5120]: I0316 15:52:49.080719 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/ae15ab63-33c1-4085-809f-5b1b4086b95b-kube-state-metrics-tls-config\") pod \"kube-state-metrics-0\" (UID: \"ae15ab63-33c1-4085-809f-5b1b4086b95b\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 15:52:49 crc kubenswrapper[5120]: I0316 15:52:49.182733 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-55h6z\" (UniqueName: \"kubernetes.io/projected/ae15ab63-33c1-4085-809f-5b1b4086b95b-kube-api-access-55h6z\") pod \"kube-state-metrics-0\" (UID: \"ae15ab63-33c1-4085-809f-5b1b4086b95b\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 15:52:49 crc kubenswrapper[5120]: I0316 15:52:49.182822 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ae15ab63-33c1-4085-809f-5b1b4086b95b-combined-ca-bundle\") pod \"kube-state-metrics-0\" (UID: \"ae15ab63-33c1-4085-809f-5b1b4086b95b\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 15:52:49 crc kubenswrapper[5120]: I0316 15:52:49.182872 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/ae15ab63-33c1-4085-809f-5b1b4086b95b-kube-state-metrics-tls-certs\") pod \"kube-state-metrics-0\" (UID: \"ae15ab63-33c1-4085-809f-5b1b4086b95b\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 15:52:49 crc kubenswrapper[5120]: I0316 15:52:49.182895 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/ae15ab63-33c1-4085-809f-5b1b4086b95b-kube-state-metrics-tls-config\") pod \"kube-state-metrics-0\" (UID: \"ae15ab63-33c1-4085-809f-5b1b4086b95b\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 15:52:49 crc kubenswrapper[5120]: I0316 15:52:49.188037 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/ae15ab63-33c1-4085-809f-5b1b4086b95b-kube-state-metrics-tls-config\") pod \"kube-state-metrics-0\" (UID: \"ae15ab63-33c1-4085-809f-5b1b4086b95b\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 15:52:49 crc kubenswrapper[5120]: I0316 15:52:49.188473 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/ae15ab63-33c1-4085-809f-5b1b4086b95b-kube-state-metrics-tls-certs\") pod \"kube-state-metrics-0\" (UID: \"ae15ab63-33c1-4085-809f-5b1b4086b95b\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 15:52:49 crc kubenswrapper[5120]: I0316 15:52:49.191665 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ae15ab63-33c1-4085-809f-5b1b4086b95b-combined-ca-bundle\") pod \"kube-state-metrics-0\" (UID: \"ae15ab63-33c1-4085-809f-5b1b4086b95b\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 15:52:49 crc kubenswrapper[5120]: I0316 15:52:49.200532 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-55h6z\" (UniqueName: \"kubernetes.io/projected/ae15ab63-33c1-4085-809f-5b1b4086b95b-kube-api-access-55h6z\") pod \"kube-state-metrics-0\" (UID: \"ae15ab63-33c1-4085-809f-5b1b4086b95b\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 15:52:49 crc kubenswrapper[5120]: I0316 15:52:49.268822 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 15:52:49 crc kubenswrapper[5120]: I0316 15:52:49.425515 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 15:52:49 crc kubenswrapper[5120]: I0316 15:52:49.425849 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="576e3e02-2c64-423f-8a3e-7cde05b41557" containerName="ceilometer-central-agent" containerID="cri-o://095d283334a88a06b2b705b78cd8933a56b348802ba05bc2795773b1360183a0" gracePeriod=30 Mar 16 15:52:49 crc kubenswrapper[5120]: I0316 15:52:49.426322 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="576e3e02-2c64-423f-8a3e-7cde05b41557" containerName="proxy-httpd" containerID="cri-o://e3ce806387a91a6da3e97fc6543cd9c4dee6483f63385289d9429d20761fa7a6" gracePeriod=30 Mar 16 15:52:49 crc kubenswrapper[5120]: I0316 15:52:49.426370 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="576e3e02-2c64-423f-8a3e-7cde05b41557" containerName="sg-core" containerID="cri-o://104043f9c638cfe6d20bba1a2a4b1473cdc084966f81057e04047ad434ff3c2f" gracePeriod=30 Mar 16 15:52:49 crc kubenswrapper[5120]: I0316 15:52:49.426402 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="576e3e02-2c64-423f-8a3e-7cde05b41557" containerName="ceilometer-notification-agent" containerID="cri-o://0d761e4d85dee137a8a132f7414f7f53952b5762e66361dca9a22d1e4940211a" gracePeriod=30 Mar 16 15:52:49 crc kubenswrapper[5120]: I0316 15:52:49.740918 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 15:52:49 crc kubenswrapper[5120]: W0316 15:52:49.742461 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podae15ab63_33c1_4085_809f_5b1b4086b95b.slice/crio-12ac7662605f653786af5ebc933e989dfdb3b43eda02ab469afc7c543b519a3a WatchSource:0}: Error finding container 12ac7662605f653786af5ebc933e989dfdb3b43eda02ab469afc7c543b519a3a: Status 404 returned error can't find the container with id 12ac7662605f653786af5ebc933e989dfdb3b43eda02ab469afc7c543b519a3a Mar 16 15:52:49 crc kubenswrapper[5120]: I0316 15:52:49.744493 5120 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Mar 16 15:52:49 crc kubenswrapper[5120]: I0316 15:52:49.876092 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"ae15ab63-33c1-4085-809f-5b1b4086b95b","Type":"ContainerStarted","Data":"12ac7662605f653786af5ebc933e989dfdb3b43eda02ab469afc7c543b519a3a"} Mar 16 15:52:49 crc kubenswrapper[5120]: I0316 15:52:49.880578 5120 generic.go:358] "Generic (PLEG): container finished" podID="576e3e02-2c64-423f-8a3e-7cde05b41557" containerID="e3ce806387a91a6da3e97fc6543cd9c4dee6483f63385289d9429d20761fa7a6" exitCode=0 Mar 16 15:52:49 crc kubenswrapper[5120]: I0316 15:52:49.880620 5120 generic.go:358] "Generic (PLEG): container finished" podID="576e3e02-2c64-423f-8a3e-7cde05b41557" containerID="104043f9c638cfe6d20bba1a2a4b1473cdc084966f81057e04047ad434ff3c2f" exitCode=2 Mar 16 15:52:49 crc kubenswrapper[5120]: I0316 15:52:49.880648 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"576e3e02-2c64-423f-8a3e-7cde05b41557","Type":"ContainerDied","Data":"e3ce806387a91a6da3e97fc6543cd9c4dee6483f63385289d9429d20761fa7a6"} Mar 16 15:52:49 crc kubenswrapper[5120]: I0316 15:52:49.880680 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"576e3e02-2c64-423f-8a3e-7cde05b41557","Type":"ContainerDied","Data":"104043f9c638cfe6d20bba1a2a4b1473cdc084966f81057e04047ad434ff3c2f"} Mar 16 15:52:50 crc kubenswrapper[5120]: I0316 15:52:50.644520 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:52:50 crc kubenswrapper[5120]: I0316 15:52:50.701810 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7d8e526d-4a8a-465b-bff3-9de49218452e" path="/var/lib/kubelet/pods/7d8e526d-4a8a-465b-bff3-9de49218452e/volumes" Mar 16 15:52:50 crc kubenswrapper[5120]: I0316 15:52:50.812941 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nb2j4\" (UniqueName: \"kubernetes.io/projected/576e3e02-2c64-423f-8a3e-7cde05b41557-kube-api-access-nb2j4\") pod \"576e3e02-2c64-423f-8a3e-7cde05b41557\" (UID: \"576e3e02-2c64-423f-8a3e-7cde05b41557\") " Mar 16 15:52:50 crc kubenswrapper[5120]: I0316 15:52:50.813054 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/576e3e02-2c64-423f-8a3e-7cde05b41557-scripts\") pod \"576e3e02-2c64-423f-8a3e-7cde05b41557\" (UID: \"576e3e02-2c64-423f-8a3e-7cde05b41557\") " Mar 16 15:52:50 crc kubenswrapper[5120]: I0316 15:52:50.813153 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/576e3e02-2c64-423f-8a3e-7cde05b41557-combined-ca-bundle\") pod \"576e3e02-2c64-423f-8a3e-7cde05b41557\" (UID: \"576e3e02-2c64-423f-8a3e-7cde05b41557\") " Mar 16 15:52:50 crc kubenswrapper[5120]: I0316 15:52:50.813212 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/576e3e02-2c64-423f-8a3e-7cde05b41557-config-data\") pod \"576e3e02-2c64-423f-8a3e-7cde05b41557\" (UID: \"576e3e02-2c64-423f-8a3e-7cde05b41557\") " Mar 16 15:52:50 crc kubenswrapper[5120]: I0316 15:52:50.813340 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/576e3e02-2c64-423f-8a3e-7cde05b41557-log-httpd\") pod \"576e3e02-2c64-423f-8a3e-7cde05b41557\" (UID: \"576e3e02-2c64-423f-8a3e-7cde05b41557\") " Mar 16 15:52:50 crc kubenswrapper[5120]: I0316 15:52:50.813414 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/576e3e02-2c64-423f-8a3e-7cde05b41557-run-httpd\") pod \"576e3e02-2c64-423f-8a3e-7cde05b41557\" (UID: \"576e3e02-2c64-423f-8a3e-7cde05b41557\") " Mar 16 15:52:50 crc kubenswrapper[5120]: I0316 15:52:50.813456 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/576e3e02-2c64-423f-8a3e-7cde05b41557-sg-core-conf-yaml\") pod \"576e3e02-2c64-423f-8a3e-7cde05b41557\" (UID: \"576e3e02-2c64-423f-8a3e-7cde05b41557\") " Mar 16 15:52:50 crc kubenswrapper[5120]: I0316 15:52:50.813889 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/576e3e02-2c64-423f-8a3e-7cde05b41557-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "576e3e02-2c64-423f-8a3e-7cde05b41557" (UID: "576e3e02-2c64-423f-8a3e-7cde05b41557"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:52:50 crc kubenswrapper[5120]: I0316 15:52:50.813937 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/576e3e02-2c64-423f-8a3e-7cde05b41557-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "576e3e02-2c64-423f-8a3e-7cde05b41557" (UID: "576e3e02-2c64-423f-8a3e-7cde05b41557"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:52:50 crc kubenswrapper[5120]: I0316 15:52:50.814285 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/576e3e02-2c64-423f-8a3e-7cde05b41557-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 15:52:50 crc kubenswrapper[5120]: I0316 15:52:50.814312 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/576e3e02-2c64-423f-8a3e-7cde05b41557-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 15:52:50 crc kubenswrapper[5120]: I0316 15:52:50.822041 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/576e3e02-2c64-423f-8a3e-7cde05b41557-kube-api-access-nb2j4" (OuterVolumeSpecName: "kube-api-access-nb2j4") pod "576e3e02-2c64-423f-8a3e-7cde05b41557" (UID: "576e3e02-2c64-423f-8a3e-7cde05b41557"). InnerVolumeSpecName "kube-api-access-nb2j4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:52:50 crc kubenswrapper[5120]: I0316 15:52:50.838347 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/576e3e02-2c64-423f-8a3e-7cde05b41557-scripts" (OuterVolumeSpecName: "scripts") pod "576e3e02-2c64-423f-8a3e-7cde05b41557" (UID: "576e3e02-2c64-423f-8a3e-7cde05b41557"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:52:50 crc kubenswrapper[5120]: I0316 15:52:50.852668 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/576e3e02-2c64-423f-8a3e-7cde05b41557-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "576e3e02-2c64-423f-8a3e-7cde05b41557" (UID: "576e3e02-2c64-423f-8a3e-7cde05b41557"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:52:50 crc kubenswrapper[5120]: I0316 15:52:50.905864 5120 generic.go:358] "Generic (PLEG): container finished" podID="576e3e02-2c64-423f-8a3e-7cde05b41557" containerID="0d761e4d85dee137a8a132f7414f7f53952b5762e66361dca9a22d1e4940211a" exitCode=0 Mar 16 15:52:50 crc kubenswrapper[5120]: I0316 15:52:50.905931 5120 generic.go:358] "Generic (PLEG): container finished" podID="576e3e02-2c64-423f-8a3e-7cde05b41557" containerID="095d283334a88a06b2b705b78cd8933a56b348802ba05bc2795773b1360183a0" exitCode=0 Mar 16 15:52:50 crc kubenswrapper[5120]: I0316 15:52:50.906093 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:52:50 crc kubenswrapper[5120]: I0316 15:52:50.906306 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"576e3e02-2c64-423f-8a3e-7cde05b41557","Type":"ContainerDied","Data":"0d761e4d85dee137a8a132f7414f7f53952b5762e66361dca9a22d1e4940211a"} Mar 16 15:52:50 crc kubenswrapper[5120]: I0316 15:52:50.906345 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"576e3e02-2c64-423f-8a3e-7cde05b41557","Type":"ContainerDied","Data":"095d283334a88a06b2b705b78cd8933a56b348802ba05bc2795773b1360183a0"} Mar 16 15:52:50 crc kubenswrapper[5120]: I0316 15:52:50.906386 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"576e3e02-2c64-423f-8a3e-7cde05b41557","Type":"ContainerDied","Data":"06dd2e418a111fba6353560d3033b52bb0ced92ee13fa084c7297e343b4ab028"} Mar 16 15:52:50 crc kubenswrapper[5120]: I0316 15:52:50.906408 5120 scope.go:117] "RemoveContainer" containerID="e3ce806387a91a6da3e97fc6543cd9c4dee6483f63385289d9429d20761fa7a6" Mar 16 15:52:50 crc kubenswrapper[5120]: I0316 15:52:50.911701 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"ae15ab63-33c1-4085-809f-5b1b4086b95b","Type":"ContainerStarted","Data":"e07e87fb3cac1808e19af0e91433064ae3fa498e7405a64cbd98e61c6a491bb3"} Mar 16 15:52:50 crc kubenswrapper[5120]: I0316 15:52:50.911813 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 15:52:50 crc kubenswrapper[5120]: I0316 15:52:50.916222 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/576e3e02-2c64-423f-8a3e-7cde05b41557-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 15:52:50 crc kubenswrapper[5120]: I0316 15:52:50.916252 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/576e3e02-2c64-423f-8a3e-7cde05b41557-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 15:52:50 crc kubenswrapper[5120]: I0316 15:52:50.916264 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nb2j4\" (UniqueName: \"kubernetes.io/projected/576e3e02-2c64-423f-8a3e-7cde05b41557-kube-api-access-nb2j4\") on node \"crc\" DevicePath \"\"" Mar 16 15:52:50 crc kubenswrapper[5120]: I0316 15:52:50.933855 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/kube-state-metrics-0" podStartSLOduration=2.534052654 podStartE2EDuration="2.933833116s" podCreationTimestamp="2026-03-16 15:52:48 +0000 UTC" firstStartedPulling="2026-03-16 15:52:49.744745893 +0000 UTC m=+1271.898677550" lastFinishedPulling="2026-03-16 15:52:50.144526355 +0000 UTC m=+1272.298458012" observedRunningTime="2026-03-16 15:52:50.930889254 +0000 UTC m=+1273.084820911" watchObservedRunningTime="2026-03-16 15:52:50.933833116 +0000 UTC m=+1273.087764783" Mar 16 15:52:50 crc kubenswrapper[5120]: I0316 15:52:50.945727 5120 scope.go:117] "RemoveContainer" containerID="104043f9c638cfe6d20bba1a2a4b1473cdc084966f81057e04047ad434ff3c2f" Mar 16 15:52:50 crc kubenswrapper[5120]: I0316 15:52:50.955980 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/576e3e02-2c64-423f-8a3e-7cde05b41557-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "576e3e02-2c64-423f-8a3e-7cde05b41557" (UID: "576e3e02-2c64-423f-8a3e-7cde05b41557"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:52:50 crc kubenswrapper[5120]: I0316 15:52:50.965712 5120 scope.go:117] "RemoveContainer" containerID="0d761e4d85dee137a8a132f7414f7f53952b5762e66361dca9a22d1e4940211a" Mar 16 15:52:50 crc kubenswrapper[5120]: I0316 15:52:50.976447 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/576e3e02-2c64-423f-8a3e-7cde05b41557-config-data" (OuterVolumeSpecName: "config-data") pod "576e3e02-2c64-423f-8a3e-7cde05b41557" (UID: "576e3e02-2c64-423f-8a3e-7cde05b41557"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:52:50 crc kubenswrapper[5120]: I0316 15:52:50.987902 5120 scope.go:117] "RemoveContainer" containerID="095d283334a88a06b2b705b78cd8933a56b348802ba05bc2795773b1360183a0" Mar 16 15:52:51 crc kubenswrapper[5120]: I0316 15:52:51.010385 5120 scope.go:117] "RemoveContainer" containerID="e3ce806387a91a6da3e97fc6543cd9c4dee6483f63385289d9429d20761fa7a6" Mar 16 15:52:51 crc kubenswrapper[5120]: E0316 15:52:51.014223 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e3ce806387a91a6da3e97fc6543cd9c4dee6483f63385289d9429d20761fa7a6\": container with ID starting with e3ce806387a91a6da3e97fc6543cd9c4dee6483f63385289d9429d20761fa7a6 not found: ID does not exist" containerID="e3ce806387a91a6da3e97fc6543cd9c4dee6483f63385289d9429d20761fa7a6" Mar 16 15:52:51 crc kubenswrapper[5120]: I0316 15:52:51.014263 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3ce806387a91a6da3e97fc6543cd9c4dee6483f63385289d9429d20761fa7a6"} err="failed to get container status \"e3ce806387a91a6da3e97fc6543cd9c4dee6483f63385289d9429d20761fa7a6\": rpc error: code = NotFound desc = could not find container \"e3ce806387a91a6da3e97fc6543cd9c4dee6483f63385289d9429d20761fa7a6\": container with ID starting with e3ce806387a91a6da3e97fc6543cd9c4dee6483f63385289d9429d20761fa7a6 not found: ID does not exist" Mar 16 15:52:51 crc kubenswrapper[5120]: I0316 15:52:51.014287 5120 scope.go:117] "RemoveContainer" containerID="104043f9c638cfe6d20bba1a2a4b1473cdc084966f81057e04047ad434ff3c2f" Mar 16 15:52:51 crc kubenswrapper[5120]: E0316 15:52:51.015479 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"104043f9c638cfe6d20bba1a2a4b1473cdc084966f81057e04047ad434ff3c2f\": container with ID starting with 104043f9c638cfe6d20bba1a2a4b1473cdc084966f81057e04047ad434ff3c2f not found: ID does not exist" containerID="104043f9c638cfe6d20bba1a2a4b1473cdc084966f81057e04047ad434ff3c2f" Mar 16 15:52:51 crc kubenswrapper[5120]: I0316 15:52:51.015505 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"104043f9c638cfe6d20bba1a2a4b1473cdc084966f81057e04047ad434ff3c2f"} err="failed to get container status \"104043f9c638cfe6d20bba1a2a4b1473cdc084966f81057e04047ad434ff3c2f\": rpc error: code = NotFound desc = could not find container \"104043f9c638cfe6d20bba1a2a4b1473cdc084966f81057e04047ad434ff3c2f\": container with ID starting with 104043f9c638cfe6d20bba1a2a4b1473cdc084966f81057e04047ad434ff3c2f not found: ID does not exist" Mar 16 15:52:51 crc kubenswrapper[5120]: I0316 15:52:51.015519 5120 scope.go:117] "RemoveContainer" containerID="0d761e4d85dee137a8a132f7414f7f53952b5762e66361dca9a22d1e4940211a" Mar 16 15:52:51 crc kubenswrapper[5120]: E0316 15:52:51.015799 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d761e4d85dee137a8a132f7414f7f53952b5762e66361dca9a22d1e4940211a\": container with ID starting with 0d761e4d85dee137a8a132f7414f7f53952b5762e66361dca9a22d1e4940211a not found: ID does not exist" containerID="0d761e4d85dee137a8a132f7414f7f53952b5762e66361dca9a22d1e4940211a" Mar 16 15:52:51 crc kubenswrapper[5120]: I0316 15:52:51.015821 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d761e4d85dee137a8a132f7414f7f53952b5762e66361dca9a22d1e4940211a"} err="failed to get container status \"0d761e4d85dee137a8a132f7414f7f53952b5762e66361dca9a22d1e4940211a\": rpc error: code = NotFound desc = could not find container \"0d761e4d85dee137a8a132f7414f7f53952b5762e66361dca9a22d1e4940211a\": container with ID starting with 0d761e4d85dee137a8a132f7414f7f53952b5762e66361dca9a22d1e4940211a not found: ID does not exist" Mar 16 15:52:51 crc kubenswrapper[5120]: I0316 15:52:51.015835 5120 scope.go:117] "RemoveContainer" containerID="095d283334a88a06b2b705b78cd8933a56b348802ba05bc2795773b1360183a0" Mar 16 15:52:51 crc kubenswrapper[5120]: I0316 15:52:51.017933 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/576e3e02-2c64-423f-8a3e-7cde05b41557-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:52:51 crc kubenswrapper[5120]: I0316 15:52:51.017954 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/576e3e02-2c64-423f-8a3e-7cde05b41557-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 15:52:51 crc kubenswrapper[5120]: E0316 15:52:51.019196 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"095d283334a88a06b2b705b78cd8933a56b348802ba05bc2795773b1360183a0\": container with ID starting with 095d283334a88a06b2b705b78cd8933a56b348802ba05bc2795773b1360183a0 not found: ID does not exist" containerID="095d283334a88a06b2b705b78cd8933a56b348802ba05bc2795773b1360183a0" Mar 16 15:52:51 crc kubenswrapper[5120]: I0316 15:52:51.019220 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"095d283334a88a06b2b705b78cd8933a56b348802ba05bc2795773b1360183a0"} err="failed to get container status \"095d283334a88a06b2b705b78cd8933a56b348802ba05bc2795773b1360183a0\": rpc error: code = NotFound desc = could not find container \"095d283334a88a06b2b705b78cd8933a56b348802ba05bc2795773b1360183a0\": container with ID starting with 095d283334a88a06b2b705b78cd8933a56b348802ba05bc2795773b1360183a0 not found: ID does not exist" Mar 16 15:52:51 crc kubenswrapper[5120]: I0316 15:52:51.019232 5120 scope.go:117] "RemoveContainer" containerID="e3ce806387a91a6da3e97fc6543cd9c4dee6483f63385289d9429d20761fa7a6" Mar 16 15:52:51 crc kubenswrapper[5120]: I0316 15:52:51.020186 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3ce806387a91a6da3e97fc6543cd9c4dee6483f63385289d9429d20761fa7a6"} err="failed to get container status \"e3ce806387a91a6da3e97fc6543cd9c4dee6483f63385289d9429d20761fa7a6\": rpc error: code = NotFound desc = could not find container \"e3ce806387a91a6da3e97fc6543cd9c4dee6483f63385289d9429d20761fa7a6\": container with ID starting with e3ce806387a91a6da3e97fc6543cd9c4dee6483f63385289d9429d20761fa7a6 not found: ID does not exist" Mar 16 15:52:51 crc kubenswrapper[5120]: I0316 15:52:51.020207 5120 scope.go:117] "RemoveContainer" containerID="104043f9c638cfe6d20bba1a2a4b1473cdc084966f81057e04047ad434ff3c2f" Mar 16 15:52:51 crc kubenswrapper[5120]: I0316 15:52:51.020400 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"104043f9c638cfe6d20bba1a2a4b1473cdc084966f81057e04047ad434ff3c2f"} err="failed to get container status \"104043f9c638cfe6d20bba1a2a4b1473cdc084966f81057e04047ad434ff3c2f\": rpc error: code = NotFound desc = could not find container \"104043f9c638cfe6d20bba1a2a4b1473cdc084966f81057e04047ad434ff3c2f\": container with ID starting with 104043f9c638cfe6d20bba1a2a4b1473cdc084966f81057e04047ad434ff3c2f not found: ID does not exist" Mar 16 15:52:51 crc kubenswrapper[5120]: I0316 15:52:51.020418 5120 scope.go:117] "RemoveContainer" containerID="0d761e4d85dee137a8a132f7414f7f53952b5762e66361dca9a22d1e4940211a" Mar 16 15:52:51 crc kubenswrapper[5120]: I0316 15:52:51.021309 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d761e4d85dee137a8a132f7414f7f53952b5762e66361dca9a22d1e4940211a"} err="failed to get container status \"0d761e4d85dee137a8a132f7414f7f53952b5762e66361dca9a22d1e4940211a\": rpc error: code = NotFound desc = could not find container \"0d761e4d85dee137a8a132f7414f7f53952b5762e66361dca9a22d1e4940211a\": container with ID starting with 0d761e4d85dee137a8a132f7414f7f53952b5762e66361dca9a22d1e4940211a not found: ID does not exist" Mar 16 15:52:51 crc kubenswrapper[5120]: I0316 15:52:51.021329 5120 scope.go:117] "RemoveContainer" containerID="095d283334a88a06b2b705b78cd8933a56b348802ba05bc2795773b1360183a0" Mar 16 15:52:51 crc kubenswrapper[5120]: I0316 15:52:51.021603 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"095d283334a88a06b2b705b78cd8933a56b348802ba05bc2795773b1360183a0"} err="failed to get container status \"095d283334a88a06b2b705b78cd8933a56b348802ba05bc2795773b1360183a0\": rpc error: code = NotFound desc = could not find container \"095d283334a88a06b2b705b78cd8933a56b348802ba05bc2795773b1360183a0\": container with ID starting with 095d283334a88a06b2b705b78cd8933a56b348802ba05bc2795773b1360183a0 not found: ID does not exist" Mar 16 15:52:51 crc kubenswrapper[5120]: I0316 15:52:51.153783 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:52:51 crc kubenswrapper[5120]: I0316 15:52:51.153845 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:52:51 crc kubenswrapper[5120]: I0316 15:52:51.168337 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 15:52:51 crc kubenswrapper[5120]: I0316 15:52:51.197543 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 15:52:51 crc kubenswrapper[5120]: I0316 15:52:51.304176 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 15:52:51 crc kubenswrapper[5120]: I0316 15:52:51.311167 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 15:52:51 crc kubenswrapper[5120]: I0316 15:52:51.342850 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 15:52:51 crc kubenswrapper[5120]: I0316 15:52:51.343746 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="576e3e02-2c64-423f-8a3e-7cde05b41557" containerName="sg-core" Mar 16 15:52:51 crc kubenswrapper[5120]: I0316 15:52:51.343776 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="576e3e02-2c64-423f-8a3e-7cde05b41557" containerName="sg-core" Mar 16 15:52:51 crc kubenswrapper[5120]: I0316 15:52:51.343803 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="576e3e02-2c64-423f-8a3e-7cde05b41557" containerName="ceilometer-central-agent" Mar 16 15:52:51 crc kubenswrapper[5120]: I0316 15:52:51.343809 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="576e3e02-2c64-423f-8a3e-7cde05b41557" containerName="ceilometer-central-agent" Mar 16 15:52:51 crc kubenswrapper[5120]: I0316 15:52:51.343846 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="576e3e02-2c64-423f-8a3e-7cde05b41557" containerName="ceilometer-notification-agent" Mar 16 15:52:51 crc kubenswrapper[5120]: I0316 15:52:51.343852 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="576e3e02-2c64-423f-8a3e-7cde05b41557" containerName="ceilometer-notification-agent" Mar 16 15:52:51 crc kubenswrapper[5120]: I0316 15:52:51.343860 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="576e3e02-2c64-423f-8a3e-7cde05b41557" containerName="proxy-httpd" Mar 16 15:52:51 crc kubenswrapper[5120]: I0316 15:52:51.343865 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="576e3e02-2c64-423f-8a3e-7cde05b41557" containerName="proxy-httpd" Mar 16 15:52:51 crc kubenswrapper[5120]: I0316 15:52:51.344032 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="576e3e02-2c64-423f-8a3e-7cde05b41557" containerName="ceilometer-central-agent" Mar 16 15:52:51 crc kubenswrapper[5120]: I0316 15:52:51.344046 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="576e3e02-2c64-423f-8a3e-7cde05b41557" containerName="ceilometer-notification-agent" Mar 16 15:52:51 crc kubenswrapper[5120]: I0316 15:52:51.344054 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="576e3e02-2c64-423f-8a3e-7cde05b41557" containerName="sg-core" Mar 16 15:52:51 crc kubenswrapper[5120]: I0316 15:52:51.344073 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="576e3e02-2c64-423f-8a3e-7cde05b41557" containerName="proxy-httpd" Mar 16 15:52:51 crc kubenswrapper[5120]: I0316 15:52:51.352112 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:52:51 crc kubenswrapper[5120]: I0316 15:52:51.354259 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 15:52:51 crc kubenswrapper[5120]: I0316 15:52:51.355902 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ceilometer-internal-svc\"" Mar 16 15:52:51 crc kubenswrapper[5120]: I0316 15:52:51.359429 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 15:52:51 crc kubenswrapper[5120]: I0316 15:52:51.367883 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 15:52:51 crc kubenswrapper[5120]: I0316 15:52:51.526870 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/91e78ecc-86d1-40bf-9439-e2bc4399e618-config-data\") pod \"ceilometer-0\" (UID: \"91e78ecc-86d1-40bf-9439-e2bc4399e618\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:52:51 crc kubenswrapper[5120]: I0316 15:52:51.526936 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/91e78ecc-86d1-40bf-9439-e2bc4399e618-scripts\") pod \"ceilometer-0\" (UID: \"91e78ecc-86d1-40bf-9439-e2bc4399e618\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:52:51 crc kubenswrapper[5120]: I0316 15:52:51.526983 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/91e78ecc-86d1-40bf-9439-e2bc4399e618-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"91e78ecc-86d1-40bf-9439-e2bc4399e618\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:52:51 crc kubenswrapper[5120]: I0316 15:52:51.527022 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/91e78ecc-86d1-40bf-9439-e2bc4399e618-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"91e78ecc-86d1-40bf-9439-e2bc4399e618\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:52:51 crc kubenswrapper[5120]: I0316 15:52:51.527050 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8vp6\" (UniqueName: \"kubernetes.io/projected/91e78ecc-86d1-40bf-9439-e2bc4399e618-kube-api-access-x8vp6\") pod \"ceilometer-0\" (UID: \"91e78ecc-86d1-40bf-9439-e2bc4399e618\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:52:51 crc kubenswrapper[5120]: I0316 15:52:51.527095 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/91e78ecc-86d1-40bf-9439-e2bc4399e618-run-httpd\") pod \"ceilometer-0\" (UID: \"91e78ecc-86d1-40bf-9439-e2bc4399e618\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:52:51 crc kubenswrapper[5120]: I0316 15:52:51.527115 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/91e78ecc-86d1-40bf-9439-e2bc4399e618-log-httpd\") pod \"ceilometer-0\" (UID: \"91e78ecc-86d1-40bf-9439-e2bc4399e618\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:52:51 crc kubenswrapper[5120]: I0316 15:52:51.527133 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/91e78ecc-86d1-40bf-9439-e2bc4399e618-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"91e78ecc-86d1-40bf-9439-e2bc4399e618\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:52:51 crc kubenswrapper[5120]: I0316 15:52:51.629393 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/91e78ecc-86d1-40bf-9439-e2bc4399e618-scripts\") pod \"ceilometer-0\" (UID: \"91e78ecc-86d1-40bf-9439-e2bc4399e618\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:52:51 crc kubenswrapper[5120]: I0316 15:52:51.629543 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/91e78ecc-86d1-40bf-9439-e2bc4399e618-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"91e78ecc-86d1-40bf-9439-e2bc4399e618\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:52:51 crc kubenswrapper[5120]: I0316 15:52:51.629636 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/91e78ecc-86d1-40bf-9439-e2bc4399e618-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"91e78ecc-86d1-40bf-9439-e2bc4399e618\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:52:51 crc kubenswrapper[5120]: I0316 15:52:51.629698 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x8vp6\" (UniqueName: \"kubernetes.io/projected/91e78ecc-86d1-40bf-9439-e2bc4399e618-kube-api-access-x8vp6\") pod \"ceilometer-0\" (UID: \"91e78ecc-86d1-40bf-9439-e2bc4399e618\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:52:51 crc kubenswrapper[5120]: I0316 15:52:51.629859 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/91e78ecc-86d1-40bf-9439-e2bc4399e618-run-httpd\") pod \"ceilometer-0\" (UID: \"91e78ecc-86d1-40bf-9439-e2bc4399e618\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:52:51 crc kubenswrapper[5120]: I0316 15:52:51.629920 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/91e78ecc-86d1-40bf-9439-e2bc4399e618-log-httpd\") pod \"ceilometer-0\" (UID: \"91e78ecc-86d1-40bf-9439-e2bc4399e618\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:52:51 crc kubenswrapper[5120]: I0316 15:52:51.629971 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/91e78ecc-86d1-40bf-9439-e2bc4399e618-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"91e78ecc-86d1-40bf-9439-e2bc4399e618\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:52:51 crc kubenswrapper[5120]: I0316 15:52:51.630047 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/91e78ecc-86d1-40bf-9439-e2bc4399e618-config-data\") pod \"ceilometer-0\" (UID: \"91e78ecc-86d1-40bf-9439-e2bc4399e618\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:52:51 crc kubenswrapper[5120]: I0316 15:52:51.630326 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/91e78ecc-86d1-40bf-9439-e2bc4399e618-run-httpd\") pod \"ceilometer-0\" (UID: \"91e78ecc-86d1-40bf-9439-e2bc4399e618\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:52:51 crc kubenswrapper[5120]: I0316 15:52:51.630516 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/91e78ecc-86d1-40bf-9439-e2bc4399e618-log-httpd\") pod \"ceilometer-0\" (UID: \"91e78ecc-86d1-40bf-9439-e2bc4399e618\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:52:51 crc kubenswrapper[5120]: I0316 15:52:51.634961 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/91e78ecc-86d1-40bf-9439-e2bc4399e618-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"91e78ecc-86d1-40bf-9439-e2bc4399e618\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:52:51 crc kubenswrapper[5120]: I0316 15:52:51.636171 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/91e78ecc-86d1-40bf-9439-e2bc4399e618-scripts\") pod \"ceilometer-0\" (UID: \"91e78ecc-86d1-40bf-9439-e2bc4399e618\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:52:51 crc kubenswrapper[5120]: I0316 15:52:51.636356 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/91e78ecc-86d1-40bf-9439-e2bc4399e618-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"91e78ecc-86d1-40bf-9439-e2bc4399e618\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:52:51 crc kubenswrapper[5120]: I0316 15:52:51.637145 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/91e78ecc-86d1-40bf-9439-e2bc4399e618-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"91e78ecc-86d1-40bf-9439-e2bc4399e618\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:52:51 crc kubenswrapper[5120]: I0316 15:52:51.637956 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/91e78ecc-86d1-40bf-9439-e2bc4399e618-config-data\") pod \"ceilometer-0\" (UID: \"91e78ecc-86d1-40bf-9439-e2bc4399e618\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:52:51 crc kubenswrapper[5120]: I0316 15:52:51.649199 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8vp6\" (UniqueName: \"kubernetes.io/projected/91e78ecc-86d1-40bf-9439-e2bc4399e618-kube-api-access-x8vp6\") pod \"ceilometer-0\" (UID: \"91e78ecc-86d1-40bf-9439-e2bc4399e618\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:52:51 crc kubenswrapper[5120]: I0316 15:52:51.667134 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:52:51 crc kubenswrapper[5120]: I0316 15:52:51.949518 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 15:52:51 crc kubenswrapper[5120]: I0316 15:52:51.977800 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 15:52:52 crc kubenswrapper[5120]: I0316 15:52:52.195172 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="14708e2c-1f13-42eb-a497-936d4740e6dd" containerName="nova-api-api" probeResult="failure" output="Get \"http://10.217.0.187:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 15:52:52 crc kubenswrapper[5120]: I0316 15:52:52.195148 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="14708e2c-1f13-42eb-a497-936d4740e6dd" containerName="nova-api-log" probeResult="failure" output="Get \"http://10.217.0.187:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 15:52:52 crc kubenswrapper[5120]: I0316 15:52:52.688197 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="576e3e02-2c64-423f-8a3e-7cde05b41557" path="/var/lib/kubelet/pods/576e3e02-2c64-423f-8a3e-7cde05b41557/volumes" Mar 16 15:52:52 crc kubenswrapper[5120]: I0316 15:52:52.936456 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"91e78ecc-86d1-40bf-9439-e2bc4399e618","Type":"ContainerStarted","Data":"4783c691fb2f63827594acd9038cc1b91a8b22f98662baa104daa79b690e2b8a"} Mar 16 15:52:52 crc kubenswrapper[5120]: I0316 15:52:52.936803 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"91e78ecc-86d1-40bf-9439-e2bc4399e618","Type":"ContainerStarted","Data":"8ff9287d7fefb5ca16eede53933e113c744c58258551e300f26495eb8872de1e"} Mar 16 15:52:53 crc kubenswrapper[5120]: I0316 15:52:53.947467 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"91e78ecc-86d1-40bf-9439-e2bc4399e618","Type":"ContainerStarted","Data":"0dde6591318ad2978c619451bb88edc14424e66c9081838e3f0f0561383c7656"} Mar 16 15:52:54 crc kubenswrapper[5120]: I0316 15:52:54.070779 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:52:54 crc kubenswrapper[5120]: I0316 15:52:54.070837 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:52:54 crc kubenswrapper[5120]: I0316 15:52:54.956722 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"91e78ecc-86d1-40bf-9439-e2bc4399e618","Type":"ContainerStarted","Data":"0a7cab07a808d59132a63e46509dc54b6ddbeec5e2bf80ef31629dad7d3c66c3"} Mar 16 15:52:56 crc kubenswrapper[5120]: I0316 15:52:56.076549 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:52:56 crc kubenswrapper[5120]: I0316 15:52:56.082948 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:52:56 crc kubenswrapper[5120]: I0316 15:52:56.083797 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:52:56 crc kubenswrapper[5120]: I0316 15:52:56.995422 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:52:58 crc kubenswrapper[5120]: I0316 15:52:58.013585 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"91e78ecc-86d1-40bf-9439-e2bc4399e618","Type":"ContainerStarted","Data":"e0b27f0c1e31c7a8c27ad471814d139d40fcb6724b17d3be1b539002a8a8b111"} Mar 16 15:52:58 crc kubenswrapper[5120]: I0316 15:52:58.014178 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:52:58 crc kubenswrapper[5120]: I0316 15:52:58.052219 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=1.864006994 podStartE2EDuration="7.052191694s" podCreationTimestamp="2026-03-16 15:52:51 +0000 UTC" firstStartedPulling="2026-03-16 15:52:51.967794386 +0000 UTC m=+1274.121726043" lastFinishedPulling="2026-03-16 15:52:57.155979076 +0000 UTC m=+1279.309910743" observedRunningTime="2026-03-16 15:52:58.044497182 +0000 UTC m=+1280.198428849" watchObservedRunningTime="2026-03-16 15:52:58.052191694 +0000 UTC m=+1280.206123391" Mar 16 15:52:59 crc kubenswrapper[5120]: I0316 15:52:59.029235 5120 generic.go:358] "Generic (PLEG): container finished" podID="4bdf4d32-2df6-4db1-8819-bae92ef9690d" containerID="bab718c240e7715476594adb89e1d45b92b2cfad75e656245dc41aa5d292445a" exitCode=137 Mar 16 15:52:59 crc kubenswrapper[5120]: I0316 15:52:59.029335 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"4bdf4d32-2df6-4db1-8819-bae92ef9690d","Type":"ContainerDied","Data":"bab718c240e7715476594adb89e1d45b92b2cfad75e656245dc41aa5d292445a"} Mar 16 15:52:59 crc kubenswrapper[5120]: I0316 15:52:59.029995 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"4bdf4d32-2df6-4db1-8819-bae92ef9690d","Type":"ContainerDied","Data":"bd1afe2a85e91182a0bcb5031ee3daa64e4e34c63b598a1663e1b326f79e1386"} Mar 16 15:52:59 crc kubenswrapper[5120]: I0316 15:52:59.030015 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bd1afe2a85e91182a0bcb5031ee3daa64e4e34c63b598a1663e1b326f79e1386" Mar 16 15:52:59 crc kubenswrapper[5120]: I0316 15:52:59.064180 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 15:52:59 crc kubenswrapper[5120]: I0316 15:52:59.069718 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4bdf4d32-2df6-4db1-8819-bae92ef9690d-combined-ca-bundle\") pod \"4bdf4d32-2df6-4db1-8819-bae92ef9690d\" (UID: \"4bdf4d32-2df6-4db1-8819-bae92ef9690d\") " Mar 16 15:52:59 crc kubenswrapper[5120]: I0316 15:52:59.069863 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4bdf4d32-2df6-4db1-8819-bae92ef9690d-config-data\") pod \"4bdf4d32-2df6-4db1-8819-bae92ef9690d\" (UID: \"4bdf4d32-2df6-4db1-8819-bae92ef9690d\") " Mar 16 15:52:59 crc kubenswrapper[5120]: I0316 15:52:59.069971 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hprlg\" (UniqueName: \"kubernetes.io/projected/4bdf4d32-2df6-4db1-8819-bae92ef9690d-kube-api-access-hprlg\") pod \"4bdf4d32-2df6-4db1-8819-bae92ef9690d\" (UID: \"4bdf4d32-2df6-4db1-8819-bae92ef9690d\") " Mar 16 15:52:59 crc kubenswrapper[5120]: I0316 15:52:59.077545 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4bdf4d32-2df6-4db1-8819-bae92ef9690d-kube-api-access-hprlg" (OuterVolumeSpecName: "kube-api-access-hprlg") pod "4bdf4d32-2df6-4db1-8819-bae92ef9690d" (UID: "4bdf4d32-2df6-4db1-8819-bae92ef9690d"). InnerVolumeSpecName "kube-api-access-hprlg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:52:59 crc kubenswrapper[5120]: I0316 15:52:59.122461 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4bdf4d32-2df6-4db1-8819-bae92ef9690d-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "4bdf4d32-2df6-4db1-8819-bae92ef9690d" (UID: "4bdf4d32-2df6-4db1-8819-bae92ef9690d"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:52:59 crc kubenswrapper[5120]: I0316 15:52:59.128838 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4bdf4d32-2df6-4db1-8819-bae92ef9690d-config-data" (OuterVolumeSpecName: "config-data") pod "4bdf4d32-2df6-4db1-8819-bae92ef9690d" (UID: "4bdf4d32-2df6-4db1-8819-bae92ef9690d"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:52:59 crc kubenswrapper[5120]: I0316 15:52:59.153786 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:52:59 crc kubenswrapper[5120]: I0316 15:52:59.153849 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:52:59 crc kubenswrapper[5120]: I0316 15:52:59.171809 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4bdf4d32-2df6-4db1-8819-bae92ef9690d-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:52:59 crc kubenswrapper[5120]: I0316 15:52:59.171840 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4bdf4d32-2df6-4db1-8819-bae92ef9690d-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 15:52:59 crc kubenswrapper[5120]: I0316 15:52:59.171852 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hprlg\" (UniqueName: \"kubernetes.io/projected/4bdf4d32-2df6-4db1-8819-bae92ef9690d-kube-api-access-hprlg\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:00 crc kubenswrapper[5120]: I0316 15:53:00.039136 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 15:53:00 crc kubenswrapper[5120]: I0316 15:53:00.080891 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 15:53:00 crc kubenswrapper[5120]: I0316 15:53:00.093185 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 15:53:00 crc kubenswrapper[5120]: I0316 15:53:00.103593 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 15:53:00 crc kubenswrapper[5120]: I0316 15:53:00.104776 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4bdf4d32-2df6-4db1-8819-bae92ef9690d" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 15:53:00 crc kubenswrapper[5120]: I0316 15:53:00.104798 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="4bdf4d32-2df6-4db1-8819-bae92ef9690d" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 15:53:00 crc kubenswrapper[5120]: I0316 15:53:00.105054 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="4bdf4d32-2df6-4db1-8819-bae92ef9690d" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 15:53:00 crc kubenswrapper[5120]: I0316 15:53:00.147930 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 15:53:00 crc kubenswrapper[5120]: I0316 15:53:00.148087 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 15:53:00 crc kubenswrapper[5120]: I0316 15:53:00.151427 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-novncproxy-cell1-public-svc\"" Mar 16 15:53:00 crc kubenswrapper[5120]: I0316 15:53:00.155158 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-novncproxy-config-data\"" Mar 16 15:53:00 crc kubenswrapper[5120]: I0316 15:53:00.155196 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-novncproxy-cell1-vencrypt\"" Mar 16 15:53:00 crc kubenswrapper[5120]: I0316 15:53:00.194795 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prq56\" (UniqueName: \"kubernetes.io/projected/32f7f790-9e5b-4052-a87d-b3abaa0b3ff0-kube-api-access-prq56\") pod \"nova-cell1-novncproxy-0\" (UID: \"32f7f790-9e5b-4052-a87d-b3abaa0b3ff0\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 15:53:00 crc kubenswrapper[5120]: I0316 15:53:00.194870 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/32f7f790-9e5b-4052-a87d-b3abaa0b3ff0-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"32f7f790-9e5b-4052-a87d-b3abaa0b3ff0\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 15:53:00 crc kubenswrapper[5120]: I0316 15:53:00.194995 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/32f7f790-9e5b-4052-a87d-b3abaa0b3ff0-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"32f7f790-9e5b-4052-a87d-b3abaa0b3ff0\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 15:53:00 crc kubenswrapper[5120]: I0316 15:53:00.195274 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/32f7f790-9e5b-4052-a87d-b3abaa0b3ff0-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"32f7f790-9e5b-4052-a87d-b3abaa0b3ff0\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 15:53:00 crc kubenswrapper[5120]: I0316 15:53:00.195472 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/32f7f790-9e5b-4052-a87d-b3abaa0b3ff0-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"32f7f790-9e5b-4052-a87d-b3abaa0b3ff0\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 15:53:00 crc kubenswrapper[5120]: I0316 15:53:00.297280 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/32f7f790-9e5b-4052-a87d-b3abaa0b3ff0-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"32f7f790-9e5b-4052-a87d-b3abaa0b3ff0\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 15:53:00 crc kubenswrapper[5120]: I0316 15:53:00.297372 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/32f7f790-9e5b-4052-a87d-b3abaa0b3ff0-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"32f7f790-9e5b-4052-a87d-b3abaa0b3ff0\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 15:53:00 crc kubenswrapper[5120]: I0316 15:53:00.297508 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-prq56\" (UniqueName: \"kubernetes.io/projected/32f7f790-9e5b-4052-a87d-b3abaa0b3ff0-kube-api-access-prq56\") pod \"nova-cell1-novncproxy-0\" (UID: \"32f7f790-9e5b-4052-a87d-b3abaa0b3ff0\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 15:53:00 crc kubenswrapper[5120]: I0316 15:53:00.297561 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/32f7f790-9e5b-4052-a87d-b3abaa0b3ff0-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"32f7f790-9e5b-4052-a87d-b3abaa0b3ff0\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 15:53:00 crc kubenswrapper[5120]: I0316 15:53:00.297586 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/32f7f790-9e5b-4052-a87d-b3abaa0b3ff0-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"32f7f790-9e5b-4052-a87d-b3abaa0b3ff0\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 15:53:00 crc kubenswrapper[5120]: I0316 15:53:00.304450 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/32f7f790-9e5b-4052-a87d-b3abaa0b3ff0-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"32f7f790-9e5b-4052-a87d-b3abaa0b3ff0\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 15:53:00 crc kubenswrapper[5120]: I0316 15:53:00.304729 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/32f7f790-9e5b-4052-a87d-b3abaa0b3ff0-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"32f7f790-9e5b-4052-a87d-b3abaa0b3ff0\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 15:53:00 crc kubenswrapper[5120]: I0316 15:53:00.309306 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/32f7f790-9e5b-4052-a87d-b3abaa0b3ff0-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"32f7f790-9e5b-4052-a87d-b3abaa0b3ff0\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 15:53:00 crc kubenswrapper[5120]: I0316 15:53:00.326824 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/32f7f790-9e5b-4052-a87d-b3abaa0b3ff0-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"32f7f790-9e5b-4052-a87d-b3abaa0b3ff0\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 15:53:00 crc kubenswrapper[5120]: I0316 15:53:00.337967 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-prq56\" (UniqueName: \"kubernetes.io/projected/32f7f790-9e5b-4052-a87d-b3abaa0b3ff0-kube-api-access-prq56\") pod \"nova-cell1-novncproxy-0\" (UID: \"32f7f790-9e5b-4052-a87d-b3abaa0b3ff0\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 15:53:00 crc kubenswrapper[5120]: I0316 15:53:00.472712 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 15:53:00 crc kubenswrapper[5120]: I0316 15:53:00.685469 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4bdf4d32-2df6-4db1-8819-bae92ef9690d" path="/var/lib/kubelet/pods/4bdf4d32-2df6-4db1-8819-bae92ef9690d/volumes" Mar 16 15:53:01 crc kubenswrapper[5120]: W0316 15:53:01.032641 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod32f7f790_9e5b_4052_a87d_b3abaa0b3ff0.slice/crio-7c2d1969f752cdb667ff1c78f7c2da0f696f4c5683dd790e40c87c79657beb73 WatchSource:0}: Error finding container 7c2d1969f752cdb667ff1c78f7c2da0f696f4c5683dd790e40c87c79657beb73: Status 404 returned error can't find the container with id 7c2d1969f752cdb667ff1c78f7c2da0f696f4c5683dd790e40c87c79657beb73 Mar 16 15:53:01 crc kubenswrapper[5120]: I0316 15:53:01.033102 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 15:53:01 crc kubenswrapper[5120]: I0316 15:53:01.050813 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"32f7f790-9e5b-4052-a87d-b3abaa0b3ff0","Type":"ContainerStarted","Data":"7c2d1969f752cdb667ff1c78f7c2da0f696f4c5683dd790e40c87c79657beb73"} Mar 16 15:53:01 crc kubenswrapper[5120]: I0316 15:53:01.158447 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:53:01 crc kubenswrapper[5120]: I0316 15:53:01.160158 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:53:01 crc kubenswrapper[5120]: I0316 15:53:01.161752 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:53:01 crc kubenswrapper[5120]: I0316 15:53:01.934428 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 15:53:02 crc kubenswrapper[5120]: I0316 15:53:02.064051 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"32f7f790-9e5b-4052-a87d-b3abaa0b3ff0","Type":"ContainerStarted","Data":"5c27deb51925eebcbc197def4aa61ef6d9334fadb9af36744bc13cd32f16e353"} Mar 16 15:53:02 crc kubenswrapper[5120]: I0316 15:53:02.068079 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:53:02 crc kubenswrapper[5120]: I0316 15:53:02.092000 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podStartSLOduration=2.091980797 podStartE2EDuration="2.091980797s" podCreationTimestamp="2026-03-16 15:53:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:53:02.087178284 +0000 UTC m=+1284.241109971" watchObservedRunningTime="2026-03-16 15:53:02.091980797 +0000 UTC m=+1284.245912454" Mar 16 15:53:03 crc kubenswrapper[5120]: I0316 15:53:03.745132 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 15:53:03 crc kubenswrapper[5120]: I0316 15:53:03.745610 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="91e78ecc-86d1-40bf-9439-e2bc4399e618" containerName="ceilometer-central-agent" containerID="cri-o://4783c691fb2f63827594acd9038cc1b91a8b22f98662baa104daa79b690e2b8a" gracePeriod=30 Mar 16 15:53:03 crc kubenswrapper[5120]: I0316 15:53:03.746037 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="91e78ecc-86d1-40bf-9439-e2bc4399e618" containerName="proxy-httpd" containerID="cri-o://e0b27f0c1e31c7a8c27ad471814d139d40fcb6724b17d3be1b539002a8a8b111" gracePeriod=30 Mar 16 15:53:03 crc kubenswrapper[5120]: I0316 15:53:03.746090 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="91e78ecc-86d1-40bf-9439-e2bc4399e618" containerName="sg-core" containerID="cri-o://0a7cab07a808d59132a63e46509dc54b6ddbeec5e2bf80ef31629dad7d3c66c3" gracePeriod=30 Mar 16 15:53:03 crc kubenswrapper[5120]: I0316 15:53:03.746122 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="91e78ecc-86d1-40bf-9439-e2bc4399e618" containerName="ceilometer-notification-agent" containerID="cri-o://0dde6591318ad2978c619451bb88edc14424e66c9081838e3f0f0561383c7656" gracePeriod=30 Mar 16 15:53:04 crc kubenswrapper[5120]: I0316 15:53:04.087146 5120 generic.go:358] "Generic (PLEG): container finished" podID="91e78ecc-86d1-40bf-9439-e2bc4399e618" containerID="e0b27f0c1e31c7a8c27ad471814d139d40fcb6724b17d3be1b539002a8a8b111" exitCode=0 Mar 16 15:53:04 crc kubenswrapper[5120]: I0316 15:53:04.087184 5120 generic.go:358] "Generic (PLEG): container finished" podID="91e78ecc-86d1-40bf-9439-e2bc4399e618" containerID="0a7cab07a808d59132a63e46509dc54b6ddbeec5e2bf80ef31629dad7d3c66c3" exitCode=2 Mar 16 15:53:04 crc kubenswrapper[5120]: I0316 15:53:04.088272 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"91e78ecc-86d1-40bf-9439-e2bc4399e618","Type":"ContainerDied","Data":"e0b27f0c1e31c7a8c27ad471814d139d40fcb6724b17d3be1b539002a8a8b111"} Mar 16 15:53:04 crc kubenswrapper[5120]: I0316 15:53:04.088332 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"91e78ecc-86d1-40bf-9439-e2bc4399e618","Type":"ContainerDied","Data":"0a7cab07a808d59132a63e46509dc54b6ddbeec5e2bf80ef31629dad7d3c66c3"} Mar 16 15:53:05 crc kubenswrapper[5120]: I0316 15:53:05.099452 5120 generic.go:358] "Generic (PLEG): container finished" podID="91e78ecc-86d1-40bf-9439-e2bc4399e618" containerID="4783c691fb2f63827594acd9038cc1b91a8b22f98662baa104daa79b690e2b8a" exitCode=0 Mar 16 15:53:05 crc kubenswrapper[5120]: I0316 15:53:05.100002 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"91e78ecc-86d1-40bf-9439-e2bc4399e618","Type":"ContainerDied","Data":"4783c691fb2f63827594acd9038cc1b91a8b22f98662baa104daa79b690e2b8a"} Mar 16 15:53:05 crc kubenswrapper[5120]: I0316 15:53:05.343085 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 15:53:05 crc kubenswrapper[5120]: I0316 15:53:05.343376 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="14708e2c-1f13-42eb-a497-936d4740e6dd" containerName="nova-api-log" containerID="cri-o://1f4a64432fb92fcc671b7dd4b1fc066758b00a9a0acdbc7bd202be5dddf2d314" gracePeriod=30 Mar 16 15:53:05 crc kubenswrapper[5120]: I0316 15:53:05.343532 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="14708e2c-1f13-42eb-a497-936d4740e6dd" containerName="nova-api-api" containerID="cri-o://19433ed16699721c47bc0145ce1b7a985002a978b53eb58e34003d7952113fa0" gracePeriod=30 Mar 16 15:53:05 crc kubenswrapper[5120]: I0316 15:53:05.475031 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 15:53:05 crc kubenswrapper[5120]: I0316 15:53:05.674015 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:53:05 crc kubenswrapper[5120]: I0316 15:53:05.805884 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/91e78ecc-86d1-40bf-9439-e2bc4399e618-sg-core-conf-yaml\") pod \"91e78ecc-86d1-40bf-9439-e2bc4399e618\" (UID: \"91e78ecc-86d1-40bf-9439-e2bc4399e618\") " Mar 16 15:53:05 crc kubenswrapper[5120]: I0316 15:53:05.805943 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/91e78ecc-86d1-40bf-9439-e2bc4399e618-ceilometer-tls-certs\") pod \"91e78ecc-86d1-40bf-9439-e2bc4399e618\" (UID: \"91e78ecc-86d1-40bf-9439-e2bc4399e618\") " Mar 16 15:53:05 crc kubenswrapper[5120]: I0316 15:53:05.806021 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/91e78ecc-86d1-40bf-9439-e2bc4399e618-run-httpd\") pod \"91e78ecc-86d1-40bf-9439-e2bc4399e618\" (UID: \"91e78ecc-86d1-40bf-9439-e2bc4399e618\") " Mar 16 15:53:05 crc kubenswrapper[5120]: I0316 15:53:05.806085 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/91e78ecc-86d1-40bf-9439-e2bc4399e618-scripts\") pod \"91e78ecc-86d1-40bf-9439-e2bc4399e618\" (UID: \"91e78ecc-86d1-40bf-9439-e2bc4399e618\") " Mar 16 15:53:05 crc kubenswrapper[5120]: I0316 15:53:05.806206 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x8vp6\" (UniqueName: \"kubernetes.io/projected/91e78ecc-86d1-40bf-9439-e2bc4399e618-kube-api-access-x8vp6\") pod \"91e78ecc-86d1-40bf-9439-e2bc4399e618\" (UID: \"91e78ecc-86d1-40bf-9439-e2bc4399e618\") " Mar 16 15:53:05 crc kubenswrapper[5120]: I0316 15:53:05.806247 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/91e78ecc-86d1-40bf-9439-e2bc4399e618-config-data\") pod \"91e78ecc-86d1-40bf-9439-e2bc4399e618\" (UID: \"91e78ecc-86d1-40bf-9439-e2bc4399e618\") " Mar 16 15:53:05 crc kubenswrapper[5120]: I0316 15:53:05.806335 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/91e78ecc-86d1-40bf-9439-e2bc4399e618-log-httpd\") pod \"91e78ecc-86d1-40bf-9439-e2bc4399e618\" (UID: \"91e78ecc-86d1-40bf-9439-e2bc4399e618\") " Mar 16 15:53:05 crc kubenswrapper[5120]: I0316 15:53:05.806358 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/91e78ecc-86d1-40bf-9439-e2bc4399e618-combined-ca-bundle\") pod \"91e78ecc-86d1-40bf-9439-e2bc4399e618\" (UID: \"91e78ecc-86d1-40bf-9439-e2bc4399e618\") " Mar 16 15:53:05 crc kubenswrapper[5120]: I0316 15:53:05.807259 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91e78ecc-86d1-40bf-9439-e2bc4399e618-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "91e78ecc-86d1-40bf-9439-e2bc4399e618" (UID: "91e78ecc-86d1-40bf-9439-e2bc4399e618"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:53:05 crc kubenswrapper[5120]: I0316 15:53:05.807848 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91e78ecc-86d1-40bf-9439-e2bc4399e618-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "91e78ecc-86d1-40bf-9439-e2bc4399e618" (UID: "91e78ecc-86d1-40bf-9439-e2bc4399e618"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:53:05 crc kubenswrapper[5120]: I0316 15:53:05.813308 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91e78ecc-86d1-40bf-9439-e2bc4399e618-kube-api-access-x8vp6" (OuterVolumeSpecName: "kube-api-access-x8vp6") pod "91e78ecc-86d1-40bf-9439-e2bc4399e618" (UID: "91e78ecc-86d1-40bf-9439-e2bc4399e618"). InnerVolumeSpecName "kube-api-access-x8vp6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:53:05 crc kubenswrapper[5120]: I0316 15:53:05.813701 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91e78ecc-86d1-40bf-9439-e2bc4399e618-scripts" (OuterVolumeSpecName: "scripts") pod "91e78ecc-86d1-40bf-9439-e2bc4399e618" (UID: "91e78ecc-86d1-40bf-9439-e2bc4399e618"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:53:05 crc kubenswrapper[5120]: I0316 15:53:05.834095 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91e78ecc-86d1-40bf-9439-e2bc4399e618-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "91e78ecc-86d1-40bf-9439-e2bc4399e618" (UID: "91e78ecc-86d1-40bf-9439-e2bc4399e618"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:53:05 crc kubenswrapper[5120]: I0316 15:53:05.887392 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91e78ecc-86d1-40bf-9439-e2bc4399e618-ceilometer-tls-certs" (OuterVolumeSpecName: "ceilometer-tls-certs") pod "91e78ecc-86d1-40bf-9439-e2bc4399e618" (UID: "91e78ecc-86d1-40bf-9439-e2bc4399e618"). InnerVolumeSpecName "ceilometer-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:53:05 crc kubenswrapper[5120]: I0316 15:53:05.895968 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91e78ecc-86d1-40bf-9439-e2bc4399e618-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "91e78ecc-86d1-40bf-9439-e2bc4399e618" (UID: "91e78ecc-86d1-40bf-9439-e2bc4399e618"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:53:05 crc kubenswrapper[5120]: I0316 15:53:05.912557 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/91e78ecc-86d1-40bf-9439-e2bc4399e618-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:05 crc kubenswrapper[5120]: I0316 15:53:05.912612 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/91e78ecc-86d1-40bf-9439-e2bc4399e618-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:05 crc kubenswrapper[5120]: I0316 15:53:05.912624 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x8vp6\" (UniqueName: \"kubernetes.io/projected/91e78ecc-86d1-40bf-9439-e2bc4399e618-kube-api-access-x8vp6\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:05 crc kubenswrapper[5120]: I0316 15:53:05.912634 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/91e78ecc-86d1-40bf-9439-e2bc4399e618-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:05 crc kubenswrapper[5120]: I0316 15:53:05.912643 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/91e78ecc-86d1-40bf-9439-e2bc4399e618-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:05 crc kubenswrapper[5120]: I0316 15:53:05.912653 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/91e78ecc-86d1-40bf-9439-e2bc4399e618-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:05 crc kubenswrapper[5120]: I0316 15:53:05.912661 5120 reconciler_common.go:299] "Volume detached for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/91e78ecc-86d1-40bf-9439-e2bc4399e618-ceilometer-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:05 crc kubenswrapper[5120]: I0316 15:53:05.925944 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91e78ecc-86d1-40bf-9439-e2bc4399e618-config-data" (OuterVolumeSpecName: "config-data") pod "91e78ecc-86d1-40bf-9439-e2bc4399e618" (UID: "91e78ecc-86d1-40bf-9439-e2bc4399e618"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:53:06 crc kubenswrapper[5120]: I0316 15:53:06.014209 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/91e78ecc-86d1-40bf-9439-e2bc4399e618-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:06 crc kubenswrapper[5120]: I0316 15:53:06.110899 5120 generic.go:358] "Generic (PLEG): container finished" podID="91e78ecc-86d1-40bf-9439-e2bc4399e618" containerID="0dde6591318ad2978c619451bb88edc14424e66c9081838e3f0f0561383c7656" exitCode=0 Mar 16 15:53:06 crc kubenswrapper[5120]: I0316 15:53:06.111170 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"91e78ecc-86d1-40bf-9439-e2bc4399e618","Type":"ContainerDied","Data":"0dde6591318ad2978c619451bb88edc14424e66c9081838e3f0f0561383c7656"} Mar 16 15:53:06 crc kubenswrapper[5120]: I0316 15:53:06.111196 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"91e78ecc-86d1-40bf-9439-e2bc4399e618","Type":"ContainerDied","Data":"8ff9287d7fefb5ca16eede53933e113c744c58258551e300f26495eb8872de1e"} Mar 16 15:53:06 crc kubenswrapper[5120]: I0316 15:53:06.111211 5120 scope.go:117] "RemoveContainer" containerID="e0b27f0c1e31c7a8c27ad471814d139d40fcb6724b17d3be1b539002a8a8b111" Mar 16 15:53:06 crc kubenswrapper[5120]: I0316 15:53:06.111331 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:53:06 crc kubenswrapper[5120]: I0316 15:53:06.118725 5120 generic.go:358] "Generic (PLEG): container finished" podID="14708e2c-1f13-42eb-a497-936d4740e6dd" containerID="1f4a64432fb92fcc671b7dd4b1fc066758b00a9a0acdbc7bd202be5dddf2d314" exitCode=143 Mar 16 15:53:06 crc kubenswrapper[5120]: I0316 15:53:06.118946 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"14708e2c-1f13-42eb-a497-936d4740e6dd","Type":"ContainerDied","Data":"1f4a64432fb92fcc671b7dd4b1fc066758b00a9a0acdbc7bd202be5dddf2d314"} Mar 16 15:53:06 crc kubenswrapper[5120]: I0316 15:53:06.140576 5120 scope.go:117] "RemoveContainer" containerID="0a7cab07a808d59132a63e46509dc54b6ddbeec5e2bf80ef31629dad7d3c66c3" Mar 16 15:53:06 crc kubenswrapper[5120]: I0316 15:53:06.151655 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 15:53:06 crc kubenswrapper[5120]: I0316 15:53:06.158810 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 15:53:06 crc kubenswrapper[5120]: I0316 15:53:06.159651 5120 scope.go:117] "RemoveContainer" containerID="0dde6591318ad2978c619451bb88edc14424e66c9081838e3f0f0561383c7656" Mar 16 15:53:06 crc kubenswrapper[5120]: I0316 15:53:06.182610 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 15:53:06 crc kubenswrapper[5120]: I0316 15:53:06.185407 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91e78ecc-86d1-40bf-9439-e2bc4399e618" containerName="sg-core" Mar 16 15:53:06 crc kubenswrapper[5120]: I0316 15:53:06.185444 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="91e78ecc-86d1-40bf-9439-e2bc4399e618" containerName="sg-core" Mar 16 15:53:06 crc kubenswrapper[5120]: I0316 15:53:06.185469 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91e78ecc-86d1-40bf-9439-e2bc4399e618" containerName="ceilometer-central-agent" Mar 16 15:53:06 crc kubenswrapper[5120]: I0316 15:53:06.185481 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="91e78ecc-86d1-40bf-9439-e2bc4399e618" containerName="ceilometer-central-agent" Mar 16 15:53:06 crc kubenswrapper[5120]: I0316 15:53:06.185513 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91e78ecc-86d1-40bf-9439-e2bc4399e618" containerName="proxy-httpd" Mar 16 15:53:06 crc kubenswrapper[5120]: I0316 15:53:06.185527 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="91e78ecc-86d1-40bf-9439-e2bc4399e618" containerName="proxy-httpd" Mar 16 15:53:06 crc kubenswrapper[5120]: I0316 15:53:06.185581 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91e78ecc-86d1-40bf-9439-e2bc4399e618" containerName="ceilometer-notification-agent" Mar 16 15:53:06 crc kubenswrapper[5120]: I0316 15:53:06.185593 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="91e78ecc-86d1-40bf-9439-e2bc4399e618" containerName="ceilometer-notification-agent" Mar 16 15:53:06 crc kubenswrapper[5120]: I0316 15:53:06.185902 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="91e78ecc-86d1-40bf-9439-e2bc4399e618" containerName="sg-core" Mar 16 15:53:06 crc kubenswrapper[5120]: I0316 15:53:06.185933 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="91e78ecc-86d1-40bf-9439-e2bc4399e618" containerName="ceilometer-central-agent" Mar 16 15:53:06 crc kubenswrapper[5120]: I0316 15:53:06.185966 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="91e78ecc-86d1-40bf-9439-e2bc4399e618" containerName="proxy-httpd" Mar 16 15:53:06 crc kubenswrapper[5120]: I0316 15:53:06.185984 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="91e78ecc-86d1-40bf-9439-e2bc4399e618" containerName="ceilometer-notification-agent" Mar 16 15:53:06 crc kubenswrapper[5120]: I0316 15:53:06.187378 5120 scope.go:117] "RemoveContainer" containerID="4783c691fb2f63827594acd9038cc1b91a8b22f98662baa104daa79b690e2b8a" Mar 16 15:53:06 crc kubenswrapper[5120]: I0316 15:53:06.202357 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 15:53:06 crc kubenswrapper[5120]: I0316 15:53:06.202510 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:53:06 crc kubenswrapper[5120]: I0316 15:53:06.210992 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 15:53:06 crc kubenswrapper[5120]: I0316 15:53:06.211102 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ceilometer-internal-svc\"" Mar 16 15:53:06 crc kubenswrapper[5120]: I0316 15:53:06.211324 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 15:53:06 crc kubenswrapper[5120]: I0316 15:53:06.214889 5120 scope.go:117] "RemoveContainer" containerID="e0b27f0c1e31c7a8c27ad471814d139d40fcb6724b17d3be1b539002a8a8b111" Mar 16 15:53:06 crc kubenswrapper[5120]: E0316 15:53:06.215903 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e0b27f0c1e31c7a8c27ad471814d139d40fcb6724b17d3be1b539002a8a8b111\": container with ID starting with e0b27f0c1e31c7a8c27ad471814d139d40fcb6724b17d3be1b539002a8a8b111 not found: ID does not exist" containerID="e0b27f0c1e31c7a8c27ad471814d139d40fcb6724b17d3be1b539002a8a8b111" Mar 16 15:53:06 crc kubenswrapper[5120]: I0316 15:53:06.215955 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0b27f0c1e31c7a8c27ad471814d139d40fcb6724b17d3be1b539002a8a8b111"} err="failed to get container status \"e0b27f0c1e31c7a8c27ad471814d139d40fcb6724b17d3be1b539002a8a8b111\": rpc error: code = NotFound desc = could not find container \"e0b27f0c1e31c7a8c27ad471814d139d40fcb6724b17d3be1b539002a8a8b111\": container with ID starting with e0b27f0c1e31c7a8c27ad471814d139d40fcb6724b17d3be1b539002a8a8b111 not found: ID does not exist" Mar 16 15:53:06 crc kubenswrapper[5120]: I0316 15:53:06.215975 5120 scope.go:117] "RemoveContainer" containerID="0a7cab07a808d59132a63e46509dc54b6ddbeec5e2bf80ef31629dad7d3c66c3" Mar 16 15:53:06 crc kubenswrapper[5120]: E0316 15:53:06.216515 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a7cab07a808d59132a63e46509dc54b6ddbeec5e2bf80ef31629dad7d3c66c3\": container with ID starting with 0a7cab07a808d59132a63e46509dc54b6ddbeec5e2bf80ef31629dad7d3c66c3 not found: ID does not exist" containerID="0a7cab07a808d59132a63e46509dc54b6ddbeec5e2bf80ef31629dad7d3c66c3" Mar 16 15:53:06 crc kubenswrapper[5120]: I0316 15:53:06.216534 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a7cab07a808d59132a63e46509dc54b6ddbeec5e2bf80ef31629dad7d3c66c3"} err="failed to get container status \"0a7cab07a808d59132a63e46509dc54b6ddbeec5e2bf80ef31629dad7d3c66c3\": rpc error: code = NotFound desc = could not find container \"0a7cab07a808d59132a63e46509dc54b6ddbeec5e2bf80ef31629dad7d3c66c3\": container with ID starting with 0a7cab07a808d59132a63e46509dc54b6ddbeec5e2bf80ef31629dad7d3c66c3 not found: ID does not exist" Mar 16 15:53:06 crc kubenswrapper[5120]: I0316 15:53:06.216548 5120 scope.go:117] "RemoveContainer" containerID="0dde6591318ad2978c619451bb88edc14424e66c9081838e3f0f0561383c7656" Mar 16 15:53:06 crc kubenswrapper[5120]: E0316 15:53:06.216958 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0dde6591318ad2978c619451bb88edc14424e66c9081838e3f0f0561383c7656\": container with ID starting with 0dde6591318ad2978c619451bb88edc14424e66c9081838e3f0f0561383c7656 not found: ID does not exist" containerID="0dde6591318ad2978c619451bb88edc14424e66c9081838e3f0f0561383c7656" Mar 16 15:53:06 crc kubenswrapper[5120]: I0316 15:53:06.216991 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0dde6591318ad2978c619451bb88edc14424e66c9081838e3f0f0561383c7656"} err="failed to get container status \"0dde6591318ad2978c619451bb88edc14424e66c9081838e3f0f0561383c7656\": rpc error: code = NotFound desc = could not find container \"0dde6591318ad2978c619451bb88edc14424e66c9081838e3f0f0561383c7656\": container with ID starting with 0dde6591318ad2978c619451bb88edc14424e66c9081838e3f0f0561383c7656 not found: ID does not exist" Mar 16 15:53:06 crc kubenswrapper[5120]: I0316 15:53:06.217003 5120 scope.go:117] "RemoveContainer" containerID="4783c691fb2f63827594acd9038cc1b91a8b22f98662baa104daa79b690e2b8a" Mar 16 15:53:06 crc kubenswrapper[5120]: E0316 15:53:06.218865 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4783c691fb2f63827594acd9038cc1b91a8b22f98662baa104daa79b690e2b8a\": container with ID starting with 4783c691fb2f63827594acd9038cc1b91a8b22f98662baa104daa79b690e2b8a not found: ID does not exist" containerID="4783c691fb2f63827594acd9038cc1b91a8b22f98662baa104daa79b690e2b8a" Mar 16 15:53:06 crc kubenswrapper[5120]: I0316 15:53:06.218902 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4783c691fb2f63827594acd9038cc1b91a8b22f98662baa104daa79b690e2b8a"} err="failed to get container status \"4783c691fb2f63827594acd9038cc1b91a8b22f98662baa104daa79b690e2b8a\": rpc error: code = NotFound desc = could not find container \"4783c691fb2f63827594acd9038cc1b91a8b22f98662baa104daa79b690e2b8a\": container with ID starting with 4783c691fb2f63827594acd9038cc1b91a8b22f98662baa104daa79b690e2b8a not found: ID does not exist" Mar 16 15:53:06 crc kubenswrapper[5120]: I0316 15:53:06.322241 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/07680162-1363-450f-ab98-79c21a0f63d1-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"07680162-1363-450f-ab98-79c21a0f63d1\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:53:06 crc kubenswrapper[5120]: I0316 15:53:06.322334 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/07680162-1363-450f-ab98-79c21a0f63d1-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"07680162-1363-450f-ab98-79c21a0f63d1\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:53:06 crc kubenswrapper[5120]: I0316 15:53:06.322372 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgxwv\" (UniqueName: \"kubernetes.io/projected/07680162-1363-450f-ab98-79c21a0f63d1-kube-api-access-fgxwv\") pod \"ceilometer-0\" (UID: \"07680162-1363-450f-ab98-79c21a0f63d1\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:53:06 crc kubenswrapper[5120]: I0316 15:53:06.322407 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/07680162-1363-450f-ab98-79c21a0f63d1-config-data\") pod \"ceilometer-0\" (UID: \"07680162-1363-450f-ab98-79c21a0f63d1\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:53:06 crc kubenswrapper[5120]: I0316 15:53:06.322435 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/07680162-1363-450f-ab98-79c21a0f63d1-scripts\") pod \"ceilometer-0\" (UID: \"07680162-1363-450f-ab98-79c21a0f63d1\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:53:06 crc kubenswrapper[5120]: I0316 15:53:06.322452 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/07680162-1363-450f-ab98-79c21a0f63d1-log-httpd\") pod \"ceilometer-0\" (UID: \"07680162-1363-450f-ab98-79c21a0f63d1\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:53:06 crc kubenswrapper[5120]: I0316 15:53:06.322494 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/07680162-1363-450f-ab98-79c21a0f63d1-run-httpd\") pod \"ceilometer-0\" (UID: \"07680162-1363-450f-ab98-79c21a0f63d1\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:53:06 crc kubenswrapper[5120]: I0316 15:53:06.322516 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/07680162-1363-450f-ab98-79c21a0f63d1-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"07680162-1363-450f-ab98-79c21a0f63d1\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:53:06 crc kubenswrapper[5120]: I0316 15:53:06.392001 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 15:53:06 crc kubenswrapper[5120]: E0316 15:53:06.392637 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[ceilometer-tls-certs combined-ca-bundle config-data kube-api-access-fgxwv log-httpd run-httpd scripts sg-core-conf-yaml], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openstack-kuttl-tests/ceilometer-0" podUID="07680162-1363-450f-ab98-79c21a0f63d1" Mar 16 15:53:06 crc kubenswrapper[5120]: I0316 15:53:06.423454 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/07680162-1363-450f-ab98-79c21a0f63d1-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"07680162-1363-450f-ab98-79c21a0f63d1\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:53:06 crc kubenswrapper[5120]: I0316 15:53:06.423503 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fgxwv\" (UniqueName: \"kubernetes.io/projected/07680162-1363-450f-ab98-79c21a0f63d1-kube-api-access-fgxwv\") pod \"ceilometer-0\" (UID: \"07680162-1363-450f-ab98-79c21a0f63d1\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:53:06 crc kubenswrapper[5120]: I0316 15:53:06.423537 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/07680162-1363-450f-ab98-79c21a0f63d1-config-data\") pod \"ceilometer-0\" (UID: \"07680162-1363-450f-ab98-79c21a0f63d1\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:53:06 crc kubenswrapper[5120]: I0316 15:53:06.423566 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/07680162-1363-450f-ab98-79c21a0f63d1-scripts\") pod \"ceilometer-0\" (UID: \"07680162-1363-450f-ab98-79c21a0f63d1\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:53:06 crc kubenswrapper[5120]: I0316 15:53:06.423582 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/07680162-1363-450f-ab98-79c21a0f63d1-log-httpd\") pod \"ceilometer-0\" (UID: \"07680162-1363-450f-ab98-79c21a0f63d1\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:53:06 crc kubenswrapper[5120]: I0316 15:53:06.423608 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/07680162-1363-450f-ab98-79c21a0f63d1-run-httpd\") pod \"ceilometer-0\" (UID: \"07680162-1363-450f-ab98-79c21a0f63d1\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:53:06 crc kubenswrapper[5120]: I0316 15:53:06.423627 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/07680162-1363-450f-ab98-79c21a0f63d1-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"07680162-1363-450f-ab98-79c21a0f63d1\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:53:06 crc kubenswrapper[5120]: I0316 15:53:06.423685 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/07680162-1363-450f-ab98-79c21a0f63d1-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"07680162-1363-450f-ab98-79c21a0f63d1\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:53:06 crc kubenswrapper[5120]: I0316 15:53:06.425235 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/07680162-1363-450f-ab98-79c21a0f63d1-run-httpd\") pod \"ceilometer-0\" (UID: \"07680162-1363-450f-ab98-79c21a0f63d1\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:53:06 crc kubenswrapper[5120]: I0316 15:53:06.425337 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/07680162-1363-450f-ab98-79c21a0f63d1-log-httpd\") pod \"ceilometer-0\" (UID: \"07680162-1363-450f-ab98-79c21a0f63d1\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:53:06 crc kubenswrapper[5120]: I0316 15:53:06.428408 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/07680162-1363-450f-ab98-79c21a0f63d1-scripts\") pod \"ceilometer-0\" (UID: \"07680162-1363-450f-ab98-79c21a0f63d1\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:53:06 crc kubenswrapper[5120]: I0316 15:53:06.429223 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/07680162-1363-450f-ab98-79c21a0f63d1-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"07680162-1363-450f-ab98-79c21a0f63d1\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:53:06 crc kubenswrapper[5120]: I0316 15:53:06.430036 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/07680162-1363-450f-ab98-79c21a0f63d1-config-data\") pod \"ceilometer-0\" (UID: \"07680162-1363-450f-ab98-79c21a0f63d1\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:53:06 crc kubenswrapper[5120]: I0316 15:53:06.430077 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/07680162-1363-450f-ab98-79c21a0f63d1-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"07680162-1363-450f-ab98-79c21a0f63d1\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:53:06 crc kubenswrapper[5120]: I0316 15:53:06.431404 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/07680162-1363-450f-ab98-79c21a0f63d1-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"07680162-1363-450f-ab98-79c21a0f63d1\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:53:06 crc kubenswrapper[5120]: I0316 15:53:06.442407 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgxwv\" (UniqueName: \"kubernetes.io/projected/07680162-1363-450f-ab98-79c21a0f63d1-kube-api-access-fgxwv\") pod \"ceilometer-0\" (UID: \"07680162-1363-450f-ab98-79c21a0f63d1\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:53:06 crc kubenswrapper[5120]: I0316 15:53:06.676697 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="91e78ecc-86d1-40bf-9439-e2bc4399e618" path="/var/lib/kubelet/pods/91e78ecc-86d1-40bf-9439-e2bc4399e618/volumes" Mar 16 15:53:07 crc kubenswrapper[5120]: I0316 15:53:07.130095 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:53:07 crc kubenswrapper[5120]: I0316 15:53:07.144701 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:53:07 crc kubenswrapper[5120]: I0316 15:53:07.241210 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/07680162-1363-450f-ab98-79c21a0f63d1-config-data\") pod \"07680162-1363-450f-ab98-79c21a0f63d1\" (UID: \"07680162-1363-450f-ab98-79c21a0f63d1\") " Mar 16 15:53:07 crc kubenswrapper[5120]: I0316 15:53:07.241410 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/07680162-1363-450f-ab98-79c21a0f63d1-sg-core-conf-yaml\") pod \"07680162-1363-450f-ab98-79c21a0f63d1\" (UID: \"07680162-1363-450f-ab98-79c21a0f63d1\") " Mar 16 15:53:07 crc kubenswrapper[5120]: I0316 15:53:07.241476 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/07680162-1363-450f-ab98-79c21a0f63d1-ceilometer-tls-certs\") pod \"07680162-1363-450f-ab98-79c21a0f63d1\" (UID: \"07680162-1363-450f-ab98-79c21a0f63d1\") " Mar 16 15:53:07 crc kubenswrapper[5120]: I0316 15:53:07.241539 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/07680162-1363-450f-ab98-79c21a0f63d1-run-httpd\") pod \"07680162-1363-450f-ab98-79c21a0f63d1\" (UID: \"07680162-1363-450f-ab98-79c21a0f63d1\") " Mar 16 15:53:07 crc kubenswrapper[5120]: I0316 15:53:07.241597 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/07680162-1363-450f-ab98-79c21a0f63d1-scripts\") pod \"07680162-1363-450f-ab98-79c21a0f63d1\" (UID: \"07680162-1363-450f-ab98-79c21a0f63d1\") " Mar 16 15:53:07 crc kubenswrapper[5120]: I0316 15:53:07.241634 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/07680162-1363-450f-ab98-79c21a0f63d1-combined-ca-bundle\") pod \"07680162-1363-450f-ab98-79c21a0f63d1\" (UID: \"07680162-1363-450f-ab98-79c21a0f63d1\") " Mar 16 15:53:07 crc kubenswrapper[5120]: I0316 15:53:07.241690 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fgxwv\" (UniqueName: \"kubernetes.io/projected/07680162-1363-450f-ab98-79c21a0f63d1-kube-api-access-fgxwv\") pod \"07680162-1363-450f-ab98-79c21a0f63d1\" (UID: \"07680162-1363-450f-ab98-79c21a0f63d1\") " Mar 16 15:53:07 crc kubenswrapper[5120]: I0316 15:53:07.241982 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07680162-1363-450f-ab98-79c21a0f63d1-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "07680162-1363-450f-ab98-79c21a0f63d1" (UID: "07680162-1363-450f-ab98-79c21a0f63d1"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:53:07 crc kubenswrapper[5120]: I0316 15:53:07.242139 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/07680162-1363-450f-ab98-79c21a0f63d1-log-httpd\") pod \"07680162-1363-450f-ab98-79c21a0f63d1\" (UID: \"07680162-1363-450f-ab98-79c21a0f63d1\") " Mar 16 15:53:07 crc kubenswrapper[5120]: I0316 15:53:07.242512 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07680162-1363-450f-ab98-79c21a0f63d1-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "07680162-1363-450f-ab98-79c21a0f63d1" (UID: "07680162-1363-450f-ab98-79c21a0f63d1"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:53:07 crc kubenswrapper[5120]: I0316 15:53:07.243537 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/07680162-1363-450f-ab98-79c21a0f63d1-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:07 crc kubenswrapper[5120]: I0316 15:53:07.243650 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/07680162-1363-450f-ab98-79c21a0f63d1-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:07 crc kubenswrapper[5120]: I0316 15:53:07.247450 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07680162-1363-450f-ab98-79c21a0f63d1-scripts" (OuterVolumeSpecName: "scripts") pod "07680162-1363-450f-ab98-79c21a0f63d1" (UID: "07680162-1363-450f-ab98-79c21a0f63d1"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:53:07 crc kubenswrapper[5120]: I0316 15:53:07.247479 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07680162-1363-450f-ab98-79c21a0f63d1-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "07680162-1363-450f-ab98-79c21a0f63d1" (UID: "07680162-1363-450f-ab98-79c21a0f63d1"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:53:07 crc kubenswrapper[5120]: I0316 15:53:07.247514 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07680162-1363-450f-ab98-79c21a0f63d1-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "07680162-1363-450f-ab98-79c21a0f63d1" (UID: "07680162-1363-450f-ab98-79c21a0f63d1"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:53:07 crc kubenswrapper[5120]: I0316 15:53:07.247557 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07680162-1363-450f-ab98-79c21a0f63d1-config-data" (OuterVolumeSpecName: "config-data") pod "07680162-1363-450f-ab98-79c21a0f63d1" (UID: "07680162-1363-450f-ab98-79c21a0f63d1"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:53:07 crc kubenswrapper[5120]: I0316 15:53:07.248139 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07680162-1363-450f-ab98-79c21a0f63d1-ceilometer-tls-certs" (OuterVolumeSpecName: "ceilometer-tls-certs") pod "07680162-1363-450f-ab98-79c21a0f63d1" (UID: "07680162-1363-450f-ab98-79c21a0f63d1"). InnerVolumeSpecName "ceilometer-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:53:07 crc kubenswrapper[5120]: I0316 15:53:07.258940 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07680162-1363-450f-ab98-79c21a0f63d1-kube-api-access-fgxwv" (OuterVolumeSpecName: "kube-api-access-fgxwv") pod "07680162-1363-450f-ab98-79c21a0f63d1" (UID: "07680162-1363-450f-ab98-79c21a0f63d1"). InnerVolumeSpecName "kube-api-access-fgxwv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:53:07 crc kubenswrapper[5120]: I0316 15:53:07.345969 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/07680162-1363-450f-ab98-79c21a0f63d1-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:07 crc kubenswrapper[5120]: I0316 15:53:07.346127 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/07680162-1363-450f-ab98-79c21a0f63d1-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:07 crc kubenswrapper[5120]: I0316 15:53:07.346152 5120 reconciler_common.go:299] "Volume detached for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/07680162-1363-450f-ab98-79c21a0f63d1-ceilometer-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:07 crc kubenswrapper[5120]: I0316 15:53:07.346172 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/07680162-1363-450f-ab98-79c21a0f63d1-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:07 crc kubenswrapper[5120]: I0316 15:53:07.346190 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/07680162-1363-450f-ab98-79c21a0f63d1-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:07 crc kubenswrapper[5120]: I0316 15:53:07.346207 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fgxwv\" (UniqueName: \"kubernetes.io/projected/07680162-1363-450f-ab98-79c21a0f63d1-kube-api-access-fgxwv\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:08 crc kubenswrapper[5120]: E0316 15:53:08.117469 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1754867 actualBytes=10240 Mar 16 15:53:08 crc kubenswrapper[5120]: I0316 15:53:08.139520 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:53:08 crc kubenswrapper[5120]: I0316 15:53:08.226874 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 15:53:08 crc kubenswrapper[5120]: I0316 15:53:08.238316 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 15:53:08 crc kubenswrapper[5120]: I0316 15:53:08.249617 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 15:53:08 crc kubenswrapper[5120]: I0316 15:53:08.263702 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 15:53:08 crc kubenswrapper[5120]: I0316 15:53:08.263845 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:53:08 crc kubenswrapper[5120]: I0316 15:53:08.268471 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 15:53:08 crc kubenswrapper[5120]: I0316 15:53:08.268737 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 15:53:08 crc kubenswrapper[5120]: I0316 15:53:08.269442 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ceilometer-internal-svc\"" Mar 16 15:53:08 crc kubenswrapper[5120]: I0316 15:53:08.368574 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8821dbd3-25f2-44ea-8a41-e716db08960a-config-data\") pod \"ceilometer-0\" (UID: \"8821dbd3-25f2-44ea-8a41-e716db08960a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:53:08 crc kubenswrapper[5120]: I0316 15:53:08.368715 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8821dbd3-25f2-44ea-8a41-e716db08960a-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"8821dbd3-25f2-44ea-8a41-e716db08960a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:53:08 crc kubenswrapper[5120]: I0316 15:53:08.368780 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/8821dbd3-25f2-44ea-8a41-e716db08960a-run-httpd\") pod \"ceilometer-0\" (UID: \"8821dbd3-25f2-44ea-8a41-e716db08960a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:53:08 crc kubenswrapper[5120]: I0316 15:53:08.368802 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/8821dbd3-25f2-44ea-8a41-e716db08960a-log-httpd\") pod \"ceilometer-0\" (UID: \"8821dbd3-25f2-44ea-8a41-e716db08960a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:53:08 crc kubenswrapper[5120]: I0316 15:53:08.368867 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/8821dbd3-25f2-44ea-8a41-e716db08960a-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"8821dbd3-25f2-44ea-8a41-e716db08960a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:53:08 crc kubenswrapper[5120]: I0316 15:53:08.368893 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/8821dbd3-25f2-44ea-8a41-e716db08960a-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"8821dbd3-25f2-44ea-8a41-e716db08960a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:53:08 crc kubenswrapper[5120]: I0316 15:53:08.368992 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zttjr\" (UniqueName: \"kubernetes.io/projected/8821dbd3-25f2-44ea-8a41-e716db08960a-kube-api-access-zttjr\") pod \"ceilometer-0\" (UID: \"8821dbd3-25f2-44ea-8a41-e716db08960a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:53:08 crc kubenswrapper[5120]: I0316 15:53:08.369029 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8821dbd3-25f2-44ea-8a41-e716db08960a-scripts\") pod \"ceilometer-0\" (UID: \"8821dbd3-25f2-44ea-8a41-e716db08960a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:53:08 crc kubenswrapper[5120]: I0316 15:53:08.470690 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/8821dbd3-25f2-44ea-8a41-e716db08960a-log-httpd\") pod \"ceilometer-0\" (UID: \"8821dbd3-25f2-44ea-8a41-e716db08960a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:53:08 crc kubenswrapper[5120]: I0316 15:53:08.470780 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/8821dbd3-25f2-44ea-8a41-e716db08960a-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"8821dbd3-25f2-44ea-8a41-e716db08960a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:53:08 crc kubenswrapper[5120]: I0316 15:53:08.470817 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/8821dbd3-25f2-44ea-8a41-e716db08960a-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"8821dbd3-25f2-44ea-8a41-e716db08960a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:53:08 crc kubenswrapper[5120]: I0316 15:53:08.470853 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zttjr\" (UniqueName: \"kubernetes.io/projected/8821dbd3-25f2-44ea-8a41-e716db08960a-kube-api-access-zttjr\") pod \"ceilometer-0\" (UID: \"8821dbd3-25f2-44ea-8a41-e716db08960a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:53:08 crc kubenswrapper[5120]: I0316 15:53:08.470897 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8821dbd3-25f2-44ea-8a41-e716db08960a-scripts\") pod \"ceilometer-0\" (UID: \"8821dbd3-25f2-44ea-8a41-e716db08960a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:53:08 crc kubenswrapper[5120]: I0316 15:53:08.470936 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8821dbd3-25f2-44ea-8a41-e716db08960a-config-data\") pod \"ceilometer-0\" (UID: \"8821dbd3-25f2-44ea-8a41-e716db08960a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:53:08 crc kubenswrapper[5120]: I0316 15:53:08.471027 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8821dbd3-25f2-44ea-8a41-e716db08960a-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"8821dbd3-25f2-44ea-8a41-e716db08960a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:53:08 crc kubenswrapper[5120]: I0316 15:53:08.471046 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/8821dbd3-25f2-44ea-8a41-e716db08960a-run-httpd\") pod \"ceilometer-0\" (UID: \"8821dbd3-25f2-44ea-8a41-e716db08960a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:53:08 crc kubenswrapper[5120]: I0316 15:53:08.471256 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/8821dbd3-25f2-44ea-8a41-e716db08960a-log-httpd\") pod \"ceilometer-0\" (UID: \"8821dbd3-25f2-44ea-8a41-e716db08960a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:53:08 crc kubenswrapper[5120]: I0316 15:53:08.471426 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/8821dbd3-25f2-44ea-8a41-e716db08960a-run-httpd\") pod \"ceilometer-0\" (UID: \"8821dbd3-25f2-44ea-8a41-e716db08960a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:53:08 crc kubenswrapper[5120]: I0316 15:53:08.480590 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/8821dbd3-25f2-44ea-8a41-e716db08960a-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"8821dbd3-25f2-44ea-8a41-e716db08960a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:53:08 crc kubenswrapper[5120]: I0316 15:53:08.480640 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8821dbd3-25f2-44ea-8a41-e716db08960a-scripts\") pod \"ceilometer-0\" (UID: \"8821dbd3-25f2-44ea-8a41-e716db08960a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:53:08 crc kubenswrapper[5120]: I0316 15:53:08.480679 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/8821dbd3-25f2-44ea-8a41-e716db08960a-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"8821dbd3-25f2-44ea-8a41-e716db08960a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:53:08 crc kubenswrapper[5120]: I0316 15:53:08.480920 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8821dbd3-25f2-44ea-8a41-e716db08960a-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"8821dbd3-25f2-44ea-8a41-e716db08960a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:53:08 crc kubenswrapper[5120]: I0316 15:53:08.481150 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8821dbd3-25f2-44ea-8a41-e716db08960a-config-data\") pod \"ceilometer-0\" (UID: \"8821dbd3-25f2-44ea-8a41-e716db08960a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:53:08 crc kubenswrapper[5120]: I0316 15:53:08.496349 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zttjr\" (UniqueName: \"kubernetes.io/projected/8821dbd3-25f2-44ea-8a41-e716db08960a-kube-api-access-zttjr\") pod \"ceilometer-0\" (UID: \"8821dbd3-25f2-44ea-8a41-e716db08960a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:53:08 crc kubenswrapper[5120]: I0316 15:53:08.584972 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:53:08 crc kubenswrapper[5120]: I0316 15:53:08.683239 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="07680162-1363-450f-ab98-79c21a0f63d1" path="/var/lib/kubelet/pods/07680162-1363-450f-ab98-79c21a0f63d1/volumes" Mar 16 15:53:08 crc kubenswrapper[5120]: I0316 15:53:08.910572 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:53:08 crc kubenswrapper[5120]: I0316 15:53:08.983007 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/14708e2c-1f13-42eb-a497-936d4740e6dd-config-data\") pod \"14708e2c-1f13-42eb-a497-936d4740e6dd\" (UID: \"14708e2c-1f13-42eb-a497-936d4740e6dd\") " Mar 16 15:53:08 crc kubenswrapper[5120]: I0316 15:53:08.983136 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/14708e2c-1f13-42eb-a497-936d4740e6dd-combined-ca-bundle\") pod \"14708e2c-1f13-42eb-a497-936d4740e6dd\" (UID: \"14708e2c-1f13-42eb-a497-936d4740e6dd\") " Mar 16 15:53:08 crc kubenswrapper[5120]: I0316 15:53:08.983205 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/14708e2c-1f13-42eb-a497-936d4740e6dd-logs\") pod \"14708e2c-1f13-42eb-a497-936d4740e6dd\" (UID: \"14708e2c-1f13-42eb-a497-936d4740e6dd\") " Mar 16 15:53:08 crc kubenswrapper[5120]: I0316 15:53:08.983314 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4jlgh\" (UniqueName: \"kubernetes.io/projected/14708e2c-1f13-42eb-a497-936d4740e6dd-kube-api-access-4jlgh\") pod \"14708e2c-1f13-42eb-a497-936d4740e6dd\" (UID: \"14708e2c-1f13-42eb-a497-936d4740e6dd\") " Mar 16 15:53:08 crc kubenswrapper[5120]: I0316 15:53:08.984244 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14708e2c-1f13-42eb-a497-936d4740e6dd-logs" (OuterVolumeSpecName: "logs") pod "14708e2c-1f13-42eb-a497-936d4740e6dd" (UID: "14708e2c-1f13-42eb-a497-936d4740e6dd"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:53:08 crc kubenswrapper[5120]: I0316 15:53:08.989201 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14708e2c-1f13-42eb-a497-936d4740e6dd-kube-api-access-4jlgh" (OuterVolumeSpecName: "kube-api-access-4jlgh") pod "14708e2c-1f13-42eb-a497-936d4740e6dd" (UID: "14708e2c-1f13-42eb-a497-936d4740e6dd"). InnerVolumeSpecName "kube-api-access-4jlgh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:53:09 crc kubenswrapper[5120]: I0316 15:53:09.013797 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/14708e2c-1f13-42eb-a497-936d4740e6dd-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "14708e2c-1f13-42eb-a497-936d4740e6dd" (UID: "14708e2c-1f13-42eb-a497-936d4740e6dd"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:53:09 crc kubenswrapper[5120]: I0316 15:53:09.020687 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/14708e2c-1f13-42eb-a497-936d4740e6dd-config-data" (OuterVolumeSpecName: "config-data") pod "14708e2c-1f13-42eb-a497-936d4740e6dd" (UID: "14708e2c-1f13-42eb-a497-936d4740e6dd"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:53:09 crc kubenswrapper[5120]: I0316 15:53:09.084974 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/14708e2c-1f13-42eb-a497-936d4740e6dd-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:09 crc kubenswrapper[5120]: I0316 15:53:09.085013 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/14708e2c-1f13-42eb-a497-936d4740e6dd-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:09 crc kubenswrapper[5120]: I0316 15:53:09.085032 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/14708e2c-1f13-42eb-a497-936d4740e6dd-logs\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:09 crc kubenswrapper[5120]: I0316 15:53:09.085044 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4jlgh\" (UniqueName: \"kubernetes.io/projected/14708e2c-1f13-42eb-a497-936d4740e6dd-kube-api-access-4jlgh\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:09 crc kubenswrapper[5120]: I0316 15:53:09.118958 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 15:53:09 crc kubenswrapper[5120]: W0316 15:53:09.130076 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8821dbd3_25f2_44ea_8a41_e716db08960a.slice/crio-ca834119cebad66de811752202fe0279a13858cdf62952538bf1a4bb923ee1d2 WatchSource:0}: Error finding container ca834119cebad66de811752202fe0279a13858cdf62952538bf1a4bb923ee1d2: Status 404 returned error can't find the container with id ca834119cebad66de811752202fe0279a13858cdf62952538bf1a4bb923ee1d2 Mar 16 15:53:09 crc kubenswrapper[5120]: I0316 15:53:09.152986 5120 generic.go:358] "Generic (PLEG): container finished" podID="14708e2c-1f13-42eb-a497-936d4740e6dd" containerID="19433ed16699721c47bc0145ce1b7a985002a978b53eb58e34003d7952113fa0" exitCode=0 Mar 16 15:53:09 crc kubenswrapper[5120]: I0316 15:53:09.153060 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"14708e2c-1f13-42eb-a497-936d4740e6dd","Type":"ContainerDied","Data":"19433ed16699721c47bc0145ce1b7a985002a978b53eb58e34003d7952113fa0"} Mar 16 15:53:09 crc kubenswrapper[5120]: I0316 15:53:09.153088 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"14708e2c-1f13-42eb-a497-936d4740e6dd","Type":"ContainerDied","Data":"f9a488602ea07f8b9c26ec638df462ef6a7e30c90acb086e5a4c9aea0c2065cd"} Mar 16 15:53:09 crc kubenswrapper[5120]: I0316 15:53:09.153105 5120 scope.go:117] "RemoveContainer" containerID="19433ed16699721c47bc0145ce1b7a985002a978b53eb58e34003d7952113fa0" Mar 16 15:53:09 crc kubenswrapper[5120]: I0316 15:53:09.153107 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:53:09 crc kubenswrapper[5120]: I0316 15:53:09.155227 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"8821dbd3-25f2-44ea-8a41-e716db08960a","Type":"ContainerStarted","Data":"ca834119cebad66de811752202fe0279a13858cdf62952538bf1a4bb923ee1d2"} Mar 16 15:53:09 crc kubenswrapper[5120]: I0316 15:53:09.197272 5120 scope.go:117] "RemoveContainer" containerID="1f4a64432fb92fcc671b7dd4b1fc066758b00a9a0acdbc7bd202be5dddf2d314" Mar 16 15:53:09 crc kubenswrapper[5120]: I0316 15:53:09.206020 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 15:53:09 crc kubenswrapper[5120]: I0316 15:53:09.222811 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 15:53:09 crc kubenswrapper[5120]: I0316 15:53:09.233478 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 15:53:09 crc kubenswrapper[5120]: I0316 15:53:09.234818 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14708e2c-1f13-42eb-a497-936d4740e6dd" containerName="nova-api-log" Mar 16 15:53:09 crc kubenswrapper[5120]: I0316 15:53:09.234840 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="14708e2c-1f13-42eb-a497-936d4740e6dd" containerName="nova-api-log" Mar 16 15:53:09 crc kubenswrapper[5120]: I0316 15:53:09.234854 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14708e2c-1f13-42eb-a497-936d4740e6dd" containerName="nova-api-api" Mar 16 15:53:09 crc kubenswrapper[5120]: I0316 15:53:09.234863 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="14708e2c-1f13-42eb-a497-936d4740e6dd" containerName="nova-api-api" Mar 16 15:53:09 crc kubenswrapper[5120]: I0316 15:53:09.235089 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="14708e2c-1f13-42eb-a497-936d4740e6dd" containerName="nova-api-log" Mar 16 15:53:09 crc kubenswrapper[5120]: I0316 15:53:09.235114 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="14708e2c-1f13-42eb-a497-936d4740e6dd" containerName="nova-api-api" Mar 16 15:53:09 crc kubenswrapper[5120]: I0316 15:53:09.238794 5120 scope.go:117] "RemoveContainer" containerID="19433ed16699721c47bc0145ce1b7a985002a978b53eb58e34003d7952113fa0" Mar 16 15:53:09 crc kubenswrapper[5120]: E0316 15:53:09.240834 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"19433ed16699721c47bc0145ce1b7a985002a978b53eb58e34003d7952113fa0\": container with ID starting with 19433ed16699721c47bc0145ce1b7a985002a978b53eb58e34003d7952113fa0 not found: ID does not exist" containerID="19433ed16699721c47bc0145ce1b7a985002a978b53eb58e34003d7952113fa0" Mar 16 15:53:09 crc kubenswrapper[5120]: I0316 15:53:09.240908 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19433ed16699721c47bc0145ce1b7a985002a978b53eb58e34003d7952113fa0"} err="failed to get container status \"19433ed16699721c47bc0145ce1b7a985002a978b53eb58e34003d7952113fa0\": rpc error: code = NotFound desc = could not find container \"19433ed16699721c47bc0145ce1b7a985002a978b53eb58e34003d7952113fa0\": container with ID starting with 19433ed16699721c47bc0145ce1b7a985002a978b53eb58e34003d7952113fa0 not found: ID does not exist" Mar 16 15:53:09 crc kubenswrapper[5120]: I0316 15:53:09.240969 5120 scope.go:117] "RemoveContainer" containerID="1f4a64432fb92fcc671b7dd4b1fc066758b00a9a0acdbc7bd202be5dddf2d314" Mar 16 15:53:09 crc kubenswrapper[5120]: E0316 15:53:09.241488 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f4a64432fb92fcc671b7dd4b1fc066758b00a9a0acdbc7bd202be5dddf2d314\": container with ID starting with 1f4a64432fb92fcc671b7dd4b1fc066758b00a9a0acdbc7bd202be5dddf2d314 not found: ID does not exist" containerID="1f4a64432fb92fcc671b7dd4b1fc066758b00a9a0acdbc7bd202be5dddf2d314" Mar 16 15:53:09 crc kubenswrapper[5120]: I0316 15:53:09.241521 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f4a64432fb92fcc671b7dd4b1fc066758b00a9a0acdbc7bd202be5dddf2d314"} err="failed to get container status \"1f4a64432fb92fcc671b7dd4b1fc066758b00a9a0acdbc7bd202be5dddf2d314\": rpc error: code = NotFound desc = could not find container \"1f4a64432fb92fcc671b7dd4b1fc066758b00a9a0acdbc7bd202be5dddf2d314\": container with ID starting with 1f4a64432fb92fcc671b7dd4b1fc066758b00a9a0acdbc7bd202be5dddf2d314 not found: ID does not exist" Mar 16 15:53:09 crc kubenswrapper[5120]: I0316 15:53:09.247070 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 15:53:09 crc kubenswrapper[5120]: I0316 15:53:09.247187 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:53:09 crc kubenswrapper[5120]: I0316 15:53:09.273903 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-config-data\"" Mar 16 15:53:09 crc kubenswrapper[5120]: I0316 15:53:09.274440 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-public-svc\"" Mar 16 15:53:09 crc kubenswrapper[5120]: I0316 15:53:09.275538 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-internal-svc\"" Mar 16 15:53:09 crc kubenswrapper[5120]: I0316 15:53:09.288404 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/812a582b-3d7b-44bd-962b-a4aae169e36e-logs\") pod \"nova-api-0\" (UID: \"812a582b-3d7b-44bd-962b-a4aae169e36e\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:53:09 crc kubenswrapper[5120]: I0316 15:53:09.288453 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/812a582b-3d7b-44bd-962b-a4aae169e36e-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"812a582b-3d7b-44bd-962b-a4aae169e36e\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:53:09 crc kubenswrapper[5120]: I0316 15:53:09.288516 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/812a582b-3d7b-44bd-962b-a4aae169e36e-public-tls-certs\") pod \"nova-api-0\" (UID: \"812a582b-3d7b-44bd-962b-a4aae169e36e\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:53:09 crc kubenswrapper[5120]: I0316 15:53:09.288552 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/812a582b-3d7b-44bd-962b-a4aae169e36e-internal-tls-certs\") pod \"nova-api-0\" (UID: \"812a582b-3d7b-44bd-962b-a4aae169e36e\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:53:09 crc kubenswrapper[5120]: I0316 15:53:09.288595 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/812a582b-3d7b-44bd-962b-a4aae169e36e-config-data\") pod \"nova-api-0\" (UID: \"812a582b-3d7b-44bd-962b-a4aae169e36e\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:53:09 crc kubenswrapper[5120]: I0316 15:53:09.288708 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2fbg\" (UniqueName: \"kubernetes.io/projected/812a582b-3d7b-44bd-962b-a4aae169e36e-kube-api-access-p2fbg\") pod \"nova-api-0\" (UID: \"812a582b-3d7b-44bd-962b-a4aae169e36e\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:53:09 crc kubenswrapper[5120]: I0316 15:53:09.391148 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/812a582b-3d7b-44bd-962b-a4aae169e36e-logs\") pod \"nova-api-0\" (UID: \"812a582b-3d7b-44bd-962b-a4aae169e36e\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:53:09 crc kubenswrapper[5120]: I0316 15:53:09.391247 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/812a582b-3d7b-44bd-962b-a4aae169e36e-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"812a582b-3d7b-44bd-962b-a4aae169e36e\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:53:09 crc kubenswrapper[5120]: I0316 15:53:09.391351 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/812a582b-3d7b-44bd-962b-a4aae169e36e-public-tls-certs\") pod \"nova-api-0\" (UID: \"812a582b-3d7b-44bd-962b-a4aae169e36e\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:53:09 crc kubenswrapper[5120]: I0316 15:53:09.391395 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/812a582b-3d7b-44bd-962b-a4aae169e36e-internal-tls-certs\") pod \"nova-api-0\" (UID: \"812a582b-3d7b-44bd-962b-a4aae169e36e\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:53:09 crc kubenswrapper[5120]: I0316 15:53:09.391469 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/812a582b-3d7b-44bd-962b-a4aae169e36e-config-data\") pod \"nova-api-0\" (UID: \"812a582b-3d7b-44bd-962b-a4aae169e36e\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:53:09 crc kubenswrapper[5120]: I0316 15:53:09.391643 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p2fbg\" (UniqueName: \"kubernetes.io/projected/812a582b-3d7b-44bd-962b-a4aae169e36e-kube-api-access-p2fbg\") pod \"nova-api-0\" (UID: \"812a582b-3d7b-44bd-962b-a4aae169e36e\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:53:09 crc kubenswrapper[5120]: I0316 15:53:09.391790 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/812a582b-3d7b-44bd-962b-a4aae169e36e-logs\") pod \"nova-api-0\" (UID: \"812a582b-3d7b-44bd-962b-a4aae169e36e\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:53:09 crc kubenswrapper[5120]: I0316 15:53:09.397532 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/812a582b-3d7b-44bd-962b-a4aae169e36e-internal-tls-certs\") pod \"nova-api-0\" (UID: \"812a582b-3d7b-44bd-962b-a4aae169e36e\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:53:09 crc kubenswrapper[5120]: I0316 15:53:09.397811 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/812a582b-3d7b-44bd-962b-a4aae169e36e-public-tls-certs\") pod \"nova-api-0\" (UID: \"812a582b-3d7b-44bd-962b-a4aae169e36e\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:53:09 crc kubenswrapper[5120]: I0316 15:53:09.398032 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/812a582b-3d7b-44bd-962b-a4aae169e36e-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"812a582b-3d7b-44bd-962b-a4aae169e36e\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:53:09 crc kubenswrapper[5120]: I0316 15:53:09.399376 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/812a582b-3d7b-44bd-962b-a4aae169e36e-config-data\") pod \"nova-api-0\" (UID: \"812a582b-3d7b-44bd-962b-a4aae169e36e\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:53:09 crc kubenswrapper[5120]: I0316 15:53:09.409913 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2fbg\" (UniqueName: \"kubernetes.io/projected/812a582b-3d7b-44bd-962b-a4aae169e36e-kube-api-access-p2fbg\") pod \"nova-api-0\" (UID: \"812a582b-3d7b-44bd-962b-a4aae169e36e\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:53:09 crc kubenswrapper[5120]: I0316 15:53:09.604253 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:53:10 crc kubenswrapper[5120]: I0316 15:53:10.107904 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 15:53:10 crc kubenswrapper[5120]: W0316 15:53:10.119905 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod812a582b_3d7b_44bd_962b_a4aae169e36e.slice/crio-3f3f26aa0919c9c7cd1272e8f9b47f243d6c9ff016b1ccba5cd9e0e2991d8ba3 WatchSource:0}: Error finding container 3f3f26aa0919c9c7cd1272e8f9b47f243d6c9ff016b1ccba5cd9e0e2991d8ba3: Status 404 returned error can't find the container with id 3f3f26aa0919c9c7cd1272e8f9b47f243d6c9ff016b1ccba5cd9e0e2991d8ba3 Mar 16 15:53:10 crc kubenswrapper[5120]: I0316 15:53:10.173420 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"8821dbd3-25f2-44ea-8a41-e716db08960a","Type":"ContainerStarted","Data":"ae70819b9a1f84ddd33ad93962ec42573aee9adbc472f37bb2fafc17feabaa45"} Mar 16 15:53:10 crc kubenswrapper[5120]: I0316 15:53:10.175297 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"812a582b-3d7b-44bd-962b-a4aae169e36e","Type":"ContainerStarted","Data":"3f3f26aa0919c9c7cd1272e8f9b47f243d6c9ff016b1ccba5cd9e0e2991d8ba3"} Mar 16 15:53:10 crc kubenswrapper[5120]: I0316 15:53:10.473417 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 15:53:10 crc kubenswrapper[5120]: I0316 15:53:10.510859 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 15:53:10 crc kubenswrapper[5120]: I0316 15:53:10.677503 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="14708e2c-1f13-42eb-a497-936d4740e6dd" path="/var/lib/kubelet/pods/14708e2c-1f13-42eb-a497-936d4740e6dd/volumes" Mar 16 15:53:11 crc kubenswrapper[5120]: I0316 15:53:11.226031 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"8821dbd3-25f2-44ea-8a41-e716db08960a","Type":"ContainerStarted","Data":"644887079b1213997556ab399de2c246219f6ab30fc16e674faf786eacb49089"} Mar 16 15:53:11 crc kubenswrapper[5120]: I0316 15:53:11.226301 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"8821dbd3-25f2-44ea-8a41-e716db08960a","Type":"ContainerStarted","Data":"90908bbbef74b7f5e704e8c24916f04d08ee29789fc078f939aaa8b2aa2fd831"} Mar 16 15:53:11 crc kubenswrapper[5120]: I0316 15:53:11.229569 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"812a582b-3d7b-44bd-962b-a4aae169e36e","Type":"ContainerStarted","Data":"768bcfca5bf0baee03b9f24b316ecf2d9c878f88b3e389eeaea4bec695e113be"} Mar 16 15:53:11 crc kubenswrapper[5120]: I0316 15:53:11.229606 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"812a582b-3d7b-44bd-962b-a4aae169e36e","Type":"ContainerStarted","Data":"2cfd699cee3b922f92c25e44c596bd02d24b5ca28ddd7e21dcdcaa5a2c496490"} Mar 16 15:53:11 crc kubenswrapper[5120]: I0316 15:53:11.250177 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 15:53:11 crc kubenswrapper[5120]: I0316 15:53:11.253725 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=2.2537098970000002 podStartE2EDuration="2.253709897s" podCreationTimestamp="2026-03-16 15:53:09 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:53:11.246639432 +0000 UTC m=+1293.400571099" watchObservedRunningTime="2026-03-16 15:53:11.253709897 +0000 UTC m=+1293.407641564" Mar 16 15:53:11 crc kubenswrapper[5120]: I0316 15:53:11.397371 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-flqm5"] Mar 16 15:53:11 crc kubenswrapper[5120]: I0316 15:53:11.405545 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-flqm5" Mar 16 15:53:11 crc kubenswrapper[5120]: I0316 15:53:11.409065 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-manage-config-data\"" Mar 16 15:53:11 crc kubenswrapper[5120]: I0316 15:53:11.409300 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-manage-scripts\"" Mar 16 15:53:11 crc kubenswrapper[5120]: I0316 15:53:11.411548 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-flqm5"] Mar 16 15:53:11 crc kubenswrapper[5120]: I0316 15:53:11.538345 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4a404dfb-ccf0-45a1-9166-7edce8f368bb-combined-ca-bundle\") pod \"nova-cell1-cell-mapping-flqm5\" (UID: \"4a404dfb-ccf0-45a1-9166-7edce8f368bb\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-flqm5" Mar 16 15:53:11 crc kubenswrapper[5120]: I0316 15:53:11.538618 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4a404dfb-ccf0-45a1-9166-7edce8f368bb-config-data\") pod \"nova-cell1-cell-mapping-flqm5\" (UID: \"4a404dfb-ccf0-45a1-9166-7edce8f368bb\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-flqm5" Mar 16 15:53:11 crc kubenswrapper[5120]: I0316 15:53:11.538664 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dmkn\" (UniqueName: \"kubernetes.io/projected/4a404dfb-ccf0-45a1-9166-7edce8f368bb-kube-api-access-8dmkn\") pod \"nova-cell1-cell-mapping-flqm5\" (UID: \"4a404dfb-ccf0-45a1-9166-7edce8f368bb\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-flqm5" Mar 16 15:53:11 crc kubenswrapper[5120]: I0316 15:53:11.538813 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4a404dfb-ccf0-45a1-9166-7edce8f368bb-scripts\") pod \"nova-cell1-cell-mapping-flqm5\" (UID: \"4a404dfb-ccf0-45a1-9166-7edce8f368bb\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-flqm5" Mar 16 15:53:11 crc kubenswrapper[5120]: I0316 15:53:11.640581 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4a404dfb-ccf0-45a1-9166-7edce8f368bb-scripts\") pod \"nova-cell1-cell-mapping-flqm5\" (UID: \"4a404dfb-ccf0-45a1-9166-7edce8f368bb\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-flqm5" Mar 16 15:53:11 crc kubenswrapper[5120]: I0316 15:53:11.640669 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4a404dfb-ccf0-45a1-9166-7edce8f368bb-combined-ca-bundle\") pod \"nova-cell1-cell-mapping-flqm5\" (UID: \"4a404dfb-ccf0-45a1-9166-7edce8f368bb\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-flqm5" Mar 16 15:53:11 crc kubenswrapper[5120]: I0316 15:53:11.640827 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4a404dfb-ccf0-45a1-9166-7edce8f368bb-config-data\") pod \"nova-cell1-cell-mapping-flqm5\" (UID: \"4a404dfb-ccf0-45a1-9166-7edce8f368bb\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-flqm5" Mar 16 15:53:11 crc kubenswrapper[5120]: I0316 15:53:11.640849 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8dmkn\" (UniqueName: \"kubernetes.io/projected/4a404dfb-ccf0-45a1-9166-7edce8f368bb-kube-api-access-8dmkn\") pod \"nova-cell1-cell-mapping-flqm5\" (UID: \"4a404dfb-ccf0-45a1-9166-7edce8f368bb\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-flqm5" Mar 16 15:53:11 crc kubenswrapper[5120]: I0316 15:53:11.648284 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4a404dfb-ccf0-45a1-9166-7edce8f368bb-combined-ca-bundle\") pod \"nova-cell1-cell-mapping-flqm5\" (UID: \"4a404dfb-ccf0-45a1-9166-7edce8f368bb\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-flqm5" Mar 16 15:53:11 crc kubenswrapper[5120]: I0316 15:53:11.657349 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4a404dfb-ccf0-45a1-9166-7edce8f368bb-scripts\") pod \"nova-cell1-cell-mapping-flqm5\" (UID: \"4a404dfb-ccf0-45a1-9166-7edce8f368bb\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-flqm5" Mar 16 15:53:11 crc kubenswrapper[5120]: I0316 15:53:11.657896 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4a404dfb-ccf0-45a1-9166-7edce8f368bb-config-data\") pod \"nova-cell1-cell-mapping-flqm5\" (UID: \"4a404dfb-ccf0-45a1-9166-7edce8f368bb\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-flqm5" Mar 16 15:53:11 crc kubenswrapper[5120]: I0316 15:53:11.661204 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dmkn\" (UniqueName: \"kubernetes.io/projected/4a404dfb-ccf0-45a1-9166-7edce8f368bb-kube-api-access-8dmkn\") pod \"nova-cell1-cell-mapping-flqm5\" (UID: \"4a404dfb-ccf0-45a1-9166-7edce8f368bb\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-flqm5" Mar 16 15:53:11 crc kubenswrapper[5120]: I0316 15:53:11.736144 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-flqm5" Mar 16 15:53:12 crc kubenswrapper[5120]: I0316 15:53:12.183731 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-flqm5"] Mar 16 15:53:12 crc kubenswrapper[5120]: I0316 15:53:12.241248 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-flqm5" event={"ID":"4a404dfb-ccf0-45a1-9166-7edce8f368bb","Type":"ContainerStarted","Data":"a5598a878fbde6bca8d9b041f5eb2451a8fabd2df274da758f72c09485c080ae"} Mar 16 15:53:13 crc kubenswrapper[5120]: I0316 15:53:13.255534 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-flqm5" event={"ID":"4a404dfb-ccf0-45a1-9166-7edce8f368bb","Type":"ContainerStarted","Data":"960a8598b16a294e272eac94b9f4e5d72aa2390affa2adf49235bad7731bf776"} Mar 16 15:53:13 crc kubenswrapper[5120]: I0316 15:53:13.291147 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-flqm5" podStartSLOduration=2.291114493 podStartE2EDuration="2.291114493s" podCreationTimestamp="2026-03-16 15:53:11 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:53:13.287281297 +0000 UTC m=+1295.441212974" watchObservedRunningTime="2026-03-16 15:53:13.291114493 +0000 UTC m=+1295.445046180" Mar 16 15:53:14 crc kubenswrapper[5120]: I0316 15:53:14.270912 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"8821dbd3-25f2-44ea-8a41-e716db08960a","Type":"ContainerStarted","Data":"c10a021b8eb3c6d7e0a7d62489b393cff613269c9c5979e7ef8c0dc2960ee167"} Mar 16 15:53:14 crc kubenswrapper[5120]: I0316 15:53:14.271598 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:53:14 crc kubenswrapper[5120]: I0316 15:53:14.320209 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.069402427 podStartE2EDuration="6.320187648s" podCreationTimestamp="2026-03-16 15:53:08 +0000 UTC" firstStartedPulling="2026-03-16 15:53:09.132742729 +0000 UTC m=+1291.286674406" lastFinishedPulling="2026-03-16 15:53:13.38352793 +0000 UTC m=+1295.537459627" observedRunningTime="2026-03-16 15:53:14.316047093 +0000 UTC m=+1296.469978780" watchObservedRunningTime="2026-03-16 15:53:14.320187648 +0000 UTC m=+1296.474119335" Mar 16 15:53:17 crc kubenswrapper[5120]: I0316 15:53:17.309125 5120 generic.go:358] "Generic (PLEG): container finished" podID="4a404dfb-ccf0-45a1-9166-7edce8f368bb" containerID="960a8598b16a294e272eac94b9f4e5d72aa2390affa2adf49235bad7731bf776" exitCode=0 Mar 16 15:53:17 crc kubenswrapper[5120]: I0316 15:53:17.309226 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-flqm5" event={"ID":"4a404dfb-ccf0-45a1-9166-7edce8f368bb","Type":"ContainerDied","Data":"960a8598b16a294e272eac94b9f4e5d72aa2390affa2adf49235bad7731bf776"} Mar 16 15:53:18 crc kubenswrapper[5120]: I0316 15:53:18.865150 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-flqm5" Mar 16 15:53:18 crc kubenswrapper[5120]: I0316 15:53:18.943912 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4a404dfb-ccf0-45a1-9166-7edce8f368bb-combined-ca-bundle\") pod \"4a404dfb-ccf0-45a1-9166-7edce8f368bb\" (UID: \"4a404dfb-ccf0-45a1-9166-7edce8f368bb\") " Mar 16 15:53:18 crc kubenswrapper[5120]: I0316 15:53:18.944000 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4a404dfb-ccf0-45a1-9166-7edce8f368bb-config-data\") pod \"4a404dfb-ccf0-45a1-9166-7edce8f368bb\" (UID: \"4a404dfb-ccf0-45a1-9166-7edce8f368bb\") " Mar 16 15:53:18 crc kubenswrapper[5120]: I0316 15:53:18.944072 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8dmkn\" (UniqueName: \"kubernetes.io/projected/4a404dfb-ccf0-45a1-9166-7edce8f368bb-kube-api-access-8dmkn\") pod \"4a404dfb-ccf0-45a1-9166-7edce8f368bb\" (UID: \"4a404dfb-ccf0-45a1-9166-7edce8f368bb\") " Mar 16 15:53:18 crc kubenswrapper[5120]: I0316 15:53:18.944457 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4a404dfb-ccf0-45a1-9166-7edce8f368bb-scripts\") pod \"4a404dfb-ccf0-45a1-9166-7edce8f368bb\" (UID: \"4a404dfb-ccf0-45a1-9166-7edce8f368bb\") " Mar 16 15:53:18 crc kubenswrapper[5120]: I0316 15:53:18.951016 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4a404dfb-ccf0-45a1-9166-7edce8f368bb-scripts" (OuterVolumeSpecName: "scripts") pod "4a404dfb-ccf0-45a1-9166-7edce8f368bb" (UID: "4a404dfb-ccf0-45a1-9166-7edce8f368bb"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:53:18 crc kubenswrapper[5120]: I0316 15:53:18.951421 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a404dfb-ccf0-45a1-9166-7edce8f368bb-kube-api-access-8dmkn" (OuterVolumeSpecName: "kube-api-access-8dmkn") pod "4a404dfb-ccf0-45a1-9166-7edce8f368bb" (UID: "4a404dfb-ccf0-45a1-9166-7edce8f368bb"). InnerVolumeSpecName "kube-api-access-8dmkn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:53:18 crc kubenswrapper[5120]: I0316 15:53:18.971296 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4a404dfb-ccf0-45a1-9166-7edce8f368bb-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "4a404dfb-ccf0-45a1-9166-7edce8f368bb" (UID: "4a404dfb-ccf0-45a1-9166-7edce8f368bb"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:53:18 crc kubenswrapper[5120]: I0316 15:53:18.989311 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4a404dfb-ccf0-45a1-9166-7edce8f368bb-config-data" (OuterVolumeSpecName: "config-data") pod "4a404dfb-ccf0-45a1-9166-7edce8f368bb" (UID: "4a404dfb-ccf0-45a1-9166-7edce8f368bb"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:53:19 crc kubenswrapper[5120]: I0316 15:53:19.046918 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4a404dfb-ccf0-45a1-9166-7edce8f368bb-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:19 crc kubenswrapper[5120]: I0316 15:53:19.046952 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4a404dfb-ccf0-45a1-9166-7edce8f368bb-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:19 crc kubenswrapper[5120]: I0316 15:53:19.046967 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8dmkn\" (UniqueName: \"kubernetes.io/projected/4a404dfb-ccf0-45a1-9166-7edce8f368bb-kube-api-access-8dmkn\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:19 crc kubenswrapper[5120]: I0316 15:53:19.046981 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4a404dfb-ccf0-45a1-9166-7edce8f368bb-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:19 crc kubenswrapper[5120]: I0316 15:53:19.336185 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-flqm5" Mar 16 15:53:19 crc kubenswrapper[5120]: I0316 15:53:19.336194 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-flqm5" event={"ID":"4a404dfb-ccf0-45a1-9166-7edce8f368bb","Type":"ContainerDied","Data":"a5598a878fbde6bca8d9b041f5eb2451a8fabd2df274da758f72c09485c080ae"} Mar 16 15:53:19 crc kubenswrapper[5120]: I0316 15:53:19.336793 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a5598a878fbde6bca8d9b041f5eb2451a8fabd2df274da758f72c09485c080ae" Mar 16 15:53:19 crc kubenswrapper[5120]: I0316 15:53:19.525088 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 15:53:19 crc kubenswrapper[5120]: I0316 15:53:19.525822 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="812a582b-3d7b-44bd-962b-a4aae169e36e" containerName="nova-api-log" containerID="cri-o://2cfd699cee3b922f92c25e44c596bd02d24b5ca28ddd7e21dcdcaa5a2c496490" gracePeriod=30 Mar 16 15:53:19 crc kubenswrapper[5120]: I0316 15:53:19.525870 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="812a582b-3d7b-44bd-962b-a4aae169e36e" containerName="nova-api-api" containerID="cri-o://768bcfca5bf0baee03b9f24b316ecf2d9c878f88b3e389eeaea4bec695e113be" gracePeriod=30 Mar 16 15:53:19 crc kubenswrapper[5120]: I0316 15:53:19.544676 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 15:53:19 crc kubenswrapper[5120]: I0316 15:53:19.544999 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="0fe72247-ecd0-4575-b917-8a771cf54c73" containerName="nova-scheduler-scheduler" containerID="cri-o://2d7287fd3073fb997048ec5e0b4370bc45178dc7304d248e4d1e646ddf5d53c2" gracePeriod=30 Mar 16 15:53:19 crc kubenswrapper[5120]: I0316 15:53:19.557212 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 15:53:19 crc kubenswrapper[5120]: I0316 15:53:19.558451 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="c71e60fb-75b4-4e87-87f8-949ab6109fff" containerName="nova-metadata-log" containerID="cri-o://938c954d1b7935bb0fe0fc1de8ab80ac21886768833b5b175a924f31c5b0dbfb" gracePeriod=30 Mar 16 15:53:19 crc kubenswrapper[5120]: I0316 15:53:19.558597 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="c71e60fb-75b4-4e87-87f8-949ab6109fff" containerName="nova-metadata-metadata" containerID="cri-o://25f72262d2ce8347e4d2db02c0e4aa8f57350ecb59f2d535a4229dd8b5d5cad5" gracePeriod=30 Mar 16 15:53:20 crc kubenswrapper[5120]: I0316 15:53:20.128180 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:53:20 crc kubenswrapper[5120]: I0316 15:53:20.171630 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/812a582b-3d7b-44bd-962b-a4aae169e36e-logs\") pod \"812a582b-3d7b-44bd-962b-a4aae169e36e\" (UID: \"812a582b-3d7b-44bd-962b-a4aae169e36e\") " Mar 16 15:53:20 crc kubenswrapper[5120]: I0316 15:53:20.171817 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/812a582b-3d7b-44bd-962b-a4aae169e36e-combined-ca-bundle\") pod \"812a582b-3d7b-44bd-962b-a4aae169e36e\" (UID: \"812a582b-3d7b-44bd-962b-a4aae169e36e\") " Mar 16 15:53:20 crc kubenswrapper[5120]: I0316 15:53:20.171905 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p2fbg\" (UniqueName: \"kubernetes.io/projected/812a582b-3d7b-44bd-962b-a4aae169e36e-kube-api-access-p2fbg\") pod \"812a582b-3d7b-44bd-962b-a4aae169e36e\" (UID: \"812a582b-3d7b-44bd-962b-a4aae169e36e\") " Mar 16 15:53:20 crc kubenswrapper[5120]: I0316 15:53:20.172163 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/812a582b-3d7b-44bd-962b-a4aae169e36e-public-tls-certs\") pod \"812a582b-3d7b-44bd-962b-a4aae169e36e\" (UID: \"812a582b-3d7b-44bd-962b-a4aae169e36e\") " Mar 16 15:53:20 crc kubenswrapper[5120]: I0316 15:53:20.172282 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/812a582b-3d7b-44bd-962b-a4aae169e36e-config-data\") pod \"812a582b-3d7b-44bd-962b-a4aae169e36e\" (UID: \"812a582b-3d7b-44bd-962b-a4aae169e36e\") " Mar 16 15:53:20 crc kubenswrapper[5120]: I0316 15:53:20.172418 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/812a582b-3d7b-44bd-962b-a4aae169e36e-internal-tls-certs\") pod \"812a582b-3d7b-44bd-962b-a4aae169e36e\" (UID: \"812a582b-3d7b-44bd-962b-a4aae169e36e\") " Mar 16 15:53:20 crc kubenswrapper[5120]: I0316 15:53:20.173848 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/812a582b-3d7b-44bd-962b-a4aae169e36e-logs" (OuterVolumeSpecName: "logs") pod "812a582b-3d7b-44bd-962b-a4aae169e36e" (UID: "812a582b-3d7b-44bd-962b-a4aae169e36e"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:53:20 crc kubenswrapper[5120]: I0316 15:53:20.178454 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/812a582b-3d7b-44bd-962b-a4aae169e36e-kube-api-access-p2fbg" (OuterVolumeSpecName: "kube-api-access-p2fbg") pod "812a582b-3d7b-44bd-962b-a4aae169e36e" (UID: "812a582b-3d7b-44bd-962b-a4aae169e36e"). InnerVolumeSpecName "kube-api-access-p2fbg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:53:20 crc kubenswrapper[5120]: I0316 15:53:20.216189 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/812a582b-3d7b-44bd-962b-a4aae169e36e-config-data" (OuterVolumeSpecName: "config-data") pod "812a582b-3d7b-44bd-962b-a4aae169e36e" (UID: "812a582b-3d7b-44bd-962b-a4aae169e36e"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:53:20 crc kubenswrapper[5120]: I0316 15:53:20.226770 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/812a582b-3d7b-44bd-962b-a4aae169e36e-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "812a582b-3d7b-44bd-962b-a4aae169e36e" (UID: "812a582b-3d7b-44bd-962b-a4aae169e36e"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:53:20 crc kubenswrapper[5120]: I0316 15:53:20.232907 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/812a582b-3d7b-44bd-962b-a4aae169e36e-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "812a582b-3d7b-44bd-962b-a4aae169e36e" (UID: "812a582b-3d7b-44bd-962b-a4aae169e36e"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:53:20 crc kubenswrapper[5120]: I0316 15:53:20.262501 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/812a582b-3d7b-44bd-962b-a4aae169e36e-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "812a582b-3d7b-44bd-962b-a4aae169e36e" (UID: "812a582b-3d7b-44bd-962b-a4aae169e36e"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:53:20 crc kubenswrapper[5120]: I0316 15:53:20.276668 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/812a582b-3d7b-44bd-962b-a4aae169e36e-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:20 crc kubenswrapper[5120]: I0316 15:53:20.276694 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/812a582b-3d7b-44bd-962b-a4aae169e36e-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:20 crc kubenswrapper[5120]: I0316 15:53:20.276703 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/812a582b-3d7b-44bd-962b-a4aae169e36e-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:20 crc kubenswrapper[5120]: I0316 15:53:20.276712 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/812a582b-3d7b-44bd-962b-a4aae169e36e-logs\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:20 crc kubenswrapper[5120]: I0316 15:53:20.276719 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/812a582b-3d7b-44bd-962b-a4aae169e36e-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:20 crc kubenswrapper[5120]: I0316 15:53:20.276730 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p2fbg\" (UniqueName: \"kubernetes.io/projected/812a582b-3d7b-44bd-962b-a4aae169e36e-kube-api-access-p2fbg\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:20 crc kubenswrapper[5120]: I0316 15:53:20.372229 5120 generic.go:358] "Generic (PLEG): container finished" podID="c71e60fb-75b4-4e87-87f8-949ab6109fff" containerID="938c954d1b7935bb0fe0fc1de8ab80ac21886768833b5b175a924f31c5b0dbfb" exitCode=143 Mar 16 15:53:20 crc kubenswrapper[5120]: I0316 15:53:20.372394 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"c71e60fb-75b4-4e87-87f8-949ab6109fff","Type":"ContainerDied","Data":"938c954d1b7935bb0fe0fc1de8ab80ac21886768833b5b175a924f31c5b0dbfb"} Mar 16 15:53:20 crc kubenswrapper[5120]: I0316 15:53:20.374944 5120 generic.go:358] "Generic (PLEG): container finished" podID="0fe72247-ecd0-4575-b917-8a771cf54c73" containerID="2d7287fd3073fb997048ec5e0b4370bc45178dc7304d248e4d1e646ddf5d53c2" exitCode=0 Mar 16 15:53:20 crc kubenswrapper[5120]: I0316 15:53:20.375079 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"0fe72247-ecd0-4575-b917-8a771cf54c73","Type":"ContainerDied","Data":"2d7287fd3073fb997048ec5e0b4370bc45178dc7304d248e4d1e646ddf5d53c2"} Mar 16 15:53:20 crc kubenswrapper[5120]: I0316 15:53:20.376664 5120 generic.go:358] "Generic (PLEG): container finished" podID="812a582b-3d7b-44bd-962b-a4aae169e36e" containerID="768bcfca5bf0baee03b9f24b316ecf2d9c878f88b3e389eeaea4bec695e113be" exitCode=0 Mar 16 15:53:20 crc kubenswrapper[5120]: I0316 15:53:20.376680 5120 generic.go:358] "Generic (PLEG): container finished" podID="812a582b-3d7b-44bd-962b-a4aae169e36e" containerID="2cfd699cee3b922f92c25e44c596bd02d24b5ca28ddd7e21dcdcaa5a2c496490" exitCode=143 Mar 16 15:53:20 crc kubenswrapper[5120]: I0316 15:53:20.376835 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"812a582b-3d7b-44bd-962b-a4aae169e36e","Type":"ContainerDied","Data":"768bcfca5bf0baee03b9f24b316ecf2d9c878f88b3e389eeaea4bec695e113be"} Mar 16 15:53:20 crc kubenswrapper[5120]: I0316 15:53:20.376850 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"812a582b-3d7b-44bd-962b-a4aae169e36e","Type":"ContainerDied","Data":"2cfd699cee3b922f92c25e44c596bd02d24b5ca28ddd7e21dcdcaa5a2c496490"} Mar 16 15:53:20 crc kubenswrapper[5120]: I0316 15:53:20.376860 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"812a582b-3d7b-44bd-962b-a4aae169e36e","Type":"ContainerDied","Data":"3f3f26aa0919c9c7cd1272e8f9b47f243d6c9ff016b1ccba5cd9e0e2991d8ba3"} Mar 16 15:53:20 crc kubenswrapper[5120]: I0316 15:53:20.376874 5120 scope.go:117] "RemoveContainer" containerID="768bcfca5bf0baee03b9f24b316ecf2d9c878f88b3e389eeaea4bec695e113be" Mar 16 15:53:20 crc kubenswrapper[5120]: I0316 15:53:20.377005 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:53:20 crc kubenswrapper[5120]: I0316 15:53:20.400670 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 15:53:20 crc kubenswrapper[5120]: I0316 15:53:20.410683 5120 scope.go:117] "RemoveContainer" containerID="2cfd699cee3b922f92c25e44c596bd02d24b5ca28ddd7e21dcdcaa5a2c496490" Mar 16 15:53:20 crc kubenswrapper[5120]: I0316 15:53:20.438346 5120 scope.go:117] "RemoveContainer" containerID="768bcfca5bf0baee03b9f24b316ecf2d9c878f88b3e389eeaea4bec695e113be" Mar 16 15:53:20 crc kubenswrapper[5120]: E0316 15:53:20.438708 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"768bcfca5bf0baee03b9f24b316ecf2d9c878f88b3e389eeaea4bec695e113be\": container with ID starting with 768bcfca5bf0baee03b9f24b316ecf2d9c878f88b3e389eeaea4bec695e113be not found: ID does not exist" containerID="768bcfca5bf0baee03b9f24b316ecf2d9c878f88b3e389eeaea4bec695e113be" Mar 16 15:53:20 crc kubenswrapper[5120]: I0316 15:53:20.438739 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"768bcfca5bf0baee03b9f24b316ecf2d9c878f88b3e389eeaea4bec695e113be"} err="failed to get container status \"768bcfca5bf0baee03b9f24b316ecf2d9c878f88b3e389eeaea4bec695e113be\": rpc error: code = NotFound desc = could not find container \"768bcfca5bf0baee03b9f24b316ecf2d9c878f88b3e389eeaea4bec695e113be\": container with ID starting with 768bcfca5bf0baee03b9f24b316ecf2d9c878f88b3e389eeaea4bec695e113be not found: ID does not exist" Mar 16 15:53:20 crc kubenswrapper[5120]: I0316 15:53:20.438880 5120 scope.go:117] "RemoveContainer" containerID="2cfd699cee3b922f92c25e44c596bd02d24b5ca28ddd7e21dcdcaa5a2c496490" Mar 16 15:53:20 crc kubenswrapper[5120]: E0316 15:53:20.440102 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2cfd699cee3b922f92c25e44c596bd02d24b5ca28ddd7e21dcdcaa5a2c496490\": container with ID starting with 2cfd699cee3b922f92c25e44c596bd02d24b5ca28ddd7e21dcdcaa5a2c496490 not found: ID does not exist" containerID="2cfd699cee3b922f92c25e44c596bd02d24b5ca28ddd7e21dcdcaa5a2c496490" Mar 16 15:53:20 crc kubenswrapper[5120]: I0316 15:53:20.440127 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2cfd699cee3b922f92c25e44c596bd02d24b5ca28ddd7e21dcdcaa5a2c496490"} err="failed to get container status \"2cfd699cee3b922f92c25e44c596bd02d24b5ca28ddd7e21dcdcaa5a2c496490\": rpc error: code = NotFound desc = could not find container \"2cfd699cee3b922f92c25e44c596bd02d24b5ca28ddd7e21dcdcaa5a2c496490\": container with ID starting with 2cfd699cee3b922f92c25e44c596bd02d24b5ca28ddd7e21dcdcaa5a2c496490 not found: ID does not exist" Mar 16 15:53:20 crc kubenswrapper[5120]: I0316 15:53:20.440141 5120 scope.go:117] "RemoveContainer" containerID="768bcfca5bf0baee03b9f24b316ecf2d9c878f88b3e389eeaea4bec695e113be" Mar 16 15:53:20 crc kubenswrapper[5120]: I0316 15:53:20.440312 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"768bcfca5bf0baee03b9f24b316ecf2d9c878f88b3e389eeaea4bec695e113be"} err="failed to get container status \"768bcfca5bf0baee03b9f24b316ecf2d9c878f88b3e389eeaea4bec695e113be\": rpc error: code = NotFound desc = could not find container \"768bcfca5bf0baee03b9f24b316ecf2d9c878f88b3e389eeaea4bec695e113be\": container with ID starting with 768bcfca5bf0baee03b9f24b316ecf2d9c878f88b3e389eeaea4bec695e113be not found: ID does not exist" Mar 16 15:53:20 crc kubenswrapper[5120]: I0316 15:53:20.440331 5120 scope.go:117] "RemoveContainer" containerID="2cfd699cee3b922f92c25e44c596bd02d24b5ca28ddd7e21dcdcaa5a2c496490" Mar 16 15:53:20 crc kubenswrapper[5120]: I0316 15:53:20.440678 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2cfd699cee3b922f92c25e44c596bd02d24b5ca28ddd7e21dcdcaa5a2c496490"} err="failed to get container status \"2cfd699cee3b922f92c25e44c596bd02d24b5ca28ddd7e21dcdcaa5a2c496490\": rpc error: code = NotFound desc = could not find container \"2cfd699cee3b922f92c25e44c596bd02d24b5ca28ddd7e21dcdcaa5a2c496490\": container with ID starting with 2cfd699cee3b922f92c25e44c596bd02d24b5ca28ddd7e21dcdcaa5a2c496490 not found: ID does not exist" Mar 16 15:53:20 crc kubenswrapper[5120]: I0316 15:53:20.454467 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 15:53:20 crc kubenswrapper[5120]: I0316 15:53:20.465476 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 15:53:20 crc kubenswrapper[5120]: I0316 15:53:20.487813 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 15:53:20 crc kubenswrapper[5120]: I0316 15:53:20.490088 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0fe72247-ecd0-4575-b917-8a771cf54c73" containerName="nova-scheduler-scheduler" Mar 16 15:53:20 crc kubenswrapper[5120]: I0316 15:53:20.490112 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="0fe72247-ecd0-4575-b917-8a771cf54c73" containerName="nova-scheduler-scheduler" Mar 16 15:53:20 crc kubenswrapper[5120]: I0316 15:53:20.490140 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="812a582b-3d7b-44bd-962b-a4aae169e36e" containerName="nova-api-api" Mar 16 15:53:20 crc kubenswrapper[5120]: I0316 15:53:20.490146 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="812a582b-3d7b-44bd-962b-a4aae169e36e" containerName="nova-api-api" Mar 16 15:53:20 crc kubenswrapper[5120]: I0316 15:53:20.490162 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a404dfb-ccf0-45a1-9166-7edce8f368bb" containerName="nova-manage" Mar 16 15:53:20 crc kubenswrapper[5120]: I0316 15:53:20.490168 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a404dfb-ccf0-45a1-9166-7edce8f368bb" containerName="nova-manage" Mar 16 15:53:20 crc kubenswrapper[5120]: I0316 15:53:20.490178 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="812a582b-3d7b-44bd-962b-a4aae169e36e" containerName="nova-api-log" Mar 16 15:53:20 crc kubenswrapper[5120]: I0316 15:53:20.490183 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="812a582b-3d7b-44bd-962b-a4aae169e36e" containerName="nova-api-log" Mar 16 15:53:20 crc kubenswrapper[5120]: I0316 15:53:20.490340 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="0fe72247-ecd0-4575-b917-8a771cf54c73" containerName="nova-scheduler-scheduler" Mar 16 15:53:20 crc kubenswrapper[5120]: I0316 15:53:20.490358 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="812a582b-3d7b-44bd-962b-a4aae169e36e" containerName="nova-api-api" Mar 16 15:53:20 crc kubenswrapper[5120]: I0316 15:53:20.490366 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="812a582b-3d7b-44bd-962b-a4aae169e36e" containerName="nova-api-log" Mar 16 15:53:20 crc kubenswrapper[5120]: I0316 15:53:20.490373 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="4a404dfb-ccf0-45a1-9166-7edce8f368bb" containerName="nova-manage" Mar 16 15:53:20 crc kubenswrapper[5120]: I0316 15:53:20.491256 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0fe72247-ecd0-4575-b917-8a771cf54c73-config-data\") pod \"0fe72247-ecd0-4575-b917-8a771cf54c73\" (UID: \"0fe72247-ecd0-4575-b917-8a771cf54c73\") " Mar 16 15:53:20 crc kubenswrapper[5120]: I0316 15:53:20.491452 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s67nf\" (UniqueName: \"kubernetes.io/projected/0fe72247-ecd0-4575-b917-8a771cf54c73-kube-api-access-s67nf\") pod \"0fe72247-ecd0-4575-b917-8a771cf54c73\" (UID: \"0fe72247-ecd0-4575-b917-8a771cf54c73\") " Mar 16 15:53:20 crc kubenswrapper[5120]: I0316 15:53:20.491517 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0fe72247-ecd0-4575-b917-8a771cf54c73-combined-ca-bundle\") pod \"0fe72247-ecd0-4575-b917-8a771cf54c73\" (UID: \"0fe72247-ecd0-4575-b917-8a771cf54c73\") " Mar 16 15:53:20 crc kubenswrapper[5120]: I0316 15:53:20.496709 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 15:53:20 crc kubenswrapper[5120]: I0316 15:53:20.496831 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:53:20 crc kubenswrapper[5120]: I0316 15:53:20.500913 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-internal-svc\"" Mar 16 15:53:20 crc kubenswrapper[5120]: I0316 15:53:20.501301 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-public-svc\"" Mar 16 15:53:20 crc kubenswrapper[5120]: I0316 15:53:20.501518 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-config-data\"" Mar 16 15:53:20 crc kubenswrapper[5120]: I0316 15:53:20.506069 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0fe72247-ecd0-4575-b917-8a771cf54c73-kube-api-access-s67nf" (OuterVolumeSpecName: "kube-api-access-s67nf") pod "0fe72247-ecd0-4575-b917-8a771cf54c73" (UID: "0fe72247-ecd0-4575-b917-8a771cf54c73"). InnerVolumeSpecName "kube-api-access-s67nf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:53:20 crc kubenswrapper[5120]: I0316 15:53:20.534338 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0fe72247-ecd0-4575-b917-8a771cf54c73-config-data" (OuterVolumeSpecName: "config-data") pod "0fe72247-ecd0-4575-b917-8a771cf54c73" (UID: "0fe72247-ecd0-4575-b917-8a771cf54c73"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:53:20 crc kubenswrapper[5120]: I0316 15:53:20.535989 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0fe72247-ecd0-4575-b917-8a771cf54c73-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "0fe72247-ecd0-4575-b917-8a771cf54c73" (UID: "0fe72247-ecd0-4575-b917-8a771cf54c73"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:53:20 crc kubenswrapper[5120]: I0316 15:53:20.593739 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6f641d93-c3e7-40c3-8d96-d89b931d18cc-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"6f641d93-c3e7-40c3-8d96-d89b931d18cc\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:53:20 crc kubenswrapper[5120]: I0316 15:53:20.593809 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxndt\" (UniqueName: \"kubernetes.io/projected/6f641d93-c3e7-40c3-8d96-d89b931d18cc-kube-api-access-dxndt\") pod \"nova-api-0\" (UID: \"6f641d93-c3e7-40c3-8d96-d89b931d18cc\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:53:20 crc kubenswrapper[5120]: I0316 15:53:20.593840 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6f641d93-c3e7-40c3-8d96-d89b931d18cc-public-tls-certs\") pod \"nova-api-0\" (UID: \"6f641d93-c3e7-40c3-8d96-d89b931d18cc\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:53:20 crc kubenswrapper[5120]: I0316 15:53:20.594001 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6f641d93-c3e7-40c3-8d96-d89b931d18cc-logs\") pod \"nova-api-0\" (UID: \"6f641d93-c3e7-40c3-8d96-d89b931d18cc\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:53:20 crc kubenswrapper[5120]: I0316 15:53:20.594036 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6f641d93-c3e7-40c3-8d96-d89b931d18cc-config-data\") pod \"nova-api-0\" (UID: \"6f641d93-c3e7-40c3-8d96-d89b931d18cc\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:53:20 crc kubenswrapper[5120]: I0316 15:53:20.594056 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6f641d93-c3e7-40c3-8d96-d89b931d18cc-internal-tls-certs\") pod \"nova-api-0\" (UID: \"6f641d93-c3e7-40c3-8d96-d89b931d18cc\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:53:20 crc kubenswrapper[5120]: I0316 15:53:20.594116 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0fe72247-ecd0-4575-b917-8a771cf54c73-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:20 crc kubenswrapper[5120]: I0316 15:53:20.594132 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0fe72247-ecd0-4575-b917-8a771cf54c73-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:20 crc kubenswrapper[5120]: I0316 15:53:20.594143 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s67nf\" (UniqueName: \"kubernetes.io/projected/0fe72247-ecd0-4575-b917-8a771cf54c73-kube-api-access-s67nf\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:20 crc kubenswrapper[5120]: I0316 15:53:20.673703 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="812a582b-3d7b-44bd-962b-a4aae169e36e" path="/var/lib/kubelet/pods/812a582b-3d7b-44bd-962b-a4aae169e36e/volumes" Mar 16 15:53:20 crc kubenswrapper[5120]: I0316 15:53:20.695914 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6f641d93-c3e7-40c3-8d96-d89b931d18cc-logs\") pod \"nova-api-0\" (UID: \"6f641d93-c3e7-40c3-8d96-d89b931d18cc\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:53:20 crc kubenswrapper[5120]: I0316 15:53:20.696423 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6f641d93-c3e7-40c3-8d96-d89b931d18cc-config-data\") pod \"nova-api-0\" (UID: \"6f641d93-c3e7-40c3-8d96-d89b931d18cc\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:53:20 crc kubenswrapper[5120]: I0316 15:53:20.696369 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6f641d93-c3e7-40c3-8d96-d89b931d18cc-logs\") pod \"nova-api-0\" (UID: \"6f641d93-c3e7-40c3-8d96-d89b931d18cc\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:53:20 crc kubenswrapper[5120]: I0316 15:53:20.696499 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6f641d93-c3e7-40c3-8d96-d89b931d18cc-internal-tls-certs\") pod \"nova-api-0\" (UID: \"6f641d93-c3e7-40c3-8d96-d89b931d18cc\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:53:20 crc kubenswrapper[5120]: I0316 15:53:20.697055 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6f641d93-c3e7-40c3-8d96-d89b931d18cc-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"6f641d93-c3e7-40c3-8d96-d89b931d18cc\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:53:20 crc kubenswrapper[5120]: I0316 15:53:20.697079 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dxndt\" (UniqueName: \"kubernetes.io/projected/6f641d93-c3e7-40c3-8d96-d89b931d18cc-kube-api-access-dxndt\") pod \"nova-api-0\" (UID: \"6f641d93-c3e7-40c3-8d96-d89b931d18cc\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:53:20 crc kubenswrapper[5120]: I0316 15:53:20.697097 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6f641d93-c3e7-40c3-8d96-d89b931d18cc-public-tls-certs\") pod \"nova-api-0\" (UID: \"6f641d93-c3e7-40c3-8d96-d89b931d18cc\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:53:20 crc kubenswrapper[5120]: I0316 15:53:20.699812 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6f641d93-c3e7-40c3-8d96-d89b931d18cc-internal-tls-certs\") pod \"nova-api-0\" (UID: \"6f641d93-c3e7-40c3-8d96-d89b931d18cc\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:53:20 crc kubenswrapper[5120]: I0316 15:53:20.700218 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6f641d93-c3e7-40c3-8d96-d89b931d18cc-config-data\") pod \"nova-api-0\" (UID: \"6f641d93-c3e7-40c3-8d96-d89b931d18cc\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:53:20 crc kubenswrapper[5120]: I0316 15:53:20.700348 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6f641d93-c3e7-40c3-8d96-d89b931d18cc-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"6f641d93-c3e7-40c3-8d96-d89b931d18cc\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:53:20 crc kubenswrapper[5120]: I0316 15:53:20.700483 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6f641d93-c3e7-40c3-8d96-d89b931d18cc-public-tls-certs\") pod \"nova-api-0\" (UID: \"6f641d93-c3e7-40c3-8d96-d89b931d18cc\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:53:20 crc kubenswrapper[5120]: I0316 15:53:20.713200 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxndt\" (UniqueName: \"kubernetes.io/projected/6f641d93-c3e7-40c3-8d96-d89b931d18cc-kube-api-access-dxndt\") pod \"nova-api-0\" (UID: \"6f641d93-c3e7-40c3-8d96-d89b931d18cc\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:53:20 crc kubenswrapper[5120]: I0316 15:53:20.821390 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:53:21 crc kubenswrapper[5120]: I0316 15:53:21.272079 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 15:53:21 crc kubenswrapper[5120]: I0316 15:53:21.389745 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"6f641d93-c3e7-40c3-8d96-d89b931d18cc","Type":"ContainerStarted","Data":"2d079b8564bab3642be9de61b938cafc3bce89a9fb5abb08a49b89c06dc9653f"} Mar 16 15:53:21 crc kubenswrapper[5120]: I0316 15:53:21.393361 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 15:53:21 crc kubenswrapper[5120]: I0316 15:53:21.393463 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"0fe72247-ecd0-4575-b917-8a771cf54c73","Type":"ContainerDied","Data":"1789240b7342a55308a955f19e4eb98e03ca50c1d8c6e2b97338f54c4c5e3edf"} Mar 16 15:53:21 crc kubenswrapper[5120]: I0316 15:53:21.393497 5120 scope.go:117] "RemoveContainer" containerID="2d7287fd3073fb997048ec5e0b4370bc45178dc7304d248e4d1e646ddf5d53c2" Mar 16 15:53:21 crc kubenswrapper[5120]: I0316 15:53:21.446384 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 15:53:21 crc kubenswrapper[5120]: I0316 15:53:21.456977 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 15:53:21 crc kubenswrapper[5120]: I0316 15:53:21.467972 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 15:53:21 crc kubenswrapper[5120]: I0316 15:53:21.478335 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 15:53:21 crc kubenswrapper[5120]: I0316 15:53:21.479574 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 15:53:21 crc kubenswrapper[5120]: I0316 15:53:21.481234 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-scheduler-config-data\"" Mar 16 15:53:21 crc kubenswrapper[5120]: I0316 15:53:21.618062 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvqgf\" (UniqueName: \"kubernetes.io/projected/cb25223e-e443-4a56-9b17-d0159918b563-kube-api-access-bvqgf\") pod \"nova-scheduler-0\" (UID: \"cb25223e-e443-4a56-9b17-d0159918b563\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 15:53:21 crc kubenswrapper[5120]: I0316 15:53:21.618486 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cb25223e-e443-4a56-9b17-d0159918b563-config-data\") pod \"nova-scheduler-0\" (UID: \"cb25223e-e443-4a56-9b17-d0159918b563\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 15:53:21 crc kubenswrapper[5120]: I0316 15:53:21.618674 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cb25223e-e443-4a56-9b17-d0159918b563-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"cb25223e-e443-4a56-9b17-d0159918b563\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 15:53:21 crc kubenswrapper[5120]: I0316 15:53:21.720047 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cb25223e-e443-4a56-9b17-d0159918b563-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"cb25223e-e443-4a56-9b17-d0159918b563\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 15:53:21 crc kubenswrapper[5120]: I0316 15:53:21.720592 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bvqgf\" (UniqueName: \"kubernetes.io/projected/cb25223e-e443-4a56-9b17-d0159918b563-kube-api-access-bvqgf\") pod \"nova-scheduler-0\" (UID: \"cb25223e-e443-4a56-9b17-d0159918b563\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 15:53:21 crc kubenswrapper[5120]: I0316 15:53:21.720739 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cb25223e-e443-4a56-9b17-d0159918b563-config-data\") pod \"nova-scheduler-0\" (UID: \"cb25223e-e443-4a56-9b17-d0159918b563\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 15:53:21 crc kubenswrapper[5120]: I0316 15:53:21.725569 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cb25223e-e443-4a56-9b17-d0159918b563-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"cb25223e-e443-4a56-9b17-d0159918b563\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 15:53:21 crc kubenswrapper[5120]: I0316 15:53:21.725737 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cb25223e-e443-4a56-9b17-d0159918b563-config-data\") pod \"nova-scheduler-0\" (UID: \"cb25223e-e443-4a56-9b17-d0159918b563\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 15:53:21 crc kubenswrapper[5120]: I0316 15:53:21.741141 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvqgf\" (UniqueName: \"kubernetes.io/projected/cb25223e-e443-4a56-9b17-d0159918b563-kube-api-access-bvqgf\") pod \"nova-scheduler-0\" (UID: \"cb25223e-e443-4a56-9b17-d0159918b563\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 15:53:21 crc kubenswrapper[5120]: I0316 15:53:21.795151 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 15:53:22 crc kubenswrapper[5120]: I0316 15:53:22.008389 5120 patch_prober.go:28] interesting pod/machine-config-daemon-7bf76 container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 15:53:22 crc kubenswrapper[5120]: I0316 15:53:22.008744 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 15:53:22 crc kubenswrapper[5120]: I0316 15:53:22.276566 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 15:53:22 crc kubenswrapper[5120]: I0316 15:53:22.418892 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"6f641d93-c3e7-40c3-8d96-d89b931d18cc","Type":"ContainerStarted","Data":"f537fe622a6860ac31c69fb493d6675ef968e5c012ab0f4860e1583cc23a4e1b"} Mar 16 15:53:22 crc kubenswrapper[5120]: I0316 15:53:22.419254 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"6f641d93-c3e7-40c3-8d96-d89b931d18cc","Type":"ContainerStarted","Data":"98e806b8d757df5c6012a1ab4db4964a7dc1f33eff452a1bc8ca796b05a78430"} Mar 16 15:53:22 crc kubenswrapper[5120]: I0316 15:53:22.425138 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"cb25223e-e443-4a56-9b17-d0159918b563","Type":"ContainerStarted","Data":"742a62722575f2f3f98c136481494d32cdf7799798baebf5e28af43ea6541e1b"} Mar 16 15:53:22 crc kubenswrapper[5120]: I0316 15:53:22.451067 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=2.451047123 podStartE2EDuration="2.451047123s" podCreationTimestamp="2026-03-16 15:53:20 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:53:22.443172005 +0000 UTC m=+1304.597103662" watchObservedRunningTime="2026-03-16 15:53:22.451047123 +0000 UTC m=+1304.604978780" Mar 16 15:53:22 crc kubenswrapper[5120]: I0316 15:53:22.680058 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0fe72247-ecd0-4575-b917-8a771cf54c73" path="/var/lib/kubelet/pods/0fe72247-ecd0-4575-b917-8a771cf54c73/volumes" Mar 16 15:53:23 crc kubenswrapper[5120]: I0316 15:53:23.200866 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:53:23 crc kubenswrapper[5120]: I0316 15:53:23.349265 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c71e60fb-75b4-4e87-87f8-949ab6109fff-logs\") pod \"c71e60fb-75b4-4e87-87f8-949ab6109fff\" (UID: \"c71e60fb-75b4-4e87-87f8-949ab6109fff\") " Mar 16 15:53:23 crc kubenswrapper[5120]: I0316 15:53:23.349374 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/c71e60fb-75b4-4e87-87f8-949ab6109fff-nova-metadata-tls-certs\") pod \"c71e60fb-75b4-4e87-87f8-949ab6109fff\" (UID: \"c71e60fb-75b4-4e87-87f8-949ab6109fff\") " Mar 16 15:53:23 crc kubenswrapper[5120]: I0316 15:53:23.349750 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c71e60fb-75b4-4e87-87f8-949ab6109fff-logs" (OuterVolumeSpecName: "logs") pod "c71e60fb-75b4-4e87-87f8-949ab6109fff" (UID: "c71e60fb-75b4-4e87-87f8-949ab6109fff"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:53:23 crc kubenswrapper[5120]: I0316 15:53:23.350170 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4t6zm\" (UniqueName: \"kubernetes.io/projected/c71e60fb-75b4-4e87-87f8-949ab6109fff-kube-api-access-4t6zm\") pod \"c71e60fb-75b4-4e87-87f8-949ab6109fff\" (UID: \"c71e60fb-75b4-4e87-87f8-949ab6109fff\") " Mar 16 15:53:23 crc kubenswrapper[5120]: I0316 15:53:23.350206 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c71e60fb-75b4-4e87-87f8-949ab6109fff-combined-ca-bundle\") pod \"c71e60fb-75b4-4e87-87f8-949ab6109fff\" (UID: \"c71e60fb-75b4-4e87-87f8-949ab6109fff\") " Mar 16 15:53:23 crc kubenswrapper[5120]: I0316 15:53:23.350259 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c71e60fb-75b4-4e87-87f8-949ab6109fff-config-data\") pod \"c71e60fb-75b4-4e87-87f8-949ab6109fff\" (UID: \"c71e60fb-75b4-4e87-87f8-949ab6109fff\") " Mar 16 15:53:23 crc kubenswrapper[5120]: I0316 15:53:23.350655 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c71e60fb-75b4-4e87-87f8-949ab6109fff-logs\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:23 crc kubenswrapper[5120]: I0316 15:53:23.359424 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c71e60fb-75b4-4e87-87f8-949ab6109fff-kube-api-access-4t6zm" (OuterVolumeSpecName: "kube-api-access-4t6zm") pod "c71e60fb-75b4-4e87-87f8-949ab6109fff" (UID: "c71e60fb-75b4-4e87-87f8-949ab6109fff"). InnerVolumeSpecName "kube-api-access-4t6zm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:53:23 crc kubenswrapper[5120]: I0316 15:53:23.379623 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c71e60fb-75b4-4e87-87f8-949ab6109fff-config-data" (OuterVolumeSpecName: "config-data") pod "c71e60fb-75b4-4e87-87f8-949ab6109fff" (UID: "c71e60fb-75b4-4e87-87f8-949ab6109fff"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:53:23 crc kubenswrapper[5120]: I0316 15:53:23.389729 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c71e60fb-75b4-4e87-87f8-949ab6109fff-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "c71e60fb-75b4-4e87-87f8-949ab6109fff" (UID: "c71e60fb-75b4-4e87-87f8-949ab6109fff"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:53:23 crc kubenswrapper[5120]: I0316 15:53:23.437960 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c71e60fb-75b4-4e87-87f8-949ab6109fff-nova-metadata-tls-certs" (OuterVolumeSpecName: "nova-metadata-tls-certs") pod "c71e60fb-75b4-4e87-87f8-949ab6109fff" (UID: "c71e60fb-75b4-4e87-87f8-949ab6109fff"). InnerVolumeSpecName "nova-metadata-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:53:23 crc kubenswrapper[5120]: I0316 15:53:23.459941 5120 reconciler_common.go:299] "Volume detached for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/c71e60fb-75b4-4e87-87f8-949ab6109fff-nova-metadata-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:23 crc kubenswrapper[5120]: I0316 15:53:23.459997 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4t6zm\" (UniqueName: \"kubernetes.io/projected/c71e60fb-75b4-4e87-87f8-949ab6109fff-kube-api-access-4t6zm\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:23 crc kubenswrapper[5120]: I0316 15:53:23.460015 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c71e60fb-75b4-4e87-87f8-949ab6109fff-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:23 crc kubenswrapper[5120]: I0316 15:53:23.460029 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c71e60fb-75b4-4e87-87f8-949ab6109fff-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:23 crc kubenswrapper[5120]: I0316 15:53:23.465714 5120 generic.go:358] "Generic (PLEG): container finished" podID="c71e60fb-75b4-4e87-87f8-949ab6109fff" containerID="25f72262d2ce8347e4d2db02c0e4aa8f57350ecb59f2d535a4229dd8b5d5cad5" exitCode=0 Mar 16 15:53:23 crc kubenswrapper[5120]: I0316 15:53:23.466166 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:53:23 crc kubenswrapper[5120]: I0316 15:53:23.469037 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"c71e60fb-75b4-4e87-87f8-949ab6109fff","Type":"ContainerDied","Data":"25f72262d2ce8347e4d2db02c0e4aa8f57350ecb59f2d535a4229dd8b5d5cad5"} Mar 16 15:53:23 crc kubenswrapper[5120]: I0316 15:53:23.469090 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"c71e60fb-75b4-4e87-87f8-949ab6109fff","Type":"ContainerDied","Data":"eab79f1cd9dedeeeda1c95259b8b870d2db4a901594cde81aa021defa2a7e12a"} Mar 16 15:53:23 crc kubenswrapper[5120]: I0316 15:53:23.469108 5120 scope.go:117] "RemoveContainer" containerID="25f72262d2ce8347e4d2db02c0e4aa8f57350ecb59f2d535a4229dd8b5d5cad5" Mar 16 15:53:23 crc kubenswrapper[5120]: I0316 15:53:23.471891 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"cb25223e-e443-4a56-9b17-d0159918b563","Type":"ContainerStarted","Data":"8748dcf62a7cbea6f73e88271be3d579871e9203831b32f0ef2c2b3d64a038b4"} Mar 16 15:53:23 crc kubenswrapper[5120]: I0316 15:53:23.497692 5120 scope.go:117] "RemoveContainer" containerID="938c954d1b7935bb0fe0fc1de8ab80ac21886768833b5b175a924f31c5b0dbfb" Mar 16 15:53:23 crc kubenswrapper[5120]: I0316 15:53:23.504442 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-scheduler-0" podStartSLOduration=2.50442491 podStartE2EDuration="2.50442491s" podCreationTimestamp="2026-03-16 15:53:21 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:53:23.491576765 +0000 UTC m=+1305.645508432" watchObservedRunningTime="2026-03-16 15:53:23.50442491 +0000 UTC m=+1305.658356567" Mar 16 15:53:23 crc kubenswrapper[5120]: I0316 15:53:23.515224 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 15:53:23 crc kubenswrapper[5120]: I0316 15:53:23.518951 5120 scope.go:117] "RemoveContainer" containerID="25f72262d2ce8347e4d2db02c0e4aa8f57350ecb59f2d535a4229dd8b5d5cad5" Mar 16 15:53:23 crc kubenswrapper[5120]: E0316 15:53:23.519378 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"25f72262d2ce8347e4d2db02c0e4aa8f57350ecb59f2d535a4229dd8b5d5cad5\": container with ID starting with 25f72262d2ce8347e4d2db02c0e4aa8f57350ecb59f2d535a4229dd8b5d5cad5 not found: ID does not exist" containerID="25f72262d2ce8347e4d2db02c0e4aa8f57350ecb59f2d535a4229dd8b5d5cad5" Mar 16 15:53:23 crc kubenswrapper[5120]: I0316 15:53:23.519447 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25f72262d2ce8347e4d2db02c0e4aa8f57350ecb59f2d535a4229dd8b5d5cad5"} err="failed to get container status \"25f72262d2ce8347e4d2db02c0e4aa8f57350ecb59f2d535a4229dd8b5d5cad5\": rpc error: code = NotFound desc = could not find container \"25f72262d2ce8347e4d2db02c0e4aa8f57350ecb59f2d535a4229dd8b5d5cad5\": container with ID starting with 25f72262d2ce8347e4d2db02c0e4aa8f57350ecb59f2d535a4229dd8b5d5cad5 not found: ID does not exist" Mar 16 15:53:23 crc kubenswrapper[5120]: I0316 15:53:23.519475 5120 scope.go:117] "RemoveContainer" containerID="938c954d1b7935bb0fe0fc1de8ab80ac21886768833b5b175a924f31c5b0dbfb" Mar 16 15:53:23 crc kubenswrapper[5120]: E0316 15:53:23.521452 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"938c954d1b7935bb0fe0fc1de8ab80ac21886768833b5b175a924f31c5b0dbfb\": container with ID starting with 938c954d1b7935bb0fe0fc1de8ab80ac21886768833b5b175a924f31c5b0dbfb not found: ID does not exist" containerID="938c954d1b7935bb0fe0fc1de8ab80ac21886768833b5b175a924f31c5b0dbfb" Mar 16 15:53:23 crc kubenswrapper[5120]: I0316 15:53:23.521482 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"938c954d1b7935bb0fe0fc1de8ab80ac21886768833b5b175a924f31c5b0dbfb"} err="failed to get container status \"938c954d1b7935bb0fe0fc1de8ab80ac21886768833b5b175a924f31c5b0dbfb\": rpc error: code = NotFound desc = could not find container \"938c954d1b7935bb0fe0fc1de8ab80ac21886768833b5b175a924f31c5b0dbfb\": container with ID starting with 938c954d1b7935bb0fe0fc1de8ab80ac21886768833b5b175a924f31c5b0dbfb not found: ID does not exist" Mar 16 15:53:23 crc kubenswrapper[5120]: I0316 15:53:23.525104 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 15:53:23 crc kubenswrapper[5120]: I0316 15:53:23.534220 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 15:53:23 crc kubenswrapper[5120]: I0316 15:53:23.535927 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c71e60fb-75b4-4e87-87f8-949ab6109fff" containerName="nova-metadata-log" Mar 16 15:53:23 crc kubenswrapper[5120]: I0316 15:53:23.535953 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c71e60fb-75b4-4e87-87f8-949ab6109fff" containerName="nova-metadata-log" Mar 16 15:53:23 crc kubenswrapper[5120]: I0316 15:53:23.535973 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c71e60fb-75b4-4e87-87f8-949ab6109fff" containerName="nova-metadata-metadata" Mar 16 15:53:23 crc kubenswrapper[5120]: I0316 15:53:23.535984 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c71e60fb-75b4-4e87-87f8-949ab6109fff" containerName="nova-metadata-metadata" Mar 16 15:53:23 crc kubenswrapper[5120]: I0316 15:53:23.536312 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c71e60fb-75b4-4e87-87f8-949ab6109fff" containerName="nova-metadata-log" Mar 16 15:53:23 crc kubenswrapper[5120]: I0316 15:53:23.536339 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c71e60fb-75b4-4e87-87f8-949ab6109fff" containerName="nova-metadata-metadata" Mar 16 15:53:23 crc kubenswrapper[5120]: I0316 15:53:23.547686 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:53:23 crc kubenswrapper[5120]: I0316 15:53:23.550291 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 15:53:23 crc kubenswrapper[5120]: I0316 15:53:23.551049 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-metadata-internal-svc\"" Mar 16 15:53:23 crc kubenswrapper[5120]: I0316 15:53:23.551383 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-metadata-config-data\"" Mar 16 15:53:23 crc kubenswrapper[5120]: I0316 15:53:23.663946 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d51d8732-80e3-463b-b8b0-714f8a2d281f-config-data\") pod \"nova-metadata-0\" (UID: \"d51d8732-80e3-463b-b8b0-714f8a2d281f\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:53:23 crc kubenswrapper[5120]: I0316 15:53:23.664270 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d51d8732-80e3-463b-b8b0-714f8a2d281f-logs\") pod \"nova-metadata-0\" (UID: \"d51d8732-80e3-463b-b8b0-714f8a2d281f\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:53:23 crc kubenswrapper[5120]: I0316 15:53:23.664399 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/d51d8732-80e3-463b-b8b0-714f8a2d281f-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"d51d8732-80e3-463b-b8b0-714f8a2d281f\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:53:23 crc kubenswrapper[5120]: I0316 15:53:23.664547 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lf9w2\" (UniqueName: \"kubernetes.io/projected/d51d8732-80e3-463b-b8b0-714f8a2d281f-kube-api-access-lf9w2\") pod \"nova-metadata-0\" (UID: \"d51d8732-80e3-463b-b8b0-714f8a2d281f\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:53:23 crc kubenswrapper[5120]: I0316 15:53:23.664842 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d51d8732-80e3-463b-b8b0-714f8a2d281f-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"d51d8732-80e3-463b-b8b0-714f8a2d281f\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:53:23 crc kubenswrapper[5120]: I0316 15:53:23.766557 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d51d8732-80e3-463b-b8b0-714f8a2d281f-config-data\") pod \"nova-metadata-0\" (UID: \"d51d8732-80e3-463b-b8b0-714f8a2d281f\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:53:23 crc kubenswrapper[5120]: I0316 15:53:23.766864 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d51d8732-80e3-463b-b8b0-714f8a2d281f-logs\") pod \"nova-metadata-0\" (UID: \"d51d8732-80e3-463b-b8b0-714f8a2d281f\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:53:23 crc kubenswrapper[5120]: I0316 15:53:23.767460 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d51d8732-80e3-463b-b8b0-714f8a2d281f-logs\") pod \"nova-metadata-0\" (UID: \"d51d8732-80e3-463b-b8b0-714f8a2d281f\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:53:23 crc kubenswrapper[5120]: I0316 15:53:23.767599 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/d51d8732-80e3-463b-b8b0-714f8a2d281f-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"d51d8732-80e3-463b-b8b0-714f8a2d281f\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:53:23 crc kubenswrapper[5120]: I0316 15:53:23.767889 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lf9w2\" (UniqueName: \"kubernetes.io/projected/d51d8732-80e3-463b-b8b0-714f8a2d281f-kube-api-access-lf9w2\") pod \"nova-metadata-0\" (UID: \"d51d8732-80e3-463b-b8b0-714f8a2d281f\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:53:23 crc kubenswrapper[5120]: I0316 15:53:23.768135 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d51d8732-80e3-463b-b8b0-714f8a2d281f-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"d51d8732-80e3-463b-b8b0-714f8a2d281f\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:53:23 crc kubenswrapper[5120]: I0316 15:53:23.772371 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d51d8732-80e3-463b-b8b0-714f8a2d281f-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"d51d8732-80e3-463b-b8b0-714f8a2d281f\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:53:23 crc kubenswrapper[5120]: I0316 15:53:23.772964 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d51d8732-80e3-463b-b8b0-714f8a2d281f-config-data\") pod \"nova-metadata-0\" (UID: \"d51d8732-80e3-463b-b8b0-714f8a2d281f\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:53:23 crc kubenswrapper[5120]: I0316 15:53:23.775363 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/d51d8732-80e3-463b-b8b0-714f8a2d281f-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"d51d8732-80e3-463b-b8b0-714f8a2d281f\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:53:23 crc kubenswrapper[5120]: I0316 15:53:23.785732 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lf9w2\" (UniqueName: \"kubernetes.io/projected/d51d8732-80e3-463b-b8b0-714f8a2d281f-kube-api-access-lf9w2\") pod \"nova-metadata-0\" (UID: \"d51d8732-80e3-463b-b8b0-714f8a2d281f\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:53:23 crc kubenswrapper[5120]: I0316 15:53:23.865971 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:53:24 crc kubenswrapper[5120]: I0316 15:53:24.286343 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 15:53:24 crc kubenswrapper[5120]: W0316 15:53:24.297461 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd51d8732_80e3_463b_b8b0_714f8a2d281f.slice/crio-25f2c8fd64c5c42c7b4f842bd00390d42b17301d271d155e5eb842218e0b7d75 WatchSource:0}: Error finding container 25f2c8fd64c5c42c7b4f842bd00390d42b17301d271d155e5eb842218e0b7d75: Status 404 returned error can't find the container with id 25f2c8fd64c5c42c7b4f842bd00390d42b17301d271d155e5eb842218e0b7d75 Mar 16 15:53:24 crc kubenswrapper[5120]: I0316 15:53:24.482418 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"d51d8732-80e3-463b-b8b0-714f8a2d281f","Type":"ContainerStarted","Data":"2b26dc531a1cf057478a38e2cb256c9931e49568a65df6c5751f0ab2d721a086"} Mar 16 15:53:24 crc kubenswrapper[5120]: I0316 15:53:24.482486 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"d51d8732-80e3-463b-b8b0-714f8a2d281f","Type":"ContainerStarted","Data":"25f2c8fd64c5c42c7b4f842bd00390d42b17301d271d155e5eb842218e0b7d75"} Mar 16 15:53:24 crc kubenswrapper[5120]: I0316 15:53:24.679484 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c71e60fb-75b4-4e87-87f8-949ab6109fff" path="/var/lib/kubelet/pods/c71e60fb-75b4-4e87-87f8-949ab6109fff/volumes" Mar 16 15:53:25 crc kubenswrapper[5120]: I0316 15:53:25.497848 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"d51d8732-80e3-463b-b8b0-714f8a2d281f","Type":"ContainerStarted","Data":"ef458ad073d82c2b8eea756d31ae0425cfc19313825ac6f80468606be451b4ff"} Mar 16 15:53:25 crc kubenswrapper[5120]: I0316 15:53:25.536153 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=2.536133498 podStartE2EDuration="2.536133498s" podCreationTimestamp="2026-03-16 15:53:23 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:53:25.521813582 +0000 UTC m=+1307.675745279" watchObservedRunningTime="2026-03-16 15:53:25.536133498 +0000 UTC m=+1307.690065165" Mar 16 15:53:26 crc kubenswrapper[5120]: I0316 15:53:26.796007 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 15:53:30 crc kubenswrapper[5120]: I0316 15:53:30.822517 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:53:30 crc kubenswrapper[5120]: I0316 15:53:30.823112 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:53:31 crc kubenswrapper[5120]: I0316 15:53:31.796283 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 15:53:31 crc kubenswrapper[5120]: I0316 15:53:31.823909 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 15:53:31 crc kubenswrapper[5120]: I0316 15:53:31.828107 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="6f641d93-c3e7-40c3-8d96-d89b931d18cc" containerName="nova-api-api" probeResult="failure" output="Get \"https://10.217.0.196:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 15:53:31 crc kubenswrapper[5120]: I0316 15:53:31.830991 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="6f641d93-c3e7-40c3-8d96-d89b931d18cc" containerName="nova-api-log" probeResult="failure" output="Get \"https://10.217.0.196:8774/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Mar 16 15:53:32 crc kubenswrapper[5120]: I0316 15:53:32.628918 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 15:53:33 crc kubenswrapper[5120]: I0316 15:53:33.867526 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:53:33 crc kubenswrapper[5120]: I0316 15:53:33.867963 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:53:34 crc kubenswrapper[5120]: I0316 15:53:34.876961 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="d51d8732-80e3-463b-b8b0-714f8a2d281f" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"https://10.217.0.198:8775/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 15:53:34 crc kubenswrapper[5120]: I0316 15:53:34.877037 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="d51d8732-80e3-463b-b8b0-714f8a2d281f" containerName="nova-metadata-log" probeResult="failure" output="Get \"https://10.217.0.198:8775/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Mar 16 15:53:38 crc kubenswrapper[5120]: I0316 15:53:38.822631 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:53:38 crc kubenswrapper[5120]: I0316 15:53:38.823001 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:53:40 crc kubenswrapper[5120]: I0316 15:53:40.834580 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:53:40 crc kubenswrapper[5120]: I0316 15:53:40.835119 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:53:40 crc kubenswrapper[5120]: I0316 15:53:40.840975 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:53:40 crc kubenswrapper[5120]: I0316 15:53:40.842265 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:53:41 crc kubenswrapper[5120]: I0316 15:53:41.867205 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:53:41 crc kubenswrapper[5120]: I0316 15:53:41.867336 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:53:43 crc kubenswrapper[5120]: I0316 15:53:43.879306 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:53:43 crc kubenswrapper[5120]: I0316 15:53:43.880241 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:53:43 crc kubenswrapper[5120]: I0316 15:53:43.900904 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:53:44 crc kubenswrapper[5120]: I0316 15:53:44.730417 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:53:45 crc kubenswrapper[5120]: I0316 15:53:45.297510 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:53:52 crc kubenswrapper[5120]: I0316 15:53:52.007824 5120 patch_prober.go:28] interesting pod/machine-config-daemon-7bf76 container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 15:53:52 crc kubenswrapper[5120]: I0316 15:53:52.008646 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 15:53:52 crc kubenswrapper[5120]: I0316 15:53:52.476811 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 15:53:52 crc kubenswrapper[5120]: I0316 15:53:52.477073 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/openstackclient" podUID="d6f8b8b2-e94a-4c67-9e6d-be16e2acbdcc" containerName="openstackclient" containerID="cri-o://5beb51d5bb791063b06be012ed5435a350b1e205f8fa5e3c6377d8212b33d428" gracePeriod=2 Mar 16 15:53:52 crc kubenswrapper[5120]: I0316 15:53:52.494089 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 15:53:52 crc kubenswrapper[5120]: I0316 15:53:52.507737 5120 status_manager.go:895] "Failed to get status for pod" podUID="d6f8b8b2-e94a-4c67-9e6d-be16e2acbdcc" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 15:53:52 crc kubenswrapper[5120]: I0316 15:53:52.509975 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 15:53:52 crc kubenswrapper[5120]: I0316 15:53:52.510609 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podUID="a7b8bb1c-b58a-43a6-8457-88a025588f1e" containerName="openstack-network-exporter" containerID="cri-o://4e2796b01696c028bbde53b67d3871a746b22ba854168fabf827f2607ee9fe5c" gracePeriod=300 Mar 16 15:53:52 crc kubenswrapper[5120]: I0316 15:53:52.516996 5120 status_manager.go:895] "Failed to get status for pod" podUID="d6f8b8b2-e94a-4c67-9e6d-be16e2acbdcc" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 15:53:52 crc kubenswrapper[5120]: I0316 15:53:52.567579 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 15:53:52 crc kubenswrapper[5120]: I0316 15:53:52.568131 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="176eef56-bc30-4119-8af5-fa1329d63aa2" containerName="glance-log" containerID="cri-o://2f65dec7986bd0522ab520af73feb24ec1981e8d8b3bd281082c4d851a61df1c" gracePeriod=30 Mar 16 15:53:52 crc kubenswrapper[5120]: I0316 15:53:52.568580 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="176eef56-bc30-4119-8af5-fa1329d63aa2" containerName="glance-httpd" containerID="cri-o://544dd46ceb52a8a8952e0260d5780a769952c63f2d32902979fa7e197c0a5577" gracePeriod=30 Mar 16 15:53:52 crc kubenswrapper[5120]: I0316 15:53:52.588023 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 15:53:52 crc kubenswrapper[5120]: I0316 15:53:52.588238 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/memcached-0" podUID="90534d56-28ff-4983-b8ea-be83259ce64d" containerName="memcached" containerID="cri-o://fabcc54b602bf9faf9dc99913094ea0b2e649eaa684c0270cf178d6a7993957a" gracePeriod=30 Mar 16 15:53:52 crc kubenswrapper[5120]: I0316 15:53:52.625315 5120 status_manager.go:905] "Pod was deleted and then recreated, skipping status update" pod="openstack-kuttl-tests/openstackclient" oldPodUID="d6f8b8b2-e94a-4c67-9e6d-be16e2acbdcc" podUID="1b5c827b-214c-452d-bd57-dc21f970d7a4" Mar 16 15:53:52 crc kubenswrapper[5120]: I0316 15:53:52.688947 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 15:53:52 crc kubenswrapper[5120]: I0316 15:53:52.690061 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6f8b8b2-e94a-4c67-9e6d-be16e2acbdcc" containerName="openstackclient" Mar 16 15:53:52 crc kubenswrapper[5120]: I0316 15:53:52.690076 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6f8b8b2-e94a-4c67-9e6d-be16e2acbdcc" containerName="openstackclient" Mar 16 15:53:52 crc kubenswrapper[5120]: I0316 15:53:52.690263 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="d6f8b8b2-e94a-4c67-9e6d-be16e2acbdcc" containerName="openstackclient" Mar 16 15:53:52 crc kubenswrapper[5120]: I0316 15:53:52.695088 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Mar 16 15:53:52 crc kubenswrapper[5120]: I0316 15:53:52.709472 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 15:53:52 crc kubenswrapper[5120]: I0316 15:53:52.745635 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 15:53:52 crc kubenswrapper[5120]: I0316 15:53:52.745949 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="cb25223e-e443-4a56-9b17-d0159918b563" containerName="nova-scheduler-scheduler" containerID="cri-o://8748dcf62a7cbea6f73e88271be3d579871e9203831b32f0ef2c2b3d64a038b4" gracePeriod=30 Mar 16 15:53:52 crc kubenswrapper[5120]: I0316 15:53:52.782828 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 15:53:52 crc kubenswrapper[5120]: I0316 15:53:52.783948 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovn-northd-0" podUID="6ac49efe-dc8a-47b2-9432-afb41c69ebff" containerName="ovn-northd" containerID="cri-o://387a7e18b82c50f51c96a48a6b0e06ca0ff7ee666aa82162ae48b3f8a16f6166" gracePeriod=30 Mar 16 15:53:52 crc kubenswrapper[5120]: I0316 15:53:52.784360 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovn-northd-0" podUID="6ac49efe-dc8a-47b2-9432-afb41c69ebff" containerName="openstack-network-exporter" containerID="cri-o://e5f97b4f3579c3f23b60ed73671c3bb6855051e5aa3db9096db0d9f0c8c645c8" gracePeriod=30 Mar 16 15:53:52 crc kubenswrapper[5120]: I0316 15:53:52.795559 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 15:53:52 crc kubenswrapper[5120]: I0316 15:53:52.795777 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="5888de0f-5da8-4605-aa27-db134fd47b31" containerName="nova-cell0-conductor-conductor" containerID="cri-o://5a00c8f45c647963a8510197f0acdd358ed4e08e0b3eefebcc584d2b7161253e" gracePeriod=30 Mar 16 15:53:52 crc kubenswrapper[5120]: I0316 15:53:52.839970 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-worker-69c8889b9f-sfbxd"] Mar 16 15:53:52 crc kubenswrapper[5120]: I0316 15:53:52.866389 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-69c8889b9f-sfbxd" Mar 16 15:53:52 crc kubenswrapper[5120]: I0316 15:53:52.872049 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1b5c827b-214c-452d-bd57-dc21f970d7a4-combined-ca-bundle\") pod \"openstackclient\" (UID: \"1b5c827b-214c-452d-bd57-dc21f970d7a4\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 15:53:52 crc kubenswrapper[5120]: I0316 15:53:52.872233 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kchr8\" (UniqueName: \"kubernetes.io/projected/1b5c827b-214c-452d-bd57-dc21f970d7a4-kube-api-access-kchr8\") pod \"openstackclient\" (UID: \"1b5c827b-214c-452d-bd57-dc21f970d7a4\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 15:53:52 crc kubenswrapper[5120]: I0316 15:53:52.872356 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/1b5c827b-214c-452d-bd57-dc21f970d7a4-openstack-config-secret\") pod \"openstackclient\" (UID: \"1b5c827b-214c-452d-bd57-dc21f970d7a4\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 15:53:52 crc kubenswrapper[5120]: I0316 15:53:52.872476 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/1b5c827b-214c-452d-bd57-dc21f970d7a4-openstack-config\") pod \"openstackclient\" (UID: \"1b5c827b-214c-452d-bd57-dc21f970d7a4\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 15:53:52 crc kubenswrapper[5120]: I0316 15:53:52.882116 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 15:53:52 crc kubenswrapper[5120]: I0316 15:53:52.882362 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="8d66ce1a-7d4c-4e04-92c9-f86d5ad81fcc" containerName="cinder-scheduler" containerID="cri-o://042e41e723df73b7e7f87e1bf90037fae0d3bd03bbc5432d058acb72b29f7255" gracePeriod=30 Mar 16 15:53:52 crc kubenswrapper[5120]: I0316 15:53:52.882488 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="8d66ce1a-7d4c-4e04-92c9-f86d5ad81fcc" containerName="probe" containerID="cri-o://3f7dde81452f0221434f72a3271f62d13dc8d444913ffecdd1876e8ea04f3e0d" gracePeriod=30 Mar 16 15:53:52 crc kubenswrapper[5120]: I0316 15:53:52.907821 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-7bd99f4458-mgw7m"] Mar 16 15:53:52 crc kubenswrapper[5120]: I0316 15:53:52.913301 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-7bd99f4458-mgw7m" Mar 16 15:53:52 crc kubenswrapper[5120]: I0316 15:53:52.913539 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 15:53:52 crc kubenswrapper[5120]: I0316 15:53:52.913771 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="d51d8732-80e3-463b-b8b0-714f8a2d281f" containerName="nova-metadata-log" containerID="cri-o://2b26dc531a1cf057478a38e2cb256c9931e49568a65df6c5751f0ab2d721a086" gracePeriod=30 Mar 16 15:53:52 crc kubenswrapper[5120]: I0316 15:53:52.913879 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="d51d8732-80e3-463b-b8b0-714f8a2d281f" containerName="nova-metadata-metadata" containerID="cri-o://ef458ad073d82c2b8eea756d31ae0425cfc19313825ac6f80468606be451b4ff" gracePeriod=30 Mar 16 15:53:52 crc kubenswrapper[5120]: I0316 15:53:52.968326 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 15:53:52 crc kubenswrapper[5120]: I0316 15:53:52.968636 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="6f641d93-c3e7-40c3-8d96-d89b931d18cc" containerName="nova-api-log" containerID="cri-o://98e806b8d757df5c6012a1ab4db4964a7dc1f33eff452a1bc8ca796b05a78430" gracePeriod=30 Mar 16 15:53:52 crc kubenswrapper[5120]: I0316 15:53:52.968816 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="6f641d93-c3e7-40c3-8d96-d89b931d18cc" containerName="nova-api-api" containerID="cri-o://f537fe622a6860ac31c69fb493d6675ef968e5c012ab0f4860e1583cc23a4e1b" gracePeriod=30 Mar 16 15:53:52 crc kubenswrapper[5120]: I0316 15:53:52.978802 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/18ef8c0b-e810-48c1-b5a5-43584c591dfa-combined-ca-bundle\") pod \"barbican-worker-69c8889b9f-sfbxd\" (UID: \"18ef8c0b-e810-48c1-b5a5-43584c591dfa\") " pod="openstack-kuttl-tests/barbican-worker-69c8889b9f-sfbxd" Mar 16 15:53:52 crc kubenswrapper[5120]: I0316 15:53:52.978849 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rc5x9\" (UniqueName: \"kubernetes.io/projected/18ef8c0b-e810-48c1-b5a5-43584c591dfa-kube-api-access-rc5x9\") pod \"barbican-worker-69c8889b9f-sfbxd\" (UID: \"18ef8c0b-e810-48c1-b5a5-43584c591dfa\") " pod="openstack-kuttl-tests/barbican-worker-69c8889b9f-sfbxd" Mar 16 15:53:52 crc kubenswrapper[5120]: I0316 15:53:52.978868 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/18ef8c0b-e810-48c1-b5a5-43584c591dfa-config-data-custom\") pod \"barbican-worker-69c8889b9f-sfbxd\" (UID: \"18ef8c0b-e810-48c1-b5a5-43584c591dfa\") " pod="openstack-kuttl-tests/barbican-worker-69c8889b9f-sfbxd" Mar 16 15:53:52 crc kubenswrapper[5120]: I0316 15:53:52.978896 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/1b5c827b-214c-452d-bd57-dc21f970d7a4-openstack-config-secret\") pod \"openstackclient\" (UID: \"1b5c827b-214c-452d-bd57-dc21f970d7a4\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 15:53:52 crc kubenswrapper[5120]: I0316 15:53:52.978949 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/18ef8c0b-e810-48c1-b5a5-43584c591dfa-logs\") pod \"barbican-worker-69c8889b9f-sfbxd\" (UID: \"18ef8c0b-e810-48c1-b5a5-43584c591dfa\") " pod="openstack-kuttl-tests/barbican-worker-69c8889b9f-sfbxd" Mar 16 15:53:52 crc kubenswrapper[5120]: I0316 15:53:52.978986 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/1b5c827b-214c-452d-bd57-dc21f970d7a4-openstack-config\") pod \"openstackclient\" (UID: \"1b5c827b-214c-452d-bd57-dc21f970d7a4\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 15:53:52 crc kubenswrapper[5120]: I0316 15:53:52.979007 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1b5c827b-214c-452d-bd57-dc21f970d7a4-combined-ca-bundle\") pod \"openstackclient\" (UID: \"1b5c827b-214c-452d-bd57-dc21f970d7a4\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 15:53:52 crc kubenswrapper[5120]: I0316 15:53:52.979053 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kchr8\" (UniqueName: \"kubernetes.io/projected/1b5c827b-214c-452d-bd57-dc21f970d7a4-kube-api-access-kchr8\") pod \"openstackclient\" (UID: \"1b5c827b-214c-452d-bd57-dc21f970d7a4\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 15:53:52 crc kubenswrapper[5120]: I0316 15:53:52.979080 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/18ef8c0b-e810-48c1-b5a5-43584c591dfa-config-data\") pod \"barbican-worker-69c8889b9f-sfbxd\" (UID: \"18ef8c0b-e810-48c1-b5a5-43584c591dfa\") " pod="openstack-kuttl-tests/barbican-worker-69c8889b9f-sfbxd" Mar 16 15:53:52 crc kubenswrapper[5120]: I0316 15:53:52.994374 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/1b5c827b-214c-452d-bd57-dc21f970d7a4-openstack-config\") pod \"openstackclient\" (UID: \"1b5c827b-214c-452d-bd57-dc21f970d7a4\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.012966 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1b5c827b-214c-452d-bd57-dc21f970d7a4-combined-ca-bundle\") pod \"openstackclient\" (UID: \"1b5c827b-214c-452d-bd57-dc21f970d7a4\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.033306 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/1b5c827b-214c-452d-bd57-dc21f970d7a4-openstack-config-secret\") pod \"openstackclient\" (UID: \"1b5c827b-214c-452d-bd57-dc21f970d7a4\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.066885 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kchr8\" (UniqueName: \"kubernetes.io/projected/1b5c827b-214c-452d-bd57-dc21f970d7a4-kube-api-access-kchr8\") pod \"openstackclient\" (UID: \"1b5c827b-214c-452d-bd57-dc21f970d7a4\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.071539 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.088920 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/5a0edbf7-738f-4c1a-9333-f23da8ab8067-config-data-custom\") pod \"barbican-keystone-listener-7bd99f4458-mgw7m\" (UID: \"5a0edbf7-738f-4c1a-9333-f23da8ab8067\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7bd99f4458-mgw7m" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.089314 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/18ef8c0b-e810-48c1-b5a5-43584c591dfa-logs\") pod \"barbican-worker-69c8889b9f-sfbxd\" (UID: \"18ef8c0b-e810-48c1-b5a5-43584c591dfa\") " pod="openstack-kuttl-tests/barbican-worker-69c8889b9f-sfbxd" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.095327 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5a0edbf7-738f-4c1a-9333-f23da8ab8067-combined-ca-bundle\") pod \"barbican-keystone-listener-7bd99f4458-mgw7m\" (UID: \"5a0edbf7-738f-4c1a-9333-f23da8ab8067\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7bd99f4458-mgw7m" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.095391 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5a0edbf7-738f-4c1a-9333-f23da8ab8067-config-data\") pod \"barbican-keystone-listener-7bd99f4458-mgw7m\" (UID: \"5a0edbf7-738f-4c1a-9333-f23da8ab8067\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7bd99f4458-mgw7m" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.095445 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/18ef8c0b-e810-48c1-b5a5-43584c591dfa-config-data\") pod \"barbican-worker-69c8889b9f-sfbxd\" (UID: \"18ef8c0b-e810-48c1-b5a5-43584c591dfa\") " pod="openstack-kuttl-tests/barbican-worker-69c8889b9f-sfbxd" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.095554 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vffgg\" (UniqueName: \"kubernetes.io/projected/5a0edbf7-738f-4c1a-9333-f23da8ab8067-kube-api-access-vffgg\") pod \"barbican-keystone-listener-7bd99f4458-mgw7m\" (UID: \"5a0edbf7-738f-4c1a-9333-f23da8ab8067\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7bd99f4458-mgw7m" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.095641 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/18ef8c0b-e810-48c1-b5a5-43584c591dfa-combined-ca-bundle\") pod \"barbican-worker-69c8889b9f-sfbxd\" (UID: \"18ef8c0b-e810-48c1-b5a5-43584c591dfa\") " pod="openstack-kuttl-tests/barbican-worker-69c8889b9f-sfbxd" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.095663 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rc5x9\" (UniqueName: \"kubernetes.io/projected/18ef8c0b-e810-48c1-b5a5-43584c591dfa-kube-api-access-rc5x9\") pod \"barbican-worker-69c8889b9f-sfbxd\" (UID: \"18ef8c0b-e810-48c1-b5a5-43584c591dfa\") " pod="openstack-kuttl-tests/barbican-worker-69c8889b9f-sfbxd" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.095697 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/18ef8c0b-e810-48c1-b5a5-43584c591dfa-config-data-custom\") pod \"barbican-worker-69c8889b9f-sfbxd\" (UID: \"18ef8c0b-e810-48c1-b5a5-43584c591dfa\") " pod="openstack-kuttl-tests/barbican-worker-69c8889b9f-sfbxd" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.095716 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5a0edbf7-738f-4c1a-9333-f23da8ab8067-logs\") pod \"barbican-keystone-listener-7bd99f4458-mgw7m\" (UID: \"5a0edbf7-738f-4c1a-9333-f23da8ab8067\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7bd99f4458-mgw7m" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.100960 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/18ef8c0b-e810-48c1-b5a5-43584c591dfa-logs\") pod \"barbican-worker-69c8889b9f-sfbxd\" (UID: \"18ef8c0b-e810-48c1-b5a5-43584c591dfa\") " pod="openstack-kuttl-tests/barbican-worker-69c8889b9f-sfbxd" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.117809 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/18ef8c0b-e810-48c1-b5a5-43584c591dfa-config-data-custom\") pod \"barbican-worker-69c8889b9f-sfbxd\" (UID: \"18ef8c0b-e810-48c1-b5a5-43584c591dfa\") " pod="openstack-kuttl-tests/barbican-worker-69c8889b9f-sfbxd" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.138030 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/18ef8c0b-e810-48c1-b5a5-43584c591dfa-config-data\") pod \"barbican-worker-69c8889b9f-sfbxd\" (UID: \"18ef8c0b-e810-48c1-b5a5-43584c591dfa\") " pod="openstack-kuttl-tests/barbican-worker-69c8889b9f-sfbxd" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.139279 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/18ef8c0b-e810-48c1-b5a5-43584c591dfa-combined-ca-bundle\") pod \"barbican-worker-69c8889b9f-sfbxd\" (UID: \"18ef8c0b-e810-48c1-b5a5-43584c591dfa\") " pod="openstack-kuttl-tests/barbican-worker-69c8889b9f-sfbxd" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.140600 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rc5x9\" (UniqueName: \"kubernetes.io/projected/18ef8c0b-e810-48c1-b5a5-43584c591dfa-kube-api-access-rc5x9\") pod \"barbican-worker-69c8889b9f-sfbxd\" (UID: \"18ef8c0b-e810-48c1-b5a5-43584c591dfa\") " pod="openstack-kuttl-tests/barbican-worker-69c8889b9f-sfbxd" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.155891 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-7bd99f4458-mgw7m"] Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.186628 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podUID="a7b8bb1c-b58a-43a6-8457-88a025588f1e" containerName="ovsdbserver-nb" containerID="cri-o://a69581666e94e68483b687690686147a201582a36041881db8d8c5e135d82930" gracePeriod=300 Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.201301 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5a0edbf7-738f-4c1a-9333-f23da8ab8067-logs\") pod \"barbican-keystone-listener-7bd99f4458-mgw7m\" (UID: \"5a0edbf7-738f-4c1a-9333-f23da8ab8067\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7bd99f4458-mgw7m" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.201360 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/5a0edbf7-738f-4c1a-9333-f23da8ab8067-config-data-custom\") pod \"barbican-keystone-listener-7bd99f4458-mgw7m\" (UID: \"5a0edbf7-738f-4c1a-9333-f23da8ab8067\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7bd99f4458-mgw7m" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.201442 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5a0edbf7-738f-4c1a-9333-f23da8ab8067-combined-ca-bundle\") pod \"barbican-keystone-listener-7bd99f4458-mgw7m\" (UID: \"5a0edbf7-738f-4c1a-9333-f23da8ab8067\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7bd99f4458-mgw7m" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.201462 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5a0edbf7-738f-4c1a-9333-f23da8ab8067-config-data\") pod \"barbican-keystone-listener-7bd99f4458-mgw7m\" (UID: \"5a0edbf7-738f-4c1a-9333-f23da8ab8067\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7bd99f4458-mgw7m" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.201516 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vffgg\" (UniqueName: \"kubernetes.io/projected/5a0edbf7-738f-4c1a-9333-f23da8ab8067-kube-api-access-vffgg\") pod \"barbican-keystone-listener-7bd99f4458-mgw7m\" (UID: \"5a0edbf7-738f-4c1a-9333-f23da8ab8067\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7bd99f4458-mgw7m" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.204583 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5a0edbf7-738f-4c1a-9333-f23da8ab8067-logs\") pod \"barbican-keystone-listener-7bd99f4458-mgw7m\" (UID: \"5a0edbf7-738f-4c1a-9333-f23da8ab8067\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7bd99f4458-mgw7m" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.207809 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/5a0edbf7-738f-4c1a-9333-f23da8ab8067-config-data-custom\") pod \"barbican-keystone-listener-7bd99f4458-mgw7m\" (UID: \"5a0edbf7-738f-4c1a-9333-f23da8ab8067\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7bd99f4458-mgw7m" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.220844 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.221147 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="d6734794-135c-4f4b-83b6-c64788f83f91" containerName="glance-log" containerID="cri-o://ebdaf82d2a1f7e9acd884bceba81a86e1a13b95df2c0fa6a630cd488d4c95e00" gracePeriod=30 Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.221653 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="d6734794-135c-4f4b-83b6-c64788f83f91" containerName="glance-httpd" containerID="cri-o://89f147b51fe4fc1e87c9c591ecb0db5c3f2e8bd2acb9a6231812f956dd8c36da" gracePeriod=30 Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.226821 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5a0edbf7-738f-4c1a-9333-f23da8ab8067-combined-ca-bundle\") pod \"barbican-keystone-listener-7bd99f4458-mgw7m\" (UID: \"5a0edbf7-738f-4c1a-9333-f23da8ab8067\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7bd99f4458-mgw7m" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.230010 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-69c8889b9f-sfbxd"] Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.230634 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vffgg\" (UniqueName: \"kubernetes.io/projected/5a0edbf7-738f-4c1a-9333-f23da8ab8067-kube-api-access-vffgg\") pod \"barbican-keystone-listener-7bd99f4458-mgw7m\" (UID: \"5a0edbf7-738f-4c1a-9333-f23da8ab8067\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7bd99f4458-mgw7m" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.237947 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.237984 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5a0edbf7-738f-4c1a-9333-f23da8ab8067-config-data\") pod \"barbican-keystone-listener-7bd99f4458-mgw7m\" (UID: \"5a0edbf7-738f-4c1a-9333-f23da8ab8067\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7bd99f4458-mgw7m" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.238248 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="4306304f-eaea-49a1-9e62-9b035dc302de" containerName="cinder-api-log" containerID="cri-o://32dc4affff57e6164d54a3b9adc39549944d248ae17ddcbe6847bc2b8586572c" gracePeriod=30 Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.238332 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="4306304f-eaea-49a1-9e62-9b035dc302de" containerName="cinder-api" containerID="cri-o://1caafbafeede915ee6f4819bb0e0954a636de7eee094105d62e479295fc329c9" gracePeriod=30 Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.263094 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-api-766fb557cd-fwt4z"] Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.278223 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-69c8889b9f-sfbxd" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.300017 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.300060 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.300460 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-766fb557cd-fwt4z" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.301543 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podUID="32f7f790-9e5b-4052-a87d-b3abaa0b3ff0" containerName="nova-cell1-novncproxy-novncproxy" containerID="cri-o://5c27deb51925eebcbc197def4aa61ef6d9334fadb9af36744bc13cd32f16e353" gracePeriod=30 Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.305987 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.306620 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="672accec-238b-4e18-9b15-5ff8429d4256" containerName="account-server" containerID="cri-o://97dd887c89b765ba273f5c85c867a679982fd142722154b57ea21c9d6404dbd7" gracePeriod=30 Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.306740 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="672accec-238b-4e18-9b15-5ff8429d4256" containerName="swift-recon-cron" containerID="cri-o://72332479aa958fc5e61ccf2b6d8d70f6451c35955b231f405b209ee03cac68de" gracePeriod=30 Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.306804 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="672accec-238b-4e18-9b15-5ff8429d4256" containerName="rsync" containerID="cri-o://f5c2fd82b6ea338f7d6c9db503db6e0feda2486b4d73e345ab3733d653dc087e" gracePeriod=30 Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.306840 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="672accec-238b-4e18-9b15-5ff8429d4256" containerName="object-expirer" containerID="cri-o://67a31541ab497c672f2f7e36c23db3fced2a193b78fad102ca2c5246637f56e2" gracePeriod=30 Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.306872 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="672accec-238b-4e18-9b15-5ff8429d4256" containerName="object-updater" containerID="cri-o://7686efc897f2d8fd462eac4cd5a266038ea5acac3f9365c2ddb297ab7f93415f" gracePeriod=30 Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.306903 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="672accec-238b-4e18-9b15-5ff8429d4256" containerName="object-auditor" containerID="cri-o://17d850bf7250355a2f26abed4c26bbd9dedcc1528a02f7aac5161667c10e607e" gracePeriod=30 Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.306933 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="672accec-238b-4e18-9b15-5ff8429d4256" containerName="object-replicator" containerID="cri-o://cde5f856ff99ea7ad37f794396a9dc9df7fc578241b167685629e114bff612a5" gracePeriod=30 Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.308138 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="672accec-238b-4e18-9b15-5ff8429d4256" containerName="object-server" containerID="cri-o://a7e88337bf9943de6762af63123d82ed7ecb5b08d43e604821d3c16b565ebd37" gracePeriod=30 Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.308213 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="672accec-238b-4e18-9b15-5ff8429d4256" containerName="container-updater" containerID="cri-o://fde5fb0b2c5ff4c6662d21de92b6d87f0744f43da51dab65466b8402c59efc3c" gracePeriod=30 Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.308324 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="672accec-238b-4e18-9b15-5ff8429d4256" containerName="container-auditor" containerID="cri-o://f6516b04c93b8952f5f103daeb13d907ded489f3bf8112a5226b3b9e7a344640" gracePeriod=30 Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.308373 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="672accec-238b-4e18-9b15-5ff8429d4256" containerName="container-replicator" containerID="cri-o://11022888adb543c6c9abb0c148040b363e988e74354acd6f81b3a4527faccc7e" gracePeriod=30 Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.308412 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="672accec-238b-4e18-9b15-5ff8429d4256" containerName="container-server" containerID="cri-o://01e871b86564712e3514085f671a2977bc7b524764ad870692c415d42dab6faa" gracePeriod=30 Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.308443 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="672accec-238b-4e18-9b15-5ff8429d4256" containerName="account-reaper" containerID="cri-o://22134ed61214cfcb4b62b61c2c8b66351c620a2ab55a0217bf762503e825f4b9" gracePeriod=30 Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.308473 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="672accec-238b-4e18-9b15-5ff8429d4256" containerName="account-auditor" containerID="cri-o://14ee402c6747f1b4b78b0a77b1edcb405e0f0a750a426e1880c2fc7730c5aeb0" gracePeriod=30 Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.308505 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="672accec-238b-4e18-9b15-5ff8429d4256" containerName="account-replicator" containerID="cri-o://a8d2135db021dc89abaf23da0be3ef286287bc8d9e97e08f5bd37833a8d66250" gracePeriod=30 Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.323386 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-766fb557cd-fwt4z"] Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.347825 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-776d498b58-sb5f8"] Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.358788 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-776d498b58-sb5f8" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.367232 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-776d498b58-sb5f8"] Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.383132 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-6646594584-l84r5"] Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.396598 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-6646594584-l84r5" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.405035 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.406148 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwjj5\" (UniqueName: \"kubernetes.io/projected/26a03664-6cb3-4982-80f5-063d8f12cc2a-kube-api-access-lwjj5\") pod \"barbican-api-766fb557cd-fwt4z\" (UID: \"26a03664-6cb3-4982-80f5-063d8f12cc2a\") " pod="openstack-kuttl-tests/barbican-api-766fb557cd-fwt4z" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.406262 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/26a03664-6cb3-4982-80f5-063d8f12cc2a-config-data\") pod \"barbican-api-766fb557cd-fwt4z\" (UID: \"26a03664-6cb3-4982-80f5-063d8f12cc2a\") " pod="openstack-kuttl-tests/barbican-api-766fb557cd-fwt4z" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.406305 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/26a03664-6cb3-4982-80f5-063d8f12cc2a-public-tls-certs\") pod \"barbican-api-766fb557cd-fwt4z\" (UID: \"26a03664-6cb3-4982-80f5-063d8f12cc2a\") " pod="openstack-kuttl-tests/barbican-api-766fb557cd-fwt4z" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.406329 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/26a03664-6cb3-4982-80f5-063d8f12cc2a-combined-ca-bundle\") pod \"barbican-api-766fb557cd-fwt4z\" (UID: \"26a03664-6cb3-4982-80f5-063d8f12cc2a\") " pod="openstack-kuttl-tests/barbican-api-766fb557cd-fwt4z" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.406368 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/26a03664-6cb3-4982-80f5-063d8f12cc2a-logs\") pod \"barbican-api-766fb557cd-fwt4z\" (UID: \"26a03664-6cb3-4982-80f5-063d8f12cc2a\") " pod="openstack-kuttl-tests/barbican-api-766fb557cd-fwt4z" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.406452 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/26a03664-6cb3-4982-80f5-063d8f12cc2a-config-data-custom\") pod \"barbican-api-766fb557cd-fwt4z\" (UID: \"26a03664-6cb3-4982-80f5-063d8f12cc2a\") " pod="openstack-kuttl-tests/barbican-api-766fb557cd-fwt4z" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.406517 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/26a03664-6cb3-4982-80f5-063d8f12cc2a-internal-tls-certs\") pod \"barbican-api-766fb557cd-fwt4z\" (UID: \"26a03664-6cb3-4982-80f5-063d8f12cc2a\") " pod="openstack-kuttl-tests/barbican-api-766fb557cd-fwt4z" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.426438 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-6b877d4f87-4vmvc"] Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.443476 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.443520 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-6646594584-l84r5"] Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.443931 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-6b877d4f87-4vmvc" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.444054 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podUID="d32a00a6-9028-411d-9f59-0b48c01c5eb2" containerName="openstack-network-exporter" containerID="cri-o://8c55763fcf264ceeed4d09a515d899986858a78501aa64cc228e9e4494fd465a" gracePeriod=300 Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.452705 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-6b877d4f87-4vmvc"] Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.460103 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-7bd99f4458-mgw7m" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.508380 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/2218d5be-dd10-4e4b-87b9-d9a5273bd197-public-tls-certs\") pod \"placement-776d498b58-sb5f8\" (UID: \"2218d5be-dd10-4e4b-87b9-d9a5273bd197\") " pod="openstack-kuttl-tests/placement-776d498b58-sb5f8" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.508414 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2218d5be-dd10-4e4b-87b9-d9a5273bd197-logs\") pod \"placement-776d498b58-sb5f8\" (UID: \"2218d5be-dd10-4e4b-87b9-d9a5273bd197\") " pod="openstack-kuttl-tests/placement-776d498b58-sb5f8" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.508443 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/952aeeb8-cdc4-469f-b50b-e5d640adc994-internal-tls-certs\") pod \"neutron-6646594584-l84r5\" (UID: \"952aeeb8-cdc4-469f-b50b-e5d640adc994\") " pod="openstack-kuttl-tests/neutron-6646594584-l84r5" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.508475 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/26a03664-6cb3-4982-80f5-063d8f12cc2a-config-data\") pod \"barbican-api-766fb557cd-fwt4z\" (UID: \"26a03664-6cb3-4982-80f5-063d8f12cc2a\") " pod="openstack-kuttl-tests/barbican-api-766fb557cd-fwt4z" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.508499 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/26a03664-6cb3-4982-80f5-063d8f12cc2a-public-tls-certs\") pod \"barbican-api-766fb557cd-fwt4z\" (UID: \"26a03664-6cb3-4982-80f5-063d8f12cc2a\") " pod="openstack-kuttl-tests/barbican-api-766fb557cd-fwt4z" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.508514 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2218d5be-dd10-4e4b-87b9-d9a5273bd197-config-data\") pod \"placement-776d498b58-sb5f8\" (UID: \"2218d5be-dd10-4e4b-87b9-d9a5273bd197\") " pod="openstack-kuttl-tests/placement-776d498b58-sb5f8" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.508532 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/26a03664-6cb3-4982-80f5-063d8f12cc2a-combined-ca-bundle\") pod \"barbican-api-766fb557cd-fwt4z\" (UID: \"26a03664-6cb3-4982-80f5-063d8f12cc2a\") " pod="openstack-kuttl-tests/barbican-api-766fb557cd-fwt4z" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.508564 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/26a03664-6cb3-4982-80f5-063d8f12cc2a-logs\") pod \"barbican-api-766fb557cd-fwt4z\" (UID: \"26a03664-6cb3-4982-80f5-063d8f12cc2a\") " pod="openstack-kuttl-tests/barbican-api-766fb557cd-fwt4z" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.508589 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2218d5be-dd10-4e4b-87b9-d9a5273bd197-combined-ca-bundle\") pod \"placement-776d498b58-sb5f8\" (UID: \"2218d5be-dd10-4e4b-87b9-d9a5273bd197\") " pod="openstack-kuttl-tests/placement-776d498b58-sb5f8" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.508619 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/952aeeb8-cdc4-469f-b50b-e5d640adc994-public-tls-certs\") pod \"neutron-6646594584-l84r5\" (UID: \"952aeeb8-cdc4-469f-b50b-e5d640adc994\") " pod="openstack-kuttl-tests/neutron-6646594584-l84r5" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.508640 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/952aeeb8-cdc4-469f-b50b-e5d640adc994-combined-ca-bundle\") pod \"neutron-6646594584-l84r5\" (UID: \"952aeeb8-cdc4-469f-b50b-e5d640adc994\") " pod="openstack-kuttl-tests/neutron-6646594584-l84r5" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.508679 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/952aeeb8-cdc4-469f-b50b-e5d640adc994-ovndb-tls-certs\") pod \"neutron-6646594584-l84r5\" (UID: \"952aeeb8-cdc4-469f-b50b-e5d640adc994\") " pod="openstack-kuttl-tests/neutron-6646594584-l84r5" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.508699 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/952aeeb8-cdc4-469f-b50b-e5d640adc994-config\") pod \"neutron-6646594584-l84r5\" (UID: \"952aeeb8-cdc4-469f-b50b-e5d640adc994\") " pod="openstack-kuttl-tests/neutron-6646594584-l84r5" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.508716 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/2218d5be-dd10-4e4b-87b9-d9a5273bd197-internal-tls-certs\") pod \"placement-776d498b58-sb5f8\" (UID: \"2218d5be-dd10-4e4b-87b9-d9a5273bd197\") " pod="openstack-kuttl-tests/placement-776d498b58-sb5f8" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.508732 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/26a03664-6cb3-4982-80f5-063d8f12cc2a-config-data-custom\") pod \"barbican-api-766fb557cd-fwt4z\" (UID: \"26a03664-6cb3-4982-80f5-063d8f12cc2a\") " pod="openstack-kuttl-tests/barbican-api-766fb557cd-fwt4z" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.512734 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/26a03664-6cb3-4982-80f5-063d8f12cc2a-logs\") pod \"barbican-api-766fb557cd-fwt4z\" (UID: \"26a03664-6cb3-4982-80f5-063d8f12cc2a\") " pod="openstack-kuttl-tests/barbican-api-766fb557cd-fwt4z" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.512948 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/26a03664-6cb3-4982-80f5-063d8f12cc2a-internal-tls-certs\") pod \"barbican-api-766fb557cd-fwt4z\" (UID: \"26a03664-6cb3-4982-80f5-063d8f12cc2a\") " pod="openstack-kuttl-tests/barbican-api-766fb557cd-fwt4z" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.513004 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/952aeeb8-cdc4-469f-b50b-e5d640adc994-httpd-config\") pod \"neutron-6646594584-l84r5\" (UID: \"952aeeb8-cdc4-469f-b50b-e5d640adc994\") " pod="openstack-kuttl-tests/neutron-6646594584-l84r5" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.513040 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9sdg5\" (UniqueName: \"kubernetes.io/projected/952aeeb8-cdc4-469f-b50b-e5d640adc994-kube-api-access-9sdg5\") pod \"neutron-6646594584-l84r5\" (UID: \"952aeeb8-cdc4-469f-b50b-e5d640adc994\") " pod="openstack-kuttl-tests/neutron-6646594584-l84r5" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.513092 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2218d5be-dd10-4e4b-87b9-d9a5273bd197-scripts\") pod \"placement-776d498b58-sb5f8\" (UID: \"2218d5be-dd10-4e4b-87b9-d9a5273bd197\") " pod="openstack-kuttl-tests/placement-776d498b58-sb5f8" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.513118 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lwjj5\" (UniqueName: \"kubernetes.io/projected/26a03664-6cb3-4982-80f5-063d8f12cc2a-kube-api-access-lwjj5\") pod \"barbican-api-766fb557cd-fwt4z\" (UID: \"26a03664-6cb3-4982-80f5-063d8f12cc2a\") " pod="openstack-kuttl-tests/barbican-api-766fb557cd-fwt4z" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.513180 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jz6nq\" (UniqueName: \"kubernetes.io/projected/2218d5be-dd10-4e4b-87b9-d9a5273bd197-kube-api-access-jz6nq\") pod \"placement-776d498b58-sb5f8\" (UID: \"2218d5be-dd10-4e4b-87b9-d9a5273bd197\") " pod="openstack-kuttl-tests/placement-776d498b58-sb5f8" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.523507 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/26a03664-6cb3-4982-80f5-063d8f12cc2a-combined-ca-bundle\") pod \"barbican-api-766fb557cd-fwt4z\" (UID: \"26a03664-6cb3-4982-80f5-063d8f12cc2a\") " pod="openstack-kuttl-tests/barbican-api-766fb557cd-fwt4z" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.527667 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/26a03664-6cb3-4982-80f5-063d8f12cc2a-public-tls-certs\") pod \"barbican-api-766fb557cd-fwt4z\" (UID: \"26a03664-6cb3-4982-80f5-063d8f12cc2a\") " pod="openstack-kuttl-tests/barbican-api-766fb557cd-fwt4z" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.527693 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/26a03664-6cb3-4982-80f5-063d8f12cc2a-config-data-custom\") pod \"barbican-api-766fb557cd-fwt4z\" (UID: \"26a03664-6cb3-4982-80f5-063d8f12cc2a\") " pod="openstack-kuttl-tests/barbican-api-766fb557cd-fwt4z" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.530476 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/26a03664-6cb3-4982-80f5-063d8f12cc2a-config-data\") pod \"barbican-api-766fb557cd-fwt4z\" (UID: \"26a03664-6cb3-4982-80f5-063d8f12cc2a\") " pod="openstack-kuttl-tests/barbican-api-766fb557cd-fwt4z" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.533282 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/26a03664-6cb3-4982-80f5-063d8f12cc2a-internal-tls-certs\") pod \"barbican-api-766fb557cd-fwt4z\" (UID: \"26a03664-6cb3-4982-80f5-063d8f12cc2a\") " pod="openstack-kuttl-tests/barbican-api-766fb557cd-fwt4z" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.552970 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podUID="d32a00a6-9028-411d-9f59-0b48c01c5eb2" containerName="ovsdbserver-sb" containerID="cri-o://648e7c7f54f433de39969c9d1bdd3b5463c4d4f0f019533353a14b1c5740b449" gracePeriod=300 Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.556481 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwjj5\" (UniqueName: \"kubernetes.io/projected/26a03664-6cb3-4982-80f5-063d8f12cc2a-kube-api-access-lwjj5\") pod \"barbican-api-766fb557cd-fwt4z\" (UID: \"26a03664-6cb3-4982-80f5-063d8f12cc2a\") " pod="openstack-kuttl-tests/barbican-api-766fb557cd-fwt4z" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.631319 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6pmd6\" (UniqueName: \"kubernetes.io/projected/26ff2779-e4aa-43b8-9704-4def1ae45033-kube-api-access-6pmd6\") pod \"keystone-6b877d4f87-4vmvc\" (UID: \"26ff2779-e4aa-43b8-9704-4def1ae45033\") " pod="openstack-kuttl-tests/keystone-6b877d4f87-4vmvc" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.631360 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/2218d5be-dd10-4e4b-87b9-d9a5273bd197-public-tls-certs\") pod \"placement-776d498b58-sb5f8\" (UID: \"2218d5be-dd10-4e4b-87b9-d9a5273bd197\") " pod="openstack-kuttl-tests/placement-776d498b58-sb5f8" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.631386 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2218d5be-dd10-4e4b-87b9-d9a5273bd197-logs\") pod \"placement-776d498b58-sb5f8\" (UID: \"2218d5be-dd10-4e4b-87b9-d9a5273bd197\") " pod="openstack-kuttl-tests/placement-776d498b58-sb5f8" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.631408 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/952aeeb8-cdc4-469f-b50b-e5d640adc994-internal-tls-certs\") pod \"neutron-6646594584-l84r5\" (UID: \"952aeeb8-cdc4-469f-b50b-e5d640adc994\") " pod="openstack-kuttl-tests/neutron-6646594584-l84r5" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.631439 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/26ff2779-e4aa-43b8-9704-4def1ae45033-public-tls-certs\") pod \"keystone-6b877d4f87-4vmvc\" (UID: \"26ff2779-e4aa-43b8-9704-4def1ae45033\") " pod="openstack-kuttl-tests/keystone-6b877d4f87-4vmvc" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.631463 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2218d5be-dd10-4e4b-87b9-d9a5273bd197-config-data\") pod \"placement-776d498b58-sb5f8\" (UID: \"2218d5be-dd10-4e4b-87b9-d9a5273bd197\") " pod="openstack-kuttl-tests/placement-776d498b58-sb5f8" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.631509 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/26ff2779-e4aa-43b8-9704-4def1ae45033-fernet-keys\") pod \"keystone-6b877d4f87-4vmvc\" (UID: \"26ff2779-e4aa-43b8-9704-4def1ae45033\") " pod="openstack-kuttl-tests/keystone-6b877d4f87-4vmvc" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.631532 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2218d5be-dd10-4e4b-87b9-d9a5273bd197-combined-ca-bundle\") pod \"placement-776d498b58-sb5f8\" (UID: \"2218d5be-dd10-4e4b-87b9-d9a5273bd197\") " pod="openstack-kuttl-tests/placement-776d498b58-sb5f8" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.631549 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/26ff2779-e4aa-43b8-9704-4def1ae45033-credential-keys\") pod \"keystone-6b877d4f87-4vmvc\" (UID: \"26ff2779-e4aa-43b8-9704-4def1ae45033\") " pod="openstack-kuttl-tests/keystone-6b877d4f87-4vmvc" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.631568 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/952aeeb8-cdc4-469f-b50b-e5d640adc994-public-tls-certs\") pod \"neutron-6646594584-l84r5\" (UID: \"952aeeb8-cdc4-469f-b50b-e5d640adc994\") " pod="openstack-kuttl-tests/neutron-6646594584-l84r5" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.631586 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/26ff2779-e4aa-43b8-9704-4def1ae45033-combined-ca-bundle\") pod \"keystone-6b877d4f87-4vmvc\" (UID: \"26ff2779-e4aa-43b8-9704-4def1ae45033\") " pod="openstack-kuttl-tests/keystone-6b877d4f87-4vmvc" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.631605 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/952aeeb8-cdc4-469f-b50b-e5d640adc994-combined-ca-bundle\") pod \"neutron-6646594584-l84r5\" (UID: \"952aeeb8-cdc4-469f-b50b-e5d640adc994\") " pod="openstack-kuttl-tests/neutron-6646594584-l84r5" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.631650 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/952aeeb8-cdc4-469f-b50b-e5d640adc994-ovndb-tls-certs\") pod \"neutron-6646594584-l84r5\" (UID: \"952aeeb8-cdc4-469f-b50b-e5d640adc994\") " pod="openstack-kuttl-tests/neutron-6646594584-l84r5" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.631670 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/952aeeb8-cdc4-469f-b50b-e5d640adc994-config\") pod \"neutron-6646594584-l84r5\" (UID: \"952aeeb8-cdc4-469f-b50b-e5d640adc994\") " pod="openstack-kuttl-tests/neutron-6646594584-l84r5" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.631685 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/26ff2779-e4aa-43b8-9704-4def1ae45033-config-data\") pod \"keystone-6b877d4f87-4vmvc\" (UID: \"26ff2779-e4aa-43b8-9704-4def1ae45033\") " pod="openstack-kuttl-tests/keystone-6b877d4f87-4vmvc" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.631703 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/2218d5be-dd10-4e4b-87b9-d9a5273bd197-internal-tls-certs\") pod \"placement-776d498b58-sb5f8\" (UID: \"2218d5be-dd10-4e4b-87b9-d9a5273bd197\") " pod="openstack-kuttl-tests/placement-776d498b58-sb5f8" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.631778 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/952aeeb8-cdc4-469f-b50b-e5d640adc994-httpd-config\") pod \"neutron-6646594584-l84r5\" (UID: \"952aeeb8-cdc4-469f-b50b-e5d640adc994\") " pod="openstack-kuttl-tests/neutron-6646594584-l84r5" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.631795 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/26ff2779-e4aa-43b8-9704-4def1ae45033-scripts\") pod \"keystone-6b877d4f87-4vmvc\" (UID: \"26ff2779-e4aa-43b8-9704-4def1ae45033\") " pod="openstack-kuttl-tests/keystone-6b877d4f87-4vmvc" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.631818 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9sdg5\" (UniqueName: \"kubernetes.io/projected/952aeeb8-cdc4-469f-b50b-e5d640adc994-kube-api-access-9sdg5\") pod \"neutron-6646594584-l84r5\" (UID: \"952aeeb8-cdc4-469f-b50b-e5d640adc994\") " pod="openstack-kuttl-tests/neutron-6646594584-l84r5" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.649301 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2218d5be-dd10-4e4b-87b9-d9a5273bd197-scripts\") pod \"placement-776d498b58-sb5f8\" (UID: \"2218d5be-dd10-4e4b-87b9-d9a5273bd197\") " pod="openstack-kuttl-tests/placement-776d498b58-sb5f8" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.649350 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/26ff2779-e4aa-43b8-9704-4def1ae45033-internal-tls-certs\") pod \"keystone-6b877d4f87-4vmvc\" (UID: \"26ff2779-e4aa-43b8-9704-4def1ae45033\") " pod="openstack-kuttl-tests/keystone-6b877d4f87-4vmvc" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.649462 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jz6nq\" (UniqueName: \"kubernetes.io/projected/2218d5be-dd10-4e4b-87b9-d9a5273bd197-kube-api-access-jz6nq\") pod \"placement-776d498b58-sb5f8\" (UID: \"2218d5be-dd10-4e4b-87b9-d9a5273bd197\") " pod="openstack-kuttl-tests/placement-776d498b58-sb5f8" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.652672 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/openstack-cell1-galera-0" podUID="14486849-fbb1-4cc9-8aa3-714e263c55fb" containerName="galera" containerID="cri-o://c81a76400410e2a94d4a9a4471ca9bca3df111d1c0d2c832dcdc03fb0fca2ae5" gracePeriod=30 Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.657510 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2218d5be-dd10-4e4b-87b9-d9a5273bd197-logs\") pod \"placement-776d498b58-sb5f8\" (UID: \"2218d5be-dd10-4e4b-87b9-d9a5273bd197\") " pod="openstack-kuttl-tests/placement-776d498b58-sb5f8" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.660031 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2218d5be-dd10-4e4b-87b9-d9a5273bd197-scripts\") pod \"placement-776d498b58-sb5f8\" (UID: \"2218d5be-dd10-4e4b-87b9-d9a5273bd197\") " pod="openstack-kuttl-tests/placement-776d498b58-sb5f8" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.665503 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/952aeeb8-cdc4-469f-b50b-e5d640adc994-public-tls-certs\") pod \"neutron-6646594584-l84r5\" (UID: \"952aeeb8-cdc4-469f-b50b-e5d640adc994\") " pod="openstack-kuttl-tests/neutron-6646594584-l84r5" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.669612 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2218d5be-dd10-4e4b-87b9-d9a5273bd197-combined-ca-bundle\") pod \"placement-776d498b58-sb5f8\" (UID: \"2218d5be-dd10-4e4b-87b9-d9a5273bd197\") " pod="openstack-kuttl-tests/placement-776d498b58-sb5f8" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.669844 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/952aeeb8-cdc4-469f-b50b-e5d640adc994-ovndb-tls-certs\") pod \"neutron-6646594584-l84r5\" (UID: \"952aeeb8-cdc4-469f-b50b-e5d640adc994\") " pod="openstack-kuttl-tests/neutron-6646594584-l84r5" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.672416 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9sdg5\" (UniqueName: \"kubernetes.io/projected/952aeeb8-cdc4-469f-b50b-e5d640adc994-kube-api-access-9sdg5\") pod \"neutron-6646594584-l84r5\" (UID: \"952aeeb8-cdc4-469f-b50b-e5d640adc994\") " pod="openstack-kuttl-tests/neutron-6646594584-l84r5" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.673165 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2218d5be-dd10-4e4b-87b9-d9a5273bd197-config-data\") pod \"placement-776d498b58-sb5f8\" (UID: \"2218d5be-dd10-4e4b-87b9-d9a5273bd197\") " pod="openstack-kuttl-tests/placement-776d498b58-sb5f8" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.673280 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/952aeeb8-cdc4-469f-b50b-e5d640adc994-config\") pod \"neutron-6646594584-l84r5\" (UID: \"952aeeb8-cdc4-469f-b50b-e5d640adc994\") " pod="openstack-kuttl-tests/neutron-6646594584-l84r5" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.675132 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jz6nq\" (UniqueName: \"kubernetes.io/projected/2218d5be-dd10-4e4b-87b9-d9a5273bd197-kube-api-access-jz6nq\") pod \"placement-776d498b58-sb5f8\" (UID: \"2218d5be-dd10-4e4b-87b9-d9a5273bd197\") " pod="openstack-kuttl-tests/placement-776d498b58-sb5f8" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.675170 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/2218d5be-dd10-4e4b-87b9-d9a5273bd197-public-tls-certs\") pod \"placement-776d498b58-sb5f8\" (UID: \"2218d5be-dd10-4e4b-87b9-d9a5273bd197\") " pod="openstack-kuttl-tests/placement-776d498b58-sb5f8" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.676935 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/2218d5be-dd10-4e4b-87b9-d9a5273bd197-internal-tls-certs\") pod \"placement-776d498b58-sb5f8\" (UID: \"2218d5be-dd10-4e4b-87b9-d9a5273bd197\") " pod="openstack-kuttl-tests/placement-776d498b58-sb5f8" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.691590 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/952aeeb8-cdc4-469f-b50b-e5d640adc994-httpd-config\") pod \"neutron-6646594584-l84r5\" (UID: \"952aeeb8-cdc4-469f-b50b-e5d640adc994\") " pod="openstack-kuttl-tests/neutron-6646594584-l84r5" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.692140 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/952aeeb8-cdc4-469f-b50b-e5d640adc994-internal-tls-certs\") pod \"neutron-6646594584-l84r5\" (UID: \"952aeeb8-cdc4-469f-b50b-e5d640adc994\") " pod="openstack-kuttl-tests/neutron-6646594584-l84r5" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.700245 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/openstack-galera-0" podUID="c95ad7ed-1944-4285-9138-0d4b954aa727" containerName="galera" containerID="cri-o://09392570662a59fc70e23951bc67499bff758e9ff6016774b3bbe8dfd1cae387" gracePeriod=30 Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.722654 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/952aeeb8-cdc4-469f-b50b-e5d640adc994-combined-ca-bundle\") pod \"neutron-6646594584-l84r5\" (UID: \"952aeeb8-cdc4-469f-b50b-e5d640adc994\") " pod="openstack-kuttl-tests/neutron-6646594584-l84r5" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.729225 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-766fb557cd-fwt4z" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.752946 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/26ff2779-e4aa-43b8-9704-4def1ae45033-scripts\") pod \"keystone-6b877d4f87-4vmvc\" (UID: \"26ff2779-e4aa-43b8-9704-4def1ae45033\") " pod="openstack-kuttl-tests/keystone-6b877d4f87-4vmvc" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.753005 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/26ff2779-e4aa-43b8-9704-4def1ae45033-internal-tls-certs\") pod \"keystone-6b877d4f87-4vmvc\" (UID: \"26ff2779-e4aa-43b8-9704-4def1ae45033\") " pod="openstack-kuttl-tests/keystone-6b877d4f87-4vmvc" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.756465 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6pmd6\" (UniqueName: \"kubernetes.io/projected/26ff2779-e4aa-43b8-9704-4def1ae45033-kube-api-access-6pmd6\") pod \"keystone-6b877d4f87-4vmvc\" (UID: \"26ff2779-e4aa-43b8-9704-4def1ae45033\") " pod="openstack-kuttl-tests/keystone-6b877d4f87-4vmvc" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.756647 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/26ff2779-e4aa-43b8-9704-4def1ae45033-public-tls-certs\") pod \"keystone-6b877d4f87-4vmvc\" (UID: \"26ff2779-e4aa-43b8-9704-4def1ae45033\") " pod="openstack-kuttl-tests/keystone-6b877d4f87-4vmvc" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.756746 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/26ff2779-e4aa-43b8-9704-4def1ae45033-fernet-keys\") pod \"keystone-6b877d4f87-4vmvc\" (UID: \"26ff2779-e4aa-43b8-9704-4def1ae45033\") " pod="openstack-kuttl-tests/keystone-6b877d4f87-4vmvc" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.756803 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/26ff2779-e4aa-43b8-9704-4def1ae45033-credential-keys\") pod \"keystone-6b877d4f87-4vmvc\" (UID: \"26ff2779-e4aa-43b8-9704-4def1ae45033\") " pod="openstack-kuttl-tests/keystone-6b877d4f87-4vmvc" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.756836 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/26ff2779-e4aa-43b8-9704-4def1ae45033-combined-ca-bundle\") pod \"keystone-6b877d4f87-4vmvc\" (UID: \"26ff2779-e4aa-43b8-9704-4def1ae45033\") " pod="openstack-kuttl-tests/keystone-6b877d4f87-4vmvc" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.756982 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/26ff2779-e4aa-43b8-9704-4def1ae45033-config-data\") pod \"keystone-6b877d4f87-4vmvc\" (UID: \"26ff2779-e4aa-43b8-9704-4def1ae45033\") " pod="openstack-kuttl-tests/keystone-6b877d4f87-4vmvc" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.761159 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/26ff2779-e4aa-43b8-9704-4def1ae45033-scripts\") pod \"keystone-6b877d4f87-4vmvc\" (UID: \"26ff2779-e4aa-43b8-9704-4def1ae45033\") " pod="openstack-kuttl-tests/keystone-6b877d4f87-4vmvc" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.762251 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-776d498b58-sb5f8" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.764703 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/26ff2779-e4aa-43b8-9704-4def1ae45033-fernet-keys\") pod \"keystone-6b877d4f87-4vmvc\" (UID: \"26ff2779-e4aa-43b8-9704-4def1ae45033\") " pod="openstack-kuttl-tests/keystone-6b877d4f87-4vmvc" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.767625 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/26ff2779-e4aa-43b8-9704-4def1ae45033-credential-keys\") pod \"keystone-6b877d4f87-4vmvc\" (UID: \"26ff2779-e4aa-43b8-9704-4def1ae45033\") " pod="openstack-kuttl-tests/keystone-6b877d4f87-4vmvc" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.769974 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/26ff2779-e4aa-43b8-9704-4def1ae45033-public-tls-certs\") pod \"keystone-6b877d4f87-4vmvc\" (UID: \"26ff2779-e4aa-43b8-9704-4def1ae45033\") " pod="openstack-kuttl-tests/keystone-6b877d4f87-4vmvc" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.770066 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/26ff2779-e4aa-43b8-9704-4def1ae45033-combined-ca-bundle\") pod \"keystone-6b877d4f87-4vmvc\" (UID: \"26ff2779-e4aa-43b8-9704-4def1ae45033\") " pod="openstack-kuttl-tests/keystone-6b877d4f87-4vmvc" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.774286 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/26ff2779-e4aa-43b8-9704-4def1ae45033-internal-tls-certs\") pod \"keystone-6b877d4f87-4vmvc\" (UID: \"26ff2779-e4aa-43b8-9704-4def1ae45033\") " pod="openstack-kuttl-tests/keystone-6b877d4f87-4vmvc" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.775008 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/26ff2779-e4aa-43b8-9704-4def1ae45033-config-data\") pod \"keystone-6b877d4f87-4vmvc\" (UID: \"26ff2779-e4aa-43b8-9704-4def1ae45033\") " pod="openstack-kuttl-tests/keystone-6b877d4f87-4vmvc" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.791816 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6pmd6\" (UniqueName: \"kubernetes.io/projected/26ff2779-e4aa-43b8-9704-4def1ae45033-kube-api-access-6pmd6\") pod \"keystone-6b877d4f87-4vmvc\" (UID: \"26ff2779-e4aa-43b8-9704-4def1ae45033\") " pod="openstack-kuttl-tests/keystone-6b877d4f87-4vmvc" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.854481 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-6646594584-l84r5" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.883249 5120 generic.go:358] "Generic (PLEG): container finished" podID="d51d8732-80e3-463b-b8b0-714f8a2d281f" containerID="2b26dc531a1cf057478a38e2cb256c9931e49568a65df6c5751f0ab2d721a086" exitCode=143 Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.883341 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"d51d8732-80e3-463b-b8b0-714f8a2d281f","Type":"ContainerDied","Data":"2b26dc531a1cf057478a38e2cb256c9931e49568a65df6c5751f0ab2d721a086"} Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.923033 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-6b877d4f87-4vmvc" Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.937569 5120 generic.go:358] "Generic (PLEG): container finished" podID="8d66ce1a-7d4c-4e04-92c9-f86d5ad81fcc" containerID="3f7dde81452f0221434f72a3271f62d13dc8d444913ffecdd1876e8ea04f3e0d" exitCode=0 Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.937665 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"8d66ce1a-7d4c-4e04-92c9-f86d5ad81fcc","Type":"ContainerDied","Data":"3f7dde81452f0221434f72a3271f62d13dc8d444913ffecdd1876e8ea04f3e0d"} Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.983590 5120 generic.go:358] "Generic (PLEG): container finished" podID="d6734794-135c-4f4b-83b6-c64788f83f91" containerID="ebdaf82d2a1f7e9acd884bceba81a86e1a13b95df2c0fa6a630cd488d4c95e00" exitCode=143 Mar 16 15:53:53 crc kubenswrapper[5120]: I0316 15:53:53.983708 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"d6734794-135c-4f4b-83b6-c64788f83f91","Type":"ContainerDied","Data":"ebdaf82d2a1f7e9acd884bceba81a86e1a13b95df2c0fa6a630cd488d4c95e00"} Mar 16 15:53:54 crc kubenswrapper[5120]: I0316 15:53:54.045230 5120 generic.go:358] "Generic (PLEG): container finished" podID="4306304f-eaea-49a1-9e62-9b035dc302de" containerID="32dc4affff57e6164d54a3b9adc39549944d248ae17ddcbe6847bc2b8586572c" exitCode=143 Mar 16 15:53:54 crc kubenswrapper[5120]: I0316 15:53:54.045375 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"4306304f-eaea-49a1-9e62-9b035dc302de","Type":"ContainerDied","Data":"32dc4affff57e6164d54a3b9adc39549944d248ae17ddcbe6847bc2b8586572c"} Mar 16 15:53:54 crc kubenswrapper[5120]: I0316 15:53:54.096066 5120 generic.go:358] "Generic (PLEG): container finished" podID="176eef56-bc30-4119-8af5-fa1329d63aa2" containerID="2f65dec7986bd0522ab520af73feb24ec1981e8d8b3bd281082c4d851a61df1c" exitCode=143 Mar 16 15:53:54 crc kubenswrapper[5120]: I0316 15:53:54.096199 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"176eef56-bc30-4119-8af5-fa1329d63aa2","Type":"ContainerDied","Data":"2f65dec7986bd0522ab520af73feb24ec1981e8d8b3bd281082c4d851a61df1c"} Mar 16 15:53:54 crc kubenswrapper[5120]: I0316 15:53:54.147945 5120 generic.go:358] "Generic (PLEG): container finished" podID="32f7f790-9e5b-4052-a87d-b3abaa0b3ff0" containerID="5c27deb51925eebcbc197def4aa61ef6d9334fadb9af36744bc13cd32f16e353" exitCode=0 Mar 16 15:53:54 crc kubenswrapper[5120]: I0316 15:53:54.147975 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"32f7f790-9e5b-4052-a87d-b3abaa0b3ff0","Type":"ContainerDied","Data":"5c27deb51925eebcbc197def4aa61ef6d9334fadb9af36744bc13cd32f16e353"} Mar 16 15:53:54 crc kubenswrapper[5120]: I0316 15:53:54.264269 5120 generic.go:358] "Generic (PLEG): container finished" podID="672accec-238b-4e18-9b15-5ff8429d4256" containerID="f5c2fd82b6ea338f7d6c9db503db6e0feda2486b4d73e345ab3733d653dc087e" exitCode=0 Mar 16 15:53:54 crc kubenswrapper[5120]: I0316 15:53:54.265222 5120 generic.go:358] "Generic (PLEG): container finished" podID="672accec-238b-4e18-9b15-5ff8429d4256" containerID="67a31541ab497c672f2f7e36c23db3fced2a193b78fad102ca2c5246637f56e2" exitCode=0 Mar 16 15:53:54 crc kubenswrapper[5120]: I0316 15:53:54.265244 5120 generic.go:358] "Generic (PLEG): container finished" podID="672accec-238b-4e18-9b15-5ff8429d4256" containerID="7686efc897f2d8fd462eac4cd5a266038ea5acac3f9365c2ddb297ab7f93415f" exitCode=0 Mar 16 15:53:54 crc kubenswrapper[5120]: I0316 15:53:54.265250 5120 generic.go:358] "Generic (PLEG): container finished" podID="672accec-238b-4e18-9b15-5ff8429d4256" containerID="17d850bf7250355a2f26abed4c26bbd9dedcc1528a02f7aac5161667c10e607e" exitCode=0 Mar 16 15:53:54 crc kubenswrapper[5120]: I0316 15:53:54.265255 5120 generic.go:358] "Generic (PLEG): container finished" podID="672accec-238b-4e18-9b15-5ff8429d4256" containerID="cde5f856ff99ea7ad37f794396a9dc9df7fc578241b167685629e114bff612a5" exitCode=0 Mar 16 15:53:54 crc kubenswrapper[5120]: I0316 15:53:54.265263 5120 generic.go:358] "Generic (PLEG): container finished" podID="672accec-238b-4e18-9b15-5ff8429d4256" containerID="a7e88337bf9943de6762af63123d82ed7ecb5b08d43e604821d3c16b565ebd37" exitCode=0 Mar 16 15:53:54 crc kubenswrapper[5120]: I0316 15:53:54.265269 5120 generic.go:358] "Generic (PLEG): container finished" podID="672accec-238b-4e18-9b15-5ff8429d4256" containerID="fde5fb0b2c5ff4c6662d21de92b6d87f0744f43da51dab65466b8402c59efc3c" exitCode=0 Mar 16 15:53:54 crc kubenswrapper[5120]: I0316 15:53:54.265274 5120 generic.go:358] "Generic (PLEG): container finished" podID="672accec-238b-4e18-9b15-5ff8429d4256" containerID="f6516b04c93b8952f5f103daeb13d907ded489f3bf8112a5226b3b9e7a344640" exitCode=0 Mar 16 15:53:54 crc kubenswrapper[5120]: I0316 15:53:54.265279 5120 generic.go:358] "Generic (PLEG): container finished" podID="672accec-238b-4e18-9b15-5ff8429d4256" containerID="11022888adb543c6c9abb0c148040b363e988e74354acd6f81b3a4527faccc7e" exitCode=0 Mar 16 15:53:54 crc kubenswrapper[5120]: I0316 15:53:54.265285 5120 generic.go:358] "Generic (PLEG): container finished" podID="672accec-238b-4e18-9b15-5ff8429d4256" containerID="01e871b86564712e3514085f671a2977bc7b524764ad870692c415d42dab6faa" exitCode=0 Mar 16 15:53:54 crc kubenswrapper[5120]: I0316 15:53:54.265290 5120 generic.go:358] "Generic (PLEG): container finished" podID="672accec-238b-4e18-9b15-5ff8429d4256" containerID="22134ed61214cfcb4b62b61c2c8b66351c620a2ab55a0217bf762503e825f4b9" exitCode=0 Mar 16 15:53:54 crc kubenswrapper[5120]: I0316 15:53:54.265295 5120 generic.go:358] "Generic (PLEG): container finished" podID="672accec-238b-4e18-9b15-5ff8429d4256" containerID="14ee402c6747f1b4b78b0a77b1edcb405e0f0a750a426e1880c2fc7730c5aeb0" exitCode=0 Mar 16 15:53:54 crc kubenswrapper[5120]: I0316 15:53:54.265301 5120 generic.go:358] "Generic (PLEG): container finished" podID="672accec-238b-4e18-9b15-5ff8429d4256" containerID="a8d2135db021dc89abaf23da0be3ef286287bc8d9e97e08f5bd37833a8d66250" exitCode=0 Mar 16 15:53:54 crc kubenswrapper[5120]: I0316 15:53:54.265418 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"672accec-238b-4e18-9b15-5ff8429d4256","Type":"ContainerDied","Data":"f5c2fd82b6ea338f7d6c9db503db6e0feda2486b4d73e345ab3733d653dc087e"} Mar 16 15:53:54 crc kubenswrapper[5120]: I0316 15:53:54.265447 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"672accec-238b-4e18-9b15-5ff8429d4256","Type":"ContainerDied","Data":"67a31541ab497c672f2f7e36c23db3fced2a193b78fad102ca2c5246637f56e2"} Mar 16 15:53:54 crc kubenswrapper[5120]: I0316 15:53:54.265456 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"672accec-238b-4e18-9b15-5ff8429d4256","Type":"ContainerDied","Data":"7686efc897f2d8fd462eac4cd5a266038ea5acac3f9365c2ddb297ab7f93415f"} Mar 16 15:53:54 crc kubenswrapper[5120]: I0316 15:53:54.265464 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"672accec-238b-4e18-9b15-5ff8429d4256","Type":"ContainerDied","Data":"17d850bf7250355a2f26abed4c26bbd9dedcc1528a02f7aac5161667c10e607e"} Mar 16 15:53:54 crc kubenswrapper[5120]: I0316 15:53:54.265746 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"672accec-238b-4e18-9b15-5ff8429d4256","Type":"ContainerDied","Data":"cde5f856ff99ea7ad37f794396a9dc9df7fc578241b167685629e114bff612a5"} Mar 16 15:53:54 crc kubenswrapper[5120]: I0316 15:53:54.265949 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"672accec-238b-4e18-9b15-5ff8429d4256","Type":"ContainerDied","Data":"a7e88337bf9943de6762af63123d82ed7ecb5b08d43e604821d3c16b565ebd37"} Mar 16 15:53:54 crc kubenswrapper[5120]: I0316 15:53:54.265967 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"672accec-238b-4e18-9b15-5ff8429d4256","Type":"ContainerDied","Data":"fde5fb0b2c5ff4c6662d21de92b6d87f0744f43da51dab65466b8402c59efc3c"} Mar 16 15:53:54 crc kubenswrapper[5120]: I0316 15:53:54.265976 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"672accec-238b-4e18-9b15-5ff8429d4256","Type":"ContainerDied","Data":"f6516b04c93b8952f5f103daeb13d907ded489f3bf8112a5226b3b9e7a344640"} Mar 16 15:53:54 crc kubenswrapper[5120]: I0316 15:53:54.265984 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"672accec-238b-4e18-9b15-5ff8429d4256","Type":"ContainerDied","Data":"11022888adb543c6c9abb0c148040b363e988e74354acd6f81b3a4527faccc7e"} Mar 16 15:53:54 crc kubenswrapper[5120]: I0316 15:53:54.265998 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"672accec-238b-4e18-9b15-5ff8429d4256","Type":"ContainerDied","Data":"01e871b86564712e3514085f671a2977bc7b524764ad870692c415d42dab6faa"} Mar 16 15:53:54 crc kubenswrapper[5120]: I0316 15:53:54.266103 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"672accec-238b-4e18-9b15-5ff8429d4256","Type":"ContainerDied","Data":"22134ed61214cfcb4b62b61c2c8b66351c620a2ab55a0217bf762503e825f4b9"} Mar 16 15:53:54 crc kubenswrapper[5120]: I0316 15:53:54.266120 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"672accec-238b-4e18-9b15-5ff8429d4256","Type":"ContainerDied","Data":"14ee402c6747f1b4b78b0a77b1edcb405e0f0a750a426e1880c2fc7730c5aeb0"} Mar 16 15:53:54 crc kubenswrapper[5120]: I0316 15:53:54.266128 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"672accec-238b-4e18-9b15-5ff8429d4256","Type":"ContainerDied","Data":"a8d2135db021dc89abaf23da0be3ef286287bc8d9e97e08f5bd37833a8d66250"} Mar 16 15:53:54 crc kubenswrapper[5120]: I0316 15:53:54.300051 5120 generic.go:358] "Generic (PLEG): container finished" podID="5888de0f-5da8-4605-aa27-db134fd47b31" containerID="5a00c8f45c647963a8510197f0acdd358ed4e08e0b3eefebcc584d2b7161253e" exitCode=0 Mar 16 15:53:54 crc kubenswrapper[5120]: I0316 15:53:54.300258 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"5888de0f-5da8-4605-aa27-db134fd47b31","Type":"ContainerDied","Data":"5a00c8f45c647963a8510197f0acdd358ed4e08e0b3eefebcc584d2b7161253e"} Mar 16 15:53:54 crc kubenswrapper[5120]: I0316 15:53:54.332914 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-0a49-account-create-update-56fsd"] Mar 16 15:53:54 crc kubenswrapper[5120]: I0316 15:53:54.339801 5120 generic.go:358] "Generic (PLEG): container finished" podID="90534d56-28ff-4983-b8ea-be83259ce64d" containerID="fabcc54b602bf9faf9dc99913094ea0b2e649eaa684c0270cf178d6a7993957a" exitCode=0 Mar 16 15:53:54 crc kubenswrapper[5120]: I0316 15:53:54.339904 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"90534d56-28ff-4983-b8ea-be83259ce64d","Type":"ContainerDied","Data":"fabcc54b602bf9faf9dc99913094ea0b2e649eaa684c0270cf178d6a7993957a"} Mar 16 15:53:54 crc kubenswrapper[5120]: I0316 15:53:54.363188 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_d32a00a6-9028-411d-9f59-0b48c01c5eb2/ovsdbserver-sb/0.log" Mar 16 15:53:54 crc kubenswrapper[5120]: I0316 15:53:54.363238 5120 generic.go:358] "Generic (PLEG): container finished" podID="d32a00a6-9028-411d-9f59-0b48c01c5eb2" containerID="8c55763fcf264ceeed4d09a515d899986858a78501aa64cc228e9e4494fd465a" exitCode=2 Mar 16 15:53:54 crc kubenswrapper[5120]: I0316 15:53:54.363251 5120 generic.go:358] "Generic (PLEG): container finished" podID="d32a00a6-9028-411d-9f59-0b48c01c5eb2" containerID="648e7c7f54f433de39969c9d1bdd3b5463c4d4f0f019533353a14b1c5740b449" exitCode=143 Mar 16 15:53:54 crc kubenswrapper[5120]: I0316 15:53:54.363308 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-0a49-account-create-update-56fsd"] Mar 16 15:53:54 crc kubenswrapper[5120]: I0316 15:53:54.363337 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"d32a00a6-9028-411d-9f59-0b48c01c5eb2","Type":"ContainerDied","Data":"8c55763fcf264ceeed4d09a515d899986858a78501aa64cc228e9e4494fd465a"} Mar 16 15:53:54 crc kubenswrapper[5120]: I0316 15:53:54.363368 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"d32a00a6-9028-411d-9f59-0b48c01c5eb2","Type":"ContainerDied","Data":"648e7c7f54f433de39969c9d1bdd3b5463c4d4f0f019533353a14b1c5740b449"} Mar 16 15:53:54 crc kubenswrapper[5120]: I0316 15:53:54.387070 5120 generic.go:358] "Generic (PLEG): container finished" podID="6ac49efe-dc8a-47b2-9432-afb41c69ebff" containerID="e5f97b4f3579c3f23b60ed73671c3bb6855051e5aa3db9096db0d9f0c8c645c8" exitCode=2 Mar 16 15:53:54 crc kubenswrapper[5120]: I0316 15:53:54.387192 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"6ac49efe-dc8a-47b2-9432-afb41c69ebff","Type":"ContainerDied","Data":"e5f97b4f3579c3f23b60ed73671c3bb6855051e5aa3db9096db0d9f0c8c645c8"} Mar 16 15:53:54 crc kubenswrapper[5120]: I0316 15:53:54.415813 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-k9tph"] Mar 16 15:53:54 crc kubenswrapper[5120]: I0316 15:53:54.442248 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_a7b8bb1c-b58a-43a6-8457-88a025588f1e/ovsdbserver-nb/0.log" Mar 16 15:53:54 crc kubenswrapper[5120]: I0316 15:53:54.442290 5120 generic.go:358] "Generic (PLEG): container finished" podID="a7b8bb1c-b58a-43a6-8457-88a025588f1e" containerID="4e2796b01696c028bbde53b67d3871a746b22ba854168fabf827f2607ee9fe5c" exitCode=2 Mar 16 15:53:54 crc kubenswrapper[5120]: I0316 15:53:54.442304 5120 generic.go:358] "Generic (PLEG): container finished" podID="a7b8bb1c-b58a-43a6-8457-88a025588f1e" containerID="a69581666e94e68483b687690686147a201582a36041881db8d8c5e135d82930" exitCode=143 Mar 16 15:53:54 crc kubenswrapper[5120]: I0316 15:53:54.442646 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/root-account-create-update-746gq"] Mar 16 15:53:54 crc kubenswrapper[5120]: I0316 15:53:54.465884 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"a7b8bb1c-b58a-43a6-8457-88a025588f1e","Type":"ContainerDied","Data":"4e2796b01696c028bbde53b67d3871a746b22ba854168fabf827f2607ee9fe5c"} Mar 16 15:53:54 crc kubenswrapper[5120]: I0316 15:53:54.465939 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-k9tph"] Mar 16 15:53:54 crc kubenswrapper[5120]: I0316 15:53:54.465966 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"a7b8bb1c-b58a-43a6-8457-88a025588f1e","Type":"ContainerDied","Data":"a69581666e94e68483b687690686147a201582a36041881db8d8c5e135d82930"} Mar 16 15:53:54 crc kubenswrapper[5120]: I0316 15:53:54.466067 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-746gq" Mar 16 15:53:54 crc kubenswrapper[5120]: I0316 15:53:54.482178 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"openstack-cell1-mariadb-root-db-secret\"" Mar 16 15:53:54 crc kubenswrapper[5120]: I0316 15:53:54.492239 5120 generic.go:358] "Generic (PLEG): container finished" podID="6f641d93-c3e7-40c3-8d96-d89b931d18cc" containerID="98e806b8d757df5c6012a1ab4db4964a7dc1f33eff452a1bc8ca796b05a78430" exitCode=143 Mar 16 15:53:54 crc kubenswrapper[5120]: I0316 15:53:54.492341 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"6f641d93-c3e7-40c3-8d96-d89b931d18cc","Type":"ContainerDied","Data":"98e806b8d757df5c6012a1ab4db4964a7dc1f33eff452a1bc8ca796b05a78430"} Mar 16 15:53:54 crc kubenswrapper[5120]: I0316 15:53:54.497436 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/19be266e-6805-4342-be0d-7fff0fc81029-operator-scripts\") pod \"root-account-create-update-746gq\" (UID: \"19be266e-6805-4342-be0d-7fff0fc81029\") " pod="openstack-kuttl-tests/root-account-create-update-746gq" Mar 16 15:53:54 crc kubenswrapper[5120]: I0316 15:53:54.497690 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hp482\" (UniqueName: \"kubernetes.io/projected/19be266e-6805-4342-be0d-7fff0fc81029-kube-api-access-hp482\") pod \"root-account-create-update-746gq\" (UID: \"19be266e-6805-4342-be0d-7fff0fc81029\") " pod="openstack-kuttl-tests/root-account-create-update-746gq" Mar 16 15:53:54 crc kubenswrapper[5120]: I0316 15:53:54.525583 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-746gq"] Mar 16 15:53:54 crc kubenswrapper[5120]: I0316 15:53:54.584734 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-0a49-account-create-update-fqp48"] Mar 16 15:53:54 crc kubenswrapper[5120]: I0316 15:53:54.613965 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hp482\" (UniqueName: \"kubernetes.io/projected/19be266e-6805-4342-be0d-7fff0fc81029-kube-api-access-hp482\") pod \"root-account-create-update-746gq\" (UID: \"19be266e-6805-4342-be0d-7fff0fc81029\") " pod="openstack-kuttl-tests/root-account-create-update-746gq" Mar 16 15:53:54 crc kubenswrapper[5120]: I0316 15:53:54.614121 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/19be266e-6805-4342-be0d-7fff0fc81029-operator-scripts\") pod \"root-account-create-update-746gq\" (UID: \"19be266e-6805-4342-be0d-7fff0fc81029\") " pod="openstack-kuttl-tests/root-account-create-update-746gq" Mar 16 15:53:54 crc kubenswrapper[5120]: I0316 15:53:54.615424 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/19be266e-6805-4342-be0d-7fff0fc81029-operator-scripts\") pod \"root-account-create-update-746gq\" (UID: \"19be266e-6805-4342-be0d-7fff0fc81029\") " pod="openstack-kuttl-tests/root-account-create-update-746gq" Mar 16 15:53:54 crc kubenswrapper[5120]: I0316 15:53:54.725540 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 15:53:54 crc kubenswrapper[5120]: I0316 15:53:54.730304 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-0a49-account-create-update-fqp48" Mar 16 15:53:54 crc kubenswrapper[5120]: I0316 15:53:54.789998 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-db-secret\"" Mar 16 15:53:54 crc kubenswrapper[5120]: I0316 15:53:54.841252 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p94gj\" (UniqueName: \"kubernetes.io/projected/687a8fb9-59e3-46c6-bdb9-f435b5cb52d9-kube-api-access-p94gj\") pod \"nova-cell1-0a49-account-create-update-fqp48\" (UID: \"687a8fb9-59e3-46c6-bdb9-f435b5cb52d9\") " pod="openstack-kuttl-tests/nova-cell1-0a49-account-create-update-fqp48" Mar 16 15:53:54 crc kubenswrapper[5120]: I0316 15:53:54.847464 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/687a8fb9-59e3-46c6-bdb9-f435b5cb52d9-operator-scripts\") pod \"nova-cell1-0a49-account-create-update-fqp48\" (UID: \"687a8fb9-59e3-46c6-bdb9-f435b5cb52d9\") " pod="openstack-kuttl-tests/nova-cell1-0a49-account-create-update-fqp48" Mar 16 15:53:54 crc kubenswrapper[5120]: I0316 15:53:54.876288 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa51d995-3c54-4c86-9103-bd38ca52653d" path="/var/lib/kubelet/pods/aa51d995-3c54-4c86-9103-bd38ca52653d/volumes" Mar 16 15:53:54 crc kubenswrapper[5120]: I0316 15:53:54.878724 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc6757c4-4a63-4db6-b3d6-2a42f658123f" path="/var/lib/kubelet/pods/cc6757c4-4a63-4db6-b3d6-2a42f658123f/volumes" Mar 16 15:53:54 crc kubenswrapper[5120]: I0316 15:53:54.879623 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 15:53:54 crc kubenswrapper[5120]: I0316 15:53:54.879658 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-0a49-account-create-update-fqp48"] Mar 16 15:53:54 crc kubenswrapper[5120]: I0316 15:53:54.892073 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-a347-account-create-update-89khd"] Mar 16 15:53:54 crc kubenswrapper[5120]: I0316 15:53:54.916272 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-a347-account-create-update-89khd" Mar 16 15:53:54 crc kubenswrapper[5120]: I0316 15:53:54.945883 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-a347-account-create-update-89khd"] Mar 16 15:53:54 crc kubenswrapper[5120]: I0316 15:53:54.947994 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-3f2f-account-create-update-rfgcb"] Mar 16 15:53:54 crc kubenswrapper[5120]: I0316 15:53:54.988208 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-db-secret\"" Mar 16 15:53:54 crc kubenswrapper[5120]: I0316 15:53:54.990419 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/687a8fb9-59e3-46c6-bdb9-f435b5cb52d9-operator-scripts\") pod \"nova-cell1-0a49-account-create-update-fqp48\" (UID: \"687a8fb9-59e3-46c6-bdb9-f435b5cb52d9\") " pod="openstack-kuttl-tests/nova-cell1-0a49-account-create-update-fqp48" Mar 16 15:53:54 crc kubenswrapper[5120]: I0316 15:53:54.990455 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3af1f773-b662-412f-820d-bea6ba7e58ca-operator-scripts\") pod \"placement-a347-account-create-update-89khd\" (UID: \"3af1f773-b662-412f-820d-bea6ba7e58ca\") " pod="openstack-kuttl-tests/placement-a347-account-create-update-89khd" Mar 16 15:53:54 crc kubenswrapper[5120]: I0316 15:53:54.990559 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfllx\" (UniqueName: \"kubernetes.io/projected/3af1f773-b662-412f-820d-bea6ba7e58ca-kube-api-access-tfllx\") pod \"placement-a347-account-create-update-89khd\" (UID: \"3af1f773-b662-412f-820d-bea6ba7e58ca\") " pod="openstack-kuttl-tests/placement-a347-account-create-update-89khd" Mar 16 15:53:54 crc kubenswrapper[5120]: I0316 15:53:54.990602 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p94gj\" (UniqueName: \"kubernetes.io/projected/687a8fb9-59e3-46c6-bdb9-f435b5cb52d9-kube-api-access-p94gj\") pod \"nova-cell1-0a49-account-create-update-fqp48\" (UID: \"687a8fb9-59e3-46c6-bdb9-f435b5cb52d9\") " pod="openstack-kuttl-tests/nova-cell1-0a49-account-create-update-fqp48" Mar 16 15:53:54 crc kubenswrapper[5120]: I0316 15:53:54.992868 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/687a8fb9-59e3-46c6-bdb9-f435b5cb52d9-operator-scripts\") pod \"nova-cell1-0a49-account-create-update-fqp48\" (UID: \"687a8fb9-59e3-46c6-bdb9-f435b5cb52d9\") " pod="openstack-kuttl-tests/nova-cell1-0a49-account-create-update-fqp48" Mar 16 15:53:55 crc kubenswrapper[5120]: I0316 15:53:55.018256 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 15:53:55 crc kubenswrapper[5120]: I0316 15:53:55.018291 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-a347-account-create-update-f9f46"] Mar 16 15:53:55 crc kubenswrapper[5120]: I0316 15:53:55.018302 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-9b99-account-create-update-djffv"] Mar 16 15:53:55 crc kubenswrapper[5120]: I0316 15:53:55.018903 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-3f2f-account-create-update-rfgcb" Mar 16 15:53:55 crc kubenswrapper[5120]: I0316 15:53:55.019229 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="8821dbd3-25f2-44ea-8a41-e716db08960a" containerName="ceilometer-central-agent" containerID="cri-o://ae70819b9a1f84ddd33ad93962ec42573aee9adbc472f37bb2fafc17feabaa45" gracePeriod=30 Mar 16 15:53:55 crc kubenswrapper[5120]: I0316 15:53:55.019326 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="8821dbd3-25f2-44ea-8a41-e716db08960a" containerName="sg-core" containerID="cri-o://644887079b1213997556ab399de2c246219f6ab30fc16e674faf786eacb49089" gracePeriod=30 Mar 16 15:53:55 crc kubenswrapper[5120]: I0316 15:53:55.019364 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="8821dbd3-25f2-44ea-8a41-e716db08960a" containerName="ceilometer-notification-agent" containerID="cri-o://90908bbbef74b7f5e704e8c24916f04d08ee29789fc078f939aaa8b2aa2fd831" gracePeriod=30 Mar 16 15:53:55 crc kubenswrapper[5120]: I0316 15:53:55.019478 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="8821dbd3-25f2-44ea-8a41-e716db08960a" containerName="proxy-httpd" containerID="cri-o://c10a021b8eb3c6d7e0a7d62489b393cff613269c9c5979e7ef8c0dc2960ee167" gracePeriod=30 Mar 16 15:53:55 crc kubenswrapper[5120]: I0316 15:53:55.034296 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-db-secret\"" Mar 16 15:53:55 crc kubenswrapper[5120]: I0316 15:53:55.052437 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p94gj\" (UniqueName: \"kubernetes.io/projected/687a8fb9-59e3-46c6-bdb9-f435b5cb52d9-kube-api-access-p94gj\") pod \"nova-cell1-0a49-account-create-update-fqp48\" (UID: \"687a8fb9-59e3-46c6-bdb9-f435b5cb52d9\") " pod="openstack-kuttl-tests/nova-cell1-0a49-account-create-update-fqp48" Mar 16 15:53:55 crc kubenswrapper[5120]: I0316 15:53:55.053328 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-3f2f-account-create-update-rfgcb"] Mar 16 15:53:55 crc kubenswrapper[5120]: I0316 15:53:55.053362 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-a347-account-create-update-f9f46"] Mar 16 15:53:55 crc kubenswrapper[5120]: I0316 15:53:55.053383 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-a8cd-account-create-update-nbt76"] Mar 16 15:53:55 crc kubenswrapper[5120]: I0316 15:53:55.063063 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-9b99-account-create-update-djffv" Mar 16 15:53:55 crc kubenswrapper[5120]: E0316 15:53:55.064666 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="387a7e18b82c50f51c96a48a6b0e06ca0ff7ee666aa82162ae48b3f8a16f6166" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Mar 16 15:53:55 crc kubenswrapper[5120]: E0316 15:53:55.072505 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="387a7e18b82c50f51c96a48a6b0e06ca0ff7ee666aa82162ae48b3f8a16f6166" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Mar 16 15:53:55 crc kubenswrapper[5120]: I0316 15:53:55.079280 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Mar 16 15:53:55 crc kubenswrapper[5120]: E0316 15:53:55.103093 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="387a7e18b82c50f51c96a48a6b0e06ca0ff7ee666aa82162ae48b3f8a16f6166" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Mar 16 15:53:55 crc kubenswrapper[5120]: E0316 15:53:55.103143 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/ovn-northd-0" podUID="6ac49efe-dc8a-47b2-9432-afb41c69ebff" containerName="ovn-northd" probeResult="unknown" Mar 16 15:53:55 crc kubenswrapper[5120]: I0316 15:53:55.106847 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5fzr\" (UniqueName: \"kubernetes.io/projected/2f3efc59-f473-4fd6-acc0-ce261268d63b-kube-api-access-q5fzr\") pod \"glance-3f2f-account-create-update-rfgcb\" (UID: \"2f3efc59-f473-4fd6-acc0-ce261268d63b\") " pod="openstack-kuttl-tests/glance-3f2f-account-create-update-rfgcb" Mar 16 15:53:55 crc kubenswrapper[5120]: I0316 15:53:55.107115 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3af1f773-b662-412f-820d-bea6ba7e58ca-operator-scripts\") pod \"placement-a347-account-create-update-89khd\" (UID: \"3af1f773-b662-412f-820d-bea6ba7e58ca\") " pod="openstack-kuttl-tests/placement-a347-account-create-update-89khd" Mar 16 15:53:55 crc kubenswrapper[5120]: I0316 15:53:55.107315 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2f3efc59-f473-4fd6-acc0-ce261268d63b-operator-scripts\") pod \"glance-3f2f-account-create-update-rfgcb\" (UID: \"2f3efc59-f473-4fd6-acc0-ce261268d63b\") " pod="openstack-kuttl-tests/glance-3f2f-account-create-update-rfgcb" Mar 16 15:53:55 crc kubenswrapper[5120]: I0316 15:53:55.107440 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tfllx\" (UniqueName: \"kubernetes.io/projected/3af1f773-b662-412f-820d-bea6ba7e58ca-kube-api-access-tfllx\") pod \"placement-a347-account-create-update-89khd\" (UID: \"3af1f773-b662-412f-820d-bea6ba7e58ca\") " pod="openstack-kuttl-tests/placement-a347-account-create-update-89khd" Mar 16 15:53:55 crc kubenswrapper[5120]: I0316 15:53:55.107910 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3af1f773-b662-412f-820d-bea6ba7e58ca-operator-scripts\") pod \"placement-a347-account-create-update-89khd\" (UID: \"3af1f773-b662-412f-820d-bea6ba7e58ca\") " pod="openstack-kuttl-tests/placement-a347-account-create-update-89khd" Mar 16 15:53:55 crc kubenswrapper[5120]: I0316 15:53:55.111576 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 15:53:55 crc kubenswrapper[5120]: I0316 15:53:55.111610 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-9b99-account-create-update-djffv"] Mar 16 15:53:55 crc kubenswrapper[5120]: I0316 15:53:55.111623 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-dd94-account-create-update-l69rr"] Mar 16 15:53:55 crc kubenswrapper[5120]: I0316 15:53:55.112667 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90534d56-28ff-4983-b8ea-be83259ce64d" containerName="memcached" Mar 16 15:53:55 crc kubenswrapper[5120]: I0316 15:53:55.112679 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="90534d56-28ff-4983-b8ea-be83259ce64d" containerName="memcached" Mar 16 15:53:55 crc kubenswrapper[5120]: I0316 15:53:55.115382 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-db-secret\"" Mar 16 15:53:55 crc kubenswrapper[5120]: I0316 15:53:55.131399 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-a8cd-account-create-update-nbt76" Mar 16 15:53:55 crc kubenswrapper[5120]: I0316 15:53:55.132132 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="90534d56-28ff-4983-b8ea-be83259ce64d" containerName="memcached" Mar 16 15:53:55 crc kubenswrapper[5120]: I0316 15:53:55.137974 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-a8cd-account-create-update-nbt76"] Mar 16 15:53:55 crc kubenswrapper[5120]: I0316 15:53:55.138004 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-dd94-account-create-update-l69rr"] Mar 16 15:53:55 crc kubenswrapper[5120]: I0316 15:53:55.138110 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-dd94-account-create-update-l69rr" Mar 16 15:53:55 crc kubenswrapper[5120]: I0316 15:53:55.160222 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-db-secret\"" Mar 16 15:53:55 crc kubenswrapper[5120]: I0316 15:53:55.191553 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-69c8889b9f-sfbxd"] Mar 16 15:53:55 crc kubenswrapper[5120]: I0316 15:53:55.234912 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_a7b8bb1c-b58a-43a6-8457-88a025588f1e/ovsdbserver-nb/0.log" Mar 16 15:53:55 crc kubenswrapper[5120]: I0316 15:53:55.234995 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 15:53:55 crc kubenswrapper[5120]: I0316 15:53:55.235152 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-db-secret\"" Mar 16 15:53:55 crc kubenswrapper[5120]: I0316 15:53:55.236694 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2f3efc59-f473-4fd6-acc0-ce261268d63b-operator-scripts\") pod \"glance-3f2f-account-create-update-rfgcb\" (UID: \"2f3efc59-f473-4fd6-acc0-ce261268d63b\") " pod="openstack-kuttl-tests/glance-3f2f-account-create-update-rfgcb" Mar 16 15:53:55 crc kubenswrapper[5120]: I0316 15:53:55.236810 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q5fzr\" (UniqueName: \"kubernetes.io/projected/2f3efc59-f473-4fd6-acc0-ce261268d63b-kube-api-access-q5fzr\") pod \"glance-3f2f-account-create-update-rfgcb\" (UID: \"2f3efc59-f473-4fd6-acc0-ce261268d63b\") " pod="openstack-kuttl-tests/glance-3f2f-account-create-update-rfgcb" Mar 16 15:53:55 crc kubenswrapper[5120]: I0316 15:53:55.244399 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfllx\" (UniqueName: \"kubernetes.io/projected/3af1f773-b662-412f-820d-bea6ba7e58ca-kube-api-access-tfllx\") pod \"placement-a347-account-create-update-89khd\" (UID: \"3af1f773-b662-412f-820d-bea6ba7e58ca\") " pod="openstack-kuttl-tests/placement-a347-account-create-update-89khd" Mar 16 15:53:55 crc kubenswrapper[5120]: I0316 15:53:55.244552 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2f3efc59-f473-4fd6-acc0-ce261268d63b-operator-scripts\") pod \"glance-3f2f-account-create-update-rfgcb\" (UID: \"2f3efc59-f473-4fd6-acc0-ce261268d63b\") " pod="openstack-kuttl-tests/glance-3f2f-account-create-update-rfgcb" Mar 16 15:53:55 crc kubenswrapper[5120]: I0316 15:53:55.341498 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/a7b8bb1c-b58a-43a6-8457-88a025588f1e-scripts\") pod \"a7b8bb1c-b58a-43a6-8457-88a025588f1e\" (UID: \"a7b8bb1c-b58a-43a6-8457-88a025588f1e\") " Mar 16 15:53:55 crc kubenswrapper[5120]: I0316 15:53:55.341575 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovndbcluster-nb-etc-ovn\" (UniqueName: \"kubernetes.io/local-volume/local-storage15-crc\") pod \"a7b8bb1c-b58a-43a6-8457-88a025588f1e\" (UID: \"a7b8bb1c-b58a-43a6-8457-88a025588f1e\") " Mar 16 15:53:55 crc kubenswrapper[5120]: I0316 15:53:55.341649 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a7b8bb1c-b58a-43a6-8457-88a025588f1e-config\") pod \"a7b8bb1c-b58a-43a6-8457-88a025588f1e\" (UID: \"a7b8bb1c-b58a-43a6-8457-88a025588f1e\") " Mar 16 15:53:55 crc kubenswrapper[5120]: I0316 15:53:55.341706 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/a7b8bb1c-b58a-43a6-8457-88a025588f1e-ovsdb-rundir\") pod \"a7b8bb1c-b58a-43a6-8457-88a025588f1e\" (UID: \"a7b8bb1c-b58a-43a6-8457-88a025588f1e\") " Mar 16 15:53:55 crc kubenswrapper[5120]: I0316 15:53:55.341730 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/90534d56-28ff-4983-b8ea-be83259ce64d-kolla-config\") pod \"90534d56-28ff-4983-b8ea-be83259ce64d\" (UID: \"90534d56-28ff-4983-b8ea-be83259ce64d\") " Mar 16 15:53:55 crc kubenswrapper[5120]: I0316 15:53:55.341750 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mxddx\" (UniqueName: \"kubernetes.io/projected/90534d56-28ff-4983-b8ea-be83259ce64d-kube-api-access-mxddx\") pod \"90534d56-28ff-4983-b8ea-be83259ce64d\" (UID: \"90534d56-28ff-4983-b8ea-be83259ce64d\") " Mar 16 15:53:55 crc kubenswrapper[5120]: I0316 15:53:55.341831 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/90534d56-28ff-4983-b8ea-be83259ce64d-config-data\") pod \"90534d56-28ff-4983-b8ea-be83259ce64d\" (UID: \"90534d56-28ff-4983-b8ea-be83259ce64d\") " Mar 16 15:53:55 crc kubenswrapper[5120]: I0316 15:53:55.341876 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/90534d56-28ff-4983-b8ea-be83259ce64d-combined-ca-bundle\") pod \"90534d56-28ff-4983-b8ea-be83259ce64d\" (UID: \"90534d56-28ff-4983-b8ea-be83259ce64d\") " Mar 16 15:53:55 crc kubenswrapper[5120]: I0316 15:53:55.341951 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/90534d56-28ff-4983-b8ea-be83259ce64d-memcached-tls-certs\") pod \"90534d56-28ff-4983-b8ea-be83259ce64d\" (UID: \"90534d56-28ff-4983-b8ea-be83259ce64d\") " Mar 16 15:53:55 crc kubenswrapper[5120]: I0316 15:53:55.342029 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a7b8bb1c-b58a-43a6-8457-88a025588f1e-combined-ca-bundle\") pod \"a7b8bb1c-b58a-43a6-8457-88a025588f1e\" (UID: \"a7b8bb1c-b58a-43a6-8457-88a025588f1e\") " Mar 16 15:53:55 crc kubenswrapper[5120]: I0316 15:53:55.342052 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/a7b8bb1c-b58a-43a6-8457-88a025588f1e-metrics-certs-tls-certs\") pod \"a7b8bb1c-b58a-43a6-8457-88a025588f1e\" (UID: \"a7b8bb1c-b58a-43a6-8457-88a025588f1e\") " Mar 16 15:53:55 crc kubenswrapper[5120]: I0316 15:53:55.342137 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/a7b8bb1c-b58a-43a6-8457-88a025588f1e-ovsdbserver-nb-tls-certs\") pod \"a7b8bb1c-b58a-43a6-8457-88a025588f1e\" (UID: \"a7b8bb1c-b58a-43a6-8457-88a025588f1e\") " Mar 16 15:53:55 crc kubenswrapper[5120]: I0316 15:53:55.342190 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5w62m\" (UniqueName: \"kubernetes.io/projected/a7b8bb1c-b58a-43a6-8457-88a025588f1e-kube-api-access-5w62m\") pod \"a7b8bb1c-b58a-43a6-8457-88a025588f1e\" (UID: \"a7b8bb1c-b58a-43a6-8457-88a025588f1e\") " Mar 16 15:53:55 crc kubenswrapper[5120]: I0316 15:53:55.342556 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0c87b06f-6b7e-46f2-8aee-34285fea622e-operator-scripts\") pod \"neutron-a8cd-account-create-update-nbt76\" (UID: \"0c87b06f-6b7e-46f2-8aee-34285fea622e\") " pod="openstack-kuttl-tests/neutron-a8cd-account-create-update-nbt76" Mar 16 15:53:55 crc kubenswrapper[5120]: I0316 15:53:55.342634 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zp9r5\" (UniqueName: \"kubernetes.io/projected/afa004e7-041e-4f04-8864-7163df19cf53-kube-api-access-zp9r5\") pod \"cinder-dd94-account-create-update-l69rr\" (UID: \"afa004e7-041e-4f04-8864-7163df19cf53\") " pod="openstack-kuttl-tests/cinder-dd94-account-create-update-l69rr" Mar 16 15:53:55 crc kubenswrapper[5120]: I0316 15:53:55.342945 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7spch\" (UniqueName: \"kubernetes.io/projected/0c87b06f-6b7e-46f2-8aee-34285fea622e-kube-api-access-7spch\") pod \"neutron-a8cd-account-create-update-nbt76\" (UID: \"0c87b06f-6b7e-46f2-8aee-34285fea622e\") " pod="openstack-kuttl-tests/neutron-a8cd-account-create-update-nbt76" Mar 16 15:53:55 crc kubenswrapper[5120]: I0316 15:53:55.343103 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/89c20c31-44e2-4359-b7ee-e2e8b00b4e19-operator-scripts\") pod \"nova-cell0-9b99-account-create-update-djffv\" (UID: \"89c20c31-44e2-4359-b7ee-e2e8b00b4e19\") " pod="openstack-kuttl-tests/nova-cell0-9b99-account-create-update-djffv" Mar 16 15:53:55 crc kubenswrapper[5120]: I0316 15:53:55.343181 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdnbr\" (UniqueName: \"kubernetes.io/projected/89c20c31-44e2-4359-b7ee-e2e8b00b4e19-kube-api-access-xdnbr\") pod \"nova-cell0-9b99-account-create-update-djffv\" (UID: \"89c20c31-44e2-4359-b7ee-e2e8b00b4e19\") " pod="openstack-kuttl-tests/nova-cell0-9b99-account-create-update-djffv" Mar 16 15:53:55 crc kubenswrapper[5120]: I0316 15:53:55.343886 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/90534d56-28ff-4983-b8ea-be83259ce64d-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "90534d56-28ff-4983-b8ea-be83259ce64d" (UID: "90534d56-28ff-4983-b8ea-be83259ce64d"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:53:55 crc kubenswrapper[5120]: I0316 15:53:55.345806 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/afa004e7-041e-4f04-8864-7163df19cf53-operator-scripts\") pod \"cinder-dd94-account-create-update-l69rr\" (UID: \"afa004e7-041e-4f04-8864-7163df19cf53\") " pod="openstack-kuttl-tests/cinder-dd94-account-create-update-l69rr" Mar 16 15:53:55 crc kubenswrapper[5120]: I0316 15:53:55.345998 5120 reconciler_common.go:299] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/90534d56-28ff-4983-b8ea-be83259ce64d-kolla-config\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:55 crc kubenswrapper[5120]: I0316 15:53:55.346409 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a7b8bb1c-b58a-43a6-8457-88a025588f1e-config" (OuterVolumeSpecName: "config") pod "a7b8bb1c-b58a-43a6-8457-88a025588f1e" (UID: "a7b8bb1c-b58a-43a6-8457-88a025588f1e"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:53:55 crc kubenswrapper[5120]: I0316 15:53:55.346935 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7b8bb1c-b58a-43a6-8457-88a025588f1e-ovsdb-rundir" (OuterVolumeSpecName: "ovsdb-rundir") pod "a7b8bb1c-b58a-43a6-8457-88a025588f1e" (UID: "a7b8bb1c-b58a-43a6-8457-88a025588f1e"). InnerVolumeSpecName "ovsdb-rundir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:53:55 crc kubenswrapper[5120]: I0316 15:53:55.350423 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/90534d56-28ff-4983-b8ea-be83259ce64d-config-data" (OuterVolumeSpecName: "config-data") pod "90534d56-28ff-4983-b8ea-be83259ce64d" (UID: "90534d56-28ff-4983-b8ea-be83259ce64d"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:53:55 crc kubenswrapper[5120]: I0316 15:53:55.362697 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a7b8bb1c-b58a-43a6-8457-88a025588f1e-scripts" (OuterVolumeSpecName: "scripts") pod "a7b8bb1c-b58a-43a6-8457-88a025588f1e" (UID: "a7b8bb1c-b58a-43a6-8457-88a025588f1e"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:53:55 crc kubenswrapper[5120]: I0316 15:53:55.362740 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-0a49-account-create-update-fqp48" Mar 16 15:53:55 crc kubenswrapper[5120]: I0316 15:53:55.373524 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-3f2f-account-create-update-dvkp2"] Mar 16 15:53:55 crc kubenswrapper[5120]: I0316 15:53:55.388402 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hp482\" (UniqueName: \"kubernetes.io/projected/19be266e-6805-4342-be0d-7fff0fc81029-kube-api-access-hp482\") pod \"root-account-create-update-746gq\" (UID: \"19be266e-6805-4342-be0d-7fff0fc81029\") " pod="openstack-kuttl-tests/root-account-create-update-746gq" Mar 16 15:53:55 crc kubenswrapper[5120]: I0316 15:53:55.391820 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-3f2f-account-create-update-dvkp2"] Mar 16 15:53:55 crc kubenswrapper[5120]: I0316 15:53:55.411069 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7b8bb1c-b58a-43a6-8457-88a025588f1e-kube-api-access-5w62m" (OuterVolumeSpecName: "kube-api-access-5w62m") pod "a7b8bb1c-b58a-43a6-8457-88a025588f1e" (UID: "a7b8bb1c-b58a-43a6-8457-88a025588f1e"). InnerVolumeSpecName "kube-api-access-5w62m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:53:55 crc kubenswrapper[5120]: I0316 15:53:55.411328 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage15-crc" (OuterVolumeSpecName: "ovndbcluster-nb-etc-ovn") pod "a7b8bb1c-b58a-43a6-8457-88a025588f1e" (UID: "a7b8bb1c-b58a-43a6-8457-88a025588f1e"). InnerVolumeSpecName "local-storage15-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 15:53:55 crc kubenswrapper[5120]: I0316 15:53:55.419215 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-9b99-account-create-update-nqhst"] Mar 16 15:53:55 crc kubenswrapper[5120]: I0316 15:53:55.424924 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90534d56-28ff-4983-b8ea-be83259ce64d-kube-api-access-mxddx" (OuterVolumeSpecName: "kube-api-access-mxddx") pod "90534d56-28ff-4983-b8ea-be83259ce64d" (UID: "90534d56-28ff-4983-b8ea-be83259ce64d"). InnerVolumeSpecName "kube-api-access-mxddx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:53:55 crc kubenswrapper[5120]: I0316 15:53:55.430198 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-a347-account-create-update-89khd" Mar 16 15:53:55 crc kubenswrapper[5120]: I0316 15:53:55.450627 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7spch\" (UniqueName: \"kubernetes.io/projected/0c87b06f-6b7e-46f2-8aee-34285fea622e-kube-api-access-7spch\") pod \"neutron-a8cd-account-create-update-nbt76\" (UID: \"0c87b06f-6b7e-46f2-8aee-34285fea622e\") " pod="openstack-kuttl-tests/neutron-a8cd-account-create-update-nbt76" Mar 16 15:53:55 crc kubenswrapper[5120]: I0316 15:53:55.450696 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/89c20c31-44e2-4359-b7ee-e2e8b00b4e19-operator-scripts\") pod \"nova-cell0-9b99-account-create-update-djffv\" (UID: \"89c20c31-44e2-4359-b7ee-e2e8b00b4e19\") " pod="openstack-kuttl-tests/nova-cell0-9b99-account-create-update-djffv" Mar 16 15:53:55 crc kubenswrapper[5120]: I0316 15:53:55.450724 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xdnbr\" (UniqueName: \"kubernetes.io/projected/89c20c31-44e2-4359-b7ee-e2e8b00b4e19-kube-api-access-xdnbr\") pod \"nova-cell0-9b99-account-create-update-djffv\" (UID: \"89c20c31-44e2-4359-b7ee-e2e8b00b4e19\") " pod="openstack-kuttl-tests/nova-cell0-9b99-account-create-update-djffv" Mar 16 15:53:55 crc kubenswrapper[5120]: I0316 15:53:55.450817 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/afa004e7-041e-4f04-8864-7163df19cf53-operator-scripts\") pod \"cinder-dd94-account-create-update-l69rr\" (UID: \"afa004e7-041e-4f04-8864-7163df19cf53\") " pod="openstack-kuttl-tests/cinder-dd94-account-create-update-l69rr" Mar 16 15:53:55 crc kubenswrapper[5120]: I0316 15:53:55.450882 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0c87b06f-6b7e-46f2-8aee-34285fea622e-operator-scripts\") pod \"neutron-a8cd-account-create-update-nbt76\" (UID: \"0c87b06f-6b7e-46f2-8aee-34285fea622e\") " pod="openstack-kuttl-tests/neutron-a8cd-account-create-update-nbt76" Mar 16 15:53:55 crc kubenswrapper[5120]: I0316 15:53:55.450908 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zp9r5\" (UniqueName: \"kubernetes.io/projected/afa004e7-041e-4f04-8864-7163df19cf53-kube-api-access-zp9r5\") pod \"cinder-dd94-account-create-update-l69rr\" (UID: \"afa004e7-041e-4f04-8864-7163df19cf53\") " pod="openstack-kuttl-tests/cinder-dd94-account-create-update-l69rr" Mar 16 15:53:55 crc kubenswrapper[5120]: I0316 15:53:55.451015 5120 reconciler_common.go:299] "Volume detached for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/a7b8bb1c-b58a-43a6-8457-88a025588f1e-ovsdb-rundir\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:55 crc kubenswrapper[5120]: I0316 15:53:55.451025 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mxddx\" (UniqueName: \"kubernetes.io/projected/90534d56-28ff-4983-b8ea-be83259ce64d-kube-api-access-mxddx\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:55 crc kubenswrapper[5120]: I0316 15:53:55.451034 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/90534d56-28ff-4983-b8ea-be83259ce64d-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:55 crc kubenswrapper[5120]: I0316 15:53:55.451046 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5w62m\" (UniqueName: \"kubernetes.io/projected/a7b8bb1c-b58a-43a6-8457-88a025588f1e-kube-api-access-5w62m\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:55 crc kubenswrapper[5120]: I0316 15:53:55.451054 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/a7b8bb1c-b58a-43a6-8457-88a025588f1e-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:55 crc kubenswrapper[5120]: I0316 15:53:55.451073 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage15-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage15-crc\") on node \"crc\" " Mar 16 15:53:55 crc kubenswrapper[5120]: I0316 15:53:55.451082 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a7b8bb1c-b58a-43a6-8457-88a025588f1e-config\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:55 crc kubenswrapper[5120]: I0316 15:53:55.452547 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/89c20c31-44e2-4359-b7ee-e2e8b00b4e19-operator-scripts\") pod \"nova-cell0-9b99-account-create-update-djffv\" (UID: \"89c20c31-44e2-4359-b7ee-e2e8b00b4e19\") " pod="openstack-kuttl-tests/nova-cell0-9b99-account-create-update-djffv" Mar 16 15:53:55 crc kubenswrapper[5120]: I0316 15:53:55.453302 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/afa004e7-041e-4f04-8864-7163df19cf53-operator-scripts\") pod \"cinder-dd94-account-create-update-l69rr\" (UID: \"afa004e7-041e-4f04-8864-7163df19cf53\") " pod="openstack-kuttl-tests/cinder-dd94-account-create-update-l69rr" Mar 16 15:53:55 crc kubenswrapper[5120]: I0316 15:53:55.453937 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0c87b06f-6b7e-46f2-8aee-34285fea622e-operator-scripts\") pod \"neutron-a8cd-account-create-update-nbt76\" (UID: \"0c87b06f-6b7e-46f2-8aee-34285fea622e\") " pod="openstack-kuttl-tests/neutron-a8cd-account-create-update-nbt76" Mar 16 15:53:55 crc kubenswrapper[5120]: I0316 15:53:55.454058 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5fzr\" (UniqueName: \"kubernetes.io/projected/2f3efc59-f473-4fd6-acc0-ce261268d63b-kube-api-access-q5fzr\") pod \"glance-3f2f-account-create-update-rfgcb\" (UID: \"2f3efc59-f473-4fd6-acc0-ce261268d63b\") " pod="openstack-kuttl-tests/glance-3f2f-account-create-update-rfgcb" Mar 16 15:53:55 crc kubenswrapper[5120]: I0316 15:53:55.488662 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-3f2f-account-create-update-rfgcb" Mar 16 15:53:55 crc kubenswrapper[5120]: I0316 15:53:55.492855 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-9b99-account-create-update-nqhst"] Mar 16 15:53:55 crc kubenswrapper[5120]: I0316 15:53:55.505154 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-746gq" Mar 16 15:53:55 crc kubenswrapper[5120]: I0316 15:53:55.557198 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdnbr\" (UniqueName: \"kubernetes.io/projected/89c20c31-44e2-4359-b7ee-e2e8b00b4e19-kube-api-access-xdnbr\") pod \"nova-cell0-9b99-account-create-update-djffv\" (UID: \"89c20c31-44e2-4359-b7ee-e2e8b00b4e19\") " pod="openstack-kuttl-tests/nova-cell0-9b99-account-create-update-djffv" Mar 16 15:53:55 crc kubenswrapper[5120]: I0316 15:53:55.574305 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zp9r5\" (UniqueName: \"kubernetes.io/projected/afa004e7-041e-4f04-8864-7163df19cf53-kube-api-access-zp9r5\") pod \"cinder-dd94-account-create-update-l69rr\" (UID: \"afa004e7-041e-4f04-8864-7163df19cf53\") " pod="openstack-kuttl-tests/cinder-dd94-account-create-update-l69rr" Mar 16 15:53:55 crc kubenswrapper[5120]: I0316 15:53:55.600371 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7spch\" (UniqueName: \"kubernetes.io/projected/0c87b06f-6b7e-46f2-8aee-34285fea622e-kube-api-access-7spch\") pod \"neutron-a8cd-account-create-update-nbt76\" (UID: \"0c87b06f-6b7e-46f2-8aee-34285fea622e\") " pod="openstack-kuttl-tests/neutron-a8cd-account-create-update-nbt76" Mar 16 15:53:55 crc kubenswrapper[5120]: I0316 15:53:55.603694 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-9b99-account-create-update-djffv" Mar 16 15:53:55 crc kubenswrapper[5120]: I0316 15:53:55.607794 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-a8cd-account-create-update-vd2sd"] Mar 16 15:53:55 crc kubenswrapper[5120]: I0316 15:53:55.620460 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-a8cd-account-create-update-vd2sd"] Mar 16 15:53:55 crc kubenswrapper[5120]: I0316 15:53:55.693012 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-a8cd-account-create-update-nbt76" Mar 16 15:53:55 crc kubenswrapper[5120]: I0316 15:53:55.707156 5120 generic.go:358] "Generic (PLEG): container finished" podID="8821dbd3-25f2-44ea-8a41-e716db08960a" containerID="644887079b1213997556ab399de2c246219f6ab30fc16e674faf786eacb49089" exitCode=2 Mar 16 15:53:55 crc kubenswrapper[5120]: I0316 15:53:55.707273 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"8821dbd3-25f2-44ea-8a41-e716db08960a","Type":"ContainerDied","Data":"644887079b1213997556ab399de2c246219f6ab30fc16e674faf786eacb49089"} Mar 16 15:53:55 crc kubenswrapper[5120]: I0316 15:53:55.749006 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-dd94-account-create-update-p7t46"] Mar 16 15:53:55 crc kubenswrapper[5120]: I0316 15:53:55.752070 5120 generic.go:358] "Generic (PLEG): container finished" podID="cb25223e-e443-4a56-9b17-d0159918b563" containerID="8748dcf62a7cbea6f73e88271be3d579871e9203831b32f0ef2c2b3d64a038b4" exitCode=0 Mar 16 15:53:55 crc kubenswrapper[5120]: I0316 15:53:55.752288 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"cb25223e-e443-4a56-9b17-d0159918b563","Type":"ContainerDied","Data":"8748dcf62a7cbea6f73e88271be3d579871e9203831b32f0ef2c2b3d64a038b4"} Mar 16 15:53:55 crc kubenswrapper[5120]: I0316 15:53:55.792288 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/90534d56-28ff-4983-b8ea-be83259ce64d-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "90534d56-28ff-4983-b8ea-be83259ce64d" (UID: "90534d56-28ff-4983-b8ea-be83259ce64d"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:53:55 crc kubenswrapper[5120]: I0316 15:53:55.814155 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/90534d56-28ff-4983-b8ea-be83259ce64d-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:55 crc kubenswrapper[5120]: I0316 15:53:55.859073 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage15-crc" (UniqueName: "kubernetes.io/local-volume/local-storage15-crc") on node "crc" Mar 16 15:53:55 crc kubenswrapper[5120]: I0316 15:53:55.905936 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-dd94-account-create-update-p7t46"] Mar 16 15:53:55 crc kubenswrapper[5120]: I0316 15:53:55.928570 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage15-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage15-crc\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:55 crc kubenswrapper[5120]: I0316 15:53:55.937519 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7b8bb1c-b58a-43a6-8457-88a025588f1e-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "a7b8bb1c-b58a-43a6-8457-88a025588f1e" (UID: "a7b8bb1c-b58a-43a6-8457-88a025588f1e"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:53:55 crc kubenswrapper[5120]: I0316 15:53:55.961796 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-h77sx"] Mar 16 15:53:56 crc kubenswrapper[5120]: I0316 15:53:56.060365 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a7b8bb1c-b58a-43a6-8457-88a025588f1e-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:56 crc kubenswrapper[5120]: I0316 15:53:56.061417 5120 generic.go:358] "Generic (PLEG): container finished" podID="672accec-238b-4e18-9b15-5ff8429d4256" containerID="97dd887c89b765ba273f5c85c867a679982fd142722154b57ea21c9d6404dbd7" exitCode=0 Mar 16 15:53:56 crc kubenswrapper[5120]: I0316 15:53:56.061529 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"672accec-238b-4e18-9b15-5ff8429d4256","Type":"ContainerDied","Data":"97dd887c89b765ba273f5c85c867a679982fd142722154b57ea21c9d6404dbd7"} Mar 16 15:53:56 crc kubenswrapper[5120]: I0316 15:53:56.062590 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7b8bb1c-b58a-43a6-8457-88a025588f1e-ovsdbserver-nb-tls-certs" (OuterVolumeSpecName: "ovsdbserver-nb-tls-certs") pod "a7b8bb1c-b58a-43a6-8457-88a025588f1e" (UID: "a7b8bb1c-b58a-43a6-8457-88a025588f1e"). InnerVolumeSpecName "ovsdbserver-nb-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:53:56 crc kubenswrapper[5120]: I0316 15:53:56.098258 5120 generic.go:358] "Generic (PLEG): container finished" podID="d6f8b8b2-e94a-4c67-9e6d-be16e2acbdcc" containerID="5beb51d5bb791063b06be012ed5435a350b1e205f8fa5e3c6377d8212b33d428" exitCode=137 Mar 16 15:53:56 crc kubenswrapper[5120]: I0316 15:53:56.126539 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Mar 16 15:53:56 crc kubenswrapper[5120]: I0316 15:53:56.126825 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"90534d56-28ff-4983-b8ea-be83259ce64d","Type":"ContainerDied","Data":"97d3d59ff745a33f7c7ce3d0202811e858cf720ad2d2b4c36ffefb6755dc6d9d"} Mar 16 15:53:56 crc kubenswrapper[5120]: I0316 15:53:56.127070 5120 scope.go:117] "RemoveContainer" containerID="fabcc54b602bf9faf9dc99913094ea0b2e649eaa684c0270cf178d6a7993957a" Mar 16 15:53:56 crc kubenswrapper[5120]: I0316 15:53:56.132631 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-h77sx"] Mar 16 15:53:56 crc kubenswrapper[5120]: I0316 15:53:56.143613 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/90534d56-28ff-4983-b8ea-be83259ce64d-memcached-tls-certs" (OuterVolumeSpecName: "memcached-tls-certs") pod "90534d56-28ff-4983-b8ea-be83259ce64d" (UID: "90534d56-28ff-4983-b8ea-be83259ce64d"). InnerVolumeSpecName "memcached-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:53:56 crc kubenswrapper[5120]: I0316 15:53:56.162868 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 15:53:56 crc kubenswrapper[5120]: I0316 15:53:56.163143 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/kube-state-metrics-0" podUID="ae15ab63-33c1-4085-809f-5b1b4086b95b" containerName="kube-state-metrics" containerID="cri-o://e07e87fb3cac1808e19af0e91433064ae3fa498e7405a64cbd98e61c6a491bb3" gracePeriod=30 Mar 16 15:53:56 crc kubenswrapper[5120]: I0316 15:53:56.163640 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-dd94-account-create-update-l69rr" Mar 16 15:53:56 crc kubenswrapper[5120]: I0316 15:53:56.165315 5120 reconciler_common.go:299] "Volume detached for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/90534d56-28ff-4983-b8ea-be83259ce64d-memcached-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:56 crc kubenswrapper[5120]: I0316 15:53:56.175776 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-5fw99"] Mar 16 15:53:56 crc kubenswrapper[5120]: I0316 15:53:56.177931 5120 reconciler_common.go:299] "Volume detached for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/a7b8bb1c-b58a-43a6-8457-88a025588f1e-ovsdbserver-nb-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:56 crc kubenswrapper[5120]: I0316 15:53:56.235048 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7b8bb1c-b58a-43a6-8457-88a025588f1e-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "a7b8bb1c-b58a-43a6-8457-88a025588f1e" (UID: "a7b8bb1c-b58a-43a6-8457-88a025588f1e"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:53:56 crc kubenswrapper[5120]: I0316 15:53:56.236894 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podUID="32f7f790-9e5b-4052-a87d-b3abaa0b3ff0" containerName="nova-cell1-novncproxy-novncproxy" probeResult="failure" output="Get \"https://10.217.0.191:6080/vnc_lite.html\": dial tcp 10.217.0.191:6080: connect: connection refused" Mar 16 15:53:56 crc kubenswrapper[5120]: I0316 15:53:56.237596 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-5fw99"] Mar 16 15:53:56 crc kubenswrapper[5120]: I0316 15:53:56.238890 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_a7b8bb1c-b58a-43a6-8457-88a025588f1e/ovsdbserver-nb/0.log" Mar 16 15:53:56 crc kubenswrapper[5120]: I0316 15:53:56.239104 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"a7b8bb1c-b58a-43a6-8457-88a025588f1e","Type":"ContainerDied","Data":"04482ea4f7f3b4622fa7a76cf37d317c1dc4a2a4747b43b85d8e2b3c3f52a0e1"} Mar 16 15:53:56 crc kubenswrapper[5120]: I0316 15:53:56.239207 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 15:53:56 crc kubenswrapper[5120]: I0316 15:53:56.264563 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-5h8xf"] Mar 16 15:53:56 crc kubenswrapper[5120]: I0316 15:53:56.273824 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-5h8xf"] Mar 16 15:53:56 crc kubenswrapper[5120]: I0316 15:53:56.279529 5120 reconciler_common.go:299] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/a7b8bb1c-b58a-43a6-8457-88a025588f1e-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:56 crc kubenswrapper[5120]: I0316 15:53:56.377417 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-gwbbm"] Mar 16 15:53:56 crc kubenswrapper[5120]: I0316 15:53:56.391290 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-gwbbm"] Mar 16 15:53:56 crc kubenswrapper[5120]: I0316 15:53:56.404653 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-flqm5"] Mar 16 15:53:56 crc kubenswrapper[5120]: I0316 15:53:56.415883 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-flqm5"] Mar 16 15:53:56 crc kubenswrapper[5120]: I0316 15:53:56.423860 5120 scope.go:117] "RemoveContainer" containerID="4e2796b01696c028bbde53b67d3871a746b22ba854168fabf827f2607ee9fe5c" Mar 16 15:53:56 crc kubenswrapper[5120]: I0316 15:53:56.454819 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_d32a00a6-9028-411d-9f59-0b48c01c5eb2/ovsdbserver-sb/0.log" Mar 16 15:53:56 crc kubenswrapper[5120]: I0316 15:53:56.454906 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 15:53:56 crc kubenswrapper[5120]: I0316 15:53:56.481103 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-w8jp7"] Mar 16 15:53:56 crc kubenswrapper[5120]: I0316 15:53:56.556604 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-w8jp7"] Mar 16 15:53:56 crc kubenswrapper[5120]: I0316 15:53:56.581318 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 15:53:56 crc kubenswrapper[5120]: I0316 15:53:56.583454 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-htm2c"] Mar 16 15:53:56 crc kubenswrapper[5120]: I0316 15:53:56.587013 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d32a00a6-9028-411d-9f59-0b48c01c5eb2-combined-ca-bundle\") pod \"d32a00a6-9028-411d-9f59-0b48c01c5eb2\" (UID: \"d32a00a6-9028-411d-9f59-0b48c01c5eb2\") " Mar 16 15:53:56 crc kubenswrapper[5120]: I0316 15:53:56.587086 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/d32a00a6-9028-411d-9f59-0b48c01c5eb2-metrics-certs-tls-certs\") pod \"d32a00a6-9028-411d-9f59-0b48c01c5eb2\" (UID: \"d32a00a6-9028-411d-9f59-0b48c01c5eb2\") " Mar 16 15:53:56 crc kubenswrapper[5120]: I0316 15:53:56.587183 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/d32a00a6-9028-411d-9f59-0b48c01c5eb2-ovsdb-rundir\") pod \"d32a00a6-9028-411d-9f59-0b48c01c5eb2\" (UID: \"d32a00a6-9028-411d-9f59-0b48c01c5eb2\") " Mar 16 15:53:56 crc kubenswrapper[5120]: I0316 15:53:56.587231 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/d32a00a6-9028-411d-9f59-0b48c01c5eb2-scripts\") pod \"d32a00a6-9028-411d-9f59-0b48c01c5eb2\" (UID: \"d32a00a6-9028-411d-9f59-0b48c01c5eb2\") " Mar 16 15:53:56 crc kubenswrapper[5120]: I0316 15:53:56.587345 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovndbcluster-sb-etc-ovn\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"d32a00a6-9028-411d-9f59-0b48c01c5eb2\" (UID: \"d32a00a6-9028-411d-9f59-0b48c01c5eb2\") " Mar 16 15:53:56 crc kubenswrapper[5120]: I0316 15:53:56.587402 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/d32a00a6-9028-411d-9f59-0b48c01c5eb2-ovsdbserver-sb-tls-certs\") pod \"d32a00a6-9028-411d-9f59-0b48c01c5eb2\" (UID: \"d32a00a6-9028-411d-9f59-0b48c01c5eb2\") " Mar 16 15:53:56 crc kubenswrapper[5120]: I0316 15:53:56.587889 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d32a00a6-9028-411d-9f59-0b48c01c5eb2-ovsdb-rundir" (OuterVolumeSpecName: "ovsdb-rundir") pod "d32a00a6-9028-411d-9f59-0b48c01c5eb2" (UID: "d32a00a6-9028-411d-9f59-0b48c01c5eb2"). InnerVolumeSpecName "ovsdb-rundir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:53:56 crc kubenswrapper[5120]: I0316 15:53:56.587922 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d32a00a6-9028-411d-9f59-0b48c01c5eb2-config\") pod \"d32a00a6-9028-411d-9f59-0b48c01c5eb2\" (UID: \"d32a00a6-9028-411d-9f59-0b48c01c5eb2\") " Mar 16 15:53:56 crc kubenswrapper[5120]: I0316 15:53:56.587962 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5kjcg\" (UniqueName: \"kubernetes.io/projected/d32a00a6-9028-411d-9f59-0b48c01c5eb2-kube-api-access-5kjcg\") pod \"d32a00a6-9028-411d-9f59-0b48c01c5eb2\" (UID: \"d32a00a6-9028-411d-9f59-0b48c01c5eb2\") " Mar 16 15:53:56 crc kubenswrapper[5120]: I0316 15:53:56.588169 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d32a00a6-9028-411d-9f59-0b48c01c5eb2-scripts" (OuterVolumeSpecName: "scripts") pod "d32a00a6-9028-411d-9f59-0b48c01c5eb2" (UID: "d32a00a6-9028-411d-9f59-0b48c01c5eb2"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:53:56 crc kubenswrapper[5120]: I0316 15:53:56.588716 5120 reconciler_common.go:299] "Volume detached for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/d32a00a6-9028-411d-9f59-0b48c01c5eb2-ovsdb-rundir\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:56 crc kubenswrapper[5120]: I0316 15:53:56.588730 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/d32a00a6-9028-411d-9f59-0b48c01c5eb2-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:56 crc kubenswrapper[5120]: I0316 15:53:56.591655 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d32a00a6-9028-411d-9f59-0b48c01c5eb2-config" (OuterVolumeSpecName: "config") pod "d32a00a6-9028-411d-9f59-0b48c01c5eb2" (UID: "d32a00a6-9028-411d-9f59-0b48c01c5eb2"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:53:56 crc kubenswrapper[5120]: I0316 15:53:56.645543 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-htm2c"] Mar 16 15:53:56 crc kubenswrapper[5120]: I0316 15:53:56.664408 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage05-crc" (OuterVolumeSpecName: "ovndbcluster-sb-etc-ovn") pod "d32a00a6-9028-411d-9f59-0b48c01c5eb2" (UID: "d32a00a6-9028-411d-9f59-0b48c01c5eb2"). InnerVolumeSpecName "local-storage05-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 15:53:56 crc kubenswrapper[5120]: I0316 15:53:56.673494 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d32a00a6-9028-411d-9f59-0b48c01c5eb2-kube-api-access-5kjcg" (OuterVolumeSpecName: "kube-api-access-5kjcg") pod "d32a00a6-9028-411d-9f59-0b48c01c5eb2" (UID: "d32a00a6-9028-411d-9f59-0b48c01c5eb2"). InnerVolumeSpecName "kube-api-access-5kjcg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:53:56 crc kubenswrapper[5120]: I0316 15:53:56.689632 5120 scope.go:117] "RemoveContainer" containerID="a69581666e94e68483b687690686147a201582a36041881db8d8c5e135d82930" Mar 16 15:53:56 crc kubenswrapper[5120]: I0316 15:53:56.691088 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cb25223e-e443-4a56-9b17-d0159918b563-config-data\") pod \"cb25223e-e443-4a56-9b17-d0159918b563\" (UID: \"cb25223e-e443-4a56-9b17-d0159918b563\") " Mar 16 15:53:56 crc kubenswrapper[5120]: I0316 15:53:56.691822 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bvqgf\" (UniqueName: \"kubernetes.io/projected/cb25223e-e443-4a56-9b17-d0159918b563-kube-api-access-bvqgf\") pod \"cb25223e-e443-4a56-9b17-d0159918b563\" (UID: \"cb25223e-e443-4a56-9b17-d0159918b563\") " Mar 16 15:53:56 crc kubenswrapper[5120]: I0316 15:53:56.692191 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cb25223e-e443-4a56-9b17-d0159918b563-combined-ca-bundle\") pod \"cb25223e-e443-4a56-9b17-d0159918b563\" (UID: \"cb25223e-e443-4a56-9b17-d0159918b563\") " Mar 16 15:53:56 crc kubenswrapper[5120]: I0316 15:53:56.693338 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") on node \"crc\" " Mar 16 15:53:56 crc kubenswrapper[5120]: I0316 15:53:56.693356 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d32a00a6-9028-411d-9f59-0b48c01c5eb2-config\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:56 crc kubenswrapper[5120]: I0316 15:53:56.693364 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5kjcg\" (UniqueName: \"kubernetes.io/projected/d32a00a6-9028-411d-9f59-0b48c01c5eb2-kube-api-access-5kjcg\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:56 crc kubenswrapper[5120]: I0316 15:53:56.716650 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb25223e-e443-4a56-9b17-d0159918b563-kube-api-access-bvqgf" (OuterVolumeSpecName: "kube-api-access-bvqgf") pod "cb25223e-e443-4a56-9b17-d0159918b563" (UID: "cb25223e-e443-4a56-9b17-d0159918b563"). InnerVolumeSpecName "kube-api-access-bvqgf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:53:56 crc kubenswrapper[5120]: I0316 15:53:56.721697 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d32a00a6-9028-411d-9f59-0b48c01c5eb2-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "d32a00a6-9028-411d-9f59-0b48c01c5eb2" (UID: "d32a00a6-9028-411d-9f59-0b48c01c5eb2"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:53:56 crc kubenswrapper[5120]: I0316 15:53:56.748404 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage05-crc" (UniqueName: "kubernetes.io/local-volume/local-storage05-crc") on node "crc" Mar 16 15:53:56 crc kubenswrapper[5120]: I0316 15:53:56.796085 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2645c221-c2bd-4cd3-a073-9396a5a87708" path="/var/lib/kubelet/pods/2645c221-c2bd-4cd3-a073-9396a5a87708/volumes" Mar 16 15:53:56 crc kubenswrapper[5120]: I0316 15:53:56.797405 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4a404dfb-ccf0-45a1-9166-7edce8f368bb" path="/var/lib/kubelet/pods/4a404dfb-ccf0-45a1-9166-7edce8f368bb/volumes" Mar 16 15:53:56 crc kubenswrapper[5120]: I0316 15:53:56.797949 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4e0214f5-7d2d-4b88-8096-a14ac906d637" path="/var/lib/kubelet/pods/4e0214f5-7d2d-4b88-8096-a14ac906d637/volumes" Mar 16 15:53:56 crc kubenswrapper[5120]: I0316 15:53:56.798448 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="575d87bf-ce91-4a4d-8e07-ef31e31f6d59" path="/var/lib/kubelet/pods/575d87bf-ce91-4a4d-8e07-ef31e31f6d59/volumes" Mar 16 15:53:56 crc kubenswrapper[5120]: I0316 15:53:56.800184 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="57766802-1c47-4741-850a-82f768369d23" path="/var/lib/kubelet/pods/57766802-1c47-4741-850a-82f768369d23/volumes" Mar 16 15:53:56 crc kubenswrapper[5120]: I0316 15:53:56.800683 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="881255d7-a4d0-4d7c-a467-fe8ed96fc94d" path="/var/lib/kubelet/pods/881255d7-a4d0-4d7c-a467-fe8ed96fc94d/volumes" Mar 16 15:53:56 crc kubenswrapper[5120]: I0316 15:53:56.801197 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="afd7061f-762c-4876-986c-64076eda9b0f" path="/var/lib/kubelet/pods/afd7061f-762c-4876-986c-64076eda9b0f/volumes" Mar 16 15:53:56 crc kubenswrapper[5120]: I0316 15:53:56.802998 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d16cf6e5-1b2b-41b7-9a80-070f44bc9a67" path="/var/lib/kubelet/pods/d16cf6e5-1b2b-41b7-9a80-070f44bc9a67/volumes" Mar 16 15:53:56 crc kubenswrapper[5120]: I0316 15:53:56.803546 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e43da138-d989-4c49-aeea-5a251a21f2d4" path="/var/lib/kubelet/pods/e43da138-d989-4c49-aeea-5a251a21f2d4/volumes" Mar 16 15:53:56 crc kubenswrapper[5120]: I0316 15:53:56.804143 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bvqgf\" (UniqueName: \"kubernetes.io/projected/cb25223e-e443-4a56-9b17-d0159918b563-kube-api-access-bvqgf\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:56 crc kubenswrapper[5120]: I0316 15:53:56.804390 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e8b7845d-53d2-4fc9-af50-91a65dc3e247" path="/var/lib/kubelet/pods/e8b7845d-53d2-4fc9-af50-91a65dc3e247/volumes" Mar 16 15:53:56 crc kubenswrapper[5120]: I0316 15:53:56.804654 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d32a00a6-9028-411d-9f59-0b48c01c5eb2-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:56 crc kubenswrapper[5120]: I0316 15:53:56.806087 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f4c8d373-a29f-4b52-8e52-04dd3dfd8ebf" path="/var/lib/kubelet/pods/f4c8d373-a29f-4b52-8e52-04dd3dfd8ebf/volumes" Mar 16 15:53:56 crc kubenswrapper[5120]: I0316 15:53:56.806517 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:56 crc kubenswrapper[5120]: I0316 15:53:56.806821 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe9eadc5-0f96-4232-89f0-22cbe36c1a8f" path="/var/lib/kubelet/pods/fe9eadc5-0f96-4232-89f0-22cbe36c1a8f/volumes" Mar 16 15:53:56 crc kubenswrapper[5120]: I0316 15:53:56.981656 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/cinder-api-0" podUID="4306304f-eaea-49a1-9e62-9b035dc302de" containerName="cinder-api" probeResult="failure" output="Get \"https://10.217.0.161:8776/healthcheck\": read tcp 10.217.0.2:40288->10.217.0.161:8776: read: connection reset by peer" Mar 16 15:53:57 crc kubenswrapper[5120]: I0316 15:53:57.135286 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb25223e-e443-4a56-9b17-d0159918b563-config-data" (OuterVolumeSpecName: "config-data") pod "cb25223e-e443-4a56-9b17-d0159918b563" (UID: "cb25223e-e443-4a56-9b17-d0159918b563"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:53:57 crc kubenswrapper[5120]: I0316 15:53:57.171367 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb25223e-e443-4a56-9b17-d0159918b563-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "cb25223e-e443-4a56-9b17-d0159918b563" (UID: "cb25223e-e443-4a56-9b17-d0159918b563"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:53:57 crc kubenswrapper[5120]: I0316 15:53:57.229472 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cb25223e-e443-4a56-9b17-d0159918b563-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:57 crc kubenswrapper[5120]: I0316 15:53:57.229509 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cb25223e-e443-4a56-9b17-d0159918b563-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:57 crc kubenswrapper[5120]: I0316 15:53:57.236027 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d32a00a6-9028-411d-9f59-0b48c01c5eb2-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "d32a00a6-9028-411d-9f59-0b48c01c5eb2" (UID: "d32a00a6-9028-411d-9f59-0b48c01c5eb2"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:53:57 crc kubenswrapper[5120]: I0316 15:53:57.238742 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d32a00a6-9028-411d-9f59-0b48c01c5eb2-ovsdbserver-sb-tls-certs" (OuterVolumeSpecName: "ovsdbserver-sb-tls-certs") pod "d32a00a6-9028-411d-9f59-0b48c01c5eb2" (UID: "d32a00a6-9028-411d-9f59-0b48c01c5eb2"). InnerVolumeSpecName "ovsdbserver-sb-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:53:57 crc kubenswrapper[5120]: I0316 15:53:57.259651 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 15:53:57 crc kubenswrapper[5120]: E0316 15:53:57.280848 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 5a00c8f45c647963a8510197f0acdd358ed4e08e0b3eefebcc584d2b7161253e is running failed: container process not found" containerID="5a00c8f45c647963a8510197f0acdd358ed4e08e0b3eefebcc584d2b7161253e" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 15:53:57 crc kubenswrapper[5120]: E0316 15:53:57.281720 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 5a00c8f45c647963a8510197f0acdd358ed4e08e0b3eefebcc584d2b7161253e is running failed: container process not found" containerID="5a00c8f45c647963a8510197f0acdd358ed4e08e0b3eefebcc584d2b7161253e" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 15:53:57 crc kubenswrapper[5120]: E0316 15:53:57.282326 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 5a00c8f45c647963a8510197f0acdd358ed4e08e0b3eefebcc584d2b7161253e is running failed: container process not found" containerID="5a00c8f45c647963a8510197f0acdd358ed4e08e0b3eefebcc584d2b7161253e" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 15:53:57 crc kubenswrapper[5120]: E0316 15:53:57.282357 5120 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 5a00c8f45c647963a8510197f0acdd358ed4e08e0b3eefebcc584d2b7161253e is running failed: container process not found" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="5888de0f-5da8-4605-aa27-db134fd47b31" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 15:53:57 crc kubenswrapper[5120]: I0316 15:53:57.307719 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_d32a00a6-9028-411d-9f59-0b48c01c5eb2/ovsdbserver-sb/0.log" Mar 16 15:53:57 crc kubenswrapper[5120]: I0316 15:53:57.307946 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 15:53:57 crc kubenswrapper[5120]: I0316 15:53:57.335899 5120 reconciler_common.go:299] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/d32a00a6-9028-411d-9f59-0b48c01c5eb2-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:57 crc kubenswrapper[5120]: I0316 15:53:57.335932 5120 reconciler_common.go:299] "Volume detached for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/d32a00a6-9028-411d-9f59-0b48c01c5eb2-ovsdbserver-sb-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:57 crc kubenswrapper[5120]: I0316 15:53:57.340869 5120 generic.go:358] "Generic (PLEG): container finished" podID="ae15ab63-33c1-4085-809f-5b1b4086b95b" containerID="e07e87fb3cac1808e19af0e91433064ae3fa498e7405a64cbd98e61c6a491bb3" exitCode=2 Mar 16 15:53:57 crc kubenswrapper[5120]: I0316 15:53:57.372959 5120 generic.go:358] "Generic (PLEG): container finished" podID="14486849-fbb1-4cc9-8aa3-714e263c55fb" containerID="c81a76400410e2a94d4a9a4471ca9bca3df111d1c0d2c832dcdc03fb0fca2ae5" exitCode=0 Mar 16 15:53:57 crc kubenswrapper[5120]: I0316 15:53:57.403562 5120 generic.go:358] "Generic (PLEG): container finished" podID="6f641d93-c3e7-40c3-8d96-d89b931d18cc" containerID="f537fe622a6860ac31c69fb493d6675ef968e5c012ab0f4860e1583cc23a4e1b" exitCode=0 Mar 16 15:53:57 crc kubenswrapper[5120]: I0316 15:53:57.407926 5120 generic.go:358] "Generic (PLEG): container finished" podID="d51d8732-80e3-463b-b8b0-714f8a2d281f" containerID="ef458ad073d82c2b8eea756d31ae0425cfc19313825ac6f80468606be451b4ff" exitCode=0 Mar 16 15:53:57 crc kubenswrapper[5120]: I0316 15:53:57.439025 5120 generic.go:358] "Generic (PLEG): container finished" podID="8d66ce1a-7d4c-4e04-92c9-f86d5ad81fcc" containerID="042e41e723df73b7e7f87e1bf90037fae0d3bd03bbc5432d058acb72b29f7255" exitCode=0 Mar 16 15:53:57 crc kubenswrapper[5120]: I0316 15:53:57.443694 5120 generic.go:358] "Generic (PLEG): container finished" podID="d6734794-135c-4f4b-83b6-c64788f83f91" containerID="89f147b51fe4fc1e87c9c591ecb0db5c3f2e8bd2acb9a6231812f956dd8c36da" exitCode=0 Mar 16 15:53:57 crc kubenswrapper[5120]: I0316 15:53:57.446374 5120 generic.go:358] "Generic (PLEG): container finished" podID="4306304f-eaea-49a1-9e62-9b035dc302de" containerID="1caafbafeede915ee6f4819bb0e0954a636de7eee094105d62e479295fc329c9" exitCode=0 Mar 16 15:53:57 crc kubenswrapper[5120]: I0316 15:53:57.450107 5120 generic.go:358] "Generic (PLEG): container finished" podID="c95ad7ed-1944-4285-9138-0d4b954aa727" containerID="09392570662a59fc70e23951bc67499bff758e9ff6016774b3bbe8dfd1cae387" exitCode=0 Mar 16 15:53:57 crc kubenswrapper[5120]: I0316 15:53:57.452851 5120 generic.go:358] "Generic (PLEG): container finished" podID="8821dbd3-25f2-44ea-8a41-e716db08960a" containerID="c10a021b8eb3c6d7e0a7d62489b393cff613269c9c5979e7ef8c0dc2960ee167" exitCode=0 Mar 16 15:53:57 crc kubenswrapper[5120]: I0316 15:53:57.452878 5120 generic.go:358] "Generic (PLEG): container finished" podID="8821dbd3-25f2-44ea-8a41-e716db08960a" containerID="ae70819b9a1f84ddd33ad93962ec42573aee9adbc472f37bb2fafc17feabaa45" exitCode=0 Mar 16 15:53:57 crc kubenswrapper[5120]: E0316 15:53:57.683328 5120 log.go:32] "RunPodSandbox from runtime service failed" err=< Mar 16 15:53:57 crc kubenswrapper[5120]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_openstackclient_openstack-kuttl-tests_1b5c827b-214c-452d-bd57-dc21f970d7a4_0(84d318ebaeae53149a96970b97fb0039946b0a19286ce9839191c852f560b92f): error adding pod openstack-kuttl-tests_openstackclient to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"84d318ebaeae53149a96970b97fb0039946b0a19286ce9839191c852f560b92f" Netns:"/var/run/netns/e21f4c54-3470-4c5d-8aff-04ed20ad3dcb" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openstack-kuttl-tests;K8S_POD_NAME=openstackclient;K8S_POD_INFRA_CONTAINER_ID=84d318ebaeae53149a96970b97fb0039946b0a19286ce9839191c852f560b92f;K8S_POD_UID=1b5c827b-214c-452d-bd57-dc21f970d7a4" Path:"" ERRORED: error configuring pod [openstack-kuttl-tests/openstackclient] networking: [openstack-kuttl-tests/openstackclient/1b5c827b-214c-452d-bd57-dc21f970d7a4:ovn-kubernetes]: error adding container to network "ovn-kubernetes": CNI request failed with status 400: '[openstack-kuttl-tests/openstackclient 84d318ebaeae53149a96970b97fb0039946b0a19286ce9839191c852f560b92f network default NAD default] [openstack-kuttl-tests/openstackclient 84d318ebaeae53149a96970b97fb0039946b0a19286ce9839191c852f560b92f network default NAD default] failed to configure pod interface: pod deleted waiting for OVS port binding for 0a:58:0a:d9:00:c7 [10.217.0.199/23] Mar 16 15:53:57 crc kubenswrapper[5120]: ' Mar 16 15:53:57 crc kubenswrapper[5120]: ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Mar 16 15:53:57 crc kubenswrapper[5120]: > Mar 16 15:53:57 crc kubenswrapper[5120]: E0316 15:53:57.683379 5120 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err=< Mar 16 15:53:57 crc kubenswrapper[5120]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_openstackclient_openstack-kuttl-tests_1b5c827b-214c-452d-bd57-dc21f970d7a4_0(84d318ebaeae53149a96970b97fb0039946b0a19286ce9839191c852f560b92f): error adding pod openstack-kuttl-tests_openstackclient to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"84d318ebaeae53149a96970b97fb0039946b0a19286ce9839191c852f560b92f" Netns:"/var/run/netns/e21f4c54-3470-4c5d-8aff-04ed20ad3dcb" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openstack-kuttl-tests;K8S_POD_NAME=openstackclient;K8S_POD_INFRA_CONTAINER_ID=84d318ebaeae53149a96970b97fb0039946b0a19286ce9839191c852f560b92f;K8S_POD_UID=1b5c827b-214c-452d-bd57-dc21f970d7a4" Path:"" ERRORED: error configuring pod [openstack-kuttl-tests/openstackclient] networking: [openstack-kuttl-tests/openstackclient/1b5c827b-214c-452d-bd57-dc21f970d7a4:ovn-kubernetes]: error adding container to network "ovn-kubernetes": CNI request failed with status 400: '[openstack-kuttl-tests/openstackclient 84d318ebaeae53149a96970b97fb0039946b0a19286ce9839191c852f560b92f network default NAD default] [openstack-kuttl-tests/openstackclient 84d318ebaeae53149a96970b97fb0039946b0a19286ce9839191c852f560b92f network default NAD default] failed to configure pod interface: pod deleted waiting for OVS port binding for 0a:58:0a:d9:00:c7 [10.217.0.199/23] Mar 16 15:53:57 crc kubenswrapper[5120]: ' Mar 16 15:53:57 crc kubenswrapper[5120]: ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Mar 16 15:53:57 crc kubenswrapper[5120]: > pod="openstack-kuttl-tests/openstackclient" Mar 16 15:53:57 crc kubenswrapper[5120]: W0316 15:53:57.853198 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod26a03664_6cb3_4982_80f5_063d8f12cc2a.slice/crio-168f973d805b675db2914f28e4ea71abd5da411857a7b7121c0285816c5d2bbc WatchSource:0}: Error finding container 168f973d805b675db2914f28e4ea71abd5da411857a7b7121c0285816c5d2bbc: Status 404 returned error can't find the container with id 168f973d805b675db2914f28e4ea71abd5da411857a7b7121c0285816c5d2bbc Mar 16 15:53:57 crc kubenswrapper[5120]: I0316 15:53:57.892020 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="176eef56-bc30-4119-8af5-fa1329d63aa2" containerName="glance-httpd" probeResult="failure" output="Get \"https://10.217.0.171:9292/healthcheck\": dial tcp 10.217.0.171:9292: connect: connection refused" Mar 16 15:53:57 crc kubenswrapper[5120]: I0316 15:53:57.892878 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="176eef56-bc30-4119-8af5-fa1329d63aa2" containerName="glance-log" probeResult="failure" output="Get \"https://10.217.0.171:9292/healthcheck\": dial tcp 10.217.0.171:9292: connect: connection refused" Mar 16 15:53:57 crc kubenswrapper[5120]: E0316 15:53:57.939129 5120 upgradeaware.go:427] Error proxying data from client to backend: readfrom tcp 38.102.83.119:34658->38.102.83.119:44311: write tcp 38.102.83.119:34658->38.102.83.119:44311: write: broken pipe Mar 16 15:53:57 crc kubenswrapper[5120]: W0316 15:53:57.996104 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod26ff2779_e4aa_43b8_9704_4def1ae45033.slice/crio-12dab1db1034f0afb2eef326f9d4733e639118c19df114c03faa0fc64e1864ef WatchSource:0}: Error finding container 12dab1db1034f0afb2eef326f9d4733e639118c19df114c03faa0fc64e1864ef: Status 404 returned error can't find the container with id 12dab1db1034f0afb2eef326f9d4733e639118c19df114c03faa0fc64e1864ef Mar 16 15:53:57 crc kubenswrapper[5120]: E0316 15:53:57.996949 5120 kubelet.go:2642] "Housekeeping took longer than expected" err="housekeeping took too long" expected="1s" actual="1.332s" Mar 16 15:53:57 crc kubenswrapper[5120]: I0316 15:53:57.997031 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-776d498b58-sb5f8"] Mar 16 15:53:57 crc kubenswrapper[5120]: I0316 15:53:57.997047 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"cb25223e-e443-4a56-9b17-d0159918b563","Type":"ContainerDied","Data":"742a62722575f2f3f98c136481494d32cdf7799798baebf5e28af43ea6541e1b"} Mar 16 15:53:57 crc kubenswrapper[5120]: I0316 15:53:57.997076 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"5888de0f-5da8-4605-aa27-db134fd47b31","Type":"ContainerDied","Data":"dbbb38ae0016789737cfd4bef731bde626c1fb8fca9c642259fe0f87e177b959"} Mar 16 15:53:57 crc kubenswrapper[5120]: I0316 15:53:57.997088 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dbbb38ae0016789737cfd4bef731bde626c1fb8fca9c642259fe0f87e177b959" Mar 16 15:53:57 crc kubenswrapper[5120]: I0316 15:53:57.997100 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-7956bcf97d-p9m4c"] Mar 16 15:53:57 crc kubenswrapper[5120]: I0316 15:53:57.997111 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-crwwq"] Mar 16 15:53:57 crc kubenswrapper[5120]: I0316 15:53:57.997121 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="347b733d96128d4e9c26dcb4b9dad3a9cbec014f1a646ce7e077de71b64f31e8" Mar 16 15:53:57 crc kubenswrapper[5120]: I0316 15:53:57.997129 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-69c8889b9f-sfbxd" event={"ID":"18ef8c0b-e810-48c1-b5a5-43584c591dfa","Type":"ContainerStarted","Data":"bcd37f54cbc166ff52b822355e3dffd9da249e43d42116ecf6339e6a81422bbe"} Mar 16 15:53:57 crc kubenswrapper[5120]: I0316 15:53:57.997138 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-69c8889b9f-sfbxd" event={"ID":"18ef8c0b-e810-48c1-b5a5-43584c591dfa","Type":"ContainerStarted","Data":"4b5df2c40e258beccc14716a4991e333fc85c2271d6be78eb67ccdce21ccd790"} Mar 16 15:53:57 crc kubenswrapper[5120]: I0316 15:53:57.997146 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-db-create-c24qt"] Mar 16 15:53:57 crc kubenswrapper[5120]: I0316 15:53:57.997156 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"d32a00a6-9028-411d-9f59-0b48c01c5eb2","Type":"ContainerDied","Data":"02a930630690d3bf3f9c44d2bd7bff09c0841b922520a2c6a9808167d7904eab"} Mar 16 15:53:57 crc kubenswrapper[5120]: I0316 15:53:57.997169 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-db-create-c24qt"] Mar 16 15:53:57 crc kubenswrapper[5120]: I0316 15:53:57.997186 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"ae15ab63-33c1-4085-809f-5b1b4086b95b","Type":"ContainerDied","Data":"e07e87fb3cac1808e19af0e91433064ae3fa498e7405a64cbd98e61c6a491bb3"} Mar 16 15:53:57 crc kubenswrapper[5120]: I0316 15:53:57.997197 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-crwwq"] Mar 16 15:53:57 crc kubenswrapper[5120]: I0316 15:53:57.997207 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"14486849-fbb1-4cc9-8aa3-714e263c55fb","Type":"ContainerDied","Data":"c81a76400410e2a94d4a9a4471ca9bca3df111d1c0d2c832dcdc03fb0fca2ae5"} Mar 16 15:53:57 crc kubenswrapper[5120]: I0316 15:53:57.997217 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-a347-account-create-update-89khd"] Mar 16 15:53:57 crc kubenswrapper[5120]: I0316 15:53:57.997230 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"6f641d93-c3e7-40c3-8d96-d89b931d18cc","Type":"ContainerDied","Data":"f537fe622a6860ac31c69fb493d6675ef968e5c012ab0f4860e1583cc23a4e1b"} Mar 16 15:53:57 crc kubenswrapper[5120]: I0316 15:53:57.997242 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-3f2f-account-create-update-rfgcb"] Mar 16 15:53:57 crc kubenswrapper[5120]: I0316 15:53:57.997290 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"d51d8732-80e3-463b-b8b0-714f8a2d281f","Type":"ContainerDied","Data":"ef458ad073d82c2b8eea756d31ae0425cfc19313825ac6f80468606be451b4ff"} Mar 16 15:53:57 crc kubenswrapper[5120]: I0316 15:53:57.997303 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"8d66ce1a-7d4c-4e04-92c9-f86d5ad81fcc","Type":"ContainerDied","Data":"042e41e723df73b7e7f87e1bf90037fae0d3bd03bbc5432d058acb72b29f7255"} Mar 16 15:53:57 crc kubenswrapper[5120]: I0316 15:53:57.997313 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"d6734794-135c-4f4b-83b6-c64788f83f91","Type":"ContainerDied","Data":"89f147b51fe4fc1e87c9c591ecb0db5c3f2e8bd2acb9a6231812f956dd8c36da"} Mar 16 15:53:57 crc kubenswrapper[5120]: I0316 15:53:57.997326 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"4306304f-eaea-49a1-9e62-9b035dc302de","Type":"ContainerDied","Data":"1caafbafeede915ee6f4819bb0e0954a636de7eee094105d62e479295fc329c9"} Mar 16 15:53:57 crc kubenswrapper[5120]: I0316 15:53:57.997336 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"32f7f790-9e5b-4052-a87d-b3abaa0b3ff0","Type":"ContainerDied","Data":"7c2d1969f752cdb667ff1c78f7c2da0f696f4c5683dd790e40c87c79657beb73"} Mar 16 15:53:57 crc kubenswrapper[5120]: I0316 15:53:57.997345 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7c2d1969f752cdb667ff1c78f7c2da0f696f4c5683dd790e40c87c79657beb73" Mar 16 15:53:57 crc kubenswrapper[5120]: I0316 15:53:57.997352 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-db-create-bdx4h"] Mar 16 15:53:57 crc kubenswrapper[5120]: I0316 15:53:57.997361 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"c95ad7ed-1944-4285-9138-0d4b954aa727","Type":"ContainerDied","Data":"09392570662a59fc70e23951bc67499bff758e9ff6016774b3bbe8dfd1cae387"} Mar 16 15:53:57 crc kubenswrapper[5120]: I0316 15:53:57.997382 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"8821dbd3-25f2-44ea-8a41-e716db08960a","Type":"ContainerDied","Data":"c10a021b8eb3c6d7e0a7d62489b393cff613269c9c5979e7ef8c0dc2960ee167"} Mar 16 15:53:57 crc kubenswrapper[5120]: I0316 15:53:57.997392 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"8821dbd3-25f2-44ea-8a41-e716db08960a","Type":"ContainerDied","Data":"ae70819b9a1f84ddd33ad93962ec42573aee9adbc472f37bb2fafc17feabaa45"} Mar 16 15:53:57 crc kubenswrapper[5120]: I0316 15:53:57.997402 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-db-create-bdx4h"] Mar 16 15:53:57 crc kubenswrapper[5120]: I0316 15:53:57.997414 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-db-create-w4dbt"] Mar 16 15:53:57 crc kubenswrapper[5120]: I0316 15:53:57.997423 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-db-create-w4dbt"] Mar 16 15:53:57 crc kubenswrapper[5120]: I0316 15:53:57.997434 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-xvqbz"] Mar 16 15:53:57 crc kubenswrapper[5120]: I0316 15:53:57.998360 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d32a00a6-9028-411d-9f59-0b48c01c5eb2" containerName="ovsdbserver-sb" Mar 16 15:53:57 crc kubenswrapper[5120]: I0316 15:53:57.998373 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="d32a00a6-9028-411d-9f59-0b48c01c5eb2" containerName="ovsdbserver-sb" Mar 16 15:53:57 crc kubenswrapper[5120]: I0316 15:53:57.998403 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7b8bb1c-b58a-43a6-8457-88a025588f1e" containerName="ovsdbserver-nb" Mar 16 15:53:57 crc kubenswrapper[5120]: I0316 15:53:57.998408 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7b8bb1c-b58a-43a6-8457-88a025588f1e" containerName="ovsdbserver-nb" Mar 16 15:53:57 crc kubenswrapper[5120]: I0316 15:53:57.998432 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d32a00a6-9028-411d-9f59-0b48c01c5eb2" containerName="openstack-network-exporter" Mar 16 15:53:57 crc kubenswrapper[5120]: I0316 15:53:57.998438 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="d32a00a6-9028-411d-9f59-0b48c01c5eb2" containerName="openstack-network-exporter" Mar 16 15:53:57 crc kubenswrapper[5120]: I0316 15:53:57.998449 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb25223e-e443-4a56-9b17-d0159918b563" containerName="nova-scheduler-scheduler" Mar 16 15:53:57 crc kubenswrapper[5120]: I0316 15:53:57.998454 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb25223e-e443-4a56-9b17-d0159918b563" containerName="nova-scheduler-scheduler" Mar 16 15:53:57 crc kubenswrapper[5120]: I0316 15:53:57.998462 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7b8bb1c-b58a-43a6-8457-88a025588f1e" containerName="openstack-network-exporter" Mar 16 15:53:57 crc kubenswrapper[5120]: I0316 15:53:57.998467 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7b8bb1c-b58a-43a6-8457-88a025588f1e" containerName="openstack-network-exporter" Mar 16 15:53:57 crc kubenswrapper[5120]: I0316 15:53:57.998622 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="a7b8bb1c-b58a-43a6-8457-88a025588f1e" containerName="openstack-network-exporter" Mar 16 15:53:57 crc kubenswrapper[5120]: I0316 15:53:57.998635 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="d32a00a6-9028-411d-9f59-0b48c01c5eb2" containerName="openstack-network-exporter" Mar 16 15:53:57 crc kubenswrapper[5120]: I0316 15:53:57.998647 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="cb25223e-e443-4a56-9b17-d0159918b563" containerName="nova-scheduler-scheduler" Mar 16 15:53:57 crc kubenswrapper[5120]: I0316 15:53:57.998656 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="a7b8bb1c-b58a-43a6-8457-88a025588f1e" containerName="ovsdbserver-nb" Mar 16 15:53:57 crc kubenswrapper[5120]: I0316 15:53:57.998671 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="d32a00a6-9028-411d-9f59-0b48c01c5eb2" containerName="ovsdbserver-sb" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.005784 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-xvqbz"] Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.005807 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-6646594584-l84r5"] Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.005820 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-9a70-account-create-update-s95ff"] Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.005830 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-9a70-account-create-update-s95ff"] Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.005913 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-xvqbz" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.006152 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-85b4fd4946-cqqk6"] Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.006185 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-236f-account-create-update-8gdw9"] Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.006441 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-7956bcf97d-p9m4c" podUID="ac8dd629-af3d-4d9c-b41a-f5b8d6d29498" containerName="placement-log" containerID="cri-o://847b3ef9b9ce57593d9c18b6ae192780d0c000dbacbc9f955495006d724af884" gracePeriod=30 Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.006809 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-7956bcf97d-p9m4c" podUID="ac8dd629-af3d-4d9c-b41a-f5b8d6d29498" containerName="placement-api" containerID="cri-o://4dec859182aa9185489fadcae215d8674987c3f6d2fb9b2af9889aac1406c176" gracePeriod=30 Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.006983 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-85b4fd4946-cqqk6" podUID="72332d22-b98a-420f-b6ce-66d22d70566b" containerName="neutron-api" containerID="cri-o://9940d1b5e7f2bb8e9549d3743c8a6e48257c84e180a8c46e9f5477a9d73d29ce" gracePeriod=30 Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.007064 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-85b4fd4946-cqqk6" podUID="72332d22-b98a-420f-b6ce-66d22d70566b" containerName="neutron-httpd" containerID="cri-o://5f2c32a9433767dc6b404267c0200ca020edcba7ea995cde3eb8bedf0cf26bf8" gracePeriod=30 Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.019453 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-dd94-account-create-update-l69rr"] Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.019509 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-236f-account-create-update-8gdw9"] Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.019523 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.019537 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.019557 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.019566 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-proxy-59c794978b-lzrxq"] Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.019597 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-5f559c8896-5jgnd"] Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.019610 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.019620 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-766fb557cd-fwt4z"] Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.019634 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-2tr4g"] Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.019715 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-2tr4g"] Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.019728 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.019615 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-236f-account-create-update-8gdw9" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.019740 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-69c8889b9f-sfbxd"] Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.019782 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.021093 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-5f559c8896-5jgnd" podUID="d442e64c-a236-4d12-8205-d5cf2cb95748" containerName="barbican-api-log" containerID="cri-o://7173ba4274579607f73bd4022925294671ad0ce2e608f3f2ca430323887062b7" gracePeriod=30 Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.021866 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-5f559c8896-5jgnd" podUID="d442e64c-a236-4d12-8205-d5cf2cb95748" containerName="barbican-api" containerID="cri-o://0470cfd37685bd89173ba27c32f8e3e3b084af837af4d8097ba45194c409f65b" gracePeriod=30 Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.021951 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-proxy-59c794978b-lzrxq" podUID="ac88284a-2f9f-4e52-8de4-1c299b94bbd1" containerName="proxy-server" containerID="cri-o://3384af102f5e21af38f70357dde5423094a7b97015a788c7ce82b5c8ddf617b2" gracePeriod=30 Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.022815 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-proxy-59c794978b-lzrxq" podUID="ac88284a-2f9f-4e52-8de4-1c299b94bbd1" containerName="proxy-httpd" containerID="cri-o://9e3ca77b7dc91937211be72bb388d6e800aa4ca62b560a55eb833bbf6b8c4ddb" gracePeriod=30 Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.055835 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-db-secret\"" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.070732 5120 scope.go:117] "RemoveContainer" containerID="8748dcf62a7cbea6f73e88271be3d579871e9203831b32f0ef2c2b3d64a038b4" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.073615 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.090499 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-c7cf47df9-t2r2b"] Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.090544 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-9b99-account-create-update-djffv"] Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.090558 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-f4d9ffc8d-lwp78"] Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.090588 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.090599 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-7bd99f4458-mgw7m"] Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.090612 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0e93-account-create-update-gbtp8"] Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.090621 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-7wc99"] Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.090632 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0e93-account-create-update-gbtp8"] Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.090663 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-7wc99"] Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.090675 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-db-create-p6nst"] Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.090684 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-db-create-p6nst"] Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.090706 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-236f-account-create-update-8b5q5"] Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.090715 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-236f-account-create-update-8b5q5"] Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.090726 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-gpg9h"] Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.090736 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-gpg9h"] Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.090768 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-0a49-account-create-update-fqp48"] Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.090781 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.090792 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-ph2vf"] Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.091043 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="387f81d1-6a19-4250-b210-26daff7cbdc9" containerName="nova-cell1-conductor-conductor" containerID="cri-o://6211858e25939c70614a9fad4891a628b70c8d2b4ada38adb2b8bd841a424715" gracePeriod=30 Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.091381 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.092855 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-c7cf47df9-t2r2b" podUID="cb293a62-0310-4af8-8376-0b2197bda8d2" containerName="barbican-worker" containerID="cri-o://354e037f289bc79961fa099797e6d89c6df4e1e5901656cb22c5c95fe04df07b" gracePeriod=30 Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.093249 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-f4d9ffc8d-lwp78" podUID="e0a6dd94-0b6e-446a-924b-a39ce7582090" containerName="barbican-keystone-listener-log" containerID="cri-o://bfc23559de2564738a88f0aeabdcc2bd4aadac83b546cb7e03c03224bc801908" gracePeriod=30 Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.093452 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-f4d9ffc8d-lwp78" podUID="e0a6dd94-0b6e-446a-924b-a39ce7582090" containerName="barbican-keystone-listener" containerID="cri-o://d98841f9e46e61836bc62ce9a26e9ee5daf9f80796e5c5c33aaeb58a64ec8ebb" gracePeriod=30 Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.095421 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"memcached-config-data\"" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.095635 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"memcached-memcached-dockercfg-l8bff\"" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.095860 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-memcached-svc\"" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.115881 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-c7cf47df9-t2r2b" podUID="cb293a62-0310-4af8-8376-0b2197bda8d2" containerName="barbican-worker-log" containerID="cri-o://bf02f4cbf7ce963664b2216d2bb7afe00bfa9ca2fcfe0b5d52f4cbc656f2fe71" gracePeriod=30 Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.149250 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-ph2vf"] Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.154128 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.166962 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-thftp\" (UniqueName: \"kubernetes.io/projected/5888de0f-5da8-4605-aa27-db134fd47b31-kube-api-access-thftp\") pod \"5888de0f-5da8-4605-aa27-db134fd47b31\" (UID: \"5888de0f-5da8-4605-aa27-db134fd47b31\") " Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.167070 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5888de0f-5da8-4605-aa27-db134fd47b31-config-data\") pod \"5888de0f-5da8-4605-aa27-db134fd47b31\" (UID: \"5888de0f-5da8-4605-aa27-db134fd47b31\") " Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.167113 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5888de0f-5da8-4605-aa27-db134fd47b31-combined-ca-bundle\") pod \"5888de0f-5da8-4605-aa27-db134fd47b31\" (UID: \"5888de0f-5da8-4605-aa27-db134fd47b31\") " Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.167592 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7090862a-0953-4c04-91f3-a37e21671e86-combined-ca-bundle\") pod \"memcached-0\" (UID: \"7090862a-0953-4c04-91f3-a37e21671e86\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.167661 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xh9rt\" (UniqueName: \"kubernetes.io/projected/7090862a-0953-4c04-91f3-a37e21671e86-kube-api-access-xh9rt\") pod \"memcached-0\" (UID: \"7090862a-0953-4c04-91f3-a37e21671e86\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.167770 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jg96\" (UniqueName: \"kubernetes.io/projected/5e604554-8190-4098-a61e-3568489988d0-kube-api-access-7jg96\") pod \"keystone-236f-account-create-update-8gdw9\" (UID: \"5e604554-8190-4098-a61e-3568489988d0\") " pod="openstack-kuttl-tests/keystone-236f-account-create-update-8gdw9" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.167844 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5e604554-8190-4098-a61e-3568489988d0-operator-scripts\") pod \"keystone-236f-account-create-update-8gdw9\" (UID: \"5e604554-8190-4098-a61e-3568489988d0\") " pod="openstack-kuttl-tests/keystone-236f-account-create-update-8gdw9" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.167905 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/51478cb6-9192-494b-a293-b5cc54cfa9a3-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-79dcd846c5-xvqbz\" (UID: \"51478cb6-9192-494b-a293-b5cc54cfa9a3\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-xvqbz" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.167945 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/7090862a-0953-4c04-91f3-a37e21671e86-kolla-config\") pod \"memcached-0\" (UID: \"7090862a-0953-4c04-91f3-a37e21671e86\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.168091 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/7090862a-0953-4c04-91f3-a37e21671e86-config-data\") pod \"memcached-0\" (UID: \"7090862a-0953-4c04-91f3-a37e21671e86\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.168132 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwdtd\" (UniqueName: \"kubernetes.io/projected/51478cb6-9192-494b-a293-b5cc54cfa9a3-kube-api-access-wwdtd\") pod \"dnsmasq-dnsmasq-79dcd846c5-xvqbz\" (UID: \"51478cb6-9192-494b-a293-b5cc54cfa9a3\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-xvqbz" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.168208 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/7090862a-0953-4c04-91f3-a37e21671e86-memcached-tls-certs\") pod \"memcached-0\" (UID: \"7090862a-0953-4c04-91f3-a37e21671e86\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.168249 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/51478cb6-9192-494b-a293-b5cc54cfa9a3-config\") pod \"dnsmasq-dnsmasq-79dcd846c5-xvqbz\" (UID: \"51478cb6-9192-494b-a293-b5cc54cfa9a3\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-xvqbz" Mar 16 15:53:58 crc kubenswrapper[5120]: E0316 15:53:58.168972 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Mar 16 15:53:58 crc kubenswrapper[5120]: E0316 15:53:58.169109 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/36a1c719-e302-4df3-99c5-5025d99c8c19-config-data podName:36a1c719-e302-4df3-99c5-5025d99c8c19 nodeName:}" failed. No retries permitted until 2026-03-16 15:53:58.66908938 +0000 UTC m=+1340.823021037 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/36a1c719-e302-4df3-99c5-5025d99c8c19-config-data") pod "rabbitmq-cell1-server-0" (UID: "36a1c719-e302-4df3-99c5-5025d99c8c19") : configmap "rabbitmq-cell1-config-data" not found Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.179641 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.190037 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.195947 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5888de0f-5da8-4605-aa27-db134fd47b31-kube-api-access-thftp" (OuterVolumeSpecName: "kube-api-access-thftp") pod "5888de0f-5da8-4605-aa27-db134fd47b31" (UID: "5888de0f-5da8-4605-aa27-db134fd47b31"). InnerVolumeSpecName "kube-api-access-thftp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.210073 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-nx5h9"] Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.211173 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.215938 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.223307 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.236525 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-db-create-7xtvp"] Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.259580 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-nx5h9"] Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.267088 5120 scope.go:117] "RemoveContainer" containerID="8c55763fcf264ceeed4d09a515d899986858a78501aa64cc228e9e4494fd465a" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.269011 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/14486849-fbb1-4cc9-8aa3-714e263c55fb-combined-ca-bundle\") pod \"14486849-fbb1-4cc9-8aa3-714e263c55fb\" (UID: \"14486849-fbb1-4cc9-8aa3-714e263c55fb\") " Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.269139 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/d6f8b8b2-e94a-4c67-9e6d-be16e2acbdcc-openstack-config\") pod \"d6f8b8b2-e94a-4c67-9e6d-be16e2acbdcc\" (UID: \"d6f8b8b2-e94a-4c67-9e6d-be16e2acbdcc\") " Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.269196 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/32f7f790-9e5b-4052-a87d-b3abaa0b3ff0-combined-ca-bundle\") pod \"32f7f790-9e5b-4052-a87d-b3abaa0b3ff0\" (UID: \"32f7f790-9e5b-4052-a87d-b3abaa0b3ff0\") " Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.269232 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d6f8b8b2-e94a-4c67-9e6d-be16e2acbdcc-combined-ca-bundle\") pod \"d6f8b8b2-e94a-4c67-9e6d-be16e2acbdcc\" (UID: \"d6f8b8b2-e94a-4c67-9e6d-be16e2acbdcc\") " Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.269273 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/14486849-fbb1-4cc9-8aa3-714e263c55fb-galera-tls-certs\") pod \"14486849-fbb1-4cc9-8aa3-714e263c55fb\" (UID: \"14486849-fbb1-4cc9-8aa3-714e263c55fb\") " Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.269323 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/32f7f790-9e5b-4052-a87d-b3abaa0b3ff0-nova-novncproxy-tls-certs\") pod \"32f7f790-9e5b-4052-a87d-b3abaa0b3ff0\" (UID: \"32f7f790-9e5b-4052-a87d-b3abaa0b3ff0\") " Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.269365 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/14486849-fbb1-4cc9-8aa3-714e263c55fb-config-data-default\") pod \"14486849-fbb1-4cc9-8aa3-714e263c55fb\" (UID: \"14486849-fbb1-4cc9-8aa3-714e263c55fb\") " Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.269432 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/d6f8b8b2-e94a-4c67-9e6d-be16e2acbdcc-openstack-config-secret\") pod \"d6f8b8b2-e94a-4c67-9e6d-be16e2acbdcc\" (UID: \"d6f8b8b2-e94a-4c67-9e6d-be16e2acbdcc\") " Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.269449 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/14486849-fbb1-4cc9-8aa3-714e263c55fb-kolla-config\") pod \"14486849-fbb1-4cc9-8aa3-714e263c55fb\" (UID: \"14486849-fbb1-4cc9-8aa3-714e263c55fb\") " Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.269472 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-prq56\" (UniqueName: \"kubernetes.io/projected/32f7f790-9e5b-4052-a87d-b3abaa0b3ff0-kube-api-access-prq56\") pod \"32f7f790-9e5b-4052-a87d-b3abaa0b3ff0\" (UID: \"32f7f790-9e5b-4052-a87d-b3abaa0b3ff0\") " Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.269527 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pdch9\" (UniqueName: \"kubernetes.io/projected/d6f8b8b2-e94a-4c67-9e6d-be16e2acbdcc-kube-api-access-pdch9\") pod \"d6f8b8b2-e94a-4c67-9e6d-be16e2acbdcc\" (UID: \"d6f8b8b2-e94a-4c67-9e6d-be16e2acbdcc\") " Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.269571 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/14486849-fbb1-4cc9-8aa3-714e263c55fb-config-data-generated\") pod \"14486849-fbb1-4cc9-8aa3-714e263c55fb\" (UID: \"14486849-fbb1-4cc9-8aa3-714e263c55fb\") " Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.269614 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/32f7f790-9e5b-4052-a87d-b3abaa0b3ff0-config-data\") pod \"32f7f790-9e5b-4052-a87d-b3abaa0b3ff0\" (UID: \"32f7f790-9e5b-4052-a87d-b3abaa0b3ff0\") " Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.269633 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/14486849-fbb1-4cc9-8aa3-714e263c55fb-operator-scripts\") pod \"14486849-fbb1-4cc9-8aa3-714e263c55fb\" (UID: \"14486849-fbb1-4cc9-8aa3-714e263c55fb\") " Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.269667 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p7cg4\" (UniqueName: \"kubernetes.io/projected/14486849-fbb1-4cc9-8aa3-714e263c55fb-kube-api-access-p7cg4\") pod \"14486849-fbb1-4cc9-8aa3-714e263c55fb\" (UID: \"14486849-fbb1-4cc9-8aa3-714e263c55fb\") " Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.269697 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"mysql-db\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"14486849-fbb1-4cc9-8aa3-714e263c55fb\" (UID: \"14486849-fbb1-4cc9-8aa3-714e263c55fb\") " Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.269730 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/32f7f790-9e5b-4052-a87d-b3abaa0b3ff0-vencrypt-tls-certs\") pod \"32f7f790-9e5b-4052-a87d-b3abaa0b3ff0\" (UID: \"32f7f790-9e5b-4052-a87d-b3abaa0b3ff0\") " Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.269930 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/7090862a-0953-4c04-91f3-a37e21671e86-memcached-tls-certs\") pod \"memcached-0\" (UID: \"7090862a-0953-4c04-91f3-a37e21671e86\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.269967 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/51478cb6-9192-494b-a293-b5cc54cfa9a3-config\") pod \"dnsmasq-dnsmasq-79dcd846c5-xvqbz\" (UID: \"51478cb6-9192-494b-a293-b5cc54cfa9a3\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-xvqbz" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.269989 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7090862a-0953-4c04-91f3-a37e21671e86-combined-ca-bundle\") pod \"memcached-0\" (UID: \"7090862a-0953-4c04-91f3-a37e21671e86\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.270039 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xh9rt\" (UniqueName: \"kubernetes.io/projected/7090862a-0953-4c04-91f3-a37e21671e86-kube-api-access-xh9rt\") pod \"memcached-0\" (UID: \"7090862a-0953-4c04-91f3-a37e21671e86\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.270110 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7jg96\" (UniqueName: \"kubernetes.io/projected/5e604554-8190-4098-a61e-3568489988d0-kube-api-access-7jg96\") pod \"keystone-236f-account-create-update-8gdw9\" (UID: \"5e604554-8190-4098-a61e-3568489988d0\") " pod="openstack-kuttl-tests/keystone-236f-account-create-update-8gdw9" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.270154 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5e604554-8190-4098-a61e-3568489988d0-operator-scripts\") pod \"keystone-236f-account-create-update-8gdw9\" (UID: \"5e604554-8190-4098-a61e-3568489988d0\") " pod="openstack-kuttl-tests/keystone-236f-account-create-update-8gdw9" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.270202 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/51478cb6-9192-494b-a293-b5cc54cfa9a3-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-79dcd846c5-xvqbz\" (UID: \"51478cb6-9192-494b-a293-b5cc54cfa9a3\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-xvqbz" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.270233 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/7090862a-0953-4c04-91f3-a37e21671e86-kolla-config\") pod \"memcached-0\" (UID: \"7090862a-0953-4c04-91f3-a37e21671e86\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.270351 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/7090862a-0953-4c04-91f3-a37e21671e86-config-data\") pod \"memcached-0\" (UID: \"7090862a-0953-4c04-91f3-a37e21671e86\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.270378 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wwdtd\" (UniqueName: \"kubernetes.io/projected/51478cb6-9192-494b-a293-b5cc54cfa9a3-kube-api-access-wwdtd\") pod \"dnsmasq-dnsmasq-79dcd846c5-xvqbz\" (UID: \"51478cb6-9192-494b-a293-b5cc54cfa9a3\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-xvqbz" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.270441 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-thftp\" (UniqueName: \"kubernetes.io/projected/5888de0f-5da8-4605-aa27-db134fd47b31-kube-api-access-thftp\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.271690 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14486849-fbb1-4cc9-8aa3-714e263c55fb-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "14486849-fbb1-4cc9-8aa3-714e263c55fb" (UID: "14486849-fbb1-4cc9-8aa3-714e263c55fb"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.272147 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-db-create-7xtvp"] Mar 16 15:53:58 crc kubenswrapper[5120]: E0316 15:53:58.272204 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 15:53:58 crc kubenswrapper[5120]: E0316 15:53:58.272291 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7090862a-0953-4c04-91f3-a37e21671e86-combined-ca-bundle podName:7090862a-0953-4c04-91f3-a37e21671e86 nodeName:}" failed. No retries permitted until 2026-03-16 15:53:58.772271065 +0000 UTC m=+1340.926202722 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/7090862a-0953-4c04-91f3-a37e21671e86-combined-ca-bundle") pod "memcached-0" (UID: "7090862a-0953-4c04-91f3-a37e21671e86") : secret "combined-ca-bundle" not found Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.273938 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14486849-fbb1-4cc9-8aa3-714e263c55fb-config-data-generated" (OuterVolumeSpecName: "config-data-generated") pod "14486849-fbb1-4cc9-8aa3-714e263c55fb" (UID: "14486849-fbb1-4cc9-8aa3-714e263c55fb"). InnerVolumeSpecName "config-data-generated". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:53:58 crc kubenswrapper[5120]: E0316 15:53:58.275506 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Mar 16 15:53:58 crc kubenswrapper[5120]: E0316 15:53:58.275591 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5e604554-8190-4098-a61e-3568489988d0-operator-scripts podName:5e604554-8190-4098-a61e-3568489988d0 nodeName:}" failed. No retries permitted until 2026-03-16 15:53:58.775557676 +0000 UTC m=+1340.929489333 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/5e604554-8190-4098-a61e-3568489988d0-operator-scripts") pod "keystone-236f-account-create-update-8gdw9" (UID: "5e604554-8190-4098-a61e-3568489988d0") : configmap "openstack-scripts" not found Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.276476 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/51478cb6-9192-494b-a293-b5cc54cfa9a3-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-79dcd846c5-xvqbz\" (UID: \"51478cb6-9192-494b-a293-b5cc54cfa9a3\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-xvqbz" Mar 16 15:53:58 crc kubenswrapper[5120]: E0316 15:53:58.276525 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/memcached-config-data: configmap "memcached-config-data" not found Mar 16 15:53:58 crc kubenswrapper[5120]: E0316 15:53:58.276551 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7090862a-0953-4c04-91f3-a37e21671e86-kolla-config podName:7090862a-0953-4c04-91f3-a37e21671e86 nodeName:}" failed. No retries permitted until 2026-03-16 15:53:58.776541823 +0000 UTC m=+1340.930473470 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kolla-config" (UniqueName: "kubernetes.io/configmap/7090862a-0953-4c04-91f3-a37e21671e86-kolla-config") pod "memcached-0" (UID: "7090862a-0953-4c04-91f3-a37e21671e86") : configmap "memcached-config-data" not found Mar 16 15:53:58 crc kubenswrapper[5120]: E0316 15:53:58.276576 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/memcached-config-data: configmap "memcached-config-data" not found Mar 16 15:53:58 crc kubenswrapper[5120]: E0316 15:53:58.276593 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7090862a-0953-4c04-91f3-a37e21671e86-config-data podName:7090862a-0953-4c04-91f3-a37e21671e86 nodeName:}" failed. No retries permitted until 2026-03-16 15:53:58.776587694 +0000 UTC m=+1340.930519351 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/7090862a-0953-4c04-91f3-a37e21671e86-config-data") pod "memcached-0" (UID: "7090862a-0953-4c04-91f3-a37e21671e86") : configmap "memcached-config-data" not found Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.277312 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/51478cb6-9192-494b-a293-b5cc54cfa9a3-config\") pod \"dnsmasq-dnsmasq-79dcd846c5-xvqbz\" (UID: \"51478cb6-9192-494b-a293-b5cc54cfa9a3\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-xvqbz" Mar 16 15:53:58 crc kubenswrapper[5120]: E0316 15:53:58.277371 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-memcached-svc: secret "cert-memcached-svc" not found Mar 16 15:53:58 crc kubenswrapper[5120]: E0316 15:53:58.277395 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7090862a-0953-4c04-91f3-a37e21671e86-memcached-tls-certs podName:7090862a-0953-4c04-91f3-a37e21671e86 nodeName:}" failed. No retries permitted until 2026-03-16 15:53:58.777387887 +0000 UTC m=+1340.931319534 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "memcached-tls-certs" (UniqueName: "kubernetes.io/secret/7090862a-0953-4c04-91f3-a37e21671e86-memcached-tls-certs") pod "memcached-0" (UID: "7090862a-0953-4c04-91f3-a37e21671e86") : secret "cert-memcached-svc" not found Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.277460 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14486849-fbb1-4cc9-8aa3-714e263c55fb-config-data-default" (OuterVolumeSpecName: "config-data-default") pod "14486849-fbb1-4cc9-8aa3-714e263c55fb" (UID: "14486849-fbb1-4cc9-8aa3-714e263c55fb"). InnerVolumeSpecName "config-data-default". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.278258 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14486849-fbb1-4cc9-8aa3-714e263c55fb-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "14486849-fbb1-4cc9-8aa3-714e263c55fb" (UID: "14486849-fbb1-4cc9-8aa3-714e263c55fb"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:53:58 crc kubenswrapper[5120]: E0316 15:53:58.285277 5120 projected.go:194] Error preparing data for projected volume kube-api-access-7jg96 for pod openstack-kuttl-tests/keystone-236f-account-create-update-8gdw9: failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 15:53:58 crc kubenswrapper[5120]: E0316 15:53:58.285337 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5e604554-8190-4098-a61e-3568489988d0-kube-api-access-7jg96 podName:5e604554-8190-4098-a61e-3568489988d0 nodeName:}" failed. No retries permitted until 2026-03-16 15:53:58.785321346 +0000 UTC m=+1340.939252993 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-7jg96" (UniqueName: "kubernetes.io/projected/5e604554-8190-4098-a61e-3568489988d0-kube-api-access-7jg96") pod "keystone-236f-account-create-update-8gdw9" (UID: "5e604554-8190-4098-a61e-3568489988d0") : failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 15:53:58 crc kubenswrapper[5120]: E0316 15:53:58.285358 5120 projected.go:194] Error preparing data for projected volume kube-api-access-xh9rt for pod openstack-kuttl-tests/memcached-0: failed to fetch token: serviceaccounts "memcached-memcached" not found Mar 16 15:53:58 crc kubenswrapper[5120]: E0316 15:53:58.285384 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7090862a-0953-4c04-91f3-a37e21671e86-kube-api-access-xh9rt podName:7090862a-0953-4c04-91f3-a37e21671e86 nodeName:}" failed. No retries permitted until 2026-03-16 15:53:58.785378437 +0000 UTC m=+1340.939310094 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-xh9rt" (UniqueName: "kubernetes.io/projected/7090862a-0953-4c04-91f3-a37e21671e86-kube-api-access-xh9rt") pod "memcached-0" (UID: "7090862a-0953-4c04-91f3-a37e21671e86") : failed to fetch token: serviceaccounts "memcached-memcached" not found Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.316030 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-746gq"] Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.322221 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwdtd\" (UniqueName: \"kubernetes.io/projected/51478cb6-9192-494b-a293-b5cc54cfa9a3-kube-api-access-wwdtd\") pod \"dnsmasq-dnsmasq-79dcd846c5-xvqbz\" (UID: \"51478cb6-9192-494b-a293-b5cc54cfa9a3\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-xvqbz" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.322945 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32f7f790-9e5b-4052-a87d-b3abaa0b3ff0-kube-api-access-prq56" (OuterVolumeSpecName: "kube-api-access-prq56") pod "32f7f790-9e5b-4052-a87d-b3abaa0b3ff0" (UID: "32f7f790-9e5b-4052-a87d-b3abaa0b3ff0"). InnerVolumeSpecName "kube-api-access-prq56". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.333911 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14486849-fbb1-4cc9-8aa3-714e263c55fb-kube-api-access-p7cg4" (OuterVolumeSpecName: "kube-api-access-p7cg4") pod "14486849-fbb1-4cc9-8aa3-714e263c55fb" (UID: "14486849-fbb1-4cc9-8aa3-714e263c55fb"). InnerVolumeSpecName "kube-api-access-p7cg4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.349646 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.371322 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6f8b8b2-e94a-4c67-9e6d-be16e2acbdcc-kube-api-access-pdch9" (OuterVolumeSpecName: "kube-api-access-pdch9") pod "d6f8b8b2-e94a-4c67-9e6d-be16e2acbdcc" (UID: "d6f8b8b2-e94a-4c67-9e6d-be16e2acbdcc"). InnerVolumeSpecName "kube-api-access-pdch9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.371989 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8d66ce1a-7d4c-4e04-92c9-f86d5ad81fcc-scripts\") pod \"8d66ce1a-7d4c-4e04-92c9-f86d5ad81fcc\" (UID: \"8d66ce1a-7d4c-4e04-92c9-f86d5ad81fcc\") " Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.372050 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6f641d93-c3e7-40c3-8d96-d89b931d18cc-config-data\") pod \"6f641d93-c3e7-40c3-8d96-d89b931d18cc\" (UID: \"6f641d93-c3e7-40c3-8d96-d89b931d18cc\") " Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.372071 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8d66ce1a-7d4c-4e04-92c9-f86d5ad81fcc-config-data\") pod \"8d66ce1a-7d4c-4e04-92c9-f86d5ad81fcc\" (UID: \"8d66ce1a-7d4c-4e04-92c9-f86d5ad81fcc\") " Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.372093 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6f641d93-c3e7-40c3-8d96-d89b931d18cc-internal-tls-certs\") pod \"6f641d93-c3e7-40c3-8d96-d89b931d18cc\" (UID: \"6f641d93-c3e7-40c3-8d96-d89b931d18cc\") " Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.372216 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/ae15ab63-33c1-4085-809f-5b1b4086b95b-kube-state-metrics-tls-config\") pod \"ae15ab63-33c1-4085-809f-5b1b4086b95b\" (UID: \"ae15ab63-33c1-4085-809f-5b1b4086b95b\") " Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.372233 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6f641d93-c3e7-40c3-8d96-d89b931d18cc-combined-ca-bundle\") pod \"6f641d93-c3e7-40c3-8d96-d89b931d18cc\" (UID: \"6f641d93-c3e7-40c3-8d96-d89b931d18cc\") " Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.372315 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/8d66ce1a-7d4c-4e04-92c9-f86d5ad81fcc-config-data-custom\") pod \"8d66ce1a-7d4c-4e04-92c9-f86d5ad81fcc\" (UID: \"8d66ce1a-7d4c-4e04-92c9-f86d5ad81fcc\") " Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.372371 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/ae15ab63-33c1-4085-809f-5b1b4086b95b-kube-state-metrics-tls-certs\") pod \"ae15ab63-33c1-4085-809f-5b1b4086b95b\" (UID: \"ae15ab63-33c1-4085-809f-5b1b4086b95b\") " Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.372444 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8d66ce1a-7d4c-4e04-92c9-f86d5ad81fcc-combined-ca-bundle\") pod \"8d66ce1a-7d4c-4e04-92c9-f86d5ad81fcc\" (UID: \"8d66ce1a-7d4c-4e04-92c9-f86d5ad81fcc\") " Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.372587 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dxndt\" (UniqueName: \"kubernetes.io/projected/6f641d93-c3e7-40c3-8d96-d89b931d18cc-kube-api-access-dxndt\") pod \"6f641d93-c3e7-40c3-8d96-d89b931d18cc\" (UID: \"6f641d93-c3e7-40c3-8d96-d89b931d18cc\") " Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.372626 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6f641d93-c3e7-40c3-8d96-d89b931d18cc-public-tls-certs\") pod \"6f641d93-c3e7-40c3-8d96-d89b931d18cc\" (UID: \"6f641d93-c3e7-40c3-8d96-d89b931d18cc\") " Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.372648 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/8d66ce1a-7d4c-4e04-92c9-f86d5ad81fcc-etc-machine-id\") pod \"8d66ce1a-7d4c-4e04-92c9-f86d5ad81fcc\" (UID: \"8d66ce1a-7d4c-4e04-92c9-f86d5ad81fcc\") " Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.372717 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-55h6z\" (UniqueName: \"kubernetes.io/projected/ae15ab63-33c1-4085-809f-5b1b4086b95b-kube-api-access-55h6z\") pod \"ae15ab63-33c1-4085-809f-5b1b4086b95b\" (UID: \"ae15ab63-33c1-4085-809f-5b1b4086b95b\") " Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.372780 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6f641d93-c3e7-40c3-8d96-d89b931d18cc-logs\") pod \"6f641d93-c3e7-40c3-8d96-d89b931d18cc\" (UID: \"6f641d93-c3e7-40c3-8d96-d89b931d18cc\") " Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.372826 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dpqm4\" (UniqueName: \"kubernetes.io/projected/8d66ce1a-7d4c-4e04-92c9-f86d5ad81fcc-kube-api-access-dpqm4\") pod \"8d66ce1a-7d4c-4e04-92c9-f86d5ad81fcc\" (UID: \"8d66ce1a-7d4c-4e04-92c9-f86d5ad81fcc\") " Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.372849 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ae15ab63-33c1-4085-809f-5b1b4086b95b-combined-ca-bundle\") pod \"ae15ab63-33c1-4085-809f-5b1b4086b95b\" (UID: \"ae15ab63-33c1-4085-809f-5b1b4086b95b\") " Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.380136 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-a8cd-account-create-update-nbt76"] Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.380524 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/8d66ce1a-7d4c-4e04-92c9-f86d5ad81fcc-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "8d66ce1a-7d4c-4e04-92c9-f86d5ad81fcc" (UID: "8d66ce1a-7d4c-4e04-92c9-f86d5ad81fcc"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.382176 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f641d93-c3e7-40c3-8d96-d89b931d18cc-logs" (OuterVolumeSpecName: "logs") pod "6f641d93-c3e7-40c3-8d96-d89b931d18cc" (UID: "6f641d93-c3e7-40c3-8d96-d89b931d18cc"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.386060 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.387414 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/14486849-fbb1-4cc9-8aa3-714e263c55fb-config-data-default\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.387439 5120 reconciler_common.go:299] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/14486849-fbb1-4cc9-8aa3-714e263c55fb-kolla-config\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.387449 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-prq56\" (UniqueName: \"kubernetes.io/projected/32f7f790-9e5b-4052-a87d-b3abaa0b3ff0-kube-api-access-prq56\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.387458 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pdch9\" (UniqueName: \"kubernetes.io/projected/d6f8b8b2-e94a-4c67-9e6d-be16e2acbdcc-kube-api-access-pdch9\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.387481 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/14486849-fbb1-4cc9-8aa3-714e263c55fb-config-data-generated\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.387488 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/14486849-fbb1-4cc9-8aa3-714e263c55fb-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.387497 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p7cg4\" (UniqueName: \"kubernetes.io/projected/14486849-fbb1-4cc9-8aa3-714e263c55fb-kube-api-access-p7cg4\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.387505 5120 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/8d66ce1a-7d4c-4e04-92c9-f86d5ad81fcc-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.387514 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6f641d93-c3e7-40c3-8d96-d89b931d18cc-logs\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.404874 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f641d93-c3e7-40c3-8d96-d89b931d18cc-kube-api-access-dxndt" (OuterVolumeSpecName: "kube-api-access-dxndt") pod "6f641d93-c3e7-40c3-8d96-d89b931d18cc" (UID: "6f641d93-c3e7-40c3-8d96-d89b931d18cc"). InnerVolumeSpecName "kube-api-access-dxndt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.419397 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 15:53:58 crc kubenswrapper[5120]: E0316 15:53:58.421868 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[combined-ca-bundle config-data kolla-config kube-api-access-xh9rt memcached-tls-certs], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openstack-kuttl-tests/memcached-0" podUID="7090862a-0953-4c04-91f3-a37e21671e86" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.423097 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d66ce1a-7d4c-4e04-92c9-f86d5ad81fcc-scripts" (OuterVolumeSpecName: "scripts") pod "8d66ce1a-7d4c-4e04-92c9-f86d5ad81fcc" (UID: "8d66ce1a-7d4c-4e04-92c9-f86d5ad81fcc"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.423213 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d66ce1a-7d4c-4e04-92c9-f86d5ad81fcc-kube-api-access-dpqm4" (OuterVolumeSpecName: "kube-api-access-dpqm4") pod "8d66ce1a-7d4c-4e04-92c9-f86d5ad81fcc" (UID: "8d66ce1a-7d4c-4e04-92c9-f86d5ad81fcc"). InnerVolumeSpecName "kube-api-access-dpqm4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.423256 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d66ce1a-7d4c-4e04-92c9-f86d5ad81fcc-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "8d66ce1a-7d4c-4e04-92c9-f86d5ad81fcc" (UID: "8d66ce1a-7d4c-4e04-92c9-f86d5ad81fcc"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.429796 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-jxphs"] Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.434961 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-jxphs"] Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.438402 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae15ab63-33c1-4085-809f-5b1b4086b95b-kube-api-access-55h6z" (OuterVolumeSpecName: "kube-api-access-55h6z") pod "ae15ab63-33c1-4085-809f-5b1b4086b95b" (UID: "ae15ab63-33c1-4085-809f-5b1b4086b95b"). InnerVolumeSpecName "kube-api-access-55h6z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.439843 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-x2qcd"] Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.439928 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage12-crc" (OuterVolumeSpecName: "mysql-db") pod "14486849-fbb1-4cc9-8aa3-714e263c55fb" (UID: "14486849-fbb1-4cc9-8aa3-714e263c55fb"). InnerVolumeSpecName "local-storage12-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.449921 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-x2qcd"] Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.452069 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.458302 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5888de0f-5da8-4605-aa27-db134fd47b31-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "5888de0f-5da8-4605-aa27-db134fd47b31" (UID: "5888de0f-5da8-4605-aa27-db134fd47b31"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.474544 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-236f-account-create-update-8gdw9"] Mar 16 15:53:58 crc kubenswrapper[5120]: E0316 15:53:58.476949 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-7jg96 operator-scripts], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openstack-kuttl-tests/keystone-236f-account-create-update-8gdw9" podUID="5e604554-8190-4098-a61e-3568489988d0" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.493615 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/4306304f-eaea-49a1-9e62-9b035dc302de-config-data-custom\") pod \"4306304f-eaea-49a1-9e62-9b035dc302de\" (UID: \"4306304f-eaea-49a1-9e62-9b035dc302de\") " Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.493686 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4306304f-eaea-49a1-9e62-9b035dc302de-logs\") pod \"4306304f-eaea-49a1-9e62-9b035dc302de\" (UID: \"4306304f-eaea-49a1-9e62-9b035dc302de\") " Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.493807 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4306304f-eaea-49a1-9e62-9b035dc302de-combined-ca-bundle\") pod \"4306304f-eaea-49a1-9e62-9b035dc302de\" (UID: \"4306304f-eaea-49a1-9e62-9b035dc302de\") " Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.493830 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/4306304f-eaea-49a1-9e62-9b035dc302de-internal-tls-certs\") pod \"4306304f-eaea-49a1-9e62-9b035dc302de\" (UID: \"4306304f-eaea-49a1-9e62-9b035dc302de\") " Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.493888 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d51d8732-80e3-463b-b8b0-714f8a2d281f-logs\") pod \"d51d8732-80e3-463b-b8b0-714f8a2d281f\" (UID: \"d51d8732-80e3-463b-b8b0-714f8a2d281f\") " Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.493917 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/4306304f-eaea-49a1-9e62-9b035dc302de-etc-machine-id\") pod \"4306304f-eaea-49a1-9e62-9b035dc302de\" (UID: \"4306304f-eaea-49a1-9e62-9b035dc302de\") " Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.493962 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/4306304f-eaea-49a1-9e62-9b035dc302de-public-tls-certs\") pod \"4306304f-eaea-49a1-9e62-9b035dc302de\" (UID: \"4306304f-eaea-49a1-9e62-9b035dc302de\") " Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.494113 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4306304f-eaea-49a1-9e62-9b035dc302de-config-data\") pod \"4306304f-eaea-49a1-9e62-9b035dc302de\" (UID: \"4306304f-eaea-49a1-9e62-9b035dc302de\") " Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.494169 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lf9w2\" (UniqueName: \"kubernetes.io/projected/d51d8732-80e3-463b-b8b0-714f8a2d281f-kube-api-access-lf9w2\") pod \"d51d8732-80e3-463b-b8b0-714f8a2d281f\" (UID: \"d51d8732-80e3-463b-b8b0-714f8a2d281f\") " Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.494362 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d51d8732-80e3-463b-b8b0-714f8a2d281f-config-data\") pod \"d51d8732-80e3-463b-b8b0-714f8a2d281f\" (UID: \"d51d8732-80e3-463b-b8b0-714f8a2d281f\") " Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.494444 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4306304f-eaea-49a1-9e62-9b035dc302de-scripts\") pod \"4306304f-eaea-49a1-9e62-9b035dc302de\" (UID: \"4306304f-eaea-49a1-9e62-9b035dc302de\") " Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.494464 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ssrsq\" (UniqueName: \"kubernetes.io/projected/4306304f-eaea-49a1-9e62-9b035dc302de-kube-api-access-ssrsq\") pod \"4306304f-eaea-49a1-9e62-9b035dc302de\" (UID: \"4306304f-eaea-49a1-9e62-9b035dc302de\") " Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.494500 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/d51d8732-80e3-463b-b8b0-714f8a2d281f-nova-metadata-tls-certs\") pod \"d51d8732-80e3-463b-b8b0-714f8a2d281f\" (UID: \"d51d8732-80e3-463b-b8b0-714f8a2d281f\") " Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.494545 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d51d8732-80e3-463b-b8b0-714f8a2d281f-combined-ca-bundle\") pod \"d51d8732-80e3-463b-b8b0-714f8a2d281f\" (UID: \"d51d8732-80e3-463b-b8b0-714f8a2d281f\") " Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.494616 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d51d8732-80e3-463b-b8b0-714f8a2d281f-logs" (OuterVolumeSpecName: "logs") pod "d51d8732-80e3-463b-b8b0-714f8a2d281f" (UID: "d51d8732-80e3-463b-b8b0-714f8a2d281f"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.499230 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/4306304f-eaea-49a1-9e62-9b035dc302de-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "4306304f-eaea-49a1-9e62-9b035dc302de" (UID: "4306304f-eaea-49a1-9e62-9b035dc302de"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.500375 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4306304f-eaea-49a1-9e62-9b035dc302de-logs" (OuterVolumeSpecName: "logs") pod "4306304f-eaea-49a1-9e62-9b035dc302de" (UID: "4306304f-eaea-49a1-9e62-9b035dc302de"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.506188 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") on node \"crc\" " Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.506236 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dxndt\" (UniqueName: \"kubernetes.io/projected/6f641d93-c3e7-40c3-8d96-d89b931d18cc-kube-api-access-dxndt\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.506250 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d51d8732-80e3-463b-b8b0-714f8a2d281f-logs\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.506259 5120 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/4306304f-eaea-49a1-9e62-9b035dc302de-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.506269 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-55h6z\" (UniqueName: \"kubernetes.io/projected/ae15ab63-33c1-4085-809f-5b1b4086b95b-kube-api-access-55h6z\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.506280 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dpqm4\" (UniqueName: \"kubernetes.io/projected/8d66ce1a-7d4c-4e04-92c9-f86d5ad81fcc-kube-api-access-dpqm4\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.506288 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8d66ce1a-7d4c-4e04-92c9-f86d5ad81fcc-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.506299 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/8d66ce1a-7d4c-4e04-92c9-f86d5ad81fcc-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.506308 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5888de0f-5da8-4605-aa27-db134fd47b31-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.506316 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4306304f-eaea-49a1-9e62-9b035dc302de-logs\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.529585 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-57d5475c78-rsjsp"] Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.529810 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/keystone-57d5475c78-rsjsp" podUID="07b2313a-7b50-4c4a-b485-ef68c88e468a" containerName="keystone-api" containerID="cri-o://497e64e16b22008e1580d7bcf4de8aa734e1762960610ad1eee91171968fbc0a" gracePeriod=30 Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.539786 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-6b877d4f87-4vmvc"] Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.543577 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"ae15ab63-33c1-4085-809f-5b1b4086b95b","Type":"ContainerDied","Data":"12ac7662605f653786af5ebc933e989dfdb3b43eda02ab469afc7c543b519a3a"} Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.543651 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.548973 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-db-create-q5hqz"] Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.551503 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"14486849-fbb1-4cc9-8aa3-714e263c55fb","Type":"ContainerDied","Data":"67b6cc78be5822ca9fa08b0e577299a67bea362b9914d26f394d0aea31ccd13a"} Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.551608 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.555857 5120 generic.go:358] "Generic (PLEG): container finished" podID="72332d22-b98a-420f-b6ce-66d22d70566b" containerID="5f2c32a9433767dc6b404267c0200ca020edcba7ea995cde3eb8bedf0cf26bf8" exitCode=0 Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.555924 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-85b4fd4946-cqqk6" event={"ID":"72332d22-b98a-420f-b6ce-66d22d70566b","Type":"ContainerDied","Data":"5f2c32a9433767dc6b404267c0200ca020edcba7ea995cde3eb8bedf0cf26bf8"} Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.557515 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-db-create-q5hqz"] Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.558168 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.558547 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"6f641d93-c3e7-40c3-8d96-d89b931d18cc","Type":"ContainerDied","Data":"2d079b8564bab3642be9de61b938cafc3bce89a9fb5abb08a49b89c06dc9653f"} Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.561211 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4306304f-eaea-49a1-9e62-9b035dc302de-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "4306304f-eaea-49a1-9e62-9b035dc302de" (UID: "4306304f-eaea-49a1-9e62-9b035dc302de"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.561731 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-xvqbz" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.562184 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"d51d8732-80e3-463b-b8b0-714f8a2d281f","Type":"ContainerDied","Data":"25f2c8fd64c5c42c7b4f842bd00390d42b17301d271d155e5eb842218e0b7d75"} Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.562419 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.564634 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"8d66ce1a-7d4c-4e04-92c9-f86d5ad81fcc","Type":"ContainerDied","Data":"85dac730ed07fc5583d198142766432292f3f059f6ca6f8a3261fe52ec1c4dae"} Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.564704 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.573341 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4306304f-eaea-49a1-9e62-9b035dc302de-scripts" (OuterVolumeSpecName: "scripts") pod "4306304f-eaea-49a1-9e62-9b035dc302de" (UID: "4306304f-eaea-49a1-9e62-9b035dc302de"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.574451 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4306304f-eaea-49a1-9e62-9b035dc302de-kube-api-access-ssrsq" (OuterVolumeSpecName: "kube-api-access-ssrsq") pod "4306304f-eaea-49a1-9e62-9b035dc302de" (UID: "4306304f-eaea-49a1-9e62-9b035dc302de"). InnerVolumeSpecName "kube-api-access-ssrsq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.579617 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d51d8732-80e3-463b-b8b0-714f8a2d281f-kube-api-access-lf9w2" (OuterVolumeSpecName: "kube-api-access-lf9w2") pod "d51d8732-80e3-463b-b8b0-714f8a2d281f" (UID: "d51d8732-80e3-463b-b8b0-714f8a2d281f"). InnerVolumeSpecName "kube-api-access-lf9w2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.581097 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.582006 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae15ab63-33c1-4085-809f-5b1b4086b95b-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ae15ab63-33c1-4085-809f-5b1b4086b95b" (UID: "ae15ab63-33c1-4085-809f-5b1b4086b95b"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.580001 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"4306304f-eaea-49a1-9e62-9b035dc302de","Type":"ContainerDied","Data":"03a532e5f3aef4d39e3e05038316d64f88f3c45b80b9e445a60645d5b7d6e8f9"} Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.584465 5120 generic.go:358] "Generic (PLEG): container finished" podID="ac8dd629-af3d-4d9c-b41a-f5b8d6d29498" containerID="847b3ef9b9ce57593d9c18b6ae192780d0c000dbacbc9f955495006d724af884" exitCode=143 Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.584547 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-7956bcf97d-p9m4c" event={"ID":"ac8dd629-af3d-4d9c-b41a-f5b8d6d29498","Type":"ContainerDied","Data":"847b3ef9b9ce57593d9c18b6ae192780d0c000dbacbc9f955495006d724af884"} Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.585225 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-766fb557cd-fwt4z"] Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.586804 5120 generic.go:358] "Generic (PLEG): container finished" podID="176eef56-bc30-4119-8af5-fa1329d63aa2" containerID="544dd46ceb52a8a8952e0260d5780a769952c63f2d32902979fa7e197c0a5577" exitCode=0 Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.586886 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"176eef56-bc30-4119-8af5-fa1329d63aa2","Type":"ContainerDied","Data":"544dd46ceb52a8a8952e0260d5780a769952c63f2d32902979fa7e197c0a5577"} Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.588169 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-766fb557cd-fwt4z" event={"ID":"26a03664-6cb3-4982-80f5-063d8f12cc2a","Type":"ContainerStarted","Data":"168f973d805b675db2914f28e4ea71abd5da411857a7b7121c0285816c5d2bbc"} Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.591568 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"8821dbd3-25f2-44ea-8a41-e716db08960a","Type":"ContainerDied","Data":"90908bbbef74b7f5e704e8c24916f04d08ee29789fc078f939aaa8b2aa2fd831"} Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.589946 5120 generic.go:358] "Generic (PLEG): container finished" podID="8821dbd3-25f2-44ea-8a41-e716db08960a" containerID="90908bbbef74b7f5e704e8c24916f04d08ee29789fc078f939aaa8b2aa2fd831" exitCode=0 Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.594218 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-6b877d4f87-4vmvc"] Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.601733 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.607298 5120 scope.go:117] "RemoveContainer" containerID="648e7c7f54f433de39969c9d1bdd3b5463c4d4f0f019533353a14b1c5740b449" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.608602 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ae15ab63-33c1-4085-809f-5b1b4086b95b-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.608630 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lf9w2\" (UniqueName: \"kubernetes.io/projected/d51d8732-80e3-463b-b8b0-714f8a2d281f-kube-api-access-lf9w2\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.608642 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4306304f-eaea-49a1-9e62-9b035dc302de-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.608653 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ssrsq\" (UniqueName: \"kubernetes.io/projected/4306304f-eaea-49a1-9e62-9b035dc302de-kube-api-access-ssrsq\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.608662 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/4306304f-eaea-49a1-9e62-9b035dc302de-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.616545 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.618236 5120 generic.go:358] "Generic (PLEG): container finished" podID="d442e64c-a236-4d12-8205-d5cf2cb95748" containerID="7173ba4274579607f73bd4022925294671ad0ce2e608f3f2ca430323887062b7" exitCode=143 Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.618405 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-5f559c8896-5jgnd" event={"ID":"d442e64c-a236-4d12-8205-d5cf2cb95748","Type":"ContainerDied","Data":"7173ba4274579607f73bd4022925294671ad0ce2e608f3f2ca430323887062b7"} Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.624492 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-6b877d4f87-4vmvc" event={"ID":"26ff2779-e4aa-43b8-9704-4def1ae45033","Type":"ContainerStarted","Data":"12dab1db1034f0afb2eef326f9d4733e639118c19df114c03faa0fc64e1864ef"} Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.625402 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.631631 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.633438 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-69c8889b9f-sfbxd" event={"ID":"18ef8c0b-e810-48c1-b5a5-43584c591dfa","Type":"ContainerStarted","Data":"959ba0f73cfaf0e69153bb7f33832702f869ac6825fc9e369095f60f526b025d"} Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.633458 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-69c8889b9f-sfbxd" podUID="18ef8c0b-e810-48c1-b5a5-43584c591dfa" containerName="barbican-worker-log" containerID="cri-o://bcd37f54cbc166ff52b822355e3dffd9da249e43d42116ecf6339e6a81422bbe" gracePeriod=30 Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.633530 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-69c8889b9f-sfbxd" podUID="18ef8c0b-e810-48c1-b5a5-43584c591dfa" containerName="barbican-worker" containerID="cri-o://959ba0f73cfaf0e69153bb7f33832702f869ac6825fc9e369095f60f526b025d" gracePeriod=30 Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.640399 5120 generic.go:358] "Generic (PLEG): container finished" podID="cb293a62-0310-4af8-8376-0b2197bda8d2" containerID="bf02f4cbf7ce963664b2216d2bb7afe00bfa9ca2fcfe0b5d52f4cbc656f2fe71" exitCode=143 Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.640456 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-c7cf47df9-t2r2b" event={"ID":"cb293a62-0310-4af8-8376-0b2197bda8d2","Type":"ContainerDied","Data":"bf02f4cbf7ce963664b2216d2bb7afe00bfa9ca2fcfe0b5d52f4cbc656f2fe71"} Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.645156 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.657973 5120 generic.go:358] "Generic (PLEG): container finished" podID="e0a6dd94-0b6e-446a-924b-a39ce7582090" containerID="bfc23559de2564738a88f0aeabdcc2bd4aadac83b546cb7e03c03224bc801908" exitCode=143 Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.661155 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-f4d9ffc8d-lwp78" event={"ID":"e0a6dd94-0b6e-446a-924b-a39ce7582090","Type":"ContainerDied","Data":"bfc23559de2564738a88f0aeabdcc2bd4aadac83b546cb7e03c03224bc801908"} Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.668987 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.669642 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.669689 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.669945 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.670010 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.714319 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/176eef56-bc30-4119-8af5-fa1329d63aa2-logs\") pod \"176eef56-bc30-4119-8af5-fa1329d63aa2\" (UID: \"176eef56-bc30-4119-8af5-fa1329d63aa2\") " Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.714822 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage12-crc" (UniqueName: "kubernetes.io/local-volume/local-storage12-crc") on node "crc" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.715955 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/176eef56-bc30-4119-8af5-fa1329d63aa2-logs" (OuterVolumeSpecName: "logs") pod "176eef56-bc30-4119-8af5-fa1329d63aa2" (UID: "176eef56-bc30-4119-8af5-fa1329d63aa2"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.719205 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/176eef56-bc30-4119-8af5-fa1329d63aa2-config-data\") pod \"176eef56-bc30-4119-8af5-fa1329d63aa2\" (UID: \"176eef56-bc30-4119-8af5-fa1329d63aa2\") " Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.723189 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rqwc7\" (UniqueName: \"kubernetes.io/projected/176eef56-bc30-4119-8af5-fa1329d63aa2-kube-api-access-rqwc7\") pod \"176eef56-bc30-4119-8af5-fa1329d63aa2\" (UID: \"176eef56-bc30-4119-8af5-fa1329d63aa2\") " Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.723412 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/176eef56-bc30-4119-8af5-fa1329d63aa2-httpd-run\") pod \"176eef56-bc30-4119-8af5-fa1329d63aa2\" (UID: \"176eef56-bc30-4119-8af5-fa1329d63aa2\") " Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.723460 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/176eef56-bc30-4119-8af5-fa1329d63aa2-scripts\") pod \"176eef56-bc30-4119-8af5-fa1329d63aa2\" (UID: \"176eef56-bc30-4119-8af5-fa1329d63aa2\") " Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.723645 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"176eef56-bc30-4119-8af5-fa1329d63aa2\" (UID: \"176eef56-bc30-4119-8af5-fa1329d63aa2\") " Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.723677 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/176eef56-bc30-4119-8af5-fa1329d63aa2-public-tls-certs\") pod \"176eef56-bc30-4119-8af5-fa1329d63aa2\" (UID: \"176eef56-bc30-4119-8af5-fa1329d63aa2\") " Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.723711 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/176eef56-bc30-4119-8af5-fa1329d63aa2-combined-ca-bundle\") pod \"176eef56-bc30-4119-8af5-fa1329d63aa2\" (UID: \"176eef56-bc30-4119-8af5-fa1329d63aa2\") " Mar 16 15:53:58 crc kubenswrapper[5120]: E0316 15:53:58.725014 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Mar 16 15:53:58 crc kubenswrapper[5120]: E0316 15:53:58.725073 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/36a1c719-e302-4df3-99c5-5025d99c8c19-config-data podName:36a1c719-e302-4df3-99c5-5025d99c8c19 nodeName:}" failed. No retries permitted until 2026-03-16 15:53:59.725056883 +0000 UTC m=+1341.878988540 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/36a1c719-e302-4df3-99c5-5025d99c8c19-config-data") pod "rabbitmq-cell1-server-0" (UID: "36a1c719-e302-4df3-99c5-5025d99c8c19") : configmap "rabbitmq-cell1-config-data" not found Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.726748 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/176eef56-bc30-4119-8af5-fa1329d63aa2-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "176eef56-bc30-4119-8af5-fa1329d63aa2" (UID: "176eef56-bc30-4119-8af5-fa1329d63aa2"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.727468 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/176eef56-bc30-4119-8af5-fa1329d63aa2-logs\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.727562 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.773516 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5888de0f-5da8-4605-aa27-db134fd47b31-config-data" (OuterVolumeSpecName: "config-data") pod "5888de0f-5da8-4605-aa27-db134fd47b31" (UID: "5888de0f-5da8-4605-aa27-db134fd47b31"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.773965 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.774094 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.777471 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="05e1d6eb-b3dc-45fd-9ae7-6636f015529b" path="/var/lib/kubelet/pods/05e1d6eb-b3dc-45fd-9ae7-6636f015529b/volumes" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.777646 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/176eef56-bc30-4119-8af5-fa1329d63aa2-kube-api-access-rqwc7" (OuterVolumeSpecName: "kube-api-access-rqwc7") pod "176eef56-bc30-4119-8af5-fa1329d63aa2" (UID: "176eef56-bc30-4119-8af5-fa1329d63aa2"). InnerVolumeSpecName "kube-api-access-rqwc7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.777843 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/176eef56-bc30-4119-8af5-fa1329d63aa2-scripts" (OuterVolumeSpecName: "scripts") pod "176eef56-bc30-4119-8af5-fa1329d63aa2" (UID: "176eef56-bc30-4119-8af5-fa1329d63aa2"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.779017 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage13-crc" (OuterVolumeSpecName: "glance") pod "176eef56-bc30-4119-8af5-fa1329d63aa2" (UID: "176eef56-bc30-4119-8af5-fa1329d63aa2"). InnerVolumeSpecName "local-storage13-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.782704 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0f99ca47-2940-4787-8fea-9f7b86c6b844" path="/var/lib/kubelet/pods/0f99ca47-2940-4787-8fea-9f7b86c6b844/volumes" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.784226 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1c96ec30-a61d-4920-b08d-06fd9c5c538c" path="/var/lib/kubelet/pods/1c96ec30-a61d-4920-b08d-06fd9c5c538c/volumes" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.784691 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2c34de88-9612-4808-9fb7-312716436225" path="/var/lib/kubelet/pods/2c34de88-9612-4808-9fb7-312716436225/volumes" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.785672 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f195b64-2183-4e0f-8db8-7bab4ad019f7" path="/var/lib/kubelet/pods/2f195b64-2183-4e0f-8db8-7bab4ad019f7/volumes" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.786744 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="31a295e6-d052-4010-9008-4b44ccf0b7b7" path="/var/lib/kubelet/pods/31a295e6-d052-4010-9008-4b44ccf0b7b7/volumes" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.790357 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="38fd2e9b-bc77-4f3c-be96-7059ba88891e" path="/var/lib/kubelet/pods/38fd2e9b-bc77-4f3c-be96-7059ba88891e/volumes" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.791087 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3ab9ab45-8904-421a-a38b-8fbd13cf84a6" path="/var/lib/kubelet/pods/3ab9ab45-8904-421a-a38b-8fbd13cf84a6/volumes" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.791594 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="47203a51-c1a7-433b-990b-f7744bc74071" path="/var/lib/kubelet/pods/47203a51-c1a7-433b-990b-f7744bc74071/volumes" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.792646 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="598fa73c-5fdc-41e2-9d7d-f3494dc37c79" path="/var/lib/kubelet/pods/598fa73c-5fdc-41e2-9d7d-f3494dc37c79/volumes" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.794518 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="62a03637-2221-40d9-a921-f87cc0f5a487" path="/var/lib/kubelet/pods/62a03637-2221-40d9-a921-f87cc0f5a487/volumes" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.797327 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7a468626-4b34-4bf0-a716-4900c7cb0a1a" path="/var/lib/kubelet/pods/7a468626-4b34-4bf0-a716-4900c7cb0a1a/volumes" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.798691 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8404bf6f-e511-4cfa-adbb-649eb3a9a7d9" path="/var/lib/kubelet/pods/8404bf6f-e511-4cfa-adbb-649eb3a9a7d9/volumes" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.799870 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="90534d56-28ff-4983-b8ea-be83259ce64d" path="/var/lib/kubelet/pods/90534d56-28ff-4983-b8ea-be83259ce64d/volumes" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.800868 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b8a74c0-777b-4320-af58-04656d3207e0" path="/var/lib/kubelet/pods/9b8a74c0-777b-4320-af58-04656d3207e0/volumes" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.802744 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a7b8bb1c-b58a-43a6-8457-88a025588f1e" path="/var/lib/kubelet/pods/a7b8bb1c-b58a-43a6-8457-88a025588f1e/volumes" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.804302 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c7b4af2e-c6d2-4479-a926-27a52b3a973e" path="/var/lib/kubelet/pods/c7b4af2e-c6d2-4479-a926-27a52b3a973e/volumes" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.804976 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb25223e-e443-4a56-9b17-d0159918b563" path="/var/lib/kubelet/pods/cb25223e-e443-4a56-9b17-d0159918b563/volumes" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.805609 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cbc99c4f-184e-4c10-9e60-9a981761ecf2" path="/var/lib/kubelet/pods/cbc99c4f-184e-4c10-9e60-9a981761ecf2/volumes" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.806793 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d32a00a6-9028-411d-9f59-0b48c01c5eb2" path="/var/lib/kubelet/pods/d32a00a6-9028-411d-9f59-0b48c01c5eb2/volumes" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.807421 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd113a80-a8fc-4706-8aec-eb299e36d6b8" path="/var/lib/kubelet/pods/fd113a80-a8fc-4706-8aec-eb299e36d6b8/volumes" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.830818 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d6734794-135c-4f4b-83b6-c64788f83f91-combined-ca-bundle\") pod \"d6734794-135c-4f4b-83b6-c64788f83f91\" (UID: \"d6734794-135c-4f4b-83b6-c64788f83f91\") " Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.830870 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"d6734794-135c-4f4b-83b6-c64788f83f91\" (UID: \"d6734794-135c-4f4b-83b6-c64788f83f91\") " Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.830945 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/8821dbd3-25f2-44ea-8a41-e716db08960a-sg-core-conf-yaml\") pod \"8821dbd3-25f2-44ea-8a41-e716db08960a\" (UID: \"8821dbd3-25f2-44ea-8a41-e716db08960a\") " Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.831077 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zttjr\" (UniqueName: \"kubernetes.io/projected/8821dbd3-25f2-44ea-8a41-e716db08960a-kube-api-access-zttjr\") pod \"8821dbd3-25f2-44ea-8a41-e716db08960a\" (UID: \"8821dbd3-25f2-44ea-8a41-e716db08960a\") " Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.831125 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8821dbd3-25f2-44ea-8a41-e716db08960a-config-data\") pod \"8821dbd3-25f2-44ea-8a41-e716db08960a\" (UID: \"8821dbd3-25f2-44ea-8a41-e716db08960a\") " Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.831398 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/8821dbd3-25f2-44ea-8a41-e716db08960a-log-httpd\") pod \"8821dbd3-25f2-44ea-8a41-e716db08960a\" (UID: \"8821dbd3-25f2-44ea-8a41-e716db08960a\") " Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.831452 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/8821dbd3-25f2-44ea-8a41-e716db08960a-run-httpd\") pod \"8821dbd3-25f2-44ea-8a41-e716db08960a\" (UID: \"8821dbd3-25f2-44ea-8a41-e716db08960a\") " Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.831484 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d6734794-135c-4f4b-83b6-c64788f83f91-scripts\") pod \"d6734794-135c-4f4b-83b6-c64788f83f91\" (UID: \"d6734794-135c-4f4b-83b6-c64788f83f91\") " Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.831537 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d6734794-135c-4f4b-83b6-c64788f83f91-logs\") pod \"d6734794-135c-4f4b-83b6-c64788f83f91\" (UID: \"d6734794-135c-4f4b-83b6-c64788f83f91\") " Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.831562 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d6734794-135c-4f4b-83b6-c64788f83f91-config-data\") pod \"d6734794-135c-4f4b-83b6-c64788f83f91\" (UID: \"d6734794-135c-4f4b-83b6-c64788f83f91\") " Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.831605 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8821dbd3-25f2-44ea-8a41-e716db08960a-combined-ca-bundle\") pod \"8821dbd3-25f2-44ea-8a41-e716db08960a\" (UID: \"8821dbd3-25f2-44ea-8a41-e716db08960a\") " Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.831640 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8821dbd3-25f2-44ea-8a41-e716db08960a-scripts\") pod \"8821dbd3-25f2-44ea-8a41-e716db08960a\" (UID: \"8821dbd3-25f2-44ea-8a41-e716db08960a\") " Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.831766 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/8821dbd3-25f2-44ea-8a41-e716db08960a-ceilometer-tls-certs\") pod \"8821dbd3-25f2-44ea-8a41-e716db08960a\" (UID: \"8821dbd3-25f2-44ea-8a41-e716db08960a\") " Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.831794 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/d6734794-135c-4f4b-83b6-c64788f83f91-httpd-run\") pod \"d6734794-135c-4f4b-83b6-c64788f83f91\" (UID: \"d6734794-135c-4f4b-83b6-c64788f83f91\") " Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.831834 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/d6734794-135c-4f4b-83b6-c64788f83f91-internal-tls-certs\") pod \"d6734794-135c-4f4b-83b6-c64788f83f91\" (UID: \"d6734794-135c-4f4b-83b6-c64788f83f91\") " Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.831993 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kdmzh\" (UniqueName: \"kubernetes.io/projected/d6734794-135c-4f4b-83b6-c64788f83f91-kube-api-access-kdmzh\") pod \"d6734794-135c-4f4b-83b6-c64788f83f91\" (UID: \"d6734794-135c-4f4b-83b6-c64788f83f91\") " Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.832399 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7jg96\" (UniqueName: \"kubernetes.io/projected/5e604554-8190-4098-a61e-3568489988d0-kube-api-access-7jg96\") pod \"keystone-236f-account-create-update-8gdw9\" (UID: \"5e604554-8190-4098-a61e-3568489988d0\") " pod="openstack-kuttl-tests/keystone-236f-account-create-update-8gdw9" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.832486 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5e604554-8190-4098-a61e-3568489988d0-operator-scripts\") pod \"keystone-236f-account-create-update-8gdw9\" (UID: \"5e604554-8190-4098-a61e-3568489988d0\") " pod="openstack-kuttl-tests/keystone-236f-account-create-update-8gdw9" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.832623 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/7090862a-0953-4c04-91f3-a37e21671e86-kolla-config\") pod \"memcached-0\" (UID: \"7090862a-0953-4c04-91f3-a37e21671e86\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.833064 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/7090862a-0953-4c04-91f3-a37e21671e86-config-data\") pod \"memcached-0\" (UID: \"7090862a-0953-4c04-91f3-a37e21671e86\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.833231 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/7090862a-0953-4c04-91f3-a37e21671e86-memcached-tls-certs\") pod \"memcached-0\" (UID: \"7090862a-0953-4c04-91f3-a37e21671e86\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.833317 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7090862a-0953-4c04-91f3-a37e21671e86-combined-ca-bundle\") pod \"memcached-0\" (UID: \"7090862a-0953-4c04-91f3-a37e21671e86\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.833456 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xh9rt\" (UniqueName: \"kubernetes.io/projected/7090862a-0953-4c04-91f3-a37e21671e86-kube-api-access-xh9rt\") pod \"memcached-0\" (UID: \"7090862a-0953-4c04-91f3-a37e21671e86\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.834055 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5888de0f-5da8-4605-aa27-db134fd47b31-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.834075 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rqwc7\" (UniqueName: \"kubernetes.io/projected/176eef56-bc30-4119-8af5-fa1329d63aa2-kube-api-access-rqwc7\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.834087 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/176eef56-bc30-4119-8af5-fa1329d63aa2-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.834098 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/176eef56-bc30-4119-8af5-fa1329d63aa2-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.834115 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") on node \"crc\" " Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.836213 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8821dbd3-25f2-44ea-8a41-e716db08960a-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "8821dbd3-25f2-44ea-8a41-e716db08960a" (UID: "8821dbd3-25f2-44ea-8a41-e716db08960a"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:53:58 crc kubenswrapper[5120]: E0316 15:53:58.844058 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/memcached-config-data: configmap "memcached-config-data" not found Mar 16 15:53:58 crc kubenswrapper[5120]: E0316 15:53:58.844151 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7090862a-0953-4c04-91f3-a37e21671e86-config-data podName:7090862a-0953-4c04-91f3-a37e21671e86 nodeName:}" failed. No retries permitted until 2026-03-16 15:53:59.844128598 +0000 UTC m=+1341.998060255 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/7090862a-0953-4c04-91f3-a37e21671e86-config-data") pod "memcached-0" (UID: "7090862a-0953-4c04-91f3-a37e21671e86") : configmap "memcached-config-data" not found Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.844563 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8821dbd3-25f2-44ea-8a41-e716db08960a-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "8821dbd3-25f2-44ea-8a41-e716db08960a" (UID: "8821dbd3-25f2-44ea-8a41-e716db08960a"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:53:58 crc kubenswrapper[5120]: E0316 15:53:58.845017 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Mar 16 15:53:58 crc kubenswrapper[5120]: E0316 15:53:58.845334 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5e604554-8190-4098-a61e-3568489988d0-operator-scripts podName:5e604554-8190-4098-a61e-3568489988d0 nodeName:}" failed. No retries permitted until 2026-03-16 15:53:59.845315031 +0000 UTC m=+1341.999246678 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/5e604554-8190-4098-a61e-3568489988d0-operator-scripts") pod "keystone-236f-account-create-update-8gdw9" (UID: "5e604554-8190-4098-a61e-3568489988d0") : configmap "openstack-scripts" not found Mar 16 15:53:58 crc kubenswrapper[5120]: E0316 15:53:58.845507 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/memcached-config-data: configmap "memcached-config-data" not found Mar 16 15:53:58 crc kubenswrapper[5120]: E0316 15:53:58.845625 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7090862a-0953-4c04-91f3-a37e21671e86-kolla-config podName:7090862a-0953-4c04-91f3-a37e21671e86 nodeName:}" failed. No retries permitted until 2026-03-16 15:53:59.845614169 +0000 UTC m=+1341.999545826 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kolla-config" (UniqueName: "kubernetes.io/configmap/7090862a-0953-4c04-91f3-a37e21671e86-kolla-config") pod "memcached-0" (UID: "7090862a-0953-4c04-91f3-a37e21671e86") : configmap "memcached-config-data" not found Mar 16 15:53:58 crc kubenswrapper[5120]: E0316 15:53:58.846054 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.846107 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6734794-135c-4f4b-83b6-c64788f83f91-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "d6734794-135c-4f4b-83b6-c64788f83f91" (UID: "d6734794-135c-4f4b-83b6-c64788f83f91"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:53:58 crc kubenswrapper[5120]: E0316 15:53:58.846312 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7090862a-0953-4c04-91f3-a37e21671e86-combined-ca-bundle podName:7090862a-0953-4c04-91f3-a37e21671e86 nodeName:}" failed. No retries permitted until 2026-03-16 15:53:59.846293818 +0000 UTC m=+1342.000225465 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/7090862a-0953-4c04-91f3-a37e21671e86-combined-ca-bundle") pod "memcached-0" (UID: "7090862a-0953-4c04-91f3-a37e21671e86") : secret "combined-ca-bundle" not found Mar 16 15:53:58 crc kubenswrapper[5120]: E0316 15:53:58.846439 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-memcached-svc: secret "cert-memcached-svc" not found Mar 16 15:53:58 crc kubenswrapper[5120]: E0316 15:53:58.846591 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7090862a-0953-4c04-91f3-a37e21671e86-memcached-tls-certs podName:7090862a-0953-4c04-91f3-a37e21671e86 nodeName:}" failed. No retries permitted until 2026-03-16 15:53:59.846580786 +0000 UTC m=+1342.000512443 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "memcached-tls-certs" (UniqueName: "kubernetes.io/secret/7090862a-0953-4c04-91f3-a37e21671e86-memcached-tls-certs") pod "memcached-0" (UID: "7090862a-0953-4c04-91f3-a37e21671e86") : secret "cert-memcached-svc" not found Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.846654 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6734794-135c-4f4b-83b6-c64788f83f91-scripts" (OuterVolumeSpecName: "scripts") pod "d6734794-135c-4f4b-83b6-c64788f83f91" (UID: "d6734794-135c-4f4b-83b6-c64788f83f91"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.846807 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8821dbd3-25f2-44ea-8a41-e716db08960a-kube-api-access-zttjr" (OuterVolumeSpecName: "kube-api-access-zttjr") pod "8821dbd3-25f2-44ea-8a41-e716db08960a" (UID: "8821dbd3-25f2-44ea-8a41-e716db08960a"). InnerVolumeSpecName "kube-api-access-zttjr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.846971 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6734794-135c-4f4b-83b6-c64788f83f91-logs" (OuterVolumeSpecName: "logs") pod "d6734794-135c-4f4b-83b6-c64788f83f91" (UID: "d6734794-135c-4f4b-83b6-c64788f83f91"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.849909 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6734794-135c-4f4b-83b6-c64788f83f91-kube-api-access-kdmzh" (OuterVolumeSpecName: "kube-api-access-kdmzh") pod "d6734794-135c-4f4b-83b6-c64788f83f91" (UID: "d6734794-135c-4f4b-83b6-c64788f83f91"). InnerVolumeSpecName "kube-api-access-kdmzh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:53:58 crc kubenswrapper[5120]: E0316 15:53:58.850411 5120 projected.go:194] Error preparing data for projected volume kube-api-access-7jg96 for pod openstack-kuttl-tests/keystone-236f-account-create-update-8gdw9: failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 15:53:58 crc kubenswrapper[5120]: E0316 15:53:58.850460 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5e604554-8190-4098-a61e-3568489988d0-kube-api-access-7jg96 podName:5e604554-8190-4098-a61e-3568489988d0 nodeName:}" failed. No retries permitted until 2026-03-16 15:53:59.850447643 +0000 UTC m=+1342.004379290 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-7jg96" (UniqueName: "kubernetes.io/projected/5e604554-8190-4098-a61e-3568489988d0-kube-api-access-7jg96") pod "keystone-236f-account-create-update-8gdw9" (UID: "5e604554-8190-4098-a61e-3568489988d0") : failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 15:53:58 crc kubenswrapper[5120]: E0316 15:53:58.851695 5120 projected.go:194] Error preparing data for projected volume kube-api-access-xh9rt for pod openstack-kuttl-tests/memcached-0: failed to fetch token: serviceaccounts "memcached-memcached" not found Mar 16 15:53:58 crc kubenswrapper[5120]: E0316 15:53:58.851896 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7090862a-0953-4c04-91f3-a37e21671e86-kube-api-access-xh9rt podName:7090862a-0953-4c04-91f3-a37e21671e86 nodeName:}" failed. No retries permitted until 2026-03-16 15:53:59.851876653 +0000 UTC m=+1342.005808310 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-xh9rt" (UniqueName: "kubernetes.io/projected/7090862a-0953-4c04-91f3-a37e21671e86-kube-api-access-xh9rt") pod "memcached-0" (UID: "7090862a-0953-4c04-91f3-a37e21671e86") : failed to fetch token: serviceaccounts "memcached-memcached" not found Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.890901 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8821dbd3-25f2-44ea-8a41-e716db08960a-scripts" (OuterVolumeSpecName: "scripts") pod "8821dbd3-25f2-44ea-8a41-e716db08960a" (UID: "8821dbd3-25f2-44ea-8a41-e716db08960a"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.897233 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage09-crc" (OuterVolumeSpecName: "glance") pod "d6734794-135c-4f4b-83b6-c64788f83f91" (UID: "d6734794-135c-4f4b-83b6-c64788f83f91"). InnerVolumeSpecName "local-storage09-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 15:53:58 crc kubenswrapper[5120]: W0316 15:53:58.938276 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod687a8fb9_59e3_46c6_bdb9_f435b5cb52d9.slice/crio-cf7e3407b76666054ac42fc9b4d91b1e7c45d6868297d5342f0c1592bdf588d9 WatchSource:0}: Error finding container cf7e3407b76666054ac42fc9b4d91b1e7c45d6868297d5342f0c1592bdf588d9: Status 404 returned error can't find the container with id cf7e3407b76666054ac42fc9b4d91b1e7c45d6868297d5342f0c1592bdf588d9 Mar 16 15:53:58 crc kubenswrapper[5120]: W0316 15:53:58.940071 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod89c20c31_44e2_4359_b7ee_e2e8b00b4e19.slice/crio-0b47030b188cc609de78cb9a2c4493898fb69ce9fbd5993d90aaad436d9b0a08 WatchSource:0}: Error finding container 0b47030b188cc609de78cb9a2c4493898fb69ce9fbd5993d90aaad436d9b0a08: Status 404 returned error can't find the container with id 0b47030b188cc609de78cb9a2c4493898fb69ce9fbd5993d90aaad436d9b0a08 Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.941887 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/d6734794-135c-4f4b-83b6-c64788f83f91-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.941917 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kdmzh\" (UniqueName: \"kubernetes.io/projected/d6734794-135c-4f4b-83b6-c64788f83f91-kube-api-access-kdmzh\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.941946 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") on node \"crc\" " Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.941958 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zttjr\" (UniqueName: \"kubernetes.io/projected/8821dbd3-25f2-44ea-8a41-e716db08960a-kube-api-access-zttjr\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.941969 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/8821dbd3-25f2-44ea-8a41-e716db08960a-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.941977 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/8821dbd3-25f2-44ea-8a41-e716db08960a-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.941986 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d6734794-135c-4f4b-83b6-c64788f83f91-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.941994 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d6734794-135c-4f4b-83b6-c64788f83f91-logs\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.942003 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8821dbd3-25f2-44ea-8a41-e716db08960a-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:58 crc kubenswrapper[5120]: I0316 15:53:58.982174 5120 scope.go:117] "RemoveContainer" containerID="e07e87fb3cac1808e19af0e91433064ae3fa498e7405a64cbd98e61c6a491bb3" Mar 16 15:53:58 crc kubenswrapper[5120]: E0316 15:53:58.982746 5120 kuberuntime_manager.go:1358] "Unhandled Error" err=< Mar 16 15:53:58 crc kubenswrapper[5120]: container &Container{Name:mariadb-account-create-update,Image:quay.io/podified-antelope-centos9/openstack-mariadb@sha256:4caef2b55e01b9a7ee88a22bc69db1893521a91d95c7ad4c8e593f14f17a5f95,Command:[/bin/sh -c #!/bin/bash Mar 16 15:53:58 crc kubenswrapper[5120]: Mar 16 15:53:58 crc kubenswrapper[5120]: MYSQL_REMOTE_HOST="" source /var/lib/operator-scripts/mysql_root_auth.sh Mar 16 15:53:58 crc kubenswrapper[5120]: Mar 16 15:53:58 crc kubenswrapper[5120]: export DatabasePassword=${DatabasePassword:?"Please specify a DatabasePassword variable."} Mar 16 15:53:58 crc kubenswrapper[5120]: Mar 16 15:53:58 crc kubenswrapper[5120]: MYSQL_CMD="mysql -h -u root -P 3306" Mar 16 15:53:58 crc kubenswrapper[5120]: Mar 16 15:53:58 crc kubenswrapper[5120]: if [ -n "glance" ]; then Mar 16 15:53:58 crc kubenswrapper[5120]: GRANT_DATABASE="glance" Mar 16 15:53:58 crc kubenswrapper[5120]: else Mar 16 15:53:58 crc kubenswrapper[5120]: GRANT_DATABASE="*" Mar 16 15:53:58 crc kubenswrapper[5120]: fi Mar 16 15:53:58 crc kubenswrapper[5120]: Mar 16 15:53:58 crc kubenswrapper[5120]: # going for maximum compatibility here: Mar 16 15:53:58 crc kubenswrapper[5120]: # 1. MySQL 8 no longer allows implicit create user when GRANT is used Mar 16 15:53:58 crc kubenswrapper[5120]: # 2. MariaDB has "CREATE OR REPLACE", but MySQL does not Mar 16 15:53:58 crc kubenswrapper[5120]: # 3. create user with CREATE but then do all password and TLS with ALTER to Mar 16 15:53:58 crc kubenswrapper[5120]: # support updates Mar 16 15:53:58 crc kubenswrapper[5120]: Mar 16 15:53:58 crc kubenswrapper[5120]: $MYSQL_CMD < logger="UnhandledError" Mar 16 15:53:58 crc kubenswrapper[5120]: E0316 15:53:58.984355 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"mariadb-account-create-update\" with CreateContainerConfigError: \"secret \\\"glance-db-secret\\\" not found\"" pod="openstack-kuttl-tests/glance-3f2f-account-create-update-rfgcb" podUID="2f3efc59-f473-4fd6-acc0-ce261268d63b" Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.005397 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6f8b8b2-e94a-4c67-9e6d-be16e2acbdcc-openstack-config" (OuterVolumeSpecName: "openstack-config") pod "d6f8b8b2-e94a-4c67-9e6d-be16e2acbdcc" (UID: "d6f8b8b2-e94a-4c67-9e6d-be16e2acbdcc"). InnerVolumeSpecName "openstack-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.005779 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage13-crc" (UniqueName: "kubernetes.io/local-volume/local-storage13-crc") on node "crc" Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.022419 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-worker-69c8889b9f-sfbxd" podStartSLOduration=7.022403322 podStartE2EDuration="7.022403322s" podCreationTimestamp="2026-03-16 15:53:52 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:53:58.651821577 +0000 UTC m=+1340.805753244" watchObservedRunningTime="2026-03-16 15:53:59.022403322 +0000 UTC m=+1341.176334979" Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.044896 5120 reconciler_common.go:299] "Volume detached for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/d6f8b8b2-e94a-4c67-9e6d-be16e2acbdcc-openstack-config\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.045051 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:59 crc kubenswrapper[5120]: E0316 15:53:59.048180 5120 kuberuntime_manager.go:1358] "Unhandled Error" err=< Mar 16 15:53:59 crc kubenswrapper[5120]: container &Container{Name:mariadb-account-create-update,Image:quay.io/podified-antelope-centos9/openstack-mariadb@sha256:4caef2b55e01b9a7ee88a22bc69db1893521a91d95c7ad4c8e593f14f17a5f95,Command:[/bin/sh -c #!/bin/bash Mar 16 15:53:59 crc kubenswrapper[5120]: Mar 16 15:53:59 crc kubenswrapper[5120]: MYSQL_REMOTE_HOST="" source /var/lib/operator-scripts/mysql_root_auth.sh Mar 16 15:53:59 crc kubenswrapper[5120]: Mar 16 15:53:59 crc kubenswrapper[5120]: export DatabasePassword=${DatabasePassword:?"Please specify a DatabasePassword variable."} Mar 16 15:53:59 crc kubenswrapper[5120]: Mar 16 15:53:59 crc kubenswrapper[5120]: MYSQL_CMD="mysql -h -u root -P 3306" Mar 16 15:53:59 crc kubenswrapper[5120]: Mar 16 15:53:59 crc kubenswrapper[5120]: if [ -n "" ]; then Mar 16 15:53:59 crc kubenswrapper[5120]: GRANT_DATABASE="" Mar 16 15:53:59 crc kubenswrapper[5120]: else Mar 16 15:53:59 crc kubenswrapper[5120]: GRANT_DATABASE="*" Mar 16 15:53:59 crc kubenswrapper[5120]: fi Mar 16 15:53:59 crc kubenswrapper[5120]: Mar 16 15:53:59 crc kubenswrapper[5120]: # going for maximum compatibility here: Mar 16 15:53:59 crc kubenswrapper[5120]: # 1. MySQL 8 no longer allows implicit create user when GRANT is used Mar 16 15:53:59 crc kubenswrapper[5120]: # 2. MariaDB has "CREATE OR REPLACE", but MySQL does not Mar 16 15:53:59 crc kubenswrapper[5120]: # 3. create user with CREATE but then do all password and TLS with ALTER to Mar 16 15:53:59 crc kubenswrapper[5120]: # support updates Mar 16 15:53:59 crc kubenswrapper[5120]: Mar 16 15:53:59 crc kubenswrapper[5120]: $MYSQL_CMD < logger="UnhandledError" Mar 16 15:53:59 crc kubenswrapper[5120]: E0316 15:53:59.048793 5120 kuberuntime_manager.go:1358] "Unhandled Error" err=< Mar 16 15:53:59 crc kubenswrapper[5120]: container &Container{Name:mariadb-account-create-update,Image:quay.io/podified-antelope-centos9/openstack-mariadb@sha256:4caef2b55e01b9a7ee88a22bc69db1893521a91d95c7ad4c8e593f14f17a5f95,Command:[/bin/sh -c #!/bin/bash Mar 16 15:53:59 crc kubenswrapper[5120]: Mar 16 15:53:59 crc kubenswrapper[5120]: MYSQL_REMOTE_HOST="" source /var/lib/operator-scripts/mysql_root_auth.sh Mar 16 15:53:59 crc kubenswrapper[5120]: Mar 16 15:53:59 crc kubenswrapper[5120]: export DatabasePassword=${DatabasePassword:?"Please specify a DatabasePassword variable."} Mar 16 15:53:59 crc kubenswrapper[5120]: Mar 16 15:53:59 crc kubenswrapper[5120]: MYSQL_CMD="mysql -h -u root -P 3306" Mar 16 15:53:59 crc kubenswrapper[5120]: Mar 16 15:53:59 crc kubenswrapper[5120]: if [ -n "placement" ]; then Mar 16 15:53:59 crc kubenswrapper[5120]: GRANT_DATABASE="placement" Mar 16 15:53:59 crc kubenswrapper[5120]: else Mar 16 15:53:59 crc kubenswrapper[5120]: GRANT_DATABASE="*" Mar 16 15:53:59 crc kubenswrapper[5120]: fi Mar 16 15:53:59 crc kubenswrapper[5120]: Mar 16 15:53:59 crc kubenswrapper[5120]: # going for maximum compatibility here: Mar 16 15:53:59 crc kubenswrapper[5120]: # 1. MySQL 8 no longer allows implicit create user when GRANT is used Mar 16 15:53:59 crc kubenswrapper[5120]: # 2. MariaDB has "CREATE OR REPLACE", but MySQL does not Mar 16 15:53:59 crc kubenswrapper[5120]: # 3. create user with CREATE but then do all password and TLS with ALTER to Mar 16 15:53:59 crc kubenswrapper[5120]: # support updates Mar 16 15:53:59 crc kubenswrapper[5120]: Mar 16 15:53:59 crc kubenswrapper[5120]: $MYSQL_CMD < logger="UnhandledError" Mar 16 15:53:59 crc kubenswrapper[5120]: E0316 15:53:59.049777 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"mariadb-account-create-update\" with CreateContainerConfigError: \"secret \\\"openstack-cell1-mariadb-root-db-secret\\\" not found\"" pod="openstack-kuttl-tests/root-account-create-update-746gq" podUID="19be266e-6805-4342-be0d-7fff0fc81029" Mar 16 15:53:59 crc kubenswrapper[5120]: E0316 15:53:59.051021 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"mariadb-account-create-update\" with CreateContainerConfigError: \"secret \\\"placement-db-secret\\\" not found\"" pod="openstack-kuttl-tests/placement-a347-account-create-update-89khd" podUID="3af1f773-b662-412f-820d-bea6ba7e58ca" Mar 16 15:53:59 crc kubenswrapper[5120]: E0316 15:53:59.073425 5120 kuberuntime_manager.go:1358] "Unhandled Error" err=< Mar 16 15:53:59 crc kubenswrapper[5120]: container &Container{Name:mariadb-account-create-update,Image:quay.io/podified-antelope-centos9/openstack-mariadb@sha256:4caef2b55e01b9a7ee88a22bc69db1893521a91d95c7ad4c8e593f14f17a5f95,Command:[/bin/sh -c #!/bin/bash Mar 16 15:53:59 crc kubenswrapper[5120]: Mar 16 15:53:59 crc kubenswrapper[5120]: MYSQL_REMOTE_HOST="" source /var/lib/operator-scripts/mysql_root_auth.sh Mar 16 15:53:59 crc kubenswrapper[5120]: Mar 16 15:53:59 crc kubenswrapper[5120]: export DatabasePassword=${DatabasePassword:?"Please specify a DatabasePassword variable."} Mar 16 15:53:59 crc kubenswrapper[5120]: Mar 16 15:53:59 crc kubenswrapper[5120]: MYSQL_CMD="mysql -h -u root -P 3306" Mar 16 15:53:59 crc kubenswrapper[5120]: Mar 16 15:53:59 crc kubenswrapper[5120]: if [ -n "nova_cell1" ]; then Mar 16 15:53:59 crc kubenswrapper[5120]: GRANT_DATABASE="nova_cell1" Mar 16 15:53:59 crc kubenswrapper[5120]: else Mar 16 15:53:59 crc kubenswrapper[5120]: GRANT_DATABASE="*" Mar 16 15:53:59 crc kubenswrapper[5120]: fi Mar 16 15:53:59 crc kubenswrapper[5120]: Mar 16 15:53:59 crc kubenswrapper[5120]: # going for maximum compatibility here: Mar 16 15:53:59 crc kubenswrapper[5120]: # 1. MySQL 8 no longer allows implicit create user when GRANT is used Mar 16 15:53:59 crc kubenswrapper[5120]: # 2. MariaDB has "CREATE OR REPLACE", but MySQL does not Mar 16 15:53:59 crc kubenswrapper[5120]: # 3. create user with CREATE but then do all password and TLS with ALTER to Mar 16 15:53:59 crc kubenswrapper[5120]: # support updates Mar 16 15:53:59 crc kubenswrapper[5120]: Mar 16 15:53:59 crc kubenswrapper[5120]: $MYSQL_CMD < logger="UnhandledError" Mar 16 15:53:59 crc kubenswrapper[5120]: E0316 15:53:59.074866 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"mariadb-account-create-update\" with CreateContainerConfigError: \"secret \\\"nova-cell1-db-secret\\\" not found\"" pod="openstack-kuttl-tests/nova-cell1-0a49-account-create-update-fqp48" podUID="687a8fb9-59e3-46c6-bdb9-f435b5cb52d9" Mar 16 15:53:59 crc kubenswrapper[5120]: E0316 15:53:59.076885 5120 kuberuntime_manager.go:1358] "Unhandled Error" err=< Mar 16 15:53:59 crc kubenswrapper[5120]: container &Container{Name:mariadb-account-create-update,Image:quay.io/podified-antelope-centos9/openstack-mariadb@sha256:4caef2b55e01b9a7ee88a22bc69db1893521a91d95c7ad4c8e593f14f17a5f95,Command:[/bin/sh -c #!/bin/bash Mar 16 15:53:59 crc kubenswrapper[5120]: Mar 16 15:53:59 crc kubenswrapper[5120]: MYSQL_REMOTE_HOST="" source /var/lib/operator-scripts/mysql_root_auth.sh Mar 16 15:53:59 crc kubenswrapper[5120]: Mar 16 15:53:59 crc kubenswrapper[5120]: export DatabasePassword=${DatabasePassword:?"Please specify a DatabasePassword variable."} Mar 16 15:53:59 crc kubenswrapper[5120]: Mar 16 15:53:59 crc kubenswrapper[5120]: MYSQL_CMD="mysql -h -u root -P 3306" Mar 16 15:53:59 crc kubenswrapper[5120]: Mar 16 15:53:59 crc kubenswrapper[5120]: if [ -n "nova_cell0" ]; then Mar 16 15:53:59 crc kubenswrapper[5120]: GRANT_DATABASE="nova_cell0" Mar 16 15:53:59 crc kubenswrapper[5120]: else Mar 16 15:53:59 crc kubenswrapper[5120]: GRANT_DATABASE="*" Mar 16 15:53:59 crc kubenswrapper[5120]: fi Mar 16 15:53:59 crc kubenswrapper[5120]: Mar 16 15:53:59 crc kubenswrapper[5120]: # going for maximum compatibility here: Mar 16 15:53:59 crc kubenswrapper[5120]: # 1. MySQL 8 no longer allows implicit create user when GRANT is used Mar 16 15:53:59 crc kubenswrapper[5120]: # 2. MariaDB has "CREATE OR REPLACE", but MySQL does not Mar 16 15:53:59 crc kubenswrapper[5120]: # 3. create user with CREATE but then do all password and TLS with ALTER to Mar 16 15:53:59 crc kubenswrapper[5120]: # support updates Mar 16 15:53:59 crc kubenswrapper[5120]: Mar 16 15:53:59 crc kubenswrapper[5120]: $MYSQL_CMD < logger="UnhandledError" Mar 16 15:53:59 crc kubenswrapper[5120]: E0316 15:53:59.079874 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"mariadb-account-create-update\" with CreateContainerConfigError: \"secret \\\"nova-cell0-db-secret\\\" not found\"" pod="openstack-kuttl-tests/nova-cell0-9b99-account-create-update-djffv" podUID="89c20c31-44e2-4359-b7ee-e2e8b00b4e19" Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.082963 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/14486849-fbb1-4cc9-8aa3-714e263c55fb-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "14486849-fbb1-4cc9-8aa3-714e263c55fb" (UID: "14486849-fbb1-4cc9-8aa3-714e263c55fb"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:53:59 crc kubenswrapper[5120]: W0316 15:53:59.091018 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podafa004e7_041e_4f04_8864_7163df19cf53.slice/crio-649a631f7cb0b7208be2261907fec14dd00e5721d67d5ecb9d4f6aa932db61f5 WatchSource:0}: Error finding container 649a631f7cb0b7208be2261907fec14dd00e5721d67d5ecb9d4f6aa932db61f5: Status 404 returned error can't find the container with id 649a631f7cb0b7208be2261907fec14dd00e5721d67d5ecb9d4f6aa932db61f5 Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.098087 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/32f7f790-9e5b-4052-a87d-b3abaa0b3ff0-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "32f7f790-9e5b-4052-a87d-b3abaa0b3ff0" (UID: "32f7f790-9e5b-4052-a87d-b3abaa0b3ff0"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:53:59 crc kubenswrapper[5120]: E0316 15:53:59.108289 5120 kuberuntime_manager.go:1358] "Unhandled Error" err=< Mar 16 15:53:59 crc kubenswrapper[5120]: container &Container{Name:mariadb-account-create-update,Image:quay.io/podified-antelope-centos9/openstack-mariadb@sha256:4caef2b55e01b9a7ee88a22bc69db1893521a91d95c7ad4c8e593f14f17a5f95,Command:[/bin/sh -c #!/bin/bash Mar 16 15:53:59 crc kubenswrapper[5120]: Mar 16 15:53:59 crc kubenswrapper[5120]: MYSQL_REMOTE_HOST="" source /var/lib/operator-scripts/mysql_root_auth.sh Mar 16 15:53:59 crc kubenswrapper[5120]: Mar 16 15:53:59 crc kubenswrapper[5120]: export DatabasePassword=${DatabasePassword:?"Please specify a DatabasePassword variable."} Mar 16 15:53:59 crc kubenswrapper[5120]: Mar 16 15:53:59 crc kubenswrapper[5120]: MYSQL_CMD="mysql -h -u root -P 3306" Mar 16 15:53:59 crc kubenswrapper[5120]: Mar 16 15:53:59 crc kubenswrapper[5120]: if [ -n "cinder" ]; then Mar 16 15:53:59 crc kubenswrapper[5120]: GRANT_DATABASE="cinder" Mar 16 15:53:59 crc kubenswrapper[5120]: else Mar 16 15:53:59 crc kubenswrapper[5120]: GRANT_DATABASE="*" Mar 16 15:53:59 crc kubenswrapper[5120]: fi Mar 16 15:53:59 crc kubenswrapper[5120]: Mar 16 15:53:59 crc kubenswrapper[5120]: # going for maximum compatibility here: Mar 16 15:53:59 crc kubenswrapper[5120]: # 1. MySQL 8 no longer allows implicit create user when GRANT is used Mar 16 15:53:59 crc kubenswrapper[5120]: # 2. MariaDB has "CREATE OR REPLACE", but MySQL does not Mar 16 15:53:59 crc kubenswrapper[5120]: # 3. create user with CREATE but then do all password and TLS with ALTER to Mar 16 15:53:59 crc kubenswrapper[5120]: # support updates Mar 16 15:53:59 crc kubenswrapper[5120]: Mar 16 15:53:59 crc kubenswrapper[5120]: $MYSQL_CMD < logger="UnhandledError" Mar 16 15:53:59 crc kubenswrapper[5120]: E0316 15:53:59.109411 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"mariadb-account-create-update\" with CreateContainerConfigError: \"secret \\\"cinder-db-secret\\\" not found\"" pod="openstack-kuttl-tests/cinder-dd94-account-create-update-l69rr" podUID="afa004e7-041e-4f04-8864-7163df19cf53" Mar 16 15:53:59 crc kubenswrapper[5120]: E0316 15:53:59.127618 5120 kuberuntime_manager.go:1358] "Unhandled Error" err=< Mar 16 15:53:59 crc kubenswrapper[5120]: container &Container{Name:mariadb-account-create-update,Image:quay.io/podified-antelope-centos9/openstack-mariadb@sha256:4caef2b55e01b9a7ee88a22bc69db1893521a91d95c7ad4c8e593f14f17a5f95,Command:[/bin/sh -c #!/bin/bash Mar 16 15:53:59 crc kubenswrapper[5120]: Mar 16 15:53:59 crc kubenswrapper[5120]: MYSQL_REMOTE_HOST="" source /var/lib/operator-scripts/mysql_root_auth.sh Mar 16 15:53:59 crc kubenswrapper[5120]: Mar 16 15:53:59 crc kubenswrapper[5120]: export DatabasePassword=${DatabasePassword:?"Please specify a DatabasePassword variable."} Mar 16 15:53:59 crc kubenswrapper[5120]: Mar 16 15:53:59 crc kubenswrapper[5120]: MYSQL_CMD="mysql -h -u root -P 3306" Mar 16 15:53:59 crc kubenswrapper[5120]: Mar 16 15:53:59 crc kubenswrapper[5120]: if [ -n "neutron" ]; then Mar 16 15:53:59 crc kubenswrapper[5120]: GRANT_DATABASE="neutron" Mar 16 15:53:59 crc kubenswrapper[5120]: else Mar 16 15:53:59 crc kubenswrapper[5120]: GRANT_DATABASE="*" Mar 16 15:53:59 crc kubenswrapper[5120]: fi Mar 16 15:53:59 crc kubenswrapper[5120]: Mar 16 15:53:59 crc kubenswrapper[5120]: # going for maximum compatibility here: Mar 16 15:53:59 crc kubenswrapper[5120]: # 1. MySQL 8 no longer allows implicit create user when GRANT is used Mar 16 15:53:59 crc kubenswrapper[5120]: # 2. MariaDB has "CREATE OR REPLACE", but MySQL does not Mar 16 15:53:59 crc kubenswrapper[5120]: # 3. create user with CREATE but then do all password and TLS with ALTER to Mar 16 15:53:59 crc kubenswrapper[5120]: # support updates Mar 16 15:53:59 crc kubenswrapper[5120]: Mar 16 15:53:59 crc kubenswrapper[5120]: $MYSQL_CMD < logger="UnhandledError" Mar 16 15:53:59 crc kubenswrapper[5120]: E0316 15:53:59.128974 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"mariadb-account-create-update\" with CreateContainerConfigError: \"secret \\\"neutron-db-secret\\\" not found\"" pod="openstack-kuttl-tests/neutron-a8cd-account-create-update-nbt76" podUID="0c87b06f-6b7e-46f2-8aee-34285fea622e" Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.149542 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/14486849-fbb1-4cc9-8aa3-714e263c55fb-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.149594 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/32f7f790-9e5b-4052-a87d-b3abaa0b3ff0-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.153860 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d51d8732-80e3-463b-b8b0-714f8a2d281f-config-data" (OuterVolumeSpecName: "config-data") pod "d51d8732-80e3-463b-b8b0-714f8a2d281f" (UID: "d51d8732-80e3-463b-b8b0-714f8a2d281f"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.156368 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6f8b8b2-e94a-4c67-9e6d-be16e2acbdcc-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "d6f8b8b2-e94a-4c67-9e6d-be16e2acbdcc" (UID: "d6f8b8b2-e94a-4c67-9e6d-be16e2acbdcc"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.181896 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/rabbitmq-server-0" podUID="39704fdb-36c4-41fe-8c13-35a3abb56c36" containerName="rabbitmq" containerID="cri-o://0a03aa8f3a904e42190911fb4d58ece9e870ad8d6392509fc8eb0208c1ebf2c3" gracePeriod=604800 Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.218374 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/32f7f790-9e5b-4052-a87d-b3abaa0b3ff0-vencrypt-tls-certs" (OuterVolumeSpecName: "vencrypt-tls-certs") pod "32f7f790-9e5b-4052-a87d-b3abaa0b3ff0" (UID: "32f7f790-9e5b-4052-a87d-b3abaa0b3ff0"). InnerVolumeSpecName "vencrypt-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.221594 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4306304f-eaea-49a1-9e62-9b035dc302de-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "4306304f-eaea-49a1-9e62-9b035dc302de" (UID: "4306304f-eaea-49a1-9e62-9b035dc302de"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.256190 5120 reconciler_common.go:299] "Volume detached for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/32f7f790-9e5b-4052-a87d-b3abaa0b3ff0-vencrypt-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.256430 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/4306304f-eaea-49a1-9e62-9b035dc302de-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.256440 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d6f8b8b2-e94a-4c67-9e6d-be16e2acbdcc-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.256450 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d51d8732-80e3-463b-b8b0-714f8a2d281f-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.313500 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8821dbd3-25f2-44ea-8a41-e716db08960a-ceilometer-tls-certs" (OuterVolumeSpecName: "ceilometer-tls-certs") pod "8821dbd3-25f2-44ea-8a41-e716db08960a" (UID: "8821dbd3-25f2-44ea-8a41-e716db08960a"). InnerVolumeSpecName "ceilometer-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.325026 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6734794-135c-4f4b-83b6-c64788f83f91-config-data" (OuterVolumeSpecName: "config-data") pod "d6734794-135c-4f4b-83b6-c64788f83f91" (UID: "d6734794-135c-4f4b-83b6-c64788f83f91"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.352421 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/14486849-fbb1-4cc9-8aa3-714e263c55fb-galera-tls-certs" (OuterVolumeSpecName: "galera-tls-certs") pod "14486849-fbb1-4cc9-8aa3-714e263c55fb" (UID: "14486849-fbb1-4cc9-8aa3-714e263c55fb"). InnerVolumeSpecName "galera-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.352677 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d51d8732-80e3-463b-b8b0-714f8a2d281f-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "d51d8732-80e3-463b-b8b0-714f8a2d281f" (UID: "d51d8732-80e3-463b-b8b0-714f8a2d281f"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.356328 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6734794-135c-4f4b-83b6-c64788f83f91-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "d6734794-135c-4f4b-83b6-c64788f83f91" (UID: "d6734794-135c-4f4b-83b6-c64788f83f91"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.357827 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/32f7f790-9e5b-4052-a87d-b3abaa0b3ff0-config-data" (OuterVolumeSpecName: "config-data") pod "32f7f790-9e5b-4052-a87d-b3abaa0b3ff0" (UID: "32f7f790-9e5b-4052-a87d-b3abaa0b3ff0"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.359957 5120 reconciler_common.go:299] "Volume detached for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/8821dbd3-25f2-44ea-8a41-e716db08960a-ceilometer-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.359986 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d6734794-135c-4f4b-83b6-c64788f83f91-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.359996 5120 reconciler_common.go:299] "Volume detached for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/14486849-fbb1-4cc9-8aa3-714e263c55fb-galera-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.360006 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d51d8732-80e3-463b-b8b0-714f8a2d281f-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.360017 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d6734794-135c-4f4b-83b6-c64788f83f91-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.360027 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/32f7f790-9e5b-4052-a87d-b3abaa0b3ff0-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.411463 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4306304f-eaea-49a1-9e62-9b035dc302de-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "4306304f-eaea-49a1-9e62-9b035dc302de" (UID: "4306304f-eaea-49a1-9e62-9b035dc302de"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.415013 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage09-crc" (UniqueName: "kubernetes.io/local-volume/local-storage09-crc") on node "crc" Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.419083 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae15ab63-33c1-4085-809f-5b1b4086b95b-kube-state-metrics-tls-config" (OuterVolumeSpecName: "kube-state-metrics-tls-config") pod "ae15ab63-33c1-4085-809f-5b1b4086b95b" (UID: "ae15ab63-33c1-4085-809f-5b1b4086b95b"). InnerVolumeSpecName "kube-state-metrics-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.429127 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d66ce1a-7d4c-4e04-92c9-f86d5ad81fcc-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "8d66ce1a-7d4c-4e04-92c9-f86d5ad81fcc" (UID: "8d66ce1a-7d4c-4e04-92c9-f86d5ad81fcc"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.435543 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f641d93-c3e7-40c3-8d96-d89b931d18cc-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "6f641d93-c3e7-40c3-8d96-d89b931d18cc" (UID: "6f641d93-c3e7-40c3-8d96-d89b931d18cc"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.454817 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/32f7f790-9e5b-4052-a87d-b3abaa0b3ff0-nova-novncproxy-tls-certs" (OuterVolumeSpecName: "nova-novncproxy-tls-certs") pod "32f7f790-9e5b-4052-a87d-b3abaa0b3ff0" (UID: "32f7f790-9e5b-4052-a87d-b3abaa0b3ff0"). InnerVolumeSpecName "nova-novncproxy-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.462621 5120 reconciler_common.go:299] "Volume detached for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/ae15ab63-33c1-4085-809f-5b1b4086b95b-kube-state-metrics-tls-config\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.462655 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8d66ce1a-7d4c-4e04-92c9-f86d5ad81fcc-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.462667 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4306304f-eaea-49a1-9e62-9b035dc302de-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.462676 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6f641d93-c3e7-40c3-8d96-d89b931d18cc-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.462685 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.462694 5120 reconciler_common.go:299] "Volume detached for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/32f7f790-9e5b-4052-a87d-b3abaa0b3ff0-nova-novncproxy-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.468520 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f641d93-c3e7-40c3-8d96-d89b931d18cc-config-data" (OuterVolumeSpecName: "config-data") pod "6f641d93-c3e7-40c3-8d96-d89b931d18cc" (UID: "6f641d93-c3e7-40c3-8d96-d89b931d18cc"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.469221 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8821dbd3-25f2-44ea-8a41-e716db08960a-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "8821dbd3-25f2-44ea-8a41-e716db08960a" (UID: "8821dbd3-25f2-44ea-8a41-e716db08960a"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.471867 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f641d93-c3e7-40c3-8d96-d89b931d18cc-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "6f641d93-c3e7-40c3-8d96-d89b931d18cc" (UID: "6f641d93-c3e7-40c3-8d96-d89b931d18cc"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.478406 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f641d93-c3e7-40c3-8d96-d89b931d18cc-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "6f641d93-c3e7-40c3-8d96-d89b931d18cc" (UID: "6f641d93-c3e7-40c3-8d96-d89b931d18cc"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.482563 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4306304f-eaea-49a1-9e62-9b035dc302de-config-data" (OuterVolumeSpecName: "config-data") pod "4306304f-eaea-49a1-9e62-9b035dc302de" (UID: "4306304f-eaea-49a1-9e62-9b035dc302de"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.484972 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae15ab63-33c1-4085-809f-5b1b4086b95b-kube-state-metrics-tls-certs" (OuterVolumeSpecName: "kube-state-metrics-tls-certs") pod "ae15ab63-33c1-4085-809f-5b1b4086b95b" (UID: "ae15ab63-33c1-4085-809f-5b1b4086b95b"). InnerVolumeSpecName "kube-state-metrics-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.502726 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/176eef56-bc30-4119-8af5-fa1329d63aa2-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "176eef56-bc30-4119-8af5-fa1329d63aa2" (UID: "176eef56-bc30-4119-8af5-fa1329d63aa2"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.506838 5120 scope.go:117] "RemoveContainer" containerID="c81a76400410e2a94d4a9a4471ca9bca3df111d1c0d2c832dcdc03fb0fca2ae5" Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.515949 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.519949 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/176eef56-bc30-4119-8af5-fa1329d63aa2-config-data" (OuterVolumeSpecName: "config-data") pod "176eef56-bc30-4119-8af5-fa1329d63aa2" (UID: "176eef56-bc30-4119-8af5-fa1329d63aa2"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.520934 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d66ce1a-7d4c-4e04-92c9-f86d5ad81fcc-config-data" (OuterVolumeSpecName: "config-data") pod "8d66ce1a-7d4c-4e04-92c9-f86d5ad81fcc" (UID: "8d66ce1a-7d4c-4e04-92c9-f86d5ad81fcc"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.520956 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4306304f-eaea-49a1-9e62-9b035dc302de-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "4306304f-eaea-49a1-9e62-9b035dc302de" (UID: "4306304f-eaea-49a1-9e62-9b035dc302de"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.523683 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6f8b8b2-e94a-4c67-9e6d-be16e2acbdcc-openstack-config-secret" (OuterVolumeSpecName: "openstack-config-secret") pod "d6f8b8b2-e94a-4c67-9e6d-be16e2acbdcc" (UID: "d6f8b8b2-e94a-4c67-9e6d-be16e2acbdcc"). InnerVolumeSpecName "openstack-config-secret". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.534950 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d51d8732-80e3-463b-b8b0-714f8a2d281f-nova-metadata-tls-certs" (OuterVolumeSpecName: "nova-metadata-tls-certs") pod "d51d8732-80e3-463b-b8b0-714f8a2d281f" (UID: "d51d8732-80e3-463b-b8b0-714f8a2d281f"). InnerVolumeSpecName "nova-metadata-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.536746 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-3f2f-account-create-update-rfgcb"] Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.536898 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-746gq"] Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.536987 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-776d498b58-sb5f8"] Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.537195 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-7bd99f4458-mgw7m"] Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.537272 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-a347-account-create-update-89khd"] Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.537337 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-9b99-account-create-update-djffv"] Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.537418 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-0a49-account-create-update-fqp48"] Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.537496 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-6646594584-l84r5"] Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.537612 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.537790 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-dd94-account-create-update-l69rr"] Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.537879 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-a8cd-account-create-update-nbt76"] Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.552236 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.552940 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.570004 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/4306304f-eaea-49a1-9e62-9b035dc302de-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.570030 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6f641d93-c3e7-40c3-8d96-d89b931d18cc-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.570040 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4306304f-eaea-49a1-9e62-9b035dc302de-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.570048 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/176eef56-bc30-4119-8af5-fa1329d63aa2-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.570056 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6f641d93-c3e7-40c3-8d96-d89b931d18cc-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.570065 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8d66ce1a-7d4c-4e04-92c9-f86d5ad81fcc-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.570072 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/8821dbd3-25f2-44ea-8a41-e716db08960a-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.570080 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6f641d93-c3e7-40c3-8d96-d89b931d18cc-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.570088 5120 reconciler_common.go:299] "Volume detached for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/d6f8b8b2-e94a-4c67-9e6d-be16e2acbdcc-openstack-config-secret\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.570098 5120 reconciler_common.go:299] "Volume detached for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/ae15ab63-33c1-4085-809f-5b1b4086b95b-kube-state-metrics-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.570107 5120 reconciler_common.go:299] "Volume detached for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/d51d8732-80e3-463b-b8b0-714f8a2d281f-nova-metadata-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.570115 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/176eef56-bc30-4119-8af5-fa1329d63aa2-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.570547 5120 scope.go:117] "RemoveContainer" containerID="dd00c43884637f26ac704813dd8249e89882ce975df6ce57039509ecaf37e98d" Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.572268 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.582151 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6734794-135c-4f4b-83b6-c64788f83f91-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "d6734794-135c-4f4b-83b6-c64788f83f91" (UID: "d6734794-135c-4f4b-83b6-c64788f83f91"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.585033 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/176eef56-bc30-4119-8af5-fa1329d63aa2-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "176eef56-bc30-4119-8af5-fa1329d63aa2" (UID: "176eef56-bc30-4119-8af5-fa1329d63aa2"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.591277 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.597075 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.598980 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8821dbd3-25f2-44ea-8a41-e716db08960a-config-data" (OuterVolumeSpecName: "config-data") pod "8821dbd3-25f2-44ea-8a41-e716db08960a" (UID: "8821dbd3-25f2-44ea-8a41-e716db08960a"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.605843 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-xvqbz"] Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.616958 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8821dbd3-25f2-44ea-8a41-e716db08960a-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "8821dbd3-25f2-44ea-8a41-e716db08960a" (UID: "8821dbd3-25f2-44ea-8a41-e716db08960a"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.639156 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" podUID="36a1c719-e302-4df3-99c5-5025d99c8c19" containerName="rabbitmq" containerID="cri-o://37ba1a2f076b719c766f791299c9142e02bcefab3e8f0c9206394edcdfa4ce9b" gracePeriod=604800 Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.670539 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/1b5c827b-214c-452d-bd57-dc21f970d7a4-openstack-config-secret\") pod \"1b5c827b-214c-452d-bd57-dc21f970d7a4\" (UID: \"1b5c827b-214c-452d-bd57-dc21f970d7a4\") " Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.670746 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1b5c827b-214c-452d-bd57-dc21f970d7a4-combined-ca-bundle\") pod \"1b5c827b-214c-452d-bd57-dc21f970d7a4\" (UID: \"1b5c827b-214c-452d-bd57-dc21f970d7a4\") " Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.670904 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kchr8\" (UniqueName: \"kubernetes.io/projected/1b5c827b-214c-452d-bd57-dc21f970d7a4-kube-api-access-kchr8\") pod \"1b5c827b-214c-452d-bd57-dc21f970d7a4\" (UID: \"1b5c827b-214c-452d-bd57-dc21f970d7a4\") " Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.670982 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/1b5c827b-214c-452d-bd57-dc21f970d7a4-openstack-config\") pod \"1b5c827b-214c-452d-bd57-dc21f970d7a4\" (UID: \"1b5c827b-214c-452d-bd57-dc21f970d7a4\") " Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.675041 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8821dbd3-25f2-44ea-8a41-e716db08960a-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.675074 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8821dbd3-25f2-44ea-8a41-e716db08960a-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.675089 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/d6734794-135c-4f4b-83b6-c64788f83f91-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.675103 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/176eef56-bc30-4119-8af5-fa1329d63aa2-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.675240 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1b5c827b-214c-452d-bd57-dc21f970d7a4-openstack-config" (OuterVolumeSpecName: "openstack-config") pod "1b5c827b-214c-452d-bd57-dc21f970d7a4" (UID: "1b5c827b-214c-452d-bd57-dc21f970d7a4"). InnerVolumeSpecName "openstack-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.679025 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1b5c827b-214c-452d-bd57-dc21f970d7a4-openstack-config-secret" (OuterVolumeSpecName: "openstack-config-secret") pod "1b5c827b-214c-452d-bd57-dc21f970d7a4" (UID: "1b5c827b-214c-452d-bd57-dc21f970d7a4"). InnerVolumeSpecName "openstack-config-secret". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.680341 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b5c827b-214c-452d-bd57-dc21f970d7a4-kube-api-access-kchr8" (OuterVolumeSpecName: "kube-api-access-kchr8") pod "1b5c827b-214c-452d-bd57-dc21f970d7a4" (UID: "1b5c827b-214c-452d-bd57-dc21f970d7a4"). InnerVolumeSpecName "kube-api-access-kchr8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.683462 5120 generic.go:358] "Generic (PLEG): container finished" podID="ac88284a-2f9f-4e52-8de4-1c299b94bbd1" containerID="3384af102f5e21af38f70357dde5423094a7b97015a788c7ce82b5c8ddf617b2" exitCode=0 Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.683546 5120 generic.go:358] "Generic (PLEG): container finished" podID="ac88284a-2f9f-4e52-8de4-1c299b94bbd1" containerID="9e3ca77b7dc91937211be72bb388d6e800aa4ca62b560a55eb833bbf6b8c4ddb" exitCode=0 Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.683652 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-59c794978b-lzrxq" event={"ID":"ac88284a-2f9f-4e52-8de4-1c299b94bbd1","Type":"ContainerDied","Data":"3384af102f5e21af38f70357dde5423094a7b97015a788c7ce82b5c8ddf617b2"} Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.683790 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-59c794978b-lzrxq" event={"ID":"ac88284a-2f9f-4e52-8de4-1c299b94bbd1","Type":"ContainerDied","Data":"9e3ca77b7dc91937211be72bb388d6e800aa4ca62b560a55eb833bbf6b8c4ddb"} Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.683866 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-59c794978b-lzrxq" event={"ID":"ac88284a-2f9f-4e52-8de4-1c299b94bbd1","Type":"ContainerDied","Data":"e82a56e1024fd06cdc37863b4890f0bff6357929c7b2f4c8e0e2bfa657add9be"} Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.683947 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e82a56e1024fd06cdc37863b4890f0bff6357929c7b2f4c8e0e2bfa657add9be" Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.684112 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1b5c827b-214c-452d-bd57-dc21f970d7a4-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "1b5c827b-214c-452d-bd57-dc21f970d7a4" (UID: "1b5c827b-214c-452d-bd57-dc21f970d7a4"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.684879 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-746gq" event={"ID":"19be266e-6805-4342-be0d-7fff0fc81029","Type":"ContainerStarted","Data":"ca389d3317d0f04ba1a92686a955d0cfa4fa41b46a2a593366e2332adff9be2f"} Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.698615 5120 generic.go:358] "Generic (PLEG): container finished" podID="18ef8c0b-e810-48c1-b5a5-43584c591dfa" containerID="bcd37f54cbc166ff52b822355e3dffd9da249e43d42116ecf6339e6a81422bbe" exitCode=143 Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.698717 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-69c8889b9f-sfbxd" event={"ID":"18ef8c0b-e810-48c1-b5a5-43584c591dfa","Type":"ContainerDied","Data":"bcd37f54cbc166ff52b822355e3dffd9da249e43d42116ecf6339e6a81422bbe"} Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.702930 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-0a49-account-create-update-fqp48" event={"ID":"687a8fb9-59e3-46c6-bdb9-f435b5cb52d9","Type":"ContainerStarted","Data":"cf7e3407b76666054ac42fc9b4d91b1e7c45d6868297d5342f0c1592bdf588d9"} Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.724206 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-dd94-account-create-update-l69rr" event={"ID":"afa004e7-041e-4f04-8864-7163df19cf53","Type":"ContainerStarted","Data":"649a631f7cb0b7208be2261907fec14dd00e5721d67d5ecb9d4f6aa932db61f5"} Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.777407 5120 reconciler_common.go:299] "Volume detached for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/1b5c827b-214c-452d-bd57-dc21f970d7a4-openstack-config-secret\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:59 crc kubenswrapper[5120]: E0316 15:53:59.777915 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.782135 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1b5c827b-214c-452d-bd57-dc21f970d7a4-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:59 crc kubenswrapper[5120]: E0316 15:53:59.782237 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/36a1c719-e302-4df3-99c5-5025d99c8c19-config-data podName:36a1c719-e302-4df3-99c5-5025d99c8c19 nodeName:}" failed. No retries permitted until 2026-03-16 15:54:01.782218846 +0000 UTC m=+1343.936150503 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/36a1c719-e302-4df3-99c5-5025d99c8c19-config-data") pod "rabbitmq-cell1-server-0" (UID: "36a1c719-e302-4df3-99c5-5025d99c8c19") : configmap "rabbitmq-cell1-config-data" not found Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.782606 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kchr8\" (UniqueName: \"kubernetes.io/projected/1b5c827b-214c-452d-bd57-dc21f970d7a4-kube-api-access-kchr8\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.782624 5120 reconciler_common.go:299] "Volume detached for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/1b5c827b-214c-452d-bd57-dc21f970d7a4-openstack-config\") on node \"crc\" DevicePath \"\"" Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.786343 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-9b99-account-create-update-djffv" event={"ID":"89c20c31-44e2-4359-b7ee-e2e8b00b4e19","Type":"ContainerStarted","Data":"0b47030b188cc609de78cb9a2c4493898fb69ce9fbd5993d90aaad436d9b0a08"} Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.807672 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-a8cd-account-create-update-nbt76" event={"ID":"0c87b06f-6b7e-46f2-8aee-34285fea622e","Type":"ContainerStarted","Data":"4d14eaa9edf61b256d908b2501c5fbc3f5bef0229bb994bd436200730af72a59"} Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.833386 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-776d498b58-sb5f8" event={"ID":"2218d5be-dd10-4e4b-87b9-d9a5273bd197","Type":"ContainerStarted","Data":"eb4746f5c8a26981859798e4d1b795ca3ff05375601e4028f34f54ffc77cb5f0"} Mar 16 15:53:59 crc kubenswrapper[5120]: E0316 15:53:59.842656 5120 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5888de0f_5da8_4605_aa27_db134fd47b31.slice/crio-dbbb38ae0016789737cfd4bef731bde626c1fb8fca9c642259fe0f87e177b959\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod14486849_fbb1_4cc9_8aa3_714e263c55fb.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5888de0f_5da8_4605_aa27_db134fd47b31.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod14486849_fbb1_4cc9_8aa3_714e263c55fb.slice/crio-67b6cc78be5822ca9fa08b0e577299a67bea362b9914d26f394d0aea31ccd13a\": RecentStats: unable to find data in memory cache]" Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.876676 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"d6734794-135c-4f4b-83b6-c64788f83f91","Type":"ContainerDied","Data":"dd67c67cfb663dd796ab5e645216b4d8b8f803a6a97b11efac0281575ea7b4be"} Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.876840 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.887025 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7jg96\" (UniqueName: \"kubernetes.io/projected/5e604554-8190-4098-a61e-3568489988d0-kube-api-access-7jg96\") pod \"keystone-236f-account-create-update-8gdw9\" (UID: \"5e604554-8190-4098-a61e-3568489988d0\") " pod="openstack-kuttl-tests/keystone-236f-account-create-update-8gdw9" Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.887086 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5e604554-8190-4098-a61e-3568489988d0-operator-scripts\") pod \"keystone-236f-account-create-update-8gdw9\" (UID: \"5e604554-8190-4098-a61e-3568489988d0\") " pod="openstack-kuttl-tests/keystone-236f-account-create-update-8gdw9" Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.887136 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/7090862a-0953-4c04-91f3-a37e21671e86-kolla-config\") pod \"memcached-0\" (UID: \"7090862a-0953-4c04-91f3-a37e21671e86\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 15:53:59 crc kubenswrapper[5120]: E0316 15:53:59.887191 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Mar 16 15:53:59 crc kubenswrapper[5120]: E0316 15:53:59.887257 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/memcached-config-data: configmap "memcached-config-data" not found Mar 16 15:53:59 crc kubenswrapper[5120]: E0316 15:53:59.887282 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5e604554-8190-4098-a61e-3568489988d0-operator-scripts podName:5e604554-8190-4098-a61e-3568489988d0 nodeName:}" failed. No retries permitted until 2026-03-16 15:54:01.887265892 +0000 UTC m=+1344.041197549 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/5e604554-8190-4098-a61e-3568489988d0-operator-scripts") pod "keystone-236f-account-create-update-8gdw9" (UID: "5e604554-8190-4098-a61e-3568489988d0") : configmap "openstack-scripts" not found Mar 16 15:53:59 crc kubenswrapper[5120]: E0316 15:53:59.887311 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7090862a-0953-4c04-91f3-a37e21671e86-config-data podName:7090862a-0953-4c04-91f3-a37e21671e86 nodeName:}" failed. No retries permitted until 2026-03-16 15:54:01.887296953 +0000 UTC m=+1344.041228610 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/7090862a-0953-4c04-91f3-a37e21671e86-config-data") pod "memcached-0" (UID: "7090862a-0953-4c04-91f3-a37e21671e86") : configmap "memcached-config-data" not found Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.887203 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/7090862a-0953-4c04-91f3-a37e21671e86-config-data\") pod \"memcached-0\" (UID: \"7090862a-0953-4c04-91f3-a37e21671e86\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.887485 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/7090862a-0953-4c04-91f3-a37e21671e86-memcached-tls-certs\") pod \"memcached-0\" (UID: \"7090862a-0953-4c04-91f3-a37e21671e86\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.887547 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7090862a-0953-4c04-91f3-a37e21671e86-combined-ca-bundle\") pod \"memcached-0\" (UID: \"7090862a-0953-4c04-91f3-a37e21671e86\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 15:53:59 crc kubenswrapper[5120]: E0316 15:53:59.887337 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/memcached-config-data: configmap "memcached-config-data" not found Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.887624 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xh9rt\" (UniqueName: \"kubernetes.io/projected/7090862a-0953-4c04-91f3-a37e21671e86-kube-api-access-xh9rt\") pod \"memcached-0\" (UID: \"7090862a-0953-4c04-91f3-a37e21671e86\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 15:53:59 crc kubenswrapper[5120]: E0316 15:53:59.887641 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7090862a-0953-4c04-91f3-a37e21671e86-kolla-config podName:7090862a-0953-4c04-91f3-a37e21671e86 nodeName:}" failed. No retries permitted until 2026-03-16 15:54:01.887632293 +0000 UTC m=+1344.041563950 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kolla-config" (UniqueName: "kubernetes.io/configmap/7090862a-0953-4c04-91f3-a37e21671e86-kolla-config") pod "memcached-0" (UID: "7090862a-0953-4c04-91f3-a37e21671e86") : configmap "memcached-config-data" not found Mar 16 15:53:59 crc kubenswrapper[5120]: E0316 15:53:59.887858 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-memcached-svc: secret "cert-memcached-svc" not found Mar 16 15:53:59 crc kubenswrapper[5120]: E0316 15:53:59.887904 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7090862a-0953-4c04-91f3-a37e21671e86-memcached-tls-certs podName:7090862a-0953-4c04-91f3-a37e21671e86 nodeName:}" failed. No retries permitted until 2026-03-16 15:54:01.88789035 +0000 UTC m=+1344.041822007 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "memcached-tls-certs" (UniqueName: "kubernetes.io/secret/7090862a-0953-4c04-91f3-a37e21671e86-memcached-tls-certs") pod "memcached-0" (UID: "7090862a-0953-4c04-91f3-a37e21671e86") : secret "cert-memcached-svc" not found Mar 16 15:53:59 crc kubenswrapper[5120]: E0316 15:53:59.887934 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 15:53:59 crc kubenswrapper[5120]: E0316 15:53:59.887956 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7090862a-0953-4c04-91f3-a37e21671e86-combined-ca-bundle podName:7090862a-0953-4c04-91f3-a37e21671e86 nodeName:}" failed. No retries permitted until 2026-03-16 15:54:01.887950502 +0000 UTC m=+1344.041882159 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/7090862a-0953-4c04-91f3-a37e21671e86-combined-ca-bundle") pod "memcached-0" (UID: "7090862a-0953-4c04-91f3-a37e21671e86") : secret "combined-ca-bundle" not found Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.889161 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-xvqbz" event={"ID":"51478cb6-9192-494b-a293-b5cc54cfa9a3","Type":"ContainerStarted","Data":"526b1de0b165b3f4d46f6b4ebd7c3a2d423d04290010b930ec2916926dcb53a0"} Mar 16 15:53:59 crc kubenswrapper[5120]: E0316 15:53:59.894022 5120 projected.go:194] Error preparing data for projected volume kube-api-access-xh9rt for pod openstack-kuttl-tests/memcached-0: failed to fetch token: serviceaccounts "memcached-memcached" not found Mar 16 15:53:59 crc kubenswrapper[5120]: E0316 15:53:59.894227 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7090862a-0953-4c04-91f3-a37e21671e86-kube-api-access-xh9rt podName:7090862a-0953-4c04-91f3-a37e21671e86 nodeName:}" failed. No retries permitted until 2026-03-16 15:54:01.894057011 +0000 UTC m=+1344.047988668 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-xh9rt" (UniqueName: "kubernetes.io/projected/7090862a-0953-4c04-91f3-a37e21671e86-kube-api-access-xh9rt") pod "memcached-0" (UID: "7090862a-0953-4c04-91f3-a37e21671e86") : failed to fetch token: serviceaccounts "memcached-memcached" not found Mar 16 15:53:59 crc kubenswrapper[5120]: E0316 15:53:59.894327 5120 projected.go:194] Error preparing data for projected volume kube-api-access-7jg96 for pod openstack-kuttl-tests/keystone-236f-account-create-update-8gdw9: failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 15:53:59 crc kubenswrapper[5120]: E0316 15:53:59.894653 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5e604554-8190-4098-a61e-3568489988d0-kube-api-access-7jg96 podName:5e604554-8190-4098-a61e-3568489988d0 nodeName:}" failed. No retries permitted until 2026-03-16 15:54:01.894641137 +0000 UTC m=+1344.048572794 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-7jg96" (UniqueName: "kubernetes.io/projected/5e604554-8190-4098-a61e-3568489988d0-kube-api-access-7jg96") pod "keystone-236f-account-create-update-8gdw9" (UID: "5e604554-8190-4098-a61e-3568489988d0") : failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.905960 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-a347-account-create-update-89khd" event={"ID":"3af1f773-b662-412f-820d-bea6ba7e58ca","Type":"ContainerStarted","Data":"3eb2ae9f1a31e93a3433346247c49bc597561f1904b93f7c1b49c00ba72f16ea"} Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.911620 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/memcached-0" podUID="90534d56-28ff-4983-b8ea-be83259ce64d" containerName="memcached" probeResult="failure" output="dial tcp 10.217.0.108:11211: i/o timeout" Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.922490 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"176eef56-bc30-4119-8af5-fa1329d63aa2","Type":"ContainerDied","Data":"94ba812ca937ebb9ed509edfea340d66f9ec5dca16f4d576188e7e4f8b2d1598"} Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.922780 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.933999 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-3f2f-account-create-update-rfgcb" event={"ID":"2f3efc59-f473-4fd6-acc0-ce261268d63b","Type":"ContainerStarted","Data":"9bde23a2111ad98a9d7a27e5dc060ae538bd48423a38de4f11e25d2e59e326b6"} Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.951602 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-766fb557cd-fwt4z" event={"ID":"26a03664-6cb3-4982-80f5-063d8f12cc2a","Type":"ContainerStarted","Data":"b4be06dc3760c0f772a705af0e0fca11910d8d85c190b7e9987da3a11afdde37"} Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.955447 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"c95ad7ed-1944-4285-9138-0d4b954aa727","Type":"ContainerDied","Data":"0791fd8d2f627e49ecf936921dadd0893d1de3fc774a289889bce63ea4bbcdf8"} Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.955584 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0791fd8d2f627e49ecf936921dadd0893d1de3fc774a289889bce63ea4bbcdf8" Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.976494 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-6646594584-l84r5" event={"ID":"952aeeb8-cdc4-469f-b50b-e5d640adc994","Type":"ContainerStarted","Data":"c610473fa6c0cb2bdada21957b858ef6b9481b70eaf99e1621a211814ef1b9d2"} Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.991945 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"8821dbd3-25f2-44ea-8a41-e716db08960a","Type":"ContainerDied","Data":"ca834119cebad66de811752202fe0279a13858cdf62952538bf1a4bb923ee1d2"} Mar 16 15:53:59 crc kubenswrapper[5120]: I0316 15:53:59.992067 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.000846 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.000884 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-7bd99f4458-mgw7m" event={"ID":"5a0edbf7-738f-4c1a-9333-f23da8ab8067","Type":"ContainerStarted","Data":"0883d28d38b241d5e263552e576ccbe58be927885b22511e24a56fd770aefbe1"} Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.001031 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-236f-account-create-update-8gdw9" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.001166 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.007046 5120 status_manager.go:895] "Failed to get status for pod" podUID="1b5c827b-214c-452d-bd57-dc21f970d7a4" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.009830 5120 status_manager.go:895] "Failed to get status for pod" podUID="1b5c827b-214c-452d-bd57-dc21f970d7a4" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.041220 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.042883 5120 status_manager.go:895] "Failed to get status for pod" podUID="1b5c827b-214c-452d-bd57-dc21f970d7a4" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.059562 5120 scope.go:117] "RemoveContainer" containerID="f537fe622a6860ac31c69fb493d6675ef968e5c012ab0f4860e1583cc23a4e1b" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.092456 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/c95ad7ed-1944-4285-9138-0d4b954aa727-kolla-config\") pod \"c95ad7ed-1944-4285-9138-0d4b954aa727\" (UID: \"c95ad7ed-1944-4285-9138-0d4b954aa727\") " Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.092501 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/c95ad7ed-1944-4285-9138-0d4b954aa727-galera-tls-certs\") pod \"c95ad7ed-1944-4285-9138-0d4b954aa727\" (UID: \"c95ad7ed-1944-4285-9138-0d4b954aa727\") " Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.092540 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c95ad7ed-1944-4285-9138-0d4b954aa727-operator-scripts\") pod \"c95ad7ed-1944-4285-9138-0d4b954aa727\" (UID: \"c95ad7ed-1944-4285-9138-0d4b954aa727\") " Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.092587 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"mysql-db\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"c95ad7ed-1944-4285-9138-0d4b954aa727\" (UID: \"c95ad7ed-1944-4285-9138-0d4b954aa727\") " Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.092638 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/c95ad7ed-1944-4285-9138-0d4b954aa727-config-data-generated\") pod \"c95ad7ed-1944-4285-9138-0d4b954aa727\" (UID: \"c95ad7ed-1944-4285-9138-0d4b954aa727\") " Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.092665 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zsjnj\" (UniqueName: \"kubernetes.io/projected/c95ad7ed-1944-4285-9138-0d4b954aa727-kube-api-access-zsjnj\") pod \"c95ad7ed-1944-4285-9138-0d4b954aa727\" (UID: \"c95ad7ed-1944-4285-9138-0d4b954aa727\") " Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.092770 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c95ad7ed-1944-4285-9138-0d4b954aa727-combined-ca-bundle\") pod \"c95ad7ed-1944-4285-9138-0d4b954aa727\" (UID: \"c95ad7ed-1944-4285-9138-0d4b954aa727\") " Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.092808 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/c95ad7ed-1944-4285-9138-0d4b954aa727-config-data-default\") pod \"c95ad7ed-1944-4285-9138-0d4b954aa727\" (UID: \"c95ad7ed-1944-4285-9138-0d4b954aa727\") " Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.094191 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c95ad7ed-1944-4285-9138-0d4b954aa727-config-data-generated" (OuterVolumeSpecName: "config-data-generated") pod "c95ad7ed-1944-4285-9138-0d4b954aa727" (UID: "c95ad7ed-1944-4285-9138-0d4b954aa727"). InnerVolumeSpecName "config-data-generated". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.094486 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c95ad7ed-1944-4285-9138-0d4b954aa727-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "c95ad7ed-1944-4285-9138-0d4b954aa727" (UID: "c95ad7ed-1944-4285-9138-0d4b954aa727"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.094599 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c95ad7ed-1944-4285-9138-0d4b954aa727-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "c95ad7ed-1944-4285-9138-0d4b954aa727" (UID: "c95ad7ed-1944-4285-9138-0d4b954aa727"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.098157 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c95ad7ed-1944-4285-9138-0d4b954aa727-kube-api-access-zsjnj" (OuterVolumeSpecName: "kube-api-access-zsjnj") pod "c95ad7ed-1944-4285-9138-0d4b954aa727" (UID: "c95ad7ed-1944-4285-9138-0d4b954aa727"). InnerVolumeSpecName "kube-api-access-zsjnj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.101591 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c95ad7ed-1944-4285-9138-0d4b954aa727-config-data-default" (OuterVolumeSpecName: "config-data-default") pod "c95ad7ed-1944-4285-9138-0d4b954aa727" (UID: "c95ad7ed-1944-4285-9138-0d4b954aa727"). InnerVolumeSpecName "config-data-default". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.103986 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage04-crc" (OuterVolumeSpecName: "mysql-db") pod "c95ad7ed-1944-4285-9138-0d4b954aa727" (UID: "c95ad7ed-1944-4285-9138-0d4b954aa727"). InnerVolumeSpecName "local-storage04-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.117222 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-59c794978b-lzrxq" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.124184 5120 status_manager.go:895] "Failed to get status for pod" podUID="1b5c827b-214c-452d-bd57-dc21f970d7a4" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.124249 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-236f-account-create-update-8gdw9" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.132946 5120 scope.go:117] "RemoveContainer" containerID="98e806b8d757df5c6012a1ab4db4964a7dc1f33eff452a1bc8ca796b05a78430" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.142538 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-infra/auto-csr-approver-29561274-v5q72"] Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.143589 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c95ad7ed-1944-4285-9138-0d4b954aa727" containerName="galera" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.143604 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c95ad7ed-1944-4285-9138-0d4b954aa727" containerName="galera" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.143613 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d51d8732-80e3-463b-b8b0-714f8a2d281f" containerName="nova-metadata-log" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.143619 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="d51d8732-80e3-463b-b8b0-714f8a2d281f" containerName="nova-metadata-log" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.143629 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac88284a-2f9f-4e52-8de4-1c299b94bbd1" containerName="proxy-server" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.143635 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac88284a-2f9f-4e52-8de4-1c299b94bbd1" containerName="proxy-server" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.143647 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8821dbd3-25f2-44ea-8a41-e716db08960a" containerName="sg-core" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.143652 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8821dbd3-25f2-44ea-8a41-e716db08960a" containerName="sg-core" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.143660 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4306304f-eaea-49a1-9e62-9b035dc302de" containerName="cinder-api-log" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.143665 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="4306304f-eaea-49a1-9e62-9b035dc302de" containerName="cinder-api-log" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.143672 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6734794-135c-4f4b-83b6-c64788f83f91" containerName="glance-log" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.143677 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6734794-135c-4f4b-83b6-c64788f83f91" containerName="glance-log" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.143689 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d51d8732-80e3-463b-b8b0-714f8a2d281f" containerName="nova-metadata-metadata" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.143694 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="d51d8732-80e3-463b-b8b0-714f8a2d281f" containerName="nova-metadata-metadata" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.143702 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d66ce1a-7d4c-4e04-92c9-f86d5ad81fcc" containerName="cinder-scheduler" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.143708 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d66ce1a-7d4c-4e04-92c9-f86d5ad81fcc" containerName="cinder-scheduler" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.143718 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d66ce1a-7d4c-4e04-92c9-f86d5ad81fcc" containerName="probe" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.143723 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d66ce1a-7d4c-4e04-92c9-f86d5ad81fcc" containerName="probe" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.143731 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f641d93-c3e7-40c3-8d96-d89b931d18cc" containerName="nova-api-api" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.143736 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f641d93-c3e7-40c3-8d96-d89b931d18cc" containerName="nova-api-api" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.143746 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac88284a-2f9f-4e52-8de4-1c299b94bbd1" containerName="proxy-httpd" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.143751 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac88284a-2f9f-4e52-8de4-1c299b94bbd1" containerName="proxy-httpd" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.143991 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="176eef56-bc30-4119-8af5-fa1329d63aa2" containerName="glance-log" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.144000 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="176eef56-bc30-4119-8af5-fa1329d63aa2" containerName="glance-log" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.144006 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="176eef56-bc30-4119-8af5-fa1329d63aa2" containerName="glance-httpd" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.144012 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="176eef56-bc30-4119-8af5-fa1329d63aa2" containerName="glance-httpd" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.144019 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae15ab63-33c1-4085-809f-5b1b4086b95b" containerName="kube-state-metrics" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.144024 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae15ab63-33c1-4085-809f-5b1b4086b95b" containerName="kube-state-metrics" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.144034 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8821dbd3-25f2-44ea-8a41-e716db08960a" containerName="proxy-httpd" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.144039 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8821dbd3-25f2-44ea-8a41-e716db08960a" containerName="proxy-httpd" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.144051 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32f7f790-9e5b-4052-a87d-b3abaa0b3ff0" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.144057 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="32f7f790-9e5b-4052-a87d-b3abaa0b3ff0" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.144066 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8821dbd3-25f2-44ea-8a41-e716db08960a" containerName="ceilometer-central-agent" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.144071 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8821dbd3-25f2-44ea-8a41-e716db08960a" containerName="ceilometer-central-agent" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.144085 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5888de0f-5da8-4605-aa27-db134fd47b31" containerName="nova-cell0-conductor-conductor" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.144091 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="5888de0f-5da8-4605-aa27-db134fd47b31" containerName="nova-cell0-conductor-conductor" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.144098 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14486849-fbb1-4cc9-8aa3-714e263c55fb" containerName="galera" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.144104 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="14486849-fbb1-4cc9-8aa3-714e263c55fb" containerName="galera" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.144114 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14486849-fbb1-4cc9-8aa3-714e263c55fb" containerName="mysql-bootstrap" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.144121 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="14486849-fbb1-4cc9-8aa3-714e263c55fb" containerName="mysql-bootstrap" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.144129 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c95ad7ed-1944-4285-9138-0d4b954aa727" containerName="mysql-bootstrap" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.144135 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c95ad7ed-1944-4285-9138-0d4b954aa727" containerName="mysql-bootstrap" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.144148 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f641d93-c3e7-40c3-8d96-d89b931d18cc" containerName="nova-api-log" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.144154 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f641d93-c3e7-40c3-8d96-d89b931d18cc" containerName="nova-api-log" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.144161 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4306304f-eaea-49a1-9e62-9b035dc302de" containerName="cinder-api" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.144167 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="4306304f-eaea-49a1-9e62-9b035dc302de" containerName="cinder-api" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.144174 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8821dbd3-25f2-44ea-8a41-e716db08960a" containerName="ceilometer-notification-agent" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.144180 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8821dbd3-25f2-44ea-8a41-e716db08960a" containerName="ceilometer-notification-agent" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.144192 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6734794-135c-4f4b-83b6-c64788f83f91" containerName="glance-httpd" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.144198 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6734794-135c-4f4b-83b6-c64788f83f91" containerName="glance-httpd" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.144368 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="4306304f-eaea-49a1-9e62-9b035dc302de" containerName="cinder-api-log" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.144381 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="5888de0f-5da8-4605-aa27-db134fd47b31" containerName="nova-cell0-conductor-conductor" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.144392 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="d6734794-135c-4f4b-83b6-c64788f83f91" containerName="glance-log" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.144400 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="32f7f790-9e5b-4052-a87d-b3abaa0b3ff0" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.144407 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ac88284a-2f9f-4e52-8de4-1c299b94bbd1" containerName="proxy-httpd" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.144501 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="d6734794-135c-4f4b-83b6-c64788f83f91" containerName="glance-httpd" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.144513 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="d51d8732-80e3-463b-b8b0-714f8a2d281f" containerName="nova-metadata-log" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.144521 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="8d66ce1a-7d4c-4e04-92c9-f86d5ad81fcc" containerName="probe" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.144527 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ae15ab63-33c1-4085-809f-5b1b4086b95b" containerName="kube-state-metrics" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.144535 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="8821dbd3-25f2-44ea-8a41-e716db08960a" containerName="proxy-httpd" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.144543 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="6f641d93-c3e7-40c3-8d96-d89b931d18cc" containerName="nova-api-api" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.144551 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ac88284a-2f9f-4e52-8de4-1c299b94bbd1" containerName="proxy-server" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.144559 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="8821dbd3-25f2-44ea-8a41-e716db08960a" containerName="sg-core" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.144566 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="8821dbd3-25f2-44ea-8a41-e716db08960a" containerName="ceilometer-central-agent" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.144575 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="8821dbd3-25f2-44ea-8a41-e716db08960a" containerName="ceilometer-notification-agent" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.144586 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="14486849-fbb1-4cc9-8aa3-714e263c55fb" containerName="galera" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.144595 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="176eef56-bc30-4119-8af5-fa1329d63aa2" containerName="glance-log" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.144603 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="d51d8732-80e3-463b-b8b0-714f8a2d281f" containerName="nova-metadata-metadata" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.144611 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="4306304f-eaea-49a1-9e62-9b035dc302de" containerName="cinder-api" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.144618 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="176eef56-bc30-4119-8af5-fa1329d63aa2" containerName="glance-httpd" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.144712 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="6f641d93-c3e7-40c3-8d96-d89b931d18cc" containerName="nova-api-log" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.144722 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c95ad7ed-1944-4285-9138-0d4b954aa727" containerName="galera" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.144731 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="8d66ce1a-7d4c-4e04-92c9-f86d5ad81fcc" containerName="cinder-scheduler" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.148005 5120 status_manager.go:895] "Failed to get status for pod" podUID="1b5c827b-214c-452d-bd57-dc21f970d7a4" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.161494 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561274-v5q72"] Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.161650 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561274-v5q72" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.165732 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"openshift-service-ca.crt\"" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.165910 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"kube-root-ca.crt\"" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.166111 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-infra\"/\"csr-approver-sa-dockercfg-x2nsz\"" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.167822 5120 status_manager.go:895] "Failed to get status for pod" podUID="1b5c827b-214c-452d-bd57-dc21f970d7a4" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.182055 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-746gq" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.182328 5120 scope.go:117] "RemoveContainer" containerID="ef458ad073d82c2b8eea756d31ae0425cfc19313825ac6f80468606be451b4ff" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.183471 5120 status_manager.go:895] "Failed to get status for pod" podUID="1b5c827b-214c-452d-bd57-dc21f970d7a4" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.194345 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/ac88284a-2f9f-4e52-8de4-1c299b94bbd1-etc-swift\") pod \"ac88284a-2f9f-4e52-8de4-1c299b94bbd1\" (UID: \"ac88284a-2f9f-4e52-8de4-1c299b94bbd1\") " Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.194422 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q95gf\" (UniqueName: \"kubernetes.io/projected/ac88284a-2f9f-4e52-8de4-1c299b94bbd1-kube-api-access-q95gf\") pod \"ac88284a-2f9f-4e52-8de4-1c299b94bbd1\" (UID: \"ac88284a-2f9f-4e52-8de4-1c299b94bbd1\") " Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.196832 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ac88284a-2f9f-4e52-8de4-1c299b94bbd1-run-httpd\") pod \"ac88284a-2f9f-4e52-8de4-1c299b94bbd1\" (UID: \"ac88284a-2f9f-4e52-8de4-1c299b94bbd1\") " Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.196974 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ac88284a-2f9f-4e52-8de4-1c299b94bbd1-combined-ca-bundle\") pod \"ac88284a-2f9f-4e52-8de4-1c299b94bbd1\" (UID: \"ac88284a-2f9f-4e52-8de4-1c299b94bbd1\") " Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.197017 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/ac88284a-2f9f-4e52-8de4-1c299b94bbd1-internal-tls-certs\") pod \"ac88284a-2f9f-4e52-8de4-1c299b94bbd1\" (UID: \"ac88284a-2f9f-4e52-8de4-1c299b94bbd1\") " Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.197090 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ac88284a-2f9f-4e52-8de4-1c299b94bbd1-config-data\") pod \"ac88284a-2f9f-4e52-8de4-1c299b94bbd1\" (UID: \"ac88284a-2f9f-4e52-8de4-1c299b94bbd1\") " Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.197143 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ac88284a-2f9f-4e52-8de4-1c299b94bbd1-public-tls-certs\") pod \"ac88284a-2f9f-4e52-8de4-1c299b94bbd1\" (UID: \"ac88284a-2f9f-4e52-8de4-1c299b94bbd1\") " Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.197195 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ac88284a-2f9f-4e52-8de4-1c299b94bbd1-log-httpd\") pod \"ac88284a-2f9f-4e52-8de4-1c299b94bbd1\" (UID: \"ac88284a-2f9f-4e52-8de4-1c299b94bbd1\") " Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.197956 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ft6g4\" (UniqueName: \"kubernetes.io/projected/72052f6a-5423-426f-bdb0-9c9f0609fa34-kube-api-access-ft6g4\") pod \"auto-csr-approver-29561274-v5q72\" (UID: \"72052f6a-5423-426f-bdb0-9c9f0609fa34\") " pod="openshift-infra/auto-csr-approver-29561274-v5q72" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.198366 5120 reconciler_common.go:299] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/c95ad7ed-1944-4285-9138-0d4b954aa727-kolla-config\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.198381 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c95ad7ed-1944-4285-9138-0d4b954aa727-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.198639 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") on node \"crc\" " Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.198657 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/c95ad7ed-1944-4285-9138-0d4b954aa727-config-data-generated\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.198670 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zsjnj\" (UniqueName: \"kubernetes.io/projected/c95ad7ed-1944-4285-9138-0d4b954aa727-kube-api-access-zsjnj\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.198679 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/c95ad7ed-1944-4285-9138-0d4b954aa727-config-data-default\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.199224 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac88284a-2f9f-4e52-8de4-1c299b94bbd1-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "ac88284a-2f9f-4e52-8de4-1c299b94bbd1" (UID: "ac88284a-2f9f-4e52-8de4-1c299b94bbd1"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.199323 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac88284a-2f9f-4e52-8de4-1c299b94bbd1-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "ac88284a-2f9f-4e52-8de4-1c299b94bbd1" (UID: "ac88284a-2f9f-4e52-8de4-1c299b94bbd1"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.215744 5120 scope.go:117] "RemoveContainer" containerID="2b26dc531a1cf057478a38e2cb256c9931e49568a65df6c5751f0ab2d721a086" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.228927 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac88284a-2f9f-4e52-8de4-1c299b94bbd1-kube-api-access-q95gf" (OuterVolumeSpecName: "kube-api-access-q95gf") pod "ac88284a-2f9f-4e52-8de4-1c299b94bbd1" (UID: "ac88284a-2f9f-4e52-8de4-1c299b94bbd1"). InnerVolumeSpecName "kube-api-access-q95gf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.233408 5120 status_manager.go:895] "Failed to get status for pod" podUID="1b5c827b-214c-452d-bd57-dc21f970d7a4" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.246781 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac88284a-2f9f-4e52-8de4-1c299b94bbd1-etc-swift" (OuterVolumeSpecName: "etc-swift") pod "ac88284a-2f9f-4e52-8de4-1c299b94bbd1" (UID: "ac88284a-2f9f-4e52-8de4-1c299b94bbd1"). InnerVolumeSpecName "etc-swift". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.262156 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.268496 5120 scope.go:117] "RemoveContainer" containerID="3f7dde81452f0221434f72a3271f62d13dc8d444913ffecdd1876e8ea04f3e0d" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.273572 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.292710 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.298630 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.299233 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/19be266e-6805-4342-be0d-7fff0fc81029-operator-scripts\") pod \"19be266e-6805-4342-be0d-7fff0fc81029\" (UID: \"19be266e-6805-4342-be0d-7fff0fc81029\") " Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.299460 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hp482\" (UniqueName: \"kubernetes.io/projected/19be266e-6805-4342-be0d-7fff0fc81029-kube-api-access-hp482\") pod \"19be266e-6805-4342-be0d-7fff0fc81029\" (UID: \"19be266e-6805-4342-be0d-7fff0fc81029\") " Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.299950 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ft6g4\" (UniqueName: \"kubernetes.io/projected/72052f6a-5423-426f-bdb0-9c9f0609fa34-kube-api-access-ft6g4\") pod \"auto-csr-approver-29561274-v5q72\" (UID: \"72052f6a-5423-426f-bdb0-9c9f0609fa34\") " pod="openshift-infra/auto-csr-approver-29561274-v5q72" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.300091 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ac88284a-2f9f-4e52-8de4-1c299b94bbd1-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.300102 5120 reconciler_common.go:299] "Volume detached for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/ac88284a-2f9f-4e52-8de4-1c299b94bbd1-etc-swift\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.300110 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q95gf\" (UniqueName: \"kubernetes.io/projected/ac88284a-2f9f-4e52-8de4-1c299b94bbd1-kube-api-access-q95gf\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.300120 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ac88284a-2f9f-4e52-8de4-1c299b94bbd1-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.300109 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/19be266e-6805-4342-be0d-7fff0fc81029-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "19be266e-6805-4342-be0d-7fff0fc81029" (UID: "19be266e-6805-4342-be0d-7fff0fc81029"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.311226 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.324052 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.329008 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.332778 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-0a49-account-create-update-fqp48" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.336900 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.344008 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.351373 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.361514 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.376334 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.397844 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.397917 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.399451 5120 scope.go:117] "RemoveContainer" containerID="042e41e723df73b7e7f87e1bf90037fae0d3bd03bbc5432d058acb72b29f7255" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.403093 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p94gj\" (UniqueName: \"kubernetes.io/projected/687a8fb9-59e3-46c6-bdb9-f435b5cb52d9-kube-api-access-p94gj\") pod \"687a8fb9-59e3-46c6-bdb9-f435b5cb52d9\" (UID: \"687a8fb9-59e3-46c6-bdb9-f435b5cb52d9\") " Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.403451 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/687a8fb9-59e3-46c6-bdb9-f435b5cb52d9-operator-scripts\") pod \"687a8fb9-59e3-46c6-bdb9-f435b5cb52d9\" (UID: \"687a8fb9-59e3-46c6-bdb9-f435b5cb52d9\") " Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.403855 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7090862a-0953-4c04-91f3-a37e21671e86-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.403870 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/19be266e-6805-4342-be0d-7fff0fc81029-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.403881 5120 reconciler_common.go:299] "Volume detached for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/7090862a-0953-4c04-91f3-a37e21671e86-memcached-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.403890 5120 reconciler_common.go:299] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/7090862a-0953-4c04-91f3-a37e21671e86-kolla-config\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.403900 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xh9rt\" (UniqueName: \"kubernetes.io/projected/7090862a-0953-4c04-91f3-a37e21671e86-kube-api-access-xh9rt\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.403910 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/7090862a-0953-4c04-91f3-a37e21671e86-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.405785 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ft6g4\" (UniqueName: \"kubernetes.io/projected/72052f6a-5423-426f-bdb0-9c9f0609fa34-kube-api-access-ft6g4\") pod \"auto-csr-approver-29561274-v5q72\" (UID: \"72052f6a-5423-426f-bdb0-9c9f0609fa34\") " pod="openshift-infra/auto-csr-approver-29561274-v5q72" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.406614 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.414405 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.419991 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/687a8fb9-59e3-46c6-bdb9-f435b5cb52d9-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "687a8fb9-59e3-46c6-bdb9-f435b5cb52d9" (UID: "687a8fb9-59e3-46c6-bdb9-f435b5cb52d9"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.420957 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19be266e-6805-4342-be0d-7fff0fc81029-kube-api-access-hp482" (OuterVolumeSpecName: "kube-api-access-hp482") pod "19be266e-6805-4342-be0d-7fff0fc81029" (UID: "19be266e-6805-4342-be0d-7fff0fc81029"). InnerVolumeSpecName "kube-api-access-hp482". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.428864 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.434384 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.448664 5120 status_manager.go:895] "Failed to get status for pod" podUID="1b5c827b-214c-452d-bd57-dc21f970d7a4" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.450528 5120 status_manager.go:895] "Failed to get status for pod" podUID="1b5c827b-214c-452d-bd57-dc21f970d7a4" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.456457 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/687a8fb9-59e3-46c6-bdb9-f435b5cb52d9-kube-api-access-p94gj" (OuterVolumeSpecName: "kube-api-access-p94gj") pod "687a8fb9-59e3-46c6-bdb9-f435b5cb52d9" (UID: "687a8fb9-59e3-46c6-bdb9-f435b5cb52d9"). InnerVolumeSpecName "kube-api-access-p94gj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.487895 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.488134 5120 scope.go:117] "RemoveContainer" containerID="1caafbafeede915ee6f4819bb0e0954a636de7eee094105d62e479295fc329c9" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.508588 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.509940 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/687a8fb9-59e3-46c6-bdb9-f435b5cb52d9-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.509978 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p94gj\" (UniqueName: \"kubernetes.io/projected/687a8fb9-59e3-46c6-bdb9-f435b5cb52d9-kube-api-access-p94gj\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.509990 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hp482\" (UniqueName: \"kubernetes.io/projected/19be266e-6805-4342-be0d-7fff0fc81029-kube-api-access-hp482\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.524156 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561274-v5q72" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.582924 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-a8cd-account-create-update-nbt76" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.592748 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-a347-account-create-update-89khd" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.594245 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-f4d9ffc8d-lwp78" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.599291 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-3f2f-account-create-update-rfgcb" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.611725 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0c87b06f-6b7e-46f2-8aee-34285fea622e-operator-scripts\") pod \"0c87b06f-6b7e-46f2-8aee-34285fea622e\" (UID: \"0c87b06f-6b7e-46f2-8aee-34285fea622e\") " Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.612124 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7spch\" (UniqueName: \"kubernetes.io/projected/0c87b06f-6b7e-46f2-8aee-34285fea622e-kube-api-access-7spch\") pod \"0c87b06f-6b7e-46f2-8aee-34285fea622e\" (UID: \"0c87b06f-6b7e-46f2-8aee-34285fea622e\") " Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.612634 5120 status_manager.go:895] "Failed to get status for pod" podUID="1b5c827b-214c-452d-bd57-dc21f970d7a4" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.612965 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c87b06f-6b7e-46f2-8aee-34285fea622e-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "0c87b06f-6b7e-46f2-8aee-34285fea622e" (UID: "0c87b06f-6b7e-46f2-8aee-34285fea622e"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.613414 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0c87b06f-6b7e-46f2-8aee-34285fea622e-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.614385 5120 status_manager.go:895] "Failed to get status for pod" podUID="1b5c827b-214c-452d-bd57-dc21f970d7a4" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.626200 5120 scope.go:117] "RemoveContainer" containerID="32dc4affff57e6164d54a3b9adc39549944d248ae17ddcbe6847bc2b8586572c" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.631643 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-9b99-account-create-update-djffv" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.637167 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c87b06f-6b7e-46f2-8aee-34285fea622e-kube-api-access-7spch" (OuterVolumeSpecName: "kube-api-access-7spch") pod "0c87b06f-6b7e-46f2-8aee-34285fea622e" (UID: "0c87b06f-6b7e-46f2-8aee-34285fea622e"). InnerVolumeSpecName "kube-api-access-7spch". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.652507 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-dd94-account-create-update-l69rr" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.660478 5120 scope.go:117] "RemoveContainer" containerID="89f147b51fe4fc1e87c9c591ecb0db5c3f2e8bd2acb9a6231812f956dd8c36da" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.681367 5120 status_manager.go:895] "Failed to get status for pod" podUID="1b5c827b-214c-452d-bd57-dc21f970d7a4" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.685885 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="14486849-fbb1-4cc9-8aa3-714e263c55fb" path="/var/lib/kubelet/pods/14486849-fbb1-4cc9-8aa3-714e263c55fb/volumes" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.686707 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="176eef56-bc30-4119-8af5-fa1329d63aa2" path="/var/lib/kubelet/pods/176eef56-bc30-4119-8af5-fa1329d63aa2/volumes" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.687323 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1b5c827b-214c-452d-bd57-dc21f970d7a4" path="/var/lib/kubelet/pods/1b5c827b-214c-452d-bd57-dc21f970d7a4/volumes" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.688149 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="32f7f790-9e5b-4052-a87d-b3abaa0b3ff0" path="/var/lib/kubelet/pods/32f7f790-9e5b-4052-a87d-b3abaa0b3ff0/volumes" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.688665 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4306304f-eaea-49a1-9e62-9b035dc302de" path="/var/lib/kubelet/pods/4306304f-eaea-49a1-9e62-9b035dc302de/volumes" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.689281 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5888de0f-5da8-4605-aa27-db134fd47b31" path="/var/lib/kubelet/pods/5888de0f-5da8-4605-aa27-db134fd47b31/volumes" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.690217 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f641d93-c3e7-40c3-8d96-d89b931d18cc" path="/var/lib/kubelet/pods/6f641d93-c3e7-40c3-8d96-d89b931d18cc/volumes" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.690606 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7090862a-0953-4c04-91f3-a37e21671e86" path="/var/lib/kubelet/pods/7090862a-0953-4c04-91f3-a37e21671e86/volumes" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.690939 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8821dbd3-25f2-44ea-8a41-e716db08960a" path="/var/lib/kubelet/pods/8821dbd3-25f2-44ea-8a41-e716db08960a/volumes" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.692446 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8d66ce1a-7d4c-4e04-92c9-f86d5ad81fcc" path="/var/lib/kubelet/pods/8d66ce1a-7d4c-4e04-92c9-f86d5ad81fcc/volumes" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.693972 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ae15ab63-33c1-4085-809f-5b1b4086b95b" path="/var/lib/kubelet/pods/ae15ab63-33c1-4085-809f-5b1b4086b95b/volumes" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.694451 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d51d8732-80e3-463b-b8b0-714f8a2d281f" path="/var/lib/kubelet/pods/d51d8732-80e3-463b-b8b0-714f8a2d281f/volumes" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.695612 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d6734794-135c-4f4b-83b6-c64788f83f91" path="/var/lib/kubelet/pods/d6734794-135c-4f4b-83b6-c64788f83f91/volumes" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.696320 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d6f8b8b2-e94a-4c67-9e6d-be16e2acbdcc" path="/var/lib/kubelet/pods/d6f8b8b2-e94a-4c67-9e6d-be16e2acbdcc/volumes" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.699033 5120 scope.go:117] "RemoveContainer" containerID="ebdaf82d2a1f7e9acd884bceba81a86e1a13b95df2c0fa6a630cd488d4c95e00" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.710043 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage04-crc" (UniqueName: "kubernetes.io/local-volume/local-storage04-crc") on node "crc" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.714800 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3af1f773-b662-412f-820d-bea6ba7e58ca-operator-scripts\") pod \"3af1f773-b662-412f-820d-bea6ba7e58ca\" (UID: \"3af1f773-b662-412f-820d-bea6ba7e58ca\") " Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.714886 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2f3efc59-f473-4fd6-acc0-ce261268d63b-operator-scripts\") pod \"2f3efc59-f473-4fd6-acc0-ce261268d63b\" (UID: \"2f3efc59-f473-4fd6-acc0-ce261268d63b\") " Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.714935 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zp9r5\" (UniqueName: \"kubernetes.io/projected/afa004e7-041e-4f04-8864-7163df19cf53-kube-api-access-zp9r5\") pod \"afa004e7-041e-4f04-8864-7163df19cf53\" (UID: \"afa004e7-041e-4f04-8864-7163df19cf53\") " Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.715002 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/afa004e7-041e-4f04-8864-7163df19cf53-operator-scripts\") pod \"afa004e7-041e-4f04-8864-7163df19cf53\" (UID: \"afa004e7-041e-4f04-8864-7163df19cf53\") " Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.715045 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/89c20c31-44e2-4359-b7ee-e2e8b00b4e19-operator-scripts\") pod \"89c20c31-44e2-4359-b7ee-e2e8b00b4e19\" (UID: \"89c20c31-44e2-4359-b7ee-e2e8b00b4e19\") " Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.715151 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q5fzr\" (UniqueName: \"kubernetes.io/projected/2f3efc59-f473-4fd6-acc0-ce261268d63b-kube-api-access-q5fzr\") pod \"2f3efc59-f473-4fd6-acc0-ce261268d63b\" (UID: \"2f3efc59-f473-4fd6-acc0-ce261268d63b\") " Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.715210 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e0a6dd94-0b6e-446a-924b-a39ce7582090-combined-ca-bundle\") pod \"e0a6dd94-0b6e-446a-924b-a39ce7582090\" (UID: \"e0a6dd94-0b6e-446a-924b-a39ce7582090\") " Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.715249 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tfllx\" (UniqueName: \"kubernetes.io/projected/3af1f773-b662-412f-820d-bea6ba7e58ca-kube-api-access-tfllx\") pod \"3af1f773-b662-412f-820d-bea6ba7e58ca\" (UID: \"3af1f773-b662-412f-820d-bea6ba7e58ca\") " Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.715285 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e0a6dd94-0b6e-446a-924b-a39ce7582090-logs\") pod \"e0a6dd94-0b6e-446a-924b-a39ce7582090\" (UID: \"e0a6dd94-0b6e-446a-924b-a39ce7582090\") " Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.715314 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e0a6dd94-0b6e-446a-924b-a39ce7582090-config-data\") pod \"e0a6dd94-0b6e-446a-924b-a39ce7582090\" (UID: \"e0a6dd94-0b6e-446a-924b-a39ce7582090\") " Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.715334 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/e0a6dd94-0b6e-446a-924b-a39ce7582090-config-data-custom\") pod \"e0a6dd94-0b6e-446a-924b-a39ce7582090\" (UID: \"e0a6dd94-0b6e-446a-924b-a39ce7582090\") " Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.715358 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rvwlb\" (UniqueName: \"kubernetes.io/projected/e0a6dd94-0b6e-446a-924b-a39ce7582090-kube-api-access-rvwlb\") pod \"e0a6dd94-0b6e-446a-924b-a39ce7582090\" (UID: \"e0a6dd94-0b6e-446a-924b-a39ce7582090\") " Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.715404 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xdnbr\" (UniqueName: \"kubernetes.io/projected/89c20c31-44e2-4359-b7ee-e2e8b00b4e19-kube-api-access-xdnbr\") pod \"89c20c31-44e2-4359-b7ee-e2e8b00b4e19\" (UID: \"89c20c31-44e2-4359-b7ee-e2e8b00b4e19\") " Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.715627 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/89c20c31-44e2-4359-b7ee-e2e8b00b4e19-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "89c20c31-44e2-4359-b7ee-e2e8b00b4e19" (UID: "89c20c31-44e2-4359-b7ee-e2e8b00b4e19"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.715703 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/afa004e7-041e-4f04-8864-7163df19cf53-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "afa004e7-041e-4f04-8864-7163df19cf53" (UID: "afa004e7-041e-4f04-8864-7163df19cf53"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.716021 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/afa004e7-041e-4f04-8864-7163df19cf53-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.716035 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.716045 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/89c20c31-44e2-4359-b7ee-e2e8b00b4e19-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.716053 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7spch\" (UniqueName: \"kubernetes.io/projected/0c87b06f-6b7e-46f2-8aee-34285fea622e-kube-api-access-7spch\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.716488 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2f3efc59-f473-4fd6-acc0-ce261268d63b-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "2f3efc59-f473-4fd6-acc0-ce261268d63b" (UID: "2f3efc59-f473-4fd6-acc0-ce261268d63b"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.721961 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0a6dd94-0b6e-446a-924b-a39ce7582090-logs" (OuterVolumeSpecName: "logs") pod "e0a6dd94-0b6e-446a-924b-a39ce7582090" (UID: "e0a6dd94-0b6e-446a-924b-a39ce7582090"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.728280 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3af1f773-b662-412f-820d-bea6ba7e58ca-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "3af1f773-b662-412f-820d-bea6ba7e58ca" (UID: "3af1f773-b662-412f-820d-bea6ba7e58ca"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.729541 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3af1f773-b662-412f-820d-bea6ba7e58ca-kube-api-access-tfllx" (OuterVolumeSpecName: "kube-api-access-tfllx") pod "3af1f773-b662-412f-820d-bea6ba7e58ca" (UID: "3af1f773-b662-412f-820d-bea6ba7e58ca"). InnerVolumeSpecName "kube-api-access-tfllx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.743346 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0a6dd94-0b6e-446a-924b-a39ce7582090-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "e0a6dd94-0b6e-446a-924b-a39ce7582090" (UID: "e0a6dd94-0b6e-446a-924b-a39ce7582090"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.743482 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0a6dd94-0b6e-446a-924b-a39ce7582090-kube-api-access-rvwlb" (OuterVolumeSpecName: "kube-api-access-rvwlb") pod "e0a6dd94-0b6e-446a-924b-a39ce7582090" (UID: "e0a6dd94-0b6e-446a-924b-a39ce7582090"). InnerVolumeSpecName "kube-api-access-rvwlb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.743557 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/afa004e7-041e-4f04-8864-7163df19cf53-kube-api-access-zp9r5" (OuterVolumeSpecName: "kube-api-access-zp9r5") pod "afa004e7-041e-4f04-8864-7163df19cf53" (UID: "afa004e7-041e-4f04-8864-7163df19cf53"). InnerVolumeSpecName "kube-api-access-zp9r5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.744909 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/89c20c31-44e2-4359-b7ee-e2e8b00b4e19-kube-api-access-xdnbr" (OuterVolumeSpecName: "kube-api-access-xdnbr") pod "89c20c31-44e2-4359-b7ee-e2e8b00b4e19" (UID: "89c20c31-44e2-4359-b7ee-e2e8b00b4e19"). InnerVolumeSpecName "kube-api-access-xdnbr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.751152 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f3efc59-f473-4fd6-acc0-ce261268d63b-kube-api-access-q5fzr" (OuterVolumeSpecName: "kube-api-access-q5fzr") pod "2f3efc59-f473-4fd6-acc0-ce261268d63b" (UID: "2f3efc59-f473-4fd6-acc0-ce261268d63b"). InnerVolumeSpecName "kube-api-access-q5fzr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.819982 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c95ad7ed-1944-4285-9138-0d4b954aa727-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "c95ad7ed-1944-4285-9138-0d4b954aa727" (UID: "c95ad7ed-1944-4285-9138-0d4b954aa727"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.820087 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tfllx\" (UniqueName: \"kubernetes.io/projected/3af1f773-b662-412f-820d-bea6ba7e58ca-kube-api-access-tfllx\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.820111 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e0a6dd94-0b6e-446a-924b-a39ce7582090-logs\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.820120 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/e0a6dd94-0b6e-446a-924b-a39ce7582090-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.820127 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rvwlb\" (UniqueName: \"kubernetes.io/projected/e0a6dd94-0b6e-446a-924b-a39ce7582090-kube-api-access-rvwlb\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.820136 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xdnbr\" (UniqueName: \"kubernetes.io/projected/89c20c31-44e2-4359-b7ee-e2e8b00b4e19-kube-api-access-xdnbr\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.820145 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3af1f773-b662-412f-820d-bea6ba7e58ca-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.820155 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2f3efc59-f473-4fd6-acc0-ce261268d63b-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.820164 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zp9r5\" (UniqueName: \"kubernetes.io/projected/afa004e7-041e-4f04-8864-7163df19cf53-kube-api-access-zp9r5\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.820172 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q5fzr\" (UniqueName: \"kubernetes.io/projected/2f3efc59-f473-4fd6-acc0-ce261268d63b-kube-api-access-q5fzr\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.861914 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac88284a-2f9f-4e52-8de4-1c299b94bbd1-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "ac88284a-2f9f-4e52-8de4-1c299b94bbd1" (UID: "ac88284a-2f9f-4e52-8de4-1c299b94bbd1"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.865345 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c95ad7ed-1944-4285-9138-0d4b954aa727-galera-tls-certs" (OuterVolumeSpecName: "galera-tls-certs") pod "c95ad7ed-1944-4285-9138-0d4b954aa727" (UID: "c95ad7ed-1944-4285-9138-0d4b954aa727"). InnerVolumeSpecName "galera-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.867884 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac88284a-2f9f-4e52-8de4-1c299b94bbd1-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ac88284a-2f9f-4e52-8de4-1c299b94bbd1" (UID: "ac88284a-2f9f-4e52-8de4-1c299b94bbd1"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.895152 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0a6dd94-0b6e-446a-924b-a39ce7582090-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e0a6dd94-0b6e-446a-924b-a39ce7582090" (UID: "e0a6dd94-0b6e-446a-924b-a39ce7582090"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.899868 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac88284a-2f9f-4e52-8de4-1c299b94bbd1-config-data" (OuterVolumeSpecName: "config-data") pod "ac88284a-2f9f-4e52-8de4-1c299b94bbd1" (UID: "ac88284a-2f9f-4e52-8de4-1c299b94bbd1"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.923889 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ac88284a-2f9f-4e52-8de4-1c299b94bbd1-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.923919 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ac88284a-2f9f-4e52-8de4-1c299b94bbd1-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.923929 5120 reconciler_common.go:299] "Volume detached for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/c95ad7ed-1944-4285-9138-0d4b954aa727-galera-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.923937 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c95ad7ed-1944-4285-9138-0d4b954aa727-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.923945 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e0a6dd94-0b6e-446a-924b-a39ce7582090-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.923953 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ac88284a-2f9f-4e52-8de4-1c299b94bbd1-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.937334 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac88284a-2f9f-4e52-8de4-1c299b94bbd1-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "ac88284a-2f9f-4e52-8de4-1c299b94bbd1" (UID: "ac88284a-2f9f-4e52-8de4-1c299b94bbd1"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:54:00 crc kubenswrapper[5120]: I0316 15:54:00.937428 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0a6dd94-0b6e-446a-924b-a39ce7582090-config-data" (OuterVolumeSpecName: "config-data") pod "e0a6dd94-0b6e-446a-924b-a39ce7582090" (UID: "e0a6dd94-0b6e-446a-924b-a39ce7582090"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:54:01 crc kubenswrapper[5120]: I0316 15:54:01.012777 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-9b99-account-create-update-djffv" Mar 16 15:54:01 crc kubenswrapper[5120]: I0316 15:54:01.016960 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-a8cd-account-create-update-nbt76" Mar 16 15:54:01 crc kubenswrapper[5120]: I0316 15:54:01.025466 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e0a6dd94-0b6e-446a-924b-a39ce7582090-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:01 crc kubenswrapper[5120]: I0316 15:54:01.025510 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/ac88284a-2f9f-4e52-8de4-1c299b94bbd1-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:01 crc kubenswrapper[5120]: I0316 15:54:01.053177 5120 generic.go:358] "Generic (PLEG): container finished" podID="51478cb6-9192-494b-a293-b5cc54cfa9a3" containerID="47d672e660915dee4a32abf5542b3e9f3216a0738c0dd0c1ced8826e5cf19a6e" exitCode=0 Mar 16 15:54:01 crc kubenswrapper[5120]: I0316 15:54:01.060661 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-a347-account-create-update-89khd" Mar 16 15:54:01 crc kubenswrapper[5120]: I0316 15:54:01.103448 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-3f2f-account-create-update-rfgcb" Mar 16 15:54:01 crc kubenswrapper[5120]: I0316 15:54:01.178514 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-766fb557cd-fwt4z" podUID="26a03664-6cb3-4982-80f5-063d8f12cc2a" containerName="barbican-api-log" containerID="cri-o://b4be06dc3760c0f772a705af0e0fca11910d8d85c190b7e9987da3a11afdde37" gracePeriod=30 Mar 16 15:54:01 crc kubenswrapper[5120]: I0316 15:54:01.179488 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-766fb557cd-fwt4z" podUID="26a03664-6cb3-4982-80f5-063d8f12cc2a" containerName="barbican-api" containerID="cri-o://44d0d0f4bb5fea2644a7968ff2c3efd3c765ae9f3e3449bb273203ee91d90f64" gracePeriod=30 Mar 16 15:54:01 crc kubenswrapper[5120]: I0316 15:54:01.192488 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-7bd99f4458-mgw7m" podUID="5a0edbf7-738f-4c1a-9333-f23da8ab8067" containerName="barbican-keystone-listener-log" containerID="cri-o://c2121e4d06f46ee4a9e8ff7fef63a6dbeab5cdae2f5f5e1ffbca0a1570f651e5" gracePeriod=30 Mar 16 15:54:01 crc kubenswrapper[5120]: I0316 15:54:01.192910 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-7bd99f4458-mgw7m" podUID="5a0edbf7-738f-4c1a-9333-f23da8ab8067" containerName="barbican-keystone-listener" containerID="cri-o://1cd092148959f4bdcdf7f0a5a7192d93e01e6842734d51ca456ee76180f927d4" gracePeriod=30 Mar 16 15:54:01 crc kubenswrapper[5120]: I0316 15:54:01.205740 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-api-766fb557cd-fwt4z" podStartSLOduration=9.205717655 podStartE2EDuration="9.205717655s" podCreationTimestamp="2026-03-16 15:53:52 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:54:01.198617369 +0000 UTC m=+1343.352549026" watchObservedRunningTime="2026-03-16 15:54:01.205717655 +0000 UTC m=+1343.359649312" Mar 16 15:54:01 crc kubenswrapper[5120]: I0316 15:54:01.216631 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/keystone-6b877d4f87-4vmvc" podUID="26ff2779-e4aa-43b8-9704-4def1ae45033" containerName="keystone-api" containerID="cri-o://9ff55543c7123563762eb13f38c5fea05c37774f980b9eaf305d74e4adc20f00" gracePeriod=30 Mar 16 15:54:01 crc kubenswrapper[5120]: I0316 15:54:01.217524 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-keystone-listener-7bd99f4458-mgw7m" podStartSLOduration=9.217506331 podStartE2EDuration="9.217506331s" podCreationTimestamp="2026-03-16 15:53:52 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:54:01.21709146 +0000 UTC m=+1343.371023117" watchObservedRunningTime="2026-03-16 15:54:01.217506331 +0000 UTC m=+1343.371437988" Mar 16 15:54:01 crc kubenswrapper[5120]: I0316 15:54:01.223829 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-746gq" Mar 16 15:54:01 crc kubenswrapper[5120]: I0316 15:54:01.238276 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-6b877d4f87-4vmvc" podStartSLOduration=9.238263885 podStartE2EDuration="9.238263885s" podCreationTimestamp="2026-03-16 15:53:52 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:54:01.235847219 +0000 UTC m=+1343.389778876" watchObservedRunningTime="2026-03-16 15:54:01.238263885 +0000 UTC m=+1343.392195542" Mar 16 15:54:01 crc kubenswrapper[5120]: I0316 15:54:01.253115 5120 generic.go:358] "Generic (PLEG): container finished" podID="cb293a62-0310-4af8-8376-0b2197bda8d2" containerID="354e037f289bc79961fa099797e6d89c6df4e1e5901656cb22c5c95fe04df07b" exitCode=0 Mar 16 15:54:01 crc kubenswrapper[5120]: I0316 15:54:01.261531 5120 generic.go:358] "Generic (PLEG): container finished" podID="e0a6dd94-0b6e-446a-924b-a39ce7582090" containerID="d98841f9e46e61836bc62ce9a26e9ee5daf9f80796e5c5c33aaeb58a64ec8ebb" exitCode=0 Mar 16 15:54:01 crc kubenswrapper[5120]: I0316 15:54:01.261672 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-f4d9ffc8d-lwp78" Mar 16 15:54:01 crc kubenswrapper[5120]: I0316 15:54:01.272471 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-0a49-account-create-update-fqp48" Mar 16 15:54:01 crc kubenswrapper[5120]: I0316 15:54:01.276331 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 15:54:01 crc kubenswrapper[5120]: I0316 15:54:01.276655 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-59c794978b-lzrxq" Mar 16 15:54:01 crc kubenswrapper[5120]: I0316 15:54:01.280847 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-5f559c8896-5jgnd" podUID="d442e64c-a236-4d12-8205-d5cf2cb95748" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.0.156:9311/healthcheck\": read tcp 10.217.0.2:56040->10.217.0.156:9311: read: connection reset by peer" Mar 16 15:54:01 crc kubenswrapper[5120]: I0316 15:54:01.281016 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-236f-account-create-update-8gdw9" Mar 16 15:54:01 crc kubenswrapper[5120]: I0316 15:54:01.281361 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-dd94-account-create-update-l69rr" Mar 16 15:54:01 crc kubenswrapper[5120]: I0316 15:54:01.323254 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-9b99-account-create-update-djffv" event={"ID":"89c20c31-44e2-4359-b7ee-e2e8b00b4e19","Type":"ContainerDied","Data":"0b47030b188cc609de78cb9a2c4493898fb69ce9fbd5993d90aaad436d9b0a08"} Mar 16 15:54:01 crc kubenswrapper[5120]: I0316 15:54:01.323300 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-766fb557cd-fwt4z" Mar 16 15:54:01 crc kubenswrapper[5120]: I0316 15:54:01.323317 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-a8cd-account-create-update-nbt76" event={"ID":"0c87b06f-6b7e-46f2-8aee-34285fea622e","Type":"ContainerDied","Data":"4d14eaa9edf61b256d908b2501c5fbc3f5bef0229bb994bd436200730af72a59"} Mar 16 15:54:01 crc kubenswrapper[5120]: I0316 15:54:01.323338 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-766fb557cd-fwt4z" Mar 16 15:54:01 crc kubenswrapper[5120]: I0316 15:54:01.323348 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/keystone-6b877d4f87-4vmvc" Mar 16 15:54:01 crc kubenswrapper[5120]: I0316 15:54:01.323361 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-776d498b58-sb5f8" event={"ID":"2218d5be-dd10-4e4b-87b9-d9a5273bd197","Type":"ContainerStarted","Data":"30fcebc78fef297d9597fb81fcfe0c3214bdcd8b95be5f9cf35017195e5e1f4e"} Mar 16 15:54:01 crc kubenswrapper[5120]: I0316 15:54:01.323373 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561274-v5q72"] Mar 16 15:54:01 crc kubenswrapper[5120]: I0316 15:54:01.323401 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-xvqbz" event={"ID":"51478cb6-9192-494b-a293-b5cc54cfa9a3","Type":"ContainerDied","Data":"47d672e660915dee4a32abf5542b3e9f3216a0738c0dd0c1ced8826e5cf19a6e"} Mar 16 15:54:01 crc kubenswrapper[5120]: I0316 15:54:01.323412 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-a347-account-create-update-89khd" event={"ID":"3af1f773-b662-412f-820d-bea6ba7e58ca","Type":"ContainerDied","Data":"3eb2ae9f1a31e93a3433346247c49bc597561f1904b93f7c1b49c00ba72f16ea"} Mar 16 15:54:01 crc kubenswrapper[5120]: I0316 15:54:01.323425 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-3f2f-account-create-update-rfgcb" event={"ID":"2f3efc59-f473-4fd6-acc0-ce261268d63b","Type":"ContainerDied","Data":"9bde23a2111ad98a9d7a27e5dc060ae538bd48423a38de4f11e25d2e59e326b6"} Mar 16 15:54:01 crc kubenswrapper[5120]: I0316 15:54:01.323436 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-766fb557cd-fwt4z" event={"ID":"26a03664-6cb3-4982-80f5-063d8f12cc2a","Type":"ContainerStarted","Data":"44d0d0f4bb5fea2644a7968ff2c3efd3c765ae9f3e3449bb273203ee91d90f64"} Mar 16 15:54:01 crc kubenswrapper[5120]: I0316 15:54:01.323445 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-6646594584-l84r5" event={"ID":"952aeeb8-cdc4-469f-b50b-e5d640adc994","Type":"ContainerStarted","Data":"90d7bd6f5ab887d265aa5f3dcd1136326d78aac9bf8e7ccdb164249f5e00a7cb"} Mar 16 15:54:01 crc kubenswrapper[5120]: I0316 15:54:01.323455 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-7bd99f4458-mgw7m" event={"ID":"5a0edbf7-738f-4c1a-9333-f23da8ab8067","Type":"ContainerStarted","Data":"1cd092148959f4bdcdf7f0a5a7192d93e01e6842734d51ca456ee76180f927d4"} Mar 16 15:54:01 crc kubenswrapper[5120]: I0316 15:54:01.323464 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-7bd99f4458-mgw7m" event={"ID":"5a0edbf7-738f-4c1a-9333-f23da8ab8067","Type":"ContainerStarted","Data":"c2121e4d06f46ee4a9e8ff7fef63a6dbeab5cdae2f5f5e1ffbca0a1570f651e5"} Mar 16 15:54:01 crc kubenswrapper[5120]: I0316 15:54:01.323475 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-6b877d4f87-4vmvc" event={"ID":"26ff2779-e4aa-43b8-9704-4def1ae45033","Type":"ContainerStarted","Data":"9ff55543c7123563762eb13f38c5fea05c37774f980b9eaf305d74e4adc20f00"} Mar 16 15:54:01 crc kubenswrapper[5120]: I0316 15:54:01.323484 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-746gq" event={"ID":"19be266e-6805-4342-be0d-7fff0fc81029","Type":"ContainerDied","Data":"ca389d3317d0f04ba1a92686a955d0cfa4fa41b46a2a593366e2332adff9be2f"} Mar 16 15:54:01 crc kubenswrapper[5120]: I0316 15:54:01.323494 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-c7cf47df9-t2r2b" event={"ID":"cb293a62-0310-4af8-8376-0b2197bda8d2","Type":"ContainerDied","Data":"354e037f289bc79961fa099797e6d89c6df4e1e5901656cb22c5c95fe04df07b"} Mar 16 15:54:01 crc kubenswrapper[5120]: I0316 15:54:01.323504 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-f4d9ffc8d-lwp78" event={"ID":"e0a6dd94-0b6e-446a-924b-a39ce7582090","Type":"ContainerDied","Data":"d98841f9e46e61836bc62ce9a26e9ee5daf9f80796e5c5c33aaeb58a64ec8ebb"} Mar 16 15:54:01 crc kubenswrapper[5120]: I0316 15:54:01.323515 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-f4d9ffc8d-lwp78" event={"ID":"e0a6dd94-0b6e-446a-924b-a39ce7582090","Type":"ContainerDied","Data":"9dda4eaf253cd7a8b8d7355293a0fe29dc51661d44531318ea90443f5dcee802"} Mar 16 15:54:01 crc kubenswrapper[5120]: I0316 15:54:01.323524 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-0a49-account-create-update-fqp48" event={"ID":"687a8fb9-59e3-46c6-bdb9-f435b5cb52d9","Type":"ContainerDied","Data":"cf7e3407b76666054ac42fc9b4d91b1e7c45d6868297d5342f0c1592bdf588d9"} Mar 16 15:54:01 crc kubenswrapper[5120]: I0316 15:54:01.323533 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-dd94-account-create-update-l69rr" event={"ID":"afa004e7-041e-4f04-8864-7163df19cf53","Type":"ContainerDied","Data":"649a631f7cb0b7208be2261907fec14dd00e5721d67d5ecb9d4f6aa932db61f5"} Mar 16 15:54:01 crc kubenswrapper[5120]: I0316 15:54:01.427967 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/placement-7956bcf97d-p9m4c" podUID="ac8dd629-af3d-4d9c-b41a-f5b8d6d29498" containerName="placement-log" probeResult="failure" output="Get \"https://10.217.0.160:8778/\": read tcp 10.217.0.2:50432->10.217.0.160:8778: read: connection reset by peer" Mar 16 15:54:01 crc kubenswrapper[5120]: I0316 15:54:01.428096 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/placement-7956bcf97d-p9m4c" podUID="ac8dd629-af3d-4d9c-b41a-f5b8d6d29498" containerName="placement-api" probeResult="failure" output="Get \"https://10.217.0.160:8778/\": read tcp 10.217.0.2:50434->10.217.0.160:8778: read: connection reset by peer" Mar 16 15:54:01 crc kubenswrapper[5120]: I0316 15:54:01.607422 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-c7cf47df9-t2r2b" Mar 16 15:54:01 crc kubenswrapper[5120]: I0316 15:54:01.643370 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cb293a62-0310-4af8-8376-0b2197bda8d2-combined-ca-bundle\") pod \"cb293a62-0310-4af8-8376-0b2197bda8d2\" (UID: \"cb293a62-0310-4af8-8376-0b2197bda8d2\") " Mar 16 15:54:01 crc kubenswrapper[5120]: I0316 15:54:01.643823 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zmttj\" (UniqueName: \"kubernetes.io/projected/cb293a62-0310-4af8-8376-0b2197bda8d2-kube-api-access-zmttj\") pod \"cb293a62-0310-4af8-8376-0b2197bda8d2\" (UID: \"cb293a62-0310-4af8-8376-0b2197bda8d2\") " Mar 16 15:54:01 crc kubenswrapper[5120]: I0316 15:54:01.643953 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cb293a62-0310-4af8-8376-0b2197bda8d2-config-data\") pod \"cb293a62-0310-4af8-8376-0b2197bda8d2\" (UID: \"cb293a62-0310-4af8-8376-0b2197bda8d2\") " Mar 16 15:54:01 crc kubenswrapper[5120]: I0316 15:54:01.644078 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/cb293a62-0310-4af8-8376-0b2197bda8d2-logs\") pod \"cb293a62-0310-4af8-8376-0b2197bda8d2\" (UID: \"cb293a62-0310-4af8-8376-0b2197bda8d2\") " Mar 16 15:54:01 crc kubenswrapper[5120]: I0316 15:54:01.644181 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/cb293a62-0310-4af8-8376-0b2197bda8d2-config-data-custom\") pod \"cb293a62-0310-4af8-8376-0b2197bda8d2\" (UID: \"cb293a62-0310-4af8-8376-0b2197bda8d2\") " Mar 16 15:54:01 crc kubenswrapper[5120]: I0316 15:54:01.651859 5120 scope.go:117] "RemoveContainer" containerID="544dd46ceb52a8a8952e0260d5780a769952c63f2d32902979fa7e197c0a5577" Mar 16 15:54:01 crc kubenswrapper[5120]: E0316 15:54:01.652092 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="6211858e25939c70614a9fad4891a628b70c8d2b4ada38adb2b8bd841a424715" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 15:54:01 crc kubenswrapper[5120]: I0316 15:54:01.668134 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb293a62-0310-4af8-8376-0b2197bda8d2-logs" (OuterVolumeSpecName: "logs") pod "cb293a62-0310-4af8-8376-0b2197bda8d2" (UID: "cb293a62-0310-4af8-8376-0b2197bda8d2"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:54:01 crc kubenswrapper[5120]: E0316 15:54:01.668260 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="6211858e25939c70614a9fad4891a628b70c8d2b4ada38adb2b8bd841a424715" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 15:54:01 crc kubenswrapper[5120]: I0316 15:54:01.668430 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb293a62-0310-4af8-8376-0b2197bda8d2-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "cb293a62-0310-4af8-8376-0b2197bda8d2" (UID: "cb293a62-0310-4af8-8376-0b2197bda8d2"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:54:01 crc kubenswrapper[5120]: E0316 15:54:01.689824 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="6211858e25939c70614a9fad4891a628b70c8d2b4ada38adb2b8bd841a424715" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 15:54:01 crc kubenswrapper[5120]: E0316 15:54:01.689896 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="387f81d1-6a19-4250-b210-26daff7cbdc9" containerName="nova-cell1-conductor-conductor" probeResult="unknown" Mar 16 15:54:01 crc kubenswrapper[5120]: I0316 15:54:01.703277 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb293a62-0310-4af8-8376-0b2197bda8d2-kube-api-access-zmttj" (OuterVolumeSpecName: "kube-api-access-zmttj") pod "cb293a62-0310-4af8-8376-0b2197bda8d2" (UID: "cb293a62-0310-4af8-8376-0b2197bda8d2"). InnerVolumeSpecName "kube-api-access-zmttj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:54:01 crc kubenswrapper[5120]: I0316 15:54:01.753612 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/cb293a62-0310-4af8-8376-0b2197bda8d2-logs\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:01 crc kubenswrapper[5120]: I0316 15:54:01.753642 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/cb293a62-0310-4af8-8376-0b2197bda8d2-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:01 crc kubenswrapper[5120]: I0316 15:54:01.753653 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zmttj\" (UniqueName: \"kubernetes.io/projected/cb293a62-0310-4af8-8376-0b2197bda8d2-kube-api-access-zmttj\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:01 crc kubenswrapper[5120]: I0316 15:54:01.780778 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb293a62-0310-4af8-8376-0b2197bda8d2-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "cb293a62-0310-4af8-8376-0b2197bda8d2" (UID: "cb293a62-0310-4af8-8376-0b2197bda8d2"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:54:01 crc kubenswrapper[5120]: I0316 15:54:01.781187 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb293a62-0310-4af8-8376-0b2197bda8d2-config-data" (OuterVolumeSpecName: "config-data") pod "cb293a62-0310-4af8-8376-0b2197bda8d2" (UID: "cb293a62-0310-4af8-8376-0b2197bda8d2"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:54:01 crc kubenswrapper[5120]: I0316 15:54:01.857867 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cb293a62-0310-4af8-8376-0b2197bda8d2-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:01 crc kubenswrapper[5120]: I0316 15:54:01.857900 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cb293a62-0310-4af8-8376-0b2197bda8d2-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:01 crc kubenswrapper[5120]: E0316 15:54:01.857960 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Mar 16 15:54:01 crc kubenswrapper[5120]: E0316 15:54:01.858009 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/36a1c719-e302-4df3-99c5-5025d99c8c19-config-data podName:36a1c719-e302-4df3-99c5-5025d99c8c19 nodeName:}" failed. No retries permitted until 2026-03-16 15:54:05.857994204 +0000 UTC m=+1348.011925861 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/36a1c719-e302-4df3-99c5-5025d99c8c19-config-data") pod "rabbitmq-cell1-server-0" (UID: "36a1c719-e302-4df3-99c5-5025d99c8c19") : configmap "rabbitmq-cell1-config-data" not found Mar 16 15:54:01 crc kubenswrapper[5120]: I0316 15:54:01.959496 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7jg96\" (UniqueName: \"kubernetes.io/projected/5e604554-8190-4098-a61e-3568489988d0-kube-api-access-7jg96\") pod \"keystone-236f-account-create-update-8gdw9\" (UID: \"5e604554-8190-4098-a61e-3568489988d0\") " pod="openstack-kuttl-tests/keystone-236f-account-create-update-8gdw9" Mar 16 15:54:01 crc kubenswrapper[5120]: I0316 15:54:01.959907 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5e604554-8190-4098-a61e-3568489988d0-operator-scripts\") pod \"keystone-236f-account-create-update-8gdw9\" (UID: \"5e604554-8190-4098-a61e-3568489988d0\") " pod="openstack-kuttl-tests/keystone-236f-account-create-update-8gdw9" Mar 16 15:54:01 crc kubenswrapper[5120]: E0316 15:54:01.960040 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: object "openstack-kuttl-tests"/"openstack-scripts" not registered Mar 16 15:54:01 crc kubenswrapper[5120]: E0316 15:54:01.960112 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5e604554-8190-4098-a61e-3568489988d0-operator-scripts podName:5e604554-8190-4098-a61e-3568489988d0 nodeName:}" failed. No retries permitted until 2026-03-16 15:54:05.960094379 +0000 UTC m=+1348.114026036 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/5e604554-8190-4098-a61e-3568489988d0-operator-scripts") pod "keystone-236f-account-create-update-8gdw9" (UID: "5e604554-8190-4098-a61e-3568489988d0") : object "openstack-kuttl-tests"/"openstack-scripts" not registered Mar 16 15:54:01 crc kubenswrapper[5120]: E0316 15:54:01.966079 5120 projected.go:194] Error preparing data for projected volume kube-api-access-7jg96 for pod openstack-kuttl-tests/keystone-236f-account-create-update-8gdw9: failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 15:54:01 crc kubenswrapper[5120]: E0316 15:54:01.966125 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5e604554-8190-4098-a61e-3568489988d0-kube-api-access-7jg96 podName:5e604554-8190-4098-a61e-3568489988d0 nodeName:}" failed. No retries permitted until 2026-03-16 15:54:05.966115466 +0000 UTC m=+1348.120047123 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-7jg96" (UniqueName: "kubernetes.io/projected/5e604554-8190-4098-a61e-3568489988d0-kube-api-access-7jg96") pod "keystone-236f-account-create-update-8gdw9" (UID: "5e604554-8190-4098-a61e-3568489988d0") : failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.001982 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-5f559c8896-5jgnd" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.026470 5120 scope.go:117] "RemoveContainer" containerID="2f65dec7986bd0522ab520af73feb24ec1981e8d8b3bd281082c4d851a61df1c" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.052529 5120 scope.go:117] "RemoveContainer" containerID="c10a021b8eb3c6d7e0a7d62489b393cff613269c9c5979e7ef8c0dc2960ee167" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.058132 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-766fb557cd-fwt4z" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.061293 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d442e64c-a236-4d12-8205-d5cf2cb95748-logs\") pod \"d442e64c-a236-4d12-8205-d5cf2cb95748\" (UID: \"d442e64c-a236-4d12-8205-d5cf2cb95748\") " Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.061339 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d442e64c-a236-4d12-8205-d5cf2cb95748-combined-ca-bundle\") pod \"d442e64c-a236-4d12-8205-d5cf2cb95748\" (UID: \"d442e64c-a236-4d12-8205-d5cf2cb95748\") " Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.061376 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/d442e64c-a236-4d12-8205-d5cf2cb95748-public-tls-certs\") pod \"d442e64c-a236-4d12-8205-d5cf2cb95748\" (UID: \"d442e64c-a236-4d12-8205-d5cf2cb95748\") " Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.061399 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/d442e64c-a236-4d12-8205-d5cf2cb95748-internal-tls-certs\") pod \"d442e64c-a236-4d12-8205-d5cf2cb95748\" (UID: \"d442e64c-a236-4d12-8205-d5cf2cb95748\") " Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.061482 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q9555\" (UniqueName: \"kubernetes.io/projected/d442e64c-a236-4d12-8205-d5cf2cb95748-kube-api-access-q9555\") pod \"d442e64c-a236-4d12-8205-d5cf2cb95748\" (UID: \"d442e64c-a236-4d12-8205-d5cf2cb95748\") " Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.061615 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/d442e64c-a236-4d12-8205-d5cf2cb95748-config-data-custom\") pod \"d442e64c-a236-4d12-8205-d5cf2cb95748\" (UID: \"d442e64c-a236-4d12-8205-d5cf2cb95748\") " Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.061694 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d442e64c-a236-4d12-8205-d5cf2cb95748-config-data\") pod \"d442e64c-a236-4d12-8205-d5cf2cb95748\" (UID: \"d442e64c-a236-4d12-8205-d5cf2cb95748\") " Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.067199 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d442e64c-a236-4d12-8205-d5cf2cb95748-logs" (OuterVolumeSpecName: "logs") pod "d442e64c-a236-4d12-8205-d5cf2cb95748" (UID: "d442e64c-a236-4d12-8205-d5cf2cb95748"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.089731 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-6b877d4f87-4vmvc" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.095750 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-7956bcf97d-p9m4c" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.105497 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.109433 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d442e64c-a236-4d12-8205-d5cf2cb95748-kube-api-access-q9555" (OuterVolumeSpecName: "kube-api-access-q9555") pod "d442e64c-a236-4d12-8205-d5cf2cb95748" (UID: "d442e64c-a236-4d12-8205-d5cf2cb95748"). InnerVolumeSpecName "kube-api-access-q9555". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.116052 5120 scope.go:117] "RemoveContainer" containerID="644887079b1213997556ab399de2c246219f6ab30fc16e674faf786eacb49089" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.126334 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d442e64c-a236-4d12-8205-d5cf2cb95748-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "d442e64c-a236-4d12-8205-d5cf2cb95748" (UID: "d442e64c-a236-4d12-8205-d5cf2cb95748"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.152599 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.163366 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/26ff2779-e4aa-43b8-9704-4def1ae45033-internal-tls-certs\") pod \"26ff2779-e4aa-43b8-9704-4def1ae45033\" (UID: \"26ff2779-e4aa-43b8-9704-4def1ae45033\") " Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.163452 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ac8dd629-af3d-4d9c-b41a-f5b8d6d29498-scripts\") pod \"ac8dd629-af3d-4d9c-b41a-f5b8d6d29498\" (UID: \"ac8dd629-af3d-4d9c-b41a-f5b8d6d29498\") " Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.163468 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/26a03664-6cb3-4982-80f5-063d8f12cc2a-config-data\") pod \"26a03664-6cb3-4982-80f5-063d8f12cc2a\" (UID: \"26a03664-6cb3-4982-80f5-063d8f12cc2a\") " Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.163488 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/26ff2779-e4aa-43b8-9704-4def1ae45033-scripts\") pod \"26ff2779-e4aa-43b8-9704-4def1ae45033\" (UID: \"26ff2779-e4aa-43b8-9704-4def1ae45033\") " Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.163575 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/26ff2779-e4aa-43b8-9704-4def1ae45033-config-data\") pod \"26ff2779-e4aa-43b8-9704-4def1ae45033\" (UID: \"26ff2779-e4aa-43b8-9704-4def1ae45033\") " Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.163611 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ac8dd629-af3d-4d9c-b41a-f5b8d6d29498-logs\") pod \"ac8dd629-af3d-4d9c-b41a-f5b8d6d29498\" (UID: \"ac8dd629-af3d-4d9c-b41a-f5b8d6d29498\") " Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.163645 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/26ff2779-e4aa-43b8-9704-4def1ae45033-combined-ca-bundle\") pod \"26ff2779-e4aa-43b8-9704-4def1ae45033\" (UID: \"26ff2779-e4aa-43b8-9704-4def1ae45033\") " Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.163684 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lwjj5\" (UniqueName: \"kubernetes.io/projected/26a03664-6cb3-4982-80f5-063d8f12cc2a-kube-api-access-lwjj5\") pod \"26a03664-6cb3-4982-80f5-063d8f12cc2a\" (UID: \"26a03664-6cb3-4982-80f5-063d8f12cc2a\") " Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.163707 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/26ff2779-e4aa-43b8-9704-4def1ae45033-fernet-keys\") pod \"26ff2779-e4aa-43b8-9704-4def1ae45033\" (UID: \"26ff2779-e4aa-43b8-9704-4def1ae45033\") " Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.163732 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6pmd6\" (UniqueName: \"kubernetes.io/projected/26ff2779-e4aa-43b8-9704-4def1ae45033-kube-api-access-6pmd6\") pod \"26ff2779-e4aa-43b8-9704-4def1ae45033\" (UID: \"26ff2779-e4aa-43b8-9704-4def1ae45033\") " Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.163797 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/26a03664-6cb3-4982-80f5-063d8f12cc2a-logs\") pod \"26a03664-6cb3-4982-80f5-063d8f12cc2a\" (UID: \"26a03664-6cb3-4982-80f5-063d8f12cc2a\") " Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.163824 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/26a03664-6cb3-4982-80f5-063d8f12cc2a-combined-ca-bundle\") pod \"26a03664-6cb3-4982-80f5-063d8f12cc2a\" (UID: \"26a03664-6cb3-4982-80f5-063d8f12cc2a\") " Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.163844 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/26a03664-6cb3-4982-80f5-063d8f12cc2a-public-tls-certs\") pod \"26a03664-6cb3-4982-80f5-063d8f12cc2a\" (UID: \"26a03664-6cb3-4982-80f5-063d8f12cc2a\") " Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.163928 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/26a03664-6cb3-4982-80f5-063d8f12cc2a-internal-tls-certs\") pod \"26a03664-6cb3-4982-80f5-063d8f12cc2a\" (UID: \"26a03664-6cb3-4982-80f5-063d8f12cc2a\") " Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.163983 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/26a03664-6cb3-4982-80f5-063d8f12cc2a-config-data-custom\") pod \"26a03664-6cb3-4982-80f5-063d8f12cc2a\" (UID: \"26a03664-6cb3-4982-80f5-063d8f12cc2a\") " Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.164011 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/ac8dd629-af3d-4d9c-b41a-f5b8d6d29498-internal-tls-certs\") pod \"ac8dd629-af3d-4d9c-b41a-f5b8d6d29498\" (UID: \"ac8dd629-af3d-4d9c-b41a-f5b8d6d29498\") " Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.164029 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ac8dd629-af3d-4d9c-b41a-f5b8d6d29498-public-tls-certs\") pod \"ac8dd629-af3d-4d9c-b41a-f5b8d6d29498\" (UID: \"ac8dd629-af3d-4d9c-b41a-f5b8d6d29498\") " Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.164052 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/26ff2779-e4aa-43b8-9704-4def1ae45033-public-tls-certs\") pod \"26ff2779-e4aa-43b8-9704-4def1ae45033\" (UID: \"26ff2779-e4aa-43b8-9704-4def1ae45033\") " Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.164066 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ac8dd629-af3d-4d9c-b41a-f5b8d6d29498-config-data\") pod \"ac8dd629-af3d-4d9c-b41a-f5b8d6d29498\" (UID: \"ac8dd629-af3d-4d9c-b41a-f5b8d6d29498\") " Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.164111 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/26ff2779-e4aa-43b8-9704-4def1ae45033-credential-keys\") pod \"26ff2779-e4aa-43b8-9704-4def1ae45033\" (UID: \"26ff2779-e4aa-43b8-9704-4def1ae45033\") " Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.164138 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ac8dd629-af3d-4d9c-b41a-f5b8d6d29498-combined-ca-bundle\") pod \"ac8dd629-af3d-4d9c-b41a-f5b8d6d29498\" (UID: \"ac8dd629-af3d-4d9c-b41a-f5b8d6d29498\") " Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.164183 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m5v64\" (UniqueName: \"kubernetes.io/projected/ac8dd629-af3d-4d9c-b41a-f5b8d6d29498-kube-api-access-m5v64\") pod \"ac8dd629-af3d-4d9c-b41a-f5b8d6d29498\" (UID: \"ac8dd629-af3d-4d9c-b41a-f5b8d6d29498\") " Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.164800 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d442e64c-a236-4d12-8205-d5cf2cb95748-logs\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.164814 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q9555\" (UniqueName: \"kubernetes.io/projected/d442e64c-a236-4d12-8205-d5cf2cb95748-kube-api-access-q9555\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.164825 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/d442e64c-a236-4d12-8205-d5cf2cb95748-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.169538 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26a03664-6cb3-4982-80f5-063d8f12cc2a-logs" (OuterVolumeSpecName: "logs") pod "26a03664-6cb3-4982-80f5-063d8f12cc2a" (UID: "26a03664-6cb3-4982-80f5-063d8f12cc2a"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.192836 5120 scope.go:117] "RemoveContainer" containerID="90908bbbef74b7f5e704e8c24916f04d08ee29789fc078f939aaa8b2aa2fd831" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.195406 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac8dd629-af3d-4d9c-b41a-f5b8d6d29498-logs" (OuterVolumeSpecName: "logs") pod "ac8dd629-af3d-4d9c-b41a-f5b8d6d29498" (UID: "ac8dd629-af3d-4d9c-b41a-f5b8d6d29498"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.197661 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-a347-account-create-update-89khd"] Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.206544 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/26ff2779-e4aa-43b8-9704-4def1ae45033-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "26ff2779-e4aa-43b8-9704-4def1ae45033" (UID: "26ff2779-e4aa-43b8-9704-4def1ae45033"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.207069 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/26ff2779-e4aa-43b8-9704-4def1ae45033-scripts" (OuterVolumeSpecName: "scripts") pod "26ff2779-e4aa-43b8-9704-4def1ae45033" (UID: "26ff2779-e4aa-43b8-9704-4def1ae45033"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.209370 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/26a03664-6cb3-4982-80f5-063d8f12cc2a-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "26a03664-6cb3-4982-80f5-063d8f12cc2a" (UID: "26a03664-6cb3-4982-80f5-063d8f12cc2a"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.215573 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-a347-account-create-update-89khd"] Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.228201 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac8dd629-af3d-4d9c-b41a-f5b8d6d29498-scripts" (OuterVolumeSpecName: "scripts") pod "ac8dd629-af3d-4d9c-b41a-f5b8d6d29498" (UID: "ac8dd629-af3d-4d9c-b41a-f5b8d6d29498"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.228215 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac8dd629-af3d-4d9c-b41a-f5b8d6d29498-kube-api-access-m5v64" (OuterVolumeSpecName: "kube-api-access-m5v64") pod "ac8dd629-af3d-4d9c-b41a-f5b8d6d29498" (UID: "ac8dd629-af3d-4d9c-b41a-f5b8d6d29498"). InnerVolumeSpecName "kube-api-access-m5v64". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.234472 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-f4d9ffc8d-lwp78"] Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.244271 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-f4d9ffc8d-lwp78"] Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.246406 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/26ff2779-e4aa-43b8-9704-4def1ae45033-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "26ff2779-e4aa-43b8-9704-4def1ae45033" (UID: "26ff2779-e4aa-43b8-9704-4def1ae45033"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.249063 5120 scope.go:117] "RemoveContainer" containerID="ae70819b9a1f84ddd33ad93962ec42573aee9adbc472f37bb2fafc17feabaa45" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.255554 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26ff2779-e4aa-43b8-9704-4def1ae45033-kube-api-access-6pmd6" (OuterVolumeSpecName: "kube-api-access-6pmd6") pod "26ff2779-e4aa-43b8-9704-4def1ae45033" (UID: "26ff2779-e4aa-43b8-9704-4def1ae45033"). InnerVolumeSpecName "kube-api-access-6pmd6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.256015 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26a03664-6cb3-4982-80f5-063d8f12cc2a-kube-api-access-lwjj5" (OuterVolumeSpecName: "kube-api-access-lwjj5") pod "26a03664-6cb3-4982-80f5-063d8f12cc2a" (UID: "26a03664-6cb3-4982-80f5-063d8f12cc2a"). InnerVolumeSpecName "kube-api-access-lwjj5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.258843 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-746gq"] Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.266787 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m5v64\" (UniqueName: \"kubernetes.io/projected/ac8dd629-af3d-4d9c-b41a-f5b8d6d29498-kube-api-access-m5v64\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.266813 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ac8dd629-af3d-4d9c-b41a-f5b8d6d29498-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.266821 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/26ff2779-e4aa-43b8-9704-4def1ae45033-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.266829 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ac8dd629-af3d-4d9c-b41a-f5b8d6d29498-logs\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.266837 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lwjj5\" (UniqueName: \"kubernetes.io/projected/26a03664-6cb3-4982-80f5-063d8f12cc2a-kube-api-access-lwjj5\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.266845 5120 reconciler_common.go:299] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/26ff2779-e4aa-43b8-9704-4def1ae45033-fernet-keys\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.266857 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6pmd6\" (UniqueName: \"kubernetes.io/projected/26ff2779-e4aa-43b8-9704-4def1ae45033-kube-api-access-6pmd6\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.266864 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/26a03664-6cb3-4982-80f5-063d8f12cc2a-logs\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.266872 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/26a03664-6cb3-4982-80f5-063d8f12cc2a-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.266883 5120 reconciler_common.go:299] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/26ff2779-e4aa-43b8-9704-4def1ae45033-credential-keys\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.266911 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-746gq"] Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.291897 5120 generic.go:358] "Generic (PLEG): container finished" podID="ac8dd629-af3d-4d9c-b41a-f5b8d6d29498" containerID="4dec859182aa9185489fadcae215d8674987c3f6d2fb9b2af9889aac1406c176" exitCode=0 Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.292026 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-7956bcf97d-p9m4c" event={"ID":"ac8dd629-af3d-4d9c-b41a-f5b8d6d29498","Type":"ContainerDied","Data":"4dec859182aa9185489fadcae215d8674987c3f6d2fb9b2af9889aac1406c176"} Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.292049 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-7956bcf97d-p9m4c" event={"ID":"ac8dd629-af3d-4d9c-b41a-f5b8d6d29498","Type":"ContainerDied","Data":"cd09ee443eae7f2ab659ca57275ec13c522469184c1ab674e61c677fc582704a"} Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.292116 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-7956bcf97d-p9m4c" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.295130 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-9b99-account-create-update-djffv"] Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.320025 5120 scope.go:117] "RemoveContainer" containerID="d98841f9e46e61836bc62ce9a26e9ee5daf9f80796e5c5c33aaeb58a64ec8ebb" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.320712 5120 generic.go:358] "Generic (PLEG): container finished" podID="26a03664-6cb3-4982-80f5-063d8f12cc2a" containerID="44d0d0f4bb5fea2644a7968ff2c3efd3c765ae9f3e3449bb273203ee91d90f64" exitCode=0 Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.320744 5120 generic.go:358] "Generic (PLEG): container finished" podID="26a03664-6cb3-4982-80f5-063d8f12cc2a" containerID="b4be06dc3760c0f772a705af0e0fca11910d8d85c190b7e9987da3a11afdde37" exitCode=143 Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.320868 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-766fb557cd-fwt4z" event={"ID":"26a03664-6cb3-4982-80f5-063d8f12cc2a","Type":"ContainerDied","Data":"44d0d0f4bb5fea2644a7968ff2c3efd3c765ae9f3e3449bb273203ee91d90f64"} Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.320927 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-766fb557cd-fwt4z" event={"ID":"26a03664-6cb3-4982-80f5-063d8f12cc2a","Type":"ContainerDied","Data":"b4be06dc3760c0f772a705af0e0fca11910d8d85c190b7e9987da3a11afdde37"} Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.320955 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-766fb557cd-fwt4z" event={"ID":"26a03664-6cb3-4982-80f5-063d8f12cc2a","Type":"ContainerDied","Data":"168f973d805b675db2914f28e4ea71abd5da411857a7b7121c0285816c5d2bbc"} Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.321020 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-766fb557cd-fwt4z" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.322219 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-9b99-account-create-update-djffv"] Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.329457 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561274-v5q72" event={"ID":"72052f6a-5423-426f-bdb0-9c9f0609fa34","Type":"ContainerStarted","Data":"dcc3097a7c726c49e3be268efabef04f4de79a03ad0836c25f5186e25dc37590"} Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.332492 5120 generic.go:358] "Generic (PLEG): container finished" podID="5a0edbf7-738f-4c1a-9333-f23da8ab8067" containerID="c2121e4d06f46ee4a9e8ff7fef63a6dbeab5cdae2f5f5e1ffbca0a1570f651e5" exitCode=143 Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.332590 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-7bd99f4458-mgw7m" event={"ID":"5a0edbf7-738f-4c1a-9333-f23da8ab8067","Type":"ContainerDied","Data":"c2121e4d06f46ee4a9e8ff7fef63a6dbeab5cdae2f5f5e1ffbca0a1570f651e5"} Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.346795 5120 generic.go:358] "Generic (PLEG): container finished" podID="d442e64c-a236-4d12-8205-d5cf2cb95748" containerID="0470cfd37685bd89173ba27c32f8e3e3b084af837af4d8097ba45194c409f65b" exitCode=0 Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.346888 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-5f559c8896-5jgnd" event={"ID":"d442e64c-a236-4d12-8205-d5cf2cb95748","Type":"ContainerDied","Data":"0470cfd37685bd89173ba27c32f8e3e3b084af837af4d8097ba45194c409f65b"} Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.346909 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-5f559c8896-5jgnd" event={"ID":"d442e64c-a236-4d12-8205-d5cf2cb95748","Type":"ContainerDied","Data":"7e372a0469bc19a39329cd83e670b9d6f87fab7ad65c731f711a594fe4696311"} Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.346991 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-5f559c8896-5jgnd" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.350480 5120 generic.go:358] "Generic (PLEG): container finished" podID="26ff2779-e4aa-43b8-9704-4def1ae45033" containerID="9ff55543c7123563762eb13f38c5fea05c37774f980b9eaf305d74e4adc20f00" exitCode=0 Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.350722 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-6b877d4f87-4vmvc" event={"ID":"26ff2779-e4aa-43b8-9704-4def1ae45033","Type":"ContainerDied","Data":"9ff55543c7123563762eb13f38c5fea05c37774f980b9eaf305d74e4adc20f00"} Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.350767 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-6b877d4f87-4vmvc" event={"ID":"26ff2779-e4aa-43b8-9704-4def1ae45033","Type":"ContainerDied","Data":"12dab1db1034f0afb2eef326f9d4733e639118c19df114c03faa0fc64e1864ef"} Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.350831 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-6b877d4f87-4vmvc" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.352453 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-a8cd-account-create-update-nbt76"] Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.353915 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-c7cf47df9-t2r2b" event={"ID":"cb293a62-0310-4af8-8376-0b2197bda8d2","Type":"ContainerDied","Data":"2e51728a4a2b7ffe6f2728b86885001e82ac31d9b246434b98744b26f8ac045c"} Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.353983 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-c7cf47df9-t2r2b" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.356548 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-northd-0_6ac49efe-dc8a-47b2-9432-afb41c69ebff/ovn-northd/0.log" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.356686 5120 generic.go:358] "Generic (PLEG): container finished" podID="6ac49efe-dc8a-47b2-9432-afb41c69ebff" containerID="387a7e18b82c50f51c96a48a6b0e06ca0ff7ee666aa82162ae48b3f8a16f6166" exitCode=139 Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.356794 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"6ac49efe-dc8a-47b2-9432-afb41c69ebff","Type":"ContainerDied","Data":"387a7e18b82c50f51c96a48a6b0e06ca0ff7ee666aa82162ae48b3f8a16f6166"} Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.356872 5120 scope.go:117] "RemoveContainer" containerID="bfc23559de2564738a88f0aeabdcc2bd4aadac83b546cb7e03c03224bc801908" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.358002 5120 generic.go:358] "Generic (PLEG): container finished" podID="07b2313a-7b50-4c4a-b485-ef68c88e468a" containerID="497e64e16b22008e1580d7bcf4de8aa734e1762960610ad1eee91171968fbc0a" exitCode=0 Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.358167 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-57d5475c78-rsjsp" event={"ID":"07b2313a-7b50-4c4a-b485-ef68c88e468a","Type":"ContainerDied","Data":"497e64e16b22008e1580d7bcf4de8aa734e1762960610ad1eee91171968fbc0a"} Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.363078 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-a8cd-account-create-update-nbt76"] Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.379325 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" podUID="36a1c719-e302-4df3-99c5-5025d99c8c19" containerName="rabbitmq" probeResult="failure" output="dial tcp 10.217.0.105:5671: connect: connection refused" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.379874 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/rabbitmq-server-0" podUID="39704fdb-36c4-41fe-8c13-35a3abb56c36" containerName="rabbitmq" probeResult="failure" output="dial tcp 10.217.0.104:5671: connect: connection refused" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.384592 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-236f-account-create-update-8gdw9"] Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.390582 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-236f-account-create-update-8gdw9"] Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.393142 5120 scope.go:117] "RemoveContainer" containerID="d98841f9e46e61836bc62ce9a26e9ee5daf9f80796e5c5c33aaeb58a64ec8ebb" Mar 16 15:54:02 crc kubenswrapper[5120]: E0316 15:54:02.397275 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d98841f9e46e61836bc62ce9a26e9ee5daf9f80796e5c5c33aaeb58a64ec8ebb\": container with ID starting with d98841f9e46e61836bc62ce9a26e9ee5daf9f80796e5c5c33aaeb58a64ec8ebb not found: ID does not exist" containerID="d98841f9e46e61836bc62ce9a26e9ee5daf9f80796e5c5c33aaeb58a64ec8ebb" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.397313 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d98841f9e46e61836bc62ce9a26e9ee5daf9f80796e5c5c33aaeb58a64ec8ebb"} err="failed to get container status \"d98841f9e46e61836bc62ce9a26e9ee5daf9f80796e5c5c33aaeb58a64ec8ebb\": rpc error: code = NotFound desc = could not find container \"d98841f9e46e61836bc62ce9a26e9ee5daf9f80796e5c5c33aaeb58a64ec8ebb\": container with ID starting with d98841f9e46e61836bc62ce9a26e9ee5daf9f80796e5c5c33aaeb58a64ec8ebb not found: ID does not exist" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.397335 5120 scope.go:117] "RemoveContainer" containerID="bfc23559de2564738a88f0aeabdcc2bd4aadac83b546cb7e03c03224bc801908" Mar 16 15:54:02 crc kubenswrapper[5120]: E0316 15:54:02.400660 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bfc23559de2564738a88f0aeabdcc2bd4aadac83b546cb7e03c03224bc801908\": container with ID starting with bfc23559de2564738a88f0aeabdcc2bd4aadac83b546cb7e03c03224bc801908 not found: ID does not exist" containerID="bfc23559de2564738a88f0aeabdcc2bd4aadac83b546cb7e03c03224bc801908" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.400684 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bfc23559de2564738a88f0aeabdcc2bd4aadac83b546cb7e03c03224bc801908"} err="failed to get container status \"bfc23559de2564738a88f0aeabdcc2bd4aadac83b546cb7e03c03224bc801908\": rpc error: code = NotFound desc = could not find container \"bfc23559de2564738a88f0aeabdcc2bd4aadac83b546cb7e03c03224bc801908\": container with ID starting with bfc23559de2564738a88f0aeabdcc2bd4aadac83b546cb7e03c03224bc801908 not found: ID does not exist" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.400700 5120 scope.go:117] "RemoveContainer" containerID="4dec859182aa9185489fadcae215d8674987c3f6d2fb9b2af9889aac1406c176" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.412396 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-northd-0_6ac49efe-dc8a-47b2-9432-afb41c69ebff/ovn-northd/0.log" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.412453 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.416513 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-57d5475c78-rsjsp" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.416647 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-0a49-account-create-update-fqp48"] Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.436242 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-0a49-account-create-update-fqp48"] Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.443454 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-proxy-59c794978b-lzrxq"] Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.455834 5120 scope.go:117] "RemoveContainer" containerID="847b3ef9b9ce57593d9c18b6ae192780d0c000dbacbc9f955495006d724af884" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.461943 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/swift-proxy-59c794978b-lzrxq"] Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.474152 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/6ac49efe-dc8a-47b2-9432-afb41c69ebff-ovn-rundir\") pod \"6ac49efe-dc8a-47b2-9432-afb41c69ebff\" (UID: \"6ac49efe-dc8a-47b2-9432-afb41c69ebff\") " Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.474224 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/07b2313a-7b50-4c4a-b485-ef68c88e468a-internal-tls-certs\") pod \"07b2313a-7b50-4c4a-b485-ef68c88e468a\" (UID: \"07b2313a-7b50-4c4a-b485-ef68c88e468a\") " Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.474284 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/6ac49efe-dc8a-47b2-9432-afb41c69ebff-ovn-northd-tls-certs\") pod \"6ac49efe-dc8a-47b2-9432-afb41c69ebff\" (UID: \"6ac49efe-dc8a-47b2-9432-afb41c69ebff\") " Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.474313 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/07b2313a-7b50-4c4a-b485-ef68c88e468a-combined-ca-bundle\") pod \"07b2313a-7b50-4c4a-b485-ef68c88e468a\" (UID: \"07b2313a-7b50-4c4a-b485-ef68c88e468a\") " Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.474361 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/07b2313a-7b50-4c4a-b485-ef68c88e468a-credential-keys\") pod \"07b2313a-7b50-4c4a-b485-ef68c88e468a\" (UID: \"07b2313a-7b50-4c4a-b485-ef68c88e468a\") " Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.474412 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/07b2313a-7b50-4c4a-b485-ef68c88e468a-public-tls-certs\") pod \"07b2313a-7b50-4c4a-b485-ef68c88e468a\" (UID: \"07b2313a-7b50-4c4a-b485-ef68c88e468a\") " Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.474454 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/07b2313a-7b50-4c4a-b485-ef68c88e468a-fernet-keys\") pod \"07b2313a-7b50-4c4a-b485-ef68c88e468a\" (UID: \"07b2313a-7b50-4c4a-b485-ef68c88e468a\") " Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.474515 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/6ac49efe-dc8a-47b2-9432-afb41c69ebff-metrics-certs-tls-certs\") pod \"6ac49efe-dc8a-47b2-9432-afb41c69ebff\" (UID: \"6ac49efe-dc8a-47b2-9432-afb41c69ebff\") " Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.474609 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6ac49efe-dc8a-47b2-9432-afb41c69ebff-config\") pod \"6ac49efe-dc8a-47b2-9432-afb41c69ebff\" (UID: \"6ac49efe-dc8a-47b2-9432-afb41c69ebff\") " Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.474690 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/07b2313a-7b50-4c4a-b485-ef68c88e468a-scripts\") pod \"07b2313a-7b50-4c4a-b485-ef68c88e468a\" (UID: \"07b2313a-7b50-4c4a-b485-ef68c88e468a\") " Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.474734 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/6ac49efe-dc8a-47b2-9432-afb41c69ebff-scripts\") pod \"6ac49efe-dc8a-47b2-9432-afb41c69ebff\" (UID: \"6ac49efe-dc8a-47b2-9432-afb41c69ebff\") " Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.474883 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6lrgt\" (UniqueName: \"kubernetes.io/projected/6ac49efe-dc8a-47b2-9432-afb41c69ebff-kube-api-access-6lrgt\") pod \"6ac49efe-dc8a-47b2-9432-afb41c69ebff\" (UID: \"6ac49efe-dc8a-47b2-9432-afb41c69ebff\") " Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.474927 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6ac49efe-dc8a-47b2-9432-afb41c69ebff-combined-ca-bundle\") pod \"6ac49efe-dc8a-47b2-9432-afb41c69ebff\" (UID: \"6ac49efe-dc8a-47b2-9432-afb41c69ebff\") " Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.475071 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/07b2313a-7b50-4c4a-b485-ef68c88e468a-config-data\") pod \"07b2313a-7b50-4c4a-b485-ef68c88e468a\" (UID: \"07b2313a-7b50-4c4a-b485-ef68c88e468a\") " Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.475107 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rnkpc\" (UniqueName: \"kubernetes.io/projected/07b2313a-7b50-4c4a-b485-ef68c88e468a-kube-api-access-rnkpc\") pod \"07b2313a-7b50-4c4a-b485-ef68c88e468a\" (UID: \"07b2313a-7b50-4c4a-b485-ef68c88e468a\") " Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.475893 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5e604554-8190-4098-a61e-3568489988d0-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.475912 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7jg96\" (UniqueName: \"kubernetes.io/projected/5e604554-8190-4098-a61e-3568489988d0-kube-api-access-7jg96\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.477446 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ac49efe-dc8a-47b2-9432-afb41c69ebff-scripts" (OuterVolumeSpecName: "scripts") pod "6ac49efe-dc8a-47b2-9432-afb41c69ebff" (UID: "6ac49efe-dc8a-47b2-9432-afb41c69ebff"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.481224 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-3f2f-account-create-update-rfgcb"] Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.482927 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ac49efe-dc8a-47b2-9432-afb41c69ebff-kube-api-access-6lrgt" (OuterVolumeSpecName: "kube-api-access-6lrgt") pod "6ac49efe-dc8a-47b2-9432-afb41c69ebff" (UID: "6ac49efe-dc8a-47b2-9432-afb41c69ebff"). InnerVolumeSpecName "kube-api-access-6lrgt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.483887 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ac49efe-dc8a-47b2-9432-afb41c69ebff-config" (OuterVolumeSpecName: "config") pod "6ac49efe-dc8a-47b2-9432-afb41c69ebff" (UID: "6ac49efe-dc8a-47b2-9432-afb41c69ebff"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.484057 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07b2313a-7b50-4c4a-b485-ef68c88e468a-scripts" (OuterVolumeSpecName: "scripts") pod "07b2313a-7b50-4c4a-b485-ef68c88e468a" (UID: "07b2313a-7b50-4c4a-b485-ef68c88e468a"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.486026 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-3f2f-account-create-update-rfgcb"] Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.486485 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07b2313a-7b50-4c4a-b485-ef68c88e468a-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "07b2313a-7b50-4c4a-b485-ef68c88e468a" (UID: "07b2313a-7b50-4c4a-b485-ef68c88e468a"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.488890 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ac49efe-dc8a-47b2-9432-afb41c69ebff-ovn-rundir" (OuterVolumeSpecName: "ovn-rundir") pod "6ac49efe-dc8a-47b2-9432-afb41c69ebff" (UID: "6ac49efe-dc8a-47b2-9432-afb41c69ebff"). InnerVolumeSpecName "ovn-rundir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.498410 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-dd94-account-create-update-l69rr"] Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.524229 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07b2313a-7b50-4c4a-b485-ef68c88e468a-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "07b2313a-7b50-4c4a-b485-ef68c88e468a" (UID: "07b2313a-7b50-4c4a-b485-ef68c88e468a"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.524257 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07b2313a-7b50-4c4a-b485-ef68c88e468a-kube-api-access-rnkpc" (OuterVolumeSpecName: "kube-api-access-rnkpc") pod "07b2313a-7b50-4c4a-b485-ef68c88e468a" (UID: "07b2313a-7b50-4c4a-b485-ef68c88e468a"). InnerVolumeSpecName "kube-api-access-rnkpc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.524820 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-dd94-account-create-update-l69rr"] Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.525865 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d442e64c-a236-4d12-8205-d5cf2cb95748-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "d442e64c-a236-4d12-8205-d5cf2cb95748" (UID: "d442e64c-a236-4d12-8205-d5cf2cb95748"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.532937 5120 scope.go:117] "RemoveContainer" containerID="4dec859182aa9185489fadcae215d8674987c3f6d2fb9b2af9889aac1406c176" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.573816 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-c7cf47df9-t2r2b"] Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.578431 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-worker-c7cf47df9-t2r2b"] Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.578877 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6lrgt\" (UniqueName: \"kubernetes.io/projected/6ac49efe-dc8a-47b2-9432-afb41c69ebff-kube-api-access-6lrgt\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.578900 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rnkpc\" (UniqueName: \"kubernetes.io/projected/07b2313a-7b50-4c4a-b485-ef68c88e468a-kube-api-access-rnkpc\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.578910 5120 reconciler_common.go:299] "Volume detached for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/6ac49efe-dc8a-47b2-9432-afb41c69ebff-ovn-rundir\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.578922 5120 reconciler_common.go:299] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/07b2313a-7b50-4c4a-b485-ef68c88e468a-credential-keys\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.578931 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d442e64c-a236-4d12-8205-d5cf2cb95748-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.578939 5120 reconciler_common.go:299] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/07b2313a-7b50-4c4a-b485-ef68c88e468a-fernet-keys\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.578948 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6ac49efe-dc8a-47b2-9432-afb41c69ebff-config\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.578956 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/07b2313a-7b50-4c4a-b485-ef68c88e468a-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.578964 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/6ac49efe-dc8a-47b2-9432-afb41c69ebff-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:02 crc kubenswrapper[5120]: E0316 15:54:02.765258 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4dec859182aa9185489fadcae215d8674987c3f6d2fb9b2af9889aac1406c176\": container with ID starting with 4dec859182aa9185489fadcae215d8674987c3f6d2fb9b2af9889aac1406c176 not found: ID does not exist" containerID="4dec859182aa9185489fadcae215d8674987c3f6d2fb9b2af9889aac1406c176" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.765317 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4dec859182aa9185489fadcae215d8674987c3f6d2fb9b2af9889aac1406c176"} err="failed to get container status \"4dec859182aa9185489fadcae215d8674987c3f6d2fb9b2af9889aac1406c176\": rpc error: code = NotFound desc = could not find container \"4dec859182aa9185489fadcae215d8674987c3f6d2fb9b2af9889aac1406c176\": container with ID starting with 4dec859182aa9185489fadcae215d8674987c3f6d2fb9b2af9889aac1406c176 not found: ID does not exist" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.765344 5120 scope.go:117] "RemoveContainer" containerID="847b3ef9b9ce57593d9c18b6ae192780d0c000dbacbc9f955495006d724af884" Mar 16 15:54:02 crc kubenswrapper[5120]: E0316 15:54:02.767273 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"847b3ef9b9ce57593d9c18b6ae192780d0c000dbacbc9f955495006d724af884\": container with ID starting with 847b3ef9b9ce57593d9c18b6ae192780d0c000dbacbc9f955495006d724af884 not found: ID does not exist" containerID="847b3ef9b9ce57593d9c18b6ae192780d0c000dbacbc9f955495006d724af884" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.767314 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"847b3ef9b9ce57593d9c18b6ae192780d0c000dbacbc9f955495006d724af884"} err="failed to get container status \"847b3ef9b9ce57593d9c18b6ae192780d0c000dbacbc9f955495006d724af884\": rpc error: code = NotFound desc = could not find container \"847b3ef9b9ce57593d9c18b6ae192780d0c000dbacbc9f955495006d724af884\": container with ID starting with 847b3ef9b9ce57593d9c18b6ae192780d0c000dbacbc9f955495006d724af884 not found: ID does not exist" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.767328 5120 scope.go:117] "RemoveContainer" containerID="44d0d0f4bb5fea2644a7968ff2c3efd3c765ae9f3e3449bb273203ee91d90f64" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.777602 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/26a03664-6cb3-4982-80f5-063d8f12cc2a-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "26a03664-6cb3-4982-80f5-063d8f12cc2a" (UID: "26a03664-6cb3-4982-80f5-063d8f12cc2a"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.779684 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/26a03664-6cb3-4982-80f5-063d8f12cc2a-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "26a03664-6cb3-4982-80f5-063d8f12cc2a" (UID: "26a03664-6cb3-4982-80f5-063d8f12cc2a"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.783971 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d442e64c-a236-4d12-8205-d5cf2cb95748-config-data" (OuterVolumeSpecName: "config-data") pod "d442e64c-a236-4d12-8205-d5cf2cb95748" (UID: "d442e64c-a236-4d12-8205-d5cf2cb95748"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.784348 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/26ff2779-e4aa-43b8-9704-4def1ae45033-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "26ff2779-e4aa-43b8-9704-4def1ae45033" (UID: "26ff2779-e4aa-43b8-9704-4def1ae45033"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.785279 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/26ff2779-e4aa-43b8-9704-4def1ae45033-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.785312 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d442e64c-a236-4d12-8205-d5cf2cb95748-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.785322 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/26a03664-6cb3-4982-80f5-063d8f12cc2a-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.785332 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/26a03664-6cb3-4982-80f5-063d8f12cc2a-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.788543 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0c87b06f-6b7e-46f2-8aee-34285fea622e" path="/var/lib/kubelet/pods/0c87b06f-6b7e-46f2-8aee-34285fea622e/volumes" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.788969 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="19be266e-6805-4342-be0d-7fff0fc81029" path="/var/lib/kubelet/pods/19be266e-6805-4342-be0d-7fff0fc81029/volumes" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.789370 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f3efc59-f473-4fd6-acc0-ce261268d63b" path="/var/lib/kubelet/pods/2f3efc59-f473-4fd6-acc0-ce261268d63b/volumes" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.789956 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3af1f773-b662-412f-820d-bea6ba7e58ca" path="/var/lib/kubelet/pods/3af1f773-b662-412f-820d-bea6ba7e58ca/volumes" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.790260 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5e604554-8190-4098-a61e-3568489988d0" path="/var/lib/kubelet/pods/5e604554-8190-4098-a61e-3568489988d0/volumes" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.790664 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="687a8fb9-59e3-46c6-bdb9-f435b5cb52d9" path="/var/lib/kubelet/pods/687a8fb9-59e3-46c6-bdb9-f435b5cb52d9/volumes" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.791643 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="89c20c31-44e2-4359-b7ee-e2e8b00b4e19" path="/var/lib/kubelet/pods/89c20c31-44e2-4359-b7ee-e2e8b00b4e19/volumes" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.799258 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac8dd629-af3d-4d9c-b41a-f5b8d6d29498-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ac8dd629-af3d-4d9c-b41a-f5b8d6d29498" (UID: "ac8dd629-af3d-4d9c-b41a-f5b8d6d29498"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.799407 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ac88284a-2f9f-4e52-8de4-1c299b94bbd1" path="/var/lib/kubelet/pods/ac88284a-2f9f-4e52-8de4-1c299b94bbd1/volumes" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.800792 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="afa004e7-041e-4f04-8864-7163df19cf53" path="/var/lib/kubelet/pods/afa004e7-041e-4f04-8864-7163df19cf53/volumes" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.801347 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c95ad7ed-1944-4285-9138-0d4b954aa727" path="/var/lib/kubelet/pods/c95ad7ed-1944-4285-9138-0d4b954aa727/volumes" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.802605 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb293a62-0310-4af8-8376-0b2197bda8d2" path="/var/lib/kubelet/pods/cb293a62-0310-4af8-8376-0b2197bda8d2/volumes" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.803282 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac8dd629-af3d-4d9c-b41a-f5b8d6d29498-config-data" (OuterVolumeSpecName: "config-data") pod "ac8dd629-af3d-4d9c-b41a-f5b8d6d29498" (UID: "ac8dd629-af3d-4d9c-b41a-f5b8d6d29498"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.803507 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e0a6dd94-0b6e-446a-924b-a39ce7582090" path="/var/lib/kubelet/pods/e0a6dd94-0b6e-446a-924b-a39ce7582090/volumes" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.804013 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07b2313a-7b50-4c4a-b485-ef68c88e468a-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "07b2313a-7b50-4c4a-b485-ef68c88e468a" (UID: "07b2313a-7b50-4c4a-b485-ef68c88e468a"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.806254 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/26ff2779-e4aa-43b8-9704-4def1ae45033-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "26ff2779-e4aa-43b8-9704-4def1ae45033" (UID: "26ff2779-e4aa-43b8-9704-4def1ae45033"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.807135 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d442e64c-a236-4d12-8205-d5cf2cb95748-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "d442e64c-a236-4d12-8205-d5cf2cb95748" (UID: "d442e64c-a236-4d12-8205-d5cf2cb95748"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.807138 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ac49efe-dc8a-47b2-9432-afb41c69ebff-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "6ac49efe-dc8a-47b2-9432-afb41c69ebff" (UID: "6ac49efe-dc8a-47b2-9432-afb41c69ebff"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.807978 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/26ff2779-e4aa-43b8-9704-4def1ae45033-config-data" (OuterVolumeSpecName: "config-data") pod "26ff2779-e4aa-43b8-9704-4def1ae45033" (UID: "26ff2779-e4aa-43b8-9704-4def1ae45033"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.808818 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d442e64c-a236-4d12-8205-d5cf2cb95748-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "d442e64c-a236-4d12-8205-d5cf2cb95748" (UID: "d442e64c-a236-4d12-8205-d5cf2cb95748"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.812228 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07b2313a-7b50-4c4a-b485-ef68c88e468a-config-data" (OuterVolumeSpecName: "config-data") pod "07b2313a-7b50-4c4a-b485-ef68c88e468a" (UID: "07b2313a-7b50-4c4a-b485-ef68c88e468a"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.814800 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/26a03664-6cb3-4982-80f5-063d8f12cc2a-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "26a03664-6cb3-4982-80f5-063d8f12cc2a" (UID: "26a03664-6cb3-4982-80f5-063d8f12cc2a"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.816040 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/26a03664-6cb3-4982-80f5-063d8f12cc2a-config-data" (OuterVolumeSpecName: "config-data") pod "26a03664-6cb3-4982-80f5-063d8f12cc2a" (UID: "26a03664-6cb3-4982-80f5-063d8f12cc2a"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.822356 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07b2313a-7b50-4c4a-b485-ef68c88e468a-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "07b2313a-7b50-4c4a-b485-ef68c88e468a" (UID: "07b2313a-7b50-4c4a-b485-ef68c88e468a"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.824500 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07b2313a-7b50-4c4a-b485-ef68c88e468a-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "07b2313a-7b50-4c4a-b485-ef68c88e468a" (UID: "07b2313a-7b50-4c4a-b485-ef68c88e468a"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.838534 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/26ff2779-e4aa-43b8-9704-4def1ae45033-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "26ff2779-e4aa-43b8-9704-4def1ae45033" (UID: "26ff2779-e4aa-43b8-9704-4def1ae45033"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.884620 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ac49efe-dc8a-47b2-9432-afb41c69ebff-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "6ac49efe-dc8a-47b2-9432-afb41c69ebff" (UID: "6ac49efe-dc8a-47b2-9432-afb41c69ebff"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.887353 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ac8dd629-af3d-4d9c-b41a-f5b8d6d29498-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.887388 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/07b2313a-7b50-4c4a-b485-ef68c88e468a-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.887397 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ac8dd629-af3d-4d9c-b41a-f5b8d6d29498-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.887409 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/26ff2779-e4aa-43b8-9704-4def1ae45033-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.887418 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/26a03664-6cb3-4982-80f5-063d8f12cc2a-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.887426 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/07b2313a-7b50-4c4a-b485-ef68c88e468a-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.887434 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/07b2313a-7b50-4c4a-b485-ef68c88e468a-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.887442 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/07b2313a-7b50-4c4a-b485-ef68c88e468a-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.887450 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/26ff2779-e4aa-43b8-9704-4def1ae45033-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.887458 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/d442e64c-a236-4d12-8205-d5cf2cb95748-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.887465 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/d442e64c-a236-4d12-8205-d5cf2cb95748-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.887475 5120 reconciler_common.go:299] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/6ac49efe-dc8a-47b2-9432-afb41c69ebff-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.887484 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/26ff2779-e4aa-43b8-9704-4def1ae45033-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.887491 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/26a03664-6cb3-4982-80f5-063d8f12cc2a-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.887499 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6ac49efe-dc8a-47b2-9432-afb41c69ebff-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.895065 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac8dd629-af3d-4d9c-b41a-f5b8d6d29498-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "ac8dd629-af3d-4d9c-b41a-f5b8d6d29498" (UID: "ac8dd629-af3d-4d9c-b41a-f5b8d6d29498"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.896993 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ac49efe-dc8a-47b2-9432-afb41c69ebff-ovn-northd-tls-certs" (OuterVolumeSpecName: "ovn-northd-tls-certs") pod "6ac49efe-dc8a-47b2-9432-afb41c69ebff" (UID: "6ac49efe-dc8a-47b2-9432-afb41c69ebff"). InnerVolumeSpecName "ovn-northd-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.903573 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac8dd629-af3d-4d9c-b41a-f5b8d6d29498-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "ac8dd629-af3d-4d9c-b41a-f5b8d6d29498" (UID: "ac8dd629-af3d-4d9c-b41a-f5b8d6d29498"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.984465 5120 scope.go:117] "RemoveContainer" containerID="b4be06dc3760c0f772a705af0e0fca11910d8d85c190b7e9987da3a11afdde37" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.989289 5120 reconciler_common.go:299] "Volume detached for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/6ac49efe-dc8a-47b2-9432-afb41c69ebff-ovn-northd-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.989321 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/ac8dd629-af3d-4d9c-b41a-f5b8d6d29498-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:02 crc kubenswrapper[5120]: I0316 15:54:02.989334 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ac8dd629-af3d-4d9c-b41a-f5b8d6d29498-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:03 crc kubenswrapper[5120]: I0316 15:54:03.014711 5120 scope.go:117] "RemoveContainer" containerID="44d0d0f4bb5fea2644a7968ff2c3efd3c765ae9f3e3449bb273203ee91d90f64" Mar 16 15:54:03 crc kubenswrapper[5120]: E0316 15:54:03.015125 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"44d0d0f4bb5fea2644a7968ff2c3efd3c765ae9f3e3449bb273203ee91d90f64\": container with ID starting with 44d0d0f4bb5fea2644a7968ff2c3efd3c765ae9f3e3449bb273203ee91d90f64 not found: ID does not exist" containerID="44d0d0f4bb5fea2644a7968ff2c3efd3c765ae9f3e3449bb273203ee91d90f64" Mar 16 15:54:03 crc kubenswrapper[5120]: I0316 15:54:03.015186 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44d0d0f4bb5fea2644a7968ff2c3efd3c765ae9f3e3449bb273203ee91d90f64"} err="failed to get container status \"44d0d0f4bb5fea2644a7968ff2c3efd3c765ae9f3e3449bb273203ee91d90f64\": rpc error: code = NotFound desc = could not find container \"44d0d0f4bb5fea2644a7968ff2c3efd3c765ae9f3e3449bb273203ee91d90f64\": container with ID starting with 44d0d0f4bb5fea2644a7968ff2c3efd3c765ae9f3e3449bb273203ee91d90f64 not found: ID does not exist" Mar 16 15:54:03 crc kubenswrapper[5120]: I0316 15:54:03.015216 5120 scope.go:117] "RemoveContainer" containerID="b4be06dc3760c0f772a705af0e0fca11910d8d85c190b7e9987da3a11afdde37" Mar 16 15:54:03 crc kubenswrapper[5120]: E0316 15:54:03.015481 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b4be06dc3760c0f772a705af0e0fca11910d8d85c190b7e9987da3a11afdde37\": container with ID starting with b4be06dc3760c0f772a705af0e0fca11910d8d85c190b7e9987da3a11afdde37 not found: ID does not exist" containerID="b4be06dc3760c0f772a705af0e0fca11910d8d85c190b7e9987da3a11afdde37" Mar 16 15:54:03 crc kubenswrapper[5120]: I0316 15:54:03.015514 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4be06dc3760c0f772a705af0e0fca11910d8d85c190b7e9987da3a11afdde37"} err="failed to get container status \"b4be06dc3760c0f772a705af0e0fca11910d8d85c190b7e9987da3a11afdde37\": rpc error: code = NotFound desc = could not find container \"b4be06dc3760c0f772a705af0e0fca11910d8d85c190b7e9987da3a11afdde37\": container with ID starting with b4be06dc3760c0f772a705af0e0fca11910d8d85c190b7e9987da3a11afdde37 not found: ID does not exist" Mar 16 15:54:03 crc kubenswrapper[5120]: I0316 15:54:03.015565 5120 scope.go:117] "RemoveContainer" containerID="44d0d0f4bb5fea2644a7968ff2c3efd3c765ae9f3e3449bb273203ee91d90f64" Mar 16 15:54:03 crc kubenswrapper[5120]: I0316 15:54:03.015852 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44d0d0f4bb5fea2644a7968ff2c3efd3c765ae9f3e3449bb273203ee91d90f64"} err="failed to get container status \"44d0d0f4bb5fea2644a7968ff2c3efd3c765ae9f3e3449bb273203ee91d90f64\": rpc error: code = NotFound desc = could not find container \"44d0d0f4bb5fea2644a7968ff2c3efd3c765ae9f3e3449bb273203ee91d90f64\": container with ID starting with 44d0d0f4bb5fea2644a7968ff2c3efd3c765ae9f3e3449bb273203ee91d90f64 not found: ID does not exist" Mar 16 15:54:03 crc kubenswrapper[5120]: I0316 15:54:03.015877 5120 scope.go:117] "RemoveContainer" containerID="b4be06dc3760c0f772a705af0e0fca11910d8d85c190b7e9987da3a11afdde37" Mar 16 15:54:03 crc kubenswrapper[5120]: I0316 15:54:03.016193 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4be06dc3760c0f772a705af0e0fca11910d8d85c190b7e9987da3a11afdde37"} err="failed to get container status \"b4be06dc3760c0f772a705af0e0fca11910d8d85c190b7e9987da3a11afdde37\": rpc error: code = NotFound desc = could not find container \"b4be06dc3760c0f772a705af0e0fca11910d8d85c190b7e9987da3a11afdde37\": container with ID starting with b4be06dc3760c0f772a705af0e0fca11910d8d85c190b7e9987da3a11afdde37 not found: ID does not exist" Mar 16 15:54:03 crc kubenswrapper[5120]: I0316 15:54:03.016220 5120 scope.go:117] "RemoveContainer" containerID="0470cfd37685bd89173ba27c32f8e3e3b084af837af4d8097ba45194c409f65b" Mar 16 15:54:03 crc kubenswrapper[5120]: I0316 15:54:03.057929 5120 scope.go:117] "RemoveContainer" containerID="7173ba4274579607f73bd4022925294671ad0ce2e608f3f2ca430323887062b7" Mar 16 15:54:03 crc kubenswrapper[5120]: I0316 15:54:03.062517 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-6b877d4f87-4vmvc"] Mar 16 15:54:03 crc kubenswrapper[5120]: I0316 15:54:03.073393 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-6b877d4f87-4vmvc"] Mar 16 15:54:03 crc kubenswrapper[5120]: I0316 15:54:03.082525 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-766fb557cd-fwt4z"] Mar 16 15:54:03 crc kubenswrapper[5120]: I0316 15:54:03.083820 5120 scope.go:117] "RemoveContainer" containerID="0470cfd37685bd89173ba27c32f8e3e3b084af837af4d8097ba45194c409f65b" Mar 16 15:54:03 crc kubenswrapper[5120]: E0316 15:54:03.084256 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0470cfd37685bd89173ba27c32f8e3e3b084af837af4d8097ba45194c409f65b\": container with ID starting with 0470cfd37685bd89173ba27c32f8e3e3b084af837af4d8097ba45194c409f65b not found: ID does not exist" containerID="0470cfd37685bd89173ba27c32f8e3e3b084af837af4d8097ba45194c409f65b" Mar 16 15:54:03 crc kubenswrapper[5120]: I0316 15:54:03.084286 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0470cfd37685bd89173ba27c32f8e3e3b084af837af4d8097ba45194c409f65b"} err="failed to get container status \"0470cfd37685bd89173ba27c32f8e3e3b084af837af4d8097ba45194c409f65b\": rpc error: code = NotFound desc = could not find container \"0470cfd37685bd89173ba27c32f8e3e3b084af837af4d8097ba45194c409f65b\": container with ID starting with 0470cfd37685bd89173ba27c32f8e3e3b084af837af4d8097ba45194c409f65b not found: ID does not exist" Mar 16 15:54:03 crc kubenswrapper[5120]: I0316 15:54:03.084309 5120 scope.go:117] "RemoveContainer" containerID="7173ba4274579607f73bd4022925294671ad0ce2e608f3f2ca430323887062b7" Mar 16 15:54:03 crc kubenswrapper[5120]: E0316 15:54:03.084712 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7173ba4274579607f73bd4022925294671ad0ce2e608f3f2ca430323887062b7\": container with ID starting with 7173ba4274579607f73bd4022925294671ad0ce2e608f3f2ca430323887062b7 not found: ID does not exist" containerID="7173ba4274579607f73bd4022925294671ad0ce2e608f3f2ca430323887062b7" Mar 16 15:54:03 crc kubenswrapper[5120]: I0316 15:54:03.084767 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7173ba4274579607f73bd4022925294671ad0ce2e608f3f2ca430323887062b7"} err="failed to get container status \"7173ba4274579607f73bd4022925294671ad0ce2e608f3f2ca430323887062b7\": rpc error: code = NotFound desc = could not find container \"7173ba4274579607f73bd4022925294671ad0ce2e608f3f2ca430323887062b7\": container with ID starting with 7173ba4274579607f73bd4022925294671ad0ce2e608f3f2ca430323887062b7 not found: ID does not exist" Mar 16 15:54:03 crc kubenswrapper[5120]: I0316 15:54:03.084792 5120 scope.go:117] "RemoveContainer" containerID="9ff55543c7123563762eb13f38c5fea05c37774f980b9eaf305d74e4adc20f00" Mar 16 15:54:03 crc kubenswrapper[5120]: I0316 15:54:03.085475 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-api-766fb557cd-fwt4z"] Mar 16 15:54:03 crc kubenswrapper[5120]: I0316 15:54:03.097415 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-5f559c8896-5jgnd"] Mar 16 15:54:03 crc kubenswrapper[5120]: I0316 15:54:03.106062 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-api-5f559c8896-5jgnd"] Mar 16 15:54:03 crc kubenswrapper[5120]: I0316 15:54:03.121037 5120 scope.go:117] "RemoveContainer" containerID="9ff55543c7123563762eb13f38c5fea05c37774f980b9eaf305d74e4adc20f00" Mar 16 15:54:03 crc kubenswrapper[5120]: E0316 15:54:03.121723 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9ff55543c7123563762eb13f38c5fea05c37774f980b9eaf305d74e4adc20f00\": container with ID starting with 9ff55543c7123563762eb13f38c5fea05c37774f980b9eaf305d74e4adc20f00 not found: ID does not exist" containerID="9ff55543c7123563762eb13f38c5fea05c37774f980b9eaf305d74e4adc20f00" Mar 16 15:54:03 crc kubenswrapper[5120]: I0316 15:54:03.121816 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ff55543c7123563762eb13f38c5fea05c37774f980b9eaf305d74e4adc20f00"} err="failed to get container status \"9ff55543c7123563762eb13f38c5fea05c37774f980b9eaf305d74e4adc20f00\": rpc error: code = NotFound desc = could not find container \"9ff55543c7123563762eb13f38c5fea05c37774f980b9eaf305d74e4adc20f00\": container with ID starting with 9ff55543c7123563762eb13f38c5fea05c37774f980b9eaf305d74e4adc20f00 not found: ID does not exist" Mar 16 15:54:03 crc kubenswrapper[5120]: I0316 15:54:03.121842 5120 scope.go:117] "RemoveContainer" containerID="354e037f289bc79961fa099797e6d89c6df4e1e5901656cb22c5c95fe04df07b" Mar 16 15:54:03 crc kubenswrapper[5120]: I0316 15:54:03.140374 5120 scope.go:117] "RemoveContainer" containerID="bf02f4cbf7ce963664b2216d2bb7afe00bfa9ca2fcfe0b5d52f4cbc656f2fe71" Mar 16 15:54:03 crc kubenswrapper[5120]: I0316 15:54:03.228103 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-7956bcf97d-p9m4c"] Mar 16 15:54:03 crc kubenswrapper[5120]: I0316 15:54:03.240330 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-7956bcf97d-p9m4c"] Mar 16 15:54:03 crc kubenswrapper[5120]: I0316 15:54:03.371086 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-xvqbz" event={"ID":"51478cb6-9192-494b-a293-b5cc54cfa9a3","Type":"ContainerStarted","Data":"5da0c0adc79d0587055e00db06bcaf568ffe174df5a0e100eeeafd6c263e0144"} Mar 16 15:54:03 crc kubenswrapper[5120]: I0316 15:54:03.371221 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-xvqbz" Mar 16 15:54:03 crc kubenswrapper[5120]: I0316 15:54:03.376833 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-6646594584-l84r5" event={"ID":"952aeeb8-cdc4-469f-b50b-e5d640adc994","Type":"ContainerStarted","Data":"53da8da602945d2f32ce588fd12de6fc2045a2045006ae3cffcc83004a53d9e9"} Mar 16 15:54:03 crc kubenswrapper[5120]: I0316 15:54:03.376985 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-6646594584-l84r5" podUID="952aeeb8-cdc4-469f-b50b-e5d640adc994" containerName="neutron-api" containerID="cri-o://90d7bd6f5ab887d265aa5f3dcd1136326d78aac9bf8e7ccdb164249f5e00a7cb" gracePeriod=30 Mar 16 15:54:03 crc kubenswrapper[5120]: I0316 15:54:03.377235 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/neutron-6646594584-l84r5" Mar 16 15:54:03 crc kubenswrapper[5120]: I0316 15:54:03.377279 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-6646594584-l84r5" podUID="952aeeb8-cdc4-469f-b50b-e5d640adc994" containerName="neutron-httpd" containerID="cri-o://53da8da602945d2f32ce588fd12de6fc2045a2045006ae3cffcc83004a53d9e9" gracePeriod=30 Mar 16 15:54:03 crc kubenswrapper[5120]: I0316 15:54:03.380703 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561274-v5q72" event={"ID":"72052f6a-5423-426f-bdb0-9c9f0609fa34","Type":"ContainerStarted","Data":"8331d515f903c421e50ffd2fd9f7943630b40337cafd0a18ec3d6ecacfb5bf37"} Mar 16 15:54:03 crc kubenswrapper[5120]: I0316 15:54:03.389333 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-xvqbz" podStartSLOduration=7.389317707 podStartE2EDuration="7.389317707s" podCreationTimestamp="2026-03-16 15:53:56 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:54:03.386624832 +0000 UTC m=+1345.540556479" watchObservedRunningTime="2026-03-16 15:54:03.389317707 +0000 UTC m=+1345.543249364" Mar 16 15:54:03 crc kubenswrapper[5120]: I0316 15:54:03.400576 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-northd-0_6ac49efe-dc8a-47b2-9432-afb41c69ebff/ovn-northd/0.log" Mar 16 15:54:03 crc kubenswrapper[5120]: I0316 15:54:03.400697 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"6ac49efe-dc8a-47b2-9432-afb41c69ebff","Type":"ContainerDied","Data":"27b62e5f00c34b47dbdd5ede6a2eec64a340cb9cc5333de3f39ec1efa1cc93a5"} Mar 16 15:54:03 crc kubenswrapper[5120]: I0316 15:54:03.400734 5120 scope.go:117] "RemoveContainer" containerID="e5f97b4f3579c3f23b60ed73671c3bb6855051e5aa3db9096db0d9f0c8c645c8" Mar 16 15:54:03 crc kubenswrapper[5120]: I0316 15:54:03.400753 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 15:54:03 crc kubenswrapper[5120]: I0316 15:54:03.405668 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-57d5475c78-rsjsp" event={"ID":"07b2313a-7b50-4c4a-b485-ef68c88e468a","Type":"ContainerDied","Data":"74ac48eab51aa4b5c8c154c6b48b3a79705b95009316b32ed6ad9a9ecc510bd4"} Mar 16 15:54:03 crc kubenswrapper[5120]: I0316 15:54:03.405712 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-57d5475c78-rsjsp" Mar 16 15:54:03 crc kubenswrapper[5120]: I0316 15:54:03.407692 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-776d498b58-sb5f8" event={"ID":"2218d5be-dd10-4e4b-87b9-d9a5273bd197","Type":"ContainerStarted","Data":"48b5bfadd956c88e734e78a783f9c3a67b2a409702b7ee057e25cbd08e32d8cc"} Mar 16 15:54:03 crc kubenswrapper[5120]: I0316 15:54:03.407868 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-776d498b58-sb5f8" podUID="2218d5be-dd10-4e4b-87b9-d9a5273bd197" containerName="placement-log" containerID="cri-o://30fcebc78fef297d9597fb81fcfe0c3214bdcd8b95be5f9cf35017195e5e1f4e" gracePeriod=30 Mar 16 15:54:03 crc kubenswrapper[5120]: I0316 15:54:03.408122 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-776d498b58-sb5f8" Mar 16 15:54:03 crc kubenswrapper[5120]: I0316 15:54:03.408152 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-776d498b58-sb5f8" Mar 16 15:54:03 crc kubenswrapper[5120]: I0316 15:54:03.408188 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-776d498b58-sb5f8" podUID="2218d5be-dd10-4e4b-87b9-d9a5273bd197" containerName="placement-api" containerID="cri-o://48b5bfadd956c88e734e78a783f9c3a67b2a409702b7ee057e25cbd08e32d8cc" gracePeriod=30 Mar 16 15:54:03 crc kubenswrapper[5120]: I0316 15:54:03.421911 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-6646594584-l84r5" podStartSLOduration=11.421895238 podStartE2EDuration="11.421895238s" podCreationTimestamp="2026-03-16 15:53:52 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:54:03.420293144 +0000 UTC m=+1345.574224821" watchObservedRunningTime="2026-03-16 15:54:03.421895238 +0000 UTC m=+1345.575826895" Mar 16 15:54:03 crc kubenswrapper[5120]: I0316 15:54:03.434239 5120 scope.go:117] "RemoveContainer" containerID="387a7e18b82c50f51c96a48a6b0e06ca0ff7ee666aa82162ae48b3f8a16f6166" Mar 16 15:54:03 crc kubenswrapper[5120]: I0316 15:54:03.443397 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-776d498b58-sb5f8" podStartSLOduration=11.443382802 podStartE2EDuration="11.443382802s" podCreationTimestamp="2026-03-16 15:53:52 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:54:03.442294302 +0000 UTC m=+1345.596225969" watchObservedRunningTime="2026-03-16 15:54:03.443382802 +0000 UTC m=+1345.597314459" Mar 16 15:54:03 crc kubenswrapper[5120]: I0316 15:54:03.450600 5120 scope.go:117] "RemoveContainer" containerID="497e64e16b22008e1580d7bcf4de8aa734e1762960610ad1eee91171968fbc0a" Mar 16 15:54:03 crc kubenswrapper[5120]: I0316 15:54:03.474932 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 15:54:03 crc kubenswrapper[5120]: I0316 15:54:03.486824 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 15:54:03 crc kubenswrapper[5120]: I0316 15:54:03.493604 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-57d5475c78-rsjsp"] Mar 16 15:54:03 crc kubenswrapper[5120]: I0316 15:54:03.500496 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-57d5475c78-rsjsp"] Mar 16 15:54:04 crc kubenswrapper[5120]: I0316 15:54:04.005562 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-776d498b58-sb5f8" Mar 16 15:54:04 crc kubenswrapper[5120]: I0316 15:54:04.106861 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jz6nq\" (UniqueName: \"kubernetes.io/projected/2218d5be-dd10-4e4b-87b9-d9a5273bd197-kube-api-access-jz6nq\") pod \"2218d5be-dd10-4e4b-87b9-d9a5273bd197\" (UID: \"2218d5be-dd10-4e4b-87b9-d9a5273bd197\") " Mar 16 15:54:04 crc kubenswrapper[5120]: I0316 15:54:04.106923 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2218d5be-dd10-4e4b-87b9-d9a5273bd197-combined-ca-bundle\") pod \"2218d5be-dd10-4e4b-87b9-d9a5273bd197\" (UID: \"2218d5be-dd10-4e4b-87b9-d9a5273bd197\") " Mar 16 15:54:04 crc kubenswrapper[5120]: I0316 15:54:04.107024 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/2218d5be-dd10-4e4b-87b9-d9a5273bd197-public-tls-certs\") pod \"2218d5be-dd10-4e4b-87b9-d9a5273bd197\" (UID: \"2218d5be-dd10-4e4b-87b9-d9a5273bd197\") " Mar 16 15:54:04 crc kubenswrapper[5120]: I0316 15:54:04.107056 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2218d5be-dd10-4e4b-87b9-d9a5273bd197-config-data\") pod \"2218d5be-dd10-4e4b-87b9-d9a5273bd197\" (UID: \"2218d5be-dd10-4e4b-87b9-d9a5273bd197\") " Mar 16 15:54:04 crc kubenswrapper[5120]: I0316 15:54:04.107078 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2218d5be-dd10-4e4b-87b9-d9a5273bd197-scripts\") pod \"2218d5be-dd10-4e4b-87b9-d9a5273bd197\" (UID: \"2218d5be-dd10-4e4b-87b9-d9a5273bd197\") " Mar 16 15:54:04 crc kubenswrapper[5120]: I0316 15:54:04.107165 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/2218d5be-dd10-4e4b-87b9-d9a5273bd197-internal-tls-certs\") pod \"2218d5be-dd10-4e4b-87b9-d9a5273bd197\" (UID: \"2218d5be-dd10-4e4b-87b9-d9a5273bd197\") " Mar 16 15:54:04 crc kubenswrapper[5120]: I0316 15:54:04.107264 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2218d5be-dd10-4e4b-87b9-d9a5273bd197-logs\") pod \"2218d5be-dd10-4e4b-87b9-d9a5273bd197\" (UID: \"2218d5be-dd10-4e4b-87b9-d9a5273bd197\") " Mar 16 15:54:04 crc kubenswrapper[5120]: I0316 15:54:04.107808 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2218d5be-dd10-4e4b-87b9-d9a5273bd197-logs" (OuterVolumeSpecName: "logs") pod "2218d5be-dd10-4e4b-87b9-d9a5273bd197" (UID: "2218d5be-dd10-4e4b-87b9-d9a5273bd197"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:54:04 crc kubenswrapper[5120]: I0316 15:54:04.112557 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2218d5be-dd10-4e4b-87b9-d9a5273bd197-scripts" (OuterVolumeSpecName: "scripts") pod "2218d5be-dd10-4e4b-87b9-d9a5273bd197" (UID: "2218d5be-dd10-4e4b-87b9-d9a5273bd197"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:54:04 crc kubenswrapper[5120]: I0316 15:54:04.120080 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2218d5be-dd10-4e4b-87b9-d9a5273bd197-kube-api-access-jz6nq" (OuterVolumeSpecName: "kube-api-access-jz6nq") pod "2218d5be-dd10-4e4b-87b9-d9a5273bd197" (UID: "2218d5be-dd10-4e4b-87b9-d9a5273bd197"). InnerVolumeSpecName "kube-api-access-jz6nq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:54:04 crc kubenswrapper[5120]: I0316 15:54:04.157892 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2218d5be-dd10-4e4b-87b9-d9a5273bd197-config-data" (OuterVolumeSpecName: "config-data") pod "2218d5be-dd10-4e4b-87b9-d9a5273bd197" (UID: "2218d5be-dd10-4e4b-87b9-d9a5273bd197"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:54:04 crc kubenswrapper[5120]: I0316 15:54:04.189032 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2218d5be-dd10-4e4b-87b9-d9a5273bd197-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "2218d5be-dd10-4e4b-87b9-d9a5273bd197" (UID: "2218d5be-dd10-4e4b-87b9-d9a5273bd197"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:54:04 crc kubenswrapper[5120]: I0316 15:54:04.202842 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2218d5be-dd10-4e4b-87b9-d9a5273bd197-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "2218d5be-dd10-4e4b-87b9-d9a5273bd197" (UID: "2218d5be-dd10-4e4b-87b9-d9a5273bd197"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:54:04 crc kubenswrapper[5120]: I0316 15:54:04.207075 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2218d5be-dd10-4e4b-87b9-d9a5273bd197-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "2218d5be-dd10-4e4b-87b9-d9a5273bd197" (UID: "2218d5be-dd10-4e4b-87b9-d9a5273bd197"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:54:04 crc kubenswrapper[5120]: I0316 15:54:04.209205 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2218d5be-dd10-4e4b-87b9-d9a5273bd197-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:04 crc kubenswrapper[5120]: I0316 15:54:04.209358 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/2218d5be-dd10-4e4b-87b9-d9a5273bd197-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:04 crc kubenswrapper[5120]: I0316 15:54:04.209452 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2218d5be-dd10-4e4b-87b9-d9a5273bd197-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:04 crc kubenswrapper[5120]: I0316 15:54:04.209532 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2218d5be-dd10-4e4b-87b9-d9a5273bd197-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:04 crc kubenswrapper[5120]: I0316 15:54:04.209624 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/2218d5be-dd10-4e4b-87b9-d9a5273bd197-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:04 crc kubenswrapper[5120]: I0316 15:54:04.209709 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2218d5be-dd10-4e4b-87b9-d9a5273bd197-logs\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:04 crc kubenswrapper[5120]: I0316 15:54:04.209820 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jz6nq\" (UniqueName: \"kubernetes.io/projected/2218d5be-dd10-4e4b-87b9-d9a5273bd197-kube-api-access-jz6nq\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:04 crc kubenswrapper[5120]: I0316 15:54:04.428074 5120 generic.go:358] "Generic (PLEG): container finished" podID="2218d5be-dd10-4e4b-87b9-d9a5273bd197" containerID="48b5bfadd956c88e734e78a783f9c3a67b2a409702b7ee057e25cbd08e32d8cc" exitCode=0 Mar 16 15:54:04 crc kubenswrapper[5120]: I0316 15:54:04.428120 5120 generic.go:358] "Generic (PLEG): container finished" podID="2218d5be-dd10-4e4b-87b9-d9a5273bd197" containerID="30fcebc78fef297d9597fb81fcfe0c3214bdcd8b95be5f9cf35017195e5e1f4e" exitCode=143 Mar 16 15:54:04 crc kubenswrapper[5120]: I0316 15:54:04.428391 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-776d498b58-sb5f8" event={"ID":"2218d5be-dd10-4e4b-87b9-d9a5273bd197","Type":"ContainerDied","Data":"48b5bfadd956c88e734e78a783f9c3a67b2a409702b7ee057e25cbd08e32d8cc"} Mar 16 15:54:04 crc kubenswrapper[5120]: I0316 15:54:04.428431 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-776d498b58-sb5f8" event={"ID":"2218d5be-dd10-4e4b-87b9-d9a5273bd197","Type":"ContainerDied","Data":"30fcebc78fef297d9597fb81fcfe0c3214bdcd8b95be5f9cf35017195e5e1f4e"} Mar 16 15:54:04 crc kubenswrapper[5120]: I0316 15:54:04.428451 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-776d498b58-sb5f8" event={"ID":"2218d5be-dd10-4e4b-87b9-d9a5273bd197","Type":"ContainerDied","Data":"eb4746f5c8a26981859798e4d1b795ca3ff05375601e4028f34f54ffc77cb5f0"} Mar 16 15:54:04 crc kubenswrapper[5120]: I0316 15:54:04.428477 5120 scope.go:117] "RemoveContainer" containerID="48b5bfadd956c88e734e78a783f9c3a67b2a409702b7ee057e25cbd08e32d8cc" Mar 16 15:54:04 crc kubenswrapper[5120]: I0316 15:54:04.428627 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-776d498b58-sb5f8" Mar 16 15:54:04 crc kubenswrapper[5120]: I0316 15:54:04.440185 5120 generic.go:358] "Generic (PLEG): container finished" podID="952aeeb8-cdc4-469f-b50b-e5d640adc994" containerID="53da8da602945d2f32ce588fd12de6fc2045a2045006ae3cffcc83004a53d9e9" exitCode=0 Mar 16 15:54:04 crc kubenswrapper[5120]: I0316 15:54:04.440278 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-6646594584-l84r5" event={"ID":"952aeeb8-cdc4-469f-b50b-e5d640adc994","Type":"ContainerDied","Data":"53da8da602945d2f32ce588fd12de6fc2045a2045006ae3cffcc83004a53d9e9"} Mar 16 15:54:04 crc kubenswrapper[5120]: I0316 15:54:04.443148 5120 generic.go:358] "Generic (PLEG): container finished" podID="72052f6a-5423-426f-bdb0-9c9f0609fa34" containerID="8331d515f903c421e50ffd2fd9f7943630b40337cafd0a18ec3d6ecacfb5bf37" exitCode=0 Mar 16 15:54:04 crc kubenswrapper[5120]: I0316 15:54:04.443889 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561274-v5q72" event={"ID":"72052f6a-5423-426f-bdb0-9c9f0609fa34","Type":"ContainerDied","Data":"8331d515f903c421e50ffd2fd9f7943630b40337cafd0a18ec3d6ecacfb5bf37"} Mar 16 15:54:04 crc kubenswrapper[5120]: I0316 15:54:04.470110 5120 scope.go:117] "RemoveContainer" containerID="30fcebc78fef297d9597fb81fcfe0c3214bdcd8b95be5f9cf35017195e5e1f4e" Mar 16 15:54:04 crc kubenswrapper[5120]: I0316 15:54:04.482238 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-776d498b58-sb5f8"] Mar 16 15:54:04 crc kubenswrapper[5120]: I0316 15:54:04.493940 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-776d498b58-sb5f8"] Mar 16 15:54:04 crc kubenswrapper[5120]: I0316 15:54:04.506138 5120 scope.go:117] "RemoveContainer" containerID="48b5bfadd956c88e734e78a783f9c3a67b2a409702b7ee057e25cbd08e32d8cc" Mar 16 15:54:04 crc kubenswrapper[5120]: E0316 15:54:04.506504 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"48b5bfadd956c88e734e78a783f9c3a67b2a409702b7ee057e25cbd08e32d8cc\": container with ID starting with 48b5bfadd956c88e734e78a783f9c3a67b2a409702b7ee057e25cbd08e32d8cc not found: ID does not exist" containerID="48b5bfadd956c88e734e78a783f9c3a67b2a409702b7ee057e25cbd08e32d8cc" Mar 16 15:54:04 crc kubenswrapper[5120]: I0316 15:54:04.506553 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48b5bfadd956c88e734e78a783f9c3a67b2a409702b7ee057e25cbd08e32d8cc"} err="failed to get container status \"48b5bfadd956c88e734e78a783f9c3a67b2a409702b7ee057e25cbd08e32d8cc\": rpc error: code = NotFound desc = could not find container \"48b5bfadd956c88e734e78a783f9c3a67b2a409702b7ee057e25cbd08e32d8cc\": container with ID starting with 48b5bfadd956c88e734e78a783f9c3a67b2a409702b7ee057e25cbd08e32d8cc not found: ID does not exist" Mar 16 15:54:04 crc kubenswrapper[5120]: I0316 15:54:04.506587 5120 scope.go:117] "RemoveContainer" containerID="30fcebc78fef297d9597fb81fcfe0c3214bdcd8b95be5f9cf35017195e5e1f4e" Mar 16 15:54:04 crc kubenswrapper[5120]: E0316 15:54:04.507074 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"30fcebc78fef297d9597fb81fcfe0c3214bdcd8b95be5f9cf35017195e5e1f4e\": container with ID starting with 30fcebc78fef297d9597fb81fcfe0c3214bdcd8b95be5f9cf35017195e5e1f4e not found: ID does not exist" containerID="30fcebc78fef297d9597fb81fcfe0c3214bdcd8b95be5f9cf35017195e5e1f4e" Mar 16 15:54:04 crc kubenswrapper[5120]: I0316 15:54:04.507132 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30fcebc78fef297d9597fb81fcfe0c3214bdcd8b95be5f9cf35017195e5e1f4e"} err="failed to get container status \"30fcebc78fef297d9597fb81fcfe0c3214bdcd8b95be5f9cf35017195e5e1f4e\": rpc error: code = NotFound desc = could not find container \"30fcebc78fef297d9597fb81fcfe0c3214bdcd8b95be5f9cf35017195e5e1f4e\": container with ID starting with 30fcebc78fef297d9597fb81fcfe0c3214bdcd8b95be5f9cf35017195e5e1f4e not found: ID does not exist" Mar 16 15:54:04 crc kubenswrapper[5120]: I0316 15:54:04.507172 5120 scope.go:117] "RemoveContainer" containerID="48b5bfadd956c88e734e78a783f9c3a67b2a409702b7ee057e25cbd08e32d8cc" Mar 16 15:54:04 crc kubenswrapper[5120]: I0316 15:54:04.507461 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48b5bfadd956c88e734e78a783f9c3a67b2a409702b7ee057e25cbd08e32d8cc"} err="failed to get container status \"48b5bfadd956c88e734e78a783f9c3a67b2a409702b7ee057e25cbd08e32d8cc\": rpc error: code = NotFound desc = could not find container \"48b5bfadd956c88e734e78a783f9c3a67b2a409702b7ee057e25cbd08e32d8cc\": container with ID starting with 48b5bfadd956c88e734e78a783f9c3a67b2a409702b7ee057e25cbd08e32d8cc not found: ID does not exist" Mar 16 15:54:04 crc kubenswrapper[5120]: I0316 15:54:04.507483 5120 scope.go:117] "RemoveContainer" containerID="30fcebc78fef297d9597fb81fcfe0c3214bdcd8b95be5f9cf35017195e5e1f4e" Mar 16 15:54:04 crc kubenswrapper[5120]: I0316 15:54:04.507898 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30fcebc78fef297d9597fb81fcfe0c3214bdcd8b95be5f9cf35017195e5e1f4e"} err="failed to get container status \"30fcebc78fef297d9597fb81fcfe0c3214bdcd8b95be5f9cf35017195e5e1f4e\": rpc error: code = NotFound desc = could not find container \"30fcebc78fef297d9597fb81fcfe0c3214bdcd8b95be5f9cf35017195e5e1f4e\": container with ID starting with 30fcebc78fef297d9597fb81fcfe0c3214bdcd8b95be5f9cf35017195e5e1f4e not found: ID does not exist" Mar 16 15:54:04 crc kubenswrapper[5120]: I0316 15:54:04.677665 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="07b2313a-7b50-4c4a-b485-ef68c88e468a" path="/var/lib/kubelet/pods/07b2313a-7b50-4c4a-b485-ef68c88e468a/volumes" Mar 16 15:54:04 crc kubenswrapper[5120]: I0316 15:54:04.679067 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2218d5be-dd10-4e4b-87b9-d9a5273bd197" path="/var/lib/kubelet/pods/2218d5be-dd10-4e4b-87b9-d9a5273bd197/volumes" Mar 16 15:54:04 crc kubenswrapper[5120]: I0316 15:54:04.680105 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="26a03664-6cb3-4982-80f5-063d8f12cc2a" path="/var/lib/kubelet/pods/26a03664-6cb3-4982-80f5-063d8f12cc2a/volumes" Mar 16 15:54:04 crc kubenswrapper[5120]: I0316 15:54:04.681588 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="26ff2779-e4aa-43b8-9704-4def1ae45033" path="/var/lib/kubelet/pods/26ff2779-e4aa-43b8-9704-4def1ae45033/volumes" Mar 16 15:54:04 crc kubenswrapper[5120]: I0316 15:54:04.682443 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ac49efe-dc8a-47b2-9432-afb41c69ebff" path="/var/lib/kubelet/pods/6ac49efe-dc8a-47b2-9432-afb41c69ebff/volumes" Mar 16 15:54:04 crc kubenswrapper[5120]: I0316 15:54:04.683716 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ac8dd629-af3d-4d9c-b41a-f5b8d6d29498" path="/var/lib/kubelet/pods/ac8dd629-af3d-4d9c-b41a-f5b8d6d29498/volumes" Mar 16 15:54:04 crc kubenswrapper[5120]: I0316 15:54:04.685115 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d442e64c-a236-4d12-8205-d5cf2cb95748" path="/var/lib/kubelet/pods/d442e64c-a236-4d12-8205-d5cf2cb95748/volumes" Mar 16 15:54:04 crc kubenswrapper[5120]: I0316 15:54:04.852658 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561274-v5q72" Mar 16 15:54:04 crc kubenswrapper[5120]: I0316 15:54:04.924417 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ft6g4\" (UniqueName: \"kubernetes.io/projected/72052f6a-5423-426f-bdb0-9c9f0609fa34-kube-api-access-ft6g4\") pod \"72052f6a-5423-426f-bdb0-9c9f0609fa34\" (UID: \"72052f6a-5423-426f-bdb0-9c9f0609fa34\") " Mar 16 15:54:04 crc kubenswrapper[5120]: I0316 15:54:04.930617 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72052f6a-5423-426f-bdb0-9c9f0609fa34-kube-api-access-ft6g4" (OuterVolumeSpecName: "kube-api-access-ft6g4") pod "72052f6a-5423-426f-bdb0-9c9f0609fa34" (UID: "72052f6a-5423-426f-bdb0-9c9f0609fa34"). InnerVolumeSpecName "kube-api-access-ft6g4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:54:05 crc kubenswrapper[5120]: I0316 15:54:05.026658 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ft6g4\" (UniqueName: \"kubernetes.io/projected/72052f6a-5423-426f-bdb0-9c9f0609fa34-kube-api-access-ft6g4\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:05 crc kubenswrapper[5120]: I0316 15:54:05.475058 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561274-v5q72" Mar 16 15:54:05 crc kubenswrapper[5120]: I0316 15:54:05.475053 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561274-v5q72" event={"ID":"72052f6a-5423-426f-bdb0-9c9f0609fa34","Type":"ContainerDied","Data":"dcc3097a7c726c49e3be268efabef04f4de79a03ad0836c25f5186e25dc37590"} Mar 16 15:54:05 crc kubenswrapper[5120]: I0316 15:54:05.475236 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dcc3097a7c726c49e3be268efabef04f4de79a03ad0836c25f5186e25dc37590" Mar 16 15:54:05 crc kubenswrapper[5120]: I0316 15:54:05.478197 5120 generic.go:358] "Generic (PLEG): container finished" podID="39704fdb-36c4-41fe-8c13-35a3abb56c36" containerID="0a03aa8f3a904e42190911fb4d58ece9e870ad8d6392509fc8eb0208c1ebf2c3" exitCode=0 Mar 16 15:54:05 crc kubenswrapper[5120]: I0316 15:54:05.478297 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"39704fdb-36c4-41fe-8c13-35a3abb56c36","Type":"ContainerDied","Data":"0a03aa8f3a904e42190911fb4d58ece9e870ad8d6392509fc8eb0208c1ebf2c3"} Mar 16 15:54:05 crc kubenswrapper[5120]: I0316 15:54:05.917186 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-infra/auto-csr-approver-29561268-lkp5k"] Mar 16 15:54:05 crc kubenswrapper[5120]: I0316 15:54:05.921529 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-infra/auto-csr-approver-29561268-lkp5k"] Mar 16 15:54:05 crc kubenswrapper[5120]: I0316 15:54:05.928087 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 15:54:05 crc kubenswrapper[5120]: E0316 15:54:05.942956 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Mar 16 15:54:05 crc kubenswrapper[5120]: E0316 15:54:05.943047 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/36a1c719-e302-4df3-99c5-5025d99c8c19-config-data podName:36a1c719-e302-4df3-99c5-5025d99c8c19 nodeName:}" failed. No retries permitted until 2026-03-16 15:54:13.943023838 +0000 UTC m=+1356.096955525 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/36a1c719-e302-4df3-99c5-5025d99c8c19-config-data") pod "rabbitmq-cell1-server-0" (UID: "36a1c719-e302-4df3-99c5-5025d99c8c19") : configmap "rabbitmq-cell1-config-data" not found Mar 16 15:54:06 crc kubenswrapper[5120]: I0316 15:54:06.043664 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/39704fdb-36c4-41fe-8c13-35a3abb56c36-rabbitmq-erlang-cookie\") pod \"39704fdb-36c4-41fe-8c13-35a3abb56c36\" (UID: \"39704fdb-36c4-41fe-8c13-35a3abb56c36\") " Mar 16 15:54:06 crc kubenswrapper[5120]: I0316 15:54:06.043798 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/39704fdb-36c4-41fe-8c13-35a3abb56c36-server-conf\") pod \"39704fdb-36c4-41fe-8c13-35a3abb56c36\" (UID: \"39704fdb-36c4-41fe-8c13-35a3abb56c36\") " Mar 16 15:54:06 crc kubenswrapper[5120]: I0316 15:54:06.043846 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dw8vt\" (UniqueName: \"kubernetes.io/projected/39704fdb-36c4-41fe-8c13-35a3abb56c36-kube-api-access-dw8vt\") pod \"39704fdb-36c4-41fe-8c13-35a3abb56c36\" (UID: \"39704fdb-36c4-41fe-8c13-35a3abb56c36\") " Mar 16 15:54:06 crc kubenswrapper[5120]: I0316 15:54:06.043905 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/39704fdb-36c4-41fe-8c13-35a3abb56c36-rabbitmq-tls\") pod \"39704fdb-36c4-41fe-8c13-35a3abb56c36\" (UID: \"39704fdb-36c4-41fe-8c13-35a3abb56c36\") " Mar 16 15:54:06 crc kubenswrapper[5120]: I0316 15:54:06.043922 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/39704fdb-36c4-41fe-8c13-35a3abb56c36-config-data\") pod \"39704fdb-36c4-41fe-8c13-35a3abb56c36\" (UID: \"39704fdb-36c4-41fe-8c13-35a3abb56c36\") " Mar 16 15:54:06 crc kubenswrapper[5120]: I0316 15:54:06.044268 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39704fdb-36c4-41fe-8c13-35a3abb56c36-rabbitmq-erlang-cookie" (OuterVolumeSpecName: "rabbitmq-erlang-cookie") pod "39704fdb-36c4-41fe-8c13-35a3abb56c36" (UID: "39704fdb-36c4-41fe-8c13-35a3abb56c36"). InnerVolumeSpecName "rabbitmq-erlang-cookie". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:54:06 crc kubenswrapper[5120]: I0316 15:54:06.044610 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"persistence\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"39704fdb-36c4-41fe-8c13-35a3abb56c36\" (UID: \"39704fdb-36c4-41fe-8c13-35a3abb56c36\") " Mar 16 15:54:06 crc kubenswrapper[5120]: I0316 15:54:06.044659 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/39704fdb-36c4-41fe-8c13-35a3abb56c36-rabbitmq-plugins\") pod \"39704fdb-36c4-41fe-8c13-35a3abb56c36\" (UID: \"39704fdb-36c4-41fe-8c13-35a3abb56c36\") " Mar 16 15:54:06 crc kubenswrapper[5120]: I0316 15:54:06.044677 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/39704fdb-36c4-41fe-8c13-35a3abb56c36-plugins-conf\") pod \"39704fdb-36c4-41fe-8c13-35a3abb56c36\" (UID: \"39704fdb-36c4-41fe-8c13-35a3abb56c36\") " Mar 16 15:54:06 crc kubenswrapper[5120]: I0316 15:54:06.044723 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/39704fdb-36c4-41fe-8c13-35a3abb56c36-rabbitmq-confd\") pod \"39704fdb-36c4-41fe-8c13-35a3abb56c36\" (UID: \"39704fdb-36c4-41fe-8c13-35a3abb56c36\") " Mar 16 15:54:06 crc kubenswrapper[5120]: I0316 15:54:06.044850 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/39704fdb-36c4-41fe-8c13-35a3abb56c36-erlang-cookie-secret\") pod \"39704fdb-36c4-41fe-8c13-35a3abb56c36\" (UID: \"39704fdb-36c4-41fe-8c13-35a3abb56c36\") " Mar 16 15:54:06 crc kubenswrapper[5120]: I0316 15:54:06.044889 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/39704fdb-36c4-41fe-8c13-35a3abb56c36-pod-info\") pod \"39704fdb-36c4-41fe-8c13-35a3abb56c36\" (UID: \"39704fdb-36c4-41fe-8c13-35a3abb56c36\") " Mar 16 15:54:06 crc kubenswrapper[5120]: I0316 15:54:06.045179 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39704fdb-36c4-41fe-8c13-35a3abb56c36-rabbitmq-plugins" (OuterVolumeSpecName: "rabbitmq-plugins") pod "39704fdb-36c4-41fe-8c13-35a3abb56c36" (UID: "39704fdb-36c4-41fe-8c13-35a3abb56c36"). InnerVolumeSpecName "rabbitmq-plugins". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:54:06 crc kubenswrapper[5120]: I0316 15:54:06.045361 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/39704fdb-36c4-41fe-8c13-35a3abb56c36-rabbitmq-plugins\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:06 crc kubenswrapper[5120]: I0316 15:54:06.045375 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/39704fdb-36c4-41fe-8c13-35a3abb56c36-rabbitmq-erlang-cookie\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:06 crc kubenswrapper[5120]: I0316 15:54:06.050447 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39704fdb-36c4-41fe-8c13-35a3abb56c36-plugins-conf" (OuterVolumeSpecName: "plugins-conf") pod "39704fdb-36c4-41fe-8c13-35a3abb56c36" (UID: "39704fdb-36c4-41fe-8c13-35a3abb56c36"). InnerVolumeSpecName "plugins-conf". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:54:06 crc kubenswrapper[5120]: I0316 15:54:06.050570 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39704fdb-36c4-41fe-8c13-35a3abb56c36-kube-api-access-dw8vt" (OuterVolumeSpecName: "kube-api-access-dw8vt") pod "39704fdb-36c4-41fe-8c13-35a3abb56c36" (UID: "39704fdb-36c4-41fe-8c13-35a3abb56c36"). InnerVolumeSpecName "kube-api-access-dw8vt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:54:06 crc kubenswrapper[5120]: I0316 15:54:06.050999 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39704fdb-36c4-41fe-8c13-35a3abb56c36-rabbitmq-tls" (OuterVolumeSpecName: "rabbitmq-tls") pod "39704fdb-36c4-41fe-8c13-35a3abb56c36" (UID: "39704fdb-36c4-41fe-8c13-35a3abb56c36"). InnerVolumeSpecName "rabbitmq-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:54:06 crc kubenswrapper[5120]: I0316 15:54:06.051157 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/39704fdb-36c4-41fe-8c13-35a3abb56c36-pod-info" (OuterVolumeSpecName: "pod-info") pod "39704fdb-36c4-41fe-8c13-35a3abb56c36" (UID: "39704fdb-36c4-41fe-8c13-35a3abb56c36"). InnerVolumeSpecName "pod-info". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Mar 16 15:54:06 crc kubenswrapper[5120]: I0316 15:54:06.052706 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/39704fdb-36c4-41fe-8c13-35a3abb56c36-erlang-cookie-secret" (OuterVolumeSpecName: "erlang-cookie-secret") pod "39704fdb-36c4-41fe-8c13-35a3abb56c36" (UID: "39704fdb-36c4-41fe-8c13-35a3abb56c36"). InnerVolumeSpecName "erlang-cookie-secret". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:54:06 crc kubenswrapper[5120]: I0316 15:54:06.054524 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage08-crc" (OuterVolumeSpecName: "persistence") pod "39704fdb-36c4-41fe-8c13-35a3abb56c36" (UID: "39704fdb-36c4-41fe-8c13-35a3abb56c36"). InnerVolumeSpecName "local-storage08-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 15:54:06 crc kubenswrapper[5120]: I0316 15:54:06.081211 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39704fdb-36c4-41fe-8c13-35a3abb56c36-config-data" (OuterVolumeSpecName: "config-data") pod "39704fdb-36c4-41fe-8c13-35a3abb56c36" (UID: "39704fdb-36c4-41fe-8c13-35a3abb56c36"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:54:06 crc kubenswrapper[5120]: I0316 15:54:06.095854 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39704fdb-36c4-41fe-8c13-35a3abb56c36-server-conf" (OuterVolumeSpecName: "server-conf") pod "39704fdb-36c4-41fe-8c13-35a3abb56c36" (UID: "39704fdb-36c4-41fe-8c13-35a3abb56c36"). InnerVolumeSpecName "server-conf". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:54:06 crc kubenswrapper[5120]: I0316 15:54:06.137213 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39704fdb-36c4-41fe-8c13-35a3abb56c36-rabbitmq-confd" (OuterVolumeSpecName: "rabbitmq-confd") pod "39704fdb-36c4-41fe-8c13-35a3abb56c36" (UID: "39704fdb-36c4-41fe-8c13-35a3abb56c36"). InnerVolumeSpecName "rabbitmq-confd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:54:06 crc kubenswrapper[5120]: I0316 15:54:06.147276 5120 reconciler_common.go:299] "Volume detached for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/39704fdb-36c4-41fe-8c13-35a3abb56c36-erlang-cookie-secret\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:06 crc kubenswrapper[5120]: I0316 15:54:06.147301 5120 reconciler_common.go:299] "Volume detached for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/39704fdb-36c4-41fe-8c13-35a3abb56c36-pod-info\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:06 crc kubenswrapper[5120]: I0316 15:54:06.147309 5120 reconciler_common.go:299] "Volume detached for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/39704fdb-36c4-41fe-8c13-35a3abb56c36-server-conf\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:06 crc kubenswrapper[5120]: I0316 15:54:06.147317 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dw8vt\" (UniqueName: \"kubernetes.io/projected/39704fdb-36c4-41fe-8c13-35a3abb56c36-kube-api-access-dw8vt\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:06 crc kubenswrapper[5120]: I0316 15:54:06.147327 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/39704fdb-36c4-41fe-8c13-35a3abb56c36-rabbitmq-tls\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:06 crc kubenswrapper[5120]: I0316 15:54:06.147335 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/39704fdb-36c4-41fe-8c13-35a3abb56c36-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:06 crc kubenswrapper[5120]: I0316 15:54:06.147357 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") on node \"crc\" " Mar 16 15:54:06 crc kubenswrapper[5120]: I0316 15:54:06.147365 5120 reconciler_common.go:299] "Volume detached for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/39704fdb-36c4-41fe-8c13-35a3abb56c36-plugins-conf\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:06 crc kubenswrapper[5120]: I0316 15:54:06.147373 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/39704fdb-36c4-41fe-8c13-35a3abb56c36-rabbitmq-confd\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:06 crc kubenswrapper[5120]: I0316 15:54:06.163824 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage08-crc" (UniqueName: "kubernetes.io/local-volume/local-storage08-crc") on node "crc" Mar 16 15:54:06 crc kubenswrapper[5120]: I0316 15:54:06.233030 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 15:54:06 crc kubenswrapper[5120]: I0316 15:54:06.249441 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:06 crc kubenswrapper[5120]: I0316 15:54:06.350647 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/36a1c719-e302-4df3-99c5-5025d99c8c19-server-conf\") pod \"36a1c719-e302-4df3-99c5-5025d99c8c19\" (UID: \"36a1c719-e302-4df3-99c5-5025d99c8c19\") " Mar 16 15:54:06 crc kubenswrapper[5120]: I0316 15:54:06.350752 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/36a1c719-e302-4df3-99c5-5025d99c8c19-rabbitmq-confd\") pod \"36a1c719-e302-4df3-99c5-5025d99c8c19\" (UID: \"36a1c719-e302-4df3-99c5-5025d99c8c19\") " Mar 16 15:54:06 crc kubenswrapper[5120]: I0316 15:54:06.350970 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/36a1c719-e302-4df3-99c5-5025d99c8c19-plugins-conf\") pod \"36a1c719-e302-4df3-99c5-5025d99c8c19\" (UID: \"36a1c719-e302-4df3-99c5-5025d99c8c19\") " Mar 16 15:54:06 crc kubenswrapper[5120]: I0316 15:54:06.351019 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/36a1c719-e302-4df3-99c5-5025d99c8c19-rabbitmq-plugins\") pod \"36a1c719-e302-4df3-99c5-5025d99c8c19\" (UID: \"36a1c719-e302-4df3-99c5-5025d99c8c19\") " Mar 16 15:54:06 crc kubenswrapper[5120]: I0316 15:54:06.351080 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/36a1c719-e302-4df3-99c5-5025d99c8c19-pod-info\") pod \"36a1c719-e302-4df3-99c5-5025d99c8c19\" (UID: \"36a1c719-e302-4df3-99c5-5025d99c8c19\") " Mar 16 15:54:06 crc kubenswrapper[5120]: I0316 15:54:06.351107 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hmhsd\" (UniqueName: \"kubernetes.io/projected/36a1c719-e302-4df3-99c5-5025d99c8c19-kube-api-access-hmhsd\") pod \"36a1c719-e302-4df3-99c5-5025d99c8c19\" (UID: \"36a1c719-e302-4df3-99c5-5025d99c8c19\") " Mar 16 15:54:06 crc kubenswrapper[5120]: I0316 15:54:06.351132 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"persistence\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"36a1c719-e302-4df3-99c5-5025d99c8c19\" (UID: \"36a1c719-e302-4df3-99c5-5025d99c8c19\") " Mar 16 15:54:06 crc kubenswrapper[5120]: I0316 15:54:06.351205 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/36a1c719-e302-4df3-99c5-5025d99c8c19-rabbitmq-erlang-cookie\") pod \"36a1c719-e302-4df3-99c5-5025d99c8c19\" (UID: \"36a1c719-e302-4df3-99c5-5025d99c8c19\") " Mar 16 15:54:06 crc kubenswrapper[5120]: I0316 15:54:06.351231 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/36a1c719-e302-4df3-99c5-5025d99c8c19-rabbitmq-tls\") pod \"36a1c719-e302-4df3-99c5-5025d99c8c19\" (UID: \"36a1c719-e302-4df3-99c5-5025d99c8c19\") " Mar 16 15:54:06 crc kubenswrapper[5120]: I0316 15:54:06.351255 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/36a1c719-e302-4df3-99c5-5025d99c8c19-config-data\") pod \"36a1c719-e302-4df3-99c5-5025d99c8c19\" (UID: \"36a1c719-e302-4df3-99c5-5025d99c8c19\") " Mar 16 15:54:06 crc kubenswrapper[5120]: I0316 15:54:06.351274 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/36a1c719-e302-4df3-99c5-5025d99c8c19-erlang-cookie-secret\") pod \"36a1c719-e302-4df3-99c5-5025d99c8c19\" (UID: \"36a1c719-e302-4df3-99c5-5025d99c8c19\") " Mar 16 15:54:06 crc kubenswrapper[5120]: I0316 15:54:06.352166 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36a1c719-e302-4df3-99c5-5025d99c8c19-plugins-conf" (OuterVolumeSpecName: "plugins-conf") pod "36a1c719-e302-4df3-99c5-5025d99c8c19" (UID: "36a1c719-e302-4df3-99c5-5025d99c8c19"). InnerVolumeSpecName "plugins-conf". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:54:06 crc kubenswrapper[5120]: I0316 15:54:06.352971 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36a1c719-e302-4df3-99c5-5025d99c8c19-rabbitmq-erlang-cookie" (OuterVolumeSpecName: "rabbitmq-erlang-cookie") pod "36a1c719-e302-4df3-99c5-5025d99c8c19" (UID: "36a1c719-e302-4df3-99c5-5025d99c8c19"). InnerVolumeSpecName "rabbitmq-erlang-cookie". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:54:06 crc kubenswrapper[5120]: I0316 15:54:06.352930 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36a1c719-e302-4df3-99c5-5025d99c8c19-rabbitmq-plugins" (OuterVolumeSpecName: "rabbitmq-plugins") pod "36a1c719-e302-4df3-99c5-5025d99c8c19" (UID: "36a1c719-e302-4df3-99c5-5025d99c8c19"). InnerVolumeSpecName "rabbitmq-plugins". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:54:06 crc kubenswrapper[5120]: I0316 15:54:06.356153 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36a1c719-e302-4df3-99c5-5025d99c8c19-erlang-cookie-secret" (OuterVolumeSpecName: "erlang-cookie-secret") pod "36a1c719-e302-4df3-99c5-5025d99c8c19" (UID: "36a1c719-e302-4df3-99c5-5025d99c8c19"). InnerVolumeSpecName "erlang-cookie-secret". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:54:06 crc kubenswrapper[5120]: I0316 15:54:06.356365 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage01-crc" (OuterVolumeSpecName: "persistence") pod "36a1c719-e302-4df3-99c5-5025d99c8c19" (UID: "36a1c719-e302-4df3-99c5-5025d99c8c19"). InnerVolumeSpecName "local-storage01-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 15:54:06 crc kubenswrapper[5120]: I0316 15:54:06.357888 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36a1c719-e302-4df3-99c5-5025d99c8c19-kube-api-access-hmhsd" (OuterVolumeSpecName: "kube-api-access-hmhsd") pod "36a1c719-e302-4df3-99c5-5025d99c8c19" (UID: "36a1c719-e302-4df3-99c5-5025d99c8c19"). InnerVolumeSpecName "kube-api-access-hmhsd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:54:06 crc kubenswrapper[5120]: I0316 15:54:06.357911 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/36a1c719-e302-4df3-99c5-5025d99c8c19-pod-info" (OuterVolumeSpecName: "pod-info") pod "36a1c719-e302-4df3-99c5-5025d99c8c19" (UID: "36a1c719-e302-4df3-99c5-5025d99c8c19"). InnerVolumeSpecName "pod-info". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Mar 16 15:54:06 crc kubenswrapper[5120]: I0316 15:54:06.358574 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36a1c719-e302-4df3-99c5-5025d99c8c19-rabbitmq-tls" (OuterVolumeSpecName: "rabbitmq-tls") pod "36a1c719-e302-4df3-99c5-5025d99c8c19" (UID: "36a1c719-e302-4df3-99c5-5025d99c8c19"). InnerVolumeSpecName "rabbitmq-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:54:06 crc kubenswrapper[5120]: I0316 15:54:06.371106 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36a1c719-e302-4df3-99c5-5025d99c8c19-config-data" (OuterVolumeSpecName: "config-data") pod "36a1c719-e302-4df3-99c5-5025d99c8c19" (UID: "36a1c719-e302-4df3-99c5-5025d99c8c19"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:54:06 crc kubenswrapper[5120]: I0316 15:54:06.401937 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36a1c719-e302-4df3-99c5-5025d99c8c19-server-conf" (OuterVolumeSpecName: "server-conf") pod "36a1c719-e302-4df3-99c5-5025d99c8c19" (UID: "36a1c719-e302-4df3-99c5-5025d99c8c19"). InnerVolumeSpecName "server-conf". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:54:06 crc kubenswrapper[5120]: I0316 15:54:06.453713 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/36a1c719-e302-4df3-99c5-5025d99c8c19-rabbitmq-plugins\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:06 crc kubenswrapper[5120]: I0316 15:54:06.453791 5120 reconciler_common.go:299] "Volume detached for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/36a1c719-e302-4df3-99c5-5025d99c8c19-pod-info\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:06 crc kubenswrapper[5120]: I0316 15:54:06.453809 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hmhsd\" (UniqueName: \"kubernetes.io/projected/36a1c719-e302-4df3-99c5-5025d99c8c19-kube-api-access-hmhsd\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:06 crc kubenswrapper[5120]: I0316 15:54:06.453868 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") on node \"crc\" " Mar 16 15:54:06 crc kubenswrapper[5120]: I0316 15:54:06.453887 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/36a1c719-e302-4df3-99c5-5025d99c8c19-rabbitmq-erlang-cookie\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:06 crc kubenswrapper[5120]: I0316 15:54:06.453905 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/36a1c719-e302-4df3-99c5-5025d99c8c19-rabbitmq-tls\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:06 crc kubenswrapper[5120]: I0316 15:54:06.453921 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/36a1c719-e302-4df3-99c5-5025d99c8c19-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:06 crc kubenswrapper[5120]: I0316 15:54:06.453938 5120 reconciler_common.go:299] "Volume detached for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/36a1c719-e302-4df3-99c5-5025d99c8c19-erlang-cookie-secret\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:06 crc kubenswrapper[5120]: I0316 15:54:06.453953 5120 reconciler_common.go:299] "Volume detached for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/36a1c719-e302-4df3-99c5-5025d99c8c19-server-conf\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:06 crc kubenswrapper[5120]: I0316 15:54:06.453968 5120 reconciler_common.go:299] "Volume detached for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/36a1c719-e302-4df3-99c5-5025d99c8c19-plugins-conf\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:06 crc kubenswrapper[5120]: I0316 15:54:06.474633 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36a1c719-e302-4df3-99c5-5025d99c8c19-rabbitmq-confd" (OuterVolumeSpecName: "rabbitmq-confd") pod "36a1c719-e302-4df3-99c5-5025d99c8c19" (UID: "36a1c719-e302-4df3-99c5-5025d99c8c19"). InnerVolumeSpecName "rabbitmq-confd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:54:06 crc kubenswrapper[5120]: I0316 15:54:06.477675 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage01-crc" (UniqueName: "kubernetes.io/local-volume/local-storage01-crc") on node "crc" Mar 16 15:54:06 crc kubenswrapper[5120]: I0316 15:54:06.494546 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"39704fdb-36c4-41fe-8c13-35a3abb56c36","Type":"ContainerDied","Data":"08e9d220be08c78853179ffc3de22d9096fe16e5752598b66ae55a1717adfb01"} Mar 16 15:54:06 crc kubenswrapper[5120]: I0316 15:54:06.494605 5120 scope.go:117] "RemoveContainer" containerID="0a03aa8f3a904e42190911fb4d58ece9e870ad8d6392509fc8eb0208c1ebf2c3" Mar 16 15:54:06 crc kubenswrapper[5120]: I0316 15:54:06.494644 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 15:54:06 crc kubenswrapper[5120]: I0316 15:54:06.498880 5120 generic.go:358] "Generic (PLEG): container finished" podID="36a1c719-e302-4df3-99c5-5025d99c8c19" containerID="37ba1a2f076b719c766f791299c9142e02bcefab3e8f0c9206394edcdfa4ce9b" exitCode=0 Mar 16 15:54:06 crc kubenswrapper[5120]: I0316 15:54:06.499069 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"36a1c719-e302-4df3-99c5-5025d99c8c19","Type":"ContainerDied","Data":"37ba1a2f076b719c766f791299c9142e02bcefab3e8f0c9206394edcdfa4ce9b"} Mar 16 15:54:06 crc kubenswrapper[5120]: I0316 15:54:06.499118 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"36a1c719-e302-4df3-99c5-5025d99c8c19","Type":"ContainerDied","Data":"0fc45789c6f9b438e93f839e5b4c471c1653680d1bc219aa8c8708aa9bbc71ee"} Mar 16 15:54:06 crc kubenswrapper[5120]: I0316 15:54:06.499174 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 15:54:06 crc kubenswrapper[5120]: I0316 15:54:06.539396 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 15:54:06 crc kubenswrapper[5120]: I0316 15:54:06.540785 5120 scope.go:117] "RemoveContainer" containerID="8970debe191db64e238196677dc31c851eca165e847dd7c77e1bae7f6b09f591" Mar 16 15:54:06 crc kubenswrapper[5120]: I0316 15:54:06.544523 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 15:54:06 crc kubenswrapper[5120]: I0316 15:54:06.556787 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:06 crc kubenswrapper[5120]: I0316 15:54:06.557152 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/36a1c719-e302-4df3-99c5-5025d99c8c19-rabbitmq-confd\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:06 crc kubenswrapper[5120]: I0316 15:54:06.566615 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 15:54:06 crc kubenswrapper[5120]: I0316 15:54:06.582686 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 15:54:06 crc kubenswrapper[5120]: I0316 15:54:06.586469 5120 scope.go:117] "RemoveContainer" containerID="37ba1a2f076b719c766f791299c9142e02bcefab3e8f0c9206394edcdfa4ce9b" Mar 16 15:54:06 crc kubenswrapper[5120]: I0316 15:54:06.622351 5120 scope.go:117] "RemoveContainer" containerID="b893f38e517ffdf9d92dd3de8d1b52ba2598e907c05bc8d1dd50838721c10b45" Mar 16 15:54:06 crc kubenswrapper[5120]: E0316 15:54:06.635542 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="6211858e25939c70614a9fad4891a628b70c8d2b4ada38adb2b8bd841a424715" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 15:54:06 crc kubenswrapper[5120]: E0316 15:54:06.637581 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="6211858e25939c70614a9fad4891a628b70c8d2b4ada38adb2b8bd841a424715" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 15:54:06 crc kubenswrapper[5120]: E0316 15:54:06.639104 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="6211858e25939c70614a9fad4891a628b70c8d2b4ada38adb2b8bd841a424715" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 15:54:06 crc kubenswrapper[5120]: E0316 15:54:06.639196 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="387f81d1-6a19-4250-b210-26daff7cbdc9" containerName="nova-cell1-conductor-conductor" probeResult="unknown" Mar 16 15:54:06 crc kubenswrapper[5120]: I0316 15:54:06.647587 5120 scope.go:117] "RemoveContainer" containerID="37ba1a2f076b719c766f791299c9142e02bcefab3e8f0c9206394edcdfa4ce9b" Mar 16 15:54:06 crc kubenswrapper[5120]: E0316 15:54:06.648069 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"37ba1a2f076b719c766f791299c9142e02bcefab3e8f0c9206394edcdfa4ce9b\": container with ID starting with 37ba1a2f076b719c766f791299c9142e02bcefab3e8f0c9206394edcdfa4ce9b not found: ID does not exist" containerID="37ba1a2f076b719c766f791299c9142e02bcefab3e8f0c9206394edcdfa4ce9b" Mar 16 15:54:06 crc kubenswrapper[5120]: I0316 15:54:06.648159 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37ba1a2f076b719c766f791299c9142e02bcefab3e8f0c9206394edcdfa4ce9b"} err="failed to get container status \"37ba1a2f076b719c766f791299c9142e02bcefab3e8f0c9206394edcdfa4ce9b\": rpc error: code = NotFound desc = could not find container \"37ba1a2f076b719c766f791299c9142e02bcefab3e8f0c9206394edcdfa4ce9b\": container with ID starting with 37ba1a2f076b719c766f791299c9142e02bcefab3e8f0c9206394edcdfa4ce9b not found: ID does not exist" Mar 16 15:54:06 crc kubenswrapper[5120]: I0316 15:54:06.648182 5120 scope.go:117] "RemoveContainer" containerID="b893f38e517ffdf9d92dd3de8d1b52ba2598e907c05bc8d1dd50838721c10b45" Mar 16 15:54:06 crc kubenswrapper[5120]: E0316 15:54:06.648461 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b893f38e517ffdf9d92dd3de8d1b52ba2598e907c05bc8d1dd50838721c10b45\": container with ID starting with b893f38e517ffdf9d92dd3de8d1b52ba2598e907c05bc8d1dd50838721c10b45 not found: ID does not exist" containerID="b893f38e517ffdf9d92dd3de8d1b52ba2598e907c05bc8d1dd50838721c10b45" Mar 16 15:54:06 crc kubenswrapper[5120]: I0316 15:54:06.648681 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b893f38e517ffdf9d92dd3de8d1b52ba2598e907c05bc8d1dd50838721c10b45"} err="failed to get container status \"b893f38e517ffdf9d92dd3de8d1b52ba2598e907c05bc8d1dd50838721c10b45\": rpc error: code = NotFound desc = could not find container \"b893f38e517ffdf9d92dd3de8d1b52ba2598e907c05bc8d1dd50838721c10b45\": container with ID starting with b893f38e517ffdf9d92dd3de8d1b52ba2598e907c05bc8d1dd50838721c10b45 not found: ID does not exist" Mar 16 15:54:06 crc kubenswrapper[5120]: I0316 15:54:06.682345 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="36a1c719-e302-4df3-99c5-5025d99c8c19" path="/var/lib/kubelet/pods/36a1c719-e302-4df3-99c5-5025d99c8c19/volumes" Mar 16 15:54:06 crc kubenswrapper[5120]: I0316 15:54:06.683997 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="39704fdb-36c4-41fe-8c13-35a3abb56c36" path="/var/lib/kubelet/pods/39704fdb-36c4-41fe-8c13-35a3abb56c36/volumes" Mar 16 15:54:06 crc kubenswrapper[5120]: I0316 15:54:06.686027 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="84ee794e-ebaa-4097-8cad-384c073a2d2e" path="/var/lib/kubelet/pods/84ee794e-ebaa-4097-8cad-384c073a2d2e/volumes" Mar 16 15:54:06 crc kubenswrapper[5120]: I0316 15:54:06.924389 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-5f559c8896-5jgnd" podUID="d442e64c-a236-4d12-8205-d5cf2cb95748" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.0.156:9311/healthcheck\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 15:54:07 crc kubenswrapper[5120]: E0316 15:54:07.488449 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1321524 actualBytes=10240 Mar 16 15:54:09 crc kubenswrapper[5120]: I0316 15:54:09.446171 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-xvqbz" Mar 16 15:54:09 crc kubenswrapper[5120]: I0316 15:54:09.516842 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-7f4777f8f-pg9tl"] Mar 16 15:54:09 crc kubenswrapper[5120]: I0316 15:54:09.518580 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7f4777f8f-pg9tl" podUID="afb802db-bd6c-476b-bd76-920d192fc44b" containerName="dnsmasq-dns" containerID="cri-o://d4bb5adbd442689f0320a608562291cb71a54efb8b9cc82d6fc38cca5fe230e4" gracePeriod=10 Mar 16 15:54:10 crc kubenswrapper[5120]: I0316 15:54:10.026637 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7f4777f8f-pg9tl" Mar 16 15:54:10 crc kubenswrapper[5120]: I0316 15:54:10.129104 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/afb802db-bd6c-476b-bd76-920d192fc44b-dnsmasq-svc\") pod \"afb802db-bd6c-476b-bd76-920d192fc44b\" (UID: \"afb802db-bd6c-476b-bd76-920d192fc44b\") " Mar 16 15:54:10 crc kubenswrapper[5120]: I0316 15:54:10.129270 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/afb802db-bd6c-476b-bd76-920d192fc44b-config\") pod \"afb802db-bd6c-476b-bd76-920d192fc44b\" (UID: \"afb802db-bd6c-476b-bd76-920d192fc44b\") " Mar 16 15:54:10 crc kubenswrapper[5120]: I0316 15:54:10.129328 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/afb802db-bd6c-476b-bd76-920d192fc44b-dns-swift-storage-0\") pod \"afb802db-bd6c-476b-bd76-920d192fc44b\" (UID: \"afb802db-bd6c-476b-bd76-920d192fc44b\") " Mar 16 15:54:10 crc kubenswrapper[5120]: I0316 15:54:10.129420 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7xs8r\" (UniqueName: \"kubernetes.io/projected/afb802db-bd6c-476b-bd76-920d192fc44b-kube-api-access-7xs8r\") pod \"afb802db-bd6c-476b-bd76-920d192fc44b\" (UID: \"afb802db-bd6c-476b-bd76-920d192fc44b\") " Mar 16 15:54:10 crc kubenswrapper[5120]: I0316 15:54:10.145912 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/afb802db-bd6c-476b-bd76-920d192fc44b-kube-api-access-7xs8r" (OuterVolumeSpecName: "kube-api-access-7xs8r") pod "afb802db-bd6c-476b-bd76-920d192fc44b" (UID: "afb802db-bd6c-476b-bd76-920d192fc44b"). InnerVolumeSpecName "kube-api-access-7xs8r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:54:10 crc kubenswrapper[5120]: I0316 15:54:10.165432 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/afb802db-bd6c-476b-bd76-920d192fc44b-dns-swift-storage-0" (OuterVolumeSpecName: "dns-swift-storage-0") pod "afb802db-bd6c-476b-bd76-920d192fc44b" (UID: "afb802db-bd6c-476b-bd76-920d192fc44b"). InnerVolumeSpecName "dns-swift-storage-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:54:10 crc kubenswrapper[5120]: I0316 15:54:10.166284 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/afb802db-bd6c-476b-bd76-920d192fc44b-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "afb802db-bd6c-476b-bd76-920d192fc44b" (UID: "afb802db-bd6c-476b-bd76-920d192fc44b"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:54:10 crc kubenswrapper[5120]: I0316 15:54:10.186595 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/afb802db-bd6c-476b-bd76-920d192fc44b-config" (OuterVolumeSpecName: "config") pod "afb802db-bd6c-476b-bd76-920d192fc44b" (UID: "afb802db-bd6c-476b-bd76-920d192fc44b"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:54:10 crc kubenswrapper[5120]: I0316 15:54:10.231188 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/afb802db-bd6c-476b-bd76-920d192fc44b-config\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:10 crc kubenswrapper[5120]: I0316 15:54:10.231219 5120 reconciler_common.go:299] "Volume detached for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/afb802db-bd6c-476b-bd76-920d192fc44b-dns-swift-storage-0\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:10 crc kubenswrapper[5120]: I0316 15:54:10.231230 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7xs8r\" (UniqueName: \"kubernetes.io/projected/afb802db-bd6c-476b-bd76-920d192fc44b-kube-api-access-7xs8r\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:10 crc kubenswrapper[5120]: I0316 15:54:10.231239 5120 reconciler_common.go:299] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/afb802db-bd6c-476b-bd76-920d192fc44b-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:10 crc kubenswrapper[5120]: I0316 15:54:10.580870 5120 generic.go:358] "Generic (PLEG): container finished" podID="afb802db-bd6c-476b-bd76-920d192fc44b" containerID="d4bb5adbd442689f0320a608562291cb71a54efb8b9cc82d6fc38cca5fe230e4" exitCode=0 Mar 16 15:54:10 crc kubenswrapper[5120]: I0316 15:54:10.581061 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7f4777f8f-pg9tl" event={"ID":"afb802db-bd6c-476b-bd76-920d192fc44b","Type":"ContainerDied","Data":"d4bb5adbd442689f0320a608562291cb71a54efb8b9cc82d6fc38cca5fe230e4"} Mar 16 15:54:10 crc kubenswrapper[5120]: I0316 15:54:10.581086 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7f4777f8f-pg9tl" event={"ID":"afb802db-bd6c-476b-bd76-920d192fc44b","Type":"ContainerDied","Data":"c556e6934d85df90712d6571249db5e46f77a3b74dcb100f59cd696fc2a02ed7"} Mar 16 15:54:10 crc kubenswrapper[5120]: I0316 15:54:10.581101 5120 scope.go:117] "RemoveContainer" containerID="d4bb5adbd442689f0320a608562291cb71a54efb8b9cc82d6fc38cca5fe230e4" Mar 16 15:54:10 crc kubenswrapper[5120]: I0316 15:54:10.581217 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7f4777f8f-pg9tl" Mar 16 15:54:10 crc kubenswrapper[5120]: I0316 15:54:10.620156 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-7f4777f8f-pg9tl"] Mar 16 15:54:10 crc kubenswrapper[5120]: I0316 15:54:10.624265 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-7f4777f8f-pg9tl"] Mar 16 15:54:10 crc kubenswrapper[5120]: I0316 15:54:10.624923 5120 scope.go:117] "RemoveContainer" containerID="f1238c63bf0f9a5efd118309a63e821aae5fde493554c16e95b6ff2c8b187299" Mar 16 15:54:10 crc kubenswrapper[5120]: I0316 15:54:10.649386 5120 scope.go:117] "RemoveContainer" containerID="d4bb5adbd442689f0320a608562291cb71a54efb8b9cc82d6fc38cca5fe230e4" Mar 16 15:54:10 crc kubenswrapper[5120]: E0316 15:54:10.650010 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d4bb5adbd442689f0320a608562291cb71a54efb8b9cc82d6fc38cca5fe230e4\": container with ID starting with d4bb5adbd442689f0320a608562291cb71a54efb8b9cc82d6fc38cca5fe230e4 not found: ID does not exist" containerID="d4bb5adbd442689f0320a608562291cb71a54efb8b9cc82d6fc38cca5fe230e4" Mar 16 15:54:10 crc kubenswrapper[5120]: I0316 15:54:10.650058 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4bb5adbd442689f0320a608562291cb71a54efb8b9cc82d6fc38cca5fe230e4"} err="failed to get container status \"d4bb5adbd442689f0320a608562291cb71a54efb8b9cc82d6fc38cca5fe230e4\": rpc error: code = NotFound desc = could not find container \"d4bb5adbd442689f0320a608562291cb71a54efb8b9cc82d6fc38cca5fe230e4\": container with ID starting with d4bb5adbd442689f0320a608562291cb71a54efb8b9cc82d6fc38cca5fe230e4 not found: ID does not exist" Mar 16 15:54:10 crc kubenswrapper[5120]: I0316 15:54:10.650083 5120 scope.go:117] "RemoveContainer" containerID="f1238c63bf0f9a5efd118309a63e821aae5fde493554c16e95b6ff2c8b187299" Mar 16 15:54:10 crc kubenswrapper[5120]: E0316 15:54:10.650357 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f1238c63bf0f9a5efd118309a63e821aae5fde493554c16e95b6ff2c8b187299\": container with ID starting with f1238c63bf0f9a5efd118309a63e821aae5fde493554c16e95b6ff2c8b187299 not found: ID does not exist" containerID="f1238c63bf0f9a5efd118309a63e821aae5fde493554c16e95b6ff2c8b187299" Mar 16 15:54:10 crc kubenswrapper[5120]: I0316 15:54:10.650379 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1238c63bf0f9a5efd118309a63e821aae5fde493554c16e95b6ff2c8b187299"} err="failed to get container status \"f1238c63bf0f9a5efd118309a63e821aae5fde493554c16e95b6ff2c8b187299\": rpc error: code = NotFound desc = could not find container \"f1238c63bf0f9a5efd118309a63e821aae5fde493554c16e95b6ff2c8b187299\": container with ID starting with f1238c63bf0f9a5efd118309a63e821aae5fde493554c16e95b6ff2c8b187299 not found: ID does not exist" Mar 16 15:54:10 crc kubenswrapper[5120]: I0316 15:54:10.676697 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="afb802db-bd6c-476b-bd76-920d192fc44b" path="/var/lib/kubelet/pods/afb802db-bd6c-476b-bd76-920d192fc44b/volumes" Mar 16 15:54:11 crc kubenswrapper[5120]: E0316 15:54:11.636245 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="6211858e25939c70614a9fad4891a628b70c8d2b4ada38adb2b8bd841a424715" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 15:54:11 crc kubenswrapper[5120]: E0316 15:54:11.638188 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="6211858e25939c70614a9fad4891a628b70c8d2b4ada38adb2b8bd841a424715" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 15:54:11 crc kubenswrapper[5120]: E0316 15:54:11.640342 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="6211858e25939c70614a9fad4891a628b70c8d2b4ada38adb2b8bd841a424715" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 15:54:11 crc kubenswrapper[5120]: E0316 15:54:11.640410 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="387f81d1-6a19-4250-b210-26daff7cbdc9" containerName="nova-cell1-conductor-conductor" probeResult="unknown" Mar 16 15:54:16 crc kubenswrapper[5120]: E0316 15:54:16.635228 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="6211858e25939c70614a9fad4891a628b70c8d2b4ada38adb2b8bd841a424715" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 15:54:16 crc kubenswrapper[5120]: E0316 15:54:16.639462 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="6211858e25939c70614a9fad4891a628b70c8d2b4ada38adb2b8bd841a424715" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 15:54:16 crc kubenswrapper[5120]: E0316 15:54:16.641828 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="6211858e25939c70614a9fad4891a628b70c8d2b4ada38adb2b8bd841a424715" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 15:54:16 crc kubenswrapper[5120]: E0316 15:54:16.641973 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="387f81d1-6a19-4250-b210-26daff7cbdc9" containerName="nova-cell1-conductor-conductor" probeResult="unknown" Mar 16 15:54:20 crc kubenswrapper[5120]: I0316 15:54:20.211490 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/neutron-85b4fd4946-cqqk6" podUID="72332d22-b98a-420f-b6ce-66d22d70566b" containerName="neutron-httpd" probeResult="failure" output="Get \"https://10.217.0.159:9696/\": dial tcp 10.217.0.159:9696: connect: connection refused" Mar 16 15:54:21 crc kubenswrapper[5120]: E0316 15:54:21.635408 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="6211858e25939c70614a9fad4891a628b70c8d2b4ada38adb2b8bd841a424715" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 15:54:21 crc kubenswrapper[5120]: E0316 15:54:21.638369 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="6211858e25939c70614a9fad4891a628b70c8d2b4ada38adb2b8bd841a424715" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 15:54:21 crc kubenswrapper[5120]: E0316 15:54:21.640131 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="6211858e25939c70614a9fad4891a628b70c8d2b4ada38adb2b8bd841a424715" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 15:54:21 crc kubenswrapper[5120]: E0316 15:54:21.640206 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="387f81d1-6a19-4250-b210-26daff7cbdc9" containerName="nova-cell1-conductor-conductor" probeResult="unknown" Mar 16 15:54:22 crc kubenswrapper[5120]: I0316 15:54:22.008284 5120 patch_prober.go:28] interesting pod/machine-config-daemon-7bf76 container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 15:54:22 crc kubenswrapper[5120]: I0316 15:54:22.008382 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 15:54:22 crc kubenswrapper[5120]: I0316 15:54:22.008469 5120 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" Mar 16 15:54:22 crc kubenswrapper[5120]: I0316 15:54:22.009603 5120 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="machine-config-daemon" containerStatusID={"Type":"cri-o","ID":"9d5e3b84b8e39e272bcdfd3629bb461cbf7fa6c81923d93bfde9f9bccbea4d36"} pod="openshift-machine-config-operator/machine-config-daemon-7bf76" containerMessage="Container machine-config-daemon failed liveness probe, will be restarted" Mar 16 15:54:22 crc kubenswrapper[5120]: I0316 15:54:22.009732 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" containerID="cri-o://9d5e3b84b8e39e272bcdfd3629bb461cbf7fa6c81923d93bfde9f9bccbea4d36" gracePeriod=600 Mar 16 15:54:22 crc kubenswrapper[5120]: I0316 15:54:22.738833 5120 generic.go:358] "Generic (PLEG): container finished" podID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerID="9d5e3b84b8e39e272bcdfd3629bb461cbf7fa6c81923d93bfde9f9bccbea4d36" exitCode=0 Mar 16 15:54:22 crc kubenswrapper[5120]: I0316 15:54:22.739175 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" event={"ID":"e2275cb4-4905-4d66-a87e-8010120db2bd","Type":"ContainerDied","Data":"9d5e3b84b8e39e272bcdfd3629bb461cbf7fa6c81923d93bfde9f9bccbea4d36"} Mar 16 15:54:22 crc kubenswrapper[5120]: I0316 15:54:22.739228 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" event={"ID":"e2275cb4-4905-4d66-a87e-8010120db2bd","Type":"ContainerStarted","Data":"02ba4fc3f84eccaecfa9e6618280f65626eb76580c4af9ae7a9d7cb3b8dd590b"} Mar 16 15:54:22 crc kubenswrapper[5120]: I0316 15:54:22.739248 5120 scope.go:117] "RemoveContainer" containerID="e5df06dc2963ff3db6fb23d78ab01fc36b1dd04900daea5fc6d49cd8c5fe5c61" Mar 16 15:54:23 crc kubenswrapper[5120]: I0316 15:54:23.754972 5120 generic.go:358] "Generic (PLEG): container finished" podID="672accec-238b-4e18-9b15-5ff8429d4256" containerID="72332479aa958fc5e61ccf2b6d8d70f6451c35955b231f405b209ee03cac68de" exitCode=137 Mar 16 15:54:23 crc kubenswrapper[5120]: I0316 15:54:23.755030 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"672accec-238b-4e18-9b15-5ff8429d4256","Type":"ContainerDied","Data":"72332479aa958fc5e61ccf2b6d8d70f6451c35955b231f405b209ee03cac68de"} Mar 16 15:54:23 crc kubenswrapper[5120]: I0316 15:54:23.755623 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"672accec-238b-4e18-9b15-5ff8429d4256","Type":"ContainerDied","Data":"1ac0de8d51240f93133081de7eb9bb268a3b8161a7e62aecd5b75835a35939b6"} Mar 16 15:54:23 crc kubenswrapper[5120]: I0316 15:54:23.755635 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1ac0de8d51240f93133081de7eb9bb268a3b8161a7e62aecd5b75835a35939b6" Mar 16 15:54:23 crc kubenswrapper[5120]: I0316 15:54:23.763495 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Mar 16 15:54:23 crc kubenswrapper[5120]: I0316 15:54:23.938203 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/672accec-238b-4e18-9b15-5ff8429d4256-lock\") pod \"672accec-238b-4e18-9b15-5ff8429d4256\" (UID: \"672accec-238b-4e18-9b15-5ff8429d4256\") " Mar 16 15:54:23 crc kubenswrapper[5120]: I0316 15:54:23.938354 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/672accec-238b-4e18-9b15-5ff8429d4256-etc-swift\") pod \"672accec-238b-4e18-9b15-5ff8429d4256\" (UID: \"672accec-238b-4e18-9b15-5ff8429d4256\") " Mar 16 15:54:23 crc kubenswrapper[5120]: I0316 15:54:23.938425 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/672accec-238b-4e18-9b15-5ff8429d4256-combined-ca-bundle\") pod \"672accec-238b-4e18-9b15-5ff8429d4256\" (UID: \"672accec-238b-4e18-9b15-5ff8429d4256\") " Mar 16 15:54:23 crc kubenswrapper[5120]: I0316 15:54:23.938493 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tzsjs\" (UniqueName: \"kubernetes.io/projected/672accec-238b-4e18-9b15-5ff8429d4256-kube-api-access-tzsjs\") pod \"672accec-238b-4e18-9b15-5ff8429d4256\" (UID: \"672accec-238b-4e18-9b15-5ff8429d4256\") " Mar 16 15:54:23 crc kubenswrapper[5120]: I0316 15:54:23.938542 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/672accec-238b-4e18-9b15-5ff8429d4256-cache\") pod \"672accec-238b-4e18-9b15-5ff8429d4256\" (UID: \"672accec-238b-4e18-9b15-5ff8429d4256\") " Mar 16 15:54:23 crc kubenswrapper[5120]: I0316 15:54:23.938595 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"swift\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") pod \"672accec-238b-4e18-9b15-5ff8429d4256\" (UID: \"672accec-238b-4e18-9b15-5ff8429d4256\") " Mar 16 15:54:23 crc kubenswrapper[5120]: I0316 15:54:23.940443 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/672accec-238b-4e18-9b15-5ff8429d4256-cache" (OuterVolumeSpecName: "cache") pod "672accec-238b-4e18-9b15-5ff8429d4256" (UID: "672accec-238b-4e18-9b15-5ff8429d4256"). InnerVolumeSpecName "cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:54:23 crc kubenswrapper[5120]: I0316 15:54:23.940724 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/672accec-238b-4e18-9b15-5ff8429d4256-lock" (OuterVolumeSpecName: "lock") pod "672accec-238b-4e18-9b15-5ff8429d4256" (UID: "672accec-238b-4e18-9b15-5ff8429d4256"). InnerVolumeSpecName "lock". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:54:23 crc kubenswrapper[5120]: I0316 15:54:23.944277 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage07-crc" (OuterVolumeSpecName: "swift") pod "672accec-238b-4e18-9b15-5ff8429d4256" (UID: "672accec-238b-4e18-9b15-5ff8429d4256"). InnerVolumeSpecName "local-storage07-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 15:54:23 crc kubenswrapper[5120]: I0316 15:54:23.947391 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/672accec-238b-4e18-9b15-5ff8429d4256-kube-api-access-tzsjs" (OuterVolumeSpecName: "kube-api-access-tzsjs") pod "672accec-238b-4e18-9b15-5ff8429d4256" (UID: "672accec-238b-4e18-9b15-5ff8429d4256"). InnerVolumeSpecName "kube-api-access-tzsjs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:54:23 crc kubenswrapper[5120]: I0316 15:54:23.963399 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/672accec-238b-4e18-9b15-5ff8429d4256-etc-swift" (OuterVolumeSpecName: "etc-swift") pod "672accec-238b-4e18-9b15-5ff8429d4256" (UID: "672accec-238b-4e18-9b15-5ff8429d4256"). InnerVolumeSpecName "etc-swift". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:54:24 crc kubenswrapper[5120]: I0316 15:54:24.040305 5120 reconciler_common.go:299] "Volume detached for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/672accec-238b-4e18-9b15-5ff8429d4256-lock\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:24 crc kubenswrapper[5120]: I0316 15:54:24.040588 5120 reconciler_common.go:299] "Volume detached for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/672accec-238b-4e18-9b15-5ff8429d4256-etc-swift\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:24 crc kubenswrapper[5120]: I0316 15:54:24.040603 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tzsjs\" (UniqueName: \"kubernetes.io/projected/672accec-238b-4e18-9b15-5ff8429d4256-kube-api-access-tzsjs\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:24 crc kubenswrapper[5120]: I0316 15:54:24.040617 5120 reconciler_common.go:299] "Volume detached for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/672accec-238b-4e18-9b15-5ff8429d4256-cache\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:24 crc kubenswrapper[5120]: I0316 15:54:24.040658 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage07-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") on node \"crc\" " Mar 16 15:54:24 crc kubenswrapper[5120]: I0316 15:54:24.055977 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage07-crc" (UniqueName: "kubernetes.io/local-volume/local-storage07-crc") on node "crc" Mar 16 15:54:24 crc kubenswrapper[5120]: I0316 15:54:24.142159 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage07-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:24 crc kubenswrapper[5120]: I0316 15:54:24.265195 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/672accec-238b-4e18-9b15-5ff8429d4256-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "672accec-238b-4e18-9b15-5ff8429d4256" (UID: "672accec-238b-4e18-9b15-5ff8429d4256"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:54:24 crc kubenswrapper[5120]: I0316 15:54:24.344623 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/672accec-238b-4e18-9b15-5ff8429d4256-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:24 crc kubenswrapper[5120]: I0316 15:54:24.781593 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Mar 16 15:54:24 crc kubenswrapper[5120]: I0316 15:54:24.827887 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 15:54:24 crc kubenswrapper[5120]: I0316 15:54:24.841300 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 15:54:26 crc kubenswrapper[5120]: E0316 15:54:26.635744 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="6211858e25939c70614a9fad4891a628b70c8d2b4ada38adb2b8bd841a424715" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 15:54:26 crc kubenswrapper[5120]: E0316 15:54:26.637423 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="6211858e25939c70614a9fad4891a628b70c8d2b4ada38adb2b8bd841a424715" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 15:54:26 crc kubenswrapper[5120]: E0316 15:54:26.638595 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="6211858e25939c70614a9fad4891a628b70c8d2b4ada38adb2b8bd841a424715" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 15:54:26 crc kubenswrapper[5120]: E0316 15:54:26.638634 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="387f81d1-6a19-4250-b210-26daff7cbdc9" containerName="nova-cell1-conductor-conductor" probeResult="unknown" Mar 16 15:54:26 crc kubenswrapper[5120]: I0316 15:54:26.683166 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="672accec-238b-4e18-9b15-5ff8429d4256" path="/var/lib/kubelet/pods/672accec-238b-4e18-9b15-5ff8429d4256/volumes" Mar 16 15:54:28 crc kubenswrapper[5120]: I0316 15:54:28.610479 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-85b4fd4946-cqqk6_72332d22-b98a-420f-b6ce-66d22d70566b/neutron-api/0.log" Mar 16 15:54:28 crc kubenswrapper[5120]: I0316 15:54:28.611313 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-85b4fd4946-cqqk6" Mar 16 15:54:28 crc kubenswrapper[5120]: I0316 15:54:28.615693 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 15:54:28 crc kubenswrapper[5120]: I0316 15:54:28.631468 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/72332d22-b98a-420f-b6ce-66d22d70566b-combined-ca-bundle\") pod \"72332d22-b98a-420f-b6ce-66d22d70566b\" (UID: \"72332d22-b98a-420f-b6ce-66d22d70566b\") " Mar 16 15:54:28 crc kubenswrapper[5120]: I0316 15:54:28.631580 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-md2pw\" (UniqueName: \"kubernetes.io/projected/387f81d1-6a19-4250-b210-26daff7cbdc9-kube-api-access-md2pw\") pod \"387f81d1-6a19-4250-b210-26daff7cbdc9\" (UID: \"387f81d1-6a19-4250-b210-26daff7cbdc9\") " Mar 16 15:54:28 crc kubenswrapper[5120]: I0316 15:54:28.631636 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/72332d22-b98a-420f-b6ce-66d22d70566b-public-tls-certs\") pod \"72332d22-b98a-420f-b6ce-66d22d70566b\" (UID: \"72332d22-b98a-420f-b6ce-66d22d70566b\") " Mar 16 15:54:28 crc kubenswrapper[5120]: I0316 15:54:28.631671 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mt5xf\" (UniqueName: \"kubernetes.io/projected/72332d22-b98a-420f-b6ce-66d22d70566b-kube-api-access-mt5xf\") pod \"72332d22-b98a-420f-b6ce-66d22d70566b\" (UID: \"72332d22-b98a-420f-b6ce-66d22d70566b\") " Mar 16 15:54:28 crc kubenswrapper[5120]: I0316 15:54:28.631709 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/72332d22-b98a-420f-b6ce-66d22d70566b-internal-tls-certs\") pod \"72332d22-b98a-420f-b6ce-66d22d70566b\" (UID: \"72332d22-b98a-420f-b6ce-66d22d70566b\") " Mar 16 15:54:28 crc kubenswrapper[5120]: I0316 15:54:28.631784 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/387f81d1-6a19-4250-b210-26daff7cbdc9-config-data\") pod \"387f81d1-6a19-4250-b210-26daff7cbdc9\" (UID: \"387f81d1-6a19-4250-b210-26daff7cbdc9\") " Mar 16 15:54:28 crc kubenswrapper[5120]: I0316 15:54:28.631857 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/72332d22-b98a-420f-b6ce-66d22d70566b-ovndb-tls-certs\") pod \"72332d22-b98a-420f-b6ce-66d22d70566b\" (UID: \"72332d22-b98a-420f-b6ce-66d22d70566b\") " Mar 16 15:54:28 crc kubenswrapper[5120]: I0316 15:54:28.631936 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/387f81d1-6a19-4250-b210-26daff7cbdc9-combined-ca-bundle\") pod \"387f81d1-6a19-4250-b210-26daff7cbdc9\" (UID: \"387f81d1-6a19-4250-b210-26daff7cbdc9\") " Mar 16 15:54:28 crc kubenswrapper[5120]: I0316 15:54:28.632071 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/72332d22-b98a-420f-b6ce-66d22d70566b-config\") pod \"72332d22-b98a-420f-b6ce-66d22d70566b\" (UID: \"72332d22-b98a-420f-b6ce-66d22d70566b\") " Mar 16 15:54:28 crc kubenswrapper[5120]: I0316 15:54:28.632120 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/72332d22-b98a-420f-b6ce-66d22d70566b-httpd-config\") pod \"72332d22-b98a-420f-b6ce-66d22d70566b\" (UID: \"72332d22-b98a-420f-b6ce-66d22d70566b\") " Mar 16 15:54:28 crc kubenswrapper[5120]: I0316 15:54:28.647931 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/72332d22-b98a-420f-b6ce-66d22d70566b-httpd-config" (OuterVolumeSpecName: "httpd-config") pod "72332d22-b98a-420f-b6ce-66d22d70566b" (UID: "72332d22-b98a-420f-b6ce-66d22d70566b"). InnerVolumeSpecName "httpd-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:54:28 crc kubenswrapper[5120]: I0316 15:54:28.648005 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72332d22-b98a-420f-b6ce-66d22d70566b-kube-api-access-mt5xf" (OuterVolumeSpecName: "kube-api-access-mt5xf") pod "72332d22-b98a-420f-b6ce-66d22d70566b" (UID: "72332d22-b98a-420f-b6ce-66d22d70566b"). InnerVolumeSpecName "kube-api-access-mt5xf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:54:28 crc kubenswrapper[5120]: I0316 15:54:28.673917 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/387f81d1-6a19-4250-b210-26daff7cbdc9-kube-api-access-md2pw" (OuterVolumeSpecName: "kube-api-access-md2pw") pod "387f81d1-6a19-4250-b210-26daff7cbdc9" (UID: "387f81d1-6a19-4250-b210-26daff7cbdc9"). InnerVolumeSpecName "kube-api-access-md2pw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:54:28 crc kubenswrapper[5120]: I0316 15:54:28.684998 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/72332d22-b98a-420f-b6ce-66d22d70566b-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "72332d22-b98a-420f-b6ce-66d22d70566b" (UID: "72332d22-b98a-420f-b6ce-66d22d70566b"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:54:28 crc kubenswrapper[5120]: I0316 15:54:28.686923 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/72332d22-b98a-420f-b6ce-66d22d70566b-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "72332d22-b98a-420f-b6ce-66d22d70566b" (UID: "72332d22-b98a-420f-b6ce-66d22d70566b"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:54:28 crc kubenswrapper[5120]: I0316 15:54:28.703186 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/387f81d1-6a19-4250-b210-26daff7cbdc9-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "387f81d1-6a19-4250-b210-26daff7cbdc9" (UID: "387f81d1-6a19-4250-b210-26daff7cbdc9"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:54:28 crc kubenswrapper[5120]: I0316 15:54:28.710553 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/387f81d1-6a19-4250-b210-26daff7cbdc9-config-data" (OuterVolumeSpecName: "config-data") pod "387f81d1-6a19-4250-b210-26daff7cbdc9" (UID: "387f81d1-6a19-4250-b210-26daff7cbdc9"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:54:28 crc kubenswrapper[5120]: I0316 15:54:28.719129 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/72332d22-b98a-420f-b6ce-66d22d70566b-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "72332d22-b98a-420f-b6ce-66d22d70566b" (UID: "72332d22-b98a-420f-b6ce-66d22d70566b"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:54:28 crc kubenswrapper[5120]: I0316 15:54:28.733753 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/72332d22-b98a-420f-b6ce-66d22d70566b-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:28 crc kubenswrapper[5120]: I0316 15:54:28.733801 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mt5xf\" (UniqueName: \"kubernetes.io/projected/72332d22-b98a-420f-b6ce-66d22d70566b-kube-api-access-mt5xf\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:28 crc kubenswrapper[5120]: I0316 15:54:28.733816 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/72332d22-b98a-420f-b6ce-66d22d70566b-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:28 crc kubenswrapper[5120]: I0316 15:54:28.733826 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/387f81d1-6a19-4250-b210-26daff7cbdc9-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:28 crc kubenswrapper[5120]: I0316 15:54:28.733838 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/387f81d1-6a19-4250-b210-26daff7cbdc9-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:28 crc kubenswrapper[5120]: I0316 15:54:28.733850 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/72332d22-b98a-420f-b6ce-66d22d70566b-httpd-config\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:28 crc kubenswrapper[5120]: I0316 15:54:28.733861 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/72332d22-b98a-420f-b6ce-66d22d70566b-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:28 crc kubenswrapper[5120]: I0316 15:54:28.733874 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-md2pw\" (UniqueName: \"kubernetes.io/projected/387f81d1-6a19-4250-b210-26daff7cbdc9-kube-api-access-md2pw\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:28 crc kubenswrapper[5120]: I0316 15:54:28.745159 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/72332d22-b98a-420f-b6ce-66d22d70566b-config" (OuterVolumeSpecName: "config") pod "72332d22-b98a-420f-b6ce-66d22d70566b" (UID: "72332d22-b98a-420f-b6ce-66d22d70566b"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:54:28 crc kubenswrapper[5120]: I0316 15:54:28.747041 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/72332d22-b98a-420f-b6ce-66d22d70566b-ovndb-tls-certs" (OuterVolumeSpecName: "ovndb-tls-certs") pod "72332d22-b98a-420f-b6ce-66d22d70566b" (UID: "72332d22-b98a-420f-b6ce-66d22d70566b"). InnerVolumeSpecName "ovndb-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:54:28 crc kubenswrapper[5120]: I0316 15:54:28.831839 5120 generic.go:358] "Generic (PLEG): container finished" podID="18ef8c0b-e810-48c1-b5a5-43584c591dfa" containerID="959ba0f73cfaf0e69153bb7f33832702f869ac6825fc9e369095f60f526b025d" exitCode=137 Mar 16 15:54:28 crc kubenswrapper[5120]: I0316 15:54:28.831967 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-69c8889b9f-sfbxd" event={"ID":"18ef8c0b-e810-48c1-b5a5-43584c591dfa","Type":"ContainerDied","Data":"959ba0f73cfaf0e69153bb7f33832702f869ac6825fc9e369095f60f526b025d"} Mar 16 15:54:28 crc kubenswrapper[5120]: I0316 15:54:28.833558 5120 generic.go:358] "Generic (PLEG): container finished" podID="387f81d1-6a19-4250-b210-26daff7cbdc9" containerID="6211858e25939c70614a9fad4891a628b70c8d2b4ada38adb2b8bd841a424715" exitCode=137 Mar 16 15:54:28 crc kubenswrapper[5120]: I0316 15:54:28.833813 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 15:54:28 crc kubenswrapper[5120]: I0316 15:54:28.834427 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"387f81d1-6a19-4250-b210-26daff7cbdc9","Type":"ContainerDied","Data":"6211858e25939c70614a9fad4891a628b70c8d2b4ada38adb2b8bd841a424715"} Mar 16 15:54:28 crc kubenswrapper[5120]: I0316 15:54:28.834482 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"387f81d1-6a19-4250-b210-26daff7cbdc9","Type":"ContainerDied","Data":"c656a669f1872a248d1465c7e5854c55698b4a43a6360d01d48675278a2e6805"} Mar 16 15:54:28 crc kubenswrapper[5120]: I0316 15:54:28.834500 5120 scope.go:117] "RemoveContainer" containerID="6211858e25939c70614a9fad4891a628b70c8d2b4ada38adb2b8bd841a424715" Mar 16 15:54:28 crc kubenswrapper[5120]: I0316 15:54:28.836206 5120 reconciler_common.go:299] "Volume detached for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/72332d22-b98a-420f-b6ce-66d22d70566b-ovndb-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:28 crc kubenswrapper[5120]: I0316 15:54:28.836246 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/72332d22-b98a-420f-b6ce-66d22d70566b-config\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:28 crc kubenswrapper[5120]: I0316 15:54:28.839205 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-85b4fd4946-cqqk6_72332d22-b98a-420f-b6ce-66d22d70566b/neutron-api/0.log" Mar 16 15:54:28 crc kubenswrapper[5120]: I0316 15:54:28.839238 5120 generic.go:358] "Generic (PLEG): container finished" podID="72332d22-b98a-420f-b6ce-66d22d70566b" containerID="9940d1b5e7f2bb8e9549d3743c8a6e48257c84e180a8c46e9f5477a9d73d29ce" exitCode=137 Mar 16 15:54:28 crc kubenswrapper[5120]: I0316 15:54:28.839555 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-85b4fd4946-cqqk6" event={"ID":"72332d22-b98a-420f-b6ce-66d22d70566b","Type":"ContainerDied","Data":"9940d1b5e7f2bb8e9549d3743c8a6e48257c84e180a8c46e9f5477a9d73d29ce"} Mar 16 15:54:28 crc kubenswrapper[5120]: I0316 15:54:28.839580 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-85b4fd4946-cqqk6" event={"ID":"72332d22-b98a-420f-b6ce-66d22d70566b","Type":"ContainerDied","Data":"e78311483b2de15358f397e2dfb02ed4f82236b7fc38844fad92bc904f9c3534"} Mar 16 15:54:28 crc kubenswrapper[5120]: I0316 15:54:28.839633 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-85b4fd4946-cqqk6" Mar 16 15:54:28 crc kubenswrapper[5120]: I0316 15:54:28.854582 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 15:54:28 crc kubenswrapper[5120]: I0316 15:54:28.862214 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 15:54:28 crc kubenswrapper[5120]: I0316 15:54:28.866160 5120 scope.go:117] "RemoveContainer" containerID="6211858e25939c70614a9fad4891a628b70c8d2b4ada38adb2b8bd841a424715" Mar 16 15:54:28 crc kubenswrapper[5120]: E0316 15:54:28.869024 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6211858e25939c70614a9fad4891a628b70c8d2b4ada38adb2b8bd841a424715\": container with ID starting with 6211858e25939c70614a9fad4891a628b70c8d2b4ada38adb2b8bd841a424715 not found: ID does not exist" containerID="6211858e25939c70614a9fad4891a628b70c8d2b4ada38adb2b8bd841a424715" Mar 16 15:54:28 crc kubenswrapper[5120]: I0316 15:54:28.869059 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6211858e25939c70614a9fad4891a628b70c8d2b4ada38adb2b8bd841a424715"} err="failed to get container status \"6211858e25939c70614a9fad4891a628b70c8d2b4ada38adb2b8bd841a424715\": rpc error: code = NotFound desc = could not find container \"6211858e25939c70614a9fad4891a628b70c8d2b4ada38adb2b8bd841a424715\": container with ID starting with 6211858e25939c70614a9fad4891a628b70c8d2b4ada38adb2b8bd841a424715 not found: ID does not exist" Mar 16 15:54:28 crc kubenswrapper[5120]: I0316 15:54:28.869081 5120 scope.go:117] "RemoveContainer" containerID="5f2c32a9433767dc6b404267c0200ca020edcba7ea995cde3eb8bedf0cf26bf8" Mar 16 15:54:28 crc kubenswrapper[5120]: I0316 15:54:28.882318 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-85b4fd4946-cqqk6"] Mar 16 15:54:28 crc kubenswrapper[5120]: I0316 15:54:28.889110 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-85b4fd4946-cqqk6"] Mar 16 15:54:28 crc kubenswrapper[5120]: I0316 15:54:28.892567 5120 scope.go:117] "RemoveContainer" containerID="9940d1b5e7f2bb8e9549d3743c8a6e48257c84e180a8c46e9f5477a9d73d29ce" Mar 16 15:54:28 crc kubenswrapper[5120]: I0316 15:54:28.918905 5120 scope.go:117] "RemoveContainer" containerID="5f2c32a9433767dc6b404267c0200ca020edcba7ea995cde3eb8bedf0cf26bf8" Mar 16 15:54:28 crc kubenswrapper[5120]: E0316 15:54:28.919371 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f2c32a9433767dc6b404267c0200ca020edcba7ea995cde3eb8bedf0cf26bf8\": container with ID starting with 5f2c32a9433767dc6b404267c0200ca020edcba7ea995cde3eb8bedf0cf26bf8 not found: ID does not exist" containerID="5f2c32a9433767dc6b404267c0200ca020edcba7ea995cde3eb8bedf0cf26bf8" Mar 16 15:54:28 crc kubenswrapper[5120]: I0316 15:54:28.919415 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f2c32a9433767dc6b404267c0200ca020edcba7ea995cde3eb8bedf0cf26bf8"} err="failed to get container status \"5f2c32a9433767dc6b404267c0200ca020edcba7ea995cde3eb8bedf0cf26bf8\": rpc error: code = NotFound desc = could not find container \"5f2c32a9433767dc6b404267c0200ca020edcba7ea995cde3eb8bedf0cf26bf8\": container with ID starting with 5f2c32a9433767dc6b404267c0200ca020edcba7ea995cde3eb8bedf0cf26bf8 not found: ID does not exist" Mar 16 15:54:28 crc kubenswrapper[5120]: I0316 15:54:28.919443 5120 scope.go:117] "RemoveContainer" containerID="9940d1b5e7f2bb8e9549d3743c8a6e48257c84e180a8c46e9f5477a9d73d29ce" Mar 16 15:54:28 crc kubenswrapper[5120]: E0316 15:54:28.920110 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9940d1b5e7f2bb8e9549d3743c8a6e48257c84e180a8c46e9f5477a9d73d29ce\": container with ID starting with 9940d1b5e7f2bb8e9549d3743c8a6e48257c84e180a8c46e9f5477a9d73d29ce not found: ID does not exist" containerID="9940d1b5e7f2bb8e9549d3743c8a6e48257c84e180a8c46e9f5477a9d73d29ce" Mar 16 15:54:28 crc kubenswrapper[5120]: I0316 15:54:28.920148 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9940d1b5e7f2bb8e9549d3743c8a6e48257c84e180a8c46e9f5477a9d73d29ce"} err="failed to get container status \"9940d1b5e7f2bb8e9549d3743c8a6e48257c84e180a8c46e9f5477a9d73d29ce\": rpc error: code = NotFound desc = could not find container \"9940d1b5e7f2bb8e9549d3743c8a6e48257c84e180a8c46e9f5477a9d73d29ce\": container with ID starting with 9940d1b5e7f2bb8e9549d3743c8a6e48257c84e180a8c46e9f5477a9d73d29ce not found: ID does not exist" Mar 16 15:54:28 crc kubenswrapper[5120]: I0316 15:54:28.944361 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-69c8889b9f-sfbxd" Mar 16 15:54:29 crc kubenswrapper[5120]: I0316 15:54:29.037982 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rc5x9\" (UniqueName: \"kubernetes.io/projected/18ef8c0b-e810-48c1-b5a5-43584c591dfa-kube-api-access-rc5x9\") pod \"18ef8c0b-e810-48c1-b5a5-43584c591dfa\" (UID: \"18ef8c0b-e810-48c1-b5a5-43584c591dfa\") " Mar 16 15:54:29 crc kubenswrapper[5120]: I0316 15:54:29.038081 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/18ef8c0b-e810-48c1-b5a5-43584c591dfa-config-data\") pod \"18ef8c0b-e810-48c1-b5a5-43584c591dfa\" (UID: \"18ef8c0b-e810-48c1-b5a5-43584c591dfa\") " Mar 16 15:54:29 crc kubenswrapper[5120]: I0316 15:54:29.038132 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/18ef8c0b-e810-48c1-b5a5-43584c591dfa-config-data-custom\") pod \"18ef8c0b-e810-48c1-b5a5-43584c591dfa\" (UID: \"18ef8c0b-e810-48c1-b5a5-43584c591dfa\") " Mar 16 15:54:29 crc kubenswrapper[5120]: I0316 15:54:29.038208 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/18ef8c0b-e810-48c1-b5a5-43584c591dfa-combined-ca-bundle\") pod \"18ef8c0b-e810-48c1-b5a5-43584c591dfa\" (UID: \"18ef8c0b-e810-48c1-b5a5-43584c591dfa\") " Mar 16 15:54:29 crc kubenswrapper[5120]: I0316 15:54:29.038240 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/18ef8c0b-e810-48c1-b5a5-43584c591dfa-logs\") pod \"18ef8c0b-e810-48c1-b5a5-43584c591dfa\" (UID: \"18ef8c0b-e810-48c1-b5a5-43584c591dfa\") " Mar 16 15:54:29 crc kubenswrapper[5120]: I0316 15:54:29.039100 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18ef8c0b-e810-48c1-b5a5-43584c591dfa-logs" (OuterVolumeSpecName: "logs") pod "18ef8c0b-e810-48c1-b5a5-43584c591dfa" (UID: "18ef8c0b-e810-48c1-b5a5-43584c591dfa"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:54:29 crc kubenswrapper[5120]: I0316 15:54:29.041897 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18ef8c0b-e810-48c1-b5a5-43584c591dfa-kube-api-access-rc5x9" (OuterVolumeSpecName: "kube-api-access-rc5x9") pod "18ef8c0b-e810-48c1-b5a5-43584c591dfa" (UID: "18ef8c0b-e810-48c1-b5a5-43584c591dfa"). InnerVolumeSpecName "kube-api-access-rc5x9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:54:29 crc kubenswrapper[5120]: I0316 15:54:29.042239 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18ef8c0b-e810-48c1-b5a5-43584c591dfa-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "18ef8c0b-e810-48c1-b5a5-43584c591dfa" (UID: "18ef8c0b-e810-48c1-b5a5-43584c591dfa"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:54:29 crc kubenswrapper[5120]: I0316 15:54:29.056294 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18ef8c0b-e810-48c1-b5a5-43584c591dfa-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "18ef8c0b-e810-48c1-b5a5-43584c591dfa" (UID: "18ef8c0b-e810-48c1-b5a5-43584c591dfa"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:54:29 crc kubenswrapper[5120]: I0316 15:54:29.087470 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18ef8c0b-e810-48c1-b5a5-43584c591dfa-config-data" (OuterVolumeSpecName: "config-data") pod "18ef8c0b-e810-48c1-b5a5-43584c591dfa" (UID: "18ef8c0b-e810-48c1-b5a5-43584c591dfa"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:54:29 crc kubenswrapper[5120]: I0316 15:54:29.140192 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/18ef8c0b-e810-48c1-b5a5-43584c591dfa-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:29 crc kubenswrapper[5120]: I0316 15:54:29.140252 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/18ef8c0b-e810-48c1-b5a5-43584c591dfa-logs\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:29 crc kubenswrapper[5120]: I0316 15:54:29.140274 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rc5x9\" (UniqueName: \"kubernetes.io/projected/18ef8c0b-e810-48c1-b5a5-43584c591dfa-kube-api-access-rc5x9\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:29 crc kubenswrapper[5120]: I0316 15:54:29.140294 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/18ef8c0b-e810-48c1-b5a5-43584c591dfa-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:29 crc kubenswrapper[5120]: I0316 15:54:29.140311 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/18ef8c0b-e810-48c1-b5a5-43584c591dfa-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:29 crc kubenswrapper[5120]: I0316 15:54:29.859665 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-69c8889b9f-sfbxd" event={"ID":"18ef8c0b-e810-48c1-b5a5-43584c591dfa","Type":"ContainerDied","Data":"4b5df2c40e258beccc14716a4991e333fc85c2271d6be78eb67ccdce21ccd790"} Mar 16 15:54:29 crc kubenswrapper[5120]: I0316 15:54:29.860754 5120 scope.go:117] "RemoveContainer" containerID="959ba0f73cfaf0e69153bb7f33832702f869ac6825fc9e369095f60f526b025d" Mar 16 15:54:29 crc kubenswrapper[5120]: I0316 15:54:29.859674 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-69c8889b9f-sfbxd" Mar 16 15:54:29 crc kubenswrapper[5120]: I0316 15:54:29.901834 5120 scope.go:117] "RemoveContainer" containerID="bcd37f54cbc166ff52b822355e3dffd9da249e43d42116ecf6339e6a81422bbe" Mar 16 15:54:29 crc kubenswrapper[5120]: I0316 15:54:29.913584 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-69c8889b9f-sfbxd"] Mar 16 15:54:29 crc kubenswrapper[5120]: I0316 15:54:29.923699 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-worker-69c8889b9f-sfbxd"] Mar 16 15:54:30 crc kubenswrapper[5120]: I0316 15:54:30.039075 5120 pod_container_manager_linux.go:217] "Failed to delete cgroup paths" cgroupName=["kubepods","besteffort","podd6f8b8b2-e94a-4c67-9e6d-be16e2acbdcc"] err="unable to destroy cgroup paths for cgroup [kubepods besteffort podd6f8b8b2-e94a-4c67-9e6d-be16e2acbdcc] : Timed out while waiting for systemd to remove kubepods-besteffort-podd6f8b8b2_e94a_4c67_9e6d_be16e2acbdcc.slice" Mar 16 15:54:30 crc kubenswrapper[5120]: I0316 15:54:30.045620 5120 pod_container_manager_linux.go:217] "Failed to delete cgroup paths" cgroupName=["kubepods","besteffort","podae15ab63-33c1-4085-809f-5b1b4086b95b"] err="unable to destroy cgroup paths for cgroup [kubepods besteffort podae15ab63-33c1-4085-809f-5b1b4086b95b] : Timed out while waiting for systemd to remove kubepods-besteffort-podae15ab63_33c1_4085_809f_5b1b4086b95b.slice" Mar 16 15:54:30 crc kubenswrapper[5120]: I0316 15:54:30.694258 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="18ef8c0b-e810-48c1-b5a5-43584c591dfa" path="/var/lib/kubelet/pods/18ef8c0b-e810-48c1-b5a5-43584c591dfa/volumes" Mar 16 15:54:30 crc kubenswrapper[5120]: I0316 15:54:30.695548 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="387f81d1-6a19-4250-b210-26daff7cbdc9" path="/var/lib/kubelet/pods/387f81d1-6a19-4250-b210-26daff7cbdc9/volumes" Mar 16 15:54:30 crc kubenswrapper[5120]: I0316 15:54:30.696494 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="72332d22-b98a-420f-b6ce-66d22d70566b" path="/var/lib/kubelet/pods/72332d22-b98a-420f-b6ce-66d22d70566b/volumes" Mar 16 15:54:31 crc kubenswrapper[5120]: I0316 15:54:31.617066 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-7bd99f4458-mgw7m" Mar 16 15:54:31 crc kubenswrapper[5120]: I0316 15:54:31.680257 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vffgg\" (UniqueName: \"kubernetes.io/projected/5a0edbf7-738f-4c1a-9333-f23da8ab8067-kube-api-access-vffgg\") pod \"5a0edbf7-738f-4c1a-9333-f23da8ab8067\" (UID: \"5a0edbf7-738f-4c1a-9333-f23da8ab8067\") " Mar 16 15:54:31 crc kubenswrapper[5120]: I0316 15:54:31.680348 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5a0edbf7-738f-4c1a-9333-f23da8ab8067-logs\") pod \"5a0edbf7-738f-4c1a-9333-f23da8ab8067\" (UID: \"5a0edbf7-738f-4c1a-9333-f23da8ab8067\") " Mar 16 15:54:31 crc kubenswrapper[5120]: I0316 15:54:31.680377 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5a0edbf7-738f-4c1a-9333-f23da8ab8067-config-data\") pod \"5a0edbf7-738f-4c1a-9333-f23da8ab8067\" (UID: \"5a0edbf7-738f-4c1a-9333-f23da8ab8067\") " Mar 16 15:54:31 crc kubenswrapper[5120]: I0316 15:54:31.680575 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5a0edbf7-738f-4c1a-9333-f23da8ab8067-combined-ca-bundle\") pod \"5a0edbf7-738f-4c1a-9333-f23da8ab8067\" (UID: \"5a0edbf7-738f-4c1a-9333-f23da8ab8067\") " Mar 16 15:54:31 crc kubenswrapper[5120]: I0316 15:54:31.680715 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/5a0edbf7-738f-4c1a-9333-f23da8ab8067-config-data-custom\") pod \"5a0edbf7-738f-4c1a-9333-f23da8ab8067\" (UID: \"5a0edbf7-738f-4c1a-9333-f23da8ab8067\") " Mar 16 15:54:31 crc kubenswrapper[5120]: I0316 15:54:31.682416 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a0edbf7-738f-4c1a-9333-f23da8ab8067-logs" (OuterVolumeSpecName: "logs") pod "5a0edbf7-738f-4c1a-9333-f23da8ab8067" (UID: "5a0edbf7-738f-4c1a-9333-f23da8ab8067"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:54:31 crc kubenswrapper[5120]: I0316 15:54:31.687233 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a0edbf7-738f-4c1a-9333-f23da8ab8067-kube-api-access-vffgg" (OuterVolumeSpecName: "kube-api-access-vffgg") pod "5a0edbf7-738f-4c1a-9333-f23da8ab8067" (UID: "5a0edbf7-738f-4c1a-9333-f23da8ab8067"). InnerVolumeSpecName "kube-api-access-vffgg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:54:31 crc kubenswrapper[5120]: I0316 15:54:31.687531 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5a0edbf7-738f-4c1a-9333-f23da8ab8067-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "5a0edbf7-738f-4c1a-9333-f23da8ab8067" (UID: "5a0edbf7-738f-4c1a-9333-f23da8ab8067"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:54:31 crc kubenswrapper[5120]: I0316 15:54:31.707448 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5a0edbf7-738f-4c1a-9333-f23da8ab8067-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "5a0edbf7-738f-4c1a-9333-f23da8ab8067" (UID: "5a0edbf7-738f-4c1a-9333-f23da8ab8067"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:54:31 crc kubenswrapper[5120]: I0316 15:54:31.748538 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5a0edbf7-738f-4c1a-9333-f23da8ab8067-config-data" (OuterVolumeSpecName: "config-data") pod "5a0edbf7-738f-4c1a-9333-f23da8ab8067" (UID: "5a0edbf7-738f-4c1a-9333-f23da8ab8067"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:54:31 crc kubenswrapper[5120]: I0316 15:54:31.782691 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vffgg\" (UniqueName: \"kubernetes.io/projected/5a0edbf7-738f-4c1a-9333-f23da8ab8067-kube-api-access-vffgg\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:31 crc kubenswrapper[5120]: I0316 15:54:31.782718 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5a0edbf7-738f-4c1a-9333-f23da8ab8067-logs\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:31 crc kubenswrapper[5120]: I0316 15:54:31.782728 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5a0edbf7-738f-4c1a-9333-f23da8ab8067-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:31 crc kubenswrapper[5120]: I0316 15:54:31.782737 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5a0edbf7-738f-4c1a-9333-f23da8ab8067-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:31 crc kubenswrapper[5120]: I0316 15:54:31.782745 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/5a0edbf7-738f-4c1a-9333-f23da8ab8067-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:31 crc kubenswrapper[5120]: I0316 15:54:31.893939 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-7bd99f4458-mgw7m" Mar 16 15:54:31 crc kubenswrapper[5120]: I0316 15:54:31.894045 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-7bd99f4458-mgw7m" event={"ID":"5a0edbf7-738f-4c1a-9333-f23da8ab8067","Type":"ContainerDied","Data":"1cd092148959f4bdcdf7f0a5a7192d93e01e6842734d51ca456ee76180f927d4"} Mar 16 15:54:31 crc kubenswrapper[5120]: I0316 15:54:31.893914 5120 generic.go:358] "Generic (PLEG): container finished" podID="5a0edbf7-738f-4c1a-9333-f23da8ab8067" containerID="1cd092148959f4bdcdf7f0a5a7192d93e01e6842734d51ca456ee76180f927d4" exitCode=137 Mar 16 15:54:31 crc kubenswrapper[5120]: I0316 15:54:31.894130 5120 scope.go:117] "RemoveContainer" containerID="1cd092148959f4bdcdf7f0a5a7192d93e01e6842734d51ca456ee76180f927d4" Mar 16 15:54:31 crc kubenswrapper[5120]: I0316 15:54:31.894327 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-7bd99f4458-mgw7m" event={"ID":"5a0edbf7-738f-4c1a-9333-f23da8ab8067","Type":"ContainerDied","Data":"0883d28d38b241d5e263552e576ccbe58be927885b22511e24a56fd770aefbe1"} Mar 16 15:54:31 crc kubenswrapper[5120]: I0316 15:54:31.946923 5120 scope.go:117] "RemoveContainer" containerID="c2121e4d06f46ee4a9e8ff7fef63a6dbeab5cdae2f5f5e1ffbca0a1570f651e5" Mar 16 15:54:31 crc kubenswrapper[5120]: I0316 15:54:31.949340 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-7bd99f4458-mgw7m"] Mar 16 15:54:31 crc kubenswrapper[5120]: I0316 15:54:31.954407 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-7bd99f4458-mgw7m"] Mar 16 15:54:31 crc kubenswrapper[5120]: I0316 15:54:31.967373 5120 scope.go:117] "RemoveContainer" containerID="1cd092148959f4bdcdf7f0a5a7192d93e01e6842734d51ca456ee76180f927d4" Mar 16 15:54:31 crc kubenswrapper[5120]: E0316 15:54:31.967862 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1cd092148959f4bdcdf7f0a5a7192d93e01e6842734d51ca456ee76180f927d4\": container with ID starting with 1cd092148959f4bdcdf7f0a5a7192d93e01e6842734d51ca456ee76180f927d4 not found: ID does not exist" containerID="1cd092148959f4bdcdf7f0a5a7192d93e01e6842734d51ca456ee76180f927d4" Mar 16 15:54:31 crc kubenswrapper[5120]: I0316 15:54:31.967896 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1cd092148959f4bdcdf7f0a5a7192d93e01e6842734d51ca456ee76180f927d4"} err="failed to get container status \"1cd092148959f4bdcdf7f0a5a7192d93e01e6842734d51ca456ee76180f927d4\": rpc error: code = NotFound desc = could not find container \"1cd092148959f4bdcdf7f0a5a7192d93e01e6842734d51ca456ee76180f927d4\": container with ID starting with 1cd092148959f4bdcdf7f0a5a7192d93e01e6842734d51ca456ee76180f927d4 not found: ID does not exist" Mar 16 15:54:31 crc kubenswrapper[5120]: I0316 15:54:31.967922 5120 scope.go:117] "RemoveContainer" containerID="c2121e4d06f46ee4a9e8ff7fef63a6dbeab5cdae2f5f5e1ffbca0a1570f651e5" Mar 16 15:54:31 crc kubenswrapper[5120]: E0316 15:54:31.968153 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c2121e4d06f46ee4a9e8ff7fef63a6dbeab5cdae2f5f5e1ffbca0a1570f651e5\": container with ID starting with c2121e4d06f46ee4a9e8ff7fef63a6dbeab5cdae2f5f5e1ffbca0a1570f651e5 not found: ID does not exist" containerID="c2121e4d06f46ee4a9e8ff7fef63a6dbeab5cdae2f5f5e1ffbca0a1570f651e5" Mar 16 15:54:31 crc kubenswrapper[5120]: I0316 15:54:31.968175 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2121e4d06f46ee4a9e8ff7fef63a6dbeab5cdae2f5f5e1ffbca0a1570f651e5"} err="failed to get container status \"c2121e4d06f46ee4a9e8ff7fef63a6dbeab5cdae2f5f5e1ffbca0a1570f651e5\": rpc error: code = NotFound desc = could not find container \"c2121e4d06f46ee4a9e8ff7fef63a6dbeab5cdae2f5f5e1ffbca0a1570f651e5\": container with ID starting with c2121e4d06f46ee4a9e8ff7fef63a6dbeab5cdae2f5f5e1ffbca0a1570f651e5 not found: ID does not exist" Mar 16 15:54:32 crc kubenswrapper[5120]: I0316 15:54:32.679437 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a0edbf7-738f-4c1a-9333-f23da8ab8067" path="/var/lib/kubelet/pods/5a0edbf7-738f-4c1a-9333-f23da8ab8067/volumes" Mar 16 15:54:33 crc kubenswrapper[5120]: I0316 15:54:33.382007 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/neutron-6646594584-l84r5" podUID="952aeeb8-cdc4-469f-b50b-e5d640adc994" containerName="neutron-httpd" probeResult="failure" output="Get \"https://10.217.0.204:9696/\": dial tcp 10.217.0.204:9696: connect: connection refused" Mar 16 15:54:33 crc kubenswrapper[5120]: I0316 15:54:33.836545 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-6646594584-l84r5_952aeeb8-cdc4-469f-b50b-e5d640adc994/neutron-api/0.log" Mar 16 15:54:33 crc kubenswrapper[5120]: I0316 15:54:33.836667 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-6646594584-l84r5" Mar 16 15:54:33 crc kubenswrapper[5120]: I0316 15:54:33.923123 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/952aeeb8-cdc4-469f-b50b-e5d640adc994-httpd-config\") pod \"952aeeb8-cdc4-469f-b50b-e5d640adc994\" (UID: \"952aeeb8-cdc4-469f-b50b-e5d640adc994\") " Mar 16 15:54:33 crc kubenswrapper[5120]: I0316 15:54:33.923357 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/952aeeb8-cdc4-469f-b50b-e5d640adc994-config\") pod \"952aeeb8-cdc4-469f-b50b-e5d640adc994\" (UID: \"952aeeb8-cdc4-469f-b50b-e5d640adc994\") " Mar 16 15:54:33 crc kubenswrapper[5120]: I0316 15:54:33.923473 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/952aeeb8-cdc4-469f-b50b-e5d640adc994-combined-ca-bundle\") pod \"952aeeb8-cdc4-469f-b50b-e5d640adc994\" (UID: \"952aeeb8-cdc4-469f-b50b-e5d640adc994\") " Mar 16 15:54:33 crc kubenswrapper[5120]: I0316 15:54:33.923550 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/952aeeb8-cdc4-469f-b50b-e5d640adc994-ovndb-tls-certs\") pod \"952aeeb8-cdc4-469f-b50b-e5d640adc994\" (UID: \"952aeeb8-cdc4-469f-b50b-e5d640adc994\") " Mar 16 15:54:33 crc kubenswrapper[5120]: I0316 15:54:33.923671 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/952aeeb8-cdc4-469f-b50b-e5d640adc994-public-tls-certs\") pod \"952aeeb8-cdc4-469f-b50b-e5d640adc994\" (UID: \"952aeeb8-cdc4-469f-b50b-e5d640adc994\") " Mar 16 15:54:33 crc kubenswrapper[5120]: I0316 15:54:33.923743 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9sdg5\" (UniqueName: \"kubernetes.io/projected/952aeeb8-cdc4-469f-b50b-e5d640adc994-kube-api-access-9sdg5\") pod \"952aeeb8-cdc4-469f-b50b-e5d640adc994\" (UID: \"952aeeb8-cdc4-469f-b50b-e5d640adc994\") " Mar 16 15:54:33 crc kubenswrapper[5120]: I0316 15:54:33.923864 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/952aeeb8-cdc4-469f-b50b-e5d640adc994-internal-tls-certs\") pod \"952aeeb8-cdc4-469f-b50b-e5d640adc994\" (UID: \"952aeeb8-cdc4-469f-b50b-e5d640adc994\") " Mar 16 15:54:33 crc kubenswrapper[5120]: I0316 15:54:33.929955 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/952aeeb8-cdc4-469f-b50b-e5d640adc994-httpd-config" (OuterVolumeSpecName: "httpd-config") pod "952aeeb8-cdc4-469f-b50b-e5d640adc994" (UID: "952aeeb8-cdc4-469f-b50b-e5d640adc994"). InnerVolumeSpecName "httpd-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:54:33 crc kubenswrapper[5120]: I0316 15:54:33.929972 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/952aeeb8-cdc4-469f-b50b-e5d640adc994-kube-api-access-9sdg5" (OuterVolumeSpecName: "kube-api-access-9sdg5") pod "952aeeb8-cdc4-469f-b50b-e5d640adc994" (UID: "952aeeb8-cdc4-469f-b50b-e5d640adc994"). InnerVolumeSpecName "kube-api-access-9sdg5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:54:33 crc kubenswrapper[5120]: I0316 15:54:33.935144 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-6646594584-l84r5_952aeeb8-cdc4-469f-b50b-e5d640adc994/neutron-api/0.log" Mar 16 15:54:33 crc kubenswrapper[5120]: I0316 15:54:33.935197 5120 generic.go:358] "Generic (PLEG): container finished" podID="952aeeb8-cdc4-469f-b50b-e5d640adc994" containerID="90d7bd6f5ab887d265aa5f3dcd1136326d78aac9bf8e7ccdb164249f5e00a7cb" exitCode=137 Mar 16 15:54:33 crc kubenswrapper[5120]: I0316 15:54:33.935392 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-6646594584-l84r5" Mar 16 15:54:33 crc kubenswrapper[5120]: I0316 15:54:33.935399 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-6646594584-l84r5" event={"ID":"952aeeb8-cdc4-469f-b50b-e5d640adc994","Type":"ContainerDied","Data":"90d7bd6f5ab887d265aa5f3dcd1136326d78aac9bf8e7ccdb164249f5e00a7cb"} Mar 16 15:54:33 crc kubenswrapper[5120]: I0316 15:54:33.935523 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-6646594584-l84r5" event={"ID":"952aeeb8-cdc4-469f-b50b-e5d640adc994","Type":"ContainerDied","Data":"c610473fa6c0cb2bdada21957b858ef6b9481b70eaf99e1621a211814ef1b9d2"} Mar 16 15:54:33 crc kubenswrapper[5120]: I0316 15:54:33.935552 5120 scope.go:117] "RemoveContainer" containerID="53da8da602945d2f32ce588fd12de6fc2045a2045006ae3cffcc83004a53d9e9" Mar 16 15:54:33 crc kubenswrapper[5120]: I0316 15:54:33.970973 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/952aeeb8-cdc4-469f-b50b-e5d640adc994-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "952aeeb8-cdc4-469f-b50b-e5d640adc994" (UID: "952aeeb8-cdc4-469f-b50b-e5d640adc994"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:54:33 crc kubenswrapper[5120]: I0316 15:54:33.975579 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/952aeeb8-cdc4-469f-b50b-e5d640adc994-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "952aeeb8-cdc4-469f-b50b-e5d640adc994" (UID: "952aeeb8-cdc4-469f-b50b-e5d640adc994"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:54:33 crc kubenswrapper[5120]: I0316 15:54:33.993459 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/952aeeb8-cdc4-469f-b50b-e5d640adc994-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "952aeeb8-cdc4-469f-b50b-e5d640adc994" (UID: "952aeeb8-cdc4-469f-b50b-e5d640adc994"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:54:33 crc kubenswrapper[5120]: I0316 15:54:33.995923 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/952aeeb8-cdc4-469f-b50b-e5d640adc994-config" (OuterVolumeSpecName: "config") pod "952aeeb8-cdc4-469f-b50b-e5d640adc994" (UID: "952aeeb8-cdc4-469f-b50b-e5d640adc994"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:54:33 crc kubenswrapper[5120]: I0316 15:54:33.998268 5120 scope.go:117] "RemoveContainer" containerID="90d7bd6f5ab887d265aa5f3dcd1136326d78aac9bf8e7ccdb164249f5e00a7cb" Mar 16 15:54:34 crc kubenswrapper[5120]: I0316 15:54:34.010641 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/952aeeb8-cdc4-469f-b50b-e5d640adc994-ovndb-tls-certs" (OuterVolumeSpecName: "ovndb-tls-certs") pod "952aeeb8-cdc4-469f-b50b-e5d640adc994" (UID: "952aeeb8-cdc4-469f-b50b-e5d640adc994"). InnerVolumeSpecName "ovndb-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:54:34 crc kubenswrapper[5120]: I0316 15:54:34.016684 5120 scope.go:117] "RemoveContainer" containerID="53da8da602945d2f32ce588fd12de6fc2045a2045006ae3cffcc83004a53d9e9" Mar 16 15:54:34 crc kubenswrapper[5120]: E0316 15:54:34.017654 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"53da8da602945d2f32ce588fd12de6fc2045a2045006ae3cffcc83004a53d9e9\": container with ID starting with 53da8da602945d2f32ce588fd12de6fc2045a2045006ae3cffcc83004a53d9e9 not found: ID does not exist" containerID="53da8da602945d2f32ce588fd12de6fc2045a2045006ae3cffcc83004a53d9e9" Mar 16 15:54:34 crc kubenswrapper[5120]: I0316 15:54:34.017720 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53da8da602945d2f32ce588fd12de6fc2045a2045006ae3cffcc83004a53d9e9"} err="failed to get container status \"53da8da602945d2f32ce588fd12de6fc2045a2045006ae3cffcc83004a53d9e9\": rpc error: code = NotFound desc = could not find container \"53da8da602945d2f32ce588fd12de6fc2045a2045006ae3cffcc83004a53d9e9\": container with ID starting with 53da8da602945d2f32ce588fd12de6fc2045a2045006ae3cffcc83004a53d9e9 not found: ID does not exist" Mar 16 15:54:34 crc kubenswrapper[5120]: I0316 15:54:34.017752 5120 scope.go:117] "RemoveContainer" containerID="90d7bd6f5ab887d265aa5f3dcd1136326d78aac9bf8e7ccdb164249f5e00a7cb" Mar 16 15:54:34 crc kubenswrapper[5120]: E0316 15:54:34.019444 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"90d7bd6f5ab887d265aa5f3dcd1136326d78aac9bf8e7ccdb164249f5e00a7cb\": container with ID starting with 90d7bd6f5ab887d265aa5f3dcd1136326d78aac9bf8e7ccdb164249f5e00a7cb not found: ID does not exist" containerID="90d7bd6f5ab887d265aa5f3dcd1136326d78aac9bf8e7ccdb164249f5e00a7cb" Mar 16 15:54:34 crc kubenswrapper[5120]: I0316 15:54:34.019486 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90d7bd6f5ab887d265aa5f3dcd1136326d78aac9bf8e7ccdb164249f5e00a7cb"} err="failed to get container status \"90d7bd6f5ab887d265aa5f3dcd1136326d78aac9bf8e7ccdb164249f5e00a7cb\": rpc error: code = NotFound desc = could not find container \"90d7bd6f5ab887d265aa5f3dcd1136326d78aac9bf8e7ccdb164249f5e00a7cb\": container with ID starting with 90d7bd6f5ab887d265aa5f3dcd1136326d78aac9bf8e7ccdb164249f5e00a7cb not found: ID does not exist" Mar 16 15:54:34 crc kubenswrapper[5120]: I0316 15:54:34.025280 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/952aeeb8-cdc4-469f-b50b-e5d640adc994-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:34 crc kubenswrapper[5120]: I0316 15:54:34.025303 5120 reconciler_common.go:299] "Volume detached for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/952aeeb8-cdc4-469f-b50b-e5d640adc994-ovndb-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:34 crc kubenswrapper[5120]: I0316 15:54:34.025313 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/952aeeb8-cdc4-469f-b50b-e5d640adc994-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:34 crc kubenswrapper[5120]: I0316 15:54:34.025322 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9sdg5\" (UniqueName: \"kubernetes.io/projected/952aeeb8-cdc4-469f-b50b-e5d640adc994-kube-api-access-9sdg5\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:34 crc kubenswrapper[5120]: I0316 15:54:34.025333 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/952aeeb8-cdc4-469f-b50b-e5d640adc994-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:34 crc kubenswrapper[5120]: I0316 15:54:34.025341 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/952aeeb8-cdc4-469f-b50b-e5d640adc994-httpd-config\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:34 crc kubenswrapper[5120]: I0316 15:54:34.025349 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/952aeeb8-cdc4-469f-b50b-e5d640adc994-config\") on node \"crc\" DevicePath \"\"" Mar 16 15:54:34 crc kubenswrapper[5120]: I0316 15:54:34.271898 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-6646594584-l84r5"] Mar 16 15:54:34 crc kubenswrapper[5120]: I0316 15:54:34.279634 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-6646594584-l84r5"] Mar 16 15:54:34 crc kubenswrapper[5120]: I0316 15:54:34.681839 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="952aeeb8-cdc4-469f-b50b-e5d640adc994" path="/var/lib/kubelet/pods/952aeeb8-cdc4-469f-b50b-e5d640adc994/volumes" Mar 16 15:54:42 crc kubenswrapper[5120]: I0316 15:54:42.961718 5120 scope.go:117] "RemoveContainer" containerID="c6e88f8b1a915c86c4e97784263497ed84ab31ee4f26b9026a67cd537114ca43" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.948389 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.949635 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="672accec-238b-4e18-9b15-5ff8429d4256" containerName="container-auditor" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.949655 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="672accec-238b-4e18-9b15-5ff8429d4256" containerName="container-auditor" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.949668 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d442e64c-a236-4d12-8205-d5cf2cb95748" containerName="barbican-api" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.949675 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="d442e64c-a236-4d12-8205-d5cf2cb95748" containerName="barbican-api" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.949688 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72332d22-b98a-420f-b6ce-66d22d70566b" containerName="neutron-api" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.949697 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="72332d22-b98a-420f-b6ce-66d22d70566b" containerName="neutron-api" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.949710 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72332d22-b98a-420f-b6ce-66d22d70566b" containerName="neutron-httpd" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.949716 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="72332d22-b98a-420f-b6ce-66d22d70566b" containerName="neutron-httpd" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.949724 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ac49efe-dc8a-47b2-9432-afb41c69ebff" containerName="ovn-northd" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.949732 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ac49efe-dc8a-47b2-9432-afb41c69ebff" containerName="ovn-northd" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.949740 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36a1c719-e302-4df3-99c5-5025d99c8c19" containerName="rabbitmq" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.949748 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="36a1c719-e302-4df3-99c5-5025d99c8c19" containerName="rabbitmq" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.949775 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac8dd629-af3d-4d9c-b41a-f5b8d6d29498" containerName="placement-log" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.949784 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac8dd629-af3d-4d9c-b41a-f5b8d6d29498" containerName="placement-log" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.949793 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0a6dd94-0b6e-446a-924b-a39ce7582090" containerName="barbican-keystone-listener-log" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.949801 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0a6dd94-0b6e-446a-924b-a39ce7582090" containerName="barbican-keystone-listener-log" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.949813 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="672accec-238b-4e18-9b15-5ff8429d4256" containerName="account-replicator" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.949820 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="672accec-238b-4e18-9b15-5ff8429d4256" containerName="account-replicator" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.949838 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39704fdb-36c4-41fe-8c13-35a3abb56c36" containerName="setup-container" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.949846 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="39704fdb-36c4-41fe-8c13-35a3abb56c36" containerName="setup-container" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.949862 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="672accec-238b-4e18-9b15-5ff8429d4256" containerName="account-reaper" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.949869 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="672accec-238b-4e18-9b15-5ff8429d4256" containerName="account-reaper" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.949881 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="672accec-238b-4e18-9b15-5ff8429d4256" containerName="object-expirer" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.949889 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="672accec-238b-4e18-9b15-5ff8429d4256" containerName="object-expirer" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.949900 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a0edbf7-738f-4c1a-9333-f23da8ab8067" containerName="barbican-keystone-listener" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.949907 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a0edbf7-738f-4c1a-9333-f23da8ab8067" containerName="barbican-keystone-listener" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.949918 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb293a62-0310-4af8-8376-0b2197bda8d2" containerName="barbican-worker-log" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.949925 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb293a62-0310-4af8-8376-0b2197bda8d2" containerName="barbican-worker-log" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.949936 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39704fdb-36c4-41fe-8c13-35a3abb56c36" containerName="rabbitmq" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.949943 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="39704fdb-36c4-41fe-8c13-35a3abb56c36" containerName="rabbitmq" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.949951 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2218d5be-dd10-4e4b-87b9-d9a5273bd197" containerName="placement-api" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.949958 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="2218d5be-dd10-4e4b-87b9-d9a5273bd197" containerName="placement-api" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.949967 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26a03664-6cb3-4982-80f5-063d8f12cc2a" containerName="barbican-api-log" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.949973 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="26a03664-6cb3-4982-80f5-063d8f12cc2a" containerName="barbican-api-log" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.949988 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="672accec-238b-4e18-9b15-5ff8429d4256" containerName="container-server" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.949995 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="672accec-238b-4e18-9b15-5ff8429d4256" containerName="container-server" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.950007 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26ff2779-e4aa-43b8-9704-4def1ae45033" containerName="keystone-api" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.950014 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="26ff2779-e4aa-43b8-9704-4def1ae45033" containerName="keystone-api" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.950024 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2218d5be-dd10-4e4b-87b9-d9a5273bd197" containerName="placement-log" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.950031 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="2218d5be-dd10-4e4b-87b9-d9a5273bd197" containerName="placement-log" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.950042 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="672accec-238b-4e18-9b15-5ff8429d4256" containerName="account-server" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.950048 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="672accec-238b-4e18-9b15-5ff8429d4256" containerName="account-server" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.950059 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36a1c719-e302-4df3-99c5-5025d99c8c19" containerName="setup-container" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.950066 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="36a1c719-e302-4df3-99c5-5025d99c8c19" containerName="setup-container" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.950079 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="672accec-238b-4e18-9b15-5ff8429d4256" containerName="container-replicator" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.950086 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="672accec-238b-4e18-9b15-5ff8429d4256" containerName="container-replicator" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.950093 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="672accec-238b-4e18-9b15-5ff8429d4256" containerName="container-updater" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.950100 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="672accec-238b-4e18-9b15-5ff8429d4256" containerName="container-updater" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.950116 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="672accec-238b-4e18-9b15-5ff8429d4256" containerName="object-updater" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.950123 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="672accec-238b-4e18-9b15-5ff8429d4256" containerName="object-updater" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.950134 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ac49efe-dc8a-47b2-9432-afb41c69ebff" containerName="openstack-network-exporter" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.950142 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ac49efe-dc8a-47b2-9432-afb41c69ebff" containerName="openstack-network-exporter" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.950151 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="672accec-238b-4e18-9b15-5ff8429d4256" containerName="object-server" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.950158 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="672accec-238b-4e18-9b15-5ff8429d4256" containerName="object-server" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.950170 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72052f6a-5423-426f-bdb0-9c9f0609fa34" containerName="oc" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.950177 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="72052f6a-5423-426f-bdb0-9c9f0609fa34" containerName="oc" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.950189 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="672accec-238b-4e18-9b15-5ff8429d4256" containerName="swift-recon-cron" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.950196 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="672accec-238b-4e18-9b15-5ff8429d4256" containerName="swift-recon-cron" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.950203 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb293a62-0310-4af8-8376-0b2197bda8d2" containerName="barbican-worker" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.950210 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb293a62-0310-4af8-8376-0b2197bda8d2" containerName="barbican-worker" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.950226 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18ef8c0b-e810-48c1-b5a5-43584c591dfa" containerName="barbican-worker-log" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.950233 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="18ef8c0b-e810-48c1-b5a5-43584c591dfa" containerName="barbican-worker-log" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.950243 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="952aeeb8-cdc4-469f-b50b-e5d640adc994" containerName="neutron-api" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.950250 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="952aeeb8-cdc4-469f-b50b-e5d640adc994" containerName="neutron-api" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.950258 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="952aeeb8-cdc4-469f-b50b-e5d640adc994" containerName="neutron-httpd" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.950266 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="952aeeb8-cdc4-469f-b50b-e5d640adc994" containerName="neutron-httpd" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.950281 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0a6dd94-0b6e-446a-924b-a39ce7582090" containerName="barbican-keystone-listener" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.950289 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0a6dd94-0b6e-446a-924b-a39ce7582090" containerName="barbican-keystone-listener" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.950300 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07b2313a-7b50-4c4a-b485-ef68c88e468a" containerName="keystone-api" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.950308 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="07b2313a-7b50-4c4a-b485-ef68c88e468a" containerName="keystone-api" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.950320 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18ef8c0b-e810-48c1-b5a5-43584c591dfa" containerName="barbican-worker" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.950328 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="18ef8c0b-e810-48c1-b5a5-43584c591dfa" containerName="barbican-worker" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.950339 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="672accec-238b-4e18-9b15-5ff8429d4256" containerName="rsync" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.950346 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="672accec-238b-4e18-9b15-5ff8429d4256" containerName="rsync" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.950358 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="afb802db-bd6c-476b-bd76-920d192fc44b" containerName="dnsmasq-dns" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.950367 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="afb802db-bd6c-476b-bd76-920d192fc44b" containerName="dnsmasq-dns" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.950378 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac8dd629-af3d-4d9c-b41a-f5b8d6d29498" containerName="placement-api" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.950386 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac8dd629-af3d-4d9c-b41a-f5b8d6d29498" containerName="placement-api" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.950393 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="387f81d1-6a19-4250-b210-26daff7cbdc9" containerName="nova-cell1-conductor-conductor" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.950400 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="387f81d1-6a19-4250-b210-26daff7cbdc9" containerName="nova-cell1-conductor-conductor" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.950445 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26a03664-6cb3-4982-80f5-063d8f12cc2a" containerName="barbican-api" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.950454 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="26a03664-6cb3-4982-80f5-063d8f12cc2a" containerName="barbican-api" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.950461 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="672accec-238b-4e18-9b15-5ff8429d4256" containerName="account-auditor" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.950469 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="672accec-238b-4e18-9b15-5ff8429d4256" containerName="account-auditor" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.950479 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="672accec-238b-4e18-9b15-5ff8429d4256" containerName="object-replicator" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.950486 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="672accec-238b-4e18-9b15-5ff8429d4256" containerName="object-replicator" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.950495 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a0edbf7-738f-4c1a-9333-f23da8ab8067" containerName="barbican-keystone-listener-log" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.950503 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a0edbf7-738f-4c1a-9333-f23da8ab8067" containerName="barbican-keystone-listener-log" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.950515 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="672accec-238b-4e18-9b15-5ff8429d4256" containerName="object-auditor" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.950522 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="672accec-238b-4e18-9b15-5ff8429d4256" containerName="object-auditor" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.950533 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="afb802db-bd6c-476b-bd76-920d192fc44b" containerName="init" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.950540 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="afb802db-bd6c-476b-bd76-920d192fc44b" containerName="init" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.950553 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d442e64c-a236-4d12-8205-d5cf2cb95748" containerName="barbican-api-log" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.950560 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="d442e64c-a236-4d12-8205-d5cf2cb95748" containerName="barbican-api-log" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.950704 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="2218d5be-dd10-4e4b-87b9-d9a5273bd197" containerName="placement-log" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.950724 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="72332d22-b98a-420f-b6ce-66d22d70566b" containerName="neutron-httpd" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.950736 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="672accec-238b-4e18-9b15-5ff8429d4256" containerName="account-server" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.950751 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="672accec-238b-4e18-9b15-5ff8429d4256" containerName="account-reaper" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.950778 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e0a6dd94-0b6e-446a-924b-a39ce7582090" containerName="barbican-keystone-listener-log" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.950788 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="72332d22-b98a-420f-b6ce-66d22d70566b" containerName="neutron-api" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.950800 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="672accec-238b-4e18-9b15-5ff8429d4256" containerName="rsync" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.950812 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="26ff2779-e4aa-43b8-9704-4def1ae45033" containerName="keystone-api" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.950822 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="18ef8c0b-e810-48c1-b5a5-43584c591dfa" containerName="barbican-worker" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.950833 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="18ef8c0b-e810-48c1-b5a5-43584c591dfa" containerName="barbican-worker-log" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.950842 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="d442e64c-a236-4d12-8205-d5cf2cb95748" containerName="barbican-api" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.950854 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e0a6dd94-0b6e-446a-924b-a39ce7582090" containerName="barbican-keystone-listener" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.950866 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="672accec-238b-4e18-9b15-5ff8429d4256" containerName="container-server" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.950875 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="672accec-238b-4e18-9b15-5ff8429d4256" containerName="object-replicator" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.950885 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="672accec-238b-4e18-9b15-5ff8429d4256" containerName="object-auditor" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.950897 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="cb293a62-0310-4af8-8376-0b2197bda8d2" containerName="barbican-worker" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.950905 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="387f81d1-6a19-4250-b210-26daff7cbdc9" containerName="nova-cell1-conductor-conductor" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.950915 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="26a03664-6cb3-4982-80f5-063d8f12cc2a" containerName="barbican-api" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.950924 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="952aeeb8-cdc4-469f-b50b-e5d640adc994" containerName="neutron-api" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.950932 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="952aeeb8-cdc4-469f-b50b-e5d640adc994" containerName="neutron-httpd" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.950942 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="2218d5be-dd10-4e4b-87b9-d9a5273bd197" containerName="placement-api" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.950950 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="672accec-238b-4e18-9b15-5ff8429d4256" containerName="account-auditor" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.950959 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="672accec-238b-4e18-9b15-5ff8429d4256" containerName="container-replicator" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.950972 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="672accec-238b-4e18-9b15-5ff8429d4256" containerName="container-auditor" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.950982 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="cb293a62-0310-4af8-8376-0b2197bda8d2" containerName="barbican-worker-log" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.950992 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="36a1c719-e302-4df3-99c5-5025d99c8c19" containerName="rabbitmq" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.951152 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="d442e64c-a236-4d12-8205-d5cf2cb95748" containerName="barbican-api-log" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.951161 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="6ac49efe-dc8a-47b2-9432-afb41c69ebff" containerName="openstack-network-exporter" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.951172 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="672accec-238b-4e18-9b15-5ff8429d4256" containerName="container-updater" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.951184 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="26a03664-6cb3-4982-80f5-063d8f12cc2a" containerName="barbican-api-log" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.951194 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="672accec-238b-4e18-9b15-5ff8429d4256" containerName="account-replicator" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.951202 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="672accec-238b-4e18-9b15-5ff8429d4256" containerName="swift-recon-cron" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.951215 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="5a0edbf7-738f-4c1a-9333-f23da8ab8067" containerName="barbican-keystone-listener-log" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.951226 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="39704fdb-36c4-41fe-8c13-35a3abb56c36" containerName="rabbitmq" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.951237 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="672accec-238b-4e18-9b15-5ff8429d4256" containerName="object-server" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.951245 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="72052f6a-5423-426f-bdb0-9c9f0609fa34" containerName="oc" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.951254 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="07b2313a-7b50-4c4a-b485-ef68c88e468a" containerName="keystone-api" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.951261 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ac8dd629-af3d-4d9c-b41a-f5b8d6d29498" containerName="placement-log" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.951271 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="5a0edbf7-738f-4c1a-9333-f23da8ab8067" containerName="barbican-keystone-listener" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.951282 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="672accec-238b-4e18-9b15-5ff8429d4256" containerName="object-updater" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.951291 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="672accec-238b-4e18-9b15-5ff8429d4256" containerName="object-expirer" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.951299 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ac8dd629-af3d-4d9c-b41a-f5b8d6d29498" containerName="placement-api" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.951309 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="6ac49efe-dc8a-47b2-9432-afb41c69ebff" containerName="ovn-northd" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.951322 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="afb802db-bd6c-476b-bd76-920d192fc44b" containerName="dnsmasq-dns" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.977099 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.977264 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.980200 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-erlang-cookie\"" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.980650 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-plugins-conf\"" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.980973 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-server-conf\"" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.981158 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-server-dockercfg-7qcqg\"" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.981371 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-default-user\"" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.981517 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-rabbitmq-svc\"" Mar 16 15:54:44 crc kubenswrapper[5120]: I0316 15:54:44.983446 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-config-data\"" Mar 16 15:54:45 crc kubenswrapper[5120]: I0316 15:54:45.008910 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/b6cf92fd-a58b-4b50-9a61-35486c401d72-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"b6cf92fd-a58b-4b50-9a61-35486c401d72\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 15:54:45 crc kubenswrapper[5120]: I0316 15:54:45.008979 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/b6cf92fd-a58b-4b50-9a61-35486c401d72-rabbitmq-tls\") pod \"rabbitmq-server-0\" (UID: \"b6cf92fd-a58b-4b50-9a61-35486c401d72\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 15:54:45 crc kubenswrapper[5120]: I0316 15:54:45.009031 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/b6cf92fd-a58b-4b50-9a61-35486c401d72-config-data\") pod \"rabbitmq-server-0\" (UID: \"b6cf92fd-a58b-4b50-9a61-35486c401d72\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 15:54:45 crc kubenswrapper[5120]: I0316 15:54:45.009051 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/b6cf92fd-a58b-4b50-9a61-35486c401d72-server-conf\") pod \"rabbitmq-server-0\" (UID: \"b6cf92fd-a58b-4b50-9a61-35486c401d72\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 15:54:45 crc kubenswrapper[5120]: I0316 15:54:45.009075 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/b6cf92fd-a58b-4b50-9a61-35486c401d72-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"b6cf92fd-a58b-4b50-9a61-35486c401d72\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 15:54:45 crc kubenswrapper[5120]: I0316 15:54:45.009102 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/b6cf92fd-a58b-4b50-9a61-35486c401d72-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"b6cf92fd-a58b-4b50-9a61-35486c401d72\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 15:54:45 crc kubenswrapper[5120]: I0316 15:54:45.009294 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/b6cf92fd-a58b-4b50-9a61-35486c401d72-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"b6cf92fd-a58b-4b50-9a61-35486c401d72\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 15:54:45 crc kubenswrapper[5120]: I0316 15:54:45.009368 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/b6cf92fd-a58b-4b50-9a61-35486c401d72-pod-info\") pod \"rabbitmq-server-0\" (UID: \"b6cf92fd-a58b-4b50-9a61-35486c401d72\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 15:54:45 crc kubenswrapper[5120]: I0316 15:54:45.009410 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage19-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") pod \"rabbitmq-server-0\" (UID: \"b6cf92fd-a58b-4b50-9a61-35486c401d72\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 15:54:45 crc kubenswrapper[5120]: I0316 15:54:45.009437 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2zwh\" (UniqueName: \"kubernetes.io/projected/b6cf92fd-a58b-4b50-9a61-35486c401d72-kube-api-access-z2zwh\") pod \"rabbitmq-server-0\" (UID: \"b6cf92fd-a58b-4b50-9a61-35486c401d72\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 15:54:45 crc kubenswrapper[5120]: I0316 15:54:45.009459 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/b6cf92fd-a58b-4b50-9a61-35486c401d72-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"b6cf92fd-a58b-4b50-9a61-35486c401d72\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 15:54:45 crc kubenswrapper[5120]: I0316 15:54:45.110920 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/b6cf92fd-a58b-4b50-9a61-35486c401d72-rabbitmq-tls\") pod \"rabbitmq-server-0\" (UID: \"b6cf92fd-a58b-4b50-9a61-35486c401d72\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 15:54:45 crc kubenswrapper[5120]: I0316 15:54:45.110970 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/b6cf92fd-a58b-4b50-9a61-35486c401d72-config-data\") pod \"rabbitmq-server-0\" (UID: \"b6cf92fd-a58b-4b50-9a61-35486c401d72\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 15:54:45 crc kubenswrapper[5120]: I0316 15:54:45.110988 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/b6cf92fd-a58b-4b50-9a61-35486c401d72-server-conf\") pod \"rabbitmq-server-0\" (UID: \"b6cf92fd-a58b-4b50-9a61-35486c401d72\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 15:54:45 crc kubenswrapper[5120]: I0316 15:54:45.111181 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/b6cf92fd-a58b-4b50-9a61-35486c401d72-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"b6cf92fd-a58b-4b50-9a61-35486c401d72\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 15:54:45 crc kubenswrapper[5120]: I0316 15:54:45.111220 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/b6cf92fd-a58b-4b50-9a61-35486c401d72-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"b6cf92fd-a58b-4b50-9a61-35486c401d72\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 15:54:45 crc kubenswrapper[5120]: I0316 15:54:45.111273 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/b6cf92fd-a58b-4b50-9a61-35486c401d72-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"b6cf92fd-a58b-4b50-9a61-35486c401d72\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 15:54:45 crc kubenswrapper[5120]: I0316 15:54:45.111295 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/b6cf92fd-a58b-4b50-9a61-35486c401d72-pod-info\") pod \"rabbitmq-server-0\" (UID: \"b6cf92fd-a58b-4b50-9a61-35486c401d72\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 15:54:45 crc kubenswrapper[5120]: I0316 15:54:45.111328 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage19-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") pod \"rabbitmq-server-0\" (UID: \"b6cf92fd-a58b-4b50-9a61-35486c401d72\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 15:54:45 crc kubenswrapper[5120]: I0316 15:54:45.111624 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage19-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") pod \"rabbitmq-server-0\" (UID: \"b6cf92fd-a58b-4b50-9a61-35486c401d72\") device mount path \"/mnt/openstack/pv19\"" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 15:54:45 crc kubenswrapper[5120]: I0316 15:54:45.111895 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/b6cf92fd-a58b-4b50-9a61-35486c401d72-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"b6cf92fd-a58b-4b50-9a61-35486c401d72\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 15:54:45 crc kubenswrapper[5120]: I0316 15:54:45.112268 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z2zwh\" (UniqueName: \"kubernetes.io/projected/b6cf92fd-a58b-4b50-9a61-35486c401d72-kube-api-access-z2zwh\") pod \"rabbitmq-server-0\" (UID: \"b6cf92fd-a58b-4b50-9a61-35486c401d72\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 15:54:45 crc kubenswrapper[5120]: I0316 15:54:45.112292 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/b6cf92fd-a58b-4b50-9a61-35486c401d72-config-data\") pod \"rabbitmq-server-0\" (UID: \"b6cf92fd-a58b-4b50-9a61-35486c401d72\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 15:54:45 crc kubenswrapper[5120]: I0316 15:54:45.112335 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/b6cf92fd-a58b-4b50-9a61-35486c401d72-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"b6cf92fd-a58b-4b50-9a61-35486c401d72\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 15:54:45 crc kubenswrapper[5120]: I0316 15:54:45.112438 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/b6cf92fd-a58b-4b50-9a61-35486c401d72-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"b6cf92fd-a58b-4b50-9a61-35486c401d72\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 15:54:45 crc kubenswrapper[5120]: I0316 15:54:45.112519 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/b6cf92fd-a58b-4b50-9a61-35486c401d72-server-conf\") pod \"rabbitmq-server-0\" (UID: \"b6cf92fd-a58b-4b50-9a61-35486c401d72\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 15:54:45 crc kubenswrapper[5120]: I0316 15:54:45.112861 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/b6cf92fd-a58b-4b50-9a61-35486c401d72-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"b6cf92fd-a58b-4b50-9a61-35486c401d72\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 15:54:45 crc kubenswrapper[5120]: I0316 15:54:45.113168 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/b6cf92fd-a58b-4b50-9a61-35486c401d72-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"b6cf92fd-a58b-4b50-9a61-35486c401d72\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 15:54:45 crc kubenswrapper[5120]: I0316 15:54:45.117219 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/b6cf92fd-a58b-4b50-9a61-35486c401d72-rabbitmq-tls\") pod \"rabbitmq-server-0\" (UID: \"b6cf92fd-a58b-4b50-9a61-35486c401d72\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 15:54:45 crc kubenswrapper[5120]: I0316 15:54:45.117485 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/b6cf92fd-a58b-4b50-9a61-35486c401d72-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"b6cf92fd-a58b-4b50-9a61-35486c401d72\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 15:54:45 crc kubenswrapper[5120]: I0316 15:54:45.118536 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/b6cf92fd-a58b-4b50-9a61-35486c401d72-pod-info\") pod \"rabbitmq-server-0\" (UID: \"b6cf92fd-a58b-4b50-9a61-35486c401d72\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 15:54:45 crc kubenswrapper[5120]: I0316 15:54:45.122660 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/b6cf92fd-a58b-4b50-9a61-35486c401d72-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"b6cf92fd-a58b-4b50-9a61-35486c401d72\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 15:54:45 crc kubenswrapper[5120]: I0316 15:54:45.135914 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage19-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") pod \"rabbitmq-server-0\" (UID: \"b6cf92fd-a58b-4b50-9a61-35486c401d72\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 15:54:45 crc kubenswrapper[5120]: I0316 15:54:45.142808 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2zwh\" (UniqueName: \"kubernetes.io/projected/b6cf92fd-a58b-4b50-9a61-35486c401d72-kube-api-access-z2zwh\") pod \"rabbitmq-server-0\" (UID: \"b6cf92fd-a58b-4b50-9a61-35486c401d72\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 15:54:45 crc kubenswrapper[5120]: I0316 15:54:45.231905 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 15:54:45 crc kubenswrapper[5120]: I0316 15:54:45.242885 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 15:54:45 crc kubenswrapper[5120]: I0316 15:54:45.244958 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-cell1-default-user\"" Mar 16 15:54:45 crc kubenswrapper[5120]: I0316 15:54:45.245012 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-cell1-server-dockercfg-c676h\"" Mar 16 15:54:45 crc kubenswrapper[5120]: I0316 15:54:45.245359 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-rabbitmq-cell1-svc\"" Mar 16 15:54:45 crc kubenswrapper[5120]: I0316 15:54:45.245545 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-cell1-plugins-conf\"" Mar 16 15:54:45 crc kubenswrapper[5120]: I0316 15:54:45.245560 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-cell1-erlang-cookie\"" Mar 16 15:54:45 crc kubenswrapper[5120]: I0316 15:54:45.246290 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-cell1-server-conf\"" Mar 16 15:54:45 crc kubenswrapper[5120]: I0316 15:54:45.247187 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-cell1-config-data\"" Mar 16 15:54:45 crc kubenswrapper[5120]: I0316 15:54:45.249777 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 15:54:45 crc kubenswrapper[5120]: I0316 15:54:45.296876 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 15:54:45 crc kubenswrapper[5120]: I0316 15:54:45.314895 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/492ba9f3-6479-432b-a2f4-cee712a51800-pod-info\") pod \"rabbitmq-cell1-server-0\" (UID: \"492ba9f3-6479-432b-a2f4-cee712a51800\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 15:54:45 crc kubenswrapper[5120]: I0316 15:54:45.314929 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5sck\" (UniqueName: \"kubernetes.io/projected/492ba9f3-6479-432b-a2f4-cee712a51800-kube-api-access-l5sck\") pod \"rabbitmq-cell1-server-0\" (UID: \"492ba9f3-6479-432b-a2f4-cee712a51800\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 15:54:45 crc kubenswrapper[5120]: I0316 15:54:45.314951 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/492ba9f3-6479-432b-a2f4-cee712a51800-config-data\") pod \"rabbitmq-cell1-server-0\" (UID: \"492ba9f3-6479-432b-a2f4-cee712a51800\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 15:54:45 crc kubenswrapper[5120]: I0316 15:54:45.314981 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/492ba9f3-6479-432b-a2f4-cee712a51800-rabbitmq-tls\") pod \"rabbitmq-cell1-server-0\" (UID: \"492ba9f3-6479-432b-a2f4-cee712a51800\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 15:54:45 crc kubenswrapper[5120]: I0316 15:54:45.315017 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/492ba9f3-6479-432b-a2f4-cee712a51800-rabbitmq-confd\") pod \"rabbitmq-cell1-server-0\" (UID: \"492ba9f3-6479-432b-a2f4-cee712a51800\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 15:54:45 crc kubenswrapper[5120]: I0316 15:54:45.315032 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/492ba9f3-6479-432b-a2f4-cee712a51800-rabbitmq-plugins\") pod \"rabbitmq-cell1-server-0\" (UID: \"492ba9f3-6479-432b-a2f4-cee712a51800\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 15:54:45 crc kubenswrapper[5120]: I0316 15:54:45.315048 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/492ba9f3-6479-432b-a2f4-cee712a51800-erlang-cookie-secret\") pod \"rabbitmq-cell1-server-0\" (UID: \"492ba9f3-6479-432b-a2f4-cee712a51800\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 15:54:45 crc kubenswrapper[5120]: I0316 15:54:45.315064 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"492ba9f3-6479-432b-a2f4-cee712a51800\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 15:54:45 crc kubenswrapper[5120]: I0316 15:54:45.315081 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/492ba9f3-6479-432b-a2f4-cee712a51800-server-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"492ba9f3-6479-432b-a2f4-cee712a51800\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 15:54:45 crc kubenswrapper[5120]: I0316 15:54:45.315115 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/492ba9f3-6479-432b-a2f4-cee712a51800-rabbitmq-erlang-cookie\") pod \"rabbitmq-cell1-server-0\" (UID: \"492ba9f3-6479-432b-a2f4-cee712a51800\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 15:54:45 crc kubenswrapper[5120]: I0316 15:54:45.315137 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/492ba9f3-6479-432b-a2f4-cee712a51800-plugins-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"492ba9f3-6479-432b-a2f4-cee712a51800\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 15:54:45 crc kubenswrapper[5120]: I0316 15:54:45.416821 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/492ba9f3-6479-432b-a2f4-cee712a51800-rabbitmq-confd\") pod \"rabbitmq-cell1-server-0\" (UID: \"492ba9f3-6479-432b-a2f4-cee712a51800\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 15:54:45 crc kubenswrapper[5120]: I0316 15:54:45.417184 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/492ba9f3-6479-432b-a2f4-cee712a51800-rabbitmq-plugins\") pod \"rabbitmq-cell1-server-0\" (UID: \"492ba9f3-6479-432b-a2f4-cee712a51800\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 15:54:45 crc kubenswrapper[5120]: I0316 15:54:45.417225 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/492ba9f3-6479-432b-a2f4-cee712a51800-erlang-cookie-secret\") pod \"rabbitmq-cell1-server-0\" (UID: \"492ba9f3-6479-432b-a2f4-cee712a51800\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 15:54:45 crc kubenswrapper[5120]: I0316 15:54:45.417245 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"492ba9f3-6479-432b-a2f4-cee712a51800\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 15:54:45 crc kubenswrapper[5120]: I0316 15:54:45.417264 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/492ba9f3-6479-432b-a2f4-cee712a51800-server-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"492ba9f3-6479-432b-a2f4-cee712a51800\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 15:54:45 crc kubenswrapper[5120]: I0316 15:54:45.417301 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/492ba9f3-6479-432b-a2f4-cee712a51800-rabbitmq-erlang-cookie\") pod \"rabbitmq-cell1-server-0\" (UID: \"492ba9f3-6479-432b-a2f4-cee712a51800\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 15:54:45 crc kubenswrapper[5120]: I0316 15:54:45.417409 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/492ba9f3-6479-432b-a2f4-cee712a51800-plugins-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"492ba9f3-6479-432b-a2f4-cee712a51800\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 15:54:45 crc kubenswrapper[5120]: I0316 15:54:45.417542 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/492ba9f3-6479-432b-a2f4-cee712a51800-pod-info\") pod \"rabbitmq-cell1-server-0\" (UID: \"492ba9f3-6479-432b-a2f4-cee712a51800\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 15:54:45 crc kubenswrapper[5120]: I0316 15:54:45.417572 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l5sck\" (UniqueName: \"kubernetes.io/projected/492ba9f3-6479-432b-a2f4-cee712a51800-kube-api-access-l5sck\") pod \"rabbitmq-cell1-server-0\" (UID: \"492ba9f3-6479-432b-a2f4-cee712a51800\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 15:54:45 crc kubenswrapper[5120]: I0316 15:54:45.417603 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/492ba9f3-6479-432b-a2f4-cee712a51800-config-data\") pod \"rabbitmq-cell1-server-0\" (UID: \"492ba9f3-6479-432b-a2f4-cee712a51800\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 15:54:45 crc kubenswrapper[5120]: I0316 15:54:45.417654 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/492ba9f3-6479-432b-a2f4-cee712a51800-rabbitmq-tls\") pod \"rabbitmq-cell1-server-0\" (UID: \"492ba9f3-6479-432b-a2f4-cee712a51800\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 15:54:45 crc kubenswrapper[5120]: I0316 15:54:45.417812 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"492ba9f3-6479-432b-a2f4-cee712a51800\") device mount path \"/mnt/openstack/pv10\"" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 15:54:45 crc kubenswrapper[5120]: I0316 15:54:45.417866 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/492ba9f3-6479-432b-a2f4-cee712a51800-rabbitmq-plugins\") pod \"rabbitmq-cell1-server-0\" (UID: \"492ba9f3-6479-432b-a2f4-cee712a51800\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 15:54:45 crc kubenswrapper[5120]: I0316 15:54:45.418592 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/492ba9f3-6479-432b-a2f4-cee712a51800-config-data\") pod \"rabbitmq-cell1-server-0\" (UID: \"492ba9f3-6479-432b-a2f4-cee712a51800\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 15:54:45 crc kubenswrapper[5120]: I0316 15:54:45.417813 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/492ba9f3-6479-432b-a2f4-cee712a51800-rabbitmq-erlang-cookie\") pod \"rabbitmq-cell1-server-0\" (UID: \"492ba9f3-6479-432b-a2f4-cee712a51800\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 15:54:45 crc kubenswrapper[5120]: I0316 15:54:45.419161 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/492ba9f3-6479-432b-a2f4-cee712a51800-server-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"492ba9f3-6479-432b-a2f4-cee712a51800\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 15:54:45 crc kubenswrapper[5120]: I0316 15:54:45.419333 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/492ba9f3-6479-432b-a2f4-cee712a51800-plugins-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"492ba9f3-6479-432b-a2f4-cee712a51800\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 15:54:45 crc kubenswrapper[5120]: I0316 15:54:45.422030 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/492ba9f3-6479-432b-a2f4-cee712a51800-pod-info\") pod \"rabbitmq-cell1-server-0\" (UID: \"492ba9f3-6479-432b-a2f4-cee712a51800\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 15:54:45 crc kubenswrapper[5120]: I0316 15:54:45.423446 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/492ba9f3-6479-432b-a2f4-cee712a51800-rabbitmq-tls\") pod \"rabbitmq-cell1-server-0\" (UID: \"492ba9f3-6479-432b-a2f4-cee712a51800\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 15:54:45 crc kubenswrapper[5120]: I0316 15:54:45.423461 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/492ba9f3-6479-432b-a2f4-cee712a51800-erlang-cookie-secret\") pod \"rabbitmq-cell1-server-0\" (UID: \"492ba9f3-6479-432b-a2f4-cee712a51800\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 15:54:45 crc kubenswrapper[5120]: I0316 15:54:45.433861 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5sck\" (UniqueName: \"kubernetes.io/projected/492ba9f3-6479-432b-a2f4-cee712a51800-kube-api-access-l5sck\") pod \"rabbitmq-cell1-server-0\" (UID: \"492ba9f3-6479-432b-a2f4-cee712a51800\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 15:54:45 crc kubenswrapper[5120]: I0316 15:54:45.438383 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/492ba9f3-6479-432b-a2f4-cee712a51800-rabbitmq-confd\") pod \"rabbitmq-cell1-server-0\" (UID: \"492ba9f3-6479-432b-a2f4-cee712a51800\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 15:54:45 crc kubenswrapper[5120]: I0316 15:54:45.445336 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"492ba9f3-6479-432b-a2f4-cee712a51800\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 15:54:45 crc kubenswrapper[5120]: I0316 15:54:45.578601 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 15:54:45 crc kubenswrapper[5120]: I0316 15:54:45.754744 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 15:54:45 crc kubenswrapper[5120]: W0316 15:54:45.771876 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6cf92fd_a58b_4b50_9a61_35486c401d72.slice/crio-604255d66c1141fe837cf202e2883d42443881438b66d3c6aef9de307be8d409 WatchSource:0}: Error finding container 604255d66c1141fe837cf202e2883d42443881438b66d3c6aef9de307be8d409: Status 404 returned error can't find the container with id 604255d66c1141fe837cf202e2883d42443881438b66d3c6aef9de307be8d409 Mar 16 15:54:45 crc kubenswrapper[5120]: I0316 15:54:45.773179 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 15:54:45 crc kubenswrapper[5120]: I0316 15:54:45.782432 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 15:54:45 crc kubenswrapper[5120]: I0316 15:54:45.789714 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 15:54:45 crc kubenswrapper[5120]: I0316 15:54:45.793893 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"galera-openstack-dockercfg-r4wz7\"" Mar 16 15:54:45 crc kubenswrapper[5120]: I0316 15:54:45.794123 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-galera-openstack-svc\"" Mar 16 15:54:45 crc kubenswrapper[5120]: I0316 15:54:45.794509 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-scripts\"" Mar 16 15:54:45 crc kubenswrapper[5120]: I0316 15:54:45.795277 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-config-data\"" Mar 16 15:54:45 crc kubenswrapper[5120]: I0316 15:54:45.799091 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"combined-ca-bundle\"" Mar 16 15:54:45 crc kubenswrapper[5120]: I0316 15:54:45.824387 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/b97c2a0c-dcad-4453-8063-d1bbcb265531-config-data-generated\") pod \"openstack-galera-0\" (UID: \"b97c2a0c-dcad-4453-8063-d1bbcb265531\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 15:54:45 crc kubenswrapper[5120]: I0316 15:54:45.824436 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/b97c2a0c-dcad-4453-8063-d1bbcb265531-config-data-default\") pod \"openstack-galera-0\" (UID: \"b97c2a0c-dcad-4453-8063-d1bbcb265531\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 15:54:45 crc kubenswrapper[5120]: I0316 15:54:45.824463 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"openstack-galera-0\" (UID: \"b97c2a0c-dcad-4453-8063-d1bbcb265531\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 15:54:45 crc kubenswrapper[5120]: I0316 15:54:45.824502 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/b97c2a0c-dcad-4453-8063-d1bbcb265531-kolla-config\") pod \"openstack-galera-0\" (UID: \"b97c2a0c-dcad-4453-8063-d1bbcb265531\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 15:54:45 crc kubenswrapper[5120]: I0316 15:54:45.824538 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b97c2a0c-dcad-4453-8063-d1bbcb265531-operator-scripts\") pod \"openstack-galera-0\" (UID: \"b97c2a0c-dcad-4453-8063-d1bbcb265531\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 15:54:45 crc kubenswrapper[5120]: I0316 15:54:45.824568 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/b97c2a0c-dcad-4453-8063-d1bbcb265531-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"b97c2a0c-dcad-4453-8063-d1bbcb265531\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 15:54:45 crc kubenswrapper[5120]: I0316 15:54:45.824604 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-626k4\" (UniqueName: \"kubernetes.io/projected/b97c2a0c-dcad-4453-8063-d1bbcb265531-kube-api-access-626k4\") pod \"openstack-galera-0\" (UID: \"b97c2a0c-dcad-4453-8063-d1bbcb265531\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 15:54:45 crc kubenswrapper[5120]: I0316 15:54:45.824641 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b97c2a0c-dcad-4453-8063-d1bbcb265531-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"b97c2a0c-dcad-4453-8063-d1bbcb265531\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 15:54:45 crc kubenswrapper[5120]: I0316 15:54:45.850874 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 15:54:45 crc kubenswrapper[5120]: W0316 15:54:45.854981 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod492ba9f3_6479_432b_a2f4_cee712a51800.slice/crio-c436d6b9a84ab6cf3eb46f7bdcedb0abd392d773c034e32116d7f84745eca689 WatchSource:0}: Error finding container c436d6b9a84ab6cf3eb46f7bdcedb0abd392d773c034e32116d7f84745eca689: Status 404 returned error can't find the container with id c436d6b9a84ab6cf3eb46f7bdcedb0abd392d773c034e32116d7f84745eca689 Mar 16 15:54:45 crc kubenswrapper[5120]: I0316 15:54:45.925785 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-626k4\" (UniqueName: \"kubernetes.io/projected/b97c2a0c-dcad-4453-8063-d1bbcb265531-kube-api-access-626k4\") pod \"openstack-galera-0\" (UID: \"b97c2a0c-dcad-4453-8063-d1bbcb265531\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 15:54:45 crc kubenswrapper[5120]: I0316 15:54:45.926017 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b97c2a0c-dcad-4453-8063-d1bbcb265531-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"b97c2a0c-dcad-4453-8063-d1bbcb265531\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 15:54:45 crc kubenswrapper[5120]: I0316 15:54:45.926106 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/b97c2a0c-dcad-4453-8063-d1bbcb265531-config-data-generated\") pod \"openstack-galera-0\" (UID: \"b97c2a0c-dcad-4453-8063-d1bbcb265531\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 15:54:45 crc kubenswrapper[5120]: I0316 15:54:45.926157 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/b97c2a0c-dcad-4453-8063-d1bbcb265531-config-data-default\") pod \"openstack-galera-0\" (UID: \"b97c2a0c-dcad-4453-8063-d1bbcb265531\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 15:54:45 crc kubenswrapper[5120]: I0316 15:54:45.926320 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"openstack-galera-0\" (UID: \"b97c2a0c-dcad-4453-8063-d1bbcb265531\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 15:54:45 crc kubenswrapper[5120]: I0316 15:54:45.926475 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/b97c2a0c-dcad-4453-8063-d1bbcb265531-kolla-config\") pod \"openstack-galera-0\" (UID: \"b97c2a0c-dcad-4453-8063-d1bbcb265531\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 15:54:45 crc kubenswrapper[5120]: I0316 15:54:45.926596 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b97c2a0c-dcad-4453-8063-d1bbcb265531-operator-scripts\") pod \"openstack-galera-0\" (UID: \"b97c2a0c-dcad-4453-8063-d1bbcb265531\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 15:54:45 crc kubenswrapper[5120]: I0316 15:54:45.926629 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/b97c2a0c-dcad-4453-8063-d1bbcb265531-config-data-generated\") pod \"openstack-galera-0\" (UID: \"b97c2a0c-dcad-4453-8063-d1bbcb265531\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 15:54:45 crc kubenswrapper[5120]: I0316 15:54:45.926807 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"openstack-galera-0\" (UID: \"b97c2a0c-dcad-4453-8063-d1bbcb265531\") device mount path \"/mnt/openstack/pv04\"" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 15:54:45 crc kubenswrapper[5120]: I0316 15:54:45.927316 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/b97c2a0c-dcad-4453-8063-d1bbcb265531-kolla-config\") pod \"openstack-galera-0\" (UID: \"b97c2a0c-dcad-4453-8063-d1bbcb265531\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 15:54:45 crc kubenswrapper[5120]: I0316 15:54:45.927368 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/b97c2a0c-dcad-4453-8063-d1bbcb265531-config-data-default\") pod \"openstack-galera-0\" (UID: \"b97c2a0c-dcad-4453-8063-d1bbcb265531\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 15:54:45 crc kubenswrapper[5120]: I0316 15:54:45.927578 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/b97c2a0c-dcad-4453-8063-d1bbcb265531-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"b97c2a0c-dcad-4453-8063-d1bbcb265531\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 15:54:45 crc kubenswrapper[5120]: I0316 15:54:45.928079 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b97c2a0c-dcad-4453-8063-d1bbcb265531-operator-scripts\") pod \"openstack-galera-0\" (UID: \"b97c2a0c-dcad-4453-8063-d1bbcb265531\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 15:54:45 crc kubenswrapper[5120]: I0316 15:54:45.930620 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b97c2a0c-dcad-4453-8063-d1bbcb265531-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"b97c2a0c-dcad-4453-8063-d1bbcb265531\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 15:54:45 crc kubenswrapper[5120]: I0316 15:54:45.931512 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/b97c2a0c-dcad-4453-8063-d1bbcb265531-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"b97c2a0c-dcad-4453-8063-d1bbcb265531\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 15:54:45 crc kubenswrapper[5120]: I0316 15:54:45.950022 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-626k4\" (UniqueName: \"kubernetes.io/projected/b97c2a0c-dcad-4453-8063-d1bbcb265531-kube-api-access-626k4\") pod \"openstack-galera-0\" (UID: \"b97c2a0c-dcad-4453-8063-d1bbcb265531\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 15:54:45 crc kubenswrapper[5120]: I0316 15:54:45.957634 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"openstack-galera-0\" (UID: \"b97c2a0c-dcad-4453-8063-d1bbcb265531\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 15:54:46 crc kubenswrapper[5120]: I0316 15:54:46.060359 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"b6cf92fd-a58b-4b50-9a61-35486c401d72","Type":"ContainerStarted","Data":"604255d66c1141fe837cf202e2883d42443881438b66d3c6aef9de307be8d409"} Mar 16 15:54:46 crc kubenswrapper[5120]: I0316 15:54:46.061920 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"492ba9f3-6479-432b-a2f4-cee712a51800","Type":"ContainerStarted","Data":"c436d6b9a84ab6cf3eb46f7bdcedb0abd392d773c034e32116d7f84745eca689"} Mar 16 15:54:46 crc kubenswrapper[5120]: I0316 15:54:46.107271 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 15:54:46 crc kubenswrapper[5120]: I0316 15:54:46.568055 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 15:54:47 crc kubenswrapper[5120]: I0316 15:54:47.074161 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"b97c2a0c-dcad-4453-8063-d1bbcb265531","Type":"ContainerStarted","Data":"c4bb05b4408f814c4b0fc3ef1cd25944679ee0d372675b310c045785c8a77bd5"} Mar 16 15:54:47 crc kubenswrapper[5120]: I0316 15:54:47.178205 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 15:54:47 crc kubenswrapper[5120]: I0316 15:54:47.191906 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 15:54:47 crc kubenswrapper[5120]: I0316 15:54:47.194925 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 15:54:47 crc kubenswrapper[5120]: I0316 15:54:47.198428 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-cell1-scripts\"" Mar 16 15:54:47 crc kubenswrapper[5120]: I0316 15:54:47.199235 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-cell1-config-data\"" Mar 16 15:54:47 crc kubenswrapper[5120]: I0316 15:54:47.199409 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-galera-openstack-cell1-svc\"" Mar 16 15:54:47 crc kubenswrapper[5120]: I0316 15:54:47.222748 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"galera-openstack-cell1-dockercfg-qfxz7\"" Mar 16 15:54:47 crc kubenswrapper[5120]: I0316 15:54:47.251385 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/48b9c79e-2a39-4fa1-9143-e4175c7b45b2-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"48b9c79e-2a39-4fa1-9143-e4175c7b45b2\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 15:54:47 crc kubenswrapper[5120]: I0316 15:54:47.251428 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/48b9c79e-2a39-4fa1-9143-e4175c7b45b2-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"48b9c79e-2a39-4fa1-9143-e4175c7b45b2\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 15:54:47 crc kubenswrapper[5120]: I0316 15:54:47.251454 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"openstack-cell1-galera-0\" (UID: \"48b9c79e-2a39-4fa1-9143-e4175c7b45b2\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 15:54:47 crc kubenswrapper[5120]: I0316 15:54:47.251482 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c72hq\" (UniqueName: \"kubernetes.io/projected/48b9c79e-2a39-4fa1-9143-e4175c7b45b2-kube-api-access-c72hq\") pod \"openstack-cell1-galera-0\" (UID: \"48b9c79e-2a39-4fa1-9143-e4175c7b45b2\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 15:54:47 crc kubenswrapper[5120]: I0316 15:54:47.251499 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/48b9c79e-2a39-4fa1-9143-e4175c7b45b2-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"48b9c79e-2a39-4fa1-9143-e4175c7b45b2\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 15:54:47 crc kubenswrapper[5120]: I0316 15:54:47.251538 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/48b9c79e-2a39-4fa1-9143-e4175c7b45b2-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"48b9c79e-2a39-4fa1-9143-e4175c7b45b2\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 15:54:47 crc kubenswrapper[5120]: I0316 15:54:47.251569 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/48b9c79e-2a39-4fa1-9143-e4175c7b45b2-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"48b9c79e-2a39-4fa1-9143-e4175c7b45b2\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 15:54:47 crc kubenswrapper[5120]: I0316 15:54:47.251595 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/48b9c79e-2a39-4fa1-9143-e4175c7b45b2-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"48b9c79e-2a39-4fa1-9143-e4175c7b45b2\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 15:54:47 crc kubenswrapper[5120]: I0316 15:54:47.353850 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/48b9c79e-2a39-4fa1-9143-e4175c7b45b2-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"48b9c79e-2a39-4fa1-9143-e4175c7b45b2\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 15:54:47 crc kubenswrapper[5120]: I0316 15:54:47.353947 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/48b9c79e-2a39-4fa1-9143-e4175c7b45b2-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"48b9c79e-2a39-4fa1-9143-e4175c7b45b2\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 15:54:47 crc kubenswrapper[5120]: I0316 15:54:47.354031 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"openstack-cell1-galera-0\" (UID: \"48b9c79e-2a39-4fa1-9143-e4175c7b45b2\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 15:54:47 crc kubenswrapper[5120]: I0316 15:54:47.354088 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c72hq\" (UniqueName: \"kubernetes.io/projected/48b9c79e-2a39-4fa1-9143-e4175c7b45b2-kube-api-access-c72hq\") pod \"openstack-cell1-galera-0\" (UID: \"48b9c79e-2a39-4fa1-9143-e4175c7b45b2\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 15:54:47 crc kubenswrapper[5120]: I0316 15:54:47.354121 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/48b9c79e-2a39-4fa1-9143-e4175c7b45b2-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"48b9c79e-2a39-4fa1-9143-e4175c7b45b2\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 15:54:47 crc kubenswrapper[5120]: I0316 15:54:47.354211 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/48b9c79e-2a39-4fa1-9143-e4175c7b45b2-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"48b9c79e-2a39-4fa1-9143-e4175c7b45b2\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 15:54:47 crc kubenswrapper[5120]: I0316 15:54:47.354290 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/48b9c79e-2a39-4fa1-9143-e4175c7b45b2-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"48b9c79e-2a39-4fa1-9143-e4175c7b45b2\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 15:54:47 crc kubenswrapper[5120]: I0316 15:54:47.354345 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/48b9c79e-2a39-4fa1-9143-e4175c7b45b2-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"48b9c79e-2a39-4fa1-9143-e4175c7b45b2\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 15:54:47 crc kubenswrapper[5120]: I0316 15:54:47.354834 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"openstack-cell1-galera-0\" (UID: \"48b9c79e-2a39-4fa1-9143-e4175c7b45b2\") device mount path \"/mnt/openstack/pv12\"" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 15:54:47 crc kubenswrapper[5120]: I0316 15:54:47.354833 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/48b9c79e-2a39-4fa1-9143-e4175c7b45b2-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"48b9c79e-2a39-4fa1-9143-e4175c7b45b2\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 15:54:47 crc kubenswrapper[5120]: I0316 15:54:47.355290 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/48b9c79e-2a39-4fa1-9143-e4175c7b45b2-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"48b9c79e-2a39-4fa1-9143-e4175c7b45b2\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 15:54:47 crc kubenswrapper[5120]: I0316 15:54:47.355492 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/48b9c79e-2a39-4fa1-9143-e4175c7b45b2-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"48b9c79e-2a39-4fa1-9143-e4175c7b45b2\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 15:54:47 crc kubenswrapper[5120]: I0316 15:54:47.356948 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/48b9c79e-2a39-4fa1-9143-e4175c7b45b2-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"48b9c79e-2a39-4fa1-9143-e4175c7b45b2\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 15:54:47 crc kubenswrapper[5120]: I0316 15:54:47.359794 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/48b9c79e-2a39-4fa1-9143-e4175c7b45b2-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"48b9c79e-2a39-4fa1-9143-e4175c7b45b2\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 15:54:47 crc kubenswrapper[5120]: I0316 15:54:47.362108 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/48b9c79e-2a39-4fa1-9143-e4175c7b45b2-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"48b9c79e-2a39-4fa1-9143-e4175c7b45b2\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 15:54:47 crc kubenswrapper[5120]: I0316 15:54:47.373100 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c72hq\" (UniqueName: \"kubernetes.io/projected/48b9c79e-2a39-4fa1-9143-e4175c7b45b2-kube-api-access-c72hq\") pod \"openstack-cell1-galera-0\" (UID: \"48b9c79e-2a39-4fa1-9143-e4175c7b45b2\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 15:54:47 crc kubenswrapper[5120]: I0316 15:54:47.377018 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"openstack-cell1-galera-0\" (UID: \"48b9c79e-2a39-4fa1-9143-e4175c7b45b2\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 15:54:47 crc kubenswrapper[5120]: I0316 15:54:47.528004 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 15:54:47 crc kubenswrapper[5120]: I0316 15:54:47.955391 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 15:54:47 crc kubenswrapper[5120]: W0316 15:54:47.959637 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod48b9c79e_2a39_4fa1_9143_e4175c7b45b2.slice/crio-e6bbfaa4c28705e9fd56de22addffac2da9b1f9e925eed57dd08a75c2a7acd67 WatchSource:0}: Error finding container e6bbfaa4c28705e9fd56de22addffac2da9b1f9e925eed57dd08a75c2a7acd67: Status 404 returned error can't find the container with id e6bbfaa4c28705e9fd56de22addffac2da9b1f9e925eed57dd08a75c2a7acd67 Mar 16 15:54:48 crc kubenswrapper[5120]: I0316 15:54:48.089405 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"b97c2a0c-dcad-4453-8063-d1bbcb265531","Type":"ContainerStarted","Data":"ac2b119aa92ab660e370e9cb5a952842b6048001c1aed3cc98a4b99d73c542f3"} Mar 16 15:54:48 crc kubenswrapper[5120]: I0316 15:54:48.098973 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"48b9c79e-2a39-4fa1-9143-e4175c7b45b2","Type":"ContainerStarted","Data":"e6bbfaa4c28705e9fd56de22addffac2da9b1f9e925eed57dd08a75c2a7acd67"} Mar 16 15:54:48 crc kubenswrapper[5120]: I0316 15:54:48.101899 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"b6cf92fd-a58b-4b50-9a61-35486c401d72","Type":"ContainerStarted","Data":"dc1ea3d63cb3c9a3449a18594ba679f9478d78eeb79482b58b07bf529b9454bc"} Mar 16 15:54:48 crc kubenswrapper[5120]: I0316 15:54:48.104446 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"492ba9f3-6479-432b-a2f4-cee712a51800","Type":"ContainerStarted","Data":"cc516c998df4368da23b745b2b3be8bba3d29335ec841cf7ca6fe843c277d2db"} Mar 16 15:54:48 crc kubenswrapper[5120]: I0316 15:54:48.430022 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 15:54:48 crc kubenswrapper[5120]: I0316 15:54:48.439680 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Mar 16 15:54:48 crc kubenswrapper[5120]: I0316 15:54:48.441901 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"memcached-config-data\"" Mar 16 15:54:48 crc kubenswrapper[5120]: I0316 15:54:48.442135 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-memcached-svc\"" Mar 16 15:54:48 crc kubenswrapper[5120]: I0316 15:54:48.442269 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"memcached-memcached-dockercfg-hxhqr\"" Mar 16 15:54:48 crc kubenswrapper[5120]: I0316 15:54:48.443798 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 15:54:48 crc kubenswrapper[5120]: I0316 15:54:48.573002 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/5664a123-9ba3-41e9-8dab-49276b5e404e-kolla-config\") pod \"memcached-0\" (UID: \"5664a123-9ba3-41e9-8dab-49276b5e404e\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 15:54:48 crc kubenswrapper[5120]: I0316 15:54:48.573078 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkpmt\" (UniqueName: \"kubernetes.io/projected/5664a123-9ba3-41e9-8dab-49276b5e404e-kube-api-access-fkpmt\") pod \"memcached-0\" (UID: \"5664a123-9ba3-41e9-8dab-49276b5e404e\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 15:54:48 crc kubenswrapper[5120]: I0316 15:54:48.573188 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/5664a123-9ba3-41e9-8dab-49276b5e404e-memcached-tls-certs\") pod \"memcached-0\" (UID: \"5664a123-9ba3-41e9-8dab-49276b5e404e\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 15:54:48 crc kubenswrapper[5120]: I0316 15:54:48.573263 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/5664a123-9ba3-41e9-8dab-49276b5e404e-config-data\") pod \"memcached-0\" (UID: \"5664a123-9ba3-41e9-8dab-49276b5e404e\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 15:54:48 crc kubenswrapper[5120]: I0316 15:54:48.573289 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5664a123-9ba3-41e9-8dab-49276b5e404e-combined-ca-bundle\") pod \"memcached-0\" (UID: \"5664a123-9ba3-41e9-8dab-49276b5e404e\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 15:54:48 crc kubenswrapper[5120]: I0316 15:54:48.675452 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/5664a123-9ba3-41e9-8dab-49276b5e404e-kolla-config\") pod \"memcached-0\" (UID: \"5664a123-9ba3-41e9-8dab-49276b5e404e\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 15:54:48 crc kubenswrapper[5120]: I0316 15:54:48.675551 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fkpmt\" (UniqueName: \"kubernetes.io/projected/5664a123-9ba3-41e9-8dab-49276b5e404e-kube-api-access-fkpmt\") pod \"memcached-0\" (UID: \"5664a123-9ba3-41e9-8dab-49276b5e404e\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 15:54:48 crc kubenswrapper[5120]: I0316 15:54:48.675593 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/5664a123-9ba3-41e9-8dab-49276b5e404e-memcached-tls-certs\") pod \"memcached-0\" (UID: \"5664a123-9ba3-41e9-8dab-49276b5e404e\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 15:54:48 crc kubenswrapper[5120]: I0316 15:54:48.675621 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/5664a123-9ba3-41e9-8dab-49276b5e404e-config-data\") pod \"memcached-0\" (UID: \"5664a123-9ba3-41e9-8dab-49276b5e404e\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 15:54:48 crc kubenswrapper[5120]: I0316 15:54:48.675642 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5664a123-9ba3-41e9-8dab-49276b5e404e-combined-ca-bundle\") pod \"memcached-0\" (UID: \"5664a123-9ba3-41e9-8dab-49276b5e404e\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 15:54:48 crc kubenswrapper[5120]: I0316 15:54:48.676855 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/5664a123-9ba3-41e9-8dab-49276b5e404e-kolla-config\") pod \"memcached-0\" (UID: \"5664a123-9ba3-41e9-8dab-49276b5e404e\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 15:54:48 crc kubenswrapper[5120]: I0316 15:54:48.677602 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/5664a123-9ba3-41e9-8dab-49276b5e404e-config-data\") pod \"memcached-0\" (UID: \"5664a123-9ba3-41e9-8dab-49276b5e404e\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 15:54:48 crc kubenswrapper[5120]: I0316 15:54:48.680720 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/5664a123-9ba3-41e9-8dab-49276b5e404e-memcached-tls-certs\") pod \"memcached-0\" (UID: \"5664a123-9ba3-41e9-8dab-49276b5e404e\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 15:54:48 crc kubenswrapper[5120]: I0316 15:54:48.681665 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5664a123-9ba3-41e9-8dab-49276b5e404e-combined-ca-bundle\") pod \"memcached-0\" (UID: \"5664a123-9ba3-41e9-8dab-49276b5e404e\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 15:54:48 crc kubenswrapper[5120]: I0316 15:54:48.699621 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkpmt\" (UniqueName: \"kubernetes.io/projected/5664a123-9ba3-41e9-8dab-49276b5e404e-kube-api-access-fkpmt\") pod \"memcached-0\" (UID: \"5664a123-9ba3-41e9-8dab-49276b5e404e\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 15:54:48 crc kubenswrapper[5120]: I0316 15:54:48.809253 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Mar 16 15:54:49 crc kubenswrapper[5120]: I0316 15:54:49.113519 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"48b9c79e-2a39-4fa1-9143-e4175c7b45b2","Type":"ContainerStarted","Data":"ede033cdbc5c460f1a243d87eb0104650bd70a244d11e81484ca2bd677c1f9f7"} Mar 16 15:54:49 crc kubenswrapper[5120]: I0316 15:54:49.238184 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 15:54:49 crc kubenswrapper[5120]: W0316 15:54:49.252448 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5664a123_9ba3_41e9_8dab_49276b5e404e.slice/crio-93d424d2baafc468faaf8b01eb215284881e85c8b9f3d267475f19552298c216 WatchSource:0}: Error finding container 93d424d2baafc468faaf8b01eb215284881e85c8b9f3d267475f19552298c216: Status 404 returned error can't find the container with id 93d424d2baafc468faaf8b01eb215284881e85c8b9f3d267475f19552298c216 Mar 16 15:54:50 crc kubenswrapper[5120]: I0316 15:54:50.122865 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"5664a123-9ba3-41e9-8dab-49276b5e404e","Type":"ContainerStarted","Data":"3e79e4c778100da677b7b8adc1bc5e9b3d67806fc66f9998e46dbce7ad87e99e"} Mar 16 15:54:50 crc kubenswrapper[5120]: I0316 15:54:50.123938 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"5664a123-9ba3-41e9-8dab-49276b5e404e","Type":"ContainerStarted","Data":"93d424d2baafc468faaf8b01eb215284881e85c8b9f3d267475f19552298c216"} Mar 16 15:54:50 crc kubenswrapper[5120]: I0316 15:54:50.125010 5120 generic.go:358] "Generic (PLEG): container finished" podID="b97c2a0c-dcad-4453-8063-d1bbcb265531" containerID="ac2b119aa92ab660e370e9cb5a952842b6048001c1aed3cc98a4b99d73c542f3" exitCode=0 Mar 16 15:54:50 crc kubenswrapper[5120]: I0316 15:54:50.125090 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"b97c2a0c-dcad-4453-8063-d1bbcb265531","Type":"ContainerDied","Data":"ac2b119aa92ab660e370e9cb5a952842b6048001c1aed3cc98a4b99d73c542f3"} Mar 16 15:54:50 crc kubenswrapper[5120]: I0316 15:54:50.126480 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/memcached-0" Mar 16 15:54:50 crc kubenswrapper[5120]: I0316 15:54:50.141148 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/memcached-0" podStartSLOduration=2.141130409 podStartE2EDuration="2.141130409s" podCreationTimestamp="2026-03-16 15:54:48 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:54:50.140188703 +0000 UTC m=+1392.294120360" watchObservedRunningTime="2026-03-16 15:54:50.141130409 +0000 UTC m=+1392.295062066" Mar 16 15:54:50 crc kubenswrapper[5120]: I0316 15:54:50.681891 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 15:54:50 crc kubenswrapper[5120]: I0316 15:54:50.685963 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 15:54:50 crc kubenswrapper[5120]: I0316 15:54:50.688096 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"telemetry-ceilometer-dockercfg-sgmdr\"" Mar 16 15:54:50 crc kubenswrapper[5120]: I0316 15:54:50.708604 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 15:54:50 crc kubenswrapper[5120]: I0316 15:54:50.812074 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bcdfr\" (UniqueName: \"kubernetes.io/projected/c434fd9b-977d-4e56-aa01-fb93cb76350d-kube-api-access-bcdfr\") pod \"kube-state-metrics-0\" (UID: \"c434fd9b-977d-4e56-aa01-fb93cb76350d\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 15:54:50 crc kubenswrapper[5120]: I0316 15:54:50.913695 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bcdfr\" (UniqueName: \"kubernetes.io/projected/c434fd9b-977d-4e56-aa01-fb93cb76350d-kube-api-access-bcdfr\") pod \"kube-state-metrics-0\" (UID: \"c434fd9b-977d-4e56-aa01-fb93cb76350d\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 15:54:50 crc kubenswrapper[5120]: I0316 15:54:50.932796 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bcdfr\" (UniqueName: \"kubernetes.io/projected/c434fd9b-977d-4e56-aa01-fb93cb76350d-kube-api-access-bcdfr\") pod \"kube-state-metrics-0\" (UID: \"c434fd9b-977d-4e56-aa01-fb93cb76350d\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 15:54:51 crc kubenswrapper[5120]: I0316 15:54:51.008482 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 15:54:51 crc kubenswrapper[5120]: I0316 15:54:51.140399 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"b97c2a0c-dcad-4453-8063-d1bbcb265531","Type":"ContainerStarted","Data":"7a661bc910ce2d776a4e9f81005f8af24f1929db2c6f86edd9380bc21d372086"} Mar 16 15:54:51 crc kubenswrapper[5120]: I0316 15:54:51.142360 5120 generic.go:358] "Generic (PLEG): container finished" podID="48b9c79e-2a39-4fa1-9143-e4175c7b45b2" containerID="ede033cdbc5c460f1a243d87eb0104650bd70a244d11e81484ca2bd677c1f9f7" exitCode=0 Mar 16 15:54:51 crc kubenswrapper[5120]: I0316 15:54:51.142891 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"48b9c79e-2a39-4fa1-9143-e4175c7b45b2","Type":"ContainerDied","Data":"ede033cdbc5c460f1a243d87eb0104650bd70a244d11e81484ca2bd677c1f9f7"} Mar 16 15:54:51 crc kubenswrapper[5120]: I0316 15:54:51.173228 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstack-galera-0" podStartSLOduration=6.173207825 podStartE2EDuration="6.173207825s" podCreationTimestamp="2026-03-16 15:54:45 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:54:51.160963906 +0000 UTC m=+1393.314895563" watchObservedRunningTime="2026-03-16 15:54:51.173207825 +0000 UTC m=+1393.327139492" Mar 16 15:54:51 crc kubenswrapper[5120]: I0316 15:54:51.475445 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 15:54:51 crc kubenswrapper[5120]: W0316 15:54:51.481835 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc434fd9b_977d_4e56_aa01_fb93cb76350d.slice/crio-4ae3912155cf98d9b66616544c4a611d63a9d1abc6a9361c09b98d51af5b209d WatchSource:0}: Error finding container 4ae3912155cf98d9b66616544c4a611d63a9d1abc6a9361c09b98d51af5b209d: Status 404 returned error can't find the container with id 4ae3912155cf98d9b66616544c4a611d63a9d1abc6a9361c09b98d51af5b209d Mar 16 15:54:52 crc kubenswrapper[5120]: I0316 15:54:52.152020 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"48b9c79e-2a39-4fa1-9143-e4175c7b45b2","Type":"ContainerStarted","Data":"94a873fd2b944f420b88e4b9e672ad596d411c27b15f3cb17cf449dd38652633"} Mar 16 15:54:52 crc kubenswrapper[5120]: I0316 15:54:52.153653 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"c434fd9b-977d-4e56-aa01-fb93cb76350d","Type":"ContainerStarted","Data":"111343d1b0cb1a9cb30e9213fa1ab9b99217b90f42c2e7cfa1cba940d9218185"} Mar 16 15:54:52 crc kubenswrapper[5120]: I0316 15:54:52.153683 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"c434fd9b-977d-4e56-aa01-fb93cb76350d","Type":"ContainerStarted","Data":"4ae3912155cf98d9b66616544c4a611d63a9d1abc6a9361c09b98d51af5b209d"} Mar 16 15:54:52 crc kubenswrapper[5120]: I0316 15:54:52.154085 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 15:54:52 crc kubenswrapper[5120]: I0316 15:54:52.192454 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstack-cell1-galera-0" podStartSLOduration=5.192435805 podStartE2EDuration="5.192435805s" podCreationTimestamp="2026-03-16 15:54:47 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:54:52.179118396 +0000 UTC m=+1394.333050053" watchObservedRunningTime="2026-03-16 15:54:52.192435805 +0000 UTC m=+1394.346367462" Mar 16 15:54:52 crc kubenswrapper[5120]: I0316 15:54:52.219256 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/kube-state-metrics-0" podStartSLOduration=1.839402487 podStartE2EDuration="2.219234397s" podCreationTimestamp="2026-03-16 15:54:50 +0000 UTC" firstStartedPulling="2026-03-16 15:54:51.483648943 +0000 UTC m=+1393.637580600" lastFinishedPulling="2026-03-16 15:54:51.863480853 +0000 UTC m=+1394.017412510" observedRunningTime="2026-03-16 15:54:52.217358835 +0000 UTC m=+1394.371290492" watchObservedRunningTime="2026-03-16 15:54:52.219234397 +0000 UTC m=+1394.373166054" Mar 16 15:54:54 crc kubenswrapper[5120]: I0316 15:54:54.029407 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 15:54:54 crc kubenswrapper[5120]: I0316 15:54:54.035540 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 15:54:54 crc kubenswrapper[5120]: I0316 15:54:54.037267 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ovndbcluster-sb-ovndbs\"" Mar 16 15:54:54 crc kubenswrapper[5120]: I0316 15:54:54.037503 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovndbcluster-sb-scripts\"" Mar 16 15:54:54 crc kubenswrapper[5120]: I0316 15:54:54.037987 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ovncluster-ovndbcluster-sb-dockercfg-8zwwj\"" Mar 16 15:54:54 crc kubenswrapper[5120]: I0316 15:54:54.038363 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ovn-metrics\"" Mar 16 15:54:54 crc kubenswrapper[5120]: I0316 15:54:54.038912 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 15:54:54 crc kubenswrapper[5120]: I0316 15:54:54.039355 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovndbcluster-sb-config\"" Mar 16 15:54:54 crc kubenswrapper[5120]: I0316 15:54:54.196309 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/588c75bf-de6d-4608-8d63-85c81408a1e3-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"588c75bf-de6d-4608-8d63-85c81408a1e3\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 15:54:54 crc kubenswrapper[5120]: I0316 15:54:54.196373 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/588c75bf-de6d-4608-8d63-85c81408a1e3-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"588c75bf-de6d-4608-8d63-85c81408a1e3\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 15:54:54 crc kubenswrapper[5120]: I0316 15:54:54.196399 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7vmn\" (UniqueName: \"kubernetes.io/projected/588c75bf-de6d-4608-8d63-85c81408a1e3-kube-api-access-z7vmn\") pod \"ovsdbserver-sb-0\" (UID: \"588c75bf-de6d-4608-8d63-85c81408a1e3\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 15:54:54 crc kubenswrapper[5120]: I0316 15:54:54.196549 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/588c75bf-de6d-4608-8d63-85c81408a1e3-config\") pod \"ovsdbserver-sb-0\" (UID: \"588c75bf-de6d-4608-8d63-85c81408a1e3\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 15:54:54 crc kubenswrapper[5120]: I0316 15:54:54.196735 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/588c75bf-de6d-4608-8d63-85c81408a1e3-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"588c75bf-de6d-4608-8d63-85c81408a1e3\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 15:54:54 crc kubenswrapper[5120]: I0316 15:54:54.196851 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"ovsdbserver-sb-0\" (UID: \"588c75bf-de6d-4608-8d63-85c81408a1e3\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 15:54:54 crc kubenswrapper[5120]: I0316 15:54:54.196927 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/588c75bf-de6d-4608-8d63-85c81408a1e3-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"588c75bf-de6d-4608-8d63-85c81408a1e3\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 15:54:54 crc kubenswrapper[5120]: I0316 15:54:54.197044 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/588c75bf-de6d-4608-8d63-85c81408a1e3-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"588c75bf-de6d-4608-8d63-85c81408a1e3\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 15:54:54 crc kubenswrapper[5120]: I0316 15:54:54.298979 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/588c75bf-de6d-4608-8d63-85c81408a1e3-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"588c75bf-de6d-4608-8d63-85c81408a1e3\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 15:54:54 crc kubenswrapper[5120]: I0316 15:54:54.299101 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/588c75bf-de6d-4608-8d63-85c81408a1e3-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"588c75bf-de6d-4608-8d63-85c81408a1e3\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 15:54:54 crc kubenswrapper[5120]: I0316 15:54:54.299140 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/588c75bf-de6d-4608-8d63-85c81408a1e3-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"588c75bf-de6d-4608-8d63-85c81408a1e3\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 15:54:54 crc kubenswrapper[5120]: I0316 15:54:54.299163 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z7vmn\" (UniqueName: \"kubernetes.io/projected/588c75bf-de6d-4608-8d63-85c81408a1e3-kube-api-access-z7vmn\") pod \"ovsdbserver-sb-0\" (UID: \"588c75bf-de6d-4608-8d63-85c81408a1e3\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 15:54:54 crc kubenswrapper[5120]: I0316 15:54:54.299197 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/588c75bf-de6d-4608-8d63-85c81408a1e3-config\") pod \"ovsdbserver-sb-0\" (UID: \"588c75bf-de6d-4608-8d63-85c81408a1e3\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 15:54:54 crc kubenswrapper[5120]: I0316 15:54:54.299271 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/588c75bf-de6d-4608-8d63-85c81408a1e3-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"588c75bf-de6d-4608-8d63-85c81408a1e3\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 15:54:54 crc kubenswrapper[5120]: I0316 15:54:54.299331 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"ovsdbserver-sb-0\" (UID: \"588c75bf-de6d-4608-8d63-85c81408a1e3\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 15:54:54 crc kubenswrapper[5120]: I0316 15:54:54.299375 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/588c75bf-de6d-4608-8d63-85c81408a1e3-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"588c75bf-de6d-4608-8d63-85c81408a1e3\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 15:54:54 crc kubenswrapper[5120]: I0316 15:54:54.299872 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/588c75bf-de6d-4608-8d63-85c81408a1e3-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"588c75bf-de6d-4608-8d63-85c81408a1e3\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 15:54:54 crc kubenswrapper[5120]: I0316 15:54:54.300129 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"ovsdbserver-sb-0\" (UID: \"588c75bf-de6d-4608-8d63-85c81408a1e3\") device mount path \"/mnt/openstack/pv05\"" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 15:54:54 crc kubenswrapper[5120]: I0316 15:54:54.300845 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/588c75bf-de6d-4608-8d63-85c81408a1e3-config\") pod \"ovsdbserver-sb-0\" (UID: \"588c75bf-de6d-4608-8d63-85c81408a1e3\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 15:54:54 crc kubenswrapper[5120]: I0316 15:54:54.301087 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/588c75bf-de6d-4608-8d63-85c81408a1e3-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"588c75bf-de6d-4608-8d63-85c81408a1e3\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 15:54:54 crc kubenswrapper[5120]: I0316 15:54:54.308126 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/588c75bf-de6d-4608-8d63-85c81408a1e3-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"588c75bf-de6d-4608-8d63-85c81408a1e3\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 15:54:54 crc kubenswrapper[5120]: I0316 15:54:54.309569 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/588c75bf-de6d-4608-8d63-85c81408a1e3-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"588c75bf-de6d-4608-8d63-85c81408a1e3\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 15:54:54 crc kubenswrapper[5120]: I0316 15:54:54.319219 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7vmn\" (UniqueName: \"kubernetes.io/projected/588c75bf-de6d-4608-8d63-85c81408a1e3-kube-api-access-z7vmn\") pod \"ovsdbserver-sb-0\" (UID: \"588c75bf-de6d-4608-8d63-85c81408a1e3\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 15:54:54 crc kubenswrapper[5120]: I0316 15:54:54.319888 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/588c75bf-de6d-4608-8d63-85c81408a1e3-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"588c75bf-de6d-4608-8d63-85c81408a1e3\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 15:54:54 crc kubenswrapper[5120]: I0316 15:54:54.327164 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"ovsdbserver-sb-0\" (UID: \"588c75bf-de6d-4608-8d63-85c81408a1e3\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 15:54:54 crc kubenswrapper[5120]: I0316 15:54:54.353117 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 15:54:54 crc kubenswrapper[5120]: W0316 15:54:54.914060 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod588c75bf_de6d_4608_8d63_85c81408a1e3.slice/crio-efa2bcd9e91bae4c253324c7c1eca6747250e478521fa9680fcd7eebd8ea6110 WatchSource:0}: Error finding container efa2bcd9e91bae4c253324c7c1eca6747250e478521fa9680fcd7eebd8ea6110: Status 404 returned error can't find the container with id efa2bcd9e91bae4c253324c7c1eca6747250e478521fa9680fcd7eebd8ea6110 Mar 16 15:54:54 crc kubenswrapper[5120]: I0316 15:54:54.914532 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 15:54:55 crc kubenswrapper[5120]: I0316 15:54:55.179746 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"588c75bf-de6d-4608-8d63-85c81408a1e3","Type":"ContainerStarted","Data":"5d526fe7f2a81cde0367c562baa67b6eaa605bb9da0cb25fb3bb2d2a88797c4f"} Mar 16 15:54:55 crc kubenswrapper[5120]: I0316 15:54:55.179807 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"588c75bf-de6d-4608-8d63-85c81408a1e3","Type":"ContainerStarted","Data":"efa2bcd9e91bae4c253324c7c1eca6747250e478521fa9680fcd7eebd8ea6110"} Mar 16 15:54:55 crc kubenswrapper[5120]: I0316 15:54:55.701835 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 15:54:55 crc kubenswrapper[5120]: I0316 15:54:55.706907 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 15:54:55 crc kubenswrapper[5120]: I0316 15:54:55.709653 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovndbcluster-nb-scripts\"" Mar 16 15:54:55 crc kubenswrapper[5120]: I0316 15:54:55.714408 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ovncluster-ovndbcluster-nb-dockercfg-8jt4r\"" Mar 16 15:54:55 crc kubenswrapper[5120]: I0316 15:54:55.714454 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ovndbcluster-nb-ovndbs\"" Mar 16 15:54:55 crc kubenswrapper[5120]: I0316 15:54:55.715239 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovndbcluster-nb-config\"" Mar 16 15:54:55 crc kubenswrapper[5120]: I0316 15:54:55.727681 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 15:54:55 crc kubenswrapper[5120]: I0316 15:54:55.822968 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage15-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage15-crc\") pod \"ovsdbserver-nb-0\" (UID: \"f8f48fe3-091f-40a2-b580-69ba5cb95392\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 15:54:55 crc kubenswrapper[5120]: I0316 15:54:55.823022 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f8f48fe3-091f-40a2-b580-69ba5cb95392-config\") pod \"ovsdbserver-nb-0\" (UID: \"f8f48fe3-091f-40a2-b580-69ba5cb95392\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 15:54:55 crc kubenswrapper[5120]: I0316 15:54:55.823050 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/f8f48fe3-091f-40a2-b580-69ba5cb95392-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"f8f48fe3-091f-40a2-b580-69ba5cb95392\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 15:54:55 crc kubenswrapper[5120]: I0316 15:54:55.823404 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvbcr\" (UniqueName: \"kubernetes.io/projected/f8f48fe3-091f-40a2-b580-69ba5cb95392-kube-api-access-jvbcr\") pod \"ovsdbserver-nb-0\" (UID: \"f8f48fe3-091f-40a2-b580-69ba5cb95392\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 15:54:55 crc kubenswrapper[5120]: I0316 15:54:55.823449 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/f8f48fe3-091f-40a2-b580-69ba5cb95392-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"f8f48fe3-091f-40a2-b580-69ba5cb95392\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 15:54:55 crc kubenswrapper[5120]: I0316 15:54:55.823518 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/f8f48fe3-091f-40a2-b580-69ba5cb95392-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"f8f48fe3-091f-40a2-b580-69ba5cb95392\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 15:54:55 crc kubenswrapper[5120]: I0316 15:54:55.823557 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/f8f48fe3-091f-40a2-b580-69ba5cb95392-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"f8f48fe3-091f-40a2-b580-69ba5cb95392\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 15:54:55 crc kubenswrapper[5120]: I0316 15:54:55.823574 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f8f48fe3-091f-40a2-b580-69ba5cb95392-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"f8f48fe3-091f-40a2-b580-69ba5cb95392\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 15:54:55 crc kubenswrapper[5120]: I0316 15:54:55.924796 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jvbcr\" (UniqueName: \"kubernetes.io/projected/f8f48fe3-091f-40a2-b580-69ba5cb95392-kube-api-access-jvbcr\") pod \"ovsdbserver-nb-0\" (UID: \"f8f48fe3-091f-40a2-b580-69ba5cb95392\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 15:54:55 crc kubenswrapper[5120]: I0316 15:54:55.925078 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/f8f48fe3-091f-40a2-b580-69ba5cb95392-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"f8f48fe3-091f-40a2-b580-69ba5cb95392\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 15:54:55 crc kubenswrapper[5120]: I0316 15:54:55.925248 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/f8f48fe3-091f-40a2-b580-69ba5cb95392-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"f8f48fe3-091f-40a2-b580-69ba5cb95392\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 15:54:55 crc kubenswrapper[5120]: I0316 15:54:55.925344 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/f8f48fe3-091f-40a2-b580-69ba5cb95392-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"f8f48fe3-091f-40a2-b580-69ba5cb95392\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 15:54:55 crc kubenswrapper[5120]: I0316 15:54:55.925412 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f8f48fe3-091f-40a2-b580-69ba5cb95392-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"f8f48fe3-091f-40a2-b580-69ba5cb95392\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 15:54:55 crc kubenswrapper[5120]: I0316 15:54:55.925516 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage15-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage15-crc\") pod \"ovsdbserver-nb-0\" (UID: \"f8f48fe3-091f-40a2-b580-69ba5cb95392\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 15:54:55 crc kubenswrapper[5120]: I0316 15:54:55.925603 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f8f48fe3-091f-40a2-b580-69ba5cb95392-config\") pod \"ovsdbserver-nb-0\" (UID: \"f8f48fe3-091f-40a2-b580-69ba5cb95392\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 15:54:55 crc kubenswrapper[5120]: I0316 15:54:55.925682 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/f8f48fe3-091f-40a2-b580-69ba5cb95392-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"f8f48fe3-091f-40a2-b580-69ba5cb95392\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 15:54:55 crc kubenswrapper[5120]: I0316 15:54:55.926341 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/f8f48fe3-091f-40a2-b580-69ba5cb95392-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"f8f48fe3-091f-40a2-b580-69ba5cb95392\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 15:54:55 crc kubenswrapper[5120]: I0316 15:54:55.926952 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/f8f48fe3-091f-40a2-b580-69ba5cb95392-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"f8f48fe3-091f-40a2-b580-69ba5cb95392\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 15:54:55 crc kubenswrapper[5120]: I0316 15:54:55.926963 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage15-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage15-crc\") pod \"ovsdbserver-nb-0\" (UID: \"f8f48fe3-091f-40a2-b580-69ba5cb95392\") device mount path \"/mnt/openstack/pv15\"" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 15:54:55 crc kubenswrapper[5120]: I0316 15:54:55.929087 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f8f48fe3-091f-40a2-b580-69ba5cb95392-config\") pod \"ovsdbserver-nb-0\" (UID: \"f8f48fe3-091f-40a2-b580-69ba5cb95392\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 15:54:55 crc kubenswrapper[5120]: I0316 15:54:55.930505 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/f8f48fe3-091f-40a2-b580-69ba5cb95392-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"f8f48fe3-091f-40a2-b580-69ba5cb95392\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 15:54:55 crc kubenswrapper[5120]: I0316 15:54:55.933357 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/f8f48fe3-091f-40a2-b580-69ba5cb95392-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"f8f48fe3-091f-40a2-b580-69ba5cb95392\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 15:54:55 crc kubenswrapper[5120]: I0316 15:54:55.933857 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f8f48fe3-091f-40a2-b580-69ba5cb95392-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"f8f48fe3-091f-40a2-b580-69ba5cb95392\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 15:54:55 crc kubenswrapper[5120]: I0316 15:54:55.950699 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage15-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage15-crc\") pod \"ovsdbserver-nb-0\" (UID: \"f8f48fe3-091f-40a2-b580-69ba5cb95392\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 15:54:55 crc kubenswrapper[5120]: I0316 15:54:55.952599 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvbcr\" (UniqueName: \"kubernetes.io/projected/f8f48fe3-091f-40a2-b580-69ba5cb95392-kube-api-access-jvbcr\") pod \"ovsdbserver-nb-0\" (UID: \"f8f48fe3-091f-40a2-b580-69ba5cb95392\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 15:54:56 crc kubenswrapper[5120]: I0316 15:54:56.036581 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 15:54:56 crc kubenswrapper[5120]: I0316 15:54:56.107987 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 15:54:56 crc kubenswrapper[5120]: I0316 15:54:56.108037 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 15:54:56 crc kubenswrapper[5120]: I0316 15:54:56.145068 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/memcached-0" Mar 16 15:54:56 crc kubenswrapper[5120]: I0316 15:54:56.242950 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"588c75bf-de6d-4608-8d63-85c81408a1e3","Type":"ContainerStarted","Data":"450ae56285ae1f86aa35df717a2b979a8b9de5972d74bdb6c7310c8a52c811a3"} Mar 16 15:54:56 crc kubenswrapper[5120]: I0316 15:54:56.337209 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 15:54:56 crc kubenswrapper[5120]: I0316 15:54:56.359946 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podStartSLOduration=2.359926544 podStartE2EDuration="2.359926544s" podCreationTimestamp="2026-03-16 15:54:54 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:54:56.278577921 +0000 UTC m=+1398.432509578" watchObservedRunningTime="2026-03-16 15:54:56.359926544 +0000 UTC m=+1398.513858201" Mar 16 15:54:56 crc kubenswrapper[5120]: I0316 15:54:56.420815 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 15:54:56 crc kubenswrapper[5120]: I0316 15:54:56.632998 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 15:54:57 crc kubenswrapper[5120]: I0316 15:54:57.256171 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"f8f48fe3-091f-40a2-b580-69ba5cb95392","Type":"ContainerStarted","Data":"2e8f7cc02c3d7a129f99450acb5b341f91067daefe4059c6c5ae46388f70b8b6"} Mar 16 15:54:57 crc kubenswrapper[5120]: I0316 15:54:57.256693 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"f8f48fe3-091f-40a2-b580-69ba5cb95392","Type":"ContainerStarted","Data":"dac788712cee13272c3b574a2a82410cb05db5c3ad287bdca48ecf5f046219a8"} Mar 16 15:54:57 crc kubenswrapper[5120]: I0316 15:54:57.256709 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"f8f48fe3-091f-40a2-b580-69ba5cb95392","Type":"ContainerStarted","Data":"b393ede14b94fc02893f2851955346984ca60c47a2f0e0264859b3fd615787d4"} Mar 16 15:54:57 crc kubenswrapper[5120]: I0316 15:54:57.283374 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podStartSLOduration=2.28335607 podStartE2EDuration="2.28335607s" podCreationTimestamp="2026-03-16 15:54:55 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:54:57.276598604 +0000 UTC m=+1399.430530261" watchObservedRunningTime="2026-03-16 15:54:57.28335607 +0000 UTC m=+1399.437287727" Mar 16 15:54:57 crc kubenswrapper[5120]: I0316 15:54:57.353810 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 15:54:57 crc kubenswrapper[5120]: I0316 15:54:57.528171 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 15:54:57 crc kubenswrapper[5120]: I0316 15:54:57.528744 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 15:54:57 crc kubenswrapper[5120]: I0316 15:54:57.607625 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 15:54:58 crc kubenswrapper[5120]: I0316 15:54:58.375400 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 15:54:59 crc kubenswrapper[5120]: I0316 15:54:59.037141 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 15:54:59 crc kubenswrapper[5120]: I0316 15:54:59.102367 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 15:54:59 crc kubenswrapper[5120]: I0316 15:54:59.278643 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 15:54:59 crc kubenswrapper[5120]: I0316 15:54:59.353242 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 15:54:59 crc kubenswrapper[5120]: I0316 15:54:59.800044 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-db-create-g9hbz"] Mar 16 15:54:59 crc kubenswrapper[5120]: I0316 15:54:59.809381 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-create-g9hbz" Mar 16 15:54:59 crc kubenswrapper[5120]: I0316 15:54:59.818639 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-db-create-g9hbz"] Mar 16 15:54:59 crc kubenswrapper[5120]: I0316 15:54:59.902243 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/bd599640-4bc1-46b5-9cbb-9b57e959c4e9-operator-scripts\") pod \"keystone-db-create-g9hbz\" (UID: \"bd599640-4bc1-46b5-9cbb-9b57e959c4e9\") " pod="openstack-kuttl-tests/keystone-db-create-g9hbz" Mar 16 15:54:59 crc kubenswrapper[5120]: I0316 15:54:59.902450 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hxmx\" (UniqueName: \"kubernetes.io/projected/bd599640-4bc1-46b5-9cbb-9b57e959c4e9-kube-api-access-8hxmx\") pod \"keystone-db-create-g9hbz\" (UID: \"bd599640-4bc1-46b5-9cbb-9b57e959c4e9\") " pod="openstack-kuttl-tests/keystone-db-create-g9hbz" Mar 16 15:54:59 crc kubenswrapper[5120]: I0316 15:54:59.930299 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-7ef1-account-create-update-lv85w"] Mar 16 15:54:59 crc kubenswrapper[5120]: I0316 15:54:59.937395 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-7ef1-account-create-update-lv85w" Mar 16 15:54:59 crc kubenswrapper[5120]: I0316 15:54:59.939796 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-db-secret\"" Mar 16 15:54:59 crc kubenswrapper[5120]: I0316 15:54:59.955369 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-7ef1-account-create-update-lv85w"] Mar 16 15:55:00 crc kubenswrapper[5120]: I0316 15:55:00.006716 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/fdfe4db3-e823-45f2-85d8-4adc47ff19f9-operator-scripts\") pod \"keystone-7ef1-account-create-update-lv85w\" (UID: \"fdfe4db3-e823-45f2-85d8-4adc47ff19f9\") " pod="openstack-kuttl-tests/keystone-7ef1-account-create-update-lv85w" Mar 16 15:55:00 crc kubenswrapper[5120]: I0316 15:55:00.007002 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/bd599640-4bc1-46b5-9cbb-9b57e959c4e9-operator-scripts\") pod \"keystone-db-create-g9hbz\" (UID: \"bd599640-4bc1-46b5-9cbb-9b57e959c4e9\") " pod="openstack-kuttl-tests/keystone-db-create-g9hbz" Mar 16 15:55:00 crc kubenswrapper[5120]: I0316 15:55:00.007135 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffdk8\" (UniqueName: \"kubernetes.io/projected/fdfe4db3-e823-45f2-85d8-4adc47ff19f9-kube-api-access-ffdk8\") pod \"keystone-7ef1-account-create-update-lv85w\" (UID: \"fdfe4db3-e823-45f2-85d8-4adc47ff19f9\") " pod="openstack-kuttl-tests/keystone-7ef1-account-create-update-lv85w" Mar 16 15:55:00 crc kubenswrapper[5120]: I0316 15:55:00.007220 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8hxmx\" (UniqueName: \"kubernetes.io/projected/bd599640-4bc1-46b5-9cbb-9b57e959c4e9-kube-api-access-8hxmx\") pod \"keystone-db-create-g9hbz\" (UID: \"bd599640-4bc1-46b5-9cbb-9b57e959c4e9\") " pod="openstack-kuttl-tests/keystone-db-create-g9hbz" Mar 16 15:55:00 crc kubenswrapper[5120]: I0316 15:55:00.008261 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/bd599640-4bc1-46b5-9cbb-9b57e959c4e9-operator-scripts\") pod \"keystone-db-create-g9hbz\" (UID: \"bd599640-4bc1-46b5-9cbb-9b57e959c4e9\") " pod="openstack-kuttl-tests/keystone-db-create-g9hbz" Mar 16 15:55:00 crc kubenswrapper[5120]: I0316 15:55:00.021402 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-db-create-wkkpd"] Mar 16 15:55:00 crc kubenswrapper[5120]: I0316 15:55:00.026739 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-create-wkkpd" Mar 16 15:55:00 crc kubenswrapper[5120]: I0316 15:55:00.031048 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-db-create-wkkpd"] Mar 16 15:55:00 crc kubenswrapper[5120]: I0316 15:55:00.040589 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hxmx\" (UniqueName: \"kubernetes.io/projected/bd599640-4bc1-46b5-9cbb-9b57e959c4e9-kube-api-access-8hxmx\") pod \"keystone-db-create-g9hbz\" (UID: \"bd599640-4bc1-46b5-9cbb-9b57e959c4e9\") " pod="openstack-kuttl-tests/keystone-db-create-g9hbz" Mar 16 15:55:00 crc kubenswrapper[5120]: I0316 15:55:00.108667 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ffdk8\" (UniqueName: \"kubernetes.io/projected/fdfe4db3-e823-45f2-85d8-4adc47ff19f9-kube-api-access-ffdk8\") pod \"keystone-7ef1-account-create-update-lv85w\" (UID: \"fdfe4db3-e823-45f2-85d8-4adc47ff19f9\") " pod="openstack-kuttl-tests/keystone-7ef1-account-create-update-lv85w" Mar 16 15:55:00 crc kubenswrapper[5120]: I0316 15:55:00.108787 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e3d90a02-e510-46ee-b65f-1ac0c36060ce-operator-scripts\") pod \"placement-db-create-wkkpd\" (UID: \"e3d90a02-e510-46ee-b65f-1ac0c36060ce\") " pod="openstack-kuttl-tests/placement-db-create-wkkpd" Mar 16 15:55:00 crc kubenswrapper[5120]: I0316 15:55:00.108891 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmmlj\" (UniqueName: \"kubernetes.io/projected/e3d90a02-e510-46ee-b65f-1ac0c36060ce-kube-api-access-jmmlj\") pod \"placement-db-create-wkkpd\" (UID: \"e3d90a02-e510-46ee-b65f-1ac0c36060ce\") " pod="openstack-kuttl-tests/placement-db-create-wkkpd" Mar 16 15:55:00 crc kubenswrapper[5120]: I0316 15:55:00.109047 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/fdfe4db3-e823-45f2-85d8-4adc47ff19f9-operator-scripts\") pod \"keystone-7ef1-account-create-update-lv85w\" (UID: \"fdfe4db3-e823-45f2-85d8-4adc47ff19f9\") " pod="openstack-kuttl-tests/keystone-7ef1-account-create-update-lv85w" Mar 16 15:55:00 crc kubenswrapper[5120]: I0316 15:55:00.109843 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/fdfe4db3-e823-45f2-85d8-4adc47ff19f9-operator-scripts\") pod \"keystone-7ef1-account-create-update-lv85w\" (UID: \"fdfe4db3-e823-45f2-85d8-4adc47ff19f9\") " pod="openstack-kuttl-tests/keystone-7ef1-account-create-update-lv85w" Mar 16 15:55:00 crc kubenswrapper[5120]: I0316 15:55:00.131969 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-create-g9hbz" Mar 16 15:55:00 crc kubenswrapper[5120]: I0316 15:55:00.132565 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffdk8\" (UniqueName: \"kubernetes.io/projected/fdfe4db3-e823-45f2-85d8-4adc47ff19f9-kube-api-access-ffdk8\") pod \"keystone-7ef1-account-create-update-lv85w\" (UID: \"fdfe4db3-e823-45f2-85d8-4adc47ff19f9\") " pod="openstack-kuttl-tests/keystone-7ef1-account-create-update-lv85w" Mar 16 15:55:00 crc kubenswrapper[5120]: I0316 15:55:00.140807 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-79ea-account-create-update-qpvh9"] Mar 16 15:55:00 crc kubenswrapper[5120]: I0316 15:55:00.150579 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-79ea-account-create-update-qpvh9" Mar 16 15:55:00 crc kubenswrapper[5120]: I0316 15:55:00.152959 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-db-secret\"" Mar 16 15:55:00 crc kubenswrapper[5120]: I0316 15:55:00.160237 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-79ea-account-create-update-qpvh9"] Mar 16 15:55:00 crc kubenswrapper[5120]: I0316 15:55:00.210040 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b6bb3fb4-89a4-4651-94cb-aed285af6acb-operator-scripts\") pod \"placement-79ea-account-create-update-qpvh9\" (UID: \"b6bb3fb4-89a4-4651-94cb-aed285af6acb\") " pod="openstack-kuttl-tests/placement-79ea-account-create-update-qpvh9" Mar 16 15:55:00 crc kubenswrapper[5120]: I0316 15:55:00.210324 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66h8p\" (UniqueName: \"kubernetes.io/projected/b6bb3fb4-89a4-4651-94cb-aed285af6acb-kube-api-access-66h8p\") pod \"placement-79ea-account-create-update-qpvh9\" (UID: \"b6bb3fb4-89a4-4651-94cb-aed285af6acb\") " pod="openstack-kuttl-tests/placement-79ea-account-create-update-qpvh9" Mar 16 15:55:00 crc kubenswrapper[5120]: I0316 15:55:00.210439 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e3d90a02-e510-46ee-b65f-1ac0c36060ce-operator-scripts\") pod \"placement-db-create-wkkpd\" (UID: \"e3d90a02-e510-46ee-b65f-1ac0c36060ce\") " pod="openstack-kuttl-tests/placement-db-create-wkkpd" Mar 16 15:55:00 crc kubenswrapper[5120]: I0316 15:55:00.210493 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jmmlj\" (UniqueName: \"kubernetes.io/projected/e3d90a02-e510-46ee-b65f-1ac0c36060ce-kube-api-access-jmmlj\") pod \"placement-db-create-wkkpd\" (UID: \"e3d90a02-e510-46ee-b65f-1ac0c36060ce\") " pod="openstack-kuttl-tests/placement-db-create-wkkpd" Mar 16 15:55:00 crc kubenswrapper[5120]: I0316 15:55:00.211363 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e3d90a02-e510-46ee-b65f-1ac0c36060ce-operator-scripts\") pod \"placement-db-create-wkkpd\" (UID: \"e3d90a02-e510-46ee-b65f-1ac0c36060ce\") " pod="openstack-kuttl-tests/placement-db-create-wkkpd" Mar 16 15:55:00 crc kubenswrapper[5120]: I0316 15:55:00.232568 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmmlj\" (UniqueName: \"kubernetes.io/projected/e3d90a02-e510-46ee-b65f-1ac0c36060ce-kube-api-access-jmmlj\") pod \"placement-db-create-wkkpd\" (UID: \"e3d90a02-e510-46ee-b65f-1ac0c36060ce\") " pod="openstack-kuttl-tests/placement-db-create-wkkpd" Mar 16 15:55:00 crc kubenswrapper[5120]: I0316 15:55:00.265510 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-7ef1-account-create-update-lv85w" Mar 16 15:55:00 crc kubenswrapper[5120]: I0316 15:55:00.311942 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b6bb3fb4-89a4-4651-94cb-aed285af6acb-operator-scripts\") pod \"placement-79ea-account-create-update-qpvh9\" (UID: \"b6bb3fb4-89a4-4651-94cb-aed285af6acb\") " pod="openstack-kuttl-tests/placement-79ea-account-create-update-qpvh9" Mar 16 15:55:00 crc kubenswrapper[5120]: I0316 15:55:00.312012 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-66h8p\" (UniqueName: \"kubernetes.io/projected/b6bb3fb4-89a4-4651-94cb-aed285af6acb-kube-api-access-66h8p\") pod \"placement-79ea-account-create-update-qpvh9\" (UID: \"b6bb3fb4-89a4-4651-94cb-aed285af6acb\") " pod="openstack-kuttl-tests/placement-79ea-account-create-update-qpvh9" Mar 16 15:55:00 crc kubenswrapper[5120]: I0316 15:55:00.313726 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b6bb3fb4-89a4-4651-94cb-aed285af6acb-operator-scripts\") pod \"placement-79ea-account-create-update-qpvh9\" (UID: \"b6bb3fb4-89a4-4651-94cb-aed285af6acb\") " pod="openstack-kuttl-tests/placement-79ea-account-create-update-qpvh9" Mar 16 15:55:00 crc kubenswrapper[5120]: I0316 15:55:00.329702 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-66h8p\" (UniqueName: \"kubernetes.io/projected/b6bb3fb4-89a4-4651-94cb-aed285af6acb-kube-api-access-66h8p\") pod \"placement-79ea-account-create-update-qpvh9\" (UID: \"b6bb3fb4-89a4-4651-94cb-aed285af6acb\") " pod="openstack-kuttl-tests/placement-79ea-account-create-update-qpvh9" Mar 16 15:55:00 crc kubenswrapper[5120]: I0316 15:55:00.386984 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-create-wkkpd" Mar 16 15:55:00 crc kubenswrapper[5120]: I0316 15:55:00.393027 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 15:55:00 crc kubenswrapper[5120]: I0316 15:55:00.434825 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 15:55:00 crc kubenswrapper[5120]: I0316 15:55:00.514461 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-79ea-account-create-update-qpvh9" Mar 16 15:55:00 crc kubenswrapper[5120]: I0316 15:55:00.577536 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-db-create-g9hbz"] Mar 16 15:55:00 crc kubenswrapper[5120]: I0316 15:55:00.693280 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-7ef1-account-create-update-lv85w"] Mar 16 15:55:00 crc kubenswrapper[5120]: I0316 15:55:00.837803 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-db-create-wkkpd"] Mar 16 15:55:00 crc kubenswrapper[5120]: W0316 15:55:00.848203 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode3d90a02_e510_46ee_b65f_1ac0c36060ce.slice/crio-071a54d799c90d97622a261550250a92716a6b23e251169258a4daff8c35cbbd WatchSource:0}: Error finding container 071a54d799c90d97622a261550250a92716a6b23e251169258a4daff8c35cbbd: Status 404 returned error can't find the container with id 071a54d799c90d97622a261550250a92716a6b23e251169258a4daff8c35cbbd Mar 16 15:55:00 crc kubenswrapper[5120]: I0316 15:55:00.961358 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-79ea-account-create-update-qpvh9"] Mar 16 15:55:01 crc kubenswrapper[5120]: I0316 15:55:01.003130 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 15:55:01 crc kubenswrapper[5120]: I0316 15:55:01.020598 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Mar 16 15:55:01 crc kubenswrapper[5120]: I0316 15:55:01.030773 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"swift-storage-config-data\"" Mar 16 15:55:01 crc kubenswrapper[5120]: I0316 15:55:01.030782 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"swift-ring-files\"" Mar 16 15:55:01 crc kubenswrapper[5120]: I0316 15:55:01.030986 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"swift-conf\"" Mar 16 15:55:01 crc kubenswrapper[5120]: I0316 15:55:01.031406 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"swift-swift-dockercfg-7jqzz\"" Mar 16 15:55:01 crc kubenswrapper[5120]: I0316 15:55:01.054816 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 15:55:01 crc kubenswrapper[5120]: I0316 15:55:01.104236 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-4zt99"] Mar 16 15:55:01 crc kubenswrapper[5120]: I0316 15:55:01.132795 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-4zt99"] Mar 16 15:55:01 crc kubenswrapper[5120]: I0316 15:55:01.132947 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-4zt99" Mar 16 15:55:01 crc kubenswrapper[5120]: I0316 15:55:01.136061 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"swift-proxy-config-data\"" Mar 16 15:55:01 crc kubenswrapper[5120]: I0316 15:55:01.137439 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"swift-ring-config-data\"" Mar 16 15:55:01 crc kubenswrapper[5120]: I0316 15:55:01.137803 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"swift-ring-scripts\"" Mar 16 15:55:01 crc kubenswrapper[5120]: I0316 15:55:01.177826 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/725b915c-7c39-43e6-8022-99dd14a6276e-combined-ca-bundle\") pod \"swift-storage-0\" (UID: \"725b915c-7c39-43e6-8022-99dd14a6276e\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 15:55:01 crc kubenswrapper[5120]: I0316 15:55:01.177875 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/725b915c-7c39-43e6-8022-99dd14a6276e-lock\") pod \"swift-storage-0\" (UID: \"725b915c-7c39-43e6-8022-99dd14a6276e\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 15:55:01 crc kubenswrapper[5120]: I0316 15:55:01.177906 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/725b915c-7c39-43e6-8022-99dd14a6276e-cache\") pod \"swift-storage-0\" (UID: \"725b915c-7c39-43e6-8022-99dd14a6276e\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 15:55:01 crc kubenswrapper[5120]: I0316 15:55:01.177932 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lb8mj\" (UniqueName: \"kubernetes.io/projected/725b915c-7c39-43e6-8022-99dd14a6276e-kube-api-access-lb8mj\") pod \"swift-storage-0\" (UID: \"725b915c-7c39-43e6-8022-99dd14a6276e\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 15:55:01 crc kubenswrapper[5120]: I0316 15:55:01.177986 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage07-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") pod \"swift-storage-0\" (UID: \"725b915c-7c39-43e6-8022-99dd14a6276e\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 15:55:01 crc kubenswrapper[5120]: I0316 15:55:01.178006 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/725b915c-7c39-43e6-8022-99dd14a6276e-etc-swift\") pod \"swift-storage-0\" (UID: \"725b915c-7c39-43e6-8022-99dd14a6276e\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 15:55:01 crc kubenswrapper[5120]: I0316 15:55:01.279813 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/ba54f8ef-0972-4ee4-b3e8-d33636032701-swiftconf\") pod \"swift-ring-rebalance-4zt99\" (UID: \"ba54f8ef-0972-4ee4-b3e8-d33636032701\") " pod="openstack-kuttl-tests/swift-ring-rebalance-4zt99" Mar 16 15:55:01 crc kubenswrapper[5120]: I0316 15:55:01.279859 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/ba54f8ef-0972-4ee4-b3e8-d33636032701-scripts\") pod \"swift-ring-rebalance-4zt99\" (UID: \"ba54f8ef-0972-4ee4-b3e8-d33636032701\") " pod="openstack-kuttl-tests/swift-ring-rebalance-4zt99" Mar 16 15:55:01 crc kubenswrapper[5120]: I0316 15:55:01.279923 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/725b915c-7c39-43e6-8022-99dd14a6276e-combined-ca-bundle\") pod \"swift-storage-0\" (UID: \"725b915c-7c39-43e6-8022-99dd14a6276e\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 15:55:01 crc kubenswrapper[5120]: I0316 15:55:01.279947 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/725b915c-7c39-43e6-8022-99dd14a6276e-lock\") pod \"swift-storage-0\" (UID: \"725b915c-7c39-43e6-8022-99dd14a6276e\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 15:55:01 crc kubenswrapper[5120]: I0316 15:55:01.279981 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ba54f8ef-0972-4ee4-b3e8-d33636032701-combined-ca-bundle\") pod \"swift-ring-rebalance-4zt99\" (UID: \"ba54f8ef-0972-4ee4-b3e8-d33636032701\") " pod="openstack-kuttl-tests/swift-ring-rebalance-4zt99" Mar 16 15:55:01 crc kubenswrapper[5120]: I0316 15:55:01.279999 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/ba54f8ef-0972-4ee4-b3e8-d33636032701-etc-swift\") pod \"swift-ring-rebalance-4zt99\" (UID: \"ba54f8ef-0972-4ee4-b3e8-d33636032701\") " pod="openstack-kuttl-tests/swift-ring-rebalance-4zt99" Mar 16 15:55:01 crc kubenswrapper[5120]: I0316 15:55:01.280015 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/725b915c-7c39-43e6-8022-99dd14a6276e-cache\") pod \"swift-storage-0\" (UID: \"725b915c-7c39-43e6-8022-99dd14a6276e\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 15:55:01 crc kubenswrapper[5120]: I0316 15:55:01.280042 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jl8mz\" (UniqueName: \"kubernetes.io/projected/ba54f8ef-0972-4ee4-b3e8-d33636032701-kube-api-access-jl8mz\") pod \"swift-ring-rebalance-4zt99\" (UID: \"ba54f8ef-0972-4ee4-b3e8-d33636032701\") " pod="openstack-kuttl-tests/swift-ring-rebalance-4zt99" Mar 16 15:55:01 crc kubenswrapper[5120]: I0316 15:55:01.280057 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lb8mj\" (UniqueName: \"kubernetes.io/projected/725b915c-7c39-43e6-8022-99dd14a6276e-kube-api-access-lb8mj\") pod \"swift-storage-0\" (UID: \"725b915c-7c39-43e6-8022-99dd14a6276e\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 15:55:01 crc kubenswrapper[5120]: I0316 15:55:01.280087 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/ba54f8ef-0972-4ee4-b3e8-d33636032701-ring-data-devices\") pod \"swift-ring-rebalance-4zt99\" (UID: \"ba54f8ef-0972-4ee4-b3e8-d33636032701\") " pod="openstack-kuttl-tests/swift-ring-rebalance-4zt99" Mar 16 15:55:01 crc kubenswrapper[5120]: I0316 15:55:01.280129 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/ba54f8ef-0972-4ee4-b3e8-d33636032701-dispersionconf\") pod \"swift-ring-rebalance-4zt99\" (UID: \"ba54f8ef-0972-4ee4-b3e8-d33636032701\") " pod="openstack-kuttl-tests/swift-ring-rebalance-4zt99" Mar 16 15:55:01 crc kubenswrapper[5120]: I0316 15:55:01.280153 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage07-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") pod \"swift-storage-0\" (UID: \"725b915c-7c39-43e6-8022-99dd14a6276e\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 15:55:01 crc kubenswrapper[5120]: I0316 15:55:01.280176 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/725b915c-7c39-43e6-8022-99dd14a6276e-etc-swift\") pod \"swift-storage-0\" (UID: \"725b915c-7c39-43e6-8022-99dd14a6276e\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 15:55:01 crc kubenswrapper[5120]: E0316 15:55:01.280321 5120 projected.go:289] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Mar 16 15:55:01 crc kubenswrapper[5120]: E0316 15:55:01.280333 5120 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Mar 16 15:55:01 crc kubenswrapper[5120]: E0316 15:55:01.280382 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/725b915c-7c39-43e6-8022-99dd14a6276e-etc-swift podName:725b915c-7c39-43e6-8022-99dd14a6276e nodeName:}" failed. No retries permitted until 2026-03-16 15:55:01.780365657 +0000 UTC m=+1403.934297314 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/725b915c-7c39-43e6-8022-99dd14a6276e-etc-swift") pod "swift-storage-0" (UID: "725b915c-7c39-43e6-8022-99dd14a6276e") : configmap "swift-ring-files" not found Mar 16 15:55:01 crc kubenswrapper[5120]: I0316 15:55:01.281982 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage07-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") pod \"swift-storage-0\" (UID: \"725b915c-7c39-43e6-8022-99dd14a6276e\") device mount path \"/mnt/openstack/pv07\"" pod="openstack-kuttl-tests/swift-storage-0" Mar 16 15:55:01 crc kubenswrapper[5120]: I0316 15:55:01.281989 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/725b915c-7c39-43e6-8022-99dd14a6276e-lock\") pod \"swift-storage-0\" (UID: \"725b915c-7c39-43e6-8022-99dd14a6276e\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 15:55:01 crc kubenswrapper[5120]: I0316 15:55:01.282149 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/725b915c-7c39-43e6-8022-99dd14a6276e-cache\") pod \"swift-storage-0\" (UID: \"725b915c-7c39-43e6-8022-99dd14a6276e\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 15:55:01 crc kubenswrapper[5120]: I0316 15:55:01.314809 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/725b915c-7c39-43e6-8022-99dd14a6276e-combined-ca-bundle\") pod \"swift-storage-0\" (UID: \"725b915c-7c39-43e6-8022-99dd14a6276e\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 15:55:01 crc kubenswrapper[5120]: I0316 15:55:01.315994 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lb8mj\" (UniqueName: \"kubernetes.io/projected/725b915c-7c39-43e6-8022-99dd14a6276e-kube-api-access-lb8mj\") pod \"swift-storage-0\" (UID: \"725b915c-7c39-43e6-8022-99dd14a6276e\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 15:55:01 crc kubenswrapper[5120]: I0316 15:55:01.328894 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage07-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") pod \"swift-storage-0\" (UID: \"725b915c-7c39-43e6-8022-99dd14a6276e\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 15:55:01 crc kubenswrapper[5120]: I0316 15:55:01.385335 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/ba54f8ef-0972-4ee4-b3e8-d33636032701-ring-data-devices\") pod \"swift-ring-rebalance-4zt99\" (UID: \"ba54f8ef-0972-4ee4-b3e8-d33636032701\") " pod="openstack-kuttl-tests/swift-ring-rebalance-4zt99" Mar 16 15:55:01 crc kubenswrapper[5120]: I0316 15:55:01.385401 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/ba54f8ef-0972-4ee4-b3e8-d33636032701-dispersionconf\") pod \"swift-ring-rebalance-4zt99\" (UID: \"ba54f8ef-0972-4ee4-b3e8-d33636032701\") " pod="openstack-kuttl-tests/swift-ring-rebalance-4zt99" Mar 16 15:55:01 crc kubenswrapper[5120]: I0316 15:55:01.385466 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/ba54f8ef-0972-4ee4-b3e8-d33636032701-swiftconf\") pod \"swift-ring-rebalance-4zt99\" (UID: \"ba54f8ef-0972-4ee4-b3e8-d33636032701\") " pod="openstack-kuttl-tests/swift-ring-rebalance-4zt99" Mar 16 15:55:01 crc kubenswrapper[5120]: I0316 15:55:01.385487 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/ba54f8ef-0972-4ee4-b3e8-d33636032701-scripts\") pod \"swift-ring-rebalance-4zt99\" (UID: \"ba54f8ef-0972-4ee4-b3e8-d33636032701\") " pod="openstack-kuttl-tests/swift-ring-rebalance-4zt99" Mar 16 15:55:01 crc kubenswrapper[5120]: I0316 15:55:01.385565 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ba54f8ef-0972-4ee4-b3e8-d33636032701-combined-ca-bundle\") pod \"swift-ring-rebalance-4zt99\" (UID: \"ba54f8ef-0972-4ee4-b3e8-d33636032701\") " pod="openstack-kuttl-tests/swift-ring-rebalance-4zt99" Mar 16 15:55:01 crc kubenswrapper[5120]: I0316 15:55:01.385582 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/ba54f8ef-0972-4ee4-b3e8-d33636032701-etc-swift\") pod \"swift-ring-rebalance-4zt99\" (UID: \"ba54f8ef-0972-4ee4-b3e8-d33636032701\") " pod="openstack-kuttl-tests/swift-ring-rebalance-4zt99" Mar 16 15:55:01 crc kubenswrapper[5120]: I0316 15:55:01.385609 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jl8mz\" (UniqueName: \"kubernetes.io/projected/ba54f8ef-0972-4ee4-b3e8-d33636032701-kube-api-access-jl8mz\") pod \"swift-ring-rebalance-4zt99\" (UID: \"ba54f8ef-0972-4ee4-b3e8-d33636032701\") " pod="openstack-kuttl-tests/swift-ring-rebalance-4zt99" Mar 16 15:55:01 crc kubenswrapper[5120]: I0316 15:55:01.386641 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/ba54f8ef-0972-4ee4-b3e8-d33636032701-scripts\") pod \"swift-ring-rebalance-4zt99\" (UID: \"ba54f8ef-0972-4ee4-b3e8-d33636032701\") " pod="openstack-kuttl-tests/swift-ring-rebalance-4zt99" Mar 16 15:55:01 crc kubenswrapper[5120]: I0316 15:55:01.387396 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/ba54f8ef-0972-4ee4-b3e8-d33636032701-ring-data-devices\") pod \"swift-ring-rebalance-4zt99\" (UID: \"ba54f8ef-0972-4ee4-b3e8-d33636032701\") " pod="openstack-kuttl-tests/swift-ring-rebalance-4zt99" Mar 16 15:55:01 crc kubenswrapper[5120]: I0316 15:55:01.387857 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/ba54f8ef-0972-4ee4-b3e8-d33636032701-etc-swift\") pod \"swift-ring-rebalance-4zt99\" (UID: \"ba54f8ef-0972-4ee4-b3e8-d33636032701\") " pod="openstack-kuttl-tests/swift-ring-rebalance-4zt99" Mar 16 15:55:01 crc kubenswrapper[5120]: I0316 15:55:01.394402 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ba54f8ef-0972-4ee4-b3e8-d33636032701-combined-ca-bundle\") pod \"swift-ring-rebalance-4zt99\" (UID: \"ba54f8ef-0972-4ee4-b3e8-d33636032701\") " pod="openstack-kuttl-tests/swift-ring-rebalance-4zt99" Mar 16 15:55:01 crc kubenswrapper[5120]: I0316 15:55:01.395137 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/ba54f8ef-0972-4ee4-b3e8-d33636032701-dispersionconf\") pod \"swift-ring-rebalance-4zt99\" (UID: \"ba54f8ef-0972-4ee4-b3e8-d33636032701\") " pod="openstack-kuttl-tests/swift-ring-rebalance-4zt99" Mar 16 15:55:01 crc kubenswrapper[5120]: I0316 15:55:01.397620 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/ba54f8ef-0972-4ee4-b3e8-d33636032701-swiftconf\") pod \"swift-ring-rebalance-4zt99\" (UID: \"ba54f8ef-0972-4ee4-b3e8-d33636032701\") " pod="openstack-kuttl-tests/swift-ring-rebalance-4zt99" Mar 16 15:55:01 crc kubenswrapper[5120]: I0316 15:55:01.404027 5120 generic.go:358] "Generic (PLEG): container finished" podID="bd599640-4bc1-46b5-9cbb-9b57e959c4e9" containerID="66eba927cd30e037dd7a7abcb37be936bc003239534927b6193e4055329f407e" exitCode=0 Mar 16 15:55:01 crc kubenswrapper[5120]: I0316 15:55:01.404264 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-create-g9hbz" event={"ID":"bd599640-4bc1-46b5-9cbb-9b57e959c4e9","Type":"ContainerDied","Data":"66eba927cd30e037dd7a7abcb37be936bc003239534927b6193e4055329f407e"} Mar 16 15:55:01 crc kubenswrapper[5120]: I0316 15:55:01.404295 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-create-g9hbz" event={"ID":"bd599640-4bc1-46b5-9cbb-9b57e959c4e9","Type":"ContainerStarted","Data":"632103d580e378dee94a7b0ee35d31205190969a4d0557043f96a7f8c210e182"} Mar 16 15:55:01 crc kubenswrapper[5120]: I0316 15:55:01.408203 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jl8mz\" (UniqueName: \"kubernetes.io/projected/ba54f8ef-0972-4ee4-b3e8-d33636032701-kube-api-access-jl8mz\") pod \"swift-ring-rebalance-4zt99\" (UID: \"ba54f8ef-0972-4ee4-b3e8-d33636032701\") " pod="openstack-kuttl-tests/swift-ring-rebalance-4zt99" Mar 16 15:55:01 crc kubenswrapper[5120]: I0316 15:55:01.414474 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-79ea-account-create-update-qpvh9" event={"ID":"b6bb3fb4-89a4-4651-94cb-aed285af6acb","Type":"ContainerStarted","Data":"a821840e7e08d7ff4ec0f7bddffb8291c36531af5c447ea1967f26ed5f58a209"} Mar 16 15:55:01 crc kubenswrapper[5120]: I0316 15:55:01.422968 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-7ef1-account-create-update-lv85w" event={"ID":"fdfe4db3-e823-45f2-85d8-4adc47ff19f9","Type":"ContainerStarted","Data":"3026ec7ccdb6e6811a15f6715c0a43c75f13ab0bdbd3560dd6ede95efc448c54"} Mar 16 15:55:01 crc kubenswrapper[5120]: I0316 15:55:01.423008 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-7ef1-account-create-update-lv85w" event={"ID":"fdfe4db3-e823-45f2-85d8-4adc47ff19f9","Type":"ContainerStarted","Data":"79cd01aa1baf4a478e030bca7e81541b8b53d40416dcbbdf382a145b9e5e2690"} Mar 16 15:55:01 crc kubenswrapper[5120]: I0316 15:55:01.427038 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-create-wkkpd" event={"ID":"e3d90a02-e510-46ee-b65f-1ac0c36060ce","Type":"ContainerStarted","Data":"21c2cf04a8ade18c800c248f1d46a2a5cf0ae2792ece1e03e9690c6bde3fdd31"} Mar 16 15:55:01 crc kubenswrapper[5120]: I0316 15:55:01.427167 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-create-wkkpd" event={"ID":"e3d90a02-e510-46ee-b65f-1ac0c36060ce","Type":"ContainerStarted","Data":"071a54d799c90d97622a261550250a92716a6b23e251169258a4daff8c35cbbd"} Mar 16 15:55:01 crc kubenswrapper[5120]: I0316 15:55:01.449665 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-79ea-account-create-update-qpvh9" podStartSLOduration=1.449643836 podStartE2EDuration="1.449643836s" podCreationTimestamp="2026-03-16 15:55:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:55:01.438852517 +0000 UTC m=+1403.592784174" watchObservedRunningTime="2026-03-16 15:55:01.449643836 +0000 UTC m=+1403.603575493" Mar 16 15:55:01 crc kubenswrapper[5120]: I0316 15:55:01.466870 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-db-create-wkkpd" podStartSLOduration=1.466854393 podStartE2EDuration="1.466854393s" podCreationTimestamp="2026-03-16 15:55:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:55:01.463644844 +0000 UTC m=+1403.617576501" watchObservedRunningTime="2026-03-16 15:55:01.466854393 +0000 UTC m=+1403.620786040" Mar 16 15:55:01 crc kubenswrapper[5120]: I0316 15:55:01.482266 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-7ef1-account-create-update-lv85w" podStartSLOduration=2.482245809 podStartE2EDuration="2.482245809s" podCreationTimestamp="2026-03-16 15:54:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:55:01.474493965 +0000 UTC m=+1403.628425622" watchObservedRunningTime="2026-03-16 15:55:01.482245809 +0000 UTC m=+1403.636177466" Mar 16 15:55:01 crc kubenswrapper[5120]: I0316 15:55:01.536036 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-4zt99" Mar 16 15:55:01 crc kubenswrapper[5120]: I0316 15:55:01.792888 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/725b915c-7c39-43e6-8022-99dd14a6276e-etc-swift\") pod \"swift-storage-0\" (UID: \"725b915c-7c39-43e6-8022-99dd14a6276e\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 15:55:01 crc kubenswrapper[5120]: E0316 15:55:01.793122 5120 projected.go:289] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Mar 16 15:55:01 crc kubenswrapper[5120]: E0316 15:55:01.793482 5120 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Mar 16 15:55:01 crc kubenswrapper[5120]: E0316 15:55:01.793549 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/725b915c-7c39-43e6-8022-99dd14a6276e-etc-swift podName:725b915c-7c39-43e6-8022-99dd14a6276e nodeName:}" failed. No retries permitted until 2026-03-16 15:55:02.793533711 +0000 UTC m=+1404.947465368 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/725b915c-7c39-43e6-8022-99dd14a6276e-etc-swift") pod "swift-storage-0" (UID: "725b915c-7c39-43e6-8022-99dd14a6276e") : configmap "swift-ring-files" not found Mar 16 15:55:02 crc kubenswrapper[5120]: I0316 15:55:02.027698 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-4zt99"] Mar 16 15:55:02 crc kubenswrapper[5120]: I0316 15:55:02.439531 5120 generic.go:358] "Generic (PLEG): container finished" podID="fdfe4db3-e823-45f2-85d8-4adc47ff19f9" containerID="3026ec7ccdb6e6811a15f6715c0a43c75f13ab0bdbd3560dd6ede95efc448c54" exitCode=0 Mar 16 15:55:02 crc kubenswrapper[5120]: I0316 15:55:02.439600 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-7ef1-account-create-update-lv85w" event={"ID":"fdfe4db3-e823-45f2-85d8-4adc47ff19f9","Type":"ContainerDied","Data":"3026ec7ccdb6e6811a15f6715c0a43c75f13ab0bdbd3560dd6ede95efc448c54"} Mar 16 15:55:02 crc kubenswrapper[5120]: I0316 15:55:02.453728 5120 generic.go:358] "Generic (PLEG): container finished" podID="e3d90a02-e510-46ee-b65f-1ac0c36060ce" containerID="21c2cf04a8ade18c800c248f1d46a2a5cf0ae2792ece1e03e9690c6bde3fdd31" exitCode=0 Mar 16 15:55:02 crc kubenswrapper[5120]: I0316 15:55:02.454372 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-create-wkkpd" event={"ID":"e3d90a02-e510-46ee-b65f-1ac0c36060ce","Type":"ContainerDied","Data":"21c2cf04a8ade18c800c248f1d46a2a5cf0ae2792ece1e03e9690c6bde3fdd31"} Mar 16 15:55:02 crc kubenswrapper[5120]: I0316 15:55:02.465278 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-4zt99" event={"ID":"ba54f8ef-0972-4ee4-b3e8-d33636032701","Type":"ContainerStarted","Data":"9a9f520f86e7e6a2f9039e33c7f82866cb9a32ef43b7327f940081c0c0ee97f2"} Mar 16 15:55:02 crc kubenswrapper[5120]: I0316 15:55:02.465343 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-4zt99" event={"ID":"ba54f8ef-0972-4ee4-b3e8-d33636032701","Type":"ContainerStarted","Data":"1eee1207b72580af2748ca7f6b4039c59b8d16b596f73ba727fd72dcdd6ef884"} Mar 16 15:55:02 crc kubenswrapper[5120]: I0316 15:55:02.475275 5120 generic.go:358] "Generic (PLEG): container finished" podID="b6bb3fb4-89a4-4651-94cb-aed285af6acb" containerID="a7fd51f3629a656232cbf77d226f38d5b5486d9e31ce6546c5c48cb6a2240450" exitCode=0 Mar 16 15:55:02 crc kubenswrapper[5120]: I0316 15:55:02.475607 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-79ea-account-create-update-qpvh9" event={"ID":"b6bb3fb4-89a4-4651-94cb-aed285af6acb","Type":"ContainerDied","Data":"a7fd51f3629a656232cbf77d226f38d5b5486d9e31ce6546c5c48cb6a2240450"} Mar 16 15:55:02 crc kubenswrapper[5120]: I0316 15:55:02.506725 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/swift-ring-rebalance-4zt99" podStartSLOduration=1.506690684 podStartE2EDuration="1.506690684s" podCreationTimestamp="2026-03-16 15:55:01 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:55:02.493934821 +0000 UTC m=+1404.647866488" watchObservedRunningTime="2026-03-16 15:55:02.506690684 +0000 UTC m=+1404.660622351" Mar 16 15:55:02 crc kubenswrapper[5120]: I0316 15:55:02.824791 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/725b915c-7c39-43e6-8022-99dd14a6276e-etc-swift\") pod \"swift-storage-0\" (UID: \"725b915c-7c39-43e6-8022-99dd14a6276e\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 15:55:02 crc kubenswrapper[5120]: E0316 15:55:02.825132 5120 projected.go:289] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Mar 16 15:55:02 crc kubenswrapper[5120]: E0316 15:55:02.825179 5120 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Mar 16 15:55:02 crc kubenswrapper[5120]: E0316 15:55:02.825238 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/725b915c-7c39-43e6-8022-99dd14a6276e-etc-swift podName:725b915c-7c39-43e6-8022-99dd14a6276e nodeName:}" failed. No retries permitted until 2026-03-16 15:55:04.825221346 +0000 UTC m=+1406.979153013 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/725b915c-7c39-43e6-8022-99dd14a6276e-etc-swift") pod "swift-storage-0" (UID: "725b915c-7c39-43e6-8022-99dd14a6276e") : configmap "swift-ring-files" not found Mar 16 15:55:02 crc kubenswrapper[5120]: I0316 15:55:02.867274 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-create-g9hbz" Mar 16 15:55:03 crc kubenswrapper[5120]: I0316 15:55:03.028205 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/bd599640-4bc1-46b5-9cbb-9b57e959c4e9-operator-scripts\") pod \"bd599640-4bc1-46b5-9cbb-9b57e959c4e9\" (UID: \"bd599640-4bc1-46b5-9cbb-9b57e959c4e9\") " Mar 16 15:55:03 crc kubenswrapper[5120]: I0316 15:55:03.028285 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8hxmx\" (UniqueName: \"kubernetes.io/projected/bd599640-4bc1-46b5-9cbb-9b57e959c4e9-kube-api-access-8hxmx\") pod \"bd599640-4bc1-46b5-9cbb-9b57e959c4e9\" (UID: \"bd599640-4bc1-46b5-9cbb-9b57e959c4e9\") " Mar 16 15:55:03 crc kubenswrapper[5120]: I0316 15:55:03.029130 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd599640-4bc1-46b5-9cbb-9b57e959c4e9-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "bd599640-4bc1-46b5-9cbb-9b57e959c4e9" (UID: "bd599640-4bc1-46b5-9cbb-9b57e959c4e9"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:55:03 crc kubenswrapper[5120]: I0316 15:55:03.029874 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/bd599640-4bc1-46b5-9cbb-9b57e959c4e9-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 15:55:03 crc kubenswrapper[5120]: I0316 15:55:03.035644 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd599640-4bc1-46b5-9cbb-9b57e959c4e9-kube-api-access-8hxmx" (OuterVolumeSpecName: "kube-api-access-8hxmx") pod "bd599640-4bc1-46b5-9cbb-9b57e959c4e9" (UID: "bd599640-4bc1-46b5-9cbb-9b57e959c4e9"). InnerVolumeSpecName "kube-api-access-8hxmx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:55:03 crc kubenswrapper[5120]: I0316 15:55:03.131299 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8hxmx\" (UniqueName: \"kubernetes.io/projected/bd599640-4bc1-46b5-9cbb-9b57e959c4e9-kube-api-access-8hxmx\") on node \"crc\" DevicePath \"\"" Mar 16 15:55:03 crc kubenswrapper[5120]: I0316 15:55:03.488315 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-create-g9hbz" Mar 16 15:55:03 crc kubenswrapper[5120]: I0316 15:55:03.488947 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-create-g9hbz" event={"ID":"bd599640-4bc1-46b5-9cbb-9b57e959c4e9","Type":"ContainerDied","Data":"632103d580e378dee94a7b0ee35d31205190969a4d0557043f96a7f8c210e182"} Mar 16 15:55:03 crc kubenswrapper[5120]: I0316 15:55:03.488998 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="632103d580e378dee94a7b0ee35d31205190969a4d0557043f96a7f8c210e182" Mar 16 15:55:03 crc kubenswrapper[5120]: I0316 15:55:03.872045 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-7ef1-account-create-update-lv85w" Mar 16 15:55:03 crc kubenswrapper[5120]: I0316 15:55:03.945772 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ffdk8\" (UniqueName: \"kubernetes.io/projected/fdfe4db3-e823-45f2-85d8-4adc47ff19f9-kube-api-access-ffdk8\") pod \"fdfe4db3-e823-45f2-85d8-4adc47ff19f9\" (UID: \"fdfe4db3-e823-45f2-85d8-4adc47ff19f9\") " Mar 16 15:55:03 crc kubenswrapper[5120]: I0316 15:55:03.946105 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/fdfe4db3-e823-45f2-85d8-4adc47ff19f9-operator-scripts\") pod \"fdfe4db3-e823-45f2-85d8-4adc47ff19f9\" (UID: \"fdfe4db3-e823-45f2-85d8-4adc47ff19f9\") " Mar 16 15:55:03 crc kubenswrapper[5120]: I0316 15:55:03.946825 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fdfe4db3-e823-45f2-85d8-4adc47ff19f9-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "fdfe4db3-e823-45f2-85d8-4adc47ff19f9" (UID: "fdfe4db3-e823-45f2-85d8-4adc47ff19f9"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:55:03 crc kubenswrapper[5120]: I0316 15:55:03.951470 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fdfe4db3-e823-45f2-85d8-4adc47ff19f9-kube-api-access-ffdk8" (OuterVolumeSpecName: "kube-api-access-ffdk8") pod "fdfe4db3-e823-45f2-85d8-4adc47ff19f9" (UID: "fdfe4db3-e823-45f2-85d8-4adc47ff19f9"). InnerVolumeSpecName "kube-api-access-ffdk8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:55:04 crc kubenswrapper[5120]: I0316 15:55:04.029187 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-create-wkkpd" Mar 16 15:55:04 crc kubenswrapper[5120]: I0316 15:55:04.033966 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-79ea-account-create-update-qpvh9" Mar 16 15:55:04 crc kubenswrapper[5120]: I0316 15:55:04.048497 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ffdk8\" (UniqueName: \"kubernetes.io/projected/fdfe4db3-e823-45f2-85d8-4adc47ff19f9-kube-api-access-ffdk8\") on node \"crc\" DevicePath \"\"" Mar 16 15:55:04 crc kubenswrapper[5120]: I0316 15:55:04.048533 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/fdfe4db3-e823-45f2-85d8-4adc47ff19f9-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 15:55:04 crc kubenswrapper[5120]: I0316 15:55:04.149735 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b6bb3fb4-89a4-4651-94cb-aed285af6acb-operator-scripts\") pod \"b6bb3fb4-89a4-4651-94cb-aed285af6acb\" (UID: \"b6bb3fb4-89a4-4651-94cb-aed285af6acb\") " Mar 16 15:55:04 crc kubenswrapper[5120]: I0316 15:55:04.149932 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e3d90a02-e510-46ee-b65f-1ac0c36060ce-operator-scripts\") pod \"e3d90a02-e510-46ee-b65f-1ac0c36060ce\" (UID: \"e3d90a02-e510-46ee-b65f-1ac0c36060ce\") " Mar 16 15:55:04 crc kubenswrapper[5120]: I0316 15:55:04.150299 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jmmlj\" (UniqueName: \"kubernetes.io/projected/e3d90a02-e510-46ee-b65f-1ac0c36060ce-kube-api-access-jmmlj\") pod \"e3d90a02-e510-46ee-b65f-1ac0c36060ce\" (UID: \"e3d90a02-e510-46ee-b65f-1ac0c36060ce\") " Mar 16 15:55:04 crc kubenswrapper[5120]: I0316 15:55:04.150461 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b6bb3fb4-89a4-4651-94cb-aed285af6acb-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "b6bb3fb4-89a4-4651-94cb-aed285af6acb" (UID: "b6bb3fb4-89a4-4651-94cb-aed285af6acb"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:55:04 crc kubenswrapper[5120]: I0316 15:55:04.150634 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-66h8p\" (UniqueName: \"kubernetes.io/projected/b6bb3fb4-89a4-4651-94cb-aed285af6acb-kube-api-access-66h8p\") pod \"b6bb3fb4-89a4-4651-94cb-aed285af6acb\" (UID: \"b6bb3fb4-89a4-4651-94cb-aed285af6acb\") " Mar 16 15:55:04 crc kubenswrapper[5120]: I0316 15:55:04.151309 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b6bb3fb4-89a4-4651-94cb-aed285af6acb-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 15:55:04 crc kubenswrapper[5120]: I0316 15:55:04.152062 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e3d90a02-e510-46ee-b65f-1ac0c36060ce-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "e3d90a02-e510-46ee-b65f-1ac0c36060ce" (UID: "e3d90a02-e510-46ee-b65f-1ac0c36060ce"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:55:04 crc kubenswrapper[5120]: I0316 15:55:04.153674 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3d90a02-e510-46ee-b65f-1ac0c36060ce-kube-api-access-jmmlj" (OuterVolumeSpecName: "kube-api-access-jmmlj") pod "e3d90a02-e510-46ee-b65f-1ac0c36060ce" (UID: "e3d90a02-e510-46ee-b65f-1ac0c36060ce"). InnerVolumeSpecName "kube-api-access-jmmlj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:55:04 crc kubenswrapper[5120]: I0316 15:55:04.154098 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6bb3fb4-89a4-4651-94cb-aed285af6acb-kube-api-access-66h8p" (OuterVolumeSpecName: "kube-api-access-66h8p") pod "b6bb3fb4-89a4-4651-94cb-aed285af6acb" (UID: "b6bb3fb4-89a4-4651-94cb-aed285af6acb"). InnerVolumeSpecName "kube-api-access-66h8p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:55:04 crc kubenswrapper[5120]: I0316 15:55:04.173637 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 15:55:04 crc kubenswrapper[5120]: I0316 15:55:04.253012 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e3d90a02-e510-46ee-b65f-1ac0c36060ce-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 15:55:04 crc kubenswrapper[5120]: I0316 15:55:04.253049 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jmmlj\" (UniqueName: \"kubernetes.io/projected/e3d90a02-e510-46ee-b65f-1ac0c36060ce-kube-api-access-jmmlj\") on node \"crc\" DevicePath \"\"" Mar 16 15:55:04 crc kubenswrapper[5120]: I0316 15:55:04.253062 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-66h8p\" (UniqueName: \"kubernetes.io/projected/b6bb3fb4-89a4-4651-94cb-aed285af6acb-kube-api-access-66h8p\") on node \"crc\" DevicePath \"\"" Mar 16 15:55:04 crc kubenswrapper[5120]: I0316 15:55:04.502295 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-79ea-account-create-update-qpvh9" event={"ID":"b6bb3fb4-89a4-4651-94cb-aed285af6acb","Type":"ContainerDied","Data":"a821840e7e08d7ff4ec0f7bddffb8291c36531af5c447ea1967f26ed5f58a209"} Mar 16 15:55:04 crc kubenswrapper[5120]: I0316 15:55:04.502654 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a821840e7e08d7ff4ec0f7bddffb8291c36531af5c447ea1967f26ed5f58a209" Mar 16 15:55:04 crc kubenswrapper[5120]: I0316 15:55:04.502776 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-79ea-account-create-update-qpvh9" Mar 16 15:55:04 crc kubenswrapper[5120]: I0316 15:55:04.507339 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-7ef1-account-create-update-lv85w" event={"ID":"fdfe4db3-e823-45f2-85d8-4adc47ff19f9","Type":"ContainerDied","Data":"79cd01aa1baf4a478e030bca7e81541b8b53d40416dcbbdf382a145b9e5e2690"} Mar 16 15:55:04 crc kubenswrapper[5120]: I0316 15:55:04.507538 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="79cd01aa1baf4a478e030bca7e81541b8b53d40416dcbbdf382a145b9e5e2690" Mar 16 15:55:04 crc kubenswrapper[5120]: I0316 15:55:04.507341 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-7ef1-account-create-update-lv85w" Mar 16 15:55:04 crc kubenswrapper[5120]: I0316 15:55:04.512854 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-create-wkkpd" Mar 16 15:55:04 crc kubenswrapper[5120]: I0316 15:55:04.516553 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-create-wkkpd" event={"ID":"e3d90a02-e510-46ee-b65f-1ac0c36060ce","Type":"ContainerDied","Data":"071a54d799c90d97622a261550250a92716a6b23e251169258a4daff8c35cbbd"} Mar 16 15:55:04 crc kubenswrapper[5120]: I0316 15:55:04.516639 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="071a54d799c90d97622a261550250a92716a6b23e251169258a4daff8c35cbbd" Mar 16 15:55:04 crc kubenswrapper[5120]: I0316 15:55:04.865170 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/725b915c-7c39-43e6-8022-99dd14a6276e-etc-swift\") pod \"swift-storage-0\" (UID: \"725b915c-7c39-43e6-8022-99dd14a6276e\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 15:55:04 crc kubenswrapper[5120]: E0316 15:55:04.865364 5120 projected.go:289] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Mar 16 15:55:04 crc kubenswrapper[5120]: E0316 15:55:04.865397 5120 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Mar 16 15:55:04 crc kubenswrapper[5120]: E0316 15:55:04.865459 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/725b915c-7c39-43e6-8022-99dd14a6276e-etc-swift podName:725b915c-7c39-43e6-8022-99dd14a6276e nodeName:}" failed. No retries permitted until 2026-03-16 15:55:08.865441275 +0000 UTC m=+1411.019372922 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/725b915c-7c39-43e6-8022-99dd14a6276e-etc-swift") pod "swift-storage-0" (UID: "725b915c-7c39-43e6-8022-99dd14a6276e") : configmap "swift-ring-files" not found Mar 16 15:55:05 crc kubenswrapper[5120]: I0316 15:55:05.379528 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 15:55:05 crc kubenswrapper[5120]: I0316 15:55:05.596287 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 15:55:05 crc kubenswrapper[5120]: I0316 15:55:05.597961 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd599640-4bc1-46b5-9cbb-9b57e959c4e9" containerName="mariadb-database-create" Mar 16 15:55:05 crc kubenswrapper[5120]: I0316 15:55:05.597993 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd599640-4bc1-46b5-9cbb-9b57e959c4e9" containerName="mariadb-database-create" Mar 16 15:55:05 crc kubenswrapper[5120]: I0316 15:55:05.598065 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fdfe4db3-e823-45f2-85d8-4adc47ff19f9" containerName="mariadb-account-create-update" Mar 16 15:55:05 crc kubenswrapper[5120]: I0316 15:55:05.598076 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="fdfe4db3-e823-45f2-85d8-4adc47ff19f9" containerName="mariadb-account-create-update" Mar 16 15:55:05 crc kubenswrapper[5120]: I0316 15:55:05.598099 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3d90a02-e510-46ee-b65f-1ac0c36060ce" containerName="mariadb-database-create" Mar 16 15:55:05 crc kubenswrapper[5120]: I0316 15:55:05.598107 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3d90a02-e510-46ee-b65f-1ac0c36060ce" containerName="mariadb-database-create" Mar 16 15:55:05 crc kubenswrapper[5120]: I0316 15:55:05.598123 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6bb3fb4-89a4-4651-94cb-aed285af6acb" containerName="mariadb-account-create-update" Mar 16 15:55:05 crc kubenswrapper[5120]: I0316 15:55:05.598133 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6bb3fb4-89a4-4651-94cb-aed285af6acb" containerName="mariadb-account-create-update" Mar 16 15:55:05 crc kubenswrapper[5120]: I0316 15:55:05.598402 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="fdfe4db3-e823-45f2-85d8-4adc47ff19f9" containerName="mariadb-account-create-update" Mar 16 15:55:05 crc kubenswrapper[5120]: I0316 15:55:05.598439 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e3d90a02-e510-46ee-b65f-1ac0c36060ce" containerName="mariadb-database-create" Mar 16 15:55:05 crc kubenswrapper[5120]: I0316 15:55:05.598452 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="b6bb3fb4-89a4-4651-94cb-aed285af6acb" containerName="mariadb-account-create-update" Mar 16 15:55:05 crc kubenswrapper[5120]: I0316 15:55:05.598467 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="bd599640-4bc1-46b5-9cbb-9b57e959c4e9" containerName="mariadb-database-create" Mar 16 15:55:05 crc kubenswrapper[5120]: I0316 15:55:05.609584 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 15:55:05 crc kubenswrapper[5120]: I0316 15:55:05.611355 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ovnnorthd-ovnnorthd-dockercfg-zwqhk\"" Mar 16 15:55:05 crc kubenswrapper[5120]: I0316 15:55:05.611937 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovnnorthd-scripts\"" Mar 16 15:55:05 crc kubenswrapper[5120]: I0316 15:55:05.612451 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 15:55:05 crc kubenswrapper[5120]: I0316 15:55:05.615232 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovnnorthd-config\"" Mar 16 15:55:05 crc kubenswrapper[5120]: I0316 15:55:05.615394 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ovnnorthd-ovndbs\"" Mar 16 15:55:05 crc kubenswrapper[5120]: I0316 15:55:05.747167 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/root-account-create-update-n5rqj"] Mar 16 15:55:05 crc kubenswrapper[5120]: I0316 15:55:05.774942 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-n5rqj" Mar 16 15:55:05 crc kubenswrapper[5120]: I0316 15:55:05.774808 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-n5rqj"] Mar 16 15:55:05 crc kubenswrapper[5120]: I0316 15:55:05.786290 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"openstack-mariadb-root-db-secret\"" Mar 16 15:55:05 crc kubenswrapper[5120]: I0316 15:55:05.789022 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3a1fe07d-3cc8-4eea-8e8b-eb2807caa357-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"3a1fe07d-3cc8-4eea-8e8b-eb2807caa357\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 15:55:05 crc kubenswrapper[5120]: I0316 15:55:05.789135 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3a1fe07d-3cc8-4eea-8e8b-eb2807caa357-config\") pod \"ovn-northd-0\" (UID: \"3a1fe07d-3cc8-4eea-8e8b-eb2807caa357\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 15:55:05 crc kubenswrapper[5120]: I0316 15:55:05.789172 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/3a1fe07d-3cc8-4eea-8e8b-eb2807caa357-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"3a1fe07d-3cc8-4eea-8e8b-eb2807caa357\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 15:55:05 crc kubenswrapper[5120]: I0316 15:55:05.789193 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/3a1fe07d-3cc8-4eea-8e8b-eb2807caa357-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"3a1fe07d-3cc8-4eea-8e8b-eb2807caa357\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 15:55:05 crc kubenswrapper[5120]: I0316 15:55:05.789218 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/3a1fe07d-3cc8-4eea-8e8b-eb2807caa357-scripts\") pod \"ovn-northd-0\" (UID: \"3a1fe07d-3cc8-4eea-8e8b-eb2807caa357\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 15:55:05 crc kubenswrapper[5120]: I0316 15:55:05.789268 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6ssc\" (UniqueName: \"kubernetes.io/projected/3a1fe07d-3cc8-4eea-8e8b-eb2807caa357-kube-api-access-x6ssc\") pod \"ovn-northd-0\" (UID: \"3a1fe07d-3cc8-4eea-8e8b-eb2807caa357\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 15:55:05 crc kubenswrapper[5120]: I0316 15:55:05.789314 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/3a1fe07d-3cc8-4eea-8e8b-eb2807caa357-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"3a1fe07d-3cc8-4eea-8e8b-eb2807caa357\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 15:55:05 crc kubenswrapper[5120]: I0316 15:55:05.890187 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3a1fe07d-3cc8-4eea-8e8b-eb2807caa357-config\") pod \"ovn-northd-0\" (UID: \"3a1fe07d-3cc8-4eea-8e8b-eb2807caa357\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 15:55:05 crc kubenswrapper[5120]: I0316 15:55:05.890495 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/20e5c33a-5083-4223-afba-110b1297b222-operator-scripts\") pod \"root-account-create-update-n5rqj\" (UID: \"20e5c33a-5083-4223-afba-110b1297b222\") " pod="openstack-kuttl-tests/root-account-create-update-n5rqj" Mar 16 15:55:05 crc kubenswrapper[5120]: I0316 15:55:05.890603 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/3a1fe07d-3cc8-4eea-8e8b-eb2807caa357-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"3a1fe07d-3cc8-4eea-8e8b-eb2807caa357\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 15:55:05 crc kubenswrapper[5120]: I0316 15:55:05.890688 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/3a1fe07d-3cc8-4eea-8e8b-eb2807caa357-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"3a1fe07d-3cc8-4eea-8e8b-eb2807caa357\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 15:55:05 crc kubenswrapper[5120]: I0316 15:55:05.890776 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/3a1fe07d-3cc8-4eea-8e8b-eb2807caa357-scripts\") pod \"ovn-northd-0\" (UID: \"3a1fe07d-3cc8-4eea-8e8b-eb2807caa357\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 15:55:05 crc kubenswrapper[5120]: I0316 15:55:05.890883 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x6ssc\" (UniqueName: \"kubernetes.io/projected/3a1fe07d-3cc8-4eea-8e8b-eb2807caa357-kube-api-access-x6ssc\") pod \"ovn-northd-0\" (UID: \"3a1fe07d-3cc8-4eea-8e8b-eb2807caa357\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 15:55:05 crc kubenswrapper[5120]: I0316 15:55:05.891249 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhrsk\" (UniqueName: \"kubernetes.io/projected/20e5c33a-5083-4223-afba-110b1297b222-kube-api-access-mhrsk\") pod \"root-account-create-update-n5rqj\" (UID: \"20e5c33a-5083-4223-afba-110b1297b222\") " pod="openstack-kuttl-tests/root-account-create-update-n5rqj" Mar 16 15:55:05 crc kubenswrapper[5120]: I0316 15:55:05.891333 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/3a1fe07d-3cc8-4eea-8e8b-eb2807caa357-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"3a1fe07d-3cc8-4eea-8e8b-eb2807caa357\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 15:55:05 crc kubenswrapper[5120]: I0316 15:55:05.891529 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3a1fe07d-3cc8-4eea-8e8b-eb2807caa357-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"3a1fe07d-3cc8-4eea-8e8b-eb2807caa357\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 15:55:05 crc kubenswrapper[5120]: I0316 15:55:05.891645 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/3a1fe07d-3cc8-4eea-8e8b-eb2807caa357-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"3a1fe07d-3cc8-4eea-8e8b-eb2807caa357\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 15:55:05 crc kubenswrapper[5120]: I0316 15:55:05.892316 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3a1fe07d-3cc8-4eea-8e8b-eb2807caa357-config\") pod \"ovn-northd-0\" (UID: \"3a1fe07d-3cc8-4eea-8e8b-eb2807caa357\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 15:55:05 crc kubenswrapper[5120]: I0316 15:55:05.892932 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/3a1fe07d-3cc8-4eea-8e8b-eb2807caa357-scripts\") pod \"ovn-northd-0\" (UID: \"3a1fe07d-3cc8-4eea-8e8b-eb2807caa357\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 15:55:05 crc kubenswrapper[5120]: I0316 15:55:05.896964 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/3a1fe07d-3cc8-4eea-8e8b-eb2807caa357-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"3a1fe07d-3cc8-4eea-8e8b-eb2807caa357\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 15:55:05 crc kubenswrapper[5120]: I0316 15:55:05.897323 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3a1fe07d-3cc8-4eea-8e8b-eb2807caa357-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"3a1fe07d-3cc8-4eea-8e8b-eb2807caa357\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 15:55:05 crc kubenswrapper[5120]: I0316 15:55:05.898953 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/3a1fe07d-3cc8-4eea-8e8b-eb2807caa357-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"3a1fe07d-3cc8-4eea-8e8b-eb2807caa357\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 15:55:05 crc kubenswrapper[5120]: I0316 15:55:05.910849 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6ssc\" (UniqueName: \"kubernetes.io/projected/3a1fe07d-3cc8-4eea-8e8b-eb2807caa357-kube-api-access-x6ssc\") pod \"ovn-northd-0\" (UID: \"3a1fe07d-3cc8-4eea-8e8b-eb2807caa357\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 15:55:05 crc kubenswrapper[5120]: I0316 15:55:05.930810 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 15:55:05 crc kubenswrapper[5120]: I0316 15:55:05.993506 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/20e5c33a-5083-4223-afba-110b1297b222-operator-scripts\") pod \"root-account-create-update-n5rqj\" (UID: \"20e5c33a-5083-4223-afba-110b1297b222\") " pod="openstack-kuttl-tests/root-account-create-update-n5rqj" Mar 16 15:55:05 crc kubenswrapper[5120]: I0316 15:55:05.993693 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mhrsk\" (UniqueName: \"kubernetes.io/projected/20e5c33a-5083-4223-afba-110b1297b222-kube-api-access-mhrsk\") pod \"root-account-create-update-n5rqj\" (UID: \"20e5c33a-5083-4223-afba-110b1297b222\") " pod="openstack-kuttl-tests/root-account-create-update-n5rqj" Mar 16 15:55:05 crc kubenswrapper[5120]: I0316 15:55:05.994861 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/20e5c33a-5083-4223-afba-110b1297b222-operator-scripts\") pod \"root-account-create-update-n5rqj\" (UID: \"20e5c33a-5083-4223-afba-110b1297b222\") " pod="openstack-kuttl-tests/root-account-create-update-n5rqj" Mar 16 15:55:06 crc kubenswrapper[5120]: I0316 15:55:06.030733 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhrsk\" (UniqueName: \"kubernetes.io/projected/20e5c33a-5083-4223-afba-110b1297b222-kube-api-access-mhrsk\") pod \"root-account-create-update-n5rqj\" (UID: \"20e5c33a-5083-4223-afba-110b1297b222\") " pod="openstack-kuttl-tests/root-account-create-update-n5rqj" Mar 16 15:55:06 crc kubenswrapper[5120]: I0316 15:55:06.101141 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-n5rqj" Mar 16 15:55:06 crc kubenswrapper[5120]: I0316 15:55:06.368155 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-db-create-d4dhh"] Mar 16 15:55:06 crc kubenswrapper[5120]: I0316 15:55:06.378224 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 15:55:06 crc kubenswrapper[5120]: I0316 15:55:06.378358 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-create-d4dhh" Mar 16 15:55:06 crc kubenswrapper[5120]: I0316 15:55:06.383862 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-db-create-d4dhh"] Mar 16 15:55:06 crc kubenswrapper[5120]: W0316 15:55:06.406504 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3a1fe07d_3cc8_4eea_8e8b_eb2807caa357.slice/crio-32a2d5fa725706f4fcf703f259c2b4a1ebfdedb4e7eb5704c2680b6e38ef18d5 WatchSource:0}: Error finding container 32a2d5fa725706f4fcf703f259c2b4a1ebfdedb4e7eb5704c2680b6e38ef18d5: Status 404 returned error can't find the container with id 32a2d5fa725706f4fcf703f259c2b4a1ebfdedb4e7eb5704c2680b6e38ef18d5 Mar 16 15:55:06 crc kubenswrapper[5120]: I0316 15:55:06.488152 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-b511-account-create-update-l95v7"] Mar 16 15:55:06 crc kubenswrapper[5120]: I0316 15:55:06.494436 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-b511-account-create-update-l95v7" Mar 16 15:55:06 crc kubenswrapper[5120]: I0316 15:55:06.495425 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-b511-account-create-update-l95v7"] Mar 16 15:55:06 crc kubenswrapper[5120]: I0316 15:55:06.502739 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjbkj\" (UniqueName: \"kubernetes.io/projected/43739814-c000-496f-bbfa-840c9297c136-kube-api-access-rjbkj\") pod \"glance-db-create-d4dhh\" (UID: \"43739814-c000-496f-bbfa-840c9297c136\") " pod="openstack-kuttl-tests/glance-db-create-d4dhh" Mar 16 15:55:06 crc kubenswrapper[5120]: I0316 15:55:06.502947 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/43739814-c000-496f-bbfa-840c9297c136-operator-scripts\") pod \"glance-db-create-d4dhh\" (UID: \"43739814-c000-496f-bbfa-840c9297c136\") " pod="openstack-kuttl-tests/glance-db-create-d4dhh" Mar 16 15:55:06 crc kubenswrapper[5120]: I0316 15:55:06.535066 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-db-secret\"" Mar 16 15:55:06 crc kubenswrapper[5120]: I0316 15:55:06.554928 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"3a1fe07d-3cc8-4eea-8e8b-eb2807caa357","Type":"ContainerStarted","Data":"32a2d5fa725706f4fcf703f259c2b4a1ebfdedb4e7eb5704c2680b6e38ef18d5"} Mar 16 15:55:06 crc kubenswrapper[5120]: I0316 15:55:06.604588 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/613105e4-7e4e-41ad-adfa-de8fa43b93f2-operator-scripts\") pod \"glance-b511-account-create-update-l95v7\" (UID: \"613105e4-7e4e-41ad-adfa-de8fa43b93f2\") " pod="openstack-kuttl-tests/glance-b511-account-create-update-l95v7" Mar 16 15:55:06 crc kubenswrapper[5120]: I0316 15:55:06.605059 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rjbkj\" (UniqueName: \"kubernetes.io/projected/43739814-c000-496f-bbfa-840c9297c136-kube-api-access-rjbkj\") pod \"glance-db-create-d4dhh\" (UID: \"43739814-c000-496f-bbfa-840c9297c136\") " pod="openstack-kuttl-tests/glance-db-create-d4dhh" Mar 16 15:55:06 crc kubenswrapper[5120]: I0316 15:55:06.605172 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhx79\" (UniqueName: \"kubernetes.io/projected/613105e4-7e4e-41ad-adfa-de8fa43b93f2-kube-api-access-jhx79\") pod \"glance-b511-account-create-update-l95v7\" (UID: \"613105e4-7e4e-41ad-adfa-de8fa43b93f2\") " pod="openstack-kuttl-tests/glance-b511-account-create-update-l95v7" Mar 16 15:55:06 crc kubenswrapper[5120]: I0316 15:55:06.605276 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/43739814-c000-496f-bbfa-840c9297c136-operator-scripts\") pod \"glance-db-create-d4dhh\" (UID: \"43739814-c000-496f-bbfa-840c9297c136\") " pod="openstack-kuttl-tests/glance-db-create-d4dhh" Mar 16 15:55:06 crc kubenswrapper[5120]: I0316 15:55:06.606519 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/43739814-c000-496f-bbfa-840c9297c136-operator-scripts\") pod \"glance-db-create-d4dhh\" (UID: \"43739814-c000-496f-bbfa-840c9297c136\") " pod="openstack-kuttl-tests/glance-db-create-d4dhh" Mar 16 15:55:06 crc kubenswrapper[5120]: I0316 15:55:06.608625 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-n5rqj"] Mar 16 15:55:06 crc kubenswrapper[5120]: W0316 15:55:06.613440 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod20e5c33a_5083_4223_afba_110b1297b222.slice/crio-c373f7126ed97bfbcb07f350d191f7cee289ca6218a0fe3f0491bd4c2bc77265 WatchSource:0}: Error finding container c373f7126ed97bfbcb07f350d191f7cee289ca6218a0fe3f0491bd4c2bc77265: Status 404 returned error can't find the container with id c373f7126ed97bfbcb07f350d191f7cee289ca6218a0fe3f0491bd4c2bc77265 Mar 16 15:55:06 crc kubenswrapper[5120]: I0316 15:55:06.629659 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjbkj\" (UniqueName: \"kubernetes.io/projected/43739814-c000-496f-bbfa-840c9297c136-kube-api-access-rjbkj\") pod \"glance-db-create-d4dhh\" (UID: \"43739814-c000-496f-bbfa-840c9297c136\") " pod="openstack-kuttl-tests/glance-db-create-d4dhh" Mar 16 15:55:06 crc kubenswrapper[5120]: I0316 15:55:06.700304 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-create-d4dhh" Mar 16 15:55:06 crc kubenswrapper[5120]: I0316 15:55:06.706742 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jhx79\" (UniqueName: \"kubernetes.io/projected/613105e4-7e4e-41ad-adfa-de8fa43b93f2-kube-api-access-jhx79\") pod \"glance-b511-account-create-update-l95v7\" (UID: \"613105e4-7e4e-41ad-adfa-de8fa43b93f2\") " pod="openstack-kuttl-tests/glance-b511-account-create-update-l95v7" Mar 16 15:55:06 crc kubenswrapper[5120]: I0316 15:55:06.707002 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/613105e4-7e4e-41ad-adfa-de8fa43b93f2-operator-scripts\") pod \"glance-b511-account-create-update-l95v7\" (UID: \"613105e4-7e4e-41ad-adfa-de8fa43b93f2\") " pod="openstack-kuttl-tests/glance-b511-account-create-update-l95v7" Mar 16 15:55:06 crc kubenswrapper[5120]: I0316 15:55:06.707788 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/613105e4-7e4e-41ad-adfa-de8fa43b93f2-operator-scripts\") pod \"glance-b511-account-create-update-l95v7\" (UID: \"613105e4-7e4e-41ad-adfa-de8fa43b93f2\") " pod="openstack-kuttl-tests/glance-b511-account-create-update-l95v7" Mar 16 15:55:06 crc kubenswrapper[5120]: I0316 15:55:06.726570 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhx79\" (UniqueName: \"kubernetes.io/projected/613105e4-7e4e-41ad-adfa-de8fa43b93f2-kube-api-access-jhx79\") pod \"glance-b511-account-create-update-l95v7\" (UID: \"613105e4-7e4e-41ad-adfa-de8fa43b93f2\") " pod="openstack-kuttl-tests/glance-b511-account-create-update-l95v7" Mar 16 15:55:06 crc kubenswrapper[5120]: I0316 15:55:06.870239 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-b511-account-create-update-l95v7" Mar 16 15:55:07 crc kubenswrapper[5120]: I0316 15:55:07.168955 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-db-create-d4dhh"] Mar 16 15:55:07 crc kubenswrapper[5120]: W0316 15:55:07.176587 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod43739814_c000_496f_bbfa_840c9297c136.slice/crio-b3423efe43db4d8e551e8e3e3715daa8df4b199bd7715fcf77d01bd11ae831cb WatchSource:0}: Error finding container b3423efe43db4d8e551e8e3e3715daa8df4b199bd7715fcf77d01bd11ae831cb: Status 404 returned error can't find the container with id b3423efe43db4d8e551e8e3e3715daa8df4b199bd7715fcf77d01bd11ae831cb Mar 16 15:55:07 crc kubenswrapper[5120]: I0316 15:55:07.315439 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-b511-account-create-update-l95v7"] Mar 16 15:55:07 crc kubenswrapper[5120]: W0316 15:55:07.325358 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod613105e4_7e4e_41ad_adfa_de8fa43b93f2.slice/crio-ffd13f980342c6e6684b3dbddbc5cfebbaa4fa6616921df7769973a5efeb3899 WatchSource:0}: Error finding container ffd13f980342c6e6684b3dbddbc5cfebbaa4fa6616921df7769973a5efeb3899: Status 404 returned error can't find the container with id ffd13f980342c6e6684b3dbddbc5cfebbaa4fa6616921df7769973a5efeb3899 Mar 16 15:55:07 crc kubenswrapper[5120]: I0316 15:55:07.567966 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-b511-account-create-update-l95v7" event={"ID":"613105e4-7e4e-41ad-adfa-de8fa43b93f2","Type":"ContainerStarted","Data":"50ce237e06ea88e2febc8f72ff349fb96e88daf1ee42f8733fcc8b3fe8f91846"} Mar 16 15:55:07 crc kubenswrapper[5120]: I0316 15:55:07.568022 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-b511-account-create-update-l95v7" event={"ID":"613105e4-7e4e-41ad-adfa-de8fa43b93f2","Type":"ContainerStarted","Data":"ffd13f980342c6e6684b3dbddbc5cfebbaa4fa6616921df7769973a5efeb3899"} Mar 16 15:55:07 crc kubenswrapper[5120]: I0316 15:55:07.572334 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"3a1fe07d-3cc8-4eea-8e8b-eb2807caa357","Type":"ContainerStarted","Data":"8769703bd7ee632a3e2c4769a2f29d820d6492a20d3a07f5c473931055316ae6"} Mar 16 15:55:07 crc kubenswrapper[5120]: I0316 15:55:07.572445 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"3a1fe07d-3cc8-4eea-8e8b-eb2807caa357","Type":"ContainerStarted","Data":"73fdaa6f98a1d0cecc065049ce5388e3add5f04f37ed5696274bbf8df19e57a5"} Mar 16 15:55:07 crc kubenswrapper[5120]: I0316 15:55:07.572617 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 15:55:07 crc kubenswrapper[5120]: I0316 15:55:07.575037 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-create-d4dhh" event={"ID":"43739814-c000-496f-bbfa-840c9297c136","Type":"ContainerStarted","Data":"8770325da4cfc31ef54b34a5e82ba65617eb8dd3b11ee81083d529c925585f95"} Mar 16 15:55:07 crc kubenswrapper[5120]: I0316 15:55:07.575137 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-create-d4dhh" event={"ID":"43739814-c000-496f-bbfa-840c9297c136","Type":"ContainerStarted","Data":"b3423efe43db4d8e551e8e3e3715daa8df4b199bd7715fcf77d01bd11ae831cb"} Mar 16 15:55:07 crc kubenswrapper[5120]: I0316 15:55:07.577698 5120 generic.go:358] "Generic (PLEG): container finished" podID="20e5c33a-5083-4223-afba-110b1297b222" containerID="8270c8dbc1b11e5b7213c6bc268f6c1f595833d463314384be040bcec0901608" exitCode=0 Mar 16 15:55:07 crc kubenswrapper[5120]: I0316 15:55:07.577796 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-n5rqj" event={"ID":"20e5c33a-5083-4223-afba-110b1297b222","Type":"ContainerDied","Data":"8270c8dbc1b11e5b7213c6bc268f6c1f595833d463314384be040bcec0901608"} Mar 16 15:55:07 crc kubenswrapper[5120]: I0316 15:55:07.577854 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-n5rqj" event={"ID":"20e5c33a-5083-4223-afba-110b1297b222","Type":"ContainerStarted","Data":"c373f7126ed97bfbcb07f350d191f7cee289ca6218a0fe3f0491bd4c2bc77265"} Mar 16 15:55:07 crc kubenswrapper[5120]: I0316 15:55:07.589886 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-b511-account-create-update-l95v7" podStartSLOduration=1.589865144 podStartE2EDuration="1.589865144s" podCreationTimestamp="2026-03-16 15:55:06 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:55:07.585278947 +0000 UTC m=+1409.739210604" watchObservedRunningTime="2026-03-16 15:55:07.589865144 +0000 UTC m=+1409.743796801" Mar 16 15:55:07 crc kubenswrapper[5120]: I0316 15:55:07.605916 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovn-northd-0" podStartSLOduration=2.605900329 podStartE2EDuration="2.605900329s" podCreationTimestamp="2026-03-16 15:55:05 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:55:07.603642906 +0000 UTC m=+1409.757574563" watchObservedRunningTime="2026-03-16 15:55:07.605900329 +0000 UTC m=+1409.759831986" Mar 16 15:55:07 crc kubenswrapper[5120]: I0316 15:55:07.622842 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-db-create-d4dhh" podStartSLOduration=1.622824618 podStartE2EDuration="1.622824618s" podCreationTimestamp="2026-03-16 15:55:06 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:55:07.616305517 +0000 UTC m=+1409.770237174" watchObservedRunningTime="2026-03-16 15:55:07.622824618 +0000 UTC m=+1409.776756265" Mar 16 15:55:08 crc kubenswrapper[5120]: E0316 15:55:08.045026 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1409453 actualBytes=10240 Mar 16 15:55:08 crc kubenswrapper[5120]: I0316 15:55:08.590250 5120 generic.go:358] "Generic (PLEG): container finished" podID="613105e4-7e4e-41ad-adfa-de8fa43b93f2" containerID="50ce237e06ea88e2febc8f72ff349fb96e88daf1ee42f8733fcc8b3fe8f91846" exitCode=0 Mar 16 15:55:08 crc kubenswrapper[5120]: I0316 15:55:08.590358 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-b511-account-create-update-l95v7" event={"ID":"613105e4-7e4e-41ad-adfa-de8fa43b93f2","Type":"ContainerDied","Data":"50ce237e06ea88e2febc8f72ff349fb96e88daf1ee42f8733fcc8b3fe8f91846"} Mar 16 15:55:08 crc kubenswrapper[5120]: I0316 15:55:08.597163 5120 generic.go:358] "Generic (PLEG): container finished" podID="43739814-c000-496f-bbfa-840c9297c136" containerID="8770325da4cfc31ef54b34a5e82ba65617eb8dd3b11ee81083d529c925585f95" exitCode=0 Mar 16 15:55:08 crc kubenswrapper[5120]: I0316 15:55:08.597526 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-create-d4dhh" event={"ID":"43739814-c000-496f-bbfa-840c9297c136","Type":"ContainerDied","Data":"8770325da4cfc31ef54b34a5e82ba65617eb8dd3b11ee81083d529c925585f95"} Mar 16 15:55:08 crc kubenswrapper[5120]: I0316 15:55:08.945956 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-n5rqj" Mar 16 15:55:08 crc kubenswrapper[5120]: I0316 15:55:08.953813 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/725b915c-7c39-43e6-8022-99dd14a6276e-etc-swift\") pod \"swift-storage-0\" (UID: \"725b915c-7c39-43e6-8022-99dd14a6276e\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 15:55:08 crc kubenswrapper[5120]: E0316 15:55:08.954020 5120 projected.go:289] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Mar 16 15:55:08 crc kubenswrapper[5120]: E0316 15:55:08.954053 5120 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Mar 16 15:55:08 crc kubenswrapper[5120]: E0316 15:55:08.954122 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/725b915c-7c39-43e6-8022-99dd14a6276e-etc-swift podName:725b915c-7c39-43e6-8022-99dd14a6276e nodeName:}" failed. No retries permitted until 2026-03-16 15:55:16.954101211 +0000 UTC m=+1419.108032878 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/725b915c-7c39-43e6-8022-99dd14a6276e-etc-swift") pod "swift-storage-0" (UID: "725b915c-7c39-43e6-8022-99dd14a6276e") : configmap "swift-ring-files" not found Mar 16 15:55:09 crc kubenswrapper[5120]: I0316 15:55:09.056500 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mhrsk\" (UniqueName: \"kubernetes.io/projected/20e5c33a-5083-4223-afba-110b1297b222-kube-api-access-mhrsk\") pod \"20e5c33a-5083-4223-afba-110b1297b222\" (UID: \"20e5c33a-5083-4223-afba-110b1297b222\") " Mar 16 15:55:09 crc kubenswrapper[5120]: I0316 15:55:09.057940 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/20e5c33a-5083-4223-afba-110b1297b222-operator-scripts\") pod \"20e5c33a-5083-4223-afba-110b1297b222\" (UID: \"20e5c33a-5083-4223-afba-110b1297b222\") " Mar 16 15:55:09 crc kubenswrapper[5120]: I0316 15:55:09.058705 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/20e5c33a-5083-4223-afba-110b1297b222-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "20e5c33a-5083-4223-afba-110b1297b222" (UID: "20e5c33a-5083-4223-afba-110b1297b222"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:55:09 crc kubenswrapper[5120]: I0316 15:55:09.058868 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/20e5c33a-5083-4223-afba-110b1297b222-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 15:55:09 crc kubenswrapper[5120]: I0316 15:55:09.062953 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20e5c33a-5083-4223-afba-110b1297b222-kube-api-access-mhrsk" (OuterVolumeSpecName: "kube-api-access-mhrsk") pod "20e5c33a-5083-4223-afba-110b1297b222" (UID: "20e5c33a-5083-4223-afba-110b1297b222"). InnerVolumeSpecName "kube-api-access-mhrsk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:55:09 crc kubenswrapper[5120]: I0316 15:55:09.160493 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mhrsk\" (UniqueName: \"kubernetes.io/projected/20e5c33a-5083-4223-afba-110b1297b222-kube-api-access-mhrsk\") on node \"crc\" DevicePath \"\"" Mar 16 15:55:09 crc kubenswrapper[5120]: I0316 15:55:09.616338 5120 generic.go:358] "Generic (PLEG): container finished" podID="ba54f8ef-0972-4ee4-b3e8-d33636032701" containerID="9a9f520f86e7e6a2f9039e33c7f82866cb9a32ef43b7327f940081c0c0ee97f2" exitCode=0 Mar 16 15:55:09 crc kubenswrapper[5120]: I0316 15:55:09.616469 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-4zt99" event={"ID":"ba54f8ef-0972-4ee4-b3e8-d33636032701","Type":"ContainerDied","Data":"9a9f520f86e7e6a2f9039e33c7f82866cb9a32ef43b7327f940081c0c0ee97f2"} Mar 16 15:55:09 crc kubenswrapper[5120]: I0316 15:55:09.620931 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-n5rqj" Mar 16 15:55:09 crc kubenswrapper[5120]: I0316 15:55:09.620944 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-n5rqj" event={"ID":"20e5c33a-5083-4223-afba-110b1297b222","Type":"ContainerDied","Data":"c373f7126ed97bfbcb07f350d191f7cee289ca6218a0fe3f0491bd4c2bc77265"} Mar 16 15:55:09 crc kubenswrapper[5120]: I0316 15:55:09.621011 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c373f7126ed97bfbcb07f350d191f7cee289ca6218a0fe3f0491bd4c2bc77265" Mar 16 15:55:10 crc kubenswrapper[5120]: I0316 15:55:10.108108 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-b511-account-create-update-l95v7" Mar 16 15:55:10 crc kubenswrapper[5120]: I0316 15:55:10.114710 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-create-d4dhh" Mar 16 15:55:10 crc kubenswrapper[5120]: I0316 15:55:10.184240 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/613105e4-7e4e-41ad-adfa-de8fa43b93f2-operator-scripts\") pod \"613105e4-7e4e-41ad-adfa-de8fa43b93f2\" (UID: \"613105e4-7e4e-41ad-adfa-de8fa43b93f2\") " Mar 16 15:55:10 crc kubenswrapper[5120]: I0316 15:55:10.184445 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rjbkj\" (UniqueName: \"kubernetes.io/projected/43739814-c000-496f-bbfa-840c9297c136-kube-api-access-rjbkj\") pod \"43739814-c000-496f-bbfa-840c9297c136\" (UID: \"43739814-c000-496f-bbfa-840c9297c136\") " Mar 16 15:55:10 crc kubenswrapper[5120]: I0316 15:55:10.184551 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jhx79\" (UniqueName: \"kubernetes.io/projected/613105e4-7e4e-41ad-adfa-de8fa43b93f2-kube-api-access-jhx79\") pod \"613105e4-7e4e-41ad-adfa-de8fa43b93f2\" (UID: \"613105e4-7e4e-41ad-adfa-de8fa43b93f2\") " Mar 16 15:55:10 crc kubenswrapper[5120]: I0316 15:55:10.184664 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/43739814-c000-496f-bbfa-840c9297c136-operator-scripts\") pod \"43739814-c000-496f-bbfa-840c9297c136\" (UID: \"43739814-c000-496f-bbfa-840c9297c136\") " Mar 16 15:55:10 crc kubenswrapper[5120]: I0316 15:55:10.185776 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/43739814-c000-496f-bbfa-840c9297c136-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "43739814-c000-496f-bbfa-840c9297c136" (UID: "43739814-c000-496f-bbfa-840c9297c136"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:55:10 crc kubenswrapper[5120]: I0316 15:55:10.185801 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/613105e4-7e4e-41ad-adfa-de8fa43b93f2-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "613105e4-7e4e-41ad-adfa-de8fa43b93f2" (UID: "613105e4-7e4e-41ad-adfa-de8fa43b93f2"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:55:10 crc kubenswrapper[5120]: I0316 15:55:10.190404 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/43739814-c000-496f-bbfa-840c9297c136-kube-api-access-rjbkj" (OuterVolumeSpecName: "kube-api-access-rjbkj") pod "43739814-c000-496f-bbfa-840c9297c136" (UID: "43739814-c000-496f-bbfa-840c9297c136"). InnerVolumeSpecName "kube-api-access-rjbkj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:55:10 crc kubenswrapper[5120]: I0316 15:55:10.196111 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/613105e4-7e4e-41ad-adfa-de8fa43b93f2-kube-api-access-jhx79" (OuterVolumeSpecName: "kube-api-access-jhx79") pod "613105e4-7e4e-41ad-adfa-de8fa43b93f2" (UID: "613105e4-7e4e-41ad-adfa-de8fa43b93f2"). InnerVolumeSpecName "kube-api-access-jhx79". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:55:10 crc kubenswrapper[5120]: I0316 15:55:10.286854 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jhx79\" (UniqueName: \"kubernetes.io/projected/613105e4-7e4e-41ad-adfa-de8fa43b93f2-kube-api-access-jhx79\") on node \"crc\" DevicePath \"\"" Mar 16 15:55:10 crc kubenswrapper[5120]: I0316 15:55:10.286881 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/43739814-c000-496f-bbfa-840c9297c136-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 15:55:10 crc kubenswrapper[5120]: I0316 15:55:10.286890 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/613105e4-7e4e-41ad-adfa-de8fa43b93f2-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 15:55:10 crc kubenswrapper[5120]: I0316 15:55:10.286901 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rjbkj\" (UniqueName: \"kubernetes.io/projected/43739814-c000-496f-bbfa-840c9297c136-kube-api-access-rjbkj\") on node \"crc\" DevicePath \"\"" Mar 16 15:55:10 crc kubenswrapper[5120]: I0316 15:55:10.637811 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-b511-account-create-update-l95v7" event={"ID":"613105e4-7e4e-41ad-adfa-de8fa43b93f2","Type":"ContainerDied","Data":"ffd13f980342c6e6684b3dbddbc5cfebbaa4fa6616921df7769973a5efeb3899"} Mar 16 15:55:10 crc kubenswrapper[5120]: I0316 15:55:10.637864 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-b511-account-create-update-l95v7" Mar 16 15:55:10 crc kubenswrapper[5120]: I0316 15:55:10.637880 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ffd13f980342c6e6684b3dbddbc5cfebbaa4fa6616921df7769973a5efeb3899" Mar 16 15:55:10 crc kubenswrapper[5120]: I0316 15:55:10.641032 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-create-d4dhh" event={"ID":"43739814-c000-496f-bbfa-840c9297c136","Type":"ContainerDied","Data":"b3423efe43db4d8e551e8e3e3715daa8df4b199bd7715fcf77d01bd11ae831cb"} Mar 16 15:55:10 crc kubenswrapper[5120]: I0316 15:55:10.641077 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b3423efe43db4d8e551e8e3e3715daa8df4b199bd7715fcf77d01bd11ae831cb" Mar 16 15:55:10 crc kubenswrapper[5120]: I0316 15:55:10.641040 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-create-d4dhh" Mar 16 15:55:11 crc kubenswrapper[5120]: I0316 15:55:11.119248 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-4zt99" Mar 16 15:55:11 crc kubenswrapper[5120]: I0316 15:55:11.205247 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jl8mz\" (UniqueName: \"kubernetes.io/projected/ba54f8ef-0972-4ee4-b3e8-d33636032701-kube-api-access-jl8mz\") pod \"ba54f8ef-0972-4ee4-b3e8-d33636032701\" (UID: \"ba54f8ef-0972-4ee4-b3e8-d33636032701\") " Mar 16 15:55:11 crc kubenswrapper[5120]: I0316 15:55:11.205293 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/ba54f8ef-0972-4ee4-b3e8-d33636032701-etc-swift\") pod \"ba54f8ef-0972-4ee4-b3e8-d33636032701\" (UID: \"ba54f8ef-0972-4ee4-b3e8-d33636032701\") " Mar 16 15:55:11 crc kubenswrapper[5120]: I0316 15:55:11.205404 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/ba54f8ef-0972-4ee4-b3e8-d33636032701-ring-data-devices\") pod \"ba54f8ef-0972-4ee4-b3e8-d33636032701\" (UID: \"ba54f8ef-0972-4ee4-b3e8-d33636032701\") " Mar 16 15:55:11 crc kubenswrapper[5120]: I0316 15:55:11.205453 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ba54f8ef-0972-4ee4-b3e8-d33636032701-combined-ca-bundle\") pod \"ba54f8ef-0972-4ee4-b3e8-d33636032701\" (UID: \"ba54f8ef-0972-4ee4-b3e8-d33636032701\") " Mar 16 15:55:11 crc kubenswrapper[5120]: I0316 15:55:11.205500 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/ba54f8ef-0972-4ee4-b3e8-d33636032701-scripts\") pod \"ba54f8ef-0972-4ee4-b3e8-d33636032701\" (UID: \"ba54f8ef-0972-4ee4-b3e8-d33636032701\") " Mar 16 15:55:11 crc kubenswrapper[5120]: I0316 15:55:11.205530 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/ba54f8ef-0972-4ee4-b3e8-d33636032701-swiftconf\") pod \"ba54f8ef-0972-4ee4-b3e8-d33636032701\" (UID: \"ba54f8ef-0972-4ee4-b3e8-d33636032701\") " Mar 16 15:55:11 crc kubenswrapper[5120]: I0316 15:55:11.205625 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/ba54f8ef-0972-4ee4-b3e8-d33636032701-dispersionconf\") pod \"ba54f8ef-0972-4ee4-b3e8-d33636032701\" (UID: \"ba54f8ef-0972-4ee4-b3e8-d33636032701\") " Mar 16 15:55:11 crc kubenswrapper[5120]: I0316 15:55:11.206317 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba54f8ef-0972-4ee4-b3e8-d33636032701-ring-data-devices" (OuterVolumeSpecName: "ring-data-devices") pod "ba54f8ef-0972-4ee4-b3e8-d33636032701" (UID: "ba54f8ef-0972-4ee4-b3e8-d33636032701"). InnerVolumeSpecName "ring-data-devices". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:55:11 crc kubenswrapper[5120]: I0316 15:55:11.206471 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba54f8ef-0972-4ee4-b3e8-d33636032701-etc-swift" (OuterVolumeSpecName: "etc-swift") pod "ba54f8ef-0972-4ee4-b3e8-d33636032701" (UID: "ba54f8ef-0972-4ee4-b3e8-d33636032701"). InnerVolumeSpecName "etc-swift". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:55:11 crc kubenswrapper[5120]: I0316 15:55:11.216803 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba54f8ef-0972-4ee4-b3e8-d33636032701-kube-api-access-jl8mz" (OuterVolumeSpecName: "kube-api-access-jl8mz") pod "ba54f8ef-0972-4ee4-b3e8-d33636032701" (UID: "ba54f8ef-0972-4ee4-b3e8-d33636032701"). InnerVolumeSpecName "kube-api-access-jl8mz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:55:11 crc kubenswrapper[5120]: I0316 15:55:11.217133 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba54f8ef-0972-4ee4-b3e8-d33636032701-dispersionconf" (OuterVolumeSpecName: "dispersionconf") pod "ba54f8ef-0972-4ee4-b3e8-d33636032701" (UID: "ba54f8ef-0972-4ee4-b3e8-d33636032701"). InnerVolumeSpecName "dispersionconf". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:55:11 crc kubenswrapper[5120]: I0316 15:55:11.230511 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba54f8ef-0972-4ee4-b3e8-d33636032701-swiftconf" (OuterVolumeSpecName: "swiftconf") pod "ba54f8ef-0972-4ee4-b3e8-d33636032701" (UID: "ba54f8ef-0972-4ee4-b3e8-d33636032701"). InnerVolumeSpecName "swiftconf". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:55:11 crc kubenswrapper[5120]: I0316 15:55:11.231979 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba54f8ef-0972-4ee4-b3e8-d33636032701-scripts" (OuterVolumeSpecName: "scripts") pod "ba54f8ef-0972-4ee4-b3e8-d33636032701" (UID: "ba54f8ef-0972-4ee4-b3e8-d33636032701"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:55:11 crc kubenswrapper[5120]: I0316 15:55:11.247964 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba54f8ef-0972-4ee4-b3e8-d33636032701-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ba54f8ef-0972-4ee4-b3e8-d33636032701" (UID: "ba54f8ef-0972-4ee4-b3e8-d33636032701"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:55:11 crc kubenswrapper[5120]: I0316 15:55:11.307441 5120 reconciler_common.go:299] "Volume detached for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/ba54f8ef-0972-4ee4-b3e8-d33636032701-ring-data-devices\") on node \"crc\" DevicePath \"\"" Mar 16 15:55:11 crc kubenswrapper[5120]: I0316 15:55:11.307480 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ba54f8ef-0972-4ee4-b3e8-d33636032701-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:55:11 crc kubenswrapper[5120]: I0316 15:55:11.307492 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/ba54f8ef-0972-4ee4-b3e8-d33636032701-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 15:55:11 crc kubenswrapper[5120]: I0316 15:55:11.307503 5120 reconciler_common.go:299] "Volume detached for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/ba54f8ef-0972-4ee4-b3e8-d33636032701-swiftconf\") on node \"crc\" DevicePath \"\"" Mar 16 15:55:11 crc kubenswrapper[5120]: I0316 15:55:11.307514 5120 reconciler_common.go:299] "Volume detached for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/ba54f8ef-0972-4ee4-b3e8-d33636032701-dispersionconf\") on node \"crc\" DevicePath \"\"" Mar 16 15:55:11 crc kubenswrapper[5120]: I0316 15:55:11.307527 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jl8mz\" (UniqueName: \"kubernetes.io/projected/ba54f8ef-0972-4ee4-b3e8-d33636032701-kube-api-access-jl8mz\") on node \"crc\" DevicePath \"\"" Mar 16 15:55:11 crc kubenswrapper[5120]: I0316 15:55:11.307541 5120 reconciler_common.go:299] "Volume detached for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/ba54f8ef-0972-4ee4-b3e8-d33636032701-etc-swift\") on node \"crc\" DevicePath \"\"" Mar 16 15:55:11 crc kubenswrapper[5120]: I0316 15:55:11.639301 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-db-sync-mx7kq"] Mar 16 15:55:11 crc kubenswrapper[5120]: I0316 15:55:11.644168 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43739814-c000-496f-bbfa-840c9297c136" containerName="mariadb-database-create" Mar 16 15:55:11 crc kubenswrapper[5120]: I0316 15:55:11.644415 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="43739814-c000-496f-bbfa-840c9297c136" containerName="mariadb-database-create" Mar 16 15:55:11 crc kubenswrapper[5120]: I0316 15:55:11.644644 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba54f8ef-0972-4ee4-b3e8-d33636032701" containerName="swift-ring-rebalance" Mar 16 15:55:11 crc kubenswrapper[5120]: I0316 15:55:11.644870 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba54f8ef-0972-4ee4-b3e8-d33636032701" containerName="swift-ring-rebalance" Mar 16 15:55:11 crc kubenswrapper[5120]: I0316 15:55:11.645159 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="613105e4-7e4e-41ad-adfa-de8fa43b93f2" containerName="mariadb-account-create-update" Mar 16 15:55:11 crc kubenswrapper[5120]: I0316 15:55:11.645320 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="613105e4-7e4e-41ad-adfa-de8fa43b93f2" containerName="mariadb-account-create-update" Mar 16 15:55:11 crc kubenswrapper[5120]: I0316 15:55:11.645588 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20e5c33a-5083-4223-afba-110b1297b222" containerName="mariadb-account-create-update" Mar 16 15:55:11 crc kubenswrapper[5120]: I0316 15:55:11.645750 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="20e5c33a-5083-4223-afba-110b1297b222" containerName="mariadb-account-create-update" Mar 16 15:55:11 crc kubenswrapper[5120]: I0316 15:55:11.646459 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="43739814-c000-496f-bbfa-840c9297c136" containerName="mariadb-database-create" Mar 16 15:55:11 crc kubenswrapper[5120]: I0316 15:55:11.646754 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="613105e4-7e4e-41ad-adfa-de8fa43b93f2" containerName="mariadb-account-create-update" Mar 16 15:55:11 crc kubenswrapper[5120]: I0316 15:55:11.646986 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ba54f8ef-0972-4ee4-b3e8-d33636032701" containerName="swift-ring-rebalance" Mar 16 15:55:11 crc kubenswrapper[5120]: I0316 15:55:11.647148 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="20e5c33a-5083-4223-afba-110b1297b222" containerName="mariadb-account-create-update" Mar 16 15:55:11 crc kubenswrapper[5120]: I0316 15:55:11.657036 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-mx7kq"] Mar 16 15:55:11 crc kubenswrapper[5120]: I0316 15:55:11.657085 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-4zt99" event={"ID":"ba54f8ef-0972-4ee4-b3e8-d33636032701","Type":"ContainerDied","Data":"1eee1207b72580af2748ca7f6b4039c59b8d16b596f73ba727fd72dcdd6ef884"} Mar 16 15:55:11 crc kubenswrapper[5120]: I0316 15:55:11.657121 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1eee1207b72580af2748ca7f6b4039c59b8d16b596f73ba727fd72dcdd6ef884" Mar 16 15:55:11 crc kubenswrapper[5120]: I0316 15:55:11.657192 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-mx7kq" Mar 16 15:55:11 crc kubenswrapper[5120]: I0316 15:55:11.657627 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-4zt99" Mar 16 15:55:11 crc kubenswrapper[5120]: I0316 15:55:11.661058 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-config-data\"" Mar 16 15:55:11 crc kubenswrapper[5120]: I0316 15:55:11.663232 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-glance-dockercfg-mkhxb\"" Mar 16 15:55:11 crc kubenswrapper[5120]: I0316 15:55:11.725637 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bf2e272a-e1d5-4e5f-b5a0-5865cd23bdde-combined-ca-bundle\") pod \"glance-db-sync-mx7kq\" (UID: \"bf2e272a-e1d5-4e5f-b5a0-5865cd23bdde\") " pod="openstack-kuttl-tests/glance-db-sync-mx7kq" Mar 16 15:55:11 crc kubenswrapper[5120]: I0316 15:55:11.727937 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8p2s\" (UniqueName: \"kubernetes.io/projected/bf2e272a-e1d5-4e5f-b5a0-5865cd23bdde-kube-api-access-h8p2s\") pod \"glance-db-sync-mx7kq\" (UID: \"bf2e272a-e1d5-4e5f-b5a0-5865cd23bdde\") " pod="openstack-kuttl-tests/glance-db-sync-mx7kq" Mar 16 15:55:11 crc kubenswrapper[5120]: I0316 15:55:11.728122 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bf2e272a-e1d5-4e5f-b5a0-5865cd23bdde-config-data\") pod \"glance-db-sync-mx7kq\" (UID: \"bf2e272a-e1d5-4e5f-b5a0-5865cd23bdde\") " pod="openstack-kuttl-tests/glance-db-sync-mx7kq" Mar 16 15:55:11 crc kubenswrapper[5120]: I0316 15:55:11.731122 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/bf2e272a-e1d5-4e5f-b5a0-5865cd23bdde-db-sync-config-data\") pod \"glance-db-sync-mx7kq\" (UID: \"bf2e272a-e1d5-4e5f-b5a0-5865cd23bdde\") " pod="openstack-kuttl-tests/glance-db-sync-mx7kq" Mar 16 15:55:11 crc kubenswrapper[5120]: I0316 15:55:11.833317 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h8p2s\" (UniqueName: \"kubernetes.io/projected/bf2e272a-e1d5-4e5f-b5a0-5865cd23bdde-kube-api-access-h8p2s\") pod \"glance-db-sync-mx7kq\" (UID: \"bf2e272a-e1d5-4e5f-b5a0-5865cd23bdde\") " pod="openstack-kuttl-tests/glance-db-sync-mx7kq" Mar 16 15:55:11 crc kubenswrapper[5120]: I0316 15:55:11.833382 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bf2e272a-e1d5-4e5f-b5a0-5865cd23bdde-config-data\") pod \"glance-db-sync-mx7kq\" (UID: \"bf2e272a-e1d5-4e5f-b5a0-5865cd23bdde\") " pod="openstack-kuttl-tests/glance-db-sync-mx7kq" Mar 16 15:55:11 crc kubenswrapper[5120]: I0316 15:55:11.833509 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/bf2e272a-e1d5-4e5f-b5a0-5865cd23bdde-db-sync-config-data\") pod \"glance-db-sync-mx7kq\" (UID: \"bf2e272a-e1d5-4e5f-b5a0-5865cd23bdde\") " pod="openstack-kuttl-tests/glance-db-sync-mx7kq" Mar 16 15:55:11 crc kubenswrapper[5120]: I0316 15:55:11.833563 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bf2e272a-e1d5-4e5f-b5a0-5865cd23bdde-combined-ca-bundle\") pod \"glance-db-sync-mx7kq\" (UID: \"bf2e272a-e1d5-4e5f-b5a0-5865cd23bdde\") " pod="openstack-kuttl-tests/glance-db-sync-mx7kq" Mar 16 15:55:11 crc kubenswrapper[5120]: I0316 15:55:11.840029 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bf2e272a-e1d5-4e5f-b5a0-5865cd23bdde-combined-ca-bundle\") pod \"glance-db-sync-mx7kq\" (UID: \"bf2e272a-e1d5-4e5f-b5a0-5865cd23bdde\") " pod="openstack-kuttl-tests/glance-db-sync-mx7kq" Mar 16 15:55:11 crc kubenswrapper[5120]: I0316 15:55:11.840033 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bf2e272a-e1d5-4e5f-b5a0-5865cd23bdde-config-data\") pod \"glance-db-sync-mx7kq\" (UID: \"bf2e272a-e1d5-4e5f-b5a0-5865cd23bdde\") " pod="openstack-kuttl-tests/glance-db-sync-mx7kq" Mar 16 15:55:11 crc kubenswrapper[5120]: I0316 15:55:11.840421 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/bf2e272a-e1d5-4e5f-b5a0-5865cd23bdde-db-sync-config-data\") pod \"glance-db-sync-mx7kq\" (UID: \"bf2e272a-e1d5-4e5f-b5a0-5865cd23bdde\") " pod="openstack-kuttl-tests/glance-db-sync-mx7kq" Mar 16 15:55:11 crc kubenswrapper[5120]: I0316 15:55:11.853178 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8p2s\" (UniqueName: \"kubernetes.io/projected/bf2e272a-e1d5-4e5f-b5a0-5865cd23bdde-kube-api-access-h8p2s\") pod \"glance-db-sync-mx7kq\" (UID: \"bf2e272a-e1d5-4e5f-b5a0-5865cd23bdde\") " pod="openstack-kuttl-tests/glance-db-sync-mx7kq" Mar 16 15:55:11 crc kubenswrapper[5120]: I0316 15:55:11.976453 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-mx7kq" Mar 16 15:55:12 crc kubenswrapper[5120]: I0316 15:55:12.174983 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-n5rqj"] Mar 16 15:55:12 crc kubenswrapper[5120]: I0316 15:55:12.182132 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-n5rqj"] Mar 16 15:55:12 crc kubenswrapper[5120]: I0316 15:55:12.555053 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-mx7kq"] Mar 16 15:55:12 crc kubenswrapper[5120]: I0316 15:55:12.689529 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="20e5c33a-5083-4223-afba-110b1297b222" path="/var/lib/kubelet/pods/20e5c33a-5083-4223-afba-110b1297b222/volumes" Mar 16 15:55:12 crc kubenswrapper[5120]: I0316 15:55:12.690503 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-mx7kq" event={"ID":"bf2e272a-e1d5-4e5f-b5a0-5865cd23bdde","Type":"ContainerStarted","Data":"e50409184b7f2f68ec84bbe8237f8601b40ae093931009d4f6ca2973a4ad8fda"} Mar 16 15:55:13 crc kubenswrapper[5120]: I0316 15:55:13.703098 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-mx7kq" event={"ID":"bf2e272a-e1d5-4e5f-b5a0-5865cd23bdde","Type":"ContainerStarted","Data":"b8bfaaad691683435144338170552fbffc891d60b767e0b3cbcbf011b8c3019d"} Mar 16 15:55:13 crc kubenswrapper[5120]: I0316 15:55:13.725607 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-db-sync-mx7kq" podStartSLOduration=2.72558141 podStartE2EDuration="2.72558141s" podCreationTimestamp="2026-03-16 15:55:11 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:55:13.723677707 +0000 UTC m=+1415.877609374" watchObservedRunningTime="2026-03-16 15:55:13.72558141 +0000 UTC m=+1415.879513097" Mar 16 15:55:16 crc kubenswrapper[5120]: I0316 15:55:16.738688 5120 generic.go:358] "Generic (PLEG): container finished" podID="bf2e272a-e1d5-4e5f-b5a0-5865cd23bdde" containerID="b8bfaaad691683435144338170552fbffc891d60b767e0b3cbcbf011b8c3019d" exitCode=0 Mar 16 15:55:16 crc kubenswrapper[5120]: I0316 15:55:16.738824 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-mx7kq" event={"ID":"bf2e272a-e1d5-4e5f-b5a0-5865cd23bdde","Type":"ContainerDied","Data":"b8bfaaad691683435144338170552fbffc891d60b767e0b3cbcbf011b8c3019d"} Mar 16 15:55:16 crc kubenswrapper[5120]: I0316 15:55:16.957044 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/725b915c-7c39-43e6-8022-99dd14a6276e-etc-swift\") pod \"swift-storage-0\" (UID: \"725b915c-7c39-43e6-8022-99dd14a6276e\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 15:55:16 crc kubenswrapper[5120]: I0316 15:55:16.965293 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/725b915c-7c39-43e6-8022-99dd14a6276e-etc-swift\") pod \"swift-storage-0\" (UID: \"725b915c-7c39-43e6-8022-99dd14a6276e\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 15:55:17 crc kubenswrapper[5120]: I0316 15:55:17.103298 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Mar 16 15:55:17 crc kubenswrapper[5120]: I0316 15:55:17.207964 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/root-account-create-update-4tnnd"] Mar 16 15:55:17 crc kubenswrapper[5120]: I0316 15:55:17.217390 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-4tnnd" Mar 16 15:55:17 crc kubenswrapper[5120]: I0316 15:55:17.223206 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-4tnnd"] Mar 16 15:55:17 crc kubenswrapper[5120]: I0316 15:55:17.224164 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"openstack-cell1-mariadb-root-db-secret\"" Mar 16 15:55:17 crc kubenswrapper[5120]: I0316 15:55:17.374211 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/6cf8526c-e5de-4dec-abde-91cbf192288d-operator-scripts\") pod \"root-account-create-update-4tnnd\" (UID: \"6cf8526c-e5de-4dec-abde-91cbf192288d\") " pod="openstack-kuttl-tests/root-account-create-update-4tnnd" Mar 16 15:55:17 crc kubenswrapper[5120]: I0316 15:55:17.374294 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snpx9\" (UniqueName: \"kubernetes.io/projected/6cf8526c-e5de-4dec-abde-91cbf192288d-kube-api-access-snpx9\") pod \"root-account-create-update-4tnnd\" (UID: \"6cf8526c-e5de-4dec-abde-91cbf192288d\") " pod="openstack-kuttl-tests/root-account-create-update-4tnnd" Mar 16 15:55:17 crc kubenswrapper[5120]: I0316 15:55:17.475319 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/6cf8526c-e5de-4dec-abde-91cbf192288d-operator-scripts\") pod \"root-account-create-update-4tnnd\" (UID: \"6cf8526c-e5de-4dec-abde-91cbf192288d\") " pod="openstack-kuttl-tests/root-account-create-update-4tnnd" Mar 16 15:55:17 crc kubenswrapper[5120]: I0316 15:55:17.475373 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-snpx9\" (UniqueName: \"kubernetes.io/projected/6cf8526c-e5de-4dec-abde-91cbf192288d-kube-api-access-snpx9\") pod \"root-account-create-update-4tnnd\" (UID: \"6cf8526c-e5de-4dec-abde-91cbf192288d\") " pod="openstack-kuttl-tests/root-account-create-update-4tnnd" Mar 16 15:55:17 crc kubenswrapper[5120]: I0316 15:55:17.476333 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/6cf8526c-e5de-4dec-abde-91cbf192288d-operator-scripts\") pod \"root-account-create-update-4tnnd\" (UID: \"6cf8526c-e5de-4dec-abde-91cbf192288d\") " pod="openstack-kuttl-tests/root-account-create-update-4tnnd" Mar 16 15:55:17 crc kubenswrapper[5120]: I0316 15:55:17.494607 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-snpx9\" (UniqueName: \"kubernetes.io/projected/6cf8526c-e5de-4dec-abde-91cbf192288d-kube-api-access-snpx9\") pod \"root-account-create-update-4tnnd\" (UID: \"6cf8526c-e5de-4dec-abde-91cbf192288d\") " pod="openstack-kuttl-tests/root-account-create-update-4tnnd" Mar 16 15:55:17 crc kubenswrapper[5120]: I0316 15:55:17.571943 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-4tnnd" Mar 16 15:55:17 crc kubenswrapper[5120]: I0316 15:55:17.692153 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 15:55:17 crc kubenswrapper[5120]: W0316 15:55:17.709107 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod725b915c_7c39_43e6_8022_99dd14a6276e.slice/crio-604e609ff8ed1901fbdfc758a07c8cf4abbc7b3557bf864bb6b8532d73b01341 WatchSource:0}: Error finding container 604e609ff8ed1901fbdfc758a07c8cf4abbc7b3557bf864bb6b8532d73b01341: Status 404 returned error can't find the container with id 604e609ff8ed1901fbdfc758a07c8cf4abbc7b3557bf864bb6b8532d73b01341 Mar 16 15:55:17 crc kubenswrapper[5120]: I0316 15:55:17.751918 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"725b915c-7c39-43e6-8022-99dd14a6276e","Type":"ContainerStarted","Data":"604e609ff8ed1901fbdfc758a07c8cf4abbc7b3557bf864bb6b8532d73b01341"} Mar 16 15:55:18 crc kubenswrapper[5120]: I0316 15:55:18.051266 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-4tnnd"] Mar 16 15:55:18 crc kubenswrapper[5120]: I0316 15:55:18.203732 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-mx7kq" Mar 16 15:55:18 crc kubenswrapper[5120]: I0316 15:55:18.294957 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bf2e272a-e1d5-4e5f-b5a0-5865cd23bdde-config-data\") pod \"bf2e272a-e1d5-4e5f-b5a0-5865cd23bdde\" (UID: \"bf2e272a-e1d5-4e5f-b5a0-5865cd23bdde\") " Mar 16 15:55:18 crc kubenswrapper[5120]: I0316 15:55:18.295037 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bf2e272a-e1d5-4e5f-b5a0-5865cd23bdde-combined-ca-bundle\") pod \"bf2e272a-e1d5-4e5f-b5a0-5865cd23bdde\" (UID: \"bf2e272a-e1d5-4e5f-b5a0-5865cd23bdde\") " Mar 16 15:55:18 crc kubenswrapper[5120]: I0316 15:55:18.295098 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h8p2s\" (UniqueName: \"kubernetes.io/projected/bf2e272a-e1d5-4e5f-b5a0-5865cd23bdde-kube-api-access-h8p2s\") pod \"bf2e272a-e1d5-4e5f-b5a0-5865cd23bdde\" (UID: \"bf2e272a-e1d5-4e5f-b5a0-5865cd23bdde\") " Mar 16 15:55:18 crc kubenswrapper[5120]: I0316 15:55:18.297177 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/bf2e272a-e1d5-4e5f-b5a0-5865cd23bdde-db-sync-config-data\") pod \"bf2e272a-e1d5-4e5f-b5a0-5865cd23bdde\" (UID: \"bf2e272a-e1d5-4e5f-b5a0-5865cd23bdde\") " Mar 16 15:55:18 crc kubenswrapper[5120]: I0316 15:55:18.303762 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bf2e272a-e1d5-4e5f-b5a0-5865cd23bdde-db-sync-config-data" (OuterVolumeSpecName: "db-sync-config-data") pod "bf2e272a-e1d5-4e5f-b5a0-5865cd23bdde" (UID: "bf2e272a-e1d5-4e5f-b5a0-5865cd23bdde"). InnerVolumeSpecName "db-sync-config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:55:18 crc kubenswrapper[5120]: I0316 15:55:18.304497 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf2e272a-e1d5-4e5f-b5a0-5865cd23bdde-kube-api-access-h8p2s" (OuterVolumeSpecName: "kube-api-access-h8p2s") pod "bf2e272a-e1d5-4e5f-b5a0-5865cd23bdde" (UID: "bf2e272a-e1d5-4e5f-b5a0-5865cd23bdde"). InnerVolumeSpecName "kube-api-access-h8p2s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:55:18 crc kubenswrapper[5120]: I0316 15:55:18.341920 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bf2e272a-e1d5-4e5f-b5a0-5865cd23bdde-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "bf2e272a-e1d5-4e5f-b5a0-5865cd23bdde" (UID: "bf2e272a-e1d5-4e5f-b5a0-5865cd23bdde"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:55:18 crc kubenswrapper[5120]: I0316 15:55:18.369099 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bf2e272a-e1d5-4e5f-b5a0-5865cd23bdde-config-data" (OuterVolumeSpecName: "config-data") pod "bf2e272a-e1d5-4e5f-b5a0-5865cd23bdde" (UID: "bf2e272a-e1d5-4e5f-b5a0-5865cd23bdde"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:55:18 crc kubenswrapper[5120]: I0316 15:55:18.401239 5120 reconciler_common.go:299] "Volume detached for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/bf2e272a-e1d5-4e5f-b5a0-5865cd23bdde-db-sync-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 15:55:18 crc kubenswrapper[5120]: I0316 15:55:18.401293 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bf2e272a-e1d5-4e5f-b5a0-5865cd23bdde-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 15:55:18 crc kubenswrapper[5120]: I0316 15:55:18.401308 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bf2e272a-e1d5-4e5f-b5a0-5865cd23bdde-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:55:18 crc kubenswrapper[5120]: I0316 15:55:18.401321 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h8p2s\" (UniqueName: \"kubernetes.io/projected/bf2e272a-e1d5-4e5f-b5a0-5865cd23bdde-kube-api-access-h8p2s\") on node \"crc\" DevicePath \"\"" Mar 16 15:55:18 crc kubenswrapper[5120]: I0316 15:55:18.684836 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 15:55:18 crc kubenswrapper[5120]: I0316 15:55:18.767809 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"725b915c-7c39-43e6-8022-99dd14a6276e","Type":"ContainerStarted","Data":"71b59b87818e9c61e2898baf97bfa1f6e0a18889a07c5b10bca12a35e6a5d59a"} Mar 16 15:55:18 crc kubenswrapper[5120]: I0316 15:55:18.767877 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"725b915c-7c39-43e6-8022-99dd14a6276e","Type":"ContainerStarted","Data":"262cd591bf64204d3ae5dd293546fa23e41d083f4d36ea5ae8c2081db5fe77fe"} Mar 16 15:55:18 crc kubenswrapper[5120]: I0316 15:55:18.767893 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"725b915c-7c39-43e6-8022-99dd14a6276e","Type":"ContainerStarted","Data":"77ec9324e0dbe58ae4b2dc527047287f83714d98ac52687796abd8b39e40a66b"} Mar 16 15:55:18 crc kubenswrapper[5120]: I0316 15:55:18.767904 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"725b915c-7c39-43e6-8022-99dd14a6276e","Type":"ContainerStarted","Data":"9065435fa0cbe38d798b7f599f263612ad1337c636838785105247be4e64c3c8"} Mar 16 15:55:18 crc kubenswrapper[5120]: I0316 15:55:18.770460 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-mx7kq" event={"ID":"bf2e272a-e1d5-4e5f-b5a0-5865cd23bdde","Type":"ContainerDied","Data":"e50409184b7f2f68ec84bbe8237f8601b40ae093931009d4f6ca2973a4ad8fda"} Mar 16 15:55:18 crc kubenswrapper[5120]: I0316 15:55:18.770502 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e50409184b7f2f68ec84bbe8237f8601b40ae093931009d4f6ca2973a4ad8fda" Mar 16 15:55:18 crc kubenswrapper[5120]: I0316 15:55:18.770797 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-mx7kq" Mar 16 15:55:18 crc kubenswrapper[5120]: I0316 15:55:18.776001 5120 generic.go:358] "Generic (PLEG): container finished" podID="6cf8526c-e5de-4dec-abde-91cbf192288d" containerID="03426e9d23e26f23f7d0a18b7532a8972a451da3596cf94f5f2146602b0aa95d" exitCode=0 Mar 16 15:55:18 crc kubenswrapper[5120]: I0316 15:55:18.776064 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-4tnnd" event={"ID":"6cf8526c-e5de-4dec-abde-91cbf192288d","Type":"ContainerDied","Data":"03426e9d23e26f23f7d0a18b7532a8972a451da3596cf94f5f2146602b0aa95d"} Mar 16 15:55:18 crc kubenswrapper[5120]: I0316 15:55:18.776098 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-4tnnd" event={"ID":"6cf8526c-e5de-4dec-abde-91cbf192288d","Type":"ContainerStarted","Data":"dc393d037b404d46986787992b175d68b34b615992936aa78aa03dea63848a15"} Mar 16 15:55:19 crc kubenswrapper[5120]: I0316 15:55:19.789517 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"725b915c-7c39-43e6-8022-99dd14a6276e","Type":"ContainerStarted","Data":"e1e5609b43f9503028b31e0b3fda895e40ba4838567fb814822286e0b240187c"} Mar 16 15:55:19 crc kubenswrapper[5120]: I0316 15:55:19.789948 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"725b915c-7c39-43e6-8022-99dd14a6276e","Type":"ContainerStarted","Data":"d3bcc1b7fd9e76c63c4579009f6a561f9ea39189bb67757e6ad92647e3d5cc00"} Mar 16 15:55:19 crc kubenswrapper[5120]: I0316 15:55:19.789962 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"725b915c-7c39-43e6-8022-99dd14a6276e","Type":"ContainerStarted","Data":"45e2db9f2a2c31aac9bb2521e7a03b67f75500e9406349b0edc7767c1c3632f2"} Mar 16 15:55:19 crc kubenswrapper[5120]: I0316 15:55:19.789974 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"725b915c-7c39-43e6-8022-99dd14a6276e","Type":"ContainerStarted","Data":"66d0d042587258a65188efea26738d109ef3471c78ed22bfed7030925260d9b8"} Mar 16 15:55:19 crc kubenswrapper[5120]: I0316 15:55:19.791336 5120 generic.go:358] "Generic (PLEG): container finished" podID="b6cf92fd-a58b-4b50-9a61-35486c401d72" containerID="dc1ea3d63cb3c9a3449a18594ba679f9478d78eeb79482b58b07bf529b9454bc" exitCode=0 Mar 16 15:55:19 crc kubenswrapper[5120]: I0316 15:55:19.791431 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"b6cf92fd-a58b-4b50-9a61-35486c401d72","Type":"ContainerDied","Data":"dc1ea3d63cb3c9a3449a18594ba679f9478d78eeb79482b58b07bf529b9454bc"} Mar 16 15:55:19 crc kubenswrapper[5120]: I0316 15:55:19.803301 5120 generic.go:358] "Generic (PLEG): container finished" podID="492ba9f3-6479-432b-a2f4-cee712a51800" containerID="cc516c998df4368da23b745b2b3be8bba3d29335ec841cf7ca6fe843c277d2db" exitCode=0 Mar 16 15:55:19 crc kubenswrapper[5120]: I0316 15:55:19.803656 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"492ba9f3-6479-432b-a2f4-cee712a51800","Type":"ContainerDied","Data":"cc516c998df4368da23b745b2b3be8bba3d29335ec841cf7ca6fe843c277d2db"} Mar 16 15:55:20 crc kubenswrapper[5120]: I0316 15:55:20.254171 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-4tnnd" Mar 16 15:55:20 crc kubenswrapper[5120]: I0316 15:55:20.343940 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-snpx9\" (UniqueName: \"kubernetes.io/projected/6cf8526c-e5de-4dec-abde-91cbf192288d-kube-api-access-snpx9\") pod \"6cf8526c-e5de-4dec-abde-91cbf192288d\" (UID: \"6cf8526c-e5de-4dec-abde-91cbf192288d\") " Mar 16 15:55:20 crc kubenswrapper[5120]: I0316 15:55:20.344202 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/6cf8526c-e5de-4dec-abde-91cbf192288d-operator-scripts\") pod \"6cf8526c-e5de-4dec-abde-91cbf192288d\" (UID: \"6cf8526c-e5de-4dec-abde-91cbf192288d\") " Mar 16 15:55:20 crc kubenswrapper[5120]: I0316 15:55:20.345007 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6cf8526c-e5de-4dec-abde-91cbf192288d-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "6cf8526c-e5de-4dec-abde-91cbf192288d" (UID: "6cf8526c-e5de-4dec-abde-91cbf192288d"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:55:20 crc kubenswrapper[5120]: I0316 15:55:20.364453 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6cf8526c-e5de-4dec-abde-91cbf192288d-kube-api-access-snpx9" (OuterVolumeSpecName: "kube-api-access-snpx9") pod "6cf8526c-e5de-4dec-abde-91cbf192288d" (UID: "6cf8526c-e5de-4dec-abde-91cbf192288d"). InnerVolumeSpecName "kube-api-access-snpx9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:55:20 crc kubenswrapper[5120]: I0316 15:55:20.446056 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/6cf8526c-e5de-4dec-abde-91cbf192288d-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 15:55:20 crc kubenswrapper[5120]: I0316 15:55:20.446084 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-snpx9\" (UniqueName: \"kubernetes.io/projected/6cf8526c-e5de-4dec-abde-91cbf192288d-kube-api-access-snpx9\") on node \"crc\" DevicePath \"\"" Mar 16 15:55:20 crc kubenswrapper[5120]: I0316 15:55:20.828304 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"725b915c-7c39-43e6-8022-99dd14a6276e","Type":"ContainerStarted","Data":"762a260277f80c61150c72c781fdfadc157f11b49e278f6b091fc4317e1db456"} Mar 16 15:55:20 crc kubenswrapper[5120]: I0316 15:55:20.828350 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"725b915c-7c39-43e6-8022-99dd14a6276e","Type":"ContainerStarted","Data":"028ca00d7f3a02e0498607bc597f8a8dc18ccbcd5f27da0dbecccbdd32f01b06"} Mar 16 15:55:20 crc kubenswrapper[5120]: I0316 15:55:20.828360 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"725b915c-7c39-43e6-8022-99dd14a6276e","Type":"ContainerStarted","Data":"1e0c2e403fa140b74e5d0d79126181003e5bd471fd02d918d968352af679aa6b"} Mar 16 15:55:20 crc kubenswrapper[5120]: I0316 15:55:20.828369 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"725b915c-7c39-43e6-8022-99dd14a6276e","Type":"ContainerStarted","Data":"fc8047922b83c19ce5ee5cd59a92fb79edc337b663b0951d81347220713d144a"} Mar 16 15:55:20 crc kubenswrapper[5120]: I0316 15:55:20.828378 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"725b915c-7c39-43e6-8022-99dd14a6276e","Type":"ContainerStarted","Data":"381f5f488e15fab4b3389a7f56848e0549ffa22667f27135f0a5d27a2b9b593e"} Mar 16 15:55:20 crc kubenswrapper[5120]: I0316 15:55:20.828386 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"725b915c-7c39-43e6-8022-99dd14a6276e","Type":"ContainerStarted","Data":"9b91d7507fff9e107013c39056e451ffe12795d6ae267b2ef0a816bc5e272d34"} Mar 16 15:55:20 crc kubenswrapper[5120]: I0316 15:55:20.832241 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"b6cf92fd-a58b-4b50-9a61-35486c401d72","Type":"ContainerStarted","Data":"8f995598e1e74ed1367783ec0b36f25d55ac74ba4980ad5bce48d0ab5392311e"} Mar 16 15:55:20 crc kubenswrapper[5120]: I0316 15:55:20.832646 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 15:55:20 crc kubenswrapper[5120]: I0316 15:55:20.834649 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-4tnnd" event={"ID":"6cf8526c-e5de-4dec-abde-91cbf192288d","Type":"ContainerDied","Data":"dc393d037b404d46986787992b175d68b34b615992936aa78aa03dea63848a15"} Mar 16 15:55:20 crc kubenswrapper[5120]: I0316 15:55:20.834685 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dc393d037b404d46986787992b175d68b34b615992936aa78aa03dea63848a15" Mar 16 15:55:20 crc kubenswrapper[5120]: I0316 15:55:20.834751 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-4tnnd" Mar 16 15:55:20 crc kubenswrapper[5120]: I0316 15:55:20.837963 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"492ba9f3-6479-432b-a2f4-cee712a51800","Type":"ContainerStarted","Data":"b3ca6adfc0432b1a1565a9b61882489441af5da7f78d4fb022760226ebb1dd18"} Mar 16 15:55:20 crc kubenswrapper[5120]: I0316 15:55:20.838249 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 15:55:20 crc kubenswrapper[5120]: I0316 15:55:20.861508 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/rabbitmq-server-0" podStartSLOduration=37.861489416 podStartE2EDuration="37.861489416s" podCreationTimestamp="2026-03-16 15:54:43 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:55:20.860151739 +0000 UTC m=+1423.014083406" watchObservedRunningTime="2026-03-16 15:55:20.861489416 +0000 UTC m=+1423.015421073" Mar 16 15:55:20 crc kubenswrapper[5120]: I0316 15:55:20.887830 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" podStartSLOduration=36.887813555 podStartE2EDuration="36.887813555s" podCreationTimestamp="2026-03-16 15:54:44 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:55:20.886188521 +0000 UTC m=+1423.040120178" watchObservedRunningTime="2026-03-16 15:55:20.887813555 +0000 UTC m=+1423.041745212" Mar 16 15:55:21 crc kubenswrapper[5120]: I0316 15:55:21.855590 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"725b915c-7c39-43e6-8022-99dd14a6276e","Type":"ContainerStarted","Data":"cb14563bca03394263c85e9a7621fecb106a313ab5894f960695d9bba681a3c8"} Mar 16 15:55:21 crc kubenswrapper[5120]: I0316 15:55:21.894196 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/swift-storage-0" podStartSLOduration=21.894172379 podStartE2EDuration="21.894172379s" podCreationTimestamp="2026-03-16 15:55:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:55:21.885965342 +0000 UTC m=+1424.039896999" watchObservedRunningTime="2026-03-16 15:55:21.894172379 +0000 UTC m=+1424.048104046" Mar 16 15:55:22 crc kubenswrapper[5120]: I0316 15:55:22.049787 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-7b9947885c-scjh2"] Mar 16 15:55:22 crc kubenswrapper[5120]: I0316 15:55:22.050616 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf2e272a-e1d5-4e5f-b5a0-5865cd23bdde" containerName="glance-db-sync" Mar 16 15:55:22 crc kubenswrapper[5120]: I0316 15:55:22.050634 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf2e272a-e1d5-4e5f-b5a0-5865cd23bdde" containerName="glance-db-sync" Mar 16 15:55:22 crc kubenswrapper[5120]: I0316 15:55:22.050664 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6cf8526c-e5de-4dec-abde-91cbf192288d" containerName="mariadb-account-create-update" Mar 16 15:55:22 crc kubenswrapper[5120]: I0316 15:55:22.050672 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="6cf8526c-e5de-4dec-abde-91cbf192288d" containerName="mariadb-account-create-update" Mar 16 15:55:22 crc kubenswrapper[5120]: I0316 15:55:22.050828 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="bf2e272a-e1d5-4e5f-b5a0-5865cd23bdde" containerName="glance-db-sync" Mar 16 15:55:22 crc kubenswrapper[5120]: I0316 15:55:22.050844 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="6cf8526c-e5de-4dec-abde-91cbf192288d" containerName="mariadb-account-create-update" Mar 16 15:55:22 crc kubenswrapper[5120]: I0316 15:55:22.056598 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7b9947885c-scjh2" Mar 16 15:55:22 crc kubenswrapper[5120]: I0316 15:55:22.059689 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"dns-swift-storage-0\"" Mar 16 15:55:22 crc kubenswrapper[5120]: I0316 15:55:22.064427 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-7b9947885c-scjh2"] Mar 16 15:55:22 crc kubenswrapper[5120]: I0316 15:55:22.071072 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/6f390644-a67b-42f8-b1d7-f8debbfee112-dns-swift-storage-0\") pod \"dnsmasq-dnsmasq-7b9947885c-scjh2\" (UID: \"6f390644-a67b-42f8-b1d7-f8debbfee112\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7b9947885c-scjh2" Mar 16 15:55:22 crc kubenswrapper[5120]: I0316 15:55:22.071109 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6f390644-a67b-42f8-b1d7-f8debbfee112-config\") pod \"dnsmasq-dnsmasq-7b9947885c-scjh2\" (UID: \"6f390644-a67b-42f8-b1d7-f8debbfee112\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7b9947885c-scjh2" Mar 16 15:55:22 crc kubenswrapper[5120]: I0316 15:55:22.071155 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/6f390644-a67b-42f8-b1d7-f8debbfee112-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-7b9947885c-scjh2\" (UID: \"6f390644-a67b-42f8-b1d7-f8debbfee112\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7b9947885c-scjh2" Mar 16 15:55:22 crc kubenswrapper[5120]: I0316 15:55:22.071206 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4thsk\" (UniqueName: \"kubernetes.io/projected/6f390644-a67b-42f8-b1d7-f8debbfee112-kube-api-access-4thsk\") pod \"dnsmasq-dnsmasq-7b9947885c-scjh2\" (UID: \"6f390644-a67b-42f8-b1d7-f8debbfee112\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7b9947885c-scjh2" Mar 16 15:55:22 crc kubenswrapper[5120]: I0316 15:55:22.172500 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/6f390644-a67b-42f8-b1d7-f8debbfee112-dns-swift-storage-0\") pod \"dnsmasq-dnsmasq-7b9947885c-scjh2\" (UID: \"6f390644-a67b-42f8-b1d7-f8debbfee112\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7b9947885c-scjh2" Mar 16 15:55:22 crc kubenswrapper[5120]: I0316 15:55:22.172580 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6f390644-a67b-42f8-b1d7-f8debbfee112-config\") pod \"dnsmasq-dnsmasq-7b9947885c-scjh2\" (UID: \"6f390644-a67b-42f8-b1d7-f8debbfee112\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7b9947885c-scjh2" Mar 16 15:55:22 crc kubenswrapper[5120]: I0316 15:55:22.172680 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/6f390644-a67b-42f8-b1d7-f8debbfee112-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-7b9947885c-scjh2\" (UID: \"6f390644-a67b-42f8-b1d7-f8debbfee112\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7b9947885c-scjh2" Mar 16 15:55:22 crc kubenswrapper[5120]: I0316 15:55:22.172797 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4thsk\" (UniqueName: \"kubernetes.io/projected/6f390644-a67b-42f8-b1d7-f8debbfee112-kube-api-access-4thsk\") pod \"dnsmasq-dnsmasq-7b9947885c-scjh2\" (UID: \"6f390644-a67b-42f8-b1d7-f8debbfee112\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7b9947885c-scjh2" Mar 16 15:55:22 crc kubenswrapper[5120]: I0316 15:55:22.174140 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/6f390644-a67b-42f8-b1d7-f8debbfee112-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-7b9947885c-scjh2\" (UID: \"6f390644-a67b-42f8-b1d7-f8debbfee112\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7b9947885c-scjh2" Mar 16 15:55:22 crc kubenswrapper[5120]: I0316 15:55:22.174260 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6f390644-a67b-42f8-b1d7-f8debbfee112-config\") pod \"dnsmasq-dnsmasq-7b9947885c-scjh2\" (UID: \"6f390644-a67b-42f8-b1d7-f8debbfee112\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7b9947885c-scjh2" Mar 16 15:55:22 crc kubenswrapper[5120]: I0316 15:55:22.174524 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/6f390644-a67b-42f8-b1d7-f8debbfee112-dns-swift-storage-0\") pod \"dnsmasq-dnsmasq-7b9947885c-scjh2\" (UID: \"6f390644-a67b-42f8-b1d7-f8debbfee112\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7b9947885c-scjh2" Mar 16 15:55:22 crc kubenswrapper[5120]: I0316 15:55:22.198887 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4thsk\" (UniqueName: \"kubernetes.io/projected/6f390644-a67b-42f8-b1d7-f8debbfee112-kube-api-access-4thsk\") pod \"dnsmasq-dnsmasq-7b9947885c-scjh2\" (UID: \"6f390644-a67b-42f8-b1d7-f8debbfee112\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7b9947885c-scjh2" Mar 16 15:55:22 crc kubenswrapper[5120]: I0316 15:55:22.376000 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7b9947885c-scjh2" Mar 16 15:55:22 crc kubenswrapper[5120]: I0316 15:55:22.927247 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-7b9947885c-scjh2"] Mar 16 15:55:23 crc kubenswrapper[5120]: I0316 15:55:23.884545 5120 generic.go:358] "Generic (PLEG): container finished" podID="6f390644-a67b-42f8-b1d7-f8debbfee112" containerID="966fdbcd3512beb83f3e2b385987833e1f291d6c095ef6d61aef3795706c6627" exitCode=0 Mar 16 15:55:23 crc kubenswrapper[5120]: I0316 15:55:23.884656 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7b9947885c-scjh2" event={"ID":"6f390644-a67b-42f8-b1d7-f8debbfee112","Type":"ContainerDied","Data":"966fdbcd3512beb83f3e2b385987833e1f291d6c095ef6d61aef3795706c6627"} Mar 16 15:55:23 crc kubenswrapper[5120]: I0316 15:55:23.884977 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7b9947885c-scjh2" event={"ID":"6f390644-a67b-42f8-b1d7-f8debbfee112","Type":"ContainerStarted","Data":"9340b23ed24b723a3487d00a2ad97cc8198ce2ca9a0a5ac27f83e6abaafc0be7"} Mar 16 15:55:24 crc kubenswrapper[5120]: I0316 15:55:24.896028 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7b9947885c-scjh2" event={"ID":"6f390644-a67b-42f8-b1d7-f8debbfee112","Type":"ContainerStarted","Data":"d993de8ecb98ba357da568f8cec731cb39fcd9735fc3b28ec60d4545d9c2d57f"} Mar 16 15:55:24 crc kubenswrapper[5120]: I0316 15:55:24.896405 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7b9947885c-scjh2" Mar 16 15:55:24 crc kubenswrapper[5120]: I0316 15:55:24.913625 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7b9947885c-scjh2" podStartSLOduration=2.913609279 podStartE2EDuration="2.913609279s" podCreationTimestamp="2026-03-16 15:55:22 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:55:24.911511752 +0000 UTC m=+1427.065443419" watchObservedRunningTime="2026-03-16 15:55:24.913609279 +0000 UTC m=+1427.067540936" Mar 16 15:55:30 crc kubenswrapper[5120]: I0316 15:55:30.909229 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7b9947885c-scjh2" Mar 16 15:55:31 crc kubenswrapper[5120]: I0316 15:55:31.002201 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-xvqbz"] Mar 16 15:55:31 crc kubenswrapper[5120]: I0316 15:55:31.003010 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-xvqbz" podUID="51478cb6-9192-494b-a293-b5cc54cfa9a3" containerName="dnsmasq-dns" containerID="cri-o://5da0c0adc79d0587055e00db06bcaf568ffe174df5a0e100eeeafd6c263e0144" gracePeriod=10 Mar 16 15:55:31 crc kubenswrapper[5120]: I0316 15:55:31.568053 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-xvqbz" Mar 16 15:55:31 crc kubenswrapper[5120]: I0316 15:55:31.650950 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/51478cb6-9192-494b-a293-b5cc54cfa9a3-dnsmasq-svc\") pod \"51478cb6-9192-494b-a293-b5cc54cfa9a3\" (UID: \"51478cb6-9192-494b-a293-b5cc54cfa9a3\") " Mar 16 15:55:31 crc kubenswrapper[5120]: I0316 15:55:31.651841 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wwdtd\" (UniqueName: \"kubernetes.io/projected/51478cb6-9192-494b-a293-b5cc54cfa9a3-kube-api-access-wwdtd\") pod \"51478cb6-9192-494b-a293-b5cc54cfa9a3\" (UID: \"51478cb6-9192-494b-a293-b5cc54cfa9a3\") " Mar 16 15:55:31 crc kubenswrapper[5120]: I0316 15:55:31.651912 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/51478cb6-9192-494b-a293-b5cc54cfa9a3-config\") pod \"51478cb6-9192-494b-a293-b5cc54cfa9a3\" (UID: \"51478cb6-9192-494b-a293-b5cc54cfa9a3\") " Mar 16 15:55:31 crc kubenswrapper[5120]: I0316 15:55:31.660010 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51478cb6-9192-494b-a293-b5cc54cfa9a3-kube-api-access-wwdtd" (OuterVolumeSpecName: "kube-api-access-wwdtd") pod "51478cb6-9192-494b-a293-b5cc54cfa9a3" (UID: "51478cb6-9192-494b-a293-b5cc54cfa9a3"). InnerVolumeSpecName "kube-api-access-wwdtd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:55:31 crc kubenswrapper[5120]: I0316 15:55:31.708236 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/51478cb6-9192-494b-a293-b5cc54cfa9a3-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "51478cb6-9192-494b-a293-b5cc54cfa9a3" (UID: "51478cb6-9192-494b-a293-b5cc54cfa9a3"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:55:31 crc kubenswrapper[5120]: I0316 15:55:31.709847 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/51478cb6-9192-494b-a293-b5cc54cfa9a3-config" (OuterVolumeSpecName: "config") pod "51478cb6-9192-494b-a293-b5cc54cfa9a3" (UID: "51478cb6-9192-494b-a293-b5cc54cfa9a3"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:55:31 crc kubenswrapper[5120]: I0316 15:55:31.755087 5120 reconciler_common.go:299] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/51478cb6-9192-494b-a293-b5cc54cfa9a3-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Mar 16 15:55:31 crc kubenswrapper[5120]: I0316 15:55:31.755357 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wwdtd\" (UniqueName: \"kubernetes.io/projected/51478cb6-9192-494b-a293-b5cc54cfa9a3-kube-api-access-wwdtd\") on node \"crc\" DevicePath \"\"" Mar 16 15:55:31 crc kubenswrapper[5120]: I0316 15:55:31.755439 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/51478cb6-9192-494b-a293-b5cc54cfa9a3-config\") on node \"crc\" DevicePath \"\"" Mar 16 15:55:31 crc kubenswrapper[5120]: I0316 15:55:31.860322 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 15:55:31 crc kubenswrapper[5120]: I0316 15:55:31.861281 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 15:55:31 crc kubenswrapper[5120]: I0316 15:55:31.995547 5120 generic.go:358] "Generic (PLEG): container finished" podID="51478cb6-9192-494b-a293-b5cc54cfa9a3" containerID="5da0c0adc79d0587055e00db06bcaf568ffe174df5a0e100eeeafd6c263e0144" exitCode=0 Mar 16 15:55:31 crc kubenswrapper[5120]: I0316 15:55:31.995603 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-xvqbz" event={"ID":"51478cb6-9192-494b-a293-b5cc54cfa9a3","Type":"ContainerDied","Data":"5da0c0adc79d0587055e00db06bcaf568ffe174df5a0e100eeeafd6c263e0144"} Mar 16 15:55:31 crc kubenswrapper[5120]: I0316 15:55:31.995676 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-xvqbz" event={"ID":"51478cb6-9192-494b-a293-b5cc54cfa9a3","Type":"ContainerDied","Data":"526b1de0b165b3f4d46f6b4ebd7c3a2d423d04290010b930ec2916926dcb53a0"} Mar 16 15:55:31 crc kubenswrapper[5120]: I0316 15:55:31.995716 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-xvqbz" Mar 16 15:55:31 crc kubenswrapper[5120]: I0316 15:55:31.995733 5120 scope.go:117] "RemoveContainer" containerID="5da0c0adc79d0587055e00db06bcaf568ffe174df5a0e100eeeafd6c263e0144" Mar 16 15:55:32 crc kubenswrapper[5120]: I0316 15:55:32.027252 5120 scope.go:117] "RemoveContainer" containerID="47d672e660915dee4a32abf5542b3e9f3216a0738c0dd0c1ced8826e5cf19a6e" Mar 16 15:55:32 crc kubenswrapper[5120]: I0316 15:55:32.037607 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-xvqbz"] Mar 16 15:55:32 crc kubenswrapper[5120]: I0316 15:55:32.047471 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-xvqbz"] Mar 16 15:55:32 crc kubenswrapper[5120]: I0316 15:55:32.062087 5120 scope.go:117] "RemoveContainer" containerID="5da0c0adc79d0587055e00db06bcaf568ffe174df5a0e100eeeafd6c263e0144" Mar 16 15:55:32 crc kubenswrapper[5120]: E0316 15:55:32.062487 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5da0c0adc79d0587055e00db06bcaf568ffe174df5a0e100eeeafd6c263e0144\": container with ID starting with 5da0c0adc79d0587055e00db06bcaf568ffe174df5a0e100eeeafd6c263e0144 not found: ID does not exist" containerID="5da0c0adc79d0587055e00db06bcaf568ffe174df5a0e100eeeafd6c263e0144" Mar 16 15:55:32 crc kubenswrapper[5120]: I0316 15:55:32.062610 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5da0c0adc79d0587055e00db06bcaf568ffe174df5a0e100eeeafd6c263e0144"} err="failed to get container status \"5da0c0adc79d0587055e00db06bcaf568ffe174df5a0e100eeeafd6c263e0144\": rpc error: code = NotFound desc = could not find container \"5da0c0adc79d0587055e00db06bcaf568ffe174df5a0e100eeeafd6c263e0144\": container with ID starting with 5da0c0adc79d0587055e00db06bcaf568ffe174df5a0e100eeeafd6c263e0144 not found: ID does not exist" Mar 16 15:55:32 crc kubenswrapper[5120]: I0316 15:55:32.062747 5120 scope.go:117] "RemoveContainer" containerID="47d672e660915dee4a32abf5542b3e9f3216a0738c0dd0c1ced8826e5cf19a6e" Mar 16 15:55:32 crc kubenswrapper[5120]: E0316 15:55:32.063114 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"47d672e660915dee4a32abf5542b3e9f3216a0738c0dd0c1ced8826e5cf19a6e\": container with ID starting with 47d672e660915dee4a32abf5542b3e9f3216a0738c0dd0c1ced8826e5cf19a6e not found: ID does not exist" containerID="47d672e660915dee4a32abf5542b3e9f3216a0738c0dd0c1ced8826e5cf19a6e" Mar 16 15:55:32 crc kubenswrapper[5120]: I0316 15:55:32.063170 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47d672e660915dee4a32abf5542b3e9f3216a0738c0dd0c1ced8826e5cf19a6e"} err="failed to get container status \"47d672e660915dee4a32abf5542b3e9f3216a0738c0dd0c1ced8826e5cf19a6e\": rpc error: code = NotFound desc = could not find container \"47d672e660915dee4a32abf5542b3e9f3216a0738c0dd0c1ced8826e5cf19a6e\": container with ID starting with 47d672e660915dee4a32abf5542b3e9f3216a0738c0dd0c1ced8826e5cf19a6e not found: ID does not exist" Mar 16 15:55:32 crc kubenswrapper[5120]: I0316 15:55:32.683159 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="51478cb6-9192-494b-a293-b5cc54cfa9a3" path="/var/lib/kubelet/pods/51478cb6-9192-494b-a293-b5cc54cfa9a3/volumes" Mar 16 15:55:33 crc kubenswrapper[5120]: I0316 15:55:33.761193 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-db-create-fmbn7"] Mar 16 15:55:33 crc kubenswrapper[5120]: I0316 15:55:33.762092 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51478cb6-9192-494b-a293-b5cc54cfa9a3" containerName="dnsmasq-dns" Mar 16 15:55:33 crc kubenswrapper[5120]: I0316 15:55:33.762111 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="51478cb6-9192-494b-a293-b5cc54cfa9a3" containerName="dnsmasq-dns" Mar 16 15:55:33 crc kubenswrapper[5120]: I0316 15:55:33.762128 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51478cb6-9192-494b-a293-b5cc54cfa9a3" containerName="init" Mar 16 15:55:33 crc kubenswrapper[5120]: I0316 15:55:33.762134 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="51478cb6-9192-494b-a293-b5cc54cfa9a3" containerName="init" Mar 16 15:55:33 crc kubenswrapper[5120]: I0316 15:55:33.762299 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="51478cb6-9192-494b-a293-b5cc54cfa9a3" containerName="dnsmasq-dns" Mar 16 15:55:33 crc kubenswrapper[5120]: I0316 15:55:33.770967 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-db-create-fmbn7"] Mar 16 15:55:33 crc kubenswrapper[5120]: I0316 15:55:33.771095 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-create-fmbn7" Mar 16 15:55:33 crc kubenswrapper[5120]: I0316 15:55:33.859519 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-3fc7-account-create-update-q9jx6"] Mar 16 15:55:33 crc kubenswrapper[5120]: I0316 15:55:33.890958 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-3fc7-account-create-update-q9jx6" Mar 16 15:55:33 crc kubenswrapper[5120]: I0316 15:55:33.895925 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-db-secret\"" Mar 16 15:55:33 crc kubenswrapper[5120]: I0316 15:55:33.910457 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9qkz\" (UniqueName: \"kubernetes.io/projected/7f39a386-dfd6-4e99-8fff-84323615eb1c-kube-api-access-f9qkz\") pod \"cinder-db-create-fmbn7\" (UID: \"7f39a386-dfd6-4e99-8fff-84323615eb1c\") " pod="openstack-kuttl-tests/cinder-db-create-fmbn7" Mar 16 15:55:33 crc kubenswrapper[5120]: I0316 15:55:33.910528 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/7f39a386-dfd6-4e99-8fff-84323615eb1c-operator-scripts\") pod \"cinder-db-create-fmbn7\" (UID: \"7f39a386-dfd6-4e99-8fff-84323615eb1c\") " pod="openstack-kuttl-tests/cinder-db-create-fmbn7" Mar 16 15:55:33 crc kubenswrapper[5120]: I0316 15:55:33.932570 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-3fc7-account-create-update-q9jx6"] Mar 16 15:55:33 crc kubenswrapper[5120]: I0316 15:55:33.954310 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-db-create-nh9pb"] Mar 16 15:55:33 crc kubenswrapper[5120]: I0316 15:55:33.971111 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-db-create-nh9pb"] Mar 16 15:55:33 crc kubenswrapper[5120]: I0316 15:55:33.971262 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-create-nh9pb" Mar 16 15:55:34 crc kubenswrapper[5120]: I0316 15:55:34.004444 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-bwm2j"] Mar 16 15:55:34 crc kubenswrapper[5120]: I0316 15:55:34.012027 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7gbq\" (UniqueName: \"kubernetes.io/projected/f0286c00-e671-4cf1-874d-eff999eba015-kube-api-access-m7gbq\") pod \"cinder-3fc7-account-create-update-q9jx6\" (UID: \"f0286c00-e671-4cf1-874d-eff999eba015\") " pod="openstack-kuttl-tests/cinder-3fc7-account-create-update-q9jx6" Mar 16 15:55:34 crc kubenswrapper[5120]: I0316 15:55:34.012125 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f9qkz\" (UniqueName: \"kubernetes.io/projected/7f39a386-dfd6-4e99-8fff-84323615eb1c-kube-api-access-f9qkz\") pod \"cinder-db-create-fmbn7\" (UID: \"7f39a386-dfd6-4e99-8fff-84323615eb1c\") " pod="openstack-kuttl-tests/cinder-db-create-fmbn7" Mar 16 15:55:34 crc kubenswrapper[5120]: I0316 15:55:34.012159 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/7f39a386-dfd6-4e99-8fff-84323615eb1c-operator-scripts\") pod \"cinder-db-create-fmbn7\" (UID: \"7f39a386-dfd6-4e99-8fff-84323615eb1c\") " pod="openstack-kuttl-tests/cinder-db-create-fmbn7" Mar 16 15:55:34 crc kubenswrapper[5120]: I0316 15:55:34.012190 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f0286c00-e671-4cf1-874d-eff999eba015-operator-scripts\") pod \"cinder-3fc7-account-create-update-q9jx6\" (UID: \"f0286c00-e671-4cf1-874d-eff999eba015\") " pod="openstack-kuttl-tests/cinder-3fc7-account-create-update-q9jx6" Mar 16 15:55:34 crc kubenswrapper[5120]: I0316 15:55:34.013295 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/7f39a386-dfd6-4e99-8fff-84323615eb1c-operator-scripts\") pod \"cinder-db-create-fmbn7\" (UID: \"7f39a386-dfd6-4e99-8fff-84323615eb1c\") " pod="openstack-kuttl-tests/cinder-db-create-fmbn7" Mar 16 15:55:34 crc kubenswrapper[5120]: I0316 15:55:34.013313 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-bwm2j" Mar 16 15:55:34 crc kubenswrapper[5120]: I0316 15:55:34.015433 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-scripts\"" Mar 16 15:55:34 crc kubenswrapper[5120]: I0316 15:55:34.015605 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-keystone-dockercfg-d2z5x\"" Mar 16 15:55:34 crc kubenswrapper[5120]: I0316 15:55:34.015834 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-config-data\"" Mar 16 15:55:34 crc kubenswrapper[5120]: I0316 15:55:34.015952 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone\"" Mar 16 15:55:34 crc kubenswrapper[5120]: I0316 15:55:34.036536 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-bwm2j"] Mar 16 15:55:34 crc kubenswrapper[5120]: I0316 15:55:34.040626 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9qkz\" (UniqueName: \"kubernetes.io/projected/7f39a386-dfd6-4e99-8fff-84323615eb1c-kube-api-access-f9qkz\") pod \"cinder-db-create-fmbn7\" (UID: \"7f39a386-dfd6-4e99-8fff-84323615eb1c\") " pod="openstack-kuttl-tests/cinder-db-create-fmbn7" Mar 16 15:55:34 crc kubenswrapper[5120]: I0316 15:55:34.088101 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-db-create-gqzqj"] Mar 16 15:55:34 crc kubenswrapper[5120]: I0316 15:55:34.093375 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-create-gqzqj" Mar 16 15:55:34 crc kubenswrapper[5120]: I0316 15:55:34.094573 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-62f1-account-create-update-vlpcg"] Mar 16 15:55:34 crc kubenswrapper[5120]: I0316 15:55:34.099171 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-62f1-account-create-update-vlpcg" Mar 16 15:55:34 crc kubenswrapper[5120]: I0316 15:55:34.099656 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-create-fmbn7" Mar 16 15:55:34 crc kubenswrapper[5120]: I0316 15:55:34.101422 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-db-create-gqzqj"] Mar 16 15:55:34 crc kubenswrapper[5120]: I0316 15:55:34.103318 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-db-secret\"" Mar 16 15:55:34 crc kubenswrapper[5120]: I0316 15:55:34.107625 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-62f1-account-create-update-vlpcg"] Mar 16 15:55:34 crc kubenswrapper[5120]: I0316 15:55:34.116028 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xn4zj\" (UniqueName: \"kubernetes.io/projected/32b14c32-be65-4d58-bb92-d61da48cc992-kube-api-access-xn4zj\") pod \"neutron-db-create-nh9pb\" (UID: \"32b14c32-be65-4d58-bb92-d61da48cc992\") " pod="openstack-kuttl-tests/neutron-db-create-nh9pb" Mar 16 15:55:34 crc kubenswrapper[5120]: I0316 15:55:34.116088 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ck5wh\" (UniqueName: \"kubernetes.io/projected/ec4c23f3-0b66-4795-8926-2aa0414de1ad-kube-api-access-ck5wh\") pod \"keystone-db-sync-bwm2j\" (UID: \"ec4c23f3-0b66-4795-8926-2aa0414de1ad\") " pod="openstack-kuttl-tests/keystone-db-sync-bwm2j" Mar 16 15:55:34 crc kubenswrapper[5120]: I0316 15:55:34.116129 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ec4c23f3-0b66-4795-8926-2aa0414de1ad-config-data\") pod \"keystone-db-sync-bwm2j\" (UID: \"ec4c23f3-0b66-4795-8926-2aa0414de1ad\") " pod="openstack-kuttl-tests/keystone-db-sync-bwm2j" Mar 16 15:55:34 crc kubenswrapper[5120]: I0316 15:55:34.116177 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f0286c00-e671-4cf1-874d-eff999eba015-operator-scripts\") pod \"cinder-3fc7-account-create-update-q9jx6\" (UID: \"f0286c00-e671-4cf1-874d-eff999eba015\") " pod="openstack-kuttl-tests/cinder-3fc7-account-create-update-q9jx6" Mar 16 15:55:34 crc kubenswrapper[5120]: I0316 15:55:34.116230 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/32b14c32-be65-4d58-bb92-d61da48cc992-operator-scripts\") pod \"neutron-db-create-nh9pb\" (UID: \"32b14c32-be65-4d58-bb92-d61da48cc992\") " pod="openstack-kuttl-tests/neutron-db-create-nh9pb" Mar 16 15:55:34 crc kubenswrapper[5120]: I0316 15:55:34.116283 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ec4c23f3-0b66-4795-8926-2aa0414de1ad-combined-ca-bundle\") pod \"keystone-db-sync-bwm2j\" (UID: \"ec4c23f3-0b66-4795-8926-2aa0414de1ad\") " pod="openstack-kuttl-tests/keystone-db-sync-bwm2j" Mar 16 15:55:34 crc kubenswrapper[5120]: I0316 15:55:34.116318 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m7gbq\" (UniqueName: \"kubernetes.io/projected/f0286c00-e671-4cf1-874d-eff999eba015-kube-api-access-m7gbq\") pod \"cinder-3fc7-account-create-update-q9jx6\" (UID: \"f0286c00-e671-4cf1-874d-eff999eba015\") " pod="openstack-kuttl-tests/cinder-3fc7-account-create-update-q9jx6" Mar 16 15:55:34 crc kubenswrapper[5120]: I0316 15:55:34.117198 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f0286c00-e671-4cf1-874d-eff999eba015-operator-scripts\") pod \"cinder-3fc7-account-create-update-q9jx6\" (UID: \"f0286c00-e671-4cf1-874d-eff999eba015\") " pod="openstack-kuttl-tests/cinder-3fc7-account-create-update-q9jx6" Mar 16 15:55:34 crc kubenswrapper[5120]: I0316 15:55:34.139294 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7gbq\" (UniqueName: \"kubernetes.io/projected/f0286c00-e671-4cf1-874d-eff999eba015-kube-api-access-m7gbq\") pod \"cinder-3fc7-account-create-update-q9jx6\" (UID: \"f0286c00-e671-4cf1-874d-eff999eba015\") " pod="openstack-kuttl-tests/cinder-3fc7-account-create-update-q9jx6" Mar 16 15:55:34 crc kubenswrapper[5120]: I0316 15:55:34.168346 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-38cb-account-create-update-mw2hg"] Mar 16 15:55:34 crc kubenswrapper[5120]: I0316 15:55:34.177356 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-38cb-account-create-update-mw2hg" Mar 16 15:55:34 crc kubenswrapper[5120]: I0316 15:55:34.180408 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-db-secret\"" Mar 16 15:55:34 crc kubenswrapper[5120]: I0316 15:55:34.182069 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-38cb-account-create-update-mw2hg"] Mar 16 15:55:34 crc kubenswrapper[5120]: I0316 15:55:34.211513 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-3fc7-account-create-update-q9jx6" Mar 16 15:55:34 crc kubenswrapper[5120]: I0316 15:55:34.219172 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/32b14c32-be65-4d58-bb92-d61da48cc992-operator-scripts\") pod \"neutron-db-create-nh9pb\" (UID: \"32b14c32-be65-4d58-bb92-d61da48cc992\") " pod="openstack-kuttl-tests/neutron-db-create-nh9pb" Mar 16 15:55:34 crc kubenswrapper[5120]: I0316 15:55:34.219599 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b7d40cc2-92b3-4f31-ad96-d8a11157d035-operator-scripts\") pod \"barbican-62f1-account-create-update-vlpcg\" (UID: \"b7d40cc2-92b3-4f31-ad96-d8a11157d035\") " pod="openstack-kuttl-tests/barbican-62f1-account-create-update-vlpcg" Mar 16 15:55:34 crc kubenswrapper[5120]: I0316 15:55:34.219722 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ec4c23f3-0b66-4795-8926-2aa0414de1ad-combined-ca-bundle\") pod \"keystone-db-sync-bwm2j\" (UID: \"ec4c23f3-0b66-4795-8926-2aa0414de1ad\") " pod="openstack-kuttl-tests/keystone-db-sync-bwm2j" Mar 16 15:55:34 crc kubenswrapper[5120]: I0316 15:55:34.219938 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6v7rh\" (UniqueName: \"kubernetes.io/projected/b7d40cc2-92b3-4f31-ad96-d8a11157d035-kube-api-access-6v7rh\") pod \"barbican-62f1-account-create-update-vlpcg\" (UID: \"b7d40cc2-92b3-4f31-ad96-d8a11157d035\") " pod="openstack-kuttl-tests/barbican-62f1-account-create-update-vlpcg" Mar 16 15:55:34 crc kubenswrapper[5120]: I0316 15:55:34.220029 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/32b14c32-be65-4d58-bb92-d61da48cc992-operator-scripts\") pod \"neutron-db-create-nh9pb\" (UID: \"32b14c32-be65-4d58-bb92-d61da48cc992\") " pod="openstack-kuttl-tests/neutron-db-create-nh9pb" Mar 16 15:55:34 crc kubenswrapper[5120]: I0316 15:55:34.220079 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xn4zj\" (UniqueName: \"kubernetes.io/projected/32b14c32-be65-4d58-bb92-d61da48cc992-kube-api-access-xn4zj\") pod \"neutron-db-create-nh9pb\" (UID: \"32b14c32-be65-4d58-bb92-d61da48cc992\") " pod="openstack-kuttl-tests/neutron-db-create-nh9pb" Mar 16 15:55:34 crc kubenswrapper[5120]: I0316 15:55:34.220121 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ck5wh\" (UniqueName: \"kubernetes.io/projected/ec4c23f3-0b66-4795-8926-2aa0414de1ad-kube-api-access-ck5wh\") pod \"keystone-db-sync-bwm2j\" (UID: \"ec4c23f3-0b66-4795-8926-2aa0414de1ad\") " pod="openstack-kuttl-tests/keystone-db-sync-bwm2j" Mar 16 15:55:34 crc kubenswrapper[5120]: I0316 15:55:34.220158 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ec4c23f3-0b66-4795-8926-2aa0414de1ad-config-data\") pod \"keystone-db-sync-bwm2j\" (UID: \"ec4c23f3-0b66-4795-8926-2aa0414de1ad\") " pod="openstack-kuttl-tests/keystone-db-sync-bwm2j" Mar 16 15:55:34 crc kubenswrapper[5120]: I0316 15:55:34.220192 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8cfst\" (UniqueName: \"kubernetes.io/projected/461d1c44-31c5-45b2-8f2e-ecf239cb7b1e-kube-api-access-8cfst\") pod \"barbican-db-create-gqzqj\" (UID: \"461d1c44-31c5-45b2-8f2e-ecf239cb7b1e\") " pod="openstack-kuttl-tests/barbican-db-create-gqzqj" Mar 16 15:55:34 crc kubenswrapper[5120]: I0316 15:55:34.220427 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/461d1c44-31c5-45b2-8f2e-ecf239cb7b1e-operator-scripts\") pod \"barbican-db-create-gqzqj\" (UID: \"461d1c44-31c5-45b2-8f2e-ecf239cb7b1e\") " pod="openstack-kuttl-tests/barbican-db-create-gqzqj" Mar 16 15:55:34 crc kubenswrapper[5120]: I0316 15:55:34.230917 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ec4c23f3-0b66-4795-8926-2aa0414de1ad-combined-ca-bundle\") pod \"keystone-db-sync-bwm2j\" (UID: \"ec4c23f3-0b66-4795-8926-2aa0414de1ad\") " pod="openstack-kuttl-tests/keystone-db-sync-bwm2j" Mar 16 15:55:34 crc kubenswrapper[5120]: I0316 15:55:34.235417 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ec4c23f3-0b66-4795-8926-2aa0414de1ad-config-data\") pod \"keystone-db-sync-bwm2j\" (UID: \"ec4c23f3-0b66-4795-8926-2aa0414de1ad\") " pod="openstack-kuttl-tests/keystone-db-sync-bwm2j" Mar 16 15:55:34 crc kubenswrapper[5120]: I0316 15:55:34.244590 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xn4zj\" (UniqueName: \"kubernetes.io/projected/32b14c32-be65-4d58-bb92-d61da48cc992-kube-api-access-xn4zj\") pod \"neutron-db-create-nh9pb\" (UID: \"32b14c32-be65-4d58-bb92-d61da48cc992\") " pod="openstack-kuttl-tests/neutron-db-create-nh9pb" Mar 16 15:55:34 crc kubenswrapper[5120]: I0316 15:55:34.247351 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ck5wh\" (UniqueName: \"kubernetes.io/projected/ec4c23f3-0b66-4795-8926-2aa0414de1ad-kube-api-access-ck5wh\") pod \"keystone-db-sync-bwm2j\" (UID: \"ec4c23f3-0b66-4795-8926-2aa0414de1ad\") " pod="openstack-kuttl-tests/keystone-db-sync-bwm2j" Mar 16 15:55:34 crc kubenswrapper[5120]: I0316 15:55:34.291891 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-create-nh9pb" Mar 16 15:55:34 crc kubenswrapper[5120]: I0316 15:55:34.321818 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8cfst\" (UniqueName: \"kubernetes.io/projected/461d1c44-31c5-45b2-8f2e-ecf239cb7b1e-kube-api-access-8cfst\") pod \"barbican-db-create-gqzqj\" (UID: \"461d1c44-31c5-45b2-8f2e-ecf239cb7b1e\") " pod="openstack-kuttl-tests/barbican-db-create-gqzqj" Mar 16 15:55:34 crc kubenswrapper[5120]: I0316 15:55:34.321870 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/461d1c44-31c5-45b2-8f2e-ecf239cb7b1e-operator-scripts\") pod \"barbican-db-create-gqzqj\" (UID: \"461d1c44-31c5-45b2-8f2e-ecf239cb7b1e\") " pod="openstack-kuttl-tests/barbican-db-create-gqzqj" Mar 16 15:55:34 crc kubenswrapper[5120]: I0316 15:55:34.322610 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/461d1c44-31c5-45b2-8f2e-ecf239cb7b1e-operator-scripts\") pod \"barbican-db-create-gqzqj\" (UID: \"461d1c44-31c5-45b2-8f2e-ecf239cb7b1e\") " pod="openstack-kuttl-tests/barbican-db-create-gqzqj" Mar 16 15:55:34 crc kubenswrapper[5120]: I0316 15:55:34.322706 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b7d40cc2-92b3-4f31-ad96-d8a11157d035-operator-scripts\") pod \"barbican-62f1-account-create-update-vlpcg\" (UID: \"b7d40cc2-92b3-4f31-ad96-d8a11157d035\") " pod="openstack-kuttl-tests/barbican-62f1-account-create-update-vlpcg" Mar 16 15:55:34 crc kubenswrapper[5120]: I0316 15:55:34.322771 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dc5l5\" (UniqueName: \"kubernetes.io/projected/7a212c23-f62a-4cb8-9c48-723d3aa714d6-kube-api-access-dc5l5\") pod \"neutron-38cb-account-create-update-mw2hg\" (UID: \"7a212c23-f62a-4cb8-9c48-723d3aa714d6\") " pod="openstack-kuttl-tests/neutron-38cb-account-create-update-mw2hg" Mar 16 15:55:34 crc kubenswrapper[5120]: I0316 15:55:34.322803 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6v7rh\" (UniqueName: \"kubernetes.io/projected/b7d40cc2-92b3-4f31-ad96-d8a11157d035-kube-api-access-6v7rh\") pod \"barbican-62f1-account-create-update-vlpcg\" (UID: \"b7d40cc2-92b3-4f31-ad96-d8a11157d035\") " pod="openstack-kuttl-tests/barbican-62f1-account-create-update-vlpcg" Mar 16 15:55:34 crc kubenswrapper[5120]: I0316 15:55:34.322852 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/7a212c23-f62a-4cb8-9c48-723d3aa714d6-operator-scripts\") pod \"neutron-38cb-account-create-update-mw2hg\" (UID: \"7a212c23-f62a-4cb8-9c48-723d3aa714d6\") " pod="openstack-kuttl-tests/neutron-38cb-account-create-update-mw2hg" Mar 16 15:55:34 crc kubenswrapper[5120]: I0316 15:55:34.323777 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b7d40cc2-92b3-4f31-ad96-d8a11157d035-operator-scripts\") pod \"barbican-62f1-account-create-update-vlpcg\" (UID: \"b7d40cc2-92b3-4f31-ad96-d8a11157d035\") " pod="openstack-kuttl-tests/barbican-62f1-account-create-update-vlpcg" Mar 16 15:55:34 crc kubenswrapper[5120]: I0316 15:55:34.330975 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-bwm2j" Mar 16 15:55:34 crc kubenswrapper[5120]: I0316 15:55:34.339469 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8cfst\" (UniqueName: \"kubernetes.io/projected/461d1c44-31c5-45b2-8f2e-ecf239cb7b1e-kube-api-access-8cfst\") pod \"barbican-db-create-gqzqj\" (UID: \"461d1c44-31c5-45b2-8f2e-ecf239cb7b1e\") " pod="openstack-kuttl-tests/barbican-db-create-gqzqj" Mar 16 15:55:34 crc kubenswrapper[5120]: I0316 15:55:34.341854 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6v7rh\" (UniqueName: \"kubernetes.io/projected/b7d40cc2-92b3-4f31-ad96-d8a11157d035-kube-api-access-6v7rh\") pod \"barbican-62f1-account-create-update-vlpcg\" (UID: \"b7d40cc2-92b3-4f31-ad96-d8a11157d035\") " pod="openstack-kuttl-tests/barbican-62f1-account-create-update-vlpcg" Mar 16 15:55:34 crc kubenswrapper[5120]: I0316 15:55:34.412235 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-create-gqzqj" Mar 16 15:55:34 crc kubenswrapper[5120]: I0316 15:55:34.424377 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dc5l5\" (UniqueName: \"kubernetes.io/projected/7a212c23-f62a-4cb8-9c48-723d3aa714d6-kube-api-access-dc5l5\") pod \"neutron-38cb-account-create-update-mw2hg\" (UID: \"7a212c23-f62a-4cb8-9c48-723d3aa714d6\") " pod="openstack-kuttl-tests/neutron-38cb-account-create-update-mw2hg" Mar 16 15:55:34 crc kubenswrapper[5120]: I0316 15:55:34.424472 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/7a212c23-f62a-4cb8-9c48-723d3aa714d6-operator-scripts\") pod \"neutron-38cb-account-create-update-mw2hg\" (UID: \"7a212c23-f62a-4cb8-9c48-723d3aa714d6\") " pod="openstack-kuttl-tests/neutron-38cb-account-create-update-mw2hg" Mar 16 15:55:34 crc kubenswrapper[5120]: I0316 15:55:34.425569 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/7a212c23-f62a-4cb8-9c48-723d3aa714d6-operator-scripts\") pod \"neutron-38cb-account-create-update-mw2hg\" (UID: \"7a212c23-f62a-4cb8-9c48-723d3aa714d6\") " pod="openstack-kuttl-tests/neutron-38cb-account-create-update-mw2hg" Mar 16 15:55:34 crc kubenswrapper[5120]: I0316 15:55:34.444377 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dc5l5\" (UniqueName: \"kubernetes.io/projected/7a212c23-f62a-4cb8-9c48-723d3aa714d6-kube-api-access-dc5l5\") pod \"neutron-38cb-account-create-update-mw2hg\" (UID: \"7a212c23-f62a-4cb8-9c48-723d3aa714d6\") " pod="openstack-kuttl-tests/neutron-38cb-account-create-update-mw2hg" Mar 16 15:55:34 crc kubenswrapper[5120]: I0316 15:55:34.474937 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-62f1-account-create-update-vlpcg" Mar 16 15:55:34 crc kubenswrapper[5120]: I0316 15:55:34.507633 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-38cb-account-create-update-mw2hg" Mar 16 15:55:34 crc kubenswrapper[5120]: I0316 15:55:34.595516 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-db-create-fmbn7"] Mar 16 15:55:34 crc kubenswrapper[5120]: W0316 15:55:34.647869 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7f39a386_dfd6_4e99_8fff_84323615eb1c.slice/crio-4ff1e0c18dd807b196492fb841a3488e1261f1ccb40e09e8be9ca8b6e411f188 WatchSource:0}: Error finding container 4ff1e0c18dd807b196492fb841a3488e1261f1ccb40e09e8be9ca8b6e411f188: Status 404 returned error can't find the container with id 4ff1e0c18dd807b196492fb841a3488e1261f1ccb40e09e8be9ca8b6e411f188 Mar 16 15:55:34 crc kubenswrapper[5120]: I0316 15:55:34.782338 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-3fc7-account-create-update-q9jx6"] Mar 16 15:55:34 crc kubenswrapper[5120]: I0316 15:55:34.810389 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-bwm2j"] Mar 16 15:55:34 crc kubenswrapper[5120]: W0316 15:55:34.810856 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podec4c23f3_0b66_4795_8926_2aa0414de1ad.slice/crio-87d8a69f4dee7ce31541fd236a6d3910b7f60112b7371b46545c94dcf4872d85 WatchSource:0}: Error finding container 87d8a69f4dee7ce31541fd236a6d3910b7f60112b7371b46545c94dcf4872d85: Status 404 returned error can't find the container with id 87d8a69f4dee7ce31541fd236a6d3910b7f60112b7371b46545c94dcf4872d85 Mar 16 15:55:34 crc kubenswrapper[5120]: I0316 15:55:34.856453 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-db-create-nh9pb"] Mar 16 15:55:34 crc kubenswrapper[5120]: I0316 15:55:34.924252 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-db-create-gqzqj"] Mar 16 15:55:35 crc kubenswrapper[5120]: I0316 15:55:35.038715 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-create-nh9pb" event={"ID":"32b14c32-be65-4d58-bb92-d61da48cc992","Type":"ContainerStarted","Data":"d8ed2dd4afab87563960ee3d6417028a4838000e36973ef8dafa898b541a3e54"} Mar 16 15:55:35 crc kubenswrapper[5120]: I0316 15:55:35.040294 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-38cb-account-create-update-mw2hg"] Mar 16 15:55:35 crc kubenswrapper[5120]: I0316 15:55:35.044353 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-bwm2j" event={"ID":"ec4c23f3-0b66-4795-8926-2aa0414de1ad","Type":"ContainerStarted","Data":"87d8a69f4dee7ce31541fd236a6d3910b7f60112b7371b46545c94dcf4872d85"} Mar 16 15:55:35 crc kubenswrapper[5120]: I0316 15:55:35.063067 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-create-gqzqj" event={"ID":"461d1c44-31c5-45b2-8f2e-ecf239cb7b1e","Type":"ContainerStarted","Data":"417d5478e054495930709fb0b9debfd6a7193db4576a860d5b225e54a70a1bcd"} Mar 16 15:55:35 crc kubenswrapper[5120]: W0316 15:55:35.066970 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7a212c23_f62a_4cb8_9c48_723d3aa714d6.slice/crio-bbd67d116d9b7a4249450b478fbcf4fd294c15ee052b4a0bed53b802ba8bbfb6 WatchSource:0}: Error finding container bbd67d116d9b7a4249450b478fbcf4fd294c15ee052b4a0bed53b802ba8bbfb6: Status 404 returned error can't find the container with id bbd67d116d9b7a4249450b478fbcf4fd294c15ee052b4a0bed53b802ba8bbfb6 Mar 16 15:55:35 crc kubenswrapper[5120]: I0316 15:55:35.076866 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-create-fmbn7" event={"ID":"7f39a386-dfd6-4e99-8fff-84323615eb1c","Type":"ContainerStarted","Data":"4d14449b09ee9eb7ab92fa6c7ebd3efd31a2e8f200b67a0d1a63a5598686a60d"} Mar 16 15:55:35 crc kubenswrapper[5120]: I0316 15:55:35.076918 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-create-fmbn7" event={"ID":"7f39a386-dfd6-4e99-8fff-84323615eb1c","Type":"ContainerStarted","Data":"4ff1e0c18dd807b196492fb841a3488e1261f1ccb40e09e8be9ca8b6e411f188"} Mar 16 15:55:35 crc kubenswrapper[5120]: I0316 15:55:35.105092 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-3fc7-account-create-update-q9jx6" event={"ID":"f0286c00-e671-4cf1-874d-eff999eba015","Type":"ContainerStarted","Data":"37482354c87ab134c49220102c746f26255e758fdf024f193c6c6a9f9521ca31"} Mar 16 15:55:35 crc kubenswrapper[5120]: I0316 15:55:35.108684 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-db-create-fmbn7" podStartSLOduration=2.108656178 podStartE2EDuration="2.108656178s" podCreationTimestamp="2026-03-16 15:55:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:55:35.103101594 +0000 UTC m=+1437.257033251" watchObservedRunningTime="2026-03-16 15:55:35.108656178 +0000 UTC m=+1437.262587825" Mar 16 15:55:35 crc kubenswrapper[5120]: I0316 15:55:35.143198 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-3fc7-account-create-update-q9jx6" podStartSLOduration=2.143174163 podStartE2EDuration="2.143174163s" podCreationTimestamp="2026-03-16 15:55:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:55:35.142413103 +0000 UTC m=+1437.296344760" watchObservedRunningTime="2026-03-16 15:55:35.143174163 +0000 UTC m=+1437.297105810" Mar 16 15:55:35 crc kubenswrapper[5120]: I0316 15:55:35.177616 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-62f1-account-create-update-vlpcg"] Mar 16 15:55:35 crc kubenswrapper[5120]: W0316 15:55:35.181647 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb7d40cc2_92b3_4f31_ad96_d8a11157d035.slice/crio-a65497d51065bc4af6eb816eb911b0b75461f743208f6feaf89a090bc98128e6 WatchSource:0}: Error finding container a65497d51065bc4af6eb816eb911b0b75461f743208f6feaf89a090bc98128e6: Status 404 returned error can't find the container with id a65497d51065bc4af6eb816eb911b0b75461f743208f6feaf89a090bc98128e6 Mar 16 15:55:36 crc kubenswrapper[5120]: I0316 15:55:36.119902 5120 generic.go:358] "Generic (PLEG): container finished" podID="f0286c00-e671-4cf1-874d-eff999eba015" containerID="93b627b9e4f29941a82f65cb8de202758a5194eb502d1f4dc890c1348701d3e2" exitCode=0 Mar 16 15:55:36 crc kubenswrapper[5120]: I0316 15:55:36.119951 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-3fc7-account-create-update-q9jx6" event={"ID":"f0286c00-e671-4cf1-874d-eff999eba015","Type":"ContainerDied","Data":"93b627b9e4f29941a82f65cb8de202758a5194eb502d1f4dc890c1348701d3e2"} Mar 16 15:55:36 crc kubenswrapper[5120]: I0316 15:55:36.123390 5120 generic.go:358] "Generic (PLEG): container finished" podID="7a212c23-f62a-4cb8-9c48-723d3aa714d6" containerID="6949dd37215d812d404e15a6beac3203cc209a3912b3a974217088bd7e9dcef2" exitCode=0 Mar 16 15:55:36 crc kubenswrapper[5120]: I0316 15:55:36.123627 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-38cb-account-create-update-mw2hg" event={"ID":"7a212c23-f62a-4cb8-9c48-723d3aa714d6","Type":"ContainerDied","Data":"6949dd37215d812d404e15a6beac3203cc209a3912b3a974217088bd7e9dcef2"} Mar 16 15:55:36 crc kubenswrapper[5120]: I0316 15:55:36.123662 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-38cb-account-create-update-mw2hg" event={"ID":"7a212c23-f62a-4cb8-9c48-723d3aa714d6","Type":"ContainerStarted","Data":"bbd67d116d9b7a4249450b478fbcf4fd294c15ee052b4a0bed53b802ba8bbfb6"} Mar 16 15:55:36 crc kubenswrapper[5120]: I0316 15:55:36.135228 5120 generic.go:358] "Generic (PLEG): container finished" podID="32b14c32-be65-4d58-bb92-d61da48cc992" containerID="3ed266fb5a6f2a6760ca4563d03638d47c9c0980fa3e22498cea160f6cb29105" exitCode=0 Mar 16 15:55:36 crc kubenswrapper[5120]: I0316 15:55:36.135468 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-create-nh9pb" event={"ID":"32b14c32-be65-4d58-bb92-d61da48cc992","Type":"ContainerDied","Data":"3ed266fb5a6f2a6760ca4563d03638d47c9c0980fa3e22498cea160f6cb29105"} Mar 16 15:55:36 crc kubenswrapper[5120]: I0316 15:55:36.149889 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-bwm2j" event={"ID":"ec4c23f3-0b66-4795-8926-2aa0414de1ad","Type":"ContainerStarted","Data":"8f7017b16a14e2106660e7584452d5ced6cfd42eff02469b4ba96b7133dca7fb"} Mar 16 15:55:36 crc kubenswrapper[5120]: I0316 15:55:36.153170 5120 generic.go:358] "Generic (PLEG): container finished" podID="b7d40cc2-92b3-4f31-ad96-d8a11157d035" containerID="288df941b6fe0e50eae8b8edf10eed8e23a402d743bf6d322c0b16385323751d" exitCode=0 Mar 16 15:55:36 crc kubenswrapper[5120]: I0316 15:55:36.153336 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-62f1-account-create-update-vlpcg" event={"ID":"b7d40cc2-92b3-4f31-ad96-d8a11157d035","Type":"ContainerDied","Data":"288df941b6fe0e50eae8b8edf10eed8e23a402d743bf6d322c0b16385323751d"} Mar 16 15:55:36 crc kubenswrapper[5120]: I0316 15:55:36.153368 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-62f1-account-create-update-vlpcg" event={"ID":"b7d40cc2-92b3-4f31-ad96-d8a11157d035","Type":"ContainerStarted","Data":"a65497d51065bc4af6eb816eb911b0b75461f743208f6feaf89a090bc98128e6"} Mar 16 15:55:36 crc kubenswrapper[5120]: I0316 15:55:36.155657 5120 generic.go:358] "Generic (PLEG): container finished" podID="461d1c44-31c5-45b2-8f2e-ecf239cb7b1e" containerID="311b617b110ca81a6d9b239342d494d0847ab7ce54905dea2970c029e96282f3" exitCode=0 Mar 16 15:55:36 crc kubenswrapper[5120]: I0316 15:55:36.155848 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-create-gqzqj" event={"ID":"461d1c44-31c5-45b2-8f2e-ecf239cb7b1e","Type":"ContainerDied","Data":"311b617b110ca81a6d9b239342d494d0847ab7ce54905dea2970c029e96282f3"} Mar 16 15:55:36 crc kubenswrapper[5120]: I0316 15:55:36.162754 5120 generic.go:358] "Generic (PLEG): container finished" podID="7f39a386-dfd6-4e99-8fff-84323615eb1c" containerID="4d14449b09ee9eb7ab92fa6c7ebd3efd31a2e8f200b67a0d1a63a5598686a60d" exitCode=0 Mar 16 15:55:36 crc kubenswrapper[5120]: I0316 15:55:36.162950 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-create-fmbn7" event={"ID":"7f39a386-dfd6-4e99-8fff-84323615eb1c","Type":"ContainerDied","Data":"4d14449b09ee9eb7ab92fa6c7ebd3efd31a2e8f200b67a0d1a63a5598686a60d"} Mar 16 15:55:36 crc kubenswrapper[5120]: I0316 15:55:36.238634 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-db-sync-bwm2j" podStartSLOduration=3.238614295 podStartE2EDuration="3.238614295s" podCreationTimestamp="2026-03-16 15:55:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:55:36.234400648 +0000 UTC m=+1438.388332305" watchObservedRunningTime="2026-03-16 15:55:36.238614295 +0000 UTC m=+1438.392545962" Mar 16 15:55:37 crc kubenswrapper[5120]: I0316 15:55:37.177059 5120 generic.go:358] "Generic (PLEG): container finished" podID="ec4c23f3-0b66-4795-8926-2aa0414de1ad" containerID="8f7017b16a14e2106660e7584452d5ced6cfd42eff02469b4ba96b7133dca7fb" exitCode=0 Mar 16 15:55:37 crc kubenswrapper[5120]: I0316 15:55:37.177221 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-bwm2j" event={"ID":"ec4c23f3-0b66-4795-8926-2aa0414de1ad","Type":"ContainerDied","Data":"8f7017b16a14e2106660e7584452d5ced6cfd42eff02469b4ba96b7133dca7fb"} Mar 16 15:55:37 crc kubenswrapper[5120]: I0316 15:55:37.631322 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-create-gqzqj" Mar 16 15:55:37 crc kubenswrapper[5120]: I0316 15:55:37.714631 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/461d1c44-31c5-45b2-8f2e-ecf239cb7b1e-operator-scripts\") pod \"461d1c44-31c5-45b2-8f2e-ecf239cb7b1e\" (UID: \"461d1c44-31c5-45b2-8f2e-ecf239cb7b1e\") " Mar 16 15:55:37 crc kubenswrapper[5120]: I0316 15:55:37.714729 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8cfst\" (UniqueName: \"kubernetes.io/projected/461d1c44-31c5-45b2-8f2e-ecf239cb7b1e-kube-api-access-8cfst\") pod \"461d1c44-31c5-45b2-8f2e-ecf239cb7b1e\" (UID: \"461d1c44-31c5-45b2-8f2e-ecf239cb7b1e\") " Mar 16 15:55:37 crc kubenswrapper[5120]: I0316 15:55:37.715350 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/461d1c44-31c5-45b2-8f2e-ecf239cb7b1e-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "461d1c44-31c5-45b2-8f2e-ecf239cb7b1e" (UID: "461d1c44-31c5-45b2-8f2e-ecf239cb7b1e"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:55:37 crc kubenswrapper[5120]: I0316 15:55:37.715974 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/461d1c44-31c5-45b2-8f2e-ecf239cb7b1e-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 15:55:37 crc kubenswrapper[5120]: I0316 15:55:37.721146 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/461d1c44-31c5-45b2-8f2e-ecf239cb7b1e-kube-api-access-8cfst" (OuterVolumeSpecName: "kube-api-access-8cfst") pod "461d1c44-31c5-45b2-8f2e-ecf239cb7b1e" (UID: "461d1c44-31c5-45b2-8f2e-ecf239cb7b1e"). InnerVolumeSpecName "kube-api-access-8cfst". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:55:37 crc kubenswrapper[5120]: I0316 15:55:37.778849 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-38cb-account-create-update-mw2hg" Mar 16 15:55:37 crc kubenswrapper[5120]: I0316 15:55:37.785335 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-create-fmbn7" Mar 16 15:55:37 crc kubenswrapper[5120]: I0316 15:55:37.791638 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-62f1-account-create-update-vlpcg" Mar 16 15:55:37 crc kubenswrapper[5120]: I0316 15:55:37.831857 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/7a212c23-f62a-4cb8-9c48-723d3aa714d6-operator-scripts\") pod \"7a212c23-f62a-4cb8-9c48-723d3aa714d6\" (UID: \"7a212c23-f62a-4cb8-9c48-723d3aa714d6\") " Mar 16 15:55:37 crc kubenswrapper[5120]: I0316 15:55:37.832262 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/7f39a386-dfd6-4e99-8fff-84323615eb1c-operator-scripts\") pod \"7f39a386-dfd6-4e99-8fff-84323615eb1c\" (UID: \"7f39a386-dfd6-4e99-8fff-84323615eb1c\") " Mar 16 15:55:37 crc kubenswrapper[5120]: I0316 15:55:37.832523 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f9qkz\" (UniqueName: \"kubernetes.io/projected/7f39a386-dfd6-4e99-8fff-84323615eb1c-kube-api-access-f9qkz\") pod \"7f39a386-dfd6-4e99-8fff-84323615eb1c\" (UID: \"7f39a386-dfd6-4e99-8fff-84323615eb1c\") " Mar 16 15:55:37 crc kubenswrapper[5120]: I0316 15:55:37.832651 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dc5l5\" (UniqueName: \"kubernetes.io/projected/7a212c23-f62a-4cb8-9c48-723d3aa714d6-kube-api-access-dc5l5\") pod \"7a212c23-f62a-4cb8-9c48-723d3aa714d6\" (UID: \"7a212c23-f62a-4cb8-9c48-723d3aa714d6\") " Mar 16 15:55:37 crc kubenswrapper[5120]: I0316 15:55:37.833052 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8cfst\" (UniqueName: \"kubernetes.io/projected/461d1c44-31c5-45b2-8f2e-ecf239cb7b1e-kube-api-access-8cfst\") on node \"crc\" DevicePath \"\"" Mar 16 15:55:37 crc kubenswrapper[5120]: I0316 15:55:37.834161 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7a212c23-f62a-4cb8-9c48-723d3aa714d6-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "7a212c23-f62a-4cb8-9c48-723d3aa714d6" (UID: "7a212c23-f62a-4cb8-9c48-723d3aa714d6"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:55:37 crc kubenswrapper[5120]: I0316 15:55:37.835706 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f39a386-dfd6-4e99-8fff-84323615eb1c-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "7f39a386-dfd6-4e99-8fff-84323615eb1c" (UID: "7f39a386-dfd6-4e99-8fff-84323615eb1c"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:55:37 crc kubenswrapper[5120]: I0316 15:55:37.839511 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f39a386-dfd6-4e99-8fff-84323615eb1c-kube-api-access-f9qkz" (OuterVolumeSpecName: "kube-api-access-f9qkz") pod "7f39a386-dfd6-4e99-8fff-84323615eb1c" (UID: "7f39a386-dfd6-4e99-8fff-84323615eb1c"). InnerVolumeSpecName "kube-api-access-f9qkz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:55:37 crc kubenswrapper[5120]: I0316 15:55:37.842501 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a212c23-f62a-4cb8-9c48-723d3aa714d6-kube-api-access-dc5l5" (OuterVolumeSpecName: "kube-api-access-dc5l5") pod "7a212c23-f62a-4cb8-9c48-723d3aa714d6" (UID: "7a212c23-f62a-4cb8-9c48-723d3aa714d6"). InnerVolumeSpecName "kube-api-access-dc5l5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:55:37 crc kubenswrapper[5120]: I0316 15:55:37.843090 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-3fc7-account-create-update-q9jx6" Mar 16 15:55:37 crc kubenswrapper[5120]: I0316 15:55:37.845936 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-create-nh9pb" Mar 16 15:55:37 crc kubenswrapper[5120]: I0316 15:55:37.934197 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b7d40cc2-92b3-4f31-ad96-d8a11157d035-operator-scripts\") pod \"b7d40cc2-92b3-4f31-ad96-d8a11157d035\" (UID: \"b7d40cc2-92b3-4f31-ad96-d8a11157d035\") " Mar 16 15:55:37 crc kubenswrapper[5120]: I0316 15:55:37.934629 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m7gbq\" (UniqueName: \"kubernetes.io/projected/f0286c00-e671-4cf1-874d-eff999eba015-kube-api-access-m7gbq\") pod \"f0286c00-e671-4cf1-874d-eff999eba015\" (UID: \"f0286c00-e671-4cf1-874d-eff999eba015\") " Mar 16 15:55:37 crc kubenswrapper[5120]: I0316 15:55:37.934694 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/32b14c32-be65-4d58-bb92-d61da48cc992-operator-scripts\") pod \"32b14c32-be65-4d58-bb92-d61da48cc992\" (UID: \"32b14c32-be65-4d58-bb92-d61da48cc992\") " Mar 16 15:55:37 crc kubenswrapper[5120]: I0316 15:55:37.934819 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xn4zj\" (UniqueName: \"kubernetes.io/projected/32b14c32-be65-4d58-bb92-d61da48cc992-kube-api-access-xn4zj\") pod \"32b14c32-be65-4d58-bb92-d61da48cc992\" (UID: \"32b14c32-be65-4d58-bb92-d61da48cc992\") " Mar 16 15:55:37 crc kubenswrapper[5120]: I0316 15:55:37.934880 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b7d40cc2-92b3-4f31-ad96-d8a11157d035-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "b7d40cc2-92b3-4f31-ad96-d8a11157d035" (UID: "b7d40cc2-92b3-4f31-ad96-d8a11157d035"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:55:37 crc kubenswrapper[5120]: I0316 15:55:37.934925 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6v7rh\" (UniqueName: \"kubernetes.io/projected/b7d40cc2-92b3-4f31-ad96-d8a11157d035-kube-api-access-6v7rh\") pod \"b7d40cc2-92b3-4f31-ad96-d8a11157d035\" (UID: \"b7d40cc2-92b3-4f31-ad96-d8a11157d035\") " Mar 16 15:55:37 crc kubenswrapper[5120]: I0316 15:55:37.934987 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f0286c00-e671-4cf1-874d-eff999eba015-operator-scripts\") pod \"f0286c00-e671-4cf1-874d-eff999eba015\" (UID: \"f0286c00-e671-4cf1-874d-eff999eba015\") " Mar 16 15:55:37 crc kubenswrapper[5120]: I0316 15:55:37.935179 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/32b14c32-be65-4d58-bb92-d61da48cc992-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "32b14c32-be65-4d58-bb92-d61da48cc992" (UID: "32b14c32-be65-4d58-bb92-d61da48cc992"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:55:37 crc kubenswrapper[5120]: I0316 15:55:37.935521 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f0286c00-e671-4cf1-874d-eff999eba015-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "f0286c00-e671-4cf1-874d-eff999eba015" (UID: "f0286c00-e671-4cf1-874d-eff999eba015"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:55:37 crc kubenswrapper[5120]: I0316 15:55:37.935791 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/7a212c23-f62a-4cb8-9c48-723d3aa714d6-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 15:55:37 crc kubenswrapper[5120]: I0316 15:55:37.935809 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/32b14c32-be65-4d58-bb92-d61da48cc992-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 15:55:37 crc kubenswrapper[5120]: I0316 15:55:37.935819 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/7f39a386-dfd6-4e99-8fff-84323615eb1c-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 15:55:37 crc kubenswrapper[5120]: I0316 15:55:37.935828 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f0286c00-e671-4cf1-874d-eff999eba015-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 15:55:37 crc kubenswrapper[5120]: I0316 15:55:37.935837 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b7d40cc2-92b3-4f31-ad96-d8a11157d035-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 15:55:37 crc kubenswrapper[5120]: I0316 15:55:37.935847 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f9qkz\" (UniqueName: \"kubernetes.io/projected/7f39a386-dfd6-4e99-8fff-84323615eb1c-kube-api-access-f9qkz\") on node \"crc\" DevicePath \"\"" Mar 16 15:55:37 crc kubenswrapper[5120]: I0316 15:55:37.935858 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dc5l5\" (UniqueName: \"kubernetes.io/projected/7a212c23-f62a-4cb8-9c48-723d3aa714d6-kube-api-access-dc5l5\") on node \"crc\" DevicePath \"\"" Mar 16 15:55:37 crc kubenswrapper[5120]: I0316 15:55:37.937966 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0286c00-e671-4cf1-874d-eff999eba015-kube-api-access-m7gbq" (OuterVolumeSpecName: "kube-api-access-m7gbq") pod "f0286c00-e671-4cf1-874d-eff999eba015" (UID: "f0286c00-e671-4cf1-874d-eff999eba015"). InnerVolumeSpecName "kube-api-access-m7gbq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:55:37 crc kubenswrapper[5120]: I0316 15:55:37.938290 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32b14c32-be65-4d58-bb92-d61da48cc992-kube-api-access-xn4zj" (OuterVolumeSpecName: "kube-api-access-xn4zj") pod "32b14c32-be65-4d58-bb92-d61da48cc992" (UID: "32b14c32-be65-4d58-bb92-d61da48cc992"). InnerVolumeSpecName "kube-api-access-xn4zj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:55:37 crc kubenswrapper[5120]: I0316 15:55:37.938552 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7d40cc2-92b3-4f31-ad96-d8a11157d035-kube-api-access-6v7rh" (OuterVolumeSpecName: "kube-api-access-6v7rh") pod "b7d40cc2-92b3-4f31-ad96-d8a11157d035" (UID: "b7d40cc2-92b3-4f31-ad96-d8a11157d035"). InnerVolumeSpecName "kube-api-access-6v7rh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:55:38 crc kubenswrapper[5120]: I0316 15:55:38.038084 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xn4zj\" (UniqueName: \"kubernetes.io/projected/32b14c32-be65-4d58-bb92-d61da48cc992-kube-api-access-xn4zj\") on node \"crc\" DevicePath \"\"" Mar 16 15:55:38 crc kubenswrapper[5120]: I0316 15:55:38.038140 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6v7rh\" (UniqueName: \"kubernetes.io/projected/b7d40cc2-92b3-4f31-ad96-d8a11157d035-kube-api-access-6v7rh\") on node \"crc\" DevicePath \"\"" Mar 16 15:55:38 crc kubenswrapper[5120]: I0316 15:55:38.038159 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m7gbq\" (UniqueName: \"kubernetes.io/projected/f0286c00-e671-4cf1-874d-eff999eba015-kube-api-access-m7gbq\") on node \"crc\" DevicePath \"\"" Mar 16 15:55:38 crc kubenswrapper[5120]: I0316 15:55:38.194895 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-3fc7-account-create-update-q9jx6" event={"ID":"f0286c00-e671-4cf1-874d-eff999eba015","Type":"ContainerDied","Data":"37482354c87ab134c49220102c746f26255e758fdf024f193c6c6a9f9521ca31"} Mar 16 15:55:38 crc kubenswrapper[5120]: I0316 15:55:38.194953 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="37482354c87ab134c49220102c746f26255e758fdf024f193c6c6a9f9521ca31" Mar 16 15:55:38 crc kubenswrapper[5120]: I0316 15:55:38.194957 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-3fc7-account-create-update-q9jx6" Mar 16 15:55:38 crc kubenswrapper[5120]: I0316 15:55:38.198641 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-38cb-account-create-update-mw2hg" Mar 16 15:55:38 crc kubenswrapper[5120]: I0316 15:55:38.198640 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-38cb-account-create-update-mw2hg" event={"ID":"7a212c23-f62a-4cb8-9c48-723d3aa714d6","Type":"ContainerDied","Data":"bbd67d116d9b7a4249450b478fbcf4fd294c15ee052b4a0bed53b802ba8bbfb6"} Mar 16 15:55:38 crc kubenswrapper[5120]: I0316 15:55:38.199200 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bbd67d116d9b7a4249450b478fbcf4fd294c15ee052b4a0bed53b802ba8bbfb6" Mar 16 15:55:38 crc kubenswrapper[5120]: I0316 15:55:38.201615 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-create-nh9pb" Mar 16 15:55:38 crc kubenswrapper[5120]: I0316 15:55:38.201746 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-create-nh9pb" event={"ID":"32b14c32-be65-4d58-bb92-d61da48cc992","Type":"ContainerDied","Data":"d8ed2dd4afab87563960ee3d6417028a4838000e36973ef8dafa898b541a3e54"} Mar 16 15:55:38 crc kubenswrapper[5120]: I0316 15:55:38.201862 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d8ed2dd4afab87563960ee3d6417028a4838000e36973ef8dafa898b541a3e54" Mar 16 15:55:38 crc kubenswrapper[5120]: I0316 15:55:38.204068 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-62f1-account-create-update-vlpcg" Mar 16 15:55:38 crc kubenswrapper[5120]: I0316 15:55:38.204147 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-62f1-account-create-update-vlpcg" event={"ID":"b7d40cc2-92b3-4f31-ad96-d8a11157d035","Type":"ContainerDied","Data":"a65497d51065bc4af6eb816eb911b0b75461f743208f6feaf89a090bc98128e6"} Mar 16 15:55:38 crc kubenswrapper[5120]: I0316 15:55:38.204211 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a65497d51065bc4af6eb816eb911b0b75461f743208f6feaf89a090bc98128e6" Mar 16 15:55:38 crc kubenswrapper[5120]: I0316 15:55:38.206939 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-create-gqzqj" event={"ID":"461d1c44-31c5-45b2-8f2e-ecf239cb7b1e","Type":"ContainerDied","Data":"417d5478e054495930709fb0b9debfd6a7193db4576a860d5b225e54a70a1bcd"} Mar 16 15:55:38 crc kubenswrapper[5120]: I0316 15:55:38.207003 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="417d5478e054495930709fb0b9debfd6a7193db4576a860d5b225e54a70a1bcd" Mar 16 15:55:38 crc kubenswrapper[5120]: I0316 15:55:38.207259 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-create-gqzqj" Mar 16 15:55:38 crc kubenswrapper[5120]: I0316 15:55:38.209810 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-create-fmbn7" Mar 16 15:55:38 crc kubenswrapper[5120]: I0316 15:55:38.209861 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-create-fmbn7" event={"ID":"7f39a386-dfd6-4e99-8fff-84323615eb1c","Type":"ContainerDied","Data":"4ff1e0c18dd807b196492fb841a3488e1261f1ccb40e09e8be9ca8b6e411f188"} Mar 16 15:55:38 crc kubenswrapper[5120]: I0316 15:55:38.209926 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4ff1e0c18dd807b196492fb841a3488e1261f1ccb40e09e8be9ca8b6e411f188" Mar 16 15:55:38 crc kubenswrapper[5120]: I0316 15:55:38.643574 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-bwm2j" Mar 16 15:55:38 crc kubenswrapper[5120]: I0316 15:55:38.753940 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ec4c23f3-0b66-4795-8926-2aa0414de1ad-combined-ca-bundle\") pod \"ec4c23f3-0b66-4795-8926-2aa0414de1ad\" (UID: \"ec4c23f3-0b66-4795-8926-2aa0414de1ad\") " Mar 16 15:55:38 crc kubenswrapper[5120]: I0316 15:55:38.754198 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ck5wh\" (UniqueName: \"kubernetes.io/projected/ec4c23f3-0b66-4795-8926-2aa0414de1ad-kube-api-access-ck5wh\") pod \"ec4c23f3-0b66-4795-8926-2aa0414de1ad\" (UID: \"ec4c23f3-0b66-4795-8926-2aa0414de1ad\") " Mar 16 15:55:38 crc kubenswrapper[5120]: I0316 15:55:38.756244 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ec4c23f3-0b66-4795-8926-2aa0414de1ad-config-data\") pod \"ec4c23f3-0b66-4795-8926-2aa0414de1ad\" (UID: \"ec4c23f3-0b66-4795-8926-2aa0414de1ad\") " Mar 16 15:55:38 crc kubenswrapper[5120]: I0316 15:55:38.775033 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec4c23f3-0b66-4795-8926-2aa0414de1ad-kube-api-access-ck5wh" (OuterVolumeSpecName: "kube-api-access-ck5wh") pod "ec4c23f3-0b66-4795-8926-2aa0414de1ad" (UID: "ec4c23f3-0b66-4795-8926-2aa0414de1ad"). InnerVolumeSpecName "kube-api-access-ck5wh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:55:38 crc kubenswrapper[5120]: I0316 15:55:38.793419 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec4c23f3-0b66-4795-8926-2aa0414de1ad-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ec4c23f3-0b66-4795-8926-2aa0414de1ad" (UID: "ec4c23f3-0b66-4795-8926-2aa0414de1ad"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:55:38 crc kubenswrapper[5120]: I0316 15:55:38.819191 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec4c23f3-0b66-4795-8926-2aa0414de1ad-config-data" (OuterVolumeSpecName: "config-data") pod "ec4c23f3-0b66-4795-8926-2aa0414de1ad" (UID: "ec4c23f3-0b66-4795-8926-2aa0414de1ad"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:55:38 crc kubenswrapper[5120]: I0316 15:55:38.859236 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ck5wh\" (UniqueName: \"kubernetes.io/projected/ec4c23f3-0b66-4795-8926-2aa0414de1ad-kube-api-access-ck5wh\") on node \"crc\" DevicePath \"\"" Mar 16 15:55:38 crc kubenswrapper[5120]: I0316 15:55:38.859285 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ec4c23f3-0b66-4795-8926-2aa0414de1ad-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 15:55:38 crc kubenswrapper[5120]: I0316 15:55:38.859299 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ec4c23f3-0b66-4795-8926-2aa0414de1ad-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:55:39 crc kubenswrapper[5120]: I0316 15:55:39.225857 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-bwm2j" event={"ID":"ec4c23f3-0b66-4795-8926-2aa0414de1ad","Type":"ContainerDied","Data":"87d8a69f4dee7ce31541fd236a6d3910b7f60112b7371b46545c94dcf4872d85"} Mar 16 15:55:39 crc kubenswrapper[5120]: I0316 15:55:39.227159 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="87d8a69f4dee7ce31541fd236a6d3910b7f60112b7371b46545c94dcf4872d85" Mar 16 15:55:39 crc kubenswrapper[5120]: I0316 15:55:39.225957 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-bwm2j" Mar 16 15:55:39 crc kubenswrapper[5120]: I0316 15:55:39.902794 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-qhrl4"] Mar 16 15:55:39 crc kubenswrapper[5120]: I0316 15:55:39.904213 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32b14c32-be65-4d58-bb92-d61da48cc992" containerName="mariadb-database-create" Mar 16 15:55:39 crc kubenswrapper[5120]: I0316 15:55:39.904236 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="32b14c32-be65-4d58-bb92-d61da48cc992" containerName="mariadb-database-create" Mar 16 15:55:39 crc kubenswrapper[5120]: I0316 15:55:39.904253 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f39a386-dfd6-4e99-8fff-84323615eb1c" containerName="mariadb-database-create" Mar 16 15:55:39 crc kubenswrapper[5120]: I0316 15:55:39.904261 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f39a386-dfd6-4e99-8fff-84323615eb1c" containerName="mariadb-database-create" Mar 16 15:55:39 crc kubenswrapper[5120]: I0316 15:55:39.904291 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec4c23f3-0b66-4795-8926-2aa0414de1ad" containerName="keystone-db-sync" Mar 16 15:55:39 crc kubenswrapper[5120]: I0316 15:55:39.904299 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec4c23f3-0b66-4795-8926-2aa0414de1ad" containerName="keystone-db-sync" Mar 16 15:55:39 crc kubenswrapper[5120]: I0316 15:55:39.904306 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="461d1c44-31c5-45b2-8f2e-ecf239cb7b1e" containerName="mariadb-database-create" Mar 16 15:55:39 crc kubenswrapper[5120]: I0316 15:55:39.904313 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="461d1c44-31c5-45b2-8f2e-ecf239cb7b1e" containerName="mariadb-database-create" Mar 16 15:55:39 crc kubenswrapper[5120]: I0316 15:55:39.904344 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a212c23-f62a-4cb8-9c48-723d3aa714d6" containerName="mariadb-account-create-update" Mar 16 15:55:39 crc kubenswrapper[5120]: I0316 15:55:39.904353 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a212c23-f62a-4cb8-9c48-723d3aa714d6" containerName="mariadb-account-create-update" Mar 16 15:55:39 crc kubenswrapper[5120]: I0316 15:55:39.904363 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0286c00-e671-4cf1-874d-eff999eba015" containerName="mariadb-account-create-update" Mar 16 15:55:39 crc kubenswrapper[5120]: I0316 15:55:39.904370 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0286c00-e671-4cf1-874d-eff999eba015" containerName="mariadb-account-create-update" Mar 16 15:55:39 crc kubenswrapper[5120]: I0316 15:55:39.904387 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7d40cc2-92b3-4f31-ad96-d8a11157d035" containerName="mariadb-account-create-update" Mar 16 15:55:39 crc kubenswrapper[5120]: I0316 15:55:39.904396 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7d40cc2-92b3-4f31-ad96-d8a11157d035" containerName="mariadb-account-create-update" Mar 16 15:55:39 crc kubenswrapper[5120]: I0316 15:55:39.904576 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="b7d40cc2-92b3-4f31-ad96-d8a11157d035" containerName="mariadb-account-create-update" Mar 16 15:55:39 crc kubenswrapper[5120]: I0316 15:55:39.904592 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7a212c23-f62a-4cb8-9c48-723d3aa714d6" containerName="mariadb-account-create-update" Mar 16 15:55:39 crc kubenswrapper[5120]: I0316 15:55:39.904603 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="32b14c32-be65-4d58-bb92-d61da48cc992" containerName="mariadb-database-create" Mar 16 15:55:39 crc kubenswrapper[5120]: I0316 15:55:39.904614 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7f39a386-dfd6-4e99-8fff-84323615eb1c" containerName="mariadb-database-create" Mar 16 15:55:39 crc kubenswrapper[5120]: I0316 15:55:39.904624 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f0286c00-e671-4cf1-874d-eff999eba015" containerName="mariadb-account-create-update" Mar 16 15:55:39 crc kubenswrapper[5120]: I0316 15:55:39.904639 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ec4c23f3-0b66-4795-8926-2aa0414de1ad" containerName="keystone-db-sync" Mar 16 15:55:39 crc kubenswrapper[5120]: I0316 15:55:39.904656 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="461d1c44-31c5-45b2-8f2e-ecf239cb7b1e" containerName="mariadb-database-create" Mar 16 15:55:39 crc kubenswrapper[5120]: I0316 15:55:39.915913 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-qhrl4" Mar 16 15:55:39 crc kubenswrapper[5120]: I0316 15:55:39.919118 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-scripts\"" Mar 16 15:55:39 crc kubenswrapper[5120]: I0316 15:55:39.923312 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"osp-secret\"" Mar 16 15:55:39 crc kubenswrapper[5120]: I0316 15:55:39.923978 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone\"" Mar 16 15:55:39 crc kubenswrapper[5120]: I0316 15:55:39.924016 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-keystone-dockercfg-d2z5x\"" Mar 16 15:55:39 crc kubenswrapper[5120]: I0316 15:55:39.930686 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-config-data\"" Mar 16 15:55:39 crc kubenswrapper[5120]: I0316 15:55:39.937181 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-qhrl4"] Mar 16 15:55:39 crc kubenswrapper[5120]: I0316 15:55:39.984838 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpcs8\" (UniqueName: \"kubernetes.io/projected/81447c10-9237-49d3-9569-0e622dc555a6-kube-api-access-hpcs8\") pod \"keystone-bootstrap-qhrl4\" (UID: \"81447c10-9237-49d3-9569-0e622dc555a6\") " pod="openstack-kuttl-tests/keystone-bootstrap-qhrl4" Mar 16 15:55:39 crc kubenswrapper[5120]: I0316 15:55:39.985017 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/81447c10-9237-49d3-9569-0e622dc555a6-credential-keys\") pod \"keystone-bootstrap-qhrl4\" (UID: \"81447c10-9237-49d3-9569-0e622dc555a6\") " pod="openstack-kuttl-tests/keystone-bootstrap-qhrl4" Mar 16 15:55:39 crc kubenswrapper[5120]: I0316 15:55:39.985050 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/81447c10-9237-49d3-9569-0e622dc555a6-config-data\") pod \"keystone-bootstrap-qhrl4\" (UID: \"81447c10-9237-49d3-9569-0e622dc555a6\") " pod="openstack-kuttl-tests/keystone-bootstrap-qhrl4" Mar 16 15:55:39 crc kubenswrapper[5120]: I0316 15:55:39.985106 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/81447c10-9237-49d3-9569-0e622dc555a6-fernet-keys\") pod \"keystone-bootstrap-qhrl4\" (UID: \"81447c10-9237-49d3-9569-0e622dc555a6\") " pod="openstack-kuttl-tests/keystone-bootstrap-qhrl4" Mar 16 15:55:39 crc kubenswrapper[5120]: I0316 15:55:39.985171 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/81447c10-9237-49d3-9569-0e622dc555a6-scripts\") pod \"keystone-bootstrap-qhrl4\" (UID: \"81447c10-9237-49d3-9569-0e622dc555a6\") " pod="openstack-kuttl-tests/keystone-bootstrap-qhrl4" Mar 16 15:55:39 crc kubenswrapper[5120]: I0316 15:55:39.985191 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/81447c10-9237-49d3-9569-0e622dc555a6-combined-ca-bundle\") pod \"keystone-bootstrap-qhrl4\" (UID: \"81447c10-9237-49d3-9569-0e622dc555a6\") " pod="openstack-kuttl-tests/keystone-bootstrap-qhrl4" Mar 16 15:55:39 crc kubenswrapper[5120]: I0316 15:55:39.989101 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.001176 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.008549 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-scripts\"" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.008674 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-glance-dockercfg-mkhxb\"" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.008798 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-external-config-data\"" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.008909 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-public-svc\"" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.009041 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.052903 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-s8lzg"] Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.063013 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-s8lzg" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.066045 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-cinder-dockercfg-gbpgl\"" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.066410 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-scripts\"" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.072848 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-config-data\"" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.075837 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-t9zsb"] Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.088770 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0e6142dc-2153-4828-8808-f0d3dc8c3a37-config-data\") pod \"glance-default-external-api-0\" (UID: \"0e6142dc-2153-4828-8808-f0d3dc8c3a37\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.088865 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0e6142dc-2153-4828-8808-f0d3dc8c3a37-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"0e6142dc-2153-4828-8808-f0d3dc8c3a37\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.088899 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/81447c10-9237-49d3-9569-0e622dc555a6-credential-keys\") pod \"keystone-bootstrap-qhrl4\" (UID: \"81447c10-9237-49d3-9569-0e622dc555a6\") " pod="openstack-kuttl-tests/keystone-bootstrap-qhrl4" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.088920 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/81447c10-9237-49d3-9569-0e622dc555a6-config-data\") pod \"keystone-bootstrap-qhrl4\" (UID: \"81447c10-9237-49d3-9569-0e622dc555a6\") " pod="openstack-kuttl-tests/keystone-bootstrap-qhrl4" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.088940 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0e6142dc-2153-4828-8808-f0d3dc8c3a37-scripts\") pod \"glance-default-external-api-0\" (UID: \"0e6142dc-2153-4828-8808-f0d3dc8c3a37\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.088966 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0e6142dc-2153-4828-8808-f0d3dc8c3a37-logs\") pod \"glance-default-external-api-0\" (UID: \"0e6142dc-2153-4828-8808-f0d3dc8c3a37\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.088981 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/81447c10-9237-49d3-9569-0e622dc555a6-fernet-keys\") pod \"keystone-bootstrap-qhrl4\" (UID: \"81447c10-9237-49d3-9569-0e622dc555a6\") " pod="openstack-kuttl-tests/keystone-bootstrap-qhrl4" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.089009 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-js79n\" (UniqueName: \"kubernetes.io/projected/0e6142dc-2153-4828-8808-f0d3dc8c3a37-kube-api-access-js79n\") pod \"glance-default-external-api-0\" (UID: \"0e6142dc-2153-4828-8808-f0d3dc8c3a37\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.089062 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/81447c10-9237-49d3-9569-0e622dc555a6-scripts\") pod \"keystone-bootstrap-qhrl4\" (UID: \"81447c10-9237-49d3-9569-0e622dc555a6\") " pod="openstack-kuttl-tests/keystone-bootstrap-qhrl4" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.089078 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/81447c10-9237-49d3-9569-0e622dc555a6-combined-ca-bundle\") pod \"keystone-bootstrap-qhrl4\" (UID: \"81447c10-9237-49d3-9569-0e622dc555a6\") " pod="openstack-kuttl-tests/keystone-bootstrap-qhrl4" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.089113 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hpcs8\" (UniqueName: \"kubernetes.io/projected/81447c10-9237-49d3-9569-0e622dc555a6-kube-api-access-hpcs8\") pod \"keystone-bootstrap-qhrl4\" (UID: \"81447c10-9237-49d3-9569-0e622dc555a6\") " pod="openstack-kuttl-tests/keystone-bootstrap-qhrl4" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.089130 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/0e6142dc-2153-4828-8808-f0d3dc8c3a37-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"0e6142dc-2153-4828-8808-f0d3dc8c3a37\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.089177 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"glance-default-external-api-0\" (UID: \"0e6142dc-2153-4828-8808-f0d3dc8c3a37\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.089216 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/0e6142dc-2153-4828-8808-f0d3dc8c3a37-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"0e6142dc-2153-4828-8808-f0d3dc8c3a37\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.089887 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-t9zsb" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.099427 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-httpd-config\"" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.104100 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-neutron-dockercfg-vgbbs\"" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.104355 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-config\"" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.110025 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/81447c10-9237-49d3-9569-0e622dc555a6-combined-ca-bundle\") pod \"keystone-bootstrap-qhrl4\" (UID: \"81447c10-9237-49d3-9569-0e622dc555a6\") " pod="openstack-kuttl-tests/keystone-bootstrap-qhrl4" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.110464 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/81447c10-9237-49d3-9569-0e622dc555a6-scripts\") pod \"keystone-bootstrap-qhrl4\" (UID: \"81447c10-9237-49d3-9569-0e622dc555a6\") " pod="openstack-kuttl-tests/keystone-bootstrap-qhrl4" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.120632 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/81447c10-9237-49d3-9569-0e622dc555a6-config-data\") pod \"keystone-bootstrap-qhrl4\" (UID: \"81447c10-9237-49d3-9569-0e622dc555a6\") " pod="openstack-kuttl-tests/keystone-bootstrap-qhrl4" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.121011 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/81447c10-9237-49d3-9569-0e622dc555a6-fernet-keys\") pod \"keystone-bootstrap-qhrl4\" (UID: \"81447c10-9237-49d3-9569-0e622dc555a6\") " pod="openstack-kuttl-tests/keystone-bootstrap-qhrl4" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.122435 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/81447c10-9237-49d3-9569-0e622dc555a6-credential-keys\") pod \"keystone-bootstrap-qhrl4\" (UID: \"81447c10-9237-49d3-9569-0e622dc555a6\") " pod="openstack-kuttl-tests/keystone-bootstrap-qhrl4" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.127006 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpcs8\" (UniqueName: \"kubernetes.io/projected/81447c10-9237-49d3-9569-0e622dc555a6-kube-api-access-hpcs8\") pod \"keystone-bootstrap-qhrl4\" (UID: \"81447c10-9237-49d3-9569-0e622dc555a6\") " pod="openstack-kuttl-tests/keystone-bootstrap-qhrl4" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.160841 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-s8lzg"] Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.179976 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.189381 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.193129 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/8d7af5d0-3283-41d8-9e35-fa6a70fceb0a-etc-machine-id\") pod \"cinder-db-sync-s8lzg\" (UID: \"8d7af5d0-3283-41d8-9e35-fa6a70fceb0a\") " pod="openstack-kuttl-tests/cinder-db-sync-s8lzg" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.193159 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jcdf\" (UniqueName: \"kubernetes.io/projected/8d7af5d0-3283-41d8-9e35-fa6a70fceb0a-kube-api-access-9jcdf\") pod \"cinder-db-sync-s8lzg\" (UID: \"8d7af5d0-3283-41d8-9e35-fa6a70fceb0a\") " pod="openstack-kuttl-tests/cinder-db-sync-s8lzg" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.193195 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"glance-default-external-api-0\" (UID: \"0e6142dc-2153-4828-8808-f0d3dc8c3a37\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.193214 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8d7af5d0-3283-41d8-9e35-fa6a70fceb0a-scripts\") pod \"cinder-db-sync-s8lzg\" (UID: \"8d7af5d0-3283-41d8-9e35-fa6a70fceb0a\") " pod="openstack-kuttl-tests/cinder-db-sync-s8lzg" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.193248 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/0e6142dc-2153-4828-8808-f0d3dc8c3a37-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"0e6142dc-2153-4828-8808-f0d3dc8c3a37\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.193902 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"glance-default-external-api-0\" (UID: \"0e6142dc-2153-4828-8808-f0d3dc8c3a37\") device mount path \"/mnt/openstack/pv13\"" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.194994 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-internal-svc\"" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.195357 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-internal-config-data\"" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.195421 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-t9zsb"] Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.195471 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0e6142dc-2153-4828-8808-f0d3dc8c3a37-config-data\") pod \"glance-default-external-api-0\" (UID: \"0e6142dc-2153-4828-8808-f0d3dc8c3a37\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.196437 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/0e6142dc-2153-4828-8808-f0d3dc8c3a37-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"0e6142dc-2153-4828-8808-f0d3dc8c3a37\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.195657 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/8d7af5d0-3283-41d8-9e35-fa6a70fceb0a-db-sync-config-data\") pod \"cinder-db-sync-s8lzg\" (UID: \"8d7af5d0-3283-41d8-9e35-fa6a70fceb0a\") " pod="openstack-kuttl-tests/cinder-db-sync-s8lzg" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.196611 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6a021027-056a-410b-aab4-8d8aff25b21a-config\") pod \"neutron-db-sync-t9zsb\" (UID: \"6a021027-056a-410b-aab4-8d8aff25b21a\") " pod="openstack-kuttl-tests/neutron-db-sync-t9zsb" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.196655 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nm66b\" (UniqueName: \"kubernetes.io/projected/6a021027-056a-410b-aab4-8d8aff25b21a-kube-api-access-nm66b\") pod \"neutron-db-sync-t9zsb\" (UID: \"6a021027-056a-410b-aab4-8d8aff25b21a\") " pod="openstack-kuttl-tests/neutron-db-sync-t9zsb" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.196684 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0e6142dc-2153-4828-8808-f0d3dc8c3a37-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"0e6142dc-2153-4828-8808-f0d3dc8c3a37\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.196714 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0e6142dc-2153-4828-8808-f0d3dc8c3a37-scripts\") pod \"glance-default-external-api-0\" (UID: \"0e6142dc-2153-4828-8808-f0d3dc8c3a37\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.196735 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8d7af5d0-3283-41d8-9e35-fa6a70fceb0a-combined-ca-bundle\") pod \"cinder-db-sync-s8lzg\" (UID: \"8d7af5d0-3283-41d8-9e35-fa6a70fceb0a\") " pod="openstack-kuttl-tests/cinder-db-sync-s8lzg" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.196796 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0e6142dc-2153-4828-8808-f0d3dc8c3a37-logs\") pod \"glance-default-external-api-0\" (UID: \"0e6142dc-2153-4828-8808-f0d3dc8c3a37\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.196824 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-js79n\" (UniqueName: \"kubernetes.io/projected/0e6142dc-2153-4828-8808-f0d3dc8c3a37-kube-api-access-js79n\") pod \"glance-default-external-api-0\" (UID: \"0e6142dc-2153-4828-8808-f0d3dc8c3a37\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.196857 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8d7af5d0-3283-41d8-9e35-fa6a70fceb0a-config-data\") pod \"cinder-db-sync-s8lzg\" (UID: \"8d7af5d0-3283-41d8-9e35-fa6a70fceb0a\") " pod="openstack-kuttl-tests/cinder-db-sync-s8lzg" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.196892 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6a021027-056a-410b-aab4-8d8aff25b21a-combined-ca-bundle\") pod \"neutron-db-sync-t9zsb\" (UID: \"6a021027-056a-410b-aab4-8d8aff25b21a\") " pod="openstack-kuttl-tests/neutron-db-sync-t9zsb" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.197215 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0e6142dc-2153-4828-8808-f0d3dc8c3a37-logs\") pod \"glance-default-external-api-0\" (UID: \"0e6142dc-2153-4828-8808-f0d3dc8c3a37\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.197685 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/0e6142dc-2153-4828-8808-f0d3dc8c3a37-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"0e6142dc-2153-4828-8808-f0d3dc8c3a37\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.203152 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/0e6142dc-2153-4828-8808-f0d3dc8c3a37-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"0e6142dc-2153-4828-8808-f0d3dc8c3a37\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.213717 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.224172 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-db-sync-ctwpk"] Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.230937 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-ctwpk" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.231504 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0e6142dc-2153-4828-8808-f0d3dc8c3a37-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"0e6142dc-2153-4828-8808-f0d3dc8c3a37\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.239398 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-js79n\" (UniqueName: \"kubernetes.io/projected/0e6142dc-2153-4828-8808-f0d3dc8c3a37-kube-api-access-js79n\") pod \"glance-default-external-api-0\" (UID: \"0e6142dc-2153-4828-8808-f0d3dc8c3a37\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.253974 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0e6142dc-2153-4828-8808-f0d3dc8c3a37-config-data\") pod \"glance-default-external-api-0\" (UID: \"0e6142dc-2153-4828-8808-f0d3dc8c3a37\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.254543 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-ctwpk"] Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.263970 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-config-data\"" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.272318 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0e6142dc-2153-4828-8808-f0d3dc8c3a37-scripts\") pod \"glance-default-external-api-0\" (UID: \"0e6142dc-2153-4828-8808-f0d3dc8c3a37\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.273165 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-scripts\"" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.275232 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-placement-dockercfg-mtc64\"" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.282884 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-qhrl4" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.293369 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.307317 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/8d7af5d0-3283-41d8-9e35-fa6a70fceb0a-etc-machine-id\") pod \"cinder-db-sync-s8lzg\" (UID: \"8d7af5d0-3283-41d8-9e35-fa6a70fceb0a\") " pod="openstack-kuttl-tests/cinder-db-sync-s8lzg" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.307372 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9jcdf\" (UniqueName: \"kubernetes.io/projected/8d7af5d0-3283-41d8-9e35-fa6a70fceb0a-kube-api-access-9jcdf\") pod \"cinder-db-sync-s8lzg\" (UID: \"8d7af5d0-3283-41d8-9e35-fa6a70fceb0a\") " pod="openstack-kuttl-tests/cinder-db-sync-s8lzg" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.307440 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8d7af5d0-3283-41d8-9e35-fa6a70fceb0a-scripts\") pod \"cinder-db-sync-s8lzg\" (UID: \"8d7af5d0-3283-41d8-9e35-fa6a70fceb0a\") " pod="openstack-kuttl-tests/cinder-db-sync-s8lzg" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.307506 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-572tj\" (UniqueName: \"kubernetes.io/projected/12cfbef3-ce86-47bd-93e0-618b4bef9819-kube-api-access-572tj\") pod \"glance-default-internal-api-0\" (UID: \"12cfbef3-ce86-47bd-93e0-618b4bef9819\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.307596 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/12cfbef3-ce86-47bd-93e0-618b4bef9819-scripts\") pod \"glance-default-internal-api-0\" (UID: \"12cfbef3-ce86-47bd-93e0-618b4bef9819\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.307672 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/8d7af5d0-3283-41d8-9e35-fa6a70fceb0a-db-sync-config-data\") pod \"cinder-db-sync-s8lzg\" (UID: \"8d7af5d0-3283-41d8-9e35-fa6a70fceb0a\") " pod="openstack-kuttl-tests/cinder-db-sync-s8lzg" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.307694 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6a021027-056a-410b-aab4-8d8aff25b21a-config\") pod \"neutron-db-sync-t9zsb\" (UID: \"6a021027-056a-410b-aab4-8d8aff25b21a\") " pod="openstack-kuttl-tests/neutron-db-sync-t9zsb" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.307717 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3caac7df-6311-46c7-bb2c-4aab1caf55fb-combined-ca-bundle\") pod \"placement-db-sync-ctwpk\" (UID: \"3caac7df-6311-46c7-bb2c-4aab1caf55fb\") " pod="openstack-kuttl-tests/placement-db-sync-ctwpk" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.307812 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nm66b\" (UniqueName: \"kubernetes.io/projected/6a021027-056a-410b-aab4-8d8aff25b21a-kube-api-access-nm66b\") pod \"neutron-db-sync-t9zsb\" (UID: \"6a021027-056a-410b-aab4-8d8aff25b21a\") " pod="openstack-kuttl-tests/neutron-db-sync-t9zsb" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.307851 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3caac7df-6311-46c7-bb2c-4aab1caf55fb-scripts\") pod \"placement-db-sync-ctwpk\" (UID: \"3caac7df-6311-46c7-bb2c-4aab1caf55fb\") " pod="openstack-kuttl-tests/placement-db-sync-ctwpk" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.307918 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8d7af5d0-3283-41d8-9e35-fa6a70fceb0a-combined-ca-bundle\") pod \"cinder-db-sync-s8lzg\" (UID: \"8d7af5d0-3283-41d8-9e35-fa6a70fceb0a\") " pod="openstack-kuttl-tests/cinder-db-sync-s8lzg" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.308001 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3caac7df-6311-46c7-bb2c-4aab1caf55fb-logs\") pod \"placement-db-sync-ctwpk\" (UID: \"3caac7df-6311-46c7-bb2c-4aab1caf55fb\") " pod="openstack-kuttl-tests/placement-db-sync-ctwpk" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.308051 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8d7af5d0-3283-41d8-9e35-fa6a70fceb0a-config-data\") pod \"cinder-db-sync-s8lzg\" (UID: \"8d7af5d0-3283-41d8-9e35-fa6a70fceb0a\") " pod="openstack-kuttl-tests/cinder-db-sync-s8lzg" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.308096 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/12cfbef3-ce86-47bd-93e0-618b4bef9819-config-data\") pod \"glance-default-internal-api-0\" (UID: \"12cfbef3-ce86-47bd-93e0-618b4bef9819\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.308137 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/12cfbef3-ce86-47bd-93e0-618b4bef9819-logs\") pod \"glance-default-internal-api-0\" (UID: \"12cfbef3-ce86-47bd-93e0-618b4bef9819\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.308169 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/12cfbef3-ce86-47bd-93e0-618b4bef9819-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"12cfbef3-ce86-47bd-93e0-618b4bef9819\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.308198 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6a021027-056a-410b-aab4-8d8aff25b21a-combined-ca-bundle\") pod \"neutron-db-sync-t9zsb\" (UID: \"6a021027-056a-410b-aab4-8d8aff25b21a\") " pod="openstack-kuttl-tests/neutron-db-sync-t9zsb" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.308223 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/12cfbef3-ce86-47bd-93e0-618b4bef9819-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"12cfbef3-ce86-47bd-93e0-618b4bef9819\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.308248 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p76r4\" (UniqueName: \"kubernetes.io/projected/3caac7df-6311-46c7-bb2c-4aab1caf55fb-kube-api-access-p76r4\") pod \"placement-db-sync-ctwpk\" (UID: \"3caac7df-6311-46c7-bb2c-4aab1caf55fb\") " pod="openstack-kuttl-tests/placement-db-sync-ctwpk" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.308333 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"glance-default-internal-api-0\" (UID: \"12cfbef3-ce86-47bd-93e0-618b4bef9819\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.308363 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/12cfbef3-ce86-47bd-93e0-618b4bef9819-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"12cfbef3-ce86-47bd-93e0-618b4bef9819\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.308441 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3caac7df-6311-46c7-bb2c-4aab1caf55fb-config-data\") pod \"placement-db-sync-ctwpk\" (UID: \"3caac7df-6311-46c7-bb2c-4aab1caf55fb\") " pod="openstack-kuttl-tests/placement-db-sync-ctwpk" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.308587 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/8d7af5d0-3283-41d8-9e35-fa6a70fceb0a-etc-machine-id\") pod \"cinder-db-sync-s8lzg\" (UID: \"8d7af5d0-3283-41d8-9e35-fa6a70fceb0a\") " pod="openstack-kuttl-tests/cinder-db-sync-s8lzg" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.312265 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/8d7af5d0-3283-41d8-9e35-fa6a70fceb0a-db-sync-config-data\") pod \"cinder-db-sync-s8lzg\" (UID: \"8d7af5d0-3283-41d8-9e35-fa6a70fceb0a\") " pod="openstack-kuttl-tests/cinder-db-sync-s8lzg" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.315613 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/6a021027-056a-410b-aab4-8d8aff25b21a-config\") pod \"neutron-db-sync-t9zsb\" (UID: \"6a021027-056a-410b-aab4-8d8aff25b21a\") " pod="openstack-kuttl-tests/neutron-db-sync-t9zsb" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.341675 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6a021027-056a-410b-aab4-8d8aff25b21a-combined-ca-bundle\") pod \"neutron-db-sync-t9zsb\" (UID: \"6a021027-056a-410b-aab4-8d8aff25b21a\") " pod="openstack-kuttl-tests/neutron-db-sync-t9zsb" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.343701 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-flwl9"] Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.344408 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8d7af5d0-3283-41d8-9e35-fa6a70fceb0a-combined-ca-bundle\") pod \"cinder-db-sync-s8lzg\" (UID: \"8d7af5d0-3283-41d8-9e35-fa6a70fceb0a\") " pod="openstack-kuttl-tests/cinder-db-sync-s8lzg" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.344696 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.348992 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8d7af5d0-3283-41d8-9e35-fa6a70fceb0a-config-data\") pod \"cinder-db-sync-s8lzg\" (UID: \"8d7af5d0-3283-41d8-9e35-fa6a70fceb0a\") " pod="openstack-kuttl-tests/cinder-db-sync-s8lzg" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.345895 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nm66b\" (UniqueName: \"kubernetes.io/projected/6a021027-056a-410b-aab4-8d8aff25b21a-kube-api-access-nm66b\") pod \"neutron-db-sync-t9zsb\" (UID: \"6a021027-056a-410b-aab4-8d8aff25b21a\") " pod="openstack-kuttl-tests/neutron-db-sync-t9zsb" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.363925 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jcdf\" (UniqueName: \"kubernetes.io/projected/8d7af5d0-3283-41d8-9e35-fa6a70fceb0a-kube-api-access-9jcdf\") pod \"cinder-db-sync-s8lzg\" (UID: \"8d7af5d0-3283-41d8-9e35-fa6a70fceb0a\") " pod="openstack-kuttl-tests/cinder-db-sync-s8lzg" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.370027 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.371339 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"glance-default-external-api-0\" (UID: \"0e6142dc-2153-4828-8808-f0d3dc8c3a37\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.371504 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.373130 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8d7af5d0-3283-41d8-9e35-fa6a70fceb0a-scripts\") pod \"cinder-db-sync-s8lzg\" (UID: \"8d7af5d0-3283-41d8-9e35-fa6a70fceb0a\") " pod="openstack-kuttl-tests/cinder-db-sync-s8lzg" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.376961 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-flwl9" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.384143 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-barbican-dockercfg-kw7h8\"" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.387333 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-config-data\"" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.392680 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-s8lzg" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.399596 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.412495 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3caac7df-6311-46c7-bb2c-4aab1caf55fb-combined-ca-bundle\") pod \"placement-db-sync-ctwpk\" (UID: \"3caac7df-6311-46c7-bb2c-4aab1caf55fb\") " pod="openstack-kuttl-tests/placement-db-sync-ctwpk" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.412565 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftz5k\" (UniqueName: \"kubernetes.io/projected/afbd55dc-1c35-4749-860a-dcebcfefca25-kube-api-access-ftz5k\") pod \"barbican-db-sync-flwl9\" (UID: \"afbd55dc-1c35-4749-860a-dcebcfefca25\") " pod="openstack-kuttl-tests/barbican-db-sync-flwl9" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.412789 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3caac7df-6311-46c7-bb2c-4aab1caf55fb-scripts\") pod \"placement-db-sync-ctwpk\" (UID: \"3caac7df-6311-46c7-bb2c-4aab1caf55fb\") " pod="openstack-kuttl-tests/placement-db-sync-ctwpk" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.412819 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8b8d1827-2a30-4e12-b2a4-bccb49518ffc-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"8b8d1827-2a30-4e12-b2a4-bccb49518ffc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.413181 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/8b8d1827-2a30-4e12-b2a4-bccb49518ffc-log-httpd\") pod \"ceilometer-0\" (UID: \"8b8d1827-2a30-4e12-b2a4-bccb49518ffc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.413226 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3caac7df-6311-46c7-bb2c-4aab1caf55fb-logs\") pod \"placement-db-sync-ctwpk\" (UID: \"3caac7df-6311-46c7-bb2c-4aab1caf55fb\") " pod="openstack-kuttl-tests/placement-db-sync-ctwpk" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.413670 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/12cfbef3-ce86-47bd-93e0-618b4bef9819-config-data\") pod \"glance-default-internal-api-0\" (UID: \"12cfbef3-ce86-47bd-93e0-618b4bef9819\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.415733 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/12cfbef3-ce86-47bd-93e0-618b4bef9819-logs\") pod \"glance-default-internal-api-0\" (UID: \"12cfbef3-ce86-47bd-93e0-618b4bef9819\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.415788 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/12cfbef3-ce86-47bd-93e0-618b4bef9819-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"12cfbef3-ce86-47bd-93e0-618b4bef9819\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.415818 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/12cfbef3-ce86-47bd-93e0-618b4bef9819-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"12cfbef3-ce86-47bd-93e0-618b4bef9819\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.415839 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p76r4\" (UniqueName: \"kubernetes.io/projected/3caac7df-6311-46c7-bb2c-4aab1caf55fb-kube-api-access-p76r4\") pod \"placement-db-sync-ctwpk\" (UID: \"3caac7df-6311-46c7-bb2c-4aab1caf55fb\") " pod="openstack-kuttl-tests/placement-db-sync-ctwpk" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.415891 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"glance-default-internal-api-0\" (UID: \"12cfbef3-ce86-47bd-93e0-618b4bef9819\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.415914 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/8b8d1827-2a30-4e12-b2a4-bccb49518ffc-run-httpd\") pod \"ceilometer-0\" (UID: \"8b8d1827-2a30-4e12-b2a4-bccb49518ffc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.415983 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/12cfbef3-ce86-47bd-93e0-618b4bef9819-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"12cfbef3-ce86-47bd-93e0-618b4bef9819\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.416011 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/afbd55dc-1c35-4749-860a-dcebcfefca25-db-sync-config-data\") pod \"barbican-db-sync-flwl9\" (UID: \"afbd55dc-1c35-4749-860a-dcebcfefca25\") " pod="openstack-kuttl-tests/barbican-db-sync-flwl9" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.416099 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3caac7df-6311-46c7-bb2c-4aab1caf55fb-config-data\") pod \"placement-db-sync-ctwpk\" (UID: \"3caac7df-6311-46c7-bb2c-4aab1caf55fb\") " pod="openstack-kuttl-tests/placement-db-sync-ctwpk" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.416159 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8b8d1827-2a30-4e12-b2a4-bccb49518ffc-config-data\") pod \"ceilometer-0\" (UID: \"8b8d1827-2a30-4e12-b2a4-bccb49518ffc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.416192 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-572tj\" (UniqueName: \"kubernetes.io/projected/12cfbef3-ce86-47bd-93e0-618b4bef9819-kube-api-access-572tj\") pod \"glance-default-internal-api-0\" (UID: \"12cfbef3-ce86-47bd-93e0-618b4bef9819\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.416219 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8b8d1827-2a30-4e12-b2a4-bccb49518ffc-scripts\") pod \"ceilometer-0\" (UID: \"8b8d1827-2a30-4e12-b2a4-bccb49518ffc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.416240 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/afbd55dc-1c35-4749-860a-dcebcfefca25-combined-ca-bundle\") pod \"barbican-db-sync-flwl9\" (UID: \"afbd55dc-1c35-4749-860a-dcebcfefca25\") " pod="openstack-kuttl-tests/barbican-db-sync-flwl9" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.416265 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/8b8d1827-2a30-4e12-b2a4-bccb49518ffc-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"8b8d1827-2a30-4e12-b2a4-bccb49518ffc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.416573 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/12cfbef3-ce86-47bd-93e0-618b4bef9819-scripts\") pod \"glance-default-internal-api-0\" (UID: \"12cfbef3-ce86-47bd-93e0-618b4bef9819\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.416600 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hzc6\" (UniqueName: \"kubernetes.io/projected/8b8d1827-2a30-4e12-b2a4-bccb49518ffc-kube-api-access-4hzc6\") pod \"ceilometer-0\" (UID: \"8b8d1827-2a30-4e12-b2a4-bccb49518ffc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.417993 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"glance-default-internal-api-0\" (UID: \"12cfbef3-ce86-47bd-93e0-618b4bef9819\") device mount path \"/mnt/openstack/pv09\"" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.418053 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3caac7df-6311-46c7-bb2c-4aab1caf55fb-logs\") pod \"placement-db-sync-ctwpk\" (UID: \"3caac7df-6311-46c7-bb2c-4aab1caf55fb\") " pod="openstack-kuttl-tests/placement-db-sync-ctwpk" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.418474 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/12cfbef3-ce86-47bd-93e0-618b4bef9819-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"12cfbef3-ce86-47bd-93e0-618b4bef9819\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.419979 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/12cfbef3-ce86-47bd-93e0-618b4bef9819-logs\") pod \"glance-default-internal-api-0\" (UID: \"12cfbef3-ce86-47bd-93e0-618b4bef9819\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.420037 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-flwl9"] Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.424396 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3caac7df-6311-46c7-bb2c-4aab1caf55fb-config-data\") pod \"placement-db-sync-ctwpk\" (UID: \"3caac7df-6311-46c7-bb2c-4aab1caf55fb\") " pod="openstack-kuttl-tests/placement-db-sync-ctwpk" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.425145 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3caac7df-6311-46c7-bb2c-4aab1caf55fb-scripts\") pod \"placement-db-sync-ctwpk\" (UID: \"3caac7df-6311-46c7-bb2c-4aab1caf55fb\") " pod="openstack-kuttl-tests/placement-db-sync-ctwpk" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.425141 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/12cfbef3-ce86-47bd-93e0-618b4bef9819-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"12cfbef3-ce86-47bd-93e0-618b4bef9819\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.426239 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/12cfbef3-ce86-47bd-93e0-618b4bef9819-config-data\") pod \"glance-default-internal-api-0\" (UID: \"12cfbef3-ce86-47bd-93e0-618b4bef9819\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.427627 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/12cfbef3-ce86-47bd-93e0-618b4bef9819-scripts\") pod \"glance-default-internal-api-0\" (UID: \"12cfbef3-ce86-47bd-93e0-618b4bef9819\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.428269 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/12cfbef3-ce86-47bd-93e0-618b4bef9819-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"12cfbef3-ce86-47bd-93e0-618b4bef9819\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.433444 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3caac7df-6311-46c7-bb2c-4aab1caf55fb-combined-ca-bundle\") pod \"placement-db-sync-ctwpk\" (UID: \"3caac7df-6311-46c7-bb2c-4aab1caf55fb\") " pod="openstack-kuttl-tests/placement-db-sync-ctwpk" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.441480 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p76r4\" (UniqueName: \"kubernetes.io/projected/3caac7df-6311-46c7-bb2c-4aab1caf55fb-kube-api-access-p76r4\") pod \"placement-db-sync-ctwpk\" (UID: \"3caac7df-6311-46c7-bb2c-4aab1caf55fb\") " pod="openstack-kuttl-tests/placement-db-sync-ctwpk" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.446807 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-572tj\" (UniqueName: \"kubernetes.io/projected/12cfbef3-ce86-47bd-93e0-618b4bef9819-kube-api-access-572tj\") pod \"glance-default-internal-api-0\" (UID: \"12cfbef3-ce86-47bd-93e0-618b4bef9819\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.493749 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"glance-default-internal-api-0\" (UID: \"12cfbef3-ce86-47bd-93e0-618b4bef9819\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.518523 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/8b8d1827-2a30-4e12-b2a4-bccb49518ffc-log-httpd\") pod \"ceilometer-0\" (UID: \"8b8d1827-2a30-4e12-b2a4-bccb49518ffc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.518609 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/8b8d1827-2a30-4e12-b2a4-bccb49518ffc-run-httpd\") pod \"ceilometer-0\" (UID: \"8b8d1827-2a30-4e12-b2a4-bccb49518ffc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.518635 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/afbd55dc-1c35-4749-860a-dcebcfefca25-db-sync-config-data\") pod \"barbican-db-sync-flwl9\" (UID: \"afbd55dc-1c35-4749-860a-dcebcfefca25\") " pod="openstack-kuttl-tests/barbican-db-sync-flwl9" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.518685 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8b8d1827-2a30-4e12-b2a4-bccb49518ffc-config-data\") pod \"ceilometer-0\" (UID: \"8b8d1827-2a30-4e12-b2a4-bccb49518ffc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.518727 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8b8d1827-2a30-4e12-b2a4-bccb49518ffc-scripts\") pod \"ceilometer-0\" (UID: \"8b8d1827-2a30-4e12-b2a4-bccb49518ffc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.518742 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/afbd55dc-1c35-4749-860a-dcebcfefca25-combined-ca-bundle\") pod \"barbican-db-sync-flwl9\" (UID: \"afbd55dc-1c35-4749-860a-dcebcfefca25\") " pod="openstack-kuttl-tests/barbican-db-sync-flwl9" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.518773 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/8b8d1827-2a30-4e12-b2a4-bccb49518ffc-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"8b8d1827-2a30-4e12-b2a4-bccb49518ffc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.518799 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4hzc6\" (UniqueName: \"kubernetes.io/projected/8b8d1827-2a30-4e12-b2a4-bccb49518ffc-kube-api-access-4hzc6\") pod \"ceilometer-0\" (UID: \"8b8d1827-2a30-4e12-b2a4-bccb49518ffc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.518860 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ftz5k\" (UniqueName: \"kubernetes.io/projected/afbd55dc-1c35-4749-860a-dcebcfefca25-kube-api-access-ftz5k\") pod \"barbican-db-sync-flwl9\" (UID: \"afbd55dc-1c35-4749-860a-dcebcfefca25\") " pod="openstack-kuttl-tests/barbican-db-sync-flwl9" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.518896 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8b8d1827-2a30-4e12-b2a4-bccb49518ffc-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"8b8d1827-2a30-4e12-b2a4-bccb49518ffc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.522129 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/8b8d1827-2a30-4e12-b2a4-bccb49518ffc-run-httpd\") pod \"ceilometer-0\" (UID: \"8b8d1827-2a30-4e12-b2a4-bccb49518ffc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.522642 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/8b8d1827-2a30-4e12-b2a4-bccb49518ffc-log-httpd\") pod \"ceilometer-0\" (UID: \"8b8d1827-2a30-4e12-b2a4-bccb49518ffc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.525232 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8b8d1827-2a30-4e12-b2a4-bccb49518ffc-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"8b8d1827-2a30-4e12-b2a4-bccb49518ffc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.525463 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/afbd55dc-1c35-4749-860a-dcebcfefca25-db-sync-config-data\") pod \"barbican-db-sync-flwl9\" (UID: \"afbd55dc-1c35-4749-860a-dcebcfefca25\") " pod="openstack-kuttl-tests/barbican-db-sync-flwl9" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.529165 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8b8d1827-2a30-4e12-b2a4-bccb49518ffc-scripts\") pod \"ceilometer-0\" (UID: \"8b8d1827-2a30-4e12-b2a4-bccb49518ffc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.531392 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/8b8d1827-2a30-4e12-b2a4-bccb49518ffc-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"8b8d1827-2a30-4e12-b2a4-bccb49518ffc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.532678 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/afbd55dc-1c35-4749-860a-dcebcfefca25-combined-ca-bundle\") pod \"barbican-db-sync-flwl9\" (UID: \"afbd55dc-1c35-4749-860a-dcebcfefca25\") " pod="openstack-kuttl-tests/barbican-db-sync-flwl9" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.534065 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8b8d1827-2a30-4e12-b2a4-bccb49518ffc-config-data\") pod \"ceilometer-0\" (UID: \"8b8d1827-2a30-4e12-b2a4-bccb49518ffc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.539427 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hzc6\" (UniqueName: \"kubernetes.io/projected/8b8d1827-2a30-4e12-b2a4-bccb49518ffc-kube-api-access-4hzc6\") pod \"ceilometer-0\" (UID: \"8b8d1827-2a30-4e12-b2a4-bccb49518ffc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.548719 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftz5k\" (UniqueName: \"kubernetes.io/projected/afbd55dc-1c35-4749-860a-dcebcfefca25-kube-api-access-ftz5k\") pod \"barbican-db-sync-flwl9\" (UID: \"afbd55dc-1c35-4749-860a-dcebcfefca25\") " pod="openstack-kuttl-tests/barbican-db-sync-flwl9" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.575708 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-t9zsb" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.602324 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.620676 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.659714 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-ctwpk" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.688601 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.700379 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-flwl9" Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.825812 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-qhrl4"] Mar 16 15:55:40 crc kubenswrapper[5120]: I0316 15:55:40.928799 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-s8lzg"] Mar 16 15:55:40 crc kubenswrapper[5120]: W0316 15:55:40.935696 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8d7af5d0_3283_41d8_9e35_fa6a70fceb0a.slice/crio-02dc8095aa9cae2aa60423e960d13f4d83458c4693f5f6a0de3a3fb8735efc31 WatchSource:0}: Error finding container 02dc8095aa9cae2aa60423e960d13f4d83458c4693f5f6a0de3a3fb8735efc31: Status 404 returned error can't find the container with id 02dc8095aa9cae2aa60423e960d13f4d83458c4693f5f6a0de3a3fb8735efc31 Mar 16 15:55:41 crc kubenswrapper[5120]: I0316 15:55:41.125480 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-t9zsb"] Mar 16 15:55:41 crc kubenswrapper[5120]: W0316 15:55:41.137222 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6a021027_056a_410b_aab4_8d8aff25b21a.slice/crio-25ff190377037d72b478fa625109e7c03b0032ad5a2690b3aefb6b839691a8cf WatchSource:0}: Error finding container 25ff190377037d72b478fa625109e7c03b0032ad5a2690b3aefb6b839691a8cf: Status 404 returned error can't find the container with id 25ff190377037d72b478fa625109e7c03b0032ad5a2690b3aefb6b839691a8cf Mar 16 15:55:41 crc kubenswrapper[5120]: I0316 15:55:41.236575 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 15:55:41 crc kubenswrapper[5120]: I0316 15:55:41.327274 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-ctwpk"] Mar 16 15:55:41 crc kubenswrapper[5120]: I0316 15:55:41.338820 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-flwl9"] Mar 16 15:55:41 crc kubenswrapper[5120]: I0316 15:55:41.345461 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"12cfbef3-ce86-47bd-93e0-618b4bef9819","Type":"ContainerStarted","Data":"2fdbe753d41a4114c617000620d9a564160d20b3f8e765e96577610eb60aaf48"} Mar 16 15:55:41 crc kubenswrapper[5120]: I0316 15:55:41.347363 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-s8lzg" event={"ID":"8d7af5d0-3283-41d8-9e35-fa6a70fceb0a","Type":"ContainerStarted","Data":"02dc8095aa9cae2aa60423e960d13f4d83458c4693f5f6a0de3a3fb8735efc31"} Mar 16 15:55:41 crc kubenswrapper[5120]: W0316 15:55:41.348500 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podafbd55dc_1c35_4749_860a_dcebcfefca25.slice/crio-4c31822b974ccb59274c0f60429906e9bf38b56e99fa0b743dbe4dfa7a39c635 WatchSource:0}: Error finding container 4c31822b974ccb59274c0f60429906e9bf38b56e99fa0b743dbe4dfa7a39c635: Status 404 returned error can't find the container with id 4c31822b974ccb59274c0f60429906e9bf38b56e99fa0b743dbe4dfa7a39c635 Mar 16 15:55:41 crc kubenswrapper[5120]: I0316 15:55:41.349029 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 15:55:41 crc kubenswrapper[5120]: I0316 15:55:41.350450 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-t9zsb" event={"ID":"6a021027-056a-410b-aab4-8d8aff25b21a","Type":"ContainerStarted","Data":"25ff190377037d72b478fa625109e7c03b0032ad5a2690b3aefb6b839691a8cf"} Mar 16 15:55:41 crc kubenswrapper[5120]: I0316 15:55:41.352806 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-qhrl4" event={"ID":"81447c10-9237-49d3-9569-0e622dc555a6","Type":"ContainerStarted","Data":"5ee503ff630324e345a43ee14c47148d1ff922720322c91eb8dbfa52c2461c42"} Mar 16 15:55:41 crc kubenswrapper[5120]: I0316 15:55:41.353086 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-qhrl4" event={"ID":"81447c10-9237-49d3-9569-0e622dc555a6","Type":"ContainerStarted","Data":"3c9dbb0944861311fe405b2ca99452f97b4ab7094e2f74b445d422c4bc36e738"} Mar 16 15:55:41 crc kubenswrapper[5120]: I0316 15:55:41.381132 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-bootstrap-qhrl4" podStartSLOduration=2.381110478 podStartE2EDuration="2.381110478s" podCreationTimestamp="2026-03-16 15:55:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:55:41.367976064 +0000 UTC m=+1443.521907721" watchObservedRunningTime="2026-03-16 15:55:41.381110478 +0000 UTC m=+1443.535042125" Mar 16 15:55:41 crc kubenswrapper[5120]: I0316 15:55:41.526161 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 15:55:41 crc kubenswrapper[5120]: I0316 15:55:41.860267 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 15:55:41 crc kubenswrapper[5120]: I0316 15:55:41.939428 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 15:55:41 crc kubenswrapper[5120]: I0316 15:55:41.946564 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 15:55:42 crc kubenswrapper[5120]: I0316 15:55:42.371083 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-t9zsb" event={"ID":"6a021027-056a-410b-aab4-8d8aff25b21a","Type":"ContainerStarted","Data":"8e6f8366d74fb157d8fdc1c1ae6c9db0eb8bce126c29574e00b155c9de9cbfa6"} Mar 16 15:55:42 crc kubenswrapper[5120]: I0316 15:55:42.381600 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-flwl9" event={"ID":"afbd55dc-1c35-4749-860a-dcebcfefca25","Type":"ContainerStarted","Data":"b721b97f025f3d84f068611af272c59bad2f5fd660230c1fcc2455e9d90a0192"} Mar 16 15:55:42 crc kubenswrapper[5120]: I0316 15:55:42.381646 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-flwl9" event={"ID":"afbd55dc-1c35-4749-860a-dcebcfefca25","Type":"ContainerStarted","Data":"4c31822b974ccb59274c0f60429906e9bf38b56e99fa0b743dbe4dfa7a39c635"} Mar 16 15:55:42 crc kubenswrapper[5120]: I0316 15:55:42.389496 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-db-sync-t9zsb" podStartSLOduration=2.389479628 podStartE2EDuration="2.389479628s" podCreationTimestamp="2026-03-16 15:55:40 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:55:42.389252542 +0000 UTC m=+1444.543184189" watchObservedRunningTime="2026-03-16 15:55:42.389479628 +0000 UTC m=+1444.543411285" Mar 16 15:55:42 crc kubenswrapper[5120]: I0316 15:55:42.405401 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"8b8d1827-2a30-4e12-b2a4-bccb49518ffc","Type":"ContainerStarted","Data":"03e260e6227a8ec97d356bf6f223ac68e607d9af18552883f6f1b4a1daeb488b"} Mar 16 15:55:42 crc kubenswrapper[5120]: I0316 15:55:42.410466 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-db-sync-flwl9" podStartSLOduration=2.4104486290000002 podStartE2EDuration="2.410448629s" podCreationTimestamp="2026-03-16 15:55:40 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:55:42.404488443 +0000 UTC m=+1444.558420100" watchObservedRunningTime="2026-03-16 15:55:42.410448629 +0000 UTC m=+1444.564380286" Mar 16 15:55:42 crc kubenswrapper[5120]: I0316 15:55:42.429976 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-ctwpk" event={"ID":"3caac7df-6311-46c7-bb2c-4aab1caf55fb","Type":"ContainerStarted","Data":"4a996f5f48bf60bbfc7b1381fa4b67dcccf4a1e706c124ab891f58be4c3e6342"} Mar 16 15:55:42 crc kubenswrapper[5120]: I0316 15:55:42.430043 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-ctwpk" event={"ID":"3caac7df-6311-46c7-bb2c-4aab1caf55fb","Type":"ContainerStarted","Data":"e89e121804f933d9ce2bfb62ce18f59265f9d584c6006ec8bffc1887f634a904"} Mar 16 15:55:42 crc kubenswrapper[5120]: I0316 15:55:42.454990 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"0e6142dc-2153-4828-8808-f0d3dc8c3a37","Type":"ContainerStarted","Data":"a321c5bab4d23c968ad25b9bab1d70de021cd5de096bb1e761bdd6515b67c8ac"} Mar 16 15:55:42 crc kubenswrapper[5120]: I0316 15:55:42.471375 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-db-sync-ctwpk" podStartSLOduration=2.471354845 podStartE2EDuration="2.471354845s" podCreationTimestamp="2026-03-16 15:55:40 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:55:42.467352614 +0000 UTC m=+1444.621284271" watchObservedRunningTime="2026-03-16 15:55:42.471354845 +0000 UTC m=+1444.625286502" Mar 16 15:55:43 crc kubenswrapper[5120]: I0316 15:55:43.478084 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"12cfbef3-ce86-47bd-93e0-618b4bef9819","Type":"ContainerStarted","Data":"2ec1e85bd4f4e2d46d5526e83997621e85686e3be1d4c1e745e56ec52db2fa09"} Mar 16 15:55:43 crc kubenswrapper[5120]: I0316 15:55:43.480704 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"0e6142dc-2153-4828-8808-f0d3dc8c3a37","Type":"ContainerStarted","Data":"39e40cfd66e88168fe015f7ac730b5087965d55de20bfcae8f241de6185b3aae"} Mar 16 15:55:43 crc kubenswrapper[5120]: I0316 15:55:43.487137 5120 generic.go:358] "Generic (PLEG): container finished" podID="afbd55dc-1c35-4749-860a-dcebcfefca25" containerID="b721b97f025f3d84f068611af272c59bad2f5fd660230c1fcc2455e9d90a0192" exitCode=0 Mar 16 15:55:43 crc kubenswrapper[5120]: I0316 15:55:43.487317 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-flwl9" event={"ID":"afbd55dc-1c35-4749-860a-dcebcfefca25","Type":"ContainerDied","Data":"b721b97f025f3d84f068611af272c59bad2f5fd660230c1fcc2455e9d90a0192"} Mar 16 15:55:43 crc kubenswrapper[5120]: I0316 15:55:43.500488 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"8b8d1827-2a30-4e12-b2a4-bccb49518ffc","Type":"ContainerStarted","Data":"cc7e5e9f455cdb4dfa2088d3b46a1f4cda1432e042f33ee229e4cc180f4a34ec"} Mar 16 15:55:43 crc kubenswrapper[5120]: I0316 15:55:43.867401 5120 scope.go:117] "RemoveContainer" containerID="09392570662a59fc70e23951bc67499bff758e9ff6016774b3bbe8dfd1cae387" Mar 16 15:55:43 crc kubenswrapper[5120]: I0316 15:55:43.913125 5120 scope.go:117] "RemoveContainer" containerID="5e8cdc5b4230c00c1992f86f19b7c3329acc7b0ca62fb691c31aa39678e05f32" Mar 16 15:55:43 crc kubenswrapper[5120]: I0316 15:55:43.971407 5120 scope.go:117] "RemoveContainer" containerID="21a6731c9cc7f5b6a4b7f93045c6fa21596e01cbb0fdcb88466c03991a106a12" Mar 16 15:55:44 crc kubenswrapper[5120]: I0316 15:55:44.034030 5120 scope.go:117] "RemoveContainer" containerID="53bfc98ae96bd02dd4b590c7c9eac982590f422687bb9e9d20a74394998b120f" Mar 16 15:55:44 crc kubenswrapper[5120]: I0316 15:55:44.075072 5120 scope.go:117] "RemoveContainer" containerID="65b8f8294c2f4cce23696de5ead69c2b76ed3f72df2fb7301e81f9a30c54c5dd" Mar 16 15:55:44 crc kubenswrapper[5120]: I0316 15:55:44.518120 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"12cfbef3-ce86-47bd-93e0-618b4bef9819","Type":"ContainerStarted","Data":"d4031b3c0a6356d5f078ec59b682128c3a721e210be8315bc9d90acfc2965f3c"} Mar 16 15:55:44 crc kubenswrapper[5120]: I0316 15:55:44.518521 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="12cfbef3-ce86-47bd-93e0-618b4bef9819" containerName="glance-log" containerID="cri-o://2ec1e85bd4f4e2d46d5526e83997621e85686e3be1d4c1e745e56ec52db2fa09" gracePeriod=30 Mar 16 15:55:44 crc kubenswrapper[5120]: I0316 15:55:44.518633 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="12cfbef3-ce86-47bd-93e0-618b4bef9819" containerName="glance-httpd" containerID="cri-o://d4031b3c0a6356d5f078ec59b682128c3a721e210be8315bc9d90acfc2965f3c" gracePeriod=30 Mar 16 15:55:44 crc kubenswrapper[5120]: I0316 15:55:44.520098 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-s8lzg" event={"ID":"8d7af5d0-3283-41d8-9e35-fa6a70fceb0a","Type":"ContainerStarted","Data":"a126851b3d7daac11080ae4cc6f484666da78c21af025c9eb08a6db6f6f87ceb"} Mar 16 15:55:44 crc kubenswrapper[5120]: I0316 15:55:44.530098 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"0e6142dc-2153-4828-8808-f0d3dc8c3a37","Type":"ContainerStarted","Data":"c2923a3d45d47fd87ebbc1247f8778e9579159dbdae511922abf8ae3eb66c6f4"} Mar 16 15:55:44 crc kubenswrapper[5120]: I0316 15:55:44.530198 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="0e6142dc-2153-4828-8808-f0d3dc8c3a37" containerName="glance-log" containerID="cri-o://39e40cfd66e88168fe015f7ac730b5087965d55de20bfcae8f241de6185b3aae" gracePeriod=30 Mar 16 15:55:44 crc kubenswrapper[5120]: I0316 15:55:44.530356 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="0e6142dc-2153-4828-8808-f0d3dc8c3a37" containerName="glance-httpd" containerID="cri-o://c2923a3d45d47fd87ebbc1247f8778e9579159dbdae511922abf8ae3eb66c6f4" gracePeriod=30 Mar 16 15:55:44 crc kubenswrapper[5120]: I0316 15:55:44.543058 5120 generic.go:358] "Generic (PLEG): container finished" podID="6a021027-056a-410b-aab4-8d8aff25b21a" containerID="8e6f8366d74fb157d8fdc1c1ae6c9db0eb8bce126c29574e00b155c9de9cbfa6" exitCode=0 Mar 16 15:55:44 crc kubenswrapper[5120]: I0316 15:55:44.543323 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-t9zsb" event={"ID":"6a021027-056a-410b-aab4-8d8aff25b21a","Type":"ContainerDied","Data":"8e6f8366d74fb157d8fdc1c1ae6c9db0eb8bce126c29574e00b155c9de9cbfa6"} Mar 16 15:55:44 crc kubenswrapper[5120]: I0316 15:55:44.545118 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-internal-api-0" podStartSLOduration=4.545101303 podStartE2EDuration="4.545101303s" podCreationTimestamp="2026-03-16 15:55:40 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:55:44.541899314 +0000 UTC m=+1446.695830971" watchObservedRunningTime="2026-03-16 15:55:44.545101303 +0000 UTC m=+1446.699032960" Mar 16 15:55:44 crc kubenswrapper[5120]: I0316 15:55:44.559196 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"8b8d1827-2a30-4e12-b2a4-bccb49518ffc","Type":"ContainerStarted","Data":"361efc4887708e8641e75ee835fd9bc36c81740accd42664a3e3b1acd93cc485"} Mar 16 15:55:44 crc kubenswrapper[5120]: I0316 15:55:44.566626 5120 generic.go:358] "Generic (PLEG): container finished" podID="3caac7df-6311-46c7-bb2c-4aab1caf55fb" containerID="4a996f5f48bf60bbfc7b1381fa4b67dcccf4a1e706c124ab891f58be4c3e6342" exitCode=0 Mar 16 15:55:44 crc kubenswrapper[5120]: I0316 15:55:44.566963 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-ctwpk" event={"ID":"3caac7df-6311-46c7-bb2c-4aab1caf55fb","Type":"ContainerDied","Data":"4a996f5f48bf60bbfc7b1381fa4b67dcccf4a1e706c124ab891f58be4c3e6342"} Mar 16 15:55:44 crc kubenswrapper[5120]: I0316 15:55:44.576231 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-db-sync-s8lzg" podStartSLOduration=4.576211424 podStartE2EDuration="4.576211424s" podCreationTimestamp="2026-03-16 15:55:40 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:55:44.566735182 +0000 UTC m=+1446.720666849" watchObservedRunningTime="2026-03-16 15:55:44.576211424 +0000 UTC m=+1446.730143081" Mar 16 15:55:44 crc kubenswrapper[5120]: I0316 15:55:44.591605 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-external-api-0" podStartSLOduration=5.59158646 podStartE2EDuration="5.59158646s" podCreationTimestamp="2026-03-16 15:55:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:55:44.589008699 +0000 UTC m=+1446.742940376" watchObservedRunningTime="2026-03-16 15:55:44.59158646 +0000 UTC m=+1446.745518107" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.276658 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-flwl9" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.440427 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.447524 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ftz5k\" (UniqueName: \"kubernetes.io/projected/afbd55dc-1c35-4749-860a-dcebcfefca25-kube-api-access-ftz5k\") pod \"afbd55dc-1c35-4749-860a-dcebcfefca25\" (UID: \"afbd55dc-1c35-4749-860a-dcebcfefca25\") " Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.448643 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/afbd55dc-1c35-4749-860a-dcebcfefca25-db-sync-config-data\") pod \"afbd55dc-1c35-4749-860a-dcebcfefca25\" (UID: \"afbd55dc-1c35-4749-860a-dcebcfefca25\") " Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.448723 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/afbd55dc-1c35-4749-860a-dcebcfefca25-combined-ca-bundle\") pod \"afbd55dc-1c35-4749-860a-dcebcfefca25\" (UID: \"afbd55dc-1c35-4749-860a-dcebcfefca25\") " Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.454613 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/afbd55dc-1c35-4749-860a-dcebcfefca25-db-sync-config-data" (OuterVolumeSpecName: "db-sync-config-data") pod "afbd55dc-1c35-4749-860a-dcebcfefca25" (UID: "afbd55dc-1c35-4749-860a-dcebcfefca25"). InnerVolumeSpecName "db-sync-config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.455557 5120 reconciler_common.go:299] "Volume detached for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/afbd55dc-1c35-4749-860a-dcebcfefca25-db-sync-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.456801 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/afbd55dc-1c35-4749-860a-dcebcfefca25-kube-api-access-ftz5k" (OuterVolumeSpecName: "kube-api-access-ftz5k") pod "afbd55dc-1c35-4749-860a-dcebcfefca25" (UID: "afbd55dc-1c35-4749-860a-dcebcfefca25"). InnerVolumeSpecName "kube-api-access-ftz5k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.495149 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/afbd55dc-1c35-4749-860a-dcebcfefca25-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "afbd55dc-1c35-4749-860a-dcebcfefca25" (UID: "afbd55dc-1c35-4749-860a-dcebcfefca25"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.556266 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0e6142dc-2153-4828-8808-f0d3dc8c3a37-scripts\") pod \"0e6142dc-2153-4828-8808-f0d3dc8c3a37\" (UID: \"0e6142dc-2153-4828-8808-f0d3dc8c3a37\") " Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.556334 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0e6142dc-2153-4828-8808-f0d3dc8c3a37-config-data\") pod \"0e6142dc-2153-4828-8808-f0d3dc8c3a37\" (UID: \"0e6142dc-2153-4828-8808-f0d3dc8c3a37\") " Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.556438 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0e6142dc-2153-4828-8808-f0d3dc8c3a37-combined-ca-bundle\") pod \"0e6142dc-2153-4828-8808-f0d3dc8c3a37\" (UID: \"0e6142dc-2153-4828-8808-f0d3dc8c3a37\") " Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.556564 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0e6142dc-2153-4828-8808-f0d3dc8c3a37-logs\") pod \"0e6142dc-2153-4828-8808-f0d3dc8c3a37\" (UID: \"0e6142dc-2153-4828-8808-f0d3dc8c3a37\") " Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.556617 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/0e6142dc-2153-4828-8808-f0d3dc8c3a37-public-tls-certs\") pod \"0e6142dc-2153-4828-8808-f0d3dc8c3a37\" (UID: \"0e6142dc-2153-4828-8808-f0d3dc8c3a37\") " Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.556666 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/0e6142dc-2153-4828-8808-f0d3dc8c3a37-httpd-run\") pod \"0e6142dc-2153-4828-8808-f0d3dc8c3a37\" (UID: \"0e6142dc-2153-4828-8808-f0d3dc8c3a37\") " Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.556723 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-js79n\" (UniqueName: \"kubernetes.io/projected/0e6142dc-2153-4828-8808-f0d3dc8c3a37-kube-api-access-js79n\") pod \"0e6142dc-2153-4828-8808-f0d3dc8c3a37\" (UID: \"0e6142dc-2153-4828-8808-f0d3dc8c3a37\") " Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.556771 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"0e6142dc-2153-4828-8808-f0d3dc8c3a37\" (UID: \"0e6142dc-2153-4828-8808-f0d3dc8c3a37\") " Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.557064 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ftz5k\" (UniqueName: \"kubernetes.io/projected/afbd55dc-1c35-4749-860a-dcebcfefca25-kube-api-access-ftz5k\") on node \"crc\" DevicePath \"\"" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.557075 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/afbd55dc-1c35-4749-860a-dcebcfefca25-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.557445 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e6142dc-2153-4828-8808-f0d3dc8c3a37-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "0e6142dc-2153-4828-8808-f0d3dc8c3a37" (UID: "0e6142dc-2153-4828-8808-f0d3dc8c3a37"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.557744 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e6142dc-2153-4828-8808-f0d3dc8c3a37-logs" (OuterVolumeSpecName: "logs") pod "0e6142dc-2153-4828-8808-f0d3dc8c3a37" (UID: "0e6142dc-2153-4828-8808-f0d3dc8c3a37"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.561661 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e6142dc-2153-4828-8808-f0d3dc8c3a37-scripts" (OuterVolumeSpecName: "scripts") pod "0e6142dc-2153-4828-8808-f0d3dc8c3a37" (UID: "0e6142dc-2153-4828-8808-f0d3dc8c3a37"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.571868 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-worker-f5857446c-9l89n"] Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.573713 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e6142dc-2153-4828-8808-f0d3dc8c3a37" containerName="glance-httpd" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.573751 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e6142dc-2153-4828-8808-f0d3dc8c3a37" containerName="glance-httpd" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.573794 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="afbd55dc-1c35-4749-860a-dcebcfefca25" containerName="barbican-db-sync" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.573800 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="afbd55dc-1c35-4749-860a-dcebcfefca25" containerName="barbican-db-sync" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.573830 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e6142dc-2153-4828-8808-f0d3dc8c3a37" containerName="glance-log" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.573836 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e6142dc-2153-4828-8808-f0d3dc8c3a37" containerName="glance-log" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.574004 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="0e6142dc-2153-4828-8808-f0d3dc8c3a37" containerName="glance-log" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.574021 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="0e6142dc-2153-4828-8808-f0d3dc8c3a37" containerName="glance-httpd" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.574035 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="afbd55dc-1c35-4749-860a-dcebcfefca25" containerName="barbican-db-sync" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.575392 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e6142dc-2153-4828-8808-f0d3dc8c3a37-kube-api-access-js79n" (OuterVolumeSpecName: "kube-api-access-js79n") pod "0e6142dc-2153-4828-8808-f0d3dc8c3a37" (UID: "0e6142dc-2153-4828-8808-f0d3dc8c3a37"). InnerVolumeSpecName "kube-api-access-js79n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.599998 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage13-crc" (OuterVolumeSpecName: "glance") pod "0e6142dc-2153-4828-8808-f0d3dc8c3a37" (UID: "0e6142dc-2153-4828-8808-f0d3dc8c3a37"). InnerVolumeSpecName "local-storage13-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.603363 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.603974 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-f5857446c-9l89n" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.604499 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-f5857446c-9l89n"] Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.611040 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-worker-config-data\"" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.622620 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-dc8f675f4-72f6q"] Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.623963 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12cfbef3-ce86-47bd-93e0-618b4bef9819" containerName="glance-log" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.623978 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="12cfbef3-ce86-47bd-93e0-618b4bef9819" containerName="glance-log" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.624038 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12cfbef3-ce86-47bd-93e0-618b4bef9819" containerName="glance-httpd" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.624044 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="12cfbef3-ce86-47bd-93e0-618b4bef9819" containerName="glance-httpd" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.624244 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="12cfbef3-ce86-47bd-93e0-618b4bef9819" containerName="glance-httpd" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.624261 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="12cfbef3-ce86-47bd-93e0-618b4bef9819" containerName="glance-log" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.631890 5120 generic.go:358] "Generic (PLEG): container finished" podID="12cfbef3-ce86-47bd-93e0-618b4bef9819" containerID="d4031b3c0a6356d5f078ec59b682128c3a721e210be8315bc9d90acfc2965f3c" exitCode=0 Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.631924 5120 generic.go:358] "Generic (PLEG): container finished" podID="12cfbef3-ce86-47bd-93e0-618b4bef9819" containerID="2ec1e85bd4f4e2d46d5526e83997621e85686e3be1d4c1e745e56ec52db2fa09" exitCode=143 Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.634265 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"12cfbef3-ce86-47bd-93e0-618b4bef9819","Type":"ContainerDied","Data":"d4031b3c0a6356d5f078ec59b682128c3a721e210be8315bc9d90acfc2965f3c"} Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.634335 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"12cfbef3-ce86-47bd-93e0-618b4bef9819","Type":"ContainerDied","Data":"2ec1e85bd4f4e2d46d5526e83997621e85686e3be1d4c1e745e56ec52db2fa09"} Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.634351 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"12cfbef3-ce86-47bd-93e0-618b4bef9819","Type":"ContainerDied","Data":"2fdbe753d41a4114c617000620d9a564160d20b3f8e765e96577610eb60aaf48"} Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.634384 5120 scope.go:117] "RemoveContainer" containerID="d4031b3c0a6356d5f078ec59b682128c3a721e210be8315bc9d90acfc2965f3c" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.634667 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.635007 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-dc8f675f4-72f6q" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.652186 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-keystone-listener-config-data\"" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.658557 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/0e6142dc-2153-4828-8808-f0d3dc8c3a37-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.658583 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-js79n\" (UniqueName: \"kubernetes.io/projected/0e6142dc-2153-4828-8808-f0d3dc8c3a37-kube-api-access-js79n\") on node \"crc\" DevicePath \"\"" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.658614 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") on node \"crc\" " Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.658624 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0e6142dc-2153-4828-8808-f0d3dc8c3a37-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.658633 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0e6142dc-2153-4828-8808-f0d3dc8c3a37-logs\") on node \"crc\" DevicePath \"\"" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.662369 5120 generic.go:358] "Generic (PLEG): container finished" podID="0e6142dc-2153-4828-8808-f0d3dc8c3a37" containerID="c2923a3d45d47fd87ebbc1247f8778e9579159dbdae511922abf8ae3eb66c6f4" exitCode=0 Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.662399 5120 generic.go:358] "Generic (PLEG): container finished" podID="0e6142dc-2153-4828-8808-f0d3dc8c3a37" containerID="39e40cfd66e88168fe015f7ac730b5087965d55de20bfcae8f241de6185b3aae" exitCode=143 Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.662589 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"0e6142dc-2153-4828-8808-f0d3dc8c3a37","Type":"ContainerDied","Data":"c2923a3d45d47fd87ebbc1247f8778e9579159dbdae511922abf8ae3eb66c6f4"} Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.662625 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"0e6142dc-2153-4828-8808-f0d3dc8c3a37","Type":"ContainerDied","Data":"39e40cfd66e88168fe015f7ac730b5087965d55de20bfcae8f241de6185b3aae"} Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.662637 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"0e6142dc-2153-4828-8808-f0d3dc8c3a37","Type":"ContainerDied","Data":"a321c5bab4d23c968ad25b9bab1d70de021cd5de096bb1e761bdd6515b67c8ac"} Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.662813 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.664145 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-dc8f675f4-72f6q"] Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.666361 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-flwl9" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.666629 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-flwl9" event={"ID":"afbd55dc-1c35-4749-860a-dcebcfefca25","Type":"ContainerDied","Data":"4c31822b974ccb59274c0f60429906e9bf38b56e99fa0b743dbe4dfa7a39c635"} Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.666740 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4c31822b974ccb59274c0f60429906e9bf38b56e99fa0b743dbe4dfa7a39c635" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.676212 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"8b8d1827-2a30-4e12-b2a4-bccb49518ffc","Type":"ContainerStarted","Data":"ccb30b885978e94a539c5cd7d3f7d92bf602eb53324edd161e2f1697fdd364cb"} Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.681659 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e6142dc-2153-4828-8808-f0d3dc8c3a37-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "0e6142dc-2153-4828-8808-f0d3dc8c3a37" (UID: "0e6142dc-2153-4828-8808-f0d3dc8c3a37"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.708447 5120 scope.go:117] "RemoveContainer" containerID="2ec1e85bd4f4e2d46d5526e83997621e85686e3be1d4c1e745e56ec52db2fa09" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.712141 5120 generic.go:358] "Generic (PLEG): container finished" podID="81447c10-9237-49d3-9569-0e622dc555a6" containerID="5ee503ff630324e345a43ee14c47148d1ff922720322c91eb8dbfa52c2461c42" exitCode=0 Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.713483 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-qhrl4" event={"ID":"81447c10-9237-49d3-9569-0e622dc555a6","Type":"ContainerDied","Data":"5ee503ff630324e345a43ee14c47148d1ff922720322c91eb8dbfa52c2461c42"} Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.720602 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e6142dc-2153-4828-8808-f0d3dc8c3a37-config-data" (OuterVolumeSpecName: "config-data") pod "0e6142dc-2153-4828-8808-f0d3dc8c3a37" (UID: "0e6142dc-2153-4828-8808-f0d3dc8c3a37"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.739578 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-api-846956b868-5mw5q"] Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.760529 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/12cfbef3-ce86-47bd-93e0-618b4bef9819-combined-ca-bundle\") pod \"12cfbef3-ce86-47bd-93e0-618b4bef9819\" (UID: \"12cfbef3-ce86-47bd-93e0-618b4bef9819\") " Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.760595 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/12cfbef3-ce86-47bd-93e0-618b4bef9819-internal-tls-certs\") pod \"12cfbef3-ce86-47bd-93e0-618b4bef9819\" (UID: \"12cfbef3-ce86-47bd-93e0-618b4bef9819\") " Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.760632 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-572tj\" (UniqueName: \"kubernetes.io/projected/12cfbef3-ce86-47bd-93e0-618b4bef9819-kube-api-access-572tj\") pod \"12cfbef3-ce86-47bd-93e0-618b4bef9819\" (UID: \"12cfbef3-ce86-47bd-93e0-618b4bef9819\") " Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.760723 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/12cfbef3-ce86-47bd-93e0-618b4bef9819-scripts\") pod \"12cfbef3-ce86-47bd-93e0-618b4bef9819\" (UID: \"12cfbef3-ce86-47bd-93e0-618b4bef9819\") " Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.760750 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/12cfbef3-ce86-47bd-93e0-618b4bef9819-logs\") pod \"12cfbef3-ce86-47bd-93e0-618b4bef9819\" (UID: \"12cfbef3-ce86-47bd-93e0-618b4bef9819\") " Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.760814 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/12cfbef3-ce86-47bd-93e0-618b4bef9819-config-data\") pod \"12cfbef3-ce86-47bd-93e0-618b4bef9819\" (UID: \"12cfbef3-ce86-47bd-93e0-618b4bef9819\") " Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.760852 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/12cfbef3-ce86-47bd-93e0-618b4bef9819-httpd-run\") pod \"12cfbef3-ce86-47bd-93e0-618b4bef9819\" (UID: \"12cfbef3-ce86-47bd-93e0-618b4bef9819\") " Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.760883 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"12cfbef3-ce86-47bd-93e0-618b4bef9819\" (UID: \"12cfbef3-ce86-47bd-93e0-618b4bef9819\") " Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.761131 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/9da74618-45dc-4a60-8f6a-dfb9c30cb13a-config-data-custom\") pod \"barbican-keystone-listener-dc8f675f4-72f6q\" (UID: \"9da74618-45dc-4a60-8f6a-dfb9c30cb13a\") " pod="openstack-kuttl-tests/barbican-keystone-listener-dc8f675f4-72f6q" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.761200 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/26088cd7-dfce-4ccd-b93e-87a82505e96d-logs\") pod \"barbican-worker-f5857446c-9l89n\" (UID: \"26088cd7-dfce-4ccd-b93e-87a82505e96d\") " pod="openstack-kuttl-tests/barbican-worker-f5857446c-9l89n" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.761275 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2s7q\" (UniqueName: \"kubernetes.io/projected/26088cd7-dfce-4ccd-b93e-87a82505e96d-kube-api-access-j2s7q\") pod \"barbican-worker-f5857446c-9l89n\" (UID: \"26088cd7-dfce-4ccd-b93e-87a82505e96d\") " pod="openstack-kuttl-tests/barbican-worker-f5857446c-9l89n" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.761411 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmg47\" (UniqueName: \"kubernetes.io/projected/9da74618-45dc-4a60-8f6a-dfb9c30cb13a-kube-api-access-kmg47\") pod \"barbican-keystone-listener-dc8f675f4-72f6q\" (UID: \"9da74618-45dc-4a60-8f6a-dfb9c30cb13a\") " pod="openstack-kuttl-tests/barbican-keystone-listener-dc8f675f4-72f6q" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.761493 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9da74618-45dc-4a60-8f6a-dfb9c30cb13a-logs\") pod \"barbican-keystone-listener-dc8f675f4-72f6q\" (UID: \"9da74618-45dc-4a60-8f6a-dfb9c30cb13a\") " pod="openstack-kuttl-tests/barbican-keystone-listener-dc8f675f4-72f6q" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.761519 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9da74618-45dc-4a60-8f6a-dfb9c30cb13a-config-data\") pod \"barbican-keystone-listener-dc8f675f4-72f6q\" (UID: \"9da74618-45dc-4a60-8f6a-dfb9c30cb13a\") " pod="openstack-kuttl-tests/barbican-keystone-listener-dc8f675f4-72f6q" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.761589 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/26088cd7-dfce-4ccd-b93e-87a82505e96d-config-data-custom\") pod \"barbican-worker-f5857446c-9l89n\" (UID: \"26088cd7-dfce-4ccd-b93e-87a82505e96d\") " pod="openstack-kuttl-tests/barbican-worker-f5857446c-9l89n" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.761678 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/26088cd7-dfce-4ccd-b93e-87a82505e96d-combined-ca-bundle\") pod \"barbican-worker-f5857446c-9l89n\" (UID: \"26088cd7-dfce-4ccd-b93e-87a82505e96d\") " pod="openstack-kuttl-tests/barbican-worker-f5857446c-9l89n" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.761746 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/26088cd7-dfce-4ccd-b93e-87a82505e96d-config-data\") pod \"barbican-worker-f5857446c-9l89n\" (UID: \"26088cd7-dfce-4ccd-b93e-87a82505e96d\") " pod="openstack-kuttl-tests/barbican-worker-f5857446c-9l89n" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.761811 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9da74618-45dc-4a60-8f6a-dfb9c30cb13a-combined-ca-bundle\") pod \"barbican-keystone-listener-dc8f675f4-72f6q\" (UID: \"9da74618-45dc-4a60-8f6a-dfb9c30cb13a\") " pod="openstack-kuttl-tests/barbican-keystone-listener-dc8f675f4-72f6q" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.762025 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0e6142dc-2153-4828-8808-f0d3dc8c3a37-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.763852 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-846956b868-5mw5q" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.768442 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-api-config-data\"" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.768620 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0e6142dc-2153-4828-8808-f0d3dc8c3a37-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.768814 5120 scope.go:117] "RemoveContainer" containerID="d4031b3c0a6356d5f078ec59b682128c3a721e210be8315bc9d90acfc2965f3c" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.774872 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage13-crc" (UniqueName: "kubernetes.io/local-volume/local-storage13-crc") on node "crc" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.777397 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12cfbef3-ce86-47bd-93e0-618b4bef9819-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "12cfbef3-ce86-47bd-93e0-618b4bef9819" (UID: "12cfbef3-ce86-47bd-93e0-618b4bef9819"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.778138 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12cfbef3-ce86-47bd-93e0-618b4bef9819-logs" (OuterVolumeSpecName: "logs") pod "12cfbef3-ce86-47bd-93e0-618b4bef9819" (UID: "12cfbef3-ce86-47bd-93e0-618b4bef9819"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.779103 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage09-crc" (OuterVolumeSpecName: "glance") pod "12cfbef3-ce86-47bd-93e0-618b4bef9819" (UID: "12cfbef3-ce86-47bd-93e0-618b4bef9819"). InnerVolumeSpecName "local-storage09-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.779887 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/12cfbef3-ce86-47bd-93e0-618b4bef9819-scripts" (OuterVolumeSpecName: "scripts") pod "12cfbef3-ce86-47bd-93e0-618b4bef9819" (UID: "12cfbef3-ce86-47bd-93e0-618b4bef9819"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:55:45 crc kubenswrapper[5120]: E0316 15:55:45.781016 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d4031b3c0a6356d5f078ec59b682128c3a721e210be8315bc9d90acfc2965f3c\": container with ID starting with d4031b3c0a6356d5f078ec59b682128c3a721e210be8315bc9d90acfc2965f3c not found: ID does not exist" containerID="d4031b3c0a6356d5f078ec59b682128c3a721e210be8315bc9d90acfc2965f3c" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.781056 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4031b3c0a6356d5f078ec59b682128c3a721e210be8315bc9d90acfc2965f3c"} err="failed to get container status \"d4031b3c0a6356d5f078ec59b682128c3a721e210be8315bc9d90acfc2965f3c\": rpc error: code = NotFound desc = could not find container \"d4031b3c0a6356d5f078ec59b682128c3a721e210be8315bc9d90acfc2965f3c\": container with ID starting with d4031b3c0a6356d5f078ec59b682128c3a721e210be8315bc9d90acfc2965f3c not found: ID does not exist" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.781083 5120 scope.go:117] "RemoveContainer" containerID="2ec1e85bd4f4e2d46d5526e83997621e85686e3be1d4c1e745e56ec52db2fa09" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.782470 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12cfbef3-ce86-47bd-93e0-618b4bef9819-kube-api-access-572tj" (OuterVolumeSpecName: "kube-api-access-572tj") pod "12cfbef3-ce86-47bd-93e0-618b4bef9819" (UID: "12cfbef3-ce86-47bd-93e0-618b4bef9819"). InnerVolumeSpecName "kube-api-access-572tj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.783228 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e6142dc-2153-4828-8808-f0d3dc8c3a37-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "0e6142dc-2153-4828-8808-f0d3dc8c3a37" (UID: "0e6142dc-2153-4828-8808-f0d3dc8c3a37"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:55:45 crc kubenswrapper[5120]: E0316 15:55:45.783336 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2ec1e85bd4f4e2d46d5526e83997621e85686e3be1d4c1e745e56ec52db2fa09\": container with ID starting with 2ec1e85bd4f4e2d46d5526e83997621e85686e3be1d4c1e745e56ec52db2fa09 not found: ID does not exist" containerID="2ec1e85bd4f4e2d46d5526e83997621e85686e3be1d4c1e745e56ec52db2fa09" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.783376 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ec1e85bd4f4e2d46d5526e83997621e85686e3be1d4c1e745e56ec52db2fa09"} err="failed to get container status \"2ec1e85bd4f4e2d46d5526e83997621e85686e3be1d4c1e745e56ec52db2fa09\": rpc error: code = NotFound desc = could not find container \"2ec1e85bd4f4e2d46d5526e83997621e85686e3be1d4c1e745e56ec52db2fa09\": container with ID starting with 2ec1e85bd4f4e2d46d5526e83997621e85686e3be1d4c1e745e56ec52db2fa09 not found: ID does not exist" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.783398 5120 scope.go:117] "RemoveContainer" containerID="d4031b3c0a6356d5f078ec59b682128c3a721e210be8315bc9d90acfc2965f3c" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.788452 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4031b3c0a6356d5f078ec59b682128c3a721e210be8315bc9d90acfc2965f3c"} err="failed to get container status \"d4031b3c0a6356d5f078ec59b682128c3a721e210be8315bc9d90acfc2965f3c\": rpc error: code = NotFound desc = could not find container \"d4031b3c0a6356d5f078ec59b682128c3a721e210be8315bc9d90acfc2965f3c\": container with ID starting with d4031b3c0a6356d5f078ec59b682128c3a721e210be8315bc9d90acfc2965f3c not found: ID does not exist" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.788482 5120 scope.go:117] "RemoveContainer" containerID="2ec1e85bd4f4e2d46d5526e83997621e85686e3be1d4c1e745e56ec52db2fa09" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.789822 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ec1e85bd4f4e2d46d5526e83997621e85686e3be1d4c1e745e56ec52db2fa09"} err="failed to get container status \"2ec1e85bd4f4e2d46d5526e83997621e85686e3be1d4c1e745e56ec52db2fa09\": rpc error: code = NotFound desc = could not find container \"2ec1e85bd4f4e2d46d5526e83997621e85686e3be1d4c1e745e56ec52db2fa09\": container with ID starting with 2ec1e85bd4f4e2d46d5526e83997621e85686e3be1d4c1e745e56ec52db2fa09 not found: ID does not exist" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.789849 5120 scope.go:117] "RemoveContainer" containerID="c2923a3d45d47fd87ebbc1247f8778e9579159dbdae511922abf8ae3eb66c6f4" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.825707 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-846956b868-5mw5q"] Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.834877 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/12cfbef3-ce86-47bd-93e0-618b4bef9819-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "12cfbef3-ce86-47bd-93e0-618b4bef9819" (UID: "12cfbef3-ce86-47bd-93e0-618b4bef9819"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.838862 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/12cfbef3-ce86-47bd-93e0-618b4bef9819-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "12cfbef3-ce86-47bd-93e0-618b4bef9819" (UID: "12cfbef3-ce86-47bd-93e0-618b4bef9819"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.861867 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/12cfbef3-ce86-47bd-93e0-618b4bef9819-config-data" (OuterVolumeSpecName: "config-data") pod "12cfbef3-ce86-47bd-93e0-618b4bef9819" (UID: "12cfbef3-ce86-47bd-93e0-618b4bef9819"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.869994 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/26088cd7-dfce-4ccd-b93e-87a82505e96d-config-data\") pod \"barbican-worker-f5857446c-9l89n\" (UID: \"26088cd7-dfce-4ccd-b93e-87a82505e96d\") " pod="openstack-kuttl-tests/barbican-worker-f5857446c-9l89n" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.870045 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9da74618-45dc-4a60-8f6a-dfb9c30cb13a-combined-ca-bundle\") pod \"barbican-keystone-listener-dc8f675f4-72f6q\" (UID: \"9da74618-45dc-4a60-8f6a-dfb9c30cb13a\") " pod="openstack-kuttl-tests/barbican-keystone-listener-dc8f675f4-72f6q" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.870083 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2bdcf641-1e8c-4994-8981-4db0f4c37973-combined-ca-bundle\") pod \"barbican-api-846956b868-5mw5q\" (UID: \"2bdcf641-1e8c-4994-8981-4db0f4c37973\") " pod="openstack-kuttl-tests/barbican-api-846956b868-5mw5q" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.870289 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/9da74618-45dc-4a60-8f6a-dfb9c30cb13a-config-data-custom\") pod \"barbican-keystone-listener-dc8f675f4-72f6q\" (UID: \"9da74618-45dc-4a60-8f6a-dfb9c30cb13a\") " pod="openstack-kuttl-tests/barbican-keystone-listener-dc8f675f4-72f6q" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.870316 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/26088cd7-dfce-4ccd-b93e-87a82505e96d-logs\") pod \"barbican-worker-f5857446c-9l89n\" (UID: \"26088cd7-dfce-4ccd-b93e-87a82505e96d\") " pod="openstack-kuttl-tests/barbican-worker-f5857446c-9l89n" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.870336 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2bdcf641-1e8c-4994-8981-4db0f4c37973-logs\") pod \"barbican-api-846956b868-5mw5q\" (UID: \"2bdcf641-1e8c-4994-8981-4db0f4c37973\") " pod="openstack-kuttl-tests/barbican-api-846956b868-5mw5q" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.870369 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j2s7q\" (UniqueName: \"kubernetes.io/projected/26088cd7-dfce-4ccd-b93e-87a82505e96d-kube-api-access-j2s7q\") pod \"barbican-worker-f5857446c-9l89n\" (UID: \"26088cd7-dfce-4ccd-b93e-87a82505e96d\") " pod="openstack-kuttl-tests/barbican-worker-f5857446c-9l89n" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.870396 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kmg47\" (UniqueName: \"kubernetes.io/projected/9da74618-45dc-4a60-8f6a-dfb9c30cb13a-kube-api-access-kmg47\") pod \"barbican-keystone-listener-dc8f675f4-72f6q\" (UID: \"9da74618-45dc-4a60-8f6a-dfb9c30cb13a\") " pod="openstack-kuttl-tests/barbican-keystone-listener-dc8f675f4-72f6q" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.870455 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9da74618-45dc-4a60-8f6a-dfb9c30cb13a-logs\") pod \"barbican-keystone-listener-dc8f675f4-72f6q\" (UID: \"9da74618-45dc-4a60-8f6a-dfb9c30cb13a\") " pod="openstack-kuttl-tests/barbican-keystone-listener-dc8f675f4-72f6q" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.870479 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9da74618-45dc-4a60-8f6a-dfb9c30cb13a-config-data\") pod \"barbican-keystone-listener-dc8f675f4-72f6q\" (UID: \"9da74618-45dc-4a60-8f6a-dfb9c30cb13a\") " pod="openstack-kuttl-tests/barbican-keystone-listener-dc8f675f4-72f6q" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.870503 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/2bdcf641-1e8c-4994-8981-4db0f4c37973-config-data-custom\") pod \"barbican-api-846956b868-5mw5q\" (UID: \"2bdcf641-1e8c-4994-8981-4db0f4c37973\") " pod="openstack-kuttl-tests/barbican-api-846956b868-5mw5q" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.870520 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2bdcf641-1e8c-4994-8981-4db0f4c37973-config-data\") pod \"barbican-api-846956b868-5mw5q\" (UID: \"2bdcf641-1e8c-4994-8981-4db0f4c37973\") " pod="openstack-kuttl-tests/barbican-api-846956b868-5mw5q" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.870557 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/26088cd7-dfce-4ccd-b93e-87a82505e96d-config-data-custom\") pod \"barbican-worker-f5857446c-9l89n\" (UID: \"26088cd7-dfce-4ccd-b93e-87a82505e96d\") " pod="openstack-kuttl-tests/barbican-worker-f5857446c-9l89n" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.870607 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rg5gd\" (UniqueName: \"kubernetes.io/projected/2bdcf641-1e8c-4994-8981-4db0f4c37973-kube-api-access-rg5gd\") pod \"barbican-api-846956b868-5mw5q\" (UID: \"2bdcf641-1e8c-4994-8981-4db0f4c37973\") " pod="openstack-kuttl-tests/barbican-api-846956b868-5mw5q" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.870649 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/26088cd7-dfce-4ccd-b93e-87a82505e96d-combined-ca-bundle\") pod \"barbican-worker-f5857446c-9l89n\" (UID: \"26088cd7-dfce-4ccd-b93e-87a82505e96d\") " pod="openstack-kuttl-tests/barbican-worker-f5857446c-9l89n" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.870695 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/12cfbef3-ce86-47bd-93e0-618b4bef9819-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.870706 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/12cfbef3-ce86-47bd-93e0-618b4bef9819-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.870716 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/0e6142dc-2153-4828-8808-f0d3dc8c3a37-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.870727 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-572tj\" (UniqueName: \"kubernetes.io/projected/12cfbef3-ce86-47bd-93e0-618b4bef9819-kube-api-access-572tj\") on node \"crc\" DevicePath \"\"" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.870737 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/12cfbef3-ce86-47bd-93e0-618b4bef9819-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.870746 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/12cfbef3-ce86-47bd-93e0-618b4bef9819-logs\") on node \"crc\" DevicePath \"\"" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.870766 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") on node \"crc\" DevicePath \"\"" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.870777 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/12cfbef3-ce86-47bd-93e0-618b4bef9819-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.870785 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/12cfbef3-ce86-47bd-93e0-618b4bef9819-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.870806 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") on node \"crc\" " Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.872942 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9da74618-45dc-4a60-8f6a-dfb9c30cb13a-logs\") pod \"barbican-keystone-listener-dc8f675f4-72f6q\" (UID: \"9da74618-45dc-4a60-8f6a-dfb9c30cb13a\") " pod="openstack-kuttl-tests/barbican-keystone-listener-dc8f675f4-72f6q" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.876393 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/26088cd7-dfce-4ccd-b93e-87a82505e96d-config-data\") pod \"barbican-worker-f5857446c-9l89n\" (UID: \"26088cd7-dfce-4ccd-b93e-87a82505e96d\") " pod="openstack-kuttl-tests/barbican-worker-f5857446c-9l89n" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.876725 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/26088cd7-dfce-4ccd-b93e-87a82505e96d-logs\") pod \"barbican-worker-f5857446c-9l89n\" (UID: \"26088cd7-dfce-4ccd-b93e-87a82505e96d\") " pod="openstack-kuttl-tests/barbican-worker-f5857446c-9l89n" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.878575 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9da74618-45dc-4a60-8f6a-dfb9c30cb13a-config-data\") pod \"barbican-keystone-listener-dc8f675f4-72f6q\" (UID: \"9da74618-45dc-4a60-8f6a-dfb9c30cb13a\") " pod="openstack-kuttl-tests/barbican-keystone-listener-dc8f675f4-72f6q" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.878585 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/26088cd7-dfce-4ccd-b93e-87a82505e96d-config-data-custom\") pod \"barbican-worker-f5857446c-9l89n\" (UID: \"26088cd7-dfce-4ccd-b93e-87a82505e96d\") " pod="openstack-kuttl-tests/barbican-worker-f5857446c-9l89n" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.879438 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/9da74618-45dc-4a60-8f6a-dfb9c30cb13a-config-data-custom\") pod \"barbican-keystone-listener-dc8f675f4-72f6q\" (UID: \"9da74618-45dc-4a60-8f6a-dfb9c30cb13a\") " pod="openstack-kuttl-tests/barbican-keystone-listener-dc8f675f4-72f6q" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.879845 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9da74618-45dc-4a60-8f6a-dfb9c30cb13a-combined-ca-bundle\") pod \"barbican-keystone-listener-dc8f675f4-72f6q\" (UID: \"9da74618-45dc-4a60-8f6a-dfb9c30cb13a\") " pod="openstack-kuttl-tests/barbican-keystone-listener-dc8f675f4-72f6q" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.883287 5120 scope.go:117] "RemoveContainer" containerID="39e40cfd66e88168fe015f7ac730b5087965d55de20bfcae8f241de6185b3aae" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.885620 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/26088cd7-dfce-4ccd-b93e-87a82505e96d-combined-ca-bundle\") pod \"barbican-worker-f5857446c-9l89n\" (UID: \"26088cd7-dfce-4ccd-b93e-87a82505e96d\") " pod="openstack-kuttl-tests/barbican-worker-f5857446c-9l89n" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.893946 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage09-crc" (UniqueName: "kubernetes.io/local-volume/local-storage09-crc") on node "crc" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.895929 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmg47\" (UniqueName: \"kubernetes.io/projected/9da74618-45dc-4a60-8f6a-dfb9c30cb13a-kube-api-access-kmg47\") pod \"barbican-keystone-listener-dc8f675f4-72f6q\" (UID: \"9da74618-45dc-4a60-8f6a-dfb9c30cb13a\") " pod="openstack-kuttl-tests/barbican-keystone-listener-dc8f675f4-72f6q" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.896312 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2s7q\" (UniqueName: \"kubernetes.io/projected/26088cd7-dfce-4ccd-b93e-87a82505e96d-kube-api-access-j2s7q\") pod \"barbican-worker-f5857446c-9l89n\" (UID: \"26088cd7-dfce-4ccd-b93e-87a82505e96d\") " pod="openstack-kuttl-tests/barbican-worker-f5857446c-9l89n" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.920682 5120 scope.go:117] "RemoveContainer" containerID="c2923a3d45d47fd87ebbc1247f8778e9579159dbdae511922abf8ae3eb66c6f4" Mar 16 15:55:45 crc kubenswrapper[5120]: E0316 15:55:45.921328 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c2923a3d45d47fd87ebbc1247f8778e9579159dbdae511922abf8ae3eb66c6f4\": container with ID starting with c2923a3d45d47fd87ebbc1247f8778e9579159dbdae511922abf8ae3eb66c6f4 not found: ID does not exist" containerID="c2923a3d45d47fd87ebbc1247f8778e9579159dbdae511922abf8ae3eb66c6f4" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.921460 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2923a3d45d47fd87ebbc1247f8778e9579159dbdae511922abf8ae3eb66c6f4"} err="failed to get container status \"c2923a3d45d47fd87ebbc1247f8778e9579159dbdae511922abf8ae3eb66c6f4\": rpc error: code = NotFound desc = could not find container \"c2923a3d45d47fd87ebbc1247f8778e9579159dbdae511922abf8ae3eb66c6f4\": container with ID starting with c2923a3d45d47fd87ebbc1247f8778e9579159dbdae511922abf8ae3eb66c6f4 not found: ID does not exist" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.921567 5120 scope.go:117] "RemoveContainer" containerID="39e40cfd66e88168fe015f7ac730b5087965d55de20bfcae8f241de6185b3aae" Mar 16 15:55:45 crc kubenswrapper[5120]: E0316 15:55:45.921990 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"39e40cfd66e88168fe015f7ac730b5087965d55de20bfcae8f241de6185b3aae\": container with ID starting with 39e40cfd66e88168fe015f7ac730b5087965d55de20bfcae8f241de6185b3aae not found: ID does not exist" containerID="39e40cfd66e88168fe015f7ac730b5087965d55de20bfcae8f241de6185b3aae" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.922080 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39e40cfd66e88168fe015f7ac730b5087965d55de20bfcae8f241de6185b3aae"} err="failed to get container status \"39e40cfd66e88168fe015f7ac730b5087965d55de20bfcae8f241de6185b3aae\": rpc error: code = NotFound desc = could not find container \"39e40cfd66e88168fe015f7ac730b5087965d55de20bfcae8f241de6185b3aae\": container with ID starting with 39e40cfd66e88168fe015f7ac730b5087965d55de20bfcae8f241de6185b3aae not found: ID does not exist" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.922152 5120 scope.go:117] "RemoveContainer" containerID="c2923a3d45d47fd87ebbc1247f8778e9579159dbdae511922abf8ae3eb66c6f4" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.922471 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2923a3d45d47fd87ebbc1247f8778e9579159dbdae511922abf8ae3eb66c6f4"} err="failed to get container status \"c2923a3d45d47fd87ebbc1247f8778e9579159dbdae511922abf8ae3eb66c6f4\": rpc error: code = NotFound desc = could not find container \"c2923a3d45d47fd87ebbc1247f8778e9579159dbdae511922abf8ae3eb66c6f4\": container with ID starting with c2923a3d45d47fd87ebbc1247f8778e9579159dbdae511922abf8ae3eb66c6f4 not found: ID does not exist" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.922550 5120 scope.go:117] "RemoveContainer" containerID="39e40cfd66e88168fe015f7ac730b5087965d55de20bfcae8f241de6185b3aae" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.922858 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39e40cfd66e88168fe015f7ac730b5087965d55de20bfcae8f241de6185b3aae"} err="failed to get container status \"39e40cfd66e88168fe015f7ac730b5087965d55de20bfcae8f241de6185b3aae\": rpc error: code = NotFound desc = could not find container \"39e40cfd66e88168fe015f7ac730b5087965d55de20bfcae8f241de6185b3aae\": container with ID starting with 39e40cfd66e88168fe015f7ac730b5087965d55de20bfcae8f241de6185b3aae not found: ID does not exist" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.956727 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-f5857446c-9l89n" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.973353 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2bdcf641-1e8c-4994-8981-4db0f4c37973-combined-ca-bundle\") pod \"barbican-api-846956b868-5mw5q\" (UID: \"2bdcf641-1e8c-4994-8981-4db0f4c37973\") " pod="openstack-kuttl-tests/barbican-api-846956b868-5mw5q" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.973456 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2bdcf641-1e8c-4994-8981-4db0f4c37973-logs\") pod \"barbican-api-846956b868-5mw5q\" (UID: \"2bdcf641-1e8c-4994-8981-4db0f4c37973\") " pod="openstack-kuttl-tests/barbican-api-846956b868-5mw5q" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.974040 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/2bdcf641-1e8c-4994-8981-4db0f4c37973-config-data-custom\") pod \"barbican-api-846956b868-5mw5q\" (UID: \"2bdcf641-1e8c-4994-8981-4db0f4c37973\") " pod="openstack-kuttl-tests/barbican-api-846956b868-5mw5q" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.974065 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2bdcf641-1e8c-4994-8981-4db0f4c37973-config-data\") pod \"barbican-api-846956b868-5mw5q\" (UID: \"2bdcf641-1e8c-4994-8981-4db0f4c37973\") " pod="openstack-kuttl-tests/barbican-api-846956b868-5mw5q" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.974138 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rg5gd\" (UniqueName: \"kubernetes.io/projected/2bdcf641-1e8c-4994-8981-4db0f4c37973-kube-api-access-rg5gd\") pod \"barbican-api-846956b868-5mw5q\" (UID: \"2bdcf641-1e8c-4994-8981-4db0f4c37973\") " pod="openstack-kuttl-tests/barbican-api-846956b868-5mw5q" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.974193 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") on node \"crc\" DevicePath \"\"" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.974435 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2bdcf641-1e8c-4994-8981-4db0f4c37973-logs\") pod \"barbican-api-846956b868-5mw5q\" (UID: \"2bdcf641-1e8c-4994-8981-4db0f4c37973\") " pod="openstack-kuttl-tests/barbican-api-846956b868-5mw5q" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.974714 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-dc8f675f4-72f6q" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.979350 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2bdcf641-1e8c-4994-8981-4db0f4c37973-combined-ca-bundle\") pod \"barbican-api-846956b868-5mw5q\" (UID: \"2bdcf641-1e8c-4994-8981-4db0f4c37973\") " pod="openstack-kuttl-tests/barbican-api-846956b868-5mw5q" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.981943 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2bdcf641-1e8c-4994-8981-4db0f4c37973-config-data\") pod \"barbican-api-846956b868-5mw5q\" (UID: \"2bdcf641-1e8c-4994-8981-4db0f4c37973\") " pod="openstack-kuttl-tests/barbican-api-846956b868-5mw5q" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.987383 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/2bdcf641-1e8c-4994-8981-4db0f4c37973-config-data-custom\") pod \"barbican-api-846956b868-5mw5q\" (UID: \"2bdcf641-1e8c-4994-8981-4db0f4c37973\") " pod="openstack-kuttl-tests/barbican-api-846956b868-5mw5q" Mar 16 15:55:45 crc kubenswrapper[5120]: I0316 15:55:45.995327 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rg5gd\" (UniqueName: \"kubernetes.io/projected/2bdcf641-1e8c-4994-8981-4db0f4c37973-kube-api-access-rg5gd\") pod \"barbican-api-846956b868-5mw5q\" (UID: \"2bdcf641-1e8c-4994-8981-4db0f4c37973\") " pod="openstack-kuttl-tests/barbican-api-846956b868-5mw5q" Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.006333 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.057212 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.100374 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.109349 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-846956b868-5mw5q" Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.136639 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.143714 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.147036 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-internal-svc\"" Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.147386 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-scripts\"" Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.147516 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-internal-config-data\"" Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.147838 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-glance-dockercfg-mkhxb\"" Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.152957 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-t9zsb" Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.173589 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.184566 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.194865 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.199105 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a021027-056a-410b-aab4-8d8aff25b21a" containerName="neutron-db-sync" Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.199259 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a021027-056a-410b-aab4-8d8aff25b21a" containerName="neutron-db-sync" Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.199572 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="6a021027-056a-410b-aab4-8d8aff25b21a" containerName="neutron-db-sync" Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.212736 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.216849 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.221507 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-public-svc\"" Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.221569 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-external-config-data\"" Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.288501 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6a021027-056a-410b-aab4-8d8aff25b21a-config\") pod \"6a021027-056a-410b-aab4-8d8aff25b21a\" (UID: \"6a021027-056a-410b-aab4-8d8aff25b21a\") " Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.289633 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nm66b\" (UniqueName: \"kubernetes.io/projected/6a021027-056a-410b-aab4-8d8aff25b21a-kube-api-access-nm66b\") pod \"6a021027-056a-410b-aab4-8d8aff25b21a\" (UID: \"6a021027-056a-410b-aab4-8d8aff25b21a\") " Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.289835 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6a021027-056a-410b-aab4-8d8aff25b21a-combined-ca-bundle\") pod \"6a021027-056a-410b-aab4-8d8aff25b21a\" (UID: \"6a021027-056a-410b-aab4-8d8aff25b21a\") " Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.290606 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/705910c5-8552-43be-ba28-dfad2b51ce96-config-data\") pod \"glance-default-internal-api-0\" (UID: \"705910c5-8552-43be-ba28-dfad2b51ce96\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.290639 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/705910c5-8552-43be-ba28-dfad2b51ce96-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"705910c5-8552-43be-ba28-dfad2b51ce96\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.290683 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"glance-default-internal-api-0\" (UID: \"705910c5-8552-43be-ba28-dfad2b51ce96\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.290704 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/705910c5-8552-43be-ba28-dfad2b51ce96-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"705910c5-8552-43be-ba28-dfad2b51ce96\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.295260 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/705910c5-8552-43be-ba28-dfad2b51ce96-logs\") pod \"glance-default-internal-api-0\" (UID: \"705910c5-8552-43be-ba28-dfad2b51ce96\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.295521 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8w9c4\" (UniqueName: \"kubernetes.io/projected/705910c5-8552-43be-ba28-dfad2b51ce96-kube-api-access-8w9c4\") pod \"glance-default-internal-api-0\" (UID: \"705910c5-8552-43be-ba28-dfad2b51ce96\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.295594 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/705910c5-8552-43be-ba28-dfad2b51ce96-scripts\") pod \"glance-default-internal-api-0\" (UID: \"705910c5-8552-43be-ba28-dfad2b51ce96\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.295662 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/705910c5-8552-43be-ba28-dfad2b51ce96-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"705910c5-8552-43be-ba28-dfad2b51ce96\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.295442 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a021027-056a-410b-aab4-8d8aff25b21a-kube-api-access-nm66b" (OuterVolumeSpecName: "kube-api-access-nm66b") pod "6a021027-056a-410b-aab4-8d8aff25b21a" (UID: "6a021027-056a-410b-aab4-8d8aff25b21a"). InnerVolumeSpecName "kube-api-access-nm66b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.328548 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a021027-056a-410b-aab4-8d8aff25b21a-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "6a021027-056a-410b-aab4-8d8aff25b21a" (UID: "6a021027-056a-410b-aab4-8d8aff25b21a"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.328862 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a021027-056a-410b-aab4-8d8aff25b21a-config" (OuterVolumeSpecName: "config") pod "6a021027-056a-410b-aab4-8d8aff25b21a" (UID: "6a021027-056a-410b-aab4-8d8aff25b21a"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.396818 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bglqw\" (UniqueName: \"kubernetes.io/projected/93f6640c-a255-4892-abe7-01f211126bb5-kube-api-access-bglqw\") pod \"glance-default-external-api-0\" (UID: \"93f6640c-a255-4892-abe7-01f211126bb5\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.396876 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/705910c5-8552-43be-ba28-dfad2b51ce96-config-data\") pod \"glance-default-internal-api-0\" (UID: \"705910c5-8552-43be-ba28-dfad2b51ce96\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.396899 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/93f6640c-a255-4892-abe7-01f211126bb5-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"93f6640c-a255-4892-abe7-01f211126bb5\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.396918 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/705910c5-8552-43be-ba28-dfad2b51ce96-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"705910c5-8552-43be-ba28-dfad2b51ce96\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.396943 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"glance-default-internal-api-0\" (UID: \"705910c5-8552-43be-ba28-dfad2b51ce96\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.396964 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/705910c5-8552-43be-ba28-dfad2b51ce96-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"705910c5-8552-43be-ba28-dfad2b51ce96\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.396981 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/93f6640c-a255-4892-abe7-01f211126bb5-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"93f6640c-a255-4892-abe7-01f211126bb5\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.397024 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/705910c5-8552-43be-ba28-dfad2b51ce96-logs\") pod \"glance-default-internal-api-0\" (UID: \"705910c5-8552-43be-ba28-dfad2b51ce96\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.397039 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8w9c4\" (UniqueName: \"kubernetes.io/projected/705910c5-8552-43be-ba28-dfad2b51ce96-kube-api-access-8w9c4\") pod \"glance-default-internal-api-0\" (UID: \"705910c5-8552-43be-ba28-dfad2b51ce96\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.397068 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"glance-default-external-api-0\" (UID: \"93f6640c-a255-4892-abe7-01f211126bb5\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.397091 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/705910c5-8552-43be-ba28-dfad2b51ce96-scripts\") pod \"glance-default-internal-api-0\" (UID: \"705910c5-8552-43be-ba28-dfad2b51ce96\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.397124 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/705910c5-8552-43be-ba28-dfad2b51ce96-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"705910c5-8552-43be-ba28-dfad2b51ce96\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.397147 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/93f6640c-a255-4892-abe7-01f211126bb5-logs\") pod \"glance-default-external-api-0\" (UID: \"93f6640c-a255-4892-abe7-01f211126bb5\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.397192 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/93f6640c-a255-4892-abe7-01f211126bb5-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"93f6640c-a255-4892-abe7-01f211126bb5\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.397217 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/93f6640c-a255-4892-abe7-01f211126bb5-config-data\") pod \"glance-default-external-api-0\" (UID: \"93f6640c-a255-4892-abe7-01f211126bb5\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.397233 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/93f6640c-a255-4892-abe7-01f211126bb5-scripts\") pod \"glance-default-external-api-0\" (UID: \"93f6640c-a255-4892-abe7-01f211126bb5\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.397333 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/6a021027-056a-410b-aab4-8d8aff25b21a-config\") on node \"crc\" DevicePath \"\"" Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.397346 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nm66b\" (UniqueName: \"kubernetes.io/projected/6a021027-056a-410b-aab4-8d8aff25b21a-kube-api-access-nm66b\") on node \"crc\" DevicePath \"\"" Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.397356 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6a021027-056a-410b-aab4-8d8aff25b21a-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.402218 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/705910c5-8552-43be-ba28-dfad2b51ce96-config-data\") pod \"glance-default-internal-api-0\" (UID: \"705910c5-8552-43be-ba28-dfad2b51ce96\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.404379 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/705910c5-8552-43be-ba28-dfad2b51ce96-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"705910c5-8552-43be-ba28-dfad2b51ce96\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.404456 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"glance-default-internal-api-0\" (UID: \"705910c5-8552-43be-ba28-dfad2b51ce96\") device mount path \"/mnt/openstack/pv09\"" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.404772 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/705910c5-8552-43be-ba28-dfad2b51ce96-logs\") pod \"glance-default-internal-api-0\" (UID: \"705910c5-8552-43be-ba28-dfad2b51ce96\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.407367 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/705910c5-8552-43be-ba28-dfad2b51ce96-scripts\") pod \"glance-default-internal-api-0\" (UID: \"705910c5-8552-43be-ba28-dfad2b51ce96\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.409351 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/705910c5-8552-43be-ba28-dfad2b51ce96-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"705910c5-8552-43be-ba28-dfad2b51ce96\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.416334 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/705910c5-8552-43be-ba28-dfad2b51ce96-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"705910c5-8552-43be-ba28-dfad2b51ce96\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.420529 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8w9c4\" (UniqueName: \"kubernetes.io/projected/705910c5-8552-43be-ba28-dfad2b51ce96-kube-api-access-8w9c4\") pod \"glance-default-internal-api-0\" (UID: \"705910c5-8552-43be-ba28-dfad2b51ce96\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.435345 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"glance-default-internal-api-0\" (UID: \"705910c5-8552-43be-ba28-dfad2b51ce96\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.453402 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-ctwpk" Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.498954 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bglqw\" (UniqueName: \"kubernetes.io/projected/93f6640c-a255-4892-abe7-01f211126bb5-kube-api-access-bglqw\") pod \"glance-default-external-api-0\" (UID: \"93f6640c-a255-4892-abe7-01f211126bb5\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.499048 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/93f6640c-a255-4892-abe7-01f211126bb5-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"93f6640c-a255-4892-abe7-01f211126bb5\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.499092 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/93f6640c-a255-4892-abe7-01f211126bb5-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"93f6640c-a255-4892-abe7-01f211126bb5\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.499145 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"glance-default-external-api-0\" (UID: \"93f6640c-a255-4892-abe7-01f211126bb5\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.499209 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/93f6640c-a255-4892-abe7-01f211126bb5-logs\") pod \"glance-default-external-api-0\" (UID: \"93f6640c-a255-4892-abe7-01f211126bb5\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.499240 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/93f6640c-a255-4892-abe7-01f211126bb5-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"93f6640c-a255-4892-abe7-01f211126bb5\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.499257 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/93f6640c-a255-4892-abe7-01f211126bb5-config-data\") pod \"glance-default-external-api-0\" (UID: \"93f6640c-a255-4892-abe7-01f211126bb5\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.499273 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/93f6640c-a255-4892-abe7-01f211126bb5-scripts\") pod \"glance-default-external-api-0\" (UID: \"93f6640c-a255-4892-abe7-01f211126bb5\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.499989 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"glance-default-external-api-0\" (UID: \"93f6640c-a255-4892-abe7-01f211126bb5\") device mount path \"/mnt/openstack/pv13\"" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.500055 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/93f6640c-a255-4892-abe7-01f211126bb5-logs\") pod \"glance-default-external-api-0\" (UID: \"93f6640c-a255-4892-abe7-01f211126bb5\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.500113 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/93f6640c-a255-4892-abe7-01f211126bb5-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"93f6640c-a255-4892-abe7-01f211126bb5\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.505656 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/93f6640c-a255-4892-abe7-01f211126bb5-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"93f6640c-a255-4892-abe7-01f211126bb5\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.505902 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/93f6640c-a255-4892-abe7-01f211126bb5-scripts\") pod \"glance-default-external-api-0\" (UID: \"93f6640c-a255-4892-abe7-01f211126bb5\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.507005 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/93f6640c-a255-4892-abe7-01f211126bb5-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"93f6640c-a255-4892-abe7-01f211126bb5\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.507184 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/93f6640c-a255-4892-abe7-01f211126bb5-config-data\") pod \"glance-default-external-api-0\" (UID: \"93f6640c-a255-4892-abe7-01f211126bb5\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.540226 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bglqw\" (UniqueName: \"kubernetes.io/projected/93f6640c-a255-4892-abe7-01f211126bb5-kube-api-access-bglqw\") pod \"glance-default-external-api-0\" (UID: \"93f6640c-a255-4892-abe7-01f211126bb5\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.542031 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"glance-default-external-api-0\" (UID: \"93f6640c-a255-4892-abe7-01f211126bb5\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.599917 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3caac7df-6311-46c7-bb2c-4aab1caf55fb-config-data\") pod \"3caac7df-6311-46c7-bb2c-4aab1caf55fb\" (UID: \"3caac7df-6311-46c7-bb2c-4aab1caf55fb\") " Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.600027 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p76r4\" (UniqueName: \"kubernetes.io/projected/3caac7df-6311-46c7-bb2c-4aab1caf55fb-kube-api-access-p76r4\") pod \"3caac7df-6311-46c7-bb2c-4aab1caf55fb\" (UID: \"3caac7df-6311-46c7-bb2c-4aab1caf55fb\") " Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.600067 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3caac7df-6311-46c7-bb2c-4aab1caf55fb-logs\") pod \"3caac7df-6311-46c7-bb2c-4aab1caf55fb\" (UID: \"3caac7df-6311-46c7-bb2c-4aab1caf55fb\") " Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.600136 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3caac7df-6311-46c7-bb2c-4aab1caf55fb-scripts\") pod \"3caac7df-6311-46c7-bb2c-4aab1caf55fb\" (UID: \"3caac7df-6311-46c7-bb2c-4aab1caf55fb\") " Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.600202 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3caac7df-6311-46c7-bb2c-4aab1caf55fb-combined-ca-bundle\") pod \"3caac7df-6311-46c7-bb2c-4aab1caf55fb\" (UID: \"3caac7df-6311-46c7-bb2c-4aab1caf55fb\") " Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.601549 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3caac7df-6311-46c7-bb2c-4aab1caf55fb-logs" (OuterVolumeSpecName: "logs") pod "3caac7df-6311-46c7-bb2c-4aab1caf55fb" (UID: "3caac7df-6311-46c7-bb2c-4aab1caf55fb"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.607003 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3caac7df-6311-46c7-bb2c-4aab1caf55fb-scripts" (OuterVolumeSpecName: "scripts") pod "3caac7df-6311-46c7-bb2c-4aab1caf55fb" (UID: "3caac7df-6311-46c7-bb2c-4aab1caf55fb"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.607350 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3caac7df-6311-46c7-bb2c-4aab1caf55fb-kube-api-access-p76r4" (OuterVolumeSpecName: "kube-api-access-p76r4") pod "3caac7df-6311-46c7-bb2c-4aab1caf55fb" (UID: "3caac7df-6311-46c7-bb2c-4aab1caf55fb"). InnerVolumeSpecName "kube-api-access-p76r4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.626359 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3caac7df-6311-46c7-bb2c-4aab1caf55fb-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "3caac7df-6311-46c7-bb2c-4aab1caf55fb" (UID: "3caac7df-6311-46c7-bb2c-4aab1caf55fb"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.648922 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-f5857446c-9l89n"] Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.650687 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3caac7df-6311-46c7-bb2c-4aab1caf55fb-config-data" (OuterVolumeSpecName: "config-data") pod "3caac7df-6311-46c7-bb2c-4aab1caf55fb" (UID: "3caac7df-6311-46c7-bb2c-4aab1caf55fb"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:55:46 crc kubenswrapper[5120]: W0316 15:55:46.655143 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9da74618_45dc_4a60_8f6a_dfb9c30cb13a.slice/crio-0152132bbacca6b7541cff75f090ad5b1ec131b5cc450089d24cd693dabdc9d6 WatchSource:0}: Error finding container 0152132bbacca6b7541cff75f090ad5b1ec131b5cc450089d24cd693dabdc9d6: Status 404 returned error can't find the container with id 0152132bbacca6b7541cff75f090ad5b1ec131b5cc450089d24cd693dabdc9d6 Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.660533 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-dc8f675f4-72f6q"] Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.679233 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0e6142dc-2153-4828-8808-f0d3dc8c3a37" path="/var/lib/kubelet/pods/0e6142dc-2153-4828-8808-f0d3dc8c3a37/volumes" Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.680005 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="12cfbef3-ce86-47bd-93e0-618b4bef9819" path="/var/lib/kubelet/pods/12cfbef3-ce86-47bd-93e0-618b4bef9819/volumes" Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.697403 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.701615 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p76r4\" (UniqueName: \"kubernetes.io/projected/3caac7df-6311-46c7-bb2c-4aab1caf55fb-kube-api-access-p76r4\") on node \"crc\" DevicePath \"\"" Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.701642 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3caac7df-6311-46c7-bb2c-4aab1caf55fb-logs\") on node \"crc\" DevicePath \"\"" Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.701655 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3caac7df-6311-46c7-bb2c-4aab1caf55fb-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.701664 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3caac7df-6311-46c7-bb2c-4aab1caf55fb-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.701674 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3caac7df-6311-46c7-bb2c-4aab1caf55fb-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.758849 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.786343 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-65787d59d-nv5lb"] Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.787737 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3caac7df-6311-46c7-bb2c-4aab1caf55fb" containerName="placement-db-sync" Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.787750 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="3caac7df-6311-46c7-bb2c-4aab1caf55fb" containerName="placement-db-sync" Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.787980 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="3caac7df-6311-46c7-bb2c-4aab1caf55fb" containerName="placement-db-sync" Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.793033 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-65787d59d-nv5lb" Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.800457 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-846956b868-5mw5q"] Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.801212 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-placement-public-svc\"" Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.808338 5120 generic.go:358] "Generic (PLEG): container finished" podID="8d7af5d0-3283-41d8-9e35-fa6a70fceb0a" containerID="a126851b3d7daac11080ae4cc6f484666da78c21af025c9eb08a6db6f6f87ceb" exitCode=0 Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.808461 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-s8lzg" event={"ID":"8d7af5d0-3283-41d8-9e35-fa6a70fceb0a","Type":"ContainerDied","Data":"a126851b3d7daac11080ae4cc6f484666da78c21af025c9eb08a6db6f6f87ceb"} Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.811220 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-placement-internal-svc\"" Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.814207 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-65787d59d-nv5lb"] Mar 16 15:55:46 crc kubenswrapper[5120]: W0316 15:55:46.814914 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2bdcf641_1e8c_4994_8981_4db0f4c37973.slice/crio-d252cb1c6ea75f1bd1326c3ffb4c7519fed7e18975e4adf1ff6b150d04c07925 WatchSource:0}: Error finding container d252cb1c6ea75f1bd1326c3ffb4c7519fed7e18975e4adf1ff6b150d04c07925: Status 404 returned error can't find the container with id d252cb1c6ea75f1bd1326c3ffb4c7519fed7e18975e4adf1ff6b150d04c07925 Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.828540 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-5df8bd5df5-8rzw7"] Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.851028 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-t9zsb" Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.875986 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-ctwpk" Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.900179 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-f5857446c-9l89n" event={"ID":"26088cd7-dfce-4ccd-b93e-87a82505e96d","Type":"ContainerStarted","Data":"34e86a88fd2481f25a313acf010fe5059818fde3f82205a30af53b5ffb720655"} Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.900221 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-t9zsb" event={"ID":"6a021027-056a-410b-aab4-8d8aff25b21a","Type":"ContainerDied","Data":"25ff190377037d72b478fa625109e7c03b0032ad5a2690b3aefb6b839691a8cf"} Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.900237 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="25ff190377037d72b478fa625109e7c03b0032ad5a2690b3aefb6b839691a8cf" Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.900252 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-dc8f675f4-72f6q" event={"ID":"9da74618-45dc-4a60-8f6a-dfb9c30cb13a","Type":"ContainerStarted","Data":"0152132bbacca6b7541cff75f090ad5b1ec131b5cc450089d24cd693dabdc9d6"} Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.900276 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-ctwpk" event={"ID":"3caac7df-6311-46c7-bb2c-4aab1caf55fb","Type":"ContainerDied","Data":"e89e121804f933d9ce2bfb62ce18f59265f9d584c6006ec8bffc1887f634a904"} Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.900286 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e89e121804f933d9ce2bfb62ce18f59265f9d584c6006ec8bffc1887f634a904" Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.901710 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-5df8bd5df5-8rzw7" Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.915164 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-5df8bd5df5-8rzw7"] Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.922493 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-httpd-config\"" Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.922916 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-neutron-ovndbs\"" Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.923444 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-config\"" Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.927249 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-neutron-dockercfg-vgbbs\"" Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.939642 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/cf58a934-0387-4876-8e01-98f0fde5e197-scripts\") pod \"placement-65787d59d-nv5lb\" (UID: \"cf58a934-0387-4876-8e01-98f0fde5e197\") " pod="openstack-kuttl-tests/placement-65787d59d-nv5lb" Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.939709 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cx5w6\" (UniqueName: \"kubernetes.io/projected/cf58a934-0387-4876-8e01-98f0fde5e197-kube-api-access-cx5w6\") pod \"placement-65787d59d-nv5lb\" (UID: \"cf58a934-0387-4876-8e01-98f0fde5e197\") " pod="openstack-kuttl-tests/placement-65787d59d-nv5lb" Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.939737 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/cf58a934-0387-4876-8e01-98f0fde5e197-public-tls-certs\") pod \"placement-65787d59d-nv5lb\" (UID: \"cf58a934-0387-4876-8e01-98f0fde5e197\") " pod="openstack-kuttl-tests/placement-65787d59d-nv5lb" Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.939851 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/4fec53ab-7e98-41e6-8a5a-13a01e505e20-httpd-config\") pod \"neutron-5df8bd5df5-8rzw7\" (UID: \"4fec53ab-7e98-41e6-8a5a-13a01e505e20\") " pod="openstack-kuttl-tests/neutron-5df8bd5df5-8rzw7" Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.939915 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4fec53ab-7e98-41e6-8a5a-13a01e505e20-config\") pod \"neutron-5df8bd5df5-8rzw7\" (UID: \"4fec53ab-7e98-41e6-8a5a-13a01e505e20\") " pod="openstack-kuttl-tests/neutron-5df8bd5df5-8rzw7" Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.939952 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjvc9\" (UniqueName: \"kubernetes.io/projected/4fec53ab-7e98-41e6-8a5a-13a01e505e20-kube-api-access-fjvc9\") pod \"neutron-5df8bd5df5-8rzw7\" (UID: \"4fec53ab-7e98-41e6-8a5a-13a01e505e20\") " pod="openstack-kuttl-tests/neutron-5df8bd5df5-8rzw7" Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.939986 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4fec53ab-7e98-41e6-8a5a-13a01e505e20-combined-ca-bundle\") pod \"neutron-5df8bd5df5-8rzw7\" (UID: \"4fec53ab-7e98-41e6-8a5a-13a01e505e20\") " pod="openstack-kuttl-tests/neutron-5df8bd5df5-8rzw7" Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.940070 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cf58a934-0387-4876-8e01-98f0fde5e197-combined-ca-bundle\") pod \"placement-65787d59d-nv5lb\" (UID: \"cf58a934-0387-4876-8e01-98f0fde5e197\") " pod="openstack-kuttl-tests/placement-65787d59d-nv5lb" Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.940101 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/cf58a934-0387-4876-8e01-98f0fde5e197-internal-tls-certs\") pod \"placement-65787d59d-nv5lb\" (UID: \"cf58a934-0387-4876-8e01-98f0fde5e197\") " pod="openstack-kuttl-tests/placement-65787d59d-nv5lb" Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.940139 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/4fec53ab-7e98-41e6-8a5a-13a01e505e20-ovndb-tls-certs\") pod \"neutron-5df8bd5df5-8rzw7\" (UID: \"4fec53ab-7e98-41e6-8a5a-13a01e505e20\") " pod="openstack-kuttl-tests/neutron-5df8bd5df5-8rzw7" Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.940276 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cf58a934-0387-4876-8e01-98f0fde5e197-config-data\") pod \"placement-65787d59d-nv5lb\" (UID: \"cf58a934-0387-4876-8e01-98f0fde5e197\") " pod="openstack-kuttl-tests/placement-65787d59d-nv5lb" Mar 16 15:55:46 crc kubenswrapper[5120]: I0316 15:55:46.940448 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/cf58a934-0387-4876-8e01-98f0fde5e197-logs\") pod \"placement-65787d59d-nv5lb\" (UID: \"cf58a934-0387-4876-8e01-98f0fde5e197\") " pod="openstack-kuttl-tests/placement-65787d59d-nv5lb" Mar 16 15:55:47 crc kubenswrapper[5120]: I0316 15:55:47.045714 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/cf58a934-0387-4876-8e01-98f0fde5e197-logs\") pod \"placement-65787d59d-nv5lb\" (UID: \"cf58a934-0387-4876-8e01-98f0fde5e197\") " pod="openstack-kuttl-tests/placement-65787d59d-nv5lb" Mar 16 15:55:47 crc kubenswrapper[5120]: I0316 15:55:47.046068 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/cf58a934-0387-4876-8e01-98f0fde5e197-scripts\") pod \"placement-65787d59d-nv5lb\" (UID: \"cf58a934-0387-4876-8e01-98f0fde5e197\") " pod="openstack-kuttl-tests/placement-65787d59d-nv5lb" Mar 16 15:55:47 crc kubenswrapper[5120]: I0316 15:55:47.046106 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cx5w6\" (UniqueName: \"kubernetes.io/projected/cf58a934-0387-4876-8e01-98f0fde5e197-kube-api-access-cx5w6\") pod \"placement-65787d59d-nv5lb\" (UID: \"cf58a934-0387-4876-8e01-98f0fde5e197\") " pod="openstack-kuttl-tests/placement-65787d59d-nv5lb" Mar 16 15:55:47 crc kubenswrapper[5120]: I0316 15:55:47.046130 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/cf58a934-0387-4876-8e01-98f0fde5e197-public-tls-certs\") pod \"placement-65787d59d-nv5lb\" (UID: \"cf58a934-0387-4876-8e01-98f0fde5e197\") " pod="openstack-kuttl-tests/placement-65787d59d-nv5lb" Mar 16 15:55:47 crc kubenswrapper[5120]: I0316 15:55:47.046154 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/4fec53ab-7e98-41e6-8a5a-13a01e505e20-httpd-config\") pod \"neutron-5df8bd5df5-8rzw7\" (UID: \"4fec53ab-7e98-41e6-8a5a-13a01e505e20\") " pod="openstack-kuttl-tests/neutron-5df8bd5df5-8rzw7" Mar 16 15:55:47 crc kubenswrapper[5120]: I0316 15:55:47.046177 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4fec53ab-7e98-41e6-8a5a-13a01e505e20-config\") pod \"neutron-5df8bd5df5-8rzw7\" (UID: \"4fec53ab-7e98-41e6-8a5a-13a01e505e20\") " pod="openstack-kuttl-tests/neutron-5df8bd5df5-8rzw7" Mar 16 15:55:47 crc kubenswrapper[5120]: I0316 15:55:47.046195 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fjvc9\" (UniqueName: \"kubernetes.io/projected/4fec53ab-7e98-41e6-8a5a-13a01e505e20-kube-api-access-fjvc9\") pod \"neutron-5df8bd5df5-8rzw7\" (UID: \"4fec53ab-7e98-41e6-8a5a-13a01e505e20\") " pod="openstack-kuttl-tests/neutron-5df8bd5df5-8rzw7" Mar 16 15:55:47 crc kubenswrapper[5120]: I0316 15:55:47.046216 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4fec53ab-7e98-41e6-8a5a-13a01e505e20-combined-ca-bundle\") pod \"neutron-5df8bd5df5-8rzw7\" (UID: \"4fec53ab-7e98-41e6-8a5a-13a01e505e20\") " pod="openstack-kuttl-tests/neutron-5df8bd5df5-8rzw7" Mar 16 15:55:47 crc kubenswrapper[5120]: I0316 15:55:47.046256 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cf58a934-0387-4876-8e01-98f0fde5e197-combined-ca-bundle\") pod \"placement-65787d59d-nv5lb\" (UID: \"cf58a934-0387-4876-8e01-98f0fde5e197\") " pod="openstack-kuttl-tests/placement-65787d59d-nv5lb" Mar 16 15:55:47 crc kubenswrapper[5120]: I0316 15:55:47.046273 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/cf58a934-0387-4876-8e01-98f0fde5e197-internal-tls-certs\") pod \"placement-65787d59d-nv5lb\" (UID: \"cf58a934-0387-4876-8e01-98f0fde5e197\") " pod="openstack-kuttl-tests/placement-65787d59d-nv5lb" Mar 16 15:55:47 crc kubenswrapper[5120]: I0316 15:55:47.046300 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/4fec53ab-7e98-41e6-8a5a-13a01e505e20-ovndb-tls-certs\") pod \"neutron-5df8bd5df5-8rzw7\" (UID: \"4fec53ab-7e98-41e6-8a5a-13a01e505e20\") " pod="openstack-kuttl-tests/neutron-5df8bd5df5-8rzw7" Mar 16 15:55:47 crc kubenswrapper[5120]: I0316 15:55:47.046329 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cf58a934-0387-4876-8e01-98f0fde5e197-config-data\") pod \"placement-65787d59d-nv5lb\" (UID: \"cf58a934-0387-4876-8e01-98f0fde5e197\") " pod="openstack-kuttl-tests/placement-65787d59d-nv5lb" Mar 16 15:55:47 crc kubenswrapper[5120]: I0316 15:55:47.047296 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/cf58a934-0387-4876-8e01-98f0fde5e197-logs\") pod \"placement-65787d59d-nv5lb\" (UID: \"cf58a934-0387-4876-8e01-98f0fde5e197\") " pod="openstack-kuttl-tests/placement-65787d59d-nv5lb" Mar 16 15:55:47 crc kubenswrapper[5120]: I0316 15:55:47.049826 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/cf58a934-0387-4876-8e01-98f0fde5e197-scripts\") pod \"placement-65787d59d-nv5lb\" (UID: \"cf58a934-0387-4876-8e01-98f0fde5e197\") " pod="openstack-kuttl-tests/placement-65787d59d-nv5lb" Mar 16 15:55:47 crc kubenswrapper[5120]: I0316 15:55:47.051056 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cf58a934-0387-4876-8e01-98f0fde5e197-config-data\") pod \"placement-65787d59d-nv5lb\" (UID: \"cf58a934-0387-4876-8e01-98f0fde5e197\") " pod="openstack-kuttl-tests/placement-65787d59d-nv5lb" Mar 16 15:55:47 crc kubenswrapper[5120]: I0316 15:55:47.055494 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cf58a934-0387-4876-8e01-98f0fde5e197-combined-ca-bundle\") pod \"placement-65787d59d-nv5lb\" (UID: \"cf58a934-0387-4876-8e01-98f0fde5e197\") " pod="openstack-kuttl-tests/placement-65787d59d-nv5lb" Mar 16 15:55:47 crc kubenswrapper[5120]: I0316 15:55:47.056986 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4fec53ab-7e98-41e6-8a5a-13a01e505e20-combined-ca-bundle\") pod \"neutron-5df8bd5df5-8rzw7\" (UID: \"4fec53ab-7e98-41e6-8a5a-13a01e505e20\") " pod="openstack-kuttl-tests/neutron-5df8bd5df5-8rzw7" Mar 16 15:55:47 crc kubenswrapper[5120]: I0316 15:55:47.061671 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/cf58a934-0387-4876-8e01-98f0fde5e197-internal-tls-certs\") pod \"placement-65787d59d-nv5lb\" (UID: \"cf58a934-0387-4876-8e01-98f0fde5e197\") " pod="openstack-kuttl-tests/placement-65787d59d-nv5lb" Mar 16 15:55:47 crc kubenswrapper[5120]: I0316 15:55:47.061692 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/cf58a934-0387-4876-8e01-98f0fde5e197-public-tls-certs\") pod \"placement-65787d59d-nv5lb\" (UID: \"cf58a934-0387-4876-8e01-98f0fde5e197\") " pod="openstack-kuttl-tests/placement-65787d59d-nv5lb" Mar 16 15:55:47 crc kubenswrapper[5120]: I0316 15:55:47.062238 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/4fec53ab-7e98-41e6-8a5a-13a01e505e20-ovndb-tls-certs\") pod \"neutron-5df8bd5df5-8rzw7\" (UID: \"4fec53ab-7e98-41e6-8a5a-13a01e505e20\") " pod="openstack-kuttl-tests/neutron-5df8bd5df5-8rzw7" Mar 16 15:55:47 crc kubenswrapper[5120]: I0316 15:55:47.062258 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/4fec53ab-7e98-41e6-8a5a-13a01e505e20-httpd-config\") pod \"neutron-5df8bd5df5-8rzw7\" (UID: \"4fec53ab-7e98-41e6-8a5a-13a01e505e20\") " pod="openstack-kuttl-tests/neutron-5df8bd5df5-8rzw7" Mar 16 15:55:47 crc kubenswrapper[5120]: I0316 15:55:47.076210 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjvc9\" (UniqueName: \"kubernetes.io/projected/4fec53ab-7e98-41e6-8a5a-13a01e505e20-kube-api-access-fjvc9\") pod \"neutron-5df8bd5df5-8rzw7\" (UID: \"4fec53ab-7e98-41e6-8a5a-13a01e505e20\") " pod="openstack-kuttl-tests/neutron-5df8bd5df5-8rzw7" Mar 16 15:55:47 crc kubenswrapper[5120]: I0316 15:55:47.084063 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cx5w6\" (UniqueName: \"kubernetes.io/projected/cf58a934-0387-4876-8e01-98f0fde5e197-kube-api-access-cx5w6\") pod \"placement-65787d59d-nv5lb\" (UID: \"cf58a934-0387-4876-8e01-98f0fde5e197\") " pod="openstack-kuttl-tests/placement-65787d59d-nv5lb" Mar 16 15:55:47 crc kubenswrapper[5120]: I0316 15:55:47.093738 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/4fec53ab-7e98-41e6-8a5a-13a01e505e20-config\") pod \"neutron-5df8bd5df5-8rzw7\" (UID: \"4fec53ab-7e98-41e6-8a5a-13a01e505e20\") " pod="openstack-kuttl-tests/neutron-5df8bd5df5-8rzw7" Mar 16 15:55:47 crc kubenswrapper[5120]: I0316 15:55:47.136179 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-65787d59d-nv5lb" Mar 16 15:55:47 crc kubenswrapper[5120]: I0316 15:55:47.242012 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-5df8bd5df5-8rzw7" Mar 16 15:55:47 crc kubenswrapper[5120]: I0316 15:55:47.376216 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-qhrl4" Mar 16 15:55:47 crc kubenswrapper[5120]: I0316 15:55:47.411235 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 15:55:47 crc kubenswrapper[5120]: I0316 15:55:47.449852 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 15:55:47 crc kubenswrapper[5120]: I0316 15:55:47.454491 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/81447c10-9237-49d3-9569-0e622dc555a6-fernet-keys\") pod \"81447c10-9237-49d3-9569-0e622dc555a6\" (UID: \"81447c10-9237-49d3-9569-0e622dc555a6\") " Mar 16 15:55:47 crc kubenswrapper[5120]: I0316 15:55:47.454570 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/81447c10-9237-49d3-9569-0e622dc555a6-combined-ca-bundle\") pod \"81447c10-9237-49d3-9569-0e622dc555a6\" (UID: \"81447c10-9237-49d3-9569-0e622dc555a6\") " Mar 16 15:55:47 crc kubenswrapper[5120]: I0316 15:55:47.454613 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/81447c10-9237-49d3-9569-0e622dc555a6-credential-keys\") pod \"81447c10-9237-49d3-9569-0e622dc555a6\" (UID: \"81447c10-9237-49d3-9569-0e622dc555a6\") " Mar 16 15:55:47 crc kubenswrapper[5120]: I0316 15:55:47.454715 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hpcs8\" (UniqueName: \"kubernetes.io/projected/81447c10-9237-49d3-9569-0e622dc555a6-kube-api-access-hpcs8\") pod \"81447c10-9237-49d3-9569-0e622dc555a6\" (UID: \"81447c10-9237-49d3-9569-0e622dc555a6\") " Mar 16 15:55:47 crc kubenswrapper[5120]: I0316 15:55:47.454862 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/81447c10-9237-49d3-9569-0e622dc555a6-config-data\") pod \"81447c10-9237-49d3-9569-0e622dc555a6\" (UID: \"81447c10-9237-49d3-9569-0e622dc555a6\") " Mar 16 15:55:47 crc kubenswrapper[5120]: I0316 15:55:47.454943 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/81447c10-9237-49d3-9569-0e622dc555a6-scripts\") pod \"81447c10-9237-49d3-9569-0e622dc555a6\" (UID: \"81447c10-9237-49d3-9569-0e622dc555a6\") " Mar 16 15:55:47 crc kubenswrapper[5120]: I0316 15:55:47.478244 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/81447c10-9237-49d3-9569-0e622dc555a6-scripts" (OuterVolumeSpecName: "scripts") pod "81447c10-9237-49d3-9569-0e622dc555a6" (UID: "81447c10-9237-49d3-9569-0e622dc555a6"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:55:47 crc kubenswrapper[5120]: I0316 15:55:47.488419 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/81447c10-9237-49d3-9569-0e622dc555a6-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "81447c10-9237-49d3-9569-0e622dc555a6" (UID: "81447c10-9237-49d3-9569-0e622dc555a6"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:55:47 crc kubenswrapper[5120]: I0316 15:55:47.504907 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81447c10-9237-49d3-9569-0e622dc555a6-kube-api-access-hpcs8" (OuterVolumeSpecName: "kube-api-access-hpcs8") pod "81447c10-9237-49d3-9569-0e622dc555a6" (UID: "81447c10-9237-49d3-9569-0e622dc555a6"). InnerVolumeSpecName "kube-api-access-hpcs8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:55:47 crc kubenswrapper[5120]: I0316 15:55:47.523958 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-65787d59d-nv5lb"] Mar 16 15:55:47 crc kubenswrapper[5120]: I0316 15:55:47.532113 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/81447c10-9237-49d3-9569-0e622dc555a6-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "81447c10-9237-49d3-9569-0e622dc555a6" (UID: "81447c10-9237-49d3-9569-0e622dc555a6"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:55:47 crc kubenswrapper[5120]: I0316 15:55:47.558251 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/81447c10-9237-49d3-9569-0e622dc555a6-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 15:55:47 crc kubenswrapper[5120]: I0316 15:55:47.558280 5120 reconciler_common.go:299] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/81447c10-9237-49d3-9569-0e622dc555a6-fernet-keys\") on node \"crc\" DevicePath \"\"" Mar 16 15:55:47 crc kubenswrapper[5120]: I0316 15:55:47.558289 5120 reconciler_common.go:299] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/81447c10-9237-49d3-9569-0e622dc555a6-credential-keys\") on node \"crc\" DevicePath \"\"" Mar 16 15:55:47 crc kubenswrapper[5120]: I0316 15:55:47.558298 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hpcs8\" (UniqueName: \"kubernetes.io/projected/81447c10-9237-49d3-9569-0e622dc555a6-kube-api-access-hpcs8\") on node \"crc\" DevicePath \"\"" Mar 16 15:55:47 crc kubenswrapper[5120]: I0316 15:55:47.656581 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/81447c10-9237-49d3-9569-0e622dc555a6-config-data" (OuterVolumeSpecName: "config-data") pod "81447c10-9237-49d3-9569-0e622dc555a6" (UID: "81447c10-9237-49d3-9569-0e622dc555a6"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:55:47 crc kubenswrapper[5120]: I0316 15:55:47.661125 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/81447c10-9237-49d3-9569-0e622dc555a6-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 15:55:47 crc kubenswrapper[5120]: I0316 15:55:47.696319 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/81447c10-9237-49d3-9569-0e622dc555a6-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "81447c10-9237-49d3-9569-0e622dc555a6" (UID: "81447c10-9237-49d3-9569-0e622dc555a6"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:55:47 crc kubenswrapper[5120]: I0316 15:55:47.762605 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/81447c10-9237-49d3-9569-0e622dc555a6-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:55:47 crc kubenswrapper[5120]: I0316 15:55:47.847381 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-qhrl4"] Mar 16 15:55:47 crc kubenswrapper[5120]: I0316 15:55:47.854177 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-qhrl4"] Mar 16 15:55:47 crc kubenswrapper[5120]: I0316 15:55:47.869018 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-5df8bd5df5-8rzw7"] Mar 16 15:55:47 crc kubenswrapper[5120]: I0316 15:55:47.944372 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-d4kn4"] Mar 16 15:55:47 crc kubenswrapper[5120]: I0316 15:55:47.945739 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81447c10-9237-49d3-9569-0e622dc555a6" containerName="keystone-bootstrap" Mar 16 15:55:47 crc kubenswrapper[5120]: I0316 15:55:47.945769 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="81447c10-9237-49d3-9569-0e622dc555a6" containerName="keystone-bootstrap" Mar 16 15:55:47 crc kubenswrapper[5120]: I0316 15:55:47.945913 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="81447c10-9237-49d3-9569-0e622dc555a6" containerName="keystone-bootstrap" Mar 16 15:55:47 crc kubenswrapper[5120]: I0316 15:55:47.950235 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-d4kn4" Mar 16 15:55:47 crc kubenswrapper[5120]: I0316 15:55:47.953968 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-d4kn4"] Mar 16 15:55:47 crc kubenswrapper[5120]: I0316 15:55:47.955266 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-f5857446c-9l89n" event={"ID":"26088cd7-dfce-4ccd-b93e-87a82505e96d","Type":"ContainerStarted","Data":"ddb032fc80332b70af942970475d083b2c36a89ec806a69547e2c9f2f11348c4"} Mar 16 15:55:47 crc kubenswrapper[5120]: I0316 15:55:47.955290 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-f5857446c-9l89n" event={"ID":"26088cd7-dfce-4ccd-b93e-87a82505e96d","Type":"ContainerStarted","Data":"29420b5fed586139ace73e358b1045da617160601f178ed63399faccf034c239"} Mar 16 15:55:47 crc kubenswrapper[5120]: I0316 15:55:47.971970 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bcdd2411-5651-46f4-ad3f-6281c4e2b780-config-data\") pod \"keystone-bootstrap-d4kn4\" (UID: \"bcdd2411-5651-46f4-ad3f-6281c4e2b780\") " pod="openstack-kuttl-tests/keystone-bootstrap-d4kn4" Mar 16 15:55:47 crc kubenswrapper[5120]: I0316 15:55:47.972049 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/bcdd2411-5651-46f4-ad3f-6281c4e2b780-scripts\") pod \"keystone-bootstrap-d4kn4\" (UID: \"bcdd2411-5651-46f4-ad3f-6281c4e2b780\") " pod="openstack-kuttl-tests/keystone-bootstrap-d4kn4" Mar 16 15:55:47 crc kubenswrapper[5120]: I0316 15:55:47.972069 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/bcdd2411-5651-46f4-ad3f-6281c4e2b780-credential-keys\") pod \"keystone-bootstrap-d4kn4\" (UID: \"bcdd2411-5651-46f4-ad3f-6281c4e2b780\") " pod="openstack-kuttl-tests/keystone-bootstrap-d4kn4" Mar 16 15:55:47 crc kubenswrapper[5120]: I0316 15:55:47.973228 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"705910c5-8552-43be-ba28-dfad2b51ce96","Type":"ContainerStarted","Data":"51a11a548581165982e0bdc2420f6360adb85e3cf92fc65130c9ae69df7a1486"} Mar 16 15:55:47 crc kubenswrapper[5120]: I0316 15:55:47.973402 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ft5g9\" (UniqueName: \"kubernetes.io/projected/bcdd2411-5651-46f4-ad3f-6281c4e2b780-kube-api-access-ft5g9\") pod \"keystone-bootstrap-d4kn4\" (UID: \"bcdd2411-5651-46f4-ad3f-6281c4e2b780\") " pod="openstack-kuttl-tests/keystone-bootstrap-d4kn4" Mar 16 15:55:47 crc kubenswrapper[5120]: I0316 15:55:47.974034 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/bcdd2411-5651-46f4-ad3f-6281c4e2b780-fernet-keys\") pod \"keystone-bootstrap-d4kn4\" (UID: \"bcdd2411-5651-46f4-ad3f-6281c4e2b780\") " pod="openstack-kuttl-tests/keystone-bootstrap-d4kn4" Mar 16 15:55:47 crc kubenswrapper[5120]: I0316 15:55:47.979967 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bcdd2411-5651-46f4-ad3f-6281c4e2b780-combined-ca-bundle\") pod \"keystone-bootstrap-d4kn4\" (UID: \"bcdd2411-5651-46f4-ad3f-6281c4e2b780\") " pod="openstack-kuttl-tests/keystone-bootstrap-d4kn4" Mar 16 15:55:48 crc kubenswrapper[5120]: I0316 15:55:48.032239 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-worker-f5857446c-9l89n" podStartSLOduration=3.032218937 podStartE2EDuration="3.032218937s" podCreationTimestamp="2026-03-16 15:55:45 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:55:48.004331635 +0000 UTC m=+1450.158263292" watchObservedRunningTime="2026-03-16 15:55:48.032218937 +0000 UTC m=+1450.186150594" Mar 16 15:55:48 crc kubenswrapper[5120]: I0316 15:55:48.035436 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-846956b868-5mw5q" event={"ID":"2bdcf641-1e8c-4994-8981-4db0f4c37973","Type":"ContainerStarted","Data":"e3ced6f61d6c257b6542a0bbff241fccd765917c8b7ba3a38dfe4e78d09ee022"} Mar 16 15:55:48 crc kubenswrapper[5120]: I0316 15:55:48.035483 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-846956b868-5mw5q" event={"ID":"2bdcf641-1e8c-4994-8981-4db0f4c37973","Type":"ContainerStarted","Data":"d6f7a1712d60e688b4b9ea58c2d56397e716e1646fb0fc20e79dbae343c202f2"} Mar 16 15:55:48 crc kubenswrapper[5120]: I0316 15:55:48.035493 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-846956b868-5mw5q" event={"ID":"2bdcf641-1e8c-4994-8981-4db0f4c37973","Type":"ContainerStarted","Data":"d252cb1c6ea75f1bd1326c3ffb4c7519fed7e18975e4adf1ff6b150d04c07925"} Mar 16 15:55:48 crc kubenswrapper[5120]: I0316 15:55:48.036616 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-846956b868-5mw5q" Mar 16 15:55:48 crc kubenswrapper[5120]: I0316 15:55:48.036640 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-846956b868-5mw5q" Mar 16 15:55:48 crc kubenswrapper[5120]: I0316 15:55:48.042877 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"8b8d1827-2a30-4e12-b2a4-bccb49518ffc","Type":"ContainerStarted","Data":"098b5ecbf56f85af50c5a808de7b88c25943d8a0e3e768d6a1de772fcfe724b8"} Mar 16 15:55:48 crc kubenswrapper[5120]: I0316 15:55:48.043035 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="8b8d1827-2a30-4e12-b2a4-bccb49518ffc" containerName="ceilometer-central-agent" containerID="cri-o://cc7e5e9f455cdb4dfa2088d3b46a1f4cda1432e042f33ee229e4cc180f4a34ec" gracePeriod=30 Mar 16 15:55:48 crc kubenswrapper[5120]: I0316 15:55:48.043231 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:55:48 crc kubenswrapper[5120]: I0316 15:55:48.043275 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="8b8d1827-2a30-4e12-b2a4-bccb49518ffc" containerName="proxy-httpd" containerID="cri-o://098b5ecbf56f85af50c5a808de7b88c25943d8a0e3e768d6a1de772fcfe724b8" gracePeriod=30 Mar 16 15:55:48 crc kubenswrapper[5120]: I0316 15:55:48.043317 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="8b8d1827-2a30-4e12-b2a4-bccb49518ffc" containerName="sg-core" containerID="cri-o://ccb30b885978e94a539c5cd7d3f7d92bf602eb53324edd161e2f1697fdd364cb" gracePeriod=30 Mar 16 15:55:48 crc kubenswrapper[5120]: I0316 15:55:48.043352 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="8b8d1827-2a30-4e12-b2a4-bccb49518ffc" containerName="ceilometer-notification-agent" containerID="cri-o://361efc4887708e8641e75ee835fd9bc36c81740accd42664a3e3b1acd93cc485" gracePeriod=30 Mar 16 15:55:48 crc kubenswrapper[5120]: I0316 15:55:48.065512 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-dc8f675f4-72f6q" event={"ID":"9da74618-45dc-4a60-8f6a-dfb9c30cb13a","Type":"ContainerStarted","Data":"8d924281be01f8bf7c744f0b2244d69b2636a7cad3a82bf98a97ff4b35a10f9f"} Mar 16 15:55:48 crc kubenswrapper[5120]: I0316 15:55:48.065559 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-dc8f675f4-72f6q" event={"ID":"9da74618-45dc-4a60-8f6a-dfb9c30cb13a","Type":"ContainerStarted","Data":"70ce6108fc29a7144fbd66baa8ec206ddbc3b451583661f15f61171c9523ee30"} Mar 16 15:55:48 crc kubenswrapper[5120]: I0316 15:55:48.081836 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"93f6640c-a255-4892-abe7-01f211126bb5","Type":"ContainerStarted","Data":"0e62a85ac91ced8b806292e48b6c8298758ca4f217f8171208caa7a0e43e770c"} Mar 16 15:55:48 crc kubenswrapper[5120]: I0316 15:55:48.081931 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ft5g9\" (UniqueName: \"kubernetes.io/projected/bcdd2411-5651-46f4-ad3f-6281c4e2b780-kube-api-access-ft5g9\") pod \"keystone-bootstrap-d4kn4\" (UID: \"bcdd2411-5651-46f4-ad3f-6281c4e2b780\") " pod="openstack-kuttl-tests/keystone-bootstrap-d4kn4" Mar 16 15:55:48 crc kubenswrapper[5120]: I0316 15:55:48.082122 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/bcdd2411-5651-46f4-ad3f-6281c4e2b780-fernet-keys\") pod \"keystone-bootstrap-d4kn4\" (UID: \"bcdd2411-5651-46f4-ad3f-6281c4e2b780\") " pod="openstack-kuttl-tests/keystone-bootstrap-d4kn4" Mar 16 15:55:48 crc kubenswrapper[5120]: I0316 15:55:48.082153 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bcdd2411-5651-46f4-ad3f-6281c4e2b780-combined-ca-bundle\") pod \"keystone-bootstrap-d4kn4\" (UID: \"bcdd2411-5651-46f4-ad3f-6281c4e2b780\") " pod="openstack-kuttl-tests/keystone-bootstrap-d4kn4" Mar 16 15:55:48 crc kubenswrapper[5120]: I0316 15:55:48.082337 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bcdd2411-5651-46f4-ad3f-6281c4e2b780-config-data\") pod \"keystone-bootstrap-d4kn4\" (UID: \"bcdd2411-5651-46f4-ad3f-6281c4e2b780\") " pod="openstack-kuttl-tests/keystone-bootstrap-d4kn4" Mar 16 15:55:48 crc kubenswrapper[5120]: I0316 15:55:48.082448 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/bcdd2411-5651-46f4-ad3f-6281c4e2b780-scripts\") pod \"keystone-bootstrap-d4kn4\" (UID: \"bcdd2411-5651-46f4-ad3f-6281c4e2b780\") " pod="openstack-kuttl-tests/keystone-bootstrap-d4kn4" Mar 16 15:55:48 crc kubenswrapper[5120]: I0316 15:55:48.082478 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/bcdd2411-5651-46f4-ad3f-6281c4e2b780-credential-keys\") pod \"keystone-bootstrap-d4kn4\" (UID: \"bcdd2411-5651-46f4-ad3f-6281c4e2b780\") " pod="openstack-kuttl-tests/keystone-bootstrap-d4kn4" Mar 16 15:55:48 crc kubenswrapper[5120]: I0316 15:55:48.100384 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bcdd2411-5651-46f4-ad3f-6281c4e2b780-config-data\") pod \"keystone-bootstrap-d4kn4\" (UID: \"bcdd2411-5651-46f4-ad3f-6281c4e2b780\") " pod="openstack-kuttl-tests/keystone-bootstrap-d4kn4" Mar 16 15:55:48 crc kubenswrapper[5120]: I0316 15:55:48.101859 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/bcdd2411-5651-46f4-ad3f-6281c4e2b780-scripts\") pod \"keystone-bootstrap-d4kn4\" (UID: \"bcdd2411-5651-46f4-ad3f-6281c4e2b780\") " pod="openstack-kuttl-tests/keystone-bootstrap-d4kn4" Mar 16 15:55:48 crc kubenswrapper[5120]: I0316 15:55:48.108570 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-5df8bd5df5-8rzw7" event={"ID":"4fec53ab-7e98-41e6-8a5a-13a01e505e20","Type":"ContainerStarted","Data":"a837d5d6f572798f6fa99d98aa8e80f904f874210f2a45d248501c7729d4c514"} Mar 16 15:55:48 crc kubenswrapper[5120]: I0316 15:55:48.121210 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/bcdd2411-5651-46f4-ad3f-6281c4e2b780-credential-keys\") pod \"keystone-bootstrap-d4kn4\" (UID: \"bcdd2411-5651-46f4-ad3f-6281c4e2b780\") " pod="openstack-kuttl-tests/keystone-bootstrap-d4kn4" Mar 16 15:55:48 crc kubenswrapper[5120]: I0316 15:55:48.121522 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bcdd2411-5651-46f4-ad3f-6281c4e2b780-combined-ca-bundle\") pod \"keystone-bootstrap-d4kn4\" (UID: \"bcdd2411-5651-46f4-ad3f-6281c4e2b780\") " pod="openstack-kuttl-tests/keystone-bootstrap-d4kn4" Mar 16 15:55:48 crc kubenswrapper[5120]: I0316 15:55:48.121664 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/bcdd2411-5651-46f4-ad3f-6281c4e2b780-fernet-keys\") pod \"keystone-bootstrap-d4kn4\" (UID: \"bcdd2411-5651-46f4-ad3f-6281c4e2b780\") " pod="openstack-kuttl-tests/keystone-bootstrap-d4kn4" Mar 16 15:55:48 crc kubenswrapper[5120]: I0316 15:55:48.123688 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ft5g9\" (UniqueName: \"kubernetes.io/projected/bcdd2411-5651-46f4-ad3f-6281c4e2b780-kube-api-access-ft5g9\") pod \"keystone-bootstrap-d4kn4\" (UID: \"bcdd2411-5651-46f4-ad3f-6281c4e2b780\") " pod="openstack-kuttl-tests/keystone-bootstrap-d4kn4" Mar 16 15:55:48 crc kubenswrapper[5120]: I0316 15:55:48.139043 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-api-846956b868-5mw5q" podStartSLOduration=3.139026615 podStartE2EDuration="3.139026615s" podCreationTimestamp="2026-03-16 15:55:45 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:55:48.063191745 +0000 UTC m=+1450.217123402" watchObservedRunningTime="2026-03-16 15:55:48.139026615 +0000 UTC m=+1450.292958272" Mar 16 15:55:48 crc kubenswrapper[5120]: I0316 15:55:48.142298 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.744720676 podStartE2EDuration="8.142283895s" podCreationTimestamp="2026-03-16 15:55:40 +0000 UTC" firstStartedPulling="2026-03-16 15:55:41.589660304 +0000 UTC m=+1443.743591961" lastFinishedPulling="2026-03-16 15:55:46.987223523 +0000 UTC m=+1449.141155180" observedRunningTime="2026-03-16 15:55:48.086363576 +0000 UTC m=+1450.240295233" watchObservedRunningTime="2026-03-16 15:55:48.142283895 +0000 UTC m=+1450.296215552" Mar 16 15:55:48 crc kubenswrapper[5120]: I0316 15:55:48.156442 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-keystone-listener-dc8f675f4-72f6q" podStartSLOduration=3.156423847 podStartE2EDuration="3.156423847s" podCreationTimestamp="2026-03-16 15:55:45 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:55:48.104933201 +0000 UTC m=+1450.258864858" watchObservedRunningTime="2026-03-16 15:55:48.156423847 +0000 UTC m=+1450.310355504" Mar 16 15:55:48 crc kubenswrapper[5120]: I0316 15:55:48.172663 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-65787d59d-nv5lb" event={"ID":"cf58a934-0387-4876-8e01-98f0fde5e197","Type":"ContainerStarted","Data":"d305f594b00d5c91584646dcd2aec6322bbd43b2fdd2aa54565d425a2e0a295d"} Mar 16 15:55:48 crc kubenswrapper[5120]: I0316 15:55:48.172701 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-65787d59d-nv5lb" event={"ID":"cf58a934-0387-4876-8e01-98f0fde5e197","Type":"ContainerStarted","Data":"1c59ff0f33a11d9cc4211216e3c3cb3c3660aee72336e61c182a2e98953976d1"} Mar 16 15:55:48 crc kubenswrapper[5120]: I0316 15:55:48.203307 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-qhrl4" Mar 16 15:55:48 crc kubenswrapper[5120]: I0316 15:55:48.204079 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3c9dbb0944861311fe405b2ca99452f97b4ab7094e2f74b445d422c4bc36e738" Mar 16 15:55:48 crc kubenswrapper[5120]: I0316 15:55:48.334131 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-d4kn4" Mar 16 15:55:48 crc kubenswrapper[5120]: I0316 15:55:48.421642 5120 status_manager.go:895] "Failed to get status for pod" podUID="81447c10-9237-49d3-9569-0e622dc555a6" pod="openstack-kuttl-tests/keystone-bootstrap-qhrl4" err="pods \"keystone-bootstrap-qhrl4\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 15:55:48 crc kubenswrapper[5120]: I0316 15:55:48.684981 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="81447c10-9237-49d3-9569-0e622dc555a6" path="/var/lib/kubelet/pods/81447c10-9237-49d3-9569-0e622dc555a6/volumes" Mar 16 15:55:48 crc kubenswrapper[5120]: I0316 15:55:48.724873 5120 status_manager.go:895] "Failed to get status for pod" podUID="81447c10-9237-49d3-9569-0e622dc555a6" pod="openstack-kuttl-tests/keystone-bootstrap-qhrl4" err="pods \"keystone-bootstrap-qhrl4\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 15:55:48 crc kubenswrapper[5120]: I0316 15:55:48.729253 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-s8lzg" Mar 16 15:55:48 crc kubenswrapper[5120]: I0316 15:55:48.807932 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8d7af5d0-3283-41d8-9e35-fa6a70fceb0a-scripts\") pod \"8d7af5d0-3283-41d8-9e35-fa6a70fceb0a\" (UID: \"8d7af5d0-3283-41d8-9e35-fa6a70fceb0a\") " Mar 16 15:55:48 crc kubenswrapper[5120]: I0316 15:55:48.808289 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/8d7af5d0-3283-41d8-9e35-fa6a70fceb0a-etc-machine-id\") pod \"8d7af5d0-3283-41d8-9e35-fa6a70fceb0a\" (UID: \"8d7af5d0-3283-41d8-9e35-fa6a70fceb0a\") " Mar 16 15:55:48 crc kubenswrapper[5120]: I0316 15:55:48.808400 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8d7af5d0-3283-41d8-9e35-fa6a70fceb0a-config-data\") pod \"8d7af5d0-3283-41d8-9e35-fa6a70fceb0a\" (UID: \"8d7af5d0-3283-41d8-9e35-fa6a70fceb0a\") " Mar 16 15:55:48 crc kubenswrapper[5120]: I0316 15:55:48.808403 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/8d7af5d0-3283-41d8-9e35-fa6a70fceb0a-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "8d7af5d0-3283-41d8-9e35-fa6a70fceb0a" (UID: "8d7af5d0-3283-41d8-9e35-fa6a70fceb0a"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 15:55:48 crc kubenswrapper[5120]: I0316 15:55:48.808572 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/8d7af5d0-3283-41d8-9e35-fa6a70fceb0a-db-sync-config-data\") pod \"8d7af5d0-3283-41d8-9e35-fa6a70fceb0a\" (UID: \"8d7af5d0-3283-41d8-9e35-fa6a70fceb0a\") " Mar 16 15:55:48 crc kubenswrapper[5120]: I0316 15:55:48.809643 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8d7af5d0-3283-41d8-9e35-fa6a70fceb0a-combined-ca-bundle\") pod \"8d7af5d0-3283-41d8-9e35-fa6a70fceb0a\" (UID: \"8d7af5d0-3283-41d8-9e35-fa6a70fceb0a\") " Mar 16 15:55:48 crc kubenswrapper[5120]: I0316 15:55:48.809682 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9jcdf\" (UniqueName: \"kubernetes.io/projected/8d7af5d0-3283-41d8-9e35-fa6a70fceb0a-kube-api-access-9jcdf\") pod \"8d7af5d0-3283-41d8-9e35-fa6a70fceb0a\" (UID: \"8d7af5d0-3283-41d8-9e35-fa6a70fceb0a\") " Mar 16 15:55:48 crc kubenswrapper[5120]: I0316 15:55:48.810587 5120 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/8d7af5d0-3283-41d8-9e35-fa6a70fceb0a-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 15:55:48 crc kubenswrapper[5120]: I0316 15:55:48.817896 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d7af5d0-3283-41d8-9e35-fa6a70fceb0a-scripts" (OuterVolumeSpecName: "scripts") pod "8d7af5d0-3283-41d8-9e35-fa6a70fceb0a" (UID: "8d7af5d0-3283-41d8-9e35-fa6a70fceb0a"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:55:48 crc kubenswrapper[5120]: I0316 15:55:48.821282 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d7af5d0-3283-41d8-9e35-fa6a70fceb0a-db-sync-config-data" (OuterVolumeSpecName: "db-sync-config-data") pod "8d7af5d0-3283-41d8-9e35-fa6a70fceb0a" (UID: "8d7af5d0-3283-41d8-9e35-fa6a70fceb0a"). InnerVolumeSpecName "db-sync-config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:55:48 crc kubenswrapper[5120]: I0316 15:55:48.842896 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d7af5d0-3283-41d8-9e35-fa6a70fceb0a-kube-api-access-9jcdf" (OuterVolumeSpecName: "kube-api-access-9jcdf") pod "8d7af5d0-3283-41d8-9e35-fa6a70fceb0a" (UID: "8d7af5d0-3283-41d8-9e35-fa6a70fceb0a"). InnerVolumeSpecName "kube-api-access-9jcdf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:55:48 crc kubenswrapper[5120]: I0316 15:55:48.916004 5120 reconciler_common.go:299] "Volume detached for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/8d7af5d0-3283-41d8-9e35-fa6a70fceb0a-db-sync-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 15:55:48 crc kubenswrapper[5120]: I0316 15:55:48.916050 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9jcdf\" (UniqueName: \"kubernetes.io/projected/8d7af5d0-3283-41d8-9e35-fa6a70fceb0a-kube-api-access-9jcdf\") on node \"crc\" DevicePath \"\"" Mar 16 15:55:48 crc kubenswrapper[5120]: I0316 15:55:48.916061 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8d7af5d0-3283-41d8-9e35-fa6a70fceb0a-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 15:55:48 crc kubenswrapper[5120]: I0316 15:55:48.960506 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d7af5d0-3283-41d8-9e35-fa6a70fceb0a-config-data" (OuterVolumeSpecName: "config-data") pod "8d7af5d0-3283-41d8-9e35-fa6a70fceb0a" (UID: "8d7af5d0-3283-41d8-9e35-fa6a70fceb0a"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:55:48 crc kubenswrapper[5120]: I0316 15:55:48.962621 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-d4kn4"] Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.008923 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d7af5d0-3283-41d8-9e35-fa6a70fceb0a-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "8d7af5d0-3283-41d8-9e35-fa6a70fceb0a" (UID: "8d7af5d0-3283-41d8-9e35-fa6a70fceb0a"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.025072 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8d7af5d0-3283-41d8-9e35-fa6a70fceb0a-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.025097 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8d7af5d0-3283-41d8-9e35-fa6a70fceb0a-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.141191 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.229290 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/8b8d1827-2a30-4e12-b2a4-bccb49518ffc-sg-core-conf-yaml\") pod \"8b8d1827-2a30-4e12-b2a4-bccb49518ffc\" (UID: \"8b8d1827-2a30-4e12-b2a4-bccb49518ffc\") " Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.229640 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8b8d1827-2a30-4e12-b2a4-bccb49518ffc-scripts\") pod \"8b8d1827-2a30-4e12-b2a4-bccb49518ffc\" (UID: \"8b8d1827-2a30-4e12-b2a4-bccb49518ffc\") " Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.229691 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8b8d1827-2a30-4e12-b2a4-bccb49518ffc-combined-ca-bundle\") pod \"8b8d1827-2a30-4e12-b2a4-bccb49518ffc\" (UID: \"8b8d1827-2a30-4e12-b2a4-bccb49518ffc\") " Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.229734 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/8b8d1827-2a30-4e12-b2a4-bccb49518ffc-run-httpd\") pod \"8b8d1827-2a30-4e12-b2a4-bccb49518ffc\" (UID: \"8b8d1827-2a30-4e12-b2a4-bccb49518ffc\") " Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.229775 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8b8d1827-2a30-4e12-b2a4-bccb49518ffc-config-data\") pod \"8b8d1827-2a30-4e12-b2a4-bccb49518ffc\" (UID: \"8b8d1827-2a30-4e12-b2a4-bccb49518ffc\") " Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.229873 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/8b8d1827-2a30-4e12-b2a4-bccb49518ffc-log-httpd\") pod \"8b8d1827-2a30-4e12-b2a4-bccb49518ffc\" (UID: \"8b8d1827-2a30-4e12-b2a4-bccb49518ffc\") " Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.230024 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4hzc6\" (UniqueName: \"kubernetes.io/projected/8b8d1827-2a30-4e12-b2a4-bccb49518ffc-kube-api-access-4hzc6\") pod \"8b8d1827-2a30-4e12-b2a4-bccb49518ffc\" (UID: \"8b8d1827-2a30-4e12-b2a4-bccb49518ffc\") " Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.230462 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b8d1827-2a30-4e12-b2a4-bccb49518ffc-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "8b8d1827-2a30-4e12-b2a4-bccb49518ffc" (UID: "8b8d1827-2a30-4e12-b2a4-bccb49518ffc"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.231427 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b8d1827-2a30-4e12-b2a4-bccb49518ffc-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "8b8d1827-2a30-4e12-b2a4-bccb49518ffc" (UID: "8b8d1827-2a30-4e12-b2a4-bccb49518ffc"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.245939 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8b8d1827-2a30-4e12-b2a4-bccb49518ffc-scripts" (OuterVolumeSpecName: "scripts") pod "8b8d1827-2a30-4e12-b2a4-bccb49518ffc" (UID: "8b8d1827-2a30-4e12-b2a4-bccb49518ffc"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.285060 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b8d1827-2a30-4e12-b2a4-bccb49518ffc-kube-api-access-4hzc6" (OuterVolumeSpecName: "kube-api-access-4hzc6") pod "8b8d1827-2a30-4e12-b2a4-bccb49518ffc" (UID: "8b8d1827-2a30-4e12-b2a4-bccb49518ffc"). InnerVolumeSpecName "kube-api-access-4hzc6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.332139 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4hzc6\" (UniqueName: \"kubernetes.io/projected/8b8d1827-2a30-4e12-b2a4-bccb49518ffc-kube-api-access-4hzc6\") on node \"crc\" DevicePath \"\"" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.332168 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8b8d1827-2a30-4e12-b2a4-bccb49518ffc-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.332179 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/8b8d1827-2a30-4e12-b2a4-bccb49518ffc-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.332189 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/8b8d1827-2a30-4e12-b2a4-bccb49518ffc-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.333147 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8b8d1827-2a30-4e12-b2a4-bccb49518ffc-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "8b8d1827-2a30-4e12-b2a4-bccb49518ffc" (UID: "8b8d1827-2a30-4e12-b2a4-bccb49518ffc"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.346231 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.347153 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b8d1827-2a30-4e12-b2a4-bccb49518ffc" containerName="sg-core" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.347170 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b8d1827-2a30-4e12-b2a4-bccb49518ffc" containerName="sg-core" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.347193 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b8d1827-2a30-4e12-b2a4-bccb49518ffc" containerName="ceilometer-notification-agent" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.347200 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b8d1827-2a30-4e12-b2a4-bccb49518ffc" containerName="ceilometer-notification-agent" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.347224 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b8d1827-2a30-4e12-b2a4-bccb49518ffc" containerName="ceilometer-central-agent" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.347230 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b8d1827-2a30-4e12-b2a4-bccb49518ffc" containerName="ceilometer-central-agent" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.347239 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b8d1827-2a30-4e12-b2a4-bccb49518ffc" containerName="proxy-httpd" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.347245 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b8d1827-2a30-4e12-b2a4-bccb49518ffc" containerName="proxy-httpd" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.347261 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d7af5d0-3283-41d8-9e35-fa6a70fceb0a" containerName="cinder-db-sync" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.347268 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d7af5d0-3283-41d8-9e35-fa6a70fceb0a" containerName="cinder-db-sync" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.347426 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="8b8d1827-2a30-4e12-b2a4-bccb49518ffc" containerName="ceilometer-notification-agent" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.347444 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="8b8d1827-2a30-4e12-b2a4-bccb49518ffc" containerName="proxy-httpd" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.347453 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="8d7af5d0-3283-41d8-9e35-fa6a70fceb0a" containerName="cinder-db-sync" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.347464 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="8b8d1827-2a30-4e12-b2a4-bccb49518ffc" containerName="sg-core" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.347475 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="8b8d1827-2a30-4e12-b2a4-bccb49518ffc" containerName="ceilometer-central-agent" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.367541 5120 generic.go:358] "Generic (PLEG): container finished" podID="8b8d1827-2a30-4e12-b2a4-bccb49518ffc" containerID="098b5ecbf56f85af50c5a808de7b88c25943d8a0e3e768d6a1de772fcfe724b8" exitCode=0 Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.367569 5120 generic.go:358] "Generic (PLEG): container finished" podID="8b8d1827-2a30-4e12-b2a4-bccb49518ffc" containerID="ccb30b885978e94a539c5cd7d3f7d92bf602eb53324edd161e2f1697fdd364cb" exitCode=2 Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.367576 5120 generic.go:358] "Generic (PLEG): container finished" podID="8b8d1827-2a30-4e12-b2a4-bccb49518ffc" containerID="361efc4887708e8641e75ee835fd9bc36c81740accd42664a3e3b1acd93cc485" exitCode=0 Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.367582 5120 generic.go:358] "Generic (PLEG): container finished" podID="8b8d1827-2a30-4e12-b2a4-bccb49518ffc" containerID="cc7e5e9f455cdb4dfa2088d3b46a1f4cda1432e042f33ee229e4cc180f4a34ec" exitCode=0 Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.367699 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.412072 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8b8d1827-2a30-4e12-b2a4-bccb49518ffc-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "8b8d1827-2a30-4e12-b2a4-bccb49518ffc" (UID: "8b8d1827-2a30-4e12-b2a4-bccb49518ffc"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.419021 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"8b8d1827-2a30-4e12-b2a4-bccb49518ffc","Type":"ContainerDied","Data":"098b5ecbf56f85af50c5a808de7b88c25943d8a0e3e768d6a1de772fcfe724b8"} Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.419074 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"8b8d1827-2a30-4e12-b2a4-bccb49518ffc","Type":"ContainerDied","Data":"ccb30b885978e94a539c5cd7d3f7d92bf602eb53324edd161e2f1697fdd364cb"} Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.419085 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"8b8d1827-2a30-4e12-b2a4-bccb49518ffc","Type":"ContainerDied","Data":"361efc4887708e8641e75ee835fd9bc36c81740accd42664a3e3b1acd93cc485"} Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.419097 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"8b8d1827-2a30-4e12-b2a4-bccb49518ffc","Type":"ContainerDied","Data":"cc7e5e9f455cdb4dfa2088d3b46a1f4cda1432e042f33ee229e4cc180f4a34ec"} Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.419109 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.419121 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"8b8d1827-2a30-4e12-b2a4-bccb49518ffc","Type":"ContainerDied","Data":"03e260e6227a8ec97d356bf6f223ac68e607d9af18552883f6f1b4a1daeb488b"} Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.419133 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.419177 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.419224 5120 scope.go:117] "RemoveContainer" containerID="098b5ecbf56f85af50c5a808de7b88c25943d8a0e3e768d6a1de772fcfe724b8" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.425017 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-scheduler-config-data\"" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.445028 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/neutron-5df8bd5df5-8rzw7" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.445065 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-d4kn4" event={"ID":"bcdd2411-5651-46f4-ad3f-6281c4e2b780","Type":"ContainerStarted","Data":"0d4f1609f1e5d2bb71e57be7c76c521f9500cb2efa95f31f55a8a626b74e0cbe"} Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.445086 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"93f6640c-a255-4892-abe7-01f211126bb5","Type":"ContainerStarted","Data":"722ca498832ae2ebfb82e105279c5eb651d13cd50b7baec7f037c4941ec3bed0"} Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.445099 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-5df8bd5df5-8rzw7" event={"ID":"4fec53ab-7e98-41e6-8a5a-13a01e505e20","Type":"ContainerStarted","Data":"a7755c4f1c544f2beb5f82d3075c770789a49b4737465a58ab5d744f67bb5963"} Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.445109 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-5df8bd5df5-8rzw7" event={"ID":"4fec53ab-7e98-41e6-8a5a-13a01e505e20","Type":"ContainerStarted","Data":"bd83292dc770a59f89aa35588285d0e5be2a7afc961aef66bc722a86aecaf425"} Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.445239 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.449408 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-api-config-data\"" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.455417 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/8b8d1827-2a30-4e12-b2a4-bccb49518ffc-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.455439 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8b8d1827-2a30-4e12-b2a4-bccb49518ffc-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.460716 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.472918 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-65787d59d-nv5lb" event={"ID":"cf58a934-0387-4876-8e01-98f0fde5e197","Type":"ContainerStarted","Data":"a59906c4c7095966c179f97d64794e73296b07cdbe357e4b6d8adae7c71a2521"} Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.473833 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-65787d59d-nv5lb" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.473861 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-65787d59d-nv5lb" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.475343 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-5df8bd5df5-8rzw7" podStartSLOduration=3.475323907 podStartE2EDuration="3.475323907s" podCreationTimestamp="2026-03-16 15:55:46 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:55:49.466265006 +0000 UTC m=+1451.620196673" watchObservedRunningTime="2026-03-16 15:55:49.475323907 +0000 UTC m=+1451.629255564" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.532212 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-s8lzg" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.533623 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-s8lzg" event={"ID":"8d7af5d0-3283-41d8-9e35-fa6a70fceb0a","Type":"ContainerDied","Data":"02dc8095aa9cae2aa60423e960d13f4d83458c4693f5f6a0de3a3fb8735efc31"} Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.533668 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="02dc8095aa9cae2aa60423e960d13f4d83458c4693f5f6a0de3a3fb8735efc31" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.544843 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-65787d59d-nv5lb" podStartSLOduration=3.544824612 podStartE2EDuration="3.544824612s" podCreationTimestamp="2026-03-16 15:55:46 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:55:49.544211256 +0000 UTC m=+1451.698142913" watchObservedRunningTime="2026-03-16 15:55:49.544824612 +0000 UTC m=+1451.698756269" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.557281 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/bd004e27-ba3d-4d48-97a8-b224be1ecc66-logs\") pod \"cinder-api-0\" (UID: \"bd004e27-ba3d-4d48-97a8-b224be1ecc66\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.557363 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/166e6318-307c-45a6-9273-2b1541498718-config-data\") pod \"cinder-scheduler-0\" (UID: \"166e6318-307c-45a6-9273-2b1541498718\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.557382 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/166e6318-307c-45a6-9273-2b1541498718-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"166e6318-307c-45a6-9273-2b1541498718\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.557411 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/bd004e27-ba3d-4d48-97a8-b224be1ecc66-config-data-custom\") pod \"cinder-api-0\" (UID: \"bd004e27-ba3d-4d48-97a8-b224be1ecc66\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.557427 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/166e6318-307c-45a6-9273-2b1541498718-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"166e6318-307c-45a6-9273-2b1541498718\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.557469 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vj8ll\" (UniqueName: \"kubernetes.io/projected/166e6318-307c-45a6-9273-2b1541498718-kube-api-access-vj8ll\") pod \"cinder-scheduler-0\" (UID: \"166e6318-307c-45a6-9273-2b1541498718\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.557512 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/166e6318-307c-45a6-9273-2b1541498718-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"166e6318-307c-45a6-9273-2b1541498718\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.557542 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/bd004e27-ba3d-4d48-97a8-b224be1ecc66-etc-machine-id\") pod \"cinder-api-0\" (UID: \"bd004e27-ba3d-4d48-97a8-b224be1ecc66\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.557572 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/166e6318-307c-45a6-9273-2b1541498718-scripts\") pod \"cinder-scheduler-0\" (UID: \"166e6318-307c-45a6-9273-2b1541498718\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.557670 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n52mq\" (UniqueName: \"kubernetes.io/projected/bd004e27-ba3d-4d48-97a8-b224be1ecc66-kube-api-access-n52mq\") pod \"cinder-api-0\" (UID: \"bd004e27-ba3d-4d48-97a8-b224be1ecc66\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.557708 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bd004e27-ba3d-4d48-97a8-b224be1ecc66-config-data\") pod \"cinder-api-0\" (UID: \"bd004e27-ba3d-4d48-97a8-b224be1ecc66\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.557734 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bd004e27-ba3d-4d48-97a8-b224be1ecc66-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"bd004e27-ba3d-4d48-97a8-b224be1ecc66\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.557771 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/bd004e27-ba3d-4d48-97a8-b224be1ecc66-scripts\") pod \"cinder-api-0\" (UID: \"bd004e27-ba3d-4d48-97a8-b224be1ecc66\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.577358 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"705910c5-8552-43be-ba28-dfad2b51ce96","Type":"ContainerStarted","Data":"4ca7ca677a69ff5a268826d7faf5ff870727b33cf022c842abb4a56c8d85e241"} Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.612469 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8b8d1827-2a30-4e12-b2a4-bccb49518ffc-config-data" (OuterVolumeSpecName: "config-data") pod "8b8d1827-2a30-4e12-b2a4-bccb49518ffc" (UID: "8b8d1827-2a30-4e12-b2a4-bccb49518ffc"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.613203 5120 scope.go:117] "RemoveContainer" containerID="ccb30b885978e94a539c5cd7d3f7d92bf602eb53324edd161e2f1697fdd364cb" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.658965 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vj8ll\" (UniqueName: \"kubernetes.io/projected/166e6318-307c-45a6-9273-2b1541498718-kube-api-access-vj8ll\") pod \"cinder-scheduler-0\" (UID: \"166e6318-307c-45a6-9273-2b1541498718\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.659047 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/166e6318-307c-45a6-9273-2b1541498718-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"166e6318-307c-45a6-9273-2b1541498718\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.659102 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/bd004e27-ba3d-4d48-97a8-b224be1ecc66-etc-machine-id\") pod \"cinder-api-0\" (UID: \"bd004e27-ba3d-4d48-97a8-b224be1ecc66\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.659150 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/166e6318-307c-45a6-9273-2b1541498718-scripts\") pod \"cinder-scheduler-0\" (UID: \"166e6318-307c-45a6-9273-2b1541498718\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.659273 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n52mq\" (UniqueName: \"kubernetes.io/projected/bd004e27-ba3d-4d48-97a8-b224be1ecc66-kube-api-access-n52mq\") pod \"cinder-api-0\" (UID: \"bd004e27-ba3d-4d48-97a8-b224be1ecc66\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.659364 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bd004e27-ba3d-4d48-97a8-b224be1ecc66-config-data\") pod \"cinder-api-0\" (UID: \"bd004e27-ba3d-4d48-97a8-b224be1ecc66\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.659409 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bd004e27-ba3d-4d48-97a8-b224be1ecc66-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"bd004e27-ba3d-4d48-97a8-b224be1ecc66\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.659426 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/bd004e27-ba3d-4d48-97a8-b224be1ecc66-scripts\") pod \"cinder-api-0\" (UID: \"bd004e27-ba3d-4d48-97a8-b224be1ecc66\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.659496 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/bd004e27-ba3d-4d48-97a8-b224be1ecc66-logs\") pod \"cinder-api-0\" (UID: \"bd004e27-ba3d-4d48-97a8-b224be1ecc66\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.659577 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/166e6318-307c-45a6-9273-2b1541498718-config-data\") pod \"cinder-scheduler-0\" (UID: \"166e6318-307c-45a6-9273-2b1541498718\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.659594 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/166e6318-307c-45a6-9273-2b1541498718-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"166e6318-307c-45a6-9273-2b1541498718\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.659619 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/bd004e27-ba3d-4d48-97a8-b224be1ecc66-config-data-custom\") pod \"cinder-api-0\" (UID: \"bd004e27-ba3d-4d48-97a8-b224be1ecc66\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.659655 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/166e6318-307c-45a6-9273-2b1541498718-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"166e6318-307c-45a6-9273-2b1541498718\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.659700 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8b8d1827-2a30-4e12-b2a4-bccb49518ffc-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.660621 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/bd004e27-ba3d-4d48-97a8-b224be1ecc66-etc-machine-id\") pod \"cinder-api-0\" (UID: \"bd004e27-ba3d-4d48-97a8-b224be1ecc66\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.661526 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/166e6318-307c-45a6-9273-2b1541498718-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"166e6318-307c-45a6-9273-2b1541498718\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.662154 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/bd004e27-ba3d-4d48-97a8-b224be1ecc66-logs\") pod \"cinder-api-0\" (UID: \"bd004e27-ba3d-4d48-97a8-b224be1ecc66\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.666311 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/166e6318-307c-45a6-9273-2b1541498718-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"166e6318-307c-45a6-9273-2b1541498718\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.666708 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/166e6318-307c-45a6-9273-2b1541498718-scripts\") pod \"cinder-scheduler-0\" (UID: \"166e6318-307c-45a6-9273-2b1541498718\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.678541 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/bd004e27-ba3d-4d48-97a8-b224be1ecc66-config-data-custom\") pod \"cinder-api-0\" (UID: \"bd004e27-ba3d-4d48-97a8-b224be1ecc66\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.683575 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/166e6318-307c-45a6-9273-2b1541498718-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"166e6318-307c-45a6-9273-2b1541498718\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.684001 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/bd004e27-ba3d-4d48-97a8-b224be1ecc66-scripts\") pod \"cinder-api-0\" (UID: \"bd004e27-ba3d-4d48-97a8-b224be1ecc66\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.684283 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bd004e27-ba3d-4d48-97a8-b224be1ecc66-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"bd004e27-ba3d-4d48-97a8-b224be1ecc66\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.684537 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/166e6318-307c-45a6-9273-2b1541498718-config-data\") pod \"cinder-scheduler-0\" (UID: \"166e6318-307c-45a6-9273-2b1541498718\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.686776 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bd004e27-ba3d-4d48-97a8-b224be1ecc66-config-data\") pod \"cinder-api-0\" (UID: \"bd004e27-ba3d-4d48-97a8-b224be1ecc66\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.688258 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vj8ll\" (UniqueName: \"kubernetes.io/projected/166e6318-307c-45a6-9273-2b1541498718-kube-api-access-vj8ll\") pod \"cinder-scheduler-0\" (UID: \"166e6318-307c-45a6-9273-2b1541498718\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.707300 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n52mq\" (UniqueName: \"kubernetes.io/projected/bd004e27-ba3d-4d48-97a8-b224be1ecc66-kube-api-access-n52mq\") pod \"cinder-api-0\" (UID: \"bd004e27-ba3d-4d48-97a8-b224be1ecc66\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.734414 5120 scope.go:117] "RemoveContainer" containerID="361efc4887708e8641e75ee835fd9bc36c81740accd42664a3e3b1acd93cc485" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.775107 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.789482 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.809155 5120 scope.go:117] "RemoveContainer" containerID="cc7e5e9f455cdb4dfa2088d3b46a1f4cda1432e042f33ee229e4cc180f4a34ec" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.809549 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.809929 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.822537 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.834508 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.843684 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.844082 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.865703 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.964205 5120 scope.go:117] "RemoveContainer" containerID="098b5ecbf56f85af50c5a808de7b88c25943d8a0e3e768d6a1de772fcfe724b8" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.966670 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/8cc8a233-a88b-4b25-8d7c-ababfa869d4e-run-httpd\") pod \"ceilometer-0\" (UID: \"8cc8a233-a88b-4b25-8d7c-ababfa869d4e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.966731 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8cc8a233-a88b-4b25-8d7c-ababfa869d4e-scripts\") pod \"ceilometer-0\" (UID: \"8cc8a233-a88b-4b25-8d7c-ababfa869d4e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.966838 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/8cc8a233-a88b-4b25-8d7c-ababfa869d4e-log-httpd\") pod \"ceilometer-0\" (UID: \"8cc8a233-a88b-4b25-8d7c-ababfa869d4e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.966855 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8cc8a233-a88b-4b25-8d7c-ababfa869d4e-config-data\") pod \"ceilometer-0\" (UID: \"8cc8a233-a88b-4b25-8d7c-ababfa869d4e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.967036 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8cc8a233-a88b-4b25-8d7c-ababfa869d4e-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"8cc8a233-a88b-4b25-8d7c-ababfa869d4e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.967069 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cj4vq\" (UniqueName: \"kubernetes.io/projected/8cc8a233-a88b-4b25-8d7c-ababfa869d4e-kube-api-access-cj4vq\") pod \"ceilometer-0\" (UID: \"8cc8a233-a88b-4b25-8d7c-ababfa869d4e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.967136 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/8cc8a233-a88b-4b25-8d7c-ababfa869d4e-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"8cc8a233-a88b-4b25-8d7c-ababfa869d4e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:55:49 crc kubenswrapper[5120]: E0316 15:55:49.970121 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"098b5ecbf56f85af50c5a808de7b88c25943d8a0e3e768d6a1de772fcfe724b8\": container with ID starting with 098b5ecbf56f85af50c5a808de7b88c25943d8a0e3e768d6a1de772fcfe724b8 not found: ID does not exist" containerID="098b5ecbf56f85af50c5a808de7b88c25943d8a0e3e768d6a1de772fcfe724b8" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.970200 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"098b5ecbf56f85af50c5a808de7b88c25943d8a0e3e768d6a1de772fcfe724b8"} err="failed to get container status \"098b5ecbf56f85af50c5a808de7b88c25943d8a0e3e768d6a1de772fcfe724b8\": rpc error: code = NotFound desc = could not find container \"098b5ecbf56f85af50c5a808de7b88c25943d8a0e3e768d6a1de772fcfe724b8\": container with ID starting with 098b5ecbf56f85af50c5a808de7b88c25943d8a0e3e768d6a1de772fcfe724b8 not found: ID does not exist" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.970356 5120 scope.go:117] "RemoveContainer" containerID="ccb30b885978e94a539c5cd7d3f7d92bf602eb53324edd161e2f1697fdd364cb" Mar 16 15:55:49 crc kubenswrapper[5120]: E0316 15:55:49.970972 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ccb30b885978e94a539c5cd7d3f7d92bf602eb53324edd161e2f1697fdd364cb\": container with ID starting with ccb30b885978e94a539c5cd7d3f7d92bf602eb53324edd161e2f1697fdd364cb not found: ID does not exist" containerID="ccb30b885978e94a539c5cd7d3f7d92bf602eb53324edd161e2f1697fdd364cb" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.971017 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ccb30b885978e94a539c5cd7d3f7d92bf602eb53324edd161e2f1697fdd364cb"} err="failed to get container status \"ccb30b885978e94a539c5cd7d3f7d92bf602eb53324edd161e2f1697fdd364cb\": rpc error: code = NotFound desc = could not find container \"ccb30b885978e94a539c5cd7d3f7d92bf602eb53324edd161e2f1697fdd364cb\": container with ID starting with ccb30b885978e94a539c5cd7d3f7d92bf602eb53324edd161e2f1697fdd364cb not found: ID does not exist" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.971046 5120 scope.go:117] "RemoveContainer" containerID="361efc4887708e8641e75ee835fd9bc36c81740accd42664a3e3b1acd93cc485" Mar 16 15:55:49 crc kubenswrapper[5120]: E0316 15:55:49.971403 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"361efc4887708e8641e75ee835fd9bc36c81740accd42664a3e3b1acd93cc485\": container with ID starting with 361efc4887708e8641e75ee835fd9bc36c81740accd42664a3e3b1acd93cc485 not found: ID does not exist" containerID="361efc4887708e8641e75ee835fd9bc36c81740accd42664a3e3b1acd93cc485" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.971423 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"361efc4887708e8641e75ee835fd9bc36c81740accd42664a3e3b1acd93cc485"} err="failed to get container status \"361efc4887708e8641e75ee835fd9bc36c81740accd42664a3e3b1acd93cc485\": rpc error: code = NotFound desc = could not find container \"361efc4887708e8641e75ee835fd9bc36c81740accd42664a3e3b1acd93cc485\": container with ID starting with 361efc4887708e8641e75ee835fd9bc36c81740accd42664a3e3b1acd93cc485 not found: ID does not exist" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.971445 5120 scope.go:117] "RemoveContainer" containerID="cc7e5e9f455cdb4dfa2088d3b46a1f4cda1432e042f33ee229e4cc180f4a34ec" Mar 16 15:55:49 crc kubenswrapper[5120]: E0316 15:55:49.971910 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc7e5e9f455cdb4dfa2088d3b46a1f4cda1432e042f33ee229e4cc180f4a34ec\": container with ID starting with cc7e5e9f455cdb4dfa2088d3b46a1f4cda1432e042f33ee229e4cc180f4a34ec not found: ID does not exist" containerID="cc7e5e9f455cdb4dfa2088d3b46a1f4cda1432e042f33ee229e4cc180f4a34ec" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.971929 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc7e5e9f455cdb4dfa2088d3b46a1f4cda1432e042f33ee229e4cc180f4a34ec"} err="failed to get container status \"cc7e5e9f455cdb4dfa2088d3b46a1f4cda1432e042f33ee229e4cc180f4a34ec\": rpc error: code = NotFound desc = could not find container \"cc7e5e9f455cdb4dfa2088d3b46a1f4cda1432e042f33ee229e4cc180f4a34ec\": container with ID starting with cc7e5e9f455cdb4dfa2088d3b46a1f4cda1432e042f33ee229e4cc180f4a34ec not found: ID does not exist" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.971951 5120 scope.go:117] "RemoveContainer" containerID="098b5ecbf56f85af50c5a808de7b88c25943d8a0e3e768d6a1de772fcfe724b8" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.972179 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"098b5ecbf56f85af50c5a808de7b88c25943d8a0e3e768d6a1de772fcfe724b8"} err="failed to get container status \"098b5ecbf56f85af50c5a808de7b88c25943d8a0e3e768d6a1de772fcfe724b8\": rpc error: code = NotFound desc = could not find container \"098b5ecbf56f85af50c5a808de7b88c25943d8a0e3e768d6a1de772fcfe724b8\": container with ID starting with 098b5ecbf56f85af50c5a808de7b88c25943d8a0e3e768d6a1de772fcfe724b8 not found: ID does not exist" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.972198 5120 scope.go:117] "RemoveContainer" containerID="ccb30b885978e94a539c5cd7d3f7d92bf602eb53324edd161e2f1697fdd364cb" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.973266 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ccb30b885978e94a539c5cd7d3f7d92bf602eb53324edd161e2f1697fdd364cb"} err="failed to get container status \"ccb30b885978e94a539c5cd7d3f7d92bf602eb53324edd161e2f1697fdd364cb\": rpc error: code = NotFound desc = could not find container \"ccb30b885978e94a539c5cd7d3f7d92bf602eb53324edd161e2f1697fdd364cb\": container with ID starting with ccb30b885978e94a539c5cd7d3f7d92bf602eb53324edd161e2f1697fdd364cb not found: ID does not exist" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.973303 5120 scope.go:117] "RemoveContainer" containerID="361efc4887708e8641e75ee835fd9bc36c81740accd42664a3e3b1acd93cc485" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.973609 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"361efc4887708e8641e75ee835fd9bc36c81740accd42664a3e3b1acd93cc485"} err="failed to get container status \"361efc4887708e8641e75ee835fd9bc36c81740accd42664a3e3b1acd93cc485\": rpc error: code = NotFound desc = could not find container \"361efc4887708e8641e75ee835fd9bc36c81740accd42664a3e3b1acd93cc485\": container with ID starting with 361efc4887708e8641e75ee835fd9bc36c81740accd42664a3e3b1acd93cc485 not found: ID does not exist" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.973638 5120 scope.go:117] "RemoveContainer" containerID="cc7e5e9f455cdb4dfa2088d3b46a1f4cda1432e042f33ee229e4cc180f4a34ec" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.973831 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc7e5e9f455cdb4dfa2088d3b46a1f4cda1432e042f33ee229e4cc180f4a34ec"} err="failed to get container status \"cc7e5e9f455cdb4dfa2088d3b46a1f4cda1432e042f33ee229e4cc180f4a34ec\": rpc error: code = NotFound desc = could not find container \"cc7e5e9f455cdb4dfa2088d3b46a1f4cda1432e042f33ee229e4cc180f4a34ec\": container with ID starting with cc7e5e9f455cdb4dfa2088d3b46a1f4cda1432e042f33ee229e4cc180f4a34ec not found: ID does not exist" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.973859 5120 scope.go:117] "RemoveContainer" containerID="098b5ecbf56f85af50c5a808de7b88c25943d8a0e3e768d6a1de772fcfe724b8" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.974046 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"098b5ecbf56f85af50c5a808de7b88c25943d8a0e3e768d6a1de772fcfe724b8"} err="failed to get container status \"098b5ecbf56f85af50c5a808de7b88c25943d8a0e3e768d6a1de772fcfe724b8\": rpc error: code = NotFound desc = could not find container \"098b5ecbf56f85af50c5a808de7b88c25943d8a0e3e768d6a1de772fcfe724b8\": container with ID starting with 098b5ecbf56f85af50c5a808de7b88c25943d8a0e3e768d6a1de772fcfe724b8 not found: ID does not exist" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.974074 5120 scope.go:117] "RemoveContainer" containerID="ccb30b885978e94a539c5cd7d3f7d92bf602eb53324edd161e2f1697fdd364cb" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.974211 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ccb30b885978e94a539c5cd7d3f7d92bf602eb53324edd161e2f1697fdd364cb"} err="failed to get container status \"ccb30b885978e94a539c5cd7d3f7d92bf602eb53324edd161e2f1697fdd364cb\": rpc error: code = NotFound desc = could not find container \"ccb30b885978e94a539c5cd7d3f7d92bf602eb53324edd161e2f1697fdd364cb\": container with ID starting with ccb30b885978e94a539c5cd7d3f7d92bf602eb53324edd161e2f1697fdd364cb not found: ID does not exist" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.974243 5120 scope.go:117] "RemoveContainer" containerID="361efc4887708e8641e75ee835fd9bc36c81740accd42664a3e3b1acd93cc485" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.974414 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"361efc4887708e8641e75ee835fd9bc36c81740accd42664a3e3b1acd93cc485"} err="failed to get container status \"361efc4887708e8641e75ee835fd9bc36c81740accd42664a3e3b1acd93cc485\": rpc error: code = NotFound desc = could not find container \"361efc4887708e8641e75ee835fd9bc36c81740accd42664a3e3b1acd93cc485\": container with ID starting with 361efc4887708e8641e75ee835fd9bc36c81740accd42664a3e3b1acd93cc485 not found: ID does not exist" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.974433 5120 scope.go:117] "RemoveContainer" containerID="cc7e5e9f455cdb4dfa2088d3b46a1f4cda1432e042f33ee229e4cc180f4a34ec" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.974598 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc7e5e9f455cdb4dfa2088d3b46a1f4cda1432e042f33ee229e4cc180f4a34ec"} err="failed to get container status \"cc7e5e9f455cdb4dfa2088d3b46a1f4cda1432e042f33ee229e4cc180f4a34ec\": rpc error: code = NotFound desc = could not find container \"cc7e5e9f455cdb4dfa2088d3b46a1f4cda1432e042f33ee229e4cc180f4a34ec\": container with ID starting with cc7e5e9f455cdb4dfa2088d3b46a1f4cda1432e042f33ee229e4cc180f4a34ec not found: ID does not exist" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.974619 5120 scope.go:117] "RemoveContainer" containerID="098b5ecbf56f85af50c5a808de7b88c25943d8a0e3e768d6a1de772fcfe724b8" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.974869 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"098b5ecbf56f85af50c5a808de7b88c25943d8a0e3e768d6a1de772fcfe724b8"} err="failed to get container status \"098b5ecbf56f85af50c5a808de7b88c25943d8a0e3e768d6a1de772fcfe724b8\": rpc error: code = NotFound desc = could not find container \"098b5ecbf56f85af50c5a808de7b88c25943d8a0e3e768d6a1de772fcfe724b8\": container with ID starting with 098b5ecbf56f85af50c5a808de7b88c25943d8a0e3e768d6a1de772fcfe724b8 not found: ID does not exist" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.974912 5120 scope.go:117] "RemoveContainer" containerID="ccb30b885978e94a539c5cd7d3f7d92bf602eb53324edd161e2f1697fdd364cb" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.979281 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ccb30b885978e94a539c5cd7d3f7d92bf602eb53324edd161e2f1697fdd364cb"} err="failed to get container status \"ccb30b885978e94a539c5cd7d3f7d92bf602eb53324edd161e2f1697fdd364cb\": rpc error: code = NotFound desc = could not find container \"ccb30b885978e94a539c5cd7d3f7d92bf602eb53324edd161e2f1697fdd364cb\": container with ID starting with ccb30b885978e94a539c5cd7d3f7d92bf602eb53324edd161e2f1697fdd364cb not found: ID does not exist" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.979307 5120 scope.go:117] "RemoveContainer" containerID="361efc4887708e8641e75ee835fd9bc36c81740accd42664a3e3b1acd93cc485" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.980476 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"361efc4887708e8641e75ee835fd9bc36c81740accd42664a3e3b1acd93cc485"} err="failed to get container status \"361efc4887708e8641e75ee835fd9bc36c81740accd42664a3e3b1acd93cc485\": rpc error: code = NotFound desc = could not find container \"361efc4887708e8641e75ee835fd9bc36c81740accd42664a3e3b1acd93cc485\": container with ID starting with 361efc4887708e8641e75ee835fd9bc36c81740accd42664a3e3b1acd93cc485 not found: ID does not exist" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.980505 5120 scope.go:117] "RemoveContainer" containerID="cc7e5e9f455cdb4dfa2088d3b46a1f4cda1432e042f33ee229e4cc180f4a34ec" Mar 16 15:55:49 crc kubenswrapper[5120]: I0316 15:55:49.980943 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc7e5e9f455cdb4dfa2088d3b46a1f4cda1432e042f33ee229e4cc180f4a34ec"} err="failed to get container status \"cc7e5e9f455cdb4dfa2088d3b46a1f4cda1432e042f33ee229e4cc180f4a34ec\": rpc error: code = NotFound desc = could not find container \"cc7e5e9f455cdb4dfa2088d3b46a1f4cda1432e042f33ee229e4cc180f4a34ec\": container with ID starting with cc7e5e9f455cdb4dfa2088d3b46a1f4cda1432e042f33ee229e4cc180f4a34ec not found: ID does not exist" Mar 16 15:55:50 crc kubenswrapper[5120]: I0316 15:55:50.069337 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/8cc8a233-a88b-4b25-8d7c-ababfa869d4e-run-httpd\") pod \"ceilometer-0\" (UID: \"8cc8a233-a88b-4b25-8d7c-ababfa869d4e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:55:50 crc kubenswrapper[5120]: I0316 15:55:50.069399 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8cc8a233-a88b-4b25-8d7c-ababfa869d4e-scripts\") pod \"ceilometer-0\" (UID: \"8cc8a233-a88b-4b25-8d7c-ababfa869d4e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:55:50 crc kubenswrapper[5120]: I0316 15:55:50.069487 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/8cc8a233-a88b-4b25-8d7c-ababfa869d4e-log-httpd\") pod \"ceilometer-0\" (UID: \"8cc8a233-a88b-4b25-8d7c-ababfa869d4e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:55:50 crc kubenswrapper[5120]: I0316 15:55:50.069513 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8cc8a233-a88b-4b25-8d7c-ababfa869d4e-config-data\") pod \"ceilometer-0\" (UID: \"8cc8a233-a88b-4b25-8d7c-ababfa869d4e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:55:50 crc kubenswrapper[5120]: I0316 15:55:50.069580 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8cc8a233-a88b-4b25-8d7c-ababfa869d4e-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"8cc8a233-a88b-4b25-8d7c-ababfa869d4e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:55:50 crc kubenswrapper[5120]: I0316 15:55:50.069607 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cj4vq\" (UniqueName: \"kubernetes.io/projected/8cc8a233-a88b-4b25-8d7c-ababfa869d4e-kube-api-access-cj4vq\") pod \"ceilometer-0\" (UID: \"8cc8a233-a88b-4b25-8d7c-ababfa869d4e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:55:50 crc kubenswrapper[5120]: I0316 15:55:50.069643 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/8cc8a233-a88b-4b25-8d7c-ababfa869d4e-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"8cc8a233-a88b-4b25-8d7c-ababfa869d4e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:55:50 crc kubenswrapper[5120]: I0316 15:55:50.071166 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/8cc8a233-a88b-4b25-8d7c-ababfa869d4e-log-httpd\") pod \"ceilometer-0\" (UID: \"8cc8a233-a88b-4b25-8d7c-ababfa869d4e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:55:50 crc kubenswrapper[5120]: I0316 15:55:50.071407 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/8cc8a233-a88b-4b25-8d7c-ababfa869d4e-run-httpd\") pod \"ceilometer-0\" (UID: \"8cc8a233-a88b-4b25-8d7c-ababfa869d4e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:55:50 crc kubenswrapper[5120]: I0316 15:55:50.077466 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8cc8a233-a88b-4b25-8d7c-ababfa869d4e-scripts\") pod \"ceilometer-0\" (UID: \"8cc8a233-a88b-4b25-8d7c-ababfa869d4e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:55:50 crc kubenswrapper[5120]: I0316 15:55:50.078000 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/8cc8a233-a88b-4b25-8d7c-ababfa869d4e-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"8cc8a233-a88b-4b25-8d7c-ababfa869d4e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:55:50 crc kubenswrapper[5120]: I0316 15:55:50.084842 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8cc8a233-a88b-4b25-8d7c-ababfa869d4e-config-data\") pod \"ceilometer-0\" (UID: \"8cc8a233-a88b-4b25-8d7c-ababfa869d4e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:55:50 crc kubenswrapper[5120]: I0316 15:55:50.093044 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8cc8a233-a88b-4b25-8d7c-ababfa869d4e-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"8cc8a233-a88b-4b25-8d7c-ababfa869d4e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:55:50 crc kubenswrapper[5120]: I0316 15:55:50.094134 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cj4vq\" (UniqueName: \"kubernetes.io/projected/8cc8a233-a88b-4b25-8d7c-ababfa869d4e-kube-api-access-cj4vq\") pod \"ceilometer-0\" (UID: \"8cc8a233-a88b-4b25-8d7c-ababfa869d4e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:55:50 crc kubenswrapper[5120]: I0316 15:55:50.169488 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:55:50 crc kubenswrapper[5120]: I0316 15:55:50.447463 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 15:55:50 crc kubenswrapper[5120]: W0316 15:55:50.450259 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbd004e27_ba3d_4d48_97a8_b224be1ecc66.slice/crio-3c0064da8df3c86c7c4846c52e4aea05f158f6b3b32ed10d67357f684eef5d67 WatchSource:0}: Error finding container 3c0064da8df3c86c7c4846c52e4aea05f158f6b3b32ed10d67357f684eef5d67: Status 404 returned error can't find the container with id 3c0064da8df3c86c7c4846c52e4aea05f158f6b3b32ed10d67357f684eef5d67 Mar 16 15:55:50 crc kubenswrapper[5120]: I0316 15:55:50.527104 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 15:55:50 crc kubenswrapper[5120]: W0316 15:55:50.531672 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod166e6318_307c_45a6_9273_2b1541498718.slice/crio-40aaeca05132f5fedb7a6f7fded0f8c375b943e3234791bfad8c5ccdb89e0f9c WatchSource:0}: Error finding container 40aaeca05132f5fedb7a6f7fded0f8c375b943e3234791bfad8c5ccdb89e0f9c: Status 404 returned error can't find the container with id 40aaeca05132f5fedb7a6f7fded0f8c375b943e3234791bfad8c5ccdb89e0f9c Mar 16 15:55:50 crc kubenswrapper[5120]: I0316 15:55:50.619913 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-d4kn4" event={"ID":"bcdd2411-5651-46f4-ad3f-6281c4e2b780","Type":"ContainerStarted","Data":"45d5950086fa920b3a7cb67a0e497fd1ac28c094739d0e4a09642bc8949119d5"} Mar 16 15:55:50 crc kubenswrapper[5120]: I0316 15:55:50.635403 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"93f6640c-a255-4892-abe7-01f211126bb5","Type":"ContainerStarted","Data":"e577d0e4c18228d6b20ba47dd68bc63702e161589d5b28f44a14d98a921df96e"} Mar 16 15:55:50 crc kubenswrapper[5120]: I0316 15:55:50.642606 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-bootstrap-d4kn4" podStartSLOduration=3.642587728 podStartE2EDuration="3.642587728s" podCreationTimestamp="2026-03-16 15:55:47 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:55:50.635876382 +0000 UTC m=+1452.789808039" watchObservedRunningTime="2026-03-16 15:55:50.642587728 +0000 UTC m=+1452.796519385" Mar 16 15:55:50 crc kubenswrapper[5120]: I0316 15:55:50.647412 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"166e6318-307c-45a6-9273-2b1541498718","Type":"ContainerStarted","Data":"40aaeca05132f5fedb7a6f7fded0f8c375b943e3234791bfad8c5ccdb89e0f9c"} Mar 16 15:55:50 crc kubenswrapper[5120]: I0316 15:55:50.653504 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"705910c5-8552-43be-ba28-dfad2b51ce96","Type":"ContainerStarted","Data":"e0012c05149be0f50d1c0f542da8165d28342dd996486c5320e55175341bf64d"} Mar 16 15:55:50 crc kubenswrapper[5120]: I0316 15:55:50.655448 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"bd004e27-ba3d-4d48-97a8-b224be1ecc66","Type":"ContainerStarted","Data":"3c0064da8df3c86c7c4846c52e4aea05f158f6b3b32ed10d67357f684eef5d67"} Mar 16 15:55:50 crc kubenswrapper[5120]: I0316 15:55:50.674401 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-external-api-0" podStartSLOduration=4.674378479 podStartE2EDuration="4.674378479s" podCreationTimestamp="2026-03-16 15:55:46 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:55:50.659054094 +0000 UTC m=+1452.812985751" watchObservedRunningTime="2026-03-16 15:55:50.674378479 +0000 UTC m=+1452.828310136" Mar 16 15:55:50 crc kubenswrapper[5120]: I0316 15:55:50.696577 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-internal-api-0" podStartSLOduration=5.696563584 podStartE2EDuration="5.696563584s" podCreationTimestamp="2026-03-16 15:55:45 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:55:50.696472721 +0000 UTC m=+1452.850404378" watchObservedRunningTime="2026-03-16 15:55:50.696563584 +0000 UTC m=+1452.850495241" Mar 16 15:55:50 crc kubenswrapper[5120]: W0316 15:55:50.701412 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8cc8a233_a88b_4b25_8d7c_ababfa869d4e.slice/crio-057b6e75980407dea501b83ca0be81cdfe54eda2fc860f27c21cfc4c218c53e4 WatchSource:0}: Error finding container 057b6e75980407dea501b83ca0be81cdfe54eda2fc860f27c21cfc4c218c53e4: Status 404 returned error can't find the container with id 057b6e75980407dea501b83ca0be81cdfe54eda2fc860f27c21cfc4c218c53e4 Mar 16 15:55:50 crc kubenswrapper[5120]: I0316 15:55:50.716310 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8b8d1827-2a30-4e12-b2a4-bccb49518ffc" path="/var/lib/kubelet/pods/8b8d1827-2a30-4e12-b2a4-bccb49518ffc/volumes" Mar 16 15:55:50 crc kubenswrapper[5120]: I0316 15:55:50.717914 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 15:55:51 crc kubenswrapper[5120]: I0316 15:55:51.680038 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"166e6318-307c-45a6-9273-2b1541498718","Type":"ContainerStarted","Data":"9feb90503f0ab3cabb3adcca53ad3cd129b16bd02539b359375f5a07e2c27d71"} Mar 16 15:55:51 crc kubenswrapper[5120]: I0316 15:55:51.682512 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"bd004e27-ba3d-4d48-97a8-b224be1ecc66","Type":"ContainerStarted","Data":"c7274eea5811a54fd2bb400f9dfce0a01e890b29e78cb6c308f35986d5d5d529"} Mar 16 15:55:51 crc kubenswrapper[5120]: I0316 15:55:51.684643 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"8cc8a233-a88b-4b25-8d7c-ababfa869d4e","Type":"ContainerStarted","Data":"74559f495137d72a82a0793c5af59e943c6b52dc27889b1421c3cb038e83d522"} Mar 16 15:55:51 crc kubenswrapper[5120]: I0316 15:55:51.684670 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"8cc8a233-a88b-4b25-8d7c-ababfa869d4e","Type":"ContainerStarted","Data":"057b6e75980407dea501b83ca0be81cdfe54eda2fc860f27c21cfc4c218c53e4"} Mar 16 15:55:52 crc kubenswrapper[5120]: I0316 15:55:52.711573 5120 generic.go:358] "Generic (PLEG): container finished" podID="bcdd2411-5651-46f4-ad3f-6281c4e2b780" containerID="45d5950086fa920b3a7cb67a0e497fd1ac28c094739d0e4a09642bc8949119d5" exitCode=0 Mar 16 15:55:52 crc kubenswrapper[5120]: I0316 15:55:52.712056 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-d4kn4" event={"ID":"bcdd2411-5651-46f4-ad3f-6281c4e2b780","Type":"ContainerDied","Data":"45d5950086fa920b3a7cb67a0e497fd1ac28c094739d0e4a09642bc8949119d5"} Mar 16 15:55:52 crc kubenswrapper[5120]: I0316 15:55:52.717171 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"166e6318-307c-45a6-9273-2b1541498718","Type":"ContainerStarted","Data":"b91d0a4cff48be949ae60c2967b9c859590bbc5f091a2b7082b44f9affa91033"} Mar 16 15:55:52 crc kubenswrapper[5120]: I0316 15:55:52.723594 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"bd004e27-ba3d-4d48-97a8-b224be1ecc66","Type":"ContainerStarted","Data":"659e1898bcbe706964dc443d5fbfbac224fbc04e29a06e0173a43a1286816a99"} Mar 16 15:55:52 crc kubenswrapper[5120]: I0316 15:55:52.723701 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:55:52 crc kubenswrapper[5120]: I0316 15:55:52.725558 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"8cc8a233-a88b-4b25-8d7c-ababfa869d4e","Type":"ContainerStarted","Data":"5b69c283319516f4ab1c5820d28054eda0c8b9a982948475472346c8c9ae1404"} Mar 16 15:55:52 crc kubenswrapper[5120]: I0316 15:55:52.747290 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-api-0" podStartSLOduration=3.7472710019999997 podStartE2EDuration="3.747271002s" podCreationTimestamp="2026-03-16 15:55:49 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:55:52.744428634 +0000 UTC m=+1454.898360291" watchObservedRunningTime="2026-03-16 15:55:52.747271002 +0000 UTC m=+1454.901202659" Mar 16 15:55:52 crc kubenswrapper[5120]: I0316 15:55:52.782605 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-scheduler-0" podStartSLOduration=3.7825860110000002 podStartE2EDuration="3.782586011s" podCreationTimestamp="2026-03-16 15:55:49 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:55:52.770186278 +0000 UTC m=+1454.924117935" watchObservedRunningTime="2026-03-16 15:55:52.782586011 +0000 UTC m=+1454.936517668" Mar 16 15:55:53 crc kubenswrapper[5120]: I0316 15:55:53.736575 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"8cc8a233-a88b-4b25-8d7c-ababfa869d4e","Type":"ContainerStarted","Data":"346dd3de73c7983bc158ca5c13d4c09ab4ea91180ceca406d1327ce4bddcb95c"} Mar 16 15:55:54 crc kubenswrapper[5120]: I0316 15:55:54.063675 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 15:55:54 crc kubenswrapper[5120]: I0316 15:55:54.187452 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-d4kn4" Mar 16 15:55:54 crc kubenswrapper[5120]: I0316 15:55:54.269382 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ft5g9\" (UniqueName: \"kubernetes.io/projected/bcdd2411-5651-46f4-ad3f-6281c4e2b780-kube-api-access-ft5g9\") pod \"bcdd2411-5651-46f4-ad3f-6281c4e2b780\" (UID: \"bcdd2411-5651-46f4-ad3f-6281c4e2b780\") " Mar 16 15:55:54 crc kubenswrapper[5120]: I0316 15:55:54.269899 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bcdd2411-5651-46f4-ad3f-6281c4e2b780-combined-ca-bundle\") pod \"bcdd2411-5651-46f4-ad3f-6281c4e2b780\" (UID: \"bcdd2411-5651-46f4-ad3f-6281c4e2b780\") " Mar 16 15:55:54 crc kubenswrapper[5120]: I0316 15:55:54.269948 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bcdd2411-5651-46f4-ad3f-6281c4e2b780-config-data\") pod \"bcdd2411-5651-46f4-ad3f-6281c4e2b780\" (UID: \"bcdd2411-5651-46f4-ad3f-6281c4e2b780\") " Mar 16 15:55:54 crc kubenswrapper[5120]: I0316 15:55:54.269999 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/bcdd2411-5651-46f4-ad3f-6281c4e2b780-fernet-keys\") pod \"bcdd2411-5651-46f4-ad3f-6281c4e2b780\" (UID: \"bcdd2411-5651-46f4-ad3f-6281c4e2b780\") " Mar 16 15:55:54 crc kubenswrapper[5120]: I0316 15:55:54.270086 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/bcdd2411-5651-46f4-ad3f-6281c4e2b780-credential-keys\") pod \"bcdd2411-5651-46f4-ad3f-6281c4e2b780\" (UID: \"bcdd2411-5651-46f4-ad3f-6281c4e2b780\") " Mar 16 15:55:54 crc kubenswrapper[5120]: I0316 15:55:54.270110 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/bcdd2411-5651-46f4-ad3f-6281c4e2b780-scripts\") pod \"bcdd2411-5651-46f4-ad3f-6281c4e2b780\" (UID: \"bcdd2411-5651-46f4-ad3f-6281c4e2b780\") " Mar 16 15:55:54 crc kubenswrapper[5120]: I0316 15:55:54.276897 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bcdd2411-5651-46f4-ad3f-6281c4e2b780-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "bcdd2411-5651-46f4-ad3f-6281c4e2b780" (UID: "bcdd2411-5651-46f4-ad3f-6281c4e2b780"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:55:54 crc kubenswrapper[5120]: I0316 15:55:54.277094 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bcdd2411-5651-46f4-ad3f-6281c4e2b780-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "bcdd2411-5651-46f4-ad3f-6281c4e2b780" (UID: "bcdd2411-5651-46f4-ad3f-6281c4e2b780"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:55:54 crc kubenswrapper[5120]: I0316 15:55:54.277486 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bcdd2411-5651-46f4-ad3f-6281c4e2b780-scripts" (OuterVolumeSpecName: "scripts") pod "bcdd2411-5651-46f4-ad3f-6281c4e2b780" (UID: "bcdd2411-5651-46f4-ad3f-6281c4e2b780"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:55:54 crc kubenswrapper[5120]: I0316 15:55:54.290011 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bcdd2411-5651-46f4-ad3f-6281c4e2b780-kube-api-access-ft5g9" (OuterVolumeSpecName: "kube-api-access-ft5g9") pod "bcdd2411-5651-46f4-ad3f-6281c4e2b780" (UID: "bcdd2411-5651-46f4-ad3f-6281c4e2b780"). InnerVolumeSpecName "kube-api-access-ft5g9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:55:54 crc kubenswrapper[5120]: I0316 15:55:54.316783 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bcdd2411-5651-46f4-ad3f-6281c4e2b780-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "bcdd2411-5651-46f4-ad3f-6281c4e2b780" (UID: "bcdd2411-5651-46f4-ad3f-6281c4e2b780"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:55:54 crc kubenswrapper[5120]: I0316 15:55:54.330561 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bcdd2411-5651-46f4-ad3f-6281c4e2b780-config-data" (OuterVolumeSpecName: "config-data") pod "bcdd2411-5651-46f4-ad3f-6281c4e2b780" (UID: "bcdd2411-5651-46f4-ad3f-6281c4e2b780"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:55:54 crc kubenswrapper[5120]: I0316 15:55:54.372337 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ft5g9\" (UniqueName: \"kubernetes.io/projected/bcdd2411-5651-46f4-ad3f-6281c4e2b780-kube-api-access-ft5g9\") on node \"crc\" DevicePath \"\"" Mar 16 15:55:54 crc kubenswrapper[5120]: I0316 15:55:54.372376 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bcdd2411-5651-46f4-ad3f-6281c4e2b780-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:55:54 crc kubenswrapper[5120]: I0316 15:55:54.372386 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bcdd2411-5651-46f4-ad3f-6281c4e2b780-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 15:55:54 crc kubenswrapper[5120]: I0316 15:55:54.372395 5120 reconciler_common.go:299] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/bcdd2411-5651-46f4-ad3f-6281c4e2b780-fernet-keys\") on node \"crc\" DevicePath \"\"" Mar 16 15:55:54 crc kubenswrapper[5120]: I0316 15:55:54.372403 5120 reconciler_common.go:299] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/bcdd2411-5651-46f4-ad3f-6281c4e2b780-credential-keys\") on node \"crc\" DevicePath \"\"" Mar 16 15:55:54 crc kubenswrapper[5120]: I0316 15:55:54.372412 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/bcdd2411-5651-46f4-ad3f-6281c4e2b780-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 15:55:54 crc kubenswrapper[5120]: I0316 15:55:54.758173 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-d4kn4" Mar 16 15:55:54 crc kubenswrapper[5120]: I0316 15:55:54.758300 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-d4kn4" event={"ID":"bcdd2411-5651-46f4-ad3f-6281c4e2b780","Type":"ContainerDied","Data":"0d4f1609f1e5d2bb71e57be7c76c521f9500cb2efa95f31f55a8a626b74e0cbe"} Mar 16 15:55:54 crc kubenswrapper[5120]: I0316 15:55:54.758357 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0d4f1609f1e5d2bb71e57be7c76c521f9500cb2efa95f31f55a8a626b74e0cbe" Mar 16 15:55:54 crc kubenswrapper[5120]: I0316 15:55:54.758598 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="bd004e27-ba3d-4d48-97a8-b224be1ecc66" containerName="cinder-api-log" containerID="cri-o://c7274eea5811a54fd2bb400f9dfce0a01e890b29e78cb6c308f35986d5d5d529" gracePeriod=30 Mar 16 15:55:54 crc kubenswrapper[5120]: I0316 15:55:54.758954 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="bd004e27-ba3d-4d48-97a8-b224be1ecc66" containerName="cinder-api" containerID="cri-o://659e1898bcbe706964dc443d5fbfbac224fbc04e29a06e0173a43a1286816a99" gracePeriod=30 Mar 16 15:55:54 crc kubenswrapper[5120]: I0316 15:55:54.776450 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 15:55:54 crc kubenswrapper[5120]: I0316 15:55:54.846834 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-549cb9f7c8-crdfd"] Mar 16 15:55:54 crc kubenswrapper[5120]: I0316 15:55:54.848289 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bcdd2411-5651-46f4-ad3f-6281c4e2b780" containerName="keystone-bootstrap" Mar 16 15:55:54 crc kubenswrapper[5120]: I0316 15:55:54.848310 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="bcdd2411-5651-46f4-ad3f-6281c4e2b780" containerName="keystone-bootstrap" Mar 16 15:55:54 crc kubenswrapper[5120]: I0316 15:55:54.849195 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="bcdd2411-5651-46f4-ad3f-6281c4e2b780" containerName="keystone-bootstrap" Mar 16 15:55:54 crc kubenswrapper[5120]: I0316 15:55:54.861062 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-549cb9f7c8-crdfd"] Mar 16 15:55:54 crc kubenswrapper[5120]: I0316 15:55:54.861216 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-549cb9f7c8-crdfd" Mar 16 15:55:54 crc kubenswrapper[5120]: I0316 15:55:54.875512 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-config-data\"" Mar 16 15:55:54 crc kubenswrapper[5120]: I0316 15:55:54.876307 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-scripts\"" Mar 16 15:55:54 crc kubenswrapper[5120]: I0316 15:55:54.877580 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-keystone-public-svc\"" Mar 16 15:55:54 crc kubenswrapper[5120]: I0316 15:55:54.877967 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone\"" Mar 16 15:55:54 crc kubenswrapper[5120]: I0316 15:55:54.881368 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-keystone-dockercfg-d2z5x\"" Mar 16 15:55:54 crc kubenswrapper[5120]: I0316 15:55:54.881436 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-keystone-internal-svc\"" Mar 16 15:55:54 crc kubenswrapper[5120]: I0316 15:55:54.983264 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/57a83a83-de95-43e1-b18c-a7b59c4d1a3b-scripts\") pod \"keystone-549cb9f7c8-crdfd\" (UID: \"57a83a83-de95-43e1-b18c-a7b59c4d1a3b\") " pod="openstack-kuttl-tests/keystone-549cb9f7c8-crdfd" Mar 16 15:55:54 crc kubenswrapper[5120]: I0316 15:55:54.983317 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/57a83a83-de95-43e1-b18c-a7b59c4d1a3b-internal-tls-certs\") pod \"keystone-549cb9f7c8-crdfd\" (UID: \"57a83a83-de95-43e1-b18c-a7b59c4d1a3b\") " pod="openstack-kuttl-tests/keystone-549cb9f7c8-crdfd" Mar 16 15:55:54 crc kubenswrapper[5120]: I0316 15:55:54.983357 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/57a83a83-de95-43e1-b18c-a7b59c4d1a3b-config-data\") pod \"keystone-549cb9f7c8-crdfd\" (UID: \"57a83a83-de95-43e1-b18c-a7b59c4d1a3b\") " pod="openstack-kuttl-tests/keystone-549cb9f7c8-crdfd" Mar 16 15:55:54 crc kubenswrapper[5120]: I0316 15:55:54.983468 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dl2wt\" (UniqueName: \"kubernetes.io/projected/57a83a83-de95-43e1-b18c-a7b59c4d1a3b-kube-api-access-dl2wt\") pod \"keystone-549cb9f7c8-crdfd\" (UID: \"57a83a83-de95-43e1-b18c-a7b59c4d1a3b\") " pod="openstack-kuttl-tests/keystone-549cb9f7c8-crdfd" Mar 16 15:55:54 crc kubenswrapper[5120]: I0316 15:55:54.983516 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/57a83a83-de95-43e1-b18c-a7b59c4d1a3b-public-tls-certs\") pod \"keystone-549cb9f7c8-crdfd\" (UID: \"57a83a83-de95-43e1-b18c-a7b59c4d1a3b\") " pod="openstack-kuttl-tests/keystone-549cb9f7c8-crdfd" Mar 16 15:55:54 crc kubenswrapper[5120]: I0316 15:55:54.983537 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/57a83a83-de95-43e1-b18c-a7b59c4d1a3b-credential-keys\") pod \"keystone-549cb9f7c8-crdfd\" (UID: \"57a83a83-de95-43e1-b18c-a7b59c4d1a3b\") " pod="openstack-kuttl-tests/keystone-549cb9f7c8-crdfd" Mar 16 15:55:54 crc kubenswrapper[5120]: I0316 15:55:54.983660 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/57a83a83-de95-43e1-b18c-a7b59c4d1a3b-combined-ca-bundle\") pod \"keystone-549cb9f7c8-crdfd\" (UID: \"57a83a83-de95-43e1-b18c-a7b59c4d1a3b\") " pod="openstack-kuttl-tests/keystone-549cb9f7c8-crdfd" Mar 16 15:55:54 crc kubenswrapper[5120]: I0316 15:55:54.983796 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/57a83a83-de95-43e1-b18c-a7b59c4d1a3b-fernet-keys\") pod \"keystone-549cb9f7c8-crdfd\" (UID: \"57a83a83-de95-43e1-b18c-a7b59c4d1a3b\") " pod="openstack-kuttl-tests/keystone-549cb9f7c8-crdfd" Mar 16 15:55:55 crc kubenswrapper[5120]: I0316 15:55:55.085663 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/57a83a83-de95-43e1-b18c-a7b59c4d1a3b-combined-ca-bundle\") pod \"keystone-549cb9f7c8-crdfd\" (UID: \"57a83a83-de95-43e1-b18c-a7b59c4d1a3b\") " pod="openstack-kuttl-tests/keystone-549cb9f7c8-crdfd" Mar 16 15:55:55 crc kubenswrapper[5120]: I0316 15:55:55.086040 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/57a83a83-de95-43e1-b18c-a7b59c4d1a3b-fernet-keys\") pod \"keystone-549cb9f7c8-crdfd\" (UID: \"57a83a83-de95-43e1-b18c-a7b59c4d1a3b\") " pod="openstack-kuttl-tests/keystone-549cb9f7c8-crdfd" Mar 16 15:55:55 crc kubenswrapper[5120]: I0316 15:55:55.086100 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/57a83a83-de95-43e1-b18c-a7b59c4d1a3b-scripts\") pod \"keystone-549cb9f7c8-crdfd\" (UID: \"57a83a83-de95-43e1-b18c-a7b59c4d1a3b\") " pod="openstack-kuttl-tests/keystone-549cb9f7c8-crdfd" Mar 16 15:55:55 crc kubenswrapper[5120]: I0316 15:55:55.086123 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/57a83a83-de95-43e1-b18c-a7b59c4d1a3b-internal-tls-certs\") pod \"keystone-549cb9f7c8-crdfd\" (UID: \"57a83a83-de95-43e1-b18c-a7b59c4d1a3b\") " pod="openstack-kuttl-tests/keystone-549cb9f7c8-crdfd" Mar 16 15:55:55 crc kubenswrapper[5120]: I0316 15:55:55.086161 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/57a83a83-de95-43e1-b18c-a7b59c4d1a3b-config-data\") pod \"keystone-549cb9f7c8-crdfd\" (UID: \"57a83a83-de95-43e1-b18c-a7b59c4d1a3b\") " pod="openstack-kuttl-tests/keystone-549cb9f7c8-crdfd" Mar 16 15:55:55 crc kubenswrapper[5120]: I0316 15:55:55.086231 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dl2wt\" (UniqueName: \"kubernetes.io/projected/57a83a83-de95-43e1-b18c-a7b59c4d1a3b-kube-api-access-dl2wt\") pod \"keystone-549cb9f7c8-crdfd\" (UID: \"57a83a83-de95-43e1-b18c-a7b59c4d1a3b\") " pod="openstack-kuttl-tests/keystone-549cb9f7c8-crdfd" Mar 16 15:55:55 crc kubenswrapper[5120]: I0316 15:55:55.086288 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/57a83a83-de95-43e1-b18c-a7b59c4d1a3b-public-tls-certs\") pod \"keystone-549cb9f7c8-crdfd\" (UID: \"57a83a83-de95-43e1-b18c-a7b59c4d1a3b\") " pod="openstack-kuttl-tests/keystone-549cb9f7c8-crdfd" Mar 16 15:55:55 crc kubenswrapper[5120]: I0316 15:55:55.086333 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/57a83a83-de95-43e1-b18c-a7b59c4d1a3b-credential-keys\") pod \"keystone-549cb9f7c8-crdfd\" (UID: \"57a83a83-de95-43e1-b18c-a7b59c4d1a3b\") " pod="openstack-kuttl-tests/keystone-549cb9f7c8-crdfd" Mar 16 15:55:55 crc kubenswrapper[5120]: I0316 15:55:55.091856 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/57a83a83-de95-43e1-b18c-a7b59c4d1a3b-credential-keys\") pod \"keystone-549cb9f7c8-crdfd\" (UID: \"57a83a83-de95-43e1-b18c-a7b59c4d1a3b\") " pod="openstack-kuttl-tests/keystone-549cb9f7c8-crdfd" Mar 16 15:55:55 crc kubenswrapper[5120]: I0316 15:55:55.091937 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/57a83a83-de95-43e1-b18c-a7b59c4d1a3b-internal-tls-certs\") pod \"keystone-549cb9f7c8-crdfd\" (UID: \"57a83a83-de95-43e1-b18c-a7b59c4d1a3b\") " pod="openstack-kuttl-tests/keystone-549cb9f7c8-crdfd" Mar 16 15:55:55 crc kubenswrapper[5120]: I0316 15:55:55.092216 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/57a83a83-de95-43e1-b18c-a7b59c4d1a3b-combined-ca-bundle\") pod \"keystone-549cb9f7c8-crdfd\" (UID: \"57a83a83-de95-43e1-b18c-a7b59c4d1a3b\") " pod="openstack-kuttl-tests/keystone-549cb9f7c8-crdfd" Mar 16 15:55:55 crc kubenswrapper[5120]: I0316 15:55:55.092325 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/57a83a83-de95-43e1-b18c-a7b59c4d1a3b-public-tls-certs\") pod \"keystone-549cb9f7c8-crdfd\" (UID: \"57a83a83-de95-43e1-b18c-a7b59c4d1a3b\") " pod="openstack-kuttl-tests/keystone-549cb9f7c8-crdfd" Mar 16 15:55:55 crc kubenswrapper[5120]: I0316 15:55:55.097782 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/57a83a83-de95-43e1-b18c-a7b59c4d1a3b-config-data\") pod \"keystone-549cb9f7c8-crdfd\" (UID: \"57a83a83-de95-43e1-b18c-a7b59c4d1a3b\") " pod="openstack-kuttl-tests/keystone-549cb9f7c8-crdfd" Mar 16 15:55:55 crc kubenswrapper[5120]: I0316 15:55:55.098588 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/57a83a83-de95-43e1-b18c-a7b59c4d1a3b-scripts\") pod \"keystone-549cb9f7c8-crdfd\" (UID: \"57a83a83-de95-43e1-b18c-a7b59c4d1a3b\") " pod="openstack-kuttl-tests/keystone-549cb9f7c8-crdfd" Mar 16 15:55:55 crc kubenswrapper[5120]: I0316 15:55:55.099981 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/57a83a83-de95-43e1-b18c-a7b59c4d1a3b-fernet-keys\") pod \"keystone-549cb9f7c8-crdfd\" (UID: \"57a83a83-de95-43e1-b18c-a7b59c4d1a3b\") " pod="openstack-kuttl-tests/keystone-549cb9f7c8-crdfd" Mar 16 15:55:55 crc kubenswrapper[5120]: I0316 15:55:55.117804 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dl2wt\" (UniqueName: \"kubernetes.io/projected/57a83a83-de95-43e1-b18c-a7b59c4d1a3b-kube-api-access-dl2wt\") pod \"keystone-549cb9f7c8-crdfd\" (UID: \"57a83a83-de95-43e1-b18c-a7b59c4d1a3b\") " pod="openstack-kuttl-tests/keystone-549cb9f7c8-crdfd" Mar 16 15:55:55 crc kubenswrapper[5120]: I0316 15:55:55.185835 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-549cb9f7c8-crdfd" Mar 16 15:55:55 crc kubenswrapper[5120]: I0316 15:55:55.609998 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:55:55 crc kubenswrapper[5120]: I0316 15:55:55.702552 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/bd004e27-ba3d-4d48-97a8-b224be1ecc66-config-data-custom\") pod \"bd004e27-ba3d-4d48-97a8-b224be1ecc66\" (UID: \"bd004e27-ba3d-4d48-97a8-b224be1ecc66\") " Mar 16 15:55:55 crc kubenswrapper[5120]: I0316 15:55:55.702621 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/bd004e27-ba3d-4d48-97a8-b224be1ecc66-etc-machine-id\") pod \"bd004e27-ba3d-4d48-97a8-b224be1ecc66\" (UID: \"bd004e27-ba3d-4d48-97a8-b224be1ecc66\") " Mar 16 15:55:55 crc kubenswrapper[5120]: I0316 15:55:55.702681 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bd004e27-ba3d-4d48-97a8-b224be1ecc66-combined-ca-bundle\") pod \"bd004e27-ba3d-4d48-97a8-b224be1ecc66\" (UID: \"bd004e27-ba3d-4d48-97a8-b224be1ecc66\") " Mar 16 15:55:55 crc kubenswrapper[5120]: I0316 15:55:55.702752 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n52mq\" (UniqueName: \"kubernetes.io/projected/bd004e27-ba3d-4d48-97a8-b224be1ecc66-kube-api-access-n52mq\") pod \"bd004e27-ba3d-4d48-97a8-b224be1ecc66\" (UID: \"bd004e27-ba3d-4d48-97a8-b224be1ecc66\") " Mar 16 15:55:55 crc kubenswrapper[5120]: I0316 15:55:55.702828 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/bd004e27-ba3d-4d48-97a8-b224be1ecc66-scripts\") pod \"bd004e27-ba3d-4d48-97a8-b224be1ecc66\" (UID: \"bd004e27-ba3d-4d48-97a8-b224be1ecc66\") " Mar 16 15:55:55 crc kubenswrapper[5120]: I0316 15:55:55.702925 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bd004e27-ba3d-4d48-97a8-b224be1ecc66-config-data\") pod \"bd004e27-ba3d-4d48-97a8-b224be1ecc66\" (UID: \"bd004e27-ba3d-4d48-97a8-b224be1ecc66\") " Mar 16 15:55:55 crc kubenswrapper[5120]: I0316 15:55:55.703066 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/bd004e27-ba3d-4d48-97a8-b224be1ecc66-logs\") pod \"bd004e27-ba3d-4d48-97a8-b224be1ecc66\" (UID: \"bd004e27-ba3d-4d48-97a8-b224be1ecc66\") " Mar 16 15:55:55 crc kubenswrapper[5120]: I0316 15:55:55.703958 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd004e27-ba3d-4d48-97a8-b224be1ecc66-logs" (OuterVolumeSpecName: "logs") pod "bd004e27-ba3d-4d48-97a8-b224be1ecc66" (UID: "bd004e27-ba3d-4d48-97a8-b224be1ecc66"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:55:55 crc kubenswrapper[5120]: I0316 15:55:55.709017 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/bd004e27-ba3d-4d48-97a8-b224be1ecc66-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "bd004e27-ba3d-4d48-97a8-b224be1ecc66" (UID: "bd004e27-ba3d-4d48-97a8-b224be1ecc66"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 15:55:55 crc kubenswrapper[5120]: I0316 15:55:55.710787 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd004e27-ba3d-4d48-97a8-b224be1ecc66-scripts" (OuterVolumeSpecName: "scripts") pod "bd004e27-ba3d-4d48-97a8-b224be1ecc66" (UID: "bd004e27-ba3d-4d48-97a8-b224be1ecc66"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:55:55 crc kubenswrapper[5120]: I0316 15:55:55.710793 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd004e27-ba3d-4d48-97a8-b224be1ecc66-kube-api-access-n52mq" (OuterVolumeSpecName: "kube-api-access-n52mq") pod "bd004e27-ba3d-4d48-97a8-b224be1ecc66" (UID: "bd004e27-ba3d-4d48-97a8-b224be1ecc66"). InnerVolumeSpecName "kube-api-access-n52mq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:55:55 crc kubenswrapper[5120]: I0316 15:55:55.715934 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd004e27-ba3d-4d48-97a8-b224be1ecc66-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "bd004e27-ba3d-4d48-97a8-b224be1ecc66" (UID: "bd004e27-ba3d-4d48-97a8-b224be1ecc66"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:55:55 crc kubenswrapper[5120]: I0316 15:55:55.721786 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-549cb9f7c8-crdfd"] Mar 16 15:55:55 crc kubenswrapper[5120]: I0316 15:55:55.769524 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd004e27-ba3d-4d48-97a8-b224be1ecc66-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "bd004e27-ba3d-4d48-97a8-b224be1ecc66" (UID: "bd004e27-ba3d-4d48-97a8-b224be1ecc66"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:55:55 crc kubenswrapper[5120]: I0316 15:55:55.781641 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-549cb9f7c8-crdfd" event={"ID":"57a83a83-de95-43e1-b18c-a7b59c4d1a3b","Type":"ContainerStarted","Data":"a7817308552d782c580ec7ccce6fa580420cfe850787c60c4a62409a46ab1204"} Mar 16 15:55:55 crc kubenswrapper[5120]: I0316 15:55:55.793214 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-5477dfc7d6-r85w6"] Mar 16 15:55:55 crc kubenswrapper[5120]: I0316 15:55:55.794150 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd004e27-ba3d-4d48-97a8-b224be1ecc66" containerName="cinder-api-log" Mar 16 15:55:55 crc kubenswrapper[5120]: I0316 15:55:55.794166 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd004e27-ba3d-4d48-97a8-b224be1ecc66" containerName="cinder-api-log" Mar 16 15:55:55 crc kubenswrapper[5120]: I0316 15:55:55.794202 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd004e27-ba3d-4d48-97a8-b224be1ecc66" containerName="cinder-api" Mar 16 15:55:55 crc kubenswrapper[5120]: I0316 15:55:55.794209 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd004e27-ba3d-4d48-97a8-b224be1ecc66" containerName="cinder-api" Mar 16 15:55:55 crc kubenswrapper[5120]: I0316 15:55:55.794355 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="bd004e27-ba3d-4d48-97a8-b224be1ecc66" containerName="cinder-api" Mar 16 15:55:55 crc kubenswrapper[5120]: I0316 15:55:55.794374 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="bd004e27-ba3d-4d48-97a8-b224be1ecc66" containerName="cinder-api-log" Mar 16 15:55:55 crc kubenswrapper[5120]: I0316 15:55:55.794555 5120 generic.go:358] "Generic (PLEG): container finished" podID="bd004e27-ba3d-4d48-97a8-b224be1ecc66" containerID="659e1898bcbe706964dc443d5fbfbac224fbc04e29a06e0173a43a1286816a99" exitCode=0 Mar 16 15:55:55 crc kubenswrapper[5120]: I0316 15:55:55.794636 5120 generic.go:358] "Generic (PLEG): container finished" podID="bd004e27-ba3d-4d48-97a8-b224be1ecc66" containerID="c7274eea5811a54fd2bb400f9dfce0a01e890b29e78cb6c308f35986d5d5d529" exitCode=143 Mar 16 15:55:55 crc kubenswrapper[5120]: I0316 15:55:55.794911 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:55:55 crc kubenswrapper[5120]: I0316 15:55:55.803103 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"bd004e27-ba3d-4d48-97a8-b224be1ecc66","Type":"ContainerDied","Data":"659e1898bcbe706964dc443d5fbfbac224fbc04e29a06e0173a43a1286816a99"} Mar 16 15:55:55 crc kubenswrapper[5120]: I0316 15:55:55.803151 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"bd004e27-ba3d-4d48-97a8-b224be1ecc66","Type":"ContainerDied","Data":"c7274eea5811a54fd2bb400f9dfce0a01e890b29e78cb6c308f35986d5d5d529"} Mar 16 15:55:55 crc kubenswrapper[5120]: I0316 15:55:55.803165 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"bd004e27-ba3d-4d48-97a8-b224be1ecc66","Type":"ContainerDied","Data":"3c0064da8df3c86c7c4846c52e4aea05f158f6b3b32ed10d67357f684eef5d67"} Mar 16 15:55:55 crc kubenswrapper[5120]: I0316 15:55:55.803185 5120 scope.go:117] "RemoveContainer" containerID="659e1898bcbe706964dc443d5fbfbac224fbc04e29a06e0173a43a1286816a99" Mar 16 15:55:55 crc kubenswrapper[5120]: I0316 15:55:55.803390 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-5477dfc7d6-r85w6" Mar 16 15:55:55 crc kubenswrapper[5120]: I0316 15:55:55.805289 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"8cc8a233-a88b-4b25-8d7c-ababfa869d4e","Type":"ContainerStarted","Data":"24ae3f9047f0356b23ac81475c2fd9f3953de44ce12ba4a3d6049c5f288c0b46"} Mar 16 15:55:55 crc kubenswrapper[5120]: I0316 15:55:55.806088 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:55:55 crc kubenswrapper[5120]: I0316 15:55:55.806320 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-neutron-internal-svc\"" Mar 16 15:55:55 crc kubenswrapper[5120]: I0316 15:55:55.806507 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-neutron-public-svc\"" Mar 16 15:55:55 crc kubenswrapper[5120]: I0316 15:55:55.807135 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n52mq\" (UniqueName: \"kubernetes.io/projected/bd004e27-ba3d-4d48-97a8-b224be1ecc66-kube-api-access-n52mq\") on node \"crc\" DevicePath \"\"" Mar 16 15:55:55 crc kubenswrapper[5120]: I0316 15:55:55.807280 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/bd004e27-ba3d-4d48-97a8-b224be1ecc66-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 15:55:55 crc kubenswrapper[5120]: I0316 15:55:55.807361 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/bd004e27-ba3d-4d48-97a8-b224be1ecc66-logs\") on node \"crc\" DevicePath \"\"" Mar 16 15:55:55 crc kubenswrapper[5120]: I0316 15:55:55.807439 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/bd004e27-ba3d-4d48-97a8-b224be1ecc66-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 15:55:55 crc kubenswrapper[5120]: I0316 15:55:55.807515 5120 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/bd004e27-ba3d-4d48-97a8-b224be1ecc66-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 15:55:55 crc kubenswrapper[5120]: I0316 15:55:55.807575 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bd004e27-ba3d-4d48-97a8-b224be1ecc66-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:55:55 crc kubenswrapper[5120]: I0316 15:55:55.812388 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-5477dfc7d6-r85w6"] Mar 16 15:55:55 crc kubenswrapper[5120]: I0316 15:55:55.829869 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd004e27-ba3d-4d48-97a8-b224be1ecc66-config-data" (OuterVolumeSpecName: "config-data") pod "bd004e27-ba3d-4d48-97a8-b224be1ecc66" (UID: "bd004e27-ba3d-4d48-97a8-b224be1ecc66"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:55:55 crc kubenswrapper[5120]: I0316 15:55:55.862647 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 15:55:55 crc kubenswrapper[5120]: I0316 15:55:55.866642 5120 scope.go:117] "RemoveContainer" containerID="c7274eea5811a54fd2bb400f9dfce0a01e890b29e78cb6c308f35986d5d5d529" Mar 16 15:55:55 crc kubenswrapper[5120]: I0316 15:55:55.878748 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.857524748 podStartE2EDuration="6.878728936s" podCreationTimestamp="2026-03-16 15:55:49 +0000 UTC" firstStartedPulling="2026-03-16 15:55:50.711495486 +0000 UTC m=+1452.865427143" lastFinishedPulling="2026-03-16 15:55:54.732699674 +0000 UTC m=+1456.886631331" observedRunningTime="2026-03-16 15:55:55.861265422 +0000 UTC m=+1458.015197089" watchObservedRunningTime="2026-03-16 15:55:55.878728936 +0000 UTC m=+1458.032660583" Mar 16 15:55:55 crc kubenswrapper[5120]: I0316 15:55:55.895172 5120 scope.go:117] "RemoveContainer" containerID="659e1898bcbe706964dc443d5fbfbac224fbc04e29a06e0173a43a1286816a99" Mar 16 15:55:55 crc kubenswrapper[5120]: E0316 15:55:55.897118 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"659e1898bcbe706964dc443d5fbfbac224fbc04e29a06e0173a43a1286816a99\": container with ID starting with 659e1898bcbe706964dc443d5fbfbac224fbc04e29a06e0173a43a1286816a99 not found: ID does not exist" containerID="659e1898bcbe706964dc443d5fbfbac224fbc04e29a06e0173a43a1286816a99" Mar 16 15:55:55 crc kubenswrapper[5120]: I0316 15:55:55.897150 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"659e1898bcbe706964dc443d5fbfbac224fbc04e29a06e0173a43a1286816a99"} err="failed to get container status \"659e1898bcbe706964dc443d5fbfbac224fbc04e29a06e0173a43a1286816a99\": rpc error: code = NotFound desc = could not find container \"659e1898bcbe706964dc443d5fbfbac224fbc04e29a06e0173a43a1286816a99\": container with ID starting with 659e1898bcbe706964dc443d5fbfbac224fbc04e29a06e0173a43a1286816a99 not found: ID does not exist" Mar 16 15:55:55 crc kubenswrapper[5120]: I0316 15:55:55.897171 5120 scope.go:117] "RemoveContainer" containerID="c7274eea5811a54fd2bb400f9dfce0a01e890b29e78cb6c308f35986d5d5d529" Mar 16 15:55:55 crc kubenswrapper[5120]: E0316 15:55:55.897426 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c7274eea5811a54fd2bb400f9dfce0a01e890b29e78cb6c308f35986d5d5d529\": container with ID starting with c7274eea5811a54fd2bb400f9dfce0a01e890b29e78cb6c308f35986d5d5d529 not found: ID does not exist" containerID="c7274eea5811a54fd2bb400f9dfce0a01e890b29e78cb6c308f35986d5d5d529" Mar 16 15:55:55 crc kubenswrapper[5120]: I0316 15:55:55.897454 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7274eea5811a54fd2bb400f9dfce0a01e890b29e78cb6c308f35986d5d5d529"} err="failed to get container status \"c7274eea5811a54fd2bb400f9dfce0a01e890b29e78cb6c308f35986d5d5d529\": rpc error: code = NotFound desc = could not find container \"c7274eea5811a54fd2bb400f9dfce0a01e890b29e78cb6c308f35986d5d5d529\": container with ID starting with c7274eea5811a54fd2bb400f9dfce0a01e890b29e78cb6c308f35986d5d5d529 not found: ID does not exist" Mar 16 15:55:55 crc kubenswrapper[5120]: I0316 15:55:55.897474 5120 scope.go:117] "RemoveContainer" containerID="659e1898bcbe706964dc443d5fbfbac224fbc04e29a06e0173a43a1286816a99" Mar 16 15:55:55 crc kubenswrapper[5120]: I0316 15:55:55.897670 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"659e1898bcbe706964dc443d5fbfbac224fbc04e29a06e0173a43a1286816a99"} err="failed to get container status \"659e1898bcbe706964dc443d5fbfbac224fbc04e29a06e0173a43a1286816a99\": rpc error: code = NotFound desc = could not find container \"659e1898bcbe706964dc443d5fbfbac224fbc04e29a06e0173a43a1286816a99\": container with ID starting with 659e1898bcbe706964dc443d5fbfbac224fbc04e29a06e0173a43a1286816a99 not found: ID does not exist" Mar 16 15:55:55 crc kubenswrapper[5120]: I0316 15:55:55.897688 5120 scope.go:117] "RemoveContainer" containerID="c7274eea5811a54fd2bb400f9dfce0a01e890b29e78cb6c308f35986d5d5d529" Mar 16 15:55:55 crc kubenswrapper[5120]: I0316 15:55:55.897886 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7274eea5811a54fd2bb400f9dfce0a01e890b29e78cb6c308f35986d5d5d529"} err="failed to get container status \"c7274eea5811a54fd2bb400f9dfce0a01e890b29e78cb6c308f35986d5d5d529\": rpc error: code = NotFound desc = could not find container \"c7274eea5811a54fd2bb400f9dfce0a01e890b29e78cb6c308f35986d5d5d529\": container with ID starting with c7274eea5811a54fd2bb400f9dfce0a01e890b29e78cb6c308f35986d5d5d529 not found: ID does not exist" Mar 16 15:55:55 crc kubenswrapper[5120]: I0316 15:55:55.911690 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/65f5015a-d673-4a1d-bd09-c695f2b41a47-httpd-config\") pod \"neutron-5477dfc7d6-r85w6\" (UID: \"65f5015a-d673-4a1d-bd09-c695f2b41a47\") " pod="openstack-kuttl-tests/neutron-5477dfc7d6-r85w6" Mar 16 15:55:55 crc kubenswrapper[5120]: I0316 15:55:55.911751 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/65f5015a-d673-4a1d-bd09-c695f2b41a47-config\") pod \"neutron-5477dfc7d6-r85w6\" (UID: \"65f5015a-d673-4a1d-bd09-c695f2b41a47\") " pod="openstack-kuttl-tests/neutron-5477dfc7d6-r85w6" Mar 16 15:55:55 crc kubenswrapper[5120]: I0316 15:55:55.912202 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/65f5015a-d673-4a1d-bd09-c695f2b41a47-ovndb-tls-certs\") pod \"neutron-5477dfc7d6-r85w6\" (UID: \"65f5015a-d673-4a1d-bd09-c695f2b41a47\") " pod="openstack-kuttl-tests/neutron-5477dfc7d6-r85w6" Mar 16 15:55:55 crc kubenswrapper[5120]: I0316 15:55:55.912379 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/65f5015a-d673-4a1d-bd09-c695f2b41a47-internal-tls-certs\") pod \"neutron-5477dfc7d6-r85w6\" (UID: \"65f5015a-d673-4a1d-bd09-c695f2b41a47\") " pod="openstack-kuttl-tests/neutron-5477dfc7d6-r85w6" Mar 16 15:55:55 crc kubenswrapper[5120]: I0316 15:55:55.912466 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfmfh\" (UniqueName: \"kubernetes.io/projected/65f5015a-d673-4a1d-bd09-c695f2b41a47-kube-api-access-lfmfh\") pod \"neutron-5477dfc7d6-r85w6\" (UID: \"65f5015a-d673-4a1d-bd09-c695f2b41a47\") " pod="openstack-kuttl-tests/neutron-5477dfc7d6-r85w6" Mar 16 15:55:55 crc kubenswrapper[5120]: I0316 15:55:55.912657 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/65f5015a-d673-4a1d-bd09-c695f2b41a47-public-tls-certs\") pod \"neutron-5477dfc7d6-r85w6\" (UID: \"65f5015a-d673-4a1d-bd09-c695f2b41a47\") " pod="openstack-kuttl-tests/neutron-5477dfc7d6-r85w6" Mar 16 15:55:55 crc kubenswrapper[5120]: I0316 15:55:55.914291 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/65f5015a-d673-4a1d-bd09-c695f2b41a47-combined-ca-bundle\") pod \"neutron-5477dfc7d6-r85w6\" (UID: \"65f5015a-d673-4a1d-bd09-c695f2b41a47\") " pod="openstack-kuttl-tests/neutron-5477dfc7d6-r85w6" Mar 16 15:55:55 crc kubenswrapper[5120]: I0316 15:55:55.914424 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bd004e27-ba3d-4d48-97a8-b224be1ecc66-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 15:55:56 crc kubenswrapper[5120]: I0316 15:55:56.016175 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/65f5015a-d673-4a1d-bd09-c695f2b41a47-httpd-config\") pod \"neutron-5477dfc7d6-r85w6\" (UID: \"65f5015a-d673-4a1d-bd09-c695f2b41a47\") " pod="openstack-kuttl-tests/neutron-5477dfc7d6-r85w6" Mar 16 15:55:56 crc kubenswrapper[5120]: I0316 15:55:56.016235 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/65f5015a-d673-4a1d-bd09-c695f2b41a47-config\") pod \"neutron-5477dfc7d6-r85w6\" (UID: \"65f5015a-d673-4a1d-bd09-c695f2b41a47\") " pod="openstack-kuttl-tests/neutron-5477dfc7d6-r85w6" Mar 16 15:55:56 crc kubenswrapper[5120]: I0316 15:55:56.016310 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/65f5015a-d673-4a1d-bd09-c695f2b41a47-ovndb-tls-certs\") pod \"neutron-5477dfc7d6-r85w6\" (UID: \"65f5015a-d673-4a1d-bd09-c695f2b41a47\") " pod="openstack-kuttl-tests/neutron-5477dfc7d6-r85w6" Mar 16 15:55:56 crc kubenswrapper[5120]: I0316 15:55:56.016353 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/65f5015a-d673-4a1d-bd09-c695f2b41a47-internal-tls-certs\") pod \"neutron-5477dfc7d6-r85w6\" (UID: \"65f5015a-d673-4a1d-bd09-c695f2b41a47\") " pod="openstack-kuttl-tests/neutron-5477dfc7d6-r85w6" Mar 16 15:55:56 crc kubenswrapper[5120]: I0316 15:55:56.016373 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lfmfh\" (UniqueName: \"kubernetes.io/projected/65f5015a-d673-4a1d-bd09-c695f2b41a47-kube-api-access-lfmfh\") pod \"neutron-5477dfc7d6-r85w6\" (UID: \"65f5015a-d673-4a1d-bd09-c695f2b41a47\") " pod="openstack-kuttl-tests/neutron-5477dfc7d6-r85w6" Mar 16 15:55:56 crc kubenswrapper[5120]: I0316 15:55:56.016409 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/65f5015a-d673-4a1d-bd09-c695f2b41a47-public-tls-certs\") pod \"neutron-5477dfc7d6-r85w6\" (UID: \"65f5015a-d673-4a1d-bd09-c695f2b41a47\") " pod="openstack-kuttl-tests/neutron-5477dfc7d6-r85w6" Mar 16 15:55:56 crc kubenswrapper[5120]: I0316 15:55:56.016453 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/65f5015a-d673-4a1d-bd09-c695f2b41a47-combined-ca-bundle\") pod \"neutron-5477dfc7d6-r85w6\" (UID: \"65f5015a-d673-4a1d-bd09-c695f2b41a47\") " pod="openstack-kuttl-tests/neutron-5477dfc7d6-r85w6" Mar 16 15:55:56 crc kubenswrapper[5120]: I0316 15:55:56.021905 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/65f5015a-d673-4a1d-bd09-c695f2b41a47-public-tls-certs\") pod \"neutron-5477dfc7d6-r85w6\" (UID: \"65f5015a-d673-4a1d-bd09-c695f2b41a47\") " pod="openstack-kuttl-tests/neutron-5477dfc7d6-r85w6" Mar 16 15:55:56 crc kubenswrapper[5120]: I0316 15:55:56.022597 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/65f5015a-d673-4a1d-bd09-c695f2b41a47-httpd-config\") pod \"neutron-5477dfc7d6-r85w6\" (UID: \"65f5015a-d673-4a1d-bd09-c695f2b41a47\") " pod="openstack-kuttl-tests/neutron-5477dfc7d6-r85w6" Mar 16 15:55:56 crc kubenswrapper[5120]: I0316 15:55:56.022883 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/65f5015a-d673-4a1d-bd09-c695f2b41a47-ovndb-tls-certs\") pod \"neutron-5477dfc7d6-r85w6\" (UID: \"65f5015a-d673-4a1d-bd09-c695f2b41a47\") " pod="openstack-kuttl-tests/neutron-5477dfc7d6-r85w6" Mar 16 15:55:56 crc kubenswrapper[5120]: I0316 15:55:56.024485 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/65f5015a-d673-4a1d-bd09-c695f2b41a47-config\") pod \"neutron-5477dfc7d6-r85w6\" (UID: \"65f5015a-d673-4a1d-bd09-c695f2b41a47\") " pod="openstack-kuttl-tests/neutron-5477dfc7d6-r85w6" Mar 16 15:55:56 crc kubenswrapper[5120]: I0316 15:55:56.025456 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/65f5015a-d673-4a1d-bd09-c695f2b41a47-combined-ca-bundle\") pod \"neutron-5477dfc7d6-r85w6\" (UID: \"65f5015a-d673-4a1d-bd09-c695f2b41a47\") " pod="openstack-kuttl-tests/neutron-5477dfc7d6-r85w6" Mar 16 15:55:56 crc kubenswrapper[5120]: I0316 15:55:56.029560 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/65f5015a-d673-4a1d-bd09-c695f2b41a47-internal-tls-certs\") pod \"neutron-5477dfc7d6-r85w6\" (UID: \"65f5015a-d673-4a1d-bd09-c695f2b41a47\") " pod="openstack-kuttl-tests/neutron-5477dfc7d6-r85w6" Mar 16 15:55:56 crc kubenswrapper[5120]: I0316 15:55:56.036646 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfmfh\" (UniqueName: \"kubernetes.io/projected/65f5015a-d673-4a1d-bd09-c695f2b41a47-kube-api-access-lfmfh\") pod \"neutron-5477dfc7d6-r85w6\" (UID: \"65f5015a-d673-4a1d-bd09-c695f2b41a47\") " pod="openstack-kuttl-tests/neutron-5477dfc7d6-r85w6" Mar 16 15:55:56 crc kubenswrapper[5120]: I0316 15:55:56.145841 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-5477dfc7d6-r85w6" Mar 16 15:55:56 crc kubenswrapper[5120]: I0316 15:55:56.287356 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 15:55:56 crc kubenswrapper[5120]: I0316 15:55:56.294122 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 15:55:56 crc kubenswrapper[5120]: I0316 15:55:56.306876 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 15:55:56 crc kubenswrapper[5120]: I0316 15:55:56.314225 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:55:56 crc kubenswrapper[5120]: I0316 15:55:56.325477 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 15:55:56 crc kubenswrapper[5120]: I0316 15:55:56.334025 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-api-config-data\"" Mar 16 15:55:56 crc kubenswrapper[5120]: I0316 15:55:56.334242 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-cinder-public-svc\"" Mar 16 15:55:56 crc kubenswrapper[5120]: I0316 15:55:56.348224 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-cinder-internal-svc\"" Mar 16 15:55:56 crc kubenswrapper[5120]: I0316 15:55:56.425695 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9f58e7c4-539f-4659-814c-9c8808d4c367-config-data\") pod \"cinder-api-0\" (UID: \"9f58e7c4-539f-4659-814c-9c8808d4c367\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:55:56 crc kubenswrapper[5120]: I0316 15:55:56.425744 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mhzf\" (UniqueName: \"kubernetes.io/projected/9f58e7c4-539f-4659-814c-9c8808d4c367-kube-api-access-7mhzf\") pod \"cinder-api-0\" (UID: \"9f58e7c4-539f-4659-814c-9c8808d4c367\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:55:56 crc kubenswrapper[5120]: I0316 15:55:56.425780 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9f58e7c4-539f-4659-814c-9c8808d4c367-scripts\") pod \"cinder-api-0\" (UID: \"9f58e7c4-539f-4659-814c-9c8808d4c367\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:55:56 crc kubenswrapper[5120]: I0316 15:55:56.425843 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/9f58e7c4-539f-4659-814c-9c8808d4c367-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"9f58e7c4-539f-4659-814c-9c8808d4c367\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:55:56 crc kubenswrapper[5120]: I0316 15:55:56.425914 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9f58e7c4-539f-4659-814c-9c8808d4c367-logs\") pod \"cinder-api-0\" (UID: \"9f58e7c4-539f-4659-814c-9c8808d4c367\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:55:56 crc kubenswrapper[5120]: I0316 15:55:56.425977 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/9f58e7c4-539f-4659-814c-9c8808d4c367-config-data-custom\") pod \"cinder-api-0\" (UID: \"9f58e7c4-539f-4659-814c-9c8808d4c367\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:55:56 crc kubenswrapper[5120]: I0316 15:55:56.425992 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9f58e7c4-539f-4659-814c-9c8808d4c367-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"9f58e7c4-539f-4659-814c-9c8808d4c367\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:55:56 crc kubenswrapper[5120]: I0316 15:55:56.426021 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/9f58e7c4-539f-4659-814c-9c8808d4c367-etc-machine-id\") pod \"cinder-api-0\" (UID: \"9f58e7c4-539f-4659-814c-9c8808d4c367\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:55:56 crc kubenswrapper[5120]: I0316 15:55:56.426037 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/9f58e7c4-539f-4659-814c-9c8808d4c367-public-tls-certs\") pod \"cinder-api-0\" (UID: \"9f58e7c4-539f-4659-814c-9c8808d4c367\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:55:56 crc kubenswrapper[5120]: I0316 15:55:56.527780 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9f58e7c4-539f-4659-814c-9c8808d4c367-config-data\") pod \"cinder-api-0\" (UID: \"9f58e7c4-539f-4659-814c-9c8808d4c367\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:55:56 crc kubenswrapper[5120]: I0316 15:55:56.527830 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7mhzf\" (UniqueName: \"kubernetes.io/projected/9f58e7c4-539f-4659-814c-9c8808d4c367-kube-api-access-7mhzf\") pod \"cinder-api-0\" (UID: \"9f58e7c4-539f-4659-814c-9c8808d4c367\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:55:56 crc kubenswrapper[5120]: I0316 15:55:56.527856 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9f58e7c4-539f-4659-814c-9c8808d4c367-scripts\") pod \"cinder-api-0\" (UID: \"9f58e7c4-539f-4659-814c-9c8808d4c367\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:55:56 crc kubenswrapper[5120]: I0316 15:55:56.527877 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/9f58e7c4-539f-4659-814c-9c8808d4c367-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"9f58e7c4-539f-4659-814c-9c8808d4c367\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:55:56 crc kubenswrapper[5120]: I0316 15:55:56.527948 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9f58e7c4-539f-4659-814c-9c8808d4c367-logs\") pod \"cinder-api-0\" (UID: \"9f58e7c4-539f-4659-814c-9c8808d4c367\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:55:56 crc kubenswrapper[5120]: I0316 15:55:56.528015 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/9f58e7c4-539f-4659-814c-9c8808d4c367-config-data-custom\") pod \"cinder-api-0\" (UID: \"9f58e7c4-539f-4659-814c-9c8808d4c367\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:55:56 crc kubenswrapper[5120]: I0316 15:55:56.528029 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9f58e7c4-539f-4659-814c-9c8808d4c367-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"9f58e7c4-539f-4659-814c-9c8808d4c367\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:55:56 crc kubenswrapper[5120]: I0316 15:55:56.528056 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/9f58e7c4-539f-4659-814c-9c8808d4c367-etc-machine-id\") pod \"cinder-api-0\" (UID: \"9f58e7c4-539f-4659-814c-9c8808d4c367\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:55:56 crc kubenswrapper[5120]: I0316 15:55:56.528070 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/9f58e7c4-539f-4659-814c-9c8808d4c367-public-tls-certs\") pod \"cinder-api-0\" (UID: \"9f58e7c4-539f-4659-814c-9c8808d4c367\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:55:56 crc kubenswrapper[5120]: I0316 15:55:56.534327 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/9f58e7c4-539f-4659-814c-9c8808d4c367-public-tls-certs\") pod \"cinder-api-0\" (UID: \"9f58e7c4-539f-4659-814c-9c8808d4c367\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:55:56 crc kubenswrapper[5120]: I0316 15:55:56.534582 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9f58e7c4-539f-4659-814c-9c8808d4c367-logs\") pod \"cinder-api-0\" (UID: \"9f58e7c4-539f-4659-814c-9c8808d4c367\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:55:56 crc kubenswrapper[5120]: I0316 15:55:56.543707 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/9f58e7c4-539f-4659-814c-9c8808d4c367-etc-machine-id\") pod \"cinder-api-0\" (UID: \"9f58e7c4-539f-4659-814c-9c8808d4c367\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:55:56 crc kubenswrapper[5120]: I0316 15:55:56.544302 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/9f58e7c4-539f-4659-814c-9c8808d4c367-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"9f58e7c4-539f-4659-814c-9c8808d4c367\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:55:56 crc kubenswrapper[5120]: I0316 15:55:56.548543 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/9f58e7c4-539f-4659-814c-9c8808d4c367-config-data-custom\") pod \"cinder-api-0\" (UID: \"9f58e7c4-539f-4659-814c-9c8808d4c367\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:55:56 crc kubenswrapper[5120]: I0316 15:55:56.549684 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9f58e7c4-539f-4659-814c-9c8808d4c367-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"9f58e7c4-539f-4659-814c-9c8808d4c367\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:55:56 crc kubenswrapper[5120]: I0316 15:55:56.557374 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9f58e7c4-539f-4659-814c-9c8808d4c367-config-data\") pod \"cinder-api-0\" (UID: \"9f58e7c4-539f-4659-814c-9c8808d4c367\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:55:56 crc kubenswrapper[5120]: I0316 15:55:56.562269 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9f58e7c4-539f-4659-814c-9c8808d4c367-scripts\") pod \"cinder-api-0\" (UID: \"9f58e7c4-539f-4659-814c-9c8808d4c367\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:55:56 crc kubenswrapper[5120]: I0316 15:55:56.580644 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mhzf\" (UniqueName: \"kubernetes.io/projected/9f58e7c4-539f-4659-814c-9c8808d4c367-kube-api-access-7mhzf\") pod \"cinder-api-0\" (UID: \"9f58e7c4-539f-4659-814c-9c8808d4c367\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:55:56 crc kubenswrapper[5120]: I0316 15:55:56.638239 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:55:56 crc kubenswrapper[5120]: I0316 15:55:56.677358 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bd004e27-ba3d-4d48-97a8-b224be1ecc66" path="/var/lib/kubelet/pods/bd004e27-ba3d-4d48-97a8-b224be1ecc66/volumes" Mar 16 15:55:56 crc kubenswrapper[5120]: I0316 15:55:56.699007 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:55:56 crc kubenswrapper[5120]: I0316 15:55:56.699047 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:55:56 crc kubenswrapper[5120]: I0316 15:55:56.745632 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:55:56 crc kubenswrapper[5120]: I0316 15:55:56.746431 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:55:56 crc kubenswrapper[5120]: I0316 15:55:56.760302 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:55:56 crc kubenswrapper[5120]: I0316 15:55:56.760351 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:55:56 crc kubenswrapper[5120]: I0316 15:55:56.841029 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:55:56 crc kubenswrapper[5120]: I0316 15:55:56.848822 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-549cb9f7c8-crdfd" event={"ID":"57a83a83-de95-43e1-b18c-a7b59c4d1a3b","Type":"ContainerStarted","Data":"a95489c8bbe1e3ef55ce309ffd1d01d5bd0af121804a472f940c85adb881b073"} Mar 16 15:55:56 crc kubenswrapper[5120]: I0316 15:55:56.848959 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/keystone-549cb9f7c8-crdfd" Mar 16 15:55:56 crc kubenswrapper[5120]: I0316 15:55:56.851042 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-5477dfc7d6-r85w6"] Mar 16 15:55:56 crc kubenswrapper[5120]: I0316 15:55:56.854685 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:55:56 crc kubenswrapper[5120]: I0316 15:55:56.854728 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:55:56 crc kubenswrapper[5120]: I0316 15:55:56.854745 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:55:56 crc kubenswrapper[5120]: I0316 15:55:56.861869 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:55:56 crc kubenswrapper[5120]: I0316 15:55:56.924994 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-549cb9f7c8-crdfd" podStartSLOduration=2.924972144 podStartE2EDuration="2.924972144s" podCreationTimestamp="2026-03-16 15:55:54 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:55:56.885398528 +0000 UTC m=+1459.039330275" watchObservedRunningTime="2026-03-16 15:55:56.924972144 +0000 UTC m=+1459.078903801" Mar 16 15:55:57 crc kubenswrapper[5120]: I0316 15:55:57.158192 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 15:55:57 crc kubenswrapper[5120]: I0316 15:55:57.528536 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-846956b868-5mw5q" Mar 16 15:55:57 crc kubenswrapper[5120]: I0316 15:55:57.558299 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-846956b868-5mw5q" Mar 16 15:55:57 crc kubenswrapper[5120]: I0316 15:55:57.736381 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-worker-54b7655659-bqszk"] Mar 16 15:55:57 crc kubenswrapper[5120]: I0316 15:55:57.748277 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-54b7655659-bqszk" Mar 16 15:55:57 crc kubenswrapper[5120]: I0316 15:55:57.748585 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-85c489687d-pcp6w"] Mar 16 15:55:57 crc kubenswrapper[5120]: I0316 15:55:57.768989 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-54b7655659-bqszk"] Mar 16 15:55:57 crc kubenswrapper[5120]: I0316 15:55:57.769043 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-85c489687d-pcp6w"] Mar 16 15:55:57 crc kubenswrapper[5120]: I0316 15:55:57.769202 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-85c489687d-pcp6w" Mar 16 15:55:57 crc kubenswrapper[5120]: I0316 15:55:57.833796 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-api-667d795786-lqmct"] Mar 16 15:55:57 crc kubenswrapper[5120]: I0316 15:55:57.854218 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-667d795786-lqmct" Mar 16 15:55:57 crc kubenswrapper[5120]: I0316 15:55:57.861920 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-667d795786-lqmct"] Mar 16 15:55:57 crc kubenswrapper[5120]: I0316 15:55:57.874047 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-5477dfc7d6-r85w6" event={"ID":"65f5015a-d673-4a1d-bd09-c695f2b41a47","Type":"ContainerStarted","Data":"e3ff05b6348b5b52f655f2e654b8bb92f34e8976b107f05b594ed2c6a0dd4dee"} Mar 16 15:55:57 crc kubenswrapper[5120]: I0316 15:55:57.874090 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-5477dfc7d6-r85w6" event={"ID":"65f5015a-d673-4a1d-bd09-c695f2b41a47","Type":"ContainerStarted","Data":"4b60d781e4c4d04ce9cd5e3a15fb61c49894b5654ae98b63df546451d7ab3a2c"} Mar 16 15:55:57 crc kubenswrapper[5120]: I0316 15:55:57.874099 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-5477dfc7d6-r85w6" event={"ID":"65f5015a-d673-4a1d-bd09-c695f2b41a47","Type":"ContainerStarted","Data":"aaec780d5e27580b2a9a8541a569d8b77f322a8a08d21cf955833816e8b4999e"} Mar 16 15:55:57 crc kubenswrapper[5120]: I0316 15:55:57.874856 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/neutron-5477dfc7d6-r85w6" Mar 16 15:55:57 crc kubenswrapper[5120]: I0316 15:55:57.880164 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckjcl\" (UniqueName: \"kubernetes.io/projected/fc59410f-18f6-4de8-b0f9-d54fcaea8faf-kube-api-access-ckjcl\") pod \"barbican-worker-54b7655659-bqszk\" (UID: \"fc59410f-18f6-4de8-b0f9-d54fcaea8faf\") " pod="openstack-kuttl-tests/barbican-worker-54b7655659-bqszk" Mar 16 15:55:57 crc kubenswrapper[5120]: I0316 15:55:57.880213 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fc59410f-18f6-4de8-b0f9-d54fcaea8faf-combined-ca-bundle\") pod \"barbican-worker-54b7655659-bqszk\" (UID: \"fc59410f-18f6-4de8-b0f9-d54fcaea8faf\") " pod="openstack-kuttl-tests/barbican-worker-54b7655659-bqszk" Mar 16 15:55:57 crc kubenswrapper[5120]: I0316 15:55:57.880252 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b3794e20-01dd-453a-bf29-20813144c61b-logs\") pod \"barbican-keystone-listener-85c489687d-pcp6w\" (UID: \"b3794e20-01dd-453a-bf29-20813144c61b\") " pod="openstack-kuttl-tests/barbican-keystone-listener-85c489687d-pcp6w" Mar 16 15:55:57 crc kubenswrapper[5120]: I0316 15:55:57.880274 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/fc59410f-18f6-4de8-b0f9-d54fcaea8faf-config-data-custom\") pod \"barbican-worker-54b7655659-bqszk\" (UID: \"fc59410f-18f6-4de8-b0f9-d54fcaea8faf\") " pod="openstack-kuttl-tests/barbican-worker-54b7655659-bqszk" Mar 16 15:55:57 crc kubenswrapper[5120]: I0316 15:55:57.880294 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cm2qn\" (UniqueName: \"kubernetes.io/projected/b3794e20-01dd-453a-bf29-20813144c61b-kube-api-access-cm2qn\") pod \"barbican-keystone-listener-85c489687d-pcp6w\" (UID: \"b3794e20-01dd-453a-bf29-20813144c61b\") " pod="openstack-kuttl-tests/barbican-keystone-listener-85c489687d-pcp6w" Mar 16 15:55:57 crc kubenswrapper[5120]: I0316 15:55:57.880341 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b3794e20-01dd-453a-bf29-20813144c61b-combined-ca-bundle\") pod \"barbican-keystone-listener-85c489687d-pcp6w\" (UID: \"b3794e20-01dd-453a-bf29-20813144c61b\") " pod="openstack-kuttl-tests/barbican-keystone-listener-85c489687d-pcp6w" Mar 16 15:55:57 crc kubenswrapper[5120]: I0316 15:55:57.880377 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fc59410f-18f6-4de8-b0f9-d54fcaea8faf-config-data\") pod \"barbican-worker-54b7655659-bqszk\" (UID: \"fc59410f-18f6-4de8-b0f9-d54fcaea8faf\") " pod="openstack-kuttl-tests/barbican-worker-54b7655659-bqszk" Mar 16 15:55:57 crc kubenswrapper[5120]: I0316 15:55:57.880409 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b3794e20-01dd-453a-bf29-20813144c61b-config-data\") pod \"barbican-keystone-listener-85c489687d-pcp6w\" (UID: \"b3794e20-01dd-453a-bf29-20813144c61b\") " pod="openstack-kuttl-tests/barbican-keystone-listener-85c489687d-pcp6w" Mar 16 15:55:57 crc kubenswrapper[5120]: I0316 15:55:57.880434 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/b3794e20-01dd-453a-bf29-20813144c61b-config-data-custom\") pod \"barbican-keystone-listener-85c489687d-pcp6w\" (UID: \"b3794e20-01dd-453a-bf29-20813144c61b\") " pod="openstack-kuttl-tests/barbican-keystone-listener-85c489687d-pcp6w" Mar 16 15:55:57 crc kubenswrapper[5120]: I0316 15:55:57.880475 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/fc59410f-18f6-4de8-b0f9-d54fcaea8faf-logs\") pod \"barbican-worker-54b7655659-bqszk\" (UID: \"fc59410f-18f6-4de8-b0f9-d54fcaea8faf\") " pod="openstack-kuttl-tests/barbican-worker-54b7655659-bqszk" Mar 16 15:55:57 crc kubenswrapper[5120]: I0316 15:55:57.890414 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"9f58e7c4-539f-4659-814c-9c8808d4c367","Type":"ContainerStarted","Data":"b349f7899c8fd998abc0b328c670e6480d75109d824359ee6e946d99452638c2"} Mar 16 15:55:57 crc kubenswrapper[5120]: I0316 15:55:57.892235 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="8cc8a233-a88b-4b25-8d7c-ababfa869d4e" containerName="ceilometer-central-agent" containerID="cri-o://74559f495137d72a82a0793c5af59e943c6b52dc27889b1421c3cb038e83d522" gracePeriod=30 Mar 16 15:55:57 crc kubenswrapper[5120]: I0316 15:55:57.893350 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:55:57 crc kubenswrapper[5120]: I0316 15:55:57.893431 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="8cc8a233-a88b-4b25-8d7c-ababfa869d4e" containerName="proxy-httpd" containerID="cri-o://24ae3f9047f0356b23ac81475c2fd9f3953de44ce12ba4a3d6049c5f288c0b46" gracePeriod=30 Mar 16 15:55:57 crc kubenswrapper[5120]: I0316 15:55:57.893499 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="8cc8a233-a88b-4b25-8d7c-ababfa869d4e" containerName="sg-core" containerID="cri-o://346dd3de73c7983bc158ca5c13d4c09ab4ea91180ceca406d1327ce4bddcb95c" gracePeriod=30 Mar 16 15:55:57 crc kubenswrapper[5120]: I0316 15:55:57.893548 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="8cc8a233-a88b-4b25-8d7c-ababfa869d4e" containerName="ceilometer-notification-agent" containerID="cri-o://5b69c283319516f4ab1c5820d28054eda0c8b9a982948475472346c8c9ae1404" gracePeriod=30 Mar 16 15:55:57 crc kubenswrapper[5120]: I0316 15:55:57.906375 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-5477dfc7d6-r85w6" podStartSLOduration=2.906361536 podStartE2EDuration="2.906361536s" podCreationTimestamp="2026-03-16 15:55:55 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:55:57.904477635 +0000 UTC m=+1460.058409312" watchObservedRunningTime="2026-03-16 15:55:57.906361536 +0000 UTC m=+1460.060293193" Mar 16 15:55:57 crc kubenswrapper[5120]: I0316 15:55:57.982402 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cm2qn\" (UniqueName: \"kubernetes.io/projected/b3794e20-01dd-453a-bf29-20813144c61b-kube-api-access-cm2qn\") pod \"barbican-keystone-listener-85c489687d-pcp6w\" (UID: \"b3794e20-01dd-453a-bf29-20813144c61b\") " pod="openstack-kuttl-tests/barbican-keystone-listener-85c489687d-pcp6w" Mar 16 15:55:57 crc kubenswrapper[5120]: I0316 15:55:57.982460 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e08f7127-ac46-4cf0-a1ae-d02c51cc94ee-combined-ca-bundle\") pod \"barbican-api-667d795786-lqmct\" (UID: \"e08f7127-ac46-4cf0-a1ae-d02c51cc94ee\") " pod="openstack-kuttl-tests/barbican-api-667d795786-lqmct" Mar 16 15:55:57 crc kubenswrapper[5120]: I0316 15:55:57.982718 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b3794e20-01dd-453a-bf29-20813144c61b-combined-ca-bundle\") pod \"barbican-keystone-listener-85c489687d-pcp6w\" (UID: \"b3794e20-01dd-453a-bf29-20813144c61b\") " pod="openstack-kuttl-tests/barbican-keystone-listener-85c489687d-pcp6w" Mar 16 15:55:57 crc kubenswrapper[5120]: I0316 15:55:57.982986 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fc59410f-18f6-4de8-b0f9-d54fcaea8faf-config-data\") pod \"barbican-worker-54b7655659-bqszk\" (UID: \"fc59410f-18f6-4de8-b0f9-d54fcaea8faf\") " pod="openstack-kuttl-tests/barbican-worker-54b7655659-bqszk" Mar 16 15:55:57 crc kubenswrapper[5120]: I0316 15:55:57.983147 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b3794e20-01dd-453a-bf29-20813144c61b-config-data\") pod \"barbican-keystone-listener-85c489687d-pcp6w\" (UID: \"b3794e20-01dd-453a-bf29-20813144c61b\") " pod="openstack-kuttl-tests/barbican-keystone-listener-85c489687d-pcp6w" Mar 16 15:55:57 crc kubenswrapper[5120]: I0316 15:55:57.983225 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/b3794e20-01dd-453a-bf29-20813144c61b-config-data-custom\") pod \"barbican-keystone-listener-85c489687d-pcp6w\" (UID: \"b3794e20-01dd-453a-bf29-20813144c61b\") " pod="openstack-kuttl-tests/barbican-keystone-listener-85c489687d-pcp6w" Mar 16 15:55:57 crc kubenswrapper[5120]: I0316 15:55:57.983396 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e08f7127-ac46-4cf0-a1ae-d02c51cc94ee-config-data\") pod \"barbican-api-667d795786-lqmct\" (UID: \"e08f7127-ac46-4cf0-a1ae-d02c51cc94ee\") " pod="openstack-kuttl-tests/barbican-api-667d795786-lqmct" Mar 16 15:55:57 crc kubenswrapper[5120]: I0316 15:55:57.983449 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/fc59410f-18f6-4de8-b0f9-d54fcaea8faf-logs\") pod \"barbican-worker-54b7655659-bqszk\" (UID: \"fc59410f-18f6-4de8-b0f9-d54fcaea8faf\") " pod="openstack-kuttl-tests/barbican-worker-54b7655659-bqszk" Mar 16 15:55:57 crc kubenswrapper[5120]: I0316 15:55:57.985803 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/fc59410f-18f6-4de8-b0f9-d54fcaea8faf-logs\") pod \"barbican-worker-54b7655659-bqszk\" (UID: \"fc59410f-18f6-4de8-b0f9-d54fcaea8faf\") " pod="openstack-kuttl-tests/barbican-worker-54b7655659-bqszk" Mar 16 15:55:57 crc kubenswrapper[5120]: I0316 15:55:57.985928 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e08f7127-ac46-4cf0-a1ae-d02c51cc94ee-logs\") pod \"barbican-api-667d795786-lqmct\" (UID: \"e08f7127-ac46-4cf0-a1ae-d02c51cc94ee\") " pod="openstack-kuttl-tests/barbican-api-667d795786-lqmct" Mar 16 15:55:57 crc kubenswrapper[5120]: I0316 15:55:57.986184 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ckjcl\" (UniqueName: \"kubernetes.io/projected/fc59410f-18f6-4de8-b0f9-d54fcaea8faf-kube-api-access-ckjcl\") pod \"barbican-worker-54b7655659-bqszk\" (UID: \"fc59410f-18f6-4de8-b0f9-d54fcaea8faf\") " pod="openstack-kuttl-tests/barbican-worker-54b7655659-bqszk" Mar 16 15:55:57 crc kubenswrapper[5120]: I0316 15:55:57.991451 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fc59410f-18f6-4de8-b0f9-d54fcaea8faf-combined-ca-bundle\") pod \"barbican-worker-54b7655659-bqszk\" (UID: \"fc59410f-18f6-4de8-b0f9-d54fcaea8faf\") " pod="openstack-kuttl-tests/barbican-worker-54b7655659-bqszk" Mar 16 15:55:57 crc kubenswrapper[5120]: I0316 15:55:57.993367 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b3794e20-01dd-453a-bf29-20813144c61b-combined-ca-bundle\") pod \"barbican-keystone-listener-85c489687d-pcp6w\" (UID: \"b3794e20-01dd-453a-bf29-20813144c61b\") " pod="openstack-kuttl-tests/barbican-keystone-listener-85c489687d-pcp6w" Mar 16 15:55:57 crc kubenswrapper[5120]: I0316 15:55:57.986468 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fc59410f-18f6-4de8-b0f9-d54fcaea8faf-combined-ca-bundle\") pod \"barbican-worker-54b7655659-bqszk\" (UID: \"fc59410f-18f6-4de8-b0f9-d54fcaea8faf\") " pod="openstack-kuttl-tests/barbican-worker-54b7655659-bqszk" Mar 16 15:55:57 crc kubenswrapper[5120]: I0316 15:55:57.995393 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b3794e20-01dd-453a-bf29-20813144c61b-logs\") pod \"barbican-keystone-listener-85c489687d-pcp6w\" (UID: \"b3794e20-01dd-453a-bf29-20813144c61b\") " pod="openstack-kuttl-tests/barbican-keystone-listener-85c489687d-pcp6w" Mar 16 15:55:57 crc kubenswrapper[5120]: I0316 15:55:57.995421 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/e08f7127-ac46-4cf0-a1ae-d02c51cc94ee-config-data-custom\") pod \"barbican-api-667d795786-lqmct\" (UID: \"e08f7127-ac46-4cf0-a1ae-d02c51cc94ee\") " pod="openstack-kuttl-tests/barbican-api-667d795786-lqmct" Mar 16 15:55:57 crc kubenswrapper[5120]: I0316 15:55:57.995453 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/fc59410f-18f6-4de8-b0f9-d54fcaea8faf-config-data-custom\") pod \"barbican-worker-54b7655659-bqszk\" (UID: \"fc59410f-18f6-4de8-b0f9-d54fcaea8faf\") " pod="openstack-kuttl-tests/barbican-worker-54b7655659-bqszk" Mar 16 15:55:57 crc kubenswrapper[5120]: I0316 15:55:57.995469 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65x4h\" (UniqueName: \"kubernetes.io/projected/e08f7127-ac46-4cf0-a1ae-d02c51cc94ee-kube-api-access-65x4h\") pod \"barbican-api-667d795786-lqmct\" (UID: \"e08f7127-ac46-4cf0-a1ae-d02c51cc94ee\") " pod="openstack-kuttl-tests/barbican-api-667d795786-lqmct" Mar 16 15:55:57 crc kubenswrapper[5120]: I0316 15:55:57.995712 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/b3794e20-01dd-453a-bf29-20813144c61b-config-data-custom\") pod \"barbican-keystone-listener-85c489687d-pcp6w\" (UID: \"b3794e20-01dd-453a-bf29-20813144c61b\") " pod="openstack-kuttl-tests/barbican-keystone-listener-85c489687d-pcp6w" Mar 16 15:55:57 crc kubenswrapper[5120]: I0316 15:55:57.996056 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fc59410f-18f6-4de8-b0f9-d54fcaea8faf-config-data\") pod \"barbican-worker-54b7655659-bqszk\" (UID: \"fc59410f-18f6-4de8-b0f9-d54fcaea8faf\") " pod="openstack-kuttl-tests/barbican-worker-54b7655659-bqszk" Mar 16 15:55:57 crc kubenswrapper[5120]: I0316 15:55:57.996057 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b3794e20-01dd-453a-bf29-20813144c61b-logs\") pod \"barbican-keystone-listener-85c489687d-pcp6w\" (UID: \"b3794e20-01dd-453a-bf29-20813144c61b\") " pod="openstack-kuttl-tests/barbican-keystone-listener-85c489687d-pcp6w" Mar 16 15:55:57 crc kubenswrapper[5120]: I0316 15:55:57.996141 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b3794e20-01dd-453a-bf29-20813144c61b-config-data\") pod \"barbican-keystone-listener-85c489687d-pcp6w\" (UID: \"b3794e20-01dd-453a-bf29-20813144c61b\") " pod="openstack-kuttl-tests/barbican-keystone-listener-85c489687d-pcp6w" Mar 16 15:55:58 crc kubenswrapper[5120]: I0316 15:55:58.000294 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/fc59410f-18f6-4de8-b0f9-d54fcaea8faf-config-data-custom\") pod \"barbican-worker-54b7655659-bqszk\" (UID: \"fc59410f-18f6-4de8-b0f9-d54fcaea8faf\") " pod="openstack-kuttl-tests/barbican-worker-54b7655659-bqszk" Mar 16 15:55:58 crc kubenswrapper[5120]: I0316 15:55:58.000365 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckjcl\" (UniqueName: \"kubernetes.io/projected/fc59410f-18f6-4de8-b0f9-d54fcaea8faf-kube-api-access-ckjcl\") pod \"barbican-worker-54b7655659-bqszk\" (UID: \"fc59410f-18f6-4de8-b0f9-d54fcaea8faf\") " pod="openstack-kuttl-tests/barbican-worker-54b7655659-bqszk" Mar 16 15:55:58 crc kubenswrapper[5120]: I0316 15:55:58.000499 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cm2qn\" (UniqueName: \"kubernetes.io/projected/b3794e20-01dd-453a-bf29-20813144c61b-kube-api-access-cm2qn\") pod \"barbican-keystone-listener-85c489687d-pcp6w\" (UID: \"b3794e20-01dd-453a-bf29-20813144c61b\") " pod="openstack-kuttl-tests/barbican-keystone-listener-85c489687d-pcp6w" Mar 16 15:55:58 crc kubenswrapper[5120]: I0316 15:55:58.094592 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-54b7655659-bqszk" Mar 16 15:55:58 crc kubenswrapper[5120]: I0316 15:55:58.096821 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e08f7127-ac46-4cf0-a1ae-d02c51cc94ee-config-data\") pod \"barbican-api-667d795786-lqmct\" (UID: \"e08f7127-ac46-4cf0-a1ae-d02c51cc94ee\") " pod="openstack-kuttl-tests/barbican-api-667d795786-lqmct" Mar 16 15:55:58 crc kubenswrapper[5120]: I0316 15:55:58.096891 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e08f7127-ac46-4cf0-a1ae-d02c51cc94ee-logs\") pod \"barbican-api-667d795786-lqmct\" (UID: \"e08f7127-ac46-4cf0-a1ae-d02c51cc94ee\") " pod="openstack-kuttl-tests/barbican-api-667d795786-lqmct" Mar 16 15:55:58 crc kubenswrapper[5120]: I0316 15:55:58.097537 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e08f7127-ac46-4cf0-a1ae-d02c51cc94ee-logs\") pod \"barbican-api-667d795786-lqmct\" (UID: \"e08f7127-ac46-4cf0-a1ae-d02c51cc94ee\") " pod="openstack-kuttl-tests/barbican-api-667d795786-lqmct" Mar 16 15:55:58 crc kubenswrapper[5120]: I0316 15:55:58.097590 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/e08f7127-ac46-4cf0-a1ae-d02c51cc94ee-config-data-custom\") pod \"barbican-api-667d795786-lqmct\" (UID: \"e08f7127-ac46-4cf0-a1ae-d02c51cc94ee\") " pod="openstack-kuttl-tests/barbican-api-667d795786-lqmct" Mar 16 15:55:58 crc kubenswrapper[5120]: I0316 15:55:58.097629 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-65x4h\" (UniqueName: \"kubernetes.io/projected/e08f7127-ac46-4cf0-a1ae-d02c51cc94ee-kube-api-access-65x4h\") pod \"barbican-api-667d795786-lqmct\" (UID: \"e08f7127-ac46-4cf0-a1ae-d02c51cc94ee\") " pod="openstack-kuttl-tests/barbican-api-667d795786-lqmct" Mar 16 15:55:58 crc kubenswrapper[5120]: I0316 15:55:58.097688 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e08f7127-ac46-4cf0-a1ae-d02c51cc94ee-combined-ca-bundle\") pod \"barbican-api-667d795786-lqmct\" (UID: \"e08f7127-ac46-4cf0-a1ae-d02c51cc94ee\") " pod="openstack-kuttl-tests/barbican-api-667d795786-lqmct" Mar 16 15:55:58 crc kubenswrapper[5120]: I0316 15:55:58.102568 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/e08f7127-ac46-4cf0-a1ae-d02c51cc94ee-config-data-custom\") pod \"barbican-api-667d795786-lqmct\" (UID: \"e08f7127-ac46-4cf0-a1ae-d02c51cc94ee\") " pod="openstack-kuttl-tests/barbican-api-667d795786-lqmct" Mar 16 15:55:58 crc kubenswrapper[5120]: I0316 15:55:58.106349 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e08f7127-ac46-4cf0-a1ae-d02c51cc94ee-config-data\") pod \"barbican-api-667d795786-lqmct\" (UID: \"e08f7127-ac46-4cf0-a1ae-d02c51cc94ee\") " pod="openstack-kuttl-tests/barbican-api-667d795786-lqmct" Mar 16 15:55:58 crc kubenswrapper[5120]: I0316 15:55:58.107852 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e08f7127-ac46-4cf0-a1ae-d02c51cc94ee-combined-ca-bundle\") pod \"barbican-api-667d795786-lqmct\" (UID: \"e08f7127-ac46-4cf0-a1ae-d02c51cc94ee\") " pod="openstack-kuttl-tests/barbican-api-667d795786-lqmct" Mar 16 15:55:58 crc kubenswrapper[5120]: I0316 15:55:58.110128 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-85c489687d-pcp6w" Mar 16 15:55:58 crc kubenswrapper[5120]: I0316 15:55:58.120256 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-65x4h\" (UniqueName: \"kubernetes.io/projected/e08f7127-ac46-4cf0-a1ae-d02c51cc94ee-kube-api-access-65x4h\") pod \"barbican-api-667d795786-lqmct\" (UID: \"e08f7127-ac46-4cf0-a1ae-d02c51cc94ee\") " pod="openstack-kuttl-tests/barbican-api-667d795786-lqmct" Mar 16 15:55:58 crc kubenswrapper[5120]: I0316 15:55:58.195349 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-667d795786-lqmct" Mar 16 15:55:58 crc kubenswrapper[5120]: I0316 15:55:58.395731 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-667d795786-lqmct"] Mar 16 15:55:58 crc kubenswrapper[5120]: I0316 15:55:58.428056 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-api-bcc6c568d-dqmvk"] Mar 16 15:55:58 crc kubenswrapper[5120]: I0316 15:55:58.443511 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-bcc6c568d-dqmvk"] Mar 16 15:55:58 crc kubenswrapper[5120]: I0316 15:55:58.443731 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-bcc6c568d-dqmvk" Mar 16 15:55:58 crc kubenswrapper[5120]: I0316 15:55:58.449431 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-barbican-internal-svc\"" Mar 16 15:55:58 crc kubenswrapper[5120]: I0316 15:55:58.450066 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-barbican-public-svc\"" Mar 16 15:55:58 crc kubenswrapper[5120]: I0316 15:55:58.506642 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ea0301d9-a692-4b65-ba34-5e989769d02c-public-tls-certs\") pod \"barbican-api-bcc6c568d-dqmvk\" (UID: \"ea0301d9-a692-4b65-ba34-5e989769d02c\") " pod="openstack-kuttl-tests/barbican-api-bcc6c568d-dqmvk" Mar 16 15:55:58 crc kubenswrapper[5120]: I0316 15:55:58.506706 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ea0301d9-a692-4b65-ba34-5e989769d02c-config-data\") pod \"barbican-api-bcc6c568d-dqmvk\" (UID: \"ea0301d9-a692-4b65-ba34-5e989769d02c\") " pod="openstack-kuttl-tests/barbican-api-bcc6c568d-dqmvk" Mar 16 15:55:58 crc kubenswrapper[5120]: I0316 15:55:58.506801 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ea0301d9-a692-4b65-ba34-5e989769d02c-logs\") pod \"barbican-api-bcc6c568d-dqmvk\" (UID: \"ea0301d9-a692-4b65-ba34-5e989769d02c\") " pod="openstack-kuttl-tests/barbican-api-bcc6c568d-dqmvk" Mar 16 15:55:58 crc kubenswrapper[5120]: I0316 15:55:58.506836 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzxkw\" (UniqueName: \"kubernetes.io/projected/ea0301d9-a692-4b65-ba34-5e989769d02c-kube-api-access-pzxkw\") pod \"barbican-api-bcc6c568d-dqmvk\" (UID: \"ea0301d9-a692-4b65-ba34-5e989769d02c\") " pod="openstack-kuttl-tests/barbican-api-bcc6c568d-dqmvk" Mar 16 15:55:58 crc kubenswrapper[5120]: I0316 15:55:58.506874 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ea0301d9-a692-4b65-ba34-5e989769d02c-combined-ca-bundle\") pod \"barbican-api-bcc6c568d-dqmvk\" (UID: \"ea0301d9-a692-4b65-ba34-5e989769d02c\") " pod="openstack-kuttl-tests/barbican-api-bcc6c568d-dqmvk" Mar 16 15:55:58 crc kubenswrapper[5120]: I0316 15:55:58.506906 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/ea0301d9-a692-4b65-ba34-5e989769d02c-config-data-custom\") pod \"barbican-api-bcc6c568d-dqmvk\" (UID: \"ea0301d9-a692-4b65-ba34-5e989769d02c\") " pod="openstack-kuttl-tests/barbican-api-bcc6c568d-dqmvk" Mar 16 15:55:58 crc kubenswrapper[5120]: I0316 15:55:58.506954 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/ea0301d9-a692-4b65-ba34-5e989769d02c-internal-tls-certs\") pod \"barbican-api-bcc6c568d-dqmvk\" (UID: \"ea0301d9-a692-4b65-ba34-5e989769d02c\") " pod="openstack-kuttl-tests/barbican-api-bcc6c568d-dqmvk" Mar 16 15:55:58 crc kubenswrapper[5120]: I0316 15:55:58.608710 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ea0301d9-a692-4b65-ba34-5e989769d02c-config-data\") pod \"barbican-api-bcc6c568d-dqmvk\" (UID: \"ea0301d9-a692-4b65-ba34-5e989769d02c\") " pod="openstack-kuttl-tests/barbican-api-bcc6c568d-dqmvk" Mar 16 15:55:58 crc kubenswrapper[5120]: I0316 15:55:58.608811 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ea0301d9-a692-4b65-ba34-5e989769d02c-logs\") pod \"barbican-api-bcc6c568d-dqmvk\" (UID: \"ea0301d9-a692-4b65-ba34-5e989769d02c\") " pod="openstack-kuttl-tests/barbican-api-bcc6c568d-dqmvk" Mar 16 15:55:58 crc kubenswrapper[5120]: I0316 15:55:58.608849 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pzxkw\" (UniqueName: \"kubernetes.io/projected/ea0301d9-a692-4b65-ba34-5e989769d02c-kube-api-access-pzxkw\") pod \"barbican-api-bcc6c568d-dqmvk\" (UID: \"ea0301d9-a692-4b65-ba34-5e989769d02c\") " pod="openstack-kuttl-tests/barbican-api-bcc6c568d-dqmvk" Mar 16 15:55:58 crc kubenswrapper[5120]: I0316 15:55:58.608889 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ea0301d9-a692-4b65-ba34-5e989769d02c-combined-ca-bundle\") pod \"barbican-api-bcc6c568d-dqmvk\" (UID: \"ea0301d9-a692-4b65-ba34-5e989769d02c\") " pod="openstack-kuttl-tests/barbican-api-bcc6c568d-dqmvk" Mar 16 15:55:58 crc kubenswrapper[5120]: I0316 15:55:58.608918 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/ea0301d9-a692-4b65-ba34-5e989769d02c-config-data-custom\") pod \"barbican-api-bcc6c568d-dqmvk\" (UID: \"ea0301d9-a692-4b65-ba34-5e989769d02c\") " pod="openstack-kuttl-tests/barbican-api-bcc6c568d-dqmvk" Mar 16 15:55:58 crc kubenswrapper[5120]: I0316 15:55:58.608965 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/ea0301d9-a692-4b65-ba34-5e989769d02c-internal-tls-certs\") pod \"barbican-api-bcc6c568d-dqmvk\" (UID: \"ea0301d9-a692-4b65-ba34-5e989769d02c\") " pod="openstack-kuttl-tests/barbican-api-bcc6c568d-dqmvk" Mar 16 15:55:58 crc kubenswrapper[5120]: I0316 15:55:58.609008 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ea0301d9-a692-4b65-ba34-5e989769d02c-public-tls-certs\") pod \"barbican-api-bcc6c568d-dqmvk\" (UID: \"ea0301d9-a692-4b65-ba34-5e989769d02c\") " pod="openstack-kuttl-tests/barbican-api-bcc6c568d-dqmvk" Mar 16 15:55:58 crc kubenswrapper[5120]: I0316 15:55:58.610607 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ea0301d9-a692-4b65-ba34-5e989769d02c-logs\") pod \"barbican-api-bcc6c568d-dqmvk\" (UID: \"ea0301d9-a692-4b65-ba34-5e989769d02c\") " pod="openstack-kuttl-tests/barbican-api-bcc6c568d-dqmvk" Mar 16 15:55:58 crc kubenswrapper[5120]: I0316 15:55:58.625542 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/ea0301d9-a692-4b65-ba34-5e989769d02c-config-data-custom\") pod \"barbican-api-bcc6c568d-dqmvk\" (UID: \"ea0301d9-a692-4b65-ba34-5e989769d02c\") " pod="openstack-kuttl-tests/barbican-api-bcc6c568d-dqmvk" Mar 16 15:55:58 crc kubenswrapper[5120]: I0316 15:55:58.627236 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ea0301d9-a692-4b65-ba34-5e989769d02c-config-data\") pod \"barbican-api-bcc6c568d-dqmvk\" (UID: \"ea0301d9-a692-4b65-ba34-5e989769d02c\") " pod="openstack-kuttl-tests/barbican-api-bcc6c568d-dqmvk" Mar 16 15:55:58 crc kubenswrapper[5120]: I0316 15:55:58.630323 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/ea0301d9-a692-4b65-ba34-5e989769d02c-internal-tls-certs\") pod \"barbican-api-bcc6c568d-dqmvk\" (UID: \"ea0301d9-a692-4b65-ba34-5e989769d02c\") " pod="openstack-kuttl-tests/barbican-api-bcc6c568d-dqmvk" Mar 16 15:55:58 crc kubenswrapper[5120]: I0316 15:55:58.632260 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ea0301d9-a692-4b65-ba34-5e989769d02c-public-tls-certs\") pod \"barbican-api-bcc6c568d-dqmvk\" (UID: \"ea0301d9-a692-4b65-ba34-5e989769d02c\") " pod="openstack-kuttl-tests/barbican-api-bcc6c568d-dqmvk" Mar 16 15:55:58 crc kubenswrapper[5120]: I0316 15:55:58.632751 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ea0301d9-a692-4b65-ba34-5e989769d02c-combined-ca-bundle\") pod \"barbican-api-bcc6c568d-dqmvk\" (UID: \"ea0301d9-a692-4b65-ba34-5e989769d02c\") " pod="openstack-kuttl-tests/barbican-api-bcc6c568d-dqmvk" Mar 16 15:55:58 crc kubenswrapper[5120]: I0316 15:55:58.636414 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzxkw\" (UniqueName: \"kubernetes.io/projected/ea0301d9-a692-4b65-ba34-5e989769d02c-kube-api-access-pzxkw\") pod \"barbican-api-bcc6c568d-dqmvk\" (UID: \"ea0301d9-a692-4b65-ba34-5e989769d02c\") " pod="openstack-kuttl-tests/barbican-api-bcc6c568d-dqmvk" Mar 16 15:55:58 crc kubenswrapper[5120]: I0316 15:55:58.763293 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-54b7655659-bqszk"] Mar 16 15:55:58 crc kubenswrapper[5120]: W0316 15:55:58.774192 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfc59410f_18f6_4de8_b0f9_d54fcaea8faf.slice/crio-bc3d9ee90383e169311bab2848e8c2a98dd69ab3a71700c42f9b8ba57378c698 WatchSource:0}: Error finding container bc3d9ee90383e169311bab2848e8c2a98dd69ab3a71700c42f9b8ba57378c698: Status 404 returned error can't find the container with id bc3d9ee90383e169311bab2848e8c2a98dd69ab3a71700c42f9b8ba57378c698 Mar 16 15:55:58 crc kubenswrapper[5120]: I0316 15:55:58.776478 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-bcc6c568d-dqmvk" Mar 16 15:55:58 crc kubenswrapper[5120]: I0316 15:55:58.875749 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-667d795786-lqmct"] Mar 16 15:55:58 crc kubenswrapper[5120]: I0316 15:55:58.895802 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-85c489687d-pcp6w"] Mar 16 15:55:58 crc kubenswrapper[5120]: I0316 15:55:58.943330 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"9f58e7c4-539f-4659-814c-9c8808d4c367","Type":"ContainerStarted","Data":"75d258dc4e86109b830c0e12b72a61aacdc0ced7c244ce27afd3fbb410c0eb73"} Mar 16 15:55:58 crc kubenswrapper[5120]: I0316 15:55:58.986285 5120 generic.go:358] "Generic (PLEG): container finished" podID="8cc8a233-a88b-4b25-8d7c-ababfa869d4e" containerID="24ae3f9047f0356b23ac81475c2fd9f3953de44ce12ba4a3d6049c5f288c0b46" exitCode=0 Mar 16 15:55:58 crc kubenswrapper[5120]: I0316 15:55:58.986317 5120 generic.go:358] "Generic (PLEG): container finished" podID="8cc8a233-a88b-4b25-8d7c-ababfa869d4e" containerID="346dd3de73c7983bc158ca5c13d4c09ab4ea91180ceca406d1327ce4bddcb95c" exitCode=2 Mar 16 15:55:58 crc kubenswrapper[5120]: I0316 15:55:58.986483 5120 generic.go:358] "Generic (PLEG): container finished" podID="8cc8a233-a88b-4b25-8d7c-ababfa869d4e" containerID="5b69c283319516f4ab1c5820d28054eda0c8b9a982948475472346c8c9ae1404" exitCode=0 Mar 16 15:55:58 crc kubenswrapper[5120]: I0316 15:55:58.986490 5120 generic.go:358] "Generic (PLEG): container finished" podID="8cc8a233-a88b-4b25-8d7c-ababfa869d4e" containerID="74559f495137d72a82a0793c5af59e943c6b52dc27889b1421c3cb038e83d522" exitCode=0 Mar 16 15:55:58 crc kubenswrapper[5120]: I0316 15:55:58.986837 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"8cc8a233-a88b-4b25-8d7c-ababfa869d4e","Type":"ContainerDied","Data":"24ae3f9047f0356b23ac81475c2fd9f3953de44ce12ba4a3d6049c5f288c0b46"} Mar 16 15:55:58 crc kubenswrapper[5120]: I0316 15:55:58.986872 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"8cc8a233-a88b-4b25-8d7c-ababfa869d4e","Type":"ContainerDied","Data":"346dd3de73c7983bc158ca5c13d4c09ab4ea91180ceca406d1327ce4bddcb95c"} Mar 16 15:55:58 crc kubenswrapper[5120]: I0316 15:55:58.986893 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"8cc8a233-a88b-4b25-8d7c-ababfa869d4e","Type":"ContainerDied","Data":"5b69c283319516f4ab1c5820d28054eda0c8b9a982948475472346c8c9ae1404"} Mar 16 15:55:58 crc kubenswrapper[5120]: I0316 15:55:58.986901 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"8cc8a233-a88b-4b25-8d7c-ababfa869d4e","Type":"ContainerDied","Data":"74559f495137d72a82a0793c5af59e943c6b52dc27889b1421c3cb038e83d522"} Mar 16 15:55:59 crc kubenswrapper[5120]: I0316 15:55:59.002496 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-54b7655659-bqszk" event={"ID":"fc59410f-18f6-4de8-b0f9-d54fcaea8faf","Type":"ContainerStarted","Data":"bc3d9ee90383e169311bab2848e8c2a98dd69ab3a71700c42f9b8ba57378c698"} Mar 16 15:55:59 crc kubenswrapper[5120]: I0316 15:55:59.003669 5120 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Mar 16 15:55:59 crc kubenswrapper[5120]: I0316 15:55:59.004549 5120 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Mar 16 15:55:59 crc kubenswrapper[5120]: I0316 15:55:59.004573 5120 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Mar 16 15:55:59 crc kubenswrapper[5120]: I0316 15:55:59.006443 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:55:59 crc kubenswrapper[5120]: I0316 15:55:59.158272 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8cc8a233-a88b-4b25-8d7c-ababfa869d4e-config-data\") pod \"8cc8a233-a88b-4b25-8d7c-ababfa869d4e\" (UID: \"8cc8a233-a88b-4b25-8d7c-ababfa869d4e\") " Mar 16 15:55:59 crc kubenswrapper[5120]: I0316 15:55:59.158913 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/8cc8a233-a88b-4b25-8d7c-ababfa869d4e-log-httpd\") pod \"8cc8a233-a88b-4b25-8d7c-ababfa869d4e\" (UID: \"8cc8a233-a88b-4b25-8d7c-ababfa869d4e\") " Mar 16 15:55:59 crc kubenswrapper[5120]: I0316 15:55:59.160235 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8cc8a233-a88b-4b25-8d7c-ababfa869d4e-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "8cc8a233-a88b-4b25-8d7c-ababfa869d4e" (UID: "8cc8a233-a88b-4b25-8d7c-ababfa869d4e"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:55:59 crc kubenswrapper[5120]: I0316 15:55:59.160303 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8cc8a233-a88b-4b25-8d7c-ababfa869d4e-scripts\") pod \"8cc8a233-a88b-4b25-8d7c-ababfa869d4e\" (UID: \"8cc8a233-a88b-4b25-8d7c-ababfa869d4e\") " Mar 16 15:55:59 crc kubenswrapper[5120]: I0316 15:55:59.160817 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/8cc8a233-a88b-4b25-8d7c-ababfa869d4e-run-httpd\") pod \"8cc8a233-a88b-4b25-8d7c-ababfa869d4e\" (UID: \"8cc8a233-a88b-4b25-8d7c-ababfa869d4e\") " Mar 16 15:55:59 crc kubenswrapper[5120]: I0316 15:55:59.161091 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8cc8a233-a88b-4b25-8d7c-ababfa869d4e-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "8cc8a233-a88b-4b25-8d7c-ababfa869d4e" (UID: "8cc8a233-a88b-4b25-8d7c-ababfa869d4e"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:55:59 crc kubenswrapper[5120]: I0316 15:55:59.161131 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8cc8a233-a88b-4b25-8d7c-ababfa869d4e-combined-ca-bundle\") pod \"8cc8a233-a88b-4b25-8d7c-ababfa869d4e\" (UID: \"8cc8a233-a88b-4b25-8d7c-ababfa869d4e\") " Mar 16 15:55:59 crc kubenswrapper[5120]: I0316 15:55:59.161726 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/8cc8a233-a88b-4b25-8d7c-ababfa869d4e-sg-core-conf-yaml\") pod \"8cc8a233-a88b-4b25-8d7c-ababfa869d4e\" (UID: \"8cc8a233-a88b-4b25-8d7c-ababfa869d4e\") " Mar 16 15:55:59 crc kubenswrapper[5120]: I0316 15:55:59.161787 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cj4vq\" (UniqueName: \"kubernetes.io/projected/8cc8a233-a88b-4b25-8d7c-ababfa869d4e-kube-api-access-cj4vq\") pod \"8cc8a233-a88b-4b25-8d7c-ababfa869d4e\" (UID: \"8cc8a233-a88b-4b25-8d7c-ababfa869d4e\") " Mar 16 15:55:59 crc kubenswrapper[5120]: I0316 15:55:59.169262 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8cc8a233-a88b-4b25-8d7c-ababfa869d4e-scripts" (OuterVolumeSpecName: "scripts") pod "8cc8a233-a88b-4b25-8d7c-ababfa869d4e" (UID: "8cc8a233-a88b-4b25-8d7c-ababfa869d4e"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:55:59 crc kubenswrapper[5120]: I0316 15:55:59.171029 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/8cc8a233-a88b-4b25-8d7c-ababfa869d4e-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 15:55:59 crc kubenswrapper[5120]: I0316 15:55:59.171058 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8cc8a233-a88b-4b25-8d7c-ababfa869d4e-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 15:55:59 crc kubenswrapper[5120]: I0316 15:55:59.171066 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/8cc8a233-a88b-4b25-8d7c-ababfa869d4e-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 15:55:59 crc kubenswrapper[5120]: I0316 15:55:59.179990 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8cc8a233-a88b-4b25-8d7c-ababfa869d4e-kube-api-access-cj4vq" (OuterVolumeSpecName: "kube-api-access-cj4vq") pod "8cc8a233-a88b-4b25-8d7c-ababfa869d4e" (UID: "8cc8a233-a88b-4b25-8d7c-ababfa869d4e"). InnerVolumeSpecName "kube-api-access-cj4vq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:55:59 crc kubenswrapper[5120]: I0316 15:55:59.180899 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:55:59 crc kubenswrapper[5120]: I0316 15:55:59.187385 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:55:59 crc kubenswrapper[5120]: I0316 15:55:59.213348 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8cc8a233-a88b-4b25-8d7c-ababfa869d4e-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "8cc8a233-a88b-4b25-8d7c-ababfa869d4e" (UID: "8cc8a233-a88b-4b25-8d7c-ababfa869d4e"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:55:59 crc kubenswrapper[5120]: I0316 15:55:59.278513 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/8cc8a233-a88b-4b25-8d7c-ababfa869d4e-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 15:55:59 crc kubenswrapper[5120]: I0316 15:55:59.278539 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cj4vq\" (UniqueName: \"kubernetes.io/projected/8cc8a233-a88b-4b25-8d7c-ababfa869d4e-kube-api-access-cj4vq\") on node \"crc\" DevicePath \"\"" Mar 16 15:55:59 crc kubenswrapper[5120]: I0316 15:55:59.307661 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8cc8a233-a88b-4b25-8d7c-ababfa869d4e-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "8cc8a233-a88b-4b25-8d7c-ababfa869d4e" (UID: "8cc8a233-a88b-4b25-8d7c-ababfa869d4e"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:55:59 crc kubenswrapper[5120]: I0316 15:55:59.339806 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-bcc6c568d-dqmvk"] Mar 16 15:55:59 crc kubenswrapper[5120]: I0316 15:55:59.379495 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8cc8a233-a88b-4b25-8d7c-ababfa869d4e-config-data" (OuterVolumeSpecName: "config-data") pod "8cc8a233-a88b-4b25-8d7c-ababfa869d4e" (UID: "8cc8a233-a88b-4b25-8d7c-ababfa869d4e"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:55:59 crc kubenswrapper[5120]: I0316 15:55:59.380718 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8cc8a233-a88b-4b25-8d7c-ababfa869d4e-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:55:59 crc kubenswrapper[5120]: I0316 15:55:59.380741 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8cc8a233-a88b-4b25-8d7c-ababfa869d4e-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 15:55:59 crc kubenswrapper[5120]: I0316 15:55:59.422924 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:55:59 crc kubenswrapper[5120]: I0316 15:55:59.438219 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:56:00 crc kubenswrapper[5120]: I0316 15:56:00.012183 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"9f58e7c4-539f-4659-814c-9c8808d4c367","Type":"ContainerStarted","Data":"a7e328cce31da34640b5261adeacdb3ac46c3fb3716817499cd5d61825eb06d3"} Mar 16 15:56:00 crc kubenswrapper[5120]: I0316 15:56:00.012438 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:56:00 crc kubenswrapper[5120]: I0316 15:56:00.015175 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-85c489687d-pcp6w" event={"ID":"b3794e20-01dd-453a-bf29-20813144c61b","Type":"ContainerStarted","Data":"755cfaa0ce8ac81606545022847fbe8cfb9de5f7c904952f36310b83f8c76f03"} Mar 16 15:56:00 crc kubenswrapper[5120]: I0316 15:56:00.015216 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-85c489687d-pcp6w" event={"ID":"b3794e20-01dd-453a-bf29-20813144c61b","Type":"ContainerStarted","Data":"8e8fbd7afb6b4def81fe53673306c45558e83d21c714994987a7ead7c9d14080"} Mar 16 15:56:00 crc kubenswrapper[5120]: I0316 15:56:00.015230 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-85c489687d-pcp6w" event={"ID":"b3794e20-01dd-453a-bf29-20813144c61b","Type":"ContainerStarted","Data":"d0ffe74e15846dc8019dc25951b10463d14ad4f2086dee46d2e7c1967b648ba0"} Mar 16 15:56:00 crc kubenswrapper[5120]: I0316 15:56:00.022056 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"8cc8a233-a88b-4b25-8d7c-ababfa869d4e","Type":"ContainerDied","Data":"057b6e75980407dea501b83ca0be81cdfe54eda2fc860f27c21cfc4c218c53e4"} Mar 16 15:56:00 crc kubenswrapper[5120]: I0316 15:56:00.022107 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:56:00 crc kubenswrapper[5120]: I0316 15:56:00.022113 5120 scope.go:117] "RemoveContainer" containerID="24ae3f9047f0356b23ac81475c2fd9f3953de44ce12ba4a3d6049c5f288c0b46" Mar 16 15:56:00 crc kubenswrapper[5120]: I0316 15:56:00.030739 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-bcc6c568d-dqmvk" event={"ID":"ea0301d9-a692-4b65-ba34-5e989769d02c","Type":"ContainerStarted","Data":"8b21d045c26ecdd9743611e46a46a194f9882c136e56843ba91195604f46f37b"} Mar 16 15:56:00 crc kubenswrapper[5120]: I0316 15:56:00.030791 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-bcc6c568d-dqmvk" event={"ID":"ea0301d9-a692-4b65-ba34-5e989769d02c","Type":"ContainerStarted","Data":"586bc7a04e27dd8d1aa0558b163f524487e412f155988226de43eca06d6c8b1e"} Mar 16 15:56:00 crc kubenswrapper[5120]: I0316 15:56:00.030835 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-bcc6c568d-dqmvk" event={"ID":"ea0301d9-a692-4b65-ba34-5e989769d02c","Type":"ContainerStarted","Data":"855b06c0e5597c565ead6ba176754161b528a634a29ad57bb0f14843391f80f1"} Mar 16 15:56:00 crc kubenswrapper[5120]: I0316 15:56:00.031096 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-bcc6c568d-dqmvk" Mar 16 15:56:00 crc kubenswrapper[5120]: I0316 15:56:00.031111 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-bcc6c568d-dqmvk" Mar 16 15:56:00 crc kubenswrapper[5120]: I0316 15:56:00.041527 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-667d795786-lqmct" podUID="e08f7127-ac46-4cf0-a1ae-d02c51cc94ee" containerName="barbican-api-log" containerID="cri-o://673076ce0d080e172baca7581fa254a91105e30ba00a678393ed10473914f8f8" gracePeriod=30 Mar 16 15:56:00 crc kubenswrapper[5120]: I0316 15:56:00.041857 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-667d795786-lqmct" event={"ID":"e08f7127-ac46-4cf0-a1ae-d02c51cc94ee","Type":"ContainerStarted","Data":"7302f84efdd87cc78b861aadcec53883f89749fbfad533396eda58332d168460"} Mar 16 15:56:00 crc kubenswrapper[5120]: I0316 15:56:00.041888 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-667d795786-lqmct" event={"ID":"e08f7127-ac46-4cf0-a1ae-d02c51cc94ee","Type":"ContainerStarted","Data":"673076ce0d080e172baca7581fa254a91105e30ba00a678393ed10473914f8f8"} Mar 16 15:56:00 crc kubenswrapper[5120]: I0316 15:56:00.041901 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-667d795786-lqmct" event={"ID":"e08f7127-ac46-4cf0-a1ae-d02c51cc94ee","Type":"ContainerStarted","Data":"084648ae27e7dfe3802768300daddcd283b8f98c410f5cec2524c00b696c2d7e"} Mar 16 15:56:00 crc kubenswrapper[5120]: I0316 15:56:00.041935 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-667d795786-lqmct" Mar 16 15:56:00 crc kubenswrapper[5120]: I0316 15:56:00.041962 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-667d795786-lqmct" Mar 16 15:56:00 crc kubenswrapper[5120]: I0316 15:56:00.042010 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-667d795786-lqmct" podUID="e08f7127-ac46-4cf0-a1ae-d02c51cc94ee" containerName="barbican-api" containerID="cri-o://7302f84efdd87cc78b861aadcec53883f89749fbfad533396eda58332d168460" gracePeriod=30 Mar 16 15:56:00 crc kubenswrapper[5120]: I0316 15:56:00.042498 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-api-0" podStartSLOduration=4.042484052 podStartE2EDuration="4.042484052s" podCreationTimestamp="2026-03-16 15:55:56 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:56:00.041392822 +0000 UTC m=+1462.195324479" watchObservedRunningTime="2026-03-16 15:56:00.042484052 +0000 UTC m=+1462.196415709" Mar 16 15:56:00 crc kubenswrapper[5120]: I0316 15:56:00.069982 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-api-667d795786-lqmct" podStartSLOduration=3.06986954 podStartE2EDuration="3.06986954s" podCreationTimestamp="2026-03-16 15:55:57 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:56:00.065377666 +0000 UTC m=+1462.219309343" watchObservedRunningTime="2026-03-16 15:56:00.06986954 +0000 UTC m=+1462.223801197" Mar 16 15:56:00 crc kubenswrapper[5120]: I0316 15:56:00.073171 5120 scope.go:117] "RemoveContainer" containerID="346dd3de73c7983bc158ca5c13d4c09ab4ea91180ceca406d1327ce4bddcb95c" Mar 16 15:56:00 crc kubenswrapper[5120]: I0316 15:56:00.073319 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-54b7655659-bqszk" event={"ID":"fc59410f-18f6-4de8-b0f9-d54fcaea8faf","Type":"ContainerStarted","Data":"a6fa07bc0f02cb03d8fcdf8ab981b8a547194306c2f75b1a463d7c6f09841cdf"} Mar 16 15:56:00 crc kubenswrapper[5120]: I0316 15:56:00.073356 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-54b7655659-bqszk" event={"ID":"fc59410f-18f6-4de8-b0f9-d54fcaea8faf","Type":"ContainerStarted","Data":"1776e0f291f7fa8432d2e5511c3d988212237dc71753bffedc712fbe9bb9ab04"} Mar 16 15:56:00 crc kubenswrapper[5120]: I0316 15:56:00.097848 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-keystone-listener-85c489687d-pcp6w" podStartSLOduration=3.097831564 podStartE2EDuration="3.097831564s" podCreationTimestamp="2026-03-16 15:55:57 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:56:00.097317541 +0000 UTC m=+1462.251249198" watchObservedRunningTime="2026-03-16 15:56:00.097831564 +0000 UTC m=+1462.251763221" Mar 16 15:56:00 crc kubenswrapper[5120]: I0316 15:56:00.162302 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-dc8f675f4-72f6q"] Mar 16 15:56:00 crc kubenswrapper[5120]: I0316 15:56:00.162854 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-dc8f675f4-72f6q" podUID="9da74618-45dc-4a60-8f6a-dfb9c30cb13a" containerName="barbican-keystone-listener" containerID="cri-o://8d924281be01f8bf7c744f0b2244d69b2636a7cad3a82bf98a97ff4b35a10f9f" gracePeriod=30 Mar 16 15:56:00 crc kubenswrapper[5120]: I0316 15:56:00.164824 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-dc8f675f4-72f6q" podUID="9da74618-45dc-4a60-8f6a-dfb9c30cb13a" containerName="barbican-keystone-listener-log" containerID="cri-o://70ce6108fc29a7144fbd66baa8ec206ddbc3b451583661f15f61171c9523ee30" gracePeriod=30 Mar 16 15:56:00 crc kubenswrapper[5120]: I0316 15:56:00.215668 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 15:56:00 crc kubenswrapper[5120]: I0316 15:56:00.237326 5120 scope.go:117] "RemoveContainer" containerID="5b69c283319516f4ab1c5820d28054eda0c8b9a982948475472346c8c9ae1404" Mar 16 15:56:00 crc kubenswrapper[5120]: I0316 15:56:00.248288 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 15:56:00 crc kubenswrapper[5120]: I0316 15:56:00.264047 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-infra/auto-csr-approver-29561276-zt964"] Mar 16 15:56:00 crc kubenswrapper[5120]: I0316 15:56:00.270970 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8cc8a233-a88b-4b25-8d7c-ababfa869d4e" containerName="sg-core" Mar 16 15:56:00 crc kubenswrapper[5120]: I0316 15:56:00.271005 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8cc8a233-a88b-4b25-8d7c-ababfa869d4e" containerName="sg-core" Mar 16 15:56:00 crc kubenswrapper[5120]: I0316 15:56:00.271015 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8cc8a233-a88b-4b25-8d7c-ababfa869d4e" containerName="ceilometer-notification-agent" Mar 16 15:56:00 crc kubenswrapper[5120]: I0316 15:56:00.271023 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8cc8a233-a88b-4b25-8d7c-ababfa869d4e" containerName="ceilometer-notification-agent" Mar 16 15:56:00 crc kubenswrapper[5120]: I0316 15:56:00.271070 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8cc8a233-a88b-4b25-8d7c-ababfa869d4e" containerName="ceilometer-central-agent" Mar 16 15:56:00 crc kubenswrapper[5120]: I0316 15:56:00.271076 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8cc8a233-a88b-4b25-8d7c-ababfa869d4e" containerName="ceilometer-central-agent" Mar 16 15:56:00 crc kubenswrapper[5120]: I0316 15:56:00.271103 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8cc8a233-a88b-4b25-8d7c-ababfa869d4e" containerName="proxy-httpd" Mar 16 15:56:00 crc kubenswrapper[5120]: I0316 15:56:00.271108 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8cc8a233-a88b-4b25-8d7c-ababfa869d4e" containerName="proxy-httpd" Mar 16 15:56:00 crc kubenswrapper[5120]: I0316 15:56:00.271248 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="8cc8a233-a88b-4b25-8d7c-ababfa869d4e" containerName="ceilometer-notification-agent" Mar 16 15:56:00 crc kubenswrapper[5120]: I0316 15:56:00.271263 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="8cc8a233-a88b-4b25-8d7c-ababfa869d4e" containerName="sg-core" Mar 16 15:56:00 crc kubenswrapper[5120]: I0316 15:56:00.271276 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="8cc8a233-a88b-4b25-8d7c-ababfa869d4e" containerName="ceilometer-central-agent" Mar 16 15:56:00 crc kubenswrapper[5120]: I0316 15:56:00.271289 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="8cc8a233-a88b-4b25-8d7c-ababfa869d4e" containerName="proxy-httpd" Mar 16 15:56:00 crc kubenswrapper[5120]: I0316 15:56:00.276114 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561276-zt964" Mar 16 15:56:00 crc kubenswrapper[5120]: I0316 15:56:00.278396 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-infra\"/\"csr-approver-sa-dockercfg-x2nsz\"" Mar 16 15:56:00 crc kubenswrapper[5120]: I0316 15:56:00.278633 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"openshift-service-ca.crt\"" Mar 16 15:56:00 crc kubenswrapper[5120]: I0316 15:56:00.278775 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"kube-root-ca.crt\"" Mar 16 15:56:00 crc kubenswrapper[5120]: I0316 15:56:00.307318 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561276-zt964"] Mar 16 15:56:00 crc kubenswrapper[5120]: I0316 15:56:00.307414 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 15:56:00 crc kubenswrapper[5120]: I0316 15:56:00.307798 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-api-bcc6c568d-dqmvk" podStartSLOduration=2.30777847 podStartE2EDuration="2.30777847s" podCreationTimestamp="2026-03-16 15:55:58 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:56:00.155273425 +0000 UTC m=+1462.309205082" watchObservedRunningTime="2026-03-16 15:56:00.30777847 +0000 UTC m=+1462.461710127" Mar 16 15:56:00 crc kubenswrapper[5120]: I0316 15:56:00.309122 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgbg2\" (UniqueName: \"kubernetes.io/projected/f827667b-46fd-4fdf-a29f-5215aff12388-kube-api-access-zgbg2\") pod \"auto-csr-approver-29561276-zt964\" (UID: \"f827667b-46fd-4fdf-a29f-5215aff12388\") " pod="openshift-infra/auto-csr-approver-29561276-zt964" Mar 16 15:56:00 crc kubenswrapper[5120]: I0316 15:56:00.323300 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 15:56:00 crc kubenswrapper[5120]: I0316 15:56:00.342067 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 15:56:00 crc kubenswrapper[5120]: I0316 15:56:00.342261 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:56:00 crc kubenswrapper[5120]: I0316 15:56:00.345747 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 15:56:00 crc kubenswrapper[5120]: I0316 15:56:00.345832 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 15:56:00 crc kubenswrapper[5120]: I0316 15:56:00.361051 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-worker-54b7655659-bqszk" podStartSLOduration=3.361023214 podStartE2EDuration="3.361023214s" podCreationTimestamp="2026-03-16 15:55:57 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:56:00.213227781 +0000 UTC m=+1462.367159438" watchObservedRunningTime="2026-03-16 15:56:00.361023214 +0000 UTC m=+1462.514954871" Mar 16 15:56:00 crc kubenswrapper[5120]: I0316 15:56:00.373911 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-f5857446c-9l89n"] Mar 16 15:56:00 crc kubenswrapper[5120]: I0316 15:56:00.374155 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-f5857446c-9l89n" podUID="26088cd7-dfce-4ccd-b93e-87a82505e96d" containerName="barbican-worker-log" containerID="cri-o://29420b5fed586139ace73e358b1045da617160601f178ed63399faccf034c239" gracePeriod=30 Mar 16 15:56:00 crc kubenswrapper[5120]: I0316 15:56:00.374609 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-f5857446c-9l89n" podUID="26088cd7-dfce-4ccd-b93e-87a82505e96d" containerName="barbican-worker" containerID="cri-o://ddb032fc80332b70af942970475d083b2c36a89ec806a69547e2c9f2f11348c4" gracePeriod=30 Mar 16 15:56:00 crc kubenswrapper[5120]: I0316 15:56:00.379952 5120 scope.go:117] "RemoveContainer" containerID="74559f495137d72a82a0793c5af59e943c6b52dc27889b1421c3cb038e83d522" Mar 16 15:56:00 crc kubenswrapper[5120]: I0316 15:56:00.400604 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 15:56:00 crc kubenswrapper[5120]: I0316 15:56:00.411106 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zgbg2\" (UniqueName: \"kubernetes.io/projected/f827667b-46fd-4fdf-a29f-5215aff12388-kube-api-access-zgbg2\") pod \"auto-csr-approver-29561276-zt964\" (UID: \"f827667b-46fd-4fdf-a29f-5215aff12388\") " pod="openshift-infra/auto-csr-approver-29561276-zt964" Mar 16 15:56:00 crc kubenswrapper[5120]: I0316 15:56:00.411166 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c841556f-1fa5-4d42-9793-f0887efc2f51-log-httpd\") pod \"ceilometer-0\" (UID: \"c841556f-1fa5-4d42-9793-f0887efc2f51\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:56:00 crc kubenswrapper[5120]: I0316 15:56:00.411208 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c841556f-1fa5-4d42-9793-f0887efc2f51-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"c841556f-1fa5-4d42-9793-f0887efc2f51\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:56:00 crc kubenswrapper[5120]: I0316 15:56:00.411237 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c841556f-1fa5-4d42-9793-f0887efc2f51-config-data\") pod \"ceilometer-0\" (UID: \"c841556f-1fa5-4d42-9793-f0887efc2f51\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:56:00 crc kubenswrapper[5120]: I0316 15:56:00.411294 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/c841556f-1fa5-4d42-9793-f0887efc2f51-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"c841556f-1fa5-4d42-9793-f0887efc2f51\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:56:00 crc kubenswrapper[5120]: I0316 15:56:00.411322 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c841556f-1fa5-4d42-9793-f0887efc2f51-run-httpd\") pod \"ceilometer-0\" (UID: \"c841556f-1fa5-4d42-9793-f0887efc2f51\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:56:00 crc kubenswrapper[5120]: I0316 15:56:00.411484 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghmr9\" (UniqueName: \"kubernetes.io/projected/c841556f-1fa5-4d42-9793-f0887efc2f51-kube-api-access-ghmr9\") pod \"ceilometer-0\" (UID: \"c841556f-1fa5-4d42-9793-f0887efc2f51\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:56:00 crc kubenswrapper[5120]: I0316 15:56:00.411534 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c841556f-1fa5-4d42-9793-f0887efc2f51-scripts\") pod \"ceilometer-0\" (UID: \"c841556f-1fa5-4d42-9793-f0887efc2f51\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:56:00 crc kubenswrapper[5120]: I0316 15:56:00.439451 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgbg2\" (UniqueName: \"kubernetes.io/projected/f827667b-46fd-4fdf-a29f-5215aff12388-kube-api-access-zgbg2\") pod \"auto-csr-approver-29561276-zt964\" (UID: \"f827667b-46fd-4fdf-a29f-5215aff12388\") " pod="openshift-infra/auto-csr-approver-29561276-zt964" Mar 16 15:56:00 crc kubenswrapper[5120]: I0316 15:56:00.513143 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c841556f-1fa5-4d42-9793-f0887efc2f51-log-httpd\") pod \"ceilometer-0\" (UID: \"c841556f-1fa5-4d42-9793-f0887efc2f51\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:56:00 crc kubenswrapper[5120]: I0316 15:56:00.513194 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c841556f-1fa5-4d42-9793-f0887efc2f51-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"c841556f-1fa5-4d42-9793-f0887efc2f51\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:56:00 crc kubenswrapper[5120]: I0316 15:56:00.513217 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c841556f-1fa5-4d42-9793-f0887efc2f51-config-data\") pod \"ceilometer-0\" (UID: \"c841556f-1fa5-4d42-9793-f0887efc2f51\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:56:00 crc kubenswrapper[5120]: I0316 15:56:00.513262 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/c841556f-1fa5-4d42-9793-f0887efc2f51-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"c841556f-1fa5-4d42-9793-f0887efc2f51\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:56:00 crc kubenswrapper[5120]: I0316 15:56:00.513279 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c841556f-1fa5-4d42-9793-f0887efc2f51-run-httpd\") pod \"ceilometer-0\" (UID: \"c841556f-1fa5-4d42-9793-f0887efc2f51\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:56:00 crc kubenswrapper[5120]: I0316 15:56:00.513368 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ghmr9\" (UniqueName: \"kubernetes.io/projected/c841556f-1fa5-4d42-9793-f0887efc2f51-kube-api-access-ghmr9\") pod \"ceilometer-0\" (UID: \"c841556f-1fa5-4d42-9793-f0887efc2f51\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:56:00 crc kubenswrapper[5120]: I0316 15:56:00.513397 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c841556f-1fa5-4d42-9793-f0887efc2f51-scripts\") pod \"ceilometer-0\" (UID: \"c841556f-1fa5-4d42-9793-f0887efc2f51\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:56:00 crc kubenswrapper[5120]: I0316 15:56:00.514738 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c841556f-1fa5-4d42-9793-f0887efc2f51-log-httpd\") pod \"ceilometer-0\" (UID: \"c841556f-1fa5-4d42-9793-f0887efc2f51\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:56:00 crc kubenswrapper[5120]: I0316 15:56:00.515147 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c841556f-1fa5-4d42-9793-f0887efc2f51-run-httpd\") pod \"ceilometer-0\" (UID: \"c841556f-1fa5-4d42-9793-f0887efc2f51\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:56:00 crc kubenswrapper[5120]: I0316 15:56:00.522680 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c841556f-1fa5-4d42-9793-f0887efc2f51-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"c841556f-1fa5-4d42-9793-f0887efc2f51\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:56:00 crc kubenswrapper[5120]: I0316 15:56:00.522902 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c841556f-1fa5-4d42-9793-f0887efc2f51-config-data\") pod \"ceilometer-0\" (UID: \"c841556f-1fa5-4d42-9793-f0887efc2f51\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:56:00 crc kubenswrapper[5120]: I0316 15:56:00.523326 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/c841556f-1fa5-4d42-9793-f0887efc2f51-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"c841556f-1fa5-4d42-9793-f0887efc2f51\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:56:00 crc kubenswrapper[5120]: I0316 15:56:00.530710 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c841556f-1fa5-4d42-9793-f0887efc2f51-scripts\") pod \"ceilometer-0\" (UID: \"c841556f-1fa5-4d42-9793-f0887efc2f51\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:56:00 crc kubenswrapper[5120]: I0316 15:56:00.534114 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghmr9\" (UniqueName: \"kubernetes.io/projected/c841556f-1fa5-4d42-9793-f0887efc2f51-kube-api-access-ghmr9\") pod \"ceilometer-0\" (UID: \"c841556f-1fa5-4d42-9793-f0887efc2f51\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:56:00 crc kubenswrapper[5120]: I0316 15:56:00.571253 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 15:56:00 crc kubenswrapper[5120]: I0316 15:56:00.650325 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561276-zt964" Mar 16 15:56:00 crc kubenswrapper[5120]: I0316 15:56:00.666849 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:56:00 crc kubenswrapper[5120]: I0316 15:56:00.707833 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8cc8a233-a88b-4b25-8d7c-ababfa869d4e" path="/var/lib/kubelet/pods/8cc8a233-a88b-4b25-8d7c-ababfa869d4e/volumes" Mar 16 15:56:00 crc kubenswrapper[5120]: I0316 15:56:00.794988 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-operators-52mmv"] Mar 16 15:56:00 crc kubenswrapper[5120]: I0316 15:56:00.803890 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-52mmv" Mar 16 15:56:00 crc kubenswrapper[5120]: I0316 15:56:00.840462 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-52mmv"] Mar 16 15:56:00 crc kubenswrapper[5120]: I0316 15:56:00.922382 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/9b651009-4b48-4a98-a27e-71239d09da8a-catalog-content\") pod \"redhat-operators-52mmv\" (UID: \"9b651009-4b48-4a98-a27e-71239d09da8a\") " pod="openshift-marketplace/redhat-operators-52mmv" Mar 16 15:56:00 crc kubenswrapper[5120]: I0316 15:56:00.922466 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mlnvm\" (UniqueName: \"kubernetes.io/projected/9b651009-4b48-4a98-a27e-71239d09da8a-kube-api-access-mlnvm\") pod \"redhat-operators-52mmv\" (UID: \"9b651009-4b48-4a98-a27e-71239d09da8a\") " pod="openshift-marketplace/redhat-operators-52mmv" Mar 16 15:56:00 crc kubenswrapper[5120]: I0316 15:56:00.922546 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/9b651009-4b48-4a98-a27e-71239d09da8a-utilities\") pod \"redhat-operators-52mmv\" (UID: \"9b651009-4b48-4a98-a27e-71239d09da8a\") " pod="openshift-marketplace/redhat-operators-52mmv" Mar 16 15:56:01 crc kubenswrapper[5120]: I0316 15:56:01.024690 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/9b651009-4b48-4a98-a27e-71239d09da8a-catalog-content\") pod \"redhat-operators-52mmv\" (UID: \"9b651009-4b48-4a98-a27e-71239d09da8a\") " pod="openshift-marketplace/redhat-operators-52mmv" Mar 16 15:56:01 crc kubenswrapper[5120]: I0316 15:56:01.025052 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mlnvm\" (UniqueName: \"kubernetes.io/projected/9b651009-4b48-4a98-a27e-71239d09da8a-kube-api-access-mlnvm\") pod \"redhat-operators-52mmv\" (UID: \"9b651009-4b48-4a98-a27e-71239d09da8a\") " pod="openshift-marketplace/redhat-operators-52mmv" Mar 16 15:56:01 crc kubenswrapper[5120]: I0316 15:56:01.025162 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/9b651009-4b48-4a98-a27e-71239d09da8a-utilities\") pod \"redhat-operators-52mmv\" (UID: \"9b651009-4b48-4a98-a27e-71239d09da8a\") " pod="openshift-marketplace/redhat-operators-52mmv" Mar 16 15:56:01 crc kubenswrapper[5120]: I0316 15:56:01.025192 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/9b651009-4b48-4a98-a27e-71239d09da8a-catalog-content\") pod \"redhat-operators-52mmv\" (UID: \"9b651009-4b48-4a98-a27e-71239d09da8a\") " pod="openshift-marketplace/redhat-operators-52mmv" Mar 16 15:56:01 crc kubenswrapper[5120]: I0316 15:56:01.025556 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/9b651009-4b48-4a98-a27e-71239d09da8a-utilities\") pod \"redhat-operators-52mmv\" (UID: \"9b651009-4b48-4a98-a27e-71239d09da8a\") " pod="openshift-marketplace/redhat-operators-52mmv" Mar 16 15:56:01 crc kubenswrapper[5120]: I0316 15:56:01.045738 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mlnvm\" (UniqueName: \"kubernetes.io/projected/9b651009-4b48-4a98-a27e-71239d09da8a-kube-api-access-mlnvm\") pod \"redhat-operators-52mmv\" (UID: \"9b651009-4b48-4a98-a27e-71239d09da8a\") " pod="openshift-marketplace/redhat-operators-52mmv" Mar 16 15:56:01 crc kubenswrapper[5120]: I0316 15:56:01.092821 5120 generic.go:358] "Generic (PLEG): container finished" podID="9da74618-45dc-4a60-8f6a-dfb9c30cb13a" containerID="8d924281be01f8bf7c744f0b2244d69b2636a7cad3a82bf98a97ff4b35a10f9f" exitCode=0 Mar 16 15:56:01 crc kubenswrapper[5120]: I0316 15:56:01.092847 5120 generic.go:358] "Generic (PLEG): container finished" podID="9da74618-45dc-4a60-8f6a-dfb9c30cb13a" containerID="70ce6108fc29a7144fbd66baa8ec206ddbc3b451583661f15f61171c9523ee30" exitCode=143 Mar 16 15:56:01 crc kubenswrapper[5120]: I0316 15:56:01.093221 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-dc8f675f4-72f6q" event={"ID":"9da74618-45dc-4a60-8f6a-dfb9c30cb13a","Type":"ContainerDied","Data":"8d924281be01f8bf7c744f0b2244d69b2636a7cad3a82bf98a97ff4b35a10f9f"} Mar 16 15:56:01 crc kubenswrapper[5120]: I0316 15:56:01.093247 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-dc8f675f4-72f6q" event={"ID":"9da74618-45dc-4a60-8f6a-dfb9c30cb13a","Type":"ContainerDied","Data":"70ce6108fc29a7144fbd66baa8ec206ddbc3b451583661f15f61171c9523ee30"} Mar 16 15:56:01 crc kubenswrapper[5120]: I0316 15:56:01.094689 5120 generic.go:358] "Generic (PLEG): container finished" podID="26088cd7-dfce-4ccd-b93e-87a82505e96d" containerID="29420b5fed586139ace73e358b1045da617160601f178ed63399faccf034c239" exitCode=143 Mar 16 15:56:01 crc kubenswrapper[5120]: I0316 15:56:01.094793 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-f5857446c-9l89n" event={"ID":"26088cd7-dfce-4ccd-b93e-87a82505e96d","Type":"ContainerDied","Data":"29420b5fed586139ace73e358b1045da617160601f178ed63399faccf034c239"} Mar 16 15:56:01 crc kubenswrapper[5120]: I0316 15:56:01.133184 5120 generic.go:358] "Generic (PLEG): container finished" podID="e08f7127-ac46-4cf0-a1ae-d02c51cc94ee" containerID="7302f84efdd87cc78b861aadcec53883f89749fbfad533396eda58332d168460" exitCode=0 Mar 16 15:56:01 crc kubenswrapper[5120]: I0316 15:56:01.133221 5120 generic.go:358] "Generic (PLEG): container finished" podID="e08f7127-ac46-4cf0-a1ae-d02c51cc94ee" containerID="673076ce0d080e172baca7581fa254a91105e30ba00a678393ed10473914f8f8" exitCode=143 Mar 16 15:56:01 crc kubenswrapper[5120]: I0316 15:56:01.134612 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-667d795786-lqmct" event={"ID":"e08f7127-ac46-4cf0-a1ae-d02c51cc94ee","Type":"ContainerDied","Data":"7302f84efdd87cc78b861aadcec53883f89749fbfad533396eda58332d168460"} Mar 16 15:56:01 crc kubenswrapper[5120]: I0316 15:56:01.134646 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-667d795786-lqmct" event={"ID":"e08f7127-ac46-4cf0-a1ae-d02c51cc94ee","Type":"ContainerDied","Data":"673076ce0d080e172baca7581fa254a91105e30ba00a678393ed10473914f8f8"} Mar 16 15:56:01 crc kubenswrapper[5120]: I0316 15:56:01.136081 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="166e6318-307c-45a6-9273-2b1541498718" containerName="cinder-scheduler" containerID="cri-o://9feb90503f0ab3cabb3adcca53ad3cd129b16bd02539b359375f5a07e2c27d71" gracePeriod=30 Mar 16 15:56:01 crc kubenswrapper[5120]: I0316 15:56:01.137979 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="166e6318-307c-45a6-9273-2b1541498718" containerName="probe" containerID="cri-o://b91d0a4cff48be949ae60c2967b9c859590bbc5f091a2b7082b44f9affa91033" gracePeriod=30 Mar 16 15:56:01 crc kubenswrapper[5120]: I0316 15:56:01.169029 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-52mmv" Mar 16 15:56:01 crc kubenswrapper[5120]: I0316 15:56:01.322025 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-dc8f675f4-72f6q" Mar 16 15:56:01 crc kubenswrapper[5120]: I0316 15:56:01.348533 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9da74618-45dc-4a60-8f6a-dfb9c30cb13a-combined-ca-bundle\") pod \"9da74618-45dc-4a60-8f6a-dfb9c30cb13a\" (UID: \"9da74618-45dc-4a60-8f6a-dfb9c30cb13a\") " Mar 16 15:56:01 crc kubenswrapper[5120]: I0316 15:56:01.348686 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/9da74618-45dc-4a60-8f6a-dfb9c30cb13a-config-data-custom\") pod \"9da74618-45dc-4a60-8f6a-dfb9c30cb13a\" (UID: \"9da74618-45dc-4a60-8f6a-dfb9c30cb13a\") " Mar 16 15:56:01 crc kubenswrapper[5120]: I0316 15:56:01.348853 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9da74618-45dc-4a60-8f6a-dfb9c30cb13a-logs\") pod \"9da74618-45dc-4a60-8f6a-dfb9c30cb13a\" (UID: \"9da74618-45dc-4a60-8f6a-dfb9c30cb13a\") " Mar 16 15:56:01 crc kubenswrapper[5120]: I0316 15:56:01.348948 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kmg47\" (UniqueName: \"kubernetes.io/projected/9da74618-45dc-4a60-8f6a-dfb9c30cb13a-kube-api-access-kmg47\") pod \"9da74618-45dc-4a60-8f6a-dfb9c30cb13a\" (UID: \"9da74618-45dc-4a60-8f6a-dfb9c30cb13a\") " Mar 16 15:56:01 crc kubenswrapper[5120]: I0316 15:56:01.350024 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9da74618-45dc-4a60-8f6a-dfb9c30cb13a-logs" (OuterVolumeSpecName: "logs") pod "9da74618-45dc-4a60-8f6a-dfb9c30cb13a" (UID: "9da74618-45dc-4a60-8f6a-dfb9c30cb13a"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:56:01 crc kubenswrapper[5120]: I0316 15:56:01.350443 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9da74618-45dc-4a60-8f6a-dfb9c30cb13a-config-data\") pod \"9da74618-45dc-4a60-8f6a-dfb9c30cb13a\" (UID: \"9da74618-45dc-4a60-8f6a-dfb9c30cb13a\") " Mar 16 15:56:01 crc kubenswrapper[5120]: I0316 15:56:01.353166 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9da74618-45dc-4a60-8f6a-dfb9c30cb13a-logs\") on node \"crc\" DevicePath \"\"" Mar 16 15:56:01 crc kubenswrapper[5120]: I0316 15:56:01.364009 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9da74618-45dc-4a60-8f6a-dfb9c30cb13a-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "9da74618-45dc-4a60-8f6a-dfb9c30cb13a" (UID: "9da74618-45dc-4a60-8f6a-dfb9c30cb13a"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:56:01 crc kubenswrapper[5120]: I0316 15:56:01.374378 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9da74618-45dc-4a60-8f6a-dfb9c30cb13a-kube-api-access-kmg47" (OuterVolumeSpecName: "kube-api-access-kmg47") pod "9da74618-45dc-4a60-8f6a-dfb9c30cb13a" (UID: "9da74618-45dc-4a60-8f6a-dfb9c30cb13a"). InnerVolumeSpecName "kube-api-access-kmg47". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:56:01 crc kubenswrapper[5120]: I0316 15:56:01.390842 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9da74618-45dc-4a60-8f6a-dfb9c30cb13a-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "9da74618-45dc-4a60-8f6a-dfb9c30cb13a" (UID: "9da74618-45dc-4a60-8f6a-dfb9c30cb13a"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:56:01 crc kubenswrapper[5120]: I0316 15:56:01.421375 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-667d795786-lqmct" Mar 16 15:56:01 crc kubenswrapper[5120]: I0316 15:56:01.438230 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9da74618-45dc-4a60-8f6a-dfb9c30cb13a-config-data" (OuterVolumeSpecName: "config-data") pod "9da74618-45dc-4a60-8f6a-dfb9c30cb13a" (UID: "9da74618-45dc-4a60-8f6a-dfb9c30cb13a"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:56:01 crc kubenswrapper[5120]: I0316 15:56:01.455777 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e08f7127-ac46-4cf0-a1ae-d02c51cc94ee-config-data\") pod \"e08f7127-ac46-4cf0-a1ae-d02c51cc94ee\" (UID: \"e08f7127-ac46-4cf0-a1ae-d02c51cc94ee\") " Mar 16 15:56:01 crc kubenswrapper[5120]: I0316 15:56:01.456865 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e08f7127-ac46-4cf0-a1ae-d02c51cc94ee-combined-ca-bundle\") pod \"e08f7127-ac46-4cf0-a1ae-d02c51cc94ee\" (UID: \"e08f7127-ac46-4cf0-a1ae-d02c51cc94ee\") " Mar 16 15:56:01 crc kubenswrapper[5120]: I0316 15:56:01.457606 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e08f7127-ac46-4cf0-a1ae-d02c51cc94ee-logs\") pod \"e08f7127-ac46-4cf0-a1ae-d02c51cc94ee\" (UID: \"e08f7127-ac46-4cf0-a1ae-d02c51cc94ee\") " Mar 16 15:56:01 crc kubenswrapper[5120]: I0316 15:56:01.457855 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-65x4h\" (UniqueName: \"kubernetes.io/projected/e08f7127-ac46-4cf0-a1ae-d02c51cc94ee-kube-api-access-65x4h\") pod \"e08f7127-ac46-4cf0-a1ae-d02c51cc94ee\" (UID: \"e08f7127-ac46-4cf0-a1ae-d02c51cc94ee\") " Mar 16 15:56:01 crc kubenswrapper[5120]: I0316 15:56:01.458015 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/e08f7127-ac46-4cf0-a1ae-d02c51cc94ee-config-data-custom\") pod \"e08f7127-ac46-4cf0-a1ae-d02c51cc94ee\" (UID: \"e08f7127-ac46-4cf0-a1ae-d02c51cc94ee\") " Mar 16 15:56:01 crc kubenswrapper[5120]: I0316 15:56:01.458921 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kmg47\" (UniqueName: \"kubernetes.io/projected/9da74618-45dc-4a60-8f6a-dfb9c30cb13a-kube-api-access-kmg47\") on node \"crc\" DevicePath \"\"" Mar 16 15:56:01 crc kubenswrapper[5120]: I0316 15:56:01.459038 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9da74618-45dc-4a60-8f6a-dfb9c30cb13a-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 15:56:01 crc kubenswrapper[5120]: I0316 15:56:01.459099 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9da74618-45dc-4a60-8f6a-dfb9c30cb13a-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:56:01 crc kubenswrapper[5120]: I0316 15:56:01.459182 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/9da74618-45dc-4a60-8f6a-dfb9c30cb13a-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 15:56:01 crc kubenswrapper[5120]: I0316 15:56:01.458933 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e08f7127-ac46-4cf0-a1ae-d02c51cc94ee-logs" (OuterVolumeSpecName: "logs") pod "e08f7127-ac46-4cf0-a1ae-d02c51cc94ee" (UID: "e08f7127-ac46-4cf0-a1ae-d02c51cc94ee"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:56:01 crc kubenswrapper[5120]: I0316 15:56:01.464142 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e08f7127-ac46-4cf0-a1ae-d02c51cc94ee-kube-api-access-65x4h" (OuterVolumeSpecName: "kube-api-access-65x4h") pod "e08f7127-ac46-4cf0-a1ae-d02c51cc94ee" (UID: "e08f7127-ac46-4cf0-a1ae-d02c51cc94ee"). InnerVolumeSpecName "kube-api-access-65x4h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:56:01 crc kubenswrapper[5120]: I0316 15:56:01.465134 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e08f7127-ac46-4cf0-a1ae-d02c51cc94ee-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "e08f7127-ac46-4cf0-a1ae-d02c51cc94ee" (UID: "e08f7127-ac46-4cf0-a1ae-d02c51cc94ee"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:56:01 crc kubenswrapper[5120]: I0316 15:56:01.490992 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 15:56:01 crc kubenswrapper[5120]: I0316 15:56:01.498877 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e08f7127-ac46-4cf0-a1ae-d02c51cc94ee-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e08f7127-ac46-4cf0-a1ae-d02c51cc94ee" (UID: "e08f7127-ac46-4cf0-a1ae-d02c51cc94ee"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:56:01 crc kubenswrapper[5120]: W0316 15:56:01.500692 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc841556f_1fa5_4d42_9793_f0887efc2f51.slice/crio-d86073f03cde9db760ec42f8a7e31ef1420701cb636c4bf9bae5040c8d070e83 WatchSource:0}: Error finding container d86073f03cde9db760ec42f8a7e31ef1420701cb636c4bf9bae5040c8d070e83: Status 404 returned error can't find the container with id d86073f03cde9db760ec42f8a7e31ef1420701cb636c4bf9bae5040c8d070e83 Mar 16 15:56:01 crc kubenswrapper[5120]: I0316 15:56:01.507751 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561276-zt964"] Mar 16 15:56:01 crc kubenswrapper[5120]: I0316 15:56:01.536842 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e08f7127-ac46-4cf0-a1ae-d02c51cc94ee-config-data" (OuterVolumeSpecName: "config-data") pod "e08f7127-ac46-4cf0-a1ae-d02c51cc94ee" (UID: "e08f7127-ac46-4cf0-a1ae-d02c51cc94ee"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:56:01 crc kubenswrapper[5120]: I0316 15:56:01.563941 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e08f7127-ac46-4cf0-a1ae-d02c51cc94ee-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 15:56:01 crc kubenswrapper[5120]: I0316 15:56:01.563977 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e08f7127-ac46-4cf0-a1ae-d02c51cc94ee-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:56:01 crc kubenswrapper[5120]: I0316 15:56:01.563989 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e08f7127-ac46-4cf0-a1ae-d02c51cc94ee-logs\") on node \"crc\" DevicePath \"\"" Mar 16 15:56:01 crc kubenswrapper[5120]: I0316 15:56:01.564003 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-65x4h\" (UniqueName: \"kubernetes.io/projected/e08f7127-ac46-4cf0-a1ae-d02c51cc94ee-kube-api-access-65x4h\") on node \"crc\" DevicePath \"\"" Mar 16 15:56:01 crc kubenswrapper[5120]: I0316 15:56:01.564013 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/e08f7127-ac46-4cf0-a1ae-d02c51cc94ee-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 15:56:01 crc kubenswrapper[5120]: I0316 15:56:01.769940 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-52mmv"] Mar 16 15:56:01 crc kubenswrapper[5120]: W0316 15:56:01.877487 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b651009_4b48_4a98_a27e_71239d09da8a.slice/crio-7473f64e1962bab6c3692b94d405bd21f087bfbdf07ab4ffd44c21436e9c7372 WatchSource:0}: Error finding container 7473f64e1962bab6c3692b94d405bd21f087bfbdf07ab4ffd44c21436e9c7372: Status 404 returned error can't find the container with id 7473f64e1962bab6c3692b94d405bd21f087bfbdf07ab4ffd44c21436e9c7372 Mar 16 15:56:02 crc kubenswrapper[5120]: I0316 15:56:02.153683 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"c841556f-1fa5-4d42-9793-f0887efc2f51","Type":"ContainerStarted","Data":"d86073f03cde9db760ec42f8a7e31ef1420701cb636c4bf9bae5040c8d070e83"} Mar 16 15:56:02 crc kubenswrapper[5120]: I0316 15:56:02.157301 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561276-zt964" event={"ID":"f827667b-46fd-4fdf-a29f-5215aff12388","Type":"ContainerStarted","Data":"dfbd6d8732a144a2d71950418f6064f08e9aa5d10d10696bab3e02069423433e"} Mar 16 15:56:02 crc kubenswrapper[5120]: I0316 15:56:02.161686 5120 generic.go:358] "Generic (PLEG): container finished" podID="9b651009-4b48-4a98-a27e-71239d09da8a" containerID="eb00610929f61a03c4858b4064fa5b98e6220c02906c968b99582c4ae0027257" exitCode=0 Mar 16 15:56:02 crc kubenswrapper[5120]: I0316 15:56:02.163064 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-52mmv" event={"ID":"9b651009-4b48-4a98-a27e-71239d09da8a","Type":"ContainerDied","Data":"eb00610929f61a03c4858b4064fa5b98e6220c02906c968b99582c4ae0027257"} Mar 16 15:56:02 crc kubenswrapper[5120]: I0316 15:56:02.163107 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-52mmv" event={"ID":"9b651009-4b48-4a98-a27e-71239d09da8a","Type":"ContainerStarted","Data":"7473f64e1962bab6c3692b94d405bd21f087bfbdf07ab4ffd44c21436e9c7372"} Mar 16 15:56:02 crc kubenswrapper[5120]: I0316 15:56:02.169253 5120 generic.go:358] "Generic (PLEG): container finished" podID="166e6318-307c-45a6-9273-2b1541498718" containerID="b91d0a4cff48be949ae60c2967b9c859590bbc5f091a2b7082b44f9affa91033" exitCode=0 Mar 16 15:56:02 crc kubenswrapper[5120]: I0316 15:56:02.169586 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"166e6318-307c-45a6-9273-2b1541498718","Type":"ContainerDied","Data":"b91d0a4cff48be949ae60c2967b9c859590bbc5f091a2b7082b44f9affa91033"} Mar 16 15:56:02 crc kubenswrapper[5120]: I0316 15:56:02.172377 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-667d795786-lqmct" event={"ID":"e08f7127-ac46-4cf0-a1ae-d02c51cc94ee","Type":"ContainerDied","Data":"084648ae27e7dfe3802768300daddcd283b8f98c410f5cec2524c00b696c2d7e"} Mar 16 15:56:02 crc kubenswrapper[5120]: I0316 15:56:02.172425 5120 scope.go:117] "RemoveContainer" containerID="7302f84efdd87cc78b861aadcec53883f89749fbfad533396eda58332d168460" Mar 16 15:56:02 crc kubenswrapper[5120]: I0316 15:56:02.172590 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-667d795786-lqmct" Mar 16 15:56:02 crc kubenswrapper[5120]: I0316 15:56:02.192440 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-dc8f675f4-72f6q" event={"ID":"9da74618-45dc-4a60-8f6a-dfb9c30cb13a","Type":"ContainerDied","Data":"0152132bbacca6b7541cff75f090ad5b1ec131b5cc450089d24cd693dabdc9d6"} Mar 16 15:56:02 crc kubenswrapper[5120]: I0316 15:56:02.192475 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-dc8f675f4-72f6q" Mar 16 15:56:02 crc kubenswrapper[5120]: I0316 15:56:02.192518 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="9f58e7c4-539f-4659-814c-9c8808d4c367" containerName="cinder-api" containerID="cri-o://a7e328cce31da34640b5261adeacdb3ac46c3fb3716817499cd5d61825eb06d3" gracePeriod=30 Mar 16 15:56:02 crc kubenswrapper[5120]: I0316 15:56:02.192545 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="9f58e7c4-539f-4659-814c-9c8808d4c367" containerName="cinder-api-log" containerID="cri-o://75d258dc4e86109b830c0e12b72a61aacdc0ced7c244ce27afd3fbb410c0eb73" gracePeriod=30 Mar 16 15:56:02 crc kubenswrapper[5120]: I0316 15:56:02.249842 5120 scope.go:117] "RemoveContainer" containerID="673076ce0d080e172baca7581fa254a91105e30ba00a678393ed10473914f8f8" Mar 16 15:56:02 crc kubenswrapper[5120]: I0316 15:56:02.263307 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-667d795786-lqmct"] Mar 16 15:56:02 crc kubenswrapper[5120]: I0316 15:56:02.273555 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-api-667d795786-lqmct"] Mar 16 15:56:02 crc kubenswrapper[5120]: I0316 15:56:02.286922 5120 scope.go:117] "RemoveContainer" containerID="8d924281be01f8bf7c744f0b2244d69b2636a7cad3a82bf98a97ff4b35a10f9f" Mar 16 15:56:02 crc kubenswrapper[5120]: I0316 15:56:02.291114 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-dc8f675f4-72f6q"] Mar 16 15:56:02 crc kubenswrapper[5120]: I0316 15:56:02.301325 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-dc8f675f4-72f6q"] Mar 16 15:56:02 crc kubenswrapper[5120]: I0316 15:56:02.330897 5120 scope.go:117] "RemoveContainer" containerID="70ce6108fc29a7144fbd66baa8ec206ddbc3b451583661f15f61171c9523ee30" Mar 16 15:56:02 crc kubenswrapper[5120]: I0316 15:56:02.675912 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9da74618-45dc-4a60-8f6a-dfb9c30cb13a" path="/var/lib/kubelet/pods/9da74618-45dc-4a60-8f6a-dfb9c30cb13a/volumes" Mar 16 15:56:02 crc kubenswrapper[5120]: I0316 15:56:02.677006 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e08f7127-ac46-4cf0-a1ae-d02c51cc94ee" path="/var/lib/kubelet/pods/e08f7127-ac46-4cf0-a1ae-d02c51cc94ee/volumes" Mar 16 15:56:02 crc kubenswrapper[5120]: I0316 15:56:02.905213 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 15:56:02 crc kubenswrapper[5120]: I0316 15:56:02.995323 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/166e6318-307c-45a6-9273-2b1541498718-scripts\") pod \"166e6318-307c-45a6-9273-2b1541498718\" (UID: \"166e6318-307c-45a6-9273-2b1541498718\") " Mar 16 15:56:02 crc kubenswrapper[5120]: I0316 15:56:02.995371 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/166e6318-307c-45a6-9273-2b1541498718-config-data\") pod \"166e6318-307c-45a6-9273-2b1541498718\" (UID: \"166e6318-307c-45a6-9273-2b1541498718\") " Mar 16 15:56:02 crc kubenswrapper[5120]: I0316 15:56:02.995422 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/166e6318-307c-45a6-9273-2b1541498718-etc-machine-id\") pod \"166e6318-307c-45a6-9273-2b1541498718\" (UID: \"166e6318-307c-45a6-9273-2b1541498718\") " Mar 16 15:56:02 crc kubenswrapper[5120]: I0316 15:56:02.995497 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/166e6318-307c-45a6-9273-2b1541498718-combined-ca-bundle\") pod \"166e6318-307c-45a6-9273-2b1541498718\" (UID: \"166e6318-307c-45a6-9273-2b1541498718\") " Mar 16 15:56:02 crc kubenswrapper[5120]: I0316 15:56:02.995551 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vj8ll\" (UniqueName: \"kubernetes.io/projected/166e6318-307c-45a6-9273-2b1541498718-kube-api-access-vj8ll\") pod \"166e6318-307c-45a6-9273-2b1541498718\" (UID: \"166e6318-307c-45a6-9273-2b1541498718\") " Mar 16 15:56:02 crc kubenswrapper[5120]: I0316 15:56:02.995692 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/166e6318-307c-45a6-9273-2b1541498718-config-data-custom\") pod \"166e6318-307c-45a6-9273-2b1541498718\" (UID: \"166e6318-307c-45a6-9273-2b1541498718\") " Mar 16 15:56:02 crc kubenswrapper[5120]: I0316 15:56:02.996453 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/166e6318-307c-45a6-9273-2b1541498718-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "166e6318-307c-45a6-9273-2b1541498718" (UID: "166e6318-307c-45a6-9273-2b1541498718"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 15:56:02 crc kubenswrapper[5120]: I0316 15:56:02.996757 5120 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/166e6318-307c-45a6-9273-2b1541498718-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 15:56:03 crc kubenswrapper[5120]: I0316 15:56:03.018937 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/166e6318-307c-45a6-9273-2b1541498718-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "166e6318-307c-45a6-9273-2b1541498718" (UID: "166e6318-307c-45a6-9273-2b1541498718"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:56:03 crc kubenswrapper[5120]: I0316 15:56:03.035601 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/166e6318-307c-45a6-9273-2b1541498718-scripts" (OuterVolumeSpecName: "scripts") pod "166e6318-307c-45a6-9273-2b1541498718" (UID: "166e6318-307c-45a6-9273-2b1541498718"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:56:03 crc kubenswrapper[5120]: I0316 15:56:03.053132 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/166e6318-307c-45a6-9273-2b1541498718-kube-api-access-vj8ll" (OuterVolumeSpecName: "kube-api-access-vj8ll") pod "166e6318-307c-45a6-9273-2b1541498718" (UID: "166e6318-307c-45a6-9273-2b1541498718"). InnerVolumeSpecName "kube-api-access-vj8ll". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:56:03 crc kubenswrapper[5120]: I0316 15:56:03.081047 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/166e6318-307c-45a6-9273-2b1541498718-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "166e6318-307c-45a6-9273-2b1541498718" (UID: "166e6318-307c-45a6-9273-2b1541498718"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:56:03 crc kubenswrapper[5120]: I0316 15:56:03.109663 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/166e6318-307c-45a6-9273-2b1541498718-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 15:56:03 crc kubenswrapper[5120]: I0316 15:56:03.109708 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/166e6318-307c-45a6-9273-2b1541498718-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 15:56:03 crc kubenswrapper[5120]: I0316 15:56:03.109720 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/166e6318-307c-45a6-9273-2b1541498718-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:56:03 crc kubenswrapper[5120]: I0316 15:56:03.109730 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vj8ll\" (UniqueName: \"kubernetes.io/projected/166e6318-307c-45a6-9273-2b1541498718-kube-api-access-vj8ll\") on node \"crc\" DevicePath \"\"" Mar 16 15:56:03 crc kubenswrapper[5120]: I0316 15:56:03.143484 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/166e6318-307c-45a6-9273-2b1541498718-config-data" (OuterVolumeSpecName: "config-data") pod "166e6318-307c-45a6-9273-2b1541498718" (UID: "166e6318-307c-45a6-9273-2b1541498718"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:56:03 crc kubenswrapper[5120]: I0316 15:56:03.206702 5120 generic.go:358] "Generic (PLEG): container finished" podID="26088cd7-dfce-4ccd-b93e-87a82505e96d" containerID="ddb032fc80332b70af942970475d083b2c36a89ec806a69547e2c9f2f11348c4" exitCode=0 Mar 16 15:56:03 crc kubenswrapper[5120]: I0316 15:56:03.206810 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-f5857446c-9l89n" event={"ID":"26088cd7-dfce-4ccd-b93e-87a82505e96d","Type":"ContainerDied","Data":"ddb032fc80332b70af942970475d083b2c36a89ec806a69547e2c9f2f11348c4"} Mar 16 15:56:03 crc kubenswrapper[5120]: I0316 15:56:03.211092 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/166e6318-307c-45a6-9273-2b1541498718-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 15:56:03 crc kubenswrapper[5120]: I0316 15:56:03.214625 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"c841556f-1fa5-4d42-9793-f0887efc2f51","Type":"ContainerStarted","Data":"09f3dceb1873a84cb2e929934bbd2dfd9e5f79aeeda3117e13c89048129b522a"} Mar 16 15:56:03 crc kubenswrapper[5120]: I0316 15:56:03.216959 5120 generic.go:358] "Generic (PLEG): container finished" podID="9f58e7c4-539f-4659-814c-9c8808d4c367" containerID="a7e328cce31da34640b5261adeacdb3ac46c3fb3716817499cd5d61825eb06d3" exitCode=0 Mar 16 15:56:03 crc kubenswrapper[5120]: I0316 15:56:03.216980 5120 generic.go:358] "Generic (PLEG): container finished" podID="9f58e7c4-539f-4659-814c-9c8808d4c367" containerID="75d258dc4e86109b830c0e12b72a61aacdc0ced7c244ce27afd3fbb410c0eb73" exitCode=143 Mar 16 15:56:03 crc kubenswrapper[5120]: I0316 15:56:03.217050 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"9f58e7c4-539f-4659-814c-9c8808d4c367","Type":"ContainerDied","Data":"a7e328cce31da34640b5261adeacdb3ac46c3fb3716817499cd5d61825eb06d3"} Mar 16 15:56:03 crc kubenswrapper[5120]: I0316 15:56:03.217086 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"9f58e7c4-539f-4659-814c-9c8808d4c367","Type":"ContainerDied","Data":"75d258dc4e86109b830c0e12b72a61aacdc0ced7c244ce27afd3fbb410c0eb73"} Mar 16 15:56:03 crc kubenswrapper[5120]: I0316 15:56:03.228773 5120 generic.go:358] "Generic (PLEG): container finished" podID="166e6318-307c-45a6-9273-2b1541498718" containerID="9feb90503f0ab3cabb3adcca53ad3cd129b16bd02539b359375f5a07e2c27d71" exitCode=0 Mar 16 15:56:03 crc kubenswrapper[5120]: I0316 15:56:03.228929 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"166e6318-307c-45a6-9273-2b1541498718","Type":"ContainerDied","Data":"9feb90503f0ab3cabb3adcca53ad3cd129b16bd02539b359375f5a07e2c27d71"} Mar 16 15:56:03 crc kubenswrapper[5120]: I0316 15:56:03.228954 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"166e6318-307c-45a6-9273-2b1541498718","Type":"ContainerDied","Data":"40aaeca05132f5fedb7a6f7fded0f8c375b943e3234791bfad8c5ccdb89e0f9c"} Mar 16 15:56:03 crc kubenswrapper[5120]: I0316 15:56:03.228977 5120 scope.go:117] "RemoveContainer" containerID="b91d0a4cff48be949ae60c2967b9c859590bbc5f091a2b7082b44f9affa91033" Mar 16 15:56:03 crc kubenswrapper[5120]: I0316 15:56:03.229082 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 15:56:03 crc kubenswrapper[5120]: I0316 15:56:03.271844 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:56:03 crc kubenswrapper[5120]: I0316 15:56:03.311919 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7mhzf\" (UniqueName: \"kubernetes.io/projected/9f58e7c4-539f-4659-814c-9c8808d4c367-kube-api-access-7mhzf\") pod \"9f58e7c4-539f-4659-814c-9c8808d4c367\" (UID: \"9f58e7c4-539f-4659-814c-9c8808d4c367\") " Mar 16 15:56:03 crc kubenswrapper[5120]: I0316 15:56:03.312003 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/9f58e7c4-539f-4659-814c-9c8808d4c367-etc-machine-id\") pod \"9f58e7c4-539f-4659-814c-9c8808d4c367\" (UID: \"9f58e7c4-539f-4659-814c-9c8808d4c367\") " Mar 16 15:56:03 crc kubenswrapper[5120]: I0316 15:56:03.312091 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9f58e7c4-539f-4659-814c-9c8808d4c367-config-data\") pod \"9f58e7c4-539f-4659-814c-9c8808d4c367\" (UID: \"9f58e7c4-539f-4659-814c-9c8808d4c367\") " Mar 16 15:56:03 crc kubenswrapper[5120]: I0316 15:56:03.312128 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/9f58e7c4-539f-4659-814c-9c8808d4c367-config-data-custom\") pod \"9f58e7c4-539f-4659-814c-9c8808d4c367\" (UID: \"9f58e7c4-539f-4659-814c-9c8808d4c367\") " Mar 16 15:56:03 crc kubenswrapper[5120]: I0316 15:56:03.312171 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9f58e7c4-539f-4659-814c-9c8808d4c367-scripts\") pod \"9f58e7c4-539f-4659-814c-9c8808d4c367\" (UID: \"9f58e7c4-539f-4659-814c-9c8808d4c367\") " Mar 16 15:56:03 crc kubenswrapper[5120]: I0316 15:56:03.312373 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/9f58e7c4-539f-4659-814c-9c8808d4c367-public-tls-certs\") pod \"9f58e7c4-539f-4659-814c-9c8808d4c367\" (UID: \"9f58e7c4-539f-4659-814c-9c8808d4c367\") " Mar 16 15:56:03 crc kubenswrapper[5120]: I0316 15:56:03.312416 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9f58e7c4-539f-4659-814c-9c8808d4c367-combined-ca-bundle\") pod \"9f58e7c4-539f-4659-814c-9c8808d4c367\" (UID: \"9f58e7c4-539f-4659-814c-9c8808d4c367\") " Mar 16 15:56:03 crc kubenswrapper[5120]: I0316 15:56:03.312490 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/9f58e7c4-539f-4659-814c-9c8808d4c367-internal-tls-certs\") pod \"9f58e7c4-539f-4659-814c-9c8808d4c367\" (UID: \"9f58e7c4-539f-4659-814c-9c8808d4c367\") " Mar 16 15:56:03 crc kubenswrapper[5120]: I0316 15:56:03.312617 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9f58e7c4-539f-4659-814c-9c8808d4c367-logs\") pod \"9f58e7c4-539f-4659-814c-9c8808d4c367\" (UID: \"9f58e7c4-539f-4659-814c-9c8808d4c367\") " Mar 16 15:56:03 crc kubenswrapper[5120]: I0316 15:56:03.313786 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f58e7c4-539f-4659-814c-9c8808d4c367-logs" (OuterVolumeSpecName: "logs") pod "9f58e7c4-539f-4659-814c-9c8808d4c367" (UID: "9f58e7c4-539f-4659-814c-9c8808d4c367"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:56:03 crc kubenswrapper[5120]: I0316 15:56:03.317535 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/9f58e7c4-539f-4659-814c-9c8808d4c367-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "9f58e7c4-539f-4659-814c-9c8808d4c367" (UID: "9f58e7c4-539f-4659-814c-9c8808d4c367"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 15:56:03 crc kubenswrapper[5120]: I0316 15:56:03.332711 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f58e7c4-539f-4659-814c-9c8808d4c367-scripts" (OuterVolumeSpecName: "scripts") pod "9f58e7c4-539f-4659-814c-9c8808d4c367" (UID: "9f58e7c4-539f-4659-814c-9c8808d4c367"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:56:03 crc kubenswrapper[5120]: I0316 15:56:03.335934 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f58e7c4-539f-4659-814c-9c8808d4c367-kube-api-access-7mhzf" (OuterVolumeSpecName: "kube-api-access-7mhzf") pod "9f58e7c4-539f-4659-814c-9c8808d4c367" (UID: "9f58e7c4-539f-4659-814c-9c8808d4c367"). InnerVolumeSpecName "kube-api-access-7mhzf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:56:03 crc kubenswrapper[5120]: I0316 15:56:03.339554 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f58e7c4-539f-4659-814c-9c8808d4c367-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "9f58e7c4-539f-4659-814c-9c8808d4c367" (UID: "9f58e7c4-539f-4659-814c-9c8808d4c367"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:56:03 crc kubenswrapper[5120]: I0316 15:56:03.363492 5120 scope.go:117] "RemoveContainer" containerID="9feb90503f0ab3cabb3adcca53ad3cd129b16bd02539b359375f5a07e2c27d71" Mar 16 15:56:03 crc kubenswrapper[5120]: I0316 15:56:03.388185 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f58e7c4-539f-4659-814c-9c8808d4c367-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "9f58e7c4-539f-4659-814c-9c8808d4c367" (UID: "9f58e7c4-539f-4659-814c-9c8808d4c367"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:56:03 crc kubenswrapper[5120]: I0316 15:56:03.396931 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 15:56:03 crc kubenswrapper[5120]: I0316 15:56:03.418909 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9f58e7c4-539f-4659-814c-9c8808d4c367-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 15:56:03 crc kubenswrapper[5120]: I0316 15:56:03.419386 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9f58e7c4-539f-4659-814c-9c8808d4c367-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:56:03 crc kubenswrapper[5120]: I0316 15:56:03.419399 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9f58e7c4-539f-4659-814c-9c8808d4c367-logs\") on node \"crc\" DevicePath \"\"" Mar 16 15:56:03 crc kubenswrapper[5120]: I0316 15:56:03.419412 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7mhzf\" (UniqueName: \"kubernetes.io/projected/9f58e7c4-539f-4659-814c-9c8808d4c367-kube-api-access-7mhzf\") on node \"crc\" DevicePath \"\"" Mar 16 15:56:03 crc kubenswrapper[5120]: I0316 15:56:03.419422 5120 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/9f58e7c4-539f-4659-814c-9c8808d4c367-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 15:56:03 crc kubenswrapper[5120]: I0316 15:56:03.419431 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/9f58e7c4-539f-4659-814c-9c8808d4c367-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 15:56:03 crc kubenswrapper[5120]: I0316 15:56:03.420703 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 15:56:03 crc kubenswrapper[5120]: I0316 15:56:03.434095 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 15:56:03 crc kubenswrapper[5120]: I0316 15:56:03.435371 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f58e7c4-539f-4659-814c-9c8808d4c367" containerName="cinder-api-log" Mar 16 15:56:03 crc kubenswrapper[5120]: I0316 15:56:03.435400 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f58e7c4-539f-4659-814c-9c8808d4c367" containerName="cinder-api-log" Mar 16 15:56:03 crc kubenswrapper[5120]: I0316 15:56:03.435420 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e08f7127-ac46-4cf0-a1ae-d02c51cc94ee" containerName="barbican-api-log" Mar 16 15:56:03 crc kubenswrapper[5120]: I0316 15:56:03.435430 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e08f7127-ac46-4cf0-a1ae-d02c51cc94ee" containerName="barbican-api-log" Mar 16 15:56:03 crc kubenswrapper[5120]: I0316 15:56:03.435469 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9da74618-45dc-4a60-8f6a-dfb9c30cb13a" containerName="barbican-keystone-listener" Mar 16 15:56:03 crc kubenswrapper[5120]: I0316 15:56:03.435477 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9da74618-45dc-4a60-8f6a-dfb9c30cb13a" containerName="barbican-keystone-listener" Mar 16 15:56:03 crc kubenswrapper[5120]: I0316 15:56:03.435498 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9da74618-45dc-4a60-8f6a-dfb9c30cb13a" containerName="barbican-keystone-listener-log" Mar 16 15:56:03 crc kubenswrapper[5120]: I0316 15:56:03.435510 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9da74618-45dc-4a60-8f6a-dfb9c30cb13a" containerName="barbican-keystone-listener-log" Mar 16 15:56:03 crc kubenswrapper[5120]: I0316 15:56:03.435521 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f58e7c4-539f-4659-814c-9c8808d4c367" containerName="cinder-api" Mar 16 15:56:03 crc kubenswrapper[5120]: I0316 15:56:03.435528 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f58e7c4-539f-4659-814c-9c8808d4c367" containerName="cinder-api" Mar 16 15:56:03 crc kubenswrapper[5120]: I0316 15:56:03.435552 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="166e6318-307c-45a6-9273-2b1541498718" containerName="probe" Mar 16 15:56:03 crc kubenswrapper[5120]: I0316 15:56:03.435561 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="166e6318-307c-45a6-9273-2b1541498718" containerName="probe" Mar 16 15:56:03 crc kubenswrapper[5120]: I0316 15:56:03.435570 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="166e6318-307c-45a6-9273-2b1541498718" containerName="cinder-scheduler" Mar 16 15:56:03 crc kubenswrapper[5120]: I0316 15:56:03.435577 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="166e6318-307c-45a6-9273-2b1541498718" containerName="cinder-scheduler" Mar 16 15:56:03 crc kubenswrapper[5120]: I0316 15:56:03.435594 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e08f7127-ac46-4cf0-a1ae-d02c51cc94ee" containerName="barbican-api" Mar 16 15:56:03 crc kubenswrapper[5120]: I0316 15:56:03.435605 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e08f7127-ac46-4cf0-a1ae-d02c51cc94ee" containerName="barbican-api" Mar 16 15:56:03 crc kubenswrapper[5120]: I0316 15:56:03.435821 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="166e6318-307c-45a6-9273-2b1541498718" containerName="probe" Mar 16 15:56:03 crc kubenswrapper[5120]: I0316 15:56:03.435841 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="166e6318-307c-45a6-9273-2b1541498718" containerName="cinder-scheduler" Mar 16 15:56:03 crc kubenswrapper[5120]: I0316 15:56:03.435856 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="9f58e7c4-539f-4659-814c-9c8808d4c367" containerName="cinder-api" Mar 16 15:56:03 crc kubenswrapper[5120]: I0316 15:56:03.435869 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e08f7127-ac46-4cf0-a1ae-d02c51cc94ee" containerName="barbican-api-log" Mar 16 15:56:03 crc kubenswrapper[5120]: I0316 15:56:03.435885 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="9f58e7c4-539f-4659-814c-9c8808d4c367" containerName="cinder-api-log" Mar 16 15:56:03 crc kubenswrapper[5120]: I0316 15:56:03.435897 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e08f7127-ac46-4cf0-a1ae-d02c51cc94ee" containerName="barbican-api" Mar 16 15:56:03 crc kubenswrapper[5120]: I0316 15:56:03.435911 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="9da74618-45dc-4a60-8f6a-dfb9c30cb13a" containerName="barbican-keystone-listener" Mar 16 15:56:03 crc kubenswrapper[5120]: I0316 15:56:03.435924 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="9da74618-45dc-4a60-8f6a-dfb9c30cb13a" containerName="barbican-keystone-listener-log" Mar 16 15:56:03 crc kubenswrapper[5120]: I0316 15:56:03.441162 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 15:56:03 crc kubenswrapper[5120]: I0316 15:56:03.443450 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-scheduler-config-data\"" Mar 16 15:56:03 crc kubenswrapper[5120]: I0316 15:56:03.453676 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 15:56:03 crc kubenswrapper[5120]: I0316 15:56:03.482400 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f58e7c4-539f-4659-814c-9c8808d4c367-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "9f58e7c4-539f-4659-814c-9c8808d4c367" (UID: "9f58e7c4-539f-4659-814c-9c8808d4c367"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:56:03 crc kubenswrapper[5120]: I0316 15:56:03.504233 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f58e7c4-539f-4659-814c-9c8808d4c367-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "9f58e7c4-539f-4659-814c-9c8808d4c367" (UID: "9f58e7c4-539f-4659-814c-9c8808d4c367"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:56:03 crc kubenswrapper[5120]: I0316 15:56:03.521468 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpcts\" (UniqueName: \"kubernetes.io/projected/f80a9ef7-32f9-44c7-945c-d1ee96105c42-kube-api-access-xpcts\") pod \"cinder-scheduler-0\" (UID: \"f80a9ef7-32f9-44c7-945c-d1ee96105c42\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 15:56:03 crc kubenswrapper[5120]: I0316 15:56:03.521541 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f80a9ef7-32f9-44c7-945c-d1ee96105c42-config-data\") pod \"cinder-scheduler-0\" (UID: \"f80a9ef7-32f9-44c7-945c-d1ee96105c42\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 15:56:03 crc kubenswrapper[5120]: I0316 15:56:03.521598 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/f80a9ef7-32f9-44c7-945c-d1ee96105c42-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"f80a9ef7-32f9-44c7-945c-d1ee96105c42\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 15:56:03 crc kubenswrapper[5120]: I0316 15:56:03.521706 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/f80a9ef7-32f9-44c7-945c-d1ee96105c42-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"f80a9ef7-32f9-44c7-945c-d1ee96105c42\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 15:56:03 crc kubenswrapper[5120]: I0316 15:56:03.521749 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f80a9ef7-32f9-44c7-945c-d1ee96105c42-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"f80a9ef7-32f9-44c7-945c-d1ee96105c42\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 15:56:03 crc kubenswrapper[5120]: I0316 15:56:03.521806 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f80a9ef7-32f9-44c7-945c-d1ee96105c42-scripts\") pod \"cinder-scheduler-0\" (UID: \"f80a9ef7-32f9-44c7-945c-d1ee96105c42\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 15:56:03 crc kubenswrapper[5120]: I0316 15:56:03.521985 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/9f58e7c4-539f-4659-814c-9c8808d4c367-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 15:56:03 crc kubenswrapper[5120]: I0316 15:56:03.522029 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/9f58e7c4-539f-4659-814c-9c8808d4c367-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 15:56:03 crc kubenswrapper[5120]: I0316 15:56:03.526682 5120 scope.go:117] "RemoveContainer" containerID="b91d0a4cff48be949ae60c2967b9c859590bbc5f091a2b7082b44f9affa91033" Mar 16 15:56:03 crc kubenswrapper[5120]: E0316 15:56:03.527137 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b91d0a4cff48be949ae60c2967b9c859590bbc5f091a2b7082b44f9affa91033\": container with ID starting with b91d0a4cff48be949ae60c2967b9c859590bbc5f091a2b7082b44f9affa91033 not found: ID does not exist" containerID="b91d0a4cff48be949ae60c2967b9c859590bbc5f091a2b7082b44f9affa91033" Mar 16 15:56:03 crc kubenswrapper[5120]: I0316 15:56:03.527189 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b91d0a4cff48be949ae60c2967b9c859590bbc5f091a2b7082b44f9affa91033"} err="failed to get container status \"b91d0a4cff48be949ae60c2967b9c859590bbc5f091a2b7082b44f9affa91033\": rpc error: code = NotFound desc = could not find container \"b91d0a4cff48be949ae60c2967b9c859590bbc5f091a2b7082b44f9affa91033\": container with ID starting with b91d0a4cff48be949ae60c2967b9c859590bbc5f091a2b7082b44f9affa91033 not found: ID does not exist" Mar 16 15:56:03 crc kubenswrapper[5120]: I0316 15:56:03.527220 5120 scope.go:117] "RemoveContainer" containerID="9feb90503f0ab3cabb3adcca53ad3cd129b16bd02539b359375f5a07e2c27d71" Mar 16 15:56:03 crc kubenswrapper[5120]: E0316 15:56:03.527525 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9feb90503f0ab3cabb3adcca53ad3cd129b16bd02539b359375f5a07e2c27d71\": container with ID starting with 9feb90503f0ab3cabb3adcca53ad3cd129b16bd02539b359375f5a07e2c27d71 not found: ID does not exist" containerID="9feb90503f0ab3cabb3adcca53ad3cd129b16bd02539b359375f5a07e2c27d71" Mar 16 15:56:03 crc kubenswrapper[5120]: I0316 15:56:03.527554 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9feb90503f0ab3cabb3adcca53ad3cd129b16bd02539b359375f5a07e2c27d71"} err="failed to get container status \"9feb90503f0ab3cabb3adcca53ad3cd129b16bd02539b359375f5a07e2c27d71\": rpc error: code = NotFound desc = could not find container \"9feb90503f0ab3cabb3adcca53ad3cd129b16bd02539b359375f5a07e2c27d71\": container with ID starting with 9feb90503f0ab3cabb3adcca53ad3cd129b16bd02539b359375f5a07e2c27d71 not found: ID does not exist" Mar 16 15:56:03 crc kubenswrapper[5120]: I0316 15:56:03.532895 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f58e7c4-539f-4659-814c-9c8808d4c367-config-data" (OuterVolumeSpecName: "config-data") pod "9f58e7c4-539f-4659-814c-9c8808d4c367" (UID: "9f58e7c4-539f-4659-814c-9c8808d4c367"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:56:03 crc kubenswrapper[5120]: I0316 15:56:03.626137 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f80a9ef7-32f9-44c7-945c-d1ee96105c42-config-data\") pod \"cinder-scheduler-0\" (UID: \"f80a9ef7-32f9-44c7-945c-d1ee96105c42\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 15:56:03 crc kubenswrapper[5120]: I0316 15:56:03.626245 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/f80a9ef7-32f9-44c7-945c-d1ee96105c42-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"f80a9ef7-32f9-44c7-945c-d1ee96105c42\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 15:56:03 crc kubenswrapper[5120]: I0316 15:56:03.626372 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/f80a9ef7-32f9-44c7-945c-d1ee96105c42-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"f80a9ef7-32f9-44c7-945c-d1ee96105c42\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 15:56:03 crc kubenswrapper[5120]: I0316 15:56:03.626401 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/f80a9ef7-32f9-44c7-945c-d1ee96105c42-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"f80a9ef7-32f9-44c7-945c-d1ee96105c42\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 15:56:03 crc kubenswrapper[5120]: I0316 15:56:03.626484 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f80a9ef7-32f9-44c7-945c-d1ee96105c42-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"f80a9ef7-32f9-44c7-945c-d1ee96105c42\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 15:56:03 crc kubenswrapper[5120]: I0316 15:56:03.626574 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f80a9ef7-32f9-44c7-945c-d1ee96105c42-scripts\") pod \"cinder-scheduler-0\" (UID: \"f80a9ef7-32f9-44c7-945c-d1ee96105c42\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 15:56:03 crc kubenswrapper[5120]: I0316 15:56:03.626910 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xpcts\" (UniqueName: \"kubernetes.io/projected/f80a9ef7-32f9-44c7-945c-d1ee96105c42-kube-api-access-xpcts\") pod \"cinder-scheduler-0\" (UID: \"f80a9ef7-32f9-44c7-945c-d1ee96105c42\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 15:56:03 crc kubenswrapper[5120]: I0316 15:56:03.627038 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9f58e7c4-539f-4659-814c-9c8808d4c367-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 15:56:03 crc kubenswrapper[5120]: I0316 15:56:03.632624 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f80a9ef7-32f9-44c7-945c-d1ee96105c42-scripts\") pod \"cinder-scheduler-0\" (UID: \"f80a9ef7-32f9-44c7-945c-d1ee96105c42\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 15:56:03 crc kubenswrapper[5120]: I0316 15:56:03.633235 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f80a9ef7-32f9-44c7-945c-d1ee96105c42-config-data\") pod \"cinder-scheduler-0\" (UID: \"f80a9ef7-32f9-44c7-945c-d1ee96105c42\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 15:56:03 crc kubenswrapper[5120]: I0316 15:56:03.635495 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f80a9ef7-32f9-44c7-945c-d1ee96105c42-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"f80a9ef7-32f9-44c7-945c-d1ee96105c42\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 15:56:03 crc kubenswrapper[5120]: I0316 15:56:03.639468 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/f80a9ef7-32f9-44c7-945c-d1ee96105c42-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"f80a9ef7-32f9-44c7-945c-d1ee96105c42\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 15:56:03 crc kubenswrapper[5120]: I0316 15:56:03.656716 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpcts\" (UniqueName: \"kubernetes.io/projected/f80a9ef7-32f9-44c7-945c-d1ee96105c42-kube-api-access-xpcts\") pod \"cinder-scheduler-0\" (UID: \"f80a9ef7-32f9-44c7-945c-d1ee96105c42\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 15:56:03 crc kubenswrapper[5120]: I0316 15:56:03.658521 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-f5857446c-9l89n" Mar 16 15:56:03 crc kubenswrapper[5120]: I0316 15:56:03.728147 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/26088cd7-dfce-4ccd-b93e-87a82505e96d-config-data\") pod \"26088cd7-dfce-4ccd-b93e-87a82505e96d\" (UID: \"26088cd7-dfce-4ccd-b93e-87a82505e96d\") " Mar 16 15:56:03 crc kubenswrapper[5120]: I0316 15:56:03.728319 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/26088cd7-dfce-4ccd-b93e-87a82505e96d-combined-ca-bundle\") pod \"26088cd7-dfce-4ccd-b93e-87a82505e96d\" (UID: \"26088cd7-dfce-4ccd-b93e-87a82505e96d\") " Mar 16 15:56:03 crc kubenswrapper[5120]: I0316 15:56:03.728540 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j2s7q\" (UniqueName: \"kubernetes.io/projected/26088cd7-dfce-4ccd-b93e-87a82505e96d-kube-api-access-j2s7q\") pod \"26088cd7-dfce-4ccd-b93e-87a82505e96d\" (UID: \"26088cd7-dfce-4ccd-b93e-87a82505e96d\") " Mar 16 15:56:03 crc kubenswrapper[5120]: I0316 15:56:03.728633 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/26088cd7-dfce-4ccd-b93e-87a82505e96d-logs\") pod \"26088cd7-dfce-4ccd-b93e-87a82505e96d\" (UID: \"26088cd7-dfce-4ccd-b93e-87a82505e96d\") " Mar 16 15:56:03 crc kubenswrapper[5120]: I0316 15:56:03.728699 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/26088cd7-dfce-4ccd-b93e-87a82505e96d-config-data-custom\") pod \"26088cd7-dfce-4ccd-b93e-87a82505e96d\" (UID: \"26088cd7-dfce-4ccd-b93e-87a82505e96d\") " Mar 16 15:56:03 crc kubenswrapper[5120]: I0316 15:56:03.729802 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26088cd7-dfce-4ccd-b93e-87a82505e96d-logs" (OuterVolumeSpecName: "logs") pod "26088cd7-dfce-4ccd-b93e-87a82505e96d" (UID: "26088cd7-dfce-4ccd-b93e-87a82505e96d"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:56:03 crc kubenswrapper[5120]: I0316 15:56:03.732980 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26088cd7-dfce-4ccd-b93e-87a82505e96d-kube-api-access-j2s7q" (OuterVolumeSpecName: "kube-api-access-j2s7q") pod "26088cd7-dfce-4ccd-b93e-87a82505e96d" (UID: "26088cd7-dfce-4ccd-b93e-87a82505e96d"). InnerVolumeSpecName "kube-api-access-j2s7q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:56:03 crc kubenswrapper[5120]: I0316 15:56:03.733114 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/26088cd7-dfce-4ccd-b93e-87a82505e96d-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "26088cd7-dfce-4ccd-b93e-87a82505e96d" (UID: "26088cd7-dfce-4ccd-b93e-87a82505e96d"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:56:03 crc kubenswrapper[5120]: I0316 15:56:03.762002 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/26088cd7-dfce-4ccd-b93e-87a82505e96d-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "26088cd7-dfce-4ccd-b93e-87a82505e96d" (UID: "26088cd7-dfce-4ccd-b93e-87a82505e96d"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:56:03 crc kubenswrapper[5120]: I0316 15:56:03.830798 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/26088cd7-dfce-4ccd-b93e-87a82505e96d-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 15:56:03 crc kubenswrapper[5120]: I0316 15:56:03.830828 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/26088cd7-dfce-4ccd-b93e-87a82505e96d-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:56:03 crc kubenswrapper[5120]: I0316 15:56:03.830841 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j2s7q\" (UniqueName: \"kubernetes.io/projected/26088cd7-dfce-4ccd-b93e-87a82505e96d-kube-api-access-j2s7q\") on node \"crc\" DevicePath \"\"" Mar 16 15:56:03 crc kubenswrapper[5120]: I0316 15:56:03.830868 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/26088cd7-dfce-4ccd-b93e-87a82505e96d-logs\") on node \"crc\" DevicePath \"\"" Mar 16 15:56:03 crc kubenswrapper[5120]: I0316 15:56:03.841374 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 15:56:04 crc kubenswrapper[5120]: I0316 15:56:04.001909 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/26088cd7-dfce-4ccd-b93e-87a82505e96d-config-data" (OuterVolumeSpecName: "config-data") pod "26088cd7-dfce-4ccd-b93e-87a82505e96d" (UID: "26088cd7-dfce-4ccd-b93e-87a82505e96d"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:56:04 crc kubenswrapper[5120]: I0316 15:56:04.035647 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/26088cd7-dfce-4ccd-b93e-87a82505e96d-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 15:56:04 crc kubenswrapper[5120]: I0316 15:56:04.239796 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-f5857446c-9l89n" event={"ID":"26088cd7-dfce-4ccd-b93e-87a82505e96d","Type":"ContainerDied","Data":"34e86a88fd2481f25a313acf010fe5059818fde3f82205a30af53b5ffb720655"} Mar 16 15:56:04 crc kubenswrapper[5120]: I0316 15:56:04.239883 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-f5857446c-9l89n" Mar 16 15:56:04 crc kubenswrapper[5120]: I0316 15:56:04.240074 5120 scope.go:117] "RemoveContainer" containerID="ddb032fc80332b70af942970475d083b2c36a89ec806a69547e2c9f2f11348c4" Mar 16 15:56:04 crc kubenswrapper[5120]: I0316 15:56:04.242537 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"c841556f-1fa5-4d42-9793-f0887efc2f51","Type":"ContainerStarted","Data":"7cc3813aa795fa5c887daed7460a1809ec0868734f02209302791ea832337890"} Mar 16 15:56:04 crc kubenswrapper[5120]: I0316 15:56:04.252254 5120 generic.go:358] "Generic (PLEG): container finished" podID="f827667b-46fd-4fdf-a29f-5215aff12388" containerID="5c7737e97c6bd0c62394c3e7424d306aafc9ac26eba6e76b2060d75537356de4" exitCode=0 Mar 16 15:56:04 crc kubenswrapper[5120]: I0316 15:56:04.252854 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561276-zt964" event={"ID":"f827667b-46fd-4fdf-a29f-5215aff12388","Type":"ContainerDied","Data":"5c7737e97c6bd0c62394c3e7424d306aafc9ac26eba6e76b2060d75537356de4"} Mar 16 15:56:04 crc kubenswrapper[5120]: I0316 15:56:04.256820 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-52mmv" event={"ID":"9b651009-4b48-4a98-a27e-71239d09da8a","Type":"ContainerStarted","Data":"406615262e590f8a65d2650d8fd1a0a18bc05bc51a52ae392dce288f9b272a13"} Mar 16 15:56:04 crc kubenswrapper[5120]: I0316 15:56:04.262219 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:56:04 crc kubenswrapper[5120]: I0316 15:56:04.262246 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"9f58e7c4-539f-4659-814c-9c8808d4c367","Type":"ContainerDied","Data":"b349f7899c8fd998abc0b328c670e6480d75109d824359ee6e946d99452638c2"} Mar 16 15:56:04 crc kubenswrapper[5120]: I0316 15:56:04.332283 5120 scope.go:117] "RemoveContainer" containerID="29420b5fed586139ace73e358b1045da617160601f178ed63399faccf034c239" Mar 16 15:56:04 crc kubenswrapper[5120]: I0316 15:56:04.390009 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-f5857446c-9l89n"] Mar 16 15:56:04 crc kubenswrapper[5120]: I0316 15:56:04.399982 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-worker-f5857446c-9l89n"] Mar 16 15:56:04 crc kubenswrapper[5120]: I0316 15:56:04.411030 5120 scope.go:117] "RemoveContainer" containerID="a7e328cce31da34640b5261adeacdb3ac46c3fb3716817499cd5d61825eb06d3" Mar 16 15:56:04 crc kubenswrapper[5120]: I0316 15:56:04.427042 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 15:56:04 crc kubenswrapper[5120]: I0316 15:56:04.446113 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 15:56:04 crc kubenswrapper[5120]: I0316 15:56:04.499499 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 15:56:04 crc kubenswrapper[5120]: I0316 15:56:04.500517 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26088cd7-dfce-4ccd-b93e-87a82505e96d" containerName="barbican-worker-log" Mar 16 15:56:04 crc kubenswrapper[5120]: I0316 15:56:04.500529 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="26088cd7-dfce-4ccd-b93e-87a82505e96d" containerName="barbican-worker-log" Mar 16 15:56:04 crc kubenswrapper[5120]: I0316 15:56:04.500551 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26088cd7-dfce-4ccd-b93e-87a82505e96d" containerName="barbican-worker" Mar 16 15:56:04 crc kubenswrapper[5120]: I0316 15:56:04.500558 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="26088cd7-dfce-4ccd-b93e-87a82505e96d" containerName="barbican-worker" Mar 16 15:56:04 crc kubenswrapper[5120]: I0316 15:56:04.500746 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="26088cd7-dfce-4ccd-b93e-87a82505e96d" containerName="barbican-worker-log" Mar 16 15:56:04 crc kubenswrapper[5120]: I0316 15:56:04.500770 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="26088cd7-dfce-4ccd-b93e-87a82505e96d" containerName="barbican-worker" Mar 16 15:56:04 crc kubenswrapper[5120]: I0316 15:56:04.522525 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 15:56:04 crc kubenswrapper[5120]: I0316 15:56:04.522560 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 15:56:04 crc kubenswrapper[5120]: I0316 15:56:04.522680 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:56:04 crc kubenswrapper[5120]: I0316 15:56:04.525724 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-cinder-internal-svc\"" Mar 16 15:56:04 crc kubenswrapper[5120]: I0316 15:56:04.536035 5120 scope.go:117] "RemoveContainer" containerID="75d258dc4e86109b830c0e12b72a61aacdc0ced7c244ce27afd3fbb410c0eb73" Mar 16 15:56:04 crc kubenswrapper[5120]: I0316 15:56:04.536492 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-cinder-public-svc\"" Mar 16 15:56:04 crc kubenswrapper[5120]: I0316 15:56:04.537228 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-api-config-data\"" Mar 16 15:56:04 crc kubenswrapper[5120]: I0316 15:56:04.646334 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe-config-data-custom\") pod \"cinder-api-0\" (UID: \"1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:56:04 crc kubenswrapper[5120]: I0316 15:56:04.646636 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe-scripts\") pod \"cinder-api-0\" (UID: \"1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:56:04 crc kubenswrapper[5120]: I0316 15:56:04.646689 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:56:04 crc kubenswrapper[5120]: I0316 15:56:04.646737 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe-public-tls-certs\") pod \"cinder-api-0\" (UID: \"1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:56:04 crc kubenswrapper[5120]: I0316 15:56:04.646782 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe-logs\") pod \"cinder-api-0\" (UID: \"1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:56:04 crc kubenswrapper[5120]: I0316 15:56:04.646805 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe-config-data\") pod \"cinder-api-0\" (UID: \"1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:56:04 crc kubenswrapper[5120]: I0316 15:56:04.646891 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe-etc-machine-id\") pod \"cinder-api-0\" (UID: \"1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:56:04 crc kubenswrapper[5120]: I0316 15:56:04.646920 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snzjg\" (UniqueName: \"kubernetes.io/projected/1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe-kube-api-access-snzjg\") pod \"cinder-api-0\" (UID: \"1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:56:04 crc kubenswrapper[5120]: I0316 15:56:04.647206 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:56:04 crc kubenswrapper[5120]: I0316 15:56:04.678422 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="166e6318-307c-45a6-9273-2b1541498718" path="/var/lib/kubelet/pods/166e6318-307c-45a6-9273-2b1541498718/volumes" Mar 16 15:56:04 crc kubenswrapper[5120]: I0316 15:56:04.679240 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="26088cd7-dfce-4ccd-b93e-87a82505e96d" path="/var/lib/kubelet/pods/26088cd7-dfce-4ccd-b93e-87a82505e96d/volumes" Mar 16 15:56:04 crc kubenswrapper[5120]: I0316 15:56:04.679830 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f58e7c4-539f-4659-814c-9c8808d4c367" path="/var/lib/kubelet/pods/9f58e7c4-539f-4659-814c-9c8808d4c367/volumes" Mar 16 15:56:04 crc kubenswrapper[5120]: I0316 15:56:04.749043 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe-public-tls-certs\") pod \"cinder-api-0\" (UID: \"1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:56:04 crc kubenswrapper[5120]: I0316 15:56:04.749099 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe-logs\") pod \"cinder-api-0\" (UID: \"1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:56:04 crc kubenswrapper[5120]: I0316 15:56:04.749121 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe-config-data\") pod \"cinder-api-0\" (UID: \"1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:56:04 crc kubenswrapper[5120]: I0316 15:56:04.749150 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe-etc-machine-id\") pod \"cinder-api-0\" (UID: \"1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:56:04 crc kubenswrapper[5120]: I0316 15:56:04.749170 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-snzjg\" (UniqueName: \"kubernetes.io/projected/1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe-kube-api-access-snzjg\") pod \"cinder-api-0\" (UID: \"1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:56:04 crc kubenswrapper[5120]: I0316 15:56:04.749451 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe-etc-machine-id\") pod \"cinder-api-0\" (UID: \"1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:56:04 crc kubenswrapper[5120]: I0316 15:56:04.749509 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe-logs\") pod \"cinder-api-0\" (UID: \"1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:56:04 crc kubenswrapper[5120]: I0316 15:56:04.749922 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:56:04 crc kubenswrapper[5120]: I0316 15:56:04.749969 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe-config-data-custom\") pod \"cinder-api-0\" (UID: \"1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:56:04 crc kubenswrapper[5120]: I0316 15:56:04.750233 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe-scripts\") pod \"cinder-api-0\" (UID: \"1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:56:04 crc kubenswrapper[5120]: I0316 15:56:04.750258 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:56:04 crc kubenswrapper[5120]: I0316 15:56:04.753163 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe-public-tls-certs\") pod \"cinder-api-0\" (UID: \"1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:56:04 crc kubenswrapper[5120]: I0316 15:56:04.753464 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe-config-data-custom\") pod \"cinder-api-0\" (UID: \"1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:56:04 crc kubenswrapper[5120]: I0316 15:56:04.753507 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe-config-data\") pod \"cinder-api-0\" (UID: \"1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:56:04 crc kubenswrapper[5120]: I0316 15:56:04.753530 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:56:04 crc kubenswrapper[5120]: I0316 15:56:04.754341 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe-scripts\") pod \"cinder-api-0\" (UID: \"1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:56:04 crc kubenswrapper[5120]: I0316 15:56:04.757939 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:56:04 crc kubenswrapper[5120]: I0316 15:56:04.764841 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-snzjg\" (UniqueName: \"kubernetes.io/projected/1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe-kube-api-access-snzjg\") pod \"cinder-api-0\" (UID: \"1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:56:04 crc kubenswrapper[5120]: I0316 15:56:04.974364 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:56:05 crc kubenswrapper[5120]: I0316 15:56:05.278216 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"c841556f-1fa5-4d42-9793-f0887efc2f51","Type":"ContainerStarted","Data":"1a407ae87c7e930427f08c6f24d322a4c1e29221eea1df6bf79891961e3a6c70"} Mar 16 15:56:05 crc kubenswrapper[5120]: I0316 15:56:05.282204 5120 generic.go:358] "Generic (PLEG): container finished" podID="9b651009-4b48-4a98-a27e-71239d09da8a" containerID="406615262e590f8a65d2650d8fd1a0a18bc05bc51a52ae392dce288f9b272a13" exitCode=0 Mar 16 15:56:05 crc kubenswrapper[5120]: I0316 15:56:05.282284 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-52mmv" event={"ID":"9b651009-4b48-4a98-a27e-71239d09da8a","Type":"ContainerDied","Data":"406615262e590f8a65d2650d8fd1a0a18bc05bc51a52ae392dce288f9b272a13"} Mar 16 15:56:05 crc kubenswrapper[5120]: I0316 15:56:05.282300 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-52mmv" event={"ID":"9b651009-4b48-4a98-a27e-71239d09da8a","Type":"ContainerStarted","Data":"030b64e6c15641cf63c49788978883ccbde376ebebfc32a145353d4a28fed672"} Mar 16 15:56:05 crc kubenswrapper[5120]: I0316 15:56:05.293291 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"f80a9ef7-32f9-44c7-945c-d1ee96105c42","Type":"ContainerStarted","Data":"b6bb33f699db1e8b2ee47f375490efe9554f49f146ae7d1e564beba920058e1b"} Mar 16 15:56:05 crc kubenswrapper[5120]: I0316 15:56:05.293346 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"f80a9ef7-32f9-44c7-945c-d1ee96105c42","Type":"ContainerStarted","Data":"5bcca1b13d128807b98c5d88e7a375c55ae9225780d937962254884f3eb4c397"} Mar 16 15:56:05 crc kubenswrapper[5120]: I0316 15:56:05.326231 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/redhat-operators-52mmv" podStartSLOduration=4.470038114 podStartE2EDuration="5.326212317s" podCreationTimestamp="2026-03-16 15:56:00 +0000 UTC" firstStartedPulling="2026-03-16 15:56:02.164166927 +0000 UTC m=+1464.318098584" lastFinishedPulling="2026-03-16 15:56:03.02034113 +0000 UTC m=+1465.174272787" observedRunningTime="2026-03-16 15:56:05.305398591 +0000 UTC m=+1467.459330258" watchObservedRunningTime="2026-03-16 15:56:05.326212317 +0000 UTC m=+1467.480143974" Mar 16 15:56:05 crc kubenswrapper[5120]: I0316 15:56:05.469634 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 15:56:05 crc kubenswrapper[5120]: I0316 15:56:05.677578 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561276-zt964" Mar 16 15:56:05 crc kubenswrapper[5120]: I0316 15:56:05.770887 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zgbg2\" (UniqueName: \"kubernetes.io/projected/f827667b-46fd-4fdf-a29f-5215aff12388-kube-api-access-zgbg2\") pod \"f827667b-46fd-4fdf-a29f-5215aff12388\" (UID: \"f827667b-46fd-4fdf-a29f-5215aff12388\") " Mar 16 15:56:05 crc kubenswrapper[5120]: I0316 15:56:05.775736 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f827667b-46fd-4fdf-a29f-5215aff12388-kube-api-access-zgbg2" (OuterVolumeSpecName: "kube-api-access-zgbg2") pod "f827667b-46fd-4fdf-a29f-5215aff12388" (UID: "f827667b-46fd-4fdf-a29f-5215aff12388"). InnerVolumeSpecName "kube-api-access-zgbg2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:56:05 crc kubenswrapper[5120]: I0316 15:56:05.872973 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zgbg2\" (UniqueName: \"kubernetes.io/projected/f827667b-46fd-4fdf-a29f-5215aff12388-kube-api-access-zgbg2\") on node \"crc\" DevicePath \"\"" Mar 16 15:56:06 crc kubenswrapper[5120]: I0316 15:56:06.313937 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"f80a9ef7-32f9-44c7-945c-d1ee96105c42","Type":"ContainerStarted","Data":"a8cc11b8ec51275761948543ede5d0db634e37eb551775e3622e1ea5aad55325"} Mar 16 15:56:06 crc kubenswrapper[5120]: I0316 15:56:06.326281 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe","Type":"ContainerStarted","Data":"fe906071d1202f4aa14cd2d7278bdcf1f183df9a4cfcdbd74158bd682176c42f"} Mar 16 15:56:06 crc kubenswrapper[5120]: I0316 15:56:06.328372 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561276-zt964" event={"ID":"f827667b-46fd-4fdf-a29f-5215aff12388","Type":"ContainerDied","Data":"dfbd6d8732a144a2d71950418f6064f08e9aa5d10d10696bab3e02069423433e"} Mar 16 15:56:06 crc kubenswrapper[5120]: I0316 15:56:06.328396 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dfbd6d8732a144a2d71950418f6064f08e9aa5d10d10696bab3e02069423433e" Mar 16 15:56:06 crc kubenswrapper[5120]: I0316 15:56:06.328392 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561276-zt964" Mar 16 15:56:06 crc kubenswrapper[5120]: I0316 15:56:06.347943 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-scheduler-0" podStartSLOduration=3.347925206 podStartE2EDuration="3.347925206s" podCreationTimestamp="2026-03-16 15:56:03 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:56:06.343186086 +0000 UTC m=+1468.497117743" watchObservedRunningTime="2026-03-16 15:56:06.347925206 +0000 UTC m=+1468.501856863" Mar 16 15:56:06 crc kubenswrapper[5120]: I0316 15:56:06.741648 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-infra/auto-csr-approver-29561270-5sfpd"] Mar 16 15:56:06 crc kubenswrapper[5120]: I0316 15:56:06.754529 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-infra/auto-csr-approver-29561270-5sfpd"] Mar 16 15:56:07 crc kubenswrapper[5120]: I0316 15:56:07.342556 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"c841556f-1fa5-4d42-9793-f0887efc2f51","Type":"ContainerStarted","Data":"933cb1b0b8a317a10f4b15ab72f19cd61f780358fa26e83b9b1049ae2855dbe1"} Mar 16 15:56:07 crc kubenswrapper[5120]: I0316 15:56:07.343127 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:56:07 crc kubenswrapper[5120]: I0316 15:56:07.347501 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe","Type":"ContainerStarted","Data":"d49fef7d81b2a23590eafc60fbe8293499b7ef16f3b6a651af145ba5b739fddb"} Mar 16 15:56:07 crc kubenswrapper[5120]: I0316 15:56:07.347549 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe","Type":"ContainerStarted","Data":"de6448102abdb4a197aec79c6edbcf87239ec4fa8fcb0c35a90a2e25c9d9d138"} Mar 16 15:56:07 crc kubenswrapper[5120]: I0316 15:56:07.348089 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:56:07 crc kubenswrapper[5120]: I0316 15:56:07.372002 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.21810206 podStartE2EDuration="7.37198793s" podCreationTimestamp="2026-03-16 15:56:00 +0000 UTC" firstStartedPulling="2026-03-16 15:56:01.501939105 +0000 UTC m=+1463.655870762" lastFinishedPulling="2026-03-16 15:56:06.655824975 +0000 UTC m=+1468.809756632" observedRunningTime="2026-03-16 15:56:07.365593533 +0000 UTC m=+1469.519525190" watchObservedRunningTime="2026-03-16 15:56:07.37198793 +0000 UTC m=+1469.525919587" Mar 16 15:56:07 crc kubenswrapper[5120]: I0316 15:56:07.387993 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-api-0" podStartSLOduration=3.387967223 podStartE2EDuration="3.387967223s" podCreationTimestamp="2026-03-16 15:56:04 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:56:07.381494313 +0000 UTC m=+1469.535425970" watchObservedRunningTime="2026-03-16 15:56:07.387967223 +0000 UTC m=+1469.541898890" Mar 16 15:56:07 crc kubenswrapper[5120]: I0316 15:56:07.746191 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-bcc6c568d-dqmvk" Mar 16 15:56:07 crc kubenswrapper[5120]: I0316 15:56:07.863821 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-bcc6c568d-dqmvk" Mar 16 15:56:07 crc kubenswrapper[5120]: I0316 15:56:07.970536 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-846956b868-5mw5q"] Mar 16 15:56:07 crc kubenswrapper[5120]: I0316 15:56:07.970966 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-846956b868-5mw5q" podUID="2bdcf641-1e8c-4994-8981-4db0f4c37973" containerName="barbican-api-log" containerID="cri-o://d6f7a1712d60e688b4b9ea58c2d56397e716e1646fb0fc20e79dbae343c202f2" gracePeriod=30 Mar 16 15:56:07 crc kubenswrapper[5120]: I0316 15:56:07.972126 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-846956b868-5mw5q" podUID="2bdcf641-1e8c-4994-8981-4db0f4c37973" containerName="barbican-api" containerID="cri-o://e3ced6f61d6c257b6542a0bbff241fccd765917c8b7ba3a38dfe4e78d09ee022" gracePeriod=30 Mar 16 15:56:08 crc kubenswrapper[5120]: E0316 15:56:08.293457 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1613505 actualBytes=10240 Mar 16 15:56:08 crc kubenswrapper[5120]: I0316 15:56:08.359696 5120 generic.go:358] "Generic (PLEG): container finished" podID="2bdcf641-1e8c-4994-8981-4db0f4c37973" containerID="d6f7a1712d60e688b4b9ea58c2d56397e716e1646fb0fc20e79dbae343c202f2" exitCode=143 Mar 16 15:56:08 crc kubenswrapper[5120]: I0316 15:56:08.359792 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-846956b868-5mw5q" event={"ID":"2bdcf641-1e8c-4994-8981-4db0f4c37973","Type":"ContainerDied","Data":"d6f7a1712d60e688b4b9ea58c2d56397e716e1646fb0fc20e79dbae343c202f2"} Mar 16 15:56:08 crc kubenswrapper[5120]: I0316 15:56:08.677250 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="110f0814-5d86-4605-aa7c-3d0687c4af18" path="/var/lib/kubelet/pods/110f0814-5d86-4605-aa7c-3d0687c4af18/volumes" Mar 16 15:56:08 crc kubenswrapper[5120]: I0316 15:56:08.842419 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 15:56:11 crc kubenswrapper[5120]: I0316 15:56:11.152611 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-846956b868-5mw5q" podUID="2bdcf641-1e8c-4994-8981-4db0f4c37973" containerName="barbican-api-log" probeResult="failure" output="Get \"http://10.217.0.255:9311/healthcheck\": read tcp 10.217.0.2:38778->10.217.0.255:9311: read: connection reset by peer" Mar 16 15:56:11 crc kubenswrapper[5120]: I0316 15:56:11.170972 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-operators-52mmv" Mar 16 15:56:11 crc kubenswrapper[5120]: I0316 15:56:11.171028 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-marketplace/redhat-operators-52mmv" Mar 16 15:56:11 crc kubenswrapper[5120]: I0316 15:56:11.229876 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-operators-52mmv" Mar 16 15:56:11 crc kubenswrapper[5120]: I0316 15:56:11.395841 5120 generic.go:358] "Generic (PLEG): container finished" podID="2bdcf641-1e8c-4994-8981-4db0f4c37973" containerID="e3ced6f61d6c257b6542a0bbff241fccd765917c8b7ba3a38dfe4e78d09ee022" exitCode=0 Mar 16 15:56:11 crc kubenswrapper[5120]: I0316 15:56:11.395931 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-846956b868-5mw5q" event={"ID":"2bdcf641-1e8c-4994-8981-4db0f4c37973","Type":"ContainerDied","Data":"e3ced6f61d6c257b6542a0bbff241fccd765917c8b7ba3a38dfe4e78d09ee022"} Mar 16 15:56:11 crc kubenswrapper[5120]: I0316 15:56:11.476829 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-operators-52mmv" Mar 16 15:56:11 crc kubenswrapper[5120]: I0316 15:56:11.533578 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-operators-52mmv"] Mar 16 15:56:11 crc kubenswrapper[5120]: I0316 15:56:11.654042 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-846956b868-5mw5q" Mar 16 15:56:11 crc kubenswrapper[5120]: I0316 15:56:11.793219 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2bdcf641-1e8c-4994-8981-4db0f4c37973-logs\") pod \"2bdcf641-1e8c-4994-8981-4db0f4c37973\" (UID: \"2bdcf641-1e8c-4994-8981-4db0f4c37973\") " Mar 16 15:56:11 crc kubenswrapper[5120]: I0316 15:56:11.793297 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rg5gd\" (UniqueName: \"kubernetes.io/projected/2bdcf641-1e8c-4994-8981-4db0f4c37973-kube-api-access-rg5gd\") pod \"2bdcf641-1e8c-4994-8981-4db0f4c37973\" (UID: \"2bdcf641-1e8c-4994-8981-4db0f4c37973\") " Mar 16 15:56:11 crc kubenswrapper[5120]: I0316 15:56:11.793523 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2bdcf641-1e8c-4994-8981-4db0f4c37973-config-data\") pod \"2bdcf641-1e8c-4994-8981-4db0f4c37973\" (UID: \"2bdcf641-1e8c-4994-8981-4db0f4c37973\") " Mar 16 15:56:11 crc kubenswrapper[5120]: I0316 15:56:11.793605 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2bdcf641-1e8c-4994-8981-4db0f4c37973-combined-ca-bundle\") pod \"2bdcf641-1e8c-4994-8981-4db0f4c37973\" (UID: \"2bdcf641-1e8c-4994-8981-4db0f4c37973\") " Mar 16 15:56:11 crc kubenswrapper[5120]: I0316 15:56:11.793704 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/2bdcf641-1e8c-4994-8981-4db0f4c37973-config-data-custom\") pod \"2bdcf641-1e8c-4994-8981-4db0f4c37973\" (UID: \"2bdcf641-1e8c-4994-8981-4db0f4c37973\") " Mar 16 15:56:11 crc kubenswrapper[5120]: I0316 15:56:11.794930 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2bdcf641-1e8c-4994-8981-4db0f4c37973-logs" (OuterVolumeSpecName: "logs") pod "2bdcf641-1e8c-4994-8981-4db0f4c37973" (UID: "2bdcf641-1e8c-4994-8981-4db0f4c37973"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:56:11 crc kubenswrapper[5120]: I0316 15:56:11.802273 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2bdcf641-1e8c-4994-8981-4db0f4c37973-kube-api-access-rg5gd" (OuterVolumeSpecName: "kube-api-access-rg5gd") pod "2bdcf641-1e8c-4994-8981-4db0f4c37973" (UID: "2bdcf641-1e8c-4994-8981-4db0f4c37973"). InnerVolumeSpecName "kube-api-access-rg5gd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:56:11 crc kubenswrapper[5120]: I0316 15:56:11.802788 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2bdcf641-1e8c-4994-8981-4db0f4c37973-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "2bdcf641-1e8c-4994-8981-4db0f4c37973" (UID: "2bdcf641-1e8c-4994-8981-4db0f4c37973"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:56:11 crc kubenswrapper[5120]: I0316 15:56:11.844042 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2bdcf641-1e8c-4994-8981-4db0f4c37973-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "2bdcf641-1e8c-4994-8981-4db0f4c37973" (UID: "2bdcf641-1e8c-4994-8981-4db0f4c37973"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:56:11 crc kubenswrapper[5120]: I0316 15:56:11.888729 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2bdcf641-1e8c-4994-8981-4db0f4c37973-config-data" (OuterVolumeSpecName: "config-data") pod "2bdcf641-1e8c-4994-8981-4db0f4c37973" (UID: "2bdcf641-1e8c-4994-8981-4db0f4c37973"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:56:11 crc kubenswrapper[5120]: I0316 15:56:11.896631 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/2bdcf641-1e8c-4994-8981-4db0f4c37973-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 15:56:11 crc kubenswrapper[5120]: I0316 15:56:11.896684 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2bdcf641-1e8c-4994-8981-4db0f4c37973-logs\") on node \"crc\" DevicePath \"\"" Mar 16 15:56:11 crc kubenswrapper[5120]: I0316 15:56:11.896704 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rg5gd\" (UniqueName: \"kubernetes.io/projected/2bdcf641-1e8c-4994-8981-4db0f4c37973-kube-api-access-rg5gd\") on node \"crc\" DevicePath \"\"" Mar 16 15:56:11 crc kubenswrapper[5120]: I0316 15:56:11.896725 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2bdcf641-1e8c-4994-8981-4db0f4c37973-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 15:56:11 crc kubenswrapper[5120]: I0316 15:56:11.896742 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2bdcf641-1e8c-4994-8981-4db0f4c37973-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:56:12 crc kubenswrapper[5120]: I0316 15:56:12.411531 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-846956b868-5mw5q" event={"ID":"2bdcf641-1e8c-4994-8981-4db0f4c37973","Type":"ContainerDied","Data":"d252cb1c6ea75f1bd1326c3ffb4c7519fed7e18975e4adf1ff6b150d04c07925"} Mar 16 15:56:12 crc kubenswrapper[5120]: I0316 15:56:12.411631 5120 scope.go:117] "RemoveContainer" containerID="e3ced6f61d6c257b6542a0bbff241fccd765917c8b7ba3a38dfe4e78d09ee022" Mar 16 15:56:12 crc kubenswrapper[5120]: I0316 15:56:12.411934 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-846956b868-5mw5q" Mar 16 15:56:12 crc kubenswrapper[5120]: I0316 15:56:12.450849 5120 scope.go:117] "RemoveContainer" containerID="d6f7a1712d60e688b4b9ea58c2d56397e716e1646fb0fc20e79dbae343c202f2" Mar 16 15:56:12 crc kubenswrapper[5120]: I0316 15:56:12.454336 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-846956b868-5mw5q"] Mar 16 15:56:12 crc kubenswrapper[5120]: I0316 15:56:12.463898 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-api-846956b868-5mw5q"] Mar 16 15:56:12 crc kubenswrapper[5120]: I0316 15:56:12.677335 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2bdcf641-1e8c-4994-8981-4db0f4c37973" path="/var/lib/kubelet/pods/2bdcf641-1e8c-4994-8981-4db0f4c37973/volumes" Mar 16 15:56:13 crc kubenswrapper[5120]: I0316 15:56:13.429556 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-marketplace/redhat-operators-52mmv" podUID="9b651009-4b48-4a98-a27e-71239d09da8a" containerName="registry-server" containerID="cri-o://030b64e6c15641cf63c49788978883ccbde376ebebfc32a145353d4a28fed672" gracePeriod=2 Mar 16 15:56:14 crc kubenswrapper[5120]: I0316 15:56:14.044225 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 15:56:14 crc kubenswrapper[5120]: I0316 15:56:14.048976 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-52mmv" Mar 16 15:56:14 crc kubenswrapper[5120]: I0316 15:56:14.146247 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mlnvm\" (UniqueName: \"kubernetes.io/projected/9b651009-4b48-4a98-a27e-71239d09da8a-kube-api-access-mlnvm\") pod \"9b651009-4b48-4a98-a27e-71239d09da8a\" (UID: \"9b651009-4b48-4a98-a27e-71239d09da8a\") " Mar 16 15:56:14 crc kubenswrapper[5120]: I0316 15:56:14.146505 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/9b651009-4b48-4a98-a27e-71239d09da8a-utilities\") pod \"9b651009-4b48-4a98-a27e-71239d09da8a\" (UID: \"9b651009-4b48-4a98-a27e-71239d09da8a\") " Mar 16 15:56:14 crc kubenswrapper[5120]: I0316 15:56:14.146643 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/9b651009-4b48-4a98-a27e-71239d09da8a-catalog-content\") pod \"9b651009-4b48-4a98-a27e-71239d09da8a\" (UID: \"9b651009-4b48-4a98-a27e-71239d09da8a\") " Mar 16 15:56:14 crc kubenswrapper[5120]: I0316 15:56:14.147485 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b651009-4b48-4a98-a27e-71239d09da8a-utilities" (OuterVolumeSpecName: "utilities") pod "9b651009-4b48-4a98-a27e-71239d09da8a" (UID: "9b651009-4b48-4a98-a27e-71239d09da8a"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:56:14 crc kubenswrapper[5120]: I0316 15:56:14.147586 5120 reconciler_common.go:299] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/9b651009-4b48-4a98-a27e-71239d09da8a-utilities\") on node \"crc\" DevicePath \"\"" Mar 16 15:56:14 crc kubenswrapper[5120]: I0316 15:56:14.163009 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b651009-4b48-4a98-a27e-71239d09da8a-kube-api-access-mlnvm" (OuterVolumeSpecName: "kube-api-access-mlnvm") pod "9b651009-4b48-4a98-a27e-71239d09da8a" (UID: "9b651009-4b48-4a98-a27e-71239d09da8a"). InnerVolumeSpecName "kube-api-access-mlnvm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:56:14 crc kubenswrapper[5120]: I0316 15:56:14.250033 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mlnvm\" (UniqueName: \"kubernetes.io/projected/9b651009-4b48-4a98-a27e-71239d09da8a-kube-api-access-mlnvm\") on node \"crc\" DevicePath \"\"" Mar 16 15:56:14 crc kubenswrapper[5120]: I0316 15:56:14.445165 5120 generic.go:358] "Generic (PLEG): container finished" podID="9b651009-4b48-4a98-a27e-71239d09da8a" containerID="030b64e6c15641cf63c49788978883ccbde376ebebfc32a145353d4a28fed672" exitCode=0 Mar 16 15:56:14 crc kubenswrapper[5120]: I0316 15:56:14.445337 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-52mmv" event={"ID":"9b651009-4b48-4a98-a27e-71239d09da8a","Type":"ContainerDied","Data":"030b64e6c15641cf63c49788978883ccbde376ebebfc32a145353d4a28fed672"} Mar 16 15:56:14 crc kubenswrapper[5120]: I0316 15:56:14.445705 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-52mmv" event={"ID":"9b651009-4b48-4a98-a27e-71239d09da8a","Type":"ContainerDied","Data":"7473f64e1962bab6c3692b94d405bd21f087bfbdf07ab4ffd44c21436e9c7372"} Mar 16 15:56:14 crc kubenswrapper[5120]: I0316 15:56:14.445742 5120 scope.go:117] "RemoveContainer" containerID="030b64e6c15641cf63c49788978883ccbde376ebebfc32a145353d4a28fed672" Mar 16 15:56:14 crc kubenswrapper[5120]: I0316 15:56:14.445396 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-52mmv" Mar 16 15:56:14 crc kubenswrapper[5120]: I0316 15:56:14.484817 5120 scope.go:117] "RemoveContainer" containerID="406615262e590f8a65d2650d8fd1a0a18bc05bc51a52ae392dce288f9b272a13" Mar 16 15:56:14 crc kubenswrapper[5120]: I0316 15:56:14.532552 5120 scope.go:117] "RemoveContainer" containerID="eb00610929f61a03c4858b4064fa5b98e6220c02906c968b99582c4ae0027257" Mar 16 15:56:14 crc kubenswrapper[5120]: I0316 15:56:14.581500 5120 scope.go:117] "RemoveContainer" containerID="030b64e6c15641cf63c49788978883ccbde376ebebfc32a145353d4a28fed672" Mar 16 15:56:14 crc kubenswrapper[5120]: E0316 15:56:14.582092 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"030b64e6c15641cf63c49788978883ccbde376ebebfc32a145353d4a28fed672\": container with ID starting with 030b64e6c15641cf63c49788978883ccbde376ebebfc32a145353d4a28fed672 not found: ID does not exist" containerID="030b64e6c15641cf63c49788978883ccbde376ebebfc32a145353d4a28fed672" Mar 16 15:56:14 crc kubenswrapper[5120]: I0316 15:56:14.582168 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"030b64e6c15641cf63c49788978883ccbde376ebebfc32a145353d4a28fed672"} err="failed to get container status \"030b64e6c15641cf63c49788978883ccbde376ebebfc32a145353d4a28fed672\": rpc error: code = NotFound desc = could not find container \"030b64e6c15641cf63c49788978883ccbde376ebebfc32a145353d4a28fed672\": container with ID starting with 030b64e6c15641cf63c49788978883ccbde376ebebfc32a145353d4a28fed672 not found: ID does not exist" Mar 16 15:56:14 crc kubenswrapper[5120]: I0316 15:56:14.582209 5120 scope.go:117] "RemoveContainer" containerID="406615262e590f8a65d2650d8fd1a0a18bc05bc51a52ae392dce288f9b272a13" Mar 16 15:56:14 crc kubenswrapper[5120]: E0316 15:56:14.582587 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"406615262e590f8a65d2650d8fd1a0a18bc05bc51a52ae392dce288f9b272a13\": container with ID starting with 406615262e590f8a65d2650d8fd1a0a18bc05bc51a52ae392dce288f9b272a13 not found: ID does not exist" containerID="406615262e590f8a65d2650d8fd1a0a18bc05bc51a52ae392dce288f9b272a13" Mar 16 15:56:14 crc kubenswrapper[5120]: I0316 15:56:14.582670 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"406615262e590f8a65d2650d8fd1a0a18bc05bc51a52ae392dce288f9b272a13"} err="failed to get container status \"406615262e590f8a65d2650d8fd1a0a18bc05bc51a52ae392dce288f9b272a13\": rpc error: code = NotFound desc = could not find container \"406615262e590f8a65d2650d8fd1a0a18bc05bc51a52ae392dce288f9b272a13\": container with ID starting with 406615262e590f8a65d2650d8fd1a0a18bc05bc51a52ae392dce288f9b272a13 not found: ID does not exist" Mar 16 15:56:14 crc kubenswrapper[5120]: I0316 15:56:14.582709 5120 scope.go:117] "RemoveContainer" containerID="eb00610929f61a03c4858b4064fa5b98e6220c02906c968b99582c4ae0027257" Mar 16 15:56:14 crc kubenswrapper[5120]: E0316 15:56:14.583387 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb00610929f61a03c4858b4064fa5b98e6220c02906c968b99582c4ae0027257\": container with ID starting with eb00610929f61a03c4858b4064fa5b98e6220c02906c968b99582c4ae0027257 not found: ID does not exist" containerID="eb00610929f61a03c4858b4064fa5b98e6220c02906c968b99582c4ae0027257" Mar 16 15:56:14 crc kubenswrapper[5120]: I0316 15:56:14.583452 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb00610929f61a03c4858b4064fa5b98e6220c02906c968b99582c4ae0027257"} err="failed to get container status \"eb00610929f61a03c4858b4064fa5b98e6220c02906c968b99582c4ae0027257\": rpc error: code = NotFound desc = could not find container \"eb00610929f61a03c4858b4064fa5b98e6220c02906c968b99582c4ae0027257\": container with ID starting with eb00610929f61a03c4858b4064fa5b98e6220c02906c968b99582c4ae0027257 not found: ID does not exist" Mar 16 15:56:15 crc kubenswrapper[5120]: I0316 15:56:15.330193 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 15:56:15 crc kubenswrapper[5120]: I0316 15:56:15.548469 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b651009-4b48-4a98-a27e-71239d09da8a-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "9b651009-4b48-4a98-a27e-71239d09da8a" (UID: "9b651009-4b48-4a98-a27e-71239d09da8a"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:56:15 crc kubenswrapper[5120]: I0316 15:56:15.602257 5120 reconciler_common.go:299] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/9b651009-4b48-4a98-a27e-71239d09da8a-catalog-content\") on node \"crc\" DevicePath \"\"" Mar 16 15:56:15 crc kubenswrapper[5120]: I0316 15:56:15.677751 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-operators-52mmv"] Mar 16 15:56:15 crc kubenswrapper[5120]: I0316 15:56:15.685647 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/redhat-operators-52mmv"] Mar 16 15:56:16 crc kubenswrapper[5120]: I0316 15:56:16.676509 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b651009-4b48-4a98-a27e-71239d09da8a" path="/var/lib/kubelet/pods/9b651009-4b48-4a98-a27e-71239d09da8a/volumes" Mar 16 15:56:20 crc kubenswrapper[5120]: I0316 15:56:20.682300 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/neutron-5df8bd5df5-8rzw7" Mar 16 15:56:21 crc kubenswrapper[5120]: I0316 15:56:21.695069 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/placement-65787d59d-nv5lb" Mar 16 15:56:22 crc kubenswrapper[5120]: I0316 15:56:22.008146 5120 patch_prober.go:28] interesting pod/machine-config-daemon-7bf76 container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 15:56:22 crc kubenswrapper[5120]: I0316 15:56:22.008232 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 15:56:22 crc kubenswrapper[5120]: I0316 15:56:22.603374 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/placement-65787d59d-nv5lb" Mar 16 15:56:22 crc kubenswrapper[5120]: I0316 15:56:22.869638 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-64b5fbbbdb-nrl4p"] Mar 16 15:56:22 crc kubenswrapper[5120]: I0316 15:56:22.870674 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2bdcf641-1e8c-4994-8981-4db0f4c37973" containerName="barbican-api" Mar 16 15:56:22 crc kubenswrapper[5120]: I0316 15:56:22.870693 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bdcf641-1e8c-4994-8981-4db0f4c37973" containerName="barbican-api" Mar 16 15:56:22 crc kubenswrapper[5120]: I0316 15:56:22.870706 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b651009-4b48-4a98-a27e-71239d09da8a" containerName="extract-content" Mar 16 15:56:22 crc kubenswrapper[5120]: I0316 15:56:22.870711 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b651009-4b48-4a98-a27e-71239d09da8a" containerName="extract-content" Mar 16 15:56:22 crc kubenswrapper[5120]: I0316 15:56:22.870722 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f827667b-46fd-4fdf-a29f-5215aff12388" containerName="oc" Mar 16 15:56:22 crc kubenswrapper[5120]: I0316 15:56:22.870729 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f827667b-46fd-4fdf-a29f-5215aff12388" containerName="oc" Mar 16 15:56:22 crc kubenswrapper[5120]: I0316 15:56:22.870749 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2bdcf641-1e8c-4994-8981-4db0f4c37973" containerName="barbican-api-log" Mar 16 15:56:22 crc kubenswrapper[5120]: I0316 15:56:22.870754 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bdcf641-1e8c-4994-8981-4db0f4c37973" containerName="barbican-api-log" Mar 16 15:56:22 crc kubenswrapper[5120]: I0316 15:56:22.870811 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b651009-4b48-4a98-a27e-71239d09da8a" containerName="registry-server" Mar 16 15:56:22 crc kubenswrapper[5120]: I0316 15:56:22.870816 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b651009-4b48-4a98-a27e-71239d09da8a" containerName="registry-server" Mar 16 15:56:22 crc kubenswrapper[5120]: I0316 15:56:22.870830 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b651009-4b48-4a98-a27e-71239d09da8a" containerName="extract-utilities" Mar 16 15:56:22 crc kubenswrapper[5120]: I0316 15:56:22.870835 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b651009-4b48-4a98-a27e-71239d09da8a" containerName="extract-utilities" Mar 16 15:56:22 crc kubenswrapper[5120]: I0316 15:56:22.871006 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="9b651009-4b48-4a98-a27e-71239d09da8a" containerName="registry-server" Mar 16 15:56:22 crc kubenswrapper[5120]: I0316 15:56:22.871018 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f827667b-46fd-4fdf-a29f-5215aff12388" containerName="oc" Mar 16 15:56:22 crc kubenswrapper[5120]: I0316 15:56:22.871028 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="2bdcf641-1e8c-4994-8981-4db0f4c37973" containerName="barbican-api" Mar 16 15:56:22 crc kubenswrapper[5120]: I0316 15:56:22.871037 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="2bdcf641-1e8c-4994-8981-4db0f4c37973" containerName="barbican-api-log" Mar 16 15:56:22 crc kubenswrapper[5120]: I0316 15:56:22.880988 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-64b5fbbbdb-nrl4p" Mar 16 15:56:22 crc kubenswrapper[5120]: I0316 15:56:22.888512 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-64b5fbbbdb-nrl4p"] Mar 16 15:56:22 crc kubenswrapper[5120]: I0316 15:56:22.970741 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/c3689d41-4ea9-4076-9b69-4a93be5896cf-public-tls-certs\") pod \"placement-64b5fbbbdb-nrl4p\" (UID: \"c3689d41-4ea9-4076-9b69-4a93be5896cf\") " pod="openstack-kuttl-tests/placement-64b5fbbbdb-nrl4p" Mar 16 15:56:22 crc kubenswrapper[5120]: I0316 15:56:22.970819 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c3689d41-4ea9-4076-9b69-4a93be5896cf-config-data\") pod \"placement-64b5fbbbdb-nrl4p\" (UID: \"c3689d41-4ea9-4076-9b69-4a93be5896cf\") " pod="openstack-kuttl-tests/placement-64b5fbbbdb-nrl4p" Mar 16 15:56:22 crc kubenswrapper[5120]: I0316 15:56:22.970978 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c3689d41-4ea9-4076-9b69-4a93be5896cf-scripts\") pod \"placement-64b5fbbbdb-nrl4p\" (UID: \"c3689d41-4ea9-4076-9b69-4a93be5896cf\") " pod="openstack-kuttl-tests/placement-64b5fbbbdb-nrl4p" Mar 16 15:56:22 crc kubenswrapper[5120]: I0316 15:56:22.971142 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c3689d41-4ea9-4076-9b69-4a93be5896cf-combined-ca-bundle\") pod \"placement-64b5fbbbdb-nrl4p\" (UID: \"c3689d41-4ea9-4076-9b69-4a93be5896cf\") " pod="openstack-kuttl-tests/placement-64b5fbbbdb-nrl4p" Mar 16 15:56:22 crc kubenswrapper[5120]: I0316 15:56:22.971178 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8nlw\" (UniqueName: \"kubernetes.io/projected/c3689d41-4ea9-4076-9b69-4a93be5896cf-kube-api-access-c8nlw\") pod \"placement-64b5fbbbdb-nrl4p\" (UID: \"c3689d41-4ea9-4076-9b69-4a93be5896cf\") " pod="openstack-kuttl-tests/placement-64b5fbbbdb-nrl4p" Mar 16 15:56:22 crc kubenswrapper[5120]: I0316 15:56:22.971212 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/c3689d41-4ea9-4076-9b69-4a93be5896cf-internal-tls-certs\") pod \"placement-64b5fbbbdb-nrl4p\" (UID: \"c3689d41-4ea9-4076-9b69-4a93be5896cf\") " pod="openstack-kuttl-tests/placement-64b5fbbbdb-nrl4p" Mar 16 15:56:22 crc kubenswrapper[5120]: I0316 15:56:22.971256 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c3689d41-4ea9-4076-9b69-4a93be5896cf-logs\") pod \"placement-64b5fbbbdb-nrl4p\" (UID: \"c3689d41-4ea9-4076-9b69-4a93be5896cf\") " pod="openstack-kuttl-tests/placement-64b5fbbbdb-nrl4p" Mar 16 15:56:23 crc kubenswrapper[5120]: I0316 15:56:23.072429 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c3689d41-4ea9-4076-9b69-4a93be5896cf-combined-ca-bundle\") pod \"placement-64b5fbbbdb-nrl4p\" (UID: \"c3689d41-4ea9-4076-9b69-4a93be5896cf\") " pod="openstack-kuttl-tests/placement-64b5fbbbdb-nrl4p" Mar 16 15:56:23 crc kubenswrapper[5120]: I0316 15:56:23.072473 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c8nlw\" (UniqueName: \"kubernetes.io/projected/c3689d41-4ea9-4076-9b69-4a93be5896cf-kube-api-access-c8nlw\") pod \"placement-64b5fbbbdb-nrl4p\" (UID: \"c3689d41-4ea9-4076-9b69-4a93be5896cf\") " pod="openstack-kuttl-tests/placement-64b5fbbbdb-nrl4p" Mar 16 15:56:23 crc kubenswrapper[5120]: I0316 15:56:23.072501 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/c3689d41-4ea9-4076-9b69-4a93be5896cf-internal-tls-certs\") pod \"placement-64b5fbbbdb-nrl4p\" (UID: \"c3689d41-4ea9-4076-9b69-4a93be5896cf\") " pod="openstack-kuttl-tests/placement-64b5fbbbdb-nrl4p" Mar 16 15:56:23 crc kubenswrapper[5120]: I0316 15:56:23.072530 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c3689d41-4ea9-4076-9b69-4a93be5896cf-logs\") pod \"placement-64b5fbbbdb-nrl4p\" (UID: \"c3689d41-4ea9-4076-9b69-4a93be5896cf\") " pod="openstack-kuttl-tests/placement-64b5fbbbdb-nrl4p" Mar 16 15:56:23 crc kubenswrapper[5120]: I0316 15:56:23.072595 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/c3689d41-4ea9-4076-9b69-4a93be5896cf-public-tls-certs\") pod \"placement-64b5fbbbdb-nrl4p\" (UID: \"c3689d41-4ea9-4076-9b69-4a93be5896cf\") " pod="openstack-kuttl-tests/placement-64b5fbbbdb-nrl4p" Mar 16 15:56:23 crc kubenswrapper[5120]: I0316 15:56:23.072617 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c3689d41-4ea9-4076-9b69-4a93be5896cf-config-data\") pod \"placement-64b5fbbbdb-nrl4p\" (UID: \"c3689d41-4ea9-4076-9b69-4a93be5896cf\") " pod="openstack-kuttl-tests/placement-64b5fbbbdb-nrl4p" Mar 16 15:56:23 crc kubenswrapper[5120]: I0316 15:56:23.072677 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c3689d41-4ea9-4076-9b69-4a93be5896cf-scripts\") pod \"placement-64b5fbbbdb-nrl4p\" (UID: \"c3689d41-4ea9-4076-9b69-4a93be5896cf\") " pod="openstack-kuttl-tests/placement-64b5fbbbdb-nrl4p" Mar 16 15:56:23 crc kubenswrapper[5120]: I0316 15:56:23.073082 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c3689d41-4ea9-4076-9b69-4a93be5896cf-logs\") pod \"placement-64b5fbbbdb-nrl4p\" (UID: \"c3689d41-4ea9-4076-9b69-4a93be5896cf\") " pod="openstack-kuttl-tests/placement-64b5fbbbdb-nrl4p" Mar 16 15:56:23 crc kubenswrapper[5120]: I0316 15:56:23.080328 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/c3689d41-4ea9-4076-9b69-4a93be5896cf-internal-tls-certs\") pod \"placement-64b5fbbbdb-nrl4p\" (UID: \"c3689d41-4ea9-4076-9b69-4a93be5896cf\") " pod="openstack-kuttl-tests/placement-64b5fbbbdb-nrl4p" Mar 16 15:56:23 crc kubenswrapper[5120]: I0316 15:56:23.080363 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/c3689d41-4ea9-4076-9b69-4a93be5896cf-public-tls-certs\") pod \"placement-64b5fbbbdb-nrl4p\" (UID: \"c3689d41-4ea9-4076-9b69-4a93be5896cf\") " pod="openstack-kuttl-tests/placement-64b5fbbbdb-nrl4p" Mar 16 15:56:23 crc kubenswrapper[5120]: I0316 15:56:23.081122 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c3689d41-4ea9-4076-9b69-4a93be5896cf-combined-ca-bundle\") pod \"placement-64b5fbbbdb-nrl4p\" (UID: \"c3689d41-4ea9-4076-9b69-4a93be5896cf\") " pod="openstack-kuttl-tests/placement-64b5fbbbdb-nrl4p" Mar 16 15:56:23 crc kubenswrapper[5120]: I0316 15:56:23.081225 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c3689d41-4ea9-4076-9b69-4a93be5896cf-config-data\") pod \"placement-64b5fbbbdb-nrl4p\" (UID: \"c3689d41-4ea9-4076-9b69-4a93be5896cf\") " pod="openstack-kuttl-tests/placement-64b5fbbbdb-nrl4p" Mar 16 15:56:23 crc kubenswrapper[5120]: I0316 15:56:23.089734 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8nlw\" (UniqueName: \"kubernetes.io/projected/c3689d41-4ea9-4076-9b69-4a93be5896cf-kube-api-access-c8nlw\") pod \"placement-64b5fbbbdb-nrl4p\" (UID: \"c3689d41-4ea9-4076-9b69-4a93be5896cf\") " pod="openstack-kuttl-tests/placement-64b5fbbbdb-nrl4p" Mar 16 15:56:23 crc kubenswrapper[5120]: I0316 15:56:23.094223 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c3689d41-4ea9-4076-9b69-4a93be5896cf-scripts\") pod \"placement-64b5fbbbdb-nrl4p\" (UID: \"c3689d41-4ea9-4076-9b69-4a93be5896cf\") " pod="openstack-kuttl-tests/placement-64b5fbbbdb-nrl4p" Mar 16 15:56:23 crc kubenswrapper[5120]: I0316 15:56:23.207249 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-64b5fbbbdb-nrl4p" Mar 16 15:56:23 crc kubenswrapper[5120]: I0316 15:56:23.703084 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-64b5fbbbdb-nrl4p"] Mar 16 15:56:23 crc kubenswrapper[5120]: W0316 15:56:23.707575 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc3689d41_4ea9_4076_9b69_4a93be5896cf.slice/crio-25166dc2cbc5426c6c653fd6146d65a74a6c27e77ea988c6eb294c1616747920 WatchSource:0}: Error finding container 25166dc2cbc5426c6c653fd6146d65a74a6c27e77ea988c6eb294c1616747920: Status 404 returned error can't find the container with id 25166dc2cbc5426c6c653fd6146d65a74a6c27e77ea988c6eb294c1616747920 Mar 16 15:56:24 crc kubenswrapper[5120]: I0316 15:56:24.578352 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-64b5fbbbdb-nrl4p" event={"ID":"c3689d41-4ea9-4076-9b69-4a93be5896cf","Type":"ContainerStarted","Data":"73eca197695f5d5d863dcbcf7fb679830074e97a2e5cb045f9230766c397bd55"} Mar 16 15:56:24 crc kubenswrapper[5120]: I0316 15:56:24.578618 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-64b5fbbbdb-nrl4p" event={"ID":"c3689d41-4ea9-4076-9b69-4a93be5896cf","Type":"ContainerStarted","Data":"ca1f5aaefb58de6d5c99abbb89a2f202aeabc9a7e3667dddb49bfe9cacae3d70"} Mar 16 15:56:24 crc kubenswrapper[5120]: I0316 15:56:24.578628 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-64b5fbbbdb-nrl4p" event={"ID":"c3689d41-4ea9-4076-9b69-4a93be5896cf","Type":"ContainerStarted","Data":"25166dc2cbc5426c6c653fd6146d65a74a6c27e77ea988c6eb294c1616747920"} Mar 16 15:56:24 crc kubenswrapper[5120]: I0316 15:56:24.579066 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-64b5fbbbdb-nrl4p" Mar 16 15:56:24 crc kubenswrapper[5120]: I0316 15:56:24.579110 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-64b5fbbbdb-nrl4p" Mar 16 15:56:24 crc kubenswrapper[5120]: I0316 15:56:24.606025 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-64b5fbbbdb-nrl4p" podStartSLOduration=2.605985608 podStartE2EDuration="2.605985608s" podCreationTimestamp="2026-03-16 15:56:22 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:56:24.600520437 +0000 UTC m=+1486.754452094" watchObservedRunningTime="2026-03-16 15:56:24.605985608 +0000 UTC m=+1486.759917275" Mar 16 15:56:27 crc kubenswrapper[5120]: I0316 15:56:27.168156 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/certified-operators-cknpd"] Mar 16 15:56:27 crc kubenswrapper[5120]: I0316 15:56:27.194520 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-cknpd" Mar 16 15:56:27 crc kubenswrapper[5120]: I0316 15:56:27.197654 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/certified-operators-cknpd"] Mar 16 15:56:27 crc kubenswrapper[5120]: I0316 15:56:27.385709 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/2bce8490-8143-4aad-a535-bb6315a95434-catalog-content\") pod \"certified-operators-cknpd\" (UID: \"2bce8490-8143-4aad-a535-bb6315a95434\") " pod="openshift-marketplace/certified-operators-cknpd" Mar 16 15:56:27 crc kubenswrapper[5120]: I0316 15:56:27.386196 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptrgn\" (UniqueName: \"kubernetes.io/projected/2bce8490-8143-4aad-a535-bb6315a95434-kube-api-access-ptrgn\") pod \"certified-operators-cknpd\" (UID: \"2bce8490-8143-4aad-a535-bb6315a95434\") " pod="openshift-marketplace/certified-operators-cknpd" Mar 16 15:56:27 crc kubenswrapper[5120]: I0316 15:56:27.386697 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/2bce8490-8143-4aad-a535-bb6315a95434-utilities\") pod \"certified-operators-cknpd\" (UID: \"2bce8490-8143-4aad-a535-bb6315a95434\") " pod="openshift-marketplace/certified-operators-cknpd" Mar 16 15:56:27 crc kubenswrapper[5120]: I0316 15:56:27.489306 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ptrgn\" (UniqueName: \"kubernetes.io/projected/2bce8490-8143-4aad-a535-bb6315a95434-kube-api-access-ptrgn\") pod \"certified-operators-cknpd\" (UID: \"2bce8490-8143-4aad-a535-bb6315a95434\") " pod="openshift-marketplace/certified-operators-cknpd" Mar 16 15:56:27 crc kubenswrapper[5120]: I0316 15:56:27.489524 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/2bce8490-8143-4aad-a535-bb6315a95434-utilities\") pod \"certified-operators-cknpd\" (UID: \"2bce8490-8143-4aad-a535-bb6315a95434\") " pod="openshift-marketplace/certified-operators-cknpd" Mar 16 15:56:27 crc kubenswrapper[5120]: I0316 15:56:27.489573 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/2bce8490-8143-4aad-a535-bb6315a95434-catalog-content\") pod \"certified-operators-cknpd\" (UID: \"2bce8490-8143-4aad-a535-bb6315a95434\") " pod="openshift-marketplace/certified-operators-cknpd" Mar 16 15:56:27 crc kubenswrapper[5120]: I0316 15:56:27.490113 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/2bce8490-8143-4aad-a535-bb6315a95434-utilities\") pod \"certified-operators-cknpd\" (UID: \"2bce8490-8143-4aad-a535-bb6315a95434\") " pod="openshift-marketplace/certified-operators-cknpd" Mar 16 15:56:27 crc kubenswrapper[5120]: I0316 15:56:27.490228 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/2bce8490-8143-4aad-a535-bb6315a95434-catalog-content\") pod \"certified-operators-cknpd\" (UID: \"2bce8490-8143-4aad-a535-bb6315a95434\") " pod="openshift-marketplace/certified-operators-cknpd" Mar 16 15:56:27 crc kubenswrapper[5120]: I0316 15:56:27.522013 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptrgn\" (UniqueName: \"kubernetes.io/projected/2bce8490-8143-4aad-a535-bb6315a95434-kube-api-access-ptrgn\") pod \"certified-operators-cknpd\" (UID: \"2bce8490-8143-4aad-a535-bb6315a95434\") " pod="openshift-marketplace/certified-operators-cknpd" Mar 16 15:56:27 crc kubenswrapper[5120]: I0316 15:56:27.548840 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-cknpd" Mar 16 15:56:28 crc kubenswrapper[5120]: I0316 15:56:28.111869 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/certified-operators-cknpd"] Mar 16 15:56:28 crc kubenswrapper[5120]: W0316 15:56:28.123668 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bce8490_8143_4aad_a535_bb6315a95434.slice/crio-7c84f9b878cab32c26f521ba24048756ac2298a3f704734738de1bb8323299ac WatchSource:0}: Error finding container 7c84f9b878cab32c26f521ba24048756ac2298a3f704734738de1bb8323299ac: Status 404 returned error can't find the container with id 7c84f9b878cab32c26f521ba24048756ac2298a3f704734738de1bb8323299ac Mar 16 15:56:28 crc kubenswrapper[5120]: I0316 15:56:28.653779 5120 generic.go:358] "Generic (PLEG): container finished" podID="2bce8490-8143-4aad-a535-bb6315a95434" containerID="edaa9d4618ff14fac9971efece6d04b93f86bbf1f29d7561193c6760c4cfa042" exitCode=0 Mar 16 15:56:28 crc kubenswrapper[5120]: I0316 15:56:28.654326 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-cknpd" event={"ID":"2bce8490-8143-4aad-a535-bb6315a95434","Type":"ContainerDied","Data":"edaa9d4618ff14fac9971efece6d04b93f86bbf1f29d7561193c6760c4cfa042"} Mar 16 15:56:28 crc kubenswrapper[5120]: I0316 15:56:28.654380 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-cknpd" event={"ID":"2bce8490-8143-4aad-a535-bb6315a95434","Type":"ContainerStarted","Data":"7c84f9b878cab32c26f521ba24048756ac2298a3f704734738de1bb8323299ac"} Mar 16 15:56:29 crc kubenswrapper[5120]: I0316 15:56:29.012352 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/neutron-5477dfc7d6-r85w6" Mar 16 15:56:29 crc kubenswrapper[5120]: I0316 15:56:29.096717 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-5df8bd5df5-8rzw7"] Mar 16 15:56:29 crc kubenswrapper[5120]: I0316 15:56:29.097551 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-5df8bd5df5-8rzw7" podUID="4fec53ab-7e98-41e6-8a5a-13a01e505e20" containerName="neutron-api" containerID="cri-o://bd83292dc770a59f89aa35588285d0e5be2a7afc961aef66bc722a86aecaf425" gracePeriod=30 Mar 16 15:56:29 crc kubenswrapper[5120]: I0316 15:56:29.098078 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-5df8bd5df5-8rzw7" podUID="4fec53ab-7e98-41e6-8a5a-13a01e505e20" containerName="neutron-httpd" containerID="cri-o://a7755c4f1c544f2beb5f82d3075c770789a49b4737465a58ab5d744f67bb5963" gracePeriod=30 Mar 16 15:56:29 crc kubenswrapper[5120]: I0316 15:56:29.256707 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/keystone-549cb9f7c8-crdfd" Mar 16 15:56:29 crc kubenswrapper[5120]: I0316 15:56:29.666165 5120 generic.go:358] "Generic (PLEG): container finished" podID="4fec53ab-7e98-41e6-8a5a-13a01e505e20" containerID="a7755c4f1c544f2beb5f82d3075c770789a49b4737465a58ab5d744f67bb5963" exitCode=0 Mar 16 15:56:29 crc kubenswrapper[5120]: I0316 15:56:29.666255 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-5df8bd5df5-8rzw7" event={"ID":"4fec53ab-7e98-41e6-8a5a-13a01e505e20","Type":"ContainerDied","Data":"a7755c4f1c544f2beb5f82d3075c770789a49b4737465a58ab5d744f67bb5963"} Mar 16 15:56:29 crc kubenswrapper[5120]: I0316 15:56:29.669147 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-cknpd" event={"ID":"2bce8490-8143-4aad-a535-bb6315a95434","Type":"ContainerStarted","Data":"017ac48a4c0b2eeedb40dac0e87f00e09e790ac0d3f995dd5c2bcd0ecd37512d"} Mar 16 15:56:30 crc kubenswrapper[5120]: I0316 15:56:30.335806 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 15:56:30 crc kubenswrapper[5120]: I0316 15:56:30.342501 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Mar 16 15:56:30 crc kubenswrapper[5120]: I0316 15:56:30.346896 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"openstackclient-openstackclient-dockercfg-mlb4l\"" Mar 16 15:56:30 crc kubenswrapper[5120]: I0316 15:56:30.347267 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"openstack-config-secret\"" Mar 16 15:56:30 crc kubenswrapper[5120]: I0316 15:56:30.348844 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-config\"" Mar 16 15:56:30 crc kubenswrapper[5120]: I0316 15:56:30.355214 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 15:56:30 crc kubenswrapper[5120]: I0316 15:56:30.369226 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tsqxx\" (UniqueName: \"kubernetes.io/projected/b5ed0fd6-65dd-4480-acce-2eb38249add6-kube-api-access-tsqxx\") pod \"openstackclient\" (UID: \"b5ed0fd6-65dd-4480-acce-2eb38249add6\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 15:56:30 crc kubenswrapper[5120]: I0316 15:56:30.369391 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/b5ed0fd6-65dd-4480-acce-2eb38249add6-openstack-config-secret\") pod \"openstackclient\" (UID: \"b5ed0fd6-65dd-4480-acce-2eb38249add6\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 15:56:30 crc kubenswrapper[5120]: I0316 15:56:30.369830 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/b5ed0fd6-65dd-4480-acce-2eb38249add6-openstack-config\") pod \"openstackclient\" (UID: \"b5ed0fd6-65dd-4480-acce-2eb38249add6\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 15:56:30 crc kubenswrapper[5120]: I0316 15:56:30.369899 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b5ed0fd6-65dd-4480-acce-2eb38249add6-combined-ca-bundle\") pod \"openstackclient\" (UID: \"b5ed0fd6-65dd-4480-acce-2eb38249add6\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 15:56:30 crc kubenswrapper[5120]: I0316 15:56:30.473747 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/b5ed0fd6-65dd-4480-acce-2eb38249add6-openstack-config\") pod \"openstackclient\" (UID: \"b5ed0fd6-65dd-4480-acce-2eb38249add6\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 15:56:30 crc kubenswrapper[5120]: I0316 15:56:30.474121 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b5ed0fd6-65dd-4480-acce-2eb38249add6-combined-ca-bundle\") pod \"openstackclient\" (UID: \"b5ed0fd6-65dd-4480-acce-2eb38249add6\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 15:56:30 crc kubenswrapper[5120]: I0316 15:56:30.474496 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/b5ed0fd6-65dd-4480-acce-2eb38249add6-openstack-config\") pod \"openstackclient\" (UID: \"b5ed0fd6-65dd-4480-acce-2eb38249add6\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 15:56:30 crc kubenswrapper[5120]: I0316 15:56:30.474575 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tsqxx\" (UniqueName: \"kubernetes.io/projected/b5ed0fd6-65dd-4480-acce-2eb38249add6-kube-api-access-tsqxx\") pod \"openstackclient\" (UID: \"b5ed0fd6-65dd-4480-acce-2eb38249add6\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 15:56:30 crc kubenswrapper[5120]: I0316 15:56:30.474656 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/b5ed0fd6-65dd-4480-acce-2eb38249add6-openstack-config-secret\") pod \"openstackclient\" (UID: \"b5ed0fd6-65dd-4480-acce-2eb38249add6\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 15:56:30 crc kubenswrapper[5120]: I0316 15:56:30.483496 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b5ed0fd6-65dd-4480-acce-2eb38249add6-combined-ca-bundle\") pod \"openstackclient\" (UID: \"b5ed0fd6-65dd-4480-acce-2eb38249add6\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 15:56:30 crc kubenswrapper[5120]: I0316 15:56:30.483836 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/b5ed0fd6-65dd-4480-acce-2eb38249add6-openstack-config-secret\") pod \"openstackclient\" (UID: \"b5ed0fd6-65dd-4480-acce-2eb38249add6\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 15:56:30 crc kubenswrapper[5120]: I0316 15:56:30.498080 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tsqxx\" (UniqueName: \"kubernetes.io/projected/b5ed0fd6-65dd-4480-acce-2eb38249add6-kube-api-access-tsqxx\") pod \"openstackclient\" (UID: \"b5ed0fd6-65dd-4480-acce-2eb38249add6\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 15:56:30 crc kubenswrapper[5120]: I0316 15:56:30.678102 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Mar 16 15:56:30 crc kubenswrapper[5120]: I0316 15:56:30.684748 5120 generic.go:358] "Generic (PLEG): container finished" podID="2bce8490-8143-4aad-a535-bb6315a95434" containerID="017ac48a4c0b2eeedb40dac0e87f00e09e790ac0d3f995dd5c2bcd0ecd37512d" exitCode=0 Mar 16 15:56:30 crc kubenswrapper[5120]: I0316 15:56:30.685015 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-cknpd" event={"ID":"2bce8490-8143-4aad-a535-bb6315a95434","Type":"ContainerDied","Data":"017ac48a4c0b2eeedb40dac0e87f00e09e790ac0d3f995dd5c2bcd0ecd37512d"} Mar 16 15:56:31 crc kubenswrapper[5120]: I0316 15:56:31.317174 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 15:56:31 crc kubenswrapper[5120]: I0316 15:56:31.697156 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstackclient" event={"ID":"b5ed0fd6-65dd-4480-acce-2eb38249add6","Type":"ContainerStarted","Data":"faa88e5970c0bf9c643f2180f59a90ed1f8b8a4a6cfd93741f962f1d1a9cacdc"} Mar 16 15:56:31 crc kubenswrapper[5120]: I0316 15:56:31.699541 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstackclient" event={"ID":"b5ed0fd6-65dd-4480-acce-2eb38249add6","Type":"ContainerStarted","Data":"49986ee726139ad2cb85ca1cce9628f1976738526c92a10260fc6b6d084f3ad0"} Mar 16 15:56:31 crc kubenswrapper[5120]: I0316 15:56:31.701006 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-cknpd" event={"ID":"2bce8490-8143-4aad-a535-bb6315a95434","Type":"ContainerStarted","Data":"bd7f88b75b8287e83660979835f2d24ab9e1334b50c87c8eba90ac891fa2c5bb"} Mar 16 15:56:31 crc kubenswrapper[5120]: I0316 15:56:31.718609 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstackclient" podStartSLOduration=1.718592719 podStartE2EDuration="1.718592719s" podCreationTimestamp="2026-03-16 15:56:30 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:56:31.715636367 +0000 UTC m=+1493.869568024" watchObservedRunningTime="2026-03-16 15:56:31.718592719 +0000 UTC m=+1493.872524376" Mar 16 15:56:31 crc kubenswrapper[5120]: I0316 15:56:31.744021 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/certified-operators-cknpd" podStartSLOduration=4.031470348 podStartE2EDuration="4.744002543s" podCreationTimestamp="2026-03-16 15:56:27 +0000 UTC" firstStartedPulling="2026-03-16 15:56:28.656320672 +0000 UTC m=+1490.810252369" lastFinishedPulling="2026-03-16 15:56:29.368852907 +0000 UTC m=+1491.522784564" observedRunningTime="2026-03-16 15:56:31.737101211 +0000 UTC m=+1493.891032868" watchObservedRunningTime="2026-03-16 15:56:31.744002543 +0000 UTC m=+1493.897934200" Mar 16 15:56:32 crc kubenswrapper[5120]: I0316 15:56:32.228428 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-5df8bd5df5-8rzw7" Mar 16 15:56:32 crc kubenswrapper[5120]: I0316 15:56:32.331886 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4fec53ab-7e98-41e6-8a5a-13a01e505e20-combined-ca-bundle\") pod \"4fec53ab-7e98-41e6-8a5a-13a01e505e20\" (UID: \"4fec53ab-7e98-41e6-8a5a-13a01e505e20\") " Mar 16 15:56:32 crc kubenswrapper[5120]: I0316 15:56:32.332001 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4fec53ab-7e98-41e6-8a5a-13a01e505e20-config\") pod \"4fec53ab-7e98-41e6-8a5a-13a01e505e20\" (UID: \"4fec53ab-7e98-41e6-8a5a-13a01e505e20\") " Mar 16 15:56:32 crc kubenswrapper[5120]: I0316 15:56:32.332078 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fjvc9\" (UniqueName: \"kubernetes.io/projected/4fec53ab-7e98-41e6-8a5a-13a01e505e20-kube-api-access-fjvc9\") pod \"4fec53ab-7e98-41e6-8a5a-13a01e505e20\" (UID: \"4fec53ab-7e98-41e6-8a5a-13a01e505e20\") " Mar 16 15:56:32 crc kubenswrapper[5120]: I0316 15:56:32.332286 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/4fec53ab-7e98-41e6-8a5a-13a01e505e20-httpd-config\") pod \"4fec53ab-7e98-41e6-8a5a-13a01e505e20\" (UID: \"4fec53ab-7e98-41e6-8a5a-13a01e505e20\") " Mar 16 15:56:32 crc kubenswrapper[5120]: I0316 15:56:32.332521 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/4fec53ab-7e98-41e6-8a5a-13a01e505e20-ovndb-tls-certs\") pod \"4fec53ab-7e98-41e6-8a5a-13a01e505e20\" (UID: \"4fec53ab-7e98-41e6-8a5a-13a01e505e20\") " Mar 16 15:56:32 crc kubenswrapper[5120]: I0316 15:56:32.339618 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4fec53ab-7e98-41e6-8a5a-13a01e505e20-httpd-config" (OuterVolumeSpecName: "httpd-config") pod "4fec53ab-7e98-41e6-8a5a-13a01e505e20" (UID: "4fec53ab-7e98-41e6-8a5a-13a01e505e20"). InnerVolumeSpecName "httpd-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:56:32 crc kubenswrapper[5120]: I0316 15:56:32.339930 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4fec53ab-7e98-41e6-8a5a-13a01e505e20-kube-api-access-fjvc9" (OuterVolumeSpecName: "kube-api-access-fjvc9") pod "4fec53ab-7e98-41e6-8a5a-13a01e505e20" (UID: "4fec53ab-7e98-41e6-8a5a-13a01e505e20"). InnerVolumeSpecName "kube-api-access-fjvc9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:56:32 crc kubenswrapper[5120]: I0316 15:56:32.399082 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4fec53ab-7e98-41e6-8a5a-13a01e505e20-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "4fec53ab-7e98-41e6-8a5a-13a01e505e20" (UID: "4fec53ab-7e98-41e6-8a5a-13a01e505e20"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:56:32 crc kubenswrapper[5120]: I0316 15:56:32.408058 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4fec53ab-7e98-41e6-8a5a-13a01e505e20-config" (OuterVolumeSpecName: "config") pod "4fec53ab-7e98-41e6-8a5a-13a01e505e20" (UID: "4fec53ab-7e98-41e6-8a5a-13a01e505e20"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:56:32 crc kubenswrapper[5120]: I0316 15:56:32.434902 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/4fec53ab-7e98-41e6-8a5a-13a01e505e20-httpd-config\") on node \"crc\" DevicePath \"\"" Mar 16 15:56:32 crc kubenswrapper[5120]: I0316 15:56:32.434940 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4fec53ab-7e98-41e6-8a5a-13a01e505e20-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:56:32 crc kubenswrapper[5120]: I0316 15:56:32.434955 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/4fec53ab-7e98-41e6-8a5a-13a01e505e20-config\") on node \"crc\" DevicePath \"\"" Mar 16 15:56:32 crc kubenswrapper[5120]: I0316 15:56:32.434964 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fjvc9\" (UniqueName: \"kubernetes.io/projected/4fec53ab-7e98-41e6-8a5a-13a01e505e20-kube-api-access-fjvc9\") on node \"crc\" DevicePath \"\"" Mar 16 15:56:32 crc kubenswrapper[5120]: I0316 15:56:32.440881 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4fec53ab-7e98-41e6-8a5a-13a01e505e20-ovndb-tls-certs" (OuterVolumeSpecName: "ovndb-tls-certs") pod "4fec53ab-7e98-41e6-8a5a-13a01e505e20" (UID: "4fec53ab-7e98-41e6-8a5a-13a01e505e20"). InnerVolumeSpecName "ovndb-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:56:32 crc kubenswrapper[5120]: I0316 15:56:32.536675 5120 reconciler_common.go:299] "Volume detached for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/4fec53ab-7e98-41e6-8a5a-13a01e505e20-ovndb-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 15:56:32 crc kubenswrapper[5120]: I0316 15:56:32.730922 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-5df8bd5df5-8rzw7" Mar 16 15:56:32 crc kubenswrapper[5120]: I0316 15:56:32.730947 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-5df8bd5df5-8rzw7" event={"ID":"4fec53ab-7e98-41e6-8a5a-13a01e505e20","Type":"ContainerDied","Data":"bd83292dc770a59f89aa35588285d0e5be2a7afc961aef66bc722a86aecaf425"} Mar 16 15:56:32 crc kubenswrapper[5120]: I0316 15:56:32.731465 5120 scope.go:117] "RemoveContainer" containerID="a7755c4f1c544f2beb5f82d3075c770789a49b4737465a58ab5d744f67bb5963" Mar 16 15:56:32 crc kubenswrapper[5120]: I0316 15:56:32.730831 5120 generic.go:358] "Generic (PLEG): container finished" podID="4fec53ab-7e98-41e6-8a5a-13a01e505e20" containerID="bd83292dc770a59f89aa35588285d0e5be2a7afc961aef66bc722a86aecaf425" exitCode=0 Mar 16 15:56:32 crc kubenswrapper[5120]: I0316 15:56:32.732053 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-5df8bd5df5-8rzw7" event={"ID":"4fec53ab-7e98-41e6-8a5a-13a01e505e20","Type":"ContainerDied","Data":"a837d5d6f572798f6fa99d98aa8e80f904f874210f2a45d248501c7729d4c514"} Mar 16 15:56:32 crc kubenswrapper[5120]: I0316 15:56:32.768980 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-5df8bd5df5-8rzw7"] Mar 16 15:56:32 crc kubenswrapper[5120]: I0316 15:56:32.774661 5120 scope.go:117] "RemoveContainer" containerID="bd83292dc770a59f89aa35588285d0e5be2a7afc961aef66bc722a86aecaf425" Mar 16 15:56:32 crc kubenswrapper[5120]: I0316 15:56:32.779681 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-5df8bd5df5-8rzw7"] Mar 16 15:56:32 crc kubenswrapper[5120]: I0316 15:56:32.809570 5120 scope.go:117] "RemoveContainer" containerID="a7755c4f1c544f2beb5f82d3075c770789a49b4737465a58ab5d744f67bb5963" Mar 16 15:56:32 crc kubenswrapper[5120]: E0316 15:56:32.813901 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a7755c4f1c544f2beb5f82d3075c770789a49b4737465a58ab5d744f67bb5963\": container with ID starting with a7755c4f1c544f2beb5f82d3075c770789a49b4737465a58ab5d744f67bb5963 not found: ID does not exist" containerID="a7755c4f1c544f2beb5f82d3075c770789a49b4737465a58ab5d744f67bb5963" Mar 16 15:56:32 crc kubenswrapper[5120]: I0316 15:56:32.813971 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7755c4f1c544f2beb5f82d3075c770789a49b4737465a58ab5d744f67bb5963"} err="failed to get container status \"a7755c4f1c544f2beb5f82d3075c770789a49b4737465a58ab5d744f67bb5963\": rpc error: code = NotFound desc = could not find container \"a7755c4f1c544f2beb5f82d3075c770789a49b4737465a58ab5d744f67bb5963\": container with ID starting with a7755c4f1c544f2beb5f82d3075c770789a49b4737465a58ab5d744f67bb5963 not found: ID does not exist" Mar 16 15:56:32 crc kubenswrapper[5120]: I0316 15:56:32.814002 5120 scope.go:117] "RemoveContainer" containerID="bd83292dc770a59f89aa35588285d0e5be2a7afc961aef66bc722a86aecaf425" Mar 16 15:56:32 crc kubenswrapper[5120]: E0316 15:56:32.816659 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd83292dc770a59f89aa35588285d0e5be2a7afc961aef66bc722a86aecaf425\": container with ID starting with bd83292dc770a59f89aa35588285d0e5be2a7afc961aef66bc722a86aecaf425 not found: ID does not exist" containerID="bd83292dc770a59f89aa35588285d0e5be2a7afc961aef66bc722a86aecaf425" Mar 16 15:56:32 crc kubenswrapper[5120]: I0316 15:56:32.816707 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd83292dc770a59f89aa35588285d0e5be2a7afc961aef66bc722a86aecaf425"} err="failed to get container status \"bd83292dc770a59f89aa35588285d0e5be2a7afc961aef66bc722a86aecaf425\": rpc error: code = NotFound desc = could not find container \"bd83292dc770a59f89aa35588285d0e5be2a7afc961aef66bc722a86aecaf425\": container with ID starting with bd83292dc770a59f89aa35588285d0e5be2a7afc961aef66bc722a86aecaf425 not found: ID does not exist" Mar 16 15:56:33 crc kubenswrapper[5120]: I0316 15:56:33.141919 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-marketplace-xqwmf"] Mar 16 15:56:33 crc kubenswrapper[5120]: I0316 15:56:33.142932 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4fec53ab-7e98-41e6-8a5a-13a01e505e20" containerName="neutron-api" Mar 16 15:56:33 crc kubenswrapper[5120]: I0316 15:56:33.142959 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="4fec53ab-7e98-41e6-8a5a-13a01e505e20" containerName="neutron-api" Mar 16 15:56:33 crc kubenswrapper[5120]: I0316 15:56:33.142993 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4fec53ab-7e98-41e6-8a5a-13a01e505e20" containerName="neutron-httpd" Mar 16 15:56:33 crc kubenswrapper[5120]: I0316 15:56:33.143002 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="4fec53ab-7e98-41e6-8a5a-13a01e505e20" containerName="neutron-httpd" Mar 16 15:56:33 crc kubenswrapper[5120]: I0316 15:56:33.143180 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="4fec53ab-7e98-41e6-8a5a-13a01e505e20" containerName="neutron-httpd" Mar 16 15:56:33 crc kubenswrapper[5120]: I0316 15:56:33.143205 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="4fec53ab-7e98-41e6-8a5a-13a01e505e20" containerName="neutron-api" Mar 16 15:56:33 crc kubenswrapper[5120]: I0316 15:56:33.150898 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-xqwmf" Mar 16 15:56:33 crc kubenswrapper[5120]: I0316 15:56:33.155803 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-xqwmf"] Mar 16 15:56:33 crc kubenswrapper[5120]: I0316 15:56:33.253548 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/7e05eef7-7c4c-4faa-809a-2fa10da8f360-catalog-content\") pod \"redhat-marketplace-xqwmf\" (UID: \"7e05eef7-7c4c-4faa-809a-2fa10da8f360\") " pod="openshift-marketplace/redhat-marketplace-xqwmf" Mar 16 15:56:33 crc kubenswrapper[5120]: I0316 15:56:33.254191 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28csq\" (UniqueName: \"kubernetes.io/projected/7e05eef7-7c4c-4faa-809a-2fa10da8f360-kube-api-access-28csq\") pod \"redhat-marketplace-xqwmf\" (UID: \"7e05eef7-7c4c-4faa-809a-2fa10da8f360\") " pod="openshift-marketplace/redhat-marketplace-xqwmf" Mar 16 15:56:33 crc kubenswrapper[5120]: I0316 15:56:33.254485 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/7e05eef7-7c4c-4faa-809a-2fa10da8f360-utilities\") pod \"redhat-marketplace-xqwmf\" (UID: \"7e05eef7-7c4c-4faa-809a-2fa10da8f360\") " pod="openshift-marketplace/redhat-marketplace-xqwmf" Mar 16 15:56:33 crc kubenswrapper[5120]: I0316 15:56:33.356364 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/7e05eef7-7c4c-4faa-809a-2fa10da8f360-catalog-content\") pod \"redhat-marketplace-xqwmf\" (UID: \"7e05eef7-7c4c-4faa-809a-2fa10da8f360\") " pod="openshift-marketplace/redhat-marketplace-xqwmf" Mar 16 15:56:33 crc kubenswrapper[5120]: I0316 15:56:33.356489 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-28csq\" (UniqueName: \"kubernetes.io/projected/7e05eef7-7c4c-4faa-809a-2fa10da8f360-kube-api-access-28csq\") pod \"redhat-marketplace-xqwmf\" (UID: \"7e05eef7-7c4c-4faa-809a-2fa10da8f360\") " pod="openshift-marketplace/redhat-marketplace-xqwmf" Mar 16 15:56:33 crc kubenswrapper[5120]: I0316 15:56:33.356913 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/7e05eef7-7c4c-4faa-809a-2fa10da8f360-utilities\") pod \"redhat-marketplace-xqwmf\" (UID: \"7e05eef7-7c4c-4faa-809a-2fa10da8f360\") " pod="openshift-marketplace/redhat-marketplace-xqwmf" Mar 16 15:56:33 crc kubenswrapper[5120]: I0316 15:56:33.356981 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/7e05eef7-7c4c-4faa-809a-2fa10da8f360-catalog-content\") pod \"redhat-marketplace-xqwmf\" (UID: \"7e05eef7-7c4c-4faa-809a-2fa10da8f360\") " pod="openshift-marketplace/redhat-marketplace-xqwmf" Mar 16 15:56:33 crc kubenswrapper[5120]: I0316 15:56:33.357338 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/7e05eef7-7c4c-4faa-809a-2fa10da8f360-utilities\") pod \"redhat-marketplace-xqwmf\" (UID: \"7e05eef7-7c4c-4faa-809a-2fa10da8f360\") " pod="openshift-marketplace/redhat-marketplace-xqwmf" Mar 16 15:56:33 crc kubenswrapper[5120]: I0316 15:56:33.385368 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-28csq\" (UniqueName: \"kubernetes.io/projected/7e05eef7-7c4c-4faa-809a-2fa10da8f360-kube-api-access-28csq\") pod \"redhat-marketplace-xqwmf\" (UID: \"7e05eef7-7c4c-4faa-809a-2fa10da8f360\") " pod="openshift-marketplace/redhat-marketplace-xqwmf" Mar 16 15:56:33 crc kubenswrapper[5120]: I0316 15:56:33.477212 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-xqwmf" Mar 16 15:56:33 crc kubenswrapper[5120]: I0316 15:56:33.836526 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/swift-proxy-59f58b5b58-tw7qc"] Mar 16 15:56:33 crc kubenswrapper[5120]: I0316 15:56:33.847949 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-59f58b5b58-tw7qc" Mar 16 15:56:33 crc kubenswrapper[5120]: I0316 15:56:33.849748 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-swift-public-svc\"" Mar 16 15:56:33 crc kubenswrapper[5120]: I0316 15:56:33.850446 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"swift-proxy-config-data\"" Mar 16 15:56:33 crc kubenswrapper[5120]: I0316 15:56:33.850925 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-swift-internal-svc\"" Mar 16 15:56:33 crc kubenswrapper[5120]: I0316 15:56:33.855413 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-proxy-59f58b5b58-tw7qc"] Mar 16 15:56:33 crc kubenswrapper[5120]: I0316 15:56:33.936659 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-xqwmf"] Mar 16 15:56:33 crc kubenswrapper[5120]: W0316 15:56:33.943576 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e05eef7_7c4c_4faa_809a_2fa10da8f360.slice/crio-29123e470b80e4e2fbb19c9ba57c85a786c38b6daa2015a68656b1c03a60c177 WatchSource:0}: Error finding container 29123e470b80e4e2fbb19c9ba57c85a786c38b6daa2015a68656b1c03a60c177: Status 404 returned error can't find the container with id 29123e470b80e4e2fbb19c9ba57c85a786c38b6daa2015a68656b1c03a60c177 Mar 16 15:56:33 crc kubenswrapper[5120]: I0316 15:56:33.968669 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2e562dac-a1db-446c-b73a-21df22608a50-run-httpd\") pod \"swift-proxy-59f58b5b58-tw7qc\" (UID: \"2e562dac-a1db-446c-b73a-21df22608a50\") " pod="openstack-kuttl-tests/swift-proxy-59f58b5b58-tw7qc" Mar 16 15:56:33 crc kubenswrapper[5120]: I0316 15:56:33.968830 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2e562dac-a1db-446c-b73a-21df22608a50-config-data\") pod \"swift-proxy-59f58b5b58-tw7qc\" (UID: \"2e562dac-a1db-446c-b73a-21df22608a50\") " pod="openstack-kuttl-tests/swift-proxy-59f58b5b58-tw7qc" Mar 16 15:56:33 crc kubenswrapper[5120]: I0316 15:56:33.968867 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2e562dac-a1db-446c-b73a-21df22608a50-combined-ca-bundle\") pod \"swift-proxy-59f58b5b58-tw7qc\" (UID: \"2e562dac-a1db-446c-b73a-21df22608a50\") " pod="openstack-kuttl-tests/swift-proxy-59f58b5b58-tw7qc" Mar 16 15:56:33 crc kubenswrapper[5120]: I0316 15:56:33.968891 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2e562dac-a1db-446c-b73a-21df22608a50-log-httpd\") pod \"swift-proxy-59f58b5b58-tw7qc\" (UID: \"2e562dac-a1db-446c-b73a-21df22608a50\") " pod="openstack-kuttl-tests/swift-proxy-59f58b5b58-tw7qc" Mar 16 15:56:33 crc kubenswrapper[5120]: I0316 15:56:33.969169 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/2e562dac-a1db-446c-b73a-21df22608a50-etc-swift\") pod \"swift-proxy-59f58b5b58-tw7qc\" (UID: \"2e562dac-a1db-446c-b73a-21df22608a50\") " pod="openstack-kuttl-tests/swift-proxy-59f58b5b58-tw7qc" Mar 16 15:56:33 crc kubenswrapper[5120]: I0316 15:56:33.969410 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/2e562dac-a1db-446c-b73a-21df22608a50-public-tls-certs\") pod \"swift-proxy-59f58b5b58-tw7qc\" (UID: \"2e562dac-a1db-446c-b73a-21df22608a50\") " pod="openstack-kuttl-tests/swift-proxy-59f58b5b58-tw7qc" Mar 16 15:56:33 crc kubenswrapper[5120]: I0316 15:56:33.969504 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/2e562dac-a1db-446c-b73a-21df22608a50-internal-tls-certs\") pod \"swift-proxy-59f58b5b58-tw7qc\" (UID: \"2e562dac-a1db-446c-b73a-21df22608a50\") " pod="openstack-kuttl-tests/swift-proxy-59f58b5b58-tw7qc" Mar 16 15:56:33 crc kubenswrapper[5120]: I0316 15:56:33.969649 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ff76x\" (UniqueName: \"kubernetes.io/projected/2e562dac-a1db-446c-b73a-21df22608a50-kube-api-access-ff76x\") pod \"swift-proxy-59f58b5b58-tw7qc\" (UID: \"2e562dac-a1db-446c-b73a-21df22608a50\") " pod="openstack-kuttl-tests/swift-proxy-59f58b5b58-tw7qc" Mar 16 15:56:34 crc kubenswrapper[5120]: I0316 15:56:34.071416 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2e562dac-a1db-446c-b73a-21df22608a50-config-data\") pod \"swift-proxy-59f58b5b58-tw7qc\" (UID: \"2e562dac-a1db-446c-b73a-21df22608a50\") " pod="openstack-kuttl-tests/swift-proxy-59f58b5b58-tw7qc" Mar 16 15:56:34 crc kubenswrapper[5120]: I0316 15:56:34.071468 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2e562dac-a1db-446c-b73a-21df22608a50-combined-ca-bundle\") pod \"swift-proxy-59f58b5b58-tw7qc\" (UID: \"2e562dac-a1db-446c-b73a-21df22608a50\") " pod="openstack-kuttl-tests/swift-proxy-59f58b5b58-tw7qc" Mar 16 15:56:34 crc kubenswrapper[5120]: I0316 15:56:34.071489 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2e562dac-a1db-446c-b73a-21df22608a50-log-httpd\") pod \"swift-proxy-59f58b5b58-tw7qc\" (UID: \"2e562dac-a1db-446c-b73a-21df22608a50\") " pod="openstack-kuttl-tests/swift-proxy-59f58b5b58-tw7qc" Mar 16 15:56:34 crc kubenswrapper[5120]: I0316 15:56:34.071778 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/2e562dac-a1db-446c-b73a-21df22608a50-etc-swift\") pod \"swift-proxy-59f58b5b58-tw7qc\" (UID: \"2e562dac-a1db-446c-b73a-21df22608a50\") " pod="openstack-kuttl-tests/swift-proxy-59f58b5b58-tw7qc" Mar 16 15:56:34 crc kubenswrapper[5120]: I0316 15:56:34.071947 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/2e562dac-a1db-446c-b73a-21df22608a50-public-tls-certs\") pod \"swift-proxy-59f58b5b58-tw7qc\" (UID: \"2e562dac-a1db-446c-b73a-21df22608a50\") " pod="openstack-kuttl-tests/swift-proxy-59f58b5b58-tw7qc" Mar 16 15:56:34 crc kubenswrapper[5120]: I0316 15:56:34.071982 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2e562dac-a1db-446c-b73a-21df22608a50-log-httpd\") pod \"swift-proxy-59f58b5b58-tw7qc\" (UID: \"2e562dac-a1db-446c-b73a-21df22608a50\") " pod="openstack-kuttl-tests/swift-proxy-59f58b5b58-tw7qc" Mar 16 15:56:34 crc kubenswrapper[5120]: I0316 15:56:34.072161 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/2e562dac-a1db-446c-b73a-21df22608a50-internal-tls-certs\") pod \"swift-proxy-59f58b5b58-tw7qc\" (UID: \"2e562dac-a1db-446c-b73a-21df22608a50\") " pod="openstack-kuttl-tests/swift-proxy-59f58b5b58-tw7qc" Mar 16 15:56:34 crc kubenswrapper[5120]: I0316 15:56:34.072226 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ff76x\" (UniqueName: \"kubernetes.io/projected/2e562dac-a1db-446c-b73a-21df22608a50-kube-api-access-ff76x\") pod \"swift-proxy-59f58b5b58-tw7qc\" (UID: \"2e562dac-a1db-446c-b73a-21df22608a50\") " pod="openstack-kuttl-tests/swift-proxy-59f58b5b58-tw7qc" Mar 16 15:56:34 crc kubenswrapper[5120]: I0316 15:56:34.072293 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2e562dac-a1db-446c-b73a-21df22608a50-run-httpd\") pod \"swift-proxy-59f58b5b58-tw7qc\" (UID: \"2e562dac-a1db-446c-b73a-21df22608a50\") " pod="openstack-kuttl-tests/swift-proxy-59f58b5b58-tw7qc" Mar 16 15:56:34 crc kubenswrapper[5120]: I0316 15:56:34.072585 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2e562dac-a1db-446c-b73a-21df22608a50-run-httpd\") pod \"swift-proxy-59f58b5b58-tw7qc\" (UID: \"2e562dac-a1db-446c-b73a-21df22608a50\") " pod="openstack-kuttl-tests/swift-proxy-59f58b5b58-tw7qc" Mar 16 15:56:34 crc kubenswrapper[5120]: I0316 15:56:34.083180 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/2e562dac-a1db-446c-b73a-21df22608a50-internal-tls-certs\") pod \"swift-proxy-59f58b5b58-tw7qc\" (UID: \"2e562dac-a1db-446c-b73a-21df22608a50\") " pod="openstack-kuttl-tests/swift-proxy-59f58b5b58-tw7qc" Mar 16 15:56:34 crc kubenswrapper[5120]: I0316 15:56:34.085693 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/2e562dac-a1db-446c-b73a-21df22608a50-public-tls-certs\") pod \"swift-proxy-59f58b5b58-tw7qc\" (UID: \"2e562dac-a1db-446c-b73a-21df22608a50\") " pod="openstack-kuttl-tests/swift-proxy-59f58b5b58-tw7qc" Mar 16 15:56:34 crc kubenswrapper[5120]: I0316 15:56:34.085922 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/2e562dac-a1db-446c-b73a-21df22608a50-etc-swift\") pod \"swift-proxy-59f58b5b58-tw7qc\" (UID: \"2e562dac-a1db-446c-b73a-21df22608a50\") " pod="openstack-kuttl-tests/swift-proxy-59f58b5b58-tw7qc" Mar 16 15:56:34 crc kubenswrapper[5120]: I0316 15:56:34.096089 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ff76x\" (UniqueName: \"kubernetes.io/projected/2e562dac-a1db-446c-b73a-21df22608a50-kube-api-access-ff76x\") pod \"swift-proxy-59f58b5b58-tw7qc\" (UID: \"2e562dac-a1db-446c-b73a-21df22608a50\") " pod="openstack-kuttl-tests/swift-proxy-59f58b5b58-tw7qc" Mar 16 15:56:34 crc kubenswrapper[5120]: I0316 15:56:34.108869 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2e562dac-a1db-446c-b73a-21df22608a50-config-data\") pod \"swift-proxy-59f58b5b58-tw7qc\" (UID: \"2e562dac-a1db-446c-b73a-21df22608a50\") " pod="openstack-kuttl-tests/swift-proxy-59f58b5b58-tw7qc" Mar 16 15:56:34 crc kubenswrapper[5120]: I0316 15:56:34.109023 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2e562dac-a1db-446c-b73a-21df22608a50-combined-ca-bundle\") pod \"swift-proxy-59f58b5b58-tw7qc\" (UID: \"2e562dac-a1db-446c-b73a-21df22608a50\") " pod="openstack-kuttl-tests/swift-proxy-59f58b5b58-tw7qc" Mar 16 15:56:34 crc kubenswrapper[5120]: I0316 15:56:34.185641 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-59f58b5b58-tw7qc" Mar 16 15:56:34 crc kubenswrapper[5120]: I0316 15:56:34.337824 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 15:56:34 crc kubenswrapper[5120]: I0316 15:56:34.338173 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="c841556f-1fa5-4d42-9793-f0887efc2f51" containerName="ceilometer-central-agent" containerID="cri-o://09f3dceb1873a84cb2e929934bbd2dfd9e5f79aeeda3117e13c89048129b522a" gracePeriod=30 Mar 16 15:56:34 crc kubenswrapper[5120]: I0316 15:56:34.338668 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="c841556f-1fa5-4d42-9793-f0887efc2f51" containerName="ceilometer-notification-agent" containerID="cri-o://7cc3813aa795fa5c887daed7460a1809ec0868734f02209302791ea832337890" gracePeriod=30 Mar 16 15:56:34 crc kubenswrapper[5120]: I0316 15:56:34.338796 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="c841556f-1fa5-4d42-9793-f0887efc2f51" containerName="proxy-httpd" containerID="cri-o://933cb1b0b8a317a10f4b15ab72f19cd61f780358fa26e83b9b1049ae2855dbe1" gracePeriod=30 Mar 16 15:56:34 crc kubenswrapper[5120]: I0316 15:56:34.338712 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="c841556f-1fa5-4d42-9793-f0887efc2f51" containerName="sg-core" containerID="cri-o://1a407ae87c7e930427f08c6f24d322a4c1e29221eea1df6bf79891961e3a6c70" gracePeriod=30 Mar 16 15:56:34 crc kubenswrapper[5120]: I0316 15:56:34.347881 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:56:34 crc kubenswrapper[5120]: I0316 15:56:34.649075 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-proxy-59f58b5b58-tw7qc"] Mar 16 15:56:34 crc kubenswrapper[5120]: W0316 15:56:34.662571 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2e562dac_a1db_446c_b73a_21df22608a50.slice/crio-41363c1c22b60fc059e8bc1b3de91f36279531426cf906c324276584e2adb3ec WatchSource:0}: Error finding container 41363c1c22b60fc059e8bc1b3de91f36279531426cf906c324276584e2adb3ec: Status 404 returned error can't find the container with id 41363c1c22b60fc059e8bc1b3de91f36279531426cf906c324276584e2adb3ec Mar 16 15:56:34 crc kubenswrapper[5120]: I0316 15:56:34.676300 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4fec53ab-7e98-41e6-8a5a-13a01e505e20" path="/var/lib/kubelet/pods/4fec53ab-7e98-41e6-8a5a-13a01e505e20/volumes" Mar 16 15:56:34 crc kubenswrapper[5120]: I0316 15:56:34.757638 5120 generic.go:358] "Generic (PLEG): container finished" podID="c841556f-1fa5-4d42-9793-f0887efc2f51" containerID="933cb1b0b8a317a10f4b15ab72f19cd61f780358fa26e83b9b1049ae2855dbe1" exitCode=0 Mar 16 15:56:34 crc kubenswrapper[5120]: I0316 15:56:34.757669 5120 generic.go:358] "Generic (PLEG): container finished" podID="c841556f-1fa5-4d42-9793-f0887efc2f51" containerID="1a407ae87c7e930427f08c6f24d322a4c1e29221eea1df6bf79891961e3a6c70" exitCode=2 Mar 16 15:56:34 crc kubenswrapper[5120]: I0316 15:56:34.757823 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"c841556f-1fa5-4d42-9793-f0887efc2f51","Type":"ContainerDied","Data":"933cb1b0b8a317a10f4b15ab72f19cd61f780358fa26e83b9b1049ae2855dbe1"} Mar 16 15:56:34 crc kubenswrapper[5120]: I0316 15:56:34.757851 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"c841556f-1fa5-4d42-9793-f0887efc2f51","Type":"ContainerDied","Data":"1a407ae87c7e930427f08c6f24d322a4c1e29221eea1df6bf79891961e3a6c70"} Mar 16 15:56:34 crc kubenswrapper[5120]: I0316 15:56:34.763370 5120 generic.go:358] "Generic (PLEG): container finished" podID="7e05eef7-7c4c-4faa-809a-2fa10da8f360" containerID="0c3aba9fcb29c166f3658a3a7f771fe636e711543830308dfa567c9f7771e9a0" exitCode=0 Mar 16 15:56:34 crc kubenswrapper[5120]: I0316 15:56:34.763456 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-xqwmf" event={"ID":"7e05eef7-7c4c-4faa-809a-2fa10da8f360","Type":"ContainerDied","Data":"0c3aba9fcb29c166f3658a3a7f771fe636e711543830308dfa567c9f7771e9a0"} Mar 16 15:56:34 crc kubenswrapper[5120]: I0316 15:56:34.763516 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-xqwmf" event={"ID":"7e05eef7-7c4c-4faa-809a-2fa10da8f360","Type":"ContainerStarted","Data":"29123e470b80e4e2fbb19c9ba57c85a786c38b6daa2015a68656b1c03a60c177"} Mar 16 15:56:34 crc kubenswrapper[5120]: I0316 15:56:34.768981 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-59f58b5b58-tw7qc" event={"ID":"2e562dac-a1db-446c-b73a-21df22608a50","Type":"ContainerStarted","Data":"41363c1c22b60fc059e8bc1b3de91f36279531426cf906c324276584e2adb3ec"} Mar 16 15:56:35 crc kubenswrapper[5120]: I0316 15:56:35.785165 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-59f58b5b58-tw7qc" event={"ID":"2e562dac-a1db-446c-b73a-21df22608a50","Type":"ContainerStarted","Data":"64e90c71960de20873b7811fc895ce903bc60eaefd9593abac82e4c4b489e606"} Mar 16 15:56:35 crc kubenswrapper[5120]: I0316 15:56:35.785811 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/swift-proxy-59f58b5b58-tw7qc" Mar 16 15:56:35 crc kubenswrapper[5120]: I0316 15:56:35.785831 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/swift-proxy-59f58b5b58-tw7qc" Mar 16 15:56:35 crc kubenswrapper[5120]: I0316 15:56:35.785840 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-59f58b5b58-tw7qc" event={"ID":"2e562dac-a1db-446c-b73a-21df22608a50","Type":"ContainerStarted","Data":"6f7dc6683e41d78ef9ed871ab4cec8bf6d45dff6e94f3f28507ba3a97f851f26"} Mar 16 15:56:35 crc kubenswrapper[5120]: I0316 15:56:35.786914 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:56:35 crc kubenswrapper[5120]: I0316 15:56:35.789503 5120 generic.go:358] "Generic (PLEG): container finished" podID="c841556f-1fa5-4d42-9793-f0887efc2f51" containerID="7cc3813aa795fa5c887daed7460a1809ec0868734f02209302791ea832337890" exitCode=0 Mar 16 15:56:35 crc kubenswrapper[5120]: I0316 15:56:35.789525 5120 generic.go:358] "Generic (PLEG): container finished" podID="c841556f-1fa5-4d42-9793-f0887efc2f51" containerID="09f3dceb1873a84cb2e929934bbd2dfd9e5f79aeeda3117e13c89048129b522a" exitCode=0 Mar 16 15:56:35 crc kubenswrapper[5120]: I0316 15:56:35.789661 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"c841556f-1fa5-4d42-9793-f0887efc2f51","Type":"ContainerDied","Data":"7cc3813aa795fa5c887daed7460a1809ec0868734f02209302791ea832337890"} Mar 16 15:56:35 crc kubenswrapper[5120]: I0316 15:56:35.789689 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"c841556f-1fa5-4d42-9793-f0887efc2f51","Type":"ContainerDied","Data":"09f3dceb1873a84cb2e929934bbd2dfd9e5f79aeeda3117e13c89048129b522a"} Mar 16 15:56:35 crc kubenswrapper[5120]: I0316 15:56:35.789701 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"c841556f-1fa5-4d42-9793-f0887efc2f51","Type":"ContainerDied","Data":"d86073f03cde9db760ec42f8a7e31ef1420701cb636c4bf9bae5040c8d070e83"} Mar 16 15:56:35 crc kubenswrapper[5120]: I0316 15:56:35.789716 5120 scope.go:117] "RemoveContainer" containerID="933cb1b0b8a317a10f4b15ab72f19cd61f780358fa26e83b9b1049ae2855dbe1" Mar 16 15:56:35 crc kubenswrapper[5120]: I0316 15:56:35.800623 5120 generic.go:358] "Generic (PLEG): container finished" podID="7e05eef7-7c4c-4faa-809a-2fa10da8f360" containerID="d40e58f6d8505d58fd3d39a24e3f06311d3de7d93591a9dd51417a619e1494b7" exitCode=0 Mar 16 15:56:35 crc kubenswrapper[5120]: I0316 15:56:35.800708 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-xqwmf" event={"ID":"7e05eef7-7c4c-4faa-809a-2fa10da8f360","Type":"ContainerDied","Data":"d40e58f6d8505d58fd3d39a24e3f06311d3de7d93591a9dd51417a619e1494b7"} Mar 16 15:56:35 crc kubenswrapper[5120]: I0316 15:56:35.832807 5120 scope.go:117] "RemoveContainer" containerID="1a407ae87c7e930427f08c6f24d322a4c1e29221eea1df6bf79891961e3a6c70" Mar 16 15:56:35 crc kubenswrapper[5120]: I0316 15:56:35.836184 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/swift-proxy-59f58b5b58-tw7qc" podStartSLOduration=2.836171046 podStartE2EDuration="2.836171046s" podCreationTimestamp="2026-03-16 15:56:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:56:35.812538081 +0000 UTC m=+1497.966469748" watchObservedRunningTime="2026-03-16 15:56:35.836171046 +0000 UTC m=+1497.990102703" Mar 16 15:56:35 crc kubenswrapper[5120]: I0316 15:56:35.858021 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c841556f-1fa5-4d42-9793-f0887efc2f51-run-httpd\") pod \"c841556f-1fa5-4d42-9793-f0887efc2f51\" (UID: \"c841556f-1fa5-4d42-9793-f0887efc2f51\") " Mar 16 15:56:35 crc kubenswrapper[5120]: I0316 15:56:35.858211 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c841556f-1fa5-4d42-9793-f0887efc2f51-log-httpd\") pod \"c841556f-1fa5-4d42-9793-f0887efc2f51\" (UID: \"c841556f-1fa5-4d42-9793-f0887efc2f51\") " Mar 16 15:56:35 crc kubenswrapper[5120]: I0316 15:56:35.858470 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c841556f-1fa5-4d42-9793-f0887efc2f51-combined-ca-bundle\") pod \"c841556f-1fa5-4d42-9793-f0887efc2f51\" (UID: \"c841556f-1fa5-4d42-9793-f0887efc2f51\") " Mar 16 15:56:35 crc kubenswrapper[5120]: I0316 15:56:35.858554 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/c841556f-1fa5-4d42-9793-f0887efc2f51-sg-core-conf-yaml\") pod \"c841556f-1fa5-4d42-9793-f0887efc2f51\" (UID: \"c841556f-1fa5-4d42-9793-f0887efc2f51\") " Mar 16 15:56:35 crc kubenswrapper[5120]: I0316 15:56:35.858598 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c841556f-1fa5-4d42-9793-f0887efc2f51-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "c841556f-1fa5-4d42-9793-f0887efc2f51" (UID: "c841556f-1fa5-4d42-9793-f0887efc2f51"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:56:35 crc kubenswrapper[5120]: I0316 15:56:35.858707 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c841556f-1fa5-4d42-9793-f0887efc2f51-config-data\") pod \"c841556f-1fa5-4d42-9793-f0887efc2f51\" (UID: \"c841556f-1fa5-4d42-9793-f0887efc2f51\") " Mar 16 15:56:35 crc kubenswrapper[5120]: I0316 15:56:35.858931 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c841556f-1fa5-4d42-9793-f0887efc2f51-scripts\") pod \"c841556f-1fa5-4d42-9793-f0887efc2f51\" (UID: \"c841556f-1fa5-4d42-9793-f0887efc2f51\") " Mar 16 15:56:35 crc kubenswrapper[5120]: I0316 15:56:35.858975 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ghmr9\" (UniqueName: \"kubernetes.io/projected/c841556f-1fa5-4d42-9793-f0887efc2f51-kube-api-access-ghmr9\") pod \"c841556f-1fa5-4d42-9793-f0887efc2f51\" (UID: \"c841556f-1fa5-4d42-9793-f0887efc2f51\") " Mar 16 15:56:35 crc kubenswrapper[5120]: I0316 15:56:35.859672 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c841556f-1fa5-4d42-9793-f0887efc2f51-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 15:56:35 crc kubenswrapper[5120]: I0316 15:56:35.859659 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c841556f-1fa5-4d42-9793-f0887efc2f51-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "c841556f-1fa5-4d42-9793-f0887efc2f51" (UID: "c841556f-1fa5-4d42-9793-f0887efc2f51"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:56:35 crc kubenswrapper[5120]: I0316 15:56:35.872552 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c841556f-1fa5-4d42-9793-f0887efc2f51-scripts" (OuterVolumeSpecName: "scripts") pod "c841556f-1fa5-4d42-9793-f0887efc2f51" (UID: "c841556f-1fa5-4d42-9793-f0887efc2f51"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:56:35 crc kubenswrapper[5120]: I0316 15:56:35.881274 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c841556f-1fa5-4d42-9793-f0887efc2f51-kube-api-access-ghmr9" (OuterVolumeSpecName: "kube-api-access-ghmr9") pod "c841556f-1fa5-4d42-9793-f0887efc2f51" (UID: "c841556f-1fa5-4d42-9793-f0887efc2f51"). InnerVolumeSpecName "kube-api-access-ghmr9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:56:35 crc kubenswrapper[5120]: I0316 15:56:35.967234 5120 scope.go:117] "RemoveContainer" containerID="7cc3813aa795fa5c887daed7460a1809ec0868734f02209302791ea832337890" Mar 16 15:56:35 crc kubenswrapper[5120]: I0316 15:56:35.974243 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c841556f-1fa5-4d42-9793-f0887efc2f51-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 15:56:35 crc kubenswrapper[5120]: I0316 15:56:35.974301 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c841556f-1fa5-4d42-9793-f0887efc2f51-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "c841556f-1fa5-4d42-9793-f0887efc2f51" (UID: "c841556f-1fa5-4d42-9793-f0887efc2f51"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:56:35 crc kubenswrapper[5120]: I0316 15:56:35.974339 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ghmr9\" (UniqueName: \"kubernetes.io/projected/c841556f-1fa5-4d42-9793-f0887efc2f51-kube-api-access-ghmr9\") on node \"crc\" DevicePath \"\"" Mar 16 15:56:35 crc kubenswrapper[5120]: I0316 15:56:35.974476 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c841556f-1fa5-4d42-9793-f0887efc2f51-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 15:56:35 crc kubenswrapper[5120]: I0316 15:56:35.989887 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c841556f-1fa5-4d42-9793-f0887efc2f51-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "c841556f-1fa5-4d42-9793-f0887efc2f51" (UID: "c841556f-1fa5-4d42-9793-f0887efc2f51"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:56:36 crc kubenswrapper[5120]: I0316 15:56:36.019616 5120 scope.go:117] "RemoveContainer" containerID="09f3dceb1873a84cb2e929934bbd2dfd9e5f79aeeda3117e13c89048129b522a" Mar 16 15:56:36 crc kubenswrapper[5120]: I0316 15:56:36.045740 5120 scope.go:117] "RemoveContainer" containerID="933cb1b0b8a317a10f4b15ab72f19cd61f780358fa26e83b9b1049ae2855dbe1" Mar 16 15:56:36 crc kubenswrapper[5120]: E0316 15:56:36.046148 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"933cb1b0b8a317a10f4b15ab72f19cd61f780358fa26e83b9b1049ae2855dbe1\": container with ID starting with 933cb1b0b8a317a10f4b15ab72f19cd61f780358fa26e83b9b1049ae2855dbe1 not found: ID does not exist" containerID="933cb1b0b8a317a10f4b15ab72f19cd61f780358fa26e83b9b1049ae2855dbe1" Mar 16 15:56:36 crc kubenswrapper[5120]: I0316 15:56:36.046212 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"933cb1b0b8a317a10f4b15ab72f19cd61f780358fa26e83b9b1049ae2855dbe1"} err="failed to get container status \"933cb1b0b8a317a10f4b15ab72f19cd61f780358fa26e83b9b1049ae2855dbe1\": rpc error: code = NotFound desc = could not find container \"933cb1b0b8a317a10f4b15ab72f19cd61f780358fa26e83b9b1049ae2855dbe1\": container with ID starting with 933cb1b0b8a317a10f4b15ab72f19cd61f780358fa26e83b9b1049ae2855dbe1 not found: ID does not exist" Mar 16 15:56:36 crc kubenswrapper[5120]: I0316 15:56:36.046251 5120 scope.go:117] "RemoveContainer" containerID="1a407ae87c7e930427f08c6f24d322a4c1e29221eea1df6bf79891961e3a6c70" Mar 16 15:56:36 crc kubenswrapper[5120]: E0316 15:56:36.046553 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a407ae87c7e930427f08c6f24d322a4c1e29221eea1df6bf79891961e3a6c70\": container with ID starting with 1a407ae87c7e930427f08c6f24d322a4c1e29221eea1df6bf79891961e3a6c70 not found: ID does not exist" containerID="1a407ae87c7e930427f08c6f24d322a4c1e29221eea1df6bf79891961e3a6c70" Mar 16 15:56:36 crc kubenswrapper[5120]: I0316 15:56:36.046591 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a407ae87c7e930427f08c6f24d322a4c1e29221eea1df6bf79891961e3a6c70"} err="failed to get container status \"1a407ae87c7e930427f08c6f24d322a4c1e29221eea1df6bf79891961e3a6c70\": rpc error: code = NotFound desc = could not find container \"1a407ae87c7e930427f08c6f24d322a4c1e29221eea1df6bf79891961e3a6c70\": container with ID starting with 1a407ae87c7e930427f08c6f24d322a4c1e29221eea1df6bf79891961e3a6c70 not found: ID does not exist" Mar 16 15:56:36 crc kubenswrapper[5120]: I0316 15:56:36.046616 5120 scope.go:117] "RemoveContainer" containerID="7cc3813aa795fa5c887daed7460a1809ec0868734f02209302791ea832337890" Mar 16 15:56:36 crc kubenswrapper[5120]: E0316 15:56:36.046788 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7cc3813aa795fa5c887daed7460a1809ec0868734f02209302791ea832337890\": container with ID starting with 7cc3813aa795fa5c887daed7460a1809ec0868734f02209302791ea832337890 not found: ID does not exist" containerID="7cc3813aa795fa5c887daed7460a1809ec0868734f02209302791ea832337890" Mar 16 15:56:36 crc kubenswrapper[5120]: I0316 15:56:36.046806 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7cc3813aa795fa5c887daed7460a1809ec0868734f02209302791ea832337890"} err="failed to get container status \"7cc3813aa795fa5c887daed7460a1809ec0868734f02209302791ea832337890\": rpc error: code = NotFound desc = could not find container \"7cc3813aa795fa5c887daed7460a1809ec0868734f02209302791ea832337890\": container with ID starting with 7cc3813aa795fa5c887daed7460a1809ec0868734f02209302791ea832337890 not found: ID does not exist" Mar 16 15:56:36 crc kubenswrapper[5120]: I0316 15:56:36.046820 5120 scope.go:117] "RemoveContainer" containerID="09f3dceb1873a84cb2e929934bbd2dfd9e5f79aeeda3117e13c89048129b522a" Mar 16 15:56:36 crc kubenswrapper[5120]: E0316 15:56:36.047059 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"09f3dceb1873a84cb2e929934bbd2dfd9e5f79aeeda3117e13c89048129b522a\": container with ID starting with 09f3dceb1873a84cb2e929934bbd2dfd9e5f79aeeda3117e13c89048129b522a not found: ID does not exist" containerID="09f3dceb1873a84cb2e929934bbd2dfd9e5f79aeeda3117e13c89048129b522a" Mar 16 15:56:36 crc kubenswrapper[5120]: I0316 15:56:36.047075 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09f3dceb1873a84cb2e929934bbd2dfd9e5f79aeeda3117e13c89048129b522a"} err="failed to get container status \"09f3dceb1873a84cb2e929934bbd2dfd9e5f79aeeda3117e13c89048129b522a\": rpc error: code = NotFound desc = could not find container \"09f3dceb1873a84cb2e929934bbd2dfd9e5f79aeeda3117e13c89048129b522a\": container with ID starting with 09f3dceb1873a84cb2e929934bbd2dfd9e5f79aeeda3117e13c89048129b522a not found: ID does not exist" Mar 16 15:56:36 crc kubenswrapper[5120]: I0316 15:56:36.047089 5120 scope.go:117] "RemoveContainer" containerID="933cb1b0b8a317a10f4b15ab72f19cd61f780358fa26e83b9b1049ae2855dbe1" Mar 16 15:56:36 crc kubenswrapper[5120]: I0316 15:56:36.047356 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"933cb1b0b8a317a10f4b15ab72f19cd61f780358fa26e83b9b1049ae2855dbe1"} err="failed to get container status \"933cb1b0b8a317a10f4b15ab72f19cd61f780358fa26e83b9b1049ae2855dbe1\": rpc error: code = NotFound desc = could not find container \"933cb1b0b8a317a10f4b15ab72f19cd61f780358fa26e83b9b1049ae2855dbe1\": container with ID starting with 933cb1b0b8a317a10f4b15ab72f19cd61f780358fa26e83b9b1049ae2855dbe1 not found: ID does not exist" Mar 16 15:56:36 crc kubenswrapper[5120]: I0316 15:56:36.047405 5120 scope.go:117] "RemoveContainer" containerID="1a407ae87c7e930427f08c6f24d322a4c1e29221eea1df6bf79891961e3a6c70" Mar 16 15:56:36 crc kubenswrapper[5120]: I0316 15:56:36.047651 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a407ae87c7e930427f08c6f24d322a4c1e29221eea1df6bf79891961e3a6c70"} err="failed to get container status \"1a407ae87c7e930427f08c6f24d322a4c1e29221eea1df6bf79891961e3a6c70\": rpc error: code = NotFound desc = could not find container \"1a407ae87c7e930427f08c6f24d322a4c1e29221eea1df6bf79891961e3a6c70\": container with ID starting with 1a407ae87c7e930427f08c6f24d322a4c1e29221eea1df6bf79891961e3a6c70 not found: ID does not exist" Mar 16 15:56:36 crc kubenswrapper[5120]: I0316 15:56:36.047676 5120 scope.go:117] "RemoveContainer" containerID="7cc3813aa795fa5c887daed7460a1809ec0868734f02209302791ea832337890" Mar 16 15:56:36 crc kubenswrapper[5120]: I0316 15:56:36.048249 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7cc3813aa795fa5c887daed7460a1809ec0868734f02209302791ea832337890"} err="failed to get container status \"7cc3813aa795fa5c887daed7460a1809ec0868734f02209302791ea832337890\": rpc error: code = NotFound desc = could not find container \"7cc3813aa795fa5c887daed7460a1809ec0868734f02209302791ea832337890\": container with ID starting with 7cc3813aa795fa5c887daed7460a1809ec0868734f02209302791ea832337890 not found: ID does not exist" Mar 16 15:56:36 crc kubenswrapper[5120]: I0316 15:56:36.048277 5120 scope.go:117] "RemoveContainer" containerID="09f3dceb1873a84cb2e929934bbd2dfd9e5f79aeeda3117e13c89048129b522a" Mar 16 15:56:36 crc kubenswrapper[5120]: I0316 15:56:36.048491 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09f3dceb1873a84cb2e929934bbd2dfd9e5f79aeeda3117e13c89048129b522a"} err="failed to get container status \"09f3dceb1873a84cb2e929934bbd2dfd9e5f79aeeda3117e13c89048129b522a\": rpc error: code = NotFound desc = could not find container \"09f3dceb1873a84cb2e929934bbd2dfd9e5f79aeeda3117e13c89048129b522a\": container with ID starting with 09f3dceb1873a84cb2e929934bbd2dfd9e5f79aeeda3117e13c89048129b522a not found: ID does not exist" Mar 16 15:56:36 crc kubenswrapper[5120]: I0316 15:56:36.072408 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c841556f-1fa5-4d42-9793-f0887efc2f51-config-data" (OuterVolumeSpecName: "config-data") pod "c841556f-1fa5-4d42-9793-f0887efc2f51" (UID: "c841556f-1fa5-4d42-9793-f0887efc2f51"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:56:36 crc kubenswrapper[5120]: I0316 15:56:36.076647 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c841556f-1fa5-4d42-9793-f0887efc2f51-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:56:36 crc kubenswrapper[5120]: I0316 15:56:36.076682 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/c841556f-1fa5-4d42-9793-f0887efc2f51-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 15:56:36 crc kubenswrapper[5120]: I0316 15:56:36.076692 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c841556f-1fa5-4d42-9793-f0887efc2f51-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 15:56:36 crc kubenswrapper[5120]: I0316 15:56:36.811994 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:56:36 crc kubenswrapper[5120]: I0316 15:56:36.817426 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-xqwmf" event={"ID":"7e05eef7-7c4c-4faa-809a-2fa10da8f360","Type":"ContainerStarted","Data":"e5dc3db28d2fc3c25234d198c994281d9cbbb12947e2a76542d7f1f45e84566d"} Mar 16 15:56:36 crc kubenswrapper[5120]: I0316 15:56:36.839029 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 15:56:36 crc kubenswrapper[5120]: I0316 15:56:36.851948 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 15:56:36 crc kubenswrapper[5120]: I0316 15:56:36.867954 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/redhat-marketplace-xqwmf" podStartSLOduration=3.297369201 podStartE2EDuration="3.867927253s" podCreationTimestamp="2026-03-16 15:56:33 +0000 UTC" firstStartedPulling="2026-03-16 15:56:34.764539345 +0000 UTC m=+1496.918471002" lastFinishedPulling="2026-03-16 15:56:35.335097397 +0000 UTC m=+1497.489029054" observedRunningTime="2026-03-16 15:56:36.865414943 +0000 UTC m=+1499.019346600" watchObservedRunningTime="2026-03-16 15:56:36.867927253 +0000 UTC m=+1499.021858910" Mar 16 15:56:36 crc kubenswrapper[5120]: I0316 15:56:36.890437 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 15:56:36 crc kubenswrapper[5120]: I0316 15:56:36.891612 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c841556f-1fa5-4d42-9793-f0887efc2f51" containerName="ceilometer-notification-agent" Mar 16 15:56:36 crc kubenswrapper[5120]: I0316 15:56:36.891632 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c841556f-1fa5-4d42-9793-f0887efc2f51" containerName="ceilometer-notification-agent" Mar 16 15:56:36 crc kubenswrapper[5120]: I0316 15:56:36.891656 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c841556f-1fa5-4d42-9793-f0887efc2f51" containerName="proxy-httpd" Mar 16 15:56:36 crc kubenswrapper[5120]: I0316 15:56:36.891662 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c841556f-1fa5-4d42-9793-f0887efc2f51" containerName="proxy-httpd" Mar 16 15:56:36 crc kubenswrapper[5120]: I0316 15:56:36.891683 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c841556f-1fa5-4d42-9793-f0887efc2f51" containerName="sg-core" Mar 16 15:56:36 crc kubenswrapper[5120]: I0316 15:56:36.891689 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c841556f-1fa5-4d42-9793-f0887efc2f51" containerName="sg-core" Mar 16 15:56:36 crc kubenswrapper[5120]: I0316 15:56:36.891700 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c841556f-1fa5-4d42-9793-f0887efc2f51" containerName="ceilometer-central-agent" Mar 16 15:56:36 crc kubenswrapper[5120]: I0316 15:56:36.891706 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c841556f-1fa5-4d42-9793-f0887efc2f51" containerName="ceilometer-central-agent" Mar 16 15:56:36 crc kubenswrapper[5120]: I0316 15:56:36.891909 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c841556f-1fa5-4d42-9793-f0887efc2f51" containerName="ceilometer-central-agent" Mar 16 15:56:36 crc kubenswrapper[5120]: I0316 15:56:36.891928 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c841556f-1fa5-4d42-9793-f0887efc2f51" containerName="sg-core" Mar 16 15:56:36 crc kubenswrapper[5120]: I0316 15:56:36.891942 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c841556f-1fa5-4d42-9793-f0887efc2f51" containerName="ceilometer-notification-agent" Mar 16 15:56:36 crc kubenswrapper[5120]: I0316 15:56:36.891954 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c841556f-1fa5-4d42-9793-f0887efc2f51" containerName="proxy-httpd" Mar 16 15:56:36 crc kubenswrapper[5120]: I0316 15:56:36.901951 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 15:56:36 crc kubenswrapper[5120]: I0316 15:56:36.902091 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:56:36 crc kubenswrapper[5120]: I0316 15:56:36.903924 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 15:56:36 crc kubenswrapper[5120]: I0316 15:56:36.904106 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 15:56:36 crc kubenswrapper[5120]: I0316 15:56:36.996626 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/275fa492-ad6d-44f0-84b3-df33f29e6f89-scripts\") pod \"ceilometer-0\" (UID: \"275fa492-ad6d-44f0-84b3-df33f29e6f89\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:56:36 crc kubenswrapper[5120]: I0316 15:56:36.996679 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/275fa492-ad6d-44f0-84b3-df33f29e6f89-log-httpd\") pod \"ceilometer-0\" (UID: \"275fa492-ad6d-44f0-84b3-df33f29e6f89\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:56:36 crc kubenswrapper[5120]: I0316 15:56:36.996701 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/275fa492-ad6d-44f0-84b3-df33f29e6f89-config-data\") pod \"ceilometer-0\" (UID: \"275fa492-ad6d-44f0-84b3-df33f29e6f89\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:56:36 crc kubenswrapper[5120]: I0316 15:56:36.996904 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/275fa492-ad6d-44f0-84b3-df33f29e6f89-run-httpd\") pod \"ceilometer-0\" (UID: \"275fa492-ad6d-44f0-84b3-df33f29e6f89\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:56:36 crc kubenswrapper[5120]: I0316 15:56:36.996978 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/275fa492-ad6d-44f0-84b3-df33f29e6f89-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"275fa492-ad6d-44f0-84b3-df33f29e6f89\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:56:36 crc kubenswrapper[5120]: I0316 15:56:36.997008 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6tqs\" (UniqueName: \"kubernetes.io/projected/275fa492-ad6d-44f0-84b3-df33f29e6f89-kube-api-access-l6tqs\") pod \"ceilometer-0\" (UID: \"275fa492-ad6d-44f0-84b3-df33f29e6f89\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:56:36 crc kubenswrapper[5120]: I0316 15:56:36.997056 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/275fa492-ad6d-44f0-84b3-df33f29e6f89-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"275fa492-ad6d-44f0-84b3-df33f29e6f89\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:56:37 crc kubenswrapper[5120]: I0316 15:56:37.098300 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/275fa492-ad6d-44f0-84b3-df33f29e6f89-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"275fa492-ad6d-44f0-84b3-df33f29e6f89\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:56:37 crc kubenswrapper[5120]: I0316 15:56:37.098693 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l6tqs\" (UniqueName: \"kubernetes.io/projected/275fa492-ad6d-44f0-84b3-df33f29e6f89-kube-api-access-l6tqs\") pod \"ceilometer-0\" (UID: \"275fa492-ad6d-44f0-84b3-df33f29e6f89\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:56:37 crc kubenswrapper[5120]: I0316 15:56:37.098750 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/275fa492-ad6d-44f0-84b3-df33f29e6f89-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"275fa492-ad6d-44f0-84b3-df33f29e6f89\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:56:37 crc kubenswrapper[5120]: I0316 15:56:37.098809 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/275fa492-ad6d-44f0-84b3-df33f29e6f89-scripts\") pod \"ceilometer-0\" (UID: \"275fa492-ad6d-44f0-84b3-df33f29e6f89\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:56:37 crc kubenswrapper[5120]: I0316 15:56:37.099059 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/275fa492-ad6d-44f0-84b3-df33f29e6f89-log-httpd\") pod \"ceilometer-0\" (UID: \"275fa492-ad6d-44f0-84b3-df33f29e6f89\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:56:37 crc kubenswrapper[5120]: I0316 15:56:37.099098 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/275fa492-ad6d-44f0-84b3-df33f29e6f89-config-data\") pod \"ceilometer-0\" (UID: \"275fa492-ad6d-44f0-84b3-df33f29e6f89\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:56:37 crc kubenswrapper[5120]: I0316 15:56:37.099405 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/275fa492-ad6d-44f0-84b3-df33f29e6f89-run-httpd\") pod \"ceilometer-0\" (UID: \"275fa492-ad6d-44f0-84b3-df33f29e6f89\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:56:37 crc kubenswrapper[5120]: I0316 15:56:37.099744 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/275fa492-ad6d-44f0-84b3-df33f29e6f89-log-httpd\") pod \"ceilometer-0\" (UID: \"275fa492-ad6d-44f0-84b3-df33f29e6f89\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:56:37 crc kubenswrapper[5120]: I0316 15:56:37.099780 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/275fa492-ad6d-44f0-84b3-df33f29e6f89-run-httpd\") pod \"ceilometer-0\" (UID: \"275fa492-ad6d-44f0-84b3-df33f29e6f89\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:56:37 crc kubenswrapper[5120]: I0316 15:56:37.111134 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/275fa492-ad6d-44f0-84b3-df33f29e6f89-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"275fa492-ad6d-44f0-84b3-df33f29e6f89\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:56:37 crc kubenswrapper[5120]: I0316 15:56:37.111367 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/275fa492-ad6d-44f0-84b3-df33f29e6f89-scripts\") pod \"ceilometer-0\" (UID: \"275fa492-ad6d-44f0-84b3-df33f29e6f89\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:56:37 crc kubenswrapper[5120]: I0316 15:56:37.119092 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6tqs\" (UniqueName: \"kubernetes.io/projected/275fa492-ad6d-44f0-84b3-df33f29e6f89-kube-api-access-l6tqs\") pod \"ceilometer-0\" (UID: \"275fa492-ad6d-44f0-84b3-df33f29e6f89\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:56:37 crc kubenswrapper[5120]: I0316 15:56:37.119788 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/275fa492-ad6d-44f0-84b3-df33f29e6f89-config-data\") pod \"ceilometer-0\" (UID: \"275fa492-ad6d-44f0-84b3-df33f29e6f89\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:56:37 crc kubenswrapper[5120]: I0316 15:56:37.123734 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/275fa492-ad6d-44f0-84b3-df33f29e6f89-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"275fa492-ad6d-44f0-84b3-df33f29e6f89\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:56:37 crc kubenswrapper[5120]: I0316 15:56:37.222854 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:56:37 crc kubenswrapper[5120]: I0316 15:56:37.549016 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-marketplace/certified-operators-cknpd" Mar 16 15:56:37 crc kubenswrapper[5120]: I0316 15:56:37.549075 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/certified-operators-cknpd" Mar 16 15:56:37 crc kubenswrapper[5120]: I0316 15:56:37.600039 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/certified-operators-cknpd" Mar 16 15:56:37 crc kubenswrapper[5120]: I0316 15:56:37.695228 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 15:56:37 crc kubenswrapper[5120]: W0316 15:56:37.698801 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod275fa492_ad6d_44f0_84b3_df33f29e6f89.slice/crio-526288e5a3538a515b9790e1e55533984f7a0638a1b2ce257a062941ff885e14 WatchSource:0}: Error finding container 526288e5a3538a515b9790e1e55533984f7a0638a1b2ce257a062941ff885e14: Status 404 returned error can't find the container with id 526288e5a3538a515b9790e1e55533984f7a0638a1b2ce257a062941ff885e14 Mar 16 15:56:37 crc kubenswrapper[5120]: I0316 15:56:37.828325 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"275fa492-ad6d-44f0-84b3-df33f29e6f89","Type":"ContainerStarted","Data":"526288e5a3538a515b9790e1e55533984f7a0638a1b2ce257a062941ff885e14"} Mar 16 15:56:37 crc kubenswrapper[5120]: I0316 15:56:37.891227 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/certified-operators-cknpd" Mar 16 15:56:38 crc kubenswrapper[5120]: I0316 15:56:38.166984 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-cj5jd"] Mar 16 15:56:38 crc kubenswrapper[5120]: I0316 15:56:38.177625 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-db-create-cj5jd" Mar 16 15:56:38 crc kubenswrapper[5120]: I0316 15:56:38.178166 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-cj5jd"] Mar 16 15:56:38 crc kubenswrapper[5120]: I0316 15:56:38.238367 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/16251914-f9cf-4313-9b3b-27435ea05123-operator-scripts\") pod \"nova-api-db-create-cj5jd\" (UID: \"16251914-f9cf-4313-9b3b-27435ea05123\") " pod="openstack-kuttl-tests/nova-api-db-create-cj5jd" Mar 16 15:56:38 crc kubenswrapper[5120]: I0316 15:56:38.238440 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wkg9\" (UniqueName: \"kubernetes.io/projected/16251914-f9cf-4313-9b3b-27435ea05123-kube-api-access-8wkg9\") pod \"nova-api-db-create-cj5jd\" (UID: \"16251914-f9cf-4313-9b3b-27435ea05123\") " pod="openstack-kuttl-tests/nova-api-db-create-cj5jd" Mar 16 15:56:38 crc kubenswrapper[5120]: I0316 15:56:38.274231 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-8a54-account-create-update-s5q9b"] Mar 16 15:56:38 crc kubenswrapper[5120]: I0316 15:56:38.279523 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-8a54-account-create-update-s5q9b" Mar 16 15:56:38 crc kubenswrapper[5120]: I0316 15:56:38.288262 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-db-secret\"" Mar 16 15:56:38 crc kubenswrapper[5120]: I0316 15:56:38.299837 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-8a54-account-create-update-s5q9b"] Mar 16 15:56:38 crc kubenswrapper[5120]: I0316 15:56:38.341481 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/16251914-f9cf-4313-9b3b-27435ea05123-operator-scripts\") pod \"nova-api-db-create-cj5jd\" (UID: \"16251914-f9cf-4313-9b3b-27435ea05123\") " pod="openstack-kuttl-tests/nova-api-db-create-cj5jd" Mar 16 15:56:38 crc kubenswrapper[5120]: I0316 15:56:38.341564 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8wkg9\" (UniqueName: \"kubernetes.io/projected/16251914-f9cf-4313-9b3b-27435ea05123-kube-api-access-8wkg9\") pod \"nova-api-db-create-cj5jd\" (UID: \"16251914-f9cf-4313-9b3b-27435ea05123\") " pod="openstack-kuttl-tests/nova-api-db-create-cj5jd" Mar 16 15:56:38 crc kubenswrapper[5120]: I0316 15:56:38.341642 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bkk2s\" (UniqueName: \"kubernetes.io/projected/372db992-7da6-4e0f-b492-76e1c6713181-kube-api-access-bkk2s\") pod \"nova-api-8a54-account-create-update-s5q9b\" (UID: \"372db992-7da6-4e0f-b492-76e1c6713181\") " pod="openstack-kuttl-tests/nova-api-8a54-account-create-update-s5q9b" Mar 16 15:56:38 crc kubenswrapper[5120]: I0316 15:56:38.341694 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/372db992-7da6-4e0f-b492-76e1c6713181-operator-scripts\") pod \"nova-api-8a54-account-create-update-s5q9b\" (UID: \"372db992-7da6-4e0f-b492-76e1c6713181\") " pod="openstack-kuttl-tests/nova-api-8a54-account-create-update-s5q9b" Mar 16 15:56:38 crc kubenswrapper[5120]: I0316 15:56:38.342566 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/16251914-f9cf-4313-9b3b-27435ea05123-operator-scripts\") pod \"nova-api-db-create-cj5jd\" (UID: \"16251914-f9cf-4313-9b3b-27435ea05123\") " pod="openstack-kuttl-tests/nova-api-db-create-cj5jd" Mar 16 15:56:38 crc kubenswrapper[5120]: I0316 15:56:38.374286 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wkg9\" (UniqueName: \"kubernetes.io/projected/16251914-f9cf-4313-9b3b-27435ea05123-kube-api-access-8wkg9\") pod \"nova-api-db-create-cj5jd\" (UID: \"16251914-f9cf-4313-9b3b-27435ea05123\") " pod="openstack-kuttl-tests/nova-api-db-create-cj5jd" Mar 16 15:56:38 crc kubenswrapper[5120]: I0316 15:56:38.378313 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-snl2v"] Mar 16 15:56:38 crc kubenswrapper[5120]: I0316 15:56:38.386017 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-db-create-snl2v" Mar 16 15:56:38 crc kubenswrapper[5120]: I0316 15:56:38.403675 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-snl2v"] Mar 16 15:56:38 crc kubenswrapper[5120]: I0316 15:56:38.444152 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bkk2s\" (UniqueName: \"kubernetes.io/projected/372db992-7da6-4e0f-b492-76e1c6713181-kube-api-access-bkk2s\") pod \"nova-api-8a54-account-create-update-s5q9b\" (UID: \"372db992-7da6-4e0f-b492-76e1c6713181\") " pod="openstack-kuttl-tests/nova-api-8a54-account-create-update-s5q9b" Mar 16 15:56:38 crc kubenswrapper[5120]: I0316 15:56:38.444218 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/372db992-7da6-4e0f-b492-76e1c6713181-operator-scripts\") pod \"nova-api-8a54-account-create-update-s5q9b\" (UID: \"372db992-7da6-4e0f-b492-76e1c6713181\") " pod="openstack-kuttl-tests/nova-api-8a54-account-create-update-s5q9b" Mar 16 15:56:38 crc kubenswrapper[5120]: I0316 15:56:38.444430 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7nrm\" (UniqueName: \"kubernetes.io/projected/512ae1aa-4bdc-4ad0-a53c-f694c3e56583-kube-api-access-x7nrm\") pod \"nova-cell0-db-create-snl2v\" (UID: \"512ae1aa-4bdc-4ad0-a53c-f694c3e56583\") " pod="openstack-kuttl-tests/nova-cell0-db-create-snl2v" Mar 16 15:56:38 crc kubenswrapper[5120]: I0316 15:56:38.444557 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/512ae1aa-4bdc-4ad0-a53c-f694c3e56583-operator-scripts\") pod \"nova-cell0-db-create-snl2v\" (UID: \"512ae1aa-4bdc-4ad0-a53c-f694c3e56583\") " pod="openstack-kuttl-tests/nova-cell0-db-create-snl2v" Mar 16 15:56:38 crc kubenswrapper[5120]: I0316 15:56:38.445883 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/372db992-7da6-4e0f-b492-76e1c6713181-operator-scripts\") pod \"nova-api-8a54-account-create-update-s5q9b\" (UID: \"372db992-7da6-4e0f-b492-76e1c6713181\") " pod="openstack-kuttl-tests/nova-api-8a54-account-create-update-s5q9b" Mar 16 15:56:38 crc kubenswrapper[5120]: I0316 15:56:38.475025 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bkk2s\" (UniqueName: \"kubernetes.io/projected/372db992-7da6-4e0f-b492-76e1c6713181-kube-api-access-bkk2s\") pod \"nova-api-8a54-account-create-update-s5q9b\" (UID: \"372db992-7da6-4e0f-b492-76e1c6713181\") " pod="openstack-kuttl-tests/nova-api-8a54-account-create-update-s5q9b" Mar 16 15:56:38 crc kubenswrapper[5120]: I0316 15:56:38.486955 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-7k2zr"] Mar 16 15:56:38 crc kubenswrapper[5120]: I0316 15:56:38.510466 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-ef54-account-create-update-bqpvb"] Mar 16 15:56:38 crc kubenswrapper[5120]: I0316 15:56:38.515883 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-ef54-account-create-update-bqpvb" Mar 16 15:56:38 crc kubenswrapper[5120]: I0316 15:56:38.516507 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-db-create-7k2zr" Mar 16 15:56:38 crc kubenswrapper[5120]: I0316 15:56:38.516598 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-7k2zr"] Mar 16 15:56:38 crc kubenswrapper[5120]: I0316 15:56:38.519073 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-db-create-cj5jd" Mar 16 15:56:38 crc kubenswrapper[5120]: I0316 15:56:38.521031 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-db-secret\"" Mar 16 15:56:38 crc kubenswrapper[5120]: I0316 15:56:38.531423 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-ef54-account-create-update-bqpvb"] Mar 16 15:56:38 crc kubenswrapper[5120]: I0316 15:56:38.547222 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x7nrm\" (UniqueName: \"kubernetes.io/projected/512ae1aa-4bdc-4ad0-a53c-f694c3e56583-kube-api-access-x7nrm\") pod \"nova-cell0-db-create-snl2v\" (UID: \"512ae1aa-4bdc-4ad0-a53c-f694c3e56583\") " pod="openstack-kuttl-tests/nova-cell0-db-create-snl2v" Mar 16 15:56:38 crc kubenswrapper[5120]: I0316 15:56:38.547320 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/512ae1aa-4bdc-4ad0-a53c-f694c3e56583-operator-scripts\") pod \"nova-cell0-db-create-snl2v\" (UID: \"512ae1aa-4bdc-4ad0-a53c-f694c3e56583\") " pod="openstack-kuttl-tests/nova-cell0-db-create-snl2v" Mar 16 15:56:38 crc kubenswrapper[5120]: I0316 15:56:38.548070 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/512ae1aa-4bdc-4ad0-a53c-f694c3e56583-operator-scripts\") pod \"nova-cell0-db-create-snl2v\" (UID: \"512ae1aa-4bdc-4ad0-a53c-f694c3e56583\") " pod="openstack-kuttl-tests/nova-cell0-db-create-snl2v" Mar 16 15:56:38 crc kubenswrapper[5120]: I0316 15:56:38.572025 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7nrm\" (UniqueName: \"kubernetes.io/projected/512ae1aa-4bdc-4ad0-a53c-f694c3e56583-kube-api-access-x7nrm\") pod \"nova-cell0-db-create-snl2v\" (UID: \"512ae1aa-4bdc-4ad0-a53c-f694c3e56583\") " pod="openstack-kuttl-tests/nova-cell0-db-create-snl2v" Mar 16 15:56:38 crc kubenswrapper[5120]: I0316 15:56:38.598689 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-8a54-account-create-update-s5q9b" Mar 16 15:56:38 crc kubenswrapper[5120]: I0316 15:56:38.648701 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8bbx\" (UniqueName: \"kubernetes.io/projected/8076c13b-f4f2-47fa-93f7-df2310ab04dc-kube-api-access-z8bbx\") pod \"nova-cell0-ef54-account-create-update-bqpvb\" (UID: \"8076c13b-f4f2-47fa-93f7-df2310ab04dc\") " pod="openstack-kuttl-tests/nova-cell0-ef54-account-create-update-bqpvb" Mar 16 15:56:38 crc kubenswrapper[5120]: I0316 15:56:38.648801 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/255a48fb-770e-45fa-8713-8f5c5dcb2a5c-operator-scripts\") pod \"nova-cell1-db-create-7k2zr\" (UID: \"255a48fb-770e-45fa-8713-8f5c5dcb2a5c\") " pod="openstack-kuttl-tests/nova-cell1-db-create-7k2zr" Mar 16 15:56:38 crc kubenswrapper[5120]: I0316 15:56:38.648925 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8076c13b-f4f2-47fa-93f7-df2310ab04dc-operator-scripts\") pod \"nova-cell0-ef54-account-create-update-bqpvb\" (UID: \"8076c13b-f4f2-47fa-93f7-df2310ab04dc\") " pod="openstack-kuttl-tests/nova-cell0-ef54-account-create-update-bqpvb" Mar 16 15:56:38 crc kubenswrapper[5120]: I0316 15:56:38.648981 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfx55\" (UniqueName: \"kubernetes.io/projected/255a48fb-770e-45fa-8713-8f5c5dcb2a5c-kube-api-access-wfx55\") pod \"nova-cell1-db-create-7k2zr\" (UID: \"255a48fb-770e-45fa-8713-8f5c5dcb2a5c\") " pod="openstack-kuttl-tests/nova-cell1-db-create-7k2zr" Mar 16 15:56:38 crc kubenswrapper[5120]: I0316 15:56:38.688689 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c841556f-1fa5-4d42-9793-f0887efc2f51" path="/var/lib/kubelet/pods/c841556f-1fa5-4d42-9793-f0887efc2f51/volumes" Mar 16 15:56:38 crc kubenswrapper[5120]: I0316 15:56:38.694351 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-dc27-account-create-update-gswht"] Mar 16 15:56:38 crc kubenswrapper[5120]: I0316 15:56:38.701623 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-dc27-account-create-update-gswht" Mar 16 15:56:38 crc kubenswrapper[5120]: I0316 15:56:38.708595 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-db-secret\"" Mar 16 15:56:38 crc kubenswrapper[5120]: I0316 15:56:38.753291 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-dc27-account-create-update-gswht"] Mar 16 15:56:38 crc kubenswrapper[5120]: I0316 15:56:38.753596 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8076c13b-f4f2-47fa-93f7-df2310ab04dc-operator-scripts\") pod \"nova-cell0-ef54-account-create-update-bqpvb\" (UID: \"8076c13b-f4f2-47fa-93f7-df2310ab04dc\") " pod="openstack-kuttl-tests/nova-cell0-ef54-account-create-update-bqpvb" Mar 16 15:56:38 crc kubenswrapper[5120]: I0316 15:56:38.754433 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8076c13b-f4f2-47fa-93f7-df2310ab04dc-operator-scripts\") pod \"nova-cell0-ef54-account-create-update-bqpvb\" (UID: \"8076c13b-f4f2-47fa-93f7-df2310ab04dc\") " pod="openstack-kuttl-tests/nova-cell0-ef54-account-create-update-bqpvb" Mar 16 15:56:38 crc kubenswrapper[5120]: I0316 15:56:38.754573 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jh2mc\" (UniqueName: \"kubernetes.io/projected/0b26707e-d8ca-4286-aa82-d91fa16c7a10-kube-api-access-jh2mc\") pod \"nova-cell1-dc27-account-create-update-gswht\" (UID: \"0b26707e-d8ca-4286-aa82-d91fa16c7a10\") " pod="openstack-kuttl-tests/nova-cell1-dc27-account-create-update-gswht" Mar 16 15:56:38 crc kubenswrapper[5120]: I0316 15:56:38.754752 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wfx55\" (UniqueName: \"kubernetes.io/projected/255a48fb-770e-45fa-8713-8f5c5dcb2a5c-kube-api-access-wfx55\") pod \"nova-cell1-db-create-7k2zr\" (UID: \"255a48fb-770e-45fa-8713-8f5c5dcb2a5c\") " pod="openstack-kuttl-tests/nova-cell1-db-create-7k2zr" Mar 16 15:56:38 crc kubenswrapper[5120]: I0316 15:56:38.755001 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z8bbx\" (UniqueName: \"kubernetes.io/projected/8076c13b-f4f2-47fa-93f7-df2310ab04dc-kube-api-access-z8bbx\") pod \"nova-cell0-ef54-account-create-update-bqpvb\" (UID: \"8076c13b-f4f2-47fa-93f7-df2310ab04dc\") " pod="openstack-kuttl-tests/nova-cell0-ef54-account-create-update-bqpvb" Mar 16 15:56:38 crc kubenswrapper[5120]: I0316 15:56:38.755084 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0b26707e-d8ca-4286-aa82-d91fa16c7a10-operator-scripts\") pod \"nova-cell1-dc27-account-create-update-gswht\" (UID: \"0b26707e-d8ca-4286-aa82-d91fa16c7a10\") " pod="openstack-kuttl-tests/nova-cell1-dc27-account-create-update-gswht" Mar 16 15:56:38 crc kubenswrapper[5120]: I0316 15:56:38.755305 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/255a48fb-770e-45fa-8713-8f5c5dcb2a5c-operator-scripts\") pod \"nova-cell1-db-create-7k2zr\" (UID: \"255a48fb-770e-45fa-8713-8f5c5dcb2a5c\") " pod="openstack-kuttl-tests/nova-cell1-db-create-7k2zr" Mar 16 15:56:38 crc kubenswrapper[5120]: I0316 15:56:38.756289 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/255a48fb-770e-45fa-8713-8f5c5dcb2a5c-operator-scripts\") pod \"nova-cell1-db-create-7k2zr\" (UID: \"255a48fb-770e-45fa-8713-8f5c5dcb2a5c\") " pod="openstack-kuttl-tests/nova-cell1-db-create-7k2zr" Mar 16 15:56:38 crc kubenswrapper[5120]: I0316 15:56:38.802783 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfx55\" (UniqueName: \"kubernetes.io/projected/255a48fb-770e-45fa-8713-8f5c5dcb2a5c-kube-api-access-wfx55\") pod \"nova-cell1-db-create-7k2zr\" (UID: \"255a48fb-770e-45fa-8713-8f5c5dcb2a5c\") " pod="openstack-kuttl-tests/nova-cell1-db-create-7k2zr" Mar 16 15:56:38 crc kubenswrapper[5120]: I0316 15:56:38.809648 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8bbx\" (UniqueName: \"kubernetes.io/projected/8076c13b-f4f2-47fa-93f7-df2310ab04dc-kube-api-access-z8bbx\") pod \"nova-cell0-ef54-account-create-update-bqpvb\" (UID: \"8076c13b-f4f2-47fa-93f7-df2310ab04dc\") " pod="openstack-kuttl-tests/nova-cell0-ef54-account-create-update-bqpvb" Mar 16 15:56:38 crc kubenswrapper[5120]: I0316 15:56:38.830794 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-db-create-snl2v" Mar 16 15:56:38 crc kubenswrapper[5120]: I0316 15:56:38.858805 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"275fa492-ad6d-44f0-84b3-df33f29e6f89","Type":"ContainerStarted","Data":"b54eaf33ea4461f32cb73207194553cad35e9691fd18f41cfa8a8c1331da9f35"} Mar 16 15:56:38 crc kubenswrapper[5120]: I0316 15:56:38.858921 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-ef54-account-create-update-bqpvb" Mar 16 15:56:38 crc kubenswrapper[5120]: I0316 15:56:38.872276 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jh2mc\" (UniqueName: \"kubernetes.io/projected/0b26707e-d8ca-4286-aa82-d91fa16c7a10-kube-api-access-jh2mc\") pod \"nova-cell1-dc27-account-create-update-gswht\" (UID: \"0b26707e-d8ca-4286-aa82-d91fa16c7a10\") " pod="openstack-kuttl-tests/nova-cell1-dc27-account-create-update-gswht" Mar 16 15:56:38 crc kubenswrapper[5120]: I0316 15:56:38.892080 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-db-create-7k2zr" Mar 16 15:56:38 crc kubenswrapper[5120]: I0316 15:56:38.892462 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0b26707e-d8ca-4286-aa82-d91fa16c7a10-operator-scripts\") pod \"nova-cell1-dc27-account-create-update-gswht\" (UID: \"0b26707e-d8ca-4286-aa82-d91fa16c7a10\") " pod="openstack-kuttl-tests/nova-cell1-dc27-account-create-update-gswht" Mar 16 15:56:38 crc kubenswrapper[5120]: I0316 15:56:38.893472 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0b26707e-d8ca-4286-aa82-d91fa16c7a10-operator-scripts\") pod \"nova-cell1-dc27-account-create-update-gswht\" (UID: \"0b26707e-d8ca-4286-aa82-d91fa16c7a10\") " pod="openstack-kuttl-tests/nova-cell1-dc27-account-create-update-gswht" Mar 16 15:56:38 crc kubenswrapper[5120]: I0316 15:56:38.900222 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jh2mc\" (UniqueName: \"kubernetes.io/projected/0b26707e-d8ca-4286-aa82-d91fa16c7a10-kube-api-access-jh2mc\") pod \"nova-cell1-dc27-account-create-update-gswht\" (UID: \"0b26707e-d8ca-4286-aa82-d91fa16c7a10\") " pod="openstack-kuttl-tests/nova-cell1-dc27-account-create-update-gswht" Mar 16 15:56:38 crc kubenswrapper[5120]: I0316 15:56:38.993693 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-dc27-account-create-update-gswht" Mar 16 15:56:39 crc kubenswrapper[5120]: I0316 15:56:39.215686 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-cj5jd"] Mar 16 15:56:39 crc kubenswrapper[5120]: I0316 15:56:39.364926 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-8a54-account-create-update-s5q9b"] Mar 16 15:56:39 crc kubenswrapper[5120]: I0316 15:56:39.377950 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-db-secret\"" Mar 16 15:56:39 crc kubenswrapper[5120]: I0316 15:56:39.492238 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-snl2v"] Mar 16 15:56:39 crc kubenswrapper[5120]: W0316 15:56:39.504746 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod512ae1aa_4bdc_4ad0_a53c_f694c3e56583.slice/crio-05449f3836f0cd52d991c070ad41a5074049f48ee85e8e3f4d529a5f0634edde WatchSource:0}: Error finding container 05449f3836f0cd52d991c070ad41a5074049f48ee85e8e3f4d529a5f0634edde: Status 404 returned error can't find the container with id 05449f3836f0cd52d991c070ad41a5074049f48ee85e8e3f4d529a5f0634edde Mar 16 15:56:39 crc kubenswrapper[5120]: I0316 15:56:39.590432 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-7k2zr"] Mar 16 15:56:39 crc kubenswrapper[5120]: W0316 15:56:39.602630 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod255a48fb_770e_45fa_8713_8f5c5dcb2a5c.slice/crio-67a4d332234ff578e1af0042f26d44b8989a6691d24437093dd43a6ea1105fb3 WatchSource:0}: Error finding container 67a4d332234ff578e1af0042f26d44b8989a6691d24437093dd43a6ea1105fb3: Status 404 returned error can't find the container with id 67a4d332234ff578e1af0042f26d44b8989a6691d24437093dd43a6ea1105fb3 Mar 16 15:56:39 crc kubenswrapper[5120]: I0316 15:56:39.602752 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-ef54-account-create-update-bqpvb"] Mar 16 15:56:39 crc kubenswrapper[5120]: I0316 15:56:39.617776 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-db-secret\"" Mar 16 15:56:39 crc kubenswrapper[5120]: I0316 15:56:39.696992 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-dc27-account-create-update-gswht"] Mar 16 15:56:39 crc kubenswrapper[5120]: I0316 15:56:39.725319 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/certified-operators-cknpd"] Mar 16 15:56:39 crc kubenswrapper[5120]: I0316 15:56:39.874587 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"275fa492-ad6d-44f0-84b3-df33f29e6f89","Type":"ContainerStarted","Data":"0cab72c92f66ff73a03dea0af4618eb0e10cfbcf823eb1178abbb8adcbf62b7c"} Mar 16 15:56:39 crc kubenswrapper[5120]: I0316 15:56:39.876301 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-ef54-account-create-update-bqpvb" event={"ID":"8076c13b-f4f2-47fa-93f7-df2310ab04dc","Type":"ContainerStarted","Data":"3ae4537bb75fb3c72bf62cedb0a10ad920bee2b89fc45fc83d759cb4eb4f4ebe"} Mar 16 15:56:39 crc kubenswrapper[5120]: I0316 15:56:39.878630 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-8a54-account-create-update-s5q9b" event={"ID":"372db992-7da6-4e0f-b492-76e1c6713181","Type":"ContainerStarted","Data":"f628abe32468e3c1a1fb2a723b1fbd57378a6b403fb582427974425009588307"} Mar 16 15:56:39 crc kubenswrapper[5120]: I0316 15:56:39.878656 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-8a54-account-create-update-s5q9b" event={"ID":"372db992-7da6-4e0f-b492-76e1c6713181","Type":"ContainerStarted","Data":"40141e91cce93ca4fc53b85e2a80e6e3a9cf29ead95581c325caf26839e0c3ea"} Mar 16 15:56:39 crc kubenswrapper[5120]: I0316 15:56:39.882101 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-dc27-account-create-update-gswht" event={"ID":"0b26707e-d8ca-4286-aa82-d91fa16c7a10","Type":"ContainerStarted","Data":"5f996890e9b70a7181a18c53b10e1f806c83f2b7f96fc73b5130bfcad34f8794"} Mar 16 15:56:39 crc kubenswrapper[5120]: I0316 15:56:39.883536 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-db-create-7k2zr" event={"ID":"255a48fb-770e-45fa-8713-8f5c5dcb2a5c","Type":"ContainerStarted","Data":"67a4d332234ff578e1af0042f26d44b8989a6691d24437093dd43a6ea1105fb3"} Mar 16 15:56:39 crc kubenswrapper[5120]: I0316 15:56:39.885576 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-db-create-snl2v" event={"ID":"512ae1aa-4bdc-4ad0-a53c-f694c3e56583","Type":"ContainerStarted","Data":"a49714a7590e82f0621f8c9521183fbb6ed758639be8404d97f370eb2168ff36"} Mar 16 15:56:39 crc kubenswrapper[5120]: I0316 15:56:39.885611 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-db-create-snl2v" event={"ID":"512ae1aa-4bdc-4ad0-a53c-f694c3e56583","Type":"ContainerStarted","Data":"05449f3836f0cd52d991c070ad41a5074049f48ee85e8e3f4d529a5f0634edde"} Mar 16 15:56:39 crc kubenswrapper[5120]: I0316 15:56:39.887948 5120 generic.go:358] "Generic (PLEG): container finished" podID="16251914-f9cf-4313-9b3b-27435ea05123" containerID="816480c61d758cd3b4221559aab6898628b38f65ddf04f4488a26f9d2942c758" exitCode=0 Mar 16 15:56:39 crc kubenswrapper[5120]: I0316 15:56:39.887998 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-db-create-cj5jd" event={"ID":"16251914-f9cf-4313-9b3b-27435ea05123","Type":"ContainerDied","Data":"816480c61d758cd3b4221559aab6898628b38f65ddf04f4488a26f9d2942c758"} Mar 16 15:56:39 crc kubenswrapper[5120]: I0316 15:56:39.888040 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-db-create-cj5jd" event={"ID":"16251914-f9cf-4313-9b3b-27435ea05123","Type":"ContainerStarted","Data":"f8c6dfb6cfec21dd89f7737337e8b909011e49c48a203ece7b3ef0d6e43b2ce8"} Mar 16 15:56:39 crc kubenswrapper[5120]: I0316 15:56:39.888272 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-marketplace/certified-operators-cknpd" podUID="2bce8490-8143-4aad-a535-bb6315a95434" containerName="registry-server" containerID="cri-o://bd7f88b75b8287e83660979835f2d24ab9e1334b50c87c8eba90ac891fa2c5bb" gracePeriod=2 Mar 16 15:56:39 crc kubenswrapper[5120]: I0316 15:56:39.922305 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-db-create-snl2v" podStartSLOduration=1.92228595 podStartE2EDuration="1.92228595s" podCreationTimestamp="2026-03-16 15:56:38 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:56:39.920688546 +0000 UTC m=+1502.074620203" watchObservedRunningTime="2026-03-16 15:56:39.92228595 +0000 UTC m=+1502.076217607" Mar 16 15:56:40 crc kubenswrapper[5120]: I0316 15:56:40.385337 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-cknpd" Mar 16 15:56:40 crc kubenswrapper[5120]: I0316 15:56:40.526351 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/2bce8490-8143-4aad-a535-bb6315a95434-utilities\") pod \"2bce8490-8143-4aad-a535-bb6315a95434\" (UID: \"2bce8490-8143-4aad-a535-bb6315a95434\") " Mar 16 15:56:40 crc kubenswrapper[5120]: I0316 15:56:40.526425 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ptrgn\" (UniqueName: \"kubernetes.io/projected/2bce8490-8143-4aad-a535-bb6315a95434-kube-api-access-ptrgn\") pod \"2bce8490-8143-4aad-a535-bb6315a95434\" (UID: \"2bce8490-8143-4aad-a535-bb6315a95434\") " Mar 16 15:56:40 crc kubenswrapper[5120]: I0316 15:56:40.526600 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/2bce8490-8143-4aad-a535-bb6315a95434-catalog-content\") pod \"2bce8490-8143-4aad-a535-bb6315a95434\" (UID: \"2bce8490-8143-4aad-a535-bb6315a95434\") " Mar 16 15:56:40 crc kubenswrapper[5120]: I0316 15:56:40.527734 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2bce8490-8143-4aad-a535-bb6315a95434-utilities" (OuterVolumeSpecName: "utilities") pod "2bce8490-8143-4aad-a535-bb6315a95434" (UID: "2bce8490-8143-4aad-a535-bb6315a95434"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:56:40 crc kubenswrapper[5120]: I0316 15:56:40.541097 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2bce8490-8143-4aad-a535-bb6315a95434-kube-api-access-ptrgn" (OuterVolumeSpecName: "kube-api-access-ptrgn") pod "2bce8490-8143-4aad-a535-bb6315a95434" (UID: "2bce8490-8143-4aad-a535-bb6315a95434"). InnerVolumeSpecName "kube-api-access-ptrgn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:56:40 crc kubenswrapper[5120]: I0316 15:56:40.561147 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2bce8490-8143-4aad-a535-bb6315a95434-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "2bce8490-8143-4aad-a535-bb6315a95434" (UID: "2bce8490-8143-4aad-a535-bb6315a95434"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:56:40 crc kubenswrapper[5120]: I0316 15:56:40.629736 5120 reconciler_common.go:299] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/2bce8490-8143-4aad-a535-bb6315a95434-catalog-content\") on node \"crc\" DevicePath \"\"" Mar 16 15:56:40 crc kubenswrapper[5120]: I0316 15:56:40.629918 5120 reconciler_common.go:299] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/2bce8490-8143-4aad-a535-bb6315a95434-utilities\") on node \"crc\" DevicePath \"\"" Mar 16 15:56:40 crc kubenswrapper[5120]: I0316 15:56:40.629980 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ptrgn\" (UniqueName: \"kubernetes.io/projected/2bce8490-8143-4aad-a535-bb6315a95434-kube-api-access-ptrgn\") on node \"crc\" DevicePath \"\"" Mar 16 15:56:40 crc kubenswrapper[5120]: I0316 15:56:40.922221 5120 generic.go:358] "Generic (PLEG): container finished" podID="2bce8490-8143-4aad-a535-bb6315a95434" containerID="bd7f88b75b8287e83660979835f2d24ab9e1334b50c87c8eba90ac891fa2c5bb" exitCode=0 Mar 16 15:56:40 crc kubenswrapper[5120]: I0316 15:56:40.922319 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-cknpd" Mar 16 15:56:40 crc kubenswrapper[5120]: I0316 15:56:40.922348 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-cknpd" event={"ID":"2bce8490-8143-4aad-a535-bb6315a95434","Type":"ContainerDied","Data":"bd7f88b75b8287e83660979835f2d24ab9e1334b50c87c8eba90ac891fa2c5bb"} Mar 16 15:56:40 crc kubenswrapper[5120]: I0316 15:56:40.922444 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-cknpd" event={"ID":"2bce8490-8143-4aad-a535-bb6315a95434","Type":"ContainerDied","Data":"7c84f9b878cab32c26f521ba24048756ac2298a3f704734738de1bb8323299ac"} Mar 16 15:56:40 crc kubenswrapper[5120]: I0316 15:56:40.922470 5120 scope.go:117] "RemoveContainer" containerID="bd7f88b75b8287e83660979835f2d24ab9e1334b50c87c8eba90ac891fa2c5bb" Mar 16 15:56:40 crc kubenswrapper[5120]: I0316 15:56:40.927360 5120 generic.go:358] "Generic (PLEG): container finished" podID="0b26707e-d8ca-4286-aa82-d91fa16c7a10" containerID="848052c39832ffc9937ad0c1a209ef2abc124e151f2f8b581a8a4b3455085c25" exitCode=0 Mar 16 15:56:40 crc kubenswrapper[5120]: I0316 15:56:40.927412 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-dc27-account-create-update-gswht" event={"ID":"0b26707e-d8ca-4286-aa82-d91fa16c7a10","Type":"ContainerDied","Data":"848052c39832ffc9937ad0c1a209ef2abc124e151f2f8b581a8a4b3455085c25"} Mar 16 15:56:40 crc kubenswrapper[5120]: I0316 15:56:40.932196 5120 generic.go:358] "Generic (PLEG): container finished" podID="255a48fb-770e-45fa-8713-8f5c5dcb2a5c" containerID="875c8c2106b5d3fb2af681c313f5c1710af0860a2f99f3e33ec9a1e47e285e23" exitCode=0 Mar 16 15:56:40 crc kubenswrapper[5120]: I0316 15:56:40.932660 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-db-create-7k2zr" event={"ID":"255a48fb-770e-45fa-8713-8f5c5dcb2a5c","Type":"ContainerDied","Data":"875c8c2106b5d3fb2af681c313f5c1710af0860a2f99f3e33ec9a1e47e285e23"} Mar 16 15:56:40 crc kubenswrapper[5120]: I0316 15:56:40.935829 5120 generic.go:358] "Generic (PLEG): container finished" podID="512ae1aa-4bdc-4ad0-a53c-f694c3e56583" containerID="a49714a7590e82f0621f8c9521183fbb6ed758639be8404d97f370eb2168ff36" exitCode=0 Mar 16 15:56:40 crc kubenswrapper[5120]: I0316 15:56:40.936026 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-db-create-snl2v" event={"ID":"512ae1aa-4bdc-4ad0-a53c-f694c3e56583","Type":"ContainerDied","Data":"a49714a7590e82f0621f8c9521183fbb6ed758639be8404d97f370eb2168ff36"} Mar 16 15:56:40 crc kubenswrapper[5120]: I0316 15:56:40.947625 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"275fa492-ad6d-44f0-84b3-df33f29e6f89","Type":"ContainerStarted","Data":"bf3728a22fe7a82bfd6d73f0ccb5a2272f5fe3dacf628ccb2c4dba7a7ba47659"} Mar 16 15:56:40 crc kubenswrapper[5120]: I0316 15:56:40.950612 5120 generic.go:358] "Generic (PLEG): container finished" podID="8076c13b-f4f2-47fa-93f7-df2310ab04dc" containerID="85fcc64044b86e65a1bd95d1042ae4823e21ae83a977321ddb0f50f645a0f65c" exitCode=0 Mar 16 15:56:40 crc kubenswrapper[5120]: I0316 15:56:40.950776 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-ef54-account-create-update-bqpvb" event={"ID":"8076c13b-f4f2-47fa-93f7-df2310ab04dc","Type":"ContainerDied","Data":"85fcc64044b86e65a1bd95d1042ae4823e21ae83a977321ddb0f50f645a0f65c"} Mar 16 15:56:40 crc kubenswrapper[5120]: I0316 15:56:40.960005 5120 generic.go:358] "Generic (PLEG): container finished" podID="372db992-7da6-4e0f-b492-76e1c6713181" containerID="f628abe32468e3c1a1fb2a723b1fbd57378a6b403fb582427974425009588307" exitCode=0 Mar 16 15:56:40 crc kubenswrapper[5120]: I0316 15:56:40.960099 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-8a54-account-create-update-s5q9b" event={"ID":"372db992-7da6-4e0f-b492-76e1c6713181","Type":"ContainerDied","Data":"f628abe32468e3c1a1fb2a723b1fbd57378a6b403fb582427974425009588307"} Mar 16 15:56:40 crc kubenswrapper[5120]: I0316 15:56:40.969022 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/certified-operators-cknpd"] Mar 16 15:56:41 crc kubenswrapper[5120]: I0316 15:56:41.008448 5120 scope.go:117] "RemoveContainer" containerID="017ac48a4c0b2eeedb40dac0e87f00e09e790ac0d3f995dd5c2bcd0ecd37512d" Mar 16 15:56:41 crc kubenswrapper[5120]: I0316 15:56:41.028781 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/certified-operators-cknpd"] Mar 16 15:56:41 crc kubenswrapper[5120]: I0316 15:56:41.045009 5120 scope.go:117] "RemoveContainer" containerID="edaa9d4618ff14fac9971efece6d04b93f86bbf1f29d7561193c6760c4cfa042" Mar 16 15:56:41 crc kubenswrapper[5120]: I0316 15:56:41.118689 5120 scope.go:117] "RemoveContainer" containerID="bd7f88b75b8287e83660979835f2d24ab9e1334b50c87c8eba90ac891fa2c5bb" Mar 16 15:56:41 crc kubenswrapper[5120]: E0316 15:56:41.121115 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd7f88b75b8287e83660979835f2d24ab9e1334b50c87c8eba90ac891fa2c5bb\": container with ID starting with bd7f88b75b8287e83660979835f2d24ab9e1334b50c87c8eba90ac891fa2c5bb not found: ID does not exist" containerID="bd7f88b75b8287e83660979835f2d24ab9e1334b50c87c8eba90ac891fa2c5bb" Mar 16 15:56:41 crc kubenswrapper[5120]: I0316 15:56:41.121173 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd7f88b75b8287e83660979835f2d24ab9e1334b50c87c8eba90ac891fa2c5bb"} err="failed to get container status \"bd7f88b75b8287e83660979835f2d24ab9e1334b50c87c8eba90ac891fa2c5bb\": rpc error: code = NotFound desc = could not find container \"bd7f88b75b8287e83660979835f2d24ab9e1334b50c87c8eba90ac891fa2c5bb\": container with ID starting with bd7f88b75b8287e83660979835f2d24ab9e1334b50c87c8eba90ac891fa2c5bb not found: ID does not exist" Mar 16 15:56:41 crc kubenswrapper[5120]: I0316 15:56:41.121204 5120 scope.go:117] "RemoveContainer" containerID="017ac48a4c0b2eeedb40dac0e87f00e09e790ac0d3f995dd5c2bcd0ecd37512d" Mar 16 15:56:41 crc kubenswrapper[5120]: E0316 15:56:41.121818 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"017ac48a4c0b2eeedb40dac0e87f00e09e790ac0d3f995dd5c2bcd0ecd37512d\": container with ID starting with 017ac48a4c0b2eeedb40dac0e87f00e09e790ac0d3f995dd5c2bcd0ecd37512d not found: ID does not exist" containerID="017ac48a4c0b2eeedb40dac0e87f00e09e790ac0d3f995dd5c2bcd0ecd37512d" Mar 16 15:56:41 crc kubenswrapper[5120]: I0316 15:56:41.121843 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"017ac48a4c0b2eeedb40dac0e87f00e09e790ac0d3f995dd5c2bcd0ecd37512d"} err="failed to get container status \"017ac48a4c0b2eeedb40dac0e87f00e09e790ac0d3f995dd5c2bcd0ecd37512d\": rpc error: code = NotFound desc = could not find container \"017ac48a4c0b2eeedb40dac0e87f00e09e790ac0d3f995dd5c2bcd0ecd37512d\": container with ID starting with 017ac48a4c0b2eeedb40dac0e87f00e09e790ac0d3f995dd5c2bcd0ecd37512d not found: ID does not exist" Mar 16 15:56:41 crc kubenswrapper[5120]: I0316 15:56:41.121861 5120 scope.go:117] "RemoveContainer" containerID="edaa9d4618ff14fac9971efece6d04b93f86bbf1f29d7561193c6760c4cfa042" Mar 16 15:56:41 crc kubenswrapper[5120]: E0316 15:56:41.123029 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"edaa9d4618ff14fac9971efece6d04b93f86bbf1f29d7561193c6760c4cfa042\": container with ID starting with edaa9d4618ff14fac9971efece6d04b93f86bbf1f29d7561193c6760c4cfa042 not found: ID does not exist" containerID="edaa9d4618ff14fac9971efece6d04b93f86bbf1f29d7561193c6760c4cfa042" Mar 16 15:56:41 crc kubenswrapper[5120]: I0316 15:56:41.123054 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"edaa9d4618ff14fac9971efece6d04b93f86bbf1f29d7561193c6760c4cfa042"} err="failed to get container status \"edaa9d4618ff14fac9971efece6d04b93f86bbf1f29d7561193c6760c4cfa042\": rpc error: code = NotFound desc = could not find container \"edaa9d4618ff14fac9971efece6d04b93f86bbf1f29d7561193c6760c4cfa042\": container with ID starting with edaa9d4618ff14fac9971efece6d04b93f86bbf1f29d7561193c6760c4cfa042 not found: ID does not exist" Mar 16 15:56:41 crc kubenswrapper[5120]: I0316 15:56:41.375316 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-8a54-account-create-update-s5q9b" Mar 16 15:56:41 crc kubenswrapper[5120]: I0316 15:56:41.396404 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-db-create-cj5jd" Mar 16 15:56:41 crc kubenswrapper[5120]: I0316 15:56:41.457810 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/372db992-7da6-4e0f-b492-76e1c6713181-operator-scripts\") pod \"372db992-7da6-4e0f-b492-76e1c6713181\" (UID: \"372db992-7da6-4e0f-b492-76e1c6713181\") " Mar 16 15:56:41 crc kubenswrapper[5120]: I0316 15:56:41.458535 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bkk2s\" (UniqueName: \"kubernetes.io/projected/372db992-7da6-4e0f-b492-76e1c6713181-kube-api-access-bkk2s\") pod \"372db992-7da6-4e0f-b492-76e1c6713181\" (UID: \"372db992-7da6-4e0f-b492-76e1c6713181\") " Mar 16 15:56:41 crc kubenswrapper[5120]: I0316 15:56:41.459724 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/372db992-7da6-4e0f-b492-76e1c6713181-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "372db992-7da6-4e0f-b492-76e1c6713181" (UID: "372db992-7da6-4e0f-b492-76e1c6713181"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:56:41 crc kubenswrapper[5120]: I0316 15:56:41.467297 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/372db992-7da6-4e0f-b492-76e1c6713181-kube-api-access-bkk2s" (OuterVolumeSpecName: "kube-api-access-bkk2s") pod "372db992-7da6-4e0f-b492-76e1c6713181" (UID: "372db992-7da6-4e0f-b492-76e1c6713181"). InnerVolumeSpecName "kube-api-access-bkk2s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:56:41 crc kubenswrapper[5120]: I0316 15:56:41.562446 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/16251914-f9cf-4313-9b3b-27435ea05123-operator-scripts\") pod \"16251914-f9cf-4313-9b3b-27435ea05123\" (UID: \"16251914-f9cf-4313-9b3b-27435ea05123\") " Mar 16 15:56:41 crc kubenswrapper[5120]: I0316 15:56:41.562699 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8wkg9\" (UniqueName: \"kubernetes.io/projected/16251914-f9cf-4313-9b3b-27435ea05123-kube-api-access-8wkg9\") pod \"16251914-f9cf-4313-9b3b-27435ea05123\" (UID: \"16251914-f9cf-4313-9b3b-27435ea05123\") " Mar 16 15:56:41 crc kubenswrapper[5120]: I0316 15:56:41.563207 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/372db992-7da6-4e0f-b492-76e1c6713181-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 15:56:41 crc kubenswrapper[5120]: I0316 15:56:41.563225 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bkk2s\" (UniqueName: \"kubernetes.io/projected/372db992-7da6-4e0f-b492-76e1c6713181-kube-api-access-bkk2s\") on node \"crc\" DevicePath \"\"" Mar 16 15:56:41 crc kubenswrapper[5120]: I0316 15:56:41.564533 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/16251914-f9cf-4313-9b3b-27435ea05123-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "16251914-f9cf-4313-9b3b-27435ea05123" (UID: "16251914-f9cf-4313-9b3b-27435ea05123"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:56:41 crc kubenswrapper[5120]: I0316 15:56:41.571492 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16251914-f9cf-4313-9b3b-27435ea05123-kube-api-access-8wkg9" (OuterVolumeSpecName: "kube-api-access-8wkg9") pod "16251914-f9cf-4313-9b3b-27435ea05123" (UID: "16251914-f9cf-4313-9b3b-27435ea05123"). InnerVolumeSpecName "kube-api-access-8wkg9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:56:41 crc kubenswrapper[5120]: I0316 15:56:41.664889 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/16251914-f9cf-4313-9b3b-27435ea05123-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 15:56:41 crc kubenswrapper[5120]: I0316 15:56:41.665091 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8wkg9\" (UniqueName: \"kubernetes.io/projected/16251914-f9cf-4313-9b3b-27435ea05123-kube-api-access-8wkg9\") on node \"crc\" DevicePath \"\"" Mar 16 15:56:41 crc kubenswrapper[5120]: I0316 15:56:41.826977 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/swift-proxy-59f58b5b58-tw7qc" Mar 16 15:56:41 crc kubenswrapper[5120]: I0316 15:56:41.848104 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/swift-proxy-59f58b5b58-tw7qc" Mar 16 15:56:41 crc kubenswrapper[5120]: I0316 15:56:41.981304 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-db-create-cj5jd" event={"ID":"16251914-f9cf-4313-9b3b-27435ea05123","Type":"ContainerDied","Data":"f8c6dfb6cfec21dd89f7737337e8b909011e49c48a203ece7b3ef0d6e43b2ce8"} Mar 16 15:56:41 crc kubenswrapper[5120]: I0316 15:56:41.981335 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-db-create-cj5jd" Mar 16 15:56:41 crc kubenswrapper[5120]: I0316 15:56:41.981349 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f8c6dfb6cfec21dd89f7737337e8b909011e49c48a203ece7b3ef0d6e43b2ce8" Mar 16 15:56:41 crc kubenswrapper[5120]: I0316 15:56:41.982822 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-8a54-account-create-update-s5q9b" event={"ID":"372db992-7da6-4e0f-b492-76e1c6713181","Type":"ContainerDied","Data":"40141e91cce93ca4fc53b85e2a80e6e3a9cf29ead95581c325caf26839e0c3ea"} Mar 16 15:56:41 crc kubenswrapper[5120]: I0316 15:56:41.982837 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="40141e91cce93ca4fc53b85e2a80e6e3a9cf29ead95581c325caf26839e0c3ea" Mar 16 15:56:41 crc kubenswrapper[5120]: I0316 15:56:41.982897 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-8a54-account-create-update-s5q9b" Mar 16 15:56:42 crc kubenswrapper[5120]: I0316 15:56:42.498567 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-dc27-account-create-update-gswht" Mar 16 15:56:42 crc kubenswrapper[5120]: I0316 15:56:42.541698 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-db-create-7k2zr" Mar 16 15:56:42 crc kubenswrapper[5120]: I0316 15:56:42.576335 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-db-create-snl2v" Mar 16 15:56:42 crc kubenswrapper[5120]: I0316 15:56:42.580009 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-ef54-account-create-update-bqpvb" Mar 16 15:56:42 crc kubenswrapper[5120]: I0316 15:56:42.594069 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/512ae1aa-4bdc-4ad0-a53c-f694c3e56583-operator-scripts\") pod \"512ae1aa-4bdc-4ad0-a53c-f694c3e56583\" (UID: \"512ae1aa-4bdc-4ad0-a53c-f694c3e56583\") " Mar 16 15:56:42 crc kubenswrapper[5120]: I0316 15:56:42.594161 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0b26707e-d8ca-4286-aa82-d91fa16c7a10-operator-scripts\") pod \"0b26707e-d8ca-4286-aa82-d91fa16c7a10\" (UID: \"0b26707e-d8ca-4286-aa82-d91fa16c7a10\") " Mar 16 15:56:42 crc kubenswrapper[5120]: I0316 15:56:42.594192 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jh2mc\" (UniqueName: \"kubernetes.io/projected/0b26707e-d8ca-4286-aa82-d91fa16c7a10-kube-api-access-jh2mc\") pod \"0b26707e-d8ca-4286-aa82-d91fa16c7a10\" (UID: \"0b26707e-d8ca-4286-aa82-d91fa16c7a10\") " Mar 16 15:56:42 crc kubenswrapper[5120]: I0316 15:56:42.594393 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z8bbx\" (UniqueName: \"kubernetes.io/projected/8076c13b-f4f2-47fa-93f7-df2310ab04dc-kube-api-access-z8bbx\") pod \"8076c13b-f4f2-47fa-93f7-df2310ab04dc\" (UID: \"8076c13b-f4f2-47fa-93f7-df2310ab04dc\") " Mar 16 15:56:42 crc kubenswrapper[5120]: I0316 15:56:42.594433 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/255a48fb-770e-45fa-8713-8f5c5dcb2a5c-operator-scripts\") pod \"255a48fb-770e-45fa-8713-8f5c5dcb2a5c\" (UID: \"255a48fb-770e-45fa-8713-8f5c5dcb2a5c\") " Mar 16 15:56:42 crc kubenswrapper[5120]: I0316 15:56:42.594497 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x7nrm\" (UniqueName: \"kubernetes.io/projected/512ae1aa-4bdc-4ad0-a53c-f694c3e56583-kube-api-access-x7nrm\") pod \"512ae1aa-4bdc-4ad0-a53c-f694c3e56583\" (UID: \"512ae1aa-4bdc-4ad0-a53c-f694c3e56583\") " Mar 16 15:56:42 crc kubenswrapper[5120]: I0316 15:56:42.594550 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8076c13b-f4f2-47fa-93f7-df2310ab04dc-operator-scripts\") pod \"8076c13b-f4f2-47fa-93f7-df2310ab04dc\" (UID: \"8076c13b-f4f2-47fa-93f7-df2310ab04dc\") " Mar 16 15:56:42 crc kubenswrapper[5120]: I0316 15:56:42.594686 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wfx55\" (UniqueName: \"kubernetes.io/projected/255a48fb-770e-45fa-8713-8f5c5dcb2a5c-kube-api-access-wfx55\") pod \"255a48fb-770e-45fa-8713-8f5c5dcb2a5c\" (UID: \"255a48fb-770e-45fa-8713-8f5c5dcb2a5c\") " Mar 16 15:56:42 crc kubenswrapper[5120]: I0316 15:56:42.594666 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/512ae1aa-4bdc-4ad0-a53c-f694c3e56583-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "512ae1aa-4bdc-4ad0-a53c-f694c3e56583" (UID: "512ae1aa-4bdc-4ad0-a53c-f694c3e56583"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:56:42 crc kubenswrapper[5120]: I0316 15:56:42.595038 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/512ae1aa-4bdc-4ad0-a53c-f694c3e56583-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 15:56:42 crc kubenswrapper[5120]: I0316 15:56:42.595872 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b26707e-d8ca-4286-aa82-d91fa16c7a10-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "0b26707e-d8ca-4286-aa82-d91fa16c7a10" (UID: "0b26707e-d8ca-4286-aa82-d91fa16c7a10"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:56:42 crc kubenswrapper[5120]: I0316 15:56:42.597149 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8076c13b-f4f2-47fa-93f7-df2310ab04dc-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "8076c13b-f4f2-47fa-93f7-df2310ab04dc" (UID: "8076c13b-f4f2-47fa-93f7-df2310ab04dc"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:56:42 crc kubenswrapper[5120]: I0316 15:56:42.601247 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8076c13b-f4f2-47fa-93f7-df2310ab04dc-kube-api-access-z8bbx" (OuterVolumeSpecName: "kube-api-access-z8bbx") pod "8076c13b-f4f2-47fa-93f7-df2310ab04dc" (UID: "8076c13b-f4f2-47fa-93f7-df2310ab04dc"). InnerVolumeSpecName "kube-api-access-z8bbx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:56:42 crc kubenswrapper[5120]: I0316 15:56:42.602563 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/255a48fb-770e-45fa-8713-8f5c5dcb2a5c-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "255a48fb-770e-45fa-8713-8f5c5dcb2a5c" (UID: "255a48fb-770e-45fa-8713-8f5c5dcb2a5c"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:56:42 crc kubenswrapper[5120]: I0316 15:56:42.603632 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/255a48fb-770e-45fa-8713-8f5c5dcb2a5c-kube-api-access-wfx55" (OuterVolumeSpecName: "kube-api-access-wfx55") pod "255a48fb-770e-45fa-8713-8f5c5dcb2a5c" (UID: "255a48fb-770e-45fa-8713-8f5c5dcb2a5c"). InnerVolumeSpecName "kube-api-access-wfx55". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:56:42 crc kubenswrapper[5120]: I0316 15:56:42.605784 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b26707e-d8ca-4286-aa82-d91fa16c7a10-kube-api-access-jh2mc" (OuterVolumeSpecName: "kube-api-access-jh2mc") pod "0b26707e-d8ca-4286-aa82-d91fa16c7a10" (UID: "0b26707e-d8ca-4286-aa82-d91fa16c7a10"). InnerVolumeSpecName "kube-api-access-jh2mc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:56:42 crc kubenswrapper[5120]: I0316 15:56:42.609901 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/512ae1aa-4bdc-4ad0-a53c-f694c3e56583-kube-api-access-x7nrm" (OuterVolumeSpecName: "kube-api-access-x7nrm") pod "512ae1aa-4bdc-4ad0-a53c-f694c3e56583" (UID: "512ae1aa-4bdc-4ad0-a53c-f694c3e56583"). InnerVolumeSpecName "kube-api-access-x7nrm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:56:42 crc kubenswrapper[5120]: I0316 15:56:42.676074 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2bce8490-8143-4aad-a535-bb6315a95434" path="/var/lib/kubelet/pods/2bce8490-8143-4aad-a535-bb6315a95434/volumes" Mar 16 15:56:42 crc kubenswrapper[5120]: I0316 15:56:42.695930 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z8bbx\" (UniqueName: \"kubernetes.io/projected/8076c13b-f4f2-47fa-93f7-df2310ab04dc-kube-api-access-z8bbx\") on node \"crc\" DevicePath \"\"" Mar 16 15:56:42 crc kubenswrapper[5120]: I0316 15:56:42.695962 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/255a48fb-770e-45fa-8713-8f5c5dcb2a5c-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 15:56:42 crc kubenswrapper[5120]: I0316 15:56:42.695972 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x7nrm\" (UniqueName: \"kubernetes.io/projected/512ae1aa-4bdc-4ad0-a53c-f694c3e56583-kube-api-access-x7nrm\") on node \"crc\" DevicePath \"\"" Mar 16 15:56:42 crc kubenswrapper[5120]: I0316 15:56:42.695981 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8076c13b-f4f2-47fa-93f7-df2310ab04dc-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 15:56:42 crc kubenswrapper[5120]: I0316 15:56:42.695991 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wfx55\" (UniqueName: \"kubernetes.io/projected/255a48fb-770e-45fa-8713-8f5c5dcb2a5c-kube-api-access-wfx55\") on node \"crc\" DevicePath \"\"" Mar 16 15:56:42 crc kubenswrapper[5120]: I0316 15:56:42.696002 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0b26707e-d8ca-4286-aa82-d91fa16c7a10-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 15:56:42 crc kubenswrapper[5120]: I0316 15:56:42.696011 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jh2mc\" (UniqueName: \"kubernetes.io/projected/0b26707e-d8ca-4286-aa82-d91fa16c7a10-kube-api-access-jh2mc\") on node \"crc\" DevicePath \"\"" Mar 16 15:56:42 crc kubenswrapper[5120]: I0316 15:56:42.738977 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-v822j_ac55471d-4e42-475f-a082-50f611571482/kube-multus/0.log" Mar 16 15:56:42 crc kubenswrapper[5120]: I0316 15:56:42.744028 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-v822j_ac55471d-4e42-475f-a082-50f611571482/kube-multus/0.log" Mar 16 15:56:42 crc kubenswrapper[5120]: I0316 15:56:42.746914 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-crc_9f0bc7fcb0822a2c13eb2d22cd8c0641/kube-controller-manager/0.log" Mar 16 15:56:42 crc kubenswrapper[5120]: I0316 15:56:42.750787 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-crc_9f0bc7fcb0822a2c13eb2d22cd8c0641/kube-controller-manager/0.log" Mar 16 15:56:43 crc kubenswrapper[5120]: I0316 15:56:43.008574 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-ef54-account-create-update-bqpvb" Mar 16 15:56:43 crc kubenswrapper[5120]: I0316 15:56:43.008605 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-ef54-account-create-update-bqpvb" event={"ID":"8076c13b-f4f2-47fa-93f7-df2310ab04dc","Type":"ContainerDied","Data":"3ae4537bb75fb3c72bf62cedb0a10ad920bee2b89fc45fc83d759cb4eb4f4ebe"} Mar 16 15:56:43 crc kubenswrapper[5120]: I0316 15:56:43.008660 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3ae4537bb75fb3c72bf62cedb0a10ad920bee2b89fc45fc83d759cb4eb4f4ebe" Mar 16 15:56:43 crc kubenswrapper[5120]: I0316 15:56:43.011593 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-dc27-account-create-update-gswht" event={"ID":"0b26707e-d8ca-4286-aa82-d91fa16c7a10","Type":"ContainerDied","Data":"5f996890e9b70a7181a18c53b10e1f806c83f2b7f96fc73b5130bfcad34f8794"} Mar 16 15:56:43 crc kubenswrapper[5120]: I0316 15:56:43.011618 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-dc27-account-create-update-gswht" Mar 16 15:56:43 crc kubenswrapper[5120]: I0316 15:56:43.011643 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5f996890e9b70a7181a18c53b10e1f806c83f2b7f96fc73b5130bfcad34f8794" Mar 16 15:56:43 crc kubenswrapper[5120]: I0316 15:56:43.014897 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-db-create-7k2zr" Mar 16 15:56:43 crc kubenswrapper[5120]: I0316 15:56:43.014938 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-db-create-7k2zr" event={"ID":"255a48fb-770e-45fa-8713-8f5c5dcb2a5c","Type":"ContainerDied","Data":"67a4d332234ff578e1af0042f26d44b8989a6691d24437093dd43a6ea1105fb3"} Mar 16 15:56:43 crc kubenswrapper[5120]: I0316 15:56:43.014974 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="67a4d332234ff578e1af0042f26d44b8989a6691d24437093dd43a6ea1105fb3" Mar 16 15:56:43 crc kubenswrapper[5120]: I0316 15:56:43.017411 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-db-create-snl2v" Mar 16 15:56:43 crc kubenswrapper[5120]: I0316 15:56:43.017478 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-db-create-snl2v" event={"ID":"512ae1aa-4bdc-4ad0-a53c-f694c3e56583","Type":"ContainerDied","Data":"05449f3836f0cd52d991c070ad41a5074049f48ee85e8e3f4d529a5f0634edde"} Mar 16 15:56:43 crc kubenswrapper[5120]: I0316 15:56:43.017517 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="05449f3836f0cd52d991c070ad41a5074049f48ee85e8e3f4d529a5f0634edde" Mar 16 15:56:43 crc kubenswrapper[5120]: I0316 15:56:43.020195 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"275fa492-ad6d-44f0-84b3-df33f29e6f89","Type":"ContainerStarted","Data":"fe7850b277d6e9bfcc5472a2f569b474b9f0a929b7e74d4aa8888a96bf55483a"} Mar 16 15:56:43 crc kubenswrapper[5120]: I0316 15:56:43.020454 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:56:43 crc kubenswrapper[5120]: I0316 15:56:43.045198 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.875405574 podStartE2EDuration="7.045175207s" podCreationTimestamp="2026-03-16 15:56:36 +0000 UTC" firstStartedPulling="2026-03-16 15:56:37.701354556 +0000 UTC m=+1499.855286213" lastFinishedPulling="2026-03-16 15:56:41.871124189 +0000 UTC m=+1504.025055846" observedRunningTime="2026-03-16 15:56:43.042848852 +0000 UTC m=+1505.196780529" watchObservedRunningTime="2026-03-16 15:56:43.045175207 +0000 UTC m=+1505.199106884" Mar 16 15:56:43 crc kubenswrapper[5120]: I0316 15:56:43.477318 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-marketplace/redhat-marketplace-xqwmf" Mar 16 15:56:43 crc kubenswrapper[5120]: I0316 15:56:43.478424 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-marketplace-xqwmf" Mar 16 15:56:43 crc kubenswrapper[5120]: I0316 15:56:43.530595 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-marketplace-xqwmf" Mar 16 15:56:44 crc kubenswrapper[5120]: I0316 15:56:44.109098 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-marketplace-xqwmf" Mar 16 15:56:44 crc kubenswrapper[5120]: I0316 15:56:44.199178 5120 scope.go:117] "RemoveContainer" containerID="77262c38f52838b7813b0801f188c555dac24fc52280dd4023a71f20a2bee610" Mar 16 15:56:44 crc kubenswrapper[5120]: I0316 15:56:44.235297 5120 scope.go:117] "RemoveContainer" containerID="e43f613a2f274b391d9bbcfbacc3662551b361db98c2e94b5ccf405de7985ddf" Mar 16 15:56:44 crc kubenswrapper[5120]: I0316 15:56:44.277080 5120 scope.go:117] "RemoveContainer" containerID="67a31541ab497c672f2f7e36c23db3fced2a193b78fad102ca2c5246637f56e2" Mar 16 15:56:44 crc kubenswrapper[5120]: I0316 15:56:44.314254 5120 scope.go:117] "RemoveContainer" containerID="22134ed61214cfcb4b62b61c2c8b66351c620a2ab55a0217bf762503e825f4b9" Mar 16 15:56:44 crc kubenswrapper[5120]: I0316 15:56:44.347229 5120 scope.go:117] "RemoveContainer" containerID="f0dc8466f57f937e327fdd03b4e6dbfc53917746f482b8eb30bd9a309d510854" Mar 16 15:56:44 crc kubenswrapper[5120]: I0316 15:56:44.373024 5120 scope.go:117] "RemoveContainer" containerID="92e3ffc74a9c0a82f9f83e8955ea6c9346517e8756f498aead0b817359fef97a" Mar 16 15:56:44 crc kubenswrapper[5120]: I0316 15:56:44.491523 5120 scope.go:117] "RemoveContainer" containerID="72332479aa958fc5e61ccf2b6d8d70f6451c35955b231f405b209ee03cac68de" Mar 16 15:56:44 crc kubenswrapper[5120]: I0316 15:56:44.517737 5120 scope.go:117] "RemoveContainer" containerID="bd5b78c94a2af2bc120c0038a55f5b8f7c033185a2105a274d5a7009b5073efe" Mar 16 15:56:44 crc kubenswrapper[5120]: I0316 15:56:44.568809 5120 scope.go:117] "RemoveContainer" containerID="ea54a0abff5bb10b70106fb9ae1f1ebe16eb93672332619135d2135880b47565" Mar 16 15:56:44 crc kubenswrapper[5120]: I0316 15:56:44.610700 5120 scope.go:117] "RemoveContainer" containerID="f5c2fd82b6ea338f7d6c9db503db6e0feda2486b4d73e345ab3733d653dc087e" Mar 16 15:56:44 crc kubenswrapper[5120]: I0316 15:56:44.631492 5120 scope.go:117] "RemoveContainer" containerID="fde5fb0b2c5ff4c6662d21de92b6d87f0744f43da51dab65466b8402c59efc3c" Mar 16 15:56:44 crc kubenswrapper[5120]: I0316 15:56:44.674162 5120 scope.go:117] "RemoveContainer" containerID="14ee402c6747f1b4b78b0a77b1edcb405e0f0a750a426e1880c2fc7730c5aeb0" Mar 16 15:56:44 crc kubenswrapper[5120]: I0316 15:56:44.700192 5120 scope.go:117] "RemoveContainer" containerID="fa4fe22876a79d9265e5ced2af3e9955f7429586398083a0f32a4c12a8e27a3c" Mar 16 15:56:44 crc kubenswrapper[5120]: I0316 15:56:44.740569 5120 scope.go:117] "RemoveContainer" containerID="a8d2135db021dc89abaf23da0be3ef286287bc8d9e97e08f5bd37833a8d66250" Mar 16 15:56:44 crc kubenswrapper[5120]: I0316 15:56:44.772336 5120 scope.go:117] "RemoveContainer" containerID="9cf1ff52e34d9a421706bbb6fd9916b0326245bd31c5fb1be6446abbe00739e8" Mar 16 15:56:44 crc kubenswrapper[5120]: I0316 15:56:44.802364 5120 scope.go:117] "RemoveContainer" containerID="bbef71805042a9e9dc316eaae0ede1249d7a5da9b07a113eb6992b51b435de25" Mar 16 15:56:44 crc kubenswrapper[5120]: I0316 15:56:44.821366 5120 scope.go:117] "RemoveContainer" containerID="f29c5599a5a10d75930b34202418a4e4dfdaf9eb0e035a7f633eb4e29115c475" Mar 16 15:56:44 crc kubenswrapper[5120]: I0316 15:56:44.840455 5120 scope.go:117] "RemoveContainer" containerID="f6516b04c93b8952f5f103daeb13d907ded489f3bf8112a5226b3b9e7a344640" Mar 16 15:56:44 crc kubenswrapper[5120]: I0316 15:56:44.870304 5120 scope.go:117] "RemoveContainer" containerID="0623ff218303a488dfd0223c2676560e8a4273890ab25b01b479732e5d7e9aaa" Mar 16 15:56:44 crc kubenswrapper[5120]: I0316 15:56:44.897079 5120 scope.go:117] "RemoveContainer" containerID="7686efc897f2d8fd462eac4cd5a266038ea5acac3f9365c2ddb297ab7f93415f" Mar 16 15:56:44 crc kubenswrapper[5120]: I0316 15:56:44.916102 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-marketplace-xqwmf"] Mar 16 15:56:44 crc kubenswrapper[5120]: I0316 15:56:44.919427 5120 scope.go:117] "RemoveContainer" containerID="97dd887c89b765ba273f5c85c867a679982fd142722154b57ea21c9d6404dbd7" Mar 16 15:56:44 crc kubenswrapper[5120]: I0316 15:56:44.954386 5120 scope.go:117] "RemoveContainer" containerID="db813feb04160a39dff817cfca02fbe3ad8df30c5a792ec7d41c63f6f169b7bd" Mar 16 15:56:45 crc kubenswrapper[5120]: I0316 15:56:45.028094 5120 scope.go:117] "RemoveContainer" containerID="0be872b6fbd5bb7ac8e55aece0b6d7374b692b4e86df832d3e8672300235303d" Mar 16 15:56:45 crc kubenswrapper[5120]: I0316 15:56:45.048453 5120 scope.go:117] "RemoveContainer" containerID="17d850bf7250355a2f26abed4c26bbd9dedcc1528a02f7aac5161667c10e607e" Mar 16 15:56:45 crc kubenswrapper[5120]: I0316 15:56:45.072289 5120 scope.go:117] "RemoveContainer" containerID="cde5f856ff99ea7ad37f794396a9dc9df7fc578241b167685629e114bff612a5" Mar 16 15:56:45 crc kubenswrapper[5120]: I0316 15:56:45.098142 5120 scope.go:117] "RemoveContainer" containerID="a0371585cd810f039230aeb2f4cd88f3eb9d2b90a7d16e3c5d1348498ccc0e11" Mar 16 15:56:45 crc kubenswrapper[5120]: I0316 15:56:45.104923 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 15:56:45 crc kubenswrapper[5120]: I0316 15:56:45.105183 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="275fa492-ad6d-44f0-84b3-df33f29e6f89" containerName="ceilometer-central-agent" containerID="cri-o://b54eaf33ea4461f32cb73207194553cad35e9691fd18f41cfa8a8c1331da9f35" gracePeriod=30 Mar 16 15:56:45 crc kubenswrapper[5120]: I0316 15:56:45.105251 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="275fa492-ad6d-44f0-84b3-df33f29e6f89" containerName="ceilometer-notification-agent" containerID="cri-o://0cab72c92f66ff73a03dea0af4618eb0e10cfbcf823eb1178abbb8adcbf62b7c" gracePeriod=30 Mar 16 15:56:45 crc kubenswrapper[5120]: I0316 15:56:45.105280 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="275fa492-ad6d-44f0-84b3-df33f29e6f89" containerName="sg-core" containerID="cri-o://bf3728a22fe7a82bfd6d73f0ccb5a2272f5fe3dacf628ccb2c4dba7a7ba47659" gracePeriod=30 Mar 16 15:56:45 crc kubenswrapper[5120]: I0316 15:56:45.105294 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="275fa492-ad6d-44f0-84b3-df33f29e6f89" containerName="proxy-httpd" containerID="cri-o://fe7850b277d6e9bfcc5472a2f569b474b9f0a929b7e74d4aa8888a96bf55483a" gracePeriod=30 Mar 16 15:56:45 crc kubenswrapper[5120]: I0316 15:56:45.132057 5120 scope.go:117] "RemoveContainer" containerID="6b226fb3c3e6a30cf01fa03c9ced6f34dd00ae13ad8e90d4f3449d551892236d" Mar 16 15:56:45 crc kubenswrapper[5120]: I0316 15:56:45.166346 5120 scope.go:117] "RemoveContainer" containerID="11022888adb543c6c9abb0c148040b363e988e74354acd6f81b3a4527faccc7e" Mar 16 15:56:45 crc kubenswrapper[5120]: I0316 15:56:45.190333 5120 scope.go:117] "RemoveContainer" containerID="01e871b86564712e3514085f671a2977bc7b524764ad870692c415d42dab6faa" Mar 16 15:56:45 crc kubenswrapper[5120]: I0316 15:56:45.223905 5120 scope.go:117] "RemoveContainer" containerID="0d80ee354d9050355b4730b29333e535d33a1e5da8e72bfccebead3d4b56a87f" Mar 16 15:56:45 crc kubenswrapper[5120]: I0316 15:56:45.363046 5120 scope.go:117] "RemoveContainer" containerID="0893e18c7c5fb4c06490d8f00ba7e3dfe7560fd36add47c9c2b1f80435087e46" Mar 16 15:56:45 crc kubenswrapper[5120]: I0316 15:56:45.426914 5120 scope.go:117] "RemoveContainer" containerID="439e67e27b13a415aa8d79b126fd7cca0830c0126cf161a6cc7daee8d018f7c1" Mar 16 15:56:45 crc kubenswrapper[5120]: I0316 15:56:45.453326 5120 scope.go:117] "RemoveContainer" containerID="a7e88337bf9943de6762af63123d82ed7ecb5b08d43e604821d3c16b565ebd37" Mar 16 15:56:45 crc kubenswrapper[5120]: I0316 15:56:45.495905 5120 scope.go:117] "RemoveContainer" containerID="5606f9ec875e826c528e4fb65ff5fd31bd80a651340c3947f06162b79757ac0e" Mar 16 15:56:45 crc kubenswrapper[5120]: I0316 15:56:45.521708 5120 scope.go:117] "RemoveContainer" containerID="061a2976be3df2e673ad197fc049e6d15f35955932edbe49dff3a84b1b51d30f" Mar 16 15:56:45 crc kubenswrapper[5120]: I0316 15:56:45.577976 5120 scope.go:117] "RemoveContainer" containerID="f2942ec6513e0750e6f7f0e379854065920c969d38fe7e164e35408445d59a9e" Mar 16 15:56:45 crc kubenswrapper[5120]: I0316 15:56:45.665260 5120 scope.go:117] "RemoveContainer" containerID="36f12ace0178f89b4b80cc54afc9fc1b1261f010245624360b90ccddecc32be1" Mar 16 15:56:46 crc kubenswrapper[5120]: I0316 15:56:46.081837 5120 generic.go:358] "Generic (PLEG): container finished" podID="275fa492-ad6d-44f0-84b3-df33f29e6f89" containerID="fe7850b277d6e9bfcc5472a2f569b474b9f0a929b7e74d4aa8888a96bf55483a" exitCode=0 Mar 16 15:56:46 crc kubenswrapper[5120]: I0316 15:56:46.081874 5120 generic.go:358] "Generic (PLEG): container finished" podID="275fa492-ad6d-44f0-84b3-df33f29e6f89" containerID="bf3728a22fe7a82bfd6d73f0ccb5a2272f5fe3dacf628ccb2c4dba7a7ba47659" exitCode=2 Mar 16 15:56:46 crc kubenswrapper[5120]: I0316 15:56:46.081885 5120 generic.go:358] "Generic (PLEG): container finished" podID="275fa492-ad6d-44f0-84b3-df33f29e6f89" containerID="0cab72c92f66ff73a03dea0af4618eb0e10cfbcf823eb1178abbb8adcbf62b7c" exitCode=0 Mar 16 15:56:46 crc kubenswrapper[5120]: I0316 15:56:46.081947 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"275fa492-ad6d-44f0-84b3-df33f29e6f89","Type":"ContainerDied","Data":"fe7850b277d6e9bfcc5472a2f569b474b9f0a929b7e74d4aa8888a96bf55483a"} Mar 16 15:56:46 crc kubenswrapper[5120]: I0316 15:56:46.081978 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"275fa492-ad6d-44f0-84b3-df33f29e6f89","Type":"ContainerDied","Data":"bf3728a22fe7a82bfd6d73f0ccb5a2272f5fe3dacf628ccb2c4dba7a7ba47659"} Mar 16 15:56:46 crc kubenswrapper[5120]: I0316 15:56:46.081992 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"275fa492-ad6d-44f0-84b3-df33f29e6f89","Type":"ContainerDied","Data":"0cab72c92f66ff73a03dea0af4618eb0e10cfbcf823eb1178abbb8adcbf62b7c"} Mar 16 15:56:46 crc kubenswrapper[5120]: I0316 15:56:46.096428 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-marketplace/redhat-marketplace-xqwmf" podUID="7e05eef7-7c4c-4faa-809a-2fa10da8f360" containerName="registry-server" containerID="cri-o://e5dc3db28d2fc3c25234d198c994281d9cbbb12947e2a76542d7f1f45e84566d" gracePeriod=2 Mar 16 15:56:46 crc kubenswrapper[5120]: I0316 15:56:46.571405 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-xqwmf" Mar 16 15:56:46 crc kubenswrapper[5120]: I0316 15:56:46.693653 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/7e05eef7-7c4c-4faa-809a-2fa10da8f360-utilities\") pod \"7e05eef7-7c4c-4faa-809a-2fa10da8f360\" (UID: \"7e05eef7-7c4c-4faa-809a-2fa10da8f360\") " Mar 16 15:56:46 crc kubenswrapper[5120]: I0316 15:56:46.693812 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/7e05eef7-7c4c-4faa-809a-2fa10da8f360-catalog-content\") pod \"7e05eef7-7c4c-4faa-809a-2fa10da8f360\" (UID: \"7e05eef7-7c4c-4faa-809a-2fa10da8f360\") " Mar 16 15:56:46 crc kubenswrapper[5120]: I0316 15:56:46.693886 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-28csq\" (UniqueName: \"kubernetes.io/projected/7e05eef7-7c4c-4faa-809a-2fa10da8f360-kube-api-access-28csq\") pod \"7e05eef7-7c4c-4faa-809a-2fa10da8f360\" (UID: \"7e05eef7-7c4c-4faa-809a-2fa10da8f360\") " Mar 16 15:56:46 crc kubenswrapper[5120]: I0316 15:56:46.695933 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e05eef7-7c4c-4faa-809a-2fa10da8f360-utilities" (OuterVolumeSpecName: "utilities") pod "7e05eef7-7c4c-4faa-809a-2fa10da8f360" (UID: "7e05eef7-7c4c-4faa-809a-2fa10da8f360"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:56:46 crc kubenswrapper[5120]: I0316 15:56:46.724219 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e05eef7-7c4c-4faa-809a-2fa10da8f360-kube-api-access-28csq" (OuterVolumeSpecName: "kube-api-access-28csq") pod "7e05eef7-7c4c-4faa-809a-2fa10da8f360" (UID: "7e05eef7-7c4c-4faa-809a-2fa10da8f360"). InnerVolumeSpecName "kube-api-access-28csq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:56:46 crc kubenswrapper[5120]: I0316 15:56:46.729508 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e05eef7-7c4c-4faa-809a-2fa10da8f360-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "7e05eef7-7c4c-4faa-809a-2fa10da8f360" (UID: "7e05eef7-7c4c-4faa-809a-2fa10da8f360"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:56:46 crc kubenswrapper[5120]: I0316 15:56:46.736128 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 15:56:46 crc kubenswrapper[5120]: I0316 15:56:46.736357 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="705910c5-8552-43be-ba28-dfad2b51ce96" containerName="glance-log" containerID="cri-o://4ca7ca677a69ff5a268826d7faf5ff870727b33cf022c842abb4a56c8d85e241" gracePeriod=30 Mar 16 15:56:46 crc kubenswrapper[5120]: I0316 15:56:46.737302 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="705910c5-8552-43be-ba28-dfad2b51ce96" containerName="glance-httpd" containerID="cri-o://e0012c05149be0f50d1c0f542da8165d28342dd996486c5320e55175341bf64d" gracePeriod=30 Mar 16 15:56:46 crc kubenswrapper[5120]: I0316 15:56:46.742288 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="705910c5-8552-43be-ba28-dfad2b51ce96" containerName="glance-httpd" probeResult="failure" output="Get \"https://10.217.1.0:9292/healthcheck\": EOF" Mar 16 15:56:46 crc kubenswrapper[5120]: I0316 15:56:46.795864 5120 reconciler_common.go:299] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/7e05eef7-7c4c-4faa-809a-2fa10da8f360-utilities\") on node \"crc\" DevicePath \"\"" Mar 16 15:56:46 crc kubenswrapper[5120]: I0316 15:56:46.795892 5120 reconciler_common.go:299] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/7e05eef7-7c4c-4faa-809a-2fa10da8f360-catalog-content\") on node \"crc\" DevicePath \"\"" Mar 16 15:56:46 crc kubenswrapper[5120]: I0316 15:56:46.795904 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-28csq\" (UniqueName: \"kubernetes.io/projected/7e05eef7-7c4c-4faa-809a-2fa10da8f360-kube-api-access-28csq\") on node \"crc\" DevicePath \"\"" Mar 16 15:56:47 crc kubenswrapper[5120]: I0316 15:56:47.128924 5120 generic.go:358] "Generic (PLEG): container finished" podID="7e05eef7-7c4c-4faa-809a-2fa10da8f360" containerID="e5dc3db28d2fc3c25234d198c994281d9cbbb12947e2a76542d7f1f45e84566d" exitCode=0 Mar 16 15:56:47 crc kubenswrapper[5120]: I0316 15:56:47.129133 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-xqwmf" event={"ID":"7e05eef7-7c4c-4faa-809a-2fa10da8f360","Type":"ContainerDied","Data":"e5dc3db28d2fc3c25234d198c994281d9cbbb12947e2a76542d7f1f45e84566d"} Mar 16 15:56:47 crc kubenswrapper[5120]: I0316 15:56:47.129168 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-xqwmf" event={"ID":"7e05eef7-7c4c-4faa-809a-2fa10da8f360","Type":"ContainerDied","Data":"29123e470b80e4e2fbb19c9ba57c85a786c38b6daa2015a68656b1c03a60c177"} Mar 16 15:56:47 crc kubenswrapper[5120]: I0316 15:56:47.129260 5120 scope.go:117] "RemoveContainer" containerID="e5dc3db28d2fc3c25234d198c994281d9cbbb12947e2a76542d7f1f45e84566d" Mar 16 15:56:47 crc kubenswrapper[5120]: I0316 15:56:47.129692 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-xqwmf" Mar 16 15:56:47 crc kubenswrapper[5120]: I0316 15:56:47.137414 5120 generic.go:358] "Generic (PLEG): container finished" podID="705910c5-8552-43be-ba28-dfad2b51ce96" containerID="4ca7ca677a69ff5a268826d7faf5ff870727b33cf022c842abb4a56c8d85e241" exitCode=143 Mar 16 15:56:47 crc kubenswrapper[5120]: I0316 15:56:47.137522 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"705910c5-8552-43be-ba28-dfad2b51ce96","Type":"ContainerDied","Data":"4ca7ca677a69ff5a268826d7faf5ff870727b33cf022c842abb4a56c8d85e241"} Mar 16 15:56:47 crc kubenswrapper[5120]: I0316 15:56:47.155918 5120 scope.go:117] "RemoveContainer" containerID="d40e58f6d8505d58fd3d39a24e3f06311d3de7d93591a9dd51417a619e1494b7" Mar 16 15:56:47 crc kubenswrapper[5120]: I0316 15:56:47.173958 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-marketplace-xqwmf"] Mar 16 15:56:47 crc kubenswrapper[5120]: I0316 15:56:47.184947 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/redhat-marketplace-xqwmf"] Mar 16 15:56:47 crc kubenswrapper[5120]: I0316 15:56:47.200645 5120 scope.go:117] "RemoveContainer" containerID="0c3aba9fcb29c166f3658a3a7f771fe636e711543830308dfa567c9f7771e9a0" Mar 16 15:56:47 crc kubenswrapper[5120]: I0316 15:56:47.227145 5120 scope.go:117] "RemoveContainer" containerID="e5dc3db28d2fc3c25234d198c994281d9cbbb12947e2a76542d7f1f45e84566d" Mar 16 15:56:47 crc kubenswrapper[5120]: E0316 15:56:47.227680 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e5dc3db28d2fc3c25234d198c994281d9cbbb12947e2a76542d7f1f45e84566d\": container with ID starting with e5dc3db28d2fc3c25234d198c994281d9cbbb12947e2a76542d7f1f45e84566d not found: ID does not exist" containerID="e5dc3db28d2fc3c25234d198c994281d9cbbb12947e2a76542d7f1f45e84566d" Mar 16 15:56:47 crc kubenswrapper[5120]: I0316 15:56:47.227707 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5dc3db28d2fc3c25234d198c994281d9cbbb12947e2a76542d7f1f45e84566d"} err="failed to get container status \"e5dc3db28d2fc3c25234d198c994281d9cbbb12947e2a76542d7f1f45e84566d\": rpc error: code = NotFound desc = could not find container \"e5dc3db28d2fc3c25234d198c994281d9cbbb12947e2a76542d7f1f45e84566d\": container with ID starting with e5dc3db28d2fc3c25234d198c994281d9cbbb12947e2a76542d7f1f45e84566d not found: ID does not exist" Mar 16 15:56:47 crc kubenswrapper[5120]: I0316 15:56:47.227725 5120 scope.go:117] "RemoveContainer" containerID="d40e58f6d8505d58fd3d39a24e3f06311d3de7d93591a9dd51417a619e1494b7" Mar 16 15:56:47 crc kubenswrapper[5120]: E0316 15:56:47.229020 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d40e58f6d8505d58fd3d39a24e3f06311d3de7d93591a9dd51417a619e1494b7\": container with ID starting with d40e58f6d8505d58fd3d39a24e3f06311d3de7d93591a9dd51417a619e1494b7 not found: ID does not exist" containerID="d40e58f6d8505d58fd3d39a24e3f06311d3de7d93591a9dd51417a619e1494b7" Mar 16 15:56:47 crc kubenswrapper[5120]: I0316 15:56:47.229046 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d40e58f6d8505d58fd3d39a24e3f06311d3de7d93591a9dd51417a619e1494b7"} err="failed to get container status \"d40e58f6d8505d58fd3d39a24e3f06311d3de7d93591a9dd51417a619e1494b7\": rpc error: code = NotFound desc = could not find container \"d40e58f6d8505d58fd3d39a24e3f06311d3de7d93591a9dd51417a619e1494b7\": container with ID starting with d40e58f6d8505d58fd3d39a24e3f06311d3de7d93591a9dd51417a619e1494b7 not found: ID does not exist" Mar 16 15:56:47 crc kubenswrapper[5120]: I0316 15:56:47.229082 5120 scope.go:117] "RemoveContainer" containerID="0c3aba9fcb29c166f3658a3a7f771fe636e711543830308dfa567c9f7771e9a0" Mar 16 15:56:47 crc kubenswrapper[5120]: E0316 15:56:47.229954 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c3aba9fcb29c166f3658a3a7f771fe636e711543830308dfa567c9f7771e9a0\": container with ID starting with 0c3aba9fcb29c166f3658a3a7f771fe636e711543830308dfa567c9f7771e9a0 not found: ID does not exist" containerID="0c3aba9fcb29c166f3658a3a7f771fe636e711543830308dfa567c9f7771e9a0" Mar 16 15:56:47 crc kubenswrapper[5120]: I0316 15:56:47.229976 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c3aba9fcb29c166f3658a3a7f771fe636e711543830308dfa567c9f7771e9a0"} err="failed to get container status \"0c3aba9fcb29c166f3658a3a7f771fe636e711543830308dfa567c9f7771e9a0\": rpc error: code = NotFound desc = could not find container \"0c3aba9fcb29c166f3658a3a7f771fe636e711543830308dfa567c9f7771e9a0\": container with ID starting with 0c3aba9fcb29c166f3658a3a7f771fe636e711543830308dfa567c9f7771e9a0 not found: ID does not exist" Mar 16 15:56:47 crc kubenswrapper[5120]: I0316 15:56:47.850311 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 15:56:47 crc kubenswrapper[5120]: I0316 15:56:47.851801 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="93f6640c-a255-4892-abe7-01f211126bb5" containerName="glance-httpd" containerID="cri-o://e577d0e4c18228d6b20ba47dd68bc63702e161589d5b28f44a14d98a921df96e" gracePeriod=30 Mar 16 15:56:47 crc kubenswrapper[5120]: I0316 15:56:47.852088 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="93f6640c-a255-4892-abe7-01f211126bb5" containerName="glance-log" containerID="cri-o://722ca498832ae2ebfb82e105279c5eb651d13cd50b7baec7f037c4941ec3bed0" gracePeriod=30 Mar 16 15:56:48 crc kubenswrapper[5120]: I0316 15:56:48.147092 5120 generic.go:358] "Generic (PLEG): container finished" podID="93f6640c-a255-4892-abe7-01f211126bb5" containerID="722ca498832ae2ebfb82e105279c5eb651d13cd50b7baec7f037c4941ec3bed0" exitCode=143 Mar 16 15:56:48 crc kubenswrapper[5120]: I0316 15:56:48.147152 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"93f6640c-a255-4892-abe7-01f211126bb5","Type":"ContainerDied","Data":"722ca498832ae2ebfb82e105279c5eb651d13cd50b7baec7f037c4941ec3bed0"} Mar 16 15:56:48 crc kubenswrapper[5120]: I0316 15:56:48.571429 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-fn6fc"] Mar 16 15:56:48 crc kubenswrapper[5120]: I0316 15:56:48.572654 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8076c13b-f4f2-47fa-93f7-df2310ab04dc" containerName="mariadb-account-create-update" Mar 16 15:56:48 crc kubenswrapper[5120]: I0316 15:56:48.572673 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8076c13b-f4f2-47fa-93f7-df2310ab04dc" containerName="mariadb-account-create-update" Mar 16 15:56:48 crc kubenswrapper[5120]: I0316 15:56:48.572689 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="255a48fb-770e-45fa-8713-8f5c5dcb2a5c" containerName="mariadb-database-create" Mar 16 15:56:48 crc kubenswrapper[5120]: I0316 15:56:48.572695 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="255a48fb-770e-45fa-8713-8f5c5dcb2a5c" containerName="mariadb-database-create" Mar 16 15:56:48 crc kubenswrapper[5120]: I0316 15:56:48.572728 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b26707e-d8ca-4286-aa82-d91fa16c7a10" containerName="mariadb-account-create-update" Mar 16 15:56:48 crc kubenswrapper[5120]: I0316 15:56:48.572736 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b26707e-d8ca-4286-aa82-d91fa16c7a10" containerName="mariadb-account-create-update" Mar 16 15:56:48 crc kubenswrapper[5120]: I0316 15:56:48.572745 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e05eef7-7c4c-4faa-809a-2fa10da8f360" containerName="extract-utilities" Mar 16 15:56:48 crc kubenswrapper[5120]: I0316 15:56:48.572750 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e05eef7-7c4c-4faa-809a-2fa10da8f360" containerName="extract-utilities" Mar 16 15:56:48 crc kubenswrapper[5120]: I0316 15:56:48.572775 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2bce8490-8143-4aad-a535-bb6315a95434" containerName="extract-utilities" Mar 16 15:56:48 crc kubenswrapper[5120]: I0316 15:56:48.572780 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bce8490-8143-4aad-a535-bb6315a95434" containerName="extract-utilities" Mar 16 15:56:48 crc kubenswrapper[5120]: I0316 15:56:48.572790 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2bce8490-8143-4aad-a535-bb6315a95434" containerName="registry-server" Mar 16 15:56:48 crc kubenswrapper[5120]: I0316 15:56:48.572797 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bce8490-8143-4aad-a535-bb6315a95434" containerName="registry-server" Mar 16 15:56:48 crc kubenswrapper[5120]: I0316 15:56:48.572813 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="512ae1aa-4bdc-4ad0-a53c-f694c3e56583" containerName="mariadb-database-create" Mar 16 15:56:48 crc kubenswrapper[5120]: I0316 15:56:48.572819 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="512ae1aa-4bdc-4ad0-a53c-f694c3e56583" containerName="mariadb-database-create" Mar 16 15:56:48 crc kubenswrapper[5120]: I0316 15:56:48.572830 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e05eef7-7c4c-4faa-809a-2fa10da8f360" containerName="extract-content" Mar 16 15:56:48 crc kubenswrapper[5120]: I0316 15:56:48.572835 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e05eef7-7c4c-4faa-809a-2fa10da8f360" containerName="extract-content" Mar 16 15:56:48 crc kubenswrapper[5120]: I0316 15:56:48.572853 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e05eef7-7c4c-4faa-809a-2fa10da8f360" containerName="registry-server" Mar 16 15:56:48 crc kubenswrapper[5120]: I0316 15:56:48.572858 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e05eef7-7c4c-4faa-809a-2fa10da8f360" containerName="registry-server" Mar 16 15:56:48 crc kubenswrapper[5120]: I0316 15:56:48.572865 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16251914-f9cf-4313-9b3b-27435ea05123" containerName="mariadb-database-create" Mar 16 15:56:48 crc kubenswrapper[5120]: I0316 15:56:48.572870 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="16251914-f9cf-4313-9b3b-27435ea05123" containerName="mariadb-database-create" Mar 16 15:56:48 crc kubenswrapper[5120]: I0316 15:56:48.572877 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2bce8490-8143-4aad-a535-bb6315a95434" containerName="extract-content" Mar 16 15:56:48 crc kubenswrapper[5120]: I0316 15:56:48.572882 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bce8490-8143-4aad-a535-bb6315a95434" containerName="extract-content" Mar 16 15:56:48 crc kubenswrapper[5120]: I0316 15:56:48.572890 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="372db992-7da6-4e0f-b492-76e1c6713181" containerName="mariadb-account-create-update" Mar 16 15:56:48 crc kubenswrapper[5120]: I0316 15:56:48.572896 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="372db992-7da6-4e0f-b492-76e1c6713181" containerName="mariadb-account-create-update" Mar 16 15:56:48 crc kubenswrapper[5120]: I0316 15:56:48.573052 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="372db992-7da6-4e0f-b492-76e1c6713181" containerName="mariadb-account-create-update" Mar 16 15:56:48 crc kubenswrapper[5120]: I0316 15:56:48.573061 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="255a48fb-770e-45fa-8713-8f5c5dcb2a5c" containerName="mariadb-database-create" Mar 16 15:56:48 crc kubenswrapper[5120]: I0316 15:56:48.573071 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="2bce8490-8143-4aad-a535-bb6315a95434" containerName="registry-server" Mar 16 15:56:48 crc kubenswrapper[5120]: I0316 15:56:48.573085 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="16251914-f9cf-4313-9b3b-27435ea05123" containerName="mariadb-database-create" Mar 16 15:56:48 crc kubenswrapper[5120]: I0316 15:56:48.573098 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="512ae1aa-4bdc-4ad0-a53c-f694c3e56583" containerName="mariadb-database-create" Mar 16 15:56:48 crc kubenswrapper[5120]: I0316 15:56:48.573107 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="8076c13b-f4f2-47fa-93f7-df2310ab04dc" containerName="mariadb-account-create-update" Mar 16 15:56:48 crc kubenswrapper[5120]: I0316 15:56:48.573114 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7e05eef7-7c4c-4faa-809a-2fa10da8f360" containerName="registry-server" Mar 16 15:56:48 crc kubenswrapper[5120]: I0316 15:56:48.573125 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="0b26707e-d8ca-4286-aa82-d91fa16c7a10" containerName="mariadb-account-create-update" Mar 16 15:56:48 crc kubenswrapper[5120]: I0316 15:56:48.577522 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-fn6fc" Mar 16 15:56:48 crc kubenswrapper[5120]: I0316 15:56:48.580309 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-conductor-config-data\"" Mar 16 15:56:48 crc kubenswrapper[5120]: I0316 15:56:48.580613 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-nova-dockercfg-t6s4k\"" Mar 16 15:56:48 crc kubenswrapper[5120]: I0316 15:56:48.584631 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-conductor-scripts\"" Mar 16 15:56:48 crc kubenswrapper[5120]: I0316 15:56:48.585933 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-fn6fc"] Mar 16 15:56:48 crc kubenswrapper[5120]: I0316 15:56:48.635520 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d8fa3460-7a46-4469-89a7-72bab7d41985-combined-ca-bundle\") pod \"nova-cell0-conductor-db-sync-fn6fc\" (UID: \"d8fa3460-7a46-4469-89a7-72bab7d41985\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-fn6fc" Mar 16 15:56:48 crc kubenswrapper[5120]: I0316 15:56:48.635568 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d8fa3460-7a46-4469-89a7-72bab7d41985-scripts\") pod \"nova-cell0-conductor-db-sync-fn6fc\" (UID: \"d8fa3460-7a46-4469-89a7-72bab7d41985\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-fn6fc" Mar 16 15:56:48 crc kubenswrapper[5120]: I0316 15:56:48.635597 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwvb4\" (UniqueName: \"kubernetes.io/projected/d8fa3460-7a46-4469-89a7-72bab7d41985-kube-api-access-jwvb4\") pod \"nova-cell0-conductor-db-sync-fn6fc\" (UID: \"d8fa3460-7a46-4469-89a7-72bab7d41985\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-fn6fc" Mar 16 15:56:48 crc kubenswrapper[5120]: I0316 15:56:48.636055 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d8fa3460-7a46-4469-89a7-72bab7d41985-config-data\") pod \"nova-cell0-conductor-db-sync-fn6fc\" (UID: \"d8fa3460-7a46-4469-89a7-72bab7d41985\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-fn6fc" Mar 16 15:56:48 crc kubenswrapper[5120]: I0316 15:56:48.675337 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7e05eef7-7c4c-4faa-809a-2fa10da8f360" path="/var/lib/kubelet/pods/7e05eef7-7c4c-4faa-809a-2fa10da8f360/volumes" Mar 16 15:56:48 crc kubenswrapper[5120]: I0316 15:56:48.737457 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d8fa3460-7a46-4469-89a7-72bab7d41985-config-data\") pod \"nova-cell0-conductor-db-sync-fn6fc\" (UID: \"d8fa3460-7a46-4469-89a7-72bab7d41985\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-fn6fc" Mar 16 15:56:48 crc kubenswrapper[5120]: I0316 15:56:48.737593 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d8fa3460-7a46-4469-89a7-72bab7d41985-combined-ca-bundle\") pod \"nova-cell0-conductor-db-sync-fn6fc\" (UID: \"d8fa3460-7a46-4469-89a7-72bab7d41985\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-fn6fc" Mar 16 15:56:48 crc kubenswrapper[5120]: I0316 15:56:48.737620 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d8fa3460-7a46-4469-89a7-72bab7d41985-scripts\") pod \"nova-cell0-conductor-db-sync-fn6fc\" (UID: \"d8fa3460-7a46-4469-89a7-72bab7d41985\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-fn6fc" Mar 16 15:56:48 crc kubenswrapper[5120]: I0316 15:56:48.737647 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jwvb4\" (UniqueName: \"kubernetes.io/projected/d8fa3460-7a46-4469-89a7-72bab7d41985-kube-api-access-jwvb4\") pod \"nova-cell0-conductor-db-sync-fn6fc\" (UID: \"d8fa3460-7a46-4469-89a7-72bab7d41985\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-fn6fc" Mar 16 15:56:48 crc kubenswrapper[5120]: I0316 15:56:48.743934 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d8fa3460-7a46-4469-89a7-72bab7d41985-scripts\") pod \"nova-cell0-conductor-db-sync-fn6fc\" (UID: \"d8fa3460-7a46-4469-89a7-72bab7d41985\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-fn6fc" Mar 16 15:56:48 crc kubenswrapper[5120]: I0316 15:56:48.744075 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d8fa3460-7a46-4469-89a7-72bab7d41985-config-data\") pod \"nova-cell0-conductor-db-sync-fn6fc\" (UID: \"d8fa3460-7a46-4469-89a7-72bab7d41985\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-fn6fc" Mar 16 15:56:48 crc kubenswrapper[5120]: I0316 15:56:48.744085 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d8fa3460-7a46-4469-89a7-72bab7d41985-combined-ca-bundle\") pod \"nova-cell0-conductor-db-sync-fn6fc\" (UID: \"d8fa3460-7a46-4469-89a7-72bab7d41985\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-fn6fc" Mar 16 15:56:48 crc kubenswrapper[5120]: I0316 15:56:48.755857 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwvb4\" (UniqueName: \"kubernetes.io/projected/d8fa3460-7a46-4469-89a7-72bab7d41985-kube-api-access-jwvb4\") pod \"nova-cell0-conductor-db-sync-fn6fc\" (UID: \"d8fa3460-7a46-4469-89a7-72bab7d41985\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-fn6fc" Mar 16 15:56:48 crc kubenswrapper[5120]: I0316 15:56:48.894515 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-fn6fc" Mar 16 15:56:49 crc kubenswrapper[5120]: I0316 15:56:49.414750 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-fn6fc"] Mar 16 15:56:49 crc kubenswrapper[5120]: W0316 15:56:49.423442 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd8fa3460_7a46_4469_89a7_72bab7d41985.slice/crio-ed45c700107379122a59df49e3e09be6b1071fe69e4c5f54ec626b8aef1df8a5 WatchSource:0}: Error finding container ed45c700107379122a59df49e3e09be6b1071fe69e4c5f54ec626b8aef1df8a5: Status 404 returned error can't find the container with id ed45c700107379122a59df49e3e09be6b1071fe69e4c5f54ec626b8aef1df8a5 Mar 16 15:56:50 crc kubenswrapper[5120]: I0316 15:56:50.168522 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-fn6fc" event={"ID":"d8fa3460-7a46-4469-89a7-72bab7d41985","Type":"ContainerStarted","Data":"092e3ad9eea3756ea0ddfff3f4378b198b2672dad35cced2d8adebdf4b5cec40"} Mar 16 15:56:50 crc kubenswrapper[5120]: I0316 15:56:50.168570 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-fn6fc" event={"ID":"d8fa3460-7a46-4469-89a7-72bab7d41985","Type":"ContainerStarted","Data":"ed45c700107379122a59df49e3e09be6b1071fe69e4c5f54ec626b8aef1df8a5"} Mar 16 15:56:50 crc kubenswrapper[5120]: I0316 15:56:50.172799 5120 generic.go:358] "Generic (PLEG): container finished" podID="705910c5-8552-43be-ba28-dfad2b51ce96" containerID="e0012c05149be0f50d1c0f542da8165d28342dd996486c5320e55175341bf64d" exitCode=0 Mar 16 15:56:50 crc kubenswrapper[5120]: I0316 15:56:50.172857 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"705910c5-8552-43be-ba28-dfad2b51ce96","Type":"ContainerDied","Data":"e0012c05149be0f50d1c0f542da8165d28342dd996486c5320e55175341bf64d"} Mar 16 15:56:50 crc kubenswrapper[5120]: I0316 15:56:50.186321 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-fn6fc" podStartSLOduration=2.186308728 podStartE2EDuration="2.186308728s" podCreationTimestamp="2026-03-16 15:56:48 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:56:50.186053711 +0000 UTC m=+1512.339985368" watchObservedRunningTime="2026-03-16 15:56:50.186308728 +0000 UTC m=+1512.340240385" Mar 16 15:56:50 crc kubenswrapper[5120]: I0316 15:56:50.449246 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:56:50 crc kubenswrapper[5120]: I0316 15:56:50.573868 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/705910c5-8552-43be-ba28-dfad2b51ce96-config-data\") pod \"705910c5-8552-43be-ba28-dfad2b51ce96\" (UID: \"705910c5-8552-43be-ba28-dfad2b51ce96\") " Mar 16 15:56:50 crc kubenswrapper[5120]: I0316 15:56:50.573947 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/705910c5-8552-43be-ba28-dfad2b51ce96-internal-tls-certs\") pod \"705910c5-8552-43be-ba28-dfad2b51ce96\" (UID: \"705910c5-8552-43be-ba28-dfad2b51ce96\") " Mar 16 15:56:50 crc kubenswrapper[5120]: I0316 15:56:50.573970 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/705910c5-8552-43be-ba28-dfad2b51ce96-scripts\") pod \"705910c5-8552-43be-ba28-dfad2b51ce96\" (UID: \"705910c5-8552-43be-ba28-dfad2b51ce96\") " Mar 16 15:56:50 crc kubenswrapper[5120]: I0316 15:56:50.573999 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/705910c5-8552-43be-ba28-dfad2b51ce96-combined-ca-bundle\") pod \"705910c5-8552-43be-ba28-dfad2b51ce96\" (UID: \"705910c5-8552-43be-ba28-dfad2b51ce96\") " Mar 16 15:56:50 crc kubenswrapper[5120]: I0316 15:56:50.574096 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"705910c5-8552-43be-ba28-dfad2b51ce96\" (UID: \"705910c5-8552-43be-ba28-dfad2b51ce96\") " Mar 16 15:56:50 crc kubenswrapper[5120]: I0316 15:56:50.574213 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/705910c5-8552-43be-ba28-dfad2b51ce96-logs\") pod \"705910c5-8552-43be-ba28-dfad2b51ce96\" (UID: \"705910c5-8552-43be-ba28-dfad2b51ce96\") " Mar 16 15:56:50 crc kubenswrapper[5120]: I0316 15:56:50.574265 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8w9c4\" (UniqueName: \"kubernetes.io/projected/705910c5-8552-43be-ba28-dfad2b51ce96-kube-api-access-8w9c4\") pod \"705910c5-8552-43be-ba28-dfad2b51ce96\" (UID: \"705910c5-8552-43be-ba28-dfad2b51ce96\") " Mar 16 15:56:50 crc kubenswrapper[5120]: I0316 15:56:50.574356 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/705910c5-8552-43be-ba28-dfad2b51ce96-httpd-run\") pod \"705910c5-8552-43be-ba28-dfad2b51ce96\" (UID: \"705910c5-8552-43be-ba28-dfad2b51ce96\") " Mar 16 15:56:50 crc kubenswrapper[5120]: I0316 15:56:50.575102 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/705910c5-8552-43be-ba28-dfad2b51ce96-logs" (OuterVolumeSpecName: "logs") pod "705910c5-8552-43be-ba28-dfad2b51ce96" (UID: "705910c5-8552-43be-ba28-dfad2b51ce96"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:56:50 crc kubenswrapper[5120]: I0316 15:56:50.575190 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/705910c5-8552-43be-ba28-dfad2b51ce96-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "705910c5-8552-43be-ba28-dfad2b51ce96" (UID: "705910c5-8552-43be-ba28-dfad2b51ce96"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:56:50 crc kubenswrapper[5120]: I0316 15:56:50.580372 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage09-crc" (OuterVolumeSpecName: "glance") pod "705910c5-8552-43be-ba28-dfad2b51ce96" (UID: "705910c5-8552-43be-ba28-dfad2b51ce96"). InnerVolumeSpecName "local-storage09-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 15:56:50 crc kubenswrapper[5120]: I0316 15:56:50.580632 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/705910c5-8552-43be-ba28-dfad2b51ce96-kube-api-access-8w9c4" (OuterVolumeSpecName: "kube-api-access-8w9c4") pod "705910c5-8552-43be-ba28-dfad2b51ce96" (UID: "705910c5-8552-43be-ba28-dfad2b51ce96"). InnerVolumeSpecName "kube-api-access-8w9c4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:56:50 crc kubenswrapper[5120]: I0316 15:56:50.580698 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/705910c5-8552-43be-ba28-dfad2b51ce96-scripts" (OuterVolumeSpecName: "scripts") pod "705910c5-8552-43be-ba28-dfad2b51ce96" (UID: "705910c5-8552-43be-ba28-dfad2b51ce96"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:56:50 crc kubenswrapper[5120]: I0316 15:56:50.617832 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/705910c5-8552-43be-ba28-dfad2b51ce96-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "705910c5-8552-43be-ba28-dfad2b51ce96" (UID: "705910c5-8552-43be-ba28-dfad2b51ce96"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:56:50 crc kubenswrapper[5120]: I0316 15:56:50.622715 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/705910c5-8552-43be-ba28-dfad2b51ce96-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "705910c5-8552-43be-ba28-dfad2b51ce96" (UID: "705910c5-8552-43be-ba28-dfad2b51ce96"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:56:50 crc kubenswrapper[5120]: I0316 15:56:50.639502 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/705910c5-8552-43be-ba28-dfad2b51ce96-config-data" (OuterVolumeSpecName: "config-data") pod "705910c5-8552-43be-ba28-dfad2b51ce96" (UID: "705910c5-8552-43be-ba28-dfad2b51ce96"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:56:50 crc kubenswrapper[5120]: I0316 15:56:50.677217 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/705910c5-8552-43be-ba28-dfad2b51ce96-logs\") on node \"crc\" DevicePath \"\"" Mar 16 15:56:50 crc kubenswrapper[5120]: I0316 15:56:50.677253 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8w9c4\" (UniqueName: \"kubernetes.io/projected/705910c5-8552-43be-ba28-dfad2b51ce96-kube-api-access-8w9c4\") on node \"crc\" DevicePath \"\"" Mar 16 15:56:50 crc kubenswrapper[5120]: I0316 15:56:50.677266 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/705910c5-8552-43be-ba28-dfad2b51ce96-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 15:56:50 crc kubenswrapper[5120]: I0316 15:56:50.677282 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/705910c5-8552-43be-ba28-dfad2b51ce96-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 15:56:50 crc kubenswrapper[5120]: I0316 15:56:50.677294 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/705910c5-8552-43be-ba28-dfad2b51ce96-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 15:56:50 crc kubenswrapper[5120]: I0316 15:56:50.677306 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/705910c5-8552-43be-ba28-dfad2b51ce96-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 15:56:50 crc kubenswrapper[5120]: I0316 15:56:50.677317 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/705910c5-8552-43be-ba28-dfad2b51ce96-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:56:50 crc kubenswrapper[5120]: I0316 15:56:50.677358 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") on node \"crc\" " Mar 16 15:56:50 crc kubenswrapper[5120]: I0316 15:56:50.700326 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage09-crc" (UniqueName: "kubernetes.io/local-volume/local-storage09-crc") on node "crc" Mar 16 15:56:50 crc kubenswrapper[5120]: I0316 15:56:50.782870 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") on node \"crc\" DevicePath \"\"" Mar 16 15:56:51 crc kubenswrapper[5120]: I0316 15:56:51.200485 5120 generic.go:358] "Generic (PLEG): container finished" podID="275fa492-ad6d-44f0-84b3-df33f29e6f89" containerID="b54eaf33ea4461f32cb73207194553cad35e9691fd18f41cfa8a8c1331da9f35" exitCode=0 Mar 16 15:56:51 crc kubenswrapper[5120]: I0316 15:56:51.201022 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"275fa492-ad6d-44f0-84b3-df33f29e6f89","Type":"ContainerDied","Data":"b54eaf33ea4461f32cb73207194553cad35e9691fd18f41cfa8a8c1331da9f35"} Mar 16 15:56:51 crc kubenswrapper[5120]: I0316 15:56:51.206711 5120 generic.go:358] "Generic (PLEG): container finished" podID="93f6640c-a255-4892-abe7-01f211126bb5" containerID="e577d0e4c18228d6b20ba47dd68bc63702e161589d5b28f44a14d98a921df96e" exitCode=0 Mar 16 15:56:51 crc kubenswrapper[5120]: I0316 15:56:51.206917 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"93f6640c-a255-4892-abe7-01f211126bb5","Type":"ContainerDied","Data":"e577d0e4c18228d6b20ba47dd68bc63702e161589d5b28f44a14d98a921df96e"} Mar 16 15:56:51 crc kubenswrapper[5120]: I0316 15:56:51.221808 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:56:51 crc kubenswrapper[5120]: I0316 15:56:51.222624 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"705910c5-8552-43be-ba28-dfad2b51ce96","Type":"ContainerDied","Data":"51a11a548581165982e0bdc2420f6360adb85e3cf92fc65130c9ae69df7a1486"} Mar 16 15:56:51 crc kubenswrapper[5120]: I0316 15:56:51.222669 5120 scope.go:117] "RemoveContainer" containerID="e0012c05149be0f50d1c0f542da8165d28342dd996486c5320e55175341bf64d" Mar 16 15:56:51 crc kubenswrapper[5120]: I0316 15:56:51.254264 5120 scope.go:117] "RemoveContainer" containerID="4ca7ca677a69ff5a268826d7faf5ff870727b33cf022c842abb4a56c8d85e241" Mar 16 15:56:51 crc kubenswrapper[5120]: I0316 15:56:51.317162 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 15:56:51 crc kubenswrapper[5120]: I0316 15:56:51.327878 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 15:56:51 crc kubenswrapper[5120]: I0316 15:56:51.369831 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 15:56:51 crc kubenswrapper[5120]: I0316 15:56:51.370996 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="705910c5-8552-43be-ba28-dfad2b51ce96" containerName="glance-httpd" Mar 16 15:56:51 crc kubenswrapper[5120]: I0316 15:56:51.371085 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="705910c5-8552-43be-ba28-dfad2b51ce96" containerName="glance-httpd" Mar 16 15:56:51 crc kubenswrapper[5120]: I0316 15:56:51.371236 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="705910c5-8552-43be-ba28-dfad2b51ce96" containerName="glance-log" Mar 16 15:56:51 crc kubenswrapper[5120]: I0316 15:56:51.371318 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="705910c5-8552-43be-ba28-dfad2b51ce96" containerName="glance-log" Mar 16 15:56:51 crc kubenswrapper[5120]: I0316 15:56:51.371595 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="705910c5-8552-43be-ba28-dfad2b51ce96" containerName="glance-httpd" Mar 16 15:56:51 crc kubenswrapper[5120]: I0316 15:56:51.371676 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="705910c5-8552-43be-ba28-dfad2b51ce96" containerName="glance-log" Mar 16 15:56:51 crc kubenswrapper[5120]: I0316 15:56:51.424451 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 15:56:51 crc kubenswrapper[5120]: I0316 15:56:51.424562 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:56:51 crc kubenswrapper[5120]: I0316 15:56:51.428397 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-internal-config-data\"" Mar 16 15:56:51 crc kubenswrapper[5120]: I0316 15:56:51.428705 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:56:51 crc kubenswrapper[5120]: I0316 15:56:51.428885 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-internal-svc\"" Mar 16 15:56:51 crc kubenswrapper[5120]: I0316 15:56:51.497249 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l6tqs\" (UniqueName: \"kubernetes.io/projected/275fa492-ad6d-44f0-84b3-df33f29e6f89-kube-api-access-l6tqs\") pod \"275fa492-ad6d-44f0-84b3-df33f29e6f89\" (UID: \"275fa492-ad6d-44f0-84b3-df33f29e6f89\") " Mar 16 15:56:51 crc kubenswrapper[5120]: I0316 15:56:51.497303 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/275fa492-ad6d-44f0-84b3-df33f29e6f89-config-data\") pod \"275fa492-ad6d-44f0-84b3-df33f29e6f89\" (UID: \"275fa492-ad6d-44f0-84b3-df33f29e6f89\") " Mar 16 15:56:51 crc kubenswrapper[5120]: I0316 15:56:51.497445 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/275fa492-ad6d-44f0-84b3-df33f29e6f89-run-httpd\") pod \"275fa492-ad6d-44f0-84b3-df33f29e6f89\" (UID: \"275fa492-ad6d-44f0-84b3-df33f29e6f89\") " Mar 16 15:56:51 crc kubenswrapper[5120]: I0316 15:56:51.497509 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/275fa492-ad6d-44f0-84b3-df33f29e6f89-sg-core-conf-yaml\") pod \"275fa492-ad6d-44f0-84b3-df33f29e6f89\" (UID: \"275fa492-ad6d-44f0-84b3-df33f29e6f89\") " Mar 16 15:56:51 crc kubenswrapper[5120]: I0316 15:56:51.497573 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/275fa492-ad6d-44f0-84b3-df33f29e6f89-combined-ca-bundle\") pod \"275fa492-ad6d-44f0-84b3-df33f29e6f89\" (UID: \"275fa492-ad6d-44f0-84b3-df33f29e6f89\") " Mar 16 15:56:51 crc kubenswrapper[5120]: I0316 15:56:51.497631 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/275fa492-ad6d-44f0-84b3-df33f29e6f89-log-httpd\") pod \"275fa492-ad6d-44f0-84b3-df33f29e6f89\" (UID: \"275fa492-ad6d-44f0-84b3-df33f29e6f89\") " Mar 16 15:56:51 crc kubenswrapper[5120]: I0316 15:56:51.497705 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/275fa492-ad6d-44f0-84b3-df33f29e6f89-scripts\") pod \"275fa492-ad6d-44f0-84b3-df33f29e6f89\" (UID: \"275fa492-ad6d-44f0-84b3-df33f29e6f89\") " Mar 16 15:56:51 crc kubenswrapper[5120]: I0316 15:56:51.497892 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/775fa932-80b8-4fd0-946e-09177e8710fb-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"775fa932-80b8-4fd0-946e-09177e8710fb\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:56:51 crc kubenswrapper[5120]: I0316 15:56:51.497936 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/775fa932-80b8-4fd0-946e-09177e8710fb-scripts\") pod \"glance-default-internal-api-0\" (UID: \"775fa932-80b8-4fd0-946e-09177e8710fb\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:56:51 crc kubenswrapper[5120]: I0316 15:56:51.497958 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/775fa932-80b8-4fd0-946e-09177e8710fb-config-data\") pod \"glance-default-internal-api-0\" (UID: \"775fa932-80b8-4fd0-946e-09177e8710fb\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:56:51 crc kubenswrapper[5120]: I0316 15:56:51.497972 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/775fa932-80b8-4fd0-946e-09177e8710fb-logs\") pod \"glance-default-internal-api-0\" (UID: \"775fa932-80b8-4fd0-946e-09177e8710fb\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:56:51 crc kubenswrapper[5120]: I0316 15:56:51.498034 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/775fa932-80b8-4fd0-946e-09177e8710fb-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"775fa932-80b8-4fd0-946e-09177e8710fb\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:56:51 crc kubenswrapper[5120]: I0316 15:56:51.498058 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/775fa932-80b8-4fd0-946e-09177e8710fb-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"775fa932-80b8-4fd0-946e-09177e8710fb\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:56:51 crc kubenswrapper[5120]: I0316 15:56:51.498097 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v68bq\" (UniqueName: \"kubernetes.io/projected/775fa932-80b8-4fd0-946e-09177e8710fb-kube-api-access-v68bq\") pod \"glance-default-internal-api-0\" (UID: \"775fa932-80b8-4fd0-946e-09177e8710fb\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:56:51 crc kubenswrapper[5120]: I0316 15:56:51.498165 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"glance-default-internal-api-0\" (UID: \"775fa932-80b8-4fd0-946e-09177e8710fb\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:56:51 crc kubenswrapper[5120]: I0316 15:56:51.505952 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/275fa492-ad6d-44f0-84b3-df33f29e6f89-kube-api-access-l6tqs" (OuterVolumeSpecName: "kube-api-access-l6tqs") pod "275fa492-ad6d-44f0-84b3-df33f29e6f89" (UID: "275fa492-ad6d-44f0-84b3-df33f29e6f89"). InnerVolumeSpecName "kube-api-access-l6tqs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:56:51 crc kubenswrapper[5120]: I0316 15:56:51.507235 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/275fa492-ad6d-44f0-84b3-df33f29e6f89-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "275fa492-ad6d-44f0-84b3-df33f29e6f89" (UID: "275fa492-ad6d-44f0-84b3-df33f29e6f89"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:56:51 crc kubenswrapper[5120]: I0316 15:56:51.507502 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/275fa492-ad6d-44f0-84b3-df33f29e6f89-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "275fa492-ad6d-44f0-84b3-df33f29e6f89" (UID: "275fa492-ad6d-44f0-84b3-df33f29e6f89"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:56:51 crc kubenswrapper[5120]: I0316 15:56:51.532927 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/275fa492-ad6d-44f0-84b3-df33f29e6f89-scripts" (OuterVolumeSpecName: "scripts") pod "275fa492-ad6d-44f0-84b3-df33f29e6f89" (UID: "275fa492-ad6d-44f0-84b3-df33f29e6f89"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:56:51 crc kubenswrapper[5120]: I0316 15:56:51.595498 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/275fa492-ad6d-44f0-84b3-df33f29e6f89-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "275fa492-ad6d-44f0-84b3-df33f29e6f89" (UID: "275fa492-ad6d-44f0-84b3-df33f29e6f89"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:56:51 crc kubenswrapper[5120]: I0316 15:56:51.599928 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"glance-default-internal-api-0\" (UID: \"775fa932-80b8-4fd0-946e-09177e8710fb\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:56:51 crc kubenswrapper[5120]: I0316 15:56:51.600079 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/775fa932-80b8-4fd0-946e-09177e8710fb-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"775fa932-80b8-4fd0-946e-09177e8710fb\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:56:51 crc kubenswrapper[5120]: I0316 15:56:51.600126 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/775fa932-80b8-4fd0-946e-09177e8710fb-scripts\") pod \"glance-default-internal-api-0\" (UID: \"775fa932-80b8-4fd0-946e-09177e8710fb\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:56:51 crc kubenswrapper[5120]: I0316 15:56:51.600147 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/775fa932-80b8-4fd0-946e-09177e8710fb-config-data\") pod \"glance-default-internal-api-0\" (UID: \"775fa932-80b8-4fd0-946e-09177e8710fb\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:56:51 crc kubenswrapper[5120]: I0316 15:56:51.600163 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/775fa932-80b8-4fd0-946e-09177e8710fb-logs\") pod \"glance-default-internal-api-0\" (UID: \"775fa932-80b8-4fd0-946e-09177e8710fb\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:56:51 crc kubenswrapper[5120]: I0316 15:56:51.600217 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/775fa932-80b8-4fd0-946e-09177e8710fb-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"775fa932-80b8-4fd0-946e-09177e8710fb\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:56:51 crc kubenswrapper[5120]: I0316 15:56:51.600241 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/775fa932-80b8-4fd0-946e-09177e8710fb-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"775fa932-80b8-4fd0-946e-09177e8710fb\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:56:51 crc kubenswrapper[5120]: I0316 15:56:51.600279 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v68bq\" (UniqueName: \"kubernetes.io/projected/775fa932-80b8-4fd0-946e-09177e8710fb-kube-api-access-v68bq\") pod \"glance-default-internal-api-0\" (UID: \"775fa932-80b8-4fd0-946e-09177e8710fb\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:56:51 crc kubenswrapper[5120]: I0316 15:56:51.600347 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/275fa492-ad6d-44f0-84b3-df33f29e6f89-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 15:56:51 crc kubenswrapper[5120]: I0316 15:56:51.600391 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/275fa492-ad6d-44f0-84b3-df33f29e6f89-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 15:56:51 crc kubenswrapper[5120]: I0316 15:56:51.600402 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l6tqs\" (UniqueName: \"kubernetes.io/projected/275fa492-ad6d-44f0-84b3-df33f29e6f89-kube-api-access-l6tqs\") on node \"crc\" DevicePath \"\"" Mar 16 15:56:51 crc kubenswrapper[5120]: I0316 15:56:51.600412 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/275fa492-ad6d-44f0-84b3-df33f29e6f89-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 15:56:51 crc kubenswrapper[5120]: I0316 15:56:51.600419 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/275fa492-ad6d-44f0-84b3-df33f29e6f89-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 15:56:51 crc kubenswrapper[5120]: I0316 15:56:51.601105 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"glance-default-internal-api-0\" (UID: \"775fa932-80b8-4fd0-946e-09177e8710fb\") device mount path \"/mnt/openstack/pv09\"" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:56:51 crc kubenswrapper[5120]: I0316 15:56:51.610079 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/775fa932-80b8-4fd0-946e-09177e8710fb-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"775fa932-80b8-4fd0-946e-09177e8710fb\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:56:51 crc kubenswrapper[5120]: I0316 15:56:51.610308 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/775fa932-80b8-4fd0-946e-09177e8710fb-logs\") pod \"glance-default-internal-api-0\" (UID: \"775fa932-80b8-4fd0-946e-09177e8710fb\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:56:51 crc kubenswrapper[5120]: I0316 15:56:51.612847 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/775fa932-80b8-4fd0-946e-09177e8710fb-scripts\") pod \"glance-default-internal-api-0\" (UID: \"775fa932-80b8-4fd0-946e-09177e8710fb\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:56:51 crc kubenswrapper[5120]: I0316 15:56:51.617421 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/775fa932-80b8-4fd0-946e-09177e8710fb-config-data\") pod \"glance-default-internal-api-0\" (UID: \"775fa932-80b8-4fd0-946e-09177e8710fb\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:56:51 crc kubenswrapper[5120]: I0316 15:56:51.618513 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/775fa932-80b8-4fd0-946e-09177e8710fb-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"775fa932-80b8-4fd0-946e-09177e8710fb\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:56:51 crc kubenswrapper[5120]: I0316 15:56:51.623901 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v68bq\" (UniqueName: \"kubernetes.io/projected/775fa932-80b8-4fd0-946e-09177e8710fb-kube-api-access-v68bq\") pod \"glance-default-internal-api-0\" (UID: \"775fa932-80b8-4fd0-946e-09177e8710fb\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:56:51 crc kubenswrapper[5120]: I0316 15:56:51.630404 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/775fa932-80b8-4fd0-946e-09177e8710fb-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"775fa932-80b8-4fd0-946e-09177e8710fb\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:56:51 crc kubenswrapper[5120]: I0316 15:56:51.636572 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/275fa492-ad6d-44f0-84b3-df33f29e6f89-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "275fa492-ad6d-44f0-84b3-df33f29e6f89" (UID: "275fa492-ad6d-44f0-84b3-df33f29e6f89"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:56:51 crc kubenswrapper[5120]: I0316 15:56:51.642187 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"glance-default-internal-api-0\" (UID: \"775fa932-80b8-4fd0-946e-09177e8710fb\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:56:51 crc kubenswrapper[5120]: I0316 15:56:51.654497 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/275fa492-ad6d-44f0-84b3-df33f29e6f89-config-data" (OuterVolumeSpecName: "config-data") pod "275fa492-ad6d-44f0-84b3-df33f29e6f89" (UID: "275fa492-ad6d-44f0-84b3-df33f29e6f89"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:56:51 crc kubenswrapper[5120]: I0316 15:56:51.698124 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:56:51 crc kubenswrapper[5120]: I0316 15:56:51.702961 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/275fa492-ad6d-44f0-84b3-df33f29e6f89-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:56:51 crc kubenswrapper[5120]: I0316 15:56:51.702988 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/275fa492-ad6d-44f0-84b3-df33f29e6f89-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 15:56:51 crc kubenswrapper[5120]: I0316 15:56:51.777930 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:56:51 crc kubenswrapper[5120]: I0316 15:56:51.803978 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/93f6640c-a255-4892-abe7-01f211126bb5-combined-ca-bundle\") pod \"93f6640c-a255-4892-abe7-01f211126bb5\" (UID: \"93f6640c-a255-4892-abe7-01f211126bb5\") " Mar 16 15:56:51 crc kubenswrapper[5120]: I0316 15:56:51.804135 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"93f6640c-a255-4892-abe7-01f211126bb5\" (UID: \"93f6640c-a255-4892-abe7-01f211126bb5\") " Mar 16 15:56:51 crc kubenswrapper[5120]: I0316 15:56:51.804244 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bglqw\" (UniqueName: \"kubernetes.io/projected/93f6640c-a255-4892-abe7-01f211126bb5-kube-api-access-bglqw\") pod \"93f6640c-a255-4892-abe7-01f211126bb5\" (UID: \"93f6640c-a255-4892-abe7-01f211126bb5\") " Mar 16 15:56:51 crc kubenswrapper[5120]: I0316 15:56:51.804303 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/93f6640c-a255-4892-abe7-01f211126bb5-httpd-run\") pod \"93f6640c-a255-4892-abe7-01f211126bb5\" (UID: \"93f6640c-a255-4892-abe7-01f211126bb5\") " Mar 16 15:56:51 crc kubenswrapper[5120]: I0316 15:56:51.804343 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/93f6640c-a255-4892-abe7-01f211126bb5-scripts\") pod \"93f6640c-a255-4892-abe7-01f211126bb5\" (UID: \"93f6640c-a255-4892-abe7-01f211126bb5\") " Mar 16 15:56:51 crc kubenswrapper[5120]: I0316 15:56:51.804420 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/93f6640c-a255-4892-abe7-01f211126bb5-public-tls-certs\") pod \"93f6640c-a255-4892-abe7-01f211126bb5\" (UID: \"93f6640c-a255-4892-abe7-01f211126bb5\") " Mar 16 15:56:51 crc kubenswrapper[5120]: I0316 15:56:51.804455 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/93f6640c-a255-4892-abe7-01f211126bb5-config-data\") pod \"93f6640c-a255-4892-abe7-01f211126bb5\" (UID: \"93f6640c-a255-4892-abe7-01f211126bb5\") " Mar 16 15:56:51 crc kubenswrapper[5120]: I0316 15:56:51.804592 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/93f6640c-a255-4892-abe7-01f211126bb5-logs\") pod \"93f6640c-a255-4892-abe7-01f211126bb5\" (UID: \"93f6640c-a255-4892-abe7-01f211126bb5\") " Mar 16 15:56:51 crc kubenswrapper[5120]: I0316 15:56:51.805511 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93f6640c-a255-4892-abe7-01f211126bb5-logs" (OuterVolumeSpecName: "logs") pod "93f6640c-a255-4892-abe7-01f211126bb5" (UID: "93f6640c-a255-4892-abe7-01f211126bb5"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:56:51 crc kubenswrapper[5120]: I0316 15:56:51.807149 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93f6640c-a255-4892-abe7-01f211126bb5-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "93f6640c-a255-4892-abe7-01f211126bb5" (UID: "93f6640c-a255-4892-abe7-01f211126bb5"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:56:51 crc kubenswrapper[5120]: I0316 15:56:51.808464 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage13-crc" (OuterVolumeSpecName: "glance") pod "93f6640c-a255-4892-abe7-01f211126bb5" (UID: "93f6640c-a255-4892-abe7-01f211126bb5"). InnerVolumeSpecName "local-storage13-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 15:56:51 crc kubenswrapper[5120]: I0316 15:56:51.809279 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93f6640c-a255-4892-abe7-01f211126bb5-kube-api-access-bglqw" (OuterVolumeSpecName: "kube-api-access-bglqw") pod "93f6640c-a255-4892-abe7-01f211126bb5" (UID: "93f6640c-a255-4892-abe7-01f211126bb5"). InnerVolumeSpecName "kube-api-access-bglqw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:56:51 crc kubenswrapper[5120]: I0316 15:56:51.811964 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93f6640c-a255-4892-abe7-01f211126bb5-scripts" (OuterVolumeSpecName: "scripts") pod "93f6640c-a255-4892-abe7-01f211126bb5" (UID: "93f6640c-a255-4892-abe7-01f211126bb5"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:56:51 crc kubenswrapper[5120]: I0316 15:56:51.864813 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93f6640c-a255-4892-abe7-01f211126bb5-config-data" (OuterVolumeSpecName: "config-data") pod "93f6640c-a255-4892-abe7-01f211126bb5" (UID: "93f6640c-a255-4892-abe7-01f211126bb5"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:56:51 crc kubenswrapper[5120]: I0316 15:56:51.867047 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93f6640c-a255-4892-abe7-01f211126bb5-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "93f6640c-a255-4892-abe7-01f211126bb5" (UID: "93f6640c-a255-4892-abe7-01f211126bb5"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:56:51 crc kubenswrapper[5120]: I0316 15:56:51.874427 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93f6640c-a255-4892-abe7-01f211126bb5-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "93f6640c-a255-4892-abe7-01f211126bb5" (UID: "93f6640c-a255-4892-abe7-01f211126bb5"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:56:51 crc kubenswrapper[5120]: I0316 15:56:51.907067 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/93f6640c-a255-4892-abe7-01f211126bb5-logs\") on node \"crc\" DevicePath \"\"" Mar 16 15:56:51 crc kubenswrapper[5120]: I0316 15:56:51.907539 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/93f6640c-a255-4892-abe7-01f211126bb5-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:56:51 crc kubenswrapper[5120]: I0316 15:56:51.907636 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") on node \"crc\" " Mar 16 15:56:51 crc kubenswrapper[5120]: I0316 15:56:51.907724 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bglqw\" (UniqueName: \"kubernetes.io/projected/93f6640c-a255-4892-abe7-01f211126bb5-kube-api-access-bglqw\") on node \"crc\" DevicePath \"\"" Mar 16 15:56:51 crc kubenswrapper[5120]: I0316 15:56:51.907816 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/93f6640c-a255-4892-abe7-01f211126bb5-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 15:56:51 crc kubenswrapper[5120]: I0316 15:56:51.907885 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/93f6640c-a255-4892-abe7-01f211126bb5-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 15:56:51 crc kubenswrapper[5120]: I0316 15:56:51.907940 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/93f6640c-a255-4892-abe7-01f211126bb5-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 15:56:51 crc kubenswrapper[5120]: I0316 15:56:51.908108 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/93f6640c-a255-4892-abe7-01f211126bb5-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 15:56:51 crc kubenswrapper[5120]: I0316 15:56:51.930342 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage13-crc" (UniqueName: "kubernetes.io/local-volume/local-storage13-crc") on node "crc" Mar 16 15:56:52 crc kubenswrapper[5120]: I0316 15:56:52.008449 5120 patch_prober.go:28] interesting pod/machine-config-daemon-7bf76 container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 15:56:52 crc kubenswrapper[5120]: I0316 15:56:52.008503 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 15:56:52 crc kubenswrapper[5120]: I0316 15:56:52.009972 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") on node \"crc\" DevicePath \"\"" Mar 16 15:56:52 crc kubenswrapper[5120]: I0316 15:56:52.240221 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"93f6640c-a255-4892-abe7-01f211126bb5","Type":"ContainerDied","Data":"0e62a85ac91ced8b806292e48b6c8298758ca4f217f8171208caa7a0e43e770c"} Mar 16 15:56:52 crc kubenswrapper[5120]: I0316 15:56:52.240266 5120 scope.go:117] "RemoveContainer" containerID="e577d0e4c18228d6b20ba47dd68bc63702e161589d5b28f44a14d98a921df96e" Mar 16 15:56:52 crc kubenswrapper[5120]: I0316 15:56:52.240372 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:56:52 crc kubenswrapper[5120]: W0316 15:56:52.247363 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod775fa932_80b8_4fd0_946e_09177e8710fb.slice/crio-fbc34890657c148f2dab578b2ab7f33a20a315ecf3e8e61be083dc057920287b WatchSource:0}: Error finding container fbc34890657c148f2dab578b2ab7f33a20a315ecf3e8e61be083dc057920287b: Status 404 returned error can't find the container with id fbc34890657c148f2dab578b2ab7f33a20a315ecf3e8e61be083dc057920287b Mar 16 15:56:52 crc kubenswrapper[5120]: I0316 15:56:52.247933 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"275fa492-ad6d-44f0-84b3-df33f29e6f89","Type":"ContainerDied","Data":"526288e5a3538a515b9790e1e55533984f7a0638a1b2ce257a062941ff885e14"} Mar 16 15:56:52 crc kubenswrapper[5120]: I0316 15:56:52.248014 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:56:52 crc kubenswrapper[5120]: I0316 15:56:52.259040 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 15:56:52 crc kubenswrapper[5120]: I0316 15:56:52.299130 5120 scope.go:117] "RemoveContainer" containerID="722ca498832ae2ebfb82e105279c5eb651d13cd50b7baec7f037c4941ec3bed0" Mar 16 15:56:52 crc kubenswrapper[5120]: I0316 15:56:52.314111 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 15:56:52 crc kubenswrapper[5120]: I0316 15:56:52.322067 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 15:56:52 crc kubenswrapper[5120]: I0316 15:56:52.337602 5120 scope.go:117] "RemoveContainer" containerID="fe7850b277d6e9bfcc5472a2f569b474b9f0a929b7e74d4aa8888a96bf55483a" Mar 16 15:56:52 crc kubenswrapper[5120]: I0316 15:56:52.348940 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 15:56:52 crc kubenswrapper[5120]: I0316 15:56:52.380312 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 15:56:52 crc kubenswrapper[5120]: I0316 15:56:52.384318 5120 scope.go:117] "RemoveContainer" containerID="bf3728a22fe7a82bfd6d73f0ccb5a2272f5fe3dacf628ccb2c4dba7a7ba47659" Mar 16 15:56:52 crc kubenswrapper[5120]: I0316 15:56:52.388400 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 15:56:52 crc kubenswrapper[5120]: I0316 15:56:52.389439 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="275fa492-ad6d-44f0-84b3-df33f29e6f89" containerName="proxy-httpd" Mar 16 15:56:52 crc kubenswrapper[5120]: I0316 15:56:52.389456 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="275fa492-ad6d-44f0-84b3-df33f29e6f89" containerName="proxy-httpd" Mar 16 15:56:52 crc kubenswrapper[5120]: I0316 15:56:52.389485 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93f6640c-a255-4892-abe7-01f211126bb5" containerName="glance-log" Mar 16 15:56:52 crc kubenswrapper[5120]: I0316 15:56:52.389490 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="93f6640c-a255-4892-abe7-01f211126bb5" containerName="glance-log" Mar 16 15:56:52 crc kubenswrapper[5120]: I0316 15:56:52.389501 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="275fa492-ad6d-44f0-84b3-df33f29e6f89" containerName="ceilometer-central-agent" Mar 16 15:56:52 crc kubenswrapper[5120]: I0316 15:56:52.389509 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="275fa492-ad6d-44f0-84b3-df33f29e6f89" containerName="ceilometer-central-agent" Mar 16 15:56:52 crc kubenswrapper[5120]: I0316 15:56:52.389519 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93f6640c-a255-4892-abe7-01f211126bb5" containerName="glance-httpd" Mar 16 15:56:52 crc kubenswrapper[5120]: I0316 15:56:52.389524 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="93f6640c-a255-4892-abe7-01f211126bb5" containerName="glance-httpd" Mar 16 15:56:52 crc kubenswrapper[5120]: I0316 15:56:52.389538 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="275fa492-ad6d-44f0-84b3-df33f29e6f89" containerName="ceilometer-notification-agent" Mar 16 15:56:52 crc kubenswrapper[5120]: I0316 15:56:52.389545 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="275fa492-ad6d-44f0-84b3-df33f29e6f89" containerName="ceilometer-notification-agent" Mar 16 15:56:52 crc kubenswrapper[5120]: I0316 15:56:52.389564 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="275fa492-ad6d-44f0-84b3-df33f29e6f89" containerName="sg-core" Mar 16 15:56:52 crc kubenswrapper[5120]: I0316 15:56:52.389573 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="275fa492-ad6d-44f0-84b3-df33f29e6f89" containerName="sg-core" Mar 16 15:56:52 crc kubenswrapper[5120]: I0316 15:56:52.389728 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="93f6640c-a255-4892-abe7-01f211126bb5" containerName="glance-log" Mar 16 15:56:52 crc kubenswrapper[5120]: I0316 15:56:52.389739 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="275fa492-ad6d-44f0-84b3-df33f29e6f89" containerName="ceilometer-notification-agent" Mar 16 15:56:52 crc kubenswrapper[5120]: I0316 15:56:52.389754 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="93f6640c-a255-4892-abe7-01f211126bb5" containerName="glance-httpd" Mar 16 15:56:52 crc kubenswrapper[5120]: I0316 15:56:52.389783 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="275fa492-ad6d-44f0-84b3-df33f29e6f89" containerName="ceilometer-central-agent" Mar 16 15:56:52 crc kubenswrapper[5120]: I0316 15:56:52.389790 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="275fa492-ad6d-44f0-84b3-df33f29e6f89" containerName="sg-core" Mar 16 15:56:52 crc kubenswrapper[5120]: I0316 15:56:52.389801 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="275fa492-ad6d-44f0-84b3-df33f29e6f89" containerName="proxy-httpd" Mar 16 15:56:52 crc kubenswrapper[5120]: I0316 15:56:52.407018 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 15:56:52 crc kubenswrapper[5120]: I0316 15:56:52.407190 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:56:52 crc kubenswrapper[5120]: I0316 15:56:52.408891 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 15:56:52 crc kubenswrapper[5120]: I0316 15:56:52.411530 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 15:56:52 crc kubenswrapper[5120]: I0316 15:56:52.412151 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 15:56:52 crc kubenswrapper[5120]: I0316 15:56:52.415143 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:56:52 crc kubenswrapper[5120]: I0316 15:56:52.419604 5120 scope.go:117] "RemoveContainer" containerID="0cab72c92f66ff73a03dea0af4618eb0e10cfbcf823eb1178abbb8adcbf62b7c" Mar 16 15:56:52 crc kubenswrapper[5120]: I0316 15:56:52.420169 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-public-svc\"" Mar 16 15:56:52 crc kubenswrapper[5120]: I0316 15:56:52.420302 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-external-config-data\"" Mar 16 15:56:52 crc kubenswrapper[5120]: I0316 15:56:52.421388 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 15:56:52 crc kubenswrapper[5120]: I0316 15:56:52.520397 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/200b575d-db8a-4a66-bead-c61f03a7f5e1-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"200b575d-db8a-4a66-bead-c61f03a7f5e1\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:56:52 crc kubenswrapper[5120]: I0316 15:56:52.520459 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a0983bdb-df60-4951-aa31-672444ba7c32-scripts\") pod \"glance-default-external-api-0\" (UID: \"a0983bdb-df60-4951-aa31-672444ba7c32\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:56:52 crc kubenswrapper[5120]: I0316 15:56:52.520567 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a0983bdb-df60-4951-aa31-672444ba7c32-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"a0983bdb-df60-4951-aa31-672444ba7c32\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:56:52 crc kubenswrapper[5120]: I0316 15:56:52.520716 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/200b575d-db8a-4a66-bead-c61f03a7f5e1-scripts\") pod \"ceilometer-0\" (UID: \"200b575d-db8a-4a66-bead-c61f03a7f5e1\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:56:52 crc kubenswrapper[5120]: I0316 15:56:52.521103 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/a0983bdb-df60-4951-aa31-672444ba7c32-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"a0983bdb-df60-4951-aa31-672444ba7c32\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:56:52 crc kubenswrapper[5120]: I0316 15:56:52.521168 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/200b575d-db8a-4a66-bead-c61f03a7f5e1-config-data\") pod \"ceilometer-0\" (UID: \"200b575d-db8a-4a66-bead-c61f03a7f5e1\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:56:52 crc kubenswrapper[5120]: I0316 15:56:52.521748 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9vj8\" (UniqueName: \"kubernetes.io/projected/200b575d-db8a-4a66-bead-c61f03a7f5e1-kube-api-access-r9vj8\") pod \"ceilometer-0\" (UID: \"200b575d-db8a-4a66-bead-c61f03a7f5e1\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:56:52 crc kubenswrapper[5120]: I0316 15:56:52.521849 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/200b575d-db8a-4a66-bead-c61f03a7f5e1-run-httpd\") pod \"ceilometer-0\" (UID: \"200b575d-db8a-4a66-bead-c61f03a7f5e1\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:56:52 crc kubenswrapper[5120]: I0316 15:56:52.521887 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"glance-default-external-api-0\" (UID: \"a0983bdb-df60-4951-aa31-672444ba7c32\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:56:52 crc kubenswrapper[5120]: I0316 15:56:52.522252 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/200b575d-db8a-4a66-bead-c61f03a7f5e1-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"200b575d-db8a-4a66-bead-c61f03a7f5e1\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:56:52 crc kubenswrapper[5120]: I0316 15:56:52.522375 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a0983bdb-df60-4951-aa31-672444ba7c32-config-data\") pod \"glance-default-external-api-0\" (UID: \"a0983bdb-df60-4951-aa31-672444ba7c32\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:56:52 crc kubenswrapper[5120]: I0316 15:56:52.522505 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/a0983bdb-df60-4951-aa31-672444ba7c32-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"a0983bdb-df60-4951-aa31-672444ba7c32\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:56:52 crc kubenswrapper[5120]: I0316 15:56:52.522557 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a0983bdb-df60-4951-aa31-672444ba7c32-logs\") pod \"glance-default-external-api-0\" (UID: \"a0983bdb-df60-4951-aa31-672444ba7c32\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:56:52 crc kubenswrapper[5120]: I0316 15:56:52.522611 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qspwm\" (UniqueName: \"kubernetes.io/projected/a0983bdb-df60-4951-aa31-672444ba7c32-kube-api-access-qspwm\") pod \"glance-default-external-api-0\" (UID: \"a0983bdb-df60-4951-aa31-672444ba7c32\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:56:52 crc kubenswrapper[5120]: I0316 15:56:52.522631 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/200b575d-db8a-4a66-bead-c61f03a7f5e1-log-httpd\") pod \"ceilometer-0\" (UID: \"200b575d-db8a-4a66-bead-c61f03a7f5e1\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:56:52 crc kubenswrapper[5120]: I0316 15:56:52.528097 5120 scope.go:117] "RemoveContainer" containerID="b54eaf33ea4461f32cb73207194553cad35e9691fd18f41cfa8a8c1331da9f35" Mar 16 15:56:52 crc kubenswrapper[5120]: I0316 15:56:52.624894 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/a0983bdb-df60-4951-aa31-672444ba7c32-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"a0983bdb-df60-4951-aa31-672444ba7c32\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:56:52 crc kubenswrapper[5120]: I0316 15:56:52.624952 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/200b575d-db8a-4a66-bead-c61f03a7f5e1-config-data\") pod \"ceilometer-0\" (UID: \"200b575d-db8a-4a66-bead-c61f03a7f5e1\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:56:52 crc kubenswrapper[5120]: I0316 15:56:52.624993 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r9vj8\" (UniqueName: \"kubernetes.io/projected/200b575d-db8a-4a66-bead-c61f03a7f5e1-kube-api-access-r9vj8\") pod \"ceilometer-0\" (UID: \"200b575d-db8a-4a66-bead-c61f03a7f5e1\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:56:52 crc kubenswrapper[5120]: I0316 15:56:52.625035 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/200b575d-db8a-4a66-bead-c61f03a7f5e1-run-httpd\") pod \"ceilometer-0\" (UID: \"200b575d-db8a-4a66-bead-c61f03a7f5e1\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:56:52 crc kubenswrapper[5120]: I0316 15:56:52.625061 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"glance-default-external-api-0\" (UID: \"a0983bdb-df60-4951-aa31-672444ba7c32\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:56:52 crc kubenswrapper[5120]: I0316 15:56:52.625113 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/200b575d-db8a-4a66-bead-c61f03a7f5e1-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"200b575d-db8a-4a66-bead-c61f03a7f5e1\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:56:52 crc kubenswrapper[5120]: I0316 15:56:52.625145 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a0983bdb-df60-4951-aa31-672444ba7c32-config-data\") pod \"glance-default-external-api-0\" (UID: \"a0983bdb-df60-4951-aa31-672444ba7c32\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:56:52 crc kubenswrapper[5120]: I0316 15:56:52.625274 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/a0983bdb-df60-4951-aa31-672444ba7c32-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"a0983bdb-df60-4951-aa31-672444ba7c32\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:56:52 crc kubenswrapper[5120]: I0316 15:56:52.625300 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a0983bdb-df60-4951-aa31-672444ba7c32-logs\") pod \"glance-default-external-api-0\" (UID: \"a0983bdb-df60-4951-aa31-672444ba7c32\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:56:52 crc kubenswrapper[5120]: I0316 15:56:52.625420 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qspwm\" (UniqueName: \"kubernetes.io/projected/a0983bdb-df60-4951-aa31-672444ba7c32-kube-api-access-qspwm\") pod \"glance-default-external-api-0\" (UID: \"a0983bdb-df60-4951-aa31-672444ba7c32\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:56:52 crc kubenswrapper[5120]: I0316 15:56:52.625436 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/200b575d-db8a-4a66-bead-c61f03a7f5e1-log-httpd\") pod \"ceilometer-0\" (UID: \"200b575d-db8a-4a66-bead-c61f03a7f5e1\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:56:52 crc kubenswrapper[5120]: I0316 15:56:52.625574 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/200b575d-db8a-4a66-bead-c61f03a7f5e1-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"200b575d-db8a-4a66-bead-c61f03a7f5e1\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:56:52 crc kubenswrapper[5120]: I0316 15:56:52.625610 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a0983bdb-df60-4951-aa31-672444ba7c32-scripts\") pod \"glance-default-external-api-0\" (UID: \"a0983bdb-df60-4951-aa31-672444ba7c32\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:56:52 crc kubenswrapper[5120]: I0316 15:56:52.625737 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a0983bdb-df60-4951-aa31-672444ba7c32-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"a0983bdb-df60-4951-aa31-672444ba7c32\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:56:52 crc kubenswrapper[5120]: I0316 15:56:52.626408 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/200b575d-db8a-4a66-bead-c61f03a7f5e1-run-httpd\") pod \"ceilometer-0\" (UID: \"200b575d-db8a-4a66-bead-c61f03a7f5e1\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:56:52 crc kubenswrapper[5120]: I0316 15:56:52.626915 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/200b575d-db8a-4a66-bead-c61f03a7f5e1-scripts\") pod \"ceilometer-0\" (UID: \"200b575d-db8a-4a66-bead-c61f03a7f5e1\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:56:52 crc kubenswrapper[5120]: I0316 15:56:52.627223 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"glance-default-external-api-0\" (UID: \"a0983bdb-df60-4951-aa31-672444ba7c32\") device mount path \"/mnt/openstack/pv13\"" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:56:52 crc kubenswrapper[5120]: I0316 15:56:52.627700 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/a0983bdb-df60-4951-aa31-672444ba7c32-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"a0983bdb-df60-4951-aa31-672444ba7c32\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:56:52 crc kubenswrapper[5120]: I0316 15:56:52.628139 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/200b575d-db8a-4a66-bead-c61f03a7f5e1-log-httpd\") pod \"ceilometer-0\" (UID: \"200b575d-db8a-4a66-bead-c61f03a7f5e1\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:56:52 crc kubenswrapper[5120]: I0316 15:56:52.629804 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a0983bdb-df60-4951-aa31-672444ba7c32-logs\") pod \"glance-default-external-api-0\" (UID: \"a0983bdb-df60-4951-aa31-672444ba7c32\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:56:52 crc kubenswrapper[5120]: I0316 15:56:52.639330 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a0983bdb-df60-4951-aa31-672444ba7c32-scripts\") pod \"glance-default-external-api-0\" (UID: \"a0983bdb-df60-4951-aa31-672444ba7c32\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:56:52 crc kubenswrapper[5120]: I0316 15:56:52.639916 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/200b575d-db8a-4a66-bead-c61f03a7f5e1-scripts\") pod \"ceilometer-0\" (UID: \"200b575d-db8a-4a66-bead-c61f03a7f5e1\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:56:52 crc kubenswrapper[5120]: I0316 15:56:52.640375 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/200b575d-db8a-4a66-bead-c61f03a7f5e1-config-data\") pod \"ceilometer-0\" (UID: \"200b575d-db8a-4a66-bead-c61f03a7f5e1\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:56:52 crc kubenswrapper[5120]: I0316 15:56:52.640611 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a0983bdb-df60-4951-aa31-672444ba7c32-config-data\") pod \"glance-default-external-api-0\" (UID: \"a0983bdb-df60-4951-aa31-672444ba7c32\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:56:52 crc kubenswrapper[5120]: I0316 15:56:52.641658 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/200b575d-db8a-4a66-bead-c61f03a7f5e1-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"200b575d-db8a-4a66-bead-c61f03a7f5e1\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:56:52 crc kubenswrapper[5120]: I0316 15:56:52.643181 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/200b575d-db8a-4a66-bead-c61f03a7f5e1-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"200b575d-db8a-4a66-bead-c61f03a7f5e1\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:56:52 crc kubenswrapper[5120]: I0316 15:56:52.644866 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/a0983bdb-df60-4951-aa31-672444ba7c32-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"a0983bdb-df60-4951-aa31-672444ba7c32\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:56:52 crc kubenswrapper[5120]: I0316 15:56:52.646026 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9vj8\" (UniqueName: \"kubernetes.io/projected/200b575d-db8a-4a66-bead-c61f03a7f5e1-kube-api-access-r9vj8\") pod \"ceilometer-0\" (UID: \"200b575d-db8a-4a66-bead-c61f03a7f5e1\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:56:52 crc kubenswrapper[5120]: I0316 15:56:52.647599 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qspwm\" (UniqueName: \"kubernetes.io/projected/a0983bdb-df60-4951-aa31-672444ba7c32-kube-api-access-qspwm\") pod \"glance-default-external-api-0\" (UID: \"a0983bdb-df60-4951-aa31-672444ba7c32\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:56:52 crc kubenswrapper[5120]: I0316 15:56:52.654557 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a0983bdb-df60-4951-aa31-672444ba7c32-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"a0983bdb-df60-4951-aa31-672444ba7c32\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:56:52 crc kubenswrapper[5120]: I0316 15:56:52.671656 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"glance-default-external-api-0\" (UID: \"a0983bdb-df60-4951-aa31-672444ba7c32\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:56:52 crc kubenswrapper[5120]: I0316 15:56:52.682340 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="275fa492-ad6d-44f0-84b3-df33f29e6f89" path="/var/lib/kubelet/pods/275fa492-ad6d-44f0-84b3-df33f29e6f89/volumes" Mar 16 15:56:52 crc kubenswrapper[5120]: I0316 15:56:52.683440 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="705910c5-8552-43be-ba28-dfad2b51ce96" path="/var/lib/kubelet/pods/705910c5-8552-43be-ba28-dfad2b51ce96/volumes" Mar 16 15:56:52 crc kubenswrapper[5120]: I0316 15:56:52.684879 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93f6640c-a255-4892-abe7-01f211126bb5" path="/var/lib/kubelet/pods/93f6640c-a255-4892-abe7-01f211126bb5/volumes" Mar 16 15:56:52 crc kubenswrapper[5120]: I0316 15:56:52.750290 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:56:52 crc kubenswrapper[5120]: I0316 15:56:52.800319 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:56:53 crc kubenswrapper[5120]: I0316 15:56:53.243189 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 15:56:53 crc kubenswrapper[5120]: I0316 15:56:53.266118 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"775fa932-80b8-4fd0-946e-09177e8710fb","Type":"ContainerStarted","Data":"9fdd34ccdb00204aa5ec64c642c353606f327596693b5828c3f17804d8ffd05b"} Mar 16 15:56:53 crc kubenswrapper[5120]: I0316 15:56:53.266165 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"775fa932-80b8-4fd0-946e-09177e8710fb","Type":"ContainerStarted","Data":"fbc34890657c148f2dab578b2ab7f33a20a315ecf3e8e61be083dc057920287b"} Mar 16 15:56:53 crc kubenswrapper[5120]: I0316 15:56:53.318125 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 15:56:54 crc kubenswrapper[5120]: I0316 15:56:54.293717 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"775fa932-80b8-4fd0-946e-09177e8710fb","Type":"ContainerStarted","Data":"0feb858da0d000831a0f51e693005f06d2aba3f94d24c4b4c297b5568998a809"} Mar 16 15:56:54 crc kubenswrapper[5120]: I0316 15:56:54.298485 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"200b575d-db8a-4a66-bead-c61f03a7f5e1","Type":"ContainerStarted","Data":"d4ac6b2d31eb956c6d94e45f69bdb5cb2dd101a9cf997a8c5123dd5c3c9bcbf1"} Mar 16 15:56:54 crc kubenswrapper[5120]: I0316 15:56:54.298523 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"200b575d-db8a-4a66-bead-c61f03a7f5e1","Type":"ContainerStarted","Data":"8414fde693a510947f9d2193c7054a712ec8e127490c14c65a504f98eb512c4c"} Mar 16 15:56:54 crc kubenswrapper[5120]: I0316 15:56:54.301228 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"a0983bdb-df60-4951-aa31-672444ba7c32","Type":"ContainerStarted","Data":"796c0a9981d4c219b1f40e68d8b57bf4e6a3f5d3b026b0a47930e1eea94c43c8"} Mar 16 15:56:54 crc kubenswrapper[5120]: I0316 15:56:54.301277 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"a0983bdb-df60-4951-aa31-672444ba7c32","Type":"ContainerStarted","Data":"19258648c68c745ef2fa7d724b47037106c920d306845d9eea9b83e22c266f1c"} Mar 16 15:56:54 crc kubenswrapper[5120]: I0316 15:56:54.328169 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-internal-api-0" podStartSLOduration=3.328122186 podStartE2EDuration="3.328122186s" podCreationTimestamp="2026-03-16 15:56:51 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:56:54.319443946 +0000 UTC m=+1516.473375593" watchObservedRunningTime="2026-03-16 15:56:54.328122186 +0000 UTC m=+1516.482053843" Mar 16 15:56:55 crc kubenswrapper[5120]: I0316 15:56:55.323000 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"a0983bdb-df60-4951-aa31-672444ba7c32","Type":"ContainerStarted","Data":"36112e54f7c3727e2e552937fcf3b649d839e6ece9f9a4e4e6b969952dbdd56b"} Mar 16 15:56:55 crc kubenswrapper[5120]: I0316 15:56:55.328508 5120 generic.go:358] "Generic (PLEG): container finished" podID="d8fa3460-7a46-4469-89a7-72bab7d41985" containerID="092e3ad9eea3756ea0ddfff3f4378b198b2672dad35cced2d8adebdf4b5cec40" exitCode=0 Mar 16 15:56:55 crc kubenswrapper[5120]: I0316 15:56:55.328617 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-fn6fc" event={"ID":"d8fa3460-7a46-4469-89a7-72bab7d41985","Type":"ContainerDied","Data":"092e3ad9eea3756ea0ddfff3f4378b198b2672dad35cced2d8adebdf4b5cec40"} Mar 16 15:56:55 crc kubenswrapper[5120]: I0316 15:56:55.333287 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"200b575d-db8a-4a66-bead-c61f03a7f5e1","Type":"ContainerStarted","Data":"a84758bbf124bbee1bcc96d2bf6dca1f4a1950f727a927f37c17312586a5de01"} Mar 16 15:56:55 crc kubenswrapper[5120]: I0316 15:56:55.333341 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"200b575d-db8a-4a66-bead-c61f03a7f5e1","Type":"ContainerStarted","Data":"c0655e3b44609d4af42e0e32e678e9b36bf7cabbe006a6254355b1faa53affae"} Mar 16 15:56:55 crc kubenswrapper[5120]: I0316 15:56:55.353152 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-external-api-0" podStartSLOduration=3.353128366 podStartE2EDuration="3.353128366s" podCreationTimestamp="2026-03-16 15:56:52 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:56:55.342047629 +0000 UTC m=+1517.495979286" watchObservedRunningTime="2026-03-16 15:56:55.353128366 +0000 UTC m=+1517.507060033" Mar 16 15:56:55 crc kubenswrapper[5120]: I0316 15:56:55.610340 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/placement-64b5fbbbdb-nrl4p" Mar 16 15:56:56 crc kubenswrapper[5120]: I0316 15:56:56.224755 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 15:56:56 crc kubenswrapper[5120]: I0316 15:56:56.562937 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/placement-64b5fbbbdb-nrl4p" Mar 16 15:56:56 crc kubenswrapper[5120]: I0316 15:56:56.653309 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-65787d59d-nv5lb"] Mar 16 15:56:56 crc kubenswrapper[5120]: I0316 15:56:56.653581 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-65787d59d-nv5lb" podUID="cf58a934-0387-4876-8e01-98f0fde5e197" containerName="placement-log" containerID="cri-o://d305f594b00d5c91584646dcd2aec6322bbd43b2fdd2aa54565d425a2e0a295d" gracePeriod=30 Mar 16 15:56:56 crc kubenswrapper[5120]: I0316 15:56:56.654051 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-65787d59d-nv5lb" podUID="cf58a934-0387-4876-8e01-98f0fde5e197" containerName="placement-api" containerID="cri-o://a59906c4c7095966c179f97d64794e73296b07cdbe357e4b6d8adae7c71a2521" gracePeriod=30 Mar 16 15:56:56 crc kubenswrapper[5120]: I0316 15:56:56.863749 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-fn6fc" Mar 16 15:56:56 crc kubenswrapper[5120]: I0316 15:56:56.933716 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d8fa3460-7a46-4469-89a7-72bab7d41985-combined-ca-bundle\") pod \"d8fa3460-7a46-4469-89a7-72bab7d41985\" (UID: \"d8fa3460-7a46-4469-89a7-72bab7d41985\") " Mar 16 15:56:56 crc kubenswrapper[5120]: I0316 15:56:56.933829 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d8fa3460-7a46-4469-89a7-72bab7d41985-config-data\") pod \"d8fa3460-7a46-4469-89a7-72bab7d41985\" (UID: \"d8fa3460-7a46-4469-89a7-72bab7d41985\") " Mar 16 15:56:56 crc kubenswrapper[5120]: I0316 15:56:56.934053 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jwvb4\" (UniqueName: \"kubernetes.io/projected/d8fa3460-7a46-4469-89a7-72bab7d41985-kube-api-access-jwvb4\") pod \"d8fa3460-7a46-4469-89a7-72bab7d41985\" (UID: \"d8fa3460-7a46-4469-89a7-72bab7d41985\") " Mar 16 15:56:56 crc kubenswrapper[5120]: I0316 15:56:56.934075 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d8fa3460-7a46-4469-89a7-72bab7d41985-scripts\") pod \"d8fa3460-7a46-4469-89a7-72bab7d41985\" (UID: \"d8fa3460-7a46-4469-89a7-72bab7d41985\") " Mar 16 15:56:56 crc kubenswrapper[5120]: I0316 15:56:56.945574 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d8fa3460-7a46-4469-89a7-72bab7d41985-scripts" (OuterVolumeSpecName: "scripts") pod "d8fa3460-7a46-4469-89a7-72bab7d41985" (UID: "d8fa3460-7a46-4469-89a7-72bab7d41985"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:56:56 crc kubenswrapper[5120]: I0316 15:56:56.952694 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8fa3460-7a46-4469-89a7-72bab7d41985-kube-api-access-jwvb4" (OuterVolumeSpecName: "kube-api-access-jwvb4") pod "d8fa3460-7a46-4469-89a7-72bab7d41985" (UID: "d8fa3460-7a46-4469-89a7-72bab7d41985"). InnerVolumeSpecName "kube-api-access-jwvb4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:56:56 crc kubenswrapper[5120]: I0316 15:56:56.971557 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d8fa3460-7a46-4469-89a7-72bab7d41985-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "d8fa3460-7a46-4469-89a7-72bab7d41985" (UID: "d8fa3460-7a46-4469-89a7-72bab7d41985"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:56:56 crc kubenswrapper[5120]: I0316 15:56:56.974853 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d8fa3460-7a46-4469-89a7-72bab7d41985-config-data" (OuterVolumeSpecName: "config-data") pod "d8fa3460-7a46-4469-89a7-72bab7d41985" (UID: "d8fa3460-7a46-4469-89a7-72bab7d41985"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:56:57 crc kubenswrapper[5120]: I0316 15:56:57.035592 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jwvb4\" (UniqueName: \"kubernetes.io/projected/d8fa3460-7a46-4469-89a7-72bab7d41985-kube-api-access-jwvb4\") on node \"crc\" DevicePath \"\"" Mar 16 15:56:57 crc kubenswrapper[5120]: I0316 15:56:57.036008 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d8fa3460-7a46-4469-89a7-72bab7d41985-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 15:56:57 crc kubenswrapper[5120]: I0316 15:56:57.036025 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d8fa3460-7a46-4469-89a7-72bab7d41985-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:56:57 crc kubenswrapper[5120]: I0316 15:56:57.036034 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d8fa3460-7a46-4469-89a7-72bab7d41985-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 15:56:57 crc kubenswrapper[5120]: I0316 15:56:57.354546 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-fn6fc" Mar 16 15:56:57 crc kubenswrapper[5120]: I0316 15:56:57.354551 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-fn6fc" event={"ID":"d8fa3460-7a46-4469-89a7-72bab7d41985","Type":"ContainerDied","Data":"ed45c700107379122a59df49e3e09be6b1071fe69e4c5f54ec626b8aef1df8a5"} Mar 16 15:56:57 crc kubenswrapper[5120]: I0316 15:56:57.354599 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ed45c700107379122a59df49e3e09be6b1071fe69e4c5f54ec626b8aef1df8a5" Mar 16 15:56:57 crc kubenswrapper[5120]: I0316 15:56:57.361072 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"200b575d-db8a-4a66-bead-c61f03a7f5e1","Type":"ContainerStarted","Data":"393466bffa74887e9088d25d6314f8a302bb0fd734ec3a6812473170232467df"} Mar 16 15:56:57 crc kubenswrapper[5120]: I0316 15:56:57.361273 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="200b575d-db8a-4a66-bead-c61f03a7f5e1" containerName="ceilometer-central-agent" containerID="cri-o://d4ac6b2d31eb956c6d94e45f69bdb5cb2dd101a9cf997a8c5123dd5c3c9bcbf1" gracePeriod=30 Mar 16 15:56:57 crc kubenswrapper[5120]: I0316 15:56:57.361553 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:56:57 crc kubenswrapper[5120]: I0316 15:56:57.361582 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="200b575d-db8a-4a66-bead-c61f03a7f5e1" containerName="proxy-httpd" containerID="cri-o://393466bffa74887e9088d25d6314f8a302bb0fd734ec3a6812473170232467df" gracePeriod=30 Mar 16 15:56:57 crc kubenswrapper[5120]: I0316 15:56:57.361639 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="200b575d-db8a-4a66-bead-c61f03a7f5e1" containerName="sg-core" containerID="cri-o://a84758bbf124bbee1bcc96d2bf6dca1f4a1950f727a927f37c17312586a5de01" gracePeriod=30 Mar 16 15:56:57 crc kubenswrapper[5120]: I0316 15:56:57.361673 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="200b575d-db8a-4a66-bead-c61f03a7f5e1" containerName="ceilometer-notification-agent" containerID="cri-o://c0655e3b44609d4af42e0e32e678e9b36bf7cabbe006a6254355b1faa53affae" gracePeriod=30 Mar 16 15:56:57 crc kubenswrapper[5120]: I0316 15:56:57.369241 5120 generic.go:358] "Generic (PLEG): container finished" podID="cf58a934-0387-4876-8e01-98f0fde5e197" containerID="d305f594b00d5c91584646dcd2aec6322bbd43b2fdd2aa54565d425a2e0a295d" exitCode=143 Mar 16 15:56:57 crc kubenswrapper[5120]: I0316 15:56:57.369494 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-65787d59d-nv5lb" event={"ID":"cf58a934-0387-4876-8e01-98f0fde5e197","Type":"ContainerDied","Data":"d305f594b00d5c91584646dcd2aec6322bbd43b2fdd2aa54565d425a2e0a295d"} Mar 16 15:56:57 crc kubenswrapper[5120]: I0316 15:56:57.386505 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=1.5626389939999998 podStartE2EDuration="5.386472284s" podCreationTimestamp="2026-03-16 15:56:52 +0000 UTC" firstStartedPulling="2026-03-16 15:56:53.256372952 +0000 UTC m=+1515.410304619" lastFinishedPulling="2026-03-16 15:56:57.080206262 +0000 UTC m=+1519.234137909" observedRunningTime="2026-03-16 15:56:57.383467711 +0000 UTC m=+1519.537399368" watchObservedRunningTime="2026-03-16 15:56:57.386472284 +0000 UTC m=+1519.540403941" Mar 16 15:56:57 crc kubenswrapper[5120]: I0316 15:56:57.441984 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 15:56:57 crc kubenswrapper[5120]: I0316 15:56:57.443104 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8fa3460-7a46-4469-89a7-72bab7d41985" containerName="nova-cell0-conductor-db-sync" Mar 16 15:56:57 crc kubenswrapper[5120]: I0316 15:56:57.443122 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8fa3460-7a46-4469-89a7-72bab7d41985" containerName="nova-cell0-conductor-db-sync" Mar 16 15:56:57 crc kubenswrapper[5120]: I0316 15:56:57.443334 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="d8fa3460-7a46-4469-89a7-72bab7d41985" containerName="nova-cell0-conductor-db-sync" Mar 16 15:56:57 crc kubenswrapper[5120]: I0316 15:56:57.447861 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 15:56:57 crc kubenswrapper[5120]: I0316 15:56:57.449198 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 15:56:57 crc kubenswrapper[5120]: I0316 15:56:57.449889 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-nova-dockercfg-t6s4k\"" Mar 16 15:56:57 crc kubenswrapper[5120]: I0316 15:56:57.462488 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-conductor-config-data\"" Mar 16 15:56:57 crc kubenswrapper[5120]: I0316 15:56:57.546373 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0f319a8d-7b93-4aaf-8fb2-73f3536a3986-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"0f319a8d-7b93-4aaf-8fb2-73f3536a3986\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 15:56:57 crc kubenswrapper[5120]: I0316 15:56:57.546439 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fg228\" (UniqueName: \"kubernetes.io/projected/0f319a8d-7b93-4aaf-8fb2-73f3536a3986-kube-api-access-fg228\") pod \"nova-cell0-conductor-0\" (UID: \"0f319a8d-7b93-4aaf-8fb2-73f3536a3986\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 15:56:57 crc kubenswrapper[5120]: I0316 15:56:57.546576 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0f319a8d-7b93-4aaf-8fb2-73f3536a3986-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"0f319a8d-7b93-4aaf-8fb2-73f3536a3986\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 15:56:57 crc kubenswrapper[5120]: I0316 15:56:57.581637 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 15:56:57 crc kubenswrapper[5120]: E0316 15:56:57.582356 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[combined-ca-bundle config-data kube-api-access-fg228], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="0f319a8d-7b93-4aaf-8fb2-73f3536a3986" Mar 16 15:56:57 crc kubenswrapper[5120]: I0316 15:56:57.648320 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fg228\" (UniqueName: \"kubernetes.io/projected/0f319a8d-7b93-4aaf-8fb2-73f3536a3986-kube-api-access-fg228\") pod \"nova-cell0-conductor-0\" (UID: \"0f319a8d-7b93-4aaf-8fb2-73f3536a3986\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 15:56:57 crc kubenswrapper[5120]: I0316 15:56:57.648504 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0f319a8d-7b93-4aaf-8fb2-73f3536a3986-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"0f319a8d-7b93-4aaf-8fb2-73f3536a3986\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 15:56:57 crc kubenswrapper[5120]: I0316 15:56:57.648562 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0f319a8d-7b93-4aaf-8fb2-73f3536a3986-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"0f319a8d-7b93-4aaf-8fb2-73f3536a3986\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 15:56:57 crc kubenswrapper[5120]: I0316 15:56:57.653965 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0f319a8d-7b93-4aaf-8fb2-73f3536a3986-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"0f319a8d-7b93-4aaf-8fb2-73f3536a3986\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 15:56:57 crc kubenswrapper[5120]: I0316 15:56:57.657728 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0f319a8d-7b93-4aaf-8fb2-73f3536a3986-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"0f319a8d-7b93-4aaf-8fb2-73f3536a3986\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 15:56:57 crc kubenswrapper[5120]: I0316 15:56:57.671186 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fg228\" (UniqueName: \"kubernetes.io/projected/0f319a8d-7b93-4aaf-8fb2-73f3536a3986-kube-api-access-fg228\") pod \"nova-cell0-conductor-0\" (UID: \"0f319a8d-7b93-4aaf-8fb2-73f3536a3986\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 15:56:58 crc kubenswrapper[5120]: I0316 15:56:58.385538 5120 generic.go:358] "Generic (PLEG): container finished" podID="200b575d-db8a-4a66-bead-c61f03a7f5e1" containerID="393466bffa74887e9088d25d6314f8a302bb0fd734ec3a6812473170232467df" exitCode=0 Mar 16 15:56:58 crc kubenswrapper[5120]: I0316 15:56:58.385568 5120 generic.go:358] "Generic (PLEG): container finished" podID="200b575d-db8a-4a66-bead-c61f03a7f5e1" containerID="a84758bbf124bbee1bcc96d2bf6dca1f4a1950f727a927f37c17312586a5de01" exitCode=2 Mar 16 15:56:58 crc kubenswrapper[5120]: I0316 15:56:58.385575 5120 generic.go:358] "Generic (PLEG): container finished" podID="200b575d-db8a-4a66-bead-c61f03a7f5e1" containerID="c0655e3b44609d4af42e0e32e678e9b36bf7cabbe006a6254355b1faa53affae" exitCode=0 Mar 16 15:56:58 crc kubenswrapper[5120]: I0316 15:56:58.386040 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 15:56:58 crc kubenswrapper[5120]: I0316 15:56:58.386628 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"200b575d-db8a-4a66-bead-c61f03a7f5e1","Type":"ContainerDied","Data":"393466bffa74887e9088d25d6314f8a302bb0fd734ec3a6812473170232467df"} Mar 16 15:56:58 crc kubenswrapper[5120]: I0316 15:56:58.386656 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"200b575d-db8a-4a66-bead-c61f03a7f5e1","Type":"ContainerDied","Data":"a84758bbf124bbee1bcc96d2bf6dca1f4a1950f727a927f37c17312586a5de01"} Mar 16 15:56:58 crc kubenswrapper[5120]: I0316 15:56:58.386668 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"200b575d-db8a-4a66-bead-c61f03a7f5e1","Type":"ContainerDied","Data":"c0655e3b44609d4af42e0e32e678e9b36bf7cabbe006a6254355b1faa53affae"} Mar 16 15:56:58 crc kubenswrapper[5120]: I0316 15:56:58.397522 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 15:56:58 crc kubenswrapper[5120]: I0316 15:56:58.465963 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0f319a8d-7b93-4aaf-8fb2-73f3536a3986-combined-ca-bundle\") pod \"0f319a8d-7b93-4aaf-8fb2-73f3536a3986\" (UID: \"0f319a8d-7b93-4aaf-8fb2-73f3536a3986\") " Mar 16 15:56:58 crc kubenswrapper[5120]: I0316 15:56:58.466263 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0f319a8d-7b93-4aaf-8fb2-73f3536a3986-config-data\") pod \"0f319a8d-7b93-4aaf-8fb2-73f3536a3986\" (UID: \"0f319a8d-7b93-4aaf-8fb2-73f3536a3986\") " Mar 16 15:56:58 crc kubenswrapper[5120]: I0316 15:56:58.466418 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fg228\" (UniqueName: \"kubernetes.io/projected/0f319a8d-7b93-4aaf-8fb2-73f3536a3986-kube-api-access-fg228\") pod \"0f319a8d-7b93-4aaf-8fb2-73f3536a3986\" (UID: \"0f319a8d-7b93-4aaf-8fb2-73f3536a3986\") " Mar 16 15:56:58 crc kubenswrapper[5120]: I0316 15:56:58.472579 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0f319a8d-7b93-4aaf-8fb2-73f3536a3986-config-data" (OuterVolumeSpecName: "config-data") pod "0f319a8d-7b93-4aaf-8fb2-73f3536a3986" (UID: "0f319a8d-7b93-4aaf-8fb2-73f3536a3986"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:56:58 crc kubenswrapper[5120]: I0316 15:56:58.475620 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0f319a8d-7b93-4aaf-8fb2-73f3536a3986-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "0f319a8d-7b93-4aaf-8fb2-73f3536a3986" (UID: "0f319a8d-7b93-4aaf-8fb2-73f3536a3986"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:56:58 crc kubenswrapper[5120]: I0316 15:56:58.476931 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f319a8d-7b93-4aaf-8fb2-73f3536a3986-kube-api-access-fg228" (OuterVolumeSpecName: "kube-api-access-fg228") pod "0f319a8d-7b93-4aaf-8fb2-73f3536a3986" (UID: "0f319a8d-7b93-4aaf-8fb2-73f3536a3986"). InnerVolumeSpecName "kube-api-access-fg228". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:56:58 crc kubenswrapper[5120]: I0316 15:56:58.569999 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0f319a8d-7b93-4aaf-8fb2-73f3536a3986-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 15:56:58 crc kubenswrapper[5120]: I0316 15:56:58.570057 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fg228\" (UniqueName: \"kubernetes.io/projected/0f319a8d-7b93-4aaf-8fb2-73f3536a3986-kube-api-access-fg228\") on node \"crc\" DevicePath \"\"" Mar 16 15:56:58 crc kubenswrapper[5120]: I0316 15:56:58.570079 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0f319a8d-7b93-4aaf-8fb2-73f3536a3986-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:56:59 crc kubenswrapper[5120]: I0316 15:56:59.393433 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 15:56:59 crc kubenswrapper[5120]: I0316 15:56:59.455528 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 15:56:59 crc kubenswrapper[5120]: I0316 15:56:59.469025 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 15:56:59 crc kubenswrapper[5120]: I0316 15:56:59.476187 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 15:56:59 crc kubenswrapper[5120]: I0316 15:56:59.488795 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 15:56:59 crc kubenswrapper[5120]: I0316 15:56:59.492086 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-conductor-config-data\"" Mar 16 15:56:59 crc kubenswrapper[5120]: I0316 15:56:59.492190 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-nova-dockercfg-t6s4k\"" Mar 16 15:56:59 crc kubenswrapper[5120]: I0316 15:56:59.497890 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 15:56:59 crc kubenswrapper[5120]: I0316 15:56:59.592068 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1bb69667-1646-4d0c-91dd-dbd582031774-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"1bb69667-1646-4d0c-91dd-dbd582031774\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 15:56:59 crc kubenswrapper[5120]: I0316 15:56:59.592740 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1bb69667-1646-4d0c-91dd-dbd582031774-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"1bb69667-1646-4d0c-91dd-dbd582031774\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 15:56:59 crc kubenswrapper[5120]: I0316 15:56:59.593023 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxvr6\" (UniqueName: \"kubernetes.io/projected/1bb69667-1646-4d0c-91dd-dbd582031774-kube-api-access-kxvr6\") pod \"nova-cell0-conductor-0\" (UID: \"1bb69667-1646-4d0c-91dd-dbd582031774\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 15:56:59 crc kubenswrapper[5120]: I0316 15:56:59.695632 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1bb69667-1646-4d0c-91dd-dbd582031774-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"1bb69667-1646-4d0c-91dd-dbd582031774\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 15:56:59 crc kubenswrapper[5120]: I0316 15:56:59.695755 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kxvr6\" (UniqueName: \"kubernetes.io/projected/1bb69667-1646-4d0c-91dd-dbd582031774-kube-api-access-kxvr6\") pod \"nova-cell0-conductor-0\" (UID: \"1bb69667-1646-4d0c-91dd-dbd582031774\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 15:56:59 crc kubenswrapper[5120]: I0316 15:56:59.695965 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1bb69667-1646-4d0c-91dd-dbd582031774-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"1bb69667-1646-4d0c-91dd-dbd582031774\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 15:56:59 crc kubenswrapper[5120]: I0316 15:56:59.704737 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1bb69667-1646-4d0c-91dd-dbd582031774-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"1bb69667-1646-4d0c-91dd-dbd582031774\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 15:56:59 crc kubenswrapper[5120]: I0316 15:56:59.713423 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1bb69667-1646-4d0c-91dd-dbd582031774-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"1bb69667-1646-4d0c-91dd-dbd582031774\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 15:56:59 crc kubenswrapper[5120]: I0316 15:56:59.721501 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxvr6\" (UniqueName: \"kubernetes.io/projected/1bb69667-1646-4d0c-91dd-dbd582031774-kube-api-access-kxvr6\") pod \"nova-cell0-conductor-0\" (UID: \"1bb69667-1646-4d0c-91dd-dbd582031774\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 15:56:59 crc kubenswrapper[5120]: I0316 15:56:59.814168 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 15:57:00 crc kubenswrapper[5120]: I0316 15:57:00.298860 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-65787d59d-nv5lb" Mar 16 15:57:00 crc kubenswrapper[5120]: I0316 15:57:00.410605 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cf58a934-0387-4876-8e01-98f0fde5e197-combined-ca-bundle\") pod \"cf58a934-0387-4876-8e01-98f0fde5e197\" (UID: \"cf58a934-0387-4876-8e01-98f0fde5e197\") " Mar 16 15:57:00 crc kubenswrapper[5120]: I0316 15:57:00.410925 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/cf58a934-0387-4876-8e01-98f0fde5e197-scripts\") pod \"cf58a934-0387-4876-8e01-98f0fde5e197\" (UID: \"cf58a934-0387-4876-8e01-98f0fde5e197\") " Mar 16 15:57:00 crc kubenswrapper[5120]: I0316 15:57:00.411065 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/cf58a934-0387-4876-8e01-98f0fde5e197-logs\") pod \"cf58a934-0387-4876-8e01-98f0fde5e197\" (UID: \"cf58a934-0387-4876-8e01-98f0fde5e197\") " Mar 16 15:57:00 crc kubenswrapper[5120]: I0316 15:57:00.411184 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/cf58a934-0387-4876-8e01-98f0fde5e197-public-tls-certs\") pod \"cf58a934-0387-4876-8e01-98f0fde5e197\" (UID: \"cf58a934-0387-4876-8e01-98f0fde5e197\") " Mar 16 15:57:00 crc kubenswrapper[5120]: I0316 15:57:00.411225 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cx5w6\" (UniqueName: \"kubernetes.io/projected/cf58a934-0387-4876-8e01-98f0fde5e197-kube-api-access-cx5w6\") pod \"cf58a934-0387-4876-8e01-98f0fde5e197\" (UID: \"cf58a934-0387-4876-8e01-98f0fde5e197\") " Mar 16 15:57:00 crc kubenswrapper[5120]: I0316 15:57:00.411251 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/cf58a934-0387-4876-8e01-98f0fde5e197-internal-tls-certs\") pod \"cf58a934-0387-4876-8e01-98f0fde5e197\" (UID: \"cf58a934-0387-4876-8e01-98f0fde5e197\") " Mar 16 15:57:00 crc kubenswrapper[5120]: I0316 15:57:00.411275 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cf58a934-0387-4876-8e01-98f0fde5e197-config-data\") pod \"cf58a934-0387-4876-8e01-98f0fde5e197\" (UID: \"cf58a934-0387-4876-8e01-98f0fde5e197\") " Mar 16 15:57:00 crc kubenswrapper[5120]: I0316 15:57:00.412064 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 15:57:00 crc kubenswrapper[5120]: I0316 15:57:00.413026 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf58a934-0387-4876-8e01-98f0fde5e197-logs" (OuterVolumeSpecName: "logs") pod "cf58a934-0387-4876-8e01-98f0fde5e197" (UID: "cf58a934-0387-4876-8e01-98f0fde5e197"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:57:00 crc kubenswrapper[5120]: I0316 15:57:00.416951 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf58a934-0387-4876-8e01-98f0fde5e197-kube-api-access-cx5w6" (OuterVolumeSpecName: "kube-api-access-cx5w6") pod "cf58a934-0387-4876-8e01-98f0fde5e197" (UID: "cf58a934-0387-4876-8e01-98f0fde5e197"). InnerVolumeSpecName "kube-api-access-cx5w6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:57:00 crc kubenswrapper[5120]: I0316 15:57:00.419937 5120 generic.go:358] "Generic (PLEG): container finished" podID="200b575d-db8a-4a66-bead-c61f03a7f5e1" containerID="d4ac6b2d31eb956c6d94e45f69bdb5cb2dd101a9cf997a8c5123dd5c3c9bcbf1" exitCode=0 Mar 16 15:57:00 crc kubenswrapper[5120]: I0316 15:57:00.420103 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"200b575d-db8a-4a66-bead-c61f03a7f5e1","Type":"ContainerDied","Data":"d4ac6b2d31eb956c6d94e45f69bdb5cb2dd101a9cf997a8c5123dd5c3c9bcbf1"} Mar 16 15:57:00 crc kubenswrapper[5120]: I0316 15:57:00.422359 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf58a934-0387-4876-8e01-98f0fde5e197-scripts" (OuterVolumeSpecName: "scripts") pod "cf58a934-0387-4876-8e01-98f0fde5e197" (UID: "cf58a934-0387-4876-8e01-98f0fde5e197"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:57:00 crc kubenswrapper[5120]: I0316 15:57:00.430596 5120 generic.go:358] "Generic (PLEG): container finished" podID="cf58a934-0387-4876-8e01-98f0fde5e197" containerID="a59906c4c7095966c179f97d64794e73296b07cdbe357e4b6d8adae7c71a2521" exitCode=0 Mar 16 15:57:00 crc kubenswrapper[5120]: I0316 15:57:00.430802 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-65787d59d-nv5lb" event={"ID":"cf58a934-0387-4876-8e01-98f0fde5e197","Type":"ContainerDied","Data":"a59906c4c7095966c179f97d64794e73296b07cdbe357e4b6d8adae7c71a2521"} Mar 16 15:57:00 crc kubenswrapper[5120]: I0316 15:57:00.430873 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-65787d59d-nv5lb" event={"ID":"cf58a934-0387-4876-8e01-98f0fde5e197","Type":"ContainerDied","Data":"1c59ff0f33a11d9cc4211216e3c3cb3c3660aee72336e61c182a2e98953976d1"} Mar 16 15:57:00 crc kubenswrapper[5120]: I0316 15:57:00.430896 5120 scope.go:117] "RemoveContainer" containerID="a59906c4c7095966c179f97d64794e73296b07cdbe357e4b6d8adae7c71a2521" Mar 16 15:57:00 crc kubenswrapper[5120]: I0316 15:57:00.430906 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-65787d59d-nv5lb" Mar 16 15:57:00 crc kubenswrapper[5120]: I0316 15:57:00.459728 5120 scope.go:117] "RemoveContainer" containerID="d305f594b00d5c91584646dcd2aec6322bbd43b2fdd2aa54565d425a2e0a295d" Mar 16 15:57:00 crc kubenswrapper[5120]: I0316 15:57:00.481588 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf58a934-0387-4876-8e01-98f0fde5e197-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "cf58a934-0387-4876-8e01-98f0fde5e197" (UID: "cf58a934-0387-4876-8e01-98f0fde5e197"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:57:00 crc kubenswrapper[5120]: I0316 15:57:00.491878 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf58a934-0387-4876-8e01-98f0fde5e197-config-data" (OuterVolumeSpecName: "config-data") pod "cf58a934-0387-4876-8e01-98f0fde5e197" (UID: "cf58a934-0387-4876-8e01-98f0fde5e197"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:57:00 crc kubenswrapper[5120]: I0316 15:57:00.505507 5120 scope.go:117] "RemoveContainer" containerID="a59906c4c7095966c179f97d64794e73296b07cdbe357e4b6d8adae7c71a2521" Mar 16 15:57:00 crc kubenswrapper[5120]: E0316 15:57:00.506108 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a59906c4c7095966c179f97d64794e73296b07cdbe357e4b6d8adae7c71a2521\": container with ID starting with a59906c4c7095966c179f97d64794e73296b07cdbe357e4b6d8adae7c71a2521 not found: ID does not exist" containerID="a59906c4c7095966c179f97d64794e73296b07cdbe357e4b6d8adae7c71a2521" Mar 16 15:57:00 crc kubenswrapper[5120]: I0316 15:57:00.506139 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a59906c4c7095966c179f97d64794e73296b07cdbe357e4b6d8adae7c71a2521"} err="failed to get container status \"a59906c4c7095966c179f97d64794e73296b07cdbe357e4b6d8adae7c71a2521\": rpc error: code = NotFound desc = could not find container \"a59906c4c7095966c179f97d64794e73296b07cdbe357e4b6d8adae7c71a2521\": container with ID starting with a59906c4c7095966c179f97d64794e73296b07cdbe357e4b6d8adae7c71a2521 not found: ID does not exist" Mar 16 15:57:00 crc kubenswrapper[5120]: I0316 15:57:00.506160 5120 scope.go:117] "RemoveContainer" containerID="d305f594b00d5c91584646dcd2aec6322bbd43b2fdd2aa54565d425a2e0a295d" Mar 16 15:57:00 crc kubenswrapper[5120]: E0316 15:57:00.506521 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d305f594b00d5c91584646dcd2aec6322bbd43b2fdd2aa54565d425a2e0a295d\": container with ID starting with d305f594b00d5c91584646dcd2aec6322bbd43b2fdd2aa54565d425a2e0a295d not found: ID does not exist" containerID="d305f594b00d5c91584646dcd2aec6322bbd43b2fdd2aa54565d425a2e0a295d" Mar 16 15:57:00 crc kubenswrapper[5120]: I0316 15:57:00.506591 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d305f594b00d5c91584646dcd2aec6322bbd43b2fdd2aa54565d425a2e0a295d"} err="failed to get container status \"d305f594b00d5c91584646dcd2aec6322bbd43b2fdd2aa54565d425a2e0a295d\": rpc error: code = NotFound desc = could not find container \"d305f594b00d5c91584646dcd2aec6322bbd43b2fdd2aa54565d425a2e0a295d\": container with ID starting with d305f594b00d5c91584646dcd2aec6322bbd43b2fdd2aa54565d425a2e0a295d not found: ID does not exist" Mar 16 15:57:00 crc kubenswrapper[5120]: I0316 15:57:00.513158 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cf58a934-0387-4876-8e01-98f0fde5e197-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 15:57:00 crc kubenswrapper[5120]: I0316 15:57:00.513185 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cf58a934-0387-4876-8e01-98f0fde5e197-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:57:00 crc kubenswrapper[5120]: I0316 15:57:00.513199 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/cf58a934-0387-4876-8e01-98f0fde5e197-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 15:57:00 crc kubenswrapper[5120]: I0316 15:57:00.513209 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/cf58a934-0387-4876-8e01-98f0fde5e197-logs\") on node \"crc\" DevicePath \"\"" Mar 16 15:57:00 crc kubenswrapper[5120]: I0316 15:57:00.513217 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cx5w6\" (UniqueName: \"kubernetes.io/projected/cf58a934-0387-4876-8e01-98f0fde5e197-kube-api-access-cx5w6\") on node \"crc\" DevicePath \"\"" Mar 16 15:57:00 crc kubenswrapper[5120]: I0316 15:57:00.533399 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf58a934-0387-4876-8e01-98f0fde5e197-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "cf58a934-0387-4876-8e01-98f0fde5e197" (UID: "cf58a934-0387-4876-8e01-98f0fde5e197"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:57:00 crc kubenswrapper[5120]: I0316 15:57:00.535079 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf58a934-0387-4876-8e01-98f0fde5e197-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "cf58a934-0387-4876-8e01-98f0fde5e197" (UID: "cf58a934-0387-4876-8e01-98f0fde5e197"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:57:00 crc kubenswrapper[5120]: I0316 15:57:00.615373 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/cf58a934-0387-4876-8e01-98f0fde5e197-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 15:57:00 crc kubenswrapper[5120]: I0316 15:57:00.615414 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/cf58a934-0387-4876-8e01-98f0fde5e197-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 15:57:00 crc kubenswrapper[5120]: I0316 15:57:00.675248 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0f319a8d-7b93-4aaf-8fb2-73f3536a3986" path="/var/lib/kubelet/pods/0f319a8d-7b93-4aaf-8fb2-73f3536a3986/volumes" Mar 16 15:57:00 crc kubenswrapper[5120]: I0316 15:57:00.693646 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:57:00 crc kubenswrapper[5120]: I0316 15:57:00.788714 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-65787d59d-nv5lb"] Mar 16 15:57:00 crc kubenswrapper[5120]: I0316 15:57:00.799915 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-65787d59d-nv5lb"] Mar 16 15:57:00 crc kubenswrapper[5120]: I0316 15:57:00.819201 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r9vj8\" (UniqueName: \"kubernetes.io/projected/200b575d-db8a-4a66-bead-c61f03a7f5e1-kube-api-access-r9vj8\") pod \"200b575d-db8a-4a66-bead-c61f03a7f5e1\" (UID: \"200b575d-db8a-4a66-bead-c61f03a7f5e1\") " Mar 16 15:57:00 crc kubenswrapper[5120]: I0316 15:57:00.819253 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/200b575d-db8a-4a66-bead-c61f03a7f5e1-log-httpd\") pod \"200b575d-db8a-4a66-bead-c61f03a7f5e1\" (UID: \"200b575d-db8a-4a66-bead-c61f03a7f5e1\") " Mar 16 15:57:00 crc kubenswrapper[5120]: I0316 15:57:00.819376 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/200b575d-db8a-4a66-bead-c61f03a7f5e1-scripts\") pod \"200b575d-db8a-4a66-bead-c61f03a7f5e1\" (UID: \"200b575d-db8a-4a66-bead-c61f03a7f5e1\") " Mar 16 15:57:00 crc kubenswrapper[5120]: I0316 15:57:00.819422 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/200b575d-db8a-4a66-bead-c61f03a7f5e1-config-data\") pod \"200b575d-db8a-4a66-bead-c61f03a7f5e1\" (UID: \"200b575d-db8a-4a66-bead-c61f03a7f5e1\") " Mar 16 15:57:00 crc kubenswrapper[5120]: I0316 15:57:00.819485 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/200b575d-db8a-4a66-bead-c61f03a7f5e1-combined-ca-bundle\") pod \"200b575d-db8a-4a66-bead-c61f03a7f5e1\" (UID: \"200b575d-db8a-4a66-bead-c61f03a7f5e1\") " Mar 16 15:57:00 crc kubenswrapper[5120]: I0316 15:57:00.819613 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/200b575d-db8a-4a66-bead-c61f03a7f5e1-run-httpd\") pod \"200b575d-db8a-4a66-bead-c61f03a7f5e1\" (UID: \"200b575d-db8a-4a66-bead-c61f03a7f5e1\") " Mar 16 15:57:00 crc kubenswrapper[5120]: I0316 15:57:00.819701 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/200b575d-db8a-4a66-bead-c61f03a7f5e1-sg-core-conf-yaml\") pod \"200b575d-db8a-4a66-bead-c61f03a7f5e1\" (UID: \"200b575d-db8a-4a66-bead-c61f03a7f5e1\") " Mar 16 15:57:00 crc kubenswrapper[5120]: I0316 15:57:00.820656 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/200b575d-db8a-4a66-bead-c61f03a7f5e1-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "200b575d-db8a-4a66-bead-c61f03a7f5e1" (UID: "200b575d-db8a-4a66-bead-c61f03a7f5e1"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:57:00 crc kubenswrapper[5120]: I0316 15:57:00.820730 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/200b575d-db8a-4a66-bead-c61f03a7f5e1-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "200b575d-db8a-4a66-bead-c61f03a7f5e1" (UID: "200b575d-db8a-4a66-bead-c61f03a7f5e1"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:57:00 crc kubenswrapper[5120]: I0316 15:57:00.829019 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/200b575d-db8a-4a66-bead-c61f03a7f5e1-scripts" (OuterVolumeSpecName: "scripts") pod "200b575d-db8a-4a66-bead-c61f03a7f5e1" (UID: "200b575d-db8a-4a66-bead-c61f03a7f5e1"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:57:00 crc kubenswrapper[5120]: I0316 15:57:00.829036 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/200b575d-db8a-4a66-bead-c61f03a7f5e1-kube-api-access-r9vj8" (OuterVolumeSpecName: "kube-api-access-r9vj8") pod "200b575d-db8a-4a66-bead-c61f03a7f5e1" (UID: "200b575d-db8a-4a66-bead-c61f03a7f5e1"). InnerVolumeSpecName "kube-api-access-r9vj8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:57:00 crc kubenswrapper[5120]: I0316 15:57:00.851663 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/200b575d-db8a-4a66-bead-c61f03a7f5e1-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "200b575d-db8a-4a66-bead-c61f03a7f5e1" (UID: "200b575d-db8a-4a66-bead-c61f03a7f5e1"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:57:00 crc kubenswrapper[5120]: I0316 15:57:00.885712 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/200b575d-db8a-4a66-bead-c61f03a7f5e1-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "200b575d-db8a-4a66-bead-c61f03a7f5e1" (UID: "200b575d-db8a-4a66-bead-c61f03a7f5e1"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:57:00 crc kubenswrapper[5120]: I0316 15:57:00.918743 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/200b575d-db8a-4a66-bead-c61f03a7f5e1-config-data" (OuterVolumeSpecName: "config-data") pod "200b575d-db8a-4a66-bead-c61f03a7f5e1" (UID: "200b575d-db8a-4a66-bead-c61f03a7f5e1"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:57:00 crc kubenswrapper[5120]: I0316 15:57:00.921370 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/200b575d-db8a-4a66-bead-c61f03a7f5e1-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 15:57:00 crc kubenswrapper[5120]: I0316 15:57:00.921402 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r9vj8\" (UniqueName: \"kubernetes.io/projected/200b575d-db8a-4a66-bead-c61f03a7f5e1-kube-api-access-r9vj8\") on node \"crc\" DevicePath \"\"" Mar 16 15:57:00 crc kubenswrapper[5120]: I0316 15:57:00.921414 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/200b575d-db8a-4a66-bead-c61f03a7f5e1-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 15:57:00 crc kubenswrapper[5120]: I0316 15:57:00.921422 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/200b575d-db8a-4a66-bead-c61f03a7f5e1-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 15:57:00 crc kubenswrapper[5120]: I0316 15:57:00.921432 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/200b575d-db8a-4a66-bead-c61f03a7f5e1-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 15:57:00 crc kubenswrapper[5120]: I0316 15:57:00.921441 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/200b575d-db8a-4a66-bead-c61f03a7f5e1-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:57:00 crc kubenswrapper[5120]: I0316 15:57:00.921449 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/200b575d-db8a-4a66-bead-c61f03a7f5e1-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 15:57:01 crc kubenswrapper[5120]: I0316 15:57:01.450086 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"200b575d-db8a-4a66-bead-c61f03a7f5e1","Type":"ContainerDied","Data":"8414fde693a510947f9d2193c7054a712ec8e127490c14c65a504f98eb512c4c"} Mar 16 15:57:01 crc kubenswrapper[5120]: I0316 15:57:01.450177 5120 scope.go:117] "RemoveContainer" containerID="393466bffa74887e9088d25d6314f8a302bb0fd734ec3a6812473170232467df" Mar 16 15:57:01 crc kubenswrapper[5120]: I0316 15:57:01.450168 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:57:01 crc kubenswrapper[5120]: I0316 15:57:01.458380 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"1bb69667-1646-4d0c-91dd-dbd582031774","Type":"ContainerStarted","Data":"8d56dff3455e29f82e0859f8794ce8f2b45665ee473c44ad5a45bc744e314e18"} Mar 16 15:57:01 crc kubenswrapper[5120]: I0316 15:57:01.458425 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"1bb69667-1646-4d0c-91dd-dbd582031774","Type":"ContainerStarted","Data":"a38c497933defc4ee712e635296f7b776f74f09d7f8570a1a506088fd3a412f9"} Mar 16 15:57:01 crc kubenswrapper[5120]: I0316 15:57:01.458968 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 15:57:01 crc kubenswrapper[5120]: I0316 15:57:01.487190 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podStartSLOduration=2.487169383 podStartE2EDuration="2.487169383s" podCreationTimestamp="2026-03-16 15:56:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:57:01.482154885 +0000 UTC m=+1523.636086572" watchObservedRunningTime="2026-03-16 15:57:01.487169383 +0000 UTC m=+1523.641101040" Mar 16 15:57:01 crc kubenswrapper[5120]: I0316 15:57:01.489988 5120 scope.go:117] "RemoveContainer" containerID="a84758bbf124bbee1bcc96d2bf6dca1f4a1950f727a927f37c17312586a5de01" Mar 16 15:57:01 crc kubenswrapper[5120]: I0316 15:57:01.513129 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 15:57:01 crc kubenswrapper[5120]: I0316 15:57:01.521373 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 15:57:01 crc kubenswrapper[5120]: I0316 15:57:01.525904 5120 scope.go:117] "RemoveContainer" containerID="c0655e3b44609d4af42e0e32e678e9b36bf7cabbe006a6254355b1faa53affae" Mar 16 15:57:01 crc kubenswrapper[5120]: I0316 15:57:01.547440 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 15:57:01 crc kubenswrapper[5120]: I0316 15:57:01.548793 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf58a934-0387-4876-8e01-98f0fde5e197" containerName="placement-api" Mar 16 15:57:01 crc kubenswrapper[5120]: I0316 15:57:01.548817 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf58a934-0387-4876-8e01-98f0fde5e197" containerName="placement-api" Mar 16 15:57:01 crc kubenswrapper[5120]: I0316 15:57:01.548836 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="200b575d-db8a-4a66-bead-c61f03a7f5e1" containerName="sg-core" Mar 16 15:57:01 crc kubenswrapper[5120]: I0316 15:57:01.548864 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="200b575d-db8a-4a66-bead-c61f03a7f5e1" containerName="sg-core" Mar 16 15:57:01 crc kubenswrapper[5120]: I0316 15:57:01.548879 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="200b575d-db8a-4a66-bead-c61f03a7f5e1" containerName="proxy-httpd" Mar 16 15:57:01 crc kubenswrapper[5120]: I0316 15:57:01.548885 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="200b575d-db8a-4a66-bead-c61f03a7f5e1" containerName="proxy-httpd" Mar 16 15:57:01 crc kubenswrapper[5120]: I0316 15:57:01.548908 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf58a934-0387-4876-8e01-98f0fde5e197" containerName="placement-log" Mar 16 15:57:01 crc kubenswrapper[5120]: I0316 15:57:01.548914 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf58a934-0387-4876-8e01-98f0fde5e197" containerName="placement-log" Mar 16 15:57:01 crc kubenswrapper[5120]: I0316 15:57:01.548953 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="200b575d-db8a-4a66-bead-c61f03a7f5e1" containerName="ceilometer-central-agent" Mar 16 15:57:01 crc kubenswrapper[5120]: I0316 15:57:01.548960 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="200b575d-db8a-4a66-bead-c61f03a7f5e1" containerName="ceilometer-central-agent" Mar 16 15:57:01 crc kubenswrapper[5120]: I0316 15:57:01.548971 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="200b575d-db8a-4a66-bead-c61f03a7f5e1" containerName="ceilometer-notification-agent" Mar 16 15:57:01 crc kubenswrapper[5120]: I0316 15:57:01.548978 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="200b575d-db8a-4a66-bead-c61f03a7f5e1" containerName="ceilometer-notification-agent" Mar 16 15:57:01 crc kubenswrapper[5120]: I0316 15:57:01.549214 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="200b575d-db8a-4a66-bead-c61f03a7f5e1" containerName="proxy-httpd" Mar 16 15:57:01 crc kubenswrapper[5120]: I0316 15:57:01.549232 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="cf58a934-0387-4876-8e01-98f0fde5e197" containerName="placement-log" Mar 16 15:57:01 crc kubenswrapper[5120]: I0316 15:57:01.549242 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="200b575d-db8a-4a66-bead-c61f03a7f5e1" containerName="ceilometer-central-agent" Mar 16 15:57:01 crc kubenswrapper[5120]: I0316 15:57:01.549250 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="cf58a934-0387-4876-8e01-98f0fde5e197" containerName="placement-api" Mar 16 15:57:01 crc kubenswrapper[5120]: I0316 15:57:01.549261 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="200b575d-db8a-4a66-bead-c61f03a7f5e1" containerName="sg-core" Mar 16 15:57:01 crc kubenswrapper[5120]: I0316 15:57:01.549274 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="200b575d-db8a-4a66-bead-c61f03a7f5e1" containerName="ceilometer-notification-agent" Mar 16 15:57:01 crc kubenswrapper[5120]: I0316 15:57:01.561717 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:57:01 crc kubenswrapper[5120]: I0316 15:57:01.566676 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 15:57:01 crc kubenswrapper[5120]: I0316 15:57:01.567088 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 15:57:01 crc kubenswrapper[5120]: I0316 15:57:01.567358 5120 scope.go:117] "RemoveContainer" containerID="d4ac6b2d31eb956c6d94e45f69bdb5cb2dd101a9cf997a8c5123dd5c3c9bcbf1" Mar 16 15:57:01 crc kubenswrapper[5120]: I0316 15:57:01.571844 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 15:57:01 crc kubenswrapper[5120]: I0316 15:57:01.635823 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0a49327a-b187-4793-80dc-d57ce84bb993-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"0a49327a-b187-4793-80dc-d57ce84bb993\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:57:01 crc kubenswrapper[5120]: I0316 15:57:01.635890 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0a49327a-b187-4793-80dc-d57ce84bb993-config-data\") pod \"ceilometer-0\" (UID: \"0a49327a-b187-4793-80dc-d57ce84bb993\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:57:01 crc kubenswrapper[5120]: I0316 15:57:01.635921 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hsj7q\" (UniqueName: \"kubernetes.io/projected/0a49327a-b187-4793-80dc-d57ce84bb993-kube-api-access-hsj7q\") pod \"ceilometer-0\" (UID: \"0a49327a-b187-4793-80dc-d57ce84bb993\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:57:01 crc kubenswrapper[5120]: I0316 15:57:01.635939 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0a49327a-b187-4793-80dc-d57ce84bb993-scripts\") pod \"ceilometer-0\" (UID: \"0a49327a-b187-4793-80dc-d57ce84bb993\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:57:01 crc kubenswrapper[5120]: I0316 15:57:01.636002 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0a49327a-b187-4793-80dc-d57ce84bb993-log-httpd\") pod \"ceilometer-0\" (UID: \"0a49327a-b187-4793-80dc-d57ce84bb993\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:57:01 crc kubenswrapper[5120]: I0316 15:57:01.636021 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/0a49327a-b187-4793-80dc-d57ce84bb993-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"0a49327a-b187-4793-80dc-d57ce84bb993\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:57:01 crc kubenswrapper[5120]: I0316 15:57:01.636050 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0a49327a-b187-4793-80dc-d57ce84bb993-run-httpd\") pod \"ceilometer-0\" (UID: \"0a49327a-b187-4793-80dc-d57ce84bb993\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:57:01 crc kubenswrapper[5120]: I0316 15:57:01.739236 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0a49327a-b187-4793-80dc-d57ce84bb993-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"0a49327a-b187-4793-80dc-d57ce84bb993\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:57:01 crc kubenswrapper[5120]: I0316 15:57:01.739342 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0a49327a-b187-4793-80dc-d57ce84bb993-config-data\") pod \"ceilometer-0\" (UID: \"0a49327a-b187-4793-80dc-d57ce84bb993\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:57:01 crc kubenswrapper[5120]: I0316 15:57:01.739567 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hsj7q\" (UniqueName: \"kubernetes.io/projected/0a49327a-b187-4793-80dc-d57ce84bb993-kube-api-access-hsj7q\") pod \"ceilometer-0\" (UID: \"0a49327a-b187-4793-80dc-d57ce84bb993\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:57:01 crc kubenswrapper[5120]: I0316 15:57:01.739642 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0a49327a-b187-4793-80dc-d57ce84bb993-scripts\") pod \"ceilometer-0\" (UID: \"0a49327a-b187-4793-80dc-d57ce84bb993\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:57:01 crc kubenswrapper[5120]: I0316 15:57:01.740329 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0a49327a-b187-4793-80dc-d57ce84bb993-log-httpd\") pod \"ceilometer-0\" (UID: \"0a49327a-b187-4793-80dc-d57ce84bb993\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:57:01 crc kubenswrapper[5120]: I0316 15:57:01.740392 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/0a49327a-b187-4793-80dc-d57ce84bb993-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"0a49327a-b187-4793-80dc-d57ce84bb993\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:57:01 crc kubenswrapper[5120]: I0316 15:57:01.740510 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0a49327a-b187-4793-80dc-d57ce84bb993-run-httpd\") pod \"ceilometer-0\" (UID: \"0a49327a-b187-4793-80dc-d57ce84bb993\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:57:01 crc kubenswrapper[5120]: I0316 15:57:01.741091 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0a49327a-b187-4793-80dc-d57ce84bb993-log-httpd\") pod \"ceilometer-0\" (UID: \"0a49327a-b187-4793-80dc-d57ce84bb993\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:57:01 crc kubenswrapper[5120]: I0316 15:57:01.741397 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0a49327a-b187-4793-80dc-d57ce84bb993-run-httpd\") pod \"ceilometer-0\" (UID: \"0a49327a-b187-4793-80dc-d57ce84bb993\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:57:01 crc kubenswrapper[5120]: I0316 15:57:01.749078 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0a49327a-b187-4793-80dc-d57ce84bb993-config-data\") pod \"ceilometer-0\" (UID: \"0a49327a-b187-4793-80dc-d57ce84bb993\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:57:01 crc kubenswrapper[5120]: I0316 15:57:01.750318 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0a49327a-b187-4793-80dc-d57ce84bb993-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"0a49327a-b187-4793-80dc-d57ce84bb993\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:57:01 crc kubenswrapper[5120]: I0316 15:57:01.751422 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/0a49327a-b187-4793-80dc-d57ce84bb993-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"0a49327a-b187-4793-80dc-d57ce84bb993\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:57:01 crc kubenswrapper[5120]: I0316 15:57:01.762477 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0a49327a-b187-4793-80dc-d57ce84bb993-scripts\") pod \"ceilometer-0\" (UID: \"0a49327a-b187-4793-80dc-d57ce84bb993\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:57:01 crc kubenswrapper[5120]: I0316 15:57:01.762610 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hsj7q\" (UniqueName: \"kubernetes.io/projected/0a49327a-b187-4793-80dc-d57ce84bb993-kube-api-access-hsj7q\") pod \"ceilometer-0\" (UID: \"0a49327a-b187-4793-80dc-d57ce84bb993\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:57:01 crc kubenswrapper[5120]: I0316 15:57:01.778238 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:57:01 crc kubenswrapper[5120]: I0316 15:57:01.778583 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:57:01 crc kubenswrapper[5120]: I0316 15:57:01.825508 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:57:01 crc kubenswrapper[5120]: I0316 15:57:01.841504 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:57:01 crc kubenswrapper[5120]: I0316 15:57:01.901292 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:57:02 crc kubenswrapper[5120]: W0316 15:57:02.429157 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0a49327a_b187_4793_80dc_d57ce84bb993.slice/crio-c3095e51410c15b78d44968ee5aca7739412be381e08fe5adda48c78104289bc WatchSource:0}: Error finding container c3095e51410c15b78d44968ee5aca7739412be381e08fe5adda48c78104289bc: Status 404 returned error can't find the container with id c3095e51410c15b78d44968ee5aca7739412be381e08fe5adda48c78104289bc Mar 16 15:57:02 crc kubenswrapper[5120]: I0316 15:57:02.433473 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 15:57:02 crc kubenswrapper[5120]: I0316 15:57:02.477813 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"0a49327a-b187-4793-80dc-d57ce84bb993","Type":"ContainerStarted","Data":"c3095e51410c15b78d44968ee5aca7739412be381e08fe5adda48c78104289bc"} Mar 16 15:57:02 crc kubenswrapper[5120]: I0316 15:57:02.478896 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:57:02 crc kubenswrapper[5120]: I0316 15:57:02.478968 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:57:02 crc kubenswrapper[5120]: I0316 15:57:02.692597 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="200b575d-db8a-4a66-bead-c61f03a7f5e1" path="/var/lib/kubelet/pods/200b575d-db8a-4a66-bead-c61f03a7f5e1/volumes" Mar 16 15:57:02 crc kubenswrapper[5120]: I0316 15:57:02.693709 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf58a934-0387-4876-8e01-98f0fde5e197" path="/var/lib/kubelet/pods/cf58a934-0387-4876-8e01-98f0fde5e197/volumes" Mar 16 15:57:02 crc kubenswrapper[5120]: I0316 15:57:02.801186 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:57:02 crc kubenswrapper[5120]: I0316 15:57:02.801326 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:57:02 crc kubenswrapper[5120]: I0316 15:57:02.857792 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:57:02 crc kubenswrapper[5120]: I0316 15:57:02.860594 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:57:03 crc kubenswrapper[5120]: I0316 15:57:03.488964 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:57:03 crc kubenswrapper[5120]: I0316 15:57:03.490496 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:57:04 crc kubenswrapper[5120]: I0316 15:57:04.295737 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:57:04 crc kubenswrapper[5120]: I0316 15:57:04.431358 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 15:57:05 crc kubenswrapper[5120]: I0316 15:57:05.219706 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:57:05 crc kubenswrapper[5120]: I0316 15:57:05.375615 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 15:57:05 crc kubenswrapper[5120]: I0316 15:57:05.509425 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"0a49327a-b187-4793-80dc-d57ce84bb993","Type":"ContainerStarted","Data":"5b7d287214fe7c5e9f3a33ceea3e5e88f0b681e1d9cceda1238ba057b32f9c0c"} Mar 16 15:57:06 crc kubenswrapper[5120]: I0316 15:57:06.521603 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"0a49327a-b187-4793-80dc-d57ce84bb993","Type":"ContainerStarted","Data":"c1f68a7963d487e4799cfcd4a1f336d9c53667254286c7d654c9614823d81a2c"} Mar 16 15:57:07 crc kubenswrapper[5120]: I0316 15:57:07.521270 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 15:57:07 crc kubenswrapper[5120]: I0316 15:57:07.556174 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"0a49327a-b187-4793-80dc-d57ce84bb993","Type":"ContainerStarted","Data":"5f7313a571b11bb2a5a90493aba0d54b505a157c6f7e5a0a45c43bd881728a96"} Mar 16 15:57:07 crc kubenswrapper[5120]: E0316 15:57:07.861603 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1612022 actualBytes=10240 Mar 16 15:57:08 crc kubenswrapper[5120]: I0316 15:57:08.038181 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-57kth"] Mar 16 15:57:08 crc kubenswrapper[5120]: I0316 15:57:08.048751 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-57kth" Mar 16 15:57:08 crc kubenswrapper[5120]: I0316 15:57:08.051726 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-57kth"] Mar 16 15:57:08 crc kubenswrapper[5120]: I0316 15:57:08.053392 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-manage-config-data\"" Mar 16 15:57:08 crc kubenswrapper[5120]: I0316 15:57:08.053865 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-manage-scripts\"" Mar 16 15:57:08 crc kubenswrapper[5120]: I0316 15:57:08.093961 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z87c6\" (UniqueName: \"kubernetes.io/projected/3f138acc-5d5b-4b31-ada9-a7943b9ed432-kube-api-access-z87c6\") pod \"nova-cell0-cell-mapping-57kth\" (UID: \"3f138acc-5d5b-4b31-ada9-a7943b9ed432\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-57kth" Mar 16 15:57:08 crc kubenswrapper[5120]: I0316 15:57:08.094051 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3f138acc-5d5b-4b31-ada9-a7943b9ed432-combined-ca-bundle\") pod \"nova-cell0-cell-mapping-57kth\" (UID: \"3f138acc-5d5b-4b31-ada9-a7943b9ed432\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-57kth" Mar 16 15:57:08 crc kubenswrapper[5120]: I0316 15:57:08.094150 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3f138acc-5d5b-4b31-ada9-a7943b9ed432-scripts\") pod \"nova-cell0-cell-mapping-57kth\" (UID: \"3f138acc-5d5b-4b31-ada9-a7943b9ed432\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-57kth" Mar 16 15:57:08 crc kubenswrapper[5120]: I0316 15:57:08.094228 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3f138acc-5d5b-4b31-ada9-a7943b9ed432-config-data\") pod \"nova-cell0-cell-mapping-57kth\" (UID: \"3f138acc-5d5b-4b31-ada9-a7943b9ed432\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-57kth" Mar 16 15:57:08 crc kubenswrapper[5120]: I0316 15:57:08.196110 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3f138acc-5d5b-4b31-ada9-a7943b9ed432-config-data\") pod \"nova-cell0-cell-mapping-57kth\" (UID: \"3f138acc-5d5b-4b31-ada9-a7943b9ed432\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-57kth" Mar 16 15:57:08 crc kubenswrapper[5120]: I0316 15:57:08.196222 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z87c6\" (UniqueName: \"kubernetes.io/projected/3f138acc-5d5b-4b31-ada9-a7943b9ed432-kube-api-access-z87c6\") pod \"nova-cell0-cell-mapping-57kth\" (UID: \"3f138acc-5d5b-4b31-ada9-a7943b9ed432\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-57kth" Mar 16 15:57:08 crc kubenswrapper[5120]: I0316 15:57:08.196275 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3f138acc-5d5b-4b31-ada9-a7943b9ed432-combined-ca-bundle\") pod \"nova-cell0-cell-mapping-57kth\" (UID: \"3f138acc-5d5b-4b31-ada9-a7943b9ed432\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-57kth" Mar 16 15:57:08 crc kubenswrapper[5120]: I0316 15:57:08.196329 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3f138acc-5d5b-4b31-ada9-a7943b9ed432-scripts\") pod \"nova-cell0-cell-mapping-57kth\" (UID: \"3f138acc-5d5b-4b31-ada9-a7943b9ed432\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-57kth" Mar 16 15:57:08 crc kubenswrapper[5120]: I0316 15:57:08.214715 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3f138acc-5d5b-4b31-ada9-a7943b9ed432-config-data\") pod \"nova-cell0-cell-mapping-57kth\" (UID: \"3f138acc-5d5b-4b31-ada9-a7943b9ed432\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-57kth" Mar 16 15:57:08 crc kubenswrapper[5120]: I0316 15:57:08.237695 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3f138acc-5d5b-4b31-ada9-a7943b9ed432-scripts\") pod \"nova-cell0-cell-mapping-57kth\" (UID: \"3f138acc-5d5b-4b31-ada9-a7943b9ed432\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-57kth" Mar 16 15:57:08 crc kubenswrapper[5120]: I0316 15:57:08.239383 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3f138acc-5d5b-4b31-ada9-a7943b9ed432-combined-ca-bundle\") pod \"nova-cell0-cell-mapping-57kth\" (UID: \"3f138acc-5d5b-4b31-ada9-a7943b9ed432\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-57kth" Mar 16 15:57:08 crc kubenswrapper[5120]: I0316 15:57:08.267457 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z87c6\" (UniqueName: \"kubernetes.io/projected/3f138acc-5d5b-4b31-ada9-a7943b9ed432-kube-api-access-z87c6\") pod \"nova-cell0-cell-mapping-57kth\" (UID: \"3f138acc-5d5b-4b31-ada9-a7943b9ed432\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-57kth" Mar 16 15:57:08 crc kubenswrapper[5120]: I0316 15:57:08.306616 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 15:57:08 crc kubenswrapper[5120]: I0316 15:57:08.315553 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:57:08 crc kubenswrapper[5120]: I0316 15:57:08.330118 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-config-data\"" Mar 16 15:57:08 crc kubenswrapper[5120]: I0316 15:57:08.348115 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 15:57:08 crc kubenswrapper[5120]: I0316 15:57:08.373477 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-57kth" Mar 16 15:57:08 crc kubenswrapper[5120]: I0316 15:57:08.407326 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 15:57:08 crc kubenswrapper[5120]: I0316 15:57:08.408623 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2gg7\" (UniqueName: \"kubernetes.io/projected/f119fad7-2300-4ad7-9954-c7da2cd41f45-kube-api-access-p2gg7\") pod \"nova-api-0\" (UID: \"f119fad7-2300-4ad7-9954-c7da2cd41f45\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:57:08 crc kubenswrapper[5120]: I0316 15:57:08.408717 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f119fad7-2300-4ad7-9954-c7da2cd41f45-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"f119fad7-2300-4ad7-9954-c7da2cd41f45\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:57:08 crc kubenswrapper[5120]: I0316 15:57:08.408807 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f119fad7-2300-4ad7-9954-c7da2cd41f45-config-data\") pod \"nova-api-0\" (UID: \"f119fad7-2300-4ad7-9954-c7da2cd41f45\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:57:08 crc kubenswrapper[5120]: I0316 15:57:08.408857 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f119fad7-2300-4ad7-9954-c7da2cd41f45-logs\") pod \"nova-api-0\" (UID: \"f119fad7-2300-4ad7-9954-c7da2cd41f45\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:57:08 crc kubenswrapper[5120]: I0316 15:57:08.417893 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 15:57:08 crc kubenswrapper[5120]: I0316 15:57:08.420923 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-scheduler-config-data\"" Mar 16 15:57:08 crc kubenswrapper[5120]: I0316 15:57:08.456153 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 15:57:08 crc kubenswrapper[5120]: I0316 15:57:08.510126 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f119fad7-2300-4ad7-9954-c7da2cd41f45-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"f119fad7-2300-4ad7-9954-c7da2cd41f45\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:57:08 crc kubenswrapper[5120]: I0316 15:57:08.510223 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f119fad7-2300-4ad7-9954-c7da2cd41f45-config-data\") pod \"nova-api-0\" (UID: \"f119fad7-2300-4ad7-9954-c7da2cd41f45\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:57:08 crc kubenswrapper[5120]: I0316 15:57:08.510254 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/981363c3-7b22-430f-aa69-2156b39ba7a3-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"981363c3-7b22-430f-aa69-2156b39ba7a3\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 15:57:08 crc kubenswrapper[5120]: I0316 15:57:08.510274 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/981363c3-7b22-430f-aa69-2156b39ba7a3-config-data\") pod \"nova-scheduler-0\" (UID: \"981363c3-7b22-430f-aa69-2156b39ba7a3\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 15:57:08 crc kubenswrapper[5120]: I0316 15:57:08.510312 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f119fad7-2300-4ad7-9954-c7da2cd41f45-logs\") pod \"nova-api-0\" (UID: \"f119fad7-2300-4ad7-9954-c7da2cd41f45\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:57:08 crc kubenswrapper[5120]: I0316 15:57:08.510365 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p2gg7\" (UniqueName: \"kubernetes.io/projected/f119fad7-2300-4ad7-9954-c7da2cd41f45-kube-api-access-p2gg7\") pod \"nova-api-0\" (UID: \"f119fad7-2300-4ad7-9954-c7da2cd41f45\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:57:08 crc kubenswrapper[5120]: I0316 15:57:08.510423 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njdn4\" (UniqueName: \"kubernetes.io/projected/981363c3-7b22-430f-aa69-2156b39ba7a3-kube-api-access-njdn4\") pod \"nova-scheduler-0\" (UID: \"981363c3-7b22-430f-aa69-2156b39ba7a3\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 15:57:08 crc kubenswrapper[5120]: I0316 15:57:08.517080 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f119fad7-2300-4ad7-9954-c7da2cd41f45-logs\") pod \"nova-api-0\" (UID: \"f119fad7-2300-4ad7-9954-c7da2cd41f45\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:57:08 crc kubenswrapper[5120]: I0316 15:57:08.537520 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f119fad7-2300-4ad7-9954-c7da2cd41f45-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"f119fad7-2300-4ad7-9954-c7da2cd41f45\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:57:08 crc kubenswrapper[5120]: I0316 15:57:08.540616 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f119fad7-2300-4ad7-9954-c7da2cd41f45-config-data\") pod \"nova-api-0\" (UID: \"f119fad7-2300-4ad7-9954-c7da2cd41f45\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:57:08 crc kubenswrapper[5120]: I0316 15:57:08.552169 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 15:57:08 crc kubenswrapper[5120]: I0316 15:57:08.591530 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:57:08 crc kubenswrapper[5120]: I0316 15:57:08.600445 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2gg7\" (UniqueName: \"kubernetes.io/projected/f119fad7-2300-4ad7-9954-c7da2cd41f45-kube-api-access-p2gg7\") pod \"nova-api-0\" (UID: \"f119fad7-2300-4ad7-9954-c7da2cd41f45\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:57:08 crc kubenswrapper[5120]: I0316 15:57:08.604535 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-metadata-config-data\"" Mar 16 15:57:08 crc kubenswrapper[5120]: I0316 15:57:08.613175 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/981363c3-7b22-430f-aa69-2156b39ba7a3-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"981363c3-7b22-430f-aa69-2156b39ba7a3\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 15:57:08 crc kubenswrapper[5120]: I0316 15:57:08.613218 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/981363c3-7b22-430f-aa69-2156b39ba7a3-config-data\") pod \"nova-scheduler-0\" (UID: \"981363c3-7b22-430f-aa69-2156b39ba7a3\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 15:57:08 crc kubenswrapper[5120]: I0316 15:57:08.613280 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/12829699-07a8-4cb4-8dbb-eb207c253f49-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"12829699-07a8-4cb4-8dbb-eb207c253f49\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:57:08 crc kubenswrapper[5120]: I0316 15:57:08.613307 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/12829699-07a8-4cb4-8dbb-eb207c253f49-logs\") pod \"nova-metadata-0\" (UID: \"12829699-07a8-4cb4-8dbb-eb207c253f49\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:57:08 crc kubenswrapper[5120]: I0316 15:57:08.613370 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-njdn4\" (UniqueName: \"kubernetes.io/projected/981363c3-7b22-430f-aa69-2156b39ba7a3-kube-api-access-njdn4\") pod \"nova-scheduler-0\" (UID: \"981363c3-7b22-430f-aa69-2156b39ba7a3\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 15:57:08 crc kubenswrapper[5120]: I0316 15:57:08.613425 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/12829699-07a8-4cb4-8dbb-eb207c253f49-config-data\") pod \"nova-metadata-0\" (UID: \"12829699-07a8-4cb4-8dbb-eb207c253f49\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:57:08 crc kubenswrapper[5120]: I0316 15:57:08.613442 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwjq5\" (UniqueName: \"kubernetes.io/projected/12829699-07a8-4cb4-8dbb-eb207c253f49-kube-api-access-rwjq5\") pod \"nova-metadata-0\" (UID: \"12829699-07a8-4cb4-8dbb-eb207c253f49\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:57:08 crc kubenswrapper[5120]: I0316 15:57:08.618363 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 15:57:08 crc kubenswrapper[5120]: I0316 15:57:08.624591 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/981363c3-7b22-430f-aa69-2156b39ba7a3-config-data\") pod \"nova-scheduler-0\" (UID: \"981363c3-7b22-430f-aa69-2156b39ba7a3\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 15:57:08 crc kubenswrapper[5120]: I0316 15:57:08.634220 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/981363c3-7b22-430f-aa69-2156b39ba7a3-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"981363c3-7b22-430f-aa69-2156b39ba7a3\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 15:57:08 crc kubenswrapper[5120]: I0316 15:57:08.642996 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 15:57:08 crc kubenswrapper[5120]: I0316 15:57:08.670614 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-njdn4\" (UniqueName: \"kubernetes.io/projected/981363c3-7b22-430f-aa69-2156b39ba7a3-kube-api-access-njdn4\") pod \"nova-scheduler-0\" (UID: \"981363c3-7b22-430f-aa69-2156b39ba7a3\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 15:57:08 crc kubenswrapper[5120]: I0316 15:57:08.695680 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:57:08 crc kubenswrapper[5120]: I0316 15:57:08.725747 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/12829699-07a8-4cb4-8dbb-eb207c253f49-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"12829699-07a8-4cb4-8dbb-eb207c253f49\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:57:08 crc kubenswrapper[5120]: I0316 15:57:08.725851 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/12829699-07a8-4cb4-8dbb-eb207c253f49-logs\") pod \"nova-metadata-0\" (UID: \"12829699-07a8-4cb4-8dbb-eb207c253f49\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:57:08 crc kubenswrapper[5120]: I0316 15:57:08.726040 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/845bfa64-f68f-475c-b8fe-ffe27e42acdc-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"845bfa64-f68f-475c-b8fe-ffe27e42acdc\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 15:57:08 crc kubenswrapper[5120]: I0316 15:57:08.726072 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/12829699-07a8-4cb4-8dbb-eb207c253f49-config-data\") pod \"nova-metadata-0\" (UID: \"12829699-07a8-4cb4-8dbb-eb207c253f49\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:57:08 crc kubenswrapper[5120]: I0316 15:57:08.726112 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rwjq5\" (UniqueName: \"kubernetes.io/projected/12829699-07a8-4cb4-8dbb-eb207c253f49-kube-api-access-rwjq5\") pod \"nova-metadata-0\" (UID: \"12829699-07a8-4cb4-8dbb-eb207c253f49\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:57:08 crc kubenswrapper[5120]: I0316 15:57:08.726147 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/845bfa64-f68f-475c-b8fe-ffe27e42acdc-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"845bfa64-f68f-475c-b8fe-ffe27e42acdc\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 15:57:08 crc kubenswrapper[5120]: I0316 15:57:08.726180 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmvp6\" (UniqueName: \"kubernetes.io/projected/845bfa64-f68f-475c-b8fe-ffe27e42acdc-kube-api-access-cmvp6\") pod \"nova-cell1-novncproxy-0\" (UID: \"845bfa64-f68f-475c-b8fe-ffe27e42acdc\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 15:57:08 crc kubenswrapper[5120]: I0316 15:57:08.729795 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/12829699-07a8-4cb4-8dbb-eb207c253f49-logs\") pod \"nova-metadata-0\" (UID: \"12829699-07a8-4cb4-8dbb-eb207c253f49\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:57:08 crc kubenswrapper[5120]: I0316 15:57:08.731673 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/12829699-07a8-4cb4-8dbb-eb207c253f49-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"12829699-07a8-4cb4-8dbb-eb207c253f49\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:57:08 crc kubenswrapper[5120]: I0316 15:57:08.741448 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/12829699-07a8-4cb4-8dbb-eb207c253f49-config-data\") pod \"nova-metadata-0\" (UID: \"12829699-07a8-4cb4-8dbb-eb207c253f49\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:57:08 crc kubenswrapper[5120]: I0316 15:57:08.753491 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 15:57:08 crc kubenswrapper[5120]: I0316 15:57:08.754963 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 15:57:08 crc kubenswrapper[5120]: I0316 15:57:08.758771 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-novncproxy-config-data\"" Mar 16 15:57:08 crc kubenswrapper[5120]: I0316 15:57:08.763322 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwjq5\" (UniqueName: \"kubernetes.io/projected/12829699-07a8-4cb4-8dbb-eb207c253f49-kube-api-access-rwjq5\") pod \"nova-metadata-0\" (UID: \"12829699-07a8-4cb4-8dbb-eb207c253f49\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:57:08 crc kubenswrapper[5120]: I0316 15:57:08.833592 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/845bfa64-f68f-475c-b8fe-ffe27e42acdc-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"845bfa64-f68f-475c-b8fe-ffe27e42acdc\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 15:57:08 crc kubenswrapper[5120]: I0316 15:57:08.833636 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cmvp6\" (UniqueName: \"kubernetes.io/projected/845bfa64-f68f-475c-b8fe-ffe27e42acdc-kube-api-access-cmvp6\") pod \"nova-cell1-novncproxy-0\" (UID: \"845bfa64-f68f-475c-b8fe-ffe27e42acdc\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 15:57:08 crc kubenswrapper[5120]: I0316 15:57:08.833827 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/845bfa64-f68f-475c-b8fe-ffe27e42acdc-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"845bfa64-f68f-475c-b8fe-ffe27e42acdc\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 15:57:08 crc kubenswrapper[5120]: I0316 15:57:08.855365 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/845bfa64-f68f-475c-b8fe-ffe27e42acdc-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"845bfa64-f68f-475c-b8fe-ffe27e42acdc\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 15:57:08 crc kubenswrapper[5120]: I0316 15:57:08.860804 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/845bfa64-f68f-475c-b8fe-ffe27e42acdc-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"845bfa64-f68f-475c-b8fe-ffe27e42acdc\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 15:57:08 crc kubenswrapper[5120]: I0316 15:57:08.865247 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmvp6\" (UniqueName: \"kubernetes.io/projected/845bfa64-f68f-475c-b8fe-ffe27e42acdc-kube-api-access-cmvp6\") pod \"nova-cell1-novncproxy-0\" (UID: \"845bfa64-f68f-475c-b8fe-ffe27e42acdc\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 15:57:08 crc kubenswrapper[5120]: I0316 15:57:08.882179 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 15:57:08 crc kubenswrapper[5120]: I0316 15:57:08.935591 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:57:09 crc kubenswrapper[5120]: I0316 15:57:09.083612 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 15:57:09 crc kubenswrapper[5120]: I0316 15:57:09.108383 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-57kth"] Mar 16 15:57:09 crc kubenswrapper[5120]: W0316 15:57:09.126748 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3f138acc_5d5b_4b31_ada9_a7943b9ed432.slice/crio-fa1b4262d9d3b9b50a4558704e0c83000484049bf06f5885987a476f5a72d6c4 WatchSource:0}: Error finding container fa1b4262d9d3b9b50a4558704e0c83000484049bf06f5885987a476f5a72d6c4: Status 404 returned error can't find the container with id fa1b4262d9d3b9b50a4558704e0c83000484049bf06f5885987a476f5a72d6c4 Mar 16 15:57:09 crc kubenswrapper[5120]: I0316 15:57:09.270015 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 15:57:09 crc kubenswrapper[5120]: I0316 15:57:09.437867 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-np2mc"] Mar 16 15:57:09 crc kubenswrapper[5120]: I0316 15:57:09.451330 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-np2mc" Mar 16 15:57:09 crc kubenswrapper[5120]: I0316 15:57:09.456921 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-conductor-config-data\"" Mar 16 15:57:09 crc kubenswrapper[5120]: I0316 15:57:09.457102 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-conductor-scripts\"" Mar 16 15:57:09 crc kubenswrapper[5120]: I0316 15:57:09.457246 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 15:57:09 crc kubenswrapper[5120]: I0316 15:57:09.467439 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-np2mc"] Mar 16 15:57:09 crc kubenswrapper[5120]: W0316 15:57:09.469937 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod981363c3_7b22_430f_aa69_2156b39ba7a3.slice/crio-767c5e376173d15e722f304017b45c525588371124341745a76554cf911699ac WatchSource:0}: Error finding container 767c5e376173d15e722f304017b45c525588371124341745a76554cf911699ac: Status 404 returned error can't find the container with id 767c5e376173d15e722f304017b45c525588371124341745a76554cf911699ac Mar 16 15:57:09 crc kubenswrapper[5120]: I0316 15:57:09.553822 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0747eaf7-a464-4360-bf02-c8e9a9be90fa-config-data\") pod \"nova-cell1-conductor-db-sync-np2mc\" (UID: \"0747eaf7-a464-4360-bf02-c8e9a9be90fa\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-np2mc" Mar 16 15:57:09 crc kubenswrapper[5120]: I0316 15:57:09.553950 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0747eaf7-a464-4360-bf02-c8e9a9be90fa-scripts\") pod \"nova-cell1-conductor-db-sync-np2mc\" (UID: \"0747eaf7-a464-4360-bf02-c8e9a9be90fa\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-np2mc" Mar 16 15:57:09 crc kubenswrapper[5120]: I0316 15:57:09.553993 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mf6fk\" (UniqueName: \"kubernetes.io/projected/0747eaf7-a464-4360-bf02-c8e9a9be90fa-kube-api-access-mf6fk\") pod \"nova-cell1-conductor-db-sync-np2mc\" (UID: \"0747eaf7-a464-4360-bf02-c8e9a9be90fa\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-np2mc" Mar 16 15:57:09 crc kubenswrapper[5120]: I0316 15:57:09.554069 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0747eaf7-a464-4360-bf02-c8e9a9be90fa-combined-ca-bundle\") pod \"nova-cell1-conductor-db-sync-np2mc\" (UID: \"0747eaf7-a464-4360-bf02-c8e9a9be90fa\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-np2mc" Mar 16 15:57:09 crc kubenswrapper[5120]: I0316 15:57:09.609868 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"981363c3-7b22-430f-aa69-2156b39ba7a3","Type":"ContainerStarted","Data":"767c5e376173d15e722f304017b45c525588371124341745a76554cf911699ac"} Mar 16 15:57:09 crc kubenswrapper[5120]: I0316 15:57:09.613657 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"0a49327a-b187-4793-80dc-d57ce84bb993","Type":"ContainerStarted","Data":"eb2f17bbe26b394561d063352949d7ec4f60b3ef1517cc2cd0bf1a399f596bfa"} Mar 16 15:57:09 crc kubenswrapper[5120]: I0316 15:57:09.614950 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:57:09 crc kubenswrapper[5120]: I0316 15:57:09.625078 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-57kth" event={"ID":"3f138acc-5d5b-4b31-ada9-a7943b9ed432","Type":"ContainerStarted","Data":"be08c6b31ab15bb00fdbf4925e690530157d077f8bd4226fabd3e129d5a8e362"} Mar 16 15:57:09 crc kubenswrapper[5120]: I0316 15:57:09.625108 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-57kth" event={"ID":"3f138acc-5d5b-4b31-ada9-a7943b9ed432","Type":"ContainerStarted","Data":"fa1b4262d9d3b9b50a4558704e0c83000484049bf06f5885987a476f5a72d6c4"} Mar 16 15:57:09 crc kubenswrapper[5120]: I0316 15:57:09.650272 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.544706381 podStartE2EDuration="8.650252421s" podCreationTimestamp="2026-03-16 15:57:01 +0000 UTC" firstStartedPulling="2026-03-16 15:57:02.432016293 +0000 UTC m=+1524.585947980" lastFinishedPulling="2026-03-16 15:57:08.537562363 +0000 UTC m=+1530.691494020" observedRunningTime="2026-03-16 15:57:09.633680392 +0000 UTC m=+1531.787612049" watchObservedRunningTime="2026-03-16 15:57:09.650252421 +0000 UTC m=+1531.804184068" Mar 16 15:57:09 crc kubenswrapper[5120]: I0316 15:57:09.655414 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"f119fad7-2300-4ad7-9954-c7da2cd41f45","Type":"ContainerStarted","Data":"43303b37b4bfa4b8b40fa925d32c140a7d3ebc73be0a2d941a74daa1837ffa55"} Mar 16 15:57:09 crc kubenswrapper[5120]: I0316 15:57:09.655964 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0747eaf7-a464-4360-bf02-c8e9a9be90fa-scripts\") pod \"nova-cell1-conductor-db-sync-np2mc\" (UID: \"0747eaf7-a464-4360-bf02-c8e9a9be90fa\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-np2mc" Mar 16 15:57:09 crc kubenswrapper[5120]: I0316 15:57:09.656067 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mf6fk\" (UniqueName: \"kubernetes.io/projected/0747eaf7-a464-4360-bf02-c8e9a9be90fa-kube-api-access-mf6fk\") pod \"nova-cell1-conductor-db-sync-np2mc\" (UID: \"0747eaf7-a464-4360-bf02-c8e9a9be90fa\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-np2mc" Mar 16 15:57:09 crc kubenswrapper[5120]: I0316 15:57:09.656159 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0747eaf7-a464-4360-bf02-c8e9a9be90fa-combined-ca-bundle\") pod \"nova-cell1-conductor-db-sync-np2mc\" (UID: \"0747eaf7-a464-4360-bf02-c8e9a9be90fa\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-np2mc" Mar 16 15:57:09 crc kubenswrapper[5120]: I0316 15:57:09.657803 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0747eaf7-a464-4360-bf02-c8e9a9be90fa-config-data\") pod \"nova-cell1-conductor-db-sync-np2mc\" (UID: \"0747eaf7-a464-4360-bf02-c8e9a9be90fa\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-np2mc" Mar 16 15:57:09 crc kubenswrapper[5120]: I0316 15:57:09.664716 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0747eaf7-a464-4360-bf02-c8e9a9be90fa-combined-ca-bundle\") pod \"nova-cell1-conductor-db-sync-np2mc\" (UID: \"0747eaf7-a464-4360-bf02-c8e9a9be90fa\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-np2mc" Mar 16 15:57:09 crc kubenswrapper[5120]: I0316 15:57:09.668881 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 15:57:09 crc kubenswrapper[5120]: W0316 15:57:09.670500 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod12829699_07a8_4cb4_8dbb_eb207c253f49.slice/crio-e103c041d22886d95a4b195072bb3348970588808d748aa931bd94f1e819176e WatchSource:0}: Error finding container e103c041d22886d95a4b195072bb3348970588808d748aa931bd94f1e819176e: Status 404 returned error can't find the container with id e103c041d22886d95a4b195072bb3348970588808d748aa931bd94f1e819176e Mar 16 15:57:09 crc kubenswrapper[5120]: I0316 15:57:09.673244 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0747eaf7-a464-4360-bf02-c8e9a9be90fa-scripts\") pod \"nova-cell1-conductor-db-sync-np2mc\" (UID: \"0747eaf7-a464-4360-bf02-c8e9a9be90fa\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-np2mc" Mar 16 15:57:09 crc kubenswrapper[5120]: I0316 15:57:09.679256 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0747eaf7-a464-4360-bf02-c8e9a9be90fa-config-data\") pod \"nova-cell1-conductor-db-sync-np2mc\" (UID: \"0747eaf7-a464-4360-bf02-c8e9a9be90fa\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-np2mc" Mar 16 15:57:09 crc kubenswrapper[5120]: I0316 15:57:09.683263 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-57kth" podStartSLOduration=1.683242745 podStartE2EDuration="1.683242745s" podCreationTimestamp="2026-03-16 15:57:08 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:57:09.655471456 +0000 UTC m=+1531.809403133" watchObservedRunningTime="2026-03-16 15:57:09.683242745 +0000 UTC m=+1531.837174402" Mar 16 15:57:09 crc kubenswrapper[5120]: I0316 15:57:09.683349 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mf6fk\" (UniqueName: \"kubernetes.io/projected/0747eaf7-a464-4360-bf02-c8e9a9be90fa-kube-api-access-mf6fk\") pod \"nova-cell1-conductor-db-sync-np2mc\" (UID: \"0747eaf7-a464-4360-bf02-c8e9a9be90fa\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-np2mc" Mar 16 15:57:09 crc kubenswrapper[5120]: I0316 15:57:09.750797 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 15:57:09 crc kubenswrapper[5120]: I0316 15:57:09.758907 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 15:57:09 crc kubenswrapper[5120]: I0316 15:57:09.765975 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 15:57:09 crc kubenswrapper[5120]: I0316 15:57:09.775838 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 15:57:09 crc kubenswrapper[5120]: I0316 15:57:09.776097 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="1bb69667-1646-4d0c-91dd-dbd582031774" containerName="nova-cell0-conductor-conductor" containerID="cri-o://8d56dff3455e29f82e0859f8794ce8f2b45665ee473c44ad5a45bc744e314e18" gracePeriod=30 Mar 16 15:57:09 crc kubenswrapper[5120]: I0316 15:57:09.781225 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 15:57:09 crc kubenswrapper[5120]: I0316 15:57:09.787957 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 15:57:09 crc kubenswrapper[5120]: I0316 15:57:09.925880 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-np2mc" Mar 16 15:57:10 crc kubenswrapper[5120]: I0316 15:57:10.374585 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-np2mc"] Mar 16 15:57:10 crc kubenswrapper[5120]: W0316 15:57:10.396270 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0747eaf7_a464_4360_bf02_c8e9a9be90fa.slice/crio-4d38f864a8357520679c5b4bb1d0eedfb8f4d19f84bbd4f0118793daeb1db6f5 WatchSource:0}: Error finding container 4d38f864a8357520679c5b4bb1d0eedfb8f4d19f84bbd4f0118793daeb1db6f5: Status 404 returned error can't find the container with id 4d38f864a8357520679c5b4bb1d0eedfb8f4d19f84bbd4f0118793daeb1db6f5 Mar 16 15:57:10 crc kubenswrapper[5120]: I0316 15:57:10.671135 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podUID="845bfa64-f68f-475c-b8fe-ffe27e42acdc" containerName="nova-cell1-novncproxy-novncproxy" containerID="cri-o://b884980f08f1614c3f23c5cb87d3d4638e85ecf8698ec49ee2836342dcf7cb4f" gracePeriod=30 Mar 16 15:57:10 crc kubenswrapper[5120]: I0316 15:57:10.673593 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-np2mc" event={"ID":"0747eaf7-a464-4360-bf02-c8e9a9be90fa","Type":"ContainerStarted","Data":"383af44933828e287b95b36f80d5514e2447d0cba7ad37a2d0b63229052a043d"} Mar 16 15:57:10 crc kubenswrapper[5120]: I0316 15:57:10.673628 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-np2mc" event={"ID":"0747eaf7-a464-4360-bf02-c8e9a9be90fa","Type":"ContainerStarted","Data":"4d38f864a8357520679c5b4bb1d0eedfb8f4d19f84bbd4f0118793daeb1db6f5"} Mar 16 15:57:10 crc kubenswrapper[5120]: I0316 15:57:10.673639 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"845bfa64-f68f-475c-b8fe-ffe27e42acdc","Type":"ContainerStarted","Data":"b884980f08f1614c3f23c5cb87d3d4638e85ecf8698ec49ee2836342dcf7cb4f"} Mar 16 15:57:10 crc kubenswrapper[5120]: I0316 15:57:10.673650 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"845bfa64-f68f-475c-b8fe-ffe27e42acdc","Type":"ContainerStarted","Data":"c96b7fd6bd8fd664150b350342b07f6d4774a9ae1e56176395e34e65d7bbe671"} Mar 16 15:57:10 crc kubenswrapper[5120]: I0316 15:57:10.678674 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"f119fad7-2300-4ad7-9954-c7da2cd41f45","Type":"ContainerStarted","Data":"430e2d5a1fe401aba4e7f4ca77010e6df98675be8d7c6c27a9447972af8d702a"} Mar 16 15:57:10 crc kubenswrapper[5120]: I0316 15:57:10.678722 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"f119fad7-2300-4ad7-9954-c7da2cd41f45","Type":"ContainerStarted","Data":"2255b39a8caff9ac512ccfe165d5489e2e6318cd39c8c1030d873843f5760a02"} Mar 16 15:57:10 crc kubenswrapper[5120]: I0316 15:57:10.678884 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="f119fad7-2300-4ad7-9954-c7da2cd41f45" containerName="nova-api-log" containerID="cri-o://2255b39a8caff9ac512ccfe165d5489e2e6318cd39c8c1030d873843f5760a02" gracePeriod=30 Mar 16 15:57:10 crc kubenswrapper[5120]: I0316 15:57:10.679235 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="f119fad7-2300-4ad7-9954-c7da2cd41f45" containerName="nova-api-api" containerID="cri-o://430e2d5a1fe401aba4e7f4ca77010e6df98675be8d7c6c27a9447972af8d702a" gracePeriod=30 Mar 16 15:57:10 crc kubenswrapper[5120]: I0316 15:57:10.688144 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"12829699-07a8-4cb4-8dbb-eb207c253f49","Type":"ContainerStarted","Data":"15e7d9f911ea86ee3518595b078428438c53be39762b01f1bd1bf5f737abe254"} Mar 16 15:57:10 crc kubenswrapper[5120]: I0316 15:57:10.688191 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"12829699-07a8-4cb4-8dbb-eb207c253f49","Type":"ContainerStarted","Data":"3f40609bb59992f386824ef9bfcbd2e80ed40590fce3abedcac7e555b1f885e0"} Mar 16 15:57:10 crc kubenswrapper[5120]: I0316 15:57:10.688202 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"12829699-07a8-4cb4-8dbb-eb207c253f49","Type":"ContainerStarted","Data":"e103c041d22886d95a4b195072bb3348970588808d748aa931bd94f1e819176e"} Mar 16 15:57:10 crc kubenswrapper[5120]: I0316 15:57:10.688230 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="12829699-07a8-4cb4-8dbb-eb207c253f49" containerName="nova-metadata-log" containerID="cri-o://3f40609bb59992f386824ef9bfcbd2e80ed40590fce3abedcac7e555b1f885e0" gracePeriod=30 Mar 16 15:57:10 crc kubenswrapper[5120]: I0316 15:57:10.688280 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="12829699-07a8-4cb4-8dbb-eb207c253f49" containerName="nova-metadata-metadata" containerID="cri-o://15e7d9f911ea86ee3518595b078428438c53be39762b01f1bd1bf5f737abe254" gracePeriod=30 Mar 16 15:57:10 crc kubenswrapper[5120]: I0316 15:57:10.688751 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-np2mc" podStartSLOduration=1.6887399840000001 podStartE2EDuration="1.688739984s" podCreationTimestamp="2026-03-16 15:57:09 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:57:10.683364565 +0000 UTC m=+1532.837296222" watchObservedRunningTime="2026-03-16 15:57:10.688739984 +0000 UTC m=+1532.842671641" Mar 16 15:57:10 crc kubenswrapper[5120]: I0316 15:57:10.697893 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"981363c3-7b22-430f-aa69-2156b39ba7a3","Type":"ContainerStarted","Data":"24cc81feb48879a69e8bd088a64555424b3a3825d67293712256b1b6f5cc5586"} Mar 16 15:57:10 crc kubenswrapper[5120]: I0316 15:57:10.698089 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="981363c3-7b22-430f-aa69-2156b39ba7a3" containerName="nova-scheduler-scheduler" containerID="cri-o://24cc81feb48879a69e8bd088a64555424b3a3825d67293712256b1b6f5cc5586" gracePeriod=30 Mar 16 15:57:10 crc kubenswrapper[5120]: I0316 15:57:10.712110 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=2.712087402 podStartE2EDuration="2.712087402s" podCreationTimestamp="2026-03-16 15:57:08 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:57:10.703668698 +0000 UTC m=+1532.857600355" watchObservedRunningTime="2026-03-16 15:57:10.712087402 +0000 UTC m=+1532.866019059" Mar 16 15:57:10 crc kubenswrapper[5120]: I0316 15:57:10.781893 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podStartSLOduration=2.7818724550000002 podStartE2EDuration="2.781872455s" podCreationTimestamp="2026-03-16 15:57:08 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:57:10.731468248 +0000 UTC m=+1532.885399925" watchObservedRunningTime="2026-03-16 15:57:10.781872455 +0000 UTC m=+1532.935804102" Mar 16 15:57:10 crc kubenswrapper[5120]: I0316 15:57:10.802482 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=2.8024600939999997 podStartE2EDuration="2.802460094s" podCreationTimestamp="2026-03-16 15:57:08 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:57:10.753803156 +0000 UTC m=+1532.907734833" watchObservedRunningTime="2026-03-16 15:57:10.802460094 +0000 UTC m=+1532.956391751" Mar 16 15:57:10 crc kubenswrapper[5120]: I0316 15:57:10.815240 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-scheduler-0" podStartSLOduration=2.815222387 podStartE2EDuration="2.815222387s" podCreationTimestamp="2026-03-16 15:57:08 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:57:10.781475303 +0000 UTC m=+1532.935406960" watchObservedRunningTime="2026-03-16 15:57:10.815222387 +0000 UTC m=+1532.969154044" Mar 16 15:57:11 crc kubenswrapper[5120]: I0316 15:57:11.476536 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:57:11 crc kubenswrapper[5120]: I0316 15:57:11.612143 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f119fad7-2300-4ad7-9954-c7da2cd41f45-config-data\") pod \"f119fad7-2300-4ad7-9954-c7da2cd41f45\" (UID: \"f119fad7-2300-4ad7-9954-c7da2cd41f45\") " Mar 16 15:57:11 crc kubenswrapper[5120]: I0316 15:57:11.612542 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f119fad7-2300-4ad7-9954-c7da2cd41f45-combined-ca-bundle\") pod \"f119fad7-2300-4ad7-9954-c7da2cd41f45\" (UID: \"f119fad7-2300-4ad7-9954-c7da2cd41f45\") " Mar 16 15:57:11 crc kubenswrapper[5120]: I0316 15:57:11.612696 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p2gg7\" (UniqueName: \"kubernetes.io/projected/f119fad7-2300-4ad7-9954-c7da2cd41f45-kube-api-access-p2gg7\") pod \"f119fad7-2300-4ad7-9954-c7da2cd41f45\" (UID: \"f119fad7-2300-4ad7-9954-c7da2cd41f45\") " Mar 16 15:57:11 crc kubenswrapper[5120]: I0316 15:57:11.612870 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f119fad7-2300-4ad7-9954-c7da2cd41f45-logs\") pod \"f119fad7-2300-4ad7-9954-c7da2cd41f45\" (UID: \"f119fad7-2300-4ad7-9954-c7da2cd41f45\") " Mar 16 15:57:11 crc kubenswrapper[5120]: I0316 15:57:11.614006 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f119fad7-2300-4ad7-9954-c7da2cd41f45-logs" (OuterVolumeSpecName: "logs") pod "f119fad7-2300-4ad7-9954-c7da2cd41f45" (UID: "f119fad7-2300-4ad7-9954-c7da2cd41f45"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:57:11 crc kubenswrapper[5120]: I0316 15:57:11.615457 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f119fad7-2300-4ad7-9954-c7da2cd41f45-logs\") on node \"crc\" DevicePath \"\"" Mar 16 15:57:11 crc kubenswrapper[5120]: I0316 15:57:11.620627 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f119fad7-2300-4ad7-9954-c7da2cd41f45-kube-api-access-p2gg7" (OuterVolumeSpecName: "kube-api-access-p2gg7") pod "f119fad7-2300-4ad7-9954-c7da2cd41f45" (UID: "f119fad7-2300-4ad7-9954-c7da2cd41f45"). InnerVolumeSpecName "kube-api-access-p2gg7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:57:11 crc kubenswrapper[5120]: I0316 15:57:11.657662 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f119fad7-2300-4ad7-9954-c7da2cd41f45-config-data" (OuterVolumeSpecName: "config-data") pod "f119fad7-2300-4ad7-9954-c7da2cd41f45" (UID: "f119fad7-2300-4ad7-9954-c7da2cd41f45"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:57:11 crc kubenswrapper[5120]: I0316 15:57:11.664824 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f119fad7-2300-4ad7-9954-c7da2cd41f45-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f119fad7-2300-4ad7-9954-c7da2cd41f45" (UID: "f119fad7-2300-4ad7-9954-c7da2cd41f45"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:57:11 crc kubenswrapper[5120]: I0316 15:57:11.713556 5120 generic.go:358] "Generic (PLEG): container finished" podID="f119fad7-2300-4ad7-9954-c7da2cd41f45" containerID="430e2d5a1fe401aba4e7f4ca77010e6df98675be8d7c6c27a9447972af8d702a" exitCode=0 Mar 16 15:57:11 crc kubenswrapper[5120]: I0316 15:57:11.713595 5120 generic.go:358] "Generic (PLEG): container finished" podID="f119fad7-2300-4ad7-9954-c7da2cd41f45" containerID="2255b39a8caff9ac512ccfe165d5489e2e6318cd39c8c1030d873843f5760a02" exitCode=143 Mar 16 15:57:11 crc kubenswrapper[5120]: I0316 15:57:11.713666 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:57:11 crc kubenswrapper[5120]: I0316 15:57:11.713691 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"f119fad7-2300-4ad7-9954-c7da2cd41f45","Type":"ContainerDied","Data":"430e2d5a1fe401aba4e7f4ca77010e6df98675be8d7c6c27a9447972af8d702a"} Mar 16 15:57:11 crc kubenswrapper[5120]: I0316 15:57:11.713725 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"f119fad7-2300-4ad7-9954-c7da2cd41f45","Type":"ContainerDied","Data":"2255b39a8caff9ac512ccfe165d5489e2e6318cd39c8c1030d873843f5760a02"} Mar 16 15:57:11 crc kubenswrapper[5120]: I0316 15:57:11.713736 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"f119fad7-2300-4ad7-9954-c7da2cd41f45","Type":"ContainerDied","Data":"43303b37b4bfa4b8b40fa925d32c140a7d3ebc73be0a2d941a74daa1837ffa55"} Mar 16 15:57:11 crc kubenswrapper[5120]: I0316 15:57:11.713751 5120 scope.go:117] "RemoveContainer" containerID="430e2d5a1fe401aba4e7f4ca77010e6df98675be8d7c6c27a9447972af8d702a" Mar 16 15:57:11 crc kubenswrapper[5120]: I0316 15:57:11.717002 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f119fad7-2300-4ad7-9954-c7da2cd41f45-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 15:57:11 crc kubenswrapper[5120]: I0316 15:57:11.717025 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f119fad7-2300-4ad7-9954-c7da2cd41f45-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:57:11 crc kubenswrapper[5120]: I0316 15:57:11.717035 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p2gg7\" (UniqueName: \"kubernetes.io/projected/f119fad7-2300-4ad7-9954-c7da2cd41f45-kube-api-access-p2gg7\") on node \"crc\" DevicePath \"\"" Mar 16 15:57:11 crc kubenswrapper[5120]: I0316 15:57:11.727094 5120 generic.go:358] "Generic (PLEG): container finished" podID="12829699-07a8-4cb4-8dbb-eb207c253f49" containerID="15e7d9f911ea86ee3518595b078428438c53be39762b01f1bd1bf5f737abe254" exitCode=0 Mar 16 15:57:11 crc kubenswrapper[5120]: I0316 15:57:11.727125 5120 generic.go:358] "Generic (PLEG): container finished" podID="12829699-07a8-4cb4-8dbb-eb207c253f49" containerID="3f40609bb59992f386824ef9bfcbd2e80ed40590fce3abedcac7e555b1f885e0" exitCode=143 Mar 16 15:57:11 crc kubenswrapper[5120]: I0316 15:57:11.727717 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"12829699-07a8-4cb4-8dbb-eb207c253f49","Type":"ContainerDied","Data":"15e7d9f911ea86ee3518595b078428438c53be39762b01f1bd1bf5f737abe254"} Mar 16 15:57:11 crc kubenswrapper[5120]: I0316 15:57:11.727780 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"12829699-07a8-4cb4-8dbb-eb207c253f49","Type":"ContainerDied","Data":"3f40609bb59992f386824ef9bfcbd2e80ed40590fce3abedcac7e555b1f885e0"} Mar 16 15:57:11 crc kubenswrapper[5120]: I0316 15:57:11.727791 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"12829699-07a8-4cb4-8dbb-eb207c253f49","Type":"ContainerDied","Data":"e103c041d22886d95a4b195072bb3348970588808d748aa931bd94f1e819176e"} Mar 16 15:57:11 crc kubenswrapper[5120]: I0316 15:57:11.727801 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e103c041d22886d95a4b195072bb3348970588808d748aa931bd94f1e819176e" Mar 16 15:57:11 crc kubenswrapper[5120]: I0316 15:57:11.735507 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:57:11 crc kubenswrapper[5120]: I0316 15:57:11.796878 5120 scope.go:117] "RemoveContainer" containerID="2255b39a8caff9ac512ccfe165d5489e2e6318cd39c8c1030d873843f5760a02" Mar 16 15:57:11 crc kubenswrapper[5120]: I0316 15:57:11.818690 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/12829699-07a8-4cb4-8dbb-eb207c253f49-logs\") pod \"12829699-07a8-4cb4-8dbb-eb207c253f49\" (UID: \"12829699-07a8-4cb4-8dbb-eb207c253f49\") " Mar 16 15:57:11 crc kubenswrapper[5120]: I0316 15:57:11.818981 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/12829699-07a8-4cb4-8dbb-eb207c253f49-config-data\") pod \"12829699-07a8-4cb4-8dbb-eb207c253f49\" (UID: \"12829699-07a8-4cb4-8dbb-eb207c253f49\") " Mar 16 15:57:11 crc kubenswrapper[5120]: I0316 15:57:11.819009 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/12829699-07a8-4cb4-8dbb-eb207c253f49-combined-ca-bundle\") pod \"12829699-07a8-4cb4-8dbb-eb207c253f49\" (UID: \"12829699-07a8-4cb4-8dbb-eb207c253f49\") " Mar 16 15:57:11 crc kubenswrapper[5120]: I0316 15:57:11.819067 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rwjq5\" (UniqueName: \"kubernetes.io/projected/12829699-07a8-4cb4-8dbb-eb207c253f49-kube-api-access-rwjq5\") pod \"12829699-07a8-4cb4-8dbb-eb207c253f49\" (UID: \"12829699-07a8-4cb4-8dbb-eb207c253f49\") " Mar 16 15:57:11 crc kubenswrapper[5120]: I0316 15:57:11.819123 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 15:57:11 crc kubenswrapper[5120]: I0316 15:57:11.826019 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12829699-07a8-4cb4-8dbb-eb207c253f49-kube-api-access-rwjq5" (OuterVolumeSpecName: "kube-api-access-rwjq5") pod "12829699-07a8-4cb4-8dbb-eb207c253f49" (UID: "12829699-07a8-4cb4-8dbb-eb207c253f49"). InnerVolumeSpecName "kube-api-access-rwjq5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:57:11 crc kubenswrapper[5120]: I0316 15:57:11.826171 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12829699-07a8-4cb4-8dbb-eb207c253f49-logs" (OuterVolumeSpecName: "logs") pod "12829699-07a8-4cb4-8dbb-eb207c253f49" (UID: "12829699-07a8-4cb4-8dbb-eb207c253f49"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:57:11 crc kubenswrapper[5120]: I0316 15:57:11.829732 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 15:57:11 crc kubenswrapper[5120]: I0316 15:57:11.834426 5120 scope.go:117] "RemoveContainer" containerID="430e2d5a1fe401aba4e7f4ca77010e6df98675be8d7c6c27a9447972af8d702a" Mar 16 15:57:11 crc kubenswrapper[5120]: E0316 15:57:11.835128 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"430e2d5a1fe401aba4e7f4ca77010e6df98675be8d7c6c27a9447972af8d702a\": container with ID starting with 430e2d5a1fe401aba4e7f4ca77010e6df98675be8d7c6c27a9447972af8d702a not found: ID does not exist" containerID="430e2d5a1fe401aba4e7f4ca77010e6df98675be8d7c6c27a9447972af8d702a" Mar 16 15:57:11 crc kubenswrapper[5120]: I0316 15:57:11.835164 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"430e2d5a1fe401aba4e7f4ca77010e6df98675be8d7c6c27a9447972af8d702a"} err="failed to get container status \"430e2d5a1fe401aba4e7f4ca77010e6df98675be8d7c6c27a9447972af8d702a\": rpc error: code = NotFound desc = could not find container \"430e2d5a1fe401aba4e7f4ca77010e6df98675be8d7c6c27a9447972af8d702a\": container with ID starting with 430e2d5a1fe401aba4e7f4ca77010e6df98675be8d7c6c27a9447972af8d702a not found: ID does not exist" Mar 16 15:57:11 crc kubenswrapper[5120]: I0316 15:57:11.835188 5120 scope.go:117] "RemoveContainer" containerID="2255b39a8caff9ac512ccfe165d5489e2e6318cd39c8c1030d873843f5760a02" Mar 16 15:57:11 crc kubenswrapper[5120]: E0316 15:57:11.839131 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2255b39a8caff9ac512ccfe165d5489e2e6318cd39c8c1030d873843f5760a02\": container with ID starting with 2255b39a8caff9ac512ccfe165d5489e2e6318cd39c8c1030d873843f5760a02 not found: ID does not exist" containerID="2255b39a8caff9ac512ccfe165d5489e2e6318cd39c8c1030d873843f5760a02" Mar 16 15:57:11 crc kubenswrapper[5120]: I0316 15:57:11.839196 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2255b39a8caff9ac512ccfe165d5489e2e6318cd39c8c1030d873843f5760a02"} err="failed to get container status \"2255b39a8caff9ac512ccfe165d5489e2e6318cd39c8c1030d873843f5760a02\": rpc error: code = NotFound desc = could not find container \"2255b39a8caff9ac512ccfe165d5489e2e6318cd39c8c1030d873843f5760a02\": container with ID starting with 2255b39a8caff9ac512ccfe165d5489e2e6318cd39c8c1030d873843f5760a02 not found: ID does not exist" Mar 16 15:57:11 crc kubenswrapper[5120]: I0316 15:57:11.839229 5120 scope.go:117] "RemoveContainer" containerID="430e2d5a1fe401aba4e7f4ca77010e6df98675be8d7c6c27a9447972af8d702a" Mar 16 15:57:11 crc kubenswrapper[5120]: I0316 15:57:11.846922 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"430e2d5a1fe401aba4e7f4ca77010e6df98675be8d7c6c27a9447972af8d702a"} err="failed to get container status \"430e2d5a1fe401aba4e7f4ca77010e6df98675be8d7c6c27a9447972af8d702a\": rpc error: code = NotFound desc = could not find container \"430e2d5a1fe401aba4e7f4ca77010e6df98675be8d7c6c27a9447972af8d702a\": container with ID starting with 430e2d5a1fe401aba4e7f4ca77010e6df98675be8d7c6c27a9447972af8d702a not found: ID does not exist" Mar 16 15:57:11 crc kubenswrapper[5120]: I0316 15:57:11.846958 5120 scope.go:117] "RemoveContainer" containerID="2255b39a8caff9ac512ccfe165d5489e2e6318cd39c8c1030d873843f5760a02" Mar 16 15:57:11 crc kubenswrapper[5120]: I0316 15:57:11.847372 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 15:57:11 crc kubenswrapper[5120]: I0316 15:57:11.848959 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12829699-07a8-4cb4-8dbb-eb207c253f49" containerName="nova-metadata-log" Mar 16 15:57:11 crc kubenswrapper[5120]: I0316 15:57:11.848976 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="12829699-07a8-4cb4-8dbb-eb207c253f49" containerName="nova-metadata-log" Mar 16 15:57:11 crc kubenswrapper[5120]: I0316 15:57:11.848989 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f119fad7-2300-4ad7-9954-c7da2cd41f45" containerName="nova-api-log" Mar 16 15:57:11 crc kubenswrapper[5120]: I0316 15:57:11.848995 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f119fad7-2300-4ad7-9954-c7da2cd41f45" containerName="nova-api-log" Mar 16 15:57:11 crc kubenswrapper[5120]: I0316 15:57:11.849058 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12829699-07a8-4cb4-8dbb-eb207c253f49" containerName="nova-metadata-metadata" Mar 16 15:57:11 crc kubenswrapper[5120]: I0316 15:57:11.849065 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="12829699-07a8-4cb4-8dbb-eb207c253f49" containerName="nova-metadata-metadata" Mar 16 15:57:11 crc kubenswrapper[5120]: I0316 15:57:11.849083 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f119fad7-2300-4ad7-9954-c7da2cd41f45" containerName="nova-api-api" Mar 16 15:57:11 crc kubenswrapper[5120]: I0316 15:57:11.849090 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f119fad7-2300-4ad7-9954-c7da2cd41f45" containerName="nova-api-api" Mar 16 15:57:11 crc kubenswrapper[5120]: I0316 15:57:11.849319 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f119fad7-2300-4ad7-9954-c7da2cd41f45" containerName="nova-api-api" Mar 16 15:57:11 crc kubenswrapper[5120]: I0316 15:57:11.849359 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="12829699-07a8-4cb4-8dbb-eb207c253f49" containerName="nova-metadata-metadata" Mar 16 15:57:11 crc kubenswrapper[5120]: I0316 15:57:11.849376 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f119fad7-2300-4ad7-9954-c7da2cd41f45" containerName="nova-api-log" Mar 16 15:57:11 crc kubenswrapper[5120]: I0316 15:57:11.849384 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="12829699-07a8-4cb4-8dbb-eb207c253f49" containerName="nova-metadata-log" Mar 16 15:57:11 crc kubenswrapper[5120]: I0316 15:57:11.849622 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2255b39a8caff9ac512ccfe165d5489e2e6318cd39c8c1030d873843f5760a02"} err="failed to get container status \"2255b39a8caff9ac512ccfe165d5489e2e6318cd39c8c1030d873843f5760a02\": rpc error: code = NotFound desc = could not find container \"2255b39a8caff9ac512ccfe165d5489e2e6318cd39c8c1030d873843f5760a02\": container with ID starting with 2255b39a8caff9ac512ccfe165d5489e2e6318cd39c8c1030d873843f5760a02 not found: ID does not exist" Mar 16 15:57:11 crc kubenswrapper[5120]: I0316 15:57:11.854388 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/12829699-07a8-4cb4-8dbb-eb207c253f49-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "12829699-07a8-4cb4-8dbb-eb207c253f49" (UID: "12829699-07a8-4cb4-8dbb-eb207c253f49"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:57:11 crc kubenswrapper[5120]: I0316 15:57:11.856277 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:57:11 crc kubenswrapper[5120]: I0316 15:57:11.856646 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/12829699-07a8-4cb4-8dbb-eb207c253f49-config-data" (OuterVolumeSpecName: "config-data") pod "12829699-07a8-4cb4-8dbb-eb207c253f49" (UID: "12829699-07a8-4cb4-8dbb-eb207c253f49"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:57:11 crc kubenswrapper[5120]: I0316 15:57:11.858548 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 15:57:11 crc kubenswrapper[5120]: I0316 15:57:11.862413 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-config-data\"" Mar 16 15:57:11 crc kubenswrapper[5120]: I0316 15:57:11.920843 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6t4r7\" (UniqueName: \"kubernetes.io/projected/5c7eb905-b64f-4cd5-89c8-15d11ae339f2-kube-api-access-6t4r7\") pod \"nova-api-0\" (UID: \"5c7eb905-b64f-4cd5-89c8-15d11ae339f2\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:57:11 crc kubenswrapper[5120]: I0316 15:57:11.921189 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5c7eb905-b64f-4cd5-89c8-15d11ae339f2-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"5c7eb905-b64f-4cd5-89c8-15d11ae339f2\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:57:11 crc kubenswrapper[5120]: I0316 15:57:11.921324 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5c7eb905-b64f-4cd5-89c8-15d11ae339f2-config-data\") pod \"nova-api-0\" (UID: \"5c7eb905-b64f-4cd5-89c8-15d11ae339f2\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:57:11 crc kubenswrapper[5120]: I0316 15:57:11.921396 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5c7eb905-b64f-4cd5-89c8-15d11ae339f2-logs\") pod \"nova-api-0\" (UID: \"5c7eb905-b64f-4cd5-89c8-15d11ae339f2\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:57:11 crc kubenswrapper[5120]: I0316 15:57:11.921519 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/12829699-07a8-4cb4-8dbb-eb207c253f49-logs\") on node \"crc\" DevicePath \"\"" Mar 16 15:57:11 crc kubenswrapper[5120]: I0316 15:57:11.921539 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/12829699-07a8-4cb4-8dbb-eb207c253f49-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 15:57:11 crc kubenswrapper[5120]: I0316 15:57:11.921550 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/12829699-07a8-4cb4-8dbb-eb207c253f49-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:57:11 crc kubenswrapper[5120]: I0316 15:57:11.921563 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rwjq5\" (UniqueName: \"kubernetes.io/projected/12829699-07a8-4cb4-8dbb-eb207c253f49-kube-api-access-rwjq5\") on node \"crc\" DevicePath \"\"" Mar 16 15:57:12 crc kubenswrapper[5120]: I0316 15:57:12.025177 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6t4r7\" (UniqueName: \"kubernetes.io/projected/5c7eb905-b64f-4cd5-89c8-15d11ae339f2-kube-api-access-6t4r7\") pod \"nova-api-0\" (UID: \"5c7eb905-b64f-4cd5-89c8-15d11ae339f2\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:57:12 crc kubenswrapper[5120]: I0316 15:57:12.027081 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5c7eb905-b64f-4cd5-89c8-15d11ae339f2-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"5c7eb905-b64f-4cd5-89c8-15d11ae339f2\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:57:12 crc kubenswrapper[5120]: I0316 15:57:12.027241 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5c7eb905-b64f-4cd5-89c8-15d11ae339f2-config-data\") pod \"nova-api-0\" (UID: \"5c7eb905-b64f-4cd5-89c8-15d11ae339f2\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:57:12 crc kubenswrapper[5120]: I0316 15:57:12.027362 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5c7eb905-b64f-4cd5-89c8-15d11ae339f2-logs\") pod \"nova-api-0\" (UID: \"5c7eb905-b64f-4cd5-89c8-15d11ae339f2\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:57:12 crc kubenswrapper[5120]: I0316 15:57:12.028059 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5c7eb905-b64f-4cd5-89c8-15d11ae339f2-logs\") pod \"nova-api-0\" (UID: \"5c7eb905-b64f-4cd5-89c8-15d11ae339f2\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:57:12 crc kubenswrapper[5120]: I0316 15:57:12.032463 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5c7eb905-b64f-4cd5-89c8-15d11ae339f2-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"5c7eb905-b64f-4cd5-89c8-15d11ae339f2\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:57:12 crc kubenswrapper[5120]: I0316 15:57:12.035587 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5c7eb905-b64f-4cd5-89c8-15d11ae339f2-config-data\") pod \"nova-api-0\" (UID: \"5c7eb905-b64f-4cd5-89c8-15d11ae339f2\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:57:12 crc kubenswrapper[5120]: I0316 15:57:12.042461 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6t4r7\" (UniqueName: \"kubernetes.io/projected/5c7eb905-b64f-4cd5-89c8-15d11ae339f2-kube-api-access-6t4r7\") pod \"nova-api-0\" (UID: \"5c7eb905-b64f-4cd5-89c8-15d11ae339f2\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:57:12 crc kubenswrapper[5120]: I0316 15:57:12.187636 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:57:12 crc kubenswrapper[5120]: E0316 15:57:12.479177 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 8d56dff3455e29f82e0859f8794ce8f2b45665ee473c44ad5a45bc744e314e18 is running failed: container process not found" containerID="8d56dff3455e29f82e0859f8794ce8f2b45665ee473c44ad5a45bc744e314e18" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 15:57:12 crc kubenswrapper[5120]: E0316 15:57:12.481153 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 8d56dff3455e29f82e0859f8794ce8f2b45665ee473c44ad5a45bc744e314e18 is running failed: container process not found" containerID="8d56dff3455e29f82e0859f8794ce8f2b45665ee473c44ad5a45bc744e314e18" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 15:57:12 crc kubenswrapper[5120]: E0316 15:57:12.481611 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 8d56dff3455e29f82e0859f8794ce8f2b45665ee473c44ad5a45bc744e314e18 is running failed: container process not found" containerID="8d56dff3455e29f82e0859f8794ce8f2b45665ee473c44ad5a45bc744e314e18" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 15:57:12 crc kubenswrapper[5120]: E0316 15:57:12.481646 5120 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 8d56dff3455e29f82e0859f8794ce8f2b45665ee473c44ad5a45bc744e314e18 is running failed: container process not found" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="1bb69667-1646-4d0c-91dd-dbd582031774" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 15:57:12 crc kubenswrapper[5120]: I0316 15:57:12.677834 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f119fad7-2300-4ad7-9954-c7da2cd41f45" path="/var/lib/kubelet/pods/f119fad7-2300-4ad7-9954-c7da2cd41f45/volumes" Mar 16 15:57:12 crc kubenswrapper[5120]: I0316 15:57:12.758803 5120 generic.go:358] "Generic (PLEG): container finished" podID="1bb69667-1646-4d0c-91dd-dbd582031774" containerID="8d56dff3455e29f82e0859f8794ce8f2b45665ee473c44ad5a45bc744e314e18" exitCode=0 Mar 16 15:57:12 crc kubenswrapper[5120]: I0316 15:57:12.758936 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:57:12 crc kubenswrapper[5120]: I0316 15:57:12.759740 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"1bb69667-1646-4d0c-91dd-dbd582031774","Type":"ContainerDied","Data":"8d56dff3455e29f82e0859f8794ce8f2b45665ee473c44ad5a45bc744e314e18"} Mar 16 15:57:12 crc kubenswrapper[5120]: I0316 15:57:12.759824 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"1bb69667-1646-4d0c-91dd-dbd582031774","Type":"ContainerDied","Data":"a38c497933defc4ee712e635296f7b776f74f09d7f8570a1a506088fd3a412f9"} Mar 16 15:57:12 crc kubenswrapper[5120]: I0316 15:57:12.759839 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a38c497933defc4ee712e635296f7b776f74f09d7f8570a1a506088fd3a412f9" Mar 16 15:57:12 crc kubenswrapper[5120]: I0316 15:57:12.802786 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 15:57:12 crc kubenswrapper[5120]: I0316 15:57:12.819095 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 15:57:12 crc kubenswrapper[5120]: I0316 15:57:12.833048 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 15:57:12 crc kubenswrapper[5120]: I0316 15:57:12.843797 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 15:57:12 crc kubenswrapper[5120]: I0316 15:57:12.856492 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 15:57:12 crc kubenswrapper[5120]: I0316 15:57:12.857894 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1bb69667-1646-4d0c-91dd-dbd582031774" containerName="nova-cell0-conductor-conductor" Mar 16 15:57:12 crc kubenswrapper[5120]: I0316 15:57:12.857912 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1bb69667-1646-4d0c-91dd-dbd582031774" containerName="nova-cell0-conductor-conductor" Mar 16 15:57:12 crc kubenswrapper[5120]: I0316 15:57:12.858169 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1bb69667-1646-4d0c-91dd-dbd582031774" containerName="nova-cell0-conductor-conductor" Mar 16 15:57:12 crc kubenswrapper[5120]: I0316 15:57:12.869265 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:57:12 crc kubenswrapper[5120]: I0316 15:57:12.871945 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-metadata-internal-svc\"" Mar 16 15:57:12 crc kubenswrapper[5120]: I0316 15:57:12.873096 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-metadata-config-data\"" Mar 16 15:57:12 crc kubenswrapper[5120]: I0316 15:57:12.888313 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 15:57:12 crc kubenswrapper[5120]: I0316 15:57:12.948123 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kxvr6\" (UniqueName: \"kubernetes.io/projected/1bb69667-1646-4d0c-91dd-dbd582031774-kube-api-access-kxvr6\") pod \"1bb69667-1646-4d0c-91dd-dbd582031774\" (UID: \"1bb69667-1646-4d0c-91dd-dbd582031774\") " Mar 16 15:57:12 crc kubenswrapper[5120]: I0316 15:57:12.948589 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1bb69667-1646-4d0c-91dd-dbd582031774-combined-ca-bundle\") pod \"1bb69667-1646-4d0c-91dd-dbd582031774\" (UID: \"1bb69667-1646-4d0c-91dd-dbd582031774\") " Mar 16 15:57:12 crc kubenswrapper[5120]: I0316 15:57:12.948677 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1bb69667-1646-4d0c-91dd-dbd582031774-config-data\") pod \"1bb69667-1646-4d0c-91dd-dbd582031774\" (UID: \"1bb69667-1646-4d0c-91dd-dbd582031774\") " Mar 16 15:57:12 crc kubenswrapper[5120]: I0316 15:57:12.948891 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/04104355-117f-484c-b549-8ea6cb950eac-logs\") pod \"nova-metadata-0\" (UID: \"04104355-117f-484c-b549-8ea6cb950eac\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:57:12 crc kubenswrapper[5120]: I0316 15:57:12.948978 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/04104355-117f-484c-b549-8ea6cb950eac-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"04104355-117f-484c-b549-8ea6cb950eac\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:57:12 crc kubenswrapper[5120]: I0316 15:57:12.949016 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xvtv\" (UniqueName: \"kubernetes.io/projected/04104355-117f-484c-b549-8ea6cb950eac-kube-api-access-2xvtv\") pod \"nova-metadata-0\" (UID: \"04104355-117f-484c-b549-8ea6cb950eac\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:57:12 crc kubenswrapper[5120]: I0316 15:57:12.949072 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/04104355-117f-484c-b549-8ea6cb950eac-config-data\") pod \"nova-metadata-0\" (UID: \"04104355-117f-484c-b549-8ea6cb950eac\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:57:12 crc kubenswrapper[5120]: I0316 15:57:12.949156 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/04104355-117f-484c-b549-8ea6cb950eac-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"04104355-117f-484c-b549-8ea6cb950eac\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:57:12 crc kubenswrapper[5120]: I0316 15:57:12.956024 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1bb69667-1646-4d0c-91dd-dbd582031774-kube-api-access-kxvr6" (OuterVolumeSpecName: "kube-api-access-kxvr6") pod "1bb69667-1646-4d0c-91dd-dbd582031774" (UID: "1bb69667-1646-4d0c-91dd-dbd582031774"). InnerVolumeSpecName "kube-api-access-kxvr6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:57:12 crc kubenswrapper[5120]: I0316 15:57:12.980793 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1bb69667-1646-4d0c-91dd-dbd582031774-config-data" (OuterVolumeSpecName: "config-data") pod "1bb69667-1646-4d0c-91dd-dbd582031774" (UID: "1bb69667-1646-4d0c-91dd-dbd582031774"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:57:12 crc kubenswrapper[5120]: I0316 15:57:12.995941 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1bb69667-1646-4d0c-91dd-dbd582031774-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "1bb69667-1646-4d0c-91dd-dbd582031774" (UID: "1bb69667-1646-4d0c-91dd-dbd582031774"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:57:13 crc kubenswrapper[5120]: I0316 15:57:13.051897 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/04104355-117f-484c-b549-8ea6cb950eac-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"04104355-117f-484c-b549-8ea6cb950eac\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:57:13 crc kubenswrapper[5120]: I0316 15:57:13.051957 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2xvtv\" (UniqueName: \"kubernetes.io/projected/04104355-117f-484c-b549-8ea6cb950eac-kube-api-access-2xvtv\") pod \"nova-metadata-0\" (UID: \"04104355-117f-484c-b549-8ea6cb950eac\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:57:13 crc kubenswrapper[5120]: I0316 15:57:13.052001 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/04104355-117f-484c-b549-8ea6cb950eac-config-data\") pod \"nova-metadata-0\" (UID: \"04104355-117f-484c-b549-8ea6cb950eac\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:57:13 crc kubenswrapper[5120]: I0316 15:57:13.052065 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/04104355-117f-484c-b549-8ea6cb950eac-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"04104355-117f-484c-b549-8ea6cb950eac\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:57:13 crc kubenswrapper[5120]: I0316 15:57:13.052129 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/04104355-117f-484c-b549-8ea6cb950eac-logs\") pod \"nova-metadata-0\" (UID: \"04104355-117f-484c-b549-8ea6cb950eac\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:57:13 crc kubenswrapper[5120]: I0316 15:57:13.052187 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1bb69667-1646-4d0c-91dd-dbd582031774-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:57:13 crc kubenswrapper[5120]: I0316 15:57:13.052197 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1bb69667-1646-4d0c-91dd-dbd582031774-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 15:57:13 crc kubenswrapper[5120]: I0316 15:57:13.052206 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kxvr6\" (UniqueName: \"kubernetes.io/projected/1bb69667-1646-4d0c-91dd-dbd582031774-kube-api-access-kxvr6\") on node \"crc\" DevicePath \"\"" Mar 16 15:57:13 crc kubenswrapper[5120]: I0316 15:57:13.052540 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/04104355-117f-484c-b549-8ea6cb950eac-logs\") pod \"nova-metadata-0\" (UID: \"04104355-117f-484c-b549-8ea6cb950eac\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:57:13 crc kubenswrapper[5120]: I0316 15:57:13.058337 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/04104355-117f-484c-b549-8ea6cb950eac-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"04104355-117f-484c-b549-8ea6cb950eac\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:57:13 crc kubenswrapper[5120]: I0316 15:57:13.058773 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/04104355-117f-484c-b549-8ea6cb950eac-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"04104355-117f-484c-b549-8ea6cb950eac\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:57:13 crc kubenswrapper[5120]: I0316 15:57:13.060159 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/04104355-117f-484c-b549-8ea6cb950eac-config-data\") pod \"nova-metadata-0\" (UID: \"04104355-117f-484c-b549-8ea6cb950eac\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:57:13 crc kubenswrapper[5120]: I0316 15:57:13.075360 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xvtv\" (UniqueName: \"kubernetes.io/projected/04104355-117f-484c-b549-8ea6cb950eac-kube-api-access-2xvtv\") pod \"nova-metadata-0\" (UID: \"04104355-117f-484c-b549-8ea6cb950eac\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:57:13 crc kubenswrapper[5120]: I0316 15:57:13.228588 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:57:13 crc kubenswrapper[5120]: I0316 15:57:13.667074 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 15:57:13 crc kubenswrapper[5120]: I0316 15:57:13.772606 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"5c7eb905-b64f-4cd5-89c8-15d11ae339f2","Type":"ContainerStarted","Data":"85125749653ae9bd34fcf895af5b75f6791e375284dcf34603dae24f439f1acf"} Mar 16 15:57:13 crc kubenswrapper[5120]: I0316 15:57:13.773093 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"5c7eb905-b64f-4cd5-89c8-15d11ae339f2","Type":"ContainerStarted","Data":"b7948f64b656f7615f084fd6015bea3e7e11d3a1660f842532254decfeea89e7"} Mar 16 15:57:13 crc kubenswrapper[5120]: I0316 15:57:13.773126 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"5c7eb905-b64f-4cd5-89c8-15d11ae339f2","Type":"ContainerStarted","Data":"01f797e4549970532d5ae05bbbe8102d3094bc73d7ff9098c82114ae485fed75"} Mar 16 15:57:13 crc kubenswrapper[5120]: I0316 15:57:13.774068 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"04104355-117f-484c-b549-8ea6cb950eac","Type":"ContainerStarted","Data":"1a7bdbd1ba540e9a1138f5483a49bc95e3cbb5b7bdcdc20c0563ba5cd01dd9f7"} Mar 16 15:57:13 crc kubenswrapper[5120]: I0316 15:57:13.774282 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 15:57:13 crc kubenswrapper[5120]: I0316 15:57:13.818023 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=2.818003667 podStartE2EDuration="2.818003667s" podCreationTimestamp="2026-03-16 15:57:11 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:57:13.803719192 +0000 UTC m=+1535.957650869" watchObservedRunningTime="2026-03-16 15:57:13.818003667 +0000 UTC m=+1535.971935314" Mar 16 15:57:13 crc kubenswrapper[5120]: I0316 15:57:13.824906 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 15:57:13 crc kubenswrapper[5120]: I0316 15:57:13.845660 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 15:57:13 crc kubenswrapper[5120]: I0316 15:57:13.855060 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 15:57:13 crc kubenswrapper[5120]: I0316 15:57:13.861671 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 15:57:13 crc kubenswrapper[5120]: I0316 15:57:13.873568 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-conductor-config-data\"" Mar 16 15:57:13 crc kubenswrapper[5120]: I0316 15:57:13.883263 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 15:57:13 crc kubenswrapper[5120]: I0316 15:57:13.892187 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 15:57:13 crc kubenswrapper[5120]: I0316 15:57:13.971565 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5da6e8f8-fa80-477a-bbf9-0e251dd24153-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"5da6e8f8-fa80-477a-bbf9-0e251dd24153\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 15:57:13 crc kubenswrapper[5120]: I0316 15:57:13.971668 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5da6e8f8-fa80-477a-bbf9-0e251dd24153-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"5da6e8f8-fa80-477a-bbf9-0e251dd24153\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 15:57:13 crc kubenswrapper[5120]: I0316 15:57:13.971774 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gbdv\" (UniqueName: \"kubernetes.io/projected/5da6e8f8-fa80-477a-bbf9-0e251dd24153-kube-api-access-9gbdv\") pod \"nova-cell0-conductor-0\" (UID: \"5da6e8f8-fa80-477a-bbf9-0e251dd24153\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 15:57:14 crc kubenswrapper[5120]: I0316 15:57:14.073930 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5da6e8f8-fa80-477a-bbf9-0e251dd24153-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"5da6e8f8-fa80-477a-bbf9-0e251dd24153\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 15:57:14 crc kubenswrapper[5120]: I0316 15:57:14.074026 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9gbdv\" (UniqueName: \"kubernetes.io/projected/5da6e8f8-fa80-477a-bbf9-0e251dd24153-kube-api-access-9gbdv\") pod \"nova-cell0-conductor-0\" (UID: \"5da6e8f8-fa80-477a-bbf9-0e251dd24153\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 15:57:14 crc kubenswrapper[5120]: I0316 15:57:14.074121 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5da6e8f8-fa80-477a-bbf9-0e251dd24153-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"5da6e8f8-fa80-477a-bbf9-0e251dd24153\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 15:57:14 crc kubenswrapper[5120]: I0316 15:57:14.080724 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5da6e8f8-fa80-477a-bbf9-0e251dd24153-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"5da6e8f8-fa80-477a-bbf9-0e251dd24153\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 15:57:14 crc kubenswrapper[5120]: I0316 15:57:14.081376 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5da6e8f8-fa80-477a-bbf9-0e251dd24153-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"5da6e8f8-fa80-477a-bbf9-0e251dd24153\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 15:57:14 crc kubenswrapper[5120]: I0316 15:57:14.083904 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 15:57:14 crc kubenswrapper[5120]: I0316 15:57:14.089334 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gbdv\" (UniqueName: \"kubernetes.io/projected/5da6e8f8-fa80-477a-bbf9-0e251dd24153-kube-api-access-9gbdv\") pod \"nova-cell0-conductor-0\" (UID: \"5da6e8f8-fa80-477a-bbf9-0e251dd24153\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 15:57:14 crc kubenswrapper[5120]: I0316 15:57:14.188445 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 15:57:14 crc kubenswrapper[5120]: I0316 15:57:14.228142 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 15:57:14 crc kubenswrapper[5120]: I0316 15:57:14.228656 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="0a49327a-b187-4793-80dc-d57ce84bb993" containerName="ceilometer-central-agent" containerID="cri-o://5b7d287214fe7c5e9f3a33ceea3e5e88f0b681e1d9cceda1238ba057b32f9c0c" gracePeriod=30 Mar 16 15:57:14 crc kubenswrapper[5120]: I0316 15:57:14.228886 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="0a49327a-b187-4793-80dc-d57ce84bb993" containerName="proxy-httpd" containerID="cri-o://eb2f17bbe26b394561d063352949d7ec4f60b3ef1517cc2cd0bf1a399f596bfa" gracePeriod=30 Mar 16 15:57:14 crc kubenswrapper[5120]: I0316 15:57:14.228957 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="0a49327a-b187-4793-80dc-d57ce84bb993" containerName="sg-core" containerID="cri-o://5f7313a571b11bb2a5a90493aba0d54b505a157c6f7e5a0a45c43bd881728a96" gracePeriod=30 Mar 16 15:57:14 crc kubenswrapper[5120]: I0316 15:57:14.229015 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="0a49327a-b187-4793-80dc-d57ce84bb993" containerName="ceilometer-notification-agent" containerID="cri-o://c1f68a7963d487e4799cfcd4a1f336d9c53667254286c7d654c9614823d81a2c" gracePeriod=30 Mar 16 15:57:14 crc kubenswrapper[5120]: E0316 15:57:14.482139 5120 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0a49327a_b187_4793_80dc_d57ce84bb993.slice/crio-5f7313a571b11bb2a5a90493aba0d54b505a157c6f7e5a0a45c43bd881728a96.scope\": RecentStats: unable to find data in memory cache]" Mar 16 15:57:14 crc kubenswrapper[5120]: I0316 15:57:14.690861 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="12829699-07a8-4cb4-8dbb-eb207c253f49" path="/var/lib/kubelet/pods/12829699-07a8-4cb4-8dbb-eb207c253f49/volumes" Mar 16 15:57:14 crc kubenswrapper[5120]: I0316 15:57:14.691560 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1bb69667-1646-4d0c-91dd-dbd582031774" path="/var/lib/kubelet/pods/1bb69667-1646-4d0c-91dd-dbd582031774/volumes" Mar 16 15:57:14 crc kubenswrapper[5120]: I0316 15:57:14.751911 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 15:57:14 crc kubenswrapper[5120]: W0316 15:57:14.762470 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5da6e8f8_fa80_477a_bbf9_0e251dd24153.slice/crio-66cc4a47321d684a121dcfda9bb2b5ae3c0cc1f88024228e2f127d0c75b955a6 WatchSource:0}: Error finding container 66cc4a47321d684a121dcfda9bb2b5ae3c0cc1f88024228e2f127d0c75b955a6: Status 404 returned error can't find the container with id 66cc4a47321d684a121dcfda9bb2b5ae3c0cc1f88024228e2f127d0c75b955a6 Mar 16 15:57:14 crc kubenswrapper[5120]: I0316 15:57:14.786292 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"5da6e8f8-fa80-477a-bbf9-0e251dd24153","Type":"ContainerStarted","Data":"66cc4a47321d684a121dcfda9bb2b5ae3c0cc1f88024228e2f127d0c75b955a6"} Mar 16 15:57:14 crc kubenswrapper[5120]: I0316 15:57:14.789459 5120 generic.go:358] "Generic (PLEG): container finished" podID="0747eaf7-a464-4360-bf02-c8e9a9be90fa" containerID="383af44933828e287b95b36f80d5514e2447d0cba7ad37a2d0b63229052a043d" exitCode=0 Mar 16 15:57:14 crc kubenswrapper[5120]: I0316 15:57:14.789535 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-np2mc" event={"ID":"0747eaf7-a464-4360-bf02-c8e9a9be90fa","Type":"ContainerDied","Data":"383af44933828e287b95b36f80d5514e2447d0cba7ad37a2d0b63229052a043d"} Mar 16 15:57:14 crc kubenswrapper[5120]: I0316 15:57:14.797873 5120 generic.go:358] "Generic (PLEG): container finished" podID="0a49327a-b187-4793-80dc-d57ce84bb993" containerID="eb2f17bbe26b394561d063352949d7ec4f60b3ef1517cc2cd0bf1a399f596bfa" exitCode=0 Mar 16 15:57:14 crc kubenswrapper[5120]: I0316 15:57:14.797899 5120 generic.go:358] "Generic (PLEG): container finished" podID="0a49327a-b187-4793-80dc-d57ce84bb993" containerID="5f7313a571b11bb2a5a90493aba0d54b505a157c6f7e5a0a45c43bd881728a96" exitCode=2 Mar 16 15:57:14 crc kubenswrapper[5120]: I0316 15:57:14.797906 5120 generic.go:358] "Generic (PLEG): container finished" podID="0a49327a-b187-4793-80dc-d57ce84bb993" containerID="c1f68a7963d487e4799cfcd4a1f336d9c53667254286c7d654c9614823d81a2c" exitCode=0 Mar 16 15:57:14 crc kubenswrapper[5120]: I0316 15:57:14.797985 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"0a49327a-b187-4793-80dc-d57ce84bb993","Type":"ContainerDied","Data":"eb2f17bbe26b394561d063352949d7ec4f60b3ef1517cc2cd0bf1a399f596bfa"} Mar 16 15:57:14 crc kubenswrapper[5120]: I0316 15:57:14.798004 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"0a49327a-b187-4793-80dc-d57ce84bb993","Type":"ContainerDied","Data":"5f7313a571b11bb2a5a90493aba0d54b505a157c6f7e5a0a45c43bd881728a96"} Mar 16 15:57:14 crc kubenswrapper[5120]: I0316 15:57:14.798028 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"0a49327a-b187-4793-80dc-d57ce84bb993","Type":"ContainerDied","Data":"c1f68a7963d487e4799cfcd4a1f336d9c53667254286c7d654c9614823d81a2c"} Mar 16 15:57:14 crc kubenswrapper[5120]: I0316 15:57:14.800780 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"04104355-117f-484c-b549-8ea6cb950eac","Type":"ContainerStarted","Data":"adc0cf09990f43d47ffbaf7374befaf5385ddb20a6738e37d2bb8a82da650e06"} Mar 16 15:57:14 crc kubenswrapper[5120]: I0316 15:57:14.800803 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"04104355-117f-484c-b549-8ea6cb950eac","Type":"ContainerStarted","Data":"216b325c919b5dbedf7e887bcbf226e6a7ded18b0295e823a7d9e145a6ff6de9"} Mar 16 15:57:14 crc kubenswrapper[5120]: I0316 15:57:14.839708 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=2.839685055 podStartE2EDuration="2.839685055s" podCreationTimestamp="2026-03-16 15:57:12 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:57:14.822671254 +0000 UTC m=+1536.976602931" watchObservedRunningTime="2026-03-16 15:57:14.839685055 +0000 UTC m=+1536.993616702" Mar 16 15:57:15 crc kubenswrapper[5120]: I0316 15:57:15.813251 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"5da6e8f8-fa80-477a-bbf9-0e251dd24153","Type":"ContainerStarted","Data":"b69196aca7077e660b738179840f4cffce2c72a012a2f8f0a16939792591c08e"} Mar 16 15:57:15 crc kubenswrapper[5120]: I0316 15:57:15.813488 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 15:57:15 crc kubenswrapper[5120]: I0316 15:57:15.818819 5120 generic.go:358] "Generic (PLEG): container finished" podID="3f138acc-5d5b-4b31-ada9-a7943b9ed432" containerID="be08c6b31ab15bb00fdbf4925e690530157d077f8bd4226fabd3e129d5a8e362" exitCode=0 Mar 16 15:57:15 crc kubenswrapper[5120]: I0316 15:57:15.818857 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-57kth" event={"ID":"3f138acc-5d5b-4b31-ada9-a7943b9ed432","Type":"ContainerDied","Data":"be08c6b31ab15bb00fdbf4925e690530157d077f8bd4226fabd3e129d5a8e362"} Mar 16 15:57:15 crc kubenswrapper[5120]: I0316 15:57:15.855108 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podStartSLOduration=2.855090099 podStartE2EDuration="2.855090099s" podCreationTimestamp="2026-03-16 15:57:13 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:57:15.833017708 +0000 UTC m=+1537.986949375" watchObservedRunningTime="2026-03-16 15:57:15.855090099 +0000 UTC m=+1538.009021756" Mar 16 15:57:16 crc kubenswrapper[5120]: I0316 15:57:16.279458 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-np2mc" Mar 16 15:57:16 crc kubenswrapper[5120]: I0316 15:57:16.434836 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0747eaf7-a464-4360-bf02-c8e9a9be90fa-combined-ca-bundle\") pod \"0747eaf7-a464-4360-bf02-c8e9a9be90fa\" (UID: \"0747eaf7-a464-4360-bf02-c8e9a9be90fa\") " Mar 16 15:57:16 crc kubenswrapper[5120]: I0316 15:57:16.434908 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0747eaf7-a464-4360-bf02-c8e9a9be90fa-config-data\") pod \"0747eaf7-a464-4360-bf02-c8e9a9be90fa\" (UID: \"0747eaf7-a464-4360-bf02-c8e9a9be90fa\") " Mar 16 15:57:16 crc kubenswrapper[5120]: I0316 15:57:16.435082 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mf6fk\" (UniqueName: \"kubernetes.io/projected/0747eaf7-a464-4360-bf02-c8e9a9be90fa-kube-api-access-mf6fk\") pod \"0747eaf7-a464-4360-bf02-c8e9a9be90fa\" (UID: \"0747eaf7-a464-4360-bf02-c8e9a9be90fa\") " Mar 16 15:57:16 crc kubenswrapper[5120]: I0316 15:57:16.435201 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0747eaf7-a464-4360-bf02-c8e9a9be90fa-scripts\") pod \"0747eaf7-a464-4360-bf02-c8e9a9be90fa\" (UID: \"0747eaf7-a464-4360-bf02-c8e9a9be90fa\") " Mar 16 15:57:16 crc kubenswrapper[5120]: I0316 15:57:16.440965 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0747eaf7-a464-4360-bf02-c8e9a9be90fa-scripts" (OuterVolumeSpecName: "scripts") pod "0747eaf7-a464-4360-bf02-c8e9a9be90fa" (UID: "0747eaf7-a464-4360-bf02-c8e9a9be90fa"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:57:16 crc kubenswrapper[5120]: I0316 15:57:16.441042 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0747eaf7-a464-4360-bf02-c8e9a9be90fa-kube-api-access-mf6fk" (OuterVolumeSpecName: "kube-api-access-mf6fk") pod "0747eaf7-a464-4360-bf02-c8e9a9be90fa" (UID: "0747eaf7-a464-4360-bf02-c8e9a9be90fa"). InnerVolumeSpecName "kube-api-access-mf6fk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:57:16 crc kubenswrapper[5120]: I0316 15:57:16.471899 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0747eaf7-a464-4360-bf02-c8e9a9be90fa-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "0747eaf7-a464-4360-bf02-c8e9a9be90fa" (UID: "0747eaf7-a464-4360-bf02-c8e9a9be90fa"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:57:16 crc kubenswrapper[5120]: I0316 15:57:16.483337 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0747eaf7-a464-4360-bf02-c8e9a9be90fa-config-data" (OuterVolumeSpecName: "config-data") pod "0747eaf7-a464-4360-bf02-c8e9a9be90fa" (UID: "0747eaf7-a464-4360-bf02-c8e9a9be90fa"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:57:16 crc kubenswrapper[5120]: I0316 15:57:16.538126 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0747eaf7-a464-4360-bf02-c8e9a9be90fa-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:57:16 crc kubenswrapper[5120]: I0316 15:57:16.538162 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0747eaf7-a464-4360-bf02-c8e9a9be90fa-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 15:57:16 crc kubenswrapper[5120]: I0316 15:57:16.538175 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mf6fk\" (UniqueName: \"kubernetes.io/projected/0747eaf7-a464-4360-bf02-c8e9a9be90fa-kube-api-access-mf6fk\") on node \"crc\" DevicePath \"\"" Mar 16 15:57:16 crc kubenswrapper[5120]: I0316 15:57:16.538189 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0747eaf7-a464-4360-bf02-c8e9a9be90fa-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 15:57:16 crc kubenswrapper[5120]: I0316 15:57:16.837127 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-np2mc" Mar 16 15:57:16 crc kubenswrapper[5120]: I0316 15:57:16.837830 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-np2mc" event={"ID":"0747eaf7-a464-4360-bf02-c8e9a9be90fa","Type":"ContainerDied","Data":"4d38f864a8357520679c5b4bb1d0eedfb8f4d19f84bbd4f0118793daeb1db6f5"} Mar 16 15:57:16 crc kubenswrapper[5120]: I0316 15:57:16.837996 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4d38f864a8357520679c5b4bb1d0eedfb8f4d19f84bbd4f0118793daeb1db6f5" Mar 16 15:57:16 crc kubenswrapper[5120]: I0316 15:57:16.903586 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 15:57:16 crc kubenswrapper[5120]: I0316 15:57:16.905219 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0747eaf7-a464-4360-bf02-c8e9a9be90fa" containerName="nova-cell1-conductor-db-sync" Mar 16 15:57:16 crc kubenswrapper[5120]: I0316 15:57:16.905249 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="0747eaf7-a464-4360-bf02-c8e9a9be90fa" containerName="nova-cell1-conductor-db-sync" Mar 16 15:57:16 crc kubenswrapper[5120]: I0316 15:57:16.905479 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="0747eaf7-a464-4360-bf02-c8e9a9be90fa" containerName="nova-cell1-conductor-db-sync" Mar 16 15:57:16 crc kubenswrapper[5120]: I0316 15:57:16.917685 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 15:57:16 crc kubenswrapper[5120]: I0316 15:57:16.922288 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-conductor-config-data\"" Mar 16 15:57:16 crc kubenswrapper[5120]: I0316 15:57:16.935257 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 15:57:17 crc kubenswrapper[5120]: I0316 15:57:17.048188 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jc7j\" (UniqueName: \"kubernetes.io/projected/63972b06-4c5e-40e4-a318-8e5f3e286ece-kube-api-access-7jc7j\") pod \"nova-cell1-conductor-0\" (UID: \"63972b06-4c5e-40e4-a318-8e5f3e286ece\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 15:57:17 crc kubenswrapper[5120]: I0316 15:57:17.048356 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/63972b06-4c5e-40e4-a318-8e5f3e286ece-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"63972b06-4c5e-40e4-a318-8e5f3e286ece\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 15:57:17 crc kubenswrapper[5120]: I0316 15:57:17.048403 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/63972b06-4c5e-40e4-a318-8e5f3e286ece-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"63972b06-4c5e-40e4-a318-8e5f3e286ece\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 15:57:17 crc kubenswrapper[5120]: I0316 15:57:17.150215 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/63972b06-4c5e-40e4-a318-8e5f3e286ece-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"63972b06-4c5e-40e4-a318-8e5f3e286ece\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 15:57:17 crc kubenswrapper[5120]: I0316 15:57:17.150605 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/63972b06-4c5e-40e4-a318-8e5f3e286ece-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"63972b06-4c5e-40e4-a318-8e5f3e286ece\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 15:57:17 crc kubenswrapper[5120]: I0316 15:57:17.150744 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7jc7j\" (UniqueName: \"kubernetes.io/projected/63972b06-4c5e-40e4-a318-8e5f3e286ece-kube-api-access-7jc7j\") pod \"nova-cell1-conductor-0\" (UID: \"63972b06-4c5e-40e4-a318-8e5f3e286ece\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 15:57:17 crc kubenswrapper[5120]: I0316 15:57:17.170466 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/63972b06-4c5e-40e4-a318-8e5f3e286ece-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"63972b06-4c5e-40e4-a318-8e5f3e286ece\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 15:57:17 crc kubenswrapper[5120]: I0316 15:57:17.180369 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/63972b06-4c5e-40e4-a318-8e5f3e286ece-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"63972b06-4c5e-40e4-a318-8e5f3e286ece\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 15:57:17 crc kubenswrapper[5120]: I0316 15:57:17.187370 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jc7j\" (UniqueName: \"kubernetes.io/projected/63972b06-4c5e-40e4-a318-8e5f3e286ece-kube-api-access-7jc7j\") pod \"nova-cell1-conductor-0\" (UID: \"63972b06-4c5e-40e4-a318-8e5f3e286ece\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 15:57:17 crc kubenswrapper[5120]: I0316 15:57:17.247053 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 15:57:17 crc kubenswrapper[5120]: I0316 15:57:17.333807 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-57kth" Mar 16 15:57:17 crc kubenswrapper[5120]: I0316 15:57:17.462832 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3f138acc-5d5b-4b31-ada9-a7943b9ed432-combined-ca-bundle\") pod \"3f138acc-5d5b-4b31-ada9-a7943b9ed432\" (UID: \"3f138acc-5d5b-4b31-ada9-a7943b9ed432\") " Mar 16 15:57:17 crc kubenswrapper[5120]: I0316 15:57:17.463161 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3f138acc-5d5b-4b31-ada9-a7943b9ed432-scripts\") pod \"3f138acc-5d5b-4b31-ada9-a7943b9ed432\" (UID: \"3f138acc-5d5b-4b31-ada9-a7943b9ed432\") " Mar 16 15:57:17 crc kubenswrapper[5120]: I0316 15:57:17.463376 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z87c6\" (UniqueName: \"kubernetes.io/projected/3f138acc-5d5b-4b31-ada9-a7943b9ed432-kube-api-access-z87c6\") pod \"3f138acc-5d5b-4b31-ada9-a7943b9ed432\" (UID: \"3f138acc-5d5b-4b31-ada9-a7943b9ed432\") " Mar 16 15:57:17 crc kubenswrapper[5120]: I0316 15:57:17.463482 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3f138acc-5d5b-4b31-ada9-a7943b9ed432-config-data\") pod \"3f138acc-5d5b-4b31-ada9-a7943b9ed432\" (UID: \"3f138acc-5d5b-4b31-ada9-a7943b9ed432\") " Mar 16 15:57:17 crc kubenswrapper[5120]: I0316 15:57:17.470330 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f138acc-5d5b-4b31-ada9-a7943b9ed432-kube-api-access-z87c6" (OuterVolumeSpecName: "kube-api-access-z87c6") pod "3f138acc-5d5b-4b31-ada9-a7943b9ed432" (UID: "3f138acc-5d5b-4b31-ada9-a7943b9ed432"). InnerVolumeSpecName "kube-api-access-z87c6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:57:17 crc kubenswrapper[5120]: I0316 15:57:17.473939 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f138acc-5d5b-4b31-ada9-a7943b9ed432-scripts" (OuterVolumeSpecName: "scripts") pod "3f138acc-5d5b-4b31-ada9-a7943b9ed432" (UID: "3f138acc-5d5b-4b31-ada9-a7943b9ed432"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:57:17 crc kubenswrapper[5120]: I0316 15:57:17.492370 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f138acc-5d5b-4b31-ada9-a7943b9ed432-config-data" (OuterVolumeSpecName: "config-data") pod "3f138acc-5d5b-4b31-ada9-a7943b9ed432" (UID: "3f138acc-5d5b-4b31-ada9-a7943b9ed432"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:57:17 crc kubenswrapper[5120]: I0316 15:57:17.512014 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f138acc-5d5b-4b31-ada9-a7943b9ed432-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "3f138acc-5d5b-4b31-ada9-a7943b9ed432" (UID: "3f138acc-5d5b-4b31-ada9-a7943b9ed432"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:57:17 crc kubenswrapper[5120]: I0316 15:57:17.565986 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z87c6\" (UniqueName: \"kubernetes.io/projected/3f138acc-5d5b-4b31-ada9-a7943b9ed432-kube-api-access-z87c6\") on node \"crc\" DevicePath \"\"" Mar 16 15:57:17 crc kubenswrapper[5120]: I0316 15:57:17.566020 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3f138acc-5d5b-4b31-ada9-a7943b9ed432-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 15:57:17 crc kubenswrapper[5120]: I0316 15:57:17.566031 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3f138acc-5d5b-4b31-ada9-a7943b9ed432-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:57:17 crc kubenswrapper[5120]: I0316 15:57:17.566039 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3f138acc-5d5b-4b31-ada9-a7943b9ed432-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 15:57:17 crc kubenswrapper[5120]: W0316 15:57:17.696693 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod63972b06_4c5e_40e4_a318_8e5f3e286ece.slice/crio-ff0294885b0b68549560389cf6a2abd98828a684c6f7de6a3cb631ed61a4974a WatchSource:0}: Error finding container ff0294885b0b68549560389cf6a2abd98828a684c6f7de6a3cb631ed61a4974a: Status 404 returned error can't find the container with id ff0294885b0b68549560389cf6a2abd98828a684c6f7de6a3cb631ed61a4974a Mar 16 15:57:17 crc kubenswrapper[5120]: I0316 15:57:17.697973 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 15:57:17 crc kubenswrapper[5120]: I0316 15:57:17.867930 5120 generic.go:358] "Generic (PLEG): container finished" podID="0a49327a-b187-4793-80dc-d57ce84bb993" containerID="5b7d287214fe7c5e9f3a33ceea3e5e88f0b681e1d9cceda1238ba057b32f9c0c" exitCode=0 Mar 16 15:57:17 crc kubenswrapper[5120]: I0316 15:57:17.868053 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"0a49327a-b187-4793-80dc-d57ce84bb993","Type":"ContainerDied","Data":"5b7d287214fe7c5e9f3a33ceea3e5e88f0b681e1d9cceda1238ba057b32f9c0c"} Mar 16 15:57:17 crc kubenswrapper[5120]: I0316 15:57:17.878658 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-57kth" event={"ID":"3f138acc-5d5b-4b31-ada9-a7943b9ed432","Type":"ContainerDied","Data":"fa1b4262d9d3b9b50a4558704e0c83000484049bf06f5885987a476f5a72d6c4"} Mar 16 15:57:17 crc kubenswrapper[5120]: I0316 15:57:17.878714 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fa1b4262d9d3b9b50a4558704e0c83000484049bf06f5885987a476f5a72d6c4" Mar 16 15:57:17 crc kubenswrapper[5120]: I0316 15:57:17.878836 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-57kth" Mar 16 15:57:17 crc kubenswrapper[5120]: I0316 15:57:17.893799 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"63972b06-4c5e-40e4-a318-8e5f3e286ece","Type":"ContainerStarted","Data":"ff0294885b0b68549560389cf6a2abd98828a684c6f7de6a3cb631ed61a4974a"} Mar 16 15:57:18 crc kubenswrapper[5120]: I0316 15:57:18.131962 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:57:18 crc kubenswrapper[5120]: I0316 15:57:18.282564 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0a49327a-b187-4793-80dc-d57ce84bb993-config-data\") pod \"0a49327a-b187-4793-80dc-d57ce84bb993\" (UID: \"0a49327a-b187-4793-80dc-d57ce84bb993\") " Mar 16 15:57:18 crc kubenswrapper[5120]: I0316 15:57:18.282972 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0a49327a-b187-4793-80dc-d57ce84bb993-combined-ca-bundle\") pod \"0a49327a-b187-4793-80dc-d57ce84bb993\" (UID: \"0a49327a-b187-4793-80dc-d57ce84bb993\") " Mar 16 15:57:18 crc kubenswrapper[5120]: I0316 15:57:18.283073 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/0a49327a-b187-4793-80dc-d57ce84bb993-sg-core-conf-yaml\") pod \"0a49327a-b187-4793-80dc-d57ce84bb993\" (UID: \"0a49327a-b187-4793-80dc-d57ce84bb993\") " Mar 16 15:57:18 crc kubenswrapper[5120]: I0316 15:57:18.283180 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0a49327a-b187-4793-80dc-d57ce84bb993-log-httpd\") pod \"0a49327a-b187-4793-80dc-d57ce84bb993\" (UID: \"0a49327a-b187-4793-80dc-d57ce84bb993\") " Mar 16 15:57:18 crc kubenswrapper[5120]: I0316 15:57:18.283397 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0a49327a-b187-4793-80dc-d57ce84bb993-scripts\") pod \"0a49327a-b187-4793-80dc-d57ce84bb993\" (UID: \"0a49327a-b187-4793-80dc-d57ce84bb993\") " Mar 16 15:57:18 crc kubenswrapper[5120]: I0316 15:57:18.283597 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0a49327a-b187-4793-80dc-d57ce84bb993-run-httpd\") pod \"0a49327a-b187-4793-80dc-d57ce84bb993\" (UID: \"0a49327a-b187-4793-80dc-d57ce84bb993\") " Mar 16 15:57:18 crc kubenswrapper[5120]: I0316 15:57:18.283808 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hsj7q\" (UniqueName: \"kubernetes.io/projected/0a49327a-b187-4793-80dc-d57ce84bb993-kube-api-access-hsj7q\") pod \"0a49327a-b187-4793-80dc-d57ce84bb993\" (UID: \"0a49327a-b187-4793-80dc-d57ce84bb993\") " Mar 16 15:57:18 crc kubenswrapper[5120]: I0316 15:57:18.286461 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a49327a-b187-4793-80dc-d57ce84bb993-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "0a49327a-b187-4793-80dc-d57ce84bb993" (UID: "0a49327a-b187-4793-80dc-d57ce84bb993"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:57:18 crc kubenswrapper[5120]: I0316 15:57:18.287253 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a49327a-b187-4793-80dc-d57ce84bb993-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "0a49327a-b187-4793-80dc-d57ce84bb993" (UID: "0a49327a-b187-4793-80dc-d57ce84bb993"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:57:18 crc kubenswrapper[5120]: I0316 15:57:18.290277 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a49327a-b187-4793-80dc-d57ce84bb993-kube-api-access-hsj7q" (OuterVolumeSpecName: "kube-api-access-hsj7q") pod "0a49327a-b187-4793-80dc-d57ce84bb993" (UID: "0a49327a-b187-4793-80dc-d57ce84bb993"). InnerVolumeSpecName "kube-api-access-hsj7q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:57:18 crc kubenswrapper[5120]: I0316 15:57:18.292057 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a49327a-b187-4793-80dc-d57ce84bb993-scripts" (OuterVolumeSpecName: "scripts") pod "0a49327a-b187-4793-80dc-d57ce84bb993" (UID: "0a49327a-b187-4793-80dc-d57ce84bb993"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:57:18 crc kubenswrapper[5120]: I0316 15:57:18.327520 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a49327a-b187-4793-80dc-d57ce84bb993-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "0a49327a-b187-4793-80dc-d57ce84bb993" (UID: "0a49327a-b187-4793-80dc-d57ce84bb993"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:57:18 crc kubenswrapper[5120]: I0316 15:57:18.382050 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a49327a-b187-4793-80dc-d57ce84bb993-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "0a49327a-b187-4793-80dc-d57ce84bb993" (UID: "0a49327a-b187-4793-80dc-d57ce84bb993"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:57:18 crc kubenswrapper[5120]: I0316 15:57:18.387028 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0a49327a-b187-4793-80dc-d57ce84bb993-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 15:57:18 crc kubenswrapper[5120]: I0316 15:57:18.387212 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hsj7q\" (UniqueName: \"kubernetes.io/projected/0a49327a-b187-4793-80dc-d57ce84bb993-kube-api-access-hsj7q\") on node \"crc\" DevicePath \"\"" Mar 16 15:57:18 crc kubenswrapper[5120]: I0316 15:57:18.387312 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0a49327a-b187-4793-80dc-d57ce84bb993-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:57:18 crc kubenswrapper[5120]: I0316 15:57:18.387430 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/0a49327a-b187-4793-80dc-d57ce84bb993-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 15:57:18 crc kubenswrapper[5120]: I0316 15:57:18.387513 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0a49327a-b187-4793-80dc-d57ce84bb993-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 15:57:18 crc kubenswrapper[5120]: I0316 15:57:18.387587 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0a49327a-b187-4793-80dc-d57ce84bb993-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 15:57:18 crc kubenswrapper[5120]: I0316 15:57:18.416286 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a49327a-b187-4793-80dc-d57ce84bb993-config-data" (OuterVolumeSpecName: "config-data") pod "0a49327a-b187-4793-80dc-d57ce84bb993" (UID: "0a49327a-b187-4793-80dc-d57ce84bb993"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:57:18 crc kubenswrapper[5120]: I0316 15:57:18.490341 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0a49327a-b187-4793-80dc-d57ce84bb993-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 15:57:18 crc kubenswrapper[5120]: I0316 15:57:18.906645 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"0a49327a-b187-4793-80dc-d57ce84bb993","Type":"ContainerDied","Data":"c3095e51410c15b78d44968ee5aca7739412be381e08fe5adda48c78104289bc"} Mar 16 15:57:18 crc kubenswrapper[5120]: I0316 15:57:18.906707 5120 scope.go:117] "RemoveContainer" containerID="eb2f17bbe26b394561d063352949d7ec4f60b3ef1517cc2cd0bf1a399f596bfa" Mar 16 15:57:18 crc kubenswrapper[5120]: I0316 15:57:18.907711 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:57:18 crc kubenswrapper[5120]: I0316 15:57:18.909977 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"63972b06-4c5e-40e4-a318-8e5f3e286ece","Type":"ContainerStarted","Data":"6b9d4e9dc1d3160e9abb2e9af3ed540f0c1e83d09c814ee53e6dfb172f8914f5"} Mar 16 15:57:18 crc kubenswrapper[5120]: I0316 15:57:18.910273 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 15:57:18 crc kubenswrapper[5120]: I0316 15:57:18.939527 5120 scope.go:117] "RemoveContainer" containerID="5f7313a571b11bb2a5a90493aba0d54b505a157c6f7e5a0a45c43bd881728a96" Mar 16 15:57:18 crc kubenswrapper[5120]: I0316 15:57:18.977081 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 15:57:18 crc kubenswrapper[5120]: I0316 15:57:18.980028 5120 scope.go:117] "RemoveContainer" containerID="c1f68a7963d487e4799cfcd4a1f336d9c53667254286c7d654c9614823d81a2c" Mar 16 15:57:19 crc kubenswrapper[5120]: I0316 15:57:18.997099 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 15:57:19 crc kubenswrapper[5120]: I0316 15:57:19.007859 5120 scope.go:117] "RemoveContainer" containerID="5b7d287214fe7c5e9f3a33ceea3e5e88f0b681e1d9cceda1238ba057b32f9c0c" Mar 16 15:57:19 crc kubenswrapper[5120]: I0316 15:57:19.010625 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podStartSLOduration=3.01061414 podStartE2EDuration="3.01061414s" podCreationTimestamp="2026-03-16 15:57:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:57:18.985998508 +0000 UTC m=+1541.139930205" watchObservedRunningTime="2026-03-16 15:57:19.01061414 +0000 UTC m=+1541.164545797" Mar 16 15:57:19 crc kubenswrapper[5120]: I0316 15:57:19.013053 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 15:57:19 crc kubenswrapper[5120]: I0316 15:57:19.013903 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f138acc-5d5b-4b31-ada9-a7943b9ed432" containerName="nova-manage" Mar 16 15:57:19 crc kubenswrapper[5120]: I0316 15:57:19.013914 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f138acc-5d5b-4b31-ada9-a7943b9ed432" containerName="nova-manage" Mar 16 15:57:19 crc kubenswrapper[5120]: I0316 15:57:19.013928 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a49327a-b187-4793-80dc-d57ce84bb993" containerName="ceilometer-notification-agent" Mar 16 15:57:19 crc kubenswrapper[5120]: I0316 15:57:19.013934 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a49327a-b187-4793-80dc-d57ce84bb993" containerName="ceilometer-notification-agent" Mar 16 15:57:19 crc kubenswrapper[5120]: I0316 15:57:19.013962 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a49327a-b187-4793-80dc-d57ce84bb993" containerName="ceilometer-central-agent" Mar 16 15:57:19 crc kubenswrapper[5120]: I0316 15:57:19.013967 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a49327a-b187-4793-80dc-d57ce84bb993" containerName="ceilometer-central-agent" Mar 16 15:57:19 crc kubenswrapper[5120]: I0316 15:57:19.013982 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a49327a-b187-4793-80dc-d57ce84bb993" containerName="sg-core" Mar 16 15:57:19 crc kubenswrapper[5120]: I0316 15:57:19.013987 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a49327a-b187-4793-80dc-d57ce84bb993" containerName="sg-core" Mar 16 15:57:19 crc kubenswrapper[5120]: I0316 15:57:19.014008 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a49327a-b187-4793-80dc-d57ce84bb993" containerName="proxy-httpd" Mar 16 15:57:19 crc kubenswrapper[5120]: I0316 15:57:19.014013 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a49327a-b187-4793-80dc-d57ce84bb993" containerName="proxy-httpd" Mar 16 15:57:19 crc kubenswrapper[5120]: I0316 15:57:19.014164 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="0a49327a-b187-4793-80dc-d57ce84bb993" containerName="ceilometer-central-agent" Mar 16 15:57:19 crc kubenswrapper[5120]: I0316 15:57:19.014180 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="3f138acc-5d5b-4b31-ada9-a7943b9ed432" containerName="nova-manage" Mar 16 15:57:19 crc kubenswrapper[5120]: I0316 15:57:19.014192 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="0a49327a-b187-4793-80dc-d57ce84bb993" containerName="ceilometer-notification-agent" Mar 16 15:57:19 crc kubenswrapper[5120]: I0316 15:57:19.014199 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="0a49327a-b187-4793-80dc-d57ce84bb993" containerName="proxy-httpd" Mar 16 15:57:19 crc kubenswrapper[5120]: I0316 15:57:19.014210 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="0a49327a-b187-4793-80dc-d57ce84bb993" containerName="sg-core" Mar 16 15:57:19 crc kubenswrapper[5120]: I0316 15:57:19.020455 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:57:19 crc kubenswrapper[5120]: I0316 15:57:19.024892 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 15:57:19 crc kubenswrapper[5120]: I0316 15:57:19.025569 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 15:57:19 crc kubenswrapper[5120]: I0316 15:57:19.047602 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 15:57:19 crc kubenswrapper[5120]: I0316 15:57:19.102516 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/9e0e932c-14a5-4bfc-8cf2-aa748fe4db76-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"9e0e932c-14a5-4bfc-8cf2-aa748fe4db76\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:57:19 crc kubenswrapper[5120]: I0316 15:57:19.102569 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9e0e932c-14a5-4bfc-8cf2-aa748fe4db76-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"9e0e932c-14a5-4bfc-8cf2-aa748fe4db76\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:57:19 crc kubenswrapper[5120]: I0316 15:57:19.102645 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9e0e932c-14a5-4bfc-8cf2-aa748fe4db76-config-data\") pod \"ceilometer-0\" (UID: \"9e0e932c-14a5-4bfc-8cf2-aa748fe4db76\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:57:19 crc kubenswrapper[5120]: I0316 15:57:19.102727 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/9e0e932c-14a5-4bfc-8cf2-aa748fe4db76-run-httpd\") pod \"ceilometer-0\" (UID: \"9e0e932c-14a5-4bfc-8cf2-aa748fe4db76\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:57:19 crc kubenswrapper[5120]: I0316 15:57:19.102805 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fsxqn\" (UniqueName: \"kubernetes.io/projected/9e0e932c-14a5-4bfc-8cf2-aa748fe4db76-kube-api-access-fsxqn\") pod \"ceilometer-0\" (UID: \"9e0e932c-14a5-4bfc-8cf2-aa748fe4db76\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:57:19 crc kubenswrapper[5120]: I0316 15:57:19.102963 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9e0e932c-14a5-4bfc-8cf2-aa748fe4db76-scripts\") pod \"ceilometer-0\" (UID: \"9e0e932c-14a5-4bfc-8cf2-aa748fe4db76\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:57:19 crc kubenswrapper[5120]: I0316 15:57:19.103012 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/9e0e932c-14a5-4bfc-8cf2-aa748fe4db76-log-httpd\") pod \"ceilometer-0\" (UID: \"9e0e932c-14a5-4bfc-8cf2-aa748fe4db76\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:57:19 crc kubenswrapper[5120]: I0316 15:57:19.204243 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9e0e932c-14a5-4bfc-8cf2-aa748fe4db76-config-data\") pod \"ceilometer-0\" (UID: \"9e0e932c-14a5-4bfc-8cf2-aa748fe4db76\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:57:19 crc kubenswrapper[5120]: I0316 15:57:19.204333 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/9e0e932c-14a5-4bfc-8cf2-aa748fe4db76-run-httpd\") pod \"ceilometer-0\" (UID: \"9e0e932c-14a5-4bfc-8cf2-aa748fe4db76\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:57:19 crc kubenswrapper[5120]: I0316 15:57:19.204402 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fsxqn\" (UniqueName: \"kubernetes.io/projected/9e0e932c-14a5-4bfc-8cf2-aa748fe4db76-kube-api-access-fsxqn\") pod \"ceilometer-0\" (UID: \"9e0e932c-14a5-4bfc-8cf2-aa748fe4db76\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:57:19 crc kubenswrapper[5120]: I0316 15:57:19.204493 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9e0e932c-14a5-4bfc-8cf2-aa748fe4db76-scripts\") pod \"ceilometer-0\" (UID: \"9e0e932c-14a5-4bfc-8cf2-aa748fe4db76\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:57:19 crc kubenswrapper[5120]: I0316 15:57:19.204516 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/9e0e932c-14a5-4bfc-8cf2-aa748fe4db76-log-httpd\") pod \"ceilometer-0\" (UID: \"9e0e932c-14a5-4bfc-8cf2-aa748fe4db76\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:57:19 crc kubenswrapper[5120]: I0316 15:57:19.204637 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/9e0e932c-14a5-4bfc-8cf2-aa748fe4db76-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"9e0e932c-14a5-4bfc-8cf2-aa748fe4db76\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:57:19 crc kubenswrapper[5120]: I0316 15:57:19.204659 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9e0e932c-14a5-4bfc-8cf2-aa748fe4db76-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"9e0e932c-14a5-4bfc-8cf2-aa748fe4db76\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:57:19 crc kubenswrapper[5120]: I0316 15:57:19.205170 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/9e0e932c-14a5-4bfc-8cf2-aa748fe4db76-log-httpd\") pod \"ceilometer-0\" (UID: \"9e0e932c-14a5-4bfc-8cf2-aa748fe4db76\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:57:19 crc kubenswrapper[5120]: I0316 15:57:19.205172 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/9e0e932c-14a5-4bfc-8cf2-aa748fe4db76-run-httpd\") pod \"ceilometer-0\" (UID: \"9e0e932c-14a5-4bfc-8cf2-aa748fe4db76\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:57:19 crc kubenswrapper[5120]: I0316 15:57:19.210208 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/9e0e932c-14a5-4bfc-8cf2-aa748fe4db76-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"9e0e932c-14a5-4bfc-8cf2-aa748fe4db76\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:57:19 crc kubenswrapper[5120]: I0316 15:57:19.210514 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9e0e932c-14a5-4bfc-8cf2-aa748fe4db76-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"9e0e932c-14a5-4bfc-8cf2-aa748fe4db76\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:57:19 crc kubenswrapper[5120]: I0316 15:57:19.211396 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9e0e932c-14a5-4bfc-8cf2-aa748fe4db76-scripts\") pod \"ceilometer-0\" (UID: \"9e0e932c-14a5-4bfc-8cf2-aa748fe4db76\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:57:19 crc kubenswrapper[5120]: I0316 15:57:19.211752 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9e0e932c-14a5-4bfc-8cf2-aa748fe4db76-config-data\") pod \"ceilometer-0\" (UID: \"9e0e932c-14a5-4bfc-8cf2-aa748fe4db76\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:57:19 crc kubenswrapper[5120]: I0316 15:57:19.219689 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fsxqn\" (UniqueName: \"kubernetes.io/projected/9e0e932c-14a5-4bfc-8cf2-aa748fe4db76-kube-api-access-fsxqn\") pod \"ceilometer-0\" (UID: \"9e0e932c-14a5-4bfc-8cf2-aa748fe4db76\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:57:19 crc kubenswrapper[5120]: I0316 15:57:19.358668 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:57:19 crc kubenswrapper[5120]: I0316 15:57:19.884329 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 15:57:19 crc kubenswrapper[5120]: W0316 15:57:19.889032 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9e0e932c_14a5_4bfc_8cf2_aa748fe4db76.slice/crio-5cb746c36b556869ad66ffe152214b487db1c76b8d012a12d38e3dadc2339ba0 WatchSource:0}: Error finding container 5cb746c36b556869ad66ffe152214b487db1c76b8d012a12d38e3dadc2339ba0: Status 404 returned error can't find the container with id 5cb746c36b556869ad66ffe152214b487db1c76b8d012a12d38e3dadc2339ba0 Mar 16 15:57:19 crc kubenswrapper[5120]: I0316 15:57:19.925077 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"9e0e932c-14a5-4bfc-8cf2-aa748fe4db76","Type":"ContainerStarted","Data":"5cb746c36b556869ad66ffe152214b487db1c76b8d012a12d38e3dadc2339ba0"} Mar 16 15:57:20 crc kubenswrapper[5120]: I0316 15:57:20.683050 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0a49327a-b187-4793-80dc-d57ce84bb993" path="/var/lib/kubelet/pods/0a49327a-b187-4793-80dc-d57ce84bb993/volumes" Mar 16 15:57:20 crc kubenswrapper[5120]: I0316 15:57:20.940952 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"9e0e932c-14a5-4bfc-8cf2-aa748fe4db76","Type":"ContainerStarted","Data":"a58b7a0fe559dec3a96a721d58c8a80ce759baa48f19577f24beec5f1de319f6"} Mar 16 15:57:21 crc kubenswrapper[5120]: I0316 15:57:21.885518 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 15:57:21 crc kubenswrapper[5120]: I0316 15:57:21.954613 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"9e0e932c-14a5-4bfc-8cf2-aa748fe4db76","Type":"ContainerStarted","Data":"c15ddf7ad977bade2f108ad9e0b02075b2123784a32043289e7fc57fa6144f3d"} Mar 16 15:57:22 crc kubenswrapper[5120]: I0316 15:57:22.007842 5120 patch_prober.go:28] interesting pod/machine-config-daemon-7bf76 container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 15:57:22 crc kubenswrapper[5120]: I0316 15:57:22.008448 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 15:57:22 crc kubenswrapper[5120]: I0316 15:57:22.008590 5120 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" Mar 16 15:57:22 crc kubenswrapper[5120]: I0316 15:57:22.009881 5120 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="machine-config-daemon" containerStatusID={"Type":"cri-o","ID":"02ba4fc3f84eccaecfa9e6618280f65626eb76580c4af9ae7a9d7cb3b8dd590b"} pod="openshift-machine-config-operator/machine-config-daemon-7bf76" containerMessage="Container machine-config-daemon failed liveness probe, will be restarted" Mar 16 15:57:22 crc kubenswrapper[5120]: I0316 15:57:22.010036 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" containerID="cri-o://02ba4fc3f84eccaecfa9e6618280f65626eb76580c4af9ae7a9d7cb3b8dd590b" gracePeriod=600 Mar 16 15:57:22 crc kubenswrapper[5120]: E0316 15:57:22.148356 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 15:57:22 crc kubenswrapper[5120]: I0316 15:57:22.188634 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:57:22 crc kubenswrapper[5120]: I0316 15:57:22.188980 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:57:22 crc kubenswrapper[5120]: I0316 15:57:22.384496 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 15:57:22 crc kubenswrapper[5120]: I0316 15:57:22.437305 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 15:57:22 crc kubenswrapper[5120]: I0316 15:57:22.437552 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="04104355-117f-484c-b549-8ea6cb950eac" containerName="nova-metadata-log" containerID="cri-o://216b325c919b5dbedf7e887bcbf226e6a7ded18b0295e823a7d9e145a6ff6de9" gracePeriod=30 Mar 16 15:57:22 crc kubenswrapper[5120]: I0316 15:57:22.437636 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="04104355-117f-484c-b549-8ea6cb950eac" containerName="nova-metadata-metadata" containerID="cri-o://adc0cf09990f43d47ffbaf7374befaf5385ddb20a6738e37d2bb8a82da650e06" gracePeriod=30 Mar 16 15:57:22 crc kubenswrapper[5120]: I0316 15:57:22.976165 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"9e0e932c-14a5-4bfc-8cf2-aa748fe4db76","Type":"ContainerStarted","Data":"f885a543fc2a0710cdab7dab8b5373b6bf1ceddee9c3f292591489498852ebe9"} Mar 16 15:57:22 crc kubenswrapper[5120]: I0316 15:57:22.978233 5120 generic.go:358] "Generic (PLEG): container finished" podID="04104355-117f-484c-b549-8ea6cb950eac" containerID="adc0cf09990f43d47ffbaf7374befaf5385ddb20a6738e37d2bb8a82da650e06" exitCode=0 Mar 16 15:57:22 crc kubenswrapper[5120]: I0316 15:57:22.978253 5120 generic.go:358] "Generic (PLEG): container finished" podID="04104355-117f-484c-b549-8ea6cb950eac" containerID="216b325c919b5dbedf7e887bcbf226e6a7ded18b0295e823a7d9e145a6ff6de9" exitCode=143 Mar 16 15:57:22 crc kubenswrapper[5120]: I0316 15:57:22.978646 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"04104355-117f-484c-b549-8ea6cb950eac","Type":"ContainerDied","Data":"adc0cf09990f43d47ffbaf7374befaf5385ddb20a6738e37d2bb8a82da650e06"} Mar 16 15:57:22 crc kubenswrapper[5120]: I0316 15:57:22.978670 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"04104355-117f-484c-b549-8ea6cb950eac","Type":"ContainerDied","Data":"216b325c919b5dbedf7e887bcbf226e6a7ded18b0295e823a7d9e145a6ff6de9"} Mar 16 15:57:22 crc kubenswrapper[5120]: I0316 15:57:22.980172 5120 generic.go:358] "Generic (PLEG): container finished" podID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerID="02ba4fc3f84eccaecfa9e6618280f65626eb76580c4af9ae7a9d7cb3b8dd590b" exitCode=0 Mar 16 15:57:22 crc kubenswrapper[5120]: I0316 15:57:22.980996 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" event={"ID":"e2275cb4-4905-4d66-a87e-8010120db2bd","Type":"ContainerDied","Data":"02ba4fc3f84eccaecfa9e6618280f65626eb76580c4af9ae7a9d7cb3b8dd590b"} Mar 16 15:57:22 crc kubenswrapper[5120]: I0316 15:57:22.981026 5120 scope.go:117] "RemoveContainer" containerID="9d5e3b84b8e39e272bcdfd3629bb461cbf7fa6c81923d93bfde9f9bccbea4d36" Mar 16 15:57:22 crc kubenswrapper[5120]: I0316 15:57:22.981334 5120 scope.go:117] "RemoveContainer" containerID="02ba4fc3f84eccaecfa9e6618280f65626eb76580c4af9ae7a9d7cb3b8dd590b" Mar 16 15:57:22 crc kubenswrapper[5120]: E0316 15:57:22.981541 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 15:57:23 crc kubenswrapper[5120]: I0316 15:57:23.152373 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:57:23 crc kubenswrapper[5120]: I0316 15:57:23.209857 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2xvtv\" (UniqueName: \"kubernetes.io/projected/04104355-117f-484c-b549-8ea6cb950eac-kube-api-access-2xvtv\") pod \"04104355-117f-484c-b549-8ea6cb950eac\" (UID: \"04104355-117f-484c-b549-8ea6cb950eac\") " Mar 16 15:57:23 crc kubenswrapper[5120]: I0316 15:57:23.210580 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/04104355-117f-484c-b549-8ea6cb950eac-config-data\") pod \"04104355-117f-484c-b549-8ea6cb950eac\" (UID: \"04104355-117f-484c-b549-8ea6cb950eac\") " Mar 16 15:57:23 crc kubenswrapper[5120]: I0316 15:57:23.210660 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/04104355-117f-484c-b549-8ea6cb950eac-nova-metadata-tls-certs\") pod \"04104355-117f-484c-b549-8ea6cb950eac\" (UID: \"04104355-117f-484c-b549-8ea6cb950eac\") " Mar 16 15:57:23 crc kubenswrapper[5120]: I0316 15:57:23.210686 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/04104355-117f-484c-b549-8ea6cb950eac-logs\") pod \"04104355-117f-484c-b549-8ea6cb950eac\" (UID: \"04104355-117f-484c-b549-8ea6cb950eac\") " Mar 16 15:57:23 crc kubenswrapper[5120]: I0316 15:57:23.210972 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/04104355-117f-484c-b549-8ea6cb950eac-combined-ca-bundle\") pod \"04104355-117f-484c-b549-8ea6cb950eac\" (UID: \"04104355-117f-484c-b549-8ea6cb950eac\") " Mar 16 15:57:23 crc kubenswrapper[5120]: I0316 15:57:23.211617 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04104355-117f-484c-b549-8ea6cb950eac-logs" (OuterVolumeSpecName: "logs") pod "04104355-117f-484c-b549-8ea6cb950eac" (UID: "04104355-117f-484c-b549-8ea6cb950eac"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:57:23 crc kubenswrapper[5120]: I0316 15:57:23.212129 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/04104355-117f-484c-b549-8ea6cb950eac-logs\") on node \"crc\" DevicePath \"\"" Mar 16 15:57:23 crc kubenswrapper[5120]: I0316 15:57:23.219096 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04104355-117f-484c-b549-8ea6cb950eac-kube-api-access-2xvtv" (OuterVolumeSpecName: "kube-api-access-2xvtv") pod "04104355-117f-484c-b549-8ea6cb950eac" (UID: "04104355-117f-484c-b549-8ea6cb950eac"). InnerVolumeSpecName "kube-api-access-2xvtv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:57:23 crc kubenswrapper[5120]: I0316 15:57:23.230896 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="5c7eb905-b64f-4cd5-89c8-15d11ae339f2" containerName="nova-api-api" probeResult="failure" output="Get \"http://10.217.1.45:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 15:57:23 crc kubenswrapper[5120]: I0316 15:57:23.231984 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="5c7eb905-b64f-4cd5-89c8-15d11ae339f2" containerName="nova-api-log" probeResult="failure" output="Get \"http://10.217.1.45:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 15:57:23 crc kubenswrapper[5120]: I0316 15:57:23.249474 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/04104355-117f-484c-b549-8ea6cb950eac-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "04104355-117f-484c-b549-8ea6cb950eac" (UID: "04104355-117f-484c-b549-8ea6cb950eac"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:57:23 crc kubenswrapper[5120]: I0316 15:57:23.270897 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/04104355-117f-484c-b549-8ea6cb950eac-config-data" (OuterVolumeSpecName: "config-data") pod "04104355-117f-484c-b549-8ea6cb950eac" (UID: "04104355-117f-484c-b549-8ea6cb950eac"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:57:23 crc kubenswrapper[5120]: I0316 15:57:23.281170 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/04104355-117f-484c-b549-8ea6cb950eac-nova-metadata-tls-certs" (OuterVolumeSpecName: "nova-metadata-tls-certs") pod "04104355-117f-484c-b549-8ea6cb950eac" (UID: "04104355-117f-484c-b549-8ea6cb950eac"). InnerVolumeSpecName "nova-metadata-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:57:23 crc kubenswrapper[5120]: I0316 15:57:23.313535 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/04104355-117f-484c-b549-8ea6cb950eac-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:57:23 crc kubenswrapper[5120]: I0316 15:57:23.313572 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2xvtv\" (UniqueName: \"kubernetes.io/projected/04104355-117f-484c-b549-8ea6cb950eac-kube-api-access-2xvtv\") on node \"crc\" DevicePath \"\"" Mar 16 15:57:23 crc kubenswrapper[5120]: I0316 15:57:23.313586 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/04104355-117f-484c-b549-8ea6cb950eac-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 15:57:23 crc kubenswrapper[5120]: I0316 15:57:23.313594 5120 reconciler_common.go:299] "Volume detached for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/04104355-117f-484c-b549-8ea6cb950eac-nova-metadata-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 15:57:24 crc kubenswrapper[5120]: I0316 15:57:23.998333 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"04104355-117f-484c-b549-8ea6cb950eac","Type":"ContainerDied","Data":"1a7bdbd1ba540e9a1138f5483a49bc95e3cbb5b7bdcdc20c0563ba5cd01dd9f7"} Mar 16 15:57:24 crc kubenswrapper[5120]: I0316 15:57:23.998389 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="5c7eb905-b64f-4cd5-89c8-15d11ae339f2" containerName="nova-api-log" containerID="cri-o://b7948f64b656f7615f084fd6015bea3e7e11d3a1660f842532254decfeea89e7" gracePeriod=30 Mar 16 15:57:24 crc kubenswrapper[5120]: I0316 15:57:24.000489 5120 scope.go:117] "RemoveContainer" containerID="adc0cf09990f43d47ffbaf7374befaf5385ddb20a6738e37d2bb8a82da650e06" Mar 16 15:57:24 crc kubenswrapper[5120]: I0316 15:57:23.998937 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:57:24 crc kubenswrapper[5120]: I0316 15:57:23.998991 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="5c7eb905-b64f-4cd5-89c8-15d11ae339f2" containerName="nova-api-api" containerID="cri-o://85125749653ae9bd34fcf895af5b75f6791e375284dcf34603dae24f439f1acf" gracePeriod=30 Mar 16 15:57:24 crc kubenswrapper[5120]: I0316 15:57:24.057653 5120 scope.go:117] "RemoveContainer" containerID="216b325c919b5dbedf7e887bcbf226e6a7ded18b0295e823a7d9e145a6ff6de9" Mar 16 15:57:24 crc kubenswrapper[5120]: I0316 15:57:24.067285 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 15:57:24 crc kubenswrapper[5120]: I0316 15:57:24.079281 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 15:57:24 crc kubenswrapper[5120]: I0316 15:57:24.087636 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 15:57:24 crc kubenswrapper[5120]: I0316 15:57:24.089541 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04104355-117f-484c-b549-8ea6cb950eac" containerName="nova-metadata-log" Mar 16 15:57:24 crc kubenswrapper[5120]: I0316 15:57:24.089578 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="04104355-117f-484c-b549-8ea6cb950eac" containerName="nova-metadata-log" Mar 16 15:57:24 crc kubenswrapper[5120]: I0316 15:57:24.089648 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04104355-117f-484c-b549-8ea6cb950eac" containerName="nova-metadata-metadata" Mar 16 15:57:24 crc kubenswrapper[5120]: I0316 15:57:24.089658 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="04104355-117f-484c-b549-8ea6cb950eac" containerName="nova-metadata-metadata" Mar 16 15:57:24 crc kubenswrapper[5120]: I0316 15:57:24.090021 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="04104355-117f-484c-b549-8ea6cb950eac" containerName="nova-metadata-metadata" Mar 16 15:57:24 crc kubenswrapper[5120]: I0316 15:57:24.090078 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="04104355-117f-484c-b549-8ea6cb950eac" containerName="nova-metadata-log" Mar 16 15:57:24 crc kubenswrapper[5120]: I0316 15:57:24.108712 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 15:57:24 crc kubenswrapper[5120]: I0316 15:57:24.108927 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:57:24 crc kubenswrapper[5120]: I0316 15:57:24.112430 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-metadata-config-data\"" Mar 16 15:57:24 crc kubenswrapper[5120]: I0316 15:57:24.113114 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-metadata-internal-svc\"" Mar 16 15:57:24 crc kubenswrapper[5120]: I0316 15:57:24.240589 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dw65j\" (UniqueName: \"kubernetes.io/projected/318b5444-18f6-45b3-aaac-62f4457fb01a-kube-api-access-dw65j\") pod \"nova-metadata-0\" (UID: \"318b5444-18f6-45b3-aaac-62f4457fb01a\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:57:24 crc kubenswrapper[5120]: I0316 15:57:24.240651 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/318b5444-18f6-45b3-aaac-62f4457fb01a-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"318b5444-18f6-45b3-aaac-62f4457fb01a\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:57:24 crc kubenswrapper[5120]: I0316 15:57:24.240673 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/318b5444-18f6-45b3-aaac-62f4457fb01a-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"318b5444-18f6-45b3-aaac-62f4457fb01a\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:57:24 crc kubenswrapper[5120]: I0316 15:57:24.240781 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/318b5444-18f6-45b3-aaac-62f4457fb01a-logs\") pod \"nova-metadata-0\" (UID: \"318b5444-18f6-45b3-aaac-62f4457fb01a\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:57:24 crc kubenswrapper[5120]: I0316 15:57:24.240810 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/318b5444-18f6-45b3-aaac-62f4457fb01a-config-data\") pod \"nova-metadata-0\" (UID: \"318b5444-18f6-45b3-aaac-62f4457fb01a\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:57:24 crc kubenswrapper[5120]: I0316 15:57:24.343055 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dw65j\" (UniqueName: \"kubernetes.io/projected/318b5444-18f6-45b3-aaac-62f4457fb01a-kube-api-access-dw65j\") pod \"nova-metadata-0\" (UID: \"318b5444-18f6-45b3-aaac-62f4457fb01a\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:57:24 crc kubenswrapper[5120]: I0316 15:57:24.343342 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/318b5444-18f6-45b3-aaac-62f4457fb01a-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"318b5444-18f6-45b3-aaac-62f4457fb01a\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:57:24 crc kubenswrapper[5120]: I0316 15:57:24.343454 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/318b5444-18f6-45b3-aaac-62f4457fb01a-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"318b5444-18f6-45b3-aaac-62f4457fb01a\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:57:24 crc kubenswrapper[5120]: I0316 15:57:24.343568 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/318b5444-18f6-45b3-aaac-62f4457fb01a-logs\") pod \"nova-metadata-0\" (UID: \"318b5444-18f6-45b3-aaac-62f4457fb01a\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:57:24 crc kubenswrapper[5120]: I0316 15:57:24.343670 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/318b5444-18f6-45b3-aaac-62f4457fb01a-config-data\") pod \"nova-metadata-0\" (UID: \"318b5444-18f6-45b3-aaac-62f4457fb01a\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:57:24 crc kubenswrapper[5120]: I0316 15:57:24.344358 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/318b5444-18f6-45b3-aaac-62f4457fb01a-logs\") pod \"nova-metadata-0\" (UID: \"318b5444-18f6-45b3-aaac-62f4457fb01a\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:57:24 crc kubenswrapper[5120]: I0316 15:57:24.348654 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/318b5444-18f6-45b3-aaac-62f4457fb01a-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"318b5444-18f6-45b3-aaac-62f4457fb01a\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:57:24 crc kubenswrapper[5120]: I0316 15:57:24.352138 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/318b5444-18f6-45b3-aaac-62f4457fb01a-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"318b5444-18f6-45b3-aaac-62f4457fb01a\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:57:24 crc kubenswrapper[5120]: I0316 15:57:24.361250 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/318b5444-18f6-45b3-aaac-62f4457fb01a-config-data\") pod \"nova-metadata-0\" (UID: \"318b5444-18f6-45b3-aaac-62f4457fb01a\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:57:24 crc kubenswrapper[5120]: I0316 15:57:24.374175 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dw65j\" (UniqueName: \"kubernetes.io/projected/318b5444-18f6-45b3-aaac-62f4457fb01a-kube-api-access-dw65j\") pod \"nova-metadata-0\" (UID: \"318b5444-18f6-45b3-aaac-62f4457fb01a\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:57:24 crc kubenswrapper[5120]: I0316 15:57:24.474298 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:57:24 crc kubenswrapper[5120]: I0316 15:57:24.693716 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="04104355-117f-484c-b549-8ea6cb950eac" path="/var/lib/kubelet/pods/04104355-117f-484c-b549-8ea6cb950eac/volumes" Mar 16 15:57:24 crc kubenswrapper[5120]: I0316 15:57:24.757174 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 15:57:25 crc kubenswrapper[5120]: I0316 15:57:25.029435 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"9e0e932c-14a5-4bfc-8cf2-aa748fe4db76","Type":"ContainerStarted","Data":"8e3be09204e3c0d32204310f0d66382c5d2443da05657ec7520e1c8e242905ae"} Mar 16 15:57:25 crc kubenswrapper[5120]: I0316 15:57:25.029978 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:57:25 crc kubenswrapper[5120]: I0316 15:57:25.041788 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"318b5444-18f6-45b3-aaac-62f4457fb01a","Type":"ContainerStarted","Data":"72edd44371c0419d4238b34e3f9e8b5b8ad817b547b0c633aea80a46c2dcc422"} Mar 16 15:57:25 crc kubenswrapper[5120]: I0316 15:57:25.042228 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"318b5444-18f6-45b3-aaac-62f4457fb01a","Type":"ContainerStarted","Data":"bfd127560fa900d8e896a8c8b3d5463781f2b507b30da9bd4930c719c3eaff29"} Mar 16 15:57:25 crc kubenswrapper[5120]: I0316 15:57:25.048469 5120 generic.go:358] "Generic (PLEG): container finished" podID="5c7eb905-b64f-4cd5-89c8-15d11ae339f2" containerID="b7948f64b656f7615f084fd6015bea3e7e11d3a1660f842532254decfeea89e7" exitCode=143 Mar 16 15:57:25 crc kubenswrapper[5120]: I0316 15:57:25.048634 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"5c7eb905-b64f-4cd5-89c8-15d11ae339f2","Type":"ContainerDied","Data":"b7948f64b656f7615f084fd6015bea3e7e11d3a1660f842532254decfeea89e7"} Mar 16 15:57:25 crc kubenswrapper[5120]: I0316 15:57:25.064747 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.523227496 podStartE2EDuration="7.064723764s" podCreationTimestamp="2026-03-16 15:57:18 +0000 UTC" firstStartedPulling="2026-03-16 15:57:19.890695616 +0000 UTC m=+1542.044627293" lastFinishedPulling="2026-03-16 15:57:24.432191904 +0000 UTC m=+1546.586123561" observedRunningTime="2026-03-16 15:57:25.053652077 +0000 UTC m=+1547.207583734" watchObservedRunningTime="2026-03-16 15:57:25.064723764 +0000 UTC m=+1547.218655421" Mar 16 15:57:25 crc kubenswrapper[5120]: I0316 15:57:25.985872 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 15:57:26 crc kubenswrapper[5120]: I0316 15:57:26.072532 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"318b5444-18f6-45b3-aaac-62f4457fb01a","Type":"ContainerStarted","Data":"ca200cb8534e05fd2b4b737bd3676b45f55b106a873123835d29436742ed23e4"} Mar 16 15:57:26 crc kubenswrapper[5120]: I0316 15:57:26.092810 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=2.092790458 podStartE2EDuration="2.092790458s" podCreationTimestamp="2026-03-16 15:57:24 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:57:26.088332115 +0000 UTC m=+1548.242263772" watchObservedRunningTime="2026-03-16 15:57:26.092790458 +0000 UTC m=+1548.246722115" Mar 16 15:57:29 crc kubenswrapper[5120]: I0316 15:57:29.049104 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:57:29 crc kubenswrapper[5120]: I0316 15:57:29.078574 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5c7eb905-b64f-4cd5-89c8-15d11ae339f2-config-data\") pod \"5c7eb905-b64f-4cd5-89c8-15d11ae339f2\" (UID: \"5c7eb905-b64f-4cd5-89c8-15d11ae339f2\") " Mar 16 15:57:29 crc kubenswrapper[5120]: I0316 15:57:29.078844 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5c7eb905-b64f-4cd5-89c8-15d11ae339f2-logs\") pod \"5c7eb905-b64f-4cd5-89c8-15d11ae339f2\" (UID: \"5c7eb905-b64f-4cd5-89c8-15d11ae339f2\") " Mar 16 15:57:29 crc kubenswrapper[5120]: I0316 15:57:29.078874 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5c7eb905-b64f-4cd5-89c8-15d11ae339f2-combined-ca-bundle\") pod \"5c7eb905-b64f-4cd5-89c8-15d11ae339f2\" (UID: \"5c7eb905-b64f-4cd5-89c8-15d11ae339f2\") " Mar 16 15:57:29 crc kubenswrapper[5120]: I0316 15:57:29.078923 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6t4r7\" (UniqueName: \"kubernetes.io/projected/5c7eb905-b64f-4cd5-89c8-15d11ae339f2-kube-api-access-6t4r7\") pod \"5c7eb905-b64f-4cd5-89c8-15d11ae339f2\" (UID: \"5c7eb905-b64f-4cd5-89c8-15d11ae339f2\") " Mar 16 15:57:29 crc kubenswrapper[5120]: I0316 15:57:29.083501 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c7eb905-b64f-4cd5-89c8-15d11ae339f2-logs" (OuterVolumeSpecName: "logs") pod "5c7eb905-b64f-4cd5-89c8-15d11ae339f2" (UID: "5c7eb905-b64f-4cd5-89c8-15d11ae339f2"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:57:29 crc kubenswrapper[5120]: I0316 15:57:29.088452 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c7eb905-b64f-4cd5-89c8-15d11ae339f2-kube-api-access-6t4r7" (OuterVolumeSpecName: "kube-api-access-6t4r7") pod "5c7eb905-b64f-4cd5-89c8-15d11ae339f2" (UID: "5c7eb905-b64f-4cd5-89c8-15d11ae339f2"). InnerVolumeSpecName "kube-api-access-6t4r7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:57:29 crc kubenswrapper[5120]: I0316 15:57:29.121318 5120 generic.go:358] "Generic (PLEG): container finished" podID="5c7eb905-b64f-4cd5-89c8-15d11ae339f2" containerID="85125749653ae9bd34fcf895af5b75f6791e375284dcf34603dae24f439f1acf" exitCode=0 Mar 16 15:57:29 crc kubenswrapper[5120]: I0316 15:57:29.121589 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:57:29 crc kubenswrapper[5120]: I0316 15:57:29.121782 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"5c7eb905-b64f-4cd5-89c8-15d11ae339f2","Type":"ContainerDied","Data":"85125749653ae9bd34fcf895af5b75f6791e375284dcf34603dae24f439f1acf"} Mar 16 15:57:29 crc kubenswrapper[5120]: I0316 15:57:29.121817 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"5c7eb905-b64f-4cd5-89c8-15d11ae339f2","Type":"ContainerDied","Data":"01f797e4549970532d5ae05bbbe8102d3094bc73d7ff9098c82114ae485fed75"} Mar 16 15:57:29 crc kubenswrapper[5120]: I0316 15:57:29.121836 5120 scope.go:117] "RemoveContainer" containerID="85125749653ae9bd34fcf895af5b75f6791e375284dcf34603dae24f439f1acf" Mar 16 15:57:29 crc kubenswrapper[5120]: I0316 15:57:29.145934 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c7eb905-b64f-4cd5-89c8-15d11ae339f2-config-data" (OuterVolumeSpecName: "config-data") pod "5c7eb905-b64f-4cd5-89c8-15d11ae339f2" (UID: "5c7eb905-b64f-4cd5-89c8-15d11ae339f2"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:57:29 crc kubenswrapper[5120]: I0316 15:57:29.149480 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c7eb905-b64f-4cd5-89c8-15d11ae339f2-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "5c7eb905-b64f-4cd5-89c8-15d11ae339f2" (UID: "5c7eb905-b64f-4cd5-89c8-15d11ae339f2"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:57:29 crc kubenswrapper[5120]: I0316 15:57:29.183639 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5c7eb905-b64f-4cd5-89c8-15d11ae339f2-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 15:57:29 crc kubenswrapper[5120]: I0316 15:57:29.183675 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5c7eb905-b64f-4cd5-89c8-15d11ae339f2-logs\") on node \"crc\" DevicePath \"\"" Mar 16 15:57:29 crc kubenswrapper[5120]: I0316 15:57:29.183684 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5c7eb905-b64f-4cd5-89c8-15d11ae339f2-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:57:29 crc kubenswrapper[5120]: I0316 15:57:29.183695 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6t4r7\" (UniqueName: \"kubernetes.io/projected/5c7eb905-b64f-4cd5-89c8-15d11ae339f2-kube-api-access-6t4r7\") on node \"crc\" DevicePath \"\"" Mar 16 15:57:29 crc kubenswrapper[5120]: I0316 15:57:29.203696 5120 scope.go:117] "RemoveContainer" containerID="b7948f64b656f7615f084fd6015bea3e7e11d3a1660f842532254decfeea89e7" Mar 16 15:57:29 crc kubenswrapper[5120]: I0316 15:57:29.228537 5120 scope.go:117] "RemoveContainer" containerID="85125749653ae9bd34fcf895af5b75f6791e375284dcf34603dae24f439f1acf" Mar 16 15:57:29 crc kubenswrapper[5120]: E0316 15:57:29.229013 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"85125749653ae9bd34fcf895af5b75f6791e375284dcf34603dae24f439f1acf\": container with ID starting with 85125749653ae9bd34fcf895af5b75f6791e375284dcf34603dae24f439f1acf not found: ID does not exist" containerID="85125749653ae9bd34fcf895af5b75f6791e375284dcf34603dae24f439f1acf" Mar 16 15:57:29 crc kubenswrapper[5120]: I0316 15:57:29.229050 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85125749653ae9bd34fcf895af5b75f6791e375284dcf34603dae24f439f1acf"} err="failed to get container status \"85125749653ae9bd34fcf895af5b75f6791e375284dcf34603dae24f439f1acf\": rpc error: code = NotFound desc = could not find container \"85125749653ae9bd34fcf895af5b75f6791e375284dcf34603dae24f439f1acf\": container with ID starting with 85125749653ae9bd34fcf895af5b75f6791e375284dcf34603dae24f439f1acf not found: ID does not exist" Mar 16 15:57:29 crc kubenswrapper[5120]: I0316 15:57:29.229069 5120 scope.go:117] "RemoveContainer" containerID="b7948f64b656f7615f084fd6015bea3e7e11d3a1660f842532254decfeea89e7" Mar 16 15:57:29 crc kubenswrapper[5120]: E0316 15:57:29.229345 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b7948f64b656f7615f084fd6015bea3e7e11d3a1660f842532254decfeea89e7\": container with ID starting with b7948f64b656f7615f084fd6015bea3e7e11d3a1660f842532254decfeea89e7 not found: ID does not exist" containerID="b7948f64b656f7615f084fd6015bea3e7e11d3a1660f842532254decfeea89e7" Mar 16 15:57:29 crc kubenswrapper[5120]: I0316 15:57:29.229365 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7948f64b656f7615f084fd6015bea3e7e11d3a1660f842532254decfeea89e7"} err="failed to get container status \"b7948f64b656f7615f084fd6015bea3e7e11d3a1660f842532254decfeea89e7\": rpc error: code = NotFound desc = could not find container \"b7948f64b656f7615f084fd6015bea3e7e11d3a1660f842532254decfeea89e7\": container with ID starting with b7948f64b656f7615f084fd6015bea3e7e11d3a1660f842532254decfeea89e7 not found: ID does not exist" Mar 16 15:57:29 crc kubenswrapper[5120]: I0316 15:57:29.474093 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 15:57:29 crc kubenswrapper[5120]: I0316 15:57:29.486730 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 15:57:29 crc kubenswrapper[5120]: I0316 15:57:29.515688 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 15:57:29 crc kubenswrapper[5120]: I0316 15:57:29.517576 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c7eb905-b64f-4cd5-89c8-15d11ae339f2" containerName="nova-api-api" Mar 16 15:57:29 crc kubenswrapper[5120]: I0316 15:57:29.517613 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c7eb905-b64f-4cd5-89c8-15d11ae339f2" containerName="nova-api-api" Mar 16 15:57:29 crc kubenswrapper[5120]: I0316 15:57:29.517650 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c7eb905-b64f-4cd5-89c8-15d11ae339f2" containerName="nova-api-log" Mar 16 15:57:29 crc kubenswrapper[5120]: I0316 15:57:29.517663 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c7eb905-b64f-4cd5-89c8-15d11ae339f2" containerName="nova-api-log" Mar 16 15:57:29 crc kubenswrapper[5120]: I0316 15:57:29.518138 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="5c7eb905-b64f-4cd5-89c8-15d11ae339f2" containerName="nova-api-api" Mar 16 15:57:29 crc kubenswrapper[5120]: I0316 15:57:29.518183 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="5c7eb905-b64f-4cd5-89c8-15d11ae339f2" containerName="nova-api-log" Mar 16 15:57:29 crc kubenswrapper[5120]: I0316 15:57:29.527176 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 15:57:29 crc kubenswrapper[5120]: I0316 15:57:29.527343 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:57:29 crc kubenswrapper[5120]: I0316 15:57:29.535326 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-config-data\"" Mar 16 15:57:29 crc kubenswrapper[5120]: I0316 15:57:29.596509 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dee0c2f4-0007-4e20-9da4-27d6e00c7dbe-config-data\") pod \"nova-api-0\" (UID: \"dee0c2f4-0007-4e20-9da4-27d6e00c7dbe\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:57:29 crc kubenswrapper[5120]: I0316 15:57:29.596831 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8bbd\" (UniqueName: \"kubernetes.io/projected/dee0c2f4-0007-4e20-9da4-27d6e00c7dbe-kube-api-access-v8bbd\") pod \"nova-api-0\" (UID: \"dee0c2f4-0007-4e20-9da4-27d6e00c7dbe\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:57:29 crc kubenswrapper[5120]: I0316 15:57:29.597067 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dee0c2f4-0007-4e20-9da4-27d6e00c7dbe-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"dee0c2f4-0007-4e20-9da4-27d6e00c7dbe\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:57:29 crc kubenswrapper[5120]: I0316 15:57:29.597135 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/dee0c2f4-0007-4e20-9da4-27d6e00c7dbe-logs\") pod \"nova-api-0\" (UID: \"dee0c2f4-0007-4e20-9da4-27d6e00c7dbe\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:57:29 crc kubenswrapper[5120]: I0316 15:57:29.699852 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dee0c2f4-0007-4e20-9da4-27d6e00c7dbe-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"dee0c2f4-0007-4e20-9da4-27d6e00c7dbe\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:57:29 crc kubenswrapper[5120]: I0316 15:57:29.699929 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/dee0c2f4-0007-4e20-9da4-27d6e00c7dbe-logs\") pod \"nova-api-0\" (UID: \"dee0c2f4-0007-4e20-9da4-27d6e00c7dbe\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:57:29 crc kubenswrapper[5120]: I0316 15:57:29.700185 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dee0c2f4-0007-4e20-9da4-27d6e00c7dbe-config-data\") pod \"nova-api-0\" (UID: \"dee0c2f4-0007-4e20-9da4-27d6e00c7dbe\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:57:29 crc kubenswrapper[5120]: I0316 15:57:29.700339 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v8bbd\" (UniqueName: \"kubernetes.io/projected/dee0c2f4-0007-4e20-9da4-27d6e00c7dbe-kube-api-access-v8bbd\") pod \"nova-api-0\" (UID: \"dee0c2f4-0007-4e20-9da4-27d6e00c7dbe\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:57:29 crc kubenswrapper[5120]: I0316 15:57:29.700733 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/dee0c2f4-0007-4e20-9da4-27d6e00c7dbe-logs\") pod \"nova-api-0\" (UID: \"dee0c2f4-0007-4e20-9da4-27d6e00c7dbe\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:57:29 crc kubenswrapper[5120]: I0316 15:57:29.706663 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dee0c2f4-0007-4e20-9da4-27d6e00c7dbe-config-data\") pod \"nova-api-0\" (UID: \"dee0c2f4-0007-4e20-9da4-27d6e00c7dbe\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:57:29 crc kubenswrapper[5120]: I0316 15:57:29.712043 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dee0c2f4-0007-4e20-9da4-27d6e00c7dbe-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"dee0c2f4-0007-4e20-9da4-27d6e00c7dbe\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:57:29 crc kubenswrapper[5120]: I0316 15:57:29.720488 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8bbd\" (UniqueName: \"kubernetes.io/projected/dee0c2f4-0007-4e20-9da4-27d6e00c7dbe-kube-api-access-v8bbd\") pod \"nova-api-0\" (UID: \"dee0c2f4-0007-4e20-9da4-27d6e00c7dbe\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:57:29 crc kubenswrapper[5120]: I0316 15:57:29.883870 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:57:30 crc kubenswrapper[5120]: I0316 15:57:30.361578 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 15:57:30 crc kubenswrapper[5120]: W0316 15:57:30.364706 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddee0c2f4_0007_4e20_9da4_27d6e00c7dbe.slice/crio-e1938c8f9d8e489dc80c52e5b8941303f343f774e4564d0b15f699e2ddeb0fcc WatchSource:0}: Error finding container e1938c8f9d8e489dc80c52e5b8941303f343f774e4564d0b15f699e2ddeb0fcc: Status 404 returned error can't find the container with id e1938c8f9d8e489dc80c52e5b8941303f343f774e4564d0b15f699e2ddeb0fcc Mar 16 15:57:30 crc kubenswrapper[5120]: I0316 15:57:30.674488 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c7eb905-b64f-4cd5-89c8-15d11ae339f2" path="/var/lib/kubelet/pods/5c7eb905-b64f-4cd5-89c8-15d11ae339f2/volumes" Mar 16 15:57:31 crc kubenswrapper[5120]: I0316 15:57:31.145785 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"dee0c2f4-0007-4e20-9da4-27d6e00c7dbe","Type":"ContainerStarted","Data":"1b4dcbbfdaf99608a495b69520908bce258af504130da12d4a9ea15986cba303"} Mar 16 15:57:31 crc kubenswrapper[5120]: I0316 15:57:31.146119 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"dee0c2f4-0007-4e20-9da4-27d6e00c7dbe","Type":"ContainerStarted","Data":"e19649935001895bcea0084948683062a1f024cde3dd8c893b8acb2eadeee9fe"} Mar 16 15:57:31 crc kubenswrapper[5120]: I0316 15:57:31.146133 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"dee0c2f4-0007-4e20-9da4-27d6e00c7dbe","Type":"ContainerStarted","Data":"e1938c8f9d8e489dc80c52e5b8941303f343f774e4564d0b15f699e2ddeb0fcc"} Mar 16 15:57:31 crc kubenswrapper[5120]: I0316 15:57:31.169576 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=2.169561342 podStartE2EDuration="2.169561342s" podCreationTimestamp="2026-03-16 15:57:29 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:57:31.165692594 +0000 UTC m=+1553.319624261" watchObservedRunningTime="2026-03-16 15:57:31.169561342 +0000 UTC m=+1553.323493009" Mar 16 15:57:33 crc kubenswrapper[5120]: I0316 15:57:33.664441 5120 scope.go:117] "RemoveContainer" containerID="02ba4fc3f84eccaecfa9e6618280f65626eb76580c4af9ae7a9d7cb3b8dd590b" Mar 16 15:57:33 crc kubenswrapper[5120]: E0316 15:57:33.665122 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 15:57:34 crc kubenswrapper[5120]: I0316 15:57:34.475498 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:57:34 crc kubenswrapper[5120]: I0316 15:57:34.475898 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:57:35 crc kubenswrapper[5120]: I0316 15:57:35.480932 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="318b5444-18f6-45b3-aaac-62f4457fb01a" containerName="nova-metadata-log" probeResult="failure" output="Get \"https://10.217.1.50:8775/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 15:57:35 crc kubenswrapper[5120]: I0316 15:57:35.480992 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="318b5444-18f6-45b3-aaac-62f4457fb01a" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"https://10.217.1.50:8775/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Mar 16 15:57:39 crc kubenswrapper[5120]: I0316 15:57:39.884116 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:57:39 crc kubenswrapper[5120]: I0316 15:57:39.884833 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:57:40 crc kubenswrapper[5120]: I0316 15:57:40.926012 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="dee0c2f4-0007-4e20-9da4-27d6e00c7dbe" containerName="nova-api-api" probeResult="failure" output="Get \"http://10.217.1.51:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 15:57:40 crc kubenswrapper[5120]: I0316 15:57:40.928202 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="dee0c2f4-0007-4e20-9da4-27d6e00c7dbe" containerName="nova-api-log" probeResult="failure" output="Get \"http://10.217.1.51:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 15:57:41 crc kubenswrapper[5120]: I0316 15:57:41.172996 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 15:57:41 crc kubenswrapper[5120]: I0316 15:57:41.257602 5120 generic.go:358] "Generic (PLEG): container finished" podID="981363c3-7b22-430f-aa69-2156b39ba7a3" containerID="24cc81feb48879a69e8bd088a64555424b3a3825d67293712256b1b6f5cc5586" exitCode=137 Mar 16 15:57:41 crc kubenswrapper[5120]: I0316 15:57:41.257687 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 15:57:41 crc kubenswrapper[5120]: I0316 15:57:41.257690 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"981363c3-7b22-430f-aa69-2156b39ba7a3","Type":"ContainerDied","Data":"24cc81feb48879a69e8bd088a64555424b3a3825d67293712256b1b6f5cc5586"} Mar 16 15:57:41 crc kubenswrapper[5120]: I0316 15:57:41.257737 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"981363c3-7b22-430f-aa69-2156b39ba7a3","Type":"ContainerDied","Data":"767c5e376173d15e722f304017b45c525588371124341745a76554cf911699ac"} Mar 16 15:57:41 crc kubenswrapper[5120]: I0316 15:57:41.257769 5120 scope.go:117] "RemoveContainer" containerID="24cc81feb48879a69e8bd088a64555424b3a3825d67293712256b1b6f5cc5586" Mar 16 15:57:41 crc kubenswrapper[5120]: I0316 15:57:41.259300 5120 generic.go:358] "Generic (PLEG): container finished" podID="845bfa64-f68f-475c-b8fe-ffe27e42acdc" containerID="b884980f08f1614c3f23c5cb87d3d4638e85ecf8698ec49ee2836342dcf7cb4f" exitCode=137 Mar 16 15:57:41 crc kubenswrapper[5120]: I0316 15:57:41.260457 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"845bfa64-f68f-475c-b8fe-ffe27e42acdc","Type":"ContainerDied","Data":"b884980f08f1614c3f23c5cb87d3d4638e85ecf8698ec49ee2836342dcf7cb4f"} Mar 16 15:57:41 crc kubenswrapper[5120]: I0316 15:57:41.260484 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"845bfa64-f68f-475c-b8fe-ffe27e42acdc","Type":"ContainerDied","Data":"c96b7fd6bd8fd664150b350342b07f6d4774a9ae1e56176395e34e65d7bbe671"} Mar 16 15:57:41 crc kubenswrapper[5120]: I0316 15:57:41.260493 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c96b7fd6bd8fd664150b350342b07f6d4774a9ae1e56176395e34e65d7bbe671" Mar 16 15:57:41 crc kubenswrapper[5120]: I0316 15:57:41.275173 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 15:57:41 crc kubenswrapper[5120]: I0316 15:57:41.278680 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/981363c3-7b22-430f-aa69-2156b39ba7a3-config-data\") pod \"981363c3-7b22-430f-aa69-2156b39ba7a3\" (UID: \"981363c3-7b22-430f-aa69-2156b39ba7a3\") " Mar 16 15:57:41 crc kubenswrapper[5120]: I0316 15:57:41.279438 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-njdn4\" (UniqueName: \"kubernetes.io/projected/981363c3-7b22-430f-aa69-2156b39ba7a3-kube-api-access-njdn4\") pod \"981363c3-7b22-430f-aa69-2156b39ba7a3\" (UID: \"981363c3-7b22-430f-aa69-2156b39ba7a3\") " Mar 16 15:57:41 crc kubenswrapper[5120]: I0316 15:57:41.279819 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/981363c3-7b22-430f-aa69-2156b39ba7a3-combined-ca-bundle\") pod \"981363c3-7b22-430f-aa69-2156b39ba7a3\" (UID: \"981363c3-7b22-430f-aa69-2156b39ba7a3\") " Mar 16 15:57:41 crc kubenswrapper[5120]: I0316 15:57:41.285432 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/981363c3-7b22-430f-aa69-2156b39ba7a3-kube-api-access-njdn4" (OuterVolumeSpecName: "kube-api-access-njdn4") pod "981363c3-7b22-430f-aa69-2156b39ba7a3" (UID: "981363c3-7b22-430f-aa69-2156b39ba7a3"). InnerVolumeSpecName "kube-api-access-njdn4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:57:41 crc kubenswrapper[5120]: I0316 15:57:41.289457 5120 scope.go:117] "RemoveContainer" containerID="24cc81feb48879a69e8bd088a64555424b3a3825d67293712256b1b6f5cc5586" Mar 16 15:57:41 crc kubenswrapper[5120]: E0316 15:57:41.302250 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"24cc81feb48879a69e8bd088a64555424b3a3825d67293712256b1b6f5cc5586\": container with ID starting with 24cc81feb48879a69e8bd088a64555424b3a3825d67293712256b1b6f5cc5586 not found: ID does not exist" containerID="24cc81feb48879a69e8bd088a64555424b3a3825d67293712256b1b6f5cc5586" Mar 16 15:57:41 crc kubenswrapper[5120]: I0316 15:57:41.302322 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24cc81feb48879a69e8bd088a64555424b3a3825d67293712256b1b6f5cc5586"} err="failed to get container status \"24cc81feb48879a69e8bd088a64555424b3a3825d67293712256b1b6f5cc5586\": rpc error: code = NotFound desc = could not find container \"24cc81feb48879a69e8bd088a64555424b3a3825d67293712256b1b6f5cc5586\": container with ID starting with 24cc81feb48879a69e8bd088a64555424b3a3825d67293712256b1b6f5cc5586 not found: ID does not exist" Mar 16 15:57:41 crc kubenswrapper[5120]: I0316 15:57:41.339040 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/981363c3-7b22-430f-aa69-2156b39ba7a3-config-data" (OuterVolumeSpecName: "config-data") pod "981363c3-7b22-430f-aa69-2156b39ba7a3" (UID: "981363c3-7b22-430f-aa69-2156b39ba7a3"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:57:41 crc kubenswrapper[5120]: I0316 15:57:41.339461 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/981363c3-7b22-430f-aa69-2156b39ba7a3-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "981363c3-7b22-430f-aa69-2156b39ba7a3" (UID: "981363c3-7b22-430f-aa69-2156b39ba7a3"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:57:41 crc kubenswrapper[5120]: I0316 15:57:41.381875 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/845bfa64-f68f-475c-b8fe-ffe27e42acdc-combined-ca-bundle\") pod \"845bfa64-f68f-475c-b8fe-ffe27e42acdc\" (UID: \"845bfa64-f68f-475c-b8fe-ffe27e42acdc\") " Mar 16 15:57:41 crc kubenswrapper[5120]: I0316 15:57:41.382376 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cmvp6\" (UniqueName: \"kubernetes.io/projected/845bfa64-f68f-475c-b8fe-ffe27e42acdc-kube-api-access-cmvp6\") pod \"845bfa64-f68f-475c-b8fe-ffe27e42acdc\" (UID: \"845bfa64-f68f-475c-b8fe-ffe27e42acdc\") " Mar 16 15:57:41 crc kubenswrapper[5120]: I0316 15:57:41.382472 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/845bfa64-f68f-475c-b8fe-ffe27e42acdc-config-data\") pod \"845bfa64-f68f-475c-b8fe-ffe27e42acdc\" (UID: \"845bfa64-f68f-475c-b8fe-ffe27e42acdc\") " Mar 16 15:57:41 crc kubenswrapper[5120]: I0316 15:57:41.383014 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/981363c3-7b22-430f-aa69-2156b39ba7a3-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:57:41 crc kubenswrapper[5120]: I0316 15:57:41.383037 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/981363c3-7b22-430f-aa69-2156b39ba7a3-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 15:57:41 crc kubenswrapper[5120]: I0316 15:57:41.383050 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-njdn4\" (UniqueName: \"kubernetes.io/projected/981363c3-7b22-430f-aa69-2156b39ba7a3-kube-api-access-njdn4\") on node \"crc\" DevicePath \"\"" Mar 16 15:57:41 crc kubenswrapper[5120]: I0316 15:57:41.386965 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/845bfa64-f68f-475c-b8fe-ffe27e42acdc-kube-api-access-cmvp6" (OuterVolumeSpecName: "kube-api-access-cmvp6") pod "845bfa64-f68f-475c-b8fe-ffe27e42acdc" (UID: "845bfa64-f68f-475c-b8fe-ffe27e42acdc"). InnerVolumeSpecName "kube-api-access-cmvp6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:57:41 crc kubenswrapper[5120]: I0316 15:57:41.407899 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/845bfa64-f68f-475c-b8fe-ffe27e42acdc-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "845bfa64-f68f-475c-b8fe-ffe27e42acdc" (UID: "845bfa64-f68f-475c-b8fe-ffe27e42acdc"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:57:41 crc kubenswrapper[5120]: I0316 15:57:41.429363 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/845bfa64-f68f-475c-b8fe-ffe27e42acdc-config-data" (OuterVolumeSpecName: "config-data") pod "845bfa64-f68f-475c-b8fe-ffe27e42acdc" (UID: "845bfa64-f68f-475c-b8fe-ffe27e42acdc"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:57:41 crc kubenswrapper[5120]: I0316 15:57:41.485236 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cmvp6\" (UniqueName: \"kubernetes.io/projected/845bfa64-f68f-475c-b8fe-ffe27e42acdc-kube-api-access-cmvp6\") on node \"crc\" DevicePath \"\"" Mar 16 15:57:41 crc kubenswrapper[5120]: I0316 15:57:41.485291 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/845bfa64-f68f-475c-b8fe-ffe27e42acdc-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 15:57:41 crc kubenswrapper[5120]: I0316 15:57:41.485306 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/845bfa64-f68f-475c-b8fe-ffe27e42acdc-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:57:41 crc kubenswrapper[5120]: I0316 15:57:41.604268 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 15:57:41 crc kubenswrapper[5120]: I0316 15:57:41.616039 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 15:57:41 crc kubenswrapper[5120]: I0316 15:57:41.631369 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 15:57:41 crc kubenswrapper[5120]: I0316 15:57:41.633000 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="845bfa64-f68f-475c-b8fe-ffe27e42acdc" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 15:57:41 crc kubenswrapper[5120]: I0316 15:57:41.633040 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="845bfa64-f68f-475c-b8fe-ffe27e42acdc" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 15:57:41 crc kubenswrapper[5120]: I0316 15:57:41.633082 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="981363c3-7b22-430f-aa69-2156b39ba7a3" containerName="nova-scheduler-scheduler" Mar 16 15:57:41 crc kubenswrapper[5120]: I0316 15:57:41.633096 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="981363c3-7b22-430f-aa69-2156b39ba7a3" containerName="nova-scheduler-scheduler" Mar 16 15:57:41 crc kubenswrapper[5120]: I0316 15:57:41.633423 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="981363c3-7b22-430f-aa69-2156b39ba7a3" containerName="nova-scheduler-scheduler" Mar 16 15:57:41 crc kubenswrapper[5120]: I0316 15:57:41.633469 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="845bfa64-f68f-475c-b8fe-ffe27e42acdc" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 15:57:41 crc kubenswrapper[5120]: I0316 15:57:41.644233 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 15:57:41 crc kubenswrapper[5120]: I0316 15:57:41.644405 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 15:57:41 crc kubenswrapper[5120]: I0316 15:57:41.651252 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-scheduler-config-data\"" Mar 16 15:57:41 crc kubenswrapper[5120]: I0316 15:57:41.691573 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2093a744-47aa-4623-99ce-d001469addae-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"2093a744-47aa-4623-99ce-d001469addae\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 15:57:41 crc kubenswrapper[5120]: I0316 15:57:41.691780 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2093a744-47aa-4623-99ce-d001469addae-config-data\") pod \"nova-scheduler-0\" (UID: \"2093a744-47aa-4623-99ce-d001469addae\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 15:57:41 crc kubenswrapper[5120]: I0316 15:57:41.691917 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbc5c\" (UniqueName: \"kubernetes.io/projected/2093a744-47aa-4623-99ce-d001469addae-kube-api-access-rbc5c\") pod \"nova-scheduler-0\" (UID: \"2093a744-47aa-4623-99ce-d001469addae\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 15:57:41 crc kubenswrapper[5120]: I0316 15:57:41.794495 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2093a744-47aa-4623-99ce-d001469addae-config-data\") pod \"nova-scheduler-0\" (UID: \"2093a744-47aa-4623-99ce-d001469addae\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 15:57:41 crc kubenswrapper[5120]: I0316 15:57:41.794619 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rbc5c\" (UniqueName: \"kubernetes.io/projected/2093a744-47aa-4623-99ce-d001469addae-kube-api-access-rbc5c\") pod \"nova-scheduler-0\" (UID: \"2093a744-47aa-4623-99ce-d001469addae\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 15:57:41 crc kubenswrapper[5120]: I0316 15:57:41.794847 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2093a744-47aa-4623-99ce-d001469addae-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"2093a744-47aa-4623-99ce-d001469addae\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 15:57:41 crc kubenswrapper[5120]: I0316 15:57:41.799668 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2093a744-47aa-4623-99ce-d001469addae-config-data\") pod \"nova-scheduler-0\" (UID: \"2093a744-47aa-4623-99ce-d001469addae\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 15:57:41 crc kubenswrapper[5120]: I0316 15:57:41.799968 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2093a744-47aa-4623-99ce-d001469addae-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"2093a744-47aa-4623-99ce-d001469addae\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 15:57:41 crc kubenswrapper[5120]: I0316 15:57:41.815528 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbc5c\" (UniqueName: \"kubernetes.io/projected/2093a744-47aa-4623-99ce-d001469addae-kube-api-access-rbc5c\") pod \"nova-scheduler-0\" (UID: \"2093a744-47aa-4623-99ce-d001469addae\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 15:57:41 crc kubenswrapper[5120]: I0316 15:57:41.965249 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 15:57:42 crc kubenswrapper[5120]: I0316 15:57:42.271263 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 15:57:42 crc kubenswrapper[5120]: I0316 15:57:42.327079 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 15:57:42 crc kubenswrapper[5120]: I0316 15:57:42.342221 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 15:57:42 crc kubenswrapper[5120]: I0316 15:57:42.353255 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 15:57:42 crc kubenswrapper[5120]: I0316 15:57:42.359242 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 15:57:42 crc kubenswrapper[5120]: I0316 15:57:42.364718 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-novncproxy-cell1-public-svc\"" Mar 16 15:57:42 crc kubenswrapper[5120]: I0316 15:57:42.365054 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-novncproxy-cell1-vencrypt\"" Mar 16 15:57:42 crc kubenswrapper[5120]: I0316 15:57:42.365331 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-novncproxy-config-data\"" Mar 16 15:57:42 crc kubenswrapper[5120]: I0316 15:57:42.375327 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 15:57:42 crc kubenswrapper[5120]: I0316 15:57:42.408289 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5f40aae9-22bd-4ef7-b5ac-a68a1f729482-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"5f40aae9-22bd-4ef7-b5ac-a68a1f729482\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 15:57:42 crc kubenswrapper[5120]: I0316 15:57:42.408454 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5f40aae9-22bd-4ef7-b5ac-a68a1f729482-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"5f40aae9-22bd-4ef7-b5ac-a68a1f729482\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 15:57:42 crc kubenswrapper[5120]: I0316 15:57:42.408602 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/5f40aae9-22bd-4ef7-b5ac-a68a1f729482-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"5f40aae9-22bd-4ef7-b5ac-a68a1f729482\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 15:57:42 crc kubenswrapper[5120]: I0316 15:57:42.408893 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/5f40aae9-22bd-4ef7-b5ac-a68a1f729482-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"5f40aae9-22bd-4ef7-b5ac-a68a1f729482\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 15:57:42 crc kubenswrapper[5120]: I0316 15:57:42.409339 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ts9jd\" (UniqueName: \"kubernetes.io/projected/5f40aae9-22bd-4ef7-b5ac-a68a1f729482-kube-api-access-ts9jd\") pod \"nova-cell1-novncproxy-0\" (UID: \"5f40aae9-22bd-4ef7-b5ac-a68a1f729482\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 15:57:42 crc kubenswrapper[5120]: I0316 15:57:42.456783 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 15:57:42 crc kubenswrapper[5120]: I0316 15:57:42.474722 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:57:42 crc kubenswrapper[5120]: I0316 15:57:42.474807 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:57:42 crc kubenswrapper[5120]: I0316 15:57:42.513205 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/5f40aae9-22bd-4ef7-b5ac-a68a1f729482-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"5f40aae9-22bd-4ef7-b5ac-a68a1f729482\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 15:57:42 crc kubenswrapper[5120]: I0316 15:57:42.513367 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ts9jd\" (UniqueName: \"kubernetes.io/projected/5f40aae9-22bd-4ef7-b5ac-a68a1f729482-kube-api-access-ts9jd\") pod \"nova-cell1-novncproxy-0\" (UID: \"5f40aae9-22bd-4ef7-b5ac-a68a1f729482\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 15:57:42 crc kubenswrapper[5120]: I0316 15:57:42.513406 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5f40aae9-22bd-4ef7-b5ac-a68a1f729482-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"5f40aae9-22bd-4ef7-b5ac-a68a1f729482\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 15:57:42 crc kubenswrapper[5120]: I0316 15:57:42.513480 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5f40aae9-22bd-4ef7-b5ac-a68a1f729482-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"5f40aae9-22bd-4ef7-b5ac-a68a1f729482\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 15:57:42 crc kubenswrapper[5120]: I0316 15:57:42.513520 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/5f40aae9-22bd-4ef7-b5ac-a68a1f729482-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"5f40aae9-22bd-4ef7-b5ac-a68a1f729482\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 15:57:42 crc kubenswrapper[5120]: I0316 15:57:42.520901 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/5f40aae9-22bd-4ef7-b5ac-a68a1f729482-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"5f40aae9-22bd-4ef7-b5ac-a68a1f729482\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 15:57:42 crc kubenswrapper[5120]: I0316 15:57:42.521057 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5f40aae9-22bd-4ef7-b5ac-a68a1f729482-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"5f40aae9-22bd-4ef7-b5ac-a68a1f729482\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 15:57:42 crc kubenswrapper[5120]: I0316 15:57:42.523485 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/5f40aae9-22bd-4ef7-b5ac-a68a1f729482-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"5f40aae9-22bd-4ef7-b5ac-a68a1f729482\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 15:57:42 crc kubenswrapper[5120]: I0316 15:57:42.524121 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5f40aae9-22bd-4ef7-b5ac-a68a1f729482-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"5f40aae9-22bd-4ef7-b5ac-a68a1f729482\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 15:57:42 crc kubenswrapper[5120]: I0316 15:57:42.537027 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ts9jd\" (UniqueName: \"kubernetes.io/projected/5f40aae9-22bd-4ef7-b5ac-a68a1f729482-kube-api-access-ts9jd\") pod \"nova-cell1-novncproxy-0\" (UID: \"5f40aae9-22bd-4ef7-b5ac-a68a1f729482\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 15:57:42 crc kubenswrapper[5120]: I0316 15:57:42.691617 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="845bfa64-f68f-475c-b8fe-ffe27e42acdc" path="/var/lib/kubelet/pods/845bfa64-f68f-475c-b8fe-ffe27e42acdc/volumes" Mar 16 15:57:42 crc kubenswrapper[5120]: I0316 15:57:42.692895 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="981363c3-7b22-430f-aa69-2156b39ba7a3" path="/var/lib/kubelet/pods/981363c3-7b22-430f-aa69-2156b39ba7a3/volumes" Mar 16 15:57:42 crc kubenswrapper[5120]: I0316 15:57:42.713023 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 15:57:42 crc kubenswrapper[5120]: I0316 15:57:42.793583 5120 pod_container_manager_linux.go:217] "Failed to delete cgroup paths" cgroupName=["kubepods","besteffort","pod12829699-07a8-4cb4-8dbb-eb207c253f49"] err="unable to destroy cgroup paths for cgroup [kubepods besteffort pod12829699-07a8-4cb4-8dbb-eb207c253f49] : Timed out while waiting for systemd to remove kubepods-besteffort-pod12829699_07a8_4cb4_8dbb_eb207c253f49.slice" Mar 16 15:57:43 crc kubenswrapper[5120]: I0316 15:57:43.164231 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 15:57:43 crc kubenswrapper[5120]: W0316 15:57:43.169599 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5f40aae9_22bd_4ef7_b5ac_a68a1f729482.slice/crio-da7a660faa34ce0df16e76b67ffe6e4e16ccdc24b94c94e5b6b9e06537407cd5 WatchSource:0}: Error finding container da7a660faa34ce0df16e76b67ffe6e4e16ccdc24b94c94e5b6b9e06537407cd5: Status 404 returned error can't find the container with id da7a660faa34ce0df16e76b67ffe6e4e16ccdc24b94c94e5b6b9e06537407cd5 Mar 16 15:57:43 crc kubenswrapper[5120]: I0316 15:57:43.284739 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"5f40aae9-22bd-4ef7-b5ac-a68a1f729482","Type":"ContainerStarted","Data":"da7a660faa34ce0df16e76b67ffe6e4e16ccdc24b94c94e5b6b9e06537407cd5"} Mar 16 15:57:43 crc kubenswrapper[5120]: I0316 15:57:43.286781 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"2093a744-47aa-4623-99ce-d001469addae","Type":"ContainerStarted","Data":"908beac09cdf4678806ac05743ba414add53c4ab73a59367248c5fe0c26056da"} Mar 16 15:57:43 crc kubenswrapper[5120]: I0316 15:57:43.286846 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"2093a744-47aa-4623-99ce-d001469addae","Type":"ContainerStarted","Data":"b873044c8678850b99567c3cccc077f18edec8cec99ad6d25ad47e735e628416"} Mar 16 15:57:43 crc kubenswrapper[5120]: I0316 15:57:43.311901 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-scheduler-0" podStartSLOduration=2.311878374 podStartE2EDuration="2.311878374s" podCreationTimestamp="2026-03-16 15:57:41 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:57:43.307114131 +0000 UTC m=+1565.461045798" watchObservedRunningTime="2026-03-16 15:57:43.311878374 +0000 UTC m=+1565.465810041" Mar 16 15:57:44 crc kubenswrapper[5120]: I0316 15:57:44.303022 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"5f40aae9-22bd-4ef7-b5ac-a68a1f729482","Type":"ContainerStarted","Data":"d7bcbc11d57f7b382223d2be2730aa8ce601aa8b7b76169a7c140d7502ae92ac"} Mar 16 15:57:44 crc kubenswrapper[5120]: I0316 15:57:44.326092 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podStartSLOduration=2.326029153 podStartE2EDuration="2.326029153s" podCreationTimestamp="2026-03-16 15:57:42 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:57:44.322882436 +0000 UTC m=+1566.476814093" watchObservedRunningTime="2026-03-16 15:57:44.326029153 +0000 UTC m=+1566.479960830" Mar 16 15:57:44 crc kubenswrapper[5120]: I0316 15:57:44.482165 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:57:44 crc kubenswrapper[5120]: I0316 15:57:44.485136 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:57:44 crc kubenswrapper[5120]: I0316 15:57:44.489789 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:57:44 crc kubenswrapper[5120]: I0316 15:57:44.683183 5120 scope.go:117] "RemoveContainer" containerID="02ba4fc3f84eccaecfa9e6618280f65626eb76580c4af9ae7a9d7cb3b8dd590b" Mar 16 15:57:44 crc kubenswrapper[5120]: E0316 15:57:44.683632 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 15:57:45 crc kubenswrapper[5120]: I0316 15:57:45.328355 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:57:46 crc kubenswrapper[5120]: I0316 15:57:46.484416 5120 scope.go:117] "RemoveContainer" containerID="be52bb163ed3add057ca7098cd985f8c3ba5b69ecf92424bbd40d24fb51fdaa3" Mar 16 15:57:46 crc kubenswrapper[5120]: I0316 15:57:46.536053 5120 scope.go:117] "RemoveContainer" containerID="8963cb6ad3d59a9fc8df271576f76ce4d3cb638946306fc2113978691907e7ed" Mar 16 15:57:46 crc kubenswrapper[5120]: I0316 15:57:46.585977 5120 scope.go:117] "RemoveContainer" containerID="bfd0553412a6b7cc899b0fe6e8ed5a6f2cdf575d9656d1ba04bf51a02d573888" Mar 16 15:57:46 crc kubenswrapper[5120]: I0316 15:57:46.631541 5120 scope.go:117] "RemoveContainer" containerID="6cdcdcd328eec0f5033841269234934b99e5df8450bc25eb4a989d603135a07d" Mar 16 15:57:46 crc kubenswrapper[5120]: I0316 15:57:46.679609 5120 scope.go:117] "RemoveContainer" containerID="1c4b46f3f8f7a7cbd61606528b240ee9f66c088250fcf1c87e7d8987acf3131c" Mar 16 15:57:46 crc kubenswrapper[5120]: I0316 15:57:46.709314 5120 scope.go:117] "RemoveContainer" containerID="5beb51d5bb791063b06be012ed5435a350b1e205f8fa5e3c6377d8212b33d428" Mar 16 15:57:46 crc kubenswrapper[5120]: I0316 15:57:46.742946 5120 scope.go:117] "RemoveContainer" containerID="3384af102f5e21af38f70357dde5423094a7b97015a788c7ce82b5c8ddf617b2" Mar 16 15:57:46 crc kubenswrapper[5120]: I0316 15:57:46.763587 5120 scope.go:117] "RemoveContainer" containerID="9e3ca77b7dc91937211be72bb388d6e800aa4ca62b560a55eb833bbf6b8c4ddb" Mar 16 15:57:46 crc kubenswrapper[5120]: I0316 15:57:46.787584 5120 scope.go:117] "RemoveContainer" containerID="44ca4a64c687729eb62d16af5e7e27badb4c4bfe19b529f9419ce7491f5a92ca" Mar 16 15:57:46 crc kubenswrapper[5120]: I0316 15:57:46.966426 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 15:57:47 crc kubenswrapper[5120]: I0316 15:57:47.713885 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 15:57:47 crc kubenswrapper[5120]: I0316 15:57:47.885089 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:57:47 crc kubenswrapper[5120]: I0316 15:57:47.885212 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:57:49 crc kubenswrapper[5120]: I0316 15:57:49.888566 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:57:49 crc kubenswrapper[5120]: I0316 15:57:49.893240 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:57:49 crc kubenswrapper[5120]: I0316 15:57:49.894338 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:57:50 crc kubenswrapper[5120]: I0316 15:57:50.388113 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:57:51 crc kubenswrapper[5120]: I0316 15:57:51.966919 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 15:57:51 crc kubenswrapper[5120]: I0316 15:57:51.995455 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 15:57:52 crc kubenswrapper[5120]: I0316 15:57:52.433456 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 15:57:52 crc kubenswrapper[5120]: I0316 15:57:52.490845 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 15:57:52 crc kubenswrapper[5120]: I0316 15:57:52.491127 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="9e0e932c-14a5-4bfc-8cf2-aa748fe4db76" containerName="ceilometer-central-agent" containerID="cri-o://a58b7a0fe559dec3a96a721d58c8a80ce759baa48f19577f24beec5f1de319f6" gracePeriod=30 Mar 16 15:57:52 crc kubenswrapper[5120]: I0316 15:57:52.491239 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="9e0e932c-14a5-4bfc-8cf2-aa748fe4db76" containerName="ceilometer-notification-agent" containerID="cri-o://c15ddf7ad977bade2f108ad9e0b02075b2123784a32043289e7fc57fa6144f3d" gracePeriod=30 Mar 16 15:57:52 crc kubenswrapper[5120]: I0316 15:57:52.491264 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="9e0e932c-14a5-4bfc-8cf2-aa748fe4db76" containerName="sg-core" containerID="cri-o://f885a543fc2a0710cdab7dab8b5373b6bf1ceddee9c3f292591489498852ebe9" gracePeriod=30 Mar 16 15:57:52 crc kubenswrapper[5120]: I0316 15:57:52.491396 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="9e0e932c-14a5-4bfc-8cf2-aa748fe4db76" containerName="proxy-httpd" containerID="cri-o://8e3be09204e3c0d32204310f0d66382c5d2443da05657ec7520e1c8e242905ae" gracePeriod=30 Mar 16 15:57:52 crc kubenswrapper[5120]: I0316 15:57:52.503025 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/ceilometer-0" podUID="9e0e932c-14a5-4bfc-8cf2-aa748fe4db76" containerName="proxy-httpd" probeResult="failure" output="Get \"http://10.217.1.49:3000/\": EOF" Mar 16 15:57:52 crc kubenswrapper[5120]: I0316 15:57:52.718262 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 15:57:52 crc kubenswrapper[5120]: I0316 15:57:52.752279 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 15:57:53 crc kubenswrapper[5120]: I0316 15:57:53.343477 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:57:53 crc kubenswrapper[5120]: I0316 15:57:53.370562 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 15:57:53 crc kubenswrapper[5120]: I0316 15:57:53.424200 5120 generic.go:358] "Generic (PLEG): container finished" podID="9e0e932c-14a5-4bfc-8cf2-aa748fe4db76" containerID="8e3be09204e3c0d32204310f0d66382c5d2443da05657ec7520e1c8e242905ae" exitCode=0 Mar 16 15:57:53 crc kubenswrapper[5120]: I0316 15:57:53.424230 5120 generic.go:358] "Generic (PLEG): container finished" podID="9e0e932c-14a5-4bfc-8cf2-aa748fe4db76" containerID="f885a543fc2a0710cdab7dab8b5373b6bf1ceddee9c3f292591489498852ebe9" exitCode=2 Mar 16 15:57:53 crc kubenswrapper[5120]: I0316 15:57:53.424237 5120 generic.go:358] "Generic (PLEG): container finished" podID="9e0e932c-14a5-4bfc-8cf2-aa748fe4db76" containerID="c15ddf7ad977bade2f108ad9e0b02075b2123784a32043289e7fc57fa6144f3d" exitCode=0 Mar 16 15:57:53 crc kubenswrapper[5120]: I0316 15:57:53.424244 5120 generic.go:358] "Generic (PLEG): container finished" podID="9e0e932c-14a5-4bfc-8cf2-aa748fe4db76" containerID="a58b7a0fe559dec3a96a721d58c8a80ce759baa48f19577f24beec5f1de319f6" exitCode=0 Mar 16 15:57:53 crc kubenswrapper[5120]: I0316 15:57:53.424348 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:57:53 crc kubenswrapper[5120]: I0316 15:57:53.424394 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"9e0e932c-14a5-4bfc-8cf2-aa748fe4db76","Type":"ContainerDied","Data":"8e3be09204e3c0d32204310f0d66382c5d2443da05657ec7520e1c8e242905ae"} Mar 16 15:57:53 crc kubenswrapper[5120]: I0316 15:57:53.424424 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"9e0e932c-14a5-4bfc-8cf2-aa748fe4db76","Type":"ContainerDied","Data":"f885a543fc2a0710cdab7dab8b5373b6bf1ceddee9c3f292591489498852ebe9"} Mar 16 15:57:53 crc kubenswrapper[5120]: I0316 15:57:53.424437 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"9e0e932c-14a5-4bfc-8cf2-aa748fe4db76","Type":"ContainerDied","Data":"c15ddf7ad977bade2f108ad9e0b02075b2123784a32043289e7fc57fa6144f3d"} Mar 16 15:57:53 crc kubenswrapper[5120]: I0316 15:57:53.424448 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"9e0e932c-14a5-4bfc-8cf2-aa748fe4db76","Type":"ContainerDied","Data":"a58b7a0fe559dec3a96a721d58c8a80ce759baa48f19577f24beec5f1de319f6"} Mar 16 15:57:53 crc kubenswrapper[5120]: I0316 15:57:53.424456 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"9e0e932c-14a5-4bfc-8cf2-aa748fe4db76","Type":"ContainerDied","Data":"5cb746c36b556869ad66ffe152214b487db1c76b8d012a12d38e3dadc2339ba0"} Mar 16 15:57:53 crc kubenswrapper[5120]: I0316 15:57:53.424471 5120 scope.go:117] "RemoveContainer" containerID="8e3be09204e3c0d32204310f0d66382c5d2443da05657ec7520e1c8e242905ae" Mar 16 15:57:53 crc kubenswrapper[5120]: I0316 15:57:53.425173 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="dee0c2f4-0007-4e20-9da4-27d6e00c7dbe" containerName="nova-api-log" containerID="cri-o://e19649935001895bcea0084948683062a1f024cde3dd8c893b8acb2eadeee9fe" gracePeriod=30 Mar 16 15:57:53 crc kubenswrapper[5120]: I0316 15:57:53.425300 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="dee0c2f4-0007-4e20-9da4-27d6e00c7dbe" containerName="nova-api-api" containerID="cri-o://1b4dcbbfdaf99608a495b69520908bce258af504130da12d4a9ea15986cba303" gracePeriod=30 Mar 16 15:57:53 crc kubenswrapper[5120]: I0316 15:57:53.443435 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 15:57:53 crc kubenswrapper[5120]: I0316 15:57:53.448482 5120 scope.go:117] "RemoveContainer" containerID="f885a543fc2a0710cdab7dab8b5373b6bf1ceddee9c3f292591489498852ebe9" Mar 16 15:57:53 crc kubenswrapper[5120]: I0316 15:57:53.473244 5120 scope.go:117] "RemoveContainer" containerID="c15ddf7ad977bade2f108ad9e0b02075b2123784a32043289e7fc57fa6144f3d" Mar 16 15:57:53 crc kubenswrapper[5120]: I0316 15:57:53.485515 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fsxqn\" (UniqueName: \"kubernetes.io/projected/9e0e932c-14a5-4bfc-8cf2-aa748fe4db76-kube-api-access-fsxqn\") pod \"9e0e932c-14a5-4bfc-8cf2-aa748fe4db76\" (UID: \"9e0e932c-14a5-4bfc-8cf2-aa748fe4db76\") " Mar 16 15:57:53 crc kubenswrapper[5120]: I0316 15:57:53.485576 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9e0e932c-14a5-4bfc-8cf2-aa748fe4db76-scripts\") pod \"9e0e932c-14a5-4bfc-8cf2-aa748fe4db76\" (UID: \"9e0e932c-14a5-4bfc-8cf2-aa748fe4db76\") " Mar 16 15:57:53 crc kubenswrapper[5120]: I0316 15:57:53.485624 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/9e0e932c-14a5-4bfc-8cf2-aa748fe4db76-run-httpd\") pod \"9e0e932c-14a5-4bfc-8cf2-aa748fe4db76\" (UID: \"9e0e932c-14a5-4bfc-8cf2-aa748fe4db76\") " Mar 16 15:57:53 crc kubenswrapper[5120]: I0316 15:57:53.485684 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9e0e932c-14a5-4bfc-8cf2-aa748fe4db76-combined-ca-bundle\") pod \"9e0e932c-14a5-4bfc-8cf2-aa748fe4db76\" (UID: \"9e0e932c-14a5-4bfc-8cf2-aa748fe4db76\") " Mar 16 15:57:53 crc kubenswrapper[5120]: I0316 15:57:53.485738 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/9e0e932c-14a5-4bfc-8cf2-aa748fe4db76-sg-core-conf-yaml\") pod \"9e0e932c-14a5-4bfc-8cf2-aa748fe4db76\" (UID: \"9e0e932c-14a5-4bfc-8cf2-aa748fe4db76\") " Mar 16 15:57:53 crc kubenswrapper[5120]: I0316 15:57:53.485850 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/9e0e932c-14a5-4bfc-8cf2-aa748fe4db76-log-httpd\") pod \"9e0e932c-14a5-4bfc-8cf2-aa748fe4db76\" (UID: \"9e0e932c-14a5-4bfc-8cf2-aa748fe4db76\") " Mar 16 15:57:53 crc kubenswrapper[5120]: I0316 15:57:53.485868 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9e0e932c-14a5-4bfc-8cf2-aa748fe4db76-config-data\") pod \"9e0e932c-14a5-4bfc-8cf2-aa748fe4db76\" (UID: \"9e0e932c-14a5-4bfc-8cf2-aa748fe4db76\") " Mar 16 15:57:53 crc kubenswrapper[5120]: I0316 15:57:53.486212 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e0e932c-14a5-4bfc-8cf2-aa748fe4db76-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "9e0e932c-14a5-4bfc-8cf2-aa748fe4db76" (UID: "9e0e932c-14a5-4bfc-8cf2-aa748fe4db76"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:57:53 crc kubenswrapper[5120]: I0316 15:57:53.486472 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e0e932c-14a5-4bfc-8cf2-aa748fe4db76-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "9e0e932c-14a5-4bfc-8cf2-aa748fe4db76" (UID: "9e0e932c-14a5-4bfc-8cf2-aa748fe4db76"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:57:53 crc kubenswrapper[5120]: I0316 15:57:53.499999 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e0e932c-14a5-4bfc-8cf2-aa748fe4db76-scripts" (OuterVolumeSpecName: "scripts") pod "9e0e932c-14a5-4bfc-8cf2-aa748fe4db76" (UID: "9e0e932c-14a5-4bfc-8cf2-aa748fe4db76"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:57:53 crc kubenswrapper[5120]: I0316 15:57:53.501722 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e0e932c-14a5-4bfc-8cf2-aa748fe4db76-kube-api-access-fsxqn" (OuterVolumeSpecName: "kube-api-access-fsxqn") pod "9e0e932c-14a5-4bfc-8cf2-aa748fe4db76" (UID: "9e0e932c-14a5-4bfc-8cf2-aa748fe4db76"). InnerVolumeSpecName "kube-api-access-fsxqn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:57:53 crc kubenswrapper[5120]: I0316 15:57:53.518471 5120 scope.go:117] "RemoveContainer" containerID="a58b7a0fe559dec3a96a721d58c8a80ce759baa48f19577f24beec5f1de319f6" Mar 16 15:57:53 crc kubenswrapper[5120]: I0316 15:57:53.544932 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e0e932c-14a5-4bfc-8cf2-aa748fe4db76-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "9e0e932c-14a5-4bfc-8cf2-aa748fe4db76" (UID: "9e0e932c-14a5-4bfc-8cf2-aa748fe4db76"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:57:53 crc kubenswrapper[5120]: I0316 15:57:53.554887 5120 scope.go:117] "RemoveContainer" containerID="8e3be09204e3c0d32204310f0d66382c5d2443da05657ec7520e1c8e242905ae" Mar 16 15:57:53 crc kubenswrapper[5120]: E0316 15:57:53.558876 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e3be09204e3c0d32204310f0d66382c5d2443da05657ec7520e1c8e242905ae\": container with ID starting with 8e3be09204e3c0d32204310f0d66382c5d2443da05657ec7520e1c8e242905ae not found: ID does not exist" containerID="8e3be09204e3c0d32204310f0d66382c5d2443da05657ec7520e1c8e242905ae" Mar 16 15:57:53 crc kubenswrapper[5120]: I0316 15:57:53.558989 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e3be09204e3c0d32204310f0d66382c5d2443da05657ec7520e1c8e242905ae"} err="failed to get container status \"8e3be09204e3c0d32204310f0d66382c5d2443da05657ec7520e1c8e242905ae\": rpc error: code = NotFound desc = could not find container \"8e3be09204e3c0d32204310f0d66382c5d2443da05657ec7520e1c8e242905ae\": container with ID starting with 8e3be09204e3c0d32204310f0d66382c5d2443da05657ec7520e1c8e242905ae not found: ID does not exist" Mar 16 15:57:53 crc kubenswrapper[5120]: I0316 15:57:53.559073 5120 scope.go:117] "RemoveContainer" containerID="f885a543fc2a0710cdab7dab8b5373b6bf1ceddee9c3f292591489498852ebe9" Mar 16 15:57:53 crc kubenswrapper[5120]: E0316 15:57:53.562826 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f885a543fc2a0710cdab7dab8b5373b6bf1ceddee9c3f292591489498852ebe9\": container with ID starting with f885a543fc2a0710cdab7dab8b5373b6bf1ceddee9c3f292591489498852ebe9 not found: ID does not exist" containerID="f885a543fc2a0710cdab7dab8b5373b6bf1ceddee9c3f292591489498852ebe9" Mar 16 15:57:53 crc kubenswrapper[5120]: I0316 15:57:53.562951 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f885a543fc2a0710cdab7dab8b5373b6bf1ceddee9c3f292591489498852ebe9"} err="failed to get container status \"f885a543fc2a0710cdab7dab8b5373b6bf1ceddee9c3f292591489498852ebe9\": rpc error: code = NotFound desc = could not find container \"f885a543fc2a0710cdab7dab8b5373b6bf1ceddee9c3f292591489498852ebe9\": container with ID starting with f885a543fc2a0710cdab7dab8b5373b6bf1ceddee9c3f292591489498852ebe9 not found: ID does not exist" Mar 16 15:57:53 crc kubenswrapper[5120]: I0316 15:57:53.563028 5120 scope.go:117] "RemoveContainer" containerID="c15ddf7ad977bade2f108ad9e0b02075b2123784a32043289e7fc57fa6144f3d" Mar 16 15:57:53 crc kubenswrapper[5120]: E0316 15:57:53.564602 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c15ddf7ad977bade2f108ad9e0b02075b2123784a32043289e7fc57fa6144f3d\": container with ID starting with c15ddf7ad977bade2f108ad9e0b02075b2123784a32043289e7fc57fa6144f3d not found: ID does not exist" containerID="c15ddf7ad977bade2f108ad9e0b02075b2123784a32043289e7fc57fa6144f3d" Mar 16 15:57:53 crc kubenswrapper[5120]: I0316 15:57:53.564709 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c15ddf7ad977bade2f108ad9e0b02075b2123784a32043289e7fc57fa6144f3d"} err="failed to get container status \"c15ddf7ad977bade2f108ad9e0b02075b2123784a32043289e7fc57fa6144f3d\": rpc error: code = NotFound desc = could not find container \"c15ddf7ad977bade2f108ad9e0b02075b2123784a32043289e7fc57fa6144f3d\": container with ID starting with c15ddf7ad977bade2f108ad9e0b02075b2123784a32043289e7fc57fa6144f3d not found: ID does not exist" Mar 16 15:57:53 crc kubenswrapper[5120]: I0316 15:57:53.564803 5120 scope.go:117] "RemoveContainer" containerID="a58b7a0fe559dec3a96a721d58c8a80ce759baa48f19577f24beec5f1de319f6" Mar 16 15:57:53 crc kubenswrapper[5120]: E0316 15:57:53.571827 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a58b7a0fe559dec3a96a721d58c8a80ce759baa48f19577f24beec5f1de319f6\": container with ID starting with a58b7a0fe559dec3a96a721d58c8a80ce759baa48f19577f24beec5f1de319f6 not found: ID does not exist" containerID="a58b7a0fe559dec3a96a721d58c8a80ce759baa48f19577f24beec5f1de319f6" Mar 16 15:57:53 crc kubenswrapper[5120]: I0316 15:57:53.571945 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a58b7a0fe559dec3a96a721d58c8a80ce759baa48f19577f24beec5f1de319f6"} err="failed to get container status \"a58b7a0fe559dec3a96a721d58c8a80ce759baa48f19577f24beec5f1de319f6\": rpc error: code = NotFound desc = could not find container \"a58b7a0fe559dec3a96a721d58c8a80ce759baa48f19577f24beec5f1de319f6\": container with ID starting with a58b7a0fe559dec3a96a721d58c8a80ce759baa48f19577f24beec5f1de319f6 not found: ID does not exist" Mar 16 15:57:53 crc kubenswrapper[5120]: I0316 15:57:53.572029 5120 scope.go:117] "RemoveContainer" containerID="8e3be09204e3c0d32204310f0d66382c5d2443da05657ec7520e1c8e242905ae" Mar 16 15:57:53 crc kubenswrapper[5120]: I0316 15:57:53.573182 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e3be09204e3c0d32204310f0d66382c5d2443da05657ec7520e1c8e242905ae"} err="failed to get container status \"8e3be09204e3c0d32204310f0d66382c5d2443da05657ec7520e1c8e242905ae\": rpc error: code = NotFound desc = could not find container \"8e3be09204e3c0d32204310f0d66382c5d2443da05657ec7520e1c8e242905ae\": container with ID starting with 8e3be09204e3c0d32204310f0d66382c5d2443da05657ec7520e1c8e242905ae not found: ID does not exist" Mar 16 15:57:53 crc kubenswrapper[5120]: I0316 15:57:53.573222 5120 scope.go:117] "RemoveContainer" containerID="f885a543fc2a0710cdab7dab8b5373b6bf1ceddee9c3f292591489498852ebe9" Mar 16 15:57:53 crc kubenswrapper[5120]: I0316 15:57:53.574085 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f885a543fc2a0710cdab7dab8b5373b6bf1ceddee9c3f292591489498852ebe9"} err="failed to get container status \"f885a543fc2a0710cdab7dab8b5373b6bf1ceddee9c3f292591489498852ebe9\": rpc error: code = NotFound desc = could not find container \"f885a543fc2a0710cdab7dab8b5373b6bf1ceddee9c3f292591489498852ebe9\": container with ID starting with f885a543fc2a0710cdab7dab8b5373b6bf1ceddee9c3f292591489498852ebe9 not found: ID does not exist" Mar 16 15:57:53 crc kubenswrapper[5120]: I0316 15:57:53.574328 5120 scope.go:117] "RemoveContainer" containerID="c15ddf7ad977bade2f108ad9e0b02075b2123784a32043289e7fc57fa6144f3d" Mar 16 15:57:53 crc kubenswrapper[5120]: I0316 15:57:53.574606 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c15ddf7ad977bade2f108ad9e0b02075b2123784a32043289e7fc57fa6144f3d"} err="failed to get container status \"c15ddf7ad977bade2f108ad9e0b02075b2123784a32043289e7fc57fa6144f3d\": rpc error: code = NotFound desc = could not find container \"c15ddf7ad977bade2f108ad9e0b02075b2123784a32043289e7fc57fa6144f3d\": container with ID starting with c15ddf7ad977bade2f108ad9e0b02075b2123784a32043289e7fc57fa6144f3d not found: ID does not exist" Mar 16 15:57:53 crc kubenswrapper[5120]: I0316 15:57:53.574625 5120 scope.go:117] "RemoveContainer" containerID="a58b7a0fe559dec3a96a721d58c8a80ce759baa48f19577f24beec5f1de319f6" Mar 16 15:57:53 crc kubenswrapper[5120]: I0316 15:57:53.574884 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a58b7a0fe559dec3a96a721d58c8a80ce759baa48f19577f24beec5f1de319f6"} err="failed to get container status \"a58b7a0fe559dec3a96a721d58c8a80ce759baa48f19577f24beec5f1de319f6\": rpc error: code = NotFound desc = could not find container \"a58b7a0fe559dec3a96a721d58c8a80ce759baa48f19577f24beec5f1de319f6\": container with ID starting with a58b7a0fe559dec3a96a721d58c8a80ce759baa48f19577f24beec5f1de319f6 not found: ID does not exist" Mar 16 15:57:53 crc kubenswrapper[5120]: I0316 15:57:53.574934 5120 scope.go:117] "RemoveContainer" containerID="8e3be09204e3c0d32204310f0d66382c5d2443da05657ec7520e1c8e242905ae" Mar 16 15:57:53 crc kubenswrapper[5120]: I0316 15:57:53.575241 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e3be09204e3c0d32204310f0d66382c5d2443da05657ec7520e1c8e242905ae"} err="failed to get container status \"8e3be09204e3c0d32204310f0d66382c5d2443da05657ec7520e1c8e242905ae\": rpc error: code = NotFound desc = could not find container \"8e3be09204e3c0d32204310f0d66382c5d2443da05657ec7520e1c8e242905ae\": container with ID starting with 8e3be09204e3c0d32204310f0d66382c5d2443da05657ec7520e1c8e242905ae not found: ID does not exist" Mar 16 15:57:53 crc kubenswrapper[5120]: I0316 15:57:53.575261 5120 scope.go:117] "RemoveContainer" containerID="f885a543fc2a0710cdab7dab8b5373b6bf1ceddee9c3f292591489498852ebe9" Mar 16 15:57:53 crc kubenswrapper[5120]: I0316 15:57:53.575672 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f885a543fc2a0710cdab7dab8b5373b6bf1ceddee9c3f292591489498852ebe9"} err="failed to get container status \"f885a543fc2a0710cdab7dab8b5373b6bf1ceddee9c3f292591489498852ebe9\": rpc error: code = NotFound desc = could not find container \"f885a543fc2a0710cdab7dab8b5373b6bf1ceddee9c3f292591489498852ebe9\": container with ID starting with f885a543fc2a0710cdab7dab8b5373b6bf1ceddee9c3f292591489498852ebe9 not found: ID does not exist" Mar 16 15:57:53 crc kubenswrapper[5120]: I0316 15:57:53.575693 5120 scope.go:117] "RemoveContainer" containerID="c15ddf7ad977bade2f108ad9e0b02075b2123784a32043289e7fc57fa6144f3d" Mar 16 15:57:53 crc kubenswrapper[5120]: I0316 15:57:53.575901 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c15ddf7ad977bade2f108ad9e0b02075b2123784a32043289e7fc57fa6144f3d"} err="failed to get container status \"c15ddf7ad977bade2f108ad9e0b02075b2123784a32043289e7fc57fa6144f3d\": rpc error: code = NotFound desc = could not find container \"c15ddf7ad977bade2f108ad9e0b02075b2123784a32043289e7fc57fa6144f3d\": container with ID starting with c15ddf7ad977bade2f108ad9e0b02075b2123784a32043289e7fc57fa6144f3d not found: ID does not exist" Mar 16 15:57:53 crc kubenswrapper[5120]: I0316 15:57:53.575921 5120 scope.go:117] "RemoveContainer" containerID="a58b7a0fe559dec3a96a721d58c8a80ce759baa48f19577f24beec5f1de319f6" Mar 16 15:57:53 crc kubenswrapper[5120]: I0316 15:57:53.576291 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a58b7a0fe559dec3a96a721d58c8a80ce759baa48f19577f24beec5f1de319f6"} err="failed to get container status \"a58b7a0fe559dec3a96a721d58c8a80ce759baa48f19577f24beec5f1de319f6\": rpc error: code = NotFound desc = could not find container \"a58b7a0fe559dec3a96a721d58c8a80ce759baa48f19577f24beec5f1de319f6\": container with ID starting with a58b7a0fe559dec3a96a721d58c8a80ce759baa48f19577f24beec5f1de319f6 not found: ID does not exist" Mar 16 15:57:53 crc kubenswrapper[5120]: I0316 15:57:53.576309 5120 scope.go:117] "RemoveContainer" containerID="8e3be09204e3c0d32204310f0d66382c5d2443da05657ec7520e1c8e242905ae" Mar 16 15:57:53 crc kubenswrapper[5120]: I0316 15:57:53.578595 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e3be09204e3c0d32204310f0d66382c5d2443da05657ec7520e1c8e242905ae"} err="failed to get container status \"8e3be09204e3c0d32204310f0d66382c5d2443da05657ec7520e1c8e242905ae\": rpc error: code = NotFound desc = could not find container \"8e3be09204e3c0d32204310f0d66382c5d2443da05657ec7520e1c8e242905ae\": container with ID starting with 8e3be09204e3c0d32204310f0d66382c5d2443da05657ec7520e1c8e242905ae not found: ID does not exist" Mar 16 15:57:53 crc kubenswrapper[5120]: I0316 15:57:53.578618 5120 scope.go:117] "RemoveContainer" containerID="f885a543fc2a0710cdab7dab8b5373b6bf1ceddee9c3f292591489498852ebe9" Mar 16 15:57:53 crc kubenswrapper[5120]: I0316 15:57:53.578859 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f885a543fc2a0710cdab7dab8b5373b6bf1ceddee9c3f292591489498852ebe9"} err="failed to get container status \"f885a543fc2a0710cdab7dab8b5373b6bf1ceddee9c3f292591489498852ebe9\": rpc error: code = NotFound desc = could not find container \"f885a543fc2a0710cdab7dab8b5373b6bf1ceddee9c3f292591489498852ebe9\": container with ID starting with f885a543fc2a0710cdab7dab8b5373b6bf1ceddee9c3f292591489498852ebe9 not found: ID does not exist" Mar 16 15:57:53 crc kubenswrapper[5120]: I0316 15:57:53.578880 5120 scope.go:117] "RemoveContainer" containerID="c15ddf7ad977bade2f108ad9e0b02075b2123784a32043289e7fc57fa6144f3d" Mar 16 15:57:53 crc kubenswrapper[5120]: I0316 15:57:53.579177 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c15ddf7ad977bade2f108ad9e0b02075b2123784a32043289e7fc57fa6144f3d"} err="failed to get container status \"c15ddf7ad977bade2f108ad9e0b02075b2123784a32043289e7fc57fa6144f3d\": rpc error: code = NotFound desc = could not find container \"c15ddf7ad977bade2f108ad9e0b02075b2123784a32043289e7fc57fa6144f3d\": container with ID starting with c15ddf7ad977bade2f108ad9e0b02075b2123784a32043289e7fc57fa6144f3d not found: ID does not exist" Mar 16 15:57:53 crc kubenswrapper[5120]: I0316 15:57:53.579205 5120 scope.go:117] "RemoveContainer" containerID="a58b7a0fe559dec3a96a721d58c8a80ce759baa48f19577f24beec5f1de319f6" Mar 16 15:57:53 crc kubenswrapper[5120]: I0316 15:57:53.579441 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a58b7a0fe559dec3a96a721d58c8a80ce759baa48f19577f24beec5f1de319f6"} err="failed to get container status \"a58b7a0fe559dec3a96a721d58c8a80ce759baa48f19577f24beec5f1de319f6\": rpc error: code = NotFound desc = could not find container \"a58b7a0fe559dec3a96a721d58c8a80ce759baa48f19577f24beec5f1de319f6\": container with ID starting with a58b7a0fe559dec3a96a721d58c8a80ce759baa48f19577f24beec5f1de319f6 not found: ID does not exist" Mar 16 15:57:53 crc kubenswrapper[5120]: I0316 15:57:53.579945 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e0e932c-14a5-4bfc-8cf2-aa748fe4db76-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "9e0e932c-14a5-4bfc-8cf2-aa748fe4db76" (UID: "9e0e932c-14a5-4bfc-8cf2-aa748fe4db76"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:57:53 crc kubenswrapper[5120]: I0316 15:57:53.588331 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/9e0e932c-14a5-4bfc-8cf2-aa748fe4db76-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 15:57:53 crc kubenswrapper[5120]: I0316 15:57:53.588352 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9e0e932c-14a5-4bfc-8cf2-aa748fe4db76-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:57:53 crc kubenswrapper[5120]: I0316 15:57:53.588364 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/9e0e932c-14a5-4bfc-8cf2-aa748fe4db76-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 15:57:53 crc kubenswrapper[5120]: I0316 15:57:53.588374 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/9e0e932c-14a5-4bfc-8cf2-aa748fe4db76-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 15:57:53 crc kubenswrapper[5120]: I0316 15:57:53.588382 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fsxqn\" (UniqueName: \"kubernetes.io/projected/9e0e932c-14a5-4bfc-8cf2-aa748fe4db76-kube-api-access-fsxqn\") on node \"crc\" DevicePath \"\"" Mar 16 15:57:53 crc kubenswrapper[5120]: I0316 15:57:53.588390 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9e0e932c-14a5-4bfc-8cf2-aa748fe4db76-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 15:57:53 crc kubenswrapper[5120]: I0316 15:57:53.621715 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e0e932c-14a5-4bfc-8cf2-aa748fe4db76-config-data" (OuterVolumeSpecName: "config-data") pod "9e0e932c-14a5-4bfc-8cf2-aa748fe4db76" (UID: "9e0e932c-14a5-4bfc-8cf2-aa748fe4db76"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:57:53 crc kubenswrapper[5120]: I0316 15:57:53.669351 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-gbpjc"] Mar 16 15:57:53 crc kubenswrapper[5120]: I0316 15:57:53.670352 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e0e932c-14a5-4bfc-8cf2-aa748fe4db76" containerName="sg-core" Mar 16 15:57:53 crc kubenswrapper[5120]: I0316 15:57:53.670372 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e0e932c-14a5-4bfc-8cf2-aa748fe4db76" containerName="sg-core" Mar 16 15:57:53 crc kubenswrapper[5120]: I0316 15:57:53.670416 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e0e932c-14a5-4bfc-8cf2-aa748fe4db76" containerName="ceilometer-central-agent" Mar 16 15:57:53 crc kubenswrapper[5120]: I0316 15:57:53.670422 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e0e932c-14a5-4bfc-8cf2-aa748fe4db76" containerName="ceilometer-central-agent" Mar 16 15:57:53 crc kubenswrapper[5120]: I0316 15:57:53.670443 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e0e932c-14a5-4bfc-8cf2-aa748fe4db76" containerName="ceilometer-notification-agent" Mar 16 15:57:53 crc kubenswrapper[5120]: I0316 15:57:53.670454 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e0e932c-14a5-4bfc-8cf2-aa748fe4db76" containerName="ceilometer-notification-agent" Mar 16 15:57:53 crc kubenswrapper[5120]: I0316 15:57:53.670475 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e0e932c-14a5-4bfc-8cf2-aa748fe4db76" containerName="proxy-httpd" Mar 16 15:57:53 crc kubenswrapper[5120]: I0316 15:57:53.670481 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e0e932c-14a5-4bfc-8cf2-aa748fe4db76" containerName="proxy-httpd" Mar 16 15:57:53 crc kubenswrapper[5120]: I0316 15:57:53.670631 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="9e0e932c-14a5-4bfc-8cf2-aa748fe4db76" containerName="ceilometer-notification-agent" Mar 16 15:57:53 crc kubenswrapper[5120]: I0316 15:57:53.670643 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="9e0e932c-14a5-4bfc-8cf2-aa748fe4db76" containerName="proxy-httpd" Mar 16 15:57:53 crc kubenswrapper[5120]: I0316 15:57:53.670655 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="9e0e932c-14a5-4bfc-8cf2-aa748fe4db76" containerName="sg-core" Mar 16 15:57:53 crc kubenswrapper[5120]: I0316 15:57:53.670673 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="9e0e932c-14a5-4bfc-8cf2-aa748fe4db76" containerName="ceilometer-central-agent" Mar 16 15:57:53 crc kubenswrapper[5120]: I0316 15:57:53.676631 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-gbpjc" Mar 16 15:57:53 crc kubenswrapper[5120]: I0316 15:57:53.680642 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-manage-config-data\"" Mar 16 15:57:53 crc kubenswrapper[5120]: I0316 15:57:53.680885 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-manage-scripts\"" Mar 16 15:57:53 crc kubenswrapper[5120]: I0316 15:57:53.684595 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-gbpjc"] Mar 16 15:57:53 crc kubenswrapper[5120]: I0316 15:57:53.698330 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9e0e932c-14a5-4bfc-8cf2-aa748fe4db76-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 15:57:53 crc kubenswrapper[5120]: I0316 15:57:53.755905 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 15:57:53 crc kubenswrapper[5120]: I0316 15:57:53.770409 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 15:57:53 crc kubenswrapper[5120]: I0316 15:57:53.791531 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 15:57:53 crc kubenswrapper[5120]: I0316 15:57:53.800224 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ndhv4\" (UniqueName: \"kubernetes.io/projected/efbef5eb-902c-46b3-ba4c-5c31917acf20-kube-api-access-ndhv4\") pod \"nova-cell1-cell-mapping-gbpjc\" (UID: \"efbef5eb-902c-46b3-ba4c-5c31917acf20\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-gbpjc" Mar 16 15:57:53 crc kubenswrapper[5120]: I0316 15:57:53.800308 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/efbef5eb-902c-46b3-ba4c-5c31917acf20-scripts\") pod \"nova-cell1-cell-mapping-gbpjc\" (UID: \"efbef5eb-902c-46b3-ba4c-5c31917acf20\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-gbpjc" Mar 16 15:57:53 crc kubenswrapper[5120]: I0316 15:57:53.800346 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/efbef5eb-902c-46b3-ba4c-5c31917acf20-config-data\") pod \"nova-cell1-cell-mapping-gbpjc\" (UID: \"efbef5eb-902c-46b3-ba4c-5c31917acf20\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-gbpjc" Mar 16 15:57:53 crc kubenswrapper[5120]: I0316 15:57:53.800469 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/efbef5eb-902c-46b3-ba4c-5c31917acf20-combined-ca-bundle\") pod \"nova-cell1-cell-mapping-gbpjc\" (UID: \"efbef5eb-902c-46b3-ba4c-5c31917acf20\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-gbpjc" Mar 16 15:57:53 crc kubenswrapper[5120]: I0316 15:57:53.802164 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 15:57:53 crc kubenswrapper[5120]: I0316 15:57:53.802296 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:57:53 crc kubenswrapper[5120]: I0316 15:57:53.805186 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 15:57:53 crc kubenswrapper[5120]: I0316 15:57:53.805423 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 15:57:53 crc kubenswrapper[5120]: I0316 15:57:53.902659 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/efbef5eb-902c-46b3-ba4c-5c31917acf20-scripts\") pod \"nova-cell1-cell-mapping-gbpjc\" (UID: \"efbef5eb-902c-46b3-ba4c-5c31917acf20\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-gbpjc" Mar 16 15:57:53 crc kubenswrapper[5120]: I0316 15:57:53.902724 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/efbef5eb-902c-46b3-ba4c-5c31917acf20-config-data\") pod \"nova-cell1-cell-mapping-gbpjc\" (UID: \"efbef5eb-902c-46b3-ba4c-5c31917acf20\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-gbpjc" Mar 16 15:57:53 crc kubenswrapper[5120]: I0316 15:57:53.902815 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/efbef5eb-902c-46b3-ba4c-5c31917acf20-combined-ca-bundle\") pod \"nova-cell1-cell-mapping-gbpjc\" (UID: \"efbef5eb-902c-46b3-ba4c-5c31917acf20\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-gbpjc" Mar 16 15:57:53 crc kubenswrapper[5120]: I0316 15:57:53.902858 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ccea3155-4cc4-4790-8a1d-3f6ebe2d0dcd-run-httpd\") pod \"ceilometer-0\" (UID: \"ccea3155-4cc4-4790-8a1d-3f6ebe2d0dcd\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:57:53 crc kubenswrapper[5120]: I0316 15:57:53.902882 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ccea3155-4cc4-4790-8a1d-3f6ebe2d0dcd-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"ccea3155-4cc4-4790-8a1d-3f6ebe2d0dcd\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:57:53 crc kubenswrapper[5120]: I0316 15:57:53.902965 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ccea3155-4cc4-4790-8a1d-3f6ebe2d0dcd-config-data\") pod \"ceilometer-0\" (UID: \"ccea3155-4cc4-4790-8a1d-3f6ebe2d0dcd\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:57:53 crc kubenswrapper[5120]: I0316 15:57:53.902982 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ccea3155-4cc4-4790-8a1d-3f6ebe2d0dcd-log-httpd\") pod \"ceilometer-0\" (UID: \"ccea3155-4cc4-4790-8a1d-3f6ebe2d0dcd\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:57:53 crc kubenswrapper[5120]: I0316 15:57:53.903025 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/ccea3155-4cc4-4790-8a1d-3f6ebe2d0dcd-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"ccea3155-4cc4-4790-8a1d-3f6ebe2d0dcd\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:57:53 crc kubenswrapper[5120]: I0316 15:57:53.903045 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ccea3155-4cc4-4790-8a1d-3f6ebe2d0dcd-scripts\") pod \"ceilometer-0\" (UID: \"ccea3155-4cc4-4790-8a1d-3f6ebe2d0dcd\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:57:53 crc kubenswrapper[5120]: I0316 15:57:53.903168 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9tlv\" (UniqueName: \"kubernetes.io/projected/ccea3155-4cc4-4790-8a1d-3f6ebe2d0dcd-kube-api-access-s9tlv\") pod \"ceilometer-0\" (UID: \"ccea3155-4cc4-4790-8a1d-3f6ebe2d0dcd\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:57:53 crc kubenswrapper[5120]: I0316 15:57:53.903285 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ndhv4\" (UniqueName: \"kubernetes.io/projected/efbef5eb-902c-46b3-ba4c-5c31917acf20-kube-api-access-ndhv4\") pod \"nova-cell1-cell-mapping-gbpjc\" (UID: \"efbef5eb-902c-46b3-ba4c-5c31917acf20\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-gbpjc" Mar 16 15:57:53 crc kubenswrapper[5120]: I0316 15:57:53.907296 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/efbef5eb-902c-46b3-ba4c-5c31917acf20-combined-ca-bundle\") pod \"nova-cell1-cell-mapping-gbpjc\" (UID: \"efbef5eb-902c-46b3-ba4c-5c31917acf20\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-gbpjc" Mar 16 15:57:53 crc kubenswrapper[5120]: I0316 15:57:53.907779 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/efbef5eb-902c-46b3-ba4c-5c31917acf20-config-data\") pod \"nova-cell1-cell-mapping-gbpjc\" (UID: \"efbef5eb-902c-46b3-ba4c-5c31917acf20\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-gbpjc" Mar 16 15:57:53 crc kubenswrapper[5120]: I0316 15:57:53.909343 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/efbef5eb-902c-46b3-ba4c-5c31917acf20-scripts\") pod \"nova-cell1-cell-mapping-gbpjc\" (UID: \"efbef5eb-902c-46b3-ba4c-5c31917acf20\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-gbpjc" Mar 16 15:57:53 crc kubenswrapper[5120]: I0316 15:57:53.920906 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ndhv4\" (UniqueName: \"kubernetes.io/projected/efbef5eb-902c-46b3-ba4c-5c31917acf20-kube-api-access-ndhv4\") pod \"nova-cell1-cell-mapping-gbpjc\" (UID: \"efbef5eb-902c-46b3-ba4c-5c31917acf20\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-gbpjc" Mar 16 15:57:54 crc kubenswrapper[5120]: I0316 15:57:54.004542 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ccea3155-4cc4-4790-8a1d-3f6ebe2d0dcd-run-httpd\") pod \"ceilometer-0\" (UID: \"ccea3155-4cc4-4790-8a1d-3f6ebe2d0dcd\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:57:54 crc kubenswrapper[5120]: I0316 15:57:54.004587 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ccea3155-4cc4-4790-8a1d-3f6ebe2d0dcd-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"ccea3155-4cc4-4790-8a1d-3f6ebe2d0dcd\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:57:54 crc kubenswrapper[5120]: I0316 15:57:54.004783 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ccea3155-4cc4-4790-8a1d-3f6ebe2d0dcd-config-data\") pod \"ceilometer-0\" (UID: \"ccea3155-4cc4-4790-8a1d-3f6ebe2d0dcd\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:57:54 crc kubenswrapper[5120]: I0316 15:57:54.005054 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ccea3155-4cc4-4790-8a1d-3f6ebe2d0dcd-run-httpd\") pod \"ceilometer-0\" (UID: \"ccea3155-4cc4-4790-8a1d-3f6ebe2d0dcd\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:57:54 crc kubenswrapper[5120]: I0316 15:57:54.005155 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ccea3155-4cc4-4790-8a1d-3f6ebe2d0dcd-log-httpd\") pod \"ceilometer-0\" (UID: \"ccea3155-4cc4-4790-8a1d-3f6ebe2d0dcd\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:57:54 crc kubenswrapper[5120]: I0316 15:57:54.005189 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/ccea3155-4cc4-4790-8a1d-3f6ebe2d0dcd-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"ccea3155-4cc4-4790-8a1d-3f6ebe2d0dcd\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:57:54 crc kubenswrapper[5120]: I0316 15:57:54.005209 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ccea3155-4cc4-4790-8a1d-3f6ebe2d0dcd-scripts\") pod \"ceilometer-0\" (UID: \"ccea3155-4cc4-4790-8a1d-3f6ebe2d0dcd\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:57:54 crc kubenswrapper[5120]: I0316 15:57:54.005257 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s9tlv\" (UniqueName: \"kubernetes.io/projected/ccea3155-4cc4-4790-8a1d-3f6ebe2d0dcd-kube-api-access-s9tlv\") pod \"ceilometer-0\" (UID: \"ccea3155-4cc4-4790-8a1d-3f6ebe2d0dcd\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:57:54 crc kubenswrapper[5120]: I0316 15:57:54.005732 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ccea3155-4cc4-4790-8a1d-3f6ebe2d0dcd-log-httpd\") pod \"ceilometer-0\" (UID: \"ccea3155-4cc4-4790-8a1d-3f6ebe2d0dcd\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:57:54 crc kubenswrapper[5120]: I0316 15:57:54.010700 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ccea3155-4cc4-4790-8a1d-3f6ebe2d0dcd-config-data\") pod \"ceilometer-0\" (UID: \"ccea3155-4cc4-4790-8a1d-3f6ebe2d0dcd\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:57:54 crc kubenswrapper[5120]: I0316 15:57:54.012650 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ccea3155-4cc4-4790-8a1d-3f6ebe2d0dcd-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"ccea3155-4cc4-4790-8a1d-3f6ebe2d0dcd\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:57:54 crc kubenswrapper[5120]: I0316 15:57:54.017488 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ccea3155-4cc4-4790-8a1d-3f6ebe2d0dcd-scripts\") pod \"ceilometer-0\" (UID: \"ccea3155-4cc4-4790-8a1d-3f6ebe2d0dcd\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:57:54 crc kubenswrapper[5120]: I0316 15:57:54.018781 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/ccea3155-4cc4-4790-8a1d-3f6ebe2d0dcd-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"ccea3155-4cc4-4790-8a1d-3f6ebe2d0dcd\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:57:54 crc kubenswrapper[5120]: I0316 15:57:54.031228 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-gbpjc" Mar 16 15:57:54 crc kubenswrapper[5120]: I0316 15:57:54.033443 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9tlv\" (UniqueName: \"kubernetes.io/projected/ccea3155-4cc4-4790-8a1d-3f6ebe2d0dcd-kube-api-access-s9tlv\") pod \"ceilometer-0\" (UID: \"ccea3155-4cc4-4790-8a1d-3f6ebe2d0dcd\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:57:54 crc kubenswrapper[5120]: I0316 15:57:54.125362 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:57:54 crc kubenswrapper[5120]: I0316 15:57:54.437961 5120 generic.go:358] "Generic (PLEG): container finished" podID="dee0c2f4-0007-4e20-9da4-27d6e00c7dbe" containerID="e19649935001895bcea0084948683062a1f024cde3dd8c893b8acb2eadeee9fe" exitCode=143 Mar 16 15:57:54 crc kubenswrapper[5120]: I0316 15:57:54.438062 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"dee0c2f4-0007-4e20-9da4-27d6e00c7dbe","Type":"ContainerDied","Data":"e19649935001895bcea0084948683062a1f024cde3dd8c893b8acb2eadeee9fe"} Mar 16 15:57:54 crc kubenswrapper[5120]: I0316 15:57:54.515578 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 15:57:54 crc kubenswrapper[5120]: I0316 15:57:54.540721 5120 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Mar 16 15:57:54 crc kubenswrapper[5120]: I0316 15:57:54.545091 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-gbpjc"] Mar 16 15:57:54 crc kubenswrapper[5120]: I0316 15:57:54.621548 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 15:57:54 crc kubenswrapper[5120]: W0316 15:57:54.636654 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podccea3155_4cc4_4790_8a1d_3f6ebe2d0dcd.slice/crio-7624e738decb671c1ddc0ec1f3e78f1afefa0176a8bdd5e45a3346758c7436a0 WatchSource:0}: Error finding container 7624e738decb671c1ddc0ec1f3e78f1afefa0176a8bdd5e45a3346758c7436a0: Status 404 returned error can't find the container with id 7624e738decb671c1ddc0ec1f3e78f1afefa0176a8bdd5e45a3346758c7436a0 Mar 16 15:57:54 crc kubenswrapper[5120]: I0316 15:57:54.677496 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9e0e932c-14a5-4bfc-8cf2-aa748fe4db76" path="/var/lib/kubelet/pods/9e0e932c-14a5-4bfc-8cf2-aa748fe4db76/volumes" Mar 16 15:57:55 crc kubenswrapper[5120]: I0316 15:57:55.457143 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ccea3155-4cc4-4790-8a1d-3f6ebe2d0dcd","Type":"ContainerStarted","Data":"e6ef1e16a9f1dbd30b2839b569e850a5aff07988979f9ef0517727f364aa14e1"} Mar 16 15:57:55 crc kubenswrapper[5120]: I0316 15:57:55.457536 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ccea3155-4cc4-4790-8a1d-3f6ebe2d0dcd","Type":"ContainerStarted","Data":"7624e738decb671c1ddc0ec1f3e78f1afefa0176a8bdd5e45a3346758c7436a0"} Mar 16 15:57:55 crc kubenswrapper[5120]: I0316 15:57:55.459364 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-gbpjc" event={"ID":"efbef5eb-902c-46b3-ba4c-5c31917acf20","Type":"ContainerStarted","Data":"df947da801d1347a8eae335f954dc1eb15ebecdc1742d0f7f720c721e4e372bf"} Mar 16 15:57:55 crc kubenswrapper[5120]: I0316 15:57:55.459395 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-gbpjc" event={"ID":"efbef5eb-902c-46b3-ba4c-5c31917acf20","Type":"ContainerStarted","Data":"cfc47265e3fb0384fc138867f944095bc3e2c3fbeba9c1c403da88349f59d605"} Mar 16 15:57:55 crc kubenswrapper[5120]: I0316 15:57:55.477342 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-gbpjc" podStartSLOduration=2.477323205 podStartE2EDuration="2.477323205s" podCreationTimestamp="2026-03-16 15:57:53 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:57:55.476585865 +0000 UTC m=+1577.630517542" watchObservedRunningTime="2026-03-16 15:57:55.477323205 +0000 UTC m=+1577.631254882" Mar 16 15:57:56 crc kubenswrapper[5120]: I0316 15:57:56.471409 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ccea3155-4cc4-4790-8a1d-3f6ebe2d0dcd","Type":"ContainerStarted","Data":"1dd4ebe973474901ee1532cc6761fa0080e8ce4a657ab1c6113dd14f2e040ba4"} Mar 16 15:57:57 crc kubenswrapper[5120]: I0316 15:57:57.193367 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:57:57 crc kubenswrapper[5120]: I0316 15:57:57.273542 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v8bbd\" (UniqueName: \"kubernetes.io/projected/dee0c2f4-0007-4e20-9da4-27d6e00c7dbe-kube-api-access-v8bbd\") pod \"dee0c2f4-0007-4e20-9da4-27d6e00c7dbe\" (UID: \"dee0c2f4-0007-4e20-9da4-27d6e00c7dbe\") " Mar 16 15:57:57 crc kubenswrapper[5120]: I0316 15:57:57.273803 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/dee0c2f4-0007-4e20-9da4-27d6e00c7dbe-logs\") pod \"dee0c2f4-0007-4e20-9da4-27d6e00c7dbe\" (UID: \"dee0c2f4-0007-4e20-9da4-27d6e00c7dbe\") " Mar 16 15:57:57 crc kubenswrapper[5120]: I0316 15:57:57.273839 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dee0c2f4-0007-4e20-9da4-27d6e00c7dbe-config-data\") pod \"dee0c2f4-0007-4e20-9da4-27d6e00c7dbe\" (UID: \"dee0c2f4-0007-4e20-9da4-27d6e00c7dbe\") " Mar 16 15:57:57 crc kubenswrapper[5120]: I0316 15:57:57.273939 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dee0c2f4-0007-4e20-9da4-27d6e00c7dbe-combined-ca-bundle\") pod \"dee0c2f4-0007-4e20-9da4-27d6e00c7dbe\" (UID: \"dee0c2f4-0007-4e20-9da4-27d6e00c7dbe\") " Mar 16 15:57:57 crc kubenswrapper[5120]: I0316 15:57:57.274708 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dee0c2f4-0007-4e20-9da4-27d6e00c7dbe-logs" (OuterVolumeSpecName: "logs") pod "dee0c2f4-0007-4e20-9da4-27d6e00c7dbe" (UID: "dee0c2f4-0007-4e20-9da4-27d6e00c7dbe"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:57:57 crc kubenswrapper[5120]: I0316 15:57:57.278644 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dee0c2f4-0007-4e20-9da4-27d6e00c7dbe-kube-api-access-v8bbd" (OuterVolumeSpecName: "kube-api-access-v8bbd") pod "dee0c2f4-0007-4e20-9da4-27d6e00c7dbe" (UID: "dee0c2f4-0007-4e20-9da4-27d6e00c7dbe"). InnerVolumeSpecName "kube-api-access-v8bbd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:57:57 crc kubenswrapper[5120]: I0316 15:57:57.313848 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dee0c2f4-0007-4e20-9da4-27d6e00c7dbe-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "dee0c2f4-0007-4e20-9da4-27d6e00c7dbe" (UID: "dee0c2f4-0007-4e20-9da4-27d6e00c7dbe"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:57:57 crc kubenswrapper[5120]: I0316 15:57:57.337858 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dee0c2f4-0007-4e20-9da4-27d6e00c7dbe-config-data" (OuterVolumeSpecName: "config-data") pod "dee0c2f4-0007-4e20-9da4-27d6e00c7dbe" (UID: "dee0c2f4-0007-4e20-9da4-27d6e00c7dbe"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:57:57 crc kubenswrapper[5120]: I0316 15:57:57.376846 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dee0c2f4-0007-4e20-9da4-27d6e00c7dbe-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:57:57 crc kubenswrapper[5120]: I0316 15:57:57.376879 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v8bbd\" (UniqueName: \"kubernetes.io/projected/dee0c2f4-0007-4e20-9da4-27d6e00c7dbe-kube-api-access-v8bbd\") on node \"crc\" DevicePath \"\"" Mar 16 15:57:57 crc kubenswrapper[5120]: I0316 15:57:57.376890 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/dee0c2f4-0007-4e20-9da4-27d6e00c7dbe-logs\") on node \"crc\" DevicePath \"\"" Mar 16 15:57:57 crc kubenswrapper[5120]: I0316 15:57:57.376901 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dee0c2f4-0007-4e20-9da4-27d6e00c7dbe-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 15:57:57 crc kubenswrapper[5120]: I0316 15:57:57.490010 5120 generic.go:358] "Generic (PLEG): container finished" podID="dee0c2f4-0007-4e20-9da4-27d6e00c7dbe" containerID="1b4dcbbfdaf99608a495b69520908bce258af504130da12d4a9ea15986cba303" exitCode=0 Mar 16 15:57:57 crc kubenswrapper[5120]: I0316 15:57:57.491167 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"dee0c2f4-0007-4e20-9da4-27d6e00c7dbe","Type":"ContainerDied","Data":"1b4dcbbfdaf99608a495b69520908bce258af504130da12d4a9ea15986cba303"} Mar 16 15:57:57 crc kubenswrapper[5120]: I0316 15:57:57.491205 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"dee0c2f4-0007-4e20-9da4-27d6e00c7dbe","Type":"ContainerDied","Data":"e1938c8f9d8e489dc80c52e5b8941303f343f774e4564d0b15f699e2ddeb0fcc"} Mar 16 15:57:57 crc kubenswrapper[5120]: I0316 15:57:57.491227 5120 scope.go:117] "RemoveContainer" containerID="1b4dcbbfdaf99608a495b69520908bce258af504130da12d4a9ea15986cba303" Mar 16 15:57:57 crc kubenswrapper[5120]: I0316 15:57:57.491466 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:57:57 crc kubenswrapper[5120]: I0316 15:57:57.539396 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 15:57:57 crc kubenswrapper[5120]: I0316 15:57:57.549299 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 15:57:57 crc kubenswrapper[5120]: I0316 15:57:57.563611 5120 scope.go:117] "RemoveContainer" containerID="e19649935001895bcea0084948683062a1f024cde3dd8c893b8acb2eadeee9fe" Mar 16 15:57:57 crc kubenswrapper[5120]: I0316 15:57:57.601295 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 15:57:57 crc kubenswrapper[5120]: I0316 15:57:57.604224 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dee0c2f4-0007-4e20-9da4-27d6e00c7dbe" containerName="nova-api-api" Mar 16 15:57:57 crc kubenswrapper[5120]: I0316 15:57:57.604246 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="dee0c2f4-0007-4e20-9da4-27d6e00c7dbe" containerName="nova-api-api" Mar 16 15:57:57 crc kubenswrapper[5120]: I0316 15:57:57.604281 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dee0c2f4-0007-4e20-9da4-27d6e00c7dbe" containerName="nova-api-log" Mar 16 15:57:57 crc kubenswrapper[5120]: I0316 15:57:57.604287 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="dee0c2f4-0007-4e20-9da4-27d6e00c7dbe" containerName="nova-api-log" Mar 16 15:57:57 crc kubenswrapper[5120]: I0316 15:57:57.604624 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="dee0c2f4-0007-4e20-9da4-27d6e00c7dbe" containerName="nova-api-log" Mar 16 15:57:57 crc kubenswrapper[5120]: I0316 15:57:57.604645 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="dee0c2f4-0007-4e20-9da4-27d6e00c7dbe" containerName="nova-api-api" Mar 16 15:57:57 crc kubenswrapper[5120]: I0316 15:57:57.613409 5120 scope.go:117] "RemoveContainer" containerID="1b4dcbbfdaf99608a495b69520908bce258af504130da12d4a9ea15986cba303" Mar 16 15:57:57 crc kubenswrapper[5120]: E0316 15:57:57.614339 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1b4dcbbfdaf99608a495b69520908bce258af504130da12d4a9ea15986cba303\": container with ID starting with 1b4dcbbfdaf99608a495b69520908bce258af504130da12d4a9ea15986cba303 not found: ID does not exist" containerID="1b4dcbbfdaf99608a495b69520908bce258af504130da12d4a9ea15986cba303" Mar 16 15:57:57 crc kubenswrapper[5120]: I0316 15:57:57.614369 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b4dcbbfdaf99608a495b69520908bce258af504130da12d4a9ea15986cba303"} err="failed to get container status \"1b4dcbbfdaf99608a495b69520908bce258af504130da12d4a9ea15986cba303\": rpc error: code = NotFound desc = could not find container \"1b4dcbbfdaf99608a495b69520908bce258af504130da12d4a9ea15986cba303\": container with ID starting with 1b4dcbbfdaf99608a495b69520908bce258af504130da12d4a9ea15986cba303 not found: ID does not exist" Mar 16 15:57:57 crc kubenswrapper[5120]: I0316 15:57:57.614390 5120 scope.go:117] "RemoveContainer" containerID="e19649935001895bcea0084948683062a1f024cde3dd8c893b8acb2eadeee9fe" Mar 16 15:57:57 crc kubenswrapper[5120]: E0316 15:57:57.614839 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e19649935001895bcea0084948683062a1f024cde3dd8c893b8acb2eadeee9fe\": container with ID starting with e19649935001895bcea0084948683062a1f024cde3dd8c893b8acb2eadeee9fe not found: ID does not exist" containerID="e19649935001895bcea0084948683062a1f024cde3dd8c893b8acb2eadeee9fe" Mar 16 15:57:57 crc kubenswrapper[5120]: I0316 15:57:57.614893 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e19649935001895bcea0084948683062a1f024cde3dd8c893b8acb2eadeee9fe"} err="failed to get container status \"e19649935001895bcea0084948683062a1f024cde3dd8c893b8acb2eadeee9fe\": rpc error: code = NotFound desc = could not find container \"e19649935001895bcea0084948683062a1f024cde3dd8c893b8acb2eadeee9fe\": container with ID starting with e19649935001895bcea0084948683062a1f024cde3dd8c893b8acb2eadeee9fe not found: ID does not exist" Mar 16 15:57:57 crc kubenswrapper[5120]: I0316 15:57:57.621158 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 15:57:57 crc kubenswrapper[5120]: I0316 15:57:57.621351 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:57:57 crc kubenswrapper[5120]: I0316 15:57:57.625295 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-public-svc\"" Mar 16 15:57:57 crc kubenswrapper[5120]: I0316 15:57:57.626802 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-internal-svc\"" Mar 16 15:57:57 crc kubenswrapper[5120]: I0316 15:57:57.634523 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-config-data\"" Mar 16 15:57:57 crc kubenswrapper[5120]: I0316 15:57:57.664388 5120 scope.go:117] "RemoveContainer" containerID="02ba4fc3f84eccaecfa9e6618280f65626eb76580c4af9ae7a9d7cb3b8dd590b" Mar 16 15:57:57 crc kubenswrapper[5120]: E0316 15:57:57.664590 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 15:57:57 crc kubenswrapper[5120]: I0316 15:57:57.697628 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a135d365-4292-4a0e-b743-a5cace8f3166-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"a135d365-4292-4a0e-b743-a5cace8f3166\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:57:57 crc kubenswrapper[5120]: I0316 15:57:57.697718 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a135d365-4292-4a0e-b743-a5cace8f3166-config-data\") pod \"nova-api-0\" (UID: \"a135d365-4292-4a0e-b743-a5cace8f3166\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:57:57 crc kubenswrapper[5120]: I0316 15:57:57.697804 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/a135d365-4292-4a0e-b743-a5cace8f3166-public-tls-certs\") pod \"nova-api-0\" (UID: \"a135d365-4292-4a0e-b743-a5cace8f3166\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:57:57 crc kubenswrapper[5120]: I0316 15:57:57.697834 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a135d365-4292-4a0e-b743-a5cace8f3166-logs\") pod \"nova-api-0\" (UID: \"a135d365-4292-4a0e-b743-a5cace8f3166\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:57:57 crc kubenswrapper[5120]: I0316 15:57:57.697855 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqzfg\" (UniqueName: \"kubernetes.io/projected/a135d365-4292-4a0e-b743-a5cace8f3166-kube-api-access-jqzfg\") pod \"nova-api-0\" (UID: \"a135d365-4292-4a0e-b743-a5cace8f3166\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:57:57 crc kubenswrapper[5120]: I0316 15:57:57.697892 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/a135d365-4292-4a0e-b743-a5cace8f3166-internal-tls-certs\") pod \"nova-api-0\" (UID: \"a135d365-4292-4a0e-b743-a5cace8f3166\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:57:57 crc kubenswrapper[5120]: I0316 15:57:57.799645 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/a135d365-4292-4a0e-b743-a5cace8f3166-internal-tls-certs\") pod \"nova-api-0\" (UID: \"a135d365-4292-4a0e-b743-a5cace8f3166\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:57:57 crc kubenswrapper[5120]: I0316 15:57:57.799790 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a135d365-4292-4a0e-b743-a5cace8f3166-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"a135d365-4292-4a0e-b743-a5cace8f3166\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:57:57 crc kubenswrapper[5120]: I0316 15:57:57.799844 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a135d365-4292-4a0e-b743-a5cace8f3166-config-data\") pod \"nova-api-0\" (UID: \"a135d365-4292-4a0e-b743-a5cace8f3166\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:57:57 crc kubenswrapper[5120]: I0316 15:57:57.799884 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/a135d365-4292-4a0e-b743-a5cace8f3166-public-tls-certs\") pod \"nova-api-0\" (UID: \"a135d365-4292-4a0e-b743-a5cace8f3166\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:57:57 crc kubenswrapper[5120]: I0316 15:57:57.799909 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a135d365-4292-4a0e-b743-a5cace8f3166-logs\") pod \"nova-api-0\" (UID: \"a135d365-4292-4a0e-b743-a5cace8f3166\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:57:57 crc kubenswrapper[5120]: I0316 15:57:57.799928 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jqzfg\" (UniqueName: \"kubernetes.io/projected/a135d365-4292-4a0e-b743-a5cace8f3166-kube-api-access-jqzfg\") pod \"nova-api-0\" (UID: \"a135d365-4292-4a0e-b743-a5cace8f3166\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:57:57 crc kubenswrapper[5120]: I0316 15:57:57.801461 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a135d365-4292-4a0e-b743-a5cace8f3166-logs\") pod \"nova-api-0\" (UID: \"a135d365-4292-4a0e-b743-a5cace8f3166\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:57:57 crc kubenswrapper[5120]: I0316 15:57:57.805141 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/a135d365-4292-4a0e-b743-a5cace8f3166-internal-tls-certs\") pod \"nova-api-0\" (UID: \"a135d365-4292-4a0e-b743-a5cace8f3166\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:57:57 crc kubenswrapper[5120]: I0316 15:57:57.807164 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/a135d365-4292-4a0e-b743-a5cace8f3166-public-tls-certs\") pod \"nova-api-0\" (UID: \"a135d365-4292-4a0e-b743-a5cace8f3166\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:57:57 crc kubenswrapper[5120]: I0316 15:57:57.807367 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a135d365-4292-4a0e-b743-a5cace8f3166-config-data\") pod \"nova-api-0\" (UID: \"a135d365-4292-4a0e-b743-a5cace8f3166\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:57:57 crc kubenswrapper[5120]: I0316 15:57:57.816515 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqzfg\" (UniqueName: \"kubernetes.io/projected/a135d365-4292-4a0e-b743-a5cace8f3166-kube-api-access-jqzfg\") pod \"nova-api-0\" (UID: \"a135d365-4292-4a0e-b743-a5cace8f3166\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:57:57 crc kubenswrapper[5120]: I0316 15:57:57.816694 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a135d365-4292-4a0e-b743-a5cace8f3166-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"a135d365-4292-4a0e-b743-a5cace8f3166\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:57:57 crc kubenswrapper[5120]: I0316 15:57:57.937087 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:57:58 crc kubenswrapper[5120]: I0316 15:57:58.418137 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 15:57:58 crc kubenswrapper[5120]: I0316 15:57:58.522644 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"a135d365-4292-4a0e-b743-a5cace8f3166","Type":"ContainerStarted","Data":"01fc3cc23e891fcf4ae45c5fe4bba18a6b4f974672af23211a753307243f03d5"} Mar 16 15:57:58 crc kubenswrapper[5120]: I0316 15:57:58.525675 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ccea3155-4cc4-4790-8a1d-3f6ebe2d0dcd","Type":"ContainerStarted","Data":"3cd09a681fec59b507fe5b3cfe4ad658860662eb6f816ebd507e38366baac93e"} Mar 16 15:57:58 crc kubenswrapper[5120]: I0316 15:57:58.678778 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dee0c2f4-0007-4e20-9da4-27d6e00c7dbe" path="/var/lib/kubelet/pods/dee0c2f4-0007-4e20-9da4-27d6e00c7dbe/volumes" Mar 16 15:57:59 crc kubenswrapper[5120]: I0316 15:57:59.540115 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"a135d365-4292-4a0e-b743-a5cace8f3166","Type":"ContainerStarted","Data":"35ce49421f86075c31b4fc24a5e0e6cdc7fe1373eb727c7ab0c71bd9c8de4726"} Mar 16 15:57:59 crc kubenswrapper[5120]: I0316 15:57:59.540439 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"a135d365-4292-4a0e-b743-a5cace8f3166","Type":"ContainerStarted","Data":"8cb67de283dc08cf0b38850daf45a157ab4df3987c5c447699d11491d5e574ca"} Mar 16 15:57:59 crc kubenswrapper[5120]: I0316 15:57:59.543099 5120 generic.go:358] "Generic (PLEG): container finished" podID="efbef5eb-902c-46b3-ba4c-5c31917acf20" containerID="df947da801d1347a8eae335f954dc1eb15ebecdc1742d0f7f720c721e4e372bf" exitCode=0 Mar 16 15:57:59 crc kubenswrapper[5120]: I0316 15:57:59.543124 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-gbpjc" event={"ID":"efbef5eb-902c-46b3-ba4c-5c31917acf20","Type":"ContainerDied","Data":"df947da801d1347a8eae335f954dc1eb15ebecdc1742d0f7f720c721e4e372bf"} Mar 16 15:57:59 crc kubenswrapper[5120]: I0316 15:57:59.582738 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=2.582722324 podStartE2EDuration="2.582722324s" podCreationTimestamp="2026-03-16 15:57:57 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:57:59.562182065 +0000 UTC m=+1581.716113752" watchObservedRunningTime="2026-03-16 15:57:59.582722324 +0000 UTC m=+1581.736653981" Mar 16 15:58:00 crc kubenswrapper[5120]: I0316 15:58:00.146112 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-infra/auto-csr-approver-29561278-nt8th"] Mar 16 15:58:00 crc kubenswrapper[5120]: I0316 15:58:00.156063 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561278-nt8th" Mar 16 15:58:00 crc kubenswrapper[5120]: I0316 15:58:00.158322 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-infra\"/\"csr-approver-sa-dockercfg-x2nsz\"" Mar 16 15:58:00 crc kubenswrapper[5120]: I0316 15:58:00.159003 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"kube-root-ca.crt\"" Mar 16 15:58:00 crc kubenswrapper[5120]: I0316 15:58:00.159327 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"openshift-service-ca.crt\"" Mar 16 15:58:00 crc kubenswrapper[5120]: I0316 15:58:00.167500 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561278-nt8th"] Mar 16 15:58:00 crc kubenswrapper[5120]: I0316 15:58:00.257927 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9b9rd\" (UniqueName: \"kubernetes.io/projected/b5ebd69d-6eae-46e3-8567-f43a281355ef-kube-api-access-9b9rd\") pod \"auto-csr-approver-29561278-nt8th\" (UID: \"b5ebd69d-6eae-46e3-8567-f43a281355ef\") " pod="openshift-infra/auto-csr-approver-29561278-nt8th" Mar 16 15:58:00 crc kubenswrapper[5120]: I0316 15:58:00.360207 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9b9rd\" (UniqueName: \"kubernetes.io/projected/b5ebd69d-6eae-46e3-8567-f43a281355ef-kube-api-access-9b9rd\") pod \"auto-csr-approver-29561278-nt8th\" (UID: \"b5ebd69d-6eae-46e3-8567-f43a281355ef\") " pod="openshift-infra/auto-csr-approver-29561278-nt8th" Mar 16 15:58:00 crc kubenswrapper[5120]: I0316 15:58:00.388570 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9b9rd\" (UniqueName: \"kubernetes.io/projected/b5ebd69d-6eae-46e3-8567-f43a281355ef-kube-api-access-9b9rd\") pod \"auto-csr-approver-29561278-nt8th\" (UID: \"b5ebd69d-6eae-46e3-8567-f43a281355ef\") " pod="openshift-infra/auto-csr-approver-29561278-nt8th" Mar 16 15:58:00 crc kubenswrapper[5120]: I0316 15:58:00.485512 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561278-nt8th" Mar 16 15:58:00 crc kubenswrapper[5120]: I0316 15:58:00.556515 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="ccea3155-4cc4-4790-8a1d-3f6ebe2d0dcd" containerName="ceilometer-central-agent" containerID="cri-o://e6ef1e16a9f1dbd30b2839b569e850a5aff07988979f9ef0517727f364aa14e1" gracePeriod=30 Mar 16 15:58:00 crc kubenswrapper[5120]: I0316 15:58:00.556838 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ccea3155-4cc4-4790-8a1d-3f6ebe2d0dcd","Type":"ContainerStarted","Data":"c0581febec3bdeea4894d87b181deb06b43899f0ed864925e46b3c1aac08d714"} Mar 16 15:58:00 crc kubenswrapper[5120]: I0316 15:58:00.558020 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:58:00 crc kubenswrapper[5120]: I0316 15:58:00.558393 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="ccea3155-4cc4-4790-8a1d-3f6ebe2d0dcd" containerName="proxy-httpd" containerID="cri-o://c0581febec3bdeea4894d87b181deb06b43899f0ed864925e46b3c1aac08d714" gracePeriod=30 Mar 16 15:58:00 crc kubenswrapper[5120]: I0316 15:58:00.558524 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="ccea3155-4cc4-4790-8a1d-3f6ebe2d0dcd" containerName="sg-core" containerID="cri-o://3cd09a681fec59b507fe5b3cfe4ad658860662eb6f816ebd507e38366baac93e" gracePeriod=30 Mar 16 15:58:00 crc kubenswrapper[5120]: I0316 15:58:00.558599 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="ccea3155-4cc4-4790-8a1d-3f6ebe2d0dcd" containerName="ceilometer-notification-agent" containerID="cri-o://1dd4ebe973474901ee1532cc6761fa0080e8ce4a657ab1c6113dd14f2e040ba4" gracePeriod=30 Mar 16 15:58:00 crc kubenswrapper[5120]: I0316 15:58:00.598464 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.3610025439999998 podStartE2EDuration="7.598447377s" podCreationTimestamp="2026-03-16 15:57:53 +0000 UTC" firstStartedPulling="2026-03-16 15:57:54.638958995 +0000 UTC m=+1576.792890652" lastFinishedPulling="2026-03-16 15:57:59.876403798 +0000 UTC m=+1582.030335485" observedRunningTime="2026-03-16 15:58:00.597156531 +0000 UTC m=+1582.751088188" watchObservedRunningTime="2026-03-16 15:58:00.598447377 +0000 UTC m=+1582.752379024" Mar 16 15:58:01 crc kubenswrapper[5120]: W0316 15:58:01.017268 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb5ebd69d_6eae_46e3_8567_f43a281355ef.slice/crio-069d8efed04c2e47a6455fe20b2ceeea58e9d3e222d0df69ae8050821a227043 WatchSource:0}: Error finding container 069d8efed04c2e47a6455fe20b2ceeea58e9d3e222d0df69ae8050821a227043: Status 404 returned error can't find the container with id 069d8efed04c2e47a6455fe20b2ceeea58e9d3e222d0df69ae8050821a227043 Mar 16 15:58:01 crc kubenswrapper[5120]: I0316 15:58:01.017597 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561278-nt8th"] Mar 16 15:58:01 crc kubenswrapper[5120]: I0316 15:58:01.018889 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-gbpjc" Mar 16 15:58:01 crc kubenswrapper[5120]: I0316 15:58:01.091365 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ndhv4\" (UniqueName: \"kubernetes.io/projected/efbef5eb-902c-46b3-ba4c-5c31917acf20-kube-api-access-ndhv4\") pod \"efbef5eb-902c-46b3-ba4c-5c31917acf20\" (UID: \"efbef5eb-902c-46b3-ba4c-5c31917acf20\") " Mar 16 15:58:01 crc kubenswrapper[5120]: I0316 15:58:01.091531 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/efbef5eb-902c-46b3-ba4c-5c31917acf20-config-data\") pod \"efbef5eb-902c-46b3-ba4c-5c31917acf20\" (UID: \"efbef5eb-902c-46b3-ba4c-5c31917acf20\") " Mar 16 15:58:01 crc kubenswrapper[5120]: I0316 15:58:01.091716 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/efbef5eb-902c-46b3-ba4c-5c31917acf20-scripts\") pod \"efbef5eb-902c-46b3-ba4c-5c31917acf20\" (UID: \"efbef5eb-902c-46b3-ba4c-5c31917acf20\") " Mar 16 15:58:01 crc kubenswrapper[5120]: I0316 15:58:01.091737 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/efbef5eb-902c-46b3-ba4c-5c31917acf20-combined-ca-bundle\") pod \"efbef5eb-902c-46b3-ba4c-5c31917acf20\" (UID: \"efbef5eb-902c-46b3-ba4c-5c31917acf20\") " Mar 16 15:58:01 crc kubenswrapper[5120]: I0316 15:58:01.098397 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/efbef5eb-902c-46b3-ba4c-5c31917acf20-scripts" (OuterVolumeSpecName: "scripts") pod "efbef5eb-902c-46b3-ba4c-5c31917acf20" (UID: "efbef5eb-902c-46b3-ba4c-5c31917acf20"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:58:01 crc kubenswrapper[5120]: I0316 15:58:01.099205 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/efbef5eb-902c-46b3-ba4c-5c31917acf20-kube-api-access-ndhv4" (OuterVolumeSpecName: "kube-api-access-ndhv4") pod "efbef5eb-902c-46b3-ba4c-5c31917acf20" (UID: "efbef5eb-902c-46b3-ba4c-5c31917acf20"). InnerVolumeSpecName "kube-api-access-ndhv4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:58:01 crc kubenswrapper[5120]: I0316 15:58:01.123079 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/efbef5eb-902c-46b3-ba4c-5c31917acf20-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "efbef5eb-902c-46b3-ba4c-5c31917acf20" (UID: "efbef5eb-902c-46b3-ba4c-5c31917acf20"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:58:01 crc kubenswrapper[5120]: I0316 15:58:01.133820 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/efbef5eb-902c-46b3-ba4c-5c31917acf20-config-data" (OuterVolumeSpecName: "config-data") pod "efbef5eb-902c-46b3-ba4c-5c31917acf20" (UID: "efbef5eb-902c-46b3-ba4c-5c31917acf20"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:58:01 crc kubenswrapper[5120]: I0316 15:58:01.193919 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/efbef5eb-902c-46b3-ba4c-5c31917acf20-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 15:58:01 crc kubenswrapper[5120]: I0316 15:58:01.193949 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/efbef5eb-902c-46b3-ba4c-5c31917acf20-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 15:58:01 crc kubenswrapper[5120]: I0316 15:58:01.193958 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/efbef5eb-902c-46b3-ba4c-5c31917acf20-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:58:01 crc kubenswrapper[5120]: I0316 15:58:01.193968 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ndhv4\" (UniqueName: \"kubernetes.io/projected/efbef5eb-902c-46b3-ba4c-5c31917acf20-kube-api-access-ndhv4\") on node \"crc\" DevicePath \"\"" Mar 16 15:58:01 crc kubenswrapper[5120]: I0316 15:58:01.567532 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561278-nt8th" event={"ID":"b5ebd69d-6eae-46e3-8567-f43a281355ef","Type":"ContainerStarted","Data":"069d8efed04c2e47a6455fe20b2ceeea58e9d3e222d0df69ae8050821a227043"} Mar 16 15:58:01 crc kubenswrapper[5120]: I0316 15:58:01.570422 5120 generic.go:358] "Generic (PLEG): container finished" podID="ccea3155-4cc4-4790-8a1d-3f6ebe2d0dcd" containerID="c0581febec3bdeea4894d87b181deb06b43899f0ed864925e46b3c1aac08d714" exitCode=0 Mar 16 15:58:01 crc kubenswrapper[5120]: I0316 15:58:01.570455 5120 generic.go:358] "Generic (PLEG): container finished" podID="ccea3155-4cc4-4790-8a1d-3f6ebe2d0dcd" containerID="3cd09a681fec59b507fe5b3cfe4ad658860662eb6f816ebd507e38366baac93e" exitCode=2 Mar 16 15:58:01 crc kubenswrapper[5120]: I0316 15:58:01.570461 5120 generic.go:358] "Generic (PLEG): container finished" podID="ccea3155-4cc4-4790-8a1d-3f6ebe2d0dcd" containerID="1dd4ebe973474901ee1532cc6761fa0080e8ce4a657ab1c6113dd14f2e040ba4" exitCode=0 Mar 16 15:58:01 crc kubenswrapper[5120]: I0316 15:58:01.570468 5120 generic.go:358] "Generic (PLEG): container finished" podID="ccea3155-4cc4-4790-8a1d-3f6ebe2d0dcd" containerID="e6ef1e16a9f1dbd30b2839b569e850a5aff07988979f9ef0517727f364aa14e1" exitCode=0 Mar 16 15:58:01 crc kubenswrapper[5120]: I0316 15:58:01.570534 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ccea3155-4cc4-4790-8a1d-3f6ebe2d0dcd","Type":"ContainerDied","Data":"c0581febec3bdeea4894d87b181deb06b43899f0ed864925e46b3c1aac08d714"} Mar 16 15:58:01 crc kubenswrapper[5120]: I0316 15:58:01.570590 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ccea3155-4cc4-4790-8a1d-3f6ebe2d0dcd","Type":"ContainerDied","Data":"3cd09a681fec59b507fe5b3cfe4ad658860662eb6f816ebd507e38366baac93e"} Mar 16 15:58:01 crc kubenswrapper[5120]: I0316 15:58:01.570602 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ccea3155-4cc4-4790-8a1d-3f6ebe2d0dcd","Type":"ContainerDied","Data":"1dd4ebe973474901ee1532cc6761fa0080e8ce4a657ab1c6113dd14f2e040ba4"} Mar 16 15:58:01 crc kubenswrapper[5120]: I0316 15:58:01.570616 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ccea3155-4cc4-4790-8a1d-3f6ebe2d0dcd","Type":"ContainerDied","Data":"e6ef1e16a9f1dbd30b2839b569e850a5aff07988979f9ef0517727f364aa14e1"} Mar 16 15:58:01 crc kubenswrapper[5120]: I0316 15:58:01.570628 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ccea3155-4cc4-4790-8a1d-3f6ebe2d0dcd","Type":"ContainerDied","Data":"7624e738decb671c1ddc0ec1f3e78f1afefa0176a8bdd5e45a3346758c7436a0"} Mar 16 15:58:01 crc kubenswrapper[5120]: I0316 15:58:01.570640 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7624e738decb671c1ddc0ec1f3e78f1afefa0176a8bdd5e45a3346758c7436a0" Mar 16 15:58:01 crc kubenswrapper[5120]: I0316 15:58:01.572782 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-gbpjc" event={"ID":"efbef5eb-902c-46b3-ba4c-5c31917acf20","Type":"ContainerDied","Data":"cfc47265e3fb0384fc138867f944095bc3e2c3fbeba9c1c403da88349f59d605"} Mar 16 15:58:01 crc kubenswrapper[5120]: I0316 15:58:01.572797 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-gbpjc" Mar 16 15:58:01 crc kubenswrapper[5120]: I0316 15:58:01.572812 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cfc47265e3fb0384fc138867f944095bc3e2c3fbeba9c1c403da88349f59d605" Mar 16 15:58:01 crc kubenswrapper[5120]: I0316 15:58:01.622689 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:58:01 crc kubenswrapper[5120]: I0316 15:58:01.708716 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ccea3155-4cc4-4790-8a1d-3f6ebe2d0dcd-config-data\") pod \"ccea3155-4cc4-4790-8a1d-3f6ebe2d0dcd\" (UID: \"ccea3155-4cc4-4790-8a1d-3f6ebe2d0dcd\") " Mar 16 15:58:01 crc kubenswrapper[5120]: I0316 15:58:01.708879 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ccea3155-4cc4-4790-8a1d-3f6ebe2d0dcd-combined-ca-bundle\") pod \"ccea3155-4cc4-4790-8a1d-3f6ebe2d0dcd\" (UID: \"ccea3155-4cc4-4790-8a1d-3f6ebe2d0dcd\") " Mar 16 15:58:01 crc kubenswrapper[5120]: I0316 15:58:01.709341 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/ccea3155-4cc4-4790-8a1d-3f6ebe2d0dcd-sg-core-conf-yaml\") pod \"ccea3155-4cc4-4790-8a1d-3f6ebe2d0dcd\" (UID: \"ccea3155-4cc4-4790-8a1d-3f6ebe2d0dcd\") " Mar 16 15:58:01 crc kubenswrapper[5120]: I0316 15:58:01.709432 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s9tlv\" (UniqueName: \"kubernetes.io/projected/ccea3155-4cc4-4790-8a1d-3f6ebe2d0dcd-kube-api-access-s9tlv\") pod \"ccea3155-4cc4-4790-8a1d-3f6ebe2d0dcd\" (UID: \"ccea3155-4cc4-4790-8a1d-3f6ebe2d0dcd\") " Mar 16 15:58:01 crc kubenswrapper[5120]: I0316 15:58:01.709544 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ccea3155-4cc4-4790-8a1d-3f6ebe2d0dcd-run-httpd\") pod \"ccea3155-4cc4-4790-8a1d-3f6ebe2d0dcd\" (UID: \"ccea3155-4cc4-4790-8a1d-3f6ebe2d0dcd\") " Mar 16 15:58:01 crc kubenswrapper[5120]: I0316 15:58:01.709603 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ccea3155-4cc4-4790-8a1d-3f6ebe2d0dcd-log-httpd\") pod \"ccea3155-4cc4-4790-8a1d-3f6ebe2d0dcd\" (UID: \"ccea3155-4cc4-4790-8a1d-3f6ebe2d0dcd\") " Mar 16 15:58:01 crc kubenswrapper[5120]: I0316 15:58:01.709650 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ccea3155-4cc4-4790-8a1d-3f6ebe2d0dcd-scripts\") pod \"ccea3155-4cc4-4790-8a1d-3f6ebe2d0dcd\" (UID: \"ccea3155-4cc4-4790-8a1d-3f6ebe2d0dcd\") " Mar 16 15:58:01 crc kubenswrapper[5120]: I0316 15:58:01.710277 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ccea3155-4cc4-4790-8a1d-3f6ebe2d0dcd-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "ccea3155-4cc4-4790-8a1d-3f6ebe2d0dcd" (UID: "ccea3155-4cc4-4790-8a1d-3f6ebe2d0dcd"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:58:01 crc kubenswrapper[5120]: I0316 15:58:01.710290 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ccea3155-4cc4-4790-8a1d-3f6ebe2d0dcd-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "ccea3155-4cc4-4790-8a1d-3f6ebe2d0dcd" (UID: "ccea3155-4cc4-4790-8a1d-3f6ebe2d0dcd"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:58:01 crc kubenswrapper[5120]: I0316 15:58:01.710715 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ccea3155-4cc4-4790-8a1d-3f6ebe2d0dcd-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 15:58:01 crc kubenswrapper[5120]: I0316 15:58:01.710736 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ccea3155-4cc4-4790-8a1d-3f6ebe2d0dcd-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 15:58:01 crc kubenswrapper[5120]: I0316 15:58:01.717903 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ccea3155-4cc4-4790-8a1d-3f6ebe2d0dcd-kube-api-access-s9tlv" (OuterVolumeSpecName: "kube-api-access-s9tlv") pod "ccea3155-4cc4-4790-8a1d-3f6ebe2d0dcd" (UID: "ccea3155-4cc4-4790-8a1d-3f6ebe2d0dcd"). InnerVolumeSpecName "kube-api-access-s9tlv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:58:01 crc kubenswrapper[5120]: I0316 15:58:01.717999 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ccea3155-4cc4-4790-8a1d-3f6ebe2d0dcd-scripts" (OuterVolumeSpecName: "scripts") pod "ccea3155-4cc4-4790-8a1d-3f6ebe2d0dcd" (UID: "ccea3155-4cc4-4790-8a1d-3f6ebe2d0dcd"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:58:01 crc kubenswrapper[5120]: I0316 15:58:01.743349 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ccea3155-4cc4-4790-8a1d-3f6ebe2d0dcd-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "ccea3155-4cc4-4790-8a1d-3f6ebe2d0dcd" (UID: "ccea3155-4cc4-4790-8a1d-3f6ebe2d0dcd"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:58:01 crc kubenswrapper[5120]: I0316 15:58:01.772461 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 15:58:01 crc kubenswrapper[5120]: I0316 15:58:01.772831 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="a135d365-4292-4a0e-b743-a5cace8f3166" containerName="nova-api-log" containerID="cri-o://8cb67de283dc08cf0b38850daf45a157ab4df3987c5c447699d11491d5e574ca" gracePeriod=30 Mar 16 15:58:01 crc kubenswrapper[5120]: I0316 15:58:01.772993 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="a135d365-4292-4a0e-b743-a5cace8f3166" containerName="nova-api-api" containerID="cri-o://35ce49421f86075c31b4fc24a5e0e6cdc7fe1373eb727c7ab0c71bd9c8de4726" gracePeriod=30 Mar 16 15:58:01 crc kubenswrapper[5120]: I0316 15:58:01.803985 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ccea3155-4cc4-4790-8a1d-3f6ebe2d0dcd-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ccea3155-4cc4-4790-8a1d-3f6ebe2d0dcd" (UID: "ccea3155-4cc4-4790-8a1d-3f6ebe2d0dcd"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:58:01 crc kubenswrapper[5120]: I0316 15:58:01.812656 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ccea3155-4cc4-4790-8a1d-3f6ebe2d0dcd-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 15:58:01 crc kubenswrapper[5120]: I0316 15:58:01.812692 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ccea3155-4cc4-4790-8a1d-3f6ebe2d0dcd-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:58:01 crc kubenswrapper[5120]: I0316 15:58:01.812701 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/ccea3155-4cc4-4790-8a1d-3f6ebe2d0dcd-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 15:58:01 crc kubenswrapper[5120]: I0316 15:58:01.812712 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s9tlv\" (UniqueName: \"kubernetes.io/projected/ccea3155-4cc4-4790-8a1d-3f6ebe2d0dcd-kube-api-access-s9tlv\") on node \"crc\" DevicePath \"\"" Mar 16 15:58:01 crc kubenswrapper[5120]: I0316 15:58:01.837154 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 15:58:01 crc kubenswrapper[5120]: I0316 15:58:01.837352 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="2093a744-47aa-4623-99ce-d001469addae" containerName="nova-scheduler-scheduler" containerID="cri-o://908beac09cdf4678806ac05743ba414add53c4ab73a59367248c5fe0c26056da" gracePeriod=30 Mar 16 15:58:01 crc kubenswrapper[5120]: I0316 15:58:01.855169 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 15:58:01 crc kubenswrapper[5120]: I0316 15:58:01.855624 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="318b5444-18f6-45b3-aaac-62f4457fb01a" containerName="nova-metadata-log" containerID="cri-o://72edd44371c0419d4238b34e3f9e8b5b8ad817b547b0c633aea80a46c2dcc422" gracePeriod=30 Mar 16 15:58:01 crc kubenswrapper[5120]: I0316 15:58:01.856101 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="318b5444-18f6-45b3-aaac-62f4457fb01a" containerName="nova-metadata-metadata" containerID="cri-o://ca200cb8534e05fd2b4b737bd3676b45f55b106a873123835d29436742ed23e4" gracePeriod=30 Mar 16 15:58:01 crc kubenswrapper[5120]: I0316 15:58:01.902172 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ccea3155-4cc4-4790-8a1d-3f6ebe2d0dcd-config-data" (OuterVolumeSpecName: "config-data") pod "ccea3155-4cc4-4790-8a1d-3f6ebe2d0dcd" (UID: "ccea3155-4cc4-4790-8a1d-3f6ebe2d0dcd"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:58:01 crc kubenswrapper[5120]: I0316 15:58:01.914201 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ccea3155-4cc4-4790-8a1d-3f6ebe2d0dcd-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 15:58:02 crc kubenswrapper[5120]: I0316 15:58:02.384500 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:58:02 crc kubenswrapper[5120]: E0316 15:58:02.405656 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="908beac09cdf4678806ac05743ba414add53c4ab73a59367248c5fe0c26056da" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 15:58:02 crc kubenswrapper[5120]: E0316 15:58:02.407582 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="908beac09cdf4678806ac05743ba414add53c4ab73a59367248c5fe0c26056da" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 15:58:02 crc kubenswrapper[5120]: E0316 15:58:02.408844 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="908beac09cdf4678806ac05743ba414add53c4ab73a59367248c5fe0c26056da" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 15:58:02 crc kubenswrapper[5120]: E0316 15:58:02.408882 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="2093a744-47aa-4623-99ce-d001469addae" containerName="nova-scheduler-scheduler" probeResult="unknown" Mar 16 15:58:02 crc kubenswrapper[5120]: I0316 15:58:02.529131 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a135d365-4292-4a0e-b743-a5cace8f3166-logs\") pod \"a135d365-4292-4a0e-b743-a5cace8f3166\" (UID: \"a135d365-4292-4a0e-b743-a5cace8f3166\") " Mar 16 15:58:02 crc kubenswrapper[5120]: I0316 15:58:02.529236 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a135d365-4292-4a0e-b743-a5cace8f3166-combined-ca-bundle\") pod \"a135d365-4292-4a0e-b743-a5cace8f3166\" (UID: \"a135d365-4292-4a0e-b743-a5cace8f3166\") " Mar 16 15:58:02 crc kubenswrapper[5120]: I0316 15:58:02.529267 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/a135d365-4292-4a0e-b743-a5cace8f3166-internal-tls-certs\") pod \"a135d365-4292-4a0e-b743-a5cace8f3166\" (UID: \"a135d365-4292-4a0e-b743-a5cace8f3166\") " Mar 16 15:58:02 crc kubenswrapper[5120]: I0316 15:58:02.529488 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a135d365-4292-4a0e-b743-a5cace8f3166-config-data\") pod \"a135d365-4292-4a0e-b743-a5cace8f3166\" (UID: \"a135d365-4292-4a0e-b743-a5cace8f3166\") " Mar 16 15:58:02 crc kubenswrapper[5120]: I0316 15:58:02.529679 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jqzfg\" (UniqueName: \"kubernetes.io/projected/a135d365-4292-4a0e-b743-a5cace8f3166-kube-api-access-jqzfg\") pod \"a135d365-4292-4a0e-b743-a5cace8f3166\" (UID: \"a135d365-4292-4a0e-b743-a5cace8f3166\") " Mar 16 15:58:02 crc kubenswrapper[5120]: I0316 15:58:02.529837 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/a135d365-4292-4a0e-b743-a5cace8f3166-public-tls-certs\") pod \"a135d365-4292-4a0e-b743-a5cace8f3166\" (UID: \"a135d365-4292-4a0e-b743-a5cace8f3166\") " Mar 16 15:58:02 crc kubenswrapper[5120]: I0316 15:58:02.530042 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a135d365-4292-4a0e-b743-a5cace8f3166-logs" (OuterVolumeSpecName: "logs") pod "a135d365-4292-4a0e-b743-a5cace8f3166" (UID: "a135d365-4292-4a0e-b743-a5cace8f3166"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:58:02 crc kubenswrapper[5120]: I0316 15:58:02.531264 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a135d365-4292-4a0e-b743-a5cace8f3166-logs\") on node \"crc\" DevicePath \"\"" Mar 16 15:58:02 crc kubenswrapper[5120]: I0316 15:58:02.541832 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a135d365-4292-4a0e-b743-a5cace8f3166-kube-api-access-jqzfg" (OuterVolumeSpecName: "kube-api-access-jqzfg") pod "a135d365-4292-4a0e-b743-a5cace8f3166" (UID: "a135d365-4292-4a0e-b743-a5cace8f3166"). InnerVolumeSpecName "kube-api-access-jqzfg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:58:02 crc kubenswrapper[5120]: I0316 15:58:02.556251 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a135d365-4292-4a0e-b743-a5cace8f3166-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "a135d365-4292-4a0e-b743-a5cace8f3166" (UID: "a135d365-4292-4a0e-b743-a5cace8f3166"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:58:02 crc kubenswrapper[5120]: I0316 15:58:02.569585 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a135d365-4292-4a0e-b743-a5cace8f3166-config-data" (OuterVolumeSpecName: "config-data") pod "a135d365-4292-4a0e-b743-a5cace8f3166" (UID: "a135d365-4292-4a0e-b743-a5cace8f3166"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:58:02 crc kubenswrapper[5120]: I0316 15:58:02.584997 5120 generic.go:358] "Generic (PLEG): container finished" podID="318b5444-18f6-45b3-aaac-62f4457fb01a" containerID="72edd44371c0419d4238b34e3f9e8b5b8ad817b547b0c633aea80a46c2dcc422" exitCode=143 Mar 16 15:58:02 crc kubenswrapper[5120]: I0316 15:58:02.585098 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"318b5444-18f6-45b3-aaac-62f4457fb01a","Type":"ContainerDied","Data":"72edd44371c0419d4238b34e3f9e8b5b8ad817b547b0c633aea80a46c2dcc422"} Mar 16 15:58:02 crc kubenswrapper[5120]: I0316 15:58:02.587665 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a135d365-4292-4a0e-b743-a5cace8f3166-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "a135d365-4292-4a0e-b743-a5cace8f3166" (UID: "a135d365-4292-4a0e-b743-a5cace8f3166"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:58:02 crc kubenswrapper[5120]: I0316 15:58:02.587687 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561278-nt8th" event={"ID":"b5ebd69d-6eae-46e3-8567-f43a281355ef","Type":"ContainerStarted","Data":"78cce0266e8895a361fcac897a2f73bbc2532f8fb68591f8d86e68607c1d63b9"} Mar 16 15:58:02 crc kubenswrapper[5120]: I0316 15:58:02.591142 5120 generic.go:358] "Generic (PLEG): container finished" podID="a135d365-4292-4a0e-b743-a5cace8f3166" containerID="35ce49421f86075c31b4fc24a5e0e6cdc7fe1373eb727c7ab0c71bd9c8de4726" exitCode=0 Mar 16 15:58:02 crc kubenswrapper[5120]: I0316 15:58:02.591197 5120 generic.go:358] "Generic (PLEG): container finished" podID="a135d365-4292-4a0e-b743-a5cace8f3166" containerID="8cb67de283dc08cf0b38850daf45a157ab4df3987c5c447699d11491d5e574ca" exitCode=143 Mar 16 15:58:02 crc kubenswrapper[5120]: I0316 15:58:02.591314 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:58:02 crc kubenswrapper[5120]: I0316 15:58:02.591407 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"a135d365-4292-4a0e-b743-a5cace8f3166","Type":"ContainerDied","Data":"35ce49421f86075c31b4fc24a5e0e6cdc7fe1373eb727c7ab0c71bd9c8de4726"} Mar 16 15:58:02 crc kubenswrapper[5120]: I0316 15:58:02.591445 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"a135d365-4292-4a0e-b743-a5cace8f3166","Type":"ContainerDied","Data":"8cb67de283dc08cf0b38850daf45a157ab4df3987c5c447699d11491d5e574ca"} Mar 16 15:58:02 crc kubenswrapper[5120]: I0316 15:58:02.591465 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"a135d365-4292-4a0e-b743-a5cace8f3166","Type":"ContainerDied","Data":"01fc3cc23e891fcf4ae45c5fe4bba18a6b4f974672af23211a753307243f03d5"} Mar 16 15:58:02 crc kubenswrapper[5120]: I0316 15:58:02.591482 5120 scope.go:117] "RemoveContainer" containerID="35ce49421f86075c31b4fc24a5e0e6cdc7fe1373eb727c7ab0c71bd9c8de4726" Mar 16 15:58:02 crc kubenswrapper[5120]: I0316 15:58:02.591623 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:58:02 crc kubenswrapper[5120]: I0316 15:58:02.613655 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-infra/auto-csr-approver-29561278-nt8th" podStartSLOduration=1.50375338 podStartE2EDuration="2.613634612s" podCreationTimestamp="2026-03-16 15:58:00 +0000 UTC" firstStartedPulling="2026-03-16 15:58:01.019575501 +0000 UTC m=+1583.173507158" lastFinishedPulling="2026-03-16 15:58:02.129456733 +0000 UTC m=+1584.283388390" observedRunningTime="2026-03-16 15:58:02.602923956 +0000 UTC m=+1584.756855613" watchObservedRunningTime="2026-03-16 15:58:02.613634612 +0000 UTC m=+1584.767566269" Mar 16 15:58:02 crc kubenswrapper[5120]: I0316 15:58:02.613951 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a135d365-4292-4a0e-b743-a5cace8f3166-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "a135d365-4292-4a0e-b743-a5cace8f3166" (UID: "a135d365-4292-4a0e-b743-a5cace8f3166"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:58:02 crc kubenswrapper[5120]: I0316 15:58:02.633200 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/a135d365-4292-4a0e-b743-a5cace8f3166-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 15:58:02 crc kubenswrapper[5120]: I0316 15:58:02.633239 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a135d365-4292-4a0e-b743-a5cace8f3166-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:58:02 crc kubenswrapper[5120]: I0316 15:58:02.633257 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/a135d365-4292-4a0e-b743-a5cace8f3166-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 15:58:02 crc kubenswrapper[5120]: I0316 15:58:02.633270 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a135d365-4292-4a0e-b743-a5cace8f3166-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 15:58:02 crc kubenswrapper[5120]: I0316 15:58:02.633284 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jqzfg\" (UniqueName: \"kubernetes.io/projected/a135d365-4292-4a0e-b743-a5cace8f3166-kube-api-access-jqzfg\") on node \"crc\" DevicePath \"\"" Mar 16 15:58:02 crc kubenswrapper[5120]: I0316 15:58:02.701526 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 15:58:02 crc kubenswrapper[5120]: I0316 15:58:02.713809 5120 scope.go:117] "RemoveContainer" containerID="8cb67de283dc08cf0b38850daf45a157ab4df3987c5c447699d11491d5e574ca" Mar 16 15:58:02 crc kubenswrapper[5120]: I0316 15:58:02.726275 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 15:58:02 crc kubenswrapper[5120]: I0316 15:58:02.733572 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 15:58:02 crc kubenswrapper[5120]: I0316 15:58:02.734652 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ccea3155-4cc4-4790-8a1d-3f6ebe2d0dcd" containerName="proxy-httpd" Mar 16 15:58:02 crc kubenswrapper[5120]: I0316 15:58:02.734664 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ccea3155-4cc4-4790-8a1d-3f6ebe2d0dcd" containerName="proxy-httpd" Mar 16 15:58:02 crc kubenswrapper[5120]: I0316 15:58:02.734678 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a135d365-4292-4a0e-b743-a5cace8f3166" containerName="nova-api-log" Mar 16 15:58:02 crc kubenswrapper[5120]: I0316 15:58:02.734684 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a135d365-4292-4a0e-b743-a5cace8f3166" containerName="nova-api-log" Mar 16 15:58:02 crc kubenswrapper[5120]: I0316 15:58:02.734697 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ccea3155-4cc4-4790-8a1d-3f6ebe2d0dcd" containerName="ceilometer-notification-agent" Mar 16 15:58:02 crc kubenswrapper[5120]: I0316 15:58:02.734704 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ccea3155-4cc4-4790-8a1d-3f6ebe2d0dcd" containerName="ceilometer-notification-agent" Mar 16 15:58:02 crc kubenswrapper[5120]: I0316 15:58:02.734719 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a135d365-4292-4a0e-b743-a5cace8f3166" containerName="nova-api-api" Mar 16 15:58:02 crc kubenswrapper[5120]: I0316 15:58:02.734725 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a135d365-4292-4a0e-b743-a5cace8f3166" containerName="nova-api-api" Mar 16 15:58:02 crc kubenswrapper[5120]: I0316 15:58:02.734743 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ccea3155-4cc4-4790-8a1d-3f6ebe2d0dcd" containerName="ceilometer-central-agent" Mar 16 15:58:02 crc kubenswrapper[5120]: I0316 15:58:02.734748 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ccea3155-4cc4-4790-8a1d-3f6ebe2d0dcd" containerName="ceilometer-central-agent" Mar 16 15:58:02 crc kubenswrapper[5120]: I0316 15:58:02.734774 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efbef5eb-902c-46b3-ba4c-5c31917acf20" containerName="nova-manage" Mar 16 15:58:02 crc kubenswrapper[5120]: I0316 15:58:02.734780 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="efbef5eb-902c-46b3-ba4c-5c31917acf20" containerName="nova-manage" Mar 16 15:58:02 crc kubenswrapper[5120]: I0316 15:58:02.734802 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ccea3155-4cc4-4790-8a1d-3f6ebe2d0dcd" containerName="sg-core" Mar 16 15:58:02 crc kubenswrapper[5120]: I0316 15:58:02.734808 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ccea3155-4cc4-4790-8a1d-3f6ebe2d0dcd" containerName="sg-core" Mar 16 15:58:02 crc kubenswrapper[5120]: I0316 15:58:02.735015 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ccea3155-4cc4-4790-8a1d-3f6ebe2d0dcd" containerName="ceilometer-central-agent" Mar 16 15:58:02 crc kubenswrapper[5120]: I0316 15:58:02.735035 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="a135d365-4292-4a0e-b743-a5cace8f3166" containerName="nova-api-log" Mar 16 15:58:02 crc kubenswrapper[5120]: I0316 15:58:02.735047 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ccea3155-4cc4-4790-8a1d-3f6ebe2d0dcd" containerName="ceilometer-notification-agent" Mar 16 15:58:02 crc kubenswrapper[5120]: I0316 15:58:02.735059 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="efbef5eb-902c-46b3-ba4c-5c31917acf20" containerName="nova-manage" Mar 16 15:58:02 crc kubenswrapper[5120]: I0316 15:58:02.735068 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ccea3155-4cc4-4790-8a1d-3f6ebe2d0dcd" containerName="sg-core" Mar 16 15:58:02 crc kubenswrapper[5120]: I0316 15:58:02.735075 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ccea3155-4cc4-4790-8a1d-3f6ebe2d0dcd" containerName="proxy-httpd" Mar 16 15:58:02 crc kubenswrapper[5120]: I0316 15:58:02.735086 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="a135d365-4292-4a0e-b743-a5cace8f3166" containerName="nova-api-api" Mar 16 15:58:02 crc kubenswrapper[5120]: I0316 15:58:02.738705 5120 scope.go:117] "RemoveContainer" containerID="35ce49421f86075c31b4fc24a5e0e6cdc7fe1373eb727c7ab0c71bd9c8de4726" Mar 16 15:58:02 crc kubenswrapper[5120]: I0316 15:58:02.744395 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 15:58:02 crc kubenswrapper[5120]: I0316 15:58:02.744496 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:58:02 crc kubenswrapper[5120]: E0316 15:58:02.747567 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"35ce49421f86075c31b4fc24a5e0e6cdc7fe1373eb727c7ab0c71bd9c8de4726\": container with ID starting with 35ce49421f86075c31b4fc24a5e0e6cdc7fe1373eb727c7ab0c71bd9c8de4726 not found: ID does not exist" containerID="35ce49421f86075c31b4fc24a5e0e6cdc7fe1373eb727c7ab0c71bd9c8de4726" Mar 16 15:58:02 crc kubenswrapper[5120]: I0316 15:58:02.747628 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35ce49421f86075c31b4fc24a5e0e6cdc7fe1373eb727c7ab0c71bd9c8de4726"} err="failed to get container status \"35ce49421f86075c31b4fc24a5e0e6cdc7fe1373eb727c7ab0c71bd9c8de4726\": rpc error: code = NotFound desc = could not find container \"35ce49421f86075c31b4fc24a5e0e6cdc7fe1373eb727c7ab0c71bd9c8de4726\": container with ID starting with 35ce49421f86075c31b4fc24a5e0e6cdc7fe1373eb727c7ab0c71bd9c8de4726 not found: ID does not exist" Mar 16 15:58:02 crc kubenswrapper[5120]: I0316 15:58:02.747657 5120 scope.go:117] "RemoveContainer" containerID="8cb67de283dc08cf0b38850daf45a157ab4df3987c5c447699d11491d5e574ca" Mar 16 15:58:02 crc kubenswrapper[5120]: I0316 15:58:02.747931 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 15:58:02 crc kubenswrapper[5120]: I0316 15:58:02.747976 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 15:58:02 crc kubenswrapper[5120]: E0316 15:58:02.748077 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8cb67de283dc08cf0b38850daf45a157ab4df3987c5c447699d11491d5e574ca\": container with ID starting with 8cb67de283dc08cf0b38850daf45a157ab4df3987c5c447699d11491d5e574ca not found: ID does not exist" containerID="8cb67de283dc08cf0b38850daf45a157ab4df3987c5c447699d11491d5e574ca" Mar 16 15:58:02 crc kubenswrapper[5120]: I0316 15:58:02.748123 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8cb67de283dc08cf0b38850daf45a157ab4df3987c5c447699d11491d5e574ca"} err="failed to get container status \"8cb67de283dc08cf0b38850daf45a157ab4df3987c5c447699d11491d5e574ca\": rpc error: code = NotFound desc = could not find container \"8cb67de283dc08cf0b38850daf45a157ab4df3987c5c447699d11491d5e574ca\": container with ID starting with 8cb67de283dc08cf0b38850daf45a157ab4df3987c5c447699d11491d5e574ca not found: ID does not exist" Mar 16 15:58:02 crc kubenswrapper[5120]: I0316 15:58:02.748150 5120 scope.go:117] "RemoveContainer" containerID="35ce49421f86075c31b4fc24a5e0e6cdc7fe1373eb727c7ab0c71bd9c8de4726" Mar 16 15:58:02 crc kubenswrapper[5120]: I0316 15:58:02.748399 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35ce49421f86075c31b4fc24a5e0e6cdc7fe1373eb727c7ab0c71bd9c8de4726"} err="failed to get container status \"35ce49421f86075c31b4fc24a5e0e6cdc7fe1373eb727c7ab0c71bd9c8de4726\": rpc error: code = NotFound desc = could not find container \"35ce49421f86075c31b4fc24a5e0e6cdc7fe1373eb727c7ab0c71bd9c8de4726\": container with ID starting with 35ce49421f86075c31b4fc24a5e0e6cdc7fe1373eb727c7ab0c71bd9c8de4726 not found: ID does not exist" Mar 16 15:58:02 crc kubenswrapper[5120]: I0316 15:58:02.748425 5120 scope.go:117] "RemoveContainer" containerID="8cb67de283dc08cf0b38850daf45a157ab4df3987c5c447699d11491d5e574ca" Mar 16 15:58:02 crc kubenswrapper[5120]: I0316 15:58:02.748605 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8cb67de283dc08cf0b38850daf45a157ab4df3987c5c447699d11491d5e574ca"} err="failed to get container status \"8cb67de283dc08cf0b38850daf45a157ab4df3987c5c447699d11491d5e574ca\": rpc error: code = NotFound desc = could not find container \"8cb67de283dc08cf0b38850daf45a157ab4df3987c5c447699d11491d5e574ca\": container with ID starting with 8cb67de283dc08cf0b38850daf45a157ab4df3987c5c447699d11491d5e574ca not found: ID does not exist" Mar 16 15:58:02 crc kubenswrapper[5120]: I0316 15:58:02.837373 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ae1d03a6-018f-4911-94d8-1a45cd691544-log-httpd\") pod \"ceilometer-0\" (UID: \"ae1d03a6-018f-4911-94d8-1a45cd691544\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:58:02 crc kubenswrapper[5120]: I0316 15:58:02.837447 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ae1d03a6-018f-4911-94d8-1a45cd691544-config-data\") pod \"ceilometer-0\" (UID: \"ae1d03a6-018f-4911-94d8-1a45cd691544\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:58:02 crc kubenswrapper[5120]: I0316 15:58:02.837511 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ae1d03a6-018f-4911-94d8-1a45cd691544-scripts\") pod \"ceilometer-0\" (UID: \"ae1d03a6-018f-4911-94d8-1a45cd691544\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:58:02 crc kubenswrapper[5120]: I0316 15:58:02.837724 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ae1d03a6-018f-4911-94d8-1a45cd691544-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"ae1d03a6-018f-4911-94d8-1a45cd691544\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:58:02 crc kubenswrapper[5120]: I0316 15:58:02.837935 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/ae1d03a6-018f-4911-94d8-1a45cd691544-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"ae1d03a6-018f-4911-94d8-1a45cd691544\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:58:02 crc kubenswrapper[5120]: I0316 15:58:02.838094 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tz6fp\" (UniqueName: \"kubernetes.io/projected/ae1d03a6-018f-4911-94d8-1a45cd691544-kube-api-access-tz6fp\") pod \"ceilometer-0\" (UID: \"ae1d03a6-018f-4911-94d8-1a45cd691544\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:58:02 crc kubenswrapper[5120]: I0316 15:58:02.838181 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ae1d03a6-018f-4911-94d8-1a45cd691544-run-httpd\") pod \"ceilometer-0\" (UID: \"ae1d03a6-018f-4911-94d8-1a45cd691544\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:58:02 crc kubenswrapper[5120]: I0316 15:58:02.931176 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 15:58:02 crc kubenswrapper[5120]: I0316 15:58:02.938988 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 15:58:02 crc kubenswrapper[5120]: I0316 15:58:02.940568 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ae1d03a6-018f-4911-94d8-1a45cd691544-scripts\") pod \"ceilometer-0\" (UID: \"ae1d03a6-018f-4911-94d8-1a45cd691544\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:58:02 crc kubenswrapper[5120]: I0316 15:58:02.940659 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ae1d03a6-018f-4911-94d8-1a45cd691544-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"ae1d03a6-018f-4911-94d8-1a45cd691544\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:58:02 crc kubenswrapper[5120]: I0316 15:58:02.940710 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/ae1d03a6-018f-4911-94d8-1a45cd691544-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"ae1d03a6-018f-4911-94d8-1a45cd691544\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:58:02 crc kubenswrapper[5120]: I0316 15:58:02.940792 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tz6fp\" (UniqueName: \"kubernetes.io/projected/ae1d03a6-018f-4911-94d8-1a45cd691544-kube-api-access-tz6fp\") pod \"ceilometer-0\" (UID: \"ae1d03a6-018f-4911-94d8-1a45cd691544\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:58:02 crc kubenswrapper[5120]: I0316 15:58:02.940837 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ae1d03a6-018f-4911-94d8-1a45cd691544-run-httpd\") pod \"ceilometer-0\" (UID: \"ae1d03a6-018f-4911-94d8-1a45cd691544\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:58:02 crc kubenswrapper[5120]: I0316 15:58:02.940908 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ae1d03a6-018f-4911-94d8-1a45cd691544-log-httpd\") pod \"ceilometer-0\" (UID: \"ae1d03a6-018f-4911-94d8-1a45cd691544\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:58:02 crc kubenswrapper[5120]: I0316 15:58:02.940936 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ae1d03a6-018f-4911-94d8-1a45cd691544-config-data\") pod \"ceilometer-0\" (UID: \"ae1d03a6-018f-4911-94d8-1a45cd691544\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:58:02 crc kubenswrapper[5120]: I0316 15:58:02.948362 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ae1d03a6-018f-4911-94d8-1a45cd691544-config-data\") pod \"ceilometer-0\" (UID: \"ae1d03a6-018f-4911-94d8-1a45cd691544\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:58:02 crc kubenswrapper[5120]: I0316 15:58:02.949035 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ae1d03a6-018f-4911-94d8-1a45cd691544-run-httpd\") pod \"ceilometer-0\" (UID: \"ae1d03a6-018f-4911-94d8-1a45cd691544\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:58:02 crc kubenswrapper[5120]: I0316 15:58:02.949273 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ae1d03a6-018f-4911-94d8-1a45cd691544-log-httpd\") pod \"ceilometer-0\" (UID: \"ae1d03a6-018f-4911-94d8-1a45cd691544\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:58:02 crc kubenswrapper[5120]: I0316 15:58:02.954119 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/ae1d03a6-018f-4911-94d8-1a45cd691544-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"ae1d03a6-018f-4911-94d8-1a45cd691544\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:58:02 crc kubenswrapper[5120]: I0316 15:58:02.959046 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ae1d03a6-018f-4911-94d8-1a45cd691544-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"ae1d03a6-018f-4911-94d8-1a45cd691544\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:58:02 crc kubenswrapper[5120]: I0316 15:58:02.961316 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 15:58:02 crc kubenswrapper[5120]: I0316 15:58:02.964980 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ae1d03a6-018f-4911-94d8-1a45cd691544-scripts\") pod \"ceilometer-0\" (UID: \"ae1d03a6-018f-4911-94d8-1a45cd691544\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:58:02 crc kubenswrapper[5120]: I0316 15:58:02.966002 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tz6fp\" (UniqueName: \"kubernetes.io/projected/ae1d03a6-018f-4911-94d8-1a45cd691544-kube-api-access-tz6fp\") pod \"ceilometer-0\" (UID: \"ae1d03a6-018f-4911-94d8-1a45cd691544\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:58:02 crc kubenswrapper[5120]: I0316 15:58:02.967925 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:58:02 crc kubenswrapper[5120]: I0316 15:58:02.970772 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-public-svc\"" Mar 16 15:58:02 crc kubenswrapper[5120]: I0316 15:58:02.971002 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-internal-svc\"" Mar 16 15:58:02 crc kubenswrapper[5120]: I0316 15:58:02.971156 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-config-data\"" Mar 16 15:58:02 crc kubenswrapper[5120]: I0316 15:58:02.989667 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 15:58:03 crc kubenswrapper[5120]: I0316 15:58:03.042589 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/188dbfe0-6d71-4ba4-a3b7-6ee900a60138-internal-tls-certs\") pod \"nova-api-0\" (UID: \"188dbfe0-6d71-4ba4-a3b7-6ee900a60138\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:58:03 crc kubenswrapper[5120]: I0316 15:58:03.042657 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/188dbfe0-6d71-4ba4-a3b7-6ee900a60138-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"188dbfe0-6d71-4ba4-a3b7-6ee900a60138\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:58:03 crc kubenswrapper[5120]: I0316 15:58:03.042735 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/188dbfe0-6d71-4ba4-a3b7-6ee900a60138-config-data\") pod \"nova-api-0\" (UID: \"188dbfe0-6d71-4ba4-a3b7-6ee900a60138\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:58:03 crc kubenswrapper[5120]: I0316 15:58:03.042840 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/188dbfe0-6d71-4ba4-a3b7-6ee900a60138-public-tls-certs\") pod \"nova-api-0\" (UID: \"188dbfe0-6d71-4ba4-a3b7-6ee900a60138\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:58:03 crc kubenswrapper[5120]: I0316 15:58:03.042878 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/188dbfe0-6d71-4ba4-a3b7-6ee900a60138-logs\") pod \"nova-api-0\" (UID: \"188dbfe0-6d71-4ba4-a3b7-6ee900a60138\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:58:03 crc kubenswrapper[5120]: I0316 15:58:03.042943 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdkrv\" (UniqueName: \"kubernetes.io/projected/188dbfe0-6d71-4ba4-a3b7-6ee900a60138-kube-api-access-cdkrv\") pod \"nova-api-0\" (UID: \"188dbfe0-6d71-4ba4-a3b7-6ee900a60138\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:58:03 crc kubenswrapper[5120]: I0316 15:58:03.067924 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:58:03 crc kubenswrapper[5120]: I0316 15:58:03.144944 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/188dbfe0-6d71-4ba4-a3b7-6ee900a60138-logs\") pod \"nova-api-0\" (UID: \"188dbfe0-6d71-4ba4-a3b7-6ee900a60138\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:58:03 crc kubenswrapper[5120]: I0316 15:58:03.145063 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cdkrv\" (UniqueName: \"kubernetes.io/projected/188dbfe0-6d71-4ba4-a3b7-6ee900a60138-kube-api-access-cdkrv\") pod \"nova-api-0\" (UID: \"188dbfe0-6d71-4ba4-a3b7-6ee900a60138\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:58:03 crc kubenswrapper[5120]: I0316 15:58:03.145107 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/188dbfe0-6d71-4ba4-a3b7-6ee900a60138-internal-tls-certs\") pod \"nova-api-0\" (UID: \"188dbfe0-6d71-4ba4-a3b7-6ee900a60138\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:58:03 crc kubenswrapper[5120]: I0316 15:58:03.145187 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/188dbfe0-6d71-4ba4-a3b7-6ee900a60138-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"188dbfe0-6d71-4ba4-a3b7-6ee900a60138\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:58:03 crc kubenswrapper[5120]: I0316 15:58:03.145232 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/188dbfe0-6d71-4ba4-a3b7-6ee900a60138-config-data\") pod \"nova-api-0\" (UID: \"188dbfe0-6d71-4ba4-a3b7-6ee900a60138\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:58:03 crc kubenswrapper[5120]: I0316 15:58:03.145378 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/188dbfe0-6d71-4ba4-a3b7-6ee900a60138-public-tls-certs\") pod \"nova-api-0\" (UID: \"188dbfe0-6d71-4ba4-a3b7-6ee900a60138\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:58:03 crc kubenswrapper[5120]: I0316 15:58:03.148582 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/188dbfe0-6d71-4ba4-a3b7-6ee900a60138-logs\") pod \"nova-api-0\" (UID: \"188dbfe0-6d71-4ba4-a3b7-6ee900a60138\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:58:03 crc kubenswrapper[5120]: I0316 15:58:03.152304 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/188dbfe0-6d71-4ba4-a3b7-6ee900a60138-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"188dbfe0-6d71-4ba4-a3b7-6ee900a60138\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:58:03 crc kubenswrapper[5120]: I0316 15:58:03.153482 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/188dbfe0-6d71-4ba4-a3b7-6ee900a60138-config-data\") pod \"nova-api-0\" (UID: \"188dbfe0-6d71-4ba4-a3b7-6ee900a60138\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:58:03 crc kubenswrapper[5120]: I0316 15:58:03.155630 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/188dbfe0-6d71-4ba4-a3b7-6ee900a60138-public-tls-certs\") pod \"nova-api-0\" (UID: \"188dbfe0-6d71-4ba4-a3b7-6ee900a60138\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:58:03 crc kubenswrapper[5120]: I0316 15:58:03.156098 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/188dbfe0-6d71-4ba4-a3b7-6ee900a60138-internal-tls-certs\") pod \"nova-api-0\" (UID: \"188dbfe0-6d71-4ba4-a3b7-6ee900a60138\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:58:03 crc kubenswrapper[5120]: I0316 15:58:03.166594 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdkrv\" (UniqueName: \"kubernetes.io/projected/188dbfe0-6d71-4ba4-a3b7-6ee900a60138-kube-api-access-cdkrv\") pod \"nova-api-0\" (UID: \"188dbfe0-6d71-4ba4-a3b7-6ee900a60138\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:58:03 crc kubenswrapper[5120]: I0316 15:58:03.313484 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:58:03 crc kubenswrapper[5120]: I0316 15:58:03.523076 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 15:58:03 crc kubenswrapper[5120]: I0316 15:58:03.616437 5120 generic.go:358] "Generic (PLEG): container finished" podID="b5ebd69d-6eae-46e3-8567-f43a281355ef" containerID="78cce0266e8895a361fcac897a2f73bbc2532f8fb68591f8d86e68607c1d63b9" exitCode=0 Mar 16 15:58:03 crc kubenswrapper[5120]: I0316 15:58:03.616706 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561278-nt8th" event={"ID":"b5ebd69d-6eae-46e3-8567-f43a281355ef","Type":"ContainerDied","Data":"78cce0266e8895a361fcac897a2f73bbc2532f8fb68591f8d86e68607c1d63b9"} Mar 16 15:58:03 crc kubenswrapper[5120]: I0316 15:58:03.621827 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ae1d03a6-018f-4911-94d8-1a45cd691544","Type":"ContainerStarted","Data":"7c6e481a78c818dbbb6c277ba8377c2b6daca502acdddc138b701a1567552fd8"} Mar 16 15:58:03 crc kubenswrapper[5120]: I0316 15:58:03.777330 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 15:58:03 crc kubenswrapper[5120]: W0316 15:58:03.782749 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod188dbfe0_6d71_4ba4_a3b7_6ee900a60138.slice/crio-2835c7c7c54adddb2757b060bdff6eb6cad04c25ea6f22eb1c8aadf3e09d736b WatchSource:0}: Error finding container 2835c7c7c54adddb2757b060bdff6eb6cad04c25ea6f22eb1c8aadf3e09d736b: Status 404 returned error can't find the container with id 2835c7c7c54adddb2757b060bdff6eb6cad04c25ea6f22eb1c8aadf3e09d736b Mar 16 15:58:04 crc kubenswrapper[5120]: I0316 15:58:04.011577 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 15:58:04 crc kubenswrapper[5120]: I0316 15:58:04.172909 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2093a744-47aa-4623-99ce-d001469addae-config-data\") pod \"2093a744-47aa-4623-99ce-d001469addae\" (UID: \"2093a744-47aa-4623-99ce-d001469addae\") " Mar 16 15:58:04 crc kubenswrapper[5120]: I0316 15:58:04.173171 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2093a744-47aa-4623-99ce-d001469addae-combined-ca-bundle\") pod \"2093a744-47aa-4623-99ce-d001469addae\" (UID: \"2093a744-47aa-4623-99ce-d001469addae\") " Mar 16 15:58:04 crc kubenswrapper[5120]: I0316 15:58:04.173248 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rbc5c\" (UniqueName: \"kubernetes.io/projected/2093a744-47aa-4623-99ce-d001469addae-kube-api-access-rbc5c\") pod \"2093a744-47aa-4623-99ce-d001469addae\" (UID: \"2093a744-47aa-4623-99ce-d001469addae\") " Mar 16 15:58:04 crc kubenswrapper[5120]: I0316 15:58:04.249889 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2093a744-47aa-4623-99ce-d001469addae-kube-api-access-rbc5c" (OuterVolumeSpecName: "kube-api-access-rbc5c") pod "2093a744-47aa-4623-99ce-d001469addae" (UID: "2093a744-47aa-4623-99ce-d001469addae"). InnerVolumeSpecName "kube-api-access-rbc5c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:58:04 crc kubenswrapper[5120]: I0316 15:58:04.258523 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2093a744-47aa-4623-99ce-d001469addae-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "2093a744-47aa-4623-99ce-d001469addae" (UID: "2093a744-47aa-4623-99ce-d001469addae"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:58:04 crc kubenswrapper[5120]: I0316 15:58:04.271383 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2093a744-47aa-4623-99ce-d001469addae-config-data" (OuterVolumeSpecName: "config-data") pod "2093a744-47aa-4623-99ce-d001469addae" (UID: "2093a744-47aa-4623-99ce-d001469addae"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:58:04 crc kubenswrapper[5120]: I0316 15:58:04.276157 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2093a744-47aa-4623-99ce-d001469addae-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:58:04 crc kubenswrapper[5120]: I0316 15:58:04.276222 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rbc5c\" (UniqueName: \"kubernetes.io/projected/2093a744-47aa-4623-99ce-d001469addae-kube-api-access-rbc5c\") on node \"crc\" DevicePath \"\"" Mar 16 15:58:04 crc kubenswrapper[5120]: I0316 15:58:04.276246 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2093a744-47aa-4623-99ce-d001469addae-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 15:58:04 crc kubenswrapper[5120]: I0316 15:58:04.642368 5120 generic.go:358] "Generic (PLEG): container finished" podID="2093a744-47aa-4623-99ce-d001469addae" containerID="908beac09cdf4678806ac05743ba414add53c4ab73a59367248c5fe0c26056da" exitCode=0 Mar 16 15:58:04 crc kubenswrapper[5120]: I0316 15:58:04.642524 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"2093a744-47aa-4623-99ce-d001469addae","Type":"ContainerDied","Data":"908beac09cdf4678806ac05743ba414add53c4ab73a59367248c5fe0c26056da"} Mar 16 15:58:04 crc kubenswrapper[5120]: I0316 15:58:04.642591 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 15:58:04 crc kubenswrapper[5120]: I0316 15:58:04.642820 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"2093a744-47aa-4623-99ce-d001469addae","Type":"ContainerDied","Data":"b873044c8678850b99567c3cccc077f18edec8cec99ad6d25ad47e735e628416"} Mar 16 15:58:04 crc kubenswrapper[5120]: I0316 15:58:04.642847 5120 scope.go:117] "RemoveContainer" containerID="908beac09cdf4678806ac05743ba414add53c4ab73a59367248c5fe0c26056da" Mar 16 15:58:04 crc kubenswrapper[5120]: I0316 15:58:04.645548 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ae1d03a6-018f-4911-94d8-1a45cd691544","Type":"ContainerStarted","Data":"8ab831120d54dbad6b23e07ae2fcce12115e98589743c136d9399be45197d676"} Mar 16 15:58:04 crc kubenswrapper[5120]: I0316 15:58:04.648455 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"188dbfe0-6d71-4ba4-a3b7-6ee900a60138","Type":"ContainerStarted","Data":"5cb5336eec2bc9d72af934b6fd40e9184ab80151a298a3a10de1976e1f86500b"} Mar 16 15:58:04 crc kubenswrapper[5120]: I0316 15:58:04.648482 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"188dbfe0-6d71-4ba4-a3b7-6ee900a60138","Type":"ContainerStarted","Data":"41a2173d1d872cc17f3406c61f519f5887c310bc059bf9c62ba549c2902c7600"} Mar 16 15:58:04 crc kubenswrapper[5120]: I0316 15:58:04.648495 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"188dbfe0-6d71-4ba4-a3b7-6ee900a60138","Type":"ContainerStarted","Data":"2835c7c7c54adddb2757b060bdff6eb6cad04c25ea6f22eb1c8aadf3e09d736b"} Mar 16 15:58:04 crc kubenswrapper[5120]: I0316 15:58:04.685690 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=2.685670933 podStartE2EDuration="2.685670933s" podCreationTimestamp="2026-03-16 15:58:02 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:58:04.673025912 +0000 UTC m=+1586.826957559" watchObservedRunningTime="2026-03-16 15:58:04.685670933 +0000 UTC m=+1586.839602610" Mar 16 15:58:04 crc kubenswrapper[5120]: I0316 15:58:04.688916 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a135d365-4292-4a0e-b743-a5cace8f3166" path="/var/lib/kubelet/pods/a135d365-4292-4a0e-b743-a5cace8f3166/volumes" Mar 16 15:58:04 crc kubenswrapper[5120]: I0316 15:58:04.689536 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ccea3155-4cc4-4790-8a1d-3f6ebe2d0dcd" path="/var/lib/kubelet/pods/ccea3155-4cc4-4790-8a1d-3f6ebe2d0dcd/volumes" Mar 16 15:58:04 crc kubenswrapper[5120]: I0316 15:58:04.693017 5120 scope.go:117] "RemoveContainer" containerID="908beac09cdf4678806ac05743ba414add53c4ab73a59367248c5fe0c26056da" Mar 16 15:58:04 crc kubenswrapper[5120]: I0316 15:58:04.699334 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 15:58:04 crc kubenswrapper[5120]: E0316 15:58:04.699828 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"908beac09cdf4678806ac05743ba414add53c4ab73a59367248c5fe0c26056da\": container with ID starting with 908beac09cdf4678806ac05743ba414add53c4ab73a59367248c5fe0c26056da not found: ID does not exist" containerID="908beac09cdf4678806ac05743ba414add53c4ab73a59367248c5fe0c26056da" Mar 16 15:58:04 crc kubenswrapper[5120]: I0316 15:58:04.699862 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"908beac09cdf4678806ac05743ba414add53c4ab73a59367248c5fe0c26056da"} err="failed to get container status \"908beac09cdf4678806ac05743ba414add53c4ab73a59367248c5fe0c26056da\": rpc error: code = NotFound desc = could not find container \"908beac09cdf4678806ac05743ba414add53c4ab73a59367248c5fe0c26056da\": container with ID starting with 908beac09cdf4678806ac05743ba414add53c4ab73a59367248c5fe0c26056da not found: ID does not exist" Mar 16 15:58:04 crc kubenswrapper[5120]: I0316 15:58:04.714427 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 15:58:04 crc kubenswrapper[5120]: I0316 15:58:04.724205 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 15:58:04 crc kubenswrapper[5120]: I0316 15:58:04.726590 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2093a744-47aa-4623-99ce-d001469addae" containerName="nova-scheduler-scheduler" Mar 16 15:58:04 crc kubenswrapper[5120]: I0316 15:58:04.726609 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="2093a744-47aa-4623-99ce-d001469addae" containerName="nova-scheduler-scheduler" Mar 16 15:58:04 crc kubenswrapper[5120]: I0316 15:58:04.727028 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="2093a744-47aa-4623-99ce-d001469addae" containerName="nova-scheduler-scheduler" Mar 16 15:58:04 crc kubenswrapper[5120]: I0316 15:58:04.738620 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 15:58:04 crc kubenswrapper[5120]: I0316 15:58:04.738719 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 15:58:04 crc kubenswrapper[5120]: I0316 15:58:04.741248 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-scheduler-config-data\"" Mar 16 15:58:04 crc kubenswrapper[5120]: I0316 15:58:04.889365 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ca4a5201-32c6-4c58-8bac-4d1b05ddfbb4-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"ca4a5201-32c6-4c58-8bac-4d1b05ddfbb4\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 15:58:04 crc kubenswrapper[5120]: I0316 15:58:04.889604 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtcb2\" (UniqueName: \"kubernetes.io/projected/ca4a5201-32c6-4c58-8bac-4d1b05ddfbb4-kube-api-access-xtcb2\") pod \"nova-scheduler-0\" (UID: \"ca4a5201-32c6-4c58-8bac-4d1b05ddfbb4\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 15:58:04 crc kubenswrapper[5120]: I0316 15:58:04.889743 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ca4a5201-32c6-4c58-8bac-4d1b05ddfbb4-config-data\") pod \"nova-scheduler-0\" (UID: \"ca4a5201-32c6-4c58-8bac-4d1b05ddfbb4\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 15:58:04 crc kubenswrapper[5120]: I0316 15:58:04.991535 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ca4a5201-32c6-4c58-8bac-4d1b05ddfbb4-config-data\") pod \"nova-scheduler-0\" (UID: \"ca4a5201-32c6-4c58-8bac-4d1b05ddfbb4\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 15:58:04 crc kubenswrapper[5120]: I0316 15:58:04.991661 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ca4a5201-32c6-4c58-8bac-4d1b05ddfbb4-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"ca4a5201-32c6-4c58-8bac-4d1b05ddfbb4\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 15:58:04 crc kubenswrapper[5120]: I0316 15:58:04.991694 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xtcb2\" (UniqueName: \"kubernetes.io/projected/ca4a5201-32c6-4c58-8bac-4d1b05ddfbb4-kube-api-access-xtcb2\") pod \"nova-scheduler-0\" (UID: \"ca4a5201-32c6-4c58-8bac-4d1b05ddfbb4\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 15:58:04 crc kubenswrapper[5120]: I0316 15:58:04.996293 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ca4a5201-32c6-4c58-8bac-4d1b05ddfbb4-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"ca4a5201-32c6-4c58-8bac-4d1b05ddfbb4\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 15:58:04 crc kubenswrapper[5120]: I0316 15:58:04.997905 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/nova-metadata-0" podUID="318b5444-18f6-45b3-aaac-62f4457fb01a" containerName="nova-metadata-log" probeResult="failure" output="Get \"https://10.217.1.50:8775/\": read tcp 10.217.0.2:34516->10.217.1.50:8775: read: connection reset by peer" Mar 16 15:58:04 crc kubenswrapper[5120]: I0316 15:58:04.998226 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/nova-metadata-0" podUID="318b5444-18f6-45b3-aaac-62f4457fb01a" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"https://10.217.1.50:8775/\": read tcp 10.217.0.2:34526->10.217.1.50:8775: read: connection reset by peer" Mar 16 15:58:04 crc kubenswrapper[5120]: I0316 15:58:04.999282 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ca4a5201-32c6-4c58-8bac-4d1b05ddfbb4-config-data\") pod \"nova-scheduler-0\" (UID: \"ca4a5201-32c6-4c58-8bac-4d1b05ddfbb4\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 15:58:05 crc kubenswrapper[5120]: I0316 15:58:05.012745 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtcb2\" (UniqueName: \"kubernetes.io/projected/ca4a5201-32c6-4c58-8bac-4d1b05ddfbb4-kube-api-access-xtcb2\") pod \"nova-scheduler-0\" (UID: \"ca4a5201-32c6-4c58-8bac-4d1b05ddfbb4\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 15:58:05 crc kubenswrapper[5120]: I0316 15:58:05.058934 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 15:58:05 crc kubenswrapper[5120]: I0316 15:58:05.160462 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561278-nt8th" Mar 16 15:58:05 crc kubenswrapper[5120]: I0316 15:58:05.223607 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9b9rd\" (UniqueName: \"kubernetes.io/projected/b5ebd69d-6eae-46e3-8567-f43a281355ef-kube-api-access-9b9rd\") pod \"b5ebd69d-6eae-46e3-8567-f43a281355ef\" (UID: \"b5ebd69d-6eae-46e3-8567-f43a281355ef\") " Mar 16 15:58:05 crc kubenswrapper[5120]: I0316 15:58:05.230126 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b5ebd69d-6eae-46e3-8567-f43a281355ef-kube-api-access-9b9rd" (OuterVolumeSpecName: "kube-api-access-9b9rd") pod "b5ebd69d-6eae-46e3-8567-f43a281355ef" (UID: "b5ebd69d-6eae-46e3-8567-f43a281355ef"). InnerVolumeSpecName "kube-api-access-9b9rd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:58:05 crc kubenswrapper[5120]: I0316 15:58:05.329472 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9b9rd\" (UniqueName: \"kubernetes.io/projected/b5ebd69d-6eae-46e3-8567-f43a281355ef-kube-api-access-9b9rd\") on node \"crc\" DevicePath \"\"" Mar 16 15:58:05 crc kubenswrapper[5120]: I0316 15:58:05.566496 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:58:05 crc kubenswrapper[5120]: I0316 15:58:05.639363 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/318b5444-18f6-45b3-aaac-62f4457fb01a-config-data\") pod \"318b5444-18f6-45b3-aaac-62f4457fb01a\" (UID: \"318b5444-18f6-45b3-aaac-62f4457fb01a\") " Mar 16 15:58:05 crc kubenswrapper[5120]: I0316 15:58:05.639529 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/318b5444-18f6-45b3-aaac-62f4457fb01a-logs\") pod \"318b5444-18f6-45b3-aaac-62f4457fb01a\" (UID: \"318b5444-18f6-45b3-aaac-62f4457fb01a\") " Mar 16 15:58:05 crc kubenswrapper[5120]: I0316 15:58:05.639887 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/318b5444-18f6-45b3-aaac-62f4457fb01a-combined-ca-bundle\") pod \"318b5444-18f6-45b3-aaac-62f4457fb01a\" (UID: \"318b5444-18f6-45b3-aaac-62f4457fb01a\") " Mar 16 15:58:05 crc kubenswrapper[5120]: I0316 15:58:05.640245 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/318b5444-18f6-45b3-aaac-62f4457fb01a-nova-metadata-tls-certs\") pod \"318b5444-18f6-45b3-aaac-62f4457fb01a\" (UID: \"318b5444-18f6-45b3-aaac-62f4457fb01a\") " Mar 16 15:58:05 crc kubenswrapper[5120]: I0316 15:58:05.640304 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dw65j\" (UniqueName: \"kubernetes.io/projected/318b5444-18f6-45b3-aaac-62f4457fb01a-kube-api-access-dw65j\") pod \"318b5444-18f6-45b3-aaac-62f4457fb01a\" (UID: \"318b5444-18f6-45b3-aaac-62f4457fb01a\") " Mar 16 15:58:05 crc kubenswrapper[5120]: I0316 15:58:05.640613 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/318b5444-18f6-45b3-aaac-62f4457fb01a-logs" (OuterVolumeSpecName: "logs") pod "318b5444-18f6-45b3-aaac-62f4457fb01a" (UID: "318b5444-18f6-45b3-aaac-62f4457fb01a"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:58:05 crc kubenswrapper[5120]: I0316 15:58:05.641078 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/318b5444-18f6-45b3-aaac-62f4457fb01a-logs\") on node \"crc\" DevicePath \"\"" Mar 16 15:58:05 crc kubenswrapper[5120]: I0316 15:58:05.655960 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/318b5444-18f6-45b3-aaac-62f4457fb01a-kube-api-access-dw65j" (OuterVolumeSpecName: "kube-api-access-dw65j") pod "318b5444-18f6-45b3-aaac-62f4457fb01a" (UID: "318b5444-18f6-45b3-aaac-62f4457fb01a"). InnerVolumeSpecName "kube-api-access-dw65j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:58:05 crc kubenswrapper[5120]: I0316 15:58:05.675777 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-infra/auto-csr-approver-29561272-5tsq4"] Mar 16 15:58:05 crc kubenswrapper[5120]: I0316 15:58:05.679539 5120 generic.go:358] "Generic (PLEG): container finished" podID="318b5444-18f6-45b3-aaac-62f4457fb01a" containerID="ca200cb8534e05fd2b4b737bd3676b45f55b106a873123835d29436742ed23e4" exitCode=0 Mar 16 15:58:05 crc kubenswrapper[5120]: I0316 15:58:05.679655 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"318b5444-18f6-45b3-aaac-62f4457fb01a","Type":"ContainerDied","Data":"ca200cb8534e05fd2b4b737bd3676b45f55b106a873123835d29436742ed23e4"} Mar 16 15:58:05 crc kubenswrapper[5120]: I0316 15:58:05.679686 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"318b5444-18f6-45b3-aaac-62f4457fb01a","Type":"ContainerDied","Data":"bfd127560fa900d8e896a8c8b3d5463781f2b507b30da9bd4930c719c3eaff29"} Mar 16 15:58:05 crc kubenswrapper[5120]: I0316 15:58:05.679703 5120 scope.go:117] "RemoveContainer" containerID="ca200cb8534e05fd2b4b737bd3676b45f55b106a873123835d29436742ed23e4" Mar 16 15:58:05 crc kubenswrapper[5120]: I0316 15:58:05.679834 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:58:05 crc kubenswrapper[5120]: I0316 15:58:05.683907 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-infra/auto-csr-approver-29561272-5tsq4"] Mar 16 15:58:05 crc kubenswrapper[5120]: I0316 15:58:05.693852 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561278-nt8th" event={"ID":"b5ebd69d-6eae-46e3-8567-f43a281355ef","Type":"ContainerDied","Data":"069d8efed04c2e47a6455fe20b2ceeea58e9d3e222d0df69ae8050821a227043"} Mar 16 15:58:05 crc kubenswrapper[5120]: I0316 15:58:05.693904 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="069d8efed04c2e47a6455fe20b2ceeea58e9d3e222d0df69ae8050821a227043" Mar 16 15:58:05 crc kubenswrapper[5120]: I0316 15:58:05.693992 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561278-nt8th" Mar 16 15:58:05 crc kubenswrapper[5120]: I0316 15:58:05.701076 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/318b5444-18f6-45b3-aaac-62f4457fb01a-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "318b5444-18f6-45b3-aaac-62f4457fb01a" (UID: "318b5444-18f6-45b3-aaac-62f4457fb01a"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:58:05 crc kubenswrapper[5120]: I0316 15:58:05.704496 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 15:58:05 crc kubenswrapper[5120]: I0316 15:58:05.714066 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ae1d03a6-018f-4911-94d8-1a45cd691544","Type":"ContainerStarted","Data":"186998e0f84b2bde1ab1330c5a0f6173446b0fdbcd1cfe73294977d852c52f0c"} Mar 16 15:58:05 crc kubenswrapper[5120]: I0316 15:58:05.718007 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/318b5444-18f6-45b3-aaac-62f4457fb01a-config-data" (OuterVolumeSpecName: "config-data") pod "318b5444-18f6-45b3-aaac-62f4457fb01a" (UID: "318b5444-18f6-45b3-aaac-62f4457fb01a"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:58:05 crc kubenswrapper[5120]: I0316 15:58:05.742801 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dw65j\" (UniqueName: \"kubernetes.io/projected/318b5444-18f6-45b3-aaac-62f4457fb01a-kube-api-access-dw65j\") on node \"crc\" DevicePath \"\"" Mar 16 15:58:05 crc kubenswrapper[5120]: I0316 15:58:05.742822 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/318b5444-18f6-45b3-aaac-62f4457fb01a-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 15:58:05 crc kubenswrapper[5120]: I0316 15:58:05.742833 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/318b5444-18f6-45b3-aaac-62f4457fb01a-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:58:05 crc kubenswrapper[5120]: I0316 15:58:05.757718 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/318b5444-18f6-45b3-aaac-62f4457fb01a-nova-metadata-tls-certs" (OuterVolumeSpecName: "nova-metadata-tls-certs") pod "318b5444-18f6-45b3-aaac-62f4457fb01a" (UID: "318b5444-18f6-45b3-aaac-62f4457fb01a"). InnerVolumeSpecName "nova-metadata-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:58:05 crc kubenswrapper[5120]: I0316 15:58:05.794349 5120 scope.go:117] "RemoveContainer" containerID="72edd44371c0419d4238b34e3f9e8b5b8ad817b547b0c633aea80a46c2dcc422" Mar 16 15:58:05 crc kubenswrapper[5120]: I0316 15:58:05.823292 5120 scope.go:117] "RemoveContainer" containerID="ca200cb8534e05fd2b4b737bd3676b45f55b106a873123835d29436742ed23e4" Mar 16 15:58:05 crc kubenswrapper[5120]: E0316 15:58:05.823832 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca200cb8534e05fd2b4b737bd3676b45f55b106a873123835d29436742ed23e4\": container with ID starting with ca200cb8534e05fd2b4b737bd3676b45f55b106a873123835d29436742ed23e4 not found: ID does not exist" containerID="ca200cb8534e05fd2b4b737bd3676b45f55b106a873123835d29436742ed23e4" Mar 16 15:58:05 crc kubenswrapper[5120]: I0316 15:58:05.823881 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca200cb8534e05fd2b4b737bd3676b45f55b106a873123835d29436742ed23e4"} err="failed to get container status \"ca200cb8534e05fd2b4b737bd3676b45f55b106a873123835d29436742ed23e4\": rpc error: code = NotFound desc = could not find container \"ca200cb8534e05fd2b4b737bd3676b45f55b106a873123835d29436742ed23e4\": container with ID starting with ca200cb8534e05fd2b4b737bd3676b45f55b106a873123835d29436742ed23e4 not found: ID does not exist" Mar 16 15:58:05 crc kubenswrapper[5120]: I0316 15:58:05.823908 5120 scope.go:117] "RemoveContainer" containerID="72edd44371c0419d4238b34e3f9e8b5b8ad817b547b0c633aea80a46c2dcc422" Mar 16 15:58:05 crc kubenswrapper[5120]: E0316 15:58:05.825626 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"72edd44371c0419d4238b34e3f9e8b5b8ad817b547b0c633aea80a46c2dcc422\": container with ID starting with 72edd44371c0419d4238b34e3f9e8b5b8ad817b547b0c633aea80a46c2dcc422 not found: ID does not exist" containerID="72edd44371c0419d4238b34e3f9e8b5b8ad817b547b0c633aea80a46c2dcc422" Mar 16 15:58:05 crc kubenswrapper[5120]: I0316 15:58:05.825687 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"72edd44371c0419d4238b34e3f9e8b5b8ad817b547b0c633aea80a46c2dcc422"} err="failed to get container status \"72edd44371c0419d4238b34e3f9e8b5b8ad817b547b0c633aea80a46c2dcc422\": rpc error: code = NotFound desc = could not find container \"72edd44371c0419d4238b34e3f9e8b5b8ad817b547b0c633aea80a46c2dcc422\": container with ID starting with 72edd44371c0419d4238b34e3f9e8b5b8ad817b547b0c633aea80a46c2dcc422 not found: ID does not exist" Mar 16 15:58:05 crc kubenswrapper[5120]: I0316 15:58:05.845340 5120 reconciler_common.go:299] "Volume detached for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/318b5444-18f6-45b3-aaac-62f4457fb01a-nova-metadata-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 15:58:06 crc kubenswrapper[5120]: I0316 15:58:06.019829 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 15:58:06 crc kubenswrapper[5120]: I0316 15:58:06.030486 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 15:58:06 crc kubenswrapper[5120]: I0316 15:58:06.039445 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 15:58:06 crc kubenswrapper[5120]: I0316 15:58:06.040652 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5ebd69d-6eae-46e3-8567-f43a281355ef" containerName="oc" Mar 16 15:58:06 crc kubenswrapper[5120]: I0316 15:58:06.040734 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5ebd69d-6eae-46e3-8567-f43a281355ef" containerName="oc" Mar 16 15:58:06 crc kubenswrapper[5120]: I0316 15:58:06.040846 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="318b5444-18f6-45b3-aaac-62f4457fb01a" containerName="nova-metadata-log" Mar 16 15:58:06 crc kubenswrapper[5120]: I0316 15:58:06.040911 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="318b5444-18f6-45b3-aaac-62f4457fb01a" containerName="nova-metadata-log" Mar 16 15:58:06 crc kubenswrapper[5120]: I0316 15:58:06.040993 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="318b5444-18f6-45b3-aaac-62f4457fb01a" containerName="nova-metadata-metadata" Mar 16 15:58:06 crc kubenswrapper[5120]: I0316 15:58:06.041045 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="318b5444-18f6-45b3-aaac-62f4457fb01a" containerName="nova-metadata-metadata" Mar 16 15:58:06 crc kubenswrapper[5120]: I0316 15:58:06.041272 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="b5ebd69d-6eae-46e3-8567-f43a281355ef" containerName="oc" Mar 16 15:58:06 crc kubenswrapper[5120]: I0316 15:58:06.041346 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="318b5444-18f6-45b3-aaac-62f4457fb01a" containerName="nova-metadata-metadata" Mar 16 15:58:06 crc kubenswrapper[5120]: I0316 15:58:06.041407 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="318b5444-18f6-45b3-aaac-62f4457fb01a" containerName="nova-metadata-log" Mar 16 15:58:06 crc kubenswrapper[5120]: I0316 15:58:06.046120 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:58:06 crc kubenswrapper[5120]: I0316 15:58:06.052260 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-metadata-internal-svc\"" Mar 16 15:58:06 crc kubenswrapper[5120]: I0316 15:58:06.052500 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 15:58:06 crc kubenswrapper[5120]: I0316 15:58:06.054226 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-metadata-config-data\"" Mar 16 15:58:06 crc kubenswrapper[5120]: I0316 15:58:06.150785 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c568edd3-501f-4254-ae95-67946f898cd3-logs\") pod \"nova-metadata-0\" (UID: \"c568edd3-501f-4254-ae95-67946f898cd3\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:58:06 crc kubenswrapper[5120]: I0316 15:58:06.151013 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c568edd3-501f-4254-ae95-67946f898cd3-config-data\") pod \"nova-metadata-0\" (UID: \"c568edd3-501f-4254-ae95-67946f898cd3\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:58:06 crc kubenswrapper[5120]: I0316 15:58:06.151148 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c568edd3-501f-4254-ae95-67946f898cd3-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"c568edd3-501f-4254-ae95-67946f898cd3\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:58:06 crc kubenswrapper[5120]: I0316 15:58:06.151245 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8b2r\" (UniqueName: \"kubernetes.io/projected/c568edd3-501f-4254-ae95-67946f898cd3-kube-api-access-v8b2r\") pod \"nova-metadata-0\" (UID: \"c568edd3-501f-4254-ae95-67946f898cd3\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:58:06 crc kubenswrapper[5120]: I0316 15:58:06.151355 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/c568edd3-501f-4254-ae95-67946f898cd3-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"c568edd3-501f-4254-ae95-67946f898cd3\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:58:06 crc kubenswrapper[5120]: I0316 15:58:06.252592 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c568edd3-501f-4254-ae95-67946f898cd3-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"c568edd3-501f-4254-ae95-67946f898cd3\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:58:06 crc kubenswrapper[5120]: I0316 15:58:06.252653 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v8b2r\" (UniqueName: \"kubernetes.io/projected/c568edd3-501f-4254-ae95-67946f898cd3-kube-api-access-v8b2r\") pod \"nova-metadata-0\" (UID: \"c568edd3-501f-4254-ae95-67946f898cd3\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:58:06 crc kubenswrapper[5120]: I0316 15:58:06.252694 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/c568edd3-501f-4254-ae95-67946f898cd3-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"c568edd3-501f-4254-ae95-67946f898cd3\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:58:06 crc kubenswrapper[5120]: I0316 15:58:06.252780 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c568edd3-501f-4254-ae95-67946f898cd3-logs\") pod \"nova-metadata-0\" (UID: \"c568edd3-501f-4254-ae95-67946f898cd3\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:58:06 crc kubenswrapper[5120]: I0316 15:58:06.252900 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c568edd3-501f-4254-ae95-67946f898cd3-config-data\") pod \"nova-metadata-0\" (UID: \"c568edd3-501f-4254-ae95-67946f898cd3\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:58:06 crc kubenswrapper[5120]: I0316 15:58:06.253613 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c568edd3-501f-4254-ae95-67946f898cd3-logs\") pod \"nova-metadata-0\" (UID: \"c568edd3-501f-4254-ae95-67946f898cd3\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:58:06 crc kubenswrapper[5120]: I0316 15:58:06.258189 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/c568edd3-501f-4254-ae95-67946f898cd3-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"c568edd3-501f-4254-ae95-67946f898cd3\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:58:06 crc kubenswrapper[5120]: I0316 15:58:06.261511 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c568edd3-501f-4254-ae95-67946f898cd3-config-data\") pod \"nova-metadata-0\" (UID: \"c568edd3-501f-4254-ae95-67946f898cd3\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:58:06 crc kubenswrapper[5120]: I0316 15:58:06.261532 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c568edd3-501f-4254-ae95-67946f898cd3-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"c568edd3-501f-4254-ae95-67946f898cd3\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:58:06 crc kubenswrapper[5120]: I0316 15:58:06.277063 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8b2r\" (UniqueName: \"kubernetes.io/projected/c568edd3-501f-4254-ae95-67946f898cd3-kube-api-access-v8b2r\") pod \"nova-metadata-0\" (UID: \"c568edd3-501f-4254-ae95-67946f898cd3\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:58:06 crc kubenswrapper[5120]: I0316 15:58:06.365640 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:58:06 crc kubenswrapper[5120]: I0316 15:58:06.677245 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0edbd946-b6a5-446e-a5b7-c950d16a98f1" path="/var/lib/kubelet/pods/0edbd946-b6a5-446e-a5b7-c950d16a98f1/volumes" Mar 16 15:58:06 crc kubenswrapper[5120]: I0316 15:58:06.680476 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2093a744-47aa-4623-99ce-d001469addae" path="/var/lib/kubelet/pods/2093a744-47aa-4623-99ce-d001469addae/volumes" Mar 16 15:58:06 crc kubenswrapper[5120]: I0316 15:58:06.681843 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="318b5444-18f6-45b3-aaac-62f4457fb01a" path="/var/lib/kubelet/pods/318b5444-18f6-45b3-aaac-62f4457fb01a/volumes" Mar 16 15:58:06 crc kubenswrapper[5120]: I0316 15:58:06.725907 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"ca4a5201-32c6-4c58-8bac-4d1b05ddfbb4","Type":"ContainerStarted","Data":"b2dd99f48a5e6c36c5d9b0bed8c62972ff65efc2c08b8a4c56e6c1ee763db013"} Mar 16 15:58:06 crc kubenswrapper[5120]: I0316 15:58:06.726229 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"ca4a5201-32c6-4c58-8bac-4d1b05ddfbb4","Type":"ContainerStarted","Data":"a752498f9edc1155132c7f5522ea40fd434573db5462da576058333ff324365d"} Mar 16 15:58:06 crc kubenswrapper[5120]: I0316 15:58:06.753318 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-scheduler-0" podStartSLOduration=2.7532938810000003 podStartE2EDuration="2.753293881s" podCreationTimestamp="2026-03-16 15:58:04 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:58:06.746249926 +0000 UTC m=+1588.900181633" watchObservedRunningTime="2026-03-16 15:58:06.753293881 +0000 UTC m=+1588.907225578" Mar 16 15:58:06 crc kubenswrapper[5120]: I0316 15:58:06.840532 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 15:58:06 crc kubenswrapper[5120]: W0316 15:58:06.845906 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc568edd3_501f_4254_ae95_67946f898cd3.slice/crio-e4e79fd4849bbaec6fd91a4e2b78435f26830ee4bf7bd50d02e2c63e3c9ab5e9 WatchSource:0}: Error finding container e4e79fd4849bbaec6fd91a4e2b78435f26830ee4bf7bd50d02e2c63e3c9ab5e9: Status 404 returned error can't find the container with id e4e79fd4849bbaec6fd91a4e2b78435f26830ee4bf7bd50d02e2c63e3c9ab5e9 Mar 16 15:58:07 crc kubenswrapper[5120]: I0316 15:58:07.744208 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"c568edd3-501f-4254-ae95-67946f898cd3","Type":"ContainerStarted","Data":"43900ca08144bf1b772b28160272d2ed488bb604fc3fbc4d53917a0d50806010"} Mar 16 15:58:07 crc kubenswrapper[5120]: I0316 15:58:07.744607 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"c568edd3-501f-4254-ae95-67946f898cd3","Type":"ContainerStarted","Data":"2b22006c50d5da36968915545fc025f97fb4e75c310ad215b4ef102ae8c5bf5c"} Mar 16 15:58:07 crc kubenswrapper[5120]: I0316 15:58:07.744626 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"c568edd3-501f-4254-ae95-67946f898cd3","Type":"ContainerStarted","Data":"e4e79fd4849bbaec6fd91a4e2b78435f26830ee4bf7bd50d02e2c63e3c9ab5e9"} Mar 16 15:58:07 crc kubenswrapper[5120]: I0316 15:58:07.750018 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ae1d03a6-018f-4911-94d8-1a45cd691544","Type":"ContainerStarted","Data":"b2a218f7c85eb417a626c7aae6f48c60f36d5eef731d7631c190206a87f8de72"} Mar 16 15:58:07 crc kubenswrapper[5120]: I0316 15:58:07.776119 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=1.776076199 podStartE2EDuration="1.776076199s" podCreationTimestamp="2026-03-16 15:58:06 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:58:07.772945682 +0000 UTC m=+1589.926877349" watchObservedRunningTime="2026-03-16 15:58:07.776076199 +0000 UTC m=+1589.930007896" Mar 16 15:58:07 crc kubenswrapper[5120]: E0316 15:58:07.936699 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1760746 actualBytes=10240 Mar 16 15:58:09 crc kubenswrapper[5120]: I0316 15:58:09.777510 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ae1d03a6-018f-4911-94d8-1a45cd691544","Type":"ContainerStarted","Data":"501daadd5356621d4fa4ffe134b38c634ce1c4c91f1995627a101eb7a00fbdbc"} Mar 16 15:58:09 crc kubenswrapper[5120]: I0316 15:58:09.780369 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:58:09 crc kubenswrapper[5120]: I0316 15:58:09.818868 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.579610145 podStartE2EDuration="7.818838448s" podCreationTimestamp="2026-03-16 15:58:02 +0000 UTC" firstStartedPulling="2026-03-16 15:58:03.522226518 +0000 UTC m=+1585.676158175" lastFinishedPulling="2026-03-16 15:58:08.761454821 +0000 UTC m=+1590.915386478" observedRunningTime="2026-03-16 15:58:09.807846235 +0000 UTC m=+1591.961777932" watchObservedRunningTime="2026-03-16 15:58:09.818838448 +0000 UTC m=+1591.972770135" Mar 16 15:58:10 crc kubenswrapper[5120]: I0316 15:58:10.060457 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 15:58:12 crc kubenswrapper[5120]: I0316 15:58:12.665084 5120 scope.go:117] "RemoveContainer" containerID="02ba4fc3f84eccaecfa9e6618280f65626eb76580c4af9ae7a9d7cb3b8dd590b" Mar 16 15:58:12 crc kubenswrapper[5120]: E0316 15:58:12.666063 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 15:58:13 crc kubenswrapper[5120]: I0316 15:58:13.313319 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:58:13 crc kubenswrapper[5120]: I0316 15:58:13.315388 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:58:14 crc kubenswrapper[5120]: I0316 15:58:14.321875 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="188dbfe0-6d71-4ba4-a3b7-6ee900a60138" containerName="nova-api-api" probeResult="failure" output="Get \"https://10.217.1.59:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 15:58:14 crc kubenswrapper[5120]: I0316 15:58:14.321964 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="188dbfe0-6d71-4ba4-a3b7-6ee900a60138" containerName="nova-api-log" probeResult="failure" output="Get \"https://10.217.1.59:8774/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Mar 16 15:58:15 crc kubenswrapper[5120]: I0316 15:58:15.060122 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 15:58:15 crc kubenswrapper[5120]: I0316 15:58:15.103328 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 15:58:15 crc kubenswrapper[5120]: I0316 15:58:15.907642 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 15:58:16 crc kubenswrapper[5120]: I0316 15:58:16.366526 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:58:16 crc kubenswrapper[5120]: I0316 15:58:16.366925 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:58:17 crc kubenswrapper[5120]: I0316 15:58:17.372935 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="c568edd3-501f-4254-ae95-67946f898cd3" containerName="nova-metadata-log" probeResult="failure" output="Get \"https://10.217.1.61:8775/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 15:58:17 crc kubenswrapper[5120]: I0316 15:58:17.372950 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="c568edd3-501f-4254-ae95-67946f898cd3" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"https://10.217.1.61:8775/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Mar 16 15:58:21 crc kubenswrapper[5120]: I0316 15:58:21.313604 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:58:21 crc kubenswrapper[5120]: I0316 15:58:21.314172 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:58:23 crc kubenswrapper[5120]: I0316 15:58:23.321117 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:58:23 crc kubenswrapper[5120]: I0316 15:58:23.327082 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:58:23 crc kubenswrapper[5120]: I0316 15:58:23.329195 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:58:23 crc kubenswrapper[5120]: I0316 15:58:23.949520 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 15:58:24 crc kubenswrapper[5120]: I0316 15:58:24.365906 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:58:24 crc kubenswrapper[5120]: I0316 15:58:24.366290 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:58:24 crc kubenswrapper[5120]: I0316 15:58:24.663558 5120 scope.go:117] "RemoveContainer" containerID="02ba4fc3f84eccaecfa9e6618280f65626eb76580c4af9ae7a9d7cb3b8dd590b" Mar 16 15:58:24 crc kubenswrapper[5120]: E0316 15:58:24.664065 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 15:58:26 crc kubenswrapper[5120]: I0316 15:58:26.373660 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:58:26 crc kubenswrapper[5120]: I0316 15:58:26.374070 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:58:26 crc kubenswrapper[5120]: I0316 15:58:26.378187 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:58:26 crc kubenswrapper[5120]: I0316 15:58:26.379914 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 15:58:38 crc kubenswrapper[5120]: I0316 15:58:38.705162 5120 scope.go:117] "RemoveContainer" containerID="02ba4fc3f84eccaecfa9e6618280f65626eb76580c4af9ae7a9d7cb3b8dd590b" Mar 16 15:58:38 crc kubenswrapper[5120]: E0316 15:58:38.706303 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 15:58:41 crc kubenswrapper[5120]: I0316 15:58:41.816600 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:58:46 crc kubenswrapper[5120]: I0316 15:58:46.417243 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 15:58:46 crc kubenswrapper[5120]: I0316 15:58:46.418031 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/kube-state-metrics-0" podUID="c434fd9b-977d-4e56-aa01-fb93cb76350d" containerName="kube-state-metrics" containerID="cri-o://111343d1b0cb1a9cb30e9213fa1ab9b99217b90f42c2e7cfa1cba940d9218185" gracePeriod=30 Mar 16 15:58:46 crc kubenswrapper[5120]: I0316 15:58:46.911865 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 15:58:46 crc kubenswrapper[5120]: I0316 15:58:46.998853 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bcdfr\" (UniqueName: \"kubernetes.io/projected/c434fd9b-977d-4e56-aa01-fb93cb76350d-kube-api-access-bcdfr\") pod \"c434fd9b-977d-4e56-aa01-fb93cb76350d\" (UID: \"c434fd9b-977d-4e56-aa01-fb93cb76350d\") " Mar 16 15:58:47 crc kubenswrapper[5120]: I0316 15:58:47.006989 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c434fd9b-977d-4e56-aa01-fb93cb76350d-kube-api-access-bcdfr" (OuterVolumeSpecName: "kube-api-access-bcdfr") pod "c434fd9b-977d-4e56-aa01-fb93cb76350d" (UID: "c434fd9b-977d-4e56-aa01-fb93cb76350d"). InnerVolumeSpecName "kube-api-access-bcdfr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:58:47 crc kubenswrapper[5120]: I0316 15:58:47.100603 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bcdfr\" (UniqueName: \"kubernetes.io/projected/c434fd9b-977d-4e56-aa01-fb93cb76350d-kube-api-access-bcdfr\") on node \"crc\" DevicePath \"\"" Mar 16 15:58:47 crc kubenswrapper[5120]: I0316 15:58:47.193359 5120 scope.go:117] "RemoveContainer" containerID="bab718c240e7715476594adb89e1d45b92b2cfad75e656245dc41aa5d292445a" Mar 16 15:58:47 crc kubenswrapper[5120]: I0316 15:58:47.215100 5120 generic.go:358] "Generic (PLEG): container finished" podID="c434fd9b-977d-4e56-aa01-fb93cb76350d" containerID="111343d1b0cb1a9cb30e9213fa1ab9b99217b90f42c2e7cfa1cba940d9218185" exitCode=2 Mar 16 15:58:47 crc kubenswrapper[5120]: I0316 15:58:47.215182 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 15:58:47 crc kubenswrapper[5120]: I0316 15:58:47.215208 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"c434fd9b-977d-4e56-aa01-fb93cb76350d","Type":"ContainerDied","Data":"111343d1b0cb1a9cb30e9213fa1ab9b99217b90f42c2e7cfa1cba940d9218185"} Mar 16 15:58:47 crc kubenswrapper[5120]: I0316 15:58:47.215541 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"c434fd9b-977d-4e56-aa01-fb93cb76350d","Type":"ContainerDied","Data":"4ae3912155cf98d9b66616544c4a611d63a9d1abc6a9361c09b98d51af5b209d"} Mar 16 15:58:47 crc kubenswrapper[5120]: I0316 15:58:47.215573 5120 scope.go:117] "RemoveContainer" containerID="111343d1b0cb1a9cb30e9213fa1ab9b99217b90f42c2e7cfa1cba940d9218185" Mar 16 15:58:47 crc kubenswrapper[5120]: I0316 15:58:47.216603 5120 scope.go:117] "RemoveContainer" containerID="a7d7ec2d67d82148a0d8f8352dba2a699544562849a7cc864810594c5756d53f" Mar 16 15:58:47 crc kubenswrapper[5120]: I0316 15:58:47.286701 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 15:58:47 crc kubenswrapper[5120]: I0316 15:58:47.303475 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 15:58:47 crc kubenswrapper[5120]: I0316 15:58:47.305666 5120 scope.go:117] "RemoveContainer" containerID="111343d1b0cb1a9cb30e9213fa1ab9b99217b90f42c2e7cfa1cba940d9218185" Mar 16 15:58:47 crc kubenswrapper[5120]: E0316 15:58:47.306429 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"111343d1b0cb1a9cb30e9213fa1ab9b99217b90f42c2e7cfa1cba940d9218185\": container with ID starting with 111343d1b0cb1a9cb30e9213fa1ab9b99217b90f42c2e7cfa1cba940d9218185 not found: ID does not exist" containerID="111343d1b0cb1a9cb30e9213fa1ab9b99217b90f42c2e7cfa1cba940d9218185" Mar 16 15:58:47 crc kubenswrapper[5120]: I0316 15:58:47.306489 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"111343d1b0cb1a9cb30e9213fa1ab9b99217b90f42c2e7cfa1cba940d9218185"} err="failed to get container status \"111343d1b0cb1a9cb30e9213fa1ab9b99217b90f42c2e7cfa1cba940d9218185\": rpc error: code = NotFound desc = could not find container \"111343d1b0cb1a9cb30e9213fa1ab9b99217b90f42c2e7cfa1cba940d9218185\": container with ID starting with 111343d1b0cb1a9cb30e9213fa1ab9b99217b90f42c2e7cfa1cba940d9218185 not found: ID does not exist" Mar 16 15:58:47 crc kubenswrapper[5120]: I0316 15:58:47.316728 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 15:58:47 crc kubenswrapper[5120]: I0316 15:58:47.318331 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c434fd9b-977d-4e56-aa01-fb93cb76350d" containerName="kube-state-metrics" Mar 16 15:58:47 crc kubenswrapper[5120]: I0316 15:58:47.318365 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c434fd9b-977d-4e56-aa01-fb93cb76350d" containerName="kube-state-metrics" Mar 16 15:58:47 crc kubenswrapper[5120]: I0316 15:58:47.318640 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c434fd9b-977d-4e56-aa01-fb93cb76350d" containerName="kube-state-metrics" Mar 16 15:58:47 crc kubenswrapper[5120]: I0316 15:58:47.326395 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 15:58:47 crc kubenswrapper[5120]: I0316 15:58:47.329637 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 15:58:47 crc kubenswrapper[5120]: I0316 15:58:47.329751 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"kube-state-metrics-tls-config\"" Mar 16 15:58:47 crc kubenswrapper[5120]: I0316 15:58:47.330242 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-kube-state-metrics-svc\"" Mar 16 15:58:47 crc kubenswrapper[5120]: I0316 15:58:47.350343 5120 scope.go:117] "RemoveContainer" containerID="a313a731c525dd1b19787a5de658b12624c60551806cbd1c01092344522ec68c" Mar 16 15:58:47 crc kubenswrapper[5120]: I0316 15:58:47.380183 5120 scope.go:117] "RemoveContainer" containerID="a1d84bb66f3463d56e26ed236913fe737e4f332a24a81b6c283709269fff0c26" Mar 16 15:58:47 crc kubenswrapper[5120]: I0316 15:58:47.405634 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gthb\" (UniqueName: \"kubernetes.io/projected/08f284b7-104e-4395-b9cc-7c8acf4b943e-kube-api-access-7gthb\") pod \"kube-state-metrics-0\" (UID: \"08f284b7-104e-4395-b9cc-7c8acf4b943e\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 15:58:47 crc kubenswrapper[5120]: I0316 15:58:47.405726 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/08f284b7-104e-4395-b9cc-7c8acf4b943e-kube-state-metrics-tls-certs\") pod \"kube-state-metrics-0\" (UID: \"08f284b7-104e-4395-b9cc-7c8acf4b943e\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 15:58:47 crc kubenswrapper[5120]: I0316 15:58:47.405860 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/08f284b7-104e-4395-b9cc-7c8acf4b943e-combined-ca-bundle\") pod \"kube-state-metrics-0\" (UID: \"08f284b7-104e-4395-b9cc-7c8acf4b943e\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 15:58:47 crc kubenswrapper[5120]: I0316 15:58:47.405998 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/08f284b7-104e-4395-b9cc-7c8acf4b943e-kube-state-metrics-tls-config\") pod \"kube-state-metrics-0\" (UID: \"08f284b7-104e-4395-b9cc-7c8acf4b943e\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 15:58:47 crc kubenswrapper[5120]: I0316 15:58:47.409224 5120 scope.go:117] "RemoveContainer" containerID="186b4e2033d4312c54f215dec67a20d5d2834f98c87348e63660f4a704ef1870" Mar 16 15:58:47 crc kubenswrapper[5120]: I0316 15:58:47.458237 5120 scope.go:117] "RemoveContainer" containerID="07f6b36802e0bbde1b411f71d5223ef63177629d26145e6e761fc31f378099a3" Mar 16 15:58:47 crc kubenswrapper[5120]: I0316 15:58:47.508367 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/08f284b7-104e-4395-b9cc-7c8acf4b943e-kube-state-metrics-tls-config\") pod \"kube-state-metrics-0\" (UID: \"08f284b7-104e-4395-b9cc-7c8acf4b943e\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 15:58:47 crc kubenswrapper[5120]: I0316 15:58:47.508554 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7gthb\" (UniqueName: \"kubernetes.io/projected/08f284b7-104e-4395-b9cc-7c8acf4b943e-kube-api-access-7gthb\") pod \"kube-state-metrics-0\" (UID: \"08f284b7-104e-4395-b9cc-7c8acf4b943e\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 15:58:47 crc kubenswrapper[5120]: I0316 15:58:47.508594 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/08f284b7-104e-4395-b9cc-7c8acf4b943e-kube-state-metrics-tls-certs\") pod \"kube-state-metrics-0\" (UID: \"08f284b7-104e-4395-b9cc-7c8acf4b943e\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 15:58:47 crc kubenswrapper[5120]: I0316 15:58:47.508628 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/08f284b7-104e-4395-b9cc-7c8acf4b943e-combined-ca-bundle\") pod \"kube-state-metrics-0\" (UID: \"08f284b7-104e-4395-b9cc-7c8acf4b943e\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 15:58:47 crc kubenswrapper[5120]: I0316 15:58:47.513123 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/08f284b7-104e-4395-b9cc-7c8acf4b943e-kube-state-metrics-tls-config\") pod \"kube-state-metrics-0\" (UID: \"08f284b7-104e-4395-b9cc-7c8acf4b943e\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 15:58:47 crc kubenswrapper[5120]: I0316 15:58:47.513519 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/08f284b7-104e-4395-b9cc-7c8acf4b943e-combined-ca-bundle\") pod \"kube-state-metrics-0\" (UID: \"08f284b7-104e-4395-b9cc-7c8acf4b943e\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 15:58:47 crc kubenswrapper[5120]: I0316 15:58:47.514408 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/08f284b7-104e-4395-b9cc-7c8acf4b943e-kube-state-metrics-tls-certs\") pod \"kube-state-metrics-0\" (UID: \"08f284b7-104e-4395-b9cc-7c8acf4b943e\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 15:58:47 crc kubenswrapper[5120]: I0316 15:58:47.515235 5120 scope.go:117] "RemoveContainer" containerID="f7c3a2c821fd28e642a6693a5f7f5e1cf9e1862c120eb79a95cbbc3b9df57f2b" Mar 16 15:58:47 crc kubenswrapper[5120]: I0316 15:58:47.546776 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gthb\" (UniqueName: \"kubernetes.io/projected/08f284b7-104e-4395-b9cc-7c8acf4b943e-kube-api-access-7gthb\") pod \"kube-state-metrics-0\" (UID: \"08f284b7-104e-4395-b9cc-7c8acf4b943e\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 15:58:47 crc kubenswrapper[5120]: I0316 15:58:47.607556 5120 scope.go:117] "RemoveContainer" containerID="5a00c8f45c647963a8510197f0acdd358ed4e08e0b3eefebcc584d2b7161253e" Mar 16 15:58:47 crc kubenswrapper[5120]: I0316 15:58:47.644974 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 15:58:48 crc kubenswrapper[5120]: I0316 15:58:48.131320 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 15:58:48 crc kubenswrapper[5120]: I0316 15:58:48.249558 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"08f284b7-104e-4395-b9cc-7c8acf4b943e","Type":"ContainerStarted","Data":"9facc72c1d24761f4185f0cf5d688d537fb04cccce47e629b7c17dcca961ec41"} Mar 16 15:58:48 crc kubenswrapper[5120]: I0316 15:58:48.253178 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 15:58:48 crc kubenswrapper[5120]: I0316 15:58:48.253691 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="ae1d03a6-018f-4911-94d8-1a45cd691544" containerName="ceilometer-central-agent" containerID="cri-o://8ab831120d54dbad6b23e07ae2fcce12115e98589743c136d9399be45197d676" gracePeriod=30 Mar 16 15:58:48 crc kubenswrapper[5120]: I0316 15:58:48.253736 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="ae1d03a6-018f-4911-94d8-1a45cd691544" containerName="proxy-httpd" containerID="cri-o://501daadd5356621d4fa4ffe134b38c634ce1c4c91f1995627a101eb7a00fbdbc" gracePeriod=30 Mar 16 15:58:48 crc kubenswrapper[5120]: I0316 15:58:48.253837 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="ae1d03a6-018f-4911-94d8-1a45cd691544" containerName="sg-core" containerID="cri-o://b2a218f7c85eb417a626c7aae6f48c60f36d5eef731d7631c190206a87f8de72" gracePeriod=30 Mar 16 15:58:48 crc kubenswrapper[5120]: I0316 15:58:48.253847 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="ae1d03a6-018f-4911-94d8-1a45cd691544" containerName="ceilometer-notification-agent" containerID="cri-o://186998e0f84b2bde1ab1330c5a0f6173446b0fdbcd1cfe73294977d852c52f0c" gracePeriod=30 Mar 16 15:58:48 crc kubenswrapper[5120]: I0316 15:58:48.691155 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c434fd9b-977d-4e56-aa01-fb93cb76350d" path="/var/lib/kubelet/pods/c434fd9b-977d-4e56-aa01-fb93cb76350d/volumes" Mar 16 15:58:49 crc kubenswrapper[5120]: I0316 15:58:49.259774 5120 generic.go:358] "Generic (PLEG): container finished" podID="ae1d03a6-018f-4911-94d8-1a45cd691544" containerID="501daadd5356621d4fa4ffe134b38c634ce1c4c91f1995627a101eb7a00fbdbc" exitCode=0 Mar 16 15:58:49 crc kubenswrapper[5120]: I0316 15:58:49.260074 5120 generic.go:358] "Generic (PLEG): container finished" podID="ae1d03a6-018f-4911-94d8-1a45cd691544" containerID="b2a218f7c85eb417a626c7aae6f48c60f36d5eef731d7631c190206a87f8de72" exitCode=2 Mar 16 15:58:49 crc kubenswrapper[5120]: I0316 15:58:49.260085 5120 generic.go:358] "Generic (PLEG): container finished" podID="ae1d03a6-018f-4911-94d8-1a45cd691544" containerID="8ab831120d54dbad6b23e07ae2fcce12115e98589743c136d9399be45197d676" exitCode=0 Mar 16 15:58:49 crc kubenswrapper[5120]: I0316 15:58:49.259872 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ae1d03a6-018f-4911-94d8-1a45cd691544","Type":"ContainerDied","Data":"501daadd5356621d4fa4ffe134b38c634ce1c4c91f1995627a101eb7a00fbdbc"} Mar 16 15:58:49 crc kubenswrapper[5120]: I0316 15:58:49.260179 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ae1d03a6-018f-4911-94d8-1a45cd691544","Type":"ContainerDied","Data":"b2a218f7c85eb417a626c7aae6f48c60f36d5eef731d7631c190206a87f8de72"} Mar 16 15:58:49 crc kubenswrapper[5120]: I0316 15:58:49.260191 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ae1d03a6-018f-4911-94d8-1a45cd691544","Type":"ContainerDied","Data":"8ab831120d54dbad6b23e07ae2fcce12115e98589743c136d9399be45197d676"} Mar 16 15:58:49 crc kubenswrapper[5120]: I0316 15:58:49.262166 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"08f284b7-104e-4395-b9cc-7c8acf4b943e","Type":"ContainerStarted","Data":"8f0c678e052c56ea5916115f262b647c8634ba2b451635a3702fc27a5161c88c"} Mar 16 15:58:49 crc kubenswrapper[5120]: I0316 15:58:49.262239 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 15:58:49 crc kubenswrapper[5120]: I0316 15:58:49.284634 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/kube-state-metrics-0" podStartSLOduration=1.82968395 podStartE2EDuration="2.284612672s" podCreationTimestamp="2026-03-16 15:58:47 +0000 UTC" firstStartedPulling="2026-03-16 15:58:48.153846748 +0000 UTC m=+1630.307778405" lastFinishedPulling="2026-03-16 15:58:48.60877547 +0000 UTC m=+1630.762707127" observedRunningTime="2026-03-16 15:58:49.280660132 +0000 UTC m=+1631.434591799" watchObservedRunningTime="2026-03-16 15:58:49.284612672 +0000 UTC m=+1631.438544329" Mar 16 15:58:52 crc kubenswrapper[5120]: I0316 15:58:52.701959 5120 scope.go:117] "RemoveContainer" containerID="02ba4fc3f84eccaecfa9e6618280f65626eb76580c4af9ae7a9d7cb3b8dd590b" Mar 16 15:58:52 crc kubenswrapper[5120]: E0316 15:58:52.702902 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 15:58:52 crc kubenswrapper[5120]: I0316 15:58:52.821289 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:58:52 crc kubenswrapper[5120]: I0316 15:58:52.917931 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ae1d03a6-018f-4911-94d8-1a45cd691544-combined-ca-bundle\") pod \"ae1d03a6-018f-4911-94d8-1a45cd691544\" (UID: \"ae1d03a6-018f-4911-94d8-1a45cd691544\") " Mar 16 15:58:52 crc kubenswrapper[5120]: I0316 15:58:52.917969 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tz6fp\" (UniqueName: \"kubernetes.io/projected/ae1d03a6-018f-4911-94d8-1a45cd691544-kube-api-access-tz6fp\") pod \"ae1d03a6-018f-4911-94d8-1a45cd691544\" (UID: \"ae1d03a6-018f-4911-94d8-1a45cd691544\") " Mar 16 15:58:52 crc kubenswrapper[5120]: I0316 15:58:52.918049 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ae1d03a6-018f-4911-94d8-1a45cd691544-run-httpd\") pod \"ae1d03a6-018f-4911-94d8-1a45cd691544\" (UID: \"ae1d03a6-018f-4911-94d8-1a45cd691544\") " Mar 16 15:58:52 crc kubenswrapper[5120]: I0316 15:58:52.918129 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/ae1d03a6-018f-4911-94d8-1a45cd691544-sg-core-conf-yaml\") pod \"ae1d03a6-018f-4911-94d8-1a45cd691544\" (UID: \"ae1d03a6-018f-4911-94d8-1a45cd691544\") " Mar 16 15:58:52 crc kubenswrapper[5120]: I0316 15:58:52.918348 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ae1d03a6-018f-4911-94d8-1a45cd691544-config-data\") pod \"ae1d03a6-018f-4911-94d8-1a45cd691544\" (UID: \"ae1d03a6-018f-4911-94d8-1a45cd691544\") " Mar 16 15:58:52 crc kubenswrapper[5120]: I0316 15:58:52.918368 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ae1d03a6-018f-4911-94d8-1a45cd691544-scripts\") pod \"ae1d03a6-018f-4911-94d8-1a45cd691544\" (UID: \"ae1d03a6-018f-4911-94d8-1a45cd691544\") " Mar 16 15:58:52 crc kubenswrapper[5120]: I0316 15:58:52.918458 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae1d03a6-018f-4911-94d8-1a45cd691544-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "ae1d03a6-018f-4911-94d8-1a45cd691544" (UID: "ae1d03a6-018f-4911-94d8-1a45cd691544"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:58:52 crc kubenswrapper[5120]: I0316 15:58:52.918511 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ae1d03a6-018f-4911-94d8-1a45cd691544-log-httpd\") pod \"ae1d03a6-018f-4911-94d8-1a45cd691544\" (UID: \"ae1d03a6-018f-4911-94d8-1a45cd691544\") " Mar 16 15:58:52 crc kubenswrapper[5120]: I0316 15:58:52.921545 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae1d03a6-018f-4911-94d8-1a45cd691544-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "ae1d03a6-018f-4911-94d8-1a45cd691544" (UID: "ae1d03a6-018f-4911-94d8-1a45cd691544"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 15:58:52 crc kubenswrapper[5120]: I0316 15:58:52.921600 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ae1d03a6-018f-4911-94d8-1a45cd691544-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 15:58:52 crc kubenswrapper[5120]: I0316 15:58:52.925772 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae1d03a6-018f-4911-94d8-1a45cd691544-scripts" (OuterVolumeSpecName: "scripts") pod "ae1d03a6-018f-4911-94d8-1a45cd691544" (UID: "ae1d03a6-018f-4911-94d8-1a45cd691544"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:58:52 crc kubenswrapper[5120]: I0316 15:58:52.934826 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae1d03a6-018f-4911-94d8-1a45cd691544-kube-api-access-tz6fp" (OuterVolumeSpecName: "kube-api-access-tz6fp") pod "ae1d03a6-018f-4911-94d8-1a45cd691544" (UID: "ae1d03a6-018f-4911-94d8-1a45cd691544"). InnerVolumeSpecName "kube-api-access-tz6fp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:58:52 crc kubenswrapper[5120]: I0316 15:58:52.951730 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae1d03a6-018f-4911-94d8-1a45cd691544-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "ae1d03a6-018f-4911-94d8-1a45cd691544" (UID: "ae1d03a6-018f-4911-94d8-1a45cd691544"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:58:53 crc kubenswrapper[5120]: I0316 15:58:53.001341 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae1d03a6-018f-4911-94d8-1a45cd691544-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ae1d03a6-018f-4911-94d8-1a45cd691544" (UID: "ae1d03a6-018f-4911-94d8-1a45cd691544"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:58:53 crc kubenswrapper[5120]: I0316 15:58:53.023382 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ae1d03a6-018f-4911-94d8-1a45cd691544-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 15:58:53 crc kubenswrapper[5120]: I0316 15:58:53.023414 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ae1d03a6-018f-4911-94d8-1a45cd691544-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 15:58:53 crc kubenswrapper[5120]: I0316 15:58:53.023423 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ae1d03a6-018f-4911-94d8-1a45cd691544-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:58:53 crc kubenswrapper[5120]: I0316 15:58:53.023437 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tz6fp\" (UniqueName: \"kubernetes.io/projected/ae1d03a6-018f-4911-94d8-1a45cd691544-kube-api-access-tz6fp\") on node \"crc\" DevicePath \"\"" Mar 16 15:58:53 crc kubenswrapper[5120]: I0316 15:58:53.023447 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/ae1d03a6-018f-4911-94d8-1a45cd691544-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 15:58:53 crc kubenswrapper[5120]: I0316 15:58:53.053059 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae1d03a6-018f-4911-94d8-1a45cd691544-config-data" (OuterVolumeSpecName: "config-data") pod "ae1d03a6-018f-4911-94d8-1a45cd691544" (UID: "ae1d03a6-018f-4911-94d8-1a45cd691544"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:58:53 crc kubenswrapper[5120]: I0316 15:58:53.124854 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ae1d03a6-018f-4911-94d8-1a45cd691544-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 15:58:53 crc kubenswrapper[5120]: I0316 15:58:53.309612 5120 generic.go:358] "Generic (PLEG): container finished" podID="ae1d03a6-018f-4911-94d8-1a45cd691544" containerID="186998e0f84b2bde1ab1330c5a0f6173446b0fdbcd1cfe73294977d852c52f0c" exitCode=0 Mar 16 15:58:53 crc kubenswrapper[5120]: I0316 15:58:53.310245 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ae1d03a6-018f-4911-94d8-1a45cd691544","Type":"ContainerDied","Data":"186998e0f84b2bde1ab1330c5a0f6173446b0fdbcd1cfe73294977d852c52f0c"} Mar 16 15:58:53 crc kubenswrapper[5120]: I0316 15:58:53.310318 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ae1d03a6-018f-4911-94d8-1a45cd691544","Type":"ContainerDied","Data":"7c6e481a78c818dbbb6c277ba8377c2b6daca502acdddc138b701a1567552fd8"} Mar 16 15:58:53 crc kubenswrapper[5120]: I0316 15:58:53.310345 5120 scope.go:117] "RemoveContainer" containerID="501daadd5356621d4fa4ffe134b38c634ce1c4c91f1995627a101eb7a00fbdbc" Mar 16 15:58:53 crc kubenswrapper[5120]: I0316 15:58:53.310265 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:58:53 crc kubenswrapper[5120]: I0316 15:58:53.344033 5120 scope.go:117] "RemoveContainer" containerID="b2a218f7c85eb417a626c7aae6f48c60f36d5eef731d7631c190206a87f8de72" Mar 16 15:58:53 crc kubenswrapper[5120]: I0316 15:58:53.356624 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 15:58:53 crc kubenswrapper[5120]: I0316 15:58:53.380297 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 15:58:53 crc kubenswrapper[5120]: I0316 15:58:53.383531 5120 scope.go:117] "RemoveContainer" containerID="186998e0f84b2bde1ab1330c5a0f6173446b0fdbcd1cfe73294977d852c52f0c" Mar 16 15:58:53 crc kubenswrapper[5120]: I0316 15:58:53.405903 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 15:58:53 crc kubenswrapper[5120]: I0316 15:58:53.407869 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae1d03a6-018f-4911-94d8-1a45cd691544" containerName="proxy-httpd" Mar 16 15:58:53 crc kubenswrapper[5120]: I0316 15:58:53.407903 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae1d03a6-018f-4911-94d8-1a45cd691544" containerName="proxy-httpd" Mar 16 15:58:53 crc kubenswrapper[5120]: I0316 15:58:53.407979 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae1d03a6-018f-4911-94d8-1a45cd691544" containerName="sg-core" Mar 16 15:58:53 crc kubenswrapper[5120]: I0316 15:58:53.407992 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae1d03a6-018f-4911-94d8-1a45cd691544" containerName="sg-core" Mar 16 15:58:53 crc kubenswrapper[5120]: I0316 15:58:53.408020 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae1d03a6-018f-4911-94d8-1a45cd691544" containerName="ceilometer-notification-agent" Mar 16 15:58:53 crc kubenswrapper[5120]: I0316 15:58:53.408033 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae1d03a6-018f-4911-94d8-1a45cd691544" containerName="ceilometer-notification-agent" Mar 16 15:58:53 crc kubenswrapper[5120]: I0316 15:58:53.408078 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae1d03a6-018f-4911-94d8-1a45cd691544" containerName="ceilometer-central-agent" Mar 16 15:58:53 crc kubenswrapper[5120]: I0316 15:58:53.408090 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae1d03a6-018f-4911-94d8-1a45cd691544" containerName="ceilometer-central-agent" Mar 16 15:58:53 crc kubenswrapper[5120]: I0316 15:58:53.408433 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ae1d03a6-018f-4911-94d8-1a45cd691544" containerName="proxy-httpd" Mar 16 15:58:53 crc kubenswrapper[5120]: I0316 15:58:53.408467 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ae1d03a6-018f-4911-94d8-1a45cd691544" containerName="sg-core" Mar 16 15:58:53 crc kubenswrapper[5120]: I0316 15:58:53.408488 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ae1d03a6-018f-4911-94d8-1a45cd691544" containerName="ceilometer-notification-agent" Mar 16 15:58:53 crc kubenswrapper[5120]: I0316 15:58:53.408514 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ae1d03a6-018f-4911-94d8-1a45cd691544" containerName="ceilometer-central-agent" Mar 16 15:58:53 crc kubenswrapper[5120]: I0316 15:58:53.420716 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:58:53 crc kubenswrapper[5120]: I0316 15:58:53.422937 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 15:58:53 crc kubenswrapper[5120]: I0316 15:58:53.428035 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 15:58:53 crc kubenswrapper[5120]: I0316 15:58:53.429623 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 15:58:53 crc kubenswrapper[5120]: I0316 15:58:53.430896 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ceilometer-internal-svc\"" Mar 16 15:58:53 crc kubenswrapper[5120]: I0316 15:58:53.465925 5120 scope.go:117] "RemoveContainer" containerID="8ab831120d54dbad6b23e07ae2fcce12115e98589743c136d9399be45197d676" Mar 16 15:58:53 crc kubenswrapper[5120]: I0316 15:58:53.484189 5120 scope.go:117] "RemoveContainer" containerID="501daadd5356621d4fa4ffe134b38c634ce1c4c91f1995627a101eb7a00fbdbc" Mar 16 15:58:53 crc kubenswrapper[5120]: E0316 15:58:53.484544 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"501daadd5356621d4fa4ffe134b38c634ce1c4c91f1995627a101eb7a00fbdbc\": container with ID starting with 501daadd5356621d4fa4ffe134b38c634ce1c4c91f1995627a101eb7a00fbdbc not found: ID does not exist" containerID="501daadd5356621d4fa4ffe134b38c634ce1c4c91f1995627a101eb7a00fbdbc" Mar 16 15:58:53 crc kubenswrapper[5120]: I0316 15:58:53.484588 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"501daadd5356621d4fa4ffe134b38c634ce1c4c91f1995627a101eb7a00fbdbc"} err="failed to get container status \"501daadd5356621d4fa4ffe134b38c634ce1c4c91f1995627a101eb7a00fbdbc\": rpc error: code = NotFound desc = could not find container \"501daadd5356621d4fa4ffe134b38c634ce1c4c91f1995627a101eb7a00fbdbc\": container with ID starting with 501daadd5356621d4fa4ffe134b38c634ce1c4c91f1995627a101eb7a00fbdbc not found: ID does not exist" Mar 16 15:58:53 crc kubenswrapper[5120]: I0316 15:58:53.484613 5120 scope.go:117] "RemoveContainer" containerID="b2a218f7c85eb417a626c7aae6f48c60f36d5eef731d7631c190206a87f8de72" Mar 16 15:58:53 crc kubenswrapper[5120]: E0316 15:58:53.485039 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b2a218f7c85eb417a626c7aae6f48c60f36d5eef731d7631c190206a87f8de72\": container with ID starting with b2a218f7c85eb417a626c7aae6f48c60f36d5eef731d7631c190206a87f8de72 not found: ID does not exist" containerID="b2a218f7c85eb417a626c7aae6f48c60f36d5eef731d7631c190206a87f8de72" Mar 16 15:58:53 crc kubenswrapper[5120]: I0316 15:58:53.485089 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2a218f7c85eb417a626c7aae6f48c60f36d5eef731d7631c190206a87f8de72"} err="failed to get container status \"b2a218f7c85eb417a626c7aae6f48c60f36d5eef731d7631c190206a87f8de72\": rpc error: code = NotFound desc = could not find container \"b2a218f7c85eb417a626c7aae6f48c60f36d5eef731d7631c190206a87f8de72\": container with ID starting with b2a218f7c85eb417a626c7aae6f48c60f36d5eef731d7631c190206a87f8de72 not found: ID does not exist" Mar 16 15:58:53 crc kubenswrapper[5120]: I0316 15:58:53.485116 5120 scope.go:117] "RemoveContainer" containerID="186998e0f84b2bde1ab1330c5a0f6173446b0fdbcd1cfe73294977d852c52f0c" Mar 16 15:58:53 crc kubenswrapper[5120]: E0316 15:58:53.485550 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"186998e0f84b2bde1ab1330c5a0f6173446b0fdbcd1cfe73294977d852c52f0c\": container with ID starting with 186998e0f84b2bde1ab1330c5a0f6173446b0fdbcd1cfe73294977d852c52f0c not found: ID does not exist" containerID="186998e0f84b2bde1ab1330c5a0f6173446b0fdbcd1cfe73294977d852c52f0c" Mar 16 15:58:53 crc kubenswrapper[5120]: I0316 15:58:53.485622 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"186998e0f84b2bde1ab1330c5a0f6173446b0fdbcd1cfe73294977d852c52f0c"} err="failed to get container status \"186998e0f84b2bde1ab1330c5a0f6173446b0fdbcd1cfe73294977d852c52f0c\": rpc error: code = NotFound desc = could not find container \"186998e0f84b2bde1ab1330c5a0f6173446b0fdbcd1cfe73294977d852c52f0c\": container with ID starting with 186998e0f84b2bde1ab1330c5a0f6173446b0fdbcd1cfe73294977d852c52f0c not found: ID does not exist" Mar 16 15:58:53 crc kubenswrapper[5120]: I0316 15:58:53.485646 5120 scope.go:117] "RemoveContainer" containerID="8ab831120d54dbad6b23e07ae2fcce12115e98589743c136d9399be45197d676" Mar 16 15:58:53 crc kubenswrapper[5120]: E0316 15:58:53.486239 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ab831120d54dbad6b23e07ae2fcce12115e98589743c136d9399be45197d676\": container with ID starting with 8ab831120d54dbad6b23e07ae2fcce12115e98589743c136d9399be45197d676 not found: ID does not exist" containerID="8ab831120d54dbad6b23e07ae2fcce12115e98589743c136d9399be45197d676" Mar 16 15:58:53 crc kubenswrapper[5120]: I0316 15:58:53.486262 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ab831120d54dbad6b23e07ae2fcce12115e98589743c136d9399be45197d676"} err="failed to get container status \"8ab831120d54dbad6b23e07ae2fcce12115e98589743c136d9399be45197d676\": rpc error: code = NotFound desc = could not find container \"8ab831120d54dbad6b23e07ae2fcce12115e98589743c136d9399be45197d676\": container with ID starting with 8ab831120d54dbad6b23e07ae2fcce12115e98589743c136d9399be45197d676 not found: ID does not exist" Mar 16 15:58:53 crc kubenswrapper[5120]: I0316 15:58:53.542402 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m875q\" (UniqueName: \"kubernetes.io/projected/1d8cf310-88d2-4a5c-a2d9-2807cd409f37-kube-api-access-m875q\") pod \"ceilometer-0\" (UID: \"1d8cf310-88d2-4a5c-a2d9-2807cd409f37\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:58:53 crc kubenswrapper[5120]: I0316 15:58:53.542474 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1d8cf310-88d2-4a5c-a2d9-2807cd409f37-config-data\") pod \"ceilometer-0\" (UID: \"1d8cf310-88d2-4a5c-a2d9-2807cd409f37\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:58:53 crc kubenswrapper[5120]: I0316 15:58:53.542706 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/1d8cf310-88d2-4a5c-a2d9-2807cd409f37-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"1d8cf310-88d2-4a5c-a2d9-2807cd409f37\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:58:53 crc kubenswrapper[5120]: I0316 15:58:53.542778 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/1d8cf310-88d2-4a5c-a2d9-2807cd409f37-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"1d8cf310-88d2-4a5c-a2d9-2807cd409f37\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:58:53 crc kubenswrapper[5120]: I0316 15:58:53.542824 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1d8cf310-88d2-4a5c-a2d9-2807cd409f37-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"1d8cf310-88d2-4a5c-a2d9-2807cd409f37\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:58:53 crc kubenswrapper[5120]: I0316 15:58:53.542964 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1d8cf310-88d2-4a5c-a2d9-2807cd409f37-log-httpd\") pod \"ceilometer-0\" (UID: \"1d8cf310-88d2-4a5c-a2d9-2807cd409f37\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:58:53 crc kubenswrapper[5120]: I0316 15:58:53.543085 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1d8cf310-88d2-4a5c-a2d9-2807cd409f37-run-httpd\") pod \"ceilometer-0\" (UID: \"1d8cf310-88d2-4a5c-a2d9-2807cd409f37\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:58:53 crc kubenswrapper[5120]: I0316 15:58:53.543116 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1d8cf310-88d2-4a5c-a2d9-2807cd409f37-scripts\") pod \"ceilometer-0\" (UID: \"1d8cf310-88d2-4a5c-a2d9-2807cd409f37\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:58:53 crc kubenswrapper[5120]: I0316 15:58:53.645134 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m875q\" (UniqueName: \"kubernetes.io/projected/1d8cf310-88d2-4a5c-a2d9-2807cd409f37-kube-api-access-m875q\") pod \"ceilometer-0\" (UID: \"1d8cf310-88d2-4a5c-a2d9-2807cd409f37\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:58:53 crc kubenswrapper[5120]: I0316 15:58:53.645194 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1d8cf310-88d2-4a5c-a2d9-2807cd409f37-config-data\") pod \"ceilometer-0\" (UID: \"1d8cf310-88d2-4a5c-a2d9-2807cd409f37\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:58:53 crc kubenswrapper[5120]: I0316 15:58:53.645270 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/1d8cf310-88d2-4a5c-a2d9-2807cd409f37-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"1d8cf310-88d2-4a5c-a2d9-2807cd409f37\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:58:53 crc kubenswrapper[5120]: I0316 15:58:53.645296 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/1d8cf310-88d2-4a5c-a2d9-2807cd409f37-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"1d8cf310-88d2-4a5c-a2d9-2807cd409f37\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:58:53 crc kubenswrapper[5120]: I0316 15:58:53.645320 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1d8cf310-88d2-4a5c-a2d9-2807cd409f37-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"1d8cf310-88d2-4a5c-a2d9-2807cd409f37\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:58:53 crc kubenswrapper[5120]: I0316 15:58:53.645384 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1d8cf310-88d2-4a5c-a2d9-2807cd409f37-log-httpd\") pod \"ceilometer-0\" (UID: \"1d8cf310-88d2-4a5c-a2d9-2807cd409f37\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:58:53 crc kubenswrapper[5120]: I0316 15:58:53.645442 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1d8cf310-88d2-4a5c-a2d9-2807cd409f37-run-httpd\") pod \"ceilometer-0\" (UID: \"1d8cf310-88d2-4a5c-a2d9-2807cd409f37\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:58:53 crc kubenswrapper[5120]: I0316 15:58:53.645466 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1d8cf310-88d2-4a5c-a2d9-2807cd409f37-scripts\") pod \"ceilometer-0\" (UID: \"1d8cf310-88d2-4a5c-a2d9-2807cd409f37\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:58:53 crc kubenswrapper[5120]: I0316 15:58:53.646855 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1d8cf310-88d2-4a5c-a2d9-2807cd409f37-log-httpd\") pod \"ceilometer-0\" (UID: \"1d8cf310-88d2-4a5c-a2d9-2807cd409f37\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:58:53 crc kubenswrapper[5120]: I0316 15:58:53.647009 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1d8cf310-88d2-4a5c-a2d9-2807cd409f37-run-httpd\") pod \"ceilometer-0\" (UID: \"1d8cf310-88d2-4a5c-a2d9-2807cd409f37\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:58:53 crc kubenswrapper[5120]: I0316 15:58:53.652474 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1d8cf310-88d2-4a5c-a2d9-2807cd409f37-scripts\") pod \"ceilometer-0\" (UID: \"1d8cf310-88d2-4a5c-a2d9-2807cd409f37\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:58:53 crc kubenswrapper[5120]: I0316 15:58:53.653285 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/1d8cf310-88d2-4a5c-a2d9-2807cd409f37-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"1d8cf310-88d2-4a5c-a2d9-2807cd409f37\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:58:53 crc kubenswrapper[5120]: I0316 15:58:53.653978 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1d8cf310-88d2-4a5c-a2d9-2807cd409f37-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"1d8cf310-88d2-4a5c-a2d9-2807cd409f37\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:58:53 crc kubenswrapper[5120]: I0316 15:58:53.654361 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1d8cf310-88d2-4a5c-a2d9-2807cd409f37-config-data\") pod \"ceilometer-0\" (UID: \"1d8cf310-88d2-4a5c-a2d9-2807cd409f37\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:58:53 crc kubenswrapper[5120]: I0316 15:58:53.665249 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/1d8cf310-88d2-4a5c-a2d9-2807cd409f37-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"1d8cf310-88d2-4a5c-a2d9-2807cd409f37\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:58:53 crc kubenswrapper[5120]: I0316 15:58:53.669554 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m875q\" (UniqueName: \"kubernetes.io/projected/1d8cf310-88d2-4a5c-a2d9-2807cd409f37-kube-api-access-m875q\") pod \"ceilometer-0\" (UID: \"1d8cf310-88d2-4a5c-a2d9-2807cd409f37\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:58:53 crc kubenswrapper[5120]: I0316 15:58:53.757858 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:58:54 crc kubenswrapper[5120]: I0316 15:58:54.249377 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 15:58:54 crc kubenswrapper[5120]: I0316 15:58:54.333997 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1d8cf310-88d2-4a5c-a2d9-2807cd409f37","Type":"ContainerStarted","Data":"9a9dcef95ab60461cbd5406abc5989757bb992fc2fb4f06cb7ce6caf861fb448"} Mar 16 15:58:54 crc kubenswrapper[5120]: I0316 15:58:54.680539 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ae1d03a6-018f-4911-94d8-1a45cd691544" path="/var/lib/kubelet/pods/ae1d03a6-018f-4911-94d8-1a45cd691544/volumes" Mar 16 15:58:55 crc kubenswrapper[5120]: I0316 15:58:55.351025 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1d8cf310-88d2-4a5c-a2d9-2807cd409f37","Type":"ContainerStarted","Data":"5947f9d479cbbe03d5e81c795fe4598420a5ae0c722f314229b64194063a5d8f"} Mar 16 15:58:56 crc kubenswrapper[5120]: I0316 15:58:56.371983 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1d8cf310-88d2-4a5c-a2d9-2807cd409f37","Type":"ContainerStarted","Data":"341049f42f477d50d61b6b0313212a767638ec69f7b505bb6a919d1797bdd5bd"} Mar 16 15:58:57 crc kubenswrapper[5120]: I0316 15:58:57.386439 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1d8cf310-88d2-4a5c-a2d9-2807cd409f37","Type":"ContainerStarted","Data":"cd64ff6d1522e78a36e711e1d6c63dfc1b9549659dfe87de0c90878031eefbbf"} Mar 16 15:58:58 crc kubenswrapper[5120]: I0316 15:58:58.403218 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1d8cf310-88d2-4a5c-a2d9-2807cd409f37","Type":"ContainerStarted","Data":"225178e952b315c5893292df5f1de300801aa1d4aa5ddd4097d9a84deac77bb4"} Mar 16 15:58:58 crc kubenswrapper[5120]: I0316 15:58:58.404206 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:58:58 crc kubenswrapper[5120]: I0316 15:58:58.438907 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=1.5800924840000001 podStartE2EDuration="5.43887619s" podCreationTimestamp="2026-03-16 15:58:53 +0000 UTC" firstStartedPulling="2026-03-16 15:58:54.255238669 +0000 UTC m=+1636.409170336" lastFinishedPulling="2026-03-16 15:58:58.114022365 +0000 UTC m=+1640.267954042" observedRunningTime="2026-03-16 15:58:58.422558049 +0000 UTC m=+1640.576489716" watchObservedRunningTime="2026-03-16 15:58:58.43887619 +0000 UTC m=+1640.592807877" Mar 16 15:59:00 crc kubenswrapper[5120]: I0316 15:59:00.279944 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 15:59:03 crc kubenswrapper[5120]: I0316 15:59:03.663567 5120 scope.go:117] "RemoveContainer" containerID="02ba4fc3f84eccaecfa9e6618280f65626eb76580c4af9ae7a9d7cb3b8dd590b" Mar 16 15:59:03 crc kubenswrapper[5120]: E0316 15:59:03.664560 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 15:59:07 crc kubenswrapper[5120]: E0316 15:59:07.928172 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1762708 actualBytes=10240 Mar 16 15:59:15 crc kubenswrapper[5120]: I0316 15:59:15.665214 5120 scope.go:117] "RemoveContainer" containerID="02ba4fc3f84eccaecfa9e6618280f65626eb76580c4af9ae7a9d7cb3b8dd590b" Mar 16 15:59:15 crc kubenswrapper[5120]: E0316 15:59:15.666306 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 15:59:29 crc kubenswrapper[5120]: I0316 15:59:29.428049 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 15:59:29 crc kubenswrapper[5120]: I0316 15:59:29.663552 5120 scope.go:117] "RemoveContainer" containerID="02ba4fc3f84eccaecfa9e6618280f65626eb76580c4af9ae7a9d7cb3b8dd590b" Mar 16 15:59:29 crc kubenswrapper[5120]: E0316 15:59:29.664097 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 15:59:33 crc kubenswrapper[5120]: I0316 15:59:33.395607 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovn-controller-sh5s2"] Mar 16 15:59:33 crc kubenswrapper[5120]: I0316 15:59:33.406623 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-controller-sh5s2" Mar 16 15:59:33 crc kubenswrapper[5120]: I0316 15:59:33.407229 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-controller-sh5s2"] Mar 16 15:59:33 crc kubenswrapper[5120]: I0316 15:59:33.416244 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovn-controller-metrics-4x949"] Mar 16 15:59:33 crc kubenswrapper[5120]: I0316 15:59:33.423549 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovncontroller-scripts\"" Mar 16 15:59:33 crc kubenswrapper[5120]: I0316 15:59:33.424066 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ovncontroller-ovncontroller-dockercfg-ptwff\"" Mar 16 15:59:33 crc kubenswrapper[5120]: I0316 15:59:33.424248 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ovncontroller-ovndbs\"" Mar 16 15:59:33 crc kubenswrapper[5120]: I0316 15:59:33.425240 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-controller-metrics-4x949" Mar 16 15:59:33 crc kubenswrapper[5120]: I0316 15:59:33.427577 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovn-controller-ovs-wmmfv"] Mar 16 15:59:33 crc kubenswrapper[5120]: I0316 15:59:33.430168 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovncontroller-metrics-config\"" Mar 16 15:59:33 crc kubenswrapper[5120]: I0316 15:59:33.446236 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-controller-metrics-4x949"] Mar 16 15:59:33 crc kubenswrapper[5120]: I0316 15:59:33.446285 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-controller-ovs-wmmfv"] Mar 16 15:59:33 crc kubenswrapper[5120]: I0316 15:59:33.446430 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-controller-ovs-wmmfv" Mar 16 15:59:33 crc kubenswrapper[5120]: I0316 15:59:33.480288 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-ovs\" (UniqueName: \"kubernetes.io/host-path/ab8ad82a-5c13-4d9e-bbae-548a51860f3c-etc-ovs\") pod \"ovn-controller-ovs-wmmfv\" (UID: \"ab8ad82a-5c13-4d9e-bbae-548a51860f3c\") " pod="openstack-kuttl-tests/ovn-controller-ovs-wmmfv" Mar 16 15:59:33 crc kubenswrapper[5120]: I0316 15:59:33.480556 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovs-rundir\" (UniqueName: \"kubernetes.io/host-path/72af703b-47ea-48cf-a221-59207e86758c-ovs-rundir\") pod \"ovn-controller-metrics-4x949\" (UID: \"72af703b-47ea-48cf-a221-59207e86758c\") " pod="openstack-kuttl-tests/ovn-controller-metrics-4x949" Mar 16 15:59:33 crc kubenswrapper[5120]: I0316 15:59:33.480665 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-run\" (UniqueName: \"kubernetes.io/host-path/ab8ad82a-5c13-4d9e-bbae-548a51860f3c-var-run\") pod \"ovn-controller-ovs-wmmfv\" (UID: \"ab8ad82a-5c13-4d9e-bbae-548a51860f3c\") " pod="openstack-kuttl-tests/ovn-controller-ovs-wmmfv" Mar 16 15:59:33 crc kubenswrapper[5120]: I0316 15:59:33.480782 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/b7909026-6951-43af-97ea-2783dc8739be-scripts\") pod \"ovn-controller-sh5s2\" (UID: \"b7909026-6951-43af-97ea-2783dc8739be\") " pod="openstack-kuttl-tests/ovn-controller-sh5s2" Mar 16 15:59:33 crc kubenswrapper[5120]: I0316 15:59:33.480918 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-log-ovn\" (UniqueName: \"kubernetes.io/host-path/b7909026-6951-43af-97ea-2783dc8739be-var-log-ovn\") pod \"ovn-controller-sh5s2\" (UID: \"b7909026-6951-43af-97ea-2783dc8739be\") " pod="openstack-kuttl-tests/ovn-controller-sh5s2" Mar 16 15:59:33 crc kubenswrapper[5120]: I0316 15:59:33.481031 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/72af703b-47ea-48cf-a221-59207e86758c-combined-ca-bundle\") pod \"ovn-controller-metrics-4x949\" (UID: \"72af703b-47ea-48cf-a221-59207e86758c\") " pod="openstack-kuttl-tests/ovn-controller-metrics-4x949" Mar 16 15:59:33 crc kubenswrapper[5120]: I0316 15:59:33.481191 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-log\" (UniqueName: \"kubernetes.io/host-path/ab8ad82a-5c13-4d9e-bbae-548a51860f3c-var-log\") pod \"ovn-controller-ovs-wmmfv\" (UID: \"ab8ad82a-5c13-4d9e-bbae-548a51860f3c\") " pod="openstack-kuttl-tests/ovn-controller-ovs-wmmfv" Mar 16 15:59:33 crc kubenswrapper[5120]: I0316 15:59:33.481287 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-controller-tls-certs\" (UniqueName: \"kubernetes.io/secret/b7909026-6951-43af-97ea-2783dc8739be-ovn-controller-tls-certs\") pod \"ovn-controller-sh5s2\" (UID: \"b7909026-6951-43af-97ea-2783dc8739be\") " pod="openstack-kuttl-tests/ovn-controller-sh5s2" Mar 16 15:59:33 crc kubenswrapper[5120]: I0316 15:59:33.481400 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/72af703b-47ea-48cf-a221-59207e86758c-config\") pod \"ovn-controller-metrics-4x949\" (UID: \"72af703b-47ea-48cf-a221-59207e86758c\") " pod="openstack-kuttl-tests/ovn-controller-metrics-4x949" Mar 16 15:59:33 crc kubenswrapper[5120]: I0316 15:59:33.481501 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/host-path/72af703b-47ea-48cf-a221-59207e86758c-ovn-rundir\") pod \"ovn-controller-metrics-4x949\" (UID: \"72af703b-47ea-48cf-a221-59207e86758c\") " pod="openstack-kuttl-tests/ovn-controller-metrics-4x949" Mar 16 15:59:33 crc kubenswrapper[5120]: I0316 15:59:33.481615 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xm4r\" (UniqueName: \"kubernetes.io/projected/ab8ad82a-5c13-4d9e-bbae-548a51860f3c-kube-api-access-4xm4r\") pod \"ovn-controller-ovs-wmmfv\" (UID: \"ab8ad82a-5c13-4d9e-bbae-548a51860f3c\") " pod="openstack-kuttl-tests/ovn-controller-ovs-wmmfv" Mar 16 15:59:33 crc kubenswrapper[5120]: I0316 15:59:33.481716 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbm98\" (UniqueName: \"kubernetes.io/projected/b7909026-6951-43af-97ea-2783dc8739be-kube-api-access-qbm98\") pod \"ovn-controller-sh5s2\" (UID: \"b7909026-6951-43af-97ea-2783dc8739be\") " pod="openstack-kuttl-tests/ovn-controller-sh5s2" Mar 16 15:59:33 crc kubenswrapper[5120]: I0316 15:59:33.481831 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-run-ovn\" (UniqueName: \"kubernetes.io/host-path/b7909026-6951-43af-97ea-2783dc8739be-var-run-ovn\") pod \"ovn-controller-sh5s2\" (UID: \"b7909026-6951-43af-97ea-2783dc8739be\") " pod="openstack-kuttl-tests/ovn-controller-sh5s2" Mar 16 15:59:33 crc kubenswrapper[5120]: I0316 15:59:33.481936 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib\" (UniqueName: \"kubernetes.io/host-path/ab8ad82a-5c13-4d9e-bbae-548a51860f3c-var-lib\") pod \"ovn-controller-ovs-wmmfv\" (UID: \"ab8ad82a-5c13-4d9e-bbae-548a51860f3c\") " pod="openstack-kuttl-tests/ovn-controller-ovs-wmmfv" Mar 16 15:59:33 crc kubenswrapper[5120]: I0316 15:59:33.482068 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k727h\" (UniqueName: \"kubernetes.io/projected/72af703b-47ea-48cf-a221-59207e86758c-kube-api-access-k727h\") pod \"ovn-controller-metrics-4x949\" (UID: \"72af703b-47ea-48cf-a221-59207e86758c\") " pod="openstack-kuttl-tests/ovn-controller-metrics-4x949" Mar 16 15:59:33 crc kubenswrapper[5120]: I0316 15:59:33.482207 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-run\" (UniqueName: \"kubernetes.io/host-path/b7909026-6951-43af-97ea-2783dc8739be-var-run\") pod \"ovn-controller-sh5s2\" (UID: \"b7909026-6951-43af-97ea-2783dc8739be\") " pod="openstack-kuttl-tests/ovn-controller-sh5s2" Mar 16 15:59:33 crc kubenswrapper[5120]: I0316 15:59:33.482532 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/ab8ad82a-5c13-4d9e-bbae-548a51860f3c-scripts\") pod \"ovn-controller-ovs-wmmfv\" (UID: \"ab8ad82a-5c13-4d9e-bbae-548a51860f3c\") " pod="openstack-kuttl-tests/ovn-controller-ovs-wmmfv" Mar 16 15:59:33 crc kubenswrapper[5120]: I0316 15:59:33.482624 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/72af703b-47ea-48cf-a221-59207e86758c-metrics-certs-tls-certs\") pod \"ovn-controller-metrics-4x949\" (UID: \"72af703b-47ea-48cf-a221-59207e86758c\") " pod="openstack-kuttl-tests/ovn-controller-metrics-4x949" Mar 16 15:59:33 crc kubenswrapper[5120]: I0316 15:59:33.482645 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b7909026-6951-43af-97ea-2783dc8739be-combined-ca-bundle\") pod \"ovn-controller-sh5s2\" (UID: \"b7909026-6951-43af-97ea-2783dc8739be\") " pod="openstack-kuttl-tests/ovn-controller-sh5s2" Mar 16 15:59:33 crc kubenswrapper[5120]: I0316 15:59:33.585141 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/72af703b-47ea-48cf-a221-59207e86758c-config\") pod \"ovn-controller-metrics-4x949\" (UID: \"72af703b-47ea-48cf-a221-59207e86758c\") " pod="openstack-kuttl-tests/ovn-controller-metrics-4x949" Mar 16 15:59:33 crc kubenswrapper[5120]: I0316 15:59:33.585197 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/host-path/72af703b-47ea-48cf-a221-59207e86758c-ovn-rundir\") pod \"ovn-controller-metrics-4x949\" (UID: \"72af703b-47ea-48cf-a221-59207e86758c\") " pod="openstack-kuttl-tests/ovn-controller-metrics-4x949" Mar 16 15:59:33 crc kubenswrapper[5120]: I0316 15:59:33.585283 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4xm4r\" (UniqueName: \"kubernetes.io/projected/ab8ad82a-5c13-4d9e-bbae-548a51860f3c-kube-api-access-4xm4r\") pod \"ovn-controller-ovs-wmmfv\" (UID: \"ab8ad82a-5c13-4d9e-bbae-548a51860f3c\") " pod="openstack-kuttl-tests/ovn-controller-ovs-wmmfv" Mar 16 15:59:33 crc kubenswrapper[5120]: I0316 15:59:33.585365 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qbm98\" (UniqueName: \"kubernetes.io/projected/b7909026-6951-43af-97ea-2783dc8739be-kube-api-access-qbm98\") pod \"ovn-controller-sh5s2\" (UID: \"b7909026-6951-43af-97ea-2783dc8739be\") " pod="openstack-kuttl-tests/ovn-controller-sh5s2" Mar 16 15:59:33 crc kubenswrapper[5120]: I0316 15:59:33.585827 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-run-ovn\" (UniqueName: \"kubernetes.io/host-path/b7909026-6951-43af-97ea-2783dc8739be-var-run-ovn\") pod \"ovn-controller-sh5s2\" (UID: \"b7909026-6951-43af-97ea-2783dc8739be\") " pod="openstack-kuttl-tests/ovn-controller-sh5s2" Mar 16 15:59:33 crc kubenswrapper[5120]: I0316 15:59:33.585935 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib\" (UniqueName: \"kubernetes.io/host-path/ab8ad82a-5c13-4d9e-bbae-548a51860f3c-var-lib\") pod \"ovn-controller-ovs-wmmfv\" (UID: \"ab8ad82a-5c13-4d9e-bbae-548a51860f3c\") " pod="openstack-kuttl-tests/ovn-controller-ovs-wmmfv" Mar 16 15:59:33 crc kubenswrapper[5120]: I0316 15:59:33.585999 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-run-ovn\" (UniqueName: \"kubernetes.io/host-path/b7909026-6951-43af-97ea-2783dc8739be-var-run-ovn\") pod \"ovn-controller-sh5s2\" (UID: \"b7909026-6951-43af-97ea-2783dc8739be\") " pod="openstack-kuttl-tests/ovn-controller-sh5s2" Mar 16 15:59:33 crc kubenswrapper[5120]: I0316 15:59:33.585996 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/host-path/72af703b-47ea-48cf-a221-59207e86758c-ovn-rundir\") pod \"ovn-controller-metrics-4x949\" (UID: \"72af703b-47ea-48cf-a221-59207e86758c\") " pod="openstack-kuttl-tests/ovn-controller-metrics-4x949" Mar 16 15:59:33 crc kubenswrapper[5120]: I0316 15:59:33.586120 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k727h\" (UniqueName: \"kubernetes.io/projected/72af703b-47ea-48cf-a221-59207e86758c-kube-api-access-k727h\") pod \"ovn-controller-metrics-4x949\" (UID: \"72af703b-47ea-48cf-a221-59207e86758c\") " pod="openstack-kuttl-tests/ovn-controller-metrics-4x949" Mar 16 15:59:33 crc kubenswrapper[5120]: I0316 15:59:33.586187 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-run\" (UniqueName: \"kubernetes.io/host-path/b7909026-6951-43af-97ea-2783dc8739be-var-run\") pod \"ovn-controller-sh5s2\" (UID: \"b7909026-6951-43af-97ea-2783dc8739be\") " pod="openstack-kuttl-tests/ovn-controller-sh5s2" Mar 16 15:59:33 crc kubenswrapper[5120]: I0316 15:59:33.586227 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/ab8ad82a-5c13-4d9e-bbae-548a51860f3c-scripts\") pod \"ovn-controller-ovs-wmmfv\" (UID: \"ab8ad82a-5c13-4d9e-bbae-548a51860f3c\") " pod="openstack-kuttl-tests/ovn-controller-ovs-wmmfv" Mar 16 15:59:33 crc kubenswrapper[5120]: I0316 15:59:33.586243 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib\" (UniqueName: \"kubernetes.io/host-path/ab8ad82a-5c13-4d9e-bbae-548a51860f3c-var-lib\") pod \"ovn-controller-ovs-wmmfv\" (UID: \"ab8ad82a-5c13-4d9e-bbae-548a51860f3c\") " pod="openstack-kuttl-tests/ovn-controller-ovs-wmmfv" Mar 16 15:59:33 crc kubenswrapper[5120]: I0316 15:59:33.586278 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/72af703b-47ea-48cf-a221-59207e86758c-metrics-certs-tls-certs\") pod \"ovn-controller-metrics-4x949\" (UID: \"72af703b-47ea-48cf-a221-59207e86758c\") " pod="openstack-kuttl-tests/ovn-controller-metrics-4x949" Mar 16 15:59:33 crc kubenswrapper[5120]: I0316 15:59:33.586302 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b7909026-6951-43af-97ea-2783dc8739be-combined-ca-bundle\") pod \"ovn-controller-sh5s2\" (UID: \"b7909026-6951-43af-97ea-2783dc8739be\") " pod="openstack-kuttl-tests/ovn-controller-sh5s2" Mar 16 15:59:33 crc kubenswrapper[5120]: I0316 15:59:33.586349 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-ovs\" (UniqueName: \"kubernetes.io/host-path/ab8ad82a-5c13-4d9e-bbae-548a51860f3c-etc-ovs\") pod \"ovn-controller-ovs-wmmfv\" (UID: \"ab8ad82a-5c13-4d9e-bbae-548a51860f3c\") " pod="openstack-kuttl-tests/ovn-controller-ovs-wmmfv" Mar 16 15:59:33 crc kubenswrapper[5120]: I0316 15:59:33.586375 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-run\" (UniqueName: \"kubernetes.io/host-path/b7909026-6951-43af-97ea-2783dc8739be-var-run\") pod \"ovn-controller-sh5s2\" (UID: \"b7909026-6951-43af-97ea-2783dc8739be\") " pod="openstack-kuttl-tests/ovn-controller-sh5s2" Mar 16 15:59:33 crc kubenswrapper[5120]: I0316 15:59:33.586376 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovs-rundir\" (UniqueName: \"kubernetes.io/host-path/72af703b-47ea-48cf-a221-59207e86758c-ovs-rundir\") pod \"ovn-controller-metrics-4x949\" (UID: \"72af703b-47ea-48cf-a221-59207e86758c\") " pod="openstack-kuttl-tests/ovn-controller-metrics-4x949" Mar 16 15:59:33 crc kubenswrapper[5120]: I0316 15:59:33.586423 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovs-rundir\" (UniqueName: \"kubernetes.io/host-path/72af703b-47ea-48cf-a221-59207e86758c-ovs-rundir\") pod \"ovn-controller-metrics-4x949\" (UID: \"72af703b-47ea-48cf-a221-59207e86758c\") " pod="openstack-kuttl-tests/ovn-controller-metrics-4x949" Mar 16 15:59:33 crc kubenswrapper[5120]: I0316 15:59:33.586432 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-run\" (UniqueName: \"kubernetes.io/host-path/ab8ad82a-5c13-4d9e-bbae-548a51860f3c-var-run\") pod \"ovn-controller-ovs-wmmfv\" (UID: \"ab8ad82a-5c13-4d9e-bbae-548a51860f3c\") " pod="openstack-kuttl-tests/ovn-controller-ovs-wmmfv" Mar 16 15:59:33 crc kubenswrapper[5120]: I0316 15:59:33.586442 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/72af703b-47ea-48cf-a221-59207e86758c-config\") pod \"ovn-controller-metrics-4x949\" (UID: \"72af703b-47ea-48cf-a221-59207e86758c\") " pod="openstack-kuttl-tests/ovn-controller-metrics-4x949" Mar 16 15:59:33 crc kubenswrapper[5120]: I0316 15:59:33.586480 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-run\" (UniqueName: \"kubernetes.io/host-path/ab8ad82a-5c13-4d9e-bbae-548a51860f3c-var-run\") pod \"ovn-controller-ovs-wmmfv\" (UID: \"ab8ad82a-5c13-4d9e-bbae-548a51860f3c\") " pod="openstack-kuttl-tests/ovn-controller-ovs-wmmfv" Mar 16 15:59:33 crc kubenswrapper[5120]: I0316 15:59:33.586804 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-ovs\" (UniqueName: \"kubernetes.io/host-path/ab8ad82a-5c13-4d9e-bbae-548a51860f3c-etc-ovs\") pod \"ovn-controller-ovs-wmmfv\" (UID: \"ab8ad82a-5c13-4d9e-bbae-548a51860f3c\") " pod="openstack-kuttl-tests/ovn-controller-ovs-wmmfv" Mar 16 15:59:33 crc kubenswrapper[5120]: I0316 15:59:33.586868 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/b7909026-6951-43af-97ea-2783dc8739be-scripts\") pod \"ovn-controller-sh5s2\" (UID: \"b7909026-6951-43af-97ea-2783dc8739be\") " pod="openstack-kuttl-tests/ovn-controller-sh5s2" Mar 16 15:59:33 crc kubenswrapper[5120]: I0316 15:59:33.586957 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-log-ovn\" (UniqueName: \"kubernetes.io/host-path/b7909026-6951-43af-97ea-2783dc8739be-var-log-ovn\") pod \"ovn-controller-sh5s2\" (UID: \"b7909026-6951-43af-97ea-2783dc8739be\") " pod="openstack-kuttl-tests/ovn-controller-sh5s2" Mar 16 15:59:33 crc kubenswrapper[5120]: I0316 15:59:33.586991 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/72af703b-47ea-48cf-a221-59207e86758c-combined-ca-bundle\") pod \"ovn-controller-metrics-4x949\" (UID: \"72af703b-47ea-48cf-a221-59207e86758c\") " pod="openstack-kuttl-tests/ovn-controller-metrics-4x949" Mar 16 15:59:33 crc kubenswrapper[5120]: I0316 15:59:33.587158 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-log\" (UniqueName: \"kubernetes.io/host-path/ab8ad82a-5c13-4d9e-bbae-548a51860f3c-var-log\") pod \"ovn-controller-ovs-wmmfv\" (UID: \"ab8ad82a-5c13-4d9e-bbae-548a51860f3c\") " pod="openstack-kuttl-tests/ovn-controller-ovs-wmmfv" Mar 16 15:59:33 crc kubenswrapper[5120]: I0316 15:59:33.587180 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-controller-tls-certs\" (UniqueName: \"kubernetes.io/secret/b7909026-6951-43af-97ea-2783dc8739be-ovn-controller-tls-certs\") pod \"ovn-controller-sh5s2\" (UID: \"b7909026-6951-43af-97ea-2783dc8739be\") " pod="openstack-kuttl-tests/ovn-controller-sh5s2" Mar 16 15:59:33 crc kubenswrapper[5120]: I0316 15:59:33.587213 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-log-ovn\" (UniqueName: \"kubernetes.io/host-path/b7909026-6951-43af-97ea-2783dc8739be-var-log-ovn\") pod \"ovn-controller-sh5s2\" (UID: \"b7909026-6951-43af-97ea-2783dc8739be\") " pod="openstack-kuttl-tests/ovn-controller-sh5s2" Mar 16 15:59:33 crc kubenswrapper[5120]: I0316 15:59:33.587478 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-log\" (UniqueName: \"kubernetes.io/host-path/ab8ad82a-5c13-4d9e-bbae-548a51860f3c-var-log\") pod \"ovn-controller-ovs-wmmfv\" (UID: \"ab8ad82a-5c13-4d9e-bbae-548a51860f3c\") " pod="openstack-kuttl-tests/ovn-controller-ovs-wmmfv" Mar 16 15:59:33 crc kubenswrapper[5120]: I0316 15:59:33.589352 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/ab8ad82a-5c13-4d9e-bbae-548a51860f3c-scripts\") pod \"ovn-controller-ovs-wmmfv\" (UID: \"ab8ad82a-5c13-4d9e-bbae-548a51860f3c\") " pod="openstack-kuttl-tests/ovn-controller-ovs-wmmfv" Mar 16 15:59:33 crc kubenswrapper[5120]: I0316 15:59:33.589638 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/b7909026-6951-43af-97ea-2783dc8739be-scripts\") pod \"ovn-controller-sh5s2\" (UID: \"b7909026-6951-43af-97ea-2783dc8739be\") " pod="openstack-kuttl-tests/ovn-controller-sh5s2" Mar 16 15:59:33 crc kubenswrapper[5120]: I0316 15:59:33.592715 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/72af703b-47ea-48cf-a221-59207e86758c-metrics-certs-tls-certs\") pod \"ovn-controller-metrics-4x949\" (UID: \"72af703b-47ea-48cf-a221-59207e86758c\") " pod="openstack-kuttl-tests/ovn-controller-metrics-4x949" Mar 16 15:59:33 crc kubenswrapper[5120]: I0316 15:59:33.592919 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-controller-tls-certs\" (UniqueName: \"kubernetes.io/secret/b7909026-6951-43af-97ea-2783dc8739be-ovn-controller-tls-certs\") pod \"ovn-controller-sh5s2\" (UID: \"b7909026-6951-43af-97ea-2783dc8739be\") " pod="openstack-kuttl-tests/ovn-controller-sh5s2" Mar 16 15:59:33 crc kubenswrapper[5120]: I0316 15:59:33.593255 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b7909026-6951-43af-97ea-2783dc8739be-combined-ca-bundle\") pod \"ovn-controller-sh5s2\" (UID: \"b7909026-6951-43af-97ea-2783dc8739be\") " pod="openstack-kuttl-tests/ovn-controller-sh5s2" Mar 16 15:59:33 crc kubenswrapper[5120]: I0316 15:59:33.596285 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/72af703b-47ea-48cf-a221-59207e86758c-combined-ca-bundle\") pod \"ovn-controller-metrics-4x949\" (UID: \"72af703b-47ea-48cf-a221-59207e86758c\") " pod="openstack-kuttl-tests/ovn-controller-metrics-4x949" Mar 16 15:59:33 crc kubenswrapper[5120]: I0316 15:59:33.603426 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbm98\" (UniqueName: \"kubernetes.io/projected/b7909026-6951-43af-97ea-2783dc8739be-kube-api-access-qbm98\") pod \"ovn-controller-sh5s2\" (UID: \"b7909026-6951-43af-97ea-2783dc8739be\") " pod="openstack-kuttl-tests/ovn-controller-sh5s2" Mar 16 15:59:33 crc kubenswrapper[5120]: I0316 15:59:33.607264 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xm4r\" (UniqueName: \"kubernetes.io/projected/ab8ad82a-5c13-4d9e-bbae-548a51860f3c-kube-api-access-4xm4r\") pod \"ovn-controller-ovs-wmmfv\" (UID: \"ab8ad82a-5c13-4d9e-bbae-548a51860f3c\") " pod="openstack-kuttl-tests/ovn-controller-ovs-wmmfv" Mar 16 15:59:33 crc kubenswrapper[5120]: I0316 15:59:33.608810 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k727h\" (UniqueName: \"kubernetes.io/projected/72af703b-47ea-48cf-a221-59207e86758c-kube-api-access-k727h\") pod \"ovn-controller-metrics-4x949\" (UID: \"72af703b-47ea-48cf-a221-59207e86758c\") " pod="openstack-kuttl-tests/ovn-controller-metrics-4x949" Mar 16 15:59:33 crc kubenswrapper[5120]: I0316 15:59:33.750670 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-controller-sh5s2" Mar 16 15:59:33 crc kubenswrapper[5120]: I0316 15:59:33.761038 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-controller-metrics-4x949" Mar 16 15:59:33 crc kubenswrapper[5120]: I0316 15:59:33.777261 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-controller-ovs-wmmfv" Mar 16 15:59:34 crc kubenswrapper[5120]: I0316 15:59:34.231569 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-controller-metrics-4x949"] Mar 16 15:59:34 crc kubenswrapper[5120]: W0316 15:59:34.295509 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb7909026_6951_43af_97ea_2783dc8739be.slice/crio-dbf3bee41b5a1b06da262881d150efebf93d8fdcaded4549f2b90ce35a22d3b9 WatchSource:0}: Error finding container dbf3bee41b5a1b06da262881d150efebf93d8fdcaded4549f2b90ce35a22d3b9: Status 404 returned error can't find the container with id dbf3bee41b5a1b06da262881d150efebf93d8fdcaded4549f2b90ce35a22d3b9 Mar 16 15:59:34 crc kubenswrapper[5120]: I0316 15:59:34.298317 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-controller-sh5s2"] Mar 16 15:59:34 crc kubenswrapper[5120]: I0316 15:59:34.410389 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-controller-ovs-wmmfv"] Mar 16 15:59:34 crc kubenswrapper[5120]: W0316 15:59:34.443788 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podab8ad82a_5c13_4d9e_bbae_548a51860f3c.slice/crio-584ac3de4782563e4aec911e4ee872cc72408e053b0982b9b98570aea3799376 WatchSource:0}: Error finding container 584ac3de4782563e4aec911e4ee872cc72408e053b0982b9b98570aea3799376: Status 404 returned error can't find the container with id 584ac3de4782563e4aec911e4ee872cc72408e053b0982b9b98570aea3799376 Mar 16 15:59:34 crc kubenswrapper[5120]: I0316 15:59:34.877884 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-controller-sh5s2" event={"ID":"b7909026-6951-43af-97ea-2783dc8739be","Type":"ContainerStarted","Data":"dbf3bee41b5a1b06da262881d150efebf93d8fdcaded4549f2b90ce35a22d3b9"} Mar 16 15:59:34 crc kubenswrapper[5120]: I0316 15:59:34.879579 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-controller-ovs-wmmfv" event={"ID":"ab8ad82a-5c13-4d9e-bbae-548a51860f3c","Type":"ContainerStarted","Data":"584ac3de4782563e4aec911e4ee872cc72408e053b0982b9b98570aea3799376"} Mar 16 15:59:34 crc kubenswrapper[5120]: I0316 15:59:34.881364 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-controller-metrics-4x949" event={"ID":"72af703b-47ea-48cf-a221-59207e86758c","Type":"ContainerStarted","Data":"34dd44c1619f504c4922a5cebaf5cca18c490f64c1434a284491b41a8f49b59a"} Mar 16 15:59:34 crc kubenswrapper[5120]: I0316 15:59:34.881389 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-controller-metrics-4x949" event={"ID":"72af703b-47ea-48cf-a221-59207e86758c","Type":"ContainerStarted","Data":"7f32cea0ac1d6d49a315917929d083a95811ecf7ef142c5693ec3d77acf03921"} Mar 16 15:59:34 crc kubenswrapper[5120]: I0316 15:59:34.918337 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovn-controller-metrics-4x949" podStartSLOduration=1.918306734 podStartE2EDuration="1.918306734s" podCreationTimestamp="2026-03-16 15:59:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 15:59:34.895207386 +0000 UTC m=+1677.049139063" watchObservedRunningTime="2026-03-16 15:59:34.918306734 +0000 UTC m=+1677.072238421" Mar 16 15:59:35 crc kubenswrapper[5120]: I0316 15:59:35.899899 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-controller-ovs-wmmfv" event={"ID":"ab8ad82a-5c13-4d9e-bbae-548a51860f3c","Type":"ContainerStarted","Data":"b014396938706fd9de4e8b35b5ccfa8f461e7692e36984d8f01010f051e1cfc7"} Mar 16 15:59:36 crc kubenswrapper[5120]: I0316 15:59:36.911851 5120 generic.go:358] "Generic (PLEG): container finished" podID="ab8ad82a-5c13-4d9e-bbae-548a51860f3c" containerID="b014396938706fd9de4e8b35b5ccfa8f461e7692e36984d8f01010f051e1cfc7" exitCode=0 Mar 16 15:59:36 crc kubenswrapper[5120]: I0316 15:59:36.911899 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-controller-ovs-wmmfv" event={"ID":"ab8ad82a-5c13-4d9e-bbae-548a51860f3c","Type":"ContainerDied","Data":"b014396938706fd9de4e8b35b5ccfa8f461e7692e36984d8f01010f051e1cfc7"} Mar 16 15:59:36 crc kubenswrapper[5120]: I0316 15:59:36.916308 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-controller-sh5s2" event={"ID":"b7909026-6951-43af-97ea-2783dc8739be","Type":"ContainerStarted","Data":"d5e55f8956b60ce26eb387326c6c3aa04eb46c292064d453f8ac9b1e811e2ae5"} Mar 16 15:59:36 crc kubenswrapper[5120]: I0316 15:59:36.917625 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ovn-controller-sh5s2" Mar 16 15:59:36 crc kubenswrapper[5120]: I0316 15:59:36.968535 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovn-controller-sh5s2" podStartSLOduration=2.62321236 podStartE2EDuration="3.968512849s" podCreationTimestamp="2026-03-16 15:59:33 +0000 UTC" firstStartedPulling="2026-03-16 15:59:34.301249988 +0000 UTC m=+1676.455181645" lastFinishedPulling="2026-03-16 15:59:35.646550477 +0000 UTC m=+1677.800482134" observedRunningTime="2026-03-16 15:59:36.967811429 +0000 UTC m=+1679.121743096" watchObservedRunningTime="2026-03-16 15:59:36.968512849 +0000 UTC m=+1679.122444516" Mar 16 15:59:37 crc kubenswrapper[5120]: I0316 15:59:37.928703 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-controller-ovs-wmmfv" event={"ID":"ab8ad82a-5c13-4d9e-bbae-548a51860f3c","Type":"ContainerStarted","Data":"60d59dba0a26cb5565debd8d07437189d473b73784a9546487b805a1faa67b1d"} Mar 16 15:59:37 crc kubenswrapper[5120]: I0316 15:59:37.929373 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ovn-controller-ovs-wmmfv" Mar 16 15:59:37 crc kubenswrapper[5120]: I0316 15:59:37.929393 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-controller-ovs-wmmfv" event={"ID":"ab8ad82a-5c13-4d9e-bbae-548a51860f3c","Type":"ContainerStarted","Data":"07f42a9b30dec55ea276347afe9aa990404c5b91295bba57ef470ca1b30032b7"} Mar 16 15:59:37 crc kubenswrapper[5120]: I0316 15:59:37.929408 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ovn-controller-ovs-wmmfv" Mar 16 15:59:37 crc kubenswrapper[5120]: I0316 15:59:37.968643 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovn-controller-ovs-wmmfv" podStartSLOduration=4.190604731 podStartE2EDuration="4.96862628s" podCreationTimestamp="2026-03-16 15:59:33 +0000 UTC" firstStartedPulling="2026-03-16 15:59:34.446242798 +0000 UTC m=+1676.600174455" lastFinishedPulling="2026-03-16 15:59:35.224264347 +0000 UTC m=+1677.378196004" observedRunningTime="2026-03-16 15:59:37.956689539 +0000 UTC m=+1680.110621196" watchObservedRunningTime="2026-03-16 15:59:37.96862628 +0000 UTC m=+1680.122557937" Mar 16 15:59:38 crc kubenswrapper[5120]: I0316 15:59:38.919970 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-controller-sh5s2"] Mar 16 15:59:38 crc kubenswrapper[5120]: I0316 15:59:38.927934 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-controller-ovs-wmmfv"] Mar 16 15:59:38 crc kubenswrapper[5120]: I0316 15:59:38.935601 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-controller-metrics-4x949"] Mar 16 15:59:38 crc kubenswrapper[5120]: I0316 15:59:38.935880 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovn-controller-metrics-4x949" podUID="72af703b-47ea-48cf-a221-59207e86758c" containerName="openstack-network-exporter" containerID="cri-o://34dd44c1619f504c4922a5cebaf5cca18c490f64c1434a284491b41a8f49b59a" gracePeriod=30 Mar 16 15:59:38 crc kubenswrapper[5120]: I0316 15:59:38.937218 5120 kubelet_pods.go:1019] "Unable to retrieve pull secret, the image pull may not succeed." pod="openstack-kuttl-tests/ovn-controller-sh5s2" secret="" err="secret \"ovncontroller-ovncontroller-dockercfg-ptwff\" not found" Mar 16 15:59:38 crc kubenswrapper[5120]: I0316 15:59:38.937658 5120 kubelet_pods.go:1019] "Unable to retrieve pull secret, the image pull may not succeed." pod="openstack-kuttl-tests/ovn-controller-ovs-wmmfv" secret="" err="secret \"ovncontroller-ovncontroller-dockercfg-ptwff\" not found" Mar 16 15:59:39 crc kubenswrapper[5120]: E0316 15:59:39.117833 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/ovncontroller-scripts: configmap "ovncontroller-scripts" not found Mar 16 15:59:39 crc kubenswrapper[5120]: E0316 15:59:39.117912 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ab8ad82a-5c13-4d9e-bbae-548a51860f3c-scripts podName:ab8ad82a-5c13-4d9e-bbae-548a51860f3c nodeName:}" failed. No retries permitted until 2026-03-16 15:59:39.617890866 +0000 UTC m=+1681.771822523 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "scripts" (UniqueName: "kubernetes.io/configmap/ab8ad82a-5c13-4d9e-bbae-548a51860f3c-scripts") pod "ovn-controller-ovs-wmmfv" (UID: "ab8ad82a-5c13-4d9e-bbae-548a51860f3c") : configmap "ovncontroller-scripts" not found Mar 16 15:59:39 crc kubenswrapper[5120]: E0316 15:59:39.117956 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/ovncontroller-scripts: configmap "ovncontroller-scripts" not found Mar 16 15:59:39 crc kubenswrapper[5120]: E0316 15:59:39.118028 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b7909026-6951-43af-97ea-2783dc8739be-scripts podName:b7909026-6951-43af-97ea-2783dc8739be nodeName:}" failed. No retries permitted until 2026-03-16 15:59:39.618008899 +0000 UTC m=+1681.771940546 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "scripts" (UniqueName: "kubernetes.io/configmap/b7909026-6951-43af-97ea-2783dc8739be-scripts") pod "ovn-controller-sh5s2" (UID: "b7909026-6951-43af-97ea-2783dc8739be") : configmap "ovncontroller-scripts" not found Mar 16 15:59:39 crc kubenswrapper[5120]: I0316 15:59:39.474096 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-controller-metrics-4x949_72af703b-47ea-48cf-a221-59207e86758c/openstack-network-exporter/0.log" Mar 16 15:59:39 crc kubenswrapper[5120]: I0316 15:59:39.474434 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-controller-metrics-4x949" Mar 16 15:59:39 crc kubenswrapper[5120]: I0316 15:59:39.628888 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/72af703b-47ea-48cf-a221-59207e86758c-metrics-certs-tls-certs\") pod \"72af703b-47ea-48cf-a221-59207e86758c\" (UID: \"72af703b-47ea-48cf-a221-59207e86758c\") " Mar 16 15:59:39 crc kubenswrapper[5120]: I0316 15:59:39.629113 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k727h\" (UniqueName: \"kubernetes.io/projected/72af703b-47ea-48cf-a221-59207e86758c-kube-api-access-k727h\") pod \"72af703b-47ea-48cf-a221-59207e86758c\" (UID: \"72af703b-47ea-48cf-a221-59207e86758c\") " Mar 16 15:59:39 crc kubenswrapper[5120]: I0316 15:59:39.629201 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/72af703b-47ea-48cf-a221-59207e86758c-config\") pod \"72af703b-47ea-48cf-a221-59207e86758c\" (UID: \"72af703b-47ea-48cf-a221-59207e86758c\") " Mar 16 15:59:39 crc kubenswrapper[5120]: I0316 15:59:39.629329 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/72af703b-47ea-48cf-a221-59207e86758c-combined-ca-bundle\") pod \"72af703b-47ea-48cf-a221-59207e86758c\" (UID: \"72af703b-47ea-48cf-a221-59207e86758c\") " Mar 16 15:59:39 crc kubenswrapper[5120]: I0316 15:59:39.629407 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/host-path/72af703b-47ea-48cf-a221-59207e86758c-ovn-rundir\") pod \"72af703b-47ea-48cf-a221-59207e86758c\" (UID: \"72af703b-47ea-48cf-a221-59207e86758c\") " Mar 16 15:59:39 crc kubenswrapper[5120]: I0316 15:59:39.629493 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovs-rundir\" (UniqueName: \"kubernetes.io/host-path/72af703b-47ea-48cf-a221-59207e86758c-ovs-rundir\") pod \"72af703b-47ea-48cf-a221-59207e86758c\" (UID: \"72af703b-47ea-48cf-a221-59207e86758c\") " Mar 16 15:59:39 crc kubenswrapper[5120]: E0316 15:59:39.630112 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/ovncontroller-scripts: configmap "ovncontroller-scripts" not found Mar 16 15:59:39 crc kubenswrapper[5120]: E0316 15:59:39.630186 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ab8ad82a-5c13-4d9e-bbae-548a51860f3c-scripts podName:ab8ad82a-5c13-4d9e-bbae-548a51860f3c nodeName:}" failed. No retries permitted until 2026-03-16 15:59:40.630167795 +0000 UTC m=+1682.784099472 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "scripts" (UniqueName: "kubernetes.io/configmap/ab8ad82a-5c13-4d9e-bbae-548a51860f3c-scripts") pod "ovn-controller-ovs-wmmfv" (UID: "ab8ad82a-5c13-4d9e-bbae-548a51860f3c") : configmap "ovncontroller-scripts" not found Mar 16 15:59:39 crc kubenswrapper[5120]: I0316 15:59:39.630657 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/72af703b-47ea-48cf-a221-59207e86758c-ovn-rundir" (OuterVolumeSpecName: "ovn-rundir") pod "72af703b-47ea-48cf-a221-59207e86758c" (UID: "72af703b-47ea-48cf-a221-59207e86758c"). InnerVolumeSpecName "ovn-rundir". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 15:59:39 crc kubenswrapper[5120]: I0316 15:59:39.630702 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/72af703b-47ea-48cf-a221-59207e86758c-ovs-rundir" (OuterVolumeSpecName: "ovs-rundir") pod "72af703b-47ea-48cf-a221-59207e86758c" (UID: "72af703b-47ea-48cf-a221-59207e86758c"). InnerVolumeSpecName "ovs-rundir". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 15:59:39 crc kubenswrapper[5120]: E0316 15:59:39.630751 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/ovncontroller-scripts: configmap "ovncontroller-scripts" not found Mar 16 15:59:39 crc kubenswrapper[5120]: E0316 15:59:39.630805 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b7909026-6951-43af-97ea-2783dc8739be-scripts podName:b7909026-6951-43af-97ea-2783dc8739be nodeName:}" failed. No retries permitted until 2026-03-16 15:59:40.630794062 +0000 UTC m=+1682.784725729 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "scripts" (UniqueName: "kubernetes.io/configmap/b7909026-6951-43af-97ea-2783dc8739be-scripts") pod "ovn-controller-sh5s2" (UID: "b7909026-6951-43af-97ea-2783dc8739be") : configmap "ovncontroller-scripts" not found Mar 16 15:59:39 crc kubenswrapper[5120]: I0316 15:59:39.631460 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/72af703b-47ea-48cf-a221-59207e86758c-config" (OuterVolumeSpecName: "config") pod "72af703b-47ea-48cf-a221-59207e86758c" (UID: "72af703b-47ea-48cf-a221-59207e86758c"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:59:39 crc kubenswrapper[5120]: I0316 15:59:39.640186 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72af703b-47ea-48cf-a221-59207e86758c-kube-api-access-k727h" (OuterVolumeSpecName: "kube-api-access-k727h") pod "72af703b-47ea-48cf-a221-59207e86758c" (UID: "72af703b-47ea-48cf-a221-59207e86758c"). InnerVolumeSpecName "kube-api-access-k727h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:59:39 crc kubenswrapper[5120]: I0316 15:59:39.667896 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/72af703b-47ea-48cf-a221-59207e86758c-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "72af703b-47ea-48cf-a221-59207e86758c" (UID: "72af703b-47ea-48cf-a221-59207e86758c"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:59:39 crc kubenswrapper[5120]: I0316 15:59:39.708387 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/72af703b-47ea-48cf-a221-59207e86758c-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "72af703b-47ea-48cf-a221-59207e86758c" (UID: "72af703b-47ea-48cf-a221-59207e86758c"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:59:39 crc kubenswrapper[5120]: I0316 15:59:39.734491 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/72af703b-47ea-48cf-a221-59207e86758c-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:59:39 crc kubenswrapper[5120]: I0316 15:59:39.734521 5120 reconciler_common.go:299] "Volume detached for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/host-path/72af703b-47ea-48cf-a221-59207e86758c-ovn-rundir\") on node \"crc\" DevicePath \"\"" Mar 16 15:59:39 crc kubenswrapper[5120]: I0316 15:59:39.734534 5120 reconciler_common.go:299] "Volume detached for volume \"ovs-rundir\" (UniqueName: \"kubernetes.io/host-path/72af703b-47ea-48cf-a221-59207e86758c-ovs-rundir\") on node \"crc\" DevicePath \"\"" Mar 16 15:59:39 crc kubenswrapper[5120]: I0316 15:59:39.734546 5120 reconciler_common.go:299] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/72af703b-47ea-48cf-a221-59207e86758c-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 15:59:39 crc kubenswrapper[5120]: I0316 15:59:39.734558 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k727h\" (UniqueName: \"kubernetes.io/projected/72af703b-47ea-48cf-a221-59207e86758c-kube-api-access-k727h\") on node \"crc\" DevicePath \"\"" Mar 16 15:59:39 crc kubenswrapper[5120]: I0316 15:59:39.734571 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/72af703b-47ea-48cf-a221-59207e86758c-config\") on node \"crc\" DevicePath \"\"" Mar 16 15:59:39 crc kubenswrapper[5120]: I0316 15:59:39.950035 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-controller-metrics-4x949_72af703b-47ea-48cf-a221-59207e86758c/openstack-network-exporter/0.log" Mar 16 15:59:39 crc kubenswrapper[5120]: I0316 15:59:39.950162 5120 generic.go:358] "Generic (PLEG): container finished" podID="72af703b-47ea-48cf-a221-59207e86758c" containerID="34dd44c1619f504c4922a5cebaf5cca18c490f64c1434a284491b41a8f49b59a" exitCode=2 Mar 16 15:59:39 crc kubenswrapper[5120]: I0316 15:59:39.950274 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-controller-metrics-4x949" event={"ID":"72af703b-47ea-48cf-a221-59207e86758c","Type":"ContainerDied","Data":"34dd44c1619f504c4922a5cebaf5cca18c490f64c1434a284491b41a8f49b59a"} Mar 16 15:59:39 crc kubenswrapper[5120]: I0316 15:59:39.950317 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-controller-metrics-4x949" Mar 16 15:59:39 crc kubenswrapper[5120]: I0316 15:59:39.950349 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-controller-metrics-4x949" event={"ID":"72af703b-47ea-48cf-a221-59207e86758c","Type":"ContainerDied","Data":"7f32cea0ac1d6d49a315917929d083a95811ecf7ef142c5693ec3d77acf03921"} Mar 16 15:59:39 crc kubenswrapper[5120]: I0316 15:59:39.950371 5120 scope.go:117] "RemoveContainer" containerID="34dd44c1619f504c4922a5cebaf5cca18c490f64c1434a284491b41a8f49b59a" Mar 16 15:59:39 crc kubenswrapper[5120]: I0316 15:59:39.993895 5120 scope.go:117] "RemoveContainer" containerID="34dd44c1619f504c4922a5cebaf5cca18c490f64c1434a284491b41a8f49b59a" Mar 16 15:59:39 crc kubenswrapper[5120]: E0316 15:59:39.995068 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"34dd44c1619f504c4922a5cebaf5cca18c490f64c1434a284491b41a8f49b59a\": container with ID starting with 34dd44c1619f504c4922a5cebaf5cca18c490f64c1434a284491b41a8f49b59a not found: ID does not exist" containerID="34dd44c1619f504c4922a5cebaf5cca18c490f64c1434a284491b41a8f49b59a" Mar 16 15:59:39 crc kubenswrapper[5120]: I0316 15:59:39.995129 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34dd44c1619f504c4922a5cebaf5cca18c490f64c1434a284491b41a8f49b59a"} err="failed to get container status \"34dd44c1619f504c4922a5cebaf5cca18c490f64c1434a284491b41a8f49b59a\": rpc error: code = NotFound desc = could not find container \"34dd44c1619f504c4922a5cebaf5cca18c490f64c1434a284491b41a8f49b59a\": container with ID starting with 34dd44c1619f504c4922a5cebaf5cca18c490f64c1434a284491b41a8f49b59a not found: ID does not exist" Mar 16 15:59:40 crc kubenswrapper[5120]: I0316 15:59:40.011830 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-controller-metrics-4x949"] Mar 16 15:59:40 crc kubenswrapper[5120]: I0316 15:59:40.021694 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovn-controller-metrics-4x949"] Mar 16 15:59:40 crc kubenswrapper[5120]: E0316 15:59:40.095715 5120 handlers.go:80] "Exec lifecycle hook for Container in Pod failed" err="command '/usr/share/ovn/scripts/ovn-ctl stop_controller' exited with 137: " execCommand=["/usr/share/ovn/scripts/ovn-ctl","stop_controller"] containerName="ovn-controller" pod="openstack-kuttl-tests/ovn-controller-sh5s2" message="Exiting ovn-controller (1) " Mar 16 15:59:40 crc kubenswrapper[5120]: E0316 15:59:40.095849 5120 kuberuntime_container.go:741] "PreStop hook failed" err="command '/usr/share/ovn/scripts/ovn-ctl stop_controller' exited with 137: " pod="openstack-kuttl-tests/ovn-controller-sh5s2" podUID="b7909026-6951-43af-97ea-2783dc8739be" containerName="ovn-controller" containerID="cri-o://d5e55f8956b60ce26eb387326c6c3aa04eb46c292064d453f8ac9b1e811e2ae5" Mar 16 15:59:40 crc kubenswrapper[5120]: I0316 15:59:40.095950 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovn-controller-sh5s2" podUID="b7909026-6951-43af-97ea-2783dc8739be" containerName="ovn-controller" containerID="cri-o://d5e55f8956b60ce26eb387326c6c3aa04eb46c292064d453f8ac9b1e811e2ae5" gracePeriod=30 Mar 16 15:59:40 crc kubenswrapper[5120]: I0316 15:59:40.326378 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovn-controller-ovs-wmmfv" podUID="ab8ad82a-5c13-4d9e-bbae-548a51860f3c" containerName="ovs-vswitchd" containerID="cri-o://60d59dba0a26cb5565debd8d07437189d473b73784a9546487b805a1faa67b1d" gracePeriod=30 Mar 16 15:59:40 crc kubenswrapper[5120]: I0316 15:59:40.502810 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-controller-sh5s2" Mar 16 15:59:40 crc kubenswrapper[5120]: I0316 15:59:40.552490 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/b7909026-6951-43af-97ea-2783dc8739be-scripts\") pod \"b7909026-6951-43af-97ea-2783dc8739be\" (UID: \"b7909026-6951-43af-97ea-2783dc8739be\") " Mar 16 15:59:40 crc kubenswrapper[5120]: I0316 15:59:40.552557 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"var-log-ovn\" (UniqueName: \"kubernetes.io/host-path/b7909026-6951-43af-97ea-2783dc8739be-var-log-ovn\") pod \"b7909026-6951-43af-97ea-2783dc8739be\" (UID: \"b7909026-6951-43af-97ea-2783dc8739be\") " Mar 16 15:59:40 crc kubenswrapper[5120]: I0316 15:59:40.552716 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"var-run-ovn\" (UniqueName: \"kubernetes.io/host-path/b7909026-6951-43af-97ea-2783dc8739be-var-run-ovn\") pod \"b7909026-6951-43af-97ea-2783dc8739be\" (UID: \"b7909026-6951-43af-97ea-2783dc8739be\") " Mar 16 15:59:40 crc kubenswrapper[5120]: I0316 15:59:40.552811 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovn-controller-tls-certs\" (UniqueName: \"kubernetes.io/secret/b7909026-6951-43af-97ea-2783dc8739be-ovn-controller-tls-certs\") pod \"b7909026-6951-43af-97ea-2783dc8739be\" (UID: \"b7909026-6951-43af-97ea-2783dc8739be\") " Mar 16 15:59:40 crc kubenswrapper[5120]: I0316 15:59:40.552839 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"var-run\" (UniqueName: \"kubernetes.io/host-path/b7909026-6951-43af-97ea-2783dc8739be-var-run\") pod \"b7909026-6951-43af-97ea-2783dc8739be\" (UID: \"b7909026-6951-43af-97ea-2783dc8739be\") " Mar 16 15:59:40 crc kubenswrapper[5120]: I0316 15:59:40.552885 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b7909026-6951-43af-97ea-2783dc8739be-combined-ca-bundle\") pod \"b7909026-6951-43af-97ea-2783dc8739be\" (UID: \"b7909026-6951-43af-97ea-2783dc8739be\") " Mar 16 15:59:40 crc kubenswrapper[5120]: I0316 15:59:40.552919 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qbm98\" (UniqueName: \"kubernetes.io/projected/b7909026-6951-43af-97ea-2783dc8739be-kube-api-access-qbm98\") pod \"b7909026-6951-43af-97ea-2783dc8739be\" (UID: \"b7909026-6951-43af-97ea-2783dc8739be\") " Mar 16 15:59:40 crc kubenswrapper[5120]: I0316 15:59:40.553681 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b7909026-6951-43af-97ea-2783dc8739be-scripts" (OuterVolumeSpecName: "scripts") pod "b7909026-6951-43af-97ea-2783dc8739be" (UID: "b7909026-6951-43af-97ea-2783dc8739be"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 15:59:40 crc kubenswrapper[5120]: I0316 15:59:40.554382 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/b7909026-6951-43af-97ea-2783dc8739be-var-run" (OuterVolumeSpecName: "var-run") pod "b7909026-6951-43af-97ea-2783dc8739be" (UID: "b7909026-6951-43af-97ea-2783dc8739be"). InnerVolumeSpecName "var-run". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 15:59:40 crc kubenswrapper[5120]: I0316 15:59:40.554446 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/b7909026-6951-43af-97ea-2783dc8739be-var-log-ovn" (OuterVolumeSpecName: "var-log-ovn") pod "b7909026-6951-43af-97ea-2783dc8739be" (UID: "b7909026-6951-43af-97ea-2783dc8739be"). InnerVolumeSpecName "var-log-ovn". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 15:59:40 crc kubenswrapper[5120]: I0316 15:59:40.554484 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/b7909026-6951-43af-97ea-2783dc8739be-var-run-ovn" (OuterVolumeSpecName: "var-run-ovn") pod "b7909026-6951-43af-97ea-2783dc8739be" (UID: "b7909026-6951-43af-97ea-2783dc8739be"). InnerVolumeSpecName "var-run-ovn". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 15:59:40 crc kubenswrapper[5120]: I0316 15:59:40.559555 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7909026-6951-43af-97ea-2783dc8739be-kube-api-access-qbm98" (OuterVolumeSpecName: "kube-api-access-qbm98") pod "b7909026-6951-43af-97ea-2783dc8739be" (UID: "b7909026-6951-43af-97ea-2783dc8739be"). InnerVolumeSpecName "kube-api-access-qbm98". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 15:59:40 crc kubenswrapper[5120]: I0316 15:59:40.586021 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b7909026-6951-43af-97ea-2783dc8739be-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "b7909026-6951-43af-97ea-2783dc8739be" (UID: "b7909026-6951-43af-97ea-2783dc8739be"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:59:40 crc kubenswrapper[5120]: E0316 15:59:40.610903 5120 handlers.go:80] "Exec lifecycle hook for Container in Pod failed" err=< Mar 16 15:59:40 crc kubenswrapper[5120]: command '/usr/local/bin/container-scripts/stop-ovsdb-server.sh' exited with 137: ++ dirname /usr/local/bin/container-scripts/stop-ovsdb-server.sh Mar 16 15:59:40 crc kubenswrapper[5120]: + source /usr/local/bin/container-scripts/functions Mar 16 15:59:40 crc kubenswrapper[5120]: ++ OVNBridge=br-int Mar 16 15:59:40 crc kubenswrapper[5120]: ++ OVNRemote=tcp:localhost:6642 Mar 16 15:59:40 crc kubenswrapper[5120]: ++ OVNEncapType=geneve Mar 16 15:59:40 crc kubenswrapper[5120]: ++ OVNAvailabilityZones= Mar 16 15:59:40 crc kubenswrapper[5120]: ++ EnableChassisAsGateway=true Mar 16 15:59:40 crc kubenswrapper[5120]: ++ PhysicalNetworks= Mar 16 15:59:40 crc kubenswrapper[5120]: ++ OVNHostName= Mar 16 15:59:40 crc kubenswrapper[5120]: ++ DB_FILE=/etc/openvswitch/conf.db Mar 16 15:59:40 crc kubenswrapper[5120]: ++ ovs_dir=/var/lib/openvswitch Mar 16 15:59:40 crc kubenswrapper[5120]: ++ FLOWS_RESTORE_SCRIPT=/var/lib/openvswitch/flows-script Mar 16 15:59:40 crc kubenswrapper[5120]: ++ FLOWS_RESTORE_DIR=/var/lib/openvswitch/saved-flows Mar 16 15:59:40 crc kubenswrapper[5120]: ++ SAFE_TO_STOP_OVSDB_SERVER_SEMAPHORE=/var/lib/openvswitch/is_safe_to_stop_ovsdb_server Mar 16 15:59:40 crc kubenswrapper[5120]: + '[' '!' -f /var/lib/openvswitch/is_safe_to_stop_ovsdb_server ']' Mar 16 15:59:40 crc kubenswrapper[5120]: + sleep 0.5 Mar 16 15:59:40 crc kubenswrapper[5120]: + '[' '!' -f /var/lib/openvswitch/is_safe_to_stop_ovsdb_server ']' Mar 16 15:59:40 crc kubenswrapper[5120]: + cleanup_ovsdb_server_semaphore Mar 16 15:59:40 crc kubenswrapper[5120]: + rm -f /var/lib/openvswitch/is_safe_to_stop_ovsdb_server Mar 16 15:59:40 crc kubenswrapper[5120]: + /usr/share/openvswitch/scripts/ovs-ctl stop --no-ovs-vswitchd Mar 16 15:59:40 crc kubenswrapper[5120]: > execCommand=["/usr/local/bin/container-scripts/stop-ovsdb-server.sh"] containerName="ovsdb-server" pod="openstack-kuttl-tests/ovn-controller-ovs-wmmfv" message=< Mar 16 15:59:40 crc kubenswrapper[5120]: Exiting ovsdb-server (5) [ OK ] Mar 16 15:59:40 crc kubenswrapper[5120]: ++ dirname /usr/local/bin/container-scripts/stop-ovsdb-server.sh Mar 16 15:59:40 crc kubenswrapper[5120]: + source /usr/local/bin/container-scripts/functions Mar 16 15:59:40 crc kubenswrapper[5120]: ++ OVNBridge=br-int Mar 16 15:59:40 crc kubenswrapper[5120]: ++ OVNRemote=tcp:localhost:6642 Mar 16 15:59:40 crc kubenswrapper[5120]: ++ OVNEncapType=geneve Mar 16 15:59:40 crc kubenswrapper[5120]: ++ OVNAvailabilityZones= Mar 16 15:59:40 crc kubenswrapper[5120]: ++ EnableChassisAsGateway=true Mar 16 15:59:40 crc kubenswrapper[5120]: ++ PhysicalNetworks= Mar 16 15:59:40 crc kubenswrapper[5120]: ++ OVNHostName= Mar 16 15:59:40 crc kubenswrapper[5120]: ++ DB_FILE=/etc/openvswitch/conf.db Mar 16 15:59:40 crc kubenswrapper[5120]: ++ ovs_dir=/var/lib/openvswitch Mar 16 15:59:40 crc kubenswrapper[5120]: ++ FLOWS_RESTORE_SCRIPT=/var/lib/openvswitch/flows-script Mar 16 15:59:40 crc kubenswrapper[5120]: ++ FLOWS_RESTORE_DIR=/var/lib/openvswitch/saved-flows Mar 16 15:59:40 crc kubenswrapper[5120]: ++ SAFE_TO_STOP_OVSDB_SERVER_SEMAPHORE=/var/lib/openvswitch/is_safe_to_stop_ovsdb_server Mar 16 15:59:40 crc kubenswrapper[5120]: + '[' '!' -f /var/lib/openvswitch/is_safe_to_stop_ovsdb_server ']' Mar 16 15:59:40 crc kubenswrapper[5120]: + sleep 0.5 Mar 16 15:59:40 crc kubenswrapper[5120]: + '[' '!' -f /var/lib/openvswitch/is_safe_to_stop_ovsdb_server ']' Mar 16 15:59:40 crc kubenswrapper[5120]: + cleanup_ovsdb_server_semaphore Mar 16 15:59:40 crc kubenswrapper[5120]: + rm -f /var/lib/openvswitch/is_safe_to_stop_ovsdb_server Mar 16 15:59:40 crc kubenswrapper[5120]: + /usr/share/openvswitch/scripts/ovs-ctl stop --no-ovs-vswitchd Mar 16 15:59:40 crc kubenswrapper[5120]: > Mar 16 15:59:40 crc kubenswrapper[5120]: E0316 15:59:40.610964 5120 kuberuntime_container.go:741] "PreStop hook failed" err=< Mar 16 15:59:40 crc kubenswrapper[5120]: command '/usr/local/bin/container-scripts/stop-ovsdb-server.sh' exited with 137: ++ dirname /usr/local/bin/container-scripts/stop-ovsdb-server.sh Mar 16 15:59:40 crc kubenswrapper[5120]: + source /usr/local/bin/container-scripts/functions Mar 16 15:59:40 crc kubenswrapper[5120]: ++ OVNBridge=br-int Mar 16 15:59:40 crc kubenswrapper[5120]: ++ OVNRemote=tcp:localhost:6642 Mar 16 15:59:40 crc kubenswrapper[5120]: ++ OVNEncapType=geneve Mar 16 15:59:40 crc kubenswrapper[5120]: ++ OVNAvailabilityZones= Mar 16 15:59:40 crc kubenswrapper[5120]: ++ EnableChassisAsGateway=true Mar 16 15:59:40 crc kubenswrapper[5120]: ++ PhysicalNetworks= Mar 16 15:59:40 crc kubenswrapper[5120]: ++ OVNHostName= Mar 16 15:59:40 crc kubenswrapper[5120]: ++ DB_FILE=/etc/openvswitch/conf.db Mar 16 15:59:40 crc kubenswrapper[5120]: ++ ovs_dir=/var/lib/openvswitch Mar 16 15:59:40 crc kubenswrapper[5120]: ++ FLOWS_RESTORE_SCRIPT=/var/lib/openvswitch/flows-script Mar 16 15:59:40 crc kubenswrapper[5120]: ++ FLOWS_RESTORE_DIR=/var/lib/openvswitch/saved-flows Mar 16 15:59:40 crc kubenswrapper[5120]: ++ SAFE_TO_STOP_OVSDB_SERVER_SEMAPHORE=/var/lib/openvswitch/is_safe_to_stop_ovsdb_server Mar 16 15:59:40 crc kubenswrapper[5120]: + '[' '!' -f /var/lib/openvswitch/is_safe_to_stop_ovsdb_server ']' Mar 16 15:59:40 crc kubenswrapper[5120]: + sleep 0.5 Mar 16 15:59:40 crc kubenswrapper[5120]: + '[' '!' -f /var/lib/openvswitch/is_safe_to_stop_ovsdb_server ']' Mar 16 15:59:40 crc kubenswrapper[5120]: + cleanup_ovsdb_server_semaphore Mar 16 15:59:40 crc kubenswrapper[5120]: + rm -f /var/lib/openvswitch/is_safe_to_stop_ovsdb_server Mar 16 15:59:40 crc kubenswrapper[5120]: + /usr/share/openvswitch/scripts/ovs-ctl stop --no-ovs-vswitchd Mar 16 15:59:40 crc kubenswrapper[5120]: > pod="openstack-kuttl-tests/ovn-controller-ovs-wmmfv" podUID="ab8ad82a-5c13-4d9e-bbae-548a51860f3c" containerName="ovsdb-server" containerID="cri-o://07f42a9b30dec55ea276347afe9aa990404c5b91295bba57ef470ca1b30032b7" Mar 16 15:59:40 crc kubenswrapper[5120]: I0316 15:59:40.611020 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovn-controller-ovs-wmmfv" podUID="ab8ad82a-5c13-4d9e-bbae-548a51860f3c" containerName="ovsdb-server" containerID="cri-o://07f42a9b30dec55ea276347afe9aa990404c5b91295bba57ef470ca1b30032b7" gracePeriod=30 Mar 16 15:59:40 crc kubenswrapper[5120]: E0316 15:59:40.655108 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/ovncontroller-scripts: configmap "ovncontroller-scripts" not found Mar 16 15:59:40 crc kubenswrapper[5120]: E0316 15:59:40.655201 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ab8ad82a-5c13-4d9e-bbae-548a51860f3c-scripts podName:ab8ad82a-5c13-4d9e-bbae-548a51860f3c nodeName:}" failed. No retries permitted until 2026-03-16 15:59:42.655181265 +0000 UTC m=+1684.809112922 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "scripts" (UniqueName: "kubernetes.io/configmap/ab8ad82a-5c13-4d9e-bbae-548a51860f3c-scripts") pod "ovn-controller-ovs-wmmfv" (UID: "ab8ad82a-5c13-4d9e-bbae-548a51860f3c") : configmap "ovncontroller-scripts" not found Mar 16 15:59:40 crc kubenswrapper[5120]: I0316 15:59:40.655134 5120 reconciler_common.go:299] "Volume detached for volume \"var-run-ovn\" (UniqueName: \"kubernetes.io/host-path/b7909026-6951-43af-97ea-2783dc8739be-var-run-ovn\") on node \"crc\" DevicePath \"\"" Mar 16 15:59:40 crc kubenswrapper[5120]: I0316 15:59:40.655476 5120 reconciler_common.go:299] "Volume detached for volume \"var-run\" (UniqueName: \"kubernetes.io/host-path/b7909026-6951-43af-97ea-2783dc8739be-var-run\") on node \"crc\" DevicePath \"\"" Mar 16 15:59:40 crc kubenswrapper[5120]: I0316 15:59:40.655548 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b7909026-6951-43af-97ea-2783dc8739be-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 15:59:40 crc kubenswrapper[5120]: I0316 15:59:40.655606 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qbm98\" (UniqueName: \"kubernetes.io/projected/b7909026-6951-43af-97ea-2783dc8739be-kube-api-access-qbm98\") on node \"crc\" DevicePath \"\"" Mar 16 15:59:40 crc kubenswrapper[5120]: I0316 15:59:40.655666 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/b7909026-6951-43af-97ea-2783dc8739be-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 15:59:40 crc kubenswrapper[5120]: I0316 15:59:40.655731 5120 reconciler_common.go:299] "Volume detached for volume \"var-log-ovn\" (UniqueName: \"kubernetes.io/host-path/b7909026-6951-43af-97ea-2783dc8739be-var-log-ovn\") on node \"crc\" DevicePath \"\"" Mar 16 15:59:40 crc kubenswrapper[5120]: I0316 15:59:40.659999 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b7909026-6951-43af-97ea-2783dc8739be-ovn-controller-tls-certs" (OuterVolumeSpecName: "ovn-controller-tls-certs") pod "b7909026-6951-43af-97ea-2783dc8739be" (UID: "b7909026-6951-43af-97ea-2783dc8739be"). InnerVolumeSpecName "ovn-controller-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 15:59:40 crc kubenswrapper[5120]: I0316 15:59:40.673406 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="72af703b-47ea-48cf-a221-59207e86758c" path="/var/lib/kubelet/pods/72af703b-47ea-48cf-a221-59207e86758c/volumes" Mar 16 15:59:40 crc kubenswrapper[5120]: I0316 15:59:40.757168 5120 reconciler_common.go:299] "Volume detached for volume \"ovn-controller-tls-certs\" (UniqueName: \"kubernetes.io/secret/b7909026-6951-43af-97ea-2783dc8739be-ovn-controller-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 15:59:40 crc kubenswrapper[5120]: I0316 15:59:40.964423 5120 generic.go:358] "Generic (PLEG): container finished" podID="b7909026-6951-43af-97ea-2783dc8739be" containerID="d5e55f8956b60ce26eb387326c6c3aa04eb46c292064d453f8ac9b1e811e2ae5" exitCode=0 Mar 16 15:59:40 crc kubenswrapper[5120]: I0316 15:59:40.964509 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-controller-sh5s2" Mar 16 15:59:40 crc kubenswrapper[5120]: I0316 15:59:40.964531 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-controller-sh5s2" event={"ID":"b7909026-6951-43af-97ea-2783dc8739be","Type":"ContainerDied","Data":"d5e55f8956b60ce26eb387326c6c3aa04eb46c292064d453f8ac9b1e811e2ae5"} Mar 16 15:59:40 crc kubenswrapper[5120]: I0316 15:59:40.964580 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-controller-sh5s2" event={"ID":"b7909026-6951-43af-97ea-2783dc8739be","Type":"ContainerDied","Data":"dbf3bee41b5a1b06da262881d150efebf93d8fdcaded4549f2b90ce35a22d3b9"} Mar 16 15:59:40 crc kubenswrapper[5120]: I0316 15:59:40.964617 5120 scope.go:117] "RemoveContainer" containerID="d5e55f8956b60ce26eb387326c6c3aa04eb46c292064d453f8ac9b1e811e2ae5" Mar 16 15:59:40 crc kubenswrapper[5120]: I0316 15:59:40.974396 5120 generic.go:358] "Generic (PLEG): container finished" podID="ab8ad82a-5c13-4d9e-bbae-548a51860f3c" containerID="07f42a9b30dec55ea276347afe9aa990404c5b91295bba57ef470ca1b30032b7" exitCode=0 Mar 16 15:59:40 crc kubenswrapper[5120]: I0316 15:59:40.974494 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-controller-ovs-wmmfv" event={"ID":"ab8ad82a-5c13-4d9e-bbae-548a51860f3c","Type":"ContainerDied","Data":"07f42a9b30dec55ea276347afe9aa990404c5b91295bba57ef470ca1b30032b7"} Mar 16 15:59:40 crc kubenswrapper[5120]: I0316 15:59:40.988691 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-controller-sh5s2"] Mar 16 15:59:40 crc kubenswrapper[5120]: I0316 15:59:40.995748 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovn-controller-sh5s2"] Mar 16 15:59:41 crc kubenswrapper[5120]: I0316 15:59:41.016601 5120 scope.go:117] "RemoveContainer" containerID="d5e55f8956b60ce26eb387326c6c3aa04eb46c292064d453f8ac9b1e811e2ae5" Mar 16 15:59:41 crc kubenswrapper[5120]: E0316 15:59:41.017279 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d5e55f8956b60ce26eb387326c6c3aa04eb46c292064d453f8ac9b1e811e2ae5\": container with ID starting with d5e55f8956b60ce26eb387326c6c3aa04eb46c292064d453f8ac9b1e811e2ae5 not found: ID does not exist" containerID="d5e55f8956b60ce26eb387326c6c3aa04eb46c292064d453f8ac9b1e811e2ae5" Mar 16 15:59:41 crc kubenswrapper[5120]: I0316 15:59:41.017324 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5e55f8956b60ce26eb387326c6c3aa04eb46c292064d453f8ac9b1e811e2ae5"} err="failed to get container status \"d5e55f8956b60ce26eb387326c6c3aa04eb46c292064d453f8ac9b1e811e2ae5\": rpc error: code = NotFound desc = could not find container \"d5e55f8956b60ce26eb387326c6c3aa04eb46c292064d453f8ac9b1e811e2ae5\": container with ID starting with d5e55f8956b60ce26eb387326c6c3aa04eb46c292064d453f8ac9b1e811e2ae5 not found: ID does not exist" Mar 16 15:59:42 crc kubenswrapper[5120]: I0316 15:59:42.676938 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b7909026-6951-43af-97ea-2783dc8739be" path="/var/lib/kubelet/pods/b7909026-6951-43af-97ea-2783dc8739be/volumes" Mar 16 15:59:42 crc kubenswrapper[5120]: E0316 15:59:42.717585 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/ovncontroller-scripts: configmap "ovncontroller-scripts" not found Mar 16 15:59:42 crc kubenswrapper[5120]: E0316 15:59:42.717661 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ab8ad82a-5c13-4d9e-bbae-548a51860f3c-scripts podName:ab8ad82a-5c13-4d9e-bbae-548a51860f3c nodeName:}" failed. No retries permitted until 2026-03-16 15:59:46.717642738 +0000 UTC m=+1688.871574395 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "scripts" (UniqueName: "kubernetes.io/configmap/ab8ad82a-5c13-4d9e-bbae-548a51860f3c-scripts") pod "ovn-controller-ovs-wmmfv" (UID: "ab8ad82a-5c13-4d9e-bbae-548a51860f3c") : configmap "ovncontroller-scripts" not found Mar 16 15:59:43 crc kubenswrapper[5120]: I0316 15:59:43.664429 5120 scope.go:117] "RemoveContainer" containerID="02ba4fc3f84eccaecfa9e6618280f65626eb76580c4af9ae7a9d7cb3b8dd590b" Mar 16 15:59:43 crc kubenswrapper[5120]: E0316 15:59:43.664634 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 15:59:46 crc kubenswrapper[5120]: E0316 15:59:46.749989 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/ovncontroller-scripts: configmap "ovncontroller-scripts" not found Mar 16 15:59:46 crc kubenswrapper[5120]: E0316 15:59:46.750441 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ab8ad82a-5c13-4d9e-bbae-548a51860f3c-scripts podName:ab8ad82a-5c13-4d9e-bbae-548a51860f3c nodeName:}" failed. No retries permitted until 2026-03-16 15:59:54.750409196 +0000 UTC m=+1696.904340893 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "scripts" (UniqueName: "kubernetes.io/configmap/ab8ad82a-5c13-4d9e-bbae-548a51860f3c-scripts") pod "ovn-controller-ovs-wmmfv" (UID: "ab8ad82a-5c13-4d9e-bbae-548a51860f3c") : configmap "ovncontroller-scripts" not found Mar 16 15:59:47 crc kubenswrapper[5120]: I0316 15:59:47.927510 5120 scope.go:117] "RemoveContainer" containerID="5c27deb51925eebcbc197def4aa61ef6d9334fadb9af36744bc13cd32f16e353" Mar 16 15:59:47 crc kubenswrapper[5120]: I0316 15:59:47.949901 5120 scope.go:117] "RemoveContainer" containerID="960a8598b16a294e272eac94b9f4e5d72aa2390affa2adf49235bad7731bf776" Mar 16 15:59:54 crc kubenswrapper[5120]: E0316 15:59:54.813594 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/ovncontroller-scripts: configmap "ovncontroller-scripts" not found Mar 16 15:59:54 crc kubenswrapper[5120]: E0316 15:59:54.814611 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ab8ad82a-5c13-4d9e-bbae-548a51860f3c-scripts podName:ab8ad82a-5c13-4d9e-bbae-548a51860f3c nodeName:}" failed. No retries permitted until 2026-03-16 16:00:10.814559354 +0000 UTC m=+1712.968491051 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "scripts" (UniqueName: "kubernetes.io/configmap/ab8ad82a-5c13-4d9e-bbae-548a51860f3c-scripts") pod "ovn-controller-ovs-wmmfv" (UID: "ab8ad82a-5c13-4d9e-bbae-548a51860f3c") : configmap "ovncontroller-scripts" not found Mar 16 15:59:55 crc kubenswrapper[5120]: I0316 15:59:55.663469 5120 scope.go:117] "RemoveContainer" containerID="02ba4fc3f84eccaecfa9e6618280f65626eb76580c4af9ae7a9d7cb3b8dd590b" Mar 16 15:59:55 crc kubenswrapper[5120]: E0316 15:59:55.663898 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:00:00 crc kubenswrapper[5120]: I0316 16:00:00.153197 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-infra/auto-csr-approver-29561280-2xg8d"] Mar 16 16:00:00 crc kubenswrapper[5120]: I0316 16:00:00.157347 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7909026-6951-43af-97ea-2783dc8739be" containerName="ovn-controller" Mar 16 16:00:00 crc kubenswrapper[5120]: I0316 16:00:00.157393 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7909026-6951-43af-97ea-2783dc8739be" containerName="ovn-controller" Mar 16 16:00:00 crc kubenswrapper[5120]: I0316 16:00:00.157422 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72af703b-47ea-48cf-a221-59207e86758c" containerName="openstack-network-exporter" Mar 16 16:00:00 crc kubenswrapper[5120]: I0316 16:00:00.157437 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="72af703b-47ea-48cf-a221-59207e86758c" containerName="openstack-network-exporter" Mar 16 16:00:00 crc kubenswrapper[5120]: I0316 16:00:00.157838 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="b7909026-6951-43af-97ea-2783dc8739be" containerName="ovn-controller" Mar 16 16:00:00 crc kubenswrapper[5120]: I0316 16:00:00.157873 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="72af703b-47ea-48cf-a221-59207e86758c" containerName="openstack-network-exporter" Mar 16 16:00:00 crc kubenswrapper[5120]: I0316 16:00:00.168671 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561280-2xg8d" Mar 16 16:00:00 crc kubenswrapper[5120]: I0316 16:00:00.170821 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29561280-pdw98"] Mar 16 16:00:00 crc kubenswrapper[5120]: I0316 16:00:00.172214 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-infra\"/\"csr-approver-sa-dockercfg-x2nsz\"" Mar 16 16:00:00 crc kubenswrapper[5120]: I0316 16:00:00.175931 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"openshift-service-ca.crt\"" Mar 16 16:00:00 crc kubenswrapper[5120]: I0316 16:00:00.175978 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"kube-root-ca.crt\"" Mar 16 16:00:00 crc kubenswrapper[5120]: I0316 16:00:00.183682 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29561280-pdw98" Mar 16 16:00:00 crc kubenswrapper[5120]: I0316 16:00:00.186259 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operator-lifecycle-manager\"/\"collect-profiles-dockercfg-vfqp6\"" Mar 16 16:00:00 crc kubenswrapper[5120]: I0316 16:00:00.188491 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561280-2xg8d"] Mar 16 16:00:00 crc kubenswrapper[5120]: I0316 16:00:00.189834 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operator-lifecycle-manager\"/\"collect-profiles-config\"" Mar 16 16:00:00 crc kubenswrapper[5120]: I0316 16:00:00.201047 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29561280-pdw98"] Mar 16 16:00:00 crc kubenswrapper[5120]: I0316 16:00:00.235619 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-576t9\" (UniqueName: \"kubernetes.io/projected/2faaeef7-818d-47ee-9a1f-05de5d494195-kube-api-access-576t9\") pod \"auto-csr-approver-29561280-2xg8d\" (UID: \"2faaeef7-818d-47ee-9a1f-05de5d494195\") " pod="openshift-infra/auto-csr-approver-29561280-2xg8d" Mar 16 16:00:00 crc kubenswrapper[5120]: I0316 16:00:00.235949 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvnmv\" (UniqueName: \"kubernetes.io/projected/552c5ec7-fe70-4bc3-bd6f-b06e529244e8-kube-api-access-cvnmv\") pod \"collect-profiles-29561280-pdw98\" (UID: \"552c5ec7-fe70-4bc3-bd6f-b06e529244e8\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561280-pdw98" Mar 16 16:00:00 crc kubenswrapper[5120]: I0316 16:00:00.236342 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/552c5ec7-fe70-4bc3-bd6f-b06e529244e8-config-volume\") pod \"collect-profiles-29561280-pdw98\" (UID: \"552c5ec7-fe70-4bc3-bd6f-b06e529244e8\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561280-pdw98" Mar 16 16:00:00 crc kubenswrapper[5120]: I0316 16:00:00.236405 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/552c5ec7-fe70-4bc3-bd6f-b06e529244e8-secret-volume\") pod \"collect-profiles-29561280-pdw98\" (UID: \"552c5ec7-fe70-4bc3-bd6f-b06e529244e8\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561280-pdw98" Mar 16 16:00:00 crc kubenswrapper[5120]: I0316 16:00:00.338690 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cvnmv\" (UniqueName: \"kubernetes.io/projected/552c5ec7-fe70-4bc3-bd6f-b06e529244e8-kube-api-access-cvnmv\") pod \"collect-profiles-29561280-pdw98\" (UID: \"552c5ec7-fe70-4bc3-bd6f-b06e529244e8\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561280-pdw98" Mar 16 16:00:00 crc kubenswrapper[5120]: I0316 16:00:00.338798 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/552c5ec7-fe70-4bc3-bd6f-b06e529244e8-config-volume\") pod \"collect-profiles-29561280-pdw98\" (UID: \"552c5ec7-fe70-4bc3-bd6f-b06e529244e8\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561280-pdw98" Mar 16 16:00:00 crc kubenswrapper[5120]: I0316 16:00:00.338821 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/552c5ec7-fe70-4bc3-bd6f-b06e529244e8-secret-volume\") pod \"collect-profiles-29561280-pdw98\" (UID: \"552c5ec7-fe70-4bc3-bd6f-b06e529244e8\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561280-pdw98" Mar 16 16:00:00 crc kubenswrapper[5120]: I0316 16:00:00.338959 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-576t9\" (UniqueName: \"kubernetes.io/projected/2faaeef7-818d-47ee-9a1f-05de5d494195-kube-api-access-576t9\") pod \"auto-csr-approver-29561280-2xg8d\" (UID: \"2faaeef7-818d-47ee-9a1f-05de5d494195\") " pod="openshift-infra/auto-csr-approver-29561280-2xg8d" Mar 16 16:00:00 crc kubenswrapper[5120]: I0316 16:00:00.340420 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/552c5ec7-fe70-4bc3-bd6f-b06e529244e8-config-volume\") pod \"collect-profiles-29561280-pdw98\" (UID: \"552c5ec7-fe70-4bc3-bd6f-b06e529244e8\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561280-pdw98" Mar 16 16:00:00 crc kubenswrapper[5120]: I0316 16:00:00.352803 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/552c5ec7-fe70-4bc3-bd6f-b06e529244e8-secret-volume\") pod \"collect-profiles-29561280-pdw98\" (UID: \"552c5ec7-fe70-4bc3-bd6f-b06e529244e8\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561280-pdw98" Mar 16 16:00:00 crc kubenswrapper[5120]: I0316 16:00:00.358636 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvnmv\" (UniqueName: \"kubernetes.io/projected/552c5ec7-fe70-4bc3-bd6f-b06e529244e8-kube-api-access-cvnmv\") pod \"collect-profiles-29561280-pdw98\" (UID: \"552c5ec7-fe70-4bc3-bd6f-b06e529244e8\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561280-pdw98" Mar 16 16:00:00 crc kubenswrapper[5120]: I0316 16:00:00.360128 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-576t9\" (UniqueName: \"kubernetes.io/projected/2faaeef7-818d-47ee-9a1f-05de5d494195-kube-api-access-576t9\") pod \"auto-csr-approver-29561280-2xg8d\" (UID: \"2faaeef7-818d-47ee-9a1f-05de5d494195\") " pod="openshift-infra/auto-csr-approver-29561280-2xg8d" Mar 16 16:00:00 crc kubenswrapper[5120]: I0316 16:00:00.509085 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561280-2xg8d" Mar 16 16:00:00 crc kubenswrapper[5120]: I0316 16:00:00.520119 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29561280-pdw98" Mar 16 16:00:00 crc kubenswrapper[5120]: I0316 16:00:00.983057 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561280-2xg8d"] Mar 16 16:00:01 crc kubenswrapper[5120]: I0316 16:00:01.079717 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29561280-pdw98"] Mar 16 16:00:01 crc kubenswrapper[5120]: W0316 16:00:01.080192 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod552c5ec7_fe70_4bc3_bd6f_b06e529244e8.slice/crio-aa9f6d1c6bead4354c29cbbfeb080e9294644a12a6dc747ccce584e56fabf494 WatchSource:0}: Error finding container aa9f6d1c6bead4354c29cbbfeb080e9294644a12a6dc747ccce584e56fabf494: Status 404 returned error can't find the container with id aa9f6d1c6bead4354c29cbbfeb080e9294644a12a6dc747ccce584e56fabf494 Mar 16 16:00:01 crc kubenswrapper[5120]: I0316 16:00:01.216140 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561280-2xg8d" event={"ID":"2faaeef7-818d-47ee-9a1f-05de5d494195","Type":"ContainerStarted","Data":"a8e0eeffd96eafc170a60c32f33f7aa9f28dbcf1559321b019fa3fbc4a6b2d7e"} Mar 16 16:00:01 crc kubenswrapper[5120]: I0316 16:00:01.218885 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/collect-profiles-29561280-pdw98" event={"ID":"552c5ec7-fe70-4bc3-bd6f-b06e529244e8","Type":"ContainerStarted","Data":"aa9f6d1c6bead4354c29cbbfeb080e9294644a12a6dc747ccce584e56fabf494"} Mar 16 16:00:02 crc kubenswrapper[5120]: I0316 16:00:02.232435 5120 generic.go:358] "Generic (PLEG): container finished" podID="552c5ec7-fe70-4bc3-bd6f-b06e529244e8" containerID="4fe6d4906da166d68c4b5d6b41135d9cd612eaaa1bc55ea677529e11ccda2135" exitCode=0 Mar 16 16:00:02 crc kubenswrapper[5120]: I0316 16:00:02.232498 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/collect-profiles-29561280-pdw98" event={"ID":"552c5ec7-fe70-4bc3-bd6f-b06e529244e8","Type":"ContainerDied","Data":"4fe6d4906da166d68c4b5d6b41135d9cd612eaaa1bc55ea677529e11ccda2135"} Mar 16 16:00:03 crc kubenswrapper[5120]: I0316 16:00:03.650659 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29561280-pdw98" Mar 16 16:00:03 crc kubenswrapper[5120]: I0316 16:00:03.730147 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/552c5ec7-fe70-4bc3-bd6f-b06e529244e8-config-volume\") pod \"552c5ec7-fe70-4bc3-bd6f-b06e529244e8\" (UID: \"552c5ec7-fe70-4bc3-bd6f-b06e529244e8\") " Mar 16 16:00:03 crc kubenswrapper[5120]: I0316 16:00:03.731036 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/552c5ec7-fe70-4bc3-bd6f-b06e529244e8-secret-volume\") pod \"552c5ec7-fe70-4bc3-bd6f-b06e529244e8\" (UID: \"552c5ec7-fe70-4bc3-bd6f-b06e529244e8\") " Mar 16 16:00:03 crc kubenswrapper[5120]: I0316 16:00:03.731072 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cvnmv\" (UniqueName: \"kubernetes.io/projected/552c5ec7-fe70-4bc3-bd6f-b06e529244e8-kube-api-access-cvnmv\") pod \"552c5ec7-fe70-4bc3-bd6f-b06e529244e8\" (UID: \"552c5ec7-fe70-4bc3-bd6f-b06e529244e8\") " Mar 16 16:00:03 crc kubenswrapper[5120]: I0316 16:00:03.732051 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/552c5ec7-fe70-4bc3-bd6f-b06e529244e8-config-volume" (OuterVolumeSpecName: "config-volume") pod "552c5ec7-fe70-4bc3-bd6f-b06e529244e8" (UID: "552c5ec7-fe70-4bc3-bd6f-b06e529244e8"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:00:03 crc kubenswrapper[5120]: I0316 16:00:03.737169 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/552c5ec7-fe70-4bc3-bd6f-b06e529244e8-secret-volume" (OuterVolumeSpecName: "secret-volume") pod "552c5ec7-fe70-4bc3-bd6f-b06e529244e8" (UID: "552c5ec7-fe70-4bc3-bd6f-b06e529244e8"). InnerVolumeSpecName "secret-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:00:03 crc kubenswrapper[5120]: I0316 16:00:03.737530 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/552c5ec7-fe70-4bc3-bd6f-b06e529244e8-kube-api-access-cvnmv" (OuterVolumeSpecName: "kube-api-access-cvnmv") pod "552c5ec7-fe70-4bc3-bd6f-b06e529244e8" (UID: "552c5ec7-fe70-4bc3-bd6f-b06e529244e8"). InnerVolumeSpecName "kube-api-access-cvnmv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:00:03 crc kubenswrapper[5120]: I0316 16:00:03.833576 5120 reconciler_common.go:299] "Volume detached for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/552c5ec7-fe70-4bc3-bd6f-b06e529244e8-secret-volume\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:03 crc kubenswrapper[5120]: I0316 16:00:03.833620 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cvnmv\" (UniqueName: \"kubernetes.io/projected/552c5ec7-fe70-4bc3-bd6f-b06e529244e8-kube-api-access-cvnmv\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:03 crc kubenswrapper[5120]: I0316 16:00:03.833632 5120 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/552c5ec7-fe70-4bc3-bd6f-b06e529244e8-config-volume\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:04 crc kubenswrapper[5120]: I0316 16:00:04.258331 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29561280-pdw98" Mar 16 16:00:04 crc kubenswrapper[5120]: I0316 16:00:04.258351 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/collect-profiles-29561280-pdw98" event={"ID":"552c5ec7-fe70-4bc3-bd6f-b06e529244e8","Type":"ContainerDied","Data":"aa9f6d1c6bead4354c29cbbfeb080e9294644a12a6dc747ccce584e56fabf494"} Mar 16 16:00:04 crc kubenswrapper[5120]: I0316 16:00:04.258390 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="aa9f6d1c6bead4354c29cbbfeb080e9294644a12a6dc747ccce584e56fabf494" Mar 16 16:00:05 crc kubenswrapper[5120]: I0316 16:00:05.274420 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561280-2xg8d" event={"ID":"2faaeef7-818d-47ee-9a1f-05de5d494195","Type":"ContainerStarted","Data":"6c61d8d5aff83a68bd43a7d9b37f351f0bc19bbdef2670a8174126d2660fde32"} Mar 16 16:00:05 crc kubenswrapper[5120]: I0316 16:00:05.302111 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-infra/auto-csr-approver-29561280-2xg8d" podStartSLOduration=1.581086293 podStartE2EDuration="5.302088107s" podCreationTimestamp="2026-03-16 16:00:00 +0000 UTC" firstStartedPulling="2026-03-16 16:00:00.991951378 +0000 UTC m=+1703.145883035" lastFinishedPulling="2026-03-16 16:00:04.712953162 +0000 UTC m=+1706.866884849" observedRunningTime="2026-03-16 16:00:05.29784972 +0000 UTC m=+1707.451781407" watchObservedRunningTime="2026-03-16 16:00:05.302088107 +0000 UTC m=+1707.456019774" Mar 16 16:00:06 crc kubenswrapper[5120]: I0316 16:00:06.289427 5120 generic.go:358] "Generic (PLEG): container finished" podID="2faaeef7-818d-47ee-9a1f-05de5d494195" containerID="6c61d8d5aff83a68bd43a7d9b37f351f0bc19bbdef2670a8174126d2660fde32" exitCode=0 Mar 16 16:00:06 crc kubenswrapper[5120]: I0316 16:00:06.290111 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561280-2xg8d" event={"ID":"2faaeef7-818d-47ee-9a1f-05de5d494195","Type":"ContainerDied","Data":"6c61d8d5aff83a68bd43a7d9b37f351f0bc19bbdef2670a8174126d2660fde32"} Mar 16 16:00:07 crc kubenswrapper[5120]: I0316 16:00:07.664297 5120 scope.go:117] "RemoveContainer" containerID="02ba4fc3f84eccaecfa9e6618280f65626eb76580c4af9ae7a9d7cb3b8dd590b" Mar 16 16:00:07 crc kubenswrapper[5120]: E0316 16:00:07.664909 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:00:07 crc kubenswrapper[5120]: I0316 16:00:07.678395 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561280-2xg8d" Mar 16 16:00:07 crc kubenswrapper[5120]: I0316 16:00:07.720420 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-576t9\" (UniqueName: \"kubernetes.io/projected/2faaeef7-818d-47ee-9a1f-05de5d494195-kube-api-access-576t9\") pod \"2faaeef7-818d-47ee-9a1f-05de5d494195\" (UID: \"2faaeef7-818d-47ee-9a1f-05de5d494195\") " Mar 16 16:00:07 crc kubenswrapper[5120]: I0316 16:00:07.727697 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2faaeef7-818d-47ee-9a1f-05de5d494195-kube-api-access-576t9" (OuterVolumeSpecName: "kube-api-access-576t9") pod "2faaeef7-818d-47ee-9a1f-05de5d494195" (UID: "2faaeef7-818d-47ee-9a1f-05de5d494195"). InnerVolumeSpecName "kube-api-access-576t9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:00:07 crc kubenswrapper[5120]: I0316 16:00:07.825096 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-576t9\" (UniqueName: \"kubernetes.io/projected/2faaeef7-818d-47ee-9a1f-05de5d494195-kube-api-access-576t9\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:08 crc kubenswrapper[5120]: E0316 16:00:08.312016 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1780704 actualBytes=10240 Mar 16 16:00:08 crc kubenswrapper[5120]: I0316 16:00:08.321138 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561280-2xg8d" Mar 16 16:00:08 crc kubenswrapper[5120]: I0316 16:00:08.321256 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561280-2xg8d" event={"ID":"2faaeef7-818d-47ee-9a1f-05de5d494195","Type":"ContainerDied","Data":"a8e0eeffd96eafc170a60c32f33f7aa9f28dbcf1559321b019fa3fbc4a6b2d7e"} Mar 16 16:00:08 crc kubenswrapper[5120]: I0316 16:00:08.321360 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a8e0eeffd96eafc170a60c32f33f7aa9f28dbcf1559321b019fa3fbc4a6b2d7e" Mar 16 16:00:08 crc kubenswrapper[5120]: I0316 16:00:08.379661 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-infra/auto-csr-approver-29561274-v5q72"] Mar 16 16:00:08 crc kubenswrapper[5120]: I0316 16:00:08.387332 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-infra/auto-csr-approver-29561274-v5q72"] Mar 16 16:00:08 crc kubenswrapper[5120]: I0316 16:00:08.684600 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="72052f6a-5423-426f-bdb0-9c9f0609fa34" path="/var/lib/kubelet/pods/72052f6a-5423-426f-bdb0-9c9f0609fa34/volumes" Mar 16 16:00:09 crc kubenswrapper[5120]: E0316 16:00:09.953902 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 07f42a9b30dec55ea276347afe9aa990404c5b91295bba57ef470ca1b30032b7 is running failed: container process not found" containerID="07f42a9b30dec55ea276347afe9aa990404c5b91295bba57ef470ca1b30032b7" cmd=["/usr/local/bin/container-scripts/ovsdb_server_readiness.sh"] Mar 16 16:00:09 crc kubenswrapper[5120]: E0316 16:00:09.955276 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="60d59dba0a26cb5565debd8d07437189d473b73784a9546487b805a1faa67b1d" cmd=["/usr/local/bin/container-scripts/vswitchd_readiness.sh"] Mar 16 16:00:09 crc kubenswrapper[5120]: E0316 16:00:09.956172 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 07f42a9b30dec55ea276347afe9aa990404c5b91295bba57ef470ca1b30032b7 is running failed: container process not found" containerID="07f42a9b30dec55ea276347afe9aa990404c5b91295bba57ef470ca1b30032b7" cmd=["/usr/local/bin/container-scripts/ovsdb_server_readiness.sh"] Mar 16 16:00:09 crc kubenswrapper[5120]: E0316 16:00:09.956545 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 07f42a9b30dec55ea276347afe9aa990404c5b91295bba57ef470ca1b30032b7 is running failed: container process not found" containerID="07f42a9b30dec55ea276347afe9aa990404c5b91295bba57ef470ca1b30032b7" cmd=["/usr/local/bin/container-scripts/ovsdb_server_readiness.sh"] Mar 16 16:00:09 crc kubenswrapper[5120]: E0316 16:00:09.956642 5120 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 07f42a9b30dec55ea276347afe9aa990404c5b91295bba57ef470ca1b30032b7 is running failed: container process not found" probeType="Readiness" pod="openstack-kuttl-tests/ovn-controller-ovs-wmmfv" podUID="ab8ad82a-5c13-4d9e-bbae-548a51860f3c" containerName="ovsdb-server" probeResult="unknown" Mar 16 16:00:09 crc kubenswrapper[5120]: E0316 16:00:09.957671 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="60d59dba0a26cb5565debd8d07437189d473b73784a9546487b805a1faa67b1d" cmd=["/usr/local/bin/container-scripts/vswitchd_readiness.sh"] Mar 16 16:00:09 crc kubenswrapper[5120]: E0316 16:00:09.960411 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="60d59dba0a26cb5565debd8d07437189d473b73784a9546487b805a1faa67b1d" cmd=["/usr/local/bin/container-scripts/vswitchd_readiness.sh"] Mar 16 16:00:09 crc kubenswrapper[5120]: E0316 16:00:09.960443 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/ovn-controller-ovs-wmmfv" podUID="ab8ad82a-5c13-4d9e-bbae-548a51860f3c" containerName="ovs-vswitchd" probeResult="unknown" Mar 16 16:00:10 crc kubenswrapper[5120]: I0316 16:00:10.807609 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-controller-ovs-wmmfv_ab8ad82a-5c13-4d9e-bbae-548a51860f3c/ovs-vswitchd/0.log" Mar 16 16:00:10 crc kubenswrapper[5120]: I0316 16:00:10.808889 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-controller-ovs-wmmfv" Mar 16 16:00:10 crc kubenswrapper[5120]: I0316 16:00:10.899131 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/ab8ad82a-5c13-4d9e-bbae-548a51860f3c-etc-ovs" (OuterVolumeSpecName: "etc-ovs") pod "ab8ad82a-5c13-4d9e-bbae-548a51860f3c" (UID: "ab8ad82a-5c13-4d9e-bbae-548a51860f3c"). InnerVolumeSpecName "etc-ovs". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 16:00:10 crc kubenswrapper[5120]: I0316 16:00:10.899175 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-ovs\" (UniqueName: \"kubernetes.io/host-path/ab8ad82a-5c13-4d9e-bbae-548a51860f3c-etc-ovs\") pod \"ab8ad82a-5c13-4d9e-bbae-548a51860f3c\" (UID: \"ab8ad82a-5c13-4d9e-bbae-548a51860f3c\") " Mar 16 16:00:10 crc kubenswrapper[5120]: I0316 16:00:10.899263 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/ab8ad82a-5c13-4d9e-bbae-548a51860f3c-scripts\") pod \"ab8ad82a-5c13-4d9e-bbae-548a51860f3c\" (UID: \"ab8ad82a-5c13-4d9e-bbae-548a51860f3c\") " Mar 16 16:00:10 crc kubenswrapper[5120]: I0316 16:00:10.899430 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"var-run\" (UniqueName: \"kubernetes.io/host-path/ab8ad82a-5c13-4d9e-bbae-548a51860f3c-var-run\") pod \"ab8ad82a-5c13-4d9e-bbae-548a51860f3c\" (UID: \"ab8ad82a-5c13-4d9e-bbae-548a51860f3c\") " Mar 16 16:00:10 crc kubenswrapper[5120]: I0316 16:00:10.899562 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"var-log\" (UniqueName: \"kubernetes.io/host-path/ab8ad82a-5c13-4d9e-bbae-548a51860f3c-var-log\") pod \"ab8ad82a-5c13-4d9e-bbae-548a51860f3c\" (UID: \"ab8ad82a-5c13-4d9e-bbae-548a51860f3c\") " Mar 16 16:00:10 crc kubenswrapper[5120]: I0316 16:00:10.899564 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/ab8ad82a-5c13-4d9e-bbae-548a51860f3c-var-run" (OuterVolumeSpecName: "var-run") pod "ab8ad82a-5c13-4d9e-bbae-548a51860f3c" (UID: "ab8ad82a-5c13-4d9e-bbae-548a51860f3c"). InnerVolumeSpecName "var-run". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 16:00:10 crc kubenswrapper[5120]: I0316 16:00:10.899647 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/ab8ad82a-5c13-4d9e-bbae-548a51860f3c-var-log" (OuterVolumeSpecName: "var-log") pod "ab8ad82a-5c13-4d9e-bbae-548a51860f3c" (UID: "ab8ad82a-5c13-4d9e-bbae-548a51860f3c"). InnerVolumeSpecName "var-log". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 16:00:10 crc kubenswrapper[5120]: I0316 16:00:10.899729 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4xm4r\" (UniqueName: \"kubernetes.io/projected/ab8ad82a-5c13-4d9e-bbae-548a51860f3c-kube-api-access-4xm4r\") pod \"ab8ad82a-5c13-4d9e-bbae-548a51860f3c\" (UID: \"ab8ad82a-5c13-4d9e-bbae-548a51860f3c\") " Mar 16 16:00:10 crc kubenswrapper[5120]: I0316 16:00:10.899871 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"var-lib\" (UniqueName: \"kubernetes.io/host-path/ab8ad82a-5c13-4d9e-bbae-548a51860f3c-var-lib\") pod \"ab8ad82a-5c13-4d9e-bbae-548a51860f3c\" (UID: \"ab8ad82a-5c13-4d9e-bbae-548a51860f3c\") " Mar 16 16:00:10 crc kubenswrapper[5120]: I0316 16:00:10.900209 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/ab8ad82a-5c13-4d9e-bbae-548a51860f3c-var-lib" (OuterVolumeSpecName: "var-lib") pod "ab8ad82a-5c13-4d9e-bbae-548a51860f3c" (UID: "ab8ad82a-5c13-4d9e-bbae-548a51860f3c"). InnerVolumeSpecName "var-lib". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 16:00:10 crc kubenswrapper[5120]: I0316 16:00:10.900668 5120 reconciler_common.go:299] "Volume detached for volume \"var-lib\" (UniqueName: \"kubernetes.io/host-path/ab8ad82a-5c13-4d9e-bbae-548a51860f3c-var-lib\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:10 crc kubenswrapper[5120]: I0316 16:00:10.900695 5120 reconciler_common.go:299] "Volume detached for volume \"etc-ovs\" (UniqueName: \"kubernetes.io/host-path/ab8ad82a-5c13-4d9e-bbae-548a51860f3c-etc-ovs\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:10 crc kubenswrapper[5120]: I0316 16:00:10.900703 5120 reconciler_common.go:299] "Volume detached for volume \"var-run\" (UniqueName: \"kubernetes.io/host-path/ab8ad82a-5c13-4d9e-bbae-548a51860f3c-var-run\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:10 crc kubenswrapper[5120]: I0316 16:00:10.900712 5120 reconciler_common.go:299] "Volume detached for volume \"var-log\" (UniqueName: \"kubernetes.io/host-path/ab8ad82a-5c13-4d9e-bbae-548a51860f3c-var-log\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:10 crc kubenswrapper[5120]: I0316 16:00:10.900720 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ab8ad82a-5c13-4d9e-bbae-548a51860f3c-scripts" (OuterVolumeSpecName: "scripts") pod "ab8ad82a-5c13-4d9e-bbae-548a51860f3c" (UID: "ab8ad82a-5c13-4d9e-bbae-548a51860f3c"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:00:10 crc kubenswrapper[5120]: I0316 16:00:10.910554 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab8ad82a-5c13-4d9e-bbae-548a51860f3c-kube-api-access-4xm4r" (OuterVolumeSpecName: "kube-api-access-4xm4r") pod "ab8ad82a-5c13-4d9e-bbae-548a51860f3c" (UID: "ab8ad82a-5c13-4d9e-bbae-548a51860f3c"). InnerVolumeSpecName "kube-api-access-4xm4r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:00:11 crc kubenswrapper[5120]: I0316 16:00:11.002701 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/ab8ad82a-5c13-4d9e-bbae-548a51860f3c-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:11 crc kubenswrapper[5120]: I0316 16:00:11.003052 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4xm4r\" (UniqueName: \"kubernetes.io/projected/ab8ad82a-5c13-4d9e-bbae-548a51860f3c-kube-api-access-4xm4r\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:11 crc kubenswrapper[5120]: I0316 16:00:11.371128 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-controller-ovs-wmmfv_ab8ad82a-5c13-4d9e-bbae-548a51860f3c/ovs-vswitchd/0.log" Mar 16 16:00:11 crc kubenswrapper[5120]: I0316 16:00:11.372129 5120 generic.go:358] "Generic (PLEG): container finished" podID="ab8ad82a-5c13-4d9e-bbae-548a51860f3c" containerID="60d59dba0a26cb5565debd8d07437189d473b73784a9546487b805a1faa67b1d" exitCode=137 Mar 16 16:00:11 crc kubenswrapper[5120]: I0316 16:00:11.372251 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-controller-ovs-wmmfv" event={"ID":"ab8ad82a-5c13-4d9e-bbae-548a51860f3c","Type":"ContainerDied","Data":"60d59dba0a26cb5565debd8d07437189d473b73784a9546487b805a1faa67b1d"} Mar 16 16:00:11 crc kubenswrapper[5120]: I0316 16:00:11.372302 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-controller-ovs-wmmfv" event={"ID":"ab8ad82a-5c13-4d9e-bbae-548a51860f3c","Type":"ContainerDied","Data":"584ac3de4782563e4aec911e4ee872cc72408e053b0982b9b98570aea3799376"} Mar 16 16:00:11 crc kubenswrapper[5120]: I0316 16:00:11.372325 5120 scope.go:117] "RemoveContainer" containerID="60d59dba0a26cb5565debd8d07437189d473b73784a9546487b805a1faa67b1d" Mar 16 16:00:11 crc kubenswrapper[5120]: I0316 16:00:11.372331 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-controller-ovs-wmmfv" Mar 16 16:00:11 crc kubenswrapper[5120]: I0316 16:00:11.419120 5120 scope.go:117] "RemoveContainer" containerID="07f42a9b30dec55ea276347afe9aa990404c5b91295bba57ef470ca1b30032b7" Mar 16 16:00:11 crc kubenswrapper[5120]: I0316 16:00:11.439370 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-controller-ovs-wmmfv"] Mar 16 16:00:11 crc kubenswrapper[5120]: I0316 16:00:11.450713 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovn-controller-ovs-wmmfv"] Mar 16 16:00:11 crc kubenswrapper[5120]: I0316 16:00:11.459056 5120 scope.go:117] "RemoveContainer" containerID="b014396938706fd9de4e8b35b5ccfa8f461e7692e36984d8f01010f051e1cfc7" Mar 16 16:00:11 crc kubenswrapper[5120]: I0316 16:00:11.540005 5120 scope.go:117] "RemoveContainer" containerID="60d59dba0a26cb5565debd8d07437189d473b73784a9546487b805a1faa67b1d" Mar 16 16:00:11 crc kubenswrapper[5120]: E0316 16:00:11.540558 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"60d59dba0a26cb5565debd8d07437189d473b73784a9546487b805a1faa67b1d\": container with ID starting with 60d59dba0a26cb5565debd8d07437189d473b73784a9546487b805a1faa67b1d not found: ID does not exist" containerID="60d59dba0a26cb5565debd8d07437189d473b73784a9546487b805a1faa67b1d" Mar 16 16:00:11 crc kubenswrapper[5120]: I0316 16:00:11.540615 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60d59dba0a26cb5565debd8d07437189d473b73784a9546487b805a1faa67b1d"} err="failed to get container status \"60d59dba0a26cb5565debd8d07437189d473b73784a9546487b805a1faa67b1d\": rpc error: code = NotFound desc = could not find container \"60d59dba0a26cb5565debd8d07437189d473b73784a9546487b805a1faa67b1d\": container with ID starting with 60d59dba0a26cb5565debd8d07437189d473b73784a9546487b805a1faa67b1d not found: ID does not exist" Mar 16 16:00:11 crc kubenswrapper[5120]: I0316 16:00:11.540654 5120 scope.go:117] "RemoveContainer" containerID="07f42a9b30dec55ea276347afe9aa990404c5b91295bba57ef470ca1b30032b7" Mar 16 16:00:11 crc kubenswrapper[5120]: E0316 16:00:11.541278 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"07f42a9b30dec55ea276347afe9aa990404c5b91295bba57ef470ca1b30032b7\": container with ID starting with 07f42a9b30dec55ea276347afe9aa990404c5b91295bba57ef470ca1b30032b7 not found: ID does not exist" containerID="07f42a9b30dec55ea276347afe9aa990404c5b91295bba57ef470ca1b30032b7" Mar 16 16:00:11 crc kubenswrapper[5120]: I0316 16:00:11.541308 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07f42a9b30dec55ea276347afe9aa990404c5b91295bba57ef470ca1b30032b7"} err="failed to get container status \"07f42a9b30dec55ea276347afe9aa990404c5b91295bba57ef470ca1b30032b7\": rpc error: code = NotFound desc = could not find container \"07f42a9b30dec55ea276347afe9aa990404c5b91295bba57ef470ca1b30032b7\": container with ID starting with 07f42a9b30dec55ea276347afe9aa990404c5b91295bba57ef470ca1b30032b7 not found: ID does not exist" Mar 16 16:00:11 crc kubenswrapper[5120]: I0316 16:00:11.541347 5120 scope.go:117] "RemoveContainer" containerID="b014396938706fd9de4e8b35b5ccfa8f461e7692e36984d8f01010f051e1cfc7" Mar 16 16:00:11 crc kubenswrapper[5120]: E0316 16:00:11.541697 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b014396938706fd9de4e8b35b5ccfa8f461e7692e36984d8f01010f051e1cfc7\": container with ID starting with b014396938706fd9de4e8b35b5ccfa8f461e7692e36984d8f01010f051e1cfc7 not found: ID does not exist" containerID="b014396938706fd9de4e8b35b5ccfa8f461e7692e36984d8f01010f051e1cfc7" Mar 16 16:00:11 crc kubenswrapper[5120]: I0316 16:00:11.541732 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b014396938706fd9de4e8b35b5ccfa8f461e7692e36984d8f01010f051e1cfc7"} err="failed to get container status \"b014396938706fd9de4e8b35b5ccfa8f461e7692e36984d8f01010f051e1cfc7\": rpc error: code = NotFound desc = could not find container \"b014396938706fd9de4e8b35b5ccfa8f461e7692e36984d8f01010f051e1cfc7\": container with ID starting with b014396938706fd9de4e8b35b5ccfa8f461e7692e36984d8f01010f051e1cfc7 not found: ID does not exist" Mar 16 16:00:12 crc kubenswrapper[5120]: I0316 16:00:12.044572 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 16:00:12 crc kubenswrapper[5120]: I0316 16:00:12.045131 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/openstackclient" podUID="b5ed0fd6-65dd-4480-acce-2eb38249add6" containerName="openstackclient" containerID="cri-o://faa88e5970c0bf9c643f2180f59a90ed1f8b8a4a6cfd93741f962f1d1a9cacdc" gracePeriod=2 Mar 16 16:00:12 crc kubenswrapper[5120]: I0316 16:00:12.046704 5120 status_manager.go:895] "Failed to get status for pod" podUID="b5ed0fd6-65dd-4480-acce-2eb38249add6" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 16:00:12 crc kubenswrapper[5120]: I0316 16:00:12.067116 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 16:00:12 crc kubenswrapper[5120]: I0316 16:00:12.236028 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-8a54-account-create-update-s5q9b"] Mar 16 16:00:12 crc kubenswrapper[5120]: I0316 16:00:12.248729 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-8a54-account-create-update-s5q9b"] Mar 16 16:00:12 crc kubenswrapper[5120]: I0316 16:00:12.260819 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-79ea-account-create-update-qpvh9"] Mar 16 16:00:12 crc kubenswrapper[5120]: I0316 16:00:12.271104 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-79ea-account-create-update-qpvh9"] Mar 16 16:00:12 crc kubenswrapper[5120]: I0316 16:00:12.361169 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-8a54-account-create-update-9l5b7"] Mar 16 16:00:12 crc kubenswrapper[5120]: I0316 16:00:12.362357 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5ed0fd6-65dd-4480-acce-2eb38249add6" containerName="openstackclient" Mar 16 16:00:12 crc kubenswrapper[5120]: I0316 16:00:12.362391 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5ed0fd6-65dd-4480-acce-2eb38249add6" containerName="openstackclient" Mar 16 16:00:12 crc kubenswrapper[5120]: I0316 16:00:12.362421 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab8ad82a-5c13-4d9e-bbae-548a51860f3c" containerName="ovsdb-server" Mar 16 16:00:12 crc kubenswrapper[5120]: I0316 16:00:12.362428 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab8ad82a-5c13-4d9e-bbae-548a51860f3c" containerName="ovsdb-server" Mar 16 16:00:12 crc kubenswrapper[5120]: I0316 16:00:12.362473 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="552c5ec7-fe70-4bc3-bd6f-b06e529244e8" containerName="collect-profiles" Mar 16 16:00:12 crc kubenswrapper[5120]: I0316 16:00:12.362481 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="552c5ec7-fe70-4bc3-bd6f-b06e529244e8" containerName="collect-profiles" Mar 16 16:00:12 crc kubenswrapper[5120]: I0316 16:00:12.362508 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab8ad82a-5c13-4d9e-bbae-548a51860f3c" containerName="ovsdb-server-init" Mar 16 16:00:12 crc kubenswrapper[5120]: I0316 16:00:12.362515 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab8ad82a-5c13-4d9e-bbae-548a51860f3c" containerName="ovsdb-server-init" Mar 16 16:00:12 crc kubenswrapper[5120]: I0316 16:00:12.362533 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2faaeef7-818d-47ee-9a1f-05de5d494195" containerName="oc" Mar 16 16:00:12 crc kubenswrapper[5120]: I0316 16:00:12.362540 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="2faaeef7-818d-47ee-9a1f-05de5d494195" containerName="oc" Mar 16 16:00:12 crc kubenswrapper[5120]: I0316 16:00:12.362557 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab8ad82a-5c13-4d9e-bbae-548a51860f3c" containerName="ovs-vswitchd" Mar 16 16:00:12 crc kubenswrapper[5120]: I0316 16:00:12.362563 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab8ad82a-5c13-4d9e-bbae-548a51860f3c" containerName="ovs-vswitchd" Mar 16 16:00:12 crc kubenswrapper[5120]: I0316 16:00:12.362748 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="2faaeef7-818d-47ee-9a1f-05de5d494195" containerName="oc" Mar 16 16:00:12 crc kubenswrapper[5120]: I0316 16:00:12.362784 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ab8ad82a-5c13-4d9e-bbae-548a51860f3c" containerName="ovs-vswitchd" Mar 16 16:00:12 crc kubenswrapper[5120]: I0316 16:00:12.362794 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="552c5ec7-fe70-4bc3-bd6f-b06e529244e8" containerName="collect-profiles" Mar 16 16:00:12 crc kubenswrapper[5120]: I0316 16:00:12.362807 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ab8ad82a-5c13-4d9e-bbae-548a51860f3c" containerName="ovsdb-server" Mar 16 16:00:12 crc kubenswrapper[5120]: I0316 16:00:12.362821 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="b5ed0fd6-65dd-4480-acce-2eb38249add6" containerName="openstackclient" Mar 16 16:00:12 crc kubenswrapper[5120]: I0316 16:00:12.379079 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-8a54-account-create-update-9l5b7" Mar 16 16:00:12 crc kubenswrapper[5120]: I0316 16:00:12.384801 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-8a54-account-create-update-9l5b7"] Mar 16 16:00:12 crc kubenswrapper[5120]: I0316 16:00:12.388657 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-db-secret\"" Mar 16 16:00:12 crc kubenswrapper[5120]: I0316 16:00:12.472651 5120 status_manager.go:895] "Failed to get status for pod" podUID="b5ed0fd6-65dd-4480-acce-2eb38249add6" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 16:00:12 crc kubenswrapper[5120]: I0316 16:00:12.497215 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-4tnnd"] Mar 16 16:00:12 crc kubenswrapper[5120]: I0316 16:00:12.512802 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 16:00:12 crc kubenswrapper[5120]: I0316 16:00:12.513509 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podUID="f8f48fe3-091f-40a2-b580-69ba5cb95392" containerName="openstack-network-exporter" containerID="cri-o://2e8f7cc02c3d7a129f99450acb5b341f91067daefe4059c6c5ae46388f70b8b6" gracePeriod=300 Mar 16 16:00:12 crc kubenswrapper[5120]: I0316 16:00:12.517379 5120 status_manager.go:895] "Failed to get status for pod" podUID="b5ed0fd6-65dd-4480-acce-2eb38249add6" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 16:00:12 crc kubenswrapper[5120]: I0316 16:00:12.545053 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ecfb18c4-5cb2-4ab6-8445-79c3eec250d8-operator-scripts\") pod \"nova-api-8a54-account-create-update-9l5b7\" (UID: \"ecfb18c4-5cb2-4ab6-8445-79c3eec250d8\") " pod="openstack-kuttl-tests/nova-api-8a54-account-create-update-9l5b7" Mar 16 16:00:12 crc kubenswrapper[5120]: I0316 16:00:12.545130 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qx5wh\" (UniqueName: \"kubernetes.io/projected/ecfb18c4-5cb2-4ab6-8445-79c3eec250d8-kube-api-access-qx5wh\") pod \"nova-api-8a54-account-create-update-9l5b7\" (UID: \"ecfb18c4-5cb2-4ab6-8445-79c3eec250d8\") " pod="openstack-kuttl-tests/nova-api-8a54-account-create-update-9l5b7" Mar 16 16:00:12 crc kubenswrapper[5120]: I0316 16:00:12.563277 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-4tnnd"] Mar 16 16:00:12 crc kubenswrapper[5120]: I0316 16:00:12.620263 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 16:00:12 crc kubenswrapper[5120]: I0316 16:00:12.629565 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podUID="f8f48fe3-091f-40a2-b580-69ba5cb95392" containerName="ovsdbserver-nb" containerID="cri-o://dac788712cee13272c3b574a2a82410cb05db5c3ad287bdca48ecf5f046219a8" gracePeriod=300 Mar 16 16:00:12 crc kubenswrapper[5120]: I0316 16:00:12.647162 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-s8lzg"] Mar 16 16:00:12 crc kubenswrapper[5120]: I0316 16:00:12.648207 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ecfb18c4-5cb2-4ab6-8445-79c3eec250d8-operator-scripts\") pod \"nova-api-8a54-account-create-update-9l5b7\" (UID: \"ecfb18c4-5cb2-4ab6-8445-79c3eec250d8\") " pod="openstack-kuttl-tests/nova-api-8a54-account-create-update-9l5b7" Mar 16 16:00:12 crc kubenswrapper[5120]: I0316 16:00:12.648258 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qx5wh\" (UniqueName: \"kubernetes.io/projected/ecfb18c4-5cb2-4ab6-8445-79c3eec250d8-kube-api-access-qx5wh\") pod \"nova-api-8a54-account-create-update-9l5b7\" (UID: \"ecfb18c4-5cb2-4ab6-8445-79c3eec250d8\") " pod="openstack-kuttl-tests/nova-api-8a54-account-create-update-9l5b7" Mar 16 16:00:12 crc kubenswrapper[5120]: I0316 16:00:12.649317 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ecfb18c4-5cb2-4ab6-8445-79c3eec250d8-operator-scripts\") pod \"nova-api-8a54-account-create-update-9l5b7\" (UID: \"ecfb18c4-5cb2-4ab6-8445-79c3eec250d8\") " pod="openstack-kuttl-tests/nova-api-8a54-account-create-update-9l5b7" Mar 16 16:00:12 crc kubenswrapper[5120]: I0316 16:00:12.706826 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="372db992-7da6-4e0f-b492-76e1c6713181" path="/var/lib/kubelet/pods/372db992-7da6-4e0f-b492-76e1c6713181/volumes" Mar 16 16:00:12 crc kubenswrapper[5120]: I0316 16:00:12.707835 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6cf8526c-e5de-4dec-abde-91cbf192288d" path="/var/lib/kubelet/pods/6cf8526c-e5de-4dec-abde-91cbf192288d/volumes" Mar 16 16:00:12 crc kubenswrapper[5120]: I0316 16:00:12.708604 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ab8ad82a-5c13-4d9e-bbae-548a51860f3c" path="/var/lib/kubelet/pods/ab8ad82a-5c13-4d9e-bbae-548a51860f3c/volumes" Mar 16 16:00:12 crc kubenswrapper[5120]: I0316 16:00:12.713421 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b6bb3fb4-89a4-4651-94cb-aed285af6acb" path="/var/lib/kubelet/pods/b6bb3fb4-89a4-4651-94cb-aed285af6acb/volumes" Mar 16 16:00:12 crc kubenswrapper[5120]: I0316 16:00:12.714747 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-s8lzg"] Mar 16 16:00:12 crc kubenswrapper[5120]: I0316 16:00:12.722555 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qx5wh\" (UniqueName: \"kubernetes.io/projected/ecfb18c4-5cb2-4ab6-8445-79c3eec250d8-kube-api-access-qx5wh\") pod \"nova-api-8a54-account-create-update-9l5b7\" (UID: \"ecfb18c4-5cb2-4ab6-8445-79c3eec250d8\") " pod="openstack-kuttl-tests/nova-api-8a54-account-create-update-9l5b7" Mar 16 16:00:12 crc kubenswrapper[5120]: I0316 16:00:12.747287 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-79ea-account-create-update-nlbgs"] Mar 16 16:00:12 crc kubenswrapper[5120]: E0316 16:00:12.752876 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Mar 16 16:00:12 crc kubenswrapper[5120]: E0316 16:00:12.752934 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/492ba9f3-6479-432b-a2f4-cee712a51800-config-data podName:492ba9f3-6479-432b-a2f4-cee712a51800 nodeName:}" failed. No retries permitted until 2026-03-16 16:00:13.252917981 +0000 UTC m=+1715.406849638 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/492ba9f3-6479-432b-a2f4-cee712a51800-config-data") pod "rabbitmq-cell1-server-0" (UID: "492ba9f3-6479-432b-a2f4-cee712a51800") : configmap "rabbitmq-cell1-config-data" not found Mar 16 16:00:12 crc kubenswrapper[5120]: I0316 16:00:12.759603 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-79ea-account-create-update-nlbgs" Mar 16 16:00:12 crc kubenswrapper[5120]: I0316 16:00:12.761866 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-8a54-account-create-update-9l5b7" Mar 16 16:00:12 crc kubenswrapper[5120]: I0316 16:00:12.766903 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-db-secret\"" Mar 16 16:00:12 crc kubenswrapper[5120]: I0316 16:00:12.772813 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-b511-account-create-update-l95v7"] Mar 16 16:00:12 crc kubenswrapper[5120]: I0316 16:00:12.801235 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-b511-account-create-update-l95v7"] Mar 16 16:00:12 crc kubenswrapper[5120]: I0316 16:00:12.842803 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-79ea-account-create-update-nlbgs"] Mar 16 16:00:12 crc kubenswrapper[5120]: I0316 16:00:12.858484 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/169cc9e8-ed2f-47c8-b98a-0143f4c480d7-operator-scripts\") pod \"placement-79ea-account-create-update-nlbgs\" (UID: \"169cc9e8-ed2f-47c8-b98a-0143f4c480d7\") " pod="openstack-kuttl-tests/placement-79ea-account-create-update-nlbgs" Mar 16 16:00:12 crc kubenswrapper[5120]: I0316 16:00:12.858690 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49c7h\" (UniqueName: \"kubernetes.io/projected/169cc9e8-ed2f-47c8-b98a-0143f4c480d7-kube-api-access-49c7h\") pod \"placement-79ea-account-create-update-nlbgs\" (UID: \"169cc9e8-ed2f-47c8-b98a-0143f4c480d7\") " pod="openstack-kuttl-tests/placement-79ea-account-create-update-nlbgs" Mar 16 16:00:12 crc kubenswrapper[5120]: I0316 16:00:12.893869 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/root-account-create-update-6b7md"] Mar 16 16:00:12 crc kubenswrapper[5120]: I0316 16:00:12.906013 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-6b7md" Mar 16 16:00:12 crc kubenswrapper[5120]: I0316 16:00:12.916325 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"openstack-cell1-mariadb-root-db-secret\"" Mar 16 16:00:12 crc kubenswrapper[5120]: I0316 16:00:12.924023 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-6b7md"] Mar 16 16:00:12 crc kubenswrapper[5120]: I0316 16:00:12.948037 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-dc27-account-create-update-2jjjz"] Mar 16 16:00:12 crc kubenswrapper[5120]: I0316 16:00:12.967969 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-49c7h\" (UniqueName: \"kubernetes.io/projected/169cc9e8-ed2f-47c8-b98a-0143f4c480d7-kube-api-access-49c7h\") pod \"placement-79ea-account-create-update-nlbgs\" (UID: \"169cc9e8-ed2f-47c8-b98a-0143f4c480d7\") " pod="openstack-kuttl-tests/placement-79ea-account-create-update-nlbgs" Mar 16 16:00:12 crc kubenswrapper[5120]: I0316 16:00:12.968099 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/169cc9e8-ed2f-47c8-b98a-0143f4c480d7-operator-scripts\") pod \"placement-79ea-account-create-update-nlbgs\" (UID: \"169cc9e8-ed2f-47c8-b98a-0143f4c480d7\") " pod="openstack-kuttl-tests/placement-79ea-account-create-update-nlbgs" Mar 16 16:00:12 crc kubenswrapper[5120]: I0316 16:00:12.970893 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/169cc9e8-ed2f-47c8-b98a-0143f4c480d7-operator-scripts\") pod \"placement-79ea-account-create-update-nlbgs\" (UID: \"169cc9e8-ed2f-47c8-b98a-0143f4c480d7\") " pod="openstack-kuttl-tests/placement-79ea-account-create-update-nlbgs" Mar 16 16:00:13 crc kubenswrapper[5120]: I0316 16:00:12.994592 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-dc27-account-create-update-2jjjz"] Mar 16 16:00:13 crc kubenswrapper[5120]: I0316 16:00:13.042250 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-dc27-account-create-update-2jjjz" Mar 16 16:00:13 crc kubenswrapper[5120]: I0316 16:00:13.043207 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-ef54-account-create-update-b2vpk"] Mar 16 16:00:13 crc kubenswrapper[5120]: I0316 16:00:13.058991 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-db-secret\"" Mar 16 16:00:13 crc kubenswrapper[5120]: I0316 16:00:13.077970 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-ef54-account-create-update-b2vpk" Mar 16 16:00:13 crc kubenswrapper[5120]: I0316 16:00:13.082214 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-ef54-account-create-update-b2vpk"] Mar 16 16:00:13 crc kubenswrapper[5120]: I0316 16:00:13.101055 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-db-secret\"" Mar 16 16:00:13 crc kubenswrapper[5120]: I0316 16:00:13.126412 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/7e2bc91b-26c0-4506-8629-832872fb453f-operator-scripts\") pod \"root-account-create-update-6b7md\" (UID: \"7e2bc91b-26c0-4506-8629-832872fb453f\") " pod="openstack-kuttl-tests/root-account-create-update-6b7md" Mar 16 16:00:13 crc kubenswrapper[5120]: I0316 16:00:13.126501 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jx24\" (UniqueName: \"kubernetes.io/projected/7e2bc91b-26c0-4506-8629-832872fb453f-kube-api-access-2jx24\") pod \"root-account-create-update-6b7md\" (UID: \"7e2bc91b-26c0-4506-8629-832872fb453f\") " pod="openstack-kuttl-tests/root-account-create-update-6b7md" Mar 16 16:00:13 crc kubenswrapper[5120]: I0316 16:00:13.126559 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z58pz\" (UniqueName: \"kubernetes.io/projected/b7049577-d3a2-4125-b841-70c5f6e1da23-kube-api-access-z58pz\") pod \"nova-cell1-dc27-account-create-update-2jjjz\" (UID: \"b7049577-d3a2-4125-b841-70c5f6e1da23\") " pod="openstack-kuttl-tests/nova-cell1-dc27-account-create-update-2jjjz" Mar 16 16:00:13 crc kubenswrapper[5120]: I0316 16:00:13.127831 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b7049577-d3a2-4125-b841-70c5f6e1da23-operator-scripts\") pod \"nova-cell1-dc27-account-create-update-2jjjz\" (UID: \"b7049577-d3a2-4125-b841-70c5f6e1da23\") " pod="openstack-kuttl-tests/nova-cell1-dc27-account-create-update-2jjjz" Mar 16 16:00:13 crc kubenswrapper[5120]: I0316 16:00:13.131321 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-dc27-account-create-update-gswht"] Mar 16 16:00:13 crc kubenswrapper[5120]: I0316 16:00:13.132993 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-49c7h\" (UniqueName: \"kubernetes.io/projected/169cc9e8-ed2f-47c8-b98a-0143f4c480d7-kube-api-access-49c7h\") pod \"placement-79ea-account-create-update-nlbgs\" (UID: \"169cc9e8-ed2f-47c8-b98a-0143f4c480d7\") " pod="openstack-kuttl-tests/placement-79ea-account-create-update-nlbgs" Mar 16 16:00:13 crc kubenswrapper[5120]: I0316 16:00:13.155522 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-dc27-account-create-update-gswht"] Mar 16 16:00:13 crc kubenswrapper[5120]: I0316 16:00:13.176897 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-62f1-account-create-update-vlpcg"] Mar 16 16:00:13 crc kubenswrapper[5120]: I0316 16:00:13.194836 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-62f1-account-create-update-vlpcg"] Mar 16 16:00:13 crc kubenswrapper[5120]: I0316 16:00:13.202144 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-mx7kq"] Mar 16 16:00:13 crc kubenswrapper[5120]: I0316 16:00:13.229448 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/7e2bc91b-26c0-4506-8629-832872fb453f-operator-scripts\") pod \"root-account-create-update-6b7md\" (UID: \"7e2bc91b-26c0-4506-8629-832872fb453f\") " pod="openstack-kuttl-tests/root-account-create-update-6b7md" Mar 16 16:00:13 crc kubenswrapper[5120]: I0316 16:00:13.229491 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2jx24\" (UniqueName: \"kubernetes.io/projected/7e2bc91b-26c0-4506-8629-832872fb453f-kube-api-access-2jx24\") pod \"root-account-create-update-6b7md\" (UID: \"7e2bc91b-26c0-4506-8629-832872fb453f\") " pod="openstack-kuttl-tests/root-account-create-update-6b7md" Mar 16 16:00:13 crc kubenswrapper[5120]: I0316 16:00:13.229516 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z58pz\" (UniqueName: \"kubernetes.io/projected/b7049577-d3a2-4125-b841-70c5f6e1da23-kube-api-access-z58pz\") pod \"nova-cell1-dc27-account-create-update-2jjjz\" (UID: \"b7049577-d3a2-4125-b841-70c5f6e1da23\") " pod="openstack-kuttl-tests/nova-cell1-dc27-account-create-update-2jjjz" Mar 16 16:00:13 crc kubenswrapper[5120]: I0316 16:00:13.229609 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/14fb94bd-5ac0-4ea1-98bf-1980cebf6e4d-operator-scripts\") pod \"nova-cell0-ef54-account-create-update-b2vpk\" (UID: \"14fb94bd-5ac0-4ea1-98bf-1980cebf6e4d\") " pod="openstack-kuttl-tests/nova-cell0-ef54-account-create-update-b2vpk" Mar 16 16:00:13 crc kubenswrapper[5120]: I0316 16:00:13.229642 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b7049577-d3a2-4125-b841-70c5f6e1da23-operator-scripts\") pod \"nova-cell1-dc27-account-create-update-2jjjz\" (UID: \"b7049577-d3a2-4125-b841-70c5f6e1da23\") " pod="openstack-kuttl-tests/nova-cell1-dc27-account-create-update-2jjjz" Mar 16 16:00:13 crc kubenswrapper[5120]: I0316 16:00:13.229663 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tx7dn\" (UniqueName: \"kubernetes.io/projected/14fb94bd-5ac0-4ea1-98bf-1980cebf6e4d-kube-api-access-tx7dn\") pod \"nova-cell0-ef54-account-create-update-b2vpk\" (UID: \"14fb94bd-5ac0-4ea1-98bf-1980cebf6e4d\") " pod="openstack-kuttl-tests/nova-cell0-ef54-account-create-update-b2vpk" Mar 16 16:00:13 crc kubenswrapper[5120]: I0316 16:00:13.230510 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/7e2bc91b-26c0-4506-8629-832872fb453f-operator-scripts\") pod \"root-account-create-update-6b7md\" (UID: \"7e2bc91b-26c0-4506-8629-832872fb453f\") " pod="openstack-kuttl-tests/root-account-create-update-6b7md" Mar 16 16:00:13 crc kubenswrapper[5120]: I0316 16:00:13.231427 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b7049577-d3a2-4125-b841-70c5f6e1da23-operator-scripts\") pod \"nova-cell1-dc27-account-create-update-2jjjz\" (UID: \"b7049577-d3a2-4125-b841-70c5f6e1da23\") " pod="openstack-kuttl-tests/nova-cell1-dc27-account-create-update-2jjjz" Mar 16 16:00:13 crc kubenswrapper[5120]: I0316 16:00:13.250509 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-mx7kq"] Mar 16 16:00:13 crc kubenswrapper[5120]: I0316 16:00:13.260933 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-ef54-account-create-update-bqpvb"] Mar 16 16:00:13 crc kubenswrapper[5120]: I0316 16:00:13.269577 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jx24\" (UniqueName: \"kubernetes.io/projected/7e2bc91b-26c0-4506-8629-832872fb453f-kube-api-access-2jx24\") pod \"root-account-create-update-6b7md\" (UID: \"7e2bc91b-26c0-4506-8629-832872fb453f\") " pod="openstack-kuttl-tests/root-account-create-update-6b7md" Mar 16 16:00:13 crc kubenswrapper[5120]: I0316 16:00:13.270003 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z58pz\" (UniqueName: \"kubernetes.io/projected/b7049577-d3a2-4125-b841-70c5f6e1da23-kube-api-access-z58pz\") pod \"nova-cell1-dc27-account-create-update-2jjjz\" (UID: \"b7049577-d3a2-4125-b841-70c5f6e1da23\") " pod="openstack-kuttl-tests/nova-cell1-dc27-account-create-update-2jjjz" Mar 16 16:00:13 crc kubenswrapper[5120]: I0316 16:00:13.274317 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-6b7md" Mar 16 16:00:13 crc kubenswrapper[5120]: I0316 16:00:13.279308 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-ef54-account-create-update-bqpvb"] Mar 16 16:00:13 crc kubenswrapper[5120]: I0316 16:00:13.287028 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 16:00:13 crc kubenswrapper[5120]: I0316 16:00:13.287310 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovn-northd-0" podUID="3a1fe07d-3cc8-4eea-8e8b-eb2807caa357" containerName="ovn-northd" containerID="cri-o://73fdaa6f98a1d0cecc065049ce5388e3add5f04f37ed5696274bbf8df19e57a5" gracePeriod=30 Mar 16 16:00:13 crc kubenswrapper[5120]: I0316 16:00:13.287774 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovn-northd-0" podUID="3a1fe07d-3cc8-4eea-8e8b-eb2807caa357" containerName="openstack-network-exporter" containerID="cri-o://8769703bd7ee632a3e2c4769a2f29d820d6492a20d3a07f5c473931055316ae6" gracePeriod=30 Mar 16 16:00:13 crc kubenswrapper[5120]: I0316 16:00:13.297503 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-ctwpk"] Mar 16 16:00:13 crc kubenswrapper[5120]: I0316 16:00:13.308819 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-38cb-account-create-update-mw2hg"] Mar 16 16:00:13 crc kubenswrapper[5120]: I0316 16:00:13.320794 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-ctwpk"] Mar 16 16:00:13 crc kubenswrapper[5120]: I0316 16:00:13.336362 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-38cb-account-create-update-mw2hg"] Mar 16 16:00:13 crc kubenswrapper[5120]: I0316 16:00:13.339192 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/14fb94bd-5ac0-4ea1-98bf-1980cebf6e4d-operator-scripts\") pod \"nova-cell0-ef54-account-create-update-b2vpk\" (UID: \"14fb94bd-5ac0-4ea1-98bf-1980cebf6e4d\") " pod="openstack-kuttl-tests/nova-cell0-ef54-account-create-update-b2vpk" Mar 16 16:00:13 crc kubenswrapper[5120]: I0316 16:00:13.339260 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tx7dn\" (UniqueName: \"kubernetes.io/projected/14fb94bd-5ac0-4ea1-98bf-1980cebf6e4d-kube-api-access-tx7dn\") pod \"nova-cell0-ef54-account-create-update-b2vpk\" (UID: \"14fb94bd-5ac0-4ea1-98bf-1980cebf6e4d\") " pod="openstack-kuttl-tests/nova-cell0-ef54-account-create-update-b2vpk" Mar 16 16:00:13 crc kubenswrapper[5120]: E0316 16:00:13.339913 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Mar 16 16:00:13 crc kubenswrapper[5120]: E0316 16:00:13.339996 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/492ba9f3-6479-432b-a2f4-cee712a51800-config-data podName:492ba9f3-6479-432b-a2f4-cee712a51800 nodeName:}" failed. No retries permitted until 2026-03-16 16:00:14.339975939 +0000 UTC m=+1716.493907596 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/492ba9f3-6479-432b-a2f4-cee712a51800-config-data") pod "rabbitmq-cell1-server-0" (UID: "492ba9f3-6479-432b-a2f4-cee712a51800") : configmap "rabbitmq-cell1-config-data" not found Mar 16 16:00:13 crc kubenswrapper[5120]: I0316 16:00:13.341114 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/14fb94bd-5ac0-4ea1-98bf-1980cebf6e4d-operator-scripts\") pod \"nova-cell0-ef54-account-create-update-b2vpk\" (UID: \"14fb94bd-5ac0-4ea1-98bf-1980cebf6e4d\") " pod="openstack-kuttl-tests/nova-cell0-ef54-account-create-update-b2vpk" Mar 16 16:00:13 crc kubenswrapper[5120]: I0316 16:00:13.350137 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 16:00:13 crc kubenswrapper[5120]: I0316 16:00:13.351204 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podUID="588c75bf-de6d-4608-8d63-85c81408a1e3" containerName="openstack-network-exporter" containerID="cri-o://450ae56285ae1f86aa35df717a2b979a8b9de5972d74bdb6c7310c8a52c811a3" gracePeriod=300 Mar 16 16:00:13 crc kubenswrapper[5120]: I0316 16:00:13.373013 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 16:00:13 crc kubenswrapper[5120]: I0316 16:00:13.386943 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-flwl9"] Mar 16 16:00:13 crc kubenswrapper[5120]: I0316 16:00:13.387608 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-79ea-account-create-update-nlbgs" Mar 16 16:00:13 crc kubenswrapper[5120]: I0316 16:00:13.393912 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-flwl9"] Mar 16 16:00:13 crc kubenswrapper[5120]: I0316 16:00:13.403937 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tx7dn\" (UniqueName: \"kubernetes.io/projected/14fb94bd-5ac0-4ea1-98bf-1980cebf6e4d-kube-api-access-tx7dn\") pod \"nova-cell0-ef54-account-create-update-b2vpk\" (UID: \"14fb94bd-5ac0-4ea1-98bf-1980cebf6e4d\") " pod="openstack-kuttl-tests/nova-cell0-ef54-account-create-update-b2vpk" Mar 16 16:00:13 crc kubenswrapper[5120]: I0316 16:00:13.404012 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-t9zsb"] Mar 16 16:00:13 crc kubenswrapper[5120]: I0316 16:00:13.415226 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-t9zsb"] Mar 16 16:00:13 crc kubenswrapper[5120]: I0316 16:00:13.428052 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-gbpjc"] Mar 16 16:00:13 crc kubenswrapper[5120]: I0316 16:00:13.432349 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-dc27-account-create-update-2jjjz" Mar 16 16:00:13 crc kubenswrapper[5120]: I0316 16:00:13.437976 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-gbpjc"] Mar 16 16:00:13 crc kubenswrapper[5120]: I0316 16:00:13.445703 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-57kth"] Mar 16 16:00:13 crc kubenswrapper[5120]: I0316 16:00:13.456923 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-57kth"] Mar 16 16:00:13 crc kubenswrapper[5120]: I0316 16:00:13.474711 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-ef54-account-create-update-b2vpk" Mar 16 16:00:13 crc kubenswrapper[5120]: I0316 16:00:13.513984 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podUID="588c75bf-de6d-4608-8d63-85c81408a1e3" containerName="ovsdbserver-sb" containerID="cri-o://5d526fe7f2a81cde0367c562baa67b6eaa605bb9da0cb25fb3bb2d2a88797c4f" gracePeriod=300 Mar 16 16:00:13 crc kubenswrapper[5120]: I0316 16:00:13.541214 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:00:13 crc kubenswrapper[5120]: I0316 16:00:13.541472 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="f80a9ef7-32f9-44c7-945c-d1ee96105c42" containerName="cinder-scheduler" containerID="cri-o://b6bb33f699db1e8b2ee47f375490efe9554f49f146ae7d1e564beba920058e1b" gracePeriod=30 Mar 16 16:00:13 crc kubenswrapper[5120]: I0316 16:00:13.541804 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="f80a9ef7-32f9-44c7-945c-d1ee96105c42" containerName="probe" containerID="cri-o://a8cc11b8ec51275761948543ede5d0db634e37eb551775e3622e1ea5aad55325" gracePeriod=30 Mar 16 16:00:13 crc kubenswrapper[5120]: E0316 16:00:13.559307 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-config-data: configmap "rabbitmq-config-data" not found Mar 16 16:00:13 crc kubenswrapper[5120]: E0316 16:00:13.559371 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b6cf92fd-a58b-4b50-9a61-35486c401d72-config-data podName:b6cf92fd-a58b-4b50-9a61-35486c401d72 nodeName:}" failed. No retries permitted until 2026-03-16 16:00:14.059354345 +0000 UTC m=+1716.213286002 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/b6cf92fd-a58b-4b50-9a61-35486c401d72-config-data") pod "rabbitmq-server-0" (UID: "b6cf92fd-a58b-4b50-9a61-35486c401d72") : configmap "rabbitmq-config-data" not found Mar 16 16:00:13 crc kubenswrapper[5120]: I0316 16:00:13.568449 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_f8f48fe3-091f-40a2-b580-69ba5cb95392/ovsdbserver-nb/0.log" Mar 16 16:00:13 crc kubenswrapper[5120]: I0316 16:00:13.568488 5120 generic.go:358] "Generic (PLEG): container finished" podID="f8f48fe3-091f-40a2-b580-69ba5cb95392" containerID="2e8f7cc02c3d7a129f99450acb5b341f91067daefe4059c6c5ae46388f70b8b6" exitCode=2 Mar 16 16:00:13 crc kubenswrapper[5120]: I0316 16:00:13.568502 5120 generic.go:358] "Generic (PLEG): container finished" podID="f8f48fe3-091f-40a2-b580-69ba5cb95392" containerID="dac788712cee13272c3b574a2a82410cb05db5c3ad287bdca48ecf5f046219a8" exitCode=143 Mar 16 16:00:13 crc kubenswrapper[5120]: I0316 16:00:13.569319 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"f8f48fe3-091f-40a2-b580-69ba5cb95392","Type":"ContainerDied","Data":"2e8f7cc02c3d7a129f99450acb5b341f91067daefe4059c6c5ae46388f70b8b6"} Mar 16 16:00:13 crc kubenswrapper[5120]: I0316 16:00:13.569355 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"f8f48fe3-091f-40a2-b580-69ba5cb95392","Type":"ContainerDied","Data":"dac788712cee13272c3b574a2a82410cb05db5c3ad287bdca48ecf5f046219a8"} Mar 16 16:00:13 crc kubenswrapper[5120]: I0316 16:00:13.569711 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_f8f48fe3-091f-40a2-b580-69ba5cb95392/ovsdbserver-nb/0.log" Mar 16 16:00:13 crc kubenswrapper[5120]: I0316 16:00:13.569814 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:00:13 crc kubenswrapper[5120]: I0316 16:00:13.572607 5120 generic.go:358] "Generic (PLEG): container finished" podID="3a1fe07d-3cc8-4eea-8e8b-eb2807caa357" containerID="8769703bd7ee632a3e2c4769a2f29d820d6492a20d3a07f5c473931055316ae6" exitCode=2 Mar 16 16:00:13 crc kubenswrapper[5120]: I0316 16:00:13.572651 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"3a1fe07d-3cc8-4eea-8e8b-eb2807caa357","Type":"ContainerDied","Data":"8769703bd7ee632a3e2c4769a2f29d820d6492a20d3a07f5c473931055316ae6"} Mar 16 16:00:13 crc kubenswrapper[5120]: I0316 16:00:13.582795 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:00:13 crc kubenswrapper[5120]: I0316 16:00:13.583052 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe" containerName="cinder-api-log" containerID="cri-o://d49fef7d81b2a23590eafc60fbe8293499b7ef16f3b6a651af145ba5b739fddb" gracePeriod=30 Mar 16 16:00:13 crc kubenswrapper[5120]: I0316 16:00:13.583094 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe" containerName="cinder-api" containerID="cri-o://de6448102abdb4a197aec79c6edbcf87239ec4fa8fcb0c35a90a2e25c9d9d138" gracePeriod=30 Mar 16 16:00:13 crc kubenswrapper[5120]: I0316 16:00:13.660701 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/f8f48fe3-091f-40a2-b580-69ba5cb95392-metrics-certs-tls-certs\") pod \"f8f48fe3-091f-40a2-b580-69ba5cb95392\" (UID: \"f8f48fe3-091f-40a2-b580-69ba5cb95392\") " Mar 16 16:00:13 crc kubenswrapper[5120]: I0316 16:00:13.661131 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/f8f48fe3-091f-40a2-b580-69ba5cb95392-ovsdb-rundir\") pod \"f8f48fe3-091f-40a2-b580-69ba5cb95392\" (UID: \"f8f48fe3-091f-40a2-b580-69ba5cb95392\") " Mar 16 16:00:13 crc kubenswrapper[5120]: I0316 16:00:13.661175 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jvbcr\" (UniqueName: \"kubernetes.io/projected/f8f48fe3-091f-40a2-b580-69ba5cb95392-kube-api-access-jvbcr\") pod \"f8f48fe3-091f-40a2-b580-69ba5cb95392\" (UID: \"f8f48fe3-091f-40a2-b580-69ba5cb95392\") " Mar 16 16:00:13 crc kubenswrapper[5120]: I0316 16:00:13.661221 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f8f48fe3-091f-40a2-b580-69ba5cb95392-config\") pod \"f8f48fe3-091f-40a2-b580-69ba5cb95392\" (UID: \"f8f48fe3-091f-40a2-b580-69ba5cb95392\") " Mar 16 16:00:13 crc kubenswrapper[5120]: I0316 16:00:13.661291 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/f8f48fe3-091f-40a2-b580-69ba5cb95392-scripts\") pod \"f8f48fe3-091f-40a2-b580-69ba5cb95392\" (UID: \"f8f48fe3-091f-40a2-b580-69ba5cb95392\") " Mar 16 16:00:13 crc kubenswrapper[5120]: I0316 16:00:13.661408 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f8f48fe3-091f-40a2-b580-69ba5cb95392-combined-ca-bundle\") pod \"f8f48fe3-091f-40a2-b580-69ba5cb95392\" (UID: \"f8f48fe3-091f-40a2-b580-69ba5cb95392\") " Mar 16 16:00:13 crc kubenswrapper[5120]: I0316 16:00:13.661474 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/f8f48fe3-091f-40a2-b580-69ba5cb95392-ovsdbserver-nb-tls-certs\") pod \"f8f48fe3-091f-40a2-b580-69ba5cb95392\" (UID: \"f8f48fe3-091f-40a2-b580-69ba5cb95392\") " Mar 16 16:00:13 crc kubenswrapper[5120]: I0316 16:00:13.661513 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovndbcluster-nb-etc-ovn\" (UniqueName: \"kubernetes.io/local-volume/local-storage15-crc\") pod \"f8f48fe3-091f-40a2-b580-69ba5cb95392\" (UID: \"f8f48fe3-091f-40a2-b580-69ba5cb95392\") " Mar 16 16:00:13 crc kubenswrapper[5120]: I0316 16:00:13.663670 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f8f48fe3-091f-40a2-b580-69ba5cb95392-config" (OuterVolumeSpecName: "config") pod "f8f48fe3-091f-40a2-b580-69ba5cb95392" (UID: "f8f48fe3-091f-40a2-b580-69ba5cb95392"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:00:13 crc kubenswrapper[5120]: I0316 16:00:13.664034 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8f48fe3-091f-40a2-b580-69ba5cb95392-ovsdb-rundir" (OuterVolumeSpecName: "ovsdb-rundir") pod "f8f48fe3-091f-40a2-b580-69ba5cb95392" (UID: "f8f48fe3-091f-40a2-b580-69ba5cb95392"). InnerVolumeSpecName "ovsdb-rundir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:00:13 crc kubenswrapper[5120]: I0316 16:00:13.669351 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage15-crc" (OuterVolumeSpecName: "ovndbcluster-nb-etc-ovn") pod "f8f48fe3-091f-40a2-b580-69ba5cb95392" (UID: "f8f48fe3-091f-40a2-b580-69ba5cb95392"). InnerVolumeSpecName "local-storage15-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:00:13 crc kubenswrapper[5120]: I0316 16:00:13.670564 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f8f48fe3-091f-40a2-b580-69ba5cb95392-scripts" (OuterVolumeSpecName: "scripts") pod "f8f48fe3-091f-40a2-b580-69ba5cb95392" (UID: "f8f48fe3-091f-40a2-b580-69ba5cb95392"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:00:13 crc kubenswrapper[5120]: I0316 16:00:13.709672 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8f48fe3-091f-40a2-b580-69ba5cb95392-kube-api-access-jvbcr" (OuterVolumeSpecName: "kube-api-access-jvbcr") pod "f8f48fe3-091f-40a2-b580-69ba5cb95392" (UID: "f8f48fe3-091f-40a2-b580-69ba5cb95392"). InnerVolumeSpecName "kube-api-access-jvbcr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:00:13 crc kubenswrapper[5120]: I0316 16:00:13.711960 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-8a54-account-create-update-9l5b7"] Mar 16 16:00:13 crc kubenswrapper[5120]: I0316 16:00:13.723802 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:00:13 crc kubenswrapper[5120]: I0316 16:00:13.724099 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="775fa932-80b8-4fd0-946e-09177e8710fb" containerName="glance-log" containerID="cri-o://9fdd34ccdb00204aa5ec64c642c353606f327596693b5828c3f17804d8ffd05b" gracePeriod=30 Mar 16 16:00:13 crc kubenswrapper[5120]: I0316 16:00:13.724255 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="775fa932-80b8-4fd0-946e-09177e8710fb" containerName="glance-httpd" containerID="cri-o://0feb858da0d000831a0f51e693005f06d2aba3f94d24c4b4c297b5568998a809" gracePeriod=30 Mar 16 16:00:13 crc kubenswrapper[5120]: I0316 16:00:13.769613 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-64b5fbbbdb-nrl4p"] Mar 16 16:00:13 crc kubenswrapper[5120]: I0316 16:00:13.773166 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-64b5fbbbdb-nrl4p" podUID="c3689d41-4ea9-4076-9b69-4a93be5896cf" containerName="placement-log" containerID="cri-o://ca1f5aaefb58de6d5c99abbb89a2f202aeabc9a7e3667dddb49bfe9cacae3d70" gracePeriod=30 Mar 16 16:00:13 crc kubenswrapper[5120]: I0316 16:00:13.774718 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-64b5fbbbdb-nrl4p" podUID="c3689d41-4ea9-4076-9b69-4a93be5896cf" containerName="placement-api" containerID="cri-o://73eca197695f5d5d863dcbcf7fb679830074e97a2e5cb045f9230766c397bd55" gracePeriod=30 Mar 16 16:00:13 crc kubenswrapper[5120]: I0316 16:00:13.780678 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage15-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage15-crc\") on node \"crc\" " Mar 16 16:00:13 crc kubenswrapper[5120]: I0316 16:00:13.780702 5120 reconciler_common.go:299] "Volume detached for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/f8f48fe3-091f-40a2-b580-69ba5cb95392-ovsdb-rundir\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:13 crc kubenswrapper[5120]: I0316 16:00:13.780715 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jvbcr\" (UniqueName: \"kubernetes.io/projected/f8f48fe3-091f-40a2-b580-69ba5cb95392-kube-api-access-jvbcr\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:13 crc kubenswrapper[5120]: I0316 16:00:13.780733 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f8f48fe3-091f-40a2-b580-69ba5cb95392-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:13 crc kubenswrapper[5120]: I0316 16:00:13.780742 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/f8f48fe3-091f-40a2-b580-69ba5cb95392-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:13 crc kubenswrapper[5120]: I0316 16:00:13.790843 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:00:13 crc kubenswrapper[5120]: I0316 16:00:13.791159 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="a0983bdb-df60-4951-aa31-672444ba7c32" containerName="glance-log" containerID="cri-o://796c0a9981d4c219b1f40e68d8b57bf4e6a3f5d3b026b0a47930e1eea94c43c8" gracePeriod=30 Mar 16 16:00:13 crc kubenswrapper[5120]: I0316 16:00:13.791642 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="a0983bdb-df60-4951-aa31-672444ba7c32" containerName="glance-httpd" containerID="cri-o://36112e54f7c3727e2e552937fcf3b649d839e6ece9f9a4e4e6b969952dbdd56b" gracePeriod=30 Mar 16 16:00:13 crc kubenswrapper[5120]: I0316 16:00:13.911186 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage15-crc" (UniqueName: "kubernetes.io/local-volume/local-storage15-crc") on node "crc" Mar 16 16:00:13 crc kubenswrapper[5120]: I0316 16:00:13.926838 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 16:00:13 crc kubenswrapper[5120]: I0316 16:00:13.929301 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="725b915c-7c39-43e6-8022-99dd14a6276e" containerName="account-server" containerID="cri-o://9065435fa0cbe38d798b7f599f263612ad1337c636838785105247be4e64c3c8" gracePeriod=30 Mar 16 16:00:13 crc kubenswrapper[5120]: I0316 16:00:13.929653 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="725b915c-7c39-43e6-8022-99dd14a6276e" containerName="container-updater" containerID="cri-o://e1e5609b43f9503028b31e0b3fda895e40ba4838567fb814822286e0b240187c" gracePeriod=30 Mar 16 16:00:13 crc kubenswrapper[5120]: I0316 16:00:13.929732 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="725b915c-7c39-43e6-8022-99dd14a6276e" containerName="container-auditor" containerID="cri-o://d3bcc1b7fd9e76c63c4579009f6a561f9ea39189bb67757e6ad92647e3d5cc00" gracePeriod=30 Mar 16 16:00:13 crc kubenswrapper[5120]: I0316 16:00:13.929799 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="725b915c-7c39-43e6-8022-99dd14a6276e" containerName="container-replicator" containerID="cri-o://45e2db9f2a2c31aac9bb2521e7a03b67f75500e9406349b0edc7767c1c3632f2" gracePeriod=30 Mar 16 16:00:13 crc kubenswrapper[5120]: I0316 16:00:13.929843 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="725b915c-7c39-43e6-8022-99dd14a6276e" containerName="container-server" containerID="cri-o://66d0d042587258a65188efea26738d109ef3471c78ed22bfed7030925260d9b8" gracePeriod=30 Mar 16 16:00:13 crc kubenswrapper[5120]: I0316 16:00:13.929647 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="725b915c-7c39-43e6-8022-99dd14a6276e" containerName="object-server" containerID="cri-o://9b91d7507fff9e107013c39056e451ffe12795d6ae267b2ef0a816bc5e272d34" gracePeriod=30 Mar 16 16:00:13 crc kubenswrapper[5120]: I0316 16:00:13.929925 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="725b915c-7c39-43e6-8022-99dd14a6276e" containerName="account-reaper" containerID="cri-o://71b59b87818e9c61e2898baf97bfa1f6e0a18889a07c5b10bca12a35e6a5d59a" gracePeriod=30 Mar 16 16:00:13 crc kubenswrapper[5120]: I0316 16:00:13.929967 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="725b915c-7c39-43e6-8022-99dd14a6276e" containerName="account-auditor" containerID="cri-o://262cd591bf64204d3ae5dd293546fa23e41d083f4d36ea5ae8c2081db5fe77fe" gracePeriod=30 Mar 16 16:00:13 crc kubenswrapper[5120]: I0316 16:00:13.930021 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="725b915c-7c39-43e6-8022-99dd14a6276e" containerName="account-replicator" containerID="cri-o://77ec9324e0dbe58ae4b2dc527047287f83714d98ac52687796abd8b39e40a66b" gracePeriod=30 Mar 16 16:00:13 crc kubenswrapper[5120]: I0316 16:00:13.930189 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="725b915c-7c39-43e6-8022-99dd14a6276e" containerName="object-expirer" containerID="cri-o://028ca00d7f3a02e0498607bc597f8a8dc18ccbcd5f27da0dbecccbdd32f01b06" gracePeriod=30 Mar 16 16:00:13 crc kubenswrapper[5120]: I0316 16:00:13.930262 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="725b915c-7c39-43e6-8022-99dd14a6276e" containerName="swift-recon-cron" containerID="cri-o://cb14563bca03394263c85e9a7621fecb106a313ab5894f960695d9bba681a3c8" gracePeriod=30 Mar 16 16:00:13 crc kubenswrapper[5120]: I0316 16:00:13.930328 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="725b915c-7c39-43e6-8022-99dd14a6276e" containerName="rsync" containerID="cri-o://762a260277f80c61150c72c781fdfadc157f11b49e278f6b091fc4317e1db456" gracePeriod=30 Mar 16 16:00:13 crc kubenswrapper[5120]: I0316 16:00:13.930628 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="725b915c-7c39-43e6-8022-99dd14a6276e" containerName="object-auditor" containerID="cri-o://fc8047922b83c19ce5ee5cd59a92fb79edc337b663b0951d81347220713d144a" gracePeriod=30 Mar 16 16:00:13 crc kubenswrapper[5120]: I0316 16:00:13.930692 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="725b915c-7c39-43e6-8022-99dd14a6276e" containerName="object-updater" containerID="cri-o://1e0c2e403fa140b74e5d0d79126181003e5bd471fd02d918d968352af679aa6b" gracePeriod=30 Mar 16 16:00:13 crc kubenswrapper[5120]: I0316 16:00:13.931363 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="725b915c-7c39-43e6-8022-99dd14a6276e" containerName="object-replicator" containerID="cri-o://381f5f488e15fab4b3389a7f56848e0549ffa22667f27135f0a5d27a2b9b593e" gracePeriod=30 Mar 16 16:00:13 crc kubenswrapper[5120]: I0316 16:00:13.938427 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f8f48fe3-091f-40a2-b580-69ba5cb95392-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f8f48fe3-091f-40a2-b580-69ba5cb95392" (UID: "f8f48fe3-091f-40a2-b580-69ba5cb95392"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:00:13 crc kubenswrapper[5120]: I0316 16:00:13.994946 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f8f48fe3-091f-40a2-b580-69ba5cb95392-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:13 crc kubenswrapper[5120]: I0316 16:00:13.994974 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage15-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage15-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.022210 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-db-create-fmbn7"] Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.083592 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f8f48fe3-091f-40a2-b580-69ba5cb95392-ovsdbserver-nb-tls-certs" (OuterVolumeSpecName: "ovsdbserver-nb-tls-certs") pod "f8f48fe3-091f-40a2-b580-69ba5cb95392" (UID: "f8f48fe3-091f-40a2-b580-69ba5cb95392"). InnerVolumeSpecName "ovsdbserver-nb-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.098236 5120 reconciler_common.go:299] "Volume detached for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/f8f48fe3-091f-40a2-b580-69ba5cb95392-ovsdbserver-nb-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:14 crc kubenswrapper[5120]: E0316 16:00:14.098463 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-config-data: configmap "rabbitmq-config-data" not found Mar 16 16:00:14 crc kubenswrapper[5120]: E0316 16:00:14.098600 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b6cf92fd-a58b-4b50-9a61-35486c401d72-config-data podName:b6cf92fd-a58b-4b50-9a61-35486c401d72 nodeName:}" failed. No retries permitted until 2026-03-16 16:00:15.098583699 +0000 UTC m=+1717.252515356 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/b6cf92fd-a58b-4b50-9a61-35486c401d72-config-data") pod "rabbitmq-server-0" (UID: "b6cf92fd-a58b-4b50-9a61-35486c401d72") : configmap "rabbitmq-config-data" not found Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.102207 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-db-create-fmbn7"] Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.128814 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-4zt99"] Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.135633 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-4zt99"] Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.144963 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-5477dfc7d6-r85w6"] Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.145478 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-5477dfc7d6-r85w6" podUID="65f5015a-d673-4a1d-bd09-c695f2b41a47" containerName="neutron-api" containerID="cri-o://4b60d781e4c4d04ce9cd5e3a15fb61c49894b5654ae98b63df546451d7ab3a2c" gracePeriod=30 Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.145873 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-5477dfc7d6-r85w6" podUID="65f5015a-d673-4a1d-bd09-c695f2b41a47" containerName="neutron-httpd" containerID="cri-o://e3ff05b6348b5b52f655f2e654b8bb92f34e8976b107f05b594ed2c6a0dd4dee" gracePeriod=30 Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.153721 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-3fc7-account-create-update-q9jx6"] Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.158986 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f8f48fe3-091f-40a2-b580-69ba5cb95392-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "f8f48fe3-091f-40a2-b580-69ba5cb95392" (UID: "f8f48fe3-091f-40a2-b580-69ba5cb95392"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.167406 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-3fc7-account-create-update-q9jx6"] Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.191984 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-db-create-d4dhh"] Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.201130 5120 reconciler_common.go:299] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/f8f48fe3-091f-40a2-b580-69ba5cb95392-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.224047 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-db-create-d4dhh"] Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.244165 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-mm5p4"] Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.263251 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8f48fe3-091f-40a2-b580-69ba5cb95392" containerName="openstack-network-exporter" Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.263284 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8f48fe3-091f-40a2-b580-69ba5cb95392" containerName="openstack-network-exporter" Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.263310 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8f48fe3-091f-40a2-b580-69ba5cb95392" containerName="ovsdbserver-nb" Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.263317 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8f48fe3-091f-40a2-b580-69ba5cb95392" containerName="ovsdbserver-nb" Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.263577 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f8f48fe3-091f-40a2-b580-69ba5cb95392" containerName="ovsdbserver-nb" Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.263587 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f8f48fe3-091f-40a2-b580-69ba5cb95392" containerName="openstack-network-exporter" Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.276088 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-db-create-gqzqj"] Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.276120 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-db-create-gqzqj"] Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.276273 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-mm5p4" Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.291605 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-mm5p4"] Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.302718 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vj6z9\" (UniqueName: \"kubernetes.io/projected/ca816558-dccc-44fa-aaa6-5a2070f1b25f-kube-api-access-vj6z9\") pod \"dnsmasq-dnsmasq-79dcd846c5-mm5p4\" (UID: \"ca816558-dccc-44fa-aaa6-5a2070f1b25f\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-mm5p4" Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.302822 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/ca816558-dccc-44fa-aaa6-5a2070f1b25f-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-79dcd846c5-mm5p4\" (UID: \"ca816558-dccc-44fa-aaa6-5a2070f1b25f\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-mm5p4" Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.302872 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ca816558-dccc-44fa-aaa6-5a2070f1b25f-config\") pod \"dnsmasq-dnsmasq-79dcd846c5-mm5p4\" (UID: \"ca816558-dccc-44fa-aaa6-5a2070f1b25f\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-mm5p4" Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.305536 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.305846 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="188dbfe0-6d71-4ba4-a3b7-6ee900a60138" containerName="nova-api-log" containerID="cri-o://41a2173d1d872cc17f3406c61f519f5887c310bc059bf9c62ba549c2902c7600" gracePeriod=30 Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.306018 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="188dbfe0-6d71-4ba4-a3b7-6ee900a60138" containerName="nova-api-api" containerID="cri-o://5cb5336eec2bc9d72af934b6fd40e9184ab80151a298a3a10de1976e1f86500b" gracePeriod=30 Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.330941 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-db-create-nh9pb"] Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.355410 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-db-create-nh9pb"] Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.366000 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.388416 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.388679 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="c568edd3-501f-4254-ae95-67946f898cd3" containerName="nova-metadata-log" containerID="cri-o://2b22006c50d5da36968915545fc025f97fb4e75c310ad215b4ef102ae8c5bf5c" gracePeriod=30 Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.389127 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="c568edd3-501f-4254-ae95-67946f898cd3" containerName="nova-metadata-metadata" containerID="cri-o://43900ca08144bf1b772b28160272d2ed488bb604fc3fbc4d53917a0d50806010" gracePeriod=30 Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.404522 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vj6z9\" (UniqueName: \"kubernetes.io/projected/ca816558-dccc-44fa-aaa6-5a2070f1b25f-kube-api-access-vj6z9\") pod \"dnsmasq-dnsmasq-79dcd846c5-mm5p4\" (UID: \"ca816558-dccc-44fa-aaa6-5a2070f1b25f\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-mm5p4" Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.404620 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/ca816558-dccc-44fa-aaa6-5a2070f1b25f-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-79dcd846c5-mm5p4\" (UID: \"ca816558-dccc-44fa-aaa6-5a2070f1b25f\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-mm5p4" Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.404676 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ca816558-dccc-44fa-aaa6-5a2070f1b25f-config\") pod \"dnsmasq-dnsmasq-79dcd846c5-mm5p4\" (UID: \"ca816558-dccc-44fa-aaa6-5a2070f1b25f\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-mm5p4" Mar 16 16:00:14 crc kubenswrapper[5120]: E0316 16:00:14.404900 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Mar 16 16:00:14 crc kubenswrapper[5120]: E0316 16:00:14.404957 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/492ba9f3-6479-432b-a2f4-cee712a51800-config-data podName:492ba9f3-6479-432b-a2f4-cee712a51800 nodeName:}" failed. No retries permitted until 2026-03-16 16:00:16.404940582 +0000 UTC m=+1718.558872239 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/492ba9f3-6479-432b-a2f4-cee712a51800-config-data") pod "rabbitmq-cell1-server-0" (UID: "492ba9f3-6479-432b-a2f4-cee712a51800") : configmap "rabbitmq-cell1-config-data" not found Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.410596 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ca816558-dccc-44fa-aaa6-5a2070f1b25f-config\") pod \"dnsmasq-dnsmasq-79dcd846c5-mm5p4\" (UID: \"ca816558-dccc-44fa-aaa6-5a2070f1b25f\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-mm5p4" Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.412419 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/ca816558-dccc-44fa-aaa6-5a2070f1b25f-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-79dcd846c5-mm5p4\" (UID: \"ca816558-dccc-44fa-aaa6-5a2070f1b25f\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-mm5p4" Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.441510 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-db-create-wkkpd"] Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.472957 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vj6z9\" (UniqueName: \"kubernetes.io/projected/ca816558-dccc-44fa-aaa6-5a2070f1b25f-kube-api-access-vj6z9\") pod \"dnsmasq-dnsmasq-79dcd846c5-mm5p4\" (UID: \"ca816558-dccc-44fa-aaa6-5a2070f1b25f\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-mm5p4" Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.484721 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-db-create-wkkpd"] Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.494806 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-79ea-account-create-update-nlbgs"] Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.512893 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-cj5jd"] Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.531249 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-cj5jd"] Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.539817 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-8a54-account-create-update-9l5b7"] Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.555928 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-snl2v"] Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.561065 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-snl2v"] Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.569022 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-ef54-account-create-update-b2vpk"] Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.578918 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-7k2zr"] Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.603962 5120 generic.go:358] "Generic (PLEG): container finished" podID="65f5015a-d673-4a1d-bd09-c695f2b41a47" containerID="e3ff05b6348b5b52f655f2e654b8bb92f34e8976b107f05b594ed2c6a0dd4dee" exitCode=0 Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.604373 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-5477dfc7d6-r85w6" event={"ID":"65f5015a-d673-4a1d-bd09-c695f2b41a47","Type":"ContainerDied","Data":"e3ff05b6348b5b52f655f2e654b8bb92f34e8976b107f05b594ed2c6a0dd4dee"} Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.614219 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-8a54-account-create-update-9l5b7" event={"ID":"ecfb18c4-5cb2-4ab6-8445-79c3eec250d8","Type":"ContainerStarted","Data":"b7515c49c371913073d8535d9e5fa690da67c551467efefb10f3a93b62aa56aa"} Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.631139 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-mm5p4" Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.635535 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-7k2zr"] Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.638317 5120 generic.go:358] "Generic (PLEG): container finished" podID="725b915c-7c39-43e6-8022-99dd14a6276e" containerID="762a260277f80c61150c72c781fdfadc157f11b49e278f6b091fc4317e1db456" exitCode=0 Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.638339 5120 generic.go:358] "Generic (PLEG): container finished" podID="725b915c-7c39-43e6-8022-99dd14a6276e" containerID="028ca00d7f3a02e0498607bc597f8a8dc18ccbcd5f27da0dbecccbdd32f01b06" exitCode=0 Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.638346 5120 generic.go:358] "Generic (PLEG): container finished" podID="725b915c-7c39-43e6-8022-99dd14a6276e" containerID="1e0c2e403fa140b74e5d0d79126181003e5bd471fd02d918d968352af679aa6b" exitCode=0 Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.638352 5120 generic.go:358] "Generic (PLEG): container finished" podID="725b915c-7c39-43e6-8022-99dd14a6276e" containerID="fc8047922b83c19ce5ee5cd59a92fb79edc337b663b0951d81347220713d144a" exitCode=0 Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.638357 5120 generic.go:358] "Generic (PLEG): container finished" podID="725b915c-7c39-43e6-8022-99dd14a6276e" containerID="381f5f488e15fab4b3389a7f56848e0549ffa22667f27135f0a5d27a2b9b593e" exitCode=0 Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.638363 5120 generic.go:358] "Generic (PLEG): container finished" podID="725b915c-7c39-43e6-8022-99dd14a6276e" containerID="e1e5609b43f9503028b31e0b3fda895e40ba4838567fb814822286e0b240187c" exitCode=0 Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.638369 5120 generic.go:358] "Generic (PLEG): container finished" podID="725b915c-7c39-43e6-8022-99dd14a6276e" containerID="d3bcc1b7fd9e76c63c4579009f6a561f9ea39189bb67757e6ad92647e3d5cc00" exitCode=0 Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.638375 5120 generic.go:358] "Generic (PLEG): container finished" podID="725b915c-7c39-43e6-8022-99dd14a6276e" containerID="45e2db9f2a2c31aac9bb2521e7a03b67f75500e9406349b0edc7767c1c3632f2" exitCode=0 Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.638380 5120 generic.go:358] "Generic (PLEG): container finished" podID="725b915c-7c39-43e6-8022-99dd14a6276e" containerID="71b59b87818e9c61e2898baf97bfa1f6e0a18889a07c5b10bca12a35e6a5d59a" exitCode=0 Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.638385 5120 generic.go:358] "Generic (PLEG): container finished" podID="725b915c-7c39-43e6-8022-99dd14a6276e" containerID="262cd591bf64204d3ae5dd293546fa23e41d083f4d36ea5ae8c2081db5fe77fe" exitCode=0 Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.638390 5120 generic.go:358] "Generic (PLEG): container finished" podID="725b915c-7c39-43e6-8022-99dd14a6276e" containerID="77ec9324e0dbe58ae4b2dc527047287f83714d98ac52687796abd8b39e40a66b" exitCode=0 Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.638459 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"725b915c-7c39-43e6-8022-99dd14a6276e","Type":"ContainerDied","Data":"762a260277f80c61150c72c781fdfadc157f11b49e278f6b091fc4317e1db456"} Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.638482 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"725b915c-7c39-43e6-8022-99dd14a6276e","Type":"ContainerDied","Data":"028ca00d7f3a02e0498607bc597f8a8dc18ccbcd5f27da0dbecccbdd32f01b06"} Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.638492 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"725b915c-7c39-43e6-8022-99dd14a6276e","Type":"ContainerDied","Data":"1e0c2e403fa140b74e5d0d79126181003e5bd471fd02d918d968352af679aa6b"} Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.638500 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"725b915c-7c39-43e6-8022-99dd14a6276e","Type":"ContainerDied","Data":"fc8047922b83c19ce5ee5cd59a92fb79edc337b663b0951d81347220713d144a"} Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.638508 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"725b915c-7c39-43e6-8022-99dd14a6276e","Type":"ContainerDied","Data":"381f5f488e15fab4b3389a7f56848e0549ffa22667f27135f0a5d27a2b9b593e"} Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.638516 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"725b915c-7c39-43e6-8022-99dd14a6276e","Type":"ContainerDied","Data":"e1e5609b43f9503028b31e0b3fda895e40ba4838567fb814822286e0b240187c"} Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.638524 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"725b915c-7c39-43e6-8022-99dd14a6276e","Type":"ContainerDied","Data":"d3bcc1b7fd9e76c63c4579009f6a561f9ea39189bb67757e6ad92647e3d5cc00"} Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.638532 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"725b915c-7c39-43e6-8022-99dd14a6276e","Type":"ContainerDied","Data":"45e2db9f2a2c31aac9bb2521e7a03b67f75500e9406349b0edc7767c1c3632f2"} Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.638540 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"725b915c-7c39-43e6-8022-99dd14a6276e","Type":"ContainerDied","Data":"71b59b87818e9c61e2898baf97bfa1f6e0a18889a07c5b10bca12a35e6a5d59a"} Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.638548 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"725b915c-7c39-43e6-8022-99dd14a6276e","Type":"ContainerDied","Data":"262cd591bf64204d3ae5dd293546fa23e41d083f4d36ea5ae8c2081db5fe77fe"} Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.638557 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"725b915c-7c39-43e6-8022-99dd14a6276e","Type":"ContainerDied","Data":"77ec9324e0dbe58ae4b2dc527047287f83714d98ac52687796abd8b39e40a66b"} Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.642881 5120 generic.go:358] "Generic (PLEG): container finished" podID="188dbfe0-6d71-4ba4-a3b7-6ee900a60138" containerID="41a2173d1d872cc17f3406c61f519f5887c310bc059bf9c62ba549c2902c7600" exitCode=143 Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.642955 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"188dbfe0-6d71-4ba4-a3b7-6ee900a60138","Type":"ContainerDied","Data":"41a2173d1d872cc17f3406c61f519f5887c310bc059bf9c62ba549c2902c7600"} Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.648832 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_588c75bf-de6d-4608-8d63-85c81408a1e3/ovsdbserver-sb/0.log" Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.649162 5120 generic.go:358] "Generic (PLEG): container finished" podID="588c75bf-de6d-4608-8d63-85c81408a1e3" containerID="450ae56285ae1f86aa35df717a2b979a8b9de5972d74bdb6c7310c8a52c811a3" exitCode=2 Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.649226 5120 generic.go:358] "Generic (PLEG): container finished" podID="588c75bf-de6d-4608-8d63-85c81408a1e3" containerID="5d526fe7f2a81cde0367c562baa67b6eaa605bb9da0cb25fb3bb2d2a88797c4f" exitCode=143 Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.649444 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"588c75bf-de6d-4608-8d63-85c81408a1e3","Type":"ContainerDied","Data":"450ae56285ae1f86aa35df717a2b979a8b9de5972d74bdb6c7310c8a52c811a3"} Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.649540 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"588c75bf-de6d-4608-8d63-85c81408a1e3","Type":"ContainerDied","Data":"5d526fe7f2a81cde0367c562baa67b6eaa605bb9da0cb25fb3bb2d2a88797c4f"} Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.652326 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-dc27-account-create-update-2jjjz"] Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.672185 5120 generic.go:358] "Generic (PLEG): container finished" podID="b5ed0fd6-65dd-4480-acce-2eb38249add6" containerID="faa88e5970c0bf9c643f2180f59a90ed1f8b8a4a6cfd93741f962f1d1a9cacdc" exitCode=137 Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.678033 5120 generic.go:358] "Generic (PLEG): container finished" podID="c568edd3-501f-4254-ae95-67946f898cd3" containerID="2b22006c50d5da36968915545fc025f97fb4e75c310ad215b4ef102ae8c5bf5c" exitCode=143 Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.685359 5120 generic.go:358] "Generic (PLEG): container finished" podID="c3689d41-4ea9-4076-9b69-4a93be5896cf" containerID="ca1f5aaefb58de6d5c99abbb89a2f202aeabc9a7e3667dddb49bfe9cacae3d70" exitCode=143 Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.696183 5120 generic.go:358] "Generic (PLEG): container finished" podID="a0983bdb-df60-4951-aa31-672444ba7c32" containerID="796c0a9981d4c219b1f40e68d8b57bf4e6a3f5d3b026b0a47930e1eea94c43c8" exitCode=143 Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.700530 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_f8f48fe3-091f-40a2-b580-69ba5cb95392/ovsdbserver-nb/0.log" Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.700732 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.701352 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b26707e-d8ca-4286-aa82-d91fa16c7a10" path="/var/lib/kubelet/pods/0b26707e-d8ca-4286-aa82-d91fa16c7a10/volumes" Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.705481 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="16251914-f9cf-4313-9b3b-27435ea05123" path="/var/lib/kubelet/pods/16251914-f9cf-4313-9b3b-27435ea05123/volumes" Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.706237 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="255a48fb-770e-45fa-8713-8f5c5dcb2a5c" path="/var/lib/kubelet/pods/255a48fb-770e-45fa-8713-8f5c5dcb2a5c/volumes" Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.706943 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="32b14c32-be65-4d58-bb92-d61da48cc992" path="/var/lib/kubelet/pods/32b14c32-be65-4d58-bb92-d61da48cc992/volumes" Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.708559 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3caac7df-6311-46c7-bb2c-4aab1caf55fb" path="/var/lib/kubelet/pods/3caac7df-6311-46c7-bb2c-4aab1caf55fb/volumes" Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.708841 5120 generic.go:358] "Generic (PLEG): container finished" podID="1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe" containerID="d49fef7d81b2a23590eafc60fbe8293499b7ef16f3b6a651af145ba5b739fddb" exitCode=143 Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.709878 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3f138acc-5d5b-4b31-ada9-a7943b9ed432" path="/var/lib/kubelet/pods/3f138acc-5d5b-4b31-ada9-a7943b9ed432/volumes" Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.710558 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="43739814-c000-496f-bbfa-840c9297c136" path="/var/lib/kubelet/pods/43739814-c000-496f-bbfa-840c9297c136/volumes" Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.711195 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="461d1c44-31c5-45b2-8f2e-ecf239cb7b1e" path="/var/lib/kubelet/pods/461d1c44-31c5-45b2-8f2e-ecf239cb7b1e/volumes" Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.712423 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="512ae1aa-4bdc-4ad0-a53c-f694c3e56583" path="/var/lib/kubelet/pods/512ae1aa-4bdc-4ad0-a53c-f694c3e56583/volumes" Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.712913 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="613105e4-7e4e-41ad-adfa-de8fa43b93f2" path="/var/lib/kubelet/pods/613105e4-7e4e-41ad-adfa-de8fa43b93f2/volumes" Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.713012 5120 generic.go:358] "Generic (PLEG): container finished" podID="775fa932-80b8-4fd0-946e-09177e8710fb" containerID="9fdd34ccdb00204aa5ec64c642c353606f327596693b5828c3f17804d8ffd05b" exitCode=143 Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.714039 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a021027-056a-410b-aab4-8d8aff25b21a" path="/var/lib/kubelet/pods/6a021027-056a-410b-aab4-8d8aff25b21a/volumes" Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.715200 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/openstack-cell1-galera-0" podUID="48b9c79e-2a39-4fa1-9143-e4175c7b45b2" containerName="galera" containerID="cri-o://94a873fd2b944f420b88e4b9e672ad596d411c27b15f3cb17cf449dd38652633" gracePeriod=30 Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.716005 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7a212c23-f62a-4cb8-9c48-723d3aa714d6" path="/var/lib/kubelet/pods/7a212c23-f62a-4cb8-9c48-723d3aa714d6/volumes" Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.716504 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7f39a386-dfd6-4e99-8fff-84323615eb1c" path="/var/lib/kubelet/pods/7f39a386-dfd6-4e99-8fff-84323615eb1c/volumes" Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.717113 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8076c13b-f4f2-47fa-93f7-df2310ab04dc" path="/var/lib/kubelet/pods/8076c13b-f4f2-47fa-93f7-df2310ab04dc/volumes" Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.717586 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8d7af5d0-3283-41d8-9e35-fa6a70fceb0a" path="/var/lib/kubelet/pods/8d7af5d0-3283-41d8-9e35-fa6a70fceb0a/volumes" Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.719981 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="afbd55dc-1c35-4749-860a-dcebcfefca25" path="/var/lib/kubelet/pods/afbd55dc-1c35-4749-860a-dcebcfefca25/volumes" Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.725022 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b7d40cc2-92b3-4f31-ad96-d8a11157d035" path="/var/lib/kubelet/pods/b7d40cc2-92b3-4f31-ad96-d8a11157d035/volumes" Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.727971 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba54f8ef-0972-4ee4-b3e8-d33636032701" path="/var/lib/kubelet/pods/ba54f8ef-0972-4ee4-b3e8-d33636032701/volumes" Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.728987 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bf2e272a-e1d5-4e5f-b5a0-5865cd23bdde" path="/var/lib/kubelet/pods/bf2e272a-e1d5-4e5f-b5a0-5865cd23bdde/volumes" Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.730079 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e3d90a02-e510-46ee-b65f-1ac0c36060ce" path="/var/lib/kubelet/pods/e3d90a02-e510-46ee-b65f-1ac0c36060ce/volumes" Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.731299 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="efbef5eb-902c-46b3-ba4c-5c31917acf20" path="/var/lib/kubelet/pods/efbef5eb-902c-46b3-ba4c-5c31917acf20/volumes" Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.734320 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f0286c00-e671-4cf1-874d-eff999eba015" path="/var/lib/kubelet/pods/f0286c00-e671-4cf1-874d-eff999eba015/volumes" Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.735081 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.735117 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-6b7md"] Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.735127 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-54b7655659-bqszk"] Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.735160 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-85c489687d-pcp6w"] Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.735173 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-bcc6c568d-dqmvk"] Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.735187 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"c568edd3-501f-4254-ae95-67946f898cd3","Type":"ContainerDied","Data":"2b22006c50d5da36968915545fc025f97fb4e75c310ad215b4ef102ae8c5bf5c"} Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.735488 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-64b5fbbbdb-nrl4p" event={"ID":"c3689d41-4ea9-4076-9b69-4a93be5896cf","Type":"ContainerDied","Data":"ca1f5aaefb58de6d5c99abbb89a2f202aeabc9a7e3667dddb49bfe9cacae3d70"} Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.735514 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"a0983bdb-df60-4951-aa31-672444ba7c32","Type":"ContainerDied","Data":"796c0a9981d4c219b1f40e68d8b57bf4e6a3f5d3b026b0a47930e1eea94c43c8"} Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.735528 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"f8f48fe3-091f-40a2-b580-69ba5cb95392","Type":"ContainerDied","Data":"b393ede14b94fc02893f2851955346984ca60c47a2f0e0264859b3fd615787d4"} Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.735561 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe","Type":"ContainerDied","Data":"d49fef7d81b2a23590eafc60fbe8293499b7ef16f3b6a651af145ba5b739fddb"} Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.735580 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"775fa932-80b8-4fd0-946e-09177e8710fb","Type":"ContainerDied","Data":"9fdd34ccdb00204aa5ec64c642c353606f327596693b5828c3f17804d8ffd05b"} Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.735604 5120 scope.go:117] "RemoveContainer" containerID="2e8f7cc02c3d7a129f99450acb5b341f91067daefe4059c6c5ae46388f70b8b6" Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.736244 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-54b7655659-bqszk" podUID="fc59410f-18f6-4de8-b0f9-d54fcaea8faf" containerName="barbican-worker-log" containerID="cri-o://1776e0f291f7fa8432d2e5511c3d988212237dc71753bffedc712fbe9bb9ab04" gracePeriod=30 Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.736480 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-85c489687d-pcp6w" podUID="b3794e20-01dd-453a-bf29-20813144c61b" containerName="barbican-keystone-listener-log" containerID="cri-o://8e8fbd7afb6b4def81fe53673306c45558e83d21c714994987a7ead7c9d14080" gracePeriod=30 Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.736565 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-54b7655659-bqszk" podUID="fc59410f-18f6-4de8-b0f9-d54fcaea8faf" containerName="barbican-worker" containerID="cri-o://a6fa07bc0f02cb03d8fcdf8ab981b8a547194306c2f75b1a463d7c6f09841cdf" gracePeriod=30 Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.736605 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-bcc6c568d-dqmvk" podUID="ea0301d9-a692-4b65-ba34-5e989769d02c" containerName="barbican-api-log" containerID="cri-o://586bc7a04e27dd8d1aa0558b163f524487e412f155988226de43eca06d6c8b1e" gracePeriod=30 Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.736651 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-85c489687d-pcp6w" podUID="b3794e20-01dd-453a-bf29-20813144c61b" containerName="barbican-keystone-listener" containerID="cri-o://755cfaa0ce8ac81606545022847fbe8cfb9de5f7c904952f36310b83f8c76f03" gracePeriod=30 Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.736664 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-bcc6c568d-dqmvk" podUID="ea0301d9-a692-4b65-ba34-5e989769d02c" containerName="barbican-api" containerID="cri-o://8b21d045c26ecdd9743611e46a46a194f9882c136e56843ba91195604f46f37b" gracePeriod=30 Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.766426 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.766736 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podUID="5f40aae9-22bd-4ef7-b5ac-a68a1f729482" containerName="nova-cell1-novncproxy-novncproxy" containerID="cri-o://d7bcbc11d57f7b382223d2be2730aa8ce601aa8b7b76169a7c140d7502ae92ac" gracePeriod=30 Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.810318 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" podUID="492ba9f3-6479-432b-a2f4-cee712a51800" containerName="rabbitmq" containerID="cri-o://b3ca6adfc0432b1a1565a9b61882489441af5da7f78d4fb022760226ebb1dd18" gracePeriod=604800 Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.810523 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-6b7md"] Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.856967 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.878884 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.879143 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="ca4a5201-32c6-4c58-8bac-4d1b05ddfbb4" containerName="nova-scheduler-scheduler" containerID="cri-o://b2dd99f48a5e6c36c5d9b0bed8c62972ff65efc2c08b8a4c56e6c1ee763db013" gracePeriod=30 Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.894688 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-ef54-account-create-update-b2vpk"] Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.925992 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-np2mc"] Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.948831 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.949138 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="63972b06-4c5e-40e4-a318-8e5f3e286ece" containerName="nova-cell1-conductor-conductor" containerID="cri-o://6b9d4e9dc1d3160e9abb2e9af3ed540f0c1e83d09c814ee53e6dfb172f8914f5" gracePeriod=30 Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.952529 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-np2mc"] Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.958974 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/rabbitmq-server-0" podUID="b6cf92fd-a58b-4b50-9a61-35486c401d72" containerName="rabbitmq" containerID="cri-o://8f995598e1e74ed1367783ec0b36f25d55ac74ba4980ad5bce48d0ab5392311e" gracePeriod=604800 Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.984823 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:00:14 crc kubenswrapper[5120]: I0316 16:00:14.985098 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="5da6e8f8-fa80-477a-bbf9-0e251dd24153" containerName="nova-cell0-conductor-conductor" containerID="cri-o://b69196aca7077e660b738179840f4cffce2c72a012a2f8f0a16939792591c08e" gracePeriod=30 Mar 16 16:00:15 crc kubenswrapper[5120]: I0316 16:00:15.005824 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-fn6fc"] Mar 16 16:00:15 crc kubenswrapper[5120]: I0316 16:00:15.014543 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-79ea-account-create-update-nlbgs"] Mar 16 16:00:15 crc kubenswrapper[5120]: I0316 16:00:15.025823 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-fn6fc"] Mar 16 16:00:15 crc kubenswrapper[5120]: I0316 16:00:15.034368 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 16:00:15 crc kubenswrapper[5120]: E0316 16:00:15.052078 5120 kuberuntime_manager.go:1358] "Unhandled Error" err=< Mar 16 16:00:15 crc kubenswrapper[5120]: container &Container{Name:mariadb-account-create-update,Image:quay.io/podified-antelope-centos9/openstack-mariadb@sha256:4caef2b55e01b9a7ee88a22bc69db1893521a91d95c7ad4c8e593f14f17a5f95,Command:[/bin/sh -c #!/bin/bash Mar 16 16:00:15 crc kubenswrapper[5120]: Mar 16 16:00:15 crc kubenswrapper[5120]: MYSQL_REMOTE_HOST="" source /var/lib/operator-scripts/mysql_root_auth.sh Mar 16 16:00:15 crc kubenswrapper[5120]: Mar 16 16:00:15 crc kubenswrapper[5120]: export DatabasePassword=${DatabasePassword:?"Please specify a DatabasePassword variable."} Mar 16 16:00:15 crc kubenswrapper[5120]: Mar 16 16:00:15 crc kubenswrapper[5120]: MYSQL_CMD="mysql -h -u root -P 3306" Mar 16 16:00:15 crc kubenswrapper[5120]: Mar 16 16:00:15 crc kubenswrapper[5120]: if [ -n "nova_api" ]; then Mar 16 16:00:15 crc kubenswrapper[5120]: GRANT_DATABASE="nova_api" Mar 16 16:00:15 crc kubenswrapper[5120]: else Mar 16 16:00:15 crc kubenswrapper[5120]: GRANT_DATABASE="*" Mar 16 16:00:15 crc kubenswrapper[5120]: fi Mar 16 16:00:15 crc kubenswrapper[5120]: Mar 16 16:00:15 crc kubenswrapper[5120]: # going for maximum compatibility here: Mar 16 16:00:15 crc kubenswrapper[5120]: # 1. MySQL 8 no longer allows implicit create user when GRANT is used Mar 16 16:00:15 crc kubenswrapper[5120]: # 2. MariaDB has "CREATE OR REPLACE", but MySQL does not Mar 16 16:00:15 crc kubenswrapper[5120]: # 3. create user with CREATE but then do all password and TLS with ALTER to Mar 16 16:00:15 crc kubenswrapper[5120]: # support updates Mar 16 16:00:15 crc kubenswrapper[5120]: Mar 16 16:00:15 crc kubenswrapper[5120]: $MYSQL_CMD < logger="UnhandledError" Mar 16 16:00:15 crc kubenswrapper[5120]: E0316 16:00:15.054175 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"mariadb-account-create-update\" with CreateContainerConfigError: \"secret \\\"nova-api-db-secret\\\" not found\"" pod="openstack-kuttl-tests/nova-api-8a54-account-create-update-9l5b7" podUID="ecfb18c4-5cb2-4ab6-8445-79c3eec250d8" Mar 16 16:00:15 crc kubenswrapper[5120]: I0316 16:00:15.061061 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 16:00:15 crc kubenswrapper[5120]: I0316 16:00:15.115161 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-dc27-account-create-update-2jjjz"] Mar 16 16:00:15 crc kubenswrapper[5120]: E0316 16:00:15.141426 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-config-data: configmap "rabbitmq-config-data" not found Mar 16 16:00:15 crc kubenswrapper[5120]: E0316 16:00:15.141509 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b6cf92fd-a58b-4b50-9a61-35486c401d72-config-data podName:b6cf92fd-a58b-4b50-9a61-35486c401d72 nodeName:}" failed. No retries permitted until 2026-03-16 16:00:17.141493414 +0000 UTC m=+1719.295425061 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/b6cf92fd-a58b-4b50-9a61-35486c401d72-config-data") pod "rabbitmq-server-0" (UID: "b6cf92fd-a58b-4b50-9a61-35486c401d72") : configmap "rabbitmq-config-data" not found Mar 16 16:00:15 crc kubenswrapper[5120]: I0316 16:00:15.157627 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 16:00:15 crc kubenswrapper[5120]: I0316 16:00:15.157920 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/kube-state-metrics-0" podUID="08f284b7-104e-4395-b9cc-7c8acf4b943e" containerName="kube-state-metrics" containerID="cri-o://8f0c678e052c56ea5916115f262b647c8634ba2b451635a3702fc27a5161c88c" gracePeriod=30 Mar 16 16:00:15 crc kubenswrapper[5120]: I0316 16:00:15.163082 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_588c75bf-de6d-4608-8d63-85c81408a1e3/ovsdbserver-sb/0.log" Mar 16 16:00:15 crc kubenswrapper[5120]: I0316 16:00:15.163149 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:00:15 crc kubenswrapper[5120]: I0316 16:00:15.185084 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:00:15 crc kubenswrapper[5120]: I0316 16:00:15.185397 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="1d8cf310-88d2-4a5c-a2d9-2807cd409f37" containerName="ceilometer-central-agent" containerID="cri-o://5947f9d479cbbe03d5e81c795fe4598420a5ae0c722f314229b64194063a5d8f" gracePeriod=30 Mar 16 16:00:15 crc kubenswrapper[5120]: I0316 16:00:15.185572 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="1d8cf310-88d2-4a5c-a2d9-2807cd409f37" containerName="proxy-httpd" containerID="cri-o://225178e952b315c5893292df5f1de300801aa1d4aa5ddd4097d9a84deac77bb4" gracePeriod=30 Mar 16 16:00:15 crc kubenswrapper[5120]: I0316 16:00:15.185621 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="1d8cf310-88d2-4a5c-a2d9-2807cd409f37" containerName="sg-core" containerID="cri-o://cd64ff6d1522e78a36e711e1d6c63dfc1b9549659dfe87de0c90878031eefbbf" gracePeriod=30 Mar 16 16:00:15 crc kubenswrapper[5120]: I0316 16:00:15.185652 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="1d8cf310-88d2-4a5c-a2d9-2807cd409f37" containerName="ceilometer-notification-agent" containerID="cri-o://341049f42f477d50d61b6b0313212a767638ec69f7b505bb6a919d1797bdd5bd" gracePeriod=30 Mar 16 16:00:15 crc kubenswrapper[5120]: I0316 16:00:15.249428 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovndbcluster-sb-etc-ovn\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"588c75bf-de6d-4608-8d63-85c81408a1e3\" (UID: \"588c75bf-de6d-4608-8d63-85c81408a1e3\") " Mar 16 16:00:15 crc kubenswrapper[5120]: I0316 16:00:15.249499 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/588c75bf-de6d-4608-8d63-85c81408a1e3-scripts\") pod \"588c75bf-de6d-4608-8d63-85c81408a1e3\" (UID: \"588c75bf-de6d-4608-8d63-85c81408a1e3\") " Mar 16 16:00:15 crc kubenswrapper[5120]: I0316 16:00:15.249523 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/588c75bf-de6d-4608-8d63-85c81408a1e3-ovsdbserver-sb-tls-certs\") pod \"588c75bf-de6d-4608-8d63-85c81408a1e3\" (UID: \"588c75bf-de6d-4608-8d63-85c81408a1e3\") " Mar 16 16:00:15 crc kubenswrapper[5120]: I0316 16:00:15.249679 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/588c75bf-de6d-4608-8d63-85c81408a1e3-config\") pod \"588c75bf-de6d-4608-8d63-85c81408a1e3\" (UID: \"588c75bf-de6d-4608-8d63-85c81408a1e3\") " Mar 16 16:00:15 crc kubenswrapper[5120]: I0316 16:00:15.249703 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/588c75bf-de6d-4608-8d63-85c81408a1e3-combined-ca-bundle\") pod \"588c75bf-de6d-4608-8d63-85c81408a1e3\" (UID: \"588c75bf-de6d-4608-8d63-85c81408a1e3\") " Mar 16 16:00:15 crc kubenswrapper[5120]: I0316 16:00:15.249770 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/588c75bf-de6d-4608-8d63-85c81408a1e3-ovsdb-rundir\") pod \"588c75bf-de6d-4608-8d63-85c81408a1e3\" (UID: \"588c75bf-de6d-4608-8d63-85c81408a1e3\") " Mar 16 16:00:15 crc kubenswrapper[5120]: I0316 16:00:15.249909 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z7vmn\" (UniqueName: \"kubernetes.io/projected/588c75bf-de6d-4608-8d63-85c81408a1e3-kube-api-access-z7vmn\") pod \"588c75bf-de6d-4608-8d63-85c81408a1e3\" (UID: \"588c75bf-de6d-4608-8d63-85c81408a1e3\") " Mar 16 16:00:15 crc kubenswrapper[5120]: I0316 16:00:15.249933 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/588c75bf-de6d-4608-8d63-85c81408a1e3-metrics-certs-tls-certs\") pod \"588c75bf-de6d-4608-8d63-85c81408a1e3\" (UID: \"588c75bf-de6d-4608-8d63-85c81408a1e3\") " Mar 16 16:00:15 crc kubenswrapper[5120]: I0316 16:00:15.251940 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/588c75bf-de6d-4608-8d63-85c81408a1e3-config" (OuterVolumeSpecName: "config") pod "588c75bf-de6d-4608-8d63-85c81408a1e3" (UID: "588c75bf-de6d-4608-8d63-85c81408a1e3"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:00:15 crc kubenswrapper[5120]: I0316 16:00:15.252117 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/588c75bf-de6d-4608-8d63-85c81408a1e3-ovsdb-rundir" (OuterVolumeSpecName: "ovsdb-rundir") pod "588c75bf-de6d-4608-8d63-85c81408a1e3" (UID: "588c75bf-de6d-4608-8d63-85c81408a1e3"). InnerVolumeSpecName "ovsdb-rundir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:00:15 crc kubenswrapper[5120]: I0316 16:00:15.260272 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/588c75bf-de6d-4608-8d63-85c81408a1e3-scripts" (OuterVolumeSpecName: "scripts") pod "588c75bf-de6d-4608-8d63-85c81408a1e3" (UID: "588c75bf-de6d-4608-8d63-85c81408a1e3"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:00:15 crc kubenswrapper[5120]: I0316 16:00:15.288398 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/588c75bf-de6d-4608-8d63-85c81408a1e3-kube-api-access-z7vmn" (OuterVolumeSpecName: "kube-api-access-z7vmn") pod "588c75bf-de6d-4608-8d63-85c81408a1e3" (UID: "588c75bf-de6d-4608-8d63-85c81408a1e3"). InnerVolumeSpecName "kube-api-access-z7vmn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:00:15 crc kubenswrapper[5120]: I0316 16:00:15.296662 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage05-crc" (OuterVolumeSpecName: "ovndbcluster-sb-etc-ovn") pod "588c75bf-de6d-4608-8d63-85c81408a1e3" (UID: "588c75bf-de6d-4608-8d63-85c81408a1e3"). InnerVolumeSpecName "local-storage05-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:00:15 crc kubenswrapper[5120]: I0316 16:00:15.336375 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/588c75bf-de6d-4608-8d63-85c81408a1e3-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "588c75bf-de6d-4608-8d63-85c81408a1e3" (UID: "588c75bf-de6d-4608-8d63-85c81408a1e3"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:00:15 crc kubenswrapper[5120]: I0316 16:00:15.352686 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/588c75bf-de6d-4608-8d63-85c81408a1e3-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:15 crc kubenswrapper[5120]: I0316 16:00:15.352865 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/588c75bf-de6d-4608-8d63-85c81408a1e3-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:15 crc kubenswrapper[5120]: I0316 16:00:15.352951 5120 reconciler_common.go:299] "Volume detached for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/588c75bf-de6d-4608-8d63-85c81408a1e3-ovsdb-rundir\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:15 crc kubenswrapper[5120]: I0316 16:00:15.353010 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z7vmn\" (UniqueName: \"kubernetes.io/projected/588c75bf-de6d-4608-8d63-85c81408a1e3-kube-api-access-z7vmn\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:15 crc kubenswrapper[5120]: I0316 16:00:15.353086 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") on node \"crc\" " Mar 16 16:00:15 crc kubenswrapper[5120]: I0316 16:00:15.353141 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/588c75bf-de6d-4608-8d63-85c81408a1e3-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:15 crc kubenswrapper[5120]: E0316 16:00:15.472340 5120 kuberuntime_manager.go:1358] "Unhandled Error" err=< Mar 16 16:00:15 crc kubenswrapper[5120]: container &Container{Name:mariadb-account-create-update,Image:quay.io/podified-antelope-centos9/openstack-mariadb@sha256:4caef2b55e01b9a7ee88a22bc69db1893521a91d95c7ad4c8e593f14f17a5f95,Command:[/bin/sh -c #!/bin/bash Mar 16 16:00:15 crc kubenswrapper[5120]: Mar 16 16:00:15 crc kubenswrapper[5120]: MYSQL_REMOTE_HOST="" source /var/lib/operator-scripts/mysql_root_auth.sh Mar 16 16:00:15 crc kubenswrapper[5120]: Mar 16 16:00:15 crc kubenswrapper[5120]: export DatabasePassword=${DatabasePassword:?"Please specify a DatabasePassword variable."} Mar 16 16:00:15 crc kubenswrapper[5120]: Mar 16 16:00:15 crc kubenswrapper[5120]: MYSQL_CMD="mysql -h -u root -P 3306" Mar 16 16:00:15 crc kubenswrapper[5120]: Mar 16 16:00:15 crc kubenswrapper[5120]: if [ -n "" ]; then Mar 16 16:00:15 crc kubenswrapper[5120]: GRANT_DATABASE="" Mar 16 16:00:15 crc kubenswrapper[5120]: else Mar 16 16:00:15 crc kubenswrapper[5120]: GRANT_DATABASE="*" Mar 16 16:00:15 crc kubenswrapper[5120]: fi Mar 16 16:00:15 crc kubenswrapper[5120]: Mar 16 16:00:15 crc kubenswrapper[5120]: # going for maximum compatibility here: Mar 16 16:00:15 crc kubenswrapper[5120]: # 1. MySQL 8 no longer allows implicit create user when GRANT is used Mar 16 16:00:15 crc kubenswrapper[5120]: # 2. MariaDB has "CREATE OR REPLACE", but MySQL does not Mar 16 16:00:15 crc kubenswrapper[5120]: # 3. create user with CREATE but then do all password and TLS with ALTER to Mar 16 16:00:15 crc kubenswrapper[5120]: # support updates Mar 16 16:00:15 crc kubenswrapper[5120]: Mar 16 16:00:15 crc kubenswrapper[5120]: $MYSQL_CMD < logger="UnhandledError" Mar 16 16:00:15 crc kubenswrapper[5120]: E0316 16:00:15.476334 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"mariadb-account-create-update\" with CreateContainerConfigError: \"secret \\\"openstack-cell1-mariadb-root-db-secret\\\" not found\"" pod="openstack-kuttl-tests/root-account-create-update-6b7md" podUID="7e2bc91b-26c0-4506-8629-832872fb453f" Mar 16 16:00:15 crc kubenswrapper[5120]: E0316 16:00:15.491590 5120 kuberuntime_manager.go:1358] "Unhandled Error" err=< Mar 16 16:00:15 crc kubenswrapper[5120]: container &Container{Name:mariadb-account-create-update,Image:quay.io/podified-antelope-centos9/openstack-mariadb@sha256:4caef2b55e01b9a7ee88a22bc69db1893521a91d95c7ad4c8e593f14f17a5f95,Command:[/bin/sh -c #!/bin/bash Mar 16 16:00:15 crc kubenswrapper[5120]: Mar 16 16:00:15 crc kubenswrapper[5120]: MYSQL_REMOTE_HOST="" source /var/lib/operator-scripts/mysql_root_auth.sh Mar 16 16:00:15 crc kubenswrapper[5120]: Mar 16 16:00:15 crc kubenswrapper[5120]: export DatabasePassword=${DatabasePassword:?"Please specify a DatabasePassword variable."} Mar 16 16:00:15 crc kubenswrapper[5120]: Mar 16 16:00:15 crc kubenswrapper[5120]: MYSQL_CMD="mysql -h -u root -P 3306" Mar 16 16:00:15 crc kubenswrapper[5120]: Mar 16 16:00:15 crc kubenswrapper[5120]: if [ -n "nova_cell0" ]; then Mar 16 16:00:15 crc kubenswrapper[5120]: GRANT_DATABASE="nova_cell0" Mar 16 16:00:15 crc kubenswrapper[5120]: else Mar 16 16:00:15 crc kubenswrapper[5120]: GRANT_DATABASE="*" Mar 16 16:00:15 crc kubenswrapper[5120]: fi Mar 16 16:00:15 crc kubenswrapper[5120]: Mar 16 16:00:15 crc kubenswrapper[5120]: # going for maximum compatibility here: Mar 16 16:00:15 crc kubenswrapper[5120]: # 1. MySQL 8 no longer allows implicit create user when GRANT is used Mar 16 16:00:15 crc kubenswrapper[5120]: # 2. MariaDB has "CREATE OR REPLACE", but MySQL does not Mar 16 16:00:15 crc kubenswrapper[5120]: # 3. create user with CREATE but then do all password and TLS with ALTER to Mar 16 16:00:15 crc kubenswrapper[5120]: # support updates Mar 16 16:00:15 crc kubenswrapper[5120]: Mar 16 16:00:15 crc kubenswrapper[5120]: $MYSQL_CMD < logger="UnhandledError" Mar 16 16:00:15 crc kubenswrapper[5120]: E0316 16:00:15.492694 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"mariadb-account-create-update\" with CreateContainerConfigError: \"secret \\\"nova-cell0-db-secret\\\" not found\"" pod="openstack-kuttl-tests/nova-cell0-ef54-account-create-update-b2vpk" podUID="14fb94bd-5ac0-4ea1-98bf-1980cebf6e4d" Mar 16 16:00:15 crc kubenswrapper[5120]: I0316 16:00:15.497814 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage05-crc" (UniqueName: "kubernetes.io/local-volume/local-storage05-crc") on node "crc" Mar 16 16:00:15 crc kubenswrapper[5120]: E0316 16:00:15.501458 5120 kuberuntime_manager.go:1358] "Unhandled Error" err=< Mar 16 16:00:15 crc kubenswrapper[5120]: container &Container{Name:mariadb-account-create-update,Image:quay.io/podified-antelope-centos9/openstack-mariadb@sha256:4caef2b55e01b9a7ee88a22bc69db1893521a91d95c7ad4c8e593f14f17a5f95,Command:[/bin/sh -c #!/bin/bash Mar 16 16:00:15 crc kubenswrapper[5120]: Mar 16 16:00:15 crc kubenswrapper[5120]: MYSQL_REMOTE_HOST="" source /var/lib/operator-scripts/mysql_root_auth.sh Mar 16 16:00:15 crc kubenswrapper[5120]: Mar 16 16:00:15 crc kubenswrapper[5120]: export DatabasePassword=${DatabasePassword:?"Please specify a DatabasePassword variable."} Mar 16 16:00:15 crc kubenswrapper[5120]: Mar 16 16:00:15 crc kubenswrapper[5120]: MYSQL_CMD="mysql -h -u root -P 3306" Mar 16 16:00:15 crc kubenswrapper[5120]: Mar 16 16:00:15 crc kubenswrapper[5120]: if [ -n "placement" ]; then Mar 16 16:00:15 crc kubenswrapper[5120]: GRANT_DATABASE="placement" Mar 16 16:00:15 crc kubenswrapper[5120]: else Mar 16 16:00:15 crc kubenswrapper[5120]: GRANT_DATABASE="*" Mar 16 16:00:15 crc kubenswrapper[5120]: fi Mar 16 16:00:15 crc kubenswrapper[5120]: Mar 16 16:00:15 crc kubenswrapper[5120]: # going for maximum compatibility here: Mar 16 16:00:15 crc kubenswrapper[5120]: # 1. MySQL 8 no longer allows implicit create user when GRANT is used Mar 16 16:00:15 crc kubenswrapper[5120]: # 2. MariaDB has "CREATE OR REPLACE", but MySQL does not Mar 16 16:00:15 crc kubenswrapper[5120]: # 3. create user with CREATE but then do all password and TLS with ALTER to Mar 16 16:00:15 crc kubenswrapper[5120]: # support updates Mar 16 16:00:15 crc kubenswrapper[5120]: Mar 16 16:00:15 crc kubenswrapper[5120]: $MYSQL_CMD < logger="UnhandledError" Mar 16 16:00:15 crc kubenswrapper[5120]: E0316 16:00:15.512939 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"mariadb-account-create-update\" with CreateContainerConfigError: \"secret \\\"placement-db-secret\\\" not found\"" pod="openstack-kuttl-tests/placement-79ea-account-create-update-nlbgs" podUID="169cc9e8-ed2f-47c8-b98a-0143f4c480d7" Mar 16 16:00:15 crc kubenswrapper[5120]: I0316 16:00:15.532418 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/588c75bf-de6d-4608-8d63-85c81408a1e3-ovsdbserver-sb-tls-certs" (OuterVolumeSpecName: "ovsdbserver-sb-tls-certs") pod "588c75bf-de6d-4608-8d63-85c81408a1e3" (UID: "588c75bf-de6d-4608-8d63-85c81408a1e3"). InnerVolumeSpecName "ovsdbserver-sb-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:00:15 crc kubenswrapper[5120]: I0316 16:00:15.532738 5120 scope.go:117] "RemoveContainer" containerID="dac788712cee13272c3b574a2a82410cb05db5c3ad287bdca48ecf5f046219a8" Mar 16 16:00:15 crc kubenswrapper[5120]: E0316 16:00:15.535620 5120 kuberuntime_manager.go:1358] "Unhandled Error" err=< Mar 16 16:00:15 crc kubenswrapper[5120]: container &Container{Name:mariadb-account-create-update,Image:quay.io/podified-antelope-centos9/openstack-mariadb@sha256:4caef2b55e01b9a7ee88a22bc69db1893521a91d95c7ad4c8e593f14f17a5f95,Command:[/bin/sh -c #!/bin/bash Mar 16 16:00:15 crc kubenswrapper[5120]: Mar 16 16:00:15 crc kubenswrapper[5120]: MYSQL_REMOTE_HOST="" source /var/lib/operator-scripts/mysql_root_auth.sh Mar 16 16:00:15 crc kubenswrapper[5120]: Mar 16 16:00:15 crc kubenswrapper[5120]: export DatabasePassword=${DatabasePassword:?"Please specify a DatabasePassword variable."} Mar 16 16:00:15 crc kubenswrapper[5120]: Mar 16 16:00:15 crc kubenswrapper[5120]: MYSQL_CMD="mysql -h -u root -P 3306" Mar 16 16:00:15 crc kubenswrapper[5120]: Mar 16 16:00:15 crc kubenswrapper[5120]: if [ -n "nova_cell1" ]; then Mar 16 16:00:15 crc kubenswrapper[5120]: GRANT_DATABASE="nova_cell1" Mar 16 16:00:15 crc kubenswrapper[5120]: else Mar 16 16:00:15 crc kubenswrapper[5120]: GRANT_DATABASE="*" Mar 16 16:00:15 crc kubenswrapper[5120]: fi Mar 16 16:00:15 crc kubenswrapper[5120]: Mar 16 16:00:15 crc kubenswrapper[5120]: # going for maximum compatibility here: Mar 16 16:00:15 crc kubenswrapper[5120]: # 1. MySQL 8 no longer allows implicit create user when GRANT is used Mar 16 16:00:15 crc kubenswrapper[5120]: # 2. MariaDB has "CREATE OR REPLACE", but MySQL does not Mar 16 16:00:15 crc kubenswrapper[5120]: # 3. create user with CREATE but then do all password and TLS with ALTER to Mar 16 16:00:15 crc kubenswrapper[5120]: # support updates Mar 16 16:00:15 crc kubenswrapper[5120]: Mar 16 16:00:15 crc kubenswrapper[5120]: $MYSQL_CMD < logger="UnhandledError" Mar 16 16:00:15 crc kubenswrapper[5120]: E0316 16:00:15.541369 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"mariadb-account-create-update\" with CreateContainerConfigError: \"secret \\\"nova-cell1-db-secret\\\" not found\"" pod="openstack-kuttl-tests/nova-cell1-dc27-account-create-update-2jjjz" podUID="b7049577-d3a2-4125-b841-70c5f6e1da23" Mar 16 16:00:15 crc kubenswrapper[5120]: I0316 16:00:15.549591 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/588c75bf-de6d-4608-8d63-85c81408a1e3-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "588c75bf-de6d-4608-8d63-85c81408a1e3" (UID: "588c75bf-de6d-4608-8d63-85c81408a1e3"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:00:15 crc kubenswrapper[5120]: I0316 16:00:15.556736 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:15 crc kubenswrapper[5120]: I0316 16:00:15.557054 5120 reconciler_common.go:299] "Volume detached for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/588c75bf-de6d-4608-8d63-85c81408a1e3-ovsdbserver-sb-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:15 crc kubenswrapper[5120]: I0316 16:00:15.557143 5120 reconciler_common.go:299] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/588c75bf-de6d-4608-8d63-85c81408a1e3-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:15 crc kubenswrapper[5120]: I0316 16:00:15.577783 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Mar 16 16:00:15 crc kubenswrapper[5120]: I0316 16:00:15.663511 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/b5ed0fd6-65dd-4480-acce-2eb38249add6-openstack-config-secret\") pod \"b5ed0fd6-65dd-4480-acce-2eb38249add6\" (UID: \"b5ed0fd6-65dd-4480-acce-2eb38249add6\") " Mar 16 16:00:15 crc kubenswrapper[5120]: I0316 16:00:15.663690 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/b5ed0fd6-65dd-4480-acce-2eb38249add6-openstack-config\") pod \"b5ed0fd6-65dd-4480-acce-2eb38249add6\" (UID: \"b5ed0fd6-65dd-4480-acce-2eb38249add6\") " Mar 16 16:00:15 crc kubenswrapper[5120]: I0316 16:00:15.663887 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b5ed0fd6-65dd-4480-acce-2eb38249add6-combined-ca-bundle\") pod \"b5ed0fd6-65dd-4480-acce-2eb38249add6\" (UID: \"b5ed0fd6-65dd-4480-acce-2eb38249add6\") " Mar 16 16:00:15 crc kubenswrapper[5120]: I0316 16:00:15.663957 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tsqxx\" (UniqueName: \"kubernetes.io/projected/b5ed0fd6-65dd-4480-acce-2eb38249add6-kube-api-access-tsqxx\") pod \"b5ed0fd6-65dd-4480-acce-2eb38249add6\" (UID: \"b5ed0fd6-65dd-4480-acce-2eb38249add6\") " Mar 16 16:00:15 crc kubenswrapper[5120]: I0316 16:00:15.677017 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b5ed0fd6-65dd-4480-acce-2eb38249add6-kube-api-access-tsqxx" (OuterVolumeSpecName: "kube-api-access-tsqxx") pod "b5ed0fd6-65dd-4480-acce-2eb38249add6" (UID: "b5ed0fd6-65dd-4480-acce-2eb38249add6"). InnerVolumeSpecName "kube-api-access-tsqxx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:00:15 crc kubenswrapper[5120]: I0316 16:00:15.704273 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b5ed0fd6-65dd-4480-acce-2eb38249add6-openstack-config" (OuterVolumeSpecName: "openstack-config") pod "b5ed0fd6-65dd-4480-acce-2eb38249add6" (UID: "b5ed0fd6-65dd-4480-acce-2eb38249add6"). InnerVolumeSpecName "openstack-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:00:15 crc kubenswrapper[5120]: I0316 16:00:15.725166 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b5ed0fd6-65dd-4480-acce-2eb38249add6-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "b5ed0fd6-65dd-4480-acce-2eb38249add6" (UID: "b5ed0fd6-65dd-4480-acce-2eb38249add6"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:00:15 crc kubenswrapper[5120]: I0316 16:00:15.744190 5120 generic.go:358] "Generic (PLEG): container finished" podID="725b915c-7c39-43e6-8022-99dd14a6276e" containerID="9b91d7507fff9e107013c39056e451ffe12795d6ae267b2ef0a816bc5e272d34" exitCode=0 Mar 16 16:00:15 crc kubenswrapper[5120]: I0316 16:00:15.744398 5120 generic.go:358] "Generic (PLEG): container finished" podID="725b915c-7c39-43e6-8022-99dd14a6276e" containerID="66d0d042587258a65188efea26738d109ef3471c78ed22bfed7030925260d9b8" exitCode=0 Mar 16 16:00:15 crc kubenswrapper[5120]: I0316 16:00:15.744405 5120 generic.go:358] "Generic (PLEG): container finished" podID="725b915c-7c39-43e6-8022-99dd14a6276e" containerID="9065435fa0cbe38d798b7f599f263612ad1337c636838785105247be4e64c3c8" exitCode=0 Mar 16 16:00:15 crc kubenswrapper[5120]: I0316 16:00:15.744504 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"725b915c-7c39-43e6-8022-99dd14a6276e","Type":"ContainerDied","Data":"9b91d7507fff9e107013c39056e451ffe12795d6ae267b2ef0a816bc5e272d34"} Mar 16 16:00:15 crc kubenswrapper[5120]: I0316 16:00:15.744547 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"725b915c-7c39-43e6-8022-99dd14a6276e","Type":"ContainerDied","Data":"66d0d042587258a65188efea26738d109ef3471c78ed22bfed7030925260d9b8"} Mar 16 16:00:15 crc kubenswrapper[5120]: I0316 16:00:15.744557 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"725b915c-7c39-43e6-8022-99dd14a6276e","Type":"ContainerDied","Data":"9065435fa0cbe38d798b7f599f263612ad1337c636838785105247be4e64c3c8"} Mar 16 16:00:15 crc kubenswrapper[5120]: I0316 16:00:15.748179 5120 generic.go:358] "Generic (PLEG): container finished" podID="ea0301d9-a692-4b65-ba34-5e989769d02c" containerID="586bc7a04e27dd8d1aa0558b163f524487e412f155988226de43eca06d6c8b1e" exitCode=143 Mar 16 16:00:15 crc kubenswrapper[5120]: I0316 16:00:15.748246 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-bcc6c568d-dqmvk" event={"ID":"ea0301d9-a692-4b65-ba34-5e989769d02c","Type":"ContainerDied","Data":"586bc7a04e27dd8d1aa0558b163f524487e412f155988226de43eca06d6c8b1e"} Mar 16 16:00:15 crc kubenswrapper[5120]: I0316 16:00:15.749579 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-dc27-account-create-update-2jjjz" event={"ID":"b7049577-d3a2-4125-b841-70c5f6e1da23","Type":"ContainerStarted","Data":"94a6494d48ba6265bca75999486e8acc0378164207517ce9c522fba19b40c560"} Mar 16 16:00:15 crc kubenswrapper[5120]: I0316 16:00:15.756780 5120 generic.go:358] "Generic (PLEG): container finished" podID="08f284b7-104e-4395-b9cc-7c8acf4b943e" containerID="8f0c678e052c56ea5916115f262b647c8634ba2b451635a3702fc27a5161c88c" exitCode=2 Mar 16 16:00:15 crc kubenswrapper[5120]: I0316 16:00:15.756865 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"08f284b7-104e-4395-b9cc-7c8acf4b943e","Type":"ContainerDied","Data":"8f0c678e052c56ea5916115f262b647c8634ba2b451635a3702fc27a5161c88c"} Mar 16 16:00:15 crc kubenswrapper[5120]: I0316 16:00:15.758580 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_588c75bf-de6d-4608-8d63-85c81408a1e3/ovsdbserver-sb/0.log" Mar 16 16:00:15 crc kubenswrapper[5120]: I0316 16:00:15.758665 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"588c75bf-de6d-4608-8d63-85c81408a1e3","Type":"ContainerDied","Data":"efa2bcd9e91bae4c253324c7c1eca6747250e478521fa9680fcd7eebd8ea6110"} Mar 16 16:00:15 crc kubenswrapper[5120]: I0316 16:00:15.758711 5120 scope.go:117] "RemoveContainer" containerID="450ae56285ae1f86aa35df717a2b979a8b9de5972d74bdb6c7310c8a52c811a3" Mar 16 16:00:15 crc kubenswrapper[5120]: I0316 16:00:15.758832 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:00:15 crc kubenswrapper[5120]: I0316 16:00:15.772864 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b5ed0fd6-65dd-4480-acce-2eb38249add6-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:15 crc kubenswrapper[5120]: I0316 16:00:15.772901 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tsqxx\" (UniqueName: \"kubernetes.io/projected/b5ed0fd6-65dd-4480-acce-2eb38249add6-kube-api-access-tsqxx\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:15 crc kubenswrapper[5120]: I0316 16:00:15.772912 5120 reconciler_common.go:299] "Volume detached for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/b5ed0fd6-65dd-4480-acce-2eb38249add6-openstack-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:15 crc kubenswrapper[5120]: I0316 16:00:15.807184 5120 generic.go:358] "Generic (PLEG): container finished" podID="1d8cf310-88d2-4a5c-a2d9-2807cd409f37" containerID="225178e952b315c5893292df5f1de300801aa1d4aa5ddd4097d9a84deac77bb4" exitCode=0 Mar 16 16:00:15 crc kubenswrapper[5120]: I0316 16:00:15.807211 5120 generic.go:358] "Generic (PLEG): container finished" podID="1d8cf310-88d2-4a5c-a2d9-2807cd409f37" containerID="cd64ff6d1522e78a36e711e1d6c63dfc1b9549659dfe87de0c90878031eefbbf" exitCode=2 Mar 16 16:00:15 crc kubenswrapper[5120]: I0316 16:00:15.807321 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1d8cf310-88d2-4a5c-a2d9-2807cd409f37","Type":"ContainerDied","Data":"225178e952b315c5893292df5f1de300801aa1d4aa5ddd4097d9a84deac77bb4"} Mar 16 16:00:15 crc kubenswrapper[5120]: I0316 16:00:15.807346 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1d8cf310-88d2-4a5c-a2d9-2807cd409f37","Type":"ContainerDied","Data":"cd64ff6d1522e78a36e711e1d6c63dfc1b9549659dfe87de0c90878031eefbbf"} Mar 16 16:00:15 crc kubenswrapper[5120]: I0316 16:00:15.819288 5120 generic.go:358] "Generic (PLEG): container finished" podID="48b9c79e-2a39-4fa1-9143-e4175c7b45b2" containerID="94a873fd2b944f420b88e4b9e672ad596d411c27b15f3cb17cf449dd38652633" exitCode=0 Mar 16 16:00:15 crc kubenswrapper[5120]: I0316 16:00:15.819387 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"48b9c79e-2a39-4fa1-9143-e4175c7b45b2","Type":"ContainerDied","Data":"94a873fd2b944f420b88e4b9e672ad596d411c27b15f3cb17cf449dd38652633"} Mar 16 16:00:15 crc kubenswrapper[5120]: I0316 16:00:15.821785 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Mar 16 16:00:15 crc kubenswrapper[5120]: I0316 16:00:15.843569 5120 generic.go:358] "Generic (PLEG): container finished" podID="f80a9ef7-32f9-44c7-945c-d1ee96105c42" containerID="a8cc11b8ec51275761948543ede5d0db634e37eb551775e3622e1ea5aad55325" exitCode=0 Mar 16 16:00:15 crc kubenswrapper[5120]: I0316 16:00:15.843823 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"f80a9ef7-32f9-44c7-945c-d1ee96105c42","Type":"ContainerDied","Data":"a8cc11b8ec51275761948543ede5d0db634e37eb551775e3622e1ea5aad55325"} Mar 16 16:00:15 crc kubenswrapper[5120]: I0316 16:00:15.856527 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b5ed0fd6-65dd-4480-acce-2eb38249add6-openstack-config-secret" (OuterVolumeSpecName: "openstack-config-secret") pod "b5ed0fd6-65dd-4480-acce-2eb38249add6" (UID: "b5ed0fd6-65dd-4480-acce-2eb38249add6"). InnerVolumeSpecName "openstack-config-secret". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:00:15 crc kubenswrapper[5120]: I0316 16:00:15.857294 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-6b7md" event={"ID":"7e2bc91b-26c0-4506-8629-832872fb453f","Type":"ContainerStarted","Data":"4495879e0786092f12567ee54871a40ab6166f540fbc6ae54070351263b78fe0"} Mar 16 16:00:15 crc kubenswrapper[5120]: I0316 16:00:15.876931 5120 reconciler_common.go:299] "Volume detached for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/b5ed0fd6-65dd-4480-acce-2eb38249add6-openstack-config-secret\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:15 crc kubenswrapper[5120]: E0316 16:00:15.877065 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="b2dd99f48a5e6c36c5d9b0bed8c62972ff65efc2c08b8a4c56e6c1ee763db013" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:00:15 crc kubenswrapper[5120]: I0316 16:00:15.877276 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-79ea-account-create-update-nlbgs" event={"ID":"169cc9e8-ed2f-47c8-b98a-0143f4c480d7","Type":"ContainerStarted","Data":"4e8e88c20282ca0bcb48ed20bf4fd75c9c07f7e4f3ede0879ef6140c6ab64e51"} Mar 16 16:00:15 crc kubenswrapper[5120]: E0316 16:00:15.880893 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="b2dd99f48a5e6c36c5d9b0bed8c62972ff65efc2c08b8a4c56e6c1ee763db013" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:00:15 crc kubenswrapper[5120]: E0316 16:00:15.882809 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="b2dd99f48a5e6c36c5d9b0bed8c62972ff65efc2c08b8a4c56e6c1ee763db013" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:00:15 crc kubenswrapper[5120]: E0316 16:00:15.883836 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="ca4a5201-32c6-4c58-8bac-4d1b05ddfbb4" containerName="nova-scheduler-scheduler" probeResult="unknown" Mar 16 16:00:15 crc kubenswrapper[5120]: I0316 16:00:15.890024 5120 generic.go:358] "Generic (PLEG): container finished" podID="fc59410f-18f6-4de8-b0f9-d54fcaea8faf" containerID="1776e0f291f7fa8432d2e5511c3d988212237dc71753bffedc712fbe9bb9ab04" exitCode=143 Mar 16 16:00:15 crc kubenswrapper[5120]: I0316 16:00:15.890402 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-54b7655659-bqszk" event={"ID":"fc59410f-18f6-4de8-b0f9-d54fcaea8faf","Type":"ContainerDied","Data":"1776e0f291f7fa8432d2e5511c3d988212237dc71753bffedc712fbe9bb9ab04"} Mar 16 16:00:15 crc kubenswrapper[5120]: I0316 16:00:15.896161 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-ef54-account-create-update-b2vpk" event={"ID":"14fb94bd-5ac0-4ea1-98bf-1980cebf6e4d","Type":"ContainerStarted","Data":"48506a0c7dbcd16fbacde23a3d4fc4f6a37b8b1ca56f7900abe509974411f305"} Mar 16 16:00:15 crc kubenswrapper[5120]: I0316 16:00:15.901986 5120 generic.go:358] "Generic (PLEG): container finished" podID="b3794e20-01dd-453a-bf29-20813144c61b" containerID="8e8fbd7afb6b4def81fe53673306c45558e83d21c714994987a7ead7c9d14080" exitCode=143 Mar 16 16:00:15 crc kubenswrapper[5120]: I0316 16:00:15.902184 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-85c489687d-pcp6w" event={"ID":"b3794e20-01dd-453a-bf29-20813144c61b","Type":"ContainerDied","Data":"8e8fbd7afb6b4def81fe53673306c45558e83d21c714994987a7ead7c9d14080"} Mar 16 16:00:15 crc kubenswrapper[5120]: E0316 16:00:15.952874 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="6b9d4e9dc1d3160e9abb2e9af3ed540f0c1e83d09c814ee53e6dfb172f8914f5" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:00:15 crc kubenswrapper[5120]: E0316 16:00:15.954136 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="6b9d4e9dc1d3160e9abb2e9af3ed540f0c1e83d09c814ee53e6dfb172f8914f5" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:00:15 crc kubenswrapper[5120]: E0316 16:00:15.963247 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="6b9d4e9dc1d3160e9abb2e9af3ed540f0c1e83d09c814ee53e6dfb172f8914f5" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:00:15 crc kubenswrapper[5120]: E0316 16:00:15.963348 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="63972b06-4c5e-40e4-a318-8e5f3e286ece" containerName="nova-cell1-conductor-conductor" probeResult="unknown" Mar 16 16:00:16 crc kubenswrapper[5120]: I0316 16:00:16.020346 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 16:00:16 crc kubenswrapper[5120]: I0316 16:00:16.052459 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 16:00:16 crc kubenswrapper[5120]: I0316 16:00:16.059985 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:00:16 crc kubenswrapper[5120]: I0316 16:00:16.088513 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-proxy-59f58b5b58-tw7qc"] Mar 16 16:00:16 crc kubenswrapper[5120]: I0316 16:00:16.088802 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-proxy-59f58b5b58-tw7qc" podUID="2e562dac-a1db-446c-b73a-21df22608a50" containerName="proxy-httpd" containerID="cri-o://6f7dc6683e41d78ef9ed871ab4cec8bf6d45dff6e94f3f28507ba3a97f851f26" gracePeriod=30 Mar 16 16:00:16 crc kubenswrapper[5120]: I0316 16:00:16.089376 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-proxy-59f58b5b58-tw7qc" podUID="2e562dac-a1db-446c-b73a-21df22608a50" containerName="proxy-server" containerID="cri-o://64e90c71960de20873b7811fc895ce903bc60eaefd9593abac82e4c4b489e606" gracePeriod=30 Mar 16 16:00:16 crc kubenswrapper[5120]: I0316 16:00:16.099561 5120 scope.go:117] "RemoveContainer" containerID="5d526fe7f2a81cde0367c562baa67b6eaa605bb9da0cb25fb3bb2d2a88797c4f" Mar 16 16:00:16 crc kubenswrapper[5120]: I0316 16:00:16.120677 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:00:16 crc kubenswrapper[5120]: I0316 16:00:16.129922 5120 scope.go:117] "RemoveContainer" containerID="faa88e5970c0bf9c643f2180f59a90ed1f8b8a4a6cfd93741f962f1d1a9cacdc" Mar 16 16:00:16 crc kubenswrapper[5120]: I0316 16:00:16.160126 5120 status_manager.go:895] "Failed to get status for pod" podUID="b5ed0fd6-65dd-4480-acce-2eb38249add6" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 16:00:16 crc kubenswrapper[5120]: I0316 16:00:16.189730 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/48b9c79e-2a39-4fa1-9143-e4175c7b45b2-operator-scripts\") pod \"48b9c79e-2a39-4fa1-9143-e4175c7b45b2\" (UID: \"48b9c79e-2a39-4fa1-9143-e4175c7b45b2\") " Mar 16 16:00:16 crc kubenswrapper[5120]: I0316 16:00:16.190337 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/48b9c79e-2a39-4fa1-9143-e4175c7b45b2-combined-ca-bundle\") pod \"48b9c79e-2a39-4fa1-9143-e4175c7b45b2\" (UID: \"48b9c79e-2a39-4fa1-9143-e4175c7b45b2\") " Mar 16 16:00:16 crc kubenswrapper[5120]: I0316 16:00:16.190379 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/08f284b7-104e-4395-b9cc-7c8acf4b943e-kube-state-metrics-tls-certs\") pod \"08f284b7-104e-4395-b9cc-7c8acf4b943e\" (UID: \"08f284b7-104e-4395-b9cc-7c8acf4b943e\") " Mar 16 16:00:16 crc kubenswrapper[5120]: I0316 16:00:16.190413 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/48b9c79e-2a39-4fa1-9143-e4175c7b45b2-kolla-config\") pod \"48b9c79e-2a39-4fa1-9143-e4175c7b45b2\" (UID: \"48b9c79e-2a39-4fa1-9143-e4175c7b45b2\") " Mar 16 16:00:16 crc kubenswrapper[5120]: I0316 16:00:16.190429 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/08f284b7-104e-4395-b9cc-7c8acf4b943e-kube-state-metrics-tls-config\") pod \"08f284b7-104e-4395-b9cc-7c8acf4b943e\" (UID: \"08f284b7-104e-4395-b9cc-7c8acf4b943e\") " Mar 16 16:00:16 crc kubenswrapper[5120]: I0316 16:00:16.190680 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/48b9c79e-2a39-4fa1-9143-e4175c7b45b2-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "48b9c79e-2a39-4fa1-9143-e4175c7b45b2" (UID: "48b9c79e-2a39-4fa1-9143-e4175c7b45b2"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:00:16 crc kubenswrapper[5120]: I0316 16:00:16.190729 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/48b9c79e-2a39-4fa1-9143-e4175c7b45b2-config-data-default\") pod \"48b9c79e-2a39-4fa1-9143-e4175c7b45b2\" (UID: \"48b9c79e-2a39-4fa1-9143-e4175c7b45b2\") " Mar 16 16:00:16 crc kubenswrapper[5120]: I0316 16:00:16.190942 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c72hq\" (UniqueName: \"kubernetes.io/projected/48b9c79e-2a39-4fa1-9143-e4175c7b45b2-kube-api-access-c72hq\") pod \"48b9c79e-2a39-4fa1-9143-e4175c7b45b2\" (UID: \"48b9c79e-2a39-4fa1-9143-e4175c7b45b2\") " Mar 16 16:00:16 crc kubenswrapper[5120]: I0316 16:00:16.190984 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7gthb\" (UniqueName: \"kubernetes.io/projected/08f284b7-104e-4395-b9cc-7c8acf4b943e-kube-api-access-7gthb\") pod \"08f284b7-104e-4395-b9cc-7c8acf4b943e\" (UID: \"08f284b7-104e-4395-b9cc-7c8acf4b943e\") " Mar 16 16:00:16 crc kubenswrapper[5120]: I0316 16:00:16.191260 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/48b9c79e-2a39-4fa1-9143-e4175c7b45b2-config-data-generated\") pod \"48b9c79e-2a39-4fa1-9143-e4175c7b45b2\" (UID: \"48b9c79e-2a39-4fa1-9143-e4175c7b45b2\") " Mar 16 16:00:16 crc kubenswrapper[5120]: I0316 16:00:16.191296 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/08f284b7-104e-4395-b9cc-7c8acf4b943e-combined-ca-bundle\") pod \"08f284b7-104e-4395-b9cc-7c8acf4b943e\" (UID: \"08f284b7-104e-4395-b9cc-7c8acf4b943e\") " Mar 16 16:00:16 crc kubenswrapper[5120]: I0316 16:00:16.191311 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/48b9c79e-2a39-4fa1-9143-e4175c7b45b2-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "48b9c79e-2a39-4fa1-9143-e4175c7b45b2" (UID: "48b9c79e-2a39-4fa1-9143-e4175c7b45b2"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:00:16 crc kubenswrapper[5120]: I0316 16:00:16.191590 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"mysql-db\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"48b9c79e-2a39-4fa1-9143-e4175c7b45b2\" (UID: \"48b9c79e-2a39-4fa1-9143-e4175c7b45b2\") " Mar 16 16:00:16 crc kubenswrapper[5120]: I0316 16:00:16.191643 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/48b9c79e-2a39-4fa1-9143-e4175c7b45b2-galera-tls-certs\") pod \"48b9c79e-2a39-4fa1-9143-e4175c7b45b2\" (UID: \"48b9c79e-2a39-4fa1-9143-e4175c7b45b2\") " Mar 16 16:00:16 crc kubenswrapper[5120]: I0316 16:00:16.192248 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/48b9c79e-2a39-4fa1-9143-e4175c7b45b2-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:16 crc kubenswrapper[5120]: I0316 16:00:16.192259 5120 reconciler_common.go:299] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/48b9c79e-2a39-4fa1-9143-e4175c7b45b2-kolla-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:16 crc kubenswrapper[5120]: I0316 16:00:16.192622 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/48b9c79e-2a39-4fa1-9143-e4175c7b45b2-config-data-default" (OuterVolumeSpecName: "config-data-default") pod "48b9c79e-2a39-4fa1-9143-e4175c7b45b2" (UID: "48b9c79e-2a39-4fa1-9143-e4175c7b45b2"). InnerVolumeSpecName "config-data-default". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:00:16 crc kubenswrapper[5120]: I0316 16:00:16.193143 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48b9c79e-2a39-4fa1-9143-e4175c7b45b2-config-data-generated" (OuterVolumeSpecName: "config-data-generated") pod "48b9c79e-2a39-4fa1-9143-e4175c7b45b2" (UID: "48b9c79e-2a39-4fa1-9143-e4175c7b45b2"). InnerVolumeSpecName "config-data-generated". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:00:16 crc kubenswrapper[5120]: I0316 16:00:16.196225 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48b9c79e-2a39-4fa1-9143-e4175c7b45b2-kube-api-access-c72hq" (OuterVolumeSpecName: "kube-api-access-c72hq") pod "48b9c79e-2a39-4fa1-9143-e4175c7b45b2" (UID: "48b9c79e-2a39-4fa1-9143-e4175c7b45b2"). InnerVolumeSpecName "kube-api-access-c72hq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:00:16 crc kubenswrapper[5120]: I0316 16:00:16.212093 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08f284b7-104e-4395-b9cc-7c8acf4b943e-kube-api-access-7gthb" (OuterVolumeSpecName: "kube-api-access-7gthb") pod "08f284b7-104e-4395-b9cc-7c8acf4b943e" (UID: "08f284b7-104e-4395-b9cc-7c8acf4b943e"). InnerVolumeSpecName "kube-api-access-7gthb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:00:16 crc kubenswrapper[5120]: I0316 16:00:16.215140 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48b9c79e-2a39-4fa1-9143-e4175c7b45b2-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "48b9c79e-2a39-4fa1-9143-e4175c7b45b2" (UID: "48b9c79e-2a39-4fa1-9143-e4175c7b45b2"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:00:16 crc kubenswrapper[5120]: I0316 16:00:16.237196 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage12-crc" (OuterVolumeSpecName: "mysql-db") pod "48b9c79e-2a39-4fa1-9143-e4175c7b45b2" (UID: "48b9c79e-2a39-4fa1-9143-e4175c7b45b2"). InnerVolumeSpecName "local-storage12-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:00:16 crc kubenswrapper[5120]: I0316 16:00:16.241472 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/08f284b7-104e-4395-b9cc-7c8acf4b943e-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "08f284b7-104e-4395-b9cc-7c8acf4b943e" (UID: "08f284b7-104e-4395-b9cc-7c8acf4b943e"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:00:16 crc kubenswrapper[5120]: I0316 16:00:16.249071 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/08f284b7-104e-4395-b9cc-7c8acf4b943e-kube-state-metrics-tls-config" (OuterVolumeSpecName: "kube-state-metrics-tls-config") pod "08f284b7-104e-4395-b9cc-7c8acf4b943e" (UID: "08f284b7-104e-4395-b9cc-7c8acf4b943e"). InnerVolumeSpecName "kube-state-metrics-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:00:16 crc kubenswrapper[5120]: I0316 16:00:16.257887 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/08f284b7-104e-4395-b9cc-7c8acf4b943e-kube-state-metrics-tls-certs" (OuterVolumeSpecName: "kube-state-metrics-tls-certs") pod "08f284b7-104e-4395-b9cc-7c8acf4b943e" (UID: "08f284b7-104e-4395-b9cc-7c8acf4b943e"). InnerVolumeSpecName "kube-state-metrics-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:00:16 crc kubenswrapper[5120]: I0316 16:00:16.284848 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48b9c79e-2a39-4fa1-9143-e4175c7b45b2-galera-tls-certs" (OuterVolumeSpecName: "galera-tls-certs") pod "48b9c79e-2a39-4fa1-9143-e4175c7b45b2" (UID: "48b9c79e-2a39-4fa1-9143-e4175c7b45b2"). InnerVolumeSpecName "galera-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:00:16 crc kubenswrapper[5120]: I0316 16:00:16.293778 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/48b9c79e-2a39-4fa1-9143-e4175c7b45b2-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:16 crc kubenswrapper[5120]: I0316 16:00:16.293813 5120 reconciler_common.go:299] "Volume detached for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/08f284b7-104e-4395-b9cc-7c8acf4b943e-kube-state-metrics-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:16 crc kubenswrapper[5120]: I0316 16:00:16.293824 5120 reconciler_common.go:299] "Volume detached for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/08f284b7-104e-4395-b9cc-7c8acf4b943e-kube-state-metrics-tls-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:16 crc kubenswrapper[5120]: I0316 16:00:16.293833 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/48b9c79e-2a39-4fa1-9143-e4175c7b45b2-config-data-default\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:16 crc kubenswrapper[5120]: I0316 16:00:16.293842 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c72hq\" (UniqueName: \"kubernetes.io/projected/48b9c79e-2a39-4fa1-9143-e4175c7b45b2-kube-api-access-c72hq\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:16 crc kubenswrapper[5120]: I0316 16:00:16.293852 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7gthb\" (UniqueName: \"kubernetes.io/projected/08f284b7-104e-4395-b9cc-7c8acf4b943e-kube-api-access-7gthb\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:16 crc kubenswrapper[5120]: I0316 16:00:16.293860 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/48b9c79e-2a39-4fa1-9143-e4175c7b45b2-config-data-generated\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:16 crc kubenswrapper[5120]: I0316 16:00:16.293873 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/08f284b7-104e-4395-b9cc-7c8acf4b943e-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:16 crc kubenswrapper[5120]: I0316 16:00:16.293899 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") on node \"crc\" " Mar 16 16:00:16 crc kubenswrapper[5120]: I0316 16:00:16.293908 5120 reconciler_common.go:299] "Volume detached for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/48b9c79e-2a39-4fa1-9143-e4175c7b45b2-galera-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:16 crc kubenswrapper[5120]: I0316 16:00:16.377017 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage12-crc" (UniqueName: "kubernetes.io/local-volume/local-storage12-crc") on node "crc" Mar 16 16:00:16 crc kubenswrapper[5120]: I0316 16:00:16.383029 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-dc27-account-create-update-2jjjz" Mar 16 16:00:16 crc kubenswrapper[5120]: I0316 16:00:16.391314 5120 status_manager.go:895] "Failed to get status for pod" podUID="b5ed0fd6-65dd-4480-acce-2eb38249add6" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 16:00:16 crc kubenswrapper[5120]: I0316 16:00:16.396904 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:16 crc kubenswrapper[5120]: I0316 16:00:16.414268 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-79ea-account-create-update-nlbgs" Mar 16 16:00:16 crc kubenswrapper[5120]: I0316 16:00:16.420089 5120 status_manager.go:895] "Failed to get status for pod" podUID="b5ed0fd6-65dd-4480-acce-2eb38249add6" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 16:00:16 crc kubenswrapper[5120]: I0316 16:00:16.500518 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b7049577-d3a2-4125-b841-70c5f6e1da23-operator-scripts\") pod \"b7049577-d3a2-4125-b841-70c5f6e1da23\" (UID: \"b7049577-d3a2-4125-b841-70c5f6e1da23\") " Mar 16 16:00:16 crc kubenswrapper[5120]: I0316 16:00:16.500605 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-49c7h\" (UniqueName: \"kubernetes.io/projected/169cc9e8-ed2f-47c8-b98a-0143f4c480d7-kube-api-access-49c7h\") pod \"169cc9e8-ed2f-47c8-b98a-0143f4c480d7\" (UID: \"169cc9e8-ed2f-47c8-b98a-0143f4c480d7\") " Mar 16 16:00:16 crc kubenswrapper[5120]: I0316 16:00:16.500683 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z58pz\" (UniqueName: \"kubernetes.io/projected/b7049577-d3a2-4125-b841-70c5f6e1da23-kube-api-access-z58pz\") pod \"b7049577-d3a2-4125-b841-70c5f6e1da23\" (UID: \"b7049577-d3a2-4125-b841-70c5f6e1da23\") " Mar 16 16:00:16 crc kubenswrapper[5120]: I0316 16:00:16.500882 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/169cc9e8-ed2f-47c8-b98a-0143f4c480d7-operator-scripts\") pod \"169cc9e8-ed2f-47c8-b98a-0143f4c480d7\" (UID: \"169cc9e8-ed2f-47c8-b98a-0143f4c480d7\") " Mar 16 16:00:16 crc kubenswrapper[5120]: E0316 16:00:16.501316 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Mar 16 16:00:16 crc kubenswrapper[5120]: E0316 16:00:16.501387 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/492ba9f3-6479-432b-a2f4-cee712a51800-config-data podName:492ba9f3-6479-432b-a2f4-cee712a51800 nodeName:}" failed. No retries permitted until 2026-03-16 16:00:20.501370156 +0000 UTC m=+1722.655301813 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/492ba9f3-6479-432b-a2f4-cee712a51800-config-data") pod "rabbitmq-cell1-server-0" (UID: "492ba9f3-6479-432b-a2f4-cee712a51800") : configmap "rabbitmq-cell1-config-data" not found Mar 16 16:00:16 crc kubenswrapper[5120]: I0316 16:00:16.502275 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/169cc9e8-ed2f-47c8-b98a-0143f4c480d7-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "169cc9e8-ed2f-47c8-b98a-0143f4c480d7" (UID: "169cc9e8-ed2f-47c8-b98a-0143f4c480d7"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:00:16 crc kubenswrapper[5120]: I0316 16:00:16.504455 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b7049577-d3a2-4125-b841-70c5f6e1da23-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "b7049577-d3a2-4125-b841-70c5f6e1da23" (UID: "b7049577-d3a2-4125-b841-70c5f6e1da23"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:00:16 crc kubenswrapper[5120]: I0316 16:00:16.506928 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/169cc9e8-ed2f-47c8-b98a-0143f4c480d7-kube-api-access-49c7h" (OuterVolumeSpecName: "kube-api-access-49c7h") pod "169cc9e8-ed2f-47c8-b98a-0143f4c480d7" (UID: "169cc9e8-ed2f-47c8-b98a-0143f4c480d7"). InnerVolumeSpecName "kube-api-access-49c7h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:00:16 crc kubenswrapper[5120]: I0316 16:00:16.513970 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7049577-d3a2-4125-b841-70c5f6e1da23-kube-api-access-z58pz" (OuterVolumeSpecName: "kube-api-access-z58pz") pod "b7049577-d3a2-4125-b841-70c5f6e1da23" (UID: "b7049577-d3a2-4125-b841-70c5f6e1da23"). InnerVolumeSpecName "kube-api-access-z58pz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:00:16 crc kubenswrapper[5120]: I0316 16:00:16.602503 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b7049577-d3a2-4125-b841-70c5f6e1da23-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:16 crc kubenswrapper[5120]: I0316 16:00:16.602533 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-49c7h\" (UniqueName: \"kubernetes.io/projected/169cc9e8-ed2f-47c8-b98a-0143f4c480d7-kube-api-access-49c7h\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:16 crc kubenswrapper[5120]: I0316 16:00:16.602546 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z58pz\" (UniqueName: \"kubernetes.io/projected/b7049577-d3a2-4125-b841-70c5f6e1da23-kube-api-access-z58pz\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:16 crc kubenswrapper[5120]: I0316 16:00:16.602557 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/169cc9e8-ed2f-47c8-b98a-0143f4c480d7-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:16 crc kubenswrapper[5120]: I0316 16:00:16.603547 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-6b7md" Mar 16 16:00:16 crc kubenswrapper[5120]: I0316 16:00:16.605003 5120 status_manager.go:895] "Failed to get status for pod" podUID="b5ed0fd6-65dd-4480-acce-2eb38249add6" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 16:00:16 crc kubenswrapper[5120]: I0316 16:00:16.679415 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0747eaf7-a464-4360-bf02-c8e9a9be90fa" path="/var/lib/kubelet/pods/0747eaf7-a464-4360-bf02-c8e9a9be90fa/volumes" Mar 16 16:00:16 crc kubenswrapper[5120]: I0316 16:00:16.680149 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="588c75bf-de6d-4608-8d63-85c81408a1e3" path="/var/lib/kubelet/pods/588c75bf-de6d-4608-8d63-85c81408a1e3/volumes" Mar 16 16:00:16 crc kubenswrapper[5120]: I0316 16:00:16.681406 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b5ed0fd6-65dd-4480-acce-2eb38249add6" path="/var/lib/kubelet/pods/b5ed0fd6-65dd-4480-acce-2eb38249add6/volumes" Mar 16 16:00:16 crc kubenswrapper[5120]: I0316 16:00:16.681907 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d8fa3460-7a46-4469-89a7-72bab7d41985" path="/var/lib/kubelet/pods/d8fa3460-7a46-4469-89a7-72bab7d41985/volumes" Mar 16 16:00:16 crc kubenswrapper[5120]: I0316 16:00:16.682617 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f8f48fe3-091f-40a2-b580-69ba5cb95392" path="/var/lib/kubelet/pods/f8f48fe3-091f-40a2-b580-69ba5cb95392/volumes" Mar 16 16:00:16 crc kubenswrapper[5120]: I0316 16:00:16.704251 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2jx24\" (UniqueName: \"kubernetes.io/projected/7e2bc91b-26c0-4506-8629-832872fb453f-kube-api-access-2jx24\") pod \"7e2bc91b-26c0-4506-8629-832872fb453f\" (UID: \"7e2bc91b-26c0-4506-8629-832872fb453f\") " Mar 16 16:00:16 crc kubenswrapper[5120]: I0316 16:00:16.704466 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/7e2bc91b-26c0-4506-8629-832872fb453f-operator-scripts\") pod \"7e2bc91b-26c0-4506-8629-832872fb453f\" (UID: \"7e2bc91b-26c0-4506-8629-832872fb453f\") " Mar 16 16:00:16 crc kubenswrapper[5120]: I0316 16:00:16.704995 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7e2bc91b-26c0-4506-8629-832872fb453f-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "7e2bc91b-26c0-4506-8629-832872fb453f" (UID: "7e2bc91b-26c0-4506-8629-832872fb453f"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:00:16 crc kubenswrapper[5120]: I0316 16:00:16.705611 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/7e2bc91b-26c0-4506-8629-832872fb453f-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:16 crc kubenswrapper[5120]: I0316 16:00:16.717135 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e2bc91b-26c0-4506-8629-832872fb453f-kube-api-access-2jx24" (OuterVolumeSpecName: "kube-api-access-2jx24") pod "7e2bc91b-26c0-4506-8629-832872fb453f" (UID: "7e2bc91b-26c0-4506-8629-832872fb453f"). InnerVolumeSpecName "kube-api-access-2jx24". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:00:16 crc kubenswrapper[5120]: I0316 16:00:16.806905 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2jx24\" (UniqueName: \"kubernetes.io/projected/7e2bc91b-26c0-4506-8629-832872fb453f-kube-api-access-2jx24\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:16 crc kubenswrapper[5120]: I0316 16:00:16.819562 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/swift-proxy-59f58b5b58-tw7qc" podUID="2e562dac-a1db-446c-b73a-21df22608a50" containerName="proxy-httpd" probeResult="failure" output="Get \"https://10.217.1.24:8080/healthcheck\": dial tcp 10.217.1.24:8080: connect: connection refused" Mar 16 16:00:16 crc kubenswrapper[5120]: E0316 16:00:16.844813 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="b69196aca7077e660b738179840f4cffce2c72a012a2f8f0a16939792591c08e" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:00:16 crc kubenswrapper[5120]: E0316 16:00:16.848659 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="b69196aca7077e660b738179840f4cffce2c72a012a2f8f0a16939792591c08e" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:00:16 crc kubenswrapper[5120]: E0316 16:00:16.852145 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="b69196aca7077e660b738179840f4cffce2c72a012a2f8f0a16939792591c08e" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:00:16 crc kubenswrapper[5120]: E0316 16:00:16.852208 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="5da6e8f8-fa80-477a-bbf9-0e251dd24153" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 16:00:16 crc kubenswrapper[5120]: I0316 16:00:16.919298 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-6b7md" event={"ID":"7e2bc91b-26c0-4506-8629-832872fb453f","Type":"ContainerDied","Data":"4495879e0786092f12567ee54871a40ab6166f540fbc6ae54070351263b78fe0"} Mar 16 16:00:16 crc kubenswrapper[5120]: I0316 16:00:16.919403 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-6b7md" Mar 16 16:00:16 crc kubenswrapper[5120]: I0316 16:00:16.929866 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-79ea-account-create-update-nlbgs" Mar 16 16:00:16 crc kubenswrapper[5120]: I0316 16:00:16.929852 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-79ea-account-create-update-nlbgs" event={"ID":"169cc9e8-ed2f-47c8-b98a-0143f4c480d7","Type":"ContainerDied","Data":"4e8e88c20282ca0bcb48ed20bf4fd75c9c07f7e4f3ede0879ef6140c6ab64e51"} Mar 16 16:00:16 crc kubenswrapper[5120]: I0316 16:00:16.953531 5120 generic.go:358] "Generic (PLEG): container finished" podID="fc59410f-18f6-4de8-b0f9-d54fcaea8faf" containerID="a6fa07bc0f02cb03d8fcdf8ab981b8a547194306c2f75b1a463d7c6f09841cdf" exitCode=0 Mar 16 16:00:16 crc kubenswrapper[5120]: I0316 16:00:16.954380 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-54b7655659-bqszk" event={"ID":"fc59410f-18f6-4de8-b0f9-d54fcaea8faf","Type":"ContainerDied","Data":"a6fa07bc0f02cb03d8fcdf8ab981b8a547194306c2f75b1a463d7c6f09841cdf"} Mar 16 16:00:16 crc kubenswrapper[5120]: I0316 16:00:16.954513 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-54b7655659-bqszk" event={"ID":"fc59410f-18f6-4de8-b0f9-d54fcaea8faf","Type":"ContainerDied","Data":"bc3d9ee90383e169311bab2848e8c2a98dd69ab3a71700c42f9b8ba57378c698"} Mar 16 16:00:16 crc kubenswrapper[5120]: I0316 16:00:16.954625 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bc3d9ee90383e169311bab2848e8c2a98dd69ab3a71700c42f9b8ba57378c698" Mar 16 16:00:16 crc kubenswrapper[5120]: I0316 16:00:16.960270 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-8a54-account-create-update-9l5b7" Mar 16 16:00:16 crc kubenswrapper[5120]: I0316 16:00:16.974705 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-ef54-account-create-update-b2vpk" event={"ID":"14fb94bd-5ac0-4ea1-98bf-1980cebf6e4d","Type":"ContainerDied","Data":"48506a0c7dbcd16fbacde23a3d4fc4f6a37b8b1ca56f7900abe509974411f305"} Mar 16 16:00:16 crc kubenswrapper[5120]: I0316 16:00:16.975307 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="48506a0c7dbcd16fbacde23a3d4fc4f6a37b8b1ca56f7900abe509974411f305" Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.002957 5120 generic.go:358] "Generic (PLEG): container finished" podID="2e562dac-a1db-446c-b73a-21df22608a50" containerID="64e90c71960de20873b7811fc895ce903bc60eaefd9593abac82e4c4b489e606" exitCode=0 Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.003108 5120 generic.go:358] "Generic (PLEG): container finished" podID="2e562dac-a1db-446c-b73a-21df22608a50" containerID="6f7dc6683e41d78ef9ed871ab4cec8bf6d45dff6e94f3f28507ba3a97f851f26" exitCode=0 Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.003091 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-59f58b5b58-tw7qc" event={"ID":"2e562dac-a1db-446c-b73a-21df22608a50","Type":"ContainerDied","Data":"64e90c71960de20873b7811fc895ce903bc60eaefd9593abac82e4c4b489e606"} Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.003425 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-59f58b5b58-tw7qc" event={"ID":"2e562dac-a1db-446c-b73a-21df22608a50","Type":"ContainerDied","Data":"6f7dc6683e41d78ef9ed871ab4cec8bf6d45dff6e94f3f28507ba3a97f851f26"} Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.010587 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qx5wh\" (UniqueName: \"kubernetes.io/projected/ecfb18c4-5cb2-4ab6-8445-79c3eec250d8-kube-api-access-qx5wh\") pod \"ecfb18c4-5cb2-4ab6-8445-79c3eec250d8\" (UID: \"ecfb18c4-5cb2-4ab6-8445-79c3eec250d8\") " Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.010705 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ecfb18c4-5cb2-4ab6-8445-79c3eec250d8-operator-scripts\") pod \"ecfb18c4-5cb2-4ab6-8445-79c3eec250d8\" (UID: \"ecfb18c4-5cb2-4ab6-8445-79c3eec250d8\") " Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.011529 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ecfb18c4-5cb2-4ab6-8445-79c3eec250d8-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "ecfb18c4-5cb2-4ab6-8445-79c3eec250d8" (UID: "ecfb18c4-5cb2-4ab6-8445-79c3eec250d8"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.029925 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-mm5p4"] Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.050882 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ecfb18c4-5cb2-4ab6-8445-79c3eec250d8-kube-api-access-qx5wh" (OuterVolumeSpecName: "kube-api-access-qx5wh") pod "ecfb18c4-5cb2-4ab6-8445-79c3eec250d8" (UID: "ecfb18c4-5cb2-4ab6-8445-79c3eec250d8"). InnerVolumeSpecName "kube-api-access-qx5wh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.051206 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-8a54-account-create-update-9l5b7" event={"ID":"ecfb18c4-5cb2-4ab6-8445-79c3eec250d8","Type":"ContainerDied","Data":"b7515c49c371913073d8535d9e5fa690da67c551467efefb10f3a93b62aa56aa"} Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.051386 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.051479 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-8a54-account-create-update-9l5b7" Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.068058 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-7ef1-account-create-update-lv85w"] Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.068469 5120 generic.go:358] "Generic (PLEG): container finished" podID="5f40aae9-22bd-4ef7-b5ac-a68a1f729482" containerID="d7bcbc11d57f7b382223d2be2730aa8ce601aa8b7b76169a7c140d7502ae92ac" exitCode=0 Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.068603 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"5f40aae9-22bd-4ef7-b5ac-a68a1f729482","Type":"ContainerDied","Data":"d7bcbc11d57f7b382223d2be2730aa8ce601aa8b7b76169a7c140d7502ae92ac"} Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.068696 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"5f40aae9-22bd-4ef7-b5ac-a68a1f729482","Type":"ContainerDied","Data":"da7a660faa34ce0df16e76b67ffe6e4e16ccdc24b94c94e5b6b9e06537407cd5"} Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.068794 5120 scope.go:117] "RemoveContainer" containerID="d7bcbc11d57f7b382223d2be2730aa8ce601aa8b7b76169a7c140d7502ae92ac" Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.069014 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-ef54-account-create-update-b2vpk" Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.123897 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-dc27-account-create-update-2jjjz" event={"ID":"b7049577-d3a2-4125-b841-70c5f6e1da23","Type":"ContainerDied","Data":"94a6494d48ba6265bca75999486e8acc0378164207517ce9c522fba19b40c560"} Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.124189 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-dc27-account-create-update-2jjjz" Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.126383 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5f40aae9-22bd-4ef7-b5ac-a68a1f729482-config-data\") pod \"5f40aae9-22bd-4ef7-b5ac-a68a1f729482\" (UID: \"5f40aae9-22bd-4ef7-b5ac-a68a1f729482\") " Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.126480 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/5f40aae9-22bd-4ef7-b5ac-a68a1f729482-nova-novncproxy-tls-certs\") pod \"5f40aae9-22bd-4ef7-b5ac-a68a1f729482\" (UID: \"5f40aae9-22bd-4ef7-b5ac-a68a1f729482\") " Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.126616 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5f40aae9-22bd-4ef7-b5ac-a68a1f729482-combined-ca-bundle\") pod \"5f40aae9-22bd-4ef7-b5ac-a68a1f729482\" (UID: \"5f40aae9-22bd-4ef7-b5ac-a68a1f729482\") " Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.126642 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ts9jd\" (UniqueName: \"kubernetes.io/projected/5f40aae9-22bd-4ef7-b5ac-a68a1f729482-kube-api-access-ts9jd\") pod \"5f40aae9-22bd-4ef7-b5ac-a68a1f729482\" (UID: \"5f40aae9-22bd-4ef7-b5ac-a68a1f729482\") " Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.126715 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/5f40aae9-22bd-4ef7-b5ac-a68a1f729482-vencrypt-tls-certs\") pod \"5f40aae9-22bd-4ef7-b5ac-a68a1f729482\" (UID: \"5f40aae9-22bd-4ef7-b5ac-a68a1f729482\") " Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.142779 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qx5wh\" (UniqueName: \"kubernetes.io/projected/ecfb18c4-5cb2-4ab6-8445-79c3eec250d8-kube-api-access-qx5wh\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.142807 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ecfb18c4-5cb2-4ab6-8445-79c3eec250d8-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:17 crc kubenswrapper[5120]: E0316 16:00:17.143890 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-config-data: configmap "rabbitmq-config-data" not found Mar 16 16:00:17 crc kubenswrapper[5120]: E0316 16:00:17.143974 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b6cf92fd-a58b-4b50-9a61-35486c401d72-config-data podName:b6cf92fd-a58b-4b50-9a61-35486c401d72 nodeName:}" failed. No retries permitted until 2026-03-16 16:00:21.143953788 +0000 UTC m=+1723.297885445 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/b6cf92fd-a58b-4b50-9a61-35486c401d72-config-data") pod "rabbitmq-server-0" (UID: "b6cf92fd-a58b-4b50-9a61-35486c401d72") : configmap "rabbitmq-config-data" not found Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.159741 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f40aae9-22bd-4ef7-b5ac-a68a1f729482-kube-api-access-ts9jd" (OuterVolumeSpecName: "kube-api-access-ts9jd") pod "5f40aae9-22bd-4ef7-b5ac-a68a1f729482" (UID: "5f40aae9-22bd-4ef7-b5ac-a68a1f729482"). InnerVolumeSpecName "kube-api-access-ts9jd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.169637 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.169869 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/memcached-0" podUID="5664a123-9ba3-41e9-8dab-49276b5e404e" containerName="memcached" containerID="cri-o://3e79e4c778100da677b7b8adc1bc5e9b3d67806fc66f9998e46dbce7ad87e99e" gracePeriod=30 Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.188008 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"08f284b7-104e-4395-b9cc-7c8acf4b943e","Type":"ContainerDied","Data":"9facc72c1d24761f4185f0cf5d688d537fb04cccce47e629b7c17dcca961ec41"} Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.188129 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.206327 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-54b7655659-bqszk" Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.210695 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f40aae9-22bd-4ef7-b5ac-a68a1f729482-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "5f40aae9-22bd-4ef7-b5ac-a68a1f729482" (UID: "5f40aae9-22bd-4ef7-b5ac-a68a1f729482"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.217586 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-59f58b5b58-tw7qc" Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.222910 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-7ef1-account-create-update-lv85w"] Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.223923 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f40aae9-22bd-4ef7-b5ac-a68a1f729482-config-data" (OuterVolumeSpecName: "config-data") pod "5f40aae9-22bd-4ef7-b5ac-a68a1f729482" (UID: "5f40aae9-22bd-4ef7-b5ac-a68a1f729482"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.226277 5120 generic.go:358] "Generic (PLEG): container finished" podID="1d8cf310-88d2-4a5c-a2d9-2807cd409f37" containerID="5947f9d479cbbe03d5e81c795fe4598420a5ae0c722f314229b64194063a5d8f" exitCode=0 Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.226525 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1d8cf310-88d2-4a5c-a2d9-2807cd409f37","Type":"ContainerDied","Data":"5947f9d479cbbe03d5e81c795fe4598420a5ae0c722f314229b64194063a5d8f"} Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.233658 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-7ef1-account-create-update-8zrpq"] Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.239072 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="588c75bf-de6d-4608-8d63-85c81408a1e3" containerName="openstack-network-exporter" Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.239107 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="588c75bf-de6d-4608-8d63-85c81408a1e3" containerName="openstack-network-exporter" Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.239119 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="588c75bf-de6d-4608-8d63-85c81408a1e3" containerName="ovsdbserver-sb" Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.239125 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="588c75bf-de6d-4608-8d63-85c81408a1e3" containerName="ovsdbserver-sb" Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.239137 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f40aae9-22bd-4ef7-b5ac-a68a1f729482" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.239145 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f40aae9-22bd-4ef7-b5ac-a68a1f729482" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.239172 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08f284b7-104e-4395-b9cc-7c8acf4b943e" containerName="kube-state-metrics" Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.239178 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="08f284b7-104e-4395-b9cc-7c8acf4b943e" containerName="kube-state-metrics" Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.239185 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e562dac-a1db-446c-b73a-21df22608a50" containerName="proxy-server" Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.239190 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e562dac-a1db-446c-b73a-21df22608a50" containerName="proxy-server" Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.239204 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc59410f-18f6-4de8-b0f9-d54fcaea8faf" containerName="barbican-worker" Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.239209 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc59410f-18f6-4de8-b0f9-d54fcaea8faf" containerName="barbican-worker" Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.239238 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48b9c79e-2a39-4fa1-9143-e4175c7b45b2" containerName="mysql-bootstrap" Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.239243 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="48b9c79e-2a39-4fa1-9143-e4175c7b45b2" containerName="mysql-bootstrap" Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.239252 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48b9c79e-2a39-4fa1-9143-e4175c7b45b2" containerName="galera" Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.239257 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="48b9c79e-2a39-4fa1-9143-e4175c7b45b2" containerName="galera" Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.239265 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e562dac-a1db-446c-b73a-21df22608a50" containerName="proxy-httpd" Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.239271 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e562dac-a1db-446c-b73a-21df22608a50" containerName="proxy-httpd" Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.239284 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc59410f-18f6-4de8-b0f9-d54fcaea8faf" containerName="barbican-worker-log" Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.239289 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc59410f-18f6-4de8-b0f9-d54fcaea8faf" containerName="barbican-worker-log" Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.239431 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="588c75bf-de6d-4608-8d63-85c81408a1e3" containerName="openstack-network-exporter" Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.239442 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="2e562dac-a1db-446c-b73a-21df22608a50" containerName="proxy-httpd" Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.239452 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="588c75bf-de6d-4608-8d63-85c81408a1e3" containerName="ovsdbserver-sb" Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.239463 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="fc59410f-18f6-4de8-b0f9-d54fcaea8faf" containerName="barbican-worker" Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.239472 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="48b9c79e-2a39-4fa1-9143-e4175c7b45b2" containerName="galera" Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.239478 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="fc59410f-18f6-4de8-b0f9-d54fcaea8faf" containerName="barbican-worker-log" Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.239488 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="2e562dac-a1db-446c-b73a-21df22608a50" containerName="proxy-server" Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.239494 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="5f40aae9-22bd-4ef7-b5ac-a68a1f729482" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.239508 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="08f284b7-104e-4395-b9cc-7c8acf4b943e" containerName="kube-state-metrics" Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.240578 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.244568 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tx7dn\" (UniqueName: \"kubernetes.io/projected/14fb94bd-5ac0-4ea1-98bf-1980cebf6e4d-kube-api-access-tx7dn\") pod \"14fb94bd-5ac0-4ea1-98bf-1980cebf6e4d\" (UID: \"14fb94bd-5ac0-4ea1-98bf-1980cebf6e4d\") " Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.250637 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/14fb94bd-5ac0-4ea1-98bf-1980cebf6e4d-operator-scripts\") pod \"14fb94bd-5ac0-4ea1-98bf-1980cebf6e4d\" (UID: \"14fb94bd-5ac0-4ea1-98bf-1980cebf6e4d\") " Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.247632 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-7ef1-account-create-update-8zrpq" Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.247533 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"48b9c79e-2a39-4fa1-9143-e4175c7b45b2","Type":"ContainerDied","Data":"e6bbfaa4c28705e9fd56de22addffac2da9b1f9e925eed57dd08a75c2a7acd67"} Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.253124 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-7ef1-account-create-update-8zrpq"] Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.251514 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14fb94bd-5ac0-4ea1-98bf-1980cebf6e4d-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "14fb94bd-5ac0-4ea1-98bf-1980cebf6e4d" (UID: "14fb94bd-5ac0-4ea1-98bf-1980cebf6e4d"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.252663 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14fb94bd-5ac0-4ea1-98bf-1980cebf6e4d-kube-api-access-tx7dn" (OuterVolumeSpecName: "kube-api-access-tx7dn") pod "14fb94bd-5ac0-4ea1-98bf-1980cebf6e4d" (UID: "14fb94bd-5ac0-4ea1-98bf-1980cebf6e4d"). InnerVolumeSpecName "kube-api-access-tx7dn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.255902 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-6b7md"] Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.265620 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-db-secret\"" Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.270808 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f40aae9-22bd-4ef7-b5ac-a68a1f729482-vencrypt-tls-certs" (OuterVolumeSpecName: "vencrypt-tls-certs") pod "5f40aae9-22bd-4ef7-b5ac-a68a1f729482" (UID: "5f40aae9-22bd-4ef7-b5ac-a68a1f729482"). InnerVolumeSpecName "vencrypt-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.276236 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tx7dn\" (UniqueName: \"kubernetes.io/projected/14fb94bd-5ac0-4ea1-98bf-1980cebf6e4d-kube-api-access-tx7dn\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.276572 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/14fb94bd-5ac0-4ea1-98bf-1980cebf6e4d-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.276856 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f40aae9-22bd-4ef7-b5ac-a68a1f729482-nova-novncproxy-tls-certs" (OuterVolumeSpecName: "nova-novncproxy-tls-certs") pod "5f40aae9-22bd-4ef7-b5ac-a68a1f729482" (UID: "5f40aae9-22bd-4ef7-b5ac-a68a1f729482"). InnerVolumeSpecName "nova-novncproxy-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.276932 5120 scope.go:117] "RemoveContainer" containerID="d7bcbc11d57f7b382223d2be2730aa8ce601aa8b7b76169a7c140d7502ae92ac" Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.277133 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5f40aae9-22bd-4ef7-b5ac-a68a1f729482-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.277154 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5f40aae9-22bd-4ef7-b5ac-a68a1f729482-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.277165 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ts9jd\" (UniqueName: \"kubernetes.io/projected/5f40aae9-22bd-4ef7-b5ac-a68a1f729482-kube-api-access-ts9jd\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.277175 5120 reconciler_common.go:299] "Volume detached for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/5f40aae9-22bd-4ef7-b5ac-a68a1f729482-vencrypt-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:17 crc kubenswrapper[5120]: E0316 16:00:17.277692 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d7bcbc11d57f7b382223d2be2730aa8ce601aa8b7b76169a7c140d7502ae92ac\": container with ID starting with d7bcbc11d57f7b382223d2be2730aa8ce601aa8b7b76169a7c140d7502ae92ac not found: ID does not exist" containerID="d7bcbc11d57f7b382223d2be2730aa8ce601aa8b7b76169a7c140d7502ae92ac" Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.277722 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7bcbc11d57f7b382223d2be2730aa8ce601aa8b7b76169a7c140d7502ae92ac"} err="failed to get container status \"d7bcbc11d57f7b382223d2be2730aa8ce601aa8b7b76169a7c140d7502ae92ac\": rpc error: code = NotFound desc = could not find container \"d7bcbc11d57f7b382223d2be2730aa8ce601aa8b7b76169a7c140d7502ae92ac\": container with ID starting with d7bcbc11d57f7b382223d2be2730aa8ce601aa8b7b76169a7c140d7502ae92ac not found: ID does not exist" Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.277741 5120 scope.go:117] "RemoveContainer" containerID="8f0c678e052c56ea5916115f262b647c8634ba2b451635a3702fc27a5161c88c" Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.294007 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-6b7md"] Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.305877 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-d4kn4"] Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.317860 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-bwm2j"] Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.353561 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-d4kn4"] Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.377733 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2e562dac-a1db-446c-b73a-21df22608a50-log-httpd\") pod \"2e562dac-a1db-446c-b73a-21df22608a50\" (UID: \"2e562dac-a1db-446c-b73a-21df22608a50\") " Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.377822 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2e562dac-a1db-446c-b73a-21df22608a50-run-httpd\") pod \"2e562dac-a1db-446c-b73a-21df22608a50\" (UID: \"2e562dac-a1db-446c-b73a-21df22608a50\") " Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.377880 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/2e562dac-a1db-446c-b73a-21df22608a50-public-tls-certs\") pod \"2e562dac-a1db-446c-b73a-21df22608a50\" (UID: \"2e562dac-a1db-446c-b73a-21df22608a50\") " Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.377948 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/2e562dac-a1db-446c-b73a-21df22608a50-etc-swift\") pod \"2e562dac-a1db-446c-b73a-21df22608a50\" (UID: \"2e562dac-a1db-446c-b73a-21df22608a50\") " Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.378040 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fc59410f-18f6-4de8-b0f9-d54fcaea8faf-config-data\") pod \"fc59410f-18f6-4de8-b0f9-d54fcaea8faf\" (UID: \"fc59410f-18f6-4de8-b0f9-d54fcaea8faf\") " Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.378078 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2e562dac-a1db-446c-b73a-21df22608a50-combined-ca-bundle\") pod \"2e562dac-a1db-446c-b73a-21df22608a50\" (UID: \"2e562dac-a1db-446c-b73a-21df22608a50\") " Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.378146 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ff76x\" (UniqueName: \"kubernetes.io/projected/2e562dac-a1db-446c-b73a-21df22608a50-kube-api-access-ff76x\") pod \"2e562dac-a1db-446c-b73a-21df22608a50\" (UID: \"2e562dac-a1db-446c-b73a-21df22608a50\") " Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.378192 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fc59410f-18f6-4de8-b0f9-d54fcaea8faf-combined-ca-bundle\") pod \"fc59410f-18f6-4de8-b0f9-d54fcaea8faf\" (UID: \"fc59410f-18f6-4de8-b0f9-d54fcaea8faf\") " Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.378220 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/fc59410f-18f6-4de8-b0f9-d54fcaea8faf-logs\") pod \"fc59410f-18f6-4de8-b0f9-d54fcaea8faf\" (UID: \"fc59410f-18f6-4de8-b0f9-d54fcaea8faf\") " Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.378255 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/2e562dac-a1db-446c-b73a-21df22608a50-internal-tls-certs\") pod \"2e562dac-a1db-446c-b73a-21df22608a50\" (UID: \"2e562dac-a1db-446c-b73a-21df22608a50\") " Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.378358 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ckjcl\" (UniqueName: \"kubernetes.io/projected/fc59410f-18f6-4de8-b0f9-d54fcaea8faf-kube-api-access-ckjcl\") pod \"fc59410f-18f6-4de8-b0f9-d54fcaea8faf\" (UID: \"fc59410f-18f6-4de8-b0f9-d54fcaea8faf\") " Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.378357 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e562dac-a1db-446c-b73a-21df22608a50-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "2e562dac-a1db-446c-b73a-21df22608a50" (UID: "2e562dac-a1db-446c-b73a-21df22608a50"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.378673 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc59410f-18f6-4de8-b0f9-d54fcaea8faf-logs" (OuterVolumeSpecName: "logs") pod "fc59410f-18f6-4de8-b0f9-d54fcaea8faf" (UID: "fc59410f-18f6-4de8-b0f9-d54fcaea8faf"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.379331 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/fc59410f-18f6-4de8-b0f9-d54fcaea8faf-config-data-custom\") pod \"fc59410f-18f6-4de8-b0f9-d54fcaea8faf\" (UID: \"fc59410f-18f6-4de8-b0f9-d54fcaea8faf\") " Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.379413 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e562dac-a1db-446c-b73a-21df22608a50-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "2e562dac-a1db-446c-b73a-21df22608a50" (UID: "2e562dac-a1db-446c-b73a-21df22608a50"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.379446 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2e562dac-a1db-446c-b73a-21df22608a50-config-data\") pod \"2e562dac-a1db-446c-b73a-21df22608a50\" (UID: \"2e562dac-a1db-446c-b73a-21df22608a50\") " Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.379873 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a6eb6a92-c8e9-4dd4-9f92-55eb20dec5c0-operator-scripts\") pod \"keystone-7ef1-account-create-update-8zrpq\" (UID: \"a6eb6a92-c8e9-4dd4-9f92-55eb20dec5c0\") " pod="openstack-kuttl-tests/keystone-7ef1-account-create-update-8zrpq" Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.380314 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lpdk5\" (UniqueName: \"kubernetes.io/projected/a6eb6a92-c8e9-4dd4-9f92-55eb20dec5c0-kube-api-access-lpdk5\") pod \"keystone-7ef1-account-create-update-8zrpq\" (UID: \"a6eb6a92-c8e9-4dd4-9f92-55eb20dec5c0\") " pod="openstack-kuttl-tests/keystone-7ef1-account-create-update-8zrpq" Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.380450 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/fc59410f-18f6-4de8-b0f9-d54fcaea8faf-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.380465 5120 reconciler_common.go:299] "Volume detached for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/5f40aae9-22bd-4ef7-b5ac-a68a1f729482-nova-novncproxy-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.380475 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2e562dac-a1db-446c-b73a-21df22608a50-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.380483 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2e562dac-a1db-446c-b73a-21df22608a50-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.382265 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-bwm2j"] Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.403583 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc59410f-18f6-4de8-b0f9-d54fcaea8faf-kube-api-access-ckjcl" (OuterVolumeSpecName: "kube-api-access-ckjcl") pod "fc59410f-18f6-4de8-b0f9-d54fcaea8faf" (UID: "fc59410f-18f6-4de8-b0f9-d54fcaea8faf"). InnerVolumeSpecName "kube-api-access-ckjcl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.405490 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc59410f-18f6-4de8-b0f9-d54fcaea8faf-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "fc59410f-18f6-4de8-b0f9-d54fcaea8faf" (UID: "fc59410f-18f6-4de8-b0f9-d54fcaea8faf"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.405569 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e562dac-a1db-446c-b73a-21df22608a50-etc-swift" (OuterVolumeSpecName: "etc-swift") pod "2e562dac-a1db-446c-b73a-21df22608a50" (UID: "2e562dac-a1db-446c-b73a-21df22608a50"). InnerVolumeSpecName "etc-swift". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.414856 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-549cb9f7c8-crdfd"] Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.415085 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/keystone-549cb9f7c8-crdfd" podUID="57a83a83-de95-43e1-b18c-a7b59c4d1a3b" containerName="keystone-api" containerID="cri-o://a95489c8bbe1e3ef55ce309ffd1d01d5bd0af121804a472f940c85adb881b073" gracePeriod=30 Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.416544 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e562dac-a1db-446c-b73a-21df22608a50-kube-api-access-ff76x" (OuterVolumeSpecName: "kube-api-access-ff76x") pod "2e562dac-a1db-446c-b73a-21df22608a50" (UID: "2e562dac-a1db-446c-b73a-21df22608a50"). InnerVolumeSpecName "kube-api-access-ff76x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.426737 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.447631 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc59410f-18f6-4de8-b0f9-d54fcaea8faf-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "fc59410f-18f6-4de8-b0f9-d54fcaea8faf" (UID: "fc59410f-18f6-4de8-b0f9-d54fcaea8faf"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.454827 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-79ea-account-create-update-nlbgs"] Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.458843 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e562dac-a1db-446c-b73a-21df22608a50-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "2e562dac-a1db-446c-b73a-21df22608a50" (UID: "2e562dac-a1db-446c-b73a-21df22608a50"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.462394 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e562dac-a1db-446c-b73a-21df22608a50-config-data" (OuterVolumeSpecName: "config-data") pod "2e562dac-a1db-446c-b73a-21df22608a50" (UID: "2e562dac-a1db-446c-b73a-21df22608a50"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.467340 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e562dac-a1db-446c-b73a-21df22608a50-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "2e562dac-a1db-446c-b73a-21df22608a50" (UID: "2e562dac-a1db-446c-b73a-21df22608a50"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.487704 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lpdk5\" (UniqueName: \"kubernetes.io/projected/a6eb6a92-c8e9-4dd4-9f92-55eb20dec5c0-kube-api-access-lpdk5\") pod \"keystone-7ef1-account-create-update-8zrpq\" (UID: \"a6eb6a92-c8e9-4dd4-9f92-55eb20dec5c0\") " pod="openstack-kuttl-tests/keystone-7ef1-account-create-update-8zrpq" Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.487922 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a6eb6a92-c8e9-4dd4-9f92-55eb20dec5c0-operator-scripts\") pod \"keystone-7ef1-account-create-update-8zrpq\" (UID: \"a6eb6a92-c8e9-4dd4-9f92-55eb20dec5c0\") " pod="openstack-kuttl-tests/keystone-7ef1-account-create-update-8zrpq" Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.488029 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ff76x\" (UniqueName: \"kubernetes.io/projected/2e562dac-a1db-446c-b73a-21df22608a50-kube-api-access-ff76x\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.488048 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fc59410f-18f6-4de8-b0f9-d54fcaea8faf-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.488061 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/2e562dac-a1db-446c-b73a-21df22608a50-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.488079 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ckjcl\" (UniqueName: \"kubernetes.io/projected/fc59410f-18f6-4de8-b0f9-d54fcaea8faf-kube-api-access-ckjcl\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.489050 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/fc59410f-18f6-4de8-b0f9-d54fcaea8faf-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.489082 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2e562dac-a1db-446c-b73a-21df22608a50-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.489097 5120 reconciler_common.go:299] "Volume detached for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/2e562dac-a1db-446c-b73a-21df22608a50-etc-swift\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.489117 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2e562dac-a1db-446c-b73a-21df22608a50-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:17 crc kubenswrapper[5120]: E0316 16:00:17.489290 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Mar 16 16:00:17 crc kubenswrapper[5120]: E0316 16:00:17.489398 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a6eb6a92-c8e9-4dd4-9f92-55eb20dec5c0-operator-scripts podName:a6eb6a92-c8e9-4dd4-9f92-55eb20dec5c0 nodeName:}" failed. No retries permitted until 2026-03-16 16:00:17.989371491 +0000 UTC m=+1720.143303158 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/a6eb6a92-c8e9-4dd4-9f92-55eb20dec5c0-operator-scripts") pod "keystone-7ef1-account-create-update-8zrpq" (UID: "a6eb6a92-c8e9-4dd4-9f92-55eb20dec5c0") : configmap "openstack-scripts" not found Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.491532 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-79ea-account-create-update-nlbgs"] Mar 16 16:00:17 crc kubenswrapper[5120]: E0316 16:00:17.493044 5120 projected.go:194] Error preparing data for projected volume kube-api-access-lpdk5 for pod openstack-kuttl-tests/keystone-7ef1-account-create-update-8zrpq: failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 16:00:17 crc kubenswrapper[5120]: E0316 16:00:17.493143 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a6eb6a92-c8e9-4dd4-9f92-55eb20dec5c0-kube-api-access-lpdk5 podName:a6eb6a92-c8e9-4dd4-9f92-55eb20dec5c0 nodeName:}" failed. No retries permitted until 2026-03-16 16:00:17.993122726 +0000 UTC m=+1720.147054383 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-lpdk5" (UniqueName: "kubernetes.io/projected/a6eb6a92-c8e9-4dd4-9f92-55eb20dec5c0-kube-api-access-lpdk5") pod "keystone-7ef1-account-create-update-8zrpq" (UID: "a6eb6a92-c8e9-4dd4-9f92-55eb20dec5c0") : failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.501154 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-7ef1-account-create-update-8zrpq"] Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.507785 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e562dac-a1db-446c-b73a-21df22608a50-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "2e562dac-a1db-446c-b73a-21df22608a50" (UID: "2e562dac-a1db-446c-b73a-21df22608a50"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.508629 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-db-create-g9hbz"] Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.515884 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-db-create-g9hbz"] Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.528988 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc59410f-18f6-4de8-b0f9-d54fcaea8faf-config-data" (OuterVolumeSpecName: "config-data") pod "fc59410f-18f6-4de8-b0f9-d54fcaea8faf" (UID: "fc59410f-18f6-4de8-b0f9-d54fcaea8faf"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:00:17 crc kubenswrapper[5120]: E0316 16:00:17.530043 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-lpdk5 operator-scripts], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openstack-kuttl-tests/keystone-7ef1-account-create-update-8zrpq" podUID="a6eb6a92-c8e9-4dd4-9f92-55eb20dec5c0" Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.535487 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-dc27-account-create-update-2jjjz"] Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.541145 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-dc27-account-create-update-2jjjz"] Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.579609 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.585458 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.593221 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fc59410f-18f6-4de8-b0f9-d54fcaea8faf-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.593256 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/2e562dac-a1db-446c-b73a-21df22608a50-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.596440 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-8a54-account-create-update-9l5b7"] Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.603948 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-8a54-account-create-update-9l5b7"] Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.616401 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.616458 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.643038 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/openstack-galera-0" podUID="b97c2a0c-dcad-4453-8063-d1bbcb265531" containerName="galera" containerID="cri-o://7a661bc910ce2d776a4e9f81005f8af24f1929db2c6f86edd9380bc21d372086" gracePeriod=30 Mar 16 16:00:17 crc kubenswrapper[5120]: I0316 16:00:17.712655 5120 scope.go:117] "RemoveContainer" containerID="94a873fd2b944f420b88e4b9e672ad596d411c27b15f3cb17cf449dd38652633" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.004295 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lpdk5\" (UniqueName: \"kubernetes.io/projected/a6eb6a92-c8e9-4dd4-9f92-55eb20dec5c0-kube-api-access-lpdk5\") pod \"keystone-7ef1-account-create-update-8zrpq\" (UID: \"a6eb6a92-c8e9-4dd4-9f92-55eb20dec5c0\") " pod="openstack-kuttl-tests/keystone-7ef1-account-create-update-8zrpq" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.004455 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a6eb6a92-c8e9-4dd4-9f92-55eb20dec5c0-operator-scripts\") pod \"keystone-7ef1-account-create-update-8zrpq\" (UID: \"a6eb6a92-c8e9-4dd4-9f92-55eb20dec5c0\") " pod="openstack-kuttl-tests/keystone-7ef1-account-create-update-8zrpq" Mar 16 16:00:18 crc kubenswrapper[5120]: E0316 16:00:18.004716 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Mar 16 16:00:18 crc kubenswrapper[5120]: E0316 16:00:18.004831 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a6eb6a92-c8e9-4dd4-9f92-55eb20dec5c0-operator-scripts podName:a6eb6a92-c8e9-4dd4-9f92-55eb20dec5c0 nodeName:}" failed. No retries permitted until 2026-03-16 16:00:19.004804777 +0000 UTC m=+1721.158736444 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/a6eb6a92-c8e9-4dd4-9f92-55eb20dec5c0-operator-scripts") pod "keystone-7ef1-account-create-update-8zrpq" (UID: "a6eb6a92-c8e9-4dd4-9f92-55eb20dec5c0") : configmap "openstack-scripts" not found Mar 16 16:00:18 crc kubenswrapper[5120]: E0316 16:00:18.008379 5120 projected.go:194] Error preparing data for projected volume kube-api-access-lpdk5 for pod openstack-kuttl-tests/keystone-7ef1-account-create-update-8zrpq: failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 16:00:18 crc kubenswrapper[5120]: E0316 16:00:18.008467 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a6eb6a92-c8e9-4dd4-9f92-55eb20dec5c0-kube-api-access-lpdk5 podName:a6eb6a92-c8e9-4dd4-9f92-55eb20dec5c0 nodeName:}" failed. No retries permitted until 2026-03-16 16:00:19.008447688 +0000 UTC m=+1721.162379345 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-lpdk5" (UniqueName: "kubernetes.io/projected/a6eb6a92-c8e9-4dd4-9f92-55eb20dec5c0-kube-api-access-lpdk5") pod "keystone-7ef1-account-create-update-8zrpq" (UID: "a6eb6a92-c8e9-4dd4-9f92-55eb20dec5c0") : failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.020909 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-bcc6c568d-dqmvk" podUID="ea0301d9-a692-4b65-ba34-5e989769d02c" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.1.14:9311/healthcheck\": read tcp 10.217.0.2:46266->10.217.1.14:9311: read: connection reset by peer" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.021192 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-bcc6c568d-dqmvk" podUID="ea0301d9-a692-4b65-ba34-5e989769d02c" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.1.14:9311/healthcheck\": read tcp 10.217.0.2:59626->10.217.1.14:9311: read: connection reset by peer" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.035350 5120 scope.go:117] "RemoveContainer" containerID="ede033cdbc5c460f1a243d87eb0104650bd70a244d11e81484ca2bd677c1f9f7" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.070460 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.105587 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/775fa932-80b8-4fd0-946e-09177e8710fb-scripts\") pod \"775fa932-80b8-4fd0-946e-09177e8710fb\" (UID: \"775fa932-80b8-4fd0-946e-09177e8710fb\") " Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.105670 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/775fa932-80b8-4fd0-946e-09177e8710fb-logs\") pod \"775fa932-80b8-4fd0-946e-09177e8710fb\" (UID: \"775fa932-80b8-4fd0-946e-09177e8710fb\") " Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.105781 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/775fa932-80b8-4fd0-946e-09177e8710fb-httpd-run\") pod \"775fa932-80b8-4fd0-946e-09177e8710fb\" (UID: \"775fa932-80b8-4fd0-946e-09177e8710fb\") " Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.105822 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/775fa932-80b8-4fd0-946e-09177e8710fb-config-data\") pod \"775fa932-80b8-4fd0-946e-09177e8710fb\" (UID: \"775fa932-80b8-4fd0-946e-09177e8710fb\") " Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.106401 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/775fa932-80b8-4fd0-946e-09177e8710fb-logs" (OuterVolumeSpecName: "logs") pod "775fa932-80b8-4fd0-946e-09177e8710fb" (UID: "775fa932-80b8-4fd0-946e-09177e8710fb"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.106583 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/775fa932-80b8-4fd0-946e-09177e8710fb-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "775fa932-80b8-4fd0-946e-09177e8710fb" (UID: "775fa932-80b8-4fd0-946e-09177e8710fb"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.106639 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/775fa932-80b8-4fd0-946e-09177e8710fb-internal-tls-certs\") pod \"775fa932-80b8-4fd0-946e-09177e8710fb\" (UID: \"775fa932-80b8-4fd0-946e-09177e8710fb\") " Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.106692 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v68bq\" (UniqueName: \"kubernetes.io/projected/775fa932-80b8-4fd0-946e-09177e8710fb-kube-api-access-v68bq\") pod \"775fa932-80b8-4fd0-946e-09177e8710fb\" (UID: \"775fa932-80b8-4fd0-946e-09177e8710fb\") " Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.106744 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"775fa932-80b8-4fd0-946e-09177e8710fb\" (UID: \"775fa932-80b8-4fd0-946e-09177e8710fb\") " Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.106786 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/775fa932-80b8-4fd0-946e-09177e8710fb-combined-ca-bundle\") pod \"775fa932-80b8-4fd0-946e-09177e8710fb\" (UID: \"775fa932-80b8-4fd0-946e-09177e8710fb\") " Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.107787 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/775fa932-80b8-4fd0-946e-09177e8710fb-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.107801 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/775fa932-80b8-4fd0-946e-09177e8710fb-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.110790 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/775fa932-80b8-4fd0-946e-09177e8710fb-kube-api-access-v68bq" (OuterVolumeSpecName: "kube-api-access-v68bq") pod "775fa932-80b8-4fd0-946e-09177e8710fb" (UID: "775fa932-80b8-4fd0-946e-09177e8710fb"). InnerVolumeSpecName "kube-api-access-v68bq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.111245 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/775fa932-80b8-4fd0-946e-09177e8710fb-scripts" (OuterVolumeSpecName: "scripts") pod "775fa932-80b8-4fd0-946e-09177e8710fb" (UID: "775fa932-80b8-4fd0-946e-09177e8710fb"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.127909 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage09-crc" (OuterVolumeSpecName: "glance") pod "775fa932-80b8-4fd0-946e-09177e8710fb" (UID: "775fa932-80b8-4fd0-946e-09177e8710fb"). InnerVolumeSpecName "local-storage09-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.132929 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.142037 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/775fa932-80b8-4fd0-946e-09177e8710fb-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "775fa932-80b8-4fd0-946e-09177e8710fb" (UID: "775fa932-80b8-4fd0-946e-09177e8710fb"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.182958 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/775fa932-80b8-4fd0-946e-09177e8710fb-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "775fa932-80b8-4fd0-946e-09177e8710fb" (UID: "775fa932-80b8-4fd0-946e-09177e8710fb"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.198893 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/775fa932-80b8-4fd0-946e-09177e8710fb-config-data" (OuterVolumeSpecName: "config-data") pod "775fa932-80b8-4fd0-946e-09177e8710fb" (UID: "775fa932-80b8-4fd0-946e-09177e8710fb"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.208020 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-85c489687d-pcp6w" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.208641 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe-internal-tls-certs\") pod \"1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe\" (UID: \"1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe\") " Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.208723 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe-public-tls-certs\") pod \"1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe\" (UID: \"1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe\") " Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.208795 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe-combined-ca-bundle\") pod \"1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe\" (UID: \"1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe\") " Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.208841 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe-config-data-custom\") pod \"1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe\" (UID: \"1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe\") " Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.208868 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe-logs\") pod \"1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe\" (UID: \"1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe\") " Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.210099 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-snzjg\" (UniqueName: \"kubernetes.io/projected/1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe-kube-api-access-snzjg\") pod \"1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe\" (UID: \"1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe\") " Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.210156 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe-etc-machine-id\") pod \"1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe\" (UID: \"1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe\") " Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.210417 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe-config-data\") pod \"1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe\" (UID: \"1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe\") " Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.210510 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe-scripts\") pod \"1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe\" (UID: \"1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe\") " Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.210983 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/775fa932-80b8-4fd0-946e-09177e8710fb-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.211002 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/775fa932-80b8-4fd0-946e-09177e8710fb-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.211013 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v68bq\" (UniqueName: \"kubernetes.io/projected/775fa932-80b8-4fd0-946e-09177e8710fb-kube-api-access-v68bq\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.211031 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") on node \"crc\" " Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.211040 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/775fa932-80b8-4fd0-946e-09177e8710fb-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.211049 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/775fa932-80b8-4fd0-946e-09177e8710fb-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.212683 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe" (UID: "1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.213513 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe-logs" (OuterVolumeSpecName: "logs") pod "1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe" (UID: "1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.219072 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe-kube-api-access-snzjg" (OuterVolumeSpecName: "kube-api-access-snzjg") pod "1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe" (UID: "1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe"). InnerVolumeSpecName "kube-api-access-snzjg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.245826 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-64b5fbbbdb-nrl4p" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.257468 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe-scripts" (OuterVolumeSpecName: "scripts") pod "1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe" (UID: "1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.269016 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe" (UID: "1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.271556 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage09-crc" (UniqueName: "kubernetes.io/local-volume/local-storage09-crc") on node "crc" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.287142 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe" (UID: "1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.287236 5120 generic.go:358] "Generic (PLEG): container finished" podID="c3689d41-4ea9-4076-9b69-4a93be5896cf" containerID="73eca197695f5d5d863dcbcf7fb679830074e97a2e5cb045f9230766c397bd55" exitCode=0 Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.287265 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-64b5fbbbdb-nrl4p" event={"ID":"c3689d41-4ea9-4076-9b69-4a93be5896cf","Type":"ContainerDied","Data":"73eca197695f5d5d863dcbcf7fb679830074e97a2e5cb045f9230766c397bd55"} Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.290157 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-64b5fbbbdb-nrl4p" event={"ID":"c3689d41-4ea9-4076-9b69-4a93be5896cf","Type":"ContainerDied","Data":"25166dc2cbc5426c6c653fd6146d65a74a6c27e77ea988c6eb294c1616747920"} Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.290251 5120 scope.go:117] "RemoveContainer" containerID="73eca197695f5d5d863dcbcf7fb679830074e97a2e5cb045f9230766c397bd55" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.287342 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-64b5fbbbdb-nrl4p" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.297783 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe" (UID: "1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.297802 5120 generic.go:358] "Generic (PLEG): container finished" podID="a0983bdb-df60-4951-aa31-672444ba7c32" containerID="36112e54f7c3727e2e552937fcf3b649d839e6ece9f9a4e4e6b969952dbdd56b" exitCode=0 Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.297928 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"a0983bdb-df60-4951-aa31-672444ba7c32","Type":"ContainerDied","Data":"36112e54f7c3727e2e552937fcf3b649d839e6ece9f9a4e4e6b969952dbdd56b"} Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.300353 5120 generic.go:358] "Generic (PLEG): container finished" podID="1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe" containerID="de6448102abdb4a197aec79c6edbcf87239ec4fa8fcb0c35a90a2e25c9d9d138" exitCode=0 Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.300492 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe","Type":"ContainerDied","Data":"de6448102abdb4a197aec79c6edbcf87239ec4fa8fcb0c35a90a2e25c9d9d138"} Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.300519 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe","Type":"ContainerDied","Data":"fe906071d1202f4aa14cd2d7278bdcf1f183df9a4cfcdbd74158bd682176c42f"} Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.300594 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.302580 5120 generic.go:358] "Generic (PLEG): container finished" podID="775fa932-80b8-4fd0-946e-09177e8710fb" containerID="0feb858da0d000831a0f51e693005f06d2aba3f94d24c4b4c297b5568998a809" exitCode=0 Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.302645 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"775fa932-80b8-4fd0-946e-09177e8710fb","Type":"ContainerDied","Data":"0feb858da0d000831a0f51e693005f06d2aba3f94d24c4b4c297b5568998a809"} Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.302662 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"775fa932-80b8-4fd0-946e-09177e8710fb","Type":"ContainerDied","Data":"fbc34890657c148f2dab578b2ab7f33a20a315ecf3e8e61be083dc057920287b"} Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.303328 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.304478 5120 generic.go:358] "Generic (PLEG): container finished" podID="b97c2a0c-dcad-4453-8063-d1bbcb265531" containerID="7a661bc910ce2d776a4e9f81005f8af24f1929db2c6f86edd9380bc21d372086" exitCode=0 Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.304726 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"b97c2a0c-dcad-4453-8063-d1bbcb265531","Type":"ContainerDied","Data":"7a661bc910ce2d776a4e9f81005f8af24f1929db2c6f86edd9380bc21d372086"} Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.306370 5120 generic.go:358] "Generic (PLEG): container finished" podID="b3794e20-01dd-453a-bf29-20813144c61b" containerID="755cfaa0ce8ac81606545022847fbe8cfb9de5f7c904952f36310b83f8c76f03" exitCode=0 Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.306432 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-85c489687d-pcp6w" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.306498 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-85c489687d-pcp6w" event={"ID":"b3794e20-01dd-453a-bf29-20813144c61b","Type":"ContainerDied","Data":"755cfaa0ce8ac81606545022847fbe8cfb9de5f7c904952f36310b83f8c76f03"} Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.306526 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-85c489687d-pcp6w" event={"ID":"b3794e20-01dd-453a-bf29-20813144c61b","Type":"ContainerDied","Data":"d0ffe74e15846dc8019dc25951b10463d14ad4f2086dee46d2e7c1967b648ba0"} Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.308317 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-59f58b5b58-tw7qc" event={"ID":"2e562dac-a1db-446c-b73a-21df22608a50","Type":"ContainerDied","Data":"41363c1c22b60fc059e8bc1b3de91f36279531426cf906c324276584e2adb3ec"} Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.308434 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-59f58b5b58-tw7qc" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.313230 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c3689d41-4ea9-4076-9b69-4a93be5896cf-scripts\") pod \"c3689d41-4ea9-4076-9b69-4a93be5896cf\" (UID: \"c3689d41-4ea9-4076-9b69-4a93be5896cf\") " Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.313309 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cm2qn\" (UniqueName: \"kubernetes.io/projected/b3794e20-01dd-453a-bf29-20813144c61b-kube-api-access-cm2qn\") pod \"b3794e20-01dd-453a-bf29-20813144c61b\" (UID: \"b3794e20-01dd-453a-bf29-20813144c61b\") " Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.313338 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b3794e20-01dd-453a-bf29-20813144c61b-logs\") pod \"b3794e20-01dd-453a-bf29-20813144c61b\" (UID: \"b3794e20-01dd-453a-bf29-20813144c61b\") " Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.313360 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b3794e20-01dd-453a-bf29-20813144c61b-combined-ca-bundle\") pod \"b3794e20-01dd-453a-bf29-20813144c61b\" (UID: \"b3794e20-01dd-453a-bf29-20813144c61b\") " Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.313417 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/b3794e20-01dd-453a-bf29-20813144c61b-config-data-custom\") pod \"b3794e20-01dd-453a-bf29-20813144c61b\" (UID: \"b3794e20-01dd-453a-bf29-20813144c61b\") " Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.313480 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/c3689d41-4ea9-4076-9b69-4a93be5896cf-public-tls-certs\") pod \"c3689d41-4ea9-4076-9b69-4a93be5896cf\" (UID: \"c3689d41-4ea9-4076-9b69-4a93be5896cf\") " Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.313533 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c3689d41-4ea9-4076-9b69-4a93be5896cf-combined-ca-bundle\") pod \"c3689d41-4ea9-4076-9b69-4a93be5896cf\" (UID: \"c3689d41-4ea9-4076-9b69-4a93be5896cf\") " Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.313557 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c3689d41-4ea9-4076-9b69-4a93be5896cf-config-data\") pod \"c3689d41-4ea9-4076-9b69-4a93be5896cf\" (UID: \"c3689d41-4ea9-4076-9b69-4a93be5896cf\") " Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.313691 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c3689d41-4ea9-4076-9b69-4a93be5896cf-logs\") pod \"c3689d41-4ea9-4076-9b69-4a93be5896cf\" (UID: \"c3689d41-4ea9-4076-9b69-4a93be5896cf\") " Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.313711 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/c3689d41-4ea9-4076-9b69-4a93be5896cf-internal-tls-certs\") pod \"c3689d41-4ea9-4076-9b69-4a93be5896cf\" (UID: \"c3689d41-4ea9-4076-9b69-4a93be5896cf\") " Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.313784 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b3794e20-01dd-453a-bf29-20813144c61b-config-data\") pod \"b3794e20-01dd-453a-bf29-20813144c61b\" (UID: \"b3794e20-01dd-453a-bf29-20813144c61b\") " Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.313800 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c8nlw\" (UniqueName: \"kubernetes.io/projected/c3689d41-4ea9-4076-9b69-4a93be5896cf-kube-api-access-c8nlw\") pod \"c3689d41-4ea9-4076-9b69-4a93be5896cf\" (UID: \"c3689d41-4ea9-4076-9b69-4a93be5896cf\") " Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.314243 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.314259 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.314268 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.314277 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.314286 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.314294 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.314304 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-snzjg\" (UniqueName: \"kubernetes.io/projected/1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe-kube-api-access-snzjg\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.314313 5120 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.316109 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3689d41-4ea9-4076-9b69-4a93be5896cf-logs" (OuterVolumeSpecName: "logs") pod "c3689d41-4ea9-4076-9b69-4a93be5896cf" (UID: "c3689d41-4ea9-4076-9b69-4a93be5896cf"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.318746 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3794e20-01dd-453a-bf29-20813144c61b-logs" (OuterVolumeSpecName: "logs") pod "b3794e20-01dd-453a-bf29-20813144c61b" (UID: "b3794e20-01dd-453a-bf29-20813144c61b"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.324558 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c3689d41-4ea9-4076-9b69-4a93be5896cf-scripts" (OuterVolumeSpecName: "scripts") pod "c3689d41-4ea9-4076-9b69-4a93be5896cf" (UID: "c3689d41-4ea9-4076-9b69-4a93be5896cf"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.326384 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3689d41-4ea9-4076-9b69-4a93be5896cf-kube-api-access-c8nlw" (OuterVolumeSpecName: "kube-api-access-c8nlw") pod "c3689d41-4ea9-4076-9b69-4a93be5896cf" (UID: "c3689d41-4ea9-4076-9b69-4a93be5896cf"). InnerVolumeSpecName "kube-api-access-c8nlw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.335307 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"188dbfe0-6d71-4ba4-a3b7-6ee900a60138","Type":"ContainerDied","Data":"5cb5336eec2bc9d72af934b6fd40e9184ab80151a298a3a10de1976e1f86500b"} Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.335164 5120 generic.go:358] "Generic (PLEG): container finished" podID="188dbfe0-6d71-4ba4-a3b7-6ee900a60138" containerID="5cb5336eec2bc9d72af934b6fd40e9184ab80151a298a3a10de1976e1f86500b" exitCode=0 Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.340065 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.355399 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe" (UID: "1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.359008 5120 generic.go:358] "Generic (PLEG): container finished" podID="ea0301d9-a692-4b65-ba34-5e989769d02c" containerID="8b21d045c26ecdd9743611e46a46a194f9882c136e56843ba91195604f46f37b" exitCode=0 Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.359088 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-bcc6c568d-dqmvk" event={"ID":"ea0301d9-a692-4b65-ba34-5e989769d02c","Type":"ContainerDied","Data":"8b21d045c26ecdd9743611e46a46a194f9882c136e56843ba91195604f46f37b"} Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.370488 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.376540 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-mm5p4" event={"ID":"ca816558-dccc-44fa-aaa6-5a2070f1b25f","Type":"ContainerStarted","Data":"b23e5249a31a3ba32a12e44b4cd5caabdbb3812e1a2bf4be34ad41cc2e244972"} Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.376599 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-mm5p4" event={"ID":"ca816558-dccc-44fa-aaa6-5a2070f1b25f","Type":"ContainerStarted","Data":"b75ee74f26d951dd4463aa274862a0263a364a3cabe1f3f395216fcd553bad08"} Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.382327 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.384728 5120 generic.go:358] "Generic (PLEG): container finished" podID="c568edd3-501f-4254-ae95-67946f898cd3" containerID="43900ca08144bf1b772b28160272d2ed488bb604fc3fbc4d53917a0d50806010" exitCode=0 Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.384885 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-54b7655659-bqszk" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.386088 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe-config-data" (OuterVolumeSpecName: "config-data") pod "1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe" (UID: "1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.386217 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"c568edd3-501f-4254-ae95-67946f898cd3","Type":"ContainerDied","Data":"43900ca08144bf1b772b28160272d2ed488bb604fc3fbc4d53917a0d50806010"} Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.386323 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-ef54-account-create-update-b2vpk" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.387248 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3794e20-01dd-453a-bf29-20813144c61b-kube-api-access-cm2qn" (OuterVolumeSpecName: "kube-api-access-cm2qn") pod "b3794e20-01dd-453a-bf29-20813144c61b" (UID: "b3794e20-01dd-453a-bf29-20813144c61b"). InnerVolumeSpecName "kube-api-access-cm2qn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.387452 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b3794e20-01dd-453a-bf29-20813144c61b-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "b3794e20-01dd-453a-bf29-20813144c61b" (UID: "b3794e20-01dd-453a-bf29-20813144c61b"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.387625 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-7ef1-account-create-update-8zrpq" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.389352 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-proxy-59f58b5b58-tw7qc"] Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.394436 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c3689d41-4ea9-4076-9b69-4a93be5896cf-config-data" (OuterVolumeSpecName: "config-data") pod "c3689d41-4ea9-4076-9b69-4a93be5896cf" (UID: "c3689d41-4ea9-4076-9b69-4a93be5896cf"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.395079 5120 scope.go:117] "RemoveContainer" containerID="ca1f5aaefb58de6d5c99abbb89a2f202aeabc9a7e3667dddb49bfe9cacae3d70" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.402367 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/swift-proxy-59f58b5b58-tw7qc"] Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.404261 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-7ef1-account-create-update-8zrpq" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.416185 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.416209 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c3689d41-4ea9-4076-9b69-4a93be5896cf-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.416219 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c8nlw\" (UniqueName: \"kubernetes.io/projected/c3689d41-4ea9-4076-9b69-4a93be5896cf-kube-api-access-c8nlw\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.416229 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c3689d41-4ea9-4076-9b69-4a93be5896cf-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.416237 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cm2qn\" (UniqueName: \"kubernetes.io/projected/b3794e20-01dd-453a-bf29-20813144c61b-kube-api-access-cm2qn\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.416245 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b3794e20-01dd-453a-bf29-20813144c61b-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.416254 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/b3794e20-01dd-453a-bf29-20813144c61b-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.416263 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.416273 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c3689d41-4ea9-4076-9b69-4a93be5896cf-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.420535 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.421881 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.450123 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.479378 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.490927 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.502962 5120 scope.go:117] "RemoveContainer" containerID="73eca197695f5d5d863dcbcf7fb679830074e97a2e5cb045f9230766c397bd55" Mar 16 16:00:18 crc kubenswrapper[5120]: E0316 16:00:18.503535 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"73eca197695f5d5d863dcbcf7fb679830074e97a2e5cb045f9230766c397bd55\": container with ID starting with 73eca197695f5d5d863dcbcf7fb679830074e97a2e5cb045f9230766c397bd55 not found: ID does not exist" containerID="73eca197695f5d5d863dcbcf7fb679830074e97a2e5cb045f9230766c397bd55" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.503563 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73eca197695f5d5d863dcbcf7fb679830074e97a2e5cb045f9230766c397bd55"} err="failed to get container status \"73eca197695f5d5d863dcbcf7fb679830074e97a2e5cb045f9230766c397bd55\": rpc error: code = NotFound desc = could not find container \"73eca197695f5d5d863dcbcf7fb679830074e97a2e5cb045f9230766c397bd55\": container with ID starting with 73eca197695f5d5d863dcbcf7fb679830074e97a2e5cb045f9230766c397bd55 not found: ID does not exist" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.503582 5120 scope.go:117] "RemoveContainer" containerID="ca1f5aaefb58de6d5c99abbb89a2f202aeabc9a7e3667dddb49bfe9cacae3d70" Mar 16 16:00:18 crc kubenswrapper[5120]: E0316 16:00:18.504989 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca1f5aaefb58de6d5c99abbb89a2f202aeabc9a7e3667dddb49bfe9cacae3d70\": container with ID starting with ca1f5aaefb58de6d5c99abbb89a2f202aeabc9a7e3667dddb49bfe9cacae3d70 not found: ID does not exist" containerID="ca1f5aaefb58de6d5c99abbb89a2f202aeabc9a7e3667dddb49bfe9cacae3d70" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.505017 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca1f5aaefb58de6d5c99abbb89a2f202aeabc9a7e3667dddb49bfe9cacae3d70"} err="failed to get container status \"ca1f5aaefb58de6d5c99abbb89a2f202aeabc9a7e3667dddb49bfe9cacae3d70\": rpc error: code = NotFound desc = could not find container \"ca1f5aaefb58de6d5c99abbb89a2f202aeabc9a7e3667dddb49bfe9cacae3d70\": container with ID starting with ca1f5aaefb58de6d5c99abbb89a2f202aeabc9a7e3667dddb49bfe9cacae3d70 not found: ID does not exist" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.505031 5120 scope.go:117] "RemoveContainer" containerID="de6448102abdb4a197aec79c6edbcf87239ec4fa8fcb0c35a90a2e25c9d9d138" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.526308 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b3794e20-01dd-453a-bf29-20813144c61b-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "b3794e20-01dd-453a-bf29-20813144c61b" (UID: "b3794e20-01dd-453a-bf29-20813144c61b"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.527278 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a0983bdb-df60-4951-aa31-672444ba7c32-scripts\") pod \"a0983bdb-df60-4951-aa31-672444ba7c32\" (UID: \"a0983bdb-df60-4951-aa31-672444ba7c32\") " Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.527311 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/c568edd3-501f-4254-ae95-67946f898cd3-nova-metadata-tls-certs\") pod \"c568edd3-501f-4254-ae95-67946f898cd3\" (UID: \"c568edd3-501f-4254-ae95-67946f898cd3\") " Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.527350 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a0983bdb-df60-4951-aa31-672444ba7c32-combined-ca-bundle\") pod \"a0983bdb-df60-4951-aa31-672444ba7c32\" (UID: \"a0983bdb-df60-4951-aa31-672444ba7c32\") " Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.527369 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a0983bdb-df60-4951-aa31-672444ba7c32-config-data\") pod \"a0983bdb-df60-4951-aa31-672444ba7c32\" (UID: \"a0983bdb-df60-4951-aa31-672444ba7c32\") " Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.527399 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a0983bdb-df60-4951-aa31-672444ba7c32-logs\") pod \"a0983bdb-df60-4951-aa31-672444ba7c32\" (UID: \"a0983bdb-df60-4951-aa31-672444ba7c32\") " Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.527525 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/188dbfe0-6d71-4ba4-a3b7-6ee900a60138-public-tls-certs\") pod \"188dbfe0-6d71-4ba4-a3b7-6ee900a60138\" (UID: \"188dbfe0-6d71-4ba4-a3b7-6ee900a60138\") " Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.527560 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/188dbfe0-6d71-4ba4-a3b7-6ee900a60138-combined-ca-bundle\") pod \"188dbfe0-6d71-4ba4-a3b7-6ee900a60138\" (UID: \"188dbfe0-6d71-4ba4-a3b7-6ee900a60138\") " Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.527700 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c568edd3-501f-4254-ae95-67946f898cd3-combined-ca-bundle\") pod \"c568edd3-501f-4254-ae95-67946f898cd3\" (UID: \"c568edd3-501f-4254-ae95-67946f898cd3\") " Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.527878 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cdkrv\" (UniqueName: \"kubernetes.io/projected/188dbfe0-6d71-4ba4-a3b7-6ee900a60138-kube-api-access-cdkrv\") pod \"188dbfe0-6d71-4ba4-a3b7-6ee900a60138\" (UID: \"188dbfe0-6d71-4ba4-a3b7-6ee900a60138\") " Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.527926 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c568edd3-501f-4254-ae95-67946f898cd3-config-data\") pod \"c568edd3-501f-4254-ae95-67946f898cd3\" (UID: \"c568edd3-501f-4254-ae95-67946f898cd3\") " Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.527999 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"a0983bdb-df60-4951-aa31-672444ba7c32\" (UID: \"a0983bdb-df60-4951-aa31-672444ba7c32\") " Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.528025 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/188dbfe0-6d71-4ba4-a3b7-6ee900a60138-logs\") pod \"188dbfe0-6d71-4ba4-a3b7-6ee900a60138\" (UID: \"188dbfe0-6d71-4ba4-a3b7-6ee900a60138\") " Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.528055 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v8b2r\" (UniqueName: \"kubernetes.io/projected/c568edd3-501f-4254-ae95-67946f898cd3-kube-api-access-v8b2r\") pod \"c568edd3-501f-4254-ae95-67946f898cd3\" (UID: \"c568edd3-501f-4254-ae95-67946f898cd3\") " Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.528136 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qspwm\" (UniqueName: \"kubernetes.io/projected/a0983bdb-df60-4951-aa31-672444ba7c32-kube-api-access-qspwm\") pod \"a0983bdb-df60-4951-aa31-672444ba7c32\" (UID: \"a0983bdb-df60-4951-aa31-672444ba7c32\") " Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.528181 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/188dbfe0-6d71-4ba4-a3b7-6ee900a60138-internal-tls-certs\") pod \"188dbfe0-6d71-4ba4-a3b7-6ee900a60138\" (UID: \"188dbfe0-6d71-4ba4-a3b7-6ee900a60138\") " Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.528259 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/a0983bdb-df60-4951-aa31-672444ba7c32-public-tls-certs\") pod \"a0983bdb-df60-4951-aa31-672444ba7c32\" (UID: \"a0983bdb-df60-4951-aa31-672444ba7c32\") " Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.528355 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c568edd3-501f-4254-ae95-67946f898cd3-logs\") pod \"c568edd3-501f-4254-ae95-67946f898cd3\" (UID: \"c568edd3-501f-4254-ae95-67946f898cd3\") " Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.528382 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/a0983bdb-df60-4951-aa31-672444ba7c32-httpd-run\") pod \"a0983bdb-df60-4951-aa31-672444ba7c32\" (UID: \"a0983bdb-df60-4951-aa31-672444ba7c32\") " Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.528433 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/188dbfe0-6d71-4ba4-a3b7-6ee900a60138-config-data\") pod \"188dbfe0-6d71-4ba4-a3b7-6ee900a60138\" (UID: \"188dbfe0-6d71-4ba4-a3b7-6ee900a60138\") " Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.531309 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b3794e20-01dd-453a-bf29-20813144c61b-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.553248 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0983bdb-df60-4951-aa31-672444ba7c32-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "a0983bdb-df60-4951-aa31-672444ba7c32" (UID: "a0983bdb-df60-4951-aa31-672444ba7c32"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.553716 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-54b7655659-bqszk"] Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.553600 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0983bdb-df60-4951-aa31-672444ba7c32-logs" (OuterVolumeSpecName: "logs") pod "a0983bdb-df60-4951-aa31-672444ba7c32" (UID: "a0983bdb-df60-4951-aa31-672444ba7c32"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.553900 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c568edd3-501f-4254-ae95-67946f898cd3-logs" (OuterVolumeSpecName: "logs") pod "c568edd3-501f-4254-ae95-67946f898cd3" (UID: "c568edd3-501f-4254-ae95-67946f898cd3"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.554691 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/188dbfe0-6d71-4ba4-a3b7-6ee900a60138-logs" (OuterVolumeSpecName: "logs") pod "188dbfe0-6d71-4ba4-a3b7-6ee900a60138" (UID: "188dbfe0-6d71-4ba4-a3b7-6ee900a60138"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.560299 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a0983bdb-df60-4951-aa31-672444ba7c32-scripts" (OuterVolumeSpecName: "scripts") pod "a0983bdb-df60-4951-aa31-672444ba7c32" (UID: "a0983bdb-df60-4951-aa31-672444ba7c32"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.560952 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/188dbfe0-6d71-4ba4-a3b7-6ee900a60138-kube-api-access-cdkrv" (OuterVolumeSpecName: "kube-api-access-cdkrv") pod "188dbfe0-6d71-4ba4-a3b7-6ee900a60138" (UID: "188dbfe0-6d71-4ba4-a3b7-6ee900a60138"). InnerVolumeSpecName "kube-api-access-cdkrv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.563211 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage13-crc" (OuterVolumeSpecName: "glance") pod "a0983bdb-df60-4951-aa31-672444ba7c32" (UID: "a0983bdb-df60-4951-aa31-672444ba7c32"). InnerVolumeSpecName "local-storage13-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.563969 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b3794e20-01dd-453a-bf29-20813144c61b-config-data" (OuterVolumeSpecName: "config-data") pod "b3794e20-01dd-453a-bf29-20813144c61b" (UID: "b3794e20-01dd-453a-bf29-20813144c61b"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.566014 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-worker-54b7655659-bqszk"] Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.566087 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0983bdb-df60-4951-aa31-672444ba7c32-kube-api-access-qspwm" (OuterVolumeSpecName: "kube-api-access-qspwm") pod "a0983bdb-df60-4951-aa31-672444ba7c32" (UID: "a0983bdb-df60-4951-aa31-672444ba7c32"). InnerVolumeSpecName "kube-api-access-qspwm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.566193 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c568edd3-501f-4254-ae95-67946f898cd3-kube-api-access-v8b2r" (OuterVolumeSpecName: "kube-api-access-v8b2r") pod "c568edd3-501f-4254-ae95-67946f898cd3" (UID: "c568edd3-501f-4254-ae95-67946f898cd3"). InnerVolumeSpecName "kube-api-access-v8b2r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.594296 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c3689d41-4ea9-4076-9b69-4a93be5896cf-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "c3689d41-4ea9-4076-9b69-4a93be5896cf" (UID: "c3689d41-4ea9-4076-9b69-4a93be5896cf"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:00:18 crc kubenswrapper[5120]: E0316 16:00:18.601084 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="73fdaa6f98a1d0cecc065049ce5388e3add5f04f37ed5696274bbf8df19e57a5" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Mar 16 16:00:18 crc kubenswrapper[5120]: E0316 16:00:18.604012 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="73fdaa6f98a1d0cecc065049ce5388e3add5f04f37ed5696274bbf8df19e57a5" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Mar 16 16:00:18 crc kubenswrapper[5120]: E0316 16:00:18.608527 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="73fdaa6f98a1d0cecc065049ce5388e3add5f04f37ed5696274bbf8df19e57a5" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Mar 16 16:00:18 crc kubenswrapper[5120]: E0316 16:00:18.608600 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/ovn-northd-0" podUID="3a1fe07d-3cc8-4eea-8e8b-eb2807caa357" containerName="ovn-northd" probeResult="unknown" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.618881 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-ef54-account-create-update-b2vpk"] Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.622563 5120 scope.go:117] "RemoveContainer" containerID="d49fef7d81b2a23590eafc60fbe8293499b7ef16f3b6a651af145ba5b739fddb" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.632984 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cdkrv\" (UniqueName: \"kubernetes.io/projected/188dbfe0-6d71-4ba4-a3b7-6ee900a60138-kube-api-access-cdkrv\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.633034 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") on node \"crc\" " Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.633044 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/188dbfe0-6d71-4ba4-a3b7-6ee900a60138-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.633053 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v8b2r\" (UniqueName: \"kubernetes.io/projected/c568edd3-501f-4254-ae95-67946f898cd3-kube-api-access-v8b2r\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.633062 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c3689d41-4ea9-4076-9b69-4a93be5896cf-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.633069 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qspwm\" (UniqueName: \"kubernetes.io/projected/a0983bdb-df60-4951-aa31-672444ba7c32-kube-api-access-qspwm\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.633078 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c568edd3-501f-4254-ae95-67946f898cd3-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.633086 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/a0983bdb-df60-4951-aa31-672444ba7c32-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.633093 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a0983bdb-df60-4951-aa31-672444ba7c32-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.633100 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a0983bdb-df60-4951-aa31-672444ba7c32-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.633108 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b3794e20-01dd-453a-bf29-20813144c61b-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.633459 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-ef54-account-create-update-b2vpk"] Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.675899 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="08f284b7-104e-4395-b9cc-7c8acf4b943e" path="/var/lib/kubelet/pods/08f284b7-104e-4395-b9cc-7c8acf4b943e/volumes" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.676505 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="14fb94bd-5ac0-4ea1-98bf-1980cebf6e4d" path="/var/lib/kubelet/pods/14fb94bd-5ac0-4ea1-98bf-1980cebf6e4d/volumes" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.677117 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="169cc9e8-ed2f-47c8-b98a-0143f4c480d7" path="/var/lib/kubelet/pods/169cc9e8-ed2f-47c8-b98a-0143f4c480d7/volumes" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.677498 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e562dac-a1db-446c-b73a-21df22608a50" path="/var/lib/kubelet/pods/2e562dac-a1db-446c-b73a-21df22608a50/volumes" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.678590 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="48b9c79e-2a39-4fa1-9143-e4175c7b45b2" path="/var/lib/kubelet/pods/48b9c79e-2a39-4fa1-9143-e4175c7b45b2/volumes" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.679132 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5f40aae9-22bd-4ef7-b5ac-a68a1f729482" path="/var/lib/kubelet/pods/5f40aae9-22bd-4ef7-b5ac-a68a1f729482/volumes" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.692375 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="775fa932-80b8-4fd0-946e-09177e8710fb" path="/var/lib/kubelet/pods/775fa932-80b8-4fd0-946e-09177e8710fb/volumes" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.714802 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7e2bc91b-26c0-4506-8629-832872fb453f" path="/var/lib/kubelet/pods/7e2bc91b-26c0-4506-8629-832872fb453f/volumes" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.729175 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c568edd3-501f-4254-ae95-67946f898cd3-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "c568edd3-501f-4254-ae95-67946f898cd3" (UID: "c568edd3-501f-4254-ae95-67946f898cd3"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.735656 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b7049577-d3a2-4125-b841-70c5f6e1da23" path="/var/lib/kubelet/pods/b7049577-d3a2-4125-b841-70c5f6e1da23/volumes" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.736841 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c568edd3-501f-4254-ae95-67946f898cd3-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.740958 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/188dbfe0-6d71-4ba4-a3b7-6ee900a60138-config-data" (OuterVolumeSpecName: "config-data") pod "188dbfe0-6d71-4ba4-a3b7-6ee900a60138" (UID: "188dbfe0-6d71-4ba4-a3b7-6ee900a60138"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.742188 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a0983bdb-df60-4951-aa31-672444ba7c32-config-data" (OuterVolumeSpecName: "config-data") pod "a0983bdb-df60-4951-aa31-672444ba7c32" (UID: "a0983bdb-df60-4951-aa31-672444ba7c32"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.742283 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c3689d41-4ea9-4076-9b69-4a93be5896cf-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "c3689d41-4ea9-4076-9b69-4a93be5896cf" (UID: "c3689d41-4ea9-4076-9b69-4a93be5896cf"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.753931 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage13-crc" (UniqueName: "kubernetes.io/local-volume/local-storage13-crc") on node "crc" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.756383 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bcdd2411-5651-46f4-ad3f-6281c4e2b780" path="/var/lib/kubelet/pods/bcdd2411-5651-46f4-ad3f-6281c4e2b780/volumes" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.769288 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bd599640-4bc1-46b5-9cbb-9b57e959c4e9" path="/var/lib/kubelet/pods/bd599640-4bc1-46b5-9cbb-9b57e959c4e9/volumes" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.769805 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec4c23f3-0b66-4795-8926-2aa0414de1ad" path="/var/lib/kubelet/pods/ec4c23f3-0b66-4795-8926-2aa0414de1ad/volumes" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.773918 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ecfb18c4-5cb2-4ab6-8445-79c3eec250d8" path="/var/lib/kubelet/pods/ecfb18c4-5cb2-4ab6-8445-79c3eec250d8/volumes" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.774436 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc59410f-18f6-4de8-b0f9-d54fcaea8faf" path="/var/lib/kubelet/pods/fc59410f-18f6-4de8-b0f9-d54fcaea8faf/volumes" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.774964 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fdfe4db3-e823-45f2-85d8-4adc47ff19f9" path="/var/lib/kubelet/pods/fdfe4db3-e823-45f2-85d8-4adc47ff19f9/volumes" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.781048 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c568edd3-501f-4254-ae95-67946f898cd3-config-data" (OuterVolumeSpecName: "config-data") pod "c568edd3-501f-4254-ae95-67946f898cd3" (UID: "c568edd3-501f-4254-ae95-67946f898cd3"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.783750 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a0983bdb-df60-4951-aa31-672444ba7c32-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "a0983bdb-df60-4951-aa31-672444ba7c32" (UID: "a0983bdb-df60-4951-aa31-672444ba7c32"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.784068 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/188dbfe0-6d71-4ba4-a3b7-6ee900a60138-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "188dbfe0-6d71-4ba4-a3b7-6ee900a60138" (UID: "188dbfe0-6d71-4ba4-a3b7-6ee900a60138"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.795288 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/188dbfe0-6d71-4ba4-a3b7-6ee900a60138-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "188dbfe0-6d71-4ba4-a3b7-6ee900a60138" (UID: "188dbfe0-6d71-4ba4-a3b7-6ee900a60138"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.795585 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/188dbfe0-6d71-4ba4-a3b7-6ee900a60138-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "188dbfe0-6d71-4ba4-a3b7-6ee900a60138" (UID: "188dbfe0-6d71-4ba4-a3b7-6ee900a60138"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.798288 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a0983bdb-df60-4951-aa31-672444ba7c32-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "a0983bdb-df60-4951-aa31-672444ba7c32" (UID: "a0983bdb-df60-4951-aa31-672444ba7c32"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.802568 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c3689d41-4ea9-4076-9b69-4a93be5896cf-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "c3689d41-4ea9-4076-9b69-4a93be5896cf" (UID: "c3689d41-4ea9-4076-9b69-4a93be5896cf"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.816552 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c568edd3-501f-4254-ae95-67946f898cd3-nova-metadata-tls-certs" (OuterVolumeSpecName: "nova-metadata-tls-certs") pod "c568edd3-501f-4254-ae95-67946f898cd3" (UID: "c568edd3-501f-4254-ae95-67946f898cd3"). InnerVolumeSpecName "nova-metadata-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.838593 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c568edd3-501f-4254-ae95-67946f898cd3-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.838629 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.838641 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/c3689d41-4ea9-4076-9b69-4a93be5896cf-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.838654 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/188dbfe0-6d71-4ba4-a3b7-6ee900a60138-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.838665 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/a0983bdb-df60-4951-aa31-672444ba7c32-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.838675 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/188dbfe0-6d71-4ba4-a3b7-6ee900a60138-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.838687 5120 reconciler_common.go:299] "Volume detached for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/c568edd3-501f-4254-ae95-67946f898cd3-nova-metadata-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.838698 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a0983bdb-df60-4951-aa31-672444ba7c32-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.838708 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/c3689d41-4ea9-4076-9b69-4a93be5896cf-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.838719 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a0983bdb-df60-4951-aa31-672444ba7c32-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.838729 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/188dbfe0-6d71-4ba4-a3b7-6ee900a60138-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.838740 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/188dbfe0-6d71-4ba4-a3b7-6ee900a60138-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.892718 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.892963 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.893063 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-85c489687d-pcp6w"] Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.893206 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-85c489687d-pcp6w"] Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.899286 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-bcc6c568d-dqmvk" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.902297 5120 scope.go:117] "RemoveContainer" containerID="de6448102abdb4a197aec79c6edbcf87239ec4fa8fcb0c35a90a2e25c9d9d138" Mar 16 16:00:18 crc kubenswrapper[5120]: E0316 16:00:18.902816 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de6448102abdb4a197aec79c6edbcf87239ec4fa8fcb0c35a90a2e25c9d9d138\": container with ID starting with de6448102abdb4a197aec79c6edbcf87239ec4fa8fcb0c35a90a2e25c9d9d138 not found: ID does not exist" containerID="de6448102abdb4a197aec79c6edbcf87239ec4fa8fcb0c35a90a2e25c9d9d138" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.902959 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de6448102abdb4a197aec79c6edbcf87239ec4fa8fcb0c35a90a2e25c9d9d138"} err="failed to get container status \"de6448102abdb4a197aec79c6edbcf87239ec4fa8fcb0c35a90a2e25c9d9d138\": rpc error: code = NotFound desc = could not find container \"de6448102abdb4a197aec79c6edbcf87239ec4fa8fcb0c35a90a2e25c9d9d138\": container with ID starting with de6448102abdb4a197aec79c6edbcf87239ec4fa8fcb0c35a90a2e25c9d9d138 not found: ID does not exist" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.903078 5120 scope.go:117] "RemoveContainer" containerID="d49fef7d81b2a23590eafc60fbe8293499b7ef16f3b6a651af145ba5b739fddb" Mar 16 16:00:18 crc kubenswrapper[5120]: E0316 16:00:18.903598 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d49fef7d81b2a23590eafc60fbe8293499b7ef16f3b6a651af145ba5b739fddb\": container with ID starting with d49fef7d81b2a23590eafc60fbe8293499b7ef16f3b6a651af145ba5b739fddb not found: ID does not exist" containerID="d49fef7d81b2a23590eafc60fbe8293499b7ef16f3b6a651af145ba5b739fddb" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.903633 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d49fef7d81b2a23590eafc60fbe8293499b7ef16f3b6a651af145ba5b739fddb"} err="failed to get container status \"d49fef7d81b2a23590eafc60fbe8293499b7ef16f3b6a651af145ba5b739fddb\": rpc error: code = NotFound desc = could not find container \"d49fef7d81b2a23590eafc60fbe8293499b7ef16f3b6a651af145ba5b739fddb\": container with ID starting with d49fef7d81b2a23590eafc60fbe8293499b7ef16f3b6a651af145ba5b739fddb not found: ID does not exist" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.903660 5120 scope.go:117] "RemoveContainer" containerID="0feb858da0d000831a0f51e693005f06d2aba3f94d24c4b4c297b5568998a809" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.935474 5120 scope.go:117] "RemoveContainer" containerID="9fdd34ccdb00204aa5ec64c642c353606f327596693b5828c3f17804d8ffd05b" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.936390 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.940067 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/ea0301d9-a692-4b65-ba34-5e989769d02c-internal-tls-certs\") pod \"ea0301d9-a692-4b65-ba34-5e989769d02c\" (UID: \"ea0301d9-a692-4b65-ba34-5e989769d02c\") " Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.940136 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/ea0301d9-a692-4b65-ba34-5e989769d02c-config-data-custom\") pod \"ea0301d9-a692-4b65-ba34-5e989769d02c\" (UID: \"ea0301d9-a692-4b65-ba34-5e989769d02c\") " Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.940181 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ea0301d9-a692-4b65-ba34-5e989769d02c-logs\") pod \"ea0301d9-a692-4b65-ba34-5e989769d02c\" (UID: \"ea0301d9-a692-4b65-ba34-5e989769d02c\") " Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.940219 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pzxkw\" (UniqueName: \"kubernetes.io/projected/ea0301d9-a692-4b65-ba34-5e989769d02c-kube-api-access-pzxkw\") pod \"ea0301d9-a692-4b65-ba34-5e989769d02c\" (UID: \"ea0301d9-a692-4b65-ba34-5e989769d02c\") " Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.940428 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ea0301d9-a692-4b65-ba34-5e989769d02c-combined-ca-bundle\") pod \"ea0301d9-a692-4b65-ba34-5e989769d02c\" (UID: \"ea0301d9-a692-4b65-ba34-5e989769d02c\") " Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.940487 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ea0301d9-a692-4b65-ba34-5e989769d02c-public-tls-certs\") pod \"ea0301d9-a692-4b65-ba34-5e989769d02c\" (UID: \"ea0301d9-a692-4b65-ba34-5e989769d02c\") " Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.940512 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ea0301d9-a692-4b65-ba34-5e989769d02c-config-data\") pod \"ea0301d9-a692-4b65-ba34-5e989769d02c\" (UID: \"ea0301d9-a692-4b65-ba34-5e989769d02c\") " Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.949148 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea0301d9-a692-4b65-ba34-5e989769d02c-logs" (OuterVolumeSpecName: "logs") pod "ea0301d9-a692-4b65-ba34-5e989769d02c" (UID: "ea0301d9-a692-4b65-ba34-5e989769d02c"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.954634 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.969197 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea0301d9-a692-4b65-ba34-5e989769d02c-kube-api-access-pzxkw" (OuterVolumeSpecName: "kube-api-access-pzxkw") pod "ea0301d9-a692-4b65-ba34-5e989769d02c" (UID: "ea0301d9-a692-4b65-ba34-5e989769d02c"). InnerVolumeSpecName "kube-api-access-pzxkw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.971067 5120 scope.go:117] "RemoveContainer" containerID="0feb858da0d000831a0f51e693005f06d2aba3f94d24c4b4c297b5568998a809" Mar 16 16:00:18 crc kubenswrapper[5120]: E0316 16:00:18.971815 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0feb858da0d000831a0f51e693005f06d2aba3f94d24c4b4c297b5568998a809\": container with ID starting with 0feb858da0d000831a0f51e693005f06d2aba3f94d24c4b4c297b5568998a809 not found: ID does not exist" containerID="0feb858da0d000831a0f51e693005f06d2aba3f94d24c4b4c297b5568998a809" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.971876 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0feb858da0d000831a0f51e693005f06d2aba3f94d24c4b4c297b5568998a809"} err="failed to get container status \"0feb858da0d000831a0f51e693005f06d2aba3f94d24c4b4c297b5568998a809\": rpc error: code = NotFound desc = could not find container \"0feb858da0d000831a0f51e693005f06d2aba3f94d24c4b4c297b5568998a809\": container with ID starting with 0feb858da0d000831a0f51e693005f06d2aba3f94d24c4b4c297b5568998a809 not found: ID does not exist" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.971905 5120 scope.go:117] "RemoveContainer" containerID="9fdd34ccdb00204aa5ec64c642c353606f327596693b5828c3f17804d8ffd05b" Mar 16 16:00:18 crc kubenswrapper[5120]: E0316 16:00:18.972247 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9fdd34ccdb00204aa5ec64c642c353606f327596693b5828c3f17804d8ffd05b\": container with ID starting with 9fdd34ccdb00204aa5ec64c642c353606f327596693b5828c3f17804d8ffd05b not found: ID does not exist" containerID="9fdd34ccdb00204aa5ec64c642c353606f327596693b5828c3f17804d8ffd05b" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.972303 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9fdd34ccdb00204aa5ec64c642c353606f327596693b5828c3f17804d8ffd05b"} err="failed to get container status \"9fdd34ccdb00204aa5ec64c642c353606f327596693b5828c3f17804d8ffd05b\": rpc error: code = NotFound desc = could not find container \"9fdd34ccdb00204aa5ec64c642c353606f327596693b5828c3f17804d8ffd05b\": container with ID starting with 9fdd34ccdb00204aa5ec64c642c353606f327596693b5828c3f17804d8ffd05b not found: ID does not exist" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.972324 5120 scope.go:117] "RemoveContainer" containerID="755cfaa0ce8ac81606545022847fbe8cfb9de5f7c904952f36310b83f8c76f03" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.987120 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea0301d9-a692-4b65-ba34-5e989769d02c-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "ea0301d9-a692-4b65-ba34-5e989769d02c" (UID: "ea0301d9-a692-4b65-ba34-5e989769d02c"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:00:18 crc kubenswrapper[5120]: I0316 16:00:18.994669 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-64b5fbbbdb-nrl4p"] Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.010157 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-64b5fbbbdb-nrl4p"] Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.042724 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/5664a123-9ba3-41e9-8dab-49276b5e404e-memcached-tls-certs\") pod \"5664a123-9ba3-41e9-8dab-49276b5e404e\" (UID: \"5664a123-9ba3-41e9-8dab-49276b5e404e\") " Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.042848 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/5664a123-9ba3-41e9-8dab-49276b5e404e-config-data\") pod \"5664a123-9ba3-41e9-8dab-49276b5e404e\" (UID: \"5664a123-9ba3-41e9-8dab-49276b5e404e\") " Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.043108 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/5664a123-9ba3-41e9-8dab-49276b5e404e-kolla-config\") pod \"5664a123-9ba3-41e9-8dab-49276b5e404e\" (UID: \"5664a123-9ba3-41e9-8dab-49276b5e404e\") " Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.043195 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/b97c2a0c-dcad-4453-8063-d1bbcb265531-config-data-default\") pod \"b97c2a0c-dcad-4453-8063-d1bbcb265531\" (UID: \"b97c2a0c-dcad-4453-8063-d1bbcb265531\") " Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.043227 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b97c2a0c-dcad-4453-8063-d1bbcb265531-operator-scripts\") pod \"b97c2a0c-dcad-4453-8063-d1bbcb265531\" (UID: \"b97c2a0c-dcad-4453-8063-d1bbcb265531\") " Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.043264 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/b97c2a0c-dcad-4453-8063-d1bbcb265531-config-data-generated\") pod \"b97c2a0c-dcad-4453-8063-d1bbcb265531\" (UID: \"b97c2a0c-dcad-4453-8063-d1bbcb265531\") " Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.043309 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b97c2a0c-dcad-4453-8063-d1bbcb265531-combined-ca-bundle\") pod \"b97c2a0c-dcad-4453-8063-d1bbcb265531\" (UID: \"b97c2a0c-dcad-4453-8063-d1bbcb265531\") " Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.043988 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fkpmt\" (UniqueName: \"kubernetes.io/projected/5664a123-9ba3-41e9-8dab-49276b5e404e-kube-api-access-fkpmt\") pod \"5664a123-9ba3-41e9-8dab-49276b5e404e\" (UID: \"5664a123-9ba3-41e9-8dab-49276b5e404e\") " Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.044052 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5664a123-9ba3-41e9-8dab-49276b5e404e-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "5664a123-9ba3-41e9-8dab-49276b5e404e" (UID: "5664a123-9ba3-41e9-8dab-49276b5e404e"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.044328 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/b97c2a0c-dcad-4453-8063-d1bbcb265531-galera-tls-certs\") pod \"b97c2a0c-dcad-4453-8063-d1bbcb265531\" (UID: \"b97c2a0c-dcad-4453-8063-d1bbcb265531\") " Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.044410 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"mysql-db\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"b97c2a0c-dcad-4453-8063-d1bbcb265531\" (UID: \"b97c2a0c-dcad-4453-8063-d1bbcb265531\") " Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.044459 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-626k4\" (UniqueName: \"kubernetes.io/projected/b97c2a0c-dcad-4453-8063-d1bbcb265531-kube-api-access-626k4\") pod \"b97c2a0c-dcad-4453-8063-d1bbcb265531\" (UID: \"b97c2a0c-dcad-4453-8063-d1bbcb265531\") " Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.044512 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/b97c2a0c-dcad-4453-8063-d1bbcb265531-kolla-config\") pod \"b97c2a0c-dcad-4453-8063-d1bbcb265531\" (UID: \"b97c2a0c-dcad-4453-8063-d1bbcb265531\") " Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.044645 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5664a123-9ba3-41e9-8dab-49276b5e404e-combined-ca-bundle\") pod \"5664a123-9ba3-41e9-8dab-49276b5e404e\" (UID: \"5664a123-9ba3-41e9-8dab-49276b5e404e\") " Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.044669 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b97c2a0c-dcad-4453-8063-d1bbcb265531-config-data-default" (OuterVolumeSpecName: "config-data-default") pod "b97c2a0c-dcad-4453-8063-d1bbcb265531" (UID: "b97c2a0c-dcad-4453-8063-d1bbcb265531"). InnerVolumeSpecName "config-data-default". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.045020 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b97c2a0c-dcad-4453-8063-d1bbcb265531-config-data-generated" (OuterVolumeSpecName: "config-data-generated") pod "b97c2a0c-dcad-4453-8063-d1bbcb265531" (UID: "b97c2a0c-dcad-4453-8063-d1bbcb265531"). InnerVolumeSpecName "config-data-generated". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.045399 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b97c2a0c-dcad-4453-8063-d1bbcb265531-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "b97c2a0c-dcad-4453-8063-d1bbcb265531" (UID: "b97c2a0c-dcad-4453-8063-d1bbcb265531"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.045485 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5664a123-9ba3-41e9-8dab-49276b5e404e-config-data" (OuterVolumeSpecName: "config-data") pod "5664a123-9ba3-41e9-8dab-49276b5e404e" (UID: "5664a123-9ba3-41e9-8dab-49276b5e404e"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.045542 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lpdk5\" (UniqueName: \"kubernetes.io/projected/a6eb6a92-c8e9-4dd4-9f92-55eb20dec5c0-kube-api-access-lpdk5\") pod \"keystone-7ef1-account-create-update-8zrpq\" (UID: \"a6eb6a92-c8e9-4dd4-9f92-55eb20dec5c0\") " pod="openstack-kuttl-tests/keystone-7ef1-account-create-update-8zrpq" Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.045712 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b97c2a0c-dcad-4453-8063-d1bbcb265531-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "b97c2a0c-dcad-4453-8063-d1bbcb265531" (UID: "b97c2a0c-dcad-4453-8063-d1bbcb265531"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.045730 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a6eb6a92-c8e9-4dd4-9f92-55eb20dec5c0-operator-scripts\") pod \"keystone-7ef1-account-create-update-8zrpq\" (UID: \"a6eb6a92-c8e9-4dd4-9f92-55eb20dec5c0\") " pod="openstack-kuttl-tests/keystone-7ef1-account-create-update-8zrpq" Mar 16 16:00:19 crc kubenswrapper[5120]: E0316 16:00:19.045909 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.045991 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/ea0301d9-a692-4b65-ba34-5e989769d02c-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.046003 5120 reconciler_common.go:299] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/b97c2a0c-dcad-4453-8063-d1bbcb265531-kolla-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.046012 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ea0301d9-a692-4b65-ba34-5e989769d02c-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.046021 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pzxkw\" (UniqueName: \"kubernetes.io/projected/ea0301d9-a692-4b65-ba34-5e989769d02c-kube-api-access-pzxkw\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:19 crc kubenswrapper[5120]: E0316 16:00:19.046055 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a6eb6a92-c8e9-4dd4-9f92-55eb20dec5c0-operator-scripts podName:a6eb6a92-c8e9-4dd4-9f92-55eb20dec5c0 nodeName:}" failed. No retries permitted until 2026-03-16 16:00:21.046024985 +0000 UTC m=+1723.199956682 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/a6eb6a92-c8e9-4dd4-9f92-55eb20dec5c0-operator-scripts") pod "keystone-7ef1-account-create-update-8zrpq" (UID: "a6eb6a92-c8e9-4dd4-9f92-55eb20dec5c0") : configmap "openstack-scripts" not found Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.046098 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/5664a123-9ba3-41e9-8dab-49276b5e404e-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.046125 5120 reconciler_common.go:299] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/5664a123-9ba3-41e9-8dab-49276b5e404e-kolla-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.046146 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/b97c2a0c-dcad-4453-8063-d1bbcb265531-config-data-default\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.046164 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b97c2a0c-dcad-4453-8063-d1bbcb265531-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.046186 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/b97c2a0c-dcad-4453-8063-d1bbcb265531-config-data-generated\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.048062 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5664a123-9ba3-41e9-8dab-49276b5e404e-kube-api-access-fkpmt" (OuterVolumeSpecName: "kube-api-access-fkpmt") pod "5664a123-9ba3-41e9-8dab-49276b5e404e" (UID: "5664a123-9ba3-41e9-8dab-49276b5e404e"). InnerVolumeSpecName "kube-api-access-fkpmt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:00:19 crc kubenswrapper[5120]: E0316 16:00:19.049677 5120 projected.go:194] Error preparing data for projected volume kube-api-access-lpdk5 for pod openstack-kuttl-tests/keystone-7ef1-account-create-update-8zrpq: failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 16:00:19 crc kubenswrapper[5120]: E0316 16:00:19.049773 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a6eb6a92-c8e9-4dd4-9f92-55eb20dec5c0-kube-api-access-lpdk5 podName:a6eb6a92-c8e9-4dd4-9f92-55eb20dec5c0 nodeName:}" failed. No retries permitted until 2026-03-16 16:00:21.049735888 +0000 UTC m=+1723.203667545 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-lpdk5" (UniqueName: "kubernetes.io/projected/a6eb6a92-c8e9-4dd4-9f92-55eb20dec5c0-kube-api-access-lpdk5") pod "keystone-7ef1-account-create-update-8zrpq" (UID: "a6eb6a92-c8e9-4dd4-9f92-55eb20dec5c0") : failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.054209 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea0301d9-a692-4b65-ba34-5e989769d02c-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "ea0301d9-a692-4b65-ba34-5e989769d02c" (UID: "ea0301d9-a692-4b65-ba34-5e989769d02c"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.055330 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b97c2a0c-dcad-4453-8063-d1bbcb265531-kube-api-access-626k4" (OuterVolumeSpecName: "kube-api-access-626k4") pod "b97c2a0c-dcad-4453-8063-d1bbcb265531" (UID: "b97c2a0c-dcad-4453-8063-d1bbcb265531"). InnerVolumeSpecName "kube-api-access-626k4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.080350 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage04-crc" (OuterVolumeSpecName: "mysql-db") pod "b97c2a0c-dcad-4453-8063-d1bbcb265531" (UID: "b97c2a0c-dcad-4453-8063-d1bbcb265531"). InnerVolumeSpecName "local-storage04-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.080829 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea0301d9-a692-4b65-ba34-5e989769d02c-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ea0301d9-a692-4b65-ba34-5e989769d02c" (UID: "ea0301d9-a692-4b65-ba34-5e989769d02c"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.093122 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5664a123-9ba3-41e9-8dab-49276b5e404e-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "5664a123-9ba3-41e9-8dab-49276b5e404e" (UID: "5664a123-9ba3-41e9-8dab-49276b5e404e"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.095961 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b97c2a0c-dcad-4453-8063-d1bbcb265531-galera-tls-certs" (OuterVolumeSpecName: "galera-tls-certs") pod "b97c2a0c-dcad-4453-8063-d1bbcb265531" (UID: "b97c2a0c-dcad-4453-8063-d1bbcb265531"). InnerVolumeSpecName "galera-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.104216 5120 scope.go:117] "RemoveContainer" containerID="8e8fbd7afb6b4def81fe53673306c45558e83d21c714994987a7ead7c9d14080" Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.104216 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea0301d9-a692-4b65-ba34-5e989769d02c-config-data" (OuterVolumeSpecName: "config-data") pod "ea0301d9-a692-4b65-ba34-5e989769d02c" (UID: "ea0301d9-a692-4b65-ba34-5e989769d02c"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.111173 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea0301d9-a692-4b65-ba34-5e989769d02c-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "ea0301d9-a692-4b65-ba34-5e989769d02c" (UID: "ea0301d9-a692-4b65-ba34-5e989769d02c"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.125705 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b97c2a0c-dcad-4453-8063-d1bbcb265531-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "b97c2a0c-dcad-4453-8063-d1bbcb265531" (UID: "b97c2a0c-dcad-4453-8063-d1bbcb265531"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.130873 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5664a123-9ba3-41e9-8dab-49276b5e404e-memcached-tls-certs" (OuterVolumeSpecName: "memcached-tls-certs") pod "5664a123-9ba3-41e9-8dab-49276b5e404e" (UID: "5664a123-9ba3-41e9-8dab-49276b5e404e"). InnerVolumeSpecName "memcached-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.134499 5120 scope.go:117] "RemoveContainer" containerID="755cfaa0ce8ac81606545022847fbe8cfb9de5f7c904952f36310b83f8c76f03" Mar 16 16:00:19 crc kubenswrapper[5120]: E0316 16:00:19.135038 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"755cfaa0ce8ac81606545022847fbe8cfb9de5f7c904952f36310b83f8c76f03\": container with ID starting with 755cfaa0ce8ac81606545022847fbe8cfb9de5f7c904952f36310b83f8c76f03 not found: ID does not exist" containerID="755cfaa0ce8ac81606545022847fbe8cfb9de5f7c904952f36310b83f8c76f03" Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.135084 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"755cfaa0ce8ac81606545022847fbe8cfb9de5f7c904952f36310b83f8c76f03"} err="failed to get container status \"755cfaa0ce8ac81606545022847fbe8cfb9de5f7c904952f36310b83f8c76f03\": rpc error: code = NotFound desc = could not find container \"755cfaa0ce8ac81606545022847fbe8cfb9de5f7c904952f36310b83f8c76f03\": container with ID starting with 755cfaa0ce8ac81606545022847fbe8cfb9de5f7c904952f36310b83f8c76f03 not found: ID does not exist" Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.135114 5120 scope.go:117] "RemoveContainer" containerID="8e8fbd7afb6b4def81fe53673306c45558e83d21c714994987a7ead7c9d14080" Mar 16 16:00:19 crc kubenswrapper[5120]: E0316 16:00:19.135383 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e8fbd7afb6b4def81fe53673306c45558e83d21c714994987a7ead7c9d14080\": container with ID starting with 8e8fbd7afb6b4def81fe53673306c45558e83d21c714994987a7ead7c9d14080 not found: ID does not exist" containerID="8e8fbd7afb6b4def81fe53673306c45558e83d21c714994987a7ead7c9d14080" Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.135411 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e8fbd7afb6b4def81fe53673306c45558e83d21c714994987a7ead7c9d14080"} err="failed to get container status \"8e8fbd7afb6b4def81fe53673306c45558e83d21c714994987a7ead7c9d14080\": rpc error: code = NotFound desc = could not find container \"8e8fbd7afb6b4def81fe53673306c45558e83d21c714994987a7ead7c9d14080\": container with ID starting with 8e8fbd7afb6b4def81fe53673306c45558e83d21c714994987a7ead7c9d14080 not found: ID does not exist" Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.135426 5120 scope.go:117] "RemoveContainer" containerID="64e90c71960de20873b7811fc895ce903bc60eaefd9593abac82e4c4b489e606" Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.147869 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5664a123-9ba3-41e9-8dab-49276b5e404e-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.147906 5120 reconciler_common.go:299] "Volume detached for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/5664a123-9ba3-41e9-8dab-49276b5e404e-memcached-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.147916 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ea0301d9-a692-4b65-ba34-5e989769d02c-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.147925 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b97c2a0c-dcad-4453-8063-d1bbcb265531-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.147933 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ea0301d9-a692-4b65-ba34-5e989769d02c-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.147941 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ea0301d9-a692-4b65-ba34-5e989769d02c-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.147950 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fkpmt\" (UniqueName: \"kubernetes.io/projected/5664a123-9ba3-41e9-8dab-49276b5e404e-kube-api-access-fkpmt\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.147961 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/ea0301d9-a692-4b65-ba34-5e989769d02c-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.147972 5120 reconciler_common.go:299] "Volume detached for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/b97c2a0c-dcad-4453-8063-d1bbcb265531-galera-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.148005 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") on node \"crc\" " Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.148016 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-626k4\" (UniqueName: \"kubernetes.io/projected/b97c2a0c-dcad-4453-8063-d1bbcb265531-kube-api-access-626k4\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.153825 5120 scope.go:117] "RemoveContainer" containerID="6f7dc6683e41d78ef9ed871ab4cec8bf6d45dff6e94f3f28507ba3a97f851f26" Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.164442 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage04-crc" (UniqueName: "kubernetes.io/local-volume/local-storage04-crc") on node "crc" Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.250023 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.396842 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"b97c2a0c-dcad-4453-8063-d1bbcb265531","Type":"ContainerDied","Data":"c4bb05b4408f814c4b0fc3ef1cd25944679ee0d372675b310c045785c8a77bd5"} Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.396894 5120 scope.go:117] "RemoveContainer" containerID="7a661bc910ce2d776a4e9f81005f8af24f1929db2c6f86edd9380bc21d372086" Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.397028 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.414189 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"188dbfe0-6d71-4ba4-a3b7-6ee900a60138","Type":"ContainerDied","Data":"2835c7c7c54adddb2757b060bdff6eb6cad04c25ea6f22eb1c8aadf3e09d736b"} Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.414288 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.416883 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-bcc6c568d-dqmvk" event={"ID":"ea0301d9-a692-4b65-ba34-5e989769d02c","Type":"ContainerDied","Data":"855b06c0e5597c565ead6ba176754161b528a634a29ad57bb0f14843391f80f1"} Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.416973 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-bcc6c568d-dqmvk" Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.427311 5120 generic.go:358] "Generic (PLEG): container finished" podID="ca816558-dccc-44fa-aaa6-5a2070f1b25f" containerID="b23e5249a31a3ba32a12e44b4cd5caabdbb3812e1a2bf4be34ad41cc2e244972" exitCode=0 Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.430164 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-mm5p4" event={"ID":"ca816558-dccc-44fa-aaa6-5a2070f1b25f","Type":"ContainerDied","Data":"b23e5249a31a3ba32a12e44b4cd5caabdbb3812e1a2bf4be34ad41cc2e244972"} Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.430263 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-mm5p4" event={"ID":"ca816558-dccc-44fa-aaa6-5a2070f1b25f","Type":"ContainerStarted","Data":"8c0784711565539c2b4e46537591612819965f687d254654b551082f9e6f53bb"} Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.430358 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-mm5p4" Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.434536 5120 generic.go:358] "Generic (PLEG): container finished" podID="5664a123-9ba3-41e9-8dab-49276b5e404e" containerID="3e79e4c778100da677b7b8adc1bc5e9b3d67806fc66f9998e46dbce7ad87e99e" exitCode=0 Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.434659 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"5664a123-9ba3-41e9-8dab-49276b5e404e","Type":"ContainerDied","Data":"3e79e4c778100da677b7b8adc1bc5e9b3d67806fc66f9998e46dbce7ad87e99e"} Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.434682 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"5664a123-9ba3-41e9-8dab-49276b5e404e","Type":"ContainerDied","Data":"93d424d2baafc468faaf8b01eb215284881e85c8b9f3d267475f19552298c216"} Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.434730 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.439223 5120 scope.go:117] "RemoveContainer" containerID="ac2b119aa92ab660e370e9cb5a952842b6048001c1aed3cc98a4b99d73c542f3" Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.458132 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"c568edd3-501f-4254-ae95-67946f898cd3","Type":"ContainerDied","Data":"e4e79fd4849bbaec6fd91a4e2b78435f26830ee4bf7bd50d02e2c63e3c9ab5e9"} Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.458183 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.472343 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"a0983bdb-df60-4951-aa31-672444ba7c32","Type":"ContainerDied","Data":"19258648c68c745ef2fa7d724b47037106c920d306845d9eea9b83e22c266f1c"} Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.472638 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.480921 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-northd-0_3a1fe07d-3cc8-4eea-8e8b-eb2807caa357/ovn-northd/0.log" Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.480969 5120 generic.go:358] "Generic (PLEG): container finished" podID="3a1fe07d-3cc8-4eea-8e8b-eb2807caa357" containerID="73fdaa6f98a1d0cecc065049ce5388e3add5f04f37ed5696274bbf8df19e57a5" exitCode=139 Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.481075 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"3a1fe07d-3cc8-4eea-8e8b-eb2807caa357","Type":"ContainerDied","Data":"73fdaa6f98a1d0cecc065049ce5388e3add5f04f37ed5696274bbf8df19e57a5"} Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.485394 5120 scope.go:117] "RemoveContainer" containerID="5cb5336eec2bc9d72af934b6fd40e9184ab80151a298a3a10de1976e1f86500b" Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.489030 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-7ef1-account-create-update-8zrpq" Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.506246 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.521713 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.524810 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-mm5p4" podStartSLOduration=6.524753256 podStartE2EDuration="6.524753256s" podCreationTimestamp="2026-03-16 16:00:13 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:00:19.501071261 +0000 UTC m=+1721.655002958" watchObservedRunningTime="2026-03-16 16:00:19.524753256 +0000 UTC m=+1721.678684913" Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.530957 5120 scope.go:117] "RemoveContainer" containerID="41a2173d1d872cc17f3406c61f519f5887c310bc059bf9c62ba549c2902c7600" Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.561520 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.570115 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.575967 5120 scope.go:117] "RemoveContainer" containerID="8b21d045c26ecdd9743611e46a46a194f9882c136e56843ba91195604f46f37b" Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.576431 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.585205 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.599051 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-7ef1-account-create-update-8zrpq"] Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.607963 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-7ef1-account-create-update-8zrpq"] Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.610328 5120 scope.go:117] "RemoveContainer" containerID="586bc7a04e27dd8d1aa0558b163f524487e412f155988226de43eca06d6c8b1e" Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.616879 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.623033 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.628967 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-bcc6c568d-dqmvk"] Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.629747 5120 scope.go:117] "RemoveContainer" containerID="3e79e4c778100da677b7b8adc1bc5e9b3d67806fc66f9998e46dbce7ad87e99e" Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.639688 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-api-bcc6c568d-dqmvk"] Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.646373 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.651109 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.662826 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lpdk5\" (UniqueName: \"kubernetes.io/projected/a6eb6a92-c8e9-4dd4-9f92-55eb20dec5c0-kube-api-access-lpdk5\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.662884 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a6eb6a92-c8e9-4dd4-9f92-55eb20dec5c0-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.716005 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-northd-0_3a1fe07d-3cc8-4eea-8e8b-eb2807caa357/ovn-northd/0.log" Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.716091 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.721431 5120 scope.go:117] "RemoveContainer" containerID="3e79e4c778100da677b7b8adc1bc5e9b3d67806fc66f9998e46dbce7ad87e99e" Mar 16 16:00:19 crc kubenswrapper[5120]: E0316 16:00:19.721822 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e79e4c778100da677b7b8adc1bc5e9b3d67806fc66f9998e46dbce7ad87e99e\": container with ID starting with 3e79e4c778100da677b7b8adc1bc5e9b3d67806fc66f9998e46dbce7ad87e99e not found: ID does not exist" containerID="3e79e4c778100da677b7b8adc1bc5e9b3d67806fc66f9998e46dbce7ad87e99e" Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.721896 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e79e4c778100da677b7b8adc1bc5e9b3d67806fc66f9998e46dbce7ad87e99e"} err="failed to get container status \"3e79e4c778100da677b7b8adc1bc5e9b3d67806fc66f9998e46dbce7ad87e99e\": rpc error: code = NotFound desc = could not find container \"3e79e4c778100da677b7b8adc1bc5e9b3d67806fc66f9998e46dbce7ad87e99e\": container with ID starting with 3e79e4c778100da677b7b8adc1bc5e9b3d67806fc66f9998e46dbce7ad87e99e not found: ID does not exist" Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.721930 5120 scope.go:117] "RemoveContainer" containerID="43900ca08144bf1b772b28160272d2ed488bb604fc3fbc4d53917a0d50806010" Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.751508 5120 scope.go:117] "RemoveContainer" containerID="2b22006c50d5da36968915545fc025f97fb4e75c310ad215b4ef102ae8c5bf5c" Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.764751 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3a1fe07d-3cc8-4eea-8e8b-eb2807caa357-combined-ca-bundle\") pod \"3a1fe07d-3cc8-4eea-8e8b-eb2807caa357\" (UID: \"3a1fe07d-3cc8-4eea-8e8b-eb2807caa357\") " Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.765358 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/3a1fe07d-3cc8-4eea-8e8b-eb2807caa357-scripts\") pod \"3a1fe07d-3cc8-4eea-8e8b-eb2807caa357\" (UID: \"3a1fe07d-3cc8-4eea-8e8b-eb2807caa357\") " Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.765679 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3a1fe07d-3cc8-4eea-8e8b-eb2807caa357-config\") pod \"3a1fe07d-3cc8-4eea-8e8b-eb2807caa357\" (UID: \"3a1fe07d-3cc8-4eea-8e8b-eb2807caa357\") " Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.765860 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/3a1fe07d-3cc8-4eea-8e8b-eb2807caa357-metrics-certs-tls-certs\") pod \"3a1fe07d-3cc8-4eea-8e8b-eb2807caa357\" (UID: \"3a1fe07d-3cc8-4eea-8e8b-eb2807caa357\") " Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.766001 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/3a1fe07d-3cc8-4eea-8e8b-eb2807caa357-ovn-rundir\") pod \"3a1fe07d-3cc8-4eea-8e8b-eb2807caa357\" (UID: \"3a1fe07d-3cc8-4eea-8e8b-eb2807caa357\") " Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.766172 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3a1fe07d-3cc8-4eea-8e8b-eb2807caa357-scripts" (OuterVolumeSpecName: "scripts") pod "3a1fe07d-3cc8-4eea-8e8b-eb2807caa357" (UID: "3a1fe07d-3cc8-4eea-8e8b-eb2807caa357"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.766202 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x6ssc\" (UniqueName: \"kubernetes.io/projected/3a1fe07d-3cc8-4eea-8e8b-eb2807caa357-kube-api-access-x6ssc\") pod \"3a1fe07d-3cc8-4eea-8e8b-eb2807caa357\" (UID: \"3a1fe07d-3cc8-4eea-8e8b-eb2807caa357\") " Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.766440 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3a1fe07d-3cc8-4eea-8e8b-eb2807caa357-config" (OuterVolumeSpecName: "config") pod "3a1fe07d-3cc8-4eea-8e8b-eb2807caa357" (UID: "3a1fe07d-3cc8-4eea-8e8b-eb2807caa357"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.766585 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/3a1fe07d-3cc8-4eea-8e8b-eb2807caa357-ovn-northd-tls-certs\") pod \"3a1fe07d-3cc8-4eea-8e8b-eb2807caa357\" (UID: \"3a1fe07d-3cc8-4eea-8e8b-eb2807caa357\") " Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.767840 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/3a1fe07d-3cc8-4eea-8e8b-eb2807caa357-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.767864 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3a1fe07d-3cc8-4eea-8e8b-eb2807caa357-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.769893 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a1fe07d-3cc8-4eea-8e8b-eb2807caa357-ovn-rundir" (OuterVolumeSpecName: "ovn-rundir") pod "3a1fe07d-3cc8-4eea-8e8b-eb2807caa357" (UID: "3a1fe07d-3cc8-4eea-8e8b-eb2807caa357"). InnerVolumeSpecName "ovn-rundir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.782057 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a1fe07d-3cc8-4eea-8e8b-eb2807caa357-kube-api-access-x6ssc" (OuterVolumeSpecName: "kube-api-access-x6ssc") pod "3a1fe07d-3cc8-4eea-8e8b-eb2807caa357" (UID: "3a1fe07d-3cc8-4eea-8e8b-eb2807caa357"). InnerVolumeSpecName "kube-api-access-x6ssc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.783168 5120 scope.go:117] "RemoveContainer" containerID="36112e54f7c3727e2e552937fcf3b649d839e6ece9f9a4e4e6b969952dbdd56b" Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.802332 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3a1fe07d-3cc8-4eea-8e8b-eb2807caa357-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "3a1fe07d-3cc8-4eea-8e8b-eb2807caa357" (UID: "3a1fe07d-3cc8-4eea-8e8b-eb2807caa357"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.848273 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3a1fe07d-3cc8-4eea-8e8b-eb2807caa357-ovn-northd-tls-certs" (OuterVolumeSpecName: "ovn-northd-tls-certs") pod "3a1fe07d-3cc8-4eea-8e8b-eb2807caa357" (UID: "3a1fe07d-3cc8-4eea-8e8b-eb2807caa357"). InnerVolumeSpecName "ovn-northd-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.853353 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3a1fe07d-3cc8-4eea-8e8b-eb2807caa357-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "3a1fe07d-3cc8-4eea-8e8b-eb2807caa357" (UID: "3a1fe07d-3cc8-4eea-8e8b-eb2807caa357"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.869426 5120 reconciler_common.go:299] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/3a1fe07d-3cc8-4eea-8e8b-eb2807caa357-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.869457 5120 reconciler_common.go:299] "Volume detached for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/3a1fe07d-3cc8-4eea-8e8b-eb2807caa357-ovn-rundir\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.869519 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x6ssc\" (UniqueName: \"kubernetes.io/projected/3a1fe07d-3cc8-4eea-8e8b-eb2807caa357-kube-api-access-x6ssc\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.869535 5120 reconciler_common.go:299] "Volume detached for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/3a1fe07d-3cc8-4eea-8e8b-eb2807caa357-ovn-northd-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.869544 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3a1fe07d-3cc8-4eea-8e8b-eb2807caa357-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:19 crc kubenswrapper[5120]: I0316 16:00:19.914429 5120 scope.go:117] "RemoveContainer" containerID="796c0a9981d4c219b1f40e68d8b57bf4e6a3f5d3b026b0a47930e1eea94c43c8" Mar 16 16:00:20 crc kubenswrapper[5120]: I0316 16:00:20.509524 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-northd-0_3a1fe07d-3cc8-4eea-8e8b-eb2807caa357/ovn-northd/0.log" Mar 16 16:00:20 crc kubenswrapper[5120]: I0316 16:00:20.509826 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:00:20 crc kubenswrapper[5120]: I0316 16:00:20.509886 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"3a1fe07d-3cc8-4eea-8e8b-eb2807caa357","Type":"ContainerDied","Data":"32a2d5fa725706f4fcf703f259c2b4a1ebfdedb4e7eb5704c2680b6e38ef18d5"} Mar 16 16:00:20 crc kubenswrapper[5120]: I0316 16:00:20.509945 5120 scope.go:117] "RemoveContainer" containerID="8769703bd7ee632a3e2c4769a2f29d820d6492a20d3a07f5c473931055316ae6" Mar 16 16:00:20 crc kubenswrapper[5120]: I0316 16:00:20.559441 5120 scope.go:117] "RemoveContainer" containerID="73fdaa6f98a1d0cecc065049ce5388e3add5f04f37ed5696274bbf8df19e57a5" Mar 16 16:00:20 crc kubenswrapper[5120]: I0316 16:00:20.568776 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 16:00:20 crc kubenswrapper[5120]: I0316 16:00:20.577081 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 16:00:20 crc kubenswrapper[5120]: E0316 16:00:20.584608 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Mar 16 16:00:20 crc kubenswrapper[5120]: E0316 16:00:20.584717 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/492ba9f3-6479-432b-a2f4-cee712a51800-config-data podName:492ba9f3-6479-432b-a2f4-cee712a51800 nodeName:}" failed. No retries permitted until 2026-03-16 16:00:28.584693222 +0000 UTC m=+1730.738624909 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/492ba9f3-6479-432b-a2f4-cee712a51800-config-data") pod "rabbitmq-cell1-server-0" (UID: "492ba9f3-6479-432b-a2f4-cee712a51800") : configmap "rabbitmq-cell1-config-data" not found Mar 16 16:00:20 crc kubenswrapper[5120]: I0316 16:00:20.663693 5120 scope.go:117] "RemoveContainer" containerID="02ba4fc3f84eccaecfa9e6618280f65626eb76580c4af9ae7a9d7cb3b8dd590b" Mar 16 16:00:20 crc kubenswrapper[5120]: E0316 16:00:20.664076 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:00:20 crc kubenswrapper[5120]: I0316 16:00:20.674514 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="188dbfe0-6d71-4ba4-a3b7-6ee900a60138" path="/var/lib/kubelet/pods/188dbfe0-6d71-4ba4-a3b7-6ee900a60138/volumes" Mar 16 16:00:20 crc kubenswrapper[5120]: I0316 16:00:20.675193 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe" path="/var/lib/kubelet/pods/1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe/volumes" Mar 16 16:00:20 crc kubenswrapper[5120]: I0316 16:00:20.675993 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3a1fe07d-3cc8-4eea-8e8b-eb2807caa357" path="/var/lib/kubelet/pods/3a1fe07d-3cc8-4eea-8e8b-eb2807caa357/volumes" Mar 16 16:00:20 crc kubenswrapper[5120]: I0316 16:00:20.677230 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5664a123-9ba3-41e9-8dab-49276b5e404e" path="/var/lib/kubelet/pods/5664a123-9ba3-41e9-8dab-49276b5e404e/volumes" Mar 16 16:00:20 crc kubenswrapper[5120]: I0316 16:00:20.677850 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a0983bdb-df60-4951-aa31-672444ba7c32" path="/var/lib/kubelet/pods/a0983bdb-df60-4951-aa31-672444ba7c32/volumes" Mar 16 16:00:20 crc kubenswrapper[5120]: I0316 16:00:20.678329 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a6eb6a92-c8e9-4dd4-9f92-55eb20dec5c0" path="/var/lib/kubelet/pods/a6eb6a92-c8e9-4dd4-9f92-55eb20dec5c0/volumes" Mar 16 16:00:20 crc kubenswrapper[5120]: I0316 16:00:20.679071 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b3794e20-01dd-453a-bf29-20813144c61b" path="/var/lib/kubelet/pods/b3794e20-01dd-453a-bf29-20813144c61b/volumes" Mar 16 16:00:20 crc kubenswrapper[5120]: I0316 16:00:20.679673 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b97c2a0c-dcad-4453-8063-d1bbcb265531" path="/var/lib/kubelet/pods/b97c2a0c-dcad-4453-8063-d1bbcb265531/volumes" Mar 16 16:00:20 crc kubenswrapper[5120]: I0316 16:00:20.680245 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c3689d41-4ea9-4076-9b69-4a93be5896cf" path="/var/lib/kubelet/pods/c3689d41-4ea9-4076-9b69-4a93be5896cf/volumes" Mar 16 16:00:20 crc kubenswrapper[5120]: I0316 16:00:20.681242 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c568edd3-501f-4254-ae95-67946f898cd3" path="/var/lib/kubelet/pods/c568edd3-501f-4254-ae95-67946f898cd3/volumes" Mar 16 16:00:20 crc kubenswrapper[5120]: I0316 16:00:20.681805 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ea0301d9-a692-4b65-ba34-5e989769d02c" path="/var/lib/kubelet/pods/ea0301d9-a692-4b65-ba34-5e989769d02c/volumes" Mar 16 16:00:20 crc kubenswrapper[5120]: E0316 16:00:20.863448 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="b2dd99f48a5e6c36c5d9b0bed8c62972ff65efc2c08b8a4c56e6c1ee763db013" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:00:20 crc kubenswrapper[5120]: E0316 16:00:20.865106 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="b2dd99f48a5e6c36c5d9b0bed8c62972ff65efc2c08b8a4c56e6c1ee763db013" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:00:20 crc kubenswrapper[5120]: E0316 16:00:20.866700 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="b2dd99f48a5e6c36c5d9b0bed8c62972ff65efc2c08b8a4c56e6c1ee763db013" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:00:20 crc kubenswrapper[5120]: E0316 16:00:20.866840 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="ca4a5201-32c6-4c58-8bac-4d1b05ddfbb4" containerName="nova-scheduler-scheduler" probeResult="unknown" Mar 16 16:00:20 crc kubenswrapper[5120]: E0316 16:00:20.944405 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="6b9d4e9dc1d3160e9abb2e9af3ed540f0c1e83d09c814ee53e6dfb172f8914f5" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:00:20 crc kubenswrapper[5120]: E0316 16:00:20.948503 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="6b9d4e9dc1d3160e9abb2e9af3ed540f0c1e83d09c814ee53e6dfb172f8914f5" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:00:20 crc kubenswrapper[5120]: E0316 16:00:20.950150 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="6b9d4e9dc1d3160e9abb2e9af3ed540f0c1e83d09c814ee53e6dfb172f8914f5" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:00:20 crc kubenswrapper[5120]: E0316 16:00:20.950198 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="63972b06-4c5e-40e4-a318-8e5f3e286ece" containerName="nova-cell1-conductor-conductor" probeResult="unknown" Mar 16 16:00:21 crc kubenswrapper[5120]: E0316 16:00:21.194485 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-config-data: configmap "rabbitmq-config-data" not found Mar 16 16:00:21 crc kubenswrapper[5120]: E0316 16:00:21.194585 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b6cf92fd-a58b-4b50-9a61-35486c401d72-config-data podName:b6cf92fd-a58b-4b50-9a61-35486c401d72 nodeName:}" failed. No retries permitted until 2026-03-16 16:00:29.194567229 +0000 UTC m=+1731.348498886 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/b6cf92fd-a58b-4b50-9a61-35486c401d72-config-data") pod "rabbitmq-server-0" (UID: "b6cf92fd-a58b-4b50-9a61-35486c401d72") : configmap "rabbitmq-config-data" not found Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.238197 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-549cb9f7c8-crdfd" Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.295698 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/57a83a83-de95-43e1-b18c-a7b59c4d1a3b-combined-ca-bundle\") pod \"57a83a83-de95-43e1-b18c-a7b59c4d1a3b\" (UID: \"57a83a83-de95-43e1-b18c-a7b59c4d1a3b\") " Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.295989 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/57a83a83-de95-43e1-b18c-a7b59c4d1a3b-internal-tls-certs\") pod \"57a83a83-de95-43e1-b18c-a7b59c4d1a3b\" (UID: \"57a83a83-de95-43e1-b18c-a7b59c4d1a3b\") " Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.296179 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/57a83a83-de95-43e1-b18c-a7b59c4d1a3b-fernet-keys\") pod \"57a83a83-de95-43e1-b18c-a7b59c4d1a3b\" (UID: \"57a83a83-de95-43e1-b18c-a7b59c4d1a3b\") " Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.296301 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/57a83a83-de95-43e1-b18c-a7b59c4d1a3b-config-data\") pod \"57a83a83-de95-43e1-b18c-a7b59c4d1a3b\" (UID: \"57a83a83-de95-43e1-b18c-a7b59c4d1a3b\") " Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.296417 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dl2wt\" (UniqueName: \"kubernetes.io/projected/57a83a83-de95-43e1-b18c-a7b59c4d1a3b-kube-api-access-dl2wt\") pod \"57a83a83-de95-43e1-b18c-a7b59c4d1a3b\" (UID: \"57a83a83-de95-43e1-b18c-a7b59c4d1a3b\") " Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.296509 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/57a83a83-de95-43e1-b18c-a7b59c4d1a3b-credential-keys\") pod \"57a83a83-de95-43e1-b18c-a7b59c4d1a3b\" (UID: \"57a83a83-de95-43e1-b18c-a7b59c4d1a3b\") " Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.296621 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/57a83a83-de95-43e1-b18c-a7b59c4d1a3b-public-tls-certs\") pod \"57a83a83-de95-43e1-b18c-a7b59c4d1a3b\" (UID: \"57a83a83-de95-43e1-b18c-a7b59c4d1a3b\") " Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.296749 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/57a83a83-de95-43e1-b18c-a7b59c4d1a3b-scripts\") pod \"57a83a83-de95-43e1-b18c-a7b59c4d1a3b\" (UID: \"57a83a83-de95-43e1-b18c-a7b59c4d1a3b\") " Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.306598 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57a83a83-de95-43e1-b18c-a7b59c4d1a3b-kube-api-access-dl2wt" (OuterVolumeSpecName: "kube-api-access-dl2wt") pod "57a83a83-de95-43e1-b18c-a7b59c4d1a3b" (UID: "57a83a83-de95-43e1-b18c-a7b59c4d1a3b"). InnerVolumeSpecName "kube-api-access-dl2wt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.306590 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/57a83a83-de95-43e1-b18c-a7b59c4d1a3b-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "57a83a83-de95-43e1-b18c-a7b59c4d1a3b" (UID: "57a83a83-de95-43e1-b18c-a7b59c4d1a3b"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.308885 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/57a83a83-de95-43e1-b18c-a7b59c4d1a3b-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "57a83a83-de95-43e1-b18c-a7b59c4d1a3b" (UID: "57a83a83-de95-43e1-b18c-a7b59c4d1a3b"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.309174 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/57a83a83-de95-43e1-b18c-a7b59c4d1a3b-scripts" (OuterVolumeSpecName: "scripts") pod "57a83a83-de95-43e1-b18c-a7b59c4d1a3b" (UID: "57a83a83-de95-43e1-b18c-a7b59c4d1a3b"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.325916 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/57a83a83-de95-43e1-b18c-a7b59c4d1a3b-config-data" (OuterVolumeSpecName: "config-data") pod "57a83a83-de95-43e1-b18c-a7b59c4d1a3b" (UID: "57a83a83-de95-43e1-b18c-a7b59c4d1a3b"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.329143 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.335025 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/57a83a83-de95-43e1-b18c-a7b59c4d1a3b-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "57a83a83-de95-43e1-b18c-a7b59c4d1a3b" (UID: "57a83a83-de95-43e1-b18c-a7b59c4d1a3b"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.361620 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/57a83a83-de95-43e1-b18c-a7b59c4d1a3b-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "57a83a83-de95-43e1-b18c-a7b59c4d1a3b" (UID: "57a83a83-de95-43e1-b18c-a7b59c4d1a3b"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.363156 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/57a83a83-de95-43e1-b18c-a7b59c4d1a3b-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "57a83a83-de95-43e1-b18c-a7b59c4d1a3b" (UID: "57a83a83-de95-43e1-b18c-a7b59c4d1a3b"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.399334 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/492ba9f3-6479-432b-a2f4-cee712a51800-rabbitmq-tls\") pod \"492ba9f3-6479-432b-a2f4-cee712a51800\" (UID: \"492ba9f3-6479-432b-a2f4-cee712a51800\") " Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.399607 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l5sck\" (UniqueName: \"kubernetes.io/projected/492ba9f3-6479-432b-a2f4-cee712a51800-kube-api-access-l5sck\") pod \"492ba9f3-6479-432b-a2f4-cee712a51800\" (UID: \"492ba9f3-6479-432b-a2f4-cee712a51800\") " Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.399714 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/492ba9f3-6479-432b-a2f4-cee712a51800-erlang-cookie-secret\") pod \"492ba9f3-6479-432b-a2f4-cee712a51800\" (UID: \"492ba9f3-6479-432b-a2f4-cee712a51800\") " Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.399827 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/492ba9f3-6479-432b-a2f4-cee712a51800-rabbitmq-plugins\") pod \"492ba9f3-6479-432b-a2f4-cee712a51800\" (UID: \"492ba9f3-6479-432b-a2f4-cee712a51800\") " Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.399926 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/492ba9f3-6479-432b-a2f4-cee712a51800-pod-info\") pod \"492ba9f3-6479-432b-a2f4-cee712a51800\" (UID: \"492ba9f3-6479-432b-a2f4-cee712a51800\") " Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.400010 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"persistence\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"492ba9f3-6479-432b-a2f4-cee712a51800\" (UID: \"492ba9f3-6479-432b-a2f4-cee712a51800\") " Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.400095 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/492ba9f3-6479-432b-a2f4-cee712a51800-config-data\") pod \"492ba9f3-6479-432b-a2f4-cee712a51800\" (UID: \"492ba9f3-6479-432b-a2f4-cee712a51800\") " Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.400243 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/492ba9f3-6479-432b-a2f4-cee712a51800-server-conf\") pod \"492ba9f3-6479-432b-a2f4-cee712a51800\" (UID: \"492ba9f3-6479-432b-a2f4-cee712a51800\") " Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.400385 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/492ba9f3-6479-432b-a2f4-cee712a51800-rabbitmq-plugins" (OuterVolumeSpecName: "rabbitmq-plugins") pod "492ba9f3-6479-432b-a2f4-cee712a51800" (UID: "492ba9f3-6479-432b-a2f4-cee712a51800"). InnerVolumeSpecName "rabbitmq-plugins". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.400716 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/492ba9f3-6479-432b-a2f4-cee712a51800-plugins-conf\") pod \"492ba9f3-6479-432b-a2f4-cee712a51800\" (UID: \"492ba9f3-6479-432b-a2f4-cee712a51800\") " Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.400834 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/492ba9f3-6479-432b-a2f4-cee712a51800-rabbitmq-erlang-cookie\") pod \"492ba9f3-6479-432b-a2f4-cee712a51800\" (UID: \"492ba9f3-6479-432b-a2f4-cee712a51800\") " Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.401080 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/492ba9f3-6479-432b-a2f4-cee712a51800-rabbitmq-confd\") pod \"492ba9f3-6479-432b-a2f4-cee712a51800\" (UID: \"492ba9f3-6479-432b-a2f4-cee712a51800\") " Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.401636 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/57a83a83-de95-43e1-b18c-a7b59c4d1a3b-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.401722 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dl2wt\" (UniqueName: \"kubernetes.io/projected/57a83a83-de95-43e1-b18c-a7b59c4d1a3b-kube-api-access-dl2wt\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.401824 5120 reconciler_common.go:299] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/57a83a83-de95-43e1-b18c-a7b59c4d1a3b-credential-keys\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.401898 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/57a83a83-de95-43e1-b18c-a7b59c4d1a3b-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.401963 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/57a83a83-de95-43e1-b18c-a7b59c4d1a3b-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.402026 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/57a83a83-de95-43e1-b18c-a7b59c4d1a3b-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.402093 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/57a83a83-de95-43e1-b18c-a7b59c4d1a3b-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.402166 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/492ba9f3-6479-432b-a2f4-cee712a51800-rabbitmq-plugins\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.402236 5120 reconciler_common.go:299] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/57a83a83-de95-43e1-b18c-a7b59c4d1a3b-fernet-keys\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.401638 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/492ba9f3-6479-432b-a2f4-cee712a51800-plugins-conf" (OuterVolumeSpecName: "plugins-conf") pod "492ba9f3-6479-432b-a2f4-cee712a51800" (UID: "492ba9f3-6479-432b-a2f4-cee712a51800"). InnerVolumeSpecName "plugins-conf". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.403901 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/492ba9f3-6479-432b-a2f4-cee712a51800-erlang-cookie-secret" (OuterVolumeSpecName: "erlang-cookie-secret") pod "492ba9f3-6479-432b-a2f4-cee712a51800" (UID: "492ba9f3-6479-432b-a2f4-cee712a51800"). InnerVolumeSpecName "erlang-cookie-secret". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.403944 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/492ba9f3-6479-432b-a2f4-cee712a51800-pod-info" (OuterVolumeSpecName: "pod-info") pod "492ba9f3-6479-432b-a2f4-cee712a51800" (UID: "492ba9f3-6479-432b-a2f4-cee712a51800"). InnerVolumeSpecName "pod-info". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.403998 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/492ba9f3-6479-432b-a2f4-cee712a51800-rabbitmq-tls" (OuterVolumeSpecName: "rabbitmq-tls") pod "492ba9f3-6479-432b-a2f4-cee712a51800" (UID: "492ba9f3-6479-432b-a2f4-cee712a51800"). InnerVolumeSpecName "rabbitmq-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.404048 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/492ba9f3-6479-432b-a2f4-cee712a51800-kube-api-access-l5sck" (OuterVolumeSpecName: "kube-api-access-l5sck") pod "492ba9f3-6479-432b-a2f4-cee712a51800" (UID: "492ba9f3-6479-432b-a2f4-cee712a51800"). InnerVolumeSpecName "kube-api-access-l5sck". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.404317 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/492ba9f3-6479-432b-a2f4-cee712a51800-rabbitmq-erlang-cookie" (OuterVolumeSpecName: "rabbitmq-erlang-cookie") pod "492ba9f3-6479-432b-a2f4-cee712a51800" (UID: "492ba9f3-6479-432b-a2f4-cee712a51800"). InnerVolumeSpecName "rabbitmq-erlang-cookie". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.407866 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage10-crc" (OuterVolumeSpecName: "persistence") pod "492ba9f3-6479-432b-a2f4-cee712a51800" (UID: "492ba9f3-6479-432b-a2f4-cee712a51800"). InnerVolumeSpecName "local-storage10-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.421813 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/492ba9f3-6479-432b-a2f4-cee712a51800-config-data" (OuterVolumeSpecName: "config-data") pod "492ba9f3-6479-432b-a2f4-cee712a51800" (UID: "492ba9f3-6479-432b-a2f4-cee712a51800"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.437892 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/492ba9f3-6479-432b-a2f4-cee712a51800-server-conf" (OuterVolumeSpecName: "server-conf") pod "492ba9f3-6479-432b-a2f4-cee712a51800" (UID: "492ba9f3-6479-432b-a2f4-cee712a51800"). InnerVolumeSpecName "server-conf". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.472807 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/492ba9f3-6479-432b-a2f4-cee712a51800-rabbitmq-confd" (OuterVolumeSpecName: "rabbitmq-confd") pod "492ba9f3-6479-432b-a2f4-cee712a51800" (UID: "492ba9f3-6479-432b-a2f4-cee712a51800"). InnerVolumeSpecName "rabbitmq-confd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.504161 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/492ba9f3-6479-432b-a2f4-cee712a51800-rabbitmq-confd\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.504193 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/492ba9f3-6479-432b-a2f4-cee712a51800-rabbitmq-tls\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.504204 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l5sck\" (UniqueName: \"kubernetes.io/projected/492ba9f3-6479-432b-a2f4-cee712a51800-kube-api-access-l5sck\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.504215 5120 reconciler_common.go:299] "Volume detached for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/492ba9f3-6479-432b-a2f4-cee712a51800-erlang-cookie-secret\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.504223 5120 reconciler_common.go:299] "Volume detached for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/492ba9f3-6479-432b-a2f4-cee712a51800-pod-info\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.504252 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") on node \"crc\" " Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.504260 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/492ba9f3-6479-432b-a2f4-cee712a51800-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.504268 5120 reconciler_common.go:299] "Volume detached for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/492ba9f3-6479-432b-a2f4-cee712a51800-server-conf\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.504276 5120 reconciler_common.go:299] "Volume detached for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/492ba9f3-6479-432b-a2f4-cee712a51800-plugins-conf\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.504285 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/492ba9f3-6479-432b-a2f4-cee712a51800-rabbitmq-erlang-cookie\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.517269 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.521290 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage10-crc" (UniqueName: "kubernetes.io/local-volume/local-storage10-crc") on node "crc" Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.536590 5120 generic.go:358] "Generic (PLEG): container finished" podID="492ba9f3-6479-432b-a2f4-cee712a51800" containerID="b3ca6adfc0432b1a1565a9b61882489441af5da7f78d4fb022760226ebb1dd18" exitCode=0 Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.536952 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.537063 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"492ba9f3-6479-432b-a2f4-cee712a51800","Type":"ContainerDied","Data":"b3ca6adfc0432b1a1565a9b61882489441af5da7f78d4fb022760226ebb1dd18"} Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.537096 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"492ba9f3-6479-432b-a2f4-cee712a51800","Type":"ContainerDied","Data":"c436d6b9a84ab6cf3eb46f7bdcedb0abd392d773c034e32116d7f84745eca689"} Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.537146 5120 scope.go:117] "RemoveContainer" containerID="b3ca6adfc0432b1a1565a9b61882489441af5da7f78d4fb022760226ebb1dd18" Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.539719 5120 generic.go:358] "Generic (PLEG): container finished" podID="57a83a83-de95-43e1-b18c-a7b59c4d1a3b" containerID="a95489c8bbe1e3ef55ce309ffd1d01d5bd0af121804a472f940c85adb881b073" exitCode=0 Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.539966 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-549cb9f7c8-crdfd" event={"ID":"57a83a83-de95-43e1-b18c-a7b59c4d1a3b","Type":"ContainerDied","Data":"a95489c8bbe1e3ef55ce309ffd1d01d5bd0af121804a472f940c85adb881b073"} Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.540086 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-549cb9f7c8-crdfd" event={"ID":"57a83a83-de95-43e1-b18c-a7b59c4d1a3b","Type":"ContainerDied","Data":"a7817308552d782c580ec7ccce6fa580420cfe850787c60c4a62409a46ab1204"} Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.540239 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-549cb9f7c8-crdfd" Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.553398 5120 generic.go:358] "Generic (PLEG): container finished" podID="b6cf92fd-a58b-4b50-9a61-35486c401d72" containerID="8f995598e1e74ed1367783ec0b36f25d55ac74ba4980ad5bce48d0ab5392311e" exitCode=0 Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.553554 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"b6cf92fd-a58b-4b50-9a61-35486c401d72","Type":"ContainerDied","Data":"8f995598e1e74ed1367783ec0b36f25d55ac74ba4980ad5bce48d0ab5392311e"} Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.553632 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"b6cf92fd-a58b-4b50-9a61-35486c401d72","Type":"ContainerDied","Data":"604255d66c1141fe837cf202e2883d42443881438b66d3c6aef9de307be8d409"} Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.553756 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.569929 5120 scope.go:117] "RemoveContainer" containerID="cc516c998df4368da23b745b2b3be8bba3d29335ec841cf7ca6fe843c277d2db" Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.595455 5120 scope.go:117] "RemoveContainer" containerID="b3ca6adfc0432b1a1565a9b61882489441af5da7f78d4fb022760226ebb1dd18" Mar 16 16:00:21 crc kubenswrapper[5120]: E0316 16:00:21.595932 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b3ca6adfc0432b1a1565a9b61882489441af5da7f78d4fb022760226ebb1dd18\": container with ID starting with b3ca6adfc0432b1a1565a9b61882489441af5da7f78d4fb022760226ebb1dd18 not found: ID does not exist" containerID="b3ca6adfc0432b1a1565a9b61882489441af5da7f78d4fb022760226ebb1dd18" Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.595994 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3ca6adfc0432b1a1565a9b61882489441af5da7f78d4fb022760226ebb1dd18"} err="failed to get container status \"b3ca6adfc0432b1a1565a9b61882489441af5da7f78d4fb022760226ebb1dd18\": rpc error: code = NotFound desc = could not find container \"b3ca6adfc0432b1a1565a9b61882489441af5da7f78d4fb022760226ebb1dd18\": container with ID starting with b3ca6adfc0432b1a1565a9b61882489441af5da7f78d4fb022760226ebb1dd18 not found: ID does not exist" Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.596030 5120 scope.go:117] "RemoveContainer" containerID="cc516c998df4368da23b745b2b3be8bba3d29335ec841cf7ca6fe843c277d2db" Mar 16 16:00:21 crc kubenswrapper[5120]: E0316 16:00:21.596289 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc516c998df4368da23b745b2b3be8bba3d29335ec841cf7ca6fe843c277d2db\": container with ID starting with cc516c998df4368da23b745b2b3be8bba3d29335ec841cf7ca6fe843c277d2db not found: ID does not exist" containerID="cc516c998df4368da23b745b2b3be8bba3d29335ec841cf7ca6fe843c277d2db" Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.596329 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc516c998df4368da23b745b2b3be8bba3d29335ec841cf7ca6fe843c277d2db"} err="failed to get container status \"cc516c998df4368da23b745b2b3be8bba3d29335ec841cf7ca6fe843c277d2db\": rpc error: code = NotFound desc = could not find container \"cc516c998df4368da23b745b2b3be8bba3d29335ec841cf7ca6fe843c277d2db\": container with ID starting with cc516c998df4368da23b745b2b3be8bba3d29335ec841cf7ca6fe843c277d2db not found: ID does not exist" Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.596349 5120 scope.go:117] "RemoveContainer" containerID="a95489c8bbe1e3ef55ce309ffd1d01d5bd0af121804a472f940c85adb881b073" Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.596440 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-549cb9f7c8-crdfd"] Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.607077 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-549cb9f7c8-crdfd"] Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.610536 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/b6cf92fd-a58b-4b50-9a61-35486c401d72-rabbitmq-confd\") pod \"b6cf92fd-a58b-4b50-9a61-35486c401d72\" (UID: \"b6cf92fd-a58b-4b50-9a61-35486c401d72\") " Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.610647 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/b6cf92fd-a58b-4b50-9a61-35486c401d72-config-data\") pod \"b6cf92fd-a58b-4b50-9a61-35486c401d72\" (UID: \"b6cf92fd-a58b-4b50-9a61-35486c401d72\") " Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.610680 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/b6cf92fd-a58b-4b50-9a61-35486c401d72-rabbitmq-plugins\") pod \"b6cf92fd-a58b-4b50-9a61-35486c401d72\" (UID: \"b6cf92fd-a58b-4b50-9a61-35486c401d72\") " Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.610731 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/b6cf92fd-a58b-4b50-9a61-35486c401d72-erlang-cookie-secret\") pod \"b6cf92fd-a58b-4b50-9a61-35486c401d72\" (UID: \"b6cf92fd-a58b-4b50-9a61-35486c401d72\") " Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.610848 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/b6cf92fd-a58b-4b50-9a61-35486c401d72-server-conf\") pod \"b6cf92fd-a58b-4b50-9a61-35486c401d72\" (UID: \"b6cf92fd-a58b-4b50-9a61-35486c401d72\") " Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.610875 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/b6cf92fd-a58b-4b50-9a61-35486c401d72-rabbitmq-erlang-cookie\") pod \"b6cf92fd-a58b-4b50-9a61-35486c401d72\" (UID: \"b6cf92fd-a58b-4b50-9a61-35486c401d72\") " Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.612965 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6cf92fd-a58b-4b50-9a61-35486c401d72-rabbitmq-plugins" (OuterVolumeSpecName: "rabbitmq-plugins") pod "b6cf92fd-a58b-4b50-9a61-35486c401d72" (UID: "b6cf92fd-a58b-4b50-9a61-35486c401d72"). InnerVolumeSpecName "rabbitmq-plugins". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.613218 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z2zwh\" (UniqueName: \"kubernetes.io/projected/b6cf92fd-a58b-4b50-9a61-35486c401d72-kube-api-access-z2zwh\") pod \"b6cf92fd-a58b-4b50-9a61-35486c401d72\" (UID: \"b6cf92fd-a58b-4b50-9a61-35486c401d72\") " Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.613278 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/b6cf92fd-a58b-4b50-9a61-35486c401d72-rabbitmq-tls\") pod \"b6cf92fd-a58b-4b50-9a61-35486c401d72\" (UID: \"b6cf92fd-a58b-4b50-9a61-35486c401d72\") " Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.613308 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/b6cf92fd-a58b-4b50-9a61-35486c401d72-pod-info\") pod \"b6cf92fd-a58b-4b50-9a61-35486c401d72\" (UID: \"b6cf92fd-a58b-4b50-9a61-35486c401d72\") " Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.613333 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/b6cf92fd-a58b-4b50-9a61-35486c401d72-plugins-conf\") pod \"b6cf92fd-a58b-4b50-9a61-35486c401d72\" (UID: \"b6cf92fd-a58b-4b50-9a61-35486c401d72\") " Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.613437 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"persistence\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") pod \"b6cf92fd-a58b-4b50-9a61-35486c401d72\" (UID: \"b6cf92fd-a58b-4b50-9a61-35486c401d72\") " Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.614476 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.614504 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/b6cf92fd-a58b-4b50-9a61-35486c401d72-rabbitmq-plugins\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.614935 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b6cf92fd-a58b-4b50-9a61-35486c401d72-plugins-conf" (OuterVolumeSpecName: "plugins-conf") pod "b6cf92fd-a58b-4b50-9a61-35486c401d72" (UID: "b6cf92fd-a58b-4b50-9a61-35486c401d72"). InnerVolumeSpecName "plugins-conf". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.615400 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6cf92fd-a58b-4b50-9a61-35486c401d72-rabbitmq-erlang-cookie" (OuterVolumeSpecName: "rabbitmq-erlang-cookie") pod "b6cf92fd-a58b-4b50-9a61-35486c401d72" (UID: "b6cf92fd-a58b-4b50-9a61-35486c401d72"). InnerVolumeSpecName "rabbitmq-erlang-cookie". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.616059 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.616187 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b6cf92fd-a58b-4b50-9a61-35486c401d72-erlang-cookie-secret" (OuterVolumeSpecName: "erlang-cookie-secret") pod "b6cf92fd-a58b-4b50-9a61-35486c401d72" (UID: "b6cf92fd-a58b-4b50-9a61-35486c401d72"). InnerVolumeSpecName "erlang-cookie-secret". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.617301 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b6cf92fd-a58b-4b50-9a61-35486c401d72-pod-info" (OuterVolumeSpecName: "pod-info") pod "b6cf92fd-a58b-4b50-9a61-35486c401d72" (UID: "b6cf92fd-a58b-4b50-9a61-35486c401d72"). InnerVolumeSpecName "pod-info". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.619527 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage19-crc" (OuterVolumeSpecName: "persistence") pod "b6cf92fd-a58b-4b50-9a61-35486c401d72" (UID: "b6cf92fd-a58b-4b50-9a61-35486c401d72"). InnerVolumeSpecName "local-storage19-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.626921 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6cf92fd-a58b-4b50-9a61-35486c401d72-kube-api-access-z2zwh" (OuterVolumeSpecName: "kube-api-access-z2zwh") pod "b6cf92fd-a58b-4b50-9a61-35486c401d72" (UID: "b6cf92fd-a58b-4b50-9a61-35486c401d72"). InnerVolumeSpecName "kube-api-access-z2zwh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.627189 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6cf92fd-a58b-4b50-9a61-35486c401d72-rabbitmq-tls" (OuterVolumeSpecName: "rabbitmq-tls") pod "b6cf92fd-a58b-4b50-9a61-35486c401d72" (UID: "b6cf92fd-a58b-4b50-9a61-35486c401d72"). InnerVolumeSpecName "rabbitmq-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.634078 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.634772 5120 scope.go:117] "RemoveContainer" containerID="a95489c8bbe1e3ef55ce309ffd1d01d5bd0af121804a472f940c85adb881b073" Mar 16 16:00:21 crc kubenswrapper[5120]: E0316 16:00:21.636703 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a95489c8bbe1e3ef55ce309ffd1d01d5bd0af121804a472f940c85adb881b073\": container with ID starting with a95489c8bbe1e3ef55ce309ffd1d01d5bd0af121804a472f940c85adb881b073 not found: ID does not exist" containerID="a95489c8bbe1e3ef55ce309ffd1d01d5bd0af121804a472f940c85adb881b073" Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.636846 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a95489c8bbe1e3ef55ce309ffd1d01d5bd0af121804a472f940c85adb881b073"} err="failed to get container status \"a95489c8bbe1e3ef55ce309ffd1d01d5bd0af121804a472f940c85adb881b073\": rpc error: code = NotFound desc = could not find container \"a95489c8bbe1e3ef55ce309ffd1d01d5bd0af121804a472f940c85adb881b073\": container with ID starting with a95489c8bbe1e3ef55ce309ffd1d01d5bd0af121804a472f940c85adb881b073 not found: ID does not exist" Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.636965 5120 scope.go:117] "RemoveContainer" containerID="8f995598e1e74ed1367783ec0b36f25d55ac74ba4980ad5bce48d0ab5392311e" Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.668081 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b6cf92fd-a58b-4b50-9a61-35486c401d72-config-data" (OuterVolumeSpecName: "config-data") pod "b6cf92fd-a58b-4b50-9a61-35486c401d72" (UID: "b6cf92fd-a58b-4b50-9a61-35486c401d72"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.682992 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b6cf92fd-a58b-4b50-9a61-35486c401d72-server-conf" (OuterVolumeSpecName: "server-conf") pod "b6cf92fd-a58b-4b50-9a61-35486c401d72" (UID: "b6cf92fd-a58b-4b50-9a61-35486c401d72"). InnerVolumeSpecName "server-conf". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.715744 5120 reconciler_common.go:299] "Volume detached for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/b6cf92fd-a58b-4b50-9a61-35486c401d72-erlang-cookie-secret\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.715783 5120 reconciler_common.go:299] "Volume detached for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/b6cf92fd-a58b-4b50-9a61-35486c401d72-server-conf\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.715794 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/b6cf92fd-a58b-4b50-9a61-35486c401d72-rabbitmq-erlang-cookie\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.715818 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z2zwh\" (UniqueName: \"kubernetes.io/projected/b6cf92fd-a58b-4b50-9a61-35486c401d72-kube-api-access-z2zwh\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.715827 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/b6cf92fd-a58b-4b50-9a61-35486c401d72-rabbitmq-tls\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.715834 5120 reconciler_common.go:299] "Volume detached for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/b6cf92fd-a58b-4b50-9a61-35486c401d72-pod-info\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.715842 5120 reconciler_common.go:299] "Volume detached for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/b6cf92fd-a58b-4b50-9a61-35486c401d72-plugins-conf\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.715875 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage19-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") on node \"crc\" " Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.715884 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/b6cf92fd-a58b-4b50-9a61-35486c401d72-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.727623 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6cf92fd-a58b-4b50-9a61-35486c401d72-rabbitmq-confd" (OuterVolumeSpecName: "rabbitmq-confd") pod "b6cf92fd-a58b-4b50-9a61-35486c401d72" (UID: "b6cf92fd-a58b-4b50-9a61-35486c401d72"). InnerVolumeSpecName "rabbitmq-confd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.731993 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage19-crc" (UniqueName: "kubernetes.io/local-volume/local-storage19-crc") on node "crc" Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.788992 5120 scope.go:117] "RemoveContainer" containerID="dc1ea3d63cb3c9a3449a18594ba679f9478d78eeb79482b58b07bf529b9454bc" Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.817985 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage19-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.818616 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/b6cf92fd-a58b-4b50-9a61-35486c401d72-rabbitmq-confd\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.819224 5120 scope.go:117] "RemoveContainer" containerID="8f995598e1e74ed1367783ec0b36f25d55ac74ba4980ad5bce48d0ab5392311e" Mar 16 16:00:21 crc kubenswrapper[5120]: E0316 16:00:21.819637 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f995598e1e74ed1367783ec0b36f25d55ac74ba4980ad5bce48d0ab5392311e\": container with ID starting with 8f995598e1e74ed1367783ec0b36f25d55ac74ba4980ad5bce48d0ab5392311e not found: ID does not exist" containerID="8f995598e1e74ed1367783ec0b36f25d55ac74ba4980ad5bce48d0ab5392311e" Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.819743 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f995598e1e74ed1367783ec0b36f25d55ac74ba4980ad5bce48d0ab5392311e"} err="failed to get container status \"8f995598e1e74ed1367783ec0b36f25d55ac74ba4980ad5bce48d0ab5392311e\": rpc error: code = NotFound desc = could not find container \"8f995598e1e74ed1367783ec0b36f25d55ac74ba4980ad5bce48d0ab5392311e\": container with ID starting with 8f995598e1e74ed1367783ec0b36f25d55ac74ba4980ad5bce48d0ab5392311e not found: ID does not exist" Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.819860 5120 scope.go:117] "RemoveContainer" containerID="dc1ea3d63cb3c9a3449a18594ba679f9478d78eeb79482b58b07bf529b9454bc" Mar 16 16:00:21 crc kubenswrapper[5120]: E0316 16:00:21.820218 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc1ea3d63cb3c9a3449a18594ba679f9478d78eeb79482b58b07bf529b9454bc\": container with ID starting with dc1ea3d63cb3c9a3449a18594ba679f9478d78eeb79482b58b07bf529b9454bc not found: ID does not exist" containerID="dc1ea3d63cb3c9a3449a18594ba679f9478d78eeb79482b58b07bf529b9454bc" Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.820256 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc1ea3d63cb3c9a3449a18594ba679f9478d78eeb79482b58b07bf529b9454bc"} err="failed to get container status \"dc1ea3d63cb3c9a3449a18594ba679f9478d78eeb79482b58b07bf529b9454bc\": rpc error: code = NotFound desc = could not find container \"dc1ea3d63cb3c9a3449a18594ba679f9478d78eeb79482b58b07bf529b9454bc\": container with ID starting with dc1ea3d63cb3c9a3449a18594ba679f9478d78eeb79482b58b07bf529b9454bc not found: ID does not exist" Mar 16 16:00:21 crc kubenswrapper[5120]: E0316 16:00:21.840468 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="b69196aca7077e660b738179840f4cffce2c72a012a2f8f0a16939792591c08e" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:00:21 crc kubenswrapper[5120]: E0316 16:00:21.841806 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="b69196aca7077e660b738179840f4cffce2c72a012a2f8f0a16939792591c08e" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:00:21 crc kubenswrapper[5120]: E0316 16:00:21.843159 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="b69196aca7077e660b738179840f4cffce2c72a012a2f8f0a16939792591c08e" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:00:21 crc kubenswrapper[5120]: E0316 16:00:21.843221 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="5da6e8f8-fa80-477a-bbf9-0e251dd24153" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.848812 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/swift-proxy-59f58b5b58-tw7qc" podUID="2e562dac-a1db-446c-b73a-21df22608a50" containerName="proxy-server" probeResult="failure" output="Get \"https://10.217.1.24:8080/healthcheck\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.892930 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 16:00:21 crc kubenswrapper[5120]: I0316 16:00:21.902225 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 16:00:22 crc kubenswrapper[5120]: I0316 16:00:22.677281 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="492ba9f3-6479-432b-a2f4-cee712a51800" path="/var/lib/kubelet/pods/492ba9f3-6479-432b-a2f4-cee712a51800/volumes" Mar 16 16:00:22 crc kubenswrapper[5120]: I0316 16:00:22.677962 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="57a83a83-de95-43e1-b18c-a7b59c4d1a3b" path="/var/lib/kubelet/pods/57a83a83-de95-43e1-b18c-a7b59c4d1a3b/volumes" Mar 16 16:00:22 crc kubenswrapper[5120]: I0316 16:00:22.678732 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b6cf92fd-a58b-4b50-9a61-35486c401d72" path="/var/lib/kubelet/pods/b6cf92fd-a58b-4b50-9a61-35486c401d72/volumes" Mar 16 16:00:25 crc kubenswrapper[5120]: I0316 16:00:25.527012 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-mm5p4" Mar 16 16:00:25 crc kubenswrapper[5120]: I0316 16:00:25.606653 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-7b9947885c-scjh2"] Mar 16 16:00:25 crc kubenswrapper[5120]: I0316 16:00:25.607148 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7b9947885c-scjh2" podUID="6f390644-a67b-42f8-b1d7-f8debbfee112" containerName="dnsmasq-dns" containerID="cri-o://d993de8ecb98ba357da568f8cec731cb39fcd9735fc3b28ec60d4545d9c2d57f" gracePeriod=10 Mar 16 16:00:25 crc kubenswrapper[5120]: E0316 16:00:25.863342 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="b2dd99f48a5e6c36c5d9b0bed8c62972ff65efc2c08b8a4c56e6c1ee763db013" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:00:25 crc kubenswrapper[5120]: E0316 16:00:25.865158 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="b2dd99f48a5e6c36c5d9b0bed8c62972ff65efc2c08b8a4c56e6c1ee763db013" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:00:25 crc kubenswrapper[5120]: E0316 16:00:25.871686 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="b2dd99f48a5e6c36c5d9b0bed8c62972ff65efc2c08b8a4c56e6c1ee763db013" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:00:25 crc kubenswrapper[5120]: E0316 16:00:25.871786 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="ca4a5201-32c6-4c58-8bac-4d1b05ddfbb4" containerName="nova-scheduler-scheduler" probeResult="unknown" Mar 16 16:00:25 crc kubenswrapper[5120]: E0316 16:00:25.958742 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="6b9d4e9dc1d3160e9abb2e9af3ed540f0c1e83d09c814ee53e6dfb172f8914f5" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:00:25 crc kubenswrapper[5120]: E0316 16:00:25.960409 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="6b9d4e9dc1d3160e9abb2e9af3ed540f0c1e83d09c814ee53e6dfb172f8914f5" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:00:25 crc kubenswrapper[5120]: E0316 16:00:25.976854 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="6b9d4e9dc1d3160e9abb2e9af3ed540f0c1e83d09c814ee53e6dfb172f8914f5" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:00:25 crc kubenswrapper[5120]: E0316 16:00:25.976926 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="63972b06-4c5e-40e4-a318-8e5f3e286ece" containerName="nova-cell1-conductor-conductor" probeResult="unknown" Mar 16 16:00:26 crc kubenswrapper[5120]: I0316 16:00:26.149941 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7b9947885c-scjh2" Mar 16 16:00:26 crc kubenswrapper[5120]: I0316 16:00:26.307210 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/6f390644-a67b-42f8-b1d7-f8debbfee112-dnsmasq-svc\") pod \"6f390644-a67b-42f8-b1d7-f8debbfee112\" (UID: \"6f390644-a67b-42f8-b1d7-f8debbfee112\") " Mar 16 16:00:26 crc kubenswrapper[5120]: I0316 16:00:26.307481 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/6f390644-a67b-42f8-b1d7-f8debbfee112-dns-swift-storage-0\") pod \"6f390644-a67b-42f8-b1d7-f8debbfee112\" (UID: \"6f390644-a67b-42f8-b1d7-f8debbfee112\") " Mar 16 16:00:26 crc kubenswrapper[5120]: I0316 16:00:26.307628 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6f390644-a67b-42f8-b1d7-f8debbfee112-config\") pod \"6f390644-a67b-42f8-b1d7-f8debbfee112\" (UID: \"6f390644-a67b-42f8-b1d7-f8debbfee112\") " Mar 16 16:00:26 crc kubenswrapper[5120]: I0316 16:00:26.307738 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4thsk\" (UniqueName: \"kubernetes.io/projected/6f390644-a67b-42f8-b1d7-f8debbfee112-kube-api-access-4thsk\") pod \"6f390644-a67b-42f8-b1d7-f8debbfee112\" (UID: \"6f390644-a67b-42f8-b1d7-f8debbfee112\") " Mar 16 16:00:26 crc kubenswrapper[5120]: I0316 16:00:26.313673 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f390644-a67b-42f8-b1d7-f8debbfee112-kube-api-access-4thsk" (OuterVolumeSpecName: "kube-api-access-4thsk") pod "6f390644-a67b-42f8-b1d7-f8debbfee112" (UID: "6f390644-a67b-42f8-b1d7-f8debbfee112"). InnerVolumeSpecName "kube-api-access-4thsk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:00:26 crc kubenswrapper[5120]: I0316 16:00:26.344572 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f390644-a67b-42f8-b1d7-f8debbfee112-config" (OuterVolumeSpecName: "config") pod "6f390644-a67b-42f8-b1d7-f8debbfee112" (UID: "6f390644-a67b-42f8-b1d7-f8debbfee112"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:00:26 crc kubenswrapper[5120]: I0316 16:00:26.350697 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f390644-a67b-42f8-b1d7-f8debbfee112-dns-swift-storage-0" (OuterVolumeSpecName: "dns-swift-storage-0") pod "6f390644-a67b-42f8-b1d7-f8debbfee112" (UID: "6f390644-a67b-42f8-b1d7-f8debbfee112"). InnerVolumeSpecName "dns-swift-storage-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:00:26 crc kubenswrapper[5120]: I0316 16:00:26.353566 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f390644-a67b-42f8-b1d7-f8debbfee112-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "6f390644-a67b-42f8-b1d7-f8debbfee112" (UID: "6f390644-a67b-42f8-b1d7-f8debbfee112"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:00:26 crc kubenswrapper[5120]: I0316 16:00:26.409372 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4thsk\" (UniqueName: \"kubernetes.io/projected/6f390644-a67b-42f8-b1d7-f8debbfee112-kube-api-access-4thsk\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:26 crc kubenswrapper[5120]: I0316 16:00:26.409580 5120 reconciler_common.go:299] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/6f390644-a67b-42f8-b1d7-f8debbfee112-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:26 crc kubenswrapper[5120]: I0316 16:00:26.409667 5120 reconciler_common.go:299] "Volume detached for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/6f390644-a67b-42f8-b1d7-f8debbfee112-dns-swift-storage-0\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:26 crc kubenswrapper[5120]: I0316 16:00:26.409804 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6f390644-a67b-42f8-b1d7-f8debbfee112-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:26 crc kubenswrapper[5120]: I0316 16:00:26.629358 5120 generic.go:358] "Generic (PLEG): container finished" podID="6f390644-a67b-42f8-b1d7-f8debbfee112" containerID="d993de8ecb98ba357da568f8cec731cb39fcd9735fc3b28ec60d4545d9c2d57f" exitCode=0 Mar 16 16:00:26 crc kubenswrapper[5120]: I0316 16:00:26.631233 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7b9947885c-scjh2" event={"ID":"6f390644-a67b-42f8-b1d7-f8debbfee112","Type":"ContainerDied","Data":"d993de8ecb98ba357da568f8cec731cb39fcd9735fc3b28ec60d4545d9c2d57f"} Mar 16 16:00:26 crc kubenswrapper[5120]: I0316 16:00:26.631440 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7b9947885c-scjh2" event={"ID":"6f390644-a67b-42f8-b1d7-f8debbfee112","Type":"ContainerDied","Data":"9340b23ed24b723a3487d00a2ad97cc8198ce2ca9a0a5ac27f83e6abaafc0be7"} Mar 16 16:00:26 crc kubenswrapper[5120]: I0316 16:00:26.631472 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7b9947885c-scjh2" Mar 16 16:00:26 crc kubenswrapper[5120]: I0316 16:00:26.631506 5120 scope.go:117] "RemoveContainer" containerID="d993de8ecb98ba357da568f8cec731cb39fcd9735fc3b28ec60d4545d9c2d57f" Mar 16 16:00:26 crc kubenswrapper[5120]: I0316 16:00:26.661042 5120 scope.go:117] "RemoveContainer" containerID="966fdbcd3512beb83f3e2b385987833e1f291d6c095ef6d61aef3795706c6627" Mar 16 16:00:26 crc kubenswrapper[5120]: I0316 16:00:26.682775 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-7b9947885c-scjh2"] Mar 16 16:00:26 crc kubenswrapper[5120]: I0316 16:00:26.690076 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-7b9947885c-scjh2"] Mar 16 16:00:26 crc kubenswrapper[5120]: I0316 16:00:26.700246 5120 scope.go:117] "RemoveContainer" containerID="d993de8ecb98ba357da568f8cec731cb39fcd9735fc3b28ec60d4545d9c2d57f" Mar 16 16:00:26 crc kubenswrapper[5120]: E0316 16:00:26.700677 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d993de8ecb98ba357da568f8cec731cb39fcd9735fc3b28ec60d4545d9c2d57f\": container with ID starting with d993de8ecb98ba357da568f8cec731cb39fcd9735fc3b28ec60d4545d9c2d57f not found: ID does not exist" containerID="d993de8ecb98ba357da568f8cec731cb39fcd9735fc3b28ec60d4545d9c2d57f" Mar 16 16:00:26 crc kubenswrapper[5120]: I0316 16:00:26.700712 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d993de8ecb98ba357da568f8cec731cb39fcd9735fc3b28ec60d4545d9c2d57f"} err="failed to get container status \"d993de8ecb98ba357da568f8cec731cb39fcd9735fc3b28ec60d4545d9c2d57f\": rpc error: code = NotFound desc = could not find container \"d993de8ecb98ba357da568f8cec731cb39fcd9735fc3b28ec60d4545d9c2d57f\": container with ID starting with d993de8ecb98ba357da568f8cec731cb39fcd9735fc3b28ec60d4545d9c2d57f not found: ID does not exist" Mar 16 16:00:26 crc kubenswrapper[5120]: I0316 16:00:26.700737 5120 scope.go:117] "RemoveContainer" containerID="966fdbcd3512beb83f3e2b385987833e1f291d6c095ef6d61aef3795706c6627" Mar 16 16:00:26 crc kubenswrapper[5120]: E0316 16:00:26.701003 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"966fdbcd3512beb83f3e2b385987833e1f291d6c095ef6d61aef3795706c6627\": container with ID starting with 966fdbcd3512beb83f3e2b385987833e1f291d6c095ef6d61aef3795706c6627 not found: ID does not exist" containerID="966fdbcd3512beb83f3e2b385987833e1f291d6c095ef6d61aef3795706c6627" Mar 16 16:00:26 crc kubenswrapper[5120]: I0316 16:00:26.701025 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"966fdbcd3512beb83f3e2b385987833e1f291d6c095ef6d61aef3795706c6627"} err="failed to get container status \"966fdbcd3512beb83f3e2b385987833e1f291d6c095ef6d61aef3795706c6627\": rpc error: code = NotFound desc = could not find container \"966fdbcd3512beb83f3e2b385987833e1f291d6c095ef6d61aef3795706c6627\": container with ID starting with 966fdbcd3512beb83f3e2b385987833e1f291d6c095ef6d61aef3795706c6627 not found: ID does not exist" Mar 16 16:00:26 crc kubenswrapper[5120]: E0316 16:00:26.842094 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="b69196aca7077e660b738179840f4cffce2c72a012a2f8f0a16939792591c08e" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:00:26 crc kubenswrapper[5120]: E0316 16:00:26.843541 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="b69196aca7077e660b738179840f4cffce2c72a012a2f8f0a16939792591c08e" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:00:26 crc kubenswrapper[5120]: E0316 16:00:26.844625 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="b69196aca7077e660b738179840f4cffce2c72a012a2f8f0a16939792591c08e" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:00:26 crc kubenswrapper[5120]: E0316 16:00:26.844721 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="5da6e8f8-fa80-477a-bbf9-0e251dd24153" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 16:00:28 crc kubenswrapper[5120]: I0316 16:00:28.676878 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f390644-a67b-42f8-b1d7-f8debbfee112" path="/var/lib/kubelet/pods/6f390644-a67b-42f8-b1d7-f8debbfee112/volumes" Mar 16 16:00:29 crc kubenswrapper[5120]: I0316 16:00:29.004127 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/neutron-5477dfc7d6-r85w6" podUID="65f5015a-d673-4a1d-bd09-c695f2b41a47" containerName="neutron-httpd" probeResult="failure" output="Get \"https://10.217.1.9:9696/\": dial tcp 10.217.1.9:9696: connect: connection refused" Mar 16 16:00:29 crc kubenswrapper[5120]: I0316 16:00:29.417952 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/ceilometer-0" podUID="1d8cf310-88d2-4a5c-a2d9-2807cd409f37" containerName="proxy-httpd" probeResult="failure" output="Get \"https://10.217.1.63:3000/\": dial tcp 10.217.1.63:3000: connect: connection refused" Mar 16 16:00:30 crc kubenswrapper[5120]: E0316 16:00:30.864741 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="b2dd99f48a5e6c36c5d9b0bed8c62972ff65efc2c08b8a4c56e6c1ee763db013" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:00:30 crc kubenswrapper[5120]: E0316 16:00:30.868099 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="b2dd99f48a5e6c36c5d9b0bed8c62972ff65efc2c08b8a4c56e6c1ee763db013" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:00:30 crc kubenswrapper[5120]: E0316 16:00:30.869944 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="b2dd99f48a5e6c36c5d9b0bed8c62972ff65efc2c08b8a4c56e6c1ee763db013" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:00:30 crc kubenswrapper[5120]: E0316 16:00:30.870115 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="ca4a5201-32c6-4c58-8bac-4d1b05ddfbb4" containerName="nova-scheduler-scheduler" probeResult="unknown" Mar 16 16:00:30 crc kubenswrapper[5120]: I0316 16:00:30.915612 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7b9947885c-scjh2" podUID="6f390644-a67b-42f8-b1d7-f8debbfee112" containerName="dnsmasq-dns" probeResult="failure" output="dial tcp 10.217.0.237:5353: i/o timeout" Mar 16 16:00:30 crc kubenswrapper[5120]: E0316 16:00:30.943817 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="6b9d4e9dc1d3160e9abb2e9af3ed540f0c1e83d09c814ee53e6dfb172f8914f5" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:00:30 crc kubenswrapper[5120]: E0316 16:00:30.945341 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="6b9d4e9dc1d3160e9abb2e9af3ed540f0c1e83d09c814ee53e6dfb172f8914f5" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:00:30 crc kubenswrapper[5120]: E0316 16:00:30.946468 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="6b9d4e9dc1d3160e9abb2e9af3ed540f0c1e83d09c814ee53e6dfb172f8914f5" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:00:30 crc kubenswrapper[5120]: E0316 16:00:30.946506 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="63972b06-4c5e-40e4-a318-8e5f3e286ece" containerName="nova-cell1-conductor-conductor" probeResult="unknown" Mar 16 16:00:31 crc kubenswrapper[5120]: I0316 16:00:31.665067 5120 scope.go:117] "RemoveContainer" containerID="02ba4fc3f84eccaecfa9e6618280f65626eb76580c4af9ae7a9d7cb3b8dd590b" Mar 16 16:00:31 crc kubenswrapper[5120]: E0316 16:00:31.665545 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:00:31 crc kubenswrapper[5120]: E0316 16:00:31.841254 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="b69196aca7077e660b738179840f4cffce2c72a012a2f8f0a16939792591c08e" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:00:31 crc kubenswrapper[5120]: E0316 16:00:31.842843 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="b69196aca7077e660b738179840f4cffce2c72a012a2f8f0a16939792591c08e" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:00:31 crc kubenswrapper[5120]: E0316 16:00:31.844166 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="b69196aca7077e660b738179840f4cffce2c72a012a2f8f0a16939792591c08e" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:00:31 crc kubenswrapper[5120]: E0316 16:00:31.844286 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="5da6e8f8-fa80-477a-bbf9-0e251dd24153" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 16:00:35 crc kubenswrapper[5120]: E0316 16:00:35.863198 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="b2dd99f48a5e6c36c5d9b0bed8c62972ff65efc2c08b8a4c56e6c1ee763db013" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:00:35 crc kubenswrapper[5120]: E0316 16:00:35.865138 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="b2dd99f48a5e6c36c5d9b0bed8c62972ff65efc2c08b8a4c56e6c1ee763db013" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:00:35 crc kubenswrapper[5120]: E0316 16:00:35.867013 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="b2dd99f48a5e6c36c5d9b0bed8c62972ff65efc2c08b8a4c56e6c1ee763db013" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:00:35 crc kubenswrapper[5120]: E0316 16:00:35.867053 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="ca4a5201-32c6-4c58-8bac-4d1b05ddfbb4" containerName="nova-scheduler-scheduler" probeResult="unknown" Mar 16 16:00:35 crc kubenswrapper[5120]: E0316 16:00:35.944542 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="6b9d4e9dc1d3160e9abb2e9af3ed540f0c1e83d09c814ee53e6dfb172f8914f5" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:00:35 crc kubenswrapper[5120]: E0316 16:00:35.946954 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="6b9d4e9dc1d3160e9abb2e9af3ed540f0c1e83d09c814ee53e6dfb172f8914f5" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:00:35 crc kubenswrapper[5120]: E0316 16:00:35.948615 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="6b9d4e9dc1d3160e9abb2e9af3ed540f0c1e83d09c814ee53e6dfb172f8914f5" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:00:35 crc kubenswrapper[5120]: E0316 16:00:35.948651 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="63972b06-4c5e-40e4-a318-8e5f3e286ece" containerName="nova-cell1-conductor-conductor" probeResult="unknown" Mar 16 16:00:36 crc kubenswrapper[5120]: E0316 16:00:36.841403 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="b69196aca7077e660b738179840f4cffce2c72a012a2f8f0a16939792591c08e" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:00:36 crc kubenswrapper[5120]: E0316 16:00:36.843864 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="b69196aca7077e660b738179840f4cffce2c72a012a2f8f0a16939792591c08e" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:00:36 crc kubenswrapper[5120]: E0316 16:00:36.845564 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="b69196aca7077e660b738179840f4cffce2c72a012a2f8f0a16939792591c08e" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:00:36 crc kubenswrapper[5120]: E0316 16:00:36.845626 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="5da6e8f8-fa80-477a-bbf9-0e251dd24153" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 16:00:40 crc kubenswrapper[5120]: E0316 16:00:40.864200 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="b2dd99f48a5e6c36c5d9b0bed8c62972ff65efc2c08b8a4c56e6c1ee763db013" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:00:40 crc kubenswrapper[5120]: E0316 16:00:40.866893 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="b2dd99f48a5e6c36c5d9b0bed8c62972ff65efc2c08b8a4c56e6c1ee763db013" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:00:40 crc kubenswrapper[5120]: E0316 16:00:40.868528 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="b2dd99f48a5e6c36c5d9b0bed8c62972ff65efc2c08b8a4c56e6c1ee763db013" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:00:40 crc kubenswrapper[5120]: E0316 16:00:40.868569 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="ca4a5201-32c6-4c58-8bac-4d1b05ddfbb4" containerName="nova-scheduler-scheduler" probeResult="unknown" Mar 16 16:00:40 crc kubenswrapper[5120]: E0316 16:00:40.945536 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="6b9d4e9dc1d3160e9abb2e9af3ed540f0c1e83d09c814ee53e6dfb172f8914f5" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:00:40 crc kubenswrapper[5120]: E0316 16:00:40.947064 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="6b9d4e9dc1d3160e9abb2e9af3ed540f0c1e83d09c814ee53e6dfb172f8914f5" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:00:40 crc kubenswrapper[5120]: E0316 16:00:40.948894 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="6b9d4e9dc1d3160e9abb2e9af3ed540f0c1e83d09c814ee53e6dfb172f8914f5" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:00:40 crc kubenswrapper[5120]: E0316 16:00:40.948948 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="63972b06-4c5e-40e4-a318-8e5f3e286ece" containerName="nova-cell1-conductor-conductor" probeResult="unknown" Mar 16 16:00:41 crc kubenswrapper[5120]: E0316 16:00:41.841142 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="b69196aca7077e660b738179840f4cffce2c72a012a2f8f0a16939792591c08e" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:00:41 crc kubenswrapper[5120]: E0316 16:00:41.843244 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="b69196aca7077e660b738179840f4cffce2c72a012a2f8f0a16939792591c08e" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:00:41 crc kubenswrapper[5120]: E0316 16:00:41.845676 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="b69196aca7077e660b738179840f4cffce2c72a012a2f8f0a16939792591c08e" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:00:41 crc kubenswrapper[5120]: E0316 16:00:41.845977 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="5da6e8f8-fa80-477a-bbf9-0e251dd24153" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 16:00:42 crc kubenswrapper[5120]: I0316 16:00:42.665938 5120 scope.go:117] "RemoveContainer" containerID="02ba4fc3f84eccaecfa9e6618280f65626eb76580c4af9ae7a9d7cb3b8dd590b" Mar 16 16:00:42 crc kubenswrapper[5120]: E0316 16:00:42.667593 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:00:43 crc kubenswrapper[5120]: I0316 16:00:43.827504 5120 generic.go:358] "Generic (PLEG): container finished" podID="f80a9ef7-32f9-44c7-945c-d1ee96105c42" containerID="b6bb33f699db1e8b2ee47f375490efe9554f49f146ae7d1e564beba920058e1b" exitCode=137 Mar 16 16:00:43 crc kubenswrapper[5120]: I0316 16:00:43.827556 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"f80a9ef7-32f9-44c7-945c-d1ee96105c42","Type":"ContainerDied","Data":"b6bb33f699db1e8b2ee47f375490efe9554f49f146ae7d1e564beba920058e1b"} Mar 16 16:00:44 crc kubenswrapper[5120]: I0316 16:00:44.091808 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:00:44 crc kubenswrapper[5120]: I0316 16:00:44.169105 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f80a9ef7-32f9-44c7-945c-d1ee96105c42-config-data\") pod \"f80a9ef7-32f9-44c7-945c-d1ee96105c42\" (UID: \"f80a9ef7-32f9-44c7-945c-d1ee96105c42\") " Mar 16 16:00:44 crc kubenswrapper[5120]: I0316 16:00:44.169137 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/f80a9ef7-32f9-44c7-945c-d1ee96105c42-etc-machine-id\") pod \"f80a9ef7-32f9-44c7-945c-d1ee96105c42\" (UID: \"f80a9ef7-32f9-44c7-945c-d1ee96105c42\") " Mar 16 16:00:44 crc kubenswrapper[5120]: I0316 16:00:44.169212 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xpcts\" (UniqueName: \"kubernetes.io/projected/f80a9ef7-32f9-44c7-945c-d1ee96105c42-kube-api-access-xpcts\") pod \"f80a9ef7-32f9-44c7-945c-d1ee96105c42\" (UID: \"f80a9ef7-32f9-44c7-945c-d1ee96105c42\") " Mar 16 16:00:44 crc kubenswrapper[5120]: I0316 16:00:44.169265 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f80a9ef7-32f9-44c7-945c-d1ee96105c42-combined-ca-bundle\") pod \"f80a9ef7-32f9-44c7-945c-d1ee96105c42\" (UID: \"f80a9ef7-32f9-44c7-945c-d1ee96105c42\") " Mar 16 16:00:44 crc kubenswrapper[5120]: I0316 16:00:44.169306 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/f80a9ef7-32f9-44c7-945c-d1ee96105c42-config-data-custom\") pod \"f80a9ef7-32f9-44c7-945c-d1ee96105c42\" (UID: \"f80a9ef7-32f9-44c7-945c-d1ee96105c42\") " Mar 16 16:00:44 crc kubenswrapper[5120]: I0316 16:00:44.169311 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/f80a9ef7-32f9-44c7-945c-d1ee96105c42-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "f80a9ef7-32f9-44c7-945c-d1ee96105c42" (UID: "f80a9ef7-32f9-44c7-945c-d1ee96105c42"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 16:00:44 crc kubenswrapper[5120]: I0316 16:00:44.169398 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f80a9ef7-32f9-44c7-945c-d1ee96105c42-scripts\") pod \"f80a9ef7-32f9-44c7-945c-d1ee96105c42\" (UID: \"f80a9ef7-32f9-44c7-945c-d1ee96105c42\") " Mar 16 16:00:44 crc kubenswrapper[5120]: I0316 16:00:44.169834 5120 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/f80a9ef7-32f9-44c7-945c-d1ee96105c42-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:44 crc kubenswrapper[5120]: I0316 16:00:44.175627 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f80a9ef7-32f9-44c7-945c-d1ee96105c42-kube-api-access-xpcts" (OuterVolumeSpecName: "kube-api-access-xpcts") pod "f80a9ef7-32f9-44c7-945c-d1ee96105c42" (UID: "f80a9ef7-32f9-44c7-945c-d1ee96105c42"). InnerVolumeSpecName "kube-api-access-xpcts". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:00:44 crc kubenswrapper[5120]: I0316 16:00:44.175967 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f80a9ef7-32f9-44c7-945c-d1ee96105c42-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "f80a9ef7-32f9-44c7-945c-d1ee96105c42" (UID: "f80a9ef7-32f9-44c7-945c-d1ee96105c42"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:00:44 crc kubenswrapper[5120]: I0316 16:00:44.189916 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f80a9ef7-32f9-44c7-945c-d1ee96105c42-scripts" (OuterVolumeSpecName: "scripts") pod "f80a9ef7-32f9-44c7-945c-d1ee96105c42" (UID: "f80a9ef7-32f9-44c7-945c-d1ee96105c42"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:00:44 crc kubenswrapper[5120]: I0316 16:00:44.232935 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f80a9ef7-32f9-44c7-945c-d1ee96105c42-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f80a9ef7-32f9-44c7-945c-d1ee96105c42" (UID: "f80a9ef7-32f9-44c7-945c-d1ee96105c42"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:00:44 crc kubenswrapper[5120]: I0316 16:00:44.264443 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f80a9ef7-32f9-44c7-945c-d1ee96105c42-config-data" (OuterVolumeSpecName: "config-data") pod "f80a9ef7-32f9-44c7-945c-d1ee96105c42" (UID: "f80a9ef7-32f9-44c7-945c-d1ee96105c42"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:00:44 crc kubenswrapper[5120]: I0316 16:00:44.271747 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f80a9ef7-32f9-44c7-945c-d1ee96105c42-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:44 crc kubenswrapper[5120]: I0316 16:00:44.271831 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xpcts\" (UniqueName: \"kubernetes.io/projected/f80a9ef7-32f9-44c7-945c-d1ee96105c42-kube-api-access-xpcts\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:44 crc kubenswrapper[5120]: I0316 16:00:44.271843 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f80a9ef7-32f9-44c7-945c-d1ee96105c42-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:44 crc kubenswrapper[5120]: I0316 16:00:44.271851 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/f80a9ef7-32f9-44c7-945c-d1ee96105c42-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:44 crc kubenswrapper[5120]: I0316 16:00:44.271870 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f80a9ef7-32f9-44c7-945c-d1ee96105c42-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:44 crc kubenswrapper[5120]: I0316 16:00:44.351153 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:00:44 crc kubenswrapper[5120]: I0316 16:00:44.372540 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/725b915c-7c39-43e6-8022-99dd14a6276e-etc-swift\") pod \"725b915c-7c39-43e6-8022-99dd14a6276e\" (UID: \"725b915c-7c39-43e6-8022-99dd14a6276e\") " Mar 16 16:00:44 crc kubenswrapper[5120]: I0316 16:00:44.372710 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/725b915c-7c39-43e6-8022-99dd14a6276e-combined-ca-bundle\") pod \"725b915c-7c39-43e6-8022-99dd14a6276e\" (UID: \"725b915c-7c39-43e6-8022-99dd14a6276e\") " Mar 16 16:00:44 crc kubenswrapper[5120]: I0316 16:00:44.372747 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/725b915c-7c39-43e6-8022-99dd14a6276e-cache\") pod \"725b915c-7c39-43e6-8022-99dd14a6276e\" (UID: \"725b915c-7c39-43e6-8022-99dd14a6276e\") " Mar 16 16:00:44 crc kubenswrapper[5120]: I0316 16:00:44.372817 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"swift\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") pod \"725b915c-7c39-43e6-8022-99dd14a6276e\" (UID: \"725b915c-7c39-43e6-8022-99dd14a6276e\") " Mar 16 16:00:44 crc kubenswrapper[5120]: I0316 16:00:44.372911 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lb8mj\" (UniqueName: \"kubernetes.io/projected/725b915c-7c39-43e6-8022-99dd14a6276e-kube-api-access-lb8mj\") pod \"725b915c-7c39-43e6-8022-99dd14a6276e\" (UID: \"725b915c-7c39-43e6-8022-99dd14a6276e\") " Mar 16 16:00:44 crc kubenswrapper[5120]: I0316 16:00:44.372941 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/725b915c-7c39-43e6-8022-99dd14a6276e-lock\") pod \"725b915c-7c39-43e6-8022-99dd14a6276e\" (UID: \"725b915c-7c39-43e6-8022-99dd14a6276e\") " Mar 16 16:00:44 crc kubenswrapper[5120]: I0316 16:00:44.374164 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/725b915c-7c39-43e6-8022-99dd14a6276e-cache" (OuterVolumeSpecName: "cache") pod "725b915c-7c39-43e6-8022-99dd14a6276e" (UID: "725b915c-7c39-43e6-8022-99dd14a6276e"). InnerVolumeSpecName "cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:00:44 crc kubenswrapper[5120]: I0316 16:00:44.377097 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/725b915c-7c39-43e6-8022-99dd14a6276e-etc-swift" (OuterVolumeSpecName: "etc-swift") pod "725b915c-7c39-43e6-8022-99dd14a6276e" (UID: "725b915c-7c39-43e6-8022-99dd14a6276e"). InnerVolumeSpecName "etc-swift". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:00:44 crc kubenswrapper[5120]: I0316 16:00:44.379209 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage07-crc" (OuterVolumeSpecName: "swift") pod "725b915c-7c39-43e6-8022-99dd14a6276e" (UID: "725b915c-7c39-43e6-8022-99dd14a6276e"). InnerVolumeSpecName "local-storage07-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:00:44 crc kubenswrapper[5120]: I0316 16:00:44.380010 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/725b915c-7c39-43e6-8022-99dd14a6276e-lock" (OuterVolumeSpecName: "lock") pod "725b915c-7c39-43e6-8022-99dd14a6276e" (UID: "725b915c-7c39-43e6-8022-99dd14a6276e"). InnerVolumeSpecName "lock". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:00:44 crc kubenswrapper[5120]: I0316 16:00:44.382983 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/725b915c-7c39-43e6-8022-99dd14a6276e-kube-api-access-lb8mj" (OuterVolumeSpecName: "kube-api-access-lb8mj") pod "725b915c-7c39-43e6-8022-99dd14a6276e" (UID: "725b915c-7c39-43e6-8022-99dd14a6276e"). InnerVolumeSpecName "kube-api-access-lb8mj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:00:44 crc kubenswrapper[5120]: I0316 16:00:44.474804 5120 reconciler_common.go:299] "Volume detached for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/725b915c-7c39-43e6-8022-99dd14a6276e-cache\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:44 crc kubenswrapper[5120]: I0316 16:00:44.475128 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage07-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") on node \"crc\" " Mar 16 16:00:44 crc kubenswrapper[5120]: I0316 16:00:44.475145 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lb8mj\" (UniqueName: \"kubernetes.io/projected/725b915c-7c39-43e6-8022-99dd14a6276e-kube-api-access-lb8mj\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:44 crc kubenswrapper[5120]: I0316 16:00:44.475159 5120 reconciler_common.go:299] "Volume detached for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/725b915c-7c39-43e6-8022-99dd14a6276e-lock\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:44 crc kubenswrapper[5120]: I0316 16:00:44.475171 5120 reconciler_common.go:299] "Volume detached for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/725b915c-7c39-43e6-8022-99dd14a6276e-etc-swift\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:44 crc kubenswrapper[5120]: I0316 16:00:44.489593 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage07-crc" (UniqueName: "kubernetes.io/local-volume/local-storage07-crc") on node "crc" Mar 16 16:00:44 crc kubenswrapper[5120]: I0316 16:00:44.576367 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage07-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:44 crc kubenswrapper[5120]: I0316 16:00:44.607578 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-5477dfc7d6-r85w6_65f5015a-d673-4a1d-bd09-c695f2b41a47/neutron-api/0.log" Mar 16 16:00:44 crc kubenswrapper[5120]: I0316 16:00:44.607680 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-5477dfc7d6-r85w6" Mar 16 16:00:44 crc kubenswrapper[5120]: I0316 16:00:44.656638 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/725b915c-7c39-43e6-8022-99dd14a6276e-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "725b915c-7c39-43e6-8022-99dd14a6276e" (UID: "725b915c-7c39-43e6-8022-99dd14a6276e"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:00:44 crc kubenswrapper[5120]: I0316 16:00:44.679769 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/65f5015a-d673-4a1d-bd09-c695f2b41a47-internal-tls-certs\") pod \"65f5015a-d673-4a1d-bd09-c695f2b41a47\" (UID: \"65f5015a-d673-4a1d-bd09-c695f2b41a47\") " Mar 16 16:00:44 crc kubenswrapper[5120]: I0316 16:00:44.679893 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/65f5015a-d673-4a1d-bd09-c695f2b41a47-config\") pod \"65f5015a-d673-4a1d-bd09-c695f2b41a47\" (UID: \"65f5015a-d673-4a1d-bd09-c695f2b41a47\") " Mar 16 16:00:44 crc kubenswrapper[5120]: I0316 16:00:44.679987 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lfmfh\" (UniqueName: \"kubernetes.io/projected/65f5015a-d673-4a1d-bd09-c695f2b41a47-kube-api-access-lfmfh\") pod \"65f5015a-d673-4a1d-bd09-c695f2b41a47\" (UID: \"65f5015a-d673-4a1d-bd09-c695f2b41a47\") " Mar 16 16:00:44 crc kubenswrapper[5120]: I0316 16:00:44.680032 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/65f5015a-d673-4a1d-bd09-c695f2b41a47-combined-ca-bundle\") pod \"65f5015a-d673-4a1d-bd09-c695f2b41a47\" (UID: \"65f5015a-d673-4a1d-bd09-c695f2b41a47\") " Mar 16 16:00:44 crc kubenswrapper[5120]: I0316 16:00:44.680134 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/65f5015a-d673-4a1d-bd09-c695f2b41a47-ovndb-tls-certs\") pod \"65f5015a-d673-4a1d-bd09-c695f2b41a47\" (UID: \"65f5015a-d673-4a1d-bd09-c695f2b41a47\") " Mar 16 16:00:44 crc kubenswrapper[5120]: I0316 16:00:44.680214 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/65f5015a-d673-4a1d-bd09-c695f2b41a47-public-tls-certs\") pod \"65f5015a-d673-4a1d-bd09-c695f2b41a47\" (UID: \"65f5015a-d673-4a1d-bd09-c695f2b41a47\") " Mar 16 16:00:44 crc kubenswrapper[5120]: I0316 16:00:44.680272 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/65f5015a-d673-4a1d-bd09-c695f2b41a47-httpd-config\") pod \"65f5015a-d673-4a1d-bd09-c695f2b41a47\" (UID: \"65f5015a-d673-4a1d-bd09-c695f2b41a47\") " Mar 16 16:00:44 crc kubenswrapper[5120]: I0316 16:00:44.681367 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/725b915c-7c39-43e6-8022-99dd14a6276e-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:44 crc kubenswrapper[5120]: I0316 16:00:44.684869 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/65f5015a-d673-4a1d-bd09-c695f2b41a47-httpd-config" (OuterVolumeSpecName: "httpd-config") pod "65f5015a-d673-4a1d-bd09-c695f2b41a47" (UID: "65f5015a-d673-4a1d-bd09-c695f2b41a47"). InnerVolumeSpecName "httpd-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:00:44 crc kubenswrapper[5120]: I0316 16:00:44.692506 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65f5015a-d673-4a1d-bd09-c695f2b41a47-kube-api-access-lfmfh" (OuterVolumeSpecName: "kube-api-access-lfmfh") pod "65f5015a-d673-4a1d-bd09-c695f2b41a47" (UID: "65f5015a-d673-4a1d-bd09-c695f2b41a47"). InnerVolumeSpecName "kube-api-access-lfmfh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:00:44 crc kubenswrapper[5120]: I0316 16:00:44.738811 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/65f5015a-d673-4a1d-bd09-c695f2b41a47-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "65f5015a-d673-4a1d-bd09-c695f2b41a47" (UID: "65f5015a-d673-4a1d-bd09-c695f2b41a47"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:00:44 crc kubenswrapper[5120]: I0316 16:00:44.747142 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/65f5015a-d673-4a1d-bd09-c695f2b41a47-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "65f5015a-d673-4a1d-bd09-c695f2b41a47" (UID: "65f5015a-d673-4a1d-bd09-c695f2b41a47"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:00:44 crc kubenswrapper[5120]: I0316 16:00:44.748177 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/65f5015a-d673-4a1d-bd09-c695f2b41a47-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "65f5015a-d673-4a1d-bd09-c695f2b41a47" (UID: "65f5015a-d673-4a1d-bd09-c695f2b41a47"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:00:44 crc kubenswrapper[5120]: I0316 16:00:44.753109 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/65f5015a-d673-4a1d-bd09-c695f2b41a47-config" (OuterVolumeSpecName: "config") pod "65f5015a-d673-4a1d-bd09-c695f2b41a47" (UID: "65f5015a-d673-4a1d-bd09-c695f2b41a47"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:00:44 crc kubenswrapper[5120]: I0316 16:00:44.761959 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/65f5015a-d673-4a1d-bd09-c695f2b41a47-ovndb-tls-certs" (OuterVolumeSpecName: "ovndb-tls-certs") pod "65f5015a-d673-4a1d-bd09-c695f2b41a47" (UID: "65f5015a-d673-4a1d-bd09-c695f2b41a47"). InnerVolumeSpecName "ovndb-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:00:44 crc kubenswrapper[5120]: I0316 16:00:44.783522 5120 reconciler_common.go:299] "Volume detached for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/65f5015a-d673-4a1d-bd09-c695f2b41a47-ovndb-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:44 crc kubenswrapper[5120]: I0316 16:00:44.783558 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/65f5015a-d673-4a1d-bd09-c695f2b41a47-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:44 crc kubenswrapper[5120]: I0316 16:00:44.783568 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/65f5015a-d673-4a1d-bd09-c695f2b41a47-httpd-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:44 crc kubenswrapper[5120]: I0316 16:00:44.783576 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/65f5015a-d673-4a1d-bd09-c695f2b41a47-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:44 crc kubenswrapper[5120]: I0316 16:00:44.783584 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/65f5015a-d673-4a1d-bd09-c695f2b41a47-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:44 crc kubenswrapper[5120]: I0316 16:00:44.783593 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lfmfh\" (UniqueName: \"kubernetes.io/projected/65f5015a-d673-4a1d-bd09-c695f2b41a47-kube-api-access-lfmfh\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:44 crc kubenswrapper[5120]: I0316 16:00:44.783606 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/65f5015a-d673-4a1d-bd09-c695f2b41a47-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:44 crc kubenswrapper[5120]: I0316 16:00:44.839669 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"f80a9ef7-32f9-44c7-945c-d1ee96105c42","Type":"ContainerDied","Data":"5bcca1b13d128807b98c5d88e7a375c55ae9225780d937962254884f3eb4c397"} Mar 16 16:00:44 crc kubenswrapper[5120]: I0316 16:00:44.839694 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:00:44 crc kubenswrapper[5120]: I0316 16:00:44.839778 5120 scope.go:117] "RemoveContainer" containerID="a8cc11b8ec51275761948543ede5d0db634e37eb551775e3622e1ea5aad55325" Mar 16 16:00:44 crc kubenswrapper[5120]: I0316 16:00:44.842261 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-5477dfc7d6-r85w6_65f5015a-d673-4a1d-bd09-c695f2b41a47/neutron-api/0.log" Mar 16 16:00:44 crc kubenswrapper[5120]: I0316 16:00:44.842325 5120 generic.go:358] "Generic (PLEG): container finished" podID="65f5015a-d673-4a1d-bd09-c695f2b41a47" containerID="4b60d781e4c4d04ce9cd5e3a15fb61c49894b5654ae98b63df546451d7ab3a2c" exitCode=137 Mar 16 16:00:44 crc kubenswrapper[5120]: I0316 16:00:44.842453 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-5477dfc7d6-r85w6" event={"ID":"65f5015a-d673-4a1d-bd09-c695f2b41a47","Type":"ContainerDied","Data":"4b60d781e4c4d04ce9cd5e3a15fb61c49894b5654ae98b63df546451d7ab3a2c"} Mar 16 16:00:44 crc kubenswrapper[5120]: I0316 16:00:44.842505 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-5477dfc7d6-r85w6" event={"ID":"65f5015a-d673-4a1d-bd09-c695f2b41a47","Type":"ContainerDied","Data":"aaec780d5e27580b2a9a8541a569d8b77f322a8a08d21cf955833816e8b4999e"} Mar 16 16:00:44 crc kubenswrapper[5120]: I0316 16:00:44.842588 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-5477dfc7d6-r85w6" Mar 16 16:00:44 crc kubenswrapper[5120]: I0316 16:00:44.855339 5120 generic.go:358] "Generic (PLEG): container finished" podID="725b915c-7c39-43e6-8022-99dd14a6276e" containerID="cb14563bca03394263c85e9a7621fecb106a313ab5894f960695d9bba681a3c8" exitCode=137 Mar 16 16:00:44 crc kubenswrapper[5120]: I0316 16:00:44.855462 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"725b915c-7c39-43e6-8022-99dd14a6276e","Type":"ContainerDied","Data":"cb14563bca03394263c85e9a7621fecb106a313ab5894f960695d9bba681a3c8"} Mar 16 16:00:44 crc kubenswrapper[5120]: I0316 16:00:44.855532 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"725b915c-7c39-43e6-8022-99dd14a6276e","Type":"ContainerDied","Data":"604e609ff8ed1901fbdfc758a07c8cf4abbc7b3557bf864bb6b8532d73b01341"} Mar 16 16:00:44 crc kubenswrapper[5120]: I0316 16:00:44.855564 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:00:44 crc kubenswrapper[5120]: I0316 16:00:44.866223 5120 scope.go:117] "RemoveContainer" containerID="b6bb33f699db1e8b2ee47f375490efe9554f49f146ae7d1e564beba920058e1b" Mar 16 16:00:44 crc kubenswrapper[5120]: I0316 16:00:44.868555 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:00:44 crc kubenswrapper[5120]: I0316 16:00:44.876633 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:00:44 crc kubenswrapper[5120]: I0316 16:00:44.890165 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-5477dfc7d6-r85w6"] Mar 16 16:00:44 crc kubenswrapper[5120]: I0316 16:00:44.896363 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-5477dfc7d6-r85w6"] Mar 16 16:00:44 crc kubenswrapper[5120]: I0316 16:00:44.920535 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 16:00:44 crc kubenswrapper[5120]: I0316 16:00:44.925243 5120 scope.go:117] "RemoveContainer" containerID="e3ff05b6348b5b52f655f2e654b8bb92f34e8976b107f05b594ed2c6a0dd4dee" Mar 16 16:00:44 crc kubenswrapper[5120]: I0316 16:00:44.933928 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.161876 5120 scope.go:117] "RemoveContainer" containerID="4b60d781e4c4d04ce9cd5e3a15fb61c49894b5654ae98b63df546451d7ab3a2c" Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.190740 5120 scope.go:117] "RemoveContainer" containerID="e3ff05b6348b5b52f655f2e654b8bb92f34e8976b107f05b594ed2c6a0dd4dee" Mar 16 16:00:45 crc kubenswrapper[5120]: E0316 16:00:45.191474 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e3ff05b6348b5b52f655f2e654b8bb92f34e8976b107f05b594ed2c6a0dd4dee\": container with ID starting with e3ff05b6348b5b52f655f2e654b8bb92f34e8976b107f05b594ed2c6a0dd4dee not found: ID does not exist" containerID="e3ff05b6348b5b52f655f2e654b8bb92f34e8976b107f05b594ed2c6a0dd4dee" Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.191535 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3ff05b6348b5b52f655f2e654b8bb92f34e8976b107f05b594ed2c6a0dd4dee"} err="failed to get container status \"e3ff05b6348b5b52f655f2e654b8bb92f34e8976b107f05b594ed2c6a0dd4dee\": rpc error: code = NotFound desc = could not find container \"e3ff05b6348b5b52f655f2e654b8bb92f34e8976b107f05b594ed2c6a0dd4dee\": container with ID starting with e3ff05b6348b5b52f655f2e654b8bb92f34e8976b107f05b594ed2c6a0dd4dee not found: ID does not exist" Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.191569 5120 scope.go:117] "RemoveContainer" containerID="4b60d781e4c4d04ce9cd5e3a15fb61c49894b5654ae98b63df546451d7ab3a2c" Mar 16 16:00:45 crc kubenswrapper[5120]: E0316 16:00:45.192028 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b60d781e4c4d04ce9cd5e3a15fb61c49894b5654ae98b63df546451d7ab3a2c\": container with ID starting with 4b60d781e4c4d04ce9cd5e3a15fb61c49894b5654ae98b63df546451d7ab3a2c not found: ID does not exist" containerID="4b60d781e4c4d04ce9cd5e3a15fb61c49894b5654ae98b63df546451d7ab3a2c" Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.192080 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b60d781e4c4d04ce9cd5e3a15fb61c49894b5654ae98b63df546451d7ab3a2c"} err="failed to get container status \"4b60d781e4c4d04ce9cd5e3a15fb61c49894b5654ae98b63df546451d7ab3a2c\": rpc error: code = NotFound desc = could not find container \"4b60d781e4c4d04ce9cd5e3a15fb61c49894b5654ae98b63df546451d7ab3a2c\": container with ID starting with 4b60d781e4c4d04ce9cd5e3a15fb61c49894b5654ae98b63df546451d7ab3a2c not found: ID does not exist" Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.192212 5120 scope.go:117] "RemoveContainer" containerID="cb14563bca03394263c85e9a7621fecb106a313ab5894f960695d9bba681a3c8" Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.208074 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.219746 5120 scope.go:117] "RemoveContainer" containerID="762a260277f80c61150c72c781fdfadc157f11b49e278f6b091fc4317e1db456" Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.242869 5120 scope.go:117] "RemoveContainer" containerID="028ca00d7f3a02e0498607bc597f8a8dc18ccbcd5f27da0dbecccbdd32f01b06" Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.293145 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ca4a5201-32c6-4c58-8bac-4d1b05ddfbb4-config-data\") pod \"ca4a5201-32c6-4c58-8bac-4d1b05ddfbb4\" (UID: \"ca4a5201-32c6-4c58-8bac-4d1b05ddfbb4\") " Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.293391 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xtcb2\" (UniqueName: \"kubernetes.io/projected/ca4a5201-32c6-4c58-8bac-4d1b05ddfbb4-kube-api-access-xtcb2\") pod \"ca4a5201-32c6-4c58-8bac-4d1b05ddfbb4\" (UID: \"ca4a5201-32c6-4c58-8bac-4d1b05ddfbb4\") " Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.293522 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ca4a5201-32c6-4c58-8bac-4d1b05ddfbb4-combined-ca-bundle\") pod \"ca4a5201-32c6-4c58-8bac-4d1b05ddfbb4\" (UID: \"ca4a5201-32c6-4c58-8bac-4d1b05ddfbb4\") " Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.302945 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca4a5201-32c6-4c58-8bac-4d1b05ddfbb4-kube-api-access-xtcb2" (OuterVolumeSpecName: "kube-api-access-xtcb2") pod "ca4a5201-32c6-4c58-8bac-4d1b05ddfbb4" (UID: "ca4a5201-32c6-4c58-8bac-4d1b05ddfbb4"). InnerVolumeSpecName "kube-api-access-xtcb2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.311301 5120 scope.go:117] "RemoveContainer" containerID="1e0c2e403fa140b74e5d0d79126181003e5bd471fd02d918d968352af679aa6b" Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.324937 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca4a5201-32c6-4c58-8bac-4d1b05ddfbb4-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ca4a5201-32c6-4c58-8bac-4d1b05ddfbb4" (UID: "ca4a5201-32c6-4c58-8bac-4d1b05ddfbb4"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.339111 5120 scope.go:117] "RemoveContainer" containerID="fc8047922b83c19ce5ee5cd59a92fb79edc337b663b0951d81347220713d144a" Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.362311 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca4a5201-32c6-4c58-8bac-4d1b05ddfbb4-config-data" (OuterVolumeSpecName: "config-data") pod "ca4a5201-32c6-4c58-8bac-4d1b05ddfbb4" (UID: "ca4a5201-32c6-4c58-8bac-4d1b05ddfbb4"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.368412 5120 scope.go:117] "RemoveContainer" containerID="381f5f488e15fab4b3389a7f56848e0549ffa22667f27135f0a5d27a2b9b593e" Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.390114 5120 scope.go:117] "RemoveContainer" containerID="9b91d7507fff9e107013c39056e451ffe12795d6ae267b2ef0a816bc5e272d34" Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.394081 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.396150 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xtcb2\" (UniqueName: \"kubernetes.io/projected/ca4a5201-32c6-4c58-8bac-4d1b05ddfbb4-kube-api-access-xtcb2\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.396277 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ca4a5201-32c6-4c58-8bac-4d1b05ddfbb4-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.396351 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ca4a5201-32c6-4c58-8bac-4d1b05ddfbb4-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.422065 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.449080 5120 scope.go:117] "RemoveContainer" containerID="e1e5609b43f9503028b31e0b3fda895e40ba4838567fb814822286e0b240187c" Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.497213 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5da6e8f8-fa80-477a-bbf9-0e251dd24153-config-data\") pod \"5da6e8f8-fa80-477a-bbf9-0e251dd24153\" (UID: \"5da6e8f8-fa80-477a-bbf9-0e251dd24153\") " Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.497261 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9gbdv\" (UniqueName: \"kubernetes.io/projected/5da6e8f8-fa80-477a-bbf9-0e251dd24153-kube-api-access-9gbdv\") pod \"5da6e8f8-fa80-477a-bbf9-0e251dd24153\" (UID: \"5da6e8f8-fa80-477a-bbf9-0e251dd24153\") " Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.497370 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5da6e8f8-fa80-477a-bbf9-0e251dd24153-combined-ca-bundle\") pod \"5da6e8f8-fa80-477a-bbf9-0e251dd24153\" (UID: \"5da6e8f8-fa80-477a-bbf9-0e251dd24153\") " Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.497482 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/63972b06-4c5e-40e4-a318-8e5f3e286ece-config-data\") pod \"63972b06-4c5e-40e4-a318-8e5f3e286ece\" (UID: \"63972b06-4c5e-40e4-a318-8e5f3e286ece\") " Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.497508 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7jc7j\" (UniqueName: \"kubernetes.io/projected/63972b06-4c5e-40e4-a318-8e5f3e286ece-kube-api-access-7jc7j\") pod \"63972b06-4c5e-40e4-a318-8e5f3e286ece\" (UID: \"63972b06-4c5e-40e4-a318-8e5f3e286ece\") " Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.497604 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/63972b06-4c5e-40e4-a318-8e5f3e286ece-combined-ca-bundle\") pod \"63972b06-4c5e-40e4-a318-8e5f3e286ece\" (UID: \"63972b06-4c5e-40e4-a318-8e5f3e286ece\") " Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.508562 5120 scope.go:117] "RemoveContainer" containerID="d3bcc1b7fd9e76c63c4579009f6a561f9ea39189bb67757e6ad92647e3d5cc00" Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.512876 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63972b06-4c5e-40e4-a318-8e5f3e286ece-kube-api-access-7jc7j" (OuterVolumeSpecName: "kube-api-access-7jc7j") pod "63972b06-4c5e-40e4-a318-8e5f3e286ece" (UID: "63972b06-4c5e-40e4-a318-8e5f3e286ece"). InnerVolumeSpecName "kube-api-access-7jc7j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.516160 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5da6e8f8-fa80-477a-bbf9-0e251dd24153-kube-api-access-9gbdv" (OuterVolumeSpecName: "kube-api-access-9gbdv") pod "5da6e8f8-fa80-477a-bbf9-0e251dd24153" (UID: "5da6e8f8-fa80-477a-bbf9-0e251dd24153"). InnerVolumeSpecName "kube-api-access-9gbdv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.521753 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5da6e8f8-fa80-477a-bbf9-0e251dd24153-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "5da6e8f8-fa80-477a-bbf9-0e251dd24153" (UID: "5da6e8f8-fa80-477a-bbf9-0e251dd24153"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.529919 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/63972b06-4c5e-40e4-a318-8e5f3e286ece-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "63972b06-4c5e-40e4-a318-8e5f3e286ece" (UID: "63972b06-4c5e-40e4-a318-8e5f3e286ece"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.532145 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/63972b06-4c5e-40e4-a318-8e5f3e286ece-config-data" (OuterVolumeSpecName: "config-data") pod "63972b06-4c5e-40e4-a318-8e5f3e286ece" (UID: "63972b06-4c5e-40e4-a318-8e5f3e286ece"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.532523 5120 scope.go:117] "RemoveContainer" containerID="45e2db9f2a2c31aac9bb2521e7a03b67f75500e9406349b0edc7767c1c3632f2" Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.537913 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5da6e8f8-fa80-477a-bbf9-0e251dd24153-config-data" (OuterVolumeSpecName: "config-data") pod "5da6e8f8-fa80-477a-bbf9-0e251dd24153" (UID: "5da6e8f8-fa80-477a-bbf9-0e251dd24153"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.550401 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.557544 5120 scope.go:117] "RemoveContainer" containerID="66d0d042587258a65188efea26738d109ef3471c78ed22bfed7030925260d9b8" Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.587686 5120 scope.go:117] "RemoveContainer" containerID="71b59b87818e9c61e2898baf97bfa1f6e0a18889a07c5b10bca12a35e6a5d59a" Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.599603 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/1d8cf310-88d2-4a5c-a2d9-2807cd409f37-sg-core-conf-yaml\") pod \"1d8cf310-88d2-4a5c-a2d9-2807cd409f37\" (UID: \"1d8cf310-88d2-4a5c-a2d9-2807cd409f37\") " Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.599693 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1d8cf310-88d2-4a5c-a2d9-2807cd409f37-combined-ca-bundle\") pod \"1d8cf310-88d2-4a5c-a2d9-2807cd409f37\" (UID: \"1d8cf310-88d2-4a5c-a2d9-2807cd409f37\") " Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.599753 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1d8cf310-88d2-4a5c-a2d9-2807cd409f37-run-httpd\") pod \"1d8cf310-88d2-4a5c-a2d9-2807cd409f37\" (UID: \"1d8cf310-88d2-4a5c-a2d9-2807cd409f37\") " Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.599855 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/1d8cf310-88d2-4a5c-a2d9-2807cd409f37-ceilometer-tls-certs\") pod \"1d8cf310-88d2-4a5c-a2d9-2807cd409f37\" (UID: \"1d8cf310-88d2-4a5c-a2d9-2807cd409f37\") " Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.599897 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1d8cf310-88d2-4a5c-a2d9-2807cd409f37-log-httpd\") pod \"1d8cf310-88d2-4a5c-a2d9-2807cd409f37\" (UID: \"1d8cf310-88d2-4a5c-a2d9-2807cd409f37\") " Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.599916 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1d8cf310-88d2-4a5c-a2d9-2807cd409f37-scripts\") pod \"1d8cf310-88d2-4a5c-a2d9-2807cd409f37\" (UID: \"1d8cf310-88d2-4a5c-a2d9-2807cd409f37\") " Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.599945 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1d8cf310-88d2-4a5c-a2d9-2807cd409f37-config-data\") pod \"1d8cf310-88d2-4a5c-a2d9-2807cd409f37\" (UID: \"1d8cf310-88d2-4a5c-a2d9-2807cd409f37\") " Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.600023 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m875q\" (UniqueName: \"kubernetes.io/projected/1d8cf310-88d2-4a5c-a2d9-2807cd409f37-kube-api-access-m875q\") pod \"1d8cf310-88d2-4a5c-a2d9-2807cd409f37\" (UID: \"1d8cf310-88d2-4a5c-a2d9-2807cd409f37\") " Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.600296 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5da6e8f8-fa80-477a-bbf9-0e251dd24153-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.600317 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9gbdv\" (UniqueName: \"kubernetes.io/projected/5da6e8f8-fa80-477a-bbf9-0e251dd24153-kube-api-access-9gbdv\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.600328 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5da6e8f8-fa80-477a-bbf9-0e251dd24153-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.600338 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/63972b06-4c5e-40e4-a318-8e5f3e286ece-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.600349 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7jc7j\" (UniqueName: \"kubernetes.io/projected/63972b06-4c5e-40e4-a318-8e5f3e286ece-kube-api-access-7jc7j\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.600357 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/63972b06-4c5e-40e4-a318-8e5f3e286ece-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.601775 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d8cf310-88d2-4a5c-a2d9-2807cd409f37-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "1d8cf310-88d2-4a5c-a2d9-2807cd409f37" (UID: "1d8cf310-88d2-4a5c-a2d9-2807cd409f37"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.601949 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d8cf310-88d2-4a5c-a2d9-2807cd409f37-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "1d8cf310-88d2-4a5c-a2d9-2807cd409f37" (UID: "1d8cf310-88d2-4a5c-a2d9-2807cd409f37"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.603979 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d8cf310-88d2-4a5c-a2d9-2807cd409f37-kube-api-access-m875q" (OuterVolumeSpecName: "kube-api-access-m875q") pod "1d8cf310-88d2-4a5c-a2d9-2807cd409f37" (UID: "1d8cf310-88d2-4a5c-a2d9-2807cd409f37"). InnerVolumeSpecName "kube-api-access-m875q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.604216 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1d8cf310-88d2-4a5c-a2d9-2807cd409f37-scripts" (OuterVolumeSpecName: "scripts") pod "1d8cf310-88d2-4a5c-a2d9-2807cd409f37" (UID: "1d8cf310-88d2-4a5c-a2d9-2807cd409f37"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.606511 5120 scope.go:117] "RemoveContainer" containerID="262cd591bf64204d3ae5dd293546fa23e41d083f4d36ea5ae8c2081db5fe77fe" Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.631393 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1d8cf310-88d2-4a5c-a2d9-2807cd409f37-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "1d8cf310-88d2-4a5c-a2d9-2807cd409f37" (UID: "1d8cf310-88d2-4a5c-a2d9-2807cd409f37"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.632790 5120 scope.go:117] "RemoveContainer" containerID="77ec9324e0dbe58ae4b2dc527047287f83714d98ac52687796abd8b39e40a66b" Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.654901 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1d8cf310-88d2-4a5c-a2d9-2807cd409f37-ceilometer-tls-certs" (OuterVolumeSpecName: "ceilometer-tls-certs") pod "1d8cf310-88d2-4a5c-a2d9-2807cd409f37" (UID: "1d8cf310-88d2-4a5c-a2d9-2807cd409f37"). InnerVolumeSpecName "ceilometer-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.655881 5120 scope.go:117] "RemoveContainer" containerID="9065435fa0cbe38d798b7f599f263612ad1337c636838785105247be4e64c3c8" Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.686043 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1d8cf310-88d2-4a5c-a2d9-2807cd409f37-config-data" (OuterVolumeSpecName: "config-data") pod "1d8cf310-88d2-4a5c-a2d9-2807cd409f37" (UID: "1d8cf310-88d2-4a5c-a2d9-2807cd409f37"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.687819 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1d8cf310-88d2-4a5c-a2d9-2807cd409f37-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "1d8cf310-88d2-4a5c-a2d9-2807cd409f37" (UID: "1d8cf310-88d2-4a5c-a2d9-2807cd409f37"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.701386 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1d8cf310-88d2-4a5c-a2d9-2807cd409f37-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.701431 5120 reconciler_common.go:299] "Volume detached for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/1d8cf310-88d2-4a5c-a2d9-2807cd409f37-ceilometer-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.701447 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1d8cf310-88d2-4a5c-a2d9-2807cd409f37-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.701461 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1d8cf310-88d2-4a5c-a2d9-2807cd409f37-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.701475 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1d8cf310-88d2-4a5c-a2d9-2807cd409f37-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.701485 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m875q\" (UniqueName: \"kubernetes.io/projected/1d8cf310-88d2-4a5c-a2d9-2807cd409f37-kube-api-access-m875q\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.701494 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/1d8cf310-88d2-4a5c-a2d9-2807cd409f37-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.701504 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1d8cf310-88d2-4a5c-a2d9-2807cd409f37-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.768146 5120 scope.go:117] "RemoveContainer" containerID="cb14563bca03394263c85e9a7621fecb106a313ab5894f960695d9bba681a3c8" Mar 16 16:00:45 crc kubenswrapper[5120]: E0316 16:00:45.768640 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cb14563bca03394263c85e9a7621fecb106a313ab5894f960695d9bba681a3c8\": container with ID starting with cb14563bca03394263c85e9a7621fecb106a313ab5894f960695d9bba681a3c8 not found: ID does not exist" containerID="cb14563bca03394263c85e9a7621fecb106a313ab5894f960695d9bba681a3c8" Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.768689 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb14563bca03394263c85e9a7621fecb106a313ab5894f960695d9bba681a3c8"} err="failed to get container status \"cb14563bca03394263c85e9a7621fecb106a313ab5894f960695d9bba681a3c8\": rpc error: code = NotFound desc = could not find container \"cb14563bca03394263c85e9a7621fecb106a313ab5894f960695d9bba681a3c8\": container with ID starting with cb14563bca03394263c85e9a7621fecb106a313ab5894f960695d9bba681a3c8 not found: ID does not exist" Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.768717 5120 scope.go:117] "RemoveContainer" containerID="762a260277f80c61150c72c781fdfadc157f11b49e278f6b091fc4317e1db456" Mar 16 16:00:45 crc kubenswrapper[5120]: E0316 16:00:45.769045 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"762a260277f80c61150c72c781fdfadc157f11b49e278f6b091fc4317e1db456\": container with ID starting with 762a260277f80c61150c72c781fdfadc157f11b49e278f6b091fc4317e1db456 not found: ID does not exist" containerID="762a260277f80c61150c72c781fdfadc157f11b49e278f6b091fc4317e1db456" Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.769094 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"762a260277f80c61150c72c781fdfadc157f11b49e278f6b091fc4317e1db456"} err="failed to get container status \"762a260277f80c61150c72c781fdfadc157f11b49e278f6b091fc4317e1db456\": rpc error: code = NotFound desc = could not find container \"762a260277f80c61150c72c781fdfadc157f11b49e278f6b091fc4317e1db456\": container with ID starting with 762a260277f80c61150c72c781fdfadc157f11b49e278f6b091fc4317e1db456 not found: ID does not exist" Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.769121 5120 scope.go:117] "RemoveContainer" containerID="028ca00d7f3a02e0498607bc597f8a8dc18ccbcd5f27da0dbecccbdd32f01b06" Mar 16 16:00:45 crc kubenswrapper[5120]: E0316 16:00:45.770367 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"028ca00d7f3a02e0498607bc597f8a8dc18ccbcd5f27da0dbecccbdd32f01b06\": container with ID starting with 028ca00d7f3a02e0498607bc597f8a8dc18ccbcd5f27da0dbecccbdd32f01b06 not found: ID does not exist" containerID="028ca00d7f3a02e0498607bc597f8a8dc18ccbcd5f27da0dbecccbdd32f01b06" Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.770400 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"028ca00d7f3a02e0498607bc597f8a8dc18ccbcd5f27da0dbecccbdd32f01b06"} err="failed to get container status \"028ca00d7f3a02e0498607bc597f8a8dc18ccbcd5f27da0dbecccbdd32f01b06\": rpc error: code = NotFound desc = could not find container \"028ca00d7f3a02e0498607bc597f8a8dc18ccbcd5f27da0dbecccbdd32f01b06\": container with ID starting with 028ca00d7f3a02e0498607bc597f8a8dc18ccbcd5f27da0dbecccbdd32f01b06 not found: ID does not exist" Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.770415 5120 scope.go:117] "RemoveContainer" containerID="1e0c2e403fa140b74e5d0d79126181003e5bd471fd02d918d968352af679aa6b" Mar 16 16:00:45 crc kubenswrapper[5120]: E0316 16:00:45.770672 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e0c2e403fa140b74e5d0d79126181003e5bd471fd02d918d968352af679aa6b\": container with ID starting with 1e0c2e403fa140b74e5d0d79126181003e5bd471fd02d918d968352af679aa6b not found: ID does not exist" containerID="1e0c2e403fa140b74e5d0d79126181003e5bd471fd02d918d968352af679aa6b" Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.770702 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e0c2e403fa140b74e5d0d79126181003e5bd471fd02d918d968352af679aa6b"} err="failed to get container status \"1e0c2e403fa140b74e5d0d79126181003e5bd471fd02d918d968352af679aa6b\": rpc error: code = NotFound desc = could not find container \"1e0c2e403fa140b74e5d0d79126181003e5bd471fd02d918d968352af679aa6b\": container with ID starting with 1e0c2e403fa140b74e5d0d79126181003e5bd471fd02d918d968352af679aa6b not found: ID does not exist" Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.770720 5120 scope.go:117] "RemoveContainer" containerID="fc8047922b83c19ce5ee5cd59a92fb79edc337b663b0951d81347220713d144a" Mar 16 16:00:45 crc kubenswrapper[5120]: E0316 16:00:45.771007 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc8047922b83c19ce5ee5cd59a92fb79edc337b663b0951d81347220713d144a\": container with ID starting with fc8047922b83c19ce5ee5cd59a92fb79edc337b663b0951d81347220713d144a not found: ID does not exist" containerID="fc8047922b83c19ce5ee5cd59a92fb79edc337b663b0951d81347220713d144a" Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.771034 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc8047922b83c19ce5ee5cd59a92fb79edc337b663b0951d81347220713d144a"} err="failed to get container status \"fc8047922b83c19ce5ee5cd59a92fb79edc337b663b0951d81347220713d144a\": rpc error: code = NotFound desc = could not find container \"fc8047922b83c19ce5ee5cd59a92fb79edc337b663b0951d81347220713d144a\": container with ID starting with fc8047922b83c19ce5ee5cd59a92fb79edc337b663b0951d81347220713d144a not found: ID does not exist" Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.771053 5120 scope.go:117] "RemoveContainer" containerID="381f5f488e15fab4b3389a7f56848e0549ffa22667f27135f0a5d27a2b9b593e" Mar 16 16:00:45 crc kubenswrapper[5120]: E0316 16:00:45.771344 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"381f5f488e15fab4b3389a7f56848e0549ffa22667f27135f0a5d27a2b9b593e\": container with ID starting with 381f5f488e15fab4b3389a7f56848e0549ffa22667f27135f0a5d27a2b9b593e not found: ID does not exist" containerID="381f5f488e15fab4b3389a7f56848e0549ffa22667f27135f0a5d27a2b9b593e" Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.771375 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"381f5f488e15fab4b3389a7f56848e0549ffa22667f27135f0a5d27a2b9b593e"} err="failed to get container status \"381f5f488e15fab4b3389a7f56848e0549ffa22667f27135f0a5d27a2b9b593e\": rpc error: code = NotFound desc = could not find container \"381f5f488e15fab4b3389a7f56848e0549ffa22667f27135f0a5d27a2b9b593e\": container with ID starting with 381f5f488e15fab4b3389a7f56848e0549ffa22667f27135f0a5d27a2b9b593e not found: ID does not exist" Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.771398 5120 scope.go:117] "RemoveContainer" containerID="9b91d7507fff9e107013c39056e451ffe12795d6ae267b2ef0a816bc5e272d34" Mar 16 16:00:45 crc kubenswrapper[5120]: E0316 16:00:45.771726 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b91d7507fff9e107013c39056e451ffe12795d6ae267b2ef0a816bc5e272d34\": container with ID starting with 9b91d7507fff9e107013c39056e451ffe12795d6ae267b2ef0a816bc5e272d34 not found: ID does not exist" containerID="9b91d7507fff9e107013c39056e451ffe12795d6ae267b2ef0a816bc5e272d34" Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.771831 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b91d7507fff9e107013c39056e451ffe12795d6ae267b2ef0a816bc5e272d34"} err="failed to get container status \"9b91d7507fff9e107013c39056e451ffe12795d6ae267b2ef0a816bc5e272d34\": rpc error: code = NotFound desc = could not find container \"9b91d7507fff9e107013c39056e451ffe12795d6ae267b2ef0a816bc5e272d34\": container with ID starting with 9b91d7507fff9e107013c39056e451ffe12795d6ae267b2ef0a816bc5e272d34 not found: ID does not exist" Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.771852 5120 scope.go:117] "RemoveContainer" containerID="e1e5609b43f9503028b31e0b3fda895e40ba4838567fb814822286e0b240187c" Mar 16 16:00:45 crc kubenswrapper[5120]: E0316 16:00:45.772096 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e1e5609b43f9503028b31e0b3fda895e40ba4838567fb814822286e0b240187c\": container with ID starting with e1e5609b43f9503028b31e0b3fda895e40ba4838567fb814822286e0b240187c not found: ID does not exist" containerID="e1e5609b43f9503028b31e0b3fda895e40ba4838567fb814822286e0b240187c" Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.772122 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1e5609b43f9503028b31e0b3fda895e40ba4838567fb814822286e0b240187c"} err="failed to get container status \"e1e5609b43f9503028b31e0b3fda895e40ba4838567fb814822286e0b240187c\": rpc error: code = NotFound desc = could not find container \"e1e5609b43f9503028b31e0b3fda895e40ba4838567fb814822286e0b240187c\": container with ID starting with e1e5609b43f9503028b31e0b3fda895e40ba4838567fb814822286e0b240187c not found: ID does not exist" Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.772137 5120 scope.go:117] "RemoveContainer" containerID="d3bcc1b7fd9e76c63c4579009f6a561f9ea39189bb67757e6ad92647e3d5cc00" Mar 16 16:00:45 crc kubenswrapper[5120]: E0316 16:00:45.772420 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d3bcc1b7fd9e76c63c4579009f6a561f9ea39189bb67757e6ad92647e3d5cc00\": container with ID starting with d3bcc1b7fd9e76c63c4579009f6a561f9ea39189bb67757e6ad92647e3d5cc00 not found: ID does not exist" containerID="d3bcc1b7fd9e76c63c4579009f6a561f9ea39189bb67757e6ad92647e3d5cc00" Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.772455 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3bcc1b7fd9e76c63c4579009f6a561f9ea39189bb67757e6ad92647e3d5cc00"} err="failed to get container status \"d3bcc1b7fd9e76c63c4579009f6a561f9ea39189bb67757e6ad92647e3d5cc00\": rpc error: code = NotFound desc = could not find container \"d3bcc1b7fd9e76c63c4579009f6a561f9ea39189bb67757e6ad92647e3d5cc00\": container with ID starting with d3bcc1b7fd9e76c63c4579009f6a561f9ea39189bb67757e6ad92647e3d5cc00 not found: ID does not exist" Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.772477 5120 scope.go:117] "RemoveContainer" containerID="45e2db9f2a2c31aac9bb2521e7a03b67f75500e9406349b0edc7767c1c3632f2" Mar 16 16:00:45 crc kubenswrapper[5120]: E0316 16:00:45.772861 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"45e2db9f2a2c31aac9bb2521e7a03b67f75500e9406349b0edc7767c1c3632f2\": container with ID starting with 45e2db9f2a2c31aac9bb2521e7a03b67f75500e9406349b0edc7767c1c3632f2 not found: ID does not exist" containerID="45e2db9f2a2c31aac9bb2521e7a03b67f75500e9406349b0edc7767c1c3632f2" Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.772895 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45e2db9f2a2c31aac9bb2521e7a03b67f75500e9406349b0edc7767c1c3632f2"} err="failed to get container status \"45e2db9f2a2c31aac9bb2521e7a03b67f75500e9406349b0edc7767c1c3632f2\": rpc error: code = NotFound desc = could not find container \"45e2db9f2a2c31aac9bb2521e7a03b67f75500e9406349b0edc7767c1c3632f2\": container with ID starting with 45e2db9f2a2c31aac9bb2521e7a03b67f75500e9406349b0edc7767c1c3632f2 not found: ID does not exist" Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.772913 5120 scope.go:117] "RemoveContainer" containerID="66d0d042587258a65188efea26738d109ef3471c78ed22bfed7030925260d9b8" Mar 16 16:00:45 crc kubenswrapper[5120]: E0316 16:00:45.773145 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"66d0d042587258a65188efea26738d109ef3471c78ed22bfed7030925260d9b8\": container with ID starting with 66d0d042587258a65188efea26738d109ef3471c78ed22bfed7030925260d9b8 not found: ID does not exist" containerID="66d0d042587258a65188efea26738d109ef3471c78ed22bfed7030925260d9b8" Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.773176 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66d0d042587258a65188efea26738d109ef3471c78ed22bfed7030925260d9b8"} err="failed to get container status \"66d0d042587258a65188efea26738d109ef3471c78ed22bfed7030925260d9b8\": rpc error: code = NotFound desc = could not find container \"66d0d042587258a65188efea26738d109ef3471c78ed22bfed7030925260d9b8\": container with ID starting with 66d0d042587258a65188efea26738d109ef3471c78ed22bfed7030925260d9b8 not found: ID does not exist" Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.773196 5120 scope.go:117] "RemoveContainer" containerID="71b59b87818e9c61e2898baf97bfa1f6e0a18889a07c5b10bca12a35e6a5d59a" Mar 16 16:00:45 crc kubenswrapper[5120]: E0316 16:00:45.773417 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"71b59b87818e9c61e2898baf97bfa1f6e0a18889a07c5b10bca12a35e6a5d59a\": container with ID starting with 71b59b87818e9c61e2898baf97bfa1f6e0a18889a07c5b10bca12a35e6a5d59a not found: ID does not exist" containerID="71b59b87818e9c61e2898baf97bfa1f6e0a18889a07c5b10bca12a35e6a5d59a" Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.773456 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71b59b87818e9c61e2898baf97bfa1f6e0a18889a07c5b10bca12a35e6a5d59a"} err="failed to get container status \"71b59b87818e9c61e2898baf97bfa1f6e0a18889a07c5b10bca12a35e6a5d59a\": rpc error: code = NotFound desc = could not find container \"71b59b87818e9c61e2898baf97bfa1f6e0a18889a07c5b10bca12a35e6a5d59a\": container with ID starting with 71b59b87818e9c61e2898baf97bfa1f6e0a18889a07c5b10bca12a35e6a5d59a not found: ID does not exist" Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.773475 5120 scope.go:117] "RemoveContainer" containerID="262cd591bf64204d3ae5dd293546fa23e41d083f4d36ea5ae8c2081db5fe77fe" Mar 16 16:00:45 crc kubenswrapper[5120]: E0316 16:00:45.773819 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"262cd591bf64204d3ae5dd293546fa23e41d083f4d36ea5ae8c2081db5fe77fe\": container with ID starting with 262cd591bf64204d3ae5dd293546fa23e41d083f4d36ea5ae8c2081db5fe77fe not found: ID does not exist" containerID="262cd591bf64204d3ae5dd293546fa23e41d083f4d36ea5ae8c2081db5fe77fe" Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.773845 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"262cd591bf64204d3ae5dd293546fa23e41d083f4d36ea5ae8c2081db5fe77fe"} err="failed to get container status \"262cd591bf64204d3ae5dd293546fa23e41d083f4d36ea5ae8c2081db5fe77fe\": rpc error: code = NotFound desc = could not find container \"262cd591bf64204d3ae5dd293546fa23e41d083f4d36ea5ae8c2081db5fe77fe\": container with ID starting with 262cd591bf64204d3ae5dd293546fa23e41d083f4d36ea5ae8c2081db5fe77fe not found: ID does not exist" Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.773861 5120 scope.go:117] "RemoveContainer" containerID="77ec9324e0dbe58ae4b2dc527047287f83714d98ac52687796abd8b39e40a66b" Mar 16 16:00:45 crc kubenswrapper[5120]: E0316 16:00:45.774233 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"77ec9324e0dbe58ae4b2dc527047287f83714d98ac52687796abd8b39e40a66b\": container with ID starting with 77ec9324e0dbe58ae4b2dc527047287f83714d98ac52687796abd8b39e40a66b not found: ID does not exist" containerID="77ec9324e0dbe58ae4b2dc527047287f83714d98ac52687796abd8b39e40a66b" Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.774281 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77ec9324e0dbe58ae4b2dc527047287f83714d98ac52687796abd8b39e40a66b"} err="failed to get container status \"77ec9324e0dbe58ae4b2dc527047287f83714d98ac52687796abd8b39e40a66b\": rpc error: code = NotFound desc = could not find container \"77ec9324e0dbe58ae4b2dc527047287f83714d98ac52687796abd8b39e40a66b\": container with ID starting with 77ec9324e0dbe58ae4b2dc527047287f83714d98ac52687796abd8b39e40a66b not found: ID does not exist" Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.774310 5120 scope.go:117] "RemoveContainer" containerID="9065435fa0cbe38d798b7f599f263612ad1337c636838785105247be4e64c3c8" Mar 16 16:00:45 crc kubenswrapper[5120]: E0316 16:00:45.774652 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9065435fa0cbe38d798b7f599f263612ad1337c636838785105247be4e64c3c8\": container with ID starting with 9065435fa0cbe38d798b7f599f263612ad1337c636838785105247be4e64c3c8 not found: ID does not exist" containerID="9065435fa0cbe38d798b7f599f263612ad1337c636838785105247be4e64c3c8" Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.774690 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9065435fa0cbe38d798b7f599f263612ad1337c636838785105247be4e64c3c8"} err="failed to get container status \"9065435fa0cbe38d798b7f599f263612ad1337c636838785105247be4e64c3c8\": rpc error: code = NotFound desc = could not find container \"9065435fa0cbe38d798b7f599f263612ad1337c636838785105247be4e64c3c8\": container with ID starting with 9065435fa0cbe38d798b7f599f263612ad1337c636838785105247be4e64c3c8 not found: ID does not exist" Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.869592 5120 generic.go:358] "Generic (PLEG): container finished" podID="63972b06-4c5e-40e4-a318-8e5f3e286ece" containerID="6b9d4e9dc1d3160e9abb2e9af3ed540f0c1e83d09c814ee53e6dfb172f8914f5" exitCode=137 Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.869741 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.869738 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"63972b06-4c5e-40e4-a318-8e5f3e286ece","Type":"ContainerDied","Data":"6b9d4e9dc1d3160e9abb2e9af3ed540f0c1e83d09c814ee53e6dfb172f8914f5"} Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.869932 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"63972b06-4c5e-40e4-a318-8e5f3e286ece","Type":"ContainerDied","Data":"ff0294885b0b68549560389cf6a2abd98828a684c6f7de6a3cb631ed61a4974a"} Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.869964 5120 scope.go:117] "RemoveContainer" containerID="6b9d4e9dc1d3160e9abb2e9af3ed540f0c1e83d09c814ee53e6dfb172f8914f5" Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.875292 5120 generic.go:358] "Generic (PLEG): container finished" podID="1d8cf310-88d2-4a5c-a2d9-2807cd409f37" containerID="341049f42f477d50d61b6b0313212a767638ec69f7b505bb6a919d1797bdd5bd" exitCode=137 Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.875326 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1d8cf310-88d2-4a5c-a2d9-2807cd409f37","Type":"ContainerDied","Data":"341049f42f477d50d61b6b0313212a767638ec69f7b505bb6a919d1797bdd5bd"} Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.875373 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1d8cf310-88d2-4a5c-a2d9-2807cd409f37","Type":"ContainerDied","Data":"9a9dcef95ab60461cbd5406abc5989757bb992fc2fb4f06cb7ce6caf861fb448"} Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.875384 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.880981 5120 generic.go:358] "Generic (PLEG): container finished" podID="5da6e8f8-fa80-477a-bbf9-0e251dd24153" containerID="b69196aca7077e660b738179840f4cffce2c72a012a2f8f0a16939792591c08e" exitCode=137 Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.881133 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"5da6e8f8-fa80-477a-bbf9-0e251dd24153","Type":"ContainerDied","Data":"b69196aca7077e660b738179840f4cffce2c72a012a2f8f0a16939792591c08e"} Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.881165 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"5da6e8f8-fa80-477a-bbf9-0e251dd24153","Type":"ContainerDied","Data":"66cc4a47321d684a121dcfda9bb2b5ae3c0cc1f88024228e2f127d0c75b955a6"} Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.881240 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.890268 5120 generic.go:358] "Generic (PLEG): container finished" podID="ca4a5201-32c6-4c58-8bac-4d1b05ddfbb4" containerID="b2dd99f48a5e6c36c5d9b0bed8c62972ff65efc2c08b8a4c56e6c1ee763db013" exitCode=137 Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.890331 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"ca4a5201-32c6-4c58-8bac-4d1b05ddfbb4","Type":"ContainerDied","Data":"b2dd99f48a5e6c36c5d9b0bed8c62972ff65efc2c08b8a4c56e6c1ee763db013"} Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.890361 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"ca4a5201-32c6-4c58-8bac-4d1b05ddfbb4","Type":"ContainerDied","Data":"a752498f9edc1155132c7f5522ea40fd434573db5462da576058333ff324365d"} Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.890422 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.898397 5120 scope.go:117] "RemoveContainer" containerID="6b9d4e9dc1d3160e9abb2e9af3ed540f0c1e83d09c814ee53e6dfb172f8914f5" Mar 16 16:00:45 crc kubenswrapper[5120]: E0316 16:00:45.899250 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b9d4e9dc1d3160e9abb2e9af3ed540f0c1e83d09c814ee53e6dfb172f8914f5\": container with ID starting with 6b9d4e9dc1d3160e9abb2e9af3ed540f0c1e83d09c814ee53e6dfb172f8914f5 not found: ID does not exist" containerID="6b9d4e9dc1d3160e9abb2e9af3ed540f0c1e83d09c814ee53e6dfb172f8914f5" Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.899277 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b9d4e9dc1d3160e9abb2e9af3ed540f0c1e83d09c814ee53e6dfb172f8914f5"} err="failed to get container status \"6b9d4e9dc1d3160e9abb2e9af3ed540f0c1e83d09c814ee53e6dfb172f8914f5\": rpc error: code = NotFound desc = could not find container \"6b9d4e9dc1d3160e9abb2e9af3ed540f0c1e83d09c814ee53e6dfb172f8914f5\": container with ID starting with 6b9d4e9dc1d3160e9abb2e9af3ed540f0c1e83d09c814ee53e6dfb172f8914f5 not found: ID does not exist" Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.899430 5120 scope.go:117] "RemoveContainer" containerID="225178e952b315c5893292df5f1de300801aa1d4aa5ddd4097d9a84deac77bb4" Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.913757 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.921754 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.927440 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.934034 5120 scope.go:117] "RemoveContainer" containerID="cd64ff6d1522e78a36e711e1d6c63dfc1b9549659dfe87de0c90878031eefbbf" Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.935442 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.940216 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.947669 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.953893 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.959099 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.968854 5120 scope.go:117] "RemoveContainer" containerID="341049f42f477d50d61b6b0313212a767638ec69f7b505bb6a919d1797bdd5bd" Mar 16 16:00:45 crc kubenswrapper[5120]: I0316 16:00:45.987490 5120 scope.go:117] "RemoveContainer" containerID="5947f9d479cbbe03d5e81c795fe4598420a5ae0c722f314229b64194063a5d8f" Mar 16 16:00:46 crc kubenswrapper[5120]: I0316 16:00:46.011545 5120 scope.go:117] "RemoveContainer" containerID="225178e952b315c5893292df5f1de300801aa1d4aa5ddd4097d9a84deac77bb4" Mar 16 16:00:46 crc kubenswrapper[5120]: E0316 16:00:46.012011 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"225178e952b315c5893292df5f1de300801aa1d4aa5ddd4097d9a84deac77bb4\": container with ID starting with 225178e952b315c5893292df5f1de300801aa1d4aa5ddd4097d9a84deac77bb4 not found: ID does not exist" containerID="225178e952b315c5893292df5f1de300801aa1d4aa5ddd4097d9a84deac77bb4" Mar 16 16:00:46 crc kubenswrapper[5120]: I0316 16:00:46.012060 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"225178e952b315c5893292df5f1de300801aa1d4aa5ddd4097d9a84deac77bb4"} err="failed to get container status \"225178e952b315c5893292df5f1de300801aa1d4aa5ddd4097d9a84deac77bb4\": rpc error: code = NotFound desc = could not find container \"225178e952b315c5893292df5f1de300801aa1d4aa5ddd4097d9a84deac77bb4\": container with ID starting with 225178e952b315c5893292df5f1de300801aa1d4aa5ddd4097d9a84deac77bb4 not found: ID does not exist" Mar 16 16:00:46 crc kubenswrapper[5120]: I0316 16:00:46.012087 5120 scope.go:117] "RemoveContainer" containerID="cd64ff6d1522e78a36e711e1d6c63dfc1b9549659dfe87de0c90878031eefbbf" Mar 16 16:00:46 crc kubenswrapper[5120]: E0316 16:00:46.012382 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd64ff6d1522e78a36e711e1d6c63dfc1b9549659dfe87de0c90878031eefbbf\": container with ID starting with cd64ff6d1522e78a36e711e1d6c63dfc1b9549659dfe87de0c90878031eefbbf not found: ID does not exist" containerID="cd64ff6d1522e78a36e711e1d6c63dfc1b9549659dfe87de0c90878031eefbbf" Mar 16 16:00:46 crc kubenswrapper[5120]: I0316 16:00:46.012401 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd64ff6d1522e78a36e711e1d6c63dfc1b9549659dfe87de0c90878031eefbbf"} err="failed to get container status \"cd64ff6d1522e78a36e711e1d6c63dfc1b9549659dfe87de0c90878031eefbbf\": rpc error: code = NotFound desc = could not find container \"cd64ff6d1522e78a36e711e1d6c63dfc1b9549659dfe87de0c90878031eefbbf\": container with ID starting with cd64ff6d1522e78a36e711e1d6c63dfc1b9549659dfe87de0c90878031eefbbf not found: ID does not exist" Mar 16 16:00:46 crc kubenswrapper[5120]: I0316 16:00:46.012411 5120 scope.go:117] "RemoveContainer" containerID="341049f42f477d50d61b6b0313212a767638ec69f7b505bb6a919d1797bdd5bd" Mar 16 16:00:46 crc kubenswrapper[5120]: E0316 16:00:46.012655 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"341049f42f477d50d61b6b0313212a767638ec69f7b505bb6a919d1797bdd5bd\": container with ID starting with 341049f42f477d50d61b6b0313212a767638ec69f7b505bb6a919d1797bdd5bd not found: ID does not exist" containerID="341049f42f477d50d61b6b0313212a767638ec69f7b505bb6a919d1797bdd5bd" Mar 16 16:00:46 crc kubenswrapper[5120]: I0316 16:00:46.012678 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"341049f42f477d50d61b6b0313212a767638ec69f7b505bb6a919d1797bdd5bd"} err="failed to get container status \"341049f42f477d50d61b6b0313212a767638ec69f7b505bb6a919d1797bdd5bd\": rpc error: code = NotFound desc = could not find container \"341049f42f477d50d61b6b0313212a767638ec69f7b505bb6a919d1797bdd5bd\": container with ID starting with 341049f42f477d50d61b6b0313212a767638ec69f7b505bb6a919d1797bdd5bd not found: ID does not exist" Mar 16 16:00:46 crc kubenswrapper[5120]: I0316 16:00:46.012710 5120 scope.go:117] "RemoveContainer" containerID="5947f9d479cbbe03d5e81c795fe4598420a5ae0c722f314229b64194063a5d8f" Mar 16 16:00:46 crc kubenswrapper[5120]: E0316 16:00:46.012934 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5947f9d479cbbe03d5e81c795fe4598420a5ae0c722f314229b64194063a5d8f\": container with ID starting with 5947f9d479cbbe03d5e81c795fe4598420a5ae0c722f314229b64194063a5d8f not found: ID does not exist" containerID="5947f9d479cbbe03d5e81c795fe4598420a5ae0c722f314229b64194063a5d8f" Mar 16 16:00:46 crc kubenswrapper[5120]: I0316 16:00:46.012952 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5947f9d479cbbe03d5e81c795fe4598420a5ae0c722f314229b64194063a5d8f"} err="failed to get container status \"5947f9d479cbbe03d5e81c795fe4598420a5ae0c722f314229b64194063a5d8f\": rpc error: code = NotFound desc = could not find container \"5947f9d479cbbe03d5e81c795fe4598420a5ae0c722f314229b64194063a5d8f\": container with ID starting with 5947f9d479cbbe03d5e81c795fe4598420a5ae0c722f314229b64194063a5d8f not found: ID does not exist" Mar 16 16:00:46 crc kubenswrapper[5120]: I0316 16:00:46.012964 5120 scope.go:117] "RemoveContainer" containerID="b69196aca7077e660b738179840f4cffce2c72a012a2f8f0a16939792591c08e" Mar 16 16:00:46 crc kubenswrapper[5120]: I0316 16:00:46.031176 5120 scope.go:117] "RemoveContainer" containerID="b69196aca7077e660b738179840f4cffce2c72a012a2f8f0a16939792591c08e" Mar 16 16:00:46 crc kubenswrapper[5120]: E0316 16:00:46.031594 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b69196aca7077e660b738179840f4cffce2c72a012a2f8f0a16939792591c08e\": container with ID starting with b69196aca7077e660b738179840f4cffce2c72a012a2f8f0a16939792591c08e not found: ID does not exist" containerID="b69196aca7077e660b738179840f4cffce2c72a012a2f8f0a16939792591c08e" Mar 16 16:00:46 crc kubenswrapper[5120]: I0316 16:00:46.031632 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b69196aca7077e660b738179840f4cffce2c72a012a2f8f0a16939792591c08e"} err="failed to get container status \"b69196aca7077e660b738179840f4cffce2c72a012a2f8f0a16939792591c08e\": rpc error: code = NotFound desc = could not find container \"b69196aca7077e660b738179840f4cffce2c72a012a2f8f0a16939792591c08e\": container with ID starting with b69196aca7077e660b738179840f4cffce2c72a012a2f8f0a16939792591c08e not found: ID does not exist" Mar 16 16:00:46 crc kubenswrapper[5120]: I0316 16:00:46.031657 5120 scope.go:117] "RemoveContainer" containerID="b2dd99f48a5e6c36c5d9b0bed8c62972ff65efc2c08b8a4c56e6c1ee763db013" Mar 16 16:00:46 crc kubenswrapper[5120]: I0316 16:00:46.051369 5120 scope.go:117] "RemoveContainer" containerID="b2dd99f48a5e6c36c5d9b0bed8c62972ff65efc2c08b8a4c56e6c1ee763db013" Mar 16 16:00:46 crc kubenswrapper[5120]: E0316 16:00:46.051880 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b2dd99f48a5e6c36c5d9b0bed8c62972ff65efc2c08b8a4c56e6c1ee763db013\": container with ID starting with b2dd99f48a5e6c36c5d9b0bed8c62972ff65efc2c08b8a4c56e6c1ee763db013 not found: ID does not exist" containerID="b2dd99f48a5e6c36c5d9b0bed8c62972ff65efc2c08b8a4c56e6c1ee763db013" Mar 16 16:00:46 crc kubenswrapper[5120]: I0316 16:00:46.051943 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2dd99f48a5e6c36c5d9b0bed8c62972ff65efc2c08b8a4c56e6c1ee763db013"} err="failed to get container status \"b2dd99f48a5e6c36c5d9b0bed8c62972ff65efc2c08b8a4c56e6c1ee763db013\": rpc error: code = NotFound desc = could not find container \"b2dd99f48a5e6c36c5d9b0bed8c62972ff65efc2c08b8a4c56e6c1ee763db013\": container with ID starting with b2dd99f48a5e6c36c5d9b0bed8c62972ff65efc2c08b8a4c56e6c1ee763db013 not found: ID does not exist" Mar 16 16:00:46 crc kubenswrapper[5120]: I0316 16:00:46.673204 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1d8cf310-88d2-4a5c-a2d9-2807cd409f37" path="/var/lib/kubelet/pods/1d8cf310-88d2-4a5c-a2d9-2807cd409f37/volumes" Mar 16 16:00:46 crc kubenswrapper[5120]: I0316 16:00:46.674266 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5da6e8f8-fa80-477a-bbf9-0e251dd24153" path="/var/lib/kubelet/pods/5da6e8f8-fa80-477a-bbf9-0e251dd24153/volumes" Mar 16 16:00:46 crc kubenswrapper[5120]: I0316 16:00:46.674827 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="63972b06-4c5e-40e4-a318-8e5f3e286ece" path="/var/lib/kubelet/pods/63972b06-4c5e-40e4-a318-8e5f3e286ece/volumes" Mar 16 16:00:46 crc kubenswrapper[5120]: I0316 16:00:46.676056 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="65f5015a-d673-4a1d-bd09-c695f2b41a47" path="/var/lib/kubelet/pods/65f5015a-d673-4a1d-bd09-c695f2b41a47/volumes" Mar 16 16:00:46 crc kubenswrapper[5120]: I0316 16:00:46.676693 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="725b915c-7c39-43e6-8022-99dd14a6276e" path="/var/lib/kubelet/pods/725b915c-7c39-43e6-8022-99dd14a6276e/volumes" Mar 16 16:00:46 crc kubenswrapper[5120]: I0316 16:00:46.678495 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca4a5201-32c6-4c58-8bac-4d1b05ddfbb4" path="/var/lib/kubelet/pods/ca4a5201-32c6-4c58-8bac-4d1b05ddfbb4/volumes" Mar 16 16:00:46 crc kubenswrapper[5120]: I0316 16:00:46.679487 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f80a9ef7-32f9-44c7-945c-d1ee96105c42" path="/var/lib/kubelet/pods/f80a9ef7-32f9-44c7-945c-d1ee96105c42/volumes" Mar 16 16:00:48 crc kubenswrapper[5120]: I0316 16:00:48.073227 5120 scope.go:117] "RemoveContainer" containerID="8331d515f903c421e50ffd2fd9f7943630b40337cafd0a18ec3d6ecacfb5bf37" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.105345 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.107738 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="725b915c-7c39-43e6-8022-99dd14a6276e" containerName="container-replicator" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.107792 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="725b915c-7c39-43e6-8022-99dd14a6276e" containerName="container-replicator" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.107819 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f80a9ef7-32f9-44c7-945c-d1ee96105c42" containerName="probe" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.107829 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f80a9ef7-32f9-44c7-945c-d1ee96105c42" containerName="probe" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.107843 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d8cf310-88d2-4a5c-a2d9-2807cd409f37" containerName="ceilometer-notification-agent" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.107856 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d8cf310-88d2-4a5c-a2d9-2807cd409f37" containerName="ceilometer-notification-agent" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.107879 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="725b915c-7c39-43e6-8022-99dd14a6276e" containerName="object-auditor" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.107889 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="725b915c-7c39-43e6-8022-99dd14a6276e" containerName="object-auditor" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.107906 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5da6e8f8-fa80-477a-bbf9-0e251dd24153" containerName="nova-cell0-conductor-conductor" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.107916 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="5da6e8f8-fa80-477a-bbf9-0e251dd24153" containerName="nova-cell0-conductor-conductor" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.107930 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b97c2a0c-dcad-4453-8063-d1bbcb265531" containerName="galera" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.107940 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="b97c2a0c-dcad-4453-8063-d1bbcb265531" containerName="galera" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.107961 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="725b915c-7c39-43e6-8022-99dd14a6276e" containerName="account-server" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.107971 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="725b915c-7c39-43e6-8022-99dd14a6276e" containerName="account-server" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.107986 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f390644-a67b-42f8-b1d7-f8debbfee112" containerName="init" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.107996 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f390644-a67b-42f8-b1d7-f8debbfee112" containerName="init" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.108011 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="775fa932-80b8-4fd0-946e-09177e8710fb" containerName="glance-httpd" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.108022 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="775fa932-80b8-4fd0-946e-09177e8710fb" containerName="glance-httpd" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.108041 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="725b915c-7c39-43e6-8022-99dd14a6276e" containerName="account-replicator" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.108050 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="725b915c-7c39-43e6-8022-99dd14a6276e" containerName="account-replicator" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.108066 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="725b915c-7c39-43e6-8022-99dd14a6276e" containerName="object-updater" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.108077 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="725b915c-7c39-43e6-8022-99dd14a6276e" containerName="object-updater" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.108089 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65f5015a-d673-4a1d-bd09-c695f2b41a47" containerName="neutron-httpd" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.108100 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="65f5015a-d673-4a1d-bd09-c695f2b41a47" containerName="neutron-httpd" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.108120 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe" containerName="cinder-api-log" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.108131 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe" containerName="cinder-api-log" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.108148 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b97c2a0c-dcad-4453-8063-d1bbcb265531" containerName="mysql-bootstrap" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.108159 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="b97c2a0c-dcad-4453-8063-d1bbcb265531" containerName="mysql-bootstrap" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.108181 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0983bdb-df60-4951-aa31-672444ba7c32" containerName="glance-httpd" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.108191 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0983bdb-df60-4951-aa31-672444ba7c32" containerName="glance-httpd" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.108206 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5664a123-9ba3-41e9-8dab-49276b5e404e" containerName="memcached" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.108220 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="5664a123-9ba3-41e9-8dab-49276b5e404e" containerName="memcached" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.108233 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57a83a83-de95-43e1-b18c-a7b59c4d1a3b" containerName="keystone-api" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.108243 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="57a83a83-de95-43e1-b18c-a7b59c4d1a3b" containerName="keystone-api" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.108258 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="188dbfe0-6d71-4ba4-a3b7-6ee900a60138" containerName="nova-api-api" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.108268 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="188dbfe0-6d71-4ba4-a3b7-6ee900a60138" containerName="nova-api-api" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.108288 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d8cf310-88d2-4a5c-a2d9-2807cd409f37" containerName="ceilometer-central-agent" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.108298 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d8cf310-88d2-4a5c-a2d9-2807cd409f37" containerName="ceilometer-central-agent" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.108313 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="725b915c-7c39-43e6-8022-99dd14a6276e" containerName="object-server" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.108323 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="725b915c-7c39-43e6-8022-99dd14a6276e" containerName="object-server" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.108340 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65f5015a-d673-4a1d-bd09-c695f2b41a47" containerName="neutron-api" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.108350 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="65f5015a-d673-4a1d-bd09-c695f2b41a47" containerName="neutron-api" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.108365 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea0301d9-a692-4b65-ba34-5e989769d02c" containerName="barbican-api" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.108376 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea0301d9-a692-4b65-ba34-5e989769d02c" containerName="barbican-api" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.108394 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a1fe07d-3cc8-4eea-8e8b-eb2807caa357" containerName="openstack-network-exporter" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.108430 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a1fe07d-3cc8-4eea-8e8b-eb2807caa357" containerName="openstack-network-exporter" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.108456 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c568edd3-501f-4254-ae95-67946f898cd3" containerName="nova-metadata-log" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.108467 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c568edd3-501f-4254-ae95-67946f898cd3" containerName="nova-metadata-log" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.108483 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3794e20-01dd-453a-bf29-20813144c61b" containerName="barbican-keystone-listener-log" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.108495 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3794e20-01dd-453a-bf29-20813144c61b" containerName="barbican-keystone-listener-log" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.108517 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="492ba9f3-6479-432b-a2f4-cee712a51800" containerName="setup-container" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.108528 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="492ba9f3-6479-432b-a2f4-cee712a51800" containerName="setup-container" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.108618 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="725b915c-7c39-43e6-8022-99dd14a6276e" containerName="object-replicator" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.108631 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="725b915c-7c39-43e6-8022-99dd14a6276e" containerName="object-replicator" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.108647 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="725b915c-7c39-43e6-8022-99dd14a6276e" containerName="swift-recon-cron" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.108658 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="725b915c-7c39-43e6-8022-99dd14a6276e" containerName="swift-recon-cron" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.108674 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a1fe07d-3cc8-4eea-8e8b-eb2807caa357" containerName="ovn-northd" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.108683 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a1fe07d-3cc8-4eea-8e8b-eb2807caa357" containerName="ovn-northd" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.108696 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c568edd3-501f-4254-ae95-67946f898cd3" containerName="nova-metadata-metadata" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.108707 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c568edd3-501f-4254-ae95-67946f898cd3" containerName="nova-metadata-metadata" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.108721 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="725b915c-7c39-43e6-8022-99dd14a6276e" containerName="object-expirer" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.108732 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="725b915c-7c39-43e6-8022-99dd14a6276e" containerName="object-expirer" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.108749 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3689d41-4ea9-4076-9b69-4a93be5896cf" containerName="placement-api" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.108785 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3689d41-4ea9-4076-9b69-4a93be5896cf" containerName="placement-api" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.108803 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d8cf310-88d2-4a5c-a2d9-2807cd409f37" containerName="proxy-httpd" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.108814 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d8cf310-88d2-4a5c-a2d9-2807cd409f37" containerName="proxy-httpd" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.108833 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f80a9ef7-32f9-44c7-945c-d1ee96105c42" containerName="cinder-scheduler" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.108843 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f80a9ef7-32f9-44c7-945c-d1ee96105c42" containerName="cinder-scheduler" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.108860 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="725b915c-7c39-43e6-8022-99dd14a6276e" containerName="account-reaper" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.108870 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="725b915c-7c39-43e6-8022-99dd14a6276e" containerName="account-reaper" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.108886 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea0301d9-a692-4b65-ba34-5e989769d02c" containerName="barbican-api-log" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.108898 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea0301d9-a692-4b65-ba34-5e989769d02c" containerName="barbican-api-log" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.108918 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="725b915c-7c39-43e6-8022-99dd14a6276e" containerName="container-server" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.108928 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="725b915c-7c39-43e6-8022-99dd14a6276e" containerName="container-server" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.108942 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="492ba9f3-6479-432b-a2f4-cee712a51800" containerName="rabbitmq" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.108954 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="492ba9f3-6479-432b-a2f4-cee712a51800" containerName="rabbitmq" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.108975 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca4a5201-32c6-4c58-8bac-4d1b05ddfbb4" containerName="nova-scheduler-scheduler" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.108986 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca4a5201-32c6-4c58-8bac-4d1b05ddfbb4" containerName="nova-scheduler-scheduler" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.109002 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3794e20-01dd-453a-bf29-20813144c61b" containerName="barbican-keystone-listener" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.109013 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3794e20-01dd-453a-bf29-20813144c61b" containerName="barbican-keystone-listener" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.109031 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe" containerName="cinder-api" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.109041 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe" containerName="cinder-api" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.109053 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="725b915c-7c39-43e6-8022-99dd14a6276e" containerName="container-auditor" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.109063 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="725b915c-7c39-43e6-8022-99dd14a6276e" containerName="container-auditor" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.109079 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="188dbfe0-6d71-4ba4-a3b7-6ee900a60138" containerName="nova-api-log" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.109091 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="188dbfe0-6d71-4ba4-a3b7-6ee900a60138" containerName="nova-api-log" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.109108 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6cf92fd-a58b-4b50-9a61-35486c401d72" containerName="setup-container" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.109118 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6cf92fd-a58b-4b50-9a61-35486c401d72" containerName="setup-container" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.109140 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0983bdb-df60-4951-aa31-672444ba7c32" containerName="glance-log" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.109150 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0983bdb-df60-4951-aa31-672444ba7c32" containerName="glance-log" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.109172 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6cf92fd-a58b-4b50-9a61-35486c401d72" containerName="rabbitmq" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.109182 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6cf92fd-a58b-4b50-9a61-35486c401d72" containerName="rabbitmq" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.109199 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d8cf310-88d2-4a5c-a2d9-2807cd409f37" containerName="sg-core" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.109209 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d8cf310-88d2-4a5c-a2d9-2807cd409f37" containerName="sg-core" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.109223 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="725b915c-7c39-43e6-8022-99dd14a6276e" containerName="rsync" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.109232 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="725b915c-7c39-43e6-8022-99dd14a6276e" containerName="rsync" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.109251 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3689d41-4ea9-4076-9b69-4a93be5896cf" containerName="placement-log" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.109261 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3689d41-4ea9-4076-9b69-4a93be5896cf" containerName="placement-log" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.109279 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f390644-a67b-42f8-b1d7-f8debbfee112" containerName="dnsmasq-dns" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.109288 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f390644-a67b-42f8-b1d7-f8debbfee112" containerName="dnsmasq-dns" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.109299 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="775fa932-80b8-4fd0-946e-09177e8710fb" containerName="glance-log" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.109311 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="775fa932-80b8-4fd0-946e-09177e8710fb" containerName="glance-log" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.109326 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63972b06-4c5e-40e4-a318-8e5f3e286ece" containerName="nova-cell1-conductor-conductor" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.109337 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="63972b06-4c5e-40e4-a318-8e5f3e286ece" containerName="nova-cell1-conductor-conductor" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.109358 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="725b915c-7c39-43e6-8022-99dd14a6276e" containerName="account-auditor" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.109371 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="725b915c-7c39-43e6-8022-99dd14a6276e" containerName="account-auditor" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.109383 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="725b915c-7c39-43e6-8022-99dd14a6276e" containerName="container-updater" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.109394 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="725b915c-7c39-43e6-8022-99dd14a6276e" containerName="container-updater" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.118939 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="775fa932-80b8-4fd0-946e-09177e8710fb" containerName="glance-httpd" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.119001 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="3a1fe07d-3cc8-4eea-8e8b-eb2807caa357" containerName="ovn-northd" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.119013 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="b3794e20-01dd-453a-bf29-20813144c61b" containerName="barbican-keystone-listener-log" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.119034 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f80a9ef7-32f9-44c7-945c-d1ee96105c42" containerName="cinder-scheduler" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.119045 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="725b915c-7c39-43e6-8022-99dd14a6276e" containerName="object-server" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.119054 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f80a9ef7-32f9-44c7-945c-d1ee96105c42" containerName="probe" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.119064 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="725b915c-7c39-43e6-8022-99dd14a6276e" containerName="object-updater" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.119075 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1d8cf310-88d2-4a5c-a2d9-2807cd409f37" containerName="ceilometer-central-agent" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.119083 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c568edd3-501f-4254-ae95-67946f898cd3" containerName="nova-metadata-log" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.119092 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="725b915c-7c39-43e6-8022-99dd14a6276e" containerName="swift-recon-cron" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.119100 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c3689d41-4ea9-4076-9b69-4a93be5896cf" containerName="placement-log" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.119107 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1d8cf310-88d2-4a5c-a2d9-2807cd409f37" containerName="ceilometer-notification-agent" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.119115 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="a0983bdb-df60-4951-aa31-672444ba7c32" containerName="glance-log" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.119126 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c3689d41-4ea9-4076-9b69-4a93be5896cf" containerName="placement-api" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.119136 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="57a83a83-de95-43e1-b18c-a7b59c4d1a3b" containerName="keystone-api" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.119143 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="65f5015a-d673-4a1d-bd09-c695f2b41a47" containerName="neutron-httpd" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.119210 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ea0301d9-a692-4b65-ba34-5e989769d02c" containerName="barbican-api" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.119221 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="63972b06-4c5e-40e4-a318-8e5f3e286ece" containerName="nova-cell1-conductor-conductor" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.119228 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="5664a123-9ba3-41e9-8dab-49276b5e404e" containerName="memcached" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.119238 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="492ba9f3-6479-432b-a2f4-cee712a51800" containerName="rabbitmq" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.119247 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="3a1fe07d-3cc8-4eea-8e8b-eb2807caa357" containerName="openstack-network-exporter" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.119257 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe" containerName="cinder-api" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.119266 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="725b915c-7c39-43e6-8022-99dd14a6276e" containerName="container-server" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.119274 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="188dbfe0-6d71-4ba4-a3b7-6ee900a60138" containerName="nova-api-api" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.119284 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="725b915c-7c39-43e6-8022-99dd14a6276e" containerName="object-expirer" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.119293 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="725b915c-7c39-43e6-8022-99dd14a6276e" containerName="rsync" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.119300 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c568edd3-501f-4254-ae95-67946f898cd3" containerName="nova-metadata-metadata" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.119307 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ea0301d9-a692-4b65-ba34-5e989769d02c" containerName="barbican-api-log" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.119317 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="725b915c-7c39-43e6-8022-99dd14a6276e" containerName="object-auditor" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.119324 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="725b915c-7c39-43e6-8022-99dd14a6276e" containerName="container-replicator" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.119337 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="b97c2a0c-dcad-4453-8063-d1bbcb265531" containerName="galera" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.119345 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="725b915c-7c39-43e6-8022-99dd14a6276e" containerName="object-replicator" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.119352 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="6f390644-a67b-42f8-b1d7-f8debbfee112" containerName="dnsmasq-dns" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.119360 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="188dbfe0-6d71-4ba4-a3b7-6ee900a60138" containerName="nova-api-log" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.119368 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="a0983bdb-df60-4951-aa31-672444ba7c32" containerName="glance-httpd" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.119374 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="5da6e8f8-fa80-477a-bbf9-0e251dd24153" containerName="nova-cell0-conductor-conductor" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.119383 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="725b915c-7c39-43e6-8022-99dd14a6276e" containerName="container-updater" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.119392 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1d8cf310-88d2-4a5c-a2d9-2807cd409f37" containerName="sg-core" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.119402 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="725b915c-7c39-43e6-8022-99dd14a6276e" containerName="account-server" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.119410 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1d8cf310-88d2-4a5c-a2d9-2807cd409f37" containerName="proxy-httpd" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.119420 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="725b915c-7c39-43e6-8022-99dd14a6276e" containerName="account-replicator" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.119427 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="b6cf92fd-a58b-4b50-9a61-35486c401d72" containerName="rabbitmq" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.119435 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="775fa932-80b8-4fd0-946e-09177e8710fb" containerName="glance-log" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.119444 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1aa827cf-9b69-4b57-85bc-5a6a46cd6cbe" containerName="cinder-api-log" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.119453 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="725b915c-7c39-43e6-8022-99dd14a6276e" containerName="account-auditor" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.119459 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="b3794e20-01dd-453a-bf29-20813144c61b" containerName="barbican-keystone-listener" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.119467 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="725b915c-7c39-43e6-8022-99dd14a6276e" containerName="container-auditor" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.119477 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="725b915c-7c39-43e6-8022-99dd14a6276e" containerName="account-reaper" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.119484 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ca4a5201-32c6-4c58-8bac-4d1b05ddfbb4" containerName="nova-scheduler-scheduler" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.119491 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="65f5015a-d673-4a1d-bd09-c695f2b41a47" containerName="neutron-api" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.158292 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.158481 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.161282 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-default-user\"" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.161335 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-plugins-conf\"" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.161393 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-server-dockercfg-gvj78\"" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.161687 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-rabbitmq-svc\"" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.161734 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-server-conf\"" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.161829 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-erlang-cookie\"" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.161903 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-config-data\"" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.275008 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/733010bf-0110-4a60-adf6-0f0ee336e96e-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"733010bf-0110-4a60-adf6-0f0ee336e96e\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.275061 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/733010bf-0110-4a60-adf6-0f0ee336e96e-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"733010bf-0110-4a60-adf6-0f0ee336e96e\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.275086 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/733010bf-0110-4a60-adf6-0f0ee336e96e-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"733010bf-0110-4a60-adf6-0f0ee336e96e\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.275202 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/733010bf-0110-4a60-adf6-0f0ee336e96e-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"733010bf-0110-4a60-adf6-0f0ee336e96e\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.275315 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/733010bf-0110-4a60-adf6-0f0ee336e96e-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"733010bf-0110-4a60-adf6-0f0ee336e96e\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.275391 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4gz6\" (UniqueName: \"kubernetes.io/projected/733010bf-0110-4a60-adf6-0f0ee336e96e-kube-api-access-p4gz6\") pod \"rabbitmq-server-0\" (UID: \"733010bf-0110-4a60-adf6-0f0ee336e96e\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.275597 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/733010bf-0110-4a60-adf6-0f0ee336e96e-config-data\") pod \"rabbitmq-server-0\" (UID: \"733010bf-0110-4a60-adf6-0f0ee336e96e\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.275659 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/733010bf-0110-4a60-adf6-0f0ee336e96e-pod-info\") pod \"rabbitmq-server-0\" (UID: \"733010bf-0110-4a60-adf6-0f0ee336e96e\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.275803 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/733010bf-0110-4a60-adf6-0f0ee336e96e-server-conf\") pod \"rabbitmq-server-0\" (UID: \"733010bf-0110-4a60-adf6-0f0ee336e96e\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.275824 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/733010bf-0110-4a60-adf6-0f0ee336e96e-rabbitmq-tls\") pod \"rabbitmq-server-0\" (UID: \"733010bf-0110-4a60-adf6-0f0ee336e96e\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.275870 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"rabbitmq-server-0\" (UID: \"733010bf-0110-4a60-adf6-0f0ee336e96e\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.351096 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.360432 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.360622 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.367802 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-cell1-default-user\"" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.367976 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-cell1-server-conf\"" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.368071 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-rabbitmq-cell1-svc\"" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.368132 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-cell1-server-dockercfg-t22c6\"" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.368200 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-cell1-plugins-conf\"" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.368228 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-cell1-erlang-cookie\"" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.368354 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-cell1-config-data\"" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.377371 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/733010bf-0110-4a60-adf6-0f0ee336e96e-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"733010bf-0110-4a60-adf6-0f0ee336e96e\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.377411 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/733010bf-0110-4a60-adf6-0f0ee336e96e-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"733010bf-0110-4a60-adf6-0f0ee336e96e\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.377433 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/733010bf-0110-4a60-adf6-0f0ee336e96e-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"733010bf-0110-4a60-adf6-0f0ee336e96e\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.377452 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/733010bf-0110-4a60-adf6-0f0ee336e96e-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"733010bf-0110-4a60-adf6-0f0ee336e96e\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.377477 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/733010bf-0110-4a60-adf6-0f0ee336e96e-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"733010bf-0110-4a60-adf6-0f0ee336e96e\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.377501 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p4gz6\" (UniqueName: \"kubernetes.io/projected/733010bf-0110-4a60-adf6-0f0ee336e96e-kube-api-access-p4gz6\") pod \"rabbitmq-server-0\" (UID: \"733010bf-0110-4a60-adf6-0f0ee336e96e\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.377542 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/733010bf-0110-4a60-adf6-0f0ee336e96e-config-data\") pod \"rabbitmq-server-0\" (UID: \"733010bf-0110-4a60-adf6-0f0ee336e96e\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.377562 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/733010bf-0110-4a60-adf6-0f0ee336e96e-pod-info\") pod \"rabbitmq-server-0\" (UID: \"733010bf-0110-4a60-adf6-0f0ee336e96e\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.377605 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/733010bf-0110-4a60-adf6-0f0ee336e96e-server-conf\") pod \"rabbitmq-server-0\" (UID: \"733010bf-0110-4a60-adf6-0f0ee336e96e\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.377620 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/733010bf-0110-4a60-adf6-0f0ee336e96e-rabbitmq-tls\") pod \"rabbitmq-server-0\" (UID: \"733010bf-0110-4a60-adf6-0f0ee336e96e\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.377650 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"rabbitmq-server-0\" (UID: \"733010bf-0110-4a60-adf6-0f0ee336e96e\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.378034 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"rabbitmq-server-0\" (UID: \"733010bf-0110-4a60-adf6-0f0ee336e96e\") device mount path \"/mnt/openstack/pv03\"" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.378301 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/733010bf-0110-4a60-adf6-0f0ee336e96e-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"733010bf-0110-4a60-adf6-0f0ee336e96e\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.380232 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/733010bf-0110-4a60-adf6-0f0ee336e96e-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"733010bf-0110-4a60-adf6-0f0ee336e96e\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.382520 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/733010bf-0110-4a60-adf6-0f0ee336e96e-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"733010bf-0110-4a60-adf6-0f0ee336e96e\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.384571 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/733010bf-0110-4a60-adf6-0f0ee336e96e-server-conf\") pod \"rabbitmq-server-0\" (UID: \"733010bf-0110-4a60-adf6-0f0ee336e96e\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.387917 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/733010bf-0110-4a60-adf6-0f0ee336e96e-config-data\") pod \"rabbitmq-server-0\" (UID: \"733010bf-0110-4a60-adf6-0f0ee336e96e\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.389823 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/733010bf-0110-4a60-adf6-0f0ee336e96e-rabbitmq-tls\") pod \"rabbitmq-server-0\" (UID: \"733010bf-0110-4a60-adf6-0f0ee336e96e\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.390024 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/733010bf-0110-4a60-adf6-0f0ee336e96e-pod-info\") pod \"rabbitmq-server-0\" (UID: \"733010bf-0110-4a60-adf6-0f0ee336e96e\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.390247 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/733010bf-0110-4a60-adf6-0f0ee336e96e-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"733010bf-0110-4a60-adf6-0f0ee336e96e\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.392891 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/733010bf-0110-4a60-adf6-0f0ee336e96e-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"733010bf-0110-4a60-adf6-0f0ee336e96e\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.406650 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4gz6\" (UniqueName: \"kubernetes.io/projected/733010bf-0110-4a60-adf6-0f0ee336e96e-kube-api-access-p4gz6\") pod \"rabbitmq-server-0\" (UID: \"733010bf-0110-4a60-adf6-0f0ee336e96e\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.412210 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"rabbitmq-server-0\" (UID: \"733010bf-0110-4a60-adf6-0f0ee336e96e\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.479236 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40-config-data\") pod \"rabbitmq-cell1-server-0\" (UID: \"5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.479791 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40-rabbitmq-erlang-cookie\") pod \"rabbitmq-cell1-server-0\" (UID: \"5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.479855 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40-server-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.480110 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40-erlang-cookie-secret\") pod \"rabbitmq-cell1-server-0\" (UID: \"5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.480223 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40-pod-info\") pod \"rabbitmq-cell1-server-0\" (UID: \"5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.480319 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage18-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.480373 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40-rabbitmq-plugins\") pod \"rabbitmq-cell1-server-0\" (UID: \"5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.480411 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40-rabbitmq-tls\") pod \"rabbitmq-cell1-server-0\" (UID: \"5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.480450 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wf4kz\" (UniqueName: \"kubernetes.io/projected/5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40-kube-api-access-wf4kz\") pod \"rabbitmq-cell1-server-0\" (UID: \"5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.480520 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40-plugins-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.480583 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40-rabbitmq-confd\") pod \"rabbitmq-cell1-server-0\" (UID: \"5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.489645 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.581952 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40-erlang-cookie-secret\") pod \"rabbitmq-cell1-server-0\" (UID: \"5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.582029 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40-pod-info\") pod \"rabbitmq-cell1-server-0\" (UID: \"5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.582332 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage18-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40\") device mount path \"/mnt/openstack/pv18\"" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.582074 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage18-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.584182 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40-rabbitmq-plugins\") pod \"rabbitmq-cell1-server-0\" (UID: \"5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.584255 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40-rabbitmq-tls\") pod \"rabbitmq-cell1-server-0\" (UID: \"5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.584339 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wf4kz\" (UniqueName: \"kubernetes.io/projected/5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40-kube-api-access-wf4kz\") pod \"rabbitmq-cell1-server-0\" (UID: \"5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.584466 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40-plugins-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.584565 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40-rabbitmq-confd\") pod \"rabbitmq-cell1-server-0\" (UID: \"5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.584798 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40-config-data\") pod \"rabbitmq-cell1-server-0\" (UID: \"5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.584892 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40-rabbitmq-erlang-cookie\") pod \"rabbitmq-cell1-server-0\" (UID: \"5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.584993 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40-server-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.585187 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40-rabbitmq-plugins\") pod \"rabbitmq-cell1-server-0\" (UID: \"5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.586073 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40-rabbitmq-erlang-cookie\") pod \"rabbitmq-cell1-server-0\" (UID: \"5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.586362 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40-config-data\") pod \"rabbitmq-cell1-server-0\" (UID: \"5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.587031 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40-plugins-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.587536 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40-server-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.589429 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40-erlang-cookie-secret\") pod \"rabbitmq-cell1-server-0\" (UID: \"5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.589494 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40-rabbitmq-tls\") pod \"rabbitmq-cell1-server-0\" (UID: \"5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.590491 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40-rabbitmq-confd\") pod \"rabbitmq-cell1-server-0\" (UID: \"5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.591639 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40-pod-info\") pod \"rabbitmq-cell1-server-0\" (UID: \"5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.614225 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wf4kz\" (UniqueName: \"kubernetes.io/projected/5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40-kube-api-access-wf4kz\") pod \"rabbitmq-cell1-server-0\" (UID: \"5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.627644 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage18-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.694422 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.764990 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.773937 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.777031 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-config-data\"" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.777256 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"galera-openstack-dockercfg-gtkz9\"" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.777400 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-galera-openstack-svc\"" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.777738 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-scripts\"" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.784696 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"combined-ca-bundle\"" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.787965 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.893861 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/68f2feef-cf44-429c-a9be-314c030d3321-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"68f2feef-cf44-429c-a9be-314c030d3321\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.893940 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/68f2feef-cf44-429c-a9be-314c030d3321-config-data-generated\") pod \"openstack-galera-0\" (UID: \"68f2feef-cf44-429c-a9be-314c030d3321\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.893968 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"openstack-galera-0\" (UID: \"68f2feef-cf44-429c-a9be-314c030d3321\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.893984 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nw6vv\" (UniqueName: \"kubernetes.io/projected/68f2feef-cf44-429c-a9be-314c030d3321-kube-api-access-nw6vv\") pod \"openstack-galera-0\" (UID: \"68f2feef-cf44-429c-a9be-314c030d3321\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.894012 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/68f2feef-cf44-429c-a9be-314c030d3321-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"68f2feef-cf44-429c-a9be-314c030d3321\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.894032 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/68f2feef-cf44-429c-a9be-314c030d3321-operator-scripts\") pod \"openstack-galera-0\" (UID: \"68f2feef-cf44-429c-a9be-314c030d3321\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.894053 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/68f2feef-cf44-429c-a9be-314c030d3321-config-data-default\") pod \"openstack-galera-0\" (UID: \"68f2feef-cf44-429c-a9be-314c030d3321\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.894113 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/68f2feef-cf44-429c-a9be-314c030d3321-kolla-config\") pod \"openstack-galera-0\" (UID: \"68f2feef-cf44-429c-a9be-314c030d3321\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.995560 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"openstack-galera-0\" (UID: \"68f2feef-cf44-429c-a9be-314c030d3321\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.995609 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nw6vv\" (UniqueName: \"kubernetes.io/projected/68f2feef-cf44-429c-a9be-314c030d3321-kube-api-access-nw6vv\") pod \"openstack-galera-0\" (UID: \"68f2feef-cf44-429c-a9be-314c030d3321\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.995641 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/68f2feef-cf44-429c-a9be-314c030d3321-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"68f2feef-cf44-429c-a9be-314c030d3321\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.995868 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/68f2feef-cf44-429c-a9be-314c030d3321-operator-scripts\") pod \"openstack-galera-0\" (UID: \"68f2feef-cf44-429c-a9be-314c030d3321\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.995938 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/68f2feef-cf44-429c-a9be-314c030d3321-config-data-default\") pod \"openstack-galera-0\" (UID: \"68f2feef-cf44-429c-a9be-314c030d3321\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.996058 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/68f2feef-cf44-429c-a9be-314c030d3321-kolla-config\") pod \"openstack-galera-0\" (UID: \"68f2feef-cf44-429c-a9be-314c030d3321\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.996044 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"openstack-galera-0\" (UID: \"68f2feef-cf44-429c-a9be-314c030d3321\") device mount path \"/mnt/openstack/pv04\"" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.996267 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/68f2feef-cf44-429c-a9be-314c030d3321-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"68f2feef-cf44-429c-a9be-314c030d3321\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.996374 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/68f2feef-cf44-429c-a9be-314c030d3321-config-data-generated\") pod \"openstack-galera-0\" (UID: \"68f2feef-cf44-429c-a9be-314c030d3321\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.996794 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/68f2feef-cf44-429c-a9be-314c030d3321-config-data-generated\") pod \"openstack-galera-0\" (UID: \"68f2feef-cf44-429c-a9be-314c030d3321\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.996859 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/68f2feef-cf44-429c-a9be-314c030d3321-kolla-config\") pod \"openstack-galera-0\" (UID: \"68f2feef-cf44-429c-a9be-314c030d3321\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.997028 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/68f2feef-cf44-429c-a9be-314c030d3321-config-data-default\") pod \"openstack-galera-0\" (UID: \"68f2feef-cf44-429c-a9be-314c030d3321\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:00:54 crc kubenswrapper[5120]: I0316 16:00:54.997359 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/68f2feef-cf44-429c-a9be-314c030d3321-operator-scripts\") pod \"openstack-galera-0\" (UID: \"68f2feef-cf44-429c-a9be-314c030d3321\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:00:55 crc kubenswrapper[5120]: I0316 16:00:55.004479 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/68f2feef-cf44-429c-a9be-314c030d3321-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"68f2feef-cf44-429c-a9be-314c030d3321\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:00:55 crc kubenswrapper[5120]: I0316 16:00:55.007394 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/68f2feef-cf44-429c-a9be-314c030d3321-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"68f2feef-cf44-429c-a9be-314c030d3321\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:00:55 crc kubenswrapper[5120]: I0316 16:00:55.007839 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 16:00:55 crc kubenswrapper[5120]: W0316 16:00:55.034931 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod733010bf_0110_4a60_adf6_0f0ee336e96e.slice/crio-fcec26a2bad396005d68f5e008fd71acdb2d27a79a808582cd7a044c60c175dc WatchSource:0}: Error finding container fcec26a2bad396005d68f5e008fd71acdb2d27a79a808582cd7a044c60c175dc: Status 404 returned error can't find the container with id fcec26a2bad396005d68f5e008fd71acdb2d27a79a808582cd7a044c60c175dc Mar 16 16:00:55 crc kubenswrapper[5120]: I0316 16:00:55.046923 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nw6vv\" (UniqueName: \"kubernetes.io/projected/68f2feef-cf44-429c-a9be-314c030d3321-kube-api-access-nw6vv\") pod \"openstack-galera-0\" (UID: \"68f2feef-cf44-429c-a9be-314c030d3321\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:00:55 crc kubenswrapper[5120]: I0316 16:00:55.048247 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"openstack-galera-0\" (UID: \"68f2feef-cf44-429c-a9be-314c030d3321\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:00:55 crc kubenswrapper[5120]: I0316 16:00:55.094289 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:00:55 crc kubenswrapper[5120]: I0316 16:00:55.188238 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 16:00:55 crc kubenswrapper[5120]: I0316 16:00:55.521426 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 16:00:56 crc kubenswrapper[5120]: I0316 16:00:56.013487 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"733010bf-0110-4a60-adf6-0f0ee336e96e","Type":"ContainerStarted","Data":"fcec26a2bad396005d68f5e008fd71acdb2d27a79a808582cd7a044c60c175dc"} Mar 16 16:00:56 crc kubenswrapper[5120]: I0316 16:00:56.014861 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40","Type":"ContainerStarted","Data":"5a4cc4adfd5dfa20dc1f4638666bc5c6108ceb1c7516e9187b091003427caf43"} Mar 16 16:00:56 crc kubenswrapper[5120]: I0316 16:00:56.016472 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"68f2feef-cf44-429c-a9be-314c030d3321","Type":"ContainerStarted","Data":"dc94898b22a23f2568159753b77f4106cdb5582c395af6560bda6a973f764d6e"} Mar 16 16:00:56 crc kubenswrapper[5120]: I0316 16:00:56.016525 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"68f2feef-cf44-429c-a9be-314c030d3321","Type":"ContainerStarted","Data":"0cbba51570bdc24dd150a9ee0a135a750f466e280dcddd3b0fca754b62a7486d"} Mar 16 16:00:56 crc kubenswrapper[5120]: I0316 16:00:56.135168 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 16:00:56 crc kubenswrapper[5120]: I0316 16:00:56.175429 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 16:00:56 crc kubenswrapper[5120]: I0316 16:00:56.175588 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:00:56 crc kubenswrapper[5120]: I0316 16:00:56.177713 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-galera-openstack-cell1-svc\"" Mar 16 16:00:56 crc kubenswrapper[5120]: I0316 16:00:56.178641 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"galera-openstack-cell1-dockercfg-kmzcz\"" Mar 16 16:00:56 crc kubenswrapper[5120]: I0316 16:00:56.182891 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-cell1-scripts\"" Mar 16 16:00:56 crc kubenswrapper[5120]: I0316 16:00:56.182951 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-cell1-config-data\"" Mar 16 16:00:56 crc kubenswrapper[5120]: I0316 16:00:56.315991 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"openstack-cell1-galera-0\" (UID: \"277044e1-8761-49a5-9b8c-c7bfa9aab448\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:00:56 crc kubenswrapper[5120]: I0316 16:00:56.316085 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6svv\" (UniqueName: \"kubernetes.io/projected/277044e1-8761-49a5-9b8c-c7bfa9aab448-kube-api-access-r6svv\") pod \"openstack-cell1-galera-0\" (UID: \"277044e1-8761-49a5-9b8c-c7bfa9aab448\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:00:56 crc kubenswrapper[5120]: I0316 16:00:56.316112 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/277044e1-8761-49a5-9b8c-c7bfa9aab448-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"277044e1-8761-49a5-9b8c-c7bfa9aab448\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:00:56 crc kubenswrapper[5120]: I0316 16:00:56.316135 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/277044e1-8761-49a5-9b8c-c7bfa9aab448-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"277044e1-8761-49a5-9b8c-c7bfa9aab448\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:00:56 crc kubenswrapper[5120]: I0316 16:00:56.316294 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/277044e1-8761-49a5-9b8c-c7bfa9aab448-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"277044e1-8761-49a5-9b8c-c7bfa9aab448\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:00:56 crc kubenswrapper[5120]: I0316 16:00:56.316342 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/277044e1-8761-49a5-9b8c-c7bfa9aab448-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"277044e1-8761-49a5-9b8c-c7bfa9aab448\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:00:56 crc kubenswrapper[5120]: I0316 16:00:56.316466 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/277044e1-8761-49a5-9b8c-c7bfa9aab448-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"277044e1-8761-49a5-9b8c-c7bfa9aab448\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:00:56 crc kubenswrapper[5120]: I0316 16:00:56.316555 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/277044e1-8761-49a5-9b8c-c7bfa9aab448-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"277044e1-8761-49a5-9b8c-c7bfa9aab448\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:00:56 crc kubenswrapper[5120]: I0316 16:00:56.418127 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/277044e1-8761-49a5-9b8c-c7bfa9aab448-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"277044e1-8761-49a5-9b8c-c7bfa9aab448\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:00:56 crc kubenswrapper[5120]: I0316 16:00:56.418180 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/277044e1-8761-49a5-9b8c-c7bfa9aab448-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"277044e1-8761-49a5-9b8c-c7bfa9aab448\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:00:56 crc kubenswrapper[5120]: I0316 16:00:56.418277 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"openstack-cell1-galera-0\" (UID: \"277044e1-8761-49a5-9b8c-c7bfa9aab448\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:00:56 crc kubenswrapper[5120]: I0316 16:00:56.418328 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r6svv\" (UniqueName: \"kubernetes.io/projected/277044e1-8761-49a5-9b8c-c7bfa9aab448-kube-api-access-r6svv\") pod \"openstack-cell1-galera-0\" (UID: \"277044e1-8761-49a5-9b8c-c7bfa9aab448\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:00:56 crc kubenswrapper[5120]: I0316 16:00:56.418551 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/277044e1-8761-49a5-9b8c-c7bfa9aab448-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"277044e1-8761-49a5-9b8c-c7bfa9aab448\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:00:56 crc kubenswrapper[5120]: I0316 16:00:56.418640 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/277044e1-8761-49a5-9b8c-c7bfa9aab448-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"277044e1-8761-49a5-9b8c-c7bfa9aab448\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:00:56 crc kubenswrapper[5120]: I0316 16:00:56.418740 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/277044e1-8761-49a5-9b8c-c7bfa9aab448-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"277044e1-8761-49a5-9b8c-c7bfa9aab448\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:00:56 crc kubenswrapper[5120]: I0316 16:00:56.418768 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"openstack-cell1-galera-0\" (UID: \"277044e1-8761-49a5-9b8c-c7bfa9aab448\") device mount path \"/mnt/openstack/pv12\"" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:00:56 crc kubenswrapper[5120]: I0316 16:00:56.418807 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/277044e1-8761-49a5-9b8c-c7bfa9aab448-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"277044e1-8761-49a5-9b8c-c7bfa9aab448\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:00:56 crc kubenswrapper[5120]: I0316 16:00:56.418874 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/277044e1-8761-49a5-9b8c-c7bfa9aab448-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"277044e1-8761-49a5-9b8c-c7bfa9aab448\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:00:56 crc kubenswrapper[5120]: I0316 16:00:56.419202 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/277044e1-8761-49a5-9b8c-c7bfa9aab448-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"277044e1-8761-49a5-9b8c-c7bfa9aab448\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:00:56 crc kubenswrapper[5120]: I0316 16:00:56.419566 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/277044e1-8761-49a5-9b8c-c7bfa9aab448-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"277044e1-8761-49a5-9b8c-c7bfa9aab448\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:00:56 crc kubenswrapper[5120]: I0316 16:00:56.420894 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/277044e1-8761-49a5-9b8c-c7bfa9aab448-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"277044e1-8761-49a5-9b8c-c7bfa9aab448\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:00:56 crc kubenswrapper[5120]: I0316 16:00:56.425603 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/277044e1-8761-49a5-9b8c-c7bfa9aab448-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"277044e1-8761-49a5-9b8c-c7bfa9aab448\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:00:56 crc kubenswrapper[5120]: I0316 16:00:56.431734 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/277044e1-8761-49a5-9b8c-c7bfa9aab448-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"277044e1-8761-49a5-9b8c-c7bfa9aab448\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:00:56 crc kubenswrapper[5120]: I0316 16:00:56.434568 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6svv\" (UniqueName: \"kubernetes.io/projected/277044e1-8761-49a5-9b8c-c7bfa9aab448-kube-api-access-r6svv\") pod \"openstack-cell1-galera-0\" (UID: \"277044e1-8761-49a5-9b8c-c7bfa9aab448\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:00:56 crc kubenswrapper[5120]: I0316 16:00:56.462049 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"openstack-cell1-galera-0\" (UID: \"277044e1-8761-49a5-9b8c-c7bfa9aab448\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:00:56 crc kubenswrapper[5120]: I0316 16:00:56.491640 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:00:56 crc kubenswrapper[5120]: I0316 16:00:56.706251 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 16:00:57 crc kubenswrapper[5120]: I0316 16:00:57.028712 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"733010bf-0110-4a60-adf6-0f0ee336e96e","Type":"ContainerStarted","Data":"83541718a4772aeb3e24fc14a61368e286ec061ec2e8d0b2cbc1e307adb6afe1"} Mar 16 16:00:57 crc kubenswrapper[5120]: I0316 16:00:57.030452 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40","Type":"ContainerStarted","Data":"7967968386c8a15eb0601cb98a0edef7d11982ab65155af5b27542488b8f6d10"} Mar 16 16:00:57 crc kubenswrapper[5120]: I0316 16:00:57.034294 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"277044e1-8761-49a5-9b8c-c7bfa9aab448","Type":"ContainerStarted","Data":"d6955eca3e6162a54848b65c3c6759493a8ebfb95a8d90de700706b55bb61b5e"} Mar 16 16:00:57 crc kubenswrapper[5120]: I0316 16:00:57.034345 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"277044e1-8761-49a5-9b8c-c7bfa9aab448","Type":"ContainerStarted","Data":"a32b0f79e810e1bedc5ce12cbb3877f2ef57760c4b4186dce70e5c57838c51ec"} Mar 16 16:00:57 crc kubenswrapper[5120]: I0316 16:00:57.412525 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 16:00:57 crc kubenswrapper[5120]: I0316 16:00:57.418724 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Mar 16 16:00:57 crc kubenswrapper[5120]: I0316 16:00:57.421209 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"memcached-config-data\"" Mar 16 16:00:57 crc kubenswrapper[5120]: I0316 16:00:57.421390 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"memcached-memcached-dockercfg-jfpv2\"" Mar 16 16:00:57 crc kubenswrapper[5120]: I0316 16:00:57.423492 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-memcached-svc\"" Mar 16 16:00:57 crc kubenswrapper[5120]: I0316 16:00:57.427826 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 16:00:57 crc kubenswrapper[5120]: I0316 16:00:57.540113 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9bs2\" (UniqueName: \"kubernetes.io/projected/a4d9ab9b-4831-4be5-968a-10f3d8f3f654-kube-api-access-d9bs2\") pod \"memcached-0\" (UID: \"a4d9ab9b-4831-4be5-968a-10f3d8f3f654\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:00:57 crc kubenswrapper[5120]: I0316 16:00:57.540462 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/a4d9ab9b-4831-4be5-968a-10f3d8f3f654-memcached-tls-certs\") pod \"memcached-0\" (UID: \"a4d9ab9b-4831-4be5-968a-10f3d8f3f654\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:00:57 crc kubenswrapper[5120]: I0316 16:00:57.540551 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/a4d9ab9b-4831-4be5-968a-10f3d8f3f654-config-data\") pod \"memcached-0\" (UID: \"a4d9ab9b-4831-4be5-968a-10f3d8f3f654\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:00:57 crc kubenswrapper[5120]: I0316 16:00:57.540569 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a4d9ab9b-4831-4be5-968a-10f3d8f3f654-combined-ca-bundle\") pod \"memcached-0\" (UID: \"a4d9ab9b-4831-4be5-968a-10f3d8f3f654\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:00:57 crc kubenswrapper[5120]: I0316 16:00:57.540800 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/a4d9ab9b-4831-4be5-968a-10f3d8f3f654-kolla-config\") pod \"memcached-0\" (UID: \"a4d9ab9b-4831-4be5-968a-10f3d8f3f654\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:00:57 crc kubenswrapper[5120]: I0316 16:00:57.643034 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/a4d9ab9b-4831-4be5-968a-10f3d8f3f654-config-data\") pod \"memcached-0\" (UID: \"a4d9ab9b-4831-4be5-968a-10f3d8f3f654\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:00:57 crc kubenswrapper[5120]: I0316 16:00:57.643078 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a4d9ab9b-4831-4be5-968a-10f3d8f3f654-combined-ca-bundle\") pod \"memcached-0\" (UID: \"a4d9ab9b-4831-4be5-968a-10f3d8f3f654\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:00:57 crc kubenswrapper[5120]: I0316 16:00:57.643188 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/a4d9ab9b-4831-4be5-968a-10f3d8f3f654-kolla-config\") pod \"memcached-0\" (UID: \"a4d9ab9b-4831-4be5-968a-10f3d8f3f654\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:00:57 crc kubenswrapper[5120]: I0316 16:00:57.643337 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d9bs2\" (UniqueName: \"kubernetes.io/projected/a4d9ab9b-4831-4be5-968a-10f3d8f3f654-kube-api-access-d9bs2\") pod \"memcached-0\" (UID: \"a4d9ab9b-4831-4be5-968a-10f3d8f3f654\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:00:57 crc kubenswrapper[5120]: I0316 16:00:57.643364 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/a4d9ab9b-4831-4be5-968a-10f3d8f3f654-memcached-tls-certs\") pod \"memcached-0\" (UID: \"a4d9ab9b-4831-4be5-968a-10f3d8f3f654\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:00:57 crc kubenswrapper[5120]: I0316 16:00:57.644030 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/a4d9ab9b-4831-4be5-968a-10f3d8f3f654-config-data\") pod \"memcached-0\" (UID: \"a4d9ab9b-4831-4be5-968a-10f3d8f3f654\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:00:57 crc kubenswrapper[5120]: I0316 16:00:57.644260 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/a4d9ab9b-4831-4be5-968a-10f3d8f3f654-kolla-config\") pod \"memcached-0\" (UID: \"a4d9ab9b-4831-4be5-968a-10f3d8f3f654\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:00:57 crc kubenswrapper[5120]: I0316 16:00:57.649154 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/a4d9ab9b-4831-4be5-968a-10f3d8f3f654-memcached-tls-certs\") pod \"memcached-0\" (UID: \"a4d9ab9b-4831-4be5-968a-10f3d8f3f654\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:00:57 crc kubenswrapper[5120]: I0316 16:00:57.649508 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a4d9ab9b-4831-4be5-968a-10f3d8f3f654-combined-ca-bundle\") pod \"memcached-0\" (UID: \"a4d9ab9b-4831-4be5-968a-10f3d8f3f654\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:00:57 crc kubenswrapper[5120]: I0316 16:00:57.664354 5120 scope.go:117] "RemoveContainer" containerID="02ba4fc3f84eccaecfa9e6618280f65626eb76580c4af9ae7a9d7cb3b8dd590b" Mar 16 16:00:57 crc kubenswrapper[5120]: E0316 16:00:57.664703 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:00:57 crc kubenswrapper[5120]: I0316 16:00:57.665203 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9bs2\" (UniqueName: \"kubernetes.io/projected/a4d9ab9b-4831-4be5-968a-10f3d8f3f654-kube-api-access-d9bs2\") pod \"memcached-0\" (UID: \"a4d9ab9b-4831-4be5-968a-10f3d8f3f654\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:00:57 crc kubenswrapper[5120]: I0316 16:00:57.803922 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Mar 16 16:00:58 crc kubenswrapper[5120]: I0316 16:00:58.263750 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 16:00:58 crc kubenswrapper[5120]: W0316 16:00:58.270682 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda4d9ab9b_4831_4be5_968a_10f3d8f3f654.slice/crio-e4ec017585aa1f942743ef7639545b8815256a243b8ba4c94b419209f0e89bb5 WatchSource:0}: Error finding container e4ec017585aa1f942743ef7639545b8815256a243b8ba4c94b419209f0e89bb5: Status 404 returned error can't find the container with id e4ec017585aa1f942743ef7639545b8815256a243b8ba4c94b419209f0e89bb5 Mar 16 16:00:59 crc kubenswrapper[5120]: I0316 16:00:59.051138 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"a4d9ab9b-4831-4be5-968a-10f3d8f3f654","Type":"ContainerStarted","Data":"3e3059607b850fa6f05558692af36319455c228bff8ca5401cf9ce390e0bb7c2"} Mar 16 16:00:59 crc kubenswrapper[5120]: I0316 16:00:59.051447 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"a4d9ab9b-4831-4be5-968a-10f3d8f3f654","Type":"ContainerStarted","Data":"e4ec017585aa1f942743ef7639545b8815256a243b8ba4c94b419209f0e89bb5"} Mar 16 16:00:59 crc kubenswrapper[5120]: I0316 16:00:59.051600 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/memcached-0" Mar 16 16:00:59 crc kubenswrapper[5120]: I0316 16:00:59.053079 5120 generic.go:358] "Generic (PLEG): container finished" podID="68f2feef-cf44-429c-a9be-314c030d3321" containerID="dc94898b22a23f2568159753b77f4106cdb5582c395af6560bda6a973f764d6e" exitCode=0 Mar 16 16:00:59 crc kubenswrapper[5120]: I0316 16:00:59.053181 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"68f2feef-cf44-429c-a9be-314c030d3321","Type":"ContainerDied","Data":"dc94898b22a23f2568159753b77f4106cdb5582c395af6560bda6a973f764d6e"} Mar 16 16:00:59 crc kubenswrapper[5120]: I0316 16:00:59.078096 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/memcached-0" podStartSLOduration=2.078074459 podStartE2EDuration="2.078074459s" podCreationTimestamp="2026-03-16 16:00:57 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:00:59.066967073 +0000 UTC m=+1761.220898750" watchObservedRunningTime="2026-03-16 16:00:59.078074459 +0000 UTC m=+1761.232006116" Mar 16 16:00:59 crc kubenswrapper[5120]: I0316 16:00:59.509423 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 16:00:59 crc kubenswrapper[5120]: I0316 16:00:59.518021 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:00:59 crc kubenswrapper[5120]: I0316 16:00:59.526417 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"telemetry-ceilometer-dockercfg-jspx5\"" Mar 16 16:00:59 crc kubenswrapper[5120]: I0316 16:00:59.527468 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 16:00:59 crc kubenswrapper[5120]: I0316 16:00:59.690961 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lgkf9\" (UniqueName: \"kubernetes.io/projected/e86380ec-b865-4f35-9a18-c2940e1216cb-kube-api-access-lgkf9\") pod \"kube-state-metrics-0\" (UID: \"e86380ec-b865-4f35-9a18-c2940e1216cb\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:00:59 crc kubenswrapper[5120]: I0316 16:00:59.792631 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lgkf9\" (UniqueName: \"kubernetes.io/projected/e86380ec-b865-4f35-9a18-c2940e1216cb-kube-api-access-lgkf9\") pod \"kube-state-metrics-0\" (UID: \"e86380ec-b865-4f35-9a18-c2940e1216cb\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:00:59 crc kubenswrapper[5120]: I0316 16:00:59.812688 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lgkf9\" (UniqueName: \"kubernetes.io/projected/e86380ec-b865-4f35-9a18-c2940e1216cb-kube-api-access-lgkf9\") pod \"kube-state-metrics-0\" (UID: \"e86380ec-b865-4f35-9a18-c2940e1216cb\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:00:59 crc kubenswrapper[5120]: I0316 16:00:59.847996 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:01:00 crc kubenswrapper[5120]: I0316 16:01:00.067384 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"68f2feef-cf44-429c-a9be-314c030d3321","Type":"ContainerStarted","Data":"c683124880345205c66d9890cec10cea0579b1b47b25532fe5d6ff8e12cfc801"} Mar 16 16:01:00 crc kubenswrapper[5120]: I0316 16:01:00.073399 5120 generic.go:358] "Generic (PLEG): container finished" podID="277044e1-8761-49a5-9b8c-c7bfa9aab448" containerID="d6955eca3e6162a54848b65c3c6759493a8ebfb95a8d90de700706b55bb61b5e" exitCode=0 Mar 16 16:01:00 crc kubenswrapper[5120]: I0316 16:01:00.073996 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"277044e1-8761-49a5-9b8c-c7bfa9aab448","Type":"ContainerDied","Data":"d6955eca3e6162a54848b65c3c6759493a8ebfb95a8d90de700706b55bb61b5e"} Mar 16 16:01:00 crc kubenswrapper[5120]: I0316 16:01:00.089018 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstack-galera-0" podStartSLOduration=6.088993892 podStartE2EDuration="6.088993892s" podCreationTimestamp="2026-03-16 16:00:54 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:01:00.086691669 +0000 UTC m=+1762.240623326" watchObservedRunningTime="2026-03-16 16:01:00.088993892 +0000 UTC m=+1762.242925549" Mar 16 16:01:00 crc kubenswrapper[5120]: I0316 16:01:00.280843 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 16:01:00 crc kubenswrapper[5120]: W0316 16:01:00.282409 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode86380ec_b865_4f35_9a18_c2940e1216cb.slice/crio-d7d685db87eac9f89d736c7b9c0106e4ffcb3d6822b41b0f8522c1037067e68f WatchSource:0}: Error finding container d7d685db87eac9f89d736c7b9c0106e4ffcb3d6822b41b0f8522c1037067e68f: Status 404 returned error can't find the container with id d7d685db87eac9f89d736c7b9c0106e4ffcb3d6822b41b0f8522c1037067e68f Mar 16 16:01:00 crc kubenswrapper[5120]: E0316 16:01:00.996287 5120 upgradeaware.go:427] Error proxying data from client to backend: readfrom tcp 38.102.83.119:46588->38.102.83.119:44311: write tcp 38.102.83.119:46588->38.102.83.119:44311: write: broken pipe Mar 16 16:01:01 crc kubenswrapper[5120]: I0316 16:01:01.084429 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"277044e1-8761-49a5-9b8c-c7bfa9aab448","Type":"ContainerStarted","Data":"d1c6a1d2fa78339ecd013f346592c0e6029d63013756dda5a3e91db4f117b7e1"} Mar 16 16:01:01 crc kubenswrapper[5120]: I0316 16:01:01.087687 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"e86380ec-b865-4f35-9a18-c2940e1216cb","Type":"ContainerStarted","Data":"97866483ac4c2f1ecad39d25a9914526fee87e86656eb5258d0b3b4a7e950343"} Mar 16 16:01:01 crc kubenswrapper[5120]: I0316 16:01:01.087743 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"e86380ec-b865-4f35-9a18-c2940e1216cb","Type":"ContainerStarted","Data":"d7d685db87eac9f89d736c7b9c0106e4ffcb3d6822b41b0f8522c1037067e68f"} Mar 16 16:01:01 crc kubenswrapper[5120]: I0316 16:01:01.087782 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:01:01 crc kubenswrapper[5120]: I0316 16:01:01.110406 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstack-cell1-galera-0" podStartSLOduration=5.110388294 podStartE2EDuration="5.110388294s" podCreationTimestamp="2026-03-16 16:00:56 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:01:01.103657688 +0000 UTC m=+1763.257589375" watchObservedRunningTime="2026-03-16 16:01:01.110388294 +0000 UTC m=+1763.264319951" Mar 16 16:01:01 crc kubenswrapper[5120]: I0316 16:01:01.122100 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/kube-state-metrics-0" podStartSLOduration=1.765084679 podStartE2EDuration="2.122082155s" podCreationTimestamp="2026-03-16 16:00:59 +0000 UTC" firstStartedPulling="2026-03-16 16:01:00.28440061 +0000 UTC m=+1762.438332267" lastFinishedPulling="2026-03-16 16:01:00.641398086 +0000 UTC m=+1762.795329743" observedRunningTime="2026-03-16 16:01:01.117056517 +0000 UTC m=+1763.270988174" watchObservedRunningTime="2026-03-16 16:01:01.122082155 +0000 UTC m=+1763.276013832" Mar 16 16:01:02 crc kubenswrapper[5120]: I0316 16:01:02.658997 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 16:01:02 crc kubenswrapper[5120]: I0316 16:01:02.668693 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:01:02 crc kubenswrapper[5120]: I0316 16:01:02.671823 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ovncluster-ovndbcluster-sb-dockercfg-xlc57\"" Mar 16 16:01:02 crc kubenswrapper[5120]: I0316 16:01:02.671896 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ovndbcluster-sb-ovndbs\"" Mar 16 16:01:02 crc kubenswrapper[5120]: I0316 16:01:02.672012 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovndbcluster-sb-config\"" Mar 16 16:01:02 crc kubenswrapper[5120]: I0316 16:01:02.672072 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovndbcluster-sb-scripts\"" Mar 16 16:01:02 crc kubenswrapper[5120]: I0316 16:01:02.675304 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ovn-metrics\"" Mar 16 16:01:02 crc kubenswrapper[5120]: I0316 16:01:02.684480 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 16:01:02 crc kubenswrapper[5120]: I0316 16:01:02.743331 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ba9461bf-d0b6-45c1-bacf-eede3329fba0-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"ba9461bf-d0b6-45c1-bacf-eede3329fba0\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:01:02 crc kubenswrapper[5120]: I0316 16:01:02.743425 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/ba9461bf-d0b6-45c1-bacf-eede3329fba0-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"ba9461bf-d0b6-45c1-bacf-eede3329fba0\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:01:02 crc kubenswrapper[5120]: I0316 16:01:02.743572 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"ovsdbserver-sb-0\" (UID: \"ba9461bf-d0b6-45c1-bacf-eede3329fba0\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:01:02 crc kubenswrapper[5120]: I0316 16:01:02.743637 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/ba9461bf-d0b6-45c1-bacf-eede3329fba0-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"ba9461bf-d0b6-45c1-bacf-eede3329fba0\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:01:02 crc kubenswrapper[5120]: I0316 16:01:02.743719 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/ba9461bf-d0b6-45c1-bacf-eede3329fba0-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"ba9461bf-d0b6-45c1-bacf-eede3329fba0\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:01:02 crc kubenswrapper[5120]: I0316 16:01:02.743884 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/ba9461bf-d0b6-45c1-bacf-eede3329fba0-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"ba9461bf-d0b6-45c1-bacf-eede3329fba0\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:01:02 crc kubenswrapper[5120]: I0316 16:01:02.743955 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6lk9\" (UniqueName: \"kubernetes.io/projected/ba9461bf-d0b6-45c1-bacf-eede3329fba0-kube-api-access-r6lk9\") pod \"ovsdbserver-sb-0\" (UID: \"ba9461bf-d0b6-45c1-bacf-eede3329fba0\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:01:02 crc kubenswrapper[5120]: I0316 16:01:02.744030 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ba9461bf-d0b6-45c1-bacf-eede3329fba0-config\") pod \"ovsdbserver-sb-0\" (UID: \"ba9461bf-d0b6-45c1-bacf-eede3329fba0\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:01:02 crc kubenswrapper[5120]: I0316 16:01:02.845720 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"ovsdbserver-sb-0\" (UID: \"ba9461bf-d0b6-45c1-bacf-eede3329fba0\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:01:02 crc kubenswrapper[5120]: I0316 16:01:02.845799 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/ba9461bf-d0b6-45c1-bacf-eede3329fba0-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"ba9461bf-d0b6-45c1-bacf-eede3329fba0\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:01:02 crc kubenswrapper[5120]: I0316 16:01:02.845943 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/ba9461bf-d0b6-45c1-bacf-eede3329fba0-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"ba9461bf-d0b6-45c1-bacf-eede3329fba0\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:01:02 crc kubenswrapper[5120]: I0316 16:01:02.846062 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/ba9461bf-d0b6-45c1-bacf-eede3329fba0-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"ba9461bf-d0b6-45c1-bacf-eede3329fba0\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:01:02 crc kubenswrapper[5120]: I0316 16:01:02.846115 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r6lk9\" (UniqueName: \"kubernetes.io/projected/ba9461bf-d0b6-45c1-bacf-eede3329fba0-kube-api-access-r6lk9\") pod \"ovsdbserver-sb-0\" (UID: \"ba9461bf-d0b6-45c1-bacf-eede3329fba0\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:01:02 crc kubenswrapper[5120]: I0316 16:01:02.846176 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ba9461bf-d0b6-45c1-bacf-eede3329fba0-config\") pod \"ovsdbserver-sb-0\" (UID: \"ba9461bf-d0b6-45c1-bacf-eede3329fba0\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:01:02 crc kubenswrapper[5120]: I0316 16:01:02.846181 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"ovsdbserver-sb-0\" (UID: \"ba9461bf-d0b6-45c1-bacf-eede3329fba0\") device mount path \"/mnt/openstack/pv05\"" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:01:02 crc kubenswrapper[5120]: I0316 16:01:02.847015 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ba9461bf-d0b6-45c1-bacf-eede3329fba0-config\") pod \"ovsdbserver-sb-0\" (UID: \"ba9461bf-d0b6-45c1-bacf-eede3329fba0\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:01:02 crc kubenswrapper[5120]: I0316 16:01:02.847035 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/ba9461bf-d0b6-45c1-bacf-eede3329fba0-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"ba9461bf-d0b6-45c1-bacf-eede3329fba0\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:01:02 crc kubenswrapper[5120]: I0316 16:01:02.847495 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ba9461bf-d0b6-45c1-bacf-eede3329fba0-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"ba9461bf-d0b6-45c1-bacf-eede3329fba0\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:01:02 crc kubenswrapper[5120]: I0316 16:01:02.847723 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/ba9461bf-d0b6-45c1-bacf-eede3329fba0-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"ba9461bf-d0b6-45c1-bacf-eede3329fba0\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:01:02 crc kubenswrapper[5120]: I0316 16:01:02.848175 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/ba9461bf-d0b6-45c1-bacf-eede3329fba0-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"ba9461bf-d0b6-45c1-bacf-eede3329fba0\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:01:02 crc kubenswrapper[5120]: I0316 16:01:02.852451 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/ba9461bf-d0b6-45c1-bacf-eede3329fba0-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"ba9461bf-d0b6-45c1-bacf-eede3329fba0\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:01:02 crc kubenswrapper[5120]: I0316 16:01:02.854508 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/ba9461bf-d0b6-45c1-bacf-eede3329fba0-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"ba9461bf-d0b6-45c1-bacf-eede3329fba0\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:01:02 crc kubenswrapper[5120]: I0316 16:01:02.866562 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ba9461bf-d0b6-45c1-bacf-eede3329fba0-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"ba9461bf-d0b6-45c1-bacf-eede3329fba0\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:01:02 crc kubenswrapper[5120]: I0316 16:01:02.866838 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"ovsdbserver-sb-0\" (UID: \"ba9461bf-d0b6-45c1-bacf-eede3329fba0\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:01:02 crc kubenswrapper[5120]: I0316 16:01:02.870069 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6lk9\" (UniqueName: \"kubernetes.io/projected/ba9461bf-d0b6-45c1-bacf-eede3329fba0-kube-api-access-r6lk9\") pod \"ovsdbserver-sb-0\" (UID: \"ba9461bf-d0b6-45c1-bacf-eede3329fba0\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:01:02 crc kubenswrapper[5120]: I0316 16:01:02.988384 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:01:03 crc kubenswrapper[5120]: W0316 16:01:03.419954 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podba9461bf_d0b6_45c1_bacf_eede3329fba0.slice/crio-3095b7513305558d1d4652440674a623e9261123d49bcfd6cb3f7b494f7d7965 WatchSource:0}: Error finding container 3095b7513305558d1d4652440674a623e9261123d49bcfd6cb3f7b494f7d7965: Status 404 returned error can't find the container with id 3095b7513305558d1d4652440674a623e9261123d49bcfd6cb3f7b494f7d7965 Mar 16 16:01:03 crc kubenswrapper[5120]: I0316 16:01:03.422450 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 16:01:04 crc kubenswrapper[5120]: I0316 16:01:04.124820 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"ba9461bf-d0b6-45c1-bacf-eede3329fba0","Type":"ContainerStarted","Data":"1f2acf4bcbbfcbd0929a426315ec1f92411324559d0fd28dc4a7096a568d7d88"} Mar 16 16:01:04 crc kubenswrapper[5120]: I0316 16:01:04.125663 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"ba9461bf-d0b6-45c1-bacf-eede3329fba0","Type":"ContainerStarted","Data":"3678fb8176154d7514722017b6b95e451fd401e53bb4aa5093bc1a67d432bada"} Mar 16 16:01:04 crc kubenswrapper[5120]: I0316 16:01:04.125693 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"ba9461bf-d0b6-45c1-bacf-eede3329fba0","Type":"ContainerStarted","Data":"3095b7513305558d1d4652440674a623e9261123d49bcfd6cb3f7b494f7d7965"} Mar 16 16:01:04 crc kubenswrapper[5120]: I0316 16:01:04.157722 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podStartSLOduration=2.157700173 podStartE2EDuration="2.157700173s" podCreationTimestamp="2026-03-16 16:01:02 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:01:04.148326786 +0000 UTC m=+1766.302258473" watchObservedRunningTime="2026-03-16 16:01:04.157700173 +0000 UTC m=+1766.311631840" Mar 16 16:01:04 crc kubenswrapper[5120]: I0316 16:01:04.421740 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 16:01:04 crc kubenswrapper[5120]: I0316 16:01:04.434549 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:01:04 crc kubenswrapper[5120]: I0316 16:01:04.438547 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovndbcluster-nb-scripts\"" Mar 16 16:01:04 crc kubenswrapper[5120]: I0316 16:01:04.438908 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovndbcluster-nb-config\"" Mar 16 16:01:04 crc kubenswrapper[5120]: I0316 16:01:04.449529 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 16:01:04 crc kubenswrapper[5120]: I0316 16:01:04.452927 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ovndbcluster-nb-ovndbs\"" Mar 16 16:01:04 crc kubenswrapper[5120]: I0316 16:01:04.453014 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ovncluster-ovndbcluster-nb-dockercfg-kqth4\"" Mar 16 16:01:04 crc kubenswrapper[5120]: I0316 16:01:04.582807 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/93ddd6a0-2403-4b9b-9bc8-e5ac0592b1bc-config\") pod \"ovsdbserver-nb-0\" (UID: \"93ddd6a0-2403-4b9b-9bc8-e5ac0592b1bc\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:01:04 crc kubenswrapper[5120]: I0316 16:01:04.582943 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage15-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage15-crc\") pod \"ovsdbserver-nb-0\" (UID: \"93ddd6a0-2403-4b9b-9bc8-e5ac0592b1bc\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:01:04 crc kubenswrapper[5120]: I0316 16:01:04.582996 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/93ddd6a0-2403-4b9b-9bc8-e5ac0592b1bc-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"93ddd6a0-2403-4b9b-9bc8-e5ac0592b1bc\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:01:04 crc kubenswrapper[5120]: I0316 16:01:04.583043 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/93ddd6a0-2403-4b9b-9bc8-e5ac0592b1bc-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"93ddd6a0-2403-4b9b-9bc8-e5ac0592b1bc\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:01:04 crc kubenswrapper[5120]: I0316 16:01:04.583069 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55jmv\" (UniqueName: \"kubernetes.io/projected/93ddd6a0-2403-4b9b-9bc8-e5ac0592b1bc-kube-api-access-55jmv\") pod \"ovsdbserver-nb-0\" (UID: \"93ddd6a0-2403-4b9b-9bc8-e5ac0592b1bc\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:01:04 crc kubenswrapper[5120]: I0316 16:01:04.583103 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/93ddd6a0-2403-4b9b-9bc8-e5ac0592b1bc-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"93ddd6a0-2403-4b9b-9bc8-e5ac0592b1bc\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:01:04 crc kubenswrapper[5120]: I0316 16:01:04.583178 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/93ddd6a0-2403-4b9b-9bc8-e5ac0592b1bc-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"93ddd6a0-2403-4b9b-9bc8-e5ac0592b1bc\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:01:04 crc kubenswrapper[5120]: I0316 16:01:04.583253 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/93ddd6a0-2403-4b9b-9bc8-e5ac0592b1bc-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"93ddd6a0-2403-4b9b-9bc8-e5ac0592b1bc\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:01:04 crc kubenswrapper[5120]: I0316 16:01:04.684989 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/93ddd6a0-2403-4b9b-9bc8-e5ac0592b1bc-config\") pod \"ovsdbserver-nb-0\" (UID: \"93ddd6a0-2403-4b9b-9bc8-e5ac0592b1bc\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:01:04 crc kubenswrapper[5120]: I0316 16:01:04.685082 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage15-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage15-crc\") pod \"ovsdbserver-nb-0\" (UID: \"93ddd6a0-2403-4b9b-9bc8-e5ac0592b1bc\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:01:04 crc kubenswrapper[5120]: I0316 16:01:04.685112 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/93ddd6a0-2403-4b9b-9bc8-e5ac0592b1bc-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"93ddd6a0-2403-4b9b-9bc8-e5ac0592b1bc\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:01:04 crc kubenswrapper[5120]: I0316 16:01:04.685139 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/93ddd6a0-2403-4b9b-9bc8-e5ac0592b1bc-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"93ddd6a0-2403-4b9b-9bc8-e5ac0592b1bc\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:01:04 crc kubenswrapper[5120]: I0316 16:01:04.685157 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-55jmv\" (UniqueName: \"kubernetes.io/projected/93ddd6a0-2403-4b9b-9bc8-e5ac0592b1bc-kube-api-access-55jmv\") pod \"ovsdbserver-nb-0\" (UID: \"93ddd6a0-2403-4b9b-9bc8-e5ac0592b1bc\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:01:04 crc kubenswrapper[5120]: I0316 16:01:04.685183 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/93ddd6a0-2403-4b9b-9bc8-e5ac0592b1bc-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"93ddd6a0-2403-4b9b-9bc8-e5ac0592b1bc\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:01:04 crc kubenswrapper[5120]: I0316 16:01:04.685391 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/93ddd6a0-2403-4b9b-9bc8-e5ac0592b1bc-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"93ddd6a0-2403-4b9b-9bc8-e5ac0592b1bc\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:01:04 crc kubenswrapper[5120]: I0316 16:01:04.685476 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/93ddd6a0-2403-4b9b-9bc8-e5ac0592b1bc-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"93ddd6a0-2403-4b9b-9bc8-e5ac0592b1bc\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:01:04 crc kubenswrapper[5120]: I0316 16:01:04.685605 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/93ddd6a0-2403-4b9b-9bc8-e5ac0592b1bc-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"93ddd6a0-2403-4b9b-9bc8-e5ac0592b1bc\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:01:04 crc kubenswrapper[5120]: I0316 16:01:04.685651 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage15-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage15-crc\") pod \"ovsdbserver-nb-0\" (UID: \"93ddd6a0-2403-4b9b-9bc8-e5ac0592b1bc\") device mount path \"/mnt/openstack/pv15\"" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:01:04 crc kubenswrapper[5120]: I0316 16:01:04.685924 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/93ddd6a0-2403-4b9b-9bc8-e5ac0592b1bc-config\") pod \"ovsdbserver-nb-0\" (UID: \"93ddd6a0-2403-4b9b-9bc8-e5ac0592b1bc\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:01:04 crc kubenswrapper[5120]: I0316 16:01:04.686436 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/93ddd6a0-2403-4b9b-9bc8-e5ac0592b1bc-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"93ddd6a0-2403-4b9b-9bc8-e5ac0592b1bc\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:01:04 crc kubenswrapper[5120]: I0316 16:01:04.690051 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/93ddd6a0-2403-4b9b-9bc8-e5ac0592b1bc-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"93ddd6a0-2403-4b9b-9bc8-e5ac0592b1bc\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:01:04 crc kubenswrapper[5120]: I0316 16:01:04.690075 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/93ddd6a0-2403-4b9b-9bc8-e5ac0592b1bc-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"93ddd6a0-2403-4b9b-9bc8-e5ac0592b1bc\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:01:04 crc kubenswrapper[5120]: I0316 16:01:04.690143 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/93ddd6a0-2403-4b9b-9bc8-e5ac0592b1bc-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"93ddd6a0-2403-4b9b-9bc8-e5ac0592b1bc\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:01:04 crc kubenswrapper[5120]: I0316 16:01:04.705853 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-55jmv\" (UniqueName: \"kubernetes.io/projected/93ddd6a0-2403-4b9b-9bc8-e5ac0592b1bc-kube-api-access-55jmv\") pod \"ovsdbserver-nb-0\" (UID: \"93ddd6a0-2403-4b9b-9bc8-e5ac0592b1bc\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:01:04 crc kubenswrapper[5120]: I0316 16:01:04.723431 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage15-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage15-crc\") pod \"ovsdbserver-nb-0\" (UID: \"93ddd6a0-2403-4b9b-9bc8-e5ac0592b1bc\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:01:04 crc kubenswrapper[5120]: I0316 16:01:04.761232 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:01:05 crc kubenswrapper[5120]: I0316 16:01:05.084023 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/memcached-0" Mar 16 16:01:05 crc kubenswrapper[5120]: I0316 16:01:05.096025 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:01:05 crc kubenswrapper[5120]: I0316 16:01:05.096087 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:01:05 crc kubenswrapper[5120]: I0316 16:01:05.207748 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 16:01:05 crc kubenswrapper[5120]: W0316 16:01:05.216039 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod93ddd6a0_2403_4b9b_9bc8_e5ac0592b1bc.slice/crio-b577c109da3620a7b1ee5117bd10d7b36223096046e1263c9c310f6e15f18563 WatchSource:0}: Error finding container b577c109da3620a7b1ee5117bd10d7b36223096046e1263c9c310f6e15f18563: Status 404 returned error can't find the container with id b577c109da3620a7b1ee5117bd10d7b36223096046e1263c9c310f6e15f18563 Mar 16 16:01:05 crc kubenswrapper[5120]: I0316 16:01:05.252339 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:01:05 crc kubenswrapper[5120]: I0316 16:01:05.343816 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:01:05 crc kubenswrapper[5120]: I0316 16:01:05.989470 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:01:06 crc kubenswrapper[5120]: I0316 16:01:06.147585 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"93ddd6a0-2403-4b9b-9bc8-e5ac0592b1bc","Type":"ContainerStarted","Data":"6762026b3241e8edba0db7da5d24e03df13f417225ee8a3fa22f7ee217cc1b80"} Mar 16 16:01:06 crc kubenswrapper[5120]: I0316 16:01:06.147652 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"93ddd6a0-2403-4b9b-9bc8-e5ac0592b1bc","Type":"ContainerStarted","Data":"6e985df37ce55e86651cfeb329ddbafb296639ab6b1d1dbbdab70c1607984fe6"} Mar 16 16:01:06 crc kubenswrapper[5120]: I0316 16:01:06.147675 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"93ddd6a0-2403-4b9b-9bc8-e5ac0592b1bc","Type":"ContainerStarted","Data":"b577c109da3620a7b1ee5117bd10d7b36223096046e1263c9c310f6e15f18563"} Mar 16 16:01:06 crc kubenswrapper[5120]: I0316 16:01:06.176645 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podStartSLOduration=2.176616509 podStartE2EDuration="2.176616509s" podCreationTimestamp="2026-03-16 16:01:04 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:01:06.173222696 +0000 UTC m=+1768.327154393" watchObservedRunningTime="2026-03-16 16:01:06.176616509 +0000 UTC m=+1768.330548196" Mar 16 16:01:06 crc kubenswrapper[5120]: I0316 16:01:06.492625 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:01:06 crc kubenswrapper[5120]: I0316 16:01:06.493032 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:01:06 crc kubenswrapper[5120]: I0316 16:01:06.595188 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:01:07 crc kubenswrapper[5120]: I0316 16:01:07.229700 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:01:07 crc kubenswrapper[5120]: I0316 16:01:07.761306 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:01:07 crc kubenswrapper[5120]: I0316 16:01:07.988998 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:01:08 crc kubenswrapper[5120]: E0316 16:01:08.001523 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1327507 actualBytes=10240 Mar 16 16:01:08 crc kubenswrapper[5120]: I0316 16:01:08.831265 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-db-create-6h4tj"] Mar 16 16:01:08 crc kubenswrapper[5120]: I0316 16:01:08.840074 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-create-6h4tj" Mar 16 16:01:08 crc kubenswrapper[5120]: I0316 16:01:08.841589 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-db-create-6h4tj"] Mar 16 16:01:08 crc kubenswrapper[5120]: I0316 16:01:08.866973 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78xks\" (UniqueName: \"kubernetes.io/projected/c1ce97a2-4d10-4bf6-8e09-2ef5ec8b67ce-kube-api-access-78xks\") pod \"keystone-db-create-6h4tj\" (UID: \"c1ce97a2-4d10-4bf6-8e09-2ef5ec8b67ce\") " pod="openstack-kuttl-tests/keystone-db-create-6h4tj" Mar 16 16:01:08 crc kubenswrapper[5120]: I0316 16:01:08.867011 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c1ce97a2-4d10-4bf6-8e09-2ef5ec8b67ce-operator-scripts\") pod \"keystone-db-create-6h4tj\" (UID: \"c1ce97a2-4d10-4bf6-8e09-2ef5ec8b67ce\") " pod="openstack-kuttl-tests/keystone-db-create-6h4tj" Mar 16 16:01:08 crc kubenswrapper[5120]: I0316 16:01:08.955364 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-bf50-account-create-update-cjqkk"] Mar 16 16:01:08 crc kubenswrapper[5120]: I0316 16:01:08.961232 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bf50-account-create-update-cjqkk" Mar 16 16:01:08 crc kubenswrapper[5120]: I0316 16:01:08.967754 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-db-secret\"" Mar 16 16:01:08 crc kubenswrapper[5120]: I0316 16:01:08.968548 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bf50-account-create-update-cjqkk"] Mar 16 16:01:08 crc kubenswrapper[5120]: I0316 16:01:08.968608 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-78xks\" (UniqueName: \"kubernetes.io/projected/c1ce97a2-4d10-4bf6-8e09-2ef5ec8b67ce-kube-api-access-78xks\") pod \"keystone-db-create-6h4tj\" (UID: \"c1ce97a2-4d10-4bf6-8e09-2ef5ec8b67ce\") " pod="openstack-kuttl-tests/keystone-db-create-6h4tj" Mar 16 16:01:08 crc kubenswrapper[5120]: I0316 16:01:08.968644 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c1ce97a2-4d10-4bf6-8e09-2ef5ec8b67ce-operator-scripts\") pod \"keystone-db-create-6h4tj\" (UID: \"c1ce97a2-4d10-4bf6-8e09-2ef5ec8b67ce\") " pod="openstack-kuttl-tests/keystone-db-create-6h4tj" Mar 16 16:01:08 crc kubenswrapper[5120]: I0316 16:01:08.969533 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c1ce97a2-4d10-4bf6-8e09-2ef5ec8b67ce-operator-scripts\") pod \"keystone-db-create-6h4tj\" (UID: \"c1ce97a2-4d10-4bf6-8e09-2ef5ec8b67ce\") " pod="openstack-kuttl-tests/keystone-db-create-6h4tj" Mar 16 16:01:08 crc kubenswrapper[5120]: I0316 16:01:08.991787 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-78xks\" (UniqueName: \"kubernetes.io/projected/c1ce97a2-4d10-4bf6-8e09-2ef5ec8b67ce-kube-api-access-78xks\") pod \"keystone-db-create-6h4tj\" (UID: \"c1ce97a2-4d10-4bf6-8e09-2ef5ec8b67ce\") " pod="openstack-kuttl-tests/keystone-db-create-6h4tj" Mar 16 16:01:09 crc kubenswrapper[5120]: I0316 16:01:09.040741 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:01:09 crc kubenswrapper[5120]: I0316 16:01:09.051407 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-db-create-wm6fp"] Mar 16 16:01:09 crc kubenswrapper[5120]: I0316 16:01:09.057568 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-create-wm6fp" Mar 16 16:01:09 crc kubenswrapper[5120]: I0316 16:01:09.070042 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0b0e3050-0f6f-47c8-a85a-92434db05b92-operator-scripts\") pod \"placement-db-create-wm6fp\" (UID: \"0b0e3050-0f6f-47c8-a85a-92434db05b92\") " pod="openstack-kuttl-tests/placement-db-create-wm6fp" Mar 16 16:01:09 crc kubenswrapper[5120]: I0316 16:01:09.070266 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ql5g6\" (UniqueName: \"kubernetes.io/projected/d104673f-f558-4205-9918-6eadf7543add-kube-api-access-ql5g6\") pod \"keystone-bf50-account-create-update-cjqkk\" (UID: \"d104673f-f558-4205-9918-6eadf7543add\") " pod="openstack-kuttl-tests/keystone-bf50-account-create-update-cjqkk" Mar 16 16:01:09 crc kubenswrapper[5120]: I0316 16:01:09.071108 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwvk4\" (UniqueName: \"kubernetes.io/projected/0b0e3050-0f6f-47c8-a85a-92434db05b92-kube-api-access-qwvk4\") pod \"placement-db-create-wm6fp\" (UID: \"0b0e3050-0f6f-47c8-a85a-92434db05b92\") " pod="openstack-kuttl-tests/placement-db-create-wm6fp" Mar 16 16:01:09 crc kubenswrapper[5120]: I0316 16:01:09.071575 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d104673f-f558-4205-9918-6eadf7543add-operator-scripts\") pod \"keystone-bf50-account-create-update-cjqkk\" (UID: \"d104673f-f558-4205-9918-6eadf7543add\") " pod="openstack-kuttl-tests/keystone-bf50-account-create-update-cjqkk" Mar 16 16:01:09 crc kubenswrapper[5120]: I0316 16:01:09.073828 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-db-create-wm6fp"] Mar 16 16:01:09 crc kubenswrapper[5120]: I0316 16:01:09.087890 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:01:09 crc kubenswrapper[5120]: I0316 16:01:09.155815 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-8c74-account-create-update-jw9ct"] Mar 16 16:01:09 crc kubenswrapper[5120]: I0316 16:01:09.164087 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-8c74-account-create-update-jw9ct" Mar 16 16:01:09 crc kubenswrapper[5120]: I0316 16:01:09.166331 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-db-secret\"" Mar 16 16:01:09 crc kubenswrapper[5120]: I0316 16:01:09.167252 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-8c74-account-create-update-jw9ct"] Mar 16 16:01:09 crc kubenswrapper[5120]: I0316 16:01:09.170326 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-create-6h4tj" Mar 16 16:01:09 crc kubenswrapper[5120]: I0316 16:01:09.172419 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d104673f-f558-4205-9918-6eadf7543add-operator-scripts\") pod \"keystone-bf50-account-create-update-cjqkk\" (UID: \"d104673f-f558-4205-9918-6eadf7543add\") " pod="openstack-kuttl-tests/keystone-bf50-account-create-update-cjqkk" Mar 16 16:01:09 crc kubenswrapper[5120]: I0316 16:01:09.172450 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0b0e3050-0f6f-47c8-a85a-92434db05b92-operator-scripts\") pod \"placement-db-create-wm6fp\" (UID: \"0b0e3050-0f6f-47c8-a85a-92434db05b92\") " pod="openstack-kuttl-tests/placement-db-create-wm6fp" Mar 16 16:01:09 crc kubenswrapper[5120]: I0316 16:01:09.172476 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2n9kl\" (UniqueName: \"kubernetes.io/projected/dd7b1ebe-2b4e-4c17-8a09-5dc362dfc914-kube-api-access-2n9kl\") pod \"placement-8c74-account-create-update-jw9ct\" (UID: \"dd7b1ebe-2b4e-4c17-8a09-5dc362dfc914\") " pod="openstack-kuttl-tests/placement-8c74-account-create-update-jw9ct" Mar 16 16:01:09 crc kubenswrapper[5120]: I0316 16:01:09.172512 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/dd7b1ebe-2b4e-4c17-8a09-5dc362dfc914-operator-scripts\") pod \"placement-8c74-account-create-update-jw9ct\" (UID: \"dd7b1ebe-2b4e-4c17-8a09-5dc362dfc914\") " pod="openstack-kuttl-tests/placement-8c74-account-create-update-jw9ct" Mar 16 16:01:09 crc kubenswrapper[5120]: I0316 16:01:09.172532 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ql5g6\" (UniqueName: \"kubernetes.io/projected/d104673f-f558-4205-9918-6eadf7543add-kube-api-access-ql5g6\") pod \"keystone-bf50-account-create-update-cjqkk\" (UID: \"d104673f-f558-4205-9918-6eadf7543add\") " pod="openstack-kuttl-tests/keystone-bf50-account-create-update-cjqkk" Mar 16 16:01:09 crc kubenswrapper[5120]: I0316 16:01:09.172607 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qwvk4\" (UniqueName: \"kubernetes.io/projected/0b0e3050-0f6f-47c8-a85a-92434db05b92-kube-api-access-qwvk4\") pod \"placement-db-create-wm6fp\" (UID: \"0b0e3050-0f6f-47c8-a85a-92434db05b92\") " pod="openstack-kuttl-tests/placement-db-create-wm6fp" Mar 16 16:01:09 crc kubenswrapper[5120]: I0316 16:01:09.173513 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d104673f-f558-4205-9918-6eadf7543add-operator-scripts\") pod \"keystone-bf50-account-create-update-cjqkk\" (UID: \"d104673f-f558-4205-9918-6eadf7543add\") " pod="openstack-kuttl-tests/keystone-bf50-account-create-update-cjqkk" Mar 16 16:01:09 crc kubenswrapper[5120]: I0316 16:01:09.173984 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0b0e3050-0f6f-47c8-a85a-92434db05b92-operator-scripts\") pod \"placement-db-create-wm6fp\" (UID: \"0b0e3050-0f6f-47c8-a85a-92434db05b92\") " pod="openstack-kuttl-tests/placement-db-create-wm6fp" Mar 16 16:01:09 crc kubenswrapper[5120]: I0316 16:01:09.189948 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwvk4\" (UniqueName: \"kubernetes.io/projected/0b0e3050-0f6f-47c8-a85a-92434db05b92-kube-api-access-qwvk4\") pod \"placement-db-create-wm6fp\" (UID: \"0b0e3050-0f6f-47c8-a85a-92434db05b92\") " pod="openstack-kuttl-tests/placement-db-create-wm6fp" Mar 16 16:01:09 crc kubenswrapper[5120]: I0316 16:01:09.194800 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ql5g6\" (UniqueName: \"kubernetes.io/projected/d104673f-f558-4205-9918-6eadf7543add-kube-api-access-ql5g6\") pod \"keystone-bf50-account-create-update-cjqkk\" (UID: \"d104673f-f558-4205-9918-6eadf7543add\") " pod="openstack-kuttl-tests/keystone-bf50-account-create-update-cjqkk" Mar 16 16:01:09 crc kubenswrapper[5120]: I0316 16:01:09.278041 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2n9kl\" (UniqueName: \"kubernetes.io/projected/dd7b1ebe-2b4e-4c17-8a09-5dc362dfc914-kube-api-access-2n9kl\") pod \"placement-8c74-account-create-update-jw9ct\" (UID: \"dd7b1ebe-2b4e-4c17-8a09-5dc362dfc914\") " pod="openstack-kuttl-tests/placement-8c74-account-create-update-jw9ct" Mar 16 16:01:09 crc kubenswrapper[5120]: I0316 16:01:09.278097 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/dd7b1ebe-2b4e-4c17-8a09-5dc362dfc914-operator-scripts\") pod \"placement-8c74-account-create-update-jw9ct\" (UID: \"dd7b1ebe-2b4e-4c17-8a09-5dc362dfc914\") " pod="openstack-kuttl-tests/placement-8c74-account-create-update-jw9ct" Mar 16 16:01:09 crc kubenswrapper[5120]: I0316 16:01:09.278840 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/dd7b1ebe-2b4e-4c17-8a09-5dc362dfc914-operator-scripts\") pod \"placement-8c74-account-create-update-jw9ct\" (UID: \"dd7b1ebe-2b4e-4c17-8a09-5dc362dfc914\") " pod="openstack-kuttl-tests/placement-8c74-account-create-update-jw9ct" Mar 16 16:01:09 crc kubenswrapper[5120]: I0316 16:01:09.281330 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bf50-account-create-update-cjqkk" Mar 16 16:01:09 crc kubenswrapper[5120]: I0316 16:01:09.295008 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2n9kl\" (UniqueName: \"kubernetes.io/projected/dd7b1ebe-2b4e-4c17-8a09-5dc362dfc914-kube-api-access-2n9kl\") pod \"placement-8c74-account-create-update-jw9ct\" (UID: \"dd7b1ebe-2b4e-4c17-8a09-5dc362dfc914\") " pod="openstack-kuttl-tests/placement-8c74-account-create-update-jw9ct" Mar 16 16:01:09 crc kubenswrapper[5120]: I0316 16:01:09.380655 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-create-wm6fp" Mar 16 16:01:09 crc kubenswrapper[5120]: I0316 16:01:09.479958 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-8c74-account-create-update-jw9ct" Mar 16 16:01:09 crc kubenswrapper[5120]: I0316 16:01:09.585503 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-db-create-6h4tj"] Mar 16 16:01:09 crc kubenswrapper[5120]: W0316 16:01:09.590290 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc1ce97a2_4d10_4bf6_8e09_2ef5ec8b67ce.slice/crio-94f1e7aef3e45b6a591fe67dff43501bffda7237b37a9f65db44f772a38040c3 WatchSource:0}: Error finding container 94f1e7aef3e45b6a591fe67dff43501bffda7237b37a9f65db44f772a38040c3: Status 404 returned error can't find the container with id 94f1e7aef3e45b6a591fe67dff43501bffda7237b37a9f65db44f772a38040c3 Mar 16 16:01:09 crc kubenswrapper[5120]: I0316 16:01:09.726091 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bf50-account-create-update-cjqkk"] Mar 16 16:01:09 crc kubenswrapper[5120]: W0316 16:01:09.735415 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd104673f_f558_4205_9918_6eadf7543add.slice/crio-664442c000aa278b02006c98fc2118a733addfaa815577582a441fa467b77a99 WatchSource:0}: Error finding container 664442c000aa278b02006c98fc2118a733addfaa815577582a441fa467b77a99: Status 404 returned error can't find the container with id 664442c000aa278b02006c98fc2118a733addfaa815577582a441fa467b77a99 Mar 16 16:01:09 crc kubenswrapper[5120]: I0316 16:01:09.762396 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:01:09 crc kubenswrapper[5120]: I0316 16:01:09.827606 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-db-create-wm6fp"] Mar 16 16:01:09 crc kubenswrapper[5120]: W0316 16:01:09.843849 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0b0e3050_0f6f_47c8_a85a_92434db05b92.slice/crio-e3c67fbd7bd1f64c8cf1bba75ca780364226936e6be6cbc633709f178cef4d8d WatchSource:0}: Error finding container e3c67fbd7bd1f64c8cf1bba75ca780364226936e6be6cbc633709f178cef4d8d: Status 404 returned error can't find the container with id e3c67fbd7bd1f64c8cf1bba75ca780364226936e6be6cbc633709f178cef4d8d Mar 16 16:01:09 crc kubenswrapper[5120]: I0316 16:01:09.917493 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-8c74-account-create-update-jw9ct"] Mar 16 16:01:09 crc kubenswrapper[5120]: I0316 16:01:09.976881 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 16:01:09 crc kubenswrapper[5120]: I0316 16:01:09.986683 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:01:09 crc kubenswrapper[5120]: I0316 16:01:09.997036 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 16:01:09 crc kubenswrapper[5120]: I0316 16:01:09.998256 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"swift-storage-config-data\"" Mar 16 16:01:09 crc kubenswrapper[5120]: I0316 16:01:09.998504 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"swift-swift-dockercfg-gjvpx\"" Mar 16 16:01:09 crc kubenswrapper[5120]: I0316 16:01:09.998828 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"swift-ring-files\"" Mar 16 16:01:09 crc kubenswrapper[5120]: I0316 16:01:09.999006 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"swift-conf\"" Mar 16 16:01:10 crc kubenswrapper[5120]: I0316 16:01:10.083974 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-k4gq4"] Mar 16 16:01:10 crc kubenswrapper[5120]: I0316 16:01:10.089123 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-k4gq4" Mar 16 16:01:10 crc kubenswrapper[5120]: I0316 16:01:10.090926 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-k4gq4"] Mar 16 16:01:10 crc kubenswrapper[5120]: I0316 16:01:10.096239 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"swift-proxy-config-data\"" Mar 16 16:01:10 crc kubenswrapper[5120]: I0316 16:01:10.096620 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"swift-ring-scripts\"" Mar 16 16:01:10 crc kubenswrapper[5120]: I0316 16:01:10.096883 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"swift-ring-config-data\"" Mar 16 16:01:10 crc kubenswrapper[5120]: I0316 16:01:10.099594 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbw4z\" (UniqueName: \"kubernetes.io/projected/7e01ce77-a7e7-4f90-880f-fb2aa9b506a0-kube-api-access-pbw4z\") pod \"swift-storage-0\" (UID: \"7e01ce77-a7e7-4f90-880f-fb2aa9b506a0\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:01:10 crc kubenswrapper[5120]: I0316 16:01:10.099662 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/7e01ce77-a7e7-4f90-880f-fb2aa9b506a0-cache\") pod \"swift-storage-0\" (UID: \"7e01ce77-a7e7-4f90-880f-fb2aa9b506a0\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:01:10 crc kubenswrapper[5120]: I0316 16:01:10.099751 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage07-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") pod \"swift-storage-0\" (UID: \"7e01ce77-a7e7-4f90-880f-fb2aa9b506a0\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:01:10 crc kubenswrapper[5120]: I0316 16:01:10.099821 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/7e01ce77-a7e7-4f90-880f-fb2aa9b506a0-lock\") pod \"swift-storage-0\" (UID: \"7e01ce77-a7e7-4f90-880f-fb2aa9b506a0\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:01:10 crc kubenswrapper[5120]: I0316 16:01:10.099961 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/7e01ce77-a7e7-4f90-880f-fb2aa9b506a0-etc-swift\") pod \"swift-storage-0\" (UID: \"7e01ce77-a7e7-4f90-880f-fb2aa9b506a0\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:01:10 crc kubenswrapper[5120]: I0316 16:01:10.100016 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7e01ce77-a7e7-4f90-880f-fb2aa9b506a0-combined-ca-bundle\") pod \"swift-storage-0\" (UID: \"7e01ce77-a7e7-4f90-880f-fb2aa9b506a0\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:01:10 crc kubenswrapper[5120]: I0316 16:01:10.192654 5120 generic.go:358] "Generic (PLEG): container finished" podID="c1ce97a2-4d10-4bf6-8e09-2ef5ec8b67ce" containerID="b596a836467f9f921d44bf550a977ae900b2598b5af55895745f8cea3e68edd6" exitCode=0 Mar 16 16:01:10 crc kubenswrapper[5120]: I0316 16:01:10.192900 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-create-6h4tj" event={"ID":"c1ce97a2-4d10-4bf6-8e09-2ef5ec8b67ce","Type":"ContainerDied","Data":"b596a836467f9f921d44bf550a977ae900b2598b5af55895745f8cea3e68edd6"} Mar 16 16:01:10 crc kubenswrapper[5120]: I0316 16:01:10.192935 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-create-6h4tj" event={"ID":"c1ce97a2-4d10-4bf6-8e09-2ef5ec8b67ce","Type":"ContainerStarted","Data":"94f1e7aef3e45b6a591fe67dff43501bffda7237b37a9f65db44f772a38040c3"} Mar 16 16:01:10 crc kubenswrapper[5120]: I0316 16:01:10.195598 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-create-wm6fp" event={"ID":"0b0e3050-0f6f-47c8-a85a-92434db05b92","Type":"ContainerStarted","Data":"e3c67fbd7bd1f64c8cf1bba75ca780364226936e6be6cbc633709f178cef4d8d"} Mar 16 16:01:10 crc kubenswrapper[5120]: I0316 16:01:10.201198 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/98e439f7-1c93-4a9e-9986-62a1936a4be2-ring-data-devices\") pod \"swift-ring-rebalance-k4gq4\" (UID: \"98e439f7-1c93-4a9e-9986-62a1936a4be2\") " pod="openstack-kuttl-tests/swift-ring-rebalance-k4gq4" Mar 16 16:01:10 crc kubenswrapper[5120]: I0316 16:01:10.201345 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/7e01ce77-a7e7-4f90-880f-fb2aa9b506a0-etc-swift\") pod \"swift-storage-0\" (UID: \"7e01ce77-a7e7-4f90-880f-fb2aa9b506a0\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:01:10 crc kubenswrapper[5120]: I0316 16:01:10.201435 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7e01ce77-a7e7-4f90-880f-fb2aa9b506a0-combined-ca-bundle\") pod \"swift-storage-0\" (UID: \"7e01ce77-a7e7-4f90-880f-fb2aa9b506a0\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:01:10 crc kubenswrapper[5120]: I0316 16:01:10.201748 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/98e439f7-1c93-4a9e-9986-62a1936a4be2-scripts\") pod \"swift-ring-rebalance-k4gq4\" (UID: \"98e439f7-1c93-4a9e-9986-62a1936a4be2\") " pod="openstack-kuttl-tests/swift-ring-rebalance-k4gq4" Mar 16 16:01:10 crc kubenswrapper[5120]: I0316 16:01:10.201951 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2pdsx\" (UniqueName: \"kubernetes.io/projected/98e439f7-1c93-4a9e-9986-62a1936a4be2-kube-api-access-2pdsx\") pod \"swift-ring-rebalance-k4gq4\" (UID: \"98e439f7-1c93-4a9e-9986-62a1936a4be2\") " pod="openstack-kuttl-tests/swift-ring-rebalance-k4gq4" Mar 16 16:01:10 crc kubenswrapper[5120]: I0316 16:01:10.202125 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pbw4z\" (UniqueName: \"kubernetes.io/projected/7e01ce77-a7e7-4f90-880f-fb2aa9b506a0-kube-api-access-pbw4z\") pod \"swift-storage-0\" (UID: \"7e01ce77-a7e7-4f90-880f-fb2aa9b506a0\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:01:10 crc kubenswrapper[5120]: E0316 16:01:10.202257 5120 projected.go:289] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Mar 16 16:01:10 crc kubenswrapper[5120]: E0316 16:01:10.202291 5120 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Mar 16 16:01:10 crc kubenswrapper[5120]: E0316 16:01:10.202359 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7e01ce77-a7e7-4f90-880f-fb2aa9b506a0-etc-swift podName:7e01ce77-a7e7-4f90-880f-fb2aa9b506a0 nodeName:}" failed. No retries permitted until 2026-03-16 16:01:10.702339627 +0000 UTC m=+1772.856271284 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/7e01ce77-a7e7-4f90-880f-fb2aa9b506a0-etc-swift") pod "swift-storage-0" (UID: "7e01ce77-a7e7-4f90-880f-fb2aa9b506a0") : configmap "swift-ring-files" not found Mar 16 16:01:10 crc kubenswrapper[5120]: I0316 16:01:10.202269 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/7e01ce77-a7e7-4f90-880f-fb2aa9b506a0-cache\") pod \"swift-storage-0\" (UID: \"7e01ce77-a7e7-4f90-880f-fb2aa9b506a0\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:01:10 crc kubenswrapper[5120]: I0316 16:01:10.202706 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/98e439f7-1c93-4a9e-9986-62a1936a4be2-swiftconf\") pod \"swift-ring-rebalance-k4gq4\" (UID: \"98e439f7-1c93-4a9e-9986-62a1936a4be2\") " pod="openstack-kuttl-tests/swift-ring-rebalance-k4gq4" Mar 16 16:01:10 crc kubenswrapper[5120]: I0316 16:01:10.202730 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/98e439f7-1c93-4a9e-9986-62a1936a4be2-combined-ca-bundle\") pod \"swift-ring-rebalance-k4gq4\" (UID: \"98e439f7-1c93-4a9e-9986-62a1936a4be2\") " pod="openstack-kuttl-tests/swift-ring-rebalance-k4gq4" Mar 16 16:01:10 crc kubenswrapper[5120]: I0316 16:01:10.202772 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage07-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") pod \"swift-storage-0\" (UID: \"7e01ce77-a7e7-4f90-880f-fb2aa9b506a0\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:01:10 crc kubenswrapper[5120]: I0316 16:01:10.202791 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/98e439f7-1c93-4a9e-9986-62a1936a4be2-dispersionconf\") pod \"swift-ring-rebalance-k4gq4\" (UID: \"98e439f7-1c93-4a9e-9986-62a1936a4be2\") " pod="openstack-kuttl-tests/swift-ring-rebalance-k4gq4" Mar 16 16:01:10 crc kubenswrapper[5120]: I0316 16:01:10.202817 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/98e439f7-1c93-4a9e-9986-62a1936a4be2-etc-swift\") pod \"swift-ring-rebalance-k4gq4\" (UID: \"98e439f7-1c93-4a9e-9986-62a1936a4be2\") " pod="openstack-kuttl-tests/swift-ring-rebalance-k4gq4" Mar 16 16:01:10 crc kubenswrapper[5120]: I0316 16:01:10.202848 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/7e01ce77-a7e7-4f90-880f-fb2aa9b506a0-lock\") pod \"swift-storage-0\" (UID: \"7e01ce77-a7e7-4f90-880f-fb2aa9b506a0\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:01:10 crc kubenswrapper[5120]: I0316 16:01:10.203296 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage07-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") pod \"swift-storage-0\" (UID: \"7e01ce77-a7e7-4f90-880f-fb2aa9b506a0\") device mount path \"/mnt/openstack/pv07\"" pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:01:10 crc kubenswrapper[5120]: I0316 16:01:10.203521 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/7e01ce77-a7e7-4f90-880f-fb2aa9b506a0-lock\") pod \"swift-storage-0\" (UID: \"7e01ce77-a7e7-4f90-880f-fb2aa9b506a0\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:01:10 crc kubenswrapper[5120]: I0316 16:01:10.203681 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/7e01ce77-a7e7-4f90-880f-fb2aa9b506a0-cache\") pod \"swift-storage-0\" (UID: \"7e01ce77-a7e7-4f90-880f-fb2aa9b506a0\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:01:10 crc kubenswrapper[5120]: I0316 16:01:10.234996 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7e01ce77-a7e7-4f90-880f-fb2aa9b506a0-combined-ca-bundle\") pod \"swift-storage-0\" (UID: \"7e01ce77-a7e7-4f90-880f-fb2aa9b506a0\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:01:10 crc kubenswrapper[5120]: I0316 16:01:10.237978 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bf50-account-create-update-cjqkk" event={"ID":"d104673f-f558-4205-9918-6eadf7543add","Type":"ContainerStarted","Data":"071d93a4083043fa8df551c6e89a4bd717d8d4b20b8c899f3e888f1fffe234d0"} Mar 16 16:01:10 crc kubenswrapper[5120]: I0316 16:01:10.238029 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bf50-account-create-update-cjqkk" event={"ID":"d104673f-f558-4205-9918-6eadf7543add","Type":"ContainerStarted","Data":"664442c000aa278b02006c98fc2118a733addfaa815577582a441fa467b77a99"} Mar 16 16:01:10 crc kubenswrapper[5120]: I0316 16:01:10.240378 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbw4z\" (UniqueName: \"kubernetes.io/projected/7e01ce77-a7e7-4f90-880f-fb2aa9b506a0-kube-api-access-pbw4z\") pod \"swift-storage-0\" (UID: \"7e01ce77-a7e7-4f90-880f-fb2aa9b506a0\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:01:10 crc kubenswrapper[5120]: I0316 16:01:10.246000 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-8c74-account-create-update-jw9ct" event={"ID":"dd7b1ebe-2b4e-4c17-8a09-5dc362dfc914","Type":"ContainerStarted","Data":"21fe3c11ffab9b0c4f47473a06999646eace0f5f54c7cf898391a1d21ee7842f"} Mar 16 16:01:10 crc kubenswrapper[5120]: I0316 16:01:10.252786 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-db-create-wm6fp" podStartSLOduration=1.252747294 podStartE2EDuration="1.252747294s" podCreationTimestamp="2026-03-16 16:01:09 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:01:10.245535106 +0000 UTC m=+1772.399466763" watchObservedRunningTime="2026-03-16 16:01:10.252747294 +0000 UTC m=+1772.406678951" Mar 16 16:01:10 crc kubenswrapper[5120]: I0316 16:01:10.267270 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage07-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") pod \"swift-storage-0\" (UID: \"7e01ce77-a7e7-4f90-880f-fb2aa9b506a0\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:01:10 crc kubenswrapper[5120]: I0316 16:01:10.270202 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-bf50-account-create-update-cjqkk" podStartSLOduration=2.270152383 podStartE2EDuration="2.270152383s" podCreationTimestamp="2026-03-16 16:01:08 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:01:10.263348536 +0000 UTC m=+1772.417280193" watchObservedRunningTime="2026-03-16 16:01:10.270152383 +0000 UTC m=+1772.424084040" Mar 16 16:01:10 crc kubenswrapper[5120]: I0316 16:01:10.289844 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-8c74-account-create-update-jw9ct" podStartSLOduration=1.289825885 podStartE2EDuration="1.289825885s" podCreationTimestamp="2026-03-16 16:01:09 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:01:10.276654912 +0000 UTC m=+1772.430586559" watchObservedRunningTime="2026-03-16 16:01:10.289825885 +0000 UTC m=+1772.443757542" Mar 16 16:01:10 crc kubenswrapper[5120]: I0316 16:01:10.304774 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/98e439f7-1c93-4a9e-9986-62a1936a4be2-ring-data-devices\") pod \"swift-ring-rebalance-k4gq4\" (UID: \"98e439f7-1c93-4a9e-9986-62a1936a4be2\") " pod="openstack-kuttl-tests/swift-ring-rebalance-k4gq4" Mar 16 16:01:10 crc kubenswrapper[5120]: I0316 16:01:10.304869 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/98e439f7-1c93-4a9e-9986-62a1936a4be2-scripts\") pod \"swift-ring-rebalance-k4gq4\" (UID: \"98e439f7-1c93-4a9e-9986-62a1936a4be2\") " pod="openstack-kuttl-tests/swift-ring-rebalance-k4gq4" Mar 16 16:01:10 crc kubenswrapper[5120]: I0316 16:01:10.304939 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2pdsx\" (UniqueName: \"kubernetes.io/projected/98e439f7-1c93-4a9e-9986-62a1936a4be2-kube-api-access-2pdsx\") pod \"swift-ring-rebalance-k4gq4\" (UID: \"98e439f7-1c93-4a9e-9986-62a1936a4be2\") " pod="openstack-kuttl-tests/swift-ring-rebalance-k4gq4" Mar 16 16:01:10 crc kubenswrapper[5120]: I0316 16:01:10.305046 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/98e439f7-1c93-4a9e-9986-62a1936a4be2-swiftconf\") pod \"swift-ring-rebalance-k4gq4\" (UID: \"98e439f7-1c93-4a9e-9986-62a1936a4be2\") " pod="openstack-kuttl-tests/swift-ring-rebalance-k4gq4" Mar 16 16:01:10 crc kubenswrapper[5120]: I0316 16:01:10.305063 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/98e439f7-1c93-4a9e-9986-62a1936a4be2-combined-ca-bundle\") pod \"swift-ring-rebalance-k4gq4\" (UID: \"98e439f7-1c93-4a9e-9986-62a1936a4be2\") " pod="openstack-kuttl-tests/swift-ring-rebalance-k4gq4" Mar 16 16:01:10 crc kubenswrapper[5120]: I0316 16:01:10.305080 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/98e439f7-1c93-4a9e-9986-62a1936a4be2-dispersionconf\") pod \"swift-ring-rebalance-k4gq4\" (UID: \"98e439f7-1c93-4a9e-9986-62a1936a4be2\") " pod="openstack-kuttl-tests/swift-ring-rebalance-k4gq4" Mar 16 16:01:10 crc kubenswrapper[5120]: I0316 16:01:10.305099 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/98e439f7-1c93-4a9e-9986-62a1936a4be2-etc-swift\") pod \"swift-ring-rebalance-k4gq4\" (UID: \"98e439f7-1c93-4a9e-9986-62a1936a4be2\") " pod="openstack-kuttl-tests/swift-ring-rebalance-k4gq4" Mar 16 16:01:10 crc kubenswrapper[5120]: I0316 16:01:10.305505 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/98e439f7-1c93-4a9e-9986-62a1936a4be2-etc-swift\") pod \"swift-ring-rebalance-k4gq4\" (UID: \"98e439f7-1c93-4a9e-9986-62a1936a4be2\") " pod="openstack-kuttl-tests/swift-ring-rebalance-k4gq4" Mar 16 16:01:10 crc kubenswrapper[5120]: I0316 16:01:10.306084 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/98e439f7-1c93-4a9e-9986-62a1936a4be2-ring-data-devices\") pod \"swift-ring-rebalance-k4gq4\" (UID: \"98e439f7-1c93-4a9e-9986-62a1936a4be2\") " pod="openstack-kuttl-tests/swift-ring-rebalance-k4gq4" Mar 16 16:01:10 crc kubenswrapper[5120]: I0316 16:01:10.307252 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/98e439f7-1c93-4a9e-9986-62a1936a4be2-scripts\") pod \"swift-ring-rebalance-k4gq4\" (UID: \"98e439f7-1c93-4a9e-9986-62a1936a4be2\") " pod="openstack-kuttl-tests/swift-ring-rebalance-k4gq4" Mar 16 16:01:10 crc kubenswrapper[5120]: I0316 16:01:10.310894 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/98e439f7-1c93-4a9e-9986-62a1936a4be2-swiftconf\") pod \"swift-ring-rebalance-k4gq4\" (UID: \"98e439f7-1c93-4a9e-9986-62a1936a4be2\") " pod="openstack-kuttl-tests/swift-ring-rebalance-k4gq4" Mar 16 16:01:10 crc kubenswrapper[5120]: I0316 16:01:10.316281 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/98e439f7-1c93-4a9e-9986-62a1936a4be2-dispersionconf\") pod \"swift-ring-rebalance-k4gq4\" (UID: \"98e439f7-1c93-4a9e-9986-62a1936a4be2\") " pod="openstack-kuttl-tests/swift-ring-rebalance-k4gq4" Mar 16 16:01:10 crc kubenswrapper[5120]: I0316 16:01:10.328925 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/98e439f7-1c93-4a9e-9986-62a1936a4be2-combined-ca-bundle\") pod \"swift-ring-rebalance-k4gq4\" (UID: \"98e439f7-1c93-4a9e-9986-62a1936a4be2\") " pod="openstack-kuttl-tests/swift-ring-rebalance-k4gq4" Mar 16 16:01:10 crc kubenswrapper[5120]: I0316 16:01:10.334980 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pdsx\" (UniqueName: \"kubernetes.io/projected/98e439f7-1c93-4a9e-9986-62a1936a4be2-kube-api-access-2pdsx\") pod \"swift-ring-rebalance-k4gq4\" (UID: \"98e439f7-1c93-4a9e-9986-62a1936a4be2\") " pod="openstack-kuttl-tests/swift-ring-rebalance-k4gq4" Mar 16 16:01:10 crc kubenswrapper[5120]: I0316 16:01:10.462335 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-k4gq4" Mar 16 16:01:10 crc kubenswrapper[5120]: I0316 16:01:10.710900 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/7e01ce77-a7e7-4f90-880f-fb2aa9b506a0-etc-swift\") pod \"swift-storage-0\" (UID: \"7e01ce77-a7e7-4f90-880f-fb2aa9b506a0\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:01:10 crc kubenswrapper[5120]: E0316 16:01:10.713358 5120 projected.go:289] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Mar 16 16:01:10 crc kubenswrapper[5120]: E0316 16:01:10.713381 5120 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Mar 16 16:01:10 crc kubenswrapper[5120]: E0316 16:01:10.713462 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7e01ce77-a7e7-4f90-880f-fb2aa9b506a0-etc-swift podName:7e01ce77-a7e7-4f90-880f-fb2aa9b506a0 nodeName:}" failed. No retries permitted until 2026-03-16 16:01:11.713418523 +0000 UTC m=+1773.867350180 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/7e01ce77-a7e7-4f90-880f-fb2aa9b506a0-etc-swift") pod "swift-storage-0" (UID: "7e01ce77-a7e7-4f90-880f-fb2aa9b506a0") : configmap "swift-ring-files" not found Mar 16 16:01:10 crc kubenswrapper[5120]: I0316 16:01:10.805108 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:01:10 crc kubenswrapper[5120]: I0316 16:01:10.843413 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:01:10 crc kubenswrapper[5120]: W0316 16:01:10.914231 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod98e439f7_1c93_4a9e_9986_62a1936a4be2.slice/crio-0fba98f221cdca3dd639a31dffaeb1430c134b8818efb165e089e955a65ed549 WatchSource:0}: Error finding container 0fba98f221cdca3dd639a31dffaeb1430c134b8818efb165e089e955a65ed549: Status 404 returned error can't find the container with id 0fba98f221cdca3dd639a31dffaeb1430c134b8818efb165e089e955a65ed549 Mar 16 16:01:10 crc kubenswrapper[5120]: I0316 16:01:10.915840 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-k4gq4"] Mar 16 16:01:11 crc kubenswrapper[5120]: I0316 16:01:11.031732 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 16:01:11 crc kubenswrapper[5120]: I0316 16:01:11.040219 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:01:11 crc kubenswrapper[5120]: I0316 16:01:11.042957 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovnnorthd-config\"" Mar 16 16:01:11 crc kubenswrapper[5120]: I0316 16:01:11.043132 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ovnnorthd-ovnnorthd-dockercfg-tkkbn\"" Mar 16 16:01:11 crc kubenswrapper[5120]: I0316 16:01:11.043281 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovnnorthd-scripts\"" Mar 16 16:01:11 crc kubenswrapper[5120]: I0316 16:01:11.043422 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ovnnorthd-ovndbs\"" Mar 16 16:01:11 crc kubenswrapper[5120]: I0316 16:01:11.055723 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 16:01:11 crc kubenswrapper[5120]: I0316 16:01:11.117637 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cf2c0d02-34db-44f6-b7e5-625a82333785-config\") pod \"ovn-northd-0\" (UID: \"cf2c0d02-34db-44f6-b7e5-625a82333785\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:01:11 crc kubenswrapper[5120]: I0316 16:01:11.117835 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/cf2c0d02-34db-44f6-b7e5-625a82333785-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"cf2c0d02-34db-44f6-b7e5-625a82333785\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:01:11 crc kubenswrapper[5120]: I0316 16:01:11.117943 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cf2c0d02-34db-44f6-b7e5-625a82333785-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"cf2c0d02-34db-44f6-b7e5-625a82333785\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:01:11 crc kubenswrapper[5120]: I0316 16:01:11.117998 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/cf2c0d02-34db-44f6-b7e5-625a82333785-scripts\") pod \"ovn-northd-0\" (UID: \"cf2c0d02-34db-44f6-b7e5-625a82333785\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:01:11 crc kubenswrapper[5120]: I0316 16:01:11.118040 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/cf2c0d02-34db-44f6-b7e5-625a82333785-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"cf2c0d02-34db-44f6-b7e5-625a82333785\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:01:11 crc kubenswrapper[5120]: I0316 16:01:11.118070 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/cf2c0d02-34db-44f6-b7e5-625a82333785-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"cf2c0d02-34db-44f6-b7e5-625a82333785\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:01:11 crc kubenswrapper[5120]: I0316 16:01:11.118306 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6jfq\" (UniqueName: \"kubernetes.io/projected/cf2c0d02-34db-44f6-b7e5-625a82333785-kube-api-access-v6jfq\") pod \"ovn-northd-0\" (UID: \"cf2c0d02-34db-44f6-b7e5-625a82333785\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:01:11 crc kubenswrapper[5120]: I0316 16:01:11.220556 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v6jfq\" (UniqueName: \"kubernetes.io/projected/cf2c0d02-34db-44f6-b7e5-625a82333785-kube-api-access-v6jfq\") pod \"ovn-northd-0\" (UID: \"cf2c0d02-34db-44f6-b7e5-625a82333785\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:01:11 crc kubenswrapper[5120]: I0316 16:01:11.220631 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cf2c0d02-34db-44f6-b7e5-625a82333785-config\") pod \"ovn-northd-0\" (UID: \"cf2c0d02-34db-44f6-b7e5-625a82333785\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:01:11 crc kubenswrapper[5120]: I0316 16:01:11.220684 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/cf2c0d02-34db-44f6-b7e5-625a82333785-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"cf2c0d02-34db-44f6-b7e5-625a82333785\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:01:11 crc kubenswrapper[5120]: I0316 16:01:11.220852 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cf2c0d02-34db-44f6-b7e5-625a82333785-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"cf2c0d02-34db-44f6-b7e5-625a82333785\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:01:11 crc kubenswrapper[5120]: I0316 16:01:11.221004 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/cf2c0d02-34db-44f6-b7e5-625a82333785-scripts\") pod \"ovn-northd-0\" (UID: \"cf2c0d02-34db-44f6-b7e5-625a82333785\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:01:11 crc kubenswrapper[5120]: I0316 16:01:11.221091 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/cf2c0d02-34db-44f6-b7e5-625a82333785-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"cf2c0d02-34db-44f6-b7e5-625a82333785\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:01:11 crc kubenswrapper[5120]: I0316 16:01:11.221161 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/cf2c0d02-34db-44f6-b7e5-625a82333785-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"cf2c0d02-34db-44f6-b7e5-625a82333785\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:01:11 crc kubenswrapper[5120]: I0316 16:01:11.221442 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/cf2c0d02-34db-44f6-b7e5-625a82333785-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"cf2c0d02-34db-44f6-b7e5-625a82333785\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:01:11 crc kubenswrapper[5120]: I0316 16:01:11.222055 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cf2c0d02-34db-44f6-b7e5-625a82333785-config\") pod \"ovn-northd-0\" (UID: \"cf2c0d02-34db-44f6-b7e5-625a82333785\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:01:11 crc kubenswrapper[5120]: I0316 16:01:11.222413 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/cf2c0d02-34db-44f6-b7e5-625a82333785-scripts\") pod \"ovn-northd-0\" (UID: \"cf2c0d02-34db-44f6-b7e5-625a82333785\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:01:11 crc kubenswrapper[5120]: I0316 16:01:11.225313 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/cf2c0d02-34db-44f6-b7e5-625a82333785-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"cf2c0d02-34db-44f6-b7e5-625a82333785\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:01:11 crc kubenswrapper[5120]: I0316 16:01:11.226376 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/cf2c0d02-34db-44f6-b7e5-625a82333785-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"cf2c0d02-34db-44f6-b7e5-625a82333785\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:01:11 crc kubenswrapper[5120]: I0316 16:01:11.228494 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cf2c0d02-34db-44f6-b7e5-625a82333785-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"cf2c0d02-34db-44f6-b7e5-625a82333785\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:01:11 crc kubenswrapper[5120]: I0316 16:01:11.240865 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6jfq\" (UniqueName: \"kubernetes.io/projected/cf2c0d02-34db-44f6-b7e5-625a82333785-kube-api-access-v6jfq\") pod \"ovn-northd-0\" (UID: \"cf2c0d02-34db-44f6-b7e5-625a82333785\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:01:11 crc kubenswrapper[5120]: I0316 16:01:11.264792 5120 generic.go:358] "Generic (PLEG): container finished" podID="0b0e3050-0f6f-47c8-a85a-92434db05b92" containerID="69e8b5c1a82de42011f2d24bc136981987055996eed6ad28b0095859c38c297c" exitCode=0 Mar 16 16:01:11 crc kubenswrapper[5120]: I0316 16:01:11.264968 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-create-wm6fp" event={"ID":"0b0e3050-0f6f-47c8-a85a-92434db05b92","Type":"ContainerDied","Data":"69e8b5c1a82de42011f2d24bc136981987055996eed6ad28b0095859c38c297c"} Mar 16 16:01:11 crc kubenswrapper[5120]: I0316 16:01:11.280200 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-k4gq4" event={"ID":"98e439f7-1c93-4a9e-9986-62a1936a4be2","Type":"ContainerStarted","Data":"0fba98f221cdca3dd639a31dffaeb1430c134b8818efb165e089e955a65ed549"} Mar 16 16:01:11 crc kubenswrapper[5120]: I0316 16:01:11.297296 5120 generic.go:358] "Generic (PLEG): container finished" podID="d104673f-f558-4205-9918-6eadf7543add" containerID="071d93a4083043fa8df551c6e89a4bd717d8d4b20b8c899f3e888f1fffe234d0" exitCode=0 Mar 16 16:01:11 crc kubenswrapper[5120]: I0316 16:01:11.297461 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bf50-account-create-update-cjqkk" event={"ID":"d104673f-f558-4205-9918-6eadf7543add","Type":"ContainerDied","Data":"071d93a4083043fa8df551c6e89a4bd717d8d4b20b8c899f3e888f1fffe234d0"} Mar 16 16:01:11 crc kubenswrapper[5120]: I0316 16:01:11.300319 5120 generic.go:358] "Generic (PLEG): container finished" podID="dd7b1ebe-2b4e-4c17-8a09-5dc362dfc914" containerID="ec574936dd64772983c355077af1e5d59d440ef6beaaa6bcd54ab720321b17d9" exitCode=0 Mar 16 16:01:11 crc kubenswrapper[5120]: I0316 16:01:11.300400 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-8c74-account-create-update-jw9ct" event={"ID":"dd7b1ebe-2b4e-4c17-8a09-5dc362dfc914","Type":"ContainerDied","Data":"ec574936dd64772983c355077af1e5d59d440ef6beaaa6bcd54ab720321b17d9"} Mar 16 16:01:11 crc kubenswrapper[5120]: I0316 16:01:11.316706 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/swift-ring-rebalance-k4gq4" podStartSLOduration=1.316681696 podStartE2EDuration="1.316681696s" podCreationTimestamp="2026-03-16 16:01:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:01:11.304163772 +0000 UTC m=+1773.458095449" watchObservedRunningTime="2026-03-16 16:01:11.316681696 +0000 UTC m=+1773.470613363" Mar 16 16:01:11 crc kubenswrapper[5120]: I0316 16:01:11.502589 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:01:11 crc kubenswrapper[5120]: I0316 16:01:11.635236 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-create-6h4tj" Mar 16 16:01:11 crc kubenswrapper[5120]: I0316 16:01:11.664584 5120 scope.go:117] "RemoveContainer" containerID="02ba4fc3f84eccaecfa9e6618280f65626eb76580c4af9ae7a9d7cb3b8dd590b" Mar 16 16:01:11 crc kubenswrapper[5120]: E0316 16:01:11.664930 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:01:11 crc kubenswrapper[5120]: I0316 16:01:11.731674 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c1ce97a2-4d10-4bf6-8e09-2ef5ec8b67ce-operator-scripts\") pod \"c1ce97a2-4d10-4bf6-8e09-2ef5ec8b67ce\" (UID: \"c1ce97a2-4d10-4bf6-8e09-2ef5ec8b67ce\") " Mar 16 16:01:11 crc kubenswrapper[5120]: I0316 16:01:11.732087 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-78xks\" (UniqueName: \"kubernetes.io/projected/c1ce97a2-4d10-4bf6-8e09-2ef5ec8b67ce-kube-api-access-78xks\") pod \"c1ce97a2-4d10-4bf6-8e09-2ef5ec8b67ce\" (UID: \"c1ce97a2-4d10-4bf6-8e09-2ef5ec8b67ce\") " Mar 16 16:01:11 crc kubenswrapper[5120]: I0316 16:01:11.732111 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c1ce97a2-4d10-4bf6-8e09-2ef5ec8b67ce-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "c1ce97a2-4d10-4bf6-8e09-2ef5ec8b67ce" (UID: "c1ce97a2-4d10-4bf6-8e09-2ef5ec8b67ce"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:01:11 crc kubenswrapper[5120]: I0316 16:01:11.733126 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/7e01ce77-a7e7-4f90-880f-fb2aa9b506a0-etc-swift\") pod \"swift-storage-0\" (UID: \"7e01ce77-a7e7-4f90-880f-fb2aa9b506a0\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:01:11 crc kubenswrapper[5120]: E0316 16:01:11.733800 5120 projected.go:289] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Mar 16 16:01:11 crc kubenswrapper[5120]: E0316 16:01:11.733833 5120 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Mar 16 16:01:11 crc kubenswrapper[5120]: E0316 16:01:11.733877 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7e01ce77-a7e7-4f90-880f-fb2aa9b506a0-etc-swift podName:7e01ce77-a7e7-4f90-880f-fb2aa9b506a0 nodeName:}" failed. No retries permitted until 2026-03-16 16:01:13.733861238 +0000 UTC m=+1775.887792895 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/7e01ce77-a7e7-4f90-880f-fb2aa9b506a0-etc-swift") pod "swift-storage-0" (UID: "7e01ce77-a7e7-4f90-880f-fb2aa9b506a0") : configmap "swift-ring-files" not found Mar 16 16:01:11 crc kubenswrapper[5120]: I0316 16:01:11.734430 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c1ce97a2-4d10-4bf6-8e09-2ef5ec8b67ce-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:01:11 crc kubenswrapper[5120]: I0316 16:01:11.736415 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1ce97a2-4d10-4bf6-8e09-2ef5ec8b67ce-kube-api-access-78xks" (OuterVolumeSpecName: "kube-api-access-78xks") pod "c1ce97a2-4d10-4bf6-8e09-2ef5ec8b67ce" (UID: "c1ce97a2-4d10-4bf6-8e09-2ef5ec8b67ce"). InnerVolumeSpecName "kube-api-access-78xks". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:01:11 crc kubenswrapper[5120]: I0316 16:01:11.835735 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-78xks\" (UniqueName: \"kubernetes.io/projected/c1ce97a2-4d10-4bf6-8e09-2ef5ec8b67ce-kube-api-access-78xks\") on node \"crc\" DevicePath \"\"" Mar 16 16:01:11 crc kubenswrapper[5120]: I0316 16:01:11.954340 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 16:01:11 crc kubenswrapper[5120]: W0316 16:01:11.959288 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcf2c0d02_34db_44f6_b7e5_625a82333785.slice/crio-c37e981b6131bcc8b415b29d539e233947481e9efd14589e23cd1613e5620094 WatchSource:0}: Error finding container c37e981b6131bcc8b415b29d539e233947481e9efd14589e23cd1613e5620094: Status 404 returned error can't find the container with id c37e981b6131bcc8b415b29d539e233947481e9efd14589e23cd1613e5620094 Mar 16 16:01:12 crc kubenswrapper[5120]: I0316 16:01:12.104199 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:01:12 crc kubenswrapper[5120]: I0316 16:01:12.309774 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-create-6h4tj" Mar 16 16:01:12 crc kubenswrapper[5120]: I0316 16:01:12.309845 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-create-6h4tj" event={"ID":"c1ce97a2-4d10-4bf6-8e09-2ef5ec8b67ce","Type":"ContainerDied","Data":"94f1e7aef3e45b6a591fe67dff43501bffda7237b37a9f65db44f772a38040c3"} Mar 16 16:01:12 crc kubenswrapper[5120]: I0316 16:01:12.310375 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="94f1e7aef3e45b6a591fe67dff43501bffda7237b37a9f65db44f772a38040c3" Mar 16 16:01:12 crc kubenswrapper[5120]: I0316 16:01:12.310808 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"cf2c0d02-34db-44f6-b7e5-625a82333785","Type":"ContainerStarted","Data":"17c9dde48e428543edf8e13201760d950879e0829d025bbcff1b1bebc7a0d973"} Mar 16 16:01:12 crc kubenswrapper[5120]: I0316 16:01:12.310829 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"cf2c0d02-34db-44f6-b7e5-625a82333785","Type":"ContainerStarted","Data":"c37e981b6131bcc8b415b29d539e233947481e9efd14589e23cd1613e5620094"} Mar 16 16:01:12 crc kubenswrapper[5120]: I0316 16:01:12.312516 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-k4gq4" event={"ID":"98e439f7-1c93-4a9e-9986-62a1936a4be2","Type":"ContainerStarted","Data":"ed742a5e26665a3d71316c608103962365a9a35c0a127813e4c4f824e7da4849"} Mar 16 16:01:12 crc kubenswrapper[5120]: I0316 16:01:12.589284 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-create-wm6fp" Mar 16 16:01:12 crc kubenswrapper[5120]: I0316 16:01:12.755434 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0b0e3050-0f6f-47c8-a85a-92434db05b92-operator-scripts\") pod \"0b0e3050-0f6f-47c8-a85a-92434db05b92\" (UID: \"0b0e3050-0f6f-47c8-a85a-92434db05b92\") " Mar 16 16:01:12 crc kubenswrapper[5120]: I0316 16:01:12.755839 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qwvk4\" (UniqueName: \"kubernetes.io/projected/0b0e3050-0f6f-47c8-a85a-92434db05b92-kube-api-access-qwvk4\") pod \"0b0e3050-0f6f-47c8-a85a-92434db05b92\" (UID: \"0b0e3050-0f6f-47c8-a85a-92434db05b92\") " Mar 16 16:01:12 crc kubenswrapper[5120]: I0316 16:01:12.756935 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b0e3050-0f6f-47c8-a85a-92434db05b92-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "0b0e3050-0f6f-47c8-a85a-92434db05b92" (UID: "0b0e3050-0f6f-47c8-a85a-92434db05b92"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:01:12 crc kubenswrapper[5120]: I0316 16:01:12.790532 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b0e3050-0f6f-47c8-a85a-92434db05b92-kube-api-access-qwvk4" (OuterVolumeSpecName: "kube-api-access-qwvk4") pod "0b0e3050-0f6f-47c8-a85a-92434db05b92" (UID: "0b0e3050-0f6f-47c8-a85a-92434db05b92"). InnerVolumeSpecName "kube-api-access-qwvk4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:01:12 crc kubenswrapper[5120]: I0316 16:01:12.814870 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bf50-account-create-update-cjqkk" Mar 16 16:01:12 crc kubenswrapper[5120]: I0316 16:01:12.824060 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-8c74-account-create-update-jw9ct" Mar 16 16:01:12 crc kubenswrapper[5120]: I0316 16:01:12.857637 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qwvk4\" (UniqueName: \"kubernetes.io/projected/0b0e3050-0f6f-47c8-a85a-92434db05b92-kube-api-access-qwvk4\") on node \"crc\" DevicePath \"\"" Mar 16 16:01:12 crc kubenswrapper[5120]: I0316 16:01:12.857690 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0b0e3050-0f6f-47c8-a85a-92434db05b92-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:01:12 crc kubenswrapper[5120]: I0316 16:01:12.958809 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ql5g6\" (UniqueName: \"kubernetes.io/projected/d104673f-f558-4205-9918-6eadf7543add-kube-api-access-ql5g6\") pod \"d104673f-f558-4205-9918-6eadf7543add\" (UID: \"d104673f-f558-4205-9918-6eadf7543add\") " Mar 16 16:01:12 crc kubenswrapper[5120]: I0316 16:01:12.958911 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2n9kl\" (UniqueName: \"kubernetes.io/projected/dd7b1ebe-2b4e-4c17-8a09-5dc362dfc914-kube-api-access-2n9kl\") pod \"dd7b1ebe-2b4e-4c17-8a09-5dc362dfc914\" (UID: \"dd7b1ebe-2b4e-4c17-8a09-5dc362dfc914\") " Mar 16 16:01:12 crc kubenswrapper[5120]: I0316 16:01:12.958967 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/dd7b1ebe-2b4e-4c17-8a09-5dc362dfc914-operator-scripts\") pod \"dd7b1ebe-2b4e-4c17-8a09-5dc362dfc914\" (UID: \"dd7b1ebe-2b4e-4c17-8a09-5dc362dfc914\") " Mar 16 16:01:12 crc kubenswrapper[5120]: I0316 16:01:12.959026 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d104673f-f558-4205-9918-6eadf7543add-operator-scripts\") pod \"d104673f-f558-4205-9918-6eadf7543add\" (UID: \"d104673f-f558-4205-9918-6eadf7543add\") " Mar 16 16:01:12 crc kubenswrapper[5120]: I0316 16:01:12.960186 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d104673f-f558-4205-9918-6eadf7543add-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "d104673f-f558-4205-9918-6eadf7543add" (UID: "d104673f-f558-4205-9918-6eadf7543add"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:01:12 crc kubenswrapper[5120]: I0316 16:01:12.960648 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dd7b1ebe-2b4e-4c17-8a09-5dc362dfc914-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "dd7b1ebe-2b4e-4c17-8a09-5dc362dfc914" (UID: "dd7b1ebe-2b4e-4c17-8a09-5dc362dfc914"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:01:12 crc kubenswrapper[5120]: I0316 16:01:12.962029 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d104673f-f558-4205-9918-6eadf7543add-kube-api-access-ql5g6" (OuterVolumeSpecName: "kube-api-access-ql5g6") pod "d104673f-f558-4205-9918-6eadf7543add" (UID: "d104673f-f558-4205-9918-6eadf7543add"). InnerVolumeSpecName "kube-api-access-ql5g6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:01:12 crc kubenswrapper[5120]: I0316 16:01:12.965885 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd7b1ebe-2b4e-4c17-8a09-5dc362dfc914-kube-api-access-2n9kl" (OuterVolumeSpecName: "kube-api-access-2n9kl") pod "dd7b1ebe-2b4e-4c17-8a09-5dc362dfc914" (UID: "dd7b1ebe-2b4e-4c17-8a09-5dc362dfc914"). InnerVolumeSpecName "kube-api-access-2n9kl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:01:13 crc kubenswrapper[5120]: I0316 16:01:13.060944 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ql5g6\" (UniqueName: \"kubernetes.io/projected/d104673f-f558-4205-9918-6eadf7543add-kube-api-access-ql5g6\") on node \"crc\" DevicePath \"\"" Mar 16 16:01:13 crc kubenswrapper[5120]: I0316 16:01:13.060997 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2n9kl\" (UniqueName: \"kubernetes.io/projected/dd7b1ebe-2b4e-4c17-8a09-5dc362dfc914-kube-api-access-2n9kl\") on node \"crc\" DevicePath \"\"" Mar 16 16:01:13 crc kubenswrapper[5120]: I0316 16:01:13.061013 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/dd7b1ebe-2b4e-4c17-8a09-5dc362dfc914-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:01:13 crc kubenswrapper[5120]: I0316 16:01:13.061026 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d104673f-f558-4205-9918-6eadf7543add-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:01:13 crc kubenswrapper[5120]: I0316 16:01:13.323231 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"cf2c0d02-34db-44f6-b7e5-625a82333785","Type":"ContainerStarted","Data":"b03cf446275a66219f4644fb85b109bab0f36b29c41995353e1cfd1b7896143f"} Mar 16 16:01:13 crc kubenswrapper[5120]: I0316 16:01:13.323343 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:01:13 crc kubenswrapper[5120]: I0316 16:01:13.325023 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-create-wm6fp" Mar 16 16:01:13 crc kubenswrapper[5120]: I0316 16:01:13.325027 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-create-wm6fp" event={"ID":"0b0e3050-0f6f-47c8-a85a-92434db05b92","Type":"ContainerDied","Data":"e3c67fbd7bd1f64c8cf1bba75ca780364226936e6be6cbc633709f178cef4d8d"} Mar 16 16:01:13 crc kubenswrapper[5120]: I0316 16:01:13.325212 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e3c67fbd7bd1f64c8cf1bba75ca780364226936e6be6cbc633709f178cef4d8d" Mar 16 16:01:13 crc kubenswrapper[5120]: I0316 16:01:13.326654 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bf50-account-create-update-cjqkk" Mar 16 16:01:13 crc kubenswrapper[5120]: I0316 16:01:13.326708 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bf50-account-create-update-cjqkk" event={"ID":"d104673f-f558-4205-9918-6eadf7543add","Type":"ContainerDied","Data":"664442c000aa278b02006c98fc2118a733addfaa815577582a441fa467b77a99"} Mar 16 16:01:13 crc kubenswrapper[5120]: I0316 16:01:13.326835 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="664442c000aa278b02006c98fc2118a733addfaa815577582a441fa467b77a99" Mar 16 16:01:13 crc kubenswrapper[5120]: I0316 16:01:13.329116 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-8c74-account-create-update-jw9ct" Mar 16 16:01:13 crc kubenswrapper[5120]: I0316 16:01:13.329158 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-8c74-account-create-update-jw9ct" event={"ID":"dd7b1ebe-2b4e-4c17-8a09-5dc362dfc914","Type":"ContainerDied","Data":"21fe3c11ffab9b0c4f47473a06999646eace0f5f54c7cf898391a1d21ee7842f"} Mar 16 16:01:13 crc kubenswrapper[5120]: I0316 16:01:13.329206 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="21fe3c11ffab9b0c4f47473a06999646eace0f5f54c7cf898391a1d21ee7842f" Mar 16 16:01:13 crc kubenswrapper[5120]: I0316 16:01:13.354588 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovn-northd-0" podStartSLOduration=2.354570934 podStartE2EDuration="2.354570934s" podCreationTimestamp="2026-03-16 16:01:11 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:01:13.349283929 +0000 UTC m=+1775.503215596" watchObservedRunningTime="2026-03-16 16:01:13.354570934 +0000 UTC m=+1775.508502591" Mar 16 16:01:13 crc kubenswrapper[5120]: I0316 16:01:13.775348 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/7e01ce77-a7e7-4f90-880f-fb2aa9b506a0-etc-swift\") pod \"swift-storage-0\" (UID: \"7e01ce77-a7e7-4f90-880f-fb2aa9b506a0\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:01:13 crc kubenswrapper[5120]: E0316 16:01:13.776987 5120 projected.go:289] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Mar 16 16:01:13 crc kubenswrapper[5120]: E0316 16:01:13.777012 5120 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Mar 16 16:01:13 crc kubenswrapper[5120]: E0316 16:01:13.777065 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7e01ce77-a7e7-4f90-880f-fb2aa9b506a0-etc-swift podName:7e01ce77-a7e7-4f90-880f-fb2aa9b506a0 nodeName:}" failed. No retries permitted until 2026-03-16 16:01:17.777045111 +0000 UTC m=+1779.930976768 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/7e01ce77-a7e7-4f90-880f-fb2aa9b506a0-etc-swift") pod "swift-storage-0" (UID: "7e01ce77-a7e7-4f90-880f-fb2aa9b506a0") : configmap "swift-ring-files" not found Mar 16 16:01:14 crc kubenswrapper[5120]: I0316 16:01:14.754339 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/root-account-create-update-bl2bf"] Mar 16 16:01:14 crc kubenswrapper[5120]: I0316 16:01:14.756362 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd7b1ebe-2b4e-4c17-8a09-5dc362dfc914" containerName="mariadb-account-create-update" Mar 16 16:01:14 crc kubenswrapper[5120]: I0316 16:01:14.756482 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd7b1ebe-2b4e-4c17-8a09-5dc362dfc914" containerName="mariadb-account-create-update" Mar 16 16:01:14 crc kubenswrapper[5120]: I0316 16:01:14.756585 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1ce97a2-4d10-4bf6-8e09-2ef5ec8b67ce" containerName="mariadb-database-create" Mar 16 16:01:14 crc kubenswrapper[5120]: I0316 16:01:14.756665 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1ce97a2-4d10-4bf6-8e09-2ef5ec8b67ce" containerName="mariadb-database-create" Mar 16 16:01:14 crc kubenswrapper[5120]: I0316 16:01:14.756753 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b0e3050-0f6f-47c8-a85a-92434db05b92" containerName="mariadb-database-create" Mar 16 16:01:14 crc kubenswrapper[5120]: I0316 16:01:14.757573 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b0e3050-0f6f-47c8-a85a-92434db05b92" containerName="mariadb-database-create" Mar 16 16:01:14 crc kubenswrapper[5120]: I0316 16:01:14.757647 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d104673f-f558-4205-9918-6eadf7543add" containerName="mariadb-account-create-update" Mar 16 16:01:14 crc kubenswrapper[5120]: I0316 16:01:14.757703 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="d104673f-f558-4205-9918-6eadf7543add" containerName="mariadb-account-create-update" Mar 16 16:01:14 crc kubenswrapper[5120]: I0316 16:01:14.758016 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="0b0e3050-0f6f-47c8-a85a-92434db05b92" containerName="mariadb-database-create" Mar 16 16:01:14 crc kubenswrapper[5120]: I0316 16:01:14.758116 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c1ce97a2-4d10-4bf6-8e09-2ef5ec8b67ce" containerName="mariadb-database-create" Mar 16 16:01:14 crc kubenswrapper[5120]: I0316 16:01:14.758203 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="d104673f-f558-4205-9918-6eadf7543add" containerName="mariadb-account-create-update" Mar 16 16:01:14 crc kubenswrapper[5120]: I0316 16:01:14.758302 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="dd7b1ebe-2b4e-4c17-8a09-5dc362dfc914" containerName="mariadb-account-create-update" Mar 16 16:01:14 crc kubenswrapper[5120]: I0316 16:01:14.765192 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-bl2bf" Mar 16 16:01:14 crc kubenswrapper[5120]: I0316 16:01:14.770464 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"openstack-mariadb-root-db-secret\"" Mar 16 16:01:14 crc kubenswrapper[5120]: I0316 16:01:14.785593 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-bl2bf"] Mar 16 16:01:14 crc kubenswrapper[5120]: I0316 16:01:14.897825 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e0ef4168-a973-42c9-b2f9-a9415e7226bf-operator-scripts\") pod \"root-account-create-update-bl2bf\" (UID: \"e0ef4168-a973-42c9-b2f9-a9415e7226bf\") " pod="openstack-kuttl-tests/root-account-create-update-bl2bf" Mar 16 16:01:14 crc kubenswrapper[5120]: I0316 16:01:14.898099 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjpdr\" (UniqueName: \"kubernetes.io/projected/e0ef4168-a973-42c9-b2f9-a9415e7226bf-kube-api-access-hjpdr\") pod \"root-account-create-update-bl2bf\" (UID: \"e0ef4168-a973-42c9-b2f9-a9415e7226bf\") " pod="openstack-kuttl-tests/root-account-create-update-bl2bf" Mar 16 16:01:15 crc kubenswrapper[5120]: I0316 16:01:15.000388 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hjpdr\" (UniqueName: \"kubernetes.io/projected/e0ef4168-a973-42c9-b2f9-a9415e7226bf-kube-api-access-hjpdr\") pod \"root-account-create-update-bl2bf\" (UID: \"e0ef4168-a973-42c9-b2f9-a9415e7226bf\") " pod="openstack-kuttl-tests/root-account-create-update-bl2bf" Mar 16 16:01:15 crc kubenswrapper[5120]: I0316 16:01:15.000696 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e0ef4168-a973-42c9-b2f9-a9415e7226bf-operator-scripts\") pod \"root-account-create-update-bl2bf\" (UID: \"e0ef4168-a973-42c9-b2f9-a9415e7226bf\") " pod="openstack-kuttl-tests/root-account-create-update-bl2bf" Mar 16 16:01:15 crc kubenswrapper[5120]: I0316 16:01:15.001988 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e0ef4168-a973-42c9-b2f9-a9415e7226bf-operator-scripts\") pod \"root-account-create-update-bl2bf\" (UID: \"e0ef4168-a973-42c9-b2f9-a9415e7226bf\") " pod="openstack-kuttl-tests/root-account-create-update-bl2bf" Mar 16 16:01:15 crc kubenswrapper[5120]: I0316 16:01:15.026545 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjpdr\" (UniqueName: \"kubernetes.io/projected/e0ef4168-a973-42c9-b2f9-a9415e7226bf-kube-api-access-hjpdr\") pod \"root-account-create-update-bl2bf\" (UID: \"e0ef4168-a973-42c9-b2f9-a9415e7226bf\") " pod="openstack-kuttl-tests/root-account-create-update-bl2bf" Mar 16 16:01:15 crc kubenswrapper[5120]: I0316 16:01:15.092466 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-bl2bf" Mar 16 16:01:15 crc kubenswrapper[5120]: I0316 16:01:15.248927 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-db-create-rjhgv"] Mar 16 16:01:15 crc kubenswrapper[5120]: I0316 16:01:15.254480 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-create-rjhgv" Mar 16 16:01:15 crc kubenswrapper[5120]: I0316 16:01:15.254834 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-db-create-rjhgv"] Mar 16 16:01:15 crc kubenswrapper[5120]: I0316 16:01:15.342161 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-6354-account-create-update-6wv9h"] Mar 16 16:01:15 crc kubenswrapper[5120]: I0316 16:01:15.347729 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-6354-account-create-update-6wv9h" Mar 16 16:01:15 crc kubenswrapper[5120]: I0316 16:01:15.349582 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-6354-account-create-update-6wv9h"] Mar 16 16:01:15 crc kubenswrapper[5120]: I0316 16:01:15.349838 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-db-secret\"" Mar 16 16:01:15 crc kubenswrapper[5120]: I0316 16:01:15.407240 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/cda3f933-805e-46a5-b273-c63aaba14e07-operator-scripts\") pod \"glance-db-create-rjhgv\" (UID: \"cda3f933-805e-46a5-b273-c63aaba14e07\") " pod="openstack-kuttl-tests/glance-db-create-rjhgv" Mar 16 16:01:15 crc kubenswrapper[5120]: I0316 16:01:15.407684 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2zndq\" (UniqueName: \"kubernetes.io/projected/cda3f933-805e-46a5-b273-c63aaba14e07-kube-api-access-2zndq\") pod \"glance-db-create-rjhgv\" (UID: \"cda3f933-805e-46a5-b273-c63aaba14e07\") " pod="openstack-kuttl-tests/glance-db-create-rjhgv" Mar 16 16:01:15 crc kubenswrapper[5120]: I0316 16:01:15.509067 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2zndq\" (UniqueName: \"kubernetes.io/projected/cda3f933-805e-46a5-b273-c63aaba14e07-kube-api-access-2zndq\") pod \"glance-db-create-rjhgv\" (UID: \"cda3f933-805e-46a5-b273-c63aaba14e07\") " pod="openstack-kuttl-tests/glance-db-create-rjhgv" Mar 16 16:01:15 crc kubenswrapper[5120]: I0316 16:01:15.509141 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2ef9f7e4-8520-4e71-b120-b60f266c5548-operator-scripts\") pod \"glance-6354-account-create-update-6wv9h\" (UID: \"2ef9f7e4-8520-4e71-b120-b60f266c5548\") " pod="openstack-kuttl-tests/glance-6354-account-create-update-6wv9h" Mar 16 16:01:15 crc kubenswrapper[5120]: I0316 16:01:15.509174 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/cda3f933-805e-46a5-b273-c63aaba14e07-operator-scripts\") pod \"glance-db-create-rjhgv\" (UID: \"cda3f933-805e-46a5-b273-c63aaba14e07\") " pod="openstack-kuttl-tests/glance-db-create-rjhgv" Mar 16 16:01:15 crc kubenswrapper[5120]: I0316 16:01:15.509203 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6lch\" (UniqueName: \"kubernetes.io/projected/2ef9f7e4-8520-4e71-b120-b60f266c5548-kube-api-access-r6lch\") pod \"glance-6354-account-create-update-6wv9h\" (UID: \"2ef9f7e4-8520-4e71-b120-b60f266c5548\") " pod="openstack-kuttl-tests/glance-6354-account-create-update-6wv9h" Mar 16 16:01:15 crc kubenswrapper[5120]: I0316 16:01:15.510320 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/cda3f933-805e-46a5-b273-c63aaba14e07-operator-scripts\") pod \"glance-db-create-rjhgv\" (UID: \"cda3f933-805e-46a5-b273-c63aaba14e07\") " pod="openstack-kuttl-tests/glance-db-create-rjhgv" Mar 16 16:01:15 crc kubenswrapper[5120]: I0316 16:01:15.534522 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2zndq\" (UniqueName: \"kubernetes.io/projected/cda3f933-805e-46a5-b273-c63aaba14e07-kube-api-access-2zndq\") pod \"glance-db-create-rjhgv\" (UID: \"cda3f933-805e-46a5-b273-c63aaba14e07\") " pod="openstack-kuttl-tests/glance-db-create-rjhgv" Mar 16 16:01:15 crc kubenswrapper[5120]: I0316 16:01:15.576561 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-create-rjhgv" Mar 16 16:01:15 crc kubenswrapper[5120]: I0316 16:01:15.595890 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-bl2bf"] Mar 16 16:01:15 crc kubenswrapper[5120]: I0316 16:01:15.610356 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r6lch\" (UniqueName: \"kubernetes.io/projected/2ef9f7e4-8520-4e71-b120-b60f266c5548-kube-api-access-r6lch\") pod \"glance-6354-account-create-update-6wv9h\" (UID: \"2ef9f7e4-8520-4e71-b120-b60f266c5548\") " pod="openstack-kuttl-tests/glance-6354-account-create-update-6wv9h" Mar 16 16:01:15 crc kubenswrapper[5120]: I0316 16:01:15.610623 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2ef9f7e4-8520-4e71-b120-b60f266c5548-operator-scripts\") pod \"glance-6354-account-create-update-6wv9h\" (UID: \"2ef9f7e4-8520-4e71-b120-b60f266c5548\") " pod="openstack-kuttl-tests/glance-6354-account-create-update-6wv9h" Mar 16 16:01:15 crc kubenswrapper[5120]: I0316 16:01:15.611633 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2ef9f7e4-8520-4e71-b120-b60f266c5548-operator-scripts\") pod \"glance-6354-account-create-update-6wv9h\" (UID: \"2ef9f7e4-8520-4e71-b120-b60f266c5548\") " pod="openstack-kuttl-tests/glance-6354-account-create-update-6wv9h" Mar 16 16:01:15 crc kubenswrapper[5120]: I0316 16:01:15.642330 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6lch\" (UniqueName: \"kubernetes.io/projected/2ef9f7e4-8520-4e71-b120-b60f266c5548-kube-api-access-r6lch\") pod \"glance-6354-account-create-update-6wv9h\" (UID: \"2ef9f7e4-8520-4e71-b120-b60f266c5548\") " pod="openstack-kuttl-tests/glance-6354-account-create-update-6wv9h" Mar 16 16:01:15 crc kubenswrapper[5120]: I0316 16:01:15.667154 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-6354-account-create-update-6wv9h" Mar 16 16:01:16 crc kubenswrapper[5120]: I0316 16:01:16.070581 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-db-create-rjhgv"] Mar 16 16:01:16 crc kubenswrapper[5120]: W0316 16:01:16.094888 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcda3f933_805e_46a5_b273_c63aaba14e07.slice/crio-3eac4e1c0dce388f1c606f48e96be807fc6fe6f4c5a90072726a568e11689a13 WatchSource:0}: Error finding container 3eac4e1c0dce388f1c606f48e96be807fc6fe6f4c5a90072726a568e11689a13: Status 404 returned error can't find the container with id 3eac4e1c0dce388f1c606f48e96be807fc6fe6f4c5a90072726a568e11689a13 Mar 16 16:01:16 crc kubenswrapper[5120]: I0316 16:01:16.136343 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-6354-account-create-update-6wv9h"] Mar 16 16:01:16 crc kubenswrapper[5120]: I0316 16:01:16.402902 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-6354-account-create-update-6wv9h" event={"ID":"2ef9f7e4-8520-4e71-b120-b60f266c5548","Type":"ContainerStarted","Data":"4382fea5dbe6b85d4dc988022ec8b60e2bcaab495ee9e1477677db109aeebc8a"} Mar 16 16:01:16 crc kubenswrapper[5120]: I0316 16:01:16.402984 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-6354-account-create-update-6wv9h" event={"ID":"2ef9f7e4-8520-4e71-b120-b60f266c5548","Type":"ContainerStarted","Data":"03273a51b7d23434dab7322c1e60c751ac362c676f724e7e5f3dde63b6cd30c9"} Mar 16 16:01:16 crc kubenswrapper[5120]: I0316 16:01:16.404934 5120 generic.go:358] "Generic (PLEG): container finished" podID="e0ef4168-a973-42c9-b2f9-a9415e7226bf" containerID="16bde90c3e45e8d6500e401af0a24d833ac7893e1b965074bc2ae3914db36645" exitCode=0 Mar 16 16:01:16 crc kubenswrapper[5120]: I0316 16:01:16.405097 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-bl2bf" event={"ID":"e0ef4168-a973-42c9-b2f9-a9415e7226bf","Type":"ContainerDied","Data":"16bde90c3e45e8d6500e401af0a24d833ac7893e1b965074bc2ae3914db36645"} Mar 16 16:01:16 crc kubenswrapper[5120]: I0316 16:01:16.405126 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-bl2bf" event={"ID":"e0ef4168-a973-42c9-b2f9-a9415e7226bf","Type":"ContainerStarted","Data":"aff3d64efdd6112e998cdb44fa87ad9f8e72949f31b1e12f45fa8bdcc97aef53"} Mar 16 16:01:16 crc kubenswrapper[5120]: I0316 16:01:16.408258 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-create-rjhgv" event={"ID":"cda3f933-805e-46a5-b273-c63aaba14e07","Type":"ContainerStarted","Data":"d87b91b98b90b71a6d1afb6d3e439a81b8646bc3845168578f549adecd3d4799"} Mar 16 16:01:16 crc kubenswrapper[5120]: I0316 16:01:16.408324 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-create-rjhgv" event={"ID":"cda3f933-805e-46a5-b273-c63aaba14e07","Type":"ContainerStarted","Data":"3eac4e1c0dce388f1c606f48e96be807fc6fe6f4c5a90072726a568e11689a13"} Mar 16 16:01:16 crc kubenswrapper[5120]: I0316 16:01:16.424537 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-6354-account-create-update-6wv9h" podStartSLOduration=1.424505266 podStartE2EDuration="1.424505266s" podCreationTimestamp="2026-03-16 16:01:15 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:01:16.416484926 +0000 UTC m=+1778.570416573" watchObservedRunningTime="2026-03-16 16:01:16.424505266 +0000 UTC m=+1778.578436923" Mar 16 16:01:16 crc kubenswrapper[5120]: I0316 16:01:16.439126 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-db-create-rjhgv" podStartSLOduration=1.439096878 podStartE2EDuration="1.439096878s" podCreationTimestamp="2026-03-16 16:01:15 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:01:16.432807595 +0000 UTC m=+1778.586739292" watchObservedRunningTime="2026-03-16 16:01:16.439096878 +0000 UTC m=+1778.593028575" Mar 16 16:01:17 crc kubenswrapper[5120]: I0316 16:01:17.420962 5120 generic.go:358] "Generic (PLEG): container finished" podID="2ef9f7e4-8520-4e71-b120-b60f266c5548" containerID="4382fea5dbe6b85d4dc988022ec8b60e2bcaab495ee9e1477677db109aeebc8a" exitCode=0 Mar 16 16:01:17 crc kubenswrapper[5120]: I0316 16:01:17.421451 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-6354-account-create-update-6wv9h" event={"ID":"2ef9f7e4-8520-4e71-b120-b60f266c5548","Type":"ContainerDied","Data":"4382fea5dbe6b85d4dc988022ec8b60e2bcaab495ee9e1477677db109aeebc8a"} Mar 16 16:01:17 crc kubenswrapper[5120]: I0316 16:01:17.424494 5120 generic.go:358] "Generic (PLEG): container finished" podID="cda3f933-805e-46a5-b273-c63aaba14e07" containerID="d87b91b98b90b71a6d1afb6d3e439a81b8646bc3845168578f549adecd3d4799" exitCode=0 Mar 16 16:01:17 crc kubenswrapper[5120]: I0316 16:01:17.424602 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-create-rjhgv" event={"ID":"cda3f933-805e-46a5-b273-c63aaba14e07","Type":"ContainerDied","Data":"d87b91b98b90b71a6d1afb6d3e439a81b8646bc3845168578f549adecd3d4799"} Mar 16 16:01:17 crc kubenswrapper[5120]: I0316 16:01:17.817068 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-bl2bf" Mar 16 16:01:17 crc kubenswrapper[5120]: I0316 16:01:17.852860 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hjpdr\" (UniqueName: \"kubernetes.io/projected/e0ef4168-a973-42c9-b2f9-a9415e7226bf-kube-api-access-hjpdr\") pod \"e0ef4168-a973-42c9-b2f9-a9415e7226bf\" (UID: \"e0ef4168-a973-42c9-b2f9-a9415e7226bf\") " Mar 16 16:01:17 crc kubenswrapper[5120]: I0316 16:01:17.853021 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e0ef4168-a973-42c9-b2f9-a9415e7226bf-operator-scripts\") pod \"e0ef4168-a973-42c9-b2f9-a9415e7226bf\" (UID: \"e0ef4168-a973-42c9-b2f9-a9415e7226bf\") " Mar 16 16:01:17 crc kubenswrapper[5120]: I0316 16:01:17.853447 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/7e01ce77-a7e7-4f90-880f-fb2aa9b506a0-etc-swift\") pod \"swift-storage-0\" (UID: \"7e01ce77-a7e7-4f90-880f-fb2aa9b506a0\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:01:17 crc kubenswrapper[5120]: E0316 16:01:17.853604 5120 projected.go:289] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Mar 16 16:01:17 crc kubenswrapper[5120]: E0316 16:01:17.853622 5120 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Mar 16 16:01:17 crc kubenswrapper[5120]: E0316 16:01:17.853674 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7e01ce77-a7e7-4f90-880f-fb2aa9b506a0-etc-swift podName:7e01ce77-a7e7-4f90-880f-fb2aa9b506a0 nodeName:}" failed. No retries permitted until 2026-03-16 16:01:25.85365907 +0000 UTC m=+1788.007590737 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/7e01ce77-a7e7-4f90-880f-fb2aa9b506a0-etc-swift") pod "swift-storage-0" (UID: "7e01ce77-a7e7-4f90-880f-fb2aa9b506a0") : configmap "swift-ring-files" not found Mar 16 16:01:17 crc kubenswrapper[5120]: I0316 16:01:17.854533 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0ef4168-a973-42c9-b2f9-a9415e7226bf-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "e0ef4168-a973-42c9-b2f9-a9415e7226bf" (UID: "e0ef4168-a973-42c9-b2f9-a9415e7226bf"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:01:17 crc kubenswrapper[5120]: I0316 16:01:17.867917 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0ef4168-a973-42c9-b2f9-a9415e7226bf-kube-api-access-hjpdr" (OuterVolumeSpecName: "kube-api-access-hjpdr") pod "e0ef4168-a973-42c9-b2f9-a9415e7226bf" (UID: "e0ef4168-a973-42c9-b2f9-a9415e7226bf"). InnerVolumeSpecName "kube-api-access-hjpdr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:01:17 crc kubenswrapper[5120]: I0316 16:01:17.955081 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hjpdr\" (UniqueName: \"kubernetes.io/projected/e0ef4168-a973-42c9-b2f9-a9415e7226bf-kube-api-access-hjpdr\") on node \"crc\" DevicePath \"\"" Mar 16 16:01:17 crc kubenswrapper[5120]: I0316 16:01:17.955135 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e0ef4168-a973-42c9-b2f9-a9415e7226bf-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:01:18 crc kubenswrapper[5120]: I0316 16:01:18.437419 5120 generic.go:358] "Generic (PLEG): container finished" podID="98e439f7-1c93-4a9e-9986-62a1936a4be2" containerID="ed742a5e26665a3d71316c608103962365a9a35c0a127813e4c4f824e7da4849" exitCode=0 Mar 16 16:01:18 crc kubenswrapper[5120]: I0316 16:01:18.437528 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-k4gq4" event={"ID":"98e439f7-1c93-4a9e-9986-62a1936a4be2","Type":"ContainerDied","Data":"ed742a5e26665a3d71316c608103962365a9a35c0a127813e4c4f824e7da4849"} Mar 16 16:01:18 crc kubenswrapper[5120]: I0316 16:01:18.440936 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-bl2bf" Mar 16 16:01:18 crc kubenswrapper[5120]: I0316 16:01:18.441285 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-bl2bf" event={"ID":"e0ef4168-a973-42c9-b2f9-a9415e7226bf","Type":"ContainerDied","Data":"aff3d64efdd6112e998cdb44fa87ad9f8e72949f31b1e12f45fa8bdcc97aef53"} Mar 16 16:01:18 crc kubenswrapper[5120]: I0316 16:01:18.441707 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="aff3d64efdd6112e998cdb44fa87ad9f8e72949f31b1e12f45fa8bdcc97aef53" Mar 16 16:01:19 crc kubenswrapper[5120]: I0316 16:01:19.006475 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-create-rjhgv" Mar 16 16:01:19 crc kubenswrapper[5120]: I0316 16:01:19.013972 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-6354-account-create-update-6wv9h" Mar 16 16:01:19 crc kubenswrapper[5120]: I0316 16:01:19.082160 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2ef9f7e4-8520-4e71-b120-b60f266c5548-operator-scripts\") pod \"2ef9f7e4-8520-4e71-b120-b60f266c5548\" (UID: \"2ef9f7e4-8520-4e71-b120-b60f266c5548\") " Mar 16 16:01:19 crc kubenswrapper[5120]: I0316 16:01:19.082673 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r6lch\" (UniqueName: \"kubernetes.io/projected/2ef9f7e4-8520-4e71-b120-b60f266c5548-kube-api-access-r6lch\") pod \"2ef9f7e4-8520-4e71-b120-b60f266c5548\" (UID: \"2ef9f7e4-8520-4e71-b120-b60f266c5548\") " Mar 16 16:01:19 crc kubenswrapper[5120]: I0316 16:01:19.082851 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/cda3f933-805e-46a5-b273-c63aaba14e07-operator-scripts\") pod \"cda3f933-805e-46a5-b273-c63aaba14e07\" (UID: \"cda3f933-805e-46a5-b273-c63aaba14e07\") " Mar 16 16:01:19 crc kubenswrapper[5120]: I0316 16:01:19.082990 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ef9f7e4-8520-4e71-b120-b60f266c5548-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "2ef9f7e4-8520-4e71-b120-b60f266c5548" (UID: "2ef9f7e4-8520-4e71-b120-b60f266c5548"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:01:19 crc kubenswrapper[5120]: I0316 16:01:19.083119 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2zndq\" (UniqueName: \"kubernetes.io/projected/cda3f933-805e-46a5-b273-c63aaba14e07-kube-api-access-2zndq\") pod \"cda3f933-805e-46a5-b273-c63aaba14e07\" (UID: \"cda3f933-805e-46a5-b273-c63aaba14e07\") " Mar 16 16:01:19 crc kubenswrapper[5120]: I0316 16:01:19.083540 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cda3f933-805e-46a5-b273-c63aaba14e07-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "cda3f933-805e-46a5-b273-c63aaba14e07" (UID: "cda3f933-805e-46a5-b273-c63aaba14e07"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:01:19 crc kubenswrapper[5120]: I0316 16:01:19.083892 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2ef9f7e4-8520-4e71-b120-b60f266c5548-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:01:19 crc kubenswrapper[5120]: I0316 16:01:19.084009 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/cda3f933-805e-46a5-b273-c63aaba14e07-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:01:19 crc kubenswrapper[5120]: I0316 16:01:19.088656 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cda3f933-805e-46a5-b273-c63aaba14e07-kube-api-access-2zndq" (OuterVolumeSpecName: "kube-api-access-2zndq") pod "cda3f933-805e-46a5-b273-c63aaba14e07" (UID: "cda3f933-805e-46a5-b273-c63aaba14e07"). InnerVolumeSpecName "kube-api-access-2zndq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:01:19 crc kubenswrapper[5120]: I0316 16:01:19.098380 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ef9f7e4-8520-4e71-b120-b60f266c5548-kube-api-access-r6lch" (OuterVolumeSpecName: "kube-api-access-r6lch") pod "2ef9f7e4-8520-4e71-b120-b60f266c5548" (UID: "2ef9f7e4-8520-4e71-b120-b60f266c5548"). InnerVolumeSpecName "kube-api-access-r6lch". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:01:19 crc kubenswrapper[5120]: I0316 16:01:19.186203 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r6lch\" (UniqueName: \"kubernetes.io/projected/2ef9f7e4-8520-4e71-b120-b60f266c5548-kube-api-access-r6lch\") on node \"crc\" DevicePath \"\"" Mar 16 16:01:19 crc kubenswrapper[5120]: I0316 16:01:19.186272 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2zndq\" (UniqueName: \"kubernetes.io/projected/cda3f933-805e-46a5-b273-c63aaba14e07-kube-api-access-2zndq\") on node \"crc\" DevicePath \"\"" Mar 16 16:01:19 crc kubenswrapper[5120]: I0316 16:01:19.454188 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-6354-account-create-update-6wv9h" Mar 16 16:01:19 crc kubenswrapper[5120]: I0316 16:01:19.454207 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-6354-account-create-update-6wv9h" event={"ID":"2ef9f7e4-8520-4e71-b120-b60f266c5548","Type":"ContainerDied","Data":"03273a51b7d23434dab7322c1e60c751ac362c676f724e7e5f3dde63b6cd30c9"} Mar 16 16:01:19 crc kubenswrapper[5120]: I0316 16:01:19.454243 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="03273a51b7d23434dab7322c1e60c751ac362c676f724e7e5f3dde63b6cd30c9" Mar 16 16:01:19 crc kubenswrapper[5120]: I0316 16:01:19.455729 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-create-rjhgv" Mar 16 16:01:19 crc kubenswrapper[5120]: I0316 16:01:19.455915 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-create-rjhgv" event={"ID":"cda3f933-805e-46a5-b273-c63aaba14e07","Type":"ContainerDied","Data":"3eac4e1c0dce388f1c606f48e96be807fc6fe6f4c5a90072726a568e11689a13"} Mar 16 16:01:19 crc kubenswrapper[5120]: I0316 16:01:19.455962 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3eac4e1c0dce388f1c606f48e96be807fc6fe6f4c5a90072726a568e11689a13" Mar 16 16:01:19 crc kubenswrapper[5120]: I0316 16:01:19.816405 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-k4gq4" Mar 16 16:01:19 crc kubenswrapper[5120]: I0316 16:01:19.896331 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2pdsx\" (UniqueName: \"kubernetes.io/projected/98e439f7-1c93-4a9e-9986-62a1936a4be2-kube-api-access-2pdsx\") pod \"98e439f7-1c93-4a9e-9986-62a1936a4be2\" (UID: \"98e439f7-1c93-4a9e-9986-62a1936a4be2\") " Mar 16 16:01:19 crc kubenswrapper[5120]: I0316 16:01:19.896418 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/98e439f7-1c93-4a9e-9986-62a1936a4be2-ring-data-devices\") pod \"98e439f7-1c93-4a9e-9986-62a1936a4be2\" (UID: \"98e439f7-1c93-4a9e-9986-62a1936a4be2\") " Mar 16 16:01:19 crc kubenswrapper[5120]: I0316 16:01:19.896477 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/98e439f7-1c93-4a9e-9986-62a1936a4be2-swiftconf\") pod \"98e439f7-1c93-4a9e-9986-62a1936a4be2\" (UID: \"98e439f7-1c93-4a9e-9986-62a1936a4be2\") " Mar 16 16:01:19 crc kubenswrapper[5120]: I0316 16:01:19.896573 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/98e439f7-1c93-4a9e-9986-62a1936a4be2-combined-ca-bundle\") pod \"98e439f7-1c93-4a9e-9986-62a1936a4be2\" (UID: \"98e439f7-1c93-4a9e-9986-62a1936a4be2\") " Mar 16 16:01:19 crc kubenswrapper[5120]: I0316 16:01:19.896730 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/98e439f7-1c93-4a9e-9986-62a1936a4be2-scripts\") pod \"98e439f7-1c93-4a9e-9986-62a1936a4be2\" (UID: \"98e439f7-1c93-4a9e-9986-62a1936a4be2\") " Mar 16 16:01:19 crc kubenswrapper[5120]: I0316 16:01:19.896787 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/98e439f7-1c93-4a9e-9986-62a1936a4be2-dispersionconf\") pod \"98e439f7-1c93-4a9e-9986-62a1936a4be2\" (UID: \"98e439f7-1c93-4a9e-9986-62a1936a4be2\") " Mar 16 16:01:19 crc kubenswrapper[5120]: I0316 16:01:19.896823 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/98e439f7-1c93-4a9e-9986-62a1936a4be2-etc-swift\") pod \"98e439f7-1c93-4a9e-9986-62a1936a4be2\" (UID: \"98e439f7-1c93-4a9e-9986-62a1936a4be2\") " Mar 16 16:01:19 crc kubenswrapper[5120]: I0316 16:01:19.896968 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/98e439f7-1c93-4a9e-9986-62a1936a4be2-ring-data-devices" (OuterVolumeSpecName: "ring-data-devices") pod "98e439f7-1c93-4a9e-9986-62a1936a4be2" (UID: "98e439f7-1c93-4a9e-9986-62a1936a4be2"). InnerVolumeSpecName "ring-data-devices". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:01:19 crc kubenswrapper[5120]: I0316 16:01:19.897300 5120 reconciler_common.go:299] "Volume detached for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/98e439f7-1c93-4a9e-9986-62a1936a4be2-ring-data-devices\") on node \"crc\" DevicePath \"\"" Mar 16 16:01:19 crc kubenswrapper[5120]: I0316 16:01:19.899683 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98e439f7-1c93-4a9e-9986-62a1936a4be2-etc-swift" (OuterVolumeSpecName: "etc-swift") pod "98e439f7-1c93-4a9e-9986-62a1936a4be2" (UID: "98e439f7-1c93-4a9e-9986-62a1936a4be2"). InnerVolumeSpecName "etc-swift". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:01:19 crc kubenswrapper[5120]: I0316 16:01:19.900634 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98e439f7-1c93-4a9e-9986-62a1936a4be2-kube-api-access-2pdsx" (OuterVolumeSpecName: "kube-api-access-2pdsx") pod "98e439f7-1c93-4a9e-9986-62a1936a4be2" (UID: "98e439f7-1c93-4a9e-9986-62a1936a4be2"). InnerVolumeSpecName "kube-api-access-2pdsx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:01:19 crc kubenswrapper[5120]: I0316 16:01:19.913009 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/98e439f7-1c93-4a9e-9986-62a1936a4be2-dispersionconf" (OuterVolumeSpecName: "dispersionconf") pod "98e439f7-1c93-4a9e-9986-62a1936a4be2" (UID: "98e439f7-1c93-4a9e-9986-62a1936a4be2"). InnerVolumeSpecName "dispersionconf". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:01:19 crc kubenswrapper[5120]: I0316 16:01:19.917288 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/98e439f7-1c93-4a9e-9986-62a1936a4be2-swiftconf" (OuterVolumeSpecName: "swiftconf") pod "98e439f7-1c93-4a9e-9986-62a1936a4be2" (UID: "98e439f7-1c93-4a9e-9986-62a1936a4be2"). InnerVolumeSpecName "swiftconf". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:01:19 crc kubenswrapper[5120]: I0316 16:01:19.919210 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/98e439f7-1c93-4a9e-9986-62a1936a4be2-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "98e439f7-1c93-4a9e-9986-62a1936a4be2" (UID: "98e439f7-1c93-4a9e-9986-62a1936a4be2"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:01:19 crc kubenswrapper[5120]: I0316 16:01:19.931377 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/98e439f7-1c93-4a9e-9986-62a1936a4be2-scripts" (OuterVolumeSpecName: "scripts") pod "98e439f7-1c93-4a9e-9986-62a1936a4be2" (UID: "98e439f7-1c93-4a9e-9986-62a1936a4be2"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:01:19 crc kubenswrapper[5120]: I0316 16:01:19.999270 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/98e439f7-1c93-4a9e-9986-62a1936a4be2-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:01:19 crc kubenswrapper[5120]: I0316 16:01:19.999307 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/98e439f7-1c93-4a9e-9986-62a1936a4be2-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:01:19 crc kubenswrapper[5120]: I0316 16:01:19.999315 5120 reconciler_common.go:299] "Volume detached for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/98e439f7-1c93-4a9e-9986-62a1936a4be2-dispersionconf\") on node \"crc\" DevicePath \"\"" Mar 16 16:01:19 crc kubenswrapper[5120]: I0316 16:01:19.999324 5120 reconciler_common.go:299] "Volume detached for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/98e439f7-1c93-4a9e-9986-62a1936a4be2-etc-swift\") on node \"crc\" DevicePath \"\"" Mar 16 16:01:19 crc kubenswrapper[5120]: I0316 16:01:19.999333 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2pdsx\" (UniqueName: \"kubernetes.io/projected/98e439f7-1c93-4a9e-9986-62a1936a4be2-kube-api-access-2pdsx\") on node \"crc\" DevicePath \"\"" Mar 16 16:01:19 crc kubenswrapper[5120]: I0316 16:01:19.999342 5120 reconciler_common.go:299] "Volume detached for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/98e439f7-1c93-4a9e-9986-62a1936a4be2-swiftconf\") on node \"crc\" DevicePath \"\"" Mar 16 16:01:20 crc kubenswrapper[5120]: I0316 16:01:20.488669 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-k4gq4" event={"ID":"98e439f7-1c93-4a9e-9986-62a1936a4be2","Type":"ContainerDied","Data":"0fba98f221cdca3dd639a31dffaeb1430c134b8818efb165e089e955a65ed549"} Mar 16 16:01:20 crc kubenswrapper[5120]: I0316 16:01:20.489005 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0fba98f221cdca3dd639a31dffaeb1430c134b8818efb165e089e955a65ed549" Mar 16 16:01:20 crc kubenswrapper[5120]: I0316 16:01:20.489092 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-k4gq4" Mar 16 16:01:20 crc kubenswrapper[5120]: I0316 16:01:20.571968 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-db-sync-rqcxz"] Mar 16 16:01:20 crc kubenswrapper[5120]: I0316 16:01:20.574166 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cda3f933-805e-46a5-b273-c63aaba14e07" containerName="mariadb-database-create" Mar 16 16:01:20 crc kubenswrapper[5120]: I0316 16:01:20.574201 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="cda3f933-805e-46a5-b273-c63aaba14e07" containerName="mariadb-database-create" Mar 16 16:01:20 crc kubenswrapper[5120]: I0316 16:01:20.574248 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98e439f7-1c93-4a9e-9986-62a1936a4be2" containerName="swift-ring-rebalance" Mar 16 16:01:20 crc kubenswrapper[5120]: I0316 16:01:20.574260 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="98e439f7-1c93-4a9e-9986-62a1936a4be2" containerName="swift-ring-rebalance" Mar 16 16:01:20 crc kubenswrapper[5120]: I0316 16:01:20.574280 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0ef4168-a973-42c9-b2f9-a9415e7226bf" containerName="mariadb-account-create-update" Mar 16 16:01:20 crc kubenswrapper[5120]: I0316 16:01:20.574290 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0ef4168-a973-42c9-b2f9-a9415e7226bf" containerName="mariadb-account-create-update" Mar 16 16:01:20 crc kubenswrapper[5120]: I0316 16:01:20.574330 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ef9f7e4-8520-4e71-b120-b60f266c5548" containerName="mariadb-account-create-update" Mar 16 16:01:20 crc kubenswrapper[5120]: I0316 16:01:20.574338 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ef9f7e4-8520-4e71-b120-b60f266c5548" containerName="mariadb-account-create-update" Mar 16 16:01:20 crc kubenswrapper[5120]: I0316 16:01:20.574537 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="cda3f933-805e-46a5-b273-c63aaba14e07" containerName="mariadb-database-create" Mar 16 16:01:20 crc kubenswrapper[5120]: I0316 16:01:20.574558 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="98e439f7-1c93-4a9e-9986-62a1936a4be2" containerName="swift-ring-rebalance" Mar 16 16:01:20 crc kubenswrapper[5120]: I0316 16:01:20.574575 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e0ef4168-a973-42c9-b2f9-a9415e7226bf" containerName="mariadb-account-create-update" Mar 16 16:01:20 crc kubenswrapper[5120]: I0316 16:01:20.574592 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="2ef9f7e4-8520-4e71-b120-b60f266c5548" containerName="mariadb-account-create-update" Mar 16 16:01:20 crc kubenswrapper[5120]: I0316 16:01:20.583383 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-rqcxz"] Mar 16 16:01:20 crc kubenswrapper[5120]: I0316 16:01:20.583502 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-rqcxz" Mar 16 16:01:20 crc kubenswrapper[5120]: I0316 16:01:20.586074 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-config-data\"" Mar 16 16:01:20 crc kubenswrapper[5120]: I0316 16:01:20.586472 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-glance-dockercfg-84rcs\"" Mar 16 16:01:20 crc kubenswrapper[5120]: I0316 16:01:20.718706 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6j5lp\" (UniqueName: \"kubernetes.io/projected/5af0f689-f31d-4721-9719-daf7d967fec1-kube-api-access-6j5lp\") pod \"glance-db-sync-rqcxz\" (UID: \"5af0f689-f31d-4721-9719-daf7d967fec1\") " pod="openstack-kuttl-tests/glance-db-sync-rqcxz" Mar 16 16:01:20 crc kubenswrapper[5120]: I0316 16:01:20.718743 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5af0f689-f31d-4721-9719-daf7d967fec1-combined-ca-bundle\") pod \"glance-db-sync-rqcxz\" (UID: \"5af0f689-f31d-4721-9719-daf7d967fec1\") " pod="openstack-kuttl-tests/glance-db-sync-rqcxz" Mar 16 16:01:20 crc kubenswrapper[5120]: I0316 16:01:20.719033 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/5af0f689-f31d-4721-9719-daf7d967fec1-db-sync-config-data\") pod \"glance-db-sync-rqcxz\" (UID: \"5af0f689-f31d-4721-9719-daf7d967fec1\") " pod="openstack-kuttl-tests/glance-db-sync-rqcxz" Mar 16 16:01:20 crc kubenswrapper[5120]: I0316 16:01:20.719204 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5af0f689-f31d-4721-9719-daf7d967fec1-config-data\") pod \"glance-db-sync-rqcxz\" (UID: \"5af0f689-f31d-4721-9719-daf7d967fec1\") " pod="openstack-kuttl-tests/glance-db-sync-rqcxz" Mar 16 16:01:20 crc kubenswrapper[5120]: I0316 16:01:20.821109 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6j5lp\" (UniqueName: \"kubernetes.io/projected/5af0f689-f31d-4721-9719-daf7d967fec1-kube-api-access-6j5lp\") pod \"glance-db-sync-rqcxz\" (UID: \"5af0f689-f31d-4721-9719-daf7d967fec1\") " pod="openstack-kuttl-tests/glance-db-sync-rqcxz" Mar 16 16:01:20 crc kubenswrapper[5120]: I0316 16:01:20.821180 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5af0f689-f31d-4721-9719-daf7d967fec1-combined-ca-bundle\") pod \"glance-db-sync-rqcxz\" (UID: \"5af0f689-f31d-4721-9719-daf7d967fec1\") " pod="openstack-kuttl-tests/glance-db-sync-rqcxz" Mar 16 16:01:20 crc kubenswrapper[5120]: I0316 16:01:20.821325 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/5af0f689-f31d-4721-9719-daf7d967fec1-db-sync-config-data\") pod \"glance-db-sync-rqcxz\" (UID: \"5af0f689-f31d-4721-9719-daf7d967fec1\") " pod="openstack-kuttl-tests/glance-db-sync-rqcxz" Mar 16 16:01:20 crc kubenswrapper[5120]: I0316 16:01:20.821374 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5af0f689-f31d-4721-9719-daf7d967fec1-config-data\") pod \"glance-db-sync-rqcxz\" (UID: \"5af0f689-f31d-4721-9719-daf7d967fec1\") " pod="openstack-kuttl-tests/glance-db-sync-rqcxz" Mar 16 16:01:20 crc kubenswrapper[5120]: I0316 16:01:20.828548 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/5af0f689-f31d-4721-9719-daf7d967fec1-db-sync-config-data\") pod \"glance-db-sync-rqcxz\" (UID: \"5af0f689-f31d-4721-9719-daf7d967fec1\") " pod="openstack-kuttl-tests/glance-db-sync-rqcxz" Mar 16 16:01:20 crc kubenswrapper[5120]: I0316 16:01:20.831339 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5af0f689-f31d-4721-9719-daf7d967fec1-config-data\") pod \"glance-db-sync-rqcxz\" (UID: \"5af0f689-f31d-4721-9719-daf7d967fec1\") " pod="openstack-kuttl-tests/glance-db-sync-rqcxz" Mar 16 16:01:20 crc kubenswrapper[5120]: I0316 16:01:20.831641 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5af0f689-f31d-4721-9719-daf7d967fec1-combined-ca-bundle\") pod \"glance-db-sync-rqcxz\" (UID: \"5af0f689-f31d-4721-9719-daf7d967fec1\") " pod="openstack-kuttl-tests/glance-db-sync-rqcxz" Mar 16 16:01:20 crc kubenswrapper[5120]: I0316 16:01:20.839935 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6j5lp\" (UniqueName: \"kubernetes.io/projected/5af0f689-f31d-4721-9719-daf7d967fec1-kube-api-access-6j5lp\") pod \"glance-db-sync-rqcxz\" (UID: \"5af0f689-f31d-4721-9719-daf7d967fec1\") " pod="openstack-kuttl-tests/glance-db-sync-rqcxz" Mar 16 16:01:20 crc kubenswrapper[5120]: I0316 16:01:20.908440 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-rqcxz" Mar 16 16:01:21 crc kubenswrapper[5120]: I0316 16:01:21.201148 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-bl2bf"] Mar 16 16:01:21 crc kubenswrapper[5120]: I0316 16:01:21.207479 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-bl2bf"] Mar 16 16:01:21 crc kubenswrapper[5120]: I0316 16:01:21.414579 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-rqcxz"] Mar 16 16:01:21 crc kubenswrapper[5120]: W0316 16:01:21.422622 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5af0f689_f31d_4721_9719_daf7d967fec1.slice/crio-db2a9208bae3e07b8027906f8d669929899359b51b7069dd46fb0fe0d9705b93 WatchSource:0}: Error finding container db2a9208bae3e07b8027906f8d669929899359b51b7069dd46fb0fe0d9705b93: Status 404 returned error can't find the container with id db2a9208bae3e07b8027906f8d669929899359b51b7069dd46fb0fe0d9705b93 Mar 16 16:01:21 crc kubenswrapper[5120]: I0316 16:01:21.500525 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-rqcxz" event={"ID":"5af0f689-f31d-4721-9719-daf7d967fec1","Type":"ContainerStarted","Data":"db2a9208bae3e07b8027906f8d669929899359b51b7069dd46fb0fe0d9705b93"} Mar 16 16:01:22 crc kubenswrapper[5120]: I0316 16:01:22.513082 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-rqcxz" event={"ID":"5af0f689-f31d-4721-9719-daf7d967fec1","Type":"ContainerStarted","Data":"33f96d08c13b95912b968beea058dc4aa708af2cce8d5ddb775b2dd276281ca7"} Mar 16 16:01:22 crc kubenswrapper[5120]: I0316 16:01:22.538156 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-db-sync-rqcxz" podStartSLOduration=2.538136829 podStartE2EDuration="2.538136829s" podCreationTimestamp="2026-03-16 16:01:20 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:01:22.531890207 +0000 UTC m=+1784.685821864" watchObservedRunningTime="2026-03-16 16:01:22.538136829 +0000 UTC m=+1784.692068486" Mar 16 16:01:22 crc kubenswrapper[5120]: I0316 16:01:22.682970 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e0ef4168-a973-42c9-b2f9-a9415e7226bf" path="/var/lib/kubelet/pods/e0ef4168-a973-42c9-b2f9-a9415e7226bf/volumes" Mar 16 16:01:24 crc kubenswrapper[5120]: I0316 16:01:24.430333 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:01:24 crc kubenswrapper[5120]: I0316 16:01:24.668913 5120 scope.go:117] "RemoveContainer" containerID="02ba4fc3f84eccaecfa9e6618280f65626eb76580c4af9ae7a9d7cb3b8dd590b" Mar 16 16:01:24 crc kubenswrapper[5120]: E0316 16:01:24.669354 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:01:25 crc kubenswrapper[5120]: I0316 16:01:25.548164 5120 generic.go:358] "Generic (PLEG): container finished" podID="5af0f689-f31d-4721-9719-daf7d967fec1" containerID="33f96d08c13b95912b968beea058dc4aa708af2cce8d5ddb775b2dd276281ca7" exitCode=0 Mar 16 16:01:25 crc kubenswrapper[5120]: I0316 16:01:25.548305 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-rqcxz" event={"ID":"5af0f689-f31d-4721-9719-daf7d967fec1","Type":"ContainerDied","Data":"33f96d08c13b95912b968beea058dc4aa708af2cce8d5ddb775b2dd276281ca7"} Mar 16 16:01:25 crc kubenswrapper[5120]: I0316 16:01:25.913141 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/7e01ce77-a7e7-4f90-880f-fb2aa9b506a0-etc-swift\") pod \"swift-storage-0\" (UID: \"7e01ce77-a7e7-4f90-880f-fb2aa9b506a0\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:01:25 crc kubenswrapper[5120]: I0316 16:01:25.926489 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/7e01ce77-a7e7-4f90-880f-fb2aa9b506a0-etc-swift\") pod \"swift-storage-0\" (UID: \"7e01ce77-a7e7-4f90-880f-fb2aa9b506a0\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:01:26 crc kubenswrapper[5120]: I0316 16:01:26.063357 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:01:26 crc kubenswrapper[5120]: I0316 16:01:26.243357 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/root-account-create-update-4cxhp"] Mar 16 16:01:26 crc kubenswrapper[5120]: I0316 16:01:26.254893 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-4cxhp" Mar 16 16:01:26 crc kubenswrapper[5120]: I0316 16:01:26.258614 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"openstack-cell1-mariadb-root-db-secret\"" Mar 16 16:01:26 crc kubenswrapper[5120]: I0316 16:01:26.271340 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-4cxhp"] Mar 16 16:01:26 crc kubenswrapper[5120]: I0316 16:01:26.429592 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82lg8\" (UniqueName: \"kubernetes.io/projected/8436861d-e102-45b0-8edf-25a8e41fa9e9-kube-api-access-82lg8\") pod \"root-account-create-update-4cxhp\" (UID: \"8436861d-e102-45b0-8edf-25a8e41fa9e9\") " pod="openstack-kuttl-tests/root-account-create-update-4cxhp" Mar 16 16:01:26 crc kubenswrapper[5120]: I0316 16:01:26.429659 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8436861d-e102-45b0-8edf-25a8e41fa9e9-operator-scripts\") pod \"root-account-create-update-4cxhp\" (UID: \"8436861d-e102-45b0-8edf-25a8e41fa9e9\") " pod="openstack-kuttl-tests/root-account-create-update-4cxhp" Mar 16 16:01:26 crc kubenswrapper[5120]: I0316 16:01:26.532463 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-82lg8\" (UniqueName: \"kubernetes.io/projected/8436861d-e102-45b0-8edf-25a8e41fa9e9-kube-api-access-82lg8\") pod \"root-account-create-update-4cxhp\" (UID: \"8436861d-e102-45b0-8edf-25a8e41fa9e9\") " pod="openstack-kuttl-tests/root-account-create-update-4cxhp" Mar 16 16:01:26 crc kubenswrapper[5120]: I0316 16:01:26.532545 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8436861d-e102-45b0-8edf-25a8e41fa9e9-operator-scripts\") pod \"root-account-create-update-4cxhp\" (UID: \"8436861d-e102-45b0-8edf-25a8e41fa9e9\") " pod="openstack-kuttl-tests/root-account-create-update-4cxhp" Mar 16 16:01:26 crc kubenswrapper[5120]: I0316 16:01:26.534143 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8436861d-e102-45b0-8edf-25a8e41fa9e9-operator-scripts\") pod \"root-account-create-update-4cxhp\" (UID: \"8436861d-e102-45b0-8edf-25a8e41fa9e9\") " pod="openstack-kuttl-tests/root-account-create-update-4cxhp" Mar 16 16:01:26 crc kubenswrapper[5120]: I0316 16:01:26.566161 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-82lg8\" (UniqueName: \"kubernetes.io/projected/8436861d-e102-45b0-8edf-25a8e41fa9e9-kube-api-access-82lg8\") pod \"root-account-create-update-4cxhp\" (UID: \"8436861d-e102-45b0-8edf-25a8e41fa9e9\") " pod="openstack-kuttl-tests/root-account-create-update-4cxhp" Mar 16 16:01:26 crc kubenswrapper[5120]: I0316 16:01:26.581378 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-4cxhp" Mar 16 16:01:26 crc kubenswrapper[5120]: W0316 16:01:26.674739 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7e01ce77_a7e7_4f90_880f_fb2aa9b506a0.slice/crio-ecf1f490646bf1e488ea895d7c712c8f3f0826e9f51436d404d69f39d55c35c9 WatchSource:0}: Error finding container ecf1f490646bf1e488ea895d7c712c8f3f0826e9f51436d404d69f39d55c35c9: Status 404 returned error can't find the container with id ecf1f490646bf1e488ea895d7c712c8f3f0826e9f51436d404d69f39d55c35c9 Mar 16 16:01:26 crc kubenswrapper[5120]: I0316 16:01:26.677842 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 16:01:26 crc kubenswrapper[5120]: I0316 16:01:26.889546 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-rqcxz" Mar 16 16:01:27 crc kubenswrapper[5120]: I0316 16:01:27.040616 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/5af0f689-f31d-4721-9719-daf7d967fec1-db-sync-config-data\") pod \"5af0f689-f31d-4721-9719-daf7d967fec1\" (UID: \"5af0f689-f31d-4721-9719-daf7d967fec1\") " Mar 16 16:01:27 crc kubenswrapper[5120]: I0316 16:01:27.041291 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6j5lp\" (UniqueName: \"kubernetes.io/projected/5af0f689-f31d-4721-9719-daf7d967fec1-kube-api-access-6j5lp\") pod \"5af0f689-f31d-4721-9719-daf7d967fec1\" (UID: \"5af0f689-f31d-4721-9719-daf7d967fec1\") " Mar 16 16:01:27 crc kubenswrapper[5120]: I0316 16:01:27.041460 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5af0f689-f31d-4721-9719-daf7d967fec1-combined-ca-bundle\") pod \"5af0f689-f31d-4721-9719-daf7d967fec1\" (UID: \"5af0f689-f31d-4721-9719-daf7d967fec1\") " Mar 16 16:01:27 crc kubenswrapper[5120]: I0316 16:01:27.041689 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5af0f689-f31d-4721-9719-daf7d967fec1-config-data\") pod \"5af0f689-f31d-4721-9719-daf7d967fec1\" (UID: \"5af0f689-f31d-4721-9719-daf7d967fec1\") " Mar 16 16:01:27 crc kubenswrapper[5120]: I0316 16:01:27.047814 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5af0f689-f31d-4721-9719-daf7d967fec1-db-sync-config-data" (OuterVolumeSpecName: "db-sync-config-data") pod "5af0f689-f31d-4721-9719-daf7d967fec1" (UID: "5af0f689-f31d-4721-9719-daf7d967fec1"). InnerVolumeSpecName "db-sync-config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:01:27 crc kubenswrapper[5120]: I0316 16:01:27.048020 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5af0f689-f31d-4721-9719-daf7d967fec1-kube-api-access-6j5lp" (OuterVolumeSpecName: "kube-api-access-6j5lp") pod "5af0f689-f31d-4721-9719-daf7d967fec1" (UID: "5af0f689-f31d-4721-9719-daf7d967fec1"). InnerVolumeSpecName "kube-api-access-6j5lp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:01:27 crc kubenswrapper[5120]: I0316 16:01:27.072929 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5af0f689-f31d-4721-9719-daf7d967fec1-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "5af0f689-f31d-4721-9719-daf7d967fec1" (UID: "5af0f689-f31d-4721-9719-daf7d967fec1"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:01:27 crc kubenswrapper[5120]: I0316 16:01:27.098033 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-4cxhp"] Mar 16 16:01:27 crc kubenswrapper[5120]: I0316 16:01:27.108082 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5af0f689-f31d-4721-9719-daf7d967fec1-config-data" (OuterVolumeSpecName: "config-data") pod "5af0f689-f31d-4721-9719-daf7d967fec1" (UID: "5af0f689-f31d-4721-9719-daf7d967fec1"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:01:27 crc kubenswrapper[5120]: I0316 16:01:27.144080 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5af0f689-f31d-4721-9719-daf7d967fec1-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:01:27 crc kubenswrapper[5120]: I0316 16:01:27.144119 5120 reconciler_common.go:299] "Volume detached for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/5af0f689-f31d-4721-9719-daf7d967fec1-db-sync-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:01:27 crc kubenswrapper[5120]: I0316 16:01:27.144131 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6j5lp\" (UniqueName: \"kubernetes.io/projected/5af0f689-f31d-4721-9719-daf7d967fec1-kube-api-access-6j5lp\") on node \"crc\" DevicePath \"\"" Mar 16 16:01:27 crc kubenswrapper[5120]: I0316 16:01:27.144140 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5af0f689-f31d-4721-9719-daf7d967fec1-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:01:27 crc kubenswrapper[5120]: I0316 16:01:27.591563 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7e01ce77-a7e7-4f90-880f-fb2aa9b506a0","Type":"ContainerStarted","Data":"e4e13714df25c26e40c47bd0a068052ffb840c737d71ada600d65029e264bda3"} Mar 16 16:01:27 crc kubenswrapper[5120]: I0316 16:01:27.591891 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7e01ce77-a7e7-4f90-880f-fb2aa9b506a0","Type":"ContainerStarted","Data":"1624b7e64adc42a87208b2c700ca76213393c6c3c5d8baa5d38a875f647eae87"} Mar 16 16:01:27 crc kubenswrapper[5120]: I0316 16:01:27.592257 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7e01ce77-a7e7-4f90-880f-fb2aa9b506a0","Type":"ContainerStarted","Data":"24b51644c8c35d60eb1d19875575dbadbac7c2899aad1712fe22e9e2cc1c8a0d"} Mar 16 16:01:27 crc kubenswrapper[5120]: I0316 16:01:27.592269 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7e01ce77-a7e7-4f90-880f-fb2aa9b506a0","Type":"ContainerStarted","Data":"9e8ac2d972fd2f48d81b09afc5e8f49bb8db2874d893c57e7a8c058fd36b3ead"} Mar 16 16:01:27 crc kubenswrapper[5120]: I0316 16:01:27.592278 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7e01ce77-a7e7-4f90-880f-fb2aa9b506a0","Type":"ContainerStarted","Data":"ecf1f490646bf1e488ea895d7c712c8f3f0826e9f51436d404d69f39d55c35c9"} Mar 16 16:01:27 crc kubenswrapper[5120]: I0316 16:01:27.606301 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-rqcxz" event={"ID":"5af0f689-f31d-4721-9719-daf7d967fec1","Type":"ContainerDied","Data":"db2a9208bae3e07b8027906f8d669929899359b51b7069dd46fb0fe0d9705b93"} Mar 16 16:01:27 crc kubenswrapper[5120]: I0316 16:01:27.606355 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="db2a9208bae3e07b8027906f8d669929899359b51b7069dd46fb0fe0d9705b93" Mar 16 16:01:27 crc kubenswrapper[5120]: I0316 16:01:27.606721 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-rqcxz" Mar 16 16:01:27 crc kubenswrapper[5120]: I0316 16:01:27.613245 5120 generic.go:358] "Generic (PLEG): container finished" podID="8436861d-e102-45b0-8edf-25a8e41fa9e9" containerID="1268c5acd57c4e702314b2f2fd4d0dafc97e71135f5bbc840bd3532131c04a0a" exitCode=0 Mar 16 16:01:27 crc kubenswrapper[5120]: I0316 16:01:27.613562 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-4cxhp" event={"ID":"8436861d-e102-45b0-8edf-25a8e41fa9e9","Type":"ContainerDied","Data":"1268c5acd57c4e702314b2f2fd4d0dafc97e71135f5bbc840bd3532131c04a0a"} Mar 16 16:01:27 crc kubenswrapper[5120]: I0316 16:01:27.613723 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-4cxhp" event={"ID":"8436861d-e102-45b0-8edf-25a8e41fa9e9","Type":"ContainerStarted","Data":"3c6314742cb9aea0a6e916778c91d650ee6a3688f13bb887400b03764556c843"} Mar 16 16:01:28 crc kubenswrapper[5120]: I0316 16:01:28.627737 5120 generic.go:358] "Generic (PLEG): container finished" podID="733010bf-0110-4a60-adf6-0f0ee336e96e" containerID="83541718a4772aeb3e24fc14a61368e286ec061ec2e8d0b2cbc1e307adb6afe1" exitCode=0 Mar 16 16:01:28 crc kubenswrapper[5120]: I0316 16:01:28.627813 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"733010bf-0110-4a60-adf6-0f0ee336e96e","Type":"ContainerDied","Data":"83541718a4772aeb3e24fc14a61368e286ec061ec2e8d0b2cbc1e307adb6afe1"} Mar 16 16:01:28 crc kubenswrapper[5120]: I0316 16:01:28.633231 5120 generic.go:358] "Generic (PLEG): container finished" podID="5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40" containerID="7967968386c8a15eb0601cb98a0edef7d11982ab65155af5b27542488b8f6d10" exitCode=0 Mar 16 16:01:28 crc kubenswrapper[5120]: I0316 16:01:28.633277 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40","Type":"ContainerDied","Data":"7967968386c8a15eb0601cb98a0edef7d11982ab65155af5b27542488b8f6d10"} Mar 16 16:01:28 crc kubenswrapper[5120]: I0316 16:01:28.645103 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7e01ce77-a7e7-4f90-880f-fb2aa9b506a0","Type":"ContainerStarted","Data":"9dacb1521b7a04a287e3368f3170f4c5d5387fe4efa3027e858a14615bc08d5b"} Mar 16 16:01:28 crc kubenswrapper[5120]: I0316 16:01:28.645189 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7e01ce77-a7e7-4f90-880f-fb2aa9b506a0","Type":"ContainerStarted","Data":"79550cc49372bb24203f30a90ef9bfd6d2ee84c2fa9667ae735271bfa17f0ede"} Mar 16 16:01:28 crc kubenswrapper[5120]: I0316 16:01:28.645207 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7e01ce77-a7e7-4f90-880f-fb2aa9b506a0","Type":"ContainerStarted","Data":"2e380b12d073a5002c1e5dd47b9250956676752c0348be88c5d0494c0816ca54"} Mar 16 16:01:28 crc kubenswrapper[5120]: I0316 16:01:28.645238 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7e01ce77-a7e7-4f90-880f-fb2aa9b506a0","Type":"ContainerStarted","Data":"a4e710398cfe29215c86b86e007c51ed81b67c778fe43c2b13c2cda4950ccf05"} Mar 16 16:01:28 crc kubenswrapper[5120]: I0316 16:01:28.645247 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7e01ce77-a7e7-4f90-880f-fb2aa9b506a0","Type":"ContainerStarted","Data":"336f3db32f57852f76e9f4875a9e9c43786cc5813a47664b60949887a3812b50"} Mar 16 16:01:28 crc kubenswrapper[5120]: I0316 16:01:28.645256 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7e01ce77-a7e7-4f90-880f-fb2aa9b506a0","Type":"ContainerStarted","Data":"aa74658997f4ba65955badab309e4d15c34829a78f5c27ce74c840cd5aab7dc5"} Mar 16 16:01:29 crc kubenswrapper[5120]: I0316 16:01:29.195871 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-4cxhp" Mar 16 16:01:29 crc kubenswrapper[5120]: I0316 16:01:29.205158 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8436861d-e102-45b0-8edf-25a8e41fa9e9-operator-scripts\") pod \"8436861d-e102-45b0-8edf-25a8e41fa9e9\" (UID: \"8436861d-e102-45b0-8edf-25a8e41fa9e9\") " Mar 16 16:01:29 crc kubenswrapper[5120]: I0316 16:01:29.205229 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-82lg8\" (UniqueName: \"kubernetes.io/projected/8436861d-e102-45b0-8edf-25a8e41fa9e9-kube-api-access-82lg8\") pod \"8436861d-e102-45b0-8edf-25a8e41fa9e9\" (UID: \"8436861d-e102-45b0-8edf-25a8e41fa9e9\") " Mar 16 16:01:29 crc kubenswrapper[5120]: I0316 16:01:29.205668 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8436861d-e102-45b0-8edf-25a8e41fa9e9-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "8436861d-e102-45b0-8edf-25a8e41fa9e9" (UID: "8436861d-e102-45b0-8edf-25a8e41fa9e9"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:01:29 crc kubenswrapper[5120]: I0316 16:01:29.211974 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8436861d-e102-45b0-8edf-25a8e41fa9e9-kube-api-access-82lg8" (OuterVolumeSpecName: "kube-api-access-82lg8") pod "8436861d-e102-45b0-8edf-25a8e41fa9e9" (UID: "8436861d-e102-45b0-8edf-25a8e41fa9e9"). InnerVolumeSpecName "kube-api-access-82lg8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:01:29 crc kubenswrapper[5120]: I0316 16:01:29.309054 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8436861d-e102-45b0-8edf-25a8e41fa9e9-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:01:29 crc kubenswrapper[5120]: I0316 16:01:29.309365 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-82lg8\" (UniqueName: \"kubernetes.io/projected/8436861d-e102-45b0-8edf-25a8e41fa9e9-kube-api-access-82lg8\") on node \"crc\" DevicePath \"\"" Mar 16 16:01:29 crc kubenswrapper[5120]: I0316 16:01:29.653252 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-4cxhp" Mar 16 16:01:29 crc kubenswrapper[5120]: I0316 16:01:29.653256 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-4cxhp" event={"ID":"8436861d-e102-45b0-8edf-25a8e41fa9e9","Type":"ContainerDied","Data":"3c6314742cb9aea0a6e916778c91d650ee6a3688f13bb887400b03764556c843"} Mar 16 16:01:29 crc kubenswrapper[5120]: I0316 16:01:29.654248 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3c6314742cb9aea0a6e916778c91d650ee6a3688f13bb887400b03764556c843" Mar 16 16:01:29 crc kubenswrapper[5120]: I0316 16:01:29.655105 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"733010bf-0110-4a60-adf6-0f0ee336e96e","Type":"ContainerStarted","Data":"4e28e8c37cae1b7cf7aa14c8b6c7ec61364c748a7c4de5653e9534e4883c47e2"} Mar 16 16:01:29 crc kubenswrapper[5120]: I0316 16:01:29.655414 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:01:29 crc kubenswrapper[5120]: I0316 16:01:29.657492 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40","Type":"ContainerStarted","Data":"dd668b15f37de671532dd2837bc715c6d43a3e9f0b987f0af2c9cd57a996952f"} Mar 16 16:01:29 crc kubenswrapper[5120]: I0316 16:01:29.657683 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:01:29 crc kubenswrapper[5120]: I0316 16:01:29.672116 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7e01ce77-a7e7-4f90-880f-fb2aa9b506a0","Type":"ContainerStarted","Data":"de9532efdc63b1e3b8ca32f670ae9e1deb9f362ce371660def5737aa8339a1dd"} Mar 16 16:01:29 crc kubenswrapper[5120]: I0316 16:01:29.672159 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7e01ce77-a7e7-4f90-880f-fb2aa9b506a0","Type":"ContainerStarted","Data":"07d1780c3ac674887e98e6e457d571c406a7ee983f0a91f7bfd134c125da3d03"} Mar 16 16:01:29 crc kubenswrapper[5120]: I0316 16:01:29.672169 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7e01ce77-a7e7-4f90-880f-fb2aa9b506a0","Type":"ContainerStarted","Data":"6819b2fc19957c0cc9ecf211d06ee6cd10c1ec89e57fa8e1c6f8f34a4272144a"} Mar 16 16:01:29 crc kubenswrapper[5120]: I0316 16:01:29.672177 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7e01ce77-a7e7-4f90-880f-fb2aa9b506a0","Type":"ContainerStarted","Data":"176e1b8679f186bfa7c613dd56d177361af47feab586da3825ca07c140f9e8aa"} Mar 16 16:01:29 crc kubenswrapper[5120]: I0316 16:01:29.672186 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7e01ce77-a7e7-4f90-880f-fb2aa9b506a0","Type":"ContainerStarted","Data":"10fa8c7b4b871978347408abb409b476cfd8fd7a2f441f3a90024ad00442c1b6"} Mar 16 16:01:29 crc kubenswrapper[5120]: I0316 16:01:29.682954 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/rabbitmq-server-0" podStartSLOduration=36.682937122 podStartE2EDuration="36.682937122s" podCreationTimestamp="2026-03-16 16:00:53 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:01:29.678456328 +0000 UTC m=+1791.832388025" watchObservedRunningTime="2026-03-16 16:01:29.682937122 +0000 UTC m=+1791.836868779" Mar 16 16:01:29 crc kubenswrapper[5120]: I0316 16:01:29.718136 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/swift-storage-0" podStartSLOduration=20.71811435 podStartE2EDuration="20.71811435s" podCreationTimestamp="2026-03-16 16:01:09 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:01:29.714583622 +0000 UTC m=+1791.868515279" watchObservedRunningTime="2026-03-16 16:01:29.71811435 +0000 UTC m=+1791.872046007" Mar 16 16:01:29 crc kubenswrapper[5120]: I0316 16:01:29.743375 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" podStartSLOduration=36.743360434 podStartE2EDuration="36.743360434s" podCreationTimestamp="2026-03-16 16:00:53 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:01:29.741322448 +0000 UTC m=+1791.895254105" watchObservedRunningTime="2026-03-16 16:01:29.743360434 +0000 UTC m=+1791.897292091" Mar 16 16:01:29 crc kubenswrapper[5120]: I0316 16:01:29.877552 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-5f5844fc89-v9sgh"] Mar 16 16:01:29 crc kubenswrapper[5120]: I0316 16:01:29.878680 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8436861d-e102-45b0-8edf-25a8e41fa9e9" containerName="mariadb-account-create-update" Mar 16 16:01:29 crc kubenswrapper[5120]: I0316 16:01:29.878707 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8436861d-e102-45b0-8edf-25a8e41fa9e9" containerName="mariadb-account-create-update" Mar 16 16:01:29 crc kubenswrapper[5120]: I0316 16:01:29.878806 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5af0f689-f31d-4721-9719-daf7d967fec1" containerName="glance-db-sync" Mar 16 16:01:29 crc kubenswrapper[5120]: I0316 16:01:29.878816 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="5af0f689-f31d-4721-9719-daf7d967fec1" containerName="glance-db-sync" Mar 16 16:01:29 crc kubenswrapper[5120]: I0316 16:01:29.878983 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="8436861d-e102-45b0-8edf-25a8e41fa9e9" containerName="mariadb-account-create-update" Mar 16 16:01:29 crc kubenswrapper[5120]: I0316 16:01:29.879014 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="5af0f689-f31d-4721-9719-daf7d967fec1" containerName="glance-db-sync" Mar 16 16:01:29 crc kubenswrapper[5120]: I0316 16:01:29.883689 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5f5844fc89-v9sgh" Mar 16 16:01:29 crc kubenswrapper[5120]: I0316 16:01:29.894686 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"dns-swift-storage-0\"" Mar 16 16:01:29 crc kubenswrapper[5120]: I0316 16:01:29.906091 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-5f5844fc89-v9sgh"] Mar 16 16:01:30 crc kubenswrapper[5120]: I0316 16:01:30.020414 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rb6n5\" (UniqueName: \"kubernetes.io/projected/a9aa09be-c2fd-46ef-b767-521dc67de64b-kube-api-access-rb6n5\") pod \"dnsmasq-dnsmasq-5f5844fc89-v9sgh\" (UID: \"a9aa09be-c2fd-46ef-b767-521dc67de64b\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5f5844fc89-v9sgh" Mar 16 16:01:30 crc kubenswrapper[5120]: I0316 16:01:30.020572 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a9aa09be-c2fd-46ef-b767-521dc67de64b-config\") pod \"dnsmasq-dnsmasq-5f5844fc89-v9sgh\" (UID: \"a9aa09be-c2fd-46ef-b767-521dc67de64b\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5f5844fc89-v9sgh" Mar 16 16:01:30 crc kubenswrapper[5120]: I0316 16:01:30.020600 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/a9aa09be-c2fd-46ef-b767-521dc67de64b-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-5f5844fc89-v9sgh\" (UID: \"a9aa09be-c2fd-46ef-b767-521dc67de64b\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5f5844fc89-v9sgh" Mar 16 16:01:30 crc kubenswrapper[5120]: I0316 16:01:30.020626 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/a9aa09be-c2fd-46ef-b767-521dc67de64b-dns-swift-storage-0\") pod \"dnsmasq-dnsmasq-5f5844fc89-v9sgh\" (UID: \"a9aa09be-c2fd-46ef-b767-521dc67de64b\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5f5844fc89-v9sgh" Mar 16 16:01:30 crc kubenswrapper[5120]: I0316 16:01:30.122176 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/a9aa09be-c2fd-46ef-b767-521dc67de64b-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-5f5844fc89-v9sgh\" (UID: \"a9aa09be-c2fd-46ef-b767-521dc67de64b\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5f5844fc89-v9sgh" Mar 16 16:01:30 crc kubenswrapper[5120]: I0316 16:01:30.122563 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/a9aa09be-c2fd-46ef-b767-521dc67de64b-dns-swift-storage-0\") pod \"dnsmasq-dnsmasq-5f5844fc89-v9sgh\" (UID: \"a9aa09be-c2fd-46ef-b767-521dc67de64b\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5f5844fc89-v9sgh" Mar 16 16:01:30 crc kubenswrapper[5120]: I0316 16:01:30.122639 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rb6n5\" (UniqueName: \"kubernetes.io/projected/a9aa09be-c2fd-46ef-b767-521dc67de64b-kube-api-access-rb6n5\") pod \"dnsmasq-dnsmasq-5f5844fc89-v9sgh\" (UID: \"a9aa09be-c2fd-46ef-b767-521dc67de64b\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5f5844fc89-v9sgh" Mar 16 16:01:30 crc kubenswrapper[5120]: I0316 16:01:30.122785 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a9aa09be-c2fd-46ef-b767-521dc67de64b-config\") pod \"dnsmasq-dnsmasq-5f5844fc89-v9sgh\" (UID: \"a9aa09be-c2fd-46ef-b767-521dc67de64b\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5f5844fc89-v9sgh" Mar 16 16:01:30 crc kubenswrapper[5120]: I0316 16:01:30.123196 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/a9aa09be-c2fd-46ef-b767-521dc67de64b-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-5f5844fc89-v9sgh\" (UID: \"a9aa09be-c2fd-46ef-b767-521dc67de64b\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5f5844fc89-v9sgh" Mar 16 16:01:30 crc kubenswrapper[5120]: I0316 16:01:30.123492 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/a9aa09be-c2fd-46ef-b767-521dc67de64b-dns-swift-storage-0\") pod \"dnsmasq-dnsmasq-5f5844fc89-v9sgh\" (UID: \"a9aa09be-c2fd-46ef-b767-521dc67de64b\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5f5844fc89-v9sgh" Mar 16 16:01:30 crc kubenswrapper[5120]: I0316 16:01:30.123573 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a9aa09be-c2fd-46ef-b767-521dc67de64b-config\") pod \"dnsmasq-dnsmasq-5f5844fc89-v9sgh\" (UID: \"a9aa09be-c2fd-46ef-b767-521dc67de64b\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5f5844fc89-v9sgh" Mar 16 16:01:30 crc kubenswrapper[5120]: I0316 16:01:30.151940 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rb6n5\" (UniqueName: \"kubernetes.io/projected/a9aa09be-c2fd-46ef-b767-521dc67de64b-kube-api-access-rb6n5\") pod \"dnsmasq-dnsmasq-5f5844fc89-v9sgh\" (UID: \"a9aa09be-c2fd-46ef-b767-521dc67de64b\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5f5844fc89-v9sgh" Mar 16 16:01:30 crc kubenswrapper[5120]: I0316 16:01:30.200888 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5f5844fc89-v9sgh" Mar 16 16:01:30 crc kubenswrapper[5120]: I0316 16:01:30.781337 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-5f5844fc89-v9sgh"] Mar 16 16:01:31 crc kubenswrapper[5120]: I0316 16:01:31.695811 5120 generic.go:358] "Generic (PLEG): container finished" podID="a9aa09be-c2fd-46ef-b767-521dc67de64b" containerID="4365433c66f99da3204da5b9bc7a9e76896fc64830798847f5ac3979dc4e8cd7" exitCode=0 Mar 16 16:01:31 crc kubenswrapper[5120]: I0316 16:01:31.696352 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5f5844fc89-v9sgh" event={"ID":"a9aa09be-c2fd-46ef-b767-521dc67de64b","Type":"ContainerDied","Data":"4365433c66f99da3204da5b9bc7a9e76896fc64830798847f5ac3979dc4e8cd7"} Mar 16 16:01:31 crc kubenswrapper[5120]: I0316 16:01:31.696382 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5f5844fc89-v9sgh" event={"ID":"a9aa09be-c2fd-46ef-b767-521dc67de64b","Type":"ContainerStarted","Data":"494b10eb6f5c8608ed4b9d3d054de8365e28486ca1d9607035e7b4639fc41cbe"} Mar 16 16:01:32 crc kubenswrapper[5120]: I0316 16:01:32.710155 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5f5844fc89-v9sgh" event={"ID":"a9aa09be-c2fd-46ef-b767-521dc67de64b","Type":"ContainerStarted","Data":"c52b4d8d8f4b969076ab180f4ca8f11331e9331f7f7990112310d116dae9e4d1"} Mar 16 16:01:32 crc kubenswrapper[5120]: I0316 16:01:32.711659 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5f5844fc89-v9sgh" Mar 16 16:01:32 crc kubenswrapper[5120]: I0316 16:01:32.739530 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5f5844fc89-v9sgh" podStartSLOduration=3.739511596 podStartE2EDuration="3.739511596s" podCreationTimestamp="2026-03-16 16:01:29 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:01:32.732077271 +0000 UTC m=+1794.886008938" watchObservedRunningTime="2026-03-16 16:01:32.739511596 +0000 UTC m=+1794.893443263" Mar 16 16:01:38 crc kubenswrapper[5120]: I0316 16:01:38.676178 5120 scope.go:117] "RemoveContainer" containerID="02ba4fc3f84eccaecfa9e6618280f65626eb76580c4af9ae7a9d7cb3b8dd590b" Mar 16 16:01:38 crc kubenswrapper[5120]: E0316 16:01:38.682106 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:01:39 crc kubenswrapper[5120]: I0316 16:01:39.733225 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5f5844fc89-v9sgh" Mar 16 16:01:39 crc kubenswrapper[5120]: I0316 16:01:39.826406 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-mm5p4"] Mar 16 16:01:39 crc kubenswrapper[5120]: I0316 16:01:39.826996 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-mm5p4" podUID="ca816558-dccc-44fa-aaa6-5a2070f1b25f" containerName="dnsmasq-dns" containerID="cri-o://8c0784711565539c2b4e46537591612819965f687d254654b551082f9e6f53bb" gracePeriod=10 Mar 16 16:01:40 crc kubenswrapper[5120]: I0316 16:01:40.257105 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-mm5p4" Mar 16 16:01:40 crc kubenswrapper[5120]: I0316 16:01:40.326629 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vj6z9\" (UniqueName: \"kubernetes.io/projected/ca816558-dccc-44fa-aaa6-5a2070f1b25f-kube-api-access-vj6z9\") pod \"ca816558-dccc-44fa-aaa6-5a2070f1b25f\" (UID: \"ca816558-dccc-44fa-aaa6-5a2070f1b25f\") " Mar 16 16:01:40 crc kubenswrapper[5120]: I0316 16:01:40.326925 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/ca816558-dccc-44fa-aaa6-5a2070f1b25f-dnsmasq-svc\") pod \"ca816558-dccc-44fa-aaa6-5a2070f1b25f\" (UID: \"ca816558-dccc-44fa-aaa6-5a2070f1b25f\") " Mar 16 16:01:40 crc kubenswrapper[5120]: I0316 16:01:40.327396 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ca816558-dccc-44fa-aaa6-5a2070f1b25f-config\") pod \"ca816558-dccc-44fa-aaa6-5a2070f1b25f\" (UID: \"ca816558-dccc-44fa-aaa6-5a2070f1b25f\") " Mar 16 16:01:40 crc kubenswrapper[5120]: I0316 16:01:40.345056 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca816558-dccc-44fa-aaa6-5a2070f1b25f-kube-api-access-vj6z9" (OuterVolumeSpecName: "kube-api-access-vj6z9") pod "ca816558-dccc-44fa-aaa6-5a2070f1b25f" (UID: "ca816558-dccc-44fa-aaa6-5a2070f1b25f"). InnerVolumeSpecName "kube-api-access-vj6z9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:01:40 crc kubenswrapper[5120]: I0316 16:01:40.381993 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca816558-dccc-44fa-aaa6-5a2070f1b25f-config" (OuterVolumeSpecName: "config") pod "ca816558-dccc-44fa-aaa6-5a2070f1b25f" (UID: "ca816558-dccc-44fa-aaa6-5a2070f1b25f"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:01:40 crc kubenswrapper[5120]: I0316 16:01:40.385268 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca816558-dccc-44fa-aaa6-5a2070f1b25f-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "ca816558-dccc-44fa-aaa6-5a2070f1b25f" (UID: "ca816558-dccc-44fa-aaa6-5a2070f1b25f"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:01:40 crc kubenswrapper[5120]: I0316 16:01:40.429891 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vj6z9\" (UniqueName: \"kubernetes.io/projected/ca816558-dccc-44fa-aaa6-5a2070f1b25f-kube-api-access-vj6z9\") on node \"crc\" DevicePath \"\"" Mar 16 16:01:40 crc kubenswrapper[5120]: I0316 16:01:40.429919 5120 reconciler_common.go:299] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/ca816558-dccc-44fa-aaa6-5a2070f1b25f-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Mar 16 16:01:40 crc kubenswrapper[5120]: I0316 16:01:40.429929 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ca816558-dccc-44fa-aaa6-5a2070f1b25f-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:01:40 crc kubenswrapper[5120]: I0316 16:01:40.690474 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:01:40 crc kubenswrapper[5120]: I0316 16:01:40.690837 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:01:40 crc kubenswrapper[5120]: I0316 16:01:40.815123 5120 generic.go:358] "Generic (PLEG): container finished" podID="ca816558-dccc-44fa-aaa6-5a2070f1b25f" containerID="8c0784711565539c2b4e46537591612819965f687d254654b551082f9e6f53bb" exitCode=0 Mar 16 16:01:40 crc kubenswrapper[5120]: I0316 16:01:40.815477 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-mm5p4" Mar 16 16:01:40 crc kubenswrapper[5120]: I0316 16:01:40.815556 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-mm5p4" event={"ID":"ca816558-dccc-44fa-aaa6-5a2070f1b25f","Type":"ContainerDied","Data":"8c0784711565539c2b4e46537591612819965f687d254654b551082f9e6f53bb"} Mar 16 16:01:40 crc kubenswrapper[5120]: I0316 16:01:40.815593 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-mm5p4" event={"ID":"ca816558-dccc-44fa-aaa6-5a2070f1b25f","Type":"ContainerDied","Data":"b75ee74f26d951dd4463aa274862a0263a364a3cabe1f3f395216fcd553bad08"} Mar 16 16:01:40 crc kubenswrapper[5120]: I0316 16:01:40.815616 5120 scope.go:117] "RemoveContainer" containerID="8c0784711565539c2b4e46537591612819965f687d254654b551082f9e6f53bb" Mar 16 16:01:40 crc kubenswrapper[5120]: I0316 16:01:40.853823 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-mm5p4"] Mar 16 16:01:40 crc kubenswrapper[5120]: I0316 16:01:40.866465 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-mm5p4"] Mar 16 16:01:40 crc kubenswrapper[5120]: I0316 16:01:40.870862 5120 scope.go:117] "RemoveContainer" containerID="b23e5249a31a3ba32a12e44b4cd5caabdbb3812e1a2bf4be34ad41cc2e244972" Mar 16 16:01:40 crc kubenswrapper[5120]: I0316 16:01:40.922217 5120 scope.go:117] "RemoveContainer" containerID="8c0784711565539c2b4e46537591612819965f687d254654b551082f9e6f53bb" Mar 16 16:01:40 crc kubenswrapper[5120]: E0316 16:01:40.926417 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c0784711565539c2b4e46537591612819965f687d254654b551082f9e6f53bb\": container with ID starting with 8c0784711565539c2b4e46537591612819965f687d254654b551082f9e6f53bb not found: ID does not exist" containerID="8c0784711565539c2b4e46537591612819965f687d254654b551082f9e6f53bb" Mar 16 16:01:40 crc kubenswrapper[5120]: I0316 16:01:40.926455 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c0784711565539c2b4e46537591612819965f687d254654b551082f9e6f53bb"} err="failed to get container status \"8c0784711565539c2b4e46537591612819965f687d254654b551082f9e6f53bb\": rpc error: code = NotFound desc = could not find container \"8c0784711565539c2b4e46537591612819965f687d254654b551082f9e6f53bb\": container with ID starting with 8c0784711565539c2b4e46537591612819965f687d254654b551082f9e6f53bb not found: ID does not exist" Mar 16 16:01:40 crc kubenswrapper[5120]: I0316 16:01:40.926477 5120 scope.go:117] "RemoveContainer" containerID="b23e5249a31a3ba32a12e44b4cd5caabdbb3812e1a2bf4be34ad41cc2e244972" Mar 16 16:01:40 crc kubenswrapper[5120]: E0316 16:01:40.928070 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b23e5249a31a3ba32a12e44b4cd5caabdbb3812e1a2bf4be34ad41cc2e244972\": container with ID starting with b23e5249a31a3ba32a12e44b4cd5caabdbb3812e1a2bf4be34ad41cc2e244972 not found: ID does not exist" containerID="b23e5249a31a3ba32a12e44b4cd5caabdbb3812e1a2bf4be34ad41cc2e244972" Mar 16 16:01:40 crc kubenswrapper[5120]: I0316 16:01:40.928138 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b23e5249a31a3ba32a12e44b4cd5caabdbb3812e1a2bf4be34ad41cc2e244972"} err="failed to get container status \"b23e5249a31a3ba32a12e44b4cd5caabdbb3812e1a2bf4be34ad41cc2e244972\": rpc error: code = NotFound desc = could not find container \"b23e5249a31a3ba32a12e44b4cd5caabdbb3812e1a2bf4be34ad41cc2e244972\": container with ID starting with b23e5249a31a3ba32a12e44b4cd5caabdbb3812e1a2bf4be34ad41cc2e244972 not found: ID does not exist" Mar 16 16:01:40 crc kubenswrapper[5120]: I0316 16:01:40.984832 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-db-create-lc5wc"] Mar 16 16:01:40 crc kubenswrapper[5120]: I0316 16:01:40.985845 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca816558-dccc-44fa-aaa6-5a2070f1b25f" containerName="dnsmasq-dns" Mar 16 16:01:40 crc kubenswrapper[5120]: I0316 16:01:40.985866 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca816558-dccc-44fa-aaa6-5a2070f1b25f" containerName="dnsmasq-dns" Mar 16 16:01:40 crc kubenswrapper[5120]: I0316 16:01:40.985906 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca816558-dccc-44fa-aaa6-5a2070f1b25f" containerName="init" Mar 16 16:01:40 crc kubenswrapper[5120]: I0316 16:01:40.985912 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca816558-dccc-44fa-aaa6-5a2070f1b25f" containerName="init" Mar 16 16:01:40 crc kubenswrapper[5120]: I0316 16:01:40.986073 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ca816558-dccc-44fa-aaa6-5a2070f1b25f" containerName="dnsmasq-dns" Mar 16 16:01:40 crc kubenswrapper[5120]: I0316 16:01:40.994472 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-create-lc5wc" Mar 16 16:01:41 crc kubenswrapper[5120]: I0316 16:01:41.002274 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-db-create-lc5wc"] Mar 16 16:01:41 crc kubenswrapper[5120]: I0316 16:01:41.127146 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-319f-account-create-update-gr29k"] Mar 16 16:01:41 crc kubenswrapper[5120]: I0316 16:01:41.143001 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-319f-account-create-update-gr29k"] Mar 16 16:01:41 crc kubenswrapper[5120]: I0316 16:01:41.143126 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-319f-account-create-update-gr29k" Mar 16 16:01:41 crc kubenswrapper[5120]: I0316 16:01:41.144693 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6v965\" (UniqueName: \"kubernetes.io/projected/34542a97-1318-45c8-a22f-6d4fd9c96846-kube-api-access-6v965\") pod \"cinder-db-create-lc5wc\" (UID: \"34542a97-1318-45c8-a22f-6d4fd9c96846\") " pod="openstack-kuttl-tests/cinder-db-create-lc5wc" Mar 16 16:01:41 crc kubenswrapper[5120]: I0316 16:01:41.145203 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/34542a97-1318-45c8-a22f-6d4fd9c96846-operator-scripts\") pod \"cinder-db-create-lc5wc\" (UID: \"34542a97-1318-45c8-a22f-6d4fd9c96846\") " pod="openstack-kuttl-tests/cinder-db-create-lc5wc" Mar 16 16:01:41 crc kubenswrapper[5120]: I0316 16:01:41.159876 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-db-secret\"" Mar 16 16:01:41 crc kubenswrapper[5120]: I0316 16:01:41.183174 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-db-create-h9d5m"] Mar 16 16:01:41 crc kubenswrapper[5120]: I0316 16:01:41.188324 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-create-h9d5m" Mar 16 16:01:41 crc kubenswrapper[5120]: I0316 16:01:41.222635 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-dc96-account-create-update-rpv8l"] Mar 16 16:01:41 crc kubenswrapper[5120]: I0316 16:01:41.230576 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-dc96-account-create-update-rpv8l" Mar 16 16:01:41 crc kubenswrapper[5120]: I0316 16:01:41.233561 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-db-secret\"" Mar 16 16:01:41 crc kubenswrapper[5120]: I0316 16:01:41.233890 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-db-create-h9d5m"] Mar 16 16:01:41 crc kubenswrapper[5120]: I0316 16:01:41.243647 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-dc96-account-create-update-rpv8l"] Mar 16 16:01:41 crc kubenswrapper[5120]: I0316 16:01:41.248928 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/34542a97-1318-45c8-a22f-6d4fd9c96846-operator-scripts\") pod \"cinder-db-create-lc5wc\" (UID: \"34542a97-1318-45c8-a22f-6d4fd9c96846\") " pod="openstack-kuttl-tests/cinder-db-create-lc5wc" Mar 16 16:01:41 crc kubenswrapper[5120]: I0316 16:01:41.248968 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6v965\" (UniqueName: \"kubernetes.io/projected/34542a97-1318-45c8-a22f-6d4fd9c96846-kube-api-access-6v965\") pod \"cinder-db-create-lc5wc\" (UID: \"34542a97-1318-45c8-a22f-6d4fd9c96846\") " pod="openstack-kuttl-tests/cinder-db-create-lc5wc" Mar 16 16:01:41 crc kubenswrapper[5120]: I0316 16:01:41.249075 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wz659\" (UniqueName: \"kubernetes.io/projected/b687141f-0dee-4a5b-a072-823f2d33133d-kube-api-access-wz659\") pod \"cinder-319f-account-create-update-gr29k\" (UID: \"b687141f-0dee-4a5b-a072-823f2d33133d\") " pod="openstack-kuttl-tests/cinder-319f-account-create-update-gr29k" Mar 16 16:01:41 crc kubenswrapper[5120]: I0316 16:01:41.249100 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b687141f-0dee-4a5b-a072-823f2d33133d-operator-scripts\") pod \"cinder-319f-account-create-update-gr29k\" (UID: \"b687141f-0dee-4a5b-a072-823f2d33133d\") " pod="openstack-kuttl-tests/cinder-319f-account-create-update-gr29k" Mar 16 16:01:41 crc kubenswrapper[5120]: I0316 16:01:41.249121 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/979d8836-4381-4d52-97bc-b2b3d339e046-operator-scripts\") pod \"neutron-db-create-h9d5m\" (UID: \"979d8836-4381-4d52-97bc-b2b3d339e046\") " pod="openstack-kuttl-tests/neutron-db-create-h9d5m" Mar 16 16:01:41 crc kubenswrapper[5120]: I0316 16:01:41.249157 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ds24\" (UniqueName: \"kubernetes.io/projected/979d8836-4381-4d52-97bc-b2b3d339e046-kube-api-access-6ds24\") pod \"neutron-db-create-h9d5m\" (UID: \"979d8836-4381-4d52-97bc-b2b3d339e046\") " pod="openstack-kuttl-tests/neutron-db-create-h9d5m" Mar 16 16:01:41 crc kubenswrapper[5120]: I0316 16:01:41.249676 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/34542a97-1318-45c8-a22f-6d4fd9c96846-operator-scripts\") pod \"cinder-db-create-lc5wc\" (UID: \"34542a97-1318-45c8-a22f-6d4fd9c96846\") " pod="openstack-kuttl-tests/cinder-db-create-lc5wc" Mar 16 16:01:41 crc kubenswrapper[5120]: I0316 16:01:41.277918 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6v965\" (UniqueName: \"kubernetes.io/projected/34542a97-1318-45c8-a22f-6d4fd9c96846-kube-api-access-6v965\") pod \"cinder-db-create-lc5wc\" (UID: \"34542a97-1318-45c8-a22f-6d4fd9c96846\") " pod="openstack-kuttl-tests/cinder-db-create-lc5wc" Mar 16 16:01:41 crc kubenswrapper[5120]: I0316 16:01:41.288775 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-nk29h"] Mar 16 16:01:41 crc kubenswrapper[5120]: I0316 16:01:41.301576 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-nk29h"] Mar 16 16:01:41 crc kubenswrapper[5120]: I0316 16:01:41.302059 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-nk29h" Mar 16 16:01:41 crc kubenswrapper[5120]: I0316 16:01:41.306728 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-scripts\"" Mar 16 16:01:41 crc kubenswrapper[5120]: I0316 16:01:41.307828 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone\"" Mar 16 16:01:41 crc kubenswrapper[5120]: I0316 16:01:41.307850 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-keystone-dockercfg-dsstd\"" Mar 16 16:01:41 crc kubenswrapper[5120]: I0316 16:01:41.308586 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-config-data\"" Mar 16 16:01:41 crc kubenswrapper[5120]: I0316 16:01:41.334057 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-create-lc5wc" Mar 16 16:01:41 crc kubenswrapper[5120]: I0316 16:01:41.350848 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wz659\" (UniqueName: \"kubernetes.io/projected/b687141f-0dee-4a5b-a072-823f2d33133d-kube-api-access-wz659\") pod \"cinder-319f-account-create-update-gr29k\" (UID: \"b687141f-0dee-4a5b-a072-823f2d33133d\") " pod="openstack-kuttl-tests/cinder-319f-account-create-update-gr29k" Mar 16 16:01:41 crc kubenswrapper[5120]: I0316 16:01:41.351111 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b687141f-0dee-4a5b-a072-823f2d33133d-operator-scripts\") pod \"cinder-319f-account-create-update-gr29k\" (UID: \"b687141f-0dee-4a5b-a072-823f2d33133d\") " pod="openstack-kuttl-tests/cinder-319f-account-create-update-gr29k" Mar 16 16:01:41 crc kubenswrapper[5120]: I0316 16:01:41.351144 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/979d8836-4381-4d52-97bc-b2b3d339e046-operator-scripts\") pod \"neutron-db-create-h9d5m\" (UID: \"979d8836-4381-4d52-97bc-b2b3d339e046\") " pod="openstack-kuttl-tests/neutron-db-create-h9d5m" Mar 16 16:01:41 crc kubenswrapper[5120]: I0316 16:01:41.351182 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6ds24\" (UniqueName: \"kubernetes.io/projected/979d8836-4381-4d52-97bc-b2b3d339e046-kube-api-access-6ds24\") pod \"neutron-db-create-h9d5m\" (UID: \"979d8836-4381-4d52-97bc-b2b3d339e046\") " pod="openstack-kuttl-tests/neutron-db-create-h9d5m" Mar 16 16:01:41 crc kubenswrapper[5120]: I0316 16:01:41.351213 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hlwn7\" (UniqueName: \"kubernetes.io/projected/9112a3f8-e8fb-4df3-8f9e-c29bd437f5ea-kube-api-access-hlwn7\") pod \"neutron-dc96-account-create-update-rpv8l\" (UID: \"9112a3f8-e8fb-4df3-8f9e-c29bd437f5ea\") " pod="openstack-kuttl-tests/neutron-dc96-account-create-update-rpv8l" Mar 16 16:01:41 crc kubenswrapper[5120]: I0316 16:01:41.351280 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9112a3f8-e8fb-4df3-8f9e-c29bd437f5ea-operator-scripts\") pod \"neutron-dc96-account-create-update-rpv8l\" (UID: \"9112a3f8-e8fb-4df3-8f9e-c29bd437f5ea\") " pod="openstack-kuttl-tests/neutron-dc96-account-create-update-rpv8l" Mar 16 16:01:41 crc kubenswrapper[5120]: I0316 16:01:41.351987 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/979d8836-4381-4d52-97bc-b2b3d339e046-operator-scripts\") pod \"neutron-db-create-h9d5m\" (UID: \"979d8836-4381-4d52-97bc-b2b3d339e046\") " pod="openstack-kuttl-tests/neutron-db-create-h9d5m" Mar 16 16:01:41 crc kubenswrapper[5120]: I0316 16:01:41.352212 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b687141f-0dee-4a5b-a072-823f2d33133d-operator-scripts\") pod \"cinder-319f-account-create-update-gr29k\" (UID: \"b687141f-0dee-4a5b-a072-823f2d33133d\") " pod="openstack-kuttl-tests/cinder-319f-account-create-update-gr29k" Mar 16 16:01:41 crc kubenswrapper[5120]: I0316 16:01:41.388693 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ds24\" (UniqueName: \"kubernetes.io/projected/979d8836-4381-4d52-97bc-b2b3d339e046-kube-api-access-6ds24\") pod \"neutron-db-create-h9d5m\" (UID: \"979d8836-4381-4d52-97bc-b2b3d339e046\") " pod="openstack-kuttl-tests/neutron-db-create-h9d5m" Mar 16 16:01:41 crc kubenswrapper[5120]: I0316 16:01:41.395390 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wz659\" (UniqueName: \"kubernetes.io/projected/b687141f-0dee-4a5b-a072-823f2d33133d-kube-api-access-wz659\") pod \"cinder-319f-account-create-update-gr29k\" (UID: \"b687141f-0dee-4a5b-a072-823f2d33133d\") " pod="openstack-kuttl-tests/cinder-319f-account-create-update-gr29k" Mar 16 16:01:41 crc kubenswrapper[5120]: I0316 16:01:41.396435 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-db-create-g5nwv"] Mar 16 16:01:41 crc kubenswrapper[5120]: I0316 16:01:41.405829 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-create-g5nwv" Mar 16 16:01:41 crc kubenswrapper[5120]: I0316 16:01:41.406431 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-55ec-account-create-update-6h2pc"] Mar 16 16:01:41 crc kubenswrapper[5120]: I0316 16:01:41.413097 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-db-create-g5nwv"] Mar 16 16:01:41 crc kubenswrapper[5120]: I0316 16:01:41.413436 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-55ec-account-create-update-6h2pc" Mar 16 16:01:41 crc kubenswrapper[5120]: I0316 16:01:41.419523 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-db-secret\"" Mar 16 16:01:41 crc kubenswrapper[5120]: I0316 16:01:41.431856 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-55ec-account-create-update-6h2pc"] Mar 16 16:01:41 crc kubenswrapper[5120]: I0316 16:01:41.453126 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfqgj\" (UniqueName: \"kubernetes.io/projected/db652175-15cd-4336-85a7-53cbb0cf505f-kube-api-access-gfqgj\") pod \"keystone-db-sync-nk29h\" (UID: \"db652175-15cd-4336-85a7-53cbb0cf505f\") " pod="openstack-kuttl-tests/keystone-db-sync-nk29h" Mar 16 16:01:41 crc kubenswrapper[5120]: I0316 16:01:41.453257 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hlwn7\" (UniqueName: \"kubernetes.io/projected/9112a3f8-e8fb-4df3-8f9e-c29bd437f5ea-kube-api-access-hlwn7\") pod \"neutron-dc96-account-create-update-rpv8l\" (UID: \"9112a3f8-e8fb-4df3-8f9e-c29bd437f5ea\") " pod="openstack-kuttl-tests/neutron-dc96-account-create-update-rpv8l" Mar 16 16:01:41 crc kubenswrapper[5120]: I0316 16:01:41.453316 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/db652175-15cd-4336-85a7-53cbb0cf505f-config-data\") pod \"keystone-db-sync-nk29h\" (UID: \"db652175-15cd-4336-85a7-53cbb0cf505f\") " pod="openstack-kuttl-tests/keystone-db-sync-nk29h" Mar 16 16:01:41 crc kubenswrapper[5120]: I0316 16:01:41.453341 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9112a3f8-e8fb-4df3-8f9e-c29bd437f5ea-operator-scripts\") pod \"neutron-dc96-account-create-update-rpv8l\" (UID: \"9112a3f8-e8fb-4df3-8f9e-c29bd437f5ea\") " pod="openstack-kuttl-tests/neutron-dc96-account-create-update-rpv8l" Mar 16 16:01:41 crc kubenswrapper[5120]: I0316 16:01:41.453357 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/db652175-15cd-4336-85a7-53cbb0cf505f-combined-ca-bundle\") pod \"keystone-db-sync-nk29h\" (UID: \"db652175-15cd-4336-85a7-53cbb0cf505f\") " pod="openstack-kuttl-tests/keystone-db-sync-nk29h" Mar 16 16:01:41 crc kubenswrapper[5120]: I0316 16:01:41.454358 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9112a3f8-e8fb-4df3-8f9e-c29bd437f5ea-operator-scripts\") pod \"neutron-dc96-account-create-update-rpv8l\" (UID: \"9112a3f8-e8fb-4df3-8f9e-c29bd437f5ea\") " pod="openstack-kuttl-tests/neutron-dc96-account-create-update-rpv8l" Mar 16 16:01:41 crc kubenswrapper[5120]: I0316 16:01:41.470728 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-319f-account-create-update-gr29k" Mar 16 16:01:41 crc kubenswrapper[5120]: I0316 16:01:41.475458 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hlwn7\" (UniqueName: \"kubernetes.io/projected/9112a3f8-e8fb-4df3-8f9e-c29bd437f5ea-kube-api-access-hlwn7\") pod \"neutron-dc96-account-create-update-rpv8l\" (UID: \"9112a3f8-e8fb-4df3-8f9e-c29bd437f5ea\") " pod="openstack-kuttl-tests/neutron-dc96-account-create-update-rpv8l" Mar 16 16:01:41 crc kubenswrapper[5120]: I0316 16:01:41.518950 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-create-h9d5m" Mar 16 16:01:41 crc kubenswrapper[5120]: I0316 16:01:41.554980 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jns8n\" (UniqueName: \"kubernetes.io/projected/b3cfedfb-c289-4e15-a017-b94faed25d78-kube-api-access-jns8n\") pod \"barbican-db-create-g5nwv\" (UID: \"b3cfedfb-c289-4e15-a017-b94faed25d78\") " pod="openstack-kuttl-tests/barbican-db-create-g5nwv" Mar 16 16:01:41 crc kubenswrapper[5120]: I0316 16:01:41.555312 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78g8n\" (UniqueName: \"kubernetes.io/projected/60778046-219c-45d9-baf3-14ec33c76c2d-kube-api-access-78g8n\") pod \"barbican-55ec-account-create-update-6h2pc\" (UID: \"60778046-219c-45d9-baf3-14ec33c76c2d\") " pod="openstack-kuttl-tests/barbican-55ec-account-create-update-6h2pc" Mar 16 16:01:41 crc kubenswrapper[5120]: I0316 16:01:41.555356 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/60778046-219c-45d9-baf3-14ec33c76c2d-operator-scripts\") pod \"barbican-55ec-account-create-update-6h2pc\" (UID: \"60778046-219c-45d9-baf3-14ec33c76c2d\") " pod="openstack-kuttl-tests/barbican-55ec-account-create-update-6h2pc" Mar 16 16:01:41 crc kubenswrapper[5120]: I0316 16:01:41.555397 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/db652175-15cd-4336-85a7-53cbb0cf505f-config-data\") pod \"keystone-db-sync-nk29h\" (UID: \"db652175-15cd-4336-85a7-53cbb0cf505f\") " pod="openstack-kuttl-tests/keystone-db-sync-nk29h" Mar 16 16:01:41 crc kubenswrapper[5120]: I0316 16:01:41.555415 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/db652175-15cd-4336-85a7-53cbb0cf505f-combined-ca-bundle\") pod \"keystone-db-sync-nk29h\" (UID: \"db652175-15cd-4336-85a7-53cbb0cf505f\") " pod="openstack-kuttl-tests/keystone-db-sync-nk29h" Mar 16 16:01:41 crc kubenswrapper[5120]: I0316 16:01:41.555467 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gfqgj\" (UniqueName: \"kubernetes.io/projected/db652175-15cd-4336-85a7-53cbb0cf505f-kube-api-access-gfqgj\") pod \"keystone-db-sync-nk29h\" (UID: \"db652175-15cd-4336-85a7-53cbb0cf505f\") " pod="openstack-kuttl-tests/keystone-db-sync-nk29h" Mar 16 16:01:41 crc kubenswrapper[5120]: I0316 16:01:41.555507 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b3cfedfb-c289-4e15-a017-b94faed25d78-operator-scripts\") pod \"barbican-db-create-g5nwv\" (UID: \"b3cfedfb-c289-4e15-a017-b94faed25d78\") " pod="openstack-kuttl-tests/barbican-db-create-g5nwv" Mar 16 16:01:41 crc kubenswrapper[5120]: I0316 16:01:41.558129 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-dc96-account-create-update-rpv8l" Mar 16 16:01:41 crc kubenswrapper[5120]: I0316 16:01:41.560069 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/db652175-15cd-4336-85a7-53cbb0cf505f-config-data\") pod \"keystone-db-sync-nk29h\" (UID: \"db652175-15cd-4336-85a7-53cbb0cf505f\") " pod="openstack-kuttl-tests/keystone-db-sync-nk29h" Mar 16 16:01:41 crc kubenswrapper[5120]: I0316 16:01:41.561834 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/db652175-15cd-4336-85a7-53cbb0cf505f-combined-ca-bundle\") pod \"keystone-db-sync-nk29h\" (UID: \"db652175-15cd-4336-85a7-53cbb0cf505f\") " pod="openstack-kuttl-tests/keystone-db-sync-nk29h" Mar 16 16:01:41 crc kubenswrapper[5120]: I0316 16:01:41.577686 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfqgj\" (UniqueName: \"kubernetes.io/projected/db652175-15cd-4336-85a7-53cbb0cf505f-kube-api-access-gfqgj\") pod \"keystone-db-sync-nk29h\" (UID: \"db652175-15cd-4336-85a7-53cbb0cf505f\") " pod="openstack-kuttl-tests/keystone-db-sync-nk29h" Mar 16 16:01:41 crc kubenswrapper[5120]: I0316 16:01:41.629215 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-nk29h" Mar 16 16:01:41 crc kubenswrapper[5120]: I0316 16:01:41.656508 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/60778046-219c-45d9-baf3-14ec33c76c2d-operator-scripts\") pod \"barbican-55ec-account-create-update-6h2pc\" (UID: \"60778046-219c-45d9-baf3-14ec33c76c2d\") " pod="openstack-kuttl-tests/barbican-55ec-account-create-update-6h2pc" Mar 16 16:01:41 crc kubenswrapper[5120]: I0316 16:01:41.656631 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b3cfedfb-c289-4e15-a017-b94faed25d78-operator-scripts\") pod \"barbican-db-create-g5nwv\" (UID: \"b3cfedfb-c289-4e15-a017-b94faed25d78\") " pod="openstack-kuttl-tests/barbican-db-create-g5nwv" Mar 16 16:01:41 crc kubenswrapper[5120]: I0316 16:01:41.656711 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jns8n\" (UniqueName: \"kubernetes.io/projected/b3cfedfb-c289-4e15-a017-b94faed25d78-kube-api-access-jns8n\") pod \"barbican-db-create-g5nwv\" (UID: \"b3cfedfb-c289-4e15-a017-b94faed25d78\") " pod="openstack-kuttl-tests/barbican-db-create-g5nwv" Mar 16 16:01:41 crc kubenswrapper[5120]: I0316 16:01:41.656734 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-78g8n\" (UniqueName: \"kubernetes.io/projected/60778046-219c-45d9-baf3-14ec33c76c2d-kube-api-access-78g8n\") pod \"barbican-55ec-account-create-update-6h2pc\" (UID: \"60778046-219c-45d9-baf3-14ec33c76c2d\") " pod="openstack-kuttl-tests/barbican-55ec-account-create-update-6h2pc" Mar 16 16:01:41 crc kubenswrapper[5120]: I0316 16:01:41.657537 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b3cfedfb-c289-4e15-a017-b94faed25d78-operator-scripts\") pod \"barbican-db-create-g5nwv\" (UID: \"b3cfedfb-c289-4e15-a017-b94faed25d78\") " pod="openstack-kuttl-tests/barbican-db-create-g5nwv" Mar 16 16:01:41 crc kubenswrapper[5120]: I0316 16:01:41.657899 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/60778046-219c-45d9-baf3-14ec33c76c2d-operator-scripts\") pod \"barbican-55ec-account-create-update-6h2pc\" (UID: \"60778046-219c-45d9-baf3-14ec33c76c2d\") " pod="openstack-kuttl-tests/barbican-55ec-account-create-update-6h2pc" Mar 16 16:01:41 crc kubenswrapper[5120]: I0316 16:01:41.674916 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-78g8n\" (UniqueName: \"kubernetes.io/projected/60778046-219c-45d9-baf3-14ec33c76c2d-kube-api-access-78g8n\") pod \"barbican-55ec-account-create-update-6h2pc\" (UID: \"60778046-219c-45d9-baf3-14ec33c76c2d\") " pod="openstack-kuttl-tests/barbican-55ec-account-create-update-6h2pc" Mar 16 16:01:41 crc kubenswrapper[5120]: I0316 16:01:41.675790 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jns8n\" (UniqueName: \"kubernetes.io/projected/b3cfedfb-c289-4e15-a017-b94faed25d78-kube-api-access-jns8n\") pod \"barbican-db-create-g5nwv\" (UID: \"b3cfedfb-c289-4e15-a017-b94faed25d78\") " pod="openstack-kuttl-tests/barbican-db-create-g5nwv" Mar 16 16:01:41 crc kubenswrapper[5120]: I0316 16:01:41.758306 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-create-g5nwv" Mar 16 16:01:41 crc kubenswrapper[5120]: I0316 16:01:41.765157 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-55ec-account-create-update-6h2pc" Mar 16 16:01:41 crc kubenswrapper[5120]: I0316 16:01:41.821163 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-db-create-lc5wc"] Mar 16 16:01:41 crc kubenswrapper[5120]: I0316 16:01:41.994187 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-319f-account-create-update-gr29k"] Mar 16 16:01:42 crc kubenswrapper[5120]: I0316 16:01:42.079085 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-dc96-account-create-update-rpv8l"] Mar 16 16:01:42 crc kubenswrapper[5120]: I0316 16:01:42.087592 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-db-create-h9d5m"] Mar 16 16:01:42 crc kubenswrapper[5120]: W0316 16:01:42.095310 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9112a3f8_e8fb_4df3_8f9e_c29bd437f5ea.slice/crio-e6a39b1af889b04a96e9de4839ab5da54dfe5ac5c4ae000e40a3b286a24c4cc4 WatchSource:0}: Error finding container e6a39b1af889b04a96e9de4839ab5da54dfe5ac5c4ae000e40a3b286a24c4cc4: Status 404 returned error can't find the container with id e6a39b1af889b04a96e9de4839ab5da54dfe5ac5c4ae000e40a3b286a24c4cc4 Mar 16 16:01:42 crc kubenswrapper[5120]: I0316 16:01:42.234455 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-nk29h"] Mar 16 16:01:42 crc kubenswrapper[5120]: I0316 16:01:42.300411 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-55ec-account-create-update-6h2pc"] Mar 16 16:01:42 crc kubenswrapper[5120]: I0316 16:01:42.385080 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-db-create-g5nwv"] Mar 16 16:01:42 crc kubenswrapper[5120]: W0316 16:01:42.387492 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb3cfedfb_c289_4e15_a017_b94faed25d78.slice/crio-89538d2a44fc55477453206e8ae222d933419164d09f1e13630f09a2025eeccf WatchSource:0}: Error finding container 89538d2a44fc55477453206e8ae222d933419164d09f1e13630f09a2025eeccf: Status 404 returned error can't find the container with id 89538d2a44fc55477453206e8ae222d933419164d09f1e13630f09a2025eeccf Mar 16 16:01:42 crc kubenswrapper[5120]: I0316 16:01:42.674460 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca816558-dccc-44fa-aaa6-5a2070f1b25f" path="/var/lib/kubelet/pods/ca816558-dccc-44fa-aaa6-5a2070f1b25f/volumes" Mar 16 16:01:42 crc kubenswrapper[5120]: I0316 16:01:42.852653 5120 generic.go:358] "Generic (PLEG): container finished" podID="60778046-219c-45d9-baf3-14ec33c76c2d" containerID="848ee717d057a223c0dd69521fd03ec0d5b6a1e844b8b8426ade07bb51602f5f" exitCode=0 Mar 16 16:01:42 crc kubenswrapper[5120]: I0316 16:01:42.852947 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-55ec-account-create-update-6h2pc" event={"ID":"60778046-219c-45d9-baf3-14ec33c76c2d","Type":"ContainerDied","Data":"848ee717d057a223c0dd69521fd03ec0d5b6a1e844b8b8426ade07bb51602f5f"} Mar 16 16:01:42 crc kubenswrapper[5120]: I0316 16:01:42.852976 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-55ec-account-create-update-6h2pc" event={"ID":"60778046-219c-45d9-baf3-14ec33c76c2d","Type":"ContainerStarted","Data":"142c22e5f4f8f6c7ba842eab149e72db0522b2cf32ae96e4776657213be05fbd"} Mar 16 16:01:42 crc kubenswrapper[5120]: I0316 16:01:42.856300 5120 generic.go:358] "Generic (PLEG): container finished" podID="34542a97-1318-45c8-a22f-6d4fd9c96846" containerID="7ffd77e31eea93d1e7ace0a0cdb54f98533fbfa2077af168290652e54a75978c" exitCode=0 Mar 16 16:01:42 crc kubenswrapper[5120]: I0316 16:01:42.856904 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-create-lc5wc" event={"ID":"34542a97-1318-45c8-a22f-6d4fd9c96846","Type":"ContainerDied","Data":"7ffd77e31eea93d1e7ace0a0cdb54f98533fbfa2077af168290652e54a75978c"} Mar 16 16:01:42 crc kubenswrapper[5120]: I0316 16:01:42.856927 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-create-lc5wc" event={"ID":"34542a97-1318-45c8-a22f-6d4fd9c96846","Type":"ContainerStarted","Data":"52c38dda9b92c253d838115bdfdd46650463fcc886c6231876e652d2156d8975"} Mar 16 16:01:42 crc kubenswrapper[5120]: I0316 16:01:42.863083 5120 generic.go:358] "Generic (PLEG): container finished" podID="979d8836-4381-4d52-97bc-b2b3d339e046" containerID="f36a1e34c2933a69a17e6610a2776c77bda37cc9b6f76e51ea55b6db39f66f7a" exitCode=0 Mar 16 16:01:42 crc kubenswrapper[5120]: I0316 16:01:42.863395 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-create-h9d5m" event={"ID":"979d8836-4381-4d52-97bc-b2b3d339e046","Type":"ContainerDied","Data":"f36a1e34c2933a69a17e6610a2776c77bda37cc9b6f76e51ea55b6db39f66f7a"} Mar 16 16:01:42 crc kubenswrapper[5120]: I0316 16:01:42.863429 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-create-h9d5m" event={"ID":"979d8836-4381-4d52-97bc-b2b3d339e046","Type":"ContainerStarted","Data":"69dc45470f96ed70db3a471f5343130ebcb534032bd7b243d7cfda25af4aa3ee"} Mar 16 16:01:42 crc kubenswrapper[5120]: I0316 16:01:42.870241 5120 generic.go:358] "Generic (PLEG): container finished" podID="b3cfedfb-c289-4e15-a017-b94faed25d78" containerID="74121ce6a7efc39e5beb3f3cec5a3d5d6cb0386878d19b45d751d804a50ae1c2" exitCode=0 Mar 16 16:01:42 crc kubenswrapper[5120]: I0316 16:01:42.870333 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-create-g5nwv" event={"ID":"b3cfedfb-c289-4e15-a017-b94faed25d78","Type":"ContainerDied","Data":"74121ce6a7efc39e5beb3f3cec5a3d5d6cb0386878d19b45d751d804a50ae1c2"} Mar 16 16:01:42 crc kubenswrapper[5120]: I0316 16:01:42.870359 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-create-g5nwv" event={"ID":"b3cfedfb-c289-4e15-a017-b94faed25d78","Type":"ContainerStarted","Data":"89538d2a44fc55477453206e8ae222d933419164d09f1e13630f09a2025eeccf"} Mar 16 16:01:42 crc kubenswrapper[5120]: I0316 16:01:42.872560 5120 generic.go:358] "Generic (PLEG): container finished" podID="b687141f-0dee-4a5b-a072-823f2d33133d" containerID="374687a984677454959d9a99ee25012a0eebddf3bda36b96383e078d8babf88a" exitCode=0 Mar 16 16:01:42 crc kubenswrapper[5120]: I0316 16:01:42.872623 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-319f-account-create-update-gr29k" event={"ID":"b687141f-0dee-4a5b-a072-823f2d33133d","Type":"ContainerDied","Data":"374687a984677454959d9a99ee25012a0eebddf3bda36b96383e078d8babf88a"} Mar 16 16:01:42 crc kubenswrapper[5120]: I0316 16:01:42.872637 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-319f-account-create-update-gr29k" event={"ID":"b687141f-0dee-4a5b-a072-823f2d33133d","Type":"ContainerStarted","Data":"d08fa01baf9740d7dbbdfea5a2cbee4b291e960272010ce7662f6dff9510cee8"} Mar 16 16:01:42 crc kubenswrapper[5120]: I0316 16:01:42.875917 5120 generic.go:358] "Generic (PLEG): container finished" podID="9112a3f8-e8fb-4df3-8f9e-c29bd437f5ea" containerID="ca216a86a8eef0b726ed0a1ab53ae38717fb398ddff0b8e08396f18c889c6736" exitCode=0 Mar 16 16:01:42 crc kubenswrapper[5120]: I0316 16:01:42.876005 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-dc96-account-create-update-rpv8l" event={"ID":"9112a3f8-e8fb-4df3-8f9e-c29bd437f5ea","Type":"ContainerDied","Data":"ca216a86a8eef0b726ed0a1ab53ae38717fb398ddff0b8e08396f18c889c6736"} Mar 16 16:01:42 crc kubenswrapper[5120]: I0316 16:01:42.876021 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-dc96-account-create-update-rpv8l" event={"ID":"9112a3f8-e8fb-4df3-8f9e-c29bd437f5ea","Type":"ContainerStarted","Data":"e6a39b1af889b04a96e9de4839ab5da54dfe5ac5c4ae000e40a3b286a24c4cc4"} Mar 16 16:01:42 crc kubenswrapper[5120]: I0316 16:01:42.877150 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-nk29h" event={"ID":"db652175-15cd-4336-85a7-53cbb0cf505f","Type":"ContainerStarted","Data":"e4b657e87642950e7d0629e7df318da4076909475a6699f0084d91ea38aea3f5"} Mar 16 16:01:42 crc kubenswrapper[5120]: I0316 16:01:42.877175 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-nk29h" event={"ID":"db652175-15cd-4336-85a7-53cbb0cf505f","Type":"ContainerStarted","Data":"3e10ae1c14e6b1fa1ee8aa6b72c5d64a926bfdde9132be7d2342d41479fa4822"} Mar 16 16:01:42 crc kubenswrapper[5120]: I0316 16:01:42.946733 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-db-sync-nk29h" podStartSLOduration=1.946710494 podStartE2EDuration="1.946710494s" podCreationTimestamp="2026-03-16 16:01:41 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:01:42.942419896 +0000 UTC m=+1805.096351553" watchObservedRunningTime="2026-03-16 16:01:42.946710494 +0000 UTC m=+1805.100642151" Mar 16 16:01:42 crc kubenswrapper[5120]: I0316 16:01:42.978917 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-v822j_ac55471d-4e42-475f-a082-50f611571482/kube-multus/0.log" Mar 16 16:01:42 crc kubenswrapper[5120]: I0316 16:01:42.980885 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-v822j_ac55471d-4e42-475f-a082-50f611571482/kube-multus/0.log" Mar 16 16:01:42 crc kubenswrapper[5120]: I0316 16:01:42.988306 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-crc_9f0bc7fcb0822a2c13eb2d22cd8c0641/kube-controller-manager/0.log" Mar 16 16:01:42 crc kubenswrapper[5120]: I0316 16:01:42.988523 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-crc_9f0bc7fcb0822a2c13eb2d22cd8c0641/kube-controller-manager/0.log" Mar 16 16:01:44 crc kubenswrapper[5120]: I0316 16:01:44.347920 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-319f-account-create-update-gr29k" Mar 16 16:01:44 crc kubenswrapper[5120]: I0316 16:01:44.511534 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b687141f-0dee-4a5b-a072-823f2d33133d-operator-scripts\") pod \"b687141f-0dee-4a5b-a072-823f2d33133d\" (UID: \"b687141f-0dee-4a5b-a072-823f2d33133d\") " Mar 16 16:01:44 crc kubenswrapper[5120]: I0316 16:01:44.511926 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wz659\" (UniqueName: \"kubernetes.io/projected/b687141f-0dee-4a5b-a072-823f2d33133d-kube-api-access-wz659\") pod \"b687141f-0dee-4a5b-a072-823f2d33133d\" (UID: \"b687141f-0dee-4a5b-a072-823f2d33133d\") " Mar 16 16:01:44 crc kubenswrapper[5120]: I0316 16:01:44.513179 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b687141f-0dee-4a5b-a072-823f2d33133d-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "b687141f-0dee-4a5b-a072-823f2d33133d" (UID: "b687141f-0dee-4a5b-a072-823f2d33133d"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:01:44 crc kubenswrapper[5120]: I0316 16:01:44.517749 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b687141f-0dee-4a5b-a072-823f2d33133d-kube-api-access-wz659" (OuterVolumeSpecName: "kube-api-access-wz659") pod "b687141f-0dee-4a5b-a072-823f2d33133d" (UID: "b687141f-0dee-4a5b-a072-823f2d33133d"). InnerVolumeSpecName "kube-api-access-wz659". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:01:44 crc kubenswrapper[5120]: I0316 16:01:44.540497 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-55ec-account-create-update-6h2pc" Mar 16 16:01:44 crc kubenswrapper[5120]: I0316 16:01:44.545989 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-create-g5nwv" Mar 16 16:01:44 crc kubenswrapper[5120]: I0316 16:01:44.553313 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-dc96-account-create-update-rpv8l" Mar 16 16:01:44 crc kubenswrapper[5120]: I0316 16:01:44.564248 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-create-h9d5m" Mar 16 16:01:44 crc kubenswrapper[5120]: I0316 16:01:44.573693 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-create-lc5wc" Mar 16 16:01:44 crc kubenswrapper[5120]: I0316 16:01:44.613435 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-78g8n\" (UniqueName: \"kubernetes.io/projected/60778046-219c-45d9-baf3-14ec33c76c2d-kube-api-access-78g8n\") pod \"60778046-219c-45d9-baf3-14ec33c76c2d\" (UID: \"60778046-219c-45d9-baf3-14ec33c76c2d\") " Mar 16 16:01:44 crc kubenswrapper[5120]: I0316 16:01:44.613531 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/60778046-219c-45d9-baf3-14ec33c76c2d-operator-scripts\") pod \"60778046-219c-45d9-baf3-14ec33c76c2d\" (UID: \"60778046-219c-45d9-baf3-14ec33c76c2d\") " Mar 16 16:01:44 crc kubenswrapper[5120]: I0316 16:01:44.613825 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b687141f-0dee-4a5b-a072-823f2d33133d-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:01:44 crc kubenswrapper[5120]: I0316 16:01:44.613838 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wz659\" (UniqueName: \"kubernetes.io/projected/b687141f-0dee-4a5b-a072-823f2d33133d-kube-api-access-wz659\") on node \"crc\" DevicePath \"\"" Mar 16 16:01:44 crc kubenswrapper[5120]: I0316 16:01:44.614245 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/60778046-219c-45d9-baf3-14ec33c76c2d-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "60778046-219c-45d9-baf3-14ec33c76c2d" (UID: "60778046-219c-45d9-baf3-14ec33c76c2d"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:01:44 crc kubenswrapper[5120]: I0316 16:01:44.620031 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60778046-219c-45d9-baf3-14ec33c76c2d-kube-api-access-78g8n" (OuterVolumeSpecName: "kube-api-access-78g8n") pod "60778046-219c-45d9-baf3-14ec33c76c2d" (UID: "60778046-219c-45d9-baf3-14ec33c76c2d"). InnerVolumeSpecName "kube-api-access-78g8n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:01:44 crc kubenswrapper[5120]: I0316 16:01:44.714872 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6v965\" (UniqueName: \"kubernetes.io/projected/34542a97-1318-45c8-a22f-6d4fd9c96846-kube-api-access-6v965\") pod \"34542a97-1318-45c8-a22f-6d4fd9c96846\" (UID: \"34542a97-1318-45c8-a22f-6d4fd9c96846\") " Mar 16 16:01:44 crc kubenswrapper[5120]: I0316 16:01:44.714921 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9112a3f8-e8fb-4df3-8f9e-c29bd437f5ea-operator-scripts\") pod \"9112a3f8-e8fb-4df3-8f9e-c29bd437f5ea\" (UID: \"9112a3f8-e8fb-4df3-8f9e-c29bd437f5ea\") " Mar 16 16:01:44 crc kubenswrapper[5120]: I0316 16:01:44.714950 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/34542a97-1318-45c8-a22f-6d4fd9c96846-operator-scripts\") pod \"34542a97-1318-45c8-a22f-6d4fd9c96846\" (UID: \"34542a97-1318-45c8-a22f-6d4fd9c96846\") " Mar 16 16:01:44 crc kubenswrapper[5120]: I0316 16:01:44.715069 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jns8n\" (UniqueName: \"kubernetes.io/projected/b3cfedfb-c289-4e15-a017-b94faed25d78-kube-api-access-jns8n\") pod \"b3cfedfb-c289-4e15-a017-b94faed25d78\" (UID: \"b3cfedfb-c289-4e15-a017-b94faed25d78\") " Mar 16 16:01:44 crc kubenswrapper[5120]: I0316 16:01:44.715090 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6ds24\" (UniqueName: \"kubernetes.io/projected/979d8836-4381-4d52-97bc-b2b3d339e046-kube-api-access-6ds24\") pod \"979d8836-4381-4d52-97bc-b2b3d339e046\" (UID: \"979d8836-4381-4d52-97bc-b2b3d339e046\") " Mar 16 16:01:44 crc kubenswrapper[5120]: I0316 16:01:44.715107 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/979d8836-4381-4d52-97bc-b2b3d339e046-operator-scripts\") pod \"979d8836-4381-4d52-97bc-b2b3d339e046\" (UID: \"979d8836-4381-4d52-97bc-b2b3d339e046\") " Mar 16 16:01:44 crc kubenswrapper[5120]: I0316 16:01:44.715286 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hlwn7\" (UniqueName: \"kubernetes.io/projected/9112a3f8-e8fb-4df3-8f9e-c29bd437f5ea-kube-api-access-hlwn7\") pod \"9112a3f8-e8fb-4df3-8f9e-c29bd437f5ea\" (UID: \"9112a3f8-e8fb-4df3-8f9e-c29bd437f5ea\") " Mar 16 16:01:44 crc kubenswrapper[5120]: I0316 16:01:44.715352 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b3cfedfb-c289-4e15-a017-b94faed25d78-operator-scripts\") pod \"b3cfedfb-c289-4e15-a017-b94faed25d78\" (UID: \"b3cfedfb-c289-4e15-a017-b94faed25d78\") " Mar 16 16:01:44 crc kubenswrapper[5120]: I0316 16:01:44.715648 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-78g8n\" (UniqueName: \"kubernetes.io/projected/60778046-219c-45d9-baf3-14ec33c76c2d-kube-api-access-78g8n\") on node \"crc\" DevicePath \"\"" Mar 16 16:01:44 crc kubenswrapper[5120]: I0316 16:01:44.715661 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/60778046-219c-45d9-baf3-14ec33c76c2d-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:01:44 crc kubenswrapper[5120]: I0316 16:01:44.716074 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b3cfedfb-c289-4e15-a017-b94faed25d78-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "b3cfedfb-c289-4e15-a017-b94faed25d78" (UID: "b3cfedfb-c289-4e15-a017-b94faed25d78"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:01:44 crc kubenswrapper[5120]: I0316 16:01:44.716459 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/979d8836-4381-4d52-97bc-b2b3d339e046-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "979d8836-4381-4d52-97bc-b2b3d339e046" (UID: "979d8836-4381-4d52-97bc-b2b3d339e046"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:01:44 crc kubenswrapper[5120]: I0316 16:01:44.716745 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9112a3f8-e8fb-4df3-8f9e-c29bd437f5ea-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "9112a3f8-e8fb-4df3-8f9e-c29bd437f5ea" (UID: "9112a3f8-e8fb-4df3-8f9e-c29bd437f5ea"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:01:44 crc kubenswrapper[5120]: I0316 16:01:44.717093 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/34542a97-1318-45c8-a22f-6d4fd9c96846-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "34542a97-1318-45c8-a22f-6d4fd9c96846" (UID: "34542a97-1318-45c8-a22f-6d4fd9c96846"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:01:44 crc kubenswrapper[5120]: I0316 16:01:44.719453 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9112a3f8-e8fb-4df3-8f9e-c29bd437f5ea-kube-api-access-hlwn7" (OuterVolumeSpecName: "kube-api-access-hlwn7") pod "9112a3f8-e8fb-4df3-8f9e-c29bd437f5ea" (UID: "9112a3f8-e8fb-4df3-8f9e-c29bd437f5ea"). InnerVolumeSpecName "kube-api-access-hlwn7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:01:44 crc kubenswrapper[5120]: I0316 16:01:44.719688 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3cfedfb-c289-4e15-a017-b94faed25d78-kube-api-access-jns8n" (OuterVolumeSpecName: "kube-api-access-jns8n") pod "b3cfedfb-c289-4e15-a017-b94faed25d78" (UID: "b3cfedfb-c289-4e15-a017-b94faed25d78"). InnerVolumeSpecName "kube-api-access-jns8n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:01:44 crc kubenswrapper[5120]: I0316 16:01:44.720904 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34542a97-1318-45c8-a22f-6d4fd9c96846-kube-api-access-6v965" (OuterVolumeSpecName: "kube-api-access-6v965") pod "34542a97-1318-45c8-a22f-6d4fd9c96846" (UID: "34542a97-1318-45c8-a22f-6d4fd9c96846"). InnerVolumeSpecName "kube-api-access-6v965". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:01:44 crc kubenswrapper[5120]: I0316 16:01:44.721007 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/979d8836-4381-4d52-97bc-b2b3d339e046-kube-api-access-6ds24" (OuterVolumeSpecName: "kube-api-access-6ds24") pod "979d8836-4381-4d52-97bc-b2b3d339e046" (UID: "979d8836-4381-4d52-97bc-b2b3d339e046"). InnerVolumeSpecName "kube-api-access-6ds24". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:01:44 crc kubenswrapper[5120]: I0316 16:01:44.818469 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hlwn7\" (UniqueName: \"kubernetes.io/projected/9112a3f8-e8fb-4df3-8f9e-c29bd437f5ea-kube-api-access-hlwn7\") on node \"crc\" DevicePath \"\"" Mar 16 16:01:44 crc kubenswrapper[5120]: I0316 16:01:44.818625 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b3cfedfb-c289-4e15-a017-b94faed25d78-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:01:44 crc kubenswrapper[5120]: I0316 16:01:44.818652 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6v965\" (UniqueName: \"kubernetes.io/projected/34542a97-1318-45c8-a22f-6d4fd9c96846-kube-api-access-6v965\") on node \"crc\" DevicePath \"\"" Mar 16 16:01:44 crc kubenswrapper[5120]: I0316 16:01:44.818665 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9112a3f8-e8fb-4df3-8f9e-c29bd437f5ea-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:01:44 crc kubenswrapper[5120]: I0316 16:01:44.818680 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/34542a97-1318-45c8-a22f-6d4fd9c96846-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:01:44 crc kubenswrapper[5120]: I0316 16:01:44.818696 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jns8n\" (UniqueName: \"kubernetes.io/projected/b3cfedfb-c289-4e15-a017-b94faed25d78-kube-api-access-jns8n\") on node \"crc\" DevicePath \"\"" Mar 16 16:01:44 crc kubenswrapper[5120]: I0316 16:01:44.818711 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6ds24\" (UniqueName: \"kubernetes.io/projected/979d8836-4381-4d52-97bc-b2b3d339e046-kube-api-access-6ds24\") on node \"crc\" DevicePath \"\"" Mar 16 16:01:44 crc kubenswrapper[5120]: I0316 16:01:44.818726 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/979d8836-4381-4d52-97bc-b2b3d339e046-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:01:44 crc kubenswrapper[5120]: I0316 16:01:44.898716 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-create-g5nwv" Mar 16 16:01:44 crc kubenswrapper[5120]: I0316 16:01:44.898727 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-create-g5nwv" event={"ID":"b3cfedfb-c289-4e15-a017-b94faed25d78","Type":"ContainerDied","Data":"89538d2a44fc55477453206e8ae222d933419164d09f1e13630f09a2025eeccf"} Mar 16 16:01:44 crc kubenswrapper[5120]: I0316 16:01:44.898811 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="89538d2a44fc55477453206e8ae222d933419164d09f1e13630f09a2025eeccf" Mar 16 16:01:44 crc kubenswrapper[5120]: I0316 16:01:44.901492 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-319f-account-create-update-gr29k" event={"ID":"b687141f-0dee-4a5b-a072-823f2d33133d","Type":"ContainerDied","Data":"d08fa01baf9740d7dbbdfea5a2cbee4b291e960272010ce7662f6dff9510cee8"} Mar 16 16:01:44 crc kubenswrapper[5120]: I0316 16:01:44.901516 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d08fa01baf9740d7dbbdfea5a2cbee4b291e960272010ce7662f6dff9510cee8" Mar 16 16:01:44 crc kubenswrapper[5120]: I0316 16:01:44.901574 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-319f-account-create-update-gr29k" Mar 16 16:01:44 crc kubenswrapper[5120]: I0316 16:01:44.903531 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-dc96-account-create-update-rpv8l" event={"ID":"9112a3f8-e8fb-4df3-8f9e-c29bd437f5ea","Type":"ContainerDied","Data":"e6a39b1af889b04a96e9de4839ab5da54dfe5ac5c4ae000e40a3b286a24c4cc4"} Mar 16 16:01:44 crc kubenswrapper[5120]: I0316 16:01:44.903593 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e6a39b1af889b04a96e9de4839ab5da54dfe5ac5c4ae000e40a3b286a24c4cc4" Mar 16 16:01:44 crc kubenswrapper[5120]: I0316 16:01:44.903799 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-dc96-account-create-update-rpv8l" Mar 16 16:01:44 crc kubenswrapper[5120]: I0316 16:01:44.905973 5120 generic.go:358] "Generic (PLEG): container finished" podID="db652175-15cd-4336-85a7-53cbb0cf505f" containerID="e4b657e87642950e7d0629e7df318da4076909475a6699f0084d91ea38aea3f5" exitCode=0 Mar 16 16:01:44 crc kubenswrapper[5120]: I0316 16:01:44.906041 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-nk29h" event={"ID":"db652175-15cd-4336-85a7-53cbb0cf505f","Type":"ContainerDied","Data":"e4b657e87642950e7d0629e7df318da4076909475a6699f0084d91ea38aea3f5"} Mar 16 16:01:44 crc kubenswrapper[5120]: I0316 16:01:44.909571 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-55ec-account-create-update-6h2pc" Mar 16 16:01:44 crc kubenswrapper[5120]: I0316 16:01:44.910027 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-55ec-account-create-update-6h2pc" event={"ID":"60778046-219c-45d9-baf3-14ec33c76c2d","Type":"ContainerDied","Data":"142c22e5f4f8f6c7ba842eab149e72db0522b2cf32ae96e4776657213be05fbd"} Mar 16 16:01:44 crc kubenswrapper[5120]: I0316 16:01:44.910881 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="142c22e5f4f8f6c7ba842eab149e72db0522b2cf32ae96e4776657213be05fbd" Mar 16 16:01:44 crc kubenswrapper[5120]: I0316 16:01:44.911558 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-create-lc5wc" Mar 16 16:01:44 crc kubenswrapper[5120]: I0316 16:01:44.911711 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-create-lc5wc" event={"ID":"34542a97-1318-45c8-a22f-6d4fd9c96846","Type":"ContainerDied","Data":"52c38dda9b92c253d838115bdfdd46650463fcc886c6231876e652d2156d8975"} Mar 16 16:01:44 crc kubenswrapper[5120]: I0316 16:01:44.911747 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="52c38dda9b92c253d838115bdfdd46650463fcc886c6231876e652d2156d8975" Mar 16 16:01:44 crc kubenswrapper[5120]: I0316 16:01:44.914548 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-create-h9d5m" event={"ID":"979d8836-4381-4d52-97bc-b2b3d339e046","Type":"ContainerDied","Data":"69dc45470f96ed70db3a471f5343130ebcb534032bd7b243d7cfda25af4aa3ee"} Mar 16 16:01:44 crc kubenswrapper[5120]: I0316 16:01:44.914586 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="69dc45470f96ed70db3a471f5343130ebcb534032bd7b243d7cfda25af4aa3ee" Mar 16 16:01:44 crc kubenswrapper[5120]: I0316 16:01:44.914662 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-create-h9d5m" Mar 16 16:01:46 crc kubenswrapper[5120]: I0316 16:01:46.259610 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-nk29h" Mar 16 16:01:46 crc kubenswrapper[5120]: I0316 16:01:46.353182 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/db652175-15cd-4336-85a7-53cbb0cf505f-combined-ca-bundle\") pod \"db652175-15cd-4336-85a7-53cbb0cf505f\" (UID: \"db652175-15cd-4336-85a7-53cbb0cf505f\") " Mar 16 16:01:46 crc kubenswrapper[5120]: I0316 16:01:46.353393 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gfqgj\" (UniqueName: \"kubernetes.io/projected/db652175-15cd-4336-85a7-53cbb0cf505f-kube-api-access-gfqgj\") pod \"db652175-15cd-4336-85a7-53cbb0cf505f\" (UID: \"db652175-15cd-4336-85a7-53cbb0cf505f\") " Mar 16 16:01:46 crc kubenswrapper[5120]: I0316 16:01:46.353548 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/db652175-15cd-4336-85a7-53cbb0cf505f-config-data\") pod \"db652175-15cd-4336-85a7-53cbb0cf505f\" (UID: \"db652175-15cd-4336-85a7-53cbb0cf505f\") " Mar 16 16:01:46 crc kubenswrapper[5120]: I0316 16:01:46.365933 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db652175-15cd-4336-85a7-53cbb0cf505f-kube-api-access-gfqgj" (OuterVolumeSpecName: "kube-api-access-gfqgj") pod "db652175-15cd-4336-85a7-53cbb0cf505f" (UID: "db652175-15cd-4336-85a7-53cbb0cf505f"). InnerVolumeSpecName "kube-api-access-gfqgj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:01:46 crc kubenswrapper[5120]: I0316 16:01:46.388456 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db652175-15cd-4336-85a7-53cbb0cf505f-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "db652175-15cd-4336-85a7-53cbb0cf505f" (UID: "db652175-15cd-4336-85a7-53cbb0cf505f"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:01:46 crc kubenswrapper[5120]: I0316 16:01:46.426094 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db652175-15cd-4336-85a7-53cbb0cf505f-config-data" (OuterVolumeSpecName: "config-data") pod "db652175-15cd-4336-85a7-53cbb0cf505f" (UID: "db652175-15cd-4336-85a7-53cbb0cf505f"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:01:46 crc kubenswrapper[5120]: I0316 16:01:46.456029 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/db652175-15cd-4336-85a7-53cbb0cf505f-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:01:46 crc kubenswrapper[5120]: I0316 16:01:46.456061 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gfqgj\" (UniqueName: \"kubernetes.io/projected/db652175-15cd-4336-85a7-53cbb0cf505f-kube-api-access-gfqgj\") on node \"crc\" DevicePath \"\"" Mar 16 16:01:46 crc kubenswrapper[5120]: I0316 16:01:46.456073 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/db652175-15cd-4336-85a7-53cbb0cf505f-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:01:46 crc kubenswrapper[5120]: I0316 16:01:46.933463 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-nk29h" Mar 16 16:01:46 crc kubenswrapper[5120]: I0316 16:01:46.933817 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-nk29h" event={"ID":"db652175-15cd-4336-85a7-53cbb0cf505f","Type":"ContainerDied","Data":"3e10ae1c14e6b1fa1ee8aa6b72c5d64a926bfdde9132be7d2342d41479fa4822"} Mar 16 16:01:46 crc kubenswrapper[5120]: I0316 16:01:46.933985 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3e10ae1c14e6b1fa1ee8aa6b72c5d64a926bfdde9132be7d2342d41479fa4822" Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.470531 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-8wn9f"] Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.471529 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9112a3f8-e8fb-4df3-8f9e-c29bd437f5ea" containerName="mariadb-account-create-update" Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.471549 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9112a3f8-e8fb-4df3-8f9e-c29bd437f5ea" containerName="mariadb-account-create-update" Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.471565 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="979d8836-4381-4d52-97bc-b2b3d339e046" containerName="mariadb-database-create" Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.471574 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="979d8836-4381-4d52-97bc-b2b3d339e046" containerName="mariadb-database-create" Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.471581 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b687141f-0dee-4a5b-a072-823f2d33133d" containerName="mariadb-account-create-update" Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.471587 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="b687141f-0dee-4a5b-a072-823f2d33133d" containerName="mariadb-account-create-update" Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.471608 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34542a97-1318-45c8-a22f-6d4fd9c96846" containerName="mariadb-database-create" Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.471613 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="34542a97-1318-45c8-a22f-6d4fd9c96846" containerName="mariadb-database-create" Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.471624 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3cfedfb-c289-4e15-a017-b94faed25d78" containerName="mariadb-database-create" Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.471629 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3cfedfb-c289-4e15-a017-b94faed25d78" containerName="mariadb-database-create" Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.471638 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60778046-219c-45d9-baf3-14ec33c76c2d" containerName="mariadb-account-create-update" Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.471643 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="60778046-219c-45d9-baf3-14ec33c76c2d" containerName="mariadb-account-create-update" Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.471652 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db652175-15cd-4336-85a7-53cbb0cf505f" containerName="keystone-db-sync" Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.471657 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="db652175-15cd-4336-85a7-53cbb0cf505f" containerName="keystone-db-sync" Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.471838 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="b687141f-0dee-4a5b-a072-823f2d33133d" containerName="mariadb-account-create-update" Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.471851 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="34542a97-1318-45c8-a22f-6d4fd9c96846" containerName="mariadb-database-create" Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.471860 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="979d8836-4381-4d52-97bc-b2b3d339e046" containerName="mariadb-database-create" Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.471869 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="60778046-219c-45d9-baf3-14ec33c76c2d" containerName="mariadb-account-create-update" Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.471879 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="b3cfedfb-c289-4e15-a017-b94faed25d78" containerName="mariadb-database-create" Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.471889 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="db652175-15cd-4336-85a7-53cbb0cf505f" containerName="keystone-db-sync" Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.471898 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="9112a3f8-e8fb-4df3-8f9e-c29bd437f5ea" containerName="mariadb-account-create-update" Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.484065 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-8wn9f" Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.488750 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone\"" Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.488966 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-keystone-dockercfg-dsstd\"" Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.489060 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-config-data\"" Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.489158 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"osp-secret\"" Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.489249 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-scripts\"" Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.495523 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-8wn9f"] Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.498982 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e52ef7fa-31bc-409e-a6eb-5b32a5082208-scripts\") pod \"keystone-bootstrap-8wn9f\" (UID: \"e52ef7fa-31bc-409e-a6eb-5b32a5082208\") " pod="openstack-kuttl-tests/keystone-bootstrap-8wn9f" Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.499088 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/e52ef7fa-31bc-409e-a6eb-5b32a5082208-credential-keys\") pod \"keystone-bootstrap-8wn9f\" (UID: \"e52ef7fa-31bc-409e-a6eb-5b32a5082208\") " pod="openstack-kuttl-tests/keystone-bootstrap-8wn9f" Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.499172 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bh6ln\" (UniqueName: \"kubernetes.io/projected/e52ef7fa-31bc-409e-a6eb-5b32a5082208-kube-api-access-bh6ln\") pod \"keystone-bootstrap-8wn9f\" (UID: \"e52ef7fa-31bc-409e-a6eb-5b32a5082208\") " pod="openstack-kuttl-tests/keystone-bootstrap-8wn9f" Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.499251 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/e52ef7fa-31bc-409e-a6eb-5b32a5082208-fernet-keys\") pod \"keystone-bootstrap-8wn9f\" (UID: \"e52ef7fa-31bc-409e-a6eb-5b32a5082208\") " pod="openstack-kuttl-tests/keystone-bootstrap-8wn9f" Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.499274 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e52ef7fa-31bc-409e-a6eb-5b32a5082208-config-data\") pod \"keystone-bootstrap-8wn9f\" (UID: \"e52ef7fa-31bc-409e-a6eb-5b32a5082208\") " pod="openstack-kuttl-tests/keystone-bootstrap-8wn9f" Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.499331 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e52ef7fa-31bc-409e-a6eb-5b32a5082208-combined-ca-bundle\") pod \"keystone-bootstrap-8wn9f\" (UID: \"e52ef7fa-31bc-409e-a6eb-5b32a5082208\") " pod="openstack-kuttl-tests/keystone-bootstrap-8wn9f" Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.553796 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.567946 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.571309 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-external-config-data\"" Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.571483 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-scripts\"" Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.571602 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-public-svc\"" Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.571742 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-glance-dockercfg-84rcs\"" Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.572352 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.601056 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/e52ef7fa-31bc-409e-a6eb-5b32a5082208-fernet-keys\") pod \"keystone-bootstrap-8wn9f\" (UID: \"e52ef7fa-31bc-409e-a6eb-5b32a5082208\") " pod="openstack-kuttl-tests/keystone-bootstrap-8wn9f" Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.601132 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e52ef7fa-31bc-409e-a6eb-5b32a5082208-config-data\") pod \"keystone-bootstrap-8wn9f\" (UID: \"e52ef7fa-31bc-409e-a6eb-5b32a5082208\") " pod="openstack-kuttl-tests/keystone-bootstrap-8wn9f" Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.601173 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e52ef7fa-31bc-409e-a6eb-5b32a5082208-combined-ca-bundle\") pod \"keystone-bootstrap-8wn9f\" (UID: \"e52ef7fa-31bc-409e-a6eb-5b32a5082208\") " pod="openstack-kuttl-tests/keystone-bootstrap-8wn9f" Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.601217 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e52ef7fa-31bc-409e-a6eb-5b32a5082208-scripts\") pod \"keystone-bootstrap-8wn9f\" (UID: \"e52ef7fa-31bc-409e-a6eb-5b32a5082208\") " pod="openstack-kuttl-tests/keystone-bootstrap-8wn9f" Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.601271 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/e52ef7fa-31bc-409e-a6eb-5b32a5082208-credential-keys\") pod \"keystone-bootstrap-8wn9f\" (UID: \"e52ef7fa-31bc-409e-a6eb-5b32a5082208\") " pod="openstack-kuttl-tests/keystone-bootstrap-8wn9f" Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.601335 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bh6ln\" (UniqueName: \"kubernetes.io/projected/e52ef7fa-31bc-409e-a6eb-5b32a5082208-kube-api-access-bh6ln\") pod \"keystone-bootstrap-8wn9f\" (UID: \"e52ef7fa-31bc-409e-a6eb-5b32a5082208\") " pod="openstack-kuttl-tests/keystone-bootstrap-8wn9f" Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.623665 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/e52ef7fa-31bc-409e-a6eb-5b32a5082208-credential-keys\") pod \"keystone-bootstrap-8wn9f\" (UID: \"e52ef7fa-31bc-409e-a6eb-5b32a5082208\") " pod="openstack-kuttl-tests/keystone-bootstrap-8wn9f" Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.632301 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e52ef7fa-31bc-409e-a6eb-5b32a5082208-scripts\") pod \"keystone-bootstrap-8wn9f\" (UID: \"e52ef7fa-31bc-409e-a6eb-5b32a5082208\") " pod="openstack-kuttl-tests/keystone-bootstrap-8wn9f" Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.634248 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/e52ef7fa-31bc-409e-a6eb-5b32a5082208-fernet-keys\") pod \"keystone-bootstrap-8wn9f\" (UID: \"e52ef7fa-31bc-409e-a6eb-5b32a5082208\") " pod="openstack-kuttl-tests/keystone-bootstrap-8wn9f" Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.635161 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bh6ln\" (UniqueName: \"kubernetes.io/projected/e52ef7fa-31bc-409e-a6eb-5b32a5082208-kube-api-access-bh6ln\") pod \"keystone-bootstrap-8wn9f\" (UID: \"e52ef7fa-31bc-409e-a6eb-5b32a5082208\") " pod="openstack-kuttl-tests/keystone-bootstrap-8wn9f" Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.640974 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e52ef7fa-31bc-409e-a6eb-5b32a5082208-config-data\") pod \"keystone-bootstrap-8wn9f\" (UID: \"e52ef7fa-31bc-409e-a6eb-5b32a5082208\") " pod="openstack-kuttl-tests/keystone-bootstrap-8wn9f" Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.644492 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e52ef7fa-31bc-409e-a6eb-5b32a5082208-combined-ca-bundle\") pod \"keystone-bootstrap-8wn9f\" (UID: \"e52ef7fa-31bc-409e-a6eb-5b32a5082208\") " pod="openstack-kuttl-tests/keystone-bootstrap-8wn9f" Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.684301 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-rlkfm"] Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.690075 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-rlkfm" Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.691980 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-cinder-dockercfg-zzbgg\"" Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.692264 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-config-data\"" Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.692435 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-scripts\"" Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.704727 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f46e6f04-3459-48b6-9acb-e441d59a9bcd-scripts\") pod \"glance-default-external-api-0\" (UID: \"f46e6f04-3459-48b6-9acb-e441d59a9bcd\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.704783 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f46e6f04-3459-48b6-9acb-e441d59a9bcd-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"f46e6f04-3459-48b6-9acb-e441d59a9bcd\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.704846 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f46e6f04-3459-48b6-9acb-e441d59a9bcd-logs\") pod \"glance-default-external-api-0\" (UID: \"f46e6f04-3459-48b6-9acb-e441d59a9bcd\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.704865 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f46e6f04-3459-48b6-9acb-e441d59a9bcd-config-data\") pod \"glance-default-external-api-0\" (UID: \"f46e6f04-3459-48b6-9acb-e441d59a9bcd\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.704903 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f46e6f04-3459-48b6-9acb-e441d59a9bcd-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"f46e6f04-3459-48b6-9acb-e441d59a9bcd\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.704990 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"glance-default-external-api-0\" (UID: \"f46e6f04-3459-48b6-9acb-e441d59a9bcd\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.705016 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kcjs7\" (UniqueName: \"kubernetes.io/projected/f46e6f04-3459-48b6-9acb-e441d59a9bcd-kube-api-access-kcjs7\") pod \"glance-default-external-api-0\" (UID: \"f46e6f04-3459-48b6-9acb-e441d59a9bcd\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.705043 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/f46e6f04-3459-48b6-9acb-e441d59a9bcd-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"f46e6f04-3459-48b6-9acb-e441d59a9bcd\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.708742 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-gqccg"] Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.722943 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-gqccg" Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.725201 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-config\"" Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.725369 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-neutron-dockercfg-6r2bm\"" Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.725913 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-httpd-config\"" Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.740529 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-rlkfm"] Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.767046 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.780034 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.787660 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-internal-config-data\"" Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.787940 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-internal-svc\"" Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.791433 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-gqccg"] Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.804441 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-8wn9f" Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.806131 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f46e6f04-3459-48b6-9acb-e441d59a9bcd-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"f46e6f04-3459-48b6-9acb-e441d59a9bcd\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.806184 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/ace8fafc-b3ed-4c95-8769-9f226ef3506f-db-sync-config-data\") pod \"cinder-db-sync-rlkfm\" (UID: \"ace8fafc-b3ed-4c95-8769-9f226ef3506f\") " pod="openstack-kuttl-tests/cinder-db-sync-rlkfm" Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.806247 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ql6hb\" (UniqueName: \"kubernetes.io/projected/ace8fafc-b3ed-4c95-8769-9f226ef3506f-kube-api-access-ql6hb\") pod \"cinder-db-sync-rlkfm\" (UID: \"ace8fafc-b3ed-4c95-8769-9f226ef3506f\") " pod="openstack-kuttl-tests/cinder-db-sync-rlkfm" Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.806278 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/ace8fafc-b3ed-4c95-8769-9f226ef3506f-etc-machine-id\") pod \"cinder-db-sync-rlkfm\" (UID: \"ace8fafc-b3ed-4c95-8769-9f226ef3506f\") " pod="openstack-kuttl-tests/cinder-db-sync-rlkfm" Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.806350 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7ghr\" (UniqueName: \"kubernetes.io/projected/f65851de-c7fc-4d33-af00-c0bd4081b4cc-kube-api-access-z7ghr\") pod \"neutron-db-sync-gqccg\" (UID: \"f65851de-c7fc-4d33-af00-c0bd4081b4cc\") " pod="openstack-kuttl-tests/neutron-db-sync-gqccg" Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.806377 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ace8fafc-b3ed-4c95-8769-9f226ef3506f-scripts\") pod \"cinder-db-sync-rlkfm\" (UID: \"ace8fafc-b3ed-4c95-8769-9f226ef3506f\") " pod="openstack-kuttl-tests/cinder-db-sync-rlkfm" Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.806420 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f65851de-c7fc-4d33-af00-c0bd4081b4cc-combined-ca-bundle\") pod \"neutron-db-sync-gqccg\" (UID: \"f65851de-c7fc-4d33-af00-c0bd4081b4cc\") " pod="openstack-kuttl-tests/neutron-db-sync-gqccg" Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.806441 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"glance-default-external-api-0\" (UID: \"f46e6f04-3459-48b6-9acb-e441d59a9bcd\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.806467 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kcjs7\" (UniqueName: \"kubernetes.io/projected/f46e6f04-3459-48b6-9acb-e441d59a9bcd-kube-api-access-kcjs7\") pod \"glance-default-external-api-0\" (UID: \"f46e6f04-3459-48b6-9acb-e441d59a9bcd\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.806518 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/f46e6f04-3459-48b6-9acb-e441d59a9bcd-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"f46e6f04-3459-48b6-9acb-e441d59a9bcd\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.806583 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f46e6f04-3459-48b6-9acb-e441d59a9bcd-scripts\") pod \"glance-default-external-api-0\" (UID: \"f46e6f04-3459-48b6-9acb-e441d59a9bcd\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.806606 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f46e6f04-3459-48b6-9acb-e441d59a9bcd-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"f46e6f04-3459-48b6-9acb-e441d59a9bcd\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.806654 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ace8fafc-b3ed-4c95-8769-9f226ef3506f-combined-ca-bundle\") pod \"cinder-db-sync-rlkfm\" (UID: \"ace8fafc-b3ed-4c95-8769-9f226ef3506f\") " pod="openstack-kuttl-tests/cinder-db-sync-rlkfm" Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.806674 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ace8fafc-b3ed-4c95-8769-9f226ef3506f-config-data\") pod \"cinder-db-sync-rlkfm\" (UID: \"ace8fafc-b3ed-4c95-8769-9f226ef3506f\") " pod="openstack-kuttl-tests/cinder-db-sync-rlkfm" Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.806702 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f65851de-c7fc-4d33-af00-c0bd4081b4cc-config\") pod \"neutron-db-sync-gqccg\" (UID: \"f65851de-c7fc-4d33-af00-c0bd4081b4cc\") " pod="openstack-kuttl-tests/neutron-db-sync-gqccg" Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.806752 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f46e6f04-3459-48b6-9acb-e441d59a9bcd-logs\") pod \"glance-default-external-api-0\" (UID: \"f46e6f04-3459-48b6-9acb-e441d59a9bcd\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.806808 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f46e6f04-3459-48b6-9acb-e441d59a9bcd-config-data\") pod \"glance-default-external-api-0\" (UID: \"f46e6f04-3459-48b6-9acb-e441d59a9bcd\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.810620 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.813437 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f46e6f04-3459-48b6-9acb-e441d59a9bcd-logs\") pod \"glance-default-external-api-0\" (UID: \"f46e6f04-3459-48b6-9acb-e441d59a9bcd\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.813465 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"glance-default-external-api-0\" (UID: \"f46e6f04-3459-48b6-9acb-e441d59a9bcd\") device mount path \"/mnt/openstack/pv13\"" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.813685 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/f46e6f04-3459-48b6-9acb-e441d59a9bcd-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"f46e6f04-3459-48b6-9acb-e441d59a9bcd\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.814031 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f46e6f04-3459-48b6-9acb-e441d59a9bcd-config-data\") pod \"glance-default-external-api-0\" (UID: \"f46e6f04-3459-48b6-9acb-e441d59a9bcd\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.820959 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f46e6f04-3459-48b6-9acb-e441d59a9bcd-scripts\") pod \"glance-default-external-api-0\" (UID: \"f46e6f04-3459-48b6-9acb-e441d59a9bcd\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.835870 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f46e6f04-3459-48b6-9acb-e441d59a9bcd-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"f46e6f04-3459-48b6-9acb-e441d59a9bcd\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.847546 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.882707 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f46e6f04-3459-48b6-9acb-e441d59a9bcd-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"f46e6f04-3459-48b6-9acb-e441d59a9bcd\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.893935 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.901979 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.910705 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ace8fafc-b3ed-4c95-8769-9f226ef3506f-combined-ca-bundle\") pod \"cinder-db-sync-rlkfm\" (UID: \"ace8fafc-b3ed-4c95-8769-9f226ef3506f\") " pod="openstack-kuttl-tests/cinder-db-sync-rlkfm" Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.910776 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ace8fafc-b3ed-4c95-8769-9f226ef3506f-config-data\") pod \"cinder-db-sync-rlkfm\" (UID: \"ace8fafc-b3ed-4c95-8769-9f226ef3506f\") " pod="openstack-kuttl-tests/cinder-db-sync-rlkfm" Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.910812 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f65851de-c7fc-4d33-af00-c0bd4081b4cc-config\") pod \"neutron-db-sync-gqccg\" (UID: \"f65851de-c7fc-4d33-af00-c0bd4081b4cc\") " pod="openstack-kuttl-tests/neutron-db-sync-gqccg" Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.910887 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/ace8fafc-b3ed-4c95-8769-9f226ef3506f-db-sync-config-data\") pod \"cinder-db-sync-rlkfm\" (UID: \"ace8fafc-b3ed-4c95-8769-9f226ef3506f\") " pod="openstack-kuttl-tests/cinder-db-sync-rlkfm" Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.910942 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"glance-default-internal-api-0\" (UID: \"e7aabe11-b85e-4c50-8a22-4c870b52d36f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.910969 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ql6hb\" (UniqueName: \"kubernetes.io/projected/ace8fafc-b3ed-4c95-8769-9f226ef3506f-kube-api-access-ql6hb\") pod \"cinder-db-sync-rlkfm\" (UID: \"ace8fafc-b3ed-4c95-8769-9f226ef3506f\") " pod="openstack-kuttl-tests/cinder-db-sync-rlkfm" Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.911005 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/ace8fafc-b3ed-4c95-8769-9f226ef3506f-etc-machine-id\") pod \"cinder-db-sync-rlkfm\" (UID: \"ace8fafc-b3ed-4c95-8769-9f226ef3506f\") " pod="openstack-kuttl-tests/cinder-db-sync-rlkfm" Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.911042 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z7ghr\" (UniqueName: \"kubernetes.io/projected/f65851de-c7fc-4d33-af00-c0bd4081b4cc-kube-api-access-z7ghr\") pod \"neutron-db-sync-gqccg\" (UID: \"f65851de-c7fc-4d33-af00-c0bd4081b4cc\") " pod="openstack-kuttl-tests/neutron-db-sync-gqccg" Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.911067 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ace8fafc-b3ed-4c95-8769-9f226ef3506f-scripts\") pod \"cinder-db-sync-rlkfm\" (UID: \"ace8fafc-b3ed-4c95-8769-9f226ef3506f\") " pod="openstack-kuttl-tests/cinder-db-sync-rlkfm" Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.911095 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f65851de-c7fc-4d33-af00-c0bd4081b4cc-combined-ca-bundle\") pod \"neutron-db-sync-gqccg\" (UID: \"f65851de-c7fc-4d33-af00-c0bd4081b4cc\") " pod="openstack-kuttl-tests/neutron-db-sync-gqccg" Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.912761 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.917312 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/ace8fafc-b3ed-4c95-8769-9f226ef3506f-etc-machine-id\") pod \"cinder-db-sync-rlkfm\" (UID: \"ace8fafc-b3ed-4c95-8769-9f226ef3506f\") " pod="openstack-kuttl-tests/cinder-db-sync-rlkfm" Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.920944 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/f65851de-c7fc-4d33-af00-c0bd4081b4cc-config\") pod \"neutron-db-sync-gqccg\" (UID: \"f65851de-c7fc-4d33-af00-c0bd4081b4cc\") " pod="openstack-kuttl-tests/neutron-db-sync-gqccg" Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.944276 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ql6hb\" (UniqueName: \"kubernetes.io/projected/ace8fafc-b3ed-4c95-8769-9f226ef3506f-kube-api-access-ql6hb\") pod \"cinder-db-sync-rlkfm\" (UID: \"ace8fafc-b3ed-4c95-8769-9f226ef3506f\") " pod="openstack-kuttl-tests/cinder-db-sync-rlkfm" Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.955222 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7ghr\" (UniqueName: \"kubernetes.io/projected/f65851de-c7fc-4d33-af00-c0bd4081b4cc-kube-api-access-z7ghr\") pod \"neutron-db-sync-gqccg\" (UID: \"f65851de-c7fc-4d33-af00-c0bd4081b4cc\") " pod="openstack-kuttl-tests/neutron-db-sync-gqccg" Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.960085 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ace8fafc-b3ed-4c95-8769-9f226ef3506f-config-data\") pod \"cinder-db-sync-rlkfm\" (UID: \"ace8fafc-b3ed-4c95-8769-9f226ef3506f\") " pod="openstack-kuttl-tests/cinder-db-sync-rlkfm" Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.960134 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ace8fafc-b3ed-4c95-8769-9f226ef3506f-combined-ca-bundle\") pod \"cinder-db-sync-rlkfm\" (UID: \"ace8fafc-b3ed-4c95-8769-9f226ef3506f\") " pod="openstack-kuttl-tests/cinder-db-sync-rlkfm" Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.960917 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f65851de-c7fc-4d33-af00-c0bd4081b4cc-combined-ca-bundle\") pod \"neutron-db-sync-gqccg\" (UID: \"f65851de-c7fc-4d33-af00-c0bd4081b4cc\") " pod="openstack-kuttl-tests/neutron-db-sync-gqccg" Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.961173 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"glance-default-external-api-0\" (UID: \"f46e6f04-3459-48b6-9acb-e441d59a9bcd\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.961519 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/ace8fafc-b3ed-4c95-8769-9f226ef3506f-db-sync-config-data\") pod \"cinder-db-sync-rlkfm\" (UID: \"ace8fafc-b3ed-4c95-8769-9f226ef3506f\") " pod="openstack-kuttl-tests/cinder-db-sync-rlkfm" Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.964639 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kcjs7\" (UniqueName: \"kubernetes.io/projected/f46e6f04-3459-48b6-9acb-e441d59a9bcd-kube-api-access-kcjs7\") pod \"glance-default-external-api-0\" (UID: \"f46e6f04-3459-48b6-9acb-e441d59a9bcd\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:01:47 crc kubenswrapper[5120]: I0316 16:01:47.966894 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ace8fafc-b3ed-4c95-8769-9f226ef3506f-scripts\") pod \"cinder-db-sync-rlkfm\" (UID: \"ace8fafc-b3ed-4c95-8769-9f226ef3506f\") " pod="openstack-kuttl-tests/cinder-db-sync-rlkfm" Mar 16 16:01:48 crc kubenswrapper[5120]: I0316 16:01:48.004926 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:01:48 crc kubenswrapper[5120]: I0316 16:01:48.013718 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"glance-default-internal-api-0\" (UID: \"e7aabe11-b85e-4c50-8a22-4c870b52d36f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:01:48 crc kubenswrapper[5120]: I0316 16:01:48.013997 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e7aabe11-b85e-4c50-8a22-4c870b52d36f-config-data\") pod \"glance-default-internal-api-0\" (UID: \"e7aabe11-b85e-4c50-8a22-4c870b52d36f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:01:48 crc kubenswrapper[5120]: I0316 16:01:48.014098 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxrkm\" (UniqueName: \"kubernetes.io/projected/e7aabe11-b85e-4c50-8a22-4c870b52d36f-kube-api-access-jxrkm\") pod \"glance-default-internal-api-0\" (UID: \"e7aabe11-b85e-4c50-8a22-4c870b52d36f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:01:48 crc kubenswrapper[5120]: I0316 16:01:48.014225 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e7aabe11-b85e-4c50-8a22-4c870b52d36f-logs\") pod \"glance-default-internal-api-0\" (UID: \"e7aabe11-b85e-4c50-8a22-4c870b52d36f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:01:48 crc kubenswrapper[5120]: I0316 16:01:48.014313 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e7aabe11-b85e-4c50-8a22-4c870b52d36f-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"e7aabe11-b85e-4c50-8a22-4c870b52d36f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:01:48 crc kubenswrapper[5120]: I0316 16:01:48.014459 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/e7aabe11-b85e-4c50-8a22-4c870b52d36f-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"e7aabe11-b85e-4c50-8a22-4c870b52d36f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:01:48 crc kubenswrapper[5120]: I0316 16:01:48.014569 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e7aabe11-b85e-4c50-8a22-4c870b52d36f-scripts\") pod \"glance-default-internal-api-0\" (UID: \"e7aabe11-b85e-4c50-8a22-4c870b52d36f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:01:48 crc kubenswrapper[5120]: I0316 16:01:48.014649 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e7aabe11-b85e-4c50-8a22-4c870b52d36f-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"e7aabe11-b85e-4c50-8a22-4c870b52d36f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:01:48 crc kubenswrapper[5120]: I0316 16:01:48.015140 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"glance-default-internal-api-0\" (UID: \"e7aabe11-b85e-4c50-8a22-4c870b52d36f\") device mount path \"/mnt/openstack/pv09\"" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:01:48 crc kubenswrapper[5120]: I0316 16:01:48.017179 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-rlkfm" Mar 16 16:01:48 crc kubenswrapper[5120]: I0316 16:01:48.047621 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"glance-default-internal-api-0\" (UID: \"e7aabe11-b85e-4c50-8a22-4c870b52d36f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:01:48 crc kubenswrapper[5120]: I0316 16:01:48.054217 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-gqccg" Mar 16 16:01:48 crc kubenswrapper[5120]: I0316 16:01:48.099489 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-6x6k9"] Mar 16 16:01:48 crc kubenswrapper[5120]: I0316 16:01:48.105499 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-6x6k9" Mar 16 16:01:48 crc kubenswrapper[5120]: I0316 16:01:48.108178 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-barbican-dockercfg-4t2nh\"" Mar 16 16:01:48 crc kubenswrapper[5120]: I0316 16:01:48.111612 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-config-data\"" Mar 16 16:01:48 crc kubenswrapper[5120]: I0316 16:01:48.119491 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-6x6k9"] Mar 16 16:01:48 crc kubenswrapper[5120]: I0316 16:01:48.120637 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jxrkm\" (UniqueName: \"kubernetes.io/projected/e7aabe11-b85e-4c50-8a22-4c870b52d36f-kube-api-access-jxrkm\") pod \"glance-default-internal-api-0\" (UID: \"e7aabe11-b85e-4c50-8a22-4c870b52d36f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:01:48 crc kubenswrapper[5120]: I0316 16:01:48.120674 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/06bf3ec7-8d8e-4aa6-ada8-7dacc2a00ac5-log-httpd\") pod \"ceilometer-0\" (UID: \"06bf3ec7-8d8e-4aa6-ada8-7dacc2a00ac5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:01:48 crc kubenswrapper[5120]: I0316 16:01:48.120700 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e7aabe11-b85e-4c50-8a22-4c870b52d36f-logs\") pod \"glance-default-internal-api-0\" (UID: \"e7aabe11-b85e-4c50-8a22-4c870b52d36f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:01:48 crc kubenswrapper[5120]: I0316 16:01:48.120730 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e7aabe11-b85e-4c50-8a22-4c870b52d36f-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"e7aabe11-b85e-4c50-8a22-4c870b52d36f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:01:48 crc kubenswrapper[5120]: I0316 16:01:48.120807 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/06bf3ec7-8d8e-4aa6-ada8-7dacc2a00ac5-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"06bf3ec7-8d8e-4aa6-ada8-7dacc2a00ac5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:01:48 crc kubenswrapper[5120]: I0316 16:01:48.120826 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/06bf3ec7-8d8e-4aa6-ada8-7dacc2a00ac5-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"06bf3ec7-8d8e-4aa6-ada8-7dacc2a00ac5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:01:48 crc kubenswrapper[5120]: I0316 16:01:48.120845 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/06bf3ec7-8d8e-4aa6-ada8-7dacc2a00ac5-scripts\") pod \"ceilometer-0\" (UID: \"06bf3ec7-8d8e-4aa6-ada8-7dacc2a00ac5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:01:48 crc kubenswrapper[5120]: I0316 16:01:48.120870 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-st4hc\" (UniqueName: \"kubernetes.io/projected/06bf3ec7-8d8e-4aa6-ada8-7dacc2a00ac5-kube-api-access-st4hc\") pod \"ceilometer-0\" (UID: \"06bf3ec7-8d8e-4aa6-ada8-7dacc2a00ac5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:01:48 crc kubenswrapper[5120]: I0316 16:01:48.120892 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/e7aabe11-b85e-4c50-8a22-4c870b52d36f-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"e7aabe11-b85e-4c50-8a22-4c870b52d36f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:01:48 crc kubenswrapper[5120]: I0316 16:01:48.120910 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e7aabe11-b85e-4c50-8a22-4c870b52d36f-scripts\") pod \"glance-default-internal-api-0\" (UID: \"e7aabe11-b85e-4c50-8a22-4c870b52d36f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:01:48 crc kubenswrapper[5120]: I0316 16:01:48.120936 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e7aabe11-b85e-4c50-8a22-4c870b52d36f-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"e7aabe11-b85e-4c50-8a22-4c870b52d36f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:01:48 crc kubenswrapper[5120]: I0316 16:01:48.121033 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tp4x\" (UniqueName: \"kubernetes.io/projected/4bbb7480-6b4f-4be1-9f89-73d58ebf1184-kube-api-access-8tp4x\") pod \"barbican-db-sync-6x6k9\" (UID: \"4bbb7480-6b4f-4be1-9f89-73d58ebf1184\") " pod="openstack-kuttl-tests/barbican-db-sync-6x6k9" Mar 16 16:01:48 crc kubenswrapper[5120]: I0316 16:01:48.121054 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/06bf3ec7-8d8e-4aa6-ada8-7dacc2a00ac5-run-httpd\") pod \"ceilometer-0\" (UID: \"06bf3ec7-8d8e-4aa6-ada8-7dacc2a00ac5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:01:48 crc kubenswrapper[5120]: I0316 16:01:48.121068 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4bbb7480-6b4f-4be1-9f89-73d58ebf1184-combined-ca-bundle\") pod \"barbican-db-sync-6x6k9\" (UID: \"4bbb7480-6b4f-4be1-9f89-73d58ebf1184\") " pod="openstack-kuttl-tests/barbican-db-sync-6x6k9" Mar 16 16:01:48 crc kubenswrapper[5120]: I0316 16:01:48.121088 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e7aabe11-b85e-4c50-8a22-4c870b52d36f-config-data\") pod \"glance-default-internal-api-0\" (UID: \"e7aabe11-b85e-4c50-8a22-4c870b52d36f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:01:48 crc kubenswrapper[5120]: I0316 16:01:48.121105 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/06bf3ec7-8d8e-4aa6-ada8-7dacc2a00ac5-config-data\") pod \"ceilometer-0\" (UID: \"06bf3ec7-8d8e-4aa6-ada8-7dacc2a00ac5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:01:48 crc kubenswrapper[5120]: I0316 16:01:48.121119 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/4bbb7480-6b4f-4be1-9f89-73d58ebf1184-db-sync-config-data\") pod \"barbican-db-sync-6x6k9\" (UID: \"4bbb7480-6b4f-4be1-9f89-73d58ebf1184\") " pod="openstack-kuttl-tests/barbican-db-sync-6x6k9" Mar 16 16:01:48 crc kubenswrapper[5120]: I0316 16:01:48.122180 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e7aabe11-b85e-4c50-8a22-4c870b52d36f-logs\") pod \"glance-default-internal-api-0\" (UID: \"e7aabe11-b85e-4c50-8a22-4c870b52d36f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:01:48 crc kubenswrapper[5120]: I0316 16:01:48.124361 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/e7aabe11-b85e-4c50-8a22-4c870b52d36f-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"e7aabe11-b85e-4c50-8a22-4c870b52d36f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:01:48 crc kubenswrapper[5120]: I0316 16:01:48.129010 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e7aabe11-b85e-4c50-8a22-4c870b52d36f-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"e7aabe11-b85e-4c50-8a22-4c870b52d36f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:01:48 crc kubenswrapper[5120]: I0316 16:01:48.143608 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e7aabe11-b85e-4c50-8a22-4c870b52d36f-scripts\") pod \"glance-default-internal-api-0\" (UID: \"e7aabe11-b85e-4c50-8a22-4c870b52d36f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:01:48 crc kubenswrapper[5120]: I0316 16:01:48.145168 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-db-sync-znw74"] Mar 16 16:01:48 crc kubenswrapper[5120]: I0316 16:01:48.149793 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e7aabe11-b85e-4c50-8a22-4c870b52d36f-config-data\") pod \"glance-default-internal-api-0\" (UID: \"e7aabe11-b85e-4c50-8a22-4c870b52d36f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:01:48 crc kubenswrapper[5120]: I0316 16:01:48.151065 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e7aabe11-b85e-4c50-8a22-4c870b52d36f-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"e7aabe11-b85e-4c50-8a22-4c870b52d36f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:01:48 crc kubenswrapper[5120]: I0316 16:01:48.159501 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxrkm\" (UniqueName: \"kubernetes.io/projected/e7aabe11-b85e-4c50-8a22-4c870b52d36f-kube-api-access-jxrkm\") pod \"glance-default-internal-api-0\" (UID: \"e7aabe11-b85e-4c50-8a22-4c870b52d36f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:01:48 crc kubenswrapper[5120]: I0316 16:01:48.164467 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-znw74" Mar 16 16:01:48 crc kubenswrapper[5120]: I0316 16:01:48.173084 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-config-data\"" Mar 16 16:01:48 crc kubenswrapper[5120]: I0316 16:01:48.174003 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-znw74"] Mar 16 16:01:48 crc kubenswrapper[5120]: I0316 16:01:48.174478 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-placement-dockercfg-ht8jm\"" Mar 16 16:01:48 crc kubenswrapper[5120]: I0316 16:01:48.171679 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-scripts\"" Mar 16 16:01:48 crc kubenswrapper[5120]: I0316 16:01:48.186255 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:01:48 crc kubenswrapper[5120]: I0316 16:01:48.225422 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68ttz\" (UniqueName: \"kubernetes.io/projected/54c2f552-edbf-47f1-9e7e-2f6ce8099914-kube-api-access-68ttz\") pod \"placement-db-sync-znw74\" (UID: \"54c2f552-edbf-47f1-9e7e-2f6ce8099914\") " pod="openstack-kuttl-tests/placement-db-sync-znw74" Mar 16 16:01:48 crc kubenswrapper[5120]: I0316 16:01:48.225468 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/06bf3ec7-8d8e-4aa6-ada8-7dacc2a00ac5-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"06bf3ec7-8d8e-4aa6-ada8-7dacc2a00ac5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:01:48 crc kubenswrapper[5120]: I0316 16:01:48.225487 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/06bf3ec7-8d8e-4aa6-ada8-7dacc2a00ac5-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"06bf3ec7-8d8e-4aa6-ada8-7dacc2a00ac5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:01:48 crc kubenswrapper[5120]: I0316 16:01:48.225505 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/06bf3ec7-8d8e-4aa6-ada8-7dacc2a00ac5-scripts\") pod \"ceilometer-0\" (UID: \"06bf3ec7-8d8e-4aa6-ada8-7dacc2a00ac5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:01:48 crc kubenswrapper[5120]: I0316 16:01:48.225534 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-st4hc\" (UniqueName: \"kubernetes.io/projected/06bf3ec7-8d8e-4aa6-ada8-7dacc2a00ac5-kube-api-access-st4hc\") pod \"ceilometer-0\" (UID: \"06bf3ec7-8d8e-4aa6-ada8-7dacc2a00ac5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:01:48 crc kubenswrapper[5120]: I0316 16:01:48.225602 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/54c2f552-edbf-47f1-9e7e-2f6ce8099914-scripts\") pod \"placement-db-sync-znw74\" (UID: \"54c2f552-edbf-47f1-9e7e-2f6ce8099914\") " pod="openstack-kuttl-tests/placement-db-sync-znw74" Mar 16 16:01:48 crc kubenswrapper[5120]: I0316 16:01:48.225687 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8tp4x\" (UniqueName: \"kubernetes.io/projected/4bbb7480-6b4f-4be1-9f89-73d58ebf1184-kube-api-access-8tp4x\") pod \"barbican-db-sync-6x6k9\" (UID: \"4bbb7480-6b4f-4be1-9f89-73d58ebf1184\") " pod="openstack-kuttl-tests/barbican-db-sync-6x6k9" Mar 16 16:01:48 crc kubenswrapper[5120]: I0316 16:01:48.225708 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/06bf3ec7-8d8e-4aa6-ada8-7dacc2a00ac5-run-httpd\") pod \"ceilometer-0\" (UID: \"06bf3ec7-8d8e-4aa6-ada8-7dacc2a00ac5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:01:48 crc kubenswrapper[5120]: I0316 16:01:48.225721 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4bbb7480-6b4f-4be1-9f89-73d58ebf1184-combined-ca-bundle\") pod \"barbican-db-sync-6x6k9\" (UID: \"4bbb7480-6b4f-4be1-9f89-73d58ebf1184\") " pod="openstack-kuttl-tests/barbican-db-sync-6x6k9" Mar 16 16:01:48 crc kubenswrapper[5120]: I0316 16:01:48.225739 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/06bf3ec7-8d8e-4aa6-ada8-7dacc2a00ac5-config-data\") pod \"ceilometer-0\" (UID: \"06bf3ec7-8d8e-4aa6-ada8-7dacc2a00ac5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:01:48 crc kubenswrapper[5120]: I0316 16:01:48.225760 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/54c2f552-edbf-47f1-9e7e-2f6ce8099914-config-data\") pod \"placement-db-sync-znw74\" (UID: \"54c2f552-edbf-47f1-9e7e-2f6ce8099914\") " pod="openstack-kuttl-tests/placement-db-sync-znw74" Mar 16 16:01:48 crc kubenswrapper[5120]: I0316 16:01:48.225893 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/4bbb7480-6b4f-4be1-9f89-73d58ebf1184-db-sync-config-data\") pod \"barbican-db-sync-6x6k9\" (UID: \"4bbb7480-6b4f-4be1-9f89-73d58ebf1184\") " pod="openstack-kuttl-tests/barbican-db-sync-6x6k9" Mar 16 16:01:48 crc kubenswrapper[5120]: I0316 16:01:48.225942 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/54c2f552-edbf-47f1-9e7e-2f6ce8099914-logs\") pod \"placement-db-sync-znw74\" (UID: \"54c2f552-edbf-47f1-9e7e-2f6ce8099914\") " pod="openstack-kuttl-tests/placement-db-sync-znw74" Mar 16 16:01:48 crc kubenswrapper[5120]: I0316 16:01:48.225972 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/06bf3ec7-8d8e-4aa6-ada8-7dacc2a00ac5-log-httpd\") pod \"ceilometer-0\" (UID: \"06bf3ec7-8d8e-4aa6-ada8-7dacc2a00ac5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:01:48 crc kubenswrapper[5120]: I0316 16:01:48.226015 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/54c2f552-edbf-47f1-9e7e-2f6ce8099914-combined-ca-bundle\") pod \"placement-db-sync-znw74\" (UID: \"54c2f552-edbf-47f1-9e7e-2f6ce8099914\") " pod="openstack-kuttl-tests/placement-db-sync-znw74" Mar 16 16:01:48 crc kubenswrapper[5120]: I0316 16:01:48.227977 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/06bf3ec7-8d8e-4aa6-ada8-7dacc2a00ac5-log-httpd\") pod \"ceilometer-0\" (UID: \"06bf3ec7-8d8e-4aa6-ada8-7dacc2a00ac5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:01:48 crc kubenswrapper[5120]: I0316 16:01:48.229897 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/06bf3ec7-8d8e-4aa6-ada8-7dacc2a00ac5-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"06bf3ec7-8d8e-4aa6-ada8-7dacc2a00ac5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:01:48 crc kubenswrapper[5120]: I0316 16:01:48.230491 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4bbb7480-6b4f-4be1-9f89-73d58ebf1184-combined-ca-bundle\") pod \"barbican-db-sync-6x6k9\" (UID: \"4bbb7480-6b4f-4be1-9f89-73d58ebf1184\") " pod="openstack-kuttl-tests/barbican-db-sync-6x6k9" Mar 16 16:01:48 crc kubenswrapper[5120]: I0316 16:01:48.232066 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/06bf3ec7-8d8e-4aa6-ada8-7dacc2a00ac5-config-data\") pod \"ceilometer-0\" (UID: \"06bf3ec7-8d8e-4aa6-ada8-7dacc2a00ac5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:01:48 crc kubenswrapper[5120]: I0316 16:01:48.232139 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/06bf3ec7-8d8e-4aa6-ada8-7dacc2a00ac5-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"06bf3ec7-8d8e-4aa6-ada8-7dacc2a00ac5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:01:48 crc kubenswrapper[5120]: I0316 16:01:48.232660 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/06bf3ec7-8d8e-4aa6-ada8-7dacc2a00ac5-run-httpd\") pod \"ceilometer-0\" (UID: \"06bf3ec7-8d8e-4aa6-ada8-7dacc2a00ac5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:01:48 crc kubenswrapper[5120]: I0316 16:01:48.233232 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/06bf3ec7-8d8e-4aa6-ada8-7dacc2a00ac5-scripts\") pod \"ceilometer-0\" (UID: \"06bf3ec7-8d8e-4aa6-ada8-7dacc2a00ac5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:01:48 crc kubenswrapper[5120]: I0316 16:01:48.239475 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/4bbb7480-6b4f-4be1-9f89-73d58ebf1184-db-sync-config-data\") pod \"barbican-db-sync-6x6k9\" (UID: \"4bbb7480-6b4f-4be1-9f89-73d58ebf1184\") " pod="openstack-kuttl-tests/barbican-db-sync-6x6k9" Mar 16 16:01:48 crc kubenswrapper[5120]: I0316 16:01:48.251814 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8tp4x\" (UniqueName: \"kubernetes.io/projected/4bbb7480-6b4f-4be1-9f89-73d58ebf1184-kube-api-access-8tp4x\") pod \"barbican-db-sync-6x6k9\" (UID: \"4bbb7480-6b4f-4be1-9f89-73d58ebf1184\") " pod="openstack-kuttl-tests/barbican-db-sync-6x6k9" Mar 16 16:01:48 crc kubenswrapper[5120]: I0316 16:01:48.257980 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-st4hc\" (UniqueName: \"kubernetes.io/projected/06bf3ec7-8d8e-4aa6-ada8-7dacc2a00ac5-kube-api-access-st4hc\") pod \"ceilometer-0\" (UID: \"06bf3ec7-8d8e-4aa6-ada8-7dacc2a00ac5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:01:48 crc kubenswrapper[5120]: I0316 16:01:48.271142 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:01:48 crc kubenswrapper[5120]: I0316 16:01:48.328116 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/54c2f552-edbf-47f1-9e7e-2f6ce8099914-scripts\") pod \"placement-db-sync-znw74\" (UID: \"54c2f552-edbf-47f1-9e7e-2f6ce8099914\") " pod="openstack-kuttl-tests/placement-db-sync-znw74" Mar 16 16:01:48 crc kubenswrapper[5120]: I0316 16:01:48.328446 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/54c2f552-edbf-47f1-9e7e-2f6ce8099914-config-data\") pod \"placement-db-sync-znw74\" (UID: \"54c2f552-edbf-47f1-9e7e-2f6ce8099914\") " pod="openstack-kuttl-tests/placement-db-sync-znw74" Mar 16 16:01:48 crc kubenswrapper[5120]: I0316 16:01:48.328487 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/54c2f552-edbf-47f1-9e7e-2f6ce8099914-logs\") pod \"placement-db-sync-znw74\" (UID: \"54c2f552-edbf-47f1-9e7e-2f6ce8099914\") " pod="openstack-kuttl-tests/placement-db-sync-znw74" Mar 16 16:01:48 crc kubenswrapper[5120]: I0316 16:01:48.328530 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/54c2f552-edbf-47f1-9e7e-2f6ce8099914-combined-ca-bundle\") pod \"placement-db-sync-znw74\" (UID: \"54c2f552-edbf-47f1-9e7e-2f6ce8099914\") " pod="openstack-kuttl-tests/placement-db-sync-znw74" Mar 16 16:01:48 crc kubenswrapper[5120]: I0316 16:01:48.328565 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-68ttz\" (UniqueName: \"kubernetes.io/projected/54c2f552-edbf-47f1-9e7e-2f6ce8099914-kube-api-access-68ttz\") pod \"placement-db-sync-znw74\" (UID: \"54c2f552-edbf-47f1-9e7e-2f6ce8099914\") " pod="openstack-kuttl-tests/placement-db-sync-znw74" Mar 16 16:01:48 crc kubenswrapper[5120]: I0316 16:01:48.329655 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/54c2f552-edbf-47f1-9e7e-2f6ce8099914-logs\") pod \"placement-db-sync-znw74\" (UID: \"54c2f552-edbf-47f1-9e7e-2f6ce8099914\") " pod="openstack-kuttl-tests/placement-db-sync-znw74" Mar 16 16:01:48 crc kubenswrapper[5120]: I0316 16:01:48.333716 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/54c2f552-edbf-47f1-9e7e-2f6ce8099914-combined-ca-bundle\") pod \"placement-db-sync-znw74\" (UID: \"54c2f552-edbf-47f1-9e7e-2f6ce8099914\") " pod="openstack-kuttl-tests/placement-db-sync-znw74" Mar 16 16:01:48 crc kubenswrapper[5120]: I0316 16:01:48.334183 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/54c2f552-edbf-47f1-9e7e-2f6ce8099914-scripts\") pod \"placement-db-sync-znw74\" (UID: \"54c2f552-edbf-47f1-9e7e-2f6ce8099914\") " pod="openstack-kuttl-tests/placement-db-sync-znw74" Mar 16 16:01:48 crc kubenswrapper[5120]: I0316 16:01:48.334491 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/54c2f552-edbf-47f1-9e7e-2f6ce8099914-config-data\") pod \"placement-db-sync-znw74\" (UID: \"54c2f552-edbf-47f1-9e7e-2f6ce8099914\") " pod="openstack-kuttl-tests/placement-db-sync-znw74" Mar 16 16:01:48 crc kubenswrapper[5120]: I0316 16:01:48.349832 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-68ttz\" (UniqueName: \"kubernetes.io/projected/54c2f552-edbf-47f1-9e7e-2f6ce8099914-kube-api-access-68ttz\") pod \"placement-db-sync-znw74\" (UID: \"54c2f552-edbf-47f1-9e7e-2f6ce8099914\") " pod="openstack-kuttl-tests/placement-db-sync-znw74" Mar 16 16:01:48 crc kubenswrapper[5120]: I0316 16:01:48.400890 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:01:48 crc kubenswrapper[5120]: I0316 16:01:48.443816 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-6x6k9" Mar 16 16:01:48 crc kubenswrapper[5120]: I0316 16:01:48.488428 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-znw74" Mar 16 16:01:48 crc kubenswrapper[5120]: I0316 16:01:48.548867 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-8wn9f"] Mar 16 16:01:48 crc kubenswrapper[5120]: W0316 16:01:48.559897 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode52ef7fa_31bc_409e_a6eb_5b32a5082208.slice/crio-394e9774a09dd4f6ff2c133b3ce4dbf642479e2158ecf4b57d01f79419486617 WatchSource:0}: Error finding container 394e9774a09dd4f6ff2c133b3ce4dbf642479e2158ecf4b57d01f79419486617: Status 404 returned error can't find the container with id 394e9774a09dd4f6ff2c133b3ce4dbf642479e2158ecf4b57d01f79419486617 Mar 16 16:01:48 crc kubenswrapper[5120]: I0316 16:01:48.661448 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:01:48 crc kubenswrapper[5120]: I0316 16:01:48.662351 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-rlkfm"] Mar 16 16:01:48 crc kubenswrapper[5120]: W0316 16:01:48.679933 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podace8fafc_b3ed_4c95_8769_9f226ef3506f.slice/crio-6de290241d4c1ee457ca8a76277acf7682d2d959541a4635de9a26558d3f5aa5 WatchSource:0}: Error finding container 6de290241d4c1ee457ca8a76277acf7682d2d959541a4635de9a26558d3f5aa5: Status 404 returned error can't find the container with id 6de290241d4c1ee457ca8a76277acf7682d2d959541a4635de9a26558d3f5aa5 Mar 16 16:01:48 crc kubenswrapper[5120]: I0316 16:01:48.709609 5120 scope.go:117] "RemoveContainer" containerID="50ce237e06ea88e2febc8f72ff349fb96e88daf1ee42f8733fcc8b3fe8f91846" Mar 16 16:01:48 crc kubenswrapper[5120]: I0316 16:01:48.741083 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-gqccg"] Mar 16 16:01:48 crc kubenswrapper[5120]: I0316 16:01:48.839894 5120 scope.go:117] "RemoveContainer" containerID="21c2cf04a8ade18c800c248f1d46a2a5cf0ae2792ece1e03e9690c6bde3fdd31" Mar 16 16:01:48 crc kubenswrapper[5120]: I0316 16:01:48.918834 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:01:48 crc kubenswrapper[5120]: I0316 16:01:48.933447 5120 scope.go:117] "RemoveContainer" containerID="8f7017b16a14e2106660e7584452d5ced6cfd42eff02469b4ba96b7133dca7fb" Mar 16 16:01:48 crc kubenswrapper[5120]: W0316 16:01:48.939270 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf46e6f04_3459_48b6_9acb_e441d59a9bcd.slice/crio-ffd42bf987a217395c40aea8fb8724eaf3a7f61ed42c35d0bf8bf6bc7e25e881 WatchSource:0}: Error finding container ffd42bf987a217395c40aea8fb8724eaf3a7f61ed42c35d0bf8bf6bc7e25e881: Status 404 returned error can't find the container with id ffd42bf987a217395c40aea8fb8724eaf3a7f61ed42c35d0bf8bf6bc7e25e881 Mar 16 16:01:48 crc kubenswrapper[5120]: I0316 16:01:48.995119 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-gqccg" event={"ID":"f65851de-c7fc-4d33-af00-c0bd4081b4cc","Type":"ContainerStarted","Data":"f192344aa6121d03c20d57b48dc67f75d2997b481433ab05fa5bf927def27e4f"} Mar 16 16:01:49 crc kubenswrapper[5120]: I0316 16:01:49.002593 5120 scope.go:117] "RemoveContainer" containerID="a7fd51f3629a656232cbf77d226f38d5b5486d9e31ce6546c5c48cb6a2240450" Mar 16 16:01:49 crc kubenswrapper[5120]: I0316 16:01:49.003197 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-rlkfm" event={"ID":"ace8fafc-b3ed-4c95-8769-9f226ef3506f","Type":"ContainerStarted","Data":"6de290241d4c1ee457ca8a76277acf7682d2d959541a4635de9a26558d3f5aa5"} Mar 16 16:01:49 crc kubenswrapper[5120]: I0316 16:01:49.017470 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-8wn9f" event={"ID":"e52ef7fa-31bc-409e-a6eb-5b32a5082208","Type":"ContainerStarted","Data":"83d52eae0e241c4594c601b1ef1e637a0cae05c8be254ed7c8590df70de76616"} Mar 16 16:01:49 crc kubenswrapper[5120]: I0316 16:01:49.017528 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-8wn9f" event={"ID":"e52ef7fa-31bc-409e-a6eb-5b32a5082208","Type":"ContainerStarted","Data":"394e9774a09dd4f6ff2c133b3ce4dbf642479e2158ecf4b57d01f79419486617"} Mar 16 16:01:49 crc kubenswrapper[5120]: I0316 16:01:49.020196 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"06bf3ec7-8d8e-4aa6-ada8-7dacc2a00ac5","Type":"ContainerStarted","Data":"83369dca93d66e3b294f1a438d50f3722a8ca879296f04552eda699910458a66"} Mar 16 16:01:49 crc kubenswrapper[5120]: I0316 16:01:49.022153 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"f46e6f04-3459-48b6-9acb-e441d59a9bcd","Type":"ContainerStarted","Data":"ffd42bf987a217395c40aea8fb8724eaf3a7f61ed42c35d0bf8bf6bc7e25e881"} Mar 16 16:01:49 crc kubenswrapper[5120]: I0316 16:01:49.055006 5120 scope.go:117] "RemoveContainer" containerID="b721b97f025f3d84f068611af272c59bad2f5fd660230c1fcc2455e9d90a0192" Mar 16 16:01:49 crc kubenswrapper[5120]: I0316 16:01:49.055839 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-znw74"] Mar 16 16:01:49 crc kubenswrapper[5120]: I0316 16:01:49.058843 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-bootstrap-8wn9f" podStartSLOduration=2.058824464 podStartE2EDuration="2.058824464s" podCreationTimestamp="2026-03-16 16:01:47 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:01:49.033931509 +0000 UTC m=+1811.187863166" watchObservedRunningTime="2026-03-16 16:01:49.058824464 +0000 UTC m=+1811.212756121" Mar 16 16:01:49 crc kubenswrapper[5120]: W0316 16:01:49.062557 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod54c2f552_edbf_47f1_9e7e_2f6ce8099914.slice/crio-97585d814db4832b66057058c75ad67d7e4b173538262aeddb89bec6a1e5e179 WatchSource:0}: Error finding container 97585d814db4832b66057058c75ad67d7e4b173538262aeddb89bec6a1e5e179: Status 404 returned error can't find the container with id 97585d814db4832b66057058c75ad67d7e4b173538262aeddb89bec6a1e5e179 Mar 16 16:01:49 crc kubenswrapper[5120]: W0316 16:01:49.066413 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4bbb7480_6b4f_4be1_9f89_73d58ebf1184.slice/crio-93ffdce207899c015c643decc61aa6fb1f1355caea4ffbcb4353ea000a39bd80 WatchSource:0}: Error finding container 93ffdce207899c015c643decc61aa6fb1f1355caea4ffbcb4353ea000a39bd80: Status 404 returned error can't find the container with id 93ffdce207899c015c643decc61aa6fb1f1355caea4ffbcb4353ea000a39bd80 Mar 16 16:01:49 crc kubenswrapper[5120]: I0316 16:01:49.084649 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-6x6k9"] Mar 16 16:01:49 crc kubenswrapper[5120]: I0316 16:01:49.092273 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:01:49 crc kubenswrapper[5120]: I0316 16:01:49.142438 5120 scope.go:117] "RemoveContainer" containerID="3ed266fb5a6f2a6760ca4563d03638d47c9c0980fa3e22498cea160f6cb29105" Mar 16 16:01:49 crc kubenswrapper[5120]: I0316 16:01:49.246998 5120 scope.go:117] "RemoveContainer" containerID="9a9f520f86e7e6a2f9039e33c7f82866cb9a32ef43b7327f940081c0c0ee97f2" Mar 16 16:01:49 crc kubenswrapper[5120]: I0316 16:01:49.306252 5120 scope.go:117] "RemoveContainer" containerID="8770325da4cfc31ef54b34a5e82ba65617eb8dd3b11ee81083d529c925585f95" Mar 16 16:01:49 crc kubenswrapper[5120]: I0316 16:01:49.386838 5120 scope.go:117] "RemoveContainer" containerID="4d14449b09ee9eb7ab92fa6c7ebd3efd31a2e8f200b67a0d1a63a5598686a60d" Mar 16 16:01:49 crc kubenswrapper[5120]: I0316 16:01:49.459661 5120 scope.go:117] "RemoveContainer" containerID="b8bfaaad691683435144338170552fbffc891d60b767e0b3cbcbf011b8c3019d" Mar 16 16:01:49 crc kubenswrapper[5120]: I0316 16:01:49.749295 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:01:49 crc kubenswrapper[5120]: I0316 16:01:49.794482 5120 scope.go:117] "RemoveContainer" containerID="5ee503ff630324e345a43ee14c47148d1ff922720322c91eb8dbfa52c2461c42" Mar 16 16:01:49 crc kubenswrapper[5120]: I0316 16:01:49.859919 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:01:49 crc kubenswrapper[5120]: I0316 16:01:49.894724 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:01:49 crc kubenswrapper[5120]: I0316 16:01:49.960028 5120 scope.go:117] "RemoveContainer" containerID="6949dd37215d812d404e15a6beac3203cc209a3912b3a974217088bd7e9dcef2" Mar 16 16:01:50 crc kubenswrapper[5120]: I0316 16:01:50.038115 5120 scope.go:117] "RemoveContainer" containerID="a126851b3d7daac11080ae4cc6f484666da78c21af025c9eb08a6db6f6f87ceb" Mar 16 16:01:50 crc kubenswrapper[5120]: I0316 16:01:50.099883 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"06bf3ec7-8d8e-4aa6-ada8-7dacc2a00ac5","Type":"ContainerStarted","Data":"ba8822c1e5c526c89e8ec262b03bae0b25fe9d104568c4cc1009b1ba1476f8b6"} Mar 16 16:01:50 crc kubenswrapper[5120]: I0316 16:01:50.140913 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-6x6k9" event={"ID":"4bbb7480-6b4f-4be1-9f89-73d58ebf1184","Type":"ContainerStarted","Data":"10baea670a97077476383cd124db93cfdc5f80794052434fdcc277de47cd3b97"} Mar 16 16:01:50 crc kubenswrapper[5120]: I0316 16:01:50.141285 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-6x6k9" event={"ID":"4bbb7480-6b4f-4be1-9f89-73d58ebf1184","Type":"ContainerStarted","Data":"93ffdce207899c015c643decc61aa6fb1f1355caea4ffbcb4353ea000a39bd80"} Mar 16 16:01:50 crc kubenswrapper[5120]: I0316 16:01:50.159960 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-db-sync-6x6k9" podStartSLOduration=3.15994331 podStartE2EDuration="3.15994331s" podCreationTimestamp="2026-03-16 16:01:47 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:01:50.157153104 +0000 UTC m=+1812.311084761" watchObservedRunningTime="2026-03-16 16:01:50.15994331 +0000 UTC m=+1812.313874957" Mar 16 16:01:50 crc kubenswrapper[5120]: I0316 16:01:50.165370 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"e7aabe11-b85e-4c50-8a22-4c870b52d36f","Type":"ContainerStarted","Data":"76ddff041f692a92151e13aaa7af0d98f27720e3b45e0b439c2aa54ab62b8485"} Mar 16 16:01:50 crc kubenswrapper[5120]: I0316 16:01:50.209876 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-gqccg" event={"ID":"f65851de-c7fc-4d33-af00-c0bd4081b4cc","Type":"ContainerStarted","Data":"786c94e304b470f789693f51f55f154d8a32456e15f398d7e70a8d0aa150ce38"} Mar 16 16:01:50 crc kubenswrapper[5120]: I0316 16:01:50.230297 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-db-sync-gqccg" podStartSLOduration=3.230280406 podStartE2EDuration="3.230280406s" podCreationTimestamp="2026-03-16 16:01:47 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:01:50.229318209 +0000 UTC m=+1812.383249876" watchObservedRunningTime="2026-03-16 16:01:50.230280406 +0000 UTC m=+1812.384212063" Mar 16 16:01:50 crc kubenswrapper[5120]: I0316 16:01:50.250115 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-znw74" event={"ID":"54c2f552-edbf-47f1-9e7e-2f6ce8099914","Type":"ContainerStarted","Data":"38f10edbc59577636e63ddd998d2af67bcd6eec978d300e177c41f50ecfff93c"} Mar 16 16:01:50 crc kubenswrapper[5120]: I0316 16:01:50.250179 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-znw74" event={"ID":"54c2f552-edbf-47f1-9e7e-2f6ce8099914","Type":"ContainerStarted","Data":"97585d814db4832b66057058c75ad67d7e4b173538262aeddb89bec6a1e5e179"} Mar 16 16:01:50 crc kubenswrapper[5120]: I0316 16:01:50.271368 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-rlkfm" event={"ID":"ace8fafc-b3ed-4c95-8769-9f226ef3506f","Type":"ContainerStarted","Data":"4be499829974498a3593cb68f355bd6ce58f7cff3d72a82bc9ff36b4e8bf6444"} Mar 16 16:01:50 crc kubenswrapper[5120]: I0316 16:01:50.284145 5120 scope.go:117] "RemoveContainer" containerID="93b627b9e4f29941a82f65cb8de202758a5194eb502d1f4dc890c1348701d3e2" Mar 16 16:01:50 crc kubenswrapper[5120]: I0316 16:01:50.310912 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-db-sync-znw74" podStartSLOduration=3.310893504 podStartE2EDuration="3.310893504s" podCreationTimestamp="2026-03-16 16:01:47 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:01:50.265073044 +0000 UTC m=+1812.419004701" watchObservedRunningTime="2026-03-16 16:01:50.310893504 +0000 UTC m=+1812.464825161" Mar 16 16:01:50 crc kubenswrapper[5120]: I0316 16:01:50.350748 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-db-sync-rlkfm" podStartSLOduration=3.350729531 podStartE2EDuration="3.350729531s" podCreationTimestamp="2026-03-16 16:01:47 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:01:50.284695774 +0000 UTC m=+1812.438627431" watchObservedRunningTime="2026-03-16 16:01:50.350729531 +0000 UTC m=+1812.504661188" Mar 16 16:01:50 crc kubenswrapper[5120]: I0316 16:01:50.398522 5120 scope.go:117] "RemoveContainer" containerID="8270c8dbc1b11e5b7213c6bc268f6c1f595833d463314384be040bcec0901608" Mar 16 16:01:50 crc kubenswrapper[5120]: I0316 16:01:50.461940 5120 scope.go:117] "RemoveContainer" containerID="3026ec7ccdb6e6811a15f6715c0a43c75f13ab0bdbd3560dd6ede95efc448c54" Mar 16 16:01:50 crc kubenswrapper[5120]: I0316 16:01:50.510553 5120 scope.go:117] "RemoveContainer" containerID="4a996f5f48bf60bbfc7b1381fa4b67dcccf4a1e706c124ab891f58be4c3e6342" Mar 16 16:01:50 crc kubenswrapper[5120]: I0316 16:01:50.563106 5120 scope.go:117] "RemoveContainer" containerID="8e6f8366d74fb157d8fdc1c1ae6c9db0eb8bce126c29574e00b155c9de9cbfa6" Mar 16 16:01:50 crc kubenswrapper[5120]: I0316 16:01:50.697332 5120 scope.go:117] "RemoveContainer" containerID="02ba4fc3f84eccaecfa9e6618280f65626eb76580c4af9ae7a9d7cb3b8dd590b" Mar 16 16:01:50 crc kubenswrapper[5120]: E0316 16:01:50.697676 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:01:50 crc kubenswrapper[5120]: I0316 16:01:50.699620 5120 scope.go:117] "RemoveContainer" containerID="288df941b6fe0e50eae8b8edf10eed8e23a402d743bf6d322c0b16385323751d" Mar 16 16:01:50 crc kubenswrapper[5120]: I0316 16:01:50.763316 5120 scope.go:117] "RemoveContainer" containerID="66eba927cd30e037dd7a7abcb37be936bc003239534927b6193e4055329f407e" Mar 16 16:01:50 crc kubenswrapper[5120]: I0316 16:01:50.810211 5120 scope.go:117] "RemoveContainer" containerID="03426e9d23e26f23f7d0a18b7532a8972a451da3596cf94f5f2146602b0aa95d" Mar 16 16:01:50 crc kubenswrapper[5120]: I0316 16:01:50.882074 5120 scope.go:117] "RemoveContainer" containerID="311b617b110ca81a6d9b239342d494d0847ab7ce54905dea2970c029e96282f3" Mar 16 16:01:51 crc kubenswrapper[5120]: I0316 16:01:51.306511 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"06bf3ec7-8d8e-4aa6-ada8-7dacc2a00ac5","Type":"ContainerStarted","Data":"caab9dc32ec71c38eb04a128f0392de356d59dff568805b1d8e7c70f3517d52e"} Mar 16 16:01:51 crc kubenswrapper[5120]: I0316 16:01:51.312209 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"f46e6f04-3459-48b6-9acb-e441d59a9bcd","Type":"ContainerStarted","Data":"faeab1002bab7ac5c674239cc611307b7b2aa3e84e7b656d901ce77e44e13ee7"} Mar 16 16:01:51 crc kubenswrapper[5120]: I0316 16:01:51.312356 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="f46e6f04-3459-48b6-9acb-e441d59a9bcd" containerName="glance-log" containerID="cri-o://faeab1002bab7ac5c674239cc611307b7b2aa3e84e7b656d901ce77e44e13ee7" gracePeriod=30 Mar 16 16:01:51 crc kubenswrapper[5120]: I0316 16:01:51.312733 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="f46e6f04-3459-48b6-9acb-e441d59a9bcd" containerName="glance-httpd" containerID="cri-o://3f8d1104dac8d3449b60f0213e012ff9d43e3aa6cb6e9f1389af517584f0d1df" gracePeriod=30 Mar 16 16:01:51 crc kubenswrapper[5120]: I0316 16:01:51.317834 5120 generic.go:358] "Generic (PLEG): container finished" podID="4bbb7480-6b4f-4be1-9f89-73d58ebf1184" containerID="10baea670a97077476383cd124db93cfdc5f80794052434fdcc277de47cd3b97" exitCode=0 Mar 16 16:01:51 crc kubenswrapper[5120]: I0316 16:01:51.317939 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-6x6k9" event={"ID":"4bbb7480-6b4f-4be1-9f89-73d58ebf1184","Type":"ContainerDied","Data":"10baea670a97077476383cd124db93cfdc5f80794052434fdcc277de47cd3b97"} Mar 16 16:01:51 crc kubenswrapper[5120]: I0316 16:01:51.324824 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"e7aabe11-b85e-4c50-8a22-4c870b52d36f","Type":"ContainerStarted","Data":"29e380e4c79dc24b62582b1113575607810252d7d8fd2977aa971954e4ba657f"} Mar 16 16:01:51 crc kubenswrapper[5120]: I0316 16:01:51.339676 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-external-api-0" podStartSLOduration=4.339653339 podStartE2EDuration="4.339653339s" podCreationTimestamp="2026-03-16 16:01:47 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:01:51.333592192 +0000 UTC m=+1813.487523849" watchObservedRunningTime="2026-03-16 16:01:51.339653339 +0000 UTC m=+1813.493584996" Mar 16 16:01:51 crc kubenswrapper[5120]: I0316 16:01:51.340625 5120 generic.go:358] "Generic (PLEG): container finished" podID="54c2f552-edbf-47f1-9e7e-2f6ce8099914" containerID="38f10edbc59577636e63ddd998d2af67bcd6eec978d300e177c41f50ecfff93c" exitCode=0 Mar 16 16:01:51 crc kubenswrapper[5120]: I0316 16:01:51.341047 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-znw74" event={"ID":"54c2f552-edbf-47f1-9e7e-2f6ce8099914","Type":"ContainerDied","Data":"38f10edbc59577636e63ddd998d2af67bcd6eec978d300e177c41f50ecfff93c"} Mar 16 16:01:52 crc kubenswrapper[5120]: I0316 16:01:52.207396 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:01:52 crc kubenswrapper[5120]: I0316 16:01:52.274174 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f46e6f04-3459-48b6-9acb-e441d59a9bcd-combined-ca-bundle\") pod \"f46e6f04-3459-48b6-9acb-e441d59a9bcd\" (UID: \"f46e6f04-3459-48b6-9acb-e441d59a9bcd\") " Mar 16 16:01:52 crc kubenswrapper[5120]: I0316 16:01:52.274313 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/f46e6f04-3459-48b6-9acb-e441d59a9bcd-httpd-run\") pod \"f46e6f04-3459-48b6-9acb-e441d59a9bcd\" (UID: \"f46e6f04-3459-48b6-9acb-e441d59a9bcd\") " Mar 16 16:01:52 crc kubenswrapper[5120]: I0316 16:01:52.274404 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f46e6f04-3459-48b6-9acb-e441d59a9bcd-public-tls-certs\") pod \"f46e6f04-3459-48b6-9acb-e441d59a9bcd\" (UID: \"f46e6f04-3459-48b6-9acb-e441d59a9bcd\") " Mar 16 16:01:52 crc kubenswrapper[5120]: I0316 16:01:52.274480 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"f46e6f04-3459-48b6-9acb-e441d59a9bcd\" (UID: \"f46e6f04-3459-48b6-9acb-e441d59a9bcd\") " Mar 16 16:01:52 crc kubenswrapper[5120]: I0316 16:01:52.274529 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f46e6f04-3459-48b6-9acb-e441d59a9bcd-scripts\") pod \"f46e6f04-3459-48b6-9acb-e441d59a9bcd\" (UID: \"f46e6f04-3459-48b6-9acb-e441d59a9bcd\") " Mar 16 16:01:52 crc kubenswrapper[5120]: I0316 16:01:52.274555 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f46e6f04-3459-48b6-9acb-e441d59a9bcd-logs\") pod \"f46e6f04-3459-48b6-9acb-e441d59a9bcd\" (UID: \"f46e6f04-3459-48b6-9acb-e441d59a9bcd\") " Mar 16 16:01:52 crc kubenswrapper[5120]: I0316 16:01:52.274604 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kcjs7\" (UniqueName: \"kubernetes.io/projected/f46e6f04-3459-48b6-9acb-e441d59a9bcd-kube-api-access-kcjs7\") pod \"f46e6f04-3459-48b6-9acb-e441d59a9bcd\" (UID: \"f46e6f04-3459-48b6-9acb-e441d59a9bcd\") " Mar 16 16:01:52 crc kubenswrapper[5120]: I0316 16:01:52.274672 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f46e6f04-3459-48b6-9acb-e441d59a9bcd-config-data\") pod \"f46e6f04-3459-48b6-9acb-e441d59a9bcd\" (UID: \"f46e6f04-3459-48b6-9acb-e441d59a9bcd\") " Mar 16 16:01:52 crc kubenswrapper[5120]: I0316 16:01:52.274776 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f46e6f04-3459-48b6-9acb-e441d59a9bcd-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "f46e6f04-3459-48b6-9acb-e441d59a9bcd" (UID: "f46e6f04-3459-48b6-9acb-e441d59a9bcd"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:01:52 crc kubenswrapper[5120]: I0316 16:01:52.275098 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f46e6f04-3459-48b6-9acb-e441d59a9bcd-logs" (OuterVolumeSpecName: "logs") pod "f46e6f04-3459-48b6-9acb-e441d59a9bcd" (UID: "f46e6f04-3459-48b6-9acb-e441d59a9bcd"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:01:52 crc kubenswrapper[5120]: I0316 16:01:52.275533 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/f46e6f04-3459-48b6-9acb-e441d59a9bcd-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 16:01:52 crc kubenswrapper[5120]: I0316 16:01:52.275560 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f46e6f04-3459-48b6-9acb-e441d59a9bcd-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:01:52 crc kubenswrapper[5120]: I0316 16:01:52.287384 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f46e6f04-3459-48b6-9acb-e441d59a9bcd-kube-api-access-kcjs7" (OuterVolumeSpecName: "kube-api-access-kcjs7") pod "f46e6f04-3459-48b6-9acb-e441d59a9bcd" (UID: "f46e6f04-3459-48b6-9acb-e441d59a9bcd"). InnerVolumeSpecName "kube-api-access-kcjs7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:01:52 crc kubenswrapper[5120]: I0316 16:01:52.292610 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage13-crc" (OuterVolumeSpecName: "glance") pod "f46e6f04-3459-48b6-9acb-e441d59a9bcd" (UID: "f46e6f04-3459-48b6-9acb-e441d59a9bcd"). InnerVolumeSpecName "local-storage13-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:01:52 crc kubenswrapper[5120]: I0316 16:01:52.301553 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f46e6f04-3459-48b6-9acb-e441d59a9bcd-scripts" (OuterVolumeSpecName: "scripts") pod "f46e6f04-3459-48b6-9acb-e441d59a9bcd" (UID: "f46e6f04-3459-48b6-9acb-e441d59a9bcd"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:01:52 crc kubenswrapper[5120]: I0316 16:01:52.306436 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f46e6f04-3459-48b6-9acb-e441d59a9bcd-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f46e6f04-3459-48b6-9acb-e441d59a9bcd" (UID: "f46e6f04-3459-48b6-9acb-e441d59a9bcd"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:01:52 crc kubenswrapper[5120]: I0316 16:01:52.341532 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f46e6f04-3459-48b6-9acb-e441d59a9bcd-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "f46e6f04-3459-48b6-9acb-e441d59a9bcd" (UID: "f46e6f04-3459-48b6-9acb-e441d59a9bcd"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:01:52 crc kubenswrapper[5120]: I0316 16:01:52.343917 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f46e6f04-3459-48b6-9acb-e441d59a9bcd-config-data" (OuterVolumeSpecName: "config-data") pod "f46e6f04-3459-48b6-9acb-e441d59a9bcd" (UID: "f46e6f04-3459-48b6-9acb-e441d59a9bcd"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:01:52 crc kubenswrapper[5120]: I0316 16:01:52.351876 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"06bf3ec7-8d8e-4aa6-ada8-7dacc2a00ac5","Type":"ContainerStarted","Data":"4f9933f0daef80d09ebbf95a1683b8eec46685f9bd6ae3ca379fda90092a37d2"} Mar 16 16:01:52 crc kubenswrapper[5120]: I0316 16:01:52.354711 5120 generic.go:358] "Generic (PLEG): container finished" podID="f46e6f04-3459-48b6-9acb-e441d59a9bcd" containerID="3f8d1104dac8d3449b60f0213e012ff9d43e3aa6cb6e9f1389af517584f0d1df" exitCode=143 Mar 16 16:01:52 crc kubenswrapper[5120]: I0316 16:01:52.354738 5120 generic.go:358] "Generic (PLEG): container finished" podID="f46e6f04-3459-48b6-9acb-e441d59a9bcd" containerID="faeab1002bab7ac5c674239cc611307b7b2aa3e84e7b656d901ce77e44e13ee7" exitCode=143 Mar 16 16:01:52 crc kubenswrapper[5120]: I0316 16:01:52.354855 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:01:52 crc kubenswrapper[5120]: I0316 16:01:52.354854 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"f46e6f04-3459-48b6-9acb-e441d59a9bcd","Type":"ContainerDied","Data":"3f8d1104dac8d3449b60f0213e012ff9d43e3aa6cb6e9f1389af517584f0d1df"} Mar 16 16:01:52 crc kubenswrapper[5120]: I0316 16:01:52.354991 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"f46e6f04-3459-48b6-9acb-e441d59a9bcd","Type":"ContainerDied","Data":"faeab1002bab7ac5c674239cc611307b7b2aa3e84e7b656d901ce77e44e13ee7"} Mar 16 16:01:52 crc kubenswrapper[5120]: I0316 16:01:52.355008 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"f46e6f04-3459-48b6-9acb-e441d59a9bcd","Type":"ContainerDied","Data":"ffd42bf987a217395c40aea8fb8724eaf3a7f61ed42c35d0bf8bf6bc7e25e881"} Mar 16 16:01:52 crc kubenswrapper[5120]: I0316 16:01:52.355026 5120 scope.go:117] "RemoveContainer" containerID="3f8d1104dac8d3449b60f0213e012ff9d43e3aa6cb6e9f1389af517584f0d1df" Mar 16 16:01:52 crc kubenswrapper[5120]: I0316 16:01:52.358231 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="e7aabe11-b85e-4c50-8a22-4c870b52d36f" containerName="glance-log" containerID="cri-o://29e380e4c79dc24b62582b1113575607810252d7d8fd2977aa971954e4ba657f" gracePeriod=30 Mar 16 16:01:52 crc kubenswrapper[5120]: I0316 16:01:52.358341 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="e7aabe11-b85e-4c50-8a22-4c870b52d36f" containerName="glance-httpd" containerID="cri-o://95e4cafa411ae2949f0e071b609450791bc5d914450333fe6b39639453289a16" gracePeriod=30 Mar 16 16:01:52 crc kubenswrapper[5120]: I0316 16:01:52.358232 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"e7aabe11-b85e-4c50-8a22-4c870b52d36f","Type":"ContainerStarted","Data":"95e4cafa411ae2949f0e071b609450791bc5d914450333fe6b39639453289a16"} Mar 16 16:01:52 crc kubenswrapper[5120]: I0316 16:01:52.378286 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f46e6f04-3459-48b6-9acb-e441d59a9bcd-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:01:52 crc kubenswrapper[5120]: I0316 16:01:52.378335 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f46e6f04-3459-48b6-9acb-e441d59a9bcd-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:01:52 crc kubenswrapper[5120]: I0316 16:01:52.378382 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") on node \"crc\" " Mar 16 16:01:52 crc kubenswrapper[5120]: I0316 16:01:52.378396 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f46e6f04-3459-48b6-9acb-e441d59a9bcd-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:01:52 crc kubenswrapper[5120]: I0316 16:01:52.378409 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kcjs7\" (UniqueName: \"kubernetes.io/projected/f46e6f04-3459-48b6-9acb-e441d59a9bcd-kube-api-access-kcjs7\") on node \"crc\" DevicePath \"\"" Mar 16 16:01:52 crc kubenswrapper[5120]: I0316 16:01:52.378419 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f46e6f04-3459-48b6-9acb-e441d59a9bcd-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:01:52 crc kubenswrapper[5120]: I0316 16:01:52.402905 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-internal-api-0" podStartSLOduration=5.402878181 podStartE2EDuration="5.402878181s" podCreationTimestamp="2026-03-16 16:01:47 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:01:52.387876829 +0000 UTC m=+1814.541808486" watchObservedRunningTime="2026-03-16 16:01:52.402878181 +0000 UTC m=+1814.556809838" Mar 16 16:01:52 crc kubenswrapper[5120]: I0316 16:01:52.410782 5120 scope.go:117] "RemoveContainer" containerID="faeab1002bab7ac5c674239cc611307b7b2aa3e84e7b656d901ce77e44e13ee7" Mar 16 16:01:52 crc kubenswrapper[5120]: I0316 16:01:52.426100 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:01:52 crc kubenswrapper[5120]: I0316 16:01:52.440008 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage13-crc" (UniqueName: "kubernetes.io/local-volume/local-storage13-crc") on node "crc" Mar 16 16:01:52 crc kubenswrapper[5120]: I0316 16:01:52.450379 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:01:52 crc kubenswrapper[5120]: I0316 16:01:52.455033 5120 scope.go:117] "RemoveContainer" containerID="3f8d1104dac8d3449b60f0213e012ff9d43e3aa6cb6e9f1389af517584f0d1df" Mar 16 16:01:52 crc kubenswrapper[5120]: E0316 16:01:52.455879 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f8d1104dac8d3449b60f0213e012ff9d43e3aa6cb6e9f1389af517584f0d1df\": container with ID starting with 3f8d1104dac8d3449b60f0213e012ff9d43e3aa6cb6e9f1389af517584f0d1df not found: ID does not exist" containerID="3f8d1104dac8d3449b60f0213e012ff9d43e3aa6cb6e9f1389af517584f0d1df" Mar 16 16:01:52 crc kubenswrapper[5120]: I0316 16:01:52.455932 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f8d1104dac8d3449b60f0213e012ff9d43e3aa6cb6e9f1389af517584f0d1df"} err="failed to get container status \"3f8d1104dac8d3449b60f0213e012ff9d43e3aa6cb6e9f1389af517584f0d1df\": rpc error: code = NotFound desc = could not find container \"3f8d1104dac8d3449b60f0213e012ff9d43e3aa6cb6e9f1389af517584f0d1df\": container with ID starting with 3f8d1104dac8d3449b60f0213e012ff9d43e3aa6cb6e9f1389af517584f0d1df not found: ID does not exist" Mar 16 16:01:52 crc kubenswrapper[5120]: I0316 16:01:52.455954 5120 scope.go:117] "RemoveContainer" containerID="faeab1002bab7ac5c674239cc611307b7b2aa3e84e7b656d901ce77e44e13ee7" Mar 16 16:01:52 crc kubenswrapper[5120]: E0316 16:01:52.456249 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"faeab1002bab7ac5c674239cc611307b7b2aa3e84e7b656d901ce77e44e13ee7\": container with ID starting with faeab1002bab7ac5c674239cc611307b7b2aa3e84e7b656d901ce77e44e13ee7 not found: ID does not exist" containerID="faeab1002bab7ac5c674239cc611307b7b2aa3e84e7b656d901ce77e44e13ee7" Mar 16 16:01:52 crc kubenswrapper[5120]: I0316 16:01:52.456270 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"faeab1002bab7ac5c674239cc611307b7b2aa3e84e7b656d901ce77e44e13ee7"} err="failed to get container status \"faeab1002bab7ac5c674239cc611307b7b2aa3e84e7b656d901ce77e44e13ee7\": rpc error: code = NotFound desc = could not find container \"faeab1002bab7ac5c674239cc611307b7b2aa3e84e7b656d901ce77e44e13ee7\": container with ID starting with faeab1002bab7ac5c674239cc611307b7b2aa3e84e7b656d901ce77e44e13ee7 not found: ID does not exist" Mar 16 16:01:52 crc kubenswrapper[5120]: I0316 16:01:52.456282 5120 scope.go:117] "RemoveContainer" containerID="3f8d1104dac8d3449b60f0213e012ff9d43e3aa6cb6e9f1389af517584f0d1df" Mar 16 16:01:52 crc kubenswrapper[5120]: I0316 16:01:52.456517 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f8d1104dac8d3449b60f0213e012ff9d43e3aa6cb6e9f1389af517584f0d1df"} err="failed to get container status \"3f8d1104dac8d3449b60f0213e012ff9d43e3aa6cb6e9f1389af517584f0d1df\": rpc error: code = NotFound desc = could not find container \"3f8d1104dac8d3449b60f0213e012ff9d43e3aa6cb6e9f1389af517584f0d1df\": container with ID starting with 3f8d1104dac8d3449b60f0213e012ff9d43e3aa6cb6e9f1389af517584f0d1df not found: ID does not exist" Mar 16 16:01:52 crc kubenswrapper[5120]: I0316 16:01:52.456536 5120 scope.go:117] "RemoveContainer" containerID="faeab1002bab7ac5c674239cc611307b7b2aa3e84e7b656d901ce77e44e13ee7" Mar 16 16:01:52 crc kubenswrapper[5120]: I0316 16:01:52.460868 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"faeab1002bab7ac5c674239cc611307b7b2aa3e84e7b656d901ce77e44e13ee7"} err="failed to get container status \"faeab1002bab7ac5c674239cc611307b7b2aa3e84e7b656d901ce77e44e13ee7\": rpc error: code = NotFound desc = could not find container \"faeab1002bab7ac5c674239cc611307b7b2aa3e84e7b656d901ce77e44e13ee7\": container with ID starting with faeab1002bab7ac5c674239cc611307b7b2aa3e84e7b656d901ce77e44e13ee7 not found: ID does not exist" Mar 16 16:01:52 crc kubenswrapper[5120]: I0316 16:01:52.474386 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:01:52 crc kubenswrapper[5120]: I0316 16:01:52.475618 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f46e6f04-3459-48b6-9acb-e441d59a9bcd" containerName="glance-log" Mar 16 16:01:52 crc kubenswrapper[5120]: I0316 16:01:52.475641 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f46e6f04-3459-48b6-9acb-e441d59a9bcd" containerName="glance-log" Mar 16 16:01:52 crc kubenswrapper[5120]: I0316 16:01:52.475656 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f46e6f04-3459-48b6-9acb-e441d59a9bcd" containerName="glance-httpd" Mar 16 16:01:52 crc kubenswrapper[5120]: I0316 16:01:52.475663 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f46e6f04-3459-48b6-9acb-e441d59a9bcd" containerName="glance-httpd" Mar 16 16:01:52 crc kubenswrapper[5120]: I0316 16:01:52.475967 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f46e6f04-3459-48b6-9acb-e441d59a9bcd" containerName="glance-log" Mar 16 16:01:52 crc kubenswrapper[5120]: I0316 16:01:52.475992 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f46e6f04-3459-48b6-9acb-e441d59a9bcd" containerName="glance-httpd" Mar 16 16:01:52 crc kubenswrapper[5120]: I0316 16:01:52.480070 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:01:52 crc kubenswrapper[5120]: I0316 16:01:52.489690 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:01:52 crc kubenswrapper[5120]: I0316 16:01:52.491650 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:01:52 crc kubenswrapper[5120]: I0316 16:01:52.498341 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-external-config-data\"" Mar 16 16:01:52 crc kubenswrapper[5120]: I0316 16:01:52.499046 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-public-svc\"" Mar 16 16:01:52 crc kubenswrapper[5120]: I0316 16:01:52.581583 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/97c05f77-d695-4853-acb9-05388320db3b-logs\") pod \"glance-default-external-api-0\" (UID: \"97c05f77-d695-4853-acb9-05388320db3b\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:01:52 crc kubenswrapper[5120]: I0316 16:01:52.581656 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/97c05f77-d695-4853-acb9-05388320db3b-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"97c05f77-d695-4853-acb9-05388320db3b\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:01:52 crc kubenswrapper[5120]: I0316 16:01:52.581699 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"glance-default-external-api-0\" (UID: \"97c05f77-d695-4853-acb9-05388320db3b\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:01:52 crc kubenswrapper[5120]: I0316 16:01:52.581805 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/97c05f77-d695-4853-acb9-05388320db3b-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"97c05f77-d695-4853-acb9-05388320db3b\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:01:52 crc kubenswrapper[5120]: I0316 16:01:52.581844 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9xzj\" (UniqueName: \"kubernetes.io/projected/97c05f77-d695-4853-acb9-05388320db3b-kube-api-access-v9xzj\") pod \"glance-default-external-api-0\" (UID: \"97c05f77-d695-4853-acb9-05388320db3b\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:01:52 crc kubenswrapper[5120]: I0316 16:01:52.581888 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/97c05f77-d695-4853-acb9-05388320db3b-config-data\") pod \"glance-default-external-api-0\" (UID: \"97c05f77-d695-4853-acb9-05388320db3b\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:01:52 crc kubenswrapper[5120]: I0316 16:01:52.581926 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/97c05f77-d695-4853-acb9-05388320db3b-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"97c05f77-d695-4853-acb9-05388320db3b\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:01:52 crc kubenswrapper[5120]: I0316 16:01:52.581968 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/97c05f77-d695-4853-acb9-05388320db3b-scripts\") pod \"glance-default-external-api-0\" (UID: \"97c05f77-d695-4853-acb9-05388320db3b\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:01:52 crc kubenswrapper[5120]: I0316 16:01:52.675527 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f46e6f04-3459-48b6-9acb-e441d59a9bcd" path="/var/lib/kubelet/pods/f46e6f04-3459-48b6-9acb-e441d59a9bcd/volumes" Mar 16 16:01:52 crc kubenswrapper[5120]: I0316 16:01:52.684582 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v9xzj\" (UniqueName: \"kubernetes.io/projected/97c05f77-d695-4853-acb9-05388320db3b-kube-api-access-v9xzj\") pod \"glance-default-external-api-0\" (UID: \"97c05f77-d695-4853-acb9-05388320db3b\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:01:52 crc kubenswrapper[5120]: I0316 16:01:52.684672 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/97c05f77-d695-4853-acb9-05388320db3b-config-data\") pod \"glance-default-external-api-0\" (UID: \"97c05f77-d695-4853-acb9-05388320db3b\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:01:52 crc kubenswrapper[5120]: I0316 16:01:52.684706 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/97c05f77-d695-4853-acb9-05388320db3b-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"97c05f77-d695-4853-acb9-05388320db3b\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:01:52 crc kubenswrapper[5120]: I0316 16:01:52.684743 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/97c05f77-d695-4853-acb9-05388320db3b-scripts\") pod \"glance-default-external-api-0\" (UID: \"97c05f77-d695-4853-acb9-05388320db3b\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:01:52 crc kubenswrapper[5120]: I0316 16:01:52.684884 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/97c05f77-d695-4853-acb9-05388320db3b-logs\") pod \"glance-default-external-api-0\" (UID: \"97c05f77-d695-4853-acb9-05388320db3b\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:01:52 crc kubenswrapper[5120]: I0316 16:01:52.684946 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/97c05f77-d695-4853-acb9-05388320db3b-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"97c05f77-d695-4853-acb9-05388320db3b\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:01:52 crc kubenswrapper[5120]: I0316 16:01:52.684976 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"glance-default-external-api-0\" (UID: \"97c05f77-d695-4853-acb9-05388320db3b\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:01:52 crc kubenswrapper[5120]: I0316 16:01:52.685167 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/97c05f77-d695-4853-acb9-05388320db3b-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"97c05f77-d695-4853-acb9-05388320db3b\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:01:52 crc kubenswrapper[5120]: I0316 16:01:52.685820 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/97c05f77-d695-4853-acb9-05388320db3b-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"97c05f77-d695-4853-acb9-05388320db3b\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:01:52 crc kubenswrapper[5120]: I0316 16:01:52.686118 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/97c05f77-d695-4853-acb9-05388320db3b-logs\") pod \"glance-default-external-api-0\" (UID: \"97c05f77-d695-4853-acb9-05388320db3b\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:01:52 crc kubenswrapper[5120]: I0316 16:01:52.687316 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"glance-default-external-api-0\" (UID: \"97c05f77-d695-4853-acb9-05388320db3b\") device mount path \"/mnt/openstack/pv13\"" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:01:52 crc kubenswrapper[5120]: I0316 16:01:52.704387 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/97c05f77-d695-4853-acb9-05388320db3b-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"97c05f77-d695-4853-acb9-05388320db3b\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:01:52 crc kubenswrapper[5120]: I0316 16:01:52.705114 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/97c05f77-d695-4853-acb9-05388320db3b-scripts\") pod \"glance-default-external-api-0\" (UID: \"97c05f77-d695-4853-acb9-05388320db3b\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:01:52 crc kubenswrapper[5120]: I0316 16:01:52.706475 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/97c05f77-d695-4853-acb9-05388320db3b-config-data\") pod \"glance-default-external-api-0\" (UID: \"97c05f77-d695-4853-acb9-05388320db3b\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:01:52 crc kubenswrapper[5120]: I0316 16:01:52.706947 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9xzj\" (UniqueName: \"kubernetes.io/projected/97c05f77-d695-4853-acb9-05388320db3b-kube-api-access-v9xzj\") pod \"glance-default-external-api-0\" (UID: \"97c05f77-d695-4853-acb9-05388320db3b\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:01:52 crc kubenswrapper[5120]: I0316 16:01:52.713733 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/97c05f77-d695-4853-acb9-05388320db3b-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"97c05f77-d695-4853-acb9-05388320db3b\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:01:52 crc kubenswrapper[5120]: I0316 16:01:52.742146 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"glance-default-external-api-0\" (UID: \"97c05f77-d695-4853-acb9-05388320db3b\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:01:52 crc kubenswrapper[5120]: I0316 16:01:52.780507 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:01:52 crc kubenswrapper[5120]: I0316 16:01:52.973952 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-6x6k9" Mar 16 16:01:52 crc kubenswrapper[5120]: I0316 16:01:52.985547 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-znw74" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.094749 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-68ttz\" (UniqueName: \"kubernetes.io/projected/54c2f552-edbf-47f1-9e7e-2f6ce8099914-kube-api-access-68ttz\") pod \"54c2f552-edbf-47f1-9e7e-2f6ce8099914\" (UID: \"54c2f552-edbf-47f1-9e7e-2f6ce8099914\") " Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.094806 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4bbb7480-6b4f-4be1-9f89-73d58ebf1184-combined-ca-bundle\") pod \"4bbb7480-6b4f-4be1-9f89-73d58ebf1184\" (UID: \"4bbb7480-6b4f-4be1-9f89-73d58ebf1184\") " Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.094861 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/54c2f552-edbf-47f1-9e7e-2f6ce8099914-scripts\") pod \"54c2f552-edbf-47f1-9e7e-2f6ce8099914\" (UID: \"54c2f552-edbf-47f1-9e7e-2f6ce8099914\") " Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.094984 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/54c2f552-edbf-47f1-9e7e-2f6ce8099914-logs\") pod \"54c2f552-edbf-47f1-9e7e-2f6ce8099914\" (UID: \"54c2f552-edbf-47f1-9e7e-2f6ce8099914\") " Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.095046 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/4bbb7480-6b4f-4be1-9f89-73d58ebf1184-db-sync-config-data\") pod \"4bbb7480-6b4f-4be1-9f89-73d58ebf1184\" (UID: \"4bbb7480-6b4f-4be1-9f89-73d58ebf1184\") " Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.095089 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8tp4x\" (UniqueName: \"kubernetes.io/projected/4bbb7480-6b4f-4be1-9f89-73d58ebf1184-kube-api-access-8tp4x\") pod \"4bbb7480-6b4f-4be1-9f89-73d58ebf1184\" (UID: \"4bbb7480-6b4f-4be1-9f89-73d58ebf1184\") " Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.095151 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/54c2f552-edbf-47f1-9e7e-2f6ce8099914-config-data\") pod \"54c2f552-edbf-47f1-9e7e-2f6ce8099914\" (UID: \"54c2f552-edbf-47f1-9e7e-2f6ce8099914\") " Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.095203 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/54c2f552-edbf-47f1-9e7e-2f6ce8099914-combined-ca-bundle\") pod \"54c2f552-edbf-47f1-9e7e-2f6ce8099914\" (UID: \"54c2f552-edbf-47f1-9e7e-2f6ce8099914\") " Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.096369 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54c2f552-edbf-47f1-9e7e-2f6ce8099914-logs" (OuterVolumeSpecName: "logs") pod "54c2f552-edbf-47f1-9e7e-2f6ce8099914" (UID: "54c2f552-edbf-47f1-9e7e-2f6ce8099914"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.100591 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4bbb7480-6b4f-4be1-9f89-73d58ebf1184-kube-api-access-8tp4x" (OuterVolumeSpecName: "kube-api-access-8tp4x") pod "4bbb7480-6b4f-4be1-9f89-73d58ebf1184" (UID: "4bbb7480-6b4f-4be1-9f89-73d58ebf1184"). InnerVolumeSpecName "kube-api-access-8tp4x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.100634 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54c2f552-edbf-47f1-9e7e-2f6ce8099914-kube-api-access-68ttz" (OuterVolumeSpecName: "kube-api-access-68ttz") pod "54c2f552-edbf-47f1-9e7e-2f6ce8099914" (UID: "54c2f552-edbf-47f1-9e7e-2f6ce8099914"). InnerVolumeSpecName "kube-api-access-68ttz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.104123 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4bbb7480-6b4f-4be1-9f89-73d58ebf1184-db-sync-config-data" (OuterVolumeSpecName: "db-sync-config-data") pod "4bbb7480-6b4f-4be1-9f89-73d58ebf1184" (UID: "4bbb7480-6b4f-4be1-9f89-73d58ebf1184"). InnerVolumeSpecName "db-sync-config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.104430 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54c2f552-edbf-47f1-9e7e-2f6ce8099914-scripts" (OuterVolumeSpecName: "scripts") pod "54c2f552-edbf-47f1-9e7e-2f6ce8099914" (UID: "54c2f552-edbf-47f1-9e7e-2f6ce8099914"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.121956 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54c2f552-edbf-47f1-9e7e-2f6ce8099914-config-data" (OuterVolumeSpecName: "config-data") pod "54c2f552-edbf-47f1-9e7e-2f6ce8099914" (UID: "54c2f552-edbf-47f1-9e7e-2f6ce8099914"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.126174 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4bbb7480-6b4f-4be1-9f89-73d58ebf1184-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "4bbb7480-6b4f-4be1-9f89-73d58ebf1184" (UID: "4bbb7480-6b4f-4be1-9f89-73d58ebf1184"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.139830 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54c2f552-edbf-47f1-9e7e-2f6ce8099914-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "54c2f552-edbf-47f1-9e7e-2f6ce8099914" (UID: "54c2f552-edbf-47f1-9e7e-2f6ce8099914"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.198884 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/54c2f552-edbf-47f1-9e7e-2f6ce8099914-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.198922 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/54c2f552-edbf-47f1-9e7e-2f6ce8099914-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.198933 5120 reconciler_common.go:299] "Volume detached for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/4bbb7480-6b4f-4be1-9f89-73d58ebf1184-db-sync-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.198944 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8tp4x\" (UniqueName: \"kubernetes.io/projected/4bbb7480-6b4f-4be1-9f89-73d58ebf1184-kube-api-access-8tp4x\") on node \"crc\" DevicePath \"\"" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.198954 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/54c2f552-edbf-47f1-9e7e-2f6ce8099914-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.198962 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/54c2f552-edbf-47f1-9e7e-2f6ce8099914-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.198972 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-68ttz\" (UniqueName: \"kubernetes.io/projected/54c2f552-edbf-47f1-9e7e-2f6ce8099914-kube-api-access-68ttz\") on node \"crc\" DevicePath \"\"" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.198981 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4bbb7480-6b4f-4be1-9f89-73d58ebf1184-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.263550 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.300177 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e7aabe11-b85e-4c50-8a22-4c870b52d36f-internal-tls-certs\") pod \"e7aabe11-b85e-4c50-8a22-4c870b52d36f\" (UID: \"e7aabe11-b85e-4c50-8a22-4c870b52d36f\") " Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.300242 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e7aabe11-b85e-4c50-8a22-4c870b52d36f-logs\") pod \"e7aabe11-b85e-4c50-8a22-4c870b52d36f\" (UID: \"e7aabe11-b85e-4c50-8a22-4c870b52d36f\") " Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.300345 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e7aabe11-b85e-4c50-8a22-4c870b52d36f-combined-ca-bundle\") pod \"e7aabe11-b85e-4c50-8a22-4c870b52d36f\" (UID: \"e7aabe11-b85e-4c50-8a22-4c870b52d36f\") " Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.300364 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/e7aabe11-b85e-4c50-8a22-4c870b52d36f-httpd-run\") pod \"e7aabe11-b85e-4c50-8a22-4c870b52d36f\" (UID: \"e7aabe11-b85e-4c50-8a22-4c870b52d36f\") " Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.300432 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jxrkm\" (UniqueName: \"kubernetes.io/projected/e7aabe11-b85e-4c50-8a22-4c870b52d36f-kube-api-access-jxrkm\") pod \"e7aabe11-b85e-4c50-8a22-4c870b52d36f\" (UID: \"e7aabe11-b85e-4c50-8a22-4c870b52d36f\") " Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.300481 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e7aabe11-b85e-4c50-8a22-4c870b52d36f-scripts\") pod \"e7aabe11-b85e-4c50-8a22-4c870b52d36f\" (UID: \"e7aabe11-b85e-4c50-8a22-4c870b52d36f\") " Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.300541 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e7aabe11-b85e-4c50-8a22-4c870b52d36f-config-data\") pod \"e7aabe11-b85e-4c50-8a22-4c870b52d36f\" (UID: \"e7aabe11-b85e-4c50-8a22-4c870b52d36f\") " Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.300642 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"e7aabe11-b85e-4c50-8a22-4c870b52d36f\" (UID: \"e7aabe11-b85e-4c50-8a22-4c870b52d36f\") " Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.301695 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7aabe11-b85e-4c50-8a22-4c870b52d36f-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "e7aabe11-b85e-4c50-8a22-4c870b52d36f" (UID: "e7aabe11-b85e-4c50-8a22-4c870b52d36f"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.306900 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage09-crc" (OuterVolumeSpecName: "glance") pod "e7aabe11-b85e-4c50-8a22-4c870b52d36f" (UID: "e7aabe11-b85e-4c50-8a22-4c870b52d36f"). InnerVolumeSpecName "local-storage09-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.307365 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7aabe11-b85e-4c50-8a22-4c870b52d36f-logs" (OuterVolumeSpecName: "logs") pod "e7aabe11-b85e-4c50-8a22-4c870b52d36f" (UID: "e7aabe11-b85e-4c50-8a22-4c870b52d36f"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.313321 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7aabe11-b85e-4c50-8a22-4c870b52d36f-kube-api-access-jxrkm" (OuterVolumeSpecName: "kube-api-access-jxrkm") pod "e7aabe11-b85e-4c50-8a22-4c870b52d36f" (UID: "e7aabe11-b85e-4c50-8a22-4c870b52d36f"). InnerVolumeSpecName "kube-api-access-jxrkm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.315269 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e7aabe11-b85e-4c50-8a22-4c870b52d36f-scripts" (OuterVolumeSpecName: "scripts") pod "e7aabe11-b85e-4c50-8a22-4c870b52d36f" (UID: "e7aabe11-b85e-4c50-8a22-4c870b52d36f"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.342487 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e7aabe11-b85e-4c50-8a22-4c870b52d36f-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e7aabe11-b85e-4c50-8a22-4c870b52d36f" (UID: "e7aabe11-b85e-4c50-8a22-4c870b52d36f"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.360889 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-5c58fd7f58-mlf64"] Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.362067 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54c2f552-edbf-47f1-9e7e-2f6ce8099914" containerName="placement-db-sync" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.362167 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="54c2f552-edbf-47f1-9e7e-2f6ce8099914" containerName="placement-db-sync" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.362266 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4bbb7480-6b4f-4be1-9f89-73d58ebf1184" containerName="barbican-db-sync" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.362352 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="4bbb7480-6b4f-4be1-9f89-73d58ebf1184" containerName="barbican-db-sync" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.362444 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7aabe11-b85e-4c50-8a22-4c870b52d36f" containerName="glance-httpd" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.362507 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7aabe11-b85e-4c50-8a22-4c870b52d36f" containerName="glance-httpd" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.362584 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7aabe11-b85e-4c50-8a22-4c870b52d36f" containerName="glance-log" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.362643 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7aabe11-b85e-4c50-8a22-4c870b52d36f" containerName="glance-log" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.362878 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e7aabe11-b85e-4c50-8a22-4c870b52d36f" containerName="glance-httpd" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.362957 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="54c2f552-edbf-47f1-9e7e-2f6ce8099914" containerName="placement-db-sync" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.363018 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="4bbb7480-6b4f-4be1-9f89-73d58ebf1184" containerName="barbican-db-sync" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.363073 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e7aabe11-b85e-4c50-8a22-4c870b52d36f" containerName="glance-log" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.374209 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-5c58fd7f58-mlf64" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.395697 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-keystone-listener-config-data\"" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.407442 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-worker-5cddcbb4cf-kdhzk"] Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.408875 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") on node \"crc\" " Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.408898 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e7aabe11-b85e-4c50-8a22-4c870b52d36f-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.408907 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e7aabe11-b85e-4c50-8a22-4c870b52d36f-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.408918 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/e7aabe11-b85e-4c50-8a22-4c870b52d36f-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.408936 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jxrkm\" (UniqueName: \"kubernetes.io/projected/e7aabe11-b85e-4c50-8a22-4c870b52d36f-kube-api-access-jxrkm\") on node \"crc\" DevicePath \"\"" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.408944 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e7aabe11-b85e-4c50-8a22-4c870b52d36f-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.420323 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-6x6k9" event={"ID":"4bbb7480-6b4f-4be1-9f89-73d58ebf1184","Type":"ContainerDied","Data":"93ffdce207899c015c643decc61aa6fb1f1355caea4ffbcb4353ea000a39bd80"} Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.420367 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="93ffdce207899c015c643decc61aa6fb1f1355caea4ffbcb4353ea000a39bd80" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.420522 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-5cddcbb4cf-kdhzk" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.420875 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-6x6k9" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.430434 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e7aabe11-b85e-4c50-8a22-4c870b52d36f-config-data" (OuterVolumeSpecName: "config-data") pod "e7aabe11-b85e-4c50-8a22-4c870b52d36f" (UID: "e7aabe11-b85e-4c50-8a22-4c870b52d36f"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.432844 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-worker-config-data\"" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.437968 5120 generic.go:358] "Generic (PLEG): container finished" podID="e7aabe11-b85e-4c50-8a22-4c870b52d36f" containerID="95e4cafa411ae2949f0e071b609450791bc5d914450333fe6b39639453289a16" exitCode=0 Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.437997 5120 generic.go:358] "Generic (PLEG): container finished" podID="e7aabe11-b85e-4c50-8a22-4c870b52d36f" containerID="29e380e4c79dc24b62582b1113575607810252d7d8fd2977aa971954e4ba657f" exitCode=143 Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.438221 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.438298 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"e7aabe11-b85e-4c50-8a22-4c870b52d36f","Type":"ContainerDied","Data":"95e4cafa411ae2949f0e071b609450791bc5d914450333fe6b39639453289a16"} Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.438339 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"e7aabe11-b85e-4c50-8a22-4c870b52d36f","Type":"ContainerDied","Data":"29e380e4c79dc24b62582b1113575607810252d7d8fd2977aa971954e4ba657f"} Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.438350 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"e7aabe11-b85e-4c50-8a22-4c870b52d36f","Type":"ContainerDied","Data":"76ddff041f692a92151e13aaa7af0d98f27720e3b45e0b439c2aa54ab62b8485"} Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.438369 5120 scope.go:117] "RemoveContainer" containerID="95e4cafa411ae2949f0e071b609450791bc5d914450333fe6b39639453289a16" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.438397 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e7aabe11-b85e-4c50-8a22-4c870b52d36f-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "e7aabe11-b85e-4c50-8a22-4c870b52d36f" (UID: "e7aabe11-b85e-4c50-8a22-4c870b52d36f"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.447480 5120 generic.go:358] "Generic (PLEG): container finished" podID="f65851de-c7fc-4d33-af00-c0bd4081b4cc" containerID="786c94e304b470f789693f51f55f154d8a32456e15f398d7e70a8d0aa150ce38" exitCode=0 Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.447536 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-gqccg" event={"ID":"f65851de-c7fc-4d33-af00-c0bd4081b4cc","Type":"ContainerDied","Data":"786c94e304b470f789693f51f55f154d8a32456e15f398d7e70a8d0aa150ce38"} Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.461584 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage09-crc" (UniqueName: "kubernetes.io/local-volume/local-storage09-crc") on node "crc" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.470140 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-5c58fd7f58-mlf64"] Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.492478 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-5cddcbb4cf-kdhzk"] Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.507773 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-znw74" event={"ID":"54c2f552-edbf-47f1-9e7e-2f6ce8099914","Type":"ContainerDied","Data":"97585d814db4832b66057058c75ad67d7e4b173538262aeddb89bec6a1e5e179"} Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.507813 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="97585d814db4832b66057058c75ad67d7e4b173538262aeddb89bec6a1e5e179" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.507780 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-znw74" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.513717 5120 scope.go:117] "RemoveContainer" containerID="29e380e4c79dc24b62582b1113575607810252d7d8fd2977aa971954e4ba657f" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.514883 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1daafc71-9f0a-4fe4-953c-1e00eab0fbfa-config-data\") pod \"barbican-worker-5cddcbb4cf-kdhzk\" (UID: \"1daafc71-9f0a-4fe4-953c-1e00eab0fbfa\") " pod="openstack-kuttl-tests/barbican-worker-5cddcbb4cf-kdhzk" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.514930 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/1daafc71-9f0a-4fe4-953c-1e00eab0fbfa-logs\") pod \"barbican-worker-5cddcbb4cf-kdhzk\" (UID: \"1daafc71-9f0a-4fe4-953c-1e00eab0fbfa\") " pod="openstack-kuttl-tests/barbican-worker-5cddcbb4cf-kdhzk" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.515025 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/1daafc71-9f0a-4fe4-953c-1e00eab0fbfa-config-data-custom\") pod \"barbican-worker-5cddcbb4cf-kdhzk\" (UID: \"1daafc71-9f0a-4fe4-953c-1e00eab0fbfa\") " pod="openstack-kuttl-tests/barbican-worker-5cddcbb4cf-kdhzk" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.515080 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1daafc71-9f0a-4fe4-953c-1e00eab0fbfa-combined-ca-bundle\") pod \"barbican-worker-5cddcbb4cf-kdhzk\" (UID: \"1daafc71-9f0a-4fe4-953c-1e00eab0fbfa\") " pod="openstack-kuttl-tests/barbican-worker-5cddcbb4cf-kdhzk" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.515133 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c6827071-9f0c-4934-a287-e8c5797c390b-logs\") pod \"barbican-keystone-listener-5c58fd7f58-mlf64\" (UID: \"c6827071-9f0c-4934-a287-e8c5797c390b\") " pod="openstack-kuttl-tests/barbican-keystone-listener-5c58fd7f58-mlf64" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.515207 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c6827071-9f0c-4934-a287-e8c5797c390b-config-data\") pod \"barbican-keystone-listener-5c58fd7f58-mlf64\" (UID: \"c6827071-9f0c-4934-a287-e8c5797c390b\") " pod="openstack-kuttl-tests/barbican-keystone-listener-5c58fd7f58-mlf64" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.515235 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c6827071-9f0c-4934-a287-e8c5797c390b-combined-ca-bundle\") pod \"barbican-keystone-listener-5c58fd7f58-mlf64\" (UID: \"c6827071-9f0c-4934-a287-e8c5797c390b\") " pod="openstack-kuttl-tests/barbican-keystone-listener-5c58fd7f58-mlf64" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.515284 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p98dw\" (UniqueName: \"kubernetes.io/projected/c6827071-9f0c-4934-a287-e8c5797c390b-kube-api-access-p98dw\") pod \"barbican-keystone-listener-5c58fd7f58-mlf64\" (UID: \"c6827071-9f0c-4934-a287-e8c5797c390b\") " pod="openstack-kuttl-tests/barbican-keystone-listener-5c58fd7f58-mlf64" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.515308 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/c6827071-9f0c-4934-a287-e8c5797c390b-config-data-custom\") pod \"barbican-keystone-listener-5c58fd7f58-mlf64\" (UID: \"c6827071-9f0c-4934-a287-e8c5797c390b\") " pod="openstack-kuttl-tests/barbican-keystone-listener-5c58fd7f58-mlf64" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.515358 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vqrh\" (UniqueName: \"kubernetes.io/projected/1daafc71-9f0a-4fe4-953c-1e00eab0fbfa-kube-api-access-5vqrh\") pod \"barbican-worker-5cddcbb4cf-kdhzk\" (UID: \"1daafc71-9f0a-4fe4-953c-1e00eab0fbfa\") " pod="openstack-kuttl-tests/barbican-worker-5cddcbb4cf-kdhzk" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.515416 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.515446 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e7aabe11-b85e-4c50-8a22-4c870b52d36f-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.515456 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e7aabe11-b85e-4c50-8a22-4c870b52d36f-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.523712 5120 generic.go:358] "Generic (PLEG): container finished" podID="ace8fafc-b3ed-4c95-8769-9f226ef3506f" containerID="4be499829974498a3593cb68f355bd6ce58f7cff3d72a82bc9ff36b4e8bf6444" exitCode=0 Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.523974 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-rlkfm" event={"ID":"ace8fafc-b3ed-4c95-8769-9f226ef3506f","Type":"ContainerDied","Data":"4be499829974498a3593cb68f355bd6ce58f7cff3d72a82bc9ff36b4e8bf6444"} Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.533925 5120 generic.go:358] "Generic (PLEG): container finished" podID="e52ef7fa-31bc-409e-a6eb-5b32a5082208" containerID="83d52eae0e241c4594c601b1ef1e637a0cae05c8be254ed7c8590df70de76616" exitCode=0 Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.534218 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-8wn9f" event={"ID":"e52ef7fa-31bc-409e-a6eb-5b32a5082208","Type":"ContainerDied","Data":"83d52eae0e241c4594c601b1ef1e637a0cae05c8be254ed7c8590df70de76616"} Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.542966 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-799cbdd458-hqv8s"] Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.565697 5120 scope.go:117] "RemoveContainer" containerID="95e4cafa411ae2949f0e071b609450791bc5d914450333fe6b39639453289a16" Mar 16 16:01:53 crc kubenswrapper[5120]: E0316 16:01:53.567118 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"95e4cafa411ae2949f0e071b609450791bc5d914450333fe6b39639453289a16\": container with ID starting with 95e4cafa411ae2949f0e071b609450791bc5d914450333fe6b39639453289a16 not found: ID does not exist" containerID="95e4cafa411ae2949f0e071b609450791bc5d914450333fe6b39639453289a16" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.567161 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95e4cafa411ae2949f0e071b609450791bc5d914450333fe6b39639453289a16"} err="failed to get container status \"95e4cafa411ae2949f0e071b609450791bc5d914450333fe6b39639453289a16\": rpc error: code = NotFound desc = could not find container \"95e4cafa411ae2949f0e071b609450791bc5d914450333fe6b39639453289a16\": container with ID starting with 95e4cafa411ae2949f0e071b609450791bc5d914450333fe6b39639453289a16 not found: ID does not exist" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.567235 5120 scope.go:117] "RemoveContainer" containerID="29e380e4c79dc24b62582b1113575607810252d7d8fd2977aa971954e4ba657f" Mar 16 16:01:53 crc kubenswrapper[5120]: E0316 16:01:53.578784 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"29e380e4c79dc24b62582b1113575607810252d7d8fd2977aa971954e4ba657f\": container with ID starting with 29e380e4c79dc24b62582b1113575607810252d7d8fd2977aa971954e4ba657f not found: ID does not exist" containerID="29e380e4c79dc24b62582b1113575607810252d7d8fd2977aa971954e4ba657f" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.578858 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29e380e4c79dc24b62582b1113575607810252d7d8fd2977aa971954e4ba657f"} err="failed to get container status \"29e380e4c79dc24b62582b1113575607810252d7d8fd2977aa971954e4ba657f\": rpc error: code = NotFound desc = could not find container \"29e380e4c79dc24b62582b1113575607810252d7d8fd2977aa971954e4ba657f\": container with ID starting with 29e380e4c79dc24b62582b1113575607810252d7d8fd2977aa971954e4ba657f not found: ID does not exist" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.578891 5120 scope.go:117] "RemoveContainer" containerID="95e4cafa411ae2949f0e071b609450791bc5d914450333fe6b39639453289a16" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.579299 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95e4cafa411ae2949f0e071b609450791bc5d914450333fe6b39639453289a16"} err="failed to get container status \"95e4cafa411ae2949f0e071b609450791bc5d914450333fe6b39639453289a16\": rpc error: code = NotFound desc = could not find container \"95e4cafa411ae2949f0e071b609450791bc5d914450333fe6b39639453289a16\": container with ID starting with 95e4cafa411ae2949f0e071b609450791bc5d914450333fe6b39639453289a16 not found: ID does not exist" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.579375 5120 scope.go:117] "RemoveContainer" containerID="29e380e4c79dc24b62582b1113575607810252d7d8fd2977aa971954e4ba657f" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.581723 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29e380e4c79dc24b62582b1113575607810252d7d8fd2977aa971954e4ba657f"} err="failed to get container status \"29e380e4c79dc24b62582b1113575607810252d7d8fd2977aa971954e4ba657f\": rpc error: code = NotFound desc = could not find container \"29e380e4c79dc24b62582b1113575607810252d7d8fd2977aa971954e4ba657f\": container with ID starting with 29e380e4c79dc24b62582b1113575607810252d7d8fd2977aa971954e4ba657f not found: ID does not exist" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.589113 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-799cbdd458-hqv8s" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.591578 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-placement-dockercfg-ht8jm\"" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.595123 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-scripts\"" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.595473 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-config-data\"" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.604825 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-799cbdd458-hqv8s"] Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.619856 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.620888 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p98dw\" (UniqueName: \"kubernetes.io/projected/c6827071-9f0c-4934-a287-e8c5797c390b-kube-api-access-p98dw\") pod \"barbican-keystone-listener-5c58fd7f58-mlf64\" (UID: \"c6827071-9f0c-4934-a287-e8c5797c390b\") " pod="openstack-kuttl-tests/barbican-keystone-listener-5c58fd7f58-mlf64" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.620920 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/c6827071-9f0c-4934-a287-e8c5797c390b-config-data-custom\") pod \"barbican-keystone-listener-5c58fd7f58-mlf64\" (UID: \"c6827071-9f0c-4934-a287-e8c5797c390b\") " pod="openstack-kuttl-tests/barbican-keystone-listener-5c58fd7f58-mlf64" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.620958 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5vqrh\" (UniqueName: \"kubernetes.io/projected/1daafc71-9f0a-4fe4-953c-1e00eab0fbfa-kube-api-access-5vqrh\") pod \"barbican-worker-5cddcbb4cf-kdhzk\" (UID: \"1daafc71-9f0a-4fe4-953c-1e00eab0fbfa\") " pod="openstack-kuttl-tests/barbican-worker-5cddcbb4cf-kdhzk" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.621011 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1daafc71-9f0a-4fe4-953c-1e00eab0fbfa-config-data\") pod \"barbican-worker-5cddcbb4cf-kdhzk\" (UID: \"1daafc71-9f0a-4fe4-953c-1e00eab0fbfa\") " pod="openstack-kuttl-tests/barbican-worker-5cddcbb4cf-kdhzk" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.621032 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/1daafc71-9f0a-4fe4-953c-1e00eab0fbfa-logs\") pod \"barbican-worker-5cddcbb4cf-kdhzk\" (UID: \"1daafc71-9f0a-4fe4-953c-1e00eab0fbfa\") " pod="openstack-kuttl-tests/barbican-worker-5cddcbb4cf-kdhzk" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.621089 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/1daafc71-9f0a-4fe4-953c-1e00eab0fbfa-config-data-custom\") pod \"barbican-worker-5cddcbb4cf-kdhzk\" (UID: \"1daafc71-9f0a-4fe4-953c-1e00eab0fbfa\") " pod="openstack-kuttl-tests/barbican-worker-5cddcbb4cf-kdhzk" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.621107 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1daafc71-9f0a-4fe4-953c-1e00eab0fbfa-combined-ca-bundle\") pod \"barbican-worker-5cddcbb4cf-kdhzk\" (UID: \"1daafc71-9f0a-4fe4-953c-1e00eab0fbfa\") " pod="openstack-kuttl-tests/barbican-worker-5cddcbb4cf-kdhzk" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.621141 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c6827071-9f0c-4934-a287-e8c5797c390b-logs\") pod \"barbican-keystone-listener-5c58fd7f58-mlf64\" (UID: \"c6827071-9f0c-4934-a287-e8c5797c390b\") " pod="openstack-kuttl-tests/barbican-keystone-listener-5c58fd7f58-mlf64" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.621189 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c6827071-9f0c-4934-a287-e8c5797c390b-config-data\") pod \"barbican-keystone-listener-5c58fd7f58-mlf64\" (UID: \"c6827071-9f0c-4934-a287-e8c5797c390b\") " pod="openstack-kuttl-tests/barbican-keystone-listener-5c58fd7f58-mlf64" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.621208 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c6827071-9f0c-4934-a287-e8c5797c390b-combined-ca-bundle\") pod \"barbican-keystone-listener-5c58fd7f58-mlf64\" (UID: \"c6827071-9f0c-4934-a287-e8c5797c390b\") " pod="openstack-kuttl-tests/barbican-keystone-listener-5c58fd7f58-mlf64" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.622100 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/1daafc71-9f0a-4fe4-953c-1e00eab0fbfa-logs\") pod \"barbican-worker-5cddcbb4cf-kdhzk\" (UID: \"1daafc71-9f0a-4fe4-953c-1e00eab0fbfa\") " pod="openstack-kuttl-tests/barbican-worker-5cddcbb4cf-kdhzk" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.624028 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c6827071-9f0c-4934-a287-e8c5797c390b-logs\") pod \"barbican-keystone-listener-5c58fd7f58-mlf64\" (UID: \"c6827071-9f0c-4934-a287-e8c5797c390b\") " pod="openstack-kuttl-tests/barbican-keystone-listener-5c58fd7f58-mlf64" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.628332 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-api-f5cb49f4b-mkrgf"] Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.630980 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c6827071-9f0c-4934-a287-e8c5797c390b-config-data\") pod \"barbican-keystone-listener-5c58fd7f58-mlf64\" (UID: \"c6827071-9f0c-4934-a287-e8c5797c390b\") " pod="openstack-kuttl-tests/barbican-keystone-listener-5c58fd7f58-mlf64" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.632431 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c6827071-9f0c-4934-a287-e8c5797c390b-combined-ca-bundle\") pod \"barbican-keystone-listener-5c58fd7f58-mlf64\" (UID: \"c6827071-9f0c-4934-a287-e8c5797c390b\") " pod="openstack-kuttl-tests/barbican-keystone-listener-5c58fd7f58-mlf64" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.635432 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/c6827071-9f0c-4934-a287-e8c5797c390b-config-data-custom\") pod \"barbican-keystone-listener-5c58fd7f58-mlf64\" (UID: \"c6827071-9f0c-4934-a287-e8c5797c390b\") " pod="openstack-kuttl-tests/barbican-keystone-listener-5c58fd7f58-mlf64" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.635538 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1daafc71-9f0a-4fe4-953c-1e00eab0fbfa-config-data\") pod \"barbican-worker-5cddcbb4cf-kdhzk\" (UID: \"1daafc71-9f0a-4fe4-953c-1e00eab0fbfa\") " pod="openstack-kuttl-tests/barbican-worker-5cddcbb4cf-kdhzk" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.638120 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-f5cb49f4b-mkrgf" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.639594 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p98dw\" (UniqueName: \"kubernetes.io/projected/c6827071-9f0c-4934-a287-e8c5797c390b-kube-api-access-p98dw\") pod \"barbican-keystone-listener-5c58fd7f58-mlf64\" (UID: \"c6827071-9f0c-4934-a287-e8c5797c390b\") " pod="openstack-kuttl-tests/barbican-keystone-listener-5c58fd7f58-mlf64" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.640829 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/1daafc71-9f0a-4fe4-953c-1e00eab0fbfa-config-data-custom\") pod \"barbican-worker-5cddcbb4cf-kdhzk\" (UID: \"1daafc71-9f0a-4fe4-953c-1e00eab0fbfa\") " pod="openstack-kuttl-tests/barbican-worker-5cddcbb4cf-kdhzk" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.640945 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-api-config-data\"" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.641001 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1daafc71-9f0a-4fe4-953c-1e00eab0fbfa-combined-ca-bundle\") pod \"barbican-worker-5cddcbb4cf-kdhzk\" (UID: \"1daafc71-9f0a-4fe4-953c-1e00eab0fbfa\") " pod="openstack-kuttl-tests/barbican-worker-5cddcbb4cf-kdhzk" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.646566 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vqrh\" (UniqueName: \"kubernetes.io/projected/1daafc71-9f0a-4fe4-953c-1e00eab0fbfa-kube-api-access-5vqrh\") pod \"barbican-worker-5cddcbb4cf-kdhzk\" (UID: \"1daafc71-9f0a-4fe4-953c-1e00eab0fbfa\") " pod="openstack-kuttl-tests/barbican-worker-5cddcbb4cf-kdhzk" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.657967 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-f5cb49f4b-mkrgf"] Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.720547 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-5c58fd7f58-mlf64" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.722041 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ca9332c4-7b03-4296-9cb8-b5fdcd487025-combined-ca-bundle\") pod \"placement-799cbdd458-hqv8s\" (UID: \"ca9332c4-7b03-4296-9cb8-b5fdcd487025\") " pod="openstack-kuttl-tests/placement-799cbdd458-hqv8s" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.722076 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ca9332c4-7b03-4296-9cb8-b5fdcd487025-logs\") pod \"placement-799cbdd458-hqv8s\" (UID: \"ca9332c4-7b03-4296-9cb8-b5fdcd487025\") " pod="openstack-kuttl-tests/placement-799cbdd458-hqv8s" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.722128 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ca9332c4-7b03-4296-9cb8-b5fdcd487025-config-data\") pod \"placement-799cbdd458-hqv8s\" (UID: \"ca9332c4-7b03-4296-9cb8-b5fdcd487025\") " pod="openstack-kuttl-tests/placement-799cbdd458-hqv8s" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.722352 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jskf\" (UniqueName: \"kubernetes.io/projected/ca9332c4-7b03-4296-9cb8-b5fdcd487025-kube-api-access-4jskf\") pod \"placement-799cbdd458-hqv8s\" (UID: \"ca9332c4-7b03-4296-9cb8-b5fdcd487025\") " pod="openstack-kuttl-tests/placement-799cbdd458-hqv8s" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.722434 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a1a6ef57-0689-4731-8c35-b337908ae72b-logs\") pod \"barbican-api-f5cb49f4b-mkrgf\" (UID: \"a1a6ef57-0689-4731-8c35-b337908ae72b\") " pod="openstack-kuttl-tests/barbican-api-f5cb49f4b-mkrgf" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.722751 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfvp5\" (UniqueName: \"kubernetes.io/projected/a1a6ef57-0689-4731-8c35-b337908ae72b-kube-api-access-jfvp5\") pod \"barbican-api-f5cb49f4b-mkrgf\" (UID: \"a1a6ef57-0689-4731-8c35-b337908ae72b\") " pod="openstack-kuttl-tests/barbican-api-f5cb49f4b-mkrgf" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.723857 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ca9332c4-7b03-4296-9cb8-b5fdcd487025-scripts\") pod \"placement-799cbdd458-hqv8s\" (UID: \"ca9332c4-7b03-4296-9cb8-b5fdcd487025\") " pod="openstack-kuttl-tests/placement-799cbdd458-hqv8s" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.723887 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/a1a6ef57-0689-4731-8c35-b337908ae72b-config-data-custom\") pod \"barbican-api-f5cb49f4b-mkrgf\" (UID: \"a1a6ef57-0689-4731-8c35-b337908ae72b\") " pod="openstack-kuttl-tests/barbican-api-f5cb49f4b-mkrgf" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.723950 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a1a6ef57-0689-4731-8c35-b337908ae72b-combined-ca-bundle\") pod \"barbican-api-f5cb49f4b-mkrgf\" (UID: \"a1a6ef57-0689-4731-8c35-b337908ae72b\") " pod="openstack-kuttl-tests/barbican-api-f5cb49f4b-mkrgf" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.724000 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a1a6ef57-0689-4731-8c35-b337908ae72b-config-data\") pod \"barbican-api-f5cb49f4b-mkrgf\" (UID: \"a1a6ef57-0689-4731-8c35-b337908ae72b\") " pod="openstack-kuttl-tests/barbican-api-f5cb49f4b-mkrgf" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.825946 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.835579 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ca9332c4-7b03-4296-9cb8-b5fdcd487025-config-data\") pod \"placement-799cbdd458-hqv8s\" (UID: \"ca9332c4-7b03-4296-9cb8-b5fdcd487025\") " pod="openstack-kuttl-tests/placement-799cbdd458-hqv8s" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.835637 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4jskf\" (UniqueName: \"kubernetes.io/projected/ca9332c4-7b03-4296-9cb8-b5fdcd487025-kube-api-access-4jskf\") pod \"placement-799cbdd458-hqv8s\" (UID: \"ca9332c4-7b03-4296-9cb8-b5fdcd487025\") " pod="openstack-kuttl-tests/placement-799cbdd458-hqv8s" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.835660 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a1a6ef57-0689-4731-8c35-b337908ae72b-logs\") pod \"barbican-api-f5cb49f4b-mkrgf\" (UID: \"a1a6ef57-0689-4731-8c35-b337908ae72b\") " pod="openstack-kuttl-tests/barbican-api-f5cb49f4b-mkrgf" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.835745 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jfvp5\" (UniqueName: \"kubernetes.io/projected/a1a6ef57-0689-4731-8c35-b337908ae72b-kube-api-access-jfvp5\") pod \"barbican-api-f5cb49f4b-mkrgf\" (UID: \"a1a6ef57-0689-4731-8c35-b337908ae72b\") " pod="openstack-kuttl-tests/barbican-api-f5cb49f4b-mkrgf" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.835791 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ca9332c4-7b03-4296-9cb8-b5fdcd487025-scripts\") pod \"placement-799cbdd458-hqv8s\" (UID: \"ca9332c4-7b03-4296-9cb8-b5fdcd487025\") " pod="openstack-kuttl-tests/placement-799cbdd458-hqv8s" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.835809 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/a1a6ef57-0689-4731-8c35-b337908ae72b-config-data-custom\") pod \"barbican-api-f5cb49f4b-mkrgf\" (UID: \"a1a6ef57-0689-4731-8c35-b337908ae72b\") " pod="openstack-kuttl-tests/barbican-api-f5cb49f4b-mkrgf" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.835825 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a1a6ef57-0689-4731-8c35-b337908ae72b-combined-ca-bundle\") pod \"barbican-api-f5cb49f4b-mkrgf\" (UID: \"a1a6ef57-0689-4731-8c35-b337908ae72b\") " pod="openstack-kuttl-tests/barbican-api-f5cb49f4b-mkrgf" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.836469 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a1a6ef57-0689-4731-8c35-b337908ae72b-logs\") pod \"barbican-api-f5cb49f4b-mkrgf\" (UID: \"a1a6ef57-0689-4731-8c35-b337908ae72b\") " pod="openstack-kuttl-tests/barbican-api-f5cb49f4b-mkrgf" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.836486 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-5cddcbb4cf-kdhzk" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.837697 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a1a6ef57-0689-4731-8c35-b337908ae72b-config-data\") pod \"barbican-api-f5cb49f4b-mkrgf\" (UID: \"a1a6ef57-0689-4731-8c35-b337908ae72b\") " pod="openstack-kuttl-tests/barbican-api-f5cb49f4b-mkrgf" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.837810 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ca9332c4-7b03-4296-9cb8-b5fdcd487025-combined-ca-bundle\") pod \"placement-799cbdd458-hqv8s\" (UID: \"ca9332c4-7b03-4296-9cb8-b5fdcd487025\") " pod="openstack-kuttl-tests/placement-799cbdd458-hqv8s" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.837834 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ca9332c4-7b03-4296-9cb8-b5fdcd487025-logs\") pod \"placement-799cbdd458-hqv8s\" (UID: \"ca9332c4-7b03-4296-9cb8-b5fdcd487025\") " pod="openstack-kuttl-tests/placement-799cbdd458-hqv8s" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.838779 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ca9332c4-7b03-4296-9cb8-b5fdcd487025-logs\") pod \"placement-799cbdd458-hqv8s\" (UID: \"ca9332c4-7b03-4296-9cb8-b5fdcd487025\") " pod="openstack-kuttl-tests/placement-799cbdd458-hqv8s" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.858431 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a1a6ef57-0689-4731-8c35-b337908ae72b-config-data\") pod \"barbican-api-f5cb49f4b-mkrgf\" (UID: \"a1a6ef57-0689-4731-8c35-b337908ae72b\") " pod="openstack-kuttl-tests/barbican-api-f5cb49f4b-mkrgf" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.862128 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ca9332c4-7b03-4296-9cb8-b5fdcd487025-config-data\") pod \"placement-799cbdd458-hqv8s\" (UID: \"ca9332c4-7b03-4296-9cb8-b5fdcd487025\") " pod="openstack-kuttl-tests/placement-799cbdd458-hqv8s" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.862330 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.864491 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ca9332c4-7b03-4296-9cb8-b5fdcd487025-scripts\") pod \"placement-799cbdd458-hqv8s\" (UID: \"ca9332c4-7b03-4296-9cb8-b5fdcd487025\") " pod="openstack-kuttl-tests/placement-799cbdd458-hqv8s" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.867552 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ca9332c4-7b03-4296-9cb8-b5fdcd487025-combined-ca-bundle\") pod \"placement-799cbdd458-hqv8s\" (UID: \"ca9332c4-7b03-4296-9cb8-b5fdcd487025\") " pod="openstack-kuttl-tests/placement-799cbdd458-hqv8s" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.867915 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a1a6ef57-0689-4731-8c35-b337908ae72b-combined-ca-bundle\") pod \"barbican-api-f5cb49f4b-mkrgf\" (UID: \"a1a6ef57-0689-4731-8c35-b337908ae72b\") " pod="openstack-kuttl-tests/barbican-api-f5cb49f4b-mkrgf" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.868917 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/a1a6ef57-0689-4731-8c35-b337908ae72b-config-data-custom\") pod \"barbican-api-f5cb49f4b-mkrgf\" (UID: \"a1a6ef57-0689-4731-8c35-b337908ae72b\") " pod="openstack-kuttl-tests/barbican-api-f5cb49f4b-mkrgf" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.875182 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.888400 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.891584 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jskf\" (UniqueName: \"kubernetes.io/projected/ca9332c4-7b03-4296-9cb8-b5fdcd487025-kube-api-access-4jskf\") pod \"placement-799cbdd458-hqv8s\" (UID: \"ca9332c4-7b03-4296-9cb8-b5fdcd487025\") " pod="openstack-kuttl-tests/placement-799cbdd458-hqv8s" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.893910 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-internal-config-data\"" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.895418 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-internal-svc\"" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.896291 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfvp5\" (UniqueName: \"kubernetes.io/projected/a1a6ef57-0689-4731-8c35-b337908ae72b-kube-api-access-jfvp5\") pod \"barbican-api-f5cb49f4b-mkrgf\" (UID: \"a1a6ef57-0689-4731-8c35-b337908ae72b\") " pod="openstack-kuttl-tests/barbican-api-f5cb49f4b-mkrgf" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.905553 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-799cbdd458-hqv8s" Mar 16 16:01:53 crc kubenswrapper[5120]: I0316 16:01:53.909284 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:01:54 crc kubenswrapper[5120]: I0316 16:01:54.022091 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-5d4d9d69db-qcw77"] Mar 16 16:01:54 crc kubenswrapper[5120]: I0316 16:01:54.025694 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-f5cb49f4b-mkrgf" Mar 16 16:01:54 crc kubenswrapper[5120]: I0316 16:01:54.032032 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-5d4d9d69db-qcw77" Mar 16 16:01:54 crc kubenswrapper[5120]: I0316 16:01:54.064922 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ee138521-8f48-4215-9e58-cf1d50ad7910-config-data\") pod \"glance-default-internal-api-0\" (UID: \"ee138521-8f48-4215-9e58-cf1d50ad7910\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:01:54 crc kubenswrapper[5120]: I0316 16:01:54.064976 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ee138521-8f48-4215-9e58-cf1d50ad7910-scripts\") pod \"glance-default-internal-api-0\" (UID: \"ee138521-8f48-4215-9e58-cf1d50ad7910\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:01:54 crc kubenswrapper[5120]: I0316 16:01:54.065048 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/ee138521-8f48-4215-9e58-cf1d50ad7910-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"ee138521-8f48-4215-9e58-cf1d50ad7910\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:01:54 crc kubenswrapper[5120]: I0316 16:01:54.065185 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"glance-default-internal-api-0\" (UID: \"ee138521-8f48-4215-9e58-cf1d50ad7910\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:01:54 crc kubenswrapper[5120]: I0316 16:01:54.065245 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ee138521-8f48-4215-9e58-cf1d50ad7910-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"ee138521-8f48-4215-9e58-cf1d50ad7910\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:01:54 crc kubenswrapper[5120]: I0316 16:01:54.065370 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/ee138521-8f48-4215-9e58-cf1d50ad7910-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"ee138521-8f48-4215-9e58-cf1d50ad7910\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:01:54 crc kubenswrapper[5120]: I0316 16:01:54.065463 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ee138521-8f48-4215-9e58-cf1d50ad7910-logs\") pod \"glance-default-internal-api-0\" (UID: \"ee138521-8f48-4215-9e58-cf1d50ad7910\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:01:54 crc kubenswrapper[5120]: I0316 16:01:54.067550 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-placement-public-svc\"" Mar 16 16:01:54 crc kubenswrapper[5120]: I0316 16:01:54.067575 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-placement-internal-svc\"" Mar 16 16:01:54 crc kubenswrapper[5120]: I0316 16:01:54.067685 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhnk4\" (UniqueName: \"kubernetes.io/projected/ee138521-8f48-4215-9e58-cf1d50ad7910-kube-api-access-mhnk4\") pod \"glance-default-internal-api-0\" (UID: \"ee138521-8f48-4215-9e58-cf1d50ad7910\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:01:54 crc kubenswrapper[5120]: I0316 16:01:54.097477 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-5d4d9d69db-qcw77"] Mar 16 16:01:54 crc kubenswrapper[5120]: I0316 16:01:54.173745 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"glance-default-internal-api-0\" (UID: \"ee138521-8f48-4215-9e58-cf1d50ad7910\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:01:54 crc kubenswrapper[5120]: I0316 16:01:54.173805 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ee138521-8f48-4215-9e58-cf1d50ad7910-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"ee138521-8f48-4215-9e58-cf1d50ad7910\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:01:54 crc kubenswrapper[5120]: I0316 16:01:54.173835 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2b78\" (UniqueName: \"kubernetes.io/projected/13a4296c-922e-4316-a6c6-cae50477429b-kube-api-access-h2b78\") pod \"placement-5d4d9d69db-qcw77\" (UID: \"13a4296c-922e-4316-a6c6-cae50477429b\") " pod="openstack-kuttl-tests/placement-5d4d9d69db-qcw77" Mar 16 16:01:54 crc kubenswrapper[5120]: I0316 16:01:54.173886 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/ee138521-8f48-4215-9e58-cf1d50ad7910-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"ee138521-8f48-4215-9e58-cf1d50ad7910\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:01:54 crc kubenswrapper[5120]: I0316 16:01:54.173927 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/13a4296c-922e-4316-a6c6-cae50477429b-combined-ca-bundle\") pod \"placement-5d4d9d69db-qcw77\" (UID: \"13a4296c-922e-4316-a6c6-cae50477429b\") " pod="openstack-kuttl-tests/placement-5d4d9d69db-qcw77" Mar 16 16:01:54 crc kubenswrapper[5120]: I0316 16:01:54.173969 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ee138521-8f48-4215-9e58-cf1d50ad7910-logs\") pod \"glance-default-internal-api-0\" (UID: \"ee138521-8f48-4215-9e58-cf1d50ad7910\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:01:54 crc kubenswrapper[5120]: I0316 16:01:54.174010 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mhnk4\" (UniqueName: \"kubernetes.io/projected/ee138521-8f48-4215-9e58-cf1d50ad7910-kube-api-access-mhnk4\") pod \"glance-default-internal-api-0\" (UID: \"ee138521-8f48-4215-9e58-cf1d50ad7910\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:01:54 crc kubenswrapper[5120]: I0316 16:01:54.174029 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/13a4296c-922e-4316-a6c6-cae50477429b-public-tls-certs\") pod \"placement-5d4d9d69db-qcw77\" (UID: \"13a4296c-922e-4316-a6c6-cae50477429b\") " pod="openstack-kuttl-tests/placement-5d4d9d69db-qcw77" Mar 16 16:01:54 crc kubenswrapper[5120]: I0316 16:01:54.174061 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/13a4296c-922e-4316-a6c6-cae50477429b-logs\") pod \"placement-5d4d9d69db-qcw77\" (UID: \"13a4296c-922e-4316-a6c6-cae50477429b\") " pod="openstack-kuttl-tests/placement-5d4d9d69db-qcw77" Mar 16 16:01:54 crc kubenswrapper[5120]: I0316 16:01:54.174095 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ee138521-8f48-4215-9e58-cf1d50ad7910-config-data\") pod \"glance-default-internal-api-0\" (UID: \"ee138521-8f48-4215-9e58-cf1d50ad7910\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:01:54 crc kubenswrapper[5120]: I0316 16:01:54.174150 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ee138521-8f48-4215-9e58-cf1d50ad7910-scripts\") pod \"glance-default-internal-api-0\" (UID: \"ee138521-8f48-4215-9e58-cf1d50ad7910\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:01:54 crc kubenswrapper[5120]: I0316 16:01:54.174171 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/13a4296c-922e-4316-a6c6-cae50477429b-scripts\") pod \"placement-5d4d9d69db-qcw77\" (UID: \"13a4296c-922e-4316-a6c6-cae50477429b\") " pod="openstack-kuttl-tests/placement-5d4d9d69db-qcw77" Mar 16 16:01:54 crc kubenswrapper[5120]: I0316 16:01:54.174199 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/13a4296c-922e-4316-a6c6-cae50477429b-config-data\") pod \"placement-5d4d9d69db-qcw77\" (UID: \"13a4296c-922e-4316-a6c6-cae50477429b\") " pod="openstack-kuttl-tests/placement-5d4d9d69db-qcw77" Mar 16 16:01:54 crc kubenswrapper[5120]: I0316 16:01:54.174232 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/13a4296c-922e-4316-a6c6-cae50477429b-internal-tls-certs\") pod \"placement-5d4d9d69db-qcw77\" (UID: \"13a4296c-922e-4316-a6c6-cae50477429b\") " pod="openstack-kuttl-tests/placement-5d4d9d69db-qcw77" Mar 16 16:01:54 crc kubenswrapper[5120]: I0316 16:01:54.174293 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/ee138521-8f48-4215-9e58-cf1d50ad7910-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"ee138521-8f48-4215-9e58-cf1d50ad7910\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:01:54 crc kubenswrapper[5120]: I0316 16:01:54.174920 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/ee138521-8f48-4215-9e58-cf1d50ad7910-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"ee138521-8f48-4215-9e58-cf1d50ad7910\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:01:54 crc kubenswrapper[5120]: I0316 16:01:54.175328 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"glance-default-internal-api-0\" (UID: \"ee138521-8f48-4215-9e58-cf1d50ad7910\") device mount path \"/mnt/openstack/pv09\"" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:01:54 crc kubenswrapper[5120]: I0316 16:01:54.175741 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ee138521-8f48-4215-9e58-cf1d50ad7910-logs\") pod \"glance-default-internal-api-0\" (UID: \"ee138521-8f48-4215-9e58-cf1d50ad7910\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:01:54 crc kubenswrapper[5120]: I0316 16:01:54.182415 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ee138521-8f48-4215-9e58-cf1d50ad7910-config-data\") pod \"glance-default-internal-api-0\" (UID: \"ee138521-8f48-4215-9e58-cf1d50ad7910\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:01:54 crc kubenswrapper[5120]: I0316 16:01:54.187741 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ee138521-8f48-4215-9e58-cf1d50ad7910-scripts\") pod \"glance-default-internal-api-0\" (UID: \"ee138521-8f48-4215-9e58-cf1d50ad7910\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:01:54 crc kubenswrapper[5120]: I0316 16:01:54.194459 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ee138521-8f48-4215-9e58-cf1d50ad7910-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"ee138521-8f48-4215-9e58-cf1d50ad7910\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:01:54 crc kubenswrapper[5120]: I0316 16:01:54.196151 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/ee138521-8f48-4215-9e58-cf1d50ad7910-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"ee138521-8f48-4215-9e58-cf1d50ad7910\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:01:54 crc kubenswrapper[5120]: I0316 16:01:54.200306 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhnk4\" (UniqueName: \"kubernetes.io/projected/ee138521-8f48-4215-9e58-cf1d50ad7910-kube-api-access-mhnk4\") pod \"glance-default-internal-api-0\" (UID: \"ee138521-8f48-4215-9e58-cf1d50ad7910\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:01:54 crc kubenswrapper[5120]: I0316 16:01:54.240153 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"glance-default-internal-api-0\" (UID: \"ee138521-8f48-4215-9e58-cf1d50ad7910\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:01:54 crc kubenswrapper[5120]: I0316 16:01:54.248087 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-5c58fd7f58-mlf64"] Mar 16 16:01:54 crc kubenswrapper[5120]: I0316 16:01:54.275656 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/13a4296c-922e-4316-a6c6-cae50477429b-public-tls-certs\") pod \"placement-5d4d9d69db-qcw77\" (UID: \"13a4296c-922e-4316-a6c6-cae50477429b\") " pod="openstack-kuttl-tests/placement-5d4d9d69db-qcw77" Mar 16 16:01:54 crc kubenswrapper[5120]: I0316 16:01:54.275716 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/13a4296c-922e-4316-a6c6-cae50477429b-logs\") pod \"placement-5d4d9d69db-qcw77\" (UID: \"13a4296c-922e-4316-a6c6-cae50477429b\") " pod="openstack-kuttl-tests/placement-5d4d9d69db-qcw77" Mar 16 16:01:54 crc kubenswrapper[5120]: I0316 16:01:54.275780 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/13a4296c-922e-4316-a6c6-cae50477429b-scripts\") pod \"placement-5d4d9d69db-qcw77\" (UID: \"13a4296c-922e-4316-a6c6-cae50477429b\") " pod="openstack-kuttl-tests/placement-5d4d9d69db-qcw77" Mar 16 16:01:54 crc kubenswrapper[5120]: I0316 16:01:54.275807 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/13a4296c-922e-4316-a6c6-cae50477429b-config-data\") pod \"placement-5d4d9d69db-qcw77\" (UID: \"13a4296c-922e-4316-a6c6-cae50477429b\") " pod="openstack-kuttl-tests/placement-5d4d9d69db-qcw77" Mar 16 16:01:54 crc kubenswrapper[5120]: I0316 16:01:54.275838 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/13a4296c-922e-4316-a6c6-cae50477429b-internal-tls-certs\") pod \"placement-5d4d9d69db-qcw77\" (UID: \"13a4296c-922e-4316-a6c6-cae50477429b\") " pod="openstack-kuttl-tests/placement-5d4d9d69db-qcw77" Mar 16 16:01:54 crc kubenswrapper[5120]: I0316 16:01:54.275907 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h2b78\" (UniqueName: \"kubernetes.io/projected/13a4296c-922e-4316-a6c6-cae50477429b-kube-api-access-h2b78\") pod \"placement-5d4d9d69db-qcw77\" (UID: \"13a4296c-922e-4316-a6c6-cae50477429b\") " pod="openstack-kuttl-tests/placement-5d4d9d69db-qcw77" Mar 16 16:01:54 crc kubenswrapper[5120]: I0316 16:01:54.275966 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/13a4296c-922e-4316-a6c6-cae50477429b-combined-ca-bundle\") pod \"placement-5d4d9d69db-qcw77\" (UID: \"13a4296c-922e-4316-a6c6-cae50477429b\") " pod="openstack-kuttl-tests/placement-5d4d9d69db-qcw77" Mar 16 16:01:54 crc kubenswrapper[5120]: I0316 16:01:54.279097 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/13a4296c-922e-4316-a6c6-cae50477429b-logs\") pod \"placement-5d4d9d69db-qcw77\" (UID: \"13a4296c-922e-4316-a6c6-cae50477429b\") " pod="openstack-kuttl-tests/placement-5d4d9d69db-qcw77" Mar 16 16:01:54 crc kubenswrapper[5120]: I0316 16:01:54.281495 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/13a4296c-922e-4316-a6c6-cae50477429b-combined-ca-bundle\") pod \"placement-5d4d9d69db-qcw77\" (UID: \"13a4296c-922e-4316-a6c6-cae50477429b\") " pod="openstack-kuttl-tests/placement-5d4d9d69db-qcw77" Mar 16 16:01:54 crc kubenswrapper[5120]: I0316 16:01:54.282163 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/13a4296c-922e-4316-a6c6-cae50477429b-scripts\") pod \"placement-5d4d9d69db-qcw77\" (UID: \"13a4296c-922e-4316-a6c6-cae50477429b\") " pod="openstack-kuttl-tests/placement-5d4d9d69db-qcw77" Mar 16 16:01:54 crc kubenswrapper[5120]: I0316 16:01:54.282616 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/13a4296c-922e-4316-a6c6-cae50477429b-public-tls-certs\") pod \"placement-5d4d9d69db-qcw77\" (UID: \"13a4296c-922e-4316-a6c6-cae50477429b\") " pod="openstack-kuttl-tests/placement-5d4d9d69db-qcw77" Mar 16 16:01:54 crc kubenswrapper[5120]: I0316 16:01:54.285093 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/13a4296c-922e-4316-a6c6-cae50477429b-config-data\") pod \"placement-5d4d9d69db-qcw77\" (UID: \"13a4296c-922e-4316-a6c6-cae50477429b\") " pod="openstack-kuttl-tests/placement-5d4d9d69db-qcw77" Mar 16 16:01:54 crc kubenswrapper[5120]: I0316 16:01:54.285585 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/13a4296c-922e-4316-a6c6-cae50477429b-internal-tls-certs\") pod \"placement-5d4d9d69db-qcw77\" (UID: \"13a4296c-922e-4316-a6c6-cae50477429b\") " pod="openstack-kuttl-tests/placement-5d4d9d69db-qcw77" Mar 16 16:01:54 crc kubenswrapper[5120]: I0316 16:01:54.295633 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2b78\" (UniqueName: \"kubernetes.io/projected/13a4296c-922e-4316-a6c6-cae50477429b-kube-api-access-h2b78\") pod \"placement-5d4d9d69db-qcw77\" (UID: \"13a4296c-922e-4316-a6c6-cae50477429b\") " pod="openstack-kuttl-tests/placement-5d4d9d69db-qcw77" Mar 16 16:01:54 crc kubenswrapper[5120]: I0316 16:01:54.388037 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-5d4d9d69db-qcw77" Mar 16 16:01:54 crc kubenswrapper[5120]: I0316 16:01:54.542477 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:01:54 crc kubenswrapper[5120]: I0316 16:01:54.559917 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"97c05f77-d695-4853-acb9-05388320db3b","Type":"ContainerStarted","Data":"2fb7224a1e61d725ae62ac7949cc94af8bf14dafa656593489f273d049fb501f"} Mar 16 16:01:54 crc kubenswrapper[5120]: I0316 16:01:54.559960 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"97c05f77-d695-4853-acb9-05388320db3b","Type":"ContainerStarted","Data":"b1520153e51d4a82d606d7bba49c21f67cd382240196618d4897d09893562f16"} Mar 16 16:01:54 crc kubenswrapper[5120]: I0316 16:01:54.561621 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-5c58fd7f58-mlf64" event={"ID":"c6827071-9f0c-4934-a287-e8c5797c390b","Type":"ContainerStarted","Data":"c3c4123b5cbd0d36089b7b23b6870cba5e52d6959fe0b7e7a2e2ddfae762753a"} Mar 16 16:01:54 crc kubenswrapper[5120]: I0316 16:01:54.561650 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-5c58fd7f58-mlf64" event={"ID":"c6827071-9f0c-4934-a287-e8c5797c390b","Type":"ContainerStarted","Data":"f79645748efcd2e49ec0b2c1b5f60c1ac7e7366822c9924ba60e8465efd385f8"} Mar 16 16:01:54 crc kubenswrapper[5120]: I0316 16:01:54.622787 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-5cddcbb4cf-kdhzk"] Mar 16 16:01:54 crc kubenswrapper[5120]: I0316 16:01:54.697038 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e7aabe11-b85e-4c50-8a22-4c870b52d36f" path="/var/lib/kubelet/pods/e7aabe11-b85e-4c50-8a22-4c870b52d36f/volumes" Mar 16 16:01:54 crc kubenswrapper[5120]: I0316 16:01:54.698390 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-799cbdd458-hqv8s"] Mar 16 16:01:54 crc kubenswrapper[5120]: I0316 16:01:54.719339 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-f5cb49f4b-mkrgf"] Mar 16 16:01:54 crc kubenswrapper[5120]: I0316 16:01:54.859612 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-5d4d9d69db-qcw77"] Mar 16 16:01:55 crc kubenswrapper[5120]: I0316 16:01:55.130752 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-gqccg" Mar 16 16:01:55 crc kubenswrapper[5120]: I0316 16:01:55.172363 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-8wn9f" Mar 16 16:01:55 crc kubenswrapper[5120]: I0316 16:01:55.302983 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e52ef7fa-31bc-409e-a6eb-5b32a5082208-scripts\") pod \"e52ef7fa-31bc-409e-a6eb-5b32a5082208\" (UID: \"e52ef7fa-31bc-409e-a6eb-5b32a5082208\") " Mar 16 16:01:55 crc kubenswrapper[5120]: I0316 16:01:55.303048 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e52ef7fa-31bc-409e-a6eb-5b32a5082208-config-data\") pod \"e52ef7fa-31bc-409e-a6eb-5b32a5082208\" (UID: \"e52ef7fa-31bc-409e-a6eb-5b32a5082208\") " Mar 16 16:01:55 crc kubenswrapper[5120]: I0316 16:01:55.303118 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e52ef7fa-31bc-409e-a6eb-5b32a5082208-combined-ca-bundle\") pod \"e52ef7fa-31bc-409e-a6eb-5b32a5082208\" (UID: \"e52ef7fa-31bc-409e-a6eb-5b32a5082208\") " Mar 16 16:01:55 crc kubenswrapper[5120]: I0316 16:01:55.303141 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f65851de-c7fc-4d33-af00-c0bd4081b4cc-combined-ca-bundle\") pod \"f65851de-c7fc-4d33-af00-c0bd4081b4cc\" (UID: \"f65851de-c7fc-4d33-af00-c0bd4081b4cc\") " Mar 16 16:01:55 crc kubenswrapper[5120]: I0316 16:01:55.303174 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/e52ef7fa-31bc-409e-a6eb-5b32a5082208-credential-keys\") pod \"e52ef7fa-31bc-409e-a6eb-5b32a5082208\" (UID: \"e52ef7fa-31bc-409e-a6eb-5b32a5082208\") " Mar 16 16:01:55 crc kubenswrapper[5120]: I0316 16:01:55.303288 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bh6ln\" (UniqueName: \"kubernetes.io/projected/e52ef7fa-31bc-409e-a6eb-5b32a5082208-kube-api-access-bh6ln\") pod \"e52ef7fa-31bc-409e-a6eb-5b32a5082208\" (UID: \"e52ef7fa-31bc-409e-a6eb-5b32a5082208\") " Mar 16 16:01:55 crc kubenswrapper[5120]: I0316 16:01:55.303379 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f65851de-c7fc-4d33-af00-c0bd4081b4cc-config\") pod \"f65851de-c7fc-4d33-af00-c0bd4081b4cc\" (UID: \"f65851de-c7fc-4d33-af00-c0bd4081b4cc\") " Mar 16 16:01:55 crc kubenswrapper[5120]: I0316 16:01:55.303457 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/e52ef7fa-31bc-409e-a6eb-5b32a5082208-fernet-keys\") pod \"e52ef7fa-31bc-409e-a6eb-5b32a5082208\" (UID: \"e52ef7fa-31bc-409e-a6eb-5b32a5082208\") " Mar 16 16:01:55 crc kubenswrapper[5120]: I0316 16:01:55.303565 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z7ghr\" (UniqueName: \"kubernetes.io/projected/f65851de-c7fc-4d33-af00-c0bd4081b4cc-kube-api-access-z7ghr\") pod \"f65851de-c7fc-4d33-af00-c0bd4081b4cc\" (UID: \"f65851de-c7fc-4d33-af00-c0bd4081b4cc\") " Mar 16 16:01:55 crc kubenswrapper[5120]: I0316 16:01:55.336436 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-rlkfm" Mar 16 16:01:55 crc kubenswrapper[5120]: I0316 16:01:55.363977 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e52ef7fa-31bc-409e-a6eb-5b32a5082208-scripts" (OuterVolumeSpecName: "scripts") pod "e52ef7fa-31bc-409e-a6eb-5b32a5082208" (UID: "e52ef7fa-31bc-409e-a6eb-5b32a5082208"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:01:55 crc kubenswrapper[5120]: I0316 16:01:55.369085 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f65851de-c7fc-4d33-af00-c0bd4081b4cc-kube-api-access-z7ghr" (OuterVolumeSpecName: "kube-api-access-z7ghr") pod "f65851de-c7fc-4d33-af00-c0bd4081b4cc" (UID: "f65851de-c7fc-4d33-af00-c0bd4081b4cc"). InnerVolumeSpecName "kube-api-access-z7ghr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:01:55 crc kubenswrapper[5120]: I0316 16:01:55.394522 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e52ef7fa-31bc-409e-a6eb-5b32a5082208-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "e52ef7fa-31bc-409e-a6eb-5b32a5082208" (UID: "e52ef7fa-31bc-409e-a6eb-5b32a5082208"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:01:55 crc kubenswrapper[5120]: I0316 16:01:55.394826 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e52ef7fa-31bc-409e-a6eb-5b32a5082208-kube-api-access-bh6ln" (OuterVolumeSpecName: "kube-api-access-bh6ln") pod "e52ef7fa-31bc-409e-a6eb-5b32a5082208" (UID: "e52ef7fa-31bc-409e-a6eb-5b32a5082208"). InnerVolumeSpecName "kube-api-access-bh6ln". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:01:55 crc kubenswrapper[5120]: I0316 16:01:55.399782 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e52ef7fa-31bc-409e-a6eb-5b32a5082208-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "e52ef7fa-31bc-409e-a6eb-5b32a5082208" (UID: "e52ef7fa-31bc-409e-a6eb-5b32a5082208"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:01:55 crc kubenswrapper[5120]: I0316 16:01:55.399902 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:01:55 crc kubenswrapper[5120]: I0316 16:01:55.406000 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z7ghr\" (UniqueName: \"kubernetes.io/projected/f65851de-c7fc-4d33-af00-c0bd4081b4cc-kube-api-access-z7ghr\") on node \"crc\" DevicePath \"\"" Mar 16 16:01:55 crc kubenswrapper[5120]: I0316 16:01:55.406231 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e52ef7fa-31bc-409e-a6eb-5b32a5082208-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:01:55 crc kubenswrapper[5120]: I0316 16:01:55.406363 5120 reconciler_common.go:299] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/e52ef7fa-31bc-409e-a6eb-5b32a5082208-credential-keys\") on node \"crc\" DevicePath \"\"" Mar 16 16:01:55 crc kubenswrapper[5120]: I0316 16:01:55.406440 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bh6ln\" (UniqueName: \"kubernetes.io/projected/e52ef7fa-31bc-409e-a6eb-5b32a5082208-kube-api-access-bh6ln\") on node \"crc\" DevicePath \"\"" Mar 16 16:01:55 crc kubenswrapper[5120]: I0316 16:01:55.406509 5120 reconciler_common.go:299] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/e52ef7fa-31bc-409e-a6eb-5b32a5082208-fernet-keys\") on node \"crc\" DevicePath \"\"" Mar 16 16:01:55 crc kubenswrapper[5120]: I0316 16:01:55.439120 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f65851de-c7fc-4d33-af00-c0bd4081b4cc-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f65851de-c7fc-4d33-af00-c0bd4081b4cc" (UID: "f65851de-c7fc-4d33-af00-c0bd4081b4cc"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:01:55 crc kubenswrapper[5120]: I0316 16:01:55.458861 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e52ef7fa-31bc-409e-a6eb-5b32a5082208-config-data" (OuterVolumeSpecName: "config-data") pod "e52ef7fa-31bc-409e-a6eb-5b32a5082208" (UID: "e52ef7fa-31bc-409e-a6eb-5b32a5082208"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:01:55 crc kubenswrapper[5120]: I0316 16:01:55.471864 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f65851de-c7fc-4d33-af00-c0bd4081b4cc-config" (OuterVolumeSpecName: "config") pod "f65851de-c7fc-4d33-af00-c0bd4081b4cc" (UID: "f65851de-c7fc-4d33-af00-c0bd4081b4cc"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:01:55 crc kubenswrapper[5120]: I0316 16:01:55.475104 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e52ef7fa-31bc-409e-a6eb-5b32a5082208-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e52ef7fa-31bc-409e-a6eb-5b32a5082208" (UID: "e52ef7fa-31bc-409e-a6eb-5b32a5082208"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:01:55 crc kubenswrapper[5120]: I0316 16:01:55.508801 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/ace8fafc-b3ed-4c95-8769-9f226ef3506f-db-sync-config-data\") pod \"ace8fafc-b3ed-4c95-8769-9f226ef3506f\" (UID: \"ace8fafc-b3ed-4c95-8769-9f226ef3506f\") " Mar 16 16:01:55 crc kubenswrapper[5120]: I0316 16:01:55.508846 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ace8fafc-b3ed-4c95-8769-9f226ef3506f-scripts\") pod \"ace8fafc-b3ed-4c95-8769-9f226ef3506f\" (UID: \"ace8fafc-b3ed-4c95-8769-9f226ef3506f\") " Mar 16 16:01:55 crc kubenswrapper[5120]: I0316 16:01:55.509205 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ace8fafc-b3ed-4c95-8769-9f226ef3506f-config-data\") pod \"ace8fafc-b3ed-4c95-8769-9f226ef3506f\" (UID: \"ace8fafc-b3ed-4c95-8769-9f226ef3506f\") " Mar 16 16:01:55 crc kubenswrapper[5120]: I0316 16:01:55.509526 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/ace8fafc-b3ed-4c95-8769-9f226ef3506f-etc-machine-id\") pod \"ace8fafc-b3ed-4c95-8769-9f226ef3506f\" (UID: \"ace8fafc-b3ed-4c95-8769-9f226ef3506f\") " Mar 16 16:01:55 crc kubenswrapper[5120]: I0316 16:01:55.509614 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ql6hb\" (UniqueName: \"kubernetes.io/projected/ace8fafc-b3ed-4c95-8769-9f226ef3506f-kube-api-access-ql6hb\") pod \"ace8fafc-b3ed-4c95-8769-9f226ef3506f\" (UID: \"ace8fafc-b3ed-4c95-8769-9f226ef3506f\") " Mar 16 16:01:55 crc kubenswrapper[5120]: I0316 16:01:55.509645 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/ace8fafc-b3ed-4c95-8769-9f226ef3506f-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "ace8fafc-b3ed-4c95-8769-9f226ef3506f" (UID: "ace8fafc-b3ed-4c95-8769-9f226ef3506f"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 16:01:55 crc kubenswrapper[5120]: I0316 16:01:55.509680 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ace8fafc-b3ed-4c95-8769-9f226ef3506f-combined-ca-bundle\") pod \"ace8fafc-b3ed-4c95-8769-9f226ef3506f\" (UID: \"ace8fafc-b3ed-4c95-8769-9f226ef3506f\") " Mar 16 16:01:55 crc kubenswrapper[5120]: I0316 16:01:55.515882 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ace8fafc-b3ed-4c95-8769-9f226ef3506f-scripts" (OuterVolumeSpecName: "scripts") pod "ace8fafc-b3ed-4c95-8769-9f226ef3506f" (UID: "ace8fafc-b3ed-4c95-8769-9f226ef3506f"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:01:55 crc kubenswrapper[5120]: I0316 16:01:55.516237 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ace8fafc-b3ed-4c95-8769-9f226ef3506f-db-sync-config-data" (OuterVolumeSpecName: "db-sync-config-data") pod "ace8fafc-b3ed-4c95-8769-9f226ef3506f" (UID: "ace8fafc-b3ed-4c95-8769-9f226ef3506f"). InnerVolumeSpecName "db-sync-config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:01:55 crc kubenswrapper[5120]: I0316 16:01:55.520361 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e52ef7fa-31bc-409e-a6eb-5b32a5082208-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:01:55 crc kubenswrapper[5120]: I0316 16:01:55.520468 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e52ef7fa-31bc-409e-a6eb-5b32a5082208-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:01:55 crc kubenswrapper[5120]: I0316 16:01:55.520540 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f65851de-c7fc-4d33-af00-c0bd4081b4cc-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:01:55 crc kubenswrapper[5120]: I0316 16:01:55.520604 5120 reconciler_common.go:299] "Volume detached for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/ace8fafc-b3ed-4c95-8769-9f226ef3506f-db-sync-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:01:55 crc kubenswrapper[5120]: I0316 16:01:55.520675 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ace8fafc-b3ed-4c95-8769-9f226ef3506f-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:01:55 crc kubenswrapper[5120]: I0316 16:01:55.520750 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/f65851de-c7fc-4d33-af00-c0bd4081b4cc-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:01:55 crc kubenswrapper[5120]: I0316 16:01:55.520843 5120 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/ace8fafc-b3ed-4c95-8769-9f226ef3506f-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 16:01:55 crc kubenswrapper[5120]: I0316 16:01:55.523054 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ace8fafc-b3ed-4c95-8769-9f226ef3506f-kube-api-access-ql6hb" (OuterVolumeSpecName: "kube-api-access-ql6hb") pod "ace8fafc-b3ed-4c95-8769-9f226ef3506f" (UID: "ace8fafc-b3ed-4c95-8769-9f226ef3506f"). InnerVolumeSpecName "kube-api-access-ql6hb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:01:55 crc kubenswrapper[5120]: I0316 16:01:55.584383 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-rlkfm" event={"ID":"ace8fafc-b3ed-4c95-8769-9f226ef3506f","Type":"ContainerDied","Data":"6de290241d4c1ee457ca8a76277acf7682d2d959541a4635de9a26558d3f5aa5"} Mar 16 16:01:55 crc kubenswrapper[5120]: I0316 16:01:55.584444 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6de290241d4c1ee457ca8a76277acf7682d2d959541a4635de9a26558d3f5aa5" Mar 16 16:01:55 crc kubenswrapper[5120]: I0316 16:01:55.584526 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-rlkfm" Mar 16 16:01:55 crc kubenswrapper[5120]: I0316 16:01:55.613711 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-f5cb49f4b-mkrgf" event={"ID":"a1a6ef57-0689-4731-8c35-b337908ae72b","Type":"ContainerStarted","Data":"fad15cdcf9dfe90af4f387d9ff64f4894ba5d311cc01c07b0b4676be0a50bbe3"} Mar 16 16:01:55 crc kubenswrapper[5120]: I0316 16:01:55.613909 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-f5cb49f4b-mkrgf" event={"ID":"a1a6ef57-0689-4731-8c35-b337908ae72b","Type":"ContainerStarted","Data":"b6378d8ea4ab166bf232fe6c0df9434cd6493b5671fbed766bf2a8cb6b31baad"} Mar 16 16:01:55 crc kubenswrapper[5120]: I0316 16:01:55.618304 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-5cddcbb4cf-kdhzk" event={"ID":"1daafc71-9f0a-4fe4-953c-1e00eab0fbfa","Type":"ContainerStarted","Data":"5dbfdd92dc8c04f1b01cb39317fa31ce9267d193611d555f654b75d0820e48f3"} Mar 16 16:01:55 crc kubenswrapper[5120]: I0316 16:01:55.618353 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-5cddcbb4cf-kdhzk" event={"ID":"1daafc71-9f0a-4fe4-953c-1e00eab0fbfa","Type":"ContainerStarted","Data":"0a7a9ae679a36fd51a38c417e5abb1bbc39c72fb1ba04aca4924ed3304f11aae"} Mar 16 16:01:55 crc kubenswrapper[5120]: I0316 16:01:55.619418 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-8wn9f" event={"ID":"e52ef7fa-31bc-409e-a6eb-5b32a5082208","Type":"ContainerDied","Data":"394e9774a09dd4f6ff2c133b3ce4dbf642479e2158ecf4b57d01f79419486617"} Mar 16 16:01:55 crc kubenswrapper[5120]: I0316 16:01:55.619435 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="394e9774a09dd4f6ff2c133b3ce4dbf642479e2158ecf4b57d01f79419486617" Mar 16 16:01:55 crc kubenswrapper[5120]: I0316 16:01:55.619494 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-8wn9f" Mar 16 16:01:55 crc kubenswrapper[5120]: I0316 16:01:55.622108 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ql6hb\" (UniqueName: \"kubernetes.io/projected/ace8fafc-b3ed-4c95-8769-9f226ef3506f-kube-api-access-ql6hb\") on node \"crc\" DevicePath \"\"" Mar 16 16:01:55 crc kubenswrapper[5120]: I0316 16:01:55.632024 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-799cbdd458-hqv8s" event={"ID":"ca9332c4-7b03-4296-9cb8-b5fdcd487025","Type":"ContainerStarted","Data":"a5d78734ec5e51ecd5fabe3bc893cb3749cd425b3dad9606dc42a10506307e94"} Mar 16 16:01:55 crc kubenswrapper[5120]: I0316 16:01:55.632079 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-799cbdd458-hqv8s" event={"ID":"ca9332c4-7b03-4296-9cb8-b5fdcd487025","Type":"ContainerStarted","Data":"f2ed0173d6dadde2b800d7ef32e3d4858baa80e203e88de189317a91c01b3b96"} Mar 16 16:01:55 crc kubenswrapper[5120]: I0316 16:01:55.656709 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-5c58fd7f58-mlf64" event={"ID":"c6827071-9f0c-4934-a287-e8c5797c390b","Type":"ContainerStarted","Data":"d91421927778a07c9c37a08ed8e999b4757e0ecdfe9406c6ece2e2ed38961bb9"} Mar 16 16:01:55 crc kubenswrapper[5120]: I0316 16:01:55.682072 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-5d4d9d69db-qcw77" event={"ID":"13a4296c-922e-4316-a6c6-cae50477429b","Type":"ContainerStarted","Data":"eb2e70376153ba3be267176a6919aca0b69370446f9cd2fd72907d52ec73ad19"} Mar 16 16:01:55 crc kubenswrapper[5120]: I0316 16:01:55.682120 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-5d4d9d69db-qcw77" event={"ID":"13a4296c-922e-4316-a6c6-cae50477429b","Type":"ContainerStarted","Data":"a94944724879327e7a5bee38f898f9d27c6723d77bd0441d925877f6a509e574"} Mar 16 16:01:55 crc kubenswrapper[5120]: I0316 16:01:55.713263 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-5b779bfdf-px7gw"] Mar 16 16:01:55 crc kubenswrapper[5120]: I0316 16:01:55.714461 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f65851de-c7fc-4d33-af00-c0bd4081b4cc" containerName="neutron-db-sync" Mar 16 16:01:55 crc kubenswrapper[5120]: I0316 16:01:55.714474 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f65851de-c7fc-4d33-af00-c0bd4081b4cc" containerName="neutron-db-sync" Mar 16 16:01:55 crc kubenswrapper[5120]: I0316 16:01:55.714506 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e52ef7fa-31bc-409e-a6eb-5b32a5082208" containerName="keystone-bootstrap" Mar 16 16:01:55 crc kubenswrapper[5120]: I0316 16:01:55.714514 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e52ef7fa-31bc-409e-a6eb-5b32a5082208" containerName="keystone-bootstrap" Mar 16 16:01:55 crc kubenswrapper[5120]: I0316 16:01:55.714527 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ace8fafc-b3ed-4c95-8769-9f226ef3506f" containerName="cinder-db-sync" Mar 16 16:01:55 crc kubenswrapper[5120]: I0316 16:01:55.714532 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ace8fafc-b3ed-4c95-8769-9f226ef3506f" containerName="cinder-db-sync" Mar 16 16:01:55 crc kubenswrapper[5120]: I0316 16:01:55.714700 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f65851de-c7fc-4d33-af00-c0bd4081b4cc" containerName="neutron-db-sync" Mar 16 16:01:55 crc kubenswrapper[5120]: I0316 16:01:55.714710 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ace8fafc-b3ed-4c95-8769-9f226ef3506f" containerName="cinder-db-sync" Mar 16 16:01:55 crc kubenswrapper[5120]: I0316 16:01:55.714728 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e52ef7fa-31bc-409e-a6eb-5b32a5082208" containerName="keystone-bootstrap" Mar 16 16:01:55 crc kubenswrapper[5120]: I0316 16:01:55.715135 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-gqccg" Mar 16 16:01:55 crc kubenswrapper[5120]: I0316 16:01:55.753629 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-keystone-listener-5c58fd7f58-mlf64" podStartSLOduration=2.753611592 podStartE2EDuration="2.753611592s" podCreationTimestamp="2026-03-16 16:01:53 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:01:55.713616911 +0000 UTC m=+1817.867548568" watchObservedRunningTime="2026-03-16 16:01:55.753611592 +0000 UTC m=+1817.907543249" Mar 16 16:01:55 crc kubenswrapper[5120]: I0316 16:01:55.758256 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-gqccg" event={"ID":"f65851de-c7fc-4d33-af00-c0bd4081b4cc","Type":"ContainerDied","Data":"f192344aa6121d03c20d57b48dc67f75d2997b481433ab05fa5bf927def27e4f"} Mar 16 16:01:55 crc kubenswrapper[5120]: I0316 16:01:55.758309 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f192344aa6121d03c20d57b48dc67f75d2997b481433ab05fa5bf927def27e4f" Mar 16 16:01:55 crc kubenswrapper[5120]: I0316 16:01:55.758430 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-5b779bfdf-px7gw" Mar 16 16:01:55 crc kubenswrapper[5120]: I0316 16:01:55.762773 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"ee138521-8f48-4215-9e58-cf1d50ad7910","Type":"ContainerStarted","Data":"fd19044e11895a17402693257502eb83df372f4ff20e42eae6cbafafdae34feb"} Mar 16 16:01:55 crc kubenswrapper[5120]: I0316 16:01:55.779738 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-httpd-config\"" Mar 16 16:01:55 crc kubenswrapper[5120]: I0316 16:01:55.779921 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-neutron-dockercfg-6r2bm\"" Mar 16 16:01:55 crc kubenswrapper[5120]: I0316 16:01:55.780028 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-config\"" Mar 16 16:01:55 crc kubenswrapper[5120]: I0316 16:01:55.795197 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-neutron-ovndbs\"" Mar 16 16:01:55 crc kubenswrapper[5120]: I0316 16:01:55.826326 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-8wn9f"] Mar 16 16:01:55 crc kubenswrapper[5120]: I0316 16:01:55.870875 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-8wn9f"] Mar 16 16:01:55 crc kubenswrapper[5120]: I0316 16:01:55.900847 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-5b779bfdf-px7gw"] Mar 16 16:01:55 crc kubenswrapper[5120]: I0316 16:01:55.938974 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-fdvcj"] Mar 16 16:01:55 crc kubenswrapper[5120]: I0316 16:01:55.943020 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bfe56c80-c472-49dc-8971-db5052d61898-combined-ca-bundle\") pod \"neutron-5b779bfdf-px7gw\" (UID: \"bfe56c80-c472-49dc-8971-db5052d61898\") " pod="openstack-kuttl-tests/neutron-5b779bfdf-px7gw" Mar 16 16:01:55 crc kubenswrapper[5120]: I0316 16:01:55.943057 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/bfe56c80-c472-49dc-8971-db5052d61898-config\") pod \"neutron-5b779bfdf-px7gw\" (UID: \"bfe56c80-c472-49dc-8971-db5052d61898\") " pod="openstack-kuttl-tests/neutron-5b779bfdf-px7gw" Mar 16 16:01:55 crc kubenswrapper[5120]: I0316 16:01:55.943081 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggjfl\" (UniqueName: \"kubernetes.io/projected/bfe56c80-c472-49dc-8971-db5052d61898-kube-api-access-ggjfl\") pod \"neutron-5b779bfdf-px7gw\" (UID: \"bfe56c80-c472-49dc-8971-db5052d61898\") " pod="openstack-kuttl-tests/neutron-5b779bfdf-px7gw" Mar 16 16:01:55 crc kubenswrapper[5120]: I0316 16:01:55.943236 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/bfe56c80-c472-49dc-8971-db5052d61898-httpd-config\") pod \"neutron-5b779bfdf-px7gw\" (UID: \"bfe56c80-c472-49dc-8971-db5052d61898\") " pod="openstack-kuttl-tests/neutron-5b779bfdf-px7gw" Mar 16 16:01:55 crc kubenswrapper[5120]: I0316 16:01:55.943316 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/bfe56c80-c472-49dc-8971-db5052d61898-ovndb-tls-certs\") pod \"neutron-5b779bfdf-px7gw\" (UID: \"bfe56c80-c472-49dc-8971-db5052d61898\") " pod="openstack-kuttl-tests/neutron-5b779bfdf-px7gw" Mar 16 16:01:55 crc kubenswrapper[5120]: I0316 16:01:55.945510 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-fdvcj" Mar 16 16:01:55 crc kubenswrapper[5120]: I0316 16:01:55.950298 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone\"" Mar 16 16:01:55 crc kubenswrapper[5120]: I0316 16:01:55.950510 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"osp-secret\"" Mar 16 16:01:55 crc kubenswrapper[5120]: I0316 16:01:55.950694 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-config-data\"" Mar 16 16:01:55 crc kubenswrapper[5120]: I0316 16:01:55.950791 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-scripts\"" Mar 16 16:01:55 crc kubenswrapper[5120]: I0316 16:01:55.953206 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-keystone-dockercfg-dsstd\"" Mar 16 16:01:55 crc kubenswrapper[5120]: I0316 16:01:55.965820 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-fdvcj"] Mar 16 16:01:55 crc kubenswrapper[5120]: I0316 16:01:55.984103 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:01:56 crc kubenswrapper[5120]: I0316 16:01:56.001987 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:01:56 crc kubenswrapper[5120]: I0316 16:01:56.006619 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-scheduler-config-data\"" Mar 16 16:01:56 crc kubenswrapper[5120]: I0316 16:01:56.015824 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:01:56 crc kubenswrapper[5120]: I0316 16:01:56.044459 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/bfe56c80-c472-49dc-8971-db5052d61898-httpd-config\") pod \"neutron-5b779bfdf-px7gw\" (UID: \"bfe56c80-c472-49dc-8971-db5052d61898\") " pod="openstack-kuttl-tests/neutron-5b779bfdf-px7gw" Mar 16 16:01:56 crc kubenswrapper[5120]: I0316 16:01:56.044523 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cb8bda64-dcf7-461e-a963-74aeeec060fd-config-data\") pod \"keystone-bootstrap-fdvcj\" (UID: \"cb8bda64-dcf7-461e-a963-74aeeec060fd\") " pod="openstack-kuttl-tests/keystone-bootstrap-fdvcj" Mar 16 16:01:56 crc kubenswrapper[5120]: I0316 16:01:56.044562 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cb8bda64-dcf7-461e-a963-74aeeec060fd-combined-ca-bundle\") pod \"keystone-bootstrap-fdvcj\" (UID: \"cb8bda64-dcf7-461e-a963-74aeeec060fd\") " pod="openstack-kuttl-tests/keystone-bootstrap-fdvcj" Mar 16 16:01:56 crc kubenswrapper[5120]: I0316 16:01:56.044583 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/cb8bda64-dcf7-461e-a963-74aeeec060fd-credential-keys\") pod \"keystone-bootstrap-fdvcj\" (UID: \"cb8bda64-dcf7-461e-a963-74aeeec060fd\") " pod="openstack-kuttl-tests/keystone-bootstrap-fdvcj" Mar 16 16:01:56 crc kubenswrapper[5120]: I0316 16:01:56.044618 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/cb8bda64-dcf7-461e-a963-74aeeec060fd-fernet-keys\") pod \"keystone-bootstrap-fdvcj\" (UID: \"cb8bda64-dcf7-461e-a963-74aeeec060fd\") " pod="openstack-kuttl-tests/keystone-bootstrap-fdvcj" Mar 16 16:01:56 crc kubenswrapper[5120]: I0316 16:01:56.044649 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/bfe56c80-c472-49dc-8971-db5052d61898-ovndb-tls-certs\") pod \"neutron-5b779bfdf-px7gw\" (UID: \"bfe56c80-c472-49dc-8971-db5052d61898\") " pod="openstack-kuttl-tests/neutron-5b779bfdf-px7gw" Mar 16 16:01:56 crc kubenswrapper[5120]: I0316 16:01:56.044673 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/cb8bda64-dcf7-461e-a963-74aeeec060fd-scripts\") pod \"keystone-bootstrap-fdvcj\" (UID: \"cb8bda64-dcf7-461e-a963-74aeeec060fd\") " pod="openstack-kuttl-tests/keystone-bootstrap-fdvcj" Mar 16 16:01:56 crc kubenswrapper[5120]: I0316 16:01:56.044695 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bfe56c80-c472-49dc-8971-db5052d61898-combined-ca-bundle\") pod \"neutron-5b779bfdf-px7gw\" (UID: \"bfe56c80-c472-49dc-8971-db5052d61898\") " pod="openstack-kuttl-tests/neutron-5b779bfdf-px7gw" Mar 16 16:01:56 crc kubenswrapper[5120]: I0316 16:01:56.044721 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/bfe56c80-c472-49dc-8971-db5052d61898-config\") pod \"neutron-5b779bfdf-px7gw\" (UID: \"bfe56c80-c472-49dc-8971-db5052d61898\") " pod="openstack-kuttl-tests/neutron-5b779bfdf-px7gw" Mar 16 16:01:56 crc kubenswrapper[5120]: I0316 16:01:56.044748 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ggjfl\" (UniqueName: \"kubernetes.io/projected/bfe56c80-c472-49dc-8971-db5052d61898-kube-api-access-ggjfl\") pod \"neutron-5b779bfdf-px7gw\" (UID: \"bfe56c80-c472-49dc-8971-db5052d61898\") " pod="openstack-kuttl-tests/neutron-5b779bfdf-px7gw" Mar 16 16:01:56 crc kubenswrapper[5120]: I0316 16:01:56.044847 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8f5h\" (UniqueName: \"kubernetes.io/projected/cb8bda64-dcf7-461e-a963-74aeeec060fd-kube-api-access-b8f5h\") pod \"keystone-bootstrap-fdvcj\" (UID: \"cb8bda64-dcf7-461e-a963-74aeeec060fd\") " pod="openstack-kuttl-tests/keystone-bootstrap-fdvcj" Mar 16 16:01:56 crc kubenswrapper[5120]: I0316 16:01:56.100836 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:01:56 crc kubenswrapper[5120]: I0316 16:01:56.111183 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:01:56 crc kubenswrapper[5120]: I0316 16:01:56.111300 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:01:56 crc kubenswrapper[5120]: I0316 16:01:56.116258 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-api-config-data\"" Mar 16 16:01:56 crc kubenswrapper[5120]: I0316 16:01:56.144452 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/bfe56c80-c472-49dc-8971-db5052d61898-ovndb-tls-certs\") pod \"neutron-5b779bfdf-px7gw\" (UID: \"bfe56c80-c472-49dc-8971-db5052d61898\") " pod="openstack-kuttl-tests/neutron-5b779bfdf-px7gw" Mar 16 16:01:56 crc kubenswrapper[5120]: I0316 16:01:56.146178 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnccw\" (UniqueName: \"kubernetes.io/projected/9e30c205-c2b2-4766-8777-6b2730f5172a-kube-api-access-rnccw\") pod \"cinder-scheduler-0\" (UID: \"9e30c205-c2b2-4766-8777-6b2730f5172a\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:01:56 crc kubenswrapper[5120]: I0316 16:01:56.146236 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9e30c205-c2b2-4766-8777-6b2730f5172a-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"9e30c205-c2b2-4766-8777-6b2730f5172a\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:01:56 crc kubenswrapper[5120]: I0316 16:01:56.146287 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/9e30c205-c2b2-4766-8777-6b2730f5172a-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"9e30c205-c2b2-4766-8777-6b2730f5172a\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:01:56 crc kubenswrapper[5120]: I0316 16:01:56.146339 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cb8bda64-dcf7-461e-a963-74aeeec060fd-config-data\") pod \"keystone-bootstrap-fdvcj\" (UID: \"cb8bda64-dcf7-461e-a963-74aeeec060fd\") " pod="openstack-kuttl-tests/keystone-bootstrap-fdvcj" Mar 16 16:01:56 crc kubenswrapper[5120]: I0316 16:01:56.146378 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cb8bda64-dcf7-461e-a963-74aeeec060fd-combined-ca-bundle\") pod \"keystone-bootstrap-fdvcj\" (UID: \"cb8bda64-dcf7-461e-a963-74aeeec060fd\") " pod="openstack-kuttl-tests/keystone-bootstrap-fdvcj" Mar 16 16:01:56 crc kubenswrapper[5120]: I0316 16:01:56.146395 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/cb8bda64-dcf7-461e-a963-74aeeec060fd-credential-keys\") pod \"keystone-bootstrap-fdvcj\" (UID: \"cb8bda64-dcf7-461e-a963-74aeeec060fd\") " pod="openstack-kuttl-tests/keystone-bootstrap-fdvcj" Mar 16 16:01:56 crc kubenswrapper[5120]: I0316 16:01:56.146436 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/cb8bda64-dcf7-461e-a963-74aeeec060fd-fernet-keys\") pod \"keystone-bootstrap-fdvcj\" (UID: \"cb8bda64-dcf7-461e-a963-74aeeec060fd\") " pod="openstack-kuttl-tests/keystone-bootstrap-fdvcj" Mar 16 16:01:56 crc kubenswrapper[5120]: I0316 16:01:56.146479 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/cb8bda64-dcf7-461e-a963-74aeeec060fd-scripts\") pod \"keystone-bootstrap-fdvcj\" (UID: \"cb8bda64-dcf7-461e-a963-74aeeec060fd\") " pod="openstack-kuttl-tests/keystone-bootstrap-fdvcj" Mar 16 16:01:56 crc kubenswrapper[5120]: I0316 16:01:56.146482 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bfe56c80-c472-49dc-8971-db5052d61898-combined-ca-bundle\") pod \"neutron-5b779bfdf-px7gw\" (UID: \"bfe56c80-c472-49dc-8971-db5052d61898\") " pod="openstack-kuttl-tests/neutron-5b779bfdf-px7gw" Mar 16 16:01:56 crc kubenswrapper[5120]: I0316 16:01:56.146961 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/bfe56c80-c472-49dc-8971-db5052d61898-config\") pod \"neutron-5b779bfdf-px7gw\" (UID: \"bfe56c80-c472-49dc-8971-db5052d61898\") " pod="openstack-kuttl-tests/neutron-5b779bfdf-px7gw" Mar 16 16:01:56 crc kubenswrapper[5120]: I0316 16:01:56.147001 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9e30c205-c2b2-4766-8777-6b2730f5172a-config-data\") pod \"cinder-scheduler-0\" (UID: \"9e30c205-c2b2-4766-8777-6b2730f5172a\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:01:56 crc kubenswrapper[5120]: I0316 16:01:56.147874 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/bfe56c80-c472-49dc-8971-db5052d61898-httpd-config\") pod \"neutron-5b779bfdf-px7gw\" (UID: \"bfe56c80-c472-49dc-8971-db5052d61898\") " pod="openstack-kuttl-tests/neutron-5b779bfdf-px7gw" Mar 16 16:01:56 crc kubenswrapper[5120]: I0316 16:01:56.150109 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/9e30c205-c2b2-4766-8777-6b2730f5172a-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"9e30c205-c2b2-4766-8777-6b2730f5172a\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:01:56 crc kubenswrapper[5120]: I0316 16:01:56.150351 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9e30c205-c2b2-4766-8777-6b2730f5172a-scripts\") pod \"cinder-scheduler-0\" (UID: \"9e30c205-c2b2-4766-8777-6b2730f5172a\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:01:56 crc kubenswrapper[5120]: I0316 16:01:56.150507 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b8f5h\" (UniqueName: \"kubernetes.io/projected/cb8bda64-dcf7-461e-a963-74aeeec060fd-kube-api-access-b8f5h\") pod \"keystone-bootstrap-fdvcj\" (UID: \"cb8bda64-dcf7-461e-a963-74aeeec060fd\") " pod="openstack-kuttl-tests/keystone-bootstrap-fdvcj" Mar 16 16:01:56 crc kubenswrapper[5120]: I0316 16:01:56.150660 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/cb8bda64-dcf7-461e-a963-74aeeec060fd-credential-keys\") pod \"keystone-bootstrap-fdvcj\" (UID: \"cb8bda64-dcf7-461e-a963-74aeeec060fd\") " pod="openstack-kuttl-tests/keystone-bootstrap-fdvcj" Mar 16 16:01:56 crc kubenswrapper[5120]: I0316 16:01:56.151617 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggjfl\" (UniqueName: \"kubernetes.io/projected/bfe56c80-c472-49dc-8971-db5052d61898-kube-api-access-ggjfl\") pod \"neutron-5b779bfdf-px7gw\" (UID: \"bfe56c80-c472-49dc-8971-db5052d61898\") " pod="openstack-kuttl-tests/neutron-5b779bfdf-px7gw" Mar 16 16:01:56 crc kubenswrapper[5120]: I0316 16:01:56.158893 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cb8bda64-dcf7-461e-a963-74aeeec060fd-config-data\") pod \"keystone-bootstrap-fdvcj\" (UID: \"cb8bda64-dcf7-461e-a963-74aeeec060fd\") " pod="openstack-kuttl-tests/keystone-bootstrap-fdvcj" Mar 16 16:01:56 crc kubenswrapper[5120]: I0316 16:01:56.163394 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/cb8bda64-dcf7-461e-a963-74aeeec060fd-fernet-keys\") pod \"keystone-bootstrap-fdvcj\" (UID: \"cb8bda64-dcf7-461e-a963-74aeeec060fd\") " pod="openstack-kuttl-tests/keystone-bootstrap-fdvcj" Mar 16 16:01:56 crc kubenswrapper[5120]: I0316 16:01:56.190271 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8f5h\" (UniqueName: \"kubernetes.io/projected/cb8bda64-dcf7-461e-a963-74aeeec060fd-kube-api-access-b8f5h\") pod \"keystone-bootstrap-fdvcj\" (UID: \"cb8bda64-dcf7-461e-a963-74aeeec060fd\") " pod="openstack-kuttl-tests/keystone-bootstrap-fdvcj" Mar 16 16:01:56 crc kubenswrapper[5120]: I0316 16:01:56.203018 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/cb8bda64-dcf7-461e-a963-74aeeec060fd-scripts\") pod \"keystone-bootstrap-fdvcj\" (UID: \"cb8bda64-dcf7-461e-a963-74aeeec060fd\") " pod="openstack-kuttl-tests/keystone-bootstrap-fdvcj" Mar 16 16:01:56 crc kubenswrapper[5120]: I0316 16:01:56.214476 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cb8bda64-dcf7-461e-a963-74aeeec060fd-combined-ca-bundle\") pod \"keystone-bootstrap-fdvcj\" (UID: \"cb8bda64-dcf7-461e-a963-74aeeec060fd\") " pod="openstack-kuttl-tests/keystone-bootstrap-fdvcj" Mar 16 16:01:56 crc kubenswrapper[5120]: I0316 16:01:56.252736 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/163efc0d-017d-48a3-b592-8053b3a30dfb-scripts\") pod \"cinder-api-0\" (UID: \"163efc0d-017d-48a3-b592-8053b3a30dfb\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:01:56 crc kubenswrapper[5120]: I0316 16:01:56.252821 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/163efc0d-017d-48a3-b592-8053b3a30dfb-config-data\") pod \"cinder-api-0\" (UID: \"163efc0d-017d-48a3-b592-8053b3a30dfb\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:01:56 crc kubenswrapper[5120]: I0316 16:01:56.252848 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9e30c205-c2b2-4766-8777-6b2730f5172a-config-data\") pod \"cinder-scheduler-0\" (UID: \"9e30c205-c2b2-4766-8777-6b2730f5172a\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:01:56 crc kubenswrapper[5120]: I0316 16:01:56.252866 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/163efc0d-017d-48a3-b592-8053b3a30dfb-config-data-custom\") pod \"cinder-api-0\" (UID: \"163efc0d-017d-48a3-b592-8053b3a30dfb\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:01:56 crc kubenswrapper[5120]: I0316 16:01:56.252897 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/9e30c205-c2b2-4766-8777-6b2730f5172a-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"9e30c205-c2b2-4766-8777-6b2730f5172a\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:01:56 crc kubenswrapper[5120]: I0316 16:01:56.252918 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9e30c205-c2b2-4766-8777-6b2730f5172a-scripts\") pod \"cinder-scheduler-0\" (UID: \"9e30c205-c2b2-4766-8777-6b2730f5172a\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:01:56 crc kubenswrapper[5120]: I0316 16:01:56.252934 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/163efc0d-017d-48a3-b592-8053b3a30dfb-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"163efc0d-017d-48a3-b592-8053b3a30dfb\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:01:56 crc kubenswrapper[5120]: I0316 16:01:56.252954 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/163efc0d-017d-48a3-b592-8053b3a30dfb-logs\") pod \"cinder-api-0\" (UID: \"163efc0d-017d-48a3-b592-8053b3a30dfb\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:01:56 crc kubenswrapper[5120]: I0316 16:01:56.253011 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rnccw\" (UniqueName: \"kubernetes.io/projected/9e30c205-c2b2-4766-8777-6b2730f5172a-kube-api-access-rnccw\") pod \"cinder-scheduler-0\" (UID: \"9e30c205-c2b2-4766-8777-6b2730f5172a\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:01:56 crc kubenswrapper[5120]: I0316 16:01:56.253053 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9e30c205-c2b2-4766-8777-6b2730f5172a-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"9e30c205-c2b2-4766-8777-6b2730f5172a\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:01:56 crc kubenswrapper[5120]: I0316 16:01:56.253082 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/9e30c205-c2b2-4766-8777-6b2730f5172a-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"9e30c205-c2b2-4766-8777-6b2730f5172a\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:01:56 crc kubenswrapper[5120]: I0316 16:01:56.253107 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/163efc0d-017d-48a3-b592-8053b3a30dfb-etc-machine-id\") pod \"cinder-api-0\" (UID: \"163efc0d-017d-48a3-b592-8053b3a30dfb\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:01:56 crc kubenswrapper[5120]: I0316 16:01:56.253123 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n85tr\" (UniqueName: \"kubernetes.io/projected/163efc0d-017d-48a3-b592-8053b3a30dfb-kube-api-access-n85tr\") pod \"cinder-api-0\" (UID: \"163efc0d-017d-48a3-b592-8053b3a30dfb\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:01:56 crc kubenswrapper[5120]: I0316 16:01:56.254021 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/9e30c205-c2b2-4766-8777-6b2730f5172a-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"9e30c205-c2b2-4766-8777-6b2730f5172a\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:01:56 crc kubenswrapper[5120]: I0316 16:01:56.286070 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/9e30c205-c2b2-4766-8777-6b2730f5172a-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"9e30c205-c2b2-4766-8777-6b2730f5172a\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:01:56 crc kubenswrapper[5120]: I0316 16:01:56.286756 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9e30c205-c2b2-4766-8777-6b2730f5172a-config-data\") pod \"cinder-scheduler-0\" (UID: \"9e30c205-c2b2-4766-8777-6b2730f5172a\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:01:56 crc kubenswrapper[5120]: I0316 16:01:56.287438 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9e30c205-c2b2-4766-8777-6b2730f5172a-scripts\") pod \"cinder-scheduler-0\" (UID: \"9e30c205-c2b2-4766-8777-6b2730f5172a\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:01:56 crc kubenswrapper[5120]: I0316 16:01:56.288042 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9e30c205-c2b2-4766-8777-6b2730f5172a-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"9e30c205-c2b2-4766-8777-6b2730f5172a\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:01:56 crc kubenswrapper[5120]: I0316 16:01:56.291446 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnccw\" (UniqueName: \"kubernetes.io/projected/9e30c205-c2b2-4766-8777-6b2730f5172a-kube-api-access-rnccw\") pod \"cinder-scheduler-0\" (UID: \"9e30c205-c2b2-4766-8777-6b2730f5172a\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:01:56 crc kubenswrapper[5120]: I0316 16:01:56.312988 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ace8fafc-b3ed-4c95-8769-9f226ef3506f-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ace8fafc-b3ed-4c95-8769-9f226ef3506f" (UID: "ace8fafc-b3ed-4c95-8769-9f226ef3506f"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:01:56 crc kubenswrapper[5120]: I0316 16:01:56.354896 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/163efc0d-017d-48a3-b592-8053b3a30dfb-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"163efc0d-017d-48a3-b592-8053b3a30dfb\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:01:56 crc kubenswrapper[5120]: I0316 16:01:56.354957 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/163efc0d-017d-48a3-b592-8053b3a30dfb-logs\") pod \"cinder-api-0\" (UID: \"163efc0d-017d-48a3-b592-8053b3a30dfb\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:01:56 crc kubenswrapper[5120]: I0316 16:01:56.355084 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/163efc0d-017d-48a3-b592-8053b3a30dfb-etc-machine-id\") pod \"cinder-api-0\" (UID: \"163efc0d-017d-48a3-b592-8053b3a30dfb\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:01:56 crc kubenswrapper[5120]: I0316 16:01:56.355106 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n85tr\" (UniqueName: \"kubernetes.io/projected/163efc0d-017d-48a3-b592-8053b3a30dfb-kube-api-access-n85tr\") pod \"cinder-api-0\" (UID: \"163efc0d-017d-48a3-b592-8053b3a30dfb\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:01:56 crc kubenswrapper[5120]: I0316 16:01:56.355177 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/163efc0d-017d-48a3-b592-8053b3a30dfb-scripts\") pod \"cinder-api-0\" (UID: \"163efc0d-017d-48a3-b592-8053b3a30dfb\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:01:56 crc kubenswrapper[5120]: I0316 16:01:56.355246 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/163efc0d-017d-48a3-b592-8053b3a30dfb-config-data\") pod \"cinder-api-0\" (UID: \"163efc0d-017d-48a3-b592-8053b3a30dfb\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:01:56 crc kubenswrapper[5120]: I0316 16:01:56.355274 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/163efc0d-017d-48a3-b592-8053b3a30dfb-config-data-custom\") pod \"cinder-api-0\" (UID: \"163efc0d-017d-48a3-b592-8053b3a30dfb\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:01:56 crc kubenswrapper[5120]: I0316 16:01:56.355333 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ace8fafc-b3ed-4c95-8769-9f226ef3506f-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:01:56 crc kubenswrapper[5120]: I0316 16:01:56.356575 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/163efc0d-017d-48a3-b592-8053b3a30dfb-logs\") pod \"cinder-api-0\" (UID: \"163efc0d-017d-48a3-b592-8053b3a30dfb\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:01:56 crc kubenswrapper[5120]: I0316 16:01:56.356635 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/163efc0d-017d-48a3-b592-8053b3a30dfb-etc-machine-id\") pod \"cinder-api-0\" (UID: \"163efc0d-017d-48a3-b592-8053b3a30dfb\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:01:56 crc kubenswrapper[5120]: I0316 16:01:56.363803 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/163efc0d-017d-48a3-b592-8053b3a30dfb-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"163efc0d-017d-48a3-b592-8053b3a30dfb\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:01:56 crc kubenswrapper[5120]: I0316 16:01:56.364155 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/163efc0d-017d-48a3-b592-8053b3a30dfb-scripts\") pod \"cinder-api-0\" (UID: \"163efc0d-017d-48a3-b592-8053b3a30dfb\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:01:56 crc kubenswrapper[5120]: I0316 16:01:56.364214 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/163efc0d-017d-48a3-b592-8053b3a30dfb-config-data-custom\") pod \"cinder-api-0\" (UID: \"163efc0d-017d-48a3-b592-8053b3a30dfb\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:01:56 crc kubenswrapper[5120]: I0316 16:01:56.366820 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/163efc0d-017d-48a3-b592-8053b3a30dfb-config-data\") pod \"cinder-api-0\" (UID: \"163efc0d-017d-48a3-b592-8053b3a30dfb\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:01:56 crc kubenswrapper[5120]: I0316 16:01:56.375265 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n85tr\" (UniqueName: \"kubernetes.io/projected/163efc0d-017d-48a3-b592-8053b3a30dfb-kube-api-access-n85tr\") pod \"cinder-api-0\" (UID: \"163efc0d-017d-48a3-b592-8053b3a30dfb\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:01:56 crc kubenswrapper[5120]: I0316 16:01:56.415679 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ace8fafc-b3ed-4c95-8769-9f226ef3506f-config-data" (OuterVolumeSpecName: "config-data") pod "ace8fafc-b3ed-4c95-8769-9f226ef3506f" (UID: "ace8fafc-b3ed-4c95-8769-9f226ef3506f"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:01:56 crc kubenswrapper[5120]: I0316 16:01:56.458363 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ace8fafc-b3ed-4c95-8769-9f226ef3506f-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:01:56 crc kubenswrapper[5120]: I0316 16:01:56.551468 5120 status_manager.go:895] "Failed to get status for pod" podUID="e52ef7fa-31bc-409e-a6eb-5b32a5082208" pod="openstack-kuttl-tests/keystone-bootstrap-8wn9f" err="pods \"keystone-bootstrap-8wn9f\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 16:01:56 crc kubenswrapper[5120]: I0316 16:01:56.588409 5120 status_manager.go:895] "Failed to get status for pod" podUID="e52ef7fa-31bc-409e-a6eb-5b32a5082208" pod="openstack-kuttl-tests/keystone-bootstrap-8wn9f" err="pods \"keystone-bootstrap-8wn9f\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 16:01:56 crc kubenswrapper[5120]: I0316 16:01:56.589048 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-5b779bfdf-px7gw" Mar 16 16:01:56 crc kubenswrapper[5120]: I0316 16:01:56.598884 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-fdvcj" Mar 16 16:01:56 crc kubenswrapper[5120]: I0316 16:01:56.600172 5120 status_manager.go:895] "Failed to get status for pod" podUID="e52ef7fa-31bc-409e-a6eb-5b32a5082208" pod="openstack-kuttl-tests/keystone-bootstrap-8wn9f" err="pods \"keystone-bootstrap-8wn9f\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 16:01:56 crc kubenswrapper[5120]: I0316 16:01:56.610676 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:01:56 crc kubenswrapper[5120]: I0316 16:01:56.641059 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:01:56 crc kubenswrapper[5120]: I0316 16:01:56.685032 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e52ef7fa-31bc-409e-a6eb-5b32a5082208" path="/var/lib/kubelet/pods/e52ef7fa-31bc-409e-a6eb-5b32a5082208/volumes" Mar 16 16:01:56 crc kubenswrapper[5120]: I0316 16:01:56.801751 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-f5cb49f4b-mkrgf" event={"ID":"a1a6ef57-0689-4731-8c35-b337908ae72b","Type":"ContainerStarted","Data":"54d86f0b2ac28c4834d76c20795d47c7b66bc155f7faed9a7d0cd5069987b642"} Mar 16 16:01:56 crc kubenswrapper[5120]: I0316 16:01:56.802790 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-f5cb49f4b-mkrgf" Mar 16 16:01:56 crc kubenswrapper[5120]: I0316 16:01:56.802819 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-f5cb49f4b-mkrgf" Mar 16 16:01:56 crc kubenswrapper[5120]: I0316 16:01:56.825258 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-5cddcbb4cf-kdhzk" event={"ID":"1daafc71-9f0a-4fe4-953c-1e00eab0fbfa","Type":"ContainerStarted","Data":"0a94c712529cb8bf1ddc356c590201952132d947f6665514c06c7392f23c8bf7"} Mar 16 16:01:56 crc kubenswrapper[5120]: I0316 16:01:56.840330 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-api-f5cb49f4b-mkrgf" podStartSLOduration=3.840297421 podStartE2EDuration="3.840297421s" podCreationTimestamp="2026-03-16 16:01:53 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:01:56.826183442 +0000 UTC m=+1818.980115099" watchObservedRunningTime="2026-03-16 16:01:56.840297421 +0000 UTC m=+1818.994229078" Mar 16 16:01:56 crc kubenswrapper[5120]: I0316 16:01:56.851525 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-worker-5cddcbb4cf-kdhzk" podStartSLOduration=3.8515066190000002 podStartE2EDuration="3.851506619s" podCreationTimestamp="2026-03-16 16:01:53 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:01:56.851499599 +0000 UTC m=+1819.005431256" watchObservedRunningTime="2026-03-16 16:01:56.851506619 +0000 UTC m=+1819.005438276" Mar 16 16:01:56 crc kubenswrapper[5120]: I0316 16:01:56.884933 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"06bf3ec7-8d8e-4aa6-ada8-7dacc2a00ac5","Type":"ContainerStarted","Data":"0ccfa1e90a41f433d1dc037be1ddac91fec1d36076fa1bd39fd0caeaaef1614e"} Mar 16 16:01:56 crc kubenswrapper[5120]: I0316 16:01:56.885133 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="06bf3ec7-8d8e-4aa6-ada8-7dacc2a00ac5" containerName="ceilometer-central-agent" containerID="cri-o://ba8822c1e5c526c89e8ec262b03bae0b25fe9d104568c4cc1009b1ba1476f8b6" gracePeriod=30 Mar 16 16:01:56 crc kubenswrapper[5120]: I0316 16:01:56.885352 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:01:56 crc kubenswrapper[5120]: I0316 16:01:56.885679 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="06bf3ec7-8d8e-4aa6-ada8-7dacc2a00ac5" containerName="sg-core" containerID="cri-o://4f9933f0daef80d09ebbf95a1683b8eec46685f9bd6ae3ca379fda90092a37d2" gracePeriod=30 Mar 16 16:01:56 crc kubenswrapper[5120]: I0316 16:01:56.885874 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="06bf3ec7-8d8e-4aa6-ada8-7dacc2a00ac5" containerName="proxy-httpd" containerID="cri-o://0ccfa1e90a41f433d1dc037be1ddac91fec1d36076fa1bd39fd0caeaaef1614e" gracePeriod=30 Mar 16 16:01:56 crc kubenswrapper[5120]: I0316 16:01:56.885937 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="06bf3ec7-8d8e-4aa6-ada8-7dacc2a00ac5" containerName="ceilometer-notification-agent" containerID="cri-o://caab9dc32ec71c38eb04a128f0392de356d59dff568805b1d8e7c70f3517d52e" gracePeriod=30 Mar 16 16:01:56 crc kubenswrapper[5120]: I0316 16:01:56.919829 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=3.353020725 podStartE2EDuration="9.919816579s" podCreationTimestamp="2026-03-16 16:01:47 +0000 UTC" firstStartedPulling="2026-03-16 16:01:48.672533653 +0000 UTC m=+1810.826465310" lastFinishedPulling="2026-03-16 16:01:55.239329507 +0000 UTC m=+1817.393261164" observedRunningTime="2026-03-16 16:01:56.918317767 +0000 UTC m=+1819.072249424" watchObservedRunningTime="2026-03-16 16:01:56.919816579 +0000 UTC m=+1819.073748236" Mar 16 16:01:56 crc kubenswrapper[5120]: I0316 16:01:56.967002 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-799cbdd458-hqv8s" event={"ID":"ca9332c4-7b03-4296-9cb8-b5fdcd487025","Type":"ContainerStarted","Data":"173ac0b3334fdba35abe7d7ab1a4e3c86b2d2a42e73a0d78096c0601325bf3dc"} Mar 16 16:01:56 crc kubenswrapper[5120]: I0316 16:01:56.968075 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-799cbdd458-hqv8s" Mar 16 16:01:56 crc kubenswrapper[5120]: I0316 16:01:56.968096 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-799cbdd458-hqv8s" Mar 16 16:01:57 crc kubenswrapper[5120]: I0316 16:01:57.006415 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-799cbdd458-hqv8s" podStartSLOduration=4.006392631 podStartE2EDuration="4.006392631s" podCreationTimestamp="2026-03-16 16:01:53 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:01:56.996065617 +0000 UTC m=+1819.149997274" watchObservedRunningTime="2026-03-16 16:01:57.006392631 +0000 UTC m=+1819.160324288" Mar 16 16:01:57 crc kubenswrapper[5120]: I0316 16:01:57.015945 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"97c05f77-d695-4853-acb9-05388320db3b","Type":"ContainerStarted","Data":"0e4b269601afde05465d88d6caa9c22cf556e6ef38c8b25edfe4940f6828106c"} Mar 16 16:01:57 crc kubenswrapper[5120]: I0316 16:01:57.057780 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-5d4d9d69db-qcw77" event={"ID":"13a4296c-922e-4316-a6c6-cae50477429b","Type":"ContainerStarted","Data":"e44e5e07928b70511e1bb7a8b3d79f3129084a9c99f8986be93aaff6ff10e073"} Mar 16 16:01:57 crc kubenswrapper[5120]: I0316 16:01:57.058076 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-5d4d9d69db-qcw77" Mar 16 16:01:57 crc kubenswrapper[5120]: I0316 16:01:57.058147 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-5d4d9d69db-qcw77" Mar 16 16:01:57 crc kubenswrapper[5120]: I0316 16:01:57.085443 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-external-api-0" podStartSLOduration=5.085426577 podStartE2EDuration="5.085426577s" podCreationTimestamp="2026-03-16 16:01:52 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:01:57.056084219 +0000 UTC m=+1819.210015876" watchObservedRunningTime="2026-03-16 16:01:57.085426577 +0000 UTC m=+1819.239358234" Mar 16 16:01:57 crc kubenswrapper[5120]: I0316 16:01:57.254007 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-5d4d9d69db-qcw77" podStartSLOduration=4.253988606 podStartE2EDuration="4.253988606s" podCreationTimestamp="2026-03-16 16:01:53 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:01:57.091798562 +0000 UTC m=+1819.245730219" watchObservedRunningTime="2026-03-16 16:01:57.253988606 +0000 UTC m=+1819.407920263" Mar 16 16:01:57 crc kubenswrapper[5120]: I0316 16:01:57.256047 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-5b779bfdf-px7gw"] Mar 16 16:01:57 crc kubenswrapper[5120]: I0316 16:01:57.439929 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:01:57 crc kubenswrapper[5120]: I0316 16:01:57.447391 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-fdvcj"] Mar 16 16:01:57 crc kubenswrapper[5120]: I0316 16:01:57.464200 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:01:57 crc kubenswrapper[5120]: W0316 16:01:57.466241 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcb8bda64_dcf7_461e_a963_74aeeec060fd.slice/crio-f78e83339543f602f722368830f00ca7db5b9646ddffa9caa4b70c8c3ec80bba WatchSource:0}: Error finding container f78e83339543f602f722368830f00ca7db5b9646ddffa9caa4b70c8c3ec80bba: Status 404 returned error can't find the container with id f78e83339543f602f722368830f00ca7db5b9646ddffa9caa4b70c8c3ec80bba Mar 16 16:01:57 crc kubenswrapper[5120]: W0316 16:01:57.479485 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9e30c205_c2b2_4766_8777_6b2730f5172a.slice/crio-bf307ffb39e68dbd309ed3b1774fabd6966bf4a532a57fb96ea6078bef606b0d WatchSource:0}: Error finding container bf307ffb39e68dbd309ed3b1774fabd6966bf4a532a57fb96ea6078bef606b0d: Status 404 returned error can't find the container with id bf307ffb39e68dbd309ed3b1774fabd6966bf4a532a57fb96ea6078bef606b0d Mar 16 16:01:57 crc kubenswrapper[5120]: I0316 16:01:57.852313 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:01:57 crc kubenswrapper[5120]: I0316 16:01:57.903321 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/06bf3ec7-8d8e-4aa6-ada8-7dacc2a00ac5-log-httpd\") pod \"06bf3ec7-8d8e-4aa6-ada8-7dacc2a00ac5\" (UID: \"06bf3ec7-8d8e-4aa6-ada8-7dacc2a00ac5\") " Mar 16 16:01:57 crc kubenswrapper[5120]: I0316 16:01:57.903429 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/06bf3ec7-8d8e-4aa6-ada8-7dacc2a00ac5-sg-core-conf-yaml\") pod \"06bf3ec7-8d8e-4aa6-ada8-7dacc2a00ac5\" (UID: \"06bf3ec7-8d8e-4aa6-ada8-7dacc2a00ac5\") " Mar 16 16:01:57 crc kubenswrapper[5120]: I0316 16:01:57.903551 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/06bf3ec7-8d8e-4aa6-ada8-7dacc2a00ac5-scripts\") pod \"06bf3ec7-8d8e-4aa6-ada8-7dacc2a00ac5\" (UID: \"06bf3ec7-8d8e-4aa6-ada8-7dacc2a00ac5\") " Mar 16 16:01:57 crc kubenswrapper[5120]: I0316 16:01:57.903638 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/06bf3ec7-8d8e-4aa6-ada8-7dacc2a00ac5-combined-ca-bundle\") pod \"06bf3ec7-8d8e-4aa6-ada8-7dacc2a00ac5\" (UID: \"06bf3ec7-8d8e-4aa6-ada8-7dacc2a00ac5\") " Mar 16 16:01:57 crc kubenswrapper[5120]: I0316 16:01:57.903701 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/06bf3ec7-8d8e-4aa6-ada8-7dacc2a00ac5-config-data\") pod \"06bf3ec7-8d8e-4aa6-ada8-7dacc2a00ac5\" (UID: \"06bf3ec7-8d8e-4aa6-ada8-7dacc2a00ac5\") " Mar 16 16:01:57 crc kubenswrapper[5120]: I0316 16:01:57.903859 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-st4hc\" (UniqueName: \"kubernetes.io/projected/06bf3ec7-8d8e-4aa6-ada8-7dacc2a00ac5-kube-api-access-st4hc\") pod \"06bf3ec7-8d8e-4aa6-ada8-7dacc2a00ac5\" (UID: \"06bf3ec7-8d8e-4aa6-ada8-7dacc2a00ac5\") " Mar 16 16:01:57 crc kubenswrapper[5120]: I0316 16:01:57.903983 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/06bf3ec7-8d8e-4aa6-ada8-7dacc2a00ac5-run-httpd\") pod \"06bf3ec7-8d8e-4aa6-ada8-7dacc2a00ac5\" (UID: \"06bf3ec7-8d8e-4aa6-ada8-7dacc2a00ac5\") " Mar 16 16:01:57 crc kubenswrapper[5120]: I0316 16:01:57.904252 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06bf3ec7-8d8e-4aa6-ada8-7dacc2a00ac5-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "06bf3ec7-8d8e-4aa6-ada8-7dacc2a00ac5" (UID: "06bf3ec7-8d8e-4aa6-ada8-7dacc2a00ac5"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:01:57 crc kubenswrapper[5120]: I0316 16:01:57.904533 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/06bf3ec7-8d8e-4aa6-ada8-7dacc2a00ac5-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:01:57 crc kubenswrapper[5120]: I0316 16:01:57.905661 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06bf3ec7-8d8e-4aa6-ada8-7dacc2a00ac5-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "06bf3ec7-8d8e-4aa6-ada8-7dacc2a00ac5" (UID: "06bf3ec7-8d8e-4aa6-ada8-7dacc2a00ac5"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:01:57 crc kubenswrapper[5120]: I0316 16:01:57.914018 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06bf3ec7-8d8e-4aa6-ada8-7dacc2a00ac5-scripts" (OuterVolumeSpecName: "scripts") pod "06bf3ec7-8d8e-4aa6-ada8-7dacc2a00ac5" (UID: "06bf3ec7-8d8e-4aa6-ada8-7dacc2a00ac5"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:01:57 crc kubenswrapper[5120]: I0316 16:01:57.943086 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06bf3ec7-8d8e-4aa6-ada8-7dacc2a00ac5-kube-api-access-st4hc" (OuterVolumeSpecName: "kube-api-access-st4hc") pod "06bf3ec7-8d8e-4aa6-ada8-7dacc2a00ac5" (UID: "06bf3ec7-8d8e-4aa6-ada8-7dacc2a00ac5"). InnerVolumeSpecName "kube-api-access-st4hc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:01:58 crc kubenswrapper[5120]: I0316 16:01:58.005059 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06bf3ec7-8d8e-4aa6-ada8-7dacc2a00ac5-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "06bf3ec7-8d8e-4aa6-ada8-7dacc2a00ac5" (UID: "06bf3ec7-8d8e-4aa6-ada8-7dacc2a00ac5"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:01:58 crc kubenswrapper[5120]: I0316 16:01:58.006256 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/06bf3ec7-8d8e-4aa6-ada8-7dacc2a00ac5-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:01:58 crc kubenswrapper[5120]: I0316 16:01:58.006276 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-st4hc\" (UniqueName: \"kubernetes.io/projected/06bf3ec7-8d8e-4aa6-ada8-7dacc2a00ac5-kube-api-access-st4hc\") on node \"crc\" DevicePath \"\"" Mar 16 16:01:58 crc kubenswrapper[5120]: I0316 16:01:58.006286 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/06bf3ec7-8d8e-4aa6-ada8-7dacc2a00ac5-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:01:58 crc kubenswrapper[5120]: I0316 16:01:58.006297 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/06bf3ec7-8d8e-4aa6-ada8-7dacc2a00ac5-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 16:01:58 crc kubenswrapper[5120]: I0316 16:01:58.098585 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"ee138521-8f48-4215-9e58-cf1d50ad7910","Type":"ContainerStarted","Data":"780d1a21d3dfa92fa26d3abf9a3a36fbee1bd1a740cfed6d040700a2c31f1959"} Mar 16 16:01:58 crc kubenswrapper[5120]: I0316 16:01:58.100983 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"163efc0d-017d-48a3-b592-8053b3a30dfb","Type":"ContainerStarted","Data":"eb9b68fac590ad1aeb605fadb0340c8bc3d65ee5981d313714f7333705718237"} Mar 16 16:01:58 crc kubenswrapper[5120]: I0316 16:01:58.104068 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-fdvcj" event={"ID":"cb8bda64-dcf7-461e-a963-74aeeec060fd","Type":"ContainerStarted","Data":"99e3ec545996bb94f68d714fc428ffb531b50020d515a649c749101075591fad"} Mar 16 16:01:58 crc kubenswrapper[5120]: I0316 16:01:58.109177 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06bf3ec7-8d8e-4aa6-ada8-7dacc2a00ac5-config-data" (OuterVolumeSpecName: "config-data") pod "06bf3ec7-8d8e-4aa6-ada8-7dacc2a00ac5" (UID: "06bf3ec7-8d8e-4aa6-ada8-7dacc2a00ac5"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:01:58 crc kubenswrapper[5120]: I0316 16:01:58.121640 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06bf3ec7-8d8e-4aa6-ada8-7dacc2a00ac5-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "06bf3ec7-8d8e-4aa6-ada8-7dacc2a00ac5" (UID: "06bf3ec7-8d8e-4aa6-ada8-7dacc2a00ac5"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:01:58 crc kubenswrapper[5120]: I0316 16:01:58.124722 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-fdvcj" event={"ID":"cb8bda64-dcf7-461e-a963-74aeeec060fd","Type":"ContainerStarted","Data":"f78e83339543f602f722368830f00ca7db5b9646ddffa9caa4b70c8c3ec80bba"} Mar 16 16:01:58 crc kubenswrapper[5120]: I0316 16:01:58.126387 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/06bf3ec7-8d8e-4aa6-ada8-7dacc2a00ac5-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:01:58 crc kubenswrapper[5120]: I0316 16:01:58.126426 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/06bf3ec7-8d8e-4aa6-ada8-7dacc2a00ac5-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:01:58 crc kubenswrapper[5120]: I0316 16:01:58.127024 5120 generic.go:358] "Generic (PLEG): container finished" podID="06bf3ec7-8d8e-4aa6-ada8-7dacc2a00ac5" containerID="0ccfa1e90a41f433d1dc037be1ddac91fec1d36076fa1bd39fd0caeaaef1614e" exitCode=0 Mar 16 16:01:58 crc kubenswrapper[5120]: I0316 16:01:58.127054 5120 generic.go:358] "Generic (PLEG): container finished" podID="06bf3ec7-8d8e-4aa6-ada8-7dacc2a00ac5" containerID="4f9933f0daef80d09ebbf95a1683b8eec46685f9bd6ae3ca379fda90092a37d2" exitCode=2 Mar 16 16:01:58 crc kubenswrapper[5120]: I0316 16:01:58.127061 5120 generic.go:358] "Generic (PLEG): container finished" podID="06bf3ec7-8d8e-4aa6-ada8-7dacc2a00ac5" containerID="caab9dc32ec71c38eb04a128f0392de356d59dff568805b1d8e7c70f3517d52e" exitCode=0 Mar 16 16:01:58 crc kubenswrapper[5120]: I0316 16:01:58.127069 5120 generic.go:358] "Generic (PLEG): container finished" podID="06bf3ec7-8d8e-4aa6-ada8-7dacc2a00ac5" containerID="ba8822c1e5c526c89e8ec262b03bae0b25fe9d104568c4cc1009b1ba1476f8b6" exitCode=0 Mar 16 16:01:58 crc kubenswrapper[5120]: I0316 16:01:58.127476 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:01:58 crc kubenswrapper[5120]: I0316 16:01:58.127672 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"06bf3ec7-8d8e-4aa6-ada8-7dacc2a00ac5","Type":"ContainerDied","Data":"0ccfa1e90a41f433d1dc037be1ddac91fec1d36076fa1bd39fd0caeaaef1614e"} Mar 16 16:01:58 crc kubenswrapper[5120]: I0316 16:01:58.127727 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"06bf3ec7-8d8e-4aa6-ada8-7dacc2a00ac5","Type":"ContainerDied","Data":"4f9933f0daef80d09ebbf95a1683b8eec46685f9bd6ae3ca379fda90092a37d2"} Mar 16 16:01:58 crc kubenswrapper[5120]: I0316 16:01:58.127737 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"06bf3ec7-8d8e-4aa6-ada8-7dacc2a00ac5","Type":"ContainerDied","Data":"caab9dc32ec71c38eb04a128f0392de356d59dff568805b1d8e7c70f3517d52e"} Mar 16 16:01:58 crc kubenswrapper[5120]: I0316 16:01:58.127745 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"06bf3ec7-8d8e-4aa6-ada8-7dacc2a00ac5","Type":"ContainerDied","Data":"ba8822c1e5c526c89e8ec262b03bae0b25fe9d104568c4cc1009b1ba1476f8b6"} Mar 16 16:01:58 crc kubenswrapper[5120]: I0316 16:01:58.127798 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"06bf3ec7-8d8e-4aa6-ada8-7dacc2a00ac5","Type":"ContainerDied","Data":"83369dca93d66e3b294f1a438d50f3722a8ca879296f04552eda699910458a66"} Mar 16 16:01:58 crc kubenswrapper[5120]: I0316 16:01:58.127817 5120 scope.go:117] "RemoveContainer" containerID="0ccfa1e90a41f433d1dc037be1ddac91fec1d36076fa1bd39fd0caeaaef1614e" Mar 16 16:01:58 crc kubenswrapper[5120]: I0316 16:01:58.129037 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-internal-api-0" podStartSLOduration=5.129021399 podStartE2EDuration="5.129021399s" podCreationTimestamp="2026-03-16 16:01:53 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:01:58.116204746 +0000 UTC m=+1820.270136393" watchObservedRunningTime="2026-03-16 16:01:58.129021399 +0000 UTC m=+1820.282953056" Mar 16 16:01:58 crc kubenswrapper[5120]: I0316 16:01:58.138094 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-bootstrap-fdvcj" podStartSLOduration=3.138080149 podStartE2EDuration="3.138080149s" podCreationTimestamp="2026-03-16 16:01:55 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:01:58.136269448 +0000 UTC m=+1820.290201105" watchObservedRunningTime="2026-03-16 16:01:58.138080149 +0000 UTC m=+1820.292011796" Mar 16 16:01:58 crc kubenswrapper[5120]: I0316 16:01:58.149858 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-5b779bfdf-px7gw" event={"ID":"bfe56c80-c472-49dc-8971-db5052d61898","Type":"ContainerStarted","Data":"fdda622d80035e11d91b16db055467f5e998c8ed06fd535051b04113b051ec7b"} Mar 16 16:01:58 crc kubenswrapper[5120]: I0316 16:01:58.149896 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-5b779bfdf-px7gw" event={"ID":"bfe56c80-c472-49dc-8971-db5052d61898","Type":"ContainerStarted","Data":"d15342bf5f1da981a5264feaf7b142259bff5bab0942dc8efe186eb2003e9fb6"} Mar 16 16:01:58 crc kubenswrapper[5120]: I0316 16:01:58.149906 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-5b779bfdf-px7gw" event={"ID":"bfe56c80-c472-49dc-8971-db5052d61898","Type":"ContainerStarted","Data":"53b5d89bd8e94b889f4b6dedd404d7d413c55ad8c52fe5d21ba729ea55fe0a4b"} Mar 16 16:01:58 crc kubenswrapper[5120]: I0316 16:01:58.151359 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/neutron-5b779bfdf-px7gw" Mar 16 16:01:58 crc kubenswrapper[5120]: I0316 16:01:58.155485 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"9e30c205-c2b2-4766-8777-6b2730f5172a","Type":"ContainerStarted","Data":"bf307ffb39e68dbd309ed3b1774fabd6966bf4a532a57fb96ea6078bef606b0d"} Mar 16 16:01:58 crc kubenswrapper[5120]: I0316 16:01:58.165931 5120 scope.go:117] "RemoveContainer" containerID="4f9933f0daef80d09ebbf95a1683b8eec46685f9bd6ae3ca379fda90092a37d2" Mar 16 16:01:58 crc kubenswrapper[5120]: I0316 16:01:58.180162 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-5b779bfdf-px7gw" podStartSLOduration=3.180141266 podStartE2EDuration="3.180141266s" podCreationTimestamp="2026-03-16 16:01:55 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:01:58.167414436 +0000 UTC m=+1820.321346093" watchObservedRunningTime="2026-03-16 16:01:58.180141266 +0000 UTC m=+1820.334072923" Mar 16 16:01:58 crc kubenswrapper[5120]: I0316 16:01:58.253084 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:01:58 crc kubenswrapper[5120]: I0316 16:01:58.280953 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:01:58 crc kubenswrapper[5120]: I0316 16:01:58.288314 5120 scope.go:117] "RemoveContainer" containerID="caab9dc32ec71c38eb04a128f0392de356d59dff568805b1d8e7c70f3517d52e" Mar 16 16:01:58 crc kubenswrapper[5120]: I0316 16:01:58.297075 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:01:58 crc kubenswrapper[5120]: I0316 16:01:58.298051 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06bf3ec7-8d8e-4aa6-ada8-7dacc2a00ac5" containerName="sg-core" Mar 16 16:01:58 crc kubenswrapper[5120]: I0316 16:01:58.298068 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="06bf3ec7-8d8e-4aa6-ada8-7dacc2a00ac5" containerName="sg-core" Mar 16 16:01:58 crc kubenswrapper[5120]: I0316 16:01:58.298089 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06bf3ec7-8d8e-4aa6-ada8-7dacc2a00ac5" containerName="ceilometer-notification-agent" Mar 16 16:01:58 crc kubenswrapper[5120]: I0316 16:01:58.298096 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="06bf3ec7-8d8e-4aa6-ada8-7dacc2a00ac5" containerName="ceilometer-notification-agent" Mar 16 16:01:58 crc kubenswrapper[5120]: I0316 16:01:58.298116 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06bf3ec7-8d8e-4aa6-ada8-7dacc2a00ac5" containerName="proxy-httpd" Mar 16 16:01:58 crc kubenswrapper[5120]: I0316 16:01:58.298121 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="06bf3ec7-8d8e-4aa6-ada8-7dacc2a00ac5" containerName="proxy-httpd" Mar 16 16:01:58 crc kubenswrapper[5120]: I0316 16:01:58.298150 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06bf3ec7-8d8e-4aa6-ada8-7dacc2a00ac5" containerName="ceilometer-central-agent" Mar 16 16:01:58 crc kubenswrapper[5120]: I0316 16:01:58.298156 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="06bf3ec7-8d8e-4aa6-ada8-7dacc2a00ac5" containerName="ceilometer-central-agent" Mar 16 16:01:58 crc kubenswrapper[5120]: I0316 16:01:58.298303 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="06bf3ec7-8d8e-4aa6-ada8-7dacc2a00ac5" containerName="sg-core" Mar 16 16:01:58 crc kubenswrapper[5120]: I0316 16:01:58.298317 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="06bf3ec7-8d8e-4aa6-ada8-7dacc2a00ac5" containerName="proxy-httpd" Mar 16 16:01:58 crc kubenswrapper[5120]: I0316 16:01:58.298324 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="06bf3ec7-8d8e-4aa6-ada8-7dacc2a00ac5" containerName="ceilometer-notification-agent" Mar 16 16:01:58 crc kubenswrapper[5120]: I0316 16:01:58.298340 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="06bf3ec7-8d8e-4aa6-ada8-7dacc2a00ac5" containerName="ceilometer-central-agent" Mar 16 16:01:58 crc kubenswrapper[5120]: I0316 16:01:58.312439 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:01:58 crc kubenswrapper[5120]: I0316 16:01:58.312635 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:01:58 crc kubenswrapper[5120]: I0316 16:01:58.314534 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 16:01:58 crc kubenswrapper[5120]: I0316 16:01:58.316361 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 16:01:58 crc kubenswrapper[5120]: I0316 16:01:58.368459 5120 scope.go:117] "RemoveContainer" containerID="ba8822c1e5c526c89e8ec262b03bae0b25fe9d104568c4cc1009b1ba1476f8b6" Mar 16 16:01:58 crc kubenswrapper[5120]: I0316 16:01:58.415907 5120 scope.go:117] "RemoveContainer" containerID="0ccfa1e90a41f433d1dc037be1ddac91fec1d36076fa1bd39fd0caeaaef1614e" Mar 16 16:01:58 crc kubenswrapper[5120]: E0316 16:01:58.419851 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0ccfa1e90a41f433d1dc037be1ddac91fec1d36076fa1bd39fd0caeaaef1614e\": container with ID starting with 0ccfa1e90a41f433d1dc037be1ddac91fec1d36076fa1bd39fd0caeaaef1614e not found: ID does not exist" containerID="0ccfa1e90a41f433d1dc037be1ddac91fec1d36076fa1bd39fd0caeaaef1614e" Mar 16 16:01:58 crc kubenswrapper[5120]: I0316 16:01:58.419884 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ccfa1e90a41f433d1dc037be1ddac91fec1d36076fa1bd39fd0caeaaef1614e"} err="failed to get container status \"0ccfa1e90a41f433d1dc037be1ddac91fec1d36076fa1bd39fd0caeaaef1614e\": rpc error: code = NotFound desc = could not find container \"0ccfa1e90a41f433d1dc037be1ddac91fec1d36076fa1bd39fd0caeaaef1614e\": container with ID starting with 0ccfa1e90a41f433d1dc037be1ddac91fec1d36076fa1bd39fd0caeaaef1614e not found: ID does not exist" Mar 16 16:01:58 crc kubenswrapper[5120]: I0316 16:01:58.419903 5120 scope.go:117] "RemoveContainer" containerID="4f9933f0daef80d09ebbf95a1683b8eec46685f9bd6ae3ca379fda90092a37d2" Mar 16 16:01:58 crc kubenswrapper[5120]: E0316 16:01:58.420206 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f9933f0daef80d09ebbf95a1683b8eec46685f9bd6ae3ca379fda90092a37d2\": container with ID starting with 4f9933f0daef80d09ebbf95a1683b8eec46685f9bd6ae3ca379fda90092a37d2 not found: ID does not exist" containerID="4f9933f0daef80d09ebbf95a1683b8eec46685f9bd6ae3ca379fda90092a37d2" Mar 16 16:01:58 crc kubenswrapper[5120]: I0316 16:01:58.420231 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f9933f0daef80d09ebbf95a1683b8eec46685f9bd6ae3ca379fda90092a37d2"} err="failed to get container status \"4f9933f0daef80d09ebbf95a1683b8eec46685f9bd6ae3ca379fda90092a37d2\": rpc error: code = NotFound desc = could not find container \"4f9933f0daef80d09ebbf95a1683b8eec46685f9bd6ae3ca379fda90092a37d2\": container with ID starting with 4f9933f0daef80d09ebbf95a1683b8eec46685f9bd6ae3ca379fda90092a37d2 not found: ID does not exist" Mar 16 16:01:58 crc kubenswrapper[5120]: I0316 16:01:58.420246 5120 scope.go:117] "RemoveContainer" containerID="caab9dc32ec71c38eb04a128f0392de356d59dff568805b1d8e7c70f3517d52e" Mar 16 16:01:58 crc kubenswrapper[5120]: E0316 16:01:58.420451 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"caab9dc32ec71c38eb04a128f0392de356d59dff568805b1d8e7c70f3517d52e\": container with ID starting with caab9dc32ec71c38eb04a128f0392de356d59dff568805b1d8e7c70f3517d52e not found: ID does not exist" containerID="caab9dc32ec71c38eb04a128f0392de356d59dff568805b1d8e7c70f3517d52e" Mar 16 16:01:58 crc kubenswrapper[5120]: I0316 16:01:58.420479 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"caab9dc32ec71c38eb04a128f0392de356d59dff568805b1d8e7c70f3517d52e"} err="failed to get container status \"caab9dc32ec71c38eb04a128f0392de356d59dff568805b1d8e7c70f3517d52e\": rpc error: code = NotFound desc = could not find container \"caab9dc32ec71c38eb04a128f0392de356d59dff568805b1d8e7c70f3517d52e\": container with ID starting with caab9dc32ec71c38eb04a128f0392de356d59dff568805b1d8e7c70f3517d52e not found: ID does not exist" Mar 16 16:01:58 crc kubenswrapper[5120]: I0316 16:01:58.420491 5120 scope.go:117] "RemoveContainer" containerID="ba8822c1e5c526c89e8ec262b03bae0b25fe9d104568c4cc1009b1ba1476f8b6" Mar 16 16:01:58 crc kubenswrapper[5120]: E0316 16:01:58.420708 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba8822c1e5c526c89e8ec262b03bae0b25fe9d104568c4cc1009b1ba1476f8b6\": container with ID starting with ba8822c1e5c526c89e8ec262b03bae0b25fe9d104568c4cc1009b1ba1476f8b6 not found: ID does not exist" containerID="ba8822c1e5c526c89e8ec262b03bae0b25fe9d104568c4cc1009b1ba1476f8b6" Mar 16 16:01:58 crc kubenswrapper[5120]: I0316 16:01:58.420730 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba8822c1e5c526c89e8ec262b03bae0b25fe9d104568c4cc1009b1ba1476f8b6"} err="failed to get container status \"ba8822c1e5c526c89e8ec262b03bae0b25fe9d104568c4cc1009b1ba1476f8b6\": rpc error: code = NotFound desc = could not find container \"ba8822c1e5c526c89e8ec262b03bae0b25fe9d104568c4cc1009b1ba1476f8b6\": container with ID starting with ba8822c1e5c526c89e8ec262b03bae0b25fe9d104568c4cc1009b1ba1476f8b6 not found: ID does not exist" Mar 16 16:01:58 crc kubenswrapper[5120]: I0316 16:01:58.420743 5120 scope.go:117] "RemoveContainer" containerID="0ccfa1e90a41f433d1dc037be1ddac91fec1d36076fa1bd39fd0caeaaef1614e" Mar 16 16:01:58 crc kubenswrapper[5120]: I0316 16:01:58.421703 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ccfa1e90a41f433d1dc037be1ddac91fec1d36076fa1bd39fd0caeaaef1614e"} err="failed to get container status \"0ccfa1e90a41f433d1dc037be1ddac91fec1d36076fa1bd39fd0caeaaef1614e\": rpc error: code = NotFound desc = could not find container \"0ccfa1e90a41f433d1dc037be1ddac91fec1d36076fa1bd39fd0caeaaef1614e\": container with ID starting with 0ccfa1e90a41f433d1dc037be1ddac91fec1d36076fa1bd39fd0caeaaef1614e not found: ID does not exist" Mar 16 16:01:58 crc kubenswrapper[5120]: I0316 16:01:58.421725 5120 scope.go:117] "RemoveContainer" containerID="4f9933f0daef80d09ebbf95a1683b8eec46685f9bd6ae3ca379fda90092a37d2" Mar 16 16:01:58 crc kubenswrapper[5120]: I0316 16:01:58.422038 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f9933f0daef80d09ebbf95a1683b8eec46685f9bd6ae3ca379fda90092a37d2"} err="failed to get container status \"4f9933f0daef80d09ebbf95a1683b8eec46685f9bd6ae3ca379fda90092a37d2\": rpc error: code = NotFound desc = could not find container \"4f9933f0daef80d09ebbf95a1683b8eec46685f9bd6ae3ca379fda90092a37d2\": container with ID starting with 4f9933f0daef80d09ebbf95a1683b8eec46685f9bd6ae3ca379fda90092a37d2 not found: ID does not exist" Mar 16 16:01:58 crc kubenswrapper[5120]: I0316 16:01:58.422065 5120 scope.go:117] "RemoveContainer" containerID="caab9dc32ec71c38eb04a128f0392de356d59dff568805b1d8e7c70f3517d52e" Mar 16 16:01:58 crc kubenswrapper[5120]: I0316 16:01:58.422251 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"caab9dc32ec71c38eb04a128f0392de356d59dff568805b1d8e7c70f3517d52e"} err="failed to get container status \"caab9dc32ec71c38eb04a128f0392de356d59dff568805b1d8e7c70f3517d52e\": rpc error: code = NotFound desc = could not find container \"caab9dc32ec71c38eb04a128f0392de356d59dff568805b1d8e7c70f3517d52e\": container with ID starting with caab9dc32ec71c38eb04a128f0392de356d59dff568805b1d8e7c70f3517d52e not found: ID does not exist" Mar 16 16:01:58 crc kubenswrapper[5120]: I0316 16:01:58.422270 5120 scope.go:117] "RemoveContainer" containerID="ba8822c1e5c526c89e8ec262b03bae0b25fe9d104568c4cc1009b1ba1476f8b6" Mar 16 16:01:58 crc kubenswrapper[5120]: I0316 16:01:58.424147 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba8822c1e5c526c89e8ec262b03bae0b25fe9d104568c4cc1009b1ba1476f8b6"} err="failed to get container status \"ba8822c1e5c526c89e8ec262b03bae0b25fe9d104568c4cc1009b1ba1476f8b6\": rpc error: code = NotFound desc = could not find container \"ba8822c1e5c526c89e8ec262b03bae0b25fe9d104568c4cc1009b1ba1476f8b6\": container with ID starting with ba8822c1e5c526c89e8ec262b03bae0b25fe9d104568c4cc1009b1ba1476f8b6 not found: ID does not exist" Mar 16 16:01:58 crc kubenswrapper[5120]: I0316 16:01:58.424170 5120 scope.go:117] "RemoveContainer" containerID="0ccfa1e90a41f433d1dc037be1ddac91fec1d36076fa1bd39fd0caeaaef1614e" Mar 16 16:01:58 crc kubenswrapper[5120]: I0316 16:01:58.424965 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ccfa1e90a41f433d1dc037be1ddac91fec1d36076fa1bd39fd0caeaaef1614e"} err="failed to get container status \"0ccfa1e90a41f433d1dc037be1ddac91fec1d36076fa1bd39fd0caeaaef1614e\": rpc error: code = NotFound desc = could not find container \"0ccfa1e90a41f433d1dc037be1ddac91fec1d36076fa1bd39fd0caeaaef1614e\": container with ID starting with 0ccfa1e90a41f433d1dc037be1ddac91fec1d36076fa1bd39fd0caeaaef1614e not found: ID does not exist" Mar 16 16:01:58 crc kubenswrapper[5120]: I0316 16:01:58.424988 5120 scope.go:117] "RemoveContainer" containerID="4f9933f0daef80d09ebbf95a1683b8eec46685f9bd6ae3ca379fda90092a37d2" Mar 16 16:01:58 crc kubenswrapper[5120]: I0316 16:01:58.425215 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f9933f0daef80d09ebbf95a1683b8eec46685f9bd6ae3ca379fda90092a37d2"} err="failed to get container status \"4f9933f0daef80d09ebbf95a1683b8eec46685f9bd6ae3ca379fda90092a37d2\": rpc error: code = NotFound desc = could not find container \"4f9933f0daef80d09ebbf95a1683b8eec46685f9bd6ae3ca379fda90092a37d2\": container with ID starting with 4f9933f0daef80d09ebbf95a1683b8eec46685f9bd6ae3ca379fda90092a37d2 not found: ID does not exist" Mar 16 16:01:58 crc kubenswrapper[5120]: I0316 16:01:58.425254 5120 scope.go:117] "RemoveContainer" containerID="caab9dc32ec71c38eb04a128f0392de356d59dff568805b1d8e7c70f3517d52e" Mar 16 16:01:58 crc kubenswrapper[5120]: I0316 16:01:58.425500 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"caab9dc32ec71c38eb04a128f0392de356d59dff568805b1d8e7c70f3517d52e"} err="failed to get container status \"caab9dc32ec71c38eb04a128f0392de356d59dff568805b1d8e7c70f3517d52e\": rpc error: code = NotFound desc = could not find container \"caab9dc32ec71c38eb04a128f0392de356d59dff568805b1d8e7c70f3517d52e\": container with ID starting with caab9dc32ec71c38eb04a128f0392de356d59dff568805b1d8e7c70f3517d52e not found: ID does not exist" Mar 16 16:01:58 crc kubenswrapper[5120]: I0316 16:01:58.425520 5120 scope.go:117] "RemoveContainer" containerID="ba8822c1e5c526c89e8ec262b03bae0b25fe9d104568c4cc1009b1ba1476f8b6" Mar 16 16:01:58 crc kubenswrapper[5120]: I0316 16:01:58.425709 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba8822c1e5c526c89e8ec262b03bae0b25fe9d104568c4cc1009b1ba1476f8b6"} err="failed to get container status \"ba8822c1e5c526c89e8ec262b03bae0b25fe9d104568c4cc1009b1ba1476f8b6\": rpc error: code = NotFound desc = could not find container \"ba8822c1e5c526c89e8ec262b03bae0b25fe9d104568c4cc1009b1ba1476f8b6\": container with ID starting with ba8822c1e5c526c89e8ec262b03bae0b25fe9d104568c4cc1009b1ba1476f8b6 not found: ID does not exist" Mar 16 16:01:58 crc kubenswrapper[5120]: I0316 16:01:58.425729 5120 scope.go:117] "RemoveContainer" containerID="0ccfa1e90a41f433d1dc037be1ddac91fec1d36076fa1bd39fd0caeaaef1614e" Mar 16 16:01:58 crc kubenswrapper[5120]: I0316 16:01:58.426124 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ccfa1e90a41f433d1dc037be1ddac91fec1d36076fa1bd39fd0caeaaef1614e"} err="failed to get container status \"0ccfa1e90a41f433d1dc037be1ddac91fec1d36076fa1bd39fd0caeaaef1614e\": rpc error: code = NotFound desc = could not find container \"0ccfa1e90a41f433d1dc037be1ddac91fec1d36076fa1bd39fd0caeaaef1614e\": container with ID starting with 0ccfa1e90a41f433d1dc037be1ddac91fec1d36076fa1bd39fd0caeaaef1614e not found: ID does not exist" Mar 16 16:01:58 crc kubenswrapper[5120]: I0316 16:01:58.426144 5120 scope.go:117] "RemoveContainer" containerID="4f9933f0daef80d09ebbf95a1683b8eec46685f9bd6ae3ca379fda90092a37d2" Mar 16 16:01:58 crc kubenswrapper[5120]: I0316 16:01:58.430320 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f9933f0daef80d09ebbf95a1683b8eec46685f9bd6ae3ca379fda90092a37d2"} err="failed to get container status \"4f9933f0daef80d09ebbf95a1683b8eec46685f9bd6ae3ca379fda90092a37d2\": rpc error: code = NotFound desc = could not find container \"4f9933f0daef80d09ebbf95a1683b8eec46685f9bd6ae3ca379fda90092a37d2\": container with ID starting with 4f9933f0daef80d09ebbf95a1683b8eec46685f9bd6ae3ca379fda90092a37d2 not found: ID does not exist" Mar 16 16:01:58 crc kubenswrapper[5120]: I0316 16:01:58.430342 5120 scope.go:117] "RemoveContainer" containerID="caab9dc32ec71c38eb04a128f0392de356d59dff568805b1d8e7c70f3517d52e" Mar 16 16:01:58 crc kubenswrapper[5120]: I0316 16:01:58.431889 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"caab9dc32ec71c38eb04a128f0392de356d59dff568805b1d8e7c70f3517d52e"} err="failed to get container status \"caab9dc32ec71c38eb04a128f0392de356d59dff568805b1d8e7c70f3517d52e\": rpc error: code = NotFound desc = could not find container \"caab9dc32ec71c38eb04a128f0392de356d59dff568805b1d8e7c70f3517d52e\": container with ID starting with caab9dc32ec71c38eb04a128f0392de356d59dff568805b1d8e7c70f3517d52e not found: ID does not exist" Mar 16 16:01:58 crc kubenswrapper[5120]: I0316 16:01:58.431910 5120 scope.go:117] "RemoveContainer" containerID="ba8822c1e5c526c89e8ec262b03bae0b25fe9d104568c4cc1009b1ba1476f8b6" Mar 16 16:01:58 crc kubenswrapper[5120]: I0316 16:01:58.432071 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba8822c1e5c526c89e8ec262b03bae0b25fe9d104568c4cc1009b1ba1476f8b6"} err="failed to get container status \"ba8822c1e5c526c89e8ec262b03bae0b25fe9d104568c4cc1009b1ba1476f8b6\": rpc error: code = NotFound desc = could not find container \"ba8822c1e5c526c89e8ec262b03bae0b25fe9d104568c4cc1009b1ba1476f8b6\": container with ID starting with ba8822c1e5c526c89e8ec262b03bae0b25fe9d104568c4cc1009b1ba1476f8b6 not found: ID does not exist" Mar 16 16:01:58 crc kubenswrapper[5120]: I0316 16:01:58.436681 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e6f29e10-c540-416f-937a-0b0e8cbceef9-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"e6f29e10-c540-416f-937a-0b0e8cbceef9\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:01:58 crc kubenswrapper[5120]: I0316 16:01:58.436963 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/e6f29e10-c540-416f-937a-0b0e8cbceef9-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"e6f29e10-c540-416f-937a-0b0e8cbceef9\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:01:58 crc kubenswrapper[5120]: I0316 16:01:58.437002 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e6f29e10-c540-416f-937a-0b0e8cbceef9-log-httpd\") pod \"ceilometer-0\" (UID: \"e6f29e10-c540-416f-937a-0b0e8cbceef9\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:01:58 crc kubenswrapper[5120]: I0316 16:01:58.437029 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chfpm\" (UniqueName: \"kubernetes.io/projected/e6f29e10-c540-416f-937a-0b0e8cbceef9-kube-api-access-chfpm\") pod \"ceilometer-0\" (UID: \"e6f29e10-c540-416f-937a-0b0e8cbceef9\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:01:58 crc kubenswrapper[5120]: I0316 16:01:58.437104 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e6f29e10-c540-416f-937a-0b0e8cbceef9-scripts\") pod \"ceilometer-0\" (UID: \"e6f29e10-c540-416f-937a-0b0e8cbceef9\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:01:58 crc kubenswrapper[5120]: I0316 16:01:58.437135 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e6f29e10-c540-416f-937a-0b0e8cbceef9-config-data\") pod \"ceilometer-0\" (UID: \"e6f29e10-c540-416f-937a-0b0e8cbceef9\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:01:58 crc kubenswrapper[5120]: I0316 16:01:58.437182 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e6f29e10-c540-416f-937a-0b0e8cbceef9-run-httpd\") pod \"ceilometer-0\" (UID: \"e6f29e10-c540-416f-937a-0b0e8cbceef9\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:01:58 crc kubenswrapper[5120]: I0316 16:01:58.538279 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e6f29e10-c540-416f-937a-0b0e8cbceef9-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"e6f29e10-c540-416f-937a-0b0e8cbceef9\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:01:58 crc kubenswrapper[5120]: I0316 16:01:58.538314 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/e6f29e10-c540-416f-937a-0b0e8cbceef9-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"e6f29e10-c540-416f-937a-0b0e8cbceef9\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:01:58 crc kubenswrapper[5120]: I0316 16:01:58.538347 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e6f29e10-c540-416f-937a-0b0e8cbceef9-log-httpd\") pod \"ceilometer-0\" (UID: \"e6f29e10-c540-416f-937a-0b0e8cbceef9\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:01:58 crc kubenswrapper[5120]: I0316 16:01:58.538376 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-chfpm\" (UniqueName: \"kubernetes.io/projected/e6f29e10-c540-416f-937a-0b0e8cbceef9-kube-api-access-chfpm\") pod \"ceilometer-0\" (UID: \"e6f29e10-c540-416f-937a-0b0e8cbceef9\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:01:58 crc kubenswrapper[5120]: I0316 16:01:58.538450 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e6f29e10-c540-416f-937a-0b0e8cbceef9-scripts\") pod \"ceilometer-0\" (UID: \"e6f29e10-c540-416f-937a-0b0e8cbceef9\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:01:58 crc kubenswrapper[5120]: I0316 16:01:58.538479 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e6f29e10-c540-416f-937a-0b0e8cbceef9-config-data\") pod \"ceilometer-0\" (UID: \"e6f29e10-c540-416f-937a-0b0e8cbceef9\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:01:58 crc kubenswrapper[5120]: I0316 16:01:58.538528 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e6f29e10-c540-416f-937a-0b0e8cbceef9-run-httpd\") pod \"ceilometer-0\" (UID: \"e6f29e10-c540-416f-937a-0b0e8cbceef9\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:01:58 crc kubenswrapper[5120]: I0316 16:01:58.538959 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e6f29e10-c540-416f-937a-0b0e8cbceef9-run-httpd\") pod \"ceilometer-0\" (UID: \"e6f29e10-c540-416f-937a-0b0e8cbceef9\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:01:58 crc kubenswrapper[5120]: I0316 16:01:58.539143 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e6f29e10-c540-416f-937a-0b0e8cbceef9-log-httpd\") pod \"ceilometer-0\" (UID: \"e6f29e10-c540-416f-937a-0b0e8cbceef9\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:01:58 crc kubenswrapper[5120]: I0316 16:01:58.543044 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e6f29e10-c540-416f-937a-0b0e8cbceef9-scripts\") pod \"ceilometer-0\" (UID: \"e6f29e10-c540-416f-937a-0b0e8cbceef9\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:01:58 crc kubenswrapper[5120]: I0316 16:01:58.543583 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e6f29e10-c540-416f-937a-0b0e8cbceef9-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"e6f29e10-c540-416f-937a-0b0e8cbceef9\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:01:58 crc kubenswrapper[5120]: I0316 16:01:58.544146 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/e6f29e10-c540-416f-937a-0b0e8cbceef9-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"e6f29e10-c540-416f-937a-0b0e8cbceef9\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:01:58 crc kubenswrapper[5120]: I0316 16:01:58.549818 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e6f29e10-c540-416f-937a-0b0e8cbceef9-config-data\") pod \"ceilometer-0\" (UID: \"e6f29e10-c540-416f-937a-0b0e8cbceef9\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:01:58 crc kubenswrapper[5120]: I0316 16:01:58.554508 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-chfpm\" (UniqueName: \"kubernetes.io/projected/e6f29e10-c540-416f-937a-0b0e8cbceef9-kube-api-access-chfpm\") pod \"ceilometer-0\" (UID: \"e6f29e10-c540-416f-937a-0b0e8cbceef9\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:01:58 crc kubenswrapper[5120]: I0316 16:01:58.632589 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:01:58 crc kubenswrapper[5120]: I0316 16:01:58.678378 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="06bf3ec7-8d8e-4aa6-ada8-7dacc2a00ac5" path="/var/lib/kubelet/pods/06bf3ec7-8d8e-4aa6-ada8-7dacc2a00ac5/volumes" Mar 16 16:01:59 crc kubenswrapper[5120]: I0316 16:01:59.160839 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:01:59 crc kubenswrapper[5120]: I0316 16:01:59.175029 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"ee138521-8f48-4215-9e58-cf1d50ad7910","Type":"ContainerStarted","Data":"4a2dee30e47e2483dd875b5fbbc3f4abc1d9b1c74824ae9639353e63a9890e0a"} Mar 16 16:01:59 crc kubenswrapper[5120]: W0316 16:01:59.180428 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode6f29e10_c540_416f_937a_0b0e8cbceef9.slice/crio-a6afe5f24117aeb51af9ada5bdf81d0157829f7bcf91ae270ff8b8e39befb673 WatchSource:0}: Error finding container a6afe5f24117aeb51af9ada5bdf81d0157829f7bcf91ae270ff8b8e39befb673: Status 404 returned error can't find the container with id a6afe5f24117aeb51af9ada5bdf81d0157829f7bcf91ae270ff8b8e39befb673 Mar 16 16:01:59 crc kubenswrapper[5120]: I0316 16:01:59.187472 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"163efc0d-017d-48a3-b592-8053b3a30dfb","Type":"ContainerStarted","Data":"7d1fda67e8a5ed89cb5bc877893fe2379fda817749cf5c4168175b8646120b5b"} Mar 16 16:01:59 crc kubenswrapper[5120]: I0316 16:01:59.203624 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"9e30c205-c2b2-4766-8777-6b2730f5172a","Type":"ContainerStarted","Data":"caa993c16d00e0213f46cc2dd20ef499c77a1c238968d283caf8f4aa952d2319"} Mar 16 16:02:00 crc kubenswrapper[5120]: I0316 16:02:00.135647 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-infra/auto-csr-approver-29561282-7mmmh"] Mar 16 16:02:00 crc kubenswrapper[5120]: I0316 16:02:00.141463 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561282-7mmmh" Mar 16 16:02:00 crc kubenswrapper[5120]: I0316 16:02:00.143432 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"openshift-service-ca.crt\"" Mar 16 16:02:00 crc kubenswrapper[5120]: I0316 16:02:00.144089 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"kube-root-ca.crt\"" Mar 16 16:02:00 crc kubenswrapper[5120]: I0316 16:02:00.144510 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-infra\"/\"csr-approver-sa-dockercfg-x2nsz\"" Mar 16 16:02:00 crc kubenswrapper[5120]: I0316 16:02:00.150268 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561282-7mmmh"] Mar 16 16:02:00 crc kubenswrapper[5120]: I0316 16:02:00.214752 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"9e30c205-c2b2-4766-8777-6b2730f5172a","Type":"ContainerStarted","Data":"3fb2f0ebaa9349fc31d1d61f88cf5c3160e366b347fc1b17e8366f0874ebfe72"} Mar 16 16:02:00 crc kubenswrapper[5120]: I0316 16:02:00.217580 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"e6f29e10-c540-416f-937a-0b0e8cbceef9","Type":"ContainerStarted","Data":"b57a42f04539435d37185f3a2ac319195f6f121989df111ab79903e0175b1a6c"} Mar 16 16:02:00 crc kubenswrapper[5120]: I0316 16:02:00.217832 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"e6f29e10-c540-416f-937a-0b0e8cbceef9","Type":"ContainerStarted","Data":"a6afe5f24117aeb51af9ada5bdf81d0157829f7bcf91ae270ff8b8e39befb673"} Mar 16 16:02:00 crc kubenswrapper[5120]: I0316 16:02:00.221009 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"163efc0d-017d-48a3-b592-8053b3a30dfb","Type":"ContainerStarted","Data":"a26d665057b44d51562f127c6b15ffa6185065ad2b0f038353d0a325845ce504"} Mar 16 16:02:00 crc kubenswrapper[5120]: I0316 16:02:00.221090 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:02:00 crc kubenswrapper[5120]: I0316 16:02:00.236085 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-scheduler-0" podStartSLOduration=5.23606421 podStartE2EDuration="5.23606421s" podCreationTimestamp="2026-03-16 16:01:55 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:02:00.232518053 +0000 UTC m=+1822.386449730" watchObservedRunningTime="2026-03-16 16:02:00.23606421 +0000 UTC m=+1822.389995877" Mar 16 16:02:00 crc kubenswrapper[5120]: I0316 16:02:00.254712 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-api-0" podStartSLOduration=4.254694913 podStartE2EDuration="4.254694913s" podCreationTimestamp="2026-03-16 16:01:56 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:02:00.252105662 +0000 UTC m=+1822.406037319" watchObservedRunningTime="2026-03-16 16:02:00.254694913 +0000 UTC m=+1822.408626570" Mar 16 16:02:00 crc kubenswrapper[5120]: I0316 16:02:00.270386 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crj5f\" (UniqueName: \"kubernetes.io/projected/8a4260b1-b93d-446f-80f7-63725b47a94e-kube-api-access-crj5f\") pod \"auto-csr-approver-29561282-7mmmh\" (UID: \"8a4260b1-b93d-446f-80f7-63725b47a94e\") " pod="openshift-infra/auto-csr-approver-29561282-7mmmh" Mar 16 16:02:00 crc kubenswrapper[5120]: I0316 16:02:00.372305 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-crj5f\" (UniqueName: \"kubernetes.io/projected/8a4260b1-b93d-446f-80f7-63725b47a94e-kube-api-access-crj5f\") pod \"auto-csr-approver-29561282-7mmmh\" (UID: \"8a4260b1-b93d-446f-80f7-63725b47a94e\") " pod="openshift-infra/auto-csr-approver-29561282-7mmmh" Mar 16 16:02:00 crc kubenswrapper[5120]: I0316 16:02:00.391844 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-crj5f\" (UniqueName: \"kubernetes.io/projected/8a4260b1-b93d-446f-80f7-63725b47a94e-kube-api-access-crj5f\") pod \"auto-csr-approver-29561282-7mmmh\" (UID: \"8a4260b1-b93d-446f-80f7-63725b47a94e\") " pod="openshift-infra/auto-csr-approver-29561282-7mmmh" Mar 16 16:02:00 crc kubenswrapper[5120]: I0316 16:02:00.459383 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561282-7mmmh" Mar 16 16:02:00 crc kubenswrapper[5120]: I0316 16:02:00.977040 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561282-7mmmh"] Mar 16 16:02:00 crc kubenswrapper[5120]: W0316 16:02:00.979198 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8a4260b1_b93d_446f_80f7_63725b47a94e.slice/crio-fadb68224b81dad3ffb1feea8cbd4916d86c34ec4a1de37bad49ab7a92786b7c WatchSource:0}: Error finding container fadb68224b81dad3ffb1feea8cbd4916d86c34ec4a1de37bad49ab7a92786b7c: Status 404 returned error can't find the container with id fadb68224b81dad3ffb1feea8cbd4916d86c34ec4a1de37bad49ab7a92786b7c Mar 16 16:02:01 crc kubenswrapper[5120]: I0316 16:02:01.233466 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"e6f29e10-c540-416f-937a-0b0e8cbceef9","Type":"ContainerStarted","Data":"83ac6bf0cd539024b4fdd280b61d2850621c5f3b2f9b764184f582295056ac7f"} Mar 16 16:02:01 crc kubenswrapper[5120]: I0316 16:02:01.233820 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"e6f29e10-c540-416f-937a-0b0e8cbceef9","Type":"ContainerStarted","Data":"c5053999b289290441bd5d0a9ad579a71fa73cf3376801ea1a32d54875d317c9"} Mar 16 16:02:01 crc kubenswrapper[5120]: I0316 16:02:01.235919 5120 generic.go:358] "Generic (PLEG): container finished" podID="cb8bda64-dcf7-461e-a963-74aeeec060fd" containerID="99e3ec545996bb94f68d714fc428ffb531b50020d515a649c749101075591fad" exitCode=0 Mar 16 16:02:01 crc kubenswrapper[5120]: I0316 16:02:01.236023 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-fdvcj" event={"ID":"cb8bda64-dcf7-461e-a963-74aeeec060fd","Type":"ContainerDied","Data":"99e3ec545996bb94f68d714fc428ffb531b50020d515a649c749101075591fad"} Mar 16 16:02:01 crc kubenswrapper[5120]: I0316 16:02:01.237554 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561282-7mmmh" event={"ID":"8a4260b1-b93d-446f-80f7-63725b47a94e","Type":"ContainerStarted","Data":"fadb68224b81dad3ffb1feea8cbd4916d86c34ec4a1de37bad49ab7a92786b7c"} Mar 16 16:02:01 crc kubenswrapper[5120]: I0316 16:02:01.611047 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:02:01 crc kubenswrapper[5120]: I0316 16:02:01.972383 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:02:02 crc kubenswrapper[5120]: I0316 16:02:02.248802 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="163efc0d-017d-48a3-b592-8053b3a30dfb" containerName="cinder-api-log" containerID="cri-o://7d1fda67e8a5ed89cb5bc877893fe2379fda817749cf5c4168175b8646120b5b" gracePeriod=30 Mar 16 16:02:02 crc kubenswrapper[5120]: I0316 16:02:02.248873 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="163efc0d-017d-48a3-b592-8053b3a30dfb" containerName="cinder-api" containerID="cri-o://a26d665057b44d51562f127c6b15ffa6185065ad2b0f038353d0a325845ce504" gracePeriod=30 Mar 16 16:02:02 crc kubenswrapper[5120]: I0316 16:02:02.781166 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:02:02 crc kubenswrapper[5120]: I0316 16:02:02.781533 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:02:02 crc kubenswrapper[5120]: I0316 16:02:02.810899 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-fdvcj" Mar 16 16:02:02 crc kubenswrapper[5120]: I0316 16:02:02.815137 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:02:02 crc kubenswrapper[5120]: I0316 16:02:02.845920 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:02:02 crc kubenswrapper[5120]: I0316 16:02:02.946554 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cb8bda64-dcf7-461e-a963-74aeeec060fd-combined-ca-bundle\") pod \"cb8bda64-dcf7-461e-a963-74aeeec060fd\" (UID: \"cb8bda64-dcf7-461e-a963-74aeeec060fd\") " Mar 16 16:02:02 crc kubenswrapper[5120]: I0316 16:02:02.946697 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cb8bda64-dcf7-461e-a963-74aeeec060fd-config-data\") pod \"cb8bda64-dcf7-461e-a963-74aeeec060fd\" (UID: \"cb8bda64-dcf7-461e-a963-74aeeec060fd\") " Mar 16 16:02:02 crc kubenswrapper[5120]: I0316 16:02:02.946808 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/cb8bda64-dcf7-461e-a963-74aeeec060fd-credential-keys\") pod \"cb8bda64-dcf7-461e-a963-74aeeec060fd\" (UID: \"cb8bda64-dcf7-461e-a963-74aeeec060fd\") " Mar 16 16:02:02 crc kubenswrapper[5120]: I0316 16:02:02.946842 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b8f5h\" (UniqueName: \"kubernetes.io/projected/cb8bda64-dcf7-461e-a963-74aeeec060fd-kube-api-access-b8f5h\") pod \"cb8bda64-dcf7-461e-a963-74aeeec060fd\" (UID: \"cb8bda64-dcf7-461e-a963-74aeeec060fd\") " Mar 16 16:02:02 crc kubenswrapper[5120]: I0316 16:02:02.947021 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/cb8bda64-dcf7-461e-a963-74aeeec060fd-scripts\") pod \"cb8bda64-dcf7-461e-a963-74aeeec060fd\" (UID: \"cb8bda64-dcf7-461e-a963-74aeeec060fd\") " Mar 16 16:02:02 crc kubenswrapper[5120]: I0316 16:02:02.947160 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/cb8bda64-dcf7-461e-a963-74aeeec060fd-fernet-keys\") pod \"cb8bda64-dcf7-461e-a963-74aeeec060fd\" (UID: \"cb8bda64-dcf7-461e-a963-74aeeec060fd\") " Mar 16 16:02:02 crc kubenswrapper[5120]: I0316 16:02:02.959734 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb8bda64-dcf7-461e-a963-74aeeec060fd-scripts" (OuterVolumeSpecName: "scripts") pod "cb8bda64-dcf7-461e-a963-74aeeec060fd" (UID: "cb8bda64-dcf7-461e-a963-74aeeec060fd"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:02:02 crc kubenswrapper[5120]: I0316 16:02:02.960280 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb8bda64-dcf7-461e-a963-74aeeec060fd-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "cb8bda64-dcf7-461e-a963-74aeeec060fd" (UID: "cb8bda64-dcf7-461e-a963-74aeeec060fd"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:02:02 crc kubenswrapper[5120]: I0316 16:02:02.961874 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb8bda64-dcf7-461e-a963-74aeeec060fd-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "cb8bda64-dcf7-461e-a963-74aeeec060fd" (UID: "cb8bda64-dcf7-461e-a963-74aeeec060fd"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:02:02 crc kubenswrapper[5120]: I0316 16:02:02.972675 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb8bda64-dcf7-461e-a963-74aeeec060fd-kube-api-access-b8f5h" (OuterVolumeSpecName: "kube-api-access-b8f5h") pod "cb8bda64-dcf7-461e-a963-74aeeec060fd" (UID: "cb8bda64-dcf7-461e-a963-74aeeec060fd"). InnerVolumeSpecName "kube-api-access-b8f5h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.000006 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb8bda64-dcf7-461e-a963-74aeeec060fd-config-data" (OuterVolumeSpecName: "config-data") pod "cb8bda64-dcf7-461e-a963-74aeeec060fd" (UID: "cb8bda64-dcf7-461e-a963-74aeeec060fd"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.000420 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb8bda64-dcf7-461e-a963-74aeeec060fd-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "cb8bda64-dcf7-461e-a963-74aeeec060fd" (UID: "cb8bda64-dcf7-461e-a963-74aeeec060fd"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.049486 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cb8bda64-dcf7-461e-a963-74aeeec060fd-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.049522 5120 reconciler_common.go:299] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/cb8bda64-dcf7-461e-a963-74aeeec060fd-credential-keys\") on node \"crc\" DevicePath \"\"" Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.049535 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b8f5h\" (UniqueName: \"kubernetes.io/projected/cb8bda64-dcf7-461e-a963-74aeeec060fd-kube-api-access-b8f5h\") on node \"crc\" DevicePath \"\"" Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.049544 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/cb8bda64-dcf7-461e-a963-74aeeec060fd-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.049568 5120 reconciler_common.go:299] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/cb8bda64-dcf7-461e-a963-74aeeec060fd-fernet-keys\") on node \"crc\" DevicePath \"\"" Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.049578 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cb8bda64-dcf7-461e-a963-74aeeec060fd-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.060408 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.150572 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/163efc0d-017d-48a3-b592-8053b3a30dfb-logs\") pod \"163efc0d-017d-48a3-b592-8053b3a30dfb\" (UID: \"163efc0d-017d-48a3-b592-8053b3a30dfb\") " Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.151060 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/163efc0d-017d-48a3-b592-8053b3a30dfb-config-data-custom\") pod \"163efc0d-017d-48a3-b592-8053b3a30dfb\" (UID: \"163efc0d-017d-48a3-b592-8053b3a30dfb\") " Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.151104 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/163efc0d-017d-48a3-b592-8053b3a30dfb-combined-ca-bundle\") pod \"163efc0d-017d-48a3-b592-8053b3a30dfb\" (UID: \"163efc0d-017d-48a3-b592-8053b3a30dfb\") " Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.151135 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/163efc0d-017d-48a3-b592-8053b3a30dfb-etc-machine-id\") pod \"163efc0d-017d-48a3-b592-8053b3a30dfb\" (UID: \"163efc0d-017d-48a3-b592-8053b3a30dfb\") " Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.151158 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n85tr\" (UniqueName: \"kubernetes.io/projected/163efc0d-017d-48a3-b592-8053b3a30dfb-kube-api-access-n85tr\") pod \"163efc0d-017d-48a3-b592-8053b3a30dfb\" (UID: \"163efc0d-017d-48a3-b592-8053b3a30dfb\") " Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.151268 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/163efc0d-017d-48a3-b592-8053b3a30dfb-logs" (OuterVolumeSpecName: "logs") pod "163efc0d-017d-48a3-b592-8053b3a30dfb" (UID: "163efc0d-017d-48a3-b592-8053b3a30dfb"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.151660 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/163efc0d-017d-48a3-b592-8053b3a30dfb-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "163efc0d-017d-48a3-b592-8053b3a30dfb" (UID: "163efc0d-017d-48a3-b592-8053b3a30dfb"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.152634 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/163efc0d-017d-48a3-b592-8053b3a30dfb-scripts\") pod \"163efc0d-017d-48a3-b592-8053b3a30dfb\" (UID: \"163efc0d-017d-48a3-b592-8053b3a30dfb\") " Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.152694 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/163efc0d-017d-48a3-b592-8053b3a30dfb-config-data\") pod \"163efc0d-017d-48a3-b592-8053b3a30dfb\" (UID: \"163efc0d-017d-48a3-b592-8053b3a30dfb\") " Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.153613 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/163efc0d-017d-48a3-b592-8053b3a30dfb-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.153636 5120 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/163efc0d-017d-48a3-b592-8053b3a30dfb-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.158857 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/163efc0d-017d-48a3-b592-8053b3a30dfb-scripts" (OuterVolumeSpecName: "scripts") pod "163efc0d-017d-48a3-b592-8053b3a30dfb" (UID: "163efc0d-017d-48a3-b592-8053b3a30dfb"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.165143 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/163efc0d-017d-48a3-b592-8053b3a30dfb-kube-api-access-n85tr" (OuterVolumeSpecName: "kube-api-access-n85tr") pod "163efc0d-017d-48a3-b592-8053b3a30dfb" (UID: "163efc0d-017d-48a3-b592-8053b3a30dfb"). InnerVolumeSpecName "kube-api-access-n85tr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.165989 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/163efc0d-017d-48a3-b592-8053b3a30dfb-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "163efc0d-017d-48a3-b592-8053b3a30dfb" (UID: "163efc0d-017d-48a3-b592-8053b3a30dfb"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.181907 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/163efc0d-017d-48a3-b592-8053b3a30dfb-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "163efc0d-017d-48a3-b592-8053b3a30dfb" (UID: "163efc0d-017d-48a3-b592-8053b3a30dfb"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.209189 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/163efc0d-017d-48a3-b592-8053b3a30dfb-config-data" (OuterVolumeSpecName: "config-data") pod "163efc0d-017d-48a3-b592-8053b3a30dfb" (UID: "163efc0d-017d-48a3-b592-8053b3a30dfb"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.255854 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/163efc0d-017d-48a3-b592-8053b3a30dfb-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.255883 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/163efc0d-017d-48a3-b592-8053b3a30dfb-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.255893 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n85tr\" (UniqueName: \"kubernetes.io/projected/163efc0d-017d-48a3-b592-8053b3a30dfb-kube-api-access-n85tr\") on node \"crc\" DevicePath \"\"" Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.255904 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/163efc0d-017d-48a3-b592-8053b3a30dfb-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.255912 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/163efc0d-017d-48a3-b592-8053b3a30dfb-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.258801 5120 generic.go:358] "Generic (PLEG): container finished" podID="163efc0d-017d-48a3-b592-8053b3a30dfb" containerID="a26d665057b44d51562f127c6b15ffa6185065ad2b0f038353d0a325845ce504" exitCode=0 Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.258829 5120 generic.go:358] "Generic (PLEG): container finished" podID="163efc0d-017d-48a3-b592-8053b3a30dfb" containerID="7d1fda67e8a5ed89cb5bc877893fe2379fda817749cf5c4168175b8646120b5b" exitCode=143 Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.258901 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.258913 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"163efc0d-017d-48a3-b592-8053b3a30dfb","Type":"ContainerDied","Data":"a26d665057b44d51562f127c6b15ffa6185065ad2b0f038353d0a325845ce504"} Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.258969 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"163efc0d-017d-48a3-b592-8053b3a30dfb","Type":"ContainerDied","Data":"7d1fda67e8a5ed89cb5bc877893fe2379fda817749cf5c4168175b8646120b5b"} Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.259015 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"163efc0d-017d-48a3-b592-8053b3a30dfb","Type":"ContainerDied","Data":"eb9b68fac590ad1aeb605fadb0340c8bc3d65ee5981d313714f7333705718237"} Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.259017 5120 scope.go:117] "RemoveContainer" containerID="a26d665057b44d51562f127c6b15ffa6185065ad2b0f038353d0a325845ce504" Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.261663 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-fdvcj" event={"ID":"cb8bda64-dcf7-461e-a963-74aeeec060fd","Type":"ContainerDied","Data":"f78e83339543f602f722368830f00ca7db5b9646ddffa9caa4b70c8c3ec80bba"} Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.261710 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-fdvcj" Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.261714 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f78e83339543f602f722368830f00ca7db5b9646ddffa9caa4b70c8c3ec80bba" Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.264090 5120 generic.go:358] "Generic (PLEG): container finished" podID="8a4260b1-b93d-446f-80f7-63725b47a94e" containerID="d270654e145e433239ceb2fac4c35672645df61ff2d8d5f57bea05589e31474e" exitCode=0 Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.264493 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561282-7mmmh" event={"ID":"8a4260b1-b93d-446f-80f7-63725b47a94e","Type":"ContainerDied","Data":"d270654e145e433239ceb2fac4c35672645df61ff2d8d5f57bea05589e31474e"} Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.284899 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"e6f29e10-c540-416f-937a-0b0e8cbceef9","Type":"ContainerStarted","Data":"df5d0129423dcd5500785dd2881b51e1a1664bfcdfd3ad6b4d5b66e40782ef7e"} Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.284980 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.285258 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.285807 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.311821 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=1.611577444 podStartE2EDuration="5.311805973s" podCreationTimestamp="2026-03-16 16:01:58 +0000 UTC" firstStartedPulling="2026-03-16 16:01:59.188321054 +0000 UTC m=+1821.342252711" lastFinishedPulling="2026-03-16 16:02:02.888549573 +0000 UTC m=+1825.042481240" observedRunningTime="2026-03-16 16:02:03.308027219 +0000 UTC m=+1825.461958876" watchObservedRunningTime="2026-03-16 16:02:03.311805973 +0000 UTC m=+1825.465737630" Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.315987 5120 scope.go:117] "RemoveContainer" containerID="7d1fda67e8a5ed89cb5bc877893fe2379fda817749cf5c4168175b8646120b5b" Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.365203 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.371692 5120 scope.go:117] "RemoveContainer" containerID="a26d665057b44d51562f127c6b15ffa6185065ad2b0f038353d0a325845ce504" Mar 16 16:02:03 crc kubenswrapper[5120]: E0316 16:02:03.372187 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a26d665057b44d51562f127c6b15ffa6185065ad2b0f038353d0a325845ce504\": container with ID starting with a26d665057b44d51562f127c6b15ffa6185065ad2b0f038353d0a325845ce504 not found: ID does not exist" containerID="a26d665057b44d51562f127c6b15ffa6185065ad2b0f038353d0a325845ce504" Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.372225 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a26d665057b44d51562f127c6b15ffa6185065ad2b0f038353d0a325845ce504"} err="failed to get container status \"a26d665057b44d51562f127c6b15ffa6185065ad2b0f038353d0a325845ce504\": rpc error: code = NotFound desc = could not find container \"a26d665057b44d51562f127c6b15ffa6185065ad2b0f038353d0a325845ce504\": container with ID starting with a26d665057b44d51562f127c6b15ffa6185065ad2b0f038353d0a325845ce504 not found: ID does not exist" Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.372276 5120 scope.go:117] "RemoveContainer" containerID="7d1fda67e8a5ed89cb5bc877893fe2379fda817749cf5c4168175b8646120b5b" Mar 16 16:02:03 crc kubenswrapper[5120]: E0316 16:02:03.372896 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d1fda67e8a5ed89cb5bc877893fe2379fda817749cf5c4168175b8646120b5b\": container with ID starting with 7d1fda67e8a5ed89cb5bc877893fe2379fda817749cf5c4168175b8646120b5b not found: ID does not exist" containerID="7d1fda67e8a5ed89cb5bc877893fe2379fda817749cf5c4168175b8646120b5b" Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.372945 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d1fda67e8a5ed89cb5bc877893fe2379fda817749cf5c4168175b8646120b5b"} err="failed to get container status \"7d1fda67e8a5ed89cb5bc877893fe2379fda817749cf5c4168175b8646120b5b\": rpc error: code = NotFound desc = could not find container \"7d1fda67e8a5ed89cb5bc877893fe2379fda817749cf5c4168175b8646120b5b\": container with ID starting with 7d1fda67e8a5ed89cb5bc877893fe2379fda817749cf5c4168175b8646120b5b not found: ID does not exist" Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.372970 5120 scope.go:117] "RemoveContainer" containerID="a26d665057b44d51562f127c6b15ffa6185065ad2b0f038353d0a325845ce504" Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.377288 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a26d665057b44d51562f127c6b15ffa6185065ad2b0f038353d0a325845ce504"} err="failed to get container status \"a26d665057b44d51562f127c6b15ffa6185065ad2b0f038353d0a325845ce504\": rpc error: code = NotFound desc = could not find container \"a26d665057b44d51562f127c6b15ffa6185065ad2b0f038353d0a325845ce504\": container with ID starting with a26d665057b44d51562f127c6b15ffa6185065ad2b0f038353d0a325845ce504 not found: ID does not exist" Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.377334 5120 scope.go:117] "RemoveContainer" containerID="7d1fda67e8a5ed89cb5bc877893fe2379fda817749cf5c4168175b8646120b5b" Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.378296 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.380611 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d1fda67e8a5ed89cb5bc877893fe2379fda817749cf5c4168175b8646120b5b"} err="failed to get container status \"7d1fda67e8a5ed89cb5bc877893fe2379fda817749cf5c4168175b8646120b5b\": rpc error: code = NotFound desc = could not find container \"7d1fda67e8a5ed89cb5bc877893fe2379fda817749cf5c4168175b8646120b5b\": container with ID starting with 7d1fda67e8a5ed89cb5bc877893fe2379fda817749cf5c4168175b8646120b5b not found: ID does not exist" Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.404294 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.405908 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="163efc0d-017d-48a3-b592-8053b3a30dfb" containerName="cinder-api" Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.405925 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="163efc0d-017d-48a3-b592-8053b3a30dfb" containerName="cinder-api" Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.405997 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb8bda64-dcf7-461e-a963-74aeeec060fd" containerName="keystone-bootstrap" Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.406005 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb8bda64-dcf7-461e-a963-74aeeec060fd" containerName="keystone-bootstrap" Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.406025 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="163efc0d-017d-48a3-b592-8053b3a30dfb" containerName="cinder-api-log" Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.406030 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="163efc0d-017d-48a3-b592-8053b3a30dfb" containerName="cinder-api-log" Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.406427 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="cb8bda64-dcf7-461e-a963-74aeeec060fd" containerName="keystone-bootstrap" Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.406471 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="163efc0d-017d-48a3-b592-8053b3a30dfb" containerName="cinder-api-log" Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.406510 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="163efc0d-017d-48a3-b592-8053b3a30dfb" containerName="cinder-api" Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.419951 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.434667 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-api-config-data\"" Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.434710 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-cinder-public-svc\"" Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.435282 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-cinder-internal-svc\"" Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.440828 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.468937 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-5948cb6c79-mrnwx"] Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.484065 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-5948cb6c79-mrnwx" Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.488388 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone\"" Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.488605 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-keystone-public-svc\"" Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.491833 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-5948cb6c79-mrnwx"] Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.494124 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-keystone-internal-svc\"" Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.494466 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-scripts\"" Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.494727 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-keystone-dockercfg-dsstd\"" Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.494950 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-config-data\"" Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.572772 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/3ac8d936-98a3-4922-ac56-1f0056b29125-etc-machine-id\") pod \"cinder-api-0\" (UID: \"3ac8d936-98a3-4922-ac56-1f0056b29125\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.572821 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3ac8d936-98a3-4922-ac56-1f0056b29125-config-data\") pod \"cinder-api-0\" (UID: \"3ac8d936-98a3-4922-ac56-1f0056b29125\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.572878 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f0204257-b12d-4e9d-bdfd-e35cfaa598b5-combined-ca-bundle\") pod \"keystone-5948cb6c79-mrnwx\" (UID: \"f0204257-b12d-4e9d-bdfd-e35cfaa598b5\") " pod="openstack-kuttl-tests/keystone-5948cb6c79-mrnwx" Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.572987 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f0204257-b12d-4e9d-bdfd-e35cfaa598b5-internal-tls-certs\") pod \"keystone-5948cb6c79-mrnwx\" (UID: \"f0204257-b12d-4e9d-bdfd-e35cfaa598b5\") " pod="openstack-kuttl-tests/keystone-5948cb6c79-mrnwx" Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.573073 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbw2c\" (UniqueName: \"kubernetes.io/projected/f0204257-b12d-4e9d-bdfd-e35cfaa598b5-kube-api-access-gbw2c\") pod \"keystone-5948cb6c79-mrnwx\" (UID: \"f0204257-b12d-4e9d-bdfd-e35cfaa598b5\") " pod="openstack-kuttl-tests/keystone-5948cb6c79-mrnwx" Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.573155 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f0204257-b12d-4e9d-bdfd-e35cfaa598b5-config-data\") pod \"keystone-5948cb6c79-mrnwx\" (UID: \"f0204257-b12d-4e9d-bdfd-e35cfaa598b5\") " pod="openstack-kuttl-tests/keystone-5948cb6c79-mrnwx" Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.573213 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f0204257-b12d-4e9d-bdfd-e35cfaa598b5-public-tls-certs\") pod \"keystone-5948cb6c79-mrnwx\" (UID: \"f0204257-b12d-4e9d-bdfd-e35cfaa598b5\") " pod="openstack-kuttl-tests/keystone-5948cb6c79-mrnwx" Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.573278 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/3ac8d936-98a3-4922-ac56-1f0056b29125-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"3ac8d936-98a3-4922-ac56-1f0056b29125\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.573331 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/f0204257-b12d-4e9d-bdfd-e35cfaa598b5-credential-keys\") pod \"keystone-5948cb6c79-mrnwx\" (UID: \"f0204257-b12d-4e9d-bdfd-e35cfaa598b5\") " pod="openstack-kuttl-tests/keystone-5948cb6c79-mrnwx" Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.573371 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmlrz\" (UniqueName: \"kubernetes.io/projected/3ac8d936-98a3-4922-ac56-1f0056b29125-kube-api-access-pmlrz\") pod \"cinder-api-0\" (UID: \"3ac8d936-98a3-4922-ac56-1f0056b29125\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.573394 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3ac8d936-98a3-4922-ac56-1f0056b29125-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"3ac8d936-98a3-4922-ac56-1f0056b29125\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.573487 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/3ac8d936-98a3-4922-ac56-1f0056b29125-config-data-custom\") pod \"cinder-api-0\" (UID: \"3ac8d936-98a3-4922-ac56-1f0056b29125\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.573533 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/3ac8d936-98a3-4922-ac56-1f0056b29125-public-tls-certs\") pod \"cinder-api-0\" (UID: \"3ac8d936-98a3-4922-ac56-1f0056b29125\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.573581 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f0204257-b12d-4e9d-bdfd-e35cfaa598b5-scripts\") pod \"keystone-5948cb6c79-mrnwx\" (UID: \"f0204257-b12d-4e9d-bdfd-e35cfaa598b5\") " pod="openstack-kuttl-tests/keystone-5948cb6c79-mrnwx" Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.573636 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/f0204257-b12d-4e9d-bdfd-e35cfaa598b5-fernet-keys\") pod \"keystone-5948cb6c79-mrnwx\" (UID: \"f0204257-b12d-4e9d-bdfd-e35cfaa598b5\") " pod="openstack-kuttl-tests/keystone-5948cb6c79-mrnwx" Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.573685 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3ac8d936-98a3-4922-ac56-1f0056b29125-logs\") pod \"cinder-api-0\" (UID: \"3ac8d936-98a3-4922-ac56-1f0056b29125\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.573727 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3ac8d936-98a3-4922-ac56-1f0056b29125-scripts\") pod \"cinder-api-0\" (UID: \"3ac8d936-98a3-4922-ac56-1f0056b29125\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.664183 5120 scope.go:117] "RemoveContainer" containerID="02ba4fc3f84eccaecfa9e6618280f65626eb76580c4af9ae7a9d7cb3b8dd590b" Mar 16 16:02:03 crc kubenswrapper[5120]: E0316 16:02:03.664531 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.675184 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/f0204257-b12d-4e9d-bdfd-e35cfaa598b5-credential-keys\") pod \"keystone-5948cb6c79-mrnwx\" (UID: \"f0204257-b12d-4e9d-bdfd-e35cfaa598b5\") " pod="openstack-kuttl-tests/keystone-5948cb6c79-mrnwx" Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.675232 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pmlrz\" (UniqueName: \"kubernetes.io/projected/3ac8d936-98a3-4922-ac56-1f0056b29125-kube-api-access-pmlrz\") pod \"cinder-api-0\" (UID: \"3ac8d936-98a3-4922-ac56-1f0056b29125\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.675254 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3ac8d936-98a3-4922-ac56-1f0056b29125-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"3ac8d936-98a3-4922-ac56-1f0056b29125\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.675288 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/3ac8d936-98a3-4922-ac56-1f0056b29125-config-data-custom\") pod \"cinder-api-0\" (UID: \"3ac8d936-98a3-4922-ac56-1f0056b29125\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.675320 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/3ac8d936-98a3-4922-ac56-1f0056b29125-public-tls-certs\") pod \"cinder-api-0\" (UID: \"3ac8d936-98a3-4922-ac56-1f0056b29125\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.675344 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f0204257-b12d-4e9d-bdfd-e35cfaa598b5-scripts\") pod \"keystone-5948cb6c79-mrnwx\" (UID: \"f0204257-b12d-4e9d-bdfd-e35cfaa598b5\") " pod="openstack-kuttl-tests/keystone-5948cb6c79-mrnwx" Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.675372 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/f0204257-b12d-4e9d-bdfd-e35cfaa598b5-fernet-keys\") pod \"keystone-5948cb6c79-mrnwx\" (UID: \"f0204257-b12d-4e9d-bdfd-e35cfaa598b5\") " pod="openstack-kuttl-tests/keystone-5948cb6c79-mrnwx" Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.675407 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3ac8d936-98a3-4922-ac56-1f0056b29125-logs\") pod \"cinder-api-0\" (UID: \"3ac8d936-98a3-4922-ac56-1f0056b29125\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.675425 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3ac8d936-98a3-4922-ac56-1f0056b29125-scripts\") pod \"cinder-api-0\" (UID: \"3ac8d936-98a3-4922-ac56-1f0056b29125\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.675451 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/3ac8d936-98a3-4922-ac56-1f0056b29125-etc-machine-id\") pod \"cinder-api-0\" (UID: \"3ac8d936-98a3-4922-ac56-1f0056b29125\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.675479 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3ac8d936-98a3-4922-ac56-1f0056b29125-config-data\") pod \"cinder-api-0\" (UID: \"3ac8d936-98a3-4922-ac56-1f0056b29125\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.675508 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f0204257-b12d-4e9d-bdfd-e35cfaa598b5-combined-ca-bundle\") pod \"keystone-5948cb6c79-mrnwx\" (UID: \"f0204257-b12d-4e9d-bdfd-e35cfaa598b5\") " pod="openstack-kuttl-tests/keystone-5948cb6c79-mrnwx" Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.675528 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f0204257-b12d-4e9d-bdfd-e35cfaa598b5-internal-tls-certs\") pod \"keystone-5948cb6c79-mrnwx\" (UID: \"f0204257-b12d-4e9d-bdfd-e35cfaa598b5\") " pod="openstack-kuttl-tests/keystone-5948cb6c79-mrnwx" Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.675552 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gbw2c\" (UniqueName: \"kubernetes.io/projected/f0204257-b12d-4e9d-bdfd-e35cfaa598b5-kube-api-access-gbw2c\") pod \"keystone-5948cb6c79-mrnwx\" (UID: \"f0204257-b12d-4e9d-bdfd-e35cfaa598b5\") " pod="openstack-kuttl-tests/keystone-5948cb6c79-mrnwx" Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.675585 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f0204257-b12d-4e9d-bdfd-e35cfaa598b5-config-data\") pod \"keystone-5948cb6c79-mrnwx\" (UID: \"f0204257-b12d-4e9d-bdfd-e35cfaa598b5\") " pod="openstack-kuttl-tests/keystone-5948cb6c79-mrnwx" Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.675611 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f0204257-b12d-4e9d-bdfd-e35cfaa598b5-public-tls-certs\") pod \"keystone-5948cb6c79-mrnwx\" (UID: \"f0204257-b12d-4e9d-bdfd-e35cfaa598b5\") " pod="openstack-kuttl-tests/keystone-5948cb6c79-mrnwx" Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.675643 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/3ac8d936-98a3-4922-ac56-1f0056b29125-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"3ac8d936-98a3-4922-ac56-1f0056b29125\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.675890 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/3ac8d936-98a3-4922-ac56-1f0056b29125-etc-machine-id\") pod \"cinder-api-0\" (UID: \"3ac8d936-98a3-4922-ac56-1f0056b29125\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.676866 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3ac8d936-98a3-4922-ac56-1f0056b29125-logs\") pod \"cinder-api-0\" (UID: \"3ac8d936-98a3-4922-ac56-1f0056b29125\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.680850 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3ac8d936-98a3-4922-ac56-1f0056b29125-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"3ac8d936-98a3-4922-ac56-1f0056b29125\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.681860 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f0204257-b12d-4e9d-bdfd-e35cfaa598b5-internal-tls-certs\") pod \"keystone-5948cb6c79-mrnwx\" (UID: \"f0204257-b12d-4e9d-bdfd-e35cfaa598b5\") " pod="openstack-kuttl-tests/keystone-5948cb6c79-mrnwx" Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.685435 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/3ac8d936-98a3-4922-ac56-1f0056b29125-config-data-custom\") pod \"cinder-api-0\" (UID: \"3ac8d936-98a3-4922-ac56-1f0056b29125\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.686458 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f0204257-b12d-4e9d-bdfd-e35cfaa598b5-combined-ca-bundle\") pod \"keystone-5948cb6c79-mrnwx\" (UID: \"f0204257-b12d-4e9d-bdfd-e35cfaa598b5\") " pod="openstack-kuttl-tests/keystone-5948cb6c79-mrnwx" Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.686834 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f0204257-b12d-4e9d-bdfd-e35cfaa598b5-public-tls-certs\") pod \"keystone-5948cb6c79-mrnwx\" (UID: \"f0204257-b12d-4e9d-bdfd-e35cfaa598b5\") " pod="openstack-kuttl-tests/keystone-5948cb6c79-mrnwx" Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.687169 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/3ac8d936-98a3-4922-ac56-1f0056b29125-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"3ac8d936-98a3-4922-ac56-1f0056b29125\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.687261 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3ac8d936-98a3-4922-ac56-1f0056b29125-config-data\") pod \"cinder-api-0\" (UID: \"3ac8d936-98a3-4922-ac56-1f0056b29125\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.687391 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f0204257-b12d-4e9d-bdfd-e35cfaa598b5-config-data\") pod \"keystone-5948cb6c79-mrnwx\" (UID: \"f0204257-b12d-4e9d-bdfd-e35cfaa598b5\") " pod="openstack-kuttl-tests/keystone-5948cb6c79-mrnwx" Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.687508 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/f0204257-b12d-4e9d-bdfd-e35cfaa598b5-credential-keys\") pod \"keystone-5948cb6c79-mrnwx\" (UID: \"f0204257-b12d-4e9d-bdfd-e35cfaa598b5\") " pod="openstack-kuttl-tests/keystone-5948cb6c79-mrnwx" Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.688125 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3ac8d936-98a3-4922-ac56-1f0056b29125-scripts\") pod \"cinder-api-0\" (UID: \"3ac8d936-98a3-4922-ac56-1f0056b29125\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.689889 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/3ac8d936-98a3-4922-ac56-1f0056b29125-public-tls-certs\") pod \"cinder-api-0\" (UID: \"3ac8d936-98a3-4922-ac56-1f0056b29125\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.696447 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/f0204257-b12d-4e9d-bdfd-e35cfaa598b5-fernet-keys\") pod \"keystone-5948cb6c79-mrnwx\" (UID: \"f0204257-b12d-4e9d-bdfd-e35cfaa598b5\") " pod="openstack-kuttl-tests/keystone-5948cb6c79-mrnwx" Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.697052 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f0204257-b12d-4e9d-bdfd-e35cfaa598b5-scripts\") pod \"keystone-5948cb6c79-mrnwx\" (UID: \"f0204257-b12d-4e9d-bdfd-e35cfaa598b5\") " pod="openstack-kuttl-tests/keystone-5948cb6c79-mrnwx" Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.700610 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmlrz\" (UniqueName: \"kubernetes.io/projected/3ac8d936-98a3-4922-ac56-1f0056b29125-kube-api-access-pmlrz\") pod \"cinder-api-0\" (UID: \"3ac8d936-98a3-4922-ac56-1f0056b29125\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.702289 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbw2c\" (UniqueName: \"kubernetes.io/projected/f0204257-b12d-4e9d-bdfd-e35cfaa598b5-kube-api-access-gbw2c\") pod \"keystone-5948cb6c79-mrnwx\" (UID: \"f0204257-b12d-4e9d-bdfd-e35cfaa598b5\") " pod="openstack-kuttl-tests/keystone-5948cb6c79-mrnwx" Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.755824 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:02:03 crc kubenswrapper[5120]: I0316 16:02:03.807133 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-5948cb6c79-mrnwx" Mar 16 16:02:04 crc kubenswrapper[5120]: I0316 16:02:04.213749 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:02:04 crc kubenswrapper[5120]: W0316 16:02:04.222076 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3ac8d936_98a3_4922_ac56_1f0056b29125.slice/crio-1a457ece2c01f871bb5e06b9599c3111f08b625c2317afcc0cb4dd35a68386f7 WatchSource:0}: Error finding container 1a457ece2c01f871bb5e06b9599c3111f08b625c2317afcc0cb4dd35a68386f7: Status 404 returned error can't find the container with id 1a457ece2c01f871bb5e06b9599c3111f08b625c2317afcc0cb4dd35a68386f7 Mar 16 16:02:04 crc kubenswrapper[5120]: I0316 16:02:04.301997 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"3ac8d936-98a3-4922-ac56-1f0056b29125","Type":"ContainerStarted","Data":"1a457ece2c01f871bb5e06b9599c3111f08b625c2317afcc0cb4dd35a68386f7"} Mar 16 16:02:04 crc kubenswrapper[5120]: I0316 16:02:04.336678 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-5948cb6c79-mrnwx"] Mar 16 16:02:04 crc kubenswrapper[5120]: W0316 16:02:04.352882 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf0204257_b12d_4e9d_bdfd_e35cfaa598b5.slice/crio-51e4a81a635fcdefc989958813a92279984ab17ba3312f3ceefdf5ce5937b08c WatchSource:0}: Error finding container 51e4a81a635fcdefc989958813a92279984ab17ba3312f3ceefdf5ce5937b08c: Status 404 returned error can't find the container with id 51e4a81a635fcdefc989958813a92279984ab17ba3312f3ceefdf5ce5937b08c Mar 16 16:02:04 crc kubenswrapper[5120]: I0316 16:02:04.543978 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:02:04 crc kubenswrapper[5120]: I0316 16:02:04.544284 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:02:04 crc kubenswrapper[5120]: I0316 16:02:04.608074 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:02:04 crc kubenswrapper[5120]: I0316 16:02:04.621406 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:02:04 crc kubenswrapper[5120]: I0316 16:02:04.673717 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="163efc0d-017d-48a3-b592-8053b3a30dfb" path="/var/lib/kubelet/pods/163efc0d-017d-48a3-b592-8053b3a30dfb/volumes" Mar 16 16:02:04 crc kubenswrapper[5120]: I0316 16:02:04.707474 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561282-7mmmh" Mar 16 16:02:04 crc kubenswrapper[5120]: I0316 16:02:04.798848 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-crj5f\" (UniqueName: \"kubernetes.io/projected/8a4260b1-b93d-446f-80f7-63725b47a94e-kube-api-access-crj5f\") pod \"8a4260b1-b93d-446f-80f7-63725b47a94e\" (UID: \"8a4260b1-b93d-446f-80f7-63725b47a94e\") " Mar 16 16:02:04 crc kubenswrapper[5120]: I0316 16:02:04.814111 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a4260b1-b93d-446f-80f7-63725b47a94e-kube-api-access-crj5f" (OuterVolumeSpecName: "kube-api-access-crj5f") pod "8a4260b1-b93d-446f-80f7-63725b47a94e" (UID: "8a4260b1-b93d-446f-80f7-63725b47a94e"). InnerVolumeSpecName "kube-api-access-crj5f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:02:04 crc kubenswrapper[5120]: I0316 16:02:04.905042 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-crj5f\" (UniqueName: \"kubernetes.io/projected/8a4260b1-b93d-446f-80f7-63725b47a94e-kube-api-access-crj5f\") on node \"crc\" DevicePath \"\"" Mar 16 16:02:05 crc kubenswrapper[5120]: I0316 16:02:05.390179 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561282-7mmmh" Mar 16 16:02:05 crc kubenswrapper[5120]: I0316 16:02:05.396298 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561282-7mmmh" event={"ID":"8a4260b1-b93d-446f-80f7-63725b47a94e","Type":"ContainerDied","Data":"fadb68224b81dad3ffb1feea8cbd4916d86c34ec4a1de37bad49ab7a92786b7c"} Mar 16 16:02:05 crc kubenswrapper[5120]: I0316 16:02:05.396368 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fadb68224b81dad3ffb1feea8cbd4916d86c34ec4a1de37bad49ab7a92786b7c" Mar 16 16:02:05 crc kubenswrapper[5120]: I0316 16:02:05.403419 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-5948cb6c79-mrnwx" event={"ID":"f0204257-b12d-4e9d-bdfd-e35cfaa598b5","Type":"ContainerStarted","Data":"afad04760bdd0af215c87e7b8b243a24c1a39f569edf6c17dc353cb96619dc0c"} Mar 16 16:02:05 crc kubenswrapper[5120]: I0316 16:02:05.403461 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-5948cb6c79-mrnwx" event={"ID":"f0204257-b12d-4e9d-bdfd-e35cfaa598b5","Type":"ContainerStarted","Data":"51e4a81a635fcdefc989958813a92279984ab17ba3312f3ceefdf5ce5937b08c"} Mar 16 16:02:05 crc kubenswrapper[5120]: I0316 16:02:05.404226 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/keystone-5948cb6c79-mrnwx" Mar 16 16:02:05 crc kubenswrapper[5120]: I0316 16:02:05.408855 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"3ac8d936-98a3-4922-ac56-1f0056b29125","Type":"ContainerStarted","Data":"c41f8dddc091059700fb5005af8223e4d1584a07fc6a078228075e568e0e4e4e"} Mar 16 16:02:05 crc kubenswrapper[5120]: I0316 16:02:05.409420 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:02:05 crc kubenswrapper[5120]: I0316 16:02:05.409571 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:02:05 crc kubenswrapper[5120]: I0316 16:02:05.447838 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-5948cb6c79-mrnwx" podStartSLOduration=2.44781324 podStartE2EDuration="2.44781324s" podCreationTimestamp="2026-03-16 16:02:03 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:02:05.441256201 +0000 UTC m=+1827.595187858" watchObservedRunningTime="2026-03-16 16:02:05.44781324 +0000 UTC m=+1827.601744897" Mar 16 16:02:05 crc kubenswrapper[5120]: I0316 16:02:05.751638 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:02:05 crc kubenswrapper[5120]: I0316 16:02:05.753812 5120 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Mar 16 16:02:05 crc kubenswrapper[5120]: I0316 16:02:05.779294 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-infra/auto-csr-approver-29561276-zt964"] Mar 16 16:02:05 crc kubenswrapper[5120]: I0316 16:02:05.792285 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:02:05 crc kubenswrapper[5120]: I0316 16:02:05.796307 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-infra/auto-csr-approver-29561276-zt964"] Mar 16 16:02:05 crc kubenswrapper[5120]: I0316 16:02:05.942140 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-f5cb49f4b-mkrgf" Mar 16 16:02:06 crc kubenswrapper[5120]: I0316 16:02:06.211378 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-f5cb49f4b-mkrgf" Mar 16 16:02:06 crc kubenswrapper[5120]: I0316 16:02:06.442044 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"3ac8d936-98a3-4922-ac56-1f0056b29125","Type":"ContainerStarted","Data":"f132e6a3974c1bba9ad90227d344ad9e877787b64b57fe6dc69fdda7f7bc7f06"} Mar 16 16:02:06 crc kubenswrapper[5120]: I0316 16:02:06.446871 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:02:06 crc kubenswrapper[5120]: I0316 16:02:06.447284 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-worker-7469b9f4cf-wq7wj"] Mar 16 16:02:06 crc kubenswrapper[5120]: I0316 16:02:06.449257 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a4260b1-b93d-446f-80f7-63725b47a94e" containerName="oc" Mar 16 16:02:06 crc kubenswrapper[5120]: I0316 16:02:06.449272 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a4260b1-b93d-446f-80f7-63725b47a94e" containerName="oc" Mar 16 16:02:06 crc kubenswrapper[5120]: I0316 16:02:06.449676 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="8a4260b1-b93d-446f-80f7-63725b47a94e" containerName="oc" Mar 16 16:02:06 crc kubenswrapper[5120]: I0316 16:02:06.463685 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-7469b9f4cf-wq7wj" Mar 16 16:02:06 crc kubenswrapper[5120]: I0316 16:02:06.481959 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-64d4b879f4-m86vx"] Mar 16 16:02:06 crc kubenswrapper[5120]: I0316 16:02:06.512606 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-7469b9f4cf-wq7wj"] Mar 16 16:02:06 crc kubenswrapper[5120]: I0316 16:02:06.513049 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-64d4b879f4-m86vx" Mar 16 16:02:06 crc kubenswrapper[5120]: I0316 16:02:06.524026 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-64d4b879f4-m86vx"] Mar 16 16:02:06 crc kubenswrapper[5120]: I0316 16:02:06.524957 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-api-0" podStartSLOduration=3.524947347 podStartE2EDuration="3.524947347s" podCreationTimestamp="2026-03-16 16:02:03 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:02:06.505629605 +0000 UTC m=+1828.659561292" watchObservedRunningTime="2026-03-16 16:02:06.524947347 +0000 UTC m=+1828.678878994" Mar 16 16:02:06 crc kubenswrapper[5120]: I0316 16:02:06.585934 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/307ebaa6-527e-4d6f-9601-dcb38aaa8a20-logs\") pod \"barbican-worker-7469b9f4cf-wq7wj\" (UID: \"307ebaa6-527e-4d6f-9601-dcb38aaa8a20\") " pod="openstack-kuttl-tests/barbican-worker-7469b9f4cf-wq7wj" Mar 16 16:02:06 crc kubenswrapper[5120]: I0316 16:02:06.586131 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a3c03367-28dc-4fa5-a569-0d97bad76025-combined-ca-bundle\") pod \"barbican-keystone-listener-64d4b879f4-m86vx\" (UID: \"a3c03367-28dc-4fa5-a569-0d97bad76025\") " pod="openstack-kuttl-tests/barbican-keystone-listener-64d4b879f4-m86vx" Mar 16 16:02:06 crc kubenswrapper[5120]: I0316 16:02:06.586431 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzb5r\" (UniqueName: \"kubernetes.io/projected/307ebaa6-527e-4d6f-9601-dcb38aaa8a20-kube-api-access-pzb5r\") pod \"barbican-worker-7469b9f4cf-wq7wj\" (UID: \"307ebaa6-527e-4d6f-9601-dcb38aaa8a20\") " pod="openstack-kuttl-tests/barbican-worker-7469b9f4cf-wq7wj" Mar 16 16:02:06 crc kubenswrapper[5120]: I0316 16:02:06.586461 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a3c03367-28dc-4fa5-a569-0d97bad76025-logs\") pod \"barbican-keystone-listener-64d4b879f4-m86vx\" (UID: \"a3c03367-28dc-4fa5-a569-0d97bad76025\") " pod="openstack-kuttl-tests/barbican-keystone-listener-64d4b879f4-m86vx" Mar 16 16:02:06 crc kubenswrapper[5120]: I0316 16:02:06.586658 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/307ebaa6-527e-4d6f-9601-dcb38aaa8a20-combined-ca-bundle\") pod \"barbican-worker-7469b9f4cf-wq7wj\" (UID: \"307ebaa6-527e-4d6f-9601-dcb38aaa8a20\") " pod="openstack-kuttl-tests/barbican-worker-7469b9f4cf-wq7wj" Mar 16 16:02:06 crc kubenswrapper[5120]: I0316 16:02:06.586884 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/307ebaa6-527e-4d6f-9601-dcb38aaa8a20-config-data-custom\") pod \"barbican-worker-7469b9f4cf-wq7wj\" (UID: \"307ebaa6-527e-4d6f-9601-dcb38aaa8a20\") " pod="openstack-kuttl-tests/barbican-worker-7469b9f4cf-wq7wj" Mar 16 16:02:06 crc kubenswrapper[5120]: I0316 16:02:06.586961 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/a3c03367-28dc-4fa5-a569-0d97bad76025-config-data-custom\") pod \"barbican-keystone-listener-64d4b879f4-m86vx\" (UID: \"a3c03367-28dc-4fa5-a569-0d97bad76025\") " pod="openstack-kuttl-tests/barbican-keystone-listener-64d4b879f4-m86vx" Mar 16 16:02:06 crc kubenswrapper[5120]: I0316 16:02:06.587052 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/307ebaa6-527e-4d6f-9601-dcb38aaa8a20-config-data\") pod \"barbican-worker-7469b9f4cf-wq7wj\" (UID: \"307ebaa6-527e-4d6f-9601-dcb38aaa8a20\") " pod="openstack-kuttl-tests/barbican-worker-7469b9f4cf-wq7wj" Mar 16 16:02:06 crc kubenswrapper[5120]: I0316 16:02:06.587113 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a3c03367-28dc-4fa5-a569-0d97bad76025-config-data\") pod \"barbican-keystone-listener-64d4b879f4-m86vx\" (UID: \"a3c03367-28dc-4fa5-a569-0d97bad76025\") " pod="openstack-kuttl-tests/barbican-keystone-listener-64d4b879f4-m86vx" Mar 16 16:02:06 crc kubenswrapper[5120]: I0316 16:02:06.587420 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9pt85\" (UniqueName: \"kubernetes.io/projected/a3c03367-28dc-4fa5-a569-0d97bad76025-kube-api-access-9pt85\") pod \"barbican-keystone-listener-64d4b879f4-m86vx\" (UID: \"a3c03367-28dc-4fa5-a569-0d97bad76025\") " pod="openstack-kuttl-tests/barbican-keystone-listener-64d4b879f4-m86vx" Mar 16 16:02:06 crc kubenswrapper[5120]: I0316 16:02:06.627823 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-6b8df9c88d-rbjrz"] Mar 16 16:02:06 crc kubenswrapper[5120]: I0316 16:02:06.645211 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-6b8df9c88d-rbjrz" Mar 16 16:02:06 crc kubenswrapper[5120]: I0316 16:02:06.646496 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-6b8df9c88d-rbjrz"] Mar 16 16:02:06 crc kubenswrapper[5120]: I0316 16:02:06.655548 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-neutron-public-svc\"" Mar 16 16:02:06 crc kubenswrapper[5120]: I0316 16:02:06.656272 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-neutron-internal-svc\"" Mar 16 16:02:06 crc kubenswrapper[5120]: I0316 16:02:06.692367 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/307ebaa6-527e-4d6f-9601-dcb38aaa8a20-config-data-custom\") pod \"barbican-worker-7469b9f4cf-wq7wj\" (UID: \"307ebaa6-527e-4d6f-9601-dcb38aaa8a20\") " pod="openstack-kuttl-tests/barbican-worker-7469b9f4cf-wq7wj" Mar 16 16:02:06 crc kubenswrapper[5120]: I0316 16:02:06.692420 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/a3c03367-28dc-4fa5-a569-0d97bad76025-config-data-custom\") pod \"barbican-keystone-listener-64d4b879f4-m86vx\" (UID: \"a3c03367-28dc-4fa5-a569-0d97bad76025\") " pod="openstack-kuttl-tests/barbican-keystone-listener-64d4b879f4-m86vx" Mar 16 16:02:06 crc kubenswrapper[5120]: I0316 16:02:06.692452 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/307ebaa6-527e-4d6f-9601-dcb38aaa8a20-config-data\") pod \"barbican-worker-7469b9f4cf-wq7wj\" (UID: \"307ebaa6-527e-4d6f-9601-dcb38aaa8a20\") " pod="openstack-kuttl-tests/barbican-worker-7469b9f4cf-wq7wj" Mar 16 16:02:06 crc kubenswrapper[5120]: I0316 16:02:06.692472 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a3c03367-28dc-4fa5-a569-0d97bad76025-config-data\") pod \"barbican-keystone-listener-64d4b879f4-m86vx\" (UID: \"a3c03367-28dc-4fa5-a569-0d97bad76025\") " pod="openstack-kuttl-tests/barbican-keystone-listener-64d4b879f4-m86vx" Mar 16 16:02:06 crc kubenswrapper[5120]: I0316 16:02:06.692515 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/9d8004a6-f52b-420c-9f64-141dae970d7e-httpd-config\") pod \"neutron-6b8df9c88d-rbjrz\" (UID: \"9d8004a6-f52b-420c-9f64-141dae970d7e\") " pod="openstack-kuttl-tests/neutron-6b8df9c88d-rbjrz" Mar 16 16:02:06 crc kubenswrapper[5120]: I0316 16:02:06.692543 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9d8004a6-f52b-420c-9f64-141dae970d7e-combined-ca-bundle\") pod \"neutron-6b8df9c88d-rbjrz\" (UID: \"9d8004a6-f52b-420c-9f64-141dae970d7e\") " pod="openstack-kuttl-tests/neutron-6b8df9c88d-rbjrz" Mar 16 16:02:06 crc kubenswrapper[5120]: I0316 16:02:06.692569 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/9d8004a6-f52b-420c-9f64-141dae970d7e-ovndb-tls-certs\") pod \"neutron-6b8df9c88d-rbjrz\" (UID: \"9d8004a6-f52b-420c-9f64-141dae970d7e\") " pod="openstack-kuttl-tests/neutron-6b8df9c88d-rbjrz" Mar 16 16:02:06 crc kubenswrapper[5120]: I0316 16:02:06.692589 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9pt85\" (UniqueName: \"kubernetes.io/projected/a3c03367-28dc-4fa5-a569-0d97bad76025-kube-api-access-9pt85\") pod \"barbican-keystone-listener-64d4b879f4-m86vx\" (UID: \"a3c03367-28dc-4fa5-a569-0d97bad76025\") " pod="openstack-kuttl-tests/barbican-keystone-listener-64d4b879f4-m86vx" Mar 16 16:02:06 crc kubenswrapper[5120]: I0316 16:02:06.692638 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/307ebaa6-527e-4d6f-9601-dcb38aaa8a20-logs\") pod \"barbican-worker-7469b9f4cf-wq7wj\" (UID: \"307ebaa6-527e-4d6f-9601-dcb38aaa8a20\") " pod="openstack-kuttl-tests/barbican-worker-7469b9f4cf-wq7wj" Mar 16 16:02:06 crc kubenswrapper[5120]: I0316 16:02:06.692658 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/9d8004a6-f52b-420c-9f64-141dae970d7e-internal-tls-certs\") pod \"neutron-6b8df9c88d-rbjrz\" (UID: \"9d8004a6-f52b-420c-9f64-141dae970d7e\") " pod="openstack-kuttl-tests/neutron-6b8df9c88d-rbjrz" Mar 16 16:02:06 crc kubenswrapper[5120]: I0316 16:02:06.692692 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/9d8004a6-f52b-420c-9f64-141dae970d7e-public-tls-certs\") pod \"neutron-6b8df9c88d-rbjrz\" (UID: \"9d8004a6-f52b-420c-9f64-141dae970d7e\") " pod="openstack-kuttl-tests/neutron-6b8df9c88d-rbjrz" Mar 16 16:02:06 crc kubenswrapper[5120]: I0316 16:02:06.692709 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a3c03367-28dc-4fa5-a569-0d97bad76025-combined-ca-bundle\") pod \"barbican-keystone-listener-64d4b879f4-m86vx\" (UID: \"a3c03367-28dc-4fa5-a569-0d97bad76025\") " pod="openstack-kuttl-tests/barbican-keystone-listener-64d4b879f4-m86vx" Mar 16 16:02:06 crc kubenswrapper[5120]: I0316 16:02:06.692725 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lh7jv\" (UniqueName: \"kubernetes.io/projected/9d8004a6-f52b-420c-9f64-141dae970d7e-kube-api-access-lh7jv\") pod \"neutron-6b8df9c88d-rbjrz\" (UID: \"9d8004a6-f52b-420c-9f64-141dae970d7e\") " pod="openstack-kuttl-tests/neutron-6b8df9c88d-rbjrz" Mar 16 16:02:06 crc kubenswrapper[5120]: I0316 16:02:06.692797 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pzb5r\" (UniqueName: \"kubernetes.io/projected/307ebaa6-527e-4d6f-9601-dcb38aaa8a20-kube-api-access-pzb5r\") pod \"barbican-worker-7469b9f4cf-wq7wj\" (UID: \"307ebaa6-527e-4d6f-9601-dcb38aaa8a20\") " pod="openstack-kuttl-tests/barbican-worker-7469b9f4cf-wq7wj" Mar 16 16:02:06 crc kubenswrapper[5120]: I0316 16:02:06.692814 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a3c03367-28dc-4fa5-a569-0d97bad76025-logs\") pod \"barbican-keystone-listener-64d4b879f4-m86vx\" (UID: \"a3c03367-28dc-4fa5-a569-0d97bad76025\") " pod="openstack-kuttl-tests/barbican-keystone-listener-64d4b879f4-m86vx" Mar 16 16:02:06 crc kubenswrapper[5120]: I0316 16:02:06.692846 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/9d8004a6-f52b-420c-9f64-141dae970d7e-config\") pod \"neutron-6b8df9c88d-rbjrz\" (UID: \"9d8004a6-f52b-420c-9f64-141dae970d7e\") " pod="openstack-kuttl-tests/neutron-6b8df9c88d-rbjrz" Mar 16 16:02:06 crc kubenswrapper[5120]: I0316 16:02:06.693351 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/307ebaa6-527e-4d6f-9601-dcb38aaa8a20-logs\") pod \"barbican-worker-7469b9f4cf-wq7wj\" (UID: \"307ebaa6-527e-4d6f-9601-dcb38aaa8a20\") " pod="openstack-kuttl-tests/barbican-worker-7469b9f4cf-wq7wj" Mar 16 16:02:06 crc kubenswrapper[5120]: I0316 16:02:06.693932 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/307ebaa6-527e-4d6f-9601-dcb38aaa8a20-combined-ca-bundle\") pod \"barbican-worker-7469b9f4cf-wq7wj\" (UID: \"307ebaa6-527e-4d6f-9601-dcb38aaa8a20\") " pod="openstack-kuttl-tests/barbican-worker-7469b9f4cf-wq7wj" Mar 16 16:02:06 crc kubenswrapper[5120]: I0316 16:02:06.703951 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/a3c03367-28dc-4fa5-a569-0d97bad76025-config-data-custom\") pod \"barbican-keystone-listener-64d4b879f4-m86vx\" (UID: \"a3c03367-28dc-4fa5-a569-0d97bad76025\") " pod="openstack-kuttl-tests/barbican-keystone-listener-64d4b879f4-m86vx" Mar 16 16:02:06 crc kubenswrapper[5120]: I0316 16:02:06.702839 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f827667b-46fd-4fdf-a29f-5215aff12388" path="/var/lib/kubelet/pods/f827667b-46fd-4fdf-a29f-5215aff12388/volumes" Mar 16 16:02:06 crc kubenswrapper[5120]: I0316 16:02:06.705807 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-api-7764ff6fcd-vw2kr"] Mar 16 16:02:06 crc kubenswrapper[5120]: I0316 16:02:06.706192 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a3c03367-28dc-4fa5-a569-0d97bad76025-logs\") pod \"barbican-keystone-listener-64d4b879f4-m86vx\" (UID: \"a3c03367-28dc-4fa5-a569-0d97bad76025\") " pod="openstack-kuttl-tests/barbican-keystone-listener-64d4b879f4-m86vx" Mar 16 16:02:06 crc kubenswrapper[5120]: I0316 16:02:06.707020 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/307ebaa6-527e-4d6f-9601-dcb38aaa8a20-config-data\") pod \"barbican-worker-7469b9f4cf-wq7wj\" (UID: \"307ebaa6-527e-4d6f-9601-dcb38aaa8a20\") " pod="openstack-kuttl-tests/barbican-worker-7469b9f4cf-wq7wj" Mar 16 16:02:06 crc kubenswrapper[5120]: I0316 16:02:06.708367 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a3c03367-28dc-4fa5-a569-0d97bad76025-config-data\") pod \"barbican-keystone-listener-64d4b879f4-m86vx\" (UID: \"a3c03367-28dc-4fa5-a569-0d97bad76025\") " pod="openstack-kuttl-tests/barbican-keystone-listener-64d4b879f4-m86vx" Mar 16 16:02:06 crc kubenswrapper[5120]: I0316 16:02:06.711575 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/307ebaa6-527e-4d6f-9601-dcb38aaa8a20-config-data-custom\") pod \"barbican-worker-7469b9f4cf-wq7wj\" (UID: \"307ebaa6-527e-4d6f-9601-dcb38aaa8a20\") " pod="openstack-kuttl-tests/barbican-worker-7469b9f4cf-wq7wj" Mar 16 16:02:06 crc kubenswrapper[5120]: I0316 16:02:06.712111 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzb5r\" (UniqueName: \"kubernetes.io/projected/307ebaa6-527e-4d6f-9601-dcb38aaa8a20-kube-api-access-pzb5r\") pod \"barbican-worker-7469b9f4cf-wq7wj\" (UID: \"307ebaa6-527e-4d6f-9601-dcb38aaa8a20\") " pod="openstack-kuttl-tests/barbican-worker-7469b9f4cf-wq7wj" Mar 16 16:02:06 crc kubenswrapper[5120]: I0316 16:02:06.713321 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/307ebaa6-527e-4d6f-9601-dcb38aaa8a20-combined-ca-bundle\") pod \"barbican-worker-7469b9f4cf-wq7wj\" (UID: \"307ebaa6-527e-4d6f-9601-dcb38aaa8a20\") " pod="openstack-kuttl-tests/barbican-worker-7469b9f4cf-wq7wj" Mar 16 16:02:06 crc kubenswrapper[5120]: I0316 16:02:06.716437 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a3c03367-28dc-4fa5-a569-0d97bad76025-combined-ca-bundle\") pod \"barbican-keystone-listener-64d4b879f4-m86vx\" (UID: \"a3c03367-28dc-4fa5-a569-0d97bad76025\") " pod="openstack-kuttl-tests/barbican-keystone-listener-64d4b879f4-m86vx" Mar 16 16:02:06 crc kubenswrapper[5120]: I0316 16:02:06.716596 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9pt85\" (UniqueName: \"kubernetes.io/projected/a3c03367-28dc-4fa5-a569-0d97bad76025-kube-api-access-9pt85\") pod \"barbican-keystone-listener-64d4b879f4-m86vx\" (UID: \"a3c03367-28dc-4fa5-a569-0d97bad76025\") " pod="openstack-kuttl-tests/barbican-keystone-listener-64d4b879f4-m86vx" Mar 16 16:02:06 crc kubenswrapper[5120]: I0316 16:02:06.724924 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-7764ff6fcd-vw2kr"] Mar 16 16:02:06 crc kubenswrapper[5120]: I0316 16:02:06.724986 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:02:06 crc kubenswrapper[5120]: I0316 16:02:06.725493 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="e6f29e10-c540-416f-937a-0b0e8cbceef9" containerName="ceilometer-central-agent" containerID="cri-o://b57a42f04539435d37185f3a2ac319195f6f121989df111ab79903e0175b1a6c" gracePeriod=30 Mar 16 16:02:06 crc kubenswrapper[5120]: I0316 16:02:06.725728 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="e6f29e10-c540-416f-937a-0b0e8cbceef9" containerName="proxy-httpd" containerID="cri-o://df5d0129423dcd5500785dd2881b51e1a1664bfcdfd3ad6b4d5b66e40782ef7e" gracePeriod=30 Mar 16 16:02:06 crc kubenswrapper[5120]: I0316 16:02:06.726236 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="e6f29e10-c540-416f-937a-0b0e8cbceef9" containerName="ceilometer-notification-agent" containerID="cri-o://c5053999b289290441bd5d0a9ad579a71fa73cf3376801ea1a32d54875d317c9" gracePeriod=30 Mar 16 16:02:06 crc kubenswrapper[5120]: I0316 16:02:06.726423 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="e6f29e10-c540-416f-937a-0b0e8cbceef9" containerName="sg-core" containerID="cri-o://83ac6bf0cd539024b4fdd280b61d2850621c5f3b2f9b764184f582295056ac7f" gracePeriod=30 Mar 16 16:02:06 crc kubenswrapper[5120]: I0316 16:02:06.726156 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-7764ff6fcd-vw2kr" Mar 16 16:02:06 crc kubenswrapper[5120]: I0316 16:02:06.793304 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-7469b9f4cf-wq7wj" Mar 16 16:02:06 crc kubenswrapper[5120]: I0316 16:02:06.795871 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/9d8004a6-f52b-420c-9f64-141dae970d7e-config\") pod \"neutron-6b8df9c88d-rbjrz\" (UID: \"9d8004a6-f52b-420c-9f64-141dae970d7e\") " pod="openstack-kuttl-tests/neutron-6b8df9c88d-rbjrz" Mar 16 16:02:06 crc kubenswrapper[5120]: I0316 16:02:06.795931 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qp7nc\" (UniqueName: \"kubernetes.io/projected/8415e416-caeb-46b1-ad95-913c481d9335-kube-api-access-qp7nc\") pod \"barbican-api-7764ff6fcd-vw2kr\" (UID: \"8415e416-caeb-46b1-ad95-913c481d9335\") " pod="openstack-kuttl-tests/barbican-api-7764ff6fcd-vw2kr" Mar 16 16:02:06 crc kubenswrapper[5120]: I0316 16:02:06.795956 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/8415e416-caeb-46b1-ad95-913c481d9335-config-data-custom\") pod \"barbican-api-7764ff6fcd-vw2kr\" (UID: \"8415e416-caeb-46b1-ad95-913c481d9335\") " pod="openstack-kuttl-tests/barbican-api-7764ff6fcd-vw2kr" Mar 16 16:02:06 crc kubenswrapper[5120]: I0316 16:02:06.796043 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/9d8004a6-f52b-420c-9f64-141dae970d7e-httpd-config\") pod \"neutron-6b8df9c88d-rbjrz\" (UID: \"9d8004a6-f52b-420c-9f64-141dae970d7e\") " pod="openstack-kuttl-tests/neutron-6b8df9c88d-rbjrz" Mar 16 16:02:06 crc kubenswrapper[5120]: I0316 16:02:06.796074 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9d8004a6-f52b-420c-9f64-141dae970d7e-combined-ca-bundle\") pod \"neutron-6b8df9c88d-rbjrz\" (UID: \"9d8004a6-f52b-420c-9f64-141dae970d7e\") " pod="openstack-kuttl-tests/neutron-6b8df9c88d-rbjrz" Mar 16 16:02:06 crc kubenswrapper[5120]: I0316 16:02:06.796111 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8415e416-caeb-46b1-ad95-913c481d9335-config-data\") pod \"barbican-api-7764ff6fcd-vw2kr\" (UID: \"8415e416-caeb-46b1-ad95-913c481d9335\") " pod="openstack-kuttl-tests/barbican-api-7764ff6fcd-vw2kr" Mar 16 16:02:06 crc kubenswrapper[5120]: I0316 16:02:06.796132 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/9d8004a6-f52b-420c-9f64-141dae970d7e-ovndb-tls-certs\") pod \"neutron-6b8df9c88d-rbjrz\" (UID: \"9d8004a6-f52b-420c-9f64-141dae970d7e\") " pod="openstack-kuttl-tests/neutron-6b8df9c88d-rbjrz" Mar 16 16:02:06 crc kubenswrapper[5120]: I0316 16:02:06.796148 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8415e416-caeb-46b1-ad95-913c481d9335-combined-ca-bundle\") pod \"barbican-api-7764ff6fcd-vw2kr\" (UID: \"8415e416-caeb-46b1-ad95-913c481d9335\") " pod="openstack-kuttl-tests/barbican-api-7764ff6fcd-vw2kr" Mar 16 16:02:06 crc kubenswrapper[5120]: I0316 16:02:06.796209 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/9d8004a6-f52b-420c-9f64-141dae970d7e-internal-tls-certs\") pod \"neutron-6b8df9c88d-rbjrz\" (UID: \"9d8004a6-f52b-420c-9f64-141dae970d7e\") " pod="openstack-kuttl-tests/neutron-6b8df9c88d-rbjrz" Mar 16 16:02:06 crc kubenswrapper[5120]: I0316 16:02:06.796241 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/9d8004a6-f52b-420c-9f64-141dae970d7e-public-tls-certs\") pod \"neutron-6b8df9c88d-rbjrz\" (UID: \"9d8004a6-f52b-420c-9f64-141dae970d7e\") " pod="openstack-kuttl-tests/neutron-6b8df9c88d-rbjrz" Mar 16 16:02:06 crc kubenswrapper[5120]: I0316 16:02:06.796260 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lh7jv\" (UniqueName: \"kubernetes.io/projected/9d8004a6-f52b-420c-9f64-141dae970d7e-kube-api-access-lh7jv\") pod \"neutron-6b8df9c88d-rbjrz\" (UID: \"9d8004a6-f52b-420c-9f64-141dae970d7e\") " pod="openstack-kuttl-tests/neutron-6b8df9c88d-rbjrz" Mar 16 16:02:06 crc kubenswrapper[5120]: I0316 16:02:06.796304 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8415e416-caeb-46b1-ad95-913c481d9335-logs\") pod \"barbican-api-7764ff6fcd-vw2kr\" (UID: \"8415e416-caeb-46b1-ad95-913c481d9335\") " pod="openstack-kuttl-tests/barbican-api-7764ff6fcd-vw2kr" Mar 16 16:02:06 crc kubenswrapper[5120]: I0316 16:02:06.809920 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9d8004a6-f52b-420c-9f64-141dae970d7e-combined-ca-bundle\") pod \"neutron-6b8df9c88d-rbjrz\" (UID: \"9d8004a6-f52b-420c-9f64-141dae970d7e\") " pod="openstack-kuttl-tests/neutron-6b8df9c88d-rbjrz" Mar 16 16:02:06 crc kubenswrapper[5120]: I0316 16:02:06.810420 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/9d8004a6-f52b-420c-9f64-141dae970d7e-internal-tls-certs\") pod \"neutron-6b8df9c88d-rbjrz\" (UID: \"9d8004a6-f52b-420c-9f64-141dae970d7e\") " pod="openstack-kuttl-tests/neutron-6b8df9c88d-rbjrz" Mar 16 16:02:06 crc kubenswrapper[5120]: I0316 16:02:06.810905 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/9d8004a6-f52b-420c-9f64-141dae970d7e-httpd-config\") pod \"neutron-6b8df9c88d-rbjrz\" (UID: \"9d8004a6-f52b-420c-9f64-141dae970d7e\") " pod="openstack-kuttl-tests/neutron-6b8df9c88d-rbjrz" Mar 16 16:02:06 crc kubenswrapper[5120]: I0316 16:02:06.814670 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/9d8004a6-f52b-420c-9f64-141dae970d7e-ovndb-tls-certs\") pod \"neutron-6b8df9c88d-rbjrz\" (UID: \"9d8004a6-f52b-420c-9f64-141dae970d7e\") " pod="openstack-kuttl-tests/neutron-6b8df9c88d-rbjrz" Mar 16 16:02:06 crc kubenswrapper[5120]: I0316 16:02:06.819538 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/9d8004a6-f52b-420c-9f64-141dae970d7e-public-tls-certs\") pod \"neutron-6b8df9c88d-rbjrz\" (UID: \"9d8004a6-f52b-420c-9f64-141dae970d7e\") " pod="openstack-kuttl-tests/neutron-6b8df9c88d-rbjrz" Mar 16 16:02:06 crc kubenswrapper[5120]: I0316 16:02:06.820590 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/9d8004a6-f52b-420c-9f64-141dae970d7e-config\") pod \"neutron-6b8df9c88d-rbjrz\" (UID: \"9d8004a6-f52b-420c-9f64-141dae970d7e\") " pod="openstack-kuttl-tests/neutron-6b8df9c88d-rbjrz" Mar 16 16:02:06 crc kubenswrapper[5120]: I0316 16:02:06.835302 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lh7jv\" (UniqueName: \"kubernetes.io/projected/9d8004a6-f52b-420c-9f64-141dae970d7e-kube-api-access-lh7jv\") pod \"neutron-6b8df9c88d-rbjrz\" (UID: \"9d8004a6-f52b-420c-9f64-141dae970d7e\") " pod="openstack-kuttl-tests/neutron-6b8df9c88d-rbjrz" Mar 16 16:02:06 crc kubenswrapper[5120]: I0316 16:02:06.893170 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-64d4b879f4-m86vx" Mar 16 16:02:06 crc kubenswrapper[5120]: I0316 16:02:06.901950 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8415e416-caeb-46b1-ad95-913c481d9335-logs\") pod \"barbican-api-7764ff6fcd-vw2kr\" (UID: \"8415e416-caeb-46b1-ad95-913c481d9335\") " pod="openstack-kuttl-tests/barbican-api-7764ff6fcd-vw2kr" Mar 16 16:02:06 crc kubenswrapper[5120]: I0316 16:02:06.902031 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qp7nc\" (UniqueName: \"kubernetes.io/projected/8415e416-caeb-46b1-ad95-913c481d9335-kube-api-access-qp7nc\") pod \"barbican-api-7764ff6fcd-vw2kr\" (UID: \"8415e416-caeb-46b1-ad95-913c481d9335\") " pod="openstack-kuttl-tests/barbican-api-7764ff6fcd-vw2kr" Mar 16 16:02:06 crc kubenswrapper[5120]: I0316 16:02:06.902056 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/8415e416-caeb-46b1-ad95-913c481d9335-config-data-custom\") pod \"barbican-api-7764ff6fcd-vw2kr\" (UID: \"8415e416-caeb-46b1-ad95-913c481d9335\") " pod="openstack-kuttl-tests/barbican-api-7764ff6fcd-vw2kr" Mar 16 16:02:06 crc kubenswrapper[5120]: I0316 16:02:06.902152 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8415e416-caeb-46b1-ad95-913c481d9335-config-data\") pod \"barbican-api-7764ff6fcd-vw2kr\" (UID: \"8415e416-caeb-46b1-ad95-913c481d9335\") " pod="openstack-kuttl-tests/barbican-api-7764ff6fcd-vw2kr" Mar 16 16:02:06 crc kubenswrapper[5120]: I0316 16:02:06.902172 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8415e416-caeb-46b1-ad95-913c481d9335-combined-ca-bundle\") pod \"barbican-api-7764ff6fcd-vw2kr\" (UID: \"8415e416-caeb-46b1-ad95-913c481d9335\") " pod="openstack-kuttl-tests/barbican-api-7764ff6fcd-vw2kr" Mar 16 16:02:06 crc kubenswrapper[5120]: I0316 16:02:06.902755 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8415e416-caeb-46b1-ad95-913c481d9335-logs\") pod \"barbican-api-7764ff6fcd-vw2kr\" (UID: \"8415e416-caeb-46b1-ad95-913c481d9335\") " pod="openstack-kuttl-tests/barbican-api-7764ff6fcd-vw2kr" Mar 16 16:02:06 crc kubenswrapper[5120]: I0316 16:02:06.908548 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8415e416-caeb-46b1-ad95-913c481d9335-combined-ca-bundle\") pod \"barbican-api-7764ff6fcd-vw2kr\" (UID: \"8415e416-caeb-46b1-ad95-913c481d9335\") " pod="openstack-kuttl-tests/barbican-api-7764ff6fcd-vw2kr" Mar 16 16:02:06 crc kubenswrapper[5120]: I0316 16:02:06.910046 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/8415e416-caeb-46b1-ad95-913c481d9335-config-data-custom\") pod \"barbican-api-7764ff6fcd-vw2kr\" (UID: \"8415e416-caeb-46b1-ad95-913c481d9335\") " pod="openstack-kuttl-tests/barbican-api-7764ff6fcd-vw2kr" Mar 16 16:02:06 crc kubenswrapper[5120]: I0316 16:02:06.917023 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8415e416-caeb-46b1-ad95-913c481d9335-config-data\") pod \"barbican-api-7764ff6fcd-vw2kr\" (UID: \"8415e416-caeb-46b1-ad95-913c481d9335\") " pod="openstack-kuttl-tests/barbican-api-7764ff6fcd-vw2kr" Mar 16 16:02:06 crc kubenswrapper[5120]: I0316 16:02:06.933507 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qp7nc\" (UniqueName: \"kubernetes.io/projected/8415e416-caeb-46b1-ad95-913c481d9335-kube-api-access-qp7nc\") pod \"barbican-api-7764ff6fcd-vw2kr\" (UID: \"8415e416-caeb-46b1-ad95-913c481d9335\") " pod="openstack-kuttl-tests/barbican-api-7764ff6fcd-vw2kr" Mar 16 16:02:06 crc kubenswrapper[5120]: I0316 16:02:06.969291 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-6b8df9c88d-rbjrz" Mar 16 16:02:07 crc kubenswrapper[5120]: I0316 16:02:07.026857 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:02:07 crc kubenswrapper[5120]: I0316 16:02:07.114236 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:02:07 crc kubenswrapper[5120]: I0316 16:02:07.207041 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-7764ff6fcd-vw2kr" Mar 16 16:02:07 crc kubenswrapper[5120]: I0316 16:02:07.207958 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-7764ff6fcd-vw2kr"] Mar 16 16:02:07 crc kubenswrapper[5120]: I0316 16:02:07.226838 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-api-5dd49d988b-vcz2l"] Mar 16 16:02:07 crc kubenswrapper[5120]: I0316 16:02:07.247227 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-5dd49d988b-vcz2l" Mar 16 16:02:07 crc kubenswrapper[5120]: I0316 16:02:07.253599 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-barbican-internal-svc\"" Mar 16 16:02:07 crc kubenswrapper[5120]: I0316 16:02:07.253634 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-5dd49d988b-vcz2l"] Mar 16 16:02:07 crc kubenswrapper[5120]: I0316 16:02:07.253930 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-barbican-public-svc\"" Mar 16 16:02:07 crc kubenswrapper[5120]: I0316 16:02:07.317844 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a4bd1853-26f2-4b40-8a3d-3ae70282ab88-config-data\") pod \"barbican-api-5dd49d988b-vcz2l\" (UID: \"a4bd1853-26f2-4b40-8a3d-3ae70282ab88\") " pod="openstack-kuttl-tests/barbican-api-5dd49d988b-vcz2l" Mar 16 16:02:07 crc kubenswrapper[5120]: I0316 16:02:07.322257 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a4bd1853-26f2-4b40-8a3d-3ae70282ab88-logs\") pod \"barbican-api-5dd49d988b-vcz2l\" (UID: \"a4bd1853-26f2-4b40-8a3d-3ae70282ab88\") " pod="openstack-kuttl-tests/barbican-api-5dd49d988b-vcz2l" Mar 16 16:02:07 crc kubenswrapper[5120]: I0316 16:02:07.322356 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/a4bd1853-26f2-4b40-8a3d-3ae70282ab88-internal-tls-certs\") pod \"barbican-api-5dd49d988b-vcz2l\" (UID: \"a4bd1853-26f2-4b40-8a3d-3ae70282ab88\") " pod="openstack-kuttl-tests/barbican-api-5dd49d988b-vcz2l" Mar 16 16:02:07 crc kubenswrapper[5120]: I0316 16:02:07.322638 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/a4bd1853-26f2-4b40-8a3d-3ae70282ab88-config-data-custom\") pod \"barbican-api-5dd49d988b-vcz2l\" (UID: \"a4bd1853-26f2-4b40-8a3d-3ae70282ab88\") " pod="openstack-kuttl-tests/barbican-api-5dd49d988b-vcz2l" Mar 16 16:02:07 crc kubenswrapper[5120]: I0316 16:02:07.322676 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7c64f\" (UniqueName: \"kubernetes.io/projected/a4bd1853-26f2-4b40-8a3d-3ae70282ab88-kube-api-access-7c64f\") pod \"barbican-api-5dd49d988b-vcz2l\" (UID: \"a4bd1853-26f2-4b40-8a3d-3ae70282ab88\") " pod="openstack-kuttl-tests/barbican-api-5dd49d988b-vcz2l" Mar 16 16:02:07 crc kubenswrapper[5120]: I0316 16:02:07.322769 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a4bd1853-26f2-4b40-8a3d-3ae70282ab88-combined-ca-bundle\") pod \"barbican-api-5dd49d988b-vcz2l\" (UID: \"a4bd1853-26f2-4b40-8a3d-3ae70282ab88\") " pod="openstack-kuttl-tests/barbican-api-5dd49d988b-vcz2l" Mar 16 16:02:07 crc kubenswrapper[5120]: I0316 16:02:07.322833 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/a4bd1853-26f2-4b40-8a3d-3ae70282ab88-public-tls-certs\") pod \"barbican-api-5dd49d988b-vcz2l\" (UID: \"a4bd1853-26f2-4b40-8a3d-3ae70282ab88\") " pod="openstack-kuttl-tests/barbican-api-5dd49d988b-vcz2l" Mar 16 16:02:07 crc kubenswrapper[5120]: I0316 16:02:07.322990 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:02:07 crc kubenswrapper[5120]: I0316 16:02:07.362093 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-7469b9f4cf-wq7wj"] Mar 16 16:02:07 crc kubenswrapper[5120]: I0316 16:02:07.425311 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a4bd1853-26f2-4b40-8a3d-3ae70282ab88-config-data\") pod \"barbican-api-5dd49d988b-vcz2l\" (UID: \"a4bd1853-26f2-4b40-8a3d-3ae70282ab88\") " pod="openstack-kuttl-tests/barbican-api-5dd49d988b-vcz2l" Mar 16 16:02:07 crc kubenswrapper[5120]: I0316 16:02:07.425432 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a4bd1853-26f2-4b40-8a3d-3ae70282ab88-logs\") pod \"barbican-api-5dd49d988b-vcz2l\" (UID: \"a4bd1853-26f2-4b40-8a3d-3ae70282ab88\") " pod="openstack-kuttl-tests/barbican-api-5dd49d988b-vcz2l" Mar 16 16:02:07 crc kubenswrapper[5120]: I0316 16:02:07.425473 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/a4bd1853-26f2-4b40-8a3d-3ae70282ab88-internal-tls-certs\") pod \"barbican-api-5dd49d988b-vcz2l\" (UID: \"a4bd1853-26f2-4b40-8a3d-3ae70282ab88\") " pod="openstack-kuttl-tests/barbican-api-5dd49d988b-vcz2l" Mar 16 16:02:07 crc kubenswrapper[5120]: I0316 16:02:07.425518 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/a4bd1853-26f2-4b40-8a3d-3ae70282ab88-config-data-custom\") pod \"barbican-api-5dd49d988b-vcz2l\" (UID: \"a4bd1853-26f2-4b40-8a3d-3ae70282ab88\") " pod="openstack-kuttl-tests/barbican-api-5dd49d988b-vcz2l" Mar 16 16:02:07 crc kubenswrapper[5120]: I0316 16:02:07.425546 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7c64f\" (UniqueName: \"kubernetes.io/projected/a4bd1853-26f2-4b40-8a3d-3ae70282ab88-kube-api-access-7c64f\") pod \"barbican-api-5dd49d988b-vcz2l\" (UID: \"a4bd1853-26f2-4b40-8a3d-3ae70282ab88\") " pod="openstack-kuttl-tests/barbican-api-5dd49d988b-vcz2l" Mar 16 16:02:07 crc kubenswrapper[5120]: I0316 16:02:07.425587 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a4bd1853-26f2-4b40-8a3d-3ae70282ab88-combined-ca-bundle\") pod \"barbican-api-5dd49d988b-vcz2l\" (UID: \"a4bd1853-26f2-4b40-8a3d-3ae70282ab88\") " pod="openstack-kuttl-tests/barbican-api-5dd49d988b-vcz2l" Mar 16 16:02:07 crc kubenswrapper[5120]: I0316 16:02:07.425629 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/a4bd1853-26f2-4b40-8a3d-3ae70282ab88-public-tls-certs\") pod \"barbican-api-5dd49d988b-vcz2l\" (UID: \"a4bd1853-26f2-4b40-8a3d-3ae70282ab88\") " pod="openstack-kuttl-tests/barbican-api-5dd49d988b-vcz2l" Mar 16 16:02:07 crc kubenswrapper[5120]: I0316 16:02:07.425994 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a4bd1853-26f2-4b40-8a3d-3ae70282ab88-logs\") pod \"barbican-api-5dd49d988b-vcz2l\" (UID: \"a4bd1853-26f2-4b40-8a3d-3ae70282ab88\") " pod="openstack-kuttl-tests/barbican-api-5dd49d988b-vcz2l" Mar 16 16:02:07 crc kubenswrapper[5120]: I0316 16:02:07.432065 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/a4bd1853-26f2-4b40-8a3d-3ae70282ab88-public-tls-certs\") pod \"barbican-api-5dd49d988b-vcz2l\" (UID: \"a4bd1853-26f2-4b40-8a3d-3ae70282ab88\") " pod="openstack-kuttl-tests/barbican-api-5dd49d988b-vcz2l" Mar 16 16:02:07 crc kubenswrapper[5120]: I0316 16:02:07.432315 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a4bd1853-26f2-4b40-8a3d-3ae70282ab88-combined-ca-bundle\") pod \"barbican-api-5dd49d988b-vcz2l\" (UID: \"a4bd1853-26f2-4b40-8a3d-3ae70282ab88\") " pod="openstack-kuttl-tests/barbican-api-5dd49d988b-vcz2l" Mar 16 16:02:07 crc kubenswrapper[5120]: I0316 16:02:07.432556 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/a4bd1853-26f2-4b40-8a3d-3ae70282ab88-config-data-custom\") pod \"barbican-api-5dd49d988b-vcz2l\" (UID: \"a4bd1853-26f2-4b40-8a3d-3ae70282ab88\") " pod="openstack-kuttl-tests/barbican-api-5dd49d988b-vcz2l" Mar 16 16:02:07 crc kubenswrapper[5120]: I0316 16:02:07.432997 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a4bd1853-26f2-4b40-8a3d-3ae70282ab88-config-data\") pod \"barbican-api-5dd49d988b-vcz2l\" (UID: \"a4bd1853-26f2-4b40-8a3d-3ae70282ab88\") " pod="openstack-kuttl-tests/barbican-api-5dd49d988b-vcz2l" Mar 16 16:02:07 crc kubenswrapper[5120]: I0316 16:02:07.435157 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/a4bd1853-26f2-4b40-8a3d-3ae70282ab88-internal-tls-certs\") pod \"barbican-api-5dd49d988b-vcz2l\" (UID: \"a4bd1853-26f2-4b40-8a3d-3ae70282ab88\") " pod="openstack-kuttl-tests/barbican-api-5dd49d988b-vcz2l" Mar 16 16:02:07 crc kubenswrapper[5120]: I0316 16:02:07.458622 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7c64f\" (UniqueName: \"kubernetes.io/projected/a4bd1853-26f2-4b40-8a3d-3ae70282ab88-kube-api-access-7c64f\") pod \"barbican-api-5dd49d988b-vcz2l\" (UID: \"a4bd1853-26f2-4b40-8a3d-3ae70282ab88\") " pod="openstack-kuttl-tests/barbican-api-5dd49d988b-vcz2l" Mar 16 16:02:07 crc kubenswrapper[5120]: I0316 16:02:07.488030 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-7469b9f4cf-wq7wj" event={"ID":"307ebaa6-527e-4d6f-9601-dcb38aaa8a20","Type":"ContainerStarted","Data":"4fafd6ad4be7de716f3a002a0a3a210e154b2599e50282b850f9d9cc64a1f10d"} Mar 16 16:02:07 crc kubenswrapper[5120]: I0316 16:02:07.522122 5120 generic.go:358] "Generic (PLEG): container finished" podID="e6f29e10-c540-416f-937a-0b0e8cbceef9" containerID="df5d0129423dcd5500785dd2881b51e1a1664bfcdfd3ad6b4d5b66e40782ef7e" exitCode=0 Mar 16 16:02:07 crc kubenswrapper[5120]: I0316 16:02:07.522273 5120 generic.go:358] "Generic (PLEG): container finished" podID="e6f29e10-c540-416f-937a-0b0e8cbceef9" containerID="83ac6bf0cd539024b4fdd280b61d2850621c5f3b2f9b764184f582295056ac7f" exitCode=2 Mar 16 16:02:07 crc kubenswrapper[5120]: I0316 16:02:07.522282 5120 generic.go:358] "Generic (PLEG): container finished" podID="e6f29e10-c540-416f-937a-0b0e8cbceef9" containerID="c5053999b289290441bd5d0a9ad579a71fa73cf3376801ea1a32d54875d317c9" exitCode=0 Mar 16 16:02:07 crc kubenswrapper[5120]: I0316 16:02:07.522289 5120 generic.go:358] "Generic (PLEG): container finished" podID="e6f29e10-c540-416f-937a-0b0e8cbceef9" containerID="b57a42f04539435d37185f3a2ac319195f6f121989df111ab79903e0175b1a6c" exitCode=0 Mar 16 16:02:07 crc kubenswrapper[5120]: I0316 16:02:07.522801 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="9e30c205-c2b2-4766-8777-6b2730f5172a" containerName="cinder-scheduler" containerID="cri-o://caa993c16d00e0213f46cc2dd20ef499c77a1c238968d283caf8f4aa952d2319" gracePeriod=30 Mar 16 16:02:07 crc kubenswrapper[5120]: I0316 16:02:07.523265 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="9e30c205-c2b2-4766-8777-6b2730f5172a" containerName="probe" containerID="cri-o://3fb2f0ebaa9349fc31d1d61f88cf5c3160e366b347fc1b17e8366f0874ebfe72" gracePeriod=30 Mar 16 16:02:07 crc kubenswrapper[5120]: I0316 16:02:07.522215 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"e6f29e10-c540-416f-937a-0b0e8cbceef9","Type":"ContainerDied","Data":"df5d0129423dcd5500785dd2881b51e1a1664bfcdfd3ad6b4d5b66e40782ef7e"} Mar 16 16:02:07 crc kubenswrapper[5120]: I0316 16:02:07.523480 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"e6f29e10-c540-416f-937a-0b0e8cbceef9","Type":"ContainerDied","Data":"83ac6bf0cd539024b4fdd280b61d2850621c5f3b2f9b764184f582295056ac7f"} Mar 16 16:02:07 crc kubenswrapper[5120]: I0316 16:02:07.523497 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"e6f29e10-c540-416f-937a-0b0e8cbceef9","Type":"ContainerDied","Data":"c5053999b289290441bd5d0a9ad579a71fa73cf3376801ea1a32d54875d317c9"} Mar 16 16:02:07 crc kubenswrapper[5120]: I0316 16:02:07.523506 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"e6f29e10-c540-416f-937a-0b0e8cbceef9","Type":"ContainerDied","Data":"b57a42f04539435d37185f3a2ac319195f6f121989df111ab79903e0175b1a6c"} Mar 16 16:02:07 crc kubenswrapper[5120]: I0316 16:02:07.523862 5120 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Mar 16 16:02:07 crc kubenswrapper[5120]: I0316 16:02:07.523878 5120 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Mar 16 16:02:07 crc kubenswrapper[5120]: I0316 16:02:07.559551 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-64d4b879f4-m86vx"] Mar 16 16:02:07 crc kubenswrapper[5120]: W0316 16:02:07.577516 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda3c03367_28dc_4fa5_a569_0d97bad76025.slice/crio-d2cf8dfbbe92fd98a0172e186ab88f45777fa39d1c82df41a15b9845e31cc1e1 WatchSource:0}: Error finding container d2cf8dfbbe92fd98a0172e186ab88f45777fa39d1c82df41a15b9845e31cc1e1: Status 404 returned error can't find the container with id d2cf8dfbbe92fd98a0172e186ab88f45777fa39d1c82df41a15b9845e31cc1e1 Mar 16 16:02:07 crc kubenswrapper[5120]: I0316 16:02:07.584722 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-5dd49d988b-vcz2l" Mar 16 16:02:07 crc kubenswrapper[5120]: I0316 16:02:07.782708 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-6b8df9c88d-rbjrz"] Mar 16 16:02:07 crc kubenswrapper[5120]: I0316 16:02:07.935490 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-7764ff6fcd-vw2kr"] Mar 16 16:02:08 crc kubenswrapper[5120]: I0316 16:02:08.073312 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:02:08 crc kubenswrapper[5120]: I0316 16:02:08.184444 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e6f29e10-c540-416f-937a-0b0e8cbceef9-combined-ca-bundle\") pod \"e6f29e10-c540-416f-937a-0b0e8cbceef9\" (UID: \"e6f29e10-c540-416f-937a-0b0e8cbceef9\") " Mar 16 16:02:08 crc kubenswrapper[5120]: I0316 16:02:08.184790 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/e6f29e10-c540-416f-937a-0b0e8cbceef9-sg-core-conf-yaml\") pod \"e6f29e10-c540-416f-937a-0b0e8cbceef9\" (UID: \"e6f29e10-c540-416f-937a-0b0e8cbceef9\") " Mar 16 16:02:08 crc kubenswrapper[5120]: I0316 16:02:08.184825 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e6f29e10-c540-416f-937a-0b0e8cbceef9-config-data\") pod \"e6f29e10-c540-416f-937a-0b0e8cbceef9\" (UID: \"e6f29e10-c540-416f-937a-0b0e8cbceef9\") " Mar 16 16:02:08 crc kubenswrapper[5120]: I0316 16:02:08.185372 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e6f29e10-c540-416f-937a-0b0e8cbceef9-run-httpd\") pod \"e6f29e10-c540-416f-937a-0b0e8cbceef9\" (UID: \"e6f29e10-c540-416f-937a-0b0e8cbceef9\") " Mar 16 16:02:08 crc kubenswrapper[5120]: I0316 16:02:08.185395 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e6f29e10-c540-416f-937a-0b0e8cbceef9-scripts\") pod \"e6f29e10-c540-416f-937a-0b0e8cbceef9\" (UID: \"e6f29e10-c540-416f-937a-0b0e8cbceef9\") " Mar 16 16:02:08 crc kubenswrapper[5120]: I0316 16:02:08.185724 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e6f29e10-c540-416f-937a-0b0e8cbceef9-log-httpd\") pod \"e6f29e10-c540-416f-937a-0b0e8cbceef9\" (UID: \"e6f29e10-c540-416f-937a-0b0e8cbceef9\") " Mar 16 16:02:08 crc kubenswrapper[5120]: I0316 16:02:08.186057 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6f29e10-c540-416f-937a-0b0e8cbceef9-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "e6f29e10-c540-416f-937a-0b0e8cbceef9" (UID: "e6f29e10-c540-416f-937a-0b0e8cbceef9"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:02:08 crc kubenswrapper[5120]: I0316 16:02:08.186133 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-chfpm\" (UniqueName: \"kubernetes.io/projected/e6f29e10-c540-416f-937a-0b0e8cbceef9-kube-api-access-chfpm\") pod \"e6f29e10-c540-416f-937a-0b0e8cbceef9\" (UID: \"e6f29e10-c540-416f-937a-0b0e8cbceef9\") " Mar 16 16:02:08 crc kubenswrapper[5120]: I0316 16:02:08.186780 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6f29e10-c540-416f-937a-0b0e8cbceef9-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "e6f29e10-c540-416f-937a-0b0e8cbceef9" (UID: "e6f29e10-c540-416f-937a-0b0e8cbceef9"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:02:08 crc kubenswrapper[5120]: I0316 16:02:08.187097 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e6f29e10-c540-416f-937a-0b0e8cbceef9-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:02:08 crc kubenswrapper[5120]: I0316 16:02:08.187115 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e6f29e10-c540-416f-937a-0b0e8cbceef9-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:02:08 crc kubenswrapper[5120]: I0316 16:02:08.196578 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e6f29e10-c540-416f-937a-0b0e8cbceef9-scripts" (OuterVolumeSpecName: "scripts") pod "e6f29e10-c540-416f-937a-0b0e8cbceef9" (UID: "e6f29e10-c540-416f-937a-0b0e8cbceef9"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:02:08 crc kubenswrapper[5120]: I0316 16:02:08.204610 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6f29e10-c540-416f-937a-0b0e8cbceef9-kube-api-access-chfpm" (OuterVolumeSpecName: "kube-api-access-chfpm") pod "e6f29e10-c540-416f-937a-0b0e8cbceef9" (UID: "e6f29e10-c540-416f-937a-0b0e8cbceef9"). InnerVolumeSpecName "kube-api-access-chfpm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:02:08 crc kubenswrapper[5120]: I0316 16:02:08.215301 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-5dd49d988b-vcz2l"] Mar 16 16:02:08 crc kubenswrapper[5120]: I0316 16:02:08.289265 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e6f29e10-c540-416f-937a-0b0e8cbceef9-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:02:08 crc kubenswrapper[5120]: I0316 16:02:08.289294 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-chfpm\" (UniqueName: \"kubernetes.io/projected/e6f29e10-c540-416f-937a-0b0e8cbceef9-kube-api-access-chfpm\") on node \"crc\" DevicePath \"\"" Mar 16 16:02:08 crc kubenswrapper[5120]: I0316 16:02:08.292421 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e6f29e10-c540-416f-937a-0b0e8cbceef9-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "e6f29e10-c540-416f-937a-0b0e8cbceef9" (UID: "e6f29e10-c540-416f-937a-0b0e8cbceef9"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:02:08 crc kubenswrapper[5120]: I0316 16:02:08.391910 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/e6f29e10-c540-416f-937a-0b0e8cbceef9-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 16:02:08 crc kubenswrapper[5120]: I0316 16:02:08.401745 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e6f29e10-c540-416f-937a-0b0e8cbceef9-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e6f29e10-c540-416f-937a-0b0e8cbceef9" (UID: "e6f29e10-c540-416f-937a-0b0e8cbceef9"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:02:08 crc kubenswrapper[5120]: I0316 16:02:08.430790 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e6f29e10-c540-416f-937a-0b0e8cbceef9-config-data" (OuterVolumeSpecName: "config-data") pod "e6f29e10-c540-416f-937a-0b0e8cbceef9" (UID: "e6f29e10-c540-416f-937a-0b0e8cbceef9"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:02:08 crc kubenswrapper[5120]: I0316 16:02:08.495863 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e6f29e10-c540-416f-937a-0b0e8cbceef9-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:02:08 crc kubenswrapper[5120]: I0316 16:02:08.495894 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e6f29e10-c540-416f-937a-0b0e8cbceef9-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:02:08 crc kubenswrapper[5120]: I0316 16:02:08.580023 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-7469b9f4cf-wq7wj" event={"ID":"307ebaa6-527e-4d6f-9601-dcb38aaa8a20","Type":"ContainerStarted","Data":"d7e5e30c61b09a69c95923f05ac16a77beb58bdaed6db16f9297e00dc08129ce"} Mar 16 16:02:08 crc kubenswrapper[5120]: I0316 16:02:08.580326 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-7469b9f4cf-wq7wj" event={"ID":"307ebaa6-527e-4d6f-9601-dcb38aaa8a20","Type":"ContainerStarted","Data":"4a7007fb9f175a2ab2bee26800be3637c8503787cc6533808c06e3b06faaddad"} Mar 16 16:02:08 crc kubenswrapper[5120]: I0316 16:02:08.583921 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-6b8df9c88d-rbjrz" event={"ID":"9d8004a6-f52b-420c-9f64-141dae970d7e","Type":"ContainerStarted","Data":"325c126814bbf2c5054010df97276a8fad76a8cd2e925d8b46965c687053ba96"} Mar 16 16:02:08 crc kubenswrapper[5120]: I0316 16:02:08.584088 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-6b8df9c88d-rbjrz" event={"ID":"9d8004a6-f52b-420c-9f64-141dae970d7e","Type":"ContainerStarted","Data":"7122001a70084eb2717f73dd53d107675a17552698fa32c81d455bdf2c07cad5"} Mar 16 16:02:08 crc kubenswrapper[5120]: I0316 16:02:08.596799 5120 generic.go:358] "Generic (PLEG): container finished" podID="9e30c205-c2b2-4766-8777-6b2730f5172a" containerID="3fb2f0ebaa9349fc31d1d61f88cf5c3160e366b347fc1b17e8366f0874ebfe72" exitCode=0 Mar 16 16:02:08 crc kubenswrapper[5120]: I0316 16:02:08.597142 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"9e30c205-c2b2-4766-8777-6b2730f5172a","Type":"ContainerDied","Data":"3fb2f0ebaa9349fc31d1d61f88cf5c3160e366b347fc1b17e8366f0874ebfe72"} Mar 16 16:02:08 crc kubenswrapper[5120]: I0316 16:02:08.603600 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-worker-7469b9f4cf-wq7wj" podStartSLOduration=2.603579015 podStartE2EDuration="2.603579015s" podCreationTimestamp="2026-03-16 16:02:06 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:02:08.601337474 +0000 UTC m=+1830.755269131" watchObservedRunningTime="2026-03-16 16:02:08.603579015 +0000 UTC m=+1830.757510672" Mar 16 16:02:08 crc kubenswrapper[5120]: I0316 16:02:08.603691 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"e6f29e10-c540-416f-937a-0b0e8cbceef9","Type":"ContainerDied","Data":"a6afe5f24117aeb51af9ada5bdf81d0157829f7bcf91ae270ff8b8e39befb673"} Mar 16 16:02:08 crc kubenswrapper[5120]: I0316 16:02:08.604056 5120 scope.go:117] "RemoveContainer" containerID="df5d0129423dcd5500785dd2881b51e1a1664bfcdfd3ad6b4d5b66e40782ef7e" Mar 16 16:02:08 crc kubenswrapper[5120]: I0316 16:02:08.603773 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:02:08 crc kubenswrapper[5120]: I0316 16:02:08.624432 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-7764ff6fcd-vw2kr" event={"ID":"8415e416-caeb-46b1-ad95-913c481d9335","Type":"ContainerStarted","Data":"a9f3bbaa6d157c8b44e2073d34125e6cecd4b706eec44f92496c67c38574acbc"} Mar 16 16:02:08 crc kubenswrapper[5120]: I0316 16:02:08.624924 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-7764ff6fcd-vw2kr" event={"ID":"8415e416-caeb-46b1-ad95-913c481d9335","Type":"ContainerStarted","Data":"70628d6c6a0143459f9d057872a5fc4b6532595c62a8041e3ea65ae6136ae1e2"} Mar 16 16:02:08 crc kubenswrapper[5120]: I0316 16:02:08.626036 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-5cddcbb4cf-kdhzk"] Mar 16 16:02:08 crc kubenswrapper[5120]: I0316 16:02:08.633420 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-5cddcbb4cf-kdhzk" podUID="1daafc71-9f0a-4fe4-953c-1e00eab0fbfa" containerName="barbican-worker-log" containerID="cri-o://5dbfdd92dc8c04f1b01cb39317fa31ce9267d193611d555f654b75d0820e48f3" gracePeriod=30 Mar 16 16:02:08 crc kubenswrapper[5120]: I0316 16:02:08.633598 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-5cddcbb4cf-kdhzk" podUID="1daafc71-9f0a-4fe4-953c-1e00eab0fbfa" containerName="barbican-worker" containerID="cri-o://0a94c712529cb8bf1ddc356c590201952132d947f6665514c06c7392f23c8bf7" gracePeriod=30 Mar 16 16:02:08 crc kubenswrapper[5120]: I0316 16:02:08.645975 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-64d4b879f4-m86vx" event={"ID":"a3c03367-28dc-4fa5-a569-0d97bad76025","Type":"ContainerStarted","Data":"463e599745b4cbe8883cb0bcd7cf94a750337b70a82a08c2bffef8028e93fa82"} Mar 16 16:02:08 crc kubenswrapper[5120]: I0316 16:02:08.646116 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-64d4b879f4-m86vx" event={"ID":"a3c03367-28dc-4fa5-a569-0d97bad76025","Type":"ContainerStarted","Data":"13b097be32c1c312c9a56e9d5be72bc21c6efd3133797c6a00939a303caf2c96"} Mar 16 16:02:08 crc kubenswrapper[5120]: I0316 16:02:08.646193 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-64d4b879f4-m86vx" event={"ID":"a3c03367-28dc-4fa5-a569-0d97bad76025","Type":"ContainerStarted","Data":"d2cf8dfbbe92fd98a0172e186ab88f45777fa39d1c82df41a15b9845e31cc1e1"} Mar 16 16:02:08 crc kubenswrapper[5120]: I0316 16:02:08.646669 5120 scope.go:117] "RemoveContainer" containerID="83ac6bf0cd539024b4fdd280b61d2850621c5f3b2f9b764184f582295056ac7f" Mar 16 16:02:08 crc kubenswrapper[5120]: I0316 16:02:08.654513 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="3ac8d936-98a3-4922-ac56-1f0056b29125" containerName="cinder-api-log" containerID="cri-o://c41f8dddc091059700fb5005af8223e4d1584a07fc6a078228075e568e0e4e4e" gracePeriod=30 Mar 16 16:02:08 crc kubenswrapper[5120]: I0316 16:02:08.655228 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-5dd49d988b-vcz2l" event={"ID":"a4bd1853-26f2-4b40-8a3d-3ae70282ab88","Type":"ContainerStarted","Data":"cc696eb8b901e5eb41cdc48434815341e805d7fe5aaf6f4c4e042c349eba69f7"} Mar 16 16:02:08 crc kubenswrapper[5120]: I0316 16:02:08.655265 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-5dd49d988b-vcz2l" event={"ID":"a4bd1853-26f2-4b40-8a3d-3ae70282ab88","Type":"ContainerStarted","Data":"571eac3da25245961f0e45f6bde80dd2a01c1eddf05b2c1cc427d76538851b9e"} Mar 16 16:02:08 crc kubenswrapper[5120]: I0316 16:02:08.655328 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="3ac8d936-98a3-4922-ac56-1f0056b29125" containerName="cinder-api" containerID="cri-o://f132e6a3974c1bba9ad90227d344ad9e877787b64b57fe6dc69fdda7f7bc7f06" gracePeriod=30 Mar 16 16:02:08 crc kubenswrapper[5120]: I0316 16:02:08.673922 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-keystone-listener-64d4b879f4-m86vx" podStartSLOduration=2.67388832 podStartE2EDuration="2.67388832s" podCreationTimestamp="2026-03-16 16:02:06 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:02:08.669972893 +0000 UTC m=+1830.823904550" watchObservedRunningTime="2026-03-16 16:02:08.67388832 +0000 UTC m=+1830.827819967" Mar 16 16:02:08 crc kubenswrapper[5120]: I0316 16:02:08.722071 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-5c58fd7f58-mlf64"] Mar 16 16:02:08 crc kubenswrapper[5120]: I0316 16:02:08.722350 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-5c58fd7f58-mlf64" podUID="c6827071-9f0c-4934-a287-e8c5797c390b" containerName="barbican-keystone-listener-log" containerID="cri-o://c3c4123b5cbd0d36089b7b23b6870cba5e52d6959fe0b7e7a2e2ddfae762753a" gracePeriod=30 Mar 16 16:02:08 crc kubenswrapper[5120]: I0316 16:02:08.722463 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-5c58fd7f58-mlf64" podUID="c6827071-9f0c-4934-a287-e8c5797c390b" containerName="barbican-keystone-listener" containerID="cri-o://d91421927778a07c9c37a08ed8e999b4757e0ecdfe9406c6ece2e2ed38961bb9" gracePeriod=30 Mar 16 16:02:08 crc kubenswrapper[5120]: I0316 16:02:08.761072 5120 scope.go:117] "RemoveContainer" containerID="c5053999b289290441bd5d0a9ad579a71fa73cf3376801ea1a32d54875d317c9" Mar 16 16:02:08 crc kubenswrapper[5120]: I0316 16:02:08.791845 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:02:08 crc kubenswrapper[5120]: I0316 16:02:08.816484 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:02:08 crc kubenswrapper[5120]: I0316 16:02:08.818641 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:02:08 crc kubenswrapper[5120]: I0316 16:02:08.818876 5120 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Mar 16 16:02:08 crc kubenswrapper[5120]: I0316 16:02:08.837332 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:02:08 crc kubenswrapper[5120]: I0316 16:02:08.838504 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6f29e10-c540-416f-937a-0b0e8cbceef9" containerName="sg-core" Mar 16 16:02:08 crc kubenswrapper[5120]: I0316 16:02:08.838542 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6f29e10-c540-416f-937a-0b0e8cbceef9" containerName="sg-core" Mar 16 16:02:08 crc kubenswrapper[5120]: I0316 16:02:08.838573 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6f29e10-c540-416f-937a-0b0e8cbceef9" containerName="ceilometer-notification-agent" Mar 16 16:02:08 crc kubenswrapper[5120]: I0316 16:02:08.838579 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6f29e10-c540-416f-937a-0b0e8cbceef9" containerName="ceilometer-notification-agent" Mar 16 16:02:08 crc kubenswrapper[5120]: I0316 16:02:08.838637 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6f29e10-c540-416f-937a-0b0e8cbceef9" containerName="ceilometer-central-agent" Mar 16 16:02:08 crc kubenswrapper[5120]: I0316 16:02:08.838644 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6f29e10-c540-416f-937a-0b0e8cbceef9" containerName="ceilometer-central-agent" Mar 16 16:02:08 crc kubenswrapper[5120]: I0316 16:02:08.838653 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6f29e10-c540-416f-937a-0b0e8cbceef9" containerName="proxy-httpd" Mar 16 16:02:08 crc kubenswrapper[5120]: I0316 16:02:08.838661 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6f29e10-c540-416f-937a-0b0e8cbceef9" containerName="proxy-httpd" Mar 16 16:02:08 crc kubenswrapper[5120]: I0316 16:02:08.838876 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e6f29e10-c540-416f-937a-0b0e8cbceef9" containerName="proxy-httpd" Mar 16 16:02:08 crc kubenswrapper[5120]: I0316 16:02:08.838888 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e6f29e10-c540-416f-937a-0b0e8cbceef9" containerName="sg-core" Mar 16 16:02:08 crc kubenswrapper[5120]: I0316 16:02:08.838898 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e6f29e10-c540-416f-937a-0b0e8cbceef9" containerName="ceilometer-central-agent" Mar 16 16:02:08 crc kubenswrapper[5120]: I0316 16:02:08.838938 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e6f29e10-c540-416f-937a-0b0e8cbceef9" containerName="ceilometer-notification-agent" Mar 16 16:02:08 crc kubenswrapper[5120]: I0316 16:02:08.848414 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:02:08 crc kubenswrapper[5120]: I0316 16:02:08.858820 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 16:02:08 crc kubenswrapper[5120]: I0316 16:02:08.859032 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 16:02:08 crc kubenswrapper[5120]: I0316 16:02:08.914284 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:02:09 crc kubenswrapper[5120]: I0316 16:02:09.021658 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xb2mw\" (UniqueName: \"kubernetes.io/projected/41237879-5c40-4f4b-ad6f-39dab45ba2d5-kube-api-access-xb2mw\") pod \"ceilometer-0\" (UID: \"41237879-5c40-4f4b-ad6f-39dab45ba2d5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:02:09 crc kubenswrapper[5120]: I0316 16:02:09.021725 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/41237879-5c40-4f4b-ad6f-39dab45ba2d5-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"41237879-5c40-4f4b-ad6f-39dab45ba2d5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:02:09 crc kubenswrapper[5120]: I0316 16:02:09.021890 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/41237879-5c40-4f4b-ad6f-39dab45ba2d5-run-httpd\") pod \"ceilometer-0\" (UID: \"41237879-5c40-4f4b-ad6f-39dab45ba2d5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:02:09 crc kubenswrapper[5120]: I0316 16:02:09.021928 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/41237879-5c40-4f4b-ad6f-39dab45ba2d5-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"41237879-5c40-4f4b-ad6f-39dab45ba2d5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:02:09 crc kubenswrapper[5120]: I0316 16:02:09.021969 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/41237879-5c40-4f4b-ad6f-39dab45ba2d5-scripts\") pod \"ceilometer-0\" (UID: \"41237879-5c40-4f4b-ad6f-39dab45ba2d5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:02:09 crc kubenswrapper[5120]: I0316 16:02:09.022011 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/41237879-5c40-4f4b-ad6f-39dab45ba2d5-log-httpd\") pod \"ceilometer-0\" (UID: \"41237879-5c40-4f4b-ad6f-39dab45ba2d5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:02:09 crc kubenswrapper[5120]: I0316 16:02:09.022040 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/41237879-5c40-4f4b-ad6f-39dab45ba2d5-config-data\") pod \"ceilometer-0\" (UID: \"41237879-5c40-4f4b-ad6f-39dab45ba2d5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:02:09 crc kubenswrapper[5120]: I0316 16:02:09.032376 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:02:09 crc kubenswrapper[5120]: I0316 16:02:09.064057 5120 scope.go:117] "RemoveContainer" containerID="b57a42f04539435d37185f3a2ac319195f6f121989df111ab79903e0175b1a6c" Mar 16 16:02:09 crc kubenswrapper[5120]: I0316 16:02:09.124974 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/41237879-5c40-4f4b-ad6f-39dab45ba2d5-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"41237879-5c40-4f4b-ad6f-39dab45ba2d5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:02:09 crc kubenswrapper[5120]: I0316 16:02:09.125054 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/41237879-5c40-4f4b-ad6f-39dab45ba2d5-scripts\") pod \"ceilometer-0\" (UID: \"41237879-5c40-4f4b-ad6f-39dab45ba2d5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:02:09 crc kubenswrapper[5120]: I0316 16:02:09.125118 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/41237879-5c40-4f4b-ad6f-39dab45ba2d5-log-httpd\") pod \"ceilometer-0\" (UID: \"41237879-5c40-4f4b-ad6f-39dab45ba2d5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:02:09 crc kubenswrapper[5120]: I0316 16:02:09.125158 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/41237879-5c40-4f4b-ad6f-39dab45ba2d5-config-data\") pod \"ceilometer-0\" (UID: \"41237879-5c40-4f4b-ad6f-39dab45ba2d5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:02:09 crc kubenswrapper[5120]: I0316 16:02:09.125426 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xb2mw\" (UniqueName: \"kubernetes.io/projected/41237879-5c40-4f4b-ad6f-39dab45ba2d5-kube-api-access-xb2mw\") pod \"ceilometer-0\" (UID: \"41237879-5c40-4f4b-ad6f-39dab45ba2d5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:02:09 crc kubenswrapper[5120]: I0316 16:02:09.125471 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/41237879-5c40-4f4b-ad6f-39dab45ba2d5-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"41237879-5c40-4f4b-ad6f-39dab45ba2d5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:02:09 crc kubenswrapper[5120]: I0316 16:02:09.125497 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/41237879-5c40-4f4b-ad6f-39dab45ba2d5-run-httpd\") pod \"ceilometer-0\" (UID: \"41237879-5c40-4f4b-ad6f-39dab45ba2d5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:02:09 crc kubenswrapper[5120]: I0316 16:02:09.126022 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/41237879-5c40-4f4b-ad6f-39dab45ba2d5-run-httpd\") pod \"ceilometer-0\" (UID: \"41237879-5c40-4f4b-ad6f-39dab45ba2d5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:02:09 crc kubenswrapper[5120]: I0316 16:02:09.132572 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/41237879-5c40-4f4b-ad6f-39dab45ba2d5-log-httpd\") pod \"ceilometer-0\" (UID: \"41237879-5c40-4f4b-ad6f-39dab45ba2d5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:02:09 crc kubenswrapper[5120]: I0316 16:02:09.133139 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/41237879-5c40-4f4b-ad6f-39dab45ba2d5-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"41237879-5c40-4f4b-ad6f-39dab45ba2d5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:02:09 crc kubenswrapper[5120]: I0316 16:02:09.136190 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/41237879-5c40-4f4b-ad6f-39dab45ba2d5-config-data\") pod \"ceilometer-0\" (UID: \"41237879-5c40-4f4b-ad6f-39dab45ba2d5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:02:09 crc kubenswrapper[5120]: I0316 16:02:09.145920 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/41237879-5c40-4f4b-ad6f-39dab45ba2d5-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"41237879-5c40-4f4b-ad6f-39dab45ba2d5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:02:09 crc kubenswrapper[5120]: I0316 16:02:09.146795 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/41237879-5c40-4f4b-ad6f-39dab45ba2d5-scripts\") pod \"ceilometer-0\" (UID: \"41237879-5c40-4f4b-ad6f-39dab45ba2d5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:02:09 crc kubenswrapper[5120]: I0316 16:02:09.149746 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xb2mw\" (UniqueName: \"kubernetes.io/projected/41237879-5c40-4f4b-ad6f-39dab45ba2d5-kube-api-access-xb2mw\") pod \"ceilometer-0\" (UID: \"41237879-5c40-4f4b-ad6f-39dab45ba2d5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:02:09 crc kubenswrapper[5120]: I0316 16:02:09.244089 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:02:09 crc kubenswrapper[5120]: I0316 16:02:09.620581 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:02:09 crc kubenswrapper[5120]: I0316 16:02:09.665409 5120 generic.go:358] "Generic (PLEG): container finished" podID="8415e416-caeb-46b1-ad95-913c481d9335" containerID="4041a1fd9f33db9374d18f6ef495d045f283669fd293a5fe9c26deec77744d37" exitCode=1 Mar 16 16:02:09 crc kubenswrapper[5120]: I0316 16:02:09.665537 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-7764ff6fcd-vw2kr" event={"ID":"8415e416-caeb-46b1-ad95-913c481d9335","Type":"ContainerDied","Data":"4041a1fd9f33db9374d18f6ef495d045f283669fd293a5fe9c26deec77744d37"} Mar 16 16:02:09 crc kubenswrapper[5120]: I0316 16:02:09.665700 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-7764ff6fcd-vw2kr" podUID="8415e416-caeb-46b1-ad95-913c481d9335" containerName="barbican-api-log" containerID="cri-o://a9f3bbaa6d157c8b44e2073d34125e6cecd4b706eec44f92496c67c38574acbc" gracePeriod=30 Mar 16 16:02:09 crc kubenswrapper[5120]: I0316 16:02:09.666063 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-7764ff6fcd-vw2kr" Mar 16 16:02:09 crc kubenswrapper[5120]: I0316 16:02:09.679832 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-5dd49d988b-vcz2l" event={"ID":"a4bd1853-26f2-4b40-8a3d-3ae70282ab88","Type":"ContainerStarted","Data":"9d45a48840b6d7f38f5e8df07afcd62928246e625344537e93a0413d1c500491"} Mar 16 16:02:09 crc kubenswrapper[5120]: I0316 16:02:09.683401 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-5dd49d988b-vcz2l" Mar 16 16:02:09 crc kubenswrapper[5120]: I0316 16:02:09.686347 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-5dd49d988b-vcz2l" Mar 16 16:02:09 crc kubenswrapper[5120]: I0316 16:02:09.690236 5120 generic.go:358] "Generic (PLEG): container finished" podID="3ac8d936-98a3-4922-ac56-1f0056b29125" containerID="f132e6a3974c1bba9ad90227d344ad9e877787b64b57fe6dc69fdda7f7bc7f06" exitCode=0 Mar 16 16:02:09 crc kubenswrapper[5120]: I0316 16:02:09.690257 5120 generic.go:358] "Generic (PLEG): container finished" podID="3ac8d936-98a3-4922-ac56-1f0056b29125" containerID="c41f8dddc091059700fb5005af8223e4d1584a07fc6a078228075e568e0e4e4e" exitCode=143 Mar 16 16:02:09 crc kubenswrapper[5120]: I0316 16:02:09.690381 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"3ac8d936-98a3-4922-ac56-1f0056b29125","Type":"ContainerDied","Data":"f132e6a3974c1bba9ad90227d344ad9e877787b64b57fe6dc69fdda7f7bc7f06"} Mar 16 16:02:09 crc kubenswrapper[5120]: I0316 16:02:09.690401 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"3ac8d936-98a3-4922-ac56-1f0056b29125","Type":"ContainerDied","Data":"c41f8dddc091059700fb5005af8223e4d1584a07fc6a078228075e568e0e4e4e"} Mar 16 16:02:09 crc kubenswrapper[5120]: I0316 16:02:09.690411 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"3ac8d936-98a3-4922-ac56-1f0056b29125","Type":"ContainerDied","Data":"1a457ece2c01f871bb5e06b9599c3111f08b625c2317afcc0cb4dd35a68386f7"} Mar 16 16:02:09 crc kubenswrapper[5120]: I0316 16:02:09.690425 5120 scope.go:117] "RemoveContainer" containerID="f132e6a3974c1bba9ad90227d344ad9e877787b64b57fe6dc69fdda7f7bc7f06" Mar 16 16:02:09 crc kubenswrapper[5120]: I0316 16:02:09.690492 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:02:09 crc kubenswrapper[5120]: I0316 16:02:09.694917 5120 generic.go:358] "Generic (PLEG): container finished" podID="1daafc71-9f0a-4fe4-953c-1e00eab0fbfa" containerID="5dbfdd92dc8c04f1b01cb39317fa31ce9267d193611d555f654b75d0820e48f3" exitCode=143 Mar 16 16:02:09 crc kubenswrapper[5120]: I0316 16:02:09.695051 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-5cddcbb4cf-kdhzk" event={"ID":"1daafc71-9f0a-4fe4-953c-1e00eab0fbfa","Type":"ContainerDied","Data":"5dbfdd92dc8c04f1b01cb39317fa31ce9267d193611d555f654b75d0820e48f3"} Mar 16 16:02:09 crc kubenswrapper[5120]: I0316 16:02:09.704123 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-6b8df9c88d-rbjrz" event={"ID":"9d8004a6-f52b-420c-9f64-141dae970d7e","Type":"ContainerStarted","Data":"24a0dfb437371b7a9e2fbca989f638c6bbaab73772e7b7c295009200a6496677"} Mar 16 16:02:09 crc kubenswrapper[5120]: I0316 16:02:09.704257 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/neutron-6b8df9c88d-rbjrz" Mar 16 16:02:09 crc kubenswrapper[5120]: I0316 16:02:09.707628 5120 generic.go:358] "Generic (PLEG): container finished" podID="c6827071-9f0c-4934-a287-e8c5797c390b" containerID="c3c4123b5cbd0d36089b7b23b6870cba5e52d6959fe0b7e7a2e2ddfae762753a" exitCode=143 Mar 16 16:02:09 crc kubenswrapper[5120]: I0316 16:02:09.709308 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-5c58fd7f58-mlf64" event={"ID":"c6827071-9f0c-4934-a287-e8c5797c390b","Type":"ContainerDied","Data":"c3c4123b5cbd0d36089b7b23b6870cba5e52d6959fe0b7e7a2e2ddfae762753a"} Mar 16 16:02:09 crc kubenswrapper[5120]: I0316 16:02:09.734673 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-api-5dd49d988b-vcz2l" podStartSLOduration=2.7346526349999998 podStartE2EDuration="2.734652635s" podCreationTimestamp="2026-03-16 16:02:07 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:02:09.701954766 +0000 UTC m=+1831.855886433" watchObservedRunningTime="2026-03-16 16:02:09.734652635 +0000 UTC m=+1831.888584292" Mar 16 16:02:09 crc kubenswrapper[5120]: I0316 16:02:09.738100 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/3ac8d936-98a3-4922-ac56-1f0056b29125-config-data-custom\") pod \"3ac8d936-98a3-4922-ac56-1f0056b29125\" (UID: \"3ac8d936-98a3-4922-ac56-1f0056b29125\") " Mar 16 16:02:09 crc kubenswrapper[5120]: I0316 16:02:09.738271 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3ac8d936-98a3-4922-ac56-1f0056b29125-scripts\") pod \"3ac8d936-98a3-4922-ac56-1f0056b29125\" (UID: \"3ac8d936-98a3-4922-ac56-1f0056b29125\") " Mar 16 16:02:09 crc kubenswrapper[5120]: I0316 16:02:09.738498 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/3ac8d936-98a3-4922-ac56-1f0056b29125-etc-machine-id\") pod \"3ac8d936-98a3-4922-ac56-1f0056b29125\" (UID: \"3ac8d936-98a3-4922-ac56-1f0056b29125\") " Mar 16 16:02:09 crc kubenswrapper[5120]: I0316 16:02:09.738624 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3ac8d936-98a3-4922-ac56-1f0056b29125-logs\") pod \"3ac8d936-98a3-4922-ac56-1f0056b29125\" (UID: \"3ac8d936-98a3-4922-ac56-1f0056b29125\") " Mar 16 16:02:09 crc kubenswrapper[5120]: I0316 16:02:09.738712 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pmlrz\" (UniqueName: \"kubernetes.io/projected/3ac8d936-98a3-4922-ac56-1f0056b29125-kube-api-access-pmlrz\") pod \"3ac8d936-98a3-4922-ac56-1f0056b29125\" (UID: \"3ac8d936-98a3-4922-ac56-1f0056b29125\") " Mar 16 16:02:09 crc kubenswrapper[5120]: I0316 16:02:09.738737 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3ac8d936-98a3-4922-ac56-1f0056b29125-config-data\") pod \"3ac8d936-98a3-4922-ac56-1f0056b29125\" (UID: \"3ac8d936-98a3-4922-ac56-1f0056b29125\") " Mar 16 16:02:09 crc kubenswrapper[5120]: I0316 16:02:09.738781 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/3ac8d936-98a3-4922-ac56-1f0056b29125-public-tls-certs\") pod \"3ac8d936-98a3-4922-ac56-1f0056b29125\" (UID: \"3ac8d936-98a3-4922-ac56-1f0056b29125\") " Mar 16 16:02:09 crc kubenswrapper[5120]: I0316 16:02:09.738837 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3ac8d936-98a3-4922-ac56-1f0056b29125-combined-ca-bundle\") pod \"3ac8d936-98a3-4922-ac56-1f0056b29125\" (UID: \"3ac8d936-98a3-4922-ac56-1f0056b29125\") " Mar 16 16:02:09 crc kubenswrapper[5120]: I0316 16:02:09.738844 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/3ac8d936-98a3-4922-ac56-1f0056b29125-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "3ac8d936-98a3-4922-ac56-1f0056b29125" (UID: "3ac8d936-98a3-4922-ac56-1f0056b29125"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 16:02:09 crc kubenswrapper[5120]: I0316 16:02:09.738973 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/3ac8d936-98a3-4922-ac56-1f0056b29125-internal-tls-certs\") pod \"3ac8d936-98a3-4922-ac56-1f0056b29125\" (UID: \"3ac8d936-98a3-4922-ac56-1f0056b29125\") " Mar 16 16:02:09 crc kubenswrapper[5120]: I0316 16:02:09.739577 5120 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/3ac8d936-98a3-4922-ac56-1f0056b29125-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 16:02:09 crc kubenswrapper[5120]: I0316 16:02:09.745015 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ac8d936-98a3-4922-ac56-1f0056b29125-logs" (OuterVolumeSpecName: "logs") pod "3ac8d936-98a3-4922-ac56-1f0056b29125" (UID: "3ac8d936-98a3-4922-ac56-1f0056b29125"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:02:09 crc kubenswrapper[5120]: I0316 16:02:09.750878 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3ac8d936-98a3-4922-ac56-1f0056b29125-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "3ac8d936-98a3-4922-ac56-1f0056b29125" (UID: "3ac8d936-98a3-4922-ac56-1f0056b29125"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:02:09 crc kubenswrapper[5120]: I0316 16:02:09.750878 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ac8d936-98a3-4922-ac56-1f0056b29125-kube-api-access-pmlrz" (OuterVolumeSpecName: "kube-api-access-pmlrz") pod "3ac8d936-98a3-4922-ac56-1f0056b29125" (UID: "3ac8d936-98a3-4922-ac56-1f0056b29125"). InnerVolumeSpecName "kube-api-access-pmlrz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:02:09 crc kubenswrapper[5120]: I0316 16:02:09.752993 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-6b8df9c88d-rbjrz" podStartSLOduration=3.752977419 podStartE2EDuration="3.752977419s" podCreationTimestamp="2026-03-16 16:02:06 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:02:09.725296517 +0000 UTC m=+1831.879228164" watchObservedRunningTime="2026-03-16 16:02:09.752977419 +0000 UTC m=+1831.906909076" Mar 16 16:02:09 crc kubenswrapper[5120]: I0316 16:02:09.753661 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3ac8d936-98a3-4922-ac56-1f0056b29125-scripts" (OuterVolumeSpecName: "scripts") pod "3ac8d936-98a3-4922-ac56-1f0056b29125" (UID: "3ac8d936-98a3-4922-ac56-1f0056b29125"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:02:09 crc kubenswrapper[5120]: I0316 16:02:09.780694 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3ac8d936-98a3-4922-ac56-1f0056b29125-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "3ac8d936-98a3-4922-ac56-1f0056b29125" (UID: "3ac8d936-98a3-4922-ac56-1f0056b29125"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:02:09 crc kubenswrapper[5120]: I0316 16:02:09.835437 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:02:09 crc kubenswrapper[5120]: W0316 16:02:09.845095 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod41237879_5c40_4f4b_ad6f_39dab45ba2d5.slice/crio-97a826a51eb103ea1b5d81924af0f4938d6b6b44c9973278063663aee0498778 WatchSource:0}: Error finding container 97a826a51eb103ea1b5d81924af0f4938d6b6b44c9973278063663aee0498778: Status 404 returned error can't find the container with id 97a826a51eb103ea1b5d81924af0f4938d6b6b44c9973278063663aee0498778 Mar 16 16:02:09 crc kubenswrapper[5120]: I0316 16:02:09.847321 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3ac8d936-98a3-4922-ac56-1f0056b29125-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "3ac8d936-98a3-4922-ac56-1f0056b29125" (UID: "3ac8d936-98a3-4922-ac56-1f0056b29125"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:02:09 crc kubenswrapper[5120]: I0316 16:02:09.847740 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/3ac8d936-98a3-4922-ac56-1f0056b29125-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:02:09 crc kubenswrapper[5120]: I0316 16:02:09.847784 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3ac8d936-98a3-4922-ac56-1f0056b29125-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:02:09 crc kubenswrapper[5120]: I0316 16:02:09.847795 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3ac8d936-98a3-4922-ac56-1f0056b29125-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:02:09 crc kubenswrapper[5120]: I0316 16:02:09.847804 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pmlrz\" (UniqueName: \"kubernetes.io/projected/3ac8d936-98a3-4922-ac56-1f0056b29125-kube-api-access-pmlrz\") on node \"crc\" DevicePath \"\"" Mar 16 16:02:09 crc kubenswrapper[5120]: I0316 16:02:09.847815 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3ac8d936-98a3-4922-ac56-1f0056b29125-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:02:09 crc kubenswrapper[5120]: I0316 16:02:09.850327 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3ac8d936-98a3-4922-ac56-1f0056b29125-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "3ac8d936-98a3-4922-ac56-1f0056b29125" (UID: "3ac8d936-98a3-4922-ac56-1f0056b29125"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:02:09 crc kubenswrapper[5120]: I0316 16:02:09.856090 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3ac8d936-98a3-4922-ac56-1f0056b29125-config-data" (OuterVolumeSpecName: "config-data") pod "3ac8d936-98a3-4922-ac56-1f0056b29125" (UID: "3ac8d936-98a3-4922-ac56-1f0056b29125"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:02:09 crc kubenswrapper[5120]: I0316 16:02:09.950830 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/3ac8d936-98a3-4922-ac56-1f0056b29125-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:02:09 crc kubenswrapper[5120]: I0316 16:02:09.950865 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3ac8d936-98a3-4922-ac56-1f0056b29125-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:02:09 crc kubenswrapper[5120]: I0316 16:02:09.950873 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/3ac8d936-98a3-4922-ac56-1f0056b29125-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:02:10 crc kubenswrapper[5120]: I0316 16:02:10.108431 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:02:10 crc kubenswrapper[5120]: I0316 16:02:10.141892 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:02:10 crc kubenswrapper[5120]: I0316 16:02:10.142185 5120 scope.go:117] "RemoveContainer" containerID="c41f8dddc091059700fb5005af8223e4d1584a07fc6a078228075e568e0e4e4e" Mar 16 16:02:10 crc kubenswrapper[5120]: I0316 16:02:10.159905 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:02:10 crc kubenswrapper[5120]: I0316 16:02:10.161100 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ac8d936-98a3-4922-ac56-1f0056b29125" containerName="cinder-api" Mar 16 16:02:10 crc kubenswrapper[5120]: I0316 16:02:10.161121 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ac8d936-98a3-4922-ac56-1f0056b29125" containerName="cinder-api" Mar 16 16:02:10 crc kubenswrapper[5120]: I0316 16:02:10.161157 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ac8d936-98a3-4922-ac56-1f0056b29125" containerName="cinder-api-log" Mar 16 16:02:10 crc kubenswrapper[5120]: I0316 16:02:10.161164 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ac8d936-98a3-4922-ac56-1f0056b29125" containerName="cinder-api-log" Mar 16 16:02:10 crc kubenswrapper[5120]: I0316 16:02:10.161348 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="3ac8d936-98a3-4922-ac56-1f0056b29125" containerName="cinder-api" Mar 16 16:02:10 crc kubenswrapper[5120]: I0316 16:02:10.161370 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="3ac8d936-98a3-4922-ac56-1f0056b29125" containerName="cinder-api-log" Mar 16 16:02:10 crc kubenswrapper[5120]: I0316 16:02:10.163609 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-7764ff6fcd-vw2kr" Mar 16 16:02:10 crc kubenswrapper[5120]: I0316 16:02:10.168263 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:02:10 crc kubenswrapper[5120]: I0316 16:02:10.170419 5120 scope.go:117] "RemoveContainer" containerID="f132e6a3974c1bba9ad90227d344ad9e877787b64b57fe6dc69fdda7f7bc7f06" Mar 16 16:02:10 crc kubenswrapper[5120]: I0316 16:02:10.170632 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-cinder-internal-svc\"" Mar 16 16:02:10 crc kubenswrapper[5120]: E0316 16:02:10.170825 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f132e6a3974c1bba9ad90227d344ad9e877787b64b57fe6dc69fdda7f7bc7f06\": container with ID starting with f132e6a3974c1bba9ad90227d344ad9e877787b64b57fe6dc69fdda7f7bc7f06 not found: ID does not exist" containerID="f132e6a3974c1bba9ad90227d344ad9e877787b64b57fe6dc69fdda7f7bc7f06" Mar 16 16:02:10 crc kubenswrapper[5120]: I0316 16:02:10.170854 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f132e6a3974c1bba9ad90227d344ad9e877787b64b57fe6dc69fdda7f7bc7f06"} err="failed to get container status \"f132e6a3974c1bba9ad90227d344ad9e877787b64b57fe6dc69fdda7f7bc7f06\": rpc error: code = NotFound desc = could not find container \"f132e6a3974c1bba9ad90227d344ad9e877787b64b57fe6dc69fdda7f7bc7f06\": container with ID starting with f132e6a3974c1bba9ad90227d344ad9e877787b64b57fe6dc69fdda7f7bc7f06 not found: ID does not exist" Mar 16 16:02:10 crc kubenswrapper[5120]: I0316 16:02:10.170869 5120 scope.go:117] "RemoveContainer" containerID="c41f8dddc091059700fb5005af8223e4d1584a07fc6a078228075e568e0e4e4e" Mar 16 16:02:10 crc kubenswrapper[5120]: I0316 16:02:10.170914 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-api-config-data\"" Mar 16 16:02:10 crc kubenswrapper[5120]: I0316 16:02:10.170954 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-cinder-public-svc\"" Mar 16 16:02:10 crc kubenswrapper[5120]: E0316 16:02:10.171111 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c41f8dddc091059700fb5005af8223e4d1584a07fc6a078228075e568e0e4e4e\": container with ID starting with c41f8dddc091059700fb5005af8223e4d1584a07fc6a078228075e568e0e4e4e not found: ID does not exist" containerID="c41f8dddc091059700fb5005af8223e4d1584a07fc6a078228075e568e0e4e4e" Mar 16 16:02:10 crc kubenswrapper[5120]: I0316 16:02:10.171142 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c41f8dddc091059700fb5005af8223e4d1584a07fc6a078228075e568e0e4e4e"} err="failed to get container status \"c41f8dddc091059700fb5005af8223e4d1584a07fc6a078228075e568e0e4e4e\": rpc error: code = NotFound desc = could not find container \"c41f8dddc091059700fb5005af8223e4d1584a07fc6a078228075e568e0e4e4e\": container with ID starting with c41f8dddc091059700fb5005af8223e4d1584a07fc6a078228075e568e0e4e4e not found: ID does not exist" Mar 16 16:02:10 crc kubenswrapper[5120]: I0316 16:02:10.171171 5120 scope.go:117] "RemoveContainer" containerID="f132e6a3974c1bba9ad90227d344ad9e877787b64b57fe6dc69fdda7f7bc7f06" Mar 16 16:02:10 crc kubenswrapper[5120]: I0316 16:02:10.171459 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f132e6a3974c1bba9ad90227d344ad9e877787b64b57fe6dc69fdda7f7bc7f06"} err="failed to get container status \"f132e6a3974c1bba9ad90227d344ad9e877787b64b57fe6dc69fdda7f7bc7f06\": rpc error: code = NotFound desc = could not find container \"f132e6a3974c1bba9ad90227d344ad9e877787b64b57fe6dc69fdda7f7bc7f06\": container with ID starting with f132e6a3974c1bba9ad90227d344ad9e877787b64b57fe6dc69fdda7f7bc7f06 not found: ID does not exist" Mar 16 16:02:10 crc kubenswrapper[5120]: I0316 16:02:10.171476 5120 scope.go:117] "RemoveContainer" containerID="c41f8dddc091059700fb5005af8223e4d1584a07fc6a078228075e568e0e4e4e" Mar 16 16:02:10 crc kubenswrapper[5120]: I0316 16:02:10.171650 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c41f8dddc091059700fb5005af8223e4d1584a07fc6a078228075e568e0e4e4e"} err="failed to get container status \"c41f8dddc091059700fb5005af8223e4d1584a07fc6a078228075e568e0e4e4e\": rpc error: code = NotFound desc = could not find container \"c41f8dddc091059700fb5005af8223e4d1584a07fc6a078228075e568e0e4e4e\": container with ID starting with c41f8dddc091059700fb5005af8223e4d1584a07fc6a078228075e568e0e4e4e not found: ID does not exist" Mar 16 16:02:10 crc kubenswrapper[5120]: I0316 16:02:10.176118 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:02:10 crc kubenswrapper[5120]: I0316 16:02:10.255418 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8415e416-caeb-46b1-ad95-913c481d9335-logs\") pod \"8415e416-caeb-46b1-ad95-913c481d9335\" (UID: \"8415e416-caeb-46b1-ad95-913c481d9335\") " Mar 16 16:02:10 crc kubenswrapper[5120]: I0316 16:02:10.255533 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qp7nc\" (UniqueName: \"kubernetes.io/projected/8415e416-caeb-46b1-ad95-913c481d9335-kube-api-access-qp7nc\") pod \"8415e416-caeb-46b1-ad95-913c481d9335\" (UID: \"8415e416-caeb-46b1-ad95-913c481d9335\") " Mar 16 16:02:10 crc kubenswrapper[5120]: I0316 16:02:10.255604 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/8415e416-caeb-46b1-ad95-913c481d9335-config-data-custom\") pod \"8415e416-caeb-46b1-ad95-913c481d9335\" (UID: \"8415e416-caeb-46b1-ad95-913c481d9335\") " Mar 16 16:02:10 crc kubenswrapper[5120]: I0316 16:02:10.255728 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8415e416-caeb-46b1-ad95-913c481d9335-combined-ca-bundle\") pod \"8415e416-caeb-46b1-ad95-913c481d9335\" (UID: \"8415e416-caeb-46b1-ad95-913c481d9335\") " Mar 16 16:02:10 crc kubenswrapper[5120]: I0316 16:02:10.255866 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8415e416-caeb-46b1-ad95-913c481d9335-config-data\") pod \"8415e416-caeb-46b1-ad95-913c481d9335\" (UID: \"8415e416-caeb-46b1-ad95-913c481d9335\") " Mar 16 16:02:10 crc kubenswrapper[5120]: I0316 16:02:10.256243 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8415e416-caeb-46b1-ad95-913c481d9335-logs" (OuterVolumeSpecName: "logs") pod "8415e416-caeb-46b1-ad95-913c481d9335" (UID: "8415e416-caeb-46b1-ad95-913c481d9335"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:02:10 crc kubenswrapper[5120]: I0316 16:02:10.263833 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8415e416-caeb-46b1-ad95-913c481d9335-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "8415e416-caeb-46b1-ad95-913c481d9335" (UID: "8415e416-caeb-46b1-ad95-913c481d9335"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:02:10 crc kubenswrapper[5120]: I0316 16:02:10.273037 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8415e416-caeb-46b1-ad95-913c481d9335-kube-api-access-qp7nc" (OuterVolumeSpecName: "kube-api-access-qp7nc") pod "8415e416-caeb-46b1-ad95-913c481d9335" (UID: "8415e416-caeb-46b1-ad95-913c481d9335"). InnerVolumeSpecName "kube-api-access-qp7nc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:02:10 crc kubenswrapper[5120]: I0316 16:02:10.299766 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8415e416-caeb-46b1-ad95-913c481d9335-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "8415e416-caeb-46b1-ad95-913c481d9335" (UID: "8415e416-caeb-46b1-ad95-913c481d9335"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:02:10 crc kubenswrapper[5120]: E0316 16:02:10.350366 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1600365 actualBytes=10240 Mar 16 16:02:10 crc kubenswrapper[5120]: I0316 16:02:10.350882 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8415e416-caeb-46b1-ad95-913c481d9335-config-data" (OuterVolumeSpecName: "config-data") pod "8415e416-caeb-46b1-ad95-913c481d9335" (UID: "8415e416-caeb-46b1-ad95-913c481d9335"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:02:10 crc kubenswrapper[5120]: I0316 16:02:10.357893 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/27074431-e87c-47e8-9d5a-97fc6edcb13a-etc-machine-id\") pod \"cinder-api-0\" (UID: \"27074431-e87c-47e8-9d5a-97fc6edcb13a\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:02:10 crc kubenswrapper[5120]: I0316 16:02:10.357937 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/27074431-e87c-47e8-9d5a-97fc6edcb13a-public-tls-certs\") pod \"cinder-api-0\" (UID: \"27074431-e87c-47e8-9d5a-97fc6edcb13a\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:02:10 crc kubenswrapper[5120]: I0316 16:02:10.357982 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/27074431-e87c-47e8-9d5a-97fc6edcb13a-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"27074431-e87c-47e8-9d5a-97fc6edcb13a\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:02:10 crc kubenswrapper[5120]: I0316 16:02:10.358031 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/27074431-e87c-47e8-9d5a-97fc6edcb13a-scripts\") pod \"cinder-api-0\" (UID: \"27074431-e87c-47e8-9d5a-97fc6edcb13a\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:02:10 crc kubenswrapper[5120]: I0316 16:02:10.358089 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/27074431-e87c-47e8-9d5a-97fc6edcb13a-config-data-custom\") pod \"cinder-api-0\" (UID: \"27074431-e87c-47e8-9d5a-97fc6edcb13a\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:02:10 crc kubenswrapper[5120]: I0316 16:02:10.358143 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/27074431-e87c-47e8-9d5a-97fc6edcb13a-config-data\") pod \"cinder-api-0\" (UID: \"27074431-e87c-47e8-9d5a-97fc6edcb13a\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:02:10 crc kubenswrapper[5120]: I0316 16:02:10.358156 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/27074431-e87c-47e8-9d5a-97fc6edcb13a-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"27074431-e87c-47e8-9d5a-97fc6edcb13a\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:02:10 crc kubenswrapper[5120]: I0316 16:02:10.358191 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/27074431-e87c-47e8-9d5a-97fc6edcb13a-logs\") pod \"cinder-api-0\" (UID: \"27074431-e87c-47e8-9d5a-97fc6edcb13a\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:02:10 crc kubenswrapper[5120]: I0316 16:02:10.358224 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjx9k\" (UniqueName: \"kubernetes.io/projected/27074431-e87c-47e8-9d5a-97fc6edcb13a-kube-api-access-xjx9k\") pod \"cinder-api-0\" (UID: \"27074431-e87c-47e8-9d5a-97fc6edcb13a\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:02:10 crc kubenswrapper[5120]: I0316 16:02:10.358442 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8415e416-caeb-46b1-ad95-913c481d9335-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:02:10 crc kubenswrapper[5120]: I0316 16:02:10.358465 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8415e416-caeb-46b1-ad95-913c481d9335-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:02:10 crc kubenswrapper[5120]: I0316 16:02:10.358477 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8415e416-caeb-46b1-ad95-913c481d9335-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:02:10 crc kubenswrapper[5120]: I0316 16:02:10.358488 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qp7nc\" (UniqueName: \"kubernetes.io/projected/8415e416-caeb-46b1-ad95-913c481d9335-kube-api-access-qp7nc\") on node \"crc\" DevicePath \"\"" Mar 16 16:02:10 crc kubenswrapper[5120]: I0316 16:02:10.358500 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/8415e416-caeb-46b1-ad95-913c481d9335-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:02:10 crc kubenswrapper[5120]: I0316 16:02:10.459544 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/27074431-e87c-47e8-9d5a-97fc6edcb13a-config-data\") pod \"cinder-api-0\" (UID: \"27074431-e87c-47e8-9d5a-97fc6edcb13a\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:02:10 crc kubenswrapper[5120]: I0316 16:02:10.459577 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/27074431-e87c-47e8-9d5a-97fc6edcb13a-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"27074431-e87c-47e8-9d5a-97fc6edcb13a\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:02:10 crc kubenswrapper[5120]: I0316 16:02:10.459615 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/27074431-e87c-47e8-9d5a-97fc6edcb13a-logs\") pod \"cinder-api-0\" (UID: \"27074431-e87c-47e8-9d5a-97fc6edcb13a\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:02:10 crc kubenswrapper[5120]: I0316 16:02:10.459651 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xjx9k\" (UniqueName: \"kubernetes.io/projected/27074431-e87c-47e8-9d5a-97fc6edcb13a-kube-api-access-xjx9k\") pod \"cinder-api-0\" (UID: \"27074431-e87c-47e8-9d5a-97fc6edcb13a\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:02:10 crc kubenswrapper[5120]: I0316 16:02:10.459687 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/27074431-e87c-47e8-9d5a-97fc6edcb13a-etc-machine-id\") pod \"cinder-api-0\" (UID: \"27074431-e87c-47e8-9d5a-97fc6edcb13a\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:02:10 crc kubenswrapper[5120]: I0316 16:02:10.459713 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/27074431-e87c-47e8-9d5a-97fc6edcb13a-public-tls-certs\") pod \"cinder-api-0\" (UID: \"27074431-e87c-47e8-9d5a-97fc6edcb13a\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:02:10 crc kubenswrapper[5120]: I0316 16:02:10.459767 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/27074431-e87c-47e8-9d5a-97fc6edcb13a-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"27074431-e87c-47e8-9d5a-97fc6edcb13a\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:02:10 crc kubenswrapper[5120]: I0316 16:02:10.459818 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/27074431-e87c-47e8-9d5a-97fc6edcb13a-scripts\") pod \"cinder-api-0\" (UID: \"27074431-e87c-47e8-9d5a-97fc6edcb13a\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:02:10 crc kubenswrapper[5120]: I0316 16:02:10.459883 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/27074431-e87c-47e8-9d5a-97fc6edcb13a-config-data-custom\") pod \"cinder-api-0\" (UID: \"27074431-e87c-47e8-9d5a-97fc6edcb13a\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:02:10 crc kubenswrapper[5120]: I0316 16:02:10.464255 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/27074431-e87c-47e8-9d5a-97fc6edcb13a-etc-machine-id\") pod \"cinder-api-0\" (UID: \"27074431-e87c-47e8-9d5a-97fc6edcb13a\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:02:10 crc kubenswrapper[5120]: I0316 16:02:10.464691 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/27074431-e87c-47e8-9d5a-97fc6edcb13a-logs\") pod \"cinder-api-0\" (UID: \"27074431-e87c-47e8-9d5a-97fc6edcb13a\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:02:10 crc kubenswrapper[5120]: I0316 16:02:10.469345 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/27074431-e87c-47e8-9d5a-97fc6edcb13a-scripts\") pod \"cinder-api-0\" (UID: \"27074431-e87c-47e8-9d5a-97fc6edcb13a\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:02:10 crc kubenswrapper[5120]: I0316 16:02:10.469471 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/27074431-e87c-47e8-9d5a-97fc6edcb13a-config-data-custom\") pod \"cinder-api-0\" (UID: \"27074431-e87c-47e8-9d5a-97fc6edcb13a\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:02:10 crc kubenswrapper[5120]: I0316 16:02:10.469728 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/27074431-e87c-47e8-9d5a-97fc6edcb13a-config-data\") pod \"cinder-api-0\" (UID: \"27074431-e87c-47e8-9d5a-97fc6edcb13a\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:02:10 crc kubenswrapper[5120]: I0316 16:02:10.470277 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/27074431-e87c-47e8-9d5a-97fc6edcb13a-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"27074431-e87c-47e8-9d5a-97fc6edcb13a\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:02:10 crc kubenswrapper[5120]: I0316 16:02:10.474337 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/27074431-e87c-47e8-9d5a-97fc6edcb13a-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"27074431-e87c-47e8-9d5a-97fc6edcb13a\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:02:10 crc kubenswrapper[5120]: I0316 16:02:10.475280 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/27074431-e87c-47e8-9d5a-97fc6edcb13a-public-tls-certs\") pod \"cinder-api-0\" (UID: \"27074431-e87c-47e8-9d5a-97fc6edcb13a\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:02:10 crc kubenswrapper[5120]: I0316 16:02:10.493008 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:02:10 crc kubenswrapper[5120]: I0316 16:02:10.498584 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjx9k\" (UniqueName: \"kubernetes.io/projected/27074431-e87c-47e8-9d5a-97fc6edcb13a-kube-api-access-xjx9k\") pod \"cinder-api-0\" (UID: \"27074431-e87c-47e8-9d5a-97fc6edcb13a\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:02:10 crc kubenswrapper[5120]: I0316 16:02:10.521718 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:02:10 crc kubenswrapper[5120]: I0316 16:02:10.663968 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9e30c205-c2b2-4766-8777-6b2730f5172a-config-data\") pod \"9e30c205-c2b2-4766-8777-6b2730f5172a\" (UID: \"9e30c205-c2b2-4766-8777-6b2730f5172a\") " Mar 16 16:02:10 crc kubenswrapper[5120]: I0316 16:02:10.664255 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/9e30c205-c2b2-4766-8777-6b2730f5172a-etc-machine-id\") pod \"9e30c205-c2b2-4766-8777-6b2730f5172a\" (UID: \"9e30c205-c2b2-4766-8777-6b2730f5172a\") " Mar 16 16:02:10 crc kubenswrapper[5120]: I0316 16:02:10.664342 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/9e30c205-c2b2-4766-8777-6b2730f5172a-config-data-custom\") pod \"9e30c205-c2b2-4766-8777-6b2730f5172a\" (UID: \"9e30c205-c2b2-4766-8777-6b2730f5172a\") " Mar 16 16:02:10 crc kubenswrapper[5120]: I0316 16:02:10.664411 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9e30c205-c2b2-4766-8777-6b2730f5172a-scripts\") pod \"9e30c205-c2b2-4766-8777-6b2730f5172a\" (UID: \"9e30c205-c2b2-4766-8777-6b2730f5172a\") " Mar 16 16:02:10 crc kubenswrapper[5120]: I0316 16:02:10.664465 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/9e30c205-c2b2-4766-8777-6b2730f5172a-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "9e30c205-c2b2-4766-8777-6b2730f5172a" (UID: "9e30c205-c2b2-4766-8777-6b2730f5172a"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 16:02:10 crc kubenswrapper[5120]: I0316 16:02:10.664497 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rnccw\" (UniqueName: \"kubernetes.io/projected/9e30c205-c2b2-4766-8777-6b2730f5172a-kube-api-access-rnccw\") pod \"9e30c205-c2b2-4766-8777-6b2730f5172a\" (UID: \"9e30c205-c2b2-4766-8777-6b2730f5172a\") " Mar 16 16:02:10 crc kubenswrapper[5120]: I0316 16:02:10.664581 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9e30c205-c2b2-4766-8777-6b2730f5172a-combined-ca-bundle\") pod \"9e30c205-c2b2-4766-8777-6b2730f5172a\" (UID: \"9e30c205-c2b2-4766-8777-6b2730f5172a\") " Mar 16 16:02:10 crc kubenswrapper[5120]: I0316 16:02:10.665716 5120 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/9e30c205-c2b2-4766-8777-6b2730f5172a-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 16:02:10 crc kubenswrapper[5120]: I0316 16:02:10.677565 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e30c205-c2b2-4766-8777-6b2730f5172a-scripts" (OuterVolumeSpecName: "scripts") pod "9e30c205-c2b2-4766-8777-6b2730f5172a" (UID: "9e30c205-c2b2-4766-8777-6b2730f5172a"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:02:10 crc kubenswrapper[5120]: I0316 16:02:10.677689 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e30c205-c2b2-4766-8777-6b2730f5172a-kube-api-access-rnccw" (OuterVolumeSpecName: "kube-api-access-rnccw") pod "9e30c205-c2b2-4766-8777-6b2730f5172a" (UID: "9e30c205-c2b2-4766-8777-6b2730f5172a"). InnerVolumeSpecName "kube-api-access-rnccw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:02:10 crc kubenswrapper[5120]: I0316 16:02:10.680119 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e30c205-c2b2-4766-8777-6b2730f5172a-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "9e30c205-c2b2-4766-8777-6b2730f5172a" (UID: "9e30c205-c2b2-4766-8777-6b2730f5172a"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:02:10 crc kubenswrapper[5120]: I0316 16:02:10.692119 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3ac8d936-98a3-4922-ac56-1f0056b29125" path="/var/lib/kubelet/pods/3ac8d936-98a3-4922-ac56-1f0056b29125/volumes" Mar 16 16:02:10 crc kubenswrapper[5120]: I0316 16:02:10.693515 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e6f29e10-c540-416f-937a-0b0e8cbceef9" path="/var/lib/kubelet/pods/e6f29e10-c540-416f-937a-0b0e8cbceef9/volumes" Mar 16 16:02:10 crc kubenswrapper[5120]: I0316 16:02:10.744056 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"41237879-5c40-4f4b-ad6f-39dab45ba2d5","Type":"ContainerStarted","Data":"2f0ea56a5de0726897ddaaf22edcdae384e978440fa164de4d6a31de3aff53ea"} Mar 16 16:02:10 crc kubenswrapper[5120]: I0316 16:02:10.744112 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"41237879-5c40-4f4b-ad6f-39dab45ba2d5","Type":"ContainerStarted","Data":"97a826a51eb103ea1b5d81924af0f4938d6b6b44c9973278063663aee0498778"} Mar 16 16:02:10 crc kubenswrapper[5120]: I0316 16:02:10.749129 5120 generic.go:358] "Generic (PLEG): container finished" podID="9e30c205-c2b2-4766-8777-6b2730f5172a" containerID="caa993c16d00e0213f46cc2dd20ef499c77a1c238968d283caf8f4aa952d2319" exitCode=0 Mar 16 16:02:10 crc kubenswrapper[5120]: I0316 16:02:10.749243 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"9e30c205-c2b2-4766-8777-6b2730f5172a","Type":"ContainerDied","Data":"caa993c16d00e0213f46cc2dd20ef499c77a1c238968d283caf8f4aa952d2319"} Mar 16 16:02:10 crc kubenswrapper[5120]: I0316 16:02:10.749281 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"9e30c205-c2b2-4766-8777-6b2730f5172a","Type":"ContainerDied","Data":"bf307ffb39e68dbd309ed3b1774fabd6966bf4a532a57fb96ea6078bef606b0d"} Mar 16 16:02:10 crc kubenswrapper[5120]: I0316 16:02:10.749303 5120 scope.go:117] "RemoveContainer" containerID="3fb2f0ebaa9349fc31d1d61f88cf5c3160e366b347fc1b17e8366f0874ebfe72" Mar 16 16:02:10 crc kubenswrapper[5120]: I0316 16:02:10.749491 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:02:10 crc kubenswrapper[5120]: I0316 16:02:10.758135 5120 generic.go:358] "Generic (PLEG): container finished" podID="8415e416-caeb-46b1-ad95-913c481d9335" containerID="a9f3bbaa6d157c8b44e2073d34125e6cecd4b706eec44f92496c67c38574acbc" exitCode=143 Mar 16 16:02:10 crc kubenswrapper[5120]: I0316 16:02:10.758233 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-7764ff6fcd-vw2kr" event={"ID":"8415e416-caeb-46b1-ad95-913c481d9335","Type":"ContainerDied","Data":"a9f3bbaa6d157c8b44e2073d34125e6cecd4b706eec44f92496c67c38574acbc"} Mar 16 16:02:10 crc kubenswrapper[5120]: I0316 16:02:10.758275 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-7764ff6fcd-vw2kr" Mar 16 16:02:10 crc kubenswrapper[5120]: I0316 16:02:10.758282 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-7764ff6fcd-vw2kr" event={"ID":"8415e416-caeb-46b1-ad95-913c481d9335","Type":"ContainerDied","Data":"70628d6c6a0143459f9d057872a5fc4b6532595c62a8041e3ea65ae6136ae1e2"} Mar 16 16:02:10 crc kubenswrapper[5120]: I0316 16:02:10.764437 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e30c205-c2b2-4766-8777-6b2730f5172a-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "9e30c205-c2b2-4766-8777-6b2730f5172a" (UID: "9e30c205-c2b2-4766-8777-6b2730f5172a"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:02:10 crc kubenswrapper[5120]: I0316 16:02:10.767354 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/9e30c205-c2b2-4766-8777-6b2730f5172a-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:02:10 crc kubenswrapper[5120]: I0316 16:02:10.767635 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9e30c205-c2b2-4766-8777-6b2730f5172a-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:02:10 crc kubenswrapper[5120]: I0316 16:02:10.767648 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rnccw\" (UniqueName: \"kubernetes.io/projected/9e30c205-c2b2-4766-8777-6b2730f5172a-kube-api-access-rnccw\") on node \"crc\" DevicePath \"\"" Mar 16 16:02:10 crc kubenswrapper[5120]: I0316 16:02:10.767660 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9e30c205-c2b2-4766-8777-6b2730f5172a-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:02:10 crc kubenswrapper[5120]: I0316 16:02:10.817577 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e30c205-c2b2-4766-8777-6b2730f5172a-config-data" (OuterVolumeSpecName: "config-data") pod "9e30c205-c2b2-4766-8777-6b2730f5172a" (UID: "9e30c205-c2b2-4766-8777-6b2730f5172a"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:02:10 crc kubenswrapper[5120]: I0316 16:02:10.869042 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9e30c205-c2b2-4766-8777-6b2730f5172a-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:02:10 crc kubenswrapper[5120]: I0316 16:02:10.888882 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-7764ff6fcd-vw2kr"] Mar 16 16:02:10 crc kubenswrapper[5120]: I0316 16:02:10.896235 5120 scope.go:117] "RemoveContainer" containerID="caa993c16d00e0213f46cc2dd20ef499c77a1c238968d283caf8f4aa952d2319" Mar 16 16:02:10 crc kubenswrapper[5120]: I0316 16:02:10.898257 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-api-7764ff6fcd-vw2kr"] Mar 16 16:02:10 crc kubenswrapper[5120]: I0316 16:02:10.920922 5120 scope.go:117] "RemoveContainer" containerID="3fb2f0ebaa9349fc31d1d61f88cf5c3160e366b347fc1b17e8366f0874ebfe72" Mar 16 16:02:10 crc kubenswrapper[5120]: E0316 16:02:10.921366 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3fb2f0ebaa9349fc31d1d61f88cf5c3160e366b347fc1b17e8366f0874ebfe72\": container with ID starting with 3fb2f0ebaa9349fc31d1d61f88cf5c3160e366b347fc1b17e8366f0874ebfe72 not found: ID does not exist" containerID="3fb2f0ebaa9349fc31d1d61f88cf5c3160e366b347fc1b17e8366f0874ebfe72" Mar 16 16:02:10 crc kubenswrapper[5120]: I0316 16:02:10.921479 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3fb2f0ebaa9349fc31d1d61f88cf5c3160e366b347fc1b17e8366f0874ebfe72"} err="failed to get container status \"3fb2f0ebaa9349fc31d1d61f88cf5c3160e366b347fc1b17e8366f0874ebfe72\": rpc error: code = NotFound desc = could not find container \"3fb2f0ebaa9349fc31d1d61f88cf5c3160e366b347fc1b17e8366f0874ebfe72\": container with ID starting with 3fb2f0ebaa9349fc31d1d61f88cf5c3160e366b347fc1b17e8366f0874ebfe72 not found: ID does not exist" Mar 16 16:02:10 crc kubenswrapper[5120]: I0316 16:02:10.921601 5120 scope.go:117] "RemoveContainer" containerID="caa993c16d00e0213f46cc2dd20ef499c77a1c238968d283caf8f4aa952d2319" Mar 16 16:02:10 crc kubenswrapper[5120]: E0316 16:02:10.921930 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"caa993c16d00e0213f46cc2dd20ef499c77a1c238968d283caf8f4aa952d2319\": container with ID starting with caa993c16d00e0213f46cc2dd20ef499c77a1c238968d283caf8f4aa952d2319 not found: ID does not exist" containerID="caa993c16d00e0213f46cc2dd20ef499c77a1c238968d283caf8f4aa952d2319" Mar 16 16:02:10 crc kubenswrapper[5120]: I0316 16:02:10.922024 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"caa993c16d00e0213f46cc2dd20ef499c77a1c238968d283caf8f4aa952d2319"} err="failed to get container status \"caa993c16d00e0213f46cc2dd20ef499c77a1c238968d283caf8f4aa952d2319\": rpc error: code = NotFound desc = could not find container \"caa993c16d00e0213f46cc2dd20ef499c77a1c238968d283caf8f4aa952d2319\": container with ID starting with caa993c16d00e0213f46cc2dd20ef499c77a1c238968d283caf8f4aa952d2319 not found: ID does not exist" Mar 16 16:02:10 crc kubenswrapper[5120]: I0316 16:02:10.922092 5120 scope.go:117] "RemoveContainer" containerID="4041a1fd9f33db9374d18f6ef495d045f283669fd293a5fe9c26deec77744d37" Mar 16 16:02:10 crc kubenswrapper[5120]: I0316 16:02:10.958107 5120 scope.go:117] "RemoveContainer" containerID="a9f3bbaa6d157c8b44e2073d34125e6cecd4b706eec44f92496c67c38574acbc" Mar 16 16:02:10 crc kubenswrapper[5120]: I0316 16:02:10.992183 5120 scope.go:117] "RemoveContainer" containerID="4041a1fd9f33db9374d18f6ef495d045f283669fd293a5fe9c26deec77744d37" Mar 16 16:02:10 crc kubenswrapper[5120]: E0316 16:02:10.992900 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4041a1fd9f33db9374d18f6ef495d045f283669fd293a5fe9c26deec77744d37\": container with ID starting with 4041a1fd9f33db9374d18f6ef495d045f283669fd293a5fe9c26deec77744d37 not found: ID does not exist" containerID="4041a1fd9f33db9374d18f6ef495d045f283669fd293a5fe9c26deec77744d37" Mar 16 16:02:10 crc kubenswrapper[5120]: I0316 16:02:10.992932 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4041a1fd9f33db9374d18f6ef495d045f283669fd293a5fe9c26deec77744d37"} err="failed to get container status \"4041a1fd9f33db9374d18f6ef495d045f283669fd293a5fe9c26deec77744d37\": rpc error: code = NotFound desc = could not find container \"4041a1fd9f33db9374d18f6ef495d045f283669fd293a5fe9c26deec77744d37\": container with ID starting with 4041a1fd9f33db9374d18f6ef495d045f283669fd293a5fe9c26deec77744d37 not found: ID does not exist" Mar 16 16:02:10 crc kubenswrapper[5120]: I0316 16:02:10.992953 5120 scope.go:117] "RemoveContainer" containerID="a9f3bbaa6d157c8b44e2073d34125e6cecd4b706eec44f92496c67c38574acbc" Mar 16 16:02:10 crc kubenswrapper[5120]: E0316 16:02:10.993325 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a9f3bbaa6d157c8b44e2073d34125e6cecd4b706eec44f92496c67c38574acbc\": container with ID starting with a9f3bbaa6d157c8b44e2073d34125e6cecd4b706eec44f92496c67c38574acbc not found: ID does not exist" containerID="a9f3bbaa6d157c8b44e2073d34125e6cecd4b706eec44f92496c67c38574acbc" Mar 16 16:02:10 crc kubenswrapper[5120]: I0316 16:02:10.993367 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9f3bbaa6d157c8b44e2073d34125e6cecd4b706eec44f92496c67c38574acbc"} err="failed to get container status \"a9f3bbaa6d157c8b44e2073d34125e6cecd4b706eec44f92496c67c38574acbc\": rpc error: code = NotFound desc = could not find container \"a9f3bbaa6d157c8b44e2073d34125e6cecd4b706eec44f92496c67c38574acbc\": container with ID starting with a9f3bbaa6d157c8b44e2073d34125e6cecd4b706eec44f92496c67c38574acbc not found: ID does not exist" Mar 16 16:02:11 crc kubenswrapper[5120]: I0316 16:02:11.031983 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:02:11 crc kubenswrapper[5120]: W0316 16:02:11.037553 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod27074431_e87c_47e8_9d5a_97fc6edcb13a.slice/crio-0b0a886e91191272e2fed5bbd9f8f29756b048f2e82dd951289143d46a8a3b9b WatchSource:0}: Error finding container 0b0a886e91191272e2fed5bbd9f8f29756b048f2e82dd951289143d46a8a3b9b: Status 404 returned error can't find the container with id 0b0a886e91191272e2fed5bbd9f8f29756b048f2e82dd951289143d46a8a3b9b Mar 16 16:02:11 crc kubenswrapper[5120]: I0316 16:02:11.112823 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:02:11 crc kubenswrapper[5120]: I0316 16:02:11.133194 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:02:11 crc kubenswrapper[5120]: I0316 16:02:11.157454 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:02:11 crc kubenswrapper[5120]: I0316 16:02:11.159008 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8415e416-caeb-46b1-ad95-913c481d9335" containerName="barbican-api" Mar 16 16:02:11 crc kubenswrapper[5120]: I0316 16:02:11.159040 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8415e416-caeb-46b1-ad95-913c481d9335" containerName="barbican-api" Mar 16 16:02:11 crc kubenswrapper[5120]: I0316 16:02:11.159064 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e30c205-c2b2-4766-8777-6b2730f5172a" containerName="cinder-scheduler" Mar 16 16:02:11 crc kubenswrapper[5120]: I0316 16:02:11.159073 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e30c205-c2b2-4766-8777-6b2730f5172a" containerName="cinder-scheduler" Mar 16 16:02:11 crc kubenswrapper[5120]: I0316 16:02:11.159112 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e30c205-c2b2-4766-8777-6b2730f5172a" containerName="probe" Mar 16 16:02:11 crc kubenswrapper[5120]: I0316 16:02:11.159122 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e30c205-c2b2-4766-8777-6b2730f5172a" containerName="probe" Mar 16 16:02:11 crc kubenswrapper[5120]: I0316 16:02:11.159132 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8415e416-caeb-46b1-ad95-913c481d9335" containerName="barbican-api-log" Mar 16 16:02:11 crc kubenswrapper[5120]: I0316 16:02:11.159140 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8415e416-caeb-46b1-ad95-913c481d9335" containerName="barbican-api-log" Mar 16 16:02:11 crc kubenswrapper[5120]: I0316 16:02:11.159366 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="8415e416-caeb-46b1-ad95-913c481d9335" containerName="barbican-api-log" Mar 16 16:02:11 crc kubenswrapper[5120]: I0316 16:02:11.159395 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="9e30c205-c2b2-4766-8777-6b2730f5172a" containerName="cinder-scheduler" Mar 16 16:02:11 crc kubenswrapper[5120]: I0316 16:02:11.159410 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="9e30c205-c2b2-4766-8777-6b2730f5172a" containerName="probe" Mar 16 16:02:11 crc kubenswrapper[5120]: I0316 16:02:11.159428 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="8415e416-caeb-46b1-ad95-913c481d9335" containerName="barbican-api" Mar 16 16:02:11 crc kubenswrapper[5120]: I0316 16:02:11.167366 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:02:11 crc kubenswrapper[5120]: I0316 16:02:11.169492 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-scheduler-config-data\"" Mar 16 16:02:11 crc kubenswrapper[5120]: I0316 16:02:11.172363 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:02:11 crc kubenswrapper[5120]: I0316 16:02:11.278311 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/18b99335-9d0e-44a5-a6d6-a8ffe17ccd05-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"18b99335-9d0e-44a5-a6d6-a8ffe17ccd05\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:02:11 crc kubenswrapper[5120]: I0316 16:02:11.278570 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/18b99335-9d0e-44a5-a6d6-a8ffe17ccd05-config-data\") pod \"cinder-scheduler-0\" (UID: \"18b99335-9d0e-44a5-a6d6-a8ffe17ccd05\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:02:11 crc kubenswrapper[5120]: I0316 16:02:11.278630 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxr46\" (UniqueName: \"kubernetes.io/projected/18b99335-9d0e-44a5-a6d6-a8ffe17ccd05-kube-api-access-mxr46\") pod \"cinder-scheduler-0\" (UID: \"18b99335-9d0e-44a5-a6d6-a8ffe17ccd05\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:02:11 crc kubenswrapper[5120]: I0316 16:02:11.278690 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/18b99335-9d0e-44a5-a6d6-a8ffe17ccd05-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"18b99335-9d0e-44a5-a6d6-a8ffe17ccd05\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:02:11 crc kubenswrapper[5120]: I0316 16:02:11.278818 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/18b99335-9d0e-44a5-a6d6-a8ffe17ccd05-scripts\") pod \"cinder-scheduler-0\" (UID: \"18b99335-9d0e-44a5-a6d6-a8ffe17ccd05\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:02:11 crc kubenswrapper[5120]: I0316 16:02:11.278882 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/18b99335-9d0e-44a5-a6d6-a8ffe17ccd05-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"18b99335-9d0e-44a5-a6d6-a8ffe17ccd05\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:02:11 crc kubenswrapper[5120]: I0316 16:02:11.380846 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/18b99335-9d0e-44a5-a6d6-a8ffe17ccd05-config-data\") pod \"cinder-scheduler-0\" (UID: \"18b99335-9d0e-44a5-a6d6-a8ffe17ccd05\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:02:11 crc kubenswrapper[5120]: I0316 16:02:11.380926 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mxr46\" (UniqueName: \"kubernetes.io/projected/18b99335-9d0e-44a5-a6d6-a8ffe17ccd05-kube-api-access-mxr46\") pod \"cinder-scheduler-0\" (UID: \"18b99335-9d0e-44a5-a6d6-a8ffe17ccd05\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:02:11 crc kubenswrapper[5120]: I0316 16:02:11.380985 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/18b99335-9d0e-44a5-a6d6-a8ffe17ccd05-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"18b99335-9d0e-44a5-a6d6-a8ffe17ccd05\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:02:11 crc kubenswrapper[5120]: I0316 16:02:11.381045 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/18b99335-9d0e-44a5-a6d6-a8ffe17ccd05-scripts\") pod \"cinder-scheduler-0\" (UID: \"18b99335-9d0e-44a5-a6d6-a8ffe17ccd05\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:02:11 crc kubenswrapper[5120]: I0316 16:02:11.381106 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/18b99335-9d0e-44a5-a6d6-a8ffe17ccd05-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"18b99335-9d0e-44a5-a6d6-a8ffe17ccd05\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:02:11 crc kubenswrapper[5120]: I0316 16:02:11.381151 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/18b99335-9d0e-44a5-a6d6-a8ffe17ccd05-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"18b99335-9d0e-44a5-a6d6-a8ffe17ccd05\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:02:11 crc kubenswrapper[5120]: I0316 16:02:11.381225 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/18b99335-9d0e-44a5-a6d6-a8ffe17ccd05-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"18b99335-9d0e-44a5-a6d6-a8ffe17ccd05\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:02:11 crc kubenswrapper[5120]: I0316 16:02:11.385307 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/18b99335-9d0e-44a5-a6d6-a8ffe17ccd05-scripts\") pod \"cinder-scheduler-0\" (UID: \"18b99335-9d0e-44a5-a6d6-a8ffe17ccd05\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:02:11 crc kubenswrapper[5120]: I0316 16:02:11.385774 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/18b99335-9d0e-44a5-a6d6-a8ffe17ccd05-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"18b99335-9d0e-44a5-a6d6-a8ffe17ccd05\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:02:11 crc kubenswrapper[5120]: I0316 16:02:11.386541 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/18b99335-9d0e-44a5-a6d6-a8ffe17ccd05-config-data\") pod \"cinder-scheduler-0\" (UID: \"18b99335-9d0e-44a5-a6d6-a8ffe17ccd05\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:02:11 crc kubenswrapper[5120]: I0316 16:02:11.387438 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/18b99335-9d0e-44a5-a6d6-a8ffe17ccd05-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"18b99335-9d0e-44a5-a6d6-a8ffe17ccd05\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:02:11 crc kubenswrapper[5120]: I0316 16:02:11.398120 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxr46\" (UniqueName: \"kubernetes.io/projected/18b99335-9d0e-44a5-a6d6-a8ffe17ccd05-kube-api-access-mxr46\") pod \"cinder-scheduler-0\" (UID: \"18b99335-9d0e-44a5-a6d6-a8ffe17ccd05\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:02:11 crc kubenswrapper[5120]: I0316 16:02:11.488907 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:02:11 crc kubenswrapper[5120]: I0316 16:02:11.779398 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"41237879-5c40-4f4b-ad6f-39dab45ba2d5","Type":"ContainerStarted","Data":"c7e01ef8a3e8a351182b7ad447cfd063af28c5831169928ef5c7e3d7d27fe70b"} Mar 16 16:02:11 crc kubenswrapper[5120]: I0316 16:02:11.788622 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"27074431-e87c-47e8-9d5a-97fc6edcb13a","Type":"ContainerStarted","Data":"0b0a886e91191272e2fed5bbd9f8f29756b048f2e82dd951289143d46a8a3b9b"} Mar 16 16:02:11 crc kubenswrapper[5120]: I0316 16:02:11.789981 5120 generic.go:358] "Generic (PLEG): container finished" podID="1daafc71-9f0a-4fe4-953c-1e00eab0fbfa" containerID="0a94c712529cb8bf1ddc356c590201952132d947f6665514c06c7392f23c8bf7" exitCode=0 Mar 16 16:02:11 crc kubenswrapper[5120]: I0316 16:02:11.790059 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-5cddcbb4cf-kdhzk" event={"ID":"1daafc71-9f0a-4fe4-953c-1e00eab0fbfa","Type":"ContainerDied","Data":"0a94c712529cb8bf1ddc356c590201952132d947f6665514c06c7392f23c8bf7"} Mar 16 16:02:11 crc kubenswrapper[5120]: I0316 16:02:11.933706 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-5cddcbb4cf-kdhzk" Mar 16 16:02:11 crc kubenswrapper[5120]: I0316 16:02:11.976363 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:02:12 crc kubenswrapper[5120]: I0316 16:02:12.015005 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/1daafc71-9f0a-4fe4-953c-1e00eab0fbfa-config-data-custom\") pod \"1daafc71-9f0a-4fe4-953c-1e00eab0fbfa\" (UID: \"1daafc71-9f0a-4fe4-953c-1e00eab0fbfa\") " Mar 16 16:02:12 crc kubenswrapper[5120]: I0316 16:02:12.015388 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5vqrh\" (UniqueName: \"kubernetes.io/projected/1daafc71-9f0a-4fe4-953c-1e00eab0fbfa-kube-api-access-5vqrh\") pod \"1daafc71-9f0a-4fe4-953c-1e00eab0fbfa\" (UID: \"1daafc71-9f0a-4fe4-953c-1e00eab0fbfa\") " Mar 16 16:02:12 crc kubenswrapper[5120]: I0316 16:02:12.015459 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1daafc71-9f0a-4fe4-953c-1e00eab0fbfa-config-data\") pod \"1daafc71-9f0a-4fe4-953c-1e00eab0fbfa\" (UID: \"1daafc71-9f0a-4fe4-953c-1e00eab0fbfa\") " Mar 16 16:02:12 crc kubenswrapper[5120]: I0316 16:02:12.015514 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/1daafc71-9f0a-4fe4-953c-1e00eab0fbfa-logs\") pod \"1daafc71-9f0a-4fe4-953c-1e00eab0fbfa\" (UID: \"1daafc71-9f0a-4fe4-953c-1e00eab0fbfa\") " Mar 16 16:02:12 crc kubenswrapper[5120]: I0316 16:02:12.015581 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1daafc71-9f0a-4fe4-953c-1e00eab0fbfa-combined-ca-bundle\") pod \"1daafc71-9f0a-4fe4-953c-1e00eab0fbfa\" (UID: \"1daafc71-9f0a-4fe4-953c-1e00eab0fbfa\") " Mar 16 16:02:12 crc kubenswrapper[5120]: I0316 16:02:12.016206 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1daafc71-9f0a-4fe4-953c-1e00eab0fbfa-logs" (OuterVolumeSpecName: "logs") pod "1daafc71-9f0a-4fe4-953c-1e00eab0fbfa" (UID: "1daafc71-9f0a-4fe4-953c-1e00eab0fbfa"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:02:12 crc kubenswrapper[5120]: I0316 16:02:12.019491 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1daafc71-9f0a-4fe4-953c-1e00eab0fbfa-kube-api-access-5vqrh" (OuterVolumeSpecName: "kube-api-access-5vqrh") pod "1daafc71-9f0a-4fe4-953c-1e00eab0fbfa" (UID: "1daafc71-9f0a-4fe4-953c-1e00eab0fbfa"). InnerVolumeSpecName "kube-api-access-5vqrh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:02:12 crc kubenswrapper[5120]: I0316 16:02:12.019851 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1daafc71-9f0a-4fe4-953c-1e00eab0fbfa-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "1daafc71-9f0a-4fe4-953c-1e00eab0fbfa" (UID: "1daafc71-9f0a-4fe4-953c-1e00eab0fbfa"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:02:12 crc kubenswrapper[5120]: I0316 16:02:12.039737 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1daafc71-9f0a-4fe4-953c-1e00eab0fbfa-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "1daafc71-9f0a-4fe4-953c-1e00eab0fbfa" (UID: "1daafc71-9f0a-4fe4-953c-1e00eab0fbfa"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:02:12 crc kubenswrapper[5120]: I0316 16:02:12.065217 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1daafc71-9f0a-4fe4-953c-1e00eab0fbfa-config-data" (OuterVolumeSpecName: "config-data") pod "1daafc71-9f0a-4fe4-953c-1e00eab0fbfa" (UID: "1daafc71-9f0a-4fe4-953c-1e00eab0fbfa"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:02:12 crc kubenswrapper[5120]: I0316 16:02:12.117259 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/1daafc71-9f0a-4fe4-953c-1e00eab0fbfa-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:02:12 crc kubenswrapper[5120]: I0316 16:02:12.117301 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5vqrh\" (UniqueName: \"kubernetes.io/projected/1daafc71-9f0a-4fe4-953c-1e00eab0fbfa-kube-api-access-5vqrh\") on node \"crc\" DevicePath \"\"" Mar 16 16:02:12 crc kubenswrapper[5120]: I0316 16:02:12.117313 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1daafc71-9f0a-4fe4-953c-1e00eab0fbfa-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:02:12 crc kubenswrapper[5120]: I0316 16:02:12.117321 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/1daafc71-9f0a-4fe4-953c-1e00eab0fbfa-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:02:12 crc kubenswrapper[5120]: I0316 16:02:12.117329 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1daafc71-9f0a-4fe4-953c-1e00eab0fbfa-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:02:12 crc kubenswrapper[5120]: I0316 16:02:12.677005 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8415e416-caeb-46b1-ad95-913c481d9335" path="/var/lib/kubelet/pods/8415e416-caeb-46b1-ad95-913c481d9335/volumes" Mar 16 16:02:12 crc kubenswrapper[5120]: I0316 16:02:12.677910 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9e30c205-c2b2-4766-8777-6b2730f5172a" path="/var/lib/kubelet/pods/9e30c205-c2b2-4766-8777-6b2730f5172a/volumes" Mar 16 16:02:12 crc kubenswrapper[5120]: I0316 16:02:12.810473 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"41237879-5c40-4f4b-ad6f-39dab45ba2d5","Type":"ContainerStarted","Data":"b84a927664ad8c9691c79d3bfb344d69ca2e8aa82fef990853248665318ff473"} Mar 16 16:02:12 crc kubenswrapper[5120]: I0316 16:02:12.815049 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"18b99335-9d0e-44a5-a6d6-a8ffe17ccd05","Type":"ContainerStarted","Data":"99feac53e678997bd71ad825e2c6c0ef61222639fa34f589c99f7cc46fab6cee"} Mar 16 16:02:12 crc kubenswrapper[5120]: I0316 16:02:12.815096 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"18b99335-9d0e-44a5-a6d6-a8ffe17ccd05","Type":"ContainerStarted","Data":"8c92e3faf6f2743c160652cefbc3429c7e86c6da358fbef6a3e7a62346d53d89"} Mar 16 16:02:12 crc kubenswrapper[5120]: I0316 16:02:12.832869 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"27074431-e87c-47e8-9d5a-97fc6edcb13a","Type":"ContainerStarted","Data":"67742b8daeb25edbf24bf7d11c17631616825891f277c6d8ea5023f5f01fa709"} Mar 16 16:02:12 crc kubenswrapper[5120]: I0316 16:02:12.832916 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"27074431-e87c-47e8-9d5a-97fc6edcb13a","Type":"ContainerStarted","Data":"a9c198c5fde8f1516c2c97543c1c28b24b2488b249ed434453537e04cab35001"} Mar 16 16:02:12 crc kubenswrapper[5120]: I0316 16:02:12.833051 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:02:12 crc kubenswrapper[5120]: I0316 16:02:12.843127 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-5cddcbb4cf-kdhzk" event={"ID":"1daafc71-9f0a-4fe4-953c-1e00eab0fbfa","Type":"ContainerDied","Data":"0a7a9ae679a36fd51a38c417e5abb1bbc39c72fb1ba04aca4924ed3304f11aae"} Mar 16 16:02:12 crc kubenswrapper[5120]: I0316 16:02:12.843181 5120 scope.go:117] "RemoveContainer" containerID="0a94c712529cb8bf1ddc356c590201952132d947f6665514c06c7392f23c8bf7" Mar 16 16:02:12 crc kubenswrapper[5120]: I0316 16:02:12.843353 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-5cddcbb4cf-kdhzk" Mar 16 16:02:12 crc kubenswrapper[5120]: I0316 16:02:12.862548 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-api-0" podStartSLOduration=2.862522712 podStartE2EDuration="2.862522712s" podCreationTimestamp="2026-03-16 16:02:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:02:12.848615219 +0000 UTC m=+1835.002546886" watchObservedRunningTime="2026-03-16 16:02:12.862522712 +0000 UTC m=+1835.016454379" Mar 16 16:02:12 crc kubenswrapper[5120]: I0316 16:02:12.883825 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-5cddcbb4cf-kdhzk"] Mar 16 16:02:12 crc kubenswrapper[5120]: I0316 16:02:12.889702 5120 scope.go:117] "RemoveContainer" containerID="5dbfdd92dc8c04f1b01cb39317fa31ce9267d193611d555f654b75d0820e48f3" Mar 16 16:02:12 crc kubenswrapper[5120]: I0316 16:02:12.891932 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-worker-5cddcbb4cf-kdhzk"] Mar 16 16:02:13 crc kubenswrapper[5120]: I0316 16:02:13.859490 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"18b99335-9d0e-44a5-a6d6-a8ffe17ccd05","Type":"ContainerStarted","Data":"27fb86bc3c9d5fdfd0c0e9eb50972c65626d46f8fbbde0a14f84fbb04c64e79c"} Mar 16 16:02:13 crc kubenswrapper[5120]: I0316 16:02:13.892742 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-scheduler-0" podStartSLOduration=2.892721716 podStartE2EDuration="2.892721716s" podCreationTimestamp="2026-03-16 16:02:11 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:02:13.885085655 +0000 UTC m=+1836.039017312" watchObservedRunningTime="2026-03-16 16:02:13.892721716 +0000 UTC m=+1836.046653373" Mar 16 16:02:14 crc kubenswrapper[5120]: I0316 16:02:14.379861 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-5c58fd7f58-mlf64" Mar 16 16:02:14 crc kubenswrapper[5120]: I0316 16:02:14.471934 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/c6827071-9f0c-4934-a287-e8c5797c390b-config-data-custom\") pod \"c6827071-9f0c-4934-a287-e8c5797c390b\" (UID: \"c6827071-9f0c-4934-a287-e8c5797c390b\") " Mar 16 16:02:14 crc kubenswrapper[5120]: I0316 16:02:14.472017 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c6827071-9f0c-4934-a287-e8c5797c390b-combined-ca-bundle\") pod \"c6827071-9f0c-4934-a287-e8c5797c390b\" (UID: \"c6827071-9f0c-4934-a287-e8c5797c390b\") " Mar 16 16:02:14 crc kubenswrapper[5120]: I0316 16:02:14.472175 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c6827071-9f0c-4934-a287-e8c5797c390b-logs\") pod \"c6827071-9f0c-4934-a287-e8c5797c390b\" (UID: \"c6827071-9f0c-4934-a287-e8c5797c390b\") " Mar 16 16:02:14 crc kubenswrapper[5120]: I0316 16:02:14.472328 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c6827071-9f0c-4934-a287-e8c5797c390b-config-data\") pod \"c6827071-9f0c-4934-a287-e8c5797c390b\" (UID: \"c6827071-9f0c-4934-a287-e8c5797c390b\") " Mar 16 16:02:14 crc kubenswrapper[5120]: I0316 16:02:14.472350 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p98dw\" (UniqueName: \"kubernetes.io/projected/c6827071-9f0c-4934-a287-e8c5797c390b-kube-api-access-p98dw\") pod \"c6827071-9f0c-4934-a287-e8c5797c390b\" (UID: \"c6827071-9f0c-4934-a287-e8c5797c390b\") " Mar 16 16:02:14 crc kubenswrapper[5120]: I0316 16:02:14.474232 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6827071-9f0c-4934-a287-e8c5797c390b-logs" (OuterVolumeSpecName: "logs") pod "c6827071-9f0c-4934-a287-e8c5797c390b" (UID: "c6827071-9f0c-4934-a287-e8c5797c390b"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:02:14 crc kubenswrapper[5120]: I0316 16:02:14.481910 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c6827071-9f0c-4934-a287-e8c5797c390b-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "c6827071-9f0c-4934-a287-e8c5797c390b" (UID: "c6827071-9f0c-4934-a287-e8c5797c390b"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:02:14 crc kubenswrapper[5120]: I0316 16:02:14.489085 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6827071-9f0c-4934-a287-e8c5797c390b-kube-api-access-p98dw" (OuterVolumeSpecName: "kube-api-access-p98dw") pod "c6827071-9f0c-4934-a287-e8c5797c390b" (UID: "c6827071-9f0c-4934-a287-e8c5797c390b"). InnerVolumeSpecName "kube-api-access-p98dw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:02:14 crc kubenswrapper[5120]: I0316 16:02:14.543023 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c6827071-9f0c-4934-a287-e8c5797c390b-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "c6827071-9f0c-4934-a287-e8c5797c390b" (UID: "c6827071-9f0c-4934-a287-e8c5797c390b"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:02:14 crc kubenswrapper[5120]: I0316 16:02:14.562941 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c6827071-9f0c-4934-a287-e8c5797c390b-config-data" (OuterVolumeSpecName: "config-data") pod "c6827071-9f0c-4934-a287-e8c5797c390b" (UID: "c6827071-9f0c-4934-a287-e8c5797c390b"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:02:14 crc kubenswrapper[5120]: I0316 16:02:14.574542 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/c6827071-9f0c-4934-a287-e8c5797c390b-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:02:14 crc kubenswrapper[5120]: I0316 16:02:14.574572 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c6827071-9f0c-4934-a287-e8c5797c390b-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:02:14 crc kubenswrapper[5120]: I0316 16:02:14.574580 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c6827071-9f0c-4934-a287-e8c5797c390b-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:02:14 crc kubenswrapper[5120]: I0316 16:02:14.574589 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c6827071-9f0c-4934-a287-e8c5797c390b-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:02:14 crc kubenswrapper[5120]: I0316 16:02:14.574612 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p98dw\" (UniqueName: \"kubernetes.io/projected/c6827071-9f0c-4934-a287-e8c5797c390b-kube-api-access-p98dw\") on node \"crc\" DevicePath \"\"" Mar 16 16:02:14 crc kubenswrapper[5120]: I0316 16:02:14.684224 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1daafc71-9f0a-4fe4-953c-1e00eab0fbfa" path="/var/lib/kubelet/pods/1daafc71-9f0a-4fe4-953c-1e00eab0fbfa/volumes" Mar 16 16:02:14 crc kubenswrapper[5120]: I0316 16:02:14.877109 5120 generic.go:358] "Generic (PLEG): container finished" podID="c6827071-9f0c-4934-a287-e8c5797c390b" containerID="d91421927778a07c9c37a08ed8e999b4757e0ecdfe9406c6ece2e2ed38961bb9" exitCode=0 Mar 16 16:02:14 crc kubenswrapper[5120]: I0316 16:02:14.877518 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-5c58fd7f58-mlf64" event={"ID":"c6827071-9f0c-4934-a287-e8c5797c390b","Type":"ContainerDied","Data":"d91421927778a07c9c37a08ed8e999b4757e0ecdfe9406c6ece2e2ed38961bb9"} Mar 16 16:02:14 crc kubenswrapper[5120]: I0316 16:02:14.877604 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-5c58fd7f58-mlf64" event={"ID":"c6827071-9f0c-4934-a287-e8c5797c390b","Type":"ContainerDied","Data":"f79645748efcd2e49ec0b2c1b5f60c1ac7e7366822c9924ba60e8465efd385f8"} Mar 16 16:02:14 crc kubenswrapper[5120]: I0316 16:02:14.877635 5120 scope.go:117] "RemoveContainer" containerID="d91421927778a07c9c37a08ed8e999b4757e0ecdfe9406c6ece2e2ed38961bb9" Mar 16 16:02:14 crc kubenswrapper[5120]: I0316 16:02:14.877842 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-5c58fd7f58-mlf64" Mar 16 16:02:14 crc kubenswrapper[5120]: I0316 16:02:14.891390 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"41237879-5c40-4f4b-ad6f-39dab45ba2d5","Type":"ContainerStarted","Data":"afe5dec266570eb41825b0c918ca41d10d6fe21669149ad76a5ea2fa6e5d12e8"} Mar 16 16:02:14 crc kubenswrapper[5120]: I0316 16:02:14.891541 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:02:14 crc kubenswrapper[5120]: I0316 16:02:14.905003 5120 scope.go:117] "RemoveContainer" containerID="c3c4123b5cbd0d36089b7b23b6870cba5e52d6959fe0b7e7a2e2ddfae762753a" Mar 16 16:02:14 crc kubenswrapper[5120]: I0316 16:02:14.911547 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-5c58fd7f58-mlf64"] Mar 16 16:02:14 crc kubenswrapper[5120]: I0316 16:02:14.921594 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-5c58fd7f58-mlf64"] Mar 16 16:02:14 crc kubenswrapper[5120]: I0316 16:02:14.936719 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.5195131760000002 podStartE2EDuration="6.936700528s" podCreationTimestamp="2026-03-16 16:02:08 +0000 UTC" firstStartedPulling="2026-03-16 16:02:09.849937148 +0000 UTC m=+1832.003868795" lastFinishedPulling="2026-03-16 16:02:14.26712449 +0000 UTC m=+1836.421056147" observedRunningTime="2026-03-16 16:02:14.92840489 +0000 UTC m=+1837.082336567" watchObservedRunningTime="2026-03-16 16:02:14.936700528 +0000 UTC m=+1837.090632185" Mar 16 16:02:14 crc kubenswrapper[5120]: I0316 16:02:14.937127 5120 scope.go:117] "RemoveContainer" containerID="d91421927778a07c9c37a08ed8e999b4757e0ecdfe9406c6ece2e2ed38961bb9" Mar 16 16:02:14 crc kubenswrapper[5120]: E0316 16:02:14.937569 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d91421927778a07c9c37a08ed8e999b4757e0ecdfe9406c6ece2e2ed38961bb9\": container with ID starting with d91421927778a07c9c37a08ed8e999b4757e0ecdfe9406c6ece2e2ed38961bb9 not found: ID does not exist" containerID="d91421927778a07c9c37a08ed8e999b4757e0ecdfe9406c6ece2e2ed38961bb9" Mar 16 16:02:14 crc kubenswrapper[5120]: I0316 16:02:14.937606 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d91421927778a07c9c37a08ed8e999b4757e0ecdfe9406c6ece2e2ed38961bb9"} err="failed to get container status \"d91421927778a07c9c37a08ed8e999b4757e0ecdfe9406c6ece2e2ed38961bb9\": rpc error: code = NotFound desc = could not find container \"d91421927778a07c9c37a08ed8e999b4757e0ecdfe9406c6ece2e2ed38961bb9\": container with ID starting with d91421927778a07c9c37a08ed8e999b4757e0ecdfe9406c6ece2e2ed38961bb9 not found: ID does not exist" Mar 16 16:02:14 crc kubenswrapper[5120]: I0316 16:02:14.937628 5120 scope.go:117] "RemoveContainer" containerID="c3c4123b5cbd0d36089b7b23b6870cba5e52d6959fe0b7e7a2e2ddfae762753a" Mar 16 16:02:14 crc kubenswrapper[5120]: E0316 16:02:14.937936 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c3c4123b5cbd0d36089b7b23b6870cba5e52d6959fe0b7e7a2e2ddfae762753a\": container with ID starting with c3c4123b5cbd0d36089b7b23b6870cba5e52d6959fe0b7e7a2e2ddfae762753a not found: ID does not exist" containerID="c3c4123b5cbd0d36089b7b23b6870cba5e52d6959fe0b7e7a2e2ddfae762753a" Mar 16 16:02:14 crc kubenswrapper[5120]: I0316 16:02:14.937979 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3c4123b5cbd0d36089b7b23b6870cba5e52d6959fe0b7e7a2e2ddfae762753a"} err="failed to get container status \"c3c4123b5cbd0d36089b7b23b6870cba5e52d6959fe0b7e7a2e2ddfae762753a\": rpc error: code = NotFound desc = could not find container \"c3c4123b5cbd0d36089b7b23b6870cba5e52d6959fe0b7e7a2e2ddfae762753a\": container with ID starting with c3c4123b5cbd0d36089b7b23b6870cba5e52d6959fe0b7e7a2e2ddfae762753a not found: ID does not exist" Mar 16 16:02:15 crc kubenswrapper[5120]: I0316 16:02:15.664292 5120 scope.go:117] "RemoveContainer" containerID="02ba4fc3f84eccaecfa9e6618280f65626eb76580c4af9ae7a9d7cb3b8dd590b" Mar 16 16:02:15 crc kubenswrapper[5120]: E0316 16:02:15.665396 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:02:16 crc kubenswrapper[5120]: I0316 16:02:16.489348 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:02:16 crc kubenswrapper[5120]: I0316 16:02:16.678971 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c6827071-9f0c-4934-a287-e8c5797c390b" path="/var/lib/kubelet/pods/c6827071-9f0c-4934-a287-e8c5797c390b/volumes" Mar 16 16:02:18 crc kubenswrapper[5120]: I0316 16:02:18.165159 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-5dd49d988b-vcz2l" Mar 16 16:02:18 crc kubenswrapper[5120]: I0316 16:02:18.165573 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-5dd49d988b-vcz2l" Mar 16 16:02:18 crc kubenswrapper[5120]: I0316 16:02:18.271288 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-f5cb49f4b-mkrgf"] Mar 16 16:02:18 crc kubenswrapper[5120]: I0316 16:02:18.271883 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-f5cb49f4b-mkrgf" podUID="a1a6ef57-0689-4731-8c35-b337908ae72b" containerName="barbican-api-log" containerID="cri-o://fad15cdcf9dfe90af4f387d9ff64f4894ba5d311cc01c07b0b4676be0a50bbe3" gracePeriod=30 Mar 16 16:02:18 crc kubenswrapper[5120]: I0316 16:02:18.271938 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-f5cb49f4b-mkrgf" podUID="a1a6ef57-0689-4731-8c35-b337908ae72b" containerName="barbican-api" containerID="cri-o://54d86f0b2ac28c4834d76c20795d47c7b66bc155f7faed9a7d0cd5069987b642" gracePeriod=30 Mar 16 16:02:18 crc kubenswrapper[5120]: I0316 16:02:18.944908 5120 generic.go:358] "Generic (PLEG): container finished" podID="a1a6ef57-0689-4731-8c35-b337908ae72b" containerID="fad15cdcf9dfe90af4f387d9ff64f4894ba5d311cc01c07b0b4676be0a50bbe3" exitCode=143 Mar 16 16:02:18 crc kubenswrapper[5120]: I0316 16:02:18.944993 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-f5cb49f4b-mkrgf" event={"ID":"a1a6ef57-0689-4731-8c35-b337908ae72b","Type":"ContainerDied","Data":"fad15cdcf9dfe90af4f387d9ff64f4894ba5d311cc01c07b0b4676be0a50bbe3"} Mar 16 16:02:20 crc kubenswrapper[5120]: I0316 16:02:20.656050 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:02:21 crc kubenswrapper[5120]: I0316 16:02:21.439520 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-f5cb49f4b-mkrgf" podUID="a1a6ef57-0689-4731-8c35-b337908ae72b" containerName="barbican-api-log" probeResult="failure" output="Get \"http://10.217.1.116:9311/healthcheck\": read tcp 10.217.0.2:46042->10.217.1.116:9311: read: connection reset by peer" Mar 16 16:02:21 crc kubenswrapper[5120]: I0316 16:02:21.439568 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-f5cb49f4b-mkrgf" podUID="a1a6ef57-0689-4731-8c35-b337908ae72b" containerName="barbican-api" probeResult="failure" output="Get \"http://10.217.1.116:9311/healthcheck\": read tcp 10.217.0.2:46046->10.217.1.116:9311: read: connection reset by peer" Mar 16 16:02:21 crc kubenswrapper[5120]: I0316 16:02:21.693054 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:02:21 crc kubenswrapper[5120]: I0316 16:02:21.953342 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-f5cb49f4b-mkrgf" Mar 16 16:02:21 crc kubenswrapper[5120]: I0316 16:02:21.955344 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jfvp5\" (UniqueName: \"kubernetes.io/projected/a1a6ef57-0689-4731-8c35-b337908ae72b-kube-api-access-jfvp5\") pod \"a1a6ef57-0689-4731-8c35-b337908ae72b\" (UID: \"a1a6ef57-0689-4731-8c35-b337908ae72b\") " Mar 16 16:02:21 crc kubenswrapper[5120]: I0316 16:02:21.965383 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1a6ef57-0689-4731-8c35-b337908ae72b-kube-api-access-jfvp5" (OuterVolumeSpecName: "kube-api-access-jfvp5") pod "a1a6ef57-0689-4731-8c35-b337908ae72b" (UID: "a1a6ef57-0689-4731-8c35-b337908ae72b"). InnerVolumeSpecName "kube-api-access-jfvp5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:02:22 crc kubenswrapper[5120]: I0316 16:02:22.003570 5120 generic.go:358] "Generic (PLEG): container finished" podID="a1a6ef57-0689-4731-8c35-b337908ae72b" containerID="54d86f0b2ac28c4834d76c20795d47c7b66bc155f7faed9a7d0cd5069987b642" exitCode=0 Mar 16 16:02:22 crc kubenswrapper[5120]: I0316 16:02:22.003666 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-f5cb49f4b-mkrgf" Mar 16 16:02:22 crc kubenswrapper[5120]: I0316 16:02:22.003703 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-f5cb49f4b-mkrgf" event={"ID":"a1a6ef57-0689-4731-8c35-b337908ae72b","Type":"ContainerDied","Data":"54d86f0b2ac28c4834d76c20795d47c7b66bc155f7faed9a7d0cd5069987b642"} Mar 16 16:02:22 crc kubenswrapper[5120]: I0316 16:02:22.003840 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-f5cb49f4b-mkrgf" event={"ID":"a1a6ef57-0689-4731-8c35-b337908ae72b","Type":"ContainerDied","Data":"b6378d8ea4ab166bf232fe6c0df9434cd6493b5671fbed766bf2a8cb6b31baad"} Mar 16 16:02:22 crc kubenswrapper[5120]: I0316 16:02:22.003864 5120 scope.go:117] "RemoveContainer" containerID="54d86f0b2ac28c4834d76c20795d47c7b66bc155f7faed9a7d0cd5069987b642" Mar 16 16:02:22 crc kubenswrapper[5120]: I0316 16:02:22.057297 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a1a6ef57-0689-4731-8c35-b337908ae72b-config-data\") pod \"a1a6ef57-0689-4731-8c35-b337908ae72b\" (UID: \"a1a6ef57-0689-4731-8c35-b337908ae72b\") " Mar 16 16:02:22 crc kubenswrapper[5120]: I0316 16:02:22.057468 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/a1a6ef57-0689-4731-8c35-b337908ae72b-config-data-custom\") pod \"a1a6ef57-0689-4731-8c35-b337908ae72b\" (UID: \"a1a6ef57-0689-4731-8c35-b337908ae72b\") " Mar 16 16:02:22 crc kubenswrapper[5120]: I0316 16:02:22.057654 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a1a6ef57-0689-4731-8c35-b337908ae72b-combined-ca-bundle\") pod \"a1a6ef57-0689-4731-8c35-b337908ae72b\" (UID: \"a1a6ef57-0689-4731-8c35-b337908ae72b\") " Mar 16 16:02:22 crc kubenswrapper[5120]: I0316 16:02:22.058601 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a1a6ef57-0689-4731-8c35-b337908ae72b-logs\") pod \"a1a6ef57-0689-4731-8c35-b337908ae72b\" (UID: \"a1a6ef57-0689-4731-8c35-b337908ae72b\") " Mar 16 16:02:22 crc kubenswrapper[5120]: I0316 16:02:22.059088 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1a6ef57-0689-4731-8c35-b337908ae72b-logs" (OuterVolumeSpecName: "logs") pod "a1a6ef57-0689-4731-8c35-b337908ae72b" (UID: "a1a6ef57-0689-4731-8c35-b337908ae72b"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:02:22 crc kubenswrapper[5120]: I0316 16:02:22.059741 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jfvp5\" (UniqueName: \"kubernetes.io/projected/a1a6ef57-0689-4731-8c35-b337908ae72b-kube-api-access-jfvp5\") on node \"crc\" DevicePath \"\"" Mar 16 16:02:22 crc kubenswrapper[5120]: I0316 16:02:22.059797 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a1a6ef57-0689-4731-8c35-b337908ae72b-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:02:22 crc kubenswrapper[5120]: I0316 16:02:22.062415 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a1a6ef57-0689-4731-8c35-b337908ae72b-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "a1a6ef57-0689-4731-8c35-b337908ae72b" (UID: "a1a6ef57-0689-4731-8c35-b337908ae72b"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:02:22 crc kubenswrapper[5120]: I0316 16:02:22.064637 5120 scope.go:117] "RemoveContainer" containerID="fad15cdcf9dfe90af4f387d9ff64f4894ba5d311cc01c07b0b4676be0a50bbe3" Mar 16 16:02:22 crc kubenswrapper[5120]: I0316 16:02:22.089274 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a1a6ef57-0689-4731-8c35-b337908ae72b-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "a1a6ef57-0689-4731-8c35-b337908ae72b" (UID: "a1a6ef57-0689-4731-8c35-b337908ae72b"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:02:22 crc kubenswrapper[5120]: I0316 16:02:22.112459 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a1a6ef57-0689-4731-8c35-b337908ae72b-config-data" (OuterVolumeSpecName: "config-data") pod "a1a6ef57-0689-4731-8c35-b337908ae72b" (UID: "a1a6ef57-0689-4731-8c35-b337908ae72b"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:02:22 crc kubenswrapper[5120]: I0316 16:02:22.137587 5120 scope.go:117] "RemoveContainer" containerID="54d86f0b2ac28c4834d76c20795d47c7b66bc155f7faed9a7d0cd5069987b642" Mar 16 16:02:22 crc kubenswrapper[5120]: E0316 16:02:22.138205 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"54d86f0b2ac28c4834d76c20795d47c7b66bc155f7faed9a7d0cd5069987b642\": container with ID starting with 54d86f0b2ac28c4834d76c20795d47c7b66bc155f7faed9a7d0cd5069987b642 not found: ID does not exist" containerID="54d86f0b2ac28c4834d76c20795d47c7b66bc155f7faed9a7d0cd5069987b642" Mar 16 16:02:22 crc kubenswrapper[5120]: I0316 16:02:22.138262 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54d86f0b2ac28c4834d76c20795d47c7b66bc155f7faed9a7d0cd5069987b642"} err="failed to get container status \"54d86f0b2ac28c4834d76c20795d47c7b66bc155f7faed9a7d0cd5069987b642\": rpc error: code = NotFound desc = could not find container \"54d86f0b2ac28c4834d76c20795d47c7b66bc155f7faed9a7d0cd5069987b642\": container with ID starting with 54d86f0b2ac28c4834d76c20795d47c7b66bc155f7faed9a7d0cd5069987b642 not found: ID does not exist" Mar 16 16:02:22 crc kubenswrapper[5120]: I0316 16:02:22.138295 5120 scope.go:117] "RemoveContainer" containerID="fad15cdcf9dfe90af4f387d9ff64f4894ba5d311cc01c07b0b4676be0a50bbe3" Mar 16 16:02:22 crc kubenswrapper[5120]: E0316 16:02:22.138829 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fad15cdcf9dfe90af4f387d9ff64f4894ba5d311cc01c07b0b4676be0a50bbe3\": container with ID starting with fad15cdcf9dfe90af4f387d9ff64f4894ba5d311cc01c07b0b4676be0a50bbe3 not found: ID does not exist" containerID="fad15cdcf9dfe90af4f387d9ff64f4894ba5d311cc01c07b0b4676be0a50bbe3" Mar 16 16:02:22 crc kubenswrapper[5120]: I0316 16:02:22.138882 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fad15cdcf9dfe90af4f387d9ff64f4894ba5d311cc01c07b0b4676be0a50bbe3"} err="failed to get container status \"fad15cdcf9dfe90af4f387d9ff64f4894ba5d311cc01c07b0b4676be0a50bbe3\": rpc error: code = NotFound desc = could not find container \"fad15cdcf9dfe90af4f387d9ff64f4894ba5d311cc01c07b0b4676be0a50bbe3\": container with ID starting with fad15cdcf9dfe90af4f387d9ff64f4894ba5d311cc01c07b0b4676be0a50bbe3 not found: ID does not exist" Mar 16 16:02:22 crc kubenswrapper[5120]: I0316 16:02:22.161658 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a1a6ef57-0689-4731-8c35-b337908ae72b-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:02:22 crc kubenswrapper[5120]: I0316 16:02:22.161708 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/a1a6ef57-0689-4731-8c35-b337908ae72b-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:02:22 crc kubenswrapper[5120]: I0316 16:02:22.161723 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a1a6ef57-0689-4731-8c35-b337908ae72b-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:02:22 crc kubenswrapper[5120]: I0316 16:02:22.363892 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-f5cb49f4b-mkrgf"] Mar 16 16:02:22 crc kubenswrapper[5120]: I0316 16:02:22.371378 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-api-f5cb49f4b-mkrgf"] Mar 16 16:02:22 crc kubenswrapper[5120]: I0316 16:02:22.676401 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a1a6ef57-0689-4731-8c35-b337908ae72b" path="/var/lib/kubelet/pods/a1a6ef57-0689-4731-8c35-b337908ae72b/volumes" Mar 16 16:02:28 crc kubenswrapper[5120]: I0316 16:02:28.164015 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/placement-5d4d9d69db-qcw77" Mar 16 16:02:28 crc kubenswrapper[5120]: I0316 16:02:28.665084 5120 scope.go:117] "RemoveContainer" containerID="02ba4fc3f84eccaecfa9e6618280f65626eb76580c4af9ae7a9d7cb3b8dd590b" Mar 16 16:02:29 crc kubenswrapper[5120]: I0316 16:02:29.022338 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/placement-5d4d9d69db-qcw77" Mar 16 16:02:29 crc kubenswrapper[5120]: I0316 16:02:29.114346 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" event={"ID":"e2275cb4-4905-4d66-a87e-8010120db2bd","Type":"ContainerStarted","Data":"41e926ecd1efaa1bb8aa66a8225167ca401bb54b97dbde9a5efe2bfb869a8032"} Mar 16 16:02:29 crc kubenswrapper[5120]: I0316 16:02:29.115821 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-799cbdd458-hqv8s"] Mar 16 16:02:29 crc kubenswrapper[5120]: I0316 16:02:29.116346 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-799cbdd458-hqv8s" podUID="ca9332c4-7b03-4296-9cb8-b5fdcd487025" containerName="placement-log" containerID="cri-o://a5d78734ec5e51ecd5fabe3bc893cb3749cd425b3dad9606dc42a10506307e94" gracePeriod=30 Mar 16 16:02:29 crc kubenswrapper[5120]: I0316 16:02:29.116541 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-799cbdd458-hqv8s" podUID="ca9332c4-7b03-4296-9cb8-b5fdcd487025" containerName="placement-api" containerID="cri-o://173ac0b3334fdba35abe7d7ab1a4e3c86b2d2a42e73a0d78096c0601325bf3dc" gracePeriod=30 Mar 16 16:02:29 crc kubenswrapper[5120]: I0316 16:02:29.149502 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/placement-799cbdd458-hqv8s" podUID="ca9332c4-7b03-4296-9cb8-b5fdcd487025" containerName="placement-api" probeResult="failure" output="Get \"http://10.217.1.115:8778/\": EOF" Mar 16 16:02:29 crc kubenswrapper[5120]: I0316 16:02:29.149550 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/placement-799cbdd458-hqv8s" podUID="ca9332c4-7b03-4296-9cb8-b5fdcd487025" containerName="placement-log" probeResult="failure" output="Get \"http://10.217.1.115:8778/\": EOF" Mar 16 16:02:29 crc kubenswrapper[5120]: I0316 16:02:29.288947 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-fb69b7968-qskx5"] Mar 16 16:02:29 crc kubenswrapper[5120]: I0316 16:02:29.290206 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6827071-9f0c-4934-a287-e8c5797c390b" containerName="barbican-keystone-listener-log" Mar 16 16:02:29 crc kubenswrapper[5120]: I0316 16:02:29.290547 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6827071-9f0c-4934-a287-e8c5797c390b" containerName="barbican-keystone-listener-log" Mar 16 16:02:29 crc kubenswrapper[5120]: I0316 16:02:29.290571 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1daafc71-9f0a-4fe4-953c-1e00eab0fbfa" containerName="barbican-worker-log" Mar 16 16:02:29 crc kubenswrapper[5120]: I0316 16:02:29.290580 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1daafc71-9f0a-4fe4-953c-1e00eab0fbfa" containerName="barbican-worker-log" Mar 16 16:02:29 crc kubenswrapper[5120]: I0316 16:02:29.290591 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1a6ef57-0689-4731-8c35-b337908ae72b" containerName="barbican-api-log" Mar 16 16:02:29 crc kubenswrapper[5120]: I0316 16:02:29.290599 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1a6ef57-0689-4731-8c35-b337908ae72b" containerName="barbican-api-log" Mar 16 16:02:29 crc kubenswrapper[5120]: I0316 16:02:29.290634 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6827071-9f0c-4934-a287-e8c5797c390b" containerName="barbican-keystone-listener" Mar 16 16:02:29 crc kubenswrapper[5120]: I0316 16:02:29.290641 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6827071-9f0c-4934-a287-e8c5797c390b" containerName="barbican-keystone-listener" Mar 16 16:02:29 crc kubenswrapper[5120]: I0316 16:02:29.290680 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1daafc71-9f0a-4fe4-953c-1e00eab0fbfa" containerName="barbican-worker" Mar 16 16:02:29 crc kubenswrapper[5120]: I0316 16:02:29.290688 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1daafc71-9f0a-4fe4-953c-1e00eab0fbfa" containerName="barbican-worker" Mar 16 16:02:29 crc kubenswrapper[5120]: I0316 16:02:29.290706 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1a6ef57-0689-4731-8c35-b337908ae72b" containerName="barbican-api" Mar 16 16:02:29 crc kubenswrapper[5120]: I0316 16:02:29.290713 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1a6ef57-0689-4731-8c35-b337908ae72b" containerName="barbican-api" Mar 16 16:02:29 crc kubenswrapper[5120]: I0316 16:02:29.290969 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c6827071-9f0c-4934-a287-e8c5797c390b" containerName="barbican-keystone-listener-log" Mar 16 16:02:29 crc kubenswrapper[5120]: I0316 16:02:29.290987 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1daafc71-9f0a-4fe4-953c-1e00eab0fbfa" containerName="barbican-worker" Mar 16 16:02:29 crc kubenswrapper[5120]: I0316 16:02:29.291001 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c6827071-9f0c-4934-a287-e8c5797c390b" containerName="barbican-keystone-listener" Mar 16 16:02:29 crc kubenswrapper[5120]: I0316 16:02:29.291024 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="a1a6ef57-0689-4731-8c35-b337908ae72b" containerName="barbican-api" Mar 16 16:02:29 crc kubenswrapper[5120]: I0316 16:02:29.291038 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1daafc71-9f0a-4fe4-953c-1e00eab0fbfa" containerName="barbican-worker-log" Mar 16 16:02:29 crc kubenswrapper[5120]: I0316 16:02:29.291047 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="a1a6ef57-0689-4731-8c35-b337908ae72b" containerName="barbican-api-log" Mar 16 16:02:29 crc kubenswrapper[5120]: I0316 16:02:29.297033 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-fb69b7968-qskx5" Mar 16 16:02:29 crc kubenswrapper[5120]: I0316 16:02:29.297359 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-fb69b7968-qskx5"] Mar 16 16:02:29 crc kubenswrapper[5120]: I0316 16:02:29.424830 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/793f378f-ef31-443c-bb12-6d75a2140296-combined-ca-bundle\") pod \"placement-fb69b7968-qskx5\" (UID: \"793f378f-ef31-443c-bb12-6d75a2140296\") " pod="openstack-kuttl-tests/placement-fb69b7968-qskx5" Mar 16 16:02:29 crc kubenswrapper[5120]: I0316 16:02:29.424973 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/793f378f-ef31-443c-bb12-6d75a2140296-logs\") pod \"placement-fb69b7968-qskx5\" (UID: \"793f378f-ef31-443c-bb12-6d75a2140296\") " pod="openstack-kuttl-tests/placement-fb69b7968-qskx5" Mar 16 16:02:29 crc kubenswrapper[5120]: I0316 16:02:29.425033 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vrbk\" (UniqueName: \"kubernetes.io/projected/793f378f-ef31-443c-bb12-6d75a2140296-kube-api-access-9vrbk\") pod \"placement-fb69b7968-qskx5\" (UID: \"793f378f-ef31-443c-bb12-6d75a2140296\") " pod="openstack-kuttl-tests/placement-fb69b7968-qskx5" Mar 16 16:02:29 crc kubenswrapper[5120]: I0316 16:02:29.425338 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/793f378f-ef31-443c-bb12-6d75a2140296-internal-tls-certs\") pod \"placement-fb69b7968-qskx5\" (UID: \"793f378f-ef31-443c-bb12-6d75a2140296\") " pod="openstack-kuttl-tests/placement-fb69b7968-qskx5" Mar 16 16:02:29 crc kubenswrapper[5120]: I0316 16:02:29.425510 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/793f378f-ef31-443c-bb12-6d75a2140296-public-tls-certs\") pod \"placement-fb69b7968-qskx5\" (UID: \"793f378f-ef31-443c-bb12-6d75a2140296\") " pod="openstack-kuttl-tests/placement-fb69b7968-qskx5" Mar 16 16:02:29 crc kubenswrapper[5120]: I0316 16:02:29.426011 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/793f378f-ef31-443c-bb12-6d75a2140296-config-data\") pod \"placement-fb69b7968-qskx5\" (UID: \"793f378f-ef31-443c-bb12-6d75a2140296\") " pod="openstack-kuttl-tests/placement-fb69b7968-qskx5" Mar 16 16:02:29 crc kubenswrapper[5120]: I0316 16:02:29.426568 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/793f378f-ef31-443c-bb12-6d75a2140296-scripts\") pod \"placement-fb69b7968-qskx5\" (UID: \"793f378f-ef31-443c-bb12-6d75a2140296\") " pod="openstack-kuttl-tests/placement-fb69b7968-qskx5" Mar 16 16:02:29 crc kubenswrapper[5120]: I0316 16:02:29.529568 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/793f378f-ef31-443c-bb12-6d75a2140296-config-data\") pod \"placement-fb69b7968-qskx5\" (UID: \"793f378f-ef31-443c-bb12-6d75a2140296\") " pod="openstack-kuttl-tests/placement-fb69b7968-qskx5" Mar 16 16:02:29 crc kubenswrapper[5120]: I0316 16:02:29.529638 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/793f378f-ef31-443c-bb12-6d75a2140296-scripts\") pod \"placement-fb69b7968-qskx5\" (UID: \"793f378f-ef31-443c-bb12-6d75a2140296\") " pod="openstack-kuttl-tests/placement-fb69b7968-qskx5" Mar 16 16:02:29 crc kubenswrapper[5120]: I0316 16:02:29.529683 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/793f378f-ef31-443c-bb12-6d75a2140296-combined-ca-bundle\") pod \"placement-fb69b7968-qskx5\" (UID: \"793f378f-ef31-443c-bb12-6d75a2140296\") " pod="openstack-kuttl-tests/placement-fb69b7968-qskx5" Mar 16 16:02:29 crc kubenswrapper[5120]: I0316 16:02:29.529712 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/793f378f-ef31-443c-bb12-6d75a2140296-logs\") pod \"placement-fb69b7968-qskx5\" (UID: \"793f378f-ef31-443c-bb12-6d75a2140296\") " pod="openstack-kuttl-tests/placement-fb69b7968-qskx5" Mar 16 16:02:29 crc kubenswrapper[5120]: I0316 16:02:29.531140 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9vrbk\" (UniqueName: \"kubernetes.io/projected/793f378f-ef31-443c-bb12-6d75a2140296-kube-api-access-9vrbk\") pod \"placement-fb69b7968-qskx5\" (UID: \"793f378f-ef31-443c-bb12-6d75a2140296\") " pod="openstack-kuttl-tests/placement-fb69b7968-qskx5" Mar 16 16:02:29 crc kubenswrapper[5120]: I0316 16:02:29.531208 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/793f378f-ef31-443c-bb12-6d75a2140296-internal-tls-certs\") pod \"placement-fb69b7968-qskx5\" (UID: \"793f378f-ef31-443c-bb12-6d75a2140296\") " pod="openstack-kuttl-tests/placement-fb69b7968-qskx5" Mar 16 16:02:29 crc kubenswrapper[5120]: I0316 16:02:29.531275 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/793f378f-ef31-443c-bb12-6d75a2140296-public-tls-certs\") pod \"placement-fb69b7968-qskx5\" (UID: \"793f378f-ef31-443c-bb12-6d75a2140296\") " pod="openstack-kuttl-tests/placement-fb69b7968-qskx5" Mar 16 16:02:29 crc kubenswrapper[5120]: I0316 16:02:29.531439 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/793f378f-ef31-443c-bb12-6d75a2140296-logs\") pod \"placement-fb69b7968-qskx5\" (UID: \"793f378f-ef31-443c-bb12-6d75a2140296\") " pod="openstack-kuttl-tests/placement-fb69b7968-qskx5" Mar 16 16:02:29 crc kubenswrapper[5120]: I0316 16:02:29.536372 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/793f378f-ef31-443c-bb12-6d75a2140296-config-data\") pod \"placement-fb69b7968-qskx5\" (UID: \"793f378f-ef31-443c-bb12-6d75a2140296\") " pod="openstack-kuttl-tests/placement-fb69b7968-qskx5" Mar 16 16:02:29 crc kubenswrapper[5120]: I0316 16:02:29.536519 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/793f378f-ef31-443c-bb12-6d75a2140296-combined-ca-bundle\") pod \"placement-fb69b7968-qskx5\" (UID: \"793f378f-ef31-443c-bb12-6d75a2140296\") " pod="openstack-kuttl-tests/placement-fb69b7968-qskx5" Mar 16 16:02:29 crc kubenswrapper[5120]: I0316 16:02:29.536829 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/793f378f-ef31-443c-bb12-6d75a2140296-scripts\") pod \"placement-fb69b7968-qskx5\" (UID: \"793f378f-ef31-443c-bb12-6d75a2140296\") " pod="openstack-kuttl-tests/placement-fb69b7968-qskx5" Mar 16 16:02:29 crc kubenswrapper[5120]: I0316 16:02:29.536882 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/793f378f-ef31-443c-bb12-6d75a2140296-internal-tls-certs\") pod \"placement-fb69b7968-qskx5\" (UID: \"793f378f-ef31-443c-bb12-6d75a2140296\") " pod="openstack-kuttl-tests/placement-fb69b7968-qskx5" Mar 16 16:02:29 crc kubenswrapper[5120]: I0316 16:02:29.539424 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/793f378f-ef31-443c-bb12-6d75a2140296-public-tls-certs\") pod \"placement-fb69b7968-qskx5\" (UID: \"793f378f-ef31-443c-bb12-6d75a2140296\") " pod="openstack-kuttl-tests/placement-fb69b7968-qskx5" Mar 16 16:02:29 crc kubenswrapper[5120]: I0316 16:02:29.545184 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vrbk\" (UniqueName: \"kubernetes.io/projected/793f378f-ef31-443c-bb12-6d75a2140296-kube-api-access-9vrbk\") pod \"placement-fb69b7968-qskx5\" (UID: \"793f378f-ef31-443c-bb12-6d75a2140296\") " pod="openstack-kuttl-tests/placement-fb69b7968-qskx5" Mar 16 16:02:29 crc kubenswrapper[5120]: I0316 16:02:29.617028 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-fb69b7968-qskx5" Mar 16 16:02:30 crc kubenswrapper[5120]: I0316 16:02:30.116149 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-fb69b7968-qskx5"] Mar 16 16:02:30 crc kubenswrapper[5120]: I0316 16:02:30.131073 5120 generic.go:358] "Generic (PLEG): container finished" podID="ca9332c4-7b03-4296-9cb8-b5fdcd487025" containerID="a5d78734ec5e51ecd5fabe3bc893cb3749cd425b3dad9606dc42a10506307e94" exitCode=143 Mar 16 16:02:30 crc kubenswrapper[5120]: I0316 16:02:30.131434 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-799cbdd458-hqv8s" event={"ID":"ca9332c4-7b03-4296-9cb8-b5fdcd487025","Type":"ContainerDied","Data":"a5d78734ec5e51ecd5fabe3bc893cb3749cd425b3dad9606dc42a10506307e94"} Mar 16 16:02:30 crc kubenswrapper[5120]: I0316 16:02:30.225722 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/neutron-5b779bfdf-px7gw" Mar 16 16:02:31 crc kubenswrapper[5120]: I0316 16:02:31.144935 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-fb69b7968-qskx5" event={"ID":"793f378f-ef31-443c-bb12-6d75a2140296","Type":"ContainerStarted","Data":"b05d1524d8d05da004906226c31ae5d3ad93c44d9f9606c3345de3d786881030"} Mar 16 16:02:31 crc kubenswrapper[5120]: I0316 16:02:31.145630 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-fb69b7968-qskx5" Mar 16 16:02:31 crc kubenswrapper[5120]: I0316 16:02:31.145815 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-fb69b7968-qskx5" event={"ID":"793f378f-ef31-443c-bb12-6d75a2140296","Type":"ContainerStarted","Data":"f83697d85210dbea97afeac8e4e308ef8197b85223ea2b15ac11ae6f4f71f13f"} Mar 16 16:02:31 crc kubenswrapper[5120]: I0316 16:02:31.145862 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-fb69b7968-qskx5" event={"ID":"793f378f-ef31-443c-bb12-6d75a2140296","Type":"ContainerStarted","Data":"82bb0050daea8ab8af6cbaf31d84b602277ca55c600b6da9eab20ae98fb40ae8"} Mar 16 16:02:31 crc kubenswrapper[5120]: I0316 16:02:31.168378 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-fb69b7968-qskx5" podStartSLOduration=2.168358544 podStartE2EDuration="2.168358544s" podCreationTimestamp="2026-03-16 16:02:29 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:02:31.16421399 +0000 UTC m=+1853.318145647" watchObservedRunningTime="2026-03-16 16:02:31.168358544 +0000 UTC m=+1853.322290201" Mar 16 16:02:32 crc kubenswrapper[5120]: I0316 16:02:32.153572 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-fb69b7968-qskx5" Mar 16 16:02:33 crc kubenswrapper[5120]: I0316 16:02:33.958163 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-799cbdd458-hqv8s" Mar 16 16:02:34 crc kubenswrapper[5120]: I0316 16:02:34.137447 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4jskf\" (UniqueName: \"kubernetes.io/projected/ca9332c4-7b03-4296-9cb8-b5fdcd487025-kube-api-access-4jskf\") pod \"ca9332c4-7b03-4296-9cb8-b5fdcd487025\" (UID: \"ca9332c4-7b03-4296-9cb8-b5fdcd487025\") " Mar 16 16:02:34 crc kubenswrapper[5120]: I0316 16:02:34.137774 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ca9332c4-7b03-4296-9cb8-b5fdcd487025-config-data\") pod \"ca9332c4-7b03-4296-9cb8-b5fdcd487025\" (UID: \"ca9332c4-7b03-4296-9cb8-b5fdcd487025\") " Mar 16 16:02:34 crc kubenswrapper[5120]: I0316 16:02:34.137961 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ca9332c4-7b03-4296-9cb8-b5fdcd487025-scripts\") pod \"ca9332c4-7b03-4296-9cb8-b5fdcd487025\" (UID: \"ca9332c4-7b03-4296-9cb8-b5fdcd487025\") " Mar 16 16:02:34 crc kubenswrapper[5120]: I0316 16:02:34.138177 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ca9332c4-7b03-4296-9cb8-b5fdcd487025-combined-ca-bundle\") pod \"ca9332c4-7b03-4296-9cb8-b5fdcd487025\" (UID: \"ca9332c4-7b03-4296-9cb8-b5fdcd487025\") " Mar 16 16:02:34 crc kubenswrapper[5120]: I0316 16:02:34.138411 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ca9332c4-7b03-4296-9cb8-b5fdcd487025-logs\") pod \"ca9332c4-7b03-4296-9cb8-b5fdcd487025\" (UID: \"ca9332c4-7b03-4296-9cb8-b5fdcd487025\") " Mar 16 16:02:34 crc kubenswrapper[5120]: I0316 16:02:34.139027 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca9332c4-7b03-4296-9cb8-b5fdcd487025-logs" (OuterVolumeSpecName: "logs") pod "ca9332c4-7b03-4296-9cb8-b5fdcd487025" (UID: "ca9332c4-7b03-4296-9cb8-b5fdcd487025"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:02:34 crc kubenswrapper[5120]: I0316 16:02:34.145993 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca9332c4-7b03-4296-9cb8-b5fdcd487025-scripts" (OuterVolumeSpecName: "scripts") pod "ca9332c4-7b03-4296-9cb8-b5fdcd487025" (UID: "ca9332c4-7b03-4296-9cb8-b5fdcd487025"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:02:34 crc kubenswrapper[5120]: I0316 16:02:34.146511 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca9332c4-7b03-4296-9cb8-b5fdcd487025-kube-api-access-4jskf" (OuterVolumeSpecName: "kube-api-access-4jskf") pod "ca9332c4-7b03-4296-9cb8-b5fdcd487025" (UID: "ca9332c4-7b03-4296-9cb8-b5fdcd487025"). InnerVolumeSpecName "kube-api-access-4jskf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:02:34 crc kubenswrapper[5120]: I0316 16:02:34.178136 5120 generic.go:358] "Generic (PLEG): container finished" podID="ca9332c4-7b03-4296-9cb8-b5fdcd487025" containerID="173ac0b3334fdba35abe7d7ab1a4e3c86b2d2a42e73a0d78096c0601325bf3dc" exitCode=0 Mar 16 16:02:34 crc kubenswrapper[5120]: I0316 16:02:34.178820 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-799cbdd458-hqv8s" event={"ID":"ca9332c4-7b03-4296-9cb8-b5fdcd487025","Type":"ContainerDied","Data":"173ac0b3334fdba35abe7d7ab1a4e3c86b2d2a42e73a0d78096c0601325bf3dc"} Mar 16 16:02:34 crc kubenswrapper[5120]: I0316 16:02:34.178885 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-799cbdd458-hqv8s" event={"ID":"ca9332c4-7b03-4296-9cb8-b5fdcd487025","Type":"ContainerDied","Data":"f2ed0173d6dadde2b800d7ef32e3d4858baa80e203e88de189317a91c01b3b96"} Mar 16 16:02:34 crc kubenswrapper[5120]: I0316 16:02:34.178909 5120 scope.go:117] "RemoveContainer" containerID="173ac0b3334fdba35abe7d7ab1a4e3c86b2d2a42e73a0d78096c0601325bf3dc" Mar 16 16:02:34 crc kubenswrapper[5120]: I0316 16:02:34.179188 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-799cbdd458-hqv8s" Mar 16 16:02:34 crc kubenswrapper[5120]: I0316 16:02:34.201353 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca9332c4-7b03-4296-9cb8-b5fdcd487025-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ca9332c4-7b03-4296-9cb8-b5fdcd487025" (UID: "ca9332c4-7b03-4296-9cb8-b5fdcd487025"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:02:34 crc kubenswrapper[5120]: I0316 16:02:34.222847 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca9332c4-7b03-4296-9cb8-b5fdcd487025-config-data" (OuterVolumeSpecName: "config-data") pod "ca9332c4-7b03-4296-9cb8-b5fdcd487025" (UID: "ca9332c4-7b03-4296-9cb8-b5fdcd487025"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:02:34 crc kubenswrapper[5120]: I0316 16:02:34.240994 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ca9332c4-7b03-4296-9cb8-b5fdcd487025-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:02:34 crc kubenswrapper[5120]: I0316 16:02:34.241033 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ca9332c4-7b03-4296-9cb8-b5fdcd487025-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:02:34 crc kubenswrapper[5120]: I0316 16:02:34.241048 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ca9332c4-7b03-4296-9cb8-b5fdcd487025-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:02:34 crc kubenswrapper[5120]: I0316 16:02:34.241059 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4jskf\" (UniqueName: \"kubernetes.io/projected/ca9332c4-7b03-4296-9cb8-b5fdcd487025-kube-api-access-4jskf\") on node \"crc\" DevicePath \"\"" Mar 16 16:02:34 crc kubenswrapper[5120]: I0316 16:02:34.241071 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ca9332c4-7b03-4296-9cb8-b5fdcd487025-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:02:34 crc kubenswrapper[5120]: I0316 16:02:34.254197 5120 scope.go:117] "RemoveContainer" containerID="a5d78734ec5e51ecd5fabe3bc893cb3749cd425b3dad9606dc42a10506307e94" Mar 16 16:02:34 crc kubenswrapper[5120]: I0316 16:02:34.276121 5120 scope.go:117] "RemoveContainer" containerID="173ac0b3334fdba35abe7d7ab1a4e3c86b2d2a42e73a0d78096c0601325bf3dc" Mar 16 16:02:34 crc kubenswrapper[5120]: E0316 16:02:34.276587 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"173ac0b3334fdba35abe7d7ab1a4e3c86b2d2a42e73a0d78096c0601325bf3dc\": container with ID starting with 173ac0b3334fdba35abe7d7ab1a4e3c86b2d2a42e73a0d78096c0601325bf3dc not found: ID does not exist" containerID="173ac0b3334fdba35abe7d7ab1a4e3c86b2d2a42e73a0d78096c0601325bf3dc" Mar 16 16:02:34 crc kubenswrapper[5120]: I0316 16:02:34.276640 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"173ac0b3334fdba35abe7d7ab1a4e3c86b2d2a42e73a0d78096c0601325bf3dc"} err="failed to get container status \"173ac0b3334fdba35abe7d7ab1a4e3c86b2d2a42e73a0d78096c0601325bf3dc\": rpc error: code = NotFound desc = could not find container \"173ac0b3334fdba35abe7d7ab1a4e3c86b2d2a42e73a0d78096c0601325bf3dc\": container with ID starting with 173ac0b3334fdba35abe7d7ab1a4e3c86b2d2a42e73a0d78096c0601325bf3dc not found: ID does not exist" Mar 16 16:02:34 crc kubenswrapper[5120]: I0316 16:02:34.276666 5120 scope.go:117] "RemoveContainer" containerID="a5d78734ec5e51ecd5fabe3bc893cb3749cd425b3dad9606dc42a10506307e94" Mar 16 16:02:34 crc kubenswrapper[5120]: E0316 16:02:34.276999 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a5d78734ec5e51ecd5fabe3bc893cb3749cd425b3dad9606dc42a10506307e94\": container with ID starting with a5d78734ec5e51ecd5fabe3bc893cb3749cd425b3dad9606dc42a10506307e94 not found: ID does not exist" containerID="a5d78734ec5e51ecd5fabe3bc893cb3749cd425b3dad9606dc42a10506307e94" Mar 16 16:02:34 crc kubenswrapper[5120]: I0316 16:02:34.277046 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5d78734ec5e51ecd5fabe3bc893cb3749cd425b3dad9606dc42a10506307e94"} err="failed to get container status \"a5d78734ec5e51ecd5fabe3bc893cb3749cd425b3dad9606dc42a10506307e94\": rpc error: code = NotFound desc = could not find container \"a5d78734ec5e51ecd5fabe3bc893cb3749cd425b3dad9606dc42a10506307e94\": container with ID starting with a5d78734ec5e51ecd5fabe3bc893cb3749cd425b3dad9606dc42a10506307e94 not found: ID does not exist" Mar 16 16:02:34 crc kubenswrapper[5120]: I0316 16:02:34.518813 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-799cbdd458-hqv8s"] Mar 16 16:02:34 crc kubenswrapper[5120]: I0316 16:02:34.527517 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-799cbdd458-hqv8s"] Mar 16 16:02:34 crc kubenswrapper[5120]: I0316 16:02:34.675110 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca9332c4-7b03-4296-9cb8-b5fdcd487025" path="/var/lib/kubelet/pods/ca9332c4-7b03-4296-9cb8-b5fdcd487025/volumes" Mar 16 16:02:37 crc kubenswrapper[5120]: I0316 16:02:37.881620 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/keystone-5948cb6c79-mrnwx" Mar 16 16:02:39 crc kubenswrapper[5120]: I0316 16:02:39.270115 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 16:02:39 crc kubenswrapper[5120]: I0316 16:02:39.271971 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca9332c4-7b03-4296-9cb8-b5fdcd487025" containerName="placement-log" Mar 16 16:02:39 crc kubenswrapper[5120]: I0316 16:02:39.272003 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca9332c4-7b03-4296-9cb8-b5fdcd487025" containerName="placement-log" Mar 16 16:02:39 crc kubenswrapper[5120]: I0316 16:02:39.272042 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca9332c4-7b03-4296-9cb8-b5fdcd487025" containerName="placement-api" Mar 16 16:02:39 crc kubenswrapper[5120]: I0316 16:02:39.272052 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca9332c4-7b03-4296-9cb8-b5fdcd487025" containerName="placement-api" Mar 16 16:02:39 crc kubenswrapper[5120]: I0316 16:02:39.272208 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ca9332c4-7b03-4296-9cb8-b5fdcd487025" containerName="placement-api" Mar 16 16:02:39 crc kubenswrapper[5120]: I0316 16:02:39.272220 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ca9332c4-7b03-4296-9cb8-b5fdcd487025" containerName="placement-log" Mar 16 16:02:39 crc kubenswrapper[5120]: I0316 16:02:39.276957 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Mar 16 16:02:39 crc kubenswrapper[5120]: I0316 16:02:39.282384 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"openstackclient-openstackclient-dockercfg-nqmgv\"" Mar 16 16:02:39 crc kubenswrapper[5120]: I0316 16:02:39.282485 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-config\"" Mar 16 16:02:39 crc kubenswrapper[5120]: I0316 16:02:39.282669 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"openstack-config-secret\"" Mar 16 16:02:39 crc kubenswrapper[5120]: I0316 16:02:39.329993 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 16:02:39 crc kubenswrapper[5120]: I0316 16:02:39.384191 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dcd99b91-243d-46cd-beb8-76527d308b62-combined-ca-bundle\") pod \"openstackclient\" (UID: \"dcd99b91-243d-46cd-beb8-76527d308b62\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:02:39 crc kubenswrapper[5120]: I0316 16:02:39.384259 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/dcd99b91-243d-46cd-beb8-76527d308b62-openstack-config\") pod \"openstackclient\" (UID: \"dcd99b91-243d-46cd-beb8-76527d308b62\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:02:39 crc kubenswrapper[5120]: I0316 16:02:39.384461 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rd7st\" (UniqueName: \"kubernetes.io/projected/dcd99b91-243d-46cd-beb8-76527d308b62-kube-api-access-rd7st\") pod \"openstackclient\" (UID: \"dcd99b91-243d-46cd-beb8-76527d308b62\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:02:39 crc kubenswrapper[5120]: I0316 16:02:39.384751 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/dcd99b91-243d-46cd-beb8-76527d308b62-openstack-config-secret\") pod \"openstackclient\" (UID: \"dcd99b91-243d-46cd-beb8-76527d308b62\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:02:39 crc kubenswrapper[5120]: I0316 16:02:39.486850 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/dcd99b91-243d-46cd-beb8-76527d308b62-openstack-config-secret\") pod \"openstackclient\" (UID: \"dcd99b91-243d-46cd-beb8-76527d308b62\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:02:39 crc kubenswrapper[5120]: I0316 16:02:39.486956 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dcd99b91-243d-46cd-beb8-76527d308b62-combined-ca-bundle\") pod \"openstackclient\" (UID: \"dcd99b91-243d-46cd-beb8-76527d308b62\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:02:39 crc kubenswrapper[5120]: I0316 16:02:39.486981 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/dcd99b91-243d-46cd-beb8-76527d308b62-openstack-config\") pod \"openstackclient\" (UID: \"dcd99b91-243d-46cd-beb8-76527d308b62\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:02:39 crc kubenswrapper[5120]: I0316 16:02:39.487031 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rd7st\" (UniqueName: \"kubernetes.io/projected/dcd99b91-243d-46cd-beb8-76527d308b62-kube-api-access-rd7st\") pod \"openstackclient\" (UID: \"dcd99b91-243d-46cd-beb8-76527d308b62\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:02:39 crc kubenswrapper[5120]: I0316 16:02:39.488022 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/dcd99b91-243d-46cd-beb8-76527d308b62-openstack-config\") pod \"openstackclient\" (UID: \"dcd99b91-243d-46cd-beb8-76527d308b62\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:02:39 crc kubenswrapper[5120]: I0316 16:02:39.500660 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/dcd99b91-243d-46cd-beb8-76527d308b62-openstack-config-secret\") pod \"openstackclient\" (UID: \"dcd99b91-243d-46cd-beb8-76527d308b62\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:02:39 crc kubenswrapper[5120]: I0316 16:02:39.503575 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dcd99b91-243d-46cd-beb8-76527d308b62-combined-ca-bundle\") pod \"openstackclient\" (UID: \"dcd99b91-243d-46cd-beb8-76527d308b62\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:02:39 crc kubenswrapper[5120]: I0316 16:02:39.504780 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rd7st\" (UniqueName: \"kubernetes.io/projected/dcd99b91-243d-46cd-beb8-76527d308b62-kube-api-access-rd7st\") pod \"openstackclient\" (UID: \"dcd99b91-243d-46cd-beb8-76527d308b62\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:02:39 crc kubenswrapper[5120]: I0316 16:02:39.641431 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Mar 16 16:02:40 crc kubenswrapper[5120]: W0316 16:02:40.127278 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddcd99b91_243d_46cd_beb8_76527d308b62.slice/crio-fdf21add28a9d4aa02341ec3f5b17383d9784187baabb5001ae0bf77ca7d2831 WatchSource:0}: Error finding container fdf21add28a9d4aa02341ec3f5b17383d9784187baabb5001ae0bf77ca7d2831: Status 404 returned error can't find the container with id fdf21add28a9d4aa02341ec3f5b17383d9784187baabb5001ae0bf77ca7d2831 Mar 16 16:02:40 crc kubenswrapper[5120]: I0316 16:02:40.128175 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 16:02:40 crc kubenswrapper[5120]: I0316 16:02:40.298494 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstackclient" event={"ID":"dcd99b91-243d-46cd-beb8-76527d308b62","Type":"ContainerStarted","Data":"fdf21add28a9d4aa02341ec3f5b17383d9784187baabb5001ae0bf77ca7d2831"} Mar 16 16:02:40 crc kubenswrapper[5120]: I0316 16:02:40.770210 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/neutron-6b8df9c88d-rbjrz" Mar 16 16:02:40 crc kubenswrapper[5120]: I0316 16:02:40.865594 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-5b779bfdf-px7gw"] Mar 16 16:02:40 crc kubenswrapper[5120]: I0316 16:02:40.866059 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-5b779bfdf-px7gw" podUID="bfe56c80-c472-49dc-8971-db5052d61898" containerName="neutron-api" containerID="cri-o://d15342bf5f1da981a5264feaf7b142259bff5bab0942dc8efe186eb2003e9fb6" gracePeriod=30 Mar 16 16:02:40 crc kubenswrapper[5120]: I0316 16:02:40.866594 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-5b779bfdf-px7gw" podUID="bfe56c80-c472-49dc-8971-db5052d61898" containerName="neutron-httpd" containerID="cri-o://fdda622d80035e11d91b16db055467f5e998c8ed06fd535051b04113b051ec7b" gracePeriod=30 Mar 16 16:02:41 crc kubenswrapper[5120]: I0316 16:02:41.308607 5120 generic.go:358] "Generic (PLEG): container finished" podID="bfe56c80-c472-49dc-8971-db5052d61898" containerID="fdda622d80035e11d91b16db055467f5e998c8ed06fd535051b04113b051ec7b" exitCode=0 Mar 16 16:02:41 crc kubenswrapper[5120]: I0316 16:02:41.308697 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-5b779bfdf-px7gw" event={"ID":"bfe56c80-c472-49dc-8971-db5052d61898","Type":"ContainerDied","Data":"fdda622d80035e11d91b16db055467f5e998c8ed06fd535051b04113b051ec7b"} Mar 16 16:02:41 crc kubenswrapper[5120]: I0316 16:02:41.310191 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstackclient" event={"ID":"dcd99b91-243d-46cd-beb8-76527d308b62","Type":"ContainerStarted","Data":"2a93e12e3b4726773dd0561044adb6eaa04a60413b252ae3a7757a91ab1954d4"} Mar 16 16:02:41 crc kubenswrapper[5120]: I0316 16:02:41.332029 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstackclient" podStartSLOduration=2.332011993 podStartE2EDuration="2.332011993s" podCreationTimestamp="2026-03-16 16:02:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:02:41.323645913 +0000 UTC m=+1863.477577570" watchObservedRunningTime="2026-03-16 16:02:41.332011993 +0000 UTC m=+1863.485943640" Mar 16 16:02:41 crc kubenswrapper[5120]: I0316 16:02:41.392081 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-hs54b"] Mar 16 16:02:41 crc kubenswrapper[5120]: I0316 16:02:41.396926 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-db-create-hs54b" Mar 16 16:02:41 crc kubenswrapper[5120]: I0316 16:02:41.403409 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-hs54b"] Mar 16 16:02:41 crc kubenswrapper[5120]: I0316 16:02:41.526924 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-r5xhj"] Mar 16 16:02:41 crc kubenswrapper[5120]: I0316 16:02:41.540849 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8a1e66b1-adb2-4ddb-bca1-257a1646ebda-operator-scripts\") pod \"nova-api-db-create-hs54b\" (UID: \"8a1e66b1-adb2-4ddb-bca1-257a1646ebda\") " pod="openstack-kuttl-tests/nova-api-db-create-hs54b" Mar 16 16:02:41 crc kubenswrapper[5120]: I0316 16:02:41.540951 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhdnm\" (UniqueName: \"kubernetes.io/projected/8a1e66b1-adb2-4ddb-bca1-257a1646ebda-kube-api-access-lhdnm\") pod \"nova-api-db-create-hs54b\" (UID: \"8a1e66b1-adb2-4ddb-bca1-257a1646ebda\") " pod="openstack-kuttl-tests/nova-api-db-create-hs54b" Mar 16 16:02:41 crc kubenswrapper[5120]: I0316 16:02:41.543021 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-db-create-r5xhj" Mar 16 16:02:41 crc kubenswrapper[5120]: I0316 16:02:41.569953 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-r5xhj"] Mar 16 16:02:41 crc kubenswrapper[5120]: I0316 16:02:41.597834 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-c16c-account-create-update-548pc"] Mar 16 16:02:41 crc kubenswrapper[5120]: I0316 16:02:41.603098 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-c16c-account-create-update-548pc" Mar 16 16:02:41 crc kubenswrapper[5120]: I0316 16:02:41.615725 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-db-secret\"" Mar 16 16:02:41 crc kubenswrapper[5120]: I0316 16:02:41.622307 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-c16c-account-create-update-548pc"] Mar 16 16:02:41 crc kubenswrapper[5120]: I0316 16:02:41.650038 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8a1e66b1-adb2-4ddb-bca1-257a1646ebda-operator-scripts\") pod \"nova-api-db-create-hs54b\" (UID: \"8a1e66b1-adb2-4ddb-bca1-257a1646ebda\") " pod="openstack-kuttl-tests/nova-api-db-create-hs54b" Mar 16 16:02:41 crc kubenswrapper[5120]: I0316 16:02:41.650132 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lhdnm\" (UniqueName: \"kubernetes.io/projected/8a1e66b1-adb2-4ddb-bca1-257a1646ebda-kube-api-access-lhdnm\") pod \"nova-api-db-create-hs54b\" (UID: \"8a1e66b1-adb2-4ddb-bca1-257a1646ebda\") " pod="openstack-kuttl-tests/nova-api-db-create-hs54b" Mar 16 16:02:41 crc kubenswrapper[5120]: I0316 16:02:41.650157 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wn4vw\" (UniqueName: \"kubernetes.io/projected/dcee9a4c-0584-41d7-ae1a-c6aa0417e113-kube-api-access-wn4vw\") pod \"nova-cell0-db-create-r5xhj\" (UID: \"dcee9a4c-0584-41d7-ae1a-c6aa0417e113\") " pod="openstack-kuttl-tests/nova-cell0-db-create-r5xhj" Mar 16 16:02:41 crc kubenswrapper[5120]: I0316 16:02:41.650286 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/dcee9a4c-0584-41d7-ae1a-c6aa0417e113-operator-scripts\") pod \"nova-cell0-db-create-r5xhj\" (UID: \"dcee9a4c-0584-41d7-ae1a-c6aa0417e113\") " pod="openstack-kuttl-tests/nova-cell0-db-create-r5xhj" Mar 16 16:02:41 crc kubenswrapper[5120]: I0316 16:02:41.651003 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8a1e66b1-adb2-4ddb-bca1-257a1646ebda-operator-scripts\") pod \"nova-api-db-create-hs54b\" (UID: \"8a1e66b1-adb2-4ddb-bca1-257a1646ebda\") " pod="openstack-kuttl-tests/nova-api-db-create-hs54b" Mar 16 16:02:41 crc kubenswrapper[5120]: I0316 16:02:41.677953 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-w8fv5"] Mar 16 16:02:41 crc kubenswrapper[5120]: I0316 16:02:41.697417 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-db-create-w8fv5" Mar 16 16:02:41 crc kubenswrapper[5120]: I0316 16:02:41.697959 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhdnm\" (UniqueName: \"kubernetes.io/projected/8a1e66b1-adb2-4ddb-bca1-257a1646ebda-kube-api-access-lhdnm\") pod \"nova-api-db-create-hs54b\" (UID: \"8a1e66b1-adb2-4ddb-bca1-257a1646ebda\") " pod="openstack-kuttl-tests/nova-api-db-create-hs54b" Mar 16 16:02:41 crc kubenswrapper[5120]: I0316 16:02:41.719636 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-w8fv5"] Mar 16 16:02:41 crc kubenswrapper[5120]: I0316 16:02:41.727336 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-db-create-hs54b" Mar 16 16:02:41 crc kubenswrapper[5120]: I0316 16:02:41.751995 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-59d2-account-create-update-v497d"] Mar 16 16:02:41 crc kubenswrapper[5120]: I0316 16:02:41.753698 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0f60c073-48fe-42f1-93ed-3b06d768b602-operator-scripts\") pod \"nova-api-c16c-account-create-update-548pc\" (UID: \"0f60c073-48fe-42f1-93ed-3b06d768b602\") " pod="openstack-kuttl-tests/nova-api-c16c-account-create-update-548pc" Mar 16 16:02:41 crc kubenswrapper[5120]: I0316 16:02:41.753817 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mx2h5\" (UniqueName: \"kubernetes.io/projected/0f60c073-48fe-42f1-93ed-3b06d768b602-kube-api-access-mx2h5\") pod \"nova-api-c16c-account-create-update-548pc\" (UID: \"0f60c073-48fe-42f1-93ed-3b06d768b602\") " pod="openstack-kuttl-tests/nova-api-c16c-account-create-update-548pc" Mar 16 16:02:41 crc kubenswrapper[5120]: I0316 16:02:41.753927 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/dcee9a4c-0584-41d7-ae1a-c6aa0417e113-operator-scripts\") pod \"nova-cell0-db-create-r5xhj\" (UID: \"dcee9a4c-0584-41d7-ae1a-c6aa0417e113\") " pod="openstack-kuttl-tests/nova-cell0-db-create-r5xhj" Mar 16 16:02:41 crc kubenswrapper[5120]: I0316 16:02:41.754090 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wn4vw\" (UniqueName: \"kubernetes.io/projected/dcee9a4c-0584-41d7-ae1a-c6aa0417e113-kube-api-access-wn4vw\") pod \"nova-cell0-db-create-r5xhj\" (UID: \"dcee9a4c-0584-41d7-ae1a-c6aa0417e113\") " pod="openstack-kuttl-tests/nova-cell0-db-create-r5xhj" Mar 16 16:02:41 crc kubenswrapper[5120]: I0316 16:02:41.760601 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/dcee9a4c-0584-41d7-ae1a-c6aa0417e113-operator-scripts\") pod \"nova-cell0-db-create-r5xhj\" (UID: \"dcee9a4c-0584-41d7-ae1a-c6aa0417e113\") " pod="openstack-kuttl-tests/nova-cell0-db-create-r5xhj" Mar 16 16:02:41 crc kubenswrapper[5120]: I0316 16:02:41.778697 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-59d2-account-create-update-v497d" Mar 16 16:02:41 crc kubenswrapper[5120]: I0316 16:02:41.782184 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-db-secret\"" Mar 16 16:02:41 crc kubenswrapper[5120]: I0316 16:02:41.788267 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wn4vw\" (UniqueName: \"kubernetes.io/projected/dcee9a4c-0584-41d7-ae1a-c6aa0417e113-kube-api-access-wn4vw\") pod \"nova-cell0-db-create-r5xhj\" (UID: \"dcee9a4c-0584-41d7-ae1a-c6aa0417e113\") " pod="openstack-kuttl-tests/nova-cell0-db-create-r5xhj" Mar 16 16:02:41 crc kubenswrapper[5120]: I0316 16:02:41.808031 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-59d2-account-create-update-v497d"] Mar 16 16:02:41 crc kubenswrapper[5120]: I0316 16:02:41.855304 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwtvp\" (UniqueName: \"kubernetes.io/projected/741f7b8c-fe99-4ac7-ae79-66467c521b87-kube-api-access-bwtvp\") pod \"nova-cell0-59d2-account-create-update-v497d\" (UID: \"741f7b8c-fe99-4ac7-ae79-66467c521b87\") " pod="openstack-kuttl-tests/nova-cell0-59d2-account-create-update-v497d" Mar 16 16:02:41 crc kubenswrapper[5120]: I0316 16:02:41.855382 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/17bda818-e2b3-45b5-9c0b-2626dadbeb45-operator-scripts\") pod \"nova-cell1-db-create-w8fv5\" (UID: \"17bda818-e2b3-45b5-9c0b-2626dadbeb45\") " pod="openstack-kuttl-tests/nova-cell1-db-create-w8fv5" Mar 16 16:02:41 crc kubenswrapper[5120]: I0316 16:02:41.855432 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0f60c073-48fe-42f1-93ed-3b06d768b602-operator-scripts\") pod \"nova-api-c16c-account-create-update-548pc\" (UID: \"0f60c073-48fe-42f1-93ed-3b06d768b602\") " pod="openstack-kuttl-tests/nova-api-c16c-account-create-update-548pc" Mar 16 16:02:41 crc kubenswrapper[5120]: I0316 16:02:41.855483 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mx2h5\" (UniqueName: \"kubernetes.io/projected/0f60c073-48fe-42f1-93ed-3b06d768b602-kube-api-access-mx2h5\") pod \"nova-api-c16c-account-create-update-548pc\" (UID: \"0f60c073-48fe-42f1-93ed-3b06d768b602\") " pod="openstack-kuttl-tests/nova-api-c16c-account-create-update-548pc" Mar 16 16:02:41 crc kubenswrapper[5120]: I0316 16:02:41.855524 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/741f7b8c-fe99-4ac7-ae79-66467c521b87-operator-scripts\") pod \"nova-cell0-59d2-account-create-update-v497d\" (UID: \"741f7b8c-fe99-4ac7-ae79-66467c521b87\") " pod="openstack-kuttl-tests/nova-cell0-59d2-account-create-update-v497d" Mar 16 16:02:41 crc kubenswrapper[5120]: I0316 16:02:41.855579 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wqls\" (UniqueName: \"kubernetes.io/projected/17bda818-e2b3-45b5-9c0b-2626dadbeb45-kube-api-access-2wqls\") pod \"nova-cell1-db-create-w8fv5\" (UID: \"17bda818-e2b3-45b5-9c0b-2626dadbeb45\") " pod="openstack-kuttl-tests/nova-cell1-db-create-w8fv5" Mar 16 16:02:41 crc kubenswrapper[5120]: I0316 16:02:41.856395 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0f60c073-48fe-42f1-93ed-3b06d768b602-operator-scripts\") pod \"nova-api-c16c-account-create-update-548pc\" (UID: \"0f60c073-48fe-42f1-93ed-3b06d768b602\") " pod="openstack-kuttl-tests/nova-api-c16c-account-create-update-548pc" Mar 16 16:02:41 crc kubenswrapper[5120]: I0316 16:02:41.888843 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mx2h5\" (UniqueName: \"kubernetes.io/projected/0f60c073-48fe-42f1-93ed-3b06d768b602-kube-api-access-mx2h5\") pod \"nova-api-c16c-account-create-update-548pc\" (UID: \"0f60c073-48fe-42f1-93ed-3b06d768b602\") " pod="openstack-kuttl-tests/nova-api-c16c-account-create-update-548pc" Mar 16 16:02:41 crc kubenswrapper[5120]: I0316 16:02:41.891135 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-db-create-r5xhj" Mar 16 16:02:41 crc kubenswrapper[5120]: I0316 16:02:41.906401 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-b179-account-create-update-fmjzp"] Mar 16 16:02:41 crc kubenswrapper[5120]: I0316 16:02:41.922498 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-b179-account-create-update-fmjzp" Mar 16 16:02:41 crc kubenswrapper[5120]: I0316 16:02:41.924723 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-db-secret\"" Mar 16 16:02:41 crc kubenswrapper[5120]: I0316 16:02:41.932197 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-b179-account-create-update-fmjzp"] Mar 16 16:02:41 crc kubenswrapper[5120]: I0316 16:02:41.960022 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bwtvp\" (UniqueName: \"kubernetes.io/projected/741f7b8c-fe99-4ac7-ae79-66467c521b87-kube-api-access-bwtvp\") pod \"nova-cell0-59d2-account-create-update-v497d\" (UID: \"741f7b8c-fe99-4ac7-ae79-66467c521b87\") " pod="openstack-kuttl-tests/nova-cell0-59d2-account-create-update-v497d" Mar 16 16:02:41 crc kubenswrapper[5120]: I0316 16:02:41.960068 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/17bda818-e2b3-45b5-9c0b-2626dadbeb45-operator-scripts\") pod \"nova-cell1-db-create-w8fv5\" (UID: \"17bda818-e2b3-45b5-9c0b-2626dadbeb45\") " pod="openstack-kuttl-tests/nova-cell1-db-create-w8fv5" Mar 16 16:02:41 crc kubenswrapper[5120]: I0316 16:02:41.960158 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/741f7b8c-fe99-4ac7-ae79-66467c521b87-operator-scripts\") pod \"nova-cell0-59d2-account-create-update-v497d\" (UID: \"741f7b8c-fe99-4ac7-ae79-66467c521b87\") " pod="openstack-kuttl-tests/nova-cell0-59d2-account-create-update-v497d" Mar 16 16:02:41 crc kubenswrapper[5120]: I0316 16:02:41.960212 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2wqls\" (UniqueName: \"kubernetes.io/projected/17bda818-e2b3-45b5-9c0b-2626dadbeb45-kube-api-access-2wqls\") pod \"nova-cell1-db-create-w8fv5\" (UID: \"17bda818-e2b3-45b5-9c0b-2626dadbeb45\") " pod="openstack-kuttl-tests/nova-cell1-db-create-w8fv5" Mar 16 16:02:41 crc kubenswrapper[5120]: I0316 16:02:41.960807 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-c16c-account-create-update-548pc" Mar 16 16:02:41 crc kubenswrapper[5120]: I0316 16:02:41.961086 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/17bda818-e2b3-45b5-9c0b-2626dadbeb45-operator-scripts\") pod \"nova-cell1-db-create-w8fv5\" (UID: \"17bda818-e2b3-45b5-9c0b-2626dadbeb45\") " pod="openstack-kuttl-tests/nova-cell1-db-create-w8fv5" Mar 16 16:02:41 crc kubenswrapper[5120]: I0316 16:02:41.961278 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/741f7b8c-fe99-4ac7-ae79-66467c521b87-operator-scripts\") pod \"nova-cell0-59d2-account-create-update-v497d\" (UID: \"741f7b8c-fe99-4ac7-ae79-66467c521b87\") " pod="openstack-kuttl-tests/nova-cell0-59d2-account-create-update-v497d" Mar 16 16:02:41 crc kubenswrapper[5120]: I0316 16:02:41.981519 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wqls\" (UniqueName: \"kubernetes.io/projected/17bda818-e2b3-45b5-9c0b-2626dadbeb45-kube-api-access-2wqls\") pod \"nova-cell1-db-create-w8fv5\" (UID: \"17bda818-e2b3-45b5-9c0b-2626dadbeb45\") " pod="openstack-kuttl-tests/nova-cell1-db-create-w8fv5" Mar 16 16:02:41 crc kubenswrapper[5120]: I0316 16:02:41.993814 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwtvp\" (UniqueName: \"kubernetes.io/projected/741f7b8c-fe99-4ac7-ae79-66467c521b87-kube-api-access-bwtvp\") pod \"nova-cell0-59d2-account-create-update-v497d\" (UID: \"741f7b8c-fe99-4ac7-ae79-66467c521b87\") " pod="openstack-kuttl-tests/nova-cell0-59d2-account-create-update-v497d" Mar 16 16:02:41 crc kubenswrapper[5120]: I0316 16:02:41.999677 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-59d2-account-create-update-v497d" Mar 16 16:02:42 crc kubenswrapper[5120]: I0316 16:02:42.063809 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5tw5\" (UniqueName: \"kubernetes.io/projected/0f3d3f0d-b689-423c-b909-2315446b2955-kube-api-access-t5tw5\") pod \"nova-cell1-b179-account-create-update-fmjzp\" (UID: \"0f3d3f0d-b689-423c-b909-2315446b2955\") " pod="openstack-kuttl-tests/nova-cell1-b179-account-create-update-fmjzp" Mar 16 16:02:42 crc kubenswrapper[5120]: I0316 16:02:42.063870 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0f3d3f0d-b689-423c-b909-2315446b2955-operator-scripts\") pod \"nova-cell1-b179-account-create-update-fmjzp\" (UID: \"0f3d3f0d-b689-423c-b909-2315446b2955\") " pod="openstack-kuttl-tests/nova-cell1-b179-account-create-update-fmjzp" Mar 16 16:02:42 crc kubenswrapper[5120]: I0316 16:02:42.165334 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t5tw5\" (UniqueName: \"kubernetes.io/projected/0f3d3f0d-b689-423c-b909-2315446b2955-kube-api-access-t5tw5\") pod \"nova-cell1-b179-account-create-update-fmjzp\" (UID: \"0f3d3f0d-b689-423c-b909-2315446b2955\") " pod="openstack-kuttl-tests/nova-cell1-b179-account-create-update-fmjzp" Mar 16 16:02:42 crc kubenswrapper[5120]: I0316 16:02:42.165398 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0f3d3f0d-b689-423c-b909-2315446b2955-operator-scripts\") pod \"nova-cell1-b179-account-create-update-fmjzp\" (UID: \"0f3d3f0d-b689-423c-b909-2315446b2955\") " pod="openstack-kuttl-tests/nova-cell1-b179-account-create-update-fmjzp" Mar 16 16:02:42 crc kubenswrapper[5120]: I0316 16:02:42.166777 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0f3d3f0d-b689-423c-b909-2315446b2955-operator-scripts\") pod \"nova-cell1-b179-account-create-update-fmjzp\" (UID: \"0f3d3f0d-b689-423c-b909-2315446b2955\") " pod="openstack-kuttl-tests/nova-cell1-b179-account-create-update-fmjzp" Mar 16 16:02:42 crc kubenswrapper[5120]: I0316 16:02:42.197530 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5tw5\" (UniqueName: \"kubernetes.io/projected/0f3d3f0d-b689-423c-b909-2315446b2955-kube-api-access-t5tw5\") pod \"nova-cell1-b179-account-create-update-fmjzp\" (UID: \"0f3d3f0d-b689-423c-b909-2315446b2955\") " pod="openstack-kuttl-tests/nova-cell1-b179-account-create-update-fmjzp" Mar 16 16:02:42 crc kubenswrapper[5120]: I0316 16:02:42.212927 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-db-create-w8fv5" Mar 16 16:02:42 crc kubenswrapper[5120]: I0316 16:02:42.316268 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-b179-account-create-update-fmjzp" Mar 16 16:02:42 crc kubenswrapper[5120]: I0316 16:02:42.409833 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-hs54b"] Mar 16 16:02:42 crc kubenswrapper[5120]: W0316 16:02:42.442619 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8a1e66b1_adb2_4ddb_bca1_257a1646ebda.slice/crio-f496fcf1217c019fa33b6ae9e460cfa078d9e67ba650d3d1ccda62739af5401a WatchSource:0}: Error finding container f496fcf1217c019fa33b6ae9e460cfa078d9e67ba650d3d1ccda62739af5401a: Status 404 returned error can't find the container with id f496fcf1217c019fa33b6ae9e460cfa078d9e67ba650d3d1ccda62739af5401a Mar 16 16:02:42 crc kubenswrapper[5120]: I0316 16:02:42.485557 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-r5xhj"] Mar 16 16:02:42 crc kubenswrapper[5120]: I0316 16:02:42.629074 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/swift-proxy-687cfbc4db-ngqr9"] Mar 16 16:02:42 crc kubenswrapper[5120]: W0316 16:02:42.643927 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0f60c073_48fe_42f1_93ed_3b06d768b602.slice/crio-53298be2c86f7699f4b188d978c80aa4daa5d118c4fa847a1ca67b43ad46505f WatchSource:0}: Error finding container 53298be2c86f7699f4b188d978c80aa4daa5d118c4fa847a1ca67b43ad46505f: Status 404 returned error can't find the container with id 53298be2c86f7699f4b188d978c80aa4daa5d118c4fa847a1ca67b43ad46505f Mar 16 16:02:42 crc kubenswrapper[5120]: I0316 16:02:42.644367 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-687cfbc4db-ngqr9" Mar 16 16:02:42 crc kubenswrapper[5120]: I0316 16:02:42.646591 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-swift-internal-svc\"" Mar 16 16:02:42 crc kubenswrapper[5120]: I0316 16:02:42.647878 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-swift-public-svc\"" Mar 16 16:02:42 crc kubenswrapper[5120]: I0316 16:02:42.650842 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"swift-proxy-config-data\"" Mar 16 16:02:42 crc kubenswrapper[5120]: I0316 16:02:42.659012 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-w8fv5"] Mar 16 16:02:42 crc kubenswrapper[5120]: I0316 16:02:42.713466 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-59d2-account-create-update-v497d"] Mar 16 16:02:42 crc kubenswrapper[5120]: I0316 16:02:42.726598 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-proxy-687cfbc4db-ngqr9"] Mar 16 16:02:42 crc kubenswrapper[5120]: I0316 16:02:42.738923 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-c16c-account-create-update-548pc"] Mar 16 16:02:42 crc kubenswrapper[5120]: I0316 16:02:42.802120 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/1cccc0e5-40f8-4ed9-9b3d-f7c667475288-internal-tls-certs\") pod \"swift-proxy-687cfbc4db-ngqr9\" (UID: \"1cccc0e5-40f8-4ed9-9b3d-f7c667475288\") " pod="openstack-kuttl-tests/swift-proxy-687cfbc4db-ngqr9" Mar 16 16:02:42 crc kubenswrapper[5120]: I0316 16:02:42.802167 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1cccc0e5-40f8-4ed9-9b3d-f7c667475288-config-data\") pod \"swift-proxy-687cfbc4db-ngqr9\" (UID: \"1cccc0e5-40f8-4ed9-9b3d-f7c667475288\") " pod="openstack-kuttl-tests/swift-proxy-687cfbc4db-ngqr9" Mar 16 16:02:42 crc kubenswrapper[5120]: I0316 16:02:42.802192 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1cccc0e5-40f8-4ed9-9b3d-f7c667475288-run-httpd\") pod \"swift-proxy-687cfbc4db-ngqr9\" (UID: \"1cccc0e5-40f8-4ed9-9b3d-f7c667475288\") " pod="openstack-kuttl-tests/swift-proxy-687cfbc4db-ngqr9" Mar 16 16:02:42 crc kubenswrapper[5120]: I0316 16:02:42.802234 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/1cccc0e5-40f8-4ed9-9b3d-f7c667475288-public-tls-certs\") pod \"swift-proxy-687cfbc4db-ngqr9\" (UID: \"1cccc0e5-40f8-4ed9-9b3d-f7c667475288\") " pod="openstack-kuttl-tests/swift-proxy-687cfbc4db-ngqr9" Mar 16 16:02:42 crc kubenswrapper[5120]: I0316 16:02:42.802283 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/1cccc0e5-40f8-4ed9-9b3d-f7c667475288-etc-swift\") pod \"swift-proxy-687cfbc4db-ngqr9\" (UID: \"1cccc0e5-40f8-4ed9-9b3d-f7c667475288\") " pod="openstack-kuttl-tests/swift-proxy-687cfbc4db-ngqr9" Mar 16 16:02:42 crc kubenswrapper[5120]: I0316 16:02:42.802311 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1cccc0e5-40f8-4ed9-9b3d-f7c667475288-combined-ca-bundle\") pod \"swift-proxy-687cfbc4db-ngqr9\" (UID: \"1cccc0e5-40f8-4ed9-9b3d-f7c667475288\") " pod="openstack-kuttl-tests/swift-proxy-687cfbc4db-ngqr9" Mar 16 16:02:42 crc kubenswrapper[5120]: I0316 16:02:42.802397 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1cccc0e5-40f8-4ed9-9b3d-f7c667475288-log-httpd\") pod \"swift-proxy-687cfbc4db-ngqr9\" (UID: \"1cccc0e5-40f8-4ed9-9b3d-f7c667475288\") " pod="openstack-kuttl-tests/swift-proxy-687cfbc4db-ngqr9" Mar 16 16:02:42 crc kubenswrapper[5120]: I0316 16:02:42.802445 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vsctl\" (UniqueName: \"kubernetes.io/projected/1cccc0e5-40f8-4ed9-9b3d-f7c667475288-kube-api-access-vsctl\") pod \"swift-proxy-687cfbc4db-ngqr9\" (UID: \"1cccc0e5-40f8-4ed9-9b3d-f7c667475288\") " pod="openstack-kuttl-tests/swift-proxy-687cfbc4db-ngqr9" Mar 16 16:02:42 crc kubenswrapper[5120]: I0316 16:02:42.908065 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vsctl\" (UniqueName: \"kubernetes.io/projected/1cccc0e5-40f8-4ed9-9b3d-f7c667475288-kube-api-access-vsctl\") pod \"swift-proxy-687cfbc4db-ngqr9\" (UID: \"1cccc0e5-40f8-4ed9-9b3d-f7c667475288\") " pod="openstack-kuttl-tests/swift-proxy-687cfbc4db-ngqr9" Mar 16 16:02:42 crc kubenswrapper[5120]: I0316 16:02:42.912578 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/1cccc0e5-40f8-4ed9-9b3d-f7c667475288-internal-tls-certs\") pod \"swift-proxy-687cfbc4db-ngqr9\" (UID: \"1cccc0e5-40f8-4ed9-9b3d-f7c667475288\") " pod="openstack-kuttl-tests/swift-proxy-687cfbc4db-ngqr9" Mar 16 16:02:42 crc kubenswrapper[5120]: I0316 16:02:42.913042 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1cccc0e5-40f8-4ed9-9b3d-f7c667475288-config-data\") pod \"swift-proxy-687cfbc4db-ngqr9\" (UID: \"1cccc0e5-40f8-4ed9-9b3d-f7c667475288\") " pod="openstack-kuttl-tests/swift-proxy-687cfbc4db-ngqr9" Mar 16 16:02:42 crc kubenswrapper[5120]: I0316 16:02:42.913138 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1cccc0e5-40f8-4ed9-9b3d-f7c667475288-run-httpd\") pod \"swift-proxy-687cfbc4db-ngqr9\" (UID: \"1cccc0e5-40f8-4ed9-9b3d-f7c667475288\") " pod="openstack-kuttl-tests/swift-proxy-687cfbc4db-ngqr9" Mar 16 16:02:42 crc kubenswrapper[5120]: I0316 16:02:42.913229 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/1cccc0e5-40f8-4ed9-9b3d-f7c667475288-public-tls-certs\") pod \"swift-proxy-687cfbc4db-ngqr9\" (UID: \"1cccc0e5-40f8-4ed9-9b3d-f7c667475288\") " pod="openstack-kuttl-tests/swift-proxy-687cfbc4db-ngqr9" Mar 16 16:02:42 crc kubenswrapper[5120]: I0316 16:02:42.913341 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/1cccc0e5-40f8-4ed9-9b3d-f7c667475288-etc-swift\") pod \"swift-proxy-687cfbc4db-ngqr9\" (UID: \"1cccc0e5-40f8-4ed9-9b3d-f7c667475288\") " pod="openstack-kuttl-tests/swift-proxy-687cfbc4db-ngqr9" Mar 16 16:02:42 crc kubenswrapper[5120]: I0316 16:02:42.913382 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1cccc0e5-40f8-4ed9-9b3d-f7c667475288-combined-ca-bundle\") pod \"swift-proxy-687cfbc4db-ngqr9\" (UID: \"1cccc0e5-40f8-4ed9-9b3d-f7c667475288\") " pod="openstack-kuttl-tests/swift-proxy-687cfbc4db-ngqr9" Mar 16 16:02:42 crc kubenswrapper[5120]: I0316 16:02:42.914117 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1cccc0e5-40f8-4ed9-9b3d-f7c667475288-log-httpd\") pod \"swift-proxy-687cfbc4db-ngqr9\" (UID: \"1cccc0e5-40f8-4ed9-9b3d-f7c667475288\") " pod="openstack-kuttl-tests/swift-proxy-687cfbc4db-ngqr9" Mar 16 16:02:42 crc kubenswrapper[5120]: I0316 16:02:42.914529 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1cccc0e5-40f8-4ed9-9b3d-f7c667475288-run-httpd\") pod \"swift-proxy-687cfbc4db-ngqr9\" (UID: \"1cccc0e5-40f8-4ed9-9b3d-f7c667475288\") " pod="openstack-kuttl-tests/swift-proxy-687cfbc4db-ngqr9" Mar 16 16:02:42 crc kubenswrapper[5120]: I0316 16:02:42.914604 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1cccc0e5-40f8-4ed9-9b3d-f7c667475288-log-httpd\") pod \"swift-proxy-687cfbc4db-ngqr9\" (UID: \"1cccc0e5-40f8-4ed9-9b3d-f7c667475288\") " pod="openstack-kuttl-tests/swift-proxy-687cfbc4db-ngqr9" Mar 16 16:02:42 crc kubenswrapper[5120]: I0316 16:02:42.922502 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/1cccc0e5-40f8-4ed9-9b3d-f7c667475288-public-tls-certs\") pod \"swift-proxy-687cfbc4db-ngqr9\" (UID: \"1cccc0e5-40f8-4ed9-9b3d-f7c667475288\") " pod="openstack-kuttl-tests/swift-proxy-687cfbc4db-ngqr9" Mar 16 16:02:42 crc kubenswrapper[5120]: I0316 16:02:42.923279 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/1cccc0e5-40f8-4ed9-9b3d-f7c667475288-internal-tls-certs\") pod \"swift-proxy-687cfbc4db-ngqr9\" (UID: \"1cccc0e5-40f8-4ed9-9b3d-f7c667475288\") " pod="openstack-kuttl-tests/swift-proxy-687cfbc4db-ngqr9" Mar 16 16:02:42 crc kubenswrapper[5120]: I0316 16:02:42.925985 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/1cccc0e5-40f8-4ed9-9b3d-f7c667475288-etc-swift\") pod \"swift-proxy-687cfbc4db-ngqr9\" (UID: \"1cccc0e5-40f8-4ed9-9b3d-f7c667475288\") " pod="openstack-kuttl-tests/swift-proxy-687cfbc4db-ngqr9" Mar 16 16:02:42 crc kubenswrapper[5120]: I0316 16:02:42.926120 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1cccc0e5-40f8-4ed9-9b3d-f7c667475288-combined-ca-bundle\") pod \"swift-proxy-687cfbc4db-ngqr9\" (UID: \"1cccc0e5-40f8-4ed9-9b3d-f7c667475288\") " pod="openstack-kuttl-tests/swift-proxy-687cfbc4db-ngqr9" Mar 16 16:02:42 crc kubenswrapper[5120]: W0316 16:02:42.928451 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0f3d3f0d_b689_423c_b909_2315446b2955.slice/crio-51fcd37d9960b14ea84902de57bd9f5e3aa80d5fd1fbf49db40105cacb8b482a WatchSource:0}: Error finding container 51fcd37d9960b14ea84902de57bd9f5e3aa80d5fd1fbf49db40105cacb8b482a: Status 404 returned error can't find the container with id 51fcd37d9960b14ea84902de57bd9f5e3aa80d5fd1fbf49db40105cacb8b482a Mar 16 16:02:42 crc kubenswrapper[5120]: I0316 16:02:42.930569 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vsctl\" (UniqueName: \"kubernetes.io/projected/1cccc0e5-40f8-4ed9-9b3d-f7c667475288-kube-api-access-vsctl\") pod \"swift-proxy-687cfbc4db-ngqr9\" (UID: \"1cccc0e5-40f8-4ed9-9b3d-f7c667475288\") " pod="openstack-kuttl-tests/swift-proxy-687cfbc4db-ngqr9" Mar 16 16:02:42 crc kubenswrapper[5120]: I0316 16:02:42.931879 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-b179-account-create-update-fmjzp"] Mar 16 16:02:42 crc kubenswrapper[5120]: I0316 16:02:42.953220 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1cccc0e5-40f8-4ed9-9b3d-f7c667475288-config-data\") pod \"swift-proxy-687cfbc4db-ngqr9\" (UID: \"1cccc0e5-40f8-4ed9-9b3d-f7c667475288\") " pod="openstack-kuttl-tests/swift-proxy-687cfbc4db-ngqr9" Mar 16 16:02:42 crc kubenswrapper[5120]: I0316 16:02:42.992306 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-687cfbc4db-ngqr9" Mar 16 16:02:43 crc kubenswrapper[5120]: I0316 16:02:43.343683 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-db-create-w8fv5" event={"ID":"17bda818-e2b3-45b5-9c0b-2626dadbeb45","Type":"ContainerStarted","Data":"b0b9d5ea808914c8c7613e8d3780917d9f9be56b3aaa7ca8367dfcf4cd686e1e"} Mar 16 16:02:43 crc kubenswrapper[5120]: I0316 16:02:43.344226 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-db-create-w8fv5" event={"ID":"17bda818-e2b3-45b5-9c0b-2626dadbeb45","Type":"ContainerStarted","Data":"1e1b22fea5736a2e86566a67033473363f9dd2949fafa31a9364224057cbd450"} Mar 16 16:02:43 crc kubenswrapper[5120]: I0316 16:02:43.347702 5120 generic.go:358] "Generic (PLEG): container finished" podID="8a1e66b1-adb2-4ddb-bca1-257a1646ebda" containerID="d60742166250557579b355a079a259e60dc389a623241387971ff86264ec58f3" exitCode=0 Mar 16 16:02:43 crc kubenswrapper[5120]: I0316 16:02:43.347822 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-db-create-hs54b" event={"ID":"8a1e66b1-adb2-4ddb-bca1-257a1646ebda","Type":"ContainerDied","Data":"d60742166250557579b355a079a259e60dc389a623241387971ff86264ec58f3"} Mar 16 16:02:43 crc kubenswrapper[5120]: I0316 16:02:43.348264 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-db-create-hs54b" event={"ID":"8a1e66b1-adb2-4ddb-bca1-257a1646ebda","Type":"ContainerStarted","Data":"f496fcf1217c019fa33b6ae9e460cfa078d9e67ba650d3d1ccda62739af5401a"} Mar 16 16:02:43 crc kubenswrapper[5120]: I0316 16:02:43.353058 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-59d2-account-create-update-v497d" event={"ID":"741f7b8c-fe99-4ac7-ae79-66467c521b87","Type":"ContainerStarted","Data":"a10f652c6f9dd13d1cefdaca4624cc5853fabb476bdc810aa820dd9d740d209d"} Mar 16 16:02:43 crc kubenswrapper[5120]: I0316 16:02:43.353099 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-59d2-account-create-update-v497d" event={"ID":"741f7b8c-fe99-4ac7-ae79-66467c521b87","Type":"ContainerStarted","Data":"cfbeeb67e4f3e8ff20d65167d951a71d75f10391954c9d5c8889a8174587178a"} Mar 16 16:02:43 crc kubenswrapper[5120]: I0316 16:02:43.355977 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-c16c-account-create-update-548pc" event={"ID":"0f60c073-48fe-42f1-93ed-3b06d768b602","Type":"ContainerStarted","Data":"fcac69ec6ee9fe77546a1a5134f2d123d3a1a9780f58876c2e6686c4e99f71f8"} Mar 16 16:02:43 crc kubenswrapper[5120]: I0316 16:02:43.356037 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-c16c-account-create-update-548pc" event={"ID":"0f60c073-48fe-42f1-93ed-3b06d768b602","Type":"ContainerStarted","Data":"53298be2c86f7699f4b188d978c80aa4daa5d118c4fa847a1ca67b43ad46505f"} Mar 16 16:02:43 crc kubenswrapper[5120]: I0316 16:02:43.366330 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-db-create-r5xhj" event={"ID":"dcee9a4c-0584-41d7-ae1a-c6aa0417e113","Type":"ContainerStarted","Data":"1baba62653ca28a6e2a3f3c314e39af94092f9fe8166b8c9fe0e71e5269c26bc"} Mar 16 16:02:43 crc kubenswrapper[5120]: I0316 16:02:43.366382 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-db-create-r5xhj" event={"ID":"dcee9a4c-0584-41d7-ae1a-c6aa0417e113","Type":"ContainerStarted","Data":"6a31ed7405d47f9e646631f71af77c57ecffe2cc35eee3e807f60cd0642f48c4"} Mar 16 16:02:43 crc kubenswrapper[5120]: I0316 16:02:43.367133 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-db-create-w8fv5" podStartSLOduration=2.366653641 podStartE2EDuration="2.366653641s" podCreationTimestamp="2026-03-16 16:02:41 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:02:43.359671149 +0000 UTC m=+1865.513602806" watchObservedRunningTime="2026-03-16 16:02:43.366653641 +0000 UTC m=+1865.520585298" Mar 16 16:02:43 crc kubenswrapper[5120]: I0316 16:02:43.372426 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-b179-account-create-update-fmjzp" event={"ID":"0f3d3f0d-b689-423c-b909-2315446b2955","Type":"ContainerStarted","Data":"05692c439c74f95df50502628c3694f08cb930b68321ec30298196ce2dd57c8c"} Mar 16 16:02:43 crc kubenswrapper[5120]: I0316 16:02:43.372460 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-b179-account-create-update-fmjzp" event={"ID":"0f3d3f0d-b689-423c-b909-2315446b2955","Type":"ContainerStarted","Data":"51fcd37d9960b14ea84902de57bd9f5e3aa80d5fd1fbf49db40105cacb8b482a"} Mar 16 16:02:43 crc kubenswrapper[5120]: I0316 16:02:43.387351 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-c16c-account-create-update-548pc" podStartSLOduration=2.387327471 podStartE2EDuration="2.387327471s" podCreationTimestamp="2026-03-16 16:02:41 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:02:43.380062101 +0000 UTC m=+1865.533993758" watchObservedRunningTime="2026-03-16 16:02:43.387327471 +0000 UTC m=+1865.541259128" Mar 16 16:02:43 crc kubenswrapper[5120]: I0316 16:02:43.396181 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-59d2-account-create-update-v497d" podStartSLOduration=2.396136743 podStartE2EDuration="2.396136743s" podCreationTimestamp="2026-03-16 16:02:41 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:02:43.395482855 +0000 UTC m=+1865.549414512" watchObservedRunningTime="2026-03-16 16:02:43.396136743 +0000 UTC m=+1865.550068400" Mar 16 16:02:43 crc kubenswrapper[5120]: I0316 16:02:43.432339 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-b179-account-create-update-fmjzp" podStartSLOduration=2.432321189 podStartE2EDuration="2.432321189s" podCreationTimestamp="2026-03-16 16:02:41 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:02:43.426126169 +0000 UTC m=+1865.580057846" watchObservedRunningTime="2026-03-16 16:02:43.432321189 +0000 UTC m=+1865.586252836" Mar 16 16:02:43 crc kubenswrapper[5120]: I0316 16:02:43.526966 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-proxy-687cfbc4db-ngqr9"] Mar 16 16:02:44 crc kubenswrapper[5120]: I0316 16:02:44.021661 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:02:44 crc kubenswrapper[5120]: I0316 16:02:44.023882 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="41237879-5c40-4f4b-ad6f-39dab45ba2d5" containerName="ceilometer-central-agent" containerID="cri-o://2f0ea56a5de0726897ddaaf22edcdae384e978440fa164de4d6a31de3aff53ea" gracePeriod=30 Mar 16 16:02:44 crc kubenswrapper[5120]: I0316 16:02:44.024161 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="41237879-5c40-4f4b-ad6f-39dab45ba2d5" containerName="sg-core" containerID="cri-o://b84a927664ad8c9691c79d3bfb344d69ca2e8aa82fef990853248665318ff473" gracePeriod=30 Mar 16 16:02:44 crc kubenswrapper[5120]: I0316 16:02:44.024223 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="41237879-5c40-4f4b-ad6f-39dab45ba2d5" containerName="ceilometer-notification-agent" containerID="cri-o://c7e01ef8a3e8a351182b7ad447cfd063af28c5831169928ef5c7e3d7d27fe70b" gracePeriod=30 Mar 16 16:02:44 crc kubenswrapper[5120]: I0316 16:02:44.024387 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="41237879-5c40-4f4b-ad6f-39dab45ba2d5" containerName="proxy-httpd" containerID="cri-o://afe5dec266570eb41825b0c918ca41d10d6fe21669149ad76a5ea2fa6e5d12e8" gracePeriod=30 Mar 16 16:02:44 crc kubenswrapper[5120]: I0316 16:02:44.033013 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:02:44 crc kubenswrapper[5120]: I0316 16:02:44.405884 5120 generic.go:358] "Generic (PLEG): container finished" podID="741f7b8c-fe99-4ac7-ae79-66467c521b87" containerID="a10f652c6f9dd13d1cefdaca4624cc5853fabb476bdc810aa820dd9d740d209d" exitCode=0 Mar 16 16:02:44 crc kubenswrapper[5120]: I0316 16:02:44.406316 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-59d2-account-create-update-v497d" event={"ID":"741f7b8c-fe99-4ac7-ae79-66467c521b87","Type":"ContainerDied","Data":"a10f652c6f9dd13d1cefdaca4624cc5853fabb476bdc810aa820dd9d740d209d"} Mar 16 16:02:44 crc kubenswrapper[5120]: I0316 16:02:44.425159 5120 generic.go:358] "Generic (PLEG): container finished" podID="0f60c073-48fe-42f1-93ed-3b06d768b602" containerID="fcac69ec6ee9fe77546a1a5134f2d123d3a1a9780f58876c2e6686c4e99f71f8" exitCode=0 Mar 16 16:02:44 crc kubenswrapper[5120]: I0316 16:02:44.425469 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-c16c-account-create-update-548pc" event={"ID":"0f60c073-48fe-42f1-93ed-3b06d768b602","Type":"ContainerDied","Data":"fcac69ec6ee9fe77546a1a5134f2d123d3a1a9780f58876c2e6686c4e99f71f8"} Mar 16 16:02:44 crc kubenswrapper[5120]: I0316 16:02:44.432975 5120 generic.go:358] "Generic (PLEG): container finished" podID="dcee9a4c-0584-41d7-ae1a-c6aa0417e113" containerID="1baba62653ca28a6e2a3f3c314e39af94092f9fe8166b8c9fe0e71e5269c26bc" exitCode=0 Mar 16 16:02:44 crc kubenswrapper[5120]: I0316 16:02:44.433039 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-db-create-r5xhj" event={"ID":"dcee9a4c-0584-41d7-ae1a-c6aa0417e113","Type":"ContainerDied","Data":"1baba62653ca28a6e2a3f3c314e39af94092f9fe8166b8c9fe0e71e5269c26bc"} Mar 16 16:02:44 crc kubenswrapper[5120]: I0316 16:02:44.459191 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-687cfbc4db-ngqr9" event={"ID":"1cccc0e5-40f8-4ed9-9b3d-f7c667475288","Type":"ContainerStarted","Data":"618551cca919c1c9a479a978588c91bbc6d144f786f3b83f5bfa042209795dec"} Mar 16 16:02:44 crc kubenswrapper[5120]: I0316 16:02:44.459269 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-687cfbc4db-ngqr9" event={"ID":"1cccc0e5-40f8-4ed9-9b3d-f7c667475288","Type":"ContainerStarted","Data":"a163ab3521839a34ec882d99811cb4498761451ad0a9a1cd6942d451f1e8f179"} Mar 16 16:02:44 crc kubenswrapper[5120]: I0316 16:02:44.463734 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/swift-proxy-687cfbc4db-ngqr9" Mar 16 16:02:44 crc kubenswrapper[5120]: I0316 16:02:44.463748 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/swift-proxy-687cfbc4db-ngqr9" Mar 16 16:02:44 crc kubenswrapper[5120]: I0316 16:02:44.463782 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-687cfbc4db-ngqr9" event={"ID":"1cccc0e5-40f8-4ed9-9b3d-f7c667475288","Type":"ContainerStarted","Data":"0f8418bf647aa6aed1db56689902140bdd30784fb301b4c81e1baf42da5305a7"} Mar 16 16:02:44 crc kubenswrapper[5120]: I0316 16:02:44.466208 5120 generic.go:358] "Generic (PLEG): container finished" podID="0f3d3f0d-b689-423c-b909-2315446b2955" containerID="05692c439c74f95df50502628c3694f08cb930b68321ec30298196ce2dd57c8c" exitCode=0 Mar 16 16:02:44 crc kubenswrapper[5120]: I0316 16:02:44.466324 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-b179-account-create-update-fmjzp" event={"ID":"0f3d3f0d-b689-423c-b909-2315446b2955","Type":"ContainerDied","Data":"05692c439c74f95df50502628c3694f08cb930b68321ec30298196ce2dd57c8c"} Mar 16 16:02:44 crc kubenswrapper[5120]: I0316 16:02:44.479147 5120 generic.go:358] "Generic (PLEG): container finished" podID="bfe56c80-c472-49dc-8971-db5052d61898" containerID="d15342bf5f1da981a5264feaf7b142259bff5bab0942dc8efe186eb2003e9fb6" exitCode=0 Mar 16 16:02:44 crc kubenswrapper[5120]: I0316 16:02:44.479227 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-5b779bfdf-px7gw" event={"ID":"bfe56c80-c472-49dc-8971-db5052d61898","Type":"ContainerDied","Data":"d15342bf5f1da981a5264feaf7b142259bff5bab0942dc8efe186eb2003e9fb6"} Mar 16 16:02:44 crc kubenswrapper[5120]: I0316 16:02:44.483313 5120 generic.go:358] "Generic (PLEG): container finished" podID="41237879-5c40-4f4b-ad6f-39dab45ba2d5" containerID="afe5dec266570eb41825b0c918ca41d10d6fe21669149ad76a5ea2fa6e5d12e8" exitCode=0 Mar 16 16:02:44 crc kubenswrapper[5120]: I0316 16:02:44.483345 5120 generic.go:358] "Generic (PLEG): container finished" podID="41237879-5c40-4f4b-ad6f-39dab45ba2d5" containerID="b84a927664ad8c9691c79d3bfb344d69ca2e8aa82fef990853248665318ff473" exitCode=2 Mar 16 16:02:44 crc kubenswrapper[5120]: I0316 16:02:44.483457 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"41237879-5c40-4f4b-ad6f-39dab45ba2d5","Type":"ContainerDied","Data":"afe5dec266570eb41825b0c918ca41d10d6fe21669149ad76a5ea2fa6e5d12e8"} Mar 16 16:02:44 crc kubenswrapper[5120]: I0316 16:02:44.483495 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"41237879-5c40-4f4b-ad6f-39dab45ba2d5","Type":"ContainerDied","Data":"b84a927664ad8c9691c79d3bfb344d69ca2e8aa82fef990853248665318ff473"} Mar 16 16:02:44 crc kubenswrapper[5120]: I0316 16:02:44.492174 5120 generic.go:358] "Generic (PLEG): container finished" podID="17bda818-e2b3-45b5-9c0b-2626dadbeb45" containerID="b0b9d5ea808914c8c7613e8d3780917d9f9be56b3aaa7ca8367dfcf4cd686e1e" exitCode=0 Mar 16 16:02:44 crc kubenswrapper[5120]: I0316 16:02:44.492693 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-db-create-w8fv5" event={"ID":"17bda818-e2b3-45b5-9c0b-2626dadbeb45","Type":"ContainerDied","Data":"b0b9d5ea808914c8c7613e8d3780917d9f9be56b3aaa7ca8367dfcf4cd686e1e"} Mar 16 16:02:44 crc kubenswrapper[5120]: I0316 16:02:44.501517 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/swift-proxy-687cfbc4db-ngqr9" podStartSLOduration=2.501496586 podStartE2EDuration="2.501496586s" podCreationTimestamp="2026-03-16 16:02:42 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:02:44.493003842 +0000 UTC m=+1866.646935499" watchObservedRunningTime="2026-03-16 16:02:44.501496586 +0000 UTC m=+1866.655428243" Mar 16 16:02:44 crc kubenswrapper[5120]: I0316 16:02:44.541147 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-5b779bfdf-px7gw" Mar 16 16:02:44 crc kubenswrapper[5120]: I0316 16:02:44.667828 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/bfe56c80-c472-49dc-8971-db5052d61898-ovndb-tls-certs\") pod \"bfe56c80-c472-49dc-8971-db5052d61898\" (UID: \"bfe56c80-c472-49dc-8971-db5052d61898\") " Mar 16 16:02:44 crc kubenswrapper[5120]: I0316 16:02:44.668225 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/bfe56c80-c472-49dc-8971-db5052d61898-config\") pod \"bfe56c80-c472-49dc-8971-db5052d61898\" (UID: \"bfe56c80-c472-49dc-8971-db5052d61898\") " Mar 16 16:02:44 crc kubenswrapper[5120]: I0316 16:02:44.668297 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/bfe56c80-c472-49dc-8971-db5052d61898-httpd-config\") pod \"bfe56c80-c472-49dc-8971-db5052d61898\" (UID: \"bfe56c80-c472-49dc-8971-db5052d61898\") " Mar 16 16:02:44 crc kubenswrapper[5120]: I0316 16:02:44.668425 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ggjfl\" (UniqueName: \"kubernetes.io/projected/bfe56c80-c472-49dc-8971-db5052d61898-kube-api-access-ggjfl\") pod \"bfe56c80-c472-49dc-8971-db5052d61898\" (UID: \"bfe56c80-c472-49dc-8971-db5052d61898\") " Mar 16 16:02:44 crc kubenswrapper[5120]: I0316 16:02:44.668486 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bfe56c80-c472-49dc-8971-db5052d61898-combined-ca-bundle\") pod \"bfe56c80-c472-49dc-8971-db5052d61898\" (UID: \"bfe56c80-c472-49dc-8971-db5052d61898\") " Mar 16 16:02:44 crc kubenswrapper[5120]: I0316 16:02:44.688940 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bfe56c80-c472-49dc-8971-db5052d61898-kube-api-access-ggjfl" (OuterVolumeSpecName: "kube-api-access-ggjfl") pod "bfe56c80-c472-49dc-8971-db5052d61898" (UID: "bfe56c80-c472-49dc-8971-db5052d61898"). InnerVolumeSpecName "kube-api-access-ggjfl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:02:44 crc kubenswrapper[5120]: I0316 16:02:44.689059 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bfe56c80-c472-49dc-8971-db5052d61898-httpd-config" (OuterVolumeSpecName: "httpd-config") pod "bfe56c80-c472-49dc-8971-db5052d61898" (UID: "bfe56c80-c472-49dc-8971-db5052d61898"). InnerVolumeSpecName "httpd-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:02:44 crc kubenswrapper[5120]: I0316 16:02:44.780973 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/bfe56c80-c472-49dc-8971-db5052d61898-httpd-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:02:44 crc kubenswrapper[5120]: I0316 16:02:44.781008 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ggjfl\" (UniqueName: \"kubernetes.io/projected/bfe56c80-c472-49dc-8971-db5052d61898-kube-api-access-ggjfl\") on node \"crc\" DevicePath \"\"" Mar 16 16:02:44 crc kubenswrapper[5120]: I0316 16:02:44.788921 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bfe56c80-c472-49dc-8971-db5052d61898-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "bfe56c80-c472-49dc-8971-db5052d61898" (UID: "bfe56c80-c472-49dc-8971-db5052d61898"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:02:44 crc kubenswrapper[5120]: I0316 16:02:44.806327 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bfe56c80-c472-49dc-8971-db5052d61898-config" (OuterVolumeSpecName: "config") pod "bfe56c80-c472-49dc-8971-db5052d61898" (UID: "bfe56c80-c472-49dc-8971-db5052d61898"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:02:44 crc kubenswrapper[5120]: I0316 16:02:44.842013 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bfe56c80-c472-49dc-8971-db5052d61898-ovndb-tls-certs" (OuterVolumeSpecName: "ovndb-tls-certs") pod "bfe56c80-c472-49dc-8971-db5052d61898" (UID: "bfe56c80-c472-49dc-8971-db5052d61898"). InnerVolumeSpecName "ovndb-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:02:44 crc kubenswrapper[5120]: I0316 16:02:44.882952 5120 reconciler_common.go:299] "Volume detached for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/bfe56c80-c472-49dc-8971-db5052d61898-ovndb-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:02:44 crc kubenswrapper[5120]: I0316 16:02:44.882986 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/bfe56c80-c472-49dc-8971-db5052d61898-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:02:44 crc kubenswrapper[5120]: I0316 16:02:44.882998 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bfe56c80-c472-49dc-8971-db5052d61898-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:02:44 crc kubenswrapper[5120]: I0316 16:02:44.939886 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-db-create-r5xhj" Mar 16 16:02:44 crc kubenswrapper[5120]: I0316 16:02:44.945237 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-db-create-hs54b" Mar 16 16:02:45 crc kubenswrapper[5120]: I0316 16:02:45.086363 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lhdnm\" (UniqueName: \"kubernetes.io/projected/8a1e66b1-adb2-4ddb-bca1-257a1646ebda-kube-api-access-lhdnm\") pod \"8a1e66b1-adb2-4ddb-bca1-257a1646ebda\" (UID: \"8a1e66b1-adb2-4ddb-bca1-257a1646ebda\") " Mar 16 16:02:45 crc kubenswrapper[5120]: I0316 16:02:45.086471 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wn4vw\" (UniqueName: \"kubernetes.io/projected/dcee9a4c-0584-41d7-ae1a-c6aa0417e113-kube-api-access-wn4vw\") pod \"dcee9a4c-0584-41d7-ae1a-c6aa0417e113\" (UID: \"dcee9a4c-0584-41d7-ae1a-c6aa0417e113\") " Mar 16 16:02:45 crc kubenswrapper[5120]: I0316 16:02:45.087120 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/dcee9a4c-0584-41d7-ae1a-c6aa0417e113-operator-scripts\") pod \"dcee9a4c-0584-41d7-ae1a-c6aa0417e113\" (UID: \"dcee9a4c-0584-41d7-ae1a-c6aa0417e113\") " Mar 16 16:02:45 crc kubenswrapper[5120]: I0316 16:02:45.087334 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8a1e66b1-adb2-4ddb-bca1-257a1646ebda-operator-scripts\") pod \"8a1e66b1-adb2-4ddb-bca1-257a1646ebda\" (UID: \"8a1e66b1-adb2-4ddb-bca1-257a1646ebda\") " Mar 16 16:02:45 crc kubenswrapper[5120]: I0316 16:02:45.087690 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dcee9a4c-0584-41d7-ae1a-c6aa0417e113-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "dcee9a4c-0584-41d7-ae1a-c6aa0417e113" (UID: "dcee9a4c-0584-41d7-ae1a-c6aa0417e113"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:02:45 crc kubenswrapper[5120]: I0316 16:02:45.087737 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a1e66b1-adb2-4ddb-bca1-257a1646ebda-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "8a1e66b1-adb2-4ddb-bca1-257a1646ebda" (UID: "8a1e66b1-adb2-4ddb-bca1-257a1646ebda"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:02:45 crc kubenswrapper[5120]: I0316 16:02:45.089982 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dcee9a4c-0584-41d7-ae1a-c6aa0417e113-kube-api-access-wn4vw" (OuterVolumeSpecName: "kube-api-access-wn4vw") pod "dcee9a4c-0584-41d7-ae1a-c6aa0417e113" (UID: "dcee9a4c-0584-41d7-ae1a-c6aa0417e113"). InnerVolumeSpecName "kube-api-access-wn4vw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:02:45 crc kubenswrapper[5120]: I0316 16:02:45.090489 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a1e66b1-adb2-4ddb-bca1-257a1646ebda-kube-api-access-lhdnm" (OuterVolumeSpecName: "kube-api-access-lhdnm") pod "8a1e66b1-adb2-4ddb-bca1-257a1646ebda" (UID: "8a1e66b1-adb2-4ddb-bca1-257a1646ebda"). InnerVolumeSpecName "kube-api-access-lhdnm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:02:45 crc kubenswrapper[5120]: I0316 16:02:45.190029 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/dcee9a4c-0584-41d7-ae1a-c6aa0417e113-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:02:45 crc kubenswrapper[5120]: I0316 16:02:45.190278 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8a1e66b1-adb2-4ddb-bca1-257a1646ebda-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:02:45 crc kubenswrapper[5120]: I0316 16:02:45.190288 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lhdnm\" (UniqueName: \"kubernetes.io/projected/8a1e66b1-adb2-4ddb-bca1-257a1646ebda-kube-api-access-lhdnm\") on node \"crc\" DevicePath \"\"" Mar 16 16:02:45 crc kubenswrapper[5120]: I0316 16:02:45.190299 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wn4vw\" (UniqueName: \"kubernetes.io/projected/dcee9a4c-0584-41d7-ae1a-c6aa0417e113-kube-api-access-wn4vw\") on node \"crc\" DevicePath \"\"" Mar 16 16:02:45 crc kubenswrapper[5120]: I0316 16:02:45.502196 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-db-create-hs54b" Mar 16 16:02:45 crc kubenswrapper[5120]: I0316 16:02:45.502200 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-db-create-hs54b" event={"ID":"8a1e66b1-adb2-4ddb-bca1-257a1646ebda","Type":"ContainerDied","Data":"f496fcf1217c019fa33b6ae9e460cfa078d9e67ba650d3d1ccda62739af5401a"} Mar 16 16:02:45 crc kubenswrapper[5120]: I0316 16:02:45.502259 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f496fcf1217c019fa33b6ae9e460cfa078d9e67ba650d3d1ccda62739af5401a" Mar 16 16:02:45 crc kubenswrapper[5120]: I0316 16:02:45.505040 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-db-create-r5xhj" Mar 16 16:02:45 crc kubenswrapper[5120]: I0316 16:02:45.505105 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-db-create-r5xhj" event={"ID":"dcee9a4c-0584-41d7-ae1a-c6aa0417e113","Type":"ContainerDied","Data":"6a31ed7405d47f9e646631f71af77c57ecffe2cc35eee3e807f60cd0642f48c4"} Mar 16 16:02:45 crc kubenswrapper[5120]: I0316 16:02:45.505543 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6a31ed7405d47f9e646631f71af77c57ecffe2cc35eee3e807f60cd0642f48c4" Mar 16 16:02:45 crc kubenswrapper[5120]: I0316 16:02:45.507448 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-5b779bfdf-px7gw" event={"ID":"bfe56c80-c472-49dc-8971-db5052d61898","Type":"ContainerDied","Data":"53b5d89bd8e94b889f4b6dedd404d7d413c55ad8c52fe5d21ba729ea55fe0a4b"} Mar 16 16:02:45 crc kubenswrapper[5120]: I0316 16:02:45.507517 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-5b779bfdf-px7gw" Mar 16 16:02:45 crc kubenswrapper[5120]: I0316 16:02:45.507531 5120 scope.go:117] "RemoveContainer" containerID="fdda622d80035e11d91b16db055467f5e998c8ed06fd535051b04113b051ec7b" Mar 16 16:02:45 crc kubenswrapper[5120]: I0316 16:02:45.517011 5120 generic.go:358] "Generic (PLEG): container finished" podID="41237879-5c40-4f4b-ad6f-39dab45ba2d5" containerID="2f0ea56a5de0726897ddaaf22edcdae384e978440fa164de4d6a31de3aff53ea" exitCode=0 Mar 16 16:02:45 crc kubenswrapper[5120]: I0316 16:02:45.517231 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"41237879-5c40-4f4b-ad6f-39dab45ba2d5","Type":"ContainerDied","Data":"2f0ea56a5de0726897ddaaf22edcdae384e978440fa164de4d6a31de3aff53ea"} Mar 16 16:02:45 crc kubenswrapper[5120]: I0316 16:02:45.563247 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-5b779bfdf-px7gw"] Mar 16 16:02:45 crc kubenswrapper[5120]: I0316 16:02:45.568582 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-5b779bfdf-px7gw"] Mar 16 16:02:45 crc kubenswrapper[5120]: I0316 16:02:45.571511 5120 scope.go:117] "RemoveContainer" containerID="d15342bf5f1da981a5264feaf7b142259bff5bab0942dc8efe186eb2003e9fb6" Mar 16 16:02:45 crc kubenswrapper[5120]: I0316 16:02:45.964004 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-59d2-account-create-update-v497d" Mar 16 16:02:46 crc kubenswrapper[5120]: I0316 16:02:46.087306 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-db-create-w8fv5" Mar 16 16:02:46 crc kubenswrapper[5120]: I0316 16:02:46.107827 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/741f7b8c-fe99-4ac7-ae79-66467c521b87-operator-scripts\") pod \"741f7b8c-fe99-4ac7-ae79-66467c521b87\" (UID: \"741f7b8c-fe99-4ac7-ae79-66467c521b87\") " Mar 16 16:02:46 crc kubenswrapper[5120]: I0316 16:02:46.107907 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bwtvp\" (UniqueName: \"kubernetes.io/projected/741f7b8c-fe99-4ac7-ae79-66467c521b87-kube-api-access-bwtvp\") pod \"741f7b8c-fe99-4ac7-ae79-66467c521b87\" (UID: \"741f7b8c-fe99-4ac7-ae79-66467c521b87\") " Mar 16 16:02:46 crc kubenswrapper[5120]: I0316 16:02:46.108663 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/741f7b8c-fe99-4ac7-ae79-66467c521b87-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "741f7b8c-fe99-4ac7-ae79-66467c521b87" (UID: "741f7b8c-fe99-4ac7-ae79-66467c521b87"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:02:46 crc kubenswrapper[5120]: I0316 16:02:46.108939 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-b179-account-create-update-fmjzp" Mar 16 16:02:46 crc kubenswrapper[5120]: I0316 16:02:46.115681 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-c16c-account-create-update-548pc" Mar 16 16:02:46 crc kubenswrapper[5120]: I0316 16:02:46.118341 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/741f7b8c-fe99-4ac7-ae79-66467c521b87-kube-api-access-bwtvp" (OuterVolumeSpecName: "kube-api-access-bwtvp") pod "741f7b8c-fe99-4ac7-ae79-66467c521b87" (UID: "741f7b8c-fe99-4ac7-ae79-66467c521b87"). InnerVolumeSpecName "kube-api-access-bwtvp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:02:46 crc kubenswrapper[5120]: I0316 16:02:46.210268 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0f60c073-48fe-42f1-93ed-3b06d768b602-operator-scripts\") pod \"0f60c073-48fe-42f1-93ed-3b06d768b602\" (UID: \"0f60c073-48fe-42f1-93ed-3b06d768b602\") " Mar 16 16:02:46 crc kubenswrapper[5120]: I0316 16:02:46.210336 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2wqls\" (UniqueName: \"kubernetes.io/projected/17bda818-e2b3-45b5-9c0b-2626dadbeb45-kube-api-access-2wqls\") pod \"17bda818-e2b3-45b5-9c0b-2626dadbeb45\" (UID: \"17bda818-e2b3-45b5-9c0b-2626dadbeb45\") " Mar 16 16:02:46 crc kubenswrapper[5120]: I0316 16:02:46.210357 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t5tw5\" (UniqueName: \"kubernetes.io/projected/0f3d3f0d-b689-423c-b909-2315446b2955-kube-api-access-t5tw5\") pod \"0f3d3f0d-b689-423c-b909-2315446b2955\" (UID: \"0f3d3f0d-b689-423c-b909-2315446b2955\") " Mar 16 16:02:46 crc kubenswrapper[5120]: I0316 16:02:46.210431 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/17bda818-e2b3-45b5-9c0b-2626dadbeb45-operator-scripts\") pod \"17bda818-e2b3-45b5-9c0b-2626dadbeb45\" (UID: \"17bda818-e2b3-45b5-9c0b-2626dadbeb45\") " Mar 16 16:02:46 crc kubenswrapper[5120]: I0316 16:02:46.210484 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mx2h5\" (UniqueName: \"kubernetes.io/projected/0f60c073-48fe-42f1-93ed-3b06d768b602-kube-api-access-mx2h5\") pod \"0f60c073-48fe-42f1-93ed-3b06d768b602\" (UID: \"0f60c073-48fe-42f1-93ed-3b06d768b602\") " Mar 16 16:02:46 crc kubenswrapper[5120]: I0316 16:02:46.210525 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0f3d3f0d-b689-423c-b909-2315446b2955-operator-scripts\") pod \"0f3d3f0d-b689-423c-b909-2315446b2955\" (UID: \"0f3d3f0d-b689-423c-b909-2315446b2955\") " Mar 16 16:02:46 crc kubenswrapper[5120]: I0316 16:02:46.210695 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f60c073-48fe-42f1-93ed-3b06d768b602-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "0f60c073-48fe-42f1-93ed-3b06d768b602" (UID: "0f60c073-48fe-42f1-93ed-3b06d768b602"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:02:46 crc kubenswrapper[5120]: I0316 16:02:46.211030 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f3d3f0d-b689-423c-b909-2315446b2955-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "0f3d3f0d-b689-423c-b909-2315446b2955" (UID: "0f3d3f0d-b689-423c-b909-2315446b2955"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:02:46 crc kubenswrapper[5120]: I0316 16:02:46.211243 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/17bda818-e2b3-45b5-9c0b-2626dadbeb45-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "17bda818-e2b3-45b5-9c0b-2626dadbeb45" (UID: "17bda818-e2b3-45b5-9c0b-2626dadbeb45"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:02:46 crc kubenswrapper[5120]: I0316 16:02:46.211441 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0f3d3f0d-b689-423c-b909-2315446b2955-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:02:46 crc kubenswrapper[5120]: I0316 16:02:46.211461 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/741f7b8c-fe99-4ac7-ae79-66467c521b87-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:02:46 crc kubenswrapper[5120]: I0316 16:02:46.211478 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bwtvp\" (UniqueName: \"kubernetes.io/projected/741f7b8c-fe99-4ac7-ae79-66467c521b87-kube-api-access-bwtvp\") on node \"crc\" DevicePath \"\"" Mar 16 16:02:46 crc kubenswrapper[5120]: I0316 16:02:46.211486 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0f60c073-48fe-42f1-93ed-3b06d768b602-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:02:46 crc kubenswrapper[5120]: I0316 16:02:46.211494 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/17bda818-e2b3-45b5-9c0b-2626dadbeb45-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:02:46 crc kubenswrapper[5120]: I0316 16:02:46.214925 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f60c073-48fe-42f1-93ed-3b06d768b602-kube-api-access-mx2h5" (OuterVolumeSpecName: "kube-api-access-mx2h5") pod "0f60c073-48fe-42f1-93ed-3b06d768b602" (UID: "0f60c073-48fe-42f1-93ed-3b06d768b602"). InnerVolumeSpecName "kube-api-access-mx2h5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:02:46 crc kubenswrapper[5120]: I0316 16:02:46.215491 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f3d3f0d-b689-423c-b909-2315446b2955-kube-api-access-t5tw5" (OuterVolumeSpecName: "kube-api-access-t5tw5") pod "0f3d3f0d-b689-423c-b909-2315446b2955" (UID: "0f3d3f0d-b689-423c-b909-2315446b2955"). InnerVolumeSpecName "kube-api-access-t5tw5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:02:46 crc kubenswrapper[5120]: I0316 16:02:46.218974 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17bda818-e2b3-45b5-9c0b-2626dadbeb45-kube-api-access-2wqls" (OuterVolumeSpecName: "kube-api-access-2wqls") pod "17bda818-e2b3-45b5-9c0b-2626dadbeb45" (UID: "17bda818-e2b3-45b5-9c0b-2626dadbeb45"). InnerVolumeSpecName "kube-api-access-2wqls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:02:46 crc kubenswrapper[5120]: I0316 16:02:46.312775 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2wqls\" (UniqueName: \"kubernetes.io/projected/17bda818-e2b3-45b5-9c0b-2626dadbeb45-kube-api-access-2wqls\") on node \"crc\" DevicePath \"\"" Mar 16 16:02:46 crc kubenswrapper[5120]: I0316 16:02:46.313099 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t5tw5\" (UniqueName: \"kubernetes.io/projected/0f3d3f0d-b689-423c-b909-2315446b2955-kube-api-access-t5tw5\") on node \"crc\" DevicePath \"\"" Mar 16 16:02:46 crc kubenswrapper[5120]: I0316 16:02:46.313109 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mx2h5\" (UniqueName: \"kubernetes.io/projected/0f60c073-48fe-42f1-93ed-3b06d768b602-kube-api-access-mx2h5\") on node \"crc\" DevicePath \"\"" Mar 16 16:02:46 crc kubenswrapper[5120]: I0316 16:02:46.536752 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-59d2-account-create-update-v497d" Mar 16 16:02:46 crc kubenswrapper[5120]: I0316 16:02:46.536801 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-59d2-account-create-update-v497d" event={"ID":"741f7b8c-fe99-4ac7-ae79-66467c521b87","Type":"ContainerDied","Data":"cfbeeb67e4f3e8ff20d65167d951a71d75f10391954c9d5c8889a8174587178a"} Mar 16 16:02:46 crc kubenswrapper[5120]: I0316 16:02:46.536843 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cfbeeb67e4f3e8ff20d65167d951a71d75f10391954c9d5c8889a8174587178a" Mar 16 16:02:46 crc kubenswrapper[5120]: I0316 16:02:46.547673 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-c16c-account-create-update-548pc" event={"ID":"0f60c073-48fe-42f1-93ed-3b06d768b602","Type":"ContainerDied","Data":"53298be2c86f7699f4b188d978c80aa4daa5d118c4fa847a1ca67b43ad46505f"} Mar 16 16:02:46 crc kubenswrapper[5120]: I0316 16:02:46.547727 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="53298be2c86f7699f4b188d978c80aa4daa5d118c4fa847a1ca67b43ad46505f" Mar 16 16:02:46 crc kubenswrapper[5120]: I0316 16:02:46.547820 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-c16c-account-create-update-548pc" Mar 16 16:02:46 crc kubenswrapper[5120]: I0316 16:02:46.557268 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-b179-account-create-update-fmjzp" Mar 16 16:02:46 crc kubenswrapper[5120]: I0316 16:02:46.557279 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-b179-account-create-update-fmjzp" event={"ID":"0f3d3f0d-b689-423c-b909-2315446b2955","Type":"ContainerDied","Data":"51fcd37d9960b14ea84902de57bd9f5e3aa80d5fd1fbf49db40105cacb8b482a"} Mar 16 16:02:46 crc kubenswrapper[5120]: I0316 16:02:46.558041 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="51fcd37d9960b14ea84902de57bd9f5e3aa80d5fd1fbf49db40105cacb8b482a" Mar 16 16:02:46 crc kubenswrapper[5120]: I0316 16:02:46.560518 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-db-create-w8fv5" Mar 16 16:02:46 crc kubenswrapper[5120]: I0316 16:02:46.560559 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-db-create-w8fv5" event={"ID":"17bda818-e2b3-45b5-9c0b-2626dadbeb45","Type":"ContainerDied","Data":"1e1b22fea5736a2e86566a67033473363f9dd2949fafa31a9364224057cbd450"} Mar 16 16:02:46 crc kubenswrapper[5120]: I0316 16:02:46.560597 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1e1b22fea5736a2e86566a67033473363f9dd2949fafa31a9364224057cbd450" Mar 16 16:02:46 crc kubenswrapper[5120]: I0316 16:02:46.676897 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bfe56c80-c472-49dc-8971-db5052d61898" path="/var/lib/kubelet/pods/bfe56c80-c472-49dc-8971-db5052d61898/volumes" Mar 16 16:02:46 crc kubenswrapper[5120]: I0316 16:02:46.741882 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:02:46 crc kubenswrapper[5120]: I0316 16:02:46.742172 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="97c05f77-d695-4853-acb9-05388320db3b" containerName="glance-log" containerID="cri-o://2fb7224a1e61d725ae62ac7949cc94af8bf14dafa656593489f273d049fb501f" gracePeriod=30 Mar 16 16:02:46 crc kubenswrapper[5120]: I0316 16:02:46.742634 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="97c05f77-d695-4853-acb9-05388320db3b" containerName="glance-httpd" containerID="cri-o://0e4b269601afde05465d88d6caa9c22cf556e6ef38c8b25edfe4940f6828106c" gracePeriod=30 Mar 16 16:02:46 crc kubenswrapper[5120]: I0316 16:02:46.975493 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-sl8qj"] Mar 16 16:02:46 crc kubenswrapper[5120]: I0316 16:02:46.976658 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17bda818-e2b3-45b5-9c0b-2626dadbeb45" containerName="mariadb-database-create" Mar 16 16:02:46 crc kubenswrapper[5120]: I0316 16:02:46.976682 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="17bda818-e2b3-45b5-9c0b-2626dadbeb45" containerName="mariadb-database-create" Mar 16 16:02:46 crc kubenswrapper[5120]: I0316 16:02:46.976702 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bfe56c80-c472-49dc-8971-db5052d61898" containerName="neutron-httpd" Mar 16 16:02:46 crc kubenswrapper[5120]: I0316 16:02:46.976710 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfe56c80-c472-49dc-8971-db5052d61898" containerName="neutron-httpd" Mar 16 16:02:46 crc kubenswrapper[5120]: I0316 16:02:46.976721 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bfe56c80-c472-49dc-8971-db5052d61898" containerName="neutron-api" Mar 16 16:02:46 crc kubenswrapper[5120]: I0316 16:02:46.976730 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfe56c80-c472-49dc-8971-db5052d61898" containerName="neutron-api" Mar 16 16:02:46 crc kubenswrapper[5120]: I0316 16:02:46.978421 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f3d3f0d-b689-423c-b909-2315446b2955" containerName="mariadb-account-create-update" Mar 16 16:02:46 crc kubenswrapper[5120]: I0316 16:02:46.978440 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f3d3f0d-b689-423c-b909-2315446b2955" containerName="mariadb-account-create-update" Mar 16 16:02:46 crc kubenswrapper[5120]: I0316 16:02:46.978457 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="741f7b8c-fe99-4ac7-ae79-66467c521b87" containerName="mariadb-account-create-update" Mar 16 16:02:46 crc kubenswrapper[5120]: I0316 16:02:46.978466 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="741f7b8c-fe99-4ac7-ae79-66467c521b87" containerName="mariadb-account-create-update" Mar 16 16:02:46 crc kubenswrapper[5120]: I0316 16:02:46.978517 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dcee9a4c-0584-41d7-ae1a-c6aa0417e113" containerName="mariadb-database-create" Mar 16 16:02:46 crc kubenswrapper[5120]: I0316 16:02:46.978526 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="dcee9a4c-0584-41d7-ae1a-c6aa0417e113" containerName="mariadb-database-create" Mar 16 16:02:46 crc kubenswrapper[5120]: I0316 16:02:46.978545 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a1e66b1-adb2-4ddb-bca1-257a1646ebda" containerName="mariadb-database-create" Mar 16 16:02:46 crc kubenswrapper[5120]: I0316 16:02:46.978552 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a1e66b1-adb2-4ddb-bca1-257a1646ebda" containerName="mariadb-database-create" Mar 16 16:02:46 crc kubenswrapper[5120]: I0316 16:02:46.978564 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f60c073-48fe-42f1-93ed-3b06d768b602" containerName="mariadb-account-create-update" Mar 16 16:02:46 crc kubenswrapper[5120]: I0316 16:02:46.978573 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f60c073-48fe-42f1-93ed-3b06d768b602" containerName="mariadb-account-create-update" Mar 16 16:02:46 crc kubenswrapper[5120]: I0316 16:02:46.978872 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="17bda818-e2b3-45b5-9c0b-2626dadbeb45" containerName="mariadb-database-create" Mar 16 16:02:46 crc kubenswrapper[5120]: I0316 16:02:46.978894 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="dcee9a4c-0584-41d7-ae1a-c6aa0417e113" containerName="mariadb-database-create" Mar 16 16:02:46 crc kubenswrapper[5120]: I0316 16:02:46.978904 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="741f7b8c-fe99-4ac7-ae79-66467c521b87" containerName="mariadb-account-create-update" Mar 16 16:02:46 crc kubenswrapper[5120]: I0316 16:02:46.978921 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="0f60c073-48fe-42f1-93ed-3b06d768b602" containerName="mariadb-account-create-update" Mar 16 16:02:46 crc kubenswrapper[5120]: I0316 16:02:46.978938 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="8a1e66b1-adb2-4ddb-bca1-257a1646ebda" containerName="mariadb-database-create" Mar 16 16:02:46 crc kubenswrapper[5120]: I0316 16:02:46.978951 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="0f3d3f0d-b689-423c-b909-2315446b2955" containerName="mariadb-account-create-update" Mar 16 16:02:46 crc kubenswrapper[5120]: I0316 16:02:46.978965 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="bfe56c80-c472-49dc-8971-db5052d61898" containerName="neutron-httpd" Mar 16 16:02:46 crc kubenswrapper[5120]: I0316 16:02:46.978982 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="bfe56c80-c472-49dc-8971-db5052d61898" containerName="neutron-api" Mar 16 16:02:47 crc kubenswrapper[5120]: I0316 16:02:47.001995 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-sl8qj"] Mar 16 16:02:47 crc kubenswrapper[5120]: I0316 16:02:47.002142 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-sl8qj" Mar 16 16:02:47 crc kubenswrapper[5120]: I0316 16:02:47.007207 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-conductor-scripts\"" Mar 16 16:02:47 crc kubenswrapper[5120]: I0316 16:02:47.007597 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-nova-dockercfg-dqzng\"" Mar 16 16:02:47 crc kubenswrapper[5120]: I0316 16:02:47.007897 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-conductor-config-data\"" Mar 16 16:02:47 crc kubenswrapper[5120]: I0316 16:02:47.128463 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4ae71795-b884-4cc8-be0b-206084f8fafd-config-data\") pod \"nova-cell0-conductor-db-sync-sl8qj\" (UID: \"4ae71795-b884-4cc8-be0b-206084f8fafd\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-sl8qj" Mar 16 16:02:47 crc kubenswrapper[5120]: I0316 16:02:47.128538 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4ae71795-b884-4cc8-be0b-206084f8fafd-scripts\") pod \"nova-cell0-conductor-db-sync-sl8qj\" (UID: \"4ae71795-b884-4cc8-be0b-206084f8fafd\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-sl8qj" Mar 16 16:02:47 crc kubenswrapper[5120]: I0316 16:02:47.128678 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4ae71795-b884-4cc8-be0b-206084f8fafd-combined-ca-bundle\") pod \"nova-cell0-conductor-db-sync-sl8qj\" (UID: \"4ae71795-b884-4cc8-be0b-206084f8fafd\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-sl8qj" Mar 16 16:02:47 crc kubenswrapper[5120]: I0316 16:02:47.128917 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-876gt\" (UniqueName: \"kubernetes.io/projected/4ae71795-b884-4cc8-be0b-206084f8fafd-kube-api-access-876gt\") pod \"nova-cell0-conductor-db-sync-sl8qj\" (UID: \"4ae71795-b884-4cc8-be0b-206084f8fafd\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-sl8qj" Mar 16 16:02:47 crc kubenswrapper[5120]: I0316 16:02:47.230586 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-876gt\" (UniqueName: \"kubernetes.io/projected/4ae71795-b884-4cc8-be0b-206084f8fafd-kube-api-access-876gt\") pod \"nova-cell0-conductor-db-sync-sl8qj\" (UID: \"4ae71795-b884-4cc8-be0b-206084f8fafd\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-sl8qj" Mar 16 16:02:47 crc kubenswrapper[5120]: I0316 16:02:47.230696 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4ae71795-b884-4cc8-be0b-206084f8fafd-config-data\") pod \"nova-cell0-conductor-db-sync-sl8qj\" (UID: \"4ae71795-b884-4cc8-be0b-206084f8fafd\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-sl8qj" Mar 16 16:02:47 crc kubenswrapper[5120]: I0316 16:02:47.230746 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4ae71795-b884-4cc8-be0b-206084f8fafd-scripts\") pod \"nova-cell0-conductor-db-sync-sl8qj\" (UID: \"4ae71795-b884-4cc8-be0b-206084f8fafd\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-sl8qj" Mar 16 16:02:47 crc kubenswrapper[5120]: I0316 16:02:47.230796 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4ae71795-b884-4cc8-be0b-206084f8fafd-combined-ca-bundle\") pod \"nova-cell0-conductor-db-sync-sl8qj\" (UID: \"4ae71795-b884-4cc8-be0b-206084f8fafd\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-sl8qj" Mar 16 16:02:47 crc kubenswrapper[5120]: I0316 16:02:47.235751 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4ae71795-b884-4cc8-be0b-206084f8fafd-combined-ca-bundle\") pod \"nova-cell0-conductor-db-sync-sl8qj\" (UID: \"4ae71795-b884-4cc8-be0b-206084f8fafd\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-sl8qj" Mar 16 16:02:47 crc kubenswrapper[5120]: I0316 16:02:47.236101 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4ae71795-b884-4cc8-be0b-206084f8fafd-scripts\") pod \"nova-cell0-conductor-db-sync-sl8qj\" (UID: \"4ae71795-b884-4cc8-be0b-206084f8fafd\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-sl8qj" Mar 16 16:02:47 crc kubenswrapper[5120]: I0316 16:02:47.237327 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4ae71795-b884-4cc8-be0b-206084f8fafd-config-data\") pod \"nova-cell0-conductor-db-sync-sl8qj\" (UID: \"4ae71795-b884-4cc8-be0b-206084f8fafd\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-sl8qj" Mar 16 16:02:47 crc kubenswrapper[5120]: I0316 16:02:47.245707 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-876gt\" (UniqueName: \"kubernetes.io/projected/4ae71795-b884-4cc8-be0b-206084f8fafd-kube-api-access-876gt\") pod \"nova-cell0-conductor-db-sync-sl8qj\" (UID: \"4ae71795-b884-4cc8-be0b-206084f8fafd\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-sl8qj" Mar 16 16:02:47 crc kubenswrapper[5120]: I0316 16:02:47.318603 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-sl8qj" Mar 16 16:02:47 crc kubenswrapper[5120]: I0316 16:02:47.537080 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:02:47 crc kubenswrapper[5120]: I0316 16:02:47.537939 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="ee138521-8f48-4215-9e58-cf1d50ad7910" containerName="glance-log" containerID="cri-o://780d1a21d3dfa92fa26d3abf9a3a36fbee1bd1a740cfed6d040700a2c31f1959" gracePeriod=30 Mar 16 16:02:47 crc kubenswrapper[5120]: I0316 16:02:47.539112 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="ee138521-8f48-4215-9e58-cf1d50ad7910" containerName="glance-httpd" containerID="cri-o://4a2dee30e47e2483dd875b5fbbc3f4abc1d9b1c74824ae9639353e63a9890e0a" gracePeriod=30 Mar 16 16:02:47 crc kubenswrapper[5120]: I0316 16:02:47.582945 5120 generic.go:358] "Generic (PLEG): container finished" podID="97c05f77-d695-4853-acb9-05388320db3b" containerID="2fb7224a1e61d725ae62ac7949cc94af8bf14dafa656593489f273d049fb501f" exitCode=143 Mar 16 16:02:47 crc kubenswrapper[5120]: I0316 16:02:47.583220 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"97c05f77-d695-4853-acb9-05388320db3b","Type":"ContainerDied","Data":"2fb7224a1e61d725ae62ac7949cc94af8bf14dafa656593489f273d049fb501f"} Mar 16 16:02:47 crc kubenswrapper[5120]: I0316 16:02:47.796280 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-sl8qj"] Mar 16 16:02:47 crc kubenswrapper[5120]: W0316 16:02:47.800164 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4ae71795_b884_4cc8_be0b_206084f8fafd.slice/crio-443a52776dcd788a92d0503be2814383b2ebfb13860eb7dc40ac8366bd1fa729 WatchSource:0}: Error finding container 443a52776dcd788a92d0503be2814383b2ebfb13860eb7dc40ac8366bd1fa729: Status 404 returned error can't find the container with id 443a52776dcd788a92d0503be2814383b2ebfb13860eb7dc40ac8366bd1fa729 Mar 16 16:02:48 crc kubenswrapper[5120]: I0316 16:02:48.263241 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:02:48 crc kubenswrapper[5120]: I0316 16:02:48.369257 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/41237879-5c40-4f4b-ad6f-39dab45ba2d5-combined-ca-bundle\") pod \"41237879-5c40-4f4b-ad6f-39dab45ba2d5\" (UID: \"41237879-5c40-4f4b-ad6f-39dab45ba2d5\") " Mar 16 16:02:48 crc kubenswrapper[5120]: I0316 16:02:48.369435 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/41237879-5c40-4f4b-ad6f-39dab45ba2d5-config-data\") pod \"41237879-5c40-4f4b-ad6f-39dab45ba2d5\" (UID: \"41237879-5c40-4f4b-ad6f-39dab45ba2d5\") " Mar 16 16:02:48 crc kubenswrapper[5120]: I0316 16:02:48.369457 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/41237879-5c40-4f4b-ad6f-39dab45ba2d5-scripts\") pod \"41237879-5c40-4f4b-ad6f-39dab45ba2d5\" (UID: \"41237879-5c40-4f4b-ad6f-39dab45ba2d5\") " Mar 16 16:02:48 crc kubenswrapper[5120]: I0316 16:02:48.369564 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xb2mw\" (UniqueName: \"kubernetes.io/projected/41237879-5c40-4f4b-ad6f-39dab45ba2d5-kube-api-access-xb2mw\") pod \"41237879-5c40-4f4b-ad6f-39dab45ba2d5\" (UID: \"41237879-5c40-4f4b-ad6f-39dab45ba2d5\") " Mar 16 16:02:48 crc kubenswrapper[5120]: I0316 16:02:48.369584 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/41237879-5c40-4f4b-ad6f-39dab45ba2d5-sg-core-conf-yaml\") pod \"41237879-5c40-4f4b-ad6f-39dab45ba2d5\" (UID: \"41237879-5c40-4f4b-ad6f-39dab45ba2d5\") " Mar 16 16:02:48 crc kubenswrapper[5120]: I0316 16:02:48.369639 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/41237879-5c40-4f4b-ad6f-39dab45ba2d5-log-httpd\") pod \"41237879-5c40-4f4b-ad6f-39dab45ba2d5\" (UID: \"41237879-5c40-4f4b-ad6f-39dab45ba2d5\") " Mar 16 16:02:48 crc kubenswrapper[5120]: I0316 16:02:48.369708 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/41237879-5c40-4f4b-ad6f-39dab45ba2d5-run-httpd\") pod \"41237879-5c40-4f4b-ad6f-39dab45ba2d5\" (UID: \"41237879-5c40-4f4b-ad6f-39dab45ba2d5\") " Mar 16 16:02:48 crc kubenswrapper[5120]: I0316 16:02:48.370080 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41237879-5c40-4f4b-ad6f-39dab45ba2d5-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "41237879-5c40-4f4b-ad6f-39dab45ba2d5" (UID: "41237879-5c40-4f4b-ad6f-39dab45ba2d5"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:02:48 crc kubenswrapper[5120]: I0316 16:02:48.370108 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41237879-5c40-4f4b-ad6f-39dab45ba2d5-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "41237879-5c40-4f4b-ad6f-39dab45ba2d5" (UID: "41237879-5c40-4f4b-ad6f-39dab45ba2d5"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:02:48 crc kubenswrapper[5120]: I0316 16:02:48.370577 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/41237879-5c40-4f4b-ad6f-39dab45ba2d5-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:02:48 crc kubenswrapper[5120]: I0316 16:02:48.370591 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/41237879-5c40-4f4b-ad6f-39dab45ba2d5-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:02:48 crc kubenswrapper[5120]: I0316 16:02:48.375484 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41237879-5c40-4f4b-ad6f-39dab45ba2d5-kube-api-access-xb2mw" (OuterVolumeSpecName: "kube-api-access-xb2mw") pod "41237879-5c40-4f4b-ad6f-39dab45ba2d5" (UID: "41237879-5c40-4f4b-ad6f-39dab45ba2d5"). InnerVolumeSpecName "kube-api-access-xb2mw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:02:48 crc kubenswrapper[5120]: I0316 16:02:48.375774 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/41237879-5c40-4f4b-ad6f-39dab45ba2d5-scripts" (OuterVolumeSpecName: "scripts") pod "41237879-5c40-4f4b-ad6f-39dab45ba2d5" (UID: "41237879-5c40-4f4b-ad6f-39dab45ba2d5"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:02:48 crc kubenswrapper[5120]: I0316 16:02:48.394939 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/41237879-5c40-4f4b-ad6f-39dab45ba2d5-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "41237879-5c40-4f4b-ad6f-39dab45ba2d5" (UID: "41237879-5c40-4f4b-ad6f-39dab45ba2d5"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:02:48 crc kubenswrapper[5120]: I0316 16:02:48.434646 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/41237879-5c40-4f4b-ad6f-39dab45ba2d5-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "41237879-5c40-4f4b-ad6f-39dab45ba2d5" (UID: "41237879-5c40-4f4b-ad6f-39dab45ba2d5"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:02:48 crc kubenswrapper[5120]: I0316 16:02:48.454346 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/41237879-5c40-4f4b-ad6f-39dab45ba2d5-config-data" (OuterVolumeSpecName: "config-data") pod "41237879-5c40-4f4b-ad6f-39dab45ba2d5" (UID: "41237879-5c40-4f4b-ad6f-39dab45ba2d5"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:02:48 crc kubenswrapper[5120]: I0316 16:02:48.473081 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/41237879-5c40-4f4b-ad6f-39dab45ba2d5-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:02:48 crc kubenswrapper[5120]: I0316 16:02:48.473115 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/41237879-5c40-4f4b-ad6f-39dab45ba2d5-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:02:48 crc kubenswrapper[5120]: I0316 16:02:48.473128 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xb2mw\" (UniqueName: \"kubernetes.io/projected/41237879-5c40-4f4b-ad6f-39dab45ba2d5-kube-api-access-xb2mw\") on node \"crc\" DevicePath \"\"" Mar 16 16:02:48 crc kubenswrapper[5120]: I0316 16:02:48.473145 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/41237879-5c40-4f4b-ad6f-39dab45ba2d5-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 16:02:48 crc kubenswrapper[5120]: I0316 16:02:48.473157 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/41237879-5c40-4f4b-ad6f-39dab45ba2d5-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:02:48 crc kubenswrapper[5120]: I0316 16:02:48.593298 5120 generic.go:358] "Generic (PLEG): container finished" podID="ee138521-8f48-4215-9e58-cf1d50ad7910" containerID="780d1a21d3dfa92fa26d3abf9a3a36fbee1bd1a740cfed6d040700a2c31f1959" exitCode=143 Mar 16 16:02:48 crc kubenswrapper[5120]: I0316 16:02:48.593423 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"ee138521-8f48-4215-9e58-cf1d50ad7910","Type":"ContainerDied","Data":"780d1a21d3dfa92fa26d3abf9a3a36fbee1bd1a740cfed6d040700a2c31f1959"} Mar 16 16:02:48 crc kubenswrapper[5120]: I0316 16:02:48.595878 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-sl8qj" event={"ID":"4ae71795-b884-4cc8-be0b-206084f8fafd","Type":"ContainerStarted","Data":"117cb0ae762127f90136bce221457081f536a88b4829b05dca9eced2b9c97a5a"} Mar 16 16:02:48 crc kubenswrapper[5120]: I0316 16:02:48.595905 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-sl8qj" event={"ID":"4ae71795-b884-4cc8-be0b-206084f8fafd","Type":"ContainerStarted","Data":"443a52776dcd788a92d0503be2814383b2ebfb13860eb7dc40ac8366bd1fa729"} Mar 16 16:02:48 crc kubenswrapper[5120]: I0316 16:02:48.599542 5120 generic.go:358] "Generic (PLEG): container finished" podID="41237879-5c40-4f4b-ad6f-39dab45ba2d5" containerID="c7e01ef8a3e8a351182b7ad447cfd063af28c5831169928ef5c7e3d7d27fe70b" exitCode=0 Mar 16 16:02:48 crc kubenswrapper[5120]: I0316 16:02:48.599656 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"41237879-5c40-4f4b-ad6f-39dab45ba2d5","Type":"ContainerDied","Data":"c7e01ef8a3e8a351182b7ad447cfd063af28c5831169928ef5c7e3d7d27fe70b"} Mar 16 16:02:48 crc kubenswrapper[5120]: I0316 16:02:48.599673 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"41237879-5c40-4f4b-ad6f-39dab45ba2d5","Type":"ContainerDied","Data":"97a826a51eb103ea1b5d81924af0f4938d6b6b44c9973278063663aee0498778"} Mar 16 16:02:48 crc kubenswrapper[5120]: I0316 16:02:48.599689 5120 scope.go:117] "RemoveContainer" containerID="afe5dec266570eb41825b0c918ca41d10d6fe21669149ad76a5ea2fa6e5d12e8" Mar 16 16:02:48 crc kubenswrapper[5120]: I0316 16:02:48.599830 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:02:48 crc kubenswrapper[5120]: I0316 16:02:48.644542 5120 scope.go:117] "RemoveContainer" containerID="b84a927664ad8c9691c79d3bfb344d69ca2e8aa82fef990853248665318ff473" Mar 16 16:02:48 crc kubenswrapper[5120]: I0316 16:02:48.651746 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-sl8qj" podStartSLOduration=2.65172405 podStartE2EDuration="2.65172405s" podCreationTimestamp="2026-03-16 16:02:46 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:02:48.622409653 +0000 UTC m=+1870.776341320" watchObservedRunningTime="2026-03-16 16:02:48.65172405 +0000 UTC m=+1870.805655707" Mar 16 16:02:48 crc kubenswrapper[5120]: I0316 16:02:48.657908 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:02:48 crc kubenswrapper[5120]: I0316 16:02:48.671277 5120 scope.go:117] "RemoveContainer" containerID="c7e01ef8a3e8a351182b7ad447cfd063af28c5831169928ef5c7e3d7d27fe70b" Mar 16 16:02:48 crc kubenswrapper[5120]: I0316 16:02:48.680728 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:02:48 crc kubenswrapper[5120]: I0316 16:02:48.688130 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:02:48 crc kubenswrapper[5120]: I0316 16:02:48.689066 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41237879-5c40-4f4b-ad6f-39dab45ba2d5" containerName="ceilometer-notification-agent" Mar 16 16:02:48 crc kubenswrapper[5120]: I0316 16:02:48.689080 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="41237879-5c40-4f4b-ad6f-39dab45ba2d5" containerName="ceilometer-notification-agent" Mar 16 16:02:48 crc kubenswrapper[5120]: I0316 16:02:48.689096 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41237879-5c40-4f4b-ad6f-39dab45ba2d5" containerName="ceilometer-central-agent" Mar 16 16:02:48 crc kubenswrapper[5120]: I0316 16:02:48.689102 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="41237879-5c40-4f4b-ad6f-39dab45ba2d5" containerName="ceilometer-central-agent" Mar 16 16:02:48 crc kubenswrapper[5120]: I0316 16:02:48.689150 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41237879-5c40-4f4b-ad6f-39dab45ba2d5" containerName="sg-core" Mar 16 16:02:48 crc kubenswrapper[5120]: I0316 16:02:48.689156 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="41237879-5c40-4f4b-ad6f-39dab45ba2d5" containerName="sg-core" Mar 16 16:02:48 crc kubenswrapper[5120]: I0316 16:02:48.689167 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41237879-5c40-4f4b-ad6f-39dab45ba2d5" containerName="proxy-httpd" Mar 16 16:02:48 crc kubenswrapper[5120]: I0316 16:02:48.689172 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="41237879-5c40-4f4b-ad6f-39dab45ba2d5" containerName="proxy-httpd" Mar 16 16:02:48 crc kubenswrapper[5120]: I0316 16:02:48.689309 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="41237879-5c40-4f4b-ad6f-39dab45ba2d5" containerName="proxy-httpd" Mar 16 16:02:48 crc kubenswrapper[5120]: I0316 16:02:48.689324 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="41237879-5c40-4f4b-ad6f-39dab45ba2d5" containerName="ceilometer-central-agent" Mar 16 16:02:48 crc kubenswrapper[5120]: I0316 16:02:48.689336 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="41237879-5c40-4f4b-ad6f-39dab45ba2d5" containerName="sg-core" Mar 16 16:02:48 crc kubenswrapper[5120]: I0316 16:02:48.689345 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="41237879-5c40-4f4b-ad6f-39dab45ba2d5" containerName="ceilometer-notification-agent" Mar 16 16:02:48 crc kubenswrapper[5120]: I0316 16:02:48.698478 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:02:48 crc kubenswrapper[5120]: I0316 16:02:48.702623 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:02:48 crc kubenswrapper[5120]: I0316 16:02:48.703460 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 16:02:48 crc kubenswrapper[5120]: I0316 16:02:48.704377 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 16:02:48 crc kubenswrapper[5120]: I0316 16:02:48.708751 5120 scope.go:117] "RemoveContainer" containerID="2f0ea56a5de0726897ddaaf22edcdae384e978440fa164de4d6a31de3aff53ea" Mar 16 16:02:48 crc kubenswrapper[5120]: I0316 16:02:48.746963 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:02:48 crc kubenswrapper[5120]: I0316 16:02:48.796830 5120 scope.go:117] "RemoveContainer" containerID="afe5dec266570eb41825b0c918ca41d10d6fe21669149ad76a5ea2fa6e5d12e8" Mar 16 16:02:48 crc kubenswrapper[5120]: E0316 16:02:48.798852 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"afe5dec266570eb41825b0c918ca41d10d6fe21669149ad76a5ea2fa6e5d12e8\": container with ID starting with afe5dec266570eb41825b0c918ca41d10d6fe21669149ad76a5ea2fa6e5d12e8 not found: ID does not exist" containerID="afe5dec266570eb41825b0c918ca41d10d6fe21669149ad76a5ea2fa6e5d12e8" Mar 16 16:02:48 crc kubenswrapper[5120]: I0316 16:02:48.798898 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"afe5dec266570eb41825b0c918ca41d10d6fe21669149ad76a5ea2fa6e5d12e8"} err="failed to get container status \"afe5dec266570eb41825b0c918ca41d10d6fe21669149ad76a5ea2fa6e5d12e8\": rpc error: code = NotFound desc = could not find container \"afe5dec266570eb41825b0c918ca41d10d6fe21669149ad76a5ea2fa6e5d12e8\": container with ID starting with afe5dec266570eb41825b0c918ca41d10d6fe21669149ad76a5ea2fa6e5d12e8 not found: ID does not exist" Mar 16 16:02:48 crc kubenswrapper[5120]: I0316 16:02:48.798922 5120 scope.go:117] "RemoveContainer" containerID="b84a927664ad8c9691c79d3bfb344d69ca2e8aa82fef990853248665318ff473" Mar 16 16:02:48 crc kubenswrapper[5120]: E0316 16:02:48.799579 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[combined-ca-bundle config-data kube-api-access-6gwrz log-httpd run-httpd scripts sg-core-conf-yaml], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openstack-kuttl-tests/ceilometer-0" podUID="23922841-3b05-4dbe-ae08-50c55a3a44c7" Mar 16 16:02:48 crc kubenswrapper[5120]: E0316 16:02:48.799824 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b84a927664ad8c9691c79d3bfb344d69ca2e8aa82fef990853248665318ff473\": container with ID starting with b84a927664ad8c9691c79d3bfb344d69ca2e8aa82fef990853248665318ff473 not found: ID does not exist" containerID="b84a927664ad8c9691c79d3bfb344d69ca2e8aa82fef990853248665318ff473" Mar 16 16:02:48 crc kubenswrapper[5120]: I0316 16:02:48.799847 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b84a927664ad8c9691c79d3bfb344d69ca2e8aa82fef990853248665318ff473"} err="failed to get container status \"b84a927664ad8c9691c79d3bfb344d69ca2e8aa82fef990853248665318ff473\": rpc error: code = NotFound desc = could not find container \"b84a927664ad8c9691c79d3bfb344d69ca2e8aa82fef990853248665318ff473\": container with ID starting with b84a927664ad8c9691c79d3bfb344d69ca2e8aa82fef990853248665318ff473 not found: ID does not exist" Mar 16 16:02:48 crc kubenswrapper[5120]: I0316 16:02:48.799861 5120 scope.go:117] "RemoveContainer" containerID="c7e01ef8a3e8a351182b7ad447cfd063af28c5831169928ef5c7e3d7d27fe70b" Mar 16 16:02:48 crc kubenswrapper[5120]: E0316 16:02:48.800169 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c7e01ef8a3e8a351182b7ad447cfd063af28c5831169928ef5c7e3d7d27fe70b\": container with ID starting with c7e01ef8a3e8a351182b7ad447cfd063af28c5831169928ef5c7e3d7d27fe70b not found: ID does not exist" containerID="c7e01ef8a3e8a351182b7ad447cfd063af28c5831169928ef5c7e3d7d27fe70b" Mar 16 16:02:48 crc kubenswrapper[5120]: I0316 16:02:48.800290 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7e01ef8a3e8a351182b7ad447cfd063af28c5831169928ef5c7e3d7d27fe70b"} err="failed to get container status \"c7e01ef8a3e8a351182b7ad447cfd063af28c5831169928ef5c7e3d7d27fe70b\": rpc error: code = NotFound desc = could not find container \"c7e01ef8a3e8a351182b7ad447cfd063af28c5831169928ef5c7e3d7d27fe70b\": container with ID starting with c7e01ef8a3e8a351182b7ad447cfd063af28c5831169928ef5c7e3d7d27fe70b not found: ID does not exist" Mar 16 16:02:48 crc kubenswrapper[5120]: I0316 16:02:48.800392 5120 scope.go:117] "RemoveContainer" containerID="2f0ea56a5de0726897ddaaf22edcdae384e978440fa164de4d6a31de3aff53ea" Mar 16 16:02:48 crc kubenswrapper[5120]: E0316 16:02:48.800754 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2f0ea56a5de0726897ddaaf22edcdae384e978440fa164de4d6a31de3aff53ea\": container with ID starting with 2f0ea56a5de0726897ddaaf22edcdae384e978440fa164de4d6a31de3aff53ea not found: ID does not exist" containerID="2f0ea56a5de0726897ddaaf22edcdae384e978440fa164de4d6a31de3aff53ea" Mar 16 16:02:48 crc kubenswrapper[5120]: I0316 16:02:48.800796 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f0ea56a5de0726897ddaaf22edcdae384e978440fa164de4d6a31de3aff53ea"} err="failed to get container status \"2f0ea56a5de0726897ddaaf22edcdae384e978440fa164de4d6a31de3aff53ea\": rpc error: code = NotFound desc = could not find container \"2f0ea56a5de0726897ddaaf22edcdae384e978440fa164de4d6a31de3aff53ea\": container with ID starting with 2f0ea56a5de0726897ddaaf22edcdae384e978440fa164de4d6a31de3aff53ea not found: ID does not exist" Mar 16 16:02:48 crc kubenswrapper[5120]: I0316 16:02:48.881179 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/23922841-3b05-4dbe-ae08-50c55a3a44c7-config-data\") pod \"ceilometer-0\" (UID: \"23922841-3b05-4dbe-ae08-50c55a3a44c7\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:02:48 crc kubenswrapper[5120]: I0316 16:02:48.881508 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/23922841-3b05-4dbe-ae08-50c55a3a44c7-log-httpd\") pod \"ceilometer-0\" (UID: \"23922841-3b05-4dbe-ae08-50c55a3a44c7\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:02:48 crc kubenswrapper[5120]: I0316 16:02:48.881644 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/23922841-3b05-4dbe-ae08-50c55a3a44c7-run-httpd\") pod \"ceilometer-0\" (UID: \"23922841-3b05-4dbe-ae08-50c55a3a44c7\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:02:48 crc kubenswrapper[5120]: I0316 16:02:48.881783 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/23922841-3b05-4dbe-ae08-50c55a3a44c7-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"23922841-3b05-4dbe-ae08-50c55a3a44c7\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:02:48 crc kubenswrapper[5120]: I0316 16:02:48.881907 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gwrz\" (UniqueName: \"kubernetes.io/projected/23922841-3b05-4dbe-ae08-50c55a3a44c7-kube-api-access-6gwrz\") pod \"ceilometer-0\" (UID: \"23922841-3b05-4dbe-ae08-50c55a3a44c7\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:02:48 crc kubenswrapper[5120]: I0316 16:02:48.882085 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/23922841-3b05-4dbe-ae08-50c55a3a44c7-scripts\") pod \"ceilometer-0\" (UID: \"23922841-3b05-4dbe-ae08-50c55a3a44c7\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:02:48 crc kubenswrapper[5120]: I0316 16:02:48.882353 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/23922841-3b05-4dbe-ae08-50c55a3a44c7-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"23922841-3b05-4dbe-ae08-50c55a3a44c7\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:02:48 crc kubenswrapper[5120]: I0316 16:02:48.984458 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/23922841-3b05-4dbe-ae08-50c55a3a44c7-scripts\") pod \"ceilometer-0\" (UID: \"23922841-3b05-4dbe-ae08-50c55a3a44c7\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:02:48 crc kubenswrapper[5120]: I0316 16:02:48.984864 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/23922841-3b05-4dbe-ae08-50c55a3a44c7-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"23922841-3b05-4dbe-ae08-50c55a3a44c7\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:02:48 crc kubenswrapper[5120]: I0316 16:02:48.985028 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/23922841-3b05-4dbe-ae08-50c55a3a44c7-config-data\") pod \"ceilometer-0\" (UID: \"23922841-3b05-4dbe-ae08-50c55a3a44c7\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:02:48 crc kubenswrapper[5120]: I0316 16:02:48.985542 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/23922841-3b05-4dbe-ae08-50c55a3a44c7-log-httpd\") pod \"ceilometer-0\" (UID: \"23922841-3b05-4dbe-ae08-50c55a3a44c7\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:02:48 crc kubenswrapper[5120]: I0316 16:02:48.986326 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/23922841-3b05-4dbe-ae08-50c55a3a44c7-run-httpd\") pod \"ceilometer-0\" (UID: \"23922841-3b05-4dbe-ae08-50c55a3a44c7\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:02:48 crc kubenswrapper[5120]: I0316 16:02:48.986446 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/23922841-3b05-4dbe-ae08-50c55a3a44c7-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"23922841-3b05-4dbe-ae08-50c55a3a44c7\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:02:48 crc kubenswrapper[5120]: I0316 16:02:48.986570 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6gwrz\" (UniqueName: \"kubernetes.io/projected/23922841-3b05-4dbe-ae08-50c55a3a44c7-kube-api-access-6gwrz\") pod \"ceilometer-0\" (UID: \"23922841-3b05-4dbe-ae08-50c55a3a44c7\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:02:48 crc kubenswrapper[5120]: I0316 16:02:48.985966 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/23922841-3b05-4dbe-ae08-50c55a3a44c7-log-httpd\") pod \"ceilometer-0\" (UID: \"23922841-3b05-4dbe-ae08-50c55a3a44c7\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:02:48 crc kubenswrapper[5120]: I0316 16:02:48.986819 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/23922841-3b05-4dbe-ae08-50c55a3a44c7-run-httpd\") pod \"ceilometer-0\" (UID: \"23922841-3b05-4dbe-ae08-50c55a3a44c7\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:02:48 crc kubenswrapper[5120]: I0316 16:02:48.989195 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/23922841-3b05-4dbe-ae08-50c55a3a44c7-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"23922841-3b05-4dbe-ae08-50c55a3a44c7\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:02:48 crc kubenswrapper[5120]: I0316 16:02:48.990349 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/23922841-3b05-4dbe-ae08-50c55a3a44c7-scripts\") pod \"ceilometer-0\" (UID: \"23922841-3b05-4dbe-ae08-50c55a3a44c7\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:02:48 crc kubenswrapper[5120]: I0316 16:02:48.998695 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/23922841-3b05-4dbe-ae08-50c55a3a44c7-config-data\") pod \"ceilometer-0\" (UID: \"23922841-3b05-4dbe-ae08-50c55a3a44c7\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:02:49 crc kubenswrapper[5120]: I0316 16:02:49.003704 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/23922841-3b05-4dbe-ae08-50c55a3a44c7-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"23922841-3b05-4dbe-ae08-50c55a3a44c7\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:02:49 crc kubenswrapper[5120]: I0316 16:02:49.009712 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gwrz\" (UniqueName: \"kubernetes.io/projected/23922841-3b05-4dbe-ae08-50c55a3a44c7-kube-api-access-6gwrz\") pod \"ceilometer-0\" (UID: \"23922841-3b05-4dbe-ae08-50c55a3a44c7\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:02:49 crc kubenswrapper[5120]: I0316 16:02:49.610159 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:02:49 crc kubenswrapper[5120]: I0316 16:02:49.630423 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:02:49 crc kubenswrapper[5120]: I0316 16:02:49.698031 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/23922841-3b05-4dbe-ae08-50c55a3a44c7-log-httpd\") pod \"23922841-3b05-4dbe-ae08-50c55a3a44c7\" (UID: \"23922841-3b05-4dbe-ae08-50c55a3a44c7\") " Mar 16 16:02:49 crc kubenswrapper[5120]: I0316 16:02:49.698104 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/23922841-3b05-4dbe-ae08-50c55a3a44c7-config-data\") pod \"23922841-3b05-4dbe-ae08-50c55a3a44c7\" (UID: \"23922841-3b05-4dbe-ae08-50c55a3a44c7\") " Mar 16 16:02:49 crc kubenswrapper[5120]: I0316 16:02:49.698161 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6gwrz\" (UniqueName: \"kubernetes.io/projected/23922841-3b05-4dbe-ae08-50c55a3a44c7-kube-api-access-6gwrz\") pod \"23922841-3b05-4dbe-ae08-50c55a3a44c7\" (UID: \"23922841-3b05-4dbe-ae08-50c55a3a44c7\") " Mar 16 16:02:49 crc kubenswrapper[5120]: I0316 16:02:49.698223 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/23922841-3b05-4dbe-ae08-50c55a3a44c7-run-httpd\") pod \"23922841-3b05-4dbe-ae08-50c55a3a44c7\" (UID: \"23922841-3b05-4dbe-ae08-50c55a3a44c7\") " Mar 16 16:02:49 crc kubenswrapper[5120]: I0316 16:02:49.698246 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/23922841-3b05-4dbe-ae08-50c55a3a44c7-sg-core-conf-yaml\") pod \"23922841-3b05-4dbe-ae08-50c55a3a44c7\" (UID: \"23922841-3b05-4dbe-ae08-50c55a3a44c7\") " Mar 16 16:02:49 crc kubenswrapper[5120]: I0316 16:02:49.698424 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/23922841-3b05-4dbe-ae08-50c55a3a44c7-combined-ca-bundle\") pod \"23922841-3b05-4dbe-ae08-50c55a3a44c7\" (UID: \"23922841-3b05-4dbe-ae08-50c55a3a44c7\") " Mar 16 16:02:49 crc kubenswrapper[5120]: I0316 16:02:49.698509 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/23922841-3b05-4dbe-ae08-50c55a3a44c7-scripts\") pod \"23922841-3b05-4dbe-ae08-50c55a3a44c7\" (UID: \"23922841-3b05-4dbe-ae08-50c55a3a44c7\") " Mar 16 16:02:49 crc kubenswrapper[5120]: I0316 16:02:49.699173 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23922841-3b05-4dbe-ae08-50c55a3a44c7-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "23922841-3b05-4dbe-ae08-50c55a3a44c7" (UID: "23922841-3b05-4dbe-ae08-50c55a3a44c7"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:02:49 crc kubenswrapper[5120]: I0316 16:02:49.699367 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23922841-3b05-4dbe-ae08-50c55a3a44c7-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "23922841-3b05-4dbe-ae08-50c55a3a44c7" (UID: "23922841-3b05-4dbe-ae08-50c55a3a44c7"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:02:49 crc kubenswrapper[5120]: I0316 16:02:49.700442 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/23922841-3b05-4dbe-ae08-50c55a3a44c7-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:02:49 crc kubenswrapper[5120]: I0316 16:02:49.700464 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/23922841-3b05-4dbe-ae08-50c55a3a44c7-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:02:49 crc kubenswrapper[5120]: I0316 16:02:49.708373 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/23922841-3b05-4dbe-ae08-50c55a3a44c7-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "23922841-3b05-4dbe-ae08-50c55a3a44c7" (UID: "23922841-3b05-4dbe-ae08-50c55a3a44c7"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:02:49 crc kubenswrapper[5120]: I0316 16:02:49.708612 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/23922841-3b05-4dbe-ae08-50c55a3a44c7-config-data" (OuterVolumeSpecName: "config-data") pod "23922841-3b05-4dbe-ae08-50c55a3a44c7" (UID: "23922841-3b05-4dbe-ae08-50c55a3a44c7"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:02:49 crc kubenswrapper[5120]: I0316 16:02:49.709912 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/23922841-3b05-4dbe-ae08-50c55a3a44c7-scripts" (OuterVolumeSpecName: "scripts") pod "23922841-3b05-4dbe-ae08-50c55a3a44c7" (UID: "23922841-3b05-4dbe-ae08-50c55a3a44c7"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:02:49 crc kubenswrapper[5120]: I0316 16:02:49.712116 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/23922841-3b05-4dbe-ae08-50c55a3a44c7-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "23922841-3b05-4dbe-ae08-50c55a3a44c7" (UID: "23922841-3b05-4dbe-ae08-50c55a3a44c7"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:02:49 crc kubenswrapper[5120]: I0316 16:02:49.713180 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23922841-3b05-4dbe-ae08-50c55a3a44c7-kube-api-access-6gwrz" (OuterVolumeSpecName: "kube-api-access-6gwrz") pod "23922841-3b05-4dbe-ae08-50c55a3a44c7" (UID: "23922841-3b05-4dbe-ae08-50c55a3a44c7"). InnerVolumeSpecName "kube-api-access-6gwrz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:02:49 crc kubenswrapper[5120]: I0316 16:02:49.802328 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/23922841-3b05-4dbe-ae08-50c55a3a44c7-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:02:49 crc kubenswrapper[5120]: I0316 16:02:49.802596 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/23922841-3b05-4dbe-ae08-50c55a3a44c7-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:02:49 crc kubenswrapper[5120]: I0316 16:02:49.802605 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/23922841-3b05-4dbe-ae08-50c55a3a44c7-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:02:49 crc kubenswrapper[5120]: I0316 16:02:49.802616 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6gwrz\" (UniqueName: \"kubernetes.io/projected/23922841-3b05-4dbe-ae08-50c55a3a44c7-kube-api-access-6gwrz\") on node \"crc\" DevicePath \"\"" Mar 16 16:02:49 crc kubenswrapper[5120]: I0316 16:02:49.802629 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/23922841-3b05-4dbe-ae08-50c55a3a44c7-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 16:02:50 crc kubenswrapper[5120]: I0316 16:02:50.521335 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:02:50 crc kubenswrapper[5120]: I0316 16:02:50.620367 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/97c05f77-d695-4853-acb9-05388320db3b-scripts\") pod \"97c05f77-d695-4853-acb9-05388320db3b\" (UID: \"97c05f77-d695-4853-acb9-05388320db3b\") " Mar 16 16:02:50 crc kubenswrapper[5120]: I0316 16:02:50.620409 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/97c05f77-d695-4853-acb9-05388320db3b-httpd-run\") pod \"97c05f77-d695-4853-acb9-05388320db3b\" (UID: \"97c05f77-d695-4853-acb9-05388320db3b\") " Mar 16 16:02:50 crc kubenswrapper[5120]: I0316 16:02:50.620441 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"97c05f77-d695-4853-acb9-05388320db3b\" (UID: \"97c05f77-d695-4853-acb9-05388320db3b\") " Mar 16 16:02:50 crc kubenswrapper[5120]: I0316 16:02:50.620480 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/97c05f77-d695-4853-acb9-05388320db3b-logs\") pod \"97c05f77-d695-4853-acb9-05388320db3b\" (UID: \"97c05f77-d695-4853-acb9-05388320db3b\") " Mar 16 16:02:50 crc kubenswrapper[5120]: I0316 16:02:50.620507 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/97c05f77-d695-4853-acb9-05388320db3b-public-tls-certs\") pod \"97c05f77-d695-4853-acb9-05388320db3b\" (UID: \"97c05f77-d695-4853-acb9-05388320db3b\") " Mar 16 16:02:50 crc kubenswrapper[5120]: I0316 16:02:50.620545 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/97c05f77-d695-4853-acb9-05388320db3b-combined-ca-bundle\") pod \"97c05f77-d695-4853-acb9-05388320db3b\" (UID: \"97c05f77-d695-4853-acb9-05388320db3b\") " Mar 16 16:02:50 crc kubenswrapper[5120]: I0316 16:02:50.620816 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/97c05f77-d695-4853-acb9-05388320db3b-config-data\") pod \"97c05f77-d695-4853-acb9-05388320db3b\" (UID: \"97c05f77-d695-4853-acb9-05388320db3b\") " Mar 16 16:02:50 crc kubenswrapper[5120]: I0316 16:02:50.620854 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v9xzj\" (UniqueName: \"kubernetes.io/projected/97c05f77-d695-4853-acb9-05388320db3b-kube-api-access-v9xzj\") pod \"97c05f77-d695-4853-acb9-05388320db3b\" (UID: \"97c05f77-d695-4853-acb9-05388320db3b\") " Mar 16 16:02:50 crc kubenswrapper[5120]: I0316 16:02:50.620918 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97c05f77-d695-4853-acb9-05388320db3b-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "97c05f77-d695-4853-acb9-05388320db3b" (UID: "97c05f77-d695-4853-acb9-05388320db3b"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:02:50 crc kubenswrapper[5120]: I0316 16:02:50.621260 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/97c05f77-d695-4853-acb9-05388320db3b-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 16:02:50 crc kubenswrapper[5120]: I0316 16:02:50.623660 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97c05f77-d695-4853-acb9-05388320db3b-logs" (OuterVolumeSpecName: "logs") pod "97c05f77-d695-4853-acb9-05388320db3b" (UID: "97c05f77-d695-4853-acb9-05388320db3b"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:02:50 crc kubenswrapper[5120]: I0316 16:02:50.627577 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97c05f77-d695-4853-acb9-05388320db3b-kube-api-access-v9xzj" (OuterVolumeSpecName: "kube-api-access-v9xzj") pod "97c05f77-d695-4853-acb9-05388320db3b" (UID: "97c05f77-d695-4853-acb9-05388320db3b"). InnerVolumeSpecName "kube-api-access-v9xzj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:02:50 crc kubenswrapper[5120]: I0316 16:02:50.629185 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage13-crc" (OuterVolumeSpecName: "glance") pod "97c05f77-d695-4853-acb9-05388320db3b" (UID: "97c05f77-d695-4853-acb9-05388320db3b"). InnerVolumeSpecName "local-storage13-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:02:50 crc kubenswrapper[5120]: I0316 16:02:50.630182 5120 generic.go:358] "Generic (PLEG): container finished" podID="97c05f77-d695-4853-acb9-05388320db3b" containerID="0e4b269601afde05465d88d6caa9c22cf556e6ef38c8b25edfe4940f6828106c" exitCode=0 Mar 16 16:02:50 crc kubenswrapper[5120]: I0316 16:02:50.630323 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"97c05f77-d695-4853-acb9-05388320db3b","Type":"ContainerDied","Data":"0e4b269601afde05465d88d6caa9c22cf556e6ef38c8b25edfe4940f6828106c"} Mar 16 16:02:50 crc kubenswrapper[5120]: I0316 16:02:50.630375 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"97c05f77-d695-4853-acb9-05388320db3b","Type":"ContainerDied","Data":"b1520153e51d4a82d606d7bba49c21f67cd382240196618d4897d09893562f16"} Mar 16 16:02:50 crc kubenswrapper[5120]: I0316 16:02:50.630397 5120 scope.go:117] "RemoveContainer" containerID="0e4b269601afde05465d88d6caa9c22cf556e6ef38c8b25edfe4940f6828106c" Mar 16 16:02:50 crc kubenswrapper[5120]: I0316 16:02:50.630328 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:02:50 crc kubenswrapper[5120]: I0316 16:02:50.630627 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/97c05f77-d695-4853-acb9-05388320db3b-scripts" (OuterVolumeSpecName: "scripts") pod "97c05f77-d695-4853-acb9-05388320db3b" (UID: "97c05f77-d695-4853-acb9-05388320db3b"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:02:50 crc kubenswrapper[5120]: I0316 16:02:50.631294 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:02:50 crc kubenswrapper[5120]: I0316 16:02:50.667542 5120 scope.go:117] "RemoveContainer" containerID="2fb7224a1e61d725ae62ac7949cc94af8bf14dafa656593489f273d049fb501f" Mar 16 16:02:50 crc kubenswrapper[5120]: I0316 16:02:50.677180 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/97c05f77-d695-4853-acb9-05388320db3b-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "97c05f77-d695-4853-acb9-05388320db3b" (UID: "97c05f77-d695-4853-acb9-05388320db3b"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:02:50 crc kubenswrapper[5120]: I0316 16:02:50.685164 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/97c05f77-d695-4853-acb9-05388320db3b-config-data" (OuterVolumeSpecName: "config-data") pod "97c05f77-d695-4853-acb9-05388320db3b" (UID: "97c05f77-d695-4853-acb9-05388320db3b"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:02:50 crc kubenswrapper[5120]: I0316 16:02:50.729220 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/97c05f77-d695-4853-acb9-05388320db3b-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "97c05f77-d695-4853-acb9-05388320db3b" (UID: "97c05f77-d695-4853-acb9-05388320db3b"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:02:50 crc kubenswrapper[5120]: I0316 16:02:50.729443 5120 scope.go:117] "RemoveContainer" containerID="0e4b269601afde05465d88d6caa9c22cf556e6ef38c8b25edfe4940f6828106c" Mar 16 16:02:50 crc kubenswrapper[5120]: I0316 16:02:50.730310 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="41237879-5c40-4f4b-ad6f-39dab45ba2d5" path="/var/lib/kubelet/pods/41237879-5c40-4f4b-ad6f-39dab45ba2d5/volumes" Mar 16 16:02:50 crc kubenswrapper[5120]: E0316 16:02:50.737408 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0e4b269601afde05465d88d6caa9c22cf556e6ef38c8b25edfe4940f6828106c\": container with ID starting with 0e4b269601afde05465d88d6caa9c22cf556e6ef38c8b25edfe4940f6828106c not found: ID does not exist" containerID="0e4b269601afde05465d88d6caa9c22cf556e6ef38c8b25edfe4940f6828106c" Mar 16 16:02:50 crc kubenswrapper[5120]: I0316 16:02:50.737444 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e4b269601afde05465d88d6caa9c22cf556e6ef38c8b25edfe4940f6828106c"} err="failed to get container status \"0e4b269601afde05465d88d6caa9c22cf556e6ef38c8b25edfe4940f6828106c\": rpc error: code = NotFound desc = could not find container \"0e4b269601afde05465d88d6caa9c22cf556e6ef38c8b25edfe4940f6828106c\": container with ID starting with 0e4b269601afde05465d88d6caa9c22cf556e6ef38c8b25edfe4940f6828106c not found: ID does not exist" Mar 16 16:02:50 crc kubenswrapper[5120]: I0316 16:02:50.737467 5120 scope.go:117] "RemoveContainer" containerID="2fb7224a1e61d725ae62ac7949cc94af8bf14dafa656593489f273d049fb501f" Mar 16 16:02:50 crc kubenswrapper[5120]: I0316 16:02:50.739683 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/97c05f77-d695-4853-acb9-05388320db3b-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:02:50 crc kubenswrapper[5120]: I0316 16:02:50.739709 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v9xzj\" (UniqueName: \"kubernetes.io/projected/97c05f77-d695-4853-acb9-05388320db3b-kube-api-access-v9xzj\") on node \"crc\" DevicePath \"\"" Mar 16 16:02:50 crc kubenswrapper[5120]: I0316 16:02:50.739719 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/97c05f77-d695-4853-acb9-05388320db3b-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:02:50 crc kubenswrapper[5120]: I0316 16:02:50.739747 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") on node \"crc\" " Mar 16 16:02:50 crc kubenswrapper[5120]: I0316 16:02:50.739792 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/97c05f77-d695-4853-acb9-05388320db3b-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:02:50 crc kubenswrapper[5120]: I0316 16:02:50.739802 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/97c05f77-d695-4853-acb9-05388320db3b-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:02:50 crc kubenswrapper[5120]: I0316 16:02:50.739814 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/97c05f77-d695-4853-acb9-05388320db3b-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:02:50 crc kubenswrapper[5120]: E0316 16:02:50.740434 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2fb7224a1e61d725ae62ac7949cc94af8bf14dafa656593489f273d049fb501f\": container with ID starting with 2fb7224a1e61d725ae62ac7949cc94af8bf14dafa656593489f273d049fb501f not found: ID does not exist" containerID="2fb7224a1e61d725ae62ac7949cc94af8bf14dafa656593489f273d049fb501f" Mar 16 16:02:50 crc kubenswrapper[5120]: I0316 16:02:50.740500 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2fb7224a1e61d725ae62ac7949cc94af8bf14dafa656593489f273d049fb501f"} err="failed to get container status \"2fb7224a1e61d725ae62ac7949cc94af8bf14dafa656593489f273d049fb501f\": rpc error: code = NotFound desc = could not find container \"2fb7224a1e61d725ae62ac7949cc94af8bf14dafa656593489f273d049fb501f\": container with ID starting with 2fb7224a1e61d725ae62ac7949cc94af8bf14dafa656593489f273d049fb501f not found: ID does not exist" Mar 16 16:02:50 crc kubenswrapper[5120]: I0316 16:02:50.762260 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:02:50 crc kubenswrapper[5120]: I0316 16:02:50.764813 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage13-crc" (UniqueName: "kubernetes.io/local-volume/local-storage13-crc") on node "crc" Mar 16 16:02:50 crc kubenswrapper[5120]: I0316 16:02:50.771846 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:02:50 crc kubenswrapper[5120]: I0316 16:02:50.780017 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:02:50 crc kubenswrapper[5120]: I0316 16:02:50.781903 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97c05f77-d695-4853-acb9-05388320db3b" containerName="glance-log" Mar 16 16:02:50 crc kubenswrapper[5120]: I0316 16:02:50.781984 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="97c05f77-d695-4853-acb9-05388320db3b" containerName="glance-log" Mar 16 16:02:50 crc kubenswrapper[5120]: I0316 16:02:50.782030 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97c05f77-d695-4853-acb9-05388320db3b" containerName="glance-httpd" Mar 16 16:02:50 crc kubenswrapper[5120]: I0316 16:02:50.782036 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="97c05f77-d695-4853-acb9-05388320db3b" containerName="glance-httpd" Mar 16 16:02:50 crc kubenswrapper[5120]: I0316 16:02:50.782192 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="97c05f77-d695-4853-acb9-05388320db3b" containerName="glance-httpd" Mar 16 16:02:50 crc kubenswrapper[5120]: I0316 16:02:50.782206 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="97c05f77-d695-4853-acb9-05388320db3b" containerName="glance-log" Mar 16 16:02:50 crc kubenswrapper[5120]: I0316 16:02:50.790313 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:02:50 crc kubenswrapper[5120]: I0316 16:02:50.790437 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:02:50 crc kubenswrapper[5120]: I0316 16:02:50.793220 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 16:02:50 crc kubenswrapper[5120]: I0316 16:02:50.793273 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 16:02:50 crc kubenswrapper[5120]: I0316 16:02:50.842113 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ce30340d-6cf2-40a4-a2ff-d9dc9dc33bd8-log-httpd\") pod \"ceilometer-0\" (UID: \"ce30340d-6cf2-40a4-a2ff-d9dc9dc33bd8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:02:50 crc kubenswrapper[5120]: I0316 16:02:50.842196 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ce30340d-6cf2-40a4-a2ff-d9dc9dc33bd8-run-httpd\") pod \"ceilometer-0\" (UID: \"ce30340d-6cf2-40a4-a2ff-d9dc9dc33bd8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:02:50 crc kubenswrapper[5120]: I0316 16:02:50.842235 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ce30340d-6cf2-40a4-a2ff-d9dc9dc33bd8-config-data\") pod \"ceilometer-0\" (UID: \"ce30340d-6cf2-40a4-a2ff-d9dc9dc33bd8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:02:50 crc kubenswrapper[5120]: I0316 16:02:50.842306 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6b6l\" (UniqueName: \"kubernetes.io/projected/ce30340d-6cf2-40a4-a2ff-d9dc9dc33bd8-kube-api-access-t6b6l\") pod \"ceilometer-0\" (UID: \"ce30340d-6cf2-40a4-a2ff-d9dc9dc33bd8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:02:50 crc kubenswrapper[5120]: I0316 16:02:50.842343 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ce30340d-6cf2-40a4-a2ff-d9dc9dc33bd8-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"ce30340d-6cf2-40a4-a2ff-d9dc9dc33bd8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:02:50 crc kubenswrapper[5120]: I0316 16:02:50.842403 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/ce30340d-6cf2-40a4-a2ff-d9dc9dc33bd8-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"ce30340d-6cf2-40a4-a2ff-d9dc9dc33bd8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:02:50 crc kubenswrapper[5120]: I0316 16:02:50.842427 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ce30340d-6cf2-40a4-a2ff-d9dc9dc33bd8-scripts\") pod \"ceilometer-0\" (UID: \"ce30340d-6cf2-40a4-a2ff-d9dc9dc33bd8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:02:50 crc kubenswrapper[5120]: I0316 16:02:50.842522 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:02:50 crc kubenswrapper[5120]: I0316 16:02:50.944048 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/ce30340d-6cf2-40a4-a2ff-d9dc9dc33bd8-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"ce30340d-6cf2-40a4-a2ff-d9dc9dc33bd8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:02:50 crc kubenswrapper[5120]: I0316 16:02:50.944379 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ce30340d-6cf2-40a4-a2ff-d9dc9dc33bd8-scripts\") pod \"ceilometer-0\" (UID: \"ce30340d-6cf2-40a4-a2ff-d9dc9dc33bd8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:02:50 crc kubenswrapper[5120]: I0316 16:02:50.944516 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ce30340d-6cf2-40a4-a2ff-d9dc9dc33bd8-log-httpd\") pod \"ceilometer-0\" (UID: \"ce30340d-6cf2-40a4-a2ff-d9dc9dc33bd8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:02:50 crc kubenswrapper[5120]: I0316 16:02:50.944588 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ce30340d-6cf2-40a4-a2ff-d9dc9dc33bd8-run-httpd\") pod \"ceilometer-0\" (UID: \"ce30340d-6cf2-40a4-a2ff-d9dc9dc33bd8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:02:50 crc kubenswrapper[5120]: I0316 16:02:50.944631 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ce30340d-6cf2-40a4-a2ff-d9dc9dc33bd8-config-data\") pod \"ceilometer-0\" (UID: \"ce30340d-6cf2-40a4-a2ff-d9dc9dc33bd8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:02:50 crc kubenswrapper[5120]: I0316 16:02:50.944694 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t6b6l\" (UniqueName: \"kubernetes.io/projected/ce30340d-6cf2-40a4-a2ff-d9dc9dc33bd8-kube-api-access-t6b6l\") pod \"ceilometer-0\" (UID: \"ce30340d-6cf2-40a4-a2ff-d9dc9dc33bd8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:02:50 crc kubenswrapper[5120]: I0316 16:02:50.944732 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ce30340d-6cf2-40a4-a2ff-d9dc9dc33bd8-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"ce30340d-6cf2-40a4-a2ff-d9dc9dc33bd8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:02:50 crc kubenswrapper[5120]: I0316 16:02:50.945898 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ce30340d-6cf2-40a4-a2ff-d9dc9dc33bd8-run-httpd\") pod \"ceilometer-0\" (UID: \"ce30340d-6cf2-40a4-a2ff-d9dc9dc33bd8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:02:50 crc kubenswrapper[5120]: I0316 16:02:50.946450 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ce30340d-6cf2-40a4-a2ff-d9dc9dc33bd8-log-httpd\") pod \"ceilometer-0\" (UID: \"ce30340d-6cf2-40a4-a2ff-d9dc9dc33bd8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:02:50 crc kubenswrapper[5120]: I0316 16:02:50.952617 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/ce30340d-6cf2-40a4-a2ff-d9dc9dc33bd8-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"ce30340d-6cf2-40a4-a2ff-d9dc9dc33bd8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:02:50 crc kubenswrapper[5120]: I0316 16:02:50.954661 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ce30340d-6cf2-40a4-a2ff-d9dc9dc33bd8-config-data\") pod \"ceilometer-0\" (UID: \"ce30340d-6cf2-40a4-a2ff-d9dc9dc33bd8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:02:50 crc kubenswrapper[5120]: I0316 16:02:50.955575 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ce30340d-6cf2-40a4-a2ff-d9dc9dc33bd8-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"ce30340d-6cf2-40a4-a2ff-d9dc9dc33bd8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:02:50 crc kubenswrapper[5120]: I0316 16:02:50.956397 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ce30340d-6cf2-40a4-a2ff-d9dc9dc33bd8-scripts\") pod \"ceilometer-0\" (UID: \"ce30340d-6cf2-40a4-a2ff-d9dc9dc33bd8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:02:50 crc kubenswrapper[5120]: I0316 16:02:50.973086 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:02:50 crc kubenswrapper[5120]: I0316 16:02:50.976575 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6b6l\" (UniqueName: \"kubernetes.io/projected/ce30340d-6cf2-40a4-a2ff-d9dc9dc33bd8-kube-api-access-t6b6l\") pod \"ceilometer-0\" (UID: \"ce30340d-6cf2-40a4-a2ff-d9dc9dc33bd8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:02:50 crc kubenswrapper[5120]: I0316 16:02:50.984461 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:02:51 crc kubenswrapper[5120]: I0316 16:02:51.004278 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:02:51 crc kubenswrapper[5120]: I0316 16:02:51.017941 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:02:51 crc kubenswrapper[5120]: I0316 16:02:51.018071 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:02:51 crc kubenswrapper[5120]: I0316 16:02:51.021305 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-external-config-data\"" Mar 16 16:02:51 crc kubenswrapper[5120]: I0316 16:02:51.021435 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-public-svc\"" Mar 16 16:02:51 crc kubenswrapper[5120]: I0316 16:02:51.053634 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f6934b6a-f36d-400a-bb39-d0cdaf66cbae-config-data\") pod \"glance-default-external-api-0\" (UID: \"f6934b6a-f36d-400a-bb39-d0cdaf66cbae\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:02:51 crc kubenswrapper[5120]: I0316 16:02:51.053712 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f6934b6a-f36d-400a-bb39-d0cdaf66cbae-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"f6934b6a-f36d-400a-bb39-d0cdaf66cbae\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:02:51 crc kubenswrapper[5120]: I0316 16:02:51.053755 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f6934b6a-f36d-400a-bb39-d0cdaf66cbae-logs\") pod \"glance-default-external-api-0\" (UID: \"f6934b6a-f36d-400a-bb39-d0cdaf66cbae\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:02:51 crc kubenswrapper[5120]: I0316 16:02:51.053816 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f6934b6a-f36d-400a-bb39-d0cdaf66cbae-scripts\") pod \"glance-default-external-api-0\" (UID: \"f6934b6a-f36d-400a-bb39-d0cdaf66cbae\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:02:51 crc kubenswrapper[5120]: I0316 16:02:51.053880 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f6934b6a-f36d-400a-bb39-d0cdaf66cbae-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"f6934b6a-f36d-400a-bb39-d0cdaf66cbae\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:02:51 crc kubenswrapper[5120]: I0316 16:02:51.053904 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/f6934b6a-f36d-400a-bb39-d0cdaf66cbae-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"f6934b6a-f36d-400a-bb39-d0cdaf66cbae\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:02:51 crc kubenswrapper[5120]: I0316 16:02:51.053961 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qpf8z\" (UniqueName: \"kubernetes.io/projected/f6934b6a-f36d-400a-bb39-d0cdaf66cbae-kube-api-access-qpf8z\") pod \"glance-default-external-api-0\" (UID: \"f6934b6a-f36d-400a-bb39-d0cdaf66cbae\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:02:51 crc kubenswrapper[5120]: I0316 16:02:51.054004 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"glance-default-external-api-0\" (UID: \"f6934b6a-f36d-400a-bb39-d0cdaf66cbae\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:02:51 crc kubenswrapper[5120]: I0316 16:02:51.156429 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f6934b6a-f36d-400a-bb39-d0cdaf66cbae-config-data\") pod \"glance-default-external-api-0\" (UID: \"f6934b6a-f36d-400a-bb39-d0cdaf66cbae\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:02:51 crc kubenswrapper[5120]: I0316 16:02:51.156852 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f6934b6a-f36d-400a-bb39-d0cdaf66cbae-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"f6934b6a-f36d-400a-bb39-d0cdaf66cbae\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:02:51 crc kubenswrapper[5120]: I0316 16:02:51.156898 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f6934b6a-f36d-400a-bb39-d0cdaf66cbae-logs\") pod \"glance-default-external-api-0\" (UID: \"f6934b6a-f36d-400a-bb39-d0cdaf66cbae\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:02:51 crc kubenswrapper[5120]: I0316 16:02:51.156932 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f6934b6a-f36d-400a-bb39-d0cdaf66cbae-scripts\") pod \"glance-default-external-api-0\" (UID: \"f6934b6a-f36d-400a-bb39-d0cdaf66cbae\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:02:51 crc kubenswrapper[5120]: I0316 16:02:51.156996 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f6934b6a-f36d-400a-bb39-d0cdaf66cbae-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"f6934b6a-f36d-400a-bb39-d0cdaf66cbae\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:02:51 crc kubenswrapper[5120]: I0316 16:02:51.157193 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/f6934b6a-f36d-400a-bb39-d0cdaf66cbae-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"f6934b6a-f36d-400a-bb39-d0cdaf66cbae\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:02:51 crc kubenswrapper[5120]: I0316 16:02:51.157259 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qpf8z\" (UniqueName: \"kubernetes.io/projected/f6934b6a-f36d-400a-bb39-d0cdaf66cbae-kube-api-access-qpf8z\") pod \"glance-default-external-api-0\" (UID: \"f6934b6a-f36d-400a-bb39-d0cdaf66cbae\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:02:51 crc kubenswrapper[5120]: I0316 16:02:51.157299 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"glance-default-external-api-0\" (UID: \"f6934b6a-f36d-400a-bb39-d0cdaf66cbae\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:02:51 crc kubenswrapper[5120]: I0316 16:02:51.157487 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f6934b6a-f36d-400a-bb39-d0cdaf66cbae-logs\") pod \"glance-default-external-api-0\" (UID: \"f6934b6a-f36d-400a-bb39-d0cdaf66cbae\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:02:51 crc kubenswrapper[5120]: I0316 16:02:51.157522 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/f6934b6a-f36d-400a-bb39-d0cdaf66cbae-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"f6934b6a-f36d-400a-bb39-d0cdaf66cbae\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:02:51 crc kubenswrapper[5120]: I0316 16:02:51.158064 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"glance-default-external-api-0\" (UID: \"f6934b6a-f36d-400a-bb39-d0cdaf66cbae\") device mount path \"/mnt/openstack/pv13\"" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:02:51 crc kubenswrapper[5120]: I0316 16:02:51.168860 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f6934b6a-f36d-400a-bb39-d0cdaf66cbae-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"f6934b6a-f36d-400a-bb39-d0cdaf66cbae\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:02:51 crc kubenswrapper[5120]: I0316 16:02:51.170289 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f6934b6a-f36d-400a-bb39-d0cdaf66cbae-config-data\") pod \"glance-default-external-api-0\" (UID: \"f6934b6a-f36d-400a-bb39-d0cdaf66cbae\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:02:51 crc kubenswrapper[5120]: I0316 16:02:51.170679 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f6934b6a-f36d-400a-bb39-d0cdaf66cbae-scripts\") pod \"glance-default-external-api-0\" (UID: \"f6934b6a-f36d-400a-bb39-d0cdaf66cbae\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:02:51 crc kubenswrapper[5120]: I0316 16:02:51.171048 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:02:51 crc kubenswrapper[5120]: I0316 16:02:51.178851 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f6934b6a-f36d-400a-bb39-d0cdaf66cbae-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"f6934b6a-f36d-400a-bb39-d0cdaf66cbae\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:02:51 crc kubenswrapper[5120]: I0316 16:02:51.180750 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qpf8z\" (UniqueName: \"kubernetes.io/projected/f6934b6a-f36d-400a-bb39-d0cdaf66cbae-kube-api-access-qpf8z\") pod \"glance-default-external-api-0\" (UID: \"f6934b6a-f36d-400a-bb39-d0cdaf66cbae\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:02:51 crc kubenswrapper[5120]: I0316 16:02:51.194611 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"glance-default-external-api-0\" (UID: \"f6934b6a-f36d-400a-bb39-d0cdaf66cbae\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:02:51 crc kubenswrapper[5120]: I0316 16:02:51.223632 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:02:51 crc kubenswrapper[5120]: I0316 16:02:51.367295 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ee138521-8f48-4215-9e58-cf1d50ad7910-combined-ca-bundle\") pod \"ee138521-8f48-4215-9e58-cf1d50ad7910\" (UID: \"ee138521-8f48-4215-9e58-cf1d50ad7910\") " Mar 16 16:02:51 crc kubenswrapper[5120]: I0316 16:02:51.367395 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ee138521-8f48-4215-9e58-cf1d50ad7910-config-data\") pod \"ee138521-8f48-4215-9e58-cf1d50ad7910\" (UID: \"ee138521-8f48-4215-9e58-cf1d50ad7910\") " Mar 16 16:02:51 crc kubenswrapper[5120]: I0316 16:02:51.367491 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mhnk4\" (UniqueName: \"kubernetes.io/projected/ee138521-8f48-4215-9e58-cf1d50ad7910-kube-api-access-mhnk4\") pod \"ee138521-8f48-4215-9e58-cf1d50ad7910\" (UID: \"ee138521-8f48-4215-9e58-cf1d50ad7910\") " Mar 16 16:02:51 crc kubenswrapper[5120]: I0316 16:02:51.367606 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ee138521-8f48-4215-9e58-cf1d50ad7910-scripts\") pod \"ee138521-8f48-4215-9e58-cf1d50ad7910\" (UID: \"ee138521-8f48-4215-9e58-cf1d50ad7910\") " Mar 16 16:02:51 crc kubenswrapper[5120]: I0316 16:02:51.367632 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/ee138521-8f48-4215-9e58-cf1d50ad7910-httpd-run\") pod \"ee138521-8f48-4215-9e58-cf1d50ad7910\" (UID: \"ee138521-8f48-4215-9e58-cf1d50ad7910\") " Mar 16 16:02:51 crc kubenswrapper[5120]: I0316 16:02:51.367712 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ee138521-8f48-4215-9e58-cf1d50ad7910-logs\") pod \"ee138521-8f48-4215-9e58-cf1d50ad7910\" (UID: \"ee138521-8f48-4215-9e58-cf1d50ad7910\") " Mar 16 16:02:51 crc kubenswrapper[5120]: I0316 16:02:51.367828 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"ee138521-8f48-4215-9e58-cf1d50ad7910\" (UID: \"ee138521-8f48-4215-9e58-cf1d50ad7910\") " Mar 16 16:02:51 crc kubenswrapper[5120]: I0316 16:02:51.367854 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/ee138521-8f48-4215-9e58-cf1d50ad7910-internal-tls-certs\") pod \"ee138521-8f48-4215-9e58-cf1d50ad7910\" (UID: \"ee138521-8f48-4215-9e58-cf1d50ad7910\") " Mar 16 16:02:51 crc kubenswrapper[5120]: I0316 16:02:51.375658 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee138521-8f48-4215-9e58-cf1d50ad7910-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "ee138521-8f48-4215-9e58-cf1d50ad7910" (UID: "ee138521-8f48-4215-9e58-cf1d50ad7910"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:02:51 crc kubenswrapper[5120]: I0316 16:02:51.380892 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee138521-8f48-4215-9e58-cf1d50ad7910-logs" (OuterVolumeSpecName: "logs") pod "ee138521-8f48-4215-9e58-cf1d50ad7910" (UID: "ee138521-8f48-4215-9e58-cf1d50ad7910"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:02:51 crc kubenswrapper[5120]: I0316 16:02:51.385919 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ee138521-8f48-4215-9e58-cf1d50ad7910-scripts" (OuterVolumeSpecName: "scripts") pod "ee138521-8f48-4215-9e58-cf1d50ad7910" (UID: "ee138521-8f48-4215-9e58-cf1d50ad7910"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:02:51 crc kubenswrapper[5120]: I0316 16:02:51.386457 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:02:51 crc kubenswrapper[5120]: I0316 16:02:51.389059 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee138521-8f48-4215-9e58-cf1d50ad7910-kube-api-access-mhnk4" (OuterVolumeSpecName: "kube-api-access-mhnk4") pod "ee138521-8f48-4215-9e58-cf1d50ad7910" (UID: "ee138521-8f48-4215-9e58-cf1d50ad7910"). InnerVolumeSpecName "kube-api-access-mhnk4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:02:51 crc kubenswrapper[5120]: I0316 16:02:51.391923 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage09-crc" (OuterVolumeSpecName: "glance") pod "ee138521-8f48-4215-9e58-cf1d50ad7910" (UID: "ee138521-8f48-4215-9e58-cf1d50ad7910"). InnerVolumeSpecName "local-storage09-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:02:51 crc kubenswrapper[5120]: I0316 16:02:51.448062 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ee138521-8f48-4215-9e58-cf1d50ad7910-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ee138521-8f48-4215-9e58-cf1d50ad7910" (UID: "ee138521-8f48-4215-9e58-cf1d50ad7910"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:02:51 crc kubenswrapper[5120]: I0316 16:02:51.472454 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ee138521-8f48-4215-9e58-cf1d50ad7910-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:02:51 crc kubenswrapper[5120]: I0316 16:02:51.472914 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") on node \"crc\" " Mar 16 16:02:51 crc kubenswrapper[5120]: I0316 16:02:51.472980 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ee138521-8f48-4215-9e58-cf1d50ad7910-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:02:51 crc kubenswrapper[5120]: I0316 16:02:51.473039 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mhnk4\" (UniqueName: \"kubernetes.io/projected/ee138521-8f48-4215-9e58-cf1d50ad7910-kube-api-access-mhnk4\") on node \"crc\" DevicePath \"\"" Mar 16 16:02:51 crc kubenswrapper[5120]: I0316 16:02:51.473094 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ee138521-8f48-4215-9e58-cf1d50ad7910-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:02:51 crc kubenswrapper[5120]: I0316 16:02:51.473146 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/ee138521-8f48-4215-9e58-cf1d50ad7910-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 16:02:51 crc kubenswrapper[5120]: I0316 16:02:51.492937 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ee138521-8f48-4215-9e58-cf1d50ad7910-config-data" (OuterVolumeSpecName: "config-data") pod "ee138521-8f48-4215-9e58-cf1d50ad7910" (UID: "ee138521-8f48-4215-9e58-cf1d50ad7910"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:02:51 crc kubenswrapper[5120]: I0316 16:02:51.498721 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage09-crc" (UniqueName: "kubernetes.io/local-volume/local-storage09-crc") on node "crc" Mar 16 16:02:51 crc kubenswrapper[5120]: I0316 16:02:51.500985 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ee138521-8f48-4215-9e58-cf1d50ad7910-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "ee138521-8f48-4215-9e58-cf1d50ad7910" (UID: "ee138521-8f48-4215-9e58-cf1d50ad7910"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:02:51 crc kubenswrapper[5120]: I0316 16:02:51.583051 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:02:51 crc kubenswrapper[5120]: I0316 16:02:51.583082 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/ee138521-8f48-4215-9e58-cf1d50ad7910-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:02:51 crc kubenswrapper[5120]: I0316 16:02:51.583092 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ee138521-8f48-4215-9e58-cf1d50ad7910-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:02:51 crc kubenswrapper[5120]: I0316 16:02:51.588395 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/swift-proxy-687cfbc4db-ngqr9" Mar 16 16:02:51 crc kubenswrapper[5120]: I0316 16:02:51.590198 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/swift-proxy-687cfbc4db-ngqr9" Mar 16 16:02:51 crc kubenswrapper[5120]: I0316 16:02:51.650673 5120 generic.go:358] "Generic (PLEG): container finished" podID="ee138521-8f48-4215-9e58-cf1d50ad7910" containerID="4a2dee30e47e2483dd875b5fbbc3f4abc1d9b1c74824ae9639353e63a9890e0a" exitCode=0 Mar 16 16:02:51 crc kubenswrapper[5120]: I0316 16:02:51.650792 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"ee138521-8f48-4215-9e58-cf1d50ad7910","Type":"ContainerDied","Data":"4a2dee30e47e2483dd875b5fbbc3f4abc1d9b1c74824ae9639353e63a9890e0a"} Mar 16 16:02:51 crc kubenswrapper[5120]: I0316 16:02:51.650843 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"ee138521-8f48-4215-9e58-cf1d50ad7910","Type":"ContainerDied","Data":"fd19044e11895a17402693257502eb83df372f4ff20e42eae6cbafafdae34feb"} Mar 16 16:02:51 crc kubenswrapper[5120]: I0316 16:02:51.650864 5120 scope.go:117] "RemoveContainer" containerID="4a2dee30e47e2483dd875b5fbbc3f4abc1d9b1c74824ae9639353e63a9890e0a" Mar 16 16:02:51 crc kubenswrapper[5120]: I0316 16:02:51.651888 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:02:51 crc kubenswrapper[5120]: I0316 16:02:51.690873 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:02:51 crc kubenswrapper[5120]: I0316 16:02:51.699738 5120 scope.go:117] "RemoveContainer" containerID="780d1a21d3dfa92fa26d3abf9a3a36fbee1bd1a740cfed6d040700a2c31f1959" Mar 16 16:02:51 crc kubenswrapper[5120]: I0316 16:02:51.761131 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:02:51 crc kubenswrapper[5120]: I0316 16:02:51.770983 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:02:51 crc kubenswrapper[5120]: I0316 16:02:51.772159 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee138521-8f48-4215-9e58-cf1d50ad7910" containerName="glance-log" Mar 16 16:02:51 crc kubenswrapper[5120]: I0316 16:02:51.772181 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee138521-8f48-4215-9e58-cf1d50ad7910" containerName="glance-log" Mar 16 16:02:51 crc kubenswrapper[5120]: I0316 16:02:51.772194 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee138521-8f48-4215-9e58-cf1d50ad7910" containerName="glance-httpd" Mar 16 16:02:51 crc kubenswrapper[5120]: I0316 16:02:51.772201 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee138521-8f48-4215-9e58-cf1d50ad7910" containerName="glance-httpd" Mar 16 16:02:51 crc kubenswrapper[5120]: I0316 16:02:51.772429 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ee138521-8f48-4215-9e58-cf1d50ad7910" containerName="glance-log" Mar 16 16:02:51 crc kubenswrapper[5120]: I0316 16:02:51.772458 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ee138521-8f48-4215-9e58-cf1d50ad7910" containerName="glance-httpd" Mar 16 16:02:51 crc kubenswrapper[5120]: I0316 16:02:51.784286 5120 scope.go:117] "RemoveContainer" containerID="4a2dee30e47e2483dd875b5fbbc3f4abc1d9b1c74824ae9639353e63a9890e0a" Mar 16 16:02:51 crc kubenswrapper[5120]: E0316 16:02:51.785547 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4a2dee30e47e2483dd875b5fbbc3f4abc1d9b1c74824ae9639353e63a9890e0a\": container with ID starting with 4a2dee30e47e2483dd875b5fbbc3f4abc1d9b1c74824ae9639353e63a9890e0a not found: ID does not exist" containerID="4a2dee30e47e2483dd875b5fbbc3f4abc1d9b1c74824ae9639353e63a9890e0a" Mar 16 16:02:51 crc kubenswrapper[5120]: I0316 16:02:51.785582 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a2dee30e47e2483dd875b5fbbc3f4abc1d9b1c74824ae9639353e63a9890e0a"} err="failed to get container status \"4a2dee30e47e2483dd875b5fbbc3f4abc1d9b1c74824ae9639353e63a9890e0a\": rpc error: code = NotFound desc = could not find container \"4a2dee30e47e2483dd875b5fbbc3f4abc1d9b1c74824ae9639353e63a9890e0a\": container with ID starting with 4a2dee30e47e2483dd875b5fbbc3f4abc1d9b1c74824ae9639353e63a9890e0a not found: ID does not exist" Mar 16 16:02:51 crc kubenswrapper[5120]: I0316 16:02:51.785605 5120 scope.go:117] "RemoveContainer" containerID="780d1a21d3dfa92fa26d3abf9a3a36fbee1bd1a740cfed6d040700a2c31f1959" Mar 16 16:02:51 crc kubenswrapper[5120]: E0316 16:02:51.786315 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"780d1a21d3dfa92fa26d3abf9a3a36fbee1bd1a740cfed6d040700a2c31f1959\": container with ID starting with 780d1a21d3dfa92fa26d3abf9a3a36fbee1bd1a740cfed6d040700a2c31f1959 not found: ID does not exist" containerID="780d1a21d3dfa92fa26d3abf9a3a36fbee1bd1a740cfed6d040700a2c31f1959" Mar 16 16:02:51 crc kubenswrapper[5120]: I0316 16:02:51.786394 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"780d1a21d3dfa92fa26d3abf9a3a36fbee1bd1a740cfed6d040700a2c31f1959"} err="failed to get container status \"780d1a21d3dfa92fa26d3abf9a3a36fbee1bd1a740cfed6d040700a2c31f1959\": rpc error: code = NotFound desc = could not find container \"780d1a21d3dfa92fa26d3abf9a3a36fbee1bd1a740cfed6d040700a2c31f1959\": container with ID starting with 780d1a21d3dfa92fa26d3abf9a3a36fbee1bd1a740cfed6d040700a2c31f1959 not found: ID does not exist" Mar 16 16:02:51 crc kubenswrapper[5120]: I0316 16:02:51.786738 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:02:51 crc kubenswrapper[5120]: I0316 16:02:51.786959 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:02:51 crc kubenswrapper[5120]: I0316 16:02:51.788951 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-internal-svc\"" Mar 16 16:02:51 crc kubenswrapper[5120]: I0316 16:02:51.789969 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-internal-config-data\"" Mar 16 16:02:51 crc kubenswrapper[5120]: I0316 16:02:51.796309 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:02:51 crc kubenswrapper[5120]: I0316 16:02:51.892391 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"glance-default-internal-api-0\" (UID: \"ff5d8cf4-cd75-4107-8fc7-a462d339bab3\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:02:51 crc kubenswrapper[5120]: I0316 16:02:51.892682 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ff5d8cf4-cd75-4107-8fc7-a462d339bab3-config-data\") pod \"glance-default-internal-api-0\" (UID: \"ff5d8cf4-cd75-4107-8fc7-a462d339bab3\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:02:51 crc kubenswrapper[5120]: I0316 16:02:51.892710 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ff5d8cf4-cd75-4107-8fc7-a462d339bab3-scripts\") pod \"glance-default-internal-api-0\" (UID: \"ff5d8cf4-cd75-4107-8fc7-a462d339bab3\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:02:51 crc kubenswrapper[5120]: I0316 16:02:51.893060 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/ff5d8cf4-cd75-4107-8fc7-a462d339bab3-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"ff5d8cf4-cd75-4107-8fc7-a462d339bab3\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:02:51 crc kubenswrapper[5120]: I0316 16:02:51.893118 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/ff5d8cf4-cd75-4107-8fc7-a462d339bab3-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"ff5d8cf4-cd75-4107-8fc7-a462d339bab3\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:02:51 crc kubenswrapper[5120]: I0316 16:02:51.893282 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ff5d8cf4-cd75-4107-8fc7-a462d339bab3-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"ff5d8cf4-cd75-4107-8fc7-a462d339bab3\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:02:51 crc kubenswrapper[5120]: I0316 16:02:51.893381 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kcjq7\" (UniqueName: \"kubernetes.io/projected/ff5d8cf4-cd75-4107-8fc7-a462d339bab3-kube-api-access-kcjq7\") pod \"glance-default-internal-api-0\" (UID: \"ff5d8cf4-cd75-4107-8fc7-a462d339bab3\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:02:51 crc kubenswrapper[5120]: I0316 16:02:51.893564 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ff5d8cf4-cd75-4107-8fc7-a462d339bab3-logs\") pod \"glance-default-internal-api-0\" (UID: \"ff5d8cf4-cd75-4107-8fc7-a462d339bab3\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:02:51 crc kubenswrapper[5120]: W0316 16:02:51.944971 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf6934b6a_f36d_400a_bb39_d0cdaf66cbae.slice/crio-52e056ae0a4cd3cf15f31b2b02f78a633b60158afa9f8e7da2dbc545cc1f3e58 WatchSource:0}: Error finding container 52e056ae0a4cd3cf15f31b2b02f78a633b60158afa9f8e7da2dbc545cc1f3e58: Status 404 returned error can't find the container with id 52e056ae0a4cd3cf15f31b2b02f78a633b60158afa9f8e7da2dbc545cc1f3e58 Mar 16 16:02:51 crc kubenswrapper[5120]: I0316 16:02:51.945570 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:02:51 crc kubenswrapper[5120]: I0316 16:02:51.995332 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/ff5d8cf4-cd75-4107-8fc7-a462d339bab3-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"ff5d8cf4-cd75-4107-8fc7-a462d339bab3\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:02:51 crc kubenswrapper[5120]: I0316 16:02:51.995379 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/ff5d8cf4-cd75-4107-8fc7-a462d339bab3-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"ff5d8cf4-cd75-4107-8fc7-a462d339bab3\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:02:51 crc kubenswrapper[5120]: I0316 16:02:51.995411 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ff5d8cf4-cd75-4107-8fc7-a462d339bab3-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"ff5d8cf4-cd75-4107-8fc7-a462d339bab3\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:02:51 crc kubenswrapper[5120]: I0316 16:02:51.995462 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kcjq7\" (UniqueName: \"kubernetes.io/projected/ff5d8cf4-cd75-4107-8fc7-a462d339bab3-kube-api-access-kcjq7\") pod \"glance-default-internal-api-0\" (UID: \"ff5d8cf4-cd75-4107-8fc7-a462d339bab3\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:02:51 crc kubenswrapper[5120]: I0316 16:02:51.995856 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/ff5d8cf4-cd75-4107-8fc7-a462d339bab3-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"ff5d8cf4-cd75-4107-8fc7-a462d339bab3\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:02:51 crc kubenswrapper[5120]: I0316 16:02:51.996387 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ff5d8cf4-cd75-4107-8fc7-a462d339bab3-logs\") pod \"glance-default-internal-api-0\" (UID: \"ff5d8cf4-cd75-4107-8fc7-a462d339bab3\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:02:51 crc kubenswrapper[5120]: I0316 16:02:51.996495 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"glance-default-internal-api-0\" (UID: \"ff5d8cf4-cd75-4107-8fc7-a462d339bab3\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:02:51 crc kubenswrapper[5120]: I0316 16:02:51.996537 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ff5d8cf4-cd75-4107-8fc7-a462d339bab3-config-data\") pod \"glance-default-internal-api-0\" (UID: \"ff5d8cf4-cd75-4107-8fc7-a462d339bab3\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:02:51 crc kubenswrapper[5120]: I0316 16:02:51.996561 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ff5d8cf4-cd75-4107-8fc7-a462d339bab3-scripts\") pod \"glance-default-internal-api-0\" (UID: \"ff5d8cf4-cd75-4107-8fc7-a462d339bab3\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:02:51 crc kubenswrapper[5120]: I0316 16:02:51.996737 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ff5d8cf4-cd75-4107-8fc7-a462d339bab3-logs\") pod \"glance-default-internal-api-0\" (UID: \"ff5d8cf4-cd75-4107-8fc7-a462d339bab3\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:02:51 crc kubenswrapper[5120]: I0316 16:02:51.996842 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"glance-default-internal-api-0\" (UID: \"ff5d8cf4-cd75-4107-8fc7-a462d339bab3\") device mount path \"/mnt/openstack/pv09\"" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:02:52 crc kubenswrapper[5120]: I0316 16:02:52.006825 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ff5d8cf4-cd75-4107-8fc7-a462d339bab3-config-data\") pod \"glance-default-internal-api-0\" (UID: \"ff5d8cf4-cd75-4107-8fc7-a462d339bab3\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:02:52 crc kubenswrapper[5120]: I0316 16:02:52.008941 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ff5d8cf4-cd75-4107-8fc7-a462d339bab3-scripts\") pod \"glance-default-internal-api-0\" (UID: \"ff5d8cf4-cd75-4107-8fc7-a462d339bab3\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:02:52 crc kubenswrapper[5120]: I0316 16:02:52.014121 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kcjq7\" (UniqueName: \"kubernetes.io/projected/ff5d8cf4-cd75-4107-8fc7-a462d339bab3-kube-api-access-kcjq7\") pod \"glance-default-internal-api-0\" (UID: \"ff5d8cf4-cd75-4107-8fc7-a462d339bab3\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:02:52 crc kubenswrapper[5120]: I0316 16:02:52.015442 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ff5d8cf4-cd75-4107-8fc7-a462d339bab3-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"ff5d8cf4-cd75-4107-8fc7-a462d339bab3\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:02:52 crc kubenswrapper[5120]: I0316 16:02:52.020403 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/ff5d8cf4-cd75-4107-8fc7-a462d339bab3-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"ff5d8cf4-cd75-4107-8fc7-a462d339bab3\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:02:52 crc kubenswrapper[5120]: I0316 16:02:52.030420 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"glance-default-internal-api-0\" (UID: \"ff5d8cf4-cd75-4107-8fc7-a462d339bab3\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:02:52 crc kubenswrapper[5120]: I0316 16:02:52.068509 5120 scope.go:117] "RemoveContainer" containerID="1776e0f291f7fa8432d2e5511c3d988212237dc71753bffedc712fbe9bb9ab04" Mar 16 16:02:52 crc kubenswrapper[5120]: I0316 16:02:52.090645 5120 scope.go:117] "RemoveContainer" containerID="a49714a7590e82f0621f8c9521183fbb6ed758639be8404d97f370eb2168ff36" Mar 16 16:02:52 crc kubenswrapper[5120]: I0316 16:02:52.117421 5120 scope.go:117] "RemoveContainer" containerID="092e3ad9eea3756ea0ddfff3f4378b198b2672dad35cced2d8adebdf4b5cec40" Mar 16 16:02:52 crc kubenswrapper[5120]: I0316 16:02:52.143454 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:02:52 crc kubenswrapper[5120]: I0316 16:02:52.165069 5120 scope.go:117] "RemoveContainer" containerID="f628abe32468e3c1a1fb2a723b1fbd57378a6b403fb582427974425009588307" Mar 16 16:02:52 crc kubenswrapper[5120]: I0316 16:02:52.204880 5120 scope.go:117] "RemoveContainer" containerID="848052c39832ffc9937ad0c1a209ef2abc124e151f2f8b581a8a4b3455085c25" Mar 16 16:02:52 crc kubenswrapper[5120]: I0316 16:02:52.251920 5120 scope.go:117] "RemoveContainer" containerID="45d5950086fa920b3a7cb67a0e497fd1ac28c094739d0e4a09642bc8949119d5" Mar 16 16:02:52 crc kubenswrapper[5120]: I0316 16:02:52.341610 5120 scope.go:117] "RemoveContainer" containerID="5c7737e97c6bd0c62394c3e7424d306aafc9ac26eba6e76b2060d75537356de4" Mar 16 16:02:52 crc kubenswrapper[5120]: I0316 16:02:52.489323 5120 scope.go:117] "RemoveContainer" containerID="85fcc64044b86e65a1bd95d1042ae4823e21ae83a977321ddb0f50f645a0f65c" Mar 16 16:02:52 crc kubenswrapper[5120]: I0316 16:02:52.522510 5120 scope.go:117] "RemoveContainer" containerID="816480c61d758cd3b4221559aab6898628b38f65ddf04f4488a26f9d2942c758" Mar 16 16:02:52 crc kubenswrapper[5120]: I0316 16:02:52.550164 5120 scope.go:117] "RemoveContainer" containerID="875c8c2106b5d3fb2af681c313f5c1710af0860a2f99f3e33ec9a1e47e285e23" Mar 16 16:02:52 crc kubenswrapper[5120]: I0316 16:02:52.594387 5120 scope.go:117] "RemoveContainer" containerID="a6fa07bc0f02cb03d8fcdf8ab981b8a547194306c2f75b1a463d7c6f09841cdf" Mar 16 16:02:52 crc kubenswrapper[5120]: I0316 16:02:52.690464 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="23922841-3b05-4dbe-ae08-50c55a3a44c7" path="/var/lib/kubelet/pods/23922841-3b05-4dbe-ae08-50c55a3a44c7/volumes" Mar 16 16:02:52 crc kubenswrapper[5120]: I0316 16:02:52.691669 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="97c05f77-d695-4853-acb9-05388320db3b" path="/var/lib/kubelet/pods/97c05f77-d695-4853-acb9-05388320db3b/volumes" Mar 16 16:02:52 crc kubenswrapper[5120]: I0316 16:02:52.693058 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ee138521-8f48-4215-9e58-cf1d50ad7910" path="/var/lib/kubelet/pods/ee138521-8f48-4215-9e58-cf1d50ad7910/volumes" Mar 16 16:02:52 crc kubenswrapper[5120]: I0316 16:02:52.695055 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:02:52 crc kubenswrapper[5120]: W0316 16:02:52.703585 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podff5d8cf4_cd75_4107_8fc7_a462d339bab3.slice/crio-2ac1ab541c81fa76a3504173676fda756218ad9a1233f87d100bea4607b006d3 WatchSource:0}: Error finding container 2ac1ab541c81fa76a3504173676fda756218ad9a1233f87d100bea4607b006d3: Status 404 returned error can't find the container with id 2ac1ab541c81fa76a3504173676fda756218ad9a1233f87d100bea4607b006d3 Mar 16 16:02:52 crc kubenswrapper[5120]: I0316 16:02:52.721953 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"f6934b6a-f36d-400a-bb39-d0cdaf66cbae","Type":"ContainerStarted","Data":"52e056ae0a4cd3cf15f31b2b02f78a633b60158afa9f8e7da2dbc545cc1f3e58"} Mar 16 16:02:52 crc kubenswrapper[5120]: I0316 16:02:52.728615 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ce30340d-6cf2-40a4-a2ff-d9dc9dc33bd8","Type":"ContainerStarted","Data":"4cfbd88a2ed91db294d49012a87b0b70f71dc2568ce3d1afefc183c2d83ff0d8"} Mar 16 16:02:53 crc kubenswrapper[5120]: I0316 16:02:53.302922 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:02:53 crc kubenswrapper[5120]: I0316 16:02:53.804629 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"f6934b6a-f36d-400a-bb39-d0cdaf66cbae","Type":"ContainerStarted","Data":"b26345e7420937f51f9ee691179115e14fd242221f59cbc6399198aa3bdde911"} Mar 16 16:02:53 crc kubenswrapper[5120]: I0316 16:02:53.805124 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"f6934b6a-f36d-400a-bb39-d0cdaf66cbae","Type":"ContainerStarted","Data":"3a0eac62028b566de718f70c8dc16d3391066a9f4380be71fc32a594a075594a"} Mar 16 16:02:53 crc kubenswrapper[5120]: I0316 16:02:53.814959 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ce30340d-6cf2-40a4-a2ff-d9dc9dc33bd8","Type":"ContainerStarted","Data":"fe3571d6d16ee5596913e2568276dff0bc97a08ef322a63c6eea2ed21d951d0e"} Mar 16 16:02:53 crc kubenswrapper[5120]: I0316 16:02:53.815002 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ce30340d-6cf2-40a4-a2ff-d9dc9dc33bd8","Type":"ContainerStarted","Data":"10b88a198c1ef9c3a4bde30fe43189201dee729f93563022ce411f37051127dd"} Mar 16 16:02:53 crc kubenswrapper[5120]: I0316 16:02:53.816579 5120 generic.go:358] "Generic (PLEG): container finished" podID="4ae71795-b884-4cc8-be0b-206084f8fafd" containerID="117cb0ae762127f90136bce221457081f536a88b4829b05dca9eced2b9c97a5a" exitCode=0 Mar 16 16:02:53 crc kubenswrapper[5120]: I0316 16:02:53.816789 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-sl8qj" event={"ID":"4ae71795-b884-4cc8-be0b-206084f8fafd","Type":"ContainerDied","Data":"117cb0ae762127f90136bce221457081f536a88b4829b05dca9eced2b9c97a5a"} Mar 16 16:02:53 crc kubenswrapper[5120]: I0316 16:02:53.818672 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"ff5d8cf4-cd75-4107-8fc7-a462d339bab3","Type":"ContainerStarted","Data":"65be4143a1b35b422634be7c4104e29fcae55ae42304921d88654fff7573e813"} Mar 16 16:02:53 crc kubenswrapper[5120]: I0316 16:02:53.818699 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"ff5d8cf4-cd75-4107-8fc7-a462d339bab3","Type":"ContainerStarted","Data":"2ac1ab541c81fa76a3504173676fda756218ad9a1233f87d100bea4607b006d3"} Mar 16 16:02:53 crc kubenswrapper[5120]: I0316 16:02:53.831689 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-external-api-0" podStartSLOduration=3.831671806 podStartE2EDuration="3.831671806s" podCreationTimestamp="2026-03-16 16:02:50 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:02:53.829967398 +0000 UTC m=+1875.983899045" watchObservedRunningTime="2026-03-16 16:02:53.831671806 +0000 UTC m=+1875.985603463" Mar 16 16:02:54 crc kubenswrapper[5120]: I0316 16:02:54.829444 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"ff5d8cf4-cd75-4107-8fc7-a462d339bab3","Type":"ContainerStarted","Data":"05d7e14d0e1d726d667bd4e4e2d362e0cadb24937d6a68b8f3ad0552047dcc74"} Mar 16 16:02:54 crc kubenswrapper[5120]: I0316 16:02:54.832028 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ce30340d-6cf2-40a4-a2ff-d9dc9dc33bd8","Type":"ContainerStarted","Data":"22ff3167a04e0ccfc916be78dd056ffe552757ee14c86c9c2b19932024d9c4f9"} Mar 16 16:02:54 crc kubenswrapper[5120]: I0316 16:02:54.860408 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-internal-api-0" podStartSLOduration=3.8603895379999997 podStartE2EDuration="3.860389538s" podCreationTimestamp="2026-03-16 16:02:51 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:02:54.854143846 +0000 UTC m=+1877.008075563" watchObservedRunningTime="2026-03-16 16:02:54.860389538 +0000 UTC m=+1877.014321195" Mar 16 16:02:55 crc kubenswrapper[5120]: I0316 16:02:55.162025 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-sl8qj" Mar 16 16:02:55 crc kubenswrapper[5120]: I0316 16:02:55.261754 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-876gt\" (UniqueName: \"kubernetes.io/projected/4ae71795-b884-4cc8-be0b-206084f8fafd-kube-api-access-876gt\") pod \"4ae71795-b884-4cc8-be0b-206084f8fafd\" (UID: \"4ae71795-b884-4cc8-be0b-206084f8fafd\") " Mar 16 16:02:55 crc kubenswrapper[5120]: I0316 16:02:55.261851 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4ae71795-b884-4cc8-be0b-206084f8fafd-config-data\") pod \"4ae71795-b884-4cc8-be0b-206084f8fafd\" (UID: \"4ae71795-b884-4cc8-be0b-206084f8fafd\") " Mar 16 16:02:55 crc kubenswrapper[5120]: I0316 16:02:55.261944 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4ae71795-b884-4cc8-be0b-206084f8fafd-combined-ca-bundle\") pod \"4ae71795-b884-4cc8-be0b-206084f8fafd\" (UID: \"4ae71795-b884-4cc8-be0b-206084f8fafd\") " Mar 16 16:02:55 crc kubenswrapper[5120]: I0316 16:02:55.262061 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4ae71795-b884-4cc8-be0b-206084f8fafd-scripts\") pod \"4ae71795-b884-4cc8-be0b-206084f8fafd\" (UID: \"4ae71795-b884-4cc8-be0b-206084f8fafd\") " Mar 16 16:02:55 crc kubenswrapper[5120]: I0316 16:02:55.275268 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ae71795-b884-4cc8-be0b-206084f8fafd-kube-api-access-876gt" (OuterVolumeSpecName: "kube-api-access-876gt") pod "4ae71795-b884-4cc8-be0b-206084f8fafd" (UID: "4ae71795-b884-4cc8-be0b-206084f8fafd"). InnerVolumeSpecName "kube-api-access-876gt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:02:55 crc kubenswrapper[5120]: I0316 16:02:55.284963 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ae71795-b884-4cc8-be0b-206084f8fafd-scripts" (OuterVolumeSpecName: "scripts") pod "4ae71795-b884-4cc8-be0b-206084f8fafd" (UID: "4ae71795-b884-4cc8-be0b-206084f8fafd"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:02:55 crc kubenswrapper[5120]: I0316 16:02:55.292856 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ae71795-b884-4cc8-be0b-206084f8fafd-config-data" (OuterVolumeSpecName: "config-data") pod "4ae71795-b884-4cc8-be0b-206084f8fafd" (UID: "4ae71795-b884-4cc8-be0b-206084f8fafd"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:02:55 crc kubenswrapper[5120]: I0316 16:02:55.298462 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ae71795-b884-4cc8-be0b-206084f8fafd-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "4ae71795-b884-4cc8-be0b-206084f8fafd" (UID: "4ae71795-b884-4cc8-be0b-206084f8fafd"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:02:55 crc kubenswrapper[5120]: I0316 16:02:55.365239 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-876gt\" (UniqueName: \"kubernetes.io/projected/4ae71795-b884-4cc8-be0b-206084f8fafd-kube-api-access-876gt\") on node \"crc\" DevicePath \"\"" Mar 16 16:02:55 crc kubenswrapper[5120]: I0316 16:02:55.365516 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4ae71795-b884-4cc8-be0b-206084f8fafd-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:02:55 crc kubenswrapper[5120]: I0316 16:02:55.365589 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4ae71795-b884-4cc8-be0b-206084f8fafd-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:02:55 crc kubenswrapper[5120]: I0316 16:02:55.365646 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4ae71795-b884-4cc8-be0b-206084f8fafd-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:02:55 crc kubenswrapper[5120]: I0316 16:02:55.844662 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-sl8qj" Mar 16 16:02:55 crc kubenswrapper[5120]: I0316 16:02:55.845981 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-sl8qj" event={"ID":"4ae71795-b884-4cc8-be0b-206084f8fafd","Type":"ContainerDied","Data":"443a52776dcd788a92d0503be2814383b2ebfb13860eb7dc40ac8366bd1fa729"} Mar 16 16:02:55 crc kubenswrapper[5120]: I0316 16:02:55.846208 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="443a52776dcd788a92d0503be2814383b2ebfb13860eb7dc40ac8366bd1fa729" Mar 16 16:02:55 crc kubenswrapper[5120]: I0316 16:02:55.928736 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:02:55 crc kubenswrapper[5120]: I0316 16:02:55.930226 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ae71795-b884-4cc8-be0b-206084f8fafd" containerName="nova-cell0-conductor-db-sync" Mar 16 16:02:55 crc kubenswrapper[5120]: I0316 16:02:55.930309 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ae71795-b884-4cc8-be0b-206084f8fafd" containerName="nova-cell0-conductor-db-sync" Mar 16 16:02:55 crc kubenswrapper[5120]: I0316 16:02:55.930559 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="4ae71795-b884-4cc8-be0b-206084f8fafd" containerName="nova-cell0-conductor-db-sync" Mar 16 16:02:55 crc kubenswrapper[5120]: I0316 16:02:55.998581 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:02:55 crc kubenswrapper[5120]: I0316 16:02:55.998732 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:02:56 crc kubenswrapper[5120]: I0316 16:02:56.005128 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-nova-dockercfg-dqzng\"" Mar 16 16:02:56 crc kubenswrapper[5120]: I0316 16:02:56.005341 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-conductor-config-data\"" Mar 16 16:02:56 crc kubenswrapper[5120]: I0316 16:02:56.087671 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e6045f50-0da0-4296-95db-bac2c92ce81e-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"e6045f50-0da0-4296-95db-bac2c92ce81e\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:02:56 crc kubenswrapper[5120]: I0316 16:02:56.087861 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e6045f50-0da0-4296-95db-bac2c92ce81e-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"e6045f50-0da0-4296-95db-bac2c92ce81e\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:02:56 crc kubenswrapper[5120]: I0316 16:02:56.087905 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjjcs\" (UniqueName: \"kubernetes.io/projected/e6045f50-0da0-4296-95db-bac2c92ce81e-kube-api-access-zjjcs\") pod \"nova-cell0-conductor-0\" (UID: \"e6045f50-0da0-4296-95db-bac2c92ce81e\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:02:56 crc kubenswrapper[5120]: I0316 16:02:56.189350 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e6045f50-0da0-4296-95db-bac2c92ce81e-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"e6045f50-0da0-4296-95db-bac2c92ce81e\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:02:56 crc kubenswrapper[5120]: I0316 16:02:56.189419 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zjjcs\" (UniqueName: \"kubernetes.io/projected/e6045f50-0da0-4296-95db-bac2c92ce81e-kube-api-access-zjjcs\") pod \"nova-cell0-conductor-0\" (UID: \"e6045f50-0da0-4296-95db-bac2c92ce81e\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:02:56 crc kubenswrapper[5120]: I0316 16:02:56.189459 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e6045f50-0da0-4296-95db-bac2c92ce81e-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"e6045f50-0da0-4296-95db-bac2c92ce81e\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:02:56 crc kubenswrapper[5120]: I0316 16:02:56.197737 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e6045f50-0da0-4296-95db-bac2c92ce81e-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"e6045f50-0da0-4296-95db-bac2c92ce81e\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:02:56 crc kubenswrapper[5120]: I0316 16:02:56.197786 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e6045f50-0da0-4296-95db-bac2c92ce81e-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"e6045f50-0da0-4296-95db-bac2c92ce81e\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:02:56 crc kubenswrapper[5120]: I0316 16:02:56.216409 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjjcs\" (UniqueName: \"kubernetes.io/projected/e6045f50-0da0-4296-95db-bac2c92ce81e-kube-api-access-zjjcs\") pod \"nova-cell0-conductor-0\" (UID: \"e6045f50-0da0-4296-95db-bac2c92ce81e\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:02:56 crc kubenswrapper[5120]: I0316 16:02:56.323949 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:02:56 crc kubenswrapper[5120]: W0316 16:02:56.732313 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode6045f50_0da0_4296_95db_bac2c92ce81e.slice/crio-2d9fecff3a15cf3d683cdae2f3f6c220094f1f02bb8f608d2b5ba2ea6e1714ae WatchSource:0}: Error finding container 2d9fecff3a15cf3d683cdae2f3f6c220094f1f02bb8f608d2b5ba2ea6e1714ae: Status 404 returned error can't find the container with id 2d9fecff3a15cf3d683cdae2f3f6c220094f1f02bb8f608d2b5ba2ea6e1714ae Mar 16 16:02:56 crc kubenswrapper[5120]: I0316 16:02:56.733740 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:02:56 crc kubenswrapper[5120]: I0316 16:02:56.735271 5120 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Mar 16 16:02:56 crc kubenswrapper[5120]: I0316 16:02:56.855075 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ce30340d-6cf2-40a4-a2ff-d9dc9dc33bd8","Type":"ContainerStarted","Data":"3f3a9321df277762f1f6ee497a36609417eddf5adb4794332454c27a3368d30f"} Mar 16 16:02:56 crc kubenswrapper[5120]: I0316 16:02:56.856186 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:02:56 crc kubenswrapper[5120]: I0316 16:02:56.855428 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="ce30340d-6cf2-40a4-a2ff-d9dc9dc33bd8" containerName="proxy-httpd" containerID="cri-o://3f3a9321df277762f1f6ee497a36609417eddf5adb4794332454c27a3368d30f" gracePeriod=30 Mar 16 16:02:56 crc kubenswrapper[5120]: I0316 16:02:56.855448 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="ce30340d-6cf2-40a4-a2ff-d9dc9dc33bd8" containerName="sg-core" containerID="cri-o://22ff3167a04e0ccfc916be78dd056ffe552757ee14c86c9c2b19932024d9c4f9" gracePeriod=30 Mar 16 16:02:56 crc kubenswrapper[5120]: I0316 16:02:56.855155 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="ce30340d-6cf2-40a4-a2ff-d9dc9dc33bd8" containerName="ceilometer-central-agent" containerID="cri-o://10b88a198c1ef9c3a4bde30fe43189201dee729f93563022ce411f37051127dd" gracePeriod=30 Mar 16 16:02:56 crc kubenswrapper[5120]: I0316 16:02:56.855465 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="ce30340d-6cf2-40a4-a2ff-d9dc9dc33bd8" containerName="ceilometer-notification-agent" containerID="cri-o://fe3571d6d16ee5596913e2568276dff0bc97a08ef322a63c6eea2ed21d951d0e" gracePeriod=30 Mar 16 16:02:56 crc kubenswrapper[5120]: I0316 16:02:56.860071 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"e6045f50-0da0-4296-95db-bac2c92ce81e","Type":"ContainerStarted","Data":"2d9fecff3a15cf3d683cdae2f3f6c220094f1f02bb8f608d2b5ba2ea6e1714ae"} Mar 16 16:02:56 crc kubenswrapper[5120]: I0316 16:02:56.884348 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.665742206 podStartE2EDuration="6.884326802s" podCreationTimestamp="2026-03-16 16:02:50 +0000 UTC" firstStartedPulling="2026-03-16 16:02:51.806568729 +0000 UTC m=+1873.960500386" lastFinishedPulling="2026-03-16 16:02:56.025153325 +0000 UTC m=+1878.179084982" observedRunningTime="2026-03-16 16:02:56.880429055 +0000 UTC m=+1879.034360732" watchObservedRunningTime="2026-03-16 16:02:56.884326802 +0000 UTC m=+1879.038258459" Mar 16 16:02:57 crc kubenswrapper[5120]: I0316 16:02:57.871028 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"e6045f50-0da0-4296-95db-bac2c92ce81e","Type":"ContainerStarted","Data":"a06fc51426d6b02d31cb674374a99a2119963b0a4b1b5ca187fb745bc1f01787"} Mar 16 16:02:57 crc kubenswrapper[5120]: I0316 16:02:57.871319 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:02:57 crc kubenswrapper[5120]: I0316 16:02:57.874119 5120 generic.go:358] "Generic (PLEG): container finished" podID="ce30340d-6cf2-40a4-a2ff-d9dc9dc33bd8" containerID="3f3a9321df277762f1f6ee497a36609417eddf5adb4794332454c27a3368d30f" exitCode=0 Mar 16 16:02:57 crc kubenswrapper[5120]: I0316 16:02:57.874158 5120 generic.go:358] "Generic (PLEG): container finished" podID="ce30340d-6cf2-40a4-a2ff-d9dc9dc33bd8" containerID="22ff3167a04e0ccfc916be78dd056ffe552757ee14c86c9c2b19932024d9c4f9" exitCode=2 Mar 16 16:02:57 crc kubenswrapper[5120]: I0316 16:02:57.874167 5120 generic.go:358] "Generic (PLEG): container finished" podID="ce30340d-6cf2-40a4-a2ff-d9dc9dc33bd8" containerID="fe3571d6d16ee5596913e2568276dff0bc97a08ef322a63c6eea2ed21d951d0e" exitCode=0 Mar 16 16:02:57 crc kubenswrapper[5120]: I0316 16:02:57.874172 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ce30340d-6cf2-40a4-a2ff-d9dc9dc33bd8","Type":"ContainerDied","Data":"3f3a9321df277762f1f6ee497a36609417eddf5adb4794332454c27a3368d30f"} Mar 16 16:02:57 crc kubenswrapper[5120]: I0316 16:02:57.874250 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ce30340d-6cf2-40a4-a2ff-d9dc9dc33bd8","Type":"ContainerDied","Data":"22ff3167a04e0ccfc916be78dd056ffe552757ee14c86c9c2b19932024d9c4f9"} Mar 16 16:02:57 crc kubenswrapper[5120]: I0316 16:02:57.874267 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ce30340d-6cf2-40a4-a2ff-d9dc9dc33bd8","Type":"ContainerDied","Data":"fe3571d6d16ee5596913e2568276dff0bc97a08ef322a63c6eea2ed21d951d0e"} Mar 16 16:02:57 crc kubenswrapper[5120]: I0316 16:02:57.891129 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podStartSLOduration=2.8911057209999997 podStartE2EDuration="2.891105721s" podCreationTimestamp="2026-03-16 16:02:55 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:02:57.888195711 +0000 UTC m=+1880.042127378" watchObservedRunningTime="2026-03-16 16:02:57.891105721 +0000 UTC m=+1880.045037388" Mar 16 16:03:01 crc kubenswrapper[5120]: I0316 16:03:01.387941 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:03:01 crc kubenswrapper[5120]: I0316 16:03:01.388322 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:03:01 crc kubenswrapper[5120]: I0316 16:03:01.439597 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:03:01 crc kubenswrapper[5120]: I0316 16:03:01.443875 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:03:01 crc kubenswrapper[5120]: I0316 16:03:01.604676 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:03:01 crc kubenswrapper[5120]: I0316 16:03:01.604952 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="e6045f50-0da0-4296-95db-bac2c92ce81e" containerName="nova-cell0-conductor-conductor" containerID="cri-o://a06fc51426d6b02d31cb674374a99a2119963b0a4b1b5ca187fb745bc1f01787" gracePeriod=30 Mar 16 16:03:01 crc kubenswrapper[5120]: E0316 16:03:01.608208 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a06fc51426d6b02d31cb674374a99a2119963b0a4b1b5ca187fb745bc1f01787" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:03:01 crc kubenswrapper[5120]: E0316 16:03:01.612268 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a06fc51426d6b02d31cb674374a99a2119963b0a4b1b5ca187fb745bc1f01787" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:03:01 crc kubenswrapper[5120]: E0316 16:03:01.615827 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a06fc51426d6b02d31cb674374a99a2119963b0a4b1b5ca187fb745bc1f01787" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:03:01 crc kubenswrapper[5120]: E0316 16:03:01.615978 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="e6045f50-0da0-4296-95db-bac2c92ce81e" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 16:03:01 crc kubenswrapper[5120]: I0316 16:03:01.934146 5120 generic.go:358] "Generic (PLEG): container finished" podID="ce30340d-6cf2-40a4-a2ff-d9dc9dc33bd8" containerID="10b88a198c1ef9c3a4bde30fe43189201dee729f93563022ce411f37051127dd" exitCode=0 Mar 16 16:03:01 crc kubenswrapper[5120]: I0316 16:03:01.934338 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ce30340d-6cf2-40a4-a2ff-d9dc9dc33bd8","Type":"ContainerDied","Data":"10b88a198c1ef9c3a4bde30fe43189201dee729f93563022ce411f37051127dd"} Mar 16 16:03:01 crc kubenswrapper[5120]: I0316 16:03:01.935161 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:03:01 crc kubenswrapper[5120]: I0316 16:03:01.935185 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:03:02 crc kubenswrapper[5120]: I0316 16:03:02.032793 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:03:02 crc kubenswrapper[5120]: I0316 16:03:02.138488 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ce30340d-6cf2-40a4-a2ff-d9dc9dc33bd8-scripts\") pod \"ce30340d-6cf2-40a4-a2ff-d9dc9dc33bd8\" (UID: \"ce30340d-6cf2-40a4-a2ff-d9dc9dc33bd8\") " Mar 16 16:03:02 crc kubenswrapper[5120]: I0316 16:03:02.138793 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t6b6l\" (UniqueName: \"kubernetes.io/projected/ce30340d-6cf2-40a4-a2ff-d9dc9dc33bd8-kube-api-access-t6b6l\") pod \"ce30340d-6cf2-40a4-a2ff-d9dc9dc33bd8\" (UID: \"ce30340d-6cf2-40a4-a2ff-d9dc9dc33bd8\") " Mar 16 16:03:02 crc kubenswrapper[5120]: I0316 16:03:02.138829 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ce30340d-6cf2-40a4-a2ff-d9dc9dc33bd8-run-httpd\") pod \"ce30340d-6cf2-40a4-a2ff-d9dc9dc33bd8\" (UID: \"ce30340d-6cf2-40a4-a2ff-d9dc9dc33bd8\") " Mar 16 16:03:02 crc kubenswrapper[5120]: I0316 16:03:02.138905 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/ce30340d-6cf2-40a4-a2ff-d9dc9dc33bd8-sg-core-conf-yaml\") pod \"ce30340d-6cf2-40a4-a2ff-d9dc9dc33bd8\" (UID: \"ce30340d-6cf2-40a4-a2ff-d9dc9dc33bd8\") " Mar 16 16:03:02 crc kubenswrapper[5120]: I0316 16:03:02.138947 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ce30340d-6cf2-40a4-a2ff-d9dc9dc33bd8-config-data\") pod \"ce30340d-6cf2-40a4-a2ff-d9dc9dc33bd8\" (UID: \"ce30340d-6cf2-40a4-a2ff-d9dc9dc33bd8\") " Mar 16 16:03:02 crc kubenswrapper[5120]: I0316 16:03:02.138964 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ce30340d-6cf2-40a4-a2ff-d9dc9dc33bd8-log-httpd\") pod \"ce30340d-6cf2-40a4-a2ff-d9dc9dc33bd8\" (UID: \"ce30340d-6cf2-40a4-a2ff-d9dc9dc33bd8\") " Mar 16 16:03:02 crc kubenswrapper[5120]: I0316 16:03:02.139008 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ce30340d-6cf2-40a4-a2ff-d9dc9dc33bd8-combined-ca-bundle\") pod \"ce30340d-6cf2-40a4-a2ff-d9dc9dc33bd8\" (UID: \"ce30340d-6cf2-40a4-a2ff-d9dc9dc33bd8\") " Mar 16 16:03:02 crc kubenswrapper[5120]: I0316 16:03:02.139205 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce30340d-6cf2-40a4-a2ff-d9dc9dc33bd8-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "ce30340d-6cf2-40a4-a2ff-d9dc9dc33bd8" (UID: "ce30340d-6cf2-40a4-a2ff-d9dc9dc33bd8"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:03:02 crc kubenswrapper[5120]: I0316 16:03:02.139452 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce30340d-6cf2-40a4-a2ff-d9dc9dc33bd8-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "ce30340d-6cf2-40a4-a2ff-d9dc9dc33bd8" (UID: "ce30340d-6cf2-40a4-a2ff-d9dc9dc33bd8"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:03:02 crc kubenswrapper[5120]: I0316 16:03:02.140211 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ce30340d-6cf2-40a4-a2ff-d9dc9dc33bd8-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:03:02 crc kubenswrapper[5120]: I0316 16:03:02.140229 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ce30340d-6cf2-40a4-a2ff-d9dc9dc33bd8-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:03:02 crc kubenswrapper[5120]: I0316 16:03:02.143868 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:03:02 crc kubenswrapper[5120]: I0316 16:03:02.144563 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:03:02 crc kubenswrapper[5120]: I0316 16:03:02.144656 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce30340d-6cf2-40a4-a2ff-d9dc9dc33bd8-scripts" (OuterVolumeSpecName: "scripts") pod "ce30340d-6cf2-40a4-a2ff-d9dc9dc33bd8" (UID: "ce30340d-6cf2-40a4-a2ff-d9dc9dc33bd8"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:03:02 crc kubenswrapper[5120]: I0316 16:03:02.144672 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce30340d-6cf2-40a4-a2ff-d9dc9dc33bd8-kube-api-access-t6b6l" (OuterVolumeSpecName: "kube-api-access-t6b6l") pod "ce30340d-6cf2-40a4-a2ff-d9dc9dc33bd8" (UID: "ce30340d-6cf2-40a4-a2ff-d9dc9dc33bd8"). InnerVolumeSpecName "kube-api-access-t6b6l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:03:02 crc kubenswrapper[5120]: I0316 16:03:02.169036 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce30340d-6cf2-40a4-a2ff-d9dc9dc33bd8-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "ce30340d-6cf2-40a4-a2ff-d9dc9dc33bd8" (UID: "ce30340d-6cf2-40a4-a2ff-d9dc9dc33bd8"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:03:02 crc kubenswrapper[5120]: I0316 16:03:02.186353 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:03:02 crc kubenswrapper[5120]: I0316 16:03:02.187781 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:03:02 crc kubenswrapper[5120]: I0316 16:03:02.239909 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce30340d-6cf2-40a4-a2ff-d9dc9dc33bd8-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ce30340d-6cf2-40a4-a2ff-d9dc9dc33bd8" (UID: "ce30340d-6cf2-40a4-a2ff-d9dc9dc33bd8"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:03:02 crc kubenswrapper[5120]: I0316 16:03:02.242139 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t6b6l\" (UniqueName: \"kubernetes.io/projected/ce30340d-6cf2-40a4-a2ff-d9dc9dc33bd8-kube-api-access-t6b6l\") on node \"crc\" DevicePath \"\"" Mar 16 16:03:02 crc kubenswrapper[5120]: I0316 16:03:02.242162 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/ce30340d-6cf2-40a4-a2ff-d9dc9dc33bd8-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 16:03:02 crc kubenswrapper[5120]: I0316 16:03:02.242172 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ce30340d-6cf2-40a4-a2ff-d9dc9dc33bd8-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:03:02 crc kubenswrapper[5120]: I0316 16:03:02.242181 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ce30340d-6cf2-40a4-a2ff-d9dc9dc33bd8-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:03:02 crc kubenswrapper[5120]: I0316 16:03:02.267571 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce30340d-6cf2-40a4-a2ff-d9dc9dc33bd8-config-data" (OuterVolumeSpecName: "config-data") pod "ce30340d-6cf2-40a4-a2ff-d9dc9dc33bd8" (UID: "ce30340d-6cf2-40a4-a2ff-d9dc9dc33bd8"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:03:02 crc kubenswrapper[5120]: I0316 16:03:02.346006 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ce30340d-6cf2-40a4-a2ff-d9dc9dc33bd8-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:03:02 crc kubenswrapper[5120]: I0316 16:03:02.487846 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:03:02 crc kubenswrapper[5120]: I0316 16:03:02.550077 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zjjcs\" (UniqueName: \"kubernetes.io/projected/e6045f50-0da0-4296-95db-bac2c92ce81e-kube-api-access-zjjcs\") pod \"e6045f50-0da0-4296-95db-bac2c92ce81e\" (UID: \"e6045f50-0da0-4296-95db-bac2c92ce81e\") " Mar 16 16:03:02 crc kubenswrapper[5120]: I0316 16:03:02.550621 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e6045f50-0da0-4296-95db-bac2c92ce81e-config-data\") pod \"e6045f50-0da0-4296-95db-bac2c92ce81e\" (UID: \"e6045f50-0da0-4296-95db-bac2c92ce81e\") " Mar 16 16:03:02 crc kubenswrapper[5120]: I0316 16:03:02.551332 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e6045f50-0da0-4296-95db-bac2c92ce81e-combined-ca-bundle\") pod \"e6045f50-0da0-4296-95db-bac2c92ce81e\" (UID: \"e6045f50-0da0-4296-95db-bac2c92ce81e\") " Mar 16 16:03:02 crc kubenswrapper[5120]: I0316 16:03:02.555622 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6045f50-0da0-4296-95db-bac2c92ce81e-kube-api-access-zjjcs" (OuterVolumeSpecName: "kube-api-access-zjjcs") pod "e6045f50-0da0-4296-95db-bac2c92ce81e" (UID: "e6045f50-0da0-4296-95db-bac2c92ce81e"). InnerVolumeSpecName "kube-api-access-zjjcs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:03:02 crc kubenswrapper[5120]: I0316 16:03:02.576342 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e6045f50-0da0-4296-95db-bac2c92ce81e-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e6045f50-0da0-4296-95db-bac2c92ce81e" (UID: "e6045f50-0da0-4296-95db-bac2c92ce81e"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:03:02 crc kubenswrapper[5120]: I0316 16:03:02.577032 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e6045f50-0da0-4296-95db-bac2c92ce81e-config-data" (OuterVolumeSpecName: "config-data") pod "e6045f50-0da0-4296-95db-bac2c92ce81e" (UID: "e6045f50-0da0-4296-95db-bac2c92ce81e"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:03:02 crc kubenswrapper[5120]: I0316 16:03:02.653337 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e6045f50-0da0-4296-95db-bac2c92ce81e-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:03:02 crc kubenswrapper[5120]: I0316 16:03:02.653370 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zjjcs\" (UniqueName: \"kubernetes.io/projected/e6045f50-0da0-4296-95db-bac2c92ce81e-kube-api-access-zjjcs\") on node \"crc\" DevicePath \"\"" Mar 16 16:03:02 crc kubenswrapper[5120]: I0316 16:03:02.653382 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e6045f50-0da0-4296-95db-bac2c92ce81e-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:03:02 crc kubenswrapper[5120]: I0316 16:03:02.954651 5120 generic.go:358] "Generic (PLEG): container finished" podID="e6045f50-0da0-4296-95db-bac2c92ce81e" containerID="a06fc51426d6b02d31cb674374a99a2119963b0a4b1b5ca187fb745bc1f01787" exitCode=0 Mar 16 16:03:02 crc kubenswrapper[5120]: I0316 16:03:02.954945 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"e6045f50-0da0-4296-95db-bac2c92ce81e","Type":"ContainerDied","Data":"a06fc51426d6b02d31cb674374a99a2119963b0a4b1b5ca187fb745bc1f01787"} Mar 16 16:03:02 crc kubenswrapper[5120]: I0316 16:03:02.955021 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"e6045f50-0da0-4296-95db-bac2c92ce81e","Type":"ContainerDied","Data":"2d9fecff3a15cf3d683cdae2f3f6c220094f1f02bb8f608d2b5ba2ea6e1714ae"} Mar 16 16:03:02 crc kubenswrapper[5120]: I0316 16:03:02.955043 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:03:02 crc kubenswrapper[5120]: I0316 16:03:02.955062 5120 scope.go:117] "RemoveContainer" containerID="a06fc51426d6b02d31cb674374a99a2119963b0a4b1b5ca187fb745bc1f01787" Mar 16 16:03:02 crc kubenswrapper[5120]: I0316 16:03:02.965533 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:03:02 crc kubenswrapper[5120]: I0316 16:03:02.966580 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ce30340d-6cf2-40a4-a2ff-d9dc9dc33bd8","Type":"ContainerDied","Data":"4cfbd88a2ed91db294d49012a87b0b70f71dc2568ce3d1afefc183c2d83ff0d8"} Mar 16 16:03:02 crc kubenswrapper[5120]: I0316 16:03:02.967675 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:03:02 crc kubenswrapper[5120]: I0316 16:03:02.967700 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:03:03 crc kubenswrapper[5120]: I0316 16:03:03.005279 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:03:03 crc kubenswrapper[5120]: I0316 16:03:03.023342 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:03:03 crc kubenswrapper[5120]: I0316 16:03:03.032563 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:03:03 crc kubenswrapper[5120]: I0316 16:03:03.046295 5120 scope.go:117] "RemoveContainer" containerID="a06fc51426d6b02d31cb674374a99a2119963b0a4b1b5ca187fb745bc1f01787" Mar 16 16:03:03 crc kubenswrapper[5120]: I0316 16:03:03.046966 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:03:03 crc kubenswrapper[5120]: E0316 16:03:03.051891 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a06fc51426d6b02d31cb674374a99a2119963b0a4b1b5ca187fb745bc1f01787\": container with ID starting with a06fc51426d6b02d31cb674374a99a2119963b0a4b1b5ca187fb745bc1f01787 not found: ID does not exist" containerID="a06fc51426d6b02d31cb674374a99a2119963b0a4b1b5ca187fb745bc1f01787" Mar 16 16:03:03 crc kubenswrapper[5120]: I0316 16:03:03.051930 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a06fc51426d6b02d31cb674374a99a2119963b0a4b1b5ca187fb745bc1f01787"} err="failed to get container status \"a06fc51426d6b02d31cb674374a99a2119963b0a4b1b5ca187fb745bc1f01787\": rpc error: code = NotFound desc = could not find container \"a06fc51426d6b02d31cb674374a99a2119963b0a4b1b5ca187fb745bc1f01787\": container with ID starting with a06fc51426d6b02d31cb674374a99a2119963b0a4b1b5ca187fb745bc1f01787 not found: ID does not exist" Mar 16 16:03:03 crc kubenswrapper[5120]: I0316 16:03:03.051953 5120 scope.go:117] "RemoveContainer" containerID="3f3a9321df277762f1f6ee497a36609417eddf5adb4794332454c27a3368d30f" Mar 16 16:03:03 crc kubenswrapper[5120]: I0316 16:03:03.065906 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:03:03 crc kubenswrapper[5120]: I0316 16:03:03.066971 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce30340d-6cf2-40a4-a2ff-d9dc9dc33bd8" containerName="ceilometer-central-agent" Mar 16 16:03:03 crc kubenswrapper[5120]: I0316 16:03:03.066990 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce30340d-6cf2-40a4-a2ff-d9dc9dc33bd8" containerName="ceilometer-central-agent" Mar 16 16:03:03 crc kubenswrapper[5120]: I0316 16:03:03.067016 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce30340d-6cf2-40a4-a2ff-d9dc9dc33bd8" containerName="ceilometer-notification-agent" Mar 16 16:03:03 crc kubenswrapper[5120]: I0316 16:03:03.067023 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce30340d-6cf2-40a4-a2ff-d9dc9dc33bd8" containerName="ceilometer-notification-agent" Mar 16 16:03:03 crc kubenswrapper[5120]: I0316 16:03:03.067034 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce30340d-6cf2-40a4-a2ff-d9dc9dc33bd8" containerName="proxy-httpd" Mar 16 16:03:03 crc kubenswrapper[5120]: I0316 16:03:03.067040 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce30340d-6cf2-40a4-a2ff-d9dc9dc33bd8" containerName="proxy-httpd" Mar 16 16:03:03 crc kubenswrapper[5120]: I0316 16:03:03.067061 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce30340d-6cf2-40a4-a2ff-d9dc9dc33bd8" containerName="sg-core" Mar 16 16:03:03 crc kubenswrapper[5120]: I0316 16:03:03.067066 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce30340d-6cf2-40a4-a2ff-d9dc9dc33bd8" containerName="sg-core" Mar 16 16:03:03 crc kubenswrapper[5120]: I0316 16:03:03.067084 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6045f50-0da0-4296-95db-bac2c92ce81e" containerName="nova-cell0-conductor-conductor" Mar 16 16:03:03 crc kubenswrapper[5120]: I0316 16:03:03.067090 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6045f50-0da0-4296-95db-bac2c92ce81e" containerName="nova-cell0-conductor-conductor" Mar 16 16:03:03 crc kubenswrapper[5120]: I0316 16:03:03.067259 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ce30340d-6cf2-40a4-a2ff-d9dc9dc33bd8" containerName="ceilometer-notification-agent" Mar 16 16:03:03 crc kubenswrapper[5120]: I0316 16:03:03.067276 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ce30340d-6cf2-40a4-a2ff-d9dc9dc33bd8" containerName="ceilometer-central-agent" Mar 16 16:03:03 crc kubenswrapper[5120]: I0316 16:03:03.067292 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ce30340d-6cf2-40a4-a2ff-d9dc9dc33bd8" containerName="sg-core" Mar 16 16:03:03 crc kubenswrapper[5120]: I0316 16:03:03.067301 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ce30340d-6cf2-40a4-a2ff-d9dc9dc33bd8" containerName="proxy-httpd" Mar 16 16:03:03 crc kubenswrapper[5120]: I0316 16:03:03.067308 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e6045f50-0da0-4296-95db-bac2c92ce81e" containerName="nova-cell0-conductor-conductor" Mar 16 16:03:03 crc kubenswrapper[5120]: I0316 16:03:03.073622 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:03:03 crc kubenswrapper[5120]: I0316 16:03:03.079996 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-nova-dockercfg-dqzng\"" Mar 16 16:03:03 crc kubenswrapper[5120]: I0316 16:03:03.081698 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-conductor-config-data\"" Mar 16 16:03:03 crc kubenswrapper[5120]: I0316 16:03:03.087990 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:03:03 crc kubenswrapper[5120]: I0316 16:03:03.090447 5120 scope.go:117] "RemoveContainer" containerID="22ff3167a04e0ccfc916be78dd056ffe552757ee14c86c9c2b19932024d9c4f9" Mar 16 16:03:03 crc kubenswrapper[5120]: I0316 16:03:03.097236 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:03:03 crc kubenswrapper[5120]: I0316 16:03:03.104265 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:03:03 crc kubenswrapper[5120]: I0316 16:03:03.105670 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:03:03 crc kubenswrapper[5120]: I0316 16:03:03.106395 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 16:03:03 crc kubenswrapper[5120]: I0316 16:03:03.106573 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 16:03:03 crc kubenswrapper[5120]: I0316 16:03:03.113462 5120 scope.go:117] "RemoveContainer" containerID="fe3571d6d16ee5596913e2568276dff0bc97a08ef322a63c6eea2ed21d951d0e" Mar 16 16:03:03 crc kubenswrapper[5120]: I0316 16:03:03.140118 5120 scope.go:117] "RemoveContainer" containerID="10b88a198c1ef9c3a4bde30fe43189201dee729f93563022ce411f37051127dd" Mar 16 16:03:03 crc kubenswrapper[5120]: I0316 16:03:03.163876 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jdzk\" (UniqueName: \"kubernetes.io/projected/45d21252-1b68-4533-9bb3-a6bc9f334171-kube-api-access-8jdzk\") pod \"nova-cell0-conductor-0\" (UID: \"45d21252-1b68-4533-9bb3-a6bc9f334171\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:03:03 crc kubenswrapper[5120]: I0316 16:03:03.163920 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r98qk\" (UniqueName: \"kubernetes.io/projected/15543dd6-22d4-4a03-8bf6-1b418e1bc713-kube-api-access-r98qk\") pod \"ceilometer-0\" (UID: \"15543dd6-22d4-4a03-8bf6-1b418e1bc713\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:03:03 crc kubenswrapper[5120]: I0316 16:03:03.163947 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/15543dd6-22d4-4a03-8bf6-1b418e1bc713-config-data\") pod \"ceilometer-0\" (UID: \"15543dd6-22d4-4a03-8bf6-1b418e1bc713\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:03:03 crc kubenswrapper[5120]: I0316 16:03:03.164033 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/15543dd6-22d4-4a03-8bf6-1b418e1bc713-log-httpd\") pod \"ceilometer-0\" (UID: \"15543dd6-22d4-4a03-8bf6-1b418e1bc713\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:03:03 crc kubenswrapper[5120]: I0316 16:03:03.164304 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/15543dd6-22d4-4a03-8bf6-1b418e1bc713-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"15543dd6-22d4-4a03-8bf6-1b418e1bc713\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:03:03 crc kubenswrapper[5120]: I0316 16:03:03.164354 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/15543dd6-22d4-4a03-8bf6-1b418e1bc713-run-httpd\") pod \"ceilometer-0\" (UID: \"15543dd6-22d4-4a03-8bf6-1b418e1bc713\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:03:03 crc kubenswrapper[5120]: I0316 16:03:03.164594 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/45d21252-1b68-4533-9bb3-a6bc9f334171-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"45d21252-1b68-4533-9bb3-a6bc9f334171\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:03:03 crc kubenswrapper[5120]: I0316 16:03:03.164628 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/15543dd6-22d4-4a03-8bf6-1b418e1bc713-scripts\") pod \"ceilometer-0\" (UID: \"15543dd6-22d4-4a03-8bf6-1b418e1bc713\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:03:03 crc kubenswrapper[5120]: I0316 16:03:03.164803 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/15543dd6-22d4-4a03-8bf6-1b418e1bc713-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"15543dd6-22d4-4a03-8bf6-1b418e1bc713\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:03:03 crc kubenswrapper[5120]: I0316 16:03:03.164853 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/45d21252-1b68-4533-9bb3-a6bc9f334171-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"45d21252-1b68-4533-9bb3-a6bc9f334171\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:03:03 crc kubenswrapper[5120]: I0316 16:03:03.175566 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/placement-fb69b7968-qskx5" Mar 16 16:03:03 crc kubenswrapper[5120]: I0316 16:03:03.266197 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/15543dd6-22d4-4a03-8bf6-1b418e1bc713-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"15543dd6-22d4-4a03-8bf6-1b418e1bc713\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:03:03 crc kubenswrapper[5120]: I0316 16:03:03.266462 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/15543dd6-22d4-4a03-8bf6-1b418e1bc713-run-httpd\") pod \"ceilometer-0\" (UID: \"15543dd6-22d4-4a03-8bf6-1b418e1bc713\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:03:03 crc kubenswrapper[5120]: I0316 16:03:03.266647 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/45d21252-1b68-4533-9bb3-a6bc9f334171-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"45d21252-1b68-4533-9bb3-a6bc9f334171\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:03:03 crc kubenswrapper[5120]: I0316 16:03:03.266671 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/15543dd6-22d4-4a03-8bf6-1b418e1bc713-scripts\") pod \"ceilometer-0\" (UID: \"15543dd6-22d4-4a03-8bf6-1b418e1bc713\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:03:03 crc kubenswrapper[5120]: I0316 16:03:03.266741 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/15543dd6-22d4-4a03-8bf6-1b418e1bc713-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"15543dd6-22d4-4a03-8bf6-1b418e1bc713\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:03:03 crc kubenswrapper[5120]: I0316 16:03:03.266779 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/45d21252-1b68-4533-9bb3-a6bc9f334171-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"45d21252-1b68-4533-9bb3-a6bc9f334171\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:03:03 crc kubenswrapper[5120]: I0316 16:03:03.266921 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8jdzk\" (UniqueName: \"kubernetes.io/projected/45d21252-1b68-4533-9bb3-a6bc9f334171-kube-api-access-8jdzk\") pod \"nova-cell0-conductor-0\" (UID: \"45d21252-1b68-4533-9bb3-a6bc9f334171\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:03:03 crc kubenswrapper[5120]: I0316 16:03:03.266950 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r98qk\" (UniqueName: \"kubernetes.io/projected/15543dd6-22d4-4a03-8bf6-1b418e1bc713-kube-api-access-r98qk\") pod \"ceilometer-0\" (UID: \"15543dd6-22d4-4a03-8bf6-1b418e1bc713\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:03:03 crc kubenswrapper[5120]: I0316 16:03:03.266967 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/15543dd6-22d4-4a03-8bf6-1b418e1bc713-config-data\") pod \"ceilometer-0\" (UID: \"15543dd6-22d4-4a03-8bf6-1b418e1bc713\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:03:03 crc kubenswrapper[5120]: I0316 16:03:03.266985 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/15543dd6-22d4-4a03-8bf6-1b418e1bc713-log-httpd\") pod \"ceilometer-0\" (UID: \"15543dd6-22d4-4a03-8bf6-1b418e1bc713\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:03:03 crc kubenswrapper[5120]: I0316 16:03:03.267607 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/15543dd6-22d4-4a03-8bf6-1b418e1bc713-run-httpd\") pod \"ceilometer-0\" (UID: \"15543dd6-22d4-4a03-8bf6-1b418e1bc713\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:03:03 crc kubenswrapper[5120]: I0316 16:03:03.268840 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/15543dd6-22d4-4a03-8bf6-1b418e1bc713-log-httpd\") pod \"ceilometer-0\" (UID: \"15543dd6-22d4-4a03-8bf6-1b418e1bc713\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:03:03 crc kubenswrapper[5120]: I0316 16:03:03.271806 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/15543dd6-22d4-4a03-8bf6-1b418e1bc713-config-data\") pod \"ceilometer-0\" (UID: \"15543dd6-22d4-4a03-8bf6-1b418e1bc713\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:03:03 crc kubenswrapper[5120]: I0316 16:03:03.271917 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/15543dd6-22d4-4a03-8bf6-1b418e1bc713-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"15543dd6-22d4-4a03-8bf6-1b418e1bc713\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:03:03 crc kubenswrapper[5120]: I0316 16:03:03.272901 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/45d21252-1b68-4533-9bb3-a6bc9f334171-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"45d21252-1b68-4533-9bb3-a6bc9f334171\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:03:03 crc kubenswrapper[5120]: I0316 16:03:03.273813 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/15543dd6-22d4-4a03-8bf6-1b418e1bc713-scripts\") pod \"ceilometer-0\" (UID: \"15543dd6-22d4-4a03-8bf6-1b418e1bc713\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:03:03 crc kubenswrapper[5120]: I0316 16:03:03.276472 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/45d21252-1b68-4533-9bb3-a6bc9f334171-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"45d21252-1b68-4533-9bb3-a6bc9f334171\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:03:03 crc kubenswrapper[5120]: I0316 16:03:03.282390 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/15543dd6-22d4-4a03-8bf6-1b418e1bc713-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"15543dd6-22d4-4a03-8bf6-1b418e1bc713\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:03:03 crc kubenswrapper[5120]: I0316 16:03:03.284675 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jdzk\" (UniqueName: \"kubernetes.io/projected/45d21252-1b68-4533-9bb3-a6bc9f334171-kube-api-access-8jdzk\") pod \"nova-cell0-conductor-0\" (UID: \"45d21252-1b68-4533-9bb3-a6bc9f334171\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:03:03 crc kubenswrapper[5120]: I0316 16:03:03.285854 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r98qk\" (UniqueName: \"kubernetes.io/projected/15543dd6-22d4-4a03-8bf6-1b418e1bc713-kube-api-access-r98qk\") pod \"ceilometer-0\" (UID: \"15543dd6-22d4-4a03-8bf6-1b418e1bc713\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:03:03 crc kubenswrapper[5120]: I0316 16:03:03.389256 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:03:03 crc kubenswrapper[5120]: I0316 16:03:03.396537 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:03:03 crc kubenswrapper[5120]: I0316 16:03:03.397196 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:03:03 crc kubenswrapper[5120]: I0316 16:03:03.862120 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:03:03 crc kubenswrapper[5120]: W0316 16:03:03.952252 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod45d21252_1b68_4533_9bb3_a6bc9f334171.slice/crio-896818b9a22f9d5f278ef1301f8dbb6fa72df92564280fdcaed4d6f224a75425 WatchSource:0}: Error finding container 896818b9a22f9d5f278ef1301f8dbb6fa72df92564280fdcaed4d6f224a75425: Status 404 returned error can't find the container with id 896818b9a22f9d5f278ef1301f8dbb6fa72df92564280fdcaed4d6f224a75425 Mar 16 16:03:03 crc kubenswrapper[5120]: I0316 16:03:03.959775 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:03:03 crc kubenswrapper[5120]: I0316 16:03:03.986482 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"15543dd6-22d4-4a03-8bf6-1b418e1bc713","Type":"ContainerStarted","Data":"63c25bde6154cc0c2236d63325cf7b0fd6b0efe03050f275a1bc0f1885ebb4b6"} Mar 16 16:03:03 crc kubenswrapper[5120]: I0316 16:03:03.988998 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"45d21252-1b68-4533-9bb3-a6bc9f334171","Type":"ContainerStarted","Data":"896818b9a22f9d5f278ef1301f8dbb6fa72df92564280fdcaed4d6f224a75425"} Mar 16 16:03:03 crc kubenswrapper[5120]: I0316 16:03:03.990900 5120 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Mar 16 16:03:03 crc kubenswrapper[5120]: I0316 16:03:03.991003 5120 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Mar 16 16:03:03 crc kubenswrapper[5120]: I0316 16:03:03.995367 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:03:04 crc kubenswrapper[5120]: I0316 16:03:04.004505 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:03:04 crc kubenswrapper[5120]: I0316 16:03:04.081227 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/placement-fb69b7968-qskx5" Mar 16 16:03:04 crc kubenswrapper[5120]: I0316 16:03:04.111037 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:03:04 crc kubenswrapper[5120]: I0316 16:03:04.176471 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-5d4d9d69db-qcw77"] Mar 16 16:03:04 crc kubenswrapper[5120]: I0316 16:03:04.176718 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-5d4d9d69db-qcw77" podUID="13a4296c-922e-4316-a6c6-cae50477429b" containerName="placement-log" containerID="cri-o://eb2e70376153ba3be267176a6919aca0b69370446f9cd2fd72907d52ec73ad19" gracePeriod=30 Mar 16 16:03:04 crc kubenswrapper[5120]: I0316 16:03:04.177157 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-5d4d9d69db-qcw77" podUID="13a4296c-922e-4316-a6c6-cae50477429b" containerName="placement-api" containerID="cri-o://e44e5e07928b70511e1bb7a8b3d79f3129084a9c99f8986be93aaff6ff10e073" gracePeriod=30 Mar 16 16:03:04 crc kubenswrapper[5120]: I0316 16:03:04.674279 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce30340d-6cf2-40a4-a2ff-d9dc9dc33bd8" path="/var/lib/kubelet/pods/ce30340d-6cf2-40a4-a2ff-d9dc9dc33bd8/volumes" Mar 16 16:03:04 crc kubenswrapper[5120]: I0316 16:03:04.675236 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e6045f50-0da0-4296-95db-bac2c92ce81e" path="/var/lib/kubelet/pods/e6045f50-0da0-4296-95db-bac2c92ce81e/volumes" Mar 16 16:03:05 crc kubenswrapper[5120]: I0316 16:03:05.000301 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"45d21252-1b68-4533-9bb3-a6bc9f334171","Type":"ContainerStarted","Data":"4332146db136bb0f7c8338516ee5e78eea0c4e33906493f9ac0fc28c73e1b585"} Mar 16 16:03:05 crc kubenswrapper[5120]: I0316 16:03:05.001652 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:03:05 crc kubenswrapper[5120]: I0316 16:03:05.000360 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="45d21252-1b68-4533-9bb3-a6bc9f334171" containerName="nova-cell0-conductor-conductor" containerID="cri-o://4332146db136bb0f7c8338516ee5e78eea0c4e33906493f9ac0fc28c73e1b585" gracePeriod=30 Mar 16 16:03:05 crc kubenswrapper[5120]: I0316 16:03:05.002953 5120 generic.go:358] "Generic (PLEG): container finished" podID="13a4296c-922e-4316-a6c6-cae50477429b" containerID="eb2e70376153ba3be267176a6919aca0b69370446f9cd2fd72907d52ec73ad19" exitCode=143 Mar 16 16:03:05 crc kubenswrapper[5120]: I0316 16:03:05.003209 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-5d4d9d69db-qcw77" event={"ID":"13a4296c-922e-4316-a6c6-cae50477429b","Type":"ContainerDied","Data":"eb2e70376153ba3be267176a6919aca0b69370446f9cd2fd72907d52ec73ad19"} Mar 16 16:03:05 crc kubenswrapper[5120]: I0316 16:03:05.005964 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"15543dd6-22d4-4a03-8bf6-1b418e1bc713","Type":"ContainerStarted","Data":"20b99827f2f986f533022f100bdadf949c2ef50fb91a9b2293bb9e0c0f9b2ab5"} Mar 16 16:03:05 crc kubenswrapper[5120]: I0316 16:03:05.020431 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podStartSLOduration=3.020416358 podStartE2EDuration="3.020416358s" podCreationTimestamp="2026-03-16 16:03:02 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:03:05.016626873 +0000 UTC m=+1887.170558520" watchObservedRunningTime="2026-03-16 16:03:05.020416358 +0000 UTC m=+1887.174348015" Mar 16 16:03:05 crc kubenswrapper[5120]: I0316 16:03:05.221706 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:03:05 crc kubenswrapper[5120]: I0316 16:03:05.221826 5120 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Mar 16 16:03:05 crc kubenswrapper[5120]: I0316 16:03:05.223166 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:03:06 crc kubenswrapper[5120]: I0316 16:03:06.035151 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"15543dd6-22d4-4a03-8bf6-1b418e1bc713","Type":"ContainerStarted","Data":"201e836a9d8b98244f1b90e0242d527cfe5ba904bad416c9b6ef354140692396"} Mar 16 16:03:07 crc kubenswrapper[5120]: I0316 16:03:07.057341 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"15543dd6-22d4-4a03-8bf6-1b418e1bc713","Type":"ContainerStarted","Data":"b84e57aec86463fcfc1c100183fb25a883ebb0a65f77826fee2c94c4d14b3d22"} Mar 16 16:03:07 crc kubenswrapper[5120]: I0316 16:03:07.881150 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-5d4d9d69db-qcw77" Mar 16 16:03:08 crc kubenswrapper[5120]: E0316 16:03:08.065437 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1685065 actualBytes=10240 Mar 16 16:03:08 crc kubenswrapper[5120]: I0316 16:03:08.072161 5120 generic.go:358] "Generic (PLEG): container finished" podID="13a4296c-922e-4316-a6c6-cae50477429b" containerID="e44e5e07928b70511e1bb7a8b3d79f3129084a9c99f8986be93aaff6ff10e073" exitCode=0 Mar 16 16:03:08 crc kubenswrapper[5120]: I0316 16:03:08.072793 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-5d4d9d69db-qcw77" event={"ID":"13a4296c-922e-4316-a6c6-cae50477429b","Type":"ContainerDied","Data":"e44e5e07928b70511e1bb7a8b3d79f3129084a9c99f8986be93aaff6ff10e073"} Mar 16 16:03:08 crc kubenswrapper[5120]: I0316 16:03:08.072828 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-5d4d9d69db-qcw77" event={"ID":"13a4296c-922e-4316-a6c6-cae50477429b","Type":"ContainerDied","Data":"a94944724879327e7a5bee38f898f9d27c6723d77bd0441d925877f6a509e574"} Mar 16 16:03:08 crc kubenswrapper[5120]: I0316 16:03:08.072850 5120 scope.go:117] "RemoveContainer" containerID="e44e5e07928b70511e1bb7a8b3d79f3129084a9c99f8986be93aaff6ff10e073" Mar 16 16:03:08 crc kubenswrapper[5120]: I0316 16:03:08.073013 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-5d4d9d69db-qcw77" Mar 16 16:03:08 crc kubenswrapper[5120]: I0316 16:03:08.075098 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/13a4296c-922e-4316-a6c6-cae50477429b-scripts\") pod \"13a4296c-922e-4316-a6c6-cae50477429b\" (UID: \"13a4296c-922e-4316-a6c6-cae50477429b\") " Mar 16 16:03:08 crc kubenswrapper[5120]: I0316 16:03:08.076961 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h2b78\" (UniqueName: \"kubernetes.io/projected/13a4296c-922e-4316-a6c6-cae50477429b-kube-api-access-h2b78\") pod \"13a4296c-922e-4316-a6c6-cae50477429b\" (UID: \"13a4296c-922e-4316-a6c6-cae50477429b\") " Mar 16 16:03:08 crc kubenswrapper[5120]: I0316 16:03:08.077112 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/13a4296c-922e-4316-a6c6-cae50477429b-config-data\") pod \"13a4296c-922e-4316-a6c6-cae50477429b\" (UID: \"13a4296c-922e-4316-a6c6-cae50477429b\") " Mar 16 16:03:08 crc kubenswrapper[5120]: I0316 16:03:08.077416 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/13a4296c-922e-4316-a6c6-cae50477429b-logs\") pod \"13a4296c-922e-4316-a6c6-cae50477429b\" (UID: \"13a4296c-922e-4316-a6c6-cae50477429b\") " Mar 16 16:03:08 crc kubenswrapper[5120]: I0316 16:03:08.077518 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/13a4296c-922e-4316-a6c6-cae50477429b-combined-ca-bundle\") pod \"13a4296c-922e-4316-a6c6-cae50477429b\" (UID: \"13a4296c-922e-4316-a6c6-cae50477429b\") " Mar 16 16:03:08 crc kubenswrapper[5120]: I0316 16:03:08.077610 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/13a4296c-922e-4316-a6c6-cae50477429b-internal-tls-certs\") pod \"13a4296c-922e-4316-a6c6-cae50477429b\" (UID: \"13a4296c-922e-4316-a6c6-cae50477429b\") " Mar 16 16:03:08 crc kubenswrapper[5120]: I0316 16:03:08.077660 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/13a4296c-922e-4316-a6c6-cae50477429b-public-tls-certs\") pod \"13a4296c-922e-4316-a6c6-cae50477429b\" (UID: \"13a4296c-922e-4316-a6c6-cae50477429b\") " Mar 16 16:03:08 crc kubenswrapper[5120]: I0316 16:03:08.078172 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13a4296c-922e-4316-a6c6-cae50477429b-logs" (OuterVolumeSpecName: "logs") pod "13a4296c-922e-4316-a6c6-cae50477429b" (UID: "13a4296c-922e-4316-a6c6-cae50477429b"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:03:08 crc kubenswrapper[5120]: I0316 16:03:08.079042 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/13a4296c-922e-4316-a6c6-cae50477429b-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:03:08 crc kubenswrapper[5120]: I0316 16:03:08.086065 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/13a4296c-922e-4316-a6c6-cae50477429b-scripts" (OuterVolumeSpecName: "scripts") pod "13a4296c-922e-4316-a6c6-cae50477429b" (UID: "13a4296c-922e-4316-a6c6-cae50477429b"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:03:08 crc kubenswrapper[5120]: I0316 16:03:08.086398 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13a4296c-922e-4316-a6c6-cae50477429b-kube-api-access-h2b78" (OuterVolumeSpecName: "kube-api-access-h2b78") pod "13a4296c-922e-4316-a6c6-cae50477429b" (UID: "13a4296c-922e-4316-a6c6-cae50477429b"). InnerVolumeSpecName "kube-api-access-h2b78". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:03:08 crc kubenswrapper[5120]: I0316 16:03:08.103487 5120 scope.go:117] "RemoveContainer" containerID="eb2e70376153ba3be267176a6919aca0b69370446f9cd2fd72907d52ec73ad19" Mar 16 16:03:08 crc kubenswrapper[5120]: I0316 16:03:08.137991 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/13a4296c-922e-4316-a6c6-cae50477429b-config-data" (OuterVolumeSpecName: "config-data") pod "13a4296c-922e-4316-a6c6-cae50477429b" (UID: "13a4296c-922e-4316-a6c6-cae50477429b"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:03:08 crc kubenswrapper[5120]: I0316 16:03:08.139304 5120 scope.go:117] "RemoveContainer" containerID="e44e5e07928b70511e1bb7a8b3d79f3129084a9c99f8986be93aaff6ff10e073" Mar 16 16:03:08 crc kubenswrapper[5120]: E0316 16:03:08.139922 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e44e5e07928b70511e1bb7a8b3d79f3129084a9c99f8986be93aaff6ff10e073\": container with ID starting with e44e5e07928b70511e1bb7a8b3d79f3129084a9c99f8986be93aaff6ff10e073 not found: ID does not exist" containerID="e44e5e07928b70511e1bb7a8b3d79f3129084a9c99f8986be93aaff6ff10e073" Mar 16 16:03:08 crc kubenswrapper[5120]: I0316 16:03:08.139959 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e44e5e07928b70511e1bb7a8b3d79f3129084a9c99f8986be93aaff6ff10e073"} err="failed to get container status \"e44e5e07928b70511e1bb7a8b3d79f3129084a9c99f8986be93aaff6ff10e073\": rpc error: code = NotFound desc = could not find container \"e44e5e07928b70511e1bb7a8b3d79f3129084a9c99f8986be93aaff6ff10e073\": container with ID starting with e44e5e07928b70511e1bb7a8b3d79f3129084a9c99f8986be93aaff6ff10e073 not found: ID does not exist" Mar 16 16:03:08 crc kubenswrapper[5120]: I0316 16:03:08.139990 5120 scope.go:117] "RemoveContainer" containerID="eb2e70376153ba3be267176a6919aca0b69370446f9cd2fd72907d52ec73ad19" Mar 16 16:03:08 crc kubenswrapper[5120]: E0316 16:03:08.140944 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb2e70376153ba3be267176a6919aca0b69370446f9cd2fd72907d52ec73ad19\": container with ID starting with eb2e70376153ba3be267176a6919aca0b69370446f9cd2fd72907d52ec73ad19 not found: ID does not exist" containerID="eb2e70376153ba3be267176a6919aca0b69370446f9cd2fd72907d52ec73ad19" Mar 16 16:03:08 crc kubenswrapper[5120]: I0316 16:03:08.140970 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb2e70376153ba3be267176a6919aca0b69370446f9cd2fd72907d52ec73ad19"} err="failed to get container status \"eb2e70376153ba3be267176a6919aca0b69370446f9cd2fd72907d52ec73ad19\": rpc error: code = NotFound desc = could not find container \"eb2e70376153ba3be267176a6919aca0b69370446f9cd2fd72907d52ec73ad19\": container with ID starting with eb2e70376153ba3be267176a6919aca0b69370446f9cd2fd72907d52ec73ad19 not found: ID does not exist" Mar 16 16:03:08 crc kubenswrapper[5120]: I0316 16:03:08.142599 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/13a4296c-922e-4316-a6c6-cae50477429b-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "13a4296c-922e-4316-a6c6-cae50477429b" (UID: "13a4296c-922e-4316-a6c6-cae50477429b"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:03:08 crc kubenswrapper[5120]: I0316 16:03:08.182164 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/13a4296c-922e-4316-a6c6-cae50477429b-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:03:08 crc kubenswrapper[5120]: I0316 16:03:08.182494 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/13a4296c-922e-4316-a6c6-cae50477429b-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:03:08 crc kubenswrapper[5120]: I0316 16:03:08.182506 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/13a4296c-922e-4316-a6c6-cae50477429b-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:03:08 crc kubenswrapper[5120]: I0316 16:03:08.182515 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h2b78\" (UniqueName: \"kubernetes.io/projected/13a4296c-922e-4316-a6c6-cae50477429b-kube-api-access-h2b78\") on node \"crc\" DevicePath \"\"" Mar 16 16:03:08 crc kubenswrapper[5120]: I0316 16:03:08.197278 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/13a4296c-922e-4316-a6c6-cae50477429b-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "13a4296c-922e-4316-a6c6-cae50477429b" (UID: "13a4296c-922e-4316-a6c6-cae50477429b"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:03:08 crc kubenswrapper[5120]: I0316 16:03:08.205896 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/13a4296c-922e-4316-a6c6-cae50477429b-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "13a4296c-922e-4316-a6c6-cae50477429b" (UID: "13a4296c-922e-4316-a6c6-cae50477429b"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:03:08 crc kubenswrapper[5120]: I0316 16:03:08.284617 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/13a4296c-922e-4316-a6c6-cae50477429b-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:03:08 crc kubenswrapper[5120]: I0316 16:03:08.284651 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/13a4296c-922e-4316-a6c6-cae50477429b-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:03:08 crc kubenswrapper[5120]: I0316 16:03:08.407813 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-5d4d9d69db-qcw77"] Mar 16 16:03:08 crc kubenswrapper[5120]: I0316 16:03:08.418608 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-5d4d9d69db-qcw77"] Mar 16 16:03:08 crc kubenswrapper[5120]: I0316 16:03:08.676443 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="13a4296c-922e-4316-a6c6-cae50477429b" path="/var/lib/kubelet/pods/13a4296c-922e-4316-a6c6-cae50477429b/volumes" Mar 16 16:03:09 crc kubenswrapper[5120]: I0316 16:03:09.091186 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="15543dd6-22d4-4a03-8bf6-1b418e1bc713" containerName="ceilometer-central-agent" containerID="cri-o://20b99827f2f986f533022f100bdadf949c2ef50fb91a9b2293bb9e0c0f9b2ab5" gracePeriod=30 Mar 16 16:03:09 crc kubenswrapper[5120]: I0316 16:03:09.091240 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"15543dd6-22d4-4a03-8bf6-1b418e1bc713","Type":"ContainerStarted","Data":"adbfe60fd3f4f82da58fc53e181e4fe68ad7f3ed69edcc2d7ad993c333089402"} Mar 16 16:03:09 crc kubenswrapper[5120]: I0316 16:03:09.091456 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:03:09 crc kubenswrapper[5120]: I0316 16:03:09.091336 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="15543dd6-22d4-4a03-8bf6-1b418e1bc713" containerName="sg-core" containerID="cri-o://b84e57aec86463fcfc1c100183fb25a883ebb0a65f77826fee2c94c4d14b3d22" gracePeriod=30 Mar 16 16:03:09 crc kubenswrapper[5120]: I0316 16:03:09.091291 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="15543dd6-22d4-4a03-8bf6-1b418e1bc713" containerName="ceilometer-notification-agent" containerID="cri-o://201e836a9d8b98244f1b90e0242d527cfe5ba904bad416c9b6ef354140692396" gracePeriod=30 Mar 16 16:03:09 crc kubenswrapper[5120]: I0316 16:03:09.091369 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="15543dd6-22d4-4a03-8bf6-1b418e1bc713" containerName="proxy-httpd" containerID="cri-o://adbfe60fd3f4f82da58fc53e181e4fe68ad7f3ed69edcc2d7ad993c333089402" gracePeriod=30 Mar 16 16:03:09 crc kubenswrapper[5120]: I0316 16:03:09.129388 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.025788615 podStartE2EDuration="6.129363206s" podCreationTimestamp="2026-03-16 16:03:03 +0000 UTC" firstStartedPulling="2026-03-16 16:03:03.875730753 +0000 UTC m=+1886.029662410" lastFinishedPulling="2026-03-16 16:03:07.979305344 +0000 UTC m=+1890.133237001" observedRunningTime="2026-03-16 16:03:09.118565059 +0000 UTC m=+1891.272496746" watchObservedRunningTime="2026-03-16 16:03:09.129363206 +0000 UTC m=+1891.283294873" Mar 16 16:03:10 crc kubenswrapper[5120]: E0316 16:03:10.003252 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="4332146db136bb0f7c8338516ee5e78eea0c4e33906493f9ac0fc28c73e1b585" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:03:10 crc kubenswrapper[5120]: E0316 16:03:10.008077 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="4332146db136bb0f7c8338516ee5e78eea0c4e33906493f9ac0fc28c73e1b585" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:03:10 crc kubenswrapper[5120]: E0316 16:03:10.009962 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="4332146db136bb0f7c8338516ee5e78eea0c4e33906493f9ac0fc28c73e1b585" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:03:10 crc kubenswrapper[5120]: E0316 16:03:10.010051 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="45d21252-1b68-4533-9bb3-a6bc9f334171" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 16:03:10 crc kubenswrapper[5120]: I0316 16:03:10.109925 5120 generic.go:358] "Generic (PLEG): container finished" podID="15543dd6-22d4-4a03-8bf6-1b418e1bc713" containerID="adbfe60fd3f4f82da58fc53e181e4fe68ad7f3ed69edcc2d7ad993c333089402" exitCode=0 Mar 16 16:03:10 crc kubenswrapper[5120]: I0316 16:03:10.110630 5120 generic.go:358] "Generic (PLEG): container finished" podID="15543dd6-22d4-4a03-8bf6-1b418e1bc713" containerID="b84e57aec86463fcfc1c100183fb25a883ebb0a65f77826fee2c94c4d14b3d22" exitCode=2 Mar 16 16:03:10 crc kubenswrapper[5120]: I0316 16:03:10.110650 5120 generic.go:358] "Generic (PLEG): container finished" podID="15543dd6-22d4-4a03-8bf6-1b418e1bc713" containerID="201e836a9d8b98244f1b90e0242d527cfe5ba904bad416c9b6ef354140692396" exitCode=0 Mar 16 16:03:10 crc kubenswrapper[5120]: I0316 16:03:10.110751 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"15543dd6-22d4-4a03-8bf6-1b418e1bc713","Type":"ContainerDied","Data":"adbfe60fd3f4f82da58fc53e181e4fe68ad7f3ed69edcc2d7ad993c333089402"} Mar 16 16:03:10 crc kubenswrapper[5120]: I0316 16:03:10.110820 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"15543dd6-22d4-4a03-8bf6-1b418e1bc713","Type":"ContainerDied","Data":"b84e57aec86463fcfc1c100183fb25a883ebb0a65f77826fee2c94c4d14b3d22"} Mar 16 16:03:10 crc kubenswrapper[5120]: I0316 16:03:10.110842 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"15543dd6-22d4-4a03-8bf6-1b418e1bc713","Type":"ContainerDied","Data":"201e836a9d8b98244f1b90e0242d527cfe5ba904bad416c9b6ef354140692396"} Mar 16 16:03:12 crc kubenswrapper[5120]: I0316 16:03:12.894393 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:03:12 crc kubenswrapper[5120]: I0316 16:03:12.984791 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/15543dd6-22d4-4a03-8bf6-1b418e1bc713-scripts\") pod \"15543dd6-22d4-4a03-8bf6-1b418e1bc713\" (UID: \"15543dd6-22d4-4a03-8bf6-1b418e1bc713\") " Mar 16 16:03:12 crc kubenswrapper[5120]: I0316 16:03:12.984859 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/15543dd6-22d4-4a03-8bf6-1b418e1bc713-combined-ca-bundle\") pod \"15543dd6-22d4-4a03-8bf6-1b418e1bc713\" (UID: \"15543dd6-22d4-4a03-8bf6-1b418e1bc713\") " Mar 16 16:03:12 crc kubenswrapper[5120]: I0316 16:03:12.985002 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r98qk\" (UniqueName: \"kubernetes.io/projected/15543dd6-22d4-4a03-8bf6-1b418e1bc713-kube-api-access-r98qk\") pod \"15543dd6-22d4-4a03-8bf6-1b418e1bc713\" (UID: \"15543dd6-22d4-4a03-8bf6-1b418e1bc713\") " Mar 16 16:03:12 crc kubenswrapper[5120]: I0316 16:03:12.985054 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/15543dd6-22d4-4a03-8bf6-1b418e1bc713-config-data\") pod \"15543dd6-22d4-4a03-8bf6-1b418e1bc713\" (UID: \"15543dd6-22d4-4a03-8bf6-1b418e1bc713\") " Mar 16 16:03:12 crc kubenswrapper[5120]: I0316 16:03:12.985093 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/15543dd6-22d4-4a03-8bf6-1b418e1bc713-run-httpd\") pod \"15543dd6-22d4-4a03-8bf6-1b418e1bc713\" (UID: \"15543dd6-22d4-4a03-8bf6-1b418e1bc713\") " Mar 16 16:03:12 crc kubenswrapper[5120]: I0316 16:03:12.985111 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/15543dd6-22d4-4a03-8bf6-1b418e1bc713-sg-core-conf-yaml\") pod \"15543dd6-22d4-4a03-8bf6-1b418e1bc713\" (UID: \"15543dd6-22d4-4a03-8bf6-1b418e1bc713\") " Mar 16 16:03:12 crc kubenswrapper[5120]: I0316 16:03:12.985143 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/15543dd6-22d4-4a03-8bf6-1b418e1bc713-log-httpd\") pod \"15543dd6-22d4-4a03-8bf6-1b418e1bc713\" (UID: \"15543dd6-22d4-4a03-8bf6-1b418e1bc713\") " Mar 16 16:03:12 crc kubenswrapper[5120]: I0316 16:03:12.985479 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15543dd6-22d4-4a03-8bf6-1b418e1bc713-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "15543dd6-22d4-4a03-8bf6-1b418e1bc713" (UID: "15543dd6-22d4-4a03-8bf6-1b418e1bc713"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:03:12 crc kubenswrapper[5120]: I0316 16:03:12.986348 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/15543dd6-22d4-4a03-8bf6-1b418e1bc713-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:03:12 crc kubenswrapper[5120]: I0316 16:03:12.986403 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15543dd6-22d4-4a03-8bf6-1b418e1bc713-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "15543dd6-22d4-4a03-8bf6-1b418e1bc713" (UID: "15543dd6-22d4-4a03-8bf6-1b418e1bc713"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:03:12 crc kubenswrapper[5120]: I0316 16:03:12.993071 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15543dd6-22d4-4a03-8bf6-1b418e1bc713-kube-api-access-r98qk" (OuterVolumeSpecName: "kube-api-access-r98qk") pod "15543dd6-22d4-4a03-8bf6-1b418e1bc713" (UID: "15543dd6-22d4-4a03-8bf6-1b418e1bc713"). InnerVolumeSpecName "kube-api-access-r98qk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:03:13 crc kubenswrapper[5120]: I0316 16:03:13.001516 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/15543dd6-22d4-4a03-8bf6-1b418e1bc713-scripts" (OuterVolumeSpecName: "scripts") pod "15543dd6-22d4-4a03-8bf6-1b418e1bc713" (UID: "15543dd6-22d4-4a03-8bf6-1b418e1bc713"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:03:13 crc kubenswrapper[5120]: I0316 16:03:13.012163 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/15543dd6-22d4-4a03-8bf6-1b418e1bc713-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "15543dd6-22d4-4a03-8bf6-1b418e1bc713" (UID: "15543dd6-22d4-4a03-8bf6-1b418e1bc713"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:03:13 crc kubenswrapper[5120]: I0316 16:03:13.071444 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/15543dd6-22d4-4a03-8bf6-1b418e1bc713-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "15543dd6-22d4-4a03-8bf6-1b418e1bc713" (UID: "15543dd6-22d4-4a03-8bf6-1b418e1bc713"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:03:13 crc kubenswrapper[5120]: I0316 16:03:13.088349 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/15543dd6-22d4-4a03-8bf6-1b418e1bc713-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:03:13 crc kubenswrapper[5120]: I0316 16:03:13.088387 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/15543dd6-22d4-4a03-8bf6-1b418e1bc713-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:03:13 crc kubenswrapper[5120]: I0316 16:03:13.088402 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r98qk\" (UniqueName: \"kubernetes.io/projected/15543dd6-22d4-4a03-8bf6-1b418e1bc713-kube-api-access-r98qk\") on node \"crc\" DevicePath \"\"" Mar 16 16:03:13 crc kubenswrapper[5120]: I0316 16:03:13.088415 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/15543dd6-22d4-4a03-8bf6-1b418e1bc713-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 16:03:13 crc kubenswrapper[5120]: I0316 16:03:13.088427 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/15543dd6-22d4-4a03-8bf6-1b418e1bc713-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:03:13 crc kubenswrapper[5120]: I0316 16:03:13.127460 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/15543dd6-22d4-4a03-8bf6-1b418e1bc713-config-data" (OuterVolumeSpecName: "config-data") pod "15543dd6-22d4-4a03-8bf6-1b418e1bc713" (UID: "15543dd6-22d4-4a03-8bf6-1b418e1bc713"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:03:13 crc kubenswrapper[5120]: I0316 16:03:13.140342 5120 generic.go:358] "Generic (PLEG): container finished" podID="15543dd6-22d4-4a03-8bf6-1b418e1bc713" containerID="20b99827f2f986f533022f100bdadf949c2ef50fb91a9b2293bb9e0c0f9b2ab5" exitCode=0 Mar 16 16:03:13 crc kubenswrapper[5120]: I0316 16:03:13.140389 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"15543dd6-22d4-4a03-8bf6-1b418e1bc713","Type":"ContainerDied","Data":"20b99827f2f986f533022f100bdadf949c2ef50fb91a9b2293bb9e0c0f9b2ab5"} Mar 16 16:03:13 crc kubenswrapper[5120]: I0316 16:03:13.140421 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"15543dd6-22d4-4a03-8bf6-1b418e1bc713","Type":"ContainerDied","Data":"63c25bde6154cc0c2236d63325cf7b0fd6b0efe03050f275a1bc0f1885ebb4b6"} Mar 16 16:03:13 crc kubenswrapper[5120]: I0316 16:03:13.140424 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:03:13 crc kubenswrapper[5120]: I0316 16:03:13.140467 5120 scope.go:117] "RemoveContainer" containerID="adbfe60fd3f4f82da58fc53e181e4fe68ad7f3ed69edcc2d7ad993c333089402" Mar 16 16:03:13 crc kubenswrapper[5120]: I0316 16:03:13.171459 5120 scope.go:117] "RemoveContainer" containerID="b84e57aec86463fcfc1c100183fb25a883ebb0a65f77826fee2c94c4d14b3d22" Mar 16 16:03:13 crc kubenswrapper[5120]: I0316 16:03:13.175164 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:03:13 crc kubenswrapper[5120]: I0316 16:03:13.182468 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:03:13 crc kubenswrapper[5120]: I0316 16:03:13.190398 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/15543dd6-22d4-4a03-8bf6-1b418e1bc713-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:03:13 crc kubenswrapper[5120]: I0316 16:03:13.205194 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:03:13 crc kubenswrapper[5120]: I0316 16:03:13.206239 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13a4296c-922e-4316-a6c6-cae50477429b" containerName="placement-log" Mar 16 16:03:13 crc kubenswrapper[5120]: I0316 16:03:13.206251 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="13a4296c-922e-4316-a6c6-cae50477429b" containerName="placement-log" Mar 16 16:03:13 crc kubenswrapper[5120]: I0316 16:03:13.206272 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15543dd6-22d4-4a03-8bf6-1b418e1bc713" containerName="sg-core" Mar 16 16:03:13 crc kubenswrapper[5120]: I0316 16:03:13.206278 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="15543dd6-22d4-4a03-8bf6-1b418e1bc713" containerName="sg-core" Mar 16 16:03:13 crc kubenswrapper[5120]: I0316 16:03:13.206289 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13a4296c-922e-4316-a6c6-cae50477429b" containerName="placement-api" Mar 16 16:03:13 crc kubenswrapper[5120]: I0316 16:03:13.206296 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="13a4296c-922e-4316-a6c6-cae50477429b" containerName="placement-api" Mar 16 16:03:13 crc kubenswrapper[5120]: I0316 16:03:13.206315 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15543dd6-22d4-4a03-8bf6-1b418e1bc713" containerName="proxy-httpd" Mar 16 16:03:13 crc kubenswrapper[5120]: I0316 16:03:13.206320 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="15543dd6-22d4-4a03-8bf6-1b418e1bc713" containerName="proxy-httpd" Mar 16 16:03:13 crc kubenswrapper[5120]: I0316 16:03:13.206334 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15543dd6-22d4-4a03-8bf6-1b418e1bc713" containerName="ceilometer-notification-agent" Mar 16 16:03:13 crc kubenswrapper[5120]: I0316 16:03:13.206358 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="15543dd6-22d4-4a03-8bf6-1b418e1bc713" containerName="ceilometer-notification-agent" Mar 16 16:03:13 crc kubenswrapper[5120]: I0316 16:03:13.206375 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15543dd6-22d4-4a03-8bf6-1b418e1bc713" containerName="ceilometer-central-agent" Mar 16 16:03:13 crc kubenswrapper[5120]: I0316 16:03:13.206388 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="15543dd6-22d4-4a03-8bf6-1b418e1bc713" containerName="ceilometer-central-agent" Mar 16 16:03:13 crc kubenswrapper[5120]: I0316 16:03:13.206571 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="13a4296c-922e-4316-a6c6-cae50477429b" containerName="placement-log" Mar 16 16:03:13 crc kubenswrapper[5120]: I0316 16:03:13.206585 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="13a4296c-922e-4316-a6c6-cae50477429b" containerName="placement-api" Mar 16 16:03:13 crc kubenswrapper[5120]: I0316 16:03:13.206592 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="15543dd6-22d4-4a03-8bf6-1b418e1bc713" containerName="sg-core" Mar 16 16:03:13 crc kubenswrapper[5120]: I0316 16:03:13.206600 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="15543dd6-22d4-4a03-8bf6-1b418e1bc713" containerName="ceilometer-notification-agent" Mar 16 16:03:13 crc kubenswrapper[5120]: I0316 16:03:13.206613 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="15543dd6-22d4-4a03-8bf6-1b418e1bc713" containerName="ceilometer-central-agent" Mar 16 16:03:13 crc kubenswrapper[5120]: I0316 16:03:13.206621 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="15543dd6-22d4-4a03-8bf6-1b418e1bc713" containerName="proxy-httpd" Mar 16 16:03:13 crc kubenswrapper[5120]: I0316 16:03:13.250913 5120 scope.go:117] "RemoveContainer" containerID="201e836a9d8b98244f1b90e0242d527cfe5ba904bad416c9b6ef354140692396" Mar 16 16:03:13 crc kubenswrapper[5120]: I0316 16:03:13.252108 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:03:13 crc kubenswrapper[5120]: I0316 16:03:13.252611 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:03:13 crc kubenswrapper[5120]: I0316 16:03:13.257047 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 16:03:13 crc kubenswrapper[5120]: I0316 16:03:13.257507 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 16:03:13 crc kubenswrapper[5120]: I0316 16:03:13.288806 5120 scope.go:117] "RemoveContainer" containerID="20b99827f2f986f533022f100bdadf949c2ef50fb91a9b2293bb9e0c0f9b2ab5" Mar 16 16:03:13 crc kubenswrapper[5120]: I0316 16:03:13.309816 5120 scope.go:117] "RemoveContainer" containerID="adbfe60fd3f4f82da58fc53e181e4fe68ad7f3ed69edcc2d7ad993c333089402" Mar 16 16:03:13 crc kubenswrapper[5120]: E0316 16:03:13.310243 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"adbfe60fd3f4f82da58fc53e181e4fe68ad7f3ed69edcc2d7ad993c333089402\": container with ID starting with adbfe60fd3f4f82da58fc53e181e4fe68ad7f3ed69edcc2d7ad993c333089402 not found: ID does not exist" containerID="adbfe60fd3f4f82da58fc53e181e4fe68ad7f3ed69edcc2d7ad993c333089402" Mar 16 16:03:13 crc kubenswrapper[5120]: I0316 16:03:13.310290 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"adbfe60fd3f4f82da58fc53e181e4fe68ad7f3ed69edcc2d7ad993c333089402"} err="failed to get container status \"adbfe60fd3f4f82da58fc53e181e4fe68ad7f3ed69edcc2d7ad993c333089402\": rpc error: code = NotFound desc = could not find container \"adbfe60fd3f4f82da58fc53e181e4fe68ad7f3ed69edcc2d7ad993c333089402\": container with ID starting with adbfe60fd3f4f82da58fc53e181e4fe68ad7f3ed69edcc2d7ad993c333089402 not found: ID does not exist" Mar 16 16:03:13 crc kubenswrapper[5120]: I0316 16:03:13.310318 5120 scope.go:117] "RemoveContainer" containerID="b84e57aec86463fcfc1c100183fb25a883ebb0a65f77826fee2c94c4d14b3d22" Mar 16 16:03:13 crc kubenswrapper[5120]: E0316 16:03:13.310769 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b84e57aec86463fcfc1c100183fb25a883ebb0a65f77826fee2c94c4d14b3d22\": container with ID starting with b84e57aec86463fcfc1c100183fb25a883ebb0a65f77826fee2c94c4d14b3d22 not found: ID does not exist" containerID="b84e57aec86463fcfc1c100183fb25a883ebb0a65f77826fee2c94c4d14b3d22" Mar 16 16:03:13 crc kubenswrapper[5120]: I0316 16:03:13.310796 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b84e57aec86463fcfc1c100183fb25a883ebb0a65f77826fee2c94c4d14b3d22"} err="failed to get container status \"b84e57aec86463fcfc1c100183fb25a883ebb0a65f77826fee2c94c4d14b3d22\": rpc error: code = NotFound desc = could not find container \"b84e57aec86463fcfc1c100183fb25a883ebb0a65f77826fee2c94c4d14b3d22\": container with ID starting with b84e57aec86463fcfc1c100183fb25a883ebb0a65f77826fee2c94c4d14b3d22 not found: ID does not exist" Mar 16 16:03:13 crc kubenswrapper[5120]: I0316 16:03:13.310813 5120 scope.go:117] "RemoveContainer" containerID="201e836a9d8b98244f1b90e0242d527cfe5ba904bad416c9b6ef354140692396" Mar 16 16:03:13 crc kubenswrapper[5120]: E0316 16:03:13.311154 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"201e836a9d8b98244f1b90e0242d527cfe5ba904bad416c9b6ef354140692396\": container with ID starting with 201e836a9d8b98244f1b90e0242d527cfe5ba904bad416c9b6ef354140692396 not found: ID does not exist" containerID="201e836a9d8b98244f1b90e0242d527cfe5ba904bad416c9b6ef354140692396" Mar 16 16:03:13 crc kubenswrapper[5120]: I0316 16:03:13.311183 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"201e836a9d8b98244f1b90e0242d527cfe5ba904bad416c9b6ef354140692396"} err="failed to get container status \"201e836a9d8b98244f1b90e0242d527cfe5ba904bad416c9b6ef354140692396\": rpc error: code = NotFound desc = could not find container \"201e836a9d8b98244f1b90e0242d527cfe5ba904bad416c9b6ef354140692396\": container with ID starting with 201e836a9d8b98244f1b90e0242d527cfe5ba904bad416c9b6ef354140692396 not found: ID does not exist" Mar 16 16:03:13 crc kubenswrapper[5120]: I0316 16:03:13.311202 5120 scope.go:117] "RemoveContainer" containerID="20b99827f2f986f533022f100bdadf949c2ef50fb91a9b2293bb9e0c0f9b2ab5" Mar 16 16:03:13 crc kubenswrapper[5120]: E0316 16:03:13.311702 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"20b99827f2f986f533022f100bdadf949c2ef50fb91a9b2293bb9e0c0f9b2ab5\": container with ID starting with 20b99827f2f986f533022f100bdadf949c2ef50fb91a9b2293bb9e0c0f9b2ab5 not found: ID does not exist" containerID="20b99827f2f986f533022f100bdadf949c2ef50fb91a9b2293bb9e0c0f9b2ab5" Mar 16 16:03:13 crc kubenswrapper[5120]: I0316 16:03:13.311732 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20b99827f2f986f533022f100bdadf949c2ef50fb91a9b2293bb9e0c0f9b2ab5"} err="failed to get container status \"20b99827f2f986f533022f100bdadf949c2ef50fb91a9b2293bb9e0c0f9b2ab5\": rpc error: code = NotFound desc = could not find container \"20b99827f2f986f533022f100bdadf949c2ef50fb91a9b2293bb9e0c0f9b2ab5\": container with ID starting with 20b99827f2f986f533022f100bdadf949c2ef50fb91a9b2293bb9e0c0f9b2ab5 not found: ID does not exist" Mar 16 16:03:13 crc kubenswrapper[5120]: I0316 16:03:13.392853 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5nzh6\" (UniqueName: \"kubernetes.io/projected/c7074645-e78d-4933-be5c-73794d1106bd-kube-api-access-5nzh6\") pod \"ceilometer-0\" (UID: \"c7074645-e78d-4933-be5c-73794d1106bd\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:03:13 crc kubenswrapper[5120]: I0316 16:03:13.392905 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c7074645-e78d-4933-be5c-73794d1106bd-scripts\") pod \"ceilometer-0\" (UID: \"c7074645-e78d-4933-be5c-73794d1106bd\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:03:13 crc kubenswrapper[5120]: I0316 16:03:13.393003 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c7074645-e78d-4933-be5c-73794d1106bd-log-httpd\") pod \"ceilometer-0\" (UID: \"c7074645-e78d-4933-be5c-73794d1106bd\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:03:13 crc kubenswrapper[5120]: I0316 16:03:13.393132 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c7074645-e78d-4933-be5c-73794d1106bd-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"c7074645-e78d-4933-be5c-73794d1106bd\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:03:13 crc kubenswrapper[5120]: I0316 16:03:13.393156 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c7074645-e78d-4933-be5c-73794d1106bd-run-httpd\") pod \"ceilometer-0\" (UID: \"c7074645-e78d-4933-be5c-73794d1106bd\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:03:13 crc kubenswrapper[5120]: I0316 16:03:13.393202 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c7074645-e78d-4933-be5c-73794d1106bd-config-data\") pod \"ceilometer-0\" (UID: \"c7074645-e78d-4933-be5c-73794d1106bd\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:03:13 crc kubenswrapper[5120]: I0316 16:03:13.393331 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/c7074645-e78d-4933-be5c-73794d1106bd-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"c7074645-e78d-4933-be5c-73794d1106bd\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:03:13 crc kubenswrapper[5120]: I0316 16:03:13.495178 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5nzh6\" (UniqueName: \"kubernetes.io/projected/c7074645-e78d-4933-be5c-73794d1106bd-kube-api-access-5nzh6\") pod \"ceilometer-0\" (UID: \"c7074645-e78d-4933-be5c-73794d1106bd\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:03:13 crc kubenswrapper[5120]: I0316 16:03:13.495249 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c7074645-e78d-4933-be5c-73794d1106bd-scripts\") pod \"ceilometer-0\" (UID: \"c7074645-e78d-4933-be5c-73794d1106bd\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:03:13 crc kubenswrapper[5120]: I0316 16:03:13.495336 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c7074645-e78d-4933-be5c-73794d1106bd-log-httpd\") pod \"ceilometer-0\" (UID: \"c7074645-e78d-4933-be5c-73794d1106bd\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:03:13 crc kubenswrapper[5120]: I0316 16:03:13.495427 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c7074645-e78d-4933-be5c-73794d1106bd-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"c7074645-e78d-4933-be5c-73794d1106bd\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:03:13 crc kubenswrapper[5120]: I0316 16:03:13.495451 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c7074645-e78d-4933-be5c-73794d1106bd-run-httpd\") pod \"ceilometer-0\" (UID: \"c7074645-e78d-4933-be5c-73794d1106bd\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:03:13 crc kubenswrapper[5120]: I0316 16:03:13.495477 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c7074645-e78d-4933-be5c-73794d1106bd-config-data\") pod \"ceilometer-0\" (UID: \"c7074645-e78d-4933-be5c-73794d1106bd\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:03:13 crc kubenswrapper[5120]: I0316 16:03:13.495519 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/c7074645-e78d-4933-be5c-73794d1106bd-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"c7074645-e78d-4933-be5c-73794d1106bd\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:03:13 crc kubenswrapper[5120]: I0316 16:03:13.495988 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c7074645-e78d-4933-be5c-73794d1106bd-log-httpd\") pod \"ceilometer-0\" (UID: \"c7074645-e78d-4933-be5c-73794d1106bd\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:03:13 crc kubenswrapper[5120]: I0316 16:03:13.496177 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c7074645-e78d-4933-be5c-73794d1106bd-run-httpd\") pod \"ceilometer-0\" (UID: \"c7074645-e78d-4933-be5c-73794d1106bd\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:03:13 crc kubenswrapper[5120]: I0316 16:03:13.501694 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/c7074645-e78d-4933-be5c-73794d1106bd-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"c7074645-e78d-4933-be5c-73794d1106bd\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:03:13 crc kubenswrapper[5120]: I0316 16:03:13.502164 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c7074645-e78d-4933-be5c-73794d1106bd-config-data\") pod \"ceilometer-0\" (UID: \"c7074645-e78d-4933-be5c-73794d1106bd\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:03:13 crc kubenswrapper[5120]: I0316 16:03:13.503074 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c7074645-e78d-4933-be5c-73794d1106bd-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"c7074645-e78d-4933-be5c-73794d1106bd\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:03:13 crc kubenswrapper[5120]: I0316 16:03:13.504426 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c7074645-e78d-4933-be5c-73794d1106bd-scripts\") pod \"ceilometer-0\" (UID: \"c7074645-e78d-4933-be5c-73794d1106bd\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:03:13 crc kubenswrapper[5120]: I0316 16:03:13.511521 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5nzh6\" (UniqueName: \"kubernetes.io/projected/c7074645-e78d-4933-be5c-73794d1106bd-kube-api-access-5nzh6\") pod \"ceilometer-0\" (UID: \"c7074645-e78d-4933-be5c-73794d1106bd\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:03:13 crc kubenswrapper[5120]: I0316 16:03:13.589355 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:03:14 crc kubenswrapper[5120]: W0316 16:03:14.101481 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc7074645_e78d_4933_be5c_73794d1106bd.slice/crio-30a4bda0a3413602f82dbc3c2666d92adaad40e51b1d38fdcc121b42270b6f72 WatchSource:0}: Error finding container 30a4bda0a3413602f82dbc3c2666d92adaad40e51b1d38fdcc121b42270b6f72: Status 404 returned error can't find the container with id 30a4bda0a3413602f82dbc3c2666d92adaad40e51b1d38fdcc121b42270b6f72 Mar 16 16:03:14 crc kubenswrapper[5120]: I0316 16:03:14.109114 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:03:14 crc kubenswrapper[5120]: I0316 16:03:14.152708 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"c7074645-e78d-4933-be5c-73794d1106bd","Type":"ContainerStarted","Data":"30a4bda0a3413602f82dbc3c2666d92adaad40e51b1d38fdcc121b42270b6f72"} Mar 16 16:03:14 crc kubenswrapper[5120]: I0316 16:03:14.682424 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="15543dd6-22d4-4a03-8bf6-1b418e1bc713" path="/var/lib/kubelet/pods/15543dd6-22d4-4a03-8bf6-1b418e1bc713/volumes" Mar 16 16:03:15 crc kubenswrapper[5120]: E0316 16:03:15.003004 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="4332146db136bb0f7c8338516ee5e78eea0c4e33906493f9ac0fc28c73e1b585" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:03:15 crc kubenswrapper[5120]: E0316 16:03:15.005298 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="4332146db136bb0f7c8338516ee5e78eea0c4e33906493f9ac0fc28c73e1b585" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:03:15 crc kubenswrapper[5120]: E0316 16:03:15.007208 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="4332146db136bb0f7c8338516ee5e78eea0c4e33906493f9ac0fc28c73e1b585" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:03:15 crc kubenswrapper[5120]: E0316 16:03:15.007282 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="45d21252-1b68-4533-9bb3-a6bc9f334171" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 16:03:15 crc kubenswrapper[5120]: I0316 16:03:15.167050 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"c7074645-e78d-4933-be5c-73794d1106bd","Type":"ContainerStarted","Data":"2bd8cf53f00f052811c78e3953630f40c7ca550347fc245d621bb1955325e8ce"} Mar 16 16:03:16 crc kubenswrapper[5120]: I0316 16:03:16.177951 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"c7074645-e78d-4933-be5c-73794d1106bd","Type":"ContainerStarted","Data":"62f205bdad16cfd54191dddc3b16af635c39e4d5ce04c1ae78ae1213c40e3a72"} Mar 16 16:03:17 crc kubenswrapper[5120]: I0316 16:03:17.217786 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"c7074645-e78d-4933-be5c-73794d1106bd","Type":"ContainerStarted","Data":"534587625eba93656024804d2c1250b989b7db5572239ba33a22f379ba68e1f8"} Mar 16 16:03:19 crc kubenswrapper[5120]: I0316 16:03:19.240660 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"c7074645-e78d-4933-be5c-73794d1106bd","Type":"ContainerStarted","Data":"c33302c795c6b15a25c20f73f77cbd503083a85173bf215e4193ea42caa789ac"} Mar 16 16:03:19 crc kubenswrapper[5120]: I0316 16:03:19.241366 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:03:19 crc kubenswrapper[5120]: I0316 16:03:19.278182 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=1.579003033 podStartE2EDuration="6.278156786s" podCreationTimestamp="2026-03-16 16:03:13 +0000 UTC" firstStartedPulling="2026-03-16 16:03:14.10398061 +0000 UTC m=+1896.257912277" lastFinishedPulling="2026-03-16 16:03:18.803134363 +0000 UTC m=+1900.957066030" observedRunningTime="2026-03-16 16:03:19.267794991 +0000 UTC m=+1901.421726648" watchObservedRunningTime="2026-03-16 16:03:19.278156786 +0000 UTC m=+1901.432088473" Mar 16 16:03:19 crc kubenswrapper[5120]: I0316 16:03:19.361708 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:03:20 crc kubenswrapper[5120]: E0316 16:03:20.003525 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="4332146db136bb0f7c8338516ee5e78eea0c4e33906493f9ac0fc28c73e1b585" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:03:20 crc kubenswrapper[5120]: E0316 16:03:20.005667 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="4332146db136bb0f7c8338516ee5e78eea0c4e33906493f9ac0fc28c73e1b585" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:03:20 crc kubenswrapper[5120]: E0316 16:03:20.007031 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="4332146db136bb0f7c8338516ee5e78eea0c4e33906493f9ac0fc28c73e1b585" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:03:20 crc kubenswrapper[5120]: E0316 16:03:20.007090 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="45d21252-1b68-4533-9bb3-a6bc9f334171" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 16:03:21 crc kubenswrapper[5120]: I0316 16:03:21.263866 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="c7074645-e78d-4933-be5c-73794d1106bd" containerName="proxy-httpd" containerID="cri-o://c33302c795c6b15a25c20f73f77cbd503083a85173bf215e4193ea42caa789ac" gracePeriod=30 Mar 16 16:03:21 crc kubenswrapper[5120]: I0316 16:03:21.263866 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="c7074645-e78d-4933-be5c-73794d1106bd" containerName="sg-core" containerID="cri-o://534587625eba93656024804d2c1250b989b7db5572239ba33a22f379ba68e1f8" gracePeriod=30 Mar 16 16:03:21 crc kubenswrapper[5120]: I0316 16:03:21.263952 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="c7074645-e78d-4933-be5c-73794d1106bd" containerName="ceilometer-notification-agent" containerID="cri-o://62f205bdad16cfd54191dddc3b16af635c39e4d5ce04c1ae78ae1213c40e3a72" gracePeriod=30 Mar 16 16:03:21 crc kubenswrapper[5120]: I0316 16:03:21.264102 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="c7074645-e78d-4933-be5c-73794d1106bd" containerName="ceilometer-central-agent" containerID="cri-o://2bd8cf53f00f052811c78e3953630f40c7ca550347fc245d621bb1955325e8ce" gracePeriod=30 Mar 16 16:03:22 crc kubenswrapper[5120]: I0316 16:03:22.082140 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:03:22 crc kubenswrapper[5120]: I0316 16:03:22.203188 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5nzh6\" (UniqueName: \"kubernetes.io/projected/c7074645-e78d-4933-be5c-73794d1106bd-kube-api-access-5nzh6\") pod \"c7074645-e78d-4933-be5c-73794d1106bd\" (UID: \"c7074645-e78d-4933-be5c-73794d1106bd\") " Mar 16 16:03:22 crc kubenswrapper[5120]: I0316 16:03:22.203326 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c7074645-e78d-4933-be5c-73794d1106bd-scripts\") pod \"c7074645-e78d-4933-be5c-73794d1106bd\" (UID: \"c7074645-e78d-4933-be5c-73794d1106bd\") " Mar 16 16:03:22 crc kubenswrapper[5120]: I0316 16:03:22.203351 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/c7074645-e78d-4933-be5c-73794d1106bd-sg-core-conf-yaml\") pod \"c7074645-e78d-4933-be5c-73794d1106bd\" (UID: \"c7074645-e78d-4933-be5c-73794d1106bd\") " Mar 16 16:03:22 crc kubenswrapper[5120]: I0316 16:03:22.203452 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c7074645-e78d-4933-be5c-73794d1106bd-log-httpd\") pod \"c7074645-e78d-4933-be5c-73794d1106bd\" (UID: \"c7074645-e78d-4933-be5c-73794d1106bd\") " Mar 16 16:03:22 crc kubenswrapper[5120]: I0316 16:03:22.203613 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c7074645-e78d-4933-be5c-73794d1106bd-combined-ca-bundle\") pod \"c7074645-e78d-4933-be5c-73794d1106bd\" (UID: \"c7074645-e78d-4933-be5c-73794d1106bd\") " Mar 16 16:03:22 crc kubenswrapper[5120]: I0316 16:03:22.203656 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c7074645-e78d-4933-be5c-73794d1106bd-run-httpd\") pod \"c7074645-e78d-4933-be5c-73794d1106bd\" (UID: \"c7074645-e78d-4933-be5c-73794d1106bd\") " Mar 16 16:03:22 crc kubenswrapper[5120]: I0316 16:03:22.203726 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c7074645-e78d-4933-be5c-73794d1106bd-config-data\") pod \"c7074645-e78d-4933-be5c-73794d1106bd\" (UID: \"c7074645-e78d-4933-be5c-73794d1106bd\") " Mar 16 16:03:22 crc kubenswrapper[5120]: I0316 16:03:22.204187 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7074645-e78d-4933-be5c-73794d1106bd-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "c7074645-e78d-4933-be5c-73794d1106bd" (UID: "c7074645-e78d-4933-be5c-73794d1106bd"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:03:22 crc kubenswrapper[5120]: I0316 16:03:22.204211 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7074645-e78d-4933-be5c-73794d1106bd-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "c7074645-e78d-4933-be5c-73794d1106bd" (UID: "c7074645-e78d-4933-be5c-73794d1106bd"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:03:22 crc kubenswrapper[5120]: I0316 16:03:22.204452 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c7074645-e78d-4933-be5c-73794d1106bd-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:03:22 crc kubenswrapper[5120]: I0316 16:03:22.204479 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c7074645-e78d-4933-be5c-73794d1106bd-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:03:22 crc kubenswrapper[5120]: I0316 16:03:22.210061 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7074645-e78d-4933-be5c-73794d1106bd-kube-api-access-5nzh6" (OuterVolumeSpecName: "kube-api-access-5nzh6") pod "c7074645-e78d-4933-be5c-73794d1106bd" (UID: "c7074645-e78d-4933-be5c-73794d1106bd"). InnerVolumeSpecName "kube-api-access-5nzh6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:03:22 crc kubenswrapper[5120]: I0316 16:03:22.210277 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c7074645-e78d-4933-be5c-73794d1106bd-scripts" (OuterVolumeSpecName: "scripts") pod "c7074645-e78d-4933-be5c-73794d1106bd" (UID: "c7074645-e78d-4933-be5c-73794d1106bd"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:03:22 crc kubenswrapper[5120]: I0316 16:03:22.235715 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c7074645-e78d-4933-be5c-73794d1106bd-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "c7074645-e78d-4933-be5c-73794d1106bd" (UID: "c7074645-e78d-4933-be5c-73794d1106bd"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:03:22 crc kubenswrapper[5120]: I0316 16:03:22.275088 5120 generic.go:358] "Generic (PLEG): container finished" podID="c7074645-e78d-4933-be5c-73794d1106bd" containerID="c33302c795c6b15a25c20f73f77cbd503083a85173bf215e4193ea42caa789ac" exitCode=0 Mar 16 16:03:22 crc kubenswrapper[5120]: I0316 16:03:22.275122 5120 generic.go:358] "Generic (PLEG): container finished" podID="c7074645-e78d-4933-be5c-73794d1106bd" containerID="534587625eba93656024804d2c1250b989b7db5572239ba33a22f379ba68e1f8" exitCode=2 Mar 16 16:03:22 crc kubenswrapper[5120]: I0316 16:03:22.275132 5120 generic.go:358] "Generic (PLEG): container finished" podID="c7074645-e78d-4933-be5c-73794d1106bd" containerID="62f205bdad16cfd54191dddc3b16af635c39e4d5ce04c1ae78ae1213c40e3a72" exitCode=0 Mar 16 16:03:22 crc kubenswrapper[5120]: I0316 16:03:22.275143 5120 generic.go:358] "Generic (PLEG): container finished" podID="c7074645-e78d-4933-be5c-73794d1106bd" containerID="2bd8cf53f00f052811c78e3953630f40c7ca550347fc245d621bb1955325e8ce" exitCode=0 Mar 16 16:03:22 crc kubenswrapper[5120]: I0316 16:03:22.275177 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:03:22 crc kubenswrapper[5120]: I0316 16:03:22.275168 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"c7074645-e78d-4933-be5c-73794d1106bd","Type":"ContainerDied","Data":"c33302c795c6b15a25c20f73f77cbd503083a85173bf215e4193ea42caa789ac"} Mar 16 16:03:22 crc kubenswrapper[5120]: I0316 16:03:22.275317 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"c7074645-e78d-4933-be5c-73794d1106bd","Type":"ContainerDied","Data":"534587625eba93656024804d2c1250b989b7db5572239ba33a22f379ba68e1f8"} Mar 16 16:03:22 crc kubenswrapper[5120]: I0316 16:03:22.275333 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"c7074645-e78d-4933-be5c-73794d1106bd","Type":"ContainerDied","Data":"62f205bdad16cfd54191dddc3b16af635c39e4d5ce04c1ae78ae1213c40e3a72"} Mar 16 16:03:22 crc kubenswrapper[5120]: I0316 16:03:22.275348 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"c7074645-e78d-4933-be5c-73794d1106bd","Type":"ContainerDied","Data":"2bd8cf53f00f052811c78e3953630f40c7ca550347fc245d621bb1955325e8ce"} Mar 16 16:03:22 crc kubenswrapper[5120]: I0316 16:03:22.275360 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"c7074645-e78d-4933-be5c-73794d1106bd","Type":"ContainerDied","Data":"30a4bda0a3413602f82dbc3c2666d92adaad40e51b1d38fdcc121b42270b6f72"} Mar 16 16:03:22 crc kubenswrapper[5120]: I0316 16:03:22.275379 5120 scope.go:117] "RemoveContainer" containerID="c33302c795c6b15a25c20f73f77cbd503083a85173bf215e4193ea42caa789ac" Mar 16 16:03:22 crc kubenswrapper[5120]: I0316 16:03:22.282012 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c7074645-e78d-4933-be5c-73794d1106bd-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "c7074645-e78d-4933-be5c-73794d1106bd" (UID: "c7074645-e78d-4933-be5c-73794d1106bd"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:03:22 crc kubenswrapper[5120]: I0316 16:03:22.294697 5120 scope.go:117] "RemoveContainer" containerID="534587625eba93656024804d2c1250b989b7db5572239ba33a22f379ba68e1f8" Mar 16 16:03:22 crc kubenswrapper[5120]: I0316 16:03:22.306901 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5nzh6\" (UniqueName: \"kubernetes.io/projected/c7074645-e78d-4933-be5c-73794d1106bd-kube-api-access-5nzh6\") on node \"crc\" DevicePath \"\"" Mar 16 16:03:22 crc kubenswrapper[5120]: I0316 16:03:22.306950 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c7074645-e78d-4933-be5c-73794d1106bd-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:03:22 crc kubenswrapper[5120]: I0316 16:03:22.306961 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/c7074645-e78d-4933-be5c-73794d1106bd-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 16:03:22 crc kubenswrapper[5120]: I0316 16:03:22.306969 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c7074645-e78d-4933-be5c-73794d1106bd-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:03:22 crc kubenswrapper[5120]: I0316 16:03:22.316906 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c7074645-e78d-4933-be5c-73794d1106bd-config-data" (OuterVolumeSpecName: "config-data") pod "c7074645-e78d-4933-be5c-73794d1106bd" (UID: "c7074645-e78d-4933-be5c-73794d1106bd"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:03:22 crc kubenswrapper[5120]: I0316 16:03:22.336966 5120 scope.go:117] "RemoveContainer" containerID="62f205bdad16cfd54191dddc3b16af635c39e4d5ce04c1ae78ae1213c40e3a72" Mar 16 16:03:22 crc kubenswrapper[5120]: I0316 16:03:22.369508 5120 scope.go:117] "RemoveContainer" containerID="2bd8cf53f00f052811c78e3953630f40c7ca550347fc245d621bb1955325e8ce" Mar 16 16:03:22 crc kubenswrapper[5120]: I0316 16:03:22.398032 5120 scope.go:117] "RemoveContainer" containerID="c33302c795c6b15a25c20f73f77cbd503083a85173bf215e4193ea42caa789ac" Mar 16 16:03:22 crc kubenswrapper[5120]: E0316 16:03:22.398662 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c33302c795c6b15a25c20f73f77cbd503083a85173bf215e4193ea42caa789ac\": container with ID starting with c33302c795c6b15a25c20f73f77cbd503083a85173bf215e4193ea42caa789ac not found: ID does not exist" containerID="c33302c795c6b15a25c20f73f77cbd503083a85173bf215e4193ea42caa789ac" Mar 16 16:03:22 crc kubenswrapper[5120]: I0316 16:03:22.398702 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c33302c795c6b15a25c20f73f77cbd503083a85173bf215e4193ea42caa789ac"} err="failed to get container status \"c33302c795c6b15a25c20f73f77cbd503083a85173bf215e4193ea42caa789ac\": rpc error: code = NotFound desc = could not find container \"c33302c795c6b15a25c20f73f77cbd503083a85173bf215e4193ea42caa789ac\": container with ID starting with c33302c795c6b15a25c20f73f77cbd503083a85173bf215e4193ea42caa789ac not found: ID does not exist" Mar 16 16:03:22 crc kubenswrapper[5120]: I0316 16:03:22.398723 5120 scope.go:117] "RemoveContainer" containerID="534587625eba93656024804d2c1250b989b7db5572239ba33a22f379ba68e1f8" Mar 16 16:03:22 crc kubenswrapper[5120]: E0316 16:03:22.399234 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"534587625eba93656024804d2c1250b989b7db5572239ba33a22f379ba68e1f8\": container with ID starting with 534587625eba93656024804d2c1250b989b7db5572239ba33a22f379ba68e1f8 not found: ID does not exist" containerID="534587625eba93656024804d2c1250b989b7db5572239ba33a22f379ba68e1f8" Mar 16 16:03:22 crc kubenswrapper[5120]: I0316 16:03:22.399290 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"534587625eba93656024804d2c1250b989b7db5572239ba33a22f379ba68e1f8"} err="failed to get container status \"534587625eba93656024804d2c1250b989b7db5572239ba33a22f379ba68e1f8\": rpc error: code = NotFound desc = could not find container \"534587625eba93656024804d2c1250b989b7db5572239ba33a22f379ba68e1f8\": container with ID starting with 534587625eba93656024804d2c1250b989b7db5572239ba33a22f379ba68e1f8 not found: ID does not exist" Mar 16 16:03:22 crc kubenswrapper[5120]: I0316 16:03:22.399322 5120 scope.go:117] "RemoveContainer" containerID="62f205bdad16cfd54191dddc3b16af635c39e4d5ce04c1ae78ae1213c40e3a72" Mar 16 16:03:22 crc kubenswrapper[5120]: E0316 16:03:22.399653 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"62f205bdad16cfd54191dddc3b16af635c39e4d5ce04c1ae78ae1213c40e3a72\": container with ID starting with 62f205bdad16cfd54191dddc3b16af635c39e4d5ce04c1ae78ae1213c40e3a72 not found: ID does not exist" containerID="62f205bdad16cfd54191dddc3b16af635c39e4d5ce04c1ae78ae1213c40e3a72" Mar 16 16:03:22 crc kubenswrapper[5120]: I0316 16:03:22.399677 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62f205bdad16cfd54191dddc3b16af635c39e4d5ce04c1ae78ae1213c40e3a72"} err="failed to get container status \"62f205bdad16cfd54191dddc3b16af635c39e4d5ce04c1ae78ae1213c40e3a72\": rpc error: code = NotFound desc = could not find container \"62f205bdad16cfd54191dddc3b16af635c39e4d5ce04c1ae78ae1213c40e3a72\": container with ID starting with 62f205bdad16cfd54191dddc3b16af635c39e4d5ce04c1ae78ae1213c40e3a72 not found: ID does not exist" Mar 16 16:03:22 crc kubenswrapper[5120]: I0316 16:03:22.399691 5120 scope.go:117] "RemoveContainer" containerID="2bd8cf53f00f052811c78e3953630f40c7ca550347fc245d621bb1955325e8ce" Mar 16 16:03:22 crc kubenswrapper[5120]: E0316 16:03:22.400122 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2bd8cf53f00f052811c78e3953630f40c7ca550347fc245d621bb1955325e8ce\": container with ID starting with 2bd8cf53f00f052811c78e3953630f40c7ca550347fc245d621bb1955325e8ce not found: ID does not exist" containerID="2bd8cf53f00f052811c78e3953630f40c7ca550347fc245d621bb1955325e8ce" Mar 16 16:03:22 crc kubenswrapper[5120]: I0316 16:03:22.400144 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2bd8cf53f00f052811c78e3953630f40c7ca550347fc245d621bb1955325e8ce"} err="failed to get container status \"2bd8cf53f00f052811c78e3953630f40c7ca550347fc245d621bb1955325e8ce\": rpc error: code = NotFound desc = could not find container \"2bd8cf53f00f052811c78e3953630f40c7ca550347fc245d621bb1955325e8ce\": container with ID starting with 2bd8cf53f00f052811c78e3953630f40c7ca550347fc245d621bb1955325e8ce not found: ID does not exist" Mar 16 16:03:22 crc kubenswrapper[5120]: I0316 16:03:22.400157 5120 scope.go:117] "RemoveContainer" containerID="c33302c795c6b15a25c20f73f77cbd503083a85173bf215e4193ea42caa789ac" Mar 16 16:03:22 crc kubenswrapper[5120]: I0316 16:03:22.400481 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c33302c795c6b15a25c20f73f77cbd503083a85173bf215e4193ea42caa789ac"} err="failed to get container status \"c33302c795c6b15a25c20f73f77cbd503083a85173bf215e4193ea42caa789ac\": rpc error: code = NotFound desc = could not find container \"c33302c795c6b15a25c20f73f77cbd503083a85173bf215e4193ea42caa789ac\": container with ID starting with c33302c795c6b15a25c20f73f77cbd503083a85173bf215e4193ea42caa789ac not found: ID does not exist" Mar 16 16:03:22 crc kubenswrapper[5120]: I0316 16:03:22.400494 5120 scope.go:117] "RemoveContainer" containerID="534587625eba93656024804d2c1250b989b7db5572239ba33a22f379ba68e1f8" Mar 16 16:03:22 crc kubenswrapper[5120]: I0316 16:03:22.400817 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"534587625eba93656024804d2c1250b989b7db5572239ba33a22f379ba68e1f8"} err="failed to get container status \"534587625eba93656024804d2c1250b989b7db5572239ba33a22f379ba68e1f8\": rpc error: code = NotFound desc = could not find container \"534587625eba93656024804d2c1250b989b7db5572239ba33a22f379ba68e1f8\": container with ID starting with 534587625eba93656024804d2c1250b989b7db5572239ba33a22f379ba68e1f8 not found: ID does not exist" Mar 16 16:03:22 crc kubenswrapper[5120]: I0316 16:03:22.400835 5120 scope.go:117] "RemoveContainer" containerID="62f205bdad16cfd54191dddc3b16af635c39e4d5ce04c1ae78ae1213c40e3a72" Mar 16 16:03:22 crc kubenswrapper[5120]: I0316 16:03:22.401515 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62f205bdad16cfd54191dddc3b16af635c39e4d5ce04c1ae78ae1213c40e3a72"} err="failed to get container status \"62f205bdad16cfd54191dddc3b16af635c39e4d5ce04c1ae78ae1213c40e3a72\": rpc error: code = NotFound desc = could not find container \"62f205bdad16cfd54191dddc3b16af635c39e4d5ce04c1ae78ae1213c40e3a72\": container with ID starting with 62f205bdad16cfd54191dddc3b16af635c39e4d5ce04c1ae78ae1213c40e3a72 not found: ID does not exist" Mar 16 16:03:22 crc kubenswrapper[5120]: I0316 16:03:22.401702 5120 scope.go:117] "RemoveContainer" containerID="2bd8cf53f00f052811c78e3953630f40c7ca550347fc245d621bb1955325e8ce" Mar 16 16:03:22 crc kubenswrapper[5120]: I0316 16:03:22.402170 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2bd8cf53f00f052811c78e3953630f40c7ca550347fc245d621bb1955325e8ce"} err="failed to get container status \"2bd8cf53f00f052811c78e3953630f40c7ca550347fc245d621bb1955325e8ce\": rpc error: code = NotFound desc = could not find container \"2bd8cf53f00f052811c78e3953630f40c7ca550347fc245d621bb1955325e8ce\": container with ID starting with 2bd8cf53f00f052811c78e3953630f40c7ca550347fc245d621bb1955325e8ce not found: ID does not exist" Mar 16 16:03:22 crc kubenswrapper[5120]: I0316 16:03:22.402190 5120 scope.go:117] "RemoveContainer" containerID="c33302c795c6b15a25c20f73f77cbd503083a85173bf215e4193ea42caa789ac" Mar 16 16:03:22 crc kubenswrapper[5120]: I0316 16:03:22.402549 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c33302c795c6b15a25c20f73f77cbd503083a85173bf215e4193ea42caa789ac"} err="failed to get container status \"c33302c795c6b15a25c20f73f77cbd503083a85173bf215e4193ea42caa789ac\": rpc error: code = NotFound desc = could not find container \"c33302c795c6b15a25c20f73f77cbd503083a85173bf215e4193ea42caa789ac\": container with ID starting with c33302c795c6b15a25c20f73f77cbd503083a85173bf215e4193ea42caa789ac not found: ID does not exist" Mar 16 16:03:22 crc kubenswrapper[5120]: I0316 16:03:22.402563 5120 scope.go:117] "RemoveContainer" containerID="534587625eba93656024804d2c1250b989b7db5572239ba33a22f379ba68e1f8" Mar 16 16:03:22 crc kubenswrapper[5120]: I0316 16:03:22.402913 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"534587625eba93656024804d2c1250b989b7db5572239ba33a22f379ba68e1f8"} err="failed to get container status \"534587625eba93656024804d2c1250b989b7db5572239ba33a22f379ba68e1f8\": rpc error: code = NotFound desc = could not find container \"534587625eba93656024804d2c1250b989b7db5572239ba33a22f379ba68e1f8\": container with ID starting with 534587625eba93656024804d2c1250b989b7db5572239ba33a22f379ba68e1f8 not found: ID does not exist" Mar 16 16:03:22 crc kubenswrapper[5120]: I0316 16:03:22.402926 5120 scope.go:117] "RemoveContainer" containerID="62f205bdad16cfd54191dddc3b16af635c39e4d5ce04c1ae78ae1213c40e3a72" Mar 16 16:03:22 crc kubenswrapper[5120]: I0316 16:03:22.403210 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62f205bdad16cfd54191dddc3b16af635c39e4d5ce04c1ae78ae1213c40e3a72"} err="failed to get container status \"62f205bdad16cfd54191dddc3b16af635c39e4d5ce04c1ae78ae1213c40e3a72\": rpc error: code = NotFound desc = could not find container \"62f205bdad16cfd54191dddc3b16af635c39e4d5ce04c1ae78ae1213c40e3a72\": container with ID starting with 62f205bdad16cfd54191dddc3b16af635c39e4d5ce04c1ae78ae1213c40e3a72 not found: ID does not exist" Mar 16 16:03:22 crc kubenswrapper[5120]: I0316 16:03:22.403223 5120 scope.go:117] "RemoveContainer" containerID="2bd8cf53f00f052811c78e3953630f40c7ca550347fc245d621bb1955325e8ce" Mar 16 16:03:22 crc kubenswrapper[5120]: I0316 16:03:22.403467 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2bd8cf53f00f052811c78e3953630f40c7ca550347fc245d621bb1955325e8ce"} err="failed to get container status \"2bd8cf53f00f052811c78e3953630f40c7ca550347fc245d621bb1955325e8ce\": rpc error: code = NotFound desc = could not find container \"2bd8cf53f00f052811c78e3953630f40c7ca550347fc245d621bb1955325e8ce\": container with ID starting with 2bd8cf53f00f052811c78e3953630f40c7ca550347fc245d621bb1955325e8ce not found: ID does not exist" Mar 16 16:03:22 crc kubenswrapper[5120]: I0316 16:03:22.403478 5120 scope.go:117] "RemoveContainer" containerID="c33302c795c6b15a25c20f73f77cbd503083a85173bf215e4193ea42caa789ac" Mar 16 16:03:22 crc kubenswrapper[5120]: I0316 16:03:22.403717 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c33302c795c6b15a25c20f73f77cbd503083a85173bf215e4193ea42caa789ac"} err="failed to get container status \"c33302c795c6b15a25c20f73f77cbd503083a85173bf215e4193ea42caa789ac\": rpc error: code = NotFound desc = could not find container \"c33302c795c6b15a25c20f73f77cbd503083a85173bf215e4193ea42caa789ac\": container with ID starting with c33302c795c6b15a25c20f73f77cbd503083a85173bf215e4193ea42caa789ac not found: ID does not exist" Mar 16 16:03:22 crc kubenswrapper[5120]: I0316 16:03:22.403731 5120 scope.go:117] "RemoveContainer" containerID="534587625eba93656024804d2c1250b989b7db5572239ba33a22f379ba68e1f8" Mar 16 16:03:22 crc kubenswrapper[5120]: I0316 16:03:22.404016 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"534587625eba93656024804d2c1250b989b7db5572239ba33a22f379ba68e1f8"} err="failed to get container status \"534587625eba93656024804d2c1250b989b7db5572239ba33a22f379ba68e1f8\": rpc error: code = NotFound desc = could not find container \"534587625eba93656024804d2c1250b989b7db5572239ba33a22f379ba68e1f8\": container with ID starting with 534587625eba93656024804d2c1250b989b7db5572239ba33a22f379ba68e1f8 not found: ID does not exist" Mar 16 16:03:22 crc kubenswrapper[5120]: I0316 16:03:22.404031 5120 scope.go:117] "RemoveContainer" containerID="62f205bdad16cfd54191dddc3b16af635c39e4d5ce04c1ae78ae1213c40e3a72" Mar 16 16:03:22 crc kubenswrapper[5120]: I0316 16:03:22.404333 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62f205bdad16cfd54191dddc3b16af635c39e4d5ce04c1ae78ae1213c40e3a72"} err="failed to get container status \"62f205bdad16cfd54191dddc3b16af635c39e4d5ce04c1ae78ae1213c40e3a72\": rpc error: code = NotFound desc = could not find container \"62f205bdad16cfd54191dddc3b16af635c39e4d5ce04c1ae78ae1213c40e3a72\": container with ID starting with 62f205bdad16cfd54191dddc3b16af635c39e4d5ce04c1ae78ae1213c40e3a72 not found: ID does not exist" Mar 16 16:03:22 crc kubenswrapper[5120]: I0316 16:03:22.404347 5120 scope.go:117] "RemoveContainer" containerID="2bd8cf53f00f052811c78e3953630f40c7ca550347fc245d621bb1955325e8ce" Mar 16 16:03:22 crc kubenswrapper[5120]: I0316 16:03:22.405487 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2bd8cf53f00f052811c78e3953630f40c7ca550347fc245d621bb1955325e8ce"} err="failed to get container status \"2bd8cf53f00f052811c78e3953630f40c7ca550347fc245d621bb1955325e8ce\": rpc error: code = NotFound desc = could not find container \"2bd8cf53f00f052811c78e3953630f40c7ca550347fc245d621bb1955325e8ce\": container with ID starting with 2bd8cf53f00f052811c78e3953630f40c7ca550347fc245d621bb1955325e8ce not found: ID does not exist" Mar 16 16:03:22 crc kubenswrapper[5120]: I0316 16:03:22.408908 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c7074645-e78d-4933-be5c-73794d1106bd-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:03:22 crc kubenswrapper[5120]: I0316 16:03:22.619556 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:03:22 crc kubenswrapper[5120]: I0316 16:03:22.631849 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:03:22 crc kubenswrapper[5120]: I0316 16:03:22.645062 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:03:22 crc kubenswrapper[5120]: I0316 16:03:22.646175 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7074645-e78d-4933-be5c-73794d1106bd" containerName="ceilometer-notification-agent" Mar 16 16:03:22 crc kubenswrapper[5120]: I0316 16:03:22.646251 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7074645-e78d-4933-be5c-73794d1106bd" containerName="ceilometer-notification-agent" Mar 16 16:03:22 crc kubenswrapper[5120]: I0316 16:03:22.646355 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7074645-e78d-4933-be5c-73794d1106bd" containerName="sg-core" Mar 16 16:03:22 crc kubenswrapper[5120]: I0316 16:03:22.646411 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7074645-e78d-4933-be5c-73794d1106bd" containerName="sg-core" Mar 16 16:03:22 crc kubenswrapper[5120]: I0316 16:03:22.646488 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7074645-e78d-4933-be5c-73794d1106bd" containerName="proxy-httpd" Mar 16 16:03:22 crc kubenswrapper[5120]: I0316 16:03:22.646558 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7074645-e78d-4933-be5c-73794d1106bd" containerName="proxy-httpd" Mar 16 16:03:22 crc kubenswrapper[5120]: I0316 16:03:22.646631 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7074645-e78d-4933-be5c-73794d1106bd" containerName="ceilometer-central-agent" Mar 16 16:03:22 crc kubenswrapper[5120]: I0316 16:03:22.646695 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7074645-e78d-4933-be5c-73794d1106bd" containerName="ceilometer-central-agent" Mar 16 16:03:22 crc kubenswrapper[5120]: I0316 16:03:22.646914 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c7074645-e78d-4933-be5c-73794d1106bd" containerName="proxy-httpd" Mar 16 16:03:22 crc kubenswrapper[5120]: I0316 16:03:22.646983 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c7074645-e78d-4933-be5c-73794d1106bd" containerName="ceilometer-central-agent" Mar 16 16:03:22 crc kubenswrapper[5120]: I0316 16:03:22.647042 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c7074645-e78d-4933-be5c-73794d1106bd" containerName="ceilometer-notification-agent" Mar 16 16:03:22 crc kubenswrapper[5120]: I0316 16:03:22.647113 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c7074645-e78d-4933-be5c-73794d1106bd" containerName="sg-core" Mar 16 16:03:22 crc kubenswrapper[5120]: I0316 16:03:22.657210 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:03:22 crc kubenswrapper[5120]: I0316 16:03:22.659776 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 16:03:22 crc kubenswrapper[5120]: I0316 16:03:22.660054 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 16:03:22 crc kubenswrapper[5120]: I0316 16:03:22.690183 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c7074645-e78d-4933-be5c-73794d1106bd" path="/var/lib/kubelet/pods/c7074645-e78d-4933-be5c-73794d1106bd/volumes" Mar 16 16:03:22 crc kubenswrapper[5120]: I0316 16:03:22.691529 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:03:22 crc kubenswrapper[5120]: I0316 16:03:22.713446 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/89a42fd0-da54-467f-9a6f-7c9d6616f659-run-httpd\") pod \"ceilometer-0\" (UID: \"89a42fd0-da54-467f-9a6f-7c9d6616f659\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:03:22 crc kubenswrapper[5120]: I0316 16:03:22.713487 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/89a42fd0-da54-467f-9a6f-7c9d6616f659-scripts\") pod \"ceilometer-0\" (UID: \"89a42fd0-da54-467f-9a6f-7c9d6616f659\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:03:22 crc kubenswrapper[5120]: I0316 16:03:22.713580 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/89a42fd0-da54-467f-9a6f-7c9d6616f659-config-data\") pod \"ceilometer-0\" (UID: \"89a42fd0-da54-467f-9a6f-7c9d6616f659\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:03:22 crc kubenswrapper[5120]: I0316 16:03:22.713598 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdbnq\" (UniqueName: \"kubernetes.io/projected/89a42fd0-da54-467f-9a6f-7c9d6616f659-kube-api-access-qdbnq\") pod \"ceilometer-0\" (UID: \"89a42fd0-da54-467f-9a6f-7c9d6616f659\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:03:22 crc kubenswrapper[5120]: I0316 16:03:22.713869 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/89a42fd0-da54-467f-9a6f-7c9d6616f659-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"89a42fd0-da54-467f-9a6f-7c9d6616f659\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:03:22 crc kubenswrapper[5120]: I0316 16:03:22.714013 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/89a42fd0-da54-467f-9a6f-7c9d6616f659-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"89a42fd0-da54-467f-9a6f-7c9d6616f659\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:03:22 crc kubenswrapper[5120]: I0316 16:03:22.714320 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/89a42fd0-da54-467f-9a6f-7c9d6616f659-log-httpd\") pod \"ceilometer-0\" (UID: \"89a42fd0-da54-467f-9a6f-7c9d6616f659\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:03:22 crc kubenswrapper[5120]: I0316 16:03:22.815955 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/89a42fd0-da54-467f-9a6f-7c9d6616f659-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"89a42fd0-da54-467f-9a6f-7c9d6616f659\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:03:22 crc kubenswrapper[5120]: I0316 16:03:22.816033 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/89a42fd0-da54-467f-9a6f-7c9d6616f659-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"89a42fd0-da54-467f-9a6f-7c9d6616f659\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:03:22 crc kubenswrapper[5120]: I0316 16:03:22.816160 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/89a42fd0-da54-467f-9a6f-7c9d6616f659-log-httpd\") pod \"ceilometer-0\" (UID: \"89a42fd0-da54-467f-9a6f-7c9d6616f659\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:03:22 crc kubenswrapper[5120]: I0316 16:03:22.816212 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/89a42fd0-da54-467f-9a6f-7c9d6616f659-run-httpd\") pod \"ceilometer-0\" (UID: \"89a42fd0-da54-467f-9a6f-7c9d6616f659\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:03:22 crc kubenswrapper[5120]: I0316 16:03:22.816242 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/89a42fd0-da54-467f-9a6f-7c9d6616f659-scripts\") pod \"ceilometer-0\" (UID: \"89a42fd0-da54-467f-9a6f-7c9d6616f659\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:03:22 crc kubenswrapper[5120]: I0316 16:03:22.816321 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/89a42fd0-da54-467f-9a6f-7c9d6616f659-config-data\") pod \"ceilometer-0\" (UID: \"89a42fd0-da54-467f-9a6f-7c9d6616f659\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:03:22 crc kubenswrapper[5120]: I0316 16:03:22.816343 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qdbnq\" (UniqueName: \"kubernetes.io/projected/89a42fd0-da54-467f-9a6f-7c9d6616f659-kube-api-access-qdbnq\") pod \"ceilometer-0\" (UID: \"89a42fd0-da54-467f-9a6f-7c9d6616f659\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:03:22 crc kubenswrapper[5120]: I0316 16:03:22.817506 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/89a42fd0-da54-467f-9a6f-7c9d6616f659-log-httpd\") pod \"ceilometer-0\" (UID: \"89a42fd0-da54-467f-9a6f-7c9d6616f659\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:03:22 crc kubenswrapper[5120]: I0316 16:03:22.817809 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/89a42fd0-da54-467f-9a6f-7c9d6616f659-run-httpd\") pod \"ceilometer-0\" (UID: \"89a42fd0-da54-467f-9a6f-7c9d6616f659\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:03:22 crc kubenswrapper[5120]: I0316 16:03:22.822711 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/89a42fd0-da54-467f-9a6f-7c9d6616f659-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"89a42fd0-da54-467f-9a6f-7c9d6616f659\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:03:22 crc kubenswrapper[5120]: I0316 16:03:22.823413 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/89a42fd0-da54-467f-9a6f-7c9d6616f659-scripts\") pod \"ceilometer-0\" (UID: \"89a42fd0-da54-467f-9a6f-7c9d6616f659\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:03:22 crc kubenswrapper[5120]: I0316 16:03:22.824049 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/89a42fd0-da54-467f-9a6f-7c9d6616f659-config-data\") pod \"ceilometer-0\" (UID: \"89a42fd0-da54-467f-9a6f-7c9d6616f659\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:03:22 crc kubenswrapper[5120]: I0316 16:03:22.830080 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/89a42fd0-da54-467f-9a6f-7c9d6616f659-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"89a42fd0-da54-467f-9a6f-7c9d6616f659\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:03:22 crc kubenswrapper[5120]: I0316 16:03:22.857561 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdbnq\" (UniqueName: \"kubernetes.io/projected/89a42fd0-da54-467f-9a6f-7c9d6616f659-kube-api-access-qdbnq\") pod \"ceilometer-0\" (UID: \"89a42fd0-da54-467f-9a6f-7c9d6616f659\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:03:22 crc kubenswrapper[5120]: I0316 16:03:22.997321 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:03:23 crc kubenswrapper[5120]: W0316 16:03:23.503690 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod89a42fd0_da54_467f_9a6f_7c9d6616f659.slice/crio-63c03030710dbe0f7430a38b52f6cf074ec47eca1fec50106cb27897a8bf299d WatchSource:0}: Error finding container 63c03030710dbe0f7430a38b52f6cf074ec47eca1fec50106cb27897a8bf299d: Status 404 returned error can't find the container with id 63c03030710dbe0f7430a38b52f6cf074ec47eca1fec50106cb27897a8bf299d Mar 16 16:03:23 crc kubenswrapper[5120]: I0316 16:03:23.503808 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:03:24 crc kubenswrapper[5120]: I0316 16:03:24.300651 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"89a42fd0-da54-467f-9a6f-7c9d6616f659","Type":"ContainerStarted","Data":"58f65bb19a8bef771f740695fdef128d489638d503aad2ffe145923bfee7078c"} Mar 16 16:03:24 crc kubenswrapper[5120]: I0316 16:03:24.300997 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"89a42fd0-da54-467f-9a6f-7c9d6616f659","Type":"ContainerStarted","Data":"63c03030710dbe0f7430a38b52f6cf074ec47eca1fec50106cb27897a8bf299d"} Mar 16 16:03:25 crc kubenswrapper[5120]: E0316 16:03:25.003232 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="4332146db136bb0f7c8338516ee5e78eea0c4e33906493f9ac0fc28c73e1b585" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:03:25 crc kubenswrapper[5120]: E0316 16:03:25.005394 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="4332146db136bb0f7c8338516ee5e78eea0c4e33906493f9ac0fc28c73e1b585" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:03:25 crc kubenswrapper[5120]: E0316 16:03:25.008133 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="4332146db136bb0f7c8338516ee5e78eea0c4e33906493f9ac0fc28c73e1b585" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:03:25 crc kubenswrapper[5120]: E0316 16:03:25.008226 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="45d21252-1b68-4533-9bb3-a6bc9f334171" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 16:03:25 crc kubenswrapper[5120]: I0316 16:03:25.315528 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"89a42fd0-da54-467f-9a6f-7c9d6616f659","Type":"ContainerStarted","Data":"3c69481010b6552720db4285e9cc48245414b17eda40dd18655f3ad51e9799a3"} Mar 16 16:03:26 crc kubenswrapper[5120]: I0316 16:03:26.335295 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"89a42fd0-da54-467f-9a6f-7c9d6616f659","Type":"ContainerStarted","Data":"d45487ad0385df222253b7f7d0ec861cf60b433abb44e075eb3f8a664096f1fb"} Mar 16 16:03:28 crc kubenswrapper[5120]: I0316 16:03:28.369296 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"89a42fd0-da54-467f-9a6f-7c9d6616f659","Type":"ContainerStarted","Data":"ec6db546a1485027c7a2136b202105ab10b81c70771cdf5767e6b2204b7e60fc"} Mar 16 16:03:28 crc kubenswrapper[5120]: I0316 16:03:28.373655 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:03:28 crc kubenswrapper[5120]: I0316 16:03:28.424662 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.379006344 podStartE2EDuration="6.424598879s" podCreationTimestamp="2026-03-16 16:03:22 +0000 UTC" firstStartedPulling="2026-03-16 16:03:23.512205668 +0000 UTC m=+1905.666137365" lastFinishedPulling="2026-03-16 16:03:27.557798253 +0000 UTC m=+1909.711729900" observedRunningTime="2026-03-16 16:03:28.419544541 +0000 UTC m=+1910.573476238" watchObservedRunningTime="2026-03-16 16:03:28.424598879 +0000 UTC m=+1910.578530566" Mar 16 16:03:30 crc kubenswrapper[5120]: E0316 16:03:30.003179 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="4332146db136bb0f7c8338516ee5e78eea0c4e33906493f9ac0fc28c73e1b585" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:03:30 crc kubenswrapper[5120]: E0316 16:03:30.006942 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="4332146db136bb0f7c8338516ee5e78eea0c4e33906493f9ac0fc28c73e1b585" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:03:30 crc kubenswrapper[5120]: E0316 16:03:30.011083 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="4332146db136bb0f7c8338516ee5e78eea0c4e33906493f9ac0fc28c73e1b585" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:03:30 crc kubenswrapper[5120]: E0316 16:03:30.011493 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="45d21252-1b68-4533-9bb3-a6bc9f334171" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 16:03:30 crc kubenswrapper[5120]: I0316 16:03:30.142479 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/community-operators-dvmlk"] Mar 16 16:03:30 crc kubenswrapper[5120]: I0316 16:03:30.166986 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-dvmlk" Mar 16 16:03:30 crc kubenswrapper[5120]: I0316 16:03:30.180670 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/community-operators-dvmlk"] Mar 16 16:03:30 crc kubenswrapper[5120]: I0316 16:03:30.186674 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/6361fbfb-238f-4535-8dd1-ddd18fd99309-catalog-content\") pod \"community-operators-dvmlk\" (UID: \"6361fbfb-238f-4535-8dd1-ddd18fd99309\") " pod="openshift-marketplace/community-operators-dvmlk" Mar 16 16:03:30 crc kubenswrapper[5120]: I0316 16:03:30.186794 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/6361fbfb-238f-4535-8dd1-ddd18fd99309-utilities\") pod \"community-operators-dvmlk\" (UID: \"6361fbfb-238f-4535-8dd1-ddd18fd99309\") " pod="openshift-marketplace/community-operators-dvmlk" Mar 16 16:03:30 crc kubenswrapper[5120]: I0316 16:03:30.186827 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d46bx\" (UniqueName: \"kubernetes.io/projected/6361fbfb-238f-4535-8dd1-ddd18fd99309-kube-api-access-d46bx\") pod \"community-operators-dvmlk\" (UID: \"6361fbfb-238f-4535-8dd1-ddd18fd99309\") " pod="openshift-marketplace/community-operators-dvmlk" Mar 16 16:03:30 crc kubenswrapper[5120]: I0316 16:03:30.291114 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/6361fbfb-238f-4535-8dd1-ddd18fd99309-catalog-content\") pod \"community-operators-dvmlk\" (UID: \"6361fbfb-238f-4535-8dd1-ddd18fd99309\") " pod="openshift-marketplace/community-operators-dvmlk" Mar 16 16:03:30 crc kubenswrapper[5120]: I0316 16:03:30.291274 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/6361fbfb-238f-4535-8dd1-ddd18fd99309-utilities\") pod \"community-operators-dvmlk\" (UID: \"6361fbfb-238f-4535-8dd1-ddd18fd99309\") " pod="openshift-marketplace/community-operators-dvmlk" Mar 16 16:03:30 crc kubenswrapper[5120]: I0316 16:03:30.291318 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d46bx\" (UniqueName: \"kubernetes.io/projected/6361fbfb-238f-4535-8dd1-ddd18fd99309-kube-api-access-d46bx\") pod \"community-operators-dvmlk\" (UID: \"6361fbfb-238f-4535-8dd1-ddd18fd99309\") " pod="openshift-marketplace/community-operators-dvmlk" Mar 16 16:03:30 crc kubenswrapper[5120]: I0316 16:03:30.291959 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/6361fbfb-238f-4535-8dd1-ddd18fd99309-utilities\") pod \"community-operators-dvmlk\" (UID: \"6361fbfb-238f-4535-8dd1-ddd18fd99309\") " pod="openshift-marketplace/community-operators-dvmlk" Mar 16 16:03:30 crc kubenswrapper[5120]: I0316 16:03:30.294036 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/6361fbfb-238f-4535-8dd1-ddd18fd99309-catalog-content\") pod \"community-operators-dvmlk\" (UID: \"6361fbfb-238f-4535-8dd1-ddd18fd99309\") " pod="openshift-marketplace/community-operators-dvmlk" Mar 16 16:03:30 crc kubenswrapper[5120]: I0316 16:03:30.317863 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d46bx\" (UniqueName: \"kubernetes.io/projected/6361fbfb-238f-4535-8dd1-ddd18fd99309-kube-api-access-d46bx\") pod \"community-operators-dvmlk\" (UID: \"6361fbfb-238f-4535-8dd1-ddd18fd99309\") " pod="openshift-marketplace/community-operators-dvmlk" Mar 16 16:03:30 crc kubenswrapper[5120]: I0316 16:03:30.514333 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-dvmlk" Mar 16 16:03:30 crc kubenswrapper[5120]: I0316 16:03:30.992805 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/community-operators-dvmlk"] Mar 16 16:03:31 crc kubenswrapper[5120]: W0316 16:03:31.002455 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6361fbfb_238f_4535_8dd1_ddd18fd99309.slice/crio-8b9c3abe7595b0a48b1028427bd2c011c7f68a2bc697f0be36d628c4179abb14 WatchSource:0}: Error finding container 8b9c3abe7595b0a48b1028427bd2c011c7f68a2bc697f0be36d628c4179abb14: Status 404 returned error can't find the container with id 8b9c3abe7595b0a48b1028427bd2c011c7f68a2bc697f0be36d628c4179abb14 Mar 16 16:03:31 crc kubenswrapper[5120]: I0316 16:03:31.418802 5120 generic.go:358] "Generic (PLEG): container finished" podID="6361fbfb-238f-4535-8dd1-ddd18fd99309" containerID="d9b0722103b595733ea772878aa172b1adce4c91ffa70452f615c6cef3c1a1c6" exitCode=0 Mar 16 16:03:31 crc kubenswrapper[5120]: I0316 16:03:31.418874 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-dvmlk" event={"ID":"6361fbfb-238f-4535-8dd1-ddd18fd99309","Type":"ContainerDied","Data":"d9b0722103b595733ea772878aa172b1adce4c91ffa70452f615c6cef3c1a1c6"} Mar 16 16:03:31 crc kubenswrapper[5120]: I0316 16:03:31.419316 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-dvmlk" event={"ID":"6361fbfb-238f-4535-8dd1-ddd18fd99309","Type":"ContainerStarted","Data":"8b9c3abe7595b0a48b1028427bd2c011c7f68a2bc697f0be36d628c4179abb14"} Mar 16 16:03:35 crc kubenswrapper[5120]: E0316 16:03:35.003149 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="4332146db136bb0f7c8338516ee5e78eea0c4e33906493f9ac0fc28c73e1b585" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:03:35 crc kubenswrapper[5120]: E0316 16:03:35.005514 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="4332146db136bb0f7c8338516ee5e78eea0c4e33906493f9ac0fc28c73e1b585" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:03:35 crc kubenswrapper[5120]: E0316 16:03:35.007345 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="4332146db136bb0f7c8338516ee5e78eea0c4e33906493f9ac0fc28c73e1b585" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:03:35 crc kubenswrapper[5120]: E0316 16:03:35.007413 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="45d21252-1b68-4533-9bb3-a6bc9f334171" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 16:03:35 crc kubenswrapper[5120]: I0316 16:03:35.483521 5120 generic.go:358] "Generic (PLEG): container finished" podID="45d21252-1b68-4533-9bb3-a6bc9f334171" containerID="4332146db136bb0f7c8338516ee5e78eea0c4e33906493f9ac0fc28c73e1b585" exitCode=137 Mar 16 16:03:35 crc kubenswrapper[5120]: I0316 16:03:35.483997 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"45d21252-1b68-4533-9bb3-a6bc9f334171","Type":"ContainerDied","Data":"4332146db136bb0f7c8338516ee5e78eea0c4e33906493f9ac0fc28c73e1b585"} Mar 16 16:03:35 crc kubenswrapper[5120]: I0316 16:03:35.484035 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"45d21252-1b68-4533-9bb3-a6bc9f334171","Type":"ContainerDied","Data":"896818b9a22f9d5f278ef1301f8dbb6fa72df92564280fdcaed4d6f224a75425"} Mar 16 16:03:35 crc kubenswrapper[5120]: I0316 16:03:35.484053 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="896818b9a22f9d5f278ef1301f8dbb6fa72df92564280fdcaed4d6f224a75425" Mar 16 16:03:35 crc kubenswrapper[5120]: I0316 16:03:35.486528 5120 generic.go:358] "Generic (PLEG): container finished" podID="6361fbfb-238f-4535-8dd1-ddd18fd99309" containerID="5d8d21dacdc84c4bde4965fce4deaad991145a49c61cc9d866afbf4286e4ea24" exitCode=0 Mar 16 16:03:35 crc kubenswrapper[5120]: I0316 16:03:35.486900 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-dvmlk" event={"ID":"6361fbfb-238f-4535-8dd1-ddd18fd99309","Type":"ContainerDied","Data":"5d8d21dacdc84c4bde4965fce4deaad991145a49c61cc9d866afbf4286e4ea24"} Mar 16 16:03:35 crc kubenswrapper[5120]: I0316 16:03:35.522009 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:03:35 crc kubenswrapper[5120]: I0316 16:03:35.598873 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8jdzk\" (UniqueName: \"kubernetes.io/projected/45d21252-1b68-4533-9bb3-a6bc9f334171-kube-api-access-8jdzk\") pod \"45d21252-1b68-4533-9bb3-a6bc9f334171\" (UID: \"45d21252-1b68-4533-9bb3-a6bc9f334171\") " Mar 16 16:03:35 crc kubenswrapper[5120]: I0316 16:03:35.599286 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/45d21252-1b68-4533-9bb3-a6bc9f334171-combined-ca-bundle\") pod \"45d21252-1b68-4533-9bb3-a6bc9f334171\" (UID: \"45d21252-1b68-4533-9bb3-a6bc9f334171\") " Mar 16 16:03:35 crc kubenswrapper[5120]: I0316 16:03:35.599456 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/45d21252-1b68-4533-9bb3-a6bc9f334171-config-data\") pod \"45d21252-1b68-4533-9bb3-a6bc9f334171\" (UID: \"45d21252-1b68-4533-9bb3-a6bc9f334171\") " Mar 16 16:03:35 crc kubenswrapper[5120]: I0316 16:03:35.606718 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45d21252-1b68-4533-9bb3-a6bc9f334171-kube-api-access-8jdzk" (OuterVolumeSpecName: "kube-api-access-8jdzk") pod "45d21252-1b68-4533-9bb3-a6bc9f334171" (UID: "45d21252-1b68-4533-9bb3-a6bc9f334171"). InnerVolumeSpecName "kube-api-access-8jdzk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:03:35 crc kubenswrapper[5120]: I0316 16:03:35.627296 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45d21252-1b68-4533-9bb3-a6bc9f334171-config-data" (OuterVolumeSpecName: "config-data") pod "45d21252-1b68-4533-9bb3-a6bc9f334171" (UID: "45d21252-1b68-4533-9bb3-a6bc9f334171"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:03:35 crc kubenswrapper[5120]: I0316 16:03:35.627830 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45d21252-1b68-4533-9bb3-a6bc9f334171-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "45d21252-1b68-4533-9bb3-a6bc9f334171" (UID: "45d21252-1b68-4533-9bb3-a6bc9f334171"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:03:35 crc kubenswrapper[5120]: I0316 16:03:35.701519 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/45d21252-1b68-4533-9bb3-a6bc9f334171-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:03:35 crc kubenswrapper[5120]: I0316 16:03:35.701553 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/45d21252-1b68-4533-9bb3-a6bc9f334171-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:03:35 crc kubenswrapper[5120]: I0316 16:03:35.701572 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8jdzk\" (UniqueName: \"kubernetes.io/projected/45d21252-1b68-4533-9bb3-a6bc9f334171-kube-api-access-8jdzk\") on node \"crc\" DevicePath \"\"" Mar 16 16:03:36 crc kubenswrapper[5120]: I0316 16:03:36.502604 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-dvmlk" event={"ID":"6361fbfb-238f-4535-8dd1-ddd18fd99309","Type":"ContainerStarted","Data":"2be04411104f1b6505b440d62d7d25aac319db5302fead2c25f351e832ca4b2f"} Mar 16 16:03:36 crc kubenswrapper[5120]: I0316 16:03:36.503293 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:03:36 crc kubenswrapper[5120]: I0316 16:03:36.541979 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/community-operators-dvmlk" podStartSLOduration=3.496907332 podStartE2EDuration="6.54196611s" podCreationTimestamp="2026-03-16 16:03:30 +0000 UTC" firstStartedPulling="2026-03-16 16:03:31.420806782 +0000 UTC m=+1913.574738479" lastFinishedPulling="2026-03-16 16:03:34.4658656 +0000 UTC m=+1916.619797257" observedRunningTime="2026-03-16 16:03:36.538217386 +0000 UTC m=+1918.692149043" watchObservedRunningTime="2026-03-16 16:03:36.54196611 +0000 UTC m=+1918.695897767" Mar 16 16:03:36 crc kubenswrapper[5120]: I0316 16:03:36.573122 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:03:36 crc kubenswrapper[5120]: I0316 16:03:36.586713 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:03:36 crc kubenswrapper[5120]: I0316 16:03:36.606513 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:03:36 crc kubenswrapper[5120]: I0316 16:03:36.607862 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45d21252-1b68-4533-9bb3-a6bc9f334171" containerName="nova-cell0-conductor-conductor" Mar 16 16:03:36 crc kubenswrapper[5120]: I0316 16:03:36.607888 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="45d21252-1b68-4533-9bb3-a6bc9f334171" containerName="nova-cell0-conductor-conductor" Mar 16 16:03:36 crc kubenswrapper[5120]: I0316 16:03:36.608113 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="45d21252-1b68-4533-9bb3-a6bc9f334171" containerName="nova-cell0-conductor-conductor" Mar 16 16:03:36 crc kubenswrapper[5120]: I0316 16:03:36.619094 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:03:36 crc kubenswrapper[5120]: I0316 16:03:36.619300 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:03:36 crc kubenswrapper[5120]: I0316 16:03:36.621877 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-nova-dockercfg-dqzng\"" Mar 16 16:03:36 crc kubenswrapper[5120]: I0316 16:03:36.622732 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-conductor-config-data\"" Mar 16 16:03:36 crc kubenswrapper[5120]: I0316 16:03:36.675257 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="45d21252-1b68-4533-9bb3-a6bc9f334171" path="/var/lib/kubelet/pods/45d21252-1b68-4533-9bb3-a6bc9f334171/volumes" Mar 16 16:03:36 crc kubenswrapper[5120]: I0316 16:03:36.737047 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2trwl\" (UniqueName: \"kubernetes.io/projected/7f4e547e-06cd-459e-8e83-9dcbefd83ea4-kube-api-access-2trwl\") pod \"nova-cell0-conductor-0\" (UID: \"7f4e547e-06cd-459e-8e83-9dcbefd83ea4\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:03:36 crc kubenswrapper[5120]: I0316 16:03:36.737122 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7f4e547e-06cd-459e-8e83-9dcbefd83ea4-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"7f4e547e-06cd-459e-8e83-9dcbefd83ea4\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:03:36 crc kubenswrapper[5120]: I0316 16:03:36.737313 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7f4e547e-06cd-459e-8e83-9dcbefd83ea4-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"7f4e547e-06cd-459e-8e83-9dcbefd83ea4\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:03:36 crc kubenswrapper[5120]: I0316 16:03:36.840041 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2trwl\" (UniqueName: \"kubernetes.io/projected/7f4e547e-06cd-459e-8e83-9dcbefd83ea4-kube-api-access-2trwl\") pod \"nova-cell0-conductor-0\" (UID: \"7f4e547e-06cd-459e-8e83-9dcbefd83ea4\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:03:36 crc kubenswrapper[5120]: I0316 16:03:36.840108 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7f4e547e-06cd-459e-8e83-9dcbefd83ea4-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"7f4e547e-06cd-459e-8e83-9dcbefd83ea4\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:03:36 crc kubenswrapper[5120]: I0316 16:03:36.840141 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7f4e547e-06cd-459e-8e83-9dcbefd83ea4-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"7f4e547e-06cd-459e-8e83-9dcbefd83ea4\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:03:36 crc kubenswrapper[5120]: I0316 16:03:36.847867 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7f4e547e-06cd-459e-8e83-9dcbefd83ea4-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"7f4e547e-06cd-459e-8e83-9dcbefd83ea4\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:03:36 crc kubenswrapper[5120]: I0316 16:03:36.853111 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7f4e547e-06cd-459e-8e83-9dcbefd83ea4-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"7f4e547e-06cd-459e-8e83-9dcbefd83ea4\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:03:36 crc kubenswrapper[5120]: I0316 16:03:36.878432 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2trwl\" (UniqueName: \"kubernetes.io/projected/7f4e547e-06cd-459e-8e83-9dcbefd83ea4-kube-api-access-2trwl\") pod \"nova-cell0-conductor-0\" (UID: \"7f4e547e-06cd-459e-8e83-9dcbefd83ea4\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:03:36 crc kubenswrapper[5120]: I0316 16:03:36.938058 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:03:37 crc kubenswrapper[5120]: I0316 16:03:37.436820 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:03:37 crc kubenswrapper[5120]: I0316 16:03:37.512555 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"7f4e547e-06cd-459e-8e83-9dcbefd83ea4","Type":"ContainerStarted","Data":"d80f8e521e6be881c26d93fb5aad5c6ff32059c57dd58ea6c4b89246bae22e34"} Mar 16 16:03:38 crc kubenswrapper[5120]: I0316 16:03:38.523796 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"7f4e547e-06cd-459e-8e83-9dcbefd83ea4","Type":"ContainerStarted","Data":"6b412424eb716d2e42d4d9ed1e7e068784cfc2c036de57bc48a157cc13bb79ba"} Mar 16 16:03:38 crc kubenswrapper[5120]: I0316 16:03:38.524198 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:03:38 crc kubenswrapper[5120]: I0316 16:03:38.542541 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podStartSLOduration=2.542524491 podStartE2EDuration="2.542524491s" podCreationTimestamp="2026-03-16 16:03:36 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:03:38.539472246 +0000 UTC m=+1920.693404143" watchObservedRunningTime="2026-03-16 16:03:38.542524491 +0000 UTC m=+1920.696456148" Mar 16 16:03:40 crc kubenswrapper[5120]: I0316 16:03:40.515799 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/community-operators-dvmlk" Mar 16 16:03:40 crc kubenswrapper[5120]: I0316 16:03:40.517325 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-marketplace/community-operators-dvmlk" Mar 16 16:03:40 crc kubenswrapper[5120]: I0316 16:03:40.577355 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/community-operators-dvmlk" Mar 16 16:03:40 crc kubenswrapper[5120]: I0316 16:03:40.628744 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/community-operators-dvmlk" Mar 16 16:03:40 crc kubenswrapper[5120]: I0316 16:03:40.695097 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/community-operators-dvmlk"] Mar 16 16:03:40 crc kubenswrapper[5120]: I0316 16:03:40.807479 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/community-operators-bgzkt"] Mar 16 16:03:40 crc kubenswrapper[5120]: I0316 16:03:40.807796 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-marketplace/community-operators-bgzkt" podUID="0f9b752f-73c2-4fc5-b1d0-8b4edfa2b771" containerName="registry-server" containerID="cri-o://159ab642b2bd29f18441224ba037b7cf6b4c710551ae735b9f1199d1eb02b395" gracePeriod=2 Mar 16 16:03:40 crc kubenswrapper[5120]: E0316 16:03:40.917972 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 159ab642b2bd29f18441224ba037b7cf6b4c710551ae735b9f1199d1eb02b395 is running failed: container process not found" containerID="159ab642b2bd29f18441224ba037b7cf6b4c710551ae735b9f1199d1eb02b395" cmd=["grpc_health_probe","-addr=:50051"] Mar 16 16:03:40 crc kubenswrapper[5120]: E0316 16:03:40.919954 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 159ab642b2bd29f18441224ba037b7cf6b4c710551ae735b9f1199d1eb02b395 is running failed: container process not found" containerID="159ab642b2bd29f18441224ba037b7cf6b4c710551ae735b9f1199d1eb02b395" cmd=["grpc_health_probe","-addr=:50051"] Mar 16 16:03:40 crc kubenswrapper[5120]: E0316 16:03:40.920337 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 159ab642b2bd29f18441224ba037b7cf6b4c710551ae735b9f1199d1eb02b395 is running failed: container process not found" containerID="159ab642b2bd29f18441224ba037b7cf6b4c710551ae735b9f1199d1eb02b395" cmd=["grpc_health_probe","-addr=:50051"] Mar 16 16:03:40 crc kubenswrapper[5120]: E0316 16:03:40.920398 5120 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 159ab642b2bd29f18441224ba037b7cf6b4c710551ae735b9f1199d1eb02b395 is running failed: container process not found" probeType="Readiness" pod="openshift-marketplace/community-operators-bgzkt" podUID="0f9b752f-73c2-4fc5-b1d0-8b4edfa2b771" containerName="registry-server" probeResult="unknown" Mar 16 16:03:41 crc kubenswrapper[5120]: I0316 16:03:41.288325 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-bgzkt" Mar 16 16:03:41 crc kubenswrapper[5120]: I0316 16:03:41.344259 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/0f9b752f-73c2-4fc5-b1d0-8b4edfa2b771-utilities\") pod \"0f9b752f-73c2-4fc5-b1d0-8b4edfa2b771\" (UID: \"0f9b752f-73c2-4fc5-b1d0-8b4edfa2b771\") " Mar 16 16:03:41 crc kubenswrapper[5120]: I0316 16:03:41.344502 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/0f9b752f-73c2-4fc5-b1d0-8b4edfa2b771-catalog-content\") pod \"0f9b752f-73c2-4fc5-b1d0-8b4edfa2b771\" (UID: \"0f9b752f-73c2-4fc5-b1d0-8b4edfa2b771\") " Mar 16 16:03:41 crc kubenswrapper[5120]: I0316 16:03:41.346032 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s9n5q\" (UniqueName: \"kubernetes.io/projected/0f9b752f-73c2-4fc5-b1d0-8b4edfa2b771-kube-api-access-s9n5q\") pod \"0f9b752f-73c2-4fc5-b1d0-8b4edfa2b771\" (UID: \"0f9b752f-73c2-4fc5-b1d0-8b4edfa2b771\") " Mar 16 16:03:41 crc kubenswrapper[5120]: I0316 16:03:41.348583 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f9b752f-73c2-4fc5-b1d0-8b4edfa2b771-utilities" (OuterVolumeSpecName: "utilities") pod "0f9b752f-73c2-4fc5-b1d0-8b4edfa2b771" (UID: "0f9b752f-73c2-4fc5-b1d0-8b4edfa2b771"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:03:41 crc kubenswrapper[5120]: I0316 16:03:41.356903 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f9b752f-73c2-4fc5-b1d0-8b4edfa2b771-kube-api-access-s9n5q" (OuterVolumeSpecName: "kube-api-access-s9n5q") pod "0f9b752f-73c2-4fc5-b1d0-8b4edfa2b771" (UID: "0f9b752f-73c2-4fc5-b1d0-8b4edfa2b771"). InnerVolumeSpecName "kube-api-access-s9n5q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:03:41 crc kubenswrapper[5120]: I0316 16:03:41.397388 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f9b752f-73c2-4fc5-b1d0-8b4edfa2b771-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "0f9b752f-73c2-4fc5-b1d0-8b4edfa2b771" (UID: "0f9b752f-73c2-4fc5-b1d0-8b4edfa2b771"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:03:41 crc kubenswrapper[5120]: I0316 16:03:41.449412 5120 reconciler_common.go:299] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/0f9b752f-73c2-4fc5-b1d0-8b4edfa2b771-utilities\") on node \"crc\" DevicePath \"\"" Mar 16 16:03:41 crc kubenswrapper[5120]: I0316 16:03:41.449681 5120 reconciler_common.go:299] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/0f9b752f-73c2-4fc5-b1d0-8b4edfa2b771-catalog-content\") on node \"crc\" DevicePath \"\"" Mar 16 16:03:41 crc kubenswrapper[5120]: I0316 16:03:41.449796 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s9n5q\" (UniqueName: \"kubernetes.io/projected/0f9b752f-73c2-4fc5-b1d0-8b4edfa2b771-kube-api-access-s9n5q\") on node \"crc\" DevicePath \"\"" Mar 16 16:03:41 crc kubenswrapper[5120]: I0316 16:03:41.564865 5120 generic.go:358] "Generic (PLEG): container finished" podID="0f9b752f-73c2-4fc5-b1d0-8b4edfa2b771" containerID="159ab642b2bd29f18441224ba037b7cf6b4c710551ae735b9f1199d1eb02b395" exitCode=0 Mar 16 16:03:41 crc kubenswrapper[5120]: I0316 16:03:41.564908 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-bgzkt" event={"ID":"0f9b752f-73c2-4fc5-b1d0-8b4edfa2b771","Type":"ContainerDied","Data":"159ab642b2bd29f18441224ba037b7cf6b4c710551ae735b9f1199d1eb02b395"} Mar 16 16:03:41 crc kubenswrapper[5120]: I0316 16:03:41.564962 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-bgzkt" event={"ID":"0f9b752f-73c2-4fc5-b1d0-8b4edfa2b771","Type":"ContainerDied","Data":"11bb29412ba23534d946ad0463fc357a72120da671ea12c6f966a658d6d28a56"} Mar 16 16:03:41 crc kubenswrapper[5120]: I0316 16:03:41.564965 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-bgzkt" Mar 16 16:03:41 crc kubenswrapper[5120]: I0316 16:03:41.564990 5120 scope.go:117] "RemoveContainer" containerID="159ab642b2bd29f18441224ba037b7cf6b4c710551ae735b9f1199d1eb02b395" Mar 16 16:03:41 crc kubenswrapper[5120]: I0316 16:03:41.601838 5120 scope.go:117] "RemoveContainer" containerID="fff02420dcf17d2304ce9c6ace9e4ec9706792f65930e2b431c61cba0692d6bd" Mar 16 16:03:41 crc kubenswrapper[5120]: I0316 16:03:41.603304 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/community-operators-bgzkt"] Mar 16 16:03:41 crc kubenswrapper[5120]: I0316 16:03:41.610107 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/community-operators-bgzkt"] Mar 16 16:03:41 crc kubenswrapper[5120]: I0316 16:03:41.622354 5120 scope.go:117] "RemoveContainer" containerID="68cebc79d4d99a0d2be6e3d0a64622ecb42a5b8453fb26430283b74fe448b28d" Mar 16 16:03:41 crc kubenswrapper[5120]: I0316 16:03:41.654948 5120 scope.go:117] "RemoveContainer" containerID="159ab642b2bd29f18441224ba037b7cf6b4c710551ae735b9f1199d1eb02b395" Mar 16 16:03:41 crc kubenswrapper[5120]: E0316 16:03:41.655232 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"159ab642b2bd29f18441224ba037b7cf6b4c710551ae735b9f1199d1eb02b395\": container with ID starting with 159ab642b2bd29f18441224ba037b7cf6b4c710551ae735b9f1199d1eb02b395 not found: ID does not exist" containerID="159ab642b2bd29f18441224ba037b7cf6b4c710551ae735b9f1199d1eb02b395" Mar 16 16:03:41 crc kubenswrapper[5120]: I0316 16:03:41.655269 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"159ab642b2bd29f18441224ba037b7cf6b4c710551ae735b9f1199d1eb02b395"} err="failed to get container status \"159ab642b2bd29f18441224ba037b7cf6b4c710551ae735b9f1199d1eb02b395\": rpc error: code = NotFound desc = could not find container \"159ab642b2bd29f18441224ba037b7cf6b4c710551ae735b9f1199d1eb02b395\": container with ID starting with 159ab642b2bd29f18441224ba037b7cf6b4c710551ae735b9f1199d1eb02b395 not found: ID does not exist" Mar 16 16:03:41 crc kubenswrapper[5120]: I0316 16:03:41.655288 5120 scope.go:117] "RemoveContainer" containerID="fff02420dcf17d2304ce9c6ace9e4ec9706792f65930e2b431c61cba0692d6bd" Mar 16 16:03:41 crc kubenswrapper[5120]: E0316 16:03:41.655482 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fff02420dcf17d2304ce9c6ace9e4ec9706792f65930e2b431c61cba0692d6bd\": container with ID starting with fff02420dcf17d2304ce9c6ace9e4ec9706792f65930e2b431c61cba0692d6bd not found: ID does not exist" containerID="fff02420dcf17d2304ce9c6ace9e4ec9706792f65930e2b431c61cba0692d6bd" Mar 16 16:03:41 crc kubenswrapper[5120]: I0316 16:03:41.655502 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fff02420dcf17d2304ce9c6ace9e4ec9706792f65930e2b431c61cba0692d6bd"} err="failed to get container status \"fff02420dcf17d2304ce9c6ace9e4ec9706792f65930e2b431c61cba0692d6bd\": rpc error: code = NotFound desc = could not find container \"fff02420dcf17d2304ce9c6ace9e4ec9706792f65930e2b431c61cba0692d6bd\": container with ID starting with fff02420dcf17d2304ce9c6ace9e4ec9706792f65930e2b431c61cba0692d6bd not found: ID does not exist" Mar 16 16:03:41 crc kubenswrapper[5120]: I0316 16:03:41.655515 5120 scope.go:117] "RemoveContainer" containerID="68cebc79d4d99a0d2be6e3d0a64622ecb42a5b8453fb26430283b74fe448b28d" Mar 16 16:03:41 crc kubenswrapper[5120]: E0316 16:03:41.655739 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"68cebc79d4d99a0d2be6e3d0a64622ecb42a5b8453fb26430283b74fe448b28d\": container with ID starting with 68cebc79d4d99a0d2be6e3d0a64622ecb42a5b8453fb26430283b74fe448b28d not found: ID does not exist" containerID="68cebc79d4d99a0d2be6e3d0a64622ecb42a5b8453fb26430283b74fe448b28d" Mar 16 16:03:41 crc kubenswrapper[5120]: I0316 16:03:41.655769 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"68cebc79d4d99a0d2be6e3d0a64622ecb42a5b8453fb26430283b74fe448b28d"} err="failed to get container status \"68cebc79d4d99a0d2be6e3d0a64622ecb42a5b8453fb26430283b74fe448b28d\": rpc error: code = NotFound desc = could not find container \"68cebc79d4d99a0d2be6e3d0a64622ecb42a5b8453fb26430283b74fe448b28d\": container with ID starting with 68cebc79d4d99a0d2be6e3d0a64622ecb42a5b8453fb26430283b74fe448b28d not found: ID does not exist" Mar 16 16:03:42 crc kubenswrapper[5120]: I0316 16:03:42.678929 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0f9b752f-73c2-4fc5-b1d0-8b4edfa2b771" path="/var/lib/kubelet/pods/0f9b752f-73c2-4fc5-b1d0-8b4edfa2b771/volumes" Mar 16 16:03:44 crc kubenswrapper[5120]: I0316 16:03:44.570864 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:03:45 crc kubenswrapper[5120]: I0316 16:03:45.081982 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-5zjn7"] Mar 16 16:03:45 crc kubenswrapper[5120]: I0316 16:03:45.083390 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f9b752f-73c2-4fc5-b1d0-8b4edfa2b771" containerName="registry-server" Mar 16 16:03:45 crc kubenswrapper[5120]: I0316 16:03:45.083414 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f9b752f-73c2-4fc5-b1d0-8b4edfa2b771" containerName="registry-server" Mar 16 16:03:45 crc kubenswrapper[5120]: I0316 16:03:45.083480 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f9b752f-73c2-4fc5-b1d0-8b4edfa2b771" containerName="extract-utilities" Mar 16 16:03:45 crc kubenswrapper[5120]: I0316 16:03:45.083489 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f9b752f-73c2-4fc5-b1d0-8b4edfa2b771" containerName="extract-utilities" Mar 16 16:03:45 crc kubenswrapper[5120]: I0316 16:03:45.083518 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f9b752f-73c2-4fc5-b1d0-8b4edfa2b771" containerName="extract-content" Mar 16 16:03:45 crc kubenswrapper[5120]: I0316 16:03:45.083527 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f9b752f-73c2-4fc5-b1d0-8b4edfa2b771" containerName="extract-content" Mar 16 16:03:45 crc kubenswrapper[5120]: I0316 16:03:45.083735 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="0f9b752f-73c2-4fc5-b1d0-8b4edfa2b771" containerName="registry-server" Mar 16 16:03:45 crc kubenswrapper[5120]: I0316 16:03:45.090269 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-5zjn7" Mar 16 16:03:45 crc kubenswrapper[5120]: I0316 16:03:45.095071 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-manage-config-data\"" Mar 16 16:03:45 crc kubenswrapper[5120]: I0316 16:03:45.095222 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-manage-scripts\"" Mar 16 16:03:45 crc kubenswrapper[5120]: I0316 16:03:45.096245 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-5zjn7"] Mar 16 16:03:45 crc kubenswrapper[5120]: I0316 16:03:45.170959 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:03:45 crc kubenswrapper[5120]: I0316 16:03:45.218369 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:03:45 crc kubenswrapper[5120]: I0316 16:03:45.218509 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:03:45 crc kubenswrapper[5120]: I0316 16:03:45.218945 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:03:45 crc kubenswrapper[5120]: I0316 16:03:45.223046 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-config-data\"" Mar 16 16:03:45 crc kubenswrapper[5120]: I0316 16:03:45.231175 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3ae99987-5845-4916-9024-031d345fee06-scripts\") pod \"nova-cell0-cell-mapping-5zjn7\" (UID: \"3ae99987-5845-4916-9024-031d345fee06\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-5zjn7" Mar 16 16:03:45 crc kubenswrapper[5120]: I0316 16:03:45.231262 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3ae99987-5845-4916-9024-031d345fee06-config-data\") pod \"nova-cell0-cell-mapping-5zjn7\" (UID: \"3ae99987-5845-4916-9024-031d345fee06\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-5zjn7" Mar 16 16:03:45 crc kubenswrapper[5120]: I0316 16:03:45.231441 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrkrm\" (UniqueName: \"kubernetes.io/projected/3ae99987-5845-4916-9024-031d345fee06-kube-api-access-wrkrm\") pod \"nova-cell0-cell-mapping-5zjn7\" (UID: \"3ae99987-5845-4916-9024-031d345fee06\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-5zjn7" Mar 16 16:03:45 crc kubenswrapper[5120]: I0316 16:03:45.231577 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3ae99987-5845-4916-9024-031d345fee06-combined-ca-bundle\") pod \"nova-cell0-cell-mapping-5zjn7\" (UID: \"3ae99987-5845-4916-9024-031d345fee06\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-5zjn7" Mar 16 16:03:45 crc kubenswrapper[5120]: I0316 16:03:45.231602 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:03:45 crc kubenswrapper[5120]: I0316 16:03:45.233628 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-novncproxy-config-data\"" Mar 16 16:03:45 crc kubenswrapper[5120]: I0316 16:03:45.247871 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:03:45 crc kubenswrapper[5120]: I0316 16:03:45.297159 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:03:45 crc kubenswrapper[5120]: I0316 16:03:45.303430 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:03:45 crc kubenswrapper[5120]: I0316 16:03:45.313747 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-scheduler-config-data\"" Mar 16 16:03:45 crc kubenswrapper[5120]: I0316 16:03:45.320314 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:03:45 crc kubenswrapper[5120]: I0316 16:03:45.332890 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87grr\" (UniqueName: \"kubernetes.io/projected/0d22536f-d947-4ab3-9875-5c21a5927d52-kube-api-access-87grr\") pod \"nova-cell1-novncproxy-0\" (UID: \"0d22536f-d947-4ab3-9875-5c21a5927d52\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:03:45 crc kubenswrapper[5120]: I0316 16:03:45.332942 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cec15169-61f9-4254-be1a-dc19a7e98bbb-config-data\") pod \"nova-api-0\" (UID: \"cec15169-61f9-4254-be1a-dc19a7e98bbb\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:03:45 crc kubenswrapper[5120]: I0316 16:03:45.332966 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3ae99987-5845-4916-9024-031d345fee06-combined-ca-bundle\") pod \"nova-cell0-cell-mapping-5zjn7\" (UID: \"3ae99987-5845-4916-9024-031d345fee06\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-5zjn7" Mar 16 16:03:45 crc kubenswrapper[5120]: I0316 16:03:45.333032 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0d22536f-d947-4ab3-9875-5c21a5927d52-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"0d22536f-d947-4ab3-9875-5c21a5927d52\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:03:45 crc kubenswrapper[5120]: I0316 16:03:45.333064 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cec15169-61f9-4254-be1a-dc19a7e98bbb-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"cec15169-61f9-4254-be1a-dc19a7e98bbb\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:03:45 crc kubenswrapper[5120]: I0316 16:03:45.333091 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-588tl\" (UniqueName: \"kubernetes.io/projected/cec15169-61f9-4254-be1a-dc19a7e98bbb-kube-api-access-588tl\") pod \"nova-api-0\" (UID: \"cec15169-61f9-4254-be1a-dc19a7e98bbb\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:03:45 crc kubenswrapper[5120]: I0316 16:03:45.333115 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/cec15169-61f9-4254-be1a-dc19a7e98bbb-logs\") pod \"nova-api-0\" (UID: \"cec15169-61f9-4254-be1a-dc19a7e98bbb\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:03:45 crc kubenswrapper[5120]: I0316 16:03:45.333166 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0d22536f-d947-4ab3-9875-5c21a5927d52-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"0d22536f-d947-4ab3-9875-5c21a5927d52\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:03:45 crc kubenswrapper[5120]: I0316 16:03:45.333189 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3ae99987-5845-4916-9024-031d345fee06-scripts\") pod \"nova-cell0-cell-mapping-5zjn7\" (UID: \"3ae99987-5845-4916-9024-031d345fee06\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-5zjn7" Mar 16 16:03:45 crc kubenswrapper[5120]: I0316 16:03:45.333259 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3ae99987-5845-4916-9024-031d345fee06-config-data\") pod \"nova-cell0-cell-mapping-5zjn7\" (UID: \"3ae99987-5845-4916-9024-031d345fee06\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-5zjn7" Mar 16 16:03:45 crc kubenswrapper[5120]: I0316 16:03:45.333275 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wrkrm\" (UniqueName: \"kubernetes.io/projected/3ae99987-5845-4916-9024-031d345fee06-kube-api-access-wrkrm\") pod \"nova-cell0-cell-mapping-5zjn7\" (UID: \"3ae99987-5845-4916-9024-031d345fee06\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-5zjn7" Mar 16 16:03:45 crc kubenswrapper[5120]: I0316 16:03:45.348909 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3ae99987-5845-4916-9024-031d345fee06-scripts\") pod \"nova-cell0-cell-mapping-5zjn7\" (UID: \"3ae99987-5845-4916-9024-031d345fee06\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-5zjn7" Mar 16 16:03:45 crc kubenswrapper[5120]: I0316 16:03:45.355910 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3ae99987-5845-4916-9024-031d345fee06-config-data\") pod \"nova-cell0-cell-mapping-5zjn7\" (UID: \"3ae99987-5845-4916-9024-031d345fee06\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-5zjn7" Mar 16 16:03:45 crc kubenswrapper[5120]: I0316 16:03:45.363567 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3ae99987-5845-4916-9024-031d345fee06-combined-ca-bundle\") pod \"nova-cell0-cell-mapping-5zjn7\" (UID: \"3ae99987-5845-4916-9024-031d345fee06\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-5zjn7" Mar 16 16:03:45 crc kubenswrapper[5120]: I0316 16:03:45.373471 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrkrm\" (UniqueName: \"kubernetes.io/projected/3ae99987-5845-4916-9024-031d345fee06-kube-api-access-wrkrm\") pod \"nova-cell0-cell-mapping-5zjn7\" (UID: \"3ae99987-5845-4916-9024-031d345fee06\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-5zjn7" Mar 16 16:03:45 crc kubenswrapper[5120]: I0316 16:03:45.377495 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:03:45 crc kubenswrapper[5120]: I0316 16:03:45.401780 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:03:45 crc kubenswrapper[5120]: I0316 16:03:45.401908 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:03:45 crc kubenswrapper[5120]: I0316 16:03:45.409466 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-metadata-config-data\"" Mar 16 16:03:45 crc kubenswrapper[5120]: I0316 16:03:45.429568 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-5zjn7" Mar 16 16:03:45 crc kubenswrapper[5120]: I0316 16:03:45.435707 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b5bf0d44-4150-48c2-82a3-7f4a1de0ba14-config-data\") pod \"nova-scheduler-0\" (UID: \"b5bf0d44-4150-48c2-82a3-7f4a1de0ba14\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:03:45 crc kubenswrapper[5120]: I0316 16:03:45.435817 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-87grr\" (UniqueName: \"kubernetes.io/projected/0d22536f-d947-4ab3-9875-5c21a5927d52-kube-api-access-87grr\") pod \"nova-cell1-novncproxy-0\" (UID: \"0d22536f-d947-4ab3-9875-5c21a5927d52\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:03:45 crc kubenswrapper[5120]: I0316 16:03:45.435862 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cec15169-61f9-4254-be1a-dc19a7e98bbb-config-data\") pod \"nova-api-0\" (UID: \"cec15169-61f9-4254-be1a-dc19a7e98bbb\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:03:45 crc kubenswrapper[5120]: I0316 16:03:45.435906 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b5bf0d44-4150-48c2-82a3-7f4a1de0ba14-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"b5bf0d44-4150-48c2-82a3-7f4a1de0ba14\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:03:45 crc kubenswrapper[5120]: I0316 16:03:45.435941 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rffq\" (UniqueName: \"kubernetes.io/projected/b5bf0d44-4150-48c2-82a3-7f4a1de0ba14-kube-api-access-7rffq\") pod \"nova-scheduler-0\" (UID: \"b5bf0d44-4150-48c2-82a3-7f4a1de0ba14\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:03:45 crc kubenswrapper[5120]: I0316 16:03:45.435988 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0d22536f-d947-4ab3-9875-5c21a5927d52-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"0d22536f-d947-4ab3-9875-5c21a5927d52\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:03:45 crc kubenswrapper[5120]: I0316 16:03:45.436023 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cec15169-61f9-4254-be1a-dc19a7e98bbb-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"cec15169-61f9-4254-be1a-dc19a7e98bbb\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:03:45 crc kubenswrapper[5120]: I0316 16:03:45.436054 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-588tl\" (UniqueName: \"kubernetes.io/projected/cec15169-61f9-4254-be1a-dc19a7e98bbb-kube-api-access-588tl\") pod \"nova-api-0\" (UID: \"cec15169-61f9-4254-be1a-dc19a7e98bbb\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:03:45 crc kubenswrapper[5120]: I0316 16:03:45.436080 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/cec15169-61f9-4254-be1a-dc19a7e98bbb-logs\") pod \"nova-api-0\" (UID: \"cec15169-61f9-4254-be1a-dc19a7e98bbb\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:03:45 crc kubenswrapper[5120]: I0316 16:03:45.436097 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0d22536f-d947-4ab3-9875-5c21a5927d52-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"0d22536f-d947-4ab3-9875-5c21a5927d52\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:03:45 crc kubenswrapper[5120]: I0316 16:03:45.438552 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/cec15169-61f9-4254-be1a-dc19a7e98bbb-logs\") pod \"nova-api-0\" (UID: \"cec15169-61f9-4254-be1a-dc19a7e98bbb\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:03:45 crc kubenswrapper[5120]: I0316 16:03:45.440482 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0d22536f-d947-4ab3-9875-5c21a5927d52-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"0d22536f-d947-4ab3-9875-5c21a5927d52\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:03:45 crc kubenswrapper[5120]: I0316 16:03:45.440694 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cec15169-61f9-4254-be1a-dc19a7e98bbb-config-data\") pod \"nova-api-0\" (UID: \"cec15169-61f9-4254-be1a-dc19a7e98bbb\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:03:45 crc kubenswrapper[5120]: I0316 16:03:45.444458 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0d22536f-d947-4ab3-9875-5c21a5927d52-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"0d22536f-d947-4ab3-9875-5c21a5927d52\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:03:45 crc kubenswrapper[5120]: I0316 16:03:45.452619 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cec15169-61f9-4254-be1a-dc19a7e98bbb-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"cec15169-61f9-4254-be1a-dc19a7e98bbb\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:03:45 crc kubenswrapper[5120]: I0316 16:03:45.456528 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-87grr\" (UniqueName: \"kubernetes.io/projected/0d22536f-d947-4ab3-9875-5c21a5927d52-kube-api-access-87grr\") pod \"nova-cell1-novncproxy-0\" (UID: \"0d22536f-d947-4ab3-9875-5c21a5927d52\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:03:45 crc kubenswrapper[5120]: I0316 16:03:45.461896 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-588tl\" (UniqueName: \"kubernetes.io/projected/cec15169-61f9-4254-be1a-dc19a7e98bbb-kube-api-access-588tl\") pod \"nova-api-0\" (UID: \"cec15169-61f9-4254-be1a-dc19a7e98bbb\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:03:45 crc kubenswrapper[5120]: I0316 16:03:45.539380 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b5bf0d44-4150-48c2-82a3-7f4a1de0ba14-config-data\") pod \"nova-scheduler-0\" (UID: \"b5bf0d44-4150-48c2-82a3-7f4a1de0ba14\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:03:45 crc kubenswrapper[5120]: I0316 16:03:45.539660 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nxkk6\" (UniqueName: \"kubernetes.io/projected/ad4b50ff-8669-41da-a679-18e16f3c00eb-kube-api-access-nxkk6\") pod \"nova-metadata-0\" (UID: \"ad4b50ff-8669-41da-a679-18e16f3c00eb\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:03:45 crc kubenswrapper[5120]: I0316 16:03:45.539729 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b5bf0d44-4150-48c2-82a3-7f4a1de0ba14-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"b5bf0d44-4150-48c2-82a3-7f4a1de0ba14\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:03:45 crc kubenswrapper[5120]: I0316 16:03:45.539752 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ad4b50ff-8669-41da-a679-18e16f3c00eb-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"ad4b50ff-8669-41da-a679-18e16f3c00eb\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:03:45 crc kubenswrapper[5120]: I0316 16:03:45.539858 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7rffq\" (UniqueName: \"kubernetes.io/projected/b5bf0d44-4150-48c2-82a3-7f4a1de0ba14-kube-api-access-7rffq\") pod \"nova-scheduler-0\" (UID: \"b5bf0d44-4150-48c2-82a3-7f4a1de0ba14\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:03:45 crc kubenswrapper[5120]: I0316 16:03:45.539879 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ad4b50ff-8669-41da-a679-18e16f3c00eb-logs\") pod \"nova-metadata-0\" (UID: \"ad4b50ff-8669-41da-a679-18e16f3c00eb\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:03:45 crc kubenswrapper[5120]: I0316 16:03:45.539969 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ad4b50ff-8669-41da-a679-18e16f3c00eb-config-data\") pod \"nova-metadata-0\" (UID: \"ad4b50ff-8669-41da-a679-18e16f3c00eb\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:03:45 crc kubenswrapper[5120]: I0316 16:03:45.544714 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b5bf0d44-4150-48c2-82a3-7f4a1de0ba14-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"b5bf0d44-4150-48c2-82a3-7f4a1de0ba14\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:03:45 crc kubenswrapper[5120]: I0316 16:03:45.546690 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b5bf0d44-4150-48c2-82a3-7f4a1de0ba14-config-data\") pod \"nova-scheduler-0\" (UID: \"b5bf0d44-4150-48c2-82a3-7f4a1de0ba14\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:03:45 crc kubenswrapper[5120]: I0316 16:03:45.555820 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rffq\" (UniqueName: \"kubernetes.io/projected/b5bf0d44-4150-48c2-82a3-7f4a1de0ba14-kube-api-access-7rffq\") pod \"nova-scheduler-0\" (UID: \"b5bf0d44-4150-48c2-82a3-7f4a1de0ba14\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:03:45 crc kubenswrapper[5120]: I0316 16:03:45.556861 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:03:45 crc kubenswrapper[5120]: I0316 16:03:45.588132 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:03:45 crc kubenswrapper[5120]: I0316 16:03:45.629954 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:03:45 crc kubenswrapper[5120]: I0316 16:03:45.642256 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ad4b50ff-8669-41da-a679-18e16f3c00eb-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"ad4b50ff-8669-41da-a679-18e16f3c00eb\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:03:45 crc kubenswrapper[5120]: I0316 16:03:45.642311 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ad4b50ff-8669-41da-a679-18e16f3c00eb-logs\") pod \"nova-metadata-0\" (UID: \"ad4b50ff-8669-41da-a679-18e16f3c00eb\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:03:45 crc kubenswrapper[5120]: I0316 16:03:45.642469 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ad4b50ff-8669-41da-a679-18e16f3c00eb-config-data\") pod \"nova-metadata-0\" (UID: \"ad4b50ff-8669-41da-a679-18e16f3c00eb\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:03:45 crc kubenswrapper[5120]: I0316 16:03:45.642573 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nxkk6\" (UniqueName: \"kubernetes.io/projected/ad4b50ff-8669-41da-a679-18e16f3c00eb-kube-api-access-nxkk6\") pod \"nova-metadata-0\" (UID: \"ad4b50ff-8669-41da-a679-18e16f3c00eb\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:03:45 crc kubenswrapper[5120]: I0316 16:03:45.643231 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ad4b50ff-8669-41da-a679-18e16f3c00eb-logs\") pod \"nova-metadata-0\" (UID: \"ad4b50ff-8669-41da-a679-18e16f3c00eb\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:03:45 crc kubenswrapper[5120]: I0316 16:03:45.646375 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ad4b50ff-8669-41da-a679-18e16f3c00eb-config-data\") pod \"nova-metadata-0\" (UID: \"ad4b50ff-8669-41da-a679-18e16f3c00eb\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:03:45 crc kubenswrapper[5120]: I0316 16:03:45.646867 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ad4b50ff-8669-41da-a679-18e16f3c00eb-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"ad4b50ff-8669-41da-a679-18e16f3c00eb\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:03:45 crc kubenswrapper[5120]: I0316 16:03:45.665085 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxkk6\" (UniqueName: \"kubernetes.io/projected/ad4b50ff-8669-41da-a679-18e16f3c00eb-kube-api-access-nxkk6\") pod \"nova-metadata-0\" (UID: \"ad4b50ff-8669-41da-a679-18e16f3c00eb\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:03:45 crc kubenswrapper[5120]: I0316 16:03:45.744726 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:03:45 crc kubenswrapper[5120]: I0316 16:03:45.904882 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:03:45 crc kubenswrapper[5120]: I0316 16:03:45.936092 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-5zjn7"] Mar 16 16:03:46 crc kubenswrapper[5120]: I0316 16:03:46.148611 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:03:46 crc kubenswrapper[5120]: I0316 16:03:46.255867 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:03:46 crc kubenswrapper[5120]: W0316 16:03:46.266565 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb5bf0d44_4150_48c2_82a3_7f4a1de0ba14.slice/crio-63397aeb70beb3a6d28f25963a75103b9b4d6831b594e729f0ddc49d135937fb WatchSource:0}: Error finding container 63397aeb70beb3a6d28f25963a75103b9b4d6831b594e729f0ddc49d135937fb: Status 404 returned error can't find the container with id 63397aeb70beb3a6d28f25963a75103b9b4d6831b594e729f0ddc49d135937fb Mar 16 16:03:46 crc kubenswrapper[5120]: I0316 16:03:46.286098 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-tqz8h"] Mar 16 16:03:46 crc kubenswrapper[5120]: I0316 16:03:46.294131 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-tqz8h"] Mar 16 16:03:46 crc kubenswrapper[5120]: I0316 16:03:46.294286 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-tqz8h" Mar 16 16:03:46 crc kubenswrapper[5120]: I0316 16:03:46.298162 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-conductor-scripts\"" Mar 16 16:03:46 crc kubenswrapper[5120]: I0316 16:03:46.298334 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-conductor-config-data\"" Mar 16 16:03:46 crc kubenswrapper[5120]: I0316 16:03:46.317901 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:03:46 crc kubenswrapper[5120]: W0316 16:03:46.322898 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podad4b50ff_8669_41da_a679_18e16f3c00eb.slice/crio-22400e83386cd055901588d89c2e57c8548da2c011a0610de0eb87b9987d2fcd WatchSource:0}: Error finding container 22400e83386cd055901588d89c2e57c8548da2c011a0610de0eb87b9987d2fcd: Status 404 returned error can't find the container with id 22400e83386cd055901588d89c2e57c8548da2c011a0610de0eb87b9987d2fcd Mar 16 16:03:46 crc kubenswrapper[5120]: I0316 16:03:46.365187 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gn9lp\" (UniqueName: \"kubernetes.io/projected/856d23a2-6b17-407a-a435-a89e7bc4c445-kube-api-access-gn9lp\") pod \"nova-cell1-conductor-db-sync-tqz8h\" (UID: \"856d23a2-6b17-407a-a435-a89e7bc4c445\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-tqz8h" Mar 16 16:03:46 crc kubenswrapper[5120]: I0316 16:03:46.365419 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/856d23a2-6b17-407a-a435-a89e7bc4c445-combined-ca-bundle\") pod \"nova-cell1-conductor-db-sync-tqz8h\" (UID: \"856d23a2-6b17-407a-a435-a89e7bc4c445\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-tqz8h" Mar 16 16:03:46 crc kubenswrapper[5120]: I0316 16:03:46.365499 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/856d23a2-6b17-407a-a435-a89e7bc4c445-scripts\") pod \"nova-cell1-conductor-db-sync-tqz8h\" (UID: \"856d23a2-6b17-407a-a435-a89e7bc4c445\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-tqz8h" Mar 16 16:03:46 crc kubenswrapper[5120]: I0316 16:03:46.365678 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/856d23a2-6b17-407a-a435-a89e7bc4c445-config-data\") pod \"nova-cell1-conductor-db-sync-tqz8h\" (UID: \"856d23a2-6b17-407a-a435-a89e7bc4c445\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-tqz8h" Mar 16 16:03:46 crc kubenswrapper[5120]: I0316 16:03:46.467924 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/856d23a2-6b17-407a-a435-a89e7bc4c445-combined-ca-bundle\") pod \"nova-cell1-conductor-db-sync-tqz8h\" (UID: \"856d23a2-6b17-407a-a435-a89e7bc4c445\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-tqz8h" Mar 16 16:03:46 crc kubenswrapper[5120]: I0316 16:03:46.468097 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/856d23a2-6b17-407a-a435-a89e7bc4c445-scripts\") pod \"nova-cell1-conductor-db-sync-tqz8h\" (UID: \"856d23a2-6b17-407a-a435-a89e7bc4c445\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-tqz8h" Mar 16 16:03:46 crc kubenswrapper[5120]: I0316 16:03:46.468175 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/856d23a2-6b17-407a-a435-a89e7bc4c445-config-data\") pod \"nova-cell1-conductor-db-sync-tqz8h\" (UID: \"856d23a2-6b17-407a-a435-a89e7bc4c445\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-tqz8h" Mar 16 16:03:46 crc kubenswrapper[5120]: I0316 16:03:46.468235 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gn9lp\" (UniqueName: \"kubernetes.io/projected/856d23a2-6b17-407a-a435-a89e7bc4c445-kube-api-access-gn9lp\") pod \"nova-cell1-conductor-db-sync-tqz8h\" (UID: \"856d23a2-6b17-407a-a435-a89e7bc4c445\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-tqz8h" Mar 16 16:03:46 crc kubenswrapper[5120]: I0316 16:03:46.475286 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/856d23a2-6b17-407a-a435-a89e7bc4c445-config-data\") pod \"nova-cell1-conductor-db-sync-tqz8h\" (UID: \"856d23a2-6b17-407a-a435-a89e7bc4c445\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-tqz8h" Mar 16 16:03:46 crc kubenswrapper[5120]: I0316 16:03:46.475548 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/856d23a2-6b17-407a-a435-a89e7bc4c445-scripts\") pod \"nova-cell1-conductor-db-sync-tqz8h\" (UID: \"856d23a2-6b17-407a-a435-a89e7bc4c445\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-tqz8h" Mar 16 16:03:46 crc kubenswrapper[5120]: I0316 16:03:46.484050 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/856d23a2-6b17-407a-a435-a89e7bc4c445-combined-ca-bundle\") pod \"nova-cell1-conductor-db-sync-tqz8h\" (UID: \"856d23a2-6b17-407a-a435-a89e7bc4c445\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-tqz8h" Mar 16 16:03:46 crc kubenswrapper[5120]: I0316 16:03:46.491746 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gn9lp\" (UniqueName: \"kubernetes.io/projected/856d23a2-6b17-407a-a435-a89e7bc4c445-kube-api-access-gn9lp\") pod \"nova-cell1-conductor-db-sync-tqz8h\" (UID: \"856d23a2-6b17-407a-a435-a89e7bc4c445\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-tqz8h" Mar 16 16:03:46 crc kubenswrapper[5120]: I0316 16:03:46.614411 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-tqz8h" Mar 16 16:03:46 crc kubenswrapper[5120]: I0316 16:03:46.662147 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"b5bf0d44-4150-48c2-82a3-7f4a1de0ba14","Type":"ContainerStarted","Data":"63397aeb70beb3a6d28f25963a75103b9b4d6831b594e729f0ddc49d135937fb"} Mar 16 16:03:46 crc kubenswrapper[5120]: I0316 16:03:46.681415 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"cec15169-61f9-4254-be1a-dc19a7e98bbb","Type":"ContainerStarted","Data":"0e1c259da4e35d77164912b003d53e4d0974b0cf31e42801fbcaf3f4ef53faf9"} Mar 16 16:03:46 crc kubenswrapper[5120]: I0316 16:03:46.681478 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"cec15169-61f9-4254-be1a-dc19a7e98bbb","Type":"ContainerStarted","Data":"a02595eb0223c99dc359e2e71900c61a26591b96a49aa7a082079ad5ed28f269"} Mar 16 16:03:46 crc kubenswrapper[5120]: I0316 16:03:46.681490 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-5zjn7" event={"ID":"3ae99987-5845-4916-9024-031d345fee06","Type":"ContainerStarted","Data":"028a09947c0847095e60707c2ea9b516a2fe50c377455be0ff8782b5e885df95"} Mar 16 16:03:46 crc kubenswrapper[5120]: I0316 16:03:46.681501 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-5zjn7" event={"ID":"3ae99987-5845-4916-9024-031d345fee06","Type":"ContainerStarted","Data":"21df590228ff3908c241c51db6118a63efaec14da26271f5b43ff0c47dd578d7"} Mar 16 16:03:46 crc kubenswrapper[5120]: I0316 16:03:46.684222 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"ad4b50ff-8669-41da-a679-18e16f3c00eb","Type":"ContainerStarted","Data":"22400e83386cd055901588d89c2e57c8548da2c011a0610de0eb87b9987d2fcd"} Mar 16 16:03:46 crc kubenswrapper[5120]: I0316 16:03:46.697074 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-5zjn7" podStartSLOduration=2.697052214 podStartE2EDuration="2.697052214s" podCreationTimestamp="2026-03-16 16:03:44 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:03:46.690235736 +0000 UTC m=+1928.844167393" watchObservedRunningTime="2026-03-16 16:03:46.697052214 +0000 UTC m=+1928.850983861" Mar 16 16:03:46 crc kubenswrapper[5120]: I0316 16:03:46.699269 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"0d22536f-d947-4ab3-9875-5c21a5927d52","Type":"ContainerStarted","Data":"9d5d762b0d48d9ee21a713e62ee8dad13b89178ca2ad42f1b924e8d21b8de8d5"} Mar 16 16:03:46 crc kubenswrapper[5120]: I0316 16:03:46.699311 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"0d22536f-d947-4ab3-9875-5c21a5927d52","Type":"ContainerStarted","Data":"20354ae1978f1cf1a200faaed356fedc8d95bca2830de8672cbf663d484db856"} Mar 16 16:03:46 crc kubenswrapper[5120]: I0316 16:03:46.716575 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podStartSLOduration=1.7165587009999999 podStartE2EDuration="1.716558701s" podCreationTimestamp="2026-03-16 16:03:45 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:03:46.715618774 +0000 UTC m=+1928.869550431" watchObservedRunningTime="2026-03-16 16:03:46.716558701 +0000 UTC m=+1928.870490358" Mar 16 16:03:47 crc kubenswrapper[5120]: I0316 16:03:47.049910 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-tqz8h"] Mar 16 16:03:47 crc kubenswrapper[5120]: W0316 16:03:47.054865 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod856d23a2_6b17_407a_a435_a89e7bc4c445.slice/crio-f4e9a4b0e8e2f8631f99e045c4b824dfdb3a4a01f37a58239d17ee9ef94fa40d WatchSource:0}: Error finding container f4e9a4b0e8e2f8631f99e045c4b824dfdb3a4a01f37a58239d17ee9ef94fa40d: Status 404 returned error can't find the container with id f4e9a4b0e8e2f8631f99e045c4b824dfdb3a4a01f37a58239d17ee9ef94fa40d Mar 16 16:03:47 crc kubenswrapper[5120]: I0316 16:03:47.709085 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-tqz8h" event={"ID":"856d23a2-6b17-407a-a435-a89e7bc4c445","Type":"ContainerStarted","Data":"0adc4c6a96adb90fb734129ae943d50e79b0e6e457fe8f3e8d125e60e78f5908"} Mar 16 16:03:47 crc kubenswrapper[5120]: I0316 16:03:47.709358 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-tqz8h" event={"ID":"856d23a2-6b17-407a-a435-a89e7bc4c445","Type":"ContainerStarted","Data":"f4e9a4b0e8e2f8631f99e045c4b824dfdb3a4a01f37a58239d17ee9ef94fa40d"} Mar 16 16:03:47 crc kubenswrapper[5120]: I0316 16:03:47.711255 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"ad4b50ff-8669-41da-a679-18e16f3c00eb","Type":"ContainerStarted","Data":"0a0dd50b3df957cb2a2b42e3d65c51694a81cadc2ec06306cd9c87022592c3be"} Mar 16 16:03:47 crc kubenswrapper[5120]: I0316 16:03:47.711307 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"ad4b50ff-8669-41da-a679-18e16f3c00eb","Type":"ContainerStarted","Data":"31de0b88033468fc2535e83bf45e8c9798b36b019cfd4fd87849a6c901d6d529"} Mar 16 16:03:47 crc kubenswrapper[5120]: I0316 16:03:47.713184 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"b5bf0d44-4150-48c2-82a3-7f4a1de0ba14","Type":"ContainerStarted","Data":"a7774028fec91d27489817ab85d374796adb8697ff20ded2f2c2e1d57763a8f4"} Mar 16 16:03:47 crc kubenswrapper[5120]: I0316 16:03:47.716136 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"cec15169-61f9-4254-be1a-dc19a7e98bbb","Type":"ContainerStarted","Data":"4c4ef40b01fcf9f56c526b166ec7810328b9b14ceeb829036d9c271714317b80"} Mar 16 16:03:47 crc kubenswrapper[5120]: I0316 16:03:47.751193 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-tqz8h" podStartSLOduration=1.751178366 podStartE2EDuration="1.751178366s" podCreationTimestamp="2026-03-16 16:03:46 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:03:47.730098736 +0000 UTC m=+1929.884030393" watchObservedRunningTime="2026-03-16 16:03:47.751178366 +0000 UTC m=+1929.905110023" Mar 16 16:03:47 crc kubenswrapper[5120]: I0316 16:03:47.754799 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-scheduler-0" podStartSLOduration=2.754751304 podStartE2EDuration="2.754751304s" podCreationTimestamp="2026-03-16 16:03:45 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:03:47.747676639 +0000 UTC m=+1929.901608296" watchObservedRunningTime="2026-03-16 16:03:47.754751304 +0000 UTC m=+1929.908682961" Mar 16 16:03:47 crc kubenswrapper[5120]: I0316 16:03:47.768444 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=2.76842444 podStartE2EDuration="2.76842444s" podCreationTimestamp="2026-03-16 16:03:45 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:03:47.762346163 +0000 UTC m=+1929.916277820" watchObservedRunningTime="2026-03-16 16:03:47.76842444 +0000 UTC m=+1929.922356097" Mar 16 16:03:47 crc kubenswrapper[5120]: I0316 16:03:47.783265 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=2.783247968 podStartE2EDuration="2.783247968s" podCreationTimestamp="2026-03-16 16:03:45 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:03:47.781105819 +0000 UTC m=+1929.935037486" watchObservedRunningTime="2026-03-16 16:03:47.783247968 +0000 UTC m=+1929.937179635" Mar 16 16:03:48 crc kubenswrapper[5120]: I0316 16:03:48.637501 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:03:48 crc kubenswrapper[5120]: I0316 16:03:48.651501 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:03:48 crc kubenswrapper[5120]: I0316 16:03:48.724151 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podUID="0d22536f-d947-4ab3-9875-5c21a5927d52" containerName="nova-cell1-novncproxy-novncproxy" containerID="cri-o://9d5d762b0d48d9ee21a713e62ee8dad13b89178ca2ad42f1b924e8d21b8de8d5" gracePeriod=30 Mar 16 16:03:49 crc kubenswrapper[5120]: I0316 16:03:49.524237 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:03:49 crc kubenswrapper[5120]: I0316 16:03:49.637837 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0d22536f-d947-4ab3-9875-5c21a5927d52-config-data\") pod \"0d22536f-d947-4ab3-9875-5c21a5927d52\" (UID: \"0d22536f-d947-4ab3-9875-5c21a5927d52\") " Mar 16 16:03:49 crc kubenswrapper[5120]: I0316 16:03:49.638186 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-87grr\" (UniqueName: \"kubernetes.io/projected/0d22536f-d947-4ab3-9875-5c21a5927d52-kube-api-access-87grr\") pod \"0d22536f-d947-4ab3-9875-5c21a5927d52\" (UID: \"0d22536f-d947-4ab3-9875-5c21a5927d52\") " Mar 16 16:03:49 crc kubenswrapper[5120]: I0316 16:03:49.638228 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0d22536f-d947-4ab3-9875-5c21a5927d52-combined-ca-bundle\") pod \"0d22536f-d947-4ab3-9875-5c21a5927d52\" (UID: \"0d22536f-d947-4ab3-9875-5c21a5927d52\") " Mar 16 16:03:49 crc kubenswrapper[5120]: I0316 16:03:49.652144 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d22536f-d947-4ab3-9875-5c21a5927d52-kube-api-access-87grr" (OuterVolumeSpecName: "kube-api-access-87grr") pod "0d22536f-d947-4ab3-9875-5c21a5927d52" (UID: "0d22536f-d947-4ab3-9875-5c21a5927d52"). InnerVolumeSpecName "kube-api-access-87grr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:03:49 crc kubenswrapper[5120]: I0316 16:03:49.668315 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0d22536f-d947-4ab3-9875-5c21a5927d52-config-data" (OuterVolumeSpecName: "config-data") pod "0d22536f-d947-4ab3-9875-5c21a5927d52" (UID: "0d22536f-d947-4ab3-9875-5c21a5927d52"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:03:49 crc kubenswrapper[5120]: I0316 16:03:49.681513 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0d22536f-d947-4ab3-9875-5c21a5927d52-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "0d22536f-d947-4ab3-9875-5c21a5927d52" (UID: "0d22536f-d947-4ab3-9875-5c21a5927d52"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:03:49 crc kubenswrapper[5120]: I0316 16:03:49.746652 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-87grr\" (UniqueName: \"kubernetes.io/projected/0d22536f-d947-4ab3-9875-5c21a5927d52-kube-api-access-87grr\") on node \"crc\" DevicePath \"\"" Mar 16 16:03:49 crc kubenswrapper[5120]: I0316 16:03:49.746696 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0d22536f-d947-4ab3-9875-5c21a5927d52-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:03:49 crc kubenswrapper[5120]: I0316 16:03:49.746709 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0d22536f-d947-4ab3-9875-5c21a5927d52-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:03:49 crc kubenswrapper[5120]: I0316 16:03:49.772465 5120 generic.go:358] "Generic (PLEG): container finished" podID="0d22536f-d947-4ab3-9875-5c21a5927d52" containerID="9d5d762b0d48d9ee21a713e62ee8dad13b89178ca2ad42f1b924e8d21b8de8d5" exitCode=0 Mar 16 16:03:49 crc kubenswrapper[5120]: I0316 16:03:49.772674 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"0d22536f-d947-4ab3-9875-5c21a5927d52","Type":"ContainerDied","Data":"9d5d762b0d48d9ee21a713e62ee8dad13b89178ca2ad42f1b924e8d21b8de8d5"} Mar 16 16:03:49 crc kubenswrapper[5120]: I0316 16:03:49.772718 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:03:49 crc kubenswrapper[5120]: I0316 16:03:49.772746 5120 scope.go:117] "RemoveContainer" containerID="9d5d762b0d48d9ee21a713e62ee8dad13b89178ca2ad42f1b924e8d21b8de8d5" Mar 16 16:03:49 crc kubenswrapper[5120]: I0316 16:03:49.772731 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"0d22536f-d947-4ab3-9875-5c21a5927d52","Type":"ContainerDied","Data":"20354ae1978f1cf1a200faaed356fedc8d95bca2830de8672cbf663d484db856"} Mar 16 16:03:49 crc kubenswrapper[5120]: I0316 16:03:49.777968 5120 generic.go:358] "Generic (PLEG): container finished" podID="856d23a2-6b17-407a-a435-a89e7bc4c445" containerID="0adc4c6a96adb90fb734129ae943d50e79b0e6e457fe8f3e8d125e60e78f5908" exitCode=0 Mar 16 16:03:49 crc kubenswrapper[5120]: I0316 16:03:49.778092 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-tqz8h" event={"ID":"856d23a2-6b17-407a-a435-a89e7bc4c445","Type":"ContainerDied","Data":"0adc4c6a96adb90fb734129ae943d50e79b0e6e457fe8f3e8d125e60e78f5908"} Mar 16 16:03:49 crc kubenswrapper[5120]: I0316 16:03:49.778267 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="ad4b50ff-8669-41da-a679-18e16f3c00eb" containerName="nova-metadata-log" containerID="cri-o://31de0b88033468fc2535e83bf45e8c9798b36b019cfd4fd87849a6c901d6d529" gracePeriod=30 Mar 16 16:03:49 crc kubenswrapper[5120]: I0316 16:03:49.778322 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="ad4b50ff-8669-41da-a679-18e16f3c00eb" containerName="nova-metadata-metadata" containerID="cri-o://0a0dd50b3df957cb2a2b42e3d65c51694a81cadc2ec06306cd9c87022592c3be" gracePeriod=30 Mar 16 16:03:49 crc kubenswrapper[5120]: I0316 16:03:49.792314 5120 scope.go:117] "RemoveContainer" containerID="9d5d762b0d48d9ee21a713e62ee8dad13b89178ca2ad42f1b924e8d21b8de8d5" Mar 16 16:03:49 crc kubenswrapper[5120]: E0316 16:03:49.795046 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d5d762b0d48d9ee21a713e62ee8dad13b89178ca2ad42f1b924e8d21b8de8d5\": container with ID starting with 9d5d762b0d48d9ee21a713e62ee8dad13b89178ca2ad42f1b924e8d21b8de8d5 not found: ID does not exist" containerID="9d5d762b0d48d9ee21a713e62ee8dad13b89178ca2ad42f1b924e8d21b8de8d5" Mar 16 16:03:49 crc kubenswrapper[5120]: I0316 16:03:49.795093 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d5d762b0d48d9ee21a713e62ee8dad13b89178ca2ad42f1b924e8d21b8de8d5"} err="failed to get container status \"9d5d762b0d48d9ee21a713e62ee8dad13b89178ca2ad42f1b924e8d21b8de8d5\": rpc error: code = NotFound desc = could not find container \"9d5d762b0d48d9ee21a713e62ee8dad13b89178ca2ad42f1b924e8d21b8de8d5\": container with ID starting with 9d5d762b0d48d9ee21a713e62ee8dad13b89178ca2ad42f1b924e8d21b8de8d5 not found: ID does not exist" Mar 16 16:03:49 crc kubenswrapper[5120]: I0316 16:03:49.838030 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:03:49 crc kubenswrapper[5120]: I0316 16:03:49.856576 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:03:49 crc kubenswrapper[5120]: I0316 16:03:49.872365 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:03:49 crc kubenswrapper[5120]: I0316 16:03:49.873845 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d22536f-d947-4ab3-9875-5c21a5927d52" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 16:03:49 crc kubenswrapper[5120]: I0316 16:03:49.873870 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d22536f-d947-4ab3-9875-5c21a5927d52" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 16:03:49 crc kubenswrapper[5120]: I0316 16:03:49.874178 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="0d22536f-d947-4ab3-9875-5c21a5927d52" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 16:03:49 crc kubenswrapper[5120]: I0316 16:03:49.880659 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:03:49 crc kubenswrapper[5120]: I0316 16:03:49.880800 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:03:49 crc kubenswrapper[5120]: I0316 16:03:49.884239 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-novncproxy-cell1-vencrypt\"" Mar 16 16:03:49 crc kubenswrapper[5120]: I0316 16:03:49.884418 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-novncproxy-config-data\"" Mar 16 16:03:49 crc kubenswrapper[5120]: I0316 16:03:49.884599 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-novncproxy-cell1-public-svc\"" Mar 16 16:03:50 crc kubenswrapper[5120]: I0316 16:03:50.051864 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/33a720a8-2252-4a1c-a6e8-751a7f3e6871-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"33a720a8-2252-4a1c-a6e8-751a7f3e6871\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:03:50 crc kubenswrapper[5120]: I0316 16:03:50.052133 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/33a720a8-2252-4a1c-a6e8-751a7f3e6871-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"33a720a8-2252-4a1c-a6e8-751a7f3e6871\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:03:50 crc kubenswrapper[5120]: I0316 16:03:50.052316 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pfngf\" (UniqueName: \"kubernetes.io/projected/33a720a8-2252-4a1c-a6e8-751a7f3e6871-kube-api-access-pfngf\") pod \"nova-cell1-novncproxy-0\" (UID: \"33a720a8-2252-4a1c-a6e8-751a7f3e6871\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:03:50 crc kubenswrapper[5120]: I0316 16:03:50.052434 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/33a720a8-2252-4a1c-a6e8-751a7f3e6871-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"33a720a8-2252-4a1c-a6e8-751a7f3e6871\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:03:50 crc kubenswrapper[5120]: I0316 16:03:50.052542 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/33a720a8-2252-4a1c-a6e8-751a7f3e6871-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"33a720a8-2252-4a1c-a6e8-751a7f3e6871\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:03:50 crc kubenswrapper[5120]: I0316 16:03:50.156144 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pfngf\" (UniqueName: \"kubernetes.io/projected/33a720a8-2252-4a1c-a6e8-751a7f3e6871-kube-api-access-pfngf\") pod \"nova-cell1-novncproxy-0\" (UID: \"33a720a8-2252-4a1c-a6e8-751a7f3e6871\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:03:50 crc kubenswrapper[5120]: I0316 16:03:50.156257 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/33a720a8-2252-4a1c-a6e8-751a7f3e6871-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"33a720a8-2252-4a1c-a6e8-751a7f3e6871\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:03:50 crc kubenswrapper[5120]: I0316 16:03:50.156292 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/33a720a8-2252-4a1c-a6e8-751a7f3e6871-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"33a720a8-2252-4a1c-a6e8-751a7f3e6871\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:03:50 crc kubenswrapper[5120]: I0316 16:03:50.156559 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/33a720a8-2252-4a1c-a6e8-751a7f3e6871-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"33a720a8-2252-4a1c-a6e8-751a7f3e6871\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:03:50 crc kubenswrapper[5120]: I0316 16:03:50.157558 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/33a720a8-2252-4a1c-a6e8-751a7f3e6871-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"33a720a8-2252-4a1c-a6e8-751a7f3e6871\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:03:50 crc kubenswrapper[5120]: I0316 16:03:50.162093 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/33a720a8-2252-4a1c-a6e8-751a7f3e6871-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"33a720a8-2252-4a1c-a6e8-751a7f3e6871\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:03:50 crc kubenswrapper[5120]: I0316 16:03:50.162276 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/33a720a8-2252-4a1c-a6e8-751a7f3e6871-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"33a720a8-2252-4a1c-a6e8-751a7f3e6871\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:03:50 crc kubenswrapper[5120]: I0316 16:03:50.177951 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/33a720a8-2252-4a1c-a6e8-751a7f3e6871-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"33a720a8-2252-4a1c-a6e8-751a7f3e6871\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:03:50 crc kubenswrapper[5120]: I0316 16:03:50.179907 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/33a720a8-2252-4a1c-a6e8-751a7f3e6871-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"33a720a8-2252-4a1c-a6e8-751a7f3e6871\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:03:50 crc kubenswrapper[5120]: I0316 16:03:50.183288 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pfngf\" (UniqueName: \"kubernetes.io/projected/33a720a8-2252-4a1c-a6e8-751a7f3e6871-kube-api-access-pfngf\") pod \"nova-cell1-novncproxy-0\" (UID: \"33a720a8-2252-4a1c-a6e8-751a7f3e6871\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:03:50 crc kubenswrapper[5120]: I0316 16:03:50.201577 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:03:50 crc kubenswrapper[5120]: I0316 16:03:50.408423 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:03:50 crc kubenswrapper[5120]: I0316 16:03:50.566597 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ad4b50ff-8669-41da-a679-18e16f3c00eb-logs\") pod \"ad4b50ff-8669-41da-a679-18e16f3c00eb\" (UID: \"ad4b50ff-8669-41da-a679-18e16f3c00eb\") " Mar 16 16:03:50 crc kubenswrapper[5120]: I0316 16:03:50.566720 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nxkk6\" (UniqueName: \"kubernetes.io/projected/ad4b50ff-8669-41da-a679-18e16f3c00eb-kube-api-access-nxkk6\") pod \"ad4b50ff-8669-41da-a679-18e16f3c00eb\" (UID: \"ad4b50ff-8669-41da-a679-18e16f3c00eb\") " Mar 16 16:03:50 crc kubenswrapper[5120]: I0316 16:03:50.566934 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ad4b50ff-8669-41da-a679-18e16f3c00eb-config-data\") pod \"ad4b50ff-8669-41da-a679-18e16f3c00eb\" (UID: \"ad4b50ff-8669-41da-a679-18e16f3c00eb\") " Mar 16 16:03:50 crc kubenswrapper[5120]: I0316 16:03:50.567024 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad4b50ff-8669-41da-a679-18e16f3c00eb-logs" (OuterVolumeSpecName: "logs") pod "ad4b50ff-8669-41da-a679-18e16f3c00eb" (UID: "ad4b50ff-8669-41da-a679-18e16f3c00eb"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:03:50 crc kubenswrapper[5120]: I0316 16:03:50.567211 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ad4b50ff-8669-41da-a679-18e16f3c00eb-combined-ca-bundle\") pod \"ad4b50ff-8669-41da-a679-18e16f3c00eb\" (UID: \"ad4b50ff-8669-41da-a679-18e16f3c00eb\") " Mar 16 16:03:50 crc kubenswrapper[5120]: I0316 16:03:50.567848 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ad4b50ff-8669-41da-a679-18e16f3c00eb-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:03:50 crc kubenswrapper[5120]: I0316 16:03:50.573175 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad4b50ff-8669-41da-a679-18e16f3c00eb-kube-api-access-nxkk6" (OuterVolumeSpecName: "kube-api-access-nxkk6") pod "ad4b50ff-8669-41da-a679-18e16f3c00eb" (UID: "ad4b50ff-8669-41da-a679-18e16f3c00eb"). InnerVolumeSpecName "kube-api-access-nxkk6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:03:50 crc kubenswrapper[5120]: I0316 16:03:50.596488 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad4b50ff-8669-41da-a679-18e16f3c00eb-config-data" (OuterVolumeSpecName: "config-data") pod "ad4b50ff-8669-41da-a679-18e16f3c00eb" (UID: "ad4b50ff-8669-41da-a679-18e16f3c00eb"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:03:50 crc kubenswrapper[5120]: I0316 16:03:50.614926 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad4b50ff-8669-41da-a679-18e16f3c00eb-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ad4b50ff-8669-41da-a679-18e16f3c00eb" (UID: "ad4b50ff-8669-41da-a679-18e16f3c00eb"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:03:50 crc kubenswrapper[5120]: I0316 16:03:50.637869 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:03:50 crc kubenswrapper[5120]: I0316 16:03:50.669421 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nxkk6\" (UniqueName: \"kubernetes.io/projected/ad4b50ff-8669-41da-a679-18e16f3c00eb-kube-api-access-nxkk6\") on node \"crc\" DevicePath \"\"" Mar 16 16:03:50 crc kubenswrapper[5120]: I0316 16:03:50.669459 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ad4b50ff-8669-41da-a679-18e16f3c00eb-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:03:50 crc kubenswrapper[5120]: I0316 16:03:50.669475 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ad4b50ff-8669-41da-a679-18e16f3c00eb-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:03:50 crc kubenswrapper[5120]: I0316 16:03:50.681788 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d22536f-d947-4ab3-9875-5c21a5927d52" path="/var/lib/kubelet/pods/0d22536f-d947-4ab3-9875-5c21a5927d52/volumes" Mar 16 16:03:50 crc kubenswrapper[5120]: I0316 16:03:50.685641 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:03:50 crc kubenswrapper[5120]: I0316 16:03:50.790260 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"33a720a8-2252-4a1c-a6e8-751a7f3e6871","Type":"ContainerStarted","Data":"6ab3644f33625bad4faea95127bfdb8bed9e3b14ff10bf01c638ea23f80cefe9"} Mar 16 16:03:50 crc kubenswrapper[5120]: I0316 16:03:50.793150 5120 generic.go:358] "Generic (PLEG): container finished" podID="ad4b50ff-8669-41da-a679-18e16f3c00eb" containerID="0a0dd50b3df957cb2a2b42e3d65c51694a81cadc2ec06306cd9c87022592c3be" exitCode=0 Mar 16 16:03:50 crc kubenswrapper[5120]: I0316 16:03:50.793169 5120 generic.go:358] "Generic (PLEG): container finished" podID="ad4b50ff-8669-41da-a679-18e16f3c00eb" containerID="31de0b88033468fc2535e83bf45e8c9798b36b019cfd4fd87849a6c901d6d529" exitCode=143 Mar 16 16:03:50 crc kubenswrapper[5120]: I0316 16:03:50.793215 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"ad4b50ff-8669-41da-a679-18e16f3c00eb","Type":"ContainerDied","Data":"0a0dd50b3df957cb2a2b42e3d65c51694a81cadc2ec06306cd9c87022592c3be"} Mar 16 16:03:50 crc kubenswrapper[5120]: I0316 16:03:50.793232 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"ad4b50ff-8669-41da-a679-18e16f3c00eb","Type":"ContainerDied","Data":"31de0b88033468fc2535e83bf45e8c9798b36b019cfd4fd87849a6c901d6d529"} Mar 16 16:03:50 crc kubenswrapper[5120]: I0316 16:03:50.793242 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"ad4b50ff-8669-41da-a679-18e16f3c00eb","Type":"ContainerDied","Data":"22400e83386cd055901588d89c2e57c8548da2c011a0610de0eb87b9987d2fcd"} Mar 16 16:03:50 crc kubenswrapper[5120]: I0316 16:03:50.793241 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:03:50 crc kubenswrapper[5120]: I0316 16:03:50.793288 5120 scope.go:117] "RemoveContainer" containerID="0a0dd50b3df957cb2a2b42e3d65c51694a81cadc2ec06306cd9c87022592c3be" Mar 16 16:03:50 crc kubenswrapper[5120]: I0316 16:03:50.840301 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:03:50 crc kubenswrapper[5120]: I0316 16:03:50.840805 5120 scope.go:117] "RemoveContainer" containerID="31de0b88033468fc2535e83bf45e8c9798b36b019cfd4fd87849a6c901d6d529" Mar 16 16:03:50 crc kubenswrapper[5120]: I0316 16:03:50.855420 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:03:50 crc kubenswrapper[5120]: I0316 16:03:50.871227 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:03:50 crc kubenswrapper[5120]: I0316 16:03:50.872559 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad4b50ff-8669-41da-a679-18e16f3c00eb" containerName="nova-metadata-log" Mar 16 16:03:50 crc kubenswrapper[5120]: I0316 16:03:50.872593 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad4b50ff-8669-41da-a679-18e16f3c00eb" containerName="nova-metadata-log" Mar 16 16:03:50 crc kubenswrapper[5120]: I0316 16:03:50.872663 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad4b50ff-8669-41da-a679-18e16f3c00eb" containerName="nova-metadata-metadata" Mar 16 16:03:50 crc kubenswrapper[5120]: I0316 16:03:50.872675 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad4b50ff-8669-41da-a679-18e16f3c00eb" containerName="nova-metadata-metadata" Mar 16 16:03:50 crc kubenswrapper[5120]: I0316 16:03:50.874031 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ad4b50ff-8669-41da-a679-18e16f3c00eb" containerName="nova-metadata-log" Mar 16 16:03:50 crc kubenswrapper[5120]: I0316 16:03:50.874071 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ad4b50ff-8669-41da-a679-18e16f3c00eb" containerName="nova-metadata-metadata" Mar 16 16:03:50 crc kubenswrapper[5120]: I0316 16:03:50.884532 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:03:50 crc kubenswrapper[5120]: I0316 16:03:50.888584 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-metadata-config-data\"" Mar 16 16:03:50 crc kubenswrapper[5120]: I0316 16:03:50.889551 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-metadata-internal-svc\"" Mar 16 16:03:50 crc kubenswrapper[5120]: I0316 16:03:50.910456 5120 scope.go:117] "RemoveContainer" containerID="0a0dd50b3df957cb2a2b42e3d65c51694a81cadc2ec06306cd9c87022592c3be" Mar 16 16:03:50 crc kubenswrapper[5120]: I0316 16:03:50.911964 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:03:50 crc kubenswrapper[5120]: E0316 16:03:50.913855 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a0dd50b3df957cb2a2b42e3d65c51694a81cadc2ec06306cd9c87022592c3be\": container with ID starting with 0a0dd50b3df957cb2a2b42e3d65c51694a81cadc2ec06306cd9c87022592c3be not found: ID does not exist" containerID="0a0dd50b3df957cb2a2b42e3d65c51694a81cadc2ec06306cd9c87022592c3be" Mar 16 16:03:50 crc kubenswrapper[5120]: I0316 16:03:50.913904 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a0dd50b3df957cb2a2b42e3d65c51694a81cadc2ec06306cd9c87022592c3be"} err="failed to get container status \"0a0dd50b3df957cb2a2b42e3d65c51694a81cadc2ec06306cd9c87022592c3be\": rpc error: code = NotFound desc = could not find container \"0a0dd50b3df957cb2a2b42e3d65c51694a81cadc2ec06306cd9c87022592c3be\": container with ID starting with 0a0dd50b3df957cb2a2b42e3d65c51694a81cadc2ec06306cd9c87022592c3be not found: ID does not exist" Mar 16 16:03:50 crc kubenswrapper[5120]: I0316 16:03:50.913925 5120 scope.go:117] "RemoveContainer" containerID="31de0b88033468fc2535e83bf45e8c9798b36b019cfd4fd87849a6c901d6d529" Mar 16 16:03:50 crc kubenswrapper[5120]: E0316 16:03:50.926499 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"31de0b88033468fc2535e83bf45e8c9798b36b019cfd4fd87849a6c901d6d529\": container with ID starting with 31de0b88033468fc2535e83bf45e8c9798b36b019cfd4fd87849a6c901d6d529 not found: ID does not exist" containerID="31de0b88033468fc2535e83bf45e8c9798b36b019cfd4fd87849a6c901d6d529" Mar 16 16:03:50 crc kubenswrapper[5120]: I0316 16:03:50.926666 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31de0b88033468fc2535e83bf45e8c9798b36b019cfd4fd87849a6c901d6d529"} err="failed to get container status \"31de0b88033468fc2535e83bf45e8c9798b36b019cfd4fd87849a6c901d6d529\": rpc error: code = NotFound desc = could not find container \"31de0b88033468fc2535e83bf45e8c9798b36b019cfd4fd87849a6c901d6d529\": container with ID starting with 31de0b88033468fc2535e83bf45e8c9798b36b019cfd4fd87849a6c901d6d529 not found: ID does not exist" Mar 16 16:03:50 crc kubenswrapper[5120]: I0316 16:03:50.926906 5120 scope.go:117] "RemoveContainer" containerID="0a0dd50b3df957cb2a2b42e3d65c51694a81cadc2ec06306cd9c87022592c3be" Mar 16 16:03:50 crc kubenswrapper[5120]: I0316 16:03:50.927715 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a0dd50b3df957cb2a2b42e3d65c51694a81cadc2ec06306cd9c87022592c3be"} err="failed to get container status \"0a0dd50b3df957cb2a2b42e3d65c51694a81cadc2ec06306cd9c87022592c3be\": rpc error: code = NotFound desc = could not find container \"0a0dd50b3df957cb2a2b42e3d65c51694a81cadc2ec06306cd9c87022592c3be\": container with ID starting with 0a0dd50b3df957cb2a2b42e3d65c51694a81cadc2ec06306cd9c87022592c3be not found: ID does not exist" Mar 16 16:03:50 crc kubenswrapper[5120]: I0316 16:03:50.927777 5120 scope.go:117] "RemoveContainer" containerID="31de0b88033468fc2535e83bf45e8c9798b36b019cfd4fd87849a6c901d6d529" Mar 16 16:03:50 crc kubenswrapper[5120]: I0316 16:03:50.931114 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31de0b88033468fc2535e83bf45e8c9798b36b019cfd4fd87849a6c901d6d529"} err="failed to get container status \"31de0b88033468fc2535e83bf45e8c9798b36b019cfd4fd87849a6c901d6d529\": rpc error: code = NotFound desc = could not find container \"31de0b88033468fc2535e83bf45e8c9798b36b019cfd4fd87849a6c901d6d529\": container with ID starting with 31de0b88033468fc2535e83bf45e8c9798b36b019cfd4fd87849a6c901d6d529 not found: ID does not exist" Mar 16 16:03:50 crc kubenswrapper[5120]: I0316 16:03:50.978513 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3ea160fa-c2b4-42af-8a9c-7fa29efc18b9-config-data\") pod \"nova-metadata-0\" (UID: \"3ea160fa-c2b4-42af-8a9c-7fa29efc18b9\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:03:50 crc kubenswrapper[5120]: I0316 16:03:50.978701 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3ea160fa-c2b4-42af-8a9c-7fa29efc18b9-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"3ea160fa-c2b4-42af-8a9c-7fa29efc18b9\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:03:50 crc kubenswrapper[5120]: I0316 16:03:50.978803 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/3ea160fa-c2b4-42af-8a9c-7fa29efc18b9-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"3ea160fa-c2b4-42af-8a9c-7fa29efc18b9\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:03:50 crc kubenswrapper[5120]: I0316 16:03:50.979158 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3ea160fa-c2b4-42af-8a9c-7fa29efc18b9-logs\") pod \"nova-metadata-0\" (UID: \"3ea160fa-c2b4-42af-8a9c-7fa29efc18b9\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:03:50 crc kubenswrapper[5120]: I0316 16:03:50.979584 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fj6hq\" (UniqueName: \"kubernetes.io/projected/3ea160fa-c2b4-42af-8a9c-7fa29efc18b9-kube-api-access-fj6hq\") pod \"nova-metadata-0\" (UID: \"3ea160fa-c2b4-42af-8a9c-7fa29efc18b9\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:03:51 crc kubenswrapper[5120]: I0316 16:03:51.080924 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3ea160fa-c2b4-42af-8a9c-7fa29efc18b9-logs\") pod \"nova-metadata-0\" (UID: \"3ea160fa-c2b4-42af-8a9c-7fa29efc18b9\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:03:51 crc kubenswrapper[5120]: I0316 16:03:51.081281 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fj6hq\" (UniqueName: \"kubernetes.io/projected/3ea160fa-c2b4-42af-8a9c-7fa29efc18b9-kube-api-access-fj6hq\") pod \"nova-metadata-0\" (UID: \"3ea160fa-c2b4-42af-8a9c-7fa29efc18b9\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:03:51 crc kubenswrapper[5120]: I0316 16:03:51.081307 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3ea160fa-c2b4-42af-8a9c-7fa29efc18b9-config-data\") pod \"nova-metadata-0\" (UID: \"3ea160fa-c2b4-42af-8a9c-7fa29efc18b9\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:03:51 crc kubenswrapper[5120]: I0316 16:03:51.081332 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3ea160fa-c2b4-42af-8a9c-7fa29efc18b9-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"3ea160fa-c2b4-42af-8a9c-7fa29efc18b9\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:03:51 crc kubenswrapper[5120]: I0316 16:03:51.081354 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/3ea160fa-c2b4-42af-8a9c-7fa29efc18b9-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"3ea160fa-c2b4-42af-8a9c-7fa29efc18b9\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:03:51 crc kubenswrapper[5120]: I0316 16:03:51.081402 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3ea160fa-c2b4-42af-8a9c-7fa29efc18b9-logs\") pod \"nova-metadata-0\" (UID: \"3ea160fa-c2b4-42af-8a9c-7fa29efc18b9\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:03:51 crc kubenswrapper[5120]: I0316 16:03:51.087036 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/3ea160fa-c2b4-42af-8a9c-7fa29efc18b9-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"3ea160fa-c2b4-42af-8a9c-7fa29efc18b9\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:03:51 crc kubenswrapper[5120]: I0316 16:03:51.088656 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3ea160fa-c2b4-42af-8a9c-7fa29efc18b9-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"3ea160fa-c2b4-42af-8a9c-7fa29efc18b9\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:03:51 crc kubenswrapper[5120]: I0316 16:03:51.089268 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3ea160fa-c2b4-42af-8a9c-7fa29efc18b9-config-data\") pod \"nova-metadata-0\" (UID: \"3ea160fa-c2b4-42af-8a9c-7fa29efc18b9\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:03:51 crc kubenswrapper[5120]: I0316 16:03:51.098985 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fj6hq\" (UniqueName: \"kubernetes.io/projected/3ea160fa-c2b4-42af-8a9c-7fa29efc18b9-kube-api-access-fj6hq\") pod \"nova-metadata-0\" (UID: \"3ea160fa-c2b4-42af-8a9c-7fa29efc18b9\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:03:51 crc kubenswrapper[5120]: I0316 16:03:51.132797 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-tqz8h" Mar 16 16:03:51 crc kubenswrapper[5120]: I0316 16:03:51.215288 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:03:51 crc kubenswrapper[5120]: I0316 16:03:51.284643 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gn9lp\" (UniqueName: \"kubernetes.io/projected/856d23a2-6b17-407a-a435-a89e7bc4c445-kube-api-access-gn9lp\") pod \"856d23a2-6b17-407a-a435-a89e7bc4c445\" (UID: \"856d23a2-6b17-407a-a435-a89e7bc4c445\") " Mar 16 16:03:51 crc kubenswrapper[5120]: I0316 16:03:51.284822 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/856d23a2-6b17-407a-a435-a89e7bc4c445-combined-ca-bundle\") pod \"856d23a2-6b17-407a-a435-a89e7bc4c445\" (UID: \"856d23a2-6b17-407a-a435-a89e7bc4c445\") " Mar 16 16:03:51 crc kubenswrapper[5120]: I0316 16:03:51.284853 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/856d23a2-6b17-407a-a435-a89e7bc4c445-config-data\") pod \"856d23a2-6b17-407a-a435-a89e7bc4c445\" (UID: \"856d23a2-6b17-407a-a435-a89e7bc4c445\") " Mar 16 16:03:51 crc kubenswrapper[5120]: I0316 16:03:51.285010 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/856d23a2-6b17-407a-a435-a89e7bc4c445-scripts\") pod \"856d23a2-6b17-407a-a435-a89e7bc4c445\" (UID: \"856d23a2-6b17-407a-a435-a89e7bc4c445\") " Mar 16 16:03:51 crc kubenswrapper[5120]: I0316 16:03:51.289051 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/856d23a2-6b17-407a-a435-a89e7bc4c445-scripts" (OuterVolumeSpecName: "scripts") pod "856d23a2-6b17-407a-a435-a89e7bc4c445" (UID: "856d23a2-6b17-407a-a435-a89e7bc4c445"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:03:51 crc kubenswrapper[5120]: I0316 16:03:51.289505 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/856d23a2-6b17-407a-a435-a89e7bc4c445-kube-api-access-gn9lp" (OuterVolumeSpecName: "kube-api-access-gn9lp") pod "856d23a2-6b17-407a-a435-a89e7bc4c445" (UID: "856d23a2-6b17-407a-a435-a89e7bc4c445"). InnerVolumeSpecName "kube-api-access-gn9lp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:03:51 crc kubenswrapper[5120]: I0316 16:03:51.318041 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/856d23a2-6b17-407a-a435-a89e7bc4c445-config-data" (OuterVolumeSpecName: "config-data") pod "856d23a2-6b17-407a-a435-a89e7bc4c445" (UID: "856d23a2-6b17-407a-a435-a89e7bc4c445"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:03:51 crc kubenswrapper[5120]: I0316 16:03:51.321687 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/856d23a2-6b17-407a-a435-a89e7bc4c445-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "856d23a2-6b17-407a-a435-a89e7bc4c445" (UID: "856d23a2-6b17-407a-a435-a89e7bc4c445"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:03:51 crc kubenswrapper[5120]: I0316 16:03:51.387655 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/856d23a2-6b17-407a-a435-a89e7bc4c445-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:03:51 crc kubenswrapper[5120]: I0316 16:03:51.387936 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/856d23a2-6b17-407a-a435-a89e7bc4c445-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:03:51 crc kubenswrapper[5120]: I0316 16:03:51.387945 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/856d23a2-6b17-407a-a435-a89e7bc4c445-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:03:51 crc kubenswrapper[5120]: I0316 16:03:51.387955 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gn9lp\" (UniqueName: \"kubernetes.io/projected/856d23a2-6b17-407a-a435-a89e7bc4c445-kube-api-access-gn9lp\") on node \"crc\" DevicePath \"\"" Mar 16 16:03:51 crc kubenswrapper[5120]: I0316 16:03:51.651302 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:03:51 crc kubenswrapper[5120]: W0316 16:03:51.662534 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3ea160fa_c2b4_42af_8a9c_7fa29efc18b9.slice/crio-dceffb1279a2397433f7790ed0feb0b02fbb992517548e509ee2f8d1885562b7 WatchSource:0}: Error finding container dceffb1279a2397433f7790ed0feb0b02fbb992517548e509ee2f8d1885562b7: Status 404 returned error can't find the container with id dceffb1279a2397433f7790ed0feb0b02fbb992517548e509ee2f8d1885562b7 Mar 16 16:03:51 crc kubenswrapper[5120]: I0316 16:03:51.816990 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-tqz8h" Mar 16 16:03:51 crc kubenswrapper[5120]: I0316 16:03:51.816993 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-tqz8h" event={"ID":"856d23a2-6b17-407a-a435-a89e7bc4c445","Type":"ContainerDied","Data":"f4e9a4b0e8e2f8631f99e045c4b824dfdb3a4a01f37a58239d17ee9ef94fa40d"} Mar 16 16:03:51 crc kubenswrapper[5120]: I0316 16:03:51.817141 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f4e9a4b0e8e2f8631f99e045c4b824dfdb3a4a01f37a58239d17ee9ef94fa40d" Mar 16 16:03:51 crc kubenswrapper[5120]: I0316 16:03:51.818481 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"3ea160fa-c2b4-42af-8a9c-7fa29efc18b9","Type":"ContainerStarted","Data":"dceffb1279a2397433f7790ed0feb0b02fbb992517548e509ee2f8d1885562b7"} Mar 16 16:03:51 crc kubenswrapper[5120]: I0316 16:03:51.822394 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"33a720a8-2252-4a1c-a6e8-751a7f3e6871","Type":"ContainerStarted","Data":"cd5e946f1c4c585a2ad263c7a1ae9f67a7f05a0eb9cb2f7345ae0c0d71f40204"} Mar 16 16:03:51 crc kubenswrapper[5120]: I0316 16:03:51.829641 5120 generic.go:358] "Generic (PLEG): container finished" podID="3ae99987-5845-4916-9024-031d345fee06" containerID="028a09947c0847095e60707c2ea9b516a2fe50c377455be0ff8782b5e885df95" exitCode=0 Mar 16 16:03:51 crc kubenswrapper[5120]: I0316 16:03:51.829800 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-5zjn7" event={"ID":"3ae99987-5845-4916-9024-031d345fee06","Type":"ContainerDied","Data":"028a09947c0847095e60707c2ea9b516a2fe50c377455be0ff8782b5e885df95"} Mar 16 16:03:51 crc kubenswrapper[5120]: I0316 16:03:51.882303 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podStartSLOduration=2.882283914 podStartE2EDuration="2.882283914s" podCreationTimestamp="2026-03-16 16:03:49 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:03:51.852626898 +0000 UTC m=+1934.006558595" watchObservedRunningTime="2026-03-16 16:03:51.882283914 +0000 UTC m=+1934.036215581" Mar 16 16:03:51 crc kubenswrapper[5120]: I0316 16:03:51.925413 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 16:03:51 crc kubenswrapper[5120]: I0316 16:03:51.926719 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="856d23a2-6b17-407a-a435-a89e7bc4c445" containerName="nova-cell1-conductor-db-sync" Mar 16 16:03:51 crc kubenswrapper[5120]: I0316 16:03:51.926744 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="856d23a2-6b17-407a-a435-a89e7bc4c445" containerName="nova-cell1-conductor-db-sync" Mar 16 16:03:51 crc kubenswrapper[5120]: I0316 16:03:51.926969 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="856d23a2-6b17-407a-a435-a89e7bc4c445" containerName="nova-cell1-conductor-db-sync" Mar 16 16:03:51 crc kubenswrapper[5120]: I0316 16:03:51.932241 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:03:51 crc kubenswrapper[5120]: I0316 16:03:51.938069 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-conductor-config-data\"" Mar 16 16:03:51 crc kubenswrapper[5120]: I0316 16:03:51.945418 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 16:03:52 crc kubenswrapper[5120]: I0316 16:03:52.003670 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hj8nl\" (UniqueName: \"kubernetes.io/projected/3b57a7de-40e8-484e-a2a9-55454c35ccd0-kube-api-access-hj8nl\") pod \"nova-cell1-conductor-0\" (UID: \"3b57a7de-40e8-484e-a2a9-55454c35ccd0\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:03:52 crc kubenswrapper[5120]: I0316 16:03:52.004018 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3b57a7de-40e8-484e-a2a9-55454c35ccd0-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"3b57a7de-40e8-484e-a2a9-55454c35ccd0\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:03:52 crc kubenswrapper[5120]: I0316 16:03:52.004431 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3b57a7de-40e8-484e-a2a9-55454c35ccd0-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"3b57a7de-40e8-484e-a2a9-55454c35ccd0\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:03:52 crc kubenswrapper[5120]: I0316 16:03:52.107148 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hj8nl\" (UniqueName: \"kubernetes.io/projected/3b57a7de-40e8-484e-a2a9-55454c35ccd0-kube-api-access-hj8nl\") pod \"nova-cell1-conductor-0\" (UID: \"3b57a7de-40e8-484e-a2a9-55454c35ccd0\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:03:52 crc kubenswrapper[5120]: I0316 16:03:52.107933 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3b57a7de-40e8-484e-a2a9-55454c35ccd0-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"3b57a7de-40e8-484e-a2a9-55454c35ccd0\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:03:52 crc kubenswrapper[5120]: I0316 16:03:52.108063 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3b57a7de-40e8-484e-a2a9-55454c35ccd0-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"3b57a7de-40e8-484e-a2a9-55454c35ccd0\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:03:52 crc kubenswrapper[5120]: I0316 16:03:52.114129 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3b57a7de-40e8-484e-a2a9-55454c35ccd0-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"3b57a7de-40e8-484e-a2a9-55454c35ccd0\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:03:52 crc kubenswrapper[5120]: I0316 16:03:52.114827 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3b57a7de-40e8-484e-a2a9-55454c35ccd0-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"3b57a7de-40e8-484e-a2a9-55454c35ccd0\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:03:52 crc kubenswrapper[5120]: I0316 16:03:52.132260 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hj8nl\" (UniqueName: \"kubernetes.io/projected/3b57a7de-40e8-484e-a2a9-55454c35ccd0-kube-api-access-hj8nl\") pod \"nova-cell1-conductor-0\" (UID: \"3b57a7de-40e8-484e-a2a9-55454c35ccd0\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:03:52 crc kubenswrapper[5120]: I0316 16:03:52.264424 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:03:52 crc kubenswrapper[5120]: I0316 16:03:52.672891 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ad4b50ff-8669-41da-a679-18e16f3c00eb" path="/var/lib/kubelet/pods/ad4b50ff-8669-41da-a679-18e16f3c00eb/volumes" Mar 16 16:03:52 crc kubenswrapper[5120]: I0316 16:03:52.792457 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 16:03:52 crc kubenswrapper[5120]: W0316 16:03:52.794848 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3b57a7de_40e8_484e_a2a9_55454c35ccd0.slice/crio-d3864a13b7bfb1ddb33be82ed65404c76208fba69210482cb6367042106f54c2 WatchSource:0}: Error finding container d3864a13b7bfb1ddb33be82ed65404c76208fba69210482cb6367042106f54c2: Status 404 returned error can't find the container with id d3864a13b7bfb1ddb33be82ed65404c76208fba69210482cb6367042106f54c2 Mar 16 16:03:52 crc kubenswrapper[5120]: I0316 16:03:52.841177 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"3ea160fa-c2b4-42af-8a9c-7fa29efc18b9","Type":"ContainerStarted","Data":"5c5d16e37de1a35273bc206e24ce443037d1c67ebfd863211db5545413c937f3"} Mar 16 16:03:52 crc kubenswrapper[5120]: I0316 16:03:52.842155 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"3ea160fa-c2b4-42af-8a9c-7fa29efc18b9","Type":"ContainerStarted","Data":"8c861a2519aabaf14c17f479af262e4d354797c15f58893df6a2c92dbb76d00c"} Mar 16 16:03:52 crc kubenswrapper[5120]: I0316 16:03:52.843340 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"3b57a7de-40e8-484e-a2a9-55454c35ccd0","Type":"ContainerStarted","Data":"d3864a13b7bfb1ddb33be82ed65404c76208fba69210482cb6367042106f54c2"} Mar 16 16:03:52 crc kubenswrapper[5120]: I0316 16:03:52.871742 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=2.871722606 podStartE2EDuration="2.871722606s" podCreationTimestamp="2026-03-16 16:03:50 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:03:52.866969794 +0000 UTC m=+1935.020901501" watchObservedRunningTime="2026-03-16 16:03:52.871722606 +0000 UTC m=+1935.025654263" Mar 16 16:03:53 crc kubenswrapper[5120]: I0316 16:03:53.135382 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-5zjn7" Mar 16 16:03:53 crc kubenswrapper[5120]: I0316 16:03:53.155135 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3ae99987-5845-4916-9024-031d345fee06-combined-ca-bundle\") pod \"3ae99987-5845-4916-9024-031d345fee06\" (UID: \"3ae99987-5845-4916-9024-031d345fee06\") " Mar 16 16:03:53 crc kubenswrapper[5120]: I0316 16:03:53.155259 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3ae99987-5845-4916-9024-031d345fee06-scripts\") pod \"3ae99987-5845-4916-9024-031d345fee06\" (UID: \"3ae99987-5845-4916-9024-031d345fee06\") " Mar 16 16:03:53 crc kubenswrapper[5120]: I0316 16:03:53.155500 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wrkrm\" (UniqueName: \"kubernetes.io/projected/3ae99987-5845-4916-9024-031d345fee06-kube-api-access-wrkrm\") pod \"3ae99987-5845-4916-9024-031d345fee06\" (UID: \"3ae99987-5845-4916-9024-031d345fee06\") " Mar 16 16:03:53 crc kubenswrapper[5120]: I0316 16:03:53.156325 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3ae99987-5845-4916-9024-031d345fee06-config-data\") pod \"3ae99987-5845-4916-9024-031d345fee06\" (UID: \"3ae99987-5845-4916-9024-031d345fee06\") " Mar 16 16:03:53 crc kubenswrapper[5120]: I0316 16:03:53.167960 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3ae99987-5845-4916-9024-031d345fee06-scripts" (OuterVolumeSpecName: "scripts") pod "3ae99987-5845-4916-9024-031d345fee06" (UID: "3ae99987-5845-4916-9024-031d345fee06"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:03:53 crc kubenswrapper[5120]: I0316 16:03:53.167993 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ae99987-5845-4916-9024-031d345fee06-kube-api-access-wrkrm" (OuterVolumeSpecName: "kube-api-access-wrkrm") pod "3ae99987-5845-4916-9024-031d345fee06" (UID: "3ae99987-5845-4916-9024-031d345fee06"). InnerVolumeSpecName "kube-api-access-wrkrm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:03:53 crc kubenswrapper[5120]: I0316 16:03:53.192000 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3ae99987-5845-4916-9024-031d345fee06-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "3ae99987-5845-4916-9024-031d345fee06" (UID: "3ae99987-5845-4916-9024-031d345fee06"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:03:53 crc kubenswrapper[5120]: I0316 16:03:53.213062 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3ae99987-5845-4916-9024-031d345fee06-config-data" (OuterVolumeSpecName: "config-data") pod "3ae99987-5845-4916-9024-031d345fee06" (UID: "3ae99987-5845-4916-9024-031d345fee06"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:03:53 crc kubenswrapper[5120]: I0316 16:03:53.258683 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wrkrm\" (UniqueName: \"kubernetes.io/projected/3ae99987-5845-4916-9024-031d345fee06-kube-api-access-wrkrm\") on node \"crc\" DevicePath \"\"" Mar 16 16:03:53 crc kubenswrapper[5120]: I0316 16:03:53.258711 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3ae99987-5845-4916-9024-031d345fee06-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:03:53 crc kubenswrapper[5120]: I0316 16:03:53.258721 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3ae99987-5845-4916-9024-031d345fee06-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:03:53 crc kubenswrapper[5120]: I0316 16:03:53.258729 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3ae99987-5845-4916-9024-031d345fee06-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:03:53 crc kubenswrapper[5120]: I0316 16:03:53.364187 5120 scope.go:117] "RemoveContainer" containerID="b884980f08f1614c3f23c5cb87d3d4638e85ecf8698ec49ee2836342dcf7cb4f" Mar 16 16:03:53 crc kubenswrapper[5120]: I0316 16:03:53.386723 5120 scope.go:117] "RemoveContainer" containerID="be08c6b31ab15bb00fdbf4925e690530157d077f8bd4226fabd3e129d5a8e362" Mar 16 16:03:53 crc kubenswrapper[5120]: I0316 16:03:53.436175 5120 scope.go:117] "RemoveContainer" containerID="15e7d9f911ea86ee3518595b078428438c53be39762b01f1bd1bf5f737abe254" Mar 16 16:03:53 crc kubenswrapper[5120]: I0316 16:03:53.460819 5120 scope.go:117] "RemoveContainer" containerID="8d56dff3455e29f82e0859f8794ce8f2b45665ee473c44ad5a45bc744e314e18" Mar 16 16:03:53 crc kubenswrapper[5120]: I0316 16:03:53.488019 5120 scope.go:117] "RemoveContainer" containerID="383af44933828e287b95b36f80d5514e2447d0cba7ad37a2d0b63229052a043d" Mar 16 16:03:53 crc kubenswrapper[5120]: I0316 16:03:53.537120 5120 scope.go:117] "RemoveContainer" containerID="3f40609bb59992f386824ef9bfcbd2e80ed40590fce3abedcac7e555b1f885e0" Mar 16 16:03:53 crc kubenswrapper[5120]: I0316 16:03:53.857485 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"3b57a7de-40e8-484e-a2a9-55454c35ccd0","Type":"ContainerStarted","Data":"e5ac583ccc9724ef6e7100e99c0c22e3b118431b2c90d1bb0d71d736f0583622"} Mar 16 16:03:53 crc kubenswrapper[5120]: I0316 16:03:53.858607 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:03:53 crc kubenswrapper[5120]: I0316 16:03:53.863501 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-5zjn7" Mar 16 16:03:53 crc kubenswrapper[5120]: I0316 16:03:53.872008 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-5zjn7" event={"ID":"3ae99987-5845-4916-9024-031d345fee06","Type":"ContainerDied","Data":"21df590228ff3908c241c51db6118a63efaec14da26271f5b43ff0c47dd578d7"} Mar 16 16:03:53 crc kubenswrapper[5120]: I0316 16:03:53.872067 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="21df590228ff3908c241c51db6118a63efaec14da26271f5b43ff0c47dd578d7" Mar 16 16:03:53 crc kubenswrapper[5120]: I0316 16:03:53.885157 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podStartSLOduration=2.885131427 podStartE2EDuration="2.885131427s" podCreationTimestamp="2026-03-16 16:03:51 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:03:53.874733231 +0000 UTC m=+1936.028664928" watchObservedRunningTime="2026-03-16 16:03:53.885131427 +0000 UTC m=+1936.039063094" Mar 16 16:03:54 crc kubenswrapper[5120]: I0316 16:03:54.082229 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:03:54 crc kubenswrapper[5120]: I0316 16:03:54.082863 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="cec15169-61f9-4254-be1a-dc19a7e98bbb" containerName="nova-api-log" containerID="cri-o://0e1c259da4e35d77164912b003d53e4d0974b0cf31e42801fbcaf3f4ef53faf9" gracePeriod=30 Mar 16 16:03:54 crc kubenswrapper[5120]: I0316 16:03:54.083349 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="cec15169-61f9-4254-be1a-dc19a7e98bbb" containerName="nova-api-api" containerID="cri-o://4c4ef40b01fcf9f56c526b166ec7810328b9b14ceeb829036d9c271714317b80" gracePeriod=30 Mar 16 16:03:54 crc kubenswrapper[5120]: I0316 16:03:54.099468 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:03:54 crc kubenswrapper[5120]: I0316 16:03:54.099778 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="b5bf0d44-4150-48c2-82a3-7f4a1de0ba14" containerName="nova-scheduler-scheduler" containerID="cri-o://a7774028fec91d27489817ab85d374796adb8697ff20ded2f2c2e1d57763a8f4" gracePeriod=30 Mar 16 16:03:54 crc kubenswrapper[5120]: I0316 16:03:54.110476 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:03:54 crc kubenswrapper[5120]: E0316 16:03:54.415043 5120 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcec15169_61f9_4254_be1a_dc19a7e98bbb.slice/crio-conmon-4c4ef40b01fcf9f56c526b166ec7810328b9b14ceeb829036d9c271714317b80.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcec15169_61f9_4254_be1a_dc19a7e98bbb.slice/crio-4c4ef40b01fcf9f56c526b166ec7810328b9b14ceeb829036d9c271714317b80.scope\": RecentStats: unable to find data in memory cache]" Mar 16 16:03:54 crc kubenswrapper[5120]: I0316 16:03:54.709466 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:03:54 crc kubenswrapper[5120]: I0316 16:03:54.794147 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-588tl\" (UniqueName: \"kubernetes.io/projected/cec15169-61f9-4254-be1a-dc19a7e98bbb-kube-api-access-588tl\") pod \"cec15169-61f9-4254-be1a-dc19a7e98bbb\" (UID: \"cec15169-61f9-4254-be1a-dc19a7e98bbb\") " Mar 16 16:03:54 crc kubenswrapper[5120]: I0316 16:03:54.794330 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cec15169-61f9-4254-be1a-dc19a7e98bbb-combined-ca-bundle\") pod \"cec15169-61f9-4254-be1a-dc19a7e98bbb\" (UID: \"cec15169-61f9-4254-be1a-dc19a7e98bbb\") " Mar 16 16:03:54 crc kubenswrapper[5120]: I0316 16:03:54.795561 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cec15169-61f9-4254-be1a-dc19a7e98bbb-config-data\") pod \"cec15169-61f9-4254-be1a-dc19a7e98bbb\" (UID: \"cec15169-61f9-4254-be1a-dc19a7e98bbb\") " Mar 16 16:03:54 crc kubenswrapper[5120]: I0316 16:03:54.795773 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/cec15169-61f9-4254-be1a-dc19a7e98bbb-logs\") pod \"cec15169-61f9-4254-be1a-dc19a7e98bbb\" (UID: \"cec15169-61f9-4254-be1a-dc19a7e98bbb\") " Mar 16 16:03:54 crc kubenswrapper[5120]: I0316 16:03:54.796138 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cec15169-61f9-4254-be1a-dc19a7e98bbb-logs" (OuterVolumeSpecName: "logs") pod "cec15169-61f9-4254-be1a-dc19a7e98bbb" (UID: "cec15169-61f9-4254-be1a-dc19a7e98bbb"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:03:54 crc kubenswrapper[5120]: I0316 16:03:54.796694 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/cec15169-61f9-4254-be1a-dc19a7e98bbb-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:03:54 crc kubenswrapper[5120]: I0316 16:03:54.799857 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cec15169-61f9-4254-be1a-dc19a7e98bbb-kube-api-access-588tl" (OuterVolumeSpecName: "kube-api-access-588tl") pod "cec15169-61f9-4254-be1a-dc19a7e98bbb" (UID: "cec15169-61f9-4254-be1a-dc19a7e98bbb"). InnerVolumeSpecName "kube-api-access-588tl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:03:54 crc kubenswrapper[5120]: I0316 16:03:54.825263 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cec15169-61f9-4254-be1a-dc19a7e98bbb-config-data" (OuterVolumeSpecName: "config-data") pod "cec15169-61f9-4254-be1a-dc19a7e98bbb" (UID: "cec15169-61f9-4254-be1a-dc19a7e98bbb"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:03:54 crc kubenswrapper[5120]: I0316 16:03:54.830576 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cec15169-61f9-4254-be1a-dc19a7e98bbb-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "cec15169-61f9-4254-be1a-dc19a7e98bbb" (UID: "cec15169-61f9-4254-be1a-dc19a7e98bbb"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:03:54 crc kubenswrapper[5120]: I0316 16:03:54.877833 5120 generic.go:358] "Generic (PLEG): container finished" podID="cec15169-61f9-4254-be1a-dc19a7e98bbb" containerID="4c4ef40b01fcf9f56c526b166ec7810328b9b14ceeb829036d9c271714317b80" exitCode=0 Mar 16 16:03:54 crc kubenswrapper[5120]: I0316 16:03:54.878972 5120 generic.go:358] "Generic (PLEG): container finished" podID="cec15169-61f9-4254-be1a-dc19a7e98bbb" containerID="0e1c259da4e35d77164912b003d53e4d0974b0cf31e42801fbcaf3f4ef53faf9" exitCode=143 Mar 16 16:03:54 crc kubenswrapper[5120]: I0316 16:03:54.877905 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:03:54 crc kubenswrapper[5120]: I0316 16:03:54.877906 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"cec15169-61f9-4254-be1a-dc19a7e98bbb","Type":"ContainerDied","Data":"4c4ef40b01fcf9f56c526b166ec7810328b9b14ceeb829036d9c271714317b80"} Mar 16 16:03:54 crc kubenswrapper[5120]: I0316 16:03:54.879523 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"cec15169-61f9-4254-be1a-dc19a7e98bbb","Type":"ContainerDied","Data":"0e1c259da4e35d77164912b003d53e4d0974b0cf31e42801fbcaf3f4ef53faf9"} Mar 16 16:03:54 crc kubenswrapper[5120]: I0316 16:03:54.879550 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"cec15169-61f9-4254-be1a-dc19a7e98bbb","Type":"ContainerDied","Data":"a02595eb0223c99dc359e2e71900c61a26591b96a49aa7a082079ad5ed28f269"} Mar 16 16:03:54 crc kubenswrapper[5120]: I0316 16:03:54.879573 5120 scope.go:117] "RemoveContainer" containerID="4c4ef40b01fcf9f56c526b166ec7810328b9b14ceeb829036d9c271714317b80" Mar 16 16:03:54 crc kubenswrapper[5120]: I0316 16:03:54.880177 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="3ea160fa-c2b4-42af-8a9c-7fa29efc18b9" containerName="nova-metadata-log" containerID="cri-o://8c861a2519aabaf14c17f479af262e4d354797c15f58893df6a2c92dbb76d00c" gracePeriod=30 Mar 16 16:03:54 crc kubenswrapper[5120]: I0316 16:03:54.880271 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="3ea160fa-c2b4-42af-8a9c-7fa29efc18b9" containerName="nova-metadata-metadata" containerID="cri-o://5c5d16e37de1a35273bc206e24ce443037d1c67ebfd863211db5545413c937f3" gracePeriod=30 Mar 16 16:03:54 crc kubenswrapper[5120]: I0316 16:03:54.900046 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cec15169-61f9-4254-be1a-dc19a7e98bbb-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:03:54 crc kubenswrapper[5120]: I0316 16:03:54.900079 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cec15169-61f9-4254-be1a-dc19a7e98bbb-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:03:54 crc kubenswrapper[5120]: I0316 16:03:54.900090 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-588tl\" (UniqueName: \"kubernetes.io/projected/cec15169-61f9-4254-be1a-dc19a7e98bbb-kube-api-access-588tl\") on node \"crc\" DevicePath \"\"" Mar 16 16:03:54 crc kubenswrapper[5120]: I0316 16:03:54.914882 5120 scope.go:117] "RemoveContainer" containerID="0e1c259da4e35d77164912b003d53e4d0974b0cf31e42801fbcaf3f4ef53faf9" Mar 16 16:03:54 crc kubenswrapper[5120]: I0316 16:03:54.926081 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:03:54 crc kubenswrapper[5120]: I0316 16:03:54.933150 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:03:54 crc kubenswrapper[5120]: I0316 16:03:54.957834 5120 scope.go:117] "RemoveContainer" containerID="4c4ef40b01fcf9f56c526b166ec7810328b9b14ceeb829036d9c271714317b80" Mar 16 16:03:54 crc kubenswrapper[5120]: E0316 16:03:54.962092 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c4ef40b01fcf9f56c526b166ec7810328b9b14ceeb829036d9c271714317b80\": container with ID starting with 4c4ef40b01fcf9f56c526b166ec7810328b9b14ceeb829036d9c271714317b80 not found: ID does not exist" containerID="4c4ef40b01fcf9f56c526b166ec7810328b9b14ceeb829036d9c271714317b80" Mar 16 16:03:54 crc kubenswrapper[5120]: I0316 16:03:54.962299 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c4ef40b01fcf9f56c526b166ec7810328b9b14ceeb829036d9c271714317b80"} err="failed to get container status \"4c4ef40b01fcf9f56c526b166ec7810328b9b14ceeb829036d9c271714317b80\": rpc error: code = NotFound desc = could not find container \"4c4ef40b01fcf9f56c526b166ec7810328b9b14ceeb829036d9c271714317b80\": container with ID starting with 4c4ef40b01fcf9f56c526b166ec7810328b9b14ceeb829036d9c271714317b80 not found: ID does not exist" Mar 16 16:03:54 crc kubenswrapper[5120]: I0316 16:03:54.962339 5120 scope.go:117] "RemoveContainer" containerID="0e1c259da4e35d77164912b003d53e4d0974b0cf31e42801fbcaf3f4ef53faf9" Mar 16 16:03:54 crc kubenswrapper[5120]: E0316 16:03:54.966944 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0e1c259da4e35d77164912b003d53e4d0974b0cf31e42801fbcaf3f4ef53faf9\": container with ID starting with 0e1c259da4e35d77164912b003d53e4d0974b0cf31e42801fbcaf3f4ef53faf9 not found: ID does not exist" containerID="0e1c259da4e35d77164912b003d53e4d0974b0cf31e42801fbcaf3f4ef53faf9" Mar 16 16:03:54 crc kubenswrapper[5120]: I0316 16:03:54.967012 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e1c259da4e35d77164912b003d53e4d0974b0cf31e42801fbcaf3f4ef53faf9"} err="failed to get container status \"0e1c259da4e35d77164912b003d53e4d0974b0cf31e42801fbcaf3f4ef53faf9\": rpc error: code = NotFound desc = could not find container \"0e1c259da4e35d77164912b003d53e4d0974b0cf31e42801fbcaf3f4ef53faf9\": container with ID starting with 0e1c259da4e35d77164912b003d53e4d0974b0cf31e42801fbcaf3f4ef53faf9 not found: ID does not exist" Mar 16 16:03:54 crc kubenswrapper[5120]: I0316 16:03:54.967050 5120 scope.go:117] "RemoveContainer" containerID="4c4ef40b01fcf9f56c526b166ec7810328b9b14ceeb829036d9c271714317b80" Mar 16 16:03:54 crc kubenswrapper[5120]: I0316 16:03:54.967860 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c4ef40b01fcf9f56c526b166ec7810328b9b14ceeb829036d9c271714317b80"} err="failed to get container status \"4c4ef40b01fcf9f56c526b166ec7810328b9b14ceeb829036d9c271714317b80\": rpc error: code = NotFound desc = could not find container \"4c4ef40b01fcf9f56c526b166ec7810328b9b14ceeb829036d9c271714317b80\": container with ID starting with 4c4ef40b01fcf9f56c526b166ec7810328b9b14ceeb829036d9c271714317b80 not found: ID does not exist" Mar 16 16:03:54 crc kubenswrapper[5120]: I0316 16:03:54.967901 5120 scope.go:117] "RemoveContainer" containerID="0e1c259da4e35d77164912b003d53e4d0974b0cf31e42801fbcaf3f4ef53faf9" Mar 16 16:03:54 crc kubenswrapper[5120]: I0316 16:03:54.969775 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:03:54 crc kubenswrapper[5120]: I0316 16:03:54.970873 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cec15169-61f9-4254-be1a-dc19a7e98bbb" containerName="nova-api-api" Mar 16 16:03:54 crc kubenswrapper[5120]: I0316 16:03:54.970885 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="cec15169-61f9-4254-be1a-dc19a7e98bbb" containerName="nova-api-api" Mar 16 16:03:54 crc kubenswrapper[5120]: I0316 16:03:54.970915 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cec15169-61f9-4254-be1a-dc19a7e98bbb" containerName="nova-api-log" Mar 16 16:03:54 crc kubenswrapper[5120]: I0316 16:03:54.970922 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="cec15169-61f9-4254-be1a-dc19a7e98bbb" containerName="nova-api-log" Mar 16 16:03:54 crc kubenswrapper[5120]: I0316 16:03:54.970945 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ae99987-5845-4916-9024-031d345fee06" containerName="nova-manage" Mar 16 16:03:54 crc kubenswrapper[5120]: I0316 16:03:54.970951 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ae99987-5845-4916-9024-031d345fee06" containerName="nova-manage" Mar 16 16:03:54 crc kubenswrapper[5120]: I0316 16:03:54.971199 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="cec15169-61f9-4254-be1a-dc19a7e98bbb" containerName="nova-api-log" Mar 16 16:03:54 crc kubenswrapper[5120]: I0316 16:03:54.971213 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="3ae99987-5845-4916-9024-031d345fee06" containerName="nova-manage" Mar 16 16:03:54 crc kubenswrapper[5120]: I0316 16:03:54.971223 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="cec15169-61f9-4254-be1a-dc19a7e98bbb" containerName="nova-api-api" Mar 16 16:03:54 crc kubenswrapper[5120]: I0316 16:03:54.973231 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e1c259da4e35d77164912b003d53e4d0974b0cf31e42801fbcaf3f4ef53faf9"} err="failed to get container status \"0e1c259da4e35d77164912b003d53e4d0974b0cf31e42801fbcaf3f4ef53faf9\": rpc error: code = NotFound desc = could not find container \"0e1c259da4e35d77164912b003d53e4d0974b0cf31e42801fbcaf3f4ef53faf9\": container with ID starting with 0e1c259da4e35d77164912b003d53e4d0974b0cf31e42801fbcaf3f4ef53faf9 not found: ID does not exist" Mar 16 16:03:54 crc kubenswrapper[5120]: I0316 16:03:54.979359 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:03:54 crc kubenswrapper[5120]: I0316 16:03:54.984184 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-config-data\"" Mar 16 16:03:54 crc kubenswrapper[5120]: I0316 16:03:54.987888 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:03:55 crc kubenswrapper[5120]: I0316 16:03:55.002805 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8cd43ab9-76e5-4675-9dc3-73ca6fd27367-config-data\") pod \"nova-api-0\" (UID: \"8cd43ab9-76e5-4675-9dc3-73ca6fd27367\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:03:55 crc kubenswrapper[5120]: I0316 16:03:55.002861 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8cd43ab9-76e5-4675-9dc3-73ca6fd27367-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"8cd43ab9-76e5-4675-9dc3-73ca6fd27367\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:03:55 crc kubenswrapper[5120]: I0316 16:03:55.002953 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w9rfr\" (UniqueName: \"kubernetes.io/projected/8cd43ab9-76e5-4675-9dc3-73ca6fd27367-kube-api-access-w9rfr\") pod \"nova-api-0\" (UID: \"8cd43ab9-76e5-4675-9dc3-73ca6fd27367\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:03:55 crc kubenswrapper[5120]: I0316 16:03:55.003058 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8cd43ab9-76e5-4675-9dc3-73ca6fd27367-logs\") pod \"nova-api-0\" (UID: \"8cd43ab9-76e5-4675-9dc3-73ca6fd27367\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:03:55 crc kubenswrapper[5120]: I0316 16:03:55.105895 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w9rfr\" (UniqueName: \"kubernetes.io/projected/8cd43ab9-76e5-4675-9dc3-73ca6fd27367-kube-api-access-w9rfr\") pod \"nova-api-0\" (UID: \"8cd43ab9-76e5-4675-9dc3-73ca6fd27367\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:03:55 crc kubenswrapper[5120]: I0316 16:03:55.106052 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8cd43ab9-76e5-4675-9dc3-73ca6fd27367-logs\") pod \"nova-api-0\" (UID: \"8cd43ab9-76e5-4675-9dc3-73ca6fd27367\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:03:55 crc kubenswrapper[5120]: I0316 16:03:55.106236 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8cd43ab9-76e5-4675-9dc3-73ca6fd27367-config-data\") pod \"nova-api-0\" (UID: \"8cd43ab9-76e5-4675-9dc3-73ca6fd27367\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:03:55 crc kubenswrapper[5120]: I0316 16:03:55.106273 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8cd43ab9-76e5-4675-9dc3-73ca6fd27367-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"8cd43ab9-76e5-4675-9dc3-73ca6fd27367\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:03:55 crc kubenswrapper[5120]: I0316 16:03:55.106963 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8cd43ab9-76e5-4675-9dc3-73ca6fd27367-logs\") pod \"nova-api-0\" (UID: \"8cd43ab9-76e5-4675-9dc3-73ca6fd27367\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:03:55 crc kubenswrapper[5120]: I0316 16:03:55.111368 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8cd43ab9-76e5-4675-9dc3-73ca6fd27367-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"8cd43ab9-76e5-4675-9dc3-73ca6fd27367\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:03:55 crc kubenswrapper[5120]: I0316 16:03:55.114996 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8cd43ab9-76e5-4675-9dc3-73ca6fd27367-config-data\") pod \"nova-api-0\" (UID: \"8cd43ab9-76e5-4675-9dc3-73ca6fd27367\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:03:55 crc kubenswrapper[5120]: I0316 16:03:55.125223 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w9rfr\" (UniqueName: \"kubernetes.io/projected/8cd43ab9-76e5-4675-9dc3-73ca6fd27367-kube-api-access-w9rfr\") pod \"nova-api-0\" (UID: \"8cd43ab9-76e5-4675-9dc3-73ca6fd27367\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:03:55 crc kubenswrapper[5120]: I0316 16:03:55.201856 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:03:55 crc kubenswrapper[5120]: I0316 16:03:55.360303 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:03:55 crc kubenswrapper[5120]: I0316 16:03:55.363015 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:03:55 crc kubenswrapper[5120]: I0316 16:03:55.412132 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3ea160fa-c2b4-42af-8a9c-7fa29efc18b9-combined-ca-bundle\") pod \"3ea160fa-c2b4-42af-8a9c-7fa29efc18b9\" (UID: \"3ea160fa-c2b4-42af-8a9c-7fa29efc18b9\") " Mar 16 16:03:55 crc kubenswrapper[5120]: I0316 16:03:55.412274 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3ea160fa-c2b4-42af-8a9c-7fa29efc18b9-logs\") pod \"3ea160fa-c2b4-42af-8a9c-7fa29efc18b9\" (UID: \"3ea160fa-c2b4-42af-8a9c-7fa29efc18b9\") " Mar 16 16:03:55 crc kubenswrapper[5120]: I0316 16:03:55.412386 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3ea160fa-c2b4-42af-8a9c-7fa29efc18b9-config-data\") pod \"3ea160fa-c2b4-42af-8a9c-7fa29efc18b9\" (UID: \"3ea160fa-c2b4-42af-8a9c-7fa29efc18b9\") " Mar 16 16:03:55 crc kubenswrapper[5120]: I0316 16:03:55.412401 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/3ea160fa-c2b4-42af-8a9c-7fa29efc18b9-nova-metadata-tls-certs\") pod \"3ea160fa-c2b4-42af-8a9c-7fa29efc18b9\" (UID: \"3ea160fa-c2b4-42af-8a9c-7fa29efc18b9\") " Mar 16 16:03:55 crc kubenswrapper[5120]: I0316 16:03:55.412533 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fj6hq\" (UniqueName: \"kubernetes.io/projected/3ea160fa-c2b4-42af-8a9c-7fa29efc18b9-kube-api-access-fj6hq\") pod \"3ea160fa-c2b4-42af-8a9c-7fa29efc18b9\" (UID: \"3ea160fa-c2b4-42af-8a9c-7fa29efc18b9\") " Mar 16 16:03:55 crc kubenswrapper[5120]: I0316 16:03:55.414068 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ea160fa-c2b4-42af-8a9c-7fa29efc18b9-logs" (OuterVolumeSpecName: "logs") pod "3ea160fa-c2b4-42af-8a9c-7fa29efc18b9" (UID: "3ea160fa-c2b4-42af-8a9c-7fa29efc18b9"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:03:55 crc kubenswrapper[5120]: I0316 16:03:55.425803 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ea160fa-c2b4-42af-8a9c-7fa29efc18b9-kube-api-access-fj6hq" (OuterVolumeSpecName: "kube-api-access-fj6hq") pod "3ea160fa-c2b4-42af-8a9c-7fa29efc18b9" (UID: "3ea160fa-c2b4-42af-8a9c-7fa29efc18b9"). InnerVolumeSpecName "kube-api-access-fj6hq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:03:55 crc kubenswrapper[5120]: I0316 16:03:55.492716 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3ea160fa-c2b4-42af-8a9c-7fa29efc18b9-config-data" (OuterVolumeSpecName: "config-data") pod "3ea160fa-c2b4-42af-8a9c-7fa29efc18b9" (UID: "3ea160fa-c2b4-42af-8a9c-7fa29efc18b9"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:03:55 crc kubenswrapper[5120]: I0316 16:03:55.506945 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3ea160fa-c2b4-42af-8a9c-7fa29efc18b9-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "3ea160fa-c2b4-42af-8a9c-7fa29efc18b9" (UID: "3ea160fa-c2b4-42af-8a9c-7fa29efc18b9"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:03:55 crc kubenswrapper[5120]: I0316 16:03:55.514368 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3ea160fa-c2b4-42af-8a9c-7fa29efc18b9-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:03:55 crc kubenswrapper[5120]: I0316 16:03:55.514402 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3ea160fa-c2b4-42af-8a9c-7fa29efc18b9-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:03:55 crc kubenswrapper[5120]: I0316 16:03:55.514434 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3ea160fa-c2b4-42af-8a9c-7fa29efc18b9-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:03:55 crc kubenswrapper[5120]: I0316 16:03:55.514444 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fj6hq\" (UniqueName: \"kubernetes.io/projected/3ea160fa-c2b4-42af-8a9c-7fa29efc18b9-kube-api-access-fj6hq\") on node \"crc\" DevicePath \"\"" Mar 16 16:03:55 crc kubenswrapper[5120]: I0316 16:03:55.533865 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3ea160fa-c2b4-42af-8a9c-7fa29efc18b9-nova-metadata-tls-certs" (OuterVolumeSpecName: "nova-metadata-tls-certs") pod "3ea160fa-c2b4-42af-8a9c-7fa29efc18b9" (UID: "3ea160fa-c2b4-42af-8a9c-7fa29efc18b9"). InnerVolumeSpecName "nova-metadata-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:03:55 crc kubenswrapper[5120]: I0316 16:03:55.616356 5120 reconciler_common.go:299] "Volume detached for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/3ea160fa-c2b4-42af-8a9c-7fa29efc18b9-nova-metadata-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:03:55 crc kubenswrapper[5120]: I0316 16:03:55.892889 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:03:55 crc kubenswrapper[5120]: W0316 16:03:55.896730 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8cd43ab9_76e5_4675_9dc3_73ca6fd27367.slice/crio-42a373f3f8c70a45eb202f960f7e08764c957df6d950e0468a2b693aeecf20eb WatchSource:0}: Error finding container 42a373f3f8c70a45eb202f960f7e08764c957df6d950e0468a2b693aeecf20eb: Status 404 returned error can't find the container with id 42a373f3f8c70a45eb202f960f7e08764c957df6d950e0468a2b693aeecf20eb Mar 16 16:03:55 crc kubenswrapper[5120]: I0316 16:03:55.896806 5120 generic.go:358] "Generic (PLEG): container finished" podID="3ea160fa-c2b4-42af-8a9c-7fa29efc18b9" containerID="5c5d16e37de1a35273bc206e24ce443037d1c67ebfd863211db5545413c937f3" exitCode=0 Mar 16 16:03:55 crc kubenswrapper[5120]: I0316 16:03:55.896832 5120 generic.go:358] "Generic (PLEG): container finished" podID="3ea160fa-c2b4-42af-8a9c-7fa29efc18b9" containerID="8c861a2519aabaf14c17f479af262e4d354797c15f58893df6a2c92dbb76d00c" exitCode=143 Mar 16 16:03:55 crc kubenswrapper[5120]: I0316 16:03:55.896983 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:03:55 crc kubenswrapper[5120]: I0316 16:03:55.897068 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"3ea160fa-c2b4-42af-8a9c-7fa29efc18b9","Type":"ContainerDied","Data":"5c5d16e37de1a35273bc206e24ce443037d1c67ebfd863211db5545413c937f3"} Mar 16 16:03:55 crc kubenswrapper[5120]: I0316 16:03:55.897099 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"3ea160fa-c2b4-42af-8a9c-7fa29efc18b9","Type":"ContainerDied","Data":"8c861a2519aabaf14c17f479af262e4d354797c15f58893df6a2c92dbb76d00c"} Mar 16 16:03:55 crc kubenswrapper[5120]: I0316 16:03:55.897111 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"3ea160fa-c2b4-42af-8a9c-7fa29efc18b9","Type":"ContainerDied","Data":"dceffb1279a2397433f7790ed0feb0b02fbb992517548e509ee2f8d1885562b7"} Mar 16 16:03:55 crc kubenswrapper[5120]: I0316 16:03:55.897131 5120 scope.go:117] "RemoveContainer" containerID="5c5d16e37de1a35273bc206e24ce443037d1c67ebfd863211db5545413c937f3" Mar 16 16:03:55 crc kubenswrapper[5120]: I0316 16:03:55.949387 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:03:55 crc kubenswrapper[5120]: I0316 16:03:55.955990 5120 scope.go:117] "RemoveContainer" containerID="8c861a2519aabaf14c17f479af262e4d354797c15f58893df6a2c92dbb76d00c" Mar 16 16:03:55 crc kubenswrapper[5120]: I0316 16:03:55.961555 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:03:55 crc kubenswrapper[5120]: I0316 16:03:55.973028 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:03:55 crc kubenswrapper[5120]: I0316 16:03:55.974364 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ea160fa-c2b4-42af-8a9c-7fa29efc18b9" containerName="nova-metadata-log" Mar 16 16:03:55 crc kubenswrapper[5120]: I0316 16:03:55.974393 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ea160fa-c2b4-42af-8a9c-7fa29efc18b9" containerName="nova-metadata-log" Mar 16 16:03:55 crc kubenswrapper[5120]: I0316 16:03:55.974444 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ea160fa-c2b4-42af-8a9c-7fa29efc18b9" containerName="nova-metadata-metadata" Mar 16 16:03:55 crc kubenswrapper[5120]: I0316 16:03:55.974452 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ea160fa-c2b4-42af-8a9c-7fa29efc18b9" containerName="nova-metadata-metadata" Mar 16 16:03:55 crc kubenswrapper[5120]: I0316 16:03:55.974735 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="3ea160fa-c2b4-42af-8a9c-7fa29efc18b9" containerName="nova-metadata-log" Mar 16 16:03:55 crc kubenswrapper[5120]: I0316 16:03:55.974791 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="3ea160fa-c2b4-42af-8a9c-7fa29efc18b9" containerName="nova-metadata-metadata" Mar 16 16:03:55 crc kubenswrapper[5120]: I0316 16:03:55.981301 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:03:55 crc kubenswrapper[5120]: I0316 16:03:55.985326 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:03:55 crc kubenswrapper[5120]: I0316 16:03:55.987107 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-metadata-config-data\"" Mar 16 16:03:55 crc kubenswrapper[5120]: I0316 16:03:55.987968 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-metadata-internal-svc\"" Mar 16 16:03:55 crc kubenswrapper[5120]: I0316 16:03:55.996415 5120 scope.go:117] "RemoveContainer" containerID="5c5d16e37de1a35273bc206e24ce443037d1c67ebfd863211db5545413c937f3" Mar 16 16:03:55 crc kubenswrapper[5120]: E0316 16:03:55.997178 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c5d16e37de1a35273bc206e24ce443037d1c67ebfd863211db5545413c937f3\": container with ID starting with 5c5d16e37de1a35273bc206e24ce443037d1c67ebfd863211db5545413c937f3 not found: ID does not exist" containerID="5c5d16e37de1a35273bc206e24ce443037d1c67ebfd863211db5545413c937f3" Mar 16 16:03:55 crc kubenswrapper[5120]: I0316 16:03:55.997238 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c5d16e37de1a35273bc206e24ce443037d1c67ebfd863211db5545413c937f3"} err="failed to get container status \"5c5d16e37de1a35273bc206e24ce443037d1c67ebfd863211db5545413c937f3\": rpc error: code = NotFound desc = could not find container \"5c5d16e37de1a35273bc206e24ce443037d1c67ebfd863211db5545413c937f3\": container with ID starting with 5c5d16e37de1a35273bc206e24ce443037d1c67ebfd863211db5545413c937f3 not found: ID does not exist" Mar 16 16:03:55 crc kubenswrapper[5120]: I0316 16:03:55.997258 5120 scope.go:117] "RemoveContainer" containerID="8c861a2519aabaf14c17f479af262e4d354797c15f58893df6a2c92dbb76d00c" Mar 16 16:03:55 crc kubenswrapper[5120]: E0316 16:03:55.997663 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c861a2519aabaf14c17f479af262e4d354797c15f58893df6a2c92dbb76d00c\": container with ID starting with 8c861a2519aabaf14c17f479af262e4d354797c15f58893df6a2c92dbb76d00c not found: ID does not exist" containerID="8c861a2519aabaf14c17f479af262e4d354797c15f58893df6a2c92dbb76d00c" Mar 16 16:03:55 crc kubenswrapper[5120]: I0316 16:03:55.997702 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c861a2519aabaf14c17f479af262e4d354797c15f58893df6a2c92dbb76d00c"} err="failed to get container status \"8c861a2519aabaf14c17f479af262e4d354797c15f58893df6a2c92dbb76d00c\": rpc error: code = NotFound desc = could not find container \"8c861a2519aabaf14c17f479af262e4d354797c15f58893df6a2c92dbb76d00c\": container with ID starting with 8c861a2519aabaf14c17f479af262e4d354797c15f58893df6a2c92dbb76d00c not found: ID does not exist" Mar 16 16:03:55 crc kubenswrapper[5120]: I0316 16:03:55.997714 5120 scope.go:117] "RemoveContainer" containerID="5c5d16e37de1a35273bc206e24ce443037d1c67ebfd863211db5545413c937f3" Mar 16 16:03:55 crc kubenswrapper[5120]: I0316 16:03:55.998103 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c5d16e37de1a35273bc206e24ce443037d1c67ebfd863211db5545413c937f3"} err="failed to get container status \"5c5d16e37de1a35273bc206e24ce443037d1c67ebfd863211db5545413c937f3\": rpc error: code = NotFound desc = could not find container \"5c5d16e37de1a35273bc206e24ce443037d1c67ebfd863211db5545413c937f3\": container with ID starting with 5c5d16e37de1a35273bc206e24ce443037d1c67ebfd863211db5545413c937f3 not found: ID does not exist" Mar 16 16:03:55 crc kubenswrapper[5120]: I0316 16:03:55.998117 5120 scope.go:117] "RemoveContainer" containerID="8c861a2519aabaf14c17f479af262e4d354797c15f58893df6a2c92dbb76d00c" Mar 16 16:03:55 crc kubenswrapper[5120]: I0316 16:03:55.998420 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c861a2519aabaf14c17f479af262e4d354797c15f58893df6a2c92dbb76d00c"} err="failed to get container status \"8c861a2519aabaf14c17f479af262e4d354797c15f58893df6a2c92dbb76d00c\": rpc error: code = NotFound desc = could not find container \"8c861a2519aabaf14c17f479af262e4d354797c15f58893df6a2c92dbb76d00c\": container with ID starting with 8c861a2519aabaf14c17f479af262e4d354797c15f58893df6a2c92dbb76d00c not found: ID does not exist" Mar 16 16:03:56 crc kubenswrapper[5120]: I0316 16:03:56.023720 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mltgr\" (UniqueName: \"kubernetes.io/projected/b846aa1f-40e6-4224-bbdc-3e00530e2de4-kube-api-access-mltgr\") pod \"nova-metadata-0\" (UID: \"b846aa1f-40e6-4224-bbdc-3e00530e2de4\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:03:56 crc kubenswrapper[5120]: I0316 16:03:56.023882 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b846aa1f-40e6-4224-bbdc-3e00530e2de4-config-data\") pod \"nova-metadata-0\" (UID: \"b846aa1f-40e6-4224-bbdc-3e00530e2de4\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:03:56 crc kubenswrapper[5120]: I0316 16:03:56.023942 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b846aa1f-40e6-4224-bbdc-3e00530e2de4-logs\") pod \"nova-metadata-0\" (UID: \"b846aa1f-40e6-4224-bbdc-3e00530e2de4\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:03:56 crc kubenswrapper[5120]: I0316 16:03:56.024055 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b846aa1f-40e6-4224-bbdc-3e00530e2de4-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"b846aa1f-40e6-4224-bbdc-3e00530e2de4\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:03:56 crc kubenswrapper[5120]: I0316 16:03:56.024199 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/b846aa1f-40e6-4224-bbdc-3e00530e2de4-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"b846aa1f-40e6-4224-bbdc-3e00530e2de4\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:03:56 crc kubenswrapper[5120]: I0316 16:03:56.125465 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b846aa1f-40e6-4224-bbdc-3e00530e2de4-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"b846aa1f-40e6-4224-bbdc-3e00530e2de4\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:03:56 crc kubenswrapper[5120]: I0316 16:03:56.125584 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/b846aa1f-40e6-4224-bbdc-3e00530e2de4-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"b846aa1f-40e6-4224-bbdc-3e00530e2de4\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:03:56 crc kubenswrapper[5120]: I0316 16:03:56.125650 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mltgr\" (UniqueName: \"kubernetes.io/projected/b846aa1f-40e6-4224-bbdc-3e00530e2de4-kube-api-access-mltgr\") pod \"nova-metadata-0\" (UID: \"b846aa1f-40e6-4224-bbdc-3e00530e2de4\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:03:56 crc kubenswrapper[5120]: I0316 16:03:56.125699 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b846aa1f-40e6-4224-bbdc-3e00530e2de4-config-data\") pod \"nova-metadata-0\" (UID: \"b846aa1f-40e6-4224-bbdc-3e00530e2de4\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:03:56 crc kubenswrapper[5120]: I0316 16:03:56.125769 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b846aa1f-40e6-4224-bbdc-3e00530e2de4-logs\") pod \"nova-metadata-0\" (UID: \"b846aa1f-40e6-4224-bbdc-3e00530e2de4\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:03:56 crc kubenswrapper[5120]: I0316 16:03:56.126139 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b846aa1f-40e6-4224-bbdc-3e00530e2de4-logs\") pod \"nova-metadata-0\" (UID: \"b846aa1f-40e6-4224-bbdc-3e00530e2de4\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:03:56 crc kubenswrapper[5120]: I0316 16:03:56.129980 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b846aa1f-40e6-4224-bbdc-3e00530e2de4-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"b846aa1f-40e6-4224-bbdc-3e00530e2de4\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:03:56 crc kubenswrapper[5120]: I0316 16:03:56.131185 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b846aa1f-40e6-4224-bbdc-3e00530e2de4-config-data\") pod \"nova-metadata-0\" (UID: \"b846aa1f-40e6-4224-bbdc-3e00530e2de4\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:03:56 crc kubenswrapper[5120]: I0316 16:03:56.137249 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/b846aa1f-40e6-4224-bbdc-3e00530e2de4-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"b846aa1f-40e6-4224-bbdc-3e00530e2de4\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:03:56 crc kubenswrapper[5120]: I0316 16:03:56.144018 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mltgr\" (UniqueName: \"kubernetes.io/projected/b846aa1f-40e6-4224-bbdc-3e00530e2de4-kube-api-access-mltgr\") pod \"nova-metadata-0\" (UID: \"b846aa1f-40e6-4224-bbdc-3e00530e2de4\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:03:56 crc kubenswrapper[5120]: I0316 16:03:56.339833 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:03:56 crc kubenswrapper[5120]: I0316 16:03:56.674697 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3ea160fa-c2b4-42af-8a9c-7fa29efc18b9" path="/var/lib/kubelet/pods/3ea160fa-c2b4-42af-8a9c-7fa29efc18b9/volumes" Mar 16 16:03:56 crc kubenswrapper[5120]: I0316 16:03:56.675562 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cec15169-61f9-4254-be1a-dc19a7e98bbb" path="/var/lib/kubelet/pods/cec15169-61f9-4254-be1a-dc19a7e98bbb/volumes" Mar 16 16:03:56 crc kubenswrapper[5120]: I0316 16:03:56.796736 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:03:56 crc kubenswrapper[5120]: W0316 16:03:56.797583 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb846aa1f_40e6_4224_bbdc_3e00530e2de4.slice/crio-c79d2564fabfbc0b00f1fd7a7d0dfbff5b88a53c95025defee46c9c39ecfca6e WatchSource:0}: Error finding container c79d2564fabfbc0b00f1fd7a7d0dfbff5b88a53c95025defee46c9c39ecfca6e: Status 404 returned error can't find the container with id c79d2564fabfbc0b00f1fd7a7d0dfbff5b88a53c95025defee46c9c39ecfca6e Mar 16 16:03:56 crc kubenswrapper[5120]: I0316 16:03:56.913950 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"b846aa1f-40e6-4224-bbdc-3e00530e2de4","Type":"ContainerStarted","Data":"c79d2564fabfbc0b00f1fd7a7d0dfbff5b88a53c95025defee46c9c39ecfca6e"} Mar 16 16:03:56 crc kubenswrapper[5120]: I0316 16:03:56.916401 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"8cd43ab9-76e5-4675-9dc3-73ca6fd27367","Type":"ContainerStarted","Data":"1e5f70d58b53de6a584014acc09aa0a97ecf167eed424a7d71af8f0cc6f32db7"} Mar 16 16:03:56 crc kubenswrapper[5120]: I0316 16:03:56.916428 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"8cd43ab9-76e5-4675-9dc3-73ca6fd27367","Type":"ContainerStarted","Data":"3ec26f713204f1d82c0c1ca227011a07b73abb3ba44ba28c90a21cbbeb11c1ed"} Mar 16 16:03:56 crc kubenswrapper[5120]: I0316 16:03:56.916439 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"8cd43ab9-76e5-4675-9dc3-73ca6fd27367","Type":"ContainerStarted","Data":"42a373f3f8c70a45eb202f960f7e08764c957df6d950e0468a2b693aeecf20eb"} Mar 16 16:03:57 crc kubenswrapper[5120]: I0316 16:03:57.931755 5120 generic.go:358] "Generic (PLEG): container finished" podID="b5bf0d44-4150-48c2-82a3-7f4a1de0ba14" containerID="a7774028fec91d27489817ab85d374796adb8697ff20ded2f2c2e1d57763a8f4" exitCode=0 Mar 16 16:03:57 crc kubenswrapper[5120]: I0316 16:03:57.931862 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"b5bf0d44-4150-48c2-82a3-7f4a1de0ba14","Type":"ContainerDied","Data":"a7774028fec91d27489817ab85d374796adb8697ff20ded2f2c2e1d57763a8f4"} Mar 16 16:03:57 crc kubenswrapper[5120]: I0316 16:03:57.934542 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"b846aa1f-40e6-4224-bbdc-3e00530e2de4","Type":"ContainerStarted","Data":"af04b2b49b4612cfa19b882074e95c5ceed2671e569b0a06867b4ea8199b3318"} Mar 16 16:03:57 crc kubenswrapper[5120]: I0316 16:03:57.934577 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"b846aa1f-40e6-4224-bbdc-3e00530e2de4","Type":"ContainerStarted","Data":"ee70ddcf5e1416f06fdd159019f6d10208ed103bcfc86f8a15c4ab3e8937582a"} Mar 16 16:03:57 crc kubenswrapper[5120]: I0316 16:03:57.955001 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=3.954984299 podStartE2EDuration="3.954984299s" podCreationTimestamp="2026-03-16 16:03:54 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:03:56.93618691 +0000 UTC m=+1939.090118657" watchObservedRunningTime="2026-03-16 16:03:57.954984299 +0000 UTC m=+1940.108915966" Mar 16 16:03:57 crc kubenswrapper[5120]: I0316 16:03:57.955114 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=2.9551104329999998 podStartE2EDuration="2.955110433s" podCreationTimestamp="2026-03-16 16:03:55 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:03:57.954115856 +0000 UTC m=+1940.108047553" watchObservedRunningTime="2026-03-16 16:03:57.955110433 +0000 UTC m=+1940.109042100" Mar 16 16:03:58 crc kubenswrapper[5120]: I0316 16:03:58.110844 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:03:58 crc kubenswrapper[5120]: I0316 16:03:58.171523 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b5bf0d44-4150-48c2-82a3-7f4a1de0ba14-combined-ca-bundle\") pod \"b5bf0d44-4150-48c2-82a3-7f4a1de0ba14\" (UID: \"b5bf0d44-4150-48c2-82a3-7f4a1de0ba14\") " Mar 16 16:03:58 crc kubenswrapper[5120]: I0316 16:03:58.171650 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b5bf0d44-4150-48c2-82a3-7f4a1de0ba14-config-data\") pod \"b5bf0d44-4150-48c2-82a3-7f4a1de0ba14\" (UID: \"b5bf0d44-4150-48c2-82a3-7f4a1de0ba14\") " Mar 16 16:03:58 crc kubenswrapper[5120]: I0316 16:03:58.171744 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7rffq\" (UniqueName: \"kubernetes.io/projected/b5bf0d44-4150-48c2-82a3-7f4a1de0ba14-kube-api-access-7rffq\") pod \"b5bf0d44-4150-48c2-82a3-7f4a1de0ba14\" (UID: \"b5bf0d44-4150-48c2-82a3-7f4a1de0ba14\") " Mar 16 16:03:58 crc kubenswrapper[5120]: I0316 16:03:58.176969 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b5bf0d44-4150-48c2-82a3-7f4a1de0ba14-kube-api-access-7rffq" (OuterVolumeSpecName: "kube-api-access-7rffq") pod "b5bf0d44-4150-48c2-82a3-7f4a1de0ba14" (UID: "b5bf0d44-4150-48c2-82a3-7f4a1de0ba14"). InnerVolumeSpecName "kube-api-access-7rffq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:03:58 crc kubenswrapper[5120]: I0316 16:03:58.198092 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b5bf0d44-4150-48c2-82a3-7f4a1de0ba14-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "b5bf0d44-4150-48c2-82a3-7f4a1de0ba14" (UID: "b5bf0d44-4150-48c2-82a3-7f4a1de0ba14"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:03:58 crc kubenswrapper[5120]: I0316 16:03:58.201559 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b5bf0d44-4150-48c2-82a3-7f4a1de0ba14-config-data" (OuterVolumeSpecName: "config-data") pod "b5bf0d44-4150-48c2-82a3-7f4a1de0ba14" (UID: "b5bf0d44-4150-48c2-82a3-7f4a1de0ba14"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:03:58 crc kubenswrapper[5120]: I0316 16:03:58.273925 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b5bf0d44-4150-48c2-82a3-7f4a1de0ba14-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:03:58 crc kubenswrapper[5120]: I0316 16:03:58.273957 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b5bf0d44-4150-48c2-82a3-7f4a1de0ba14-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:03:58 crc kubenswrapper[5120]: I0316 16:03:58.273967 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7rffq\" (UniqueName: \"kubernetes.io/projected/b5bf0d44-4150-48c2-82a3-7f4a1de0ba14-kube-api-access-7rffq\") on node \"crc\" DevicePath \"\"" Mar 16 16:03:58 crc kubenswrapper[5120]: I0316 16:03:58.945691 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"b5bf0d44-4150-48c2-82a3-7f4a1de0ba14","Type":"ContainerDied","Data":"63397aeb70beb3a6d28f25963a75103b9b4d6831b594e729f0ddc49d135937fb"} Mar 16 16:03:58 crc kubenswrapper[5120]: I0316 16:03:58.945999 5120 scope.go:117] "RemoveContainer" containerID="a7774028fec91d27489817ab85d374796adb8697ff20ded2f2c2e1d57763a8f4" Mar 16 16:03:58 crc kubenswrapper[5120]: I0316 16:03:58.945712 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:03:58 crc kubenswrapper[5120]: I0316 16:03:58.974345 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:03:58 crc kubenswrapper[5120]: I0316 16:03:58.989954 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:03:59 crc kubenswrapper[5120]: I0316 16:03:59.012472 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:03:59 crc kubenswrapper[5120]: I0316 16:03:59.013560 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5bf0d44-4150-48c2-82a3-7f4a1de0ba14" containerName="nova-scheduler-scheduler" Mar 16 16:03:59 crc kubenswrapper[5120]: I0316 16:03:59.013579 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5bf0d44-4150-48c2-82a3-7f4a1de0ba14" containerName="nova-scheduler-scheduler" Mar 16 16:03:59 crc kubenswrapper[5120]: I0316 16:03:59.013791 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="b5bf0d44-4150-48c2-82a3-7f4a1de0ba14" containerName="nova-scheduler-scheduler" Mar 16 16:03:59 crc kubenswrapper[5120]: I0316 16:03:59.021192 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:03:59 crc kubenswrapper[5120]: I0316 16:03:59.025028 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-scheduler-config-data\"" Mar 16 16:03:59 crc kubenswrapper[5120]: I0316 16:03:59.030696 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:03:59 crc kubenswrapper[5120]: I0316 16:03:59.101210 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f5d3b57e-2be9-4ddd-8ac2-65a5fa52f88c-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"f5d3b57e-2be9-4ddd-8ac2-65a5fa52f88c\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:03:59 crc kubenswrapper[5120]: I0316 16:03:59.101322 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tp8wx\" (UniqueName: \"kubernetes.io/projected/f5d3b57e-2be9-4ddd-8ac2-65a5fa52f88c-kube-api-access-tp8wx\") pod \"nova-scheduler-0\" (UID: \"f5d3b57e-2be9-4ddd-8ac2-65a5fa52f88c\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:03:59 crc kubenswrapper[5120]: I0316 16:03:59.101979 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f5d3b57e-2be9-4ddd-8ac2-65a5fa52f88c-config-data\") pod \"nova-scheduler-0\" (UID: \"f5d3b57e-2be9-4ddd-8ac2-65a5fa52f88c\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:03:59 crc kubenswrapper[5120]: I0316 16:03:59.204099 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f5d3b57e-2be9-4ddd-8ac2-65a5fa52f88c-config-data\") pod \"nova-scheduler-0\" (UID: \"f5d3b57e-2be9-4ddd-8ac2-65a5fa52f88c\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:03:59 crc kubenswrapper[5120]: I0316 16:03:59.204489 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f5d3b57e-2be9-4ddd-8ac2-65a5fa52f88c-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"f5d3b57e-2be9-4ddd-8ac2-65a5fa52f88c\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:03:59 crc kubenswrapper[5120]: I0316 16:03:59.204547 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tp8wx\" (UniqueName: \"kubernetes.io/projected/f5d3b57e-2be9-4ddd-8ac2-65a5fa52f88c-kube-api-access-tp8wx\") pod \"nova-scheduler-0\" (UID: \"f5d3b57e-2be9-4ddd-8ac2-65a5fa52f88c\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:03:59 crc kubenswrapper[5120]: I0316 16:03:59.218594 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f5d3b57e-2be9-4ddd-8ac2-65a5fa52f88c-config-data\") pod \"nova-scheduler-0\" (UID: \"f5d3b57e-2be9-4ddd-8ac2-65a5fa52f88c\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:03:59 crc kubenswrapper[5120]: I0316 16:03:59.219572 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f5d3b57e-2be9-4ddd-8ac2-65a5fa52f88c-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"f5d3b57e-2be9-4ddd-8ac2-65a5fa52f88c\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:03:59 crc kubenswrapper[5120]: I0316 16:03:59.231154 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tp8wx\" (UniqueName: \"kubernetes.io/projected/f5d3b57e-2be9-4ddd-8ac2-65a5fa52f88c-kube-api-access-tp8wx\") pod \"nova-scheduler-0\" (UID: \"f5d3b57e-2be9-4ddd-8ac2-65a5fa52f88c\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:03:59 crc kubenswrapper[5120]: I0316 16:03:59.345332 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:03:59 crc kubenswrapper[5120]: I0316 16:03:59.866323 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:03:59 crc kubenswrapper[5120]: I0316 16:03:59.958821 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"f5d3b57e-2be9-4ddd-8ac2-65a5fa52f88c","Type":"ContainerStarted","Data":"96ae303fa5af9ebbb16c5117aff456a6ef29c5634ce36b13378455777c39e47c"} Mar 16 16:04:00 crc kubenswrapper[5120]: I0316 16:04:00.144164 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-infra/auto-csr-approver-29561284-dwp8z"] Mar 16 16:04:00 crc kubenswrapper[5120]: I0316 16:04:00.149508 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561284-dwp8z" Mar 16 16:04:00 crc kubenswrapper[5120]: I0316 16:04:00.154711 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561284-dwp8z"] Mar 16 16:04:00 crc kubenswrapper[5120]: I0316 16:04:00.159040 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"kube-root-ca.crt\"" Mar 16 16:04:00 crc kubenswrapper[5120]: I0316 16:04:00.159137 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"openshift-service-ca.crt\"" Mar 16 16:04:00 crc kubenswrapper[5120]: I0316 16:04:00.159248 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-infra\"/\"csr-approver-sa-dockercfg-x2nsz\"" Mar 16 16:04:00 crc kubenswrapper[5120]: I0316 16:04:00.201827 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:04:00 crc kubenswrapper[5120]: I0316 16:04:00.222065 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:04:00 crc kubenswrapper[5120]: I0316 16:04:00.223230 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbd52\" (UniqueName: \"kubernetes.io/projected/cdea2a15-eb34-4b5c-8c3f-e40fd48b5081-kube-api-access-nbd52\") pod \"auto-csr-approver-29561284-dwp8z\" (UID: \"cdea2a15-eb34-4b5c-8c3f-e40fd48b5081\") " pod="openshift-infra/auto-csr-approver-29561284-dwp8z" Mar 16 16:04:00 crc kubenswrapper[5120]: I0316 16:04:00.325452 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nbd52\" (UniqueName: \"kubernetes.io/projected/cdea2a15-eb34-4b5c-8c3f-e40fd48b5081-kube-api-access-nbd52\") pod \"auto-csr-approver-29561284-dwp8z\" (UID: \"cdea2a15-eb34-4b5c-8c3f-e40fd48b5081\") " pod="openshift-infra/auto-csr-approver-29561284-dwp8z" Mar 16 16:04:00 crc kubenswrapper[5120]: I0316 16:04:00.344656 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbd52\" (UniqueName: \"kubernetes.io/projected/cdea2a15-eb34-4b5c-8c3f-e40fd48b5081-kube-api-access-nbd52\") pod \"auto-csr-approver-29561284-dwp8z\" (UID: \"cdea2a15-eb34-4b5c-8c3f-e40fd48b5081\") " pod="openshift-infra/auto-csr-approver-29561284-dwp8z" Mar 16 16:04:00 crc kubenswrapper[5120]: I0316 16:04:00.400135 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:04:00 crc kubenswrapper[5120]: I0316 16:04:00.481082 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561284-dwp8z" Mar 16 16:04:00 crc kubenswrapper[5120]: I0316 16:04:00.674750 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b5bf0d44-4150-48c2-82a3-7f4a1de0ba14" path="/var/lib/kubelet/pods/b5bf0d44-4150-48c2-82a3-7f4a1de0ba14/volumes" Mar 16 16:04:00 crc kubenswrapper[5120]: I0316 16:04:00.797424 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561284-dwp8z"] Mar 16 16:04:00 crc kubenswrapper[5120]: I0316 16:04:00.931396 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:04:00 crc kubenswrapper[5120]: I0316 16:04:00.975035 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"f5d3b57e-2be9-4ddd-8ac2-65a5fa52f88c","Type":"ContainerStarted","Data":"17d899a7f8231acf41ce5087610195ff8a21788ab94fbc6dc108c8d0520ce504"} Mar 16 16:04:00 crc kubenswrapper[5120]: I0316 16:04:00.977355 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561284-dwp8z" event={"ID":"cdea2a15-eb34-4b5c-8c3f-e40fd48b5081","Type":"ContainerStarted","Data":"1487a84df1f28273a22ca54f2a31b7d8f849bcd3bccbbc7cb8ff61957a620884"} Mar 16 16:04:00 crc kubenswrapper[5120]: I0316 16:04:00.997858 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:04:00 crc kubenswrapper[5120]: I0316 16:04:00.998600 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-scheduler-0" podStartSLOduration=2.998580387 podStartE2EDuration="2.998580387s" podCreationTimestamp="2026-03-16 16:03:58 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:04:00.993384684 +0000 UTC m=+1943.147316341" watchObservedRunningTime="2026-03-16 16:04:00.998580387 +0000 UTC m=+1943.152512034" Mar 16 16:04:01 crc kubenswrapper[5120]: I0316 16:04:01.410353 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-x2wb5"] Mar 16 16:04:01 crc kubenswrapper[5120]: I0316 16:04:01.418027 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-x2wb5" Mar 16 16:04:01 crc kubenswrapper[5120]: I0316 16:04:01.420218 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-manage-config-data\"" Mar 16 16:04:01 crc kubenswrapper[5120]: I0316 16:04:01.422005 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-manage-scripts\"" Mar 16 16:04:01 crc kubenswrapper[5120]: I0316 16:04:01.425984 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-x2wb5"] Mar 16 16:04:01 crc kubenswrapper[5120]: I0316 16:04:01.552491 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e5bc895e-5719-43f2-bbbe-e892520dbdd9-scripts\") pod \"nova-cell1-cell-mapping-x2wb5\" (UID: \"e5bc895e-5719-43f2-bbbe-e892520dbdd9\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-x2wb5" Mar 16 16:04:01 crc kubenswrapper[5120]: I0316 16:04:01.552538 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vj7pf\" (UniqueName: \"kubernetes.io/projected/e5bc895e-5719-43f2-bbbe-e892520dbdd9-kube-api-access-vj7pf\") pod \"nova-cell1-cell-mapping-x2wb5\" (UID: \"e5bc895e-5719-43f2-bbbe-e892520dbdd9\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-x2wb5" Mar 16 16:04:01 crc kubenswrapper[5120]: I0316 16:04:01.552573 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e5bc895e-5719-43f2-bbbe-e892520dbdd9-combined-ca-bundle\") pod \"nova-cell1-cell-mapping-x2wb5\" (UID: \"e5bc895e-5719-43f2-bbbe-e892520dbdd9\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-x2wb5" Mar 16 16:04:01 crc kubenswrapper[5120]: I0316 16:04:01.552782 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e5bc895e-5719-43f2-bbbe-e892520dbdd9-config-data\") pod \"nova-cell1-cell-mapping-x2wb5\" (UID: \"e5bc895e-5719-43f2-bbbe-e892520dbdd9\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-x2wb5" Mar 16 16:04:01 crc kubenswrapper[5120]: I0316 16:04:01.655068 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e5bc895e-5719-43f2-bbbe-e892520dbdd9-scripts\") pod \"nova-cell1-cell-mapping-x2wb5\" (UID: \"e5bc895e-5719-43f2-bbbe-e892520dbdd9\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-x2wb5" Mar 16 16:04:01 crc kubenswrapper[5120]: I0316 16:04:01.655128 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vj7pf\" (UniqueName: \"kubernetes.io/projected/e5bc895e-5719-43f2-bbbe-e892520dbdd9-kube-api-access-vj7pf\") pod \"nova-cell1-cell-mapping-x2wb5\" (UID: \"e5bc895e-5719-43f2-bbbe-e892520dbdd9\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-x2wb5" Mar 16 16:04:01 crc kubenswrapper[5120]: I0316 16:04:01.655171 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e5bc895e-5719-43f2-bbbe-e892520dbdd9-combined-ca-bundle\") pod \"nova-cell1-cell-mapping-x2wb5\" (UID: \"e5bc895e-5719-43f2-bbbe-e892520dbdd9\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-x2wb5" Mar 16 16:04:01 crc kubenswrapper[5120]: I0316 16:04:01.655239 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e5bc895e-5719-43f2-bbbe-e892520dbdd9-config-data\") pod \"nova-cell1-cell-mapping-x2wb5\" (UID: \"e5bc895e-5719-43f2-bbbe-e892520dbdd9\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-x2wb5" Mar 16 16:04:01 crc kubenswrapper[5120]: I0316 16:04:01.661561 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e5bc895e-5719-43f2-bbbe-e892520dbdd9-config-data\") pod \"nova-cell1-cell-mapping-x2wb5\" (UID: \"e5bc895e-5719-43f2-bbbe-e892520dbdd9\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-x2wb5" Mar 16 16:04:01 crc kubenswrapper[5120]: I0316 16:04:01.667381 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e5bc895e-5719-43f2-bbbe-e892520dbdd9-scripts\") pod \"nova-cell1-cell-mapping-x2wb5\" (UID: \"e5bc895e-5719-43f2-bbbe-e892520dbdd9\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-x2wb5" Mar 16 16:04:01 crc kubenswrapper[5120]: I0316 16:04:01.668104 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e5bc895e-5719-43f2-bbbe-e892520dbdd9-combined-ca-bundle\") pod \"nova-cell1-cell-mapping-x2wb5\" (UID: \"e5bc895e-5719-43f2-bbbe-e892520dbdd9\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-x2wb5" Mar 16 16:04:01 crc kubenswrapper[5120]: I0316 16:04:01.692831 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vj7pf\" (UniqueName: \"kubernetes.io/projected/e5bc895e-5719-43f2-bbbe-e892520dbdd9-kube-api-access-vj7pf\") pod \"nova-cell1-cell-mapping-x2wb5\" (UID: \"e5bc895e-5719-43f2-bbbe-e892520dbdd9\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-x2wb5" Mar 16 16:04:01 crc kubenswrapper[5120]: I0316 16:04:01.752963 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-x2wb5" Mar 16 16:04:02 crc kubenswrapper[5120]: W0316 16:04:02.257234 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode5bc895e_5719_43f2_bbbe_e892520dbdd9.slice/crio-7ef9a08c8f8d3803cd2ec3a2c2f52c28fdaa39457f296204e0693bc153600d84 WatchSource:0}: Error finding container 7ef9a08c8f8d3803cd2ec3a2c2f52c28fdaa39457f296204e0693bc153600d84: Status 404 returned error can't find the container with id 7ef9a08c8f8d3803cd2ec3a2c2f52c28fdaa39457f296204e0693bc153600d84 Mar 16 16:04:02 crc kubenswrapper[5120]: I0316 16:04:02.268705 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-x2wb5"] Mar 16 16:04:03 crc kubenswrapper[5120]: I0316 16:04:03.008713 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-x2wb5" event={"ID":"e5bc895e-5719-43f2-bbbe-e892520dbdd9","Type":"ContainerStarted","Data":"82bbb6ccca17d71e282ef2e46f6279fe406d5f8c97fc1cf7ecf828e9ef042e9f"} Mar 16 16:04:03 crc kubenswrapper[5120]: I0316 16:04:03.009105 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-x2wb5" event={"ID":"e5bc895e-5719-43f2-bbbe-e892520dbdd9","Type":"ContainerStarted","Data":"7ef9a08c8f8d3803cd2ec3a2c2f52c28fdaa39457f296204e0693bc153600d84"} Mar 16 16:04:03 crc kubenswrapper[5120]: I0316 16:04:03.010969 5120 generic.go:358] "Generic (PLEG): container finished" podID="cdea2a15-eb34-4b5c-8c3f-e40fd48b5081" containerID="03bfdb11d2885c4fd03a8617f7a9dc51003ba407e3a4fc8ee01cbc966adcebf4" exitCode=0 Mar 16 16:04:03 crc kubenswrapper[5120]: I0316 16:04:03.011383 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561284-dwp8z" event={"ID":"cdea2a15-eb34-4b5c-8c3f-e40fd48b5081","Type":"ContainerDied","Data":"03bfdb11d2885c4fd03a8617f7a9dc51003ba407e3a4fc8ee01cbc966adcebf4"} Mar 16 16:04:03 crc kubenswrapper[5120]: I0316 16:04:03.032440 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-x2wb5" podStartSLOduration=2.032423684 podStartE2EDuration="2.032423684s" podCreationTimestamp="2026-03-16 16:04:01 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:04:03.027986321 +0000 UTC m=+1945.181918018" watchObservedRunningTime="2026-03-16 16:04:03.032423684 +0000 UTC m=+1945.186355341" Mar 16 16:04:04 crc kubenswrapper[5120]: I0316 16:04:04.345819 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:04:04 crc kubenswrapper[5120]: I0316 16:04:04.379937 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 16:04:04 crc kubenswrapper[5120]: I0316 16:04:04.380515 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/kube-state-metrics-0" podUID="e86380ec-b865-4f35-9a18-c2940e1216cb" containerName="kube-state-metrics" containerID="cri-o://97866483ac4c2f1ecad39d25a9914526fee87e86656eb5258d0b3b4a7e950343" gracePeriod=30 Mar 16 16:04:04 crc kubenswrapper[5120]: I0316 16:04:04.482597 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561284-dwp8z" Mar 16 16:04:04 crc kubenswrapper[5120]: I0316 16:04:04.632015 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nbd52\" (UniqueName: \"kubernetes.io/projected/cdea2a15-eb34-4b5c-8c3f-e40fd48b5081-kube-api-access-nbd52\") pod \"cdea2a15-eb34-4b5c-8c3f-e40fd48b5081\" (UID: \"cdea2a15-eb34-4b5c-8c3f-e40fd48b5081\") " Mar 16 16:04:04 crc kubenswrapper[5120]: I0316 16:04:04.652920 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cdea2a15-eb34-4b5c-8c3f-e40fd48b5081-kube-api-access-nbd52" (OuterVolumeSpecName: "kube-api-access-nbd52") pod "cdea2a15-eb34-4b5c-8c3f-e40fd48b5081" (UID: "cdea2a15-eb34-4b5c-8c3f-e40fd48b5081"). InnerVolumeSpecName "kube-api-access-nbd52". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:04:04 crc kubenswrapper[5120]: I0316 16:04:04.734598 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nbd52\" (UniqueName: \"kubernetes.io/projected/cdea2a15-eb34-4b5c-8c3f-e40fd48b5081-kube-api-access-nbd52\") on node \"crc\" DevicePath \"\"" Mar 16 16:04:04 crc kubenswrapper[5120]: I0316 16:04:04.812809 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:04:04 crc kubenswrapper[5120]: I0316 16:04:04.937132 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lgkf9\" (UniqueName: \"kubernetes.io/projected/e86380ec-b865-4f35-9a18-c2940e1216cb-kube-api-access-lgkf9\") pod \"e86380ec-b865-4f35-9a18-c2940e1216cb\" (UID: \"e86380ec-b865-4f35-9a18-c2940e1216cb\") " Mar 16 16:04:04 crc kubenswrapper[5120]: I0316 16:04:04.942411 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e86380ec-b865-4f35-9a18-c2940e1216cb-kube-api-access-lgkf9" (OuterVolumeSpecName: "kube-api-access-lgkf9") pod "e86380ec-b865-4f35-9a18-c2940e1216cb" (UID: "e86380ec-b865-4f35-9a18-c2940e1216cb"). InnerVolumeSpecName "kube-api-access-lgkf9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:04:05 crc kubenswrapper[5120]: I0316 16:04:05.033904 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561284-dwp8z" event={"ID":"cdea2a15-eb34-4b5c-8c3f-e40fd48b5081","Type":"ContainerDied","Data":"1487a84df1f28273a22ca54f2a31b7d8f849bcd3bccbbc7cb8ff61957a620884"} Mar 16 16:04:05 crc kubenswrapper[5120]: I0316 16:04:05.033940 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1487a84df1f28273a22ca54f2a31b7d8f849bcd3bccbbc7cb8ff61957a620884" Mar 16 16:04:05 crc kubenswrapper[5120]: I0316 16:04:05.034001 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561284-dwp8z" Mar 16 16:04:05 crc kubenswrapper[5120]: I0316 16:04:05.036059 5120 generic.go:358] "Generic (PLEG): container finished" podID="e86380ec-b865-4f35-9a18-c2940e1216cb" containerID="97866483ac4c2f1ecad39d25a9914526fee87e86656eb5258d0b3b4a7e950343" exitCode=2 Mar 16 16:04:05 crc kubenswrapper[5120]: I0316 16:04:05.036275 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"e86380ec-b865-4f35-9a18-c2940e1216cb","Type":"ContainerDied","Data":"97866483ac4c2f1ecad39d25a9914526fee87e86656eb5258d0b3b4a7e950343"} Mar 16 16:04:05 crc kubenswrapper[5120]: I0316 16:04:05.036295 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"e86380ec-b865-4f35-9a18-c2940e1216cb","Type":"ContainerDied","Data":"d7d685db87eac9f89d736c7b9c0106e4ffcb3d6822b41b0f8522c1037067e68f"} Mar 16 16:04:05 crc kubenswrapper[5120]: I0316 16:04:05.036310 5120 scope.go:117] "RemoveContainer" containerID="97866483ac4c2f1ecad39d25a9914526fee87e86656eb5258d0b3b4a7e950343" Mar 16 16:04:05 crc kubenswrapper[5120]: I0316 16:04:05.036406 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:04:05 crc kubenswrapper[5120]: I0316 16:04:05.038942 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lgkf9\" (UniqueName: \"kubernetes.io/projected/e86380ec-b865-4f35-9a18-c2940e1216cb-kube-api-access-lgkf9\") on node \"crc\" DevicePath \"\"" Mar 16 16:04:05 crc kubenswrapper[5120]: I0316 16:04:05.076975 5120 scope.go:117] "RemoveContainer" containerID="97866483ac4c2f1ecad39d25a9914526fee87e86656eb5258d0b3b4a7e950343" Mar 16 16:04:05 crc kubenswrapper[5120]: I0316 16:04:05.077124 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 16:04:05 crc kubenswrapper[5120]: E0316 16:04:05.078344 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"97866483ac4c2f1ecad39d25a9914526fee87e86656eb5258d0b3b4a7e950343\": container with ID starting with 97866483ac4c2f1ecad39d25a9914526fee87e86656eb5258d0b3b4a7e950343 not found: ID does not exist" containerID="97866483ac4c2f1ecad39d25a9914526fee87e86656eb5258d0b3b4a7e950343" Mar 16 16:04:05 crc kubenswrapper[5120]: I0316 16:04:05.078377 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97866483ac4c2f1ecad39d25a9914526fee87e86656eb5258d0b3b4a7e950343"} err="failed to get container status \"97866483ac4c2f1ecad39d25a9914526fee87e86656eb5258d0b3b4a7e950343\": rpc error: code = NotFound desc = could not find container \"97866483ac4c2f1ecad39d25a9914526fee87e86656eb5258d0b3b4a7e950343\": container with ID starting with 97866483ac4c2f1ecad39d25a9914526fee87e86656eb5258d0b3b4a7e950343 not found: ID does not exist" Mar 16 16:04:05 crc kubenswrapper[5120]: I0316 16:04:05.087140 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 16:04:05 crc kubenswrapper[5120]: I0316 16:04:05.100494 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 16:04:05 crc kubenswrapper[5120]: I0316 16:04:05.102019 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cdea2a15-eb34-4b5c-8c3f-e40fd48b5081" containerName="oc" Mar 16 16:04:05 crc kubenswrapper[5120]: I0316 16:04:05.102043 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="cdea2a15-eb34-4b5c-8c3f-e40fd48b5081" containerName="oc" Mar 16 16:04:05 crc kubenswrapper[5120]: I0316 16:04:05.102095 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e86380ec-b865-4f35-9a18-c2940e1216cb" containerName="kube-state-metrics" Mar 16 16:04:05 crc kubenswrapper[5120]: I0316 16:04:05.102104 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e86380ec-b865-4f35-9a18-c2940e1216cb" containerName="kube-state-metrics" Mar 16 16:04:05 crc kubenswrapper[5120]: I0316 16:04:05.102361 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e86380ec-b865-4f35-9a18-c2940e1216cb" containerName="kube-state-metrics" Mar 16 16:04:05 crc kubenswrapper[5120]: I0316 16:04:05.102381 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="cdea2a15-eb34-4b5c-8c3f-e40fd48b5081" containerName="oc" Mar 16 16:04:05 crc kubenswrapper[5120]: I0316 16:04:05.579699 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:04:05 crc kubenswrapper[5120]: I0316 16:04:05.579814 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-infra/auto-csr-approver-29561278-nt8th"] Mar 16 16:04:05 crc kubenswrapper[5120]: I0316 16:04:05.579846 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-infra/auto-csr-approver-29561278-nt8th"] Mar 16 16:04:05 crc kubenswrapper[5120]: I0316 16:04:05.579876 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:04:05 crc kubenswrapper[5120]: I0316 16:04:05.579933 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:04:05 crc kubenswrapper[5120]: I0316 16:04:05.583252 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-kube-state-metrics-svc\"" Mar 16 16:04:05 crc kubenswrapper[5120]: I0316 16:04:05.583326 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"kube-state-metrics-tls-config\"" Mar 16 16:04:05 crc kubenswrapper[5120]: I0316 16:04:05.658701 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26cqj\" (UniqueName: \"kubernetes.io/projected/bf18fdee-b4c7-4582-adad-7025308e294a-kube-api-access-26cqj\") pod \"kube-state-metrics-0\" (UID: \"bf18fdee-b4c7-4582-adad-7025308e294a\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:04:05 crc kubenswrapper[5120]: I0316 16:04:05.659130 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/bf18fdee-b4c7-4582-adad-7025308e294a-kube-state-metrics-tls-config\") pod \"kube-state-metrics-0\" (UID: \"bf18fdee-b4c7-4582-adad-7025308e294a\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:04:05 crc kubenswrapper[5120]: I0316 16:04:05.659185 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bf18fdee-b4c7-4582-adad-7025308e294a-combined-ca-bundle\") pod \"kube-state-metrics-0\" (UID: \"bf18fdee-b4c7-4582-adad-7025308e294a\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:04:05 crc kubenswrapper[5120]: I0316 16:04:05.659243 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/bf18fdee-b4c7-4582-adad-7025308e294a-kube-state-metrics-tls-certs\") pod \"kube-state-metrics-0\" (UID: \"bf18fdee-b4c7-4582-adad-7025308e294a\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:04:05 crc kubenswrapper[5120]: I0316 16:04:05.675918 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 16:04:05 crc kubenswrapper[5120]: I0316 16:04:05.761034 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-26cqj\" (UniqueName: \"kubernetes.io/projected/bf18fdee-b4c7-4582-adad-7025308e294a-kube-api-access-26cqj\") pod \"kube-state-metrics-0\" (UID: \"bf18fdee-b4c7-4582-adad-7025308e294a\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:04:05 crc kubenswrapper[5120]: I0316 16:04:05.761381 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/bf18fdee-b4c7-4582-adad-7025308e294a-kube-state-metrics-tls-config\") pod \"kube-state-metrics-0\" (UID: \"bf18fdee-b4c7-4582-adad-7025308e294a\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:04:05 crc kubenswrapper[5120]: I0316 16:04:05.761522 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bf18fdee-b4c7-4582-adad-7025308e294a-combined-ca-bundle\") pod \"kube-state-metrics-0\" (UID: \"bf18fdee-b4c7-4582-adad-7025308e294a\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:04:05 crc kubenswrapper[5120]: I0316 16:04:05.761632 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/bf18fdee-b4c7-4582-adad-7025308e294a-kube-state-metrics-tls-certs\") pod \"kube-state-metrics-0\" (UID: \"bf18fdee-b4c7-4582-adad-7025308e294a\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:04:05 crc kubenswrapper[5120]: I0316 16:04:05.773196 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bf18fdee-b4c7-4582-adad-7025308e294a-combined-ca-bundle\") pod \"kube-state-metrics-0\" (UID: \"bf18fdee-b4c7-4582-adad-7025308e294a\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:04:05 crc kubenswrapper[5120]: I0316 16:04:05.774241 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/bf18fdee-b4c7-4582-adad-7025308e294a-kube-state-metrics-tls-config\") pod \"kube-state-metrics-0\" (UID: \"bf18fdee-b4c7-4582-adad-7025308e294a\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:04:05 crc kubenswrapper[5120]: I0316 16:04:05.778176 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/bf18fdee-b4c7-4582-adad-7025308e294a-kube-state-metrics-tls-certs\") pod \"kube-state-metrics-0\" (UID: \"bf18fdee-b4c7-4582-adad-7025308e294a\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:04:05 crc kubenswrapper[5120]: I0316 16:04:05.782672 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-26cqj\" (UniqueName: \"kubernetes.io/projected/bf18fdee-b4c7-4582-adad-7025308e294a-kube-api-access-26cqj\") pod \"kube-state-metrics-0\" (UID: \"bf18fdee-b4c7-4582-adad-7025308e294a\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:04:05 crc kubenswrapper[5120]: I0316 16:04:05.969424 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:04:06 crc kubenswrapper[5120]: I0316 16:04:06.340541 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:04:06 crc kubenswrapper[5120]: I0316 16:04:06.340885 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:04:06 crc kubenswrapper[5120]: I0316 16:04:06.402954 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="8cd43ab9-76e5-4675-9dc3-73ca6fd27367" containerName="nova-api-api" probeResult="failure" output="Get \"http://10.217.1.165:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 16:04:06 crc kubenswrapper[5120]: I0316 16:04:06.403007 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="8cd43ab9-76e5-4675-9dc3-73ca6fd27367" containerName="nova-api-log" probeResult="failure" output="Get \"http://10.217.1.165:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 16:04:06 crc kubenswrapper[5120]: I0316 16:04:06.466953 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 16:04:06 crc kubenswrapper[5120]: W0316 16:04:06.469429 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbf18fdee_b4c7_4582_adad_7025308e294a.slice/crio-cb4985470b62aff5699121922eb399c52b88fb8921a75e967f76a866b024ffdf WatchSource:0}: Error finding container cb4985470b62aff5699121922eb399c52b88fb8921a75e967f76a866b024ffdf: Status 404 returned error can't find the container with id cb4985470b62aff5699121922eb399c52b88fb8921a75e967f76a866b024ffdf Mar 16 16:04:06 crc kubenswrapper[5120]: I0316 16:04:06.672842 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b5ebd69d-6eae-46e3-8567-f43a281355ef" path="/var/lib/kubelet/pods/b5ebd69d-6eae-46e3-8567-f43a281355ef/volumes" Mar 16 16:04:06 crc kubenswrapper[5120]: I0316 16:04:06.673490 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e86380ec-b865-4f35-9a18-c2940e1216cb" path="/var/lib/kubelet/pods/e86380ec-b865-4f35-9a18-c2940e1216cb/volumes" Mar 16 16:04:06 crc kubenswrapper[5120]: I0316 16:04:06.782509 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:04:06 crc kubenswrapper[5120]: I0316 16:04:06.782918 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="89a42fd0-da54-467f-9a6f-7c9d6616f659" containerName="ceilometer-central-agent" containerID="cri-o://58f65bb19a8bef771f740695fdef128d489638d503aad2ffe145923bfee7078c" gracePeriod=30 Mar 16 16:04:06 crc kubenswrapper[5120]: I0316 16:04:06.783002 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="89a42fd0-da54-467f-9a6f-7c9d6616f659" containerName="proxy-httpd" containerID="cri-o://ec6db546a1485027c7a2136b202105ab10b81c70771cdf5767e6b2204b7e60fc" gracePeriod=30 Mar 16 16:04:06 crc kubenswrapper[5120]: I0316 16:04:06.783076 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="89a42fd0-da54-467f-9a6f-7c9d6616f659" containerName="ceilometer-notification-agent" containerID="cri-o://3c69481010b6552720db4285e9cc48245414b17eda40dd18655f3ad51e9799a3" gracePeriod=30 Mar 16 16:04:06 crc kubenswrapper[5120]: I0316 16:04:06.783054 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="89a42fd0-da54-467f-9a6f-7c9d6616f659" containerName="sg-core" containerID="cri-o://d45487ad0385df222253b7f7d0ec861cf60b433abb44e075eb3f8a664096f1fb" gracePeriod=30 Mar 16 16:04:07 crc kubenswrapper[5120]: I0316 16:04:07.085479 5120 generic.go:358] "Generic (PLEG): container finished" podID="89a42fd0-da54-467f-9a6f-7c9d6616f659" containerID="ec6db546a1485027c7a2136b202105ab10b81c70771cdf5767e6b2204b7e60fc" exitCode=0 Mar 16 16:04:07 crc kubenswrapper[5120]: I0316 16:04:07.085820 5120 generic.go:358] "Generic (PLEG): container finished" podID="89a42fd0-da54-467f-9a6f-7c9d6616f659" containerID="d45487ad0385df222253b7f7d0ec861cf60b433abb44e075eb3f8a664096f1fb" exitCode=2 Mar 16 16:04:07 crc kubenswrapper[5120]: I0316 16:04:07.085558 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"89a42fd0-da54-467f-9a6f-7c9d6616f659","Type":"ContainerDied","Data":"ec6db546a1485027c7a2136b202105ab10b81c70771cdf5767e6b2204b7e60fc"} Mar 16 16:04:07 crc kubenswrapper[5120]: I0316 16:04:07.085962 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"89a42fd0-da54-467f-9a6f-7c9d6616f659","Type":"ContainerDied","Data":"d45487ad0385df222253b7f7d0ec861cf60b433abb44e075eb3f8a664096f1fb"} Mar 16 16:04:07 crc kubenswrapper[5120]: I0316 16:04:07.087969 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"bf18fdee-b4c7-4582-adad-7025308e294a","Type":"ContainerStarted","Data":"cb4985470b62aff5699121922eb399c52b88fb8921a75e967f76a866b024ffdf"} Mar 16 16:04:07 crc kubenswrapper[5120]: I0316 16:04:07.090751 5120 generic.go:358] "Generic (PLEG): container finished" podID="e5bc895e-5719-43f2-bbbe-e892520dbdd9" containerID="82bbb6ccca17d71e282ef2e46f6279fe406d5f8c97fc1cf7ecf828e9ef042e9f" exitCode=0 Mar 16 16:04:07 crc kubenswrapper[5120]: I0316 16:04:07.090961 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-x2wb5" event={"ID":"e5bc895e-5719-43f2-bbbe-e892520dbdd9","Type":"ContainerDied","Data":"82bbb6ccca17d71e282ef2e46f6279fe406d5f8c97fc1cf7ecf828e9ef042e9f"} Mar 16 16:04:07 crc kubenswrapper[5120]: I0316 16:04:07.347952 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="b846aa1f-40e6-4224-bbdc-3e00530e2de4" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"https://10.217.1.166:8775/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 16:04:07 crc kubenswrapper[5120]: I0316 16:04:07.350578 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="b846aa1f-40e6-4224-bbdc-3e00530e2de4" containerName="nova-metadata-log" probeResult="failure" output="Get \"https://10.217.1.166:8775/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 16:04:08 crc kubenswrapper[5120]: I0316 16:04:08.104970 5120 generic.go:358] "Generic (PLEG): container finished" podID="89a42fd0-da54-467f-9a6f-7c9d6616f659" containerID="58f65bb19a8bef771f740695fdef128d489638d503aad2ffe145923bfee7078c" exitCode=0 Mar 16 16:04:08 crc kubenswrapper[5120]: I0316 16:04:08.105123 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"89a42fd0-da54-467f-9a6f-7c9d6616f659","Type":"ContainerDied","Data":"58f65bb19a8bef771f740695fdef128d489638d503aad2ffe145923bfee7078c"} Mar 16 16:04:08 crc kubenswrapper[5120]: I0316 16:04:08.116721 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"bf18fdee-b4c7-4582-adad-7025308e294a","Type":"ContainerStarted","Data":"2dafb1802184407cc6fca262f22606a9a38d289c9b6357255620abb0d8c59bbb"} Mar 16 16:04:08 crc kubenswrapper[5120]: I0316 16:04:08.116919 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:04:08 crc kubenswrapper[5120]: E0316 16:04:08.128842 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1772237 actualBytes=10240 Mar 16 16:04:08 crc kubenswrapper[5120]: I0316 16:04:08.140543 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/kube-state-metrics-0" podStartSLOduration=2.7378179879999998 podStartE2EDuration="3.140523641s" podCreationTimestamp="2026-03-16 16:04:05 +0000 UTC" firstStartedPulling="2026-03-16 16:04:06.472608826 +0000 UTC m=+1948.626540483" lastFinishedPulling="2026-03-16 16:04:06.875314479 +0000 UTC m=+1949.029246136" observedRunningTime="2026-03-16 16:04:08.137885979 +0000 UTC m=+1950.291817636" watchObservedRunningTime="2026-03-16 16:04:08.140523641 +0000 UTC m=+1950.294455298" Mar 16 16:04:08 crc kubenswrapper[5120]: I0316 16:04:08.541842 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-x2wb5" Mar 16 16:04:08 crc kubenswrapper[5120]: I0316 16:04:08.631703 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e5bc895e-5719-43f2-bbbe-e892520dbdd9-scripts\") pod \"e5bc895e-5719-43f2-bbbe-e892520dbdd9\" (UID: \"e5bc895e-5719-43f2-bbbe-e892520dbdd9\") " Mar 16 16:04:08 crc kubenswrapper[5120]: I0316 16:04:08.631744 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vj7pf\" (UniqueName: \"kubernetes.io/projected/e5bc895e-5719-43f2-bbbe-e892520dbdd9-kube-api-access-vj7pf\") pod \"e5bc895e-5719-43f2-bbbe-e892520dbdd9\" (UID: \"e5bc895e-5719-43f2-bbbe-e892520dbdd9\") " Mar 16 16:04:08 crc kubenswrapper[5120]: I0316 16:04:08.631786 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e5bc895e-5719-43f2-bbbe-e892520dbdd9-config-data\") pod \"e5bc895e-5719-43f2-bbbe-e892520dbdd9\" (UID: \"e5bc895e-5719-43f2-bbbe-e892520dbdd9\") " Mar 16 16:04:08 crc kubenswrapper[5120]: I0316 16:04:08.631931 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e5bc895e-5719-43f2-bbbe-e892520dbdd9-combined-ca-bundle\") pod \"e5bc895e-5719-43f2-bbbe-e892520dbdd9\" (UID: \"e5bc895e-5719-43f2-bbbe-e892520dbdd9\") " Mar 16 16:04:08 crc kubenswrapper[5120]: I0316 16:04:08.637642 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e5bc895e-5719-43f2-bbbe-e892520dbdd9-scripts" (OuterVolumeSpecName: "scripts") pod "e5bc895e-5719-43f2-bbbe-e892520dbdd9" (UID: "e5bc895e-5719-43f2-bbbe-e892520dbdd9"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:04:08 crc kubenswrapper[5120]: I0316 16:04:08.637948 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5bc895e-5719-43f2-bbbe-e892520dbdd9-kube-api-access-vj7pf" (OuterVolumeSpecName: "kube-api-access-vj7pf") pod "e5bc895e-5719-43f2-bbbe-e892520dbdd9" (UID: "e5bc895e-5719-43f2-bbbe-e892520dbdd9"). InnerVolumeSpecName "kube-api-access-vj7pf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:04:08 crc kubenswrapper[5120]: I0316 16:04:08.661932 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e5bc895e-5719-43f2-bbbe-e892520dbdd9-config-data" (OuterVolumeSpecName: "config-data") pod "e5bc895e-5719-43f2-bbbe-e892520dbdd9" (UID: "e5bc895e-5719-43f2-bbbe-e892520dbdd9"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:04:08 crc kubenswrapper[5120]: I0316 16:04:08.662525 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e5bc895e-5719-43f2-bbbe-e892520dbdd9-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e5bc895e-5719-43f2-bbbe-e892520dbdd9" (UID: "e5bc895e-5719-43f2-bbbe-e892520dbdd9"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:04:08 crc kubenswrapper[5120]: I0316 16:04:08.735685 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e5bc895e-5719-43f2-bbbe-e892520dbdd9-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:04:08 crc kubenswrapper[5120]: I0316 16:04:08.735714 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e5bc895e-5719-43f2-bbbe-e892520dbdd9-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:04:08 crc kubenswrapper[5120]: I0316 16:04:08.735725 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e5bc895e-5719-43f2-bbbe-e892520dbdd9-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:04:08 crc kubenswrapper[5120]: I0316 16:04:08.735733 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vj7pf\" (UniqueName: \"kubernetes.io/projected/e5bc895e-5719-43f2-bbbe-e892520dbdd9-kube-api-access-vj7pf\") on node \"crc\" DevicePath \"\"" Mar 16 16:04:09 crc kubenswrapper[5120]: I0316 16:04:09.140091 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-x2wb5" Mar 16 16:04:09 crc kubenswrapper[5120]: I0316 16:04:09.140830 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-x2wb5" event={"ID":"e5bc895e-5719-43f2-bbbe-e892520dbdd9","Type":"ContainerDied","Data":"7ef9a08c8f8d3803cd2ec3a2c2f52c28fdaa39457f296204e0693bc153600d84"} Mar 16 16:04:09 crc kubenswrapper[5120]: I0316 16:04:09.140900 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7ef9a08c8f8d3803cd2ec3a2c2f52c28fdaa39457f296204e0693bc153600d84" Mar 16 16:04:09 crc kubenswrapper[5120]: I0316 16:04:09.338513 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:04:09 crc kubenswrapper[5120]: I0316 16:04:09.338947 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="8cd43ab9-76e5-4675-9dc3-73ca6fd27367" containerName="nova-api-log" containerID="cri-o://3ec26f713204f1d82c0c1ca227011a07b73abb3ba44ba28c90a21cbbeb11c1ed" gracePeriod=30 Mar 16 16:04:09 crc kubenswrapper[5120]: I0316 16:04:09.339034 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="8cd43ab9-76e5-4675-9dc3-73ca6fd27367" containerName="nova-api-api" containerID="cri-o://1e5f70d58b53de6a584014acc09aa0a97ecf167eed424a7d71af8f0cc6f32db7" gracePeriod=30 Mar 16 16:04:09 crc kubenswrapper[5120]: I0316 16:04:09.348221 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:04:09 crc kubenswrapper[5120]: I0316 16:04:09.356004 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:04:09 crc kubenswrapper[5120]: I0316 16:04:09.356260 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="b846aa1f-40e6-4224-bbdc-3e00530e2de4" containerName="nova-metadata-log" containerID="cri-o://ee70ddcf5e1416f06fdd159019f6d10208ed103bcfc86f8a15c4ab3e8937582a" gracePeriod=30 Mar 16 16:04:09 crc kubenswrapper[5120]: I0316 16:04:09.356351 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="b846aa1f-40e6-4224-bbdc-3e00530e2de4" containerName="nova-metadata-metadata" containerID="cri-o://af04b2b49b4612cfa19b882074e95c5ceed2671e569b0a06867b4ea8199b3318" gracePeriod=30 Mar 16 16:04:09 crc kubenswrapper[5120]: I0316 16:04:09.366609 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:04:09 crc kubenswrapper[5120]: I0316 16:04:09.407311 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:04:10 crc kubenswrapper[5120]: I0316 16:04:10.149522 5120 generic.go:358] "Generic (PLEG): container finished" podID="8cd43ab9-76e5-4675-9dc3-73ca6fd27367" containerID="3ec26f713204f1d82c0c1ca227011a07b73abb3ba44ba28c90a21cbbeb11c1ed" exitCode=143 Mar 16 16:04:10 crc kubenswrapper[5120]: I0316 16:04:10.149669 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"8cd43ab9-76e5-4675-9dc3-73ca6fd27367","Type":"ContainerDied","Data":"3ec26f713204f1d82c0c1ca227011a07b73abb3ba44ba28c90a21cbbeb11c1ed"} Mar 16 16:04:10 crc kubenswrapper[5120]: I0316 16:04:10.152079 5120 generic.go:358] "Generic (PLEG): container finished" podID="b846aa1f-40e6-4224-bbdc-3e00530e2de4" containerID="ee70ddcf5e1416f06fdd159019f6d10208ed103bcfc86f8a15c4ab3e8937582a" exitCode=143 Mar 16 16:04:10 crc kubenswrapper[5120]: I0316 16:04:10.152464 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="f5d3b57e-2be9-4ddd-8ac2-65a5fa52f88c" containerName="nova-scheduler-scheduler" containerID="cri-o://17d899a7f8231acf41ce5087610195ff8a21788ab94fbc6dc108c8d0520ce504" gracePeriod=30 Mar 16 16:04:10 crc kubenswrapper[5120]: I0316 16:04:10.152724 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"b846aa1f-40e6-4224-bbdc-3e00530e2de4","Type":"ContainerDied","Data":"ee70ddcf5e1416f06fdd159019f6d10208ed103bcfc86f8a15c4ab3e8937582a"} Mar 16 16:04:10 crc kubenswrapper[5120]: E0316 16:04:10.155150 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="17d899a7f8231acf41ce5087610195ff8a21788ab94fbc6dc108c8d0520ce504" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:04:10 crc kubenswrapper[5120]: E0316 16:04:10.157551 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="17d899a7f8231acf41ce5087610195ff8a21788ab94fbc6dc108c8d0520ce504" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:04:10 crc kubenswrapper[5120]: E0316 16:04:10.159401 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="17d899a7f8231acf41ce5087610195ff8a21788ab94fbc6dc108c8d0520ce504" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:04:10 crc kubenswrapper[5120]: E0316 16:04:10.159489 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="f5d3b57e-2be9-4ddd-8ac2-65a5fa52f88c" containerName="nova-scheduler-scheduler" probeResult="unknown" Mar 16 16:04:11 crc kubenswrapper[5120]: I0316 16:04:11.571027 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:04:11 crc kubenswrapper[5120]: I0316 16:04:11.735269 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f5d3b57e-2be9-4ddd-8ac2-65a5fa52f88c-config-data\") pod \"f5d3b57e-2be9-4ddd-8ac2-65a5fa52f88c\" (UID: \"f5d3b57e-2be9-4ddd-8ac2-65a5fa52f88c\") " Mar 16 16:04:11 crc kubenswrapper[5120]: I0316 16:04:11.736066 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f5d3b57e-2be9-4ddd-8ac2-65a5fa52f88c-combined-ca-bundle\") pod \"f5d3b57e-2be9-4ddd-8ac2-65a5fa52f88c\" (UID: \"f5d3b57e-2be9-4ddd-8ac2-65a5fa52f88c\") " Mar 16 16:04:11 crc kubenswrapper[5120]: I0316 16:04:11.736218 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tp8wx\" (UniqueName: \"kubernetes.io/projected/f5d3b57e-2be9-4ddd-8ac2-65a5fa52f88c-kube-api-access-tp8wx\") pod \"f5d3b57e-2be9-4ddd-8ac2-65a5fa52f88c\" (UID: \"f5d3b57e-2be9-4ddd-8ac2-65a5fa52f88c\") " Mar 16 16:04:11 crc kubenswrapper[5120]: I0316 16:04:11.746945 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5d3b57e-2be9-4ddd-8ac2-65a5fa52f88c-kube-api-access-tp8wx" (OuterVolumeSpecName: "kube-api-access-tp8wx") pod "f5d3b57e-2be9-4ddd-8ac2-65a5fa52f88c" (UID: "f5d3b57e-2be9-4ddd-8ac2-65a5fa52f88c"). InnerVolumeSpecName "kube-api-access-tp8wx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:04:11 crc kubenswrapper[5120]: I0316 16:04:11.761657 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f5d3b57e-2be9-4ddd-8ac2-65a5fa52f88c-config-data" (OuterVolumeSpecName: "config-data") pod "f5d3b57e-2be9-4ddd-8ac2-65a5fa52f88c" (UID: "f5d3b57e-2be9-4ddd-8ac2-65a5fa52f88c"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:04:11 crc kubenswrapper[5120]: I0316 16:04:11.762345 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f5d3b57e-2be9-4ddd-8ac2-65a5fa52f88c-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f5d3b57e-2be9-4ddd-8ac2-65a5fa52f88c" (UID: "f5d3b57e-2be9-4ddd-8ac2-65a5fa52f88c"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:04:11 crc kubenswrapper[5120]: I0316 16:04:11.839786 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f5d3b57e-2be9-4ddd-8ac2-65a5fa52f88c-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:04:11 crc kubenswrapper[5120]: I0316 16:04:11.839821 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f5d3b57e-2be9-4ddd-8ac2-65a5fa52f88c-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:04:11 crc kubenswrapper[5120]: I0316 16:04:11.839832 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tp8wx\" (UniqueName: \"kubernetes.io/projected/f5d3b57e-2be9-4ddd-8ac2-65a5fa52f88c-kube-api-access-tp8wx\") on node \"crc\" DevicePath \"\"" Mar 16 16:04:12 crc kubenswrapper[5120]: I0316 16:04:12.204708 5120 generic.go:358] "Generic (PLEG): container finished" podID="f5d3b57e-2be9-4ddd-8ac2-65a5fa52f88c" containerID="17d899a7f8231acf41ce5087610195ff8a21788ab94fbc6dc108c8d0520ce504" exitCode=0 Mar 16 16:04:12 crc kubenswrapper[5120]: I0316 16:04:12.204906 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"f5d3b57e-2be9-4ddd-8ac2-65a5fa52f88c","Type":"ContainerDied","Data":"17d899a7f8231acf41ce5087610195ff8a21788ab94fbc6dc108c8d0520ce504"} Mar 16 16:04:12 crc kubenswrapper[5120]: I0316 16:04:12.205116 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"f5d3b57e-2be9-4ddd-8ac2-65a5fa52f88c","Type":"ContainerDied","Data":"96ae303fa5af9ebbb16c5117aff456a6ef29c5634ce36b13378455777c39e47c"} Mar 16 16:04:12 crc kubenswrapper[5120]: I0316 16:04:12.205137 5120 scope.go:117] "RemoveContainer" containerID="17d899a7f8231acf41ce5087610195ff8a21788ab94fbc6dc108c8d0520ce504" Mar 16 16:04:12 crc kubenswrapper[5120]: I0316 16:04:12.205724 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:04:12 crc kubenswrapper[5120]: I0316 16:04:12.209100 5120 generic.go:358] "Generic (PLEG): container finished" podID="89a42fd0-da54-467f-9a6f-7c9d6616f659" containerID="3c69481010b6552720db4285e9cc48245414b17eda40dd18655f3ad51e9799a3" exitCode=0 Mar 16 16:04:12 crc kubenswrapper[5120]: I0316 16:04:12.209302 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"89a42fd0-da54-467f-9a6f-7c9d6616f659","Type":"ContainerDied","Data":"3c69481010b6552720db4285e9cc48245414b17eda40dd18655f3ad51e9799a3"} Mar 16 16:04:12 crc kubenswrapper[5120]: I0316 16:04:12.231933 5120 scope.go:117] "RemoveContainer" containerID="17d899a7f8231acf41ce5087610195ff8a21788ab94fbc6dc108c8d0520ce504" Mar 16 16:04:12 crc kubenswrapper[5120]: E0316 16:04:12.232361 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"17d899a7f8231acf41ce5087610195ff8a21788ab94fbc6dc108c8d0520ce504\": container with ID starting with 17d899a7f8231acf41ce5087610195ff8a21788ab94fbc6dc108c8d0520ce504 not found: ID does not exist" containerID="17d899a7f8231acf41ce5087610195ff8a21788ab94fbc6dc108c8d0520ce504" Mar 16 16:04:12 crc kubenswrapper[5120]: I0316 16:04:12.232389 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17d899a7f8231acf41ce5087610195ff8a21788ab94fbc6dc108c8d0520ce504"} err="failed to get container status \"17d899a7f8231acf41ce5087610195ff8a21788ab94fbc6dc108c8d0520ce504\": rpc error: code = NotFound desc = could not find container \"17d899a7f8231acf41ce5087610195ff8a21788ab94fbc6dc108c8d0520ce504\": container with ID starting with 17d899a7f8231acf41ce5087610195ff8a21788ab94fbc6dc108c8d0520ce504 not found: ID does not exist" Mar 16 16:04:12 crc kubenswrapper[5120]: I0316 16:04:12.290230 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:04:12 crc kubenswrapper[5120]: I0316 16:04:12.309798 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:04:12 crc kubenswrapper[5120]: I0316 16:04:12.322801 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:04:12 crc kubenswrapper[5120]: I0316 16:04:12.330859 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5bc895e-5719-43f2-bbbe-e892520dbdd9" containerName="nova-manage" Mar 16 16:04:12 crc kubenswrapper[5120]: I0316 16:04:12.330895 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5bc895e-5719-43f2-bbbe-e892520dbdd9" containerName="nova-manage" Mar 16 16:04:12 crc kubenswrapper[5120]: I0316 16:04:12.330931 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5d3b57e-2be9-4ddd-8ac2-65a5fa52f88c" containerName="nova-scheduler-scheduler" Mar 16 16:04:12 crc kubenswrapper[5120]: I0316 16:04:12.330938 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5d3b57e-2be9-4ddd-8ac2-65a5fa52f88c" containerName="nova-scheduler-scheduler" Mar 16 16:04:12 crc kubenswrapper[5120]: I0316 16:04:12.331166 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f5d3b57e-2be9-4ddd-8ac2-65a5fa52f88c" containerName="nova-scheduler-scheduler" Mar 16 16:04:12 crc kubenswrapper[5120]: I0316 16:04:12.331196 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e5bc895e-5719-43f2-bbbe-e892520dbdd9" containerName="nova-manage" Mar 16 16:04:12 crc kubenswrapper[5120]: I0316 16:04:12.337843 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:04:12 crc kubenswrapper[5120]: I0316 16:04:12.340921 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:04:12 crc kubenswrapper[5120]: I0316 16:04:12.343006 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-scheduler-config-data\"" Mar 16 16:04:12 crc kubenswrapper[5120]: I0316 16:04:12.350630 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3ebc6d87-1ea4-4702-b166-ba35f25972b6-config-data\") pod \"nova-scheduler-0\" (UID: \"3ebc6d87-1ea4-4702-b166-ba35f25972b6\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:04:12 crc kubenswrapper[5120]: I0316 16:04:12.350774 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3ebc6d87-1ea4-4702-b166-ba35f25972b6-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"3ebc6d87-1ea4-4702-b166-ba35f25972b6\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:04:12 crc kubenswrapper[5120]: I0316 16:04:12.350847 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-db2c8\" (UniqueName: \"kubernetes.io/projected/3ebc6d87-1ea4-4702-b166-ba35f25972b6-kube-api-access-db2c8\") pod \"nova-scheduler-0\" (UID: \"3ebc6d87-1ea4-4702-b166-ba35f25972b6\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:04:12 crc kubenswrapper[5120]: I0316 16:04:12.453327 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-db2c8\" (UniqueName: \"kubernetes.io/projected/3ebc6d87-1ea4-4702-b166-ba35f25972b6-kube-api-access-db2c8\") pod \"nova-scheduler-0\" (UID: \"3ebc6d87-1ea4-4702-b166-ba35f25972b6\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:04:12 crc kubenswrapper[5120]: I0316 16:04:12.453473 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3ebc6d87-1ea4-4702-b166-ba35f25972b6-config-data\") pod \"nova-scheduler-0\" (UID: \"3ebc6d87-1ea4-4702-b166-ba35f25972b6\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:04:12 crc kubenswrapper[5120]: I0316 16:04:12.453620 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3ebc6d87-1ea4-4702-b166-ba35f25972b6-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"3ebc6d87-1ea4-4702-b166-ba35f25972b6\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:04:12 crc kubenswrapper[5120]: I0316 16:04:12.460666 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3ebc6d87-1ea4-4702-b166-ba35f25972b6-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"3ebc6d87-1ea4-4702-b166-ba35f25972b6\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:04:12 crc kubenswrapper[5120]: I0316 16:04:12.460791 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3ebc6d87-1ea4-4702-b166-ba35f25972b6-config-data\") pod \"nova-scheduler-0\" (UID: \"3ebc6d87-1ea4-4702-b166-ba35f25972b6\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:04:12 crc kubenswrapper[5120]: I0316 16:04:12.479333 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-db2c8\" (UniqueName: \"kubernetes.io/projected/3ebc6d87-1ea4-4702-b166-ba35f25972b6-kube-api-access-db2c8\") pod \"nova-scheduler-0\" (UID: \"3ebc6d87-1ea4-4702-b166-ba35f25972b6\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:04:12 crc kubenswrapper[5120]: I0316 16:04:12.664037 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:04:12 crc kubenswrapper[5120]: I0316 16:04:12.682166 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f5d3b57e-2be9-4ddd-8ac2-65a5fa52f88c" path="/var/lib/kubelet/pods/f5d3b57e-2be9-4ddd-8ac2-65a5fa52f88c/volumes" Mar 16 16:04:12 crc kubenswrapper[5120]: I0316 16:04:12.739631 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:04:12 crc kubenswrapper[5120]: I0316 16:04:12.767693 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/89a42fd0-da54-467f-9a6f-7c9d6616f659-run-httpd\") pod \"89a42fd0-da54-467f-9a6f-7c9d6616f659\" (UID: \"89a42fd0-da54-467f-9a6f-7c9d6616f659\") " Mar 16 16:04:12 crc kubenswrapper[5120]: I0316 16:04:12.767744 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/89a42fd0-da54-467f-9a6f-7c9d6616f659-config-data\") pod \"89a42fd0-da54-467f-9a6f-7c9d6616f659\" (UID: \"89a42fd0-da54-467f-9a6f-7c9d6616f659\") " Mar 16 16:04:12 crc kubenswrapper[5120]: I0316 16:04:12.768417 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/89a42fd0-da54-467f-9a6f-7c9d6616f659-combined-ca-bundle\") pod \"89a42fd0-da54-467f-9a6f-7c9d6616f659\" (UID: \"89a42fd0-da54-467f-9a6f-7c9d6616f659\") " Mar 16 16:04:12 crc kubenswrapper[5120]: I0316 16:04:12.768544 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qdbnq\" (UniqueName: \"kubernetes.io/projected/89a42fd0-da54-467f-9a6f-7c9d6616f659-kube-api-access-qdbnq\") pod \"89a42fd0-da54-467f-9a6f-7c9d6616f659\" (UID: \"89a42fd0-da54-467f-9a6f-7c9d6616f659\") " Mar 16 16:04:12 crc kubenswrapper[5120]: I0316 16:04:12.768563 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/89a42fd0-da54-467f-9a6f-7c9d6616f659-log-httpd\") pod \"89a42fd0-da54-467f-9a6f-7c9d6616f659\" (UID: \"89a42fd0-da54-467f-9a6f-7c9d6616f659\") " Mar 16 16:04:12 crc kubenswrapper[5120]: I0316 16:04:12.768605 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/89a42fd0-da54-467f-9a6f-7c9d6616f659-sg-core-conf-yaml\") pod \"89a42fd0-da54-467f-9a6f-7c9d6616f659\" (UID: \"89a42fd0-da54-467f-9a6f-7c9d6616f659\") " Mar 16 16:04:12 crc kubenswrapper[5120]: I0316 16:04:12.768638 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/89a42fd0-da54-467f-9a6f-7c9d6616f659-scripts\") pod \"89a42fd0-da54-467f-9a6f-7c9d6616f659\" (UID: \"89a42fd0-da54-467f-9a6f-7c9d6616f659\") " Mar 16 16:04:12 crc kubenswrapper[5120]: I0316 16:04:12.770296 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89a42fd0-da54-467f-9a6f-7c9d6616f659-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "89a42fd0-da54-467f-9a6f-7c9d6616f659" (UID: "89a42fd0-da54-467f-9a6f-7c9d6616f659"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:04:12 crc kubenswrapper[5120]: I0316 16:04:12.771135 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89a42fd0-da54-467f-9a6f-7c9d6616f659-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "89a42fd0-da54-467f-9a6f-7c9d6616f659" (UID: "89a42fd0-da54-467f-9a6f-7c9d6616f659"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:04:12 crc kubenswrapper[5120]: I0316 16:04:12.782718 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/89a42fd0-da54-467f-9a6f-7c9d6616f659-kube-api-access-qdbnq" (OuterVolumeSpecName: "kube-api-access-qdbnq") pod "89a42fd0-da54-467f-9a6f-7c9d6616f659" (UID: "89a42fd0-da54-467f-9a6f-7c9d6616f659"). InnerVolumeSpecName "kube-api-access-qdbnq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:04:12 crc kubenswrapper[5120]: I0316 16:04:12.786291 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/89a42fd0-da54-467f-9a6f-7c9d6616f659-scripts" (OuterVolumeSpecName: "scripts") pod "89a42fd0-da54-467f-9a6f-7c9d6616f659" (UID: "89a42fd0-da54-467f-9a6f-7c9d6616f659"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:04:12 crc kubenswrapper[5120]: I0316 16:04:12.826196 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/89a42fd0-da54-467f-9a6f-7c9d6616f659-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "89a42fd0-da54-467f-9a6f-7c9d6616f659" (UID: "89a42fd0-da54-467f-9a6f-7c9d6616f659"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:04:12 crc kubenswrapper[5120]: I0316 16:04:12.835608 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:04:12 crc kubenswrapper[5120]: I0316 16:04:12.870418 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8cd43ab9-76e5-4675-9dc3-73ca6fd27367-logs\") pod \"8cd43ab9-76e5-4675-9dc3-73ca6fd27367\" (UID: \"8cd43ab9-76e5-4675-9dc3-73ca6fd27367\") " Mar 16 16:04:12 crc kubenswrapper[5120]: I0316 16:04:12.870493 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8cd43ab9-76e5-4675-9dc3-73ca6fd27367-combined-ca-bundle\") pod \"8cd43ab9-76e5-4675-9dc3-73ca6fd27367\" (UID: \"8cd43ab9-76e5-4675-9dc3-73ca6fd27367\") " Mar 16 16:04:12 crc kubenswrapper[5120]: I0316 16:04:12.870632 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8cd43ab9-76e5-4675-9dc3-73ca6fd27367-config-data\") pod \"8cd43ab9-76e5-4675-9dc3-73ca6fd27367\" (UID: \"8cd43ab9-76e5-4675-9dc3-73ca6fd27367\") " Mar 16 16:04:12 crc kubenswrapper[5120]: I0316 16:04:12.870685 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w9rfr\" (UniqueName: \"kubernetes.io/projected/8cd43ab9-76e5-4675-9dc3-73ca6fd27367-kube-api-access-w9rfr\") pod \"8cd43ab9-76e5-4675-9dc3-73ca6fd27367\" (UID: \"8cd43ab9-76e5-4675-9dc3-73ca6fd27367\") " Mar 16 16:04:12 crc kubenswrapper[5120]: I0316 16:04:12.871184 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/89a42fd0-da54-467f-9a6f-7c9d6616f659-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:04:12 crc kubenswrapper[5120]: I0316 16:04:12.871201 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qdbnq\" (UniqueName: \"kubernetes.io/projected/89a42fd0-da54-467f-9a6f-7c9d6616f659-kube-api-access-qdbnq\") on node \"crc\" DevicePath \"\"" Mar 16 16:04:12 crc kubenswrapper[5120]: I0316 16:04:12.871212 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/89a42fd0-da54-467f-9a6f-7c9d6616f659-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:04:12 crc kubenswrapper[5120]: I0316 16:04:12.871222 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/89a42fd0-da54-467f-9a6f-7c9d6616f659-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 16:04:12 crc kubenswrapper[5120]: I0316 16:04:12.871231 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/89a42fd0-da54-467f-9a6f-7c9d6616f659-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:04:12 crc kubenswrapper[5120]: I0316 16:04:12.871314 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8cd43ab9-76e5-4675-9dc3-73ca6fd27367-logs" (OuterVolumeSpecName: "logs") pod "8cd43ab9-76e5-4675-9dc3-73ca6fd27367" (UID: "8cd43ab9-76e5-4675-9dc3-73ca6fd27367"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:04:12 crc kubenswrapper[5120]: I0316 16:04:12.875156 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8cd43ab9-76e5-4675-9dc3-73ca6fd27367-kube-api-access-w9rfr" (OuterVolumeSpecName: "kube-api-access-w9rfr") pod "8cd43ab9-76e5-4675-9dc3-73ca6fd27367" (UID: "8cd43ab9-76e5-4675-9dc3-73ca6fd27367"). InnerVolumeSpecName "kube-api-access-w9rfr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:04:12 crc kubenswrapper[5120]: I0316 16:04:12.885600 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/89a42fd0-da54-467f-9a6f-7c9d6616f659-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "89a42fd0-da54-467f-9a6f-7c9d6616f659" (UID: "89a42fd0-da54-467f-9a6f-7c9d6616f659"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:04:12 crc kubenswrapper[5120]: I0316 16:04:12.887349 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/89a42fd0-da54-467f-9a6f-7c9d6616f659-config-data" (OuterVolumeSpecName: "config-data") pod "89a42fd0-da54-467f-9a6f-7c9d6616f659" (UID: "89a42fd0-da54-467f-9a6f-7c9d6616f659"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:04:12 crc kubenswrapper[5120]: I0316 16:04:12.898953 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8cd43ab9-76e5-4675-9dc3-73ca6fd27367-config-data" (OuterVolumeSpecName: "config-data") pod "8cd43ab9-76e5-4675-9dc3-73ca6fd27367" (UID: "8cd43ab9-76e5-4675-9dc3-73ca6fd27367"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:04:12 crc kubenswrapper[5120]: I0316 16:04:12.899512 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8cd43ab9-76e5-4675-9dc3-73ca6fd27367-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "8cd43ab9-76e5-4675-9dc3-73ca6fd27367" (UID: "8cd43ab9-76e5-4675-9dc3-73ca6fd27367"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:04:12 crc kubenswrapper[5120]: I0316 16:04:12.964644 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:04:12 crc kubenswrapper[5120]: I0316 16:04:12.972754 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/89a42fd0-da54-467f-9a6f-7c9d6616f659-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:04:12 crc kubenswrapper[5120]: I0316 16:04:12.972798 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8cd43ab9-76e5-4675-9dc3-73ca6fd27367-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:04:12 crc kubenswrapper[5120]: I0316 16:04:12.972807 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8cd43ab9-76e5-4675-9dc3-73ca6fd27367-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:04:12 crc kubenswrapper[5120]: I0316 16:04:12.972817 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/89a42fd0-da54-467f-9a6f-7c9d6616f659-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:04:12 crc kubenswrapper[5120]: I0316 16:04:12.972826 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8cd43ab9-76e5-4675-9dc3-73ca6fd27367-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:04:12 crc kubenswrapper[5120]: I0316 16:04:12.972834 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w9rfr\" (UniqueName: \"kubernetes.io/projected/8cd43ab9-76e5-4675-9dc3-73ca6fd27367-kube-api-access-w9rfr\") on node \"crc\" DevicePath \"\"" Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.074048 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b846aa1f-40e6-4224-bbdc-3e00530e2de4-config-data\") pod \"b846aa1f-40e6-4224-bbdc-3e00530e2de4\" (UID: \"b846aa1f-40e6-4224-bbdc-3e00530e2de4\") " Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.074105 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b846aa1f-40e6-4224-bbdc-3e00530e2de4-logs\") pod \"b846aa1f-40e6-4224-bbdc-3e00530e2de4\" (UID: \"b846aa1f-40e6-4224-bbdc-3e00530e2de4\") " Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.074222 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mltgr\" (UniqueName: \"kubernetes.io/projected/b846aa1f-40e6-4224-bbdc-3e00530e2de4-kube-api-access-mltgr\") pod \"b846aa1f-40e6-4224-bbdc-3e00530e2de4\" (UID: \"b846aa1f-40e6-4224-bbdc-3e00530e2de4\") " Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.074298 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b846aa1f-40e6-4224-bbdc-3e00530e2de4-combined-ca-bundle\") pod \"b846aa1f-40e6-4224-bbdc-3e00530e2de4\" (UID: \"b846aa1f-40e6-4224-bbdc-3e00530e2de4\") " Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.074424 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/b846aa1f-40e6-4224-bbdc-3e00530e2de4-nova-metadata-tls-certs\") pod \"b846aa1f-40e6-4224-bbdc-3e00530e2de4\" (UID: \"b846aa1f-40e6-4224-bbdc-3e00530e2de4\") " Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.074714 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b846aa1f-40e6-4224-bbdc-3e00530e2de4-logs" (OuterVolumeSpecName: "logs") pod "b846aa1f-40e6-4224-bbdc-3e00530e2de4" (UID: "b846aa1f-40e6-4224-bbdc-3e00530e2de4"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.074890 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b846aa1f-40e6-4224-bbdc-3e00530e2de4-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.077810 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b846aa1f-40e6-4224-bbdc-3e00530e2de4-kube-api-access-mltgr" (OuterVolumeSpecName: "kube-api-access-mltgr") pod "b846aa1f-40e6-4224-bbdc-3e00530e2de4" (UID: "b846aa1f-40e6-4224-bbdc-3e00530e2de4"). InnerVolumeSpecName "kube-api-access-mltgr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.098185 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b846aa1f-40e6-4224-bbdc-3e00530e2de4-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "b846aa1f-40e6-4224-bbdc-3e00530e2de4" (UID: "b846aa1f-40e6-4224-bbdc-3e00530e2de4"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.103139 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b846aa1f-40e6-4224-bbdc-3e00530e2de4-config-data" (OuterVolumeSpecName: "config-data") pod "b846aa1f-40e6-4224-bbdc-3e00530e2de4" (UID: "b846aa1f-40e6-4224-bbdc-3e00530e2de4"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.136319 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.137566 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b846aa1f-40e6-4224-bbdc-3e00530e2de4-nova-metadata-tls-certs" (OuterVolumeSpecName: "nova-metadata-tls-certs") pod "b846aa1f-40e6-4224-bbdc-3e00530e2de4" (UID: "b846aa1f-40e6-4224-bbdc-3e00530e2de4"). InnerVolumeSpecName "nova-metadata-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.190876 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mltgr\" (UniqueName: \"kubernetes.io/projected/b846aa1f-40e6-4224-bbdc-3e00530e2de4-kube-api-access-mltgr\") on node \"crc\" DevicePath \"\"" Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.190910 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b846aa1f-40e6-4224-bbdc-3e00530e2de4-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.190920 5120 reconciler_common.go:299] "Volume detached for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/b846aa1f-40e6-4224-bbdc-3e00530e2de4-nova-metadata-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.190930 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b846aa1f-40e6-4224-bbdc-3e00530e2de4-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.220274 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"3ebc6d87-1ea4-4702-b166-ba35f25972b6","Type":"ContainerStarted","Data":"ce8e12a91269e3b6faa45ce17ddaaae0c95306bd5a61a6595c6e9133bfb4d453"} Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.221624 5120 generic.go:358] "Generic (PLEG): container finished" podID="8cd43ab9-76e5-4675-9dc3-73ca6fd27367" containerID="1e5f70d58b53de6a584014acc09aa0a97ecf167eed424a7d71af8f0cc6f32db7" exitCode=0 Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.221748 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"8cd43ab9-76e5-4675-9dc3-73ca6fd27367","Type":"ContainerDied","Data":"1e5f70d58b53de6a584014acc09aa0a97ecf167eed424a7d71af8f0cc6f32db7"} Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.221941 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"8cd43ab9-76e5-4675-9dc3-73ca6fd27367","Type":"ContainerDied","Data":"42a373f3f8c70a45eb202f960f7e08764c957df6d950e0468a2b693aeecf20eb"} Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.222010 5120 scope.go:117] "RemoveContainer" containerID="1e5f70d58b53de6a584014acc09aa0a97ecf167eed424a7d71af8f0cc6f32db7" Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.222140 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.233409 5120 generic.go:358] "Generic (PLEG): container finished" podID="b846aa1f-40e6-4224-bbdc-3e00530e2de4" containerID="af04b2b49b4612cfa19b882074e95c5ceed2671e569b0a06867b4ea8199b3318" exitCode=0 Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.233490 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"b846aa1f-40e6-4224-bbdc-3e00530e2de4","Type":"ContainerDied","Data":"af04b2b49b4612cfa19b882074e95c5ceed2671e569b0a06867b4ea8199b3318"} Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.233517 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"b846aa1f-40e6-4224-bbdc-3e00530e2de4","Type":"ContainerDied","Data":"c79d2564fabfbc0b00f1fd7a7d0dfbff5b88a53c95025defee46c9c39ecfca6e"} Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.233723 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.247193 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.247308 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"89a42fd0-da54-467f-9a6f-7c9d6616f659","Type":"ContainerDied","Data":"63c03030710dbe0f7430a38b52f6cf074ec47eca1fec50106cb27897a8bf299d"} Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.357986 5120 scope.go:117] "RemoveContainer" containerID="3ec26f713204f1d82c0c1ca227011a07b73abb3ba44ba28c90a21cbbeb11c1ed" Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.383655 5120 scope.go:117] "RemoveContainer" containerID="1e5f70d58b53de6a584014acc09aa0a97ecf167eed424a7d71af8f0cc6f32db7" Mar 16 16:04:13 crc kubenswrapper[5120]: E0316 16:04:13.384415 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e5f70d58b53de6a584014acc09aa0a97ecf167eed424a7d71af8f0cc6f32db7\": container with ID starting with 1e5f70d58b53de6a584014acc09aa0a97ecf167eed424a7d71af8f0cc6f32db7 not found: ID does not exist" containerID="1e5f70d58b53de6a584014acc09aa0a97ecf167eed424a7d71af8f0cc6f32db7" Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.384450 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e5f70d58b53de6a584014acc09aa0a97ecf167eed424a7d71af8f0cc6f32db7"} err="failed to get container status \"1e5f70d58b53de6a584014acc09aa0a97ecf167eed424a7d71af8f0cc6f32db7\": rpc error: code = NotFound desc = could not find container \"1e5f70d58b53de6a584014acc09aa0a97ecf167eed424a7d71af8f0cc6f32db7\": container with ID starting with 1e5f70d58b53de6a584014acc09aa0a97ecf167eed424a7d71af8f0cc6f32db7 not found: ID does not exist" Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.384472 5120 scope.go:117] "RemoveContainer" containerID="3ec26f713204f1d82c0c1ca227011a07b73abb3ba44ba28c90a21cbbeb11c1ed" Mar 16 16:04:13 crc kubenswrapper[5120]: E0316 16:04:13.384954 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ec26f713204f1d82c0c1ca227011a07b73abb3ba44ba28c90a21cbbeb11c1ed\": container with ID starting with 3ec26f713204f1d82c0c1ca227011a07b73abb3ba44ba28c90a21cbbeb11c1ed not found: ID does not exist" containerID="3ec26f713204f1d82c0c1ca227011a07b73abb3ba44ba28c90a21cbbeb11c1ed" Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.385001 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ec26f713204f1d82c0c1ca227011a07b73abb3ba44ba28c90a21cbbeb11c1ed"} err="failed to get container status \"3ec26f713204f1d82c0c1ca227011a07b73abb3ba44ba28c90a21cbbeb11c1ed\": rpc error: code = NotFound desc = could not find container \"3ec26f713204f1d82c0c1ca227011a07b73abb3ba44ba28c90a21cbbeb11c1ed\": container with ID starting with 3ec26f713204f1d82c0c1ca227011a07b73abb3ba44ba28c90a21cbbeb11c1ed not found: ID does not exist" Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.385027 5120 scope.go:117] "RemoveContainer" containerID="af04b2b49b4612cfa19b882074e95c5ceed2671e569b0a06867b4ea8199b3318" Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.421337 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.431264 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.441844 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.450011 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.460642 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.461629 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8cd43ab9-76e5-4675-9dc3-73ca6fd27367" containerName="nova-api-log" Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.461647 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8cd43ab9-76e5-4675-9dc3-73ca6fd27367" containerName="nova-api-log" Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.461661 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8cd43ab9-76e5-4675-9dc3-73ca6fd27367" containerName="nova-api-api" Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.461666 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8cd43ab9-76e5-4675-9dc3-73ca6fd27367" containerName="nova-api-api" Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.461681 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89a42fd0-da54-467f-9a6f-7c9d6616f659" containerName="sg-core" Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.461686 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="89a42fd0-da54-467f-9a6f-7c9d6616f659" containerName="sg-core" Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.461700 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89a42fd0-da54-467f-9a6f-7c9d6616f659" containerName="ceilometer-notification-agent" Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.461706 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="89a42fd0-da54-467f-9a6f-7c9d6616f659" containerName="ceilometer-notification-agent" Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.461718 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b846aa1f-40e6-4224-bbdc-3e00530e2de4" containerName="nova-metadata-log" Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.461724 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="b846aa1f-40e6-4224-bbdc-3e00530e2de4" containerName="nova-metadata-log" Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.461738 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b846aa1f-40e6-4224-bbdc-3e00530e2de4" containerName="nova-metadata-metadata" Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.461744 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="b846aa1f-40e6-4224-bbdc-3e00530e2de4" containerName="nova-metadata-metadata" Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.461773 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89a42fd0-da54-467f-9a6f-7c9d6616f659" containerName="proxy-httpd" Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.461778 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="89a42fd0-da54-467f-9a6f-7c9d6616f659" containerName="proxy-httpd" Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.461788 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89a42fd0-da54-467f-9a6f-7c9d6616f659" containerName="ceilometer-central-agent" Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.461794 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="89a42fd0-da54-467f-9a6f-7c9d6616f659" containerName="ceilometer-central-agent" Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.461958 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="b846aa1f-40e6-4224-bbdc-3e00530e2de4" containerName="nova-metadata-metadata" Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.461976 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="89a42fd0-da54-467f-9a6f-7c9d6616f659" containerName="sg-core" Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.461986 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="89a42fd0-da54-467f-9a6f-7c9d6616f659" containerName="proxy-httpd" Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.461996 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="b846aa1f-40e6-4224-bbdc-3e00530e2de4" containerName="nova-metadata-log" Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.462007 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="89a42fd0-da54-467f-9a6f-7c9d6616f659" containerName="ceilometer-central-agent" Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.462018 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="8cd43ab9-76e5-4675-9dc3-73ca6fd27367" containerName="nova-api-log" Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.462025 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="8cd43ab9-76e5-4675-9dc3-73ca6fd27367" containerName="nova-api-api" Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.462034 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="89a42fd0-da54-467f-9a6f-7c9d6616f659" containerName="ceilometer-notification-agent" Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.468007 5120 scope.go:117] "RemoveContainer" containerID="ee70ddcf5e1416f06fdd159019f6d10208ed103bcfc86f8a15c4ab3e8937582a" Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.469596 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.473906 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.474010 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-metadata-config-data\"" Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.474135 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-metadata-internal-svc\"" Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.486145 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.495478 5120 scope.go:117] "RemoveContainer" containerID="af04b2b49b4612cfa19b882074e95c5ceed2671e569b0a06867b4ea8199b3318" Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.496172 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:04:13 crc kubenswrapper[5120]: E0316 16:04:13.496204 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af04b2b49b4612cfa19b882074e95c5ceed2671e569b0a06867b4ea8199b3318\": container with ID starting with af04b2b49b4612cfa19b882074e95c5ceed2671e569b0a06867b4ea8199b3318 not found: ID does not exist" containerID="af04b2b49b4612cfa19b882074e95c5ceed2671e569b0a06867b4ea8199b3318" Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.496366 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af04b2b49b4612cfa19b882074e95c5ceed2671e569b0a06867b4ea8199b3318"} err="failed to get container status \"af04b2b49b4612cfa19b882074e95c5ceed2671e569b0a06867b4ea8199b3318\": rpc error: code = NotFound desc = could not find container \"af04b2b49b4612cfa19b882074e95c5ceed2671e569b0a06867b4ea8199b3318\": container with ID starting with af04b2b49b4612cfa19b882074e95c5ceed2671e569b0a06867b4ea8199b3318 not found: ID does not exist" Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.496401 5120 scope.go:117] "RemoveContainer" containerID="ee70ddcf5e1416f06fdd159019f6d10208ed103bcfc86f8a15c4ab3e8937582a" Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.496518 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:04:13 crc kubenswrapper[5120]: E0316 16:04:13.496860 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee70ddcf5e1416f06fdd159019f6d10208ed103bcfc86f8a15c4ab3e8937582a\": container with ID starting with ee70ddcf5e1416f06fdd159019f6d10208ed103bcfc86f8a15c4ab3e8937582a not found: ID does not exist" containerID="ee70ddcf5e1416f06fdd159019f6d10208ed103bcfc86f8a15c4ab3e8937582a" Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.496915 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee70ddcf5e1416f06fdd159019f6d10208ed103bcfc86f8a15c4ab3e8937582a"} err="failed to get container status \"ee70ddcf5e1416f06fdd159019f6d10208ed103bcfc86f8a15c4ab3e8937582a\": rpc error: code = NotFound desc = could not find container \"ee70ddcf5e1416f06fdd159019f6d10208ed103bcfc86f8a15c4ab3e8937582a\": container with ID starting with ee70ddcf5e1416f06fdd159019f6d10208ed103bcfc86f8a15c4ab3e8937582a not found: ID does not exist" Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.496946 5120 scope.go:117] "RemoveContainer" containerID="ec6db546a1485027c7a2136b202105ab10b81c70771cdf5767e6b2204b7e60fc" Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.500908 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-config-data\"" Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.504977 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.520418 5120 scope.go:117] "RemoveContainer" containerID="d45487ad0385df222253b7f7d0ec861cf60b433abb44e075eb3f8a664096f1fb" Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.520909 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.543706 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.551768 5120 scope.go:117] "RemoveContainer" containerID="3c69481010b6552720db4285e9cc48245414b17eda40dd18655f3ad51e9799a3" Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.555311 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.555438 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.558450 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ceilometer-internal-svc\"" Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.558790 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.560045 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.584890 5120 scope.go:117] "RemoveContainer" containerID="58f65bb19a8bef771f740695fdef128d489638d503aad2ffe145923bfee7078c" Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.604301 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zlmrv\" (UniqueName: \"kubernetes.io/projected/7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb-kube-api-access-zlmrv\") pod \"ceilometer-0\" (UID: \"7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.604336 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb-run-httpd\") pod \"ceilometer-0\" (UID: \"7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.604367 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/dc65f459-0e57-40f8-bab7-5a42ed6c2eb2-logs\") pod \"nova-api-0\" (UID: \"dc65f459-0e57-40f8-bab7-5a42ed6c2eb2\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.604433 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.604450 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.604639 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bf01270c-6ae8-4c7f-aee3-42a125c155e4-config-data\") pod \"nova-metadata-0\" (UID: \"bf01270c-6ae8-4c7f-aee3-42a125c155e4\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.604733 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/bf01270c-6ae8-4c7f-aee3-42a125c155e4-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"bf01270c-6ae8-4c7f-aee3-42a125c155e4\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.606034 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bf01270c-6ae8-4c7f-aee3-42a125c155e4-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"bf01270c-6ae8-4c7f-aee3-42a125c155e4\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.606131 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dc65f459-0e57-40f8-bab7-5a42ed6c2eb2-config-data\") pod \"nova-api-0\" (UID: \"dc65f459-0e57-40f8-bab7-5a42ed6c2eb2\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.606173 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/bf01270c-6ae8-4c7f-aee3-42a125c155e4-logs\") pod \"nova-metadata-0\" (UID: \"bf01270c-6ae8-4c7f-aee3-42a125c155e4\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.606188 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzfqm\" (UniqueName: \"kubernetes.io/projected/bf01270c-6ae8-4c7f-aee3-42a125c155e4-kube-api-access-lzfqm\") pod \"nova-metadata-0\" (UID: \"bf01270c-6ae8-4c7f-aee3-42a125c155e4\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.606228 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dc65f459-0e57-40f8-bab7-5a42ed6c2eb2-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"dc65f459-0e57-40f8-bab7-5a42ed6c2eb2\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.606265 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb-config-data\") pod \"ceilometer-0\" (UID: \"7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.606348 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb-log-httpd\") pod \"ceilometer-0\" (UID: \"7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.606437 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5pb2\" (UniqueName: \"kubernetes.io/projected/dc65f459-0e57-40f8-bab7-5a42ed6c2eb2-kube-api-access-r5pb2\") pod \"nova-api-0\" (UID: \"dc65f459-0e57-40f8-bab7-5a42ed6c2eb2\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.606457 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.606529 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb-scripts\") pod \"ceilometer-0\" (UID: \"7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.709596 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dc65f459-0e57-40f8-bab7-5a42ed6c2eb2-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"dc65f459-0e57-40f8-bab7-5a42ed6c2eb2\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.709707 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb-config-data\") pod \"ceilometer-0\" (UID: \"7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.709901 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb-log-httpd\") pod \"ceilometer-0\" (UID: \"7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.710003 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r5pb2\" (UniqueName: \"kubernetes.io/projected/dc65f459-0e57-40f8-bab7-5a42ed6c2eb2-kube-api-access-r5pb2\") pod \"nova-api-0\" (UID: \"dc65f459-0e57-40f8-bab7-5a42ed6c2eb2\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.710050 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.710160 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb-scripts\") pod \"ceilometer-0\" (UID: \"7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.710368 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zlmrv\" (UniqueName: \"kubernetes.io/projected/7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb-kube-api-access-zlmrv\") pod \"ceilometer-0\" (UID: \"7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.710422 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb-run-httpd\") pod \"ceilometer-0\" (UID: \"7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.710876 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb-log-httpd\") pod \"ceilometer-0\" (UID: \"7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.711197 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb-run-httpd\") pod \"ceilometer-0\" (UID: \"7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.711370 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/dc65f459-0e57-40f8-bab7-5a42ed6c2eb2-logs\") pod \"nova-api-0\" (UID: \"dc65f459-0e57-40f8-bab7-5a42ed6c2eb2\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.711704 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/dc65f459-0e57-40f8-bab7-5a42ed6c2eb2-logs\") pod \"nova-api-0\" (UID: \"dc65f459-0e57-40f8-bab7-5a42ed6c2eb2\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.712127 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.712208 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.712365 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bf01270c-6ae8-4c7f-aee3-42a125c155e4-config-data\") pod \"nova-metadata-0\" (UID: \"bf01270c-6ae8-4c7f-aee3-42a125c155e4\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.712462 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/bf01270c-6ae8-4c7f-aee3-42a125c155e4-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"bf01270c-6ae8-4c7f-aee3-42a125c155e4\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.712540 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bf01270c-6ae8-4c7f-aee3-42a125c155e4-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"bf01270c-6ae8-4c7f-aee3-42a125c155e4\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.712649 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dc65f459-0e57-40f8-bab7-5a42ed6c2eb2-config-data\") pod \"nova-api-0\" (UID: \"dc65f459-0e57-40f8-bab7-5a42ed6c2eb2\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.712725 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/bf01270c-6ae8-4c7f-aee3-42a125c155e4-logs\") pod \"nova-metadata-0\" (UID: \"bf01270c-6ae8-4c7f-aee3-42a125c155e4\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.712836 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lzfqm\" (UniqueName: \"kubernetes.io/projected/bf01270c-6ae8-4c7f-aee3-42a125c155e4-kube-api-access-lzfqm\") pod \"nova-metadata-0\" (UID: \"bf01270c-6ae8-4c7f-aee3-42a125c155e4\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.713722 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/bf01270c-6ae8-4c7f-aee3-42a125c155e4-logs\") pod \"nova-metadata-0\" (UID: \"bf01270c-6ae8-4c7f-aee3-42a125c155e4\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.715910 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.717958 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dc65f459-0e57-40f8-bab7-5a42ed6c2eb2-config-data\") pod \"nova-api-0\" (UID: \"dc65f459-0e57-40f8-bab7-5a42ed6c2eb2\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.719272 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dc65f459-0e57-40f8-bab7-5a42ed6c2eb2-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"dc65f459-0e57-40f8-bab7-5a42ed6c2eb2\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.720961 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bf01270c-6ae8-4c7f-aee3-42a125c155e4-config-data\") pod \"nova-metadata-0\" (UID: \"bf01270c-6ae8-4c7f-aee3-42a125c155e4\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.721829 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.725821 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bf01270c-6ae8-4c7f-aee3-42a125c155e4-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"bf01270c-6ae8-4c7f-aee3-42a125c155e4\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.726000 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5pb2\" (UniqueName: \"kubernetes.io/projected/dc65f459-0e57-40f8-bab7-5a42ed6c2eb2-kube-api-access-r5pb2\") pod \"nova-api-0\" (UID: \"dc65f459-0e57-40f8-bab7-5a42ed6c2eb2\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.728399 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/bf01270c-6ae8-4c7f-aee3-42a125c155e4-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"bf01270c-6ae8-4c7f-aee3-42a125c155e4\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.729493 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.731834 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zlmrv\" (UniqueName: \"kubernetes.io/projected/7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb-kube-api-access-zlmrv\") pod \"ceilometer-0\" (UID: \"7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.733248 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzfqm\" (UniqueName: \"kubernetes.io/projected/bf01270c-6ae8-4c7f-aee3-42a125c155e4-kube-api-access-lzfqm\") pod \"nova-metadata-0\" (UID: \"bf01270c-6ae8-4c7f-aee3-42a125c155e4\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.733461 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb-scripts\") pod \"ceilometer-0\" (UID: \"7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.743139 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb-config-data\") pod \"ceilometer-0\" (UID: \"7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.789636 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.815174 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:04:13 crc kubenswrapper[5120]: I0316 16:04:13.879954 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:04:14 crc kubenswrapper[5120]: I0316 16:04:14.262022 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"3ebc6d87-1ea4-4702-b166-ba35f25972b6","Type":"ContainerStarted","Data":"eff80265be11a9f35bed980c90ec7b17787848134b0779846cf1cf326e03ffdf"} Mar 16 16:04:14 crc kubenswrapper[5120]: I0316 16:04:14.295106 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-scheduler-0" podStartSLOduration=2.295089971 podStartE2EDuration="2.295089971s" podCreationTimestamp="2026-03-16 16:04:12 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:04:14.291474541 +0000 UTC m=+1956.445406198" watchObservedRunningTime="2026-03-16 16:04:14.295089971 +0000 UTC m=+1956.449021618" Mar 16 16:04:14 crc kubenswrapper[5120]: I0316 16:04:14.328720 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:04:14 crc kubenswrapper[5120]: I0316 16:04:14.410104 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:04:14 crc kubenswrapper[5120]: I0316 16:04:14.476551 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:04:14 crc kubenswrapper[5120]: I0316 16:04:14.674568 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="89a42fd0-da54-467f-9a6f-7c9d6616f659" path="/var/lib/kubelet/pods/89a42fd0-da54-467f-9a6f-7c9d6616f659/volumes" Mar 16 16:04:14 crc kubenswrapper[5120]: I0316 16:04:14.717493 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8cd43ab9-76e5-4675-9dc3-73ca6fd27367" path="/var/lib/kubelet/pods/8cd43ab9-76e5-4675-9dc3-73ca6fd27367/volumes" Mar 16 16:04:14 crc kubenswrapper[5120]: I0316 16:04:14.722197 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b846aa1f-40e6-4224-bbdc-3e00530e2de4" path="/var/lib/kubelet/pods/b846aa1f-40e6-4224-bbdc-3e00530e2de4/volumes" Mar 16 16:04:15 crc kubenswrapper[5120]: I0316 16:04:15.281342 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"bf01270c-6ae8-4c7f-aee3-42a125c155e4","Type":"ContainerStarted","Data":"f8852284e9aa7bf5f9936f8b164ef155d866b0509c8c5f804bc8c607e3bf3da3"} Mar 16 16:04:15 crc kubenswrapper[5120]: I0316 16:04:15.281692 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"bf01270c-6ae8-4c7f-aee3-42a125c155e4","Type":"ContainerStarted","Data":"7edc213d41fc38f7529c3978651267fea171acd33243384a105115f62973a9ef"} Mar 16 16:04:15 crc kubenswrapper[5120]: I0316 16:04:15.281704 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"bf01270c-6ae8-4c7f-aee3-42a125c155e4","Type":"ContainerStarted","Data":"1671da198747e089ff4b28fc748fc78b9729133ee2ee28ec98b40a2aa16763e8"} Mar 16 16:04:15 crc kubenswrapper[5120]: I0316 16:04:15.284145 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb","Type":"ContainerStarted","Data":"2a45a2e7119026f81f8493aa005b6cc1960e8042ccbc31264db412850422c522"} Mar 16 16:04:15 crc kubenswrapper[5120]: I0316 16:04:15.284183 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb","Type":"ContainerStarted","Data":"582aab45764153fc0fdb5c3628b290efcd3e5868527ea565d3f41d37d0c76d5b"} Mar 16 16:04:15 crc kubenswrapper[5120]: I0316 16:04:15.288466 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"dc65f459-0e57-40f8-bab7-5a42ed6c2eb2","Type":"ContainerStarted","Data":"ea7cbc682ac8972634b4f05f4a7f2d51c980b93063e545f4f98982fe14eb19c5"} Mar 16 16:04:15 crc kubenswrapper[5120]: I0316 16:04:15.288519 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"dc65f459-0e57-40f8-bab7-5a42ed6c2eb2","Type":"ContainerStarted","Data":"dff1db796369c030e55c47088ea64e58ad440c62ad64ac189ce6225f8e75bcde"} Mar 16 16:04:15 crc kubenswrapper[5120]: I0316 16:04:15.288532 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"dc65f459-0e57-40f8-bab7-5a42ed6c2eb2","Type":"ContainerStarted","Data":"0215689fd2c85d481781c56b7929e4d358aaf590cd7ad935c8167cd62741ad00"} Mar 16 16:04:15 crc kubenswrapper[5120]: I0316 16:04:15.302464 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=2.302443785 podStartE2EDuration="2.302443785s" podCreationTimestamp="2026-03-16 16:04:13 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:04:15.302369913 +0000 UTC m=+1957.456301580" watchObservedRunningTime="2026-03-16 16:04:15.302443785 +0000 UTC m=+1957.456375442" Mar 16 16:04:15 crc kubenswrapper[5120]: I0316 16:04:15.327440 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=2.327420613 podStartE2EDuration="2.327420613s" podCreationTimestamp="2026-03-16 16:04:13 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:04:15.322886758 +0000 UTC m=+1957.476818485" watchObservedRunningTime="2026-03-16 16:04:15.327420613 +0000 UTC m=+1957.481352270" Mar 16 16:04:16 crc kubenswrapper[5120]: I0316 16:04:16.304436 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb","Type":"ContainerStarted","Data":"9f5e15054e19d40aeca8a266da1d560fa86e33551d1d8554f259c7a082840240"} Mar 16 16:04:17 crc kubenswrapper[5120]: I0316 16:04:17.321922 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb","Type":"ContainerStarted","Data":"fe51943a165c66ccc931ba5bf0249660fd4fecec23bb730bc9cd14fca07c1649"} Mar 16 16:04:17 crc kubenswrapper[5120]: I0316 16:04:17.664234 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:04:19 crc kubenswrapper[5120]: I0316 16:04:19.152951 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:04:20 crc kubenswrapper[5120]: I0316 16:04:20.353670 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb","Type":"ContainerStarted","Data":"281a48c34e8903a5f142d786adab237558e1438f9ce44130f7c6ace1d22cf8f9"} Mar 16 16:04:20 crc kubenswrapper[5120]: I0316 16:04:20.353869 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:04:20 crc kubenswrapper[5120]: I0316 16:04:20.382309 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.215393388 podStartE2EDuration="7.382277495s" podCreationTimestamp="2026-03-16 16:04:13 +0000 UTC" firstStartedPulling="2026-03-16 16:04:14.49493982 +0000 UTC m=+1956.648871477" lastFinishedPulling="2026-03-16 16:04:19.661823897 +0000 UTC m=+1961.815755584" observedRunningTime="2026-03-16 16:04:20.377799622 +0000 UTC m=+1962.531731309" watchObservedRunningTime="2026-03-16 16:04:20.382277495 +0000 UTC m=+1962.536209182" Mar 16 16:04:22 crc kubenswrapper[5120]: I0316 16:04:22.672317 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:04:22 crc kubenswrapper[5120]: I0316 16:04:22.711725 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:04:23 crc kubenswrapper[5120]: I0316 16:04:23.430451 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:04:23 crc kubenswrapper[5120]: I0316 16:04:23.790471 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:04:23 crc kubenswrapper[5120]: I0316 16:04:23.790567 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:04:23 crc kubenswrapper[5120]: I0316 16:04:23.815541 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:04:23 crc kubenswrapper[5120]: I0316 16:04:23.815600 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:04:24 crc kubenswrapper[5120]: I0316 16:04:24.797936 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="bf01270c-6ae8-4c7f-aee3-42a125c155e4" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"https://10.217.1.172:8775/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 16:04:24 crc kubenswrapper[5120]: I0316 16:04:24.798930 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="bf01270c-6ae8-4c7f-aee3-42a125c155e4" containerName="nova-metadata-log" probeResult="failure" output="Get \"https://10.217.1.172:8775/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 16:04:24 crc kubenswrapper[5120]: I0316 16:04:24.856998 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="dc65f459-0e57-40f8-bab7-5a42ed6c2eb2" containerName="nova-api-log" probeResult="failure" output="Get \"http://10.217.1.173:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 16:04:24 crc kubenswrapper[5120]: I0316 16:04:24.857907 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="dc65f459-0e57-40f8-bab7-5a42ed6c2eb2" containerName="nova-api-api" probeResult="failure" output="Get \"http://10.217.1.173:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 16:04:31 crc kubenswrapper[5120]: I0316 16:04:31.790396 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:04:31 crc kubenswrapper[5120]: I0316 16:04:31.791055 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:04:31 crc kubenswrapper[5120]: I0316 16:04:31.815801 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:04:31 crc kubenswrapper[5120]: I0316 16:04:31.815854 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:04:33 crc kubenswrapper[5120]: I0316 16:04:33.797110 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:04:33 crc kubenswrapper[5120]: I0316 16:04:33.804067 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:04:33 crc kubenswrapper[5120]: I0316 16:04:33.805557 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:04:33 crc kubenswrapper[5120]: I0316 16:04:33.822960 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:04:33 crc kubenswrapper[5120]: I0316 16:04:33.832148 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:04:33 crc kubenswrapper[5120]: I0316 16:04:33.843418 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:04:34 crc kubenswrapper[5120]: I0316 16:04:34.518752 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:04:34 crc kubenswrapper[5120]: I0316 16:04:34.521007 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:04:36 crc kubenswrapper[5120]: I0316 16:04:36.405405 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:04:36 crc kubenswrapper[5120]: I0316 16:04:36.406275 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb" containerName="ceilometer-central-agent" containerID="cri-o://2a45a2e7119026f81f8493aa005b6cc1960e8042ccbc31264db412850422c522" gracePeriod=30 Mar 16 16:04:36 crc kubenswrapper[5120]: I0316 16:04:36.406857 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb" containerName="sg-core" containerID="cri-o://fe51943a165c66ccc931ba5bf0249660fd4fecec23bb730bc9cd14fca07c1649" gracePeriod=30 Mar 16 16:04:36 crc kubenswrapper[5120]: I0316 16:04:36.406932 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb" containerName="proxy-httpd" containerID="cri-o://281a48c34e8903a5f142d786adab237558e1438f9ce44130f7c6ace1d22cf8f9" gracePeriod=30 Mar 16 16:04:36 crc kubenswrapper[5120]: I0316 16:04:36.406952 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb" containerName="ceilometer-notification-agent" containerID="cri-o://9f5e15054e19d40aeca8a266da1d560fa86e33551d1d8554f259c7a082840240" gracePeriod=30 Mar 16 16:04:36 crc kubenswrapper[5120]: I0316 16:04:36.416164 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/ceilometer-0" podUID="7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb" containerName="proxy-httpd" probeResult="failure" output="Get \"https://10.217.1.174:3000/\": EOF" Mar 16 16:04:36 crc kubenswrapper[5120]: I0316 16:04:36.564097 5120 generic.go:358] "Generic (PLEG): container finished" podID="7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb" containerID="fe51943a165c66ccc931ba5bf0249660fd4fecec23bb730bc9cd14fca07c1649" exitCode=2 Mar 16 16:04:36 crc kubenswrapper[5120]: I0316 16:04:36.564554 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb","Type":"ContainerDied","Data":"fe51943a165c66ccc931ba5bf0249660fd4fecec23bb730bc9cd14fca07c1649"} Mar 16 16:04:37 crc kubenswrapper[5120]: I0316 16:04:37.253200 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:04:37 crc kubenswrapper[5120]: I0316 16:04:37.368575 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb-ceilometer-tls-certs\") pod \"7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb\" (UID: \"7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb\") " Mar 16 16:04:37 crc kubenswrapper[5120]: I0316 16:04:37.368649 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zlmrv\" (UniqueName: \"kubernetes.io/projected/7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb-kube-api-access-zlmrv\") pod \"7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb\" (UID: \"7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb\") " Mar 16 16:04:37 crc kubenswrapper[5120]: I0316 16:04:37.368797 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb-sg-core-conf-yaml\") pod \"7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb\" (UID: \"7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb\") " Mar 16 16:04:37 crc kubenswrapper[5120]: I0316 16:04:37.368833 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb-run-httpd\") pod \"7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb\" (UID: \"7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb\") " Mar 16 16:04:37 crc kubenswrapper[5120]: I0316 16:04:37.368899 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb-combined-ca-bundle\") pod \"7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb\" (UID: \"7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb\") " Mar 16 16:04:37 crc kubenswrapper[5120]: I0316 16:04:37.368942 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb-log-httpd\") pod \"7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb\" (UID: \"7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb\") " Mar 16 16:04:37 crc kubenswrapper[5120]: I0316 16:04:37.369027 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb-config-data\") pod \"7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb\" (UID: \"7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb\") " Mar 16 16:04:37 crc kubenswrapper[5120]: I0316 16:04:37.369168 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb-scripts\") pod \"7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb\" (UID: \"7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb\") " Mar 16 16:04:37 crc kubenswrapper[5120]: I0316 16:04:37.370841 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb" (UID: "7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:04:37 crc kubenswrapper[5120]: I0316 16:04:37.374323 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb" (UID: "7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:04:37 crc kubenswrapper[5120]: I0316 16:04:37.376967 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb-kube-api-access-zlmrv" (OuterVolumeSpecName: "kube-api-access-zlmrv") pod "7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb" (UID: "7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb"). InnerVolumeSpecName "kube-api-access-zlmrv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:04:37 crc kubenswrapper[5120]: I0316 16:04:37.378285 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb-scripts" (OuterVolumeSpecName: "scripts") pod "7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb" (UID: "7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:04:37 crc kubenswrapper[5120]: I0316 16:04:37.425886 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb" (UID: "7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:04:37 crc kubenswrapper[5120]: I0316 16:04:37.449432 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb-ceilometer-tls-certs" (OuterVolumeSpecName: "ceilometer-tls-certs") pod "7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb" (UID: "7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb"). InnerVolumeSpecName "ceilometer-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:04:37 crc kubenswrapper[5120]: I0316 16:04:37.472239 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 16:04:37 crc kubenswrapper[5120]: I0316 16:04:37.472287 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:04:37 crc kubenswrapper[5120]: I0316 16:04:37.472304 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:04:37 crc kubenswrapper[5120]: I0316 16:04:37.472321 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:04:37 crc kubenswrapper[5120]: I0316 16:04:37.472338 5120 reconciler_common.go:299] "Volume detached for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb-ceilometer-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:04:37 crc kubenswrapper[5120]: I0316 16:04:37.472355 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zlmrv\" (UniqueName: \"kubernetes.io/projected/7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb-kube-api-access-zlmrv\") on node \"crc\" DevicePath \"\"" Mar 16 16:04:37 crc kubenswrapper[5120]: I0316 16:04:37.472685 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb" (UID: "7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:04:37 crc kubenswrapper[5120]: I0316 16:04:37.486977 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb-config-data" (OuterVolumeSpecName: "config-data") pod "7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb" (UID: "7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:04:37 crc kubenswrapper[5120]: I0316 16:04:37.555217 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:04:37 crc kubenswrapper[5120]: I0316 16:04:37.573794 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:04:37 crc kubenswrapper[5120]: I0316 16:04:37.573821 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:04:37 crc kubenswrapper[5120]: I0316 16:04:37.586563 5120 generic.go:358] "Generic (PLEG): container finished" podID="7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb" containerID="281a48c34e8903a5f142d786adab237558e1438f9ce44130f7c6ace1d22cf8f9" exitCode=0 Mar 16 16:04:37 crc kubenswrapper[5120]: I0316 16:04:37.586598 5120 generic.go:358] "Generic (PLEG): container finished" podID="7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb" containerID="9f5e15054e19d40aeca8a266da1d560fa86e33551d1d8554f259c7a082840240" exitCode=0 Mar 16 16:04:37 crc kubenswrapper[5120]: I0316 16:04:37.586612 5120 generic.go:358] "Generic (PLEG): container finished" podID="7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb" containerID="2a45a2e7119026f81f8493aa005b6cc1960e8042ccbc31264db412850422c522" exitCode=0 Mar 16 16:04:37 crc kubenswrapper[5120]: I0316 16:04:37.586672 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:04:37 crc kubenswrapper[5120]: I0316 16:04:37.587303 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="dc65f459-0e57-40f8-bab7-5a42ed6c2eb2" containerName="nova-api-log" containerID="cri-o://dff1db796369c030e55c47088ea64e58ad440c62ad64ac189ce6225f8e75bcde" gracePeriod=30 Mar 16 16:04:37 crc kubenswrapper[5120]: I0316 16:04:37.587462 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb","Type":"ContainerDied","Data":"281a48c34e8903a5f142d786adab237558e1438f9ce44130f7c6ace1d22cf8f9"} Mar 16 16:04:37 crc kubenswrapper[5120]: I0316 16:04:37.587476 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="dc65f459-0e57-40f8-bab7-5a42ed6c2eb2" containerName="nova-api-api" containerID="cri-o://ea7cbc682ac8972634b4f05f4a7f2d51c980b93063e545f4f98982fe14eb19c5" gracePeriod=30 Mar 16 16:04:37 crc kubenswrapper[5120]: I0316 16:04:37.587648 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb","Type":"ContainerDied","Data":"9f5e15054e19d40aeca8a266da1d560fa86e33551d1d8554f259c7a082840240"} Mar 16 16:04:37 crc kubenswrapper[5120]: I0316 16:04:37.587680 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb","Type":"ContainerDied","Data":"2a45a2e7119026f81f8493aa005b6cc1960e8042ccbc31264db412850422c522"} Mar 16 16:04:37 crc kubenswrapper[5120]: I0316 16:04:37.587699 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb","Type":"ContainerDied","Data":"582aab45764153fc0fdb5c3628b290efcd3e5868527ea565d3f41d37d0c76d5b"} Mar 16 16:04:37 crc kubenswrapper[5120]: I0316 16:04:37.587701 5120 scope.go:117] "RemoveContainer" containerID="281a48c34e8903a5f142d786adab237558e1438f9ce44130f7c6ace1d22cf8f9" Mar 16 16:04:37 crc kubenswrapper[5120]: I0316 16:04:37.623779 5120 scope.go:117] "RemoveContainer" containerID="fe51943a165c66ccc931ba5bf0249660fd4fecec23bb730bc9cd14fca07c1649" Mar 16 16:04:37 crc kubenswrapper[5120]: I0316 16:04:37.632127 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:04:37 crc kubenswrapper[5120]: I0316 16:04:37.639735 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:04:37 crc kubenswrapper[5120]: I0316 16:04:37.653350 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:04:37 crc kubenswrapper[5120]: I0316 16:04:37.654352 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb" containerName="ceilometer-central-agent" Mar 16 16:04:37 crc kubenswrapper[5120]: I0316 16:04:37.654370 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb" containerName="ceilometer-central-agent" Mar 16 16:04:37 crc kubenswrapper[5120]: I0316 16:04:37.654402 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb" containerName="ceilometer-notification-agent" Mar 16 16:04:37 crc kubenswrapper[5120]: I0316 16:04:37.654409 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb" containerName="ceilometer-notification-agent" Mar 16 16:04:37 crc kubenswrapper[5120]: I0316 16:04:37.654436 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb" containerName="proxy-httpd" Mar 16 16:04:37 crc kubenswrapper[5120]: I0316 16:04:37.654442 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb" containerName="proxy-httpd" Mar 16 16:04:37 crc kubenswrapper[5120]: I0316 16:04:37.654468 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb" containerName="sg-core" Mar 16 16:04:37 crc kubenswrapper[5120]: I0316 16:04:37.654473 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb" containerName="sg-core" Mar 16 16:04:37 crc kubenswrapper[5120]: I0316 16:04:37.654628 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb" containerName="sg-core" Mar 16 16:04:37 crc kubenswrapper[5120]: I0316 16:04:37.654646 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb" containerName="ceilometer-notification-agent" Mar 16 16:04:37 crc kubenswrapper[5120]: I0316 16:04:37.654659 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb" containerName="ceilometer-central-agent" Mar 16 16:04:37 crc kubenswrapper[5120]: I0316 16:04:37.654669 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb" containerName="proxy-httpd" Mar 16 16:04:37 crc kubenswrapper[5120]: I0316 16:04:37.664054 5120 scope.go:117] "RemoveContainer" containerID="9f5e15054e19d40aeca8a266da1d560fa86e33551d1d8554f259c7a082840240" Mar 16 16:04:37 crc kubenswrapper[5120]: I0316 16:04:37.666350 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:04:37 crc kubenswrapper[5120]: I0316 16:04:37.669539 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ceilometer-internal-svc\"" Mar 16 16:04:37 crc kubenswrapper[5120]: I0316 16:04:37.669929 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 16:04:37 crc kubenswrapper[5120]: I0316 16:04:37.670072 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 16:04:37 crc kubenswrapper[5120]: I0316 16:04:37.672656 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:04:37 crc kubenswrapper[5120]: I0316 16:04:37.707071 5120 scope.go:117] "RemoveContainer" containerID="2a45a2e7119026f81f8493aa005b6cc1960e8042ccbc31264db412850422c522" Mar 16 16:04:37 crc kubenswrapper[5120]: I0316 16:04:37.759427 5120 scope.go:117] "RemoveContainer" containerID="281a48c34e8903a5f142d786adab237558e1438f9ce44130f7c6ace1d22cf8f9" Mar 16 16:04:37 crc kubenswrapper[5120]: E0316 16:04:37.759945 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"281a48c34e8903a5f142d786adab237558e1438f9ce44130f7c6ace1d22cf8f9\": container with ID starting with 281a48c34e8903a5f142d786adab237558e1438f9ce44130f7c6ace1d22cf8f9 not found: ID does not exist" containerID="281a48c34e8903a5f142d786adab237558e1438f9ce44130f7c6ace1d22cf8f9" Mar 16 16:04:37 crc kubenswrapper[5120]: I0316 16:04:37.759983 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"281a48c34e8903a5f142d786adab237558e1438f9ce44130f7c6ace1d22cf8f9"} err="failed to get container status \"281a48c34e8903a5f142d786adab237558e1438f9ce44130f7c6ace1d22cf8f9\": rpc error: code = NotFound desc = could not find container \"281a48c34e8903a5f142d786adab237558e1438f9ce44130f7c6ace1d22cf8f9\": container with ID starting with 281a48c34e8903a5f142d786adab237558e1438f9ce44130f7c6ace1d22cf8f9 not found: ID does not exist" Mar 16 16:04:37 crc kubenswrapper[5120]: I0316 16:04:37.760028 5120 scope.go:117] "RemoveContainer" containerID="fe51943a165c66ccc931ba5bf0249660fd4fecec23bb730bc9cd14fca07c1649" Mar 16 16:04:37 crc kubenswrapper[5120]: E0316 16:04:37.760289 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe51943a165c66ccc931ba5bf0249660fd4fecec23bb730bc9cd14fca07c1649\": container with ID starting with fe51943a165c66ccc931ba5bf0249660fd4fecec23bb730bc9cd14fca07c1649 not found: ID does not exist" containerID="fe51943a165c66ccc931ba5bf0249660fd4fecec23bb730bc9cd14fca07c1649" Mar 16 16:04:37 crc kubenswrapper[5120]: I0316 16:04:37.760313 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe51943a165c66ccc931ba5bf0249660fd4fecec23bb730bc9cd14fca07c1649"} err="failed to get container status \"fe51943a165c66ccc931ba5bf0249660fd4fecec23bb730bc9cd14fca07c1649\": rpc error: code = NotFound desc = could not find container \"fe51943a165c66ccc931ba5bf0249660fd4fecec23bb730bc9cd14fca07c1649\": container with ID starting with fe51943a165c66ccc931ba5bf0249660fd4fecec23bb730bc9cd14fca07c1649 not found: ID does not exist" Mar 16 16:04:37 crc kubenswrapper[5120]: I0316 16:04:37.760325 5120 scope.go:117] "RemoveContainer" containerID="9f5e15054e19d40aeca8a266da1d560fa86e33551d1d8554f259c7a082840240" Mar 16 16:04:37 crc kubenswrapper[5120]: E0316 16:04:37.760519 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f5e15054e19d40aeca8a266da1d560fa86e33551d1d8554f259c7a082840240\": container with ID starting with 9f5e15054e19d40aeca8a266da1d560fa86e33551d1d8554f259c7a082840240 not found: ID does not exist" containerID="9f5e15054e19d40aeca8a266da1d560fa86e33551d1d8554f259c7a082840240" Mar 16 16:04:37 crc kubenswrapper[5120]: I0316 16:04:37.760552 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f5e15054e19d40aeca8a266da1d560fa86e33551d1d8554f259c7a082840240"} err="failed to get container status \"9f5e15054e19d40aeca8a266da1d560fa86e33551d1d8554f259c7a082840240\": rpc error: code = NotFound desc = could not find container \"9f5e15054e19d40aeca8a266da1d560fa86e33551d1d8554f259c7a082840240\": container with ID starting with 9f5e15054e19d40aeca8a266da1d560fa86e33551d1d8554f259c7a082840240 not found: ID does not exist" Mar 16 16:04:37 crc kubenswrapper[5120]: I0316 16:04:37.760563 5120 scope.go:117] "RemoveContainer" containerID="2a45a2e7119026f81f8493aa005b6cc1960e8042ccbc31264db412850422c522" Mar 16 16:04:37 crc kubenswrapper[5120]: E0316 16:04:37.760710 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2a45a2e7119026f81f8493aa005b6cc1960e8042ccbc31264db412850422c522\": container with ID starting with 2a45a2e7119026f81f8493aa005b6cc1960e8042ccbc31264db412850422c522 not found: ID does not exist" containerID="2a45a2e7119026f81f8493aa005b6cc1960e8042ccbc31264db412850422c522" Mar 16 16:04:37 crc kubenswrapper[5120]: I0316 16:04:37.760724 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a45a2e7119026f81f8493aa005b6cc1960e8042ccbc31264db412850422c522"} err="failed to get container status \"2a45a2e7119026f81f8493aa005b6cc1960e8042ccbc31264db412850422c522\": rpc error: code = NotFound desc = could not find container \"2a45a2e7119026f81f8493aa005b6cc1960e8042ccbc31264db412850422c522\": container with ID starting with 2a45a2e7119026f81f8493aa005b6cc1960e8042ccbc31264db412850422c522 not found: ID does not exist" Mar 16 16:04:37 crc kubenswrapper[5120]: I0316 16:04:37.760775 5120 scope.go:117] "RemoveContainer" containerID="281a48c34e8903a5f142d786adab237558e1438f9ce44130f7c6ace1d22cf8f9" Mar 16 16:04:37 crc kubenswrapper[5120]: I0316 16:04:37.760950 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"281a48c34e8903a5f142d786adab237558e1438f9ce44130f7c6ace1d22cf8f9"} err="failed to get container status \"281a48c34e8903a5f142d786adab237558e1438f9ce44130f7c6ace1d22cf8f9\": rpc error: code = NotFound desc = could not find container \"281a48c34e8903a5f142d786adab237558e1438f9ce44130f7c6ace1d22cf8f9\": container with ID starting with 281a48c34e8903a5f142d786adab237558e1438f9ce44130f7c6ace1d22cf8f9 not found: ID does not exist" Mar 16 16:04:37 crc kubenswrapper[5120]: I0316 16:04:37.760983 5120 scope.go:117] "RemoveContainer" containerID="fe51943a165c66ccc931ba5bf0249660fd4fecec23bb730bc9cd14fca07c1649" Mar 16 16:04:37 crc kubenswrapper[5120]: I0316 16:04:37.761112 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe51943a165c66ccc931ba5bf0249660fd4fecec23bb730bc9cd14fca07c1649"} err="failed to get container status \"fe51943a165c66ccc931ba5bf0249660fd4fecec23bb730bc9cd14fca07c1649\": rpc error: code = NotFound desc = could not find container \"fe51943a165c66ccc931ba5bf0249660fd4fecec23bb730bc9cd14fca07c1649\": container with ID starting with fe51943a165c66ccc931ba5bf0249660fd4fecec23bb730bc9cd14fca07c1649 not found: ID does not exist" Mar 16 16:04:37 crc kubenswrapper[5120]: I0316 16:04:37.761141 5120 scope.go:117] "RemoveContainer" containerID="9f5e15054e19d40aeca8a266da1d560fa86e33551d1d8554f259c7a082840240" Mar 16 16:04:37 crc kubenswrapper[5120]: I0316 16:04:37.761306 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f5e15054e19d40aeca8a266da1d560fa86e33551d1d8554f259c7a082840240"} err="failed to get container status \"9f5e15054e19d40aeca8a266da1d560fa86e33551d1d8554f259c7a082840240\": rpc error: code = NotFound desc = could not find container \"9f5e15054e19d40aeca8a266da1d560fa86e33551d1d8554f259c7a082840240\": container with ID starting with 9f5e15054e19d40aeca8a266da1d560fa86e33551d1d8554f259c7a082840240 not found: ID does not exist" Mar 16 16:04:37 crc kubenswrapper[5120]: I0316 16:04:37.761321 5120 scope.go:117] "RemoveContainer" containerID="2a45a2e7119026f81f8493aa005b6cc1960e8042ccbc31264db412850422c522" Mar 16 16:04:37 crc kubenswrapper[5120]: I0316 16:04:37.761486 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a45a2e7119026f81f8493aa005b6cc1960e8042ccbc31264db412850422c522"} err="failed to get container status \"2a45a2e7119026f81f8493aa005b6cc1960e8042ccbc31264db412850422c522\": rpc error: code = NotFound desc = could not find container \"2a45a2e7119026f81f8493aa005b6cc1960e8042ccbc31264db412850422c522\": container with ID starting with 2a45a2e7119026f81f8493aa005b6cc1960e8042ccbc31264db412850422c522 not found: ID does not exist" Mar 16 16:04:37 crc kubenswrapper[5120]: I0316 16:04:37.761498 5120 scope.go:117] "RemoveContainer" containerID="281a48c34e8903a5f142d786adab237558e1438f9ce44130f7c6ace1d22cf8f9" Mar 16 16:04:37 crc kubenswrapper[5120]: I0316 16:04:37.761645 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"281a48c34e8903a5f142d786adab237558e1438f9ce44130f7c6ace1d22cf8f9"} err="failed to get container status \"281a48c34e8903a5f142d786adab237558e1438f9ce44130f7c6ace1d22cf8f9\": rpc error: code = NotFound desc = could not find container \"281a48c34e8903a5f142d786adab237558e1438f9ce44130f7c6ace1d22cf8f9\": container with ID starting with 281a48c34e8903a5f142d786adab237558e1438f9ce44130f7c6ace1d22cf8f9 not found: ID does not exist" Mar 16 16:04:37 crc kubenswrapper[5120]: I0316 16:04:37.761658 5120 scope.go:117] "RemoveContainer" containerID="fe51943a165c66ccc931ba5bf0249660fd4fecec23bb730bc9cd14fca07c1649" Mar 16 16:04:37 crc kubenswrapper[5120]: I0316 16:04:37.761833 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe51943a165c66ccc931ba5bf0249660fd4fecec23bb730bc9cd14fca07c1649"} err="failed to get container status \"fe51943a165c66ccc931ba5bf0249660fd4fecec23bb730bc9cd14fca07c1649\": rpc error: code = NotFound desc = could not find container \"fe51943a165c66ccc931ba5bf0249660fd4fecec23bb730bc9cd14fca07c1649\": container with ID starting with fe51943a165c66ccc931ba5bf0249660fd4fecec23bb730bc9cd14fca07c1649 not found: ID does not exist" Mar 16 16:04:37 crc kubenswrapper[5120]: I0316 16:04:37.761876 5120 scope.go:117] "RemoveContainer" containerID="9f5e15054e19d40aeca8a266da1d560fa86e33551d1d8554f259c7a082840240" Mar 16 16:04:37 crc kubenswrapper[5120]: I0316 16:04:37.762050 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f5e15054e19d40aeca8a266da1d560fa86e33551d1d8554f259c7a082840240"} err="failed to get container status \"9f5e15054e19d40aeca8a266da1d560fa86e33551d1d8554f259c7a082840240\": rpc error: code = NotFound desc = could not find container \"9f5e15054e19d40aeca8a266da1d560fa86e33551d1d8554f259c7a082840240\": container with ID starting with 9f5e15054e19d40aeca8a266da1d560fa86e33551d1d8554f259c7a082840240 not found: ID does not exist" Mar 16 16:04:37 crc kubenswrapper[5120]: I0316 16:04:37.762073 5120 scope.go:117] "RemoveContainer" containerID="2a45a2e7119026f81f8493aa005b6cc1960e8042ccbc31264db412850422c522" Mar 16 16:04:37 crc kubenswrapper[5120]: I0316 16:04:37.764374 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a45a2e7119026f81f8493aa005b6cc1960e8042ccbc31264db412850422c522"} err="failed to get container status \"2a45a2e7119026f81f8493aa005b6cc1960e8042ccbc31264db412850422c522\": rpc error: code = NotFound desc = could not find container \"2a45a2e7119026f81f8493aa005b6cc1960e8042ccbc31264db412850422c522\": container with ID starting with 2a45a2e7119026f81f8493aa005b6cc1960e8042ccbc31264db412850422c522 not found: ID does not exist" Mar 16 16:04:37 crc kubenswrapper[5120]: I0316 16:04:37.779250 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/abd1f184-dd0e-40b2-b88c-f57a584d03dd-run-httpd\") pod \"ceilometer-0\" (UID: \"abd1f184-dd0e-40b2-b88c-f57a584d03dd\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:04:37 crc kubenswrapper[5120]: I0316 16:04:37.779334 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/abd1f184-dd0e-40b2-b88c-f57a584d03dd-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"abd1f184-dd0e-40b2-b88c-f57a584d03dd\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:04:37 crc kubenswrapper[5120]: I0316 16:04:37.779374 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/abd1f184-dd0e-40b2-b88c-f57a584d03dd-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"abd1f184-dd0e-40b2-b88c-f57a584d03dd\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:04:37 crc kubenswrapper[5120]: I0316 16:04:37.779399 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/abd1f184-dd0e-40b2-b88c-f57a584d03dd-config-data\") pod \"ceilometer-0\" (UID: \"abd1f184-dd0e-40b2-b88c-f57a584d03dd\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:04:37 crc kubenswrapper[5120]: I0316 16:04:37.779417 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/abd1f184-dd0e-40b2-b88c-f57a584d03dd-scripts\") pod \"ceilometer-0\" (UID: \"abd1f184-dd0e-40b2-b88c-f57a584d03dd\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:04:37 crc kubenswrapper[5120]: I0316 16:04:37.779461 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/abd1f184-dd0e-40b2-b88c-f57a584d03dd-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"abd1f184-dd0e-40b2-b88c-f57a584d03dd\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:04:37 crc kubenswrapper[5120]: I0316 16:04:37.779494 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/abd1f184-dd0e-40b2-b88c-f57a584d03dd-log-httpd\") pod \"ceilometer-0\" (UID: \"abd1f184-dd0e-40b2-b88c-f57a584d03dd\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:04:37 crc kubenswrapper[5120]: I0316 16:04:37.779548 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmpzl\" (UniqueName: \"kubernetes.io/projected/abd1f184-dd0e-40b2-b88c-f57a584d03dd-kube-api-access-mmpzl\") pod \"ceilometer-0\" (UID: \"abd1f184-dd0e-40b2-b88c-f57a584d03dd\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:04:37 crc kubenswrapper[5120]: I0316 16:04:37.881280 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/abd1f184-dd0e-40b2-b88c-f57a584d03dd-log-httpd\") pod \"ceilometer-0\" (UID: \"abd1f184-dd0e-40b2-b88c-f57a584d03dd\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:04:37 crc kubenswrapper[5120]: I0316 16:04:37.881364 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mmpzl\" (UniqueName: \"kubernetes.io/projected/abd1f184-dd0e-40b2-b88c-f57a584d03dd-kube-api-access-mmpzl\") pod \"ceilometer-0\" (UID: \"abd1f184-dd0e-40b2-b88c-f57a584d03dd\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:04:37 crc kubenswrapper[5120]: I0316 16:04:37.881458 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/abd1f184-dd0e-40b2-b88c-f57a584d03dd-run-httpd\") pod \"ceilometer-0\" (UID: \"abd1f184-dd0e-40b2-b88c-f57a584d03dd\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:04:37 crc kubenswrapper[5120]: I0316 16:04:37.881495 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/abd1f184-dd0e-40b2-b88c-f57a584d03dd-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"abd1f184-dd0e-40b2-b88c-f57a584d03dd\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:04:37 crc kubenswrapper[5120]: I0316 16:04:37.881535 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/abd1f184-dd0e-40b2-b88c-f57a584d03dd-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"abd1f184-dd0e-40b2-b88c-f57a584d03dd\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:04:37 crc kubenswrapper[5120]: I0316 16:04:37.881558 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/abd1f184-dd0e-40b2-b88c-f57a584d03dd-config-data\") pod \"ceilometer-0\" (UID: \"abd1f184-dd0e-40b2-b88c-f57a584d03dd\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:04:37 crc kubenswrapper[5120]: I0316 16:04:37.881575 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/abd1f184-dd0e-40b2-b88c-f57a584d03dd-scripts\") pod \"ceilometer-0\" (UID: \"abd1f184-dd0e-40b2-b88c-f57a584d03dd\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:04:37 crc kubenswrapper[5120]: I0316 16:04:37.881620 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/abd1f184-dd0e-40b2-b88c-f57a584d03dd-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"abd1f184-dd0e-40b2-b88c-f57a584d03dd\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:04:37 crc kubenswrapper[5120]: I0316 16:04:37.881794 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/abd1f184-dd0e-40b2-b88c-f57a584d03dd-log-httpd\") pod \"ceilometer-0\" (UID: \"abd1f184-dd0e-40b2-b88c-f57a584d03dd\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:04:37 crc kubenswrapper[5120]: I0316 16:04:37.882484 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/abd1f184-dd0e-40b2-b88c-f57a584d03dd-run-httpd\") pod \"ceilometer-0\" (UID: \"abd1f184-dd0e-40b2-b88c-f57a584d03dd\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:04:37 crc kubenswrapper[5120]: I0316 16:04:37.886947 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/abd1f184-dd0e-40b2-b88c-f57a584d03dd-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"abd1f184-dd0e-40b2-b88c-f57a584d03dd\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:04:37 crc kubenswrapper[5120]: I0316 16:04:37.887609 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/abd1f184-dd0e-40b2-b88c-f57a584d03dd-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"abd1f184-dd0e-40b2-b88c-f57a584d03dd\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:04:37 crc kubenswrapper[5120]: I0316 16:04:37.888851 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/abd1f184-dd0e-40b2-b88c-f57a584d03dd-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"abd1f184-dd0e-40b2-b88c-f57a584d03dd\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:04:37 crc kubenswrapper[5120]: I0316 16:04:37.889911 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/abd1f184-dd0e-40b2-b88c-f57a584d03dd-scripts\") pod \"ceilometer-0\" (UID: \"abd1f184-dd0e-40b2-b88c-f57a584d03dd\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:04:37 crc kubenswrapper[5120]: I0316 16:04:37.890000 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/abd1f184-dd0e-40b2-b88c-f57a584d03dd-config-data\") pod \"ceilometer-0\" (UID: \"abd1f184-dd0e-40b2-b88c-f57a584d03dd\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:04:37 crc kubenswrapper[5120]: I0316 16:04:37.898710 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmpzl\" (UniqueName: \"kubernetes.io/projected/abd1f184-dd0e-40b2-b88c-f57a584d03dd-kube-api-access-mmpzl\") pod \"ceilometer-0\" (UID: \"abd1f184-dd0e-40b2-b88c-f57a584d03dd\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:04:37 crc kubenswrapper[5120]: I0316 16:04:37.994489 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:04:38 crc kubenswrapper[5120]: I0316 16:04:38.485316 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:04:38 crc kubenswrapper[5120]: W0316 16:04:38.491473 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podabd1f184_dd0e_40b2_b88c_f57a584d03dd.slice/crio-8614afb9fdf275092bdc628016a3de4cbbdc012b5e0335c5d3dd4124d4b44978 WatchSource:0}: Error finding container 8614afb9fdf275092bdc628016a3de4cbbdc012b5e0335c5d3dd4124d4b44978: Status 404 returned error can't find the container with id 8614afb9fdf275092bdc628016a3de4cbbdc012b5e0335c5d3dd4124d4b44978 Mar 16 16:04:38 crc kubenswrapper[5120]: I0316 16:04:38.598971 5120 generic.go:358] "Generic (PLEG): container finished" podID="dc65f459-0e57-40f8-bab7-5a42ed6c2eb2" containerID="dff1db796369c030e55c47088ea64e58ad440c62ad64ac189ce6225f8e75bcde" exitCode=143 Mar 16 16:04:38 crc kubenswrapper[5120]: I0316 16:04:38.599070 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"dc65f459-0e57-40f8-bab7-5a42ed6c2eb2","Type":"ContainerDied","Data":"dff1db796369c030e55c47088ea64e58ad440c62ad64ac189ce6225f8e75bcde"} Mar 16 16:04:38 crc kubenswrapper[5120]: I0316 16:04:38.601192 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"abd1f184-dd0e-40b2-b88c-f57a584d03dd","Type":"ContainerStarted","Data":"8614afb9fdf275092bdc628016a3de4cbbdc012b5e0335c5d3dd4124d4b44978"} Mar 16 16:04:38 crc kubenswrapper[5120]: I0316 16:04:38.685874 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb" path="/var/lib/kubelet/pods/7baa9a5d-beb6-4812-8ebc-8dd3dedb2afb/volumes" Mar 16 16:04:39 crc kubenswrapper[5120]: I0316 16:04:39.612356 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"abd1f184-dd0e-40b2-b88c-f57a584d03dd","Type":"ContainerStarted","Data":"9da54e15a0f0b636d82eaa71c69a4ffbd57442ea3433d4f28194462f467f618c"} Mar 16 16:04:40 crc kubenswrapper[5120]: I0316 16:04:40.320020 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:04:40 crc kubenswrapper[5120]: I0316 16:04:40.623503 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"abd1f184-dd0e-40b2-b88c-f57a584d03dd","Type":"ContainerStarted","Data":"e9b766f691adc0c4ae0b895bda49a6724f62af301cf9508fcd76997861f6d7c7"} Mar 16 16:04:40 crc kubenswrapper[5120]: I0316 16:04:40.623783 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"abd1f184-dd0e-40b2-b88c-f57a584d03dd","Type":"ContainerStarted","Data":"d5993c994fdd05afbf56297541e2a05d3f7b373dcd3fa1d7da10a2b77bb35b58"} Mar 16 16:04:41 crc kubenswrapper[5120]: I0316 16:04:41.215126 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:04:41 crc kubenswrapper[5120]: I0316 16:04:41.355677 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/dc65f459-0e57-40f8-bab7-5a42ed6c2eb2-logs\") pod \"dc65f459-0e57-40f8-bab7-5a42ed6c2eb2\" (UID: \"dc65f459-0e57-40f8-bab7-5a42ed6c2eb2\") " Mar 16 16:04:41 crc kubenswrapper[5120]: I0316 16:04:41.355736 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dc65f459-0e57-40f8-bab7-5a42ed6c2eb2-config-data\") pod \"dc65f459-0e57-40f8-bab7-5a42ed6c2eb2\" (UID: \"dc65f459-0e57-40f8-bab7-5a42ed6c2eb2\") " Mar 16 16:04:41 crc kubenswrapper[5120]: I0316 16:04:41.356147 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dc65f459-0e57-40f8-bab7-5a42ed6c2eb2-combined-ca-bundle\") pod \"dc65f459-0e57-40f8-bab7-5a42ed6c2eb2\" (UID: \"dc65f459-0e57-40f8-bab7-5a42ed6c2eb2\") " Mar 16 16:04:41 crc kubenswrapper[5120]: I0316 16:04:41.356164 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc65f459-0e57-40f8-bab7-5a42ed6c2eb2-logs" (OuterVolumeSpecName: "logs") pod "dc65f459-0e57-40f8-bab7-5a42ed6c2eb2" (UID: "dc65f459-0e57-40f8-bab7-5a42ed6c2eb2"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:04:41 crc kubenswrapper[5120]: I0316 16:04:41.356196 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r5pb2\" (UniqueName: \"kubernetes.io/projected/dc65f459-0e57-40f8-bab7-5a42ed6c2eb2-kube-api-access-r5pb2\") pod \"dc65f459-0e57-40f8-bab7-5a42ed6c2eb2\" (UID: \"dc65f459-0e57-40f8-bab7-5a42ed6c2eb2\") " Mar 16 16:04:41 crc kubenswrapper[5120]: I0316 16:04:41.356683 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/dc65f459-0e57-40f8-bab7-5a42ed6c2eb2-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:04:41 crc kubenswrapper[5120]: I0316 16:04:41.375503 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc65f459-0e57-40f8-bab7-5a42ed6c2eb2-kube-api-access-r5pb2" (OuterVolumeSpecName: "kube-api-access-r5pb2") pod "dc65f459-0e57-40f8-bab7-5a42ed6c2eb2" (UID: "dc65f459-0e57-40f8-bab7-5a42ed6c2eb2"). InnerVolumeSpecName "kube-api-access-r5pb2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:04:41 crc kubenswrapper[5120]: I0316 16:04:41.384694 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc65f459-0e57-40f8-bab7-5a42ed6c2eb2-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "dc65f459-0e57-40f8-bab7-5a42ed6c2eb2" (UID: "dc65f459-0e57-40f8-bab7-5a42ed6c2eb2"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:04:41 crc kubenswrapper[5120]: I0316 16:04:41.401335 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc65f459-0e57-40f8-bab7-5a42ed6c2eb2-config-data" (OuterVolumeSpecName: "config-data") pod "dc65f459-0e57-40f8-bab7-5a42ed6c2eb2" (UID: "dc65f459-0e57-40f8-bab7-5a42ed6c2eb2"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:04:41 crc kubenswrapper[5120]: I0316 16:04:41.458427 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dc65f459-0e57-40f8-bab7-5a42ed6c2eb2-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:04:41 crc kubenswrapper[5120]: I0316 16:04:41.458473 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r5pb2\" (UniqueName: \"kubernetes.io/projected/dc65f459-0e57-40f8-bab7-5a42ed6c2eb2-kube-api-access-r5pb2\") on node \"crc\" DevicePath \"\"" Mar 16 16:04:41 crc kubenswrapper[5120]: I0316 16:04:41.458485 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dc65f459-0e57-40f8-bab7-5a42ed6c2eb2-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:04:41 crc kubenswrapper[5120]: I0316 16:04:41.636032 5120 generic.go:358] "Generic (PLEG): container finished" podID="dc65f459-0e57-40f8-bab7-5a42ed6c2eb2" containerID="ea7cbc682ac8972634b4f05f4a7f2d51c980b93063e545f4f98982fe14eb19c5" exitCode=0 Mar 16 16:04:41 crc kubenswrapper[5120]: I0316 16:04:41.636113 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:04:41 crc kubenswrapper[5120]: I0316 16:04:41.636122 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"dc65f459-0e57-40f8-bab7-5a42ed6c2eb2","Type":"ContainerDied","Data":"ea7cbc682ac8972634b4f05f4a7f2d51c980b93063e545f4f98982fe14eb19c5"} Mar 16 16:04:41 crc kubenswrapper[5120]: I0316 16:04:41.636165 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"dc65f459-0e57-40f8-bab7-5a42ed6c2eb2","Type":"ContainerDied","Data":"0215689fd2c85d481781c56b7929e4d358aaf590cd7ad935c8167cd62741ad00"} Mar 16 16:04:41 crc kubenswrapper[5120]: I0316 16:04:41.636187 5120 scope.go:117] "RemoveContainer" containerID="ea7cbc682ac8972634b4f05f4a7f2d51c980b93063e545f4f98982fe14eb19c5" Mar 16 16:04:41 crc kubenswrapper[5120]: I0316 16:04:41.666137 5120 scope.go:117] "RemoveContainer" containerID="dff1db796369c030e55c47088ea64e58ad440c62ad64ac189ce6225f8e75bcde" Mar 16 16:04:41 crc kubenswrapper[5120]: I0316 16:04:41.693399 5120 scope.go:117] "RemoveContainer" containerID="ea7cbc682ac8972634b4f05f4a7f2d51c980b93063e545f4f98982fe14eb19c5" Mar 16 16:04:41 crc kubenswrapper[5120]: E0316 16:04:41.693910 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea7cbc682ac8972634b4f05f4a7f2d51c980b93063e545f4f98982fe14eb19c5\": container with ID starting with ea7cbc682ac8972634b4f05f4a7f2d51c980b93063e545f4f98982fe14eb19c5 not found: ID does not exist" containerID="ea7cbc682ac8972634b4f05f4a7f2d51c980b93063e545f4f98982fe14eb19c5" Mar 16 16:04:41 crc kubenswrapper[5120]: I0316 16:04:41.693944 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea7cbc682ac8972634b4f05f4a7f2d51c980b93063e545f4f98982fe14eb19c5"} err="failed to get container status \"ea7cbc682ac8972634b4f05f4a7f2d51c980b93063e545f4f98982fe14eb19c5\": rpc error: code = NotFound desc = could not find container \"ea7cbc682ac8972634b4f05f4a7f2d51c980b93063e545f4f98982fe14eb19c5\": container with ID starting with ea7cbc682ac8972634b4f05f4a7f2d51c980b93063e545f4f98982fe14eb19c5 not found: ID does not exist" Mar 16 16:04:41 crc kubenswrapper[5120]: I0316 16:04:41.693962 5120 scope.go:117] "RemoveContainer" containerID="dff1db796369c030e55c47088ea64e58ad440c62ad64ac189ce6225f8e75bcde" Mar 16 16:04:41 crc kubenswrapper[5120]: E0316 16:04:41.694274 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dff1db796369c030e55c47088ea64e58ad440c62ad64ac189ce6225f8e75bcde\": container with ID starting with dff1db796369c030e55c47088ea64e58ad440c62ad64ac189ce6225f8e75bcde not found: ID does not exist" containerID="dff1db796369c030e55c47088ea64e58ad440c62ad64ac189ce6225f8e75bcde" Mar 16 16:04:41 crc kubenswrapper[5120]: I0316 16:04:41.694292 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dff1db796369c030e55c47088ea64e58ad440c62ad64ac189ce6225f8e75bcde"} err="failed to get container status \"dff1db796369c030e55c47088ea64e58ad440c62ad64ac189ce6225f8e75bcde\": rpc error: code = NotFound desc = could not find container \"dff1db796369c030e55c47088ea64e58ad440c62ad64ac189ce6225f8e75bcde\": container with ID starting with dff1db796369c030e55c47088ea64e58ad440c62ad64ac189ce6225f8e75bcde not found: ID does not exist" Mar 16 16:04:41 crc kubenswrapper[5120]: I0316 16:04:41.703751 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:04:41 crc kubenswrapper[5120]: I0316 16:04:41.721487 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:04:41 crc kubenswrapper[5120]: I0316 16:04:41.748153 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:04:41 crc kubenswrapper[5120]: I0316 16:04:41.750323 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc65f459-0e57-40f8-bab7-5a42ed6c2eb2" containerName="nova-api-api" Mar 16 16:04:41 crc kubenswrapper[5120]: I0316 16:04:41.750340 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc65f459-0e57-40f8-bab7-5a42ed6c2eb2" containerName="nova-api-api" Mar 16 16:04:41 crc kubenswrapper[5120]: I0316 16:04:41.750359 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc65f459-0e57-40f8-bab7-5a42ed6c2eb2" containerName="nova-api-log" Mar 16 16:04:41 crc kubenswrapper[5120]: I0316 16:04:41.750364 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc65f459-0e57-40f8-bab7-5a42ed6c2eb2" containerName="nova-api-log" Mar 16 16:04:41 crc kubenswrapper[5120]: I0316 16:04:41.750530 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="dc65f459-0e57-40f8-bab7-5a42ed6c2eb2" containerName="nova-api-api" Mar 16 16:04:41 crc kubenswrapper[5120]: I0316 16:04:41.750551 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="dc65f459-0e57-40f8-bab7-5a42ed6c2eb2" containerName="nova-api-log" Mar 16 16:04:41 crc kubenswrapper[5120]: I0316 16:04:41.761190 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:04:41 crc kubenswrapper[5120]: I0316 16:04:41.761318 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:04:41 crc kubenswrapper[5120]: I0316 16:04:41.763978 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-config-data\"" Mar 16 16:04:41 crc kubenswrapper[5120]: I0316 16:04:41.764348 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-internal-svc\"" Mar 16 16:04:41 crc kubenswrapper[5120]: I0316 16:04:41.765153 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-public-svc\"" Mar 16 16:04:41 crc kubenswrapper[5120]: I0316 16:04:41.866126 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/dbb06351-e6e7-4a49-a941-33b16fc6206d-internal-tls-certs\") pod \"nova-api-0\" (UID: \"dbb06351-e6e7-4a49-a941-33b16fc6206d\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:04:41 crc kubenswrapper[5120]: I0316 16:04:41.866188 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hh7rw\" (UniqueName: \"kubernetes.io/projected/dbb06351-e6e7-4a49-a941-33b16fc6206d-kube-api-access-hh7rw\") pod \"nova-api-0\" (UID: \"dbb06351-e6e7-4a49-a941-33b16fc6206d\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:04:41 crc kubenswrapper[5120]: I0316 16:04:41.866243 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dbb06351-e6e7-4a49-a941-33b16fc6206d-config-data\") pod \"nova-api-0\" (UID: \"dbb06351-e6e7-4a49-a941-33b16fc6206d\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:04:41 crc kubenswrapper[5120]: I0316 16:04:41.866354 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/dbb06351-e6e7-4a49-a941-33b16fc6206d-public-tls-certs\") pod \"nova-api-0\" (UID: \"dbb06351-e6e7-4a49-a941-33b16fc6206d\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:04:41 crc kubenswrapper[5120]: I0316 16:04:41.866634 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/dbb06351-e6e7-4a49-a941-33b16fc6206d-logs\") pod \"nova-api-0\" (UID: \"dbb06351-e6e7-4a49-a941-33b16fc6206d\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:04:41 crc kubenswrapper[5120]: I0316 16:04:41.866700 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dbb06351-e6e7-4a49-a941-33b16fc6206d-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"dbb06351-e6e7-4a49-a941-33b16fc6206d\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:04:41 crc kubenswrapper[5120]: I0316 16:04:41.968502 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/dbb06351-e6e7-4a49-a941-33b16fc6206d-internal-tls-certs\") pod \"nova-api-0\" (UID: \"dbb06351-e6e7-4a49-a941-33b16fc6206d\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:04:41 crc kubenswrapper[5120]: I0316 16:04:41.968557 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hh7rw\" (UniqueName: \"kubernetes.io/projected/dbb06351-e6e7-4a49-a941-33b16fc6206d-kube-api-access-hh7rw\") pod \"nova-api-0\" (UID: \"dbb06351-e6e7-4a49-a941-33b16fc6206d\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:04:41 crc kubenswrapper[5120]: I0316 16:04:41.968613 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dbb06351-e6e7-4a49-a941-33b16fc6206d-config-data\") pod \"nova-api-0\" (UID: \"dbb06351-e6e7-4a49-a941-33b16fc6206d\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:04:41 crc kubenswrapper[5120]: I0316 16:04:41.968636 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/dbb06351-e6e7-4a49-a941-33b16fc6206d-public-tls-certs\") pod \"nova-api-0\" (UID: \"dbb06351-e6e7-4a49-a941-33b16fc6206d\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:04:41 crc kubenswrapper[5120]: I0316 16:04:41.968699 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/dbb06351-e6e7-4a49-a941-33b16fc6206d-logs\") pod \"nova-api-0\" (UID: \"dbb06351-e6e7-4a49-a941-33b16fc6206d\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:04:41 crc kubenswrapper[5120]: I0316 16:04:41.968718 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dbb06351-e6e7-4a49-a941-33b16fc6206d-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"dbb06351-e6e7-4a49-a941-33b16fc6206d\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:04:41 crc kubenswrapper[5120]: I0316 16:04:41.970222 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/dbb06351-e6e7-4a49-a941-33b16fc6206d-logs\") pod \"nova-api-0\" (UID: \"dbb06351-e6e7-4a49-a941-33b16fc6206d\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:04:41 crc kubenswrapper[5120]: I0316 16:04:41.974148 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dbb06351-e6e7-4a49-a941-33b16fc6206d-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"dbb06351-e6e7-4a49-a941-33b16fc6206d\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:04:41 crc kubenswrapper[5120]: I0316 16:04:41.974441 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/dbb06351-e6e7-4a49-a941-33b16fc6206d-public-tls-certs\") pod \"nova-api-0\" (UID: \"dbb06351-e6e7-4a49-a941-33b16fc6206d\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:04:41 crc kubenswrapper[5120]: I0316 16:04:41.975883 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/dbb06351-e6e7-4a49-a941-33b16fc6206d-internal-tls-certs\") pod \"nova-api-0\" (UID: \"dbb06351-e6e7-4a49-a941-33b16fc6206d\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:04:41 crc kubenswrapper[5120]: I0316 16:04:41.981773 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dbb06351-e6e7-4a49-a941-33b16fc6206d-config-data\") pod \"nova-api-0\" (UID: \"dbb06351-e6e7-4a49-a941-33b16fc6206d\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:04:41 crc kubenswrapper[5120]: I0316 16:04:41.984983 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hh7rw\" (UniqueName: \"kubernetes.io/projected/dbb06351-e6e7-4a49-a941-33b16fc6206d-kube-api-access-hh7rw\") pod \"nova-api-0\" (UID: \"dbb06351-e6e7-4a49-a941-33b16fc6206d\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:04:42 crc kubenswrapper[5120]: I0316 16:04:42.089095 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:04:42 crc kubenswrapper[5120]: I0316 16:04:42.548773 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:04:42 crc kubenswrapper[5120]: W0316 16:04:42.558181 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddbb06351_e6e7_4a49_a941_33b16fc6206d.slice/crio-97baf905b3960aa9d2ea773e43fafcef68a8f5f41dc685f0a1d957063efde5a9 WatchSource:0}: Error finding container 97baf905b3960aa9d2ea773e43fafcef68a8f5f41dc685f0a1d957063efde5a9: Status 404 returned error can't find the container with id 97baf905b3960aa9d2ea773e43fafcef68a8f5f41dc685f0a1d957063efde5a9 Mar 16 16:04:42 crc kubenswrapper[5120]: I0316 16:04:42.650961 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"dbb06351-e6e7-4a49-a941-33b16fc6206d","Type":"ContainerStarted","Data":"97baf905b3960aa9d2ea773e43fafcef68a8f5f41dc685f0a1d957063efde5a9"} Mar 16 16:04:42 crc kubenswrapper[5120]: I0316 16:04:42.678401 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc65f459-0e57-40f8-bab7-5a42ed6c2eb2" path="/var/lib/kubelet/pods/dc65f459-0e57-40f8-bab7-5a42ed6c2eb2/volumes" Mar 16 16:04:43 crc kubenswrapper[5120]: I0316 16:04:43.667289 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"dbb06351-e6e7-4a49-a941-33b16fc6206d","Type":"ContainerStarted","Data":"d6fc349f836b03a8939dfbaec2c3ff1e2196bfd6ed181b5867b764b47417dff0"} Mar 16 16:04:43 crc kubenswrapper[5120]: I0316 16:04:43.667934 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"dbb06351-e6e7-4a49-a941-33b16fc6206d","Type":"ContainerStarted","Data":"f84dba618b96e6c2b2f2dee7b7aa69256626268516a21c1ba646c04d0f6801f1"} Mar 16 16:04:43 crc kubenswrapper[5120]: I0316 16:04:43.670065 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"abd1f184-dd0e-40b2-b88c-f57a584d03dd","Type":"ContainerStarted","Data":"aa61ef49ff053af29979c425a473fc8bd03de9f9383a16a54110b7a7224dc094"} Mar 16 16:04:43 crc kubenswrapper[5120]: I0316 16:04:43.670195 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:04:43 crc kubenswrapper[5120]: I0316 16:04:43.670210 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="abd1f184-dd0e-40b2-b88c-f57a584d03dd" containerName="ceilometer-central-agent" containerID="cri-o://9da54e15a0f0b636d82eaa71c69a4ffbd57442ea3433d4f28194462f467f618c" gracePeriod=30 Mar 16 16:04:43 crc kubenswrapper[5120]: I0316 16:04:43.670234 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="abd1f184-dd0e-40b2-b88c-f57a584d03dd" containerName="proxy-httpd" containerID="cri-o://aa61ef49ff053af29979c425a473fc8bd03de9f9383a16a54110b7a7224dc094" gracePeriod=30 Mar 16 16:04:43 crc kubenswrapper[5120]: I0316 16:04:43.670272 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="abd1f184-dd0e-40b2-b88c-f57a584d03dd" containerName="ceilometer-notification-agent" containerID="cri-o://d5993c994fdd05afbf56297541e2a05d3f7b373dcd3fa1d7da10a2b77bb35b58" gracePeriod=30 Mar 16 16:04:43 crc kubenswrapper[5120]: I0316 16:04:43.670227 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="abd1f184-dd0e-40b2-b88c-f57a584d03dd" containerName="sg-core" containerID="cri-o://e9b766f691adc0c4ae0b895bda49a6724f62af301cf9508fcd76997861f6d7c7" gracePeriod=30 Mar 16 16:04:43 crc kubenswrapper[5120]: I0316 16:04:43.694514 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=2.694497765 podStartE2EDuration="2.694497765s" podCreationTimestamp="2026-03-16 16:04:41 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:04:43.68849613 +0000 UTC m=+1985.842427827" watchObservedRunningTime="2026-03-16 16:04:43.694497765 +0000 UTC m=+1985.848429422" Mar 16 16:04:43 crc kubenswrapper[5120]: I0316 16:04:43.744072 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.781029887 podStartE2EDuration="6.744045028s" podCreationTimestamp="2026-03-16 16:04:37 +0000 UTC" firstStartedPulling="2026-03-16 16:04:38.49418966 +0000 UTC m=+1980.648121307" lastFinishedPulling="2026-03-16 16:04:42.457204791 +0000 UTC m=+1984.611136448" observedRunningTime="2026-03-16 16:04:43.732710227 +0000 UTC m=+1985.886641894" watchObservedRunningTime="2026-03-16 16:04:43.744045028 +0000 UTC m=+1985.897976715" Mar 16 16:04:44 crc kubenswrapper[5120]: I0316 16:04:44.689951 5120 generic.go:358] "Generic (PLEG): container finished" podID="abd1f184-dd0e-40b2-b88c-f57a584d03dd" containerID="aa61ef49ff053af29979c425a473fc8bd03de9f9383a16a54110b7a7224dc094" exitCode=0 Mar 16 16:04:44 crc kubenswrapper[5120]: I0316 16:04:44.690261 5120 generic.go:358] "Generic (PLEG): container finished" podID="abd1f184-dd0e-40b2-b88c-f57a584d03dd" containerID="e9b766f691adc0c4ae0b895bda49a6724f62af301cf9508fcd76997861f6d7c7" exitCode=2 Mar 16 16:04:44 crc kubenswrapper[5120]: I0316 16:04:44.690274 5120 generic.go:358] "Generic (PLEG): container finished" podID="abd1f184-dd0e-40b2-b88c-f57a584d03dd" containerID="d5993c994fdd05afbf56297541e2a05d3f7b373dcd3fa1d7da10a2b77bb35b58" exitCode=0 Mar 16 16:04:44 crc kubenswrapper[5120]: I0316 16:04:44.690286 5120 generic.go:358] "Generic (PLEG): container finished" podID="abd1f184-dd0e-40b2-b88c-f57a584d03dd" containerID="9da54e15a0f0b636d82eaa71c69a4ffbd57442ea3433d4f28194462f467f618c" exitCode=0 Mar 16 16:04:44 crc kubenswrapper[5120]: I0316 16:04:44.690016 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"abd1f184-dd0e-40b2-b88c-f57a584d03dd","Type":"ContainerDied","Data":"aa61ef49ff053af29979c425a473fc8bd03de9f9383a16a54110b7a7224dc094"} Mar 16 16:04:44 crc kubenswrapper[5120]: I0316 16:04:44.690377 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"abd1f184-dd0e-40b2-b88c-f57a584d03dd","Type":"ContainerDied","Data":"e9b766f691adc0c4ae0b895bda49a6724f62af301cf9508fcd76997861f6d7c7"} Mar 16 16:04:44 crc kubenswrapper[5120]: I0316 16:04:44.690399 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"abd1f184-dd0e-40b2-b88c-f57a584d03dd","Type":"ContainerDied","Data":"d5993c994fdd05afbf56297541e2a05d3f7b373dcd3fa1d7da10a2b77bb35b58"} Mar 16 16:04:44 crc kubenswrapper[5120]: I0316 16:04:44.690414 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"abd1f184-dd0e-40b2-b88c-f57a584d03dd","Type":"ContainerDied","Data":"9da54e15a0f0b636d82eaa71c69a4ffbd57442ea3433d4f28194462f467f618c"} Mar 16 16:04:44 crc kubenswrapper[5120]: I0316 16:04:44.777465 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:04:44 crc kubenswrapper[5120]: I0316 16:04:44.847003 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/abd1f184-dd0e-40b2-b88c-f57a584d03dd-sg-core-conf-yaml\") pod \"abd1f184-dd0e-40b2-b88c-f57a584d03dd\" (UID: \"abd1f184-dd0e-40b2-b88c-f57a584d03dd\") " Mar 16 16:04:44 crc kubenswrapper[5120]: I0316 16:04:44.847076 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/abd1f184-dd0e-40b2-b88c-f57a584d03dd-scripts\") pod \"abd1f184-dd0e-40b2-b88c-f57a584d03dd\" (UID: \"abd1f184-dd0e-40b2-b88c-f57a584d03dd\") " Mar 16 16:04:44 crc kubenswrapper[5120]: I0316 16:04:44.865195 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/abd1f184-dd0e-40b2-b88c-f57a584d03dd-scripts" (OuterVolumeSpecName: "scripts") pod "abd1f184-dd0e-40b2-b88c-f57a584d03dd" (UID: "abd1f184-dd0e-40b2-b88c-f57a584d03dd"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:04:44 crc kubenswrapper[5120]: I0316 16:04:44.883970 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/abd1f184-dd0e-40b2-b88c-f57a584d03dd-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "abd1f184-dd0e-40b2-b88c-f57a584d03dd" (UID: "abd1f184-dd0e-40b2-b88c-f57a584d03dd"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:04:44 crc kubenswrapper[5120]: I0316 16:04:44.948494 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/abd1f184-dd0e-40b2-b88c-f57a584d03dd-ceilometer-tls-certs\") pod \"abd1f184-dd0e-40b2-b88c-f57a584d03dd\" (UID: \"abd1f184-dd0e-40b2-b88c-f57a584d03dd\") " Mar 16 16:04:44 crc kubenswrapper[5120]: I0316 16:04:44.948642 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mmpzl\" (UniqueName: \"kubernetes.io/projected/abd1f184-dd0e-40b2-b88c-f57a584d03dd-kube-api-access-mmpzl\") pod \"abd1f184-dd0e-40b2-b88c-f57a584d03dd\" (UID: \"abd1f184-dd0e-40b2-b88c-f57a584d03dd\") " Mar 16 16:04:44 crc kubenswrapper[5120]: I0316 16:04:44.948681 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/abd1f184-dd0e-40b2-b88c-f57a584d03dd-log-httpd\") pod \"abd1f184-dd0e-40b2-b88c-f57a584d03dd\" (UID: \"abd1f184-dd0e-40b2-b88c-f57a584d03dd\") " Mar 16 16:04:44 crc kubenswrapper[5120]: I0316 16:04:44.948731 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/abd1f184-dd0e-40b2-b88c-f57a584d03dd-config-data\") pod \"abd1f184-dd0e-40b2-b88c-f57a584d03dd\" (UID: \"abd1f184-dd0e-40b2-b88c-f57a584d03dd\") " Mar 16 16:04:44 crc kubenswrapper[5120]: I0316 16:04:44.948752 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/abd1f184-dd0e-40b2-b88c-f57a584d03dd-combined-ca-bundle\") pod \"abd1f184-dd0e-40b2-b88c-f57a584d03dd\" (UID: \"abd1f184-dd0e-40b2-b88c-f57a584d03dd\") " Mar 16 16:04:44 crc kubenswrapper[5120]: I0316 16:04:44.948797 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/abd1f184-dd0e-40b2-b88c-f57a584d03dd-run-httpd\") pod \"abd1f184-dd0e-40b2-b88c-f57a584d03dd\" (UID: \"abd1f184-dd0e-40b2-b88c-f57a584d03dd\") " Mar 16 16:04:44 crc kubenswrapper[5120]: I0316 16:04:44.949125 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/abd1f184-dd0e-40b2-b88c-f57a584d03dd-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 16:04:44 crc kubenswrapper[5120]: I0316 16:04:44.949145 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/abd1f184-dd0e-40b2-b88c-f57a584d03dd-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:04:44 crc kubenswrapper[5120]: I0316 16:04:44.949249 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/abd1f184-dd0e-40b2-b88c-f57a584d03dd-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "abd1f184-dd0e-40b2-b88c-f57a584d03dd" (UID: "abd1f184-dd0e-40b2-b88c-f57a584d03dd"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:04:44 crc kubenswrapper[5120]: I0316 16:04:44.949782 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/abd1f184-dd0e-40b2-b88c-f57a584d03dd-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "abd1f184-dd0e-40b2-b88c-f57a584d03dd" (UID: "abd1f184-dd0e-40b2-b88c-f57a584d03dd"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:04:44 crc kubenswrapper[5120]: I0316 16:04:44.951713 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/abd1f184-dd0e-40b2-b88c-f57a584d03dd-kube-api-access-mmpzl" (OuterVolumeSpecName: "kube-api-access-mmpzl") pod "abd1f184-dd0e-40b2-b88c-f57a584d03dd" (UID: "abd1f184-dd0e-40b2-b88c-f57a584d03dd"). InnerVolumeSpecName "kube-api-access-mmpzl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:04:45 crc kubenswrapper[5120]: I0316 16:04:45.003432 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/abd1f184-dd0e-40b2-b88c-f57a584d03dd-ceilometer-tls-certs" (OuterVolumeSpecName: "ceilometer-tls-certs") pod "abd1f184-dd0e-40b2-b88c-f57a584d03dd" (UID: "abd1f184-dd0e-40b2-b88c-f57a584d03dd"). InnerVolumeSpecName "ceilometer-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:04:45 crc kubenswrapper[5120]: I0316 16:04:45.041161 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/abd1f184-dd0e-40b2-b88c-f57a584d03dd-config-data" (OuterVolumeSpecName: "config-data") pod "abd1f184-dd0e-40b2-b88c-f57a584d03dd" (UID: "abd1f184-dd0e-40b2-b88c-f57a584d03dd"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:04:45 crc kubenswrapper[5120]: I0316 16:04:45.050514 5120 reconciler_common.go:299] "Volume detached for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/abd1f184-dd0e-40b2-b88c-f57a584d03dd-ceilometer-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:04:45 crc kubenswrapper[5120]: I0316 16:04:45.050556 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mmpzl\" (UniqueName: \"kubernetes.io/projected/abd1f184-dd0e-40b2-b88c-f57a584d03dd-kube-api-access-mmpzl\") on node \"crc\" DevicePath \"\"" Mar 16 16:04:45 crc kubenswrapper[5120]: I0316 16:04:45.050571 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/abd1f184-dd0e-40b2-b88c-f57a584d03dd-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:04:45 crc kubenswrapper[5120]: I0316 16:04:45.050585 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/abd1f184-dd0e-40b2-b88c-f57a584d03dd-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:04:45 crc kubenswrapper[5120]: I0316 16:04:45.050598 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/abd1f184-dd0e-40b2-b88c-f57a584d03dd-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:04:45 crc kubenswrapper[5120]: I0316 16:04:45.064475 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/abd1f184-dd0e-40b2-b88c-f57a584d03dd-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "abd1f184-dd0e-40b2-b88c-f57a584d03dd" (UID: "abd1f184-dd0e-40b2-b88c-f57a584d03dd"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:04:45 crc kubenswrapper[5120]: I0316 16:04:45.152378 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/abd1f184-dd0e-40b2-b88c-f57a584d03dd-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:04:45 crc kubenswrapper[5120]: I0316 16:04:45.705649 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:04:45 crc kubenswrapper[5120]: I0316 16:04:45.705667 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"abd1f184-dd0e-40b2-b88c-f57a584d03dd","Type":"ContainerDied","Data":"8614afb9fdf275092bdc628016a3de4cbbdc012b5e0335c5d3dd4124d4b44978"} Mar 16 16:04:45 crc kubenswrapper[5120]: I0316 16:04:45.706171 5120 scope.go:117] "RemoveContainer" containerID="aa61ef49ff053af29979c425a473fc8bd03de9f9383a16a54110b7a7224dc094" Mar 16 16:04:45 crc kubenswrapper[5120]: I0316 16:04:45.744474 5120 scope.go:117] "RemoveContainer" containerID="e9b766f691adc0c4ae0b895bda49a6724f62af301cf9508fcd76997861f6d7c7" Mar 16 16:04:45 crc kubenswrapper[5120]: I0316 16:04:45.746625 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:04:45 crc kubenswrapper[5120]: I0316 16:04:45.754417 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:04:45 crc kubenswrapper[5120]: I0316 16:04:45.779625 5120 scope.go:117] "RemoveContainer" containerID="d5993c994fdd05afbf56297541e2a05d3f7b373dcd3fa1d7da10a2b77bb35b58" Mar 16 16:04:45 crc kubenswrapper[5120]: I0316 16:04:45.794265 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:04:45 crc kubenswrapper[5120]: I0316 16:04:45.796117 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="abd1f184-dd0e-40b2-b88c-f57a584d03dd" containerName="sg-core" Mar 16 16:04:45 crc kubenswrapper[5120]: I0316 16:04:45.796149 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="abd1f184-dd0e-40b2-b88c-f57a584d03dd" containerName="sg-core" Mar 16 16:04:45 crc kubenswrapper[5120]: I0316 16:04:45.796215 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="abd1f184-dd0e-40b2-b88c-f57a584d03dd" containerName="ceilometer-central-agent" Mar 16 16:04:45 crc kubenswrapper[5120]: I0316 16:04:45.796229 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="abd1f184-dd0e-40b2-b88c-f57a584d03dd" containerName="ceilometer-central-agent" Mar 16 16:04:45 crc kubenswrapper[5120]: I0316 16:04:45.796247 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="abd1f184-dd0e-40b2-b88c-f57a584d03dd" containerName="ceilometer-notification-agent" Mar 16 16:04:45 crc kubenswrapper[5120]: I0316 16:04:45.796259 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="abd1f184-dd0e-40b2-b88c-f57a584d03dd" containerName="ceilometer-notification-agent" Mar 16 16:04:45 crc kubenswrapper[5120]: I0316 16:04:45.796297 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="abd1f184-dd0e-40b2-b88c-f57a584d03dd" containerName="proxy-httpd" Mar 16 16:04:45 crc kubenswrapper[5120]: I0316 16:04:45.796312 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="abd1f184-dd0e-40b2-b88c-f57a584d03dd" containerName="proxy-httpd" Mar 16 16:04:45 crc kubenswrapper[5120]: I0316 16:04:45.796613 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="abd1f184-dd0e-40b2-b88c-f57a584d03dd" containerName="ceilometer-central-agent" Mar 16 16:04:45 crc kubenswrapper[5120]: I0316 16:04:45.796666 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="abd1f184-dd0e-40b2-b88c-f57a584d03dd" containerName="proxy-httpd" Mar 16 16:04:45 crc kubenswrapper[5120]: I0316 16:04:45.796686 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="abd1f184-dd0e-40b2-b88c-f57a584d03dd" containerName="ceilometer-notification-agent" Mar 16 16:04:45 crc kubenswrapper[5120]: I0316 16:04:45.796707 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="abd1f184-dd0e-40b2-b88c-f57a584d03dd" containerName="sg-core" Mar 16 16:04:45 crc kubenswrapper[5120]: I0316 16:04:45.818411 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:04:45 crc kubenswrapper[5120]: I0316 16:04:45.820650 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:04:45 crc kubenswrapper[5120]: I0316 16:04:45.823057 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 16:04:45 crc kubenswrapper[5120]: I0316 16:04:45.825427 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ceilometer-internal-svc\"" Mar 16 16:04:45 crc kubenswrapper[5120]: I0316 16:04:45.825649 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 16:04:45 crc kubenswrapper[5120]: I0316 16:04:45.835439 5120 scope.go:117] "RemoveContainer" containerID="9da54e15a0f0b636d82eaa71c69a4ffbd57442ea3433d4f28194462f467f618c" Mar 16 16:04:45 crc kubenswrapper[5120]: I0316 16:04:45.870259 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6244v\" (UniqueName: \"kubernetes.io/projected/1772eb98-e47b-45ce-a67e-e50b9e67caf0-kube-api-access-6244v\") pod \"ceilometer-0\" (UID: \"1772eb98-e47b-45ce-a67e-e50b9e67caf0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:04:45 crc kubenswrapper[5120]: I0316 16:04:45.870520 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/1772eb98-e47b-45ce-a67e-e50b9e67caf0-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"1772eb98-e47b-45ce-a67e-e50b9e67caf0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:04:45 crc kubenswrapper[5120]: I0316 16:04:45.870595 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1772eb98-e47b-45ce-a67e-e50b9e67caf0-scripts\") pod \"ceilometer-0\" (UID: \"1772eb98-e47b-45ce-a67e-e50b9e67caf0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:04:45 crc kubenswrapper[5120]: I0316 16:04:45.870645 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1772eb98-e47b-45ce-a67e-e50b9e67caf0-log-httpd\") pod \"ceilometer-0\" (UID: \"1772eb98-e47b-45ce-a67e-e50b9e67caf0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:04:45 crc kubenswrapper[5120]: I0316 16:04:45.870751 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1772eb98-e47b-45ce-a67e-e50b9e67caf0-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"1772eb98-e47b-45ce-a67e-e50b9e67caf0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:04:45 crc kubenswrapper[5120]: I0316 16:04:45.870825 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1772eb98-e47b-45ce-a67e-e50b9e67caf0-run-httpd\") pod \"ceilometer-0\" (UID: \"1772eb98-e47b-45ce-a67e-e50b9e67caf0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:04:45 crc kubenswrapper[5120]: I0316 16:04:45.870972 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1772eb98-e47b-45ce-a67e-e50b9e67caf0-config-data\") pod \"ceilometer-0\" (UID: \"1772eb98-e47b-45ce-a67e-e50b9e67caf0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:04:45 crc kubenswrapper[5120]: I0316 16:04:45.871058 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/1772eb98-e47b-45ce-a67e-e50b9e67caf0-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"1772eb98-e47b-45ce-a67e-e50b9e67caf0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:04:45 crc kubenswrapper[5120]: I0316 16:04:45.973321 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/1772eb98-e47b-45ce-a67e-e50b9e67caf0-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"1772eb98-e47b-45ce-a67e-e50b9e67caf0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:04:45 crc kubenswrapper[5120]: I0316 16:04:45.973509 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1772eb98-e47b-45ce-a67e-e50b9e67caf0-scripts\") pod \"ceilometer-0\" (UID: \"1772eb98-e47b-45ce-a67e-e50b9e67caf0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:04:45 crc kubenswrapper[5120]: I0316 16:04:45.973564 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1772eb98-e47b-45ce-a67e-e50b9e67caf0-log-httpd\") pod \"ceilometer-0\" (UID: \"1772eb98-e47b-45ce-a67e-e50b9e67caf0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:04:45 crc kubenswrapper[5120]: I0316 16:04:45.973712 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1772eb98-e47b-45ce-a67e-e50b9e67caf0-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"1772eb98-e47b-45ce-a67e-e50b9e67caf0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:04:45 crc kubenswrapper[5120]: I0316 16:04:45.974740 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1772eb98-e47b-45ce-a67e-e50b9e67caf0-run-httpd\") pod \"ceilometer-0\" (UID: \"1772eb98-e47b-45ce-a67e-e50b9e67caf0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:04:45 crc kubenswrapper[5120]: I0316 16:04:45.974815 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1772eb98-e47b-45ce-a67e-e50b9e67caf0-log-httpd\") pod \"ceilometer-0\" (UID: \"1772eb98-e47b-45ce-a67e-e50b9e67caf0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:04:45 crc kubenswrapper[5120]: I0316 16:04:45.975032 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1772eb98-e47b-45ce-a67e-e50b9e67caf0-config-data\") pod \"ceilometer-0\" (UID: \"1772eb98-e47b-45ce-a67e-e50b9e67caf0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:04:45 crc kubenswrapper[5120]: I0316 16:04:45.975193 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/1772eb98-e47b-45ce-a67e-e50b9e67caf0-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"1772eb98-e47b-45ce-a67e-e50b9e67caf0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:04:45 crc kubenswrapper[5120]: I0316 16:04:45.975460 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6244v\" (UniqueName: \"kubernetes.io/projected/1772eb98-e47b-45ce-a67e-e50b9e67caf0-kube-api-access-6244v\") pod \"ceilometer-0\" (UID: \"1772eb98-e47b-45ce-a67e-e50b9e67caf0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:04:45 crc kubenswrapper[5120]: I0316 16:04:45.975538 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1772eb98-e47b-45ce-a67e-e50b9e67caf0-run-httpd\") pod \"ceilometer-0\" (UID: \"1772eb98-e47b-45ce-a67e-e50b9e67caf0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:04:45 crc kubenswrapper[5120]: I0316 16:04:45.978932 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1772eb98-e47b-45ce-a67e-e50b9e67caf0-scripts\") pod \"ceilometer-0\" (UID: \"1772eb98-e47b-45ce-a67e-e50b9e67caf0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:04:45 crc kubenswrapper[5120]: I0316 16:04:45.980793 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/1772eb98-e47b-45ce-a67e-e50b9e67caf0-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"1772eb98-e47b-45ce-a67e-e50b9e67caf0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:04:45 crc kubenswrapper[5120]: I0316 16:04:45.990315 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/1772eb98-e47b-45ce-a67e-e50b9e67caf0-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"1772eb98-e47b-45ce-a67e-e50b9e67caf0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:04:45 crc kubenswrapper[5120]: I0316 16:04:45.990486 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1772eb98-e47b-45ce-a67e-e50b9e67caf0-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"1772eb98-e47b-45ce-a67e-e50b9e67caf0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:04:45 crc kubenswrapper[5120]: I0316 16:04:45.991737 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1772eb98-e47b-45ce-a67e-e50b9e67caf0-config-data\") pod \"ceilometer-0\" (UID: \"1772eb98-e47b-45ce-a67e-e50b9e67caf0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:04:46 crc kubenswrapper[5120]: I0316 16:04:46.007022 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6244v\" (UniqueName: \"kubernetes.io/projected/1772eb98-e47b-45ce-a67e-e50b9e67caf0-kube-api-access-6244v\") pod \"ceilometer-0\" (UID: \"1772eb98-e47b-45ce-a67e-e50b9e67caf0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:04:46 crc kubenswrapper[5120]: I0316 16:04:46.134534 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:04:46 crc kubenswrapper[5120]: W0316 16:04:46.616620 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1772eb98_e47b_45ce_a67e_e50b9e67caf0.slice/crio-1aae1d148686d880efd7bb0532c9e0e3c73e6d872634927c0586c412e4d8543f WatchSource:0}: Error finding container 1aae1d148686d880efd7bb0532c9e0e3c73e6d872634927c0586c412e4d8543f: Status 404 returned error can't find the container with id 1aae1d148686d880efd7bb0532c9e0e3c73e6d872634927c0586c412e4d8543f Mar 16 16:04:46 crc kubenswrapper[5120]: I0316 16:04:46.625719 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:04:46 crc kubenswrapper[5120]: I0316 16:04:46.681043 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="abd1f184-dd0e-40b2-b88c-f57a584d03dd" path="/var/lib/kubelet/pods/abd1f184-dd0e-40b2-b88c-f57a584d03dd/volumes" Mar 16 16:04:46 crc kubenswrapper[5120]: I0316 16:04:46.719878 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1772eb98-e47b-45ce-a67e-e50b9e67caf0","Type":"ContainerStarted","Data":"1aae1d148686d880efd7bb0532c9e0e3c73e6d872634927c0586c412e4d8543f"} Mar 16 16:04:47 crc kubenswrapper[5120]: I0316 16:04:47.732743 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1772eb98-e47b-45ce-a67e-e50b9e67caf0","Type":"ContainerStarted","Data":"9207a0eba561450da1739e87b41360794387e17d5e87dde63f73d34b21c027f6"} Mar 16 16:04:48 crc kubenswrapper[5120]: I0316 16:04:48.755474 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1772eb98-e47b-45ce-a67e-e50b9e67caf0","Type":"ContainerStarted","Data":"5c7b2d7e27758e01aa1845776072027a01093fa74fc93da4150e46428ab4c949"} Mar 16 16:04:49 crc kubenswrapper[5120]: I0316 16:04:49.767618 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1772eb98-e47b-45ce-a67e-e50b9e67caf0","Type":"ContainerStarted","Data":"5949242ae362aadaf6773132502eb99e4ef7078f73eabada4736d3c78179ddc4"} Mar 16 16:04:51 crc kubenswrapper[5120]: I0316 16:04:51.794153 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1772eb98-e47b-45ce-a67e-e50b9e67caf0","Type":"ContainerStarted","Data":"065050cf4721835b3ae26ffee5ff1ce77b764f4545f4eccd695d98ca6ee38df4"} Mar 16 16:04:51 crc kubenswrapper[5120]: I0316 16:04:51.794712 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:04:51 crc kubenswrapper[5120]: I0316 16:04:51.824997 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.277982451 podStartE2EDuration="6.824972706s" podCreationTimestamp="2026-03-16 16:04:45 +0000 UTC" firstStartedPulling="2026-03-16 16:04:46.618524391 +0000 UTC m=+1988.772456068" lastFinishedPulling="2026-03-16 16:04:51.165514666 +0000 UTC m=+1993.319446323" observedRunningTime="2026-03-16 16:04:51.811888245 +0000 UTC m=+1993.965819912" watchObservedRunningTime="2026-03-16 16:04:51.824972706 +0000 UTC m=+1993.978904363" Mar 16 16:04:52 crc kubenswrapper[5120]: I0316 16:04:52.008316 5120 patch_prober.go:28] interesting pod/machine-config-daemon-7bf76 container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 16:04:52 crc kubenswrapper[5120]: I0316 16:04:52.008373 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 16:04:52 crc kubenswrapper[5120]: I0316 16:04:52.090243 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:04:52 crc kubenswrapper[5120]: I0316 16:04:52.090294 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:04:53 crc kubenswrapper[5120]: I0316 16:04:53.101006 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="dbb06351-e6e7-4a49-a941-33b16fc6206d" containerName="nova-api-log" probeResult="failure" output="Get \"https://10.217.1.176:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 16:04:53 crc kubenswrapper[5120]: I0316 16:04:53.102415 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="dbb06351-e6e7-4a49-a941-33b16fc6206d" containerName="nova-api-api" probeResult="failure" output="Get \"https://10.217.1.176:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 16:04:53 crc kubenswrapper[5120]: I0316 16:04:53.833810 5120 scope.go:117] "RemoveContainer" containerID="e6ef1e16a9f1dbd30b2839b569e850a5aff07988979f9ef0517727f364aa14e1" Mar 16 16:04:53 crc kubenswrapper[5120]: I0316 16:04:53.875547 5120 scope.go:117] "RemoveContainer" containerID="df947da801d1347a8eae335f954dc1eb15ebecdc1742d0f7f720c721e4e372bf" Mar 16 16:04:53 crc kubenswrapper[5120]: I0316 16:04:53.954546 5120 scope.go:117] "RemoveContainer" containerID="c0581febec3bdeea4894d87b181deb06b43899f0ed864925e46b3c1aac08d714" Mar 16 16:04:53 crc kubenswrapper[5120]: I0316 16:04:53.995352 5120 scope.go:117] "RemoveContainer" containerID="78cce0266e8895a361fcac897a2f73bbc2532f8fb68591f8d86e68607c1d63b9" Mar 16 16:04:54 crc kubenswrapper[5120]: I0316 16:04:54.104443 5120 scope.go:117] "RemoveContainer" containerID="1dd4ebe973474901ee1532cc6761fa0080e8ce4a657ab1c6113dd14f2e040ba4" Mar 16 16:04:54 crc kubenswrapper[5120]: I0316 16:04:54.130011 5120 scope.go:117] "RemoveContainer" containerID="3cd09a681fec59b507fe5b3cfe4ad658860662eb6f816ebd507e38366baac93e" Mar 16 16:05:00 crc kubenswrapper[5120]: I0316 16:05:00.089275 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:05:00 crc kubenswrapper[5120]: I0316 16:05:00.090064 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:05:02 crc kubenswrapper[5120]: I0316 16:05:02.099628 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:05:02 crc kubenswrapper[5120]: I0316 16:05:02.103734 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:05:02 crc kubenswrapper[5120]: I0316 16:05:02.111895 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:05:02 crc kubenswrapper[5120]: I0316 16:05:02.925447 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:05:07 crc kubenswrapper[5120]: I0316 16:05:07.113311 5120 patch_prober.go:28] interesting pod/oauth-openshift-dd58bbf49-wdb2p container/oauth-openshift namespace/openshift-authentication: Readiness probe status=failure output="Get \"https://10.217.0.57:6443/healthz\": context deadline exceeded" start-of-body= Mar 16 16:05:07 crc kubenswrapper[5120]: I0316 16:05:07.114121 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-authentication/oauth-openshift-dd58bbf49-wdb2p" podUID="808be0cf-299b-4841-86a5-48b87d795b80" containerName="oauth-openshift" probeResult="failure" output="Get \"https://10.217.0.57:6443/healthz\": context deadline exceeded" Mar 16 16:05:08 crc kubenswrapper[5120]: E0316 16:05:08.538800 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1762826 actualBytes=10240 Mar 16 16:05:22 crc kubenswrapper[5120]: I0316 16:05:22.008260 5120 patch_prober.go:28] interesting pod/machine-config-daemon-7bf76 container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 16:05:22 crc kubenswrapper[5120]: I0316 16:05:22.008824 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 16:05:22 crc kubenswrapper[5120]: I0316 16:05:22.817011 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:05:28 crc kubenswrapper[5120]: I0316 16:05:28.003040 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-559fccdf94-s7jlg"] Mar 16 16:05:28 crc kubenswrapper[5120]: I0316 16:05:28.019749 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-559fccdf94-s7jlg" Mar 16 16:05:28 crc kubenswrapper[5120]: I0316 16:05:28.024440 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-559fccdf94-s7jlg"] Mar 16 16:05:28 crc kubenswrapper[5120]: I0316 16:05:28.130216 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/71c0d423-34cc-44f0-8fb5-7671a0f41d57-combined-ca-bundle\") pod \"placement-559fccdf94-s7jlg\" (UID: \"71c0d423-34cc-44f0-8fb5-7671a0f41d57\") " pod="openstack-kuttl-tests/placement-559fccdf94-s7jlg" Mar 16 16:05:28 crc kubenswrapper[5120]: I0316 16:05:28.130602 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nchkw\" (UniqueName: \"kubernetes.io/projected/71c0d423-34cc-44f0-8fb5-7671a0f41d57-kube-api-access-nchkw\") pod \"placement-559fccdf94-s7jlg\" (UID: \"71c0d423-34cc-44f0-8fb5-7671a0f41d57\") " pod="openstack-kuttl-tests/placement-559fccdf94-s7jlg" Mar 16 16:05:28 crc kubenswrapper[5120]: I0316 16:05:28.130749 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/71c0d423-34cc-44f0-8fb5-7671a0f41d57-scripts\") pod \"placement-559fccdf94-s7jlg\" (UID: \"71c0d423-34cc-44f0-8fb5-7671a0f41d57\") " pod="openstack-kuttl-tests/placement-559fccdf94-s7jlg" Mar 16 16:05:28 crc kubenswrapper[5120]: I0316 16:05:28.130949 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/71c0d423-34cc-44f0-8fb5-7671a0f41d57-public-tls-certs\") pod \"placement-559fccdf94-s7jlg\" (UID: \"71c0d423-34cc-44f0-8fb5-7671a0f41d57\") " pod="openstack-kuttl-tests/placement-559fccdf94-s7jlg" Mar 16 16:05:28 crc kubenswrapper[5120]: I0316 16:05:28.131232 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/71c0d423-34cc-44f0-8fb5-7671a0f41d57-config-data\") pod \"placement-559fccdf94-s7jlg\" (UID: \"71c0d423-34cc-44f0-8fb5-7671a0f41d57\") " pod="openstack-kuttl-tests/placement-559fccdf94-s7jlg" Mar 16 16:05:28 crc kubenswrapper[5120]: I0316 16:05:28.131271 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/71c0d423-34cc-44f0-8fb5-7671a0f41d57-internal-tls-certs\") pod \"placement-559fccdf94-s7jlg\" (UID: \"71c0d423-34cc-44f0-8fb5-7671a0f41d57\") " pod="openstack-kuttl-tests/placement-559fccdf94-s7jlg" Mar 16 16:05:28 crc kubenswrapper[5120]: I0316 16:05:28.131395 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/71c0d423-34cc-44f0-8fb5-7671a0f41d57-logs\") pod \"placement-559fccdf94-s7jlg\" (UID: \"71c0d423-34cc-44f0-8fb5-7671a0f41d57\") " pod="openstack-kuttl-tests/placement-559fccdf94-s7jlg" Mar 16 16:05:28 crc kubenswrapper[5120]: I0316 16:05:28.233474 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nchkw\" (UniqueName: \"kubernetes.io/projected/71c0d423-34cc-44f0-8fb5-7671a0f41d57-kube-api-access-nchkw\") pod \"placement-559fccdf94-s7jlg\" (UID: \"71c0d423-34cc-44f0-8fb5-7671a0f41d57\") " pod="openstack-kuttl-tests/placement-559fccdf94-s7jlg" Mar 16 16:05:28 crc kubenswrapper[5120]: I0316 16:05:28.233576 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/71c0d423-34cc-44f0-8fb5-7671a0f41d57-scripts\") pod \"placement-559fccdf94-s7jlg\" (UID: \"71c0d423-34cc-44f0-8fb5-7671a0f41d57\") " pod="openstack-kuttl-tests/placement-559fccdf94-s7jlg" Mar 16 16:05:28 crc kubenswrapper[5120]: I0316 16:05:28.233611 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/71c0d423-34cc-44f0-8fb5-7671a0f41d57-public-tls-certs\") pod \"placement-559fccdf94-s7jlg\" (UID: \"71c0d423-34cc-44f0-8fb5-7671a0f41d57\") " pod="openstack-kuttl-tests/placement-559fccdf94-s7jlg" Mar 16 16:05:28 crc kubenswrapper[5120]: I0316 16:05:28.233681 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/71c0d423-34cc-44f0-8fb5-7671a0f41d57-config-data\") pod \"placement-559fccdf94-s7jlg\" (UID: \"71c0d423-34cc-44f0-8fb5-7671a0f41d57\") " pod="openstack-kuttl-tests/placement-559fccdf94-s7jlg" Mar 16 16:05:28 crc kubenswrapper[5120]: I0316 16:05:28.233702 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/71c0d423-34cc-44f0-8fb5-7671a0f41d57-internal-tls-certs\") pod \"placement-559fccdf94-s7jlg\" (UID: \"71c0d423-34cc-44f0-8fb5-7671a0f41d57\") " pod="openstack-kuttl-tests/placement-559fccdf94-s7jlg" Mar 16 16:05:28 crc kubenswrapper[5120]: I0316 16:05:28.233788 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/71c0d423-34cc-44f0-8fb5-7671a0f41d57-logs\") pod \"placement-559fccdf94-s7jlg\" (UID: \"71c0d423-34cc-44f0-8fb5-7671a0f41d57\") " pod="openstack-kuttl-tests/placement-559fccdf94-s7jlg" Mar 16 16:05:28 crc kubenswrapper[5120]: I0316 16:05:28.233851 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/71c0d423-34cc-44f0-8fb5-7671a0f41d57-combined-ca-bundle\") pod \"placement-559fccdf94-s7jlg\" (UID: \"71c0d423-34cc-44f0-8fb5-7671a0f41d57\") " pod="openstack-kuttl-tests/placement-559fccdf94-s7jlg" Mar 16 16:05:28 crc kubenswrapper[5120]: I0316 16:05:28.234829 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/71c0d423-34cc-44f0-8fb5-7671a0f41d57-logs\") pod \"placement-559fccdf94-s7jlg\" (UID: \"71c0d423-34cc-44f0-8fb5-7671a0f41d57\") " pod="openstack-kuttl-tests/placement-559fccdf94-s7jlg" Mar 16 16:05:28 crc kubenswrapper[5120]: I0316 16:05:28.242225 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/71c0d423-34cc-44f0-8fb5-7671a0f41d57-combined-ca-bundle\") pod \"placement-559fccdf94-s7jlg\" (UID: \"71c0d423-34cc-44f0-8fb5-7671a0f41d57\") " pod="openstack-kuttl-tests/placement-559fccdf94-s7jlg" Mar 16 16:05:28 crc kubenswrapper[5120]: I0316 16:05:28.243808 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/71c0d423-34cc-44f0-8fb5-7671a0f41d57-config-data\") pod \"placement-559fccdf94-s7jlg\" (UID: \"71c0d423-34cc-44f0-8fb5-7671a0f41d57\") " pod="openstack-kuttl-tests/placement-559fccdf94-s7jlg" Mar 16 16:05:28 crc kubenswrapper[5120]: I0316 16:05:28.244051 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/71c0d423-34cc-44f0-8fb5-7671a0f41d57-public-tls-certs\") pod \"placement-559fccdf94-s7jlg\" (UID: \"71c0d423-34cc-44f0-8fb5-7671a0f41d57\") " pod="openstack-kuttl-tests/placement-559fccdf94-s7jlg" Mar 16 16:05:28 crc kubenswrapper[5120]: I0316 16:05:28.244296 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/71c0d423-34cc-44f0-8fb5-7671a0f41d57-internal-tls-certs\") pod \"placement-559fccdf94-s7jlg\" (UID: \"71c0d423-34cc-44f0-8fb5-7671a0f41d57\") " pod="openstack-kuttl-tests/placement-559fccdf94-s7jlg" Mar 16 16:05:28 crc kubenswrapper[5120]: I0316 16:05:28.245352 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/71c0d423-34cc-44f0-8fb5-7671a0f41d57-scripts\") pod \"placement-559fccdf94-s7jlg\" (UID: \"71c0d423-34cc-44f0-8fb5-7671a0f41d57\") " pod="openstack-kuttl-tests/placement-559fccdf94-s7jlg" Mar 16 16:05:28 crc kubenswrapper[5120]: I0316 16:05:28.255715 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nchkw\" (UniqueName: \"kubernetes.io/projected/71c0d423-34cc-44f0-8fb5-7671a0f41d57-kube-api-access-nchkw\") pod \"placement-559fccdf94-s7jlg\" (UID: \"71c0d423-34cc-44f0-8fb5-7671a0f41d57\") " pod="openstack-kuttl-tests/placement-559fccdf94-s7jlg" Mar 16 16:05:28 crc kubenswrapper[5120]: I0316 16:05:28.341196 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-559fccdf94-s7jlg" Mar 16 16:05:28 crc kubenswrapper[5120]: I0316 16:05:28.612656 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-559fccdf94-s7jlg"] Mar 16 16:05:28 crc kubenswrapper[5120]: I0316 16:05:28.654653 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-85c78fd974-xjpjw"] Mar 16 16:05:28 crc kubenswrapper[5120]: I0316 16:05:28.660690 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-85c78fd974-xjpjw" Mar 16 16:05:28 crc kubenswrapper[5120]: I0316 16:05:28.676065 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-85c78fd974-xjpjw"] Mar 16 16:05:28 crc kubenswrapper[5120]: I0316 16:05:28.850428 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/9d957ec2-c514-472f-8d88-1d6c6fa2449a-internal-tls-certs\") pod \"placement-85c78fd974-xjpjw\" (UID: \"9d957ec2-c514-472f-8d88-1d6c6fa2449a\") " pod="openstack-kuttl-tests/placement-85c78fd974-xjpjw" Mar 16 16:05:28 crc kubenswrapper[5120]: I0316 16:05:28.850563 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9d957ec2-c514-472f-8d88-1d6c6fa2449a-scripts\") pod \"placement-85c78fd974-xjpjw\" (UID: \"9d957ec2-c514-472f-8d88-1d6c6fa2449a\") " pod="openstack-kuttl-tests/placement-85c78fd974-xjpjw" Mar 16 16:05:28 crc kubenswrapper[5120]: I0316 16:05:28.851345 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9d957ec2-c514-472f-8d88-1d6c6fa2449a-combined-ca-bundle\") pod \"placement-85c78fd974-xjpjw\" (UID: \"9d957ec2-c514-472f-8d88-1d6c6fa2449a\") " pod="openstack-kuttl-tests/placement-85c78fd974-xjpjw" Mar 16 16:05:28 crc kubenswrapper[5120]: I0316 16:05:28.851437 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9d957ec2-c514-472f-8d88-1d6c6fa2449a-logs\") pod \"placement-85c78fd974-xjpjw\" (UID: \"9d957ec2-c514-472f-8d88-1d6c6fa2449a\") " pod="openstack-kuttl-tests/placement-85c78fd974-xjpjw" Mar 16 16:05:28 crc kubenswrapper[5120]: I0316 16:05:28.851467 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9d957ec2-c514-472f-8d88-1d6c6fa2449a-config-data\") pod \"placement-85c78fd974-xjpjw\" (UID: \"9d957ec2-c514-472f-8d88-1d6c6fa2449a\") " pod="openstack-kuttl-tests/placement-85c78fd974-xjpjw" Mar 16 16:05:28 crc kubenswrapper[5120]: I0316 16:05:28.851803 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/9d957ec2-c514-472f-8d88-1d6c6fa2449a-public-tls-certs\") pod \"placement-85c78fd974-xjpjw\" (UID: \"9d957ec2-c514-472f-8d88-1d6c6fa2449a\") " pod="openstack-kuttl-tests/placement-85c78fd974-xjpjw" Mar 16 16:05:28 crc kubenswrapper[5120]: I0316 16:05:28.852064 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4mtn\" (UniqueName: \"kubernetes.io/projected/9d957ec2-c514-472f-8d88-1d6c6fa2449a-kube-api-access-m4mtn\") pod \"placement-85c78fd974-xjpjw\" (UID: \"9d957ec2-c514-472f-8d88-1d6c6fa2449a\") " pod="openstack-kuttl-tests/placement-85c78fd974-xjpjw" Mar 16 16:05:28 crc kubenswrapper[5120]: I0316 16:05:28.874705 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-559fccdf94-s7jlg"] Mar 16 16:05:28 crc kubenswrapper[5120]: I0316 16:05:28.954606 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9d957ec2-c514-472f-8d88-1d6c6fa2449a-combined-ca-bundle\") pod \"placement-85c78fd974-xjpjw\" (UID: \"9d957ec2-c514-472f-8d88-1d6c6fa2449a\") " pod="openstack-kuttl-tests/placement-85c78fd974-xjpjw" Mar 16 16:05:28 crc kubenswrapper[5120]: I0316 16:05:28.954685 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9d957ec2-c514-472f-8d88-1d6c6fa2449a-logs\") pod \"placement-85c78fd974-xjpjw\" (UID: \"9d957ec2-c514-472f-8d88-1d6c6fa2449a\") " pod="openstack-kuttl-tests/placement-85c78fd974-xjpjw" Mar 16 16:05:28 crc kubenswrapper[5120]: I0316 16:05:28.954729 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9d957ec2-c514-472f-8d88-1d6c6fa2449a-config-data\") pod \"placement-85c78fd974-xjpjw\" (UID: \"9d957ec2-c514-472f-8d88-1d6c6fa2449a\") " pod="openstack-kuttl-tests/placement-85c78fd974-xjpjw" Mar 16 16:05:28 crc kubenswrapper[5120]: I0316 16:05:28.954928 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/9d957ec2-c514-472f-8d88-1d6c6fa2449a-public-tls-certs\") pod \"placement-85c78fd974-xjpjw\" (UID: \"9d957ec2-c514-472f-8d88-1d6c6fa2449a\") " pod="openstack-kuttl-tests/placement-85c78fd974-xjpjw" Mar 16 16:05:28 crc kubenswrapper[5120]: I0316 16:05:28.955037 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m4mtn\" (UniqueName: \"kubernetes.io/projected/9d957ec2-c514-472f-8d88-1d6c6fa2449a-kube-api-access-m4mtn\") pod \"placement-85c78fd974-xjpjw\" (UID: \"9d957ec2-c514-472f-8d88-1d6c6fa2449a\") " pod="openstack-kuttl-tests/placement-85c78fd974-xjpjw" Mar 16 16:05:28 crc kubenswrapper[5120]: I0316 16:05:28.955189 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/9d957ec2-c514-472f-8d88-1d6c6fa2449a-internal-tls-certs\") pod \"placement-85c78fd974-xjpjw\" (UID: \"9d957ec2-c514-472f-8d88-1d6c6fa2449a\") " pod="openstack-kuttl-tests/placement-85c78fd974-xjpjw" Mar 16 16:05:28 crc kubenswrapper[5120]: I0316 16:05:28.955266 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9d957ec2-c514-472f-8d88-1d6c6fa2449a-scripts\") pod \"placement-85c78fd974-xjpjw\" (UID: \"9d957ec2-c514-472f-8d88-1d6c6fa2449a\") " pod="openstack-kuttl-tests/placement-85c78fd974-xjpjw" Mar 16 16:05:28 crc kubenswrapper[5120]: I0316 16:05:28.956822 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9d957ec2-c514-472f-8d88-1d6c6fa2449a-logs\") pod \"placement-85c78fd974-xjpjw\" (UID: \"9d957ec2-c514-472f-8d88-1d6c6fa2449a\") " pod="openstack-kuttl-tests/placement-85c78fd974-xjpjw" Mar 16 16:05:28 crc kubenswrapper[5120]: I0316 16:05:28.961053 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9d957ec2-c514-472f-8d88-1d6c6fa2449a-scripts\") pod \"placement-85c78fd974-xjpjw\" (UID: \"9d957ec2-c514-472f-8d88-1d6c6fa2449a\") " pod="openstack-kuttl-tests/placement-85c78fd974-xjpjw" Mar 16 16:05:28 crc kubenswrapper[5120]: I0316 16:05:28.961408 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/9d957ec2-c514-472f-8d88-1d6c6fa2449a-internal-tls-certs\") pod \"placement-85c78fd974-xjpjw\" (UID: \"9d957ec2-c514-472f-8d88-1d6c6fa2449a\") " pod="openstack-kuttl-tests/placement-85c78fd974-xjpjw" Mar 16 16:05:28 crc kubenswrapper[5120]: I0316 16:05:28.962283 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9d957ec2-c514-472f-8d88-1d6c6fa2449a-config-data\") pod \"placement-85c78fd974-xjpjw\" (UID: \"9d957ec2-c514-472f-8d88-1d6c6fa2449a\") " pod="openstack-kuttl-tests/placement-85c78fd974-xjpjw" Mar 16 16:05:28 crc kubenswrapper[5120]: I0316 16:05:28.962961 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/9d957ec2-c514-472f-8d88-1d6c6fa2449a-public-tls-certs\") pod \"placement-85c78fd974-xjpjw\" (UID: \"9d957ec2-c514-472f-8d88-1d6c6fa2449a\") " pod="openstack-kuttl-tests/placement-85c78fd974-xjpjw" Mar 16 16:05:28 crc kubenswrapper[5120]: I0316 16:05:28.973858 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9d957ec2-c514-472f-8d88-1d6c6fa2449a-combined-ca-bundle\") pod \"placement-85c78fd974-xjpjw\" (UID: \"9d957ec2-c514-472f-8d88-1d6c6fa2449a\") " pod="openstack-kuttl-tests/placement-85c78fd974-xjpjw" Mar 16 16:05:28 crc kubenswrapper[5120]: I0316 16:05:28.984348 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4mtn\" (UniqueName: \"kubernetes.io/projected/9d957ec2-c514-472f-8d88-1d6c6fa2449a-kube-api-access-m4mtn\") pod \"placement-85c78fd974-xjpjw\" (UID: \"9d957ec2-c514-472f-8d88-1d6c6fa2449a\") " pod="openstack-kuttl-tests/placement-85c78fd974-xjpjw" Mar 16 16:05:29 crc kubenswrapper[5120]: I0316 16:05:29.282372 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-85c78fd974-xjpjw" Mar 16 16:05:29 crc kubenswrapper[5120]: I0316 16:05:29.395496 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-559fccdf94-s7jlg" event={"ID":"71c0d423-34cc-44f0-8fb5-7671a0f41d57","Type":"ContainerStarted","Data":"b9bc32cbd36d1f9089bdf60604ee44ec0d69cbe1cb39593804285f2e9019749a"} Mar 16 16:05:29 crc kubenswrapper[5120]: I0316 16:05:29.395568 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-559fccdf94-s7jlg" event={"ID":"71c0d423-34cc-44f0-8fb5-7671a0f41d57","Type":"ContainerStarted","Data":"c01e877977093dc1765ff75b4b1544572154cc8d776b3022401b30a6aa2f9077"} Mar 16 16:05:29 crc kubenswrapper[5120]: I0316 16:05:29.767349 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:05:29 crc kubenswrapper[5120]: I0316 16:05:29.775035 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="f6934b6a-f36d-400a-bb39-d0cdaf66cbae" containerName="glance-log" containerID="cri-o://3a0eac62028b566de718f70c8dc16d3391066a9f4380be71fc32a594a075594a" gracePeriod=30 Mar 16 16:05:29 crc kubenswrapper[5120]: I0316 16:05:29.775579 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="f6934b6a-f36d-400a-bb39-d0cdaf66cbae" containerName="glance-httpd" containerID="cri-o://b26345e7420937f51f9ee691179115e14fd242221f59cbc6399198aa3bdde911" gracePeriod=30 Mar 16 16:05:29 crc kubenswrapper[5120]: I0316 16:05:29.801692 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-85c78fd974-xjpjw"] Mar 16 16:05:29 crc kubenswrapper[5120]: I0316 16:05:29.853300 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:05:29 crc kubenswrapper[5120]: I0316 16:05:29.853590 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="ff5d8cf4-cd75-4107-8fc7-a462d339bab3" containerName="glance-log" containerID="cri-o://65be4143a1b35b422634be7c4104e29fcae55ae42304921d88654fff7573e813" gracePeriod=30 Mar 16 16:05:29 crc kubenswrapper[5120]: I0316 16:05:29.853663 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="ff5d8cf4-cd75-4107-8fc7-a462d339bab3" containerName="glance-httpd" containerID="cri-o://05d7e14d0e1d726d667bd4e4e2d362e0cadb24937d6a68b8f3ad0552047dcc74" gracePeriod=30 Mar 16 16:05:30 crc kubenswrapper[5120]: I0316 16:05:30.406466 5120 generic.go:358] "Generic (PLEG): container finished" podID="f6934b6a-f36d-400a-bb39-d0cdaf66cbae" containerID="3a0eac62028b566de718f70c8dc16d3391066a9f4380be71fc32a594a075594a" exitCode=143 Mar 16 16:05:30 crc kubenswrapper[5120]: I0316 16:05:30.406841 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"f6934b6a-f36d-400a-bb39-d0cdaf66cbae","Type":"ContainerDied","Data":"3a0eac62028b566de718f70c8dc16d3391066a9f4380be71fc32a594a075594a"} Mar 16 16:05:30 crc kubenswrapper[5120]: I0316 16:05:30.410574 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-85c78fd974-xjpjw" event={"ID":"9d957ec2-c514-472f-8d88-1d6c6fa2449a","Type":"ContainerStarted","Data":"4116dcb83724da3c7c7e7b411acb5b9cee7912b69d024280fbdb5d4b961c617a"} Mar 16 16:05:30 crc kubenswrapper[5120]: I0316 16:05:30.410601 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-85c78fd974-xjpjw" event={"ID":"9d957ec2-c514-472f-8d88-1d6c6fa2449a","Type":"ContainerStarted","Data":"ed7c036767ac426d78f2c45467d40f88e65f0494312c02576528585784ff26f9"} Mar 16 16:05:30 crc kubenswrapper[5120]: I0316 16:05:30.412570 5120 generic.go:358] "Generic (PLEG): container finished" podID="ff5d8cf4-cd75-4107-8fc7-a462d339bab3" containerID="65be4143a1b35b422634be7c4104e29fcae55ae42304921d88654fff7573e813" exitCode=143 Mar 16 16:05:30 crc kubenswrapper[5120]: I0316 16:05:30.412702 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"ff5d8cf4-cd75-4107-8fc7-a462d339bab3","Type":"ContainerDied","Data":"65be4143a1b35b422634be7c4104e29fcae55ae42304921d88654fff7573e813"} Mar 16 16:05:30 crc kubenswrapper[5120]: I0316 16:05:30.415517 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-559fccdf94-s7jlg" event={"ID":"71c0d423-34cc-44f0-8fb5-7671a0f41d57","Type":"ContainerStarted","Data":"b522a4e0b06675a752bcb56764ac4acd121ff2e19bf1bc4ee1960e904ae0b6d1"} Mar 16 16:05:30 crc kubenswrapper[5120]: I0316 16:05:30.415737 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-559fccdf94-s7jlg" podUID="71c0d423-34cc-44f0-8fb5-7671a0f41d57" containerName="placement-log" containerID="cri-o://b9bc32cbd36d1f9089bdf60604ee44ec0d69cbe1cb39593804285f2e9019749a" gracePeriod=30 Mar 16 16:05:30 crc kubenswrapper[5120]: I0316 16:05:30.415911 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-559fccdf94-s7jlg" podUID="71c0d423-34cc-44f0-8fb5-7671a0f41d57" containerName="placement-api" containerID="cri-o://b522a4e0b06675a752bcb56764ac4acd121ff2e19bf1bc4ee1960e904ae0b6d1" gracePeriod=30 Mar 16 16:05:30 crc kubenswrapper[5120]: I0316 16:05:30.415986 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-559fccdf94-s7jlg" Mar 16 16:05:30 crc kubenswrapper[5120]: I0316 16:05:30.416027 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-559fccdf94-s7jlg" Mar 16 16:05:30 crc kubenswrapper[5120]: I0316 16:05:30.466486 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-559fccdf94-s7jlg" podStartSLOduration=3.466462767 podStartE2EDuration="3.466462767s" podCreationTimestamp="2026-03-16 16:05:27 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:05:30.444486497 +0000 UTC m=+2032.598418174" watchObservedRunningTime="2026-03-16 16:05:30.466462767 +0000 UTC m=+2032.620394434" Mar 16 16:05:30 crc kubenswrapper[5120]: I0316 16:05:30.970442 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-559fccdf94-s7jlg" Mar 16 16:05:31 crc kubenswrapper[5120]: I0316 16:05:31.033489 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/71c0d423-34cc-44f0-8fb5-7671a0f41d57-combined-ca-bundle\") pod \"71c0d423-34cc-44f0-8fb5-7671a0f41d57\" (UID: \"71c0d423-34cc-44f0-8fb5-7671a0f41d57\") " Mar 16 16:05:31 crc kubenswrapper[5120]: I0316 16:05:31.033604 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/71c0d423-34cc-44f0-8fb5-7671a0f41d57-config-data\") pod \"71c0d423-34cc-44f0-8fb5-7671a0f41d57\" (UID: \"71c0d423-34cc-44f0-8fb5-7671a0f41d57\") " Mar 16 16:05:31 crc kubenswrapper[5120]: I0316 16:05:31.033638 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/71c0d423-34cc-44f0-8fb5-7671a0f41d57-logs\") pod \"71c0d423-34cc-44f0-8fb5-7671a0f41d57\" (UID: \"71c0d423-34cc-44f0-8fb5-7671a0f41d57\") " Mar 16 16:05:31 crc kubenswrapper[5120]: I0316 16:05:31.033701 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/71c0d423-34cc-44f0-8fb5-7671a0f41d57-public-tls-certs\") pod \"71c0d423-34cc-44f0-8fb5-7671a0f41d57\" (UID: \"71c0d423-34cc-44f0-8fb5-7671a0f41d57\") " Mar 16 16:05:31 crc kubenswrapper[5120]: I0316 16:05:31.033719 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/71c0d423-34cc-44f0-8fb5-7671a0f41d57-internal-tls-certs\") pod \"71c0d423-34cc-44f0-8fb5-7671a0f41d57\" (UID: \"71c0d423-34cc-44f0-8fb5-7671a0f41d57\") " Mar 16 16:05:31 crc kubenswrapper[5120]: I0316 16:05:31.033996 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/71c0d423-34cc-44f0-8fb5-7671a0f41d57-scripts\") pod \"71c0d423-34cc-44f0-8fb5-7671a0f41d57\" (UID: \"71c0d423-34cc-44f0-8fb5-7671a0f41d57\") " Mar 16 16:05:31 crc kubenswrapper[5120]: I0316 16:05:31.034021 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nchkw\" (UniqueName: \"kubernetes.io/projected/71c0d423-34cc-44f0-8fb5-7671a0f41d57-kube-api-access-nchkw\") pod \"71c0d423-34cc-44f0-8fb5-7671a0f41d57\" (UID: \"71c0d423-34cc-44f0-8fb5-7671a0f41d57\") " Mar 16 16:05:31 crc kubenswrapper[5120]: I0316 16:05:31.034068 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71c0d423-34cc-44f0-8fb5-7671a0f41d57-logs" (OuterVolumeSpecName: "logs") pod "71c0d423-34cc-44f0-8fb5-7671a0f41d57" (UID: "71c0d423-34cc-44f0-8fb5-7671a0f41d57"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:05:31 crc kubenswrapper[5120]: I0316 16:05:31.035092 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/71c0d423-34cc-44f0-8fb5-7671a0f41d57-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:31 crc kubenswrapper[5120]: I0316 16:05:31.041939 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/71c0d423-34cc-44f0-8fb5-7671a0f41d57-scripts" (OuterVolumeSpecName: "scripts") pod "71c0d423-34cc-44f0-8fb5-7671a0f41d57" (UID: "71c0d423-34cc-44f0-8fb5-7671a0f41d57"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:31 crc kubenswrapper[5120]: I0316 16:05:31.042440 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71c0d423-34cc-44f0-8fb5-7671a0f41d57-kube-api-access-nchkw" (OuterVolumeSpecName: "kube-api-access-nchkw") pod "71c0d423-34cc-44f0-8fb5-7671a0f41d57" (UID: "71c0d423-34cc-44f0-8fb5-7671a0f41d57"). InnerVolumeSpecName "kube-api-access-nchkw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:05:31 crc kubenswrapper[5120]: I0316 16:05:31.096013 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:05:31 crc kubenswrapper[5120]: I0316 16:05:31.096276 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="18b99335-9d0e-44a5-a6d6-a8ffe17ccd05" containerName="cinder-scheduler" containerID="cri-o://99feac53e678997bd71ad825e2c6c0ef61222639fa34f589c99f7cc46fab6cee" gracePeriod=30 Mar 16 16:05:31 crc kubenswrapper[5120]: I0316 16:05:31.096665 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="18b99335-9d0e-44a5-a6d6-a8ffe17ccd05" containerName="probe" containerID="cri-o://27fb86bc3c9d5fdfd0c0e9eb50972c65626d46f8fbbde0a14f84fbb04c64e79c" gracePeriod=30 Mar 16 16:05:31 crc kubenswrapper[5120]: I0316 16:05:31.119062 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/71c0d423-34cc-44f0-8fb5-7671a0f41d57-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "71c0d423-34cc-44f0-8fb5-7671a0f41d57" (UID: "71c0d423-34cc-44f0-8fb5-7671a0f41d57"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:31 crc kubenswrapper[5120]: I0316 16:05:31.136510 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:05:31 crc kubenswrapper[5120]: I0316 16:05:31.136747 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/71c0d423-34cc-44f0-8fb5-7671a0f41d57-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:31 crc kubenswrapper[5120]: I0316 16:05:31.136777 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nchkw\" (UniqueName: \"kubernetes.io/projected/71c0d423-34cc-44f0-8fb5-7671a0f41d57-kube-api-access-nchkw\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:31 crc kubenswrapper[5120]: I0316 16:05:31.136788 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/71c0d423-34cc-44f0-8fb5-7671a0f41d57-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:31 crc kubenswrapper[5120]: I0316 16:05:31.136766 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="27074431-e87c-47e8-9d5a-97fc6edcb13a" containerName="cinder-api-log" containerID="cri-o://67742b8daeb25edbf24bf7d11c17631616825891f277c6d8ea5023f5f01fa709" gracePeriod=30 Mar 16 16:05:31 crc kubenswrapper[5120]: I0316 16:05:31.136811 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="27074431-e87c-47e8-9d5a-97fc6edcb13a" containerName="cinder-api" containerID="cri-o://a9c198c5fde8f1516c2c97543c1c28b24b2488b249ed434453537e04cab35001" gracePeriod=30 Mar 16 16:05:31 crc kubenswrapper[5120]: I0316 16:05:31.156436 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/71c0d423-34cc-44f0-8fb5-7671a0f41d57-config-data" (OuterVolumeSpecName: "config-data") pod "71c0d423-34cc-44f0-8fb5-7671a0f41d57" (UID: "71c0d423-34cc-44f0-8fb5-7671a0f41d57"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:31 crc kubenswrapper[5120]: I0316 16:05:31.185506 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/71c0d423-34cc-44f0-8fb5-7671a0f41d57-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "71c0d423-34cc-44f0-8fb5-7671a0f41d57" (UID: "71c0d423-34cc-44f0-8fb5-7671a0f41d57"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:31 crc kubenswrapper[5120]: I0316 16:05:31.200451 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/71c0d423-34cc-44f0-8fb5-7671a0f41d57-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "71c0d423-34cc-44f0-8fb5-7671a0f41d57" (UID: "71c0d423-34cc-44f0-8fb5-7671a0f41d57"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:31 crc kubenswrapper[5120]: I0316 16:05:31.238335 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/71c0d423-34cc-44f0-8fb5-7671a0f41d57-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:31 crc kubenswrapper[5120]: I0316 16:05:31.238369 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/71c0d423-34cc-44f0-8fb5-7671a0f41d57-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:31 crc kubenswrapper[5120]: I0316 16:05:31.238381 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/71c0d423-34cc-44f0-8fb5-7671a0f41d57-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:31 crc kubenswrapper[5120]: I0316 16:05:31.426193 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-85c78fd974-xjpjw" event={"ID":"9d957ec2-c514-472f-8d88-1d6c6fa2449a","Type":"ContainerStarted","Data":"333737d93d6fbb25bb5004ab514939c313486791cddcf0cc65119cd679595d46"} Mar 16 16:05:31 crc kubenswrapper[5120]: I0316 16:05:31.426352 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-85c78fd974-xjpjw" Mar 16 16:05:31 crc kubenswrapper[5120]: I0316 16:05:31.426552 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-85c78fd974-xjpjw" Mar 16 16:05:31 crc kubenswrapper[5120]: I0316 16:05:31.428342 5120 generic.go:358] "Generic (PLEG): container finished" podID="71c0d423-34cc-44f0-8fb5-7671a0f41d57" containerID="b522a4e0b06675a752bcb56764ac4acd121ff2e19bf1bc4ee1960e904ae0b6d1" exitCode=0 Mar 16 16:05:31 crc kubenswrapper[5120]: I0316 16:05:31.428371 5120 generic.go:358] "Generic (PLEG): container finished" podID="71c0d423-34cc-44f0-8fb5-7671a0f41d57" containerID="b9bc32cbd36d1f9089bdf60604ee44ec0d69cbe1cb39593804285f2e9019749a" exitCode=143 Mar 16 16:05:31 crc kubenswrapper[5120]: I0316 16:05:31.428438 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-559fccdf94-s7jlg" event={"ID":"71c0d423-34cc-44f0-8fb5-7671a0f41d57","Type":"ContainerDied","Data":"b522a4e0b06675a752bcb56764ac4acd121ff2e19bf1bc4ee1960e904ae0b6d1"} Mar 16 16:05:31 crc kubenswrapper[5120]: I0316 16:05:31.428477 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-559fccdf94-s7jlg" event={"ID":"71c0d423-34cc-44f0-8fb5-7671a0f41d57","Type":"ContainerDied","Data":"b9bc32cbd36d1f9089bdf60604ee44ec0d69cbe1cb39593804285f2e9019749a"} Mar 16 16:05:31 crc kubenswrapper[5120]: I0316 16:05:31.428487 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-559fccdf94-s7jlg" event={"ID":"71c0d423-34cc-44f0-8fb5-7671a0f41d57","Type":"ContainerDied","Data":"c01e877977093dc1765ff75b4b1544572154cc8d776b3022401b30a6aa2f9077"} Mar 16 16:05:31 crc kubenswrapper[5120]: I0316 16:05:31.428504 5120 scope.go:117] "RemoveContainer" containerID="b522a4e0b06675a752bcb56764ac4acd121ff2e19bf1bc4ee1960e904ae0b6d1" Mar 16 16:05:31 crc kubenswrapper[5120]: I0316 16:05:31.428683 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-559fccdf94-s7jlg" Mar 16 16:05:31 crc kubenswrapper[5120]: I0316 16:05:31.436064 5120 generic.go:358] "Generic (PLEG): container finished" podID="27074431-e87c-47e8-9d5a-97fc6edcb13a" containerID="67742b8daeb25edbf24bf7d11c17631616825891f277c6d8ea5023f5f01fa709" exitCode=143 Mar 16 16:05:31 crc kubenswrapper[5120]: I0316 16:05:31.436162 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"27074431-e87c-47e8-9d5a-97fc6edcb13a","Type":"ContainerDied","Data":"67742b8daeb25edbf24bf7d11c17631616825891f277c6d8ea5023f5f01fa709"} Mar 16 16:05:31 crc kubenswrapper[5120]: I0316 16:05:31.445135 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-85c78fd974-xjpjw" podStartSLOduration=3.44512513 podStartE2EDuration="3.44512513s" podCreationTimestamp="2026-03-16 16:05:28 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:05:31.443417584 +0000 UTC m=+2033.597349241" watchObservedRunningTime="2026-03-16 16:05:31.44512513 +0000 UTC m=+2033.599056787" Mar 16 16:05:31 crc kubenswrapper[5120]: I0316 16:05:31.472035 5120 scope.go:117] "RemoveContainer" containerID="b9bc32cbd36d1f9089bdf60604ee44ec0d69cbe1cb39593804285f2e9019749a" Mar 16 16:05:31 crc kubenswrapper[5120]: I0316 16:05:31.490565 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-559fccdf94-s7jlg"] Mar 16 16:05:31 crc kubenswrapper[5120]: I0316 16:05:31.499339 5120 scope.go:117] "RemoveContainer" containerID="b522a4e0b06675a752bcb56764ac4acd121ff2e19bf1bc4ee1960e904ae0b6d1" Mar 16 16:05:31 crc kubenswrapper[5120]: E0316 16:05:31.500537 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b522a4e0b06675a752bcb56764ac4acd121ff2e19bf1bc4ee1960e904ae0b6d1\": container with ID starting with b522a4e0b06675a752bcb56764ac4acd121ff2e19bf1bc4ee1960e904ae0b6d1 not found: ID does not exist" containerID="b522a4e0b06675a752bcb56764ac4acd121ff2e19bf1bc4ee1960e904ae0b6d1" Mar 16 16:05:31 crc kubenswrapper[5120]: I0316 16:05:31.500590 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b522a4e0b06675a752bcb56764ac4acd121ff2e19bf1bc4ee1960e904ae0b6d1"} err="failed to get container status \"b522a4e0b06675a752bcb56764ac4acd121ff2e19bf1bc4ee1960e904ae0b6d1\": rpc error: code = NotFound desc = could not find container \"b522a4e0b06675a752bcb56764ac4acd121ff2e19bf1bc4ee1960e904ae0b6d1\": container with ID starting with b522a4e0b06675a752bcb56764ac4acd121ff2e19bf1bc4ee1960e904ae0b6d1 not found: ID does not exist" Mar 16 16:05:31 crc kubenswrapper[5120]: I0316 16:05:31.500620 5120 scope.go:117] "RemoveContainer" containerID="b9bc32cbd36d1f9089bdf60604ee44ec0d69cbe1cb39593804285f2e9019749a" Mar 16 16:05:31 crc kubenswrapper[5120]: E0316 16:05:31.501096 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b9bc32cbd36d1f9089bdf60604ee44ec0d69cbe1cb39593804285f2e9019749a\": container with ID starting with b9bc32cbd36d1f9089bdf60604ee44ec0d69cbe1cb39593804285f2e9019749a not found: ID does not exist" containerID="b9bc32cbd36d1f9089bdf60604ee44ec0d69cbe1cb39593804285f2e9019749a" Mar 16 16:05:31 crc kubenswrapper[5120]: I0316 16:05:31.501262 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9bc32cbd36d1f9089bdf60604ee44ec0d69cbe1cb39593804285f2e9019749a"} err="failed to get container status \"b9bc32cbd36d1f9089bdf60604ee44ec0d69cbe1cb39593804285f2e9019749a\": rpc error: code = NotFound desc = could not find container \"b9bc32cbd36d1f9089bdf60604ee44ec0d69cbe1cb39593804285f2e9019749a\": container with ID starting with b9bc32cbd36d1f9089bdf60604ee44ec0d69cbe1cb39593804285f2e9019749a not found: ID does not exist" Mar 16 16:05:31 crc kubenswrapper[5120]: I0316 16:05:31.501468 5120 scope.go:117] "RemoveContainer" containerID="b522a4e0b06675a752bcb56764ac4acd121ff2e19bf1bc4ee1960e904ae0b6d1" Mar 16 16:05:31 crc kubenswrapper[5120]: I0316 16:05:31.501486 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-559fccdf94-s7jlg"] Mar 16 16:05:31 crc kubenswrapper[5120]: I0316 16:05:31.501744 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b522a4e0b06675a752bcb56764ac4acd121ff2e19bf1bc4ee1960e904ae0b6d1"} err="failed to get container status \"b522a4e0b06675a752bcb56764ac4acd121ff2e19bf1bc4ee1960e904ae0b6d1\": rpc error: code = NotFound desc = could not find container \"b522a4e0b06675a752bcb56764ac4acd121ff2e19bf1bc4ee1960e904ae0b6d1\": container with ID starting with b522a4e0b06675a752bcb56764ac4acd121ff2e19bf1bc4ee1960e904ae0b6d1 not found: ID does not exist" Mar 16 16:05:31 crc kubenswrapper[5120]: I0316 16:05:31.501803 5120 scope.go:117] "RemoveContainer" containerID="b9bc32cbd36d1f9089bdf60604ee44ec0d69cbe1cb39593804285f2e9019749a" Mar 16 16:05:31 crc kubenswrapper[5120]: I0316 16:05:31.502401 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9bc32cbd36d1f9089bdf60604ee44ec0d69cbe1cb39593804285f2e9019749a"} err="failed to get container status \"b9bc32cbd36d1f9089bdf60604ee44ec0d69cbe1cb39593804285f2e9019749a\": rpc error: code = NotFound desc = could not find container \"b9bc32cbd36d1f9089bdf60604ee44ec0d69cbe1cb39593804285f2e9019749a\": container with ID starting with b9bc32cbd36d1f9089bdf60604ee44ec0d69cbe1cb39593804285f2e9019749a not found: ID does not exist" Mar 16 16:05:32 crc kubenswrapper[5120]: I0316 16:05:32.121959 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-dbbdddfd-6ldcl"] Mar 16 16:05:32 crc kubenswrapper[5120]: I0316 16:05:32.122934 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71c0d423-34cc-44f0-8fb5-7671a0f41d57" containerName="placement-log" Mar 16 16:05:32 crc kubenswrapper[5120]: I0316 16:05:32.122949 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="71c0d423-34cc-44f0-8fb5-7671a0f41d57" containerName="placement-log" Mar 16 16:05:32 crc kubenswrapper[5120]: I0316 16:05:32.122967 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71c0d423-34cc-44f0-8fb5-7671a0f41d57" containerName="placement-api" Mar 16 16:05:32 crc kubenswrapper[5120]: I0316 16:05:32.122973 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="71c0d423-34cc-44f0-8fb5-7671a0f41d57" containerName="placement-api" Mar 16 16:05:32 crc kubenswrapper[5120]: I0316 16:05:32.123175 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="71c0d423-34cc-44f0-8fb5-7671a0f41d57" containerName="placement-log" Mar 16 16:05:32 crc kubenswrapper[5120]: I0316 16:05:32.123198 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="71c0d423-34cc-44f0-8fb5-7671a0f41d57" containerName="placement-api" Mar 16 16:05:32 crc kubenswrapper[5120]: I0316 16:05:32.128169 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-dbbdddfd-6ldcl" Mar 16 16:05:32 crc kubenswrapper[5120]: I0316 16:05:32.139052 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-dbbdddfd-6ldcl"] Mar 16 16:05:32 crc kubenswrapper[5120]: I0316 16:05:32.262566 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/44247dca-a1cf-42bd-8b32-51322d84cde0-ovndb-tls-certs\") pod \"neutron-dbbdddfd-6ldcl\" (UID: \"44247dca-a1cf-42bd-8b32-51322d84cde0\") " pod="openstack-kuttl-tests/neutron-dbbdddfd-6ldcl" Mar 16 16:05:32 crc kubenswrapper[5120]: I0316 16:05:32.262677 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55nsx\" (UniqueName: \"kubernetes.io/projected/44247dca-a1cf-42bd-8b32-51322d84cde0-kube-api-access-55nsx\") pod \"neutron-dbbdddfd-6ldcl\" (UID: \"44247dca-a1cf-42bd-8b32-51322d84cde0\") " pod="openstack-kuttl-tests/neutron-dbbdddfd-6ldcl" Mar 16 16:05:32 crc kubenswrapper[5120]: I0316 16:05:32.262716 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/44247dca-a1cf-42bd-8b32-51322d84cde0-internal-tls-certs\") pod \"neutron-dbbdddfd-6ldcl\" (UID: \"44247dca-a1cf-42bd-8b32-51322d84cde0\") " pod="openstack-kuttl-tests/neutron-dbbdddfd-6ldcl" Mar 16 16:05:32 crc kubenswrapper[5120]: I0316 16:05:32.263023 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/44247dca-a1cf-42bd-8b32-51322d84cde0-httpd-config\") pod \"neutron-dbbdddfd-6ldcl\" (UID: \"44247dca-a1cf-42bd-8b32-51322d84cde0\") " pod="openstack-kuttl-tests/neutron-dbbdddfd-6ldcl" Mar 16 16:05:32 crc kubenswrapper[5120]: I0316 16:05:32.263377 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/44247dca-a1cf-42bd-8b32-51322d84cde0-public-tls-certs\") pod \"neutron-dbbdddfd-6ldcl\" (UID: \"44247dca-a1cf-42bd-8b32-51322d84cde0\") " pod="openstack-kuttl-tests/neutron-dbbdddfd-6ldcl" Mar 16 16:05:32 crc kubenswrapper[5120]: I0316 16:05:32.263455 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/44247dca-a1cf-42bd-8b32-51322d84cde0-config\") pod \"neutron-dbbdddfd-6ldcl\" (UID: \"44247dca-a1cf-42bd-8b32-51322d84cde0\") " pod="openstack-kuttl-tests/neutron-dbbdddfd-6ldcl" Mar 16 16:05:32 crc kubenswrapper[5120]: I0316 16:05:32.263492 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/44247dca-a1cf-42bd-8b32-51322d84cde0-combined-ca-bundle\") pod \"neutron-dbbdddfd-6ldcl\" (UID: \"44247dca-a1cf-42bd-8b32-51322d84cde0\") " pod="openstack-kuttl-tests/neutron-dbbdddfd-6ldcl" Mar 16 16:05:32 crc kubenswrapper[5120]: I0316 16:05:32.365359 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-55nsx\" (UniqueName: \"kubernetes.io/projected/44247dca-a1cf-42bd-8b32-51322d84cde0-kube-api-access-55nsx\") pod \"neutron-dbbdddfd-6ldcl\" (UID: \"44247dca-a1cf-42bd-8b32-51322d84cde0\") " pod="openstack-kuttl-tests/neutron-dbbdddfd-6ldcl" Mar 16 16:05:32 crc kubenswrapper[5120]: I0316 16:05:32.365420 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/44247dca-a1cf-42bd-8b32-51322d84cde0-internal-tls-certs\") pod \"neutron-dbbdddfd-6ldcl\" (UID: \"44247dca-a1cf-42bd-8b32-51322d84cde0\") " pod="openstack-kuttl-tests/neutron-dbbdddfd-6ldcl" Mar 16 16:05:32 crc kubenswrapper[5120]: I0316 16:05:32.365508 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/44247dca-a1cf-42bd-8b32-51322d84cde0-httpd-config\") pod \"neutron-dbbdddfd-6ldcl\" (UID: \"44247dca-a1cf-42bd-8b32-51322d84cde0\") " pod="openstack-kuttl-tests/neutron-dbbdddfd-6ldcl" Mar 16 16:05:32 crc kubenswrapper[5120]: I0316 16:05:32.365602 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/44247dca-a1cf-42bd-8b32-51322d84cde0-public-tls-certs\") pod \"neutron-dbbdddfd-6ldcl\" (UID: \"44247dca-a1cf-42bd-8b32-51322d84cde0\") " pod="openstack-kuttl-tests/neutron-dbbdddfd-6ldcl" Mar 16 16:05:32 crc kubenswrapper[5120]: I0316 16:05:32.365630 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/44247dca-a1cf-42bd-8b32-51322d84cde0-config\") pod \"neutron-dbbdddfd-6ldcl\" (UID: \"44247dca-a1cf-42bd-8b32-51322d84cde0\") " pod="openstack-kuttl-tests/neutron-dbbdddfd-6ldcl" Mar 16 16:05:32 crc kubenswrapper[5120]: I0316 16:05:32.365648 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/44247dca-a1cf-42bd-8b32-51322d84cde0-combined-ca-bundle\") pod \"neutron-dbbdddfd-6ldcl\" (UID: \"44247dca-a1cf-42bd-8b32-51322d84cde0\") " pod="openstack-kuttl-tests/neutron-dbbdddfd-6ldcl" Mar 16 16:05:32 crc kubenswrapper[5120]: I0316 16:05:32.365702 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/44247dca-a1cf-42bd-8b32-51322d84cde0-ovndb-tls-certs\") pod \"neutron-dbbdddfd-6ldcl\" (UID: \"44247dca-a1cf-42bd-8b32-51322d84cde0\") " pod="openstack-kuttl-tests/neutron-dbbdddfd-6ldcl" Mar 16 16:05:32 crc kubenswrapper[5120]: I0316 16:05:32.372013 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/44247dca-a1cf-42bd-8b32-51322d84cde0-ovndb-tls-certs\") pod \"neutron-dbbdddfd-6ldcl\" (UID: \"44247dca-a1cf-42bd-8b32-51322d84cde0\") " pod="openstack-kuttl-tests/neutron-dbbdddfd-6ldcl" Mar 16 16:05:32 crc kubenswrapper[5120]: I0316 16:05:32.372034 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/44247dca-a1cf-42bd-8b32-51322d84cde0-public-tls-certs\") pod \"neutron-dbbdddfd-6ldcl\" (UID: \"44247dca-a1cf-42bd-8b32-51322d84cde0\") " pod="openstack-kuttl-tests/neutron-dbbdddfd-6ldcl" Mar 16 16:05:32 crc kubenswrapper[5120]: I0316 16:05:32.372367 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/44247dca-a1cf-42bd-8b32-51322d84cde0-combined-ca-bundle\") pod \"neutron-dbbdddfd-6ldcl\" (UID: \"44247dca-a1cf-42bd-8b32-51322d84cde0\") " pod="openstack-kuttl-tests/neutron-dbbdddfd-6ldcl" Mar 16 16:05:32 crc kubenswrapper[5120]: I0316 16:05:32.373124 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/44247dca-a1cf-42bd-8b32-51322d84cde0-config\") pod \"neutron-dbbdddfd-6ldcl\" (UID: \"44247dca-a1cf-42bd-8b32-51322d84cde0\") " pod="openstack-kuttl-tests/neutron-dbbdddfd-6ldcl" Mar 16 16:05:32 crc kubenswrapper[5120]: I0316 16:05:32.374846 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/44247dca-a1cf-42bd-8b32-51322d84cde0-httpd-config\") pod \"neutron-dbbdddfd-6ldcl\" (UID: \"44247dca-a1cf-42bd-8b32-51322d84cde0\") " pod="openstack-kuttl-tests/neutron-dbbdddfd-6ldcl" Mar 16 16:05:32 crc kubenswrapper[5120]: I0316 16:05:32.379958 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/44247dca-a1cf-42bd-8b32-51322d84cde0-internal-tls-certs\") pod \"neutron-dbbdddfd-6ldcl\" (UID: \"44247dca-a1cf-42bd-8b32-51322d84cde0\") " pod="openstack-kuttl-tests/neutron-dbbdddfd-6ldcl" Mar 16 16:05:32 crc kubenswrapper[5120]: I0316 16:05:32.383385 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-55nsx\" (UniqueName: \"kubernetes.io/projected/44247dca-a1cf-42bd-8b32-51322d84cde0-kube-api-access-55nsx\") pod \"neutron-dbbdddfd-6ldcl\" (UID: \"44247dca-a1cf-42bd-8b32-51322d84cde0\") " pod="openstack-kuttl-tests/neutron-dbbdddfd-6ldcl" Mar 16 16:05:32 crc kubenswrapper[5120]: I0316 16:05:32.447716 5120 generic.go:358] "Generic (PLEG): container finished" podID="18b99335-9d0e-44a5-a6d6-a8ffe17ccd05" containerID="27fb86bc3c9d5fdfd0c0e9eb50972c65626d46f8fbbde0a14f84fbb04c64e79c" exitCode=0 Mar 16 16:05:32 crc kubenswrapper[5120]: I0316 16:05:32.447815 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"18b99335-9d0e-44a5-a6d6-a8ffe17ccd05","Type":"ContainerDied","Data":"27fb86bc3c9d5fdfd0c0e9eb50972c65626d46f8fbbde0a14f84fbb04c64e79c"} Mar 16 16:05:32 crc kubenswrapper[5120]: I0316 16:05:32.467819 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-dbbdddfd-6ldcl" Mar 16 16:05:32 crc kubenswrapper[5120]: I0316 16:05:32.596217 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-dbbdddfd-6ldcl"] Mar 16 16:05:32 crc kubenswrapper[5120]: I0316 16:05:32.634409 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-58cc99cf94-2svpf"] Mar 16 16:05:32 crc kubenswrapper[5120]: I0316 16:05:32.646989 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-58cc99cf94-2svpf" Mar 16 16:05:32 crc kubenswrapper[5120]: I0316 16:05:32.657992 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-58cc99cf94-2svpf"] Mar 16 16:05:32 crc kubenswrapper[5120]: I0316 16:05:32.680092 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="71c0d423-34cc-44f0-8fb5-7671a0f41d57" path="/var/lib/kubelet/pods/71c0d423-34cc-44f0-8fb5-7671a0f41d57/volumes" Mar 16 16:05:32 crc kubenswrapper[5120]: I0316 16:05:32.773827 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pg4wn\" (UniqueName: \"kubernetes.io/projected/2e1be97f-dece-41af-b53b-e6d37affb572-kube-api-access-pg4wn\") pod \"neutron-58cc99cf94-2svpf\" (UID: \"2e1be97f-dece-41af-b53b-e6d37affb572\") " pod="openstack-kuttl-tests/neutron-58cc99cf94-2svpf" Mar 16 16:05:32 crc kubenswrapper[5120]: I0316 16:05:32.773893 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/2e1be97f-dece-41af-b53b-e6d37affb572-httpd-config\") pod \"neutron-58cc99cf94-2svpf\" (UID: \"2e1be97f-dece-41af-b53b-e6d37affb572\") " pod="openstack-kuttl-tests/neutron-58cc99cf94-2svpf" Mar 16 16:05:32 crc kubenswrapper[5120]: I0316 16:05:32.773913 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2e1be97f-dece-41af-b53b-e6d37affb572-combined-ca-bundle\") pod \"neutron-58cc99cf94-2svpf\" (UID: \"2e1be97f-dece-41af-b53b-e6d37affb572\") " pod="openstack-kuttl-tests/neutron-58cc99cf94-2svpf" Mar 16 16:05:32 crc kubenswrapper[5120]: I0316 16:05:32.775546 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/2e1be97f-dece-41af-b53b-e6d37affb572-ovndb-tls-certs\") pod \"neutron-58cc99cf94-2svpf\" (UID: \"2e1be97f-dece-41af-b53b-e6d37affb572\") " pod="openstack-kuttl-tests/neutron-58cc99cf94-2svpf" Mar 16 16:05:32 crc kubenswrapper[5120]: I0316 16:05:32.775684 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/2e1be97f-dece-41af-b53b-e6d37affb572-public-tls-certs\") pod \"neutron-58cc99cf94-2svpf\" (UID: \"2e1be97f-dece-41af-b53b-e6d37affb572\") " pod="openstack-kuttl-tests/neutron-58cc99cf94-2svpf" Mar 16 16:05:32 crc kubenswrapper[5120]: I0316 16:05:32.775745 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2e1be97f-dece-41af-b53b-e6d37affb572-config\") pod \"neutron-58cc99cf94-2svpf\" (UID: \"2e1be97f-dece-41af-b53b-e6d37affb572\") " pod="openstack-kuttl-tests/neutron-58cc99cf94-2svpf" Mar 16 16:05:32 crc kubenswrapper[5120]: I0316 16:05:32.775783 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/2e1be97f-dece-41af-b53b-e6d37affb572-internal-tls-certs\") pod \"neutron-58cc99cf94-2svpf\" (UID: \"2e1be97f-dece-41af-b53b-e6d37affb572\") " pod="openstack-kuttl-tests/neutron-58cc99cf94-2svpf" Mar 16 16:05:32 crc kubenswrapper[5120]: I0316 16:05:32.877364 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/2e1be97f-dece-41af-b53b-e6d37affb572-ovndb-tls-certs\") pod \"neutron-58cc99cf94-2svpf\" (UID: \"2e1be97f-dece-41af-b53b-e6d37affb572\") " pod="openstack-kuttl-tests/neutron-58cc99cf94-2svpf" Mar 16 16:05:32 crc kubenswrapper[5120]: I0316 16:05:32.877468 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/2e1be97f-dece-41af-b53b-e6d37affb572-public-tls-certs\") pod \"neutron-58cc99cf94-2svpf\" (UID: \"2e1be97f-dece-41af-b53b-e6d37affb572\") " pod="openstack-kuttl-tests/neutron-58cc99cf94-2svpf" Mar 16 16:05:32 crc kubenswrapper[5120]: I0316 16:05:32.877503 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2e1be97f-dece-41af-b53b-e6d37affb572-config\") pod \"neutron-58cc99cf94-2svpf\" (UID: \"2e1be97f-dece-41af-b53b-e6d37affb572\") " pod="openstack-kuttl-tests/neutron-58cc99cf94-2svpf" Mar 16 16:05:32 crc kubenswrapper[5120]: I0316 16:05:32.878330 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/2e1be97f-dece-41af-b53b-e6d37affb572-internal-tls-certs\") pod \"neutron-58cc99cf94-2svpf\" (UID: \"2e1be97f-dece-41af-b53b-e6d37affb572\") " pod="openstack-kuttl-tests/neutron-58cc99cf94-2svpf" Mar 16 16:05:32 crc kubenswrapper[5120]: I0316 16:05:32.878464 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pg4wn\" (UniqueName: \"kubernetes.io/projected/2e1be97f-dece-41af-b53b-e6d37affb572-kube-api-access-pg4wn\") pod \"neutron-58cc99cf94-2svpf\" (UID: \"2e1be97f-dece-41af-b53b-e6d37affb572\") " pod="openstack-kuttl-tests/neutron-58cc99cf94-2svpf" Mar 16 16:05:32 crc kubenswrapper[5120]: I0316 16:05:32.878508 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/2e1be97f-dece-41af-b53b-e6d37affb572-httpd-config\") pod \"neutron-58cc99cf94-2svpf\" (UID: \"2e1be97f-dece-41af-b53b-e6d37affb572\") " pod="openstack-kuttl-tests/neutron-58cc99cf94-2svpf" Mar 16 16:05:32 crc kubenswrapper[5120]: I0316 16:05:32.878528 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2e1be97f-dece-41af-b53b-e6d37affb572-combined-ca-bundle\") pod \"neutron-58cc99cf94-2svpf\" (UID: \"2e1be97f-dece-41af-b53b-e6d37affb572\") " pod="openstack-kuttl-tests/neutron-58cc99cf94-2svpf" Mar 16 16:05:32 crc kubenswrapper[5120]: I0316 16:05:32.887738 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/2e1be97f-dece-41af-b53b-e6d37affb572-config\") pod \"neutron-58cc99cf94-2svpf\" (UID: \"2e1be97f-dece-41af-b53b-e6d37affb572\") " pod="openstack-kuttl-tests/neutron-58cc99cf94-2svpf" Mar 16 16:05:32 crc kubenswrapper[5120]: I0316 16:05:32.893441 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/2e1be97f-dece-41af-b53b-e6d37affb572-internal-tls-certs\") pod \"neutron-58cc99cf94-2svpf\" (UID: \"2e1be97f-dece-41af-b53b-e6d37affb572\") " pod="openstack-kuttl-tests/neutron-58cc99cf94-2svpf" Mar 16 16:05:32 crc kubenswrapper[5120]: I0316 16:05:32.898454 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/2e1be97f-dece-41af-b53b-e6d37affb572-public-tls-certs\") pod \"neutron-58cc99cf94-2svpf\" (UID: \"2e1be97f-dece-41af-b53b-e6d37affb572\") " pod="openstack-kuttl-tests/neutron-58cc99cf94-2svpf" Mar 16 16:05:32 crc kubenswrapper[5120]: I0316 16:05:32.898545 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/2e1be97f-dece-41af-b53b-e6d37affb572-ovndb-tls-certs\") pod \"neutron-58cc99cf94-2svpf\" (UID: \"2e1be97f-dece-41af-b53b-e6d37affb572\") " pod="openstack-kuttl-tests/neutron-58cc99cf94-2svpf" Mar 16 16:05:32 crc kubenswrapper[5120]: I0316 16:05:32.901592 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2e1be97f-dece-41af-b53b-e6d37affb572-combined-ca-bundle\") pod \"neutron-58cc99cf94-2svpf\" (UID: \"2e1be97f-dece-41af-b53b-e6d37affb572\") " pod="openstack-kuttl-tests/neutron-58cc99cf94-2svpf" Mar 16 16:05:32 crc kubenswrapper[5120]: I0316 16:05:32.908524 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pg4wn\" (UniqueName: \"kubernetes.io/projected/2e1be97f-dece-41af-b53b-e6d37affb572-kube-api-access-pg4wn\") pod \"neutron-58cc99cf94-2svpf\" (UID: \"2e1be97f-dece-41af-b53b-e6d37affb572\") " pod="openstack-kuttl-tests/neutron-58cc99cf94-2svpf" Mar 16 16:05:32 crc kubenswrapper[5120]: I0316 16:05:32.911865 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/2e1be97f-dece-41af-b53b-e6d37affb572-httpd-config\") pod \"neutron-58cc99cf94-2svpf\" (UID: \"2e1be97f-dece-41af-b53b-e6d37affb572\") " pod="openstack-kuttl-tests/neutron-58cc99cf94-2svpf" Mar 16 16:05:32 crc kubenswrapper[5120]: I0316 16:05:32.961363 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-dbbdddfd-6ldcl"] Mar 16 16:05:32 crc kubenswrapper[5120]: I0316 16:05:32.971910 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-58cc99cf94-2svpf" Mar 16 16:05:33 crc kubenswrapper[5120]: I0316 16:05:33.397263 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:05:33 crc kubenswrapper[5120]: I0316 16:05:33.477798 5120 generic.go:358] "Generic (PLEG): container finished" podID="ff5d8cf4-cd75-4107-8fc7-a462d339bab3" containerID="05d7e14d0e1d726d667bd4e4e2d362e0cadb24937d6a68b8f3ad0552047dcc74" exitCode=0 Mar 16 16:05:33 crc kubenswrapper[5120]: I0316 16:05:33.478127 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"ff5d8cf4-cd75-4107-8fc7-a462d339bab3","Type":"ContainerDied","Data":"05d7e14d0e1d726d667bd4e4e2d362e0cadb24937d6a68b8f3ad0552047dcc74"} Mar 16 16:05:33 crc kubenswrapper[5120]: I0316 16:05:33.480502 5120 generic.go:358] "Generic (PLEG): container finished" podID="f6934b6a-f36d-400a-bb39-d0cdaf66cbae" containerID="b26345e7420937f51f9ee691179115e14fd242221f59cbc6399198aa3bdde911" exitCode=0 Mar 16 16:05:33 crc kubenswrapper[5120]: I0316 16:05:33.480628 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"f6934b6a-f36d-400a-bb39-d0cdaf66cbae","Type":"ContainerDied","Data":"b26345e7420937f51f9ee691179115e14fd242221f59cbc6399198aa3bdde911"} Mar 16 16:05:33 crc kubenswrapper[5120]: I0316 16:05:33.480672 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"f6934b6a-f36d-400a-bb39-d0cdaf66cbae","Type":"ContainerDied","Data":"52e056ae0a4cd3cf15f31b2b02f78a633b60158afa9f8e7da2dbc545cc1f3e58"} Mar 16 16:05:33 crc kubenswrapper[5120]: I0316 16:05:33.480684 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:05:33 crc kubenswrapper[5120]: I0316 16:05:33.480690 5120 scope.go:117] "RemoveContainer" containerID="b26345e7420937f51f9ee691179115e14fd242221f59cbc6399198aa3bdde911" Mar 16 16:05:33 crc kubenswrapper[5120]: I0316 16:05:33.496317 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-dbbdddfd-6ldcl" event={"ID":"44247dca-a1cf-42bd-8b32-51322d84cde0","Type":"ContainerStarted","Data":"3dd06cef3ecd0e7da8edb4a40afddee18218c601406d8cd6838f33a4fb58f9a6"} Mar 16 16:05:33 crc kubenswrapper[5120]: I0316 16:05:33.496367 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-dbbdddfd-6ldcl" event={"ID":"44247dca-a1cf-42bd-8b32-51322d84cde0","Type":"ContainerStarted","Data":"837b7a514fe2ecac0a17c6412f1877c676ed660ca56065980c9a32de580d5a27"} Mar 16 16:05:33 crc kubenswrapper[5120]: I0316 16:05:33.564022 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f6934b6a-f36d-400a-bb39-d0cdaf66cbae-public-tls-certs\") pod \"f6934b6a-f36d-400a-bb39-d0cdaf66cbae\" (UID: \"f6934b6a-f36d-400a-bb39-d0cdaf66cbae\") " Mar 16 16:05:33 crc kubenswrapper[5120]: I0316 16:05:33.564158 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"f6934b6a-f36d-400a-bb39-d0cdaf66cbae\" (UID: \"f6934b6a-f36d-400a-bb39-d0cdaf66cbae\") " Mar 16 16:05:33 crc kubenswrapper[5120]: I0316 16:05:33.564210 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/f6934b6a-f36d-400a-bb39-d0cdaf66cbae-httpd-run\") pod \"f6934b6a-f36d-400a-bb39-d0cdaf66cbae\" (UID: \"f6934b6a-f36d-400a-bb39-d0cdaf66cbae\") " Mar 16 16:05:33 crc kubenswrapper[5120]: I0316 16:05:33.564238 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f6934b6a-f36d-400a-bb39-d0cdaf66cbae-config-data\") pod \"f6934b6a-f36d-400a-bb39-d0cdaf66cbae\" (UID: \"f6934b6a-f36d-400a-bb39-d0cdaf66cbae\") " Mar 16 16:05:33 crc kubenswrapper[5120]: I0316 16:05:33.564330 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f6934b6a-f36d-400a-bb39-d0cdaf66cbae-logs\") pod \"f6934b6a-f36d-400a-bb39-d0cdaf66cbae\" (UID: \"f6934b6a-f36d-400a-bb39-d0cdaf66cbae\") " Mar 16 16:05:33 crc kubenswrapper[5120]: I0316 16:05:33.564377 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f6934b6a-f36d-400a-bb39-d0cdaf66cbae-scripts\") pod \"f6934b6a-f36d-400a-bb39-d0cdaf66cbae\" (UID: \"f6934b6a-f36d-400a-bb39-d0cdaf66cbae\") " Mar 16 16:05:33 crc kubenswrapper[5120]: I0316 16:05:33.564487 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qpf8z\" (UniqueName: \"kubernetes.io/projected/f6934b6a-f36d-400a-bb39-d0cdaf66cbae-kube-api-access-qpf8z\") pod \"f6934b6a-f36d-400a-bb39-d0cdaf66cbae\" (UID: \"f6934b6a-f36d-400a-bb39-d0cdaf66cbae\") " Mar 16 16:05:33 crc kubenswrapper[5120]: I0316 16:05:33.564588 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f6934b6a-f36d-400a-bb39-d0cdaf66cbae-combined-ca-bundle\") pod \"f6934b6a-f36d-400a-bb39-d0cdaf66cbae\" (UID: \"f6934b6a-f36d-400a-bb39-d0cdaf66cbae\") " Mar 16 16:05:33 crc kubenswrapper[5120]: I0316 16:05:33.565716 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6934b6a-f36d-400a-bb39-d0cdaf66cbae-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "f6934b6a-f36d-400a-bb39-d0cdaf66cbae" (UID: "f6934b6a-f36d-400a-bb39-d0cdaf66cbae"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:05:33 crc kubenswrapper[5120]: I0316 16:05:33.566292 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6934b6a-f36d-400a-bb39-d0cdaf66cbae-logs" (OuterVolumeSpecName: "logs") pod "f6934b6a-f36d-400a-bb39-d0cdaf66cbae" (UID: "f6934b6a-f36d-400a-bb39-d0cdaf66cbae"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:05:33 crc kubenswrapper[5120]: I0316 16:05:33.567552 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/f6934b6a-f36d-400a-bb39-d0cdaf66cbae-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:33 crc kubenswrapper[5120]: I0316 16:05:33.567598 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f6934b6a-f36d-400a-bb39-d0cdaf66cbae-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:33 crc kubenswrapper[5120]: I0316 16:05:33.570439 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage13-crc" (OuterVolumeSpecName: "glance") pod "f6934b6a-f36d-400a-bb39-d0cdaf66cbae" (UID: "f6934b6a-f36d-400a-bb39-d0cdaf66cbae"). InnerVolumeSpecName "local-storage13-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:05:33 crc kubenswrapper[5120]: I0316 16:05:33.570438 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f6934b6a-f36d-400a-bb39-d0cdaf66cbae-scripts" (OuterVolumeSpecName: "scripts") pod "f6934b6a-f36d-400a-bb39-d0cdaf66cbae" (UID: "f6934b6a-f36d-400a-bb39-d0cdaf66cbae"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:33 crc kubenswrapper[5120]: I0316 16:05:33.572765 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6934b6a-f36d-400a-bb39-d0cdaf66cbae-kube-api-access-qpf8z" (OuterVolumeSpecName: "kube-api-access-qpf8z") pod "f6934b6a-f36d-400a-bb39-d0cdaf66cbae" (UID: "f6934b6a-f36d-400a-bb39-d0cdaf66cbae"). InnerVolumeSpecName "kube-api-access-qpf8z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:05:33 crc kubenswrapper[5120]: I0316 16:05:33.573273 5120 scope.go:117] "RemoveContainer" containerID="3a0eac62028b566de718f70c8dc16d3391066a9f4380be71fc32a594a075594a" Mar 16 16:05:33 crc kubenswrapper[5120]: I0316 16:05:33.594193 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f6934b6a-f36d-400a-bb39-d0cdaf66cbae-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f6934b6a-f36d-400a-bb39-d0cdaf66cbae" (UID: "f6934b6a-f36d-400a-bb39-d0cdaf66cbae"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:33 crc kubenswrapper[5120]: I0316 16:05:33.628658 5120 scope.go:117] "RemoveContainer" containerID="b26345e7420937f51f9ee691179115e14fd242221f59cbc6399198aa3bdde911" Mar 16 16:05:33 crc kubenswrapper[5120]: E0316 16:05:33.629161 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b26345e7420937f51f9ee691179115e14fd242221f59cbc6399198aa3bdde911\": container with ID starting with b26345e7420937f51f9ee691179115e14fd242221f59cbc6399198aa3bdde911 not found: ID does not exist" containerID="b26345e7420937f51f9ee691179115e14fd242221f59cbc6399198aa3bdde911" Mar 16 16:05:33 crc kubenswrapper[5120]: I0316 16:05:33.629191 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b26345e7420937f51f9ee691179115e14fd242221f59cbc6399198aa3bdde911"} err="failed to get container status \"b26345e7420937f51f9ee691179115e14fd242221f59cbc6399198aa3bdde911\": rpc error: code = NotFound desc = could not find container \"b26345e7420937f51f9ee691179115e14fd242221f59cbc6399198aa3bdde911\": container with ID starting with b26345e7420937f51f9ee691179115e14fd242221f59cbc6399198aa3bdde911 not found: ID does not exist" Mar 16 16:05:33 crc kubenswrapper[5120]: I0316 16:05:33.629214 5120 scope.go:117] "RemoveContainer" containerID="3a0eac62028b566de718f70c8dc16d3391066a9f4380be71fc32a594a075594a" Mar 16 16:05:33 crc kubenswrapper[5120]: E0316 16:05:33.629559 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a0eac62028b566de718f70c8dc16d3391066a9f4380be71fc32a594a075594a\": container with ID starting with 3a0eac62028b566de718f70c8dc16d3391066a9f4380be71fc32a594a075594a not found: ID does not exist" containerID="3a0eac62028b566de718f70c8dc16d3391066a9f4380be71fc32a594a075594a" Mar 16 16:05:33 crc kubenswrapper[5120]: I0316 16:05:33.629577 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a0eac62028b566de718f70c8dc16d3391066a9f4380be71fc32a594a075594a"} err="failed to get container status \"3a0eac62028b566de718f70c8dc16d3391066a9f4380be71fc32a594a075594a\": rpc error: code = NotFound desc = could not find container \"3a0eac62028b566de718f70c8dc16d3391066a9f4380be71fc32a594a075594a\": container with ID starting with 3a0eac62028b566de718f70c8dc16d3391066a9f4380be71fc32a594a075594a not found: ID does not exist" Mar 16 16:05:33 crc kubenswrapper[5120]: I0316 16:05:33.634460 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f6934b6a-f36d-400a-bb39-d0cdaf66cbae-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "f6934b6a-f36d-400a-bb39-d0cdaf66cbae" (UID: "f6934b6a-f36d-400a-bb39-d0cdaf66cbae"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:33 crc kubenswrapper[5120]: I0316 16:05:33.642708 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:05:33 crc kubenswrapper[5120]: I0316 16:05:33.645197 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f6934b6a-f36d-400a-bb39-d0cdaf66cbae-config-data" (OuterVolumeSpecName: "config-data") pod "f6934b6a-f36d-400a-bb39-d0cdaf66cbae" (UID: "f6934b6a-f36d-400a-bb39-d0cdaf66cbae"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:33 crc kubenswrapper[5120]: I0316 16:05:33.672278 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f6934b6a-f36d-400a-bb39-d0cdaf66cbae-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:33 crc kubenswrapper[5120]: I0316 16:05:33.672313 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f6934b6a-f36d-400a-bb39-d0cdaf66cbae-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:33 crc kubenswrapper[5120]: I0316 16:05:33.672337 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") on node \"crc\" " Mar 16 16:05:33 crc kubenswrapper[5120]: I0316 16:05:33.672346 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f6934b6a-f36d-400a-bb39-d0cdaf66cbae-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:33 crc kubenswrapper[5120]: I0316 16:05:33.672355 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f6934b6a-f36d-400a-bb39-d0cdaf66cbae-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:33 crc kubenswrapper[5120]: I0316 16:05:33.672366 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qpf8z\" (UniqueName: \"kubernetes.io/projected/f6934b6a-f36d-400a-bb39-d0cdaf66cbae-kube-api-access-qpf8z\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:33 crc kubenswrapper[5120]: I0316 16:05:33.707073 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage13-crc" (UniqueName: "kubernetes.io/local-volume/local-storage13-crc") on node "crc" Mar 16 16:05:33 crc kubenswrapper[5120]: I0316 16:05:33.782057 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-58cc99cf94-2svpf"] Mar 16 16:05:33 crc kubenswrapper[5120]: I0316 16:05:33.783143 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ff5d8cf4-cd75-4107-8fc7-a462d339bab3-config-data\") pod \"ff5d8cf4-cd75-4107-8fc7-a462d339bab3\" (UID: \"ff5d8cf4-cd75-4107-8fc7-a462d339bab3\") " Mar 16 16:05:33 crc kubenswrapper[5120]: I0316 16:05:33.783176 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/ff5d8cf4-cd75-4107-8fc7-a462d339bab3-httpd-run\") pod \"ff5d8cf4-cd75-4107-8fc7-a462d339bab3\" (UID: \"ff5d8cf4-cd75-4107-8fc7-a462d339bab3\") " Mar 16 16:05:33 crc kubenswrapper[5120]: I0316 16:05:33.783212 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/ff5d8cf4-cd75-4107-8fc7-a462d339bab3-internal-tls-certs\") pod \"ff5d8cf4-cd75-4107-8fc7-a462d339bab3\" (UID: \"ff5d8cf4-cd75-4107-8fc7-a462d339bab3\") " Mar 16 16:05:33 crc kubenswrapper[5120]: I0316 16:05:33.783235 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ff5d8cf4-cd75-4107-8fc7-a462d339bab3-scripts\") pod \"ff5d8cf4-cd75-4107-8fc7-a462d339bab3\" (UID: \"ff5d8cf4-cd75-4107-8fc7-a462d339bab3\") " Mar 16 16:05:33 crc kubenswrapper[5120]: I0316 16:05:33.783359 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kcjq7\" (UniqueName: \"kubernetes.io/projected/ff5d8cf4-cd75-4107-8fc7-a462d339bab3-kube-api-access-kcjq7\") pod \"ff5d8cf4-cd75-4107-8fc7-a462d339bab3\" (UID: \"ff5d8cf4-cd75-4107-8fc7-a462d339bab3\") " Mar 16 16:05:33 crc kubenswrapper[5120]: I0316 16:05:33.783392 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"ff5d8cf4-cd75-4107-8fc7-a462d339bab3\" (UID: \"ff5d8cf4-cd75-4107-8fc7-a462d339bab3\") " Mar 16 16:05:33 crc kubenswrapper[5120]: I0316 16:05:33.783438 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ff5d8cf4-cd75-4107-8fc7-a462d339bab3-combined-ca-bundle\") pod \"ff5d8cf4-cd75-4107-8fc7-a462d339bab3\" (UID: \"ff5d8cf4-cd75-4107-8fc7-a462d339bab3\") " Mar 16 16:05:33 crc kubenswrapper[5120]: I0316 16:05:33.783566 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ff5d8cf4-cd75-4107-8fc7-a462d339bab3-logs\") pod \"ff5d8cf4-cd75-4107-8fc7-a462d339bab3\" (UID: \"ff5d8cf4-cd75-4107-8fc7-a462d339bab3\") " Mar 16 16:05:33 crc kubenswrapper[5120]: I0316 16:05:33.784046 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:33 crc kubenswrapper[5120]: I0316 16:05:33.784980 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff5d8cf4-cd75-4107-8fc7-a462d339bab3-logs" (OuterVolumeSpecName: "logs") pod "ff5d8cf4-cd75-4107-8fc7-a462d339bab3" (UID: "ff5d8cf4-cd75-4107-8fc7-a462d339bab3"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:05:33 crc kubenswrapper[5120]: I0316 16:05:33.785449 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff5d8cf4-cd75-4107-8fc7-a462d339bab3-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "ff5d8cf4-cd75-4107-8fc7-a462d339bab3" (UID: "ff5d8cf4-cd75-4107-8fc7-a462d339bab3"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:05:33 crc kubenswrapper[5120]: I0316 16:05:33.788120 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage09-crc" (OuterVolumeSpecName: "glance") pod "ff5d8cf4-cd75-4107-8fc7-a462d339bab3" (UID: "ff5d8cf4-cd75-4107-8fc7-a462d339bab3"). InnerVolumeSpecName "local-storage09-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:05:33 crc kubenswrapper[5120]: I0316 16:05:33.788187 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff5d8cf4-cd75-4107-8fc7-a462d339bab3-kube-api-access-kcjq7" (OuterVolumeSpecName: "kube-api-access-kcjq7") pod "ff5d8cf4-cd75-4107-8fc7-a462d339bab3" (UID: "ff5d8cf4-cd75-4107-8fc7-a462d339bab3"). InnerVolumeSpecName "kube-api-access-kcjq7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:05:33 crc kubenswrapper[5120]: I0316 16:05:33.788577 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff5d8cf4-cd75-4107-8fc7-a462d339bab3-scripts" (OuterVolumeSpecName: "scripts") pod "ff5d8cf4-cd75-4107-8fc7-a462d339bab3" (UID: "ff5d8cf4-cd75-4107-8fc7-a462d339bab3"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:33 crc kubenswrapper[5120]: I0316 16:05:33.824673 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:05:33 crc kubenswrapper[5120]: I0316 16:05:33.830924 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff5d8cf4-cd75-4107-8fc7-a462d339bab3-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ff5d8cf4-cd75-4107-8fc7-a462d339bab3" (UID: "ff5d8cf4-cd75-4107-8fc7-a462d339bab3"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:33 crc kubenswrapper[5120]: I0316 16:05:33.845160 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:05:33 crc kubenswrapper[5120]: I0316 16:05:33.852529 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff5d8cf4-cd75-4107-8fc7-a462d339bab3-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "ff5d8cf4-cd75-4107-8fc7-a462d339bab3" (UID: "ff5d8cf4-cd75-4107-8fc7-a462d339bab3"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:33 crc kubenswrapper[5120]: I0316 16:05:33.855859 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:05:33 crc kubenswrapper[5120]: I0316 16:05:33.856889 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff5d8cf4-cd75-4107-8fc7-a462d339bab3" containerName="glance-httpd" Mar 16 16:05:33 crc kubenswrapper[5120]: I0316 16:05:33.856905 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff5d8cf4-cd75-4107-8fc7-a462d339bab3" containerName="glance-httpd" Mar 16 16:05:33 crc kubenswrapper[5120]: I0316 16:05:33.856942 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6934b6a-f36d-400a-bb39-d0cdaf66cbae" containerName="glance-httpd" Mar 16 16:05:33 crc kubenswrapper[5120]: I0316 16:05:33.856949 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6934b6a-f36d-400a-bb39-d0cdaf66cbae" containerName="glance-httpd" Mar 16 16:05:33 crc kubenswrapper[5120]: I0316 16:05:33.856961 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6934b6a-f36d-400a-bb39-d0cdaf66cbae" containerName="glance-log" Mar 16 16:05:33 crc kubenswrapper[5120]: I0316 16:05:33.856967 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6934b6a-f36d-400a-bb39-d0cdaf66cbae" containerName="glance-log" Mar 16 16:05:33 crc kubenswrapper[5120]: I0316 16:05:33.857007 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff5d8cf4-cd75-4107-8fc7-a462d339bab3" containerName="glance-log" Mar 16 16:05:33 crc kubenswrapper[5120]: I0316 16:05:33.857013 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff5d8cf4-cd75-4107-8fc7-a462d339bab3" containerName="glance-log" Mar 16 16:05:33 crc kubenswrapper[5120]: I0316 16:05:33.857176 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ff5d8cf4-cd75-4107-8fc7-a462d339bab3" containerName="glance-log" Mar 16 16:05:33 crc kubenswrapper[5120]: I0316 16:05:33.857189 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f6934b6a-f36d-400a-bb39-d0cdaf66cbae" containerName="glance-httpd" Mar 16 16:05:33 crc kubenswrapper[5120]: I0316 16:05:33.857201 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ff5d8cf4-cd75-4107-8fc7-a462d339bab3" containerName="glance-httpd" Mar 16 16:05:33 crc kubenswrapper[5120]: I0316 16:05:33.857209 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f6934b6a-f36d-400a-bb39-d0cdaf66cbae" containerName="glance-log" Mar 16 16:05:33 crc kubenswrapper[5120]: I0316 16:05:33.862018 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:05:33 crc kubenswrapper[5120]: I0316 16:05:33.868298 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-external-config-data\"" Mar 16 16:05:33 crc kubenswrapper[5120]: I0316 16:05:33.868883 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-public-svc\"" Mar 16 16:05:33 crc kubenswrapper[5120]: I0316 16:05:33.870204 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:05:33 crc kubenswrapper[5120]: I0316 16:05:33.874434 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff5d8cf4-cd75-4107-8fc7-a462d339bab3-config-data" (OuterVolumeSpecName: "config-data") pod "ff5d8cf4-cd75-4107-8fc7-a462d339bab3" (UID: "ff5d8cf4-cd75-4107-8fc7-a462d339bab3"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:33 crc kubenswrapper[5120]: I0316 16:05:33.885584 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ff5d8cf4-cd75-4107-8fc7-a462d339bab3-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:33 crc kubenswrapper[5120]: I0316 16:05:33.885624 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/ff5d8cf4-cd75-4107-8fc7-a462d339bab3-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:33 crc kubenswrapper[5120]: I0316 16:05:33.885634 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/ff5d8cf4-cd75-4107-8fc7-a462d339bab3-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:33 crc kubenswrapper[5120]: I0316 16:05:33.885642 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ff5d8cf4-cd75-4107-8fc7-a462d339bab3-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:33 crc kubenswrapper[5120]: I0316 16:05:33.885651 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kcjq7\" (UniqueName: \"kubernetes.io/projected/ff5d8cf4-cd75-4107-8fc7-a462d339bab3-kube-api-access-kcjq7\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:33 crc kubenswrapper[5120]: I0316 16:05:33.885694 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") on node \"crc\" " Mar 16 16:05:33 crc kubenswrapper[5120]: I0316 16:05:33.885703 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ff5d8cf4-cd75-4107-8fc7-a462d339bab3-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:33 crc kubenswrapper[5120]: I0316 16:05:33.885711 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ff5d8cf4-cd75-4107-8fc7-a462d339bab3-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:33 crc kubenswrapper[5120]: I0316 16:05:33.908580 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage09-crc" (UniqueName: "kubernetes.io/local-volume/local-storage09-crc") on node "crc" Mar 16 16:05:33 crc kubenswrapper[5120]: I0316 16:05:33.987581 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"glance-default-external-api-0\" (UID: \"e21caabc-db04-4dca-af4d-fbbbbde012ef\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:05:33 crc kubenswrapper[5120]: I0316 16:05:33.987628 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e21caabc-db04-4dca-af4d-fbbbbde012ef-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"e21caabc-db04-4dca-af4d-fbbbbde012ef\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:05:33 crc kubenswrapper[5120]: I0316 16:05:33.987667 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/e21caabc-db04-4dca-af4d-fbbbbde012ef-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"e21caabc-db04-4dca-af4d-fbbbbde012ef\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:05:33 crc kubenswrapper[5120]: I0316 16:05:33.987720 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wt2mz\" (UniqueName: \"kubernetes.io/projected/e21caabc-db04-4dca-af4d-fbbbbde012ef-kube-api-access-wt2mz\") pod \"glance-default-external-api-0\" (UID: \"e21caabc-db04-4dca-af4d-fbbbbde012ef\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:05:33 crc kubenswrapper[5120]: I0316 16:05:33.988145 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e21caabc-db04-4dca-af4d-fbbbbde012ef-config-data\") pod \"glance-default-external-api-0\" (UID: \"e21caabc-db04-4dca-af4d-fbbbbde012ef\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:05:33 crc kubenswrapper[5120]: I0316 16:05:33.988278 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e21caabc-db04-4dca-af4d-fbbbbde012ef-scripts\") pod \"glance-default-external-api-0\" (UID: \"e21caabc-db04-4dca-af4d-fbbbbde012ef\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:05:33 crc kubenswrapper[5120]: I0316 16:05:33.988334 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e21caabc-db04-4dca-af4d-fbbbbde012ef-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"e21caabc-db04-4dca-af4d-fbbbbde012ef\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:05:33 crc kubenswrapper[5120]: I0316 16:05:33.988447 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e21caabc-db04-4dca-af4d-fbbbbde012ef-logs\") pod \"glance-default-external-api-0\" (UID: \"e21caabc-db04-4dca-af4d-fbbbbde012ef\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:05:33 crc kubenswrapper[5120]: I0316 16:05:33.988681 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:34 crc kubenswrapper[5120]: I0316 16:05:34.017505 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:05:34 crc kubenswrapper[5120]: I0316 16:05:34.018271 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="7f4e547e-06cd-459e-8e83-9dcbefd83ea4" containerName="nova-cell0-conductor-conductor" containerID="cri-o://6b412424eb716d2e42d4d9ed1e7e068784cfc2c036de57bc48a157cc13bb79ba" gracePeriod=30 Mar 16 16:05:34 crc kubenswrapper[5120]: I0316 16:05:34.065820 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:05:34 crc kubenswrapper[5120]: I0316 16:05:34.066096 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="3ebc6d87-1ea4-4702-b166-ba35f25972b6" containerName="nova-scheduler-scheduler" containerID="cri-o://eff80265be11a9f35bed980c90ec7b17787848134b0779846cf1cf326e03ffdf" gracePeriod=30 Mar 16 16:05:34 crc kubenswrapper[5120]: I0316 16:05:34.077209 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:05:34 crc kubenswrapper[5120]: I0316 16:05:34.077451 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podUID="33a720a8-2252-4a1c-a6e8-751a7f3e6871" containerName="nova-cell1-novncproxy-novncproxy" containerID="cri-o://cd5e946f1c4c585a2ad263c7a1ae9f67a7f05a0eb9cb2f7345ae0c0d71f40204" gracePeriod=30 Mar 16 16:05:34 crc kubenswrapper[5120]: I0316 16:05:34.087276 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:05:34 crc kubenswrapper[5120]: I0316 16:05:34.087519 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="bf01270c-6ae8-4c7f-aee3-42a125c155e4" containerName="nova-metadata-log" containerID="cri-o://7edc213d41fc38f7529c3978651267fea171acd33243384a105115f62973a9ef" gracePeriod=30 Mar 16 16:05:34 crc kubenswrapper[5120]: I0316 16:05:34.087964 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="bf01270c-6ae8-4c7f-aee3-42a125c155e4" containerName="nova-metadata-metadata" containerID="cri-o://f8852284e9aa7bf5f9936f8b164ef155d866b0509c8c5f804bc8c607e3bf3da3" gracePeriod=30 Mar 16 16:05:34 crc kubenswrapper[5120]: I0316 16:05:34.089968 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e21caabc-db04-4dca-af4d-fbbbbde012ef-config-data\") pod \"glance-default-external-api-0\" (UID: \"e21caabc-db04-4dca-af4d-fbbbbde012ef\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:05:34 crc kubenswrapper[5120]: I0316 16:05:34.090042 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e21caabc-db04-4dca-af4d-fbbbbde012ef-scripts\") pod \"glance-default-external-api-0\" (UID: \"e21caabc-db04-4dca-af4d-fbbbbde012ef\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:05:34 crc kubenswrapper[5120]: I0316 16:05:34.090072 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e21caabc-db04-4dca-af4d-fbbbbde012ef-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"e21caabc-db04-4dca-af4d-fbbbbde012ef\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:05:34 crc kubenswrapper[5120]: I0316 16:05:34.090098 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e21caabc-db04-4dca-af4d-fbbbbde012ef-logs\") pod \"glance-default-external-api-0\" (UID: \"e21caabc-db04-4dca-af4d-fbbbbde012ef\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:05:34 crc kubenswrapper[5120]: I0316 16:05:34.090154 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"glance-default-external-api-0\" (UID: \"e21caabc-db04-4dca-af4d-fbbbbde012ef\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:05:34 crc kubenswrapper[5120]: I0316 16:05:34.090181 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e21caabc-db04-4dca-af4d-fbbbbde012ef-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"e21caabc-db04-4dca-af4d-fbbbbde012ef\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:05:34 crc kubenswrapper[5120]: I0316 16:05:34.090220 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/e21caabc-db04-4dca-af4d-fbbbbde012ef-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"e21caabc-db04-4dca-af4d-fbbbbde012ef\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:05:34 crc kubenswrapper[5120]: I0316 16:05:34.090239 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wt2mz\" (UniqueName: \"kubernetes.io/projected/e21caabc-db04-4dca-af4d-fbbbbde012ef-kube-api-access-wt2mz\") pod \"glance-default-external-api-0\" (UID: \"e21caabc-db04-4dca-af4d-fbbbbde012ef\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:05:34 crc kubenswrapper[5120]: I0316 16:05:34.090661 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e21caabc-db04-4dca-af4d-fbbbbde012ef-logs\") pod \"glance-default-external-api-0\" (UID: \"e21caabc-db04-4dca-af4d-fbbbbde012ef\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:05:34 crc kubenswrapper[5120]: I0316 16:05:34.090739 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"glance-default-external-api-0\" (UID: \"e21caabc-db04-4dca-af4d-fbbbbde012ef\") device mount path \"/mnt/openstack/pv13\"" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:05:34 crc kubenswrapper[5120]: I0316 16:05:34.092332 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/e21caabc-db04-4dca-af4d-fbbbbde012ef-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"e21caabc-db04-4dca-af4d-fbbbbde012ef\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:05:34 crc kubenswrapper[5120]: I0316 16:05:34.094406 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e21caabc-db04-4dca-af4d-fbbbbde012ef-config-data\") pod \"glance-default-external-api-0\" (UID: \"e21caabc-db04-4dca-af4d-fbbbbde012ef\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:05:34 crc kubenswrapper[5120]: I0316 16:05:34.096290 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e21caabc-db04-4dca-af4d-fbbbbde012ef-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"e21caabc-db04-4dca-af4d-fbbbbde012ef\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:05:34 crc kubenswrapper[5120]: I0316 16:05:34.098416 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e21caabc-db04-4dca-af4d-fbbbbde012ef-scripts\") pod \"glance-default-external-api-0\" (UID: \"e21caabc-db04-4dca-af4d-fbbbbde012ef\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:05:34 crc kubenswrapper[5120]: I0316 16:05:34.106969 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e21caabc-db04-4dca-af4d-fbbbbde012ef-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"e21caabc-db04-4dca-af4d-fbbbbde012ef\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:05:34 crc kubenswrapper[5120]: I0316 16:05:34.112622 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wt2mz\" (UniqueName: \"kubernetes.io/projected/e21caabc-db04-4dca-af4d-fbbbbde012ef-kube-api-access-wt2mz\") pod \"glance-default-external-api-0\" (UID: \"e21caabc-db04-4dca-af4d-fbbbbde012ef\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:05:34 crc kubenswrapper[5120]: I0316 16:05:34.133337 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:05:34 crc kubenswrapper[5120]: I0316 16:05:34.133593 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="dbb06351-e6e7-4a49-a941-33b16fc6206d" containerName="nova-api-log" containerID="cri-o://f84dba618b96e6c2b2f2dee7b7aa69256626268516a21c1ba646c04d0f6801f1" gracePeriod=30 Mar 16 16:05:34 crc kubenswrapper[5120]: I0316 16:05:34.134069 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="dbb06351-e6e7-4a49-a941-33b16fc6206d" containerName="nova-api-api" containerID="cri-o://d6fc349f836b03a8939dfbaec2c3ff1e2196bfd6ed181b5867b764b47417dff0" gracePeriod=30 Mar 16 16:05:34 crc kubenswrapper[5120]: I0316 16:05:34.150314 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"glance-default-external-api-0\" (UID: \"e21caabc-db04-4dca-af4d-fbbbbde012ef\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:05:34 crc kubenswrapper[5120]: I0316 16:05:34.163453 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 16:05:34 crc kubenswrapper[5120]: I0316 16:05:34.163662 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="3b57a7de-40e8-484e-a2a9-55454c35ccd0" containerName="nova-cell1-conductor-conductor" containerID="cri-o://e5ac583ccc9724ef6e7100e99c0c22e3b118431b2c90d1bb0d71d736f0583622" gracePeriod=30 Mar 16 16:05:34 crc kubenswrapper[5120]: I0316 16:05:34.184940 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:05:34 crc kubenswrapper[5120]: I0316 16:05:34.326972 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/cinder-api-0" podUID="27074431-e87c-47e8-9d5a-97fc6edcb13a" containerName="cinder-api" probeResult="failure" output="Get \"https://10.217.1.133:8776/healthcheck\": read tcp 10.217.0.2:53524->10.217.1.133:8776: read: connection reset by peer" Mar 16 16:05:34 crc kubenswrapper[5120]: I0316 16:05:34.518410 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-dbbdddfd-6ldcl" event={"ID":"44247dca-a1cf-42bd-8b32-51322d84cde0","Type":"ContainerStarted","Data":"d2352e0088e9931dce600d12eb8ee3e08ae5cf21e193079916b0ea0c1de43d87"} Mar 16 16:05:34 crc kubenswrapper[5120]: I0316 16:05:34.518590 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-dbbdddfd-6ldcl" podUID="44247dca-a1cf-42bd-8b32-51322d84cde0" containerName="neutron-api" containerID="cri-o://3dd06cef3ecd0e7da8edb4a40afddee18218c601406d8cd6838f33a4fb58f9a6" gracePeriod=30 Mar 16 16:05:34 crc kubenswrapper[5120]: I0316 16:05:34.520097 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/neutron-dbbdddfd-6ldcl" Mar 16 16:05:34 crc kubenswrapper[5120]: I0316 16:05:34.520448 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-dbbdddfd-6ldcl" podUID="44247dca-a1cf-42bd-8b32-51322d84cde0" containerName="neutron-httpd" containerID="cri-o://d2352e0088e9931dce600d12eb8ee3e08ae5cf21e193079916b0ea0c1de43d87" gracePeriod=30 Mar 16 16:05:34 crc kubenswrapper[5120]: I0316 16:05:34.532849 5120 generic.go:358] "Generic (PLEG): container finished" podID="27074431-e87c-47e8-9d5a-97fc6edcb13a" containerID="a9c198c5fde8f1516c2c97543c1c28b24b2488b249ed434453537e04cab35001" exitCode=0 Mar 16 16:05:34 crc kubenswrapper[5120]: I0316 16:05:34.533057 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"27074431-e87c-47e8-9d5a-97fc6edcb13a","Type":"ContainerDied","Data":"a9c198c5fde8f1516c2c97543c1c28b24b2488b249ed434453537e04cab35001"} Mar 16 16:05:34 crc kubenswrapper[5120]: I0316 16:05:34.538310 5120 generic.go:358] "Generic (PLEG): container finished" podID="bf01270c-6ae8-4c7f-aee3-42a125c155e4" containerID="7edc213d41fc38f7529c3978651267fea171acd33243384a105115f62973a9ef" exitCode=143 Mar 16 16:05:34 crc kubenswrapper[5120]: I0316 16:05:34.538400 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"bf01270c-6ae8-4c7f-aee3-42a125c155e4","Type":"ContainerDied","Data":"7edc213d41fc38f7529c3978651267fea171acd33243384a105115f62973a9ef"} Mar 16 16:05:34 crc kubenswrapper[5120]: I0316 16:05:34.550908 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-dbbdddfd-6ldcl" podStartSLOduration=2.550888252 podStartE2EDuration="2.550888252s" podCreationTimestamp="2026-03-16 16:05:32 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:05:34.544858248 +0000 UTC m=+2036.698789905" watchObservedRunningTime="2026-03-16 16:05:34.550888252 +0000 UTC m=+2036.704819909" Mar 16 16:05:34 crc kubenswrapper[5120]: I0316 16:05:34.554331 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:05:34 crc kubenswrapper[5120]: I0316 16:05:34.557850 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"ff5d8cf4-cd75-4107-8fc7-a462d339bab3","Type":"ContainerDied","Data":"2ac1ab541c81fa76a3504173676fda756218ad9a1233f87d100bea4607b006d3"} Mar 16 16:05:34 crc kubenswrapper[5120]: I0316 16:05:34.557920 5120 scope.go:117] "RemoveContainer" containerID="05d7e14d0e1d726d667bd4e4e2d362e0cadb24937d6a68b8f3ad0552047dcc74" Mar 16 16:05:34 crc kubenswrapper[5120]: E0316 16:05:34.562479 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="6b412424eb716d2e42d4d9ed1e7e068784cfc2c036de57bc48a157cc13bb79ba" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:05:34 crc kubenswrapper[5120]: E0316 16:05:34.569185 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="6b412424eb716d2e42d4d9ed1e7e068784cfc2c036de57bc48a157cc13bb79ba" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:05:34 crc kubenswrapper[5120]: I0316 16:05:34.575928 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-58cc99cf94-2svpf" event={"ID":"2e1be97f-dece-41af-b53b-e6d37affb572","Type":"ContainerStarted","Data":"dab79283d9387a520a903f7176e97d9f3c4925818be8f94fcabfa4403183b00d"} Mar 16 16:05:34 crc kubenswrapper[5120]: I0316 16:05:34.576074 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-58cc99cf94-2svpf" event={"ID":"2e1be97f-dece-41af-b53b-e6d37affb572","Type":"ContainerStarted","Data":"f5f1335640dfd2cdc323b6f629fe282cb7bc92486d51adb3bc351687fdacd823"} Mar 16 16:05:34 crc kubenswrapper[5120]: I0316 16:05:34.576165 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-58cc99cf94-2svpf" event={"ID":"2e1be97f-dece-41af-b53b-e6d37affb572","Type":"ContainerStarted","Data":"b23da404c4efb2d6f0a2bf86a1760b4b889941143668e973bb351c85d9482af9"} Mar 16 16:05:34 crc kubenswrapper[5120]: I0316 16:05:34.577491 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/neutron-58cc99cf94-2svpf" Mar 16 16:05:34 crc kubenswrapper[5120]: E0316 16:05:34.580022 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="6b412424eb716d2e42d4d9ed1e7e068784cfc2c036de57bc48a157cc13bb79ba" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:05:34 crc kubenswrapper[5120]: E0316 16:05:34.580084 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="7f4e547e-06cd-459e-8e83-9dcbefd83ea4" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 16:05:34 crc kubenswrapper[5120]: I0316 16:05:34.584898 5120 generic.go:358] "Generic (PLEG): container finished" podID="dbb06351-e6e7-4a49-a941-33b16fc6206d" containerID="f84dba618b96e6c2b2f2dee7b7aa69256626268516a21c1ba646c04d0f6801f1" exitCode=143 Mar 16 16:05:34 crc kubenswrapper[5120]: I0316 16:05:34.585016 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"dbb06351-e6e7-4a49-a941-33b16fc6206d","Type":"ContainerDied","Data":"f84dba618b96e6c2b2f2dee7b7aa69256626268516a21c1ba646c04d0f6801f1"} Mar 16 16:05:34 crc kubenswrapper[5120]: I0316 16:05:34.601720 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:05:34 crc kubenswrapper[5120]: I0316 16:05:34.618823 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:05:34 crc kubenswrapper[5120]: I0316 16:05:34.642894 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:05:34 crc kubenswrapper[5120]: I0316 16:05:34.650551 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-58cc99cf94-2svpf" podStartSLOduration=2.650529421 podStartE2EDuration="2.650529421s" podCreationTimestamp="2026-03-16 16:05:32 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:05:34.623202086 +0000 UTC m=+2036.777133743" watchObservedRunningTime="2026-03-16 16:05:34.650529421 +0000 UTC m=+2036.804461078" Mar 16 16:05:34 crc kubenswrapper[5120]: I0316 16:05:34.678188 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:05:34 crc kubenswrapper[5120]: I0316 16:05:34.681713 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-internal-svc\"" Mar 16 16:05:34 crc kubenswrapper[5120]: I0316 16:05:34.682360 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-internal-config-data\"" Mar 16 16:05:34 crc kubenswrapper[5120]: I0316 16:05:34.715808 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f6934b6a-f36d-400a-bb39-d0cdaf66cbae" path="/var/lib/kubelet/pods/f6934b6a-f36d-400a-bb39-d0cdaf66cbae/volumes" Mar 16 16:05:34 crc kubenswrapper[5120]: I0316 16:05:34.721662 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ff5d8cf4-cd75-4107-8fc7-a462d339bab3" path="/var/lib/kubelet/pods/ff5d8cf4-cd75-4107-8fc7-a462d339bab3/volumes" Mar 16 16:05:34 crc kubenswrapper[5120]: I0316 16:05:34.725223 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:05:34 crc kubenswrapper[5120]: I0316 16:05:34.725254 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:05:34 crc kubenswrapper[5120]: I0316 16:05:34.759184 5120 scope.go:117] "RemoveContainer" containerID="65be4143a1b35b422634be7c4104e29fcae55ae42304921d88654fff7573e813" Mar 16 16:05:34 crc kubenswrapper[5120]: I0316 16:05:34.870683 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/e81e832e-72a4-4622-b4b9-e6a41d92fce3-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"e81e832e-72a4-4622-b4b9-e6a41d92fce3\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:05:34 crc kubenswrapper[5120]: I0316 16:05:34.870778 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e81e832e-72a4-4622-b4b9-e6a41d92fce3-logs\") pod \"glance-default-internal-api-0\" (UID: \"e81e832e-72a4-4622-b4b9-e6a41d92fce3\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:05:34 crc kubenswrapper[5120]: I0316 16:05:34.870803 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e81e832e-72a4-4622-b4b9-e6a41d92fce3-config-data\") pod \"glance-default-internal-api-0\" (UID: \"e81e832e-72a4-4622-b4b9-e6a41d92fce3\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:05:34 crc kubenswrapper[5120]: I0316 16:05:34.870834 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"glance-default-internal-api-0\" (UID: \"e81e832e-72a4-4622-b4b9-e6a41d92fce3\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:05:34 crc kubenswrapper[5120]: I0316 16:05:34.870857 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e81e832e-72a4-4622-b4b9-e6a41d92fce3-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"e81e832e-72a4-4622-b4b9-e6a41d92fce3\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:05:34 crc kubenswrapper[5120]: I0316 16:05:34.870882 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e81e832e-72a4-4622-b4b9-e6a41d92fce3-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"e81e832e-72a4-4622-b4b9-e6a41d92fce3\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:05:34 crc kubenswrapper[5120]: I0316 16:05:34.870950 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e81e832e-72a4-4622-b4b9-e6a41d92fce3-scripts\") pod \"glance-default-internal-api-0\" (UID: \"e81e832e-72a4-4622-b4b9-e6a41d92fce3\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:05:34 crc kubenswrapper[5120]: I0316 16:05:34.871033 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dwrm\" (UniqueName: \"kubernetes.io/projected/e81e832e-72a4-4622-b4b9-e6a41d92fce3-kube-api-access-7dwrm\") pod \"glance-default-internal-api-0\" (UID: \"e81e832e-72a4-4622-b4b9-e6a41d92fce3\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:05:34 crc kubenswrapper[5120]: I0316 16:05:34.955916 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:05:34 crc kubenswrapper[5120]: I0316 16:05:34.972812 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e81e832e-72a4-4622-b4b9-e6a41d92fce3-scripts\") pod \"glance-default-internal-api-0\" (UID: \"e81e832e-72a4-4622-b4b9-e6a41d92fce3\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:05:34 crc kubenswrapper[5120]: I0316 16:05:34.972917 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7dwrm\" (UniqueName: \"kubernetes.io/projected/e81e832e-72a4-4622-b4b9-e6a41d92fce3-kube-api-access-7dwrm\") pod \"glance-default-internal-api-0\" (UID: \"e81e832e-72a4-4622-b4b9-e6a41d92fce3\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:05:34 crc kubenswrapper[5120]: I0316 16:05:34.972968 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/e81e832e-72a4-4622-b4b9-e6a41d92fce3-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"e81e832e-72a4-4622-b4b9-e6a41d92fce3\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:05:34 crc kubenswrapper[5120]: I0316 16:05:34.973023 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e81e832e-72a4-4622-b4b9-e6a41d92fce3-logs\") pod \"glance-default-internal-api-0\" (UID: \"e81e832e-72a4-4622-b4b9-e6a41d92fce3\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:05:34 crc kubenswrapper[5120]: I0316 16:05:34.973045 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e81e832e-72a4-4622-b4b9-e6a41d92fce3-config-data\") pod \"glance-default-internal-api-0\" (UID: \"e81e832e-72a4-4622-b4b9-e6a41d92fce3\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:05:34 crc kubenswrapper[5120]: I0316 16:05:34.973076 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"glance-default-internal-api-0\" (UID: \"e81e832e-72a4-4622-b4b9-e6a41d92fce3\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:05:34 crc kubenswrapper[5120]: I0316 16:05:34.973098 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e81e832e-72a4-4622-b4b9-e6a41d92fce3-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"e81e832e-72a4-4622-b4b9-e6a41d92fce3\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:05:34 crc kubenswrapper[5120]: I0316 16:05:34.973122 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e81e832e-72a4-4622-b4b9-e6a41d92fce3-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"e81e832e-72a4-4622-b4b9-e6a41d92fce3\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:05:34 crc kubenswrapper[5120]: I0316 16:05:34.974934 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"glance-default-internal-api-0\" (UID: \"e81e832e-72a4-4622-b4b9-e6a41d92fce3\") device mount path \"/mnt/openstack/pv09\"" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:05:34 crc kubenswrapper[5120]: I0316 16:05:34.983682 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e81e832e-72a4-4622-b4b9-e6a41d92fce3-scripts\") pod \"glance-default-internal-api-0\" (UID: \"e81e832e-72a4-4622-b4b9-e6a41d92fce3\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:05:34 crc kubenswrapper[5120]: I0316 16:05:34.984295 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/e81e832e-72a4-4622-b4b9-e6a41d92fce3-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"e81e832e-72a4-4622-b4b9-e6a41d92fce3\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:05:34 crc kubenswrapper[5120]: I0316 16:05:34.984848 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e81e832e-72a4-4622-b4b9-e6a41d92fce3-logs\") pod \"glance-default-internal-api-0\" (UID: \"e81e832e-72a4-4622-b4b9-e6a41d92fce3\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:05:34 crc kubenswrapper[5120]: I0316 16:05:34.987588 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e81e832e-72a4-4622-b4b9-e6a41d92fce3-config-data\") pod \"glance-default-internal-api-0\" (UID: \"e81e832e-72a4-4622-b4b9-e6a41d92fce3\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:05:34 crc kubenswrapper[5120]: I0316 16:05:34.989004 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e81e832e-72a4-4622-b4b9-e6a41d92fce3-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"e81e832e-72a4-4622-b4b9-e6a41d92fce3\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:05:34 crc kubenswrapper[5120]: I0316 16:05:34.996285 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dwrm\" (UniqueName: \"kubernetes.io/projected/e81e832e-72a4-4622-b4b9-e6a41d92fce3-kube-api-access-7dwrm\") pod \"glance-default-internal-api-0\" (UID: \"e81e832e-72a4-4622-b4b9-e6a41d92fce3\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:05:35 crc kubenswrapper[5120]: I0316 16:05:35.002507 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e81e832e-72a4-4622-b4b9-e6a41d92fce3-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"e81e832e-72a4-4622-b4b9-e6a41d92fce3\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:05:35 crc kubenswrapper[5120]: I0316 16:05:35.037592 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"glance-default-internal-api-0\" (UID: \"e81e832e-72a4-4622-b4b9-e6a41d92fce3\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:05:35 crc kubenswrapper[5120]: I0316 16:05:35.076786 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/27074431-e87c-47e8-9d5a-97fc6edcb13a-logs\") pod \"27074431-e87c-47e8-9d5a-97fc6edcb13a\" (UID: \"27074431-e87c-47e8-9d5a-97fc6edcb13a\") " Mar 16 16:05:35 crc kubenswrapper[5120]: I0316 16:05:35.076924 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/27074431-e87c-47e8-9d5a-97fc6edcb13a-config-data\") pod \"27074431-e87c-47e8-9d5a-97fc6edcb13a\" (UID: \"27074431-e87c-47e8-9d5a-97fc6edcb13a\") " Mar 16 16:05:35 crc kubenswrapper[5120]: I0316 16:05:35.076956 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/27074431-e87c-47e8-9d5a-97fc6edcb13a-config-data-custom\") pod \"27074431-e87c-47e8-9d5a-97fc6edcb13a\" (UID: \"27074431-e87c-47e8-9d5a-97fc6edcb13a\") " Mar 16 16:05:35 crc kubenswrapper[5120]: I0316 16:05:35.077035 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/27074431-e87c-47e8-9d5a-97fc6edcb13a-combined-ca-bundle\") pod \"27074431-e87c-47e8-9d5a-97fc6edcb13a\" (UID: \"27074431-e87c-47e8-9d5a-97fc6edcb13a\") " Mar 16 16:05:35 crc kubenswrapper[5120]: I0316 16:05:35.077077 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/27074431-e87c-47e8-9d5a-97fc6edcb13a-internal-tls-certs\") pod \"27074431-e87c-47e8-9d5a-97fc6edcb13a\" (UID: \"27074431-e87c-47e8-9d5a-97fc6edcb13a\") " Mar 16 16:05:35 crc kubenswrapper[5120]: I0316 16:05:35.077221 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xjx9k\" (UniqueName: \"kubernetes.io/projected/27074431-e87c-47e8-9d5a-97fc6edcb13a-kube-api-access-xjx9k\") pod \"27074431-e87c-47e8-9d5a-97fc6edcb13a\" (UID: \"27074431-e87c-47e8-9d5a-97fc6edcb13a\") " Mar 16 16:05:35 crc kubenswrapper[5120]: I0316 16:05:35.077248 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/27074431-e87c-47e8-9d5a-97fc6edcb13a-scripts\") pod \"27074431-e87c-47e8-9d5a-97fc6edcb13a\" (UID: \"27074431-e87c-47e8-9d5a-97fc6edcb13a\") " Mar 16 16:05:35 crc kubenswrapper[5120]: I0316 16:05:35.077293 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/27074431-e87c-47e8-9d5a-97fc6edcb13a-public-tls-certs\") pod \"27074431-e87c-47e8-9d5a-97fc6edcb13a\" (UID: \"27074431-e87c-47e8-9d5a-97fc6edcb13a\") " Mar 16 16:05:35 crc kubenswrapper[5120]: I0316 16:05:35.077364 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/27074431-e87c-47e8-9d5a-97fc6edcb13a-etc-machine-id\") pod \"27074431-e87c-47e8-9d5a-97fc6edcb13a\" (UID: \"27074431-e87c-47e8-9d5a-97fc6edcb13a\") " Mar 16 16:05:35 crc kubenswrapper[5120]: I0316 16:05:35.077880 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27074431-e87c-47e8-9d5a-97fc6edcb13a-logs" (OuterVolumeSpecName: "logs") pod "27074431-e87c-47e8-9d5a-97fc6edcb13a" (UID: "27074431-e87c-47e8-9d5a-97fc6edcb13a"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:05:35 crc kubenswrapper[5120]: I0316 16:05:35.078175 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/27074431-e87c-47e8-9d5a-97fc6edcb13a-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:35 crc kubenswrapper[5120]: I0316 16:05:35.078285 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/27074431-e87c-47e8-9d5a-97fc6edcb13a-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "27074431-e87c-47e8-9d5a-97fc6edcb13a" (UID: "27074431-e87c-47e8-9d5a-97fc6edcb13a"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 16:05:35 crc kubenswrapper[5120]: I0316 16:05:35.085946 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27074431-e87c-47e8-9d5a-97fc6edcb13a-scripts" (OuterVolumeSpecName: "scripts") pod "27074431-e87c-47e8-9d5a-97fc6edcb13a" (UID: "27074431-e87c-47e8-9d5a-97fc6edcb13a"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:35 crc kubenswrapper[5120]: I0316 16:05:35.086828 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27074431-e87c-47e8-9d5a-97fc6edcb13a-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "27074431-e87c-47e8-9d5a-97fc6edcb13a" (UID: "27074431-e87c-47e8-9d5a-97fc6edcb13a"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:35 crc kubenswrapper[5120]: I0316 16:05:35.093159 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27074431-e87c-47e8-9d5a-97fc6edcb13a-kube-api-access-xjx9k" (OuterVolumeSpecName: "kube-api-access-xjx9k") pod "27074431-e87c-47e8-9d5a-97fc6edcb13a" (UID: "27074431-e87c-47e8-9d5a-97fc6edcb13a"). InnerVolumeSpecName "kube-api-access-xjx9k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:05:35 crc kubenswrapper[5120]: I0316 16:05:35.123104 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:05:35 crc kubenswrapper[5120]: I0316 16:05:35.142354 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:05:35 crc kubenswrapper[5120]: I0316 16:05:35.180076 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xjx9k\" (UniqueName: \"kubernetes.io/projected/27074431-e87c-47e8-9d5a-97fc6edcb13a-kube-api-access-xjx9k\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:35 crc kubenswrapper[5120]: I0316 16:05:35.180110 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/27074431-e87c-47e8-9d5a-97fc6edcb13a-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:35 crc kubenswrapper[5120]: I0316 16:05:35.180121 5120 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/27074431-e87c-47e8-9d5a-97fc6edcb13a-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:35 crc kubenswrapper[5120]: I0316 16:05:35.180130 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/27074431-e87c-47e8-9d5a-97fc6edcb13a-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:35 crc kubenswrapper[5120]: I0316 16:05:35.186857 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27074431-e87c-47e8-9d5a-97fc6edcb13a-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "27074431-e87c-47e8-9d5a-97fc6edcb13a" (UID: "27074431-e87c-47e8-9d5a-97fc6edcb13a"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:35 crc kubenswrapper[5120]: I0316 16:05:35.194066 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27074431-e87c-47e8-9d5a-97fc6edcb13a-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "27074431-e87c-47e8-9d5a-97fc6edcb13a" (UID: "27074431-e87c-47e8-9d5a-97fc6edcb13a"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:35 crc kubenswrapper[5120]: I0316 16:05:35.221969 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27074431-e87c-47e8-9d5a-97fc6edcb13a-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "27074431-e87c-47e8-9d5a-97fc6edcb13a" (UID: "27074431-e87c-47e8-9d5a-97fc6edcb13a"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:35 crc kubenswrapper[5120]: I0316 16:05:35.282623 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/33a720a8-2252-4a1c-a6e8-751a7f3e6871-config-data\") pod \"33a720a8-2252-4a1c-a6e8-751a7f3e6871\" (UID: \"33a720a8-2252-4a1c-a6e8-751a7f3e6871\") " Mar 16 16:05:35 crc kubenswrapper[5120]: I0316 16:05:35.282713 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/33a720a8-2252-4a1c-a6e8-751a7f3e6871-vencrypt-tls-certs\") pod \"33a720a8-2252-4a1c-a6e8-751a7f3e6871\" (UID: \"33a720a8-2252-4a1c-a6e8-751a7f3e6871\") " Mar 16 16:05:35 crc kubenswrapper[5120]: I0316 16:05:35.282926 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pfngf\" (UniqueName: \"kubernetes.io/projected/33a720a8-2252-4a1c-a6e8-751a7f3e6871-kube-api-access-pfngf\") pod \"33a720a8-2252-4a1c-a6e8-751a7f3e6871\" (UID: \"33a720a8-2252-4a1c-a6e8-751a7f3e6871\") " Mar 16 16:05:35 crc kubenswrapper[5120]: I0316 16:05:35.283036 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/33a720a8-2252-4a1c-a6e8-751a7f3e6871-combined-ca-bundle\") pod \"33a720a8-2252-4a1c-a6e8-751a7f3e6871\" (UID: \"33a720a8-2252-4a1c-a6e8-751a7f3e6871\") " Mar 16 16:05:35 crc kubenswrapper[5120]: I0316 16:05:35.283531 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/33a720a8-2252-4a1c-a6e8-751a7f3e6871-nova-novncproxy-tls-certs\") pod \"33a720a8-2252-4a1c-a6e8-751a7f3e6871\" (UID: \"33a720a8-2252-4a1c-a6e8-751a7f3e6871\") " Mar 16 16:05:35 crc kubenswrapper[5120]: I0316 16:05:35.284573 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/27074431-e87c-47e8-9d5a-97fc6edcb13a-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:35 crc kubenswrapper[5120]: I0316 16:05:35.284588 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/27074431-e87c-47e8-9d5a-97fc6edcb13a-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:35 crc kubenswrapper[5120]: I0316 16:05:35.284598 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/27074431-e87c-47e8-9d5a-97fc6edcb13a-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:35 crc kubenswrapper[5120]: I0316 16:05:35.296340 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33a720a8-2252-4a1c-a6e8-751a7f3e6871-kube-api-access-pfngf" (OuterVolumeSpecName: "kube-api-access-pfngf") pod "33a720a8-2252-4a1c-a6e8-751a7f3e6871" (UID: "33a720a8-2252-4a1c-a6e8-751a7f3e6871"). InnerVolumeSpecName "kube-api-access-pfngf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:05:35 crc kubenswrapper[5120]: I0316 16:05:35.305913 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27074431-e87c-47e8-9d5a-97fc6edcb13a-config-data" (OuterVolumeSpecName: "config-data") pod "27074431-e87c-47e8-9d5a-97fc6edcb13a" (UID: "27074431-e87c-47e8-9d5a-97fc6edcb13a"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:35 crc kubenswrapper[5120]: I0316 16:05:35.350957 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/33a720a8-2252-4a1c-a6e8-751a7f3e6871-config-data" (OuterVolumeSpecName: "config-data") pod "33a720a8-2252-4a1c-a6e8-751a7f3e6871" (UID: "33a720a8-2252-4a1c-a6e8-751a7f3e6871"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:35 crc kubenswrapper[5120]: I0316 16:05:35.362565 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/33a720a8-2252-4a1c-a6e8-751a7f3e6871-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "33a720a8-2252-4a1c-a6e8-751a7f3e6871" (UID: "33a720a8-2252-4a1c-a6e8-751a7f3e6871"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:35 crc kubenswrapper[5120]: I0316 16:05:35.370851 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/33a720a8-2252-4a1c-a6e8-751a7f3e6871-nova-novncproxy-tls-certs" (OuterVolumeSpecName: "nova-novncproxy-tls-certs") pod "33a720a8-2252-4a1c-a6e8-751a7f3e6871" (UID: "33a720a8-2252-4a1c-a6e8-751a7f3e6871"). InnerVolumeSpecName "nova-novncproxy-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:35 crc kubenswrapper[5120]: I0316 16:05:35.394240 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/33a720a8-2252-4a1c-a6e8-751a7f3e6871-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:35 crc kubenswrapper[5120]: I0316 16:05:35.394279 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/27074431-e87c-47e8-9d5a-97fc6edcb13a-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:35 crc kubenswrapper[5120]: I0316 16:05:35.394291 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pfngf\" (UniqueName: \"kubernetes.io/projected/33a720a8-2252-4a1c-a6e8-751a7f3e6871-kube-api-access-pfngf\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:35 crc kubenswrapper[5120]: I0316 16:05:35.394302 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/33a720a8-2252-4a1c-a6e8-751a7f3e6871-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:35 crc kubenswrapper[5120]: I0316 16:05:35.394312 5120 reconciler_common.go:299] "Volume detached for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/33a720a8-2252-4a1c-a6e8-751a7f3e6871-nova-novncproxy-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:35 crc kubenswrapper[5120]: I0316 16:05:35.405899 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/33a720a8-2252-4a1c-a6e8-751a7f3e6871-vencrypt-tls-certs" (OuterVolumeSpecName: "vencrypt-tls-certs") pod "33a720a8-2252-4a1c-a6e8-751a7f3e6871" (UID: "33a720a8-2252-4a1c-a6e8-751a7f3e6871"). InnerVolumeSpecName "vencrypt-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:35 crc kubenswrapper[5120]: I0316 16:05:35.495982 5120 reconciler_common.go:299] "Volume detached for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/33a720a8-2252-4a1c-a6e8-751a7f3e6871-vencrypt-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:35 crc kubenswrapper[5120]: I0316 16:05:35.614080 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"e21caabc-db04-4dca-af4d-fbbbbde012ef","Type":"ContainerStarted","Data":"ebdaee0d994fd3c624ba9c9c9e67fca1f174e37975d7d4dcd1d9e18b45f9f6b8"} Mar 16 16:05:35 crc kubenswrapper[5120]: I0316 16:05:35.630299 5120 generic.go:358] "Generic (PLEG): container finished" podID="33a720a8-2252-4a1c-a6e8-751a7f3e6871" containerID="cd5e946f1c4c585a2ad263c7a1ae9f67a7f05a0eb9cb2f7345ae0c0d71f40204" exitCode=0 Mar 16 16:05:35 crc kubenswrapper[5120]: I0316 16:05:35.630386 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:05:35 crc kubenswrapper[5120]: I0316 16:05:35.630410 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"33a720a8-2252-4a1c-a6e8-751a7f3e6871","Type":"ContainerDied","Data":"cd5e946f1c4c585a2ad263c7a1ae9f67a7f05a0eb9cb2f7345ae0c0d71f40204"} Mar 16 16:05:35 crc kubenswrapper[5120]: I0316 16:05:35.630820 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"33a720a8-2252-4a1c-a6e8-751a7f3e6871","Type":"ContainerDied","Data":"6ab3644f33625bad4faea95127bfdb8bed9e3b14ff10bf01c638ea23f80cefe9"} Mar 16 16:05:35 crc kubenswrapper[5120]: I0316 16:05:35.630844 5120 scope.go:117] "RemoveContainer" containerID="cd5e946f1c4c585a2ad263c7a1ae9f67a7f05a0eb9cb2f7345ae0c0d71f40204" Mar 16 16:05:35 crc kubenswrapper[5120]: I0316 16:05:35.638959 5120 generic.go:358] "Generic (PLEG): container finished" podID="7f4e547e-06cd-459e-8e83-9dcbefd83ea4" containerID="6b412424eb716d2e42d4d9ed1e7e068784cfc2c036de57bc48a157cc13bb79ba" exitCode=0 Mar 16 16:05:35 crc kubenswrapper[5120]: I0316 16:05:35.639017 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"7f4e547e-06cd-459e-8e83-9dcbefd83ea4","Type":"ContainerDied","Data":"6b412424eb716d2e42d4d9ed1e7e068784cfc2c036de57bc48a157cc13bb79ba"} Mar 16 16:05:35 crc kubenswrapper[5120]: I0316 16:05:35.648454 5120 generic.go:358] "Generic (PLEG): container finished" podID="18b99335-9d0e-44a5-a6d6-a8ffe17ccd05" containerID="99feac53e678997bd71ad825e2c6c0ef61222639fa34f589c99f7cc46fab6cee" exitCode=0 Mar 16 16:05:35 crc kubenswrapper[5120]: I0316 16:05:35.648592 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"18b99335-9d0e-44a5-a6d6-a8ffe17ccd05","Type":"ContainerDied","Data":"99feac53e678997bd71ad825e2c6c0ef61222639fa34f589c99f7cc46fab6cee"} Mar 16 16:05:35 crc kubenswrapper[5120]: I0316 16:05:35.650131 5120 generic.go:358] "Generic (PLEG): container finished" podID="44247dca-a1cf-42bd-8b32-51322d84cde0" containerID="d2352e0088e9931dce600d12eb8ee3e08ae5cf21e193079916b0ea0c1de43d87" exitCode=0 Mar 16 16:05:35 crc kubenswrapper[5120]: I0316 16:05:35.650233 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-dbbdddfd-6ldcl" event={"ID":"44247dca-a1cf-42bd-8b32-51322d84cde0","Type":"ContainerDied","Data":"d2352e0088e9931dce600d12eb8ee3e08ae5cf21e193079916b0ea0c1de43d87"} Mar 16 16:05:35 crc kubenswrapper[5120]: I0316 16:05:35.652581 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"27074431-e87c-47e8-9d5a-97fc6edcb13a","Type":"ContainerDied","Data":"0b0a886e91191272e2fed5bbd9f8f29756b048f2e82dd951289143d46a8a3b9b"} Mar 16 16:05:35 crc kubenswrapper[5120]: I0316 16:05:35.653386 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:05:35 crc kubenswrapper[5120]: I0316 16:05:35.696313 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:05:35 crc kubenswrapper[5120]: I0316 16:05:35.716019 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:05:35 crc kubenswrapper[5120]: I0316 16:05:35.729083 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:05:35 crc kubenswrapper[5120]: I0316 16:05:35.730180 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27074431-e87c-47e8-9d5a-97fc6edcb13a" containerName="cinder-api" Mar 16 16:05:35 crc kubenswrapper[5120]: I0316 16:05:35.730193 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="27074431-e87c-47e8-9d5a-97fc6edcb13a" containerName="cinder-api" Mar 16 16:05:35 crc kubenswrapper[5120]: I0316 16:05:35.730213 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27074431-e87c-47e8-9d5a-97fc6edcb13a" containerName="cinder-api-log" Mar 16 16:05:35 crc kubenswrapper[5120]: I0316 16:05:35.730219 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="27074431-e87c-47e8-9d5a-97fc6edcb13a" containerName="cinder-api-log" Mar 16 16:05:35 crc kubenswrapper[5120]: I0316 16:05:35.730231 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33a720a8-2252-4a1c-a6e8-751a7f3e6871" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 16:05:35 crc kubenswrapper[5120]: I0316 16:05:35.730238 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="33a720a8-2252-4a1c-a6e8-751a7f3e6871" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 16:05:35 crc kubenswrapper[5120]: I0316 16:05:35.730467 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="27074431-e87c-47e8-9d5a-97fc6edcb13a" containerName="cinder-api" Mar 16 16:05:35 crc kubenswrapper[5120]: I0316 16:05:35.730491 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="33a720a8-2252-4a1c-a6e8-751a7f3e6871" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 16:05:35 crc kubenswrapper[5120]: I0316 16:05:35.730503 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="27074431-e87c-47e8-9d5a-97fc6edcb13a" containerName="cinder-api-log" Mar 16 16:05:35 crc kubenswrapper[5120]: I0316 16:05:35.742419 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:05:35 crc kubenswrapper[5120]: I0316 16:05:35.747949 5120 scope.go:117] "RemoveContainer" containerID="cd5e946f1c4c585a2ad263c7a1ae9f67a7f05a0eb9cb2f7345ae0c0d71f40204" Mar 16 16:05:35 crc kubenswrapper[5120]: I0316 16:05:35.748453 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-novncproxy-config-data\"" Mar 16 16:05:35 crc kubenswrapper[5120]: I0316 16:05:35.748531 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-novncproxy-cell1-vencrypt\"" Mar 16 16:05:35 crc kubenswrapper[5120]: I0316 16:05:35.748812 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-novncproxy-cell1-public-svc\"" Mar 16 16:05:35 crc kubenswrapper[5120]: E0316 16:05:35.754277 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd5e946f1c4c585a2ad263c7a1ae9f67a7f05a0eb9cb2f7345ae0c0d71f40204\": container with ID starting with cd5e946f1c4c585a2ad263c7a1ae9f67a7f05a0eb9cb2f7345ae0c0d71f40204 not found: ID does not exist" containerID="cd5e946f1c4c585a2ad263c7a1ae9f67a7f05a0eb9cb2f7345ae0c0d71f40204" Mar 16 16:05:35 crc kubenswrapper[5120]: I0316 16:05:35.754315 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd5e946f1c4c585a2ad263c7a1ae9f67a7f05a0eb9cb2f7345ae0c0d71f40204"} err="failed to get container status \"cd5e946f1c4c585a2ad263c7a1ae9f67a7f05a0eb9cb2f7345ae0c0d71f40204\": rpc error: code = NotFound desc = could not find container \"cd5e946f1c4c585a2ad263c7a1ae9f67a7f05a0eb9cb2f7345ae0c0d71f40204\": container with ID starting with cd5e946f1c4c585a2ad263c7a1ae9f67a7f05a0eb9cb2f7345ae0c0d71f40204 not found: ID does not exist" Mar 16 16:05:35 crc kubenswrapper[5120]: I0316 16:05:35.754339 5120 scope.go:117] "RemoveContainer" containerID="a9c198c5fde8f1516c2c97543c1c28b24b2488b249ed434453537e04cab35001" Mar 16 16:05:35 crc kubenswrapper[5120]: I0316 16:05:35.767437 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:05:35 crc kubenswrapper[5120]: I0316 16:05:35.774588 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:05:35 crc kubenswrapper[5120]: I0316 16:05:35.784798 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:05:35 crc kubenswrapper[5120]: I0316 16:05:35.792321 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:05:35 crc kubenswrapper[5120]: I0316 16:05:35.803434 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:05:35 crc kubenswrapper[5120]: I0316 16:05:35.803540 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:05:35 crc kubenswrapper[5120]: I0316 16:05:35.808632 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-cinder-public-svc\"" Mar 16 16:05:35 crc kubenswrapper[5120]: I0316 16:05:35.808857 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-api-config-data\"" Mar 16 16:05:35 crc kubenswrapper[5120]: I0316 16:05:35.808987 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-cinder-internal-svc\"" Mar 16 16:05:35 crc kubenswrapper[5120]: I0316 16:05:35.867938 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:05:35 crc kubenswrapper[5120]: E0316 16:05:35.904972 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="e5ac583ccc9724ef6e7100e99c0c22e3b118431b2c90d1bb0d71d736f0583622" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:05:35 crc kubenswrapper[5120]: I0316 16:05:35.905031 5120 scope.go:117] "RemoveContainer" containerID="67742b8daeb25edbf24bf7d11c17631616825891f277c6d8ea5023f5f01fa709" Mar 16 16:05:35 crc kubenswrapper[5120]: E0316 16:05:35.906388 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="e5ac583ccc9724ef6e7100e99c0c22e3b118431b2c90d1bb0d71d736f0583622" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:05:35 crc kubenswrapper[5120]: E0316 16:05:35.907984 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="e5ac583ccc9724ef6e7100e99c0c22e3b118431b2c90d1bb0d71d736f0583622" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:05:35 crc kubenswrapper[5120]: E0316 16:05:35.908016 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="3b57a7de-40e8-484e-a2a9-55454c35ccd0" containerName="nova-cell1-conductor-conductor" probeResult="unknown" Mar 16 16:05:35 crc kubenswrapper[5120]: I0316 16:05:35.912581 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nh4fn\" (UniqueName: \"kubernetes.io/projected/5b630779-e8f9-434c-9449-d2aad103f041-kube-api-access-nh4fn\") pod \"cinder-api-0\" (UID: \"5b630779-e8f9-434c-9449-d2aad103f041\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:05:35 crc kubenswrapper[5120]: I0316 16:05:35.912636 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5b630779-e8f9-434c-9449-d2aad103f041-config-data\") pod \"cinder-api-0\" (UID: \"5b630779-e8f9-434c-9449-d2aad103f041\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:05:35 crc kubenswrapper[5120]: I0316 16:05:35.912655 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5b630779-e8f9-434c-9449-d2aad103f041-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"5b630779-e8f9-434c-9449-d2aad103f041\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:05:35 crc kubenswrapper[5120]: I0316 16:05:35.912681 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l62x9\" (UniqueName: \"kubernetes.io/projected/52c2852f-8732-4310-8402-b925b49a12ea-kube-api-access-l62x9\") pod \"nova-cell1-novncproxy-0\" (UID: \"52c2852f-8732-4310-8402-b925b49a12ea\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:05:35 crc kubenswrapper[5120]: I0316 16:05:35.912701 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/52c2852f-8732-4310-8402-b925b49a12ea-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"52c2852f-8732-4310-8402-b925b49a12ea\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:05:35 crc kubenswrapper[5120]: I0316 16:05:35.912729 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5b630779-e8f9-434c-9449-d2aad103f041-logs\") pod \"cinder-api-0\" (UID: \"5b630779-e8f9-434c-9449-d2aad103f041\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:05:35 crc kubenswrapper[5120]: I0316 16:05:35.912792 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/52c2852f-8732-4310-8402-b925b49a12ea-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"52c2852f-8732-4310-8402-b925b49a12ea\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:05:35 crc kubenswrapper[5120]: I0316 16:05:35.912841 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/5b630779-e8f9-434c-9449-d2aad103f041-public-tls-certs\") pod \"cinder-api-0\" (UID: \"5b630779-e8f9-434c-9449-d2aad103f041\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:05:35 crc kubenswrapper[5120]: I0316 16:05:35.912869 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/52c2852f-8732-4310-8402-b925b49a12ea-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"52c2852f-8732-4310-8402-b925b49a12ea\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:05:35 crc kubenswrapper[5120]: I0316 16:05:35.912912 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/5b630779-e8f9-434c-9449-d2aad103f041-etc-machine-id\") pod \"cinder-api-0\" (UID: \"5b630779-e8f9-434c-9449-d2aad103f041\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:05:35 crc kubenswrapper[5120]: I0316 16:05:35.912930 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/5b630779-e8f9-434c-9449-d2aad103f041-config-data-custom\") pod \"cinder-api-0\" (UID: \"5b630779-e8f9-434c-9449-d2aad103f041\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:05:35 crc kubenswrapper[5120]: I0316 16:05:35.912960 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/5b630779-e8f9-434c-9449-d2aad103f041-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"5b630779-e8f9-434c-9449-d2aad103f041\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:05:35 crc kubenswrapper[5120]: I0316 16:05:35.912977 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5b630779-e8f9-434c-9449-d2aad103f041-scripts\") pod \"cinder-api-0\" (UID: \"5b630779-e8f9-434c-9449-d2aad103f041\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:05:35 crc kubenswrapper[5120]: I0316 16:05:35.913042 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/52c2852f-8732-4310-8402-b925b49a12ea-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"52c2852f-8732-4310-8402-b925b49a12ea\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:05:35 crc kubenswrapper[5120]: I0316 16:05:35.965387 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:05:36 crc kubenswrapper[5120]: I0316 16:05:36.009473 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:05:36 crc kubenswrapper[5120]: I0316 16:05:36.015359 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/18b99335-9d0e-44a5-a6d6-a8ffe17ccd05-config-data\") pod \"18b99335-9d0e-44a5-a6d6-a8ffe17ccd05\" (UID: \"18b99335-9d0e-44a5-a6d6-a8ffe17ccd05\") " Mar 16 16:05:36 crc kubenswrapper[5120]: I0316 16:05:36.015434 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/18b99335-9d0e-44a5-a6d6-a8ffe17ccd05-scripts\") pod \"18b99335-9d0e-44a5-a6d6-a8ffe17ccd05\" (UID: \"18b99335-9d0e-44a5-a6d6-a8ffe17ccd05\") " Mar 16 16:05:36 crc kubenswrapper[5120]: I0316 16:05:36.015551 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/18b99335-9d0e-44a5-a6d6-a8ffe17ccd05-etc-machine-id\") pod \"18b99335-9d0e-44a5-a6d6-a8ffe17ccd05\" (UID: \"18b99335-9d0e-44a5-a6d6-a8ffe17ccd05\") " Mar 16 16:05:36 crc kubenswrapper[5120]: I0316 16:05:36.015584 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/18b99335-9d0e-44a5-a6d6-a8ffe17ccd05-config-data-custom\") pod \"18b99335-9d0e-44a5-a6d6-a8ffe17ccd05\" (UID: \"18b99335-9d0e-44a5-a6d6-a8ffe17ccd05\") " Mar 16 16:05:36 crc kubenswrapper[5120]: I0316 16:05:36.015603 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mxr46\" (UniqueName: \"kubernetes.io/projected/18b99335-9d0e-44a5-a6d6-a8ffe17ccd05-kube-api-access-mxr46\") pod \"18b99335-9d0e-44a5-a6d6-a8ffe17ccd05\" (UID: \"18b99335-9d0e-44a5-a6d6-a8ffe17ccd05\") " Mar 16 16:05:36 crc kubenswrapper[5120]: I0316 16:05:36.015678 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/18b99335-9d0e-44a5-a6d6-a8ffe17ccd05-combined-ca-bundle\") pod \"18b99335-9d0e-44a5-a6d6-a8ffe17ccd05\" (UID: \"18b99335-9d0e-44a5-a6d6-a8ffe17ccd05\") " Mar 16 16:05:36 crc kubenswrapper[5120]: I0316 16:05:36.015910 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/5b630779-e8f9-434c-9449-d2aad103f041-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"5b630779-e8f9-434c-9449-d2aad103f041\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:05:36 crc kubenswrapper[5120]: I0316 16:05:36.015935 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5b630779-e8f9-434c-9449-d2aad103f041-scripts\") pod \"cinder-api-0\" (UID: \"5b630779-e8f9-434c-9449-d2aad103f041\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:05:36 crc kubenswrapper[5120]: I0316 16:05:36.015994 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/52c2852f-8732-4310-8402-b925b49a12ea-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"52c2852f-8732-4310-8402-b925b49a12ea\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:05:36 crc kubenswrapper[5120]: I0316 16:05:36.016061 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nh4fn\" (UniqueName: \"kubernetes.io/projected/5b630779-e8f9-434c-9449-d2aad103f041-kube-api-access-nh4fn\") pod \"cinder-api-0\" (UID: \"5b630779-e8f9-434c-9449-d2aad103f041\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:05:36 crc kubenswrapper[5120]: I0316 16:05:36.016164 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5b630779-e8f9-434c-9449-d2aad103f041-config-data\") pod \"cinder-api-0\" (UID: \"5b630779-e8f9-434c-9449-d2aad103f041\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:05:36 crc kubenswrapper[5120]: I0316 16:05:36.016934 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5b630779-e8f9-434c-9449-d2aad103f041-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"5b630779-e8f9-434c-9449-d2aad103f041\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:05:36 crc kubenswrapper[5120]: I0316 16:05:36.016965 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l62x9\" (UniqueName: \"kubernetes.io/projected/52c2852f-8732-4310-8402-b925b49a12ea-kube-api-access-l62x9\") pod \"nova-cell1-novncproxy-0\" (UID: \"52c2852f-8732-4310-8402-b925b49a12ea\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:05:36 crc kubenswrapper[5120]: I0316 16:05:36.016985 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/52c2852f-8732-4310-8402-b925b49a12ea-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"52c2852f-8732-4310-8402-b925b49a12ea\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:05:36 crc kubenswrapper[5120]: I0316 16:05:36.017189 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5b630779-e8f9-434c-9449-d2aad103f041-logs\") pod \"cinder-api-0\" (UID: \"5b630779-e8f9-434c-9449-d2aad103f041\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:05:36 crc kubenswrapper[5120]: I0316 16:05:36.017290 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/52c2852f-8732-4310-8402-b925b49a12ea-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"52c2852f-8732-4310-8402-b925b49a12ea\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:05:36 crc kubenswrapper[5120]: I0316 16:05:36.017345 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/5b630779-e8f9-434c-9449-d2aad103f041-public-tls-certs\") pod \"cinder-api-0\" (UID: \"5b630779-e8f9-434c-9449-d2aad103f041\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:05:36 crc kubenswrapper[5120]: I0316 16:05:36.017372 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/52c2852f-8732-4310-8402-b925b49a12ea-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"52c2852f-8732-4310-8402-b925b49a12ea\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:05:36 crc kubenswrapper[5120]: I0316 16:05:36.017417 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/5b630779-e8f9-434c-9449-d2aad103f041-etc-machine-id\") pod \"cinder-api-0\" (UID: \"5b630779-e8f9-434c-9449-d2aad103f041\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:05:36 crc kubenswrapper[5120]: I0316 16:05:36.017437 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/5b630779-e8f9-434c-9449-d2aad103f041-config-data-custom\") pod \"cinder-api-0\" (UID: \"5b630779-e8f9-434c-9449-d2aad103f041\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:05:36 crc kubenswrapper[5120]: I0316 16:05:36.020672 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18b99335-9d0e-44a5-a6d6-a8ffe17ccd05-kube-api-access-mxr46" (OuterVolumeSpecName: "kube-api-access-mxr46") pod "18b99335-9d0e-44a5-a6d6-a8ffe17ccd05" (UID: "18b99335-9d0e-44a5-a6d6-a8ffe17ccd05"). InnerVolumeSpecName "kube-api-access-mxr46". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:05:36 crc kubenswrapper[5120]: I0316 16:05:36.020726 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/18b99335-9d0e-44a5-a6d6-a8ffe17ccd05-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "18b99335-9d0e-44a5-a6d6-a8ffe17ccd05" (UID: "18b99335-9d0e-44a5-a6d6-a8ffe17ccd05"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 16:05:36 crc kubenswrapper[5120]: I0316 16:05:36.021734 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/52c2852f-8732-4310-8402-b925b49a12ea-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"52c2852f-8732-4310-8402-b925b49a12ea\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:05:36 crc kubenswrapper[5120]: I0316 16:05:36.022817 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18b99335-9d0e-44a5-a6d6-a8ffe17ccd05-scripts" (OuterVolumeSpecName: "scripts") pod "18b99335-9d0e-44a5-a6d6-a8ffe17ccd05" (UID: "18b99335-9d0e-44a5-a6d6-a8ffe17ccd05"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:36 crc kubenswrapper[5120]: I0316 16:05:36.025292 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/52c2852f-8732-4310-8402-b925b49a12ea-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"52c2852f-8732-4310-8402-b925b49a12ea\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:05:36 crc kubenswrapper[5120]: I0316 16:05:36.025531 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5b630779-e8f9-434c-9449-d2aad103f041-logs\") pod \"cinder-api-0\" (UID: \"5b630779-e8f9-434c-9449-d2aad103f041\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:05:36 crc kubenswrapper[5120]: I0316 16:05:36.026004 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5b630779-e8f9-434c-9449-d2aad103f041-scripts\") pod \"cinder-api-0\" (UID: \"5b630779-e8f9-434c-9449-d2aad103f041\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:05:36 crc kubenswrapper[5120]: I0316 16:05:36.026070 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/5b630779-e8f9-434c-9449-d2aad103f041-etc-machine-id\") pod \"cinder-api-0\" (UID: \"5b630779-e8f9-434c-9449-d2aad103f041\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:05:36 crc kubenswrapper[5120]: I0316 16:05:36.028571 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/52c2852f-8732-4310-8402-b925b49a12ea-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"52c2852f-8732-4310-8402-b925b49a12ea\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:05:36 crc kubenswrapper[5120]: I0316 16:05:36.031145 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/52c2852f-8732-4310-8402-b925b49a12ea-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"52c2852f-8732-4310-8402-b925b49a12ea\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:05:36 crc kubenswrapper[5120]: I0316 16:05:36.036536 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/5b630779-e8f9-434c-9449-d2aad103f041-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"5b630779-e8f9-434c-9449-d2aad103f041\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:05:36 crc kubenswrapper[5120]: I0316 16:05:36.037087 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/5b630779-e8f9-434c-9449-d2aad103f041-public-tls-certs\") pod \"cinder-api-0\" (UID: \"5b630779-e8f9-434c-9449-d2aad103f041\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:05:36 crc kubenswrapper[5120]: I0316 16:05:36.037449 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/5b630779-e8f9-434c-9449-d2aad103f041-config-data-custom\") pod \"cinder-api-0\" (UID: \"5b630779-e8f9-434c-9449-d2aad103f041\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:05:36 crc kubenswrapper[5120]: I0316 16:05:36.042836 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5b630779-e8f9-434c-9449-d2aad103f041-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"5b630779-e8f9-434c-9449-d2aad103f041\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:05:36 crc kubenswrapper[5120]: I0316 16:05:36.042897 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18b99335-9d0e-44a5-a6d6-a8ffe17ccd05-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "18b99335-9d0e-44a5-a6d6-a8ffe17ccd05" (UID: "18b99335-9d0e-44a5-a6d6-a8ffe17ccd05"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:36 crc kubenswrapper[5120]: I0316 16:05:36.043742 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5b630779-e8f9-434c-9449-d2aad103f041-config-data\") pod \"cinder-api-0\" (UID: \"5b630779-e8f9-434c-9449-d2aad103f041\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:05:36 crc kubenswrapper[5120]: I0316 16:05:36.048403 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nh4fn\" (UniqueName: \"kubernetes.io/projected/5b630779-e8f9-434c-9449-d2aad103f041-kube-api-access-nh4fn\") pod \"cinder-api-0\" (UID: \"5b630779-e8f9-434c-9449-d2aad103f041\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:05:36 crc kubenswrapper[5120]: I0316 16:05:36.050222 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l62x9\" (UniqueName: \"kubernetes.io/projected/52c2852f-8732-4310-8402-b925b49a12ea-kube-api-access-l62x9\") pod \"nova-cell1-novncproxy-0\" (UID: \"52c2852f-8732-4310-8402-b925b49a12ea\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:05:36 crc kubenswrapper[5120]: I0316 16:05:36.091511 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18b99335-9d0e-44a5-a6d6-a8ffe17ccd05-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "18b99335-9d0e-44a5-a6d6-a8ffe17ccd05" (UID: "18b99335-9d0e-44a5-a6d6-a8ffe17ccd05"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:36 crc kubenswrapper[5120]: I0316 16:05:36.118626 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2trwl\" (UniqueName: \"kubernetes.io/projected/7f4e547e-06cd-459e-8e83-9dcbefd83ea4-kube-api-access-2trwl\") pod \"7f4e547e-06cd-459e-8e83-9dcbefd83ea4\" (UID: \"7f4e547e-06cd-459e-8e83-9dcbefd83ea4\") " Mar 16 16:05:36 crc kubenswrapper[5120]: I0316 16:05:36.118903 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7f4e547e-06cd-459e-8e83-9dcbefd83ea4-config-data\") pod \"7f4e547e-06cd-459e-8e83-9dcbefd83ea4\" (UID: \"7f4e547e-06cd-459e-8e83-9dcbefd83ea4\") " Mar 16 16:05:36 crc kubenswrapper[5120]: I0316 16:05:36.118954 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7f4e547e-06cd-459e-8e83-9dcbefd83ea4-combined-ca-bundle\") pod \"7f4e547e-06cd-459e-8e83-9dcbefd83ea4\" (UID: \"7f4e547e-06cd-459e-8e83-9dcbefd83ea4\") " Mar 16 16:05:36 crc kubenswrapper[5120]: I0316 16:05:36.119745 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/18b99335-9d0e-44a5-a6d6-a8ffe17ccd05-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:36 crc kubenswrapper[5120]: I0316 16:05:36.119786 5120 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/18b99335-9d0e-44a5-a6d6-a8ffe17ccd05-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:36 crc kubenswrapper[5120]: I0316 16:05:36.119800 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/18b99335-9d0e-44a5-a6d6-a8ffe17ccd05-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:36 crc kubenswrapper[5120]: I0316 16:05:36.119814 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mxr46\" (UniqueName: \"kubernetes.io/projected/18b99335-9d0e-44a5-a6d6-a8ffe17ccd05-kube-api-access-mxr46\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:36 crc kubenswrapper[5120]: I0316 16:05:36.119871 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/18b99335-9d0e-44a5-a6d6-a8ffe17ccd05-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:36 crc kubenswrapper[5120]: I0316 16:05:36.123300 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f4e547e-06cd-459e-8e83-9dcbefd83ea4-kube-api-access-2trwl" (OuterVolumeSpecName: "kube-api-access-2trwl") pod "7f4e547e-06cd-459e-8e83-9dcbefd83ea4" (UID: "7f4e547e-06cd-459e-8e83-9dcbefd83ea4"). InnerVolumeSpecName "kube-api-access-2trwl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:05:36 crc kubenswrapper[5120]: I0316 16:05:36.130791 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18b99335-9d0e-44a5-a6d6-a8ffe17ccd05-config-data" (OuterVolumeSpecName: "config-data") pod "18b99335-9d0e-44a5-a6d6-a8ffe17ccd05" (UID: "18b99335-9d0e-44a5-a6d6-a8ffe17ccd05"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:36 crc kubenswrapper[5120]: I0316 16:05:36.154595 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7f4e547e-06cd-459e-8e83-9dcbefd83ea4-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "7f4e547e-06cd-459e-8e83-9dcbefd83ea4" (UID: "7f4e547e-06cd-459e-8e83-9dcbefd83ea4"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:36 crc kubenswrapper[5120]: I0316 16:05:36.155598 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:05:36 crc kubenswrapper[5120]: I0316 16:05:36.171385 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7f4e547e-06cd-459e-8e83-9dcbefd83ea4-config-data" (OuterVolumeSpecName: "config-data") pod "7f4e547e-06cd-459e-8e83-9dcbefd83ea4" (UID: "7f4e547e-06cd-459e-8e83-9dcbefd83ea4"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:36 crc kubenswrapper[5120]: I0316 16:05:36.179716 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:05:36 crc kubenswrapper[5120]: I0316 16:05:36.221307 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2trwl\" (UniqueName: \"kubernetes.io/projected/7f4e547e-06cd-459e-8e83-9dcbefd83ea4-kube-api-access-2trwl\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:36 crc kubenswrapper[5120]: I0316 16:05:36.221340 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7f4e547e-06cd-459e-8e83-9dcbefd83ea4-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:36 crc kubenswrapper[5120]: I0316 16:05:36.221351 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7f4e547e-06cd-459e-8e83-9dcbefd83ea4-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:36 crc kubenswrapper[5120]: I0316 16:05:36.221361 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/18b99335-9d0e-44a5-a6d6-a8ffe17ccd05-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:36 crc kubenswrapper[5120]: I0316 16:05:36.688177 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="27074431-e87c-47e8-9d5a-97fc6edcb13a" path="/var/lib/kubelet/pods/27074431-e87c-47e8-9d5a-97fc6edcb13a/volumes" Mar 16 16:05:36 crc kubenswrapper[5120]: I0316 16:05:36.690140 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="33a720a8-2252-4a1c-a6e8-751a7f3e6871" path="/var/lib/kubelet/pods/33a720a8-2252-4a1c-a6e8-751a7f3e6871/volumes" Mar 16 16:05:36 crc kubenswrapper[5120]: I0316 16:05:36.692184 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:05:36 crc kubenswrapper[5120]: I0316 16:05:36.692336 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"18b99335-9d0e-44a5-a6d6-a8ffe17ccd05","Type":"ContainerDied","Data":"8c92e3faf6f2743c160652cefbc3429c7e86c6da358fbef6a3e7a62346d53d89"} Mar 16 16:05:36 crc kubenswrapper[5120]: I0316 16:05:36.692444 5120 scope.go:117] "RemoveContainer" containerID="27fb86bc3c9d5fdfd0c0e9eb50972c65626d46f8fbbde0a14f84fbb04c64e79c" Mar 16 16:05:36 crc kubenswrapper[5120]: I0316 16:05:36.728406 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"e81e832e-72a4-4622-b4b9-e6a41d92fce3","Type":"ContainerStarted","Data":"a3220fcd7ef59cd33ae120d4069976f8d77ecbd97b331a5b0b7c81979d822580"} Mar 16 16:05:36 crc kubenswrapper[5120]: I0316 16:05:36.729993 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"e21caabc-db04-4dca-af4d-fbbbbde012ef","Type":"ContainerStarted","Data":"690d8c0414abcfba6ac522dccd770b198d8df01c4d769b43d45f9b7b69658a8b"} Mar 16 16:05:36 crc kubenswrapper[5120]: I0316 16:05:36.742388 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"7f4e547e-06cd-459e-8e83-9dcbefd83ea4","Type":"ContainerDied","Data":"d80f8e521e6be881c26d93fb5aad5c6ff32059c57dd58ea6c4b89246bae22e34"} Mar 16 16:05:36 crc kubenswrapper[5120]: I0316 16:05:36.742482 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:05:36 crc kubenswrapper[5120]: I0316 16:05:36.775910 5120 scope.go:117] "RemoveContainer" containerID="99feac53e678997bd71ad825e2c6c0ef61222639fa34f589c99f7cc46fab6cee" Mar 16 16:05:36 crc kubenswrapper[5120]: I0316 16:05:36.787437 5120 generic.go:358] "Generic (PLEG): container finished" podID="3b57a7de-40e8-484e-a2a9-55454c35ccd0" containerID="e5ac583ccc9724ef6e7100e99c0c22e3b118431b2c90d1bb0d71d736f0583622" exitCode=0 Mar 16 16:05:36 crc kubenswrapper[5120]: I0316 16:05:36.798543 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:05:36 crc kubenswrapper[5120]: I0316 16:05:36.798602 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"3b57a7de-40e8-484e-a2a9-55454c35ccd0","Type":"ContainerDied","Data":"e5ac583ccc9724ef6e7100e99c0c22e3b118431b2c90d1bb0d71d736f0583622"} Mar 16 16:05:36 crc kubenswrapper[5120]: E0316 16:05:36.848388 5120 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod18b99335_9d0e_44a5_a6d6_a8ffe17ccd05.slice/crio-8c92e3faf6f2743c160652cefbc3429c7e86c6da358fbef6a3e7a62346d53d89\": RecentStats: unable to find data in memory cache]" Mar 16 16:05:36 crc kubenswrapper[5120]: I0316 16:05:36.869189 5120 scope.go:117] "RemoveContainer" containerID="6b412424eb716d2e42d4d9ed1e7e068784cfc2c036de57bc48a157cc13bb79ba" Mar 16 16:05:36 crc kubenswrapper[5120]: I0316 16:05:36.897673 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:05:36 crc kubenswrapper[5120]: I0316 16:05:36.910741 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:05:36 crc kubenswrapper[5120]: I0316 16:05:36.913042 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f4e547e-06cd-459e-8e83-9dcbefd83ea4" containerName="nova-cell0-conductor-conductor" Mar 16 16:05:36 crc kubenswrapper[5120]: I0316 16:05:36.913070 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f4e547e-06cd-459e-8e83-9dcbefd83ea4" containerName="nova-cell0-conductor-conductor" Mar 16 16:05:36 crc kubenswrapper[5120]: I0316 16:05:36.913082 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18b99335-9d0e-44a5-a6d6-a8ffe17ccd05" containerName="cinder-scheduler" Mar 16 16:05:36 crc kubenswrapper[5120]: I0316 16:05:36.913089 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="18b99335-9d0e-44a5-a6d6-a8ffe17ccd05" containerName="cinder-scheduler" Mar 16 16:05:36 crc kubenswrapper[5120]: I0316 16:05:36.913116 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18b99335-9d0e-44a5-a6d6-a8ffe17ccd05" containerName="probe" Mar 16 16:05:36 crc kubenswrapper[5120]: I0316 16:05:36.913122 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="18b99335-9d0e-44a5-a6d6-a8ffe17ccd05" containerName="probe" Mar 16 16:05:36 crc kubenswrapper[5120]: I0316 16:05:36.913294 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7f4e547e-06cd-459e-8e83-9dcbefd83ea4" containerName="nova-cell0-conductor-conductor" Mar 16 16:05:36 crc kubenswrapper[5120]: I0316 16:05:36.913313 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="18b99335-9d0e-44a5-a6d6-a8ffe17ccd05" containerName="cinder-scheduler" Mar 16 16:05:36 crc kubenswrapper[5120]: I0316 16:05:36.913326 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="18b99335-9d0e-44a5-a6d6-a8ffe17ccd05" containerName="probe" Mar 16 16:05:36 crc kubenswrapper[5120]: I0316 16:05:36.926201 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:05:36 crc kubenswrapper[5120]: I0316 16:05:36.926323 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:05:36 crc kubenswrapper[5120]: I0316 16:05:36.926541 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:05:36 crc kubenswrapper[5120]: I0316 16:05:36.932287 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-scheduler-config-data\"" Mar 16 16:05:36 crc kubenswrapper[5120]: I0316 16:05:36.934539 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:05:36 crc kubenswrapper[5120]: I0316 16:05:36.942078 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:05:36 crc kubenswrapper[5120]: I0316 16:05:36.951308 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:05:36 crc kubenswrapper[5120]: I0316 16:05:36.954347 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-conductor-config-data\"" Mar 16 16:05:36 crc kubenswrapper[5120]: I0316 16:05:36.974705 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:05:37 crc kubenswrapper[5120]: I0316 16:05:37.025742 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:05:37 crc kubenswrapper[5120]: I0316 16:05:37.051169 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/34a68caa-76db-4be4-9ecd-8955435c0e90-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"34a68caa-76db-4be4-9ecd-8955435c0e90\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:05:37 crc kubenswrapper[5120]: I0316 16:05:37.051232 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/34a68caa-76db-4be4-9ecd-8955435c0e90-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"34a68caa-76db-4be4-9ecd-8955435c0e90\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:05:37 crc kubenswrapper[5120]: I0316 16:05:37.051264 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/683d3459-b9fc-478c-b74e-c1a09fd45e4d-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"683d3459-b9fc-478c-b74e-c1a09fd45e4d\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:05:37 crc kubenswrapper[5120]: I0316 16:05:37.051421 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/34a68caa-76db-4be4-9ecd-8955435c0e90-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"34a68caa-76db-4be4-9ecd-8955435c0e90\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:05:37 crc kubenswrapper[5120]: I0316 16:05:37.051500 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqv59\" (UniqueName: \"kubernetes.io/projected/34a68caa-76db-4be4-9ecd-8955435c0e90-kube-api-access-tqv59\") pod \"cinder-scheduler-0\" (UID: \"34a68caa-76db-4be4-9ecd-8955435c0e90\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:05:37 crc kubenswrapper[5120]: I0316 16:05:37.051532 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/34a68caa-76db-4be4-9ecd-8955435c0e90-config-data\") pod \"cinder-scheduler-0\" (UID: \"34a68caa-76db-4be4-9ecd-8955435c0e90\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:05:37 crc kubenswrapper[5120]: I0316 16:05:37.051653 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69lg2\" (UniqueName: \"kubernetes.io/projected/683d3459-b9fc-478c-b74e-c1a09fd45e4d-kube-api-access-69lg2\") pod \"nova-cell0-conductor-0\" (UID: \"683d3459-b9fc-478c-b74e-c1a09fd45e4d\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:05:37 crc kubenswrapper[5120]: I0316 16:05:37.051734 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/34a68caa-76db-4be4-9ecd-8955435c0e90-scripts\") pod \"cinder-scheduler-0\" (UID: \"34a68caa-76db-4be4-9ecd-8955435c0e90\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:05:37 crc kubenswrapper[5120]: I0316 16:05:37.051783 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/683d3459-b9fc-478c-b74e-c1a09fd45e4d-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"683d3459-b9fc-478c-b74e-c1a09fd45e4d\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:05:37 crc kubenswrapper[5120]: I0316 16:05:37.066049 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:05:37 crc kubenswrapper[5120]: I0316 16:05:37.154535 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/34a68caa-76db-4be4-9ecd-8955435c0e90-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"34a68caa-76db-4be4-9ecd-8955435c0e90\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:05:37 crc kubenswrapper[5120]: I0316 16:05:37.154605 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/34a68caa-76db-4be4-9ecd-8955435c0e90-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"34a68caa-76db-4be4-9ecd-8955435c0e90\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:05:37 crc kubenswrapper[5120]: I0316 16:05:37.154626 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/683d3459-b9fc-478c-b74e-c1a09fd45e4d-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"683d3459-b9fc-478c-b74e-c1a09fd45e4d\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:05:37 crc kubenswrapper[5120]: I0316 16:05:37.154637 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/34a68caa-76db-4be4-9ecd-8955435c0e90-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"34a68caa-76db-4be4-9ecd-8955435c0e90\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:05:37 crc kubenswrapper[5120]: I0316 16:05:37.154670 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/34a68caa-76db-4be4-9ecd-8955435c0e90-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"34a68caa-76db-4be4-9ecd-8955435c0e90\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:05:37 crc kubenswrapper[5120]: I0316 16:05:37.154777 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tqv59\" (UniqueName: \"kubernetes.io/projected/34a68caa-76db-4be4-9ecd-8955435c0e90-kube-api-access-tqv59\") pod \"cinder-scheduler-0\" (UID: \"34a68caa-76db-4be4-9ecd-8955435c0e90\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:05:37 crc kubenswrapper[5120]: I0316 16:05:37.154805 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/34a68caa-76db-4be4-9ecd-8955435c0e90-config-data\") pod \"cinder-scheduler-0\" (UID: \"34a68caa-76db-4be4-9ecd-8955435c0e90\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:05:37 crc kubenswrapper[5120]: I0316 16:05:37.154915 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-69lg2\" (UniqueName: \"kubernetes.io/projected/683d3459-b9fc-478c-b74e-c1a09fd45e4d-kube-api-access-69lg2\") pod \"nova-cell0-conductor-0\" (UID: \"683d3459-b9fc-478c-b74e-c1a09fd45e4d\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:05:37 crc kubenswrapper[5120]: I0316 16:05:37.154995 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/34a68caa-76db-4be4-9ecd-8955435c0e90-scripts\") pod \"cinder-scheduler-0\" (UID: \"34a68caa-76db-4be4-9ecd-8955435c0e90\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:05:37 crc kubenswrapper[5120]: I0316 16:05:37.155029 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/683d3459-b9fc-478c-b74e-c1a09fd45e4d-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"683d3459-b9fc-478c-b74e-c1a09fd45e4d\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:05:37 crc kubenswrapper[5120]: I0316 16:05:37.166849 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/34a68caa-76db-4be4-9ecd-8955435c0e90-config-data\") pod \"cinder-scheduler-0\" (UID: \"34a68caa-76db-4be4-9ecd-8955435c0e90\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:05:37 crc kubenswrapper[5120]: I0316 16:05:37.167294 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/34a68caa-76db-4be4-9ecd-8955435c0e90-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"34a68caa-76db-4be4-9ecd-8955435c0e90\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:05:37 crc kubenswrapper[5120]: I0316 16:05:37.184532 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/34a68caa-76db-4be4-9ecd-8955435c0e90-scripts\") pod \"cinder-scheduler-0\" (UID: \"34a68caa-76db-4be4-9ecd-8955435c0e90\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:05:37 crc kubenswrapper[5120]: I0316 16:05:37.184974 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/683d3459-b9fc-478c-b74e-c1a09fd45e4d-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"683d3459-b9fc-478c-b74e-c1a09fd45e4d\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:05:37 crc kubenswrapper[5120]: I0316 16:05:37.186360 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/34a68caa-76db-4be4-9ecd-8955435c0e90-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"34a68caa-76db-4be4-9ecd-8955435c0e90\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:05:37 crc kubenswrapper[5120]: I0316 16:05:37.192132 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqv59\" (UniqueName: \"kubernetes.io/projected/34a68caa-76db-4be4-9ecd-8955435c0e90-kube-api-access-tqv59\") pod \"cinder-scheduler-0\" (UID: \"34a68caa-76db-4be4-9ecd-8955435c0e90\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:05:37 crc kubenswrapper[5120]: I0316 16:05:37.192726 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/683d3459-b9fc-478c-b74e-c1a09fd45e4d-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"683d3459-b9fc-478c-b74e-c1a09fd45e4d\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:05:37 crc kubenswrapper[5120]: I0316 16:05:37.195615 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-69lg2\" (UniqueName: \"kubernetes.io/projected/683d3459-b9fc-478c-b74e-c1a09fd45e4d-kube-api-access-69lg2\") pod \"nova-cell0-conductor-0\" (UID: \"683d3459-b9fc-478c-b74e-c1a09fd45e4d\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:05:37 crc kubenswrapper[5120]: W0316 16:05:37.237285 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod52c2852f_8732_4310_8402_b925b49a12ea.slice/crio-3a141b46969ecdbc7c353d87dd4d47de6ecaa5ff1cb38a8000083611fe0011f0 WatchSource:0}: Error finding container 3a141b46969ecdbc7c353d87dd4d47de6ecaa5ff1cb38a8000083611fe0011f0: Status 404 returned error can't find the container with id 3a141b46969ecdbc7c353d87dd4d47de6ecaa5ff1cb38a8000083611fe0011f0 Mar 16 16:05:37 crc kubenswrapper[5120]: I0316 16:05:37.262738 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:05:37 crc kubenswrapper[5120]: I0316 16:05:37.342579 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:05:37 crc kubenswrapper[5120]: I0316 16:05:37.342922 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:05:37 crc kubenswrapper[5120]: I0316 16:05:37.358693 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:05:37 crc kubenswrapper[5120]: I0316 16:05:37.385053 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:05:37 crc kubenswrapper[5120]: I0316 16:05:37.460961 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-db2c8\" (UniqueName: \"kubernetes.io/projected/3ebc6d87-1ea4-4702-b166-ba35f25972b6-kube-api-access-db2c8\") pod \"3ebc6d87-1ea4-4702-b166-ba35f25972b6\" (UID: \"3ebc6d87-1ea4-4702-b166-ba35f25972b6\") " Mar 16 16:05:37 crc kubenswrapper[5120]: I0316 16:05:37.461286 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3b57a7de-40e8-484e-a2a9-55454c35ccd0-combined-ca-bundle\") pod \"3b57a7de-40e8-484e-a2a9-55454c35ccd0\" (UID: \"3b57a7de-40e8-484e-a2a9-55454c35ccd0\") " Mar 16 16:05:37 crc kubenswrapper[5120]: I0316 16:05:37.461325 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hj8nl\" (UniqueName: \"kubernetes.io/projected/3b57a7de-40e8-484e-a2a9-55454c35ccd0-kube-api-access-hj8nl\") pod \"3b57a7de-40e8-484e-a2a9-55454c35ccd0\" (UID: \"3b57a7de-40e8-484e-a2a9-55454c35ccd0\") " Mar 16 16:05:37 crc kubenswrapper[5120]: I0316 16:05:37.461442 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3ebc6d87-1ea4-4702-b166-ba35f25972b6-config-data\") pod \"3ebc6d87-1ea4-4702-b166-ba35f25972b6\" (UID: \"3ebc6d87-1ea4-4702-b166-ba35f25972b6\") " Mar 16 16:05:37 crc kubenswrapper[5120]: I0316 16:05:37.461463 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3ebc6d87-1ea4-4702-b166-ba35f25972b6-combined-ca-bundle\") pod \"3ebc6d87-1ea4-4702-b166-ba35f25972b6\" (UID: \"3ebc6d87-1ea4-4702-b166-ba35f25972b6\") " Mar 16 16:05:37 crc kubenswrapper[5120]: I0316 16:05:37.461491 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3b57a7de-40e8-484e-a2a9-55454c35ccd0-config-data\") pod \"3b57a7de-40e8-484e-a2a9-55454c35ccd0\" (UID: \"3b57a7de-40e8-484e-a2a9-55454c35ccd0\") " Mar 16 16:05:37 crc kubenswrapper[5120]: I0316 16:05:37.468725 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ebc6d87-1ea4-4702-b166-ba35f25972b6-kube-api-access-db2c8" (OuterVolumeSpecName: "kube-api-access-db2c8") pod "3ebc6d87-1ea4-4702-b166-ba35f25972b6" (UID: "3ebc6d87-1ea4-4702-b166-ba35f25972b6"). InnerVolumeSpecName "kube-api-access-db2c8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:05:37 crc kubenswrapper[5120]: I0316 16:05:37.474051 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b57a7de-40e8-484e-a2a9-55454c35ccd0-kube-api-access-hj8nl" (OuterVolumeSpecName: "kube-api-access-hj8nl") pod "3b57a7de-40e8-484e-a2a9-55454c35ccd0" (UID: "3b57a7de-40e8-484e-a2a9-55454c35ccd0"). InnerVolumeSpecName "kube-api-access-hj8nl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:05:37 crc kubenswrapper[5120]: I0316 16:05:37.539845 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b57a7de-40e8-484e-a2a9-55454c35ccd0-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "3b57a7de-40e8-484e-a2a9-55454c35ccd0" (UID: "3b57a7de-40e8-484e-a2a9-55454c35ccd0"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:37 crc kubenswrapper[5120]: I0316 16:05:37.556264 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b57a7de-40e8-484e-a2a9-55454c35ccd0-config-data" (OuterVolumeSpecName: "config-data") pod "3b57a7de-40e8-484e-a2a9-55454c35ccd0" (UID: "3b57a7de-40e8-484e-a2a9-55454c35ccd0"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:37 crc kubenswrapper[5120]: I0316 16:05:37.564047 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-db2c8\" (UniqueName: \"kubernetes.io/projected/3ebc6d87-1ea4-4702-b166-ba35f25972b6-kube-api-access-db2c8\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:37 crc kubenswrapper[5120]: I0316 16:05:37.564070 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3b57a7de-40e8-484e-a2a9-55454c35ccd0-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:37 crc kubenswrapper[5120]: I0316 16:05:37.564082 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hj8nl\" (UniqueName: \"kubernetes.io/projected/3b57a7de-40e8-484e-a2a9-55454c35ccd0-kube-api-access-hj8nl\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:37 crc kubenswrapper[5120]: I0316 16:05:37.564113 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3b57a7de-40e8-484e-a2a9-55454c35ccd0-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:37 crc kubenswrapper[5120]: I0316 16:05:37.581404 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3ebc6d87-1ea4-4702-b166-ba35f25972b6-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "3ebc6d87-1ea4-4702-b166-ba35f25972b6" (UID: "3ebc6d87-1ea4-4702-b166-ba35f25972b6"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:37 crc kubenswrapper[5120]: I0316 16:05:37.590916 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3ebc6d87-1ea4-4702-b166-ba35f25972b6-config-data" (OuterVolumeSpecName: "config-data") pod "3ebc6d87-1ea4-4702-b166-ba35f25972b6" (UID: "3ebc6d87-1ea4-4702-b166-ba35f25972b6"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:37 crc kubenswrapper[5120]: I0316 16:05:37.667945 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3ebc6d87-1ea4-4702-b166-ba35f25972b6-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:37 crc kubenswrapper[5120]: I0316 16:05:37.667975 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3ebc6d87-1ea4-4702-b166-ba35f25972b6-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:37 crc kubenswrapper[5120]: I0316 16:05:37.814114 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"52c2852f-8732-4310-8402-b925b49a12ea","Type":"ContainerStarted","Data":"3a141b46969ecdbc7c353d87dd4d47de6ecaa5ff1cb38a8000083611fe0011f0"} Mar 16 16:05:37 crc kubenswrapper[5120]: I0316 16:05:37.836538 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-7dcb9fc94d-5c4n9"] Mar 16 16:05:37 crc kubenswrapper[5120]: I0316 16:05:37.838846 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b57a7de-40e8-484e-a2a9-55454c35ccd0" containerName="nova-cell1-conductor-conductor" Mar 16 16:05:37 crc kubenswrapper[5120]: I0316 16:05:37.838873 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b57a7de-40e8-484e-a2a9-55454c35ccd0" containerName="nova-cell1-conductor-conductor" Mar 16 16:05:37 crc kubenswrapper[5120]: I0316 16:05:37.838935 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ebc6d87-1ea4-4702-b166-ba35f25972b6" containerName="nova-scheduler-scheduler" Mar 16 16:05:37 crc kubenswrapper[5120]: I0316 16:05:37.838942 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ebc6d87-1ea4-4702-b166-ba35f25972b6" containerName="nova-scheduler-scheduler" Mar 16 16:05:37 crc kubenswrapper[5120]: I0316 16:05:37.839126 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="3b57a7de-40e8-484e-a2a9-55454c35ccd0" containerName="nova-cell1-conductor-conductor" Mar 16 16:05:37 crc kubenswrapper[5120]: I0316 16:05:37.839153 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="3ebc6d87-1ea4-4702-b166-ba35f25972b6" containerName="nova-scheduler-scheduler" Mar 16 16:05:37 crc kubenswrapper[5120]: I0316 16:05:37.846487 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-7dcb9fc94d-5c4n9" Mar 16 16:05:37 crc kubenswrapper[5120]: I0316 16:05:37.865289 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-7dcb9fc94d-5c4n9"] Mar 16 16:05:37 crc kubenswrapper[5120]: I0316 16:05:37.865970 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:05:37 crc kubenswrapper[5120]: I0316 16:05:37.865985 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"3b57a7de-40e8-484e-a2a9-55454c35ccd0","Type":"ContainerDied","Data":"d3864a13b7bfb1ddb33be82ed65404c76208fba69210482cb6367042106f54c2"} Mar 16 16:05:37 crc kubenswrapper[5120]: I0316 16:05:37.866966 5120 scope.go:117] "RemoveContainer" containerID="e5ac583ccc9724ef6e7100e99c0c22e3b118431b2c90d1bb0d71d736f0583622" Mar 16 16:05:37 crc kubenswrapper[5120]: I0316 16:05:37.882378 5120 generic.go:358] "Generic (PLEG): container finished" podID="3ebc6d87-1ea4-4702-b166-ba35f25972b6" containerID="eff80265be11a9f35bed980c90ec7b17787848134b0779846cf1cf326e03ffdf" exitCode=0 Mar 16 16:05:37 crc kubenswrapper[5120]: I0316 16:05:37.882461 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"3ebc6d87-1ea4-4702-b166-ba35f25972b6","Type":"ContainerDied","Data":"eff80265be11a9f35bed980c90ec7b17787848134b0779846cf1cf326e03ffdf"} Mar 16 16:05:37 crc kubenswrapper[5120]: I0316 16:05:37.882488 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"3ebc6d87-1ea4-4702-b166-ba35f25972b6","Type":"ContainerDied","Data":"ce8e12a91269e3b6faa45ce17ddaaae0c95306bd5a61a6595c6e9133bfb4d453"} Mar 16 16:05:37 crc kubenswrapper[5120]: I0316 16:05:37.882545 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:05:37 crc kubenswrapper[5120]: I0316 16:05:37.907263 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-worker-c76f59879-tpdpx"] Mar 16 16:05:37 crc kubenswrapper[5120]: I0316 16:05:37.931733 5120 generic.go:358] "Generic (PLEG): container finished" podID="dbb06351-e6e7-4a49-a941-33b16fc6206d" containerID="d6fc349f836b03a8939dfbaec2c3ff1e2196bfd6ed181b5867b764b47417dff0" exitCode=0 Mar 16 16:05:37 crc kubenswrapper[5120]: I0316 16:05:37.941606 5120 scope.go:117] "RemoveContainer" containerID="eff80265be11a9f35bed980c90ec7b17787848134b0779846cf1cf326e03ffdf" Mar 16 16:05:37 crc kubenswrapper[5120]: I0316 16:05:37.943892 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:05:37 crc kubenswrapper[5120]: I0316 16:05:37.943961 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"dbb06351-e6e7-4a49-a941-33b16fc6206d","Type":"ContainerDied","Data":"d6fc349f836b03a8939dfbaec2c3ff1e2196bfd6ed181b5867b764b47417dff0"} Mar 16 16:05:37 crc kubenswrapper[5120]: I0316 16:05:37.944010 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"5b630779-e8f9-434c-9449-d2aad103f041","Type":"ContainerStarted","Data":"6b492be3458dba056e2631b8befc2aaceb7eb83de082f3e234d239baab32764d"} Mar 16 16:05:37 crc kubenswrapper[5120]: I0316 16:05:37.944027 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-c76f59879-tpdpx"] Mar 16 16:05:37 crc kubenswrapper[5120]: I0316 16:05:37.944145 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-c76f59879-tpdpx" Mar 16 16:05:37 crc kubenswrapper[5120]: I0316 16:05:37.957715 5120 generic.go:358] "Generic (PLEG): container finished" podID="bf01270c-6ae8-4c7f-aee3-42a125c155e4" containerID="f8852284e9aa7bf5f9936f8b164ef155d866b0509c8c5f804bc8c607e3bf3da3" exitCode=0 Mar 16 16:05:37 crc kubenswrapper[5120]: I0316 16:05:37.957884 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"bf01270c-6ae8-4c7f-aee3-42a125c155e4","Type":"ContainerDied","Data":"f8852284e9aa7bf5f9936f8b164ef155d866b0509c8c5f804bc8c607e3bf3da3"} Mar 16 16:05:37 crc kubenswrapper[5120]: I0316 16:05:37.976030 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxg2f\" (UniqueName: \"kubernetes.io/projected/e2185e65-e56e-4f2e-929e-9caa246e5961-kube-api-access-qxg2f\") pod \"barbican-keystone-listener-7dcb9fc94d-5c4n9\" (UID: \"e2185e65-e56e-4f2e-929e-9caa246e5961\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7dcb9fc94d-5c4n9" Mar 16 16:05:37 crc kubenswrapper[5120]: I0316 16:05:37.976144 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/e2185e65-e56e-4f2e-929e-9caa246e5961-config-data-custom\") pod \"barbican-keystone-listener-7dcb9fc94d-5c4n9\" (UID: \"e2185e65-e56e-4f2e-929e-9caa246e5961\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7dcb9fc94d-5c4n9" Mar 16 16:05:37 crc kubenswrapper[5120]: I0316 16:05:37.976182 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e2185e65-e56e-4f2e-929e-9caa246e5961-logs\") pod \"barbican-keystone-listener-7dcb9fc94d-5c4n9\" (UID: \"e2185e65-e56e-4f2e-929e-9caa246e5961\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7dcb9fc94d-5c4n9" Mar 16 16:05:37 crc kubenswrapper[5120]: I0316 16:05:37.976202 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e2185e65-e56e-4f2e-929e-9caa246e5961-combined-ca-bundle\") pod \"barbican-keystone-listener-7dcb9fc94d-5c4n9\" (UID: \"e2185e65-e56e-4f2e-929e-9caa246e5961\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7dcb9fc94d-5c4n9" Mar 16 16:05:37 crc kubenswrapper[5120]: I0316 16:05:37.976259 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e2185e65-e56e-4f2e-929e-9caa246e5961-config-data\") pod \"barbican-keystone-listener-7dcb9fc94d-5c4n9\" (UID: \"e2185e65-e56e-4f2e-929e-9caa246e5961\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7dcb9fc94d-5c4n9" Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.009836 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-api-857694d5fb-pdlqj"] Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.010964 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf01270c-6ae8-4c7f-aee3-42a125c155e4" containerName="nova-metadata-metadata" Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.010983 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf01270c-6ae8-4c7f-aee3-42a125c155e4" containerName="nova-metadata-metadata" Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.010998 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf01270c-6ae8-4c7f-aee3-42a125c155e4" containerName="nova-metadata-log" Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.011004 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf01270c-6ae8-4c7f-aee3-42a125c155e4" containerName="nova-metadata-log" Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.011245 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="bf01270c-6ae8-4c7f-aee3-42a125c155e4" containerName="nova-metadata-log" Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.011262 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="bf01270c-6ae8-4c7f-aee3-42a125c155e4" containerName="nova-metadata-metadata" Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.015454 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-857694d5fb-pdlqj" Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.035682 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-857694d5fb-pdlqj"] Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.062843 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.072918 5120 scope.go:117] "RemoveContainer" containerID="eff80265be11a9f35bed980c90ec7b17787848134b0779846cf1cf326e03ffdf" Mar 16 16:05:38 crc kubenswrapper[5120]: E0316 16:05:38.077442 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eff80265be11a9f35bed980c90ec7b17787848134b0779846cf1cf326e03ffdf\": container with ID starting with eff80265be11a9f35bed980c90ec7b17787848134b0779846cf1cf326e03ffdf not found: ID does not exist" containerID="eff80265be11a9f35bed980c90ec7b17787848134b0779846cf1cf326e03ffdf" Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.077491 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eff80265be11a9f35bed980c90ec7b17787848134b0779846cf1cf326e03ffdf"} err="failed to get container status \"eff80265be11a9f35bed980c90ec7b17787848134b0779846cf1cf326e03ffdf\": rpc error: code = NotFound desc = could not find container \"eff80265be11a9f35bed980c90ec7b17787848134b0779846cf1cf326e03ffdf\": container with ID starting with eff80265be11a9f35bed980c90ec7b17787848134b0779846cf1cf326e03ffdf not found: ID does not exist" Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.077510 5120 scope.go:117] "RemoveContainer" containerID="f8852284e9aa7bf5f9936f8b164ef155d866b0509c8c5f804bc8c607e3bf3da3" Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.078730 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lzfqm\" (UniqueName: \"kubernetes.io/projected/bf01270c-6ae8-4c7f-aee3-42a125c155e4-kube-api-access-lzfqm\") pod \"bf01270c-6ae8-4c7f-aee3-42a125c155e4\" (UID: \"bf01270c-6ae8-4c7f-aee3-42a125c155e4\") " Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.078811 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/bf01270c-6ae8-4c7f-aee3-42a125c155e4-nova-metadata-tls-certs\") pod \"bf01270c-6ae8-4c7f-aee3-42a125c155e4\" (UID: \"bf01270c-6ae8-4c7f-aee3-42a125c155e4\") " Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.078880 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bf01270c-6ae8-4c7f-aee3-42a125c155e4-config-data\") pod \"bf01270c-6ae8-4c7f-aee3-42a125c155e4\" (UID: \"bf01270c-6ae8-4c7f-aee3-42a125c155e4\") " Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.079001 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/bf01270c-6ae8-4c7f-aee3-42a125c155e4-logs\") pod \"bf01270c-6ae8-4c7f-aee3-42a125c155e4\" (UID: \"bf01270c-6ae8-4c7f-aee3-42a125c155e4\") " Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.079023 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bf01270c-6ae8-4c7f-aee3-42a125c155e4-combined-ca-bundle\") pod \"bf01270c-6ae8-4c7f-aee3-42a125c155e4\" (UID: \"bf01270c-6ae8-4c7f-aee3-42a125c155e4\") " Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.079374 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/e2185e65-e56e-4f2e-929e-9caa246e5961-config-data-custom\") pod \"barbican-keystone-listener-7dcb9fc94d-5c4n9\" (UID: \"e2185e65-e56e-4f2e-929e-9caa246e5961\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7dcb9fc94d-5c4n9" Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.079407 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ab84006c-23ad-4247-abe7-0d1016d65297-combined-ca-bundle\") pod \"barbican-worker-c76f59879-tpdpx\" (UID: \"ab84006c-23ad-4247-abe7-0d1016d65297\") " pod="openstack-kuttl-tests/barbican-worker-c76f59879-tpdpx" Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.079435 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e2185e65-e56e-4f2e-929e-9caa246e5961-logs\") pod \"barbican-keystone-listener-7dcb9fc94d-5c4n9\" (UID: \"e2185e65-e56e-4f2e-929e-9caa246e5961\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7dcb9fc94d-5c4n9" Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.079456 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e2185e65-e56e-4f2e-929e-9caa246e5961-combined-ca-bundle\") pod \"barbican-keystone-listener-7dcb9fc94d-5c4n9\" (UID: \"e2185e65-e56e-4f2e-929e-9caa246e5961\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7dcb9fc94d-5c4n9" Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.079514 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ab84006c-23ad-4247-abe7-0d1016d65297-logs\") pod \"barbican-worker-c76f59879-tpdpx\" (UID: \"ab84006c-23ad-4247-abe7-0d1016d65297\") " pod="openstack-kuttl-tests/barbican-worker-c76f59879-tpdpx" Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.079538 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e2185e65-e56e-4f2e-929e-9caa246e5961-config-data\") pod \"barbican-keystone-listener-7dcb9fc94d-5c4n9\" (UID: \"e2185e65-e56e-4f2e-929e-9caa246e5961\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7dcb9fc94d-5c4n9" Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.079564 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bb0a18f2-a95f-4ee1-b6a6-d0400f70760f-config-data\") pod \"barbican-api-857694d5fb-pdlqj\" (UID: \"bb0a18f2-a95f-4ee1-b6a6-d0400f70760f\") " pod="openstack-kuttl-tests/barbican-api-857694d5fb-pdlqj" Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.079591 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/bb0a18f2-a95f-4ee1-b6a6-d0400f70760f-config-data-custom\") pod \"barbican-api-857694d5fb-pdlqj\" (UID: \"bb0a18f2-a95f-4ee1-b6a6-d0400f70760f\") " pod="openstack-kuttl-tests/barbican-api-857694d5fb-pdlqj" Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.079620 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57rgw\" (UniqueName: \"kubernetes.io/projected/bb0a18f2-a95f-4ee1-b6a6-d0400f70760f-kube-api-access-57rgw\") pod \"barbican-api-857694d5fb-pdlqj\" (UID: \"bb0a18f2-a95f-4ee1-b6a6-d0400f70760f\") " pod="openstack-kuttl-tests/barbican-api-857694d5fb-pdlqj" Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.079645 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bb0a18f2-a95f-4ee1-b6a6-d0400f70760f-combined-ca-bundle\") pod \"barbican-api-857694d5fb-pdlqj\" (UID: \"bb0a18f2-a95f-4ee1-b6a6-d0400f70760f\") " pod="openstack-kuttl-tests/barbican-api-857694d5fb-pdlqj" Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.079670 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ab84006c-23ad-4247-abe7-0d1016d65297-config-data\") pod \"barbican-worker-c76f59879-tpdpx\" (UID: \"ab84006c-23ad-4247-abe7-0d1016d65297\") " pod="openstack-kuttl-tests/barbican-worker-c76f59879-tpdpx" Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.080128 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e2185e65-e56e-4f2e-929e-9caa246e5961-logs\") pod \"barbican-keystone-listener-7dcb9fc94d-5c4n9\" (UID: \"e2185e65-e56e-4f2e-929e-9caa246e5961\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7dcb9fc94d-5c4n9" Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.079728 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/bb0a18f2-a95f-4ee1-b6a6-d0400f70760f-logs\") pod \"barbican-api-857694d5fb-pdlqj\" (UID: \"bb0a18f2-a95f-4ee1-b6a6-d0400f70760f\") " pod="openstack-kuttl-tests/barbican-api-857694d5fb-pdlqj" Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.083837 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qxg2f\" (UniqueName: \"kubernetes.io/projected/e2185e65-e56e-4f2e-929e-9caa246e5961-kube-api-access-qxg2f\") pod \"barbican-keystone-listener-7dcb9fc94d-5c4n9\" (UID: \"e2185e65-e56e-4f2e-929e-9caa246e5961\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7dcb9fc94d-5c4n9" Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.083904 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/bb0a18f2-a95f-4ee1-b6a6-d0400f70760f-internal-tls-certs\") pod \"barbican-api-857694d5fb-pdlqj\" (UID: \"bb0a18f2-a95f-4ee1-b6a6-d0400f70760f\") " pod="openstack-kuttl-tests/barbican-api-857694d5fb-pdlqj" Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.083976 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/bb0a18f2-a95f-4ee1-b6a6-d0400f70760f-public-tls-certs\") pod \"barbican-api-857694d5fb-pdlqj\" (UID: \"bb0a18f2-a95f-4ee1-b6a6-d0400f70760f\") " pod="openstack-kuttl-tests/barbican-api-857694d5fb-pdlqj" Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.084019 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbltt\" (UniqueName: \"kubernetes.io/projected/ab84006c-23ad-4247-abe7-0d1016d65297-kube-api-access-fbltt\") pod \"barbican-worker-c76f59879-tpdpx\" (UID: \"ab84006c-23ad-4247-abe7-0d1016d65297\") " pod="openstack-kuttl-tests/barbican-worker-c76f59879-tpdpx" Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.084045 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/ab84006c-23ad-4247-abe7-0d1016d65297-config-data-custom\") pod \"barbican-worker-c76f59879-tpdpx\" (UID: \"ab84006c-23ad-4247-abe7-0d1016d65297\") " pod="openstack-kuttl-tests/barbican-worker-c76f59879-tpdpx" Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.094823 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.096963 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf01270c-6ae8-4c7f-aee3-42a125c155e4-logs" (OuterVolumeSpecName: "logs") pod "bf01270c-6ae8-4c7f-aee3-42a125c155e4" (UID: "bf01270c-6ae8-4c7f-aee3-42a125c155e4"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.104974 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxg2f\" (UniqueName: \"kubernetes.io/projected/e2185e65-e56e-4f2e-929e-9caa246e5961-kube-api-access-qxg2f\") pod \"barbican-keystone-listener-7dcb9fc94d-5c4n9\" (UID: \"e2185e65-e56e-4f2e-929e-9caa246e5961\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7dcb9fc94d-5c4n9" Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.109796 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/e2185e65-e56e-4f2e-929e-9caa246e5961-config-data-custom\") pod \"barbican-keystone-listener-7dcb9fc94d-5c4n9\" (UID: \"e2185e65-e56e-4f2e-929e-9caa246e5961\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7dcb9fc94d-5c4n9" Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.112951 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf01270c-6ae8-4c7f-aee3-42a125c155e4-kube-api-access-lzfqm" (OuterVolumeSpecName: "kube-api-access-lzfqm") pod "bf01270c-6ae8-4c7f-aee3-42a125c155e4" (UID: "bf01270c-6ae8-4c7f-aee3-42a125c155e4"). InnerVolumeSpecName "kube-api-access-lzfqm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.117399 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e2185e65-e56e-4f2e-929e-9caa246e5961-combined-ca-bundle\") pod \"barbican-keystone-listener-7dcb9fc94d-5c4n9\" (UID: \"e2185e65-e56e-4f2e-929e-9caa246e5961\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7dcb9fc94d-5c4n9" Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.121220 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e2185e65-e56e-4f2e-929e-9caa246e5961-config-data\") pod \"barbican-keystone-listener-7dcb9fc94d-5c4n9\" (UID: \"e2185e65-e56e-4f2e-929e-9caa246e5961\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7dcb9fc94d-5c4n9" Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.130825 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.150118 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bf01270c-6ae8-4c7f-aee3-42a125c155e4-config-data" (OuterVolumeSpecName: "config-data") pod "bf01270c-6ae8-4c7f-aee3-42a125c155e4" (UID: "bf01270c-6ae8-4c7f-aee3-42a125c155e4"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.165643 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.167795 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-conductor-config-data\"" Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.171684 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bf01270c-6ae8-4c7f-aee3-42a125c155e4-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "bf01270c-6ae8-4c7f-aee3-42a125c155e4" (UID: "bf01270c-6ae8-4c7f-aee3-42a125c155e4"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.182443 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.186928 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/bb0a18f2-a95f-4ee1-b6a6-d0400f70760f-logs\") pod \"barbican-api-857694d5fb-pdlqj\" (UID: \"bb0a18f2-a95f-4ee1-b6a6-d0400f70760f\") " pod="openstack-kuttl-tests/barbican-api-857694d5fb-pdlqj" Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.187005 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/bb0a18f2-a95f-4ee1-b6a6-d0400f70760f-internal-tls-certs\") pod \"barbican-api-857694d5fb-pdlqj\" (UID: \"bb0a18f2-a95f-4ee1-b6a6-d0400f70760f\") " pod="openstack-kuttl-tests/barbican-api-857694d5fb-pdlqj" Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.187052 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/bb0a18f2-a95f-4ee1-b6a6-d0400f70760f-public-tls-certs\") pod \"barbican-api-857694d5fb-pdlqj\" (UID: \"bb0a18f2-a95f-4ee1-b6a6-d0400f70760f\") " pod="openstack-kuttl-tests/barbican-api-857694d5fb-pdlqj" Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.187084 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fbltt\" (UniqueName: \"kubernetes.io/projected/ab84006c-23ad-4247-abe7-0d1016d65297-kube-api-access-fbltt\") pod \"barbican-worker-c76f59879-tpdpx\" (UID: \"ab84006c-23ad-4247-abe7-0d1016d65297\") " pod="openstack-kuttl-tests/barbican-worker-c76f59879-tpdpx" Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.187109 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/ab84006c-23ad-4247-abe7-0d1016d65297-config-data-custom\") pod \"barbican-worker-c76f59879-tpdpx\" (UID: \"ab84006c-23ad-4247-abe7-0d1016d65297\") " pod="openstack-kuttl-tests/barbican-worker-c76f59879-tpdpx" Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.187139 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ab84006c-23ad-4247-abe7-0d1016d65297-combined-ca-bundle\") pod \"barbican-worker-c76f59879-tpdpx\" (UID: \"ab84006c-23ad-4247-abe7-0d1016d65297\") " pod="openstack-kuttl-tests/barbican-worker-c76f59879-tpdpx" Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.187206 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ab84006c-23ad-4247-abe7-0d1016d65297-logs\") pod \"barbican-worker-c76f59879-tpdpx\" (UID: \"ab84006c-23ad-4247-abe7-0d1016d65297\") " pod="openstack-kuttl-tests/barbican-worker-c76f59879-tpdpx" Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.187237 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bb0a18f2-a95f-4ee1-b6a6-d0400f70760f-config-data\") pod \"barbican-api-857694d5fb-pdlqj\" (UID: \"bb0a18f2-a95f-4ee1-b6a6-d0400f70760f\") " pod="openstack-kuttl-tests/barbican-api-857694d5fb-pdlqj" Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.187263 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/bb0a18f2-a95f-4ee1-b6a6-d0400f70760f-config-data-custom\") pod \"barbican-api-857694d5fb-pdlqj\" (UID: \"bb0a18f2-a95f-4ee1-b6a6-d0400f70760f\") " pod="openstack-kuttl-tests/barbican-api-857694d5fb-pdlqj" Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.187288 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-57rgw\" (UniqueName: \"kubernetes.io/projected/bb0a18f2-a95f-4ee1-b6a6-d0400f70760f-kube-api-access-57rgw\") pod \"barbican-api-857694d5fb-pdlqj\" (UID: \"bb0a18f2-a95f-4ee1-b6a6-d0400f70760f\") " pod="openstack-kuttl-tests/barbican-api-857694d5fb-pdlqj" Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.187311 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bb0a18f2-a95f-4ee1-b6a6-d0400f70760f-combined-ca-bundle\") pod \"barbican-api-857694d5fb-pdlqj\" (UID: \"bb0a18f2-a95f-4ee1-b6a6-d0400f70760f\") " pod="openstack-kuttl-tests/barbican-api-857694d5fb-pdlqj" Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.187339 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ab84006c-23ad-4247-abe7-0d1016d65297-config-data\") pod \"barbican-worker-c76f59879-tpdpx\" (UID: \"ab84006c-23ad-4247-abe7-0d1016d65297\") " pod="openstack-kuttl-tests/barbican-worker-c76f59879-tpdpx" Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.187403 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lzfqm\" (UniqueName: \"kubernetes.io/projected/bf01270c-6ae8-4c7f-aee3-42a125c155e4-kube-api-access-lzfqm\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.187416 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bf01270c-6ae8-4c7f-aee3-42a125c155e4-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.187425 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/bf01270c-6ae8-4c7f-aee3-42a125c155e4-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.187433 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bf01270c-6ae8-4c7f-aee3-42a125c155e4-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.191589 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ab84006c-23ad-4247-abe7-0d1016d65297-logs\") pod \"barbican-worker-c76f59879-tpdpx\" (UID: \"ab84006c-23ad-4247-abe7-0d1016d65297\") " pod="openstack-kuttl-tests/barbican-worker-c76f59879-tpdpx" Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.196086 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/bb0a18f2-a95f-4ee1-b6a6-d0400f70760f-logs\") pod \"barbican-api-857694d5fb-pdlqj\" (UID: \"bb0a18f2-a95f-4ee1-b6a6-d0400f70760f\") " pod="openstack-kuttl-tests/barbican-api-857694d5fb-pdlqj" Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.198514 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bb0a18f2-a95f-4ee1-b6a6-d0400f70760f-config-data\") pod \"barbican-api-857694d5fb-pdlqj\" (UID: \"bb0a18f2-a95f-4ee1-b6a6-d0400f70760f\") " pod="openstack-kuttl-tests/barbican-api-857694d5fb-pdlqj" Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.198983 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ab84006c-23ad-4247-abe7-0d1016d65297-config-data\") pod \"barbican-worker-c76f59879-tpdpx\" (UID: \"ab84006c-23ad-4247-abe7-0d1016d65297\") " pod="openstack-kuttl-tests/barbican-worker-c76f59879-tpdpx" Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.245952 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/ab84006c-23ad-4247-abe7-0d1016d65297-config-data-custom\") pod \"barbican-worker-c76f59879-tpdpx\" (UID: \"ab84006c-23ad-4247-abe7-0d1016d65297\") " pod="openstack-kuttl-tests/barbican-worker-c76f59879-tpdpx" Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.246143 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bb0a18f2-a95f-4ee1-b6a6-d0400f70760f-combined-ca-bundle\") pod \"barbican-api-857694d5fb-pdlqj\" (UID: \"bb0a18f2-a95f-4ee1-b6a6-d0400f70760f\") " pod="openstack-kuttl-tests/barbican-api-857694d5fb-pdlqj" Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.246629 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/bb0a18f2-a95f-4ee1-b6a6-d0400f70760f-public-tls-certs\") pod \"barbican-api-857694d5fb-pdlqj\" (UID: \"bb0a18f2-a95f-4ee1-b6a6-d0400f70760f\") " pod="openstack-kuttl-tests/barbican-api-857694d5fb-pdlqj" Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.246990 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/bb0a18f2-a95f-4ee1-b6a6-d0400f70760f-internal-tls-certs\") pod \"barbican-api-857694d5fb-pdlqj\" (UID: \"bb0a18f2-a95f-4ee1-b6a6-d0400f70760f\") " pod="openstack-kuttl-tests/barbican-api-857694d5fb-pdlqj" Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.251382 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbltt\" (UniqueName: \"kubernetes.io/projected/ab84006c-23ad-4247-abe7-0d1016d65297-kube-api-access-fbltt\") pod \"barbican-worker-c76f59879-tpdpx\" (UID: \"ab84006c-23ad-4247-abe7-0d1016d65297\") " pod="openstack-kuttl-tests/barbican-worker-c76f59879-tpdpx" Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.251987 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/bb0a18f2-a95f-4ee1-b6a6-d0400f70760f-config-data-custom\") pod \"barbican-api-857694d5fb-pdlqj\" (UID: \"bb0a18f2-a95f-4ee1-b6a6-d0400f70760f\") " pod="openstack-kuttl-tests/barbican-api-857694d5fb-pdlqj" Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.252577 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bf01270c-6ae8-4c7f-aee3-42a125c155e4-nova-metadata-tls-certs" (OuterVolumeSpecName: "nova-metadata-tls-certs") pod "bf01270c-6ae8-4c7f-aee3-42a125c155e4" (UID: "bf01270c-6ae8-4c7f-aee3-42a125c155e4"). InnerVolumeSpecName "nova-metadata-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.253883 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-57rgw\" (UniqueName: \"kubernetes.io/projected/bb0a18f2-a95f-4ee1-b6a6-d0400f70760f-kube-api-access-57rgw\") pod \"barbican-api-857694d5fb-pdlqj\" (UID: \"bb0a18f2-a95f-4ee1-b6a6-d0400f70760f\") " pod="openstack-kuttl-tests/barbican-api-857694d5fb-pdlqj" Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.258084 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-7dcb9fc94d-5c4n9" Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.290943 5120 scope.go:117] "RemoveContainer" containerID="7edc213d41fc38f7529c3978651267fea171acd33243384a105115f62973a9ef" Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.291442 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8f091159-612f-4c40-b215-344c86fe9f65-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"8f091159-612f-4c40-b215-344c86fe9f65\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.291919 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvq9p\" (UniqueName: \"kubernetes.io/projected/8f091159-612f-4c40-b215-344c86fe9f65-kube-api-access-bvq9p\") pod \"nova-cell1-conductor-0\" (UID: \"8f091159-612f-4c40-b215-344c86fe9f65\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.292341 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8f091159-612f-4c40-b215-344c86fe9f65-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"8f091159-612f-4c40-b215-344c86fe9f65\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.292744 5120 reconciler_common.go:299] "Volume detached for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/bf01270c-6ae8-4c7f-aee3-42a125c155e4-nova-metadata-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.301355 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ab84006c-23ad-4247-abe7-0d1016d65297-combined-ca-bundle\") pod \"barbican-worker-c76f59879-tpdpx\" (UID: \"ab84006c-23ad-4247-abe7-0d1016d65297\") " pod="openstack-kuttl-tests/barbican-worker-c76f59879-tpdpx" Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.302979 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-c76f59879-tpdpx" Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.325799 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.341518 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.351194 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.352408 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-857694d5fb-pdlqj" Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.367969 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.375260 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-scheduler-config-data\"" Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.376695 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.388962 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.394035 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.395251 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8f091159-612f-4c40-b215-344c86fe9f65-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"8f091159-612f-4c40-b215-344c86fe9f65\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.395446 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8f091159-612f-4c40-b215-344c86fe9f65-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"8f091159-612f-4c40-b215-344c86fe9f65\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.395473 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bvq9p\" (UniqueName: \"kubernetes.io/projected/8f091159-612f-4c40-b215-344c86fe9f65-kube-api-access-bvq9p\") pod \"nova-cell1-conductor-0\" (UID: \"8f091159-612f-4c40-b215-344c86fe9f65\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.404337 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8f091159-612f-4c40-b215-344c86fe9f65-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"8f091159-612f-4c40-b215-344c86fe9f65\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.413914 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8f091159-612f-4c40-b215-344c86fe9f65-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"8f091159-612f-4c40-b215-344c86fe9f65\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.418466 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvq9p\" (UniqueName: \"kubernetes.io/projected/8f091159-612f-4c40-b215-344c86fe9f65-kube-api-access-bvq9p\") pod \"nova-cell1-conductor-0\" (UID: \"8f091159-612f-4c40-b215-344c86fe9f65\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.497236 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dbb06351-e6e7-4a49-a941-33b16fc6206d-combined-ca-bundle\") pod \"dbb06351-e6e7-4a49-a941-33b16fc6206d\" (UID: \"dbb06351-e6e7-4a49-a941-33b16fc6206d\") " Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.497328 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hh7rw\" (UniqueName: \"kubernetes.io/projected/dbb06351-e6e7-4a49-a941-33b16fc6206d-kube-api-access-hh7rw\") pod \"dbb06351-e6e7-4a49-a941-33b16fc6206d\" (UID: \"dbb06351-e6e7-4a49-a941-33b16fc6206d\") " Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.497373 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dbb06351-e6e7-4a49-a941-33b16fc6206d-config-data\") pod \"dbb06351-e6e7-4a49-a941-33b16fc6206d\" (UID: \"dbb06351-e6e7-4a49-a941-33b16fc6206d\") " Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.497406 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/dbb06351-e6e7-4a49-a941-33b16fc6206d-logs\") pod \"dbb06351-e6e7-4a49-a941-33b16fc6206d\" (UID: \"dbb06351-e6e7-4a49-a941-33b16fc6206d\") " Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.497432 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/dbb06351-e6e7-4a49-a941-33b16fc6206d-public-tls-certs\") pod \"dbb06351-e6e7-4a49-a941-33b16fc6206d\" (UID: \"dbb06351-e6e7-4a49-a941-33b16fc6206d\") " Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.497496 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/dbb06351-e6e7-4a49-a941-33b16fc6206d-internal-tls-certs\") pod \"dbb06351-e6e7-4a49-a941-33b16fc6206d\" (UID: \"dbb06351-e6e7-4a49-a941-33b16fc6206d\") " Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.497994 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6645a7f0-de34-43c5-9422-1483edda0298-config-data\") pod \"nova-scheduler-0\" (UID: \"6645a7f0-de34-43c5-9422-1483edda0298\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.498098 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6645a7f0-de34-43c5-9422-1483edda0298-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"6645a7f0-de34-43c5-9422-1483edda0298\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.498152 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nl4tt\" (UniqueName: \"kubernetes.io/projected/6645a7f0-de34-43c5-9422-1483edda0298-kube-api-access-nl4tt\") pod \"nova-scheduler-0\" (UID: \"6645a7f0-de34-43c5-9422-1483edda0298\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.505382 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.507746 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.509942 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbb06351-e6e7-4a49-a941-33b16fc6206d-logs" (OuterVolumeSpecName: "logs") pod "dbb06351-e6e7-4a49-a941-33b16fc6206d" (UID: "dbb06351-e6e7-4a49-a941-33b16fc6206d"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.512813 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dbb06351-e6e7-4a49-a941-33b16fc6206d-kube-api-access-hh7rw" (OuterVolumeSpecName: "kube-api-access-hh7rw") pod "dbb06351-e6e7-4a49-a941-33b16fc6206d" (UID: "dbb06351-e6e7-4a49-a941-33b16fc6206d"). InnerVolumeSpecName "kube-api-access-hh7rw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.570172 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dbb06351-e6e7-4a49-a941-33b16fc6206d-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "dbb06351-e6e7-4a49-a941-33b16fc6206d" (UID: "dbb06351-e6e7-4a49-a941-33b16fc6206d"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.603216 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nl4tt\" (UniqueName: \"kubernetes.io/projected/6645a7f0-de34-43c5-9422-1483edda0298-kube-api-access-nl4tt\") pod \"nova-scheduler-0\" (UID: \"6645a7f0-de34-43c5-9422-1483edda0298\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.603584 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6645a7f0-de34-43c5-9422-1483edda0298-config-data\") pod \"nova-scheduler-0\" (UID: \"6645a7f0-de34-43c5-9422-1483edda0298\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.603875 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6645a7f0-de34-43c5-9422-1483edda0298-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"6645a7f0-de34-43c5-9422-1483edda0298\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.603949 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dbb06351-e6e7-4a49-a941-33b16fc6206d-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.603964 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hh7rw\" (UniqueName: \"kubernetes.io/projected/dbb06351-e6e7-4a49-a941-33b16fc6206d-kube-api-access-hh7rw\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.603974 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/dbb06351-e6e7-4a49-a941-33b16fc6206d-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.609218 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-scheduler-config-data\"" Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.610588 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dbb06351-e6e7-4a49-a941-33b16fc6206d-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "dbb06351-e6e7-4a49-a941-33b16fc6206d" (UID: "dbb06351-e6e7-4a49-a941-33b16fc6206d"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.611519 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dbb06351-e6e7-4a49-a941-33b16fc6206d-config-data" (OuterVolumeSpecName: "config-data") pod "dbb06351-e6e7-4a49-a941-33b16fc6206d" (UID: "dbb06351-e6e7-4a49-a941-33b16fc6206d"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.615895 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6645a7f0-de34-43c5-9422-1483edda0298-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"6645a7f0-de34-43c5-9422-1483edda0298\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.618859 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dbb06351-e6e7-4a49-a941-33b16fc6206d-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "dbb06351-e6e7-4a49-a941-33b16fc6206d" (UID: "dbb06351-e6e7-4a49-a941-33b16fc6206d"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.631681 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6645a7f0-de34-43c5-9422-1483edda0298-config-data\") pod \"nova-scheduler-0\" (UID: \"6645a7f0-de34-43c5-9422-1483edda0298\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.705896 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nl4tt\" (UniqueName: \"kubernetes.io/projected/6645a7f0-de34-43c5-9422-1483edda0298-kube-api-access-nl4tt\") pod \"nova-scheduler-0\" (UID: \"6645a7f0-de34-43c5-9422-1483edda0298\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.705522 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dbb06351-e6e7-4a49-a941-33b16fc6206d-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.706877 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/dbb06351-e6e7-4a49-a941-33b16fc6206d-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.706888 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/dbb06351-e6e7-4a49-a941-33b16fc6206d-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.816615 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="18b99335-9d0e-44a5-a6d6-a8ffe17ccd05" path="/var/lib/kubelet/pods/18b99335-9d0e-44a5-a6d6-a8ffe17ccd05/volumes" Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.838182 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3b57a7de-40e8-484e-a2a9-55454c35ccd0" path="/var/lib/kubelet/pods/3b57a7de-40e8-484e-a2a9-55454c35ccd0/volumes" Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.838879 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3ebc6d87-1ea4-4702-b166-ba35f25972b6" path="/var/lib/kubelet/pods/3ebc6d87-1ea4-4702-b166-ba35f25972b6/volumes" Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.839350 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7f4e547e-06cd-459e-8e83-9dcbefd83ea4" path="/var/lib/kubelet/pods/7f4e547e-06cd-459e-8e83-9dcbefd83ea4/volumes" Mar 16 16:05:38 crc kubenswrapper[5120]: I0316 16:05:38.988935 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:05:39 crc kubenswrapper[5120]: I0316 16:05:39.031547 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"e81e832e-72a4-4622-b4b9-e6a41d92fce3","Type":"ContainerStarted","Data":"ce28a1492a234a150502a3eae0e257dda366d7ad8553ae0ddc198e26f63873f4"} Mar 16 16:05:39 crc kubenswrapper[5120]: I0316 16:05:39.075018 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"683d3459-b9fc-478c-b74e-c1a09fd45e4d","Type":"ContainerStarted","Data":"7a6820d3a24d23e855c9be472d4e4b66d36ad7fcc83346577d9377a21c4e581c"} Mar 16 16:05:39 crc kubenswrapper[5120]: I0316 16:05:39.091421 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"e21caabc-db04-4dca-af4d-fbbbbde012ef","Type":"ContainerStarted","Data":"8eea30b4264cb5b81ae072784fc62cef45ea952a53322bf12789607ce5b7ee48"} Mar 16 16:05:39 crc kubenswrapper[5120]: I0316 16:05:39.116161 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"34a68caa-76db-4be4-9ecd-8955435c0e90","Type":"ContainerStarted","Data":"e39b1dd50fcafc14aec7bc9438ebf792d0a729e6b113372c1bb024a5217ce754"} Mar 16 16:05:39 crc kubenswrapper[5120]: I0316 16:05:39.117556 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-external-api-0" podStartSLOduration=6.117487245 podStartE2EDuration="6.117487245s" podCreationTimestamp="2026-03-16 16:05:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:05:39.109461205 +0000 UTC m=+2041.263392872" watchObservedRunningTime="2026-03-16 16:05:39.117487245 +0000 UTC m=+2041.271418922" Mar 16 16:05:39 crc kubenswrapper[5120]: I0316 16:05:39.131697 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"bf01270c-6ae8-4c7f-aee3-42a125c155e4","Type":"ContainerDied","Data":"1671da198747e089ff4b28fc748fc78b9729133ee2ee28ec98b40a2aa16763e8"} Mar 16 16:05:39 crc kubenswrapper[5120]: I0316 16:05:39.131824 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:05:39 crc kubenswrapper[5120]: I0316 16:05:39.144279 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"52c2852f-8732-4310-8402-b925b49a12ea","Type":"ContainerStarted","Data":"4e202a31ccedf17053edeb22d44409d0b1d73cbca98af3319d183a5acfbde57c"} Mar 16 16:05:39 crc kubenswrapper[5120]: I0316 16:05:39.188851 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:05:39 crc kubenswrapper[5120]: I0316 16:05:39.204322 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:05:39 crc kubenswrapper[5120]: I0316 16:05:39.213958 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:05:39 crc kubenswrapper[5120]: I0316 16:05:39.214121 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"dbb06351-e6e7-4a49-a941-33b16fc6206d","Type":"ContainerDied","Data":"97baf905b3960aa9d2ea773e43fafcef68a8f5f41dc685f0a1d957063efde5a9"} Mar 16 16:05:39 crc kubenswrapper[5120]: I0316 16:05:39.214180 5120 scope.go:117] "RemoveContainer" containerID="d6fc349f836b03a8939dfbaec2c3ff1e2196bfd6ed181b5867b764b47417dff0" Mar 16 16:05:39 crc kubenswrapper[5120]: I0316 16:05:39.240118 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-7dcb9fc94d-5c4n9"] Mar 16 16:05:39 crc kubenswrapper[5120]: I0316 16:05:39.270728 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:05:39 crc kubenswrapper[5120]: I0316 16:05:39.298822 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbb06351-e6e7-4a49-a941-33b16fc6206d" containerName="nova-api-api" Mar 16 16:05:39 crc kubenswrapper[5120]: I0316 16:05:39.298864 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbb06351-e6e7-4a49-a941-33b16fc6206d" containerName="nova-api-api" Mar 16 16:05:39 crc kubenswrapper[5120]: I0316 16:05:39.298935 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbb06351-e6e7-4a49-a941-33b16fc6206d" containerName="nova-api-log" Mar 16 16:05:39 crc kubenswrapper[5120]: I0316 16:05:39.298942 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbb06351-e6e7-4a49-a941-33b16fc6206d" containerName="nova-api-log" Mar 16 16:05:39 crc kubenswrapper[5120]: I0316 16:05:39.299370 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="dbb06351-e6e7-4a49-a941-33b16fc6206d" containerName="nova-api-log" Mar 16 16:05:39 crc kubenswrapper[5120]: I0316 16:05:39.299389 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="dbb06351-e6e7-4a49-a941-33b16fc6206d" containerName="nova-api-api" Mar 16 16:05:39 crc kubenswrapper[5120]: I0316 16:05:39.301513 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podStartSLOduration=4.301487235 podStartE2EDuration="4.301487235s" podCreationTimestamp="2026-03-16 16:05:35 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:05:39.184208804 +0000 UTC m=+2041.338140461" watchObservedRunningTime="2026-03-16 16:05:39.301487235 +0000 UTC m=+2041.455418892" Mar 16 16:05:39 crc kubenswrapper[5120]: I0316 16:05:39.321180 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:05:39 crc kubenswrapper[5120]: I0316 16:05:39.321362 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:05:39 crc kubenswrapper[5120]: I0316 16:05:39.327158 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-metadata-config-data\"" Mar 16 16:05:39 crc kubenswrapper[5120]: I0316 16:05:39.328638 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-metadata-internal-svc\"" Mar 16 16:05:39 crc kubenswrapper[5120]: I0316 16:05:39.384236 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:05:39 crc kubenswrapper[5120]: I0316 16:05:39.411688 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:05:39 crc kubenswrapper[5120]: I0316 16:05:39.419038 5120 scope.go:117] "RemoveContainer" containerID="f84dba618b96e6c2b2f2dee7b7aa69256626268516a21c1ba646c04d0f6801f1" Mar 16 16:05:39 crc kubenswrapper[5120]: I0316 16:05:39.427843 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:05:39 crc kubenswrapper[5120]: I0316 16:05:39.434389 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e8e4bade-e33d-4cc6-80ec-5f96e39c8f20-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"e8e4bade-e33d-4cc6-80ec-5f96e39c8f20\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:05:39 crc kubenswrapper[5120]: I0316 16:05:39.434579 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e8e4bade-e33d-4cc6-80ec-5f96e39c8f20-config-data\") pod \"nova-metadata-0\" (UID: \"e8e4bade-e33d-4cc6-80ec-5f96e39c8f20\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:05:39 crc kubenswrapper[5120]: I0316 16:05:39.434631 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/e8e4bade-e33d-4cc6-80ec-5f96e39c8f20-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"e8e4bade-e33d-4cc6-80ec-5f96e39c8f20\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:05:39 crc kubenswrapper[5120]: I0316 16:05:39.434724 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2jt7\" (UniqueName: \"kubernetes.io/projected/e8e4bade-e33d-4cc6-80ec-5f96e39c8f20-kube-api-access-d2jt7\") pod \"nova-metadata-0\" (UID: \"e8e4bade-e33d-4cc6-80ec-5f96e39c8f20\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:05:39 crc kubenswrapper[5120]: I0316 16:05:39.434838 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e8e4bade-e33d-4cc6-80ec-5f96e39c8f20-logs\") pod \"nova-metadata-0\" (UID: \"e8e4bade-e33d-4cc6-80ec-5f96e39c8f20\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:05:39 crc kubenswrapper[5120]: I0316 16:05:39.435098 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:05:39 crc kubenswrapper[5120]: I0316 16:05:39.438123 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-internal-svc\"" Mar 16 16:05:39 crc kubenswrapper[5120]: I0316 16:05:39.438461 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-config-data\"" Mar 16 16:05:39 crc kubenswrapper[5120]: I0316 16:05:39.439842 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-public-svc\"" Mar 16 16:05:39 crc kubenswrapper[5120]: I0316 16:05:39.498690 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:05:39 crc kubenswrapper[5120]: I0316 16:05:39.540922 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 16:05:39 crc kubenswrapper[5120]: I0316 16:05:39.541849 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-769xx\" (UniqueName: \"kubernetes.io/projected/4e3ac124-ebc3-4631-a7b1-5dc135748d5d-kube-api-access-769xx\") pod \"nova-api-0\" (UID: \"4e3ac124-ebc3-4631-a7b1-5dc135748d5d\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:05:39 crc kubenswrapper[5120]: I0316 16:05:39.541899 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d2jt7\" (UniqueName: \"kubernetes.io/projected/e8e4bade-e33d-4cc6-80ec-5f96e39c8f20-kube-api-access-d2jt7\") pod \"nova-metadata-0\" (UID: \"e8e4bade-e33d-4cc6-80ec-5f96e39c8f20\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:05:39 crc kubenswrapper[5120]: I0316 16:05:39.541980 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e8e4bade-e33d-4cc6-80ec-5f96e39c8f20-logs\") pod \"nova-metadata-0\" (UID: \"e8e4bade-e33d-4cc6-80ec-5f96e39c8f20\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:05:39 crc kubenswrapper[5120]: I0316 16:05:39.542017 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/4e3ac124-ebc3-4631-a7b1-5dc135748d5d-internal-tls-certs\") pod \"nova-api-0\" (UID: \"4e3ac124-ebc3-4631-a7b1-5dc135748d5d\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:05:39 crc kubenswrapper[5120]: I0316 16:05:39.542061 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4e3ac124-ebc3-4631-a7b1-5dc135748d5d-logs\") pod \"nova-api-0\" (UID: \"4e3ac124-ebc3-4631-a7b1-5dc135748d5d\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:05:39 crc kubenswrapper[5120]: I0316 16:05:39.542082 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4e3ac124-ebc3-4631-a7b1-5dc135748d5d-config-data\") pod \"nova-api-0\" (UID: \"4e3ac124-ebc3-4631-a7b1-5dc135748d5d\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:05:39 crc kubenswrapper[5120]: I0316 16:05:39.542100 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4e3ac124-ebc3-4631-a7b1-5dc135748d5d-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"4e3ac124-ebc3-4631-a7b1-5dc135748d5d\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:05:39 crc kubenswrapper[5120]: I0316 16:05:39.542127 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e8e4bade-e33d-4cc6-80ec-5f96e39c8f20-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"e8e4bade-e33d-4cc6-80ec-5f96e39c8f20\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:05:39 crc kubenswrapper[5120]: I0316 16:05:39.542159 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e8e4bade-e33d-4cc6-80ec-5f96e39c8f20-config-data\") pod \"nova-metadata-0\" (UID: \"e8e4bade-e33d-4cc6-80ec-5f96e39c8f20\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:05:39 crc kubenswrapper[5120]: I0316 16:05:39.542190 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/4e3ac124-ebc3-4631-a7b1-5dc135748d5d-public-tls-certs\") pod \"nova-api-0\" (UID: \"4e3ac124-ebc3-4631-a7b1-5dc135748d5d\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:05:39 crc kubenswrapper[5120]: I0316 16:05:39.542218 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/e8e4bade-e33d-4cc6-80ec-5f96e39c8f20-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"e8e4bade-e33d-4cc6-80ec-5f96e39c8f20\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:05:39 crc kubenswrapper[5120]: I0316 16:05:39.542656 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e8e4bade-e33d-4cc6-80ec-5f96e39c8f20-logs\") pod \"nova-metadata-0\" (UID: \"e8e4bade-e33d-4cc6-80ec-5f96e39c8f20\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:05:39 crc kubenswrapper[5120]: I0316 16:05:39.548652 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-857694d5fb-pdlqj"] Mar 16 16:05:39 crc kubenswrapper[5120]: I0316 16:05:39.554015 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e8e4bade-e33d-4cc6-80ec-5f96e39c8f20-config-data\") pod \"nova-metadata-0\" (UID: \"e8e4bade-e33d-4cc6-80ec-5f96e39c8f20\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:05:39 crc kubenswrapper[5120]: I0316 16:05:39.559376 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/e8e4bade-e33d-4cc6-80ec-5f96e39c8f20-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"e8e4bade-e33d-4cc6-80ec-5f96e39c8f20\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:05:39 crc kubenswrapper[5120]: I0316 16:05:39.565137 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2jt7\" (UniqueName: \"kubernetes.io/projected/e8e4bade-e33d-4cc6-80ec-5f96e39c8f20-kube-api-access-d2jt7\") pod \"nova-metadata-0\" (UID: \"e8e4bade-e33d-4cc6-80ec-5f96e39c8f20\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:05:39 crc kubenswrapper[5120]: I0316 16:05:39.565485 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e8e4bade-e33d-4cc6-80ec-5f96e39c8f20-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"e8e4bade-e33d-4cc6-80ec-5f96e39c8f20\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:05:39 crc kubenswrapper[5120]: I0316 16:05:39.647324 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/4e3ac124-ebc3-4631-a7b1-5dc135748d5d-internal-tls-certs\") pod \"nova-api-0\" (UID: \"4e3ac124-ebc3-4631-a7b1-5dc135748d5d\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:05:39 crc kubenswrapper[5120]: I0316 16:05:39.647449 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4e3ac124-ebc3-4631-a7b1-5dc135748d5d-logs\") pod \"nova-api-0\" (UID: \"4e3ac124-ebc3-4631-a7b1-5dc135748d5d\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:05:39 crc kubenswrapper[5120]: I0316 16:05:39.647475 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4e3ac124-ebc3-4631-a7b1-5dc135748d5d-config-data\") pod \"nova-api-0\" (UID: \"4e3ac124-ebc3-4631-a7b1-5dc135748d5d\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:05:39 crc kubenswrapper[5120]: I0316 16:05:39.647493 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4e3ac124-ebc3-4631-a7b1-5dc135748d5d-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"4e3ac124-ebc3-4631-a7b1-5dc135748d5d\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:05:39 crc kubenswrapper[5120]: I0316 16:05:39.647607 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/4e3ac124-ebc3-4631-a7b1-5dc135748d5d-public-tls-certs\") pod \"nova-api-0\" (UID: \"4e3ac124-ebc3-4631-a7b1-5dc135748d5d\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:05:39 crc kubenswrapper[5120]: I0316 16:05:39.647717 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-769xx\" (UniqueName: \"kubernetes.io/projected/4e3ac124-ebc3-4631-a7b1-5dc135748d5d-kube-api-access-769xx\") pod \"nova-api-0\" (UID: \"4e3ac124-ebc3-4631-a7b1-5dc135748d5d\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:05:39 crc kubenswrapper[5120]: I0316 16:05:39.649283 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4e3ac124-ebc3-4631-a7b1-5dc135748d5d-logs\") pod \"nova-api-0\" (UID: \"4e3ac124-ebc3-4631-a7b1-5dc135748d5d\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:05:39 crc kubenswrapper[5120]: I0316 16:05:39.652688 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4e3ac124-ebc3-4631-a7b1-5dc135748d5d-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"4e3ac124-ebc3-4631-a7b1-5dc135748d5d\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:05:39 crc kubenswrapper[5120]: I0316 16:05:39.655352 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/4e3ac124-ebc3-4631-a7b1-5dc135748d5d-public-tls-certs\") pod \"nova-api-0\" (UID: \"4e3ac124-ebc3-4631-a7b1-5dc135748d5d\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:05:39 crc kubenswrapper[5120]: I0316 16:05:39.655505 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4e3ac124-ebc3-4631-a7b1-5dc135748d5d-config-data\") pod \"nova-api-0\" (UID: \"4e3ac124-ebc3-4631-a7b1-5dc135748d5d\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:05:39 crc kubenswrapper[5120]: I0316 16:05:39.661668 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/4e3ac124-ebc3-4631-a7b1-5dc135748d5d-internal-tls-certs\") pod \"nova-api-0\" (UID: \"4e3ac124-ebc3-4631-a7b1-5dc135748d5d\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:05:39 crc kubenswrapper[5120]: I0316 16:05:39.671677 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-769xx\" (UniqueName: \"kubernetes.io/projected/4e3ac124-ebc3-4631-a7b1-5dc135748d5d-kube-api-access-769xx\") pod \"nova-api-0\" (UID: \"4e3ac124-ebc3-4631-a7b1-5dc135748d5d\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:05:39 crc kubenswrapper[5120]: I0316 16:05:39.678145 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-c76f59879-tpdpx"] Mar 16 16:05:39 crc kubenswrapper[5120]: I0316 16:05:39.693395 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:05:39 crc kubenswrapper[5120]: I0316 16:05:39.939378 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:05:39 crc kubenswrapper[5120]: I0316 16:05:39.973347 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:05:40 crc kubenswrapper[5120]: I0316 16:05:40.023313 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:05:40 crc kubenswrapper[5120]: I0316 16:05:40.261557 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"6645a7f0-de34-43c5-9422-1483edda0298","Type":"ContainerStarted","Data":"c95e062c78b43ac61bfb1ce3d6158aededf0d14a169d8cab5f5143628863dce1"} Mar 16 16:05:40 crc kubenswrapper[5120]: I0316 16:05:40.261965 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"6645a7f0-de34-43c5-9422-1483edda0298","Type":"ContainerStarted","Data":"4fa027892a69ee2d8daff9aa94346dd72f383a9a833d39b76f0c7cb70ae6c4f7"} Mar 16 16:05:40 crc kubenswrapper[5120]: I0316 16:05:40.285264 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-c76f59879-tpdpx" event={"ID":"ab84006c-23ad-4247-abe7-0d1016d65297","Type":"ContainerStarted","Data":"ee7c99e35f0ea6542759434ce015ae8518de8dfb907666327a5a872082e8e57b"} Mar 16 16:05:40 crc kubenswrapper[5120]: I0316 16:05:40.285327 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-c76f59879-tpdpx" event={"ID":"ab84006c-23ad-4247-abe7-0d1016d65297","Type":"ContainerStarted","Data":"acada8089eb9f47179fa97b10d5836616181a8a10a52af098feb5ad0ffc525f3"} Mar 16 16:05:40 crc kubenswrapper[5120]: I0316 16:05:40.288372 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-scheduler-0" podStartSLOduration=2.288355082 podStartE2EDuration="2.288355082s" podCreationTimestamp="2026-03-16 16:05:38 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:05:40.277367162 +0000 UTC m=+2042.431298819" watchObservedRunningTime="2026-03-16 16:05:40.288355082 +0000 UTC m=+2042.442286739" Mar 16 16:05:40 crc kubenswrapper[5120]: I0316 16:05:40.302007 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-7dcb9fc94d-5c4n9" event={"ID":"e2185e65-e56e-4f2e-929e-9caa246e5961","Type":"ContainerStarted","Data":"93af2507717d78fa1e06041087d6f02fc16b229867935621c914a9dd2f241aa8"} Mar 16 16:05:40 crc kubenswrapper[5120]: I0316 16:05:40.302056 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-7dcb9fc94d-5c4n9" event={"ID":"e2185e65-e56e-4f2e-929e-9caa246e5961","Type":"ContainerStarted","Data":"40bd5aa8ffbc011ef8e11f2ed417896e985859c34028c4046dc4d3e420ede635"} Mar 16 16:05:40 crc kubenswrapper[5120]: I0316 16:05:40.358003 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"8f091159-612f-4c40-b215-344c86fe9f65","Type":"ContainerStarted","Data":"a886de49bae32ee69eeae0c96d915691d3f0168922fae6e6426547d7baf51a40"} Mar 16 16:05:40 crc kubenswrapper[5120]: I0316 16:05:40.358049 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"8f091159-612f-4c40-b215-344c86fe9f65","Type":"ContainerStarted","Data":"a6b5fdb7523dae1d2b764d0ff7ec6a2d2afdc48e8805b990590273036075533c"} Mar 16 16:05:40 crc kubenswrapper[5120]: I0316 16:05:40.358092 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:05:40 crc kubenswrapper[5120]: I0316 16:05:40.380931 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podStartSLOduration=3.380911777 podStartE2EDuration="3.380911777s" podCreationTimestamp="2026-03-16 16:05:37 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:05:40.380430575 +0000 UTC m=+2042.534362232" watchObservedRunningTime="2026-03-16 16:05:40.380911777 +0000 UTC m=+2042.534843434" Mar 16 16:05:40 crc kubenswrapper[5120]: I0316 16:05:40.426599 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-857694d5fb-pdlqj" event={"ID":"bb0a18f2-a95f-4ee1-b6a6-d0400f70760f","Type":"ContainerStarted","Data":"d8ebe2d4ddfb0a9cea2a5d26051fad69b766700efa153b18ebda89d66de2709d"} Mar 16 16:05:40 crc kubenswrapper[5120]: I0316 16:05:40.426641 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-857694d5fb-pdlqj" event={"ID":"bb0a18f2-a95f-4ee1-b6a6-d0400f70760f","Type":"ContainerStarted","Data":"2c10d450142b41dc0d02c79bba499ecc896443a72618ad00125eed31bb8bab4f"} Mar 16 16:05:40 crc kubenswrapper[5120]: I0316 16:05:40.460921 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"e81e832e-72a4-4622-b4b9-e6a41d92fce3","Type":"ContainerStarted","Data":"3f106e4da64e5a562b06278622c6480a350064564e56ac929cfe8afda3b1b6a2"} Mar 16 16:05:40 crc kubenswrapper[5120]: I0316 16:05:40.470501 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"683d3459-b9fc-478c-b74e-c1a09fd45e4d","Type":"ContainerStarted","Data":"eaa8e905618c3287f78bbdda9d5b8e1d7a9ea191e193e106e08869701479bec0"} Mar 16 16:05:40 crc kubenswrapper[5120]: I0316 16:05:40.470724 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="683d3459-b9fc-478c-b74e-c1a09fd45e4d" containerName="nova-cell0-conductor-conductor" containerID="cri-o://eaa8e905618c3287f78bbdda9d5b8e1d7a9ea191e193e106e08869701479bec0" gracePeriod=30 Mar 16 16:05:40 crc kubenswrapper[5120]: I0316 16:05:40.470890 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:05:40 crc kubenswrapper[5120]: I0316 16:05:40.477324 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"e8e4bade-e33d-4cc6-80ec-5f96e39c8f20","Type":"ContainerStarted","Data":"19ba121de81b6e6f2f79c4e086bccef995a0a795c9f964f4d0594df9077aa426"} Mar 16 16:05:40 crc kubenswrapper[5120]: I0316 16:05:40.503295 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-internal-api-0" podStartSLOduration=6.503276796 podStartE2EDuration="6.503276796s" podCreationTimestamp="2026-03-16 16:05:34 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:05:40.478023257 +0000 UTC m=+2042.631954914" watchObservedRunningTime="2026-03-16 16:05:40.503276796 +0000 UTC m=+2042.657208453" Mar 16 16:05:40 crc kubenswrapper[5120]: I0316 16:05:40.519143 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podStartSLOduration=4.519124259 podStartE2EDuration="4.519124259s" podCreationTimestamp="2026-03-16 16:05:36 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:05:40.504895441 +0000 UTC m=+2042.658827098" watchObservedRunningTime="2026-03-16 16:05:40.519124259 +0000 UTC m=+2042.673055916" Mar 16 16:05:40 crc kubenswrapper[5120]: I0316 16:05:40.584676 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:05:40 crc kubenswrapper[5120]: I0316 16:05:40.677306 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bf01270c-6ae8-4c7f-aee3-42a125c155e4" path="/var/lib/kubelet/pods/bf01270c-6ae8-4c7f-aee3-42a125c155e4/volumes" Mar 16 16:05:40 crc kubenswrapper[5120]: I0316 16:05:40.677918 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dbb06351-e6e7-4a49-a941-33b16fc6206d" path="/var/lib/kubelet/pods/dbb06351-e6e7-4a49-a941-33b16fc6206d/volumes" Mar 16 16:05:40 crc kubenswrapper[5120]: I0316 16:05:40.791294 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:05:40 crc kubenswrapper[5120]: I0316 16:05:40.791568 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="1772eb98-e47b-45ce-a67e-e50b9e67caf0" containerName="ceilometer-central-agent" containerID="cri-o://9207a0eba561450da1739e87b41360794387e17d5e87dde63f73d34b21c027f6" gracePeriod=30 Mar 16 16:05:40 crc kubenswrapper[5120]: I0316 16:05:40.791866 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="1772eb98-e47b-45ce-a67e-e50b9e67caf0" containerName="proxy-httpd" containerID="cri-o://065050cf4721835b3ae26ffee5ff1ce77b764f4545f4eccd695d98ca6ee38df4" gracePeriod=30 Mar 16 16:05:40 crc kubenswrapper[5120]: I0316 16:05:40.792059 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="1772eb98-e47b-45ce-a67e-e50b9e67caf0" containerName="ceilometer-notification-agent" containerID="cri-o://5c7b2d7e27758e01aa1845776072027a01093fa74fc93da4150e46428ab4c949" gracePeriod=30 Mar 16 16:05:40 crc kubenswrapper[5120]: I0316 16:05:40.792099 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="1772eb98-e47b-45ce-a67e-e50b9e67caf0" containerName="sg-core" containerID="cri-o://5949242ae362aadaf6773132502eb99e4ef7078f73eabada4736d3c78179ddc4" gracePeriod=30 Mar 16 16:05:41 crc kubenswrapper[5120]: I0316 16:05:41.156357 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:05:41 crc kubenswrapper[5120]: I0316 16:05:41.562475 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-7dcb9fc94d-5c4n9" event={"ID":"e2185e65-e56e-4f2e-929e-9caa246e5961","Type":"ContainerStarted","Data":"1c74980f647fc3b6602e8abf9607add11294a4ae33e9ef294003251f4db6cb54"} Mar 16 16:05:41 crc kubenswrapper[5120]: I0316 16:05:41.577062 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-857694d5fb-pdlqj" event={"ID":"bb0a18f2-a95f-4ee1-b6a6-d0400f70760f","Type":"ContainerStarted","Data":"6f1d0f5762f66532294471c478da1e90478aa8e63f3a52ffb5466af1e5e246c7"} Mar 16 16:05:41 crc kubenswrapper[5120]: I0316 16:05:41.578019 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-857694d5fb-pdlqj" Mar 16 16:05:41 crc kubenswrapper[5120]: I0316 16:05:41.578047 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-857694d5fb-pdlqj" Mar 16 16:05:41 crc kubenswrapper[5120]: I0316 16:05:41.582959 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"5b630779-e8f9-434c-9449-d2aad103f041","Type":"ContainerStarted","Data":"c9abfc0dbbcf0d1cd004190466602e73374823f5f514bd5c3beb0cb3aea8c284"} Mar 16 16:05:41 crc kubenswrapper[5120]: I0316 16:05:41.590376 5120 generic.go:358] "Generic (PLEG): container finished" podID="1772eb98-e47b-45ce-a67e-e50b9e67caf0" containerID="065050cf4721835b3ae26ffee5ff1ce77b764f4545f4eccd695d98ca6ee38df4" exitCode=0 Mar 16 16:05:41 crc kubenswrapper[5120]: I0316 16:05:41.590401 5120 generic.go:358] "Generic (PLEG): container finished" podID="1772eb98-e47b-45ce-a67e-e50b9e67caf0" containerID="5949242ae362aadaf6773132502eb99e4ef7078f73eabada4736d3c78179ddc4" exitCode=2 Mar 16 16:05:41 crc kubenswrapper[5120]: I0316 16:05:41.590408 5120 generic.go:358] "Generic (PLEG): container finished" podID="1772eb98-e47b-45ce-a67e-e50b9e67caf0" containerID="9207a0eba561450da1739e87b41360794387e17d5e87dde63f73d34b21c027f6" exitCode=0 Mar 16 16:05:41 crc kubenswrapper[5120]: I0316 16:05:41.590463 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1772eb98-e47b-45ce-a67e-e50b9e67caf0","Type":"ContainerDied","Data":"065050cf4721835b3ae26ffee5ff1ce77b764f4545f4eccd695d98ca6ee38df4"} Mar 16 16:05:41 crc kubenswrapper[5120]: I0316 16:05:41.590486 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1772eb98-e47b-45ce-a67e-e50b9e67caf0","Type":"ContainerDied","Data":"5949242ae362aadaf6773132502eb99e4ef7078f73eabada4736d3c78179ddc4"} Mar 16 16:05:41 crc kubenswrapper[5120]: I0316 16:05:41.590495 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1772eb98-e47b-45ce-a67e-e50b9e67caf0","Type":"ContainerDied","Data":"9207a0eba561450da1739e87b41360794387e17d5e87dde63f73d34b21c027f6"} Mar 16 16:05:41 crc kubenswrapper[5120]: I0316 16:05:41.606677 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-keystone-listener-7dcb9fc94d-5c4n9" podStartSLOduration=4.606657503 podStartE2EDuration="4.606657503s" podCreationTimestamp="2026-03-16 16:05:37 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:05:41.585619778 +0000 UTC m=+2043.739551435" watchObservedRunningTime="2026-03-16 16:05:41.606657503 +0000 UTC m=+2043.760589160" Mar 16 16:05:41 crc kubenswrapper[5120]: I0316 16:05:41.609105 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"e8e4bade-e33d-4cc6-80ec-5f96e39c8f20","Type":"ContainerStarted","Data":"4d19035ffb723ffb2508178ff7d2cf820ceaca9202ab046e0e1c2483ac9ffe16"} Mar 16 16:05:41 crc kubenswrapper[5120]: I0316 16:05:41.609161 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"e8e4bade-e33d-4cc6-80ec-5f96e39c8f20","Type":"ContainerStarted","Data":"1a7116daa99aee53c27ccbc6b8927b279cc329e65d3b4f93760d164d6c9baf8a"} Mar 16 16:05:41 crc kubenswrapper[5120]: I0316 16:05:41.613056 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-api-857694d5fb-pdlqj" podStartSLOduration=4.613041927 podStartE2EDuration="4.613041927s" podCreationTimestamp="2026-03-16 16:05:37 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:05:41.601279636 +0000 UTC m=+2043.755211293" watchObservedRunningTime="2026-03-16 16:05:41.613041927 +0000 UTC m=+2043.766973584" Mar 16 16:05:41 crc kubenswrapper[5120]: I0316 16:05:41.626288 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"34a68caa-76db-4be4-9ecd-8955435c0e90","Type":"ContainerStarted","Data":"d6456b18671133be61b3e3aee639a3b98b4bd2c9402ee3e32ee592907357518e"} Mar 16 16:05:41 crc kubenswrapper[5120]: I0316 16:05:41.630716 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-c76f59879-tpdpx" event={"ID":"ab84006c-23ad-4247-abe7-0d1016d65297","Type":"ContainerStarted","Data":"cdc147d80656cda5bf5c1c16abcc7aa843b3b309337641361dde69e6baf74a24"} Mar 16 16:05:41 crc kubenswrapper[5120]: I0316 16:05:41.632523 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-64d4b879f4-m86vx"] Mar 16 16:05:41 crc kubenswrapper[5120]: I0316 16:05:41.632694 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-64d4b879f4-m86vx" podUID="a3c03367-28dc-4fa5-a569-0d97bad76025" containerName="barbican-keystone-listener-log" containerID="cri-o://13b097be32c1c312c9a56e9d5be72bc21c6efd3133797c6a00939a303caf2c96" gracePeriod=30 Mar 16 16:05:41 crc kubenswrapper[5120]: I0316 16:05:41.632784 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-64d4b879f4-m86vx" podUID="a3c03367-28dc-4fa5-a569-0d97bad76025" containerName="barbican-keystone-listener" containerID="cri-o://463e599745b4cbe8883cb0bcd7cf94a750337b70a82a08c2bffef8028e93fa82" gracePeriod=30 Mar 16 16:05:41 crc kubenswrapper[5120]: I0316 16:05:41.647361 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=2.647341983 podStartE2EDuration="2.647341983s" podCreationTimestamp="2026-03-16 16:05:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:05:41.627432479 +0000 UTC m=+2043.781364136" watchObservedRunningTime="2026-03-16 16:05:41.647341983 +0000 UTC m=+2043.801273640" Mar 16 16:05:41 crc kubenswrapper[5120]: I0316 16:05:41.655057 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"4e3ac124-ebc3-4631-a7b1-5dc135748d5d","Type":"ContainerStarted","Data":"340d50169e48c14cb6d4557c098a1c2d295af9830d64eeaf1c4c58f08e737170"} Mar 16 16:05:41 crc kubenswrapper[5120]: I0316 16:05:41.655354 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"4e3ac124-ebc3-4631-a7b1-5dc135748d5d","Type":"ContainerStarted","Data":"310b308ba52fcab67cf2c502456c2de0465f9ee7f89783de5324d7ed344a0950"} Mar 16 16:05:41 crc kubenswrapper[5120]: I0316 16:05:41.655364 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"4e3ac124-ebc3-4631-a7b1-5dc135748d5d","Type":"ContainerStarted","Data":"90a2419a9183252c414cde3138c1b54de74254a93def19c96674d07dc4a3df01"} Mar 16 16:05:41 crc kubenswrapper[5120]: I0316 16:05:41.670884 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-worker-c76f59879-tpdpx" podStartSLOduration=4.670868214 podStartE2EDuration="4.670868214s" podCreationTimestamp="2026-03-16 16:05:37 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:05:41.656886693 +0000 UTC m=+2043.810818350" watchObservedRunningTime="2026-03-16 16:05:41.670868214 +0000 UTC m=+2043.824799861" Mar 16 16:05:41 crc kubenswrapper[5120]: I0316 16:05:41.712576 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-7469b9f4cf-wq7wj"] Mar 16 16:05:41 crc kubenswrapper[5120]: I0316 16:05:41.712872 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-7469b9f4cf-wq7wj" podUID="307ebaa6-527e-4d6f-9601-dcb38aaa8a20" containerName="barbican-worker-log" containerID="cri-o://4a7007fb9f175a2ab2bee26800be3637c8503787cc6533808c06e3b06faaddad" gracePeriod=30 Mar 16 16:05:41 crc kubenswrapper[5120]: I0316 16:05:41.713342 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-7469b9f4cf-wq7wj" podUID="307ebaa6-527e-4d6f-9601-dcb38aaa8a20" containerName="barbican-worker" containerID="cri-o://d7e5e30c61b09a69c95923f05ac16a77beb58bdaed6db16f9297e00dc08129ce" gracePeriod=30 Mar 16 16:05:41 crc kubenswrapper[5120]: I0316 16:05:41.749621 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=2.749601753 podStartE2EDuration="2.749601753s" podCreationTimestamp="2026-03-16 16:05:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:05:41.690184721 +0000 UTC m=+2043.844116388" watchObservedRunningTime="2026-03-16 16:05:41.749601753 +0000 UTC m=+2043.903533410" Mar 16 16:05:42 crc kubenswrapper[5120]: I0316 16:05:42.343617 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:05:42 crc kubenswrapper[5120]: I0316 16:05:42.436412 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1772eb98-e47b-45ce-a67e-e50b9e67caf0-log-httpd\") pod \"1772eb98-e47b-45ce-a67e-e50b9e67caf0\" (UID: \"1772eb98-e47b-45ce-a67e-e50b9e67caf0\") " Mar 16 16:05:42 crc kubenswrapper[5120]: I0316 16:05:42.436488 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1772eb98-e47b-45ce-a67e-e50b9e67caf0-combined-ca-bundle\") pod \"1772eb98-e47b-45ce-a67e-e50b9e67caf0\" (UID: \"1772eb98-e47b-45ce-a67e-e50b9e67caf0\") " Mar 16 16:05:42 crc kubenswrapper[5120]: I0316 16:05:42.436633 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/1772eb98-e47b-45ce-a67e-e50b9e67caf0-sg-core-conf-yaml\") pod \"1772eb98-e47b-45ce-a67e-e50b9e67caf0\" (UID: \"1772eb98-e47b-45ce-a67e-e50b9e67caf0\") " Mar 16 16:05:42 crc kubenswrapper[5120]: I0316 16:05:42.436676 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1772eb98-e47b-45ce-a67e-e50b9e67caf0-run-httpd\") pod \"1772eb98-e47b-45ce-a67e-e50b9e67caf0\" (UID: \"1772eb98-e47b-45ce-a67e-e50b9e67caf0\") " Mar 16 16:05:42 crc kubenswrapper[5120]: I0316 16:05:42.436713 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1772eb98-e47b-45ce-a67e-e50b9e67caf0-scripts\") pod \"1772eb98-e47b-45ce-a67e-e50b9e67caf0\" (UID: \"1772eb98-e47b-45ce-a67e-e50b9e67caf0\") " Mar 16 16:05:42 crc kubenswrapper[5120]: I0316 16:05:42.436784 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1772eb98-e47b-45ce-a67e-e50b9e67caf0-config-data\") pod \"1772eb98-e47b-45ce-a67e-e50b9e67caf0\" (UID: \"1772eb98-e47b-45ce-a67e-e50b9e67caf0\") " Mar 16 16:05:42 crc kubenswrapper[5120]: I0316 16:05:42.436903 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/1772eb98-e47b-45ce-a67e-e50b9e67caf0-ceilometer-tls-certs\") pod \"1772eb98-e47b-45ce-a67e-e50b9e67caf0\" (UID: \"1772eb98-e47b-45ce-a67e-e50b9e67caf0\") " Mar 16 16:05:42 crc kubenswrapper[5120]: I0316 16:05:42.436962 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6244v\" (UniqueName: \"kubernetes.io/projected/1772eb98-e47b-45ce-a67e-e50b9e67caf0-kube-api-access-6244v\") pod \"1772eb98-e47b-45ce-a67e-e50b9e67caf0\" (UID: \"1772eb98-e47b-45ce-a67e-e50b9e67caf0\") " Mar 16 16:05:42 crc kubenswrapper[5120]: I0316 16:05:42.438347 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1772eb98-e47b-45ce-a67e-e50b9e67caf0-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "1772eb98-e47b-45ce-a67e-e50b9e67caf0" (UID: "1772eb98-e47b-45ce-a67e-e50b9e67caf0"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:05:42 crc kubenswrapper[5120]: I0316 16:05:42.440904 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1772eb98-e47b-45ce-a67e-e50b9e67caf0-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "1772eb98-e47b-45ce-a67e-e50b9e67caf0" (UID: "1772eb98-e47b-45ce-a67e-e50b9e67caf0"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:05:42 crc kubenswrapper[5120]: I0316 16:05:42.448613 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1772eb98-e47b-45ce-a67e-e50b9e67caf0-scripts" (OuterVolumeSpecName: "scripts") pod "1772eb98-e47b-45ce-a67e-e50b9e67caf0" (UID: "1772eb98-e47b-45ce-a67e-e50b9e67caf0"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:42 crc kubenswrapper[5120]: I0316 16:05:42.488090 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1772eb98-e47b-45ce-a67e-e50b9e67caf0-kube-api-access-6244v" (OuterVolumeSpecName: "kube-api-access-6244v") pod "1772eb98-e47b-45ce-a67e-e50b9e67caf0" (UID: "1772eb98-e47b-45ce-a67e-e50b9e67caf0"). InnerVolumeSpecName "kube-api-access-6244v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:05:42 crc kubenswrapper[5120]: I0316 16:05:42.506916 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1772eb98-e47b-45ce-a67e-e50b9e67caf0-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "1772eb98-e47b-45ce-a67e-e50b9e67caf0" (UID: "1772eb98-e47b-45ce-a67e-e50b9e67caf0"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:42 crc kubenswrapper[5120]: I0316 16:05:42.541268 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1772eb98-e47b-45ce-a67e-e50b9e67caf0-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:42 crc kubenswrapper[5120]: I0316 16:05:42.541297 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/1772eb98-e47b-45ce-a67e-e50b9e67caf0-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:42 crc kubenswrapper[5120]: I0316 16:05:42.541310 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1772eb98-e47b-45ce-a67e-e50b9e67caf0-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:42 crc kubenswrapper[5120]: I0316 16:05:42.541319 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1772eb98-e47b-45ce-a67e-e50b9e67caf0-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:42 crc kubenswrapper[5120]: I0316 16:05:42.541327 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6244v\" (UniqueName: \"kubernetes.io/projected/1772eb98-e47b-45ce-a67e-e50b9e67caf0-kube-api-access-6244v\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:42 crc kubenswrapper[5120]: I0316 16:05:42.579888 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1772eb98-e47b-45ce-a67e-e50b9e67caf0-ceilometer-tls-certs" (OuterVolumeSpecName: "ceilometer-tls-certs") pod "1772eb98-e47b-45ce-a67e-e50b9e67caf0" (UID: "1772eb98-e47b-45ce-a67e-e50b9e67caf0"). InnerVolumeSpecName "ceilometer-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:42 crc kubenswrapper[5120]: I0316 16:05:42.589945 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1772eb98-e47b-45ce-a67e-e50b9e67caf0-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "1772eb98-e47b-45ce-a67e-e50b9e67caf0" (UID: "1772eb98-e47b-45ce-a67e-e50b9e67caf0"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:42 crc kubenswrapper[5120]: I0316 16:05:42.643652 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1772eb98-e47b-45ce-a67e-e50b9e67caf0-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:42 crc kubenswrapper[5120]: I0316 16:05:42.643686 5120 reconciler_common.go:299] "Volume detached for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/1772eb98-e47b-45ce-a67e-e50b9e67caf0-ceilometer-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:42 crc kubenswrapper[5120]: I0316 16:05:42.646946 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1772eb98-e47b-45ce-a67e-e50b9e67caf0-config-data" (OuterVolumeSpecName: "config-data") pod "1772eb98-e47b-45ce-a67e-e50b9e67caf0" (UID: "1772eb98-e47b-45ce-a67e-e50b9e67caf0"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:42 crc kubenswrapper[5120]: I0316 16:05:42.667384 5120 generic.go:358] "Generic (PLEG): container finished" podID="307ebaa6-527e-4d6f-9601-dcb38aaa8a20" containerID="4a7007fb9f175a2ab2bee26800be3637c8503787cc6533808c06e3b06faaddad" exitCode=143 Mar 16 16:05:42 crc kubenswrapper[5120]: I0316 16:05:42.678343 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-7469b9f4cf-wq7wj" event={"ID":"307ebaa6-527e-4d6f-9601-dcb38aaa8a20","Type":"ContainerDied","Data":"4a7007fb9f175a2ab2bee26800be3637c8503787cc6533808c06e3b06faaddad"} Mar 16 16:05:42 crc kubenswrapper[5120]: I0316 16:05:42.681738 5120 generic.go:358] "Generic (PLEG): container finished" podID="1772eb98-e47b-45ce-a67e-e50b9e67caf0" containerID="5c7b2d7e27758e01aa1845776072027a01093fa74fc93da4150e46428ab4c949" exitCode=0 Mar 16 16:05:42 crc kubenswrapper[5120]: I0316 16:05:42.681867 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1772eb98-e47b-45ce-a67e-e50b9e67caf0","Type":"ContainerDied","Data":"5c7b2d7e27758e01aa1845776072027a01093fa74fc93da4150e46428ab4c949"} Mar 16 16:05:42 crc kubenswrapper[5120]: I0316 16:05:42.681900 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1772eb98-e47b-45ce-a67e-e50b9e67caf0","Type":"ContainerDied","Data":"1aae1d148686d880efd7bb0532c9e0e3c73e6d872634927c0586c412e4d8543f"} Mar 16 16:05:42 crc kubenswrapper[5120]: I0316 16:05:42.681920 5120 scope.go:117] "RemoveContainer" containerID="065050cf4721835b3ae26ffee5ff1ce77b764f4545f4eccd695d98ca6ee38df4" Mar 16 16:05:42 crc kubenswrapper[5120]: I0316 16:05:42.682076 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:05:42 crc kubenswrapper[5120]: I0316 16:05:42.694059 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"34a68caa-76db-4be4-9ecd-8955435c0e90","Type":"ContainerStarted","Data":"d3c2d0cc170c0d12ffcf3081d057790b94d54951249a16995141e7f80ac473e6"} Mar 16 16:05:42 crc kubenswrapper[5120]: I0316 16:05:42.700263 5120 generic.go:358] "Generic (PLEG): container finished" podID="a3c03367-28dc-4fa5-a569-0d97bad76025" containerID="13b097be32c1c312c9a56e9d5be72bc21c6efd3133797c6a00939a303caf2c96" exitCode=143 Mar 16 16:05:42 crc kubenswrapper[5120]: I0316 16:05:42.701064 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-64d4b879f4-m86vx" event={"ID":"a3c03367-28dc-4fa5-a569-0d97bad76025","Type":"ContainerDied","Data":"13b097be32c1c312c9a56e9d5be72bc21c6efd3133797c6a00939a303caf2c96"} Mar 16 16:05:42 crc kubenswrapper[5120]: I0316 16:05:42.728985 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-scheduler-0" podStartSLOduration=6.728965735 podStartE2EDuration="6.728965735s" podCreationTimestamp="2026-03-16 16:05:36 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:05:42.715109857 +0000 UTC m=+2044.869041514" watchObservedRunningTime="2026-03-16 16:05:42.728965735 +0000 UTC m=+2044.882897392" Mar 16 16:05:42 crc kubenswrapper[5120]: I0316 16:05:42.740826 5120 scope.go:117] "RemoveContainer" containerID="5949242ae362aadaf6773132502eb99e4ef7078f73eabada4736d3c78179ddc4" Mar 16 16:05:42 crc kubenswrapper[5120]: I0316 16:05:42.746070 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1772eb98-e47b-45ce-a67e-e50b9e67caf0-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:42 crc kubenswrapper[5120]: I0316 16:05:42.760266 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:05:42 crc kubenswrapper[5120]: I0316 16:05:42.772608 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:05:42 crc kubenswrapper[5120]: I0316 16:05:42.777251 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:05:42 crc kubenswrapper[5120]: I0316 16:05:42.778665 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1772eb98-e47b-45ce-a67e-e50b9e67caf0" containerName="sg-core" Mar 16 16:05:42 crc kubenswrapper[5120]: I0316 16:05:42.778690 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1772eb98-e47b-45ce-a67e-e50b9e67caf0" containerName="sg-core" Mar 16 16:05:42 crc kubenswrapper[5120]: I0316 16:05:42.778780 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1772eb98-e47b-45ce-a67e-e50b9e67caf0" containerName="proxy-httpd" Mar 16 16:05:42 crc kubenswrapper[5120]: I0316 16:05:42.778789 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1772eb98-e47b-45ce-a67e-e50b9e67caf0" containerName="proxy-httpd" Mar 16 16:05:42 crc kubenswrapper[5120]: I0316 16:05:42.778802 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1772eb98-e47b-45ce-a67e-e50b9e67caf0" containerName="ceilometer-notification-agent" Mar 16 16:05:42 crc kubenswrapper[5120]: I0316 16:05:42.778811 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1772eb98-e47b-45ce-a67e-e50b9e67caf0" containerName="ceilometer-notification-agent" Mar 16 16:05:42 crc kubenswrapper[5120]: I0316 16:05:42.778823 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1772eb98-e47b-45ce-a67e-e50b9e67caf0" containerName="ceilometer-central-agent" Mar 16 16:05:42 crc kubenswrapper[5120]: I0316 16:05:42.778831 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1772eb98-e47b-45ce-a67e-e50b9e67caf0" containerName="ceilometer-central-agent" Mar 16 16:05:42 crc kubenswrapper[5120]: I0316 16:05:42.779063 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1772eb98-e47b-45ce-a67e-e50b9e67caf0" containerName="sg-core" Mar 16 16:05:42 crc kubenswrapper[5120]: I0316 16:05:42.779098 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1772eb98-e47b-45ce-a67e-e50b9e67caf0" containerName="ceilometer-notification-agent" Mar 16 16:05:42 crc kubenswrapper[5120]: I0316 16:05:42.779114 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1772eb98-e47b-45ce-a67e-e50b9e67caf0" containerName="proxy-httpd" Mar 16 16:05:42 crc kubenswrapper[5120]: I0316 16:05:42.779127 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1772eb98-e47b-45ce-a67e-e50b9e67caf0" containerName="ceilometer-central-agent" Mar 16 16:05:42 crc kubenswrapper[5120]: I0316 16:05:42.779561 5120 scope.go:117] "RemoveContainer" containerID="5c7b2d7e27758e01aa1845776072027a01093fa74fc93da4150e46428ab4c949" Mar 16 16:05:42 crc kubenswrapper[5120]: I0316 16:05:42.791005 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:05:42 crc kubenswrapper[5120]: I0316 16:05:42.797311 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ceilometer-internal-svc\"" Mar 16 16:05:42 crc kubenswrapper[5120]: I0316 16:05:42.797498 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 16:05:42 crc kubenswrapper[5120]: I0316 16:05:42.798259 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 16:05:42 crc kubenswrapper[5120]: I0316 16:05:42.804210 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:05:42 crc kubenswrapper[5120]: I0316 16:05:42.847968 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/c6ef2171-25f8-43d1-a037-b915f5b77abc-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"c6ef2171-25f8-43d1-a037-b915f5b77abc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:05:42 crc kubenswrapper[5120]: I0316 16:05:42.848042 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c6ef2171-25f8-43d1-a037-b915f5b77abc-log-httpd\") pod \"ceilometer-0\" (UID: \"c6ef2171-25f8-43d1-a037-b915f5b77abc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:05:42 crc kubenswrapper[5120]: I0316 16:05:42.848083 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwb7w\" (UniqueName: \"kubernetes.io/projected/c6ef2171-25f8-43d1-a037-b915f5b77abc-kube-api-access-zwb7w\") pod \"ceilometer-0\" (UID: \"c6ef2171-25f8-43d1-a037-b915f5b77abc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:05:42 crc kubenswrapper[5120]: I0316 16:05:42.848122 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c6ef2171-25f8-43d1-a037-b915f5b77abc-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"c6ef2171-25f8-43d1-a037-b915f5b77abc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:05:42 crc kubenswrapper[5120]: I0316 16:05:42.848332 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c6ef2171-25f8-43d1-a037-b915f5b77abc-scripts\") pod \"ceilometer-0\" (UID: \"c6ef2171-25f8-43d1-a037-b915f5b77abc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:05:42 crc kubenswrapper[5120]: I0316 16:05:42.848371 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c6ef2171-25f8-43d1-a037-b915f5b77abc-config-data\") pod \"ceilometer-0\" (UID: \"c6ef2171-25f8-43d1-a037-b915f5b77abc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:05:42 crc kubenswrapper[5120]: I0316 16:05:42.848417 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/c6ef2171-25f8-43d1-a037-b915f5b77abc-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"c6ef2171-25f8-43d1-a037-b915f5b77abc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:05:42 crc kubenswrapper[5120]: I0316 16:05:42.848540 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c6ef2171-25f8-43d1-a037-b915f5b77abc-run-httpd\") pod \"ceilometer-0\" (UID: \"c6ef2171-25f8-43d1-a037-b915f5b77abc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:05:42 crc kubenswrapper[5120]: I0316 16:05:42.850072 5120 scope.go:117] "RemoveContainer" containerID="9207a0eba561450da1739e87b41360794387e17d5e87dde63f73d34b21c027f6" Mar 16 16:05:42 crc kubenswrapper[5120]: I0316 16:05:42.882654 5120 scope.go:117] "RemoveContainer" containerID="065050cf4721835b3ae26ffee5ff1ce77b764f4545f4eccd695d98ca6ee38df4" Mar 16 16:05:42 crc kubenswrapper[5120]: E0316 16:05:42.883198 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"065050cf4721835b3ae26ffee5ff1ce77b764f4545f4eccd695d98ca6ee38df4\": container with ID starting with 065050cf4721835b3ae26ffee5ff1ce77b764f4545f4eccd695d98ca6ee38df4 not found: ID does not exist" containerID="065050cf4721835b3ae26ffee5ff1ce77b764f4545f4eccd695d98ca6ee38df4" Mar 16 16:05:42 crc kubenswrapper[5120]: I0316 16:05:42.883247 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"065050cf4721835b3ae26ffee5ff1ce77b764f4545f4eccd695d98ca6ee38df4"} err="failed to get container status \"065050cf4721835b3ae26ffee5ff1ce77b764f4545f4eccd695d98ca6ee38df4\": rpc error: code = NotFound desc = could not find container \"065050cf4721835b3ae26ffee5ff1ce77b764f4545f4eccd695d98ca6ee38df4\": container with ID starting with 065050cf4721835b3ae26ffee5ff1ce77b764f4545f4eccd695d98ca6ee38df4 not found: ID does not exist" Mar 16 16:05:42 crc kubenswrapper[5120]: I0316 16:05:42.883271 5120 scope.go:117] "RemoveContainer" containerID="5949242ae362aadaf6773132502eb99e4ef7078f73eabada4736d3c78179ddc4" Mar 16 16:05:42 crc kubenswrapper[5120]: E0316 16:05:42.883512 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5949242ae362aadaf6773132502eb99e4ef7078f73eabada4736d3c78179ddc4\": container with ID starting with 5949242ae362aadaf6773132502eb99e4ef7078f73eabada4736d3c78179ddc4 not found: ID does not exist" containerID="5949242ae362aadaf6773132502eb99e4ef7078f73eabada4736d3c78179ddc4" Mar 16 16:05:42 crc kubenswrapper[5120]: I0316 16:05:42.883535 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5949242ae362aadaf6773132502eb99e4ef7078f73eabada4736d3c78179ddc4"} err="failed to get container status \"5949242ae362aadaf6773132502eb99e4ef7078f73eabada4736d3c78179ddc4\": rpc error: code = NotFound desc = could not find container \"5949242ae362aadaf6773132502eb99e4ef7078f73eabada4736d3c78179ddc4\": container with ID starting with 5949242ae362aadaf6773132502eb99e4ef7078f73eabada4736d3c78179ddc4 not found: ID does not exist" Mar 16 16:05:42 crc kubenswrapper[5120]: I0316 16:05:42.883549 5120 scope.go:117] "RemoveContainer" containerID="5c7b2d7e27758e01aa1845776072027a01093fa74fc93da4150e46428ab4c949" Mar 16 16:05:42 crc kubenswrapper[5120]: E0316 16:05:42.883736 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c7b2d7e27758e01aa1845776072027a01093fa74fc93da4150e46428ab4c949\": container with ID starting with 5c7b2d7e27758e01aa1845776072027a01093fa74fc93da4150e46428ab4c949 not found: ID does not exist" containerID="5c7b2d7e27758e01aa1845776072027a01093fa74fc93da4150e46428ab4c949" Mar 16 16:05:42 crc kubenswrapper[5120]: I0316 16:05:42.883777 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c7b2d7e27758e01aa1845776072027a01093fa74fc93da4150e46428ab4c949"} err="failed to get container status \"5c7b2d7e27758e01aa1845776072027a01093fa74fc93da4150e46428ab4c949\": rpc error: code = NotFound desc = could not find container \"5c7b2d7e27758e01aa1845776072027a01093fa74fc93da4150e46428ab4c949\": container with ID starting with 5c7b2d7e27758e01aa1845776072027a01093fa74fc93da4150e46428ab4c949 not found: ID does not exist" Mar 16 16:05:42 crc kubenswrapper[5120]: I0316 16:05:42.883797 5120 scope.go:117] "RemoveContainer" containerID="9207a0eba561450da1739e87b41360794387e17d5e87dde63f73d34b21c027f6" Mar 16 16:05:42 crc kubenswrapper[5120]: E0316 16:05:42.884010 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9207a0eba561450da1739e87b41360794387e17d5e87dde63f73d34b21c027f6\": container with ID starting with 9207a0eba561450da1739e87b41360794387e17d5e87dde63f73d34b21c027f6 not found: ID does not exist" containerID="9207a0eba561450da1739e87b41360794387e17d5e87dde63f73d34b21c027f6" Mar 16 16:05:42 crc kubenswrapper[5120]: I0316 16:05:42.884032 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9207a0eba561450da1739e87b41360794387e17d5e87dde63f73d34b21c027f6"} err="failed to get container status \"9207a0eba561450da1739e87b41360794387e17d5e87dde63f73d34b21c027f6\": rpc error: code = NotFound desc = could not find container \"9207a0eba561450da1739e87b41360794387e17d5e87dde63f73d34b21c027f6\": container with ID starting with 9207a0eba561450da1739e87b41360794387e17d5e87dde63f73d34b21c027f6 not found: ID does not exist" Mar 16 16:05:42 crc kubenswrapper[5120]: I0316 16:05:42.954419 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c6ef2171-25f8-43d1-a037-b915f5b77abc-run-httpd\") pod \"ceilometer-0\" (UID: \"c6ef2171-25f8-43d1-a037-b915f5b77abc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:05:42 crc kubenswrapper[5120]: I0316 16:05:42.954586 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/c6ef2171-25f8-43d1-a037-b915f5b77abc-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"c6ef2171-25f8-43d1-a037-b915f5b77abc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:05:42 crc kubenswrapper[5120]: I0316 16:05:42.954628 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c6ef2171-25f8-43d1-a037-b915f5b77abc-log-httpd\") pod \"ceilometer-0\" (UID: \"c6ef2171-25f8-43d1-a037-b915f5b77abc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:05:42 crc kubenswrapper[5120]: I0316 16:05:42.954647 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zwb7w\" (UniqueName: \"kubernetes.io/projected/c6ef2171-25f8-43d1-a037-b915f5b77abc-kube-api-access-zwb7w\") pod \"ceilometer-0\" (UID: \"c6ef2171-25f8-43d1-a037-b915f5b77abc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:05:42 crc kubenswrapper[5120]: I0316 16:05:42.954676 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c6ef2171-25f8-43d1-a037-b915f5b77abc-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"c6ef2171-25f8-43d1-a037-b915f5b77abc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:05:42 crc kubenswrapper[5120]: I0316 16:05:42.954740 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c6ef2171-25f8-43d1-a037-b915f5b77abc-scripts\") pod \"ceilometer-0\" (UID: \"c6ef2171-25f8-43d1-a037-b915f5b77abc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:05:42 crc kubenswrapper[5120]: I0316 16:05:42.954770 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c6ef2171-25f8-43d1-a037-b915f5b77abc-config-data\") pod \"ceilometer-0\" (UID: \"c6ef2171-25f8-43d1-a037-b915f5b77abc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:05:42 crc kubenswrapper[5120]: I0316 16:05:42.954792 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/c6ef2171-25f8-43d1-a037-b915f5b77abc-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"c6ef2171-25f8-43d1-a037-b915f5b77abc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:05:42 crc kubenswrapper[5120]: I0316 16:05:42.955590 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c6ef2171-25f8-43d1-a037-b915f5b77abc-run-httpd\") pod \"ceilometer-0\" (UID: \"c6ef2171-25f8-43d1-a037-b915f5b77abc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:05:42 crc kubenswrapper[5120]: I0316 16:05:42.955866 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c6ef2171-25f8-43d1-a037-b915f5b77abc-log-httpd\") pod \"ceilometer-0\" (UID: \"c6ef2171-25f8-43d1-a037-b915f5b77abc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:05:42 crc kubenswrapper[5120]: I0316 16:05:42.959639 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c6ef2171-25f8-43d1-a037-b915f5b77abc-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"c6ef2171-25f8-43d1-a037-b915f5b77abc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:05:42 crc kubenswrapper[5120]: I0316 16:05:42.959703 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c6ef2171-25f8-43d1-a037-b915f5b77abc-scripts\") pod \"ceilometer-0\" (UID: \"c6ef2171-25f8-43d1-a037-b915f5b77abc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:05:42 crc kubenswrapper[5120]: I0316 16:05:42.963270 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/c6ef2171-25f8-43d1-a037-b915f5b77abc-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"c6ef2171-25f8-43d1-a037-b915f5b77abc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:05:42 crc kubenswrapper[5120]: I0316 16:05:42.963728 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c6ef2171-25f8-43d1-a037-b915f5b77abc-config-data\") pod \"ceilometer-0\" (UID: \"c6ef2171-25f8-43d1-a037-b915f5b77abc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:05:42 crc kubenswrapper[5120]: I0316 16:05:42.968190 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/c6ef2171-25f8-43d1-a037-b915f5b77abc-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"c6ef2171-25f8-43d1-a037-b915f5b77abc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:05:42 crc kubenswrapper[5120]: I0316 16:05:42.974475 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwb7w\" (UniqueName: \"kubernetes.io/projected/c6ef2171-25f8-43d1-a037-b915f5b77abc-kube-api-access-zwb7w\") pod \"ceilometer-0\" (UID: \"c6ef2171-25f8-43d1-a037-b915f5b77abc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:05:43 crc kubenswrapper[5120]: I0316 16:05:43.126811 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:05:43 crc kubenswrapper[5120]: I0316 16:05:43.177654 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/swift-proxy-87b69bc94-qlznl"] Mar 16 16:05:43 crc kubenswrapper[5120]: I0316 16:05:43.188261 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-87b69bc94-qlznl" Mar 16 16:05:43 crc kubenswrapper[5120]: I0316 16:05:43.194564 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-proxy-87b69bc94-qlznl"] Mar 16 16:05:43 crc kubenswrapper[5120]: I0316 16:05:43.263826 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/502b04b6-fe65-4be1-847c-172941719e46-config-data\") pod \"swift-proxy-87b69bc94-qlznl\" (UID: \"502b04b6-fe65-4be1-847c-172941719e46\") " pod="openstack-kuttl-tests/swift-proxy-87b69bc94-qlznl" Mar 16 16:05:43 crc kubenswrapper[5120]: I0316 16:05:43.263880 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/502b04b6-fe65-4be1-847c-172941719e46-etc-swift\") pod \"swift-proxy-87b69bc94-qlznl\" (UID: \"502b04b6-fe65-4be1-847c-172941719e46\") " pod="openstack-kuttl-tests/swift-proxy-87b69bc94-qlznl" Mar 16 16:05:43 crc kubenswrapper[5120]: I0316 16:05:43.263924 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/502b04b6-fe65-4be1-847c-172941719e46-public-tls-certs\") pod \"swift-proxy-87b69bc94-qlznl\" (UID: \"502b04b6-fe65-4be1-847c-172941719e46\") " pod="openstack-kuttl-tests/swift-proxy-87b69bc94-qlznl" Mar 16 16:05:43 crc kubenswrapper[5120]: I0316 16:05:43.264297 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/502b04b6-fe65-4be1-847c-172941719e46-internal-tls-certs\") pod \"swift-proxy-87b69bc94-qlznl\" (UID: \"502b04b6-fe65-4be1-847c-172941719e46\") " pod="openstack-kuttl-tests/swift-proxy-87b69bc94-qlznl" Mar 16 16:05:43 crc kubenswrapper[5120]: I0316 16:05:43.264350 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/502b04b6-fe65-4be1-847c-172941719e46-log-httpd\") pod \"swift-proxy-87b69bc94-qlznl\" (UID: \"502b04b6-fe65-4be1-847c-172941719e46\") " pod="openstack-kuttl-tests/swift-proxy-87b69bc94-qlznl" Mar 16 16:05:43 crc kubenswrapper[5120]: I0316 16:05:43.264410 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgptb\" (UniqueName: \"kubernetes.io/projected/502b04b6-fe65-4be1-847c-172941719e46-kube-api-access-kgptb\") pod \"swift-proxy-87b69bc94-qlznl\" (UID: \"502b04b6-fe65-4be1-847c-172941719e46\") " pod="openstack-kuttl-tests/swift-proxy-87b69bc94-qlznl" Mar 16 16:05:43 crc kubenswrapper[5120]: I0316 16:05:43.264498 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/502b04b6-fe65-4be1-847c-172941719e46-run-httpd\") pod \"swift-proxy-87b69bc94-qlznl\" (UID: \"502b04b6-fe65-4be1-847c-172941719e46\") " pod="openstack-kuttl-tests/swift-proxy-87b69bc94-qlznl" Mar 16 16:05:43 crc kubenswrapper[5120]: I0316 16:05:43.264613 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/502b04b6-fe65-4be1-847c-172941719e46-combined-ca-bundle\") pod \"swift-proxy-87b69bc94-qlznl\" (UID: \"502b04b6-fe65-4be1-847c-172941719e46\") " pod="openstack-kuttl-tests/swift-proxy-87b69bc94-qlznl" Mar 16 16:05:43 crc kubenswrapper[5120]: I0316 16:05:43.366527 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/502b04b6-fe65-4be1-847c-172941719e46-internal-tls-certs\") pod \"swift-proxy-87b69bc94-qlznl\" (UID: \"502b04b6-fe65-4be1-847c-172941719e46\") " pod="openstack-kuttl-tests/swift-proxy-87b69bc94-qlznl" Mar 16 16:05:43 crc kubenswrapper[5120]: I0316 16:05:43.366881 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/502b04b6-fe65-4be1-847c-172941719e46-log-httpd\") pod \"swift-proxy-87b69bc94-qlznl\" (UID: \"502b04b6-fe65-4be1-847c-172941719e46\") " pod="openstack-kuttl-tests/swift-proxy-87b69bc94-qlznl" Mar 16 16:05:43 crc kubenswrapper[5120]: I0316 16:05:43.366924 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kgptb\" (UniqueName: \"kubernetes.io/projected/502b04b6-fe65-4be1-847c-172941719e46-kube-api-access-kgptb\") pod \"swift-proxy-87b69bc94-qlznl\" (UID: \"502b04b6-fe65-4be1-847c-172941719e46\") " pod="openstack-kuttl-tests/swift-proxy-87b69bc94-qlznl" Mar 16 16:05:43 crc kubenswrapper[5120]: I0316 16:05:43.366971 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/502b04b6-fe65-4be1-847c-172941719e46-run-httpd\") pod \"swift-proxy-87b69bc94-qlznl\" (UID: \"502b04b6-fe65-4be1-847c-172941719e46\") " pod="openstack-kuttl-tests/swift-proxy-87b69bc94-qlznl" Mar 16 16:05:43 crc kubenswrapper[5120]: I0316 16:05:43.367033 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/502b04b6-fe65-4be1-847c-172941719e46-combined-ca-bundle\") pod \"swift-proxy-87b69bc94-qlznl\" (UID: \"502b04b6-fe65-4be1-847c-172941719e46\") " pod="openstack-kuttl-tests/swift-proxy-87b69bc94-qlznl" Mar 16 16:05:43 crc kubenswrapper[5120]: I0316 16:05:43.367057 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/502b04b6-fe65-4be1-847c-172941719e46-config-data\") pod \"swift-proxy-87b69bc94-qlznl\" (UID: \"502b04b6-fe65-4be1-847c-172941719e46\") " pod="openstack-kuttl-tests/swift-proxy-87b69bc94-qlznl" Mar 16 16:05:43 crc kubenswrapper[5120]: I0316 16:05:43.367089 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/502b04b6-fe65-4be1-847c-172941719e46-etc-swift\") pod \"swift-proxy-87b69bc94-qlznl\" (UID: \"502b04b6-fe65-4be1-847c-172941719e46\") " pod="openstack-kuttl-tests/swift-proxy-87b69bc94-qlznl" Mar 16 16:05:43 crc kubenswrapper[5120]: I0316 16:05:43.367128 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/502b04b6-fe65-4be1-847c-172941719e46-public-tls-certs\") pod \"swift-proxy-87b69bc94-qlznl\" (UID: \"502b04b6-fe65-4be1-847c-172941719e46\") " pod="openstack-kuttl-tests/swift-proxy-87b69bc94-qlznl" Mar 16 16:05:43 crc kubenswrapper[5120]: I0316 16:05:43.367392 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/502b04b6-fe65-4be1-847c-172941719e46-log-httpd\") pod \"swift-proxy-87b69bc94-qlznl\" (UID: \"502b04b6-fe65-4be1-847c-172941719e46\") " pod="openstack-kuttl-tests/swift-proxy-87b69bc94-qlznl" Mar 16 16:05:43 crc kubenswrapper[5120]: I0316 16:05:43.367647 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/502b04b6-fe65-4be1-847c-172941719e46-run-httpd\") pod \"swift-proxy-87b69bc94-qlznl\" (UID: \"502b04b6-fe65-4be1-847c-172941719e46\") " pod="openstack-kuttl-tests/swift-proxy-87b69bc94-qlznl" Mar 16 16:05:43 crc kubenswrapper[5120]: I0316 16:05:43.374632 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/502b04b6-fe65-4be1-847c-172941719e46-config-data\") pod \"swift-proxy-87b69bc94-qlznl\" (UID: \"502b04b6-fe65-4be1-847c-172941719e46\") " pod="openstack-kuttl-tests/swift-proxy-87b69bc94-qlznl" Mar 16 16:05:43 crc kubenswrapper[5120]: I0316 16:05:43.377453 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/502b04b6-fe65-4be1-847c-172941719e46-etc-swift\") pod \"swift-proxy-87b69bc94-qlznl\" (UID: \"502b04b6-fe65-4be1-847c-172941719e46\") " pod="openstack-kuttl-tests/swift-proxy-87b69bc94-qlznl" Mar 16 16:05:43 crc kubenswrapper[5120]: I0316 16:05:43.378056 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/502b04b6-fe65-4be1-847c-172941719e46-public-tls-certs\") pod \"swift-proxy-87b69bc94-qlznl\" (UID: \"502b04b6-fe65-4be1-847c-172941719e46\") " pod="openstack-kuttl-tests/swift-proxy-87b69bc94-qlznl" Mar 16 16:05:43 crc kubenswrapper[5120]: I0316 16:05:43.378330 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/502b04b6-fe65-4be1-847c-172941719e46-internal-tls-certs\") pod \"swift-proxy-87b69bc94-qlznl\" (UID: \"502b04b6-fe65-4be1-847c-172941719e46\") " pod="openstack-kuttl-tests/swift-proxy-87b69bc94-qlznl" Mar 16 16:05:43 crc kubenswrapper[5120]: I0316 16:05:43.386585 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/502b04b6-fe65-4be1-847c-172941719e46-combined-ca-bundle\") pod \"swift-proxy-87b69bc94-qlznl\" (UID: \"502b04b6-fe65-4be1-847c-172941719e46\") " pod="openstack-kuttl-tests/swift-proxy-87b69bc94-qlznl" Mar 16 16:05:43 crc kubenswrapper[5120]: I0316 16:05:43.402461 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgptb\" (UniqueName: \"kubernetes.io/projected/502b04b6-fe65-4be1-847c-172941719e46-kube-api-access-kgptb\") pod \"swift-proxy-87b69bc94-qlznl\" (UID: \"502b04b6-fe65-4be1-847c-172941719e46\") " pod="openstack-kuttl-tests/swift-proxy-87b69bc94-qlznl" Mar 16 16:05:43 crc kubenswrapper[5120]: I0316 16:05:43.529431 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-87b69bc94-qlznl" Mar 16 16:05:43 crc kubenswrapper[5120]: I0316 16:05:43.674975 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:05:43 crc kubenswrapper[5120]: I0316 16:05:43.723627 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"5b630779-e8f9-434c-9449-d2aad103f041","Type":"ContainerStarted","Data":"e3fdff7b57d0a087985cbd2289bc6fbf6801532cb62e3595713545733446a1e0"} Mar 16 16:05:43 crc kubenswrapper[5120]: I0316 16:05:43.724126 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:05:43 crc kubenswrapper[5120]: I0316 16:05:43.766083 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-api-0" podStartSLOduration=8.766062233 podStartE2EDuration="8.766062233s" podCreationTimestamp="2026-03-16 16:05:35 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:05:43.749406258 +0000 UTC m=+2045.903337915" watchObservedRunningTime="2026-03-16 16:05:43.766062233 +0000 UTC m=+2045.919993890" Mar 16 16:05:43 crc kubenswrapper[5120]: I0316 16:05:43.990181 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:05:44 crc kubenswrapper[5120]: I0316 16:05:44.001842 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-proxy-87b69bc94-qlznl"] Mar 16 16:05:44 crc kubenswrapper[5120]: I0316 16:05:44.177800 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-64d4b879f4-m86vx" Mar 16 16:05:44 crc kubenswrapper[5120]: I0316 16:05:44.185527 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:05:44 crc kubenswrapper[5120]: I0316 16:05:44.186036 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:05:44 crc kubenswrapper[5120]: I0316 16:05:44.232306 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:05:44 crc kubenswrapper[5120]: I0316 16:05:44.242265 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:05:44 crc kubenswrapper[5120]: I0316 16:05:44.302843 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a3c03367-28dc-4fa5-a569-0d97bad76025-logs\") pod \"a3c03367-28dc-4fa5-a569-0d97bad76025\" (UID: \"a3c03367-28dc-4fa5-a569-0d97bad76025\") " Mar 16 16:05:44 crc kubenswrapper[5120]: I0316 16:05:44.303524 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3c03367-28dc-4fa5-a569-0d97bad76025-logs" (OuterVolumeSpecName: "logs") pod "a3c03367-28dc-4fa5-a569-0d97bad76025" (UID: "a3c03367-28dc-4fa5-a569-0d97bad76025"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:05:44 crc kubenswrapper[5120]: I0316 16:05:44.304260 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/a3c03367-28dc-4fa5-a569-0d97bad76025-config-data-custom\") pod \"a3c03367-28dc-4fa5-a569-0d97bad76025\" (UID: \"a3c03367-28dc-4fa5-a569-0d97bad76025\") " Mar 16 16:05:44 crc kubenswrapper[5120]: I0316 16:05:44.304325 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a3c03367-28dc-4fa5-a569-0d97bad76025-config-data\") pod \"a3c03367-28dc-4fa5-a569-0d97bad76025\" (UID: \"a3c03367-28dc-4fa5-a569-0d97bad76025\") " Mar 16 16:05:44 crc kubenswrapper[5120]: I0316 16:05:44.304512 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a3c03367-28dc-4fa5-a569-0d97bad76025-combined-ca-bundle\") pod \"a3c03367-28dc-4fa5-a569-0d97bad76025\" (UID: \"a3c03367-28dc-4fa5-a569-0d97bad76025\") " Mar 16 16:05:44 crc kubenswrapper[5120]: I0316 16:05:44.304556 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9pt85\" (UniqueName: \"kubernetes.io/projected/a3c03367-28dc-4fa5-a569-0d97bad76025-kube-api-access-9pt85\") pod \"a3c03367-28dc-4fa5-a569-0d97bad76025\" (UID: \"a3c03367-28dc-4fa5-a569-0d97bad76025\") " Mar 16 16:05:44 crc kubenswrapper[5120]: I0316 16:05:44.306210 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a3c03367-28dc-4fa5-a569-0d97bad76025-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:44 crc kubenswrapper[5120]: I0316 16:05:44.313113 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3c03367-28dc-4fa5-a569-0d97bad76025-kube-api-access-9pt85" (OuterVolumeSpecName: "kube-api-access-9pt85") pod "a3c03367-28dc-4fa5-a569-0d97bad76025" (UID: "a3c03367-28dc-4fa5-a569-0d97bad76025"). InnerVolumeSpecName "kube-api-access-9pt85". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:05:44 crc kubenswrapper[5120]: I0316 16:05:44.314476 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a3c03367-28dc-4fa5-a569-0d97bad76025-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "a3c03367-28dc-4fa5-a569-0d97bad76025" (UID: "a3c03367-28dc-4fa5-a569-0d97bad76025"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:44 crc kubenswrapper[5120]: I0316 16:05:44.334307 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a3c03367-28dc-4fa5-a569-0d97bad76025-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "a3c03367-28dc-4fa5-a569-0d97bad76025" (UID: "a3c03367-28dc-4fa5-a569-0d97bad76025"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:44 crc kubenswrapper[5120]: I0316 16:05:44.386464 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a3c03367-28dc-4fa5-a569-0d97bad76025-config-data" (OuterVolumeSpecName: "config-data") pod "a3c03367-28dc-4fa5-a569-0d97bad76025" (UID: "a3c03367-28dc-4fa5-a569-0d97bad76025"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:44 crc kubenswrapper[5120]: I0316 16:05:44.411798 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a3c03367-28dc-4fa5-a569-0d97bad76025-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:44 crc kubenswrapper[5120]: I0316 16:05:44.411837 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9pt85\" (UniqueName: \"kubernetes.io/projected/a3c03367-28dc-4fa5-a569-0d97bad76025-kube-api-access-9pt85\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:44 crc kubenswrapper[5120]: I0316 16:05:44.411848 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/a3c03367-28dc-4fa5-a569-0d97bad76025-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:44 crc kubenswrapper[5120]: I0316 16:05:44.411857 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a3c03367-28dc-4fa5-a569-0d97bad76025-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:44 crc kubenswrapper[5120]: I0316 16:05:44.676493 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1772eb98-e47b-45ce-a67e-e50b9e67caf0" path="/var/lib/kubelet/pods/1772eb98-e47b-45ce-a67e-e50b9e67caf0/volumes" Mar 16 16:05:44 crc kubenswrapper[5120]: I0316 16:05:44.744894 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"c6ef2171-25f8-43d1-a037-b915f5b77abc","Type":"ContainerStarted","Data":"2d0b86f84ea9cbf53b3f863fadf423c26de96160c88b2c0c460eb8283fe6384c"} Mar 16 16:05:44 crc kubenswrapper[5120]: I0316 16:05:44.744946 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"c6ef2171-25f8-43d1-a037-b915f5b77abc","Type":"ContainerStarted","Data":"eeea894f1003e772f79c479d2d9e54b500d1a02ac928cf33d99ae98b75d8bf79"} Mar 16 16:05:44 crc kubenswrapper[5120]: I0316 16:05:44.747049 5120 generic.go:358] "Generic (PLEG): container finished" podID="a3c03367-28dc-4fa5-a569-0d97bad76025" containerID="463e599745b4cbe8883cb0bcd7cf94a750337b70a82a08c2bffef8028e93fa82" exitCode=0 Mar 16 16:05:44 crc kubenswrapper[5120]: I0316 16:05:44.747130 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-64d4b879f4-m86vx" Mar 16 16:05:44 crc kubenswrapper[5120]: I0316 16:05:44.747247 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-64d4b879f4-m86vx" event={"ID":"a3c03367-28dc-4fa5-a569-0d97bad76025","Type":"ContainerDied","Data":"463e599745b4cbe8883cb0bcd7cf94a750337b70a82a08c2bffef8028e93fa82"} Mar 16 16:05:44 crc kubenswrapper[5120]: I0316 16:05:44.747280 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-64d4b879f4-m86vx" event={"ID":"a3c03367-28dc-4fa5-a569-0d97bad76025","Type":"ContainerDied","Data":"d2cf8dfbbe92fd98a0172e186ab88f45777fa39d1c82df41a15b9845e31cc1e1"} Mar 16 16:05:44 crc kubenswrapper[5120]: I0316 16:05:44.747297 5120 scope.go:117] "RemoveContainer" containerID="463e599745b4cbe8883cb0bcd7cf94a750337b70a82a08c2bffef8028e93fa82" Mar 16 16:05:44 crc kubenswrapper[5120]: I0316 16:05:44.751667 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-87b69bc94-qlznl" event={"ID":"502b04b6-fe65-4be1-847c-172941719e46","Type":"ContainerStarted","Data":"500f344bc8320a64252eb3717ce8847a36e2bdc36c2206a38cd7cf09aa08ed3a"} Mar 16 16:05:44 crc kubenswrapper[5120]: I0316 16:05:44.751714 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-87b69bc94-qlznl" event={"ID":"502b04b6-fe65-4be1-847c-172941719e46","Type":"ContainerStarted","Data":"e2f06c71fb4d23c856b18d6f3d945870a0ff7ae00f7fb9467dfd44c1eb0c3f68"} Mar 16 16:05:44 crc kubenswrapper[5120]: I0316 16:05:44.751731 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-87b69bc94-qlznl" event={"ID":"502b04b6-fe65-4be1-847c-172941719e46","Type":"ContainerStarted","Data":"e29adafa1020551359eef0e70335fb53fffa6284bb5acad7446fa3f82606ae63"} Mar 16 16:05:44 crc kubenswrapper[5120]: I0316 16:05:44.753301 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:05:44 crc kubenswrapper[5120]: I0316 16:05:44.753336 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:05:44 crc kubenswrapper[5120]: I0316 16:05:44.753346 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/swift-proxy-87b69bc94-qlznl" Mar 16 16:05:44 crc kubenswrapper[5120]: I0316 16:05:44.753364 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/swift-proxy-87b69bc94-qlznl" Mar 16 16:05:44 crc kubenswrapper[5120]: I0316 16:05:44.775135 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-64d4b879f4-m86vx"] Mar 16 16:05:44 crc kubenswrapper[5120]: I0316 16:05:44.779941 5120 scope.go:117] "RemoveContainer" containerID="13b097be32c1c312c9a56e9d5be72bc21c6efd3133797c6a00939a303caf2c96" Mar 16 16:05:44 crc kubenswrapper[5120]: I0316 16:05:44.785575 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-64d4b879f4-m86vx"] Mar 16 16:05:44 crc kubenswrapper[5120]: I0316 16:05:44.799011 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/swift-proxy-87b69bc94-qlznl" podStartSLOduration=1.798948365 podStartE2EDuration="1.798948365s" podCreationTimestamp="2026-03-16 16:05:43 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:05:44.78958469 +0000 UTC m=+2046.943516347" watchObservedRunningTime="2026-03-16 16:05:44.798948365 +0000 UTC m=+2046.952880042" Mar 16 16:05:44 crc kubenswrapper[5120]: I0316 16:05:44.815212 5120 scope.go:117] "RemoveContainer" containerID="463e599745b4cbe8883cb0bcd7cf94a750337b70a82a08c2bffef8028e93fa82" Mar 16 16:05:44 crc kubenswrapper[5120]: E0316 16:05:44.818122 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"463e599745b4cbe8883cb0bcd7cf94a750337b70a82a08c2bffef8028e93fa82\": container with ID starting with 463e599745b4cbe8883cb0bcd7cf94a750337b70a82a08c2bffef8028e93fa82 not found: ID does not exist" containerID="463e599745b4cbe8883cb0bcd7cf94a750337b70a82a08c2bffef8028e93fa82" Mar 16 16:05:44 crc kubenswrapper[5120]: I0316 16:05:44.818162 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"463e599745b4cbe8883cb0bcd7cf94a750337b70a82a08c2bffef8028e93fa82"} err="failed to get container status \"463e599745b4cbe8883cb0bcd7cf94a750337b70a82a08c2bffef8028e93fa82\": rpc error: code = NotFound desc = could not find container \"463e599745b4cbe8883cb0bcd7cf94a750337b70a82a08c2bffef8028e93fa82\": container with ID starting with 463e599745b4cbe8883cb0bcd7cf94a750337b70a82a08c2bffef8028e93fa82 not found: ID does not exist" Mar 16 16:05:44 crc kubenswrapper[5120]: I0316 16:05:44.818183 5120 scope.go:117] "RemoveContainer" containerID="13b097be32c1c312c9a56e9d5be72bc21c6efd3133797c6a00939a303caf2c96" Mar 16 16:05:44 crc kubenswrapper[5120]: E0316 16:05:44.821076 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"13b097be32c1c312c9a56e9d5be72bc21c6efd3133797c6a00939a303caf2c96\": container with ID starting with 13b097be32c1c312c9a56e9d5be72bc21c6efd3133797c6a00939a303caf2c96 not found: ID does not exist" containerID="13b097be32c1c312c9a56e9d5be72bc21c6efd3133797c6a00939a303caf2c96" Mar 16 16:05:44 crc kubenswrapper[5120]: I0316 16:05:44.821135 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13b097be32c1c312c9a56e9d5be72bc21c6efd3133797c6a00939a303caf2c96"} err="failed to get container status \"13b097be32c1c312c9a56e9d5be72bc21c6efd3133797c6a00939a303caf2c96\": rpc error: code = NotFound desc = could not find container \"13b097be32c1c312c9a56e9d5be72bc21c6efd3133797c6a00939a303caf2c96\": container with ID starting with 13b097be32c1c312c9a56e9d5be72bc21c6efd3133797c6a00939a303caf2c96 not found: ID does not exist" Mar 16 16:05:45 crc kubenswrapper[5120]: I0316 16:05:45.089449 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:05:45 crc kubenswrapper[5120]: I0316 16:05:45.163540 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:05:45 crc kubenswrapper[5120]: I0316 16:05:45.163580 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:05:45 crc kubenswrapper[5120]: I0316 16:05:45.197254 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:05:45 crc kubenswrapper[5120]: I0316 16:05:45.306165 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:05:45 crc kubenswrapper[5120]: I0316 16:05:45.346948 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:05:45 crc kubenswrapper[5120]: E0316 16:05:45.473473 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="eaa8e905618c3287f78bbdda9d5b8e1d7a9ea191e193e106e08869701479bec0" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:05:45 crc kubenswrapper[5120]: E0316 16:05:45.479071 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="eaa8e905618c3287f78bbdda9d5b8e1d7a9ea191e193e106e08869701479bec0" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:05:45 crc kubenswrapper[5120]: E0316 16:05:45.482418 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="eaa8e905618c3287f78bbdda9d5b8e1d7a9ea191e193e106e08869701479bec0" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:05:45 crc kubenswrapper[5120]: E0316 16:05:45.482469 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="683d3459-b9fc-478c-b74e-c1a09fd45e4d" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 16:05:45 crc kubenswrapper[5120]: I0316 16:05:45.775956 5120 generic.go:358] "Generic (PLEG): container finished" podID="307ebaa6-527e-4d6f-9601-dcb38aaa8a20" containerID="d7e5e30c61b09a69c95923f05ac16a77beb58bdaed6db16f9297e00dc08129ce" exitCode=0 Mar 16 16:05:45 crc kubenswrapper[5120]: I0316 16:05:45.776166 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-7469b9f4cf-wq7wj" event={"ID":"307ebaa6-527e-4d6f-9601-dcb38aaa8a20","Type":"ContainerDied","Data":"d7e5e30c61b09a69c95923f05ac16a77beb58bdaed6db16f9297e00dc08129ce"} Mar 16 16:05:45 crc kubenswrapper[5120]: I0316 16:05:45.776503 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-7469b9f4cf-wq7wj" event={"ID":"307ebaa6-527e-4d6f-9601-dcb38aaa8a20","Type":"ContainerDied","Data":"4fafd6ad4be7de716f3a002a0a3a210e154b2599e50282b850f9d9cc64a1f10d"} Mar 16 16:05:45 crc kubenswrapper[5120]: I0316 16:05:45.776520 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4fafd6ad4be7de716f3a002a0a3a210e154b2599e50282b850f9d9cc64a1f10d" Mar 16 16:05:45 crc kubenswrapper[5120]: I0316 16:05:45.778612 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"c6ef2171-25f8-43d1-a037-b915f5b77abc","Type":"ContainerStarted","Data":"3eb73c59c62ea647f400a2728674a5a5fff71ad386b71213f4394dd33c2bc900"} Mar 16 16:05:45 crc kubenswrapper[5120]: I0316 16:05:45.780589 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="e81e832e-72a4-4622-b4b9-e6a41d92fce3" containerName="glance-log" containerID="cri-o://ce28a1492a234a150502a3eae0e257dda366d7ad8553ae0ddc198e26f63873f4" gracePeriod=30 Mar 16 16:05:45 crc kubenswrapper[5120]: I0316 16:05:45.780691 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="e81e832e-72a4-4622-b4b9-e6a41d92fce3" containerName="glance-httpd" containerID="cri-o://3f106e4da64e5a562b06278622c6480a350064564e56ac929cfe8afda3b1b6a2" gracePeriod=30 Mar 16 16:05:45 crc kubenswrapper[5120]: I0316 16:05:45.784835 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:05:45 crc kubenswrapper[5120]: I0316 16:05:45.784866 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:05:45 crc kubenswrapper[5120]: I0316 16:05:45.789606 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="e81e832e-72a4-4622-b4b9-e6a41d92fce3" containerName="glance-httpd" probeResult="failure" output="Get \"https://10.217.1.183:9292/healthcheck\": read tcp 10.217.0.2:47346->10.217.1.183:9292: read: connection reset by peer" Mar 16 16:05:45 crc kubenswrapper[5120]: I0316 16:05:45.789732 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="e81e832e-72a4-4622-b4b9-e6a41d92fce3" containerName="glance-log" probeResult="failure" output="Get \"https://10.217.1.183:9292/healthcheck\": read tcp 10.217.0.2:47352->10.217.1.183:9292: read: connection reset by peer" Mar 16 16:05:45 crc kubenswrapper[5120]: I0316 16:05:45.811393 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-7469b9f4cf-wq7wj" Mar 16 16:05:45 crc kubenswrapper[5120]: I0316 16:05:45.884400 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/307ebaa6-527e-4d6f-9601-dcb38aaa8a20-combined-ca-bundle\") pod \"307ebaa6-527e-4d6f-9601-dcb38aaa8a20\" (UID: \"307ebaa6-527e-4d6f-9601-dcb38aaa8a20\") " Mar 16 16:05:45 crc kubenswrapper[5120]: I0316 16:05:45.884592 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/307ebaa6-527e-4d6f-9601-dcb38aaa8a20-config-data\") pod \"307ebaa6-527e-4d6f-9601-dcb38aaa8a20\" (UID: \"307ebaa6-527e-4d6f-9601-dcb38aaa8a20\") " Mar 16 16:05:45 crc kubenswrapper[5120]: I0316 16:05:45.884785 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pzb5r\" (UniqueName: \"kubernetes.io/projected/307ebaa6-527e-4d6f-9601-dcb38aaa8a20-kube-api-access-pzb5r\") pod \"307ebaa6-527e-4d6f-9601-dcb38aaa8a20\" (UID: \"307ebaa6-527e-4d6f-9601-dcb38aaa8a20\") " Mar 16 16:05:45 crc kubenswrapper[5120]: I0316 16:05:45.884816 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/307ebaa6-527e-4d6f-9601-dcb38aaa8a20-config-data-custom\") pod \"307ebaa6-527e-4d6f-9601-dcb38aaa8a20\" (UID: \"307ebaa6-527e-4d6f-9601-dcb38aaa8a20\") " Mar 16 16:05:45 crc kubenswrapper[5120]: I0316 16:05:45.884903 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/307ebaa6-527e-4d6f-9601-dcb38aaa8a20-logs\") pod \"307ebaa6-527e-4d6f-9601-dcb38aaa8a20\" (UID: \"307ebaa6-527e-4d6f-9601-dcb38aaa8a20\") " Mar 16 16:05:45 crc kubenswrapper[5120]: I0316 16:05:45.888818 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/307ebaa6-527e-4d6f-9601-dcb38aaa8a20-logs" (OuterVolumeSpecName: "logs") pod "307ebaa6-527e-4d6f-9601-dcb38aaa8a20" (UID: "307ebaa6-527e-4d6f-9601-dcb38aaa8a20"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:05:45 crc kubenswrapper[5120]: I0316 16:05:45.903433 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/307ebaa6-527e-4d6f-9601-dcb38aaa8a20-kube-api-access-pzb5r" (OuterVolumeSpecName: "kube-api-access-pzb5r") pod "307ebaa6-527e-4d6f-9601-dcb38aaa8a20" (UID: "307ebaa6-527e-4d6f-9601-dcb38aaa8a20"). InnerVolumeSpecName "kube-api-access-pzb5r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:05:45 crc kubenswrapper[5120]: I0316 16:05:45.906906 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/307ebaa6-527e-4d6f-9601-dcb38aaa8a20-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "307ebaa6-527e-4d6f-9601-dcb38aaa8a20" (UID: "307ebaa6-527e-4d6f-9601-dcb38aaa8a20"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:46 crc kubenswrapper[5120]: I0316 16:05:46.015849 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/307ebaa6-527e-4d6f-9601-dcb38aaa8a20-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "307ebaa6-527e-4d6f-9601-dcb38aaa8a20" (UID: "307ebaa6-527e-4d6f-9601-dcb38aaa8a20"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:46 crc kubenswrapper[5120]: I0316 16:05:46.023378 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pzb5r\" (UniqueName: \"kubernetes.io/projected/307ebaa6-527e-4d6f-9601-dcb38aaa8a20-kube-api-access-pzb5r\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:46 crc kubenswrapper[5120]: I0316 16:05:46.023414 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/307ebaa6-527e-4d6f-9601-dcb38aaa8a20-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:46 crc kubenswrapper[5120]: I0316 16:05:46.023426 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/307ebaa6-527e-4d6f-9601-dcb38aaa8a20-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:46 crc kubenswrapper[5120]: I0316 16:05:46.023436 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/307ebaa6-527e-4d6f-9601-dcb38aaa8a20-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:46 crc kubenswrapper[5120]: I0316 16:05:46.079997 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/307ebaa6-527e-4d6f-9601-dcb38aaa8a20-config-data" (OuterVolumeSpecName: "config-data") pod "307ebaa6-527e-4d6f-9601-dcb38aaa8a20" (UID: "307ebaa6-527e-4d6f-9601-dcb38aaa8a20"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:46 crc kubenswrapper[5120]: I0316 16:05:46.125068 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/307ebaa6-527e-4d6f-9601-dcb38aaa8a20-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:46 crc kubenswrapper[5120]: I0316 16:05:46.158484 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:05:46 crc kubenswrapper[5120]: I0316 16:05:46.190559 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:05:46 crc kubenswrapper[5120]: I0316 16:05:46.675323 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a3c03367-28dc-4fa5-a569-0d97bad76025" path="/var/lib/kubelet/pods/a3c03367-28dc-4fa5-a569-0d97bad76025/volumes" Mar 16 16:05:46 crc kubenswrapper[5120]: I0316 16:05:46.694348 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:05:46 crc kubenswrapper[5120]: I0316 16:05:46.820632 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"c6ef2171-25f8-43d1-a037-b915f5b77abc","Type":"ContainerStarted","Data":"48de766ec48090227f6df29a7b45a2b202795208666a9ad5390af083fc0cc007"} Mar 16 16:05:46 crc kubenswrapper[5120]: I0316 16:05:46.826108 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:05:46 crc kubenswrapper[5120]: I0316 16:05:46.828951 5120 generic.go:358] "Generic (PLEG): container finished" podID="e81e832e-72a4-4622-b4b9-e6a41d92fce3" containerID="3f106e4da64e5a562b06278622c6480a350064564e56ac929cfe8afda3b1b6a2" exitCode=0 Mar 16 16:05:46 crc kubenswrapper[5120]: I0316 16:05:46.828979 5120 generic.go:358] "Generic (PLEG): container finished" podID="e81e832e-72a4-4622-b4b9-e6a41d92fce3" containerID="ce28a1492a234a150502a3eae0e257dda366d7ad8553ae0ddc198e26f63873f4" exitCode=143 Mar 16 16:05:46 crc kubenswrapper[5120]: I0316 16:05:46.829100 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-7469b9f4cf-wq7wj" Mar 16 16:05:46 crc kubenswrapper[5120]: I0316 16:05:46.829882 5120 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Mar 16 16:05:46 crc kubenswrapper[5120]: I0316 16:05:46.829895 5120 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Mar 16 16:05:46 crc kubenswrapper[5120]: I0316 16:05:46.829998 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="e21caabc-db04-4dca-af4d-fbbbbde012ef" containerName="glance-log" containerID="cri-o://690d8c0414abcfba6ac522dccd770b198d8df01c4d769b43d45f9b7b69658a8b" gracePeriod=30 Mar 16 16:05:46 crc kubenswrapper[5120]: I0316 16:05:46.830118 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"e81e832e-72a4-4622-b4b9-e6a41d92fce3","Type":"ContainerDied","Data":"3f106e4da64e5a562b06278622c6480a350064564e56ac929cfe8afda3b1b6a2"} Mar 16 16:05:46 crc kubenswrapper[5120]: I0316 16:05:46.830150 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"e81e832e-72a4-4622-b4b9-e6a41d92fce3","Type":"ContainerDied","Data":"ce28a1492a234a150502a3eae0e257dda366d7ad8553ae0ddc198e26f63873f4"} Mar 16 16:05:46 crc kubenswrapper[5120]: I0316 16:05:46.830161 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"e81e832e-72a4-4622-b4b9-e6a41d92fce3","Type":"ContainerDied","Data":"a3220fcd7ef59cd33ae120d4069976f8d77ecbd97b331a5b0b7c81979d822580"} Mar 16 16:05:46 crc kubenswrapper[5120]: I0316 16:05:46.830177 5120 scope.go:117] "RemoveContainer" containerID="3f106e4da64e5a562b06278622c6480a350064564e56ac929cfe8afda3b1b6a2" Mar 16 16:05:46 crc kubenswrapper[5120]: I0316 16:05:46.832012 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="e21caabc-db04-4dca-af4d-fbbbbde012ef" containerName="glance-httpd" containerID="cri-o://8eea30b4264cb5b81ae072784fc62cef45ea952a53322bf12789607ce5b7ee48" gracePeriod=30 Mar 16 16:05:46 crc kubenswrapper[5120]: I0316 16:05:46.842424 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="e21caabc-db04-4dca-af4d-fbbbbde012ef" containerName="glance-httpd" probeResult="failure" output="Get \"https://10.217.1.182:9292/healthcheck\": EOF" Mar 16 16:05:46 crc kubenswrapper[5120]: I0316 16:05:46.842521 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="e21caabc-db04-4dca-af4d-fbbbbde012ef" containerName="glance-log" probeResult="failure" output="Get \"https://10.217.1.182:9292/healthcheck\": EOF" Mar 16 16:05:46 crc kubenswrapper[5120]: I0316 16:05:46.873201 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:05:46 crc kubenswrapper[5120]: I0316 16:05:46.888569 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-7469b9f4cf-wq7wj"] Mar 16 16:05:46 crc kubenswrapper[5120]: I0316 16:05:46.889636 5120 scope.go:117] "RemoveContainer" containerID="ce28a1492a234a150502a3eae0e257dda366d7ad8553ae0ddc198e26f63873f4" Mar 16 16:05:46 crc kubenswrapper[5120]: I0316 16:05:46.921449 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-worker-7469b9f4cf-wq7wj"] Mar 16 16:05:46 crc kubenswrapper[5120]: I0316 16:05:46.936525 5120 scope.go:117] "RemoveContainer" containerID="3f106e4da64e5a562b06278622c6480a350064564e56ac929cfe8afda3b1b6a2" Mar 16 16:05:46 crc kubenswrapper[5120]: E0316 16:05:46.944613 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f106e4da64e5a562b06278622c6480a350064564e56ac929cfe8afda3b1b6a2\": container with ID starting with 3f106e4da64e5a562b06278622c6480a350064564e56ac929cfe8afda3b1b6a2 not found: ID does not exist" containerID="3f106e4da64e5a562b06278622c6480a350064564e56ac929cfe8afda3b1b6a2" Mar 16 16:05:46 crc kubenswrapper[5120]: I0316 16:05:46.945723 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f106e4da64e5a562b06278622c6480a350064564e56ac929cfe8afda3b1b6a2"} err="failed to get container status \"3f106e4da64e5a562b06278622c6480a350064564e56ac929cfe8afda3b1b6a2\": rpc error: code = NotFound desc = could not find container \"3f106e4da64e5a562b06278622c6480a350064564e56ac929cfe8afda3b1b6a2\": container with ID starting with 3f106e4da64e5a562b06278622c6480a350064564e56ac929cfe8afda3b1b6a2 not found: ID does not exist" Mar 16 16:05:46 crc kubenswrapper[5120]: I0316 16:05:46.945815 5120 scope.go:117] "RemoveContainer" containerID="ce28a1492a234a150502a3eae0e257dda366d7ad8553ae0ddc198e26f63873f4" Mar 16 16:05:46 crc kubenswrapper[5120]: E0316 16:05:46.955808 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce28a1492a234a150502a3eae0e257dda366d7ad8553ae0ddc198e26f63873f4\": container with ID starting with ce28a1492a234a150502a3eae0e257dda366d7ad8553ae0ddc198e26f63873f4 not found: ID does not exist" containerID="ce28a1492a234a150502a3eae0e257dda366d7ad8553ae0ddc198e26f63873f4" Mar 16 16:05:46 crc kubenswrapper[5120]: I0316 16:05:46.955871 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce28a1492a234a150502a3eae0e257dda366d7ad8553ae0ddc198e26f63873f4"} err="failed to get container status \"ce28a1492a234a150502a3eae0e257dda366d7ad8553ae0ddc198e26f63873f4\": rpc error: code = NotFound desc = could not find container \"ce28a1492a234a150502a3eae0e257dda366d7ad8553ae0ddc198e26f63873f4\": container with ID starting with ce28a1492a234a150502a3eae0e257dda366d7ad8553ae0ddc198e26f63873f4 not found: ID does not exist" Mar 16 16:05:46 crc kubenswrapper[5120]: I0316 16:05:46.955898 5120 scope.go:117] "RemoveContainer" containerID="3f106e4da64e5a562b06278622c6480a350064564e56ac929cfe8afda3b1b6a2" Mar 16 16:05:46 crc kubenswrapper[5120]: I0316 16:05:46.959153 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f106e4da64e5a562b06278622c6480a350064564e56ac929cfe8afda3b1b6a2"} err="failed to get container status \"3f106e4da64e5a562b06278622c6480a350064564e56ac929cfe8afda3b1b6a2\": rpc error: code = NotFound desc = could not find container \"3f106e4da64e5a562b06278622c6480a350064564e56ac929cfe8afda3b1b6a2\": container with ID starting with 3f106e4da64e5a562b06278622c6480a350064564e56ac929cfe8afda3b1b6a2 not found: ID does not exist" Mar 16 16:05:46 crc kubenswrapper[5120]: I0316 16:05:46.959176 5120 scope.go:117] "RemoveContainer" containerID="ce28a1492a234a150502a3eae0e257dda366d7ad8553ae0ddc198e26f63873f4" Mar 16 16:05:46 crc kubenswrapper[5120]: I0316 16:05:46.960300 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce28a1492a234a150502a3eae0e257dda366d7ad8553ae0ddc198e26f63873f4"} err="failed to get container status \"ce28a1492a234a150502a3eae0e257dda366d7ad8553ae0ddc198e26f63873f4\": rpc error: code = NotFound desc = could not find container \"ce28a1492a234a150502a3eae0e257dda366d7ad8553ae0ddc198e26f63873f4\": container with ID starting with ce28a1492a234a150502a3eae0e257dda366d7ad8553ae0ddc198e26f63873f4 not found: ID does not exist" Mar 16 16:05:46 crc kubenswrapper[5120]: I0316 16:05:46.964454 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e81e832e-72a4-4622-b4b9-e6a41d92fce3-internal-tls-certs\") pod \"e81e832e-72a4-4622-b4b9-e6a41d92fce3\" (UID: \"e81e832e-72a4-4622-b4b9-e6a41d92fce3\") " Mar 16 16:05:46 crc kubenswrapper[5120]: I0316 16:05:46.964553 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/e81e832e-72a4-4622-b4b9-e6a41d92fce3-httpd-run\") pod \"e81e832e-72a4-4622-b4b9-e6a41d92fce3\" (UID: \"e81e832e-72a4-4622-b4b9-e6a41d92fce3\") " Mar 16 16:05:46 crc kubenswrapper[5120]: I0316 16:05:46.964645 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"e81e832e-72a4-4622-b4b9-e6a41d92fce3\" (UID: \"e81e832e-72a4-4622-b4b9-e6a41d92fce3\") " Mar 16 16:05:46 crc kubenswrapper[5120]: I0316 16:05:46.964680 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e81e832e-72a4-4622-b4b9-e6a41d92fce3-combined-ca-bundle\") pod \"e81e832e-72a4-4622-b4b9-e6a41d92fce3\" (UID: \"e81e832e-72a4-4622-b4b9-e6a41d92fce3\") " Mar 16 16:05:46 crc kubenswrapper[5120]: I0316 16:05:46.964734 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e81e832e-72a4-4622-b4b9-e6a41d92fce3-config-data\") pod \"e81e832e-72a4-4622-b4b9-e6a41d92fce3\" (UID: \"e81e832e-72a4-4622-b4b9-e6a41d92fce3\") " Mar 16 16:05:46 crc kubenswrapper[5120]: I0316 16:05:46.964771 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e81e832e-72a4-4622-b4b9-e6a41d92fce3-logs\") pod \"e81e832e-72a4-4622-b4b9-e6a41d92fce3\" (UID: \"e81e832e-72a4-4622-b4b9-e6a41d92fce3\") " Mar 16 16:05:46 crc kubenswrapper[5120]: I0316 16:05:46.964955 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7dwrm\" (UniqueName: \"kubernetes.io/projected/e81e832e-72a4-4622-b4b9-e6a41d92fce3-kube-api-access-7dwrm\") pod \"e81e832e-72a4-4622-b4b9-e6a41d92fce3\" (UID: \"e81e832e-72a4-4622-b4b9-e6a41d92fce3\") " Mar 16 16:05:46 crc kubenswrapper[5120]: I0316 16:05:46.964986 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e81e832e-72a4-4622-b4b9-e6a41d92fce3-scripts\") pod \"e81e832e-72a4-4622-b4b9-e6a41d92fce3\" (UID: \"e81e832e-72a4-4622-b4b9-e6a41d92fce3\") " Mar 16 16:05:46 crc kubenswrapper[5120]: I0316 16:05:46.966408 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e81e832e-72a4-4622-b4b9-e6a41d92fce3-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "e81e832e-72a4-4622-b4b9-e6a41d92fce3" (UID: "e81e832e-72a4-4622-b4b9-e6a41d92fce3"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:05:46 crc kubenswrapper[5120]: I0316 16:05:46.966517 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e81e832e-72a4-4622-b4b9-e6a41d92fce3-logs" (OuterVolumeSpecName: "logs") pod "e81e832e-72a4-4622-b4b9-e6a41d92fce3" (UID: "e81e832e-72a4-4622-b4b9-e6a41d92fce3"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:05:46 crc kubenswrapper[5120]: I0316 16:05:46.976459 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/e81e832e-72a4-4622-b4b9-e6a41d92fce3-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:46 crc kubenswrapper[5120]: I0316 16:05:46.976491 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e81e832e-72a4-4622-b4b9-e6a41d92fce3-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:46 crc kubenswrapper[5120]: I0316 16:05:46.990550 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage09-crc" (OuterVolumeSpecName: "glance") pod "e81e832e-72a4-4622-b4b9-e6a41d92fce3" (UID: "e81e832e-72a4-4622-b4b9-e6a41d92fce3"). InnerVolumeSpecName "local-storage09-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:05:47 crc kubenswrapper[5120]: I0316 16:05:47.000001 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e81e832e-72a4-4622-b4b9-e6a41d92fce3-kube-api-access-7dwrm" (OuterVolumeSpecName: "kube-api-access-7dwrm") pod "e81e832e-72a4-4622-b4b9-e6a41d92fce3" (UID: "e81e832e-72a4-4622-b4b9-e6a41d92fce3"). InnerVolumeSpecName "kube-api-access-7dwrm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:05:47 crc kubenswrapper[5120]: I0316 16:05:47.000075 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e81e832e-72a4-4622-b4b9-e6a41d92fce3-scripts" (OuterVolumeSpecName: "scripts") pod "e81e832e-72a4-4622-b4b9-e6a41d92fce3" (UID: "e81e832e-72a4-4622-b4b9-e6a41d92fce3"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:47 crc kubenswrapper[5120]: I0316 16:05:47.030252 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e81e832e-72a4-4622-b4b9-e6a41d92fce3-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e81e832e-72a4-4622-b4b9-e6a41d92fce3" (UID: "e81e832e-72a4-4622-b4b9-e6a41d92fce3"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:47 crc kubenswrapper[5120]: I0316 16:05:47.071828 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e81e832e-72a4-4622-b4b9-e6a41d92fce3-config-data" (OuterVolumeSpecName: "config-data") pod "e81e832e-72a4-4622-b4b9-e6a41d92fce3" (UID: "e81e832e-72a4-4622-b4b9-e6a41d92fce3"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:47 crc kubenswrapper[5120]: I0316 16:05:47.077805 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") on node \"crc\" " Mar 16 16:05:47 crc kubenswrapper[5120]: I0316 16:05:47.077836 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e81e832e-72a4-4622-b4b9-e6a41d92fce3-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:47 crc kubenswrapper[5120]: I0316 16:05:47.077847 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e81e832e-72a4-4622-b4b9-e6a41d92fce3-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:47 crc kubenswrapper[5120]: I0316 16:05:47.077856 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7dwrm\" (UniqueName: \"kubernetes.io/projected/e81e832e-72a4-4622-b4b9-e6a41d92fce3-kube-api-access-7dwrm\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:47 crc kubenswrapper[5120]: I0316 16:05:47.077865 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e81e832e-72a4-4622-b4b9-e6a41d92fce3-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:47 crc kubenswrapper[5120]: I0316 16:05:47.112203 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage09-crc" (UniqueName: "kubernetes.io/local-volume/local-storage09-crc") on node "crc" Mar 16 16:05:47 crc kubenswrapper[5120]: I0316 16:05:47.137910 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e81e832e-72a4-4622-b4b9-e6a41d92fce3-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "e81e832e-72a4-4622-b4b9-e6a41d92fce3" (UID: "e81e832e-72a4-4622-b4b9-e6a41d92fce3"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:47 crc kubenswrapper[5120]: I0316 16:05:47.179346 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e81e832e-72a4-4622-b4b9-e6a41d92fce3-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:47 crc kubenswrapper[5120]: I0316 16:05:47.179385 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:47 crc kubenswrapper[5120]: E0316 16:05:47.186995 5120 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddbb06351_e6e7_4a49_a941_33b16fc6206d.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbf01270c_6ae8_4c7f_aee3_42a125c155e4.slice\": RecentStats: unable to find data in memory cache]" Mar 16 16:05:47 crc kubenswrapper[5120]: I0316 16:05:47.190214 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-85c78fd974-xjpjw"] Mar 16 16:05:47 crc kubenswrapper[5120]: I0316 16:05:47.190607 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-85c78fd974-xjpjw" podUID="9d957ec2-c514-472f-8d88-1d6c6fa2449a" containerName="placement-log" containerID="cri-o://4116dcb83724da3c7c7e7b411acb5b9cee7912b69d024280fbdb5d4b961c617a" gracePeriod=30 Mar 16 16:05:47 crc kubenswrapper[5120]: I0316 16:05:47.190837 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-85c78fd974-xjpjw" podUID="9d957ec2-c514-472f-8d88-1d6c6fa2449a" containerName="placement-api" containerID="cri-o://333737d93d6fbb25bb5004ab514939c313486791cddcf0cc65119cd679595d46" gracePeriod=30 Mar 16 16:05:47 crc kubenswrapper[5120]: I0316 16:05:47.228000 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/placement-85c78fd974-xjpjw" podUID="9d957ec2-c514-472f-8d88-1d6c6fa2449a" containerName="placement-api" probeResult="failure" output="Get \"https://10.217.1.179:8778/\": EOF" Mar 16 16:05:47 crc kubenswrapper[5120]: I0316 16:05:47.228522 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/placement-85c78fd974-xjpjw" podUID="9d957ec2-c514-472f-8d88-1d6c6fa2449a" containerName="placement-log" probeResult="failure" output="Get \"https://10.217.1.179:8778/\": EOF" Mar 16 16:05:47 crc kubenswrapper[5120]: I0316 16:05:47.267237 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:05:47 crc kubenswrapper[5120]: I0316 16:05:47.309888 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:05:47 crc kubenswrapper[5120]: I0316 16:05:47.310135 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="5b630779-e8f9-434c-9449-d2aad103f041" containerName="cinder-api-log" containerID="cri-o://c9abfc0dbbcf0d1cd004190466602e73374823f5f514bd5c3beb0cb3aea8c284" gracePeriod=30 Mar 16 16:05:47 crc kubenswrapper[5120]: I0316 16:05:47.310264 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="5b630779-e8f9-434c-9449-d2aad103f041" containerName="cinder-api" containerID="cri-o://e3fdff7b57d0a087985cbd2289bc6fbf6801532cb62e3595713545733446a1e0" gracePeriod=30 Mar 16 16:05:47 crc kubenswrapper[5120]: I0316 16:05:47.332091 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/cinder-api-0" podUID="5b630779-e8f9-434c-9449-d2aad103f041" containerName="cinder-api" probeResult="failure" output="Get \"https://10.217.1.185:8776/healthcheck\": read tcp 10.217.0.2:47810->10.217.1.185:8776: read: connection reset by peer" Mar 16 16:05:47 crc kubenswrapper[5120]: I0316 16:05:47.572003 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-58cc99cf94-2svpf"] Mar 16 16:05:47 crc kubenswrapper[5120]: I0316 16:05:47.572264 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-58cc99cf94-2svpf" podUID="2e1be97f-dece-41af-b53b-e6d37affb572" containerName="neutron-api" containerID="cri-o://f5f1335640dfd2cdc323b6f629fe282cb7bc92486d51adb3bc351687fdacd823" gracePeriod=30 Mar 16 16:05:47 crc kubenswrapper[5120]: I0316 16:05:47.572625 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-58cc99cf94-2svpf" podUID="2e1be97f-dece-41af-b53b-e6d37affb572" containerName="neutron-httpd" containerID="cri-o://dab79283d9387a520a903f7176e97d9f3c4925818be8f94fcabfa4403183b00d" gracePeriod=30 Mar 16 16:05:47 crc kubenswrapper[5120]: I0316 16:05:47.585544 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/neutron-58cc99cf94-2svpf" podUID="2e1be97f-dece-41af-b53b-e6d37affb572" containerName="neutron-httpd" probeResult="failure" output="Get \"https://10.217.1.181:9696/\": EOF" Mar 16 16:05:47 crc kubenswrapper[5120]: I0316 16:05:47.637033 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:05:47 crc kubenswrapper[5120]: I0316 16:05:47.857162 5120 generic.go:358] "Generic (PLEG): container finished" podID="5b630779-e8f9-434c-9449-d2aad103f041" containerID="e3fdff7b57d0a087985cbd2289bc6fbf6801532cb62e3595713545733446a1e0" exitCode=0 Mar 16 16:05:47 crc kubenswrapper[5120]: I0316 16:05:47.858109 5120 generic.go:358] "Generic (PLEG): container finished" podID="5b630779-e8f9-434c-9449-d2aad103f041" containerID="c9abfc0dbbcf0d1cd004190466602e73374823f5f514bd5c3beb0cb3aea8c284" exitCode=143 Mar 16 16:05:47 crc kubenswrapper[5120]: I0316 16:05:47.857240 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"5b630779-e8f9-434c-9449-d2aad103f041","Type":"ContainerDied","Data":"e3fdff7b57d0a087985cbd2289bc6fbf6801532cb62e3595713545733446a1e0"} Mar 16 16:05:47 crc kubenswrapper[5120]: I0316 16:05:47.858298 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"5b630779-e8f9-434c-9449-d2aad103f041","Type":"ContainerDied","Data":"c9abfc0dbbcf0d1cd004190466602e73374823f5f514bd5c3beb0cb3aea8c284"} Mar 16 16:05:47 crc kubenswrapper[5120]: I0316 16:05:47.860248 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:05:47 crc kubenswrapper[5120]: I0316 16:05:47.873956 5120 generic.go:358] "Generic (PLEG): container finished" podID="9d957ec2-c514-472f-8d88-1d6c6fa2449a" containerID="4116dcb83724da3c7c7e7b411acb5b9cee7912b69d024280fbdb5d4b961c617a" exitCode=143 Mar 16 16:05:47 crc kubenswrapper[5120]: I0316 16:05:47.874143 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-85c78fd974-xjpjw" event={"ID":"9d957ec2-c514-472f-8d88-1d6c6fa2449a","Type":"ContainerDied","Data":"4116dcb83724da3c7c7e7b411acb5b9cee7912b69d024280fbdb5d4b961c617a"} Mar 16 16:05:47 crc kubenswrapper[5120]: I0316 16:05:47.878751 5120 generic.go:358] "Generic (PLEG): container finished" podID="e21caabc-db04-4dca-af4d-fbbbbde012ef" containerID="690d8c0414abcfba6ac522dccd770b198d8df01c4d769b43d45f9b7b69658a8b" exitCode=143 Mar 16 16:05:47 crc kubenswrapper[5120]: I0316 16:05:47.879107 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"e21caabc-db04-4dca-af4d-fbbbbde012ef","Type":"ContainerDied","Data":"690d8c0414abcfba6ac522dccd770b198d8df01c4d769b43d45f9b7b69658a8b"} Mar 16 16:05:47 crc kubenswrapper[5120]: I0316 16:05:47.885545 5120 generic.go:358] "Generic (PLEG): container finished" podID="2e1be97f-dece-41af-b53b-e6d37affb572" containerID="dab79283d9387a520a903f7176e97d9f3c4925818be8f94fcabfa4403183b00d" exitCode=0 Mar 16 16:05:47 crc kubenswrapper[5120]: I0316 16:05:47.886453 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-58cc99cf94-2svpf" event={"ID":"2e1be97f-dece-41af-b53b-e6d37affb572","Type":"ContainerDied","Data":"dab79283d9387a520a903f7176e97d9f3c4925818be8f94fcabfa4403183b00d"} Mar 16 16:05:47 crc kubenswrapper[5120]: I0316 16:05:47.912515 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:05:47 crc kubenswrapper[5120]: I0316 16:05:47.932682 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:05:47 crc kubenswrapper[5120]: I0316 16:05:47.969732 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:05:47 crc kubenswrapper[5120]: I0316 16:05:47.970939 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e81e832e-72a4-4622-b4b9-e6a41d92fce3" containerName="glance-log" Mar 16 16:05:47 crc kubenswrapper[5120]: I0316 16:05:47.971035 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e81e832e-72a4-4622-b4b9-e6a41d92fce3" containerName="glance-log" Mar 16 16:05:47 crc kubenswrapper[5120]: I0316 16:05:47.971125 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="307ebaa6-527e-4d6f-9601-dcb38aaa8a20" containerName="barbican-worker-log" Mar 16 16:05:47 crc kubenswrapper[5120]: I0316 16:05:47.971202 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="307ebaa6-527e-4d6f-9601-dcb38aaa8a20" containerName="barbican-worker-log" Mar 16 16:05:47 crc kubenswrapper[5120]: I0316 16:05:47.971263 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="307ebaa6-527e-4d6f-9601-dcb38aaa8a20" containerName="barbican-worker" Mar 16 16:05:47 crc kubenswrapper[5120]: I0316 16:05:47.971315 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="307ebaa6-527e-4d6f-9601-dcb38aaa8a20" containerName="barbican-worker" Mar 16 16:05:47 crc kubenswrapper[5120]: I0316 16:05:47.971370 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e81e832e-72a4-4622-b4b9-e6a41d92fce3" containerName="glance-httpd" Mar 16 16:05:47 crc kubenswrapper[5120]: I0316 16:05:47.971449 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e81e832e-72a4-4622-b4b9-e6a41d92fce3" containerName="glance-httpd" Mar 16 16:05:47 crc kubenswrapper[5120]: I0316 16:05:47.971531 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3c03367-28dc-4fa5-a569-0d97bad76025" containerName="barbican-keystone-listener-log" Mar 16 16:05:47 crc kubenswrapper[5120]: I0316 16:05:47.971586 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3c03367-28dc-4fa5-a569-0d97bad76025" containerName="barbican-keystone-listener-log" Mar 16 16:05:47 crc kubenswrapper[5120]: I0316 16:05:47.971647 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3c03367-28dc-4fa5-a569-0d97bad76025" containerName="barbican-keystone-listener" Mar 16 16:05:47 crc kubenswrapper[5120]: I0316 16:05:47.971698 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3c03367-28dc-4fa5-a569-0d97bad76025" containerName="barbican-keystone-listener" Mar 16 16:05:47 crc kubenswrapper[5120]: I0316 16:05:47.971928 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="307ebaa6-527e-4d6f-9601-dcb38aaa8a20" containerName="barbican-worker-log" Mar 16 16:05:47 crc kubenswrapper[5120]: I0316 16:05:47.972058 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e81e832e-72a4-4622-b4b9-e6a41d92fce3" containerName="glance-log" Mar 16 16:05:47 crc kubenswrapper[5120]: I0316 16:05:47.972121 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="a3c03367-28dc-4fa5-a569-0d97bad76025" containerName="barbican-keystone-listener" Mar 16 16:05:47 crc kubenswrapper[5120]: I0316 16:05:47.972180 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="a3c03367-28dc-4fa5-a569-0d97bad76025" containerName="barbican-keystone-listener-log" Mar 16 16:05:47 crc kubenswrapper[5120]: I0316 16:05:47.972246 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="307ebaa6-527e-4d6f-9601-dcb38aaa8a20" containerName="barbican-worker" Mar 16 16:05:47 crc kubenswrapper[5120]: I0316 16:05:47.972300 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e81e832e-72a4-4622-b4b9-e6a41d92fce3" containerName="glance-httpd" Mar 16 16:05:47 crc kubenswrapper[5120]: I0316 16:05:47.979443 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:05:47 crc kubenswrapper[5120]: I0316 16:05:47.981553 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-internal-config-data\"" Mar 16 16:05:47 crc kubenswrapper[5120]: I0316 16:05:47.982718 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-internal-svc\"" Mar 16 16:05:48 crc kubenswrapper[5120]: I0316 16:05:48.018494 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:05:48 crc kubenswrapper[5120]: I0316 16:05:48.039060 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:05:48 crc kubenswrapper[5120]: I0316 16:05:48.100654 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/efc5b4b3-507b-4f7b-9524-621ff45c12a6-logs\") pod \"glance-default-internal-api-0\" (UID: \"efc5b4b3-507b-4f7b-9524-621ff45c12a6\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:05:48 crc kubenswrapper[5120]: I0316 16:05:48.100701 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/efc5b4b3-507b-4f7b-9524-621ff45c12a6-scripts\") pod \"glance-default-internal-api-0\" (UID: \"efc5b4b3-507b-4f7b-9524-621ff45c12a6\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:05:48 crc kubenswrapper[5120]: I0316 16:05:48.100832 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/efc5b4b3-507b-4f7b-9524-621ff45c12a6-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"efc5b4b3-507b-4f7b-9524-621ff45c12a6\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:05:48 crc kubenswrapper[5120]: I0316 16:05:48.100911 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4sss\" (UniqueName: \"kubernetes.io/projected/efc5b4b3-507b-4f7b-9524-621ff45c12a6-kube-api-access-g4sss\") pod \"glance-default-internal-api-0\" (UID: \"efc5b4b3-507b-4f7b-9524-621ff45c12a6\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:05:48 crc kubenswrapper[5120]: I0316 16:05:48.100953 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/efc5b4b3-507b-4f7b-9524-621ff45c12a6-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"efc5b4b3-507b-4f7b-9524-621ff45c12a6\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:05:48 crc kubenswrapper[5120]: I0316 16:05:48.100989 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/efc5b4b3-507b-4f7b-9524-621ff45c12a6-config-data\") pod \"glance-default-internal-api-0\" (UID: \"efc5b4b3-507b-4f7b-9524-621ff45c12a6\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:05:48 crc kubenswrapper[5120]: I0316 16:05:48.101153 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/efc5b4b3-507b-4f7b-9524-621ff45c12a6-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"efc5b4b3-507b-4f7b-9524-621ff45c12a6\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:05:48 crc kubenswrapper[5120]: I0316 16:05:48.101284 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"glance-default-internal-api-0\" (UID: \"efc5b4b3-507b-4f7b-9524-621ff45c12a6\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:05:48 crc kubenswrapper[5120]: I0316 16:05:48.202459 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/efc5b4b3-507b-4f7b-9524-621ff45c12a6-config-data\") pod \"glance-default-internal-api-0\" (UID: \"efc5b4b3-507b-4f7b-9524-621ff45c12a6\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:05:48 crc kubenswrapper[5120]: I0316 16:05:48.202528 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/efc5b4b3-507b-4f7b-9524-621ff45c12a6-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"efc5b4b3-507b-4f7b-9524-621ff45c12a6\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:05:48 crc kubenswrapper[5120]: I0316 16:05:48.202591 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"glance-default-internal-api-0\" (UID: \"efc5b4b3-507b-4f7b-9524-621ff45c12a6\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:05:48 crc kubenswrapper[5120]: I0316 16:05:48.202650 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/efc5b4b3-507b-4f7b-9524-621ff45c12a6-logs\") pod \"glance-default-internal-api-0\" (UID: \"efc5b4b3-507b-4f7b-9524-621ff45c12a6\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:05:48 crc kubenswrapper[5120]: I0316 16:05:48.202670 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/efc5b4b3-507b-4f7b-9524-621ff45c12a6-scripts\") pod \"glance-default-internal-api-0\" (UID: \"efc5b4b3-507b-4f7b-9524-621ff45c12a6\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:05:48 crc kubenswrapper[5120]: I0316 16:05:48.202739 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/efc5b4b3-507b-4f7b-9524-621ff45c12a6-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"efc5b4b3-507b-4f7b-9524-621ff45c12a6\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:05:48 crc kubenswrapper[5120]: I0316 16:05:48.202812 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g4sss\" (UniqueName: \"kubernetes.io/projected/efc5b4b3-507b-4f7b-9524-621ff45c12a6-kube-api-access-g4sss\") pod \"glance-default-internal-api-0\" (UID: \"efc5b4b3-507b-4f7b-9524-621ff45c12a6\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:05:48 crc kubenswrapper[5120]: I0316 16:05:48.202834 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/efc5b4b3-507b-4f7b-9524-621ff45c12a6-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"efc5b4b3-507b-4f7b-9524-621ff45c12a6\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:05:48 crc kubenswrapper[5120]: I0316 16:05:48.203332 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"glance-default-internal-api-0\" (UID: \"efc5b4b3-507b-4f7b-9524-621ff45c12a6\") device mount path \"/mnt/openstack/pv09\"" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:05:48 crc kubenswrapper[5120]: I0316 16:05:48.203840 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/efc5b4b3-507b-4f7b-9524-621ff45c12a6-logs\") pod \"glance-default-internal-api-0\" (UID: \"efc5b4b3-507b-4f7b-9524-621ff45c12a6\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:05:48 crc kubenswrapper[5120]: I0316 16:05:48.204081 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/efc5b4b3-507b-4f7b-9524-621ff45c12a6-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"efc5b4b3-507b-4f7b-9524-621ff45c12a6\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:05:48 crc kubenswrapper[5120]: I0316 16:05:48.213064 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/efc5b4b3-507b-4f7b-9524-621ff45c12a6-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"efc5b4b3-507b-4f7b-9524-621ff45c12a6\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:05:48 crc kubenswrapper[5120]: I0316 16:05:48.221289 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-64d4b879f4-bbkqw"] Mar 16 16:05:48 crc kubenswrapper[5120]: I0316 16:05:48.237512 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/efc5b4b3-507b-4f7b-9524-621ff45c12a6-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"efc5b4b3-507b-4f7b-9524-621ff45c12a6\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:05:48 crc kubenswrapper[5120]: I0316 16:05:48.238644 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/efc5b4b3-507b-4f7b-9524-621ff45c12a6-scripts\") pod \"glance-default-internal-api-0\" (UID: \"efc5b4b3-507b-4f7b-9524-621ff45c12a6\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:05:48 crc kubenswrapper[5120]: I0316 16:05:48.240851 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-64d4b879f4-bbkqw" Mar 16 16:05:48 crc kubenswrapper[5120]: I0316 16:05:48.246994 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/efc5b4b3-507b-4f7b-9524-621ff45c12a6-config-data\") pod \"glance-default-internal-api-0\" (UID: \"efc5b4b3-507b-4f7b-9524-621ff45c12a6\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:05:48 crc kubenswrapper[5120]: I0316 16:05:48.247903 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4sss\" (UniqueName: \"kubernetes.io/projected/efc5b4b3-507b-4f7b-9524-621ff45c12a6-kube-api-access-g4sss\") pod \"glance-default-internal-api-0\" (UID: \"efc5b4b3-507b-4f7b-9524-621ff45c12a6\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:05:48 crc kubenswrapper[5120]: I0316 16:05:48.248593 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"glance-default-internal-api-0\" (UID: \"efc5b4b3-507b-4f7b-9524-621ff45c12a6\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:05:48 crc kubenswrapper[5120]: I0316 16:05:48.262819 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-worker-7469b9f4cf-grmhg"] Mar 16 16:05:48 crc kubenswrapper[5120]: I0316 16:05:48.329101 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:05:48 crc kubenswrapper[5120]: I0316 16:05:48.341082 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:05:48 crc kubenswrapper[5120]: I0316 16:05:48.348349 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-7469b9f4cf-grmhg" Mar 16 16:05:48 crc kubenswrapper[5120]: I0316 16:05:48.363536 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-64d4b879f4-bbkqw"] Mar 16 16:05:48 crc kubenswrapper[5120]: I0316 16:05:48.394112 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-7469b9f4cf-grmhg"] Mar 16 16:05:48 crc kubenswrapper[5120]: I0316 16:05:48.415047 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5b630779-e8f9-434c-9449-d2aad103f041-scripts\") pod \"5b630779-e8f9-434c-9449-d2aad103f041\" (UID: \"5b630779-e8f9-434c-9449-d2aad103f041\") " Mar 16 16:05:48 crc kubenswrapper[5120]: I0316 16:05:48.417443 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/5b630779-e8f9-434c-9449-d2aad103f041-etc-machine-id\") pod \"5b630779-e8f9-434c-9449-d2aad103f041\" (UID: \"5b630779-e8f9-434c-9449-d2aad103f041\") " Mar 16 16:05:48 crc kubenswrapper[5120]: I0316 16:05:48.417605 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/5b630779-e8f9-434c-9449-d2aad103f041-internal-tls-certs\") pod \"5b630779-e8f9-434c-9449-d2aad103f041\" (UID: \"5b630779-e8f9-434c-9449-d2aad103f041\") " Mar 16 16:05:48 crc kubenswrapper[5120]: I0316 16:05:48.417802 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5b630779-e8f9-434c-9449-d2aad103f041-combined-ca-bundle\") pod \"5b630779-e8f9-434c-9449-d2aad103f041\" (UID: \"5b630779-e8f9-434c-9449-d2aad103f041\") " Mar 16 16:05:48 crc kubenswrapper[5120]: I0316 16:05:48.417925 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/5b630779-e8f9-434c-9449-d2aad103f041-public-tls-certs\") pod \"5b630779-e8f9-434c-9449-d2aad103f041\" (UID: \"5b630779-e8f9-434c-9449-d2aad103f041\") " Mar 16 16:05:48 crc kubenswrapper[5120]: I0316 16:05:48.418037 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5b630779-e8f9-434c-9449-d2aad103f041-config-data\") pod \"5b630779-e8f9-434c-9449-d2aad103f041\" (UID: \"5b630779-e8f9-434c-9449-d2aad103f041\") " Mar 16 16:05:48 crc kubenswrapper[5120]: I0316 16:05:48.427976 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5b630779-e8f9-434c-9449-d2aad103f041-logs\") pod \"5b630779-e8f9-434c-9449-d2aad103f041\" (UID: \"5b630779-e8f9-434c-9449-d2aad103f041\") " Mar 16 16:05:48 crc kubenswrapper[5120]: I0316 16:05:48.428074 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/5b630779-e8f9-434c-9449-d2aad103f041-config-data-custom\") pod \"5b630779-e8f9-434c-9449-d2aad103f041\" (UID: \"5b630779-e8f9-434c-9449-d2aad103f041\") " Mar 16 16:05:48 crc kubenswrapper[5120]: I0316 16:05:48.428146 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nh4fn\" (UniqueName: \"kubernetes.io/projected/5b630779-e8f9-434c-9449-d2aad103f041-kube-api-access-nh4fn\") pod \"5b630779-e8f9-434c-9449-d2aad103f041\" (UID: \"5b630779-e8f9-434c-9449-d2aad103f041\") " Mar 16 16:05:48 crc kubenswrapper[5120]: I0316 16:05:48.428854 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5k4lv\" (UniqueName: \"kubernetes.io/projected/7fc6bd2b-b3c9-42e9-b7f5-c2aef4997e6c-kube-api-access-5k4lv\") pod \"barbican-keystone-listener-64d4b879f4-bbkqw\" (UID: \"7fc6bd2b-b3c9-42e9-b7f5-c2aef4997e6c\") " pod="openstack-kuttl-tests/barbican-keystone-listener-64d4b879f4-bbkqw" Mar 16 16:05:48 crc kubenswrapper[5120]: I0316 16:05:48.428926 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7fc6bd2b-b3c9-42e9-b7f5-c2aef4997e6c-logs\") pod \"barbican-keystone-listener-64d4b879f4-bbkqw\" (UID: \"7fc6bd2b-b3c9-42e9-b7f5-c2aef4997e6c\") " pod="openstack-kuttl-tests/barbican-keystone-listener-64d4b879f4-bbkqw" Mar 16 16:05:48 crc kubenswrapper[5120]: I0316 16:05:48.429051 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/7fc6bd2b-b3c9-42e9-b7f5-c2aef4997e6c-config-data-custom\") pod \"barbican-keystone-listener-64d4b879f4-bbkqw\" (UID: \"7fc6bd2b-b3c9-42e9-b7f5-c2aef4997e6c\") " pod="openstack-kuttl-tests/barbican-keystone-listener-64d4b879f4-bbkqw" Mar 16 16:05:48 crc kubenswrapper[5120]: I0316 16:05:48.429326 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7fc6bd2b-b3c9-42e9-b7f5-c2aef4997e6c-combined-ca-bundle\") pod \"barbican-keystone-listener-64d4b879f4-bbkqw\" (UID: \"7fc6bd2b-b3c9-42e9-b7f5-c2aef4997e6c\") " pod="openstack-kuttl-tests/barbican-keystone-listener-64d4b879f4-bbkqw" Mar 16 16:05:48 crc kubenswrapper[5120]: I0316 16:05:48.429440 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7fc6bd2b-b3c9-42e9-b7f5-c2aef4997e6c-config-data\") pod \"barbican-keystone-listener-64d4b879f4-bbkqw\" (UID: \"7fc6bd2b-b3c9-42e9-b7f5-c2aef4997e6c\") " pod="openstack-kuttl-tests/barbican-keystone-listener-64d4b879f4-bbkqw" Mar 16 16:05:48 crc kubenswrapper[5120]: I0316 16:05:48.430300 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/5b630779-e8f9-434c-9449-d2aad103f041-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "5b630779-e8f9-434c-9449-d2aad103f041" (UID: "5b630779-e8f9-434c-9449-d2aad103f041"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 16:05:48 crc kubenswrapper[5120]: I0316 16:05:48.432335 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b630779-e8f9-434c-9449-d2aad103f041-scripts" (OuterVolumeSpecName: "scripts") pod "5b630779-e8f9-434c-9449-d2aad103f041" (UID: "5b630779-e8f9-434c-9449-d2aad103f041"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:48 crc kubenswrapper[5120]: I0316 16:05:48.434034 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b630779-e8f9-434c-9449-d2aad103f041-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "5b630779-e8f9-434c-9449-d2aad103f041" (UID: "5b630779-e8f9-434c-9449-d2aad103f041"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:48 crc kubenswrapper[5120]: I0316 16:05:48.454936 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b630779-e8f9-434c-9449-d2aad103f041-logs" (OuterVolumeSpecName: "logs") pod "5b630779-e8f9-434c-9449-d2aad103f041" (UID: "5b630779-e8f9-434c-9449-d2aad103f041"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:05:48 crc kubenswrapper[5120]: I0316 16:05:48.455002 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b630779-e8f9-434c-9449-d2aad103f041-kube-api-access-nh4fn" (OuterVolumeSpecName: "kube-api-access-nh4fn") pod "5b630779-e8f9-434c-9449-d2aad103f041" (UID: "5b630779-e8f9-434c-9449-d2aad103f041"). InnerVolumeSpecName "kube-api-access-nh4fn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:05:48 crc kubenswrapper[5120]: I0316 16:05:48.460820 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-857694d5fb-pdlqj"] Mar 16 16:05:48 crc kubenswrapper[5120]: I0316 16:05:48.461147 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-857694d5fb-pdlqj" podUID="bb0a18f2-a95f-4ee1-b6a6-d0400f70760f" containerName="barbican-api-log" containerID="cri-o://d8ebe2d4ddfb0a9cea2a5d26051fad69b766700efa153b18ebda89d66de2709d" gracePeriod=30 Mar 16 16:05:48 crc kubenswrapper[5120]: I0316 16:05:48.461502 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-857694d5fb-pdlqj" podUID="bb0a18f2-a95f-4ee1-b6a6-d0400f70760f" containerName="barbican-api" containerID="cri-o://6f1d0f5762f66532294471c478da1e90478aa8e63f3a52ffb5466af1e5e246c7" gracePeriod=30 Mar 16 16:05:48 crc kubenswrapper[5120]: I0316 16:05:48.476962 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b630779-e8f9-434c-9449-d2aad103f041-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "5b630779-e8f9-434c-9449-d2aad103f041" (UID: "5b630779-e8f9-434c-9449-d2aad103f041"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:48 crc kubenswrapper[5120]: I0316 16:05:48.477823 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-857694d5fb-pdlqj" podUID="bb0a18f2-a95f-4ee1-b6a6-d0400f70760f" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.1.190:9311/healthcheck\": EOF" Mar 16 16:05:48 crc kubenswrapper[5120]: I0316 16:05:48.487346 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openstack-kuttl-tests/barbican-api-857694d5fb-pdlqj" podUID="bb0a18f2-a95f-4ee1-b6a6-d0400f70760f" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.1.190:9311/healthcheck\": EOF" Mar 16 16:05:48 crc kubenswrapper[5120]: I0316 16:05:48.487726 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-857694d5fb-pdlqj" podUID="bb0a18f2-a95f-4ee1-b6a6-d0400f70760f" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.1.190:9311/healthcheck\": EOF" Mar 16 16:05:48 crc kubenswrapper[5120]: I0316 16:05:48.487949 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openstack-kuttl-tests/barbican-api-857694d5fb-pdlqj" podUID="bb0a18f2-a95f-4ee1-b6a6-d0400f70760f" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.1.190:9311/healthcheck\": EOF" Mar 16 16:05:48 crc kubenswrapper[5120]: I0316 16:05:48.528927 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b630779-e8f9-434c-9449-d2aad103f041-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "5b630779-e8f9-434c-9449-d2aad103f041" (UID: "5b630779-e8f9-434c-9449-d2aad103f041"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:48 crc kubenswrapper[5120]: I0316 16:05:48.531945 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5k4lv\" (UniqueName: \"kubernetes.io/projected/7fc6bd2b-b3c9-42e9-b7f5-c2aef4997e6c-kube-api-access-5k4lv\") pod \"barbican-keystone-listener-64d4b879f4-bbkqw\" (UID: \"7fc6bd2b-b3c9-42e9-b7f5-c2aef4997e6c\") " pod="openstack-kuttl-tests/barbican-keystone-listener-64d4b879f4-bbkqw" Mar 16 16:05:48 crc kubenswrapper[5120]: I0316 16:05:48.532146 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7fc6bd2b-b3c9-42e9-b7f5-c2aef4997e6c-logs\") pod \"barbican-keystone-listener-64d4b879f4-bbkqw\" (UID: \"7fc6bd2b-b3c9-42e9-b7f5-c2aef4997e6c\") " pod="openstack-kuttl-tests/barbican-keystone-listener-64d4b879f4-bbkqw" Mar 16 16:05:48 crc kubenswrapper[5120]: I0316 16:05:48.532245 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/f0da01d8-8d71-47f3-9ec8-73dd0aabe316-config-data-custom\") pod \"barbican-worker-7469b9f4cf-grmhg\" (UID: \"f0da01d8-8d71-47f3-9ec8-73dd0aabe316\") " pod="openstack-kuttl-tests/barbican-worker-7469b9f4cf-grmhg" Mar 16 16:05:48 crc kubenswrapper[5120]: I0316 16:05:48.532331 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f0da01d8-8d71-47f3-9ec8-73dd0aabe316-logs\") pod \"barbican-worker-7469b9f4cf-grmhg\" (UID: \"f0da01d8-8d71-47f3-9ec8-73dd0aabe316\") " pod="openstack-kuttl-tests/barbican-worker-7469b9f4cf-grmhg" Mar 16 16:05:48 crc kubenswrapper[5120]: I0316 16:05:48.532444 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/7fc6bd2b-b3c9-42e9-b7f5-c2aef4997e6c-config-data-custom\") pod \"barbican-keystone-listener-64d4b879f4-bbkqw\" (UID: \"7fc6bd2b-b3c9-42e9-b7f5-c2aef4997e6c\") " pod="openstack-kuttl-tests/barbican-keystone-listener-64d4b879f4-bbkqw" Mar 16 16:05:48 crc kubenswrapper[5120]: I0316 16:05:48.532539 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vb84b\" (UniqueName: \"kubernetes.io/projected/f0da01d8-8d71-47f3-9ec8-73dd0aabe316-kube-api-access-vb84b\") pod \"barbican-worker-7469b9f4cf-grmhg\" (UID: \"f0da01d8-8d71-47f3-9ec8-73dd0aabe316\") " pod="openstack-kuttl-tests/barbican-worker-7469b9f4cf-grmhg" Mar 16 16:05:48 crc kubenswrapper[5120]: I0316 16:05:48.532663 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f0da01d8-8d71-47f3-9ec8-73dd0aabe316-combined-ca-bundle\") pod \"barbican-worker-7469b9f4cf-grmhg\" (UID: \"f0da01d8-8d71-47f3-9ec8-73dd0aabe316\") " pod="openstack-kuttl-tests/barbican-worker-7469b9f4cf-grmhg" Mar 16 16:05:48 crc kubenswrapper[5120]: I0316 16:05:48.533029 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f0da01d8-8d71-47f3-9ec8-73dd0aabe316-config-data\") pod \"barbican-worker-7469b9f4cf-grmhg\" (UID: \"f0da01d8-8d71-47f3-9ec8-73dd0aabe316\") " pod="openstack-kuttl-tests/barbican-worker-7469b9f4cf-grmhg" Mar 16 16:05:48 crc kubenswrapper[5120]: I0316 16:05:48.533202 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7fc6bd2b-b3c9-42e9-b7f5-c2aef4997e6c-combined-ca-bundle\") pod \"barbican-keystone-listener-64d4b879f4-bbkqw\" (UID: \"7fc6bd2b-b3c9-42e9-b7f5-c2aef4997e6c\") " pod="openstack-kuttl-tests/barbican-keystone-listener-64d4b879f4-bbkqw" Mar 16 16:05:48 crc kubenswrapper[5120]: I0316 16:05:48.533330 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7fc6bd2b-b3c9-42e9-b7f5-c2aef4997e6c-config-data\") pod \"barbican-keystone-listener-64d4b879f4-bbkqw\" (UID: \"7fc6bd2b-b3c9-42e9-b7f5-c2aef4997e6c\") " pod="openstack-kuttl-tests/barbican-keystone-listener-64d4b879f4-bbkqw" Mar 16 16:05:48 crc kubenswrapper[5120]: I0316 16:05:48.537116 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7fc6bd2b-b3c9-42e9-b7f5-c2aef4997e6c-logs\") pod \"barbican-keystone-listener-64d4b879f4-bbkqw\" (UID: \"7fc6bd2b-b3c9-42e9-b7f5-c2aef4997e6c\") " pod="openstack-kuttl-tests/barbican-keystone-listener-64d4b879f4-bbkqw" Mar 16 16:05:48 crc kubenswrapper[5120]: I0316 16:05:48.537162 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/5b630779-e8f9-434c-9449-d2aad103f041-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:48 crc kubenswrapper[5120]: I0316 16:05:48.537191 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5b630779-e8f9-434c-9449-d2aad103f041-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:48 crc kubenswrapper[5120]: I0316 16:05:48.537203 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/5b630779-e8f9-434c-9449-d2aad103f041-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:48 crc kubenswrapper[5120]: I0316 16:05:48.537213 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nh4fn\" (UniqueName: \"kubernetes.io/projected/5b630779-e8f9-434c-9449-d2aad103f041-kube-api-access-nh4fn\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:48 crc kubenswrapper[5120]: I0316 16:05:48.537225 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5b630779-e8f9-434c-9449-d2aad103f041-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:48 crc kubenswrapper[5120]: I0316 16:05:48.537235 5120 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/5b630779-e8f9-434c-9449-d2aad103f041-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:48 crc kubenswrapper[5120]: I0316 16:05:48.537247 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5b630779-e8f9-434c-9449-d2aad103f041-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:48 crc kubenswrapper[5120]: I0316 16:05:48.547932 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7fc6bd2b-b3c9-42e9-b7f5-c2aef4997e6c-combined-ca-bundle\") pod \"barbican-keystone-listener-64d4b879f4-bbkqw\" (UID: \"7fc6bd2b-b3c9-42e9-b7f5-c2aef4997e6c\") " pod="openstack-kuttl-tests/barbican-keystone-listener-64d4b879f4-bbkqw" Mar 16 16:05:48 crc kubenswrapper[5120]: I0316 16:05:48.552936 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7fc6bd2b-b3c9-42e9-b7f5-c2aef4997e6c-config-data\") pod \"barbican-keystone-listener-64d4b879f4-bbkqw\" (UID: \"7fc6bd2b-b3c9-42e9-b7f5-c2aef4997e6c\") " pod="openstack-kuttl-tests/barbican-keystone-listener-64d4b879f4-bbkqw" Mar 16 16:05:48 crc kubenswrapper[5120]: I0316 16:05:48.554095 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/7fc6bd2b-b3c9-42e9-b7f5-c2aef4997e6c-config-data-custom\") pod \"barbican-keystone-listener-64d4b879f4-bbkqw\" (UID: \"7fc6bd2b-b3c9-42e9-b7f5-c2aef4997e6c\") " pod="openstack-kuttl-tests/barbican-keystone-listener-64d4b879f4-bbkqw" Mar 16 16:05:48 crc kubenswrapper[5120]: I0316 16:05:48.568477 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5k4lv\" (UniqueName: \"kubernetes.io/projected/7fc6bd2b-b3c9-42e9-b7f5-c2aef4997e6c-kube-api-access-5k4lv\") pod \"barbican-keystone-listener-64d4b879f4-bbkqw\" (UID: \"7fc6bd2b-b3c9-42e9-b7f5-c2aef4997e6c\") " pod="openstack-kuttl-tests/barbican-keystone-listener-64d4b879f4-bbkqw" Mar 16 16:05:48 crc kubenswrapper[5120]: I0316 16:05:48.596291 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b630779-e8f9-434c-9449-d2aad103f041-config-data" (OuterVolumeSpecName: "config-data") pod "5b630779-e8f9-434c-9449-d2aad103f041" (UID: "5b630779-e8f9-434c-9449-d2aad103f041"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:48 crc kubenswrapper[5120]: I0316 16:05:48.636719 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-64d4b879f4-bbkqw" Mar 16 16:05:48 crc kubenswrapper[5120]: I0316 16:05:48.638272 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/f0da01d8-8d71-47f3-9ec8-73dd0aabe316-config-data-custom\") pod \"barbican-worker-7469b9f4cf-grmhg\" (UID: \"f0da01d8-8d71-47f3-9ec8-73dd0aabe316\") " pod="openstack-kuttl-tests/barbican-worker-7469b9f4cf-grmhg" Mar 16 16:05:48 crc kubenswrapper[5120]: I0316 16:05:48.638867 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f0da01d8-8d71-47f3-9ec8-73dd0aabe316-logs\") pod \"barbican-worker-7469b9f4cf-grmhg\" (UID: \"f0da01d8-8d71-47f3-9ec8-73dd0aabe316\") " pod="openstack-kuttl-tests/barbican-worker-7469b9f4cf-grmhg" Mar 16 16:05:48 crc kubenswrapper[5120]: I0316 16:05:48.638936 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vb84b\" (UniqueName: \"kubernetes.io/projected/f0da01d8-8d71-47f3-9ec8-73dd0aabe316-kube-api-access-vb84b\") pod \"barbican-worker-7469b9f4cf-grmhg\" (UID: \"f0da01d8-8d71-47f3-9ec8-73dd0aabe316\") " pod="openstack-kuttl-tests/barbican-worker-7469b9f4cf-grmhg" Mar 16 16:05:48 crc kubenswrapper[5120]: I0316 16:05:48.638995 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f0da01d8-8d71-47f3-9ec8-73dd0aabe316-combined-ca-bundle\") pod \"barbican-worker-7469b9f4cf-grmhg\" (UID: \"f0da01d8-8d71-47f3-9ec8-73dd0aabe316\") " pod="openstack-kuttl-tests/barbican-worker-7469b9f4cf-grmhg" Mar 16 16:05:48 crc kubenswrapper[5120]: I0316 16:05:48.639050 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f0da01d8-8d71-47f3-9ec8-73dd0aabe316-config-data\") pod \"barbican-worker-7469b9f4cf-grmhg\" (UID: \"f0da01d8-8d71-47f3-9ec8-73dd0aabe316\") " pod="openstack-kuttl-tests/barbican-worker-7469b9f4cf-grmhg" Mar 16 16:05:48 crc kubenswrapper[5120]: I0316 16:05:48.639182 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5b630779-e8f9-434c-9449-d2aad103f041-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:48 crc kubenswrapper[5120]: I0316 16:05:48.641339 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f0da01d8-8d71-47f3-9ec8-73dd0aabe316-logs\") pod \"barbican-worker-7469b9f4cf-grmhg\" (UID: \"f0da01d8-8d71-47f3-9ec8-73dd0aabe316\") " pod="openstack-kuttl-tests/barbican-worker-7469b9f4cf-grmhg" Mar 16 16:05:48 crc kubenswrapper[5120]: I0316 16:05:48.653950 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/f0da01d8-8d71-47f3-9ec8-73dd0aabe316-config-data-custom\") pod \"barbican-worker-7469b9f4cf-grmhg\" (UID: \"f0da01d8-8d71-47f3-9ec8-73dd0aabe316\") " pod="openstack-kuttl-tests/barbican-worker-7469b9f4cf-grmhg" Mar 16 16:05:48 crc kubenswrapper[5120]: I0316 16:05:48.654545 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f0da01d8-8d71-47f3-9ec8-73dd0aabe316-combined-ca-bundle\") pod \"barbican-worker-7469b9f4cf-grmhg\" (UID: \"f0da01d8-8d71-47f3-9ec8-73dd0aabe316\") " pod="openstack-kuttl-tests/barbican-worker-7469b9f4cf-grmhg" Mar 16 16:05:48 crc kubenswrapper[5120]: I0316 16:05:48.666630 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f0da01d8-8d71-47f3-9ec8-73dd0aabe316-config-data\") pod \"barbican-worker-7469b9f4cf-grmhg\" (UID: \"f0da01d8-8d71-47f3-9ec8-73dd0aabe316\") " pod="openstack-kuttl-tests/barbican-worker-7469b9f4cf-grmhg" Mar 16 16:05:48 crc kubenswrapper[5120]: I0316 16:05:48.680279 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vb84b\" (UniqueName: \"kubernetes.io/projected/f0da01d8-8d71-47f3-9ec8-73dd0aabe316-kube-api-access-vb84b\") pod \"barbican-worker-7469b9f4cf-grmhg\" (UID: \"f0da01d8-8d71-47f3-9ec8-73dd0aabe316\") " pod="openstack-kuttl-tests/barbican-worker-7469b9f4cf-grmhg" Mar 16 16:05:48 crc kubenswrapper[5120]: I0316 16:05:48.684020 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b630779-e8f9-434c-9449-d2aad103f041-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "5b630779-e8f9-434c-9449-d2aad103f041" (UID: "5b630779-e8f9-434c-9449-d2aad103f041"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:48 crc kubenswrapper[5120]: I0316 16:05:48.684283 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-7469b9f4cf-grmhg" Mar 16 16:05:48 crc kubenswrapper[5120]: I0316 16:05:48.723882 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="307ebaa6-527e-4d6f-9601-dcb38aaa8a20" path="/var/lib/kubelet/pods/307ebaa6-527e-4d6f-9601-dcb38aaa8a20/volumes" Mar 16 16:05:48 crc kubenswrapper[5120]: I0316 16:05:48.724799 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e81e832e-72a4-4622-b4b9-e6a41d92fce3" path="/var/lib/kubelet/pods/e81e832e-72a4-4622-b4b9-e6a41d92fce3/volumes" Mar 16 16:05:48 crc kubenswrapper[5120]: I0316 16:05:48.741319 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/5b630779-e8f9-434c-9449-d2aad103f041-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:48 crc kubenswrapper[5120]: I0316 16:05:48.911576 5120 generic.go:358] "Generic (PLEG): container finished" podID="bb0a18f2-a95f-4ee1-b6a6-d0400f70760f" containerID="d8ebe2d4ddfb0a9cea2a5d26051fad69b766700efa153b18ebda89d66de2709d" exitCode=143 Mar 16 16:05:48 crc kubenswrapper[5120]: I0316 16:05:48.911688 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-857694d5fb-pdlqj" event={"ID":"bb0a18f2-a95f-4ee1-b6a6-d0400f70760f","Type":"ContainerDied","Data":"d8ebe2d4ddfb0a9cea2a5d26051fad69b766700efa153b18ebda89d66de2709d"} Mar 16 16:05:48 crc kubenswrapper[5120]: I0316 16:05:48.924051 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="34a68caa-76db-4be4-9ecd-8955435c0e90" containerName="cinder-scheduler" containerID="cri-o://d6456b18671133be61b3e3aee639a3b98b4bd2c9402ee3e32ee592907357518e" gracePeriod=30 Mar 16 16:05:48 crc kubenswrapper[5120]: I0316 16:05:48.924338 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:05:48 crc kubenswrapper[5120]: I0316 16:05:48.925008 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"5b630779-e8f9-434c-9449-d2aad103f041","Type":"ContainerDied","Data":"6b492be3458dba056e2631b8befc2aaceb7eb83de082f3e234d239baab32764d"} Mar 16 16:05:48 crc kubenswrapper[5120]: I0316 16:05:48.925038 5120 scope.go:117] "RemoveContainer" containerID="e3fdff7b57d0a087985cbd2289bc6fbf6801532cb62e3595713545733446a1e0" Mar 16 16:05:48 crc kubenswrapper[5120]: I0316 16:05:48.925329 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="34a68caa-76db-4be4-9ecd-8955435c0e90" containerName="probe" containerID="cri-o://d3c2d0cc170c0d12ffcf3081d057790b94d54951249a16995141e7f80ac473e6" gracePeriod=30 Mar 16 16:05:48 crc kubenswrapper[5120]: I0316 16:05:48.957277 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:05:48 crc kubenswrapper[5120]: I0316 16:05:48.976627 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:05:48 crc kubenswrapper[5120]: I0316 16:05:48.992179 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:05:48 crc kubenswrapper[5120]: I0316 16:05:48.994479 5120 scope.go:117] "RemoveContainer" containerID="c9abfc0dbbcf0d1cd004190466602e73374823f5f514bd5c3beb0cb3aea8c284" Mar 16 16:05:49 crc kubenswrapper[5120]: I0316 16:05:49.006164 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:05:49 crc kubenswrapper[5120]: I0316 16:05:49.030945 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:05:49 crc kubenswrapper[5120]: I0316 16:05:49.032040 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b630779-e8f9-434c-9449-d2aad103f041" containerName="cinder-api" Mar 16 16:05:49 crc kubenswrapper[5120]: I0316 16:05:49.032057 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b630779-e8f9-434c-9449-d2aad103f041" containerName="cinder-api" Mar 16 16:05:49 crc kubenswrapper[5120]: I0316 16:05:49.032075 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b630779-e8f9-434c-9449-d2aad103f041" containerName="cinder-api-log" Mar 16 16:05:49 crc kubenswrapper[5120]: I0316 16:05:49.032083 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b630779-e8f9-434c-9449-d2aad103f041" containerName="cinder-api-log" Mar 16 16:05:49 crc kubenswrapper[5120]: I0316 16:05:49.032281 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="5b630779-e8f9-434c-9449-d2aad103f041" containerName="cinder-api" Mar 16 16:05:49 crc kubenswrapper[5120]: I0316 16:05:49.032303 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="5b630779-e8f9-434c-9449-d2aad103f041" containerName="cinder-api-log" Mar 16 16:05:49 crc kubenswrapper[5120]: I0316 16:05:49.042947 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:05:49 crc kubenswrapper[5120]: I0316 16:05:49.046282 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:05:49 crc kubenswrapper[5120]: I0316 16:05:49.051698 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-cinder-internal-svc\"" Mar 16 16:05:49 crc kubenswrapper[5120]: I0316 16:05:49.051937 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-api-config-data\"" Mar 16 16:05:49 crc kubenswrapper[5120]: I0316 16:05:49.052064 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-cinder-public-svc\"" Mar 16 16:05:49 crc kubenswrapper[5120]: I0316 16:05:49.103232 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:05:49 crc kubenswrapper[5120]: I0316 16:05:49.156586 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-7469b9f4cf-grmhg"] Mar 16 16:05:49 crc kubenswrapper[5120]: I0316 16:05:49.159862 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f8028a79-c5c3-420e-ac48-33a3991aba76-public-tls-certs\") pod \"cinder-api-0\" (UID: \"f8028a79-c5c3-420e-ac48-33a3991aba76\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:05:49 crc kubenswrapper[5120]: I0316 16:05:49.159965 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f8028a79-c5c3-420e-ac48-33a3991aba76-scripts\") pod \"cinder-api-0\" (UID: \"f8028a79-c5c3-420e-ac48-33a3991aba76\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:05:49 crc kubenswrapper[5120]: I0316 16:05:49.160024 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f8028a79-c5c3-420e-ac48-33a3991aba76-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"f8028a79-c5c3-420e-ac48-33a3991aba76\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:05:49 crc kubenswrapper[5120]: I0316 16:05:49.160114 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f8028a79-c5c3-420e-ac48-33a3991aba76-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"f8028a79-c5c3-420e-ac48-33a3991aba76\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:05:49 crc kubenswrapper[5120]: I0316 16:05:49.160197 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f8028a79-c5c3-420e-ac48-33a3991aba76-config-data\") pod \"cinder-api-0\" (UID: \"f8028a79-c5c3-420e-ac48-33a3991aba76\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:05:49 crc kubenswrapper[5120]: I0316 16:05:49.160332 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f8028a79-c5c3-420e-ac48-33a3991aba76-logs\") pod \"cinder-api-0\" (UID: \"f8028a79-c5c3-420e-ac48-33a3991aba76\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:05:49 crc kubenswrapper[5120]: I0316 16:05:49.160541 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97dxz\" (UniqueName: \"kubernetes.io/projected/f8028a79-c5c3-420e-ac48-33a3991aba76-kube-api-access-97dxz\") pod \"cinder-api-0\" (UID: \"f8028a79-c5c3-420e-ac48-33a3991aba76\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:05:49 crc kubenswrapper[5120]: I0316 16:05:49.160720 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/f8028a79-c5c3-420e-ac48-33a3991aba76-config-data-custom\") pod \"cinder-api-0\" (UID: \"f8028a79-c5c3-420e-ac48-33a3991aba76\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:05:49 crc kubenswrapper[5120]: I0316 16:05:49.160837 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/f8028a79-c5c3-420e-ac48-33a3991aba76-etc-machine-id\") pod \"cinder-api-0\" (UID: \"f8028a79-c5c3-420e-ac48-33a3991aba76\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:05:49 crc kubenswrapper[5120]: I0316 16:05:49.200577 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-64d4b879f4-bbkqw"] Mar 16 16:05:49 crc kubenswrapper[5120]: I0316 16:05:49.264870 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/f8028a79-c5c3-420e-ac48-33a3991aba76-etc-machine-id\") pod \"cinder-api-0\" (UID: \"f8028a79-c5c3-420e-ac48-33a3991aba76\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:05:49 crc kubenswrapper[5120]: I0316 16:05:49.264962 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f8028a79-c5c3-420e-ac48-33a3991aba76-public-tls-certs\") pod \"cinder-api-0\" (UID: \"f8028a79-c5c3-420e-ac48-33a3991aba76\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:05:49 crc kubenswrapper[5120]: I0316 16:05:49.265002 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f8028a79-c5c3-420e-ac48-33a3991aba76-scripts\") pod \"cinder-api-0\" (UID: \"f8028a79-c5c3-420e-ac48-33a3991aba76\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:05:49 crc kubenswrapper[5120]: I0316 16:05:49.265021 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f8028a79-c5c3-420e-ac48-33a3991aba76-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"f8028a79-c5c3-420e-ac48-33a3991aba76\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:05:49 crc kubenswrapper[5120]: I0316 16:05:49.265044 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f8028a79-c5c3-420e-ac48-33a3991aba76-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"f8028a79-c5c3-420e-ac48-33a3991aba76\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:05:49 crc kubenswrapper[5120]: I0316 16:05:49.265072 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f8028a79-c5c3-420e-ac48-33a3991aba76-config-data\") pod \"cinder-api-0\" (UID: \"f8028a79-c5c3-420e-ac48-33a3991aba76\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:05:49 crc kubenswrapper[5120]: I0316 16:05:49.265116 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f8028a79-c5c3-420e-ac48-33a3991aba76-logs\") pod \"cinder-api-0\" (UID: \"f8028a79-c5c3-420e-ac48-33a3991aba76\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:05:49 crc kubenswrapper[5120]: I0316 16:05:49.265171 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-97dxz\" (UniqueName: \"kubernetes.io/projected/f8028a79-c5c3-420e-ac48-33a3991aba76-kube-api-access-97dxz\") pod \"cinder-api-0\" (UID: \"f8028a79-c5c3-420e-ac48-33a3991aba76\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:05:49 crc kubenswrapper[5120]: I0316 16:05:49.265237 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/f8028a79-c5c3-420e-ac48-33a3991aba76-config-data-custom\") pod \"cinder-api-0\" (UID: \"f8028a79-c5c3-420e-ac48-33a3991aba76\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:05:49 crc kubenswrapper[5120]: I0316 16:05:49.267978 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/f8028a79-c5c3-420e-ac48-33a3991aba76-etc-machine-id\") pod \"cinder-api-0\" (UID: \"f8028a79-c5c3-420e-ac48-33a3991aba76\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:05:49 crc kubenswrapper[5120]: I0316 16:05:49.268687 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f8028a79-c5c3-420e-ac48-33a3991aba76-logs\") pod \"cinder-api-0\" (UID: \"f8028a79-c5c3-420e-ac48-33a3991aba76\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:05:49 crc kubenswrapper[5120]: I0316 16:05:49.274750 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f8028a79-c5c3-420e-ac48-33a3991aba76-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"f8028a79-c5c3-420e-ac48-33a3991aba76\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:05:49 crc kubenswrapper[5120]: I0316 16:05:49.275526 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/f8028a79-c5c3-420e-ac48-33a3991aba76-config-data-custom\") pod \"cinder-api-0\" (UID: \"f8028a79-c5c3-420e-ac48-33a3991aba76\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:05:49 crc kubenswrapper[5120]: I0316 16:05:49.276385 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f8028a79-c5c3-420e-ac48-33a3991aba76-config-data\") pod \"cinder-api-0\" (UID: \"f8028a79-c5c3-420e-ac48-33a3991aba76\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:05:49 crc kubenswrapper[5120]: I0316 16:05:49.276973 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f8028a79-c5c3-420e-ac48-33a3991aba76-public-tls-certs\") pod \"cinder-api-0\" (UID: \"f8028a79-c5c3-420e-ac48-33a3991aba76\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:05:49 crc kubenswrapper[5120]: I0316 16:05:49.277279 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f8028a79-c5c3-420e-ac48-33a3991aba76-scripts\") pod \"cinder-api-0\" (UID: \"f8028a79-c5c3-420e-ac48-33a3991aba76\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:05:49 crc kubenswrapper[5120]: I0316 16:05:49.277492 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f8028a79-c5c3-420e-ac48-33a3991aba76-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"f8028a79-c5c3-420e-ac48-33a3991aba76\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:05:49 crc kubenswrapper[5120]: I0316 16:05:49.292801 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-97dxz\" (UniqueName: \"kubernetes.io/projected/f8028a79-c5c3-420e-ac48-33a3991aba76-kube-api-access-97dxz\") pod \"cinder-api-0\" (UID: \"f8028a79-c5c3-420e-ac48-33a3991aba76\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:05:49 crc kubenswrapper[5120]: I0316 16:05:49.388148 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:05:49 crc kubenswrapper[5120]: I0316 16:05:49.694422 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:05:49 crc kubenswrapper[5120]: I0316 16:05:49.694655 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:05:49 crc kubenswrapper[5120]: I0316 16:05:49.935186 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:05:49 crc kubenswrapper[5120]: I0316 16:05:49.955273 5120 generic.go:358] "Generic (PLEG): container finished" podID="34a68caa-76db-4be4-9ecd-8955435c0e90" containerID="d3c2d0cc170c0d12ffcf3081d057790b94d54951249a16995141e7f80ac473e6" exitCode=0 Mar 16 16:05:49 crc kubenswrapper[5120]: I0316 16:05:49.955409 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"34a68caa-76db-4be4-9ecd-8955435c0e90","Type":"ContainerDied","Data":"d3c2d0cc170c0d12ffcf3081d057790b94d54951249a16995141e7f80ac473e6"} Mar 16 16:05:49 crc kubenswrapper[5120]: I0316 16:05:49.956581 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"efc5b4b3-507b-4f7b-9524-621ff45c12a6","Type":"ContainerStarted","Data":"d54009659cb3df3b96ffdc7ab91eeda40089ee15b6c6dc57a9f8a916d5260186"} Mar 16 16:05:49 crc kubenswrapper[5120]: I0316 16:05:49.970325 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"c6ef2171-25f8-43d1-a037-b915f5b77abc","Type":"ContainerStarted","Data":"d08e4507821305fa617df2be4e46ebdc378f0875b915d89ed924026144f26267"} Mar 16 16:05:49 crc kubenswrapper[5120]: I0316 16:05:49.970519 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:05:49 crc kubenswrapper[5120]: I0316 16:05:49.975214 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:05:49 crc kubenswrapper[5120]: I0316 16:05:49.975244 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:05:49 crc kubenswrapper[5120]: I0316 16:05:49.990202 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-7469b9f4cf-grmhg" event={"ID":"f0da01d8-8d71-47f3-9ec8-73dd0aabe316","Type":"ContainerStarted","Data":"b2628ee32787319a15d501d9f10281fc7f6881d6eb55598e18e00b9a947c19f6"} Mar 16 16:05:49 crc kubenswrapper[5120]: I0316 16:05:49.990239 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-7469b9f4cf-grmhg" event={"ID":"f0da01d8-8d71-47f3-9ec8-73dd0aabe316","Type":"ContainerStarted","Data":"6d2bd392c68baa40b3861d82bffff7de01a314630099e0bdcff290b5812f7c49"} Mar 16 16:05:49 crc kubenswrapper[5120]: I0316 16:05:49.990662 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.924246093 podStartE2EDuration="7.990650493s" podCreationTimestamp="2026-03-16 16:05:42 +0000 UTC" firstStartedPulling="2026-03-16 16:05:43.70807765 +0000 UTC m=+2045.862009307" lastFinishedPulling="2026-03-16 16:05:48.77448205 +0000 UTC m=+2050.928413707" observedRunningTime="2026-03-16 16:05:49.986032028 +0000 UTC m=+2052.139963685" watchObservedRunningTime="2026-03-16 16:05:49.990650493 +0000 UTC m=+2052.144582150" Mar 16 16:05:49 crc kubenswrapper[5120]: I0316 16:05:49.998379 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-64d4b879f4-bbkqw" event={"ID":"7fc6bd2b-b3c9-42e9-b7f5-c2aef4997e6c","Type":"ContainerStarted","Data":"dacff6fc847fdebd6d8ee7408f52597ea61ec912f45e06fc013aa5067459105a"} Mar 16 16:05:49 crc kubenswrapper[5120]: I0316 16:05:49.998450 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-64d4b879f4-bbkqw" event={"ID":"7fc6bd2b-b3c9-42e9-b7f5-c2aef4997e6c","Type":"ContainerStarted","Data":"818c886a632dc66a965ac822aa59a853fd9ae3fab06b84bbe64a6baf3251a8c7"} Mar 16 16:05:50 crc kubenswrapper[5120]: I0316 16:05:50.060294 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:05:50 crc kubenswrapper[5120]: E0316 16:05:50.485034 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="eaa8e905618c3287f78bbdda9d5b8e1d7a9ea191e193e106e08869701479bec0" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:05:50 crc kubenswrapper[5120]: E0316 16:05:50.490413 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="eaa8e905618c3287f78bbdda9d5b8e1d7a9ea191e193e106e08869701479bec0" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:05:50 crc kubenswrapper[5120]: E0316 16:05:50.492002 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="eaa8e905618c3287f78bbdda9d5b8e1d7a9ea191e193e106e08869701479bec0" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:05:50 crc kubenswrapper[5120]: E0316 16:05:50.492035 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="683d3459-b9fc-478c-b74e-c1a09fd45e4d" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 16:05:50 crc kubenswrapper[5120]: I0316 16:05:50.685222 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b630779-e8f9-434c-9449-d2aad103f041" path="/var/lib/kubelet/pods/5b630779-e8f9-434c-9449-d2aad103f041/volumes" Mar 16 16:05:50 crc kubenswrapper[5120]: I0316 16:05:50.704950 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="e8e4bade-e33d-4cc6-80ec-5f96e39c8f20" containerName="nova-metadata-log" probeResult="failure" output="Get \"https://10.217.1.193:8775/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Mar 16 16:05:50 crc kubenswrapper[5120]: I0316 16:05:50.744788 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="e8e4bade-e33d-4cc6-80ec-5f96e39c8f20" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"https://10.217.1.193:8775/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Mar 16 16:05:50 crc kubenswrapper[5120]: I0316 16:05:50.949035 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-58cc99cf94-2svpf" Mar 16 16:05:50 crc kubenswrapper[5120]: I0316 16:05:50.984589 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/2e1be97f-dece-41af-b53b-e6d37affb572-httpd-config\") pod \"2e1be97f-dece-41af-b53b-e6d37affb572\" (UID: \"2e1be97f-dece-41af-b53b-e6d37affb572\") " Mar 16 16:05:50 crc kubenswrapper[5120]: I0316 16:05:50.984626 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pg4wn\" (UniqueName: \"kubernetes.io/projected/2e1be97f-dece-41af-b53b-e6d37affb572-kube-api-access-pg4wn\") pod \"2e1be97f-dece-41af-b53b-e6d37affb572\" (UID: \"2e1be97f-dece-41af-b53b-e6d37affb572\") " Mar 16 16:05:50 crc kubenswrapper[5120]: I0316 16:05:50.984681 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2e1be97f-dece-41af-b53b-e6d37affb572-combined-ca-bundle\") pod \"2e1be97f-dece-41af-b53b-e6d37affb572\" (UID: \"2e1be97f-dece-41af-b53b-e6d37affb572\") " Mar 16 16:05:50 crc kubenswrapper[5120]: I0316 16:05:50.984702 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/2e1be97f-dece-41af-b53b-e6d37affb572-public-tls-certs\") pod \"2e1be97f-dece-41af-b53b-e6d37affb572\" (UID: \"2e1be97f-dece-41af-b53b-e6d37affb572\") " Mar 16 16:05:50 crc kubenswrapper[5120]: I0316 16:05:50.984799 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/2e1be97f-dece-41af-b53b-e6d37affb572-ovndb-tls-certs\") pod \"2e1be97f-dece-41af-b53b-e6d37affb572\" (UID: \"2e1be97f-dece-41af-b53b-e6d37affb572\") " Mar 16 16:05:50 crc kubenswrapper[5120]: I0316 16:05:50.984823 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/2e1be97f-dece-41af-b53b-e6d37affb572-internal-tls-certs\") pod \"2e1be97f-dece-41af-b53b-e6d37affb572\" (UID: \"2e1be97f-dece-41af-b53b-e6d37affb572\") " Mar 16 16:05:50 crc kubenswrapper[5120]: I0316 16:05:50.984857 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2e1be97f-dece-41af-b53b-e6d37affb572-config\") pod \"2e1be97f-dece-41af-b53b-e6d37affb572\" (UID: \"2e1be97f-dece-41af-b53b-e6d37affb572\") " Mar 16 16:05:50 crc kubenswrapper[5120]: I0316 16:05:50.989696 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="4e3ac124-ebc3-4631-a7b1-5dc135748d5d" containerName="nova-api-api" probeResult="failure" output="Get \"https://10.217.1.194:8774/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Mar 16 16:05:50 crc kubenswrapper[5120]: I0316 16:05:50.990131 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="4e3ac124-ebc3-4631-a7b1-5dc135748d5d" containerName="nova-api-log" probeResult="failure" output="Get \"https://10.217.1.194:8774/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Mar 16 16:05:51 crc kubenswrapper[5120]: I0316 16:05:51.023907 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e1be97f-dece-41af-b53b-e6d37affb572-httpd-config" (OuterVolumeSpecName: "httpd-config") pod "2e1be97f-dece-41af-b53b-e6d37affb572" (UID: "2e1be97f-dece-41af-b53b-e6d37affb572"). InnerVolumeSpecName "httpd-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:51 crc kubenswrapper[5120]: I0316 16:05:51.030988 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e1be97f-dece-41af-b53b-e6d37affb572-kube-api-access-pg4wn" (OuterVolumeSpecName: "kube-api-access-pg4wn") pod "2e1be97f-dece-41af-b53b-e6d37affb572" (UID: "2e1be97f-dece-41af-b53b-e6d37affb572"). InnerVolumeSpecName "kube-api-access-pg4wn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:05:51 crc kubenswrapper[5120]: I0316 16:05:51.040604 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"f8028a79-c5c3-420e-ac48-33a3991aba76","Type":"ContainerStarted","Data":"a095c7f1f907780f7424cf333177c34a85a7c08d0cd7e3d71396251b5a7d77ef"} Mar 16 16:05:51 crc kubenswrapper[5120]: I0316 16:05:51.076546 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"efc5b4b3-507b-4f7b-9524-621ff45c12a6","Type":"ContainerStarted","Data":"02893fdeddb9bac6b9de74b4a3bfe760717fd2af15213aafd5d06efdd9dfcf71"} Mar 16 16:05:51 crc kubenswrapper[5120]: I0316 16:05:51.086447 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-7469b9f4cf-grmhg" event={"ID":"f0da01d8-8d71-47f3-9ec8-73dd0aabe316","Type":"ContainerStarted","Data":"7bcdb368355b6e7789534603513d090ead891f3b93288ee9ef529114e1e19738"} Mar 16 16:05:51 crc kubenswrapper[5120]: I0316 16:05:51.088275 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/2e1be97f-dece-41af-b53b-e6d37affb572-httpd-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:51 crc kubenswrapper[5120]: I0316 16:05:51.088666 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pg4wn\" (UniqueName: \"kubernetes.io/projected/2e1be97f-dece-41af-b53b-e6d37affb572-kube-api-access-pg4wn\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:51 crc kubenswrapper[5120]: I0316 16:05:51.133618 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-worker-7469b9f4cf-grmhg" podStartSLOduration=3.13360182 podStartE2EDuration="3.13360182s" podCreationTimestamp="2026-03-16 16:05:48 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:05:51.116004709 +0000 UTC m=+2053.269936366" watchObservedRunningTime="2026-03-16 16:05:51.13360182 +0000 UTC m=+2053.287533467" Mar 16 16:05:51 crc kubenswrapper[5120]: I0316 16:05:51.142170 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-64d4b879f4-bbkqw" event={"ID":"7fc6bd2b-b3c9-42e9-b7f5-c2aef4997e6c","Type":"ContainerStarted","Data":"b5396e89a059e714407464e3e525c2b2bddc597fbfcbc921d6ab126d84a862e2"} Mar 16 16:05:51 crc kubenswrapper[5120]: I0316 16:05:51.161154 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e1be97f-dece-41af-b53b-e6d37affb572-config" (OuterVolumeSpecName: "config") pod "2e1be97f-dece-41af-b53b-e6d37affb572" (UID: "2e1be97f-dece-41af-b53b-e6d37affb572"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:51 crc kubenswrapper[5120]: I0316 16:05:51.167863 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e1be97f-dece-41af-b53b-e6d37affb572-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "2e1be97f-dece-41af-b53b-e6d37affb572" (UID: "2e1be97f-dece-41af-b53b-e6d37affb572"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:51 crc kubenswrapper[5120]: I0316 16:05:51.177972 5120 generic.go:358] "Generic (PLEG): container finished" podID="2e1be97f-dece-41af-b53b-e6d37affb572" containerID="f5f1335640dfd2cdc323b6f629fe282cb7bc92486d51adb3bc351687fdacd823" exitCode=0 Mar 16 16:05:51 crc kubenswrapper[5120]: I0316 16:05:51.178951 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-58cc99cf94-2svpf" Mar 16 16:05:51 crc kubenswrapper[5120]: I0316 16:05:51.179017 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-c76f59879-tpdpx"] Mar 16 16:05:51 crc kubenswrapper[5120]: I0316 16:05:51.179050 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-58cc99cf94-2svpf" event={"ID":"2e1be97f-dece-41af-b53b-e6d37affb572","Type":"ContainerDied","Data":"f5f1335640dfd2cdc323b6f629fe282cb7bc92486d51adb3bc351687fdacd823"} Mar 16 16:05:51 crc kubenswrapper[5120]: I0316 16:05:51.179072 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-58cc99cf94-2svpf" event={"ID":"2e1be97f-dece-41af-b53b-e6d37affb572","Type":"ContainerDied","Data":"b23da404c4efb2d6f0a2bf86a1760b4b889941143668e973bb351c85d9482af9"} Mar 16 16:05:51 crc kubenswrapper[5120]: I0316 16:05:51.179090 5120 scope.go:117] "RemoveContainer" containerID="dab79283d9387a520a903f7176e97d9f3c4925818be8f94fcabfa4403183b00d" Mar 16 16:05:51 crc kubenswrapper[5120]: I0316 16:05:51.181599 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-c76f59879-tpdpx" podUID="ab84006c-23ad-4247-abe7-0d1016d65297" containerName="barbican-worker-log" containerID="cri-o://ee7c99e35f0ea6542759434ce015ae8518de8dfb907666327a5a872082e8e57b" gracePeriod=30 Mar 16 16:05:51 crc kubenswrapper[5120]: I0316 16:05:51.181746 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-c76f59879-tpdpx" podUID="ab84006c-23ad-4247-abe7-0d1016d65297" containerName="barbican-worker" containerID="cri-o://cdc147d80656cda5bf5c1c16abcc7aa843b3b309337641361dde69e6baf74a24" gracePeriod=30 Mar 16 16:05:51 crc kubenswrapper[5120]: I0316 16:05:51.200798 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e1be97f-dece-41af-b53b-e6d37affb572-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "2e1be97f-dece-41af-b53b-e6d37affb572" (UID: "2e1be97f-dece-41af-b53b-e6d37affb572"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:51 crc kubenswrapper[5120]: I0316 16:05:51.209235 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e1be97f-dece-41af-b53b-e6d37affb572-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "2e1be97f-dece-41af-b53b-e6d37affb572" (UID: "2e1be97f-dece-41af-b53b-e6d37affb572"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:51 crc kubenswrapper[5120]: I0316 16:05:51.211545 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/2e1be97f-dece-41af-b53b-e6d37affb572-public-tls-certs\") pod \"2e1be97f-dece-41af-b53b-e6d37affb572\" (UID: \"2e1be97f-dece-41af-b53b-e6d37affb572\") " Mar 16 16:05:51 crc kubenswrapper[5120]: W0316 16:05:51.211898 5120 empty_dir.go:511] Warning: Unmount skipped because path does not exist: /var/lib/kubelet/pods/2e1be97f-dece-41af-b53b-e6d37affb572/volumes/kubernetes.io~secret/public-tls-certs Mar 16 16:05:51 crc kubenswrapper[5120]: I0316 16:05:51.212081 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e1be97f-dece-41af-b53b-e6d37affb572-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "2e1be97f-dece-41af-b53b-e6d37affb572" (UID: "2e1be97f-dece-41af-b53b-e6d37affb572"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:51 crc kubenswrapper[5120]: I0316 16:05:51.216720 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/2e1be97f-dece-41af-b53b-e6d37affb572-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:51 crc kubenswrapper[5120]: I0316 16:05:51.216753 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2e1be97f-dece-41af-b53b-e6d37affb572-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:51 crc kubenswrapper[5120]: I0316 16:05:51.216793 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/2e1be97f-dece-41af-b53b-e6d37affb572-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:51 crc kubenswrapper[5120]: I0316 16:05:51.216802 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/2e1be97f-dece-41af-b53b-e6d37affb572-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:51 crc kubenswrapper[5120]: I0316 16:05:51.227963 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-keystone-listener-64d4b879f4-bbkqw" podStartSLOduration=3.227939573 podStartE2EDuration="3.227939573s" podCreationTimestamp="2026-03-16 16:05:48 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:05:51.160972586 +0000 UTC m=+2053.314904243" watchObservedRunningTime="2026-03-16 16:05:51.227939573 +0000 UTC m=+2053.381871230" Mar 16 16:05:51 crc kubenswrapper[5120]: I0316 16:05:51.241995 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e1be97f-dece-41af-b53b-e6d37affb572-ovndb-tls-certs" (OuterVolumeSpecName: "ovndb-tls-certs") pod "2e1be97f-dece-41af-b53b-e6d37affb572" (UID: "2e1be97f-dece-41af-b53b-e6d37affb572"). InnerVolumeSpecName "ovndb-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:51 crc kubenswrapper[5120]: I0316 16:05:51.257427 5120 scope.go:117] "RemoveContainer" containerID="f5f1335640dfd2cdc323b6f629fe282cb7bc92486d51adb3bc351687fdacd823" Mar 16 16:05:51 crc kubenswrapper[5120]: I0316 16:05:51.264360 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="e21caabc-db04-4dca-af4d-fbbbbde012ef" containerName="glance-log" probeResult="failure" output="Get \"https://10.217.1.182:9292/healthcheck\": read tcp 10.217.0.2:43512->10.217.1.182:9292: read: connection reset by peer" Mar 16 16:05:51 crc kubenswrapper[5120]: I0316 16:05:51.264520 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="e21caabc-db04-4dca-af4d-fbbbbde012ef" containerName="glance-httpd" probeResult="failure" output="Get \"https://10.217.1.182:9292/healthcheck\": read tcp 10.217.0.2:43510->10.217.1.182:9292: read: connection reset by peer" Mar 16 16:05:51 crc kubenswrapper[5120]: I0316 16:05:51.278157 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-7dcb9fc94d-5c4n9"] Mar 16 16:05:51 crc kubenswrapper[5120]: I0316 16:05:51.278418 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-7dcb9fc94d-5c4n9" podUID="e2185e65-e56e-4f2e-929e-9caa246e5961" containerName="barbican-keystone-listener-log" containerID="cri-o://93af2507717d78fa1e06041087d6f02fc16b229867935621c914a9dd2f241aa8" gracePeriod=30 Mar 16 16:05:51 crc kubenswrapper[5120]: I0316 16:05:51.278889 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-7dcb9fc94d-5c4n9" podUID="e2185e65-e56e-4f2e-929e-9caa246e5961" containerName="barbican-keystone-listener" containerID="cri-o://1c74980f647fc3b6602e8abf9607add11294a4ae33e9ef294003251f4db6cb54" gracePeriod=30 Mar 16 16:05:51 crc kubenswrapper[5120]: I0316 16:05:51.319354 5120 reconciler_common.go:299] "Volume detached for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/2e1be97f-dece-41af-b53b-e6d37affb572-ovndb-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:51 crc kubenswrapper[5120]: I0316 16:05:51.343908 5120 scope.go:117] "RemoveContainer" containerID="dab79283d9387a520a903f7176e97d9f3c4925818be8f94fcabfa4403183b00d" Mar 16 16:05:51 crc kubenswrapper[5120]: E0316 16:05:51.345312 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dab79283d9387a520a903f7176e97d9f3c4925818be8f94fcabfa4403183b00d\": container with ID starting with dab79283d9387a520a903f7176e97d9f3c4925818be8f94fcabfa4403183b00d not found: ID does not exist" containerID="dab79283d9387a520a903f7176e97d9f3c4925818be8f94fcabfa4403183b00d" Mar 16 16:05:51 crc kubenswrapper[5120]: I0316 16:05:51.345344 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dab79283d9387a520a903f7176e97d9f3c4925818be8f94fcabfa4403183b00d"} err="failed to get container status \"dab79283d9387a520a903f7176e97d9f3c4925818be8f94fcabfa4403183b00d\": rpc error: code = NotFound desc = could not find container \"dab79283d9387a520a903f7176e97d9f3c4925818be8f94fcabfa4403183b00d\": container with ID starting with dab79283d9387a520a903f7176e97d9f3c4925818be8f94fcabfa4403183b00d not found: ID does not exist" Mar 16 16:05:51 crc kubenswrapper[5120]: I0316 16:05:51.345364 5120 scope.go:117] "RemoveContainer" containerID="f5f1335640dfd2cdc323b6f629fe282cb7bc92486d51adb3bc351687fdacd823" Mar 16 16:05:51 crc kubenswrapper[5120]: E0316 16:05:51.360719 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f5f1335640dfd2cdc323b6f629fe282cb7bc92486d51adb3bc351687fdacd823\": container with ID starting with f5f1335640dfd2cdc323b6f629fe282cb7bc92486d51adb3bc351687fdacd823 not found: ID does not exist" containerID="f5f1335640dfd2cdc323b6f629fe282cb7bc92486d51adb3bc351687fdacd823" Mar 16 16:05:51 crc kubenswrapper[5120]: I0316 16:05:51.360773 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5f1335640dfd2cdc323b6f629fe282cb7bc92486d51adb3bc351687fdacd823"} err="failed to get container status \"f5f1335640dfd2cdc323b6f629fe282cb7bc92486d51adb3bc351687fdacd823\": rpc error: code = NotFound desc = could not find container \"f5f1335640dfd2cdc323b6f629fe282cb7bc92486d51adb3bc351687fdacd823\": container with ID starting with f5f1335640dfd2cdc323b6f629fe282cb7bc92486d51adb3bc351687fdacd823 not found: ID does not exist" Mar 16 16:05:51 crc kubenswrapper[5120]: I0316 16:05:51.628774 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-58cc99cf94-2svpf"] Mar 16 16:05:51 crc kubenswrapper[5120]: I0316 16:05:51.650486 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-58cc99cf94-2svpf"] Mar 16 16:05:51 crc kubenswrapper[5120]: I0316 16:05:51.877423 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/swift-proxy-87b69bc94-qlznl" Mar 16 16:05:51 crc kubenswrapper[5120]: I0316 16:05:51.877892 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/swift-proxy-87b69bc94-qlznl" Mar 16 16:05:51 crc kubenswrapper[5120]: I0316 16:05:51.972255 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-proxy-687cfbc4db-ngqr9"] Mar 16 16:05:51 crc kubenswrapper[5120]: I0316 16:05:51.972504 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-proxy-687cfbc4db-ngqr9" podUID="1cccc0e5-40f8-4ed9-9b3d-f7c667475288" containerName="proxy-httpd" containerID="cri-o://a163ab3521839a34ec882d99811cb4498761451ad0a9a1cd6942d451f1e8f179" gracePeriod=30 Mar 16 16:05:51 crc kubenswrapper[5120]: I0316 16:05:51.973606 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-proxy-687cfbc4db-ngqr9" podUID="1cccc0e5-40f8-4ed9-9b3d-f7c667475288" containerName="proxy-server" containerID="cri-o://618551cca919c1c9a479a978588c91bbc6d144f786f3b83f5bfa042209795dec" gracePeriod=30 Mar 16 16:05:52 crc kubenswrapper[5120]: I0316 16:05:52.007720 5120 patch_prober.go:28] interesting pod/machine-config-daemon-7bf76 container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 16:05:52 crc kubenswrapper[5120]: I0316 16:05:52.008517 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 16:05:52 crc kubenswrapper[5120]: I0316 16:05:52.008670 5120 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" Mar 16 16:05:52 crc kubenswrapper[5120]: I0316 16:05:52.009619 5120 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="machine-config-daemon" containerStatusID={"Type":"cri-o","ID":"41e926ecd1efaa1bb8aa66a8225167ca401bb54b97dbde9a5efe2bfb869a8032"} pod="openshift-machine-config-operator/machine-config-daemon-7bf76" containerMessage="Container machine-config-daemon failed liveness probe, will be restarted" Mar 16 16:05:52 crc kubenswrapper[5120]: I0316 16:05:52.009755 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" containerID="cri-o://41e926ecd1efaa1bb8aa66a8225167ca401bb54b97dbde9a5efe2bfb869a8032" gracePeriod=600 Mar 16 16:05:52 crc kubenswrapper[5120]: I0316 16:05:52.019222 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:05:52 crc kubenswrapper[5120]: I0316 16:05:52.035424 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e21caabc-db04-4dca-af4d-fbbbbde012ef-public-tls-certs\") pod \"e21caabc-db04-4dca-af4d-fbbbbde012ef\" (UID: \"e21caabc-db04-4dca-af4d-fbbbbde012ef\") " Mar 16 16:05:52 crc kubenswrapper[5120]: I0316 16:05:52.035520 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wt2mz\" (UniqueName: \"kubernetes.io/projected/e21caabc-db04-4dca-af4d-fbbbbde012ef-kube-api-access-wt2mz\") pod \"e21caabc-db04-4dca-af4d-fbbbbde012ef\" (UID: \"e21caabc-db04-4dca-af4d-fbbbbde012ef\") " Mar 16 16:05:52 crc kubenswrapper[5120]: I0316 16:05:52.035606 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/e21caabc-db04-4dca-af4d-fbbbbde012ef-httpd-run\") pod \"e21caabc-db04-4dca-af4d-fbbbbde012ef\" (UID: \"e21caabc-db04-4dca-af4d-fbbbbde012ef\") " Mar 16 16:05:52 crc kubenswrapper[5120]: I0316 16:05:52.035693 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e21caabc-db04-4dca-af4d-fbbbbde012ef-combined-ca-bundle\") pod \"e21caabc-db04-4dca-af4d-fbbbbde012ef\" (UID: \"e21caabc-db04-4dca-af4d-fbbbbde012ef\") " Mar 16 16:05:52 crc kubenswrapper[5120]: I0316 16:05:52.035741 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e21caabc-db04-4dca-af4d-fbbbbde012ef-config-data\") pod \"e21caabc-db04-4dca-af4d-fbbbbde012ef\" (UID: \"e21caabc-db04-4dca-af4d-fbbbbde012ef\") " Mar 16 16:05:52 crc kubenswrapper[5120]: I0316 16:05:52.035864 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e21caabc-db04-4dca-af4d-fbbbbde012ef-logs\") pod \"e21caabc-db04-4dca-af4d-fbbbbde012ef\" (UID: \"e21caabc-db04-4dca-af4d-fbbbbde012ef\") " Mar 16 16:05:52 crc kubenswrapper[5120]: I0316 16:05:52.035923 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e21caabc-db04-4dca-af4d-fbbbbde012ef-scripts\") pod \"e21caabc-db04-4dca-af4d-fbbbbde012ef\" (UID: \"e21caabc-db04-4dca-af4d-fbbbbde012ef\") " Mar 16 16:05:52 crc kubenswrapper[5120]: I0316 16:05:52.035938 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"e21caabc-db04-4dca-af4d-fbbbbde012ef\" (UID: \"e21caabc-db04-4dca-af4d-fbbbbde012ef\") " Mar 16 16:05:52 crc kubenswrapper[5120]: I0316 16:05:52.036353 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e21caabc-db04-4dca-af4d-fbbbbde012ef-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "e21caabc-db04-4dca-af4d-fbbbbde012ef" (UID: "e21caabc-db04-4dca-af4d-fbbbbde012ef"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:05:52 crc kubenswrapper[5120]: I0316 16:05:52.036754 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/e21caabc-db04-4dca-af4d-fbbbbde012ef-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:52 crc kubenswrapper[5120]: I0316 16:05:52.045959 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e21caabc-db04-4dca-af4d-fbbbbde012ef-logs" (OuterVolumeSpecName: "logs") pod "e21caabc-db04-4dca-af4d-fbbbbde012ef" (UID: "e21caabc-db04-4dca-af4d-fbbbbde012ef"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:05:52 crc kubenswrapper[5120]: I0316 16:05:52.046086 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e21caabc-db04-4dca-af4d-fbbbbde012ef-kube-api-access-wt2mz" (OuterVolumeSpecName: "kube-api-access-wt2mz") pod "e21caabc-db04-4dca-af4d-fbbbbde012ef" (UID: "e21caabc-db04-4dca-af4d-fbbbbde012ef"). InnerVolumeSpecName "kube-api-access-wt2mz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:05:52 crc kubenswrapper[5120]: I0316 16:05:52.046318 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e21caabc-db04-4dca-af4d-fbbbbde012ef-scripts" (OuterVolumeSpecName: "scripts") pod "e21caabc-db04-4dca-af4d-fbbbbde012ef" (UID: "e21caabc-db04-4dca-af4d-fbbbbde012ef"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:52 crc kubenswrapper[5120]: I0316 16:05:52.050388 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage13-crc" (OuterVolumeSpecName: "glance") pod "e21caabc-db04-4dca-af4d-fbbbbde012ef" (UID: "e21caabc-db04-4dca-af4d-fbbbbde012ef"). InnerVolumeSpecName "local-storage13-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:05:52 crc kubenswrapper[5120]: I0316 16:05:52.099878 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e21caabc-db04-4dca-af4d-fbbbbde012ef-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e21caabc-db04-4dca-af4d-fbbbbde012ef" (UID: "e21caabc-db04-4dca-af4d-fbbbbde012ef"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:52 crc kubenswrapper[5120]: I0316 16:05:52.138511 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e21caabc-db04-4dca-af4d-fbbbbde012ef-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:52 crc kubenswrapper[5120]: I0316 16:05:52.138754 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e21caabc-db04-4dca-af4d-fbbbbde012ef-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:52 crc kubenswrapper[5120]: I0316 16:05:52.139020 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e21caabc-db04-4dca-af4d-fbbbbde012ef-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:52 crc kubenswrapper[5120]: I0316 16:05:52.139132 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") on node \"crc\" " Mar 16 16:05:52 crc kubenswrapper[5120]: I0316 16:05:52.167927 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wt2mz\" (UniqueName: \"kubernetes.io/projected/e21caabc-db04-4dca-af4d-fbbbbde012ef-kube-api-access-wt2mz\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:52 crc kubenswrapper[5120]: I0316 16:05:52.139901 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e21caabc-db04-4dca-af4d-fbbbbde012ef-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "e21caabc-db04-4dca-af4d-fbbbbde012ef" (UID: "e21caabc-db04-4dca-af4d-fbbbbde012ef"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:52 crc kubenswrapper[5120]: I0316 16:05:52.186510 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage13-crc" (UniqueName: "kubernetes.io/local-volume/local-storage13-crc") on node "crc" Mar 16 16:05:52 crc kubenswrapper[5120]: I0316 16:05:52.189939 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e21caabc-db04-4dca-af4d-fbbbbde012ef-config-data" (OuterVolumeSpecName: "config-data") pod "e21caabc-db04-4dca-af4d-fbbbbde012ef" (UID: "e21caabc-db04-4dca-af4d-fbbbbde012ef"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:52 crc kubenswrapper[5120]: I0316 16:05:52.235005 5120 generic.go:358] "Generic (PLEG): container finished" podID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerID="41e926ecd1efaa1bb8aa66a8225167ca401bb54b97dbde9a5efe2bfb869a8032" exitCode=0 Mar 16 16:05:52 crc kubenswrapper[5120]: I0316 16:05:52.235314 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" event={"ID":"e2275cb4-4905-4d66-a87e-8010120db2bd","Type":"ContainerDied","Data":"41e926ecd1efaa1bb8aa66a8225167ca401bb54b97dbde9a5efe2bfb869a8032"} Mar 16 16:05:52 crc kubenswrapper[5120]: I0316 16:05:52.235365 5120 scope.go:117] "RemoveContainer" containerID="02ba4fc3f84eccaecfa9e6618280f65626eb76580c4af9ae7a9d7cb3b8dd590b" Mar 16 16:05:52 crc kubenswrapper[5120]: I0316 16:05:52.256887 5120 generic.go:358] "Generic (PLEG): container finished" podID="e21caabc-db04-4dca-af4d-fbbbbde012ef" containerID="8eea30b4264cb5b81ae072784fc62cef45ea952a53322bf12789607ce5b7ee48" exitCode=0 Mar 16 16:05:52 crc kubenswrapper[5120]: I0316 16:05:52.257029 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"e21caabc-db04-4dca-af4d-fbbbbde012ef","Type":"ContainerDied","Data":"8eea30b4264cb5b81ae072784fc62cef45ea952a53322bf12789607ce5b7ee48"} Mar 16 16:05:52 crc kubenswrapper[5120]: I0316 16:05:52.257054 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"e21caabc-db04-4dca-af4d-fbbbbde012ef","Type":"ContainerDied","Data":"ebdaee0d994fd3c624ba9c9c9e67fca1f174e37975d7d4dcd1d9e18b45f9f6b8"} Mar 16 16:05:52 crc kubenswrapper[5120]: I0316 16:05:52.257122 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:05:52 crc kubenswrapper[5120]: I0316 16:05:52.271193 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e21caabc-db04-4dca-af4d-fbbbbde012ef-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:52 crc kubenswrapper[5120]: I0316 16:05:52.271222 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e21caabc-db04-4dca-af4d-fbbbbde012ef-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:52 crc kubenswrapper[5120]: I0316 16:05:52.271231 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:52 crc kubenswrapper[5120]: I0316 16:05:52.298829 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"f8028a79-c5c3-420e-ac48-33a3991aba76","Type":"ContainerStarted","Data":"d3ba9fee80a25c94a411c85c3313f845f1922efd50dc1f17b4b3834009a2c44c"} Mar 16 16:05:52 crc kubenswrapper[5120]: I0316 16:05:52.302588 5120 scope.go:117] "RemoveContainer" containerID="8eea30b4264cb5b81ae072784fc62cef45ea952a53322bf12789607ce5b7ee48" Mar 16 16:05:52 crc kubenswrapper[5120]: I0316 16:05:52.312201 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:05:52 crc kubenswrapper[5120]: I0316 16:05:52.313044 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"efc5b4b3-507b-4f7b-9524-621ff45c12a6","Type":"ContainerStarted","Data":"826e018a02a787264e19107777830f87c35b2977f3638effba1fabc838449141"} Mar 16 16:05:52 crc kubenswrapper[5120]: I0316 16:05:52.318649 5120 generic.go:358] "Generic (PLEG): container finished" podID="ab84006c-23ad-4247-abe7-0d1016d65297" containerID="ee7c99e35f0ea6542759434ce015ae8518de8dfb907666327a5a872082e8e57b" exitCode=143 Mar 16 16:05:52 crc kubenswrapper[5120]: I0316 16:05:52.318822 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-c76f59879-tpdpx" event={"ID":"ab84006c-23ad-4247-abe7-0d1016d65297","Type":"ContainerDied","Data":"ee7c99e35f0ea6542759434ce015ae8518de8dfb907666327a5a872082e8e57b"} Mar 16 16:05:52 crc kubenswrapper[5120]: I0316 16:05:52.330690 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:05:52 crc kubenswrapper[5120]: I0316 16:05:52.354933 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:05:52 crc kubenswrapper[5120]: I0316 16:05:52.355896 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e21caabc-db04-4dca-af4d-fbbbbde012ef" containerName="glance-log" Mar 16 16:05:52 crc kubenswrapper[5120]: I0316 16:05:52.355909 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e21caabc-db04-4dca-af4d-fbbbbde012ef" containerName="glance-log" Mar 16 16:05:52 crc kubenswrapper[5120]: I0316 16:05:52.355947 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e1be97f-dece-41af-b53b-e6d37affb572" containerName="neutron-api" Mar 16 16:05:52 crc kubenswrapper[5120]: I0316 16:05:52.355956 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e1be97f-dece-41af-b53b-e6d37affb572" containerName="neutron-api" Mar 16 16:05:52 crc kubenswrapper[5120]: I0316 16:05:52.355972 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e21caabc-db04-4dca-af4d-fbbbbde012ef" containerName="glance-httpd" Mar 16 16:05:52 crc kubenswrapper[5120]: I0316 16:05:52.355977 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e21caabc-db04-4dca-af4d-fbbbbde012ef" containerName="glance-httpd" Mar 16 16:05:52 crc kubenswrapper[5120]: I0316 16:05:52.356002 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e1be97f-dece-41af-b53b-e6d37affb572" containerName="neutron-httpd" Mar 16 16:05:52 crc kubenswrapper[5120]: I0316 16:05:52.356007 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e1be97f-dece-41af-b53b-e6d37affb572" containerName="neutron-httpd" Mar 16 16:05:52 crc kubenswrapper[5120]: I0316 16:05:52.356176 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e21caabc-db04-4dca-af4d-fbbbbde012ef" containerName="glance-httpd" Mar 16 16:05:52 crc kubenswrapper[5120]: I0316 16:05:52.356190 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="2e1be97f-dece-41af-b53b-e6d37affb572" containerName="neutron-httpd" Mar 16 16:05:52 crc kubenswrapper[5120]: I0316 16:05:52.356199 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="2e1be97f-dece-41af-b53b-e6d37affb572" containerName="neutron-api" Mar 16 16:05:52 crc kubenswrapper[5120]: I0316 16:05:52.356209 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e21caabc-db04-4dca-af4d-fbbbbde012ef" containerName="glance-log" Mar 16 16:05:52 crc kubenswrapper[5120]: I0316 16:05:52.360501 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-internal-api-0" podStartSLOduration=5.360481406 podStartE2EDuration="5.360481406s" podCreationTimestamp="2026-03-16 16:05:47 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:05:52.336146842 +0000 UTC m=+2054.490078499" watchObservedRunningTime="2026-03-16 16:05:52.360481406 +0000 UTC m=+2054.514413053" Mar 16 16:05:52 crc kubenswrapper[5120]: I0316 16:05:52.362549 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:05:52 crc kubenswrapper[5120]: I0316 16:05:52.387841 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:05:52 crc kubenswrapper[5120]: I0316 16:05:52.388750 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-external-config-data\"" Mar 16 16:05:52 crc kubenswrapper[5120]: I0316 16:05:52.388842 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-public-svc\"" Mar 16 16:05:52 crc kubenswrapper[5120]: I0316 16:05:52.389020 5120 generic.go:358] "Generic (PLEG): container finished" podID="e2185e65-e56e-4f2e-929e-9caa246e5961" containerID="93af2507717d78fa1e06041087d6f02fc16b229867935621c914a9dd2f241aa8" exitCode=143 Mar 16 16:05:52 crc kubenswrapper[5120]: I0316 16:05:52.389084 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-7dcb9fc94d-5c4n9" event={"ID":"e2185e65-e56e-4f2e-929e-9caa246e5961","Type":"ContainerDied","Data":"93af2507717d78fa1e06041087d6f02fc16b229867935621c914a9dd2f241aa8"} Mar 16 16:05:52 crc kubenswrapper[5120]: I0316 16:05:52.431892 5120 scope.go:117] "RemoveContainer" containerID="690d8c0414abcfba6ac522dccd770b198d8df01c4d769b43d45f9b7b69658a8b" Mar 16 16:05:52 crc kubenswrapper[5120]: I0316 16:05:52.475172 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c1c401a6-a61c-45bf-b9a2-c99abf5bc72e-config-data\") pod \"glance-default-external-api-0\" (UID: \"c1c401a6-a61c-45bf-b9a2-c99abf5bc72e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:05:52 crc kubenswrapper[5120]: I0316 16:05:52.475239 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/c1c401a6-a61c-45bf-b9a2-c99abf5bc72e-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"c1c401a6-a61c-45bf-b9a2-c99abf5bc72e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:05:52 crc kubenswrapper[5120]: I0316 16:05:52.475280 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"glance-default-external-api-0\" (UID: \"c1c401a6-a61c-45bf-b9a2-c99abf5bc72e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:05:52 crc kubenswrapper[5120]: I0316 16:05:52.475347 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c1c401a6-a61c-45bf-b9a2-c99abf5bc72e-logs\") pod \"glance-default-external-api-0\" (UID: \"c1c401a6-a61c-45bf-b9a2-c99abf5bc72e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:05:52 crc kubenswrapper[5120]: I0316 16:05:52.475382 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/c1c401a6-a61c-45bf-b9a2-c99abf5bc72e-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"c1c401a6-a61c-45bf-b9a2-c99abf5bc72e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:05:52 crc kubenswrapper[5120]: I0316 16:05:52.475404 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c1c401a6-a61c-45bf-b9a2-c99abf5bc72e-scripts\") pod \"glance-default-external-api-0\" (UID: \"c1c401a6-a61c-45bf-b9a2-c99abf5bc72e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:05:52 crc kubenswrapper[5120]: I0316 16:05:52.475431 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c1c401a6-a61c-45bf-b9a2-c99abf5bc72e-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"c1c401a6-a61c-45bf-b9a2-c99abf5bc72e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:05:52 crc kubenswrapper[5120]: I0316 16:05:52.475595 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8wsc\" (UniqueName: \"kubernetes.io/projected/c1c401a6-a61c-45bf-b9a2-c99abf5bc72e-kube-api-access-v8wsc\") pod \"glance-default-external-api-0\" (UID: \"c1c401a6-a61c-45bf-b9a2-c99abf5bc72e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:05:52 crc kubenswrapper[5120]: I0316 16:05:52.485552 5120 scope.go:117] "RemoveContainer" containerID="8eea30b4264cb5b81ae072784fc62cef45ea952a53322bf12789607ce5b7ee48" Mar 16 16:05:52 crc kubenswrapper[5120]: E0316 16:05:52.486026 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8eea30b4264cb5b81ae072784fc62cef45ea952a53322bf12789607ce5b7ee48\": container with ID starting with 8eea30b4264cb5b81ae072784fc62cef45ea952a53322bf12789607ce5b7ee48 not found: ID does not exist" containerID="8eea30b4264cb5b81ae072784fc62cef45ea952a53322bf12789607ce5b7ee48" Mar 16 16:05:52 crc kubenswrapper[5120]: I0316 16:05:52.486064 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8eea30b4264cb5b81ae072784fc62cef45ea952a53322bf12789607ce5b7ee48"} err="failed to get container status \"8eea30b4264cb5b81ae072784fc62cef45ea952a53322bf12789607ce5b7ee48\": rpc error: code = NotFound desc = could not find container \"8eea30b4264cb5b81ae072784fc62cef45ea952a53322bf12789607ce5b7ee48\": container with ID starting with 8eea30b4264cb5b81ae072784fc62cef45ea952a53322bf12789607ce5b7ee48 not found: ID does not exist" Mar 16 16:05:52 crc kubenswrapper[5120]: I0316 16:05:52.486084 5120 scope.go:117] "RemoveContainer" containerID="690d8c0414abcfba6ac522dccd770b198d8df01c4d769b43d45f9b7b69658a8b" Mar 16 16:05:52 crc kubenswrapper[5120]: E0316 16:05:52.486647 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"690d8c0414abcfba6ac522dccd770b198d8df01c4d769b43d45f9b7b69658a8b\": container with ID starting with 690d8c0414abcfba6ac522dccd770b198d8df01c4d769b43d45f9b7b69658a8b not found: ID does not exist" containerID="690d8c0414abcfba6ac522dccd770b198d8df01c4d769b43d45f9b7b69658a8b" Mar 16 16:05:52 crc kubenswrapper[5120]: I0316 16:05:52.486671 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"690d8c0414abcfba6ac522dccd770b198d8df01c4d769b43d45f9b7b69658a8b"} err="failed to get container status \"690d8c0414abcfba6ac522dccd770b198d8df01c4d769b43d45f9b7b69658a8b\": rpc error: code = NotFound desc = could not find container \"690d8c0414abcfba6ac522dccd770b198d8df01c4d769b43d45f9b7b69658a8b\": container with ID starting with 690d8c0414abcfba6ac522dccd770b198d8df01c4d769b43d45f9b7b69658a8b not found: ID does not exist" Mar 16 16:05:52 crc kubenswrapper[5120]: I0316 16:05:52.578961 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v8wsc\" (UniqueName: \"kubernetes.io/projected/c1c401a6-a61c-45bf-b9a2-c99abf5bc72e-kube-api-access-v8wsc\") pod \"glance-default-external-api-0\" (UID: \"c1c401a6-a61c-45bf-b9a2-c99abf5bc72e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:05:52 crc kubenswrapper[5120]: I0316 16:05:52.579252 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c1c401a6-a61c-45bf-b9a2-c99abf5bc72e-config-data\") pod \"glance-default-external-api-0\" (UID: \"c1c401a6-a61c-45bf-b9a2-c99abf5bc72e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:05:52 crc kubenswrapper[5120]: I0316 16:05:52.579287 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/c1c401a6-a61c-45bf-b9a2-c99abf5bc72e-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"c1c401a6-a61c-45bf-b9a2-c99abf5bc72e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:05:52 crc kubenswrapper[5120]: I0316 16:05:52.579314 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"glance-default-external-api-0\" (UID: \"c1c401a6-a61c-45bf-b9a2-c99abf5bc72e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:05:52 crc kubenswrapper[5120]: I0316 16:05:52.579357 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c1c401a6-a61c-45bf-b9a2-c99abf5bc72e-logs\") pod \"glance-default-external-api-0\" (UID: \"c1c401a6-a61c-45bf-b9a2-c99abf5bc72e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:05:52 crc kubenswrapper[5120]: I0316 16:05:52.579383 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/c1c401a6-a61c-45bf-b9a2-c99abf5bc72e-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"c1c401a6-a61c-45bf-b9a2-c99abf5bc72e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:05:52 crc kubenswrapper[5120]: I0316 16:05:52.579404 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c1c401a6-a61c-45bf-b9a2-c99abf5bc72e-scripts\") pod \"glance-default-external-api-0\" (UID: \"c1c401a6-a61c-45bf-b9a2-c99abf5bc72e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:05:52 crc kubenswrapper[5120]: I0316 16:05:52.579430 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c1c401a6-a61c-45bf-b9a2-c99abf5bc72e-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"c1c401a6-a61c-45bf-b9a2-c99abf5bc72e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:05:52 crc kubenswrapper[5120]: I0316 16:05:52.579868 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/c1c401a6-a61c-45bf-b9a2-c99abf5bc72e-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"c1c401a6-a61c-45bf-b9a2-c99abf5bc72e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:05:52 crc kubenswrapper[5120]: I0316 16:05:52.580048 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c1c401a6-a61c-45bf-b9a2-c99abf5bc72e-logs\") pod \"glance-default-external-api-0\" (UID: \"c1c401a6-a61c-45bf-b9a2-c99abf5bc72e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:05:52 crc kubenswrapper[5120]: I0316 16:05:52.580320 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"glance-default-external-api-0\" (UID: \"c1c401a6-a61c-45bf-b9a2-c99abf5bc72e\") device mount path \"/mnt/openstack/pv13\"" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:05:52 crc kubenswrapper[5120]: I0316 16:05:52.620488 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c1c401a6-a61c-45bf-b9a2-c99abf5bc72e-scripts\") pod \"glance-default-external-api-0\" (UID: \"c1c401a6-a61c-45bf-b9a2-c99abf5bc72e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:05:52 crc kubenswrapper[5120]: I0316 16:05:52.622198 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c1c401a6-a61c-45bf-b9a2-c99abf5bc72e-config-data\") pod \"glance-default-external-api-0\" (UID: \"c1c401a6-a61c-45bf-b9a2-c99abf5bc72e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:05:52 crc kubenswrapper[5120]: I0316 16:05:52.628328 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/c1c401a6-a61c-45bf-b9a2-c99abf5bc72e-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"c1c401a6-a61c-45bf-b9a2-c99abf5bc72e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:05:52 crc kubenswrapper[5120]: I0316 16:05:52.630375 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c1c401a6-a61c-45bf-b9a2-c99abf5bc72e-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"c1c401a6-a61c-45bf-b9a2-c99abf5bc72e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:05:52 crc kubenswrapper[5120]: I0316 16:05:52.682586 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8wsc\" (UniqueName: \"kubernetes.io/projected/c1c401a6-a61c-45bf-b9a2-c99abf5bc72e-kube-api-access-v8wsc\") pod \"glance-default-external-api-0\" (UID: \"c1c401a6-a61c-45bf-b9a2-c99abf5bc72e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:05:52 crc kubenswrapper[5120]: I0316 16:05:52.700336 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"glance-default-external-api-0\" (UID: \"c1c401a6-a61c-45bf-b9a2-c99abf5bc72e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:05:52 crc kubenswrapper[5120]: I0316 16:05:52.718406 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:05:52 crc kubenswrapper[5120]: I0316 16:05:52.747521 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e1be97f-dece-41af-b53b-e6d37affb572" path="/var/lib/kubelet/pods/2e1be97f-dece-41af-b53b-e6d37affb572/volumes" Mar 16 16:05:52 crc kubenswrapper[5120]: I0316 16:05:52.785565 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e21caabc-db04-4dca-af4d-fbbbbde012ef" path="/var/lib/kubelet/pods/e21caabc-db04-4dca-af4d-fbbbbde012ef/volumes" Mar 16 16:05:52 crc kubenswrapper[5120]: I0316 16:05:52.852946 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-687cfbc4db-ngqr9" Mar 16 16:05:52 crc kubenswrapper[5120]: I0316 16:05:52.999349 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1cccc0e5-40f8-4ed9-9b3d-f7c667475288-config-data\") pod \"1cccc0e5-40f8-4ed9-9b3d-f7c667475288\" (UID: \"1cccc0e5-40f8-4ed9-9b3d-f7c667475288\") " Mar 16 16:05:53 crc kubenswrapper[5120]: I0316 16:05:52.999407 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1cccc0e5-40f8-4ed9-9b3d-f7c667475288-log-httpd\") pod \"1cccc0e5-40f8-4ed9-9b3d-f7c667475288\" (UID: \"1cccc0e5-40f8-4ed9-9b3d-f7c667475288\") " Mar 16 16:05:53 crc kubenswrapper[5120]: I0316 16:05:52.999466 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/1cccc0e5-40f8-4ed9-9b3d-f7c667475288-internal-tls-certs\") pod \"1cccc0e5-40f8-4ed9-9b3d-f7c667475288\" (UID: \"1cccc0e5-40f8-4ed9-9b3d-f7c667475288\") " Mar 16 16:05:53 crc kubenswrapper[5120]: I0316 16:05:52.999535 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vsctl\" (UniqueName: \"kubernetes.io/projected/1cccc0e5-40f8-4ed9-9b3d-f7c667475288-kube-api-access-vsctl\") pod \"1cccc0e5-40f8-4ed9-9b3d-f7c667475288\" (UID: \"1cccc0e5-40f8-4ed9-9b3d-f7c667475288\") " Mar 16 16:05:53 crc kubenswrapper[5120]: I0316 16:05:52.999665 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/1cccc0e5-40f8-4ed9-9b3d-f7c667475288-public-tls-certs\") pod \"1cccc0e5-40f8-4ed9-9b3d-f7c667475288\" (UID: \"1cccc0e5-40f8-4ed9-9b3d-f7c667475288\") " Mar 16 16:05:53 crc kubenswrapper[5120]: I0316 16:05:52.999707 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/1cccc0e5-40f8-4ed9-9b3d-f7c667475288-etc-swift\") pod \"1cccc0e5-40f8-4ed9-9b3d-f7c667475288\" (UID: \"1cccc0e5-40f8-4ed9-9b3d-f7c667475288\") " Mar 16 16:05:53 crc kubenswrapper[5120]: I0316 16:05:52.999772 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1cccc0e5-40f8-4ed9-9b3d-f7c667475288-combined-ca-bundle\") pod \"1cccc0e5-40f8-4ed9-9b3d-f7c667475288\" (UID: \"1cccc0e5-40f8-4ed9-9b3d-f7c667475288\") " Mar 16 16:05:53 crc kubenswrapper[5120]: I0316 16:05:52.999801 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1cccc0e5-40f8-4ed9-9b3d-f7c667475288-run-httpd\") pod \"1cccc0e5-40f8-4ed9-9b3d-f7c667475288\" (UID: \"1cccc0e5-40f8-4ed9-9b3d-f7c667475288\") " Mar 16 16:05:53 crc kubenswrapper[5120]: I0316 16:05:53.000669 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1cccc0e5-40f8-4ed9-9b3d-f7c667475288-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "1cccc0e5-40f8-4ed9-9b3d-f7c667475288" (UID: "1cccc0e5-40f8-4ed9-9b3d-f7c667475288"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:05:53 crc kubenswrapper[5120]: I0316 16:05:53.002976 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1cccc0e5-40f8-4ed9-9b3d-f7c667475288-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "1cccc0e5-40f8-4ed9-9b3d-f7c667475288" (UID: "1cccc0e5-40f8-4ed9-9b3d-f7c667475288"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:05:53 crc kubenswrapper[5120]: I0316 16:05:53.011013 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1cccc0e5-40f8-4ed9-9b3d-f7c667475288-etc-swift" (OuterVolumeSpecName: "etc-swift") pod "1cccc0e5-40f8-4ed9-9b3d-f7c667475288" (UID: "1cccc0e5-40f8-4ed9-9b3d-f7c667475288"). InnerVolumeSpecName "etc-swift". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:05:53 crc kubenswrapper[5120]: I0316 16:05:53.017380 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1cccc0e5-40f8-4ed9-9b3d-f7c667475288-kube-api-access-vsctl" (OuterVolumeSpecName: "kube-api-access-vsctl") pod "1cccc0e5-40f8-4ed9-9b3d-f7c667475288" (UID: "1cccc0e5-40f8-4ed9-9b3d-f7c667475288"). InnerVolumeSpecName "kube-api-access-vsctl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:05:53 crc kubenswrapper[5120]: I0316 16:05:53.103259 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1cccc0e5-40f8-4ed9-9b3d-f7c667475288-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:53 crc kubenswrapper[5120]: I0316 16:05:53.103307 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vsctl\" (UniqueName: \"kubernetes.io/projected/1cccc0e5-40f8-4ed9-9b3d-f7c667475288-kube-api-access-vsctl\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:53 crc kubenswrapper[5120]: I0316 16:05:53.103323 5120 reconciler_common.go:299] "Volume detached for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/1cccc0e5-40f8-4ed9-9b3d-f7c667475288-etc-swift\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:53 crc kubenswrapper[5120]: I0316 16:05:53.103335 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1cccc0e5-40f8-4ed9-9b3d-f7c667475288-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:53 crc kubenswrapper[5120]: I0316 16:05:53.410736 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-85c78fd974-xjpjw" Mar 16 16:05:53 crc kubenswrapper[5120]: I0316 16:05:53.414151 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:05:53 crc kubenswrapper[5120]: I0316 16:05:53.414432 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="c6ef2171-25f8-43d1-a037-b915f5b77abc" containerName="ceilometer-central-agent" containerID="cri-o://2d0b86f84ea9cbf53b3f863fadf423c26de96160c88b2c0c460eb8283fe6384c" gracePeriod=30 Mar 16 16:05:53 crc kubenswrapper[5120]: I0316 16:05:53.414586 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="c6ef2171-25f8-43d1-a037-b915f5b77abc" containerName="proxy-httpd" containerID="cri-o://d08e4507821305fa617df2be4e46ebdc378f0875b915d89ed924026144f26267" gracePeriod=30 Mar 16 16:05:53 crc kubenswrapper[5120]: I0316 16:05:53.414643 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="c6ef2171-25f8-43d1-a037-b915f5b77abc" containerName="sg-core" containerID="cri-o://48de766ec48090227f6df29a7b45a2b202795208666a9ad5390af083fc0cc007" gracePeriod=30 Mar 16 16:05:53 crc kubenswrapper[5120]: I0316 16:05:53.414675 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="c6ef2171-25f8-43d1-a037-b915f5b77abc" containerName="ceilometer-notification-agent" containerID="cri-o://3eb73c59c62ea647f400a2728674a5a5fff71ad386b71213f4394dd33c2bc900" gracePeriod=30 Mar 16 16:05:53 crc kubenswrapper[5120]: I0316 16:05:53.427434 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1cccc0e5-40f8-4ed9-9b3d-f7c667475288-config-data" (OuterVolumeSpecName: "config-data") pod "1cccc0e5-40f8-4ed9-9b3d-f7c667475288" (UID: "1cccc0e5-40f8-4ed9-9b3d-f7c667475288"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:53 crc kubenswrapper[5120]: I0316 16:05:53.451144 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" event={"ID":"e2275cb4-4905-4d66-a87e-8010120db2bd","Type":"ContainerStarted","Data":"bc2df124cc6ad146d7c7dd2115ac815986fb62978d38895f6d345a4a9b14dbd8"} Mar 16 16:05:53 crc kubenswrapper[5120]: I0316 16:05:53.455865 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1cccc0e5-40f8-4ed9-9b3d-f7c667475288-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "1cccc0e5-40f8-4ed9-9b3d-f7c667475288" (UID: "1cccc0e5-40f8-4ed9-9b3d-f7c667475288"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:53 crc kubenswrapper[5120]: I0316 16:05:53.461905 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:05:53 crc kubenswrapper[5120]: I0316 16:05:53.468240 5120 generic.go:358] "Generic (PLEG): container finished" podID="9d957ec2-c514-472f-8d88-1d6c6fa2449a" containerID="333737d93d6fbb25bb5004ab514939c313486791cddcf0cc65119cd679595d46" exitCode=0 Mar 16 16:05:53 crc kubenswrapper[5120]: I0316 16:05:53.468331 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-85c78fd974-xjpjw" event={"ID":"9d957ec2-c514-472f-8d88-1d6c6fa2449a","Type":"ContainerDied","Data":"333737d93d6fbb25bb5004ab514939c313486791cddcf0cc65119cd679595d46"} Mar 16 16:05:53 crc kubenswrapper[5120]: I0316 16:05:53.468370 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-85c78fd974-xjpjw" event={"ID":"9d957ec2-c514-472f-8d88-1d6c6fa2449a","Type":"ContainerDied","Data":"ed7c036767ac426d78f2c45467d40f88e65f0494312c02576528585784ff26f9"} Mar 16 16:05:53 crc kubenswrapper[5120]: I0316 16:05:53.468388 5120 scope.go:117] "RemoveContainer" containerID="333737d93d6fbb25bb5004ab514939c313486791cddcf0cc65119cd679595d46" Mar 16 16:05:53 crc kubenswrapper[5120]: I0316 16:05:53.468524 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-85c78fd974-xjpjw" Mar 16 16:05:53 crc kubenswrapper[5120]: I0316 16:05:53.472487 5120 generic.go:358] "Generic (PLEG): container finished" podID="34a68caa-76db-4be4-9ecd-8955435c0e90" containerID="d6456b18671133be61b3e3aee639a3b98b4bd2c9402ee3e32ee592907357518e" exitCode=0 Mar 16 16:05:53 crc kubenswrapper[5120]: I0316 16:05:53.472599 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"34a68caa-76db-4be4-9ecd-8955435c0e90","Type":"ContainerDied","Data":"d6456b18671133be61b3e3aee639a3b98b4bd2c9402ee3e32ee592907357518e"} Mar 16 16:05:53 crc kubenswrapper[5120]: I0316 16:05:53.473519 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1cccc0e5-40f8-4ed9-9b3d-f7c667475288-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "1cccc0e5-40f8-4ed9-9b3d-f7c667475288" (UID: "1cccc0e5-40f8-4ed9-9b3d-f7c667475288"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:53 crc kubenswrapper[5120]: I0316 16:05:53.475944 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1cccc0e5-40f8-4ed9-9b3d-f7c667475288-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "1cccc0e5-40f8-4ed9-9b3d-f7c667475288" (UID: "1cccc0e5-40f8-4ed9-9b3d-f7c667475288"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:53 crc kubenswrapper[5120]: I0316 16:05:53.476471 5120 generic.go:358] "Generic (PLEG): container finished" podID="1cccc0e5-40f8-4ed9-9b3d-f7c667475288" containerID="618551cca919c1c9a479a978588c91bbc6d144f786f3b83f5bfa042209795dec" exitCode=0 Mar 16 16:05:53 crc kubenswrapper[5120]: I0316 16:05:53.476489 5120 generic.go:358] "Generic (PLEG): container finished" podID="1cccc0e5-40f8-4ed9-9b3d-f7c667475288" containerID="a163ab3521839a34ec882d99811cb4498761451ad0a9a1cd6942d451f1e8f179" exitCode=0 Mar 16 16:05:53 crc kubenswrapper[5120]: I0316 16:05:53.477556 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-687cfbc4db-ngqr9" Mar 16 16:05:53 crc kubenswrapper[5120]: I0316 16:05:53.480878 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-687cfbc4db-ngqr9" event={"ID":"1cccc0e5-40f8-4ed9-9b3d-f7c667475288","Type":"ContainerDied","Data":"618551cca919c1c9a479a978588c91bbc6d144f786f3b83f5bfa042209795dec"} Mar 16 16:05:53 crc kubenswrapper[5120]: I0316 16:05:53.485838 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-687cfbc4db-ngqr9" event={"ID":"1cccc0e5-40f8-4ed9-9b3d-f7c667475288","Type":"ContainerDied","Data":"a163ab3521839a34ec882d99811cb4498761451ad0a9a1cd6942d451f1e8f179"} Mar 16 16:05:53 crc kubenswrapper[5120]: I0316 16:05:53.485977 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-687cfbc4db-ngqr9" event={"ID":"1cccc0e5-40f8-4ed9-9b3d-f7c667475288","Type":"ContainerDied","Data":"0f8418bf647aa6aed1db56689902140bdd30784fb301b4c81e1baf42da5305a7"} Mar 16 16:05:53 crc kubenswrapper[5120]: I0316 16:05:53.510719 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m4mtn\" (UniqueName: \"kubernetes.io/projected/9d957ec2-c514-472f-8d88-1d6c6fa2449a-kube-api-access-m4mtn\") pod \"9d957ec2-c514-472f-8d88-1d6c6fa2449a\" (UID: \"9d957ec2-c514-472f-8d88-1d6c6fa2449a\") " Mar 16 16:05:53 crc kubenswrapper[5120]: I0316 16:05:53.510927 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9d957ec2-c514-472f-8d88-1d6c6fa2449a-combined-ca-bundle\") pod \"9d957ec2-c514-472f-8d88-1d6c6fa2449a\" (UID: \"9d957ec2-c514-472f-8d88-1d6c6fa2449a\") " Mar 16 16:05:53 crc kubenswrapper[5120]: I0316 16:05:53.511024 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/9d957ec2-c514-472f-8d88-1d6c6fa2449a-public-tls-certs\") pod \"9d957ec2-c514-472f-8d88-1d6c6fa2449a\" (UID: \"9d957ec2-c514-472f-8d88-1d6c6fa2449a\") " Mar 16 16:05:53 crc kubenswrapper[5120]: I0316 16:05:53.511123 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/9d957ec2-c514-472f-8d88-1d6c6fa2449a-internal-tls-certs\") pod \"9d957ec2-c514-472f-8d88-1d6c6fa2449a\" (UID: \"9d957ec2-c514-472f-8d88-1d6c6fa2449a\") " Mar 16 16:05:53 crc kubenswrapper[5120]: I0316 16:05:53.511187 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9d957ec2-c514-472f-8d88-1d6c6fa2449a-logs\") pod \"9d957ec2-c514-472f-8d88-1d6c6fa2449a\" (UID: \"9d957ec2-c514-472f-8d88-1d6c6fa2449a\") " Mar 16 16:05:53 crc kubenswrapper[5120]: I0316 16:05:53.511205 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9d957ec2-c514-472f-8d88-1d6c6fa2449a-config-data\") pod \"9d957ec2-c514-472f-8d88-1d6c6fa2449a\" (UID: \"9d957ec2-c514-472f-8d88-1d6c6fa2449a\") " Mar 16 16:05:53 crc kubenswrapper[5120]: I0316 16:05:53.511432 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9d957ec2-c514-472f-8d88-1d6c6fa2449a-scripts\") pod \"9d957ec2-c514-472f-8d88-1d6c6fa2449a\" (UID: \"9d957ec2-c514-472f-8d88-1d6c6fa2449a\") " Mar 16 16:05:53 crc kubenswrapper[5120]: I0316 16:05:53.511933 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/1cccc0e5-40f8-4ed9-9b3d-f7c667475288-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:53 crc kubenswrapper[5120]: I0316 16:05:53.511971 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1cccc0e5-40f8-4ed9-9b3d-f7c667475288-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:53 crc kubenswrapper[5120]: I0316 16:05:53.511982 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1cccc0e5-40f8-4ed9-9b3d-f7c667475288-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:53 crc kubenswrapper[5120]: I0316 16:05:53.511992 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/1cccc0e5-40f8-4ed9-9b3d-f7c667475288-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:53 crc kubenswrapper[5120]: I0316 16:05:53.517199 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d957ec2-c514-472f-8d88-1d6c6fa2449a-logs" (OuterVolumeSpecName: "logs") pod "9d957ec2-c514-472f-8d88-1d6c6fa2449a" (UID: "9d957ec2-c514-472f-8d88-1d6c6fa2449a"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:05:53 crc kubenswrapper[5120]: I0316 16:05:53.556688 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d957ec2-c514-472f-8d88-1d6c6fa2449a-kube-api-access-m4mtn" (OuterVolumeSpecName: "kube-api-access-m4mtn") pod "9d957ec2-c514-472f-8d88-1d6c6fa2449a" (UID: "9d957ec2-c514-472f-8d88-1d6c6fa2449a"). InnerVolumeSpecName "kube-api-access-m4mtn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:05:53 crc kubenswrapper[5120]: I0316 16:05:53.557253 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9d957ec2-c514-472f-8d88-1d6c6fa2449a-scripts" (OuterVolumeSpecName: "scripts") pod "9d957ec2-c514-472f-8d88-1d6c6fa2449a" (UID: "9d957ec2-c514-472f-8d88-1d6c6fa2449a"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:53 crc kubenswrapper[5120]: I0316 16:05:53.614155 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9d957ec2-c514-472f-8d88-1d6c6fa2449a-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:53 crc kubenswrapper[5120]: I0316 16:05:53.614181 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9d957ec2-c514-472f-8d88-1d6c6fa2449a-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:53 crc kubenswrapper[5120]: I0316 16:05:53.614191 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m4mtn\" (UniqueName: \"kubernetes.io/projected/9d957ec2-c514-472f-8d88-1d6c6fa2449a-kube-api-access-m4mtn\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:53 crc kubenswrapper[5120]: I0316 16:05:53.621657 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9d957ec2-c514-472f-8d88-1d6c6fa2449a-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "9d957ec2-c514-472f-8d88-1d6c6fa2449a" (UID: "9d957ec2-c514-472f-8d88-1d6c6fa2449a"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:53 crc kubenswrapper[5120]: I0316 16:05:53.658978 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9d957ec2-c514-472f-8d88-1d6c6fa2449a-config-data" (OuterVolumeSpecName: "config-data") pod "9d957ec2-c514-472f-8d88-1d6c6fa2449a" (UID: "9d957ec2-c514-472f-8d88-1d6c6fa2449a"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:53 crc kubenswrapper[5120]: I0316 16:05:53.722999 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9d957ec2-c514-472f-8d88-1d6c6fa2449a-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:53 crc kubenswrapper[5120]: I0316 16:05:53.723032 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9d957ec2-c514-472f-8d88-1d6c6fa2449a-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:53 crc kubenswrapper[5120]: I0316 16:05:53.747450 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9d957ec2-c514-472f-8d88-1d6c6fa2449a-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "9d957ec2-c514-472f-8d88-1d6c6fa2449a" (UID: "9d957ec2-c514-472f-8d88-1d6c6fa2449a"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:53 crc kubenswrapper[5120]: I0316 16:05:53.771510 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9d957ec2-c514-472f-8d88-1d6c6fa2449a-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "9d957ec2-c514-472f-8d88-1d6c6fa2449a" (UID: "9d957ec2-c514-472f-8d88-1d6c6fa2449a"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:53 crc kubenswrapper[5120]: I0316 16:05:53.828205 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/9d957ec2-c514-472f-8d88-1d6c6fa2449a-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:53 crc kubenswrapper[5120]: I0316 16:05:53.828249 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/9d957ec2-c514-472f-8d88-1d6c6fa2449a-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:53 crc kubenswrapper[5120]: I0316 16:05:53.846822 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-proxy-687cfbc4db-ngqr9"] Mar 16 16:05:53 crc kubenswrapper[5120]: I0316 16:05:53.852193 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/swift-proxy-687cfbc4db-ngqr9"] Mar 16 16:05:53 crc kubenswrapper[5120]: I0316 16:05:53.854861 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:05:53 crc kubenswrapper[5120]: I0316 16:05:53.858688 5120 scope.go:117] "RemoveContainer" containerID="4116dcb83724da3c7c7e7b411acb5b9cee7912b69d024280fbdb5d4b961c617a" Mar 16 16:05:53 crc kubenswrapper[5120]: I0316 16:05:53.907800 5120 scope.go:117] "RemoveContainer" containerID="333737d93d6fbb25bb5004ab514939c313486791cddcf0cc65119cd679595d46" Mar 16 16:05:53 crc kubenswrapper[5120]: E0316 16:05:53.919664 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"333737d93d6fbb25bb5004ab514939c313486791cddcf0cc65119cd679595d46\": container with ID starting with 333737d93d6fbb25bb5004ab514939c313486791cddcf0cc65119cd679595d46 not found: ID does not exist" containerID="333737d93d6fbb25bb5004ab514939c313486791cddcf0cc65119cd679595d46" Mar 16 16:05:53 crc kubenswrapper[5120]: I0316 16:05:53.919714 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"333737d93d6fbb25bb5004ab514939c313486791cddcf0cc65119cd679595d46"} err="failed to get container status \"333737d93d6fbb25bb5004ab514939c313486791cddcf0cc65119cd679595d46\": rpc error: code = NotFound desc = could not find container \"333737d93d6fbb25bb5004ab514939c313486791cddcf0cc65119cd679595d46\": container with ID starting with 333737d93d6fbb25bb5004ab514939c313486791cddcf0cc65119cd679595d46 not found: ID does not exist" Mar 16 16:05:53 crc kubenswrapper[5120]: I0316 16:05:53.919738 5120 scope.go:117] "RemoveContainer" containerID="4116dcb83724da3c7c7e7b411acb5b9cee7912b69d024280fbdb5d4b961c617a" Mar 16 16:05:53 crc kubenswrapper[5120]: E0316 16:05:53.920192 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4116dcb83724da3c7c7e7b411acb5b9cee7912b69d024280fbdb5d4b961c617a\": container with ID starting with 4116dcb83724da3c7c7e7b411acb5b9cee7912b69d024280fbdb5d4b961c617a not found: ID does not exist" containerID="4116dcb83724da3c7c7e7b411acb5b9cee7912b69d024280fbdb5d4b961c617a" Mar 16 16:05:53 crc kubenswrapper[5120]: I0316 16:05:53.920235 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4116dcb83724da3c7c7e7b411acb5b9cee7912b69d024280fbdb5d4b961c617a"} err="failed to get container status \"4116dcb83724da3c7c7e7b411acb5b9cee7912b69d024280fbdb5d4b961c617a\": rpc error: code = NotFound desc = could not find container \"4116dcb83724da3c7c7e7b411acb5b9cee7912b69d024280fbdb5d4b961c617a\": container with ID starting with 4116dcb83724da3c7c7e7b411acb5b9cee7912b69d024280fbdb5d4b961c617a not found: ID does not exist" Mar 16 16:05:53 crc kubenswrapper[5120]: I0316 16:05:53.920261 5120 scope.go:117] "RemoveContainer" containerID="618551cca919c1c9a479a978588c91bbc6d144f786f3b83f5bfa042209795dec" Mar 16 16:05:53 crc kubenswrapper[5120]: I0316 16:05:53.930470 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/34a68caa-76db-4be4-9ecd-8955435c0e90-scripts\") pod \"34a68caa-76db-4be4-9ecd-8955435c0e90\" (UID: \"34a68caa-76db-4be4-9ecd-8955435c0e90\") " Mar 16 16:05:53 crc kubenswrapper[5120]: I0316 16:05:53.930586 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/34a68caa-76db-4be4-9ecd-8955435c0e90-etc-machine-id\") pod \"34a68caa-76db-4be4-9ecd-8955435c0e90\" (UID: \"34a68caa-76db-4be4-9ecd-8955435c0e90\") " Mar 16 16:05:53 crc kubenswrapper[5120]: I0316 16:05:53.930692 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/34a68caa-76db-4be4-9ecd-8955435c0e90-config-data\") pod \"34a68caa-76db-4be4-9ecd-8955435c0e90\" (UID: \"34a68caa-76db-4be4-9ecd-8955435c0e90\") " Mar 16 16:05:53 crc kubenswrapper[5120]: I0316 16:05:53.930971 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/34a68caa-76db-4be4-9ecd-8955435c0e90-config-data-custom\") pod \"34a68caa-76db-4be4-9ecd-8955435c0e90\" (UID: \"34a68caa-76db-4be4-9ecd-8955435c0e90\") " Mar 16 16:05:53 crc kubenswrapper[5120]: I0316 16:05:53.931029 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tqv59\" (UniqueName: \"kubernetes.io/projected/34a68caa-76db-4be4-9ecd-8955435c0e90-kube-api-access-tqv59\") pod \"34a68caa-76db-4be4-9ecd-8955435c0e90\" (UID: \"34a68caa-76db-4be4-9ecd-8955435c0e90\") " Mar 16 16:05:53 crc kubenswrapper[5120]: I0316 16:05:53.931097 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/34a68caa-76db-4be4-9ecd-8955435c0e90-combined-ca-bundle\") pod \"34a68caa-76db-4be4-9ecd-8955435c0e90\" (UID: \"34a68caa-76db-4be4-9ecd-8955435c0e90\") " Mar 16 16:05:53 crc kubenswrapper[5120]: I0316 16:05:53.931268 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/34a68caa-76db-4be4-9ecd-8955435c0e90-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "34a68caa-76db-4be4-9ecd-8955435c0e90" (UID: "34a68caa-76db-4be4-9ecd-8955435c0e90"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 16:05:53 crc kubenswrapper[5120]: I0316 16:05:53.933502 5120 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/34a68caa-76db-4be4-9ecd-8955435c0e90-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:53 crc kubenswrapper[5120]: I0316 16:05:53.942720 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/34a68caa-76db-4be4-9ecd-8955435c0e90-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "34a68caa-76db-4be4-9ecd-8955435c0e90" (UID: "34a68caa-76db-4be4-9ecd-8955435c0e90"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:53 crc kubenswrapper[5120]: I0316 16:05:53.949588 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/34a68caa-76db-4be4-9ecd-8955435c0e90-scripts" (OuterVolumeSpecName: "scripts") pod "34a68caa-76db-4be4-9ecd-8955435c0e90" (UID: "34a68caa-76db-4be4-9ecd-8955435c0e90"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:53 crc kubenswrapper[5120]: I0316 16:05:53.962282 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34a68caa-76db-4be4-9ecd-8955435c0e90-kube-api-access-tqv59" (OuterVolumeSpecName: "kube-api-access-tqv59") pod "34a68caa-76db-4be4-9ecd-8955435c0e90" (UID: "34a68caa-76db-4be4-9ecd-8955435c0e90"). InnerVolumeSpecName "kube-api-access-tqv59". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:05:53 crc kubenswrapper[5120]: I0316 16:05:53.986825 5120 scope.go:117] "RemoveContainer" containerID="a163ab3521839a34ec882d99811cb4498761451ad0a9a1cd6942d451f1e8f179" Mar 16 16:05:54 crc kubenswrapper[5120]: I0316 16:05:54.025680 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/34a68caa-76db-4be4-9ecd-8955435c0e90-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "34a68caa-76db-4be4-9ecd-8955435c0e90" (UID: "34a68caa-76db-4be4-9ecd-8955435c0e90"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:54 crc kubenswrapper[5120]: I0316 16:05:54.026331 5120 scope.go:117] "RemoveContainer" containerID="618551cca919c1c9a479a978588c91bbc6d144f786f3b83f5bfa042209795dec" Mar 16 16:05:54 crc kubenswrapper[5120]: E0316 16:05:54.027311 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"618551cca919c1c9a479a978588c91bbc6d144f786f3b83f5bfa042209795dec\": container with ID starting with 618551cca919c1c9a479a978588c91bbc6d144f786f3b83f5bfa042209795dec not found: ID does not exist" containerID="618551cca919c1c9a479a978588c91bbc6d144f786f3b83f5bfa042209795dec" Mar 16 16:05:54 crc kubenswrapper[5120]: I0316 16:05:54.027372 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"618551cca919c1c9a479a978588c91bbc6d144f786f3b83f5bfa042209795dec"} err="failed to get container status \"618551cca919c1c9a479a978588c91bbc6d144f786f3b83f5bfa042209795dec\": rpc error: code = NotFound desc = could not find container \"618551cca919c1c9a479a978588c91bbc6d144f786f3b83f5bfa042209795dec\": container with ID starting with 618551cca919c1c9a479a978588c91bbc6d144f786f3b83f5bfa042209795dec not found: ID does not exist" Mar 16 16:05:54 crc kubenswrapper[5120]: I0316 16:05:54.027397 5120 scope.go:117] "RemoveContainer" containerID="a163ab3521839a34ec882d99811cb4498761451ad0a9a1cd6942d451f1e8f179" Mar 16 16:05:54 crc kubenswrapper[5120]: E0316 16:05:54.030632 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a163ab3521839a34ec882d99811cb4498761451ad0a9a1cd6942d451f1e8f179\": container with ID starting with a163ab3521839a34ec882d99811cb4498761451ad0a9a1cd6942d451f1e8f179 not found: ID does not exist" containerID="a163ab3521839a34ec882d99811cb4498761451ad0a9a1cd6942d451f1e8f179" Mar 16 16:05:54 crc kubenswrapper[5120]: I0316 16:05:54.030653 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a163ab3521839a34ec882d99811cb4498761451ad0a9a1cd6942d451f1e8f179"} err="failed to get container status \"a163ab3521839a34ec882d99811cb4498761451ad0a9a1cd6942d451f1e8f179\": rpc error: code = NotFound desc = could not find container \"a163ab3521839a34ec882d99811cb4498761451ad0a9a1cd6942d451f1e8f179\": container with ID starting with a163ab3521839a34ec882d99811cb4498761451ad0a9a1cd6942d451f1e8f179 not found: ID does not exist" Mar 16 16:05:54 crc kubenswrapper[5120]: I0316 16:05:54.030675 5120 scope.go:117] "RemoveContainer" containerID="618551cca919c1c9a479a978588c91bbc6d144f786f3b83f5bfa042209795dec" Mar 16 16:05:54 crc kubenswrapper[5120]: I0316 16:05:54.031018 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"618551cca919c1c9a479a978588c91bbc6d144f786f3b83f5bfa042209795dec"} err="failed to get container status \"618551cca919c1c9a479a978588c91bbc6d144f786f3b83f5bfa042209795dec\": rpc error: code = NotFound desc = could not find container \"618551cca919c1c9a479a978588c91bbc6d144f786f3b83f5bfa042209795dec\": container with ID starting with 618551cca919c1c9a479a978588c91bbc6d144f786f3b83f5bfa042209795dec not found: ID does not exist" Mar 16 16:05:54 crc kubenswrapper[5120]: I0316 16:05:54.031035 5120 scope.go:117] "RemoveContainer" containerID="a163ab3521839a34ec882d99811cb4498761451ad0a9a1cd6942d451f1e8f179" Mar 16 16:05:54 crc kubenswrapper[5120]: I0316 16:05:54.031229 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a163ab3521839a34ec882d99811cb4498761451ad0a9a1cd6942d451f1e8f179"} err="failed to get container status \"a163ab3521839a34ec882d99811cb4498761451ad0a9a1cd6942d451f1e8f179\": rpc error: code = NotFound desc = could not find container \"a163ab3521839a34ec882d99811cb4498761451ad0a9a1cd6942d451f1e8f179\": container with ID starting with a163ab3521839a34ec882d99811cb4498761451ad0a9a1cd6942d451f1e8f179 not found: ID does not exist" Mar 16 16:05:54 crc kubenswrapper[5120]: I0316 16:05:54.034832 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/34a68caa-76db-4be4-9ecd-8955435c0e90-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:54 crc kubenswrapper[5120]: I0316 16:05:54.034854 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tqv59\" (UniqueName: \"kubernetes.io/projected/34a68caa-76db-4be4-9ecd-8955435c0e90-kube-api-access-tqv59\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:54 crc kubenswrapper[5120]: I0316 16:05:54.034864 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/34a68caa-76db-4be4-9ecd-8955435c0e90-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:54 crc kubenswrapper[5120]: I0316 16:05:54.034873 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/34a68caa-76db-4be4-9ecd-8955435c0e90-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:54 crc kubenswrapper[5120]: I0316 16:05:54.267016 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-85c78fd974-xjpjw"] Mar 16 16:05:54 crc kubenswrapper[5120]: I0316 16:05:54.298021 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-85c78fd974-xjpjw"] Mar 16 16:05:54 crc kubenswrapper[5120]: I0316 16:05:54.314649 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/34a68caa-76db-4be4-9ecd-8955435c0e90-config-data" (OuterVolumeSpecName: "config-data") pod "34a68caa-76db-4be4-9ecd-8955435c0e90" (UID: "34a68caa-76db-4be4-9ecd-8955435c0e90"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:54 crc kubenswrapper[5120]: I0316 16:05:54.346653 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-55ec-account-create-update-6h2pc"] Mar 16 16:05:54 crc kubenswrapper[5120]: I0316 16:05:54.349225 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-55ec-account-create-update-6h2pc"] Mar 16 16:05:54 crc kubenswrapper[5120]: I0316 16:05:54.353129 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/34a68caa-76db-4be4-9ecd-8955435c0e90-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:54 crc kubenswrapper[5120]: I0316 16:05:54.429870 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-4cxhp"] Mar 16 16:05:54 crc kubenswrapper[5120]: I0316 16:05:54.462607 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-4cxhp"] Mar 16 16:05:54 crc kubenswrapper[5120]: I0316 16:05:54.475961 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-55ec-account-create-update-dkz9b"] Mar 16 16:05:54 crc kubenswrapper[5120]: I0316 16:05:54.476992 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d957ec2-c514-472f-8d88-1d6c6fa2449a" containerName="placement-log" Mar 16 16:05:54 crc kubenswrapper[5120]: I0316 16:05:54.477011 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d957ec2-c514-472f-8d88-1d6c6fa2449a" containerName="placement-log" Mar 16 16:05:54 crc kubenswrapper[5120]: I0316 16:05:54.477021 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1cccc0e5-40f8-4ed9-9b3d-f7c667475288" containerName="proxy-server" Mar 16 16:05:54 crc kubenswrapper[5120]: I0316 16:05:54.477029 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1cccc0e5-40f8-4ed9-9b3d-f7c667475288" containerName="proxy-server" Mar 16 16:05:54 crc kubenswrapper[5120]: I0316 16:05:54.477061 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d957ec2-c514-472f-8d88-1d6c6fa2449a" containerName="placement-api" Mar 16 16:05:54 crc kubenswrapper[5120]: I0316 16:05:54.477067 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d957ec2-c514-472f-8d88-1d6c6fa2449a" containerName="placement-api" Mar 16 16:05:54 crc kubenswrapper[5120]: I0316 16:05:54.477081 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34a68caa-76db-4be4-9ecd-8955435c0e90" containerName="cinder-scheduler" Mar 16 16:05:54 crc kubenswrapper[5120]: I0316 16:05:54.477086 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="34a68caa-76db-4be4-9ecd-8955435c0e90" containerName="cinder-scheduler" Mar 16 16:05:54 crc kubenswrapper[5120]: I0316 16:05:54.477103 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1cccc0e5-40f8-4ed9-9b3d-f7c667475288" containerName="proxy-httpd" Mar 16 16:05:54 crc kubenswrapper[5120]: I0316 16:05:54.477108 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1cccc0e5-40f8-4ed9-9b3d-f7c667475288" containerName="proxy-httpd" Mar 16 16:05:54 crc kubenswrapper[5120]: I0316 16:05:54.477117 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34a68caa-76db-4be4-9ecd-8955435c0e90" containerName="probe" Mar 16 16:05:54 crc kubenswrapper[5120]: I0316 16:05:54.477122 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="34a68caa-76db-4be4-9ecd-8955435c0e90" containerName="probe" Mar 16 16:05:54 crc kubenswrapper[5120]: I0316 16:05:54.477285 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="34a68caa-76db-4be4-9ecd-8955435c0e90" containerName="probe" Mar 16 16:05:54 crc kubenswrapper[5120]: I0316 16:05:54.477295 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="9d957ec2-c514-472f-8d88-1d6c6fa2449a" containerName="placement-api" Mar 16 16:05:54 crc kubenswrapper[5120]: I0316 16:05:54.477313 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1cccc0e5-40f8-4ed9-9b3d-f7c667475288" containerName="proxy-server" Mar 16 16:05:54 crc kubenswrapper[5120]: I0316 16:05:54.477325 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="9d957ec2-c514-472f-8d88-1d6c6fa2449a" containerName="placement-log" Mar 16 16:05:54 crc kubenswrapper[5120]: I0316 16:05:54.477337 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="34a68caa-76db-4be4-9ecd-8955435c0e90" containerName="cinder-scheduler" Mar 16 16:05:54 crc kubenswrapper[5120]: I0316 16:05:54.477343 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1cccc0e5-40f8-4ed9-9b3d-f7c667475288" containerName="proxy-httpd" Mar 16 16:05:54 crc kubenswrapper[5120]: I0316 16:05:54.482231 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-55ec-account-create-update-dkz9b" Mar 16 16:05:54 crc kubenswrapper[5120]: I0316 16:05:54.497534 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 16:05:54 crc kubenswrapper[5120]: I0316 16:05:54.497818 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-db-secret\"" Mar 16 16:05:54 crc kubenswrapper[5120]: I0316 16:05:54.497835 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/openstackclient" podUID="dcd99b91-243d-46cd-beb8-76527d308b62" containerName="openstackclient" containerID="cri-o://2a93e12e3b4726773dd0561044adb6eaa04a60413b252ae3a7757a91ab1954d4" gracePeriod=2 Mar 16 16:05:54 crc kubenswrapper[5120]: I0316 16:05:54.533004 5120 status_manager.go:895] "Failed to get status for pod" podUID="dcd99b91-243d-46cd-beb8-76527d308b62" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 16:05:54 crc kubenswrapper[5120]: I0316 16:05:54.546841 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 16:05:54 crc kubenswrapper[5120]: I0316 16:05:54.557888 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-7dcb9fc94d-5c4n9" Mar 16 16:05:54 crc kubenswrapper[5120]: I0316 16:05:54.579330 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6fkg\" (UniqueName: \"kubernetes.io/projected/8d184805-87aa-4026-ac8b-a36076620a10-kube-api-access-s6fkg\") pod \"barbican-55ec-account-create-update-dkz9b\" (UID: \"8d184805-87aa-4026-ac8b-a36076620a10\") " pod="openstack-kuttl-tests/barbican-55ec-account-create-update-dkz9b" Mar 16 16:05:54 crc kubenswrapper[5120]: I0316 16:05:54.579516 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8d184805-87aa-4026-ac8b-a36076620a10-operator-scripts\") pod \"barbican-55ec-account-create-update-dkz9b\" (UID: \"8d184805-87aa-4026-ac8b-a36076620a10\") " pod="openstack-kuttl-tests/barbican-55ec-account-create-update-dkz9b" Mar 16 16:05:54 crc kubenswrapper[5120]: I0316 16:05:54.583831 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-55ec-account-create-update-dkz9b"] Mar 16 16:05:54 crc kubenswrapper[5120]: I0316 16:05:54.588833 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"c1c401a6-a61c-45bf-b9a2-c99abf5bc72e","Type":"ContainerStarted","Data":"3c6173d29d75978a43cf46850703233a0f30a27ee3d27eb15a622e7a358da406"} Mar 16 16:05:54 crc kubenswrapper[5120]: I0316 16:05:54.624030 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 16:05:54 crc kubenswrapper[5120]: I0316 16:05:54.675287 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:05:54 crc kubenswrapper[5120]: I0316 16:05:54.678356 5120 status_manager.go:895] "Failed to get status for pod" podUID="dcd99b91-243d-46cd-beb8-76527d308b62" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 16:05:54 crc kubenswrapper[5120]: I0316 16:05:54.690742 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1cccc0e5-40f8-4ed9-9b3d-f7c667475288" path="/var/lib/kubelet/pods/1cccc0e5-40f8-4ed9-9b3d-f7c667475288/volumes" Mar 16 16:05:54 crc kubenswrapper[5120]: I0316 16:05:54.691636 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="60778046-219c-45d9-baf3-14ec33c76c2d" path="/var/lib/kubelet/pods/60778046-219c-45d9-baf3-14ec33c76c2d/volumes" Mar 16 16:05:54 crc kubenswrapper[5120]: I0316 16:05:54.692236 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8436861d-e102-45b0-8edf-25a8e41fa9e9" path="/var/lib/kubelet/pods/8436861d-e102-45b0-8edf-25a8e41fa9e9/volumes" Mar 16 16:05:54 crc kubenswrapper[5120]: I0316 16:05:54.697334 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9d957ec2-c514-472f-8d88-1d6c6fa2449a" path="/var/lib/kubelet/pods/9d957ec2-c514-472f-8d88-1d6c6fa2449a/volumes" Mar 16 16:05:54 crc kubenswrapper[5120]: I0316 16:05:54.698310 5120 status_manager.go:895] "Failed to get status for pod" podUID="dcd99b91-243d-46cd-beb8-76527d308b62" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 16:05:54 crc kubenswrapper[5120]: I0316 16:05:54.705750 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e2185e65-e56e-4f2e-929e-9caa246e5961-logs\") pod \"e2185e65-e56e-4f2e-929e-9caa246e5961\" (UID: \"e2185e65-e56e-4f2e-929e-9caa246e5961\") " Mar 16 16:05:54 crc kubenswrapper[5120]: I0316 16:05:54.717010 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s6fkg\" (UniqueName: \"kubernetes.io/projected/8d184805-87aa-4026-ac8b-a36076620a10-kube-api-access-s6fkg\") pod \"barbican-55ec-account-create-update-dkz9b\" (UID: \"8d184805-87aa-4026-ac8b-a36076620a10\") " pod="openstack-kuttl-tests/barbican-55ec-account-create-update-dkz9b" Mar 16 16:05:54 crc kubenswrapper[5120]: I0316 16:05:54.717303 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8d184805-87aa-4026-ac8b-a36076620a10-operator-scripts\") pod \"barbican-55ec-account-create-update-dkz9b\" (UID: \"8d184805-87aa-4026-ac8b-a36076620a10\") " pod="openstack-kuttl-tests/barbican-55ec-account-create-update-dkz9b" Mar 16 16:05:54 crc kubenswrapper[5120]: I0316 16:05:54.724186 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"34a68caa-76db-4be4-9ecd-8955435c0e90","Type":"ContainerDied","Data":"e39b1dd50fcafc14aec7bc9438ebf792d0a729e6b113372c1bb024a5217ce754"} Mar 16 16:05:54 crc kubenswrapper[5120]: I0316 16:05:54.724236 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"f8028a79-c5c3-420e-ac48-33a3991aba76","Type":"ContainerStarted","Data":"35ec5a05bbc159911764272ba82d5bc63ef299314eb28a011b42096695ea946d"} Mar 16 16:05:54 crc kubenswrapper[5120]: I0316 16:05:54.724250 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/root-account-create-update-7g7vr"] Mar 16 16:05:54 crc kubenswrapper[5120]: I0316 16:05:54.725337 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dcd99b91-243d-46cd-beb8-76527d308b62" containerName="openstackclient" Mar 16 16:05:54 crc kubenswrapper[5120]: I0316 16:05:54.725349 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="dcd99b91-243d-46cd-beb8-76527d308b62" containerName="openstackclient" Mar 16 16:05:54 crc kubenswrapper[5120]: I0316 16:05:54.725362 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2185e65-e56e-4f2e-929e-9caa246e5961" containerName="barbican-keystone-listener-log" Mar 16 16:05:54 crc kubenswrapper[5120]: I0316 16:05:54.725368 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2185e65-e56e-4f2e-929e-9caa246e5961" containerName="barbican-keystone-listener-log" Mar 16 16:05:54 crc kubenswrapper[5120]: I0316 16:05:54.725395 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2185e65-e56e-4f2e-929e-9caa246e5961" containerName="barbican-keystone-listener" Mar 16 16:05:54 crc kubenswrapper[5120]: I0316 16:05:54.725400 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2185e65-e56e-4f2e-929e-9caa246e5961" containerName="barbican-keystone-listener" Mar 16 16:05:54 crc kubenswrapper[5120]: I0316 16:05:54.725556 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e2185e65-e56e-4f2e-929e-9caa246e5961" containerName="barbican-keystone-listener" Mar 16 16:05:54 crc kubenswrapper[5120]: I0316 16:05:54.725568 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e2185e65-e56e-4f2e-929e-9caa246e5961" containerName="barbican-keystone-listener-log" Mar 16 16:05:54 crc kubenswrapper[5120]: I0316 16:05:54.725580 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="dcd99b91-243d-46cd-beb8-76527d308b62" containerName="openstackclient" Mar 16 16:05:54 crc kubenswrapper[5120]: I0316 16:05:54.727465 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2185e65-e56e-4f2e-929e-9caa246e5961-logs" (OuterVolumeSpecName: "logs") pod "e2185e65-e56e-4f2e-929e-9caa246e5961" (UID: "e2185e65-e56e-4f2e-929e-9caa246e5961"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:05:54 crc kubenswrapper[5120]: I0316 16:05:54.729917 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8d184805-87aa-4026-ac8b-a36076620a10-operator-scripts\") pod \"barbican-55ec-account-create-update-dkz9b\" (UID: \"8d184805-87aa-4026-ac8b-a36076620a10\") " pod="openstack-kuttl-tests/barbican-55ec-account-create-update-dkz9b" Mar 16 16:05:54 crc kubenswrapper[5120]: I0316 16:05:54.730242 5120 scope.go:117] "RemoveContainer" containerID="d3c2d0cc170c0d12ffcf3081d057790b94d54951249a16995141e7f80ac473e6" Mar 16 16:05:54 crc kubenswrapper[5120]: I0316 16:05:54.735668 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:05:54 crc kubenswrapper[5120]: I0316 16:05:54.735795 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-7g7vr" Mar 16 16:05:54 crc kubenswrapper[5120]: I0316 16:05:54.748404 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"openstack-cell1-mariadb-root-db-secret\"" Mar 16 16:05:54 crc kubenswrapper[5120]: I0316 16:05:54.774345 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-7g7vr"] Mar 16 16:05:54 crc kubenswrapper[5120]: I0316 16:05:54.795177 5120 generic.go:358] "Generic (PLEG): container finished" podID="c6ef2171-25f8-43d1-a037-b915f5b77abc" containerID="d08e4507821305fa617df2be4e46ebdc378f0875b915d89ed924026144f26267" exitCode=0 Mar 16 16:05:54 crc kubenswrapper[5120]: I0316 16:05:54.795209 5120 generic.go:358] "Generic (PLEG): container finished" podID="c6ef2171-25f8-43d1-a037-b915f5b77abc" containerID="48de766ec48090227f6df29a7b45a2b202795208666a9ad5390af083fc0cc007" exitCode=2 Mar 16 16:05:54 crc kubenswrapper[5120]: I0316 16:05:54.795216 5120 generic.go:358] "Generic (PLEG): container finished" podID="c6ef2171-25f8-43d1-a037-b915f5b77abc" containerID="3eb73c59c62ea647f400a2728674a5a5fff71ad386b71213f4394dd33c2bc900" exitCode=0 Mar 16 16:05:54 crc kubenswrapper[5120]: I0316 16:05:54.795224 5120 generic.go:358] "Generic (PLEG): container finished" podID="c6ef2171-25f8-43d1-a037-b915f5b77abc" containerID="2d0b86f84ea9cbf53b3f863fadf423c26de96160c88b2c0c460eb8283fe6384c" exitCode=0 Mar 16 16:05:54 crc kubenswrapper[5120]: I0316 16:05:54.795455 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"c6ef2171-25f8-43d1-a037-b915f5b77abc","Type":"ContainerDied","Data":"d08e4507821305fa617df2be4e46ebdc378f0875b915d89ed924026144f26267"} Mar 16 16:05:54 crc kubenswrapper[5120]: I0316 16:05:54.795482 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"c6ef2171-25f8-43d1-a037-b915f5b77abc","Type":"ContainerDied","Data":"48de766ec48090227f6df29a7b45a2b202795208666a9ad5390af083fc0cc007"} Mar 16 16:05:54 crc kubenswrapper[5120]: I0316 16:05:54.795494 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"c6ef2171-25f8-43d1-a037-b915f5b77abc","Type":"ContainerDied","Data":"3eb73c59c62ea647f400a2728674a5a5fff71ad386b71213f4394dd33c2bc900"} Mar 16 16:05:54 crc kubenswrapper[5120]: I0316 16:05:54.795503 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"c6ef2171-25f8-43d1-a037-b915f5b77abc","Type":"ContainerDied","Data":"2d0b86f84ea9cbf53b3f863fadf423c26de96160c88b2c0c460eb8283fe6384c"} Mar 16 16:05:54 crc kubenswrapper[5120]: I0316 16:05:54.825742 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e2185e65-e56e-4f2e-929e-9caa246e5961-config-data\") pod \"e2185e65-e56e-4f2e-929e-9caa246e5961\" (UID: \"e2185e65-e56e-4f2e-929e-9caa246e5961\") " Mar 16 16:05:54 crc kubenswrapper[5120]: I0316 16:05:54.825866 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/e2185e65-e56e-4f2e-929e-9caa246e5961-config-data-custom\") pod \"e2185e65-e56e-4f2e-929e-9caa246e5961\" (UID: \"e2185e65-e56e-4f2e-929e-9caa246e5961\") " Mar 16 16:05:54 crc kubenswrapper[5120]: I0316 16:05:54.825955 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e2185e65-e56e-4f2e-929e-9caa246e5961-combined-ca-bundle\") pod \"e2185e65-e56e-4f2e-929e-9caa246e5961\" (UID: \"e2185e65-e56e-4f2e-929e-9caa246e5961\") " Mar 16 16:05:54 crc kubenswrapper[5120]: I0316 16:05:54.826301 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qxg2f\" (UniqueName: \"kubernetes.io/projected/e2185e65-e56e-4f2e-929e-9caa246e5961-kube-api-access-qxg2f\") pod \"e2185e65-e56e-4f2e-929e-9caa246e5961\" (UID: \"e2185e65-e56e-4f2e-929e-9caa246e5961\") " Mar 16 16:05:54 crc kubenswrapper[5120]: I0316 16:05:54.828123 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/4f18ae61-e496-433a-851f-3ac657fa2455-operator-scripts\") pod \"root-account-create-update-7g7vr\" (UID: \"4f18ae61-e496-433a-851f-3ac657fa2455\") " pod="openstack-kuttl-tests/root-account-create-update-7g7vr" Mar 16 16:05:54 crc kubenswrapper[5120]: I0316 16:05:54.828317 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqnc8\" (UniqueName: \"kubernetes.io/projected/4f18ae61-e496-433a-851f-3ac657fa2455-kube-api-access-qqnc8\") pod \"root-account-create-update-7g7vr\" (UID: \"4f18ae61-e496-433a-851f-3ac657fa2455\") " pod="openstack-kuttl-tests/root-account-create-update-7g7vr" Mar 16 16:05:54 crc kubenswrapper[5120]: I0316 16:05:54.828578 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e2185e65-e56e-4f2e-929e-9caa246e5961-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:54 crc kubenswrapper[5120]: E0316 16:05:54.828734 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-cinder-internal-svc: secret "cert-cinder-internal-svc" not found Mar 16 16:05:54 crc kubenswrapper[5120]: E0316 16:05:54.828828 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8028a79-c5c3-420e-ac48-33a3991aba76-internal-tls-certs podName:f8028a79-c5c3-420e-ac48-33a3991aba76 nodeName:}" failed. No retries permitted until 2026-03-16 16:05:55.328807555 +0000 UTC m=+2057.482739212 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/f8028a79-c5c3-420e-ac48-33a3991aba76-internal-tls-certs") pod "cinder-api-0" (UID: "f8028a79-c5c3-420e-ac48-33a3991aba76") : secret "cert-cinder-internal-svc" not found Mar 16 16:05:54 crc kubenswrapper[5120]: E0316 16:05:54.829098 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-cinder-public-svc: secret "cert-cinder-public-svc" not found Mar 16 16:05:54 crc kubenswrapper[5120]: E0316 16:05:54.829138 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8028a79-c5c3-420e-ac48-33a3991aba76-public-tls-certs podName:f8028a79-c5c3-420e-ac48-33a3991aba76 nodeName:}" failed. No retries permitted until 2026-03-16 16:05:55.329129614 +0000 UTC m=+2057.483061261 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/f8028a79-c5c3-420e-ac48-33a3991aba76-public-tls-certs") pod "cinder-api-0" (UID: "f8028a79-c5c3-420e-ac48-33a3991aba76") : secret "cert-cinder-public-svc" not found Mar 16 16:05:54 crc kubenswrapper[5120]: E0316 16:05:54.829516 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 16:05:54 crc kubenswrapper[5120]: E0316 16:05:54.829582 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8028a79-c5c3-420e-ac48-33a3991aba76-combined-ca-bundle podName:f8028a79-c5c3-420e-ac48-33a3991aba76 nodeName:}" failed. No retries permitted until 2026-03-16 16:05:55.329560635 +0000 UTC m=+2057.483492292 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/f8028a79-c5c3-420e-ac48-33a3991aba76-combined-ca-bundle") pod "cinder-api-0" (UID: "f8028a79-c5c3-420e-ac48-33a3991aba76") : secret "combined-ca-bundle" not found Mar 16 16:05:54 crc kubenswrapper[5120]: I0316 16:05:54.842114 5120 generic.go:358] "Generic (PLEG): container finished" podID="e2185e65-e56e-4f2e-929e-9caa246e5961" containerID="1c74980f647fc3b6602e8abf9607add11294a4ae33e9ef294003251f4db6cb54" exitCode=0 Mar 16 16:05:54 crc kubenswrapper[5120]: I0316 16:05:54.849503 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-7dcb9fc94d-5c4n9" event={"ID":"e2185e65-e56e-4f2e-929e-9caa246e5961","Type":"ContainerDied","Data":"1c74980f647fc3b6602e8abf9607add11294a4ae33e9ef294003251f4db6cb54"} Mar 16 16:05:54 crc kubenswrapper[5120]: I0316 16:05:54.849552 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-7dcb9fc94d-5c4n9" event={"ID":"e2185e65-e56e-4f2e-929e-9caa246e5961","Type":"ContainerDied","Data":"40bd5aa8ffbc011ef8e11f2ed417896e985859c34028c4046dc4d3e420ede635"} Mar 16 16:05:54 crc kubenswrapper[5120]: I0316 16:05:54.861470 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-7dcb9fc94d-5c4n9" Mar 16 16:05:54 crc kubenswrapper[5120]: I0316 16:05:54.902949 5120 scope.go:117] "RemoveContainer" containerID="d6456b18671133be61b3e3aee639a3b98b4bd2c9402ee3e32ee592907357518e" Mar 16 16:05:54 crc kubenswrapper[5120]: I0316 16:05:54.911846 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6fkg\" (UniqueName: \"kubernetes.io/projected/8d184805-87aa-4026-ac8b-a36076620a10-kube-api-access-s6fkg\") pod \"barbican-55ec-account-create-update-dkz9b\" (UID: \"8d184805-87aa-4026-ac8b-a36076620a10\") " pod="openstack-kuttl-tests/barbican-55ec-account-create-update-dkz9b" Mar 16 16:05:54 crc kubenswrapper[5120]: I0316 16:05:54.937084 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qqnc8\" (UniqueName: \"kubernetes.io/projected/4f18ae61-e496-433a-851f-3ac657fa2455-kube-api-access-qqnc8\") pod \"root-account-create-update-7g7vr\" (UID: \"4f18ae61-e496-433a-851f-3ac657fa2455\") " pod="openstack-kuttl-tests/root-account-create-update-7g7vr" Mar 16 16:05:54 crc kubenswrapper[5120]: I0316 16:05:54.937582 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/4f18ae61-e496-433a-851f-3ac657fa2455-operator-scripts\") pod \"root-account-create-update-7g7vr\" (UID: \"4f18ae61-e496-433a-851f-3ac657fa2455\") " pod="openstack-kuttl-tests/root-account-create-update-7g7vr" Mar 16 16:05:54 crc kubenswrapper[5120]: I0316 16:05:54.938444 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/4f18ae61-e496-433a-851f-3ac657fa2455-operator-scripts\") pod \"root-account-create-update-7g7vr\" (UID: \"4f18ae61-e496-433a-851f-3ac657fa2455\") " pod="openstack-kuttl-tests/root-account-create-update-7g7vr" Mar 16 16:05:54 crc kubenswrapper[5120]: I0316 16:05:54.950129 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-6354-account-create-update-6wv9h"] Mar 16 16:05:54 crc kubenswrapper[5120]: I0316 16:05:54.950151 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2185e65-e56e-4f2e-929e-9caa246e5961-kube-api-access-qxg2f" (OuterVolumeSpecName: "kube-api-access-qxg2f") pod "e2185e65-e56e-4f2e-929e-9caa246e5961" (UID: "e2185e65-e56e-4f2e-929e-9caa246e5961"). InnerVolumeSpecName "kube-api-access-qxg2f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:05:54 crc kubenswrapper[5120]: I0316 16:05:54.951804 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e2185e65-e56e-4f2e-929e-9caa246e5961-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "e2185e65-e56e-4f2e-929e-9caa246e5961" (UID: "e2185e65-e56e-4f2e-929e-9caa246e5961"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:55 crc kubenswrapper[5120]: I0316 16:05:55.075862 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qxg2f\" (UniqueName: \"kubernetes.io/projected/e2185e65-e56e-4f2e-929e-9caa246e5961-kube-api-access-qxg2f\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:55 crc kubenswrapper[5120]: I0316 16:05:55.085898 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/e2185e65-e56e-4f2e-929e-9caa246e5961-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:55 crc kubenswrapper[5120]: I0316 16:05:55.086606 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqnc8\" (UniqueName: \"kubernetes.io/projected/4f18ae61-e496-433a-851f-3ac657fa2455-kube-api-access-qqnc8\") pod \"root-account-create-update-7g7vr\" (UID: \"4f18ae61-e496-433a-851f-3ac657fa2455\") " pod="openstack-kuttl-tests/root-account-create-update-7g7vr" Mar 16 16:05:55 crc kubenswrapper[5120]: I0316 16:05:55.101162 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-7g7vr" Mar 16 16:05:55 crc kubenswrapper[5120]: I0316 16:05:55.149712 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e2185e65-e56e-4f2e-929e-9caa246e5961-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e2185e65-e56e-4f2e-929e-9caa246e5961" (UID: "e2185e65-e56e-4f2e-929e-9caa246e5961"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:55 crc kubenswrapper[5120]: I0316 16:05:55.165856 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-6354-account-create-update-6wv9h"] Mar 16 16:05:55 crc kubenswrapper[5120]: I0316 16:05:55.167623 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e2185e65-e56e-4f2e-929e-9caa246e5961-config-data" (OuterVolumeSpecName: "config-data") pod "e2185e65-e56e-4f2e-929e-9caa246e5961" (UID: "e2185e65-e56e-4f2e-929e-9caa246e5961"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:55 crc kubenswrapper[5120]: I0316 16:05:55.190661 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e2185e65-e56e-4f2e-929e-9caa246e5961-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:55 crc kubenswrapper[5120]: I0316 16:05:55.214599 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e2185e65-e56e-4f2e-929e-9caa246e5961-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:55 crc kubenswrapper[5120]: I0316 16:05:55.190947 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 16:05:55 crc kubenswrapper[5120]: I0316 16:05:55.214673 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-c16c-account-create-update-548pc"] Mar 16 16:05:55 crc kubenswrapper[5120]: I0316 16:05:55.207486 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-55ec-account-create-update-dkz9b" Mar 16 16:05:55 crc kubenswrapper[5120]: I0316 16:05:55.216031 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podUID="93ddd6a0-2403-4b9b-9bc8-e5ac0592b1bc" containerName="openstack-network-exporter" containerID="cri-o://6762026b3241e8edba0db7da5d24e03df13f417225ee8a3fa22f7ee217cc1b80" gracePeriod=300 Mar 16 16:05:55 crc kubenswrapper[5120]: I0316 16:05:55.231828 5120 scope.go:117] "RemoveContainer" containerID="1c74980f647fc3b6602e8abf9607add11294a4ae33e9ef294003251f4db6cb54" Mar 16 16:05:55 crc kubenswrapper[5120]: I0316 16:05:55.232586 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:05:55 crc kubenswrapper[5120]: I0316 16:05:55.261177 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-c16c-account-create-update-548pc"] Mar 16 16:05:55 crc kubenswrapper[5120]: I0316 16:05:55.299226 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:05:55 crc kubenswrapper[5120]: I0316 16:05:55.349709 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-rqcxz"] Mar 16 16:05:55 crc kubenswrapper[5120]: I0316 16:05:55.372833 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 16:05:55 crc kubenswrapper[5120]: I0316 16:05:55.404447 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-59d2-account-create-update-v497d"] Mar 16 16:05:55 crc kubenswrapper[5120]: I0316 16:05:55.414882 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-rqcxz"] Mar 16 16:05:55 crc kubenswrapper[5120]: E0316 16:05:55.422725 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-cinder-internal-svc: secret "cert-cinder-internal-svc" not found Mar 16 16:05:55 crc kubenswrapper[5120]: E0316 16:05:55.422819 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8028a79-c5c3-420e-ac48-33a3991aba76-internal-tls-certs podName:f8028a79-c5c3-420e-ac48-33a3991aba76 nodeName:}" failed. No retries permitted until 2026-03-16 16:05:56.422801112 +0000 UTC m=+2058.576732769 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/f8028a79-c5c3-420e-ac48-33a3991aba76-internal-tls-certs") pod "cinder-api-0" (UID: "f8028a79-c5c3-420e-ac48-33a3991aba76") : secret "cert-cinder-internal-svc" not found Mar 16 16:05:55 crc kubenswrapper[5120]: E0316 16:05:55.422878 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-cinder-public-svc: secret "cert-cinder-public-svc" not found Mar 16 16:05:55 crc kubenswrapper[5120]: E0316 16:05:55.422899 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8028a79-c5c3-420e-ac48-33a3991aba76-public-tls-certs podName:f8028a79-c5c3-420e-ac48-33a3991aba76 nodeName:}" failed. No retries permitted until 2026-03-16 16:05:56.422893025 +0000 UTC m=+2058.576824682 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/f8028a79-c5c3-420e-ac48-33a3991aba76-public-tls-certs") pod "cinder-api-0" (UID: "f8028a79-c5c3-420e-ac48-33a3991aba76") : secret "cert-cinder-public-svc" not found Mar 16 16:05:55 crc kubenswrapper[5120]: E0316 16:05:55.422949 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 16:05:55 crc kubenswrapper[5120]: E0316 16:05:55.423049 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8028a79-c5c3-420e-ac48-33a3991aba76-combined-ca-bundle podName:f8028a79-c5c3-420e-ac48-33a3991aba76 nodeName:}" failed. No retries permitted until 2026-03-16 16:05:56.423028168 +0000 UTC m=+2058.576959815 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/f8028a79-c5c3-420e-ac48-33a3991aba76-combined-ca-bundle") pod "cinder-api-0" (UID: "f8028a79-c5c3-420e-ac48-33a3991aba76") : secret "combined-ca-bundle" not found Mar 16 16:05:55 crc kubenswrapper[5120]: I0316 16:05:55.432032 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-59d2-account-create-update-v497d"] Mar 16 16:05:55 crc kubenswrapper[5120]: I0316 16:05:55.439382 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:05:55 crc kubenswrapper[5120]: I0316 16:05:55.439838 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-api-0" podStartSLOduration=7.4398175460000004 podStartE2EDuration="7.439817546s" podCreationTimestamp="2026-03-16 16:05:48 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:05:54.92720334 +0000 UTC m=+2057.081135007" watchObservedRunningTime="2026-03-16 16:05:55.439817546 +0000 UTC m=+2057.593749203" Mar 16 16:05:55 crc kubenswrapper[5120]: I0316 16:05:55.446314 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-857694d5fb-pdlqj" podUID="bb0a18f2-a95f-4ee1-b6a6-d0400f70760f" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.1.190:9311/healthcheck\": read tcp 10.217.0.2:46396->10.217.1.190:9311: read: connection reset by peer" Mar 16 16:05:55 crc kubenswrapper[5120]: I0316 16:05:55.446391 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-857694d5fb-pdlqj" podUID="bb0a18f2-a95f-4ee1-b6a6-d0400f70760f" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.1.190:9311/healthcheck\": read tcp 10.217.0.2:46404->10.217.1.190:9311: read: connection reset by peer" Mar 16 16:05:55 crc kubenswrapper[5120]: I0316 16:05:55.463668 5120 scope.go:117] "RemoveContainer" containerID="93af2507717d78fa1e06041087d6f02fc16b229867935621c914a9dd2f241aa8" Mar 16 16:05:55 crc kubenswrapper[5120]: E0316 16:05:55.485272 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="eaa8e905618c3287f78bbdda9d5b8e1d7a9ea191e193e106e08869701479bec0" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:05:55 crc kubenswrapper[5120]: E0316 16:05:55.491338 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="eaa8e905618c3287f78bbdda9d5b8e1d7a9ea191e193e106e08869701479bec0" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:05:55 crc kubenswrapper[5120]: I0316 16:05:55.491513 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 16:05:55 crc kubenswrapper[5120]: I0316 16:05:55.491868 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podUID="ba9461bf-d0b6-45c1-bacf-eede3329fba0" containerName="openstack-network-exporter" containerID="cri-o://1f2acf4bcbbfcbd0929a426315ec1f92411324559d0fd28dc4a7096a568d7d88" gracePeriod=300 Mar 16 16:05:55 crc kubenswrapper[5120]: E0316 16:05:55.494409 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="eaa8e905618c3287f78bbdda9d5b8e1d7a9ea191e193e106e08869701479bec0" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:05:55 crc kubenswrapper[5120]: E0316 16:05:55.494458 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="683d3459-b9fc-478c-b74e-c1a09fd45e4d" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 16:05:55 crc kubenswrapper[5120]: I0316 16:05:55.507251 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 16:05:55 crc kubenswrapper[5120]: I0316 16:05:55.508506 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovn-northd-0" podUID="cf2c0d02-34db-44f6-b7e5-625a82333785" containerName="ovn-northd" containerID="cri-o://17c9dde48e428543edf8e13201760d950879e0829d025bbcff1b1bebc7a0d973" gracePeriod=30 Mar 16 16:05:55 crc kubenswrapper[5120]: I0316 16:05:55.508492 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovn-northd-0" podUID="cf2c0d02-34db-44f6-b7e5-625a82333785" containerName="openstack-network-exporter" containerID="cri-o://b03cf446275a66219f4644fb85b109bab0f36b29c41995353e1cfd1b7896143f" gracePeriod=30 Mar 16 16:05:55 crc kubenswrapper[5120]: I0316 16:05:55.524561 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c6ef2171-25f8-43d1-a037-b915f5b77abc-scripts\") pod \"c6ef2171-25f8-43d1-a037-b915f5b77abc\" (UID: \"c6ef2171-25f8-43d1-a037-b915f5b77abc\") " Mar 16 16:05:55 crc kubenswrapper[5120]: I0316 16:05:55.524676 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c6ef2171-25f8-43d1-a037-b915f5b77abc-combined-ca-bundle\") pod \"c6ef2171-25f8-43d1-a037-b915f5b77abc\" (UID: \"c6ef2171-25f8-43d1-a037-b915f5b77abc\") " Mar 16 16:05:55 crc kubenswrapper[5120]: I0316 16:05:55.524698 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c6ef2171-25f8-43d1-a037-b915f5b77abc-config-data\") pod \"c6ef2171-25f8-43d1-a037-b915f5b77abc\" (UID: \"c6ef2171-25f8-43d1-a037-b915f5b77abc\") " Mar 16 16:05:55 crc kubenswrapper[5120]: I0316 16:05:55.524746 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zwb7w\" (UniqueName: \"kubernetes.io/projected/c6ef2171-25f8-43d1-a037-b915f5b77abc-kube-api-access-zwb7w\") pod \"c6ef2171-25f8-43d1-a037-b915f5b77abc\" (UID: \"c6ef2171-25f8-43d1-a037-b915f5b77abc\") " Mar 16 16:05:55 crc kubenswrapper[5120]: I0316 16:05:55.524820 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/c6ef2171-25f8-43d1-a037-b915f5b77abc-sg-core-conf-yaml\") pod \"c6ef2171-25f8-43d1-a037-b915f5b77abc\" (UID: \"c6ef2171-25f8-43d1-a037-b915f5b77abc\") " Mar 16 16:05:55 crc kubenswrapper[5120]: I0316 16:05:55.524971 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c6ef2171-25f8-43d1-a037-b915f5b77abc-log-httpd\") pod \"c6ef2171-25f8-43d1-a037-b915f5b77abc\" (UID: \"c6ef2171-25f8-43d1-a037-b915f5b77abc\") " Mar 16 16:05:55 crc kubenswrapper[5120]: I0316 16:05:55.525047 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/c6ef2171-25f8-43d1-a037-b915f5b77abc-ceilometer-tls-certs\") pod \"c6ef2171-25f8-43d1-a037-b915f5b77abc\" (UID: \"c6ef2171-25f8-43d1-a037-b915f5b77abc\") " Mar 16 16:05:55 crc kubenswrapper[5120]: I0316 16:05:55.525063 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c6ef2171-25f8-43d1-a037-b915f5b77abc-run-httpd\") pod \"c6ef2171-25f8-43d1-a037-b915f5b77abc\" (UID: \"c6ef2171-25f8-43d1-a037-b915f5b77abc\") " Mar 16 16:05:55 crc kubenswrapper[5120]: I0316 16:05:55.527551 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6ef2171-25f8-43d1-a037-b915f5b77abc-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "c6ef2171-25f8-43d1-a037-b915f5b77abc" (UID: "c6ef2171-25f8-43d1-a037-b915f5b77abc"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:05:55 crc kubenswrapper[5120]: I0316 16:05:55.531628 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-b179-account-create-update-fmjzp"] Mar 16 16:05:55 crc kubenswrapper[5120]: I0316 16:05:55.533985 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6ef2171-25f8-43d1-a037-b915f5b77abc-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "c6ef2171-25f8-43d1-a037-b915f5b77abc" (UID: "c6ef2171-25f8-43d1-a037-b915f5b77abc"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:05:55 crc kubenswrapper[5120]: I0316 16:05:55.548361 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c6ef2171-25f8-43d1-a037-b915f5b77abc-scripts" (OuterVolumeSpecName: "scripts") pod "c6ef2171-25f8-43d1-a037-b915f5b77abc" (UID: "c6ef2171-25f8-43d1-a037-b915f5b77abc"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:55 crc kubenswrapper[5120]: I0316 16:05:55.552812 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c6ef2171-25f8-43d1-a037-b915f5b77abc-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:55 crc kubenswrapper[5120]: I0316 16:05:55.552843 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c6ef2171-25f8-43d1-a037-b915f5b77abc-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:55 crc kubenswrapper[5120]: I0316 16:05:55.552853 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c6ef2171-25f8-43d1-a037-b915f5b77abc-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:55 crc kubenswrapper[5120]: E0316 16:05:55.553937 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-config-data: configmap "rabbitmq-config-data" not found Mar 16 16:05:55 crc kubenswrapper[5120]: E0316 16:05:55.553999 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/733010bf-0110-4a60-adf6-0f0ee336e96e-config-data podName:733010bf-0110-4a60-adf6-0f0ee336e96e nodeName:}" failed. No retries permitted until 2026-03-16 16:05:56.053982682 +0000 UTC m=+2058.207914329 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/733010bf-0110-4a60-adf6-0f0ee336e96e-config-data") pod "rabbitmq-server-0" (UID: "733010bf-0110-4a60-adf6-0f0ee336e96e") : configmap "rabbitmq-config-data" not found Mar 16 16:05:55 crc kubenswrapper[5120]: I0316 16:05:55.576068 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-b179-account-create-update-fmjzp"] Mar 16 16:05:55 crc kubenswrapper[5120]: I0316 16:05:55.599370 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-8c74-account-create-update-jw9ct"] Mar 16 16:05:55 crc kubenswrapper[5120]: I0316 16:05:55.605932 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6ef2171-25f8-43d1-a037-b915f5b77abc-kube-api-access-zwb7w" (OuterVolumeSpecName: "kube-api-access-zwb7w") pod "c6ef2171-25f8-43d1-a037-b915f5b77abc" (UID: "c6ef2171-25f8-43d1-a037-b915f5b77abc"). InnerVolumeSpecName "kube-api-access-zwb7w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:05:55 crc kubenswrapper[5120]: I0316 16:05:55.606586 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podUID="93ddd6a0-2403-4b9b-9bc8-e5ac0592b1bc" containerName="ovsdbserver-nb" containerID="cri-o://6e985df37ce55e86651cfeb329ddbafb296639ab6b1d1dbbdab70c1607984fe6" gracePeriod=300 Mar 16 16:05:55 crc kubenswrapper[5120]: I0316 16:05:55.606894 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-8c74-account-create-update-jw9ct"] Mar 16 16:05:55 crc kubenswrapper[5120]: I0316 16:05:55.637317 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-319f-account-create-update-gr29k"] Mar 16 16:05:55 crc kubenswrapper[5120]: I0316 16:05:55.658585 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zwb7w\" (UniqueName: \"kubernetes.io/projected/c6ef2171-25f8-43d1-a037-b915f5b77abc-kube-api-access-zwb7w\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:55 crc kubenswrapper[5120]: I0316 16:05:55.676259 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c6ef2171-25f8-43d1-a037-b915f5b77abc-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "c6ef2171-25f8-43d1-a037-b915f5b77abc" (UID: "c6ef2171-25f8-43d1-a037-b915f5b77abc"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:55 crc kubenswrapper[5120]: I0316 16:05:55.682399 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-319f-account-create-update-gr29k"] Mar 16 16:05:55 crc kubenswrapper[5120]: I0316 16:05:55.691443 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-znw74"] Mar 16 16:05:55 crc kubenswrapper[5120]: I0316 16:05:55.723946 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podUID="ba9461bf-d0b6-45c1-bacf-eede3329fba0" containerName="ovsdbserver-sb" containerID="cri-o://3678fb8176154d7514722017b6b95e451fd401e53bb4aa5093bc1a67d432bada" gracePeriod=300 Mar 16 16:05:55 crc kubenswrapper[5120]: I0316 16:05:55.730188 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-znw74"] Mar 16 16:05:55 crc kubenswrapper[5120]: I0316 16:05:55.760334 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/c6ef2171-25f8-43d1-a037-b915f5b77abc-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:55 crc kubenswrapper[5120]: I0316 16:05:55.774005 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-6x6k9"] Mar 16 16:05:55 crc kubenswrapper[5120]: I0316 16:05:55.789861 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-dc96-account-create-update-rpv8l"] Mar 16 16:05:55 crc kubenswrapper[5120]: I0316 16:05:55.795508 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c6ef2171-25f8-43d1-a037-b915f5b77abc-ceilometer-tls-certs" (OuterVolumeSpecName: "ceilometer-tls-certs") pod "c6ef2171-25f8-43d1-a037-b915f5b77abc" (UID: "c6ef2171-25f8-43d1-a037-b915f5b77abc"). InnerVolumeSpecName "ceilometer-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:55 crc kubenswrapper[5120]: E0316 16:05:55.811100 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 6e985df37ce55e86651cfeb329ddbafb296639ab6b1d1dbbdab70c1607984fe6 is running failed: container process not found" containerID="6e985df37ce55e86651cfeb329ddbafb296639ab6b1d1dbbdab70c1607984fe6" cmd=["/usr/bin/pidof","ovsdb-server"] Mar 16 16:05:55 crc kubenswrapper[5120]: E0316 16:05:55.812520 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 6e985df37ce55e86651cfeb329ddbafb296639ab6b1d1dbbdab70c1607984fe6 is running failed: container process not found" containerID="6e985df37ce55e86651cfeb329ddbafb296639ab6b1d1dbbdab70c1607984fe6" cmd=["/usr/bin/pidof","ovsdb-server"] Mar 16 16:05:55 crc kubenswrapper[5120]: I0316 16:05:55.812823 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-6x6k9"] Mar 16 16:05:55 crc kubenswrapper[5120]: E0316 16:05:55.813791 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 6e985df37ce55e86651cfeb329ddbafb296639ab6b1d1dbbdab70c1607984fe6 is running failed: container process not found" containerID="6e985df37ce55e86651cfeb329ddbafb296639ab6b1d1dbbdab70c1607984fe6" cmd=["/usr/bin/pidof","ovsdb-server"] Mar 16 16:05:55 crc kubenswrapper[5120]: E0316 16:05:55.813821 5120 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 6e985df37ce55e86651cfeb329ddbafb296639ab6b1d1dbbdab70c1607984fe6 is running failed: container process not found" probeType="Readiness" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podUID="93ddd6a0-2403-4b9b-9bc8-e5ac0592b1bc" containerName="ovsdbserver-nb" probeResult="unknown" Mar 16 16:05:55 crc kubenswrapper[5120]: I0316 16:05:55.816282 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-dc96-account-create-update-rpv8l"] Mar 16 16:05:55 crc kubenswrapper[5120]: I0316 16:05:55.830346 5120 scope.go:117] "RemoveContainer" containerID="1c74980f647fc3b6602e8abf9607add11294a4ae33e9ef294003251f4db6cb54" Mar 16 16:05:55 crc kubenswrapper[5120]: E0316 16:05:55.843819 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c74980f647fc3b6602e8abf9607add11294a4ae33e9ef294003251f4db6cb54\": container with ID starting with 1c74980f647fc3b6602e8abf9607add11294a4ae33e9ef294003251f4db6cb54 not found: ID does not exist" containerID="1c74980f647fc3b6602e8abf9607add11294a4ae33e9ef294003251f4db6cb54" Mar 16 16:05:55 crc kubenswrapper[5120]: I0316 16:05:55.843862 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c74980f647fc3b6602e8abf9607add11294a4ae33e9ef294003251f4db6cb54"} err="failed to get container status \"1c74980f647fc3b6602e8abf9607add11294a4ae33e9ef294003251f4db6cb54\": rpc error: code = NotFound desc = could not find container \"1c74980f647fc3b6602e8abf9607add11294a4ae33e9ef294003251f4db6cb54\": container with ID starting with 1c74980f647fc3b6602e8abf9607add11294a4ae33e9ef294003251f4db6cb54 not found: ID does not exist" Mar 16 16:05:55 crc kubenswrapper[5120]: I0316 16:05:55.843886 5120 scope.go:117] "RemoveContainer" containerID="93af2507717d78fa1e06041087d6f02fc16b229867935621c914a9dd2f241aa8" Mar 16 16:05:55 crc kubenswrapper[5120]: E0316 16:05:55.846299 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93af2507717d78fa1e06041087d6f02fc16b229867935621c914a9dd2f241aa8\": container with ID starting with 93af2507717d78fa1e06041087d6f02fc16b229867935621c914a9dd2f241aa8 not found: ID does not exist" containerID="93af2507717d78fa1e06041087d6f02fc16b229867935621c914a9dd2f241aa8" Mar 16 16:05:55 crc kubenswrapper[5120]: I0316 16:05:55.846330 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93af2507717d78fa1e06041087d6f02fc16b229867935621c914a9dd2f241aa8"} err="failed to get container status \"93af2507717d78fa1e06041087d6f02fc16b229867935621c914a9dd2f241aa8\": rpc error: code = NotFound desc = could not find container \"93af2507717d78fa1e06041087d6f02fc16b229867935621c914a9dd2f241aa8\": container with ID starting with 93af2507717d78fa1e06041087d6f02fc16b229867935621c914a9dd2f241aa8 not found: ID does not exist" Mar 16 16:05:55 crc kubenswrapper[5120]: I0316 16:05:55.853200 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-x2wb5"] Mar 16 16:05:55 crc kubenswrapper[5120]: I0316 16:05:55.862269 5120 reconciler_common.go:299] "Volume detached for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/c6ef2171-25f8-43d1-a037-b915f5b77abc-ceilometer-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:55 crc kubenswrapper[5120]: I0316 16:05:55.891477 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-x2wb5"] Mar 16 16:05:55 crc kubenswrapper[5120]: I0316 16:05:55.911143 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-5zjn7"] Mar 16 16:05:55 crc kubenswrapper[5120]: I0316 16:05:55.949088 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:05:55 crc kubenswrapper[5120]: I0316 16:05:55.949096 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"c6ef2171-25f8-43d1-a037-b915f5b77abc","Type":"ContainerDied","Data":"eeea894f1003e772f79c479d2d9e54b500d1a02ac928cf33d99ae98b75d8bf79"} Mar 16 16:05:55 crc kubenswrapper[5120]: I0316 16:05:55.949340 5120 scope.go:117] "RemoveContainer" containerID="d08e4507821305fa617df2be4e46ebdc378f0875b915d89ed924026144f26267" Mar 16 16:05:55 crc kubenswrapper[5120]: I0316 16:05:55.974051 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-5zjn7"] Mar 16 16:05:55 crc kubenswrapper[5120]: I0316 16:05:55.992871 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_93ddd6a0-2403-4b9b-9bc8-e5ac0592b1bc/ovsdbserver-nb/0.log" Mar 16 16:05:55 crc kubenswrapper[5120]: I0316 16:05:55.992914 5120 generic.go:358] "Generic (PLEG): container finished" podID="93ddd6a0-2403-4b9b-9bc8-e5ac0592b1bc" containerID="6762026b3241e8edba0db7da5d24e03df13f417225ee8a3fa22f7ee217cc1b80" exitCode=2 Mar 16 16:05:55 crc kubenswrapper[5120]: I0316 16:05:55.992931 5120 generic.go:358] "Generic (PLEG): container finished" podID="93ddd6a0-2403-4b9b-9bc8-e5ac0592b1bc" containerID="6e985df37ce55e86651cfeb329ddbafb296639ab6b1d1dbbdab70c1607984fe6" exitCode=143 Mar 16 16:05:55 crc kubenswrapper[5120]: I0316 16:05:55.993235 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"93ddd6a0-2403-4b9b-9bc8-e5ac0592b1bc","Type":"ContainerDied","Data":"6762026b3241e8edba0db7da5d24e03df13f417225ee8a3fa22f7ee217cc1b80"} Mar 16 16:05:55 crc kubenswrapper[5120]: I0316 16:05:55.993260 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"93ddd6a0-2403-4b9b-9bc8-e5ac0592b1bc","Type":"ContainerDied","Data":"6e985df37ce55e86651cfeb329ddbafb296639ab6b1d1dbbdab70c1607984fe6"} Mar 16 16:05:55 crc kubenswrapper[5120]: I0316 16:05:55.994692 5120 scope.go:117] "RemoveContainer" containerID="48de766ec48090227f6df29a7b45a2b202795208666a9ad5390af083fc0cc007" Mar 16 16:05:56 crc kubenswrapper[5120]: I0316 16:05:56.003938 5120 generic.go:358] "Generic (PLEG): container finished" podID="bb0a18f2-a95f-4ee1-b6a6-d0400f70760f" containerID="6f1d0f5762f66532294471c478da1e90478aa8e63f3a52ffb5466af1e5e246c7" exitCode=0 Mar 16 16:05:56 crc kubenswrapper[5120]: I0316 16:05:56.004135 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-857694d5fb-pdlqj" event={"ID":"bb0a18f2-a95f-4ee1-b6a6-d0400f70760f","Type":"ContainerDied","Data":"6f1d0f5762f66532294471c478da1e90478aa8e63f3a52ffb5466af1e5e246c7"} Mar 16 16:05:56 crc kubenswrapper[5120]: I0316 16:05:56.004705 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-rlkfm"] Mar 16 16:05:56 crc kubenswrapper[5120]: I0316 16:05:56.024818 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-rlkfm"] Mar 16 16:05:56 crc kubenswrapper[5120]: I0316 16:05:56.028886 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"c1c401a6-a61c-45bf-b9a2-c99abf5bc72e","Type":"ContainerStarted","Data":"55f7c0a8dd3fb411516491f25d8f37988d6b1a6048217e2cb2d9a1a04990ab30"} Mar 16 16:05:56 crc kubenswrapper[5120]: I0316 16:05:56.051414 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c6ef2171-25f8-43d1-a037-b915f5b77abc-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "c6ef2171-25f8-43d1-a037-b915f5b77abc" (UID: "c6ef2171-25f8-43d1-a037-b915f5b77abc"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:56 crc kubenswrapper[5120]: I0316 16:05:56.053928 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_ba9461bf-d0b6-45c1-bacf-eede3329fba0/ovsdbserver-sb/0.log" Mar 16 16:05:56 crc kubenswrapper[5120]: I0316 16:05:56.053994 5120 generic.go:358] "Generic (PLEG): container finished" podID="ba9461bf-d0b6-45c1-bacf-eede3329fba0" containerID="1f2acf4bcbbfcbd0929a426315ec1f92411324559d0fd28dc4a7096a568d7d88" exitCode=2 Mar 16 16:05:56 crc kubenswrapper[5120]: I0316 16:05:56.054181 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"ba9461bf-d0b6-45c1-bacf-eede3329fba0","Type":"ContainerDied","Data":"1f2acf4bcbbfcbd0929a426315ec1f92411324559d0fd28dc4a7096a568d7d88"} Mar 16 16:05:56 crc kubenswrapper[5120]: I0316 16:05:56.078894 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c6ef2171-25f8-43d1-a037-b915f5b77abc-config-data" (OuterVolumeSpecName: "config-data") pod "c6ef2171-25f8-43d1-a037-b915f5b77abc" (UID: "c6ef2171-25f8-43d1-a037-b915f5b77abc"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:56 crc kubenswrapper[5120]: I0316 16:05:56.088629 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-k4gq4"] Mar 16 16:05:56 crc kubenswrapper[5120]: I0316 16:05:56.102720 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c6ef2171-25f8-43d1-a037-b915f5b77abc-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:56 crc kubenswrapper[5120]: I0316 16:05:56.102747 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c6ef2171-25f8-43d1-a037-b915f5b77abc-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:56 crc kubenswrapper[5120]: E0316 16:05:56.102821 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-config-data: configmap "rabbitmq-config-data" not found Mar 16 16:05:56 crc kubenswrapper[5120]: E0316 16:05:56.102865 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/733010bf-0110-4a60-adf6-0f0ee336e96e-config-data podName:733010bf-0110-4a60-adf6-0f0ee336e96e nodeName:}" failed. No retries permitted until 2026-03-16 16:05:57.102851648 +0000 UTC m=+2059.256783305 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/733010bf-0110-4a60-adf6-0f0ee336e96e-config-data") pod "rabbitmq-server-0" (UID: "733010bf-0110-4a60-adf6-0f0ee336e96e") : configmap "rabbitmq-config-data" not found Mar 16 16:05:56 crc kubenswrapper[5120]: I0316 16:05:56.106853 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/nova-api-0" podUID="dbb06351-e6e7-4a49-a941-33b16fc6206d" containerName="nova-api-log" probeResult="failure" output="Get \"https://10.217.1.176:8774/\": context deadline exceeded" Mar 16 16:05:56 crc kubenswrapper[5120]: I0316 16:05:56.118149 5120 generic.go:358] "Generic (PLEG): container finished" podID="cf2c0d02-34db-44f6-b7e5-625a82333785" containerID="b03cf446275a66219f4644fb85b109bab0f36b29c41995353e1cfd1b7896143f" exitCode=2 Mar 16 16:05:56 crc kubenswrapper[5120]: I0316 16:05:56.118492 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"cf2c0d02-34db-44f6-b7e5-625a82333785","Type":"ContainerDied","Data":"b03cf446275a66219f4644fb85b109bab0f36b29c41995353e1cfd1b7896143f"} Mar 16 16:05:56 crc kubenswrapper[5120]: I0316 16:05:56.123992 5120 kubelet_pods.go:1019] "Unable to retrieve pull secret, the image pull may not succeed." pod="openstack-kuttl-tests/cinder-api-0" secret="" err="secret \"cinder-cinder-dockercfg-zzbgg\" not found" Mar 16 16:05:56 crc kubenswrapper[5120]: I0316 16:05:56.149901 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-k4gq4"] Mar 16 16:05:56 crc kubenswrapper[5120]: I0316 16:05:56.184819 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-gqccg"] Mar 16 16:05:56 crc kubenswrapper[5120]: I0316 16:05:56.219985 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-gqccg"] Mar 16 16:05:56 crc kubenswrapper[5120]: I0316 16:05:56.231701 5120 scope.go:117] "RemoveContainer" containerID="3eb73c59c62ea647f400a2728674a5a5fff71ad386b71213f4394dd33c2bc900" Mar 16 16:05:56 crc kubenswrapper[5120]: I0316 16:05:56.258440 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 16:05:56 crc kubenswrapper[5120]: I0316 16:05:56.259345 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="7e01ce77-a7e7-4f90-880f-fb2aa9b506a0" containerName="account-server" containerID="cri-o://9e8ac2d972fd2f48d81b09afc5e8f49bb8db2874d893c57e7a8c058fd36b3ead" gracePeriod=30 Mar 16 16:05:56 crc kubenswrapper[5120]: I0316 16:05:56.259558 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="7e01ce77-a7e7-4f90-880f-fb2aa9b506a0" containerName="container-updater" containerID="cri-o://2e380b12d073a5002c1e5dd47b9250956676752c0348be88c5d0494c0816ca54" gracePeriod=30 Mar 16 16:05:56 crc kubenswrapper[5120]: I0316 16:05:56.260447 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="7e01ce77-a7e7-4f90-880f-fb2aa9b506a0" containerName="object-replicator" containerID="cri-o://9dacb1521b7a04a287e3368f3170f4c5d5387fe4efa3027e858a14615bc08d5b" gracePeriod=30 Mar 16 16:05:56 crc kubenswrapper[5120]: I0316 16:05:56.260521 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="7e01ce77-a7e7-4f90-880f-fb2aa9b506a0" containerName="object-auditor" containerID="cri-o://10fa8c7b4b871978347408abb409b476cfd8fd7a2f441f3a90024ad00442c1b6" gracePeriod=30 Mar 16 16:05:56 crc kubenswrapper[5120]: I0316 16:05:56.260029 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="7e01ce77-a7e7-4f90-880f-fb2aa9b506a0" containerName="container-server" containerID="cri-o://aa74658997f4ba65955badab309e4d15c34829a78f5c27ce74c840cd5aab7dc5" gracePeriod=30 Mar 16 16:05:56 crc kubenswrapper[5120]: I0316 16:05:56.260045 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="7e01ce77-a7e7-4f90-880f-fb2aa9b506a0" containerName="account-reaper" containerID="cri-o://e4e13714df25c26e40c47bd0a068052ffb840c737d71ada600d65029e264bda3" gracePeriod=30 Mar 16 16:05:56 crc kubenswrapper[5120]: I0316 16:05:56.260080 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="7e01ce77-a7e7-4f90-880f-fb2aa9b506a0" containerName="account-auditor" containerID="cri-o://1624b7e64adc42a87208b2c700ca76213393c6c3c5d8baa5d38a875f647eae87" gracePeriod=30 Mar 16 16:05:56 crc kubenswrapper[5120]: I0316 16:05:56.260094 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="7e01ce77-a7e7-4f90-880f-fb2aa9b506a0" containerName="account-replicator" containerID="cri-o://24b51644c8c35d60eb1d19875575dbadbac7c2899aad1712fe22e9e2cc1c8a0d" gracePeriod=30 Mar 16 16:05:56 crc kubenswrapper[5120]: I0316 16:05:56.260186 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="7e01ce77-a7e7-4f90-880f-fb2aa9b506a0" containerName="object-updater" containerID="cri-o://176e1b8679f186bfa7c613dd56d177361af47feab586da3825ca07c140f9e8aa" gracePeriod=30 Mar 16 16:05:56 crc kubenswrapper[5120]: I0316 16:05:56.260207 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="7e01ce77-a7e7-4f90-880f-fb2aa9b506a0" containerName="swift-recon-cron" containerID="cri-o://de9532efdc63b1e3b8ca32f670ae9e1deb9f362ce371660def5737aa8339a1dd" gracePeriod=30 Mar 16 16:05:56 crc kubenswrapper[5120]: I0316 16:05:56.260230 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="7e01ce77-a7e7-4f90-880f-fb2aa9b506a0" containerName="rsync" containerID="cri-o://07d1780c3ac674887e98e6e457d571c406a7ee983f0a91f7bfd134c125da3d03" gracePeriod=30 Mar 16 16:05:56 crc kubenswrapper[5120]: I0316 16:05:56.260363 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="7e01ce77-a7e7-4f90-880f-fb2aa9b506a0" containerName="object-expirer" containerID="cri-o://6819b2fc19957c0cc9ecf211d06ee6cd10c1ec89e57fa8e1c6f8f34a4272144a" gracePeriod=30 Mar 16 16:05:56 crc kubenswrapper[5120]: I0316 16:05:56.260017 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="7e01ce77-a7e7-4f90-880f-fb2aa9b506a0" containerName="container-replicator" containerID="cri-o://336f3db32f57852f76e9f4875a9e9c43786cc5813a47664b60949887a3812b50" gracePeriod=30 Mar 16 16:05:56 crc kubenswrapper[5120]: I0316 16:05:56.259997 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="7e01ce77-a7e7-4f90-880f-fb2aa9b506a0" containerName="container-auditor" containerID="cri-o://a4e710398cfe29215c86b86e007c51ed81b67c778fe43c2b13c2cda4950ccf05" gracePeriod=30 Mar 16 16:05:56 crc kubenswrapper[5120]: I0316 16:05:56.261106 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="7e01ce77-a7e7-4f90-880f-fb2aa9b506a0" containerName="object-server" containerID="cri-o://79550cc49372bb24203f30a90ef9bfd6d2ee84c2fa9667ae735271bfa17f0ede" gracePeriod=30 Mar 16 16:05:56 crc kubenswrapper[5120]: I0316 16:05:56.291142 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:05:56 crc kubenswrapper[5120]: I0316 16:05:56.291925 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="efc5b4b3-507b-4f7b-9524-621ff45c12a6" containerName="glance-log" containerID="cri-o://02893fdeddb9bac6b9de74b4a3bfe760717fd2af15213aafd5d06efdd9dfcf71" gracePeriod=30 Mar 16 16:05:56 crc kubenswrapper[5120]: I0316 16:05:56.292565 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="efc5b4b3-507b-4f7b-9524-621ff45c12a6" containerName="glance-httpd" containerID="cri-o://826e018a02a787264e19107777830f87c35b2977f3638effba1fabc838449141" gracePeriod=30 Mar 16 16:05:56 crc kubenswrapper[5120]: I0316 16:05:56.300801 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-7dcb9fc94d-5c4n9"] Mar 16 16:05:56 crc kubenswrapper[5120]: E0316 16:05:56.336937 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cinder-api-config-data: secret "cinder-api-config-data" not found Mar 16 16:05:56 crc kubenswrapper[5120]: E0316 16:05:56.337012 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8028a79-c5c3-420e-ac48-33a3991aba76-config-data-custom podName:f8028a79-c5c3-420e-ac48-33a3991aba76 nodeName:}" failed. No retries permitted until 2026-03-16 16:05:56.836994477 +0000 UTC m=+2058.990926134 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "config-data-custom" (UniqueName: "kubernetes.io/secret/f8028a79-c5c3-420e-ac48-33a3991aba76-config-data-custom") pod "cinder-api-0" (UID: "f8028a79-c5c3-420e-ac48-33a3991aba76") : secret "cinder-api-config-data" not found Mar 16 16:05:56 crc kubenswrapper[5120]: E0316 16:05:56.337309 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cinder-scripts: secret "cinder-scripts" not found Mar 16 16:05:56 crc kubenswrapper[5120]: E0316 16:05:56.337340 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8028a79-c5c3-420e-ac48-33a3991aba76-scripts podName:f8028a79-c5c3-420e-ac48-33a3991aba76 nodeName:}" failed. No retries permitted until 2026-03-16 16:05:56.837332446 +0000 UTC m=+2058.991264103 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "scripts" (UniqueName: "kubernetes.io/secret/f8028a79-c5c3-420e-ac48-33a3991aba76-scripts") pod "cinder-api-0" (UID: "f8028a79-c5c3-420e-ac48-33a3991aba76") : secret "cinder-scripts" not found Mar 16 16:05:56 crc kubenswrapper[5120]: E0316 16:05:56.337379 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cinder-config-data: secret "cinder-config-data" not found Mar 16 16:05:56 crc kubenswrapper[5120]: E0316 16:05:56.337408 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8028a79-c5c3-420e-ac48-33a3991aba76-config-data podName:f8028a79-c5c3-420e-ac48-33a3991aba76 nodeName:}" failed. No retries permitted until 2026-03-16 16:05:56.837399437 +0000 UTC m=+2058.991331094 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/secret/f8028a79-c5c3-420e-ac48-33a3991aba76-config-data") pod "cinder-api-0" (UID: "f8028a79-c5c3-420e-ac48-33a3991aba76") : secret "cinder-config-data" not found Mar 16 16:05:56 crc kubenswrapper[5120]: I0316 16:05:56.346616 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-7dcb9fc94d-5c4n9"] Mar 16 16:05:56 crc kubenswrapper[5120]: I0316 16:05:56.417055 5120 scope.go:117] "RemoveContainer" containerID="2d0b86f84ea9cbf53b3f863fadf423c26de96160c88b2c0c460eb8283fe6384c" Mar 16 16:05:56 crc kubenswrapper[5120]: E0316 16:05:56.442406 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 16:05:56 crc kubenswrapper[5120]: E0316 16:05:56.442485 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8028a79-c5c3-420e-ac48-33a3991aba76-combined-ca-bundle podName:f8028a79-c5c3-420e-ac48-33a3991aba76 nodeName:}" failed. No retries permitted until 2026-03-16 16:05:58.442468414 +0000 UTC m=+2060.596400071 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/f8028a79-c5c3-420e-ac48-33a3991aba76-combined-ca-bundle") pod "cinder-api-0" (UID: "f8028a79-c5c3-420e-ac48-33a3991aba76") : secret "combined-ca-bundle" not found Mar 16 16:05:56 crc kubenswrapper[5120]: E0316 16:05:56.444981 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-cinder-public-svc: secret "cert-cinder-public-svc" not found Mar 16 16:05:56 crc kubenswrapper[5120]: E0316 16:05:56.445040 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8028a79-c5c3-420e-ac48-33a3991aba76-public-tls-certs podName:f8028a79-c5c3-420e-ac48-33a3991aba76 nodeName:}" failed. No retries permitted until 2026-03-16 16:05:58.445022274 +0000 UTC m=+2060.598953931 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/f8028a79-c5c3-420e-ac48-33a3991aba76-public-tls-certs") pod "cinder-api-0" (UID: "f8028a79-c5c3-420e-ac48-33a3991aba76") : secret "cert-cinder-public-svc" not found Mar 16 16:05:56 crc kubenswrapper[5120]: E0316 16:05:56.445096 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-cinder-internal-svc: secret "cert-cinder-internal-svc" not found Mar 16 16:05:56 crc kubenswrapper[5120]: E0316 16:05:56.445121 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8028a79-c5c3-420e-ac48-33a3991aba76-internal-tls-certs podName:f8028a79-c5c3-420e-ac48-33a3991aba76 nodeName:}" failed. No retries permitted until 2026-03-16 16:05:58.445114626 +0000 UTC m=+2060.599046283 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/f8028a79-c5c3-420e-ac48-33a3991aba76-internal-tls-certs") pod "cinder-api-0" (UID: "f8028a79-c5c3-420e-ac48-33a3991aba76") : secret "cert-cinder-internal-svc" not found Mar 16 16:05:56 crc kubenswrapper[5120]: I0316 16:05:56.452857 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-fb69b7968-qskx5"] Mar 16 16:05:56 crc kubenswrapper[5120]: I0316 16:05:56.453977 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-fb69b7968-qskx5" podUID="793f378f-ef31-443c-bb12-6d75a2140296" containerName="placement-log" containerID="cri-o://f83697d85210dbea97afeac8e4e308ef8197b85223ea2b15ac11ae6f4f71f13f" gracePeriod=30 Mar 16 16:05:56 crc kubenswrapper[5120]: I0316 16:05:56.454443 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-fb69b7968-qskx5" podUID="793f378f-ef31-443c-bb12-6d75a2140296" containerName="placement-api" containerID="cri-o://b05d1524d8d05da004906226c31ae5d3ad93c44d9f9606c3345de3d786881030" gracePeriod=30 Mar 16 16:05:56 crc kubenswrapper[5120]: I0316 16:05:56.460427 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-857694d5fb-pdlqj" Mar 16 16:05:56 crc kubenswrapper[5120]: I0316 16:05:56.481239 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-l8vn4"] Mar 16 16:05:56 crc kubenswrapper[5120]: I0316 16:05:56.537609 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6ef2171-25f8-43d1-a037-b915f5b77abc" containerName="ceilometer-notification-agent" Mar 16 16:05:56 crc kubenswrapper[5120]: I0316 16:05:56.537642 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6ef2171-25f8-43d1-a037-b915f5b77abc" containerName="ceilometer-notification-agent" Mar 16 16:05:56 crc kubenswrapper[5120]: I0316 16:05:56.537670 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb0a18f2-a95f-4ee1-b6a6-d0400f70760f" containerName="barbican-api" Mar 16 16:05:56 crc kubenswrapper[5120]: I0316 16:05:56.537676 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb0a18f2-a95f-4ee1-b6a6-d0400f70760f" containerName="barbican-api" Mar 16 16:05:56 crc kubenswrapper[5120]: I0316 16:05:56.537702 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6ef2171-25f8-43d1-a037-b915f5b77abc" containerName="sg-core" Mar 16 16:05:56 crc kubenswrapper[5120]: I0316 16:05:56.537709 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6ef2171-25f8-43d1-a037-b915f5b77abc" containerName="sg-core" Mar 16 16:05:56 crc kubenswrapper[5120]: I0316 16:05:56.537730 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6ef2171-25f8-43d1-a037-b915f5b77abc" containerName="ceilometer-central-agent" Mar 16 16:05:56 crc kubenswrapper[5120]: I0316 16:05:56.537735 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6ef2171-25f8-43d1-a037-b915f5b77abc" containerName="ceilometer-central-agent" Mar 16 16:05:56 crc kubenswrapper[5120]: I0316 16:05:56.551458 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6ef2171-25f8-43d1-a037-b915f5b77abc" containerName="proxy-httpd" Mar 16 16:05:56 crc kubenswrapper[5120]: I0316 16:05:56.551716 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6ef2171-25f8-43d1-a037-b915f5b77abc" containerName="proxy-httpd" Mar 16 16:05:56 crc kubenswrapper[5120]: I0316 16:05:56.562873 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb0a18f2-a95f-4ee1-b6a6-d0400f70760f" containerName="barbican-api-log" Mar 16 16:05:56 crc kubenswrapper[5120]: I0316 16:05:56.562912 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb0a18f2-a95f-4ee1-b6a6-d0400f70760f" containerName="barbican-api-log" Mar 16 16:05:56 crc kubenswrapper[5120]: I0316 16:05:56.567126 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="bb0a18f2-a95f-4ee1-b6a6-d0400f70760f" containerName="barbican-api" Mar 16 16:05:56 crc kubenswrapper[5120]: I0316 16:05:56.567153 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c6ef2171-25f8-43d1-a037-b915f5b77abc" containerName="ceilometer-central-agent" Mar 16 16:05:56 crc kubenswrapper[5120]: I0316 16:05:56.567165 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="bb0a18f2-a95f-4ee1-b6a6-d0400f70760f" containerName="barbican-api-log" Mar 16 16:05:56 crc kubenswrapper[5120]: I0316 16:05:56.567182 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c6ef2171-25f8-43d1-a037-b915f5b77abc" containerName="sg-core" Mar 16 16:05:56 crc kubenswrapper[5120]: I0316 16:05:56.567195 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c6ef2171-25f8-43d1-a037-b915f5b77abc" containerName="ceilometer-notification-agent" Mar 16 16:05:56 crc kubenswrapper[5120]: I0316 16:05:56.567204 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c6ef2171-25f8-43d1-a037-b915f5b77abc" containerName="proxy-httpd" Mar 16 16:05:56 crc kubenswrapper[5120]: I0316 16:05:56.607567 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bb0a18f2-a95f-4ee1-b6a6-d0400f70760f-config-data\") pod \"bb0a18f2-a95f-4ee1-b6a6-d0400f70760f\" (UID: \"bb0a18f2-a95f-4ee1-b6a6-d0400f70760f\") " Mar 16 16:05:56 crc kubenswrapper[5120]: I0316 16:05:56.607647 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/bb0a18f2-a95f-4ee1-b6a6-d0400f70760f-internal-tls-certs\") pod \"bb0a18f2-a95f-4ee1-b6a6-d0400f70760f\" (UID: \"bb0a18f2-a95f-4ee1-b6a6-d0400f70760f\") " Mar 16 16:05:56 crc kubenswrapper[5120]: I0316 16:05:56.607726 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/bb0a18f2-a95f-4ee1-b6a6-d0400f70760f-config-data-custom\") pod \"bb0a18f2-a95f-4ee1-b6a6-d0400f70760f\" (UID: \"bb0a18f2-a95f-4ee1-b6a6-d0400f70760f\") " Mar 16 16:05:56 crc kubenswrapper[5120]: I0316 16:05:56.607854 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/bb0a18f2-a95f-4ee1-b6a6-d0400f70760f-logs\") pod \"bb0a18f2-a95f-4ee1-b6a6-d0400f70760f\" (UID: \"bb0a18f2-a95f-4ee1-b6a6-d0400f70760f\") " Mar 16 16:05:56 crc kubenswrapper[5120]: I0316 16:05:56.607871 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/bb0a18f2-a95f-4ee1-b6a6-d0400f70760f-public-tls-certs\") pod \"bb0a18f2-a95f-4ee1-b6a6-d0400f70760f\" (UID: \"bb0a18f2-a95f-4ee1-b6a6-d0400f70760f\") " Mar 16 16:05:56 crc kubenswrapper[5120]: I0316 16:05:56.608072 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-57rgw\" (UniqueName: \"kubernetes.io/projected/bb0a18f2-a95f-4ee1-b6a6-d0400f70760f-kube-api-access-57rgw\") pod \"bb0a18f2-a95f-4ee1-b6a6-d0400f70760f\" (UID: \"bb0a18f2-a95f-4ee1-b6a6-d0400f70760f\") " Mar 16 16:05:56 crc kubenswrapper[5120]: I0316 16:05:56.608107 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bb0a18f2-a95f-4ee1-b6a6-d0400f70760f-combined-ca-bundle\") pod \"bb0a18f2-a95f-4ee1-b6a6-d0400f70760f\" (UID: \"bb0a18f2-a95f-4ee1-b6a6-d0400f70760f\") " Mar 16 16:05:56 crc kubenswrapper[5120]: I0316 16:05:56.613933 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-l8vn4"] Mar 16 16:05:56 crc kubenswrapper[5120]: I0316 16:05:56.614032 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb0a18f2-a95f-4ee1-b6a6-d0400f70760f-logs" (OuterVolumeSpecName: "logs") pod "bb0a18f2-a95f-4ee1-b6a6-d0400f70760f" (UID: "bb0a18f2-a95f-4ee1-b6a6-d0400f70760f"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:05:56 crc kubenswrapper[5120]: I0316 16:05:56.614082 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-l8vn4" Mar 16 16:05:56 crc kubenswrapper[5120]: I0316 16:05:56.636340 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_93ddd6a0-2403-4b9b-9bc8-e5ac0592b1bc/ovsdbserver-nb/0.log" Mar 16 16:05:56 crc kubenswrapper[5120]: I0316 16:05:56.636514 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:05:56 crc kubenswrapper[5120]: I0316 16:05:56.636644 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:05:56 crc kubenswrapper[5120]: I0316 16:05:56.656546 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb0a18f2-a95f-4ee1-b6a6-d0400f70760f-kube-api-access-57rgw" (OuterVolumeSpecName: "kube-api-access-57rgw") pod "bb0a18f2-a95f-4ee1-b6a6-d0400f70760f" (UID: "bb0a18f2-a95f-4ee1-b6a6-d0400f70760f"). InnerVolumeSpecName "kube-api-access-57rgw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:05:56 crc kubenswrapper[5120]: I0316 16:05:56.727426 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/93ddd6a0-2403-4b9b-9bc8-e5ac0592b1bc-combined-ca-bundle\") pod \"93ddd6a0-2403-4b9b-9bc8-e5ac0592b1bc\" (UID: \"93ddd6a0-2403-4b9b-9bc8-e5ac0592b1bc\") " Mar 16 16:05:56 crc kubenswrapper[5120]: I0316 16:05:56.727480 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovndbcluster-nb-etc-ovn\" (UniqueName: \"kubernetes.io/local-volume/local-storage15-crc\") pod \"93ddd6a0-2403-4b9b-9bc8-e5ac0592b1bc\" (UID: \"93ddd6a0-2403-4b9b-9bc8-e5ac0592b1bc\") " Mar 16 16:05:56 crc kubenswrapper[5120]: I0316 16:05:56.727683 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/93ddd6a0-2403-4b9b-9bc8-e5ac0592b1bc-config\") pod \"93ddd6a0-2403-4b9b-9bc8-e5ac0592b1bc\" (UID: \"93ddd6a0-2403-4b9b-9bc8-e5ac0592b1bc\") " Mar 16 16:05:56 crc kubenswrapper[5120]: I0316 16:05:56.728057 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/93ddd6a0-2403-4b9b-9bc8-e5ac0592b1bc-scripts\") pod \"93ddd6a0-2403-4b9b-9bc8-e5ac0592b1bc\" (UID: \"93ddd6a0-2403-4b9b-9bc8-e5ac0592b1bc\") " Mar 16 16:05:56 crc kubenswrapper[5120]: I0316 16:05:56.728094 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/93ddd6a0-2403-4b9b-9bc8-e5ac0592b1bc-ovsdb-rundir\") pod \"93ddd6a0-2403-4b9b-9bc8-e5ac0592b1bc\" (UID: \"93ddd6a0-2403-4b9b-9bc8-e5ac0592b1bc\") " Mar 16 16:05:56 crc kubenswrapper[5120]: I0316 16:05:56.728180 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/93ddd6a0-2403-4b9b-9bc8-e5ac0592b1bc-metrics-certs-tls-certs\") pod \"93ddd6a0-2403-4b9b-9bc8-e5ac0592b1bc\" (UID: \"93ddd6a0-2403-4b9b-9bc8-e5ac0592b1bc\") " Mar 16 16:05:56 crc kubenswrapper[5120]: I0316 16:05:56.728254 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-55jmv\" (UniqueName: \"kubernetes.io/projected/93ddd6a0-2403-4b9b-9bc8-e5ac0592b1bc-kube-api-access-55jmv\") pod \"93ddd6a0-2403-4b9b-9bc8-e5ac0592b1bc\" (UID: \"93ddd6a0-2403-4b9b-9bc8-e5ac0592b1bc\") " Mar 16 16:05:56 crc kubenswrapper[5120]: I0316 16:05:56.728274 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/93ddd6a0-2403-4b9b-9bc8-e5ac0592b1bc-ovsdbserver-nb-tls-certs\") pod \"93ddd6a0-2403-4b9b-9bc8-e5ac0592b1bc\" (UID: \"93ddd6a0-2403-4b9b-9bc8-e5ac0592b1bc\") " Mar 16 16:05:56 crc kubenswrapper[5120]: I0316 16:05:56.728459 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/26cb0730-b6af-4f60-baa0-3ce77a180060-config\") pod \"dnsmasq-dnsmasq-79dcd846c5-l8vn4\" (UID: \"26cb0730-b6af-4f60-baa0-3ce77a180060\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-l8vn4" Mar 16 16:05:56 crc kubenswrapper[5120]: I0316 16:05:56.728498 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmfwc\" (UniqueName: \"kubernetes.io/projected/26cb0730-b6af-4f60-baa0-3ce77a180060-kube-api-access-xmfwc\") pod \"dnsmasq-dnsmasq-79dcd846c5-l8vn4\" (UID: \"26cb0730-b6af-4f60-baa0-3ce77a180060\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-l8vn4" Mar 16 16:05:56 crc kubenswrapper[5120]: I0316 16:05:56.728644 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/26cb0730-b6af-4f60-baa0-3ce77a180060-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-79dcd846c5-l8vn4\" (UID: \"26cb0730-b6af-4f60-baa0-3ce77a180060\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-l8vn4" Mar 16 16:05:56 crc kubenswrapper[5120]: I0316 16:05:56.728934 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/bb0a18f2-a95f-4ee1-b6a6-d0400f70760f-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:56 crc kubenswrapper[5120]: I0316 16:05:56.728954 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-57rgw\" (UniqueName: \"kubernetes.io/projected/bb0a18f2-a95f-4ee1-b6a6-d0400f70760f-kube-api-access-57rgw\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:56 crc kubenswrapper[5120]: I0316 16:05:56.734875 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bb0a18f2-a95f-4ee1-b6a6-d0400f70760f-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "bb0a18f2-a95f-4ee1-b6a6-d0400f70760f" (UID: "bb0a18f2-a95f-4ee1-b6a6-d0400f70760f"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:56 crc kubenswrapper[5120]: I0316 16:05:56.735706 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/93ddd6a0-2403-4b9b-9bc8-e5ac0592b1bc-config" (OuterVolumeSpecName: "config") pod "93ddd6a0-2403-4b9b-9bc8-e5ac0592b1bc" (UID: "93ddd6a0-2403-4b9b-9bc8-e5ac0592b1bc"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:05:56 crc kubenswrapper[5120]: I0316 16:05:56.742365 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/93ddd6a0-2403-4b9b-9bc8-e5ac0592b1bc-scripts" (OuterVolumeSpecName: "scripts") pod "93ddd6a0-2403-4b9b-9bc8-e5ac0592b1bc" (UID: "93ddd6a0-2403-4b9b-9bc8-e5ac0592b1bc"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:05:56 crc kubenswrapper[5120]: I0316 16:05:56.749199 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93ddd6a0-2403-4b9b-9bc8-e5ac0592b1bc-kube-api-access-55jmv" (OuterVolumeSpecName: "kube-api-access-55jmv") pod "93ddd6a0-2403-4b9b-9bc8-e5ac0592b1bc" (UID: "93ddd6a0-2403-4b9b-9bc8-e5ac0592b1bc"). InnerVolumeSpecName "kube-api-access-55jmv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:05:56 crc kubenswrapper[5120]: I0316 16:05:56.755200 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage15-crc" (OuterVolumeSpecName: "ovndbcluster-nb-etc-ovn") pod "93ddd6a0-2403-4b9b-9bc8-e5ac0592b1bc" (UID: "93ddd6a0-2403-4b9b-9bc8-e5ac0592b1bc"). InnerVolumeSpecName "local-storage15-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:05:56 crc kubenswrapper[5120]: I0316 16:05:56.803118 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93ddd6a0-2403-4b9b-9bc8-e5ac0592b1bc-ovsdb-rundir" (OuterVolumeSpecName: "ovsdb-rundir") pod "93ddd6a0-2403-4b9b-9bc8-e5ac0592b1bc" (UID: "93ddd6a0-2403-4b9b-9bc8-e5ac0592b1bc"). InnerVolumeSpecName "ovsdb-rundir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:05:56 crc kubenswrapper[5120]: I0316 16:05:56.844606 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/26cb0730-b6af-4f60-baa0-3ce77a180060-config\") pod \"dnsmasq-dnsmasq-79dcd846c5-l8vn4\" (UID: \"26cb0730-b6af-4f60-baa0-3ce77a180060\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-l8vn4" Mar 16 16:05:56 crc kubenswrapper[5120]: I0316 16:05:56.844666 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xmfwc\" (UniqueName: \"kubernetes.io/projected/26cb0730-b6af-4f60-baa0-3ce77a180060-kube-api-access-xmfwc\") pod \"dnsmasq-dnsmasq-79dcd846c5-l8vn4\" (UID: \"26cb0730-b6af-4f60-baa0-3ce77a180060\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-l8vn4" Mar 16 16:05:56 crc kubenswrapper[5120]: I0316 16:05:56.844803 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/26cb0730-b6af-4f60-baa0-3ce77a180060-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-79dcd846c5-l8vn4\" (UID: \"26cb0730-b6af-4f60-baa0-3ce77a180060\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-l8vn4" Mar 16 16:05:56 crc kubenswrapper[5120]: I0316 16:05:56.845029 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/93ddd6a0-2403-4b9b-9bc8-e5ac0592b1bc-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:56 crc kubenswrapper[5120]: I0316 16:05:56.845041 5120 reconciler_common.go:299] "Volume detached for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/93ddd6a0-2403-4b9b-9bc8-e5ac0592b1bc-ovsdb-rundir\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:56 crc kubenswrapper[5120]: I0316 16:05:56.845051 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-55jmv\" (UniqueName: \"kubernetes.io/projected/93ddd6a0-2403-4b9b-9bc8-e5ac0592b1bc-kube-api-access-55jmv\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:56 crc kubenswrapper[5120]: I0316 16:05:56.845068 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage15-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage15-crc\") on node \"crc\" " Mar 16 16:05:56 crc kubenswrapper[5120]: I0316 16:05:56.845078 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/bb0a18f2-a95f-4ee1-b6a6-d0400f70760f-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:56 crc kubenswrapper[5120]: I0316 16:05:56.845086 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/93ddd6a0-2403-4b9b-9bc8-e5ac0592b1bc-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:56 crc kubenswrapper[5120]: E0316 16:05:56.856946 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cinder-config-data: secret "cinder-config-data" not found Mar 16 16:05:56 crc kubenswrapper[5120]: E0316 16:05:56.857026 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8028a79-c5c3-420e-ac48-33a3991aba76-config-data podName:f8028a79-c5c3-420e-ac48-33a3991aba76 nodeName:}" failed. No retries permitted until 2026-03-16 16:05:57.857007055 +0000 UTC m=+2060.010938702 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/secret/f8028a79-c5c3-420e-ac48-33a3991aba76-config-data") pod "cinder-api-0" (UID: "f8028a79-c5c3-420e-ac48-33a3991aba76") : secret "cinder-config-data" not found Mar 16 16:05:56 crc kubenswrapper[5120]: E0316 16:05:56.857290 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cinder-api-config-data: secret "cinder-api-config-data" not found Mar 16 16:05:56 crc kubenswrapper[5120]: E0316 16:05:56.857399 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8028a79-c5c3-420e-ac48-33a3991aba76-config-data-custom podName:f8028a79-c5c3-420e-ac48-33a3991aba76 nodeName:}" failed. No retries permitted until 2026-03-16 16:05:57.857382116 +0000 UTC m=+2060.011313773 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "config-data-custom" (UniqueName: "kubernetes.io/secret/f8028a79-c5c3-420e-ac48-33a3991aba76-config-data-custom") pod "cinder-api-0" (UID: "f8028a79-c5c3-420e-ac48-33a3991aba76") : secret "cinder-api-config-data" not found Mar 16 16:05:56 crc kubenswrapper[5120]: E0316 16:05:56.857474 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cinder-scripts: secret "cinder-scripts" not found Mar 16 16:05:56 crc kubenswrapper[5120]: E0316 16:05:56.857532 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8028a79-c5c3-420e-ac48-33a3991aba76-scripts podName:f8028a79-c5c3-420e-ac48-33a3991aba76 nodeName:}" failed. No retries permitted until 2026-03-16 16:05:57.857517399 +0000 UTC m=+2060.011449056 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "scripts" (UniqueName: "kubernetes.io/secret/f8028a79-c5c3-420e-ac48-33a3991aba76-scripts") pod "cinder-api-0" (UID: "f8028a79-c5c3-420e-ac48-33a3991aba76") : secret "cinder-scripts" not found Mar 16 16:05:56 crc kubenswrapper[5120]: I0316 16:05:56.858266 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/26cb0730-b6af-4f60-baa0-3ce77a180060-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-79dcd846c5-l8vn4\" (UID: \"26cb0730-b6af-4f60-baa0-3ce77a180060\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-l8vn4" Mar 16 16:05:56 crc kubenswrapper[5120]: I0316 16:05:56.859551 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/26cb0730-b6af-4f60-baa0-3ce77a180060-config\") pod \"dnsmasq-dnsmasq-79dcd846c5-l8vn4\" (UID: \"26cb0730-b6af-4f60-baa0-3ce77a180060\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-l8vn4" Mar 16 16:05:56 crc kubenswrapper[5120]: I0316 16:05:56.952676 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmfwc\" (UniqueName: \"kubernetes.io/projected/26cb0730-b6af-4f60-baa0-3ce77a180060-kube-api-access-xmfwc\") pod \"dnsmasq-dnsmasq-79dcd846c5-l8vn4\" (UID: \"26cb0730-b6af-4f60-baa0-3ce77a180060\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-l8vn4" Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.037152 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0f3d3f0d-b689-423c-b909-2315446b2955" path="/var/lib/kubelet/pods/0f3d3f0d-b689-423c-b909-2315446b2955/volumes" Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.038536 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0f60c073-48fe-42f1-93ed-3b06d768b602" path="/var/lib/kubelet/pods/0f60c073-48fe-42f1-93ed-3b06d768b602/volumes" Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.039129 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2ef9f7e4-8520-4e71-b120-b60f266c5548" path="/var/lib/kubelet/pods/2ef9f7e4-8520-4e71-b120-b60f266c5548/volumes" Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.039603 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="34a68caa-76db-4be4-9ecd-8955435c0e90" path="/var/lib/kubelet/pods/34a68caa-76db-4be4-9ecd-8955435c0e90/volumes" Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.041342 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3ae99987-5845-4916-9024-031d345fee06" path="/var/lib/kubelet/pods/3ae99987-5845-4916-9024-031d345fee06/volumes" Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.041789 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bb0a18f2-a95f-4ee1-b6a6-d0400f70760f-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "bb0a18f2-a95f-4ee1-b6a6-d0400f70760f" (UID: "bb0a18f2-a95f-4ee1-b6a6-d0400f70760f"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.041858 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4bbb7480-6b4f-4be1-9f89-73d58ebf1184" path="/var/lib/kubelet/pods/4bbb7480-6b4f-4be1-9f89-73d58ebf1184/volumes" Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.044183 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="54c2f552-edbf-47f1-9e7e-2f6ce8099914" path="/var/lib/kubelet/pods/54c2f552-edbf-47f1-9e7e-2f6ce8099914/volumes" Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.046929 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5af0f689-f31d-4721-9719-daf7d967fec1" path="/var/lib/kubelet/pods/5af0f689-f31d-4721-9719-daf7d967fec1/volumes" Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.047979 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="741f7b8c-fe99-4ac7-ae79-66467c521b87" path="/var/lib/kubelet/pods/741f7b8c-fe99-4ac7-ae79-66467c521b87/volumes" Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.049315 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9112a3f8-e8fb-4df3-8f9e-c29bd437f5ea" path="/var/lib/kubelet/pods/9112a3f8-e8fb-4df3-8f9e-c29bd437f5ea/volumes" Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.051004 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="98e439f7-1c93-4a9e-9986-62a1936a4be2" path="/var/lib/kubelet/pods/98e439f7-1c93-4a9e-9986-62a1936a4be2/volumes" Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.051619 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ace8fafc-b3ed-4c95-8769-9f226ef3506f" path="/var/lib/kubelet/pods/ace8fafc-b3ed-4c95-8769-9f226ef3506f/volumes" Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.052610 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b687141f-0dee-4a5b-a072-823f2d33133d" path="/var/lib/kubelet/pods/b687141f-0dee-4a5b-a072-823f2d33133d/volumes" Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.053847 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dd7b1ebe-2b4e-4c17-8a09-5dc362dfc914" path="/var/lib/kubelet/pods/dd7b1ebe-2b4e-4c17-8a09-5dc362dfc914/volumes" Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.054549 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e2185e65-e56e-4f2e-929e-9caa246e5961" path="/var/lib/kubelet/pods/e2185e65-e56e-4f2e-929e-9caa246e5961/volumes" Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.055336 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e5bc895e-5719-43f2-bbbe-e892520dbdd9" path="/var/lib/kubelet/pods/e5bc895e-5719-43f2-bbbe-e892520dbdd9/volumes" Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.056415 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f65851de-c7fc-4d33-af00-c0bd4081b4cc" path="/var/lib/kubelet/pods/f65851de-c7fc-4d33-af00-c0bd4081b4cc/volumes" Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.064055 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bb0a18f2-a95f-4ee1-b6a6-d0400f70760f-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.084048 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage15-crc" (UniqueName: "kubernetes.io/local-volume/local-storage15-crc") on node "crc" Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.125245 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93ddd6a0-2403-4b9b-9bc8-e5ac0592b1bc-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "93ddd6a0-2403-4b9b-9bc8-e5ac0592b1bc" (UID: "93ddd6a0-2403-4b9b-9bc8-e5ac0592b1bc"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.131249 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bb0a18f2-a95f-4ee1-b6a6-d0400f70760f-config-data" (OuterVolumeSpecName: "config-data") pod "bb0a18f2-a95f-4ee1-b6a6-d0400f70760f" (UID: "bb0a18f2-a95f-4ee1-b6a6-d0400f70760f"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:57 crc kubenswrapper[5120]: W0316 16:05:57.159005 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4f18ae61_e496_433a_851f_3ac657fa2455.slice/crio-e5ec5c97b94b64c580566e796d432ecfc8b34d5cae3a96c3b1642795d929f914 WatchSource:0}: Error finding container e5ec5c97b94b64c580566e796d432ecfc8b34d5cae3a96c3b1642795d929f914: Status 404 returned error can't find the container with id e5ec5c97b94b64c580566e796d432ecfc8b34d5cae3a96c3b1642795d929f914 Mar 16 16:05:57 crc kubenswrapper[5120]: E0316 16:05:57.160453 5120 kuberuntime_manager.go:1358] "Unhandled Error" err=< Mar 16 16:05:57 crc kubenswrapper[5120]: container &Container{Name:mariadb-account-create-update,Image:quay.io/podified-antelope-centos9/openstack-mariadb@sha256:4caef2b55e01b9a7ee88a22bc69db1893521a91d95c7ad4c8e593f14f17a5f95,Command:[/bin/sh -c #!/bin/bash Mar 16 16:05:57 crc kubenswrapper[5120]: Mar 16 16:05:57 crc kubenswrapper[5120]: MYSQL_REMOTE_HOST="" source /var/lib/operator-scripts/mysql_root_auth.sh Mar 16 16:05:57 crc kubenswrapper[5120]: Mar 16 16:05:57 crc kubenswrapper[5120]: export DatabasePassword=${DatabasePassword:?"Please specify a DatabasePassword variable."} Mar 16 16:05:57 crc kubenswrapper[5120]: Mar 16 16:05:57 crc kubenswrapper[5120]: MYSQL_CMD="mysql -h -u root -P 3306" Mar 16 16:05:57 crc kubenswrapper[5120]: Mar 16 16:05:57 crc kubenswrapper[5120]: if [ -n "barbican" ]; then Mar 16 16:05:57 crc kubenswrapper[5120]: GRANT_DATABASE="barbican" Mar 16 16:05:57 crc kubenswrapper[5120]: else Mar 16 16:05:57 crc kubenswrapper[5120]: GRANT_DATABASE="*" Mar 16 16:05:57 crc kubenswrapper[5120]: fi Mar 16 16:05:57 crc kubenswrapper[5120]: Mar 16 16:05:57 crc kubenswrapper[5120]: # going for maximum compatibility here: Mar 16 16:05:57 crc kubenswrapper[5120]: # 1. MySQL 8 no longer allows implicit create user when GRANT is used Mar 16 16:05:57 crc kubenswrapper[5120]: # 2. MariaDB has "CREATE OR REPLACE", but MySQL does not Mar 16 16:05:57 crc kubenswrapper[5120]: # 3. create user with CREATE but then do all password and TLS with ALTER to Mar 16 16:05:57 crc kubenswrapper[5120]: # support updates Mar 16 16:05:57 crc kubenswrapper[5120]: Mar 16 16:05:57 crc kubenswrapper[5120]: $MYSQL_CMD < logger="UnhandledError" Mar 16 16:05:57 crc kubenswrapper[5120]: E0316 16:05:57.162922 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"mariadb-account-create-update\" with CreateContainerConfigError: \"secret \\\"barbican-db-secret\\\" not found\"" pod="openstack-kuttl-tests/barbican-55ec-account-create-update-dkz9b" podUID="8d184805-87aa-4026-ac8b-a36076620a10" Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.166842 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bb0a18f2-a95f-4ee1-b6a6-d0400f70760f-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.166868 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/93ddd6a0-2403-4b9b-9bc8-e5ac0592b1bc-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.166879 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage15-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage15-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:57 crc kubenswrapper[5120]: E0316 16:05:57.166937 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-config-data: configmap "rabbitmq-config-data" not found Mar 16 16:05:57 crc kubenswrapper[5120]: E0316 16:05:57.167484 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/733010bf-0110-4a60-adf6-0f0ee336e96e-config-data podName:733010bf-0110-4a60-adf6-0f0ee336e96e nodeName:}" failed. No retries permitted until 2026-03-16 16:05:59.167433535 +0000 UTC m=+2061.321365192 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/733010bf-0110-4a60-adf6-0f0ee336e96e-config-data") pod "rabbitmq-server-0" (UID: "733010bf-0110-4a60-adf6-0f0ee336e96e") : configmap "rabbitmq-config-data" not found Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.201212 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_93ddd6a0-2403-4b9b-9bc8-e5ac0592b1bc/ovsdbserver-nb/0.log" Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.234548 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bb0a18f2-a95f-4ee1-b6a6-d0400f70760f-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "bb0a18f2-a95f-4ee1-b6a6-d0400f70760f" (UID: "bb0a18f2-a95f-4ee1-b6a6-d0400f70760f"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.237384 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bb0a18f2-a95f-4ee1-b6a6-d0400f70760f-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "bb0a18f2-a95f-4ee1-b6a6-d0400f70760f" (UID: "bb0a18f2-a95f-4ee1-b6a6-d0400f70760f"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:57 crc kubenswrapper[5120]: E0316 16:05:57.243067 5120 kuberuntime_manager.go:1358] "Unhandled Error" err=< Mar 16 16:05:57 crc kubenswrapper[5120]: container &Container{Name:mariadb-account-create-update,Image:quay.io/podified-antelope-centos9/openstack-mariadb@sha256:4caef2b55e01b9a7ee88a22bc69db1893521a91d95c7ad4c8e593f14f17a5f95,Command:[/bin/sh -c #!/bin/bash Mar 16 16:05:57 crc kubenswrapper[5120]: Mar 16 16:05:57 crc kubenswrapper[5120]: MYSQL_REMOTE_HOST="" source /var/lib/operator-scripts/mysql_root_auth.sh Mar 16 16:05:57 crc kubenswrapper[5120]: Mar 16 16:05:57 crc kubenswrapper[5120]: export DatabasePassword=${DatabasePassword:?"Please specify a DatabasePassword variable."} Mar 16 16:05:57 crc kubenswrapper[5120]: Mar 16 16:05:57 crc kubenswrapper[5120]: MYSQL_CMD="mysql -h -u root -P 3306" Mar 16 16:05:57 crc kubenswrapper[5120]: Mar 16 16:05:57 crc kubenswrapper[5120]: if [ -n "" ]; then Mar 16 16:05:57 crc kubenswrapper[5120]: GRANT_DATABASE="" Mar 16 16:05:57 crc kubenswrapper[5120]: else Mar 16 16:05:57 crc kubenswrapper[5120]: GRANT_DATABASE="*" Mar 16 16:05:57 crc kubenswrapper[5120]: fi Mar 16 16:05:57 crc kubenswrapper[5120]: Mar 16 16:05:57 crc kubenswrapper[5120]: # going for maximum compatibility here: Mar 16 16:05:57 crc kubenswrapper[5120]: # 1. MySQL 8 no longer allows implicit create user when GRANT is used Mar 16 16:05:57 crc kubenswrapper[5120]: # 2. MariaDB has "CREATE OR REPLACE", but MySQL does not Mar 16 16:05:57 crc kubenswrapper[5120]: # 3. create user with CREATE but then do all password and TLS with ALTER to Mar 16 16:05:57 crc kubenswrapper[5120]: # support updates Mar 16 16:05:57 crc kubenswrapper[5120]: Mar 16 16:05:57 crc kubenswrapper[5120]: $MYSQL_CMD < logger="UnhandledError" Mar 16 16:05:57 crc kubenswrapper[5120]: E0316 16:05:57.245347 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"mariadb-account-create-update\" with CreateContainerConfigError: \"secret \\\"openstack-cell1-mariadb-root-db-secret\\\" not found\"" pod="openstack-kuttl-tests/root-account-create-update-7g7vr" podUID="4f18ae61-e496-433a-851f-3ac657fa2455" Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.271287 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/bb0a18f2-a95f-4ee1-b6a6-d0400f70760f-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.271325 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/bb0a18f2-a95f-4ee1-b6a6-d0400f70760f-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.280950 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.294275 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-857694d5fb-pdlqj" Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.308681 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93ddd6a0-2403-4b9b-9bc8-e5ac0592b1bc-ovsdbserver-nb-tls-certs" (OuterVolumeSpecName: "ovsdbserver-nb-tls-certs") pod "93ddd6a0-2403-4b9b-9bc8-e5ac0592b1bc" (UID: "93ddd6a0-2403-4b9b-9bc8-e5ac0592b1bc"). InnerVolumeSpecName "ovsdbserver-nb-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.310132 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_ba9461bf-d0b6-45c1-bacf-eede3329fba0/ovsdbserver-sb/0.log" Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.310172 5120 generic.go:358] "Generic (PLEG): container finished" podID="ba9461bf-d0b6-45c1-bacf-eede3329fba0" containerID="3678fb8176154d7514722017b6b95e451fd401e53bb4aa5093bc1a67d432bada" exitCode=143 Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.333074 5120 generic.go:358] "Generic (PLEG): container finished" podID="793f378f-ef31-443c-bb12-6d75a2140296" containerID="f83697d85210dbea97afeac8e4e308ef8197b85223ea2b15ac11ae6f4f71f13f" exitCode=143 Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.355721 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-db-create-rjhgv"] Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.355774 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-db-create-rjhgv"] Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.356698 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"93ddd6a0-2403-4b9b-9bc8-e5ac0592b1bc","Type":"ContainerDied","Data":"b577c109da3620a7b1ee5117bd10d7b36223096046e1263c9c310f6e15f18563"} Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.356736 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-857694d5fb-pdlqj" event={"ID":"bb0a18f2-a95f-4ee1-b6a6-d0400f70760f","Type":"ContainerDied","Data":"2c10d450142b41dc0d02c79bba499ecc896443a72618ad00125eed31bb8bab4f"} Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.356753 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.356783 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-6b8df9c88d-rbjrz"] Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.356794 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.356805 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.356817 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"ba9461bf-d0b6-45c1-bacf-eede3329fba0","Type":"ContainerDied","Data":"3678fb8176154d7514722017b6b95e451fd401e53bb4aa5093bc1a67d432bada"} Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.356829 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-55ec-account-create-update-dkz9b" event={"ID":"8d184805-87aa-4026-ac8b-a36076620a10","Type":"ContainerStarted","Data":"19c0dfff3ca6c3da7fe90e6ade4606ace246c928af15f8c511630bab8ba075df"} Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.356840 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.356851 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-fb69b7968-qskx5" event={"ID":"793f378f-ef31-443c-bb12-6d75a2140296","Type":"ContainerDied","Data":"f83697d85210dbea97afeac8e4e308ef8197b85223ea2b15ac11ae6f4f71f13f"} Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.357020 5120 scope.go:117] "RemoveContainer" containerID="6762026b3241e8edba0db7da5d24e03df13f417225ee8a3fa22f7ee217cc1b80" Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.357396 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.357418 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-hs54b"] Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.357426 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.357437 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.357449 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-hs54b"] Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.357459 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-w8fv5"] Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.357468 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-w8fv5"] Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.357478 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.357556 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="e8e4bade-e33d-4cc6-80ec-5f96e39c8f20" containerName="nova-metadata-log" containerID="cri-o://1a7116daa99aee53c27ccbc6b8927b279cc329e65d3b4f93760d164d6c9baf8a" gracePeriod=30 Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.391457 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="e8e4bade-e33d-4cc6-80ec-5f96e39c8f20" containerName="nova-metadata-metadata" containerID="cri-o://4d19035ffb723ffb2508178ff7d2cf820ceaca9202ab046e0e1c2483ac9ffe16" gracePeriod=30 Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.392039 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-6b8df9c88d-rbjrz" podUID="9d8004a6-f52b-420c-9f64-141dae970d7e" containerName="neutron-api" containerID="cri-o://325c126814bbf2c5054010df97276a8fad76a8cd2e925d8b46965c687053ba96" gracePeriod=30 Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.392315 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="4e3ac124-ebc3-4631-a7b1-5dc135748d5d" containerName="nova-api-log" containerID="cri-o://310b308ba52fcab67cf2c502456c2de0465f9ee7f89783de5324d7ed344a0950" gracePeriod=30 Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.392408 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-6b8df9c88d-rbjrz" podUID="9d8004a6-f52b-420c-9f64-141dae970d7e" containerName="neutron-httpd" containerID="cri-o://24a0dfb437371b7a9e2fbca989f638c6bbaab73772e7b7c295009200a6496677" gracePeriod=30 Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.392485 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="4e3ac124-ebc3-4631-a7b1-5dc135748d5d" containerName="nova-api-api" containerID="cri-o://340d50169e48c14cb6d4557c098a1c2d295af9830d64eeaf1c4c58f08e737170" gracePeriod=30 Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.392908 5120 generic.go:358] "Generic (PLEG): container finished" podID="efc5b4b3-507b-4f7b-9524-621ff45c12a6" containerID="02893fdeddb9bac6b9de74b4a3bfe760717fd2af15213aafd5d06efdd9dfcf71" exitCode=143 Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.393173 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93ddd6a0-2403-4b9b-9bc8-e5ac0592b1bc" containerName="openstack-network-exporter" Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.393211 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="93ddd6a0-2403-4b9b-9bc8-e5ac0592b1bc" containerName="openstack-network-exporter" Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.394107 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93ddd6a0-2403-4b9b-9bc8-e5ac0592b1bc" containerName="ovsdbserver-nb" Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.394125 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="93ddd6a0-2403-4b9b-9bc8-e5ac0592b1bc" containerName="ovsdbserver-nb" Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.394432 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="93ddd6a0-2403-4b9b-9bc8-e5ac0592b1bc" containerName="openstack-network-exporter" Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.394453 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="93ddd6a0-2403-4b9b-9bc8-e5ac0592b1bc" containerName="ovsdbserver-nb" Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.395209 5120 reconciler_common.go:299] "Volume detached for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/93ddd6a0-2403-4b9b-9bc8-e5ac0592b1bc-ovsdbserver-nb-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.410110 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93ddd6a0-2403-4b9b-9bc8-e5ac0592b1bc-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "93ddd6a0-2403-4b9b-9bc8-e5ac0592b1bc" (UID: "93ddd6a0-2403-4b9b-9bc8-e5ac0592b1bc"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.412039 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"efc5b4b3-507b-4f7b-9524-621ff45c12a6","Type":"ContainerDied","Data":"02893fdeddb9bac6b9de74b4a3bfe760717fd2af15213aafd5d06efdd9dfcf71"} Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.412084 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.412098 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-r5xhj"] Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.412111 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-r5xhj"] Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.412128 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-55ec-account-create-update-dkz9b"] Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.412141 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-db-create-lc5wc"] Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.412148 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-5dd49d988b-vcz2l"] Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.412157 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-db-create-wm6fp"] Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.412166 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-db-create-lc5wc"] Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.412178 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-7469b9f4cf-grmhg"] Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.412189 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-db-create-g5nwv"] Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.412197 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-db-create-wm6fp"] Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.412207 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-db-create-g5nwv"] Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.412216 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-sl8qj"] Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.412224 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-db-create-h9d5m"] Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.412233 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-sl8qj"] Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.412243 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-db-create-h9d5m"] Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.412254 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-tqz8h"] Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.412463 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-tqz8h"] Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.412495 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-5dd49d988b-vcz2l" podUID="a4bd1853-26f2-4b40-8a3d-3ae70282ab88" containerName="barbican-api-log" containerID="cri-o://cc696eb8b901e5eb41cdc48434815341e805d7fe5aaf6f4c4e042c349eba69f7" gracePeriod=30 Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.412514 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.412530 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.412546 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-64d4b879f4-bbkqw"] Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.412558 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-7g7vr"] Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.412606 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.412817 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-64d4b879f4-bbkqw" podUID="7fc6bd2b-b3c9-42e9-b7f5-c2aef4997e6c" containerName="barbican-keystone-listener-log" containerID="cri-o://dacff6fc847fdebd6d8ee7408f52597ea61ec912f45e06fc013aa5067459105a" gracePeriod=30 Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.412932 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-5dd49d988b-vcz2l" podUID="a4bd1853-26f2-4b40-8a3d-3ae70282ab88" containerName="barbican-api" containerID="cri-o://9d45a48840b6d7f38f5e8df07afcd62928246e625344537e93a0413d1c500491" gracePeriod=30 Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.413095 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-7469b9f4cf-grmhg" podUID="f0da01d8-8d71-47f3-9ec8-73dd0aabe316" containerName="barbican-worker-log" containerID="cri-o://b2628ee32787319a15d501d9f10281fc7f6881d6eb55598e18e00b9a947c19f6" gracePeriod=30 Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.413102 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-64d4b879f4-bbkqw" podUID="7fc6bd2b-b3c9-42e9-b7f5-c2aef4997e6c" containerName="barbican-keystone-listener" containerID="cri-o://b5396e89a059e714407464e3e525c2b2bddc597fbfcbc921d6ab126d84a862e2" gracePeriod=30 Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.413179 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-7469b9f4cf-grmhg" podUID="f0da01d8-8d71-47f3-9ec8-73dd0aabe316" containerName="barbican-worker" containerID="cri-o://7bcdb368355b6e7789534603513d090ead891f3b93288ee9ef529114e1e19738" gracePeriod=30 Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.413848 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="8f091159-612f-4c40-b215-344c86fe9f65" containerName="nova-cell1-conductor-conductor" containerID="cri-o://a886de49bae32ee69eeae0c96d915691d3f0168922fae6e6426547d7baf51a40" gracePeriod=30 Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.414163 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podUID="52c2852f-8732-4310-8402-b925b49a12ea" containerName="nova-cell1-novncproxy-novncproxy" containerID="cri-o://4e202a31ccedf17053edeb22d44409d0b1d73cbca98af3319d183a5acfbde57c" gracePeriod=30 Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.414451 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ceilometer-internal-svc\"" Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.414473 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.416325 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.419900 5120 generic.go:358] "Generic (PLEG): container finished" podID="7e01ce77-a7e7-4f90-880f-fb2aa9b506a0" containerID="07d1780c3ac674887e98e6e457d571c406a7ee983f0a91f7bfd134c125da3d03" exitCode=0 Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.419951 5120 generic.go:358] "Generic (PLEG): container finished" podID="7e01ce77-a7e7-4f90-880f-fb2aa9b506a0" containerID="6819b2fc19957c0cc9ecf211d06ee6cd10c1ec89e57fa8e1c6f8f34a4272144a" exitCode=0 Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.419959 5120 generic.go:358] "Generic (PLEG): container finished" podID="7e01ce77-a7e7-4f90-880f-fb2aa9b506a0" containerID="176e1b8679f186bfa7c613dd56d177361af47feab586da3825ca07c140f9e8aa" exitCode=0 Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.419965 5120 generic.go:358] "Generic (PLEG): container finished" podID="7e01ce77-a7e7-4f90-880f-fb2aa9b506a0" containerID="10fa8c7b4b871978347408abb409b476cfd8fd7a2f441f3a90024ad00442c1b6" exitCode=0 Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.419970 5120 generic.go:358] "Generic (PLEG): container finished" podID="7e01ce77-a7e7-4f90-880f-fb2aa9b506a0" containerID="9dacb1521b7a04a287e3368f3170f4c5d5387fe4efa3027e858a14615bc08d5b" exitCode=0 Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.419976 5120 generic.go:358] "Generic (PLEG): container finished" podID="7e01ce77-a7e7-4f90-880f-fb2aa9b506a0" containerID="79550cc49372bb24203f30a90ef9bfd6d2ee84c2fa9667ae735271bfa17f0ede" exitCode=0 Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.419981 5120 generic.go:358] "Generic (PLEG): container finished" podID="7e01ce77-a7e7-4f90-880f-fb2aa9b506a0" containerID="2e380b12d073a5002c1e5dd47b9250956676752c0348be88c5d0494c0816ca54" exitCode=0 Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.419986 5120 generic.go:358] "Generic (PLEG): container finished" podID="7e01ce77-a7e7-4f90-880f-fb2aa9b506a0" containerID="a4e710398cfe29215c86b86e007c51ed81b67c778fe43c2b13c2cda4950ccf05" exitCode=0 Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.419992 5120 generic.go:358] "Generic (PLEG): container finished" podID="7e01ce77-a7e7-4f90-880f-fb2aa9b506a0" containerID="336f3db32f57852f76e9f4875a9e9c43786cc5813a47664b60949887a3812b50" exitCode=0 Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.419997 5120 generic.go:358] "Generic (PLEG): container finished" podID="7e01ce77-a7e7-4f90-880f-fb2aa9b506a0" containerID="aa74658997f4ba65955badab309e4d15c34829a78f5c27ce74c840cd5aab7dc5" exitCode=0 Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.420019 5120 generic.go:358] "Generic (PLEG): container finished" podID="7e01ce77-a7e7-4f90-880f-fb2aa9b506a0" containerID="e4e13714df25c26e40c47bd0a068052ffb840c737d71ada600d65029e264bda3" exitCode=0 Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.420026 5120 generic.go:358] "Generic (PLEG): container finished" podID="7e01ce77-a7e7-4f90-880f-fb2aa9b506a0" containerID="1624b7e64adc42a87208b2c700ca76213393c6c3c5d8baa5d38a875f647eae87" exitCode=0 Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.420033 5120 generic.go:358] "Generic (PLEG): container finished" podID="7e01ce77-a7e7-4f90-880f-fb2aa9b506a0" containerID="24b51644c8c35d60eb1d19875575dbadbac7c2899aad1712fe22e9e2cc1c8a0d" exitCode=0 Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.420158 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7e01ce77-a7e7-4f90-880f-fb2aa9b506a0","Type":"ContainerDied","Data":"07d1780c3ac674887e98e6e457d571c406a7ee983f0a91f7bfd134c125da3d03"} Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.420195 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7e01ce77-a7e7-4f90-880f-fb2aa9b506a0","Type":"ContainerDied","Data":"6819b2fc19957c0cc9ecf211d06ee6cd10c1ec89e57fa8e1c6f8f34a4272144a"} Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.420205 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7e01ce77-a7e7-4f90-880f-fb2aa9b506a0","Type":"ContainerDied","Data":"176e1b8679f186bfa7c613dd56d177361af47feab586da3825ca07c140f9e8aa"} Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.420214 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7e01ce77-a7e7-4f90-880f-fb2aa9b506a0","Type":"ContainerDied","Data":"10fa8c7b4b871978347408abb409b476cfd8fd7a2f441f3a90024ad00442c1b6"} Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.420223 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7e01ce77-a7e7-4f90-880f-fb2aa9b506a0","Type":"ContainerDied","Data":"9dacb1521b7a04a287e3368f3170f4c5d5387fe4efa3027e858a14615bc08d5b"} Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.420233 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7e01ce77-a7e7-4f90-880f-fb2aa9b506a0","Type":"ContainerDied","Data":"79550cc49372bb24203f30a90ef9bfd6d2ee84c2fa9667ae735271bfa17f0ede"} Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.420241 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7e01ce77-a7e7-4f90-880f-fb2aa9b506a0","Type":"ContainerDied","Data":"2e380b12d073a5002c1e5dd47b9250956676752c0348be88c5d0494c0816ca54"} Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.420250 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7e01ce77-a7e7-4f90-880f-fb2aa9b506a0","Type":"ContainerDied","Data":"a4e710398cfe29215c86b86e007c51ed81b67c778fe43c2b13c2cda4950ccf05"} Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.420258 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7e01ce77-a7e7-4f90-880f-fb2aa9b506a0","Type":"ContainerDied","Data":"336f3db32f57852f76e9f4875a9e9c43786cc5813a47664b60949887a3812b50"} Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.420268 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7e01ce77-a7e7-4f90-880f-fb2aa9b506a0","Type":"ContainerDied","Data":"aa74658997f4ba65955badab309e4d15c34829a78f5c27ce74c840cd5aab7dc5"} Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.420279 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7e01ce77-a7e7-4f90-880f-fb2aa9b506a0","Type":"ContainerDied","Data":"e4e13714df25c26e40c47bd0a068052ffb840c737d71ada600d65029e264bda3"} Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.420288 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7e01ce77-a7e7-4f90-880f-fb2aa9b506a0","Type":"ContainerDied","Data":"1624b7e64adc42a87208b2c700ca76213393c6c3c5d8baa5d38a875f647eae87"} Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.420296 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7e01ce77-a7e7-4f90-880f-fb2aa9b506a0","Type":"ContainerDied","Data":"24b51644c8c35d60eb1d19875575dbadbac7c2899aad1712fe22e9e2cc1c8a0d"} Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.430559 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.443939 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-55ec-account-create-update-dkz9b"] Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.449661 5120 generic.go:358] "Generic (PLEG): container finished" podID="ab84006c-23ad-4247-abe7-0d1016d65297" containerID="cdc147d80656cda5bf5c1c16abcc7aa843b3b309337641361dde69e6baf74a24" exitCode=0 Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.449738 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-c76f59879-tpdpx" event={"ID":"ab84006c-23ad-4247-abe7-0d1016d65297","Type":"ContainerDied","Data":"cdc147d80656cda5bf5c1c16abcc7aa843b3b309337641361dde69e6baf74a24"} Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.457930 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-7g7vr"] Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.464673 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.473883 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.474110 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/kube-state-metrics-0" podUID="bf18fdee-b4c7-4582-adad-7025308e294a" containerName="kube-state-metrics" containerID="cri-o://2dafb1802184407cc6fca262f22606a9a38d289c9b6357255620abb0d8c59bbb" gracePeriod=30 Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.479218 5120 generic.go:358] "Generic (PLEG): container finished" podID="dcd99b91-243d-46cd-beb8-76527d308b62" containerID="2a93e12e3b4726773dd0561044adb6eaa04a60413b252ae3a7757a91ab1954d4" exitCode=137 Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.479810 5120 kubelet_pods.go:1019] "Unable to retrieve pull secret, the image pull may not succeed." pod="openstack-kuttl-tests/cinder-api-0" secret="" err="secret \"cinder-cinder-dockercfg-zzbgg\" not found" Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.497281 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/030f81c1-4c0e-446e-959d-9912af124e3a-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"030f81c1-4c0e-446e-959d-9912af124e3a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.497328 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/030f81c1-4c0e-446e-959d-9912af124e3a-log-httpd\") pod \"ceilometer-0\" (UID: \"030f81c1-4c0e-446e-959d-9912af124e3a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.497421 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xk676\" (UniqueName: \"kubernetes.io/projected/030f81c1-4c0e-446e-959d-9912af124e3a-kube-api-access-xk676\") pod \"ceilometer-0\" (UID: \"030f81c1-4c0e-446e-959d-9912af124e3a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.497468 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/030f81c1-4c0e-446e-959d-9912af124e3a-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"030f81c1-4c0e-446e-959d-9912af124e3a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.497486 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/030f81c1-4c0e-446e-959d-9912af124e3a-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"030f81c1-4c0e-446e-959d-9912af124e3a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.497508 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/030f81c1-4c0e-446e-959d-9912af124e3a-run-httpd\") pod \"ceilometer-0\" (UID: \"030f81c1-4c0e-446e-959d-9912af124e3a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.497528 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/030f81c1-4c0e-446e-959d-9912af124e3a-config-data\") pod \"ceilometer-0\" (UID: \"030f81c1-4c0e-446e-959d-9912af124e3a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.497542 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/030f81c1-4c0e-446e-959d-9912af124e3a-scripts\") pod \"ceilometer-0\" (UID: \"030f81c1-4c0e-446e-959d-9912af124e3a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.498330 5120 reconciler_common.go:299] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/93ddd6a0-2403-4b9b-9bc8-e5ac0592b1bc-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:57 crc kubenswrapper[5120]: E0316 16:05:57.518984 5120 kuberuntime_manager.go:1358] "Unhandled Error" err=< Mar 16 16:05:57 crc kubenswrapper[5120]: container &Container{Name:mariadb-account-create-update,Image:quay.io/podified-antelope-centos9/openstack-mariadb@sha256:4caef2b55e01b9a7ee88a22bc69db1893521a91d95c7ad4c8e593f14f17a5f95,Command:[/bin/sh -c #!/bin/bash Mar 16 16:05:57 crc kubenswrapper[5120]: Mar 16 16:05:57 crc kubenswrapper[5120]: MYSQL_REMOTE_HOST="" source /var/lib/operator-scripts/mysql_root_auth.sh Mar 16 16:05:57 crc kubenswrapper[5120]: Mar 16 16:05:57 crc kubenswrapper[5120]: export DatabasePassword=${DatabasePassword:?"Please specify a DatabasePassword variable."} Mar 16 16:05:57 crc kubenswrapper[5120]: Mar 16 16:05:57 crc kubenswrapper[5120]: MYSQL_CMD="mysql -h -u root -P 3306" Mar 16 16:05:57 crc kubenswrapper[5120]: Mar 16 16:05:57 crc kubenswrapper[5120]: if [ -n "barbican" ]; then Mar 16 16:05:57 crc kubenswrapper[5120]: GRANT_DATABASE="barbican" Mar 16 16:05:57 crc kubenswrapper[5120]: else Mar 16 16:05:57 crc kubenswrapper[5120]: GRANT_DATABASE="*" Mar 16 16:05:57 crc kubenswrapper[5120]: fi Mar 16 16:05:57 crc kubenswrapper[5120]: Mar 16 16:05:57 crc kubenswrapper[5120]: # going for maximum compatibility here: Mar 16 16:05:57 crc kubenswrapper[5120]: # 1. MySQL 8 no longer allows implicit create user when GRANT is used Mar 16 16:05:57 crc kubenswrapper[5120]: # 2. MariaDB has "CREATE OR REPLACE", but MySQL does not Mar 16 16:05:57 crc kubenswrapper[5120]: # 3. create user with CREATE but then do all password and TLS with ALTER to Mar 16 16:05:57 crc kubenswrapper[5120]: # support updates Mar 16 16:05:57 crc kubenswrapper[5120]: Mar 16 16:05:57 crc kubenswrapper[5120]: $MYSQL_CMD < logger="UnhandledError" Mar 16 16:05:57 crc kubenswrapper[5120]: E0316 16:05:57.523937 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"mariadb-account-create-update\" with CreateContainerConfigError: \"secret \\\"barbican-db-secret\\\" not found\"" pod="openstack-kuttl-tests/barbican-55ec-account-create-update-dkz9b" podUID="8d184805-87aa-4026-ac8b-a36076620a10" Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.570856 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-857694d5fb-pdlqj"] Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.592195 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-api-857694d5fb-pdlqj"] Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.599576 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/030f81c1-4c0e-446e-959d-9912af124e3a-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"030f81c1-4c0e-446e-959d-9912af124e3a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.599612 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/030f81c1-4c0e-446e-959d-9912af124e3a-log-httpd\") pod \"ceilometer-0\" (UID: \"030f81c1-4c0e-446e-959d-9912af124e3a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.599692 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xk676\" (UniqueName: \"kubernetes.io/projected/030f81c1-4c0e-446e-959d-9912af124e3a-kube-api-access-xk676\") pod \"ceilometer-0\" (UID: \"030f81c1-4c0e-446e-959d-9912af124e3a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.599740 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/030f81c1-4c0e-446e-959d-9912af124e3a-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"030f81c1-4c0e-446e-959d-9912af124e3a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.599778 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/030f81c1-4c0e-446e-959d-9912af124e3a-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"030f81c1-4c0e-446e-959d-9912af124e3a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.599801 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/030f81c1-4c0e-446e-959d-9912af124e3a-run-httpd\") pod \"ceilometer-0\" (UID: \"030f81c1-4c0e-446e-959d-9912af124e3a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.599819 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/030f81c1-4c0e-446e-959d-9912af124e3a-config-data\") pod \"ceilometer-0\" (UID: \"030f81c1-4c0e-446e-959d-9912af124e3a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.599835 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/030f81c1-4c0e-446e-959d-9912af124e3a-scripts\") pod \"ceilometer-0\" (UID: \"030f81c1-4c0e-446e-959d-9912af124e3a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:05:57 crc kubenswrapper[5120]: E0316 16:05:57.599945 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/ceilometer-config-data: secret "ceilometer-config-data" not found Mar 16 16:05:57 crc kubenswrapper[5120]: E0316 16:05:57.600070 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/030f81c1-4c0e-446e-959d-9912af124e3a-sg-core-conf-yaml podName:030f81c1-4c0e-446e-959d-9912af124e3a nodeName:}" failed. No retries permitted until 2026-03-16 16:05:58.10005007 +0000 UTC m=+2060.253981727 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "sg-core-conf-yaml" (UniqueName: "kubernetes.io/secret/030f81c1-4c0e-446e-959d-9912af124e3a-sg-core-conf-yaml") pod "ceilometer-0" (UID: "030f81c1-4c0e-446e-959d-9912af124e3a") : secret "ceilometer-config-data" not found Mar 16 16:05:57 crc kubenswrapper[5120]: E0316 16:05:57.600158 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 16:05:57 crc kubenswrapper[5120]: E0316 16:05:57.600202 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/030f81c1-4c0e-446e-959d-9912af124e3a-combined-ca-bundle podName:030f81c1-4c0e-446e-959d-9912af124e3a nodeName:}" failed. No retries permitted until 2026-03-16 16:05:58.100194143 +0000 UTC m=+2060.254125800 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/030f81c1-4c0e-446e-959d-9912af124e3a-combined-ca-bundle") pod "ceilometer-0" (UID: "030f81c1-4c0e-446e-959d-9912af124e3a") : secret "combined-ca-bundle" not found Mar 16 16:05:57 crc kubenswrapper[5120]: E0316 16:05:57.600262 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-ceilometer-internal-svc: secret "cert-ceilometer-internal-svc" not found Mar 16 16:05:57 crc kubenswrapper[5120]: E0316 16:05:57.600304 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/030f81c1-4c0e-446e-959d-9912af124e3a-ceilometer-tls-certs podName:030f81c1-4c0e-446e-959d-9912af124e3a nodeName:}" failed. No retries permitted until 2026-03-16 16:05:58.100287696 +0000 UTC m=+2060.254219353 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ceilometer-tls-certs" (UniqueName: "kubernetes.io/secret/030f81c1-4c0e-446e-959d-9912af124e3a-ceilometer-tls-certs") pod "ceilometer-0" (UID: "030f81c1-4c0e-446e-959d-9912af124e3a") : secret "cert-ceilometer-internal-svc" not found Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.601864 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/030f81c1-4c0e-446e-959d-9912af124e3a-log-httpd\") pod \"ceilometer-0\" (UID: \"030f81c1-4c0e-446e-959d-9912af124e3a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:05:57 crc kubenswrapper[5120]: E0316 16:05:57.601940 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/ceilometer-config-data: secret "ceilometer-config-data" not found Mar 16 16:05:57 crc kubenswrapper[5120]: E0316 16:05:57.601974 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/030f81c1-4c0e-446e-959d-9912af124e3a-config-data podName:030f81c1-4c0e-446e-959d-9912af124e3a nodeName:}" failed. No retries permitted until 2026-03-16 16:05:58.101965402 +0000 UTC m=+2060.255897049 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/secret/030f81c1-4c0e-446e-959d-9912af124e3a-config-data") pod "ceilometer-0" (UID: "030f81c1-4c0e-446e-959d-9912af124e3a") : secret "ceilometer-config-data" not found Mar 16 16:05:57 crc kubenswrapper[5120]: E0316 16:05:57.602012 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/ceilometer-scripts: secret "ceilometer-scripts" not found Mar 16 16:05:57 crc kubenswrapper[5120]: E0316 16:05:57.602082 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/030f81c1-4c0e-446e-959d-9912af124e3a-scripts podName:030f81c1-4c0e-446e-959d-9912af124e3a nodeName:}" failed. No retries permitted until 2026-03-16 16:05:58.102062915 +0000 UTC m=+2060.255994572 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "scripts" (UniqueName: "kubernetes.io/secret/030f81c1-4c0e-446e-959d-9912af124e3a-scripts") pod "ceilometer-0" (UID: "030f81c1-4c0e-446e-959d-9912af124e3a") : secret "ceilometer-scripts" not found Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.603591 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/030f81c1-4c0e-446e-959d-9912af124e3a-run-httpd\") pod \"ceilometer-0\" (UID: \"030f81c1-4c0e-446e-959d-9912af124e3a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:05:57 crc kubenswrapper[5120]: E0316 16:05:57.606190 5120 projected.go:194] Error preparing data for projected volume kube-api-access-xk676 for pod openstack-kuttl-tests/ceilometer-0: failed to fetch token: serviceaccounts "telemetry-ceilometer" not found Mar 16 16:05:57 crc kubenswrapper[5120]: E0316 16:05:57.606234 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/030f81c1-4c0e-446e-959d-9912af124e3a-kube-api-access-xk676 podName:030f81c1-4c0e-446e-959d-9912af124e3a nodeName:}" failed. No retries permitted until 2026-03-16 16:05:58.106223229 +0000 UTC m=+2060.260154886 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-xk676" (UniqueName: "kubernetes.io/projected/030f81c1-4c0e-446e-959d-9912af124e3a-kube-api-access-xk676") pod "ceilometer-0" (UID: "030f81c1-4c0e-446e-959d-9912af124e3a") : failed to fetch token: serviceaccounts "telemetry-ceilometer" not found Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.646495 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" podUID="5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40" containerName="rabbitmq" containerID="cri-o://dd668b15f37de671532dd2837bc715c6d43a3e9f0b987f0af2c9cd57a996952f" gracePeriod=604800 Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.694262 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.694312 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.722217 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/rabbitmq-server-0" podUID="733010bf-0110-4a60-adf6-0f0ee336e96e" containerName="rabbitmq" containerID="cri-o://4e28e8c37cae1b7cf7aa14c8b6c7ec61364c748a7c4de5653e9534e4883c47e2" gracePeriod=604800 Mar 16 16:05:57 crc kubenswrapper[5120]: E0316 16:05:57.861510 5120 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddbb06351_e6e7_4a49_a941_33b16fc6206d.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbf01270c_6ae8_4c7f_aee3_42a125c155e4.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbb0a18f2_a95f_4ee1_b6a6_d0400f70760f.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode8e4bade_e33d_4cc6_80ec_5f96e39c8f20.slice/crio-1a7116daa99aee53c27ccbc6b8927b279cc329e65d3b4f93760d164d6c9baf8a.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbb0a18f2_a95f_4ee1_b6a6_d0400f70760f.slice/crio-2c10d450142b41dc0d02c79bba499ecc896443a72618ad00125eed31bb8bab4f\": RecentStats: unable to find data in memory cache]" Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.879971 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-l8vn4" Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.886323 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-proxy-87b69bc94-qlznl"] Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.886638 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-proxy-87b69bc94-qlznl" podUID="502b04b6-fe65-4be1-847c-172941719e46" containerName="proxy-httpd" containerID="cri-o://e2f06c71fb4d23c856b18d6f3d945870a0ff7ae00f7fb9467dfd44c1eb0c3f68" gracePeriod=30 Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.887175 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-proxy-87b69bc94-qlznl" podUID="502b04b6-fe65-4be1-847c-172941719e46" containerName="proxy-server" containerID="cri-o://500f344bc8320a64252eb3717ce8847a36e2bdc36c2206a38cd7cf09aa08ed3a" gracePeriod=30 Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.896487 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_ba9461bf-d0b6-45c1-bacf-eede3329fba0/ovsdbserver-sb/0.log" Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.896561 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.905649 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/openstack-cell1-galera-0" podUID="277044e1-8761-49a5-9b8c-c7bfa9aab448" containerName="galera" containerID="cri-o://d1c6a1d2fa78339ecd013f346592c0e6029d63013756dda5a3e91db4f117b7e1" gracePeriod=30 Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.910929 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/ba9461bf-d0b6-45c1-bacf-eede3329fba0-ovsdbserver-sb-tls-certs\") pod \"ba9461bf-d0b6-45c1-bacf-eede3329fba0\" (UID: \"ba9461bf-d0b6-45c1-bacf-eede3329fba0\") " Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.911099 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r6lk9\" (UniqueName: \"kubernetes.io/projected/ba9461bf-d0b6-45c1-bacf-eede3329fba0-kube-api-access-r6lk9\") pod \"ba9461bf-d0b6-45c1-bacf-eede3329fba0\" (UID: \"ba9461bf-d0b6-45c1-bacf-eede3329fba0\") " Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.911311 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/ba9461bf-d0b6-45c1-bacf-eede3329fba0-ovsdb-rundir\") pod \"ba9461bf-d0b6-45c1-bacf-eede3329fba0\" (UID: \"ba9461bf-d0b6-45c1-bacf-eede3329fba0\") " Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.911345 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ba9461bf-d0b6-45c1-bacf-eede3329fba0-config\") pod \"ba9461bf-d0b6-45c1-bacf-eede3329fba0\" (UID: \"ba9461bf-d0b6-45c1-bacf-eede3329fba0\") " Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.911376 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ba9461bf-d0b6-45c1-bacf-eede3329fba0-combined-ca-bundle\") pod \"ba9461bf-d0b6-45c1-bacf-eede3329fba0\" (UID: \"ba9461bf-d0b6-45c1-bacf-eede3329fba0\") " Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.911447 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovndbcluster-sb-etc-ovn\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"ba9461bf-d0b6-45c1-bacf-eede3329fba0\" (UID: \"ba9461bf-d0b6-45c1-bacf-eede3329fba0\") " Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.911502 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/ba9461bf-d0b6-45c1-bacf-eede3329fba0-scripts\") pod \"ba9461bf-d0b6-45c1-bacf-eede3329fba0\" (UID: \"ba9461bf-d0b6-45c1-bacf-eede3329fba0\") " Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.911530 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/ba9461bf-d0b6-45c1-bacf-eede3329fba0-metrics-certs-tls-certs\") pod \"ba9461bf-d0b6-45c1-bacf-eede3329fba0\" (UID: \"ba9461bf-d0b6-45c1-bacf-eede3329fba0\") " Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.911846 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba9461bf-d0b6-45c1-bacf-eede3329fba0-ovsdb-rundir" (OuterVolumeSpecName: "ovsdb-rundir") pod "ba9461bf-d0b6-45c1-bacf-eede3329fba0" (UID: "ba9461bf-d0b6-45c1-bacf-eede3329fba0"). InnerVolumeSpecName "ovsdb-rundir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.912200 5120 reconciler_common.go:299] "Volume detached for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/ba9461bf-d0b6-45c1-bacf-eede3329fba0-ovsdb-rundir\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:57 crc kubenswrapper[5120]: E0316 16:05:57.912252 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cinder-config-data: secret "cinder-config-data" not found Mar 16 16:05:57 crc kubenswrapper[5120]: E0316 16:05:57.912292 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8028a79-c5c3-420e-ac48-33a3991aba76-config-data podName:f8028a79-c5c3-420e-ac48-33a3991aba76 nodeName:}" failed. No retries permitted until 2026-03-16 16:05:59.912278289 +0000 UTC m=+2062.066209946 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/secret/f8028a79-c5c3-420e-ac48-33a3991aba76-config-data") pod "cinder-api-0" (UID: "f8028a79-c5c3-420e-ac48-33a3991aba76") : secret "cinder-config-data" not found Mar 16 16:05:57 crc kubenswrapper[5120]: E0316 16:05:57.912599 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cinder-scripts: secret "cinder-scripts" not found Mar 16 16:05:57 crc kubenswrapper[5120]: E0316 16:05:57.912629 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8028a79-c5c3-420e-ac48-33a3991aba76-scripts podName:f8028a79-c5c3-420e-ac48-33a3991aba76 nodeName:}" failed. No retries permitted until 2026-03-16 16:05:59.912619628 +0000 UTC m=+2062.066551285 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "scripts" (UniqueName: "kubernetes.io/secret/f8028a79-c5c3-420e-ac48-33a3991aba76-scripts") pod "cinder-api-0" (UID: "f8028a79-c5c3-420e-ac48-33a3991aba76") : secret "cinder-scripts" not found Mar 16 16:05:57 crc kubenswrapper[5120]: E0316 16:05:57.912679 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cinder-api-config-data: secret "cinder-api-config-data" not found Mar 16 16:05:57 crc kubenswrapper[5120]: E0316 16:05:57.912705 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8028a79-c5c3-420e-ac48-33a3991aba76-config-data-custom podName:f8028a79-c5c3-420e-ac48-33a3991aba76 nodeName:}" failed. No retries permitted until 2026-03-16 16:05:59.91269728 +0000 UTC m=+2062.066628937 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "config-data-custom" (UniqueName: "kubernetes.io/secret/f8028a79-c5c3-420e-ac48-33a3991aba76-config-data-custom") pod "cinder-api-0" (UID: "f8028a79-c5c3-420e-ac48-33a3991aba76") : secret "cinder-api-config-data" not found Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.912954 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba9461bf-d0b6-45c1-bacf-eede3329fba0-config" (OuterVolumeSpecName: "config") pod "ba9461bf-d0b6-45c1-bacf-eede3329fba0" (UID: "ba9461bf-d0b6-45c1-bacf-eede3329fba0"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.913084 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba9461bf-d0b6-45c1-bacf-eede3329fba0-scripts" (OuterVolumeSpecName: "scripts") pod "ba9461bf-d0b6-45c1-bacf-eede3329fba0" (UID: "ba9461bf-d0b6-45c1-bacf-eede3329fba0"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.919899 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage05-crc" (OuterVolumeSpecName: "ovndbcluster-sb-etc-ovn") pod "ba9461bf-d0b6-45c1-bacf-eede3329fba0" (UID: "ba9461bf-d0b6-45c1-bacf-eede3329fba0"). InnerVolumeSpecName "local-storage05-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.926485 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba9461bf-d0b6-45c1-bacf-eede3329fba0-kube-api-access-r6lk9" (OuterVolumeSpecName: "kube-api-access-r6lk9") pod "ba9461bf-d0b6-45c1-bacf-eede3329fba0" (UID: "ba9461bf-d0b6-45c1-bacf-eede3329fba0"). InnerVolumeSpecName "kube-api-access-r6lk9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.967385 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba9461bf-d0b6-45c1-bacf-eede3329fba0-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ba9461bf-d0b6-45c1-bacf-eede3329fba0" (UID: "ba9461bf-d0b6-45c1-bacf-eede3329fba0"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.974746 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:05:57 crc kubenswrapper[5120]: I0316 16:05:57.974840 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.002786 5120 scope.go:117] "RemoveContainer" containerID="6e985df37ce55e86651cfeb329ddbafb296639ab6b1d1dbbdab70c1607984fe6" Mar 16 16:05:58 crc kubenswrapper[5120]: E0316 16:05:58.012268 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[ceilometer-tls-certs combined-ca-bundle config-data kube-api-access-xk676 scripts sg-core-conf-yaml], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openstack-kuttl-tests/ceilometer-0" podUID="030f81c1-4c0e-446e-959d-9912af124e3a" Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.016502 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r6lk9\" (UniqueName: \"kubernetes.io/projected/ba9461bf-d0b6-45c1-bacf-eede3329fba0-kube-api-access-r6lk9\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.016529 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ba9461bf-d0b6-45c1-bacf-eede3329fba0-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.016539 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ba9461bf-d0b6-45c1-bacf-eede3329fba0-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.016558 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") on node \"crc\" " Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.016567 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/ba9461bf-d0b6-45c1-bacf-eede3329fba0-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.023021 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.034747 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.036901 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-c76f59879-tpdpx" Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.044684 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba9461bf-d0b6-45c1-bacf-eede3329fba0-ovsdbserver-sb-tls-certs" (OuterVolumeSpecName: "ovsdbserver-sb-tls-certs") pod "ba9461bf-d0b6-45c1-bacf-eede3329fba0" (UID: "ba9461bf-d0b6-45c1-bacf-eede3329fba0"). InnerVolumeSpecName "ovsdbserver-sb-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.046492 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage05-crc" (UniqueName: "kubernetes.io/local-volume/local-storage05-crc") on node "crc" Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.099183 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba9461bf-d0b6-45c1-bacf-eede3329fba0-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "ba9461bf-d0b6-45c1-bacf-eede3329fba0" (UID: "ba9461bf-d0b6-45c1-bacf-eede3329fba0"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.117134 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ab84006c-23ad-4247-abe7-0d1016d65297-config-data\") pod \"ab84006c-23ad-4247-abe7-0d1016d65297\" (UID: \"ab84006c-23ad-4247-abe7-0d1016d65297\") " Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.117319 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fbltt\" (UniqueName: \"kubernetes.io/projected/ab84006c-23ad-4247-abe7-0d1016d65297-kube-api-access-fbltt\") pod \"ab84006c-23ad-4247-abe7-0d1016d65297\" (UID: \"ab84006c-23ad-4247-abe7-0d1016d65297\") " Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.117363 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/ab84006c-23ad-4247-abe7-0d1016d65297-config-data-custom\") pod \"ab84006c-23ad-4247-abe7-0d1016d65297\" (UID: \"ab84006c-23ad-4247-abe7-0d1016d65297\") " Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.117455 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ab84006c-23ad-4247-abe7-0d1016d65297-logs\") pod \"ab84006c-23ad-4247-abe7-0d1016d65297\" (UID: \"ab84006c-23ad-4247-abe7-0d1016d65297\") " Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.117585 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ab84006c-23ad-4247-abe7-0d1016d65297-combined-ca-bundle\") pod \"ab84006c-23ad-4247-abe7-0d1016d65297\" (UID: \"ab84006c-23ad-4247-abe7-0d1016d65297\") " Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.117789 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xk676\" (UniqueName: \"kubernetes.io/projected/030f81c1-4c0e-446e-959d-9912af124e3a-kube-api-access-xk676\") pod \"ceilometer-0\" (UID: \"030f81c1-4c0e-446e-959d-9912af124e3a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.117863 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/030f81c1-4c0e-446e-959d-9912af124e3a-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"030f81c1-4c0e-446e-959d-9912af124e3a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.117893 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/030f81c1-4c0e-446e-959d-9912af124e3a-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"030f81c1-4c0e-446e-959d-9912af124e3a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.117919 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/030f81c1-4c0e-446e-959d-9912af124e3a-config-data\") pod \"ceilometer-0\" (UID: \"030f81c1-4c0e-446e-959d-9912af124e3a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.117938 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/030f81c1-4c0e-446e-959d-9912af124e3a-scripts\") pod \"ceilometer-0\" (UID: \"030f81c1-4c0e-446e-959d-9912af124e3a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.118150 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/030f81c1-4c0e-446e-959d-9912af124e3a-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"030f81c1-4c0e-446e-959d-9912af124e3a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.118248 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.118264 5120 reconciler_common.go:299] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/ba9461bf-d0b6-45c1-bacf-eede3329fba0-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.118277 5120 reconciler_common.go:299] "Volume detached for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/ba9461bf-d0b6-45c1-bacf-eede3329fba0-ovsdbserver-sb-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:58 crc kubenswrapper[5120]: E0316 16:05:58.118348 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-ceilometer-internal-svc: secret "cert-ceilometer-internal-svc" not found Mar 16 16:05:58 crc kubenswrapper[5120]: E0316 16:05:58.118396 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/030f81c1-4c0e-446e-959d-9912af124e3a-ceilometer-tls-certs podName:030f81c1-4c0e-446e-959d-9912af124e3a nodeName:}" failed. No retries permitted until 2026-03-16 16:05:59.118381592 +0000 UTC m=+2061.272313239 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "ceilometer-tls-certs" (UniqueName: "kubernetes.io/secret/030f81c1-4c0e-446e-959d-9912af124e3a-ceilometer-tls-certs") pod "ceilometer-0" (UID: "030f81c1-4c0e-446e-959d-9912af124e3a") : secret "cert-ceilometer-internal-svc" not found Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.124259 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab84006c-23ad-4247-abe7-0d1016d65297-logs" (OuterVolumeSpecName: "logs") pod "ab84006c-23ad-4247-abe7-0d1016d65297" (UID: "ab84006c-23ad-4247-abe7-0d1016d65297"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:05:58 crc kubenswrapper[5120]: E0316 16:05:58.126321 5120 projected.go:194] Error preparing data for projected volume kube-api-access-xk676 for pod openstack-kuttl-tests/ceilometer-0: failed to fetch token: serviceaccounts "telemetry-ceilometer" not found Mar 16 16:05:58 crc kubenswrapper[5120]: E0316 16:05:58.126385 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/030f81c1-4c0e-446e-959d-9912af124e3a-kube-api-access-xk676 podName:030f81c1-4c0e-446e-959d-9912af124e3a nodeName:}" failed. No retries permitted until 2026-03-16 16:05:59.12636644 +0000 UTC m=+2061.280298097 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-xk676" (UniqueName: "kubernetes.io/projected/030f81c1-4c0e-446e-959d-9912af124e3a-kube-api-access-xk676") pod "ceilometer-0" (UID: "030f81c1-4c0e-446e-959d-9912af124e3a") : failed to fetch token: serviceaccounts "telemetry-ceilometer" not found Mar 16 16:05:58 crc kubenswrapper[5120]: E0316 16:05:58.126714 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/ceilometer-config-data: secret "ceilometer-config-data" not found Mar 16 16:05:58 crc kubenswrapper[5120]: E0316 16:05:58.126745 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/030f81c1-4c0e-446e-959d-9912af124e3a-config-data podName:030f81c1-4c0e-446e-959d-9912af124e3a nodeName:}" failed. No retries permitted until 2026-03-16 16:05:59.12673728 +0000 UTC m=+2061.280668937 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/secret/030f81c1-4c0e-446e-959d-9912af124e3a-config-data") pod "ceilometer-0" (UID: "030f81c1-4c0e-446e-959d-9912af124e3a") : secret "ceilometer-config-data" not found Mar 16 16:05:58 crc kubenswrapper[5120]: E0316 16:05:58.126796 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/ceilometer-config-data: secret "ceilometer-config-data" not found Mar 16 16:05:58 crc kubenswrapper[5120]: E0316 16:05:58.126815 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/030f81c1-4c0e-446e-959d-9912af124e3a-sg-core-conf-yaml podName:030f81c1-4c0e-446e-959d-9912af124e3a nodeName:}" failed. No retries permitted until 2026-03-16 16:05:59.126808802 +0000 UTC m=+2061.280740459 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "sg-core-conf-yaml" (UniqueName: "kubernetes.io/secret/030f81c1-4c0e-446e-959d-9912af124e3a-sg-core-conf-yaml") pod "ceilometer-0" (UID: "030f81c1-4c0e-446e-959d-9912af124e3a") : secret "ceilometer-config-data" not found Mar 16 16:05:58 crc kubenswrapper[5120]: E0316 16:05:58.126846 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 16:05:58 crc kubenswrapper[5120]: E0316 16:05:58.126865 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/030f81c1-4c0e-446e-959d-9912af124e3a-combined-ca-bundle podName:030f81c1-4c0e-446e-959d-9912af124e3a nodeName:}" failed. No retries permitted until 2026-03-16 16:05:59.126860223 +0000 UTC m=+2061.280791870 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/030f81c1-4c0e-446e-959d-9912af124e3a-combined-ca-bundle") pod "ceilometer-0" (UID: "030f81c1-4c0e-446e-959d-9912af124e3a") : secret "combined-ca-bundle" not found Mar 16 16:05:58 crc kubenswrapper[5120]: E0316 16:05:58.126899 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/ceilometer-scripts: secret "ceilometer-scripts" not found Mar 16 16:05:58 crc kubenswrapper[5120]: E0316 16:05:58.126916 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/030f81c1-4c0e-446e-959d-9912af124e3a-scripts podName:030f81c1-4c0e-446e-959d-9912af124e3a nodeName:}" failed. No retries permitted until 2026-03-16 16:05:59.126911675 +0000 UTC m=+2061.280843332 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "scripts" (UniqueName: "kubernetes.io/secret/030f81c1-4c0e-446e-959d-9912af124e3a-scripts") pod "ceilometer-0" (UID: "030f81c1-4c0e-446e-959d-9912af124e3a") : secret "ceilometer-scripts" not found Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.132162 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab84006c-23ad-4247-abe7-0d1016d65297-kube-api-access-fbltt" (OuterVolumeSpecName: "kube-api-access-fbltt") pod "ab84006c-23ad-4247-abe7-0d1016d65297" (UID: "ab84006c-23ad-4247-abe7-0d1016d65297"). InnerVolumeSpecName "kube-api-access-fbltt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.135208 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ab84006c-23ad-4247-abe7-0d1016d65297-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "ab84006c-23ad-4247-abe7-0d1016d65297" (UID: "ab84006c-23ad-4247-abe7-0d1016d65297"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.167702 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ab84006c-23ad-4247-abe7-0d1016d65297-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ab84006c-23ad-4247-abe7-0d1016d65297" (UID: "ab84006c-23ad-4247-abe7-0d1016d65297"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.171796 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ab84006c-23ad-4247-abe7-0d1016d65297-config-data" (OuterVolumeSpecName: "config-data") pod "ab84006c-23ad-4247-abe7-0d1016d65297" (UID: "ab84006c-23ad-4247-abe7-0d1016d65297"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.221416 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ab84006c-23ad-4247-abe7-0d1016d65297-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.221448 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ab84006c-23ad-4247-abe7-0d1016d65297-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.221458 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ab84006c-23ad-4247-abe7-0d1016d65297-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.221467 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fbltt\" (UniqueName: \"kubernetes.io/projected/ab84006c-23ad-4247-abe7-0d1016d65297-kube-api-access-fbltt\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.221476 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/ab84006c-23ad-4247-abe7-0d1016d65297-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.345586 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.375155 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.410133 5120 scope.go:117] "RemoveContainer" containerID="6f1d0f5762f66532294471c478da1e90478aa8e63f3a52ffb5466af1e5e246c7" Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.424451 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.424999 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/dcd99b91-243d-46cd-beb8-76527d308b62-openstack-config-secret\") pod \"dcd99b91-243d-46cd-beb8-76527d308b62\" (UID: \"dcd99b91-243d-46cd-beb8-76527d308b62\") " Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.425091 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"efc5b4b3-507b-4f7b-9524-621ff45c12a6\" (UID: \"efc5b4b3-507b-4f7b-9524-621ff45c12a6\") " Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.425141 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dcd99b91-243d-46cd-beb8-76527d308b62-combined-ca-bundle\") pod \"dcd99b91-243d-46cd-beb8-76527d308b62\" (UID: \"dcd99b91-243d-46cd-beb8-76527d308b62\") " Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.425221 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/efc5b4b3-507b-4f7b-9524-621ff45c12a6-httpd-run\") pod \"efc5b4b3-507b-4f7b-9524-621ff45c12a6\" (UID: \"efc5b4b3-507b-4f7b-9524-621ff45c12a6\") " Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.425250 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/efc5b4b3-507b-4f7b-9524-621ff45c12a6-scripts\") pod \"efc5b4b3-507b-4f7b-9524-621ff45c12a6\" (UID: \"efc5b4b3-507b-4f7b-9524-621ff45c12a6\") " Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.425272 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/dcd99b91-243d-46cd-beb8-76527d308b62-openstack-config\") pod \"dcd99b91-243d-46cd-beb8-76527d308b62\" (UID: \"dcd99b91-243d-46cd-beb8-76527d308b62\") " Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.425293 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/efc5b4b3-507b-4f7b-9524-621ff45c12a6-logs\") pod \"efc5b4b3-507b-4f7b-9524-621ff45c12a6\" (UID: \"efc5b4b3-507b-4f7b-9524-621ff45c12a6\") " Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.425365 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g4sss\" (UniqueName: \"kubernetes.io/projected/efc5b4b3-507b-4f7b-9524-621ff45c12a6-kube-api-access-g4sss\") pod \"efc5b4b3-507b-4f7b-9524-621ff45c12a6\" (UID: \"efc5b4b3-507b-4f7b-9524-621ff45c12a6\") " Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.425444 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/efc5b4b3-507b-4f7b-9524-621ff45c12a6-internal-tls-certs\") pod \"efc5b4b3-507b-4f7b-9524-621ff45c12a6\" (UID: \"efc5b4b3-507b-4f7b-9524-621ff45c12a6\") " Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.425520 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/efc5b4b3-507b-4f7b-9524-621ff45c12a6-config-data\") pod \"efc5b4b3-507b-4f7b-9524-621ff45c12a6\" (UID: \"efc5b4b3-507b-4f7b-9524-621ff45c12a6\") " Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.425565 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/efc5b4b3-507b-4f7b-9524-621ff45c12a6-combined-ca-bundle\") pod \"efc5b4b3-507b-4f7b-9524-621ff45c12a6\" (UID: \"efc5b4b3-507b-4f7b-9524-621ff45c12a6\") " Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.425703 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rd7st\" (UniqueName: \"kubernetes.io/projected/dcd99b91-243d-46cd-beb8-76527d308b62-kube-api-access-rd7st\") pod \"dcd99b91-243d-46cd-beb8-76527d308b62\" (UID: \"dcd99b91-243d-46cd-beb8-76527d308b62\") " Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.425720 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/efc5b4b3-507b-4f7b-9524-621ff45c12a6-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "efc5b4b3-507b-4f7b-9524-621ff45c12a6" (UID: "efc5b4b3-507b-4f7b-9524-621ff45c12a6"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.427859 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/efc5b4b3-507b-4f7b-9524-621ff45c12a6-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.428608 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/efc5b4b3-507b-4f7b-9524-621ff45c12a6-logs" (OuterVolumeSpecName: "logs") pod "efc5b4b3-507b-4f7b-9524-621ff45c12a6" (UID: "efc5b4b3-507b-4f7b-9524-621ff45c12a6"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.439996 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/efc5b4b3-507b-4f7b-9524-621ff45c12a6-scripts" (OuterVolumeSpecName: "scripts") pod "efc5b4b3-507b-4f7b-9524-621ff45c12a6" (UID: "efc5b4b3-507b-4f7b-9524-621ff45c12a6"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.440657 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage09-crc" (OuterVolumeSpecName: "glance") pod "efc5b4b3-507b-4f7b-9524-621ff45c12a6" (UID: "efc5b4b3-507b-4f7b-9524-621ff45c12a6"). InnerVolumeSpecName "local-storage09-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.440846 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/efc5b4b3-507b-4f7b-9524-621ff45c12a6-kube-api-access-g4sss" (OuterVolumeSpecName: "kube-api-access-g4sss") pod "efc5b4b3-507b-4f7b-9524-621ff45c12a6" (UID: "efc5b4b3-507b-4f7b-9524-621ff45c12a6"). InnerVolumeSpecName "kube-api-access-g4sss". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.450000 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dcd99b91-243d-46cd-beb8-76527d308b62-kube-api-access-rd7st" (OuterVolumeSpecName: "kube-api-access-rd7st") pod "dcd99b91-243d-46cd-beb8-76527d308b62" (UID: "dcd99b91-243d-46cd-beb8-76527d308b62"). InnerVolumeSpecName "kube-api-access-rd7st". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.456743 5120 scope.go:117] "RemoveContainer" containerID="d8ebe2d4ddfb0a9cea2a5d26051fad69b766700efa153b18ebda89d66de2709d" Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.484675 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-l8vn4"] Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.498975 5120 generic.go:358] "Generic (PLEG): container finished" podID="52c2852f-8732-4310-8402-b925b49a12ea" containerID="4e202a31ccedf17053edeb22d44409d0b1d73cbca98af3319d183a5acfbde57c" exitCode=0 Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.499019 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"52c2852f-8732-4310-8402-b925b49a12ea","Type":"ContainerDied","Data":"4e202a31ccedf17053edeb22d44409d0b1d73cbca98af3319d183a5acfbde57c"} Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.501093 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-c76f59879-tpdpx" event={"ID":"ab84006c-23ad-4247-abe7-0d1016d65297","Type":"ContainerDied","Data":"acada8089eb9f47179fa97b10d5836616181a8a10a52af098feb5ad0ffc525f3"} Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.501175 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-c76f59879-tpdpx" Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.503124 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.508505 5120 generic.go:358] "Generic (PLEG): container finished" podID="4e3ac124-ebc3-4631-a7b1-5dc135748d5d" containerID="310b308ba52fcab67cf2c502456c2de0465f9ee7f89783de5324d7ed344a0950" exitCode=143 Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.508563 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"4e3ac124-ebc3-4631-a7b1-5dc135748d5d","Type":"ContainerDied","Data":"310b308ba52fcab67cf2c502456c2de0465f9ee7f89783de5324d7ed344a0950"} Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.510402 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.511997 5120 generic.go:358] "Generic (PLEG): container finished" podID="f0da01d8-8d71-47f3-9ec8-73dd0aabe316" containerID="b2628ee32787319a15d501d9f10281fc7f6881d6eb55598e18e00b9a947c19f6" exitCode=143 Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.512092 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-7469b9f4cf-grmhg" event={"ID":"f0da01d8-8d71-47f3-9ec8-73dd0aabe316","Type":"ContainerDied","Data":"b2628ee32787319a15d501d9f10281fc7f6881d6eb55598e18e00b9a947c19f6"} Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.513307 5120 generic.go:358] "Generic (PLEG): container finished" podID="7fc6bd2b-b3c9-42e9-b7f5-c2aef4997e6c" containerID="dacff6fc847fdebd6d8ee7408f52597ea61ec912f45e06fc013aa5067459105a" exitCode=143 Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.513401 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-64d4b879f4-bbkqw" event={"ID":"7fc6bd2b-b3c9-42e9-b7f5-c2aef4997e6c","Type":"ContainerDied","Data":"dacff6fc847fdebd6d8ee7408f52597ea61ec912f45e06fc013aa5067459105a"} Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.515419 5120 generic.go:358] "Generic (PLEG): container finished" podID="a4bd1853-26f2-4b40-8a3d-3ae70282ab88" containerID="cc696eb8b901e5eb41cdc48434815341e805d7fe5aaf6f4c4e042c349eba69f7" exitCode=143 Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.515517 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-5dd49d988b-vcz2l" event={"ID":"a4bd1853-26f2-4b40-8a3d-3ae70282ab88","Type":"ContainerDied","Data":"cc696eb8b901e5eb41cdc48434815341e805d7fe5aaf6f4c4e042c349eba69f7"} Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.520744 5120 generic.go:358] "Generic (PLEG): container finished" podID="502b04b6-fe65-4be1-847c-172941719e46" containerID="500f344bc8320a64252eb3717ce8847a36e2bdc36c2206a38cd7cf09aa08ed3a" exitCode=0 Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.520802 5120 generic.go:358] "Generic (PLEG): container finished" podID="502b04b6-fe65-4be1-847c-172941719e46" containerID="e2f06c71fb4d23c856b18d6f3d945870a0ff7ae00f7fb9467dfd44c1eb0c3f68" exitCode=0 Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.520884 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-87b69bc94-qlznl" event={"ID":"502b04b6-fe65-4be1-847c-172941719e46","Type":"ContainerDied","Data":"500f344bc8320a64252eb3717ce8847a36e2bdc36c2206a38cd7cf09aa08ed3a"} Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.520959 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-87b69bc94-qlznl" event={"ID":"502b04b6-fe65-4be1-847c-172941719e46","Type":"ContainerDied","Data":"e2f06c71fb4d23c856b18d6f3d945870a0ff7ae00f7fb9467dfd44c1eb0c3f68"} Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.522370 5120 generic.go:358] "Generic (PLEG): container finished" podID="277044e1-8761-49a5-9b8c-c7bfa9aab448" containerID="d1c6a1d2fa78339ecd013f346592c0e6029d63013756dda5a3e91db4f117b7e1" exitCode=0 Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.522443 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"277044e1-8761-49a5-9b8c-c7bfa9aab448","Type":"ContainerDied","Data":"d1c6a1d2fa78339ecd013f346592c0e6029d63013756dda5a3e91db4f117b7e1"} Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.524816 5120 scope.go:117] "RemoveContainer" containerID="cdc147d80656cda5bf5c1c16abcc7aa843b3b309337641361dde69e6baf74a24" Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.528752 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"c1c401a6-a61c-45bf-b9a2-c99abf5bc72e","Type":"ContainerStarted","Data":"0c16f787f148c1a8396186623c178c7e2406248d3427a3c9a19308855b44a4cb"} Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.528790 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/52c2852f-8732-4310-8402-b925b49a12ea-vencrypt-tls-certs\") pod \"52c2852f-8732-4310-8402-b925b49a12ea\" (UID: \"52c2852f-8732-4310-8402-b925b49a12ea\") " Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.528855 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/bf18fdee-b4c7-4582-adad-7025308e294a-kube-state-metrics-tls-certs\") pod \"bf18fdee-b4c7-4582-adad-7025308e294a\" (UID: \"bf18fdee-b4c7-4582-adad-7025308e294a\") " Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.528930 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="c1c401a6-a61c-45bf-b9a2-c99abf5bc72e" containerName="glance-log" containerID="cri-o://55f7c0a8dd3fb411516491f25d8f37988d6b1a6048217e2cb2d9a1a04990ab30" gracePeriod=30 Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.528960 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/bf18fdee-b4c7-4582-adad-7025308e294a-kube-state-metrics-tls-config\") pod \"bf18fdee-b4c7-4582-adad-7025308e294a\" (UID: \"bf18fdee-b4c7-4582-adad-7025308e294a\") " Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.529019 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bf18fdee-b4c7-4582-adad-7025308e294a-combined-ca-bundle\") pod \"bf18fdee-b4c7-4582-adad-7025308e294a\" (UID: \"bf18fdee-b4c7-4582-adad-7025308e294a\") " Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.529187 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="c1c401a6-a61c-45bf-b9a2-c99abf5bc72e" containerName="glance-httpd" containerID="cri-o://0c16f787f148c1a8396186623c178c7e2406248d3427a3c9a19308855b44a4cb" gracePeriod=30 Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.532954 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/52c2852f-8732-4310-8402-b925b49a12ea-config-data\") pod \"52c2852f-8732-4310-8402-b925b49a12ea\" (UID: \"52c2852f-8732-4310-8402-b925b49a12ea\") " Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.533273 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l62x9\" (UniqueName: \"kubernetes.io/projected/52c2852f-8732-4310-8402-b925b49a12ea-kube-api-access-l62x9\") pod \"52c2852f-8732-4310-8402-b925b49a12ea\" (UID: \"52c2852f-8732-4310-8402-b925b49a12ea\") " Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.533310 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-26cqj\" (UniqueName: \"kubernetes.io/projected/bf18fdee-b4c7-4582-adad-7025308e294a-kube-api-access-26cqj\") pod \"bf18fdee-b4c7-4582-adad-7025308e294a\" (UID: \"bf18fdee-b4c7-4582-adad-7025308e294a\") " Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.533379 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/52c2852f-8732-4310-8402-b925b49a12ea-combined-ca-bundle\") pod \"52c2852f-8732-4310-8402-b925b49a12ea\" (UID: \"52c2852f-8732-4310-8402-b925b49a12ea\") " Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.533422 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/52c2852f-8732-4310-8402-b925b49a12ea-nova-novncproxy-tls-certs\") pod \"52c2852f-8732-4310-8402-b925b49a12ea\" (UID: \"52c2852f-8732-4310-8402-b925b49a12ea\") " Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.535234 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/efc5b4b3-507b-4f7b-9524-621ff45c12a6-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.535252 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/efc5b4b3-507b-4f7b-9524-621ff45c12a6-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.535265 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g4sss\" (UniqueName: \"kubernetes.io/projected/efc5b4b3-507b-4f7b-9524-621ff45c12a6-kube-api-access-g4sss\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.535285 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rd7st\" (UniqueName: \"kubernetes.io/projected/dcd99b91-243d-46cd-beb8-76527d308b62-kube-api-access-rd7st\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.535304 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") on node \"crc\" " Mar 16 16:05:58 crc kubenswrapper[5120]: E0316 16:05:58.538655 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-cinder-public-svc: secret "cert-cinder-public-svc" not found Mar 16 16:05:58 crc kubenswrapper[5120]: E0316 16:05:58.538728 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8028a79-c5c3-420e-ac48-33a3991aba76-public-tls-certs podName:f8028a79-c5c3-420e-ac48-33a3991aba76 nodeName:}" failed. No retries permitted until 2026-03-16 16:06:02.538710262 +0000 UTC m=+2064.692641919 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/f8028a79-c5c3-420e-ac48-33a3991aba76-public-tls-certs") pod "cinder-api-0" (UID: "f8028a79-c5c3-420e-ac48-33a3991aba76") : secret "cert-cinder-public-svc" not found Mar 16 16:05:58 crc kubenswrapper[5120]: E0316 16:05:58.541553 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-cinder-internal-svc: secret "cert-cinder-internal-svc" not found Mar 16 16:05:58 crc kubenswrapper[5120]: E0316 16:05:58.541632 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8028a79-c5c3-420e-ac48-33a3991aba76-internal-tls-certs podName:f8028a79-c5c3-420e-ac48-33a3991aba76 nodeName:}" failed. No retries permitted until 2026-03-16 16:06:02.541611691 +0000 UTC m=+2064.695543338 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/f8028a79-c5c3-420e-ac48-33a3991aba76-internal-tls-certs") pod "cinder-api-0" (UID: "f8028a79-c5c3-420e-ac48-33a3991aba76") : secret "cert-cinder-internal-svc" not found Mar 16 16:05:58 crc kubenswrapper[5120]: E0316 16:05:58.541676 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 16:05:58 crc kubenswrapper[5120]: E0316 16:05:58.541705 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8028a79-c5c3-420e-ac48-33a3991aba76-combined-ca-bundle podName:f8028a79-c5c3-420e-ac48-33a3991aba76 nodeName:}" failed. No retries permitted until 2026-03-16 16:06:02.541696913 +0000 UTC m=+2064.695628570 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/f8028a79-c5c3-420e-ac48-33a3991aba76-combined-ca-bundle") pod "cinder-api-0" (UID: "f8028a79-c5c3-420e-ac48-33a3991aba76") : secret "combined-ca-bundle" not found Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.545966 5120 generic.go:358] "Generic (PLEG): container finished" podID="e8e4bade-e33d-4cc6-80ec-5f96e39c8f20" containerID="1a7116daa99aee53c27ccbc6b8927b279cc329e65d3b4f93760d164d6c9baf8a" exitCode=143 Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.546090 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"e8e4bade-e33d-4cc6-80ec-5f96e39c8f20","Type":"ContainerDied","Data":"1a7116daa99aee53c27ccbc6b8927b279cc329e65d3b4f93760d164d6c9baf8a"} Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.552248 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-c76f59879-tpdpx"] Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.555946 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-7g7vr" event={"ID":"4f18ae61-e496-433a-851f-3ac657fa2455","Type":"ContainerStarted","Data":"e5ec5c97b94b64c580566e796d432ecfc8b34d5cae3a96c3b1642795d929f914"} Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.556355 5120 kubelet_pods.go:1019] "Unable to retrieve pull secret, the image pull may not succeed." pod="openstack-kuttl-tests/root-account-create-update-7g7vr" secret="" err="secret \"galera-openstack-cell1-dockercfg-kmzcz\" not found" Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.569660 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf18fdee-b4c7-4582-adad-7025308e294a-kube-api-access-26cqj" (OuterVolumeSpecName: "kube-api-access-26cqj") pod "bf18fdee-b4c7-4582-adad-7025308e294a" (UID: "bf18fdee-b4c7-4582-adad-7025308e294a"). InnerVolumeSpecName "kube-api-access-26cqj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.574135 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/52c2852f-8732-4310-8402-b925b49a12ea-kube-api-access-l62x9" (OuterVolumeSpecName: "kube-api-access-l62x9") pod "52c2852f-8732-4310-8402-b925b49a12ea" (UID: "52c2852f-8732-4310-8402-b925b49a12ea"). InnerVolumeSpecName "kube-api-access-l62x9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.585560 5120 generic.go:358] "Generic (PLEG): container finished" podID="9d8004a6-f52b-420c-9f64-141dae970d7e" containerID="24a0dfb437371b7a9e2fbca989f638c6bbaab73772e7b7c295009200a6496677" exitCode=0 Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.585811 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-6b8df9c88d-rbjrz" event={"ID":"9d8004a6-f52b-420c-9f64-141dae970d7e","Type":"ContainerDied","Data":"24a0dfb437371b7a9e2fbca989f638c6bbaab73772e7b7c295009200a6496677"} Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.603701 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_ba9461bf-d0b6-45c1-bacf-eede3329fba0/ovsdbserver-sb/0.log" Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.603948 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"ba9461bf-d0b6-45c1-bacf-eede3329fba0","Type":"ContainerDied","Data":"3095b7513305558d1d4652440674a623e9261123d49bcfd6cb3f7b494f7d7965"} Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.604007 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.614858 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-worker-c76f59879-tpdpx"] Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.614969 5120 scope.go:117] "RemoveContainer" containerID="ee7c99e35f0ea6542759434ce015ae8518de8dfb907666327a5a872082e8e57b" Mar 16 16:05:58 crc kubenswrapper[5120]: E0316 16:05:58.615577 5120 kuberuntime_manager.go:1358] "Unhandled Error" err=< Mar 16 16:05:58 crc kubenswrapper[5120]: container &Container{Name:mariadb-account-create-update,Image:quay.io/podified-antelope-centos9/openstack-mariadb@sha256:4caef2b55e01b9a7ee88a22bc69db1893521a91d95c7ad4c8e593f14f17a5f95,Command:[/bin/sh -c #!/bin/bash Mar 16 16:05:58 crc kubenswrapper[5120]: Mar 16 16:05:58 crc kubenswrapper[5120]: MYSQL_REMOTE_HOST="" source /var/lib/operator-scripts/mysql_root_auth.sh Mar 16 16:05:58 crc kubenswrapper[5120]: Mar 16 16:05:58 crc kubenswrapper[5120]: export DatabasePassword=${DatabasePassword:?"Please specify a DatabasePassword variable."} Mar 16 16:05:58 crc kubenswrapper[5120]: Mar 16 16:05:58 crc kubenswrapper[5120]: MYSQL_CMD="mysql -h -u root -P 3306" Mar 16 16:05:58 crc kubenswrapper[5120]: Mar 16 16:05:58 crc kubenswrapper[5120]: if [ -n "" ]; then Mar 16 16:05:58 crc kubenswrapper[5120]: GRANT_DATABASE="" Mar 16 16:05:58 crc kubenswrapper[5120]: else Mar 16 16:05:58 crc kubenswrapper[5120]: GRANT_DATABASE="*" Mar 16 16:05:58 crc kubenswrapper[5120]: fi Mar 16 16:05:58 crc kubenswrapper[5120]: Mar 16 16:05:58 crc kubenswrapper[5120]: # going for maximum compatibility here: Mar 16 16:05:58 crc kubenswrapper[5120]: # 1. MySQL 8 no longer allows implicit create user when GRANT is used Mar 16 16:05:58 crc kubenswrapper[5120]: # 2. MariaDB has "CREATE OR REPLACE", but MySQL does not Mar 16 16:05:58 crc kubenswrapper[5120]: # 3. create user with CREATE but then do all password and TLS with ALTER to Mar 16 16:05:58 crc kubenswrapper[5120]: # support updates Mar 16 16:05:58 crc kubenswrapper[5120]: Mar 16 16:05:58 crc kubenswrapper[5120]: $MYSQL_CMD < logger="UnhandledError" Mar 16 16:05:58 crc kubenswrapper[5120]: E0316 16:05:58.617656 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"mariadb-account-create-update\" with CreateContainerConfigError: \"secret \\\"openstack-cell1-mariadb-root-db-secret\\\" not found\"" pod="openstack-kuttl-tests/root-account-create-update-7g7vr" podUID="4f18ae61-e496-433a-851f-3ac657fa2455" Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.627742 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage09-crc" (UniqueName: "kubernetes.io/local-volume/local-storage09-crc") on node "crc" Mar 16 16:05:58 crc kubenswrapper[5120]: E0316 16:05:58.641539 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-cell1-scripts: configmap "openstack-cell1-scripts" not found Mar 16 16:05:58 crc kubenswrapper[5120]: E0316 16:05:58.641614 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4f18ae61-e496-433a-851f-3ac657fa2455-operator-scripts podName:4f18ae61-e496-433a-851f-3ac657fa2455 nodeName:}" failed. No retries permitted until 2026-03-16 16:05:59.141592919 +0000 UTC m=+2061.295524576 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/4f18ae61-e496-433a-851f-3ac657fa2455-operator-scripts") pod "root-account-create-update-7g7vr" (UID: "4f18ae61-e496-433a-851f-3ac657fa2455") : configmap "openstack-cell1-scripts" not found Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.641784 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.641800 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l62x9\" (UniqueName: \"kubernetes.io/projected/52c2852f-8732-4310-8402-b925b49a12ea-kube-api-access-l62x9\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.641814 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-26cqj\" (UniqueName: \"kubernetes.io/projected/bf18fdee-b4c7-4582-adad-7025308e294a-kube-api-access-26cqj\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.644600 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dcd99b91-243d-46cd-beb8-76527d308b62-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "dcd99b91-243d-46cd-beb8-76527d308b62" (UID: "dcd99b91-243d-46cd-beb8-76527d308b62"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.648773 5120 generic.go:358] "Generic (PLEG): container finished" podID="efc5b4b3-507b-4f7b-9524-621ff45c12a6" containerID="826e018a02a787264e19107777830f87c35b2977f3638effba1fabc838449141" exitCode=0 Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.648923 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"efc5b4b3-507b-4f7b-9524-621ff45c12a6","Type":"ContainerDied","Data":"826e018a02a787264e19107777830f87c35b2977f3638effba1fabc838449141"} Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.648951 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"efc5b4b3-507b-4f7b-9524-621ff45c12a6","Type":"ContainerDied","Data":"d54009659cb3df3b96ffdc7ab91eeda40089ee15b6c6dc57a9f8a916d5260186"} Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.649103 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.649216 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-external-api-0" podStartSLOduration=6.649197406 podStartE2EDuration="6.649197406s" podCreationTimestamp="2026-03-16 16:05:52 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:05:58.568994188 +0000 UTC m=+2060.722947145" watchObservedRunningTime="2026-03-16 16:05:58.649197406 +0000 UTC m=+2060.803129063" Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.695050 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dcd99b91-243d-46cd-beb8-76527d308b62-openstack-config" (OuterVolumeSpecName: "openstack-config") pod "dcd99b91-243d-46cd-beb8-76527d308b62" (UID: "dcd99b91-243d-46cd-beb8-76527d308b62"). InnerVolumeSpecName "openstack-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.713018 5120 generic.go:358] "Generic (PLEG): container finished" podID="bf18fdee-b4c7-4582-adad-7025308e294a" containerID="2dafb1802184407cc6fca262f22606a9a38d289c9b6357255620abb0d8c59bbb" exitCode=2 Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.713615 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.719562 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dcd99b91-243d-46cd-beb8-76527d308b62-openstack-config-secret" (OuterVolumeSpecName: "openstack-config-secret") pod "dcd99b91-243d-46cd-beb8-76527d308b62" (UID: "dcd99b91-243d-46cd-beb8-76527d308b62"). InnerVolumeSpecName "openstack-config-secret". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.720371 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b0e3050-0f6f-47c8-a85a-92434db05b92" path="/var/lib/kubelet/pods/0b0e3050-0f6f-47c8-a85a-92434db05b92/volumes" Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.721296 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="17bda818-e2b3-45b5-9c0b-2626dadbeb45" path="/var/lib/kubelet/pods/17bda818-e2b3-45b5-9c0b-2626dadbeb45/volumes" Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.721832 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="34542a97-1318-45c8-a22f-6d4fd9c96846" path="/var/lib/kubelet/pods/34542a97-1318-45c8-a22f-6d4fd9c96846/volumes" Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.722331 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4ae71795-b884-4cc8-be0b-206084f8fafd" path="/var/lib/kubelet/pods/4ae71795-b884-4cc8-be0b-206084f8fafd/volumes" Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.722834 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="856d23a2-6b17-407a-a435-a89e7bc4c445" path="/var/lib/kubelet/pods/856d23a2-6b17-407a-a435-a89e7bc4c445/volumes" Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.723733 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a1e66b1-adb2-4ddb-bca1-257a1646ebda" path="/var/lib/kubelet/pods/8a1e66b1-adb2-4ddb-bca1-257a1646ebda/volumes" Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.724350 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93ddd6a0-2403-4b9b-9bc8-e5ac0592b1bc" path="/var/lib/kubelet/pods/93ddd6a0-2403-4b9b-9bc8-e5ac0592b1bc/volumes" Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.724903 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="979d8836-4381-4d52-97bc-b2b3d339e046" path="/var/lib/kubelet/pods/979d8836-4381-4d52-97bc-b2b3d339e046/volumes" Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.726278 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ab84006c-23ad-4247-abe7-0d1016d65297" path="/var/lib/kubelet/pods/ab84006c-23ad-4247-abe7-0d1016d65297/volumes" Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.727086 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b3cfedfb-c289-4e15-a017-b94faed25d78" path="/var/lib/kubelet/pods/b3cfedfb-c289-4e15-a017-b94faed25d78/volumes" Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.727583 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bb0a18f2-a95f-4ee1-b6a6-d0400f70760f" path="/var/lib/kubelet/pods/bb0a18f2-a95f-4ee1-b6a6-d0400f70760f/volumes" Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.737814 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c6ef2171-25f8-43d1-a037-b915f5b77abc" path="/var/lib/kubelet/pods/c6ef2171-25f8-43d1-a037-b915f5b77abc/volumes" Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.739631 5120 generic.go:358] "Generic (PLEG): container finished" podID="7e01ce77-a7e7-4f90-880f-fb2aa9b506a0" containerID="9e8ac2d972fd2f48d81b09afc5e8f49bb8db2874d893c57e7a8c058fd36b3ead" exitCode=0 Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.739744 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.740293 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="f8028a79-c5c3-420e-ac48-33a3991aba76" containerName="cinder-api-log" containerID="cri-o://d3ba9fee80a25c94a411c85c3313f845f1922efd50dc1f17b4b3834009a2c44c" gracePeriod=30 Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.740429 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="f8028a79-c5c3-420e-ac48-33a3991aba76" containerName="cinder-api" containerID="cri-o://35ec5a05bbc159911764272ba82d5bc63ef299314eb28a011b42096695ea946d" gracePeriod=30 Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.741207 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cda3f933-805e-46a5-b273-c63aaba14e07" path="/var/lib/kubelet/pods/cda3f933-805e-46a5-b273-c63aaba14e07/volumes" Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.743097 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/efc5b4b3-507b-4f7b-9524-621ff45c12a6-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "efc5b4b3-507b-4f7b-9524-621ff45c12a6" (UID: "efc5b4b3-507b-4f7b-9524-621ff45c12a6"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.745014 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dcd99b91-243d-46cd-beb8-76527d308b62" path="/var/lib/kubelet/pods/dcd99b91-243d-46cd-beb8-76527d308b62/volumes" Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.745529 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dcee9a4c-0584-41d7-ae1a-c6aa0417e113" path="/var/lib/kubelet/pods/dcee9a4c-0584-41d7-ae1a-c6aa0417e113/volumes" Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.748257 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dcd99b91-243d-46cd-beb8-76527d308b62-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.748279 5120 reconciler_common.go:299] "Volume detached for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/dcd99b91-243d-46cd-beb8-76527d308b62-openstack-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.748289 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/efc5b4b3-507b-4f7b-9524-621ff45c12a6-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.748298 5120 reconciler_common.go:299] "Volume detached for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/dcd99b91-243d-46cd-beb8-76527d308b62-openstack-config-secret\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.767117 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openstack-kuttl-tests/cinder-api-0" podUID="f8028a79-c5c3-420e-ac48-33a3991aba76" containerName="cinder-api" probeResult="failure" output="Get \"https://10.217.1.200:8776/healthcheck\": EOF" Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.767526 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/cinder-api-0" podUID="f8028a79-c5c3-420e-ac48-33a3991aba76" containerName="cinder-api" probeResult="failure" output="Get \"https://10.217.1.200:8776/healthcheck\": EOF" Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.785320 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bf18fdee-b4c7-4582-adad-7025308e294a-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "bf18fdee-b4c7-4582-adad-7025308e294a" (UID: "bf18fdee-b4c7-4582-adad-7025308e294a"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.830908 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/52c2852f-8732-4310-8402-b925b49a12ea-vencrypt-tls-certs" (OuterVolumeSpecName: "vencrypt-tls-certs") pod "52c2852f-8732-4310-8402-b925b49a12ea" (UID: "52c2852f-8732-4310-8402-b925b49a12ea"). InnerVolumeSpecName "vencrypt-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.838608 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/52c2852f-8732-4310-8402-b925b49a12ea-nova-novncproxy-tls-certs" (OuterVolumeSpecName: "nova-novncproxy-tls-certs") pod "52c2852f-8732-4310-8402-b925b49a12ea" (UID: "52c2852f-8732-4310-8402-b925b49a12ea"). InnerVolumeSpecName "nova-novncproxy-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.852553 5120 reconciler_common.go:299] "Volume detached for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/52c2852f-8732-4310-8402-b925b49a12ea-vencrypt-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.852601 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bf18fdee-b4c7-4582-adad-7025308e294a-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.852613 5120 reconciler_common.go:299] "Volume detached for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/52c2852f-8732-4310-8402-b925b49a12ea-nova-novncproxy-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.873078 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/52c2852f-8732-4310-8402-b925b49a12ea-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "52c2852f-8732-4310-8402-b925b49a12ea" (UID: "52c2852f-8732-4310-8402-b925b49a12ea"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.876297 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/52c2852f-8732-4310-8402-b925b49a12ea-config-data" (OuterVolumeSpecName: "config-data") pod "52c2852f-8732-4310-8402-b925b49a12ea" (UID: "52c2852f-8732-4310-8402-b925b49a12ea"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.876362 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/efc5b4b3-507b-4f7b-9524-621ff45c12a6-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "efc5b4b3-507b-4f7b-9524-621ff45c12a6" (UID: "efc5b4b3-507b-4f7b-9524-621ff45c12a6"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.930341 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bf18fdee-b4c7-4582-adad-7025308e294a-kube-state-metrics-tls-config" (OuterVolumeSpecName: "kube-state-metrics-tls-config") pod "bf18fdee-b4c7-4582-adad-7025308e294a" (UID: "bf18fdee-b4c7-4582-adad-7025308e294a"). InnerVolumeSpecName "kube-state-metrics-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.942933 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bf18fdee-b4c7-4582-adad-7025308e294a-kube-state-metrics-tls-certs" (OuterVolumeSpecName: "kube-state-metrics-tls-certs") pod "bf18fdee-b4c7-4582-adad-7025308e294a" (UID: "bf18fdee-b4c7-4582-adad-7025308e294a"). InnerVolumeSpecName "kube-state-metrics-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.971596 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"bf18fdee-b4c7-4582-adad-7025308e294a","Type":"ContainerDied","Data":"2dafb1802184407cc6fca262f22606a9a38d289c9b6357255620abb0d8c59bbb"} Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.971636 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"bf18fdee-b4c7-4582-adad-7025308e294a","Type":"ContainerDied","Data":"cb4985470b62aff5699121922eb399c52b88fb8921a75e967f76a866b024ffdf"} Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.971647 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7e01ce77-a7e7-4f90-880f-fb2aa9b506a0","Type":"ContainerDied","Data":"9e8ac2d972fd2f48d81b09afc5e8f49bb8db2874d893c57e7a8c058fd36b3ead"} Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.988923 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/efc5b4b3-507b-4f7b-9524-621ff45c12a6-config-data" (OuterVolumeSpecName: "config-data") pod "efc5b4b3-507b-4f7b-9524-621ff45c12a6" (UID: "efc5b4b3-507b-4f7b-9524-621ff45c12a6"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.989373 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/52c2852f-8732-4310-8402-b925b49a12ea-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.989392 5120 reconciler_common.go:299] "Volume detached for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/bf18fdee-b4c7-4582-adad-7025308e294a-kube-state-metrics-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.989405 5120 reconciler_common.go:299] "Volume detached for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/bf18fdee-b4c7-4582-adad-7025308e294a-kube-state-metrics-tls-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.989416 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/efc5b4b3-507b-4f7b-9524-621ff45c12a6-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.989427 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/efc5b4b3-507b-4f7b-9524-621ff45c12a6-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:58 crc kubenswrapper[5120]: I0316 16:05:58.989439 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/52c2852f-8732-4310-8402-b925b49a12ea-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.006523 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.026103 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.029861 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-87b69bc94-qlznl" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.037317 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.057068 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.067872 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.081690 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.199885 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/277044e1-8761-49a5-9b8c-c7bfa9aab448-galera-tls-certs\") pod \"277044e1-8761-49a5-9b8c-c7bfa9aab448\" (UID: \"277044e1-8761-49a5-9b8c-c7bfa9aab448\") " Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.199955 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/030f81c1-4c0e-446e-959d-9912af124e3a-log-httpd\") pod \"030f81c1-4c0e-446e-959d-9912af124e3a\" (UID: \"030f81c1-4c0e-446e-959d-9912af124e3a\") " Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.200015 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/030f81c1-4c0e-446e-959d-9912af124e3a-run-httpd\") pod \"030f81c1-4c0e-446e-959d-9912af124e3a\" (UID: \"030f81c1-4c0e-446e-959d-9912af124e3a\") " Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.200058 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r6svv\" (UniqueName: \"kubernetes.io/projected/277044e1-8761-49a5-9b8c-c7bfa9aab448-kube-api-access-r6svv\") pod \"277044e1-8761-49a5-9b8c-c7bfa9aab448\" (UID: \"277044e1-8761-49a5-9b8c-c7bfa9aab448\") " Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.200096 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/502b04b6-fe65-4be1-847c-172941719e46-run-httpd\") pod \"502b04b6-fe65-4be1-847c-172941719e46\" (UID: \"502b04b6-fe65-4be1-847c-172941719e46\") " Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.201107 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/277044e1-8761-49a5-9b8c-c7bfa9aab448-config-data-generated\") pod \"277044e1-8761-49a5-9b8c-c7bfa9aab448\" (UID: \"277044e1-8761-49a5-9b8c-c7bfa9aab448\") " Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.201146 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/502b04b6-fe65-4be1-847c-172941719e46-combined-ca-bundle\") pod \"502b04b6-fe65-4be1-847c-172941719e46\" (UID: \"502b04b6-fe65-4be1-847c-172941719e46\") " Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.201176 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/502b04b6-fe65-4be1-847c-172941719e46-public-tls-certs\") pod \"502b04b6-fe65-4be1-847c-172941719e46\" (UID: \"502b04b6-fe65-4be1-847c-172941719e46\") " Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.201235 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/277044e1-8761-49a5-9b8c-c7bfa9aab448-combined-ca-bundle\") pod \"277044e1-8761-49a5-9b8c-c7bfa9aab448\" (UID: \"277044e1-8761-49a5-9b8c-c7bfa9aab448\") " Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.201259 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kgptb\" (UniqueName: \"kubernetes.io/projected/502b04b6-fe65-4be1-847c-172941719e46-kube-api-access-kgptb\") pod \"502b04b6-fe65-4be1-847c-172941719e46\" (UID: \"502b04b6-fe65-4be1-847c-172941719e46\") " Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.201306 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"mysql-db\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"277044e1-8761-49a5-9b8c-c7bfa9aab448\" (UID: \"277044e1-8761-49a5-9b8c-c7bfa9aab448\") " Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.201394 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/277044e1-8761-49a5-9b8c-c7bfa9aab448-operator-scripts\") pod \"277044e1-8761-49a5-9b8c-c7bfa9aab448\" (UID: \"277044e1-8761-49a5-9b8c-c7bfa9aab448\") " Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.201447 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/502b04b6-fe65-4be1-847c-172941719e46-internal-tls-certs\") pod \"502b04b6-fe65-4be1-847c-172941719e46\" (UID: \"502b04b6-fe65-4be1-847c-172941719e46\") " Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.201494 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/277044e1-8761-49a5-9b8c-c7bfa9aab448-config-data-default\") pod \"277044e1-8761-49a5-9b8c-c7bfa9aab448\" (UID: \"277044e1-8761-49a5-9b8c-c7bfa9aab448\") " Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.201534 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/277044e1-8761-49a5-9b8c-c7bfa9aab448-kolla-config\") pod \"277044e1-8761-49a5-9b8c-c7bfa9aab448\" (UID: \"277044e1-8761-49a5-9b8c-c7bfa9aab448\") " Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.201616 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/502b04b6-fe65-4be1-847c-172941719e46-etc-swift\") pod \"502b04b6-fe65-4be1-847c-172941719e46\" (UID: \"502b04b6-fe65-4be1-847c-172941719e46\") " Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.201674 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/502b04b6-fe65-4be1-847c-172941719e46-log-httpd\") pod \"502b04b6-fe65-4be1-847c-172941719e46\" (UID: \"502b04b6-fe65-4be1-847c-172941719e46\") " Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.201710 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/502b04b6-fe65-4be1-847c-172941719e46-config-data\") pod \"502b04b6-fe65-4be1-847c-172941719e46\" (UID: \"502b04b6-fe65-4be1-847c-172941719e46\") " Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.204851 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/030f81c1-4c0e-446e-959d-9912af124e3a-config-data\") pod \"ceilometer-0\" (UID: \"030f81c1-4c0e-446e-959d-9912af124e3a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.204892 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/030f81c1-4c0e-446e-959d-9912af124e3a-scripts\") pod \"ceilometer-0\" (UID: \"030f81c1-4c0e-446e-959d-9912af124e3a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.205319 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/030f81c1-4c0e-446e-959d-9912af124e3a-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"030f81c1-4c0e-446e-959d-9912af124e3a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.205478 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xk676\" (UniqueName: \"kubernetes.io/projected/030f81c1-4c0e-446e-959d-9912af124e3a-kube-api-access-xk676\") pod \"ceilometer-0\" (UID: \"030f81c1-4c0e-446e-959d-9912af124e3a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.205554 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/030f81c1-4c0e-446e-959d-9912af124e3a-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"030f81c1-4c0e-446e-959d-9912af124e3a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.205577 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/030f81c1-4c0e-446e-959d-9912af124e3a-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"030f81c1-4c0e-446e-959d-9912af124e3a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:05:59 crc kubenswrapper[5120]: E0316 16:05:59.205712 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 16:05:59 crc kubenswrapper[5120]: E0316 16:05:59.206143 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/030f81c1-4c0e-446e-959d-9912af124e3a-combined-ca-bundle podName:030f81c1-4c0e-446e-959d-9912af124e3a nodeName:}" failed. No retries permitted until 2026-03-16 16:06:01.206125692 +0000 UTC m=+2063.360057349 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/030f81c1-4c0e-446e-959d-9912af124e3a-combined-ca-bundle") pod "ceilometer-0" (UID: "030f81c1-4c0e-446e-959d-9912af124e3a") : secret "combined-ca-bundle" not found Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.207118 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/277044e1-8761-49a5-9b8c-c7bfa9aab448-config-data-default" (OuterVolumeSpecName: "config-data-default") pod "277044e1-8761-49a5-9b8c-c7bfa9aab448" (UID: "277044e1-8761-49a5-9b8c-c7bfa9aab448"). InnerVolumeSpecName "config-data-default". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.209024 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/502b04b6-fe65-4be1-847c-172941719e46-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "502b04b6-fe65-4be1-847c-172941719e46" (UID: "502b04b6-fe65-4be1-847c-172941719e46"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.209744 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/277044e1-8761-49a5-9b8c-c7bfa9aab448-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "277044e1-8761-49a5-9b8c-c7bfa9aab448" (UID: "277044e1-8761-49a5-9b8c-c7bfa9aab448"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.212009 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/030f81c1-4c0e-446e-959d-9912af124e3a-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "030f81c1-4c0e-446e-959d-9912af124e3a" (UID: "030f81c1-4c0e-446e-959d-9912af124e3a"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:05:59 crc kubenswrapper[5120]: E0316 16:05:59.212114 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-cell1-scripts: configmap "openstack-cell1-scripts" not found Mar 16 16:05:59 crc kubenswrapper[5120]: E0316 16:05:59.212189 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4f18ae61-e496-433a-851f-3ac657fa2455-operator-scripts podName:4f18ae61-e496-433a-851f-3ac657fa2455 nodeName:}" failed. No retries permitted until 2026-03-16 16:06:00.212166878 +0000 UTC m=+2062.366098535 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/4f18ae61-e496-433a-851f-3ac657fa2455-operator-scripts") pod "root-account-create-update-7g7vr" (UID: "4f18ae61-e496-433a-851f-3ac657fa2455") : configmap "openstack-cell1-scripts" not found Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.212399 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/502b04b6-fe65-4be1-847c-172941719e46-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "502b04b6-fe65-4be1-847c-172941719e46" (UID: "502b04b6-fe65-4be1-847c-172941719e46"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.212813 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/030f81c1-4c0e-446e-959d-9912af124e3a-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "030f81c1-4c0e-446e-959d-9912af124e3a" (UID: "030f81c1-4c0e-446e-959d-9912af124e3a"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:05:59 crc kubenswrapper[5120]: E0316 16:05:59.216389 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/ceilometer-config-data: secret "ceilometer-config-data" not found Mar 16 16:05:59 crc kubenswrapper[5120]: E0316 16:05:59.216491 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/030f81c1-4c0e-446e-959d-9912af124e3a-config-data podName:030f81c1-4c0e-446e-959d-9912af124e3a nodeName:}" failed. No retries permitted until 2026-03-16 16:06:01.216465535 +0000 UTC m=+2063.370397192 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/secret/030f81c1-4c0e-446e-959d-9912af124e3a-config-data") pod "ceilometer-0" (UID: "030f81c1-4c0e-446e-959d-9912af124e3a") : secret "ceilometer-config-data" not found Mar 16 16:05:59 crc kubenswrapper[5120]: E0316 16:05:59.219341 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-ceilometer-internal-svc: secret "cert-ceilometer-internal-svc" not found Mar 16 16:05:59 crc kubenswrapper[5120]: E0316 16:05:59.219405 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/030f81c1-4c0e-446e-959d-9912af124e3a-ceilometer-tls-certs podName:030f81c1-4c0e-446e-959d-9912af124e3a nodeName:}" failed. No retries permitted until 2026-03-16 16:06:01.219387574 +0000 UTC m=+2063.373319231 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "ceilometer-tls-certs" (UniqueName: "kubernetes.io/secret/030f81c1-4c0e-446e-959d-9912af124e3a-ceilometer-tls-certs") pod "ceilometer-0" (UID: "030f81c1-4c0e-446e-959d-9912af124e3a") : secret "cert-ceilometer-internal-svc" not found Mar 16 16:05:59 crc kubenswrapper[5120]: E0316 16:05:59.219442 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-config-data: configmap "rabbitmq-config-data" not found Mar 16 16:05:59 crc kubenswrapper[5120]: E0316 16:05:59.219461 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/733010bf-0110-4a60-adf6-0f0ee336e96e-config-data podName:733010bf-0110-4a60-adf6-0f0ee336e96e nodeName:}" failed. No retries permitted until 2026-03-16 16:06:03.219455556 +0000 UTC m=+2065.373387213 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/733010bf-0110-4a60-adf6-0f0ee336e96e-config-data") pod "rabbitmq-server-0" (UID: "733010bf-0110-4a60-adf6-0f0ee336e96e") : configmap "rabbitmq-config-data" not found Mar 16 16:05:59 crc kubenswrapper[5120]: E0316 16:05:59.219496 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/ceilometer-config-data: secret "ceilometer-config-data" not found Mar 16 16:05:59 crc kubenswrapper[5120]: E0316 16:05:59.219512 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/030f81c1-4c0e-446e-959d-9912af124e3a-sg-core-conf-yaml podName:030f81c1-4c0e-446e-959d-9912af124e3a nodeName:}" failed. No retries permitted until 2026-03-16 16:06:01.219507118 +0000 UTC m=+2063.373438775 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "sg-core-conf-yaml" (UniqueName: "kubernetes.io/secret/030f81c1-4c0e-446e-959d-9912af124e3a-sg-core-conf-yaml") pod "ceilometer-0" (UID: "030f81c1-4c0e-446e-959d-9912af124e3a") : secret "ceilometer-config-data" not found Mar 16 16:05:59 crc kubenswrapper[5120]: E0316 16:05:59.219593 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/ceilometer-scripts: secret "ceilometer-scripts" not found Mar 16 16:05:59 crc kubenswrapper[5120]: E0316 16:05:59.219612 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/030f81c1-4c0e-446e-959d-9912af124e3a-scripts podName:030f81c1-4c0e-446e-959d-9912af124e3a nodeName:}" failed. No retries permitted until 2026-03-16 16:06:01.21960724 +0000 UTC m=+2063.373538897 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "scripts" (UniqueName: "kubernetes.io/secret/030f81c1-4c0e-446e-959d-9912af124e3a-scripts") pod "ceilometer-0" (UID: "030f81c1-4c0e-446e-959d-9912af124e3a") : secret "ceilometer-scripts" not found Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.221908 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/277044e1-8761-49a5-9b8c-c7bfa9aab448-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "277044e1-8761-49a5-9b8c-c7bfa9aab448" (UID: "277044e1-8761-49a5-9b8c-c7bfa9aab448"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.222046 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/277044e1-8761-49a5-9b8c-c7bfa9aab448-config-data-generated" (OuterVolumeSpecName: "config-data-generated") pod "277044e1-8761-49a5-9b8c-c7bfa9aab448" (UID: "277044e1-8761-49a5-9b8c-c7bfa9aab448"). InnerVolumeSpecName "config-data-generated". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:05:59 crc kubenswrapper[5120]: E0316 16:05:59.248006 5120 projected.go:194] Error preparing data for projected volume kube-api-access-xk676 for pod openstack-kuttl-tests/ceilometer-0: failed to fetch token: serviceaccounts "telemetry-ceilometer" not found Mar 16 16:05:59 crc kubenswrapper[5120]: E0316 16:05:59.248094 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/030f81c1-4c0e-446e-959d-9912af124e3a-kube-api-access-xk676 podName:030f81c1-4c0e-446e-959d-9912af124e3a nodeName:}" failed. No retries permitted until 2026-03-16 16:06:01.248057386 +0000 UTC m=+2063.401989043 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-xk676" (UniqueName: "kubernetes.io/projected/030f81c1-4c0e-446e-959d-9912af124e3a-kube-api-access-xk676") pod "ceilometer-0" (UID: "030f81c1-4c0e-446e-959d-9912af124e3a") : failed to fetch token: serviceaccounts "telemetry-ceilometer" not found Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.253702 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/502b04b6-fe65-4be1-847c-172941719e46-kube-api-access-kgptb" (OuterVolumeSpecName: "kube-api-access-kgptb") pod "502b04b6-fe65-4be1-847c-172941719e46" (UID: "502b04b6-fe65-4be1-847c-172941719e46"). InnerVolumeSpecName "kube-api-access-kgptb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.259948 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/277044e1-8761-49a5-9b8c-c7bfa9aab448-kube-api-access-r6svv" (OuterVolumeSpecName: "kube-api-access-r6svv") pod "277044e1-8761-49a5-9b8c-c7bfa9aab448" (UID: "277044e1-8761-49a5-9b8c-c7bfa9aab448"). InnerVolumeSpecName "kube-api-access-r6svv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.297599 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-bf50-account-create-update-cjqkk"] Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.322778 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/030f81c1-4c0e-446e-959d-9912af124e3a-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.322805 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/030f81c1-4c0e-446e-959d-9912af124e3a-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.322814 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r6svv\" (UniqueName: \"kubernetes.io/projected/277044e1-8761-49a5-9b8c-c7bfa9aab448-kube-api-access-r6svv\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.322822 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/502b04b6-fe65-4be1-847c-172941719e46-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.322831 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/277044e1-8761-49a5-9b8c-c7bfa9aab448-config-data-generated\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.322842 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kgptb\" (UniqueName: \"kubernetes.io/projected/502b04b6-fe65-4be1-847c-172941719e46-kube-api-access-kgptb\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.322851 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/277044e1-8761-49a5-9b8c-c7bfa9aab448-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.322861 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/277044e1-8761-49a5-9b8c-c7bfa9aab448-config-data-default\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.322869 5120 reconciler_common.go:299] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/277044e1-8761-49a5-9b8c-c7bfa9aab448-kolla-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.322877 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/502b04b6-fe65-4be1-847c-172941719e46-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.327874 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-bf50-account-create-update-cjqkk"] Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.353024 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-bf50-account-create-update-q29q7"] Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.354074 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab84006c-23ad-4247-abe7-0d1016d65297" containerName="barbican-worker-log" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.354088 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab84006c-23ad-4247-abe7-0d1016d65297" containerName="barbican-worker-log" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.354107 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efc5b4b3-507b-4f7b-9524-621ff45c12a6" containerName="glance-log" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.354113 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="efc5b4b3-507b-4f7b-9524-621ff45c12a6" containerName="glance-log" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.354125 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf18fdee-b4c7-4582-adad-7025308e294a" containerName="kube-state-metrics" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.354131 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf18fdee-b4c7-4582-adad-7025308e294a" containerName="kube-state-metrics" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.354144 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="502b04b6-fe65-4be1-847c-172941719e46" containerName="proxy-server" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.354150 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="502b04b6-fe65-4be1-847c-172941719e46" containerName="proxy-server" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.354159 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="502b04b6-fe65-4be1-847c-172941719e46" containerName="proxy-httpd" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.354164 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="502b04b6-fe65-4be1-847c-172941719e46" containerName="proxy-httpd" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.354177 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="277044e1-8761-49a5-9b8c-c7bfa9aab448" containerName="galera" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.354182 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="277044e1-8761-49a5-9b8c-c7bfa9aab448" containerName="galera" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.354188 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba9461bf-d0b6-45c1-bacf-eede3329fba0" containerName="ovsdbserver-sb" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.354195 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba9461bf-d0b6-45c1-bacf-eede3329fba0" containerName="ovsdbserver-sb" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.354220 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba9461bf-d0b6-45c1-bacf-eede3329fba0" containerName="openstack-network-exporter" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.354225 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba9461bf-d0b6-45c1-bacf-eede3329fba0" containerName="openstack-network-exporter" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.354233 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab84006c-23ad-4247-abe7-0d1016d65297" containerName="barbican-worker" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.354240 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab84006c-23ad-4247-abe7-0d1016d65297" containerName="barbican-worker" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.354263 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efc5b4b3-507b-4f7b-9524-621ff45c12a6" containerName="glance-httpd" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.354268 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="efc5b4b3-507b-4f7b-9524-621ff45c12a6" containerName="glance-httpd" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.354275 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="277044e1-8761-49a5-9b8c-c7bfa9aab448" containerName="mysql-bootstrap" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.354280 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="277044e1-8761-49a5-9b8c-c7bfa9aab448" containerName="mysql-bootstrap" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.354296 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52c2852f-8732-4310-8402-b925b49a12ea" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.354302 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="52c2852f-8732-4310-8402-b925b49a12ea" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.354443 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="efc5b4b3-507b-4f7b-9524-621ff45c12a6" containerName="glance-httpd" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.354451 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="52c2852f-8732-4310-8402-b925b49a12ea" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.354459 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ba9461bf-d0b6-45c1-bacf-eede3329fba0" containerName="ovsdbserver-sb" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.354472 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ab84006c-23ad-4247-abe7-0d1016d65297" containerName="barbican-worker-log" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.354481 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ab84006c-23ad-4247-abe7-0d1016d65297" containerName="barbican-worker" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.354487 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="502b04b6-fe65-4be1-847c-172941719e46" containerName="proxy-httpd" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.354498 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ba9461bf-d0b6-45c1-bacf-eede3329fba0" containerName="openstack-network-exporter" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.354508 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="277044e1-8761-49a5-9b8c-c7bfa9aab448" containerName="galera" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.354516 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="bf18fdee-b4c7-4582-adad-7025308e294a" containerName="kube-state-metrics" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.354524 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="efc5b4b3-507b-4f7b-9524-621ff45c12a6" containerName="glance-log" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.354533 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="502b04b6-fe65-4be1-847c-172941719e46" containerName="proxy-server" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.360954 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/502b04b6-fe65-4be1-847c-172941719e46-etc-swift" (OuterVolumeSpecName: "etc-swift") pod "502b04b6-fe65-4be1-847c-172941719e46" (UID: "502b04b6-fe65-4be1-847c-172941719e46"). InnerVolumeSpecName "etc-swift". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.370122 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage12-crc" (OuterVolumeSpecName: "mysql-db") pod "277044e1-8761-49a5-9b8c-c7bfa9aab448" (UID: "277044e1-8761-49a5-9b8c-c7bfa9aab448"). InnerVolumeSpecName "local-storage12-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.379696 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-fdvcj"] Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.379733 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-fdvcj"] Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.379751 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-5948cb6c79-mrnwx"] Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.380164 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/keystone-5948cb6c79-mrnwx" podUID="f0204257-b12d-4e9d-bdfd-e35cfaa598b5" containerName="keystone-api" containerID="cri-o://afad04760bdd0af215c87e7b8b243a24c1a39f569edf6c17dc353cb96619dc0c" gracePeriod=30 Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.380990 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bf50-account-create-update-q29q7" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.386681 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-db-secret\"" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.396956 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/277044e1-8761-49a5-9b8c-c7bfa9aab448-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "277044e1-8761-49a5-9b8c-c7bfa9aab448" (UID: "277044e1-8761-49a5-9b8c-c7bfa9aab448"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.397097 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bf50-account-create-update-q29q7"] Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.407199 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-nk29h"] Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.414199 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-nk29h"] Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.421634 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.425794 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbb24\" (UniqueName: \"kubernetes.io/projected/ce867319-e5ac-4d55-bf20-a2e66410a421-kube-api-access-cbb24\") pod \"keystone-bf50-account-create-update-q29q7\" (UID: \"ce867319-e5ac-4d55-bf20-a2e66410a421\") " pod="openstack-kuttl-tests/keystone-bf50-account-create-update-q29q7" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.426520 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ce867319-e5ac-4d55-bf20-a2e66410a421-operator-scripts\") pod \"keystone-bf50-account-create-update-q29q7\" (UID: \"ce867319-e5ac-4d55-bf20-a2e66410a421\") " pod="openstack-kuttl-tests/keystone-bf50-account-create-update-q29q7" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.426596 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/277044e1-8761-49a5-9b8c-c7bfa9aab448-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.426636 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") on node \"crc\" " Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.426648 5120 reconciler_common.go:299] "Volume detached for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/502b04b6-fe65-4be1-847c-172941719e46-etc-swift\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.453413 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage12-crc" (UniqueName: "kubernetes.io/local-volume/local-storage12-crc") on node "crc" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.475127 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/502b04b6-fe65-4be1-847c-172941719e46-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "502b04b6-fe65-4be1-847c-172941719e46" (UID: "502b04b6-fe65-4be1-847c-172941719e46"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.480321 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-bf50-account-create-update-q29q7"] Mar 16 16:05:59 crc kubenswrapper[5120]: E0316 16:05:59.481221 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-cbb24 operator-scripts], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openstack-kuttl-tests/keystone-bf50-account-create-update-q29q7" podUID="ce867319-e5ac-4d55-bf20-a2e66410a421" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.491325 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/277044e1-8761-49a5-9b8c-c7bfa9aab448-galera-tls-certs" (OuterVolumeSpecName: "galera-tls-certs") pod "277044e1-8761-49a5-9b8c-c7bfa9aab448" (UID: "277044e1-8761-49a5-9b8c-c7bfa9aab448"). InnerVolumeSpecName "galera-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.491394 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-db-create-6h4tj"] Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.493069 5120 scope.go:117] "RemoveContainer" containerID="2a93e12e3b4726773dd0561044adb6eaa04a60413b252ae3a7757a91ab1954d4" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.494690 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-db-create-6h4tj"] Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.514834 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.514900 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.528598 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cbb24\" (UniqueName: \"kubernetes.io/projected/ce867319-e5ac-4d55-bf20-a2e66410a421-kube-api-access-cbb24\") pod \"keystone-bf50-account-create-update-q29q7\" (UID: \"ce867319-e5ac-4d55-bf20-a2e66410a421\") " pod="openstack-kuttl-tests/keystone-bf50-account-create-update-q29q7" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.528737 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ce867319-e5ac-4d55-bf20-a2e66410a421-operator-scripts\") pod \"keystone-bf50-account-create-update-q29q7\" (UID: \"ce867319-e5ac-4d55-bf20-a2e66410a421\") " pod="openstack-kuttl-tests/keystone-bf50-account-create-update-q29q7" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.528826 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.528844 5120 reconciler_common.go:299] "Volume detached for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/277044e1-8761-49a5-9b8c-c7bfa9aab448-galera-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.528854 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/502b04b6-fe65-4be1-847c-172941719e46-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:59 crc kubenswrapper[5120]: E0316 16:05:59.528899 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Mar 16 16:05:59 crc kubenswrapper[5120]: E0316 16:05:59.528952 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ce867319-e5ac-4d55-bf20-a2e66410a421-operator-scripts podName:ce867319-e5ac-4d55-bf20-a2e66410a421 nodeName:}" failed. No retries permitted until 2026-03-16 16:06:00.028938901 +0000 UTC m=+2062.182870548 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/ce867319-e5ac-4d55-bf20-a2e66410a421-operator-scripts") pod "keystone-bf50-account-create-update-q29q7" (UID: "ce867319-e5ac-4d55-bf20-a2e66410a421") : configmap "openstack-scripts" not found Mar 16 16:05:59 crc kubenswrapper[5120]: E0316 16:05:59.532390 5120 projected.go:194] Error preparing data for projected volume kube-api-access-cbb24 for pod openstack-kuttl-tests/keystone-bf50-account-create-update-q29q7: failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 16:05:59 crc kubenswrapper[5120]: E0316 16:05:59.532455 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ce867319-e5ac-4d55-bf20-a2e66410a421-kube-api-access-cbb24 podName:ce867319-e5ac-4d55-bf20-a2e66410a421 nodeName:}" failed. No retries permitted until 2026-03-16 16:06:00.032438006 +0000 UTC m=+2062.186369663 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-cbb24" (UniqueName: "kubernetes.io/projected/ce867319-e5ac-4d55-bf20-a2e66410a421-kube-api-access-cbb24") pod "keystone-bf50-account-create-update-q29q7" (UID: "ce867319-e5ac-4d55-bf20-a2e66410a421") : failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.542604 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-55ec-account-create-update-dkz9b" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.543963 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/502b04b6-fe65-4be1-847c-172941719e46-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "502b04b6-fe65-4be1-847c-172941719e46" (UID: "502b04b6-fe65-4be1-847c-172941719e46"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.550327 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/502b04b6-fe65-4be1-847c-172941719e46-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "502b04b6-fe65-4be1-847c-172941719e46" (UID: "502b04b6-fe65-4be1-847c-172941719e46"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.553477 5120 scope.go:117] "RemoveContainer" containerID="1f2acf4bcbbfcbd0929a426315ec1f92411324559d0fd28dc4a7096a568d7d88" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.562853 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/502b04b6-fe65-4be1-847c-172941719e46-config-data" (OuterVolumeSpecName: "config-data") pod "502b04b6-fe65-4be1-847c-172941719e46" (UID: "502b04b6-fe65-4be1-847c-172941719e46"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.585039 5120 scope.go:117] "RemoveContainer" containerID="3678fb8176154d7514722017b6b95e451fd401e53bb4aa5093bc1a67d432bada" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.608517 5120 scope.go:117] "RemoveContainer" containerID="826e018a02a787264e19107777830f87c35b2977f3638effba1fabc838449141" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.631183 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s6fkg\" (UniqueName: \"kubernetes.io/projected/8d184805-87aa-4026-ac8b-a36076620a10-kube-api-access-s6fkg\") pod \"8d184805-87aa-4026-ac8b-a36076620a10\" (UID: \"8d184805-87aa-4026-ac8b-a36076620a10\") " Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.631341 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8d184805-87aa-4026-ac8b-a36076620a10-operator-scripts\") pod \"8d184805-87aa-4026-ac8b-a36076620a10\" (UID: \"8d184805-87aa-4026-ac8b-a36076620a10\") " Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.631888 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d184805-87aa-4026-ac8b-a36076620a10-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "8d184805-87aa-4026-ac8b-a36076620a10" (UID: "8d184805-87aa-4026-ac8b-a36076620a10"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.631903 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/502b04b6-fe65-4be1-847c-172941719e46-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.631961 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/502b04b6-fe65-4be1-847c-172941719e46-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.631974 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/502b04b6-fe65-4be1-847c-172941719e46-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.635403 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d184805-87aa-4026-ac8b-a36076620a10-kube-api-access-s6fkg" (OuterVolumeSpecName: "kube-api-access-s6fkg") pod "8d184805-87aa-4026-ac8b-a36076620a10" (UID: "8d184805-87aa-4026-ac8b-a36076620a10"). InnerVolumeSpecName "kube-api-access-s6fkg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.665669 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/openstack-galera-0" podUID="68f2feef-cf44-429c-a9be-314c030d3321" containerName="galera" containerID="cri-o://c683124880345205c66d9890cec10cea0579b1b47b25532fe5d6ff8e12cfc801" gracePeriod=30 Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.735283 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s6fkg\" (UniqueName: \"kubernetes.io/projected/8d184805-87aa-4026-ac8b-a36076620a10-kube-api-access-s6fkg\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.735324 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8d184805-87aa-4026-ac8b-a36076620a10-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.757034 5120 scope.go:117] "RemoveContainer" containerID="02893fdeddb9bac6b9de74b4a3bfe760717fd2af15213aafd5d06efdd9dfcf71" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.774150 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.774143 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"277044e1-8761-49a5-9b8c-c7bfa9aab448","Type":"ContainerDied","Data":"a32b0f79e810e1bedc5ce12cbb3877f2ef57760c4b4186dce70e5c57838c51ec"} Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.778284 5120 generic.go:358] "Generic (PLEG): container finished" podID="c1c401a6-a61c-45bf-b9a2-c99abf5bc72e" containerID="0c16f787f148c1a8396186623c178c7e2406248d3427a3c9a19308855b44a4cb" exitCode=0 Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.778318 5120 generic.go:358] "Generic (PLEG): container finished" podID="c1c401a6-a61c-45bf-b9a2-c99abf5bc72e" containerID="55f7c0a8dd3fb411516491f25d8f37988d6b1a6048217e2cb2d9a1a04990ab30" exitCode=143 Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.778374 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"c1c401a6-a61c-45bf-b9a2-c99abf5bc72e","Type":"ContainerDied","Data":"0c16f787f148c1a8396186623c178c7e2406248d3427a3c9a19308855b44a4cb"} Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.778427 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"c1c401a6-a61c-45bf-b9a2-c99abf5bc72e","Type":"ContainerDied","Data":"55f7c0a8dd3fb411516491f25d8f37988d6b1a6048217e2cb2d9a1a04990ab30"} Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.778452 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"c1c401a6-a61c-45bf-b9a2-c99abf5bc72e","Type":"ContainerDied","Data":"3c6173d29d75978a43cf46850703233a0f30a27ee3d27eb15a622e7a358da406"} Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.778466 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3c6173d29d75978a43cf46850703233a0f30a27ee3d27eb15a622e7a358da406" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.793719 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.795358 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-l8vn4" event={"ID":"26cb0730-b6af-4f60-baa0-3ce77a180060","Type":"ContainerStarted","Data":"802b4aae9cb24fe7d40aabbdf7d527409c92b9e8da55c54271cc4565e6c0860e"} Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.802098 5120 generic.go:358] "Generic (PLEG): container finished" podID="f8028a79-c5c3-420e-ac48-33a3991aba76" containerID="d3ba9fee80a25c94a411c85c3313f845f1922efd50dc1f17b4b3834009a2c44c" exitCode=143 Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.802171 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"f8028a79-c5c3-420e-ac48-33a3991aba76","Type":"ContainerDied","Data":"d3ba9fee80a25c94a411c85c3313f845f1922efd50dc1f17b4b3834009a2c44c"} Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.807265 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-55ec-account-create-update-dkz9b" event={"ID":"8d184805-87aa-4026-ac8b-a36076620a10","Type":"ContainerDied","Data":"19c0dfff3ca6c3da7fe90e6ade4606ace246c928af15f8c511630bab8ba075df"} Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.807352 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-55ec-account-create-update-dkz9b" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.811470 5120 scope.go:117] "RemoveContainer" containerID="826e018a02a787264e19107777830f87c35b2977f3638effba1fabc838449141" Mar 16 16:05:59 crc kubenswrapper[5120]: E0316 16:05:59.812618 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"826e018a02a787264e19107777830f87c35b2977f3638effba1fabc838449141\": container with ID starting with 826e018a02a787264e19107777830f87c35b2977f3638effba1fabc838449141 not found: ID does not exist" containerID="826e018a02a787264e19107777830f87c35b2977f3638effba1fabc838449141" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.812656 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"826e018a02a787264e19107777830f87c35b2977f3638effba1fabc838449141"} err="failed to get container status \"826e018a02a787264e19107777830f87c35b2977f3638effba1fabc838449141\": rpc error: code = NotFound desc = could not find container \"826e018a02a787264e19107777830f87c35b2977f3638effba1fabc838449141\": container with ID starting with 826e018a02a787264e19107777830f87c35b2977f3638effba1fabc838449141 not found: ID does not exist" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.812678 5120 scope.go:117] "RemoveContainer" containerID="02893fdeddb9bac6b9de74b4a3bfe760717fd2af15213aafd5d06efdd9dfcf71" Mar 16 16:05:59 crc kubenswrapper[5120]: E0316 16:05:59.813949 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"02893fdeddb9bac6b9de74b4a3bfe760717fd2af15213aafd5d06efdd9dfcf71\": container with ID starting with 02893fdeddb9bac6b9de74b4a3bfe760717fd2af15213aafd5d06efdd9dfcf71 not found: ID does not exist" containerID="02893fdeddb9bac6b9de74b4a3bfe760717fd2af15213aafd5d06efdd9dfcf71" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.813977 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02893fdeddb9bac6b9de74b4a3bfe760717fd2af15213aafd5d06efdd9dfcf71"} err="failed to get container status \"02893fdeddb9bac6b9de74b4a3bfe760717fd2af15213aafd5d06efdd9dfcf71\": rpc error: code = NotFound desc = could not find container \"02893fdeddb9bac6b9de74b4a3bfe760717fd2af15213aafd5d06efdd9dfcf71\": container with ID starting with 02893fdeddb9bac6b9de74b4a3bfe760717fd2af15213aafd5d06efdd9dfcf71 not found: ID does not exist" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.813993 5120 scope.go:117] "RemoveContainer" containerID="2dafb1802184407cc6fca262f22606a9a38d289c9b6357255620abb0d8c59bbb" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.814242 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.814260 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"52c2852f-8732-4310-8402-b925b49a12ea","Type":"ContainerDied","Data":"3a141b46969ecdbc7c353d87dd4d47de6ecaa5ff1cb38a8000083611fe0011f0"} Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.836352 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-87b69bc94-qlznl" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.836404 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-87b69bc94-qlznl" event={"ID":"502b04b6-fe65-4be1-847c-172941719e46","Type":"ContainerDied","Data":"e29adafa1020551359eef0e70335fb53fffa6284bb5acad7446fa3f82606ae63"} Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.836462 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bf50-account-create-update-q29q7" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.836776 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.837313 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c1c401a6-a61c-45bf-b9a2-c99abf5bc72e-config-data\") pod \"c1c401a6-a61c-45bf-b9a2-c99abf5bc72e\" (UID: \"c1c401a6-a61c-45bf-b9a2-c99abf5bc72e\") " Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.837728 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c1c401a6-a61c-45bf-b9a2-c99abf5bc72e-logs\") pod \"c1c401a6-a61c-45bf-b9a2-c99abf5bc72e\" (UID: \"c1c401a6-a61c-45bf-b9a2-c99abf5bc72e\") " Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.837792 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/c1c401a6-a61c-45bf-b9a2-c99abf5bc72e-httpd-run\") pod \"c1c401a6-a61c-45bf-b9a2-c99abf5bc72e\" (UID: \"c1c401a6-a61c-45bf-b9a2-c99abf5bc72e\") " Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.837861 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/c1c401a6-a61c-45bf-b9a2-c99abf5bc72e-public-tls-certs\") pod \"c1c401a6-a61c-45bf-b9a2-c99abf5bc72e\" (UID: \"c1c401a6-a61c-45bf-b9a2-c99abf5bc72e\") " Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.837936 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"c1c401a6-a61c-45bf-b9a2-c99abf5bc72e\" (UID: \"c1c401a6-a61c-45bf-b9a2-c99abf5bc72e\") " Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.837978 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v8wsc\" (UniqueName: \"kubernetes.io/projected/c1c401a6-a61c-45bf-b9a2-c99abf5bc72e-kube-api-access-v8wsc\") pod \"c1c401a6-a61c-45bf-b9a2-c99abf5bc72e\" (UID: \"c1c401a6-a61c-45bf-b9a2-c99abf5bc72e\") " Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.838030 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c1c401a6-a61c-45bf-b9a2-c99abf5bc72e-scripts\") pod \"c1c401a6-a61c-45bf-b9a2-c99abf5bc72e\" (UID: \"c1c401a6-a61c-45bf-b9a2-c99abf5bc72e\") " Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.838048 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c1c401a6-a61c-45bf-b9a2-c99abf5bc72e-combined-ca-bundle\") pod \"c1c401a6-a61c-45bf-b9a2-c99abf5bc72e\" (UID: \"c1c401a6-a61c-45bf-b9a2-c99abf5bc72e\") " Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.839659 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1c401a6-a61c-45bf-b9a2-c99abf5bc72e-logs" (OuterVolumeSpecName: "logs") pod "c1c401a6-a61c-45bf-b9a2-c99abf5bc72e" (UID: "c1c401a6-a61c-45bf-b9a2-c99abf5bc72e"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.840378 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1c401a6-a61c-45bf-b9a2-c99abf5bc72e-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "c1c401a6-a61c-45bf-b9a2-c99abf5bc72e" (UID: "c1c401a6-a61c-45bf-b9a2-c99abf5bc72e"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.850340 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1c401a6-a61c-45bf-b9a2-c99abf5bc72e-kube-api-access-v8wsc" (OuterVolumeSpecName: "kube-api-access-v8wsc") pod "c1c401a6-a61c-45bf-b9a2-c99abf5bc72e" (UID: "c1c401a6-a61c-45bf-b9a2-c99abf5bc72e"). InnerVolumeSpecName "kube-api-access-v8wsc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.852219 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage13-crc" (OuterVolumeSpecName: "glance") pod "c1c401a6-a61c-45bf-b9a2-c99abf5bc72e" (UID: "c1c401a6-a61c-45bf-b9a2-c99abf5bc72e"). InnerVolumeSpecName "local-storage13-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.858223 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.863906 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c1c401a6-a61c-45bf-b9a2-c99abf5bc72e-scripts" (OuterVolumeSpecName: "scripts") pod "c1c401a6-a61c-45bf-b9a2-c99abf5bc72e" (UID: "c1c401a6-a61c-45bf-b9a2-c99abf5bc72e"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.870487 5120 scope.go:117] "RemoveContainer" containerID="2dafb1802184407cc6fca262f22606a9a38d289c9b6357255620abb0d8c59bbb" Mar 16 16:05:59 crc kubenswrapper[5120]: E0316 16:05:59.874611 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2dafb1802184407cc6fca262f22606a9a38d289c9b6357255620abb0d8c59bbb\": container with ID starting with 2dafb1802184407cc6fca262f22606a9a38d289c9b6357255620abb0d8c59bbb not found: ID does not exist" containerID="2dafb1802184407cc6fca262f22606a9a38d289c9b6357255620abb0d8c59bbb" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.874722 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2dafb1802184407cc6fca262f22606a9a38d289c9b6357255620abb0d8c59bbb"} err="failed to get container status \"2dafb1802184407cc6fca262f22606a9a38d289c9b6357255620abb0d8c59bbb\": rpc error: code = NotFound desc = could not find container \"2dafb1802184407cc6fca262f22606a9a38d289c9b6357255620abb0d8c59bbb\": container with ID starting with 2dafb1802184407cc6fca262f22606a9a38d289c9b6357255620abb0d8c59bbb not found: ID does not exist" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.874847 5120 scope.go:117] "RemoveContainer" containerID="d1c6a1d2fa78339ecd013f346592c0e6029d63013756dda5a3e91db4f117b7e1" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.878544 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.886577 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.899808 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.902133 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c1c401a6-a61c-45bf-b9a2-c99abf5bc72e-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "c1c401a6-a61c-45bf-b9a2-c99abf5bc72e" (UID: "c1c401a6-a61c-45bf-b9a2-c99abf5bc72e"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.915867 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c1c401a6-a61c-45bf-b9a2-c99abf5bc72e-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "c1c401a6-a61c-45bf-b9a2-c99abf5bc72e" (UID: "c1c401a6-a61c-45bf-b9a2-c99abf5bc72e"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.922194 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-55ec-account-create-update-dkz9b"] Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.929133 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-55ec-account-create-update-dkz9b"] Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.932961 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c1c401a6-a61c-45bf-b9a2-c99abf5bc72e-config-data" (OuterVolumeSpecName: "config-data") pod "c1c401a6-a61c-45bf-b9a2-c99abf5bc72e" (UID: "c1c401a6-a61c-45bf-b9a2-c99abf5bc72e"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:05:59 crc kubenswrapper[5120]: E0316 16:05:59.941171 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cinder-config-data: secret "cinder-config-data" not found Mar 16 16:05:59 crc kubenswrapper[5120]: E0316 16:05:59.941236 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8028a79-c5c3-420e-ac48-33a3991aba76-config-data podName:f8028a79-c5c3-420e-ac48-33a3991aba76 nodeName:}" failed. No retries permitted until 2026-03-16 16:06:03.941220649 +0000 UTC m=+2066.095152316 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/secret/f8028a79-c5c3-420e-ac48-33a3991aba76-config-data") pod "cinder-api-0" (UID: "f8028a79-c5c3-420e-ac48-33a3991aba76") : secret "cinder-config-data" not found Mar 16 16:05:59 crc kubenswrapper[5120]: E0316 16:05:59.941525 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cinder-scripts: secret "cinder-scripts" not found Mar 16 16:05:59 crc kubenswrapper[5120]: E0316 16:05:59.941664 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8028a79-c5c3-420e-ac48-33a3991aba76-scripts podName:f8028a79-c5c3-420e-ac48-33a3991aba76 nodeName:}" failed. No retries permitted until 2026-03-16 16:06:03.941645812 +0000 UTC m=+2066.095577469 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "scripts" (UniqueName: "kubernetes.io/secret/f8028a79-c5c3-420e-ac48-33a3991aba76-scripts") pod "cinder-api-0" (UID: "f8028a79-c5c3-420e-ac48-33a3991aba76") : secret "cinder-scripts" not found Mar 16 16:05:59 crc kubenswrapper[5120]: E0316 16:05:59.941879 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cinder-api-config-data: secret "cinder-api-config-data" not found Mar 16 16:05:59 crc kubenswrapper[5120]: E0316 16:05:59.942463 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8028a79-c5c3-420e-ac48-33a3991aba76-config-data-custom podName:f8028a79-c5c3-420e-ac48-33a3991aba76 nodeName:}" failed. No retries permitted until 2026-03-16 16:06:03.942445823 +0000 UTC m=+2066.096377560 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "config-data-custom" (UniqueName: "kubernetes.io/secret/f8028a79-c5c3-420e-ac48-33a3991aba76-config-data-custom") pod "cinder-api-0" (UID: "f8028a79-c5c3-420e-ac48-33a3991aba76") : secret "cinder-api-config-data" not found Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.941532 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") on node \"crc\" " Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.942959 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v8wsc\" (UniqueName: \"kubernetes.io/projected/c1c401a6-a61c-45bf-b9a2-c99abf5bc72e-kube-api-access-v8wsc\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.943189 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c1c401a6-a61c-45bf-b9a2-c99abf5bc72e-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.943329 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c1c401a6-a61c-45bf-b9a2-c99abf5bc72e-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.943646 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c1c401a6-a61c-45bf-b9a2-c99abf5bc72e-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.943852 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c1c401a6-a61c-45bf-b9a2-c99abf5bc72e-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.944203 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/c1c401a6-a61c-45bf-b9a2-c99abf5bc72e-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.944350 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/c1c401a6-a61c-45bf-b9a2-c99abf5bc72e-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:05:59 crc kubenswrapper[5120]: I0316 16:05:59.965904 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage13-crc" (UniqueName: "kubernetes.io/local-volume/local-storage13-crc") on node "crc" Mar 16 16:06:00 crc kubenswrapper[5120]: I0316 16:06:00.057109 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cbb24\" (UniqueName: \"kubernetes.io/projected/ce867319-e5ac-4d55-bf20-a2e66410a421-kube-api-access-cbb24\") pod \"keystone-bf50-account-create-update-q29q7\" (UID: \"ce867319-e5ac-4d55-bf20-a2e66410a421\") " pod="openstack-kuttl-tests/keystone-bf50-account-create-update-q29q7" Mar 16 16:06:00 crc kubenswrapper[5120]: I0316 16:06:00.057252 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ce867319-e5ac-4d55-bf20-a2e66410a421-operator-scripts\") pod \"keystone-bf50-account-create-update-q29q7\" (UID: \"ce867319-e5ac-4d55-bf20-a2e66410a421\") " pod="openstack-kuttl-tests/keystone-bf50-account-create-update-q29q7" Mar 16 16:06:00 crc kubenswrapper[5120]: I0316 16:06:00.057321 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:00 crc kubenswrapper[5120]: E0316 16:06:00.057383 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Mar 16 16:06:00 crc kubenswrapper[5120]: E0316 16:06:00.057435 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ce867319-e5ac-4d55-bf20-a2e66410a421-operator-scripts podName:ce867319-e5ac-4d55-bf20-a2e66410a421 nodeName:}" failed. No retries permitted until 2026-03-16 16:06:01.05742257 +0000 UTC m=+2063.211354227 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/ce867319-e5ac-4d55-bf20-a2e66410a421-operator-scripts") pod "keystone-bf50-account-create-update-q29q7" (UID: "ce867319-e5ac-4d55-bf20-a2e66410a421") : configmap "openstack-scripts" not found Mar 16 16:06:00 crc kubenswrapper[5120]: I0316 16:06:00.057570 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bf50-account-create-update-q29q7" Mar 16 16:06:00 crc kubenswrapper[5120]: E0316 16:06:00.062225 5120 projected.go:194] Error preparing data for projected volume kube-api-access-cbb24 for pod openstack-kuttl-tests/keystone-bf50-account-create-update-q29q7: failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 16:06:00 crc kubenswrapper[5120]: E0316 16:06:00.062307 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ce867319-e5ac-4d55-bf20-a2e66410a421-kube-api-access-cbb24 podName:ce867319-e5ac-4d55-bf20-a2e66410a421 nodeName:}" failed. No retries permitted until 2026-03-16 16:06:01.062288803 +0000 UTC m=+2063.216220460 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-cbb24" (UniqueName: "kubernetes.io/projected/ce867319-e5ac-4d55-bf20-a2e66410a421-kube-api-access-cbb24") pod "keystone-bf50-account-create-update-q29q7" (UID: "ce867319-e5ac-4d55-bf20-a2e66410a421") : failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 16:06:00 crc kubenswrapper[5120]: I0316 16:06:00.083017 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-proxy-87b69bc94-qlznl"] Mar 16 16:06:00 crc kubenswrapper[5120]: I0316 16:06:00.097123 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/swift-proxy-87b69bc94-qlznl"] Mar 16 16:06:00 crc kubenswrapper[5120]: I0316 16:06:00.102274 5120 scope.go:117] "RemoveContainer" containerID="d6955eca3e6162a54848b65c3c6759493a8ebfb95a8d90de700706b55bb61b5e" Mar 16 16:06:00 crc kubenswrapper[5120]: I0316 16:06:00.147869 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-infra/auto-csr-approver-29561286-2qjw6"] Mar 16 16:06:00 crc kubenswrapper[5120]: I0316 16:06:00.150035 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1c401a6-a61c-45bf-b9a2-c99abf5bc72e" containerName="glance-httpd" Mar 16 16:06:00 crc kubenswrapper[5120]: I0316 16:06:00.150066 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1c401a6-a61c-45bf-b9a2-c99abf5bc72e" containerName="glance-httpd" Mar 16 16:06:00 crc kubenswrapper[5120]: I0316 16:06:00.150149 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1c401a6-a61c-45bf-b9a2-c99abf5bc72e" containerName="glance-log" Mar 16 16:06:00 crc kubenswrapper[5120]: I0316 16:06:00.150160 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1c401a6-a61c-45bf-b9a2-c99abf5bc72e" containerName="glance-log" Mar 16 16:06:00 crc kubenswrapper[5120]: I0316 16:06:00.150382 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c1c401a6-a61c-45bf-b9a2-c99abf5bc72e" containerName="glance-log" Mar 16 16:06:00 crc kubenswrapper[5120]: I0316 16:06:00.150404 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c1c401a6-a61c-45bf-b9a2-c99abf5bc72e" containerName="glance-httpd" Mar 16 16:06:00 crc kubenswrapper[5120]: I0316 16:06:00.154936 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:06:00 crc kubenswrapper[5120]: I0316 16:06:00.155065 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561286-2qjw6" Mar 16 16:06:00 crc kubenswrapper[5120]: I0316 16:06:00.157534 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"kube-root-ca.crt\"" Mar 16 16:06:00 crc kubenswrapper[5120]: I0316 16:06:00.157876 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-infra\"/\"csr-approver-sa-dockercfg-x2nsz\"" Mar 16 16:06:00 crc kubenswrapper[5120]: I0316 16:06:00.158028 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"openshift-service-ca.crt\"" Mar 16 16:06:00 crc kubenswrapper[5120]: I0316 16:06:00.160266 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:06:00 crc kubenswrapper[5120]: I0316 16:06:00.165951 5120 scope.go:117] "RemoveContainer" containerID="4e202a31ccedf17053edeb22d44409d0b1d73cbca98af3319d183a5acfbde57c" Mar 16 16:06:00 crc kubenswrapper[5120]: I0316 16:06:00.182722 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561286-2qjw6"] Mar 16 16:06:00 crc kubenswrapper[5120]: I0316 16:06:00.209201 5120 scope.go:117] "RemoveContainer" containerID="500f344bc8320a64252eb3717ce8847a36e2bdc36c2206a38cd7cf09aa08ed3a" Mar 16 16:06:00 crc kubenswrapper[5120]: I0316 16:06:00.242526 5120 scope.go:117] "RemoveContainer" containerID="e2f06c71fb4d23c856b18d6f3d945870a0ff7ae00f7fb9467dfd44c1eb0c3f68" Mar 16 16:06:00 crc kubenswrapper[5120]: I0316 16:06:00.251620 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-7g7vr" Mar 16 16:06:00 crc kubenswrapper[5120]: I0316 16:06:00.264580 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqdng\" (UniqueName: \"kubernetes.io/projected/d908918a-f75b-405a-8ba3-5faa341a849a-kube-api-access-cqdng\") pod \"auto-csr-approver-29561286-2qjw6\" (UID: \"d908918a-f75b-405a-8ba3-5faa341a849a\") " pod="openshift-infra/auto-csr-approver-29561286-2qjw6" Mar 16 16:06:00 crc kubenswrapper[5120]: I0316 16:06:00.264717 5120 reconciler_common.go:299] "Volume detached for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/030f81c1-4c0e-446e-959d-9912af124e3a-ceilometer-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:00 crc kubenswrapper[5120]: I0316 16:06:00.264731 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/030f81c1-4c0e-446e-959d-9912af124e3a-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:00 crc kubenswrapper[5120]: I0316 16:06:00.264740 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/030f81c1-4c0e-446e-959d-9912af124e3a-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:00 crc kubenswrapper[5120]: I0316 16:06:00.264751 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xk676\" (UniqueName: \"kubernetes.io/projected/030f81c1-4c0e-446e-959d-9912af124e3a-kube-api-access-xk676\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:00 crc kubenswrapper[5120]: I0316 16:06:00.264808 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/030f81c1-4c0e-446e-959d-9912af124e3a-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:00 crc kubenswrapper[5120]: I0316 16:06:00.264817 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/030f81c1-4c0e-446e-959d-9912af124e3a-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:00 crc kubenswrapper[5120]: E0316 16:06:00.264901 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-cell1-scripts: configmap "openstack-cell1-scripts" not found Mar 16 16:06:00 crc kubenswrapper[5120]: E0316 16:06:00.264948 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4f18ae61-e496-433a-851f-3ac657fa2455-operator-scripts podName:4f18ae61-e496-433a-851f-3ac657fa2455 nodeName:}" failed. No retries permitted until 2026-03-16 16:06:02.264932412 +0000 UTC m=+2064.418864069 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/4f18ae61-e496-433a-851f-3ac657fa2455-operator-scripts") pod "root-account-create-update-7g7vr" (UID: "4f18ae61-e496-433a-851f-3ac657fa2455") : configmap "openstack-cell1-scripts" not found Mar 16 16:06:00 crc kubenswrapper[5120]: I0316 16:06:00.366568 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qqnc8\" (UniqueName: \"kubernetes.io/projected/4f18ae61-e496-433a-851f-3ac657fa2455-kube-api-access-qqnc8\") pod \"4f18ae61-e496-433a-851f-3ac657fa2455\" (UID: \"4f18ae61-e496-433a-851f-3ac657fa2455\") " Mar 16 16:06:00 crc kubenswrapper[5120]: I0316 16:06:00.366640 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/4f18ae61-e496-433a-851f-3ac657fa2455-operator-scripts\") pod \"4f18ae61-e496-433a-851f-3ac657fa2455\" (UID: \"4f18ae61-e496-433a-851f-3ac657fa2455\") " Mar 16 16:06:00 crc kubenswrapper[5120]: I0316 16:06:00.367068 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cqdng\" (UniqueName: \"kubernetes.io/projected/d908918a-f75b-405a-8ba3-5faa341a849a-kube-api-access-cqdng\") pod \"auto-csr-approver-29561286-2qjw6\" (UID: \"d908918a-f75b-405a-8ba3-5faa341a849a\") " pod="openshift-infra/auto-csr-approver-29561286-2qjw6" Mar 16 16:06:00 crc kubenswrapper[5120]: I0316 16:06:00.367243 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f18ae61-e496-433a-851f-3ac657fa2455-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "4f18ae61-e496-433a-851f-3ac657fa2455" (UID: "4f18ae61-e496-433a-851f-3ac657fa2455"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:06:00 crc kubenswrapper[5120]: I0316 16:06:00.375448 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f18ae61-e496-433a-851f-3ac657fa2455-kube-api-access-qqnc8" (OuterVolumeSpecName: "kube-api-access-qqnc8") pod "4f18ae61-e496-433a-851f-3ac657fa2455" (UID: "4f18ae61-e496-433a-851f-3ac657fa2455"). InnerVolumeSpecName "kube-api-access-qqnc8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:06:00 crc kubenswrapper[5120]: I0316 16:06:00.384562 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqdng\" (UniqueName: \"kubernetes.io/projected/d908918a-f75b-405a-8ba3-5faa341a849a-kube-api-access-cqdng\") pod \"auto-csr-approver-29561286-2qjw6\" (UID: \"d908918a-f75b-405a-8ba3-5faa341a849a\") " pod="openshift-infra/auto-csr-approver-29561286-2qjw6" Mar 16 16:06:00 crc kubenswrapper[5120]: I0316 16:06:00.443464 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:06:00 crc kubenswrapper[5120]: I0316 16:06:00.468713 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/68f2feef-cf44-429c-a9be-314c030d3321-config-data-default\") pod \"68f2feef-cf44-429c-a9be-314c030d3321\" (UID: \"68f2feef-cf44-429c-a9be-314c030d3321\") " Mar 16 16:06:00 crc kubenswrapper[5120]: I0316 16:06:00.468836 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/68f2feef-cf44-429c-a9be-314c030d3321-operator-scripts\") pod \"68f2feef-cf44-429c-a9be-314c030d3321\" (UID: \"68f2feef-cf44-429c-a9be-314c030d3321\") " Mar 16 16:06:00 crc kubenswrapper[5120]: I0316 16:06:00.468941 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"mysql-db\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"68f2feef-cf44-429c-a9be-314c030d3321\" (UID: \"68f2feef-cf44-429c-a9be-314c030d3321\") " Mar 16 16:06:00 crc kubenswrapper[5120]: I0316 16:06:00.468991 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/68f2feef-cf44-429c-a9be-314c030d3321-galera-tls-certs\") pod \"68f2feef-cf44-429c-a9be-314c030d3321\" (UID: \"68f2feef-cf44-429c-a9be-314c030d3321\") " Mar 16 16:06:00 crc kubenswrapper[5120]: I0316 16:06:00.469064 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/68f2feef-cf44-429c-a9be-314c030d3321-config-data-generated\") pod \"68f2feef-cf44-429c-a9be-314c030d3321\" (UID: \"68f2feef-cf44-429c-a9be-314c030d3321\") " Mar 16 16:06:00 crc kubenswrapper[5120]: I0316 16:06:00.469103 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/68f2feef-cf44-429c-a9be-314c030d3321-combined-ca-bundle\") pod \"68f2feef-cf44-429c-a9be-314c030d3321\" (UID: \"68f2feef-cf44-429c-a9be-314c030d3321\") " Mar 16 16:06:00 crc kubenswrapper[5120]: I0316 16:06:00.469147 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/68f2feef-cf44-429c-a9be-314c030d3321-kolla-config\") pod \"68f2feef-cf44-429c-a9be-314c030d3321\" (UID: \"68f2feef-cf44-429c-a9be-314c030d3321\") " Mar 16 16:06:00 crc kubenswrapper[5120]: I0316 16:06:00.469260 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nw6vv\" (UniqueName: \"kubernetes.io/projected/68f2feef-cf44-429c-a9be-314c030d3321-kube-api-access-nw6vv\") pod \"68f2feef-cf44-429c-a9be-314c030d3321\" (UID: \"68f2feef-cf44-429c-a9be-314c030d3321\") " Mar 16 16:06:00 crc kubenswrapper[5120]: I0316 16:06:00.469704 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qqnc8\" (UniqueName: \"kubernetes.io/projected/4f18ae61-e496-433a-851f-3ac657fa2455-kube-api-access-qqnc8\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:00 crc kubenswrapper[5120]: I0316 16:06:00.469705 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68f2feef-cf44-429c-a9be-314c030d3321-config-data-default" (OuterVolumeSpecName: "config-data-default") pod "68f2feef-cf44-429c-a9be-314c030d3321" (UID: "68f2feef-cf44-429c-a9be-314c030d3321"). InnerVolumeSpecName "config-data-default". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:06:00 crc kubenswrapper[5120]: I0316 16:06:00.469723 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/4f18ae61-e496-433a-851f-3ac657fa2455-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:00 crc kubenswrapper[5120]: I0316 16:06:00.469837 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68f2feef-cf44-429c-a9be-314c030d3321-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "68f2feef-cf44-429c-a9be-314c030d3321" (UID: "68f2feef-cf44-429c-a9be-314c030d3321"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:06:00 crc kubenswrapper[5120]: I0316 16:06:00.470155 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68f2feef-cf44-429c-a9be-314c030d3321-config-data-generated" (OuterVolumeSpecName: "config-data-generated") pod "68f2feef-cf44-429c-a9be-314c030d3321" (UID: "68f2feef-cf44-429c-a9be-314c030d3321"). InnerVolumeSpecName "config-data-generated". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:06:00 crc kubenswrapper[5120]: I0316 16:06:00.470527 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68f2feef-cf44-429c-a9be-314c030d3321-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "68f2feef-cf44-429c-a9be-314c030d3321" (UID: "68f2feef-cf44-429c-a9be-314c030d3321"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:06:00 crc kubenswrapper[5120]: I0316 16:06:00.480237 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561286-2qjw6" Mar 16 16:06:00 crc kubenswrapper[5120]: E0316 16:06:00.500142 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="eaa8e905618c3287f78bbdda9d5b8e1d7a9ea191e193e106e08869701479bec0" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:06:00 crc kubenswrapper[5120]: E0316 16:06:00.502861 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="eaa8e905618c3287f78bbdda9d5b8e1d7a9ea191e193e106e08869701479bec0" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:06:00 crc kubenswrapper[5120]: E0316 16:06:00.504582 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="eaa8e905618c3287f78bbdda9d5b8e1d7a9ea191e193e106e08869701479bec0" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:06:00 crc kubenswrapper[5120]: E0316 16:06:00.504655 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="683d3459-b9fc-478c-b74e-c1a09fd45e4d" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 16:06:00 crc kubenswrapper[5120]: I0316 16:06:00.520621 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68f2feef-cf44-429c-a9be-314c030d3321-kube-api-access-nw6vv" (OuterVolumeSpecName: "kube-api-access-nw6vv") pod "68f2feef-cf44-429c-a9be-314c030d3321" (UID: "68f2feef-cf44-429c-a9be-314c030d3321"). InnerVolumeSpecName "kube-api-access-nw6vv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:06:00 crc kubenswrapper[5120]: I0316 16:06:00.525821 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage04-crc" (OuterVolumeSpecName: "mysql-db") pod "68f2feef-cf44-429c-a9be-314c030d3321" (UID: "68f2feef-cf44-429c-a9be-314c030d3321"). InnerVolumeSpecName "local-storage04-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:06:00 crc kubenswrapper[5120]: I0316 16:06:00.543800 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68f2feef-cf44-429c-a9be-314c030d3321-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "68f2feef-cf44-429c-a9be-314c030d3321" (UID: "68f2feef-cf44-429c-a9be-314c030d3321"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:06:00 crc kubenswrapper[5120]: I0316 16:06:00.556560 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68f2feef-cf44-429c-a9be-314c030d3321-galera-tls-certs" (OuterVolumeSpecName: "galera-tls-certs") pod "68f2feef-cf44-429c-a9be-314c030d3321" (UID: "68f2feef-cf44-429c-a9be-314c030d3321"). InnerVolumeSpecName "galera-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:06:00 crc kubenswrapper[5120]: I0316 16:06:00.573900 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/68f2feef-cf44-429c-a9be-314c030d3321-config-data-generated\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:00 crc kubenswrapper[5120]: I0316 16:06:00.573949 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/68f2feef-cf44-429c-a9be-314c030d3321-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:00 crc kubenswrapper[5120]: I0316 16:06:00.573960 5120 reconciler_common.go:299] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/68f2feef-cf44-429c-a9be-314c030d3321-kolla-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:00 crc kubenswrapper[5120]: I0316 16:06:00.573971 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nw6vv\" (UniqueName: \"kubernetes.io/projected/68f2feef-cf44-429c-a9be-314c030d3321-kube-api-access-nw6vv\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:00 crc kubenswrapper[5120]: I0316 16:06:00.573982 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/68f2feef-cf44-429c-a9be-314c030d3321-config-data-default\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:00 crc kubenswrapper[5120]: I0316 16:06:00.573991 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/68f2feef-cf44-429c-a9be-314c030d3321-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:00 crc kubenswrapper[5120]: I0316 16:06:00.574036 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") on node \"crc\" " Mar 16 16:06:00 crc kubenswrapper[5120]: I0316 16:06:00.574045 5120 reconciler_common.go:299] "Volume detached for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/68f2feef-cf44-429c-a9be-314c030d3321-galera-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:00 crc kubenswrapper[5120]: I0316 16:06:00.594090 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage04-crc" (UniqueName: "kubernetes.io/local-volume/local-storage04-crc") on node "crc" Mar 16 16:06:00 crc kubenswrapper[5120]: I0316 16:06:00.679001 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:00 crc kubenswrapper[5120]: I0316 16:06:00.683952 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="030f81c1-4c0e-446e-959d-9912af124e3a" path="/var/lib/kubelet/pods/030f81c1-4c0e-446e-959d-9912af124e3a/volumes" Mar 16 16:06:00 crc kubenswrapper[5120]: I0316 16:06:00.684934 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="277044e1-8761-49a5-9b8c-c7bfa9aab448" path="/var/lib/kubelet/pods/277044e1-8761-49a5-9b8c-c7bfa9aab448/volumes" Mar 16 16:06:00 crc kubenswrapper[5120]: I0316 16:06:00.685988 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="502b04b6-fe65-4be1-847c-172941719e46" path="/var/lib/kubelet/pods/502b04b6-fe65-4be1-847c-172941719e46/volumes" Mar 16 16:06:00 crc kubenswrapper[5120]: I0316 16:06:00.688086 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="52c2852f-8732-4310-8402-b925b49a12ea" path="/var/lib/kubelet/pods/52c2852f-8732-4310-8402-b925b49a12ea/volumes" Mar 16 16:06:00 crc kubenswrapper[5120]: I0316 16:06:00.689301 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" podUID="5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40" containerName="rabbitmq" probeResult="failure" output="dial tcp 10.217.1.77:5671: connect: connection refused" Mar 16 16:06:00 crc kubenswrapper[5120]: I0316 16:06:00.689482 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8d184805-87aa-4026-ac8b-a36076620a10" path="/var/lib/kubelet/pods/8d184805-87aa-4026-ac8b-a36076620a10/volumes" Mar 16 16:06:00 crc kubenswrapper[5120]: I0316 16:06:00.689597 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/rabbitmq-server-0" podUID="733010bf-0110-4a60-adf6-0f0ee336e96e" containerName="rabbitmq" probeResult="failure" output="dial tcp 10.217.1.76:5671: connect: connection refused" Mar 16 16:06:00 crc kubenswrapper[5120]: I0316 16:06:00.690627 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba9461bf-d0b6-45c1-bacf-eede3329fba0" path="/var/lib/kubelet/pods/ba9461bf-d0b6-45c1-bacf-eede3329fba0/volumes" Mar 16 16:06:00 crc kubenswrapper[5120]: I0316 16:06:00.691394 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bf18fdee-b4c7-4582-adad-7025308e294a" path="/var/lib/kubelet/pods/bf18fdee-b4c7-4582-adad-7025308e294a/volumes" Mar 16 16:06:00 crc kubenswrapper[5120]: I0316 16:06:00.693172 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c1ce97a2-4d10-4bf6-8e09-2ef5ec8b67ce" path="/var/lib/kubelet/pods/c1ce97a2-4d10-4bf6-8e09-2ef5ec8b67ce/volumes" Mar 16 16:06:00 crc kubenswrapper[5120]: I0316 16:06:00.694429 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb8bda64-dcf7-461e-a963-74aeeec060fd" path="/var/lib/kubelet/pods/cb8bda64-dcf7-461e-a963-74aeeec060fd/volumes" Mar 16 16:06:00 crc kubenswrapper[5120]: I0316 16:06:00.695975 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d104673f-f558-4205-9918-6eadf7543add" path="/var/lib/kubelet/pods/d104673f-f558-4205-9918-6eadf7543add/volumes" Mar 16 16:06:00 crc kubenswrapper[5120]: I0316 16:06:00.696642 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="db652175-15cd-4336-85a7-53cbb0cf505f" path="/var/lib/kubelet/pods/db652175-15cd-4336-85a7-53cbb0cf505f/volumes" Mar 16 16:06:00 crc kubenswrapper[5120]: I0316 16:06:00.697274 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="efc5b4b3-507b-4f7b-9524-621ff45c12a6" path="/var/lib/kubelet/pods/efc5b4b3-507b-4f7b-9524-621ff45c12a6/volumes" Mar 16 16:06:00 crc kubenswrapper[5120]: I0316 16:06:00.858582 5120 generic.go:358] "Generic (PLEG): container finished" podID="e8e4bade-e33d-4cc6-80ec-5f96e39c8f20" containerID="4d19035ffb723ffb2508178ff7d2cf820ceaca9202ab046e0e1c2483ac9ffe16" exitCode=0 Mar 16 16:06:00 crc kubenswrapper[5120]: I0316 16:06:00.858662 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"e8e4bade-e33d-4cc6-80ec-5f96e39c8f20","Type":"ContainerDied","Data":"4d19035ffb723ffb2508178ff7d2cf820ceaca9202ab046e0e1c2483ac9ffe16"} Mar 16 16:06:00 crc kubenswrapper[5120]: I0316 16:06:00.859847 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-7g7vr" Mar 16 16:06:00 crc kubenswrapper[5120]: I0316 16:06:00.859944 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-7g7vr" event={"ID":"4f18ae61-e496-433a-851f-3ac657fa2455","Type":"ContainerDied","Data":"e5ec5c97b94b64c580566e796d432ecfc8b34d5cae3a96c3b1642795d929f914"} Mar 16 16:06:00 crc kubenswrapper[5120]: I0316 16:06:00.863703 5120 generic.go:358] "Generic (PLEG): container finished" podID="26cb0730-b6af-4f60-baa0-3ce77a180060" containerID="a12e212cfd35e0f82f763be81ea2f0d9a0e7b1d3d8b36718315a116a76f1cf0a" exitCode=0 Mar 16 16:06:00 crc kubenswrapper[5120]: I0316 16:06:00.864051 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-l8vn4" event={"ID":"26cb0730-b6af-4f60-baa0-3ce77a180060","Type":"ContainerDied","Data":"a12e212cfd35e0f82f763be81ea2f0d9a0e7b1d3d8b36718315a116a76f1cf0a"} Mar 16 16:06:00 crc kubenswrapper[5120]: I0316 16:06:00.881330 5120 generic.go:358] "Generic (PLEG): container finished" podID="68f2feef-cf44-429c-a9be-314c030d3321" containerID="c683124880345205c66d9890cec10cea0579b1b47b25532fe5d6ff8e12cfc801" exitCode=0 Mar 16 16:06:00 crc kubenswrapper[5120]: I0316 16:06:00.881449 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:06:00 crc kubenswrapper[5120]: I0316 16:06:00.881472 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"68f2feef-cf44-429c-a9be-314c030d3321","Type":"ContainerDied","Data":"c683124880345205c66d9890cec10cea0579b1b47b25532fe5d6ff8e12cfc801"} Mar 16 16:06:00 crc kubenswrapper[5120]: I0316 16:06:00.881906 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"68f2feef-cf44-429c-a9be-314c030d3321","Type":"ContainerDied","Data":"0cbba51570bdc24dd150a9ee0a135a750f466e280dcddd3b0fca754b62a7486d"} Mar 16 16:06:00 crc kubenswrapper[5120]: I0316 16:06:00.881960 5120 scope.go:117] "RemoveContainer" containerID="c683124880345205c66d9890cec10cea0579b1b47b25532fe5d6ff8e12cfc801" Mar 16 16:06:00 crc kubenswrapper[5120]: I0316 16:06:00.894004 5120 generic.go:358] "Generic (PLEG): container finished" podID="a4bd1853-26f2-4b40-8a3d-3ae70282ab88" containerID="9d45a48840b6d7f38f5e8df07afcd62928246e625344537e93a0413d1c500491" exitCode=0 Mar 16 16:06:00 crc kubenswrapper[5120]: I0316 16:06:00.894152 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:06:00 crc kubenswrapper[5120]: I0316 16:06:00.894554 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-5dd49d988b-vcz2l" event={"ID":"a4bd1853-26f2-4b40-8a3d-3ae70282ab88","Type":"ContainerDied","Data":"9d45a48840b6d7f38f5e8df07afcd62928246e625344537e93a0413d1c500491"} Mar 16 16:06:00 crc kubenswrapper[5120]: I0316 16:06:00.894612 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bf50-account-create-update-q29q7" Mar 16 16:06:00 crc kubenswrapper[5120]: I0316 16:06:00.989442 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-7g7vr"] Mar 16 16:06:00 crc kubenswrapper[5120]: I0316 16:06:00.995905 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-7g7vr"] Mar 16 16:06:01 crc kubenswrapper[5120]: I0316 16:06:01.018752 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561286-2qjw6"] Mar 16 16:06:01 crc kubenswrapper[5120]: I0316 16:06:01.052548 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:06:01 crc kubenswrapper[5120]: I0316 16:06:01.055896 5120 scope.go:117] "RemoveContainer" containerID="dc94898b22a23f2568159753b77f4106cdb5582c395af6560bda6a973f764d6e" Mar 16 16:06:01 crc kubenswrapper[5120]: I0316 16:06:01.070005 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-5dd49d988b-vcz2l" Mar 16 16:06:01 crc kubenswrapper[5120]: I0316 16:06:01.091267 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/a4bd1853-26f2-4b40-8a3d-3ae70282ab88-public-tls-certs\") pod \"a4bd1853-26f2-4b40-8a3d-3ae70282ab88\" (UID: \"a4bd1853-26f2-4b40-8a3d-3ae70282ab88\") " Mar 16 16:06:01 crc kubenswrapper[5120]: I0316 16:06:01.091317 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a4bd1853-26f2-4b40-8a3d-3ae70282ab88-logs\") pod \"a4bd1853-26f2-4b40-8a3d-3ae70282ab88\" (UID: \"a4bd1853-26f2-4b40-8a3d-3ae70282ab88\") " Mar 16 16:06:01 crc kubenswrapper[5120]: I0316 16:06:01.091372 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e8e4bade-e33d-4cc6-80ec-5f96e39c8f20-config-data\") pod \"e8e4bade-e33d-4cc6-80ec-5f96e39c8f20\" (UID: \"e8e4bade-e33d-4cc6-80ec-5f96e39c8f20\") " Mar 16 16:06:01 crc kubenswrapper[5120]: I0316 16:06:01.091413 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/e8e4bade-e33d-4cc6-80ec-5f96e39c8f20-nova-metadata-tls-certs\") pod \"e8e4bade-e33d-4cc6-80ec-5f96e39c8f20\" (UID: \"e8e4bade-e33d-4cc6-80ec-5f96e39c8f20\") " Mar 16 16:06:01 crc kubenswrapper[5120]: I0316 16:06:01.091443 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7c64f\" (UniqueName: \"kubernetes.io/projected/a4bd1853-26f2-4b40-8a3d-3ae70282ab88-kube-api-access-7c64f\") pod \"a4bd1853-26f2-4b40-8a3d-3ae70282ab88\" (UID: \"a4bd1853-26f2-4b40-8a3d-3ae70282ab88\") " Mar 16 16:06:01 crc kubenswrapper[5120]: I0316 16:06:01.091609 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a4bd1853-26f2-4b40-8a3d-3ae70282ab88-config-data\") pod \"a4bd1853-26f2-4b40-8a3d-3ae70282ab88\" (UID: \"a4bd1853-26f2-4b40-8a3d-3ae70282ab88\") " Mar 16 16:06:01 crc kubenswrapper[5120]: I0316 16:06:01.091690 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/a4bd1853-26f2-4b40-8a3d-3ae70282ab88-config-data-custom\") pod \"a4bd1853-26f2-4b40-8a3d-3ae70282ab88\" (UID: \"a4bd1853-26f2-4b40-8a3d-3ae70282ab88\") " Mar 16 16:06:01 crc kubenswrapper[5120]: I0316 16:06:01.091814 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a4bd1853-26f2-4b40-8a3d-3ae70282ab88-combined-ca-bundle\") pod \"a4bd1853-26f2-4b40-8a3d-3ae70282ab88\" (UID: \"a4bd1853-26f2-4b40-8a3d-3ae70282ab88\") " Mar 16 16:06:01 crc kubenswrapper[5120]: I0316 16:06:01.091880 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e8e4bade-e33d-4cc6-80ec-5f96e39c8f20-logs\") pod \"e8e4bade-e33d-4cc6-80ec-5f96e39c8f20\" (UID: \"e8e4bade-e33d-4cc6-80ec-5f96e39c8f20\") " Mar 16 16:06:01 crc kubenswrapper[5120]: I0316 16:06:01.091932 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d2jt7\" (UniqueName: \"kubernetes.io/projected/e8e4bade-e33d-4cc6-80ec-5f96e39c8f20-kube-api-access-d2jt7\") pod \"e8e4bade-e33d-4cc6-80ec-5f96e39c8f20\" (UID: \"e8e4bade-e33d-4cc6-80ec-5f96e39c8f20\") " Mar 16 16:06:01 crc kubenswrapper[5120]: I0316 16:06:01.093470 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e8e4bade-e33d-4cc6-80ec-5f96e39c8f20-combined-ca-bundle\") pod \"e8e4bade-e33d-4cc6-80ec-5f96e39c8f20\" (UID: \"e8e4bade-e33d-4cc6-80ec-5f96e39c8f20\") " Mar 16 16:06:01 crc kubenswrapper[5120]: I0316 16:06:01.093558 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/a4bd1853-26f2-4b40-8a3d-3ae70282ab88-internal-tls-certs\") pod \"a4bd1853-26f2-4b40-8a3d-3ae70282ab88\" (UID: \"a4bd1853-26f2-4b40-8a3d-3ae70282ab88\") " Mar 16 16:06:01 crc kubenswrapper[5120]: I0316 16:06:01.093854 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cbb24\" (UniqueName: \"kubernetes.io/projected/ce867319-e5ac-4d55-bf20-a2e66410a421-kube-api-access-cbb24\") pod \"keystone-bf50-account-create-update-q29q7\" (UID: \"ce867319-e5ac-4d55-bf20-a2e66410a421\") " pod="openstack-kuttl-tests/keystone-bf50-account-create-update-q29q7" Mar 16 16:06:01 crc kubenswrapper[5120]: I0316 16:06:01.094083 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ce867319-e5ac-4d55-bf20-a2e66410a421-operator-scripts\") pod \"keystone-bf50-account-create-update-q29q7\" (UID: \"ce867319-e5ac-4d55-bf20-a2e66410a421\") " pod="openstack-kuttl-tests/keystone-bf50-account-create-update-q29q7" Mar 16 16:06:01 crc kubenswrapper[5120]: E0316 16:06:01.096572 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: object "openstack-kuttl-tests"/"openstack-scripts" not registered Mar 16 16:06:01 crc kubenswrapper[5120]: E0316 16:06:01.096640 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ce867319-e5ac-4d55-bf20-a2e66410a421-operator-scripts podName:ce867319-e5ac-4d55-bf20-a2e66410a421 nodeName:}" failed. No retries permitted until 2026-03-16 16:06:03.096625625 +0000 UTC m=+2065.250557282 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/ce867319-e5ac-4d55-bf20-a2e66410a421-operator-scripts") pod "keystone-bf50-account-create-update-q29q7" (UID: "ce867319-e5ac-4d55-bf20-a2e66410a421") : object "openstack-kuttl-tests"/"openstack-scripts" not registered Mar 16 16:06:01 crc kubenswrapper[5120]: I0316 16:06:01.099866 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a4bd1853-26f2-4b40-8a3d-3ae70282ab88-logs" (OuterVolumeSpecName: "logs") pod "a4bd1853-26f2-4b40-8a3d-3ae70282ab88" (UID: "a4bd1853-26f2-4b40-8a3d-3ae70282ab88"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:06:01 crc kubenswrapper[5120]: I0316 16:06:01.103449 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a4bd1853-26f2-4b40-8a3d-3ae70282ab88-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "a4bd1853-26f2-4b40-8a3d-3ae70282ab88" (UID: "a4bd1853-26f2-4b40-8a3d-3ae70282ab88"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:06:01 crc kubenswrapper[5120]: I0316 16:06:01.111699 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8e4bade-e33d-4cc6-80ec-5f96e39c8f20-kube-api-access-d2jt7" (OuterVolumeSpecName: "kube-api-access-d2jt7") pod "e8e4bade-e33d-4cc6-80ec-5f96e39c8f20" (UID: "e8e4bade-e33d-4cc6-80ec-5f96e39c8f20"). InnerVolumeSpecName "kube-api-access-d2jt7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:06:01 crc kubenswrapper[5120]: I0316 16:06:01.112740 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8e4bade-e33d-4cc6-80ec-5f96e39c8f20-logs" (OuterVolumeSpecName: "logs") pod "e8e4bade-e33d-4cc6-80ec-5f96e39c8f20" (UID: "e8e4bade-e33d-4cc6-80ec-5f96e39c8f20"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:06:01 crc kubenswrapper[5120]: E0316 16:06:01.113733 5120 projected.go:194] Error preparing data for projected volume kube-api-access-cbb24 for pod openstack-kuttl-tests/keystone-bf50-account-create-update-q29q7: failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 16:06:01 crc kubenswrapper[5120]: E0316 16:06:01.113886 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ce867319-e5ac-4d55-bf20-a2e66410a421-kube-api-access-cbb24 podName:ce867319-e5ac-4d55-bf20-a2e66410a421 nodeName:}" failed. No retries permitted until 2026-03-16 16:06:03.113869216 +0000 UTC m=+2065.267800873 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-cbb24" (UniqueName: "kubernetes.io/projected/ce867319-e5ac-4d55-bf20-a2e66410a421-kube-api-access-cbb24") pod "keystone-bf50-account-create-update-q29q7" (UID: "ce867319-e5ac-4d55-bf20-a2e66410a421") : failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 16:06:01 crc kubenswrapper[5120]: I0316 16:06:01.120970 5120 scope.go:117] "RemoveContainer" containerID="c683124880345205c66d9890cec10cea0579b1b47b25532fe5d6ff8e12cfc801" Mar 16 16:06:01 crc kubenswrapper[5120]: E0316 16:06:01.121897 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c683124880345205c66d9890cec10cea0579b1b47b25532fe5d6ff8e12cfc801\": container with ID starting with c683124880345205c66d9890cec10cea0579b1b47b25532fe5d6ff8e12cfc801 not found: ID does not exist" containerID="c683124880345205c66d9890cec10cea0579b1b47b25532fe5d6ff8e12cfc801" Mar 16 16:06:01 crc kubenswrapper[5120]: I0316 16:06:01.121946 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c683124880345205c66d9890cec10cea0579b1b47b25532fe5d6ff8e12cfc801"} err="failed to get container status \"c683124880345205c66d9890cec10cea0579b1b47b25532fe5d6ff8e12cfc801\": rpc error: code = NotFound desc = could not find container \"c683124880345205c66d9890cec10cea0579b1b47b25532fe5d6ff8e12cfc801\": container with ID starting with c683124880345205c66d9890cec10cea0579b1b47b25532fe5d6ff8e12cfc801 not found: ID does not exist" Mar 16 16:06:01 crc kubenswrapper[5120]: I0316 16:06:01.121972 5120 scope.go:117] "RemoveContainer" containerID="dc94898b22a23f2568159753b77f4106cdb5582c395af6560bda6a973f764d6e" Mar 16 16:06:01 crc kubenswrapper[5120]: E0316 16:06:01.123597 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc94898b22a23f2568159753b77f4106cdb5582c395af6560bda6a973f764d6e\": container with ID starting with dc94898b22a23f2568159753b77f4106cdb5582c395af6560bda6a973f764d6e not found: ID does not exist" containerID="dc94898b22a23f2568159753b77f4106cdb5582c395af6560bda6a973f764d6e" Mar 16 16:06:01 crc kubenswrapper[5120]: I0316 16:06:01.123634 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc94898b22a23f2568159753b77f4106cdb5582c395af6560bda6a973f764d6e"} err="failed to get container status \"dc94898b22a23f2568159753b77f4106cdb5582c395af6560bda6a973f764d6e\": rpc error: code = NotFound desc = could not find container \"dc94898b22a23f2568159753b77f4106cdb5582c395af6560bda6a973f764d6e\": container with ID starting with dc94898b22a23f2568159753b77f4106cdb5582c395af6560bda6a973f764d6e not found: ID does not exist" Mar 16 16:06:01 crc kubenswrapper[5120]: I0316 16:06:01.150175 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a4bd1853-26f2-4b40-8a3d-3ae70282ab88-kube-api-access-7c64f" (OuterVolumeSpecName: "kube-api-access-7c64f") pod "a4bd1853-26f2-4b40-8a3d-3ae70282ab88" (UID: "a4bd1853-26f2-4b40-8a3d-3ae70282ab88"). InnerVolumeSpecName "kube-api-access-7c64f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:06:01 crc kubenswrapper[5120]: I0316 16:06:01.153586 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-bf50-account-create-update-q29q7"] Mar 16 16:06:01 crc kubenswrapper[5120]: I0316 16:06:01.157702 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8e4bade-e33d-4cc6-80ec-5f96e39c8f20-config-data" (OuterVolumeSpecName: "config-data") pod "e8e4bade-e33d-4cc6-80ec-5f96e39c8f20" (UID: "e8e4bade-e33d-4cc6-80ec-5f96e39c8f20"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:06:01 crc kubenswrapper[5120]: I0316 16:06:01.160866 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a4bd1853-26f2-4b40-8a3d-3ae70282ab88-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "a4bd1853-26f2-4b40-8a3d-3ae70282ab88" (UID: "a4bd1853-26f2-4b40-8a3d-3ae70282ab88"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:06:01 crc kubenswrapper[5120]: I0316 16:06:01.161275 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-bf50-account-create-update-q29q7"] Mar 16 16:06:01 crc kubenswrapper[5120]: I0316 16:06:01.166915 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 16:06:01 crc kubenswrapper[5120]: I0316 16:06:01.170789 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 16:06:01 crc kubenswrapper[5120]: I0316 16:06:01.175436 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:06:01 crc kubenswrapper[5120]: I0316 16:06:01.180354 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:06:01 crc kubenswrapper[5120]: I0316 16:06:01.200615 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a4bd1853-26f2-4b40-8a3d-3ae70282ab88-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:01 crc kubenswrapper[5120]: I0316 16:06:01.200653 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cbb24\" (UniqueName: \"kubernetes.io/projected/ce867319-e5ac-4d55-bf20-a2e66410a421-kube-api-access-cbb24\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:01 crc kubenswrapper[5120]: I0316 16:06:01.200664 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e8e4bade-e33d-4cc6-80ec-5f96e39c8f20-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:01 crc kubenswrapper[5120]: I0316 16:06:01.200702 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7c64f\" (UniqueName: \"kubernetes.io/projected/a4bd1853-26f2-4b40-8a3d-3ae70282ab88-kube-api-access-7c64f\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:01 crc kubenswrapper[5120]: I0316 16:06:01.200715 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ce867319-e5ac-4d55-bf20-a2e66410a421-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:01 crc kubenswrapper[5120]: I0316 16:06:01.200725 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/a4bd1853-26f2-4b40-8a3d-3ae70282ab88-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:01 crc kubenswrapper[5120]: I0316 16:06:01.200733 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a4bd1853-26f2-4b40-8a3d-3ae70282ab88-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:01 crc kubenswrapper[5120]: I0316 16:06:01.200742 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e8e4bade-e33d-4cc6-80ec-5f96e39c8f20-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:01 crc kubenswrapper[5120]: I0316 16:06:01.200751 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d2jt7\" (UniqueName: \"kubernetes.io/projected/e8e4bade-e33d-4cc6-80ec-5f96e39c8f20-kube-api-access-d2jt7\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:01 crc kubenswrapper[5120]: I0316 16:06:01.227211 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8e4bade-e33d-4cc6-80ec-5f96e39c8f20-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e8e4bade-e33d-4cc6-80ec-5f96e39c8f20" (UID: "e8e4bade-e33d-4cc6-80ec-5f96e39c8f20"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:06:01 crc kubenswrapper[5120]: I0316 16:06:01.233001 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a4bd1853-26f2-4b40-8a3d-3ae70282ab88-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "a4bd1853-26f2-4b40-8a3d-3ae70282ab88" (UID: "a4bd1853-26f2-4b40-8a3d-3ae70282ab88"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:06:01 crc kubenswrapper[5120]: I0316 16:06:01.234920 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a4bd1853-26f2-4b40-8a3d-3ae70282ab88-config-data" (OuterVolumeSpecName: "config-data") pod "a4bd1853-26f2-4b40-8a3d-3ae70282ab88" (UID: "a4bd1853-26f2-4b40-8a3d-3ae70282ab88"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:06:01 crc kubenswrapper[5120]: I0316 16:06:01.249896 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8e4bade-e33d-4cc6-80ec-5f96e39c8f20-nova-metadata-tls-certs" (OuterVolumeSpecName: "nova-metadata-tls-certs") pod "e8e4bade-e33d-4cc6-80ec-5f96e39c8f20" (UID: "e8e4bade-e33d-4cc6-80ec-5f96e39c8f20"). InnerVolumeSpecName "nova-metadata-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:06:01 crc kubenswrapper[5120]: I0316 16:06:01.250402 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a4bd1853-26f2-4b40-8a3d-3ae70282ab88-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "a4bd1853-26f2-4b40-8a3d-3ae70282ab88" (UID: "a4bd1853-26f2-4b40-8a3d-3ae70282ab88"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:06:01 crc kubenswrapper[5120]: I0316 16:06:01.302951 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e8e4bade-e33d-4cc6-80ec-5f96e39c8f20-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:01 crc kubenswrapper[5120]: I0316 16:06:01.302981 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/a4bd1853-26f2-4b40-8a3d-3ae70282ab88-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:01 crc kubenswrapper[5120]: I0316 16:06:01.302990 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/a4bd1853-26f2-4b40-8a3d-3ae70282ab88-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:01 crc kubenswrapper[5120]: I0316 16:06:01.302998 5120 reconciler_common.go:299] "Volume detached for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/e8e4bade-e33d-4cc6-80ec-5f96e39c8f20-nova-metadata-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:01 crc kubenswrapper[5120]: I0316 16:06:01.303009 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a4bd1853-26f2-4b40-8a3d-3ae70282ab88-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:01 crc kubenswrapper[5120]: I0316 16:06:01.450165 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-fb69b7968-qskx5" Mar 16 16:06:01 crc kubenswrapper[5120]: I0316 16:06:01.505449 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/793f378f-ef31-443c-bb12-6d75a2140296-combined-ca-bundle\") pod \"793f378f-ef31-443c-bb12-6d75a2140296\" (UID: \"793f378f-ef31-443c-bb12-6d75a2140296\") " Mar 16 16:06:01 crc kubenswrapper[5120]: I0316 16:06:01.505702 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9vrbk\" (UniqueName: \"kubernetes.io/projected/793f378f-ef31-443c-bb12-6d75a2140296-kube-api-access-9vrbk\") pod \"793f378f-ef31-443c-bb12-6d75a2140296\" (UID: \"793f378f-ef31-443c-bb12-6d75a2140296\") " Mar 16 16:06:01 crc kubenswrapper[5120]: I0316 16:06:01.505785 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/793f378f-ef31-443c-bb12-6d75a2140296-internal-tls-certs\") pod \"793f378f-ef31-443c-bb12-6d75a2140296\" (UID: \"793f378f-ef31-443c-bb12-6d75a2140296\") " Mar 16 16:06:01 crc kubenswrapper[5120]: I0316 16:06:01.505813 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/793f378f-ef31-443c-bb12-6d75a2140296-public-tls-certs\") pod \"793f378f-ef31-443c-bb12-6d75a2140296\" (UID: \"793f378f-ef31-443c-bb12-6d75a2140296\") " Mar 16 16:06:01 crc kubenswrapper[5120]: I0316 16:06:01.505849 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/793f378f-ef31-443c-bb12-6d75a2140296-scripts\") pod \"793f378f-ef31-443c-bb12-6d75a2140296\" (UID: \"793f378f-ef31-443c-bb12-6d75a2140296\") " Mar 16 16:06:01 crc kubenswrapper[5120]: I0316 16:06:01.505969 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/793f378f-ef31-443c-bb12-6d75a2140296-logs\") pod \"793f378f-ef31-443c-bb12-6d75a2140296\" (UID: \"793f378f-ef31-443c-bb12-6d75a2140296\") " Mar 16 16:06:01 crc kubenswrapper[5120]: I0316 16:06:01.506164 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/793f378f-ef31-443c-bb12-6d75a2140296-config-data\") pod \"793f378f-ef31-443c-bb12-6d75a2140296\" (UID: \"793f378f-ef31-443c-bb12-6d75a2140296\") " Mar 16 16:06:01 crc kubenswrapper[5120]: I0316 16:06:01.508036 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/793f378f-ef31-443c-bb12-6d75a2140296-logs" (OuterVolumeSpecName: "logs") pod "793f378f-ef31-443c-bb12-6d75a2140296" (UID: "793f378f-ef31-443c-bb12-6d75a2140296"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:06:01 crc kubenswrapper[5120]: I0316 16:06:01.544155 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/793f378f-ef31-443c-bb12-6d75a2140296-kube-api-access-9vrbk" (OuterVolumeSpecName: "kube-api-access-9vrbk") pod "793f378f-ef31-443c-bb12-6d75a2140296" (UID: "793f378f-ef31-443c-bb12-6d75a2140296"). InnerVolumeSpecName "kube-api-access-9vrbk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:06:01 crc kubenswrapper[5120]: I0316 16:06:01.545269 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/793f378f-ef31-443c-bb12-6d75a2140296-scripts" (OuterVolumeSpecName: "scripts") pod "793f378f-ef31-443c-bb12-6d75a2140296" (UID: "793f378f-ef31-443c-bb12-6d75a2140296"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:06:01 crc kubenswrapper[5120]: I0316 16:06:01.564769 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/793f378f-ef31-443c-bb12-6d75a2140296-config-data" (OuterVolumeSpecName: "config-data") pod "793f378f-ef31-443c-bb12-6d75a2140296" (UID: "793f378f-ef31-443c-bb12-6d75a2140296"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:06:01 crc kubenswrapper[5120]: I0316 16:06:01.565854 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/793f378f-ef31-443c-bb12-6d75a2140296-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "793f378f-ef31-443c-bb12-6d75a2140296" (UID: "793f378f-ef31-443c-bb12-6d75a2140296"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:06:01 crc kubenswrapper[5120]: I0316 16:06:01.606185 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/793f378f-ef31-443c-bb12-6d75a2140296-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "793f378f-ef31-443c-bb12-6d75a2140296" (UID: "793f378f-ef31-443c-bb12-6d75a2140296"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:06:01 crc kubenswrapper[5120]: I0316 16:06:01.609193 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/793f378f-ef31-443c-bb12-6d75a2140296-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:01 crc kubenswrapper[5120]: I0316 16:06:01.609215 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/793f378f-ef31-443c-bb12-6d75a2140296-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:01 crc kubenswrapper[5120]: I0316 16:06:01.609227 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9vrbk\" (UniqueName: \"kubernetes.io/projected/793f378f-ef31-443c-bb12-6d75a2140296-kube-api-access-9vrbk\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:01 crc kubenswrapper[5120]: I0316 16:06:01.609236 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/793f378f-ef31-443c-bb12-6d75a2140296-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:01 crc kubenswrapper[5120]: I0316 16:06:01.609265 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/793f378f-ef31-443c-bb12-6d75a2140296-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:01 crc kubenswrapper[5120]: I0316 16:06:01.609274 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/793f378f-ef31-443c-bb12-6d75a2140296-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:01 crc kubenswrapper[5120]: I0316 16:06:01.614994 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/793f378f-ef31-443c-bb12-6d75a2140296-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "793f378f-ef31-443c-bb12-6d75a2140296" (UID: "793f378f-ef31-443c-bb12-6d75a2140296"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:06:01 crc kubenswrapper[5120]: E0316 16:06:01.662962 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a886de49bae32ee69eeae0c96d915691d3f0168922fae6e6426547d7baf51a40" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:06:01 crc kubenswrapper[5120]: E0316 16:06:01.664612 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a886de49bae32ee69eeae0c96d915691d3f0168922fae6e6426547d7baf51a40" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:06:01 crc kubenswrapper[5120]: E0316 16:06:01.665971 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a886de49bae32ee69eeae0c96d915691d3f0168922fae6e6426547d7baf51a40" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:06:01 crc kubenswrapper[5120]: E0316 16:06:01.666060 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="8f091159-612f-4c40-b215-344c86fe9f65" containerName="nova-cell1-conductor-conductor" probeResult="unknown" Mar 16 16:06:01 crc kubenswrapper[5120]: I0316 16:06:01.711403 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/793f378f-ef31-443c-bb12-6d75a2140296-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:01 crc kubenswrapper[5120]: I0316 16:06:01.898904 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-7469b9f4cf-grmhg" Mar 16 16:06:01 crc kubenswrapper[5120]: I0316 16:06:01.904424 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-64d4b879f4-bbkqw" Mar 16 16:06:01 crc kubenswrapper[5120]: I0316 16:06:01.904726 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-l8vn4" event={"ID":"26cb0730-b6af-4f60-baa0-3ce77a180060","Type":"ContainerStarted","Data":"c4923841e960725d0debbe505df5dfd0ea3b5ba0b3dd1e99f961ab5ade2ebc47"} Mar 16 16:06:01 crc kubenswrapper[5120]: I0316 16:06:01.904945 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-l8vn4" Mar 16 16:06:01 crc kubenswrapper[5120]: I0316 16:06:01.908423 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-northd-0_cf2c0d02-34db-44f6-b7e5-625a82333785/ovn-northd/0.log" Mar 16 16:06:01 crc kubenswrapper[5120]: I0316 16:06:01.908545 5120 generic.go:358] "Generic (PLEG): container finished" podID="cf2c0d02-34db-44f6-b7e5-625a82333785" containerID="17c9dde48e428543edf8e13201760d950879e0829d025bbcff1b1bebc7a0d973" exitCode=139 Mar 16 16:06:01 crc kubenswrapper[5120]: I0316 16:06:01.908660 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"cf2c0d02-34db-44f6-b7e5-625a82333785","Type":"ContainerDied","Data":"17c9dde48e428543edf8e13201760d950879e0829d025bbcff1b1bebc7a0d973"} Mar 16 16:06:01 crc kubenswrapper[5120]: I0316 16:06:01.921606 5120 generic.go:358] "Generic (PLEG): container finished" podID="793f378f-ef31-443c-bb12-6d75a2140296" containerID="b05d1524d8d05da004906226c31ae5d3ad93c44d9f9606c3345de3d786881030" exitCode=0 Mar 16 16:06:01 crc kubenswrapper[5120]: I0316 16:06:01.921836 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-fb69b7968-qskx5" event={"ID":"793f378f-ef31-443c-bb12-6d75a2140296","Type":"ContainerDied","Data":"b05d1524d8d05da004906226c31ae5d3ad93c44d9f9606c3345de3d786881030"} Mar 16 16:06:01 crc kubenswrapper[5120]: I0316 16:06:01.921864 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-fb69b7968-qskx5" event={"ID":"793f378f-ef31-443c-bb12-6d75a2140296","Type":"ContainerDied","Data":"82bb0050daea8ab8af6cbaf31d84b602277ca55c600b6da9eab20ae98fb40ae8"} Mar 16 16:06:01 crc kubenswrapper[5120]: I0316 16:06:01.921879 5120 scope.go:117] "RemoveContainer" containerID="b05d1524d8d05da004906226c31ae5d3ad93c44d9f9606c3345de3d786881030" Mar 16 16:06:01 crc kubenswrapper[5120]: I0316 16:06:01.921979 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-fb69b7968-qskx5" Mar 16 16:06:01 crc kubenswrapper[5120]: I0316 16:06:01.928292 5120 generic.go:358] "Generic (PLEG): container finished" podID="f0da01d8-8d71-47f3-9ec8-73dd0aabe316" containerID="7bcdb368355b6e7789534603513d090ead891f3b93288ee9ef529114e1e19738" exitCode=0 Mar 16 16:06:01 crc kubenswrapper[5120]: I0316 16:06:01.928400 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-7469b9f4cf-grmhg" event={"ID":"f0da01d8-8d71-47f3-9ec8-73dd0aabe316","Type":"ContainerDied","Data":"7bcdb368355b6e7789534603513d090ead891f3b93288ee9ef529114e1e19738"} Mar 16 16:06:01 crc kubenswrapper[5120]: I0316 16:06:01.928422 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-7469b9f4cf-grmhg" event={"ID":"f0da01d8-8d71-47f3-9ec8-73dd0aabe316","Type":"ContainerDied","Data":"6d2bd392c68baa40b3861d82bffff7de01a314630099e0bdcff290b5812f7c49"} Mar 16 16:06:01 crc kubenswrapper[5120]: I0316 16:06:01.928478 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-7469b9f4cf-grmhg" Mar 16 16:06:01 crc kubenswrapper[5120]: I0316 16:06:01.930843 5120 generic.go:358] "Generic (PLEG): container finished" podID="7fc6bd2b-b3c9-42e9-b7f5-c2aef4997e6c" containerID="b5396e89a059e714407464e3e525c2b2bddc597fbfcbc921d6ab126d84a862e2" exitCode=0 Mar 16 16:06:01 crc kubenswrapper[5120]: I0316 16:06:01.930911 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-64d4b879f4-bbkqw" event={"ID":"7fc6bd2b-b3c9-42e9-b7f5-c2aef4997e6c","Type":"ContainerDied","Data":"b5396e89a059e714407464e3e525c2b2bddc597fbfcbc921d6ab126d84a862e2"} Mar 16 16:06:01 crc kubenswrapper[5120]: I0316 16:06:01.930928 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-64d4b879f4-bbkqw" event={"ID":"7fc6bd2b-b3c9-42e9-b7f5-c2aef4997e6c","Type":"ContainerDied","Data":"818c886a632dc66a965ac822aa59a853fd9ae3fab06b84bbe64a6baf3251a8c7"} Mar 16 16:06:01 crc kubenswrapper[5120]: I0316 16:06:01.930975 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-64d4b879f4-bbkqw" Mar 16 16:06:01 crc kubenswrapper[5120]: I0316 16:06:01.933967 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561286-2qjw6" event={"ID":"d908918a-f75b-405a-8ba3-5faa341a849a","Type":"ContainerStarted","Data":"a63f9c7f4633a606634a4289412eeaa769ff81438abf91e98800773ba5b9ced7"} Mar 16 16:06:01 crc kubenswrapper[5120]: I0316 16:06:01.942323 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-5dd49d988b-vcz2l" event={"ID":"a4bd1853-26f2-4b40-8a3d-3ae70282ab88","Type":"ContainerDied","Data":"571eac3da25245961f0e45f6bde80dd2a01c1eddf05b2c1cc427d76538851b9e"} Mar 16 16:06:01 crc kubenswrapper[5120]: I0316 16:06:01.942548 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-5dd49d988b-vcz2l" Mar 16 16:06:01 crc kubenswrapper[5120]: I0316 16:06:01.958888 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:06:01 crc kubenswrapper[5120]: I0316 16:06:01.959066 5120 scope.go:117] "RemoveContainer" containerID="f83697d85210dbea97afeac8e4e308ef8197b85223ea2b15ac11ae6f4f71f13f" Mar 16 16:06:01 crc kubenswrapper[5120]: I0316 16:06:01.958890 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"e8e4bade-e33d-4cc6-80ec-5f96e39c8f20","Type":"ContainerDied","Data":"19ba121de81b6e6f2f79c4e086bccef995a0a795c9f964f4d0594df9077aa426"} Mar 16 16:06:01 crc kubenswrapper[5120]: I0316 16:06:01.975594 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-l8vn4" podStartSLOduration=6.975571738 podStartE2EDuration="6.975571738s" podCreationTimestamp="2026-03-16 16:05:55 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:06:01.964526846 +0000 UTC m=+2064.118458503" watchObservedRunningTime="2026-03-16 16:06:01.975571738 +0000 UTC m=+2064.129503405" Mar 16 16:06:01 crc kubenswrapper[5120]: I0316 16:06:01.996101 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-fb69b7968-qskx5"] Mar 16 16:06:02 crc kubenswrapper[5120]: I0316 16:06:02.002010 5120 scope.go:117] "RemoveContainer" containerID="b05d1524d8d05da004906226c31ae5d3ad93c44d9f9606c3345de3d786881030" Mar 16 16:06:02 crc kubenswrapper[5120]: E0316 16:06:02.003258 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b05d1524d8d05da004906226c31ae5d3ad93c44d9f9606c3345de3d786881030\": container with ID starting with b05d1524d8d05da004906226c31ae5d3ad93c44d9f9606c3345de3d786881030 not found: ID does not exist" containerID="b05d1524d8d05da004906226c31ae5d3ad93c44d9f9606c3345de3d786881030" Mar 16 16:06:02 crc kubenswrapper[5120]: I0316 16:06:02.003285 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b05d1524d8d05da004906226c31ae5d3ad93c44d9f9606c3345de3d786881030"} err="failed to get container status \"b05d1524d8d05da004906226c31ae5d3ad93c44d9f9606c3345de3d786881030\": rpc error: code = NotFound desc = could not find container \"b05d1524d8d05da004906226c31ae5d3ad93c44d9f9606c3345de3d786881030\": container with ID starting with b05d1524d8d05da004906226c31ae5d3ad93c44d9f9606c3345de3d786881030 not found: ID does not exist" Mar 16 16:06:02 crc kubenswrapper[5120]: I0316 16:06:02.003303 5120 scope.go:117] "RemoveContainer" containerID="f83697d85210dbea97afeac8e4e308ef8197b85223ea2b15ac11ae6f4f71f13f" Mar 16 16:06:02 crc kubenswrapper[5120]: E0316 16:06:02.003516 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f83697d85210dbea97afeac8e4e308ef8197b85223ea2b15ac11ae6f4f71f13f\": container with ID starting with f83697d85210dbea97afeac8e4e308ef8197b85223ea2b15ac11ae6f4f71f13f not found: ID does not exist" containerID="f83697d85210dbea97afeac8e4e308ef8197b85223ea2b15ac11ae6f4f71f13f" Mar 16 16:06:02 crc kubenswrapper[5120]: I0316 16:06:02.003536 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f83697d85210dbea97afeac8e4e308ef8197b85223ea2b15ac11ae6f4f71f13f"} err="failed to get container status \"f83697d85210dbea97afeac8e4e308ef8197b85223ea2b15ac11ae6f4f71f13f\": rpc error: code = NotFound desc = could not find container \"f83697d85210dbea97afeac8e4e308ef8197b85223ea2b15ac11ae6f4f71f13f\": container with ID starting with f83697d85210dbea97afeac8e4e308ef8197b85223ea2b15ac11ae6f4f71f13f not found: ID does not exist" Mar 16 16:06:02 crc kubenswrapper[5120]: I0316 16:06:02.003548 5120 scope.go:117] "RemoveContainer" containerID="7bcdb368355b6e7789534603513d090ead891f3b93288ee9ef529114e1e19738" Mar 16 16:06:02 crc kubenswrapper[5120]: I0316 16:06:02.009249 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-fb69b7968-qskx5"] Mar 16 16:06:02 crc kubenswrapper[5120]: I0316 16:06:02.020676 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f0da01d8-8d71-47f3-9ec8-73dd0aabe316-combined-ca-bundle\") pod \"f0da01d8-8d71-47f3-9ec8-73dd0aabe316\" (UID: \"f0da01d8-8d71-47f3-9ec8-73dd0aabe316\") " Mar 16 16:06:02 crc kubenswrapper[5120]: I0316 16:06:02.020738 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5k4lv\" (UniqueName: \"kubernetes.io/projected/7fc6bd2b-b3c9-42e9-b7f5-c2aef4997e6c-kube-api-access-5k4lv\") pod \"7fc6bd2b-b3c9-42e9-b7f5-c2aef4997e6c\" (UID: \"7fc6bd2b-b3c9-42e9-b7f5-c2aef4997e6c\") " Mar 16 16:06:02 crc kubenswrapper[5120]: I0316 16:06:02.021628 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7fc6bd2b-b3c9-42e9-b7f5-c2aef4997e6c-combined-ca-bundle\") pod \"7fc6bd2b-b3c9-42e9-b7f5-c2aef4997e6c\" (UID: \"7fc6bd2b-b3c9-42e9-b7f5-c2aef4997e6c\") " Mar 16 16:06:02 crc kubenswrapper[5120]: I0316 16:06:02.021746 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/7fc6bd2b-b3c9-42e9-b7f5-c2aef4997e6c-config-data-custom\") pod \"7fc6bd2b-b3c9-42e9-b7f5-c2aef4997e6c\" (UID: \"7fc6bd2b-b3c9-42e9-b7f5-c2aef4997e6c\") " Mar 16 16:06:02 crc kubenswrapper[5120]: I0316 16:06:02.021863 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7fc6bd2b-b3c9-42e9-b7f5-c2aef4997e6c-logs\") pod \"7fc6bd2b-b3c9-42e9-b7f5-c2aef4997e6c\" (UID: \"7fc6bd2b-b3c9-42e9-b7f5-c2aef4997e6c\") " Mar 16 16:06:02 crc kubenswrapper[5120]: I0316 16:06:02.021909 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f0da01d8-8d71-47f3-9ec8-73dd0aabe316-config-data\") pod \"f0da01d8-8d71-47f3-9ec8-73dd0aabe316\" (UID: \"f0da01d8-8d71-47f3-9ec8-73dd0aabe316\") " Mar 16 16:06:02 crc kubenswrapper[5120]: I0316 16:06:02.022049 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vb84b\" (UniqueName: \"kubernetes.io/projected/f0da01d8-8d71-47f3-9ec8-73dd0aabe316-kube-api-access-vb84b\") pod \"f0da01d8-8d71-47f3-9ec8-73dd0aabe316\" (UID: \"f0da01d8-8d71-47f3-9ec8-73dd0aabe316\") " Mar 16 16:06:02 crc kubenswrapper[5120]: I0316 16:06:02.022124 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f0da01d8-8d71-47f3-9ec8-73dd0aabe316-logs\") pod \"f0da01d8-8d71-47f3-9ec8-73dd0aabe316\" (UID: \"f0da01d8-8d71-47f3-9ec8-73dd0aabe316\") " Mar 16 16:06:02 crc kubenswrapper[5120]: I0316 16:06:02.022178 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/f0da01d8-8d71-47f3-9ec8-73dd0aabe316-config-data-custom\") pod \"f0da01d8-8d71-47f3-9ec8-73dd0aabe316\" (UID: \"f0da01d8-8d71-47f3-9ec8-73dd0aabe316\") " Mar 16 16:06:02 crc kubenswrapper[5120]: I0316 16:06:02.022244 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7fc6bd2b-b3c9-42e9-b7f5-c2aef4997e6c-config-data\") pod \"7fc6bd2b-b3c9-42e9-b7f5-c2aef4997e6c\" (UID: \"7fc6bd2b-b3c9-42e9-b7f5-c2aef4997e6c\") " Mar 16 16:06:02 crc kubenswrapper[5120]: I0316 16:06:02.022803 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:06:02 crc kubenswrapper[5120]: I0316 16:06:02.024054 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0da01d8-8d71-47f3-9ec8-73dd0aabe316-logs" (OuterVolumeSpecName: "logs") pod "f0da01d8-8d71-47f3-9ec8-73dd0aabe316" (UID: "f0da01d8-8d71-47f3-9ec8-73dd0aabe316"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:06:02 crc kubenswrapper[5120]: I0316 16:06:02.024376 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7fc6bd2b-b3c9-42e9-b7f5-c2aef4997e6c-logs" (OuterVolumeSpecName: "logs") pod "7fc6bd2b-b3c9-42e9-b7f5-c2aef4997e6c" (UID: "7fc6bd2b-b3c9-42e9-b7f5-c2aef4997e6c"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:06:02 crc kubenswrapper[5120]: I0316 16:06:02.026994 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7fc6bd2b-b3c9-42e9-b7f5-c2aef4997e6c-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:02 crc kubenswrapper[5120]: I0316 16:06:02.027020 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f0da01d8-8d71-47f3-9ec8-73dd0aabe316-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:02 crc kubenswrapper[5120]: I0316 16:06:02.032526 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:06:02 crc kubenswrapper[5120]: I0316 16:06:02.032592 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7fc6bd2b-b3c9-42e9-b7f5-c2aef4997e6c-kube-api-access-5k4lv" (OuterVolumeSpecName: "kube-api-access-5k4lv") pod "7fc6bd2b-b3c9-42e9-b7f5-c2aef4997e6c" (UID: "7fc6bd2b-b3c9-42e9-b7f5-c2aef4997e6c"). InnerVolumeSpecName "kube-api-access-5k4lv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:06:02 crc kubenswrapper[5120]: I0316 16:06:02.033732 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0da01d8-8d71-47f3-9ec8-73dd0aabe316-kube-api-access-vb84b" (OuterVolumeSpecName: "kube-api-access-vb84b") pod "f0da01d8-8d71-47f3-9ec8-73dd0aabe316" (UID: "f0da01d8-8d71-47f3-9ec8-73dd0aabe316"). InnerVolumeSpecName "kube-api-access-vb84b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:06:02 crc kubenswrapper[5120]: I0316 16:06:02.036061 5120 scope.go:117] "RemoveContainer" containerID="b2628ee32787319a15d501d9f10281fc7f6881d6eb55598e18e00b9a947c19f6" Mar 16 16:06:02 crc kubenswrapper[5120]: I0316 16:06:02.038029 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-5dd49d988b-vcz2l"] Mar 16 16:06:02 crc kubenswrapper[5120]: I0316 16:06:02.044265 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-api-5dd49d988b-vcz2l"] Mar 16 16:06:02 crc kubenswrapper[5120]: I0316 16:06:02.045263 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0da01d8-8d71-47f3-9ec8-73dd0aabe316-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "f0da01d8-8d71-47f3-9ec8-73dd0aabe316" (UID: "f0da01d8-8d71-47f3-9ec8-73dd0aabe316"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:06:02 crc kubenswrapper[5120]: I0316 16:06:02.045625 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7fc6bd2b-b3c9-42e9-b7f5-c2aef4997e6c-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "7fc6bd2b-b3c9-42e9-b7f5-c2aef4997e6c" (UID: "7fc6bd2b-b3c9-42e9-b7f5-c2aef4997e6c"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:06:02 crc kubenswrapper[5120]: I0316 16:06:02.055407 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0da01d8-8d71-47f3-9ec8-73dd0aabe316-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f0da01d8-8d71-47f3-9ec8-73dd0aabe316" (UID: "f0da01d8-8d71-47f3-9ec8-73dd0aabe316"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:06:02 crc kubenswrapper[5120]: I0316 16:06:02.055475 5120 scope.go:117] "RemoveContainer" containerID="7bcdb368355b6e7789534603513d090ead891f3b93288ee9ef529114e1e19738" Mar 16 16:06:02 crc kubenswrapper[5120]: E0316 16:06:02.055919 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7bcdb368355b6e7789534603513d090ead891f3b93288ee9ef529114e1e19738\": container with ID starting with 7bcdb368355b6e7789534603513d090ead891f3b93288ee9ef529114e1e19738 not found: ID does not exist" containerID="7bcdb368355b6e7789534603513d090ead891f3b93288ee9ef529114e1e19738" Mar 16 16:06:02 crc kubenswrapper[5120]: I0316 16:06:02.055954 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7bcdb368355b6e7789534603513d090ead891f3b93288ee9ef529114e1e19738"} err="failed to get container status \"7bcdb368355b6e7789534603513d090ead891f3b93288ee9ef529114e1e19738\": rpc error: code = NotFound desc = could not find container \"7bcdb368355b6e7789534603513d090ead891f3b93288ee9ef529114e1e19738\": container with ID starting with 7bcdb368355b6e7789534603513d090ead891f3b93288ee9ef529114e1e19738 not found: ID does not exist" Mar 16 16:06:02 crc kubenswrapper[5120]: I0316 16:06:02.055973 5120 scope.go:117] "RemoveContainer" containerID="b2628ee32787319a15d501d9f10281fc7f6881d6eb55598e18e00b9a947c19f6" Mar 16 16:06:02 crc kubenswrapper[5120]: E0316 16:06:02.056257 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b2628ee32787319a15d501d9f10281fc7f6881d6eb55598e18e00b9a947c19f6\": container with ID starting with b2628ee32787319a15d501d9f10281fc7f6881d6eb55598e18e00b9a947c19f6 not found: ID does not exist" containerID="b2628ee32787319a15d501d9f10281fc7f6881d6eb55598e18e00b9a947c19f6" Mar 16 16:06:02 crc kubenswrapper[5120]: I0316 16:06:02.056286 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2628ee32787319a15d501d9f10281fc7f6881d6eb55598e18e00b9a947c19f6"} err="failed to get container status \"b2628ee32787319a15d501d9f10281fc7f6881d6eb55598e18e00b9a947c19f6\": rpc error: code = NotFound desc = could not find container \"b2628ee32787319a15d501d9f10281fc7f6881d6eb55598e18e00b9a947c19f6\": container with ID starting with b2628ee32787319a15d501d9f10281fc7f6881d6eb55598e18e00b9a947c19f6 not found: ID does not exist" Mar 16 16:06:02 crc kubenswrapper[5120]: I0316 16:06:02.056321 5120 scope.go:117] "RemoveContainer" containerID="b5396e89a059e714407464e3e525c2b2bddc597fbfcbc921d6ab126d84a862e2" Mar 16 16:06:02 crc kubenswrapper[5120]: I0316 16:06:02.065897 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7fc6bd2b-b3c9-42e9-b7f5-c2aef4997e6c-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "7fc6bd2b-b3c9-42e9-b7f5-c2aef4997e6c" (UID: "7fc6bd2b-b3c9-42e9-b7f5-c2aef4997e6c"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:06:02 crc kubenswrapper[5120]: I0316 16:06:02.068494 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7fc6bd2b-b3c9-42e9-b7f5-c2aef4997e6c-config-data" (OuterVolumeSpecName: "config-data") pod "7fc6bd2b-b3c9-42e9-b7f5-c2aef4997e6c" (UID: "7fc6bd2b-b3c9-42e9-b7f5-c2aef4997e6c"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:06:02 crc kubenswrapper[5120]: I0316 16:06:02.075184 5120 scope.go:117] "RemoveContainer" containerID="dacff6fc847fdebd6d8ee7408f52597ea61ec912f45e06fc013aa5067459105a" Mar 16 16:06:02 crc kubenswrapper[5120]: I0316 16:06:02.092362 5120 scope.go:117] "RemoveContainer" containerID="b5396e89a059e714407464e3e525c2b2bddc597fbfcbc921d6ab126d84a862e2" Mar 16 16:06:02 crc kubenswrapper[5120]: E0316 16:06:02.092697 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b5396e89a059e714407464e3e525c2b2bddc597fbfcbc921d6ab126d84a862e2\": container with ID starting with b5396e89a059e714407464e3e525c2b2bddc597fbfcbc921d6ab126d84a862e2 not found: ID does not exist" containerID="b5396e89a059e714407464e3e525c2b2bddc597fbfcbc921d6ab126d84a862e2" Mar 16 16:06:02 crc kubenswrapper[5120]: I0316 16:06:02.092740 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5396e89a059e714407464e3e525c2b2bddc597fbfcbc921d6ab126d84a862e2"} err="failed to get container status \"b5396e89a059e714407464e3e525c2b2bddc597fbfcbc921d6ab126d84a862e2\": rpc error: code = NotFound desc = could not find container \"b5396e89a059e714407464e3e525c2b2bddc597fbfcbc921d6ab126d84a862e2\": container with ID starting with b5396e89a059e714407464e3e525c2b2bddc597fbfcbc921d6ab126d84a862e2 not found: ID does not exist" Mar 16 16:06:02 crc kubenswrapper[5120]: I0316 16:06:02.092782 5120 scope.go:117] "RemoveContainer" containerID="dacff6fc847fdebd6d8ee7408f52597ea61ec912f45e06fc013aa5067459105a" Mar 16 16:06:02 crc kubenswrapper[5120]: E0316 16:06:02.093074 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dacff6fc847fdebd6d8ee7408f52597ea61ec912f45e06fc013aa5067459105a\": container with ID starting with dacff6fc847fdebd6d8ee7408f52597ea61ec912f45e06fc013aa5067459105a not found: ID does not exist" containerID="dacff6fc847fdebd6d8ee7408f52597ea61ec912f45e06fc013aa5067459105a" Mar 16 16:06:02 crc kubenswrapper[5120]: I0316 16:06:02.093126 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dacff6fc847fdebd6d8ee7408f52597ea61ec912f45e06fc013aa5067459105a"} err="failed to get container status \"dacff6fc847fdebd6d8ee7408f52597ea61ec912f45e06fc013aa5067459105a\": rpc error: code = NotFound desc = could not find container \"dacff6fc847fdebd6d8ee7408f52597ea61ec912f45e06fc013aa5067459105a\": container with ID starting with dacff6fc847fdebd6d8ee7408f52597ea61ec912f45e06fc013aa5067459105a not found: ID does not exist" Mar 16 16:06:02 crc kubenswrapper[5120]: I0316 16:06:02.093155 5120 scope.go:117] "RemoveContainer" containerID="9d45a48840b6d7f38f5e8df07afcd62928246e625344537e93a0413d1c500491" Mar 16 16:06:02 crc kubenswrapper[5120]: I0316 16:06:02.107498 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0da01d8-8d71-47f3-9ec8-73dd0aabe316-config-data" (OuterVolumeSpecName: "config-data") pod "f0da01d8-8d71-47f3-9ec8-73dd0aabe316" (UID: "f0da01d8-8d71-47f3-9ec8-73dd0aabe316"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:06:02 crc kubenswrapper[5120]: I0316 16:06:02.113922 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-northd-0_cf2c0d02-34db-44f6-b7e5-625a82333785/ovn-northd/0.log" Mar 16 16:06:02 crc kubenswrapper[5120]: I0316 16:06:02.114004 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:06:02 crc kubenswrapper[5120]: I0316 16:06:02.130627 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f0da01d8-8d71-47f3-9ec8-73dd0aabe316-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:02 crc kubenswrapper[5120]: I0316 16:06:02.130650 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5k4lv\" (UniqueName: \"kubernetes.io/projected/7fc6bd2b-b3c9-42e9-b7f5-c2aef4997e6c-kube-api-access-5k4lv\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:02 crc kubenswrapper[5120]: I0316 16:06:02.130660 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7fc6bd2b-b3c9-42e9-b7f5-c2aef4997e6c-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:02 crc kubenswrapper[5120]: I0316 16:06:02.130671 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/7fc6bd2b-b3c9-42e9-b7f5-c2aef4997e6c-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:02 crc kubenswrapper[5120]: I0316 16:06:02.130679 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f0da01d8-8d71-47f3-9ec8-73dd0aabe316-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:02 crc kubenswrapper[5120]: I0316 16:06:02.130690 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vb84b\" (UniqueName: \"kubernetes.io/projected/f0da01d8-8d71-47f3-9ec8-73dd0aabe316-kube-api-access-vb84b\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:02 crc kubenswrapper[5120]: I0316 16:06:02.130700 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/f0da01d8-8d71-47f3-9ec8-73dd0aabe316-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:02 crc kubenswrapper[5120]: I0316 16:06:02.130708 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7fc6bd2b-b3c9-42e9-b7f5-c2aef4997e6c-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:02 crc kubenswrapper[5120]: I0316 16:06:02.133104 5120 scope.go:117] "RemoveContainer" containerID="cc696eb8b901e5eb41cdc48434815341e805d7fe5aaf6f4c4e042c349eba69f7" Mar 16 16:06:02 crc kubenswrapper[5120]: I0316 16:06:02.153078 5120 scope.go:117] "RemoveContainer" containerID="4d19035ffb723ffb2508178ff7d2cf820ceaca9202ab046e0e1c2483ac9ffe16" Mar 16 16:06:02 crc kubenswrapper[5120]: I0316 16:06:02.171797 5120 scope.go:117] "RemoveContainer" containerID="1a7116daa99aee53c27ccbc6b8927b279cc329e65d3b4f93760d164d6c9baf8a" Mar 16 16:06:02 crc kubenswrapper[5120]: I0316 16:06:02.231242 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cf2c0d02-34db-44f6-b7e5-625a82333785-config\") pod \"cf2c0d02-34db-44f6-b7e5-625a82333785\" (UID: \"cf2c0d02-34db-44f6-b7e5-625a82333785\") " Mar 16 16:06:02 crc kubenswrapper[5120]: I0316 16:06:02.231449 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/cf2c0d02-34db-44f6-b7e5-625a82333785-scripts\") pod \"cf2c0d02-34db-44f6-b7e5-625a82333785\" (UID: \"cf2c0d02-34db-44f6-b7e5-625a82333785\") " Mar 16 16:06:02 crc kubenswrapper[5120]: I0316 16:06:02.231648 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/cf2c0d02-34db-44f6-b7e5-625a82333785-metrics-certs-tls-certs\") pod \"cf2c0d02-34db-44f6-b7e5-625a82333785\" (UID: \"cf2c0d02-34db-44f6-b7e5-625a82333785\") " Mar 16 16:06:02 crc kubenswrapper[5120]: I0316 16:06:02.231674 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cf2c0d02-34db-44f6-b7e5-625a82333785-combined-ca-bundle\") pod \"cf2c0d02-34db-44f6-b7e5-625a82333785\" (UID: \"cf2c0d02-34db-44f6-b7e5-625a82333785\") " Mar 16 16:06:02 crc kubenswrapper[5120]: I0316 16:06:02.231697 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v6jfq\" (UniqueName: \"kubernetes.io/projected/cf2c0d02-34db-44f6-b7e5-625a82333785-kube-api-access-v6jfq\") pod \"cf2c0d02-34db-44f6-b7e5-625a82333785\" (UID: \"cf2c0d02-34db-44f6-b7e5-625a82333785\") " Mar 16 16:06:02 crc kubenswrapper[5120]: I0316 16:06:02.231732 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/cf2c0d02-34db-44f6-b7e5-625a82333785-ovn-northd-tls-certs\") pod \"cf2c0d02-34db-44f6-b7e5-625a82333785\" (UID: \"cf2c0d02-34db-44f6-b7e5-625a82333785\") " Mar 16 16:06:02 crc kubenswrapper[5120]: I0316 16:06:02.231944 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/cf2c0d02-34db-44f6-b7e5-625a82333785-ovn-rundir\") pod \"cf2c0d02-34db-44f6-b7e5-625a82333785\" (UID: \"cf2c0d02-34db-44f6-b7e5-625a82333785\") " Mar 16 16:06:02 crc kubenswrapper[5120]: I0316 16:06:02.232001 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf2c0d02-34db-44f6-b7e5-625a82333785-config" (OuterVolumeSpecName: "config") pod "cf2c0d02-34db-44f6-b7e5-625a82333785" (UID: "cf2c0d02-34db-44f6-b7e5-625a82333785"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:06:02 crc kubenswrapper[5120]: I0316 16:06:02.232038 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf2c0d02-34db-44f6-b7e5-625a82333785-scripts" (OuterVolumeSpecName: "scripts") pod "cf2c0d02-34db-44f6-b7e5-625a82333785" (UID: "cf2c0d02-34db-44f6-b7e5-625a82333785"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:06:02 crc kubenswrapper[5120]: I0316 16:06:02.234654 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cf2c0d02-34db-44f6-b7e5-625a82333785-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:02 crc kubenswrapper[5120]: I0316 16:06:02.234673 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/cf2c0d02-34db-44f6-b7e5-625a82333785-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:02 crc kubenswrapper[5120]: I0316 16:06:02.234969 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf2c0d02-34db-44f6-b7e5-625a82333785-ovn-rundir" (OuterVolumeSpecName: "ovn-rundir") pod "cf2c0d02-34db-44f6-b7e5-625a82333785" (UID: "cf2c0d02-34db-44f6-b7e5-625a82333785"). InnerVolumeSpecName "ovn-rundir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:06:02 crc kubenswrapper[5120]: I0316 16:06:02.235229 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf2c0d02-34db-44f6-b7e5-625a82333785-kube-api-access-v6jfq" (OuterVolumeSpecName: "kube-api-access-v6jfq") pod "cf2c0d02-34db-44f6-b7e5-625a82333785" (UID: "cf2c0d02-34db-44f6-b7e5-625a82333785"). InnerVolumeSpecName "kube-api-access-v6jfq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:06:02 crc kubenswrapper[5120]: I0316 16:06:02.261286 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-7469b9f4cf-grmhg"] Mar 16 16:06:02 crc kubenswrapper[5120]: I0316 16:06:02.264076 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf2c0d02-34db-44f6-b7e5-625a82333785-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "cf2c0d02-34db-44f6-b7e5-625a82333785" (UID: "cf2c0d02-34db-44f6-b7e5-625a82333785"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:06:02 crc kubenswrapper[5120]: I0316 16:06:02.266438 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-worker-7469b9f4cf-grmhg"] Mar 16 16:06:02 crc kubenswrapper[5120]: I0316 16:06:02.276803 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-64d4b879f4-bbkqw"] Mar 16 16:06:02 crc kubenswrapper[5120]: I0316 16:06:02.282731 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-64d4b879f4-bbkqw"] Mar 16 16:06:02 crc kubenswrapper[5120]: I0316 16:06:02.301298 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf2c0d02-34db-44f6-b7e5-625a82333785-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "cf2c0d02-34db-44f6-b7e5-625a82333785" (UID: "cf2c0d02-34db-44f6-b7e5-625a82333785"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:06:02 crc kubenswrapper[5120]: I0316 16:06:02.315831 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf2c0d02-34db-44f6-b7e5-625a82333785-ovn-northd-tls-certs" (OuterVolumeSpecName: "ovn-northd-tls-certs") pod "cf2c0d02-34db-44f6-b7e5-625a82333785" (UID: "cf2c0d02-34db-44f6-b7e5-625a82333785"). InnerVolumeSpecName "ovn-northd-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:06:02 crc kubenswrapper[5120]: I0316 16:06:02.338744 5120 reconciler_common.go:299] "Volume detached for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/cf2c0d02-34db-44f6-b7e5-625a82333785-ovn-rundir\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:02 crc kubenswrapper[5120]: I0316 16:06:02.338800 5120 reconciler_common.go:299] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/cf2c0d02-34db-44f6-b7e5-625a82333785-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:02 crc kubenswrapper[5120]: I0316 16:06:02.338810 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cf2c0d02-34db-44f6-b7e5-625a82333785-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:02 crc kubenswrapper[5120]: I0316 16:06:02.338819 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v6jfq\" (UniqueName: \"kubernetes.io/projected/cf2c0d02-34db-44f6-b7e5-625a82333785-kube-api-access-v6jfq\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:02 crc kubenswrapper[5120]: I0316 16:06:02.338828 5120 reconciler_common.go:299] "Volume detached for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/cf2c0d02-34db-44f6-b7e5-625a82333785-ovn-northd-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:02 crc kubenswrapper[5120]: E0316 16:06:02.543869 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-cinder-public-svc: secret "cert-cinder-public-svc" not found Mar 16 16:06:02 crc kubenswrapper[5120]: E0316 16:06:02.543915 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 16:06:02 crc kubenswrapper[5120]: E0316 16:06:02.543936 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-cinder-internal-svc: secret "cert-cinder-internal-svc" not found Mar 16 16:06:02 crc kubenswrapper[5120]: E0316 16:06:02.544009 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8028a79-c5c3-420e-ac48-33a3991aba76-public-tls-certs podName:f8028a79-c5c3-420e-ac48-33a3991aba76 nodeName:}" failed. No retries permitted until 2026-03-16 16:06:10.543967027 +0000 UTC m=+2072.697898724 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/f8028a79-c5c3-420e-ac48-33a3991aba76-public-tls-certs") pod "cinder-api-0" (UID: "f8028a79-c5c3-420e-ac48-33a3991aba76") : secret "cert-cinder-public-svc" not found Mar 16 16:06:02 crc kubenswrapper[5120]: E0316 16:06:02.544079 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8028a79-c5c3-420e-ac48-33a3991aba76-combined-ca-bundle podName:f8028a79-c5c3-420e-ac48-33a3991aba76 nodeName:}" failed. No retries permitted until 2026-03-16 16:06:10.544060089 +0000 UTC m=+2072.697991786 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/f8028a79-c5c3-420e-ac48-33a3991aba76-combined-ca-bundle") pod "cinder-api-0" (UID: "f8028a79-c5c3-420e-ac48-33a3991aba76") : secret "combined-ca-bundle" not found Mar 16 16:06:02 crc kubenswrapper[5120]: E0316 16:06:02.544114 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8028a79-c5c3-420e-ac48-33a3991aba76-internal-tls-certs podName:f8028a79-c5c3-420e-ac48-33a3991aba76 nodeName:}" failed. No retries permitted until 2026-03-16 16:06:10.54410222 +0000 UTC m=+2072.698033907 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/f8028a79-c5c3-420e-ac48-33a3991aba76-internal-tls-certs") pod "cinder-api-0" (UID: "f8028a79-c5c3-420e-ac48-33a3991aba76") : secret "cert-cinder-internal-svc" not found Mar 16 16:06:02 crc kubenswrapper[5120]: I0316 16:06:02.709691 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4f18ae61-e496-433a-851f-3ac657fa2455" path="/var/lib/kubelet/pods/4f18ae61-e496-433a-851f-3ac657fa2455/volumes" Mar 16 16:06:02 crc kubenswrapper[5120]: I0316 16:06:02.710531 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="68f2feef-cf44-429c-a9be-314c030d3321" path="/var/lib/kubelet/pods/68f2feef-cf44-429c-a9be-314c030d3321/volumes" Mar 16 16:06:02 crc kubenswrapper[5120]: I0316 16:06:02.711202 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="793f378f-ef31-443c-bb12-6d75a2140296" path="/var/lib/kubelet/pods/793f378f-ef31-443c-bb12-6d75a2140296/volumes" Mar 16 16:06:02 crc kubenswrapper[5120]: I0316 16:06:02.712238 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7fc6bd2b-b3c9-42e9-b7f5-c2aef4997e6c" path="/var/lib/kubelet/pods/7fc6bd2b-b3c9-42e9-b7f5-c2aef4997e6c/volumes" Mar 16 16:06:02 crc kubenswrapper[5120]: I0316 16:06:02.712808 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a4bd1853-26f2-4b40-8a3d-3ae70282ab88" path="/var/lib/kubelet/pods/a4bd1853-26f2-4b40-8a3d-3ae70282ab88/volumes" Mar 16 16:06:02 crc kubenswrapper[5120]: I0316 16:06:02.713393 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c1c401a6-a61c-45bf-b9a2-c99abf5bc72e" path="/var/lib/kubelet/pods/c1c401a6-a61c-45bf-b9a2-c99abf5bc72e/volumes" Mar 16 16:06:02 crc kubenswrapper[5120]: I0316 16:06:02.716890 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce867319-e5ac-4d55-bf20-a2e66410a421" path="/var/lib/kubelet/pods/ce867319-e5ac-4d55-bf20-a2e66410a421/volumes" Mar 16 16:06:02 crc kubenswrapper[5120]: I0316 16:06:02.717200 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e8e4bade-e33d-4cc6-80ec-5f96e39c8f20" path="/var/lib/kubelet/pods/e8e4bade-e33d-4cc6-80ec-5f96e39c8f20/volumes" Mar 16 16:06:02 crc kubenswrapper[5120]: I0316 16:06:02.717740 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f0da01d8-8d71-47f3-9ec8-73dd0aabe316" path="/var/lib/kubelet/pods/f0da01d8-8d71-47f3-9ec8-73dd0aabe316/volumes" Mar 16 16:06:02 crc kubenswrapper[5120]: I0316 16:06:02.989696 5120 generic.go:358] "Generic (PLEG): container finished" podID="d908918a-f75b-405a-8ba3-5faa341a849a" containerID="1d6d6f83863b1764aee0eb76bb4d03a4aebdfb7d9dad3440b0ff896169247056" exitCode=0 Mar 16 16:06:02 crc kubenswrapper[5120]: I0316 16:06:02.989893 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561286-2qjw6" event={"ID":"d908918a-f75b-405a-8ba3-5faa341a849a","Type":"ContainerDied","Data":"1d6d6f83863b1764aee0eb76bb4d03a4aebdfb7d9dad3440b0ff896169247056"} Mar 16 16:06:02 crc kubenswrapper[5120]: I0316 16:06:02.999545 5120 generic.go:358] "Generic (PLEG): container finished" podID="f0204257-b12d-4e9d-bdfd-e35cfaa598b5" containerID="afad04760bdd0af215c87e7b8b243a24c1a39f569edf6c17dc353cb96619dc0c" exitCode=0 Mar 16 16:06:03 crc kubenswrapper[5120]: I0316 16:06:03.000289 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-5948cb6c79-mrnwx" event={"ID":"f0204257-b12d-4e9d-bdfd-e35cfaa598b5","Type":"ContainerDied","Data":"afad04760bdd0af215c87e7b8b243a24c1a39f569edf6c17dc353cb96619dc0c"} Mar 16 16:06:03 crc kubenswrapper[5120]: I0316 16:06:03.000396 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-5948cb6c79-mrnwx" event={"ID":"f0204257-b12d-4e9d-bdfd-e35cfaa598b5","Type":"ContainerDied","Data":"51e4a81a635fcdefc989958813a92279984ab17ba3312f3ceefdf5ce5937b08c"} Mar 16 16:06:03 crc kubenswrapper[5120]: I0316 16:06:03.000418 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="51e4a81a635fcdefc989958813a92279984ab17ba3312f3ceefdf5ce5937b08c" Mar 16 16:06:03 crc kubenswrapper[5120]: I0316 16:06:03.005496 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-northd-0_cf2c0d02-34db-44f6-b7e5-625a82333785/ovn-northd/0.log" Mar 16 16:06:03 crc kubenswrapper[5120]: I0316 16:06:03.005715 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:06:03 crc kubenswrapper[5120]: I0316 16:06:03.006108 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"cf2c0d02-34db-44f6-b7e5-625a82333785","Type":"ContainerDied","Data":"c37e981b6131bcc8b415b29d539e233947481e9efd14589e23cd1613e5620094"} Mar 16 16:06:03 crc kubenswrapper[5120]: I0316 16:06:03.006202 5120 scope.go:117] "RemoveContainer" containerID="b03cf446275a66219f4644fb85b109bab0f36b29c41995353e1cfd1b7896143f" Mar 16 16:06:03 crc kubenswrapper[5120]: I0316 16:06:03.050446 5120 scope.go:117] "RemoveContainer" containerID="17c9dde48e428543edf8e13201760d950879e0829d025bbcff1b1bebc7a0d973" Mar 16 16:06:03 crc kubenswrapper[5120]: I0316 16:06:03.054240 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-5948cb6c79-mrnwx" Mar 16 16:06:03 crc kubenswrapper[5120]: I0316 16:06:03.054616 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 16:06:03 crc kubenswrapper[5120]: I0316 16:06:03.059899 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 16:06:03 crc kubenswrapper[5120]: I0316 16:06:03.153845 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/f0204257-b12d-4e9d-bdfd-e35cfaa598b5-fernet-keys\") pod \"f0204257-b12d-4e9d-bdfd-e35cfaa598b5\" (UID: \"f0204257-b12d-4e9d-bdfd-e35cfaa598b5\") " Mar 16 16:06:03 crc kubenswrapper[5120]: I0316 16:06:03.153916 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f0204257-b12d-4e9d-bdfd-e35cfaa598b5-internal-tls-certs\") pod \"f0204257-b12d-4e9d-bdfd-e35cfaa598b5\" (UID: \"f0204257-b12d-4e9d-bdfd-e35cfaa598b5\") " Mar 16 16:06:03 crc kubenswrapper[5120]: I0316 16:06:03.153996 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gbw2c\" (UniqueName: \"kubernetes.io/projected/f0204257-b12d-4e9d-bdfd-e35cfaa598b5-kube-api-access-gbw2c\") pod \"f0204257-b12d-4e9d-bdfd-e35cfaa598b5\" (UID: \"f0204257-b12d-4e9d-bdfd-e35cfaa598b5\") " Mar 16 16:06:03 crc kubenswrapper[5120]: I0316 16:06:03.154069 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/f0204257-b12d-4e9d-bdfd-e35cfaa598b5-credential-keys\") pod \"f0204257-b12d-4e9d-bdfd-e35cfaa598b5\" (UID: \"f0204257-b12d-4e9d-bdfd-e35cfaa598b5\") " Mar 16 16:06:03 crc kubenswrapper[5120]: I0316 16:06:03.154123 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f0204257-b12d-4e9d-bdfd-e35cfaa598b5-combined-ca-bundle\") pod \"f0204257-b12d-4e9d-bdfd-e35cfaa598b5\" (UID: \"f0204257-b12d-4e9d-bdfd-e35cfaa598b5\") " Mar 16 16:06:03 crc kubenswrapper[5120]: I0316 16:06:03.154163 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f0204257-b12d-4e9d-bdfd-e35cfaa598b5-public-tls-certs\") pod \"f0204257-b12d-4e9d-bdfd-e35cfaa598b5\" (UID: \"f0204257-b12d-4e9d-bdfd-e35cfaa598b5\") " Mar 16 16:06:03 crc kubenswrapper[5120]: I0316 16:06:03.154211 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f0204257-b12d-4e9d-bdfd-e35cfaa598b5-scripts\") pod \"f0204257-b12d-4e9d-bdfd-e35cfaa598b5\" (UID: \"f0204257-b12d-4e9d-bdfd-e35cfaa598b5\") " Mar 16 16:06:03 crc kubenswrapper[5120]: I0316 16:06:03.154386 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f0204257-b12d-4e9d-bdfd-e35cfaa598b5-config-data\") pod \"f0204257-b12d-4e9d-bdfd-e35cfaa598b5\" (UID: \"f0204257-b12d-4e9d-bdfd-e35cfaa598b5\") " Mar 16 16:06:03 crc kubenswrapper[5120]: I0316 16:06:03.161176 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0204257-b12d-4e9d-bdfd-e35cfaa598b5-kube-api-access-gbw2c" (OuterVolumeSpecName: "kube-api-access-gbw2c") pod "f0204257-b12d-4e9d-bdfd-e35cfaa598b5" (UID: "f0204257-b12d-4e9d-bdfd-e35cfaa598b5"). InnerVolumeSpecName "kube-api-access-gbw2c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:06:03 crc kubenswrapper[5120]: I0316 16:06:03.161414 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0204257-b12d-4e9d-bdfd-e35cfaa598b5-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "f0204257-b12d-4e9d-bdfd-e35cfaa598b5" (UID: "f0204257-b12d-4e9d-bdfd-e35cfaa598b5"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:06:03 crc kubenswrapper[5120]: I0316 16:06:03.176719 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0204257-b12d-4e9d-bdfd-e35cfaa598b5-scripts" (OuterVolumeSpecName: "scripts") pod "f0204257-b12d-4e9d-bdfd-e35cfaa598b5" (UID: "f0204257-b12d-4e9d-bdfd-e35cfaa598b5"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:06:03 crc kubenswrapper[5120]: I0316 16:06:03.176919 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0204257-b12d-4e9d-bdfd-e35cfaa598b5-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "f0204257-b12d-4e9d-bdfd-e35cfaa598b5" (UID: "f0204257-b12d-4e9d-bdfd-e35cfaa598b5"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:06:03 crc kubenswrapper[5120]: I0316 16:06:03.184929 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0204257-b12d-4e9d-bdfd-e35cfaa598b5-config-data" (OuterVolumeSpecName: "config-data") pod "f0204257-b12d-4e9d-bdfd-e35cfaa598b5" (UID: "f0204257-b12d-4e9d-bdfd-e35cfaa598b5"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:06:03 crc kubenswrapper[5120]: I0316 16:06:03.198514 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0204257-b12d-4e9d-bdfd-e35cfaa598b5-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f0204257-b12d-4e9d-bdfd-e35cfaa598b5" (UID: "f0204257-b12d-4e9d-bdfd-e35cfaa598b5"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:06:03 crc kubenswrapper[5120]: I0316 16:06:03.204844 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0204257-b12d-4e9d-bdfd-e35cfaa598b5-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "f0204257-b12d-4e9d-bdfd-e35cfaa598b5" (UID: "f0204257-b12d-4e9d-bdfd-e35cfaa598b5"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:06:03 crc kubenswrapper[5120]: I0316 16:06:03.227992 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0204257-b12d-4e9d-bdfd-e35cfaa598b5-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "f0204257-b12d-4e9d-bdfd-e35cfaa598b5" (UID: "f0204257-b12d-4e9d-bdfd-e35cfaa598b5"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:06:03 crc kubenswrapper[5120]: E0316 16:06:03.259978 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-config-data: configmap "rabbitmq-config-data" not found Mar 16 16:06:03 crc kubenswrapper[5120]: E0316 16:06:03.260094 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/733010bf-0110-4a60-adf6-0f0ee336e96e-config-data podName:733010bf-0110-4a60-adf6-0f0ee336e96e nodeName:}" failed. No retries permitted until 2026-03-16 16:06:11.260071537 +0000 UTC m=+2073.414003194 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/733010bf-0110-4a60-adf6-0f0ee336e96e-config-data") pod "rabbitmq-server-0" (UID: "733010bf-0110-4a60-adf6-0f0ee336e96e") : configmap "rabbitmq-config-data" not found Mar 16 16:06:03 crc kubenswrapper[5120]: I0316 16:06:03.260486 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f0204257-b12d-4e9d-bdfd-e35cfaa598b5-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:03 crc kubenswrapper[5120]: I0316 16:06:03.260500 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f0204257-b12d-4e9d-bdfd-e35cfaa598b5-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:03 crc kubenswrapper[5120]: I0316 16:06:03.260512 5120 reconciler_common.go:299] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/f0204257-b12d-4e9d-bdfd-e35cfaa598b5-fernet-keys\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:03 crc kubenswrapper[5120]: I0316 16:06:03.260521 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f0204257-b12d-4e9d-bdfd-e35cfaa598b5-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:03 crc kubenswrapper[5120]: I0316 16:06:03.260531 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gbw2c\" (UniqueName: \"kubernetes.io/projected/f0204257-b12d-4e9d-bdfd-e35cfaa598b5-kube-api-access-gbw2c\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:03 crc kubenswrapper[5120]: I0316 16:06:03.260540 5120 reconciler_common.go:299] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/f0204257-b12d-4e9d-bdfd-e35cfaa598b5-credential-keys\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:03 crc kubenswrapper[5120]: I0316 16:06:03.260549 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f0204257-b12d-4e9d-bdfd-e35cfaa598b5-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:03 crc kubenswrapper[5120]: I0316 16:06:03.260560 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f0204257-b12d-4e9d-bdfd-e35cfaa598b5-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:03 crc kubenswrapper[5120]: E0316 16:06:03.978724 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cinder-api-config-data: secret "cinder-api-config-data" not found Mar 16 16:06:03 crc kubenswrapper[5120]: E0316 16:06:03.978929 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cinder-config-data: secret "cinder-config-data" not found Mar 16 16:06:03 crc kubenswrapper[5120]: E0316 16:06:03.979040 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cinder-scripts: secret "cinder-scripts" not found Mar 16 16:06:03 crc kubenswrapper[5120]: E0316 16:06:03.978932 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8028a79-c5c3-420e-ac48-33a3991aba76-config-data-custom podName:f8028a79-c5c3-420e-ac48-33a3991aba76 nodeName:}" failed. No retries permitted until 2026-03-16 16:06:11.978863829 +0000 UTC m=+2074.132795526 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "config-data-custom" (UniqueName: "kubernetes.io/secret/f8028a79-c5c3-420e-ac48-33a3991aba76-config-data-custom") pod "cinder-api-0" (UID: "f8028a79-c5c3-420e-ac48-33a3991aba76") : secret "cinder-api-config-data" not found Mar 16 16:06:03 crc kubenswrapper[5120]: E0316 16:06:03.979094 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8028a79-c5c3-420e-ac48-33a3991aba76-config-data podName:f8028a79-c5c3-420e-ac48-33a3991aba76 nodeName:}" failed. No retries permitted until 2026-03-16 16:06:11.979074094 +0000 UTC m=+2074.133005761 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/secret/f8028a79-c5c3-420e-ac48-33a3991aba76-config-data") pod "cinder-api-0" (UID: "f8028a79-c5c3-420e-ac48-33a3991aba76") : secret "cinder-config-data" not found Mar 16 16:06:03 crc kubenswrapper[5120]: E0316 16:06:03.979112 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8028a79-c5c3-420e-ac48-33a3991aba76-scripts podName:f8028a79-c5c3-420e-ac48-33a3991aba76 nodeName:}" failed. No retries permitted until 2026-03-16 16:06:11.979103065 +0000 UTC m=+2074.133034742 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "scripts" (UniqueName: "kubernetes.io/secret/f8028a79-c5c3-420e-ac48-33a3991aba76-scripts") pod "cinder-api-0" (UID: "f8028a79-c5c3-420e-ac48-33a3991aba76") : secret "cinder-scripts" not found Mar 16 16:06:04 crc kubenswrapper[5120]: I0316 16:06:04.030861 5120 generic.go:358] "Generic (PLEG): container finished" podID="733010bf-0110-4a60-adf6-0f0ee336e96e" containerID="4e28e8c37cae1b7cf7aa14c8b6c7ec61364c748a7c4de5653e9534e4883c47e2" exitCode=0 Mar 16 16:06:04 crc kubenswrapper[5120]: I0316 16:06:04.030942 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"733010bf-0110-4a60-adf6-0f0ee336e96e","Type":"ContainerDied","Data":"4e28e8c37cae1b7cf7aa14c8b6c7ec61364c748a7c4de5653e9534e4883c47e2"} Mar 16 16:06:04 crc kubenswrapper[5120]: I0316 16:06:04.036936 5120 generic.go:358] "Generic (PLEG): container finished" podID="5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40" containerID="dd668b15f37de671532dd2837bc715c6d43a3e9f0b987f0af2c9cd57a996952f" exitCode=0 Mar 16 16:06:04 crc kubenswrapper[5120]: I0316 16:06:04.037050 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40","Type":"ContainerDied","Data":"dd668b15f37de671532dd2837bc715c6d43a3e9f0b987f0af2c9cd57a996952f"} Mar 16 16:06:04 crc kubenswrapper[5120]: I0316 16:06:04.037598 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-5948cb6c79-mrnwx" Mar 16 16:06:04 crc kubenswrapper[5120]: I0316 16:06:04.092678 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-5948cb6c79-mrnwx"] Mar 16 16:06:04 crc kubenswrapper[5120]: I0316 16:06:04.100637 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-5948cb6c79-mrnwx"] Mar 16 16:06:04 crc kubenswrapper[5120]: I0316 16:06:04.322108 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:06:04 crc kubenswrapper[5120]: I0316 16:06:04.391166 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40-config-data\") pod \"5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40\" (UID: \"5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40\") " Mar 16 16:06:04 crc kubenswrapper[5120]: I0316 16:06:04.391208 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40-rabbitmq-confd\") pod \"5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40\" (UID: \"5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40\") " Mar 16 16:06:04 crc kubenswrapper[5120]: I0316 16:06:04.391244 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"persistence\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") pod \"5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40\" (UID: \"5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40\") " Mar 16 16:06:04 crc kubenswrapper[5120]: I0316 16:06:04.391302 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40-rabbitmq-plugins\") pod \"5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40\" (UID: \"5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40\") " Mar 16 16:06:04 crc kubenswrapper[5120]: I0316 16:06:04.391336 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40-pod-info\") pod \"5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40\" (UID: \"5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40\") " Mar 16 16:06:04 crc kubenswrapper[5120]: I0316 16:06:04.391350 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40-plugins-conf\") pod \"5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40\" (UID: \"5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40\") " Mar 16 16:06:04 crc kubenswrapper[5120]: I0316 16:06:04.391385 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40-erlang-cookie-secret\") pod \"5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40\" (UID: \"5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40\") " Mar 16 16:06:04 crc kubenswrapper[5120]: I0316 16:06:04.391426 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40-server-conf\") pod \"5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40\" (UID: \"5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40\") " Mar 16 16:06:04 crc kubenswrapper[5120]: I0316 16:06:04.391455 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40-rabbitmq-tls\") pod \"5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40\" (UID: \"5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40\") " Mar 16 16:06:04 crc kubenswrapper[5120]: I0316 16:06:04.391594 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wf4kz\" (UniqueName: \"kubernetes.io/projected/5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40-kube-api-access-wf4kz\") pod \"5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40\" (UID: \"5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40\") " Mar 16 16:06:04 crc kubenswrapper[5120]: I0316 16:06:04.391616 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40-rabbitmq-erlang-cookie\") pod \"5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40\" (UID: \"5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40\") " Mar 16 16:06:04 crc kubenswrapper[5120]: I0316 16:06:04.392383 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40-rabbitmq-erlang-cookie" (OuterVolumeSpecName: "rabbitmq-erlang-cookie") pod "5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40" (UID: "5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40"). InnerVolumeSpecName "rabbitmq-erlang-cookie". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:06:04 crc kubenswrapper[5120]: I0316 16:06:04.392910 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40-plugins-conf" (OuterVolumeSpecName: "plugins-conf") pod "5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40" (UID: "5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40"). InnerVolumeSpecName "plugins-conf". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:06:04 crc kubenswrapper[5120]: I0316 16:06:04.397384 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40-rabbitmq-plugins" (OuterVolumeSpecName: "rabbitmq-plugins") pod "5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40" (UID: "5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40"). InnerVolumeSpecName "rabbitmq-plugins". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:06:04 crc kubenswrapper[5120]: I0316 16:06:04.397979 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40-rabbitmq-erlang-cookie\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:04 crc kubenswrapper[5120]: I0316 16:06:04.398006 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40-rabbitmq-plugins\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:04 crc kubenswrapper[5120]: I0316 16:06:04.398016 5120 reconciler_common.go:299] "Volume detached for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40-plugins-conf\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:04 crc kubenswrapper[5120]: I0316 16:06:04.410946 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40-pod-info" (OuterVolumeSpecName: "pod-info") pod "5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40" (UID: "5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40"). InnerVolumeSpecName "pod-info". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Mar 16 16:06:04 crc kubenswrapper[5120]: I0316 16:06:04.410999 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40-kube-api-access-wf4kz" (OuterVolumeSpecName: "kube-api-access-wf4kz") pod "5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40" (UID: "5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40"). InnerVolumeSpecName "kube-api-access-wf4kz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:06:04 crc kubenswrapper[5120]: I0316 16:06:04.417243 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage18-crc" (OuterVolumeSpecName: "persistence") pod "5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40" (UID: "5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40"). InnerVolumeSpecName "local-storage18-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:06:04 crc kubenswrapper[5120]: I0316 16:06:04.417389 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40-erlang-cookie-secret" (OuterVolumeSpecName: "erlang-cookie-secret") pod "5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40" (UID: "5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40"). InnerVolumeSpecName "erlang-cookie-secret". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:06:04 crc kubenswrapper[5120]: I0316 16:06:04.417520 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40-rabbitmq-tls" (OuterVolumeSpecName: "rabbitmq-tls") pod "5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40" (UID: "5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40"). InnerVolumeSpecName "rabbitmq-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:06:04 crc kubenswrapper[5120]: I0316 16:06:04.423443 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40-config-data" (OuterVolumeSpecName: "config-data") pod "5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40" (UID: "5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:06:04 crc kubenswrapper[5120]: I0316 16:06:04.434700 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561286-2qjw6" Mar 16 16:06:04 crc kubenswrapper[5120]: I0316 16:06:04.450323 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:06:04 crc kubenswrapper[5120]: I0316 16:06:04.476666 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40-server-conf" (OuterVolumeSpecName: "server-conf") pod "5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40" (UID: "5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40"). InnerVolumeSpecName "server-conf". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:06:04 crc kubenswrapper[5120]: I0316 16:06:04.502525 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wf4kz\" (UniqueName: \"kubernetes.io/projected/5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40-kube-api-access-wf4kz\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:04 crc kubenswrapper[5120]: I0316 16:06:04.502551 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:04 crc kubenswrapper[5120]: I0316 16:06:04.502573 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage18-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") on node \"crc\" " Mar 16 16:06:04 crc kubenswrapper[5120]: I0316 16:06:04.502582 5120 reconciler_common.go:299] "Volume detached for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40-pod-info\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:04 crc kubenswrapper[5120]: I0316 16:06:04.502591 5120 reconciler_common.go:299] "Volume detached for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40-erlang-cookie-secret\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:04 crc kubenswrapper[5120]: I0316 16:06:04.502601 5120 reconciler_common.go:299] "Volume detached for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40-server-conf\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:04 crc kubenswrapper[5120]: I0316 16:06:04.502609 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40-rabbitmq-tls\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:04 crc kubenswrapper[5120]: I0316 16:06:04.504976 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40-rabbitmq-confd" (OuterVolumeSpecName: "rabbitmq-confd") pod "5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40" (UID: "5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40"). InnerVolumeSpecName "rabbitmq-confd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:06:04 crc kubenswrapper[5120]: I0316 16:06:04.518148 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage18-crc" (UniqueName: "kubernetes.io/local-volume/local-storage18-crc") on node "crc" Mar 16 16:06:04 crc kubenswrapper[5120]: I0316 16:06:04.523591 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/neutron-dbbdddfd-6ldcl" podUID="44247dca-a1cf-42bd-8b32-51322d84cde0" containerName="neutron-httpd" probeResult="failure" output="Get \"https://10.217.1.180:9696/\": dial tcp 10.217.1.180:9696: connect: connection refused" Mar 16 16:06:04 crc kubenswrapper[5120]: I0316 16:06:04.604134 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"persistence\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"733010bf-0110-4a60-adf6-0f0ee336e96e\" (UID: \"733010bf-0110-4a60-adf6-0f0ee336e96e\") " Mar 16 16:06:04 crc kubenswrapper[5120]: I0316 16:06:04.604236 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/733010bf-0110-4a60-adf6-0f0ee336e96e-rabbitmq-tls\") pod \"733010bf-0110-4a60-adf6-0f0ee336e96e\" (UID: \"733010bf-0110-4a60-adf6-0f0ee336e96e\") " Mar 16 16:06:04 crc kubenswrapper[5120]: I0316 16:06:04.604277 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cqdng\" (UniqueName: \"kubernetes.io/projected/d908918a-f75b-405a-8ba3-5faa341a849a-kube-api-access-cqdng\") pod \"d908918a-f75b-405a-8ba3-5faa341a849a\" (UID: \"d908918a-f75b-405a-8ba3-5faa341a849a\") " Mar 16 16:06:04 crc kubenswrapper[5120]: I0316 16:06:04.604312 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/733010bf-0110-4a60-adf6-0f0ee336e96e-plugins-conf\") pod \"733010bf-0110-4a60-adf6-0f0ee336e96e\" (UID: \"733010bf-0110-4a60-adf6-0f0ee336e96e\") " Mar 16 16:06:04 crc kubenswrapper[5120]: I0316 16:06:04.604387 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/733010bf-0110-4a60-adf6-0f0ee336e96e-rabbitmq-plugins\") pod \"733010bf-0110-4a60-adf6-0f0ee336e96e\" (UID: \"733010bf-0110-4a60-adf6-0f0ee336e96e\") " Mar 16 16:06:04 crc kubenswrapper[5120]: I0316 16:06:04.604412 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/733010bf-0110-4a60-adf6-0f0ee336e96e-erlang-cookie-secret\") pod \"733010bf-0110-4a60-adf6-0f0ee336e96e\" (UID: \"733010bf-0110-4a60-adf6-0f0ee336e96e\") " Mar 16 16:06:04 crc kubenswrapper[5120]: I0316 16:06:04.604462 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/733010bf-0110-4a60-adf6-0f0ee336e96e-pod-info\") pod \"733010bf-0110-4a60-adf6-0f0ee336e96e\" (UID: \"733010bf-0110-4a60-adf6-0f0ee336e96e\") " Mar 16 16:06:04 crc kubenswrapper[5120]: I0316 16:06:04.604521 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/733010bf-0110-4a60-adf6-0f0ee336e96e-rabbitmq-erlang-cookie\") pod \"733010bf-0110-4a60-adf6-0f0ee336e96e\" (UID: \"733010bf-0110-4a60-adf6-0f0ee336e96e\") " Mar 16 16:06:04 crc kubenswrapper[5120]: I0316 16:06:04.604574 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/733010bf-0110-4a60-adf6-0f0ee336e96e-server-conf\") pod \"733010bf-0110-4a60-adf6-0f0ee336e96e\" (UID: \"733010bf-0110-4a60-adf6-0f0ee336e96e\") " Mar 16 16:06:04 crc kubenswrapper[5120]: I0316 16:06:04.604597 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/733010bf-0110-4a60-adf6-0f0ee336e96e-rabbitmq-confd\") pod \"733010bf-0110-4a60-adf6-0f0ee336e96e\" (UID: \"733010bf-0110-4a60-adf6-0f0ee336e96e\") " Mar 16 16:06:04 crc kubenswrapper[5120]: I0316 16:06:04.604630 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p4gz6\" (UniqueName: \"kubernetes.io/projected/733010bf-0110-4a60-adf6-0f0ee336e96e-kube-api-access-p4gz6\") pod \"733010bf-0110-4a60-adf6-0f0ee336e96e\" (UID: \"733010bf-0110-4a60-adf6-0f0ee336e96e\") " Mar 16 16:06:04 crc kubenswrapper[5120]: I0316 16:06:04.604718 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/733010bf-0110-4a60-adf6-0f0ee336e96e-config-data\") pod \"733010bf-0110-4a60-adf6-0f0ee336e96e\" (UID: \"733010bf-0110-4a60-adf6-0f0ee336e96e\") " Mar 16 16:06:04 crc kubenswrapper[5120]: I0316 16:06:04.605227 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40-rabbitmq-confd\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:04 crc kubenswrapper[5120]: I0316 16:06:04.605247 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage18-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:04 crc kubenswrapper[5120]: I0316 16:06:04.608591 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/733010bf-0110-4a60-adf6-0f0ee336e96e-rabbitmq-plugins" (OuterVolumeSpecName: "rabbitmq-plugins") pod "733010bf-0110-4a60-adf6-0f0ee336e96e" (UID: "733010bf-0110-4a60-adf6-0f0ee336e96e"). InnerVolumeSpecName "rabbitmq-plugins". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:06:04 crc kubenswrapper[5120]: I0316 16:06:04.608831 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/733010bf-0110-4a60-adf6-0f0ee336e96e-plugins-conf" (OuterVolumeSpecName: "plugins-conf") pod "733010bf-0110-4a60-adf6-0f0ee336e96e" (UID: "733010bf-0110-4a60-adf6-0f0ee336e96e"). InnerVolumeSpecName "plugins-conf". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:06:04 crc kubenswrapper[5120]: I0316 16:06:04.609388 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/733010bf-0110-4a60-adf6-0f0ee336e96e-rabbitmq-erlang-cookie" (OuterVolumeSpecName: "rabbitmq-erlang-cookie") pod "733010bf-0110-4a60-adf6-0f0ee336e96e" (UID: "733010bf-0110-4a60-adf6-0f0ee336e96e"). InnerVolumeSpecName "rabbitmq-erlang-cookie". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:06:04 crc kubenswrapper[5120]: I0316 16:06:04.611910 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage03-crc" (OuterVolumeSpecName: "persistence") pod "733010bf-0110-4a60-adf6-0f0ee336e96e" (UID: "733010bf-0110-4a60-adf6-0f0ee336e96e"). InnerVolumeSpecName "local-storage03-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:06:04 crc kubenswrapper[5120]: I0316 16:06:04.618295 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/733010bf-0110-4a60-adf6-0f0ee336e96e-erlang-cookie-secret" (OuterVolumeSpecName: "erlang-cookie-secret") pod "733010bf-0110-4a60-adf6-0f0ee336e96e" (UID: "733010bf-0110-4a60-adf6-0f0ee336e96e"). InnerVolumeSpecName "erlang-cookie-secret". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:06:04 crc kubenswrapper[5120]: I0316 16:06:04.629021 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/733010bf-0110-4a60-adf6-0f0ee336e96e-config-data" (OuterVolumeSpecName: "config-data") pod "733010bf-0110-4a60-adf6-0f0ee336e96e" (UID: "733010bf-0110-4a60-adf6-0f0ee336e96e"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:06:04 crc kubenswrapper[5120]: I0316 16:06:04.629257 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d908918a-f75b-405a-8ba3-5faa341a849a-kube-api-access-cqdng" (OuterVolumeSpecName: "kube-api-access-cqdng") pod "d908918a-f75b-405a-8ba3-5faa341a849a" (UID: "d908918a-f75b-405a-8ba3-5faa341a849a"). InnerVolumeSpecName "kube-api-access-cqdng". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:06:04 crc kubenswrapper[5120]: I0316 16:06:04.629477 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/733010bf-0110-4a60-adf6-0f0ee336e96e-pod-info" (OuterVolumeSpecName: "pod-info") pod "733010bf-0110-4a60-adf6-0f0ee336e96e" (UID: "733010bf-0110-4a60-adf6-0f0ee336e96e"). InnerVolumeSpecName "pod-info". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Mar 16 16:06:04 crc kubenswrapper[5120]: I0316 16:06:04.629713 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/733010bf-0110-4a60-adf6-0f0ee336e96e-rabbitmq-tls" (OuterVolumeSpecName: "rabbitmq-tls") pod "733010bf-0110-4a60-adf6-0f0ee336e96e" (UID: "733010bf-0110-4a60-adf6-0f0ee336e96e"). InnerVolumeSpecName "rabbitmq-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:06:04 crc kubenswrapper[5120]: I0316 16:06:04.637928 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/733010bf-0110-4a60-adf6-0f0ee336e96e-kube-api-access-p4gz6" (OuterVolumeSpecName: "kube-api-access-p4gz6") pod "733010bf-0110-4a60-adf6-0f0ee336e96e" (UID: "733010bf-0110-4a60-adf6-0f0ee336e96e"). InnerVolumeSpecName "kube-api-access-p4gz6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:06:04 crc kubenswrapper[5120]: I0316 16:06:04.663393 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/733010bf-0110-4a60-adf6-0f0ee336e96e-server-conf" (OuterVolumeSpecName: "server-conf") pod "733010bf-0110-4a60-adf6-0f0ee336e96e" (UID: "733010bf-0110-4a60-adf6-0f0ee336e96e"). InnerVolumeSpecName "server-conf". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:06:04 crc kubenswrapper[5120]: I0316 16:06:04.675247 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf2c0d02-34db-44f6-b7e5-625a82333785" path="/var/lib/kubelet/pods/cf2c0d02-34db-44f6-b7e5-625a82333785/volumes" Mar 16 16:06:04 crc kubenswrapper[5120]: I0316 16:06:04.676006 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f0204257-b12d-4e9d-bdfd-e35cfaa598b5" path="/var/lib/kubelet/pods/f0204257-b12d-4e9d-bdfd-e35cfaa598b5/volumes" Mar 16 16:06:04 crc kubenswrapper[5120]: I0316 16:06:04.707707 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/733010bf-0110-4a60-adf6-0f0ee336e96e-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:04 crc kubenswrapper[5120]: I0316 16:06:04.707834 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") on node \"crc\" " Mar 16 16:06:04 crc kubenswrapper[5120]: I0316 16:06:04.707857 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/733010bf-0110-4a60-adf6-0f0ee336e96e-rabbitmq-tls\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:04 crc kubenswrapper[5120]: I0316 16:06:04.707880 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cqdng\" (UniqueName: \"kubernetes.io/projected/d908918a-f75b-405a-8ba3-5faa341a849a-kube-api-access-cqdng\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:04 crc kubenswrapper[5120]: I0316 16:06:04.707899 5120 reconciler_common.go:299] "Volume detached for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/733010bf-0110-4a60-adf6-0f0ee336e96e-plugins-conf\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:04 crc kubenswrapper[5120]: I0316 16:06:04.707916 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/733010bf-0110-4a60-adf6-0f0ee336e96e-rabbitmq-plugins\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:04 crc kubenswrapper[5120]: I0316 16:06:04.707933 5120 reconciler_common.go:299] "Volume detached for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/733010bf-0110-4a60-adf6-0f0ee336e96e-erlang-cookie-secret\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:04 crc kubenswrapper[5120]: I0316 16:06:04.707950 5120 reconciler_common.go:299] "Volume detached for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/733010bf-0110-4a60-adf6-0f0ee336e96e-pod-info\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:04 crc kubenswrapper[5120]: I0316 16:06:04.707967 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/733010bf-0110-4a60-adf6-0f0ee336e96e-rabbitmq-erlang-cookie\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:04 crc kubenswrapper[5120]: I0316 16:06:04.707984 5120 reconciler_common.go:299] "Volume detached for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/733010bf-0110-4a60-adf6-0f0ee336e96e-server-conf\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:04 crc kubenswrapper[5120]: I0316 16:06:04.708001 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p4gz6\" (UniqueName: \"kubernetes.io/projected/733010bf-0110-4a60-adf6-0f0ee336e96e-kube-api-access-p4gz6\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:04 crc kubenswrapper[5120]: I0316 16:06:04.735444 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage03-crc" (UniqueName: "kubernetes.io/local-volume/local-storage03-crc") on node "crc" Mar 16 16:06:04 crc kubenswrapper[5120]: I0316 16:06:04.741380 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/733010bf-0110-4a60-adf6-0f0ee336e96e-rabbitmq-confd" (OuterVolumeSpecName: "rabbitmq-confd") pod "733010bf-0110-4a60-adf6-0f0ee336e96e" (UID: "733010bf-0110-4a60-adf6-0f0ee336e96e"). InnerVolumeSpecName "rabbitmq-confd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:06:04 crc kubenswrapper[5120]: I0316 16:06:04.809780 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/733010bf-0110-4a60-adf6-0f0ee336e96e-rabbitmq-confd\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:04 crc kubenswrapper[5120]: I0316 16:06:04.809804 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:04 crc kubenswrapper[5120]: I0316 16:06:04.957025 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-dbbdddfd-6ldcl_44247dca-a1cf-42bd-8b32-51322d84cde0/neutron-api/0.log" Mar 16 16:06:04 crc kubenswrapper[5120]: I0316 16:06:04.957313 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-dbbdddfd-6ldcl" Mar 16 16:06:05 crc kubenswrapper[5120]: I0316 16:06:05.068087 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40","Type":"ContainerDied","Data":"5a4cc4adfd5dfa20dc1f4638666bc5c6108ceb1c7516e9187b091003427caf43"} Mar 16 16:06:05 crc kubenswrapper[5120]: I0316 16:06:05.068162 5120 scope.go:117] "RemoveContainer" containerID="dd668b15f37de671532dd2837bc715c6d43a3e9f0b987f0af2c9cd57a996952f" Mar 16 16:06:05 crc kubenswrapper[5120]: I0316 16:06:05.068193 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:06:05 crc kubenswrapper[5120]: I0316 16:06:05.072624 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561286-2qjw6" event={"ID":"d908918a-f75b-405a-8ba3-5faa341a849a","Type":"ContainerDied","Data":"a63f9c7f4633a606634a4289412eeaa769ff81438abf91e98800773ba5b9ced7"} Mar 16 16:06:05 crc kubenswrapper[5120]: I0316 16:06:05.072730 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a63f9c7f4633a606634a4289412eeaa769ff81438abf91e98800773ba5b9ced7" Mar 16 16:06:05 crc kubenswrapper[5120]: I0316 16:06:05.072779 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561286-2qjw6" Mar 16 16:06:05 crc kubenswrapper[5120]: I0316 16:06:05.076653 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-dbbdddfd-6ldcl_44247dca-a1cf-42bd-8b32-51322d84cde0/neutron-api/0.log" Mar 16 16:06:05 crc kubenswrapper[5120]: I0316 16:06:05.076719 5120 generic.go:358] "Generic (PLEG): container finished" podID="44247dca-a1cf-42bd-8b32-51322d84cde0" containerID="3dd06cef3ecd0e7da8edb4a40afddee18218c601406d8cd6838f33a4fb58f9a6" exitCode=137 Mar 16 16:06:05 crc kubenswrapper[5120]: I0316 16:06:05.076746 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-dbbdddfd-6ldcl" event={"ID":"44247dca-a1cf-42bd-8b32-51322d84cde0","Type":"ContainerDied","Data":"3dd06cef3ecd0e7da8edb4a40afddee18218c601406d8cd6838f33a4fb58f9a6"} Mar 16 16:06:05 crc kubenswrapper[5120]: I0316 16:06:05.076786 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-dbbdddfd-6ldcl" event={"ID":"44247dca-a1cf-42bd-8b32-51322d84cde0","Type":"ContainerDied","Data":"837b7a514fe2ecac0a17c6412f1877c676ed660ca56065980c9a32de580d5a27"} Mar 16 16:06:05 crc kubenswrapper[5120]: I0316 16:06:05.076804 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-dbbdddfd-6ldcl" Mar 16 16:06:05 crc kubenswrapper[5120]: I0316 16:06:05.079862 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:06:05 crc kubenswrapper[5120]: I0316 16:06:05.080099 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"733010bf-0110-4a60-adf6-0f0ee336e96e","Type":"ContainerDied","Data":"fcec26a2bad396005d68f5e008fd71acdb2d27a79a808582cd7a044c60c175dc"} Mar 16 16:06:05 crc kubenswrapper[5120]: I0316 16:06:05.104019 5120 scope.go:117] "RemoveContainer" containerID="7967968386c8a15eb0601cb98a0edef7d11982ab65155af5b27542488b8f6d10" Mar 16 16:06:05 crc kubenswrapper[5120]: I0316 16:06:05.113953 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 16:06:05 crc kubenswrapper[5120]: I0316 16:06:05.115855 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/44247dca-a1cf-42bd-8b32-51322d84cde0-internal-tls-certs\") pod \"44247dca-a1cf-42bd-8b32-51322d84cde0\" (UID: \"44247dca-a1cf-42bd-8b32-51322d84cde0\") " Mar 16 16:06:05 crc kubenswrapper[5120]: I0316 16:06:05.116063 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/44247dca-a1cf-42bd-8b32-51322d84cde0-ovndb-tls-certs\") pod \"44247dca-a1cf-42bd-8b32-51322d84cde0\" (UID: \"44247dca-a1cf-42bd-8b32-51322d84cde0\") " Mar 16 16:06:05 crc kubenswrapper[5120]: I0316 16:06:05.116146 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/44247dca-a1cf-42bd-8b32-51322d84cde0-httpd-config\") pod \"44247dca-a1cf-42bd-8b32-51322d84cde0\" (UID: \"44247dca-a1cf-42bd-8b32-51322d84cde0\") " Mar 16 16:06:05 crc kubenswrapper[5120]: I0316 16:06:05.116278 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/44247dca-a1cf-42bd-8b32-51322d84cde0-combined-ca-bundle\") pod \"44247dca-a1cf-42bd-8b32-51322d84cde0\" (UID: \"44247dca-a1cf-42bd-8b32-51322d84cde0\") " Mar 16 16:06:05 crc kubenswrapper[5120]: I0316 16:06:05.116361 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/44247dca-a1cf-42bd-8b32-51322d84cde0-public-tls-certs\") pod \"44247dca-a1cf-42bd-8b32-51322d84cde0\" (UID: \"44247dca-a1cf-42bd-8b32-51322d84cde0\") " Mar 16 16:06:05 crc kubenswrapper[5120]: I0316 16:06:05.116548 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/44247dca-a1cf-42bd-8b32-51322d84cde0-config\") pod \"44247dca-a1cf-42bd-8b32-51322d84cde0\" (UID: \"44247dca-a1cf-42bd-8b32-51322d84cde0\") " Mar 16 16:06:05 crc kubenswrapper[5120]: I0316 16:06:05.116613 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-55nsx\" (UniqueName: \"kubernetes.io/projected/44247dca-a1cf-42bd-8b32-51322d84cde0-kube-api-access-55nsx\") pod \"44247dca-a1cf-42bd-8b32-51322d84cde0\" (UID: \"44247dca-a1cf-42bd-8b32-51322d84cde0\") " Mar 16 16:06:05 crc kubenswrapper[5120]: I0316 16:06:05.126225 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/44247dca-a1cf-42bd-8b32-51322d84cde0-httpd-config" (OuterVolumeSpecName: "httpd-config") pod "44247dca-a1cf-42bd-8b32-51322d84cde0" (UID: "44247dca-a1cf-42bd-8b32-51322d84cde0"). InnerVolumeSpecName "httpd-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:06:05 crc kubenswrapper[5120]: I0316 16:06:05.127290 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 16:06:05 crc kubenswrapper[5120]: I0316 16:06:05.127649 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44247dca-a1cf-42bd-8b32-51322d84cde0-kube-api-access-55nsx" (OuterVolumeSpecName: "kube-api-access-55nsx") pod "44247dca-a1cf-42bd-8b32-51322d84cde0" (UID: "44247dca-a1cf-42bd-8b32-51322d84cde0"). InnerVolumeSpecName "kube-api-access-55nsx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:06:05 crc kubenswrapper[5120]: I0316 16:06:05.133269 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 16:06:05 crc kubenswrapper[5120]: I0316 16:06:05.133612 5120 scope.go:117] "RemoveContainer" containerID="d2352e0088e9931dce600d12eb8ee3e08ae5cf21e193079916b0ea0c1de43d87" Mar 16 16:06:05 crc kubenswrapper[5120]: I0316 16:06:05.140029 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 16:06:05 crc kubenswrapper[5120]: I0316 16:06:05.158262 5120 scope.go:117] "RemoveContainer" containerID="3dd06cef3ecd0e7da8edb4a40afddee18218c601406d8cd6838f33a4fb58f9a6" Mar 16 16:06:05 crc kubenswrapper[5120]: I0316 16:06:05.175010 5120 scope.go:117] "RemoveContainer" containerID="d2352e0088e9931dce600d12eb8ee3e08ae5cf21e193079916b0ea0c1de43d87" Mar 16 16:06:05 crc kubenswrapper[5120]: E0316 16:06:05.175310 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d2352e0088e9931dce600d12eb8ee3e08ae5cf21e193079916b0ea0c1de43d87\": container with ID starting with d2352e0088e9931dce600d12eb8ee3e08ae5cf21e193079916b0ea0c1de43d87 not found: ID does not exist" containerID="d2352e0088e9931dce600d12eb8ee3e08ae5cf21e193079916b0ea0c1de43d87" Mar 16 16:06:05 crc kubenswrapper[5120]: I0316 16:06:05.175355 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2352e0088e9931dce600d12eb8ee3e08ae5cf21e193079916b0ea0c1de43d87"} err="failed to get container status \"d2352e0088e9931dce600d12eb8ee3e08ae5cf21e193079916b0ea0c1de43d87\": rpc error: code = NotFound desc = could not find container \"d2352e0088e9931dce600d12eb8ee3e08ae5cf21e193079916b0ea0c1de43d87\": container with ID starting with d2352e0088e9931dce600d12eb8ee3e08ae5cf21e193079916b0ea0c1de43d87 not found: ID does not exist" Mar 16 16:06:05 crc kubenswrapper[5120]: I0316 16:06:05.175382 5120 scope.go:117] "RemoveContainer" containerID="3dd06cef3ecd0e7da8edb4a40afddee18218c601406d8cd6838f33a4fb58f9a6" Mar 16 16:06:05 crc kubenswrapper[5120]: E0316 16:06:05.175698 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3dd06cef3ecd0e7da8edb4a40afddee18218c601406d8cd6838f33a4fb58f9a6\": container with ID starting with 3dd06cef3ecd0e7da8edb4a40afddee18218c601406d8cd6838f33a4fb58f9a6 not found: ID does not exist" containerID="3dd06cef3ecd0e7da8edb4a40afddee18218c601406d8cd6838f33a4fb58f9a6" Mar 16 16:06:05 crc kubenswrapper[5120]: I0316 16:06:05.175747 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3dd06cef3ecd0e7da8edb4a40afddee18218c601406d8cd6838f33a4fb58f9a6"} err="failed to get container status \"3dd06cef3ecd0e7da8edb4a40afddee18218c601406d8cd6838f33a4fb58f9a6\": rpc error: code = NotFound desc = could not find container \"3dd06cef3ecd0e7da8edb4a40afddee18218c601406d8cd6838f33a4fb58f9a6\": container with ID starting with 3dd06cef3ecd0e7da8edb4a40afddee18218c601406d8cd6838f33a4fb58f9a6 not found: ID does not exist" Mar 16 16:06:05 crc kubenswrapper[5120]: I0316 16:06:05.175786 5120 scope.go:117] "RemoveContainer" containerID="4e28e8c37cae1b7cf7aa14c8b6c7ec61364c748a7c4de5653e9534e4883c47e2" Mar 16 16:06:05 crc kubenswrapper[5120]: I0316 16:06:05.190195 5120 scope.go:117] "RemoveContainer" containerID="83541718a4772aeb3e24fc14a61368e286ec061ec2e8d0b2cbc1e307adb6afe1" Mar 16 16:06:05 crc kubenswrapper[5120]: I0316 16:06:05.221081 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/44247dca-a1cf-42bd-8b32-51322d84cde0-httpd-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:05 crc kubenswrapper[5120]: I0316 16:06:05.221184 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-55nsx\" (UniqueName: \"kubernetes.io/projected/44247dca-a1cf-42bd-8b32-51322d84cde0-kube-api-access-55nsx\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:05 crc kubenswrapper[5120]: I0316 16:06:05.459651 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/44247dca-a1cf-42bd-8b32-51322d84cde0-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "44247dca-a1cf-42bd-8b32-51322d84cde0" (UID: "44247dca-a1cf-42bd-8b32-51322d84cde0"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:06:05 crc kubenswrapper[5120]: I0316 16:06:05.479046 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/44247dca-a1cf-42bd-8b32-51322d84cde0-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "44247dca-a1cf-42bd-8b32-51322d84cde0" (UID: "44247dca-a1cf-42bd-8b32-51322d84cde0"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:06:05 crc kubenswrapper[5120]: E0316 16:06:05.479159 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="eaa8e905618c3287f78bbdda9d5b8e1d7a9ea191e193e106e08869701479bec0" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:06:05 crc kubenswrapper[5120]: E0316 16:06:05.490279 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="eaa8e905618c3287f78bbdda9d5b8e1d7a9ea191e193e106e08869701479bec0" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:06:05 crc kubenswrapper[5120]: I0316 16:06:05.493035 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/44247dca-a1cf-42bd-8b32-51322d84cde0-config" (OuterVolumeSpecName: "config") pod "44247dca-a1cf-42bd-8b32-51322d84cde0" (UID: "44247dca-a1cf-42bd-8b32-51322d84cde0"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:06:05 crc kubenswrapper[5120]: E0316 16:06:05.493806 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="eaa8e905618c3287f78bbdda9d5b8e1d7a9ea191e193e106e08869701479bec0" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:06:05 crc kubenswrapper[5120]: E0316 16:06:05.493863 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="683d3459-b9fc-478c-b74e-c1a09fd45e4d" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 16:06:05 crc kubenswrapper[5120]: I0316 16:06:05.497330 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-infra/auto-csr-approver-29561280-2xg8d"] Mar 16 16:06:05 crc kubenswrapper[5120]: I0316 16:06:05.506618 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-infra/auto-csr-approver-29561280-2xg8d"] Mar 16 16:06:05 crc kubenswrapper[5120]: I0316 16:06:05.512037 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/44247dca-a1cf-42bd-8b32-51322d84cde0-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "44247dca-a1cf-42bd-8b32-51322d84cde0" (UID: "44247dca-a1cf-42bd-8b32-51322d84cde0"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:06:05 crc kubenswrapper[5120]: I0316 16:06:05.527287 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/44247dca-a1cf-42bd-8b32-51322d84cde0-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:05 crc kubenswrapper[5120]: I0316 16:06:05.527313 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/44247dca-a1cf-42bd-8b32-51322d84cde0-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:05 crc kubenswrapper[5120]: I0316 16:06:05.527323 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/44247dca-a1cf-42bd-8b32-51322d84cde0-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:05 crc kubenswrapper[5120]: I0316 16:06:05.527333 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/44247dca-a1cf-42bd-8b32-51322d84cde0-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:05 crc kubenswrapper[5120]: I0316 16:06:05.543698 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/44247dca-a1cf-42bd-8b32-51322d84cde0-ovndb-tls-certs" (OuterVolumeSpecName: "ovndb-tls-certs") pod "44247dca-a1cf-42bd-8b32-51322d84cde0" (UID: "44247dca-a1cf-42bd-8b32-51322d84cde0"). InnerVolumeSpecName "ovndb-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:06:05 crc kubenswrapper[5120]: I0316 16:06:05.629273 5120 reconciler_common.go:299] "Volume detached for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/44247dca-a1cf-42bd-8b32-51322d84cde0-ovndb-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:05 crc kubenswrapper[5120]: I0316 16:06:05.726274 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-dbbdddfd-6ldcl"] Mar 16 16:06:05 crc kubenswrapper[5120]: I0316 16:06:05.730966 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-dbbdddfd-6ldcl"] Mar 16 16:06:06 crc kubenswrapper[5120]: E0316 16:06:06.660233 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a886de49bae32ee69eeae0c96d915691d3f0168922fae6e6426547d7baf51a40" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:06:06 crc kubenswrapper[5120]: E0316 16:06:06.662168 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a886de49bae32ee69eeae0c96d915691d3f0168922fae6e6426547d7baf51a40" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:06:06 crc kubenswrapper[5120]: E0316 16:06:06.664417 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a886de49bae32ee69eeae0c96d915691d3f0168922fae6e6426547d7baf51a40" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:06:06 crc kubenswrapper[5120]: E0316 16:06:06.664558 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="8f091159-612f-4c40-b215-344c86fe9f65" containerName="nova-cell1-conductor-conductor" probeResult="unknown" Mar 16 16:06:06 crc kubenswrapper[5120]: I0316 16:06:06.678200 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2faaeef7-818d-47ee-9a1f-05de5d494195" path="/var/lib/kubelet/pods/2faaeef7-818d-47ee-9a1f-05de5d494195/volumes" Mar 16 16:06:06 crc kubenswrapper[5120]: I0316 16:06:06.679030 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="44247dca-a1cf-42bd-8b32-51322d84cde0" path="/var/lib/kubelet/pods/44247dca-a1cf-42bd-8b32-51322d84cde0/volumes" Mar 16 16:06:06 crc kubenswrapper[5120]: I0316 16:06:06.679787 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40" path="/var/lib/kubelet/pods/5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40/volumes" Mar 16 16:06:06 crc kubenswrapper[5120]: I0316 16:06:06.681537 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="733010bf-0110-4a60-adf6-0f0ee336e96e" path="/var/lib/kubelet/pods/733010bf-0110-4a60-adf6-0f0ee336e96e/volumes" Mar 16 16:06:07 crc kubenswrapper[5120]: I0316 16:06:07.098898 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 16:06:07 crc kubenswrapper[5120]: I0316 16:06:07.099190 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/memcached-0" podUID="a4d9ab9b-4831-4be5-968a-10f3d8f3f654" containerName="memcached" containerID="cri-o://3e3059607b850fa6f05558692af36319455c228bff8ca5401cf9ce390e0bb7c2" gracePeriod=30 Mar 16 16:06:07 crc kubenswrapper[5120]: I0316 16:06:07.117086 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:06:07 crc kubenswrapper[5120]: I0316 16:06:07.117348 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="6645a7f0-de34-43c5-9422-1483edda0298" containerName="nova-scheduler-scheduler" containerID="cri-o://c95e062c78b43ac61bfb1ce3d6158aededf0d14a169d8cab5f5143628863dce1" gracePeriod=30 Mar 16 16:06:07 crc kubenswrapper[5120]: E0316 16:06:07.900404 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1390133 actualBytes=10240 Mar 16 16:06:08 crc kubenswrapper[5120]: I0316 16:06:08.012972 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-l8vn4" Mar 16 16:06:08 crc kubenswrapper[5120]: E0316 16:06:08.067875 5120 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbf01270c_6ae8_4c7f_aee3_42a125c155e4.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddbb06351_e6e7_4a49_a941_33b16fc6206d.slice\": RecentStats: unable to find data in memory cache]" Mar 16 16:06:08 crc kubenswrapper[5120]: I0316 16:06:08.073543 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-5f5844fc89-v9sgh"] Mar 16 16:06:08 crc kubenswrapper[5120]: I0316 16:06:08.073846 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5f5844fc89-v9sgh" podUID="a9aa09be-c2fd-46ef-b767-521dc67de64b" containerName="dnsmasq-dns" containerID="cri-o://c52b4d8d8f4b969076ab180f4ca8f11331e9331f7f7990112310d116dae9e4d1" gracePeriod=10 Mar 16 16:06:08 crc kubenswrapper[5120]: I0316 16:06:08.612630 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5f5844fc89-v9sgh" Mar 16 16:06:08 crc kubenswrapper[5120]: I0316 16:06:08.714855 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Mar 16 16:06:08 crc kubenswrapper[5120]: I0316 16:06:08.728830 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a9aa09be-c2fd-46ef-b767-521dc67de64b-config\") pod \"a9aa09be-c2fd-46ef-b767-521dc67de64b\" (UID: \"a9aa09be-c2fd-46ef-b767-521dc67de64b\") " Mar 16 16:06:08 crc kubenswrapper[5120]: I0316 16:06:08.729225 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/a9aa09be-c2fd-46ef-b767-521dc67de64b-dns-swift-storage-0\") pod \"a9aa09be-c2fd-46ef-b767-521dc67de64b\" (UID: \"a9aa09be-c2fd-46ef-b767-521dc67de64b\") " Mar 16 16:06:08 crc kubenswrapper[5120]: I0316 16:06:08.729393 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rb6n5\" (UniqueName: \"kubernetes.io/projected/a9aa09be-c2fd-46ef-b767-521dc67de64b-kube-api-access-rb6n5\") pod \"a9aa09be-c2fd-46ef-b767-521dc67de64b\" (UID: \"a9aa09be-c2fd-46ef-b767-521dc67de64b\") " Mar 16 16:06:08 crc kubenswrapper[5120]: I0316 16:06:08.729737 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/a9aa09be-c2fd-46ef-b767-521dc67de64b-dnsmasq-svc\") pod \"a9aa09be-c2fd-46ef-b767-521dc67de64b\" (UID: \"a9aa09be-c2fd-46ef-b767-521dc67de64b\") " Mar 16 16:06:08 crc kubenswrapper[5120]: I0316 16:06:08.742339 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/cinder-api-0" podUID="f8028a79-c5c3-420e-ac48-33a3991aba76" containerName="cinder-api" probeResult="failure" output="Get \"https://10.217.1.200:8776/healthcheck\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Mar 16 16:06:08 crc kubenswrapper[5120]: I0316 16:06:08.742383 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a9aa09be-c2fd-46ef-b767-521dc67de64b-kube-api-access-rb6n5" (OuterVolumeSpecName: "kube-api-access-rb6n5") pod "a9aa09be-c2fd-46ef-b767-521dc67de64b" (UID: "a9aa09be-c2fd-46ef-b767-521dc67de64b"). InnerVolumeSpecName "kube-api-access-rb6n5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:06:08 crc kubenswrapper[5120]: I0316 16:06:08.773730 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a9aa09be-c2fd-46ef-b767-521dc67de64b-dns-swift-storage-0" (OuterVolumeSpecName: "dns-swift-storage-0") pod "a9aa09be-c2fd-46ef-b767-521dc67de64b" (UID: "a9aa09be-c2fd-46ef-b767-521dc67de64b"). InnerVolumeSpecName "dns-swift-storage-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:06:08 crc kubenswrapper[5120]: I0316 16:06:08.778480 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a9aa09be-c2fd-46ef-b767-521dc67de64b-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "a9aa09be-c2fd-46ef-b767-521dc67de64b" (UID: "a9aa09be-c2fd-46ef-b767-521dc67de64b"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:06:08 crc kubenswrapper[5120]: I0316 16:06:08.779877 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a9aa09be-c2fd-46ef-b767-521dc67de64b-config" (OuterVolumeSpecName: "config") pod "a9aa09be-c2fd-46ef-b767-521dc67de64b" (UID: "a9aa09be-c2fd-46ef-b767-521dc67de64b"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:06:08 crc kubenswrapper[5120]: I0316 16:06:08.833265 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/a4d9ab9b-4831-4be5-968a-10f3d8f3f654-config-data\") pod \"a4d9ab9b-4831-4be5-968a-10f3d8f3f654\" (UID: \"a4d9ab9b-4831-4be5-968a-10f3d8f3f654\") " Mar 16 16:06:08 crc kubenswrapper[5120]: I0316 16:06:08.833309 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d9bs2\" (UniqueName: \"kubernetes.io/projected/a4d9ab9b-4831-4be5-968a-10f3d8f3f654-kube-api-access-d9bs2\") pod \"a4d9ab9b-4831-4be5-968a-10f3d8f3f654\" (UID: \"a4d9ab9b-4831-4be5-968a-10f3d8f3f654\") " Mar 16 16:06:08 crc kubenswrapper[5120]: I0316 16:06:08.833387 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a4d9ab9b-4831-4be5-968a-10f3d8f3f654-combined-ca-bundle\") pod \"a4d9ab9b-4831-4be5-968a-10f3d8f3f654\" (UID: \"a4d9ab9b-4831-4be5-968a-10f3d8f3f654\") " Mar 16 16:06:08 crc kubenswrapper[5120]: I0316 16:06:08.833583 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/a4d9ab9b-4831-4be5-968a-10f3d8f3f654-memcached-tls-certs\") pod \"a4d9ab9b-4831-4be5-968a-10f3d8f3f654\" (UID: \"a4d9ab9b-4831-4be5-968a-10f3d8f3f654\") " Mar 16 16:06:08 crc kubenswrapper[5120]: I0316 16:06:08.833651 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/a4d9ab9b-4831-4be5-968a-10f3d8f3f654-kolla-config\") pod \"a4d9ab9b-4831-4be5-968a-10f3d8f3f654\" (UID: \"a4d9ab9b-4831-4be5-968a-10f3d8f3f654\") " Mar 16 16:06:08 crc kubenswrapper[5120]: I0316 16:06:08.834525 5120 reconciler_common.go:299] "Volume detached for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/a9aa09be-c2fd-46ef-b767-521dc67de64b-dns-swift-storage-0\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:08 crc kubenswrapper[5120]: I0316 16:06:08.834546 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rb6n5\" (UniqueName: \"kubernetes.io/projected/a9aa09be-c2fd-46ef-b767-521dc67de64b-kube-api-access-rb6n5\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:08 crc kubenswrapper[5120]: I0316 16:06:08.834556 5120 reconciler_common.go:299] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/a9aa09be-c2fd-46ef-b767-521dc67de64b-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:08 crc kubenswrapper[5120]: I0316 16:06:08.834565 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a9aa09be-c2fd-46ef-b767-521dc67de64b-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:08 crc kubenswrapper[5120]: I0316 16:06:08.835137 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a4d9ab9b-4831-4be5-968a-10f3d8f3f654-config-data" (OuterVolumeSpecName: "config-data") pod "a4d9ab9b-4831-4be5-968a-10f3d8f3f654" (UID: "a4d9ab9b-4831-4be5-968a-10f3d8f3f654"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:06:08 crc kubenswrapper[5120]: I0316 16:06:08.835446 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a4d9ab9b-4831-4be5-968a-10f3d8f3f654-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "a4d9ab9b-4831-4be5-968a-10f3d8f3f654" (UID: "a4d9ab9b-4831-4be5-968a-10f3d8f3f654"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:06:08 crc kubenswrapper[5120]: I0316 16:06:08.837697 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a4d9ab9b-4831-4be5-968a-10f3d8f3f654-kube-api-access-d9bs2" (OuterVolumeSpecName: "kube-api-access-d9bs2") pod "a4d9ab9b-4831-4be5-968a-10f3d8f3f654" (UID: "a4d9ab9b-4831-4be5-968a-10f3d8f3f654"). InnerVolumeSpecName "kube-api-access-d9bs2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:06:08 crc kubenswrapper[5120]: I0316 16:06:08.853785 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a4d9ab9b-4831-4be5-968a-10f3d8f3f654-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "a4d9ab9b-4831-4be5-968a-10f3d8f3f654" (UID: "a4d9ab9b-4831-4be5-968a-10f3d8f3f654"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:06:08 crc kubenswrapper[5120]: I0316 16:06:08.886598 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a4d9ab9b-4831-4be5-968a-10f3d8f3f654-memcached-tls-certs" (OuterVolumeSpecName: "memcached-tls-certs") pod "a4d9ab9b-4831-4be5-968a-10f3d8f3f654" (UID: "a4d9ab9b-4831-4be5-968a-10f3d8f3f654"). InnerVolumeSpecName "memcached-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:06:08 crc kubenswrapper[5120]: I0316 16:06:08.936323 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/a4d9ab9b-4831-4be5-968a-10f3d8f3f654-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:08 crc kubenswrapper[5120]: I0316 16:06:08.936359 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d9bs2\" (UniqueName: \"kubernetes.io/projected/a4d9ab9b-4831-4be5-968a-10f3d8f3f654-kube-api-access-d9bs2\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:08 crc kubenswrapper[5120]: I0316 16:06:08.936376 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a4d9ab9b-4831-4be5-968a-10f3d8f3f654-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:08 crc kubenswrapper[5120]: I0316 16:06:08.936389 5120 reconciler_common.go:299] "Volume detached for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/a4d9ab9b-4831-4be5-968a-10f3d8f3f654-memcached-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:08 crc kubenswrapper[5120]: I0316 16:06:08.936401 5120 reconciler_common.go:299] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/a4d9ab9b-4831-4be5-968a-10f3d8f3f654-kolla-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:09 crc kubenswrapper[5120]: I0316 16:06:09.130587 5120 generic.go:358] "Generic (PLEG): container finished" podID="a4d9ab9b-4831-4be5-968a-10f3d8f3f654" containerID="3e3059607b850fa6f05558692af36319455c228bff8ca5401cf9ce390e0bb7c2" exitCode=0 Mar 16 16:06:09 crc kubenswrapper[5120]: I0316 16:06:09.130673 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"a4d9ab9b-4831-4be5-968a-10f3d8f3f654","Type":"ContainerDied","Data":"3e3059607b850fa6f05558692af36319455c228bff8ca5401cf9ce390e0bb7c2"} Mar 16 16:06:09 crc kubenswrapper[5120]: I0316 16:06:09.130705 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"a4d9ab9b-4831-4be5-968a-10f3d8f3f654","Type":"ContainerDied","Data":"e4ec017585aa1f942743ef7639545b8815256a243b8ba4c94b419209f0e89bb5"} Mar 16 16:06:09 crc kubenswrapper[5120]: I0316 16:06:09.130726 5120 scope.go:117] "RemoveContainer" containerID="3e3059607b850fa6f05558692af36319455c228bff8ca5401cf9ce390e0bb7c2" Mar 16 16:06:09 crc kubenswrapper[5120]: I0316 16:06:09.130874 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Mar 16 16:06:09 crc kubenswrapper[5120]: I0316 16:06:09.157455 5120 generic.go:358] "Generic (PLEG): container finished" podID="a9aa09be-c2fd-46ef-b767-521dc67de64b" containerID="c52b4d8d8f4b969076ab180f4ca8f11331e9331f7f7990112310d116dae9e4d1" exitCode=0 Mar 16 16:06:09 crc kubenswrapper[5120]: I0316 16:06:09.157939 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5f5844fc89-v9sgh" event={"ID":"a9aa09be-c2fd-46ef-b767-521dc67de64b","Type":"ContainerDied","Data":"c52b4d8d8f4b969076ab180f4ca8f11331e9331f7f7990112310d116dae9e4d1"} Mar 16 16:06:09 crc kubenswrapper[5120]: I0316 16:06:09.157983 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5f5844fc89-v9sgh" Mar 16 16:06:09 crc kubenswrapper[5120]: I0316 16:06:09.157990 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5f5844fc89-v9sgh" event={"ID":"a9aa09be-c2fd-46ef-b767-521dc67de64b","Type":"ContainerDied","Data":"494b10eb6f5c8608ed4b9d3d054de8365e28486ca1d9607035e7b4639fc41cbe"} Mar 16 16:06:09 crc kubenswrapper[5120]: I0316 16:06:09.193171 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 16:06:09 crc kubenswrapper[5120]: I0316 16:06:09.201274 5120 scope.go:117] "RemoveContainer" containerID="3e3059607b850fa6f05558692af36319455c228bff8ca5401cf9ce390e0bb7c2" Mar 16 16:06:09 crc kubenswrapper[5120]: E0316 16:06:09.201798 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e3059607b850fa6f05558692af36319455c228bff8ca5401cf9ce390e0bb7c2\": container with ID starting with 3e3059607b850fa6f05558692af36319455c228bff8ca5401cf9ce390e0bb7c2 not found: ID does not exist" containerID="3e3059607b850fa6f05558692af36319455c228bff8ca5401cf9ce390e0bb7c2" Mar 16 16:06:09 crc kubenswrapper[5120]: I0316 16:06:09.201856 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e3059607b850fa6f05558692af36319455c228bff8ca5401cf9ce390e0bb7c2"} err="failed to get container status \"3e3059607b850fa6f05558692af36319455c228bff8ca5401cf9ce390e0bb7c2\": rpc error: code = NotFound desc = could not find container \"3e3059607b850fa6f05558692af36319455c228bff8ca5401cf9ce390e0bb7c2\": container with ID starting with 3e3059607b850fa6f05558692af36319455c228bff8ca5401cf9ce390e0bb7c2 not found: ID does not exist" Mar 16 16:06:09 crc kubenswrapper[5120]: I0316 16:06:09.201891 5120 scope.go:117] "RemoveContainer" containerID="c52b4d8d8f4b969076ab180f4ca8f11331e9331f7f7990112310d116dae9e4d1" Mar 16 16:06:09 crc kubenswrapper[5120]: I0316 16:06:09.235392 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 16:06:09 crc kubenswrapper[5120]: I0316 16:06:09.274373 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-5f5844fc89-v9sgh"] Mar 16 16:06:09 crc kubenswrapper[5120]: I0316 16:06:09.275774 5120 scope.go:117] "RemoveContainer" containerID="4365433c66f99da3204da5b9bc7a9e76896fc64830798847f5ac3979dc4e8cd7" Mar 16 16:06:09 crc kubenswrapper[5120]: I0316 16:06:09.286892 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-5f5844fc89-v9sgh"] Mar 16 16:06:09 crc kubenswrapper[5120]: I0316 16:06:09.309343 5120 scope.go:117] "RemoveContainer" containerID="c52b4d8d8f4b969076ab180f4ca8f11331e9331f7f7990112310d116dae9e4d1" Mar 16 16:06:09 crc kubenswrapper[5120]: E0316 16:06:09.309815 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c52b4d8d8f4b969076ab180f4ca8f11331e9331f7f7990112310d116dae9e4d1\": container with ID starting with c52b4d8d8f4b969076ab180f4ca8f11331e9331f7f7990112310d116dae9e4d1 not found: ID does not exist" containerID="c52b4d8d8f4b969076ab180f4ca8f11331e9331f7f7990112310d116dae9e4d1" Mar 16 16:06:09 crc kubenswrapper[5120]: I0316 16:06:09.309873 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c52b4d8d8f4b969076ab180f4ca8f11331e9331f7f7990112310d116dae9e4d1"} err="failed to get container status \"c52b4d8d8f4b969076ab180f4ca8f11331e9331f7f7990112310d116dae9e4d1\": rpc error: code = NotFound desc = could not find container \"c52b4d8d8f4b969076ab180f4ca8f11331e9331f7f7990112310d116dae9e4d1\": container with ID starting with c52b4d8d8f4b969076ab180f4ca8f11331e9331f7f7990112310d116dae9e4d1 not found: ID does not exist" Mar 16 16:06:09 crc kubenswrapper[5120]: I0316 16:06:09.309903 5120 scope.go:117] "RemoveContainer" containerID="4365433c66f99da3204da5b9bc7a9e76896fc64830798847f5ac3979dc4e8cd7" Mar 16 16:06:09 crc kubenswrapper[5120]: E0316 16:06:09.310804 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4365433c66f99da3204da5b9bc7a9e76896fc64830798847f5ac3979dc4e8cd7\": container with ID starting with 4365433c66f99da3204da5b9bc7a9e76896fc64830798847f5ac3979dc4e8cd7 not found: ID does not exist" containerID="4365433c66f99da3204da5b9bc7a9e76896fc64830798847f5ac3979dc4e8cd7" Mar 16 16:06:09 crc kubenswrapper[5120]: I0316 16:06:09.310892 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4365433c66f99da3204da5b9bc7a9e76896fc64830798847f5ac3979dc4e8cd7"} err="failed to get container status \"4365433c66f99da3204da5b9bc7a9e76896fc64830798847f5ac3979dc4e8cd7\": rpc error: code = NotFound desc = could not find container \"4365433c66f99da3204da5b9bc7a9e76896fc64830798847f5ac3979dc4e8cd7\": container with ID starting with 4365433c66f99da3204da5b9bc7a9e76896fc64830798847f5ac3979dc4e8cd7 not found: ID does not exist" Mar 16 16:06:10 crc kubenswrapper[5120]: E0316 16:06:10.001908 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="c95e062c78b43ac61bfb1ce3d6158aededf0d14a169d8cab5f5143628863dce1" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:06:10 crc kubenswrapper[5120]: E0316 16:06:10.004718 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="c95e062c78b43ac61bfb1ce3d6158aededf0d14a169d8cab5f5143628863dce1" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:06:10 crc kubenswrapper[5120]: E0316 16:06:10.006371 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="c95e062c78b43ac61bfb1ce3d6158aededf0d14a169d8cab5f5143628863dce1" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:06:10 crc kubenswrapper[5120]: E0316 16:06:10.006481 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="6645a7f0-de34-43c5-9422-1483edda0298" containerName="nova-scheduler-scheduler" probeResult="unknown" Mar 16 16:06:10 crc kubenswrapper[5120]: E0316 16:06:10.474017 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="eaa8e905618c3287f78bbdda9d5b8e1d7a9ea191e193e106e08869701479bec0" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:06:10 crc kubenswrapper[5120]: E0316 16:06:10.476497 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="eaa8e905618c3287f78bbdda9d5b8e1d7a9ea191e193e106e08869701479bec0" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:06:10 crc kubenswrapper[5120]: E0316 16:06:10.479254 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="eaa8e905618c3287f78bbdda9d5b8e1d7a9ea191e193e106e08869701479bec0" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:06:10 crc kubenswrapper[5120]: E0316 16:06:10.479368 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="683d3459-b9fc-478c-b74e-c1a09fd45e4d" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 16:06:10 crc kubenswrapper[5120]: E0316 16:06:10.574219 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 16:06:10 crc kubenswrapper[5120]: E0316 16:06:10.574291 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8028a79-c5c3-420e-ac48-33a3991aba76-combined-ca-bundle podName:f8028a79-c5c3-420e-ac48-33a3991aba76 nodeName:}" failed. No retries permitted until 2026-03-16 16:06:26.574275378 +0000 UTC m=+2088.728207035 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/f8028a79-c5c3-420e-ac48-33a3991aba76-combined-ca-bundle") pod "cinder-api-0" (UID: "f8028a79-c5c3-420e-ac48-33a3991aba76") : secret "combined-ca-bundle" not found Mar 16 16:06:10 crc kubenswrapper[5120]: E0316 16:06:10.574455 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-cinder-public-svc: secret "cert-cinder-public-svc" not found Mar 16 16:06:10 crc kubenswrapper[5120]: E0316 16:06:10.574478 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8028a79-c5c3-420e-ac48-33a3991aba76-public-tls-certs podName:f8028a79-c5c3-420e-ac48-33a3991aba76 nodeName:}" failed. No retries permitted until 2026-03-16 16:06:26.574470743 +0000 UTC m=+2088.728402390 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/f8028a79-c5c3-420e-ac48-33a3991aba76-public-tls-certs") pod "cinder-api-0" (UID: "f8028a79-c5c3-420e-ac48-33a3991aba76") : secret "cert-cinder-public-svc" not found Mar 16 16:06:10 crc kubenswrapper[5120]: E0316 16:06:10.574564 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-cinder-internal-svc: secret "cert-cinder-internal-svc" not found Mar 16 16:06:10 crc kubenswrapper[5120]: E0316 16:06:10.574584 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8028a79-c5c3-420e-ac48-33a3991aba76-internal-tls-certs podName:f8028a79-c5c3-420e-ac48-33a3991aba76 nodeName:}" failed. No retries permitted until 2026-03-16 16:06:26.574577676 +0000 UTC m=+2088.728509333 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/f8028a79-c5c3-420e-ac48-33a3991aba76-internal-tls-certs") pod "cinder-api-0" (UID: "f8028a79-c5c3-420e-ac48-33a3991aba76") : secret "cert-cinder-internal-svc" not found Mar 16 16:06:10 crc kubenswrapper[5120]: I0316 16:06:10.675306 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a4d9ab9b-4831-4be5-968a-10f3d8f3f654" path="/var/lib/kubelet/pods/a4d9ab9b-4831-4be5-968a-10f3d8f3f654/volumes" Mar 16 16:06:10 crc kubenswrapper[5120]: I0316 16:06:10.676120 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a9aa09be-c2fd-46ef-b767-521dc67de64b" path="/var/lib/kubelet/pods/a9aa09be-c2fd-46ef-b767-521dc67de64b/volumes" Mar 16 16:06:10 crc kubenswrapper[5120]: I0316 16:06:10.797414 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/neutron-6b8df9c88d-rbjrz" podUID="9d8004a6-f52b-420c-9f64-141dae970d7e" containerName="neutron-httpd" probeResult="failure" output="Get \"https://10.217.1.129:9696/\": dial tcp 10.217.1.129:9696: connect: connection refused" Mar 16 16:06:10 crc kubenswrapper[5120]: I0316 16:06:10.947952 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:06:11 crc kubenswrapper[5120]: I0316 16:06:11.102954 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/683d3459-b9fc-478c-b74e-c1a09fd45e4d-combined-ca-bundle\") pod \"683d3459-b9fc-478c-b74e-c1a09fd45e4d\" (UID: \"683d3459-b9fc-478c-b74e-c1a09fd45e4d\") " Mar 16 16:06:11 crc kubenswrapper[5120]: I0316 16:06:11.103128 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-69lg2\" (UniqueName: \"kubernetes.io/projected/683d3459-b9fc-478c-b74e-c1a09fd45e4d-kube-api-access-69lg2\") pod \"683d3459-b9fc-478c-b74e-c1a09fd45e4d\" (UID: \"683d3459-b9fc-478c-b74e-c1a09fd45e4d\") " Mar 16 16:06:11 crc kubenswrapper[5120]: I0316 16:06:11.103301 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/683d3459-b9fc-478c-b74e-c1a09fd45e4d-config-data\") pod \"683d3459-b9fc-478c-b74e-c1a09fd45e4d\" (UID: \"683d3459-b9fc-478c-b74e-c1a09fd45e4d\") " Mar 16 16:06:11 crc kubenswrapper[5120]: I0316 16:06:11.108620 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/683d3459-b9fc-478c-b74e-c1a09fd45e4d-kube-api-access-69lg2" (OuterVolumeSpecName: "kube-api-access-69lg2") pod "683d3459-b9fc-478c-b74e-c1a09fd45e4d" (UID: "683d3459-b9fc-478c-b74e-c1a09fd45e4d"). InnerVolumeSpecName "kube-api-access-69lg2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:06:11 crc kubenswrapper[5120]: I0316 16:06:11.130031 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/683d3459-b9fc-478c-b74e-c1a09fd45e4d-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "683d3459-b9fc-478c-b74e-c1a09fd45e4d" (UID: "683d3459-b9fc-478c-b74e-c1a09fd45e4d"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:06:11 crc kubenswrapper[5120]: I0316 16:06:11.160844 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/683d3459-b9fc-478c-b74e-c1a09fd45e4d-config-data" (OuterVolumeSpecName: "config-data") pod "683d3459-b9fc-478c-b74e-c1a09fd45e4d" (UID: "683d3459-b9fc-478c-b74e-c1a09fd45e4d"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:06:11 crc kubenswrapper[5120]: I0316 16:06:11.184452 5120 generic.go:358] "Generic (PLEG): container finished" podID="683d3459-b9fc-478c-b74e-c1a09fd45e4d" containerID="eaa8e905618c3287f78bbdda9d5b8e1d7a9ea191e193e106e08869701479bec0" exitCode=137 Mar 16 16:06:11 crc kubenswrapper[5120]: I0316 16:06:11.184594 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:06:11 crc kubenswrapper[5120]: I0316 16:06:11.184595 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"683d3459-b9fc-478c-b74e-c1a09fd45e4d","Type":"ContainerDied","Data":"eaa8e905618c3287f78bbdda9d5b8e1d7a9ea191e193e106e08869701479bec0"} Mar 16 16:06:11 crc kubenswrapper[5120]: I0316 16:06:11.184807 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"683d3459-b9fc-478c-b74e-c1a09fd45e4d","Type":"ContainerDied","Data":"7a6820d3a24d23e855c9be472d4e4b66d36ad7fcc83346577d9377a21c4e581c"} Mar 16 16:06:11 crc kubenswrapper[5120]: I0316 16:06:11.184831 5120 scope.go:117] "RemoveContainer" containerID="eaa8e905618c3287f78bbdda9d5b8e1d7a9ea191e193e106e08869701479bec0" Mar 16 16:06:11 crc kubenswrapper[5120]: I0316 16:06:11.187688 5120 generic.go:358] "Generic (PLEG): container finished" podID="4e3ac124-ebc3-4631-a7b1-5dc135748d5d" containerID="340d50169e48c14cb6d4557c098a1c2d295af9830d64eeaf1c4c58f08e737170" exitCode=0 Mar 16 16:06:11 crc kubenswrapper[5120]: I0316 16:06:11.187800 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"4e3ac124-ebc3-4631-a7b1-5dc135748d5d","Type":"ContainerDied","Data":"340d50169e48c14cb6d4557c098a1c2d295af9830d64eeaf1c4c58f08e737170"} Mar 16 16:06:11 crc kubenswrapper[5120]: I0316 16:06:11.205963 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/683d3459-b9fc-478c-b74e-c1a09fd45e4d-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:11 crc kubenswrapper[5120]: I0316 16:06:11.206004 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-69lg2\" (UniqueName: \"kubernetes.io/projected/683d3459-b9fc-478c-b74e-c1a09fd45e4d-kube-api-access-69lg2\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:11 crc kubenswrapper[5120]: I0316 16:06:11.206018 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/683d3459-b9fc-478c-b74e-c1a09fd45e4d-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:11 crc kubenswrapper[5120]: I0316 16:06:11.230162 5120 scope.go:117] "RemoveContainer" containerID="eaa8e905618c3287f78bbdda9d5b8e1d7a9ea191e193e106e08869701479bec0" Mar 16 16:06:11 crc kubenswrapper[5120]: E0316 16:06:11.230730 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eaa8e905618c3287f78bbdda9d5b8e1d7a9ea191e193e106e08869701479bec0\": container with ID starting with eaa8e905618c3287f78bbdda9d5b8e1d7a9ea191e193e106e08869701479bec0 not found: ID does not exist" containerID="eaa8e905618c3287f78bbdda9d5b8e1d7a9ea191e193e106e08869701479bec0" Mar 16 16:06:11 crc kubenswrapper[5120]: I0316 16:06:11.230836 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eaa8e905618c3287f78bbdda9d5b8e1d7a9ea191e193e106e08869701479bec0"} err="failed to get container status \"eaa8e905618c3287f78bbdda9d5b8e1d7a9ea191e193e106e08869701479bec0\": rpc error: code = NotFound desc = could not find container \"eaa8e905618c3287f78bbdda9d5b8e1d7a9ea191e193e106e08869701479bec0\": container with ID starting with eaa8e905618c3287f78bbdda9d5b8e1d7a9ea191e193e106e08869701479bec0 not found: ID does not exist" Mar 16 16:06:11 crc kubenswrapper[5120]: I0316 16:06:11.236051 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:06:11 crc kubenswrapper[5120]: I0316 16:06:11.240644 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:06:11 crc kubenswrapper[5120]: I0316 16:06:11.247542 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:06:11 crc kubenswrapper[5120]: I0316 16:06:11.408199 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4e3ac124-ebc3-4631-a7b1-5dc135748d5d-combined-ca-bundle\") pod \"4e3ac124-ebc3-4631-a7b1-5dc135748d5d\" (UID: \"4e3ac124-ebc3-4631-a7b1-5dc135748d5d\") " Mar 16 16:06:11 crc kubenswrapper[5120]: I0316 16:06:11.408616 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/4e3ac124-ebc3-4631-a7b1-5dc135748d5d-internal-tls-certs\") pod \"4e3ac124-ebc3-4631-a7b1-5dc135748d5d\" (UID: \"4e3ac124-ebc3-4631-a7b1-5dc135748d5d\") " Mar 16 16:06:11 crc kubenswrapper[5120]: I0316 16:06:11.408823 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-769xx\" (UniqueName: \"kubernetes.io/projected/4e3ac124-ebc3-4631-a7b1-5dc135748d5d-kube-api-access-769xx\") pod \"4e3ac124-ebc3-4631-a7b1-5dc135748d5d\" (UID: \"4e3ac124-ebc3-4631-a7b1-5dc135748d5d\") " Mar 16 16:06:11 crc kubenswrapper[5120]: I0316 16:06:11.408980 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4e3ac124-ebc3-4631-a7b1-5dc135748d5d-logs\") pod \"4e3ac124-ebc3-4631-a7b1-5dc135748d5d\" (UID: \"4e3ac124-ebc3-4631-a7b1-5dc135748d5d\") " Mar 16 16:06:11 crc kubenswrapper[5120]: I0316 16:06:11.409113 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4e3ac124-ebc3-4631-a7b1-5dc135748d5d-config-data\") pod \"4e3ac124-ebc3-4631-a7b1-5dc135748d5d\" (UID: \"4e3ac124-ebc3-4631-a7b1-5dc135748d5d\") " Mar 16 16:06:11 crc kubenswrapper[5120]: I0316 16:06:11.409252 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/4e3ac124-ebc3-4631-a7b1-5dc135748d5d-public-tls-certs\") pod \"4e3ac124-ebc3-4631-a7b1-5dc135748d5d\" (UID: \"4e3ac124-ebc3-4631-a7b1-5dc135748d5d\") " Mar 16 16:06:11 crc kubenswrapper[5120]: I0316 16:06:11.409702 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e3ac124-ebc3-4631-a7b1-5dc135748d5d-logs" (OuterVolumeSpecName: "logs") pod "4e3ac124-ebc3-4631-a7b1-5dc135748d5d" (UID: "4e3ac124-ebc3-4631-a7b1-5dc135748d5d"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:06:11 crc kubenswrapper[5120]: I0316 16:06:11.413608 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e3ac124-ebc3-4631-a7b1-5dc135748d5d-kube-api-access-769xx" (OuterVolumeSpecName: "kube-api-access-769xx") pod "4e3ac124-ebc3-4631-a7b1-5dc135748d5d" (UID: "4e3ac124-ebc3-4631-a7b1-5dc135748d5d"). InnerVolumeSpecName "kube-api-access-769xx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:06:11 crc kubenswrapper[5120]: I0316 16:06:11.428155 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4e3ac124-ebc3-4631-a7b1-5dc135748d5d-config-data" (OuterVolumeSpecName: "config-data") pod "4e3ac124-ebc3-4631-a7b1-5dc135748d5d" (UID: "4e3ac124-ebc3-4631-a7b1-5dc135748d5d"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:06:11 crc kubenswrapper[5120]: I0316 16:06:11.446823 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4e3ac124-ebc3-4631-a7b1-5dc135748d5d-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "4e3ac124-ebc3-4631-a7b1-5dc135748d5d" (UID: "4e3ac124-ebc3-4631-a7b1-5dc135748d5d"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:06:11 crc kubenswrapper[5120]: I0316 16:06:11.450973 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4e3ac124-ebc3-4631-a7b1-5dc135748d5d-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "4e3ac124-ebc3-4631-a7b1-5dc135748d5d" (UID: "4e3ac124-ebc3-4631-a7b1-5dc135748d5d"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:06:11 crc kubenswrapper[5120]: I0316 16:06:11.486431 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4e3ac124-ebc3-4631-a7b1-5dc135748d5d-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "4e3ac124-ebc3-4631-a7b1-5dc135748d5d" (UID: "4e3ac124-ebc3-4631-a7b1-5dc135748d5d"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:06:11 crc kubenswrapper[5120]: I0316 16:06:11.512009 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4e3ac124-ebc3-4631-a7b1-5dc135748d5d-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:11 crc kubenswrapper[5120]: I0316 16:06:11.512051 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4e3ac124-ebc3-4631-a7b1-5dc135748d5d-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:11 crc kubenswrapper[5120]: I0316 16:06:11.512064 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/4e3ac124-ebc3-4631-a7b1-5dc135748d5d-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:11 crc kubenswrapper[5120]: I0316 16:06:11.512077 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4e3ac124-ebc3-4631-a7b1-5dc135748d5d-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:11 crc kubenswrapper[5120]: I0316 16:06:11.512088 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/4e3ac124-ebc3-4631-a7b1-5dc135748d5d-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:11 crc kubenswrapper[5120]: I0316 16:06:11.512099 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-769xx\" (UniqueName: \"kubernetes.io/projected/4e3ac124-ebc3-4631-a7b1-5dc135748d5d-kube-api-access-769xx\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:11 crc kubenswrapper[5120]: E0316 16:06:11.660459 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a886de49bae32ee69eeae0c96d915691d3f0168922fae6e6426547d7baf51a40" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:06:11 crc kubenswrapper[5120]: E0316 16:06:11.662572 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a886de49bae32ee69eeae0c96d915691d3f0168922fae6e6426547d7baf51a40" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:06:11 crc kubenswrapper[5120]: E0316 16:06:11.664663 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a886de49bae32ee69eeae0c96d915691d3f0168922fae6e6426547d7baf51a40" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:06:11 crc kubenswrapper[5120]: E0316 16:06:11.664712 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="8f091159-612f-4c40-b215-344c86fe9f65" containerName="nova-cell1-conductor-conductor" probeResult="unknown" Mar 16 16:06:12 crc kubenswrapper[5120]: E0316 16:06:12.021713 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cinder-api-config-data: secret "cinder-api-config-data" not found Mar 16 16:06:12 crc kubenswrapper[5120]: E0316 16:06:12.021830 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8028a79-c5c3-420e-ac48-33a3991aba76-config-data-custom podName:f8028a79-c5c3-420e-ac48-33a3991aba76 nodeName:}" failed. No retries permitted until 2026-03-16 16:06:28.021804124 +0000 UTC m=+2090.175735881 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "config-data-custom" (UniqueName: "kubernetes.io/secret/f8028a79-c5c3-420e-ac48-33a3991aba76-config-data-custom") pod "cinder-api-0" (UID: "f8028a79-c5c3-420e-ac48-33a3991aba76") : secret "cinder-api-config-data" not found Mar 16 16:06:12 crc kubenswrapper[5120]: E0316 16:06:12.022333 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cinder-config-data: secret "cinder-config-data" not found Mar 16 16:06:12 crc kubenswrapper[5120]: E0316 16:06:12.022459 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cinder-scripts: secret "cinder-scripts" not found Mar 16 16:06:12 crc kubenswrapper[5120]: E0316 16:06:12.022699 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8028a79-c5c3-420e-ac48-33a3991aba76-config-data podName:f8028a79-c5c3-420e-ac48-33a3991aba76 nodeName:}" failed. No retries permitted until 2026-03-16 16:06:28.022662178 +0000 UTC m=+2090.176593865 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/secret/f8028a79-c5c3-420e-ac48-33a3991aba76-config-data") pod "cinder-api-0" (UID: "f8028a79-c5c3-420e-ac48-33a3991aba76") : secret "cinder-config-data" not found Mar 16 16:06:12 crc kubenswrapper[5120]: E0316 16:06:12.022905 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8028a79-c5c3-420e-ac48-33a3991aba76-scripts podName:f8028a79-c5c3-420e-ac48-33a3991aba76 nodeName:}" failed. No retries permitted until 2026-03-16 16:06:28.022848263 +0000 UTC m=+2090.176779960 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "scripts" (UniqueName: "kubernetes.io/secret/f8028a79-c5c3-420e-ac48-33a3991aba76-scripts") pod "cinder-api-0" (UID: "f8028a79-c5c3-420e-ac48-33a3991aba76") : secret "cinder-scripts" not found Mar 16 16:06:12 crc kubenswrapper[5120]: I0316 16:06:12.198488 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/cinder-api-0" podUID="f8028a79-c5c3-420e-ac48-33a3991aba76" containerName="cinder-api" probeResult="failure" output="Get \"https://10.217.1.200:8776/healthcheck\": read tcp 10.217.0.2:43022->10.217.1.200:8776: read: connection reset by peer" Mar 16 16:06:12 crc kubenswrapper[5120]: I0316 16:06:12.212936 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:06:12 crc kubenswrapper[5120]: I0316 16:06:12.212970 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"4e3ac124-ebc3-4631-a7b1-5dc135748d5d","Type":"ContainerDied","Data":"90a2419a9183252c414cde3138c1b54de74254a93def19c96674d07dc4a3df01"} Mar 16 16:06:12 crc kubenswrapper[5120]: I0316 16:06:12.213032 5120 scope.go:117] "RemoveContainer" containerID="340d50169e48c14cb6d4557c098a1c2d295af9830d64eeaf1c4c58f08e737170" Mar 16 16:06:12 crc kubenswrapper[5120]: I0316 16:06:12.350811 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:06:12 crc kubenswrapper[5120]: I0316 16:06:12.357151 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:06:12 crc kubenswrapper[5120]: I0316 16:06:12.477337 5120 scope.go:117] "RemoveContainer" containerID="310b308ba52fcab67cf2c502456c2de0465f9ee7f89783de5324d7ed344a0950" Mar 16 16:06:12 crc kubenswrapper[5120]: I0316 16:06:12.675046 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4e3ac124-ebc3-4631-a7b1-5dc135748d5d" path="/var/lib/kubelet/pods/4e3ac124-ebc3-4631-a7b1-5dc135748d5d/volumes" Mar 16 16:06:12 crc kubenswrapper[5120]: I0316 16:06:12.675899 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="683d3459-b9fc-478c-b74e-c1a09fd45e4d" path="/var/lib/kubelet/pods/683d3459-b9fc-478c-b74e-c1a09fd45e4d/volumes" Mar 16 16:06:12 crc kubenswrapper[5120]: I0316 16:06:12.705942 5120 pod_container_manager_linux.go:217] "Failed to delete cgroup paths" cgroupName=["kubepods","besteffort","pod1772eb98-e47b-45ce-a67e-e50b9e67caf0"] err="unable to destroy cgroup paths for cgroup [kubepods besteffort pod1772eb98-e47b-45ce-a67e-e50b9e67caf0] : Timed out while waiting for systemd to remove kubepods-besteffort-pod1772eb98_e47b_45ce_a67e_e50b9e67caf0.slice" Mar 16 16:06:12 crc kubenswrapper[5120]: I0316 16:06:12.882190 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:06:13 crc kubenswrapper[5120]: I0316 16:06:13.053791 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f8028a79-c5c3-420e-ac48-33a3991aba76-internal-tls-certs\") pod \"f8028a79-c5c3-420e-ac48-33a3991aba76\" (UID: \"f8028a79-c5c3-420e-ac48-33a3991aba76\") " Mar 16 16:06:13 crc kubenswrapper[5120]: I0316 16:06:13.053851 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f8028a79-c5c3-420e-ac48-33a3991aba76-scripts\") pod \"f8028a79-c5c3-420e-ac48-33a3991aba76\" (UID: \"f8028a79-c5c3-420e-ac48-33a3991aba76\") " Mar 16 16:06:13 crc kubenswrapper[5120]: I0316 16:06:13.054196 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/f8028a79-c5c3-420e-ac48-33a3991aba76-config-data-custom\") pod \"f8028a79-c5c3-420e-ac48-33a3991aba76\" (UID: \"f8028a79-c5c3-420e-ac48-33a3991aba76\") " Mar 16 16:06:13 crc kubenswrapper[5120]: I0316 16:06:13.054264 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f8028a79-c5c3-420e-ac48-33a3991aba76-config-data\") pod \"f8028a79-c5c3-420e-ac48-33a3991aba76\" (UID: \"f8028a79-c5c3-420e-ac48-33a3991aba76\") " Mar 16 16:06:13 crc kubenswrapper[5120]: I0316 16:06:13.054341 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-97dxz\" (UniqueName: \"kubernetes.io/projected/f8028a79-c5c3-420e-ac48-33a3991aba76-kube-api-access-97dxz\") pod \"f8028a79-c5c3-420e-ac48-33a3991aba76\" (UID: \"f8028a79-c5c3-420e-ac48-33a3991aba76\") " Mar 16 16:06:13 crc kubenswrapper[5120]: I0316 16:06:13.054422 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f8028a79-c5c3-420e-ac48-33a3991aba76-combined-ca-bundle\") pod \"f8028a79-c5c3-420e-ac48-33a3991aba76\" (UID: \"f8028a79-c5c3-420e-ac48-33a3991aba76\") " Mar 16 16:06:13 crc kubenswrapper[5120]: I0316 16:06:13.054479 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f8028a79-c5c3-420e-ac48-33a3991aba76-logs\") pod \"f8028a79-c5c3-420e-ac48-33a3991aba76\" (UID: \"f8028a79-c5c3-420e-ac48-33a3991aba76\") " Mar 16 16:06:13 crc kubenswrapper[5120]: I0316 16:06:13.054541 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f8028a79-c5c3-420e-ac48-33a3991aba76-public-tls-certs\") pod \"f8028a79-c5c3-420e-ac48-33a3991aba76\" (UID: \"f8028a79-c5c3-420e-ac48-33a3991aba76\") " Mar 16 16:06:13 crc kubenswrapper[5120]: I0316 16:06:13.054585 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/f8028a79-c5c3-420e-ac48-33a3991aba76-etc-machine-id\") pod \"f8028a79-c5c3-420e-ac48-33a3991aba76\" (UID: \"f8028a79-c5c3-420e-ac48-33a3991aba76\") " Mar 16 16:06:13 crc kubenswrapper[5120]: I0316 16:06:13.054977 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/f8028a79-c5c3-420e-ac48-33a3991aba76-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "f8028a79-c5c3-420e-ac48-33a3991aba76" (UID: "f8028a79-c5c3-420e-ac48-33a3991aba76"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 16:06:13 crc kubenswrapper[5120]: I0316 16:06:13.055279 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8028a79-c5c3-420e-ac48-33a3991aba76-logs" (OuterVolumeSpecName: "logs") pod "f8028a79-c5c3-420e-ac48-33a3991aba76" (UID: "f8028a79-c5c3-420e-ac48-33a3991aba76"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:06:13 crc kubenswrapper[5120]: I0316 16:06:13.059824 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8028a79-c5c3-420e-ac48-33a3991aba76-kube-api-access-97dxz" (OuterVolumeSpecName: "kube-api-access-97dxz") pod "f8028a79-c5c3-420e-ac48-33a3991aba76" (UID: "f8028a79-c5c3-420e-ac48-33a3991aba76"). InnerVolumeSpecName "kube-api-access-97dxz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:06:13 crc kubenswrapper[5120]: I0316 16:06:13.061080 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f8028a79-c5c3-420e-ac48-33a3991aba76-scripts" (OuterVolumeSpecName: "scripts") pod "f8028a79-c5c3-420e-ac48-33a3991aba76" (UID: "f8028a79-c5c3-420e-ac48-33a3991aba76"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:06:13 crc kubenswrapper[5120]: I0316 16:06:13.062358 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f8028a79-c5c3-420e-ac48-33a3991aba76-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "f8028a79-c5c3-420e-ac48-33a3991aba76" (UID: "f8028a79-c5c3-420e-ac48-33a3991aba76"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:06:13 crc kubenswrapper[5120]: I0316 16:06:13.096343 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f8028a79-c5c3-420e-ac48-33a3991aba76-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f8028a79-c5c3-420e-ac48-33a3991aba76" (UID: "f8028a79-c5c3-420e-ac48-33a3991aba76"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:06:13 crc kubenswrapper[5120]: I0316 16:06:13.097213 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f8028a79-c5c3-420e-ac48-33a3991aba76-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "f8028a79-c5c3-420e-ac48-33a3991aba76" (UID: "f8028a79-c5c3-420e-ac48-33a3991aba76"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:06:13 crc kubenswrapper[5120]: I0316 16:06:13.102940 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f8028a79-c5c3-420e-ac48-33a3991aba76-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "f8028a79-c5c3-420e-ac48-33a3991aba76" (UID: "f8028a79-c5c3-420e-ac48-33a3991aba76"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:06:13 crc kubenswrapper[5120]: I0316 16:06:13.107575 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f8028a79-c5c3-420e-ac48-33a3991aba76-config-data" (OuterVolumeSpecName: "config-data") pod "f8028a79-c5c3-420e-ac48-33a3991aba76" (UID: "f8028a79-c5c3-420e-ac48-33a3991aba76"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:06:13 crc kubenswrapper[5120]: I0316 16:06:13.157363 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/f8028a79-c5c3-420e-ac48-33a3991aba76-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:13 crc kubenswrapper[5120]: I0316 16:06:13.157422 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f8028a79-c5c3-420e-ac48-33a3991aba76-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:13 crc kubenswrapper[5120]: I0316 16:06:13.157441 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-97dxz\" (UniqueName: \"kubernetes.io/projected/f8028a79-c5c3-420e-ac48-33a3991aba76-kube-api-access-97dxz\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:13 crc kubenswrapper[5120]: I0316 16:06:13.157464 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f8028a79-c5c3-420e-ac48-33a3991aba76-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:13 crc kubenswrapper[5120]: I0316 16:06:13.157481 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f8028a79-c5c3-420e-ac48-33a3991aba76-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:13 crc kubenswrapper[5120]: I0316 16:06:13.157497 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f8028a79-c5c3-420e-ac48-33a3991aba76-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:13 crc kubenswrapper[5120]: I0316 16:06:13.157519 5120 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/f8028a79-c5c3-420e-ac48-33a3991aba76-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:13 crc kubenswrapper[5120]: I0316 16:06:13.157536 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f8028a79-c5c3-420e-ac48-33a3991aba76-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:13 crc kubenswrapper[5120]: I0316 16:06:13.157552 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f8028a79-c5c3-420e-ac48-33a3991aba76-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:13 crc kubenswrapper[5120]: I0316 16:06:13.225174 5120 generic.go:358] "Generic (PLEG): container finished" podID="f8028a79-c5c3-420e-ac48-33a3991aba76" containerID="35ec5a05bbc159911764272ba82d5bc63ef299314eb28a011b42096695ea946d" exitCode=0 Mar 16 16:06:13 crc kubenswrapper[5120]: I0316 16:06:13.225485 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"f8028a79-c5c3-420e-ac48-33a3991aba76","Type":"ContainerDied","Data":"35ec5a05bbc159911764272ba82d5bc63ef299314eb28a011b42096695ea946d"} Mar 16 16:06:13 crc kubenswrapper[5120]: I0316 16:06:13.225540 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"f8028a79-c5c3-420e-ac48-33a3991aba76","Type":"ContainerDied","Data":"a095c7f1f907780f7424cf333177c34a85a7c08d0cd7e3d71396251b5a7d77ef"} Mar 16 16:06:13 crc kubenswrapper[5120]: I0316 16:06:13.225581 5120 scope.go:117] "RemoveContainer" containerID="35ec5a05bbc159911764272ba82d5bc63ef299314eb28a011b42096695ea946d" Mar 16 16:06:13 crc kubenswrapper[5120]: I0316 16:06:13.225816 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:06:13 crc kubenswrapper[5120]: I0316 16:06:13.253328 5120 scope.go:117] "RemoveContainer" containerID="d3ba9fee80a25c94a411c85c3313f845f1922efd50dc1f17b4b3834009a2c44c" Mar 16 16:06:13 crc kubenswrapper[5120]: I0316 16:06:13.280894 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:06:13 crc kubenswrapper[5120]: I0316 16:06:13.284002 5120 scope.go:117] "RemoveContainer" containerID="35ec5a05bbc159911764272ba82d5bc63ef299314eb28a011b42096695ea946d" Mar 16 16:06:13 crc kubenswrapper[5120]: E0316 16:06:13.284463 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"35ec5a05bbc159911764272ba82d5bc63ef299314eb28a011b42096695ea946d\": container with ID starting with 35ec5a05bbc159911764272ba82d5bc63ef299314eb28a011b42096695ea946d not found: ID does not exist" containerID="35ec5a05bbc159911764272ba82d5bc63ef299314eb28a011b42096695ea946d" Mar 16 16:06:13 crc kubenswrapper[5120]: I0316 16:06:13.284523 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35ec5a05bbc159911764272ba82d5bc63ef299314eb28a011b42096695ea946d"} err="failed to get container status \"35ec5a05bbc159911764272ba82d5bc63ef299314eb28a011b42096695ea946d\": rpc error: code = NotFound desc = could not find container \"35ec5a05bbc159911764272ba82d5bc63ef299314eb28a011b42096695ea946d\": container with ID starting with 35ec5a05bbc159911764272ba82d5bc63ef299314eb28a011b42096695ea946d not found: ID does not exist" Mar 16 16:06:13 crc kubenswrapper[5120]: I0316 16:06:13.284557 5120 scope.go:117] "RemoveContainer" containerID="d3ba9fee80a25c94a411c85c3313f845f1922efd50dc1f17b4b3834009a2c44c" Mar 16 16:06:13 crc kubenswrapper[5120]: E0316 16:06:13.284928 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d3ba9fee80a25c94a411c85c3313f845f1922efd50dc1f17b4b3834009a2c44c\": container with ID starting with d3ba9fee80a25c94a411c85c3313f845f1922efd50dc1f17b4b3834009a2c44c not found: ID does not exist" containerID="d3ba9fee80a25c94a411c85c3313f845f1922efd50dc1f17b4b3834009a2c44c" Mar 16 16:06:13 crc kubenswrapper[5120]: I0316 16:06:13.284958 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3ba9fee80a25c94a411c85c3313f845f1922efd50dc1f17b4b3834009a2c44c"} err="failed to get container status \"d3ba9fee80a25c94a411c85c3313f845f1922efd50dc1f17b4b3834009a2c44c\": rpc error: code = NotFound desc = could not find container \"d3ba9fee80a25c94a411c85c3313f845f1922efd50dc1f17b4b3834009a2c44c\": container with ID starting with d3ba9fee80a25c94a411c85c3313f845f1922efd50dc1f17b4b3834009a2c44c not found: ID does not exist" Mar 16 16:06:13 crc kubenswrapper[5120]: I0316 16:06:13.286290 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:06:14 crc kubenswrapper[5120]: I0316 16:06:14.679194 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f8028a79-c5c3-420e-ac48-33a3991aba76" path="/var/lib/kubelet/pods/f8028a79-c5c3-420e-ac48-33a3991aba76/volumes" Mar 16 16:06:15 crc kubenswrapper[5120]: E0316 16:06:15.002128 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="c95e062c78b43ac61bfb1ce3d6158aededf0d14a169d8cab5f5143628863dce1" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:06:15 crc kubenswrapper[5120]: E0316 16:06:15.004427 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="c95e062c78b43ac61bfb1ce3d6158aededf0d14a169d8cab5f5143628863dce1" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:06:15 crc kubenswrapper[5120]: E0316 16:06:15.010278 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="c95e062c78b43ac61bfb1ce3d6158aededf0d14a169d8cab5f5143628863dce1" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:06:15 crc kubenswrapper[5120]: E0316 16:06:15.010346 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="6645a7f0-de34-43c5-9422-1483edda0298" containerName="nova-scheduler-scheduler" probeResult="unknown" Mar 16 16:06:16 crc kubenswrapper[5120]: E0316 16:06:16.659109 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a886de49bae32ee69eeae0c96d915691d3f0168922fae6e6426547d7baf51a40" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:06:16 crc kubenswrapper[5120]: E0316 16:06:16.661683 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a886de49bae32ee69eeae0c96d915691d3f0168922fae6e6426547d7baf51a40" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:06:16 crc kubenswrapper[5120]: E0316 16:06:16.664000 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a886de49bae32ee69eeae0c96d915691d3f0168922fae6e6426547d7baf51a40" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:06:16 crc kubenswrapper[5120]: E0316 16:06:16.664088 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="8f091159-612f-4c40-b215-344c86fe9f65" containerName="nova-cell1-conductor-conductor" probeResult="unknown" Mar 16 16:06:18 crc kubenswrapper[5120]: E0316 16:06:18.262988 5120 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbf01270c_6ae8_4c7f_aee3_42a125c155e4.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddbb06351_e6e7_4a49_a941_33b16fc6206d.slice\": RecentStats: unable to find data in memory cache]" Mar 16 16:06:20 crc kubenswrapper[5120]: E0316 16:06:20.002780 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="c95e062c78b43ac61bfb1ce3d6158aededf0d14a169d8cab5f5143628863dce1" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:06:20 crc kubenswrapper[5120]: E0316 16:06:20.007222 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="c95e062c78b43ac61bfb1ce3d6158aededf0d14a169d8cab5f5143628863dce1" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:06:20 crc kubenswrapper[5120]: E0316 16:06:20.008444 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="c95e062c78b43ac61bfb1ce3d6158aededf0d14a169d8cab5f5143628863dce1" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:06:20 crc kubenswrapper[5120]: E0316 16:06:20.008482 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="6645a7f0-de34-43c5-9422-1483edda0298" containerName="nova-scheduler-scheduler" probeResult="unknown" Mar 16 16:06:21 crc kubenswrapper[5120]: E0316 16:06:21.659403 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a886de49bae32ee69eeae0c96d915691d3f0168922fae6e6426547d7baf51a40" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:06:21 crc kubenswrapper[5120]: E0316 16:06:21.662170 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a886de49bae32ee69eeae0c96d915691d3f0168922fae6e6426547d7baf51a40" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:06:21 crc kubenswrapper[5120]: E0316 16:06:21.664701 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a886de49bae32ee69eeae0c96d915691d3f0168922fae6e6426547d7baf51a40" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:06:21 crc kubenswrapper[5120]: E0316 16:06:21.664911 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="8f091159-612f-4c40-b215-344c86fe9f65" containerName="nova-cell1-conductor-conductor" probeResult="unknown" Mar 16 16:06:25 crc kubenswrapper[5120]: E0316 16:06:25.001454 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="c95e062c78b43ac61bfb1ce3d6158aededf0d14a169d8cab5f5143628863dce1" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:06:25 crc kubenswrapper[5120]: E0316 16:06:25.012408 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="c95e062c78b43ac61bfb1ce3d6158aededf0d14a169d8cab5f5143628863dce1" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:06:25 crc kubenswrapper[5120]: E0316 16:06:25.014812 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="c95e062c78b43ac61bfb1ce3d6158aededf0d14a169d8cab5f5143628863dce1" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:06:25 crc kubenswrapper[5120]: E0316 16:06:25.014890 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="6645a7f0-de34-43c5-9422-1483edda0298" containerName="nova-scheduler-scheduler" probeResult="unknown" Mar 16 16:06:25 crc kubenswrapper[5120]: I0316 16:06:25.476577 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-operators-kflw6"] Mar 16 16:06:25 crc kubenswrapper[5120]: I0316 16:06:25.478533 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9aa09be-c2fd-46ef-b767-521dc67de64b" containerName="init" Mar 16 16:06:25 crc kubenswrapper[5120]: I0316 16:06:25.478574 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9aa09be-c2fd-46ef-b767-521dc67de64b" containerName="init" Mar 16 16:06:25 crc kubenswrapper[5120]: I0316 16:06:25.478596 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="683d3459-b9fc-478c-b74e-c1a09fd45e4d" containerName="nova-cell0-conductor-conductor" Mar 16 16:06:25 crc kubenswrapper[5120]: I0316 16:06:25.478606 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="683d3459-b9fc-478c-b74e-c1a09fd45e4d" containerName="nova-cell0-conductor-conductor" Mar 16 16:06:25 crc kubenswrapper[5120]: I0316 16:06:25.478623 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40" containerName="setup-container" Mar 16 16:06:25 crc kubenswrapper[5120]: I0316 16:06:25.478631 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40" containerName="setup-container" Mar 16 16:06:25 crc kubenswrapper[5120]: I0316 16:06:25.478645 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8e4bade-e33d-4cc6-80ec-5f96e39c8f20" containerName="nova-metadata-log" Mar 16 16:06:25 crc kubenswrapper[5120]: I0316 16:06:25.478654 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8e4bade-e33d-4cc6-80ec-5f96e39c8f20" containerName="nova-metadata-log" Mar 16 16:06:25 crc kubenswrapper[5120]: I0316 16:06:25.478668 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf2c0d02-34db-44f6-b7e5-625a82333785" containerName="ovn-northd" Mar 16 16:06:25 crc kubenswrapper[5120]: I0316 16:06:25.478676 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf2c0d02-34db-44f6-b7e5-625a82333785" containerName="ovn-northd" Mar 16 16:06:25 crc kubenswrapper[5120]: I0316 16:06:25.478694 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4bd1853-26f2-4b40-8a3d-3ae70282ab88" containerName="barbican-api-log" Mar 16 16:06:25 crc kubenswrapper[5120]: I0316 16:06:25.478702 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4bd1853-26f2-4b40-8a3d-3ae70282ab88" containerName="barbican-api-log" Mar 16 16:06:25 crc kubenswrapper[5120]: I0316 16:06:25.478719 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9aa09be-c2fd-46ef-b767-521dc67de64b" containerName="dnsmasq-dns" Mar 16 16:06:25 crc kubenswrapper[5120]: I0316 16:06:25.478726 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9aa09be-c2fd-46ef-b767-521dc67de64b" containerName="dnsmasq-dns" Mar 16 16:06:25 crc kubenswrapper[5120]: I0316 16:06:25.478739 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7fc6bd2b-b3c9-42e9-b7f5-c2aef4997e6c" containerName="barbican-keystone-listener" Mar 16 16:06:25 crc kubenswrapper[5120]: I0316 16:06:25.478747 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7fc6bd2b-b3c9-42e9-b7f5-c2aef4997e6c" containerName="barbican-keystone-listener" Mar 16 16:06:25 crc kubenswrapper[5120]: I0316 16:06:25.478850 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="793f378f-ef31-443c-bb12-6d75a2140296" containerName="placement-api" Mar 16 16:06:25 crc kubenswrapper[5120]: I0316 16:06:25.478861 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="793f378f-ef31-443c-bb12-6d75a2140296" containerName="placement-api" Mar 16 16:06:25 crc kubenswrapper[5120]: I0316 16:06:25.478870 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68f2feef-cf44-429c-a9be-314c030d3321" containerName="galera" Mar 16 16:06:25 crc kubenswrapper[5120]: I0316 16:06:25.478877 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="68f2feef-cf44-429c-a9be-314c030d3321" containerName="galera" Mar 16 16:06:25 crc kubenswrapper[5120]: I0316 16:06:25.478894 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0da01d8-8d71-47f3-9ec8-73dd0aabe316" containerName="barbican-worker-log" Mar 16 16:06:25 crc kubenswrapper[5120]: I0316 16:06:25.478901 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0da01d8-8d71-47f3-9ec8-73dd0aabe316" containerName="barbican-worker-log" Mar 16 16:06:25 crc kubenswrapper[5120]: I0316 16:06:25.478916 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40" containerName="rabbitmq" Mar 16 16:06:25 crc kubenswrapper[5120]: I0316 16:06:25.478923 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40" containerName="rabbitmq" Mar 16 16:06:25 crc kubenswrapper[5120]: I0316 16:06:25.478934 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8028a79-c5c3-420e-ac48-33a3991aba76" containerName="cinder-api" Mar 16 16:06:25 crc kubenswrapper[5120]: I0316 16:06:25.478942 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8028a79-c5c3-420e-ac48-33a3991aba76" containerName="cinder-api" Mar 16 16:06:25 crc kubenswrapper[5120]: I0316 16:06:25.478965 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44247dca-a1cf-42bd-8b32-51322d84cde0" containerName="neutron-httpd" Mar 16 16:06:25 crc kubenswrapper[5120]: I0316 16:06:25.478972 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="44247dca-a1cf-42bd-8b32-51322d84cde0" containerName="neutron-httpd" Mar 16 16:06:25 crc kubenswrapper[5120]: I0316 16:06:25.478992 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68f2feef-cf44-429c-a9be-314c030d3321" containerName="mysql-bootstrap" Mar 16 16:06:25 crc kubenswrapper[5120]: I0316 16:06:25.479000 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="68f2feef-cf44-429c-a9be-314c030d3321" containerName="mysql-bootstrap" Mar 16 16:06:25 crc kubenswrapper[5120]: I0316 16:06:25.479013 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8e4bade-e33d-4cc6-80ec-5f96e39c8f20" containerName="nova-metadata-metadata" Mar 16 16:06:25 crc kubenswrapper[5120]: I0316 16:06:25.479021 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8e4bade-e33d-4cc6-80ec-5f96e39c8f20" containerName="nova-metadata-metadata" Mar 16 16:06:25 crc kubenswrapper[5120]: I0316 16:06:25.479032 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="793f378f-ef31-443c-bb12-6d75a2140296" containerName="placement-log" Mar 16 16:06:25 crc kubenswrapper[5120]: I0316 16:06:25.479039 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="793f378f-ef31-443c-bb12-6d75a2140296" containerName="placement-log" Mar 16 16:06:25 crc kubenswrapper[5120]: I0316 16:06:25.479049 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44247dca-a1cf-42bd-8b32-51322d84cde0" containerName="neutron-api" Mar 16 16:06:25 crc kubenswrapper[5120]: I0316 16:06:25.479057 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="44247dca-a1cf-42bd-8b32-51322d84cde0" containerName="neutron-api" Mar 16 16:06:25 crc kubenswrapper[5120]: I0316 16:06:25.479079 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0da01d8-8d71-47f3-9ec8-73dd0aabe316" containerName="barbican-worker" Mar 16 16:06:25 crc kubenswrapper[5120]: I0316 16:06:25.479089 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0da01d8-8d71-47f3-9ec8-73dd0aabe316" containerName="barbican-worker" Mar 16 16:06:25 crc kubenswrapper[5120]: I0316 16:06:25.479098 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4bd1853-26f2-4b40-8a3d-3ae70282ab88" containerName="barbican-api" Mar 16 16:06:25 crc kubenswrapper[5120]: I0316 16:06:25.479106 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4bd1853-26f2-4b40-8a3d-3ae70282ab88" containerName="barbican-api" Mar 16 16:06:25 crc kubenswrapper[5120]: I0316 16:06:25.479126 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4d9ab9b-4831-4be5-968a-10f3d8f3f654" containerName="memcached" Mar 16 16:06:25 crc kubenswrapper[5120]: I0316 16:06:25.479134 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4d9ab9b-4831-4be5-968a-10f3d8f3f654" containerName="memcached" Mar 16 16:06:25 crc kubenswrapper[5120]: I0316 16:06:25.479148 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0204257-b12d-4e9d-bdfd-e35cfaa598b5" containerName="keystone-api" Mar 16 16:06:25 crc kubenswrapper[5120]: I0316 16:06:25.479156 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0204257-b12d-4e9d-bdfd-e35cfaa598b5" containerName="keystone-api" Mar 16 16:06:25 crc kubenswrapper[5120]: I0316 16:06:25.479197 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="733010bf-0110-4a60-adf6-0f0ee336e96e" containerName="rabbitmq" Mar 16 16:06:25 crc kubenswrapper[5120]: I0316 16:06:25.479206 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="733010bf-0110-4a60-adf6-0f0ee336e96e" containerName="rabbitmq" Mar 16 16:06:25 crc kubenswrapper[5120]: I0316 16:06:25.479221 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8028a79-c5c3-420e-ac48-33a3991aba76" containerName="cinder-api-log" Mar 16 16:06:25 crc kubenswrapper[5120]: I0316 16:06:25.479228 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8028a79-c5c3-420e-ac48-33a3991aba76" containerName="cinder-api-log" Mar 16 16:06:25 crc kubenswrapper[5120]: I0316 16:06:25.479247 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7fc6bd2b-b3c9-42e9-b7f5-c2aef4997e6c" containerName="barbican-keystone-listener-log" Mar 16 16:06:25 crc kubenswrapper[5120]: I0316 16:06:25.479254 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7fc6bd2b-b3c9-42e9-b7f5-c2aef4997e6c" containerName="barbican-keystone-listener-log" Mar 16 16:06:25 crc kubenswrapper[5120]: I0316 16:06:25.479272 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e3ac124-ebc3-4631-a7b1-5dc135748d5d" containerName="nova-api-log" Mar 16 16:06:25 crc kubenswrapper[5120]: I0316 16:06:25.479280 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e3ac124-ebc3-4631-a7b1-5dc135748d5d" containerName="nova-api-log" Mar 16 16:06:25 crc kubenswrapper[5120]: I0316 16:06:25.479293 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="733010bf-0110-4a60-adf6-0f0ee336e96e" containerName="setup-container" Mar 16 16:06:25 crc kubenswrapper[5120]: I0316 16:06:25.479301 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="733010bf-0110-4a60-adf6-0f0ee336e96e" containerName="setup-container" Mar 16 16:06:25 crc kubenswrapper[5120]: I0316 16:06:25.479309 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf2c0d02-34db-44f6-b7e5-625a82333785" containerName="openstack-network-exporter" Mar 16 16:06:25 crc kubenswrapper[5120]: I0316 16:06:25.479317 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf2c0d02-34db-44f6-b7e5-625a82333785" containerName="openstack-network-exporter" Mar 16 16:06:25 crc kubenswrapper[5120]: I0316 16:06:25.479328 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d908918a-f75b-405a-8ba3-5faa341a849a" containerName="oc" Mar 16 16:06:25 crc kubenswrapper[5120]: I0316 16:06:25.479336 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="d908918a-f75b-405a-8ba3-5faa341a849a" containerName="oc" Mar 16 16:06:25 crc kubenswrapper[5120]: I0316 16:06:25.479349 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e3ac124-ebc3-4631-a7b1-5dc135748d5d" containerName="nova-api-api" Mar 16 16:06:25 crc kubenswrapper[5120]: I0316 16:06:25.479357 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e3ac124-ebc3-4631-a7b1-5dc135748d5d" containerName="nova-api-api" Mar 16 16:06:25 crc kubenswrapper[5120]: I0316 16:06:25.479522 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="793f378f-ef31-443c-bb12-6d75a2140296" containerName="placement-log" Mar 16 16:06:25 crc kubenswrapper[5120]: I0316 16:06:25.479543 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="733010bf-0110-4a60-adf6-0f0ee336e96e" containerName="rabbitmq" Mar 16 16:06:25 crc kubenswrapper[5120]: I0316 16:06:25.479555 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="683d3459-b9fc-478c-b74e-c1a09fd45e4d" containerName="nova-cell0-conductor-conductor" Mar 16 16:06:25 crc kubenswrapper[5120]: I0316 16:06:25.479573 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="cf2c0d02-34db-44f6-b7e5-625a82333785" containerName="openstack-network-exporter" Mar 16 16:06:25 crc kubenswrapper[5120]: I0316 16:06:25.479584 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="a4d9ab9b-4831-4be5-968a-10f3d8f3f654" containerName="memcached" Mar 16 16:06:25 crc kubenswrapper[5120]: I0316 16:06:25.479594 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="a4bd1853-26f2-4b40-8a3d-3ae70282ab88" containerName="barbican-api" Mar 16 16:06:25 crc kubenswrapper[5120]: I0316 16:06:25.479610 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="68f2feef-cf44-429c-a9be-314c030d3321" containerName="galera" Mar 16 16:06:25 crc kubenswrapper[5120]: I0316 16:06:25.479621 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="cf2c0d02-34db-44f6-b7e5-625a82333785" containerName="ovn-northd" Mar 16 16:06:25 crc kubenswrapper[5120]: I0316 16:06:25.479636 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="4e3ac124-ebc3-4631-a7b1-5dc135748d5d" containerName="nova-api-log" Mar 16 16:06:25 crc kubenswrapper[5120]: I0316 16:06:25.479647 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f8028a79-c5c3-420e-ac48-33a3991aba76" containerName="cinder-api-log" Mar 16 16:06:25 crc kubenswrapper[5120]: I0316 16:06:25.479657 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="d908918a-f75b-405a-8ba3-5faa341a849a" containerName="oc" Mar 16 16:06:25 crc kubenswrapper[5120]: I0316 16:06:25.479669 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7fc6bd2b-b3c9-42e9-b7f5-c2aef4997e6c" containerName="barbican-keystone-listener" Mar 16 16:06:25 crc kubenswrapper[5120]: I0316 16:06:25.479678 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f8028a79-c5c3-420e-ac48-33a3991aba76" containerName="cinder-api" Mar 16 16:06:25 crc kubenswrapper[5120]: I0316 16:06:25.479688 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e8e4bade-e33d-4cc6-80ec-5f96e39c8f20" containerName="nova-metadata-log" Mar 16 16:06:25 crc kubenswrapper[5120]: I0316 16:06:25.479701 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f0da01d8-8d71-47f3-9ec8-73dd0aabe316" containerName="barbican-worker" Mar 16 16:06:25 crc kubenswrapper[5120]: I0316 16:06:25.479714 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e8e4bade-e33d-4cc6-80ec-5f96e39c8f20" containerName="nova-metadata-metadata" Mar 16 16:06:25 crc kubenswrapper[5120]: I0316 16:06:25.479726 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="a4bd1853-26f2-4b40-8a3d-3ae70282ab88" containerName="barbican-api-log" Mar 16 16:06:25 crc kubenswrapper[5120]: I0316 16:06:25.479735 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7fc6bd2b-b3c9-42e9-b7f5-c2aef4997e6c" containerName="barbican-keystone-listener-log" Mar 16 16:06:25 crc kubenswrapper[5120]: I0316 16:06:25.479746 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f0da01d8-8d71-47f3-9ec8-73dd0aabe316" containerName="barbican-worker-log" Mar 16 16:06:25 crc kubenswrapper[5120]: I0316 16:06:25.479776 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="a9aa09be-c2fd-46ef-b767-521dc67de64b" containerName="dnsmasq-dns" Mar 16 16:06:25 crc kubenswrapper[5120]: I0316 16:06:25.479793 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="44247dca-a1cf-42bd-8b32-51322d84cde0" containerName="neutron-httpd" Mar 16 16:06:25 crc kubenswrapper[5120]: I0316 16:06:25.479804 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="793f378f-ef31-443c-bb12-6d75a2140296" containerName="placement-api" Mar 16 16:06:25 crc kubenswrapper[5120]: I0316 16:06:25.479814 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f0204257-b12d-4e9d-bdfd-e35cfaa598b5" containerName="keystone-api" Mar 16 16:06:25 crc kubenswrapper[5120]: I0316 16:06:25.479824 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="4e3ac124-ebc3-4631-a7b1-5dc135748d5d" containerName="nova-api-api" Mar 16 16:06:25 crc kubenswrapper[5120]: I0316 16:06:25.479836 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="44247dca-a1cf-42bd-8b32-51322d84cde0" containerName="neutron-api" Mar 16 16:06:25 crc kubenswrapper[5120]: I0316 16:06:25.479848 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="5ea0edb2-ea1d-4fd6-8c8b-4fcb4a6d7b40" containerName="rabbitmq" Mar 16 16:06:25 crc kubenswrapper[5120]: I0316 16:06:25.535891 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-kflw6"] Mar 16 16:06:25 crc kubenswrapper[5120]: I0316 16:06:25.536094 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-kflw6" Mar 16 16:06:25 crc kubenswrapper[5120]: I0316 16:06:25.626617 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/e80e8df3-88ad-4789-89af-38d912522931-utilities\") pod \"redhat-operators-kflw6\" (UID: \"e80e8df3-88ad-4789-89af-38d912522931\") " pod="openshift-marketplace/redhat-operators-kflw6" Mar 16 16:06:25 crc kubenswrapper[5120]: I0316 16:06:25.627022 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/e80e8df3-88ad-4789-89af-38d912522931-catalog-content\") pod \"redhat-operators-kflw6\" (UID: \"e80e8df3-88ad-4789-89af-38d912522931\") " pod="openshift-marketplace/redhat-operators-kflw6" Mar 16 16:06:25 crc kubenswrapper[5120]: I0316 16:06:25.627269 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stk4c\" (UniqueName: \"kubernetes.io/projected/e80e8df3-88ad-4789-89af-38d912522931-kube-api-access-stk4c\") pod \"redhat-operators-kflw6\" (UID: \"e80e8df3-88ad-4789-89af-38d912522931\") " pod="openshift-marketplace/redhat-operators-kflw6" Mar 16 16:06:25 crc kubenswrapper[5120]: I0316 16:06:25.728888 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/e80e8df3-88ad-4789-89af-38d912522931-catalog-content\") pod \"redhat-operators-kflw6\" (UID: \"e80e8df3-88ad-4789-89af-38d912522931\") " pod="openshift-marketplace/redhat-operators-kflw6" Mar 16 16:06:25 crc kubenswrapper[5120]: I0316 16:06:25.729416 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/e80e8df3-88ad-4789-89af-38d912522931-catalog-content\") pod \"redhat-operators-kflw6\" (UID: \"e80e8df3-88ad-4789-89af-38d912522931\") " pod="openshift-marketplace/redhat-operators-kflw6" Mar 16 16:06:25 crc kubenswrapper[5120]: I0316 16:06:25.729529 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-stk4c\" (UniqueName: \"kubernetes.io/projected/e80e8df3-88ad-4789-89af-38d912522931-kube-api-access-stk4c\") pod \"redhat-operators-kflw6\" (UID: \"e80e8df3-88ad-4789-89af-38d912522931\") " pod="openshift-marketplace/redhat-operators-kflw6" Mar 16 16:06:25 crc kubenswrapper[5120]: I0316 16:06:25.729710 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/e80e8df3-88ad-4789-89af-38d912522931-utilities\") pod \"redhat-operators-kflw6\" (UID: \"e80e8df3-88ad-4789-89af-38d912522931\") " pod="openshift-marketplace/redhat-operators-kflw6" Mar 16 16:06:25 crc kubenswrapper[5120]: I0316 16:06:25.730734 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/e80e8df3-88ad-4789-89af-38d912522931-utilities\") pod \"redhat-operators-kflw6\" (UID: \"e80e8df3-88ad-4789-89af-38d912522931\") " pod="openshift-marketplace/redhat-operators-kflw6" Mar 16 16:06:25 crc kubenswrapper[5120]: I0316 16:06:25.753787 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-stk4c\" (UniqueName: \"kubernetes.io/projected/e80e8df3-88ad-4789-89af-38d912522931-kube-api-access-stk4c\") pod \"redhat-operators-kflw6\" (UID: \"e80e8df3-88ad-4789-89af-38d912522931\") " pod="openshift-marketplace/redhat-operators-kflw6" Mar 16 16:06:25 crc kubenswrapper[5120]: I0316 16:06:25.859582 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-kflw6" Mar 16 16:06:26 crc kubenswrapper[5120]: I0316 16:06:26.353711 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-kflw6"] Mar 16 16:06:26 crc kubenswrapper[5120]: I0316 16:06:26.379227 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-kflw6" event={"ID":"e80e8df3-88ad-4789-89af-38d912522931","Type":"ContainerStarted","Data":"678f7955b360f9d3afc95f1181f86dc058f263b7d95de36a893bfe884181dd3d"} Mar 16 16:06:26 crc kubenswrapper[5120]: E0316 16:06:26.658955 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a886de49bae32ee69eeae0c96d915691d3f0168922fae6e6426547d7baf51a40" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:06:26 crc kubenswrapper[5120]: E0316 16:06:26.661062 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a886de49bae32ee69eeae0c96d915691d3f0168922fae6e6426547d7baf51a40" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:06:26 crc kubenswrapper[5120]: E0316 16:06:26.662503 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a886de49bae32ee69eeae0c96d915691d3f0168922fae6e6426547d7baf51a40" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:06:26 crc kubenswrapper[5120]: E0316 16:06:26.662541 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="8f091159-612f-4c40-b215-344c86fe9f65" containerName="nova-cell1-conductor-conductor" probeResult="unknown" Mar 16 16:06:27 crc kubenswrapper[5120]: I0316 16:06:27.281917 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:06:27 crc kubenswrapper[5120]: I0316 16:06:27.361606 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/7e01ce77-a7e7-4f90-880f-fb2aa9b506a0-cache\") pod \"7e01ce77-a7e7-4f90-880f-fb2aa9b506a0\" (UID: \"7e01ce77-a7e7-4f90-880f-fb2aa9b506a0\") " Mar 16 16:06:27 crc kubenswrapper[5120]: I0316 16:06:27.361692 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"swift\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") pod \"7e01ce77-a7e7-4f90-880f-fb2aa9b506a0\" (UID: \"7e01ce77-a7e7-4f90-880f-fb2aa9b506a0\") " Mar 16 16:06:27 crc kubenswrapper[5120]: I0316 16:06:27.361819 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/7e01ce77-a7e7-4f90-880f-fb2aa9b506a0-etc-swift\") pod \"7e01ce77-a7e7-4f90-880f-fb2aa9b506a0\" (UID: \"7e01ce77-a7e7-4f90-880f-fb2aa9b506a0\") " Mar 16 16:06:27 crc kubenswrapper[5120]: I0316 16:06:27.361859 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/7e01ce77-a7e7-4f90-880f-fb2aa9b506a0-lock\") pod \"7e01ce77-a7e7-4f90-880f-fb2aa9b506a0\" (UID: \"7e01ce77-a7e7-4f90-880f-fb2aa9b506a0\") " Mar 16 16:06:27 crc kubenswrapper[5120]: I0316 16:06:27.361929 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7e01ce77-a7e7-4f90-880f-fb2aa9b506a0-combined-ca-bundle\") pod \"7e01ce77-a7e7-4f90-880f-fb2aa9b506a0\" (UID: \"7e01ce77-a7e7-4f90-880f-fb2aa9b506a0\") " Mar 16 16:06:27 crc kubenswrapper[5120]: I0316 16:06:27.361976 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pbw4z\" (UniqueName: \"kubernetes.io/projected/7e01ce77-a7e7-4f90-880f-fb2aa9b506a0-kube-api-access-pbw4z\") pod \"7e01ce77-a7e7-4f90-880f-fb2aa9b506a0\" (UID: \"7e01ce77-a7e7-4f90-880f-fb2aa9b506a0\") " Mar 16 16:06:27 crc kubenswrapper[5120]: I0316 16:06:27.362253 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e01ce77-a7e7-4f90-880f-fb2aa9b506a0-cache" (OuterVolumeSpecName: "cache") pod "7e01ce77-a7e7-4f90-880f-fb2aa9b506a0" (UID: "7e01ce77-a7e7-4f90-880f-fb2aa9b506a0"). InnerVolumeSpecName "cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:06:27 crc kubenswrapper[5120]: I0316 16:06:27.362360 5120 reconciler_common.go:299] "Volume detached for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/7e01ce77-a7e7-4f90-880f-fb2aa9b506a0-cache\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:27 crc kubenswrapper[5120]: I0316 16:06:27.362739 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e01ce77-a7e7-4f90-880f-fb2aa9b506a0-lock" (OuterVolumeSpecName: "lock") pod "7e01ce77-a7e7-4f90-880f-fb2aa9b506a0" (UID: "7e01ce77-a7e7-4f90-880f-fb2aa9b506a0"). InnerVolumeSpecName "lock". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:06:27 crc kubenswrapper[5120]: I0316 16:06:27.367748 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage07-crc" (OuterVolumeSpecName: "swift") pod "7e01ce77-a7e7-4f90-880f-fb2aa9b506a0" (UID: "7e01ce77-a7e7-4f90-880f-fb2aa9b506a0"). InnerVolumeSpecName "local-storage07-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:06:27 crc kubenswrapper[5120]: I0316 16:06:27.368430 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e01ce77-a7e7-4f90-880f-fb2aa9b506a0-kube-api-access-pbw4z" (OuterVolumeSpecName: "kube-api-access-pbw4z") pod "7e01ce77-a7e7-4f90-880f-fb2aa9b506a0" (UID: "7e01ce77-a7e7-4f90-880f-fb2aa9b506a0"). InnerVolumeSpecName "kube-api-access-pbw4z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:06:27 crc kubenswrapper[5120]: I0316 16:06:27.376648 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e01ce77-a7e7-4f90-880f-fb2aa9b506a0-etc-swift" (OuterVolumeSpecName: "etc-swift") pod "7e01ce77-a7e7-4f90-880f-fb2aa9b506a0" (UID: "7e01ce77-a7e7-4f90-880f-fb2aa9b506a0"). InnerVolumeSpecName "etc-swift". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:06:27 crc kubenswrapper[5120]: I0316 16:06:27.403577 5120 generic.go:358] "Generic (PLEG): container finished" podID="7e01ce77-a7e7-4f90-880f-fb2aa9b506a0" containerID="de9532efdc63b1e3b8ca32f670ae9e1deb9f362ce371660def5737aa8339a1dd" exitCode=137 Mar 16 16:06:27 crc kubenswrapper[5120]: I0316 16:06:27.403747 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7e01ce77-a7e7-4f90-880f-fb2aa9b506a0","Type":"ContainerDied","Data":"de9532efdc63b1e3b8ca32f670ae9e1deb9f362ce371660def5737aa8339a1dd"} Mar 16 16:06:27 crc kubenswrapper[5120]: I0316 16:06:27.403833 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7e01ce77-a7e7-4f90-880f-fb2aa9b506a0","Type":"ContainerDied","Data":"ecf1f490646bf1e488ea895d7c712c8f3f0826e9f51436d404d69f39d55c35c9"} Mar 16 16:06:27 crc kubenswrapper[5120]: I0316 16:06:27.403889 5120 scope.go:117] "RemoveContainer" containerID="de9532efdc63b1e3b8ca32f670ae9e1deb9f362ce371660def5737aa8339a1dd" Mar 16 16:06:27 crc kubenswrapper[5120]: I0316 16:06:27.404267 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:06:27 crc kubenswrapper[5120]: I0316 16:06:27.409154 5120 generic.go:358] "Generic (PLEG): container finished" podID="e80e8df3-88ad-4789-89af-38d912522931" containerID="0a652576966bf4c64e78e5abffddbc53e1b8f8d1fb69d6f0d090f90959af6b68" exitCode=0 Mar 16 16:06:27 crc kubenswrapper[5120]: I0316 16:06:27.409356 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-kflw6" event={"ID":"e80e8df3-88ad-4789-89af-38d912522931","Type":"ContainerDied","Data":"0a652576966bf4c64e78e5abffddbc53e1b8f8d1fb69d6f0d090f90959af6b68"} Mar 16 16:06:27 crc kubenswrapper[5120]: I0316 16:06:27.458039 5120 scope.go:117] "RemoveContainer" containerID="07d1780c3ac674887e98e6e457d571c406a7ee983f0a91f7bfd134c125da3d03" Mar 16 16:06:27 crc kubenswrapper[5120]: I0316 16:06:27.464360 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage07-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") on node \"crc\" " Mar 16 16:06:27 crc kubenswrapper[5120]: I0316 16:06:27.464392 5120 reconciler_common.go:299] "Volume detached for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/7e01ce77-a7e7-4f90-880f-fb2aa9b506a0-etc-swift\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:27 crc kubenswrapper[5120]: I0316 16:06:27.464403 5120 reconciler_common.go:299] "Volume detached for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/7e01ce77-a7e7-4f90-880f-fb2aa9b506a0-lock\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:27 crc kubenswrapper[5120]: I0316 16:06:27.464412 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pbw4z\" (UniqueName: \"kubernetes.io/projected/7e01ce77-a7e7-4f90-880f-fb2aa9b506a0-kube-api-access-pbw4z\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:27 crc kubenswrapper[5120]: I0316 16:06:27.482777 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage07-crc" (UniqueName: "kubernetes.io/local-volume/local-storage07-crc") on node "crc" Mar 16 16:06:27 crc kubenswrapper[5120]: I0316 16:06:27.565988 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage07-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:27 crc kubenswrapper[5120]: I0316 16:06:27.579579 5120 scope.go:117] "RemoveContainer" containerID="6819b2fc19957c0cc9ecf211d06ee6cd10c1ec89e57fa8e1c6f8f34a4272144a" Mar 16 16:06:27 crc kubenswrapper[5120]: I0316 16:06:27.597857 5120 scope.go:117] "RemoveContainer" containerID="176e1b8679f186bfa7c613dd56d177361af47feab586da3825ca07c140f9e8aa" Mar 16 16:06:27 crc kubenswrapper[5120]: I0316 16:06:27.619844 5120 scope.go:117] "RemoveContainer" containerID="10fa8c7b4b871978347408abb409b476cfd8fd7a2f441f3a90024ad00442c1b6" Mar 16 16:06:27 crc kubenswrapper[5120]: I0316 16:06:27.652777 5120 scope.go:117] "RemoveContainer" containerID="9dacb1521b7a04a287e3368f3170f4c5d5387fe4efa3027e858a14615bc08d5b" Mar 16 16:06:27 crc kubenswrapper[5120]: I0316 16:06:27.675384 5120 scope.go:117] "RemoveContainer" containerID="79550cc49372bb24203f30a90ef9bfd6d2ee84c2fa9667ae735271bfa17f0ede" Mar 16 16:06:27 crc kubenswrapper[5120]: I0316 16:06:27.696233 5120 scope.go:117] "RemoveContainer" containerID="2e380b12d073a5002c1e5dd47b9250956676752c0348be88c5d0494c0816ca54" Mar 16 16:06:27 crc kubenswrapper[5120]: I0316 16:06:27.720562 5120 scope.go:117] "RemoveContainer" containerID="a4e710398cfe29215c86b86e007c51ed81b67c778fe43c2b13c2cda4950ccf05" Mar 16 16:06:27 crc kubenswrapper[5120]: I0316 16:06:27.732481 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e01ce77-a7e7-4f90-880f-fb2aa9b506a0-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "7e01ce77-a7e7-4f90-880f-fb2aa9b506a0" (UID: "7e01ce77-a7e7-4f90-880f-fb2aa9b506a0"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:06:27 crc kubenswrapper[5120]: I0316 16:06:27.757625 5120 scope.go:117] "RemoveContainer" containerID="336f3db32f57852f76e9f4875a9e9c43786cc5813a47664b60949887a3812b50" Mar 16 16:06:27 crc kubenswrapper[5120]: I0316 16:06:27.778083 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7e01ce77-a7e7-4f90-880f-fb2aa9b506a0-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:27 crc kubenswrapper[5120]: I0316 16:06:27.830937 5120 scope.go:117] "RemoveContainer" containerID="aa74658997f4ba65955badab309e4d15c34829a78f5c27ce74c840cd5aab7dc5" Mar 16 16:06:27 crc kubenswrapper[5120]: I0316 16:06:27.903282 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-6b8df9c88d-rbjrz_9d8004a6-f52b-420c-9f64-141dae970d7e/neutron-api/0.log" Mar 16 16:06:27 crc kubenswrapper[5120]: I0316 16:06:27.903549 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-6b8df9c88d-rbjrz" Mar 16 16:06:27 crc kubenswrapper[5120]: I0316 16:06:27.908498 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:06:27 crc kubenswrapper[5120]: I0316 16:06:27.910041 5120 scope.go:117] "RemoveContainer" containerID="e4e13714df25c26e40c47bd0a068052ffb840c737d71ada600d65029e264bda3" Mar 16 16:06:27 crc kubenswrapper[5120]: I0316 16:06:27.936535 5120 scope.go:117] "RemoveContainer" containerID="1624b7e64adc42a87208b2c700ca76213393c6c3c5d8baa5d38a875f647eae87" Mar 16 16:06:27 crc kubenswrapper[5120]: I0316 16:06:27.961659 5120 scope.go:117] "RemoveContainer" containerID="24b51644c8c35d60eb1d19875575dbadbac7c2899aad1712fe22e9e2cc1c8a0d" Mar 16 16:06:27 crc kubenswrapper[5120]: I0316 16:06:27.979656 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/9d8004a6-f52b-420c-9f64-141dae970d7e-ovndb-tls-certs\") pod \"9d8004a6-f52b-420c-9f64-141dae970d7e\" (UID: \"9d8004a6-f52b-420c-9f64-141dae970d7e\") " Mar 16 16:06:27 crc kubenswrapper[5120]: I0316 16:06:27.979693 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8f091159-612f-4c40-b215-344c86fe9f65-combined-ca-bundle\") pod \"8f091159-612f-4c40-b215-344c86fe9f65\" (UID: \"8f091159-612f-4c40-b215-344c86fe9f65\") " Mar 16 16:06:27 crc kubenswrapper[5120]: I0316 16:06:27.979775 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9d8004a6-f52b-420c-9f64-141dae970d7e-combined-ca-bundle\") pod \"9d8004a6-f52b-420c-9f64-141dae970d7e\" (UID: \"9d8004a6-f52b-420c-9f64-141dae970d7e\") " Mar 16 16:06:27 crc kubenswrapper[5120]: I0316 16:06:27.979795 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/9d8004a6-f52b-420c-9f64-141dae970d7e-internal-tls-certs\") pod \"9d8004a6-f52b-420c-9f64-141dae970d7e\" (UID: \"9d8004a6-f52b-420c-9f64-141dae970d7e\") " Mar 16 16:06:27 crc kubenswrapper[5120]: I0316 16:06:27.979816 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lh7jv\" (UniqueName: \"kubernetes.io/projected/9d8004a6-f52b-420c-9f64-141dae970d7e-kube-api-access-lh7jv\") pod \"9d8004a6-f52b-420c-9f64-141dae970d7e\" (UID: \"9d8004a6-f52b-420c-9f64-141dae970d7e\") " Mar 16 16:06:27 crc kubenswrapper[5120]: I0316 16:06:27.979858 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/9d8004a6-f52b-420c-9f64-141dae970d7e-public-tls-certs\") pod \"9d8004a6-f52b-420c-9f64-141dae970d7e\" (UID: \"9d8004a6-f52b-420c-9f64-141dae970d7e\") " Mar 16 16:06:27 crc kubenswrapper[5120]: I0316 16:06:27.979889 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/9d8004a6-f52b-420c-9f64-141dae970d7e-config\") pod \"9d8004a6-f52b-420c-9f64-141dae970d7e\" (UID: \"9d8004a6-f52b-420c-9f64-141dae970d7e\") " Mar 16 16:06:27 crc kubenswrapper[5120]: I0316 16:06:27.979973 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/9d8004a6-f52b-420c-9f64-141dae970d7e-httpd-config\") pod \"9d8004a6-f52b-420c-9f64-141dae970d7e\" (UID: \"9d8004a6-f52b-420c-9f64-141dae970d7e\") " Mar 16 16:06:27 crc kubenswrapper[5120]: I0316 16:06:27.980470 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bvq9p\" (UniqueName: \"kubernetes.io/projected/8f091159-612f-4c40-b215-344c86fe9f65-kube-api-access-bvq9p\") pod \"8f091159-612f-4c40-b215-344c86fe9f65\" (UID: \"8f091159-612f-4c40-b215-344c86fe9f65\") " Mar 16 16:06:27 crc kubenswrapper[5120]: I0316 16:06:27.980555 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8f091159-612f-4c40-b215-344c86fe9f65-config-data\") pod \"8f091159-612f-4c40-b215-344c86fe9f65\" (UID: \"8f091159-612f-4c40-b215-344c86fe9f65\") " Mar 16 16:06:27 crc kubenswrapper[5120]: I0316 16:06:27.984032 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d8004a6-f52b-420c-9f64-141dae970d7e-kube-api-access-lh7jv" (OuterVolumeSpecName: "kube-api-access-lh7jv") pod "9d8004a6-f52b-420c-9f64-141dae970d7e" (UID: "9d8004a6-f52b-420c-9f64-141dae970d7e"). InnerVolumeSpecName "kube-api-access-lh7jv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:06:27 crc kubenswrapper[5120]: I0316 16:06:27.984072 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f091159-612f-4c40-b215-344c86fe9f65-kube-api-access-bvq9p" (OuterVolumeSpecName: "kube-api-access-bvq9p") pod "8f091159-612f-4c40-b215-344c86fe9f65" (UID: "8f091159-612f-4c40-b215-344c86fe9f65"). InnerVolumeSpecName "kube-api-access-bvq9p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:06:27 crc kubenswrapper[5120]: I0316 16:06:27.985523 5120 scope.go:117] "RemoveContainer" containerID="9e8ac2d972fd2f48d81b09afc5e8f49bb8db2874d893c57e7a8c058fd36b3ead" Mar 16 16:06:27 crc kubenswrapper[5120]: I0316 16:06:27.986822 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9d8004a6-f52b-420c-9f64-141dae970d7e-httpd-config" (OuterVolumeSpecName: "httpd-config") pod "9d8004a6-f52b-420c-9f64-141dae970d7e" (UID: "9d8004a6-f52b-420c-9f64-141dae970d7e"). InnerVolumeSpecName "httpd-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:06:27 crc kubenswrapper[5120]: I0316 16:06:27.999311 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f091159-612f-4c40-b215-344c86fe9f65-config-data" (OuterVolumeSpecName: "config-data") pod "8f091159-612f-4c40-b215-344c86fe9f65" (UID: "8f091159-612f-4c40-b215-344c86fe9f65"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:06:28 crc kubenswrapper[5120]: I0316 16:06:28.001489 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f091159-612f-4c40-b215-344c86fe9f65-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "8f091159-612f-4c40-b215-344c86fe9f65" (UID: "8f091159-612f-4c40-b215-344c86fe9f65"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:06:28 crc kubenswrapper[5120]: I0316 16:06:28.020485 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9d8004a6-f52b-420c-9f64-141dae970d7e-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "9d8004a6-f52b-420c-9f64-141dae970d7e" (UID: "9d8004a6-f52b-420c-9f64-141dae970d7e"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:06:28 crc kubenswrapper[5120]: I0316 16:06:28.027214 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9d8004a6-f52b-420c-9f64-141dae970d7e-config" (OuterVolumeSpecName: "config") pod "9d8004a6-f52b-420c-9f64-141dae970d7e" (UID: "9d8004a6-f52b-420c-9f64-141dae970d7e"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:06:28 crc kubenswrapper[5120]: I0316 16:06:28.027946 5120 scope.go:117] "RemoveContainer" containerID="de9532efdc63b1e3b8ca32f670ae9e1deb9f362ce371660def5737aa8339a1dd" Mar 16 16:06:28 crc kubenswrapper[5120]: E0316 16:06:28.029156 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de9532efdc63b1e3b8ca32f670ae9e1deb9f362ce371660def5737aa8339a1dd\": container with ID starting with de9532efdc63b1e3b8ca32f670ae9e1deb9f362ce371660def5737aa8339a1dd not found: ID does not exist" containerID="de9532efdc63b1e3b8ca32f670ae9e1deb9f362ce371660def5737aa8339a1dd" Mar 16 16:06:28 crc kubenswrapper[5120]: I0316 16:06:28.029238 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de9532efdc63b1e3b8ca32f670ae9e1deb9f362ce371660def5737aa8339a1dd"} err="failed to get container status \"de9532efdc63b1e3b8ca32f670ae9e1deb9f362ce371660def5737aa8339a1dd\": rpc error: code = NotFound desc = could not find container \"de9532efdc63b1e3b8ca32f670ae9e1deb9f362ce371660def5737aa8339a1dd\": container with ID starting with de9532efdc63b1e3b8ca32f670ae9e1deb9f362ce371660def5737aa8339a1dd not found: ID does not exist" Mar 16 16:06:28 crc kubenswrapper[5120]: I0316 16:06:28.029264 5120 scope.go:117] "RemoveContainer" containerID="07d1780c3ac674887e98e6e457d571c406a7ee983f0a91f7bfd134c125da3d03" Mar 16 16:06:28 crc kubenswrapper[5120]: E0316 16:06:28.030724 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"07d1780c3ac674887e98e6e457d571c406a7ee983f0a91f7bfd134c125da3d03\": container with ID starting with 07d1780c3ac674887e98e6e457d571c406a7ee983f0a91f7bfd134c125da3d03 not found: ID does not exist" containerID="07d1780c3ac674887e98e6e457d571c406a7ee983f0a91f7bfd134c125da3d03" Mar 16 16:06:28 crc kubenswrapper[5120]: I0316 16:06:28.030773 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07d1780c3ac674887e98e6e457d571c406a7ee983f0a91f7bfd134c125da3d03"} err="failed to get container status \"07d1780c3ac674887e98e6e457d571c406a7ee983f0a91f7bfd134c125da3d03\": rpc error: code = NotFound desc = could not find container \"07d1780c3ac674887e98e6e457d571c406a7ee983f0a91f7bfd134c125da3d03\": container with ID starting with 07d1780c3ac674887e98e6e457d571c406a7ee983f0a91f7bfd134c125da3d03 not found: ID does not exist" Mar 16 16:06:28 crc kubenswrapper[5120]: I0316 16:06:28.030796 5120 scope.go:117] "RemoveContainer" containerID="6819b2fc19957c0cc9ecf211d06ee6cd10c1ec89e57fa8e1c6f8f34a4272144a" Mar 16 16:06:28 crc kubenswrapper[5120]: E0316 16:06:28.031187 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6819b2fc19957c0cc9ecf211d06ee6cd10c1ec89e57fa8e1c6f8f34a4272144a\": container with ID starting with 6819b2fc19957c0cc9ecf211d06ee6cd10c1ec89e57fa8e1c6f8f34a4272144a not found: ID does not exist" containerID="6819b2fc19957c0cc9ecf211d06ee6cd10c1ec89e57fa8e1c6f8f34a4272144a" Mar 16 16:06:28 crc kubenswrapper[5120]: I0316 16:06:28.031208 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6819b2fc19957c0cc9ecf211d06ee6cd10c1ec89e57fa8e1c6f8f34a4272144a"} err="failed to get container status \"6819b2fc19957c0cc9ecf211d06ee6cd10c1ec89e57fa8e1c6f8f34a4272144a\": rpc error: code = NotFound desc = could not find container \"6819b2fc19957c0cc9ecf211d06ee6cd10c1ec89e57fa8e1c6f8f34a4272144a\": container with ID starting with 6819b2fc19957c0cc9ecf211d06ee6cd10c1ec89e57fa8e1c6f8f34a4272144a not found: ID does not exist" Mar 16 16:06:28 crc kubenswrapper[5120]: I0316 16:06:28.031223 5120 scope.go:117] "RemoveContainer" containerID="176e1b8679f186bfa7c613dd56d177361af47feab586da3825ca07c140f9e8aa" Mar 16 16:06:28 crc kubenswrapper[5120]: E0316 16:06:28.031602 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"176e1b8679f186bfa7c613dd56d177361af47feab586da3825ca07c140f9e8aa\": container with ID starting with 176e1b8679f186bfa7c613dd56d177361af47feab586da3825ca07c140f9e8aa not found: ID does not exist" containerID="176e1b8679f186bfa7c613dd56d177361af47feab586da3825ca07c140f9e8aa" Mar 16 16:06:28 crc kubenswrapper[5120]: I0316 16:06:28.031628 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"176e1b8679f186bfa7c613dd56d177361af47feab586da3825ca07c140f9e8aa"} err="failed to get container status \"176e1b8679f186bfa7c613dd56d177361af47feab586da3825ca07c140f9e8aa\": rpc error: code = NotFound desc = could not find container \"176e1b8679f186bfa7c613dd56d177361af47feab586da3825ca07c140f9e8aa\": container with ID starting with 176e1b8679f186bfa7c613dd56d177361af47feab586da3825ca07c140f9e8aa not found: ID does not exist" Mar 16 16:06:28 crc kubenswrapper[5120]: I0316 16:06:28.031641 5120 scope.go:117] "RemoveContainer" containerID="10fa8c7b4b871978347408abb409b476cfd8fd7a2f441f3a90024ad00442c1b6" Mar 16 16:06:28 crc kubenswrapper[5120]: E0316 16:06:28.032074 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"10fa8c7b4b871978347408abb409b476cfd8fd7a2f441f3a90024ad00442c1b6\": container with ID starting with 10fa8c7b4b871978347408abb409b476cfd8fd7a2f441f3a90024ad00442c1b6 not found: ID does not exist" containerID="10fa8c7b4b871978347408abb409b476cfd8fd7a2f441f3a90024ad00442c1b6" Mar 16 16:06:28 crc kubenswrapper[5120]: I0316 16:06:28.032099 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10fa8c7b4b871978347408abb409b476cfd8fd7a2f441f3a90024ad00442c1b6"} err="failed to get container status \"10fa8c7b4b871978347408abb409b476cfd8fd7a2f441f3a90024ad00442c1b6\": rpc error: code = NotFound desc = could not find container \"10fa8c7b4b871978347408abb409b476cfd8fd7a2f441f3a90024ad00442c1b6\": container with ID starting with 10fa8c7b4b871978347408abb409b476cfd8fd7a2f441f3a90024ad00442c1b6 not found: ID does not exist" Mar 16 16:06:28 crc kubenswrapper[5120]: I0316 16:06:28.032113 5120 scope.go:117] "RemoveContainer" containerID="9dacb1521b7a04a287e3368f3170f4c5d5387fe4efa3027e858a14615bc08d5b" Mar 16 16:06:28 crc kubenswrapper[5120]: E0316 16:06:28.033992 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9dacb1521b7a04a287e3368f3170f4c5d5387fe4efa3027e858a14615bc08d5b\": container with ID starting with 9dacb1521b7a04a287e3368f3170f4c5d5387fe4efa3027e858a14615bc08d5b not found: ID does not exist" containerID="9dacb1521b7a04a287e3368f3170f4c5d5387fe4efa3027e858a14615bc08d5b" Mar 16 16:06:28 crc kubenswrapper[5120]: I0316 16:06:28.034018 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9dacb1521b7a04a287e3368f3170f4c5d5387fe4efa3027e858a14615bc08d5b"} err="failed to get container status \"9dacb1521b7a04a287e3368f3170f4c5d5387fe4efa3027e858a14615bc08d5b\": rpc error: code = NotFound desc = could not find container \"9dacb1521b7a04a287e3368f3170f4c5d5387fe4efa3027e858a14615bc08d5b\": container with ID starting with 9dacb1521b7a04a287e3368f3170f4c5d5387fe4efa3027e858a14615bc08d5b not found: ID does not exist" Mar 16 16:06:28 crc kubenswrapper[5120]: I0316 16:06:28.034033 5120 scope.go:117] "RemoveContainer" containerID="79550cc49372bb24203f30a90ef9bfd6d2ee84c2fa9667ae735271bfa17f0ede" Mar 16 16:06:28 crc kubenswrapper[5120]: E0316 16:06:28.038251 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"79550cc49372bb24203f30a90ef9bfd6d2ee84c2fa9667ae735271bfa17f0ede\": container with ID starting with 79550cc49372bb24203f30a90ef9bfd6d2ee84c2fa9667ae735271bfa17f0ede not found: ID does not exist" containerID="79550cc49372bb24203f30a90ef9bfd6d2ee84c2fa9667ae735271bfa17f0ede" Mar 16 16:06:28 crc kubenswrapper[5120]: I0316 16:06:28.038300 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79550cc49372bb24203f30a90ef9bfd6d2ee84c2fa9667ae735271bfa17f0ede"} err="failed to get container status \"79550cc49372bb24203f30a90ef9bfd6d2ee84c2fa9667ae735271bfa17f0ede\": rpc error: code = NotFound desc = could not find container \"79550cc49372bb24203f30a90ef9bfd6d2ee84c2fa9667ae735271bfa17f0ede\": container with ID starting with 79550cc49372bb24203f30a90ef9bfd6d2ee84c2fa9667ae735271bfa17f0ede not found: ID does not exist" Mar 16 16:06:28 crc kubenswrapper[5120]: I0316 16:06:28.038356 5120 scope.go:117] "RemoveContainer" containerID="2e380b12d073a5002c1e5dd47b9250956676752c0348be88c5d0494c0816ca54" Mar 16 16:06:28 crc kubenswrapper[5120]: I0316 16:06:28.042540 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9d8004a6-f52b-420c-9f64-141dae970d7e-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "9d8004a6-f52b-420c-9f64-141dae970d7e" (UID: "9d8004a6-f52b-420c-9f64-141dae970d7e"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:06:28 crc kubenswrapper[5120]: I0316 16:06:28.045287 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9d8004a6-f52b-420c-9f64-141dae970d7e-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "9d8004a6-f52b-420c-9f64-141dae970d7e" (UID: "9d8004a6-f52b-420c-9f64-141dae970d7e"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:06:28 crc kubenswrapper[5120]: I0316 16:06:28.048671 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 16:06:28 crc kubenswrapper[5120]: E0316 16:06:28.049526 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2e380b12d073a5002c1e5dd47b9250956676752c0348be88c5d0494c0816ca54\": container with ID starting with 2e380b12d073a5002c1e5dd47b9250956676752c0348be88c5d0494c0816ca54 not found: ID does not exist" containerID="2e380b12d073a5002c1e5dd47b9250956676752c0348be88c5d0494c0816ca54" Mar 16 16:06:28 crc kubenswrapper[5120]: I0316 16:06:28.049564 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e380b12d073a5002c1e5dd47b9250956676752c0348be88c5d0494c0816ca54"} err="failed to get container status \"2e380b12d073a5002c1e5dd47b9250956676752c0348be88c5d0494c0816ca54\": rpc error: code = NotFound desc = could not find container \"2e380b12d073a5002c1e5dd47b9250956676752c0348be88c5d0494c0816ca54\": container with ID starting with 2e380b12d073a5002c1e5dd47b9250956676752c0348be88c5d0494c0816ca54 not found: ID does not exist" Mar 16 16:06:28 crc kubenswrapper[5120]: I0316 16:06:28.049589 5120 scope.go:117] "RemoveContainer" containerID="a4e710398cfe29215c86b86e007c51ed81b67c778fe43c2b13c2cda4950ccf05" Mar 16 16:06:28 crc kubenswrapper[5120]: E0316 16:06:28.049969 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a4e710398cfe29215c86b86e007c51ed81b67c778fe43c2b13c2cda4950ccf05\": container with ID starting with a4e710398cfe29215c86b86e007c51ed81b67c778fe43c2b13c2cda4950ccf05 not found: ID does not exist" containerID="a4e710398cfe29215c86b86e007c51ed81b67c778fe43c2b13c2cda4950ccf05" Mar 16 16:06:28 crc kubenswrapper[5120]: I0316 16:06:28.050004 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4e710398cfe29215c86b86e007c51ed81b67c778fe43c2b13c2cda4950ccf05"} err="failed to get container status \"a4e710398cfe29215c86b86e007c51ed81b67c778fe43c2b13c2cda4950ccf05\": rpc error: code = NotFound desc = could not find container \"a4e710398cfe29215c86b86e007c51ed81b67c778fe43c2b13c2cda4950ccf05\": container with ID starting with a4e710398cfe29215c86b86e007c51ed81b67c778fe43c2b13c2cda4950ccf05 not found: ID does not exist" Mar 16 16:06:28 crc kubenswrapper[5120]: I0316 16:06:28.050029 5120 scope.go:117] "RemoveContainer" containerID="336f3db32f57852f76e9f4875a9e9c43786cc5813a47664b60949887a3812b50" Mar 16 16:06:28 crc kubenswrapper[5120]: E0316 16:06:28.050783 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"336f3db32f57852f76e9f4875a9e9c43786cc5813a47664b60949887a3812b50\": container with ID starting with 336f3db32f57852f76e9f4875a9e9c43786cc5813a47664b60949887a3812b50 not found: ID does not exist" containerID="336f3db32f57852f76e9f4875a9e9c43786cc5813a47664b60949887a3812b50" Mar 16 16:06:28 crc kubenswrapper[5120]: I0316 16:06:28.050808 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"336f3db32f57852f76e9f4875a9e9c43786cc5813a47664b60949887a3812b50"} err="failed to get container status \"336f3db32f57852f76e9f4875a9e9c43786cc5813a47664b60949887a3812b50\": rpc error: code = NotFound desc = could not find container \"336f3db32f57852f76e9f4875a9e9c43786cc5813a47664b60949887a3812b50\": container with ID starting with 336f3db32f57852f76e9f4875a9e9c43786cc5813a47664b60949887a3812b50 not found: ID does not exist" Mar 16 16:06:28 crc kubenswrapper[5120]: I0316 16:06:28.050820 5120 scope.go:117] "RemoveContainer" containerID="aa74658997f4ba65955badab309e4d15c34829a78f5c27ce74c840cd5aab7dc5" Mar 16 16:06:28 crc kubenswrapper[5120]: E0316 16:06:28.051687 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa74658997f4ba65955badab309e4d15c34829a78f5c27ce74c840cd5aab7dc5\": container with ID starting with aa74658997f4ba65955badab309e4d15c34829a78f5c27ce74c840cd5aab7dc5 not found: ID does not exist" containerID="aa74658997f4ba65955badab309e4d15c34829a78f5c27ce74c840cd5aab7dc5" Mar 16 16:06:28 crc kubenswrapper[5120]: I0316 16:06:28.051709 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa74658997f4ba65955badab309e4d15c34829a78f5c27ce74c840cd5aab7dc5"} err="failed to get container status \"aa74658997f4ba65955badab309e4d15c34829a78f5c27ce74c840cd5aab7dc5\": rpc error: code = NotFound desc = could not find container \"aa74658997f4ba65955badab309e4d15c34829a78f5c27ce74c840cd5aab7dc5\": container with ID starting with aa74658997f4ba65955badab309e4d15c34829a78f5c27ce74c840cd5aab7dc5 not found: ID does not exist" Mar 16 16:06:28 crc kubenswrapper[5120]: I0316 16:06:28.051721 5120 scope.go:117] "RemoveContainer" containerID="e4e13714df25c26e40c47bd0a068052ffb840c737d71ada600d65029e264bda3" Mar 16 16:06:28 crc kubenswrapper[5120]: E0316 16:06:28.052257 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e4e13714df25c26e40c47bd0a068052ffb840c737d71ada600d65029e264bda3\": container with ID starting with e4e13714df25c26e40c47bd0a068052ffb840c737d71ada600d65029e264bda3 not found: ID does not exist" containerID="e4e13714df25c26e40c47bd0a068052ffb840c737d71ada600d65029e264bda3" Mar 16 16:06:28 crc kubenswrapper[5120]: I0316 16:06:28.052282 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4e13714df25c26e40c47bd0a068052ffb840c737d71ada600d65029e264bda3"} err="failed to get container status \"e4e13714df25c26e40c47bd0a068052ffb840c737d71ada600d65029e264bda3\": rpc error: code = NotFound desc = could not find container \"e4e13714df25c26e40c47bd0a068052ffb840c737d71ada600d65029e264bda3\": container with ID starting with e4e13714df25c26e40c47bd0a068052ffb840c737d71ada600d65029e264bda3 not found: ID does not exist" Mar 16 16:06:28 crc kubenswrapper[5120]: I0316 16:06:28.052298 5120 scope.go:117] "RemoveContainer" containerID="1624b7e64adc42a87208b2c700ca76213393c6c3c5d8baa5d38a875f647eae87" Mar 16 16:06:28 crc kubenswrapper[5120]: E0316 16:06:28.052607 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1624b7e64adc42a87208b2c700ca76213393c6c3c5d8baa5d38a875f647eae87\": container with ID starting with 1624b7e64adc42a87208b2c700ca76213393c6c3c5d8baa5d38a875f647eae87 not found: ID does not exist" containerID="1624b7e64adc42a87208b2c700ca76213393c6c3c5d8baa5d38a875f647eae87" Mar 16 16:06:28 crc kubenswrapper[5120]: I0316 16:06:28.052626 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1624b7e64adc42a87208b2c700ca76213393c6c3c5d8baa5d38a875f647eae87"} err="failed to get container status \"1624b7e64adc42a87208b2c700ca76213393c6c3c5d8baa5d38a875f647eae87\": rpc error: code = NotFound desc = could not find container \"1624b7e64adc42a87208b2c700ca76213393c6c3c5d8baa5d38a875f647eae87\": container with ID starting with 1624b7e64adc42a87208b2c700ca76213393c6c3c5d8baa5d38a875f647eae87 not found: ID does not exist" Mar 16 16:06:28 crc kubenswrapper[5120]: I0316 16:06:28.052640 5120 scope.go:117] "RemoveContainer" containerID="24b51644c8c35d60eb1d19875575dbadbac7c2899aad1712fe22e9e2cc1c8a0d" Mar 16 16:06:28 crc kubenswrapper[5120]: E0316 16:06:28.053036 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"24b51644c8c35d60eb1d19875575dbadbac7c2899aad1712fe22e9e2cc1c8a0d\": container with ID starting with 24b51644c8c35d60eb1d19875575dbadbac7c2899aad1712fe22e9e2cc1c8a0d not found: ID does not exist" containerID="24b51644c8c35d60eb1d19875575dbadbac7c2899aad1712fe22e9e2cc1c8a0d" Mar 16 16:06:28 crc kubenswrapper[5120]: I0316 16:06:28.053055 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24b51644c8c35d60eb1d19875575dbadbac7c2899aad1712fe22e9e2cc1c8a0d"} err="failed to get container status \"24b51644c8c35d60eb1d19875575dbadbac7c2899aad1712fe22e9e2cc1c8a0d\": rpc error: code = NotFound desc = could not find container \"24b51644c8c35d60eb1d19875575dbadbac7c2899aad1712fe22e9e2cc1c8a0d\": container with ID starting with 24b51644c8c35d60eb1d19875575dbadbac7c2899aad1712fe22e9e2cc1c8a0d not found: ID does not exist" Mar 16 16:06:28 crc kubenswrapper[5120]: I0316 16:06:28.053066 5120 scope.go:117] "RemoveContainer" containerID="9e8ac2d972fd2f48d81b09afc5e8f49bb8db2874d893c57e7a8c058fd36b3ead" Mar 16 16:06:28 crc kubenswrapper[5120]: E0316 16:06:28.053379 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9e8ac2d972fd2f48d81b09afc5e8f49bb8db2874d893c57e7a8c058fd36b3ead\": container with ID starting with 9e8ac2d972fd2f48d81b09afc5e8f49bb8db2874d893c57e7a8c058fd36b3ead not found: ID does not exist" containerID="9e8ac2d972fd2f48d81b09afc5e8f49bb8db2874d893c57e7a8c058fd36b3ead" Mar 16 16:06:28 crc kubenswrapper[5120]: I0316 16:06:28.053411 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e8ac2d972fd2f48d81b09afc5e8f49bb8db2874d893c57e7a8c058fd36b3ead"} err="failed to get container status \"9e8ac2d972fd2f48d81b09afc5e8f49bb8db2874d893c57e7a8c058fd36b3ead\": rpc error: code = NotFound desc = could not find container \"9e8ac2d972fd2f48d81b09afc5e8f49bb8db2874d893c57e7a8c058fd36b3ead\": container with ID starting with 9e8ac2d972fd2f48d81b09afc5e8f49bb8db2874d893c57e7a8c058fd36b3ead not found: ID does not exist" Mar 16 16:06:28 crc kubenswrapper[5120]: I0316 16:06:28.053778 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9d8004a6-f52b-420c-9f64-141dae970d7e-ovndb-tls-certs" (OuterVolumeSpecName: "ovndb-tls-certs") pod "9d8004a6-f52b-420c-9f64-141dae970d7e" (UID: "9d8004a6-f52b-420c-9f64-141dae970d7e"). InnerVolumeSpecName "ovndb-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:06:28 crc kubenswrapper[5120]: I0316 16:06:28.054608 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 16:06:28 crc kubenswrapper[5120]: I0316 16:06:28.082304 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/9d8004a6-f52b-420c-9f64-141dae970d7e-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:28 crc kubenswrapper[5120]: I0316 16:06:28.082329 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/9d8004a6-f52b-420c-9f64-141dae970d7e-httpd-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:28 crc kubenswrapper[5120]: I0316 16:06:28.082339 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bvq9p\" (UniqueName: \"kubernetes.io/projected/8f091159-612f-4c40-b215-344c86fe9f65-kube-api-access-bvq9p\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:28 crc kubenswrapper[5120]: I0316 16:06:28.082348 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8f091159-612f-4c40-b215-344c86fe9f65-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:28 crc kubenswrapper[5120]: I0316 16:06:28.082356 5120 reconciler_common.go:299] "Volume detached for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/9d8004a6-f52b-420c-9f64-141dae970d7e-ovndb-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:28 crc kubenswrapper[5120]: I0316 16:06:28.082367 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8f091159-612f-4c40-b215-344c86fe9f65-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:28 crc kubenswrapper[5120]: I0316 16:06:28.082378 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9d8004a6-f52b-420c-9f64-141dae970d7e-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:28 crc kubenswrapper[5120]: I0316 16:06:28.082388 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/9d8004a6-f52b-420c-9f64-141dae970d7e-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:28 crc kubenswrapper[5120]: I0316 16:06:28.082396 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lh7jv\" (UniqueName: \"kubernetes.io/projected/9d8004a6-f52b-420c-9f64-141dae970d7e-kube-api-access-lh7jv\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:28 crc kubenswrapper[5120]: I0316 16:06:28.082404 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/9d8004a6-f52b-420c-9f64-141dae970d7e-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:28 crc kubenswrapper[5120]: I0316 16:06:28.426872 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-6b8df9c88d-rbjrz_9d8004a6-f52b-420c-9f64-141dae970d7e/neutron-api/0.log" Mar 16 16:06:28 crc kubenswrapper[5120]: I0316 16:06:28.426930 5120 generic.go:358] "Generic (PLEG): container finished" podID="9d8004a6-f52b-420c-9f64-141dae970d7e" containerID="325c126814bbf2c5054010df97276a8fad76a8cd2e925d8b46965c687053ba96" exitCode=137 Mar 16 16:06:28 crc kubenswrapper[5120]: I0316 16:06:28.427091 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-6b8df9c88d-rbjrz" Mar 16 16:06:28 crc kubenswrapper[5120]: I0316 16:06:28.427174 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-6b8df9c88d-rbjrz" event={"ID":"9d8004a6-f52b-420c-9f64-141dae970d7e","Type":"ContainerDied","Data":"325c126814bbf2c5054010df97276a8fad76a8cd2e925d8b46965c687053ba96"} Mar 16 16:06:28 crc kubenswrapper[5120]: I0316 16:06:28.427285 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-6b8df9c88d-rbjrz" event={"ID":"9d8004a6-f52b-420c-9f64-141dae970d7e","Type":"ContainerDied","Data":"7122001a70084eb2717f73dd53d107675a17552698fa32c81d455bdf2c07cad5"} Mar 16 16:06:28 crc kubenswrapper[5120]: I0316 16:06:28.427307 5120 scope.go:117] "RemoveContainer" containerID="24a0dfb437371b7a9e2fbca989f638c6bbaab73772e7b7c295009200a6496677" Mar 16 16:06:28 crc kubenswrapper[5120]: I0316 16:06:28.432860 5120 generic.go:358] "Generic (PLEG): container finished" podID="8f091159-612f-4c40-b215-344c86fe9f65" containerID="a886de49bae32ee69eeae0c96d915691d3f0168922fae6e6426547d7baf51a40" exitCode=137 Mar 16 16:06:28 crc kubenswrapper[5120]: I0316 16:06:28.432956 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:06:28 crc kubenswrapper[5120]: I0316 16:06:28.433011 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"8f091159-612f-4c40-b215-344c86fe9f65","Type":"ContainerDied","Data":"a886de49bae32ee69eeae0c96d915691d3f0168922fae6e6426547d7baf51a40"} Mar 16 16:06:28 crc kubenswrapper[5120]: I0316 16:06:28.433037 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"8f091159-612f-4c40-b215-344c86fe9f65","Type":"ContainerDied","Data":"a6b5fdb7523dae1d2b764d0ff7ec6a2d2afdc48e8805b990590273036075533c"} Mar 16 16:06:28 crc kubenswrapper[5120]: I0316 16:06:28.453366 5120 scope.go:117] "RemoveContainer" containerID="325c126814bbf2c5054010df97276a8fad76a8cd2e925d8b46965c687053ba96" Mar 16 16:06:28 crc kubenswrapper[5120]: I0316 16:06:28.477305 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-6b8df9c88d-rbjrz"] Mar 16 16:06:28 crc kubenswrapper[5120]: I0316 16:06:28.483657 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-6b8df9c88d-rbjrz"] Mar 16 16:06:28 crc kubenswrapper[5120]: I0316 16:06:28.489745 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 16:06:28 crc kubenswrapper[5120]: I0316 16:06:28.494020 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 16:06:28 crc kubenswrapper[5120]: I0316 16:06:28.497987 5120 scope.go:117] "RemoveContainer" containerID="24a0dfb437371b7a9e2fbca989f638c6bbaab73772e7b7c295009200a6496677" Mar 16 16:06:28 crc kubenswrapper[5120]: E0316 16:06:28.498672 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"24a0dfb437371b7a9e2fbca989f638c6bbaab73772e7b7c295009200a6496677\": container with ID starting with 24a0dfb437371b7a9e2fbca989f638c6bbaab73772e7b7c295009200a6496677 not found: ID does not exist" containerID="24a0dfb437371b7a9e2fbca989f638c6bbaab73772e7b7c295009200a6496677" Mar 16 16:06:28 crc kubenswrapper[5120]: I0316 16:06:28.498704 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24a0dfb437371b7a9e2fbca989f638c6bbaab73772e7b7c295009200a6496677"} err="failed to get container status \"24a0dfb437371b7a9e2fbca989f638c6bbaab73772e7b7c295009200a6496677\": rpc error: code = NotFound desc = could not find container \"24a0dfb437371b7a9e2fbca989f638c6bbaab73772e7b7c295009200a6496677\": container with ID starting with 24a0dfb437371b7a9e2fbca989f638c6bbaab73772e7b7c295009200a6496677 not found: ID does not exist" Mar 16 16:06:28 crc kubenswrapper[5120]: I0316 16:06:28.498729 5120 scope.go:117] "RemoveContainer" containerID="325c126814bbf2c5054010df97276a8fad76a8cd2e925d8b46965c687053ba96" Mar 16 16:06:28 crc kubenswrapper[5120]: E0316 16:06:28.499184 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"325c126814bbf2c5054010df97276a8fad76a8cd2e925d8b46965c687053ba96\": container with ID starting with 325c126814bbf2c5054010df97276a8fad76a8cd2e925d8b46965c687053ba96 not found: ID does not exist" containerID="325c126814bbf2c5054010df97276a8fad76a8cd2e925d8b46965c687053ba96" Mar 16 16:06:28 crc kubenswrapper[5120]: I0316 16:06:28.499205 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"325c126814bbf2c5054010df97276a8fad76a8cd2e925d8b46965c687053ba96"} err="failed to get container status \"325c126814bbf2c5054010df97276a8fad76a8cd2e925d8b46965c687053ba96\": rpc error: code = NotFound desc = could not find container \"325c126814bbf2c5054010df97276a8fad76a8cd2e925d8b46965c687053ba96\": container with ID starting with 325c126814bbf2c5054010df97276a8fad76a8cd2e925d8b46965c687053ba96 not found: ID does not exist" Mar 16 16:06:28 crc kubenswrapper[5120]: I0316 16:06:28.499219 5120 scope.go:117] "RemoveContainer" containerID="a886de49bae32ee69eeae0c96d915691d3f0168922fae6e6426547d7baf51a40" Mar 16 16:06:28 crc kubenswrapper[5120]: E0316 16:06:28.517840 5120 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbf01270c_6ae8_4c7f_aee3_42a125c155e4.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddbb06351_e6e7_4a49_a941_33b16fc6206d.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9d8004a6_f52b_420c_9f64_141dae970d7e.slice/crio-7122001a70084eb2717f73dd53d107675a17552698fa32c81d455bdf2c07cad5\": RecentStats: unable to find data in memory cache]" Mar 16 16:06:28 crc kubenswrapper[5120]: I0316 16:06:28.526669 5120 scope.go:117] "RemoveContainer" containerID="a886de49bae32ee69eeae0c96d915691d3f0168922fae6e6426547d7baf51a40" Mar 16 16:06:28 crc kubenswrapper[5120]: E0316 16:06:28.527329 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a886de49bae32ee69eeae0c96d915691d3f0168922fae6e6426547d7baf51a40\": container with ID starting with a886de49bae32ee69eeae0c96d915691d3f0168922fae6e6426547d7baf51a40 not found: ID does not exist" containerID="a886de49bae32ee69eeae0c96d915691d3f0168922fae6e6426547d7baf51a40" Mar 16 16:06:28 crc kubenswrapper[5120]: I0316 16:06:28.527449 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a886de49bae32ee69eeae0c96d915691d3f0168922fae6e6426547d7baf51a40"} err="failed to get container status \"a886de49bae32ee69eeae0c96d915691d3f0168922fae6e6426547d7baf51a40\": rpc error: code = NotFound desc = could not find container \"a886de49bae32ee69eeae0c96d915691d3f0168922fae6e6426547d7baf51a40\": container with ID starting with a886de49bae32ee69eeae0c96d915691d3f0168922fae6e6426547d7baf51a40 not found: ID does not exist" Mar 16 16:06:28 crc kubenswrapper[5120]: I0316 16:06:28.678058 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7e01ce77-a7e7-4f90-880f-fb2aa9b506a0" path="/var/lib/kubelet/pods/7e01ce77-a7e7-4f90-880f-fb2aa9b506a0/volumes" Mar 16 16:06:28 crc kubenswrapper[5120]: I0316 16:06:28.682495 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8f091159-612f-4c40-b215-344c86fe9f65" path="/var/lib/kubelet/pods/8f091159-612f-4c40-b215-344c86fe9f65/volumes" Mar 16 16:06:28 crc kubenswrapper[5120]: I0316 16:06:28.684106 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9d8004a6-f52b-420c-9f64-141dae970d7e" path="/var/lib/kubelet/pods/9d8004a6-f52b-420c-9f64-141dae970d7e/volumes" Mar 16 16:06:29 crc kubenswrapper[5120]: I0316 16:06:29.446499 5120 generic.go:358] "Generic (PLEG): container finished" podID="e80e8df3-88ad-4789-89af-38d912522931" containerID="70177dc034340cfc9e490776cd973709a45d4a1d70cd99415531e8f497a42ac3" exitCode=0 Mar 16 16:06:29 crc kubenswrapper[5120]: I0316 16:06:29.446546 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-kflw6" event={"ID":"e80e8df3-88ad-4789-89af-38d912522931","Type":"ContainerDied","Data":"70177dc034340cfc9e490776cd973709a45d4a1d70cd99415531e8f497a42ac3"} Mar 16 16:06:30 crc kubenswrapper[5120]: E0316 16:06:30.002019 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="c95e062c78b43ac61bfb1ce3d6158aededf0d14a169d8cab5f5143628863dce1" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:06:30 crc kubenswrapper[5120]: E0316 16:06:30.003601 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="c95e062c78b43ac61bfb1ce3d6158aededf0d14a169d8cab5f5143628863dce1" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:06:30 crc kubenswrapper[5120]: E0316 16:06:30.004908 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="c95e062c78b43ac61bfb1ce3d6158aededf0d14a169d8cab5f5143628863dce1" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:06:30 crc kubenswrapper[5120]: E0316 16:06:30.004940 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="6645a7f0-de34-43c5-9422-1483edda0298" containerName="nova-scheduler-scheduler" probeResult="unknown" Mar 16 16:06:30 crc kubenswrapper[5120]: I0316 16:06:30.463586 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-kflw6" event={"ID":"e80e8df3-88ad-4789-89af-38d912522931","Type":"ContainerStarted","Data":"9bf3f97931100e269d327e9b2cfe87e5cc13a2b816e049ab5a84601c77d01cbe"} Mar 16 16:06:30 crc kubenswrapper[5120]: I0316 16:06:30.484667 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/redhat-operators-kflw6" podStartSLOduration=4.642402961 podStartE2EDuration="5.484652282s" podCreationTimestamp="2026-03-16 16:06:25 +0000 UTC" firstStartedPulling="2026-03-16 16:06:27.410461361 +0000 UTC m=+2089.564393018" lastFinishedPulling="2026-03-16 16:06:28.252710682 +0000 UTC m=+2090.406642339" observedRunningTime="2026-03-16 16:06:30.479652685 +0000 UTC m=+2092.633584332" watchObservedRunningTime="2026-03-16 16:06:30.484652282 +0000 UTC m=+2092.638583939" Mar 16 16:06:35 crc kubenswrapper[5120]: E0316 16:06:35.001347 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="c95e062c78b43ac61bfb1ce3d6158aededf0d14a169d8cab5f5143628863dce1" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:06:35 crc kubenswrapper[5120]: E0316 16:06:35.003342 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="c95e062c78b43ac61bfb1ce3d6158aededf0d14a169d8cab5f5143628863dce1" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:06:35 crc kubenswrapper[5120]: E0316 16:06:35.005296 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="c95e062c78b43ac61bfb1ce3d6158aededf0d14a169d8cab5f5143628863dce1" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:06:35 crc kubenswrapper[5120]: E0316 16:06:35.005333 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="6645a7f0-de34-43c5-9422-1483edda0298" containerName="nova-scheduler-scheduler" probeResult="unknown" Mar 16 16:06:35 crc kubenswrapper[5120]: I0316 16:06:35.860028 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-marketplace/redhat-operators-kflw6" Mar 16 16:06:35 crc kubenswrapper[5120]: I0316 16:06:35.860125 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-operators-kflw6" Mar 16 16:06:36 crc kubenswrapper[5120]: I0316 16:06:36.908517 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-marketplace/redhat-operators-kflw6" podUID="e80e8df3-88ad-4789-89af-38d912522931" containerName="registry-server" probeResult="failure" output=< Mar 16 16:06:36 crc kubenswrapper[5120]: timeout: failed to connect service ":50051" within 1s Mar 16 16:06:36 crc kubenswrapper[5120]: > Mar 16 16:06:37 crc kubenswrapper[5120]: I0316 16:06:37.532333 5120 generic.go:358] "Generic (PLEG): container finished" podID="6645a7f0-de34-43c5-9422-1483edda0298" containerID="c95e062c78b43ac61bfb1ce3d6158aededf0d14a169d8cab5f5143628863dce1" exitCode=137 Mar 16 16:06:37 crc kubenswrapper[5120]: I0316 16:06:37.532380 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"6645a7f0-de34-43c5-9422-1483edda0298","Type":"ContainerDied","Data":"c95e062c78b43ac61bfb1ce3d6158aededf0d14a169d8cab5f5143628863dce1"} Mar 16 16:06:37 crc kubenswrapper[5120]: I0316 16:06:37.532873 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"6645a7f0-de34-43c5-9422-1483edda0298","Type":"ContainerDied","Data":"4fa027892a69ee2d8daff9aa94346dd72f383a9a833d39b76f0c7cb70ae6c4f7"} Mar 16 16:06:37 crc kubenswrapper[5120]: I0316 16:06:37.532919 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4fa027892a69ee2d8daff9aa94346dd72f383a9a833d39b76f0c7cb70ae6c4f7" Mar 16 16:06:37 crc kubenswrapper[5120]: I0316 16:06:37.553435 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:06:37 crc kubenswrapper[5120]: I0316 16:06:37.649103 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6645a7f0-de34-43c5-9422-1483edda0298-config-data\") pod \"6645a7f0-de34-43c5-9422-1483edda0298\" (UID: \"6645a7f0-de34-43c5-9422-1483edda0298\") " Mar 16 16:06:37 crc kubenswrapper[5120]: I0316 16:06:37.649146 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6645a7f0-de34-43c5-9422-1483edda0298-combined-ca-bundle\") pod \"6645a7f0-de34-43c5-9422-1483edda0298\" (UID: \"6645a7f0-de34-43c5-9422-1483edda0298\") " Mar 16 16:06:37 crc kubenswrapper[5120]: I0316 16:06:37.649173 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nl4tt\" (UniqueName: \"kubernetes.io/projected/6645a7f0-de34-43c5-9422-1483edda0298-kube-api-access-nl4tt\") pod \"6645a7f0-de34-43c5-9422-1483edda0298\" (UID: \"6645a7f0-de34-43c5-9422-1483edda0298\") " Mar 16 16:06:37 crc kubenswrapper[5120]: I0316 16:06:37.654504 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6645a7f0-de34-43c5-9422-1483edda0298-kube-api-access-nl4tt" (OuterVolumeSpecName: "kube-api-access-nl4tt") pod "6645a7f0-de34-43c5-9422-1483edda0298" (UID: "6645a7f0-de34-43c5-9422-1483edda0298"). InnerVolumeSpecName "kube-api-access-nl4tt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:06:37 crc kubenswrapper[5120]: I0316 16:06:37.668345 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6645a7f0-de34-43c5-9422-1483edda0298-config-data" (OuterVolumeSpecName: "config-data") pod "6645a7f0-de34-43c5-9422-1483edda0298" (UID: "6645a7f0-de34-43c5-9422-1483edda0298"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:06:37 crc kubenswrapper[5120]: I0316 16:06:37.685123 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6645a7f0-de34-43c5-9422-1483edda0298-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "6645a7f0-de34-43c5-9422-1483edda0298" (UID: "6645a7f0-de34-43c5-9422-1483edda0298"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:06:37 crc kubenswrapper[5120]: I0316 16:06:37.726517 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["crc-storage/crc-storage-crc-gwzcf"] Mar 16 16:06:37 crc kubenswrapper[5120]: I0316 16:06:37.727212 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["crc-storage/crc-storage-crc-gwzcf"] Mar 16 16:06:37 crc kubenswrapper[5120]: I0316 16:06:37.751143 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6645a7f0-de34-43c5-9422-1483edda0298-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:37 crc kubenswrapper[5120]: I0316 16:06:37.751352 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6645a7f0-de34-43c5-9422-1483edda0298-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:37 crc kubenswrapper[5120]: I0316 16:06:37.751363 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nl4tt\" (UniqueName: \"kubernetes.io/projected/6645a7f0-de34-43c5-9422-1483edda0298-kube-api-access-nl4tt\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:37 crc kubenswrapper[5120]: I0316 16:06:37.829653 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["crc-storage/crc-storage-crc-mz4dk"] Mar 16 16:06:37 crc kubenswrapper[5120]: I0316 16:06:37.831917 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e01ce77-a7e7-4f90-880f-fb2aa9b506a0" containerName="object-replicator" Mar 16 16:06:37 crc kubenswrapper[5120]: I0316 16:06:37.832098 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e01ce77-a7e7-4f90-880f-fb2aa9b506a0" containerName="object-replicator" Mar 16 16:06:37 crc kubenswrapper[5120]: I0316 16:06:37.832182 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e01ce77-a7e7-4f90-880f-fb2aa9b506a0" containerName="container-server" Mar 16 16:06:37 crc kubenswrapper[5120]: I0316 16:06:37.832263 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e01ce77-a7e7-4f90-880f-fb2aa9b506a0" containerName="container-server" Mar 16 16:06:37 crc kubenswrapper[5120]: I0316 16:06:37.832360 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e01ce77-a7e7-4f90-880f-fb2aa9b506a0" containerName="container-replicator" Mar 16 16:06:37 crc kubenswrapper[5120]: I0316 16:06:37.832443 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e01ce77-a7e7-4f90-880f-fb2aa9b506a0" containerName="container-replicator" Mar 16 16:06:37 crc kubenswrapper[5120]: I0316 16:06:37.832533 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e01ce77-a7e7-4f90-880f-fb2aa9b506a0" containerName="rsync" Mar 16 16:06:37 crc kubenswrapper[5120]: I0316 16:06:37.832610 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e01ce77-a7e7-4f90-880f-fb2aa9b506a0" containerName="rsync" Mar 16 16:06:37 crc kubenswrapper[5120]: I0316 16:06:37.832695 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e01ce77-a7e7-4f90-880f-fb2aa9b506a0" containerName="account-replicator" Mar 16 16:06:37 crc kubenswrapper[5120]: I0316 16:06:37.832793 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e01ce77-a7e7-4f90-880f-fb2aa9b506a0" containerName="account-replicator" Mar 16 16:06:37 crc kubenswrapper[5120]: I0316 16:06:37.833282 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e01ce77-a7e7-4f90-880f-fb2aa9b506a0" containerName="object-updater" Mar 16 16:06:37 crc kubenswrapper[5120]: I0316 16:06:37.833369 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e01ce77-a7e7-4f90-880f-fb2aa9b506a0" containerName="object-updater" Mar 16 16:06:37 crc kubenswrapper[5120]: I0316 16:06:37.833430 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e01ce77-a7e7-4f90-880f-fb2aa9b506a0" containerName="account-server" Mar 16 16:06:37 crc kubenswrapper[5120]: I0316 16:06:37.833438 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e01ce77-a7e7-4f90-880f-fb2aa9b506a0" containerName="account-server" Mar 16 16:06:37 crc kubenswrapper[5120]: I0316 16:06:37.833469 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e01ce77-a7e7-4f90-880f-fb2aa9b506a0" containerName="account-reaper" Mar 16 16:06:37 crc kubenswrapper[5120]: I0316 16:06:37.833477 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e01ce77-a7e7-4f90-880f-fb2aa9b506a0" containerName="account-reaper" Mar 16 16:06:37 crc kubenswrapper[5120]: I0316 16:06:37.833489 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e01ce77-a7e7-4f90-880f-fb2aa9b506a0" containerName="swift-recon-cron" Mar 16 16:06:37 crc kubenswrapper[5120]: I0316 16:06:37.833497 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e01ce77-a7e7-4f90-880f-fb2aa9b506a0" containerName="swift-recon-cron" Mar 16 16:06:37 crc kubenswrapper[5120]: I0316 16:06:37.833514 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e01ce77-a7e7-4f90-880f-fb2aa9b506a0" containerName="container-updater" Mar 16 16:06:37 crc kubenswrapper[5120]: I0316 16:06:37.833522 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e01ce77-a7e7-4f90-880f-fb2aa9b506a0" containerName="container-updater" Mar 16 16:06:37 crc kubenswrapper[5120]: I0316 16:06:37.833549 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d8004a6-f52b-420c-9f64-141dae970d7e" containerName="neutron-httpd" Mar 16 16:06:37 crc kubenswrapper[5120]: I0316 16:06:37.833557 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d8004a6-f52b-420c-9f64-141dae970d7e" containerName="neutron-httpd" Mar 16 16:06:37 crc kubenswrapper[5120]: I0316 16:06:37.833576 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e01ce77-a7e7-4f90-880f-fb2aa9b506a0" containerName="object-server" Mar 16 16:06:37 crc kubenswrapper[5120]: I0316 16:06:37.833584 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e01ce77-a7e7-4f90-880f-fb2aa9b506a0" containerName="object-server" Mar 16 16:06:37 crc kubenswrapper[5120]: I0316 16:06:37.833598 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e01ce77-a7e7-4f90-880f-fb2aa9b506a0" containerName="container-auditor" Mar 16 16:06:37 crc kubenswrapper[5120]: I0316 16:06:37.833606 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e01ce77-a7e7-4f90-880f-fb2aa9b506a0" containerName="container-auditor" Mar 16 16:06:37 crc kubenswrapper[5120]: I0316 16:06:37.833621 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d8004a6-f52b-420c-9f64-141dae970d7e" containerName="neutron-api" Mar 16 16:06:37 crc kubenswrapper[5120]: I0316 16:06:37.833629 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d8004a6-f52b-420c-9f64-141dae970d7e" containerName="neutron-api" Mar 16 16:06:37 crc kubenswrapper[5120]: I0316 16:06:37.833665 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e01ce77-a7e7-4f90-880f-fb2aa9b506a0" containerName="account-auditor" Mar 16 16:06:37 crc kubenswrapper[5120]: I0316 16:06:37.833700 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e01ce77-a7e7-4f90-880f-fb2aa9b506a0" containerName="account-auditor" Mar 16 16:06:37 crc kubenswrapper[5120]: I0316 16:06:37.833721 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e01ce77-a7e7-4f90-880f-fb2aa9b506a0" containerName="object-expirer" Mar 16 16:06:37 crc kubenswrapper[5120]: I0316 16:06:37.833730 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e01ce77-a7e7-4f90-880f-fb2aa9b506a0" containerName="object-expirer" Mar 16 16:06:37 crc kubenswrapper[5120]: I0316 16:06:37.833744 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f091159-612f-4c40-b215-344c86fe9f65" containerName="nova-cell1-conductor-conductor" Mar 16 16:06:37 crc kubenswrapper[5120]: I0316 16:06:37.833755 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f091159-612f-4c40-b215-344c86fe9f65" containerName="nova-cell1-conductor-conductor" Mar 16 16:06:37 crc kubenswrapper[5120]: I0316 16:06:37.833817 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6645a7f0-de34-43c5-9422-1483edda0298" containerName="nova-scheduler-scheduler" Mar 16 16:06:37 crc kubenswrapper[5120]: I0316 16:06:37.833830 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="6645a7f0-de34-43c5-9422-1483edda0298" containerName="nova-scheduler-scheduler" Mar 16 16:06:37 crc kubenswrapper[5120]: I0316 16:06:37.833847 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e01ce77-a7e7-4f90-880f-fb2aa9b506a0" containerName="object-auditor" Mar 16 16:06:37 crc kubenswrapper[5120]: I0316 16:06:37.833858 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e01ce77-a7e7-4f90-880f-fb2aa9b506a0" containerName="object-auditor" Mar 16 16:06:37 crc kubenswrapper[5120]: I0316 16:06:37.834221 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7e01ce77-a7e7-4f90-880f-fb2aa9b506a0" containerName="account-reaper" Mar 16 16:06:37 crc kubenswrapper[5120]: I0316 16:06:37.834246 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7e01ce77-a7e7-4f90-880f-fb2aa9b506a0" containerName="account-auditor" Mar 16 16:06:37 crc kubenswrapper[5120]: I0316 16:06:37.834261 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7e01ce77-a7e7-4f90-880f-fb2aa9b506a0" containerName="container-server" Mar 16 16:06:37 crc kubenswrapper[5120]: I0316 16:06:37.834277 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7e01ce77-a7e7-4f90-880f-fb2aa9b506a0" containerName="object-replicator" Mar 16 16:06:37 crc kubenswrapper[5120]: I0316 16:06:37.834297 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7e01ce77-a7e7-4f90-880f-fb2aa9b506a0" containerName="object-auditor" Mar 16 16:06:37 crc kubenswrapper[5120]: I0316 16:06:37.834309 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="8f091159-612f-4c40-b215-344c86fe9f65" containerName="nova-cell1-conductor-conductor" Mar 16 16:06:37 crc kubenswrapper[5120]: I0316 16:06:37.834325 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7e01ce77-a7e7-4f90-880f-fb2aa9b506a0" containerName="object-updater" Mar 16 16:06:37 crc kubenswrapper[5120]: I0316 16:06:37.834342 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="6645a7f0-de34-43c5-9422-1483edda0298" containerName="nova-scheduler-scheduler" Mar 16 16:06:37 crc kubenswrapper[5120]: I0316 16:06:37.834360 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7e01ce77-a7e7-4f90-880f-fb2aa9b506a0" containerName="account-replicator" Mar 16 16:06:37 crc kubenswrapper[5120]: I0316 16:06:37.834374 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7e01ce77-a7e7-4f90-880f-fb2aa9b506a0" containerName="swift-recon-cron" Mar 16 16:06:37 crc kubenswrapper[5120]: I0316 16:06:37.834393 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7e01ce77-a7e7-4f90-880f-fb2aa9b506a0" containerName="container-updater" Mar 16 16:06:37 crc kubenswrapper[5120]: I0316 16:06:37.834405 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7e01ce77-a7e7-4f90-880f-fb2aa9b506a0" containerName="object-server" Mar 16 16:06:37 crc kubenswrapper[5120]: I0316 16:06:37.834421 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7e01ce77-a7e7-4f90-880f-fb2aa9b506a0" containerName="account-server" Mar 16 16:06:37 crc kubenswrapper[5120]: I0316 16:06:37.834438 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7e01ce77-a7e7-4f90-880f-fb2aa9b506a0" containerName="rsync" Mar 16 16:06:37 crc kubenswrapper[5120]: I0316 16:06:37.834452 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="9d8004a6-f52b-420c-9f64-141dae970d7e" containerName="neutron-httpd" Mar 16 16:06:37 crc kubenswrapper[5120]: I0316 16:06:37.834469 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7e01ce77-a7e7-4f90-880f-fb2aa9b506a0" containerName="container-replicator" Mar 16 16:06:37 crc kubenswrapper[5120]: I0316 16:06:37.834486 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="9d8004a6-f52b-420c-9f64-141dae970d7e" containerName="neutron-api" Mar 16 16:06:37 crc kubenswrapper[5120]: I0316 16:06:37.834499 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7e01ce77-a7e7-4f90-880f-fb2aa9b506a0" containerName="object-expirer" Mar 16 16:06:37 crc kubenswrapper[5120]: I0316 16:06:37.834514 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7e01ce77-a7e7-4f90-880f-fb2aa9b506a0" containerName="container-auditor" Mar 16 16:06:37 crc kubenswrapper[5120]: I0316 16:06:37.840843 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-mz4dk"] Mar 16 16:06:37 crc kubenswrapper[5120]: I0316 16:06:37.840991 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-mz4dk" Mar 16 16:06:37 crc kubenswrapper[5120]: I0316 16:06:37.844357 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"openshift-service-ca.crt\"" Mar 16 16:06:37 crc kubenswrapper[5120]: I0316 16:06:37.844454 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"kube-root-ca.crt\"" Mar 16 16:06:37 crc kubenswrapper[5120]: I0316 16:06:37.846490 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"crc-storage\"/\"crc-storage-dockercfg-s2tht\"" Mar 16 16:06:37 crc kubenswrapper[5120]: I0316 16:06:37.847358 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"crc-storage\"" Mar 16 16:06:37 crc kubenswrapper[5120]: I0316 16:06:37.953838 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/b48a1d76-8f28-4154-a6fe-7fea2af455d6-crc-storage\") pod \"crc-storage-crc-mz4dk\" (UID: \"b48a1d76-8f28-4154-a6fe-7fea2af455d6\") " pod="crc-storage/crc-storage-crc-mz4dk" Mar 16 16:06:37 crc kubenswrapper[5120]: I0316 16:06:37.954841 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/b48a1d76-8f28-4154-a6fe-7fea2af455d6-node-mnt\") pod \"crc-storage-crc-mz4dk\" (UID: \"b48a1d76-8f28-4154-a6fe-7fea2af455d6\") " pod="crc-storage/crc-storage-crc-mz4dk" Mar 16 16:06:37 crc kubenswrapper[5120]: I0316 16:06:37.955099 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tkfw6\" (UniqueName: \"kubernetes.io/projected/b48a1d76-8f28-4154-a6fe-7fea2af455d6-kube-api-access-tkfw6\") pod \"crc-storage-crc-mz4dk\" (UID: \"b48a1d76-8f28-4154-a6fe-7fea2af455d6\") " pod="crc-storage/crc-storage-crc-mz4dk" Mar 16 16:06:38 crc kubenswrapper[5120]: I0316 16:06:38.056452 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/b48a1d76-8f28-4154-a6fe-7fea2af455d6-node-mnt\") pod \"crc-storage-crc-mz4dk\" (UID: \"b48a1d76-8f28-4154-a6fe-7fea2af455d6\") " pod="crc-storage/crc-storage-crc-mz4dk" Mar 16 16:06:38 crc kubenswrapper[5120]: I0316 16:06:38.056545 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tkfw6\" (UniqueName: \"kubernetes.io/projected/b48a1d76-8f28-4154-a6fe-7fea2af455d6-kube-api-access-tkfw6\") pod \"crc-storage-crc-mz4dk\" (UID: \"b48a1d76-8f28-4154-a6fe-7fea2af455d6\") " pod="crc-storage/crc-storage-crc-mz4dk" Mar 16 16:06:38 crc kubenswrapper[5120]: I0316 16:06:38.056605 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/b48a1d76-8f28-4154-a6fe-7fea2af455d6-crc-storage\") pod \"crc-storage-crc-mz4dk\" (UID: \"b48a1d76-8f28-4154-a6fe-7fea2af455d6\") " pod="crc-storage/crc-storage-crc-mz4dk" Mar 16 16:06:38 crc kubenswrapper[5120]: I0316 16:06:38.057188 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/b48a1d76-8f28-4154-a6fe-7fea2af455d6-node-mnt\") pod \"crc-storage-crc-mz4dk\" (UID: \"b48a1d76-8f28-4154-a6fe-7fea2af455d6\") " pod="crc-storage/crc-storage-crc-mz4dk" Mar 16 16:06:38 crc kubenswrapper[5120]: I0316 16:06:38.057254 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/b48a1d76-8f28-4154-a6fe-7fea2af455d6-crc-storage\") pod \"crc-storage-crc-mz4dk\" (UID: \"b48a1d76-8f28-4154-a6fe-7fea2af455d6\") " pod="crc-storage/crc-storage-crc-mz4dk" Mar 16 16:06:38 crc kubenswrapper[5120]: I0316 16:06:38.074975 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tkfw6\" (UniqueName: \"kubernetes.io/projected/b48a1d76-8f28-4154-a6fe-7fea2af455d6-kube-api-access-tkfw6\") pod \"crc-storage-crc-mz4dk\" (UID: \"b48a1d76-8f28-4154-a6fe-7fea2af455d6\") " pod="crc-storage/crc-storage-crc-mz4dk" Mar 16 16:06:38 crc kubenswrapper[5120]: I0316 16:06:38.156362 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-mz4dk" Mar 16 16:06:38 crc kubenswrapper[5120]: I0316 16:06:38.545205 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:06:38 crc kubenswrapper[5120]: I0316 16:06:38.590681 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:06:38 crc kubenswrapper[5120]: I0316 16:06:38.596854 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:06:38 crc kubenswrapper[5120]: I0316 16:06:38.639829 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-mz4dk"] Mar 16 16:06:38 crc kubenswrapper[5120]: I0316 16:06:38.680306 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0aca7ef2-1df2-4dd5-b2f4-c067874f36a2" path="/var/lib/kubelet/pods/0aca7ef2-1df2-4dd5-b2f4-c067874f36a2/volumes" Mar 16 16:06:38 crc kubenswrapper[5120]: I0316 16:06:38.681098 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6645a7f0-de34-43c5-9422-1483edda0298" path="/var/lib/kubelet/pods/6645a7f0-de34-43c5-9422-1483edda0298/volumes" Mar 16 16:06:38 crc kubenswrapper[5120]: E0316 16:06:38.719504 5120 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbf01270c_6ae8_4c7f_aee3_42a125c155e4.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddbb06351_e6e7_4a49_a941_33b16fc6206d.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6645a7f0_de34_43c5_9422_1483edda0298.slice/crio-4fa027892a69ee2d8daff9aa94346dd72f383a9a833d39b76f0c7cb70ae6c4f7\": RecentStats: unable to find data in memory cache]" Mar 16 16:06:39 crc kubenswrapper[5120]: I0316 16:06:39.556327 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-mz4dk" event={"ID":"b48a1d76-8f28-4154-a6fe-7fea2af455d6","Type":"ContainerStarted","Data":"5b27e0c4f8fcbb05d85a1fecfcfd66e263968479f5142e8e81a58a8db988dfef"} Mar 16 16:06:39 crc kubenswrapper[5120]: I0316 16:06:39.557110 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-mz4dk" event={"ID":"b48a1d76-8f28-4154-a6fe-7fea2af455d6","Type":"ContainerStarted","Data":"7f7700d175f804462f577c4aa7c917c04e81aa04e6fa66aa673a20b3070fd7bc"} Mar 16 16:06:39 crc kubenswrapper[5120]: I0316 16:06:39.578217 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="crc-storage/crc-storage-crc-mz4dk" podStartSLOduration=2.045689734 podStartE2EDuration="2.578196213s" podCreationTimestamp="2026-03-16 16:06:37 +0000 UTC" firstStartedPulling="2026-03-16 16:06:38.651703384 +0000 UTC m=+2100.805635051" lastFinishedPulling="2026-03-16 16:06:39.184209833 +0000 UTC m=+2101.338141530" observedRunningTime="2026-03-16 16:06:39.571288185 +0000 UTC m=+2101.725219842" watchObservedRunningTime="2026-03-16 16:06:39.578196213 +0000 UTC m=+2101.732127870" Mar 16 16:06:40 crc kubenswrapper[5120]: I0316 16:06:40.571524 5120 generic.go:358] "Generic (PLEG): container finished" podID="b48a1d76-8f28-4154-a6fe-7fea2af455d6" containerID="5b27e0c4f8fcbb05d85a1fecfcfd66e263968479f5142e8e81a58a8db988dfef" exitCode=0 Mar 16 16:06:40 crc kubenswrapper[5120]: I0316 16:06:40.571579 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-mz4dk" event={"ID":"b48a1d76-8f28-4154-a6fe-7fea2af455d6","Type":"ContainerDied","Data":"5b27e0c4f8fcbb05d85a1fecfcfd66e263968479f5142e8e81a58a8db988dfef"} Mar 16 16:06:42 crc kubenswrapper[5120]: I0316 16:06:42.010668 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-mz4dk" Mar 16 16:06:42 crc kubenswrapper[5120]: I0316 16:06:42.132355 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/b48a1d76-8f28-4154-a6fe-7fea2af455d6-node-mnt\") pod \"b48a1d76-8f28-4154-a6fe-7fea2af455d6\" (UID: \"b48a1d76-8f28-4154-a6fe-7fea2af455d6\") " Mar 16 16:06:42 crc kubenswrapper[5120]: I0316 16:06:42.132743 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tkfw6\" (UniqueName: \"kubernetes.io/projected/b48a1d76-8f28-4154-a6fe-7fea2af455d6-kube-api-access-tkfw6\") pod \"b48a1d76-8f28-4154-a6fe-7fea2af455d6\" (UID: \"b48a1d76-8f28-4154-a6fe-7fea2af455d6\") " Mar 16 16:06:42 crc kubenswrapper[5120]: I0316 16:06:42.132455 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/b48a1d76-8f28-4154-a6fe-7fea2af455d6-node-mnt" (OuterVolumeSpecName: "node-mnt") pod "b48a1d76-8f28-4154-a6fe-7fea2af455d6" (UID: "b48a1d76-8f28-4154-a6fe-7fea2af455d6"). InnerVolumeSpecName "node-mnt". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 16:06:42 crc kubenswrapper[5120]: I0316 16:06:42.133011 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/b48a1d76-8f28-4154-a6fe-7fea2af455d6-crc-storage\") pod \"b48a1d76-8f28-4154-a6fe-7fea2af455d6\" (UID: \"b48a1d76-8f28-4154-a6fe-7fea2af455d6\") " Mar 16 16:06:42 crc kubenswrapper[5120]: I0316 16:06:42.133671 5120 reconciler_common.go:299] "Volume detached for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/b48a1d76-8f28-4154-a6fe-7fea2af455d6-node-mnt\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:42 crc kubenswrapper[5120]: I0316 16:06:42.142144 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b48a1d76-8f28-4154-a6fe-7fea2af455d6-kube-api-access-tkfw6" (OuterVolumeSpecName: "kube-api-access-tkfw6") pod "b48a1d76-8f28-4154-a6fe-7fea2af455d6" (UID: "b48a1d76-8f28-4154-a6fe-7fea2af455d6"). InnerVolumeSpecName "kube-api-access-tkfw6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:06:42 crc kubenswrapper[5120]: I0316 16:06:42.154166 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b48a1d76-8f28-4154-a6fe-7fea2af455d6-crc-storage" (OuterVolumeSpecName: "crc-storage") pod "b48a1d76-8f28-4154-a6fe-7fea2af455d6" (UID: "b48a1d76-8f28-4154-a6fe-7fea2af455d6"). InnerVolumeSpecName "crc-storage". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:06:42 crc kubenswrapper[5120]: I0316 16:06:42.236145 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tkfw6\" (UniqueName: \"kubernetes.io/projected/b48a1d76-8f28-4154-a6fe-7fea2af455d6-kube-api-access-tkfw6\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:42 crc kubenswrapper[5120]: I0316 16:06:42.236216 5120 reconciler_common.go:299] "Volume detached for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/b48a1d76-8f28-4154-a6fe-7fea2af455d6-crc-storage\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:42 crc kubenswrapper[5120]: I0316 16:06:42.596913 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-mz4dk" event={"ID":"b48a1d76-8f28-4154-a6fe-7fea2af455d6","Type":"ContainerDied","Data":"7f7700d175f804462f577c4aa7c917c04e81aa04e6fa66aa673a20b3070fd7bc"} Mar 16 16:06:42 crc kubenswrapper[5120]: I0316 16:06:42.596964 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7f7700d175f804462f577c4aa7c917c04e81aa04e6fa66aa673a20b3070fd7bc" Mar 16 16:06:42 crc kubenswrapper[5120]: I0316 16:06:42.596936 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-mz4dk" Mar 16 16:06:43 crc kubenswrapper[5120]: I0316 16:06:43.113970 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-v822j_ac55471d-4e42-475f-a082-50f611571482/kube-multus/0.log" Mar 16 16:06:43 crc kubenswrapper[5120]: I0316 16:06:43.114391 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-v822j_ac55471d-4e42-475f-a082-50f611571482/kube-multus/0.log" Mar 16 16:06:43 crc kubenswrapper[5120]: I0316 16:06:43.119228 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-crc_9f0bc7fcb0822a2c13eb2d22cd8c0641/kube-controller-manager/0.log" Mar 16 16:06:43 crc kubenswrapper[5120]: I0316 16:06:43.119256 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-crc_9f0bc7fcb0822a2c13eb2d22cd8c0641/kube-controller-manager/0.log" Mar 16 16:06:44 crc kubenswrapper[5120]: I0316 16:06:44.834631 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["crc-storage/crc-storage-crc-mz4dk"] Mar 16 16:06:44 crc kubenswrapper[5120]: I0316 16:06:44.844263 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["crc-storage/crc-storage-crc-mz4dk"] Mar 16 16:06:44 crc kubenswrapper[5120]: I0316 16:06:44.981109 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["crc-storage/crc-storage-crc-rl6vz"] Mar 16 16:06:44 crc kubenswrapper[5120]: I0316 16:06:44.984054 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b48a1d76-8f28-4154-a6fe-7fea2af455d6" containerName="storage" Mar 16 16:06:44 crc kubenswrapper[5120]: I0316 16:06:44.984087 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="b48a1d76-8f28-4154-a6fe-7fea2af455d6" containerName="storage" Mar 16 16:06:44 crc kubenswrapper[5120]: I0316 16:06:44.984456 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="b48a1d76-8f28-4154-a6fe-7fea2af455d6" containerName="storage" Mar 16 16:06:44 crc kubenswrapper[5120]: I0316 16:06:44.991979 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-rl6vz" Mar 16 16:06:44 crc kubenswrapper[5120]: I0316 16:06:44.994590 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"crc-storage\"" Mar 16 16:06:44 crc kubenswrapper[5120]: I0316 16:06:44.994833 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"crc-storage\"/\"crc-storage-dockercfg-s2tht\"" Mar 16 16:06:44 crc kubenswrapper[5120]: I0316 16:06:44.995288 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"kube-root-ca.crt\"" Mar 16 16:06:45 crc kubenswrapper[5120]: I0316 16:06:44.995442 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"openshift-service-ca.crt\"" Mar 16 16:06:45 crc kubenswrapper[5120]: I0316 16:06:44.999947 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-rl6vz"] Mar 16 16:06:45 crc kubenswrapper[5120]: I0316 16:06:45.093705 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/74a0eab3-79e7-4265-a1af-65f659f3f91d-node-mnt\") pod \"crc-storage-crc-rl6vz\" (UID: \"74a0eab3-79e7-4265-a1af-65f659f3f91d\") " pod="crc-storage/crc-storage-crc-rl6vz" Mar 16 16:06:45 crc kubenswrapper[5120]: I0316 16:06:45.093810 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6fqt\" (UniqueName: \"kubernetes.io/projected/74a0eab3-79e7-4265-a1af-65f659f3f91d-kube-api-access-z6fqt\") pod \"crc-storage-crc-rl6vz\" (UID: \"74a0eab3-79e7-4265-a1af-65f659f3f91d\") " pod="crc-storage/crc-storage-crc-rl6vz" Mar 16 16:06:45 crc kubenswrapper[5120]: I0316 16:06:45.093989 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/74a0eab3-79e7-4265-a1af-65f659f3f91d-crc-storage\") pod \"crc-storage-crc-rl6vz\" (UID: \"74a0eab3-79e7-4265-a1af-65f659f3f91d\") " pod="crc-storage/crc-storage-crc-rl6vz" Mar 16 16:06:45 crc kubenswrapper[5120]: I0316 16:06:45.195230 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/74a0eab3-79e7-4265-a1af-65f659f3f91d-crc-storage\") pod \"crc-storage-crc-rl6vz\" (UID: \"74a0eab3-79e7-4265-a1af-65f659f3f91d\") " pod="crc-storage/crc-storage-crc-rl6vz" Mar 16 16:06:45 crc kubenswrapper[5120]: I0316 16:06:45.195373 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/74a0eab3-79e7-4265-a1af-65f659f3f91d-node-mnt\") pod \"crc-storage-crc-rl6vz\" (UID: \"74a0eab3-79e7-4265-a1af-65f659f3f91d\") " pod="crc-storage/crc-storage-crc-rl6vz" Mar 16 16:06:45 crc kubenswrapper[5120]: I0316 16:06:45.195438 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z6fqt\" (UniqueName: \"kubernetes.io/projected/74a0eab3-79e7-4265-a1af-65f659f3f91d-kube-api-access-z6fqt\") pod \"crc-storage-crc-rl6vz\" (UID: \"74a0eab3-79e7-4265-a1af-65f659f3f91d\") " pod="crc-storage/crc-storage-crc-rl6vz" Mar 16 16:06:45 crc kubenswrapper[5120]: I0316 16:06:45.195745 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/74a0eab3-79e7-4265-a1af-65f659f3f91d-node-mnt\") pod \"crc-storage-crc-rl6vz\" (UID: \"74a0eab3-79e7-4265-a1af-65f659f3f91d\") " pod="crc-storage/crc-storage-crc-rl6vz" Mar 16 16:06:45 crc kubenswrapper[5120]: I0316 16:06:45.195929 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/74a0eab3-79e7-4265-a1af-65f659f3f91d-crc-storage\") pod \"crc-storage-crc-rl6vz\" (UID: \"74a0eab3-79e7-4265-a1af-65f659f3f91d\") " pod="crc-storage/crc-storage-crc-rl6vz" Mar 16 16:06:45 crc kubenswrapper[5120]: I0316 16:06:45.215535 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6fqt\" (UniqueName: \"kubernetes.io/projected/74a0eab3-79e7-4265-a1af-65f659f3f91d-kube-api-access-z6fqt\") pod \"crc-storage-crc-rl6vz\" (UID: \"74a0eab3-79e7-4265-a1af-65f659f3f91d\") " pod="crc-storage/crc-storage-crc-rl6vz" Mar 16 16:06:45 crc kubenswrapper[5120]: I0316 16:06:45.320965 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-rl6vz" Mar 16 16:06:45 crc kubenswrapper[5120]: I0316 16:06:45.776810 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-rl6vz"] Mar 16 16:06:45 crc kubenswrapper[5120]: I0316 16:06:45.918477 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-operators-kflw6" Mar 16 16:06:45 crc kubenswrapper[5120]: I0316 16:06:45.984181 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-operators-kflw6" Mar 16 16:06:46 crc kubenswrapper[5120]: I0316 16:06:46.170346 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-operators-kflw6"] Mar 16 16:06:46 crc kubenswrapper[5120]: I0316 16:06:46.640944 5120 generic.go:358] "Generic (PLEG): container finished" podID="74a0eab3-79e7-4265-a1af-65f659f3f91d" containerID="21bd09901929d3bf3882c7a1caeb77b83d0d14197d81b76717966b11af63259f" exitCode=0 Mar 16 16:06:46 crc kubenswrapper[5120]: I0316 16:06:46.641037 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-rl6vz" event={"ID":"74a0eab3-79e7-4265-a1af-65f659f3f91d","Type":"ContainerDied","Data":"21bd09901929d3bf3882c7a1caeb77b83d0d14197d81b76717966b11af63259f"} Mar 16 16:06:46 crc kubenswrapper[5120]: I0316 16:06:46.641379 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-rl6vz" event={"ID":"74a0eab3-79e7-4265-a1af-65f659f3f91d","Type":"ContainerStarted","Data":"05088c797c640b44ff79b949f2a9c8e4a535bc4f045f651fb49661f8b9d912c7"} Mar 16 16:06:46 crc kubenswrapper[5120]: I0316 16:06:46.681701 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b48a1d76-8f28-4154-a6fe-7fea2af455d6" path="/var/lib/kubelet/pods/b48a1d76-8f28-4154-a6fe-7fea2af455d6/volumes" Mar 16 16:06:47 crc kubenswrapper[5120]: I0316 16:06:47.654478 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-marketplace/redhat-operators-kflw6" podUID="e80e8df3-88ad-4789-89af-38d912522931" containerName="registry-server" containerID="cri-o://9bf3f97931100e269d327e9b2cfe87e5cc13a2b816e049ab5a84601c77d01cbe" gracePeriod=2 Mar 16 16:06:48 crc kubenswrapper[5120]: I0316 16:06:48.063784 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-rl6vz" Mar 16 16:06:48 crc kubenswrapper[5120]: I0316 16:06:48.147284 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/74a0eab3-79e7-4265-a1af-65f659f3f91d-node-mnt\") pod \"74a0eab3-79e7-4265-a1af-65f659f3f91d\" (UID: \"74a0eab3-79e7-4265-a1af-65f659f3f91d\") " Mar 16 16:06:48 crc kubenswrapper[5120]: I0316 16:06:48.147459 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/74a0eab3-79e7-4265-a1af-65f659f3f91d-crc-storage\") pod \"74a0eab3-79e7-4265-a1af-65f659f3f91d\" (UID: \"74a0eab3-79e7-4265-a1af-65f659f3f91d\") " Mar 16 16:06:48 crc kubenswrapper[5120]: I0316 16:06:48.147517 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z6fqt\" (UniqueName: \"kubernetes.io/projected/74a0eab3-79e7-4265-a1af-65f659f3f91d-kube-api-access-z6fqt\") pod \"74a0eab3-79e7-4265-a1af-65f659f3f91d\" (UID: \"74a0eab3-79e7-4265-a1af-65f659f3f91d\") " Mar 16 16:06:48 crc kubenswrapper[5120]: I0316 16:06:48.147671 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/74a0eab3-79e7-4265-a1af-65f659f3f91d-node-mnt" (OuterVolumeSpecName: "node-mnt") pod "74a0eab3-79e7-4265-a1af-65f659f3f91d" (UID: "74a0eab3-79e7-4265-a1af-65f659f3f91d"). InnerVolumeSpecName "node-mnt". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 16:06:48 crc kubenswrapper[5120]: I0316 16:06:48.148397 5120 reconciler_common.go:299] "Volume detached for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/74a0eab3-79e7-4265-a1af-65f659f3f91d-node-mnt\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:48 crc kubenswrapper[5120]: I0316 16:06:48.153947 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74a0eab3-79e7-4265-a1af-65f659f3f91d-kube-api-access-z6fqt" (OuterVolumeSpecName: "kube-api-access-z6fqt") pod "74a0eab3-79e7-4265-a1af-65f659f3f91d" (UID: "74a0eab3-79e7-4265-a1af-65f659f3f91d"). InnerVolumeSpecName "kube-api-access-z6fqt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:06:48 crc kubenswrapper[5120]: I0316 16:06:48.183620 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74a0eab3-79e7-4265-a1af-65f659f3f91d-crc-storage" (OuterVolumeSpecName: "crc-storage") pod "74a0eab3-79e7-4265-a1af-65f659f3f91d" (UID: "74a0eab3-79e7-4265-a1af-65f659f3f91d"). InnerVolumeSpecName "crc-storage". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:06:48 crc kubenswrapper[5120]: I0316 16:06:48.197317 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-kflw6" Mar 16 16:06:48 crc kubenswrapper[5120]: I0316 16:06:48.250388 5120 reconciler_common.go:299] "Volume detached for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/74a0eab3-79e7-4265-a1af-65f659f3f91d-crc-storage\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:48 crc kubenswrapper[5120]: I0316 16:06:48.250420 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z6fqt\" (UniqueName: \"kubernetes.io/projected/74a0eab3-79e7-4265-a1af-65f659f3f91d-kube-api-access-z6fqt\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:48 crc kubenswrapper[5120]: I0316 16:06:48.351017 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/e80e8df3-88ad-4789-89af-38d912522931-utilities\") pod \"e80e8df3-88ad-4789-89af-38d912522931\" (UID: \"e80e8df3-88ad-4789-89af-38d912522931\") " Mar 16 16:06:48 crc kubenswrapper[5120]: I0316 16:06:48.351148 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-stk4c\" (UniqueName: \"kubernetes.io/projected/e80e8df3-88ad-4789-89af-38d912522931-kube-api-access-stk4c\") pod \"e80e8df3-88ad-4789-89af-38d912522931\" (UID: \"e80e8df3-88ad-4789-89af-38d912522931\") " Mar 16 16:06:48 crc kubenswrapper[5120]: I0316 16:06:48.351442 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/e80e8df3-88ad-4789-89af-38d912522931-catalog-content\") pod \"e80e8df3-88ad-4789-89af-38d912522931\" (UID: \"e80e8df3-88ad-4789-89af-38d912522931\") " Mar 16 16:06:48 crc kubenswrapper[5120]: I0316 16:06:48.352778 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e80e8df3-88ad-4789-89af-38d912522931-utilities" (OuterVolumeSpecName: "utilities") pod "e80e8df3-88ad-4789-89af-38d912522931" (UID: "e80e8df3-88ad-4789-89af-38d912522931"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:06:48 crc kubenswrapper[5120]: I0316 16:06:48.354728 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e80e8df3-88ad-4789-89af-38d912522931-kube-api-access-stk4c" (OuterVolumeSpecName: "kube-api-access-stk4c") pod "e80e8df3-88ad-4789-89af-38d912522931" (UID: "e80e8df3-88ad-4789-89af-38d912522931"). InnerVolumeSpecName "kube-api-access-stk4c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:06:48 crc kubenswrapper[5120]: I0316 16:06:48.454312 5120 reconciler_common.go:299] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/e80e8df3-88ad-4789-89af-38d912522931-utilities\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:48 crc kubenswrapper[5120]: I0316 16:06:48.454376 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-stk4c\" (UniqueName: \"kubernetes.io/projected/e80e8df3-88ad-4789-89af-38d912522931-kube-api-access-stk4c\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:48 crc kubenswrapper[5120]: I0316 16:06:48.505877 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e80e8df3-88ad-4789-89af-38d912522931-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "e80e8df3-88ad-4789-89af-38d912522931" (UID: "e80e8df3-88ad-4789-89af-38d912522931"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:06:48 crc kubenswrapper[5120]: I0316 16:06:48.556345 5120 reconciler_common.go:299] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/e80e8df3-88ad-4789-89af-38d912522931-catalog-content\") on node \"crc\" DevicePath \"\"" Mar 16 16:06:48 crc kubenswrapper[5120]: I0316 16:06:48.678319 5120 generic.go:358] "Generic (PLEG): container finished" podID="e80e8df3-88ad-4789-89af-38d912522931" containerID="9bf3f97931100e269d327e9b2cfe87e5cc13a2b816e049ab5a84601c77d01cbe" exitCode=0 Mar 16 16:06:48 crc kubenswrapper[5120]: I0316 16:06:48.679294 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-kflw6" Mar 16 16:06:48 crc kubenswrapper[5120]: I0316 16:06:48.679620 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-rl6vz" Mar 16 16:06:48 crc kubenswrapper[5120]: I0316 16:06:48.688592 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-rl6vz" event={"ID":"74a0eab3-79e7-4265-a1af-65f659f3f91d","Type":"ContainerDied","Data":"05088c797c640b44ff79b949f2a9c8e4a535bc4f045f651fb49661f8b9d912c7"} Mar 16 16:06:48 crc kubenswrapper[5120]: I0316 16:06:48.688659 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="05088c797c640b44ff79b949f2a9c8e4a535bc4f045f651fb49661f8b9d912c7" Mar 16 16:06:48 crc kubenswrapper[5120]: I0316 16:06:48.688688 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-kflw6" event={"ID":"e80e8df3-88ad-4789-89af-38d912522931","Type":"ContainerDied","Data":"9bf3f97931100e269d327e9b2cfe87e5cc13a2b816e049ab5a84601c77d01cbe"} Mar 16 16:06:48 crc kubenswrapper[5120]: I0316 16:06:48.688719 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-kflw6" event={"ID":"e80e8df3-88ad-4789-89af-38d912522931","Type":"ContainerDied","Data":"678f7955b360f9d3afc95f1181f86dc058f263b7d95de36a893bfe884181dd3d"} Mar 16 16:06:48 crc kubenswrapper[5120]: I0316 16:06:48.688756 5120 scope.go:117] "RemoveContainer" containerID="9bf3f97931100e269d327e9b2cfe87e5cc13a2b816e049ab5a84601c77d01cbe" Mar 16 16:06:48 crc kubenswrapper[5120]: I0316 16:06:48.731845 5120 scope.go:117] "RemoveContainer" containerID="70177dc034340cfc9e490776cd973709a45d4a1d70cd99415531e8f497a42ac3" Mar 16 16:06:48 crc kubenswrapper[5120]: I0316 16:06:48.750719 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-operators-kflw6"] Mar 16 16:06:48 crc kubenswrapper[5120]: I0316 16:06:48.758291 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/redhat-operators-kflw6"] Mar 16 16:06:48 crc kubenswrapper[5120]: I0316 16:06:48.769826 5120 scope.go:117] "RemoveContainer" containerID="0a652576966bf4c64e78e5abffddbc53e1b8f8d1fb69d6f0d090f90959af6b68" Mar 16 16:06:48 crc kubenswrapper[5120]: I0316 16:06:48.838500 5120 scope.go:117] "RemoveContainer" containerID="9bf3f97931100e269d327e9b2cfe87e5cc13a2b816e049ab5a84601c77d01cbe" Mar 16 16:06:48 crc kubenswrapper[5120]: E0316 16:06:48.840892 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9bf3f97931100e269d327e9b2cfe87e5cc13a2b816e049ab5a84601c77d01cbe\": container with ID starting with 9bf3f97931100e269d327e9b2cfe87e5cc13a2b816e049ab5a84601c77d01cbe not found: ID does not exist" containerID="9bf3f97931100e269d327e9b2cfe87e5cc13a2b816e049ab5a84601c77d01cbe" Mar 16 16:06:48 crc kubenswrapper[5120]: I0316 16:06:48.840962 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9bf3f97931100e269d327e9b2cfe87e5cc13a2b816e049ab5a84601c77d01cbe"} err="failed to get container status \"9bf3f97931100e269d327e9b2cfe87e5cc13a2b816e049ab5a84601c77d01cbe\": rpc error: code = NotFound desc = could not find container \"9bf3f97931100e269d327e9b2cfe87e5cc13a2b816e049ab5a84601c77d01cbe\": container with ID starting with 9bf3f97931100e269d327e9b2cfe87e5cc13a2b816e049ab5a84601c77d01cbe not found: ID does not exist" Mar 16 16:06:48 crc kubenswrapper[5120]: I0316 16:06:48.840990 5120 scope.go:117] "RemoveContainer" containerID="70177dc034340cfc9e490776cd973709a45d4a1d70cd99415531e8f497a42ac3" Mar 16 16:06:48 crc kubenswrapper[5120]: E0316 16:06:48.841824 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"70177dc034340cfc9e490776cd973709a45d4a1d70cd99415531e8f497a42ac3\": container with ID starting with 70177dc034340cfc9e490776cd973709a45d4a1d70cd99415531e8f497a42ac3 not found: ID does not exist" containerID="70177dc034340cfc9e490776cd973709a45d4a1d70cd99415531e8f497a42ac3" Mar 16 16:06:48 crc kubenswrapper[5120]: I0316 16:06:48.841852 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70177dc034340cfc9e490776cd973709a45d4a1d70cd99415531e8f497a42ac3"} err="failed to get container status \"70177dc034340cfc9e490776cd973709a45d4a1d70cd99415531e8f497a42ac3\": rpc error: code = NotFound desc = could not find container \"70177dc034340cfc9e490776cd973709a45d4a1d70cd99415531e8f497a42ac3\": container with ID starting with 70177dc034340cfc9e490776cd973709a45d4a1d70cd99415531e8f497a42ac3 not found: ID does not exist" Mar 16 16:06:48 crc kubenswrapper[5120]: I0316 16:06:48.841869 5120 scope.go:117] "RemoveContainer" containerID="0a652576966bf4c64e78e5abffddbc53e1b8f8d1fb69d6f0d090f90959af6b68" Mar 16 16:06:48 crc kubenswrapper[5120]: E0316 16:06:48.844330 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a652576966bf4c64e78e5abffddbc53e1b8f8d1fb69d6f0d090f90959af6b68\": container with ID starting with 0a652576966bf4c64e78e5abffddbc53e1b8f8d1fb69d6f0d090f90959af6b68 not found: ID does not exist" containerID="0a652576966bf4c64e78e5abffddbc53e1b8f8d1fb69d6f0d090f90959af6b68" Mar 16 16:06:48 crc kubenswrapper[5120]: I0316 16:06:48.844388 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a652576966bf4c64e78e5abffddbc53e1b8f8d1fb69d6f0d090f90959af6b68"} err="failed to get container status \"0a652576966bf4c64e78e5abffddbc53e1b8f8d1fb69d6f0d090f90959af6b68\": rpc error: code = NotFound desc = could not find container \"0a652576966bf4c64e78e5abffddbc53e1b8f8d1fb69d6f0d090f90959af6b68\": container with ID starting with 0a652576966bf4c64e78e5abffddbc53e1b8f8d1fb69d6f0d090f90959af6b68 not found: ID does not exist" Mar 16 16:06:50 crc kubenswrapper[5120]: I0316 16:06:50.674202 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e80e8df3-88ad-4789-89af-38d912522931" path="/var/lib/kubelet/pods/e80e8df3-88ad-4789-89af-38d912522931/volumes" Mar 16 16:06:57 crc kubenswrapper[5120]: I0316 16:06:57.806164 5120 scope.go:117] "RemoveContainer" containerID="6c61d8d5aff83a68bd43a7d9b37f351f0bc19bbdef2670a8174126d2660fde32" Mar 16 16:06:57 crc kubenswrapper[5120]: I0316 16:06:57.929681 5120 scope.go:117] "RemoveContainer" containerID="3280982dc357d74ede0d29ab9151dec78861cc38d1b28fdd36ccf0f638f3325e" Mar 16 16:07:01 crc kubenswrapper[5120]: I0316 16:07:01.239275 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 16:07:01 crc kubenswrapper[5120]: I0316 16:07:01.240466 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e80e8df3-88ad-4789-89af-38d912522931" containerName="extract-utilities" Mar 16 16:07:01 crc kubenswrapper[5120]: I0316 16:07:01.240478 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e80e8df3-88ad-4789-89af-38d912522931" containerName="extract-utilities" Mar 16 16:07:01 crc kubenswrapper[5120]: I0316 16:07:01.240504 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74a0eab3-79e7-4265-a1af-65f659f3f91d" containerName="storage" Mar 16 16:07:01 crc kubenswrapper[5120]: I0316 16:07:01.240510 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="74a0eab3-79e7-4265-a1af-65f659f3f91d" containerName="storage" Mar 16 16:07:01 crc kubenswrapper[5120]: I0316 16:07:01.240528 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e80e8df3-88ad-4789-89af-38d912522931" containerName="extract-content" Mar 16 16:07:01 crc kubenswrapper[5120]: I0316 16:07:01.240534 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e80e8df3-88ad-4789-89af-38d912522931" containerName="extract-content" Mar 16 16:07:01 crc kubenswrapper[5120]: I0316 16:07:01.240550 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e80e8df3-88ad-4789-89af-38d912522931" containerName="registry-server" Mar 16 16:07:01 crc kubenswrapper[5120]: I0316 16:07:01.240556 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e80e8df3-88ad-4789-89af-38d912522931" containerName="registry-server" Mar 16 16:07:01 crc kubenswrapper[5120]: I0316 16:07:01.240664 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e80e8df3-88ad-4789-89af-38d912522931" containerName="registry-server" Mar 16 16:07:01 crc kubenswrapper[5120]: I0316 16:07:01.240674 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="74a0eab3-79e7-4265-a1af-65f659f3f91d" containerName="storage" Mar 16 16:07:01 crc kubenswrapper[5120]: I0316 16:07:01.282510 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 16:07:01 crc kubenswrapper[5120]: I0316 16:07:01.282740 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:07:01 crc kubenswrapper[5120]: I0316 16:07:01.285000 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-rabbitmq-svc\"" Mar 16 16:07:01 crc kubenswrapper[5120]: I0316 16:07:01.285737 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-config-data\"" Mar 16 16:07:01 crc kubenswrapper[5120]: I0316 16:07:01.286429 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-plugins-conf\"" Mar 16 16:07:01 crc kubenswrapper[5120]: I0316 16:07:01.286824 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-default-user\"" Mar 16 16:07:01 crc kubenswrapper[5120]: I0316 16:07:01.286843 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-server-conf\"" Mar 16 16:07:01 crc kubenswrapper[5120]: I0316 16:07:01.286890 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-server-dockercfg-hds7n\"" Mar 16 16:07:01 crc kubenswrapper[5120]: I0316 16:07:01.286981 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-erlang-cookie\"" Mar 16 16:07:01 crc kubenswrapper[5120]: I0316 16:07:01.385877 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab-pod-info\") pod \"rabbitmq-server-0\" (UID: \"ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:07:01 crc kubenswrapper[5120]: I0316 16:07:01.386399 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:07:01 crc kubenswrapper[5120]: I0316 16:07:01.386487 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"rabbitmq-server-0\" (UID: \"ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:07:01 crc kubenswrapper[5120]: I0316 16:07:01.386522 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab-config-data\") pod \"rabbitmq-server-0\" (UID: \"ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:07:01 crc kubenswrapper[5120]: I0316 16:07:01.386555 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:07:01 crc kubenswrapper[5120]: I0316 16:07:01.386594 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:07:01 crc kubenswrapper[5120]: I0316 16:07:01.386650 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab-server-conf\") pod \"rabbitmq-server-0\" (UID: \"ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:07:01 crc kubenswrapper[5120]: I0316 16:07:01.386720 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:07:01 crc kubenswrapper[5120]: I0316 16:07:01.386821 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:07:01 crc kubenswrapper[5120]: I0316 16:07:01.386901 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vz574\" (UniqueName: \"kubernetes.io/projected/ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab-kube-api-access-vz574\") pod \"rabbitmq-server-0\" (UID: \"ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:07:01 crc kubenswrapper[5120]: I0316 16:07:01.387009 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab-rabbitmq-tls\") pod \"rabbitmq-server-0\" (UID: \"ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:07:01 crc kubenswrapper[5120]: I0316 16:07:01.488865 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vz574\" (UniqueName: \"kubernetes.io/projected/ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab-kube-api-access-vz574\") pod \"rabbitmq-server-0\" (UID: \"ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:07:01 crc kubenswrapper[5120]: I0316 16:07:01.488992 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab-rabbitmq-tls\") pod \"rabbitmq-server-0\" (UID: \"ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:07:01 crc kubenswrapper[5120]: I0316 16:07:01.489173 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab-pod-info\") pod \"rabbitmq-server-0\" (UID: \"ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:07:01 crc kubenswrapper[5120]: I0316 16:07:01.490098 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:07:01 crc kubenswrapper[5120]: I0316 16:07:01.490234 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"rabbitmq-server-0\" (UID: \"ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:07:01 crc kubenswrapper[5120]: I0316 16:07:01.490273 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab-config-data\") pod \"rabbitmq-server-0\" (UID: \"ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:07:01 crc kubenswrapper[5120]: I0316 16:07:01.490305 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:07:01 crc kubenswrapper[5120]: I0316 16:07:01.490341 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:07:01 crc kubenswrapper[5120]: I0316 16:07:01.490467 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab-server-conf\") pod \"rabbitmq-server-0\" (UID: \"ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:07:01 crc kubenswrapper[5120]: I0316 16:07:01.490523 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:07:01 crc kubenswrapper[5120]: I0316 16:07:01.490548 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:07:01 crc kubenswrapper[5120]: I0316 16:07:01.490883 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"rabbitmq-server-0\" (UID: \"ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab\") device mount path \"/mnt/openstack/pv03\"" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:07:01 crc kubenswrapper[5120]: I0316 16:07:01.491571 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:07:01 crc kubenswrapper[5120]: I0316 16:07:01.491626 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab-config-data\") pod \"rabbitmq-server-0\" (UID: \"ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:07:01 crc kubenswrapper[5120]: I0316 16:07:01.491649 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:07:01 crc kubenswrapper[5120]: I0316 16:07:01.492176 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:07:01 crc kubenswrapper[5120]: I0316 16:07:01.493376 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab-server-conf\") pod \"rabbitmq-server-0\" (UID: \"ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:07:01 crc kubenswrapper[5120]: I0316 16:07:01.506196 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:07:01 crc kubenswrapper[5120]: I0316 16:07:01.506998 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab-pod-info\") pod \"rabbitmq-server-0\" (UID: \"ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:07:01 crc kubenswrapper[5120]: I0316 16:07:01.507811 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:07:01 crc kubenswrapper[5120]: I0316 16:07:01.508602 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab-rabbitmq-tls\") pod \"rabbitmq-server-0\" (UID: \"ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:07:01 crc kubenswrapper[5120]: I0316 16:07:01.532136 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vz574\" (UniqueName: \"kubernetes.io/projected/ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab-kube-api-access-vz574\") pod \"rabbitmq-server-0\" (UID: \"ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:07:01 crc kubenswrapper[5120]: I0316 16:07:01.533088 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 16:07:01 crc kubenswrapper[5120]: I0316 16:07:01.545523 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"rabbitmq-server-0\" (UID: \"ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:07:01 crc kubenswrapper[5120]: I0316 16:07:01.545824 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 16:07:01 crc kubenswrapper[5120]: I0316 16:07:01.546038 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:07:01 crc kubenswrapper[5120]: I0316 16:07:01.553707 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-cell1-config-data\"" Mar 16 16:07:01 crc kubenswrapper[5120]: I0316 16:07:01.554002 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-cell1-erlang-cookie\"" Mar 16 16:07:01 crc kubenswrapper[5120]: I0316 16:07:01.554523 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-cell1-plugins-conf\"" Mar 16 16:07:01 crc kubenswrapper[5120]: I0316 16:07:01.555113 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-cell1-server-conf\"" Mar 16 16:07:01 crc kubenswrapper[5120]: I0316 16:07:01.559588 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-rabbitmq-cell1-svc\"" Mar 16 16:07:01 crc kubenswrapper[5120]: I0316 16:07:01.559869 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-cell1-server-dockercfg-hrl4l\"" Mar 16 16:07:01 crc kubenswrapper[5120]: I0316 16:07:01.562593 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-cell1-default-user\"" Mar 16 16:07:01 crc kubenswrapper[5120]: I0316 16:07:01.605384 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:07:01 crc kubenswrapper[5120]: I0316 16:07:01.693334 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a-config-data\") pod \"rabbitmq-cell1-server-0\" (UID: \"de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:07:01 crc kubenswrapper[5120]: I0316 16:07:01.693387 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:07:01 crc kubenswrapper[5120]: I0316 16:07:01.693419 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a-rabbitmq-confd\") pod \"rabbitmq-cell1-server-0\" (UID: \"de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:07:01 crc kubenswrapper[5120]: I0316 16:07:01.693438 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a-pod-info\") pod \"rabbitmq-cell1-server-0\" (UID: \"de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:07:01 crc kubenswrapper[5120]: I0316 16:07:01.693456 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a-plugins-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:07:01 crc kubenswrapper[5120]: I0316 16:07:01.693490 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a-rabbitmq-tls\") pod \"rabbitmq-cell1-server-0\" (UID: \"de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:07:01 crc kubenswrapper[5120]: I0316 16:07:01.693516 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22p8p\" (UniqueName: \"kubernetes.io/projected/de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a-kube-api-access-22p8p\") pod \"rabbitmq-cell1-server-0\" (UID: \"de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:07:01 crc kubenswrapper[5120]: I0316 16:07:01.693590 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a-erlang-cookie-secret\") pod \"rabbitmq-cell1-server-0\" (UID: \"de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:07:01 crc kubenswrapper[5120]: I0316 16:07:01.693619 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a-server-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:07:01 crc kubenswrapper[5120]: I0316 16:07:01.693658 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a-rabbitmq-erlang-cookie\") pod \"rabbitmq-cell1-server-0\" (UID: \"de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:07:01 crc kubenswrapper[5120]: I0316 16:07:01.693674 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a-rabbitmq-plugins\") pod \"rabbitmq-cell1-server-0\" (UID: \"de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:07:01 crc kubenswrapper[5120]: I0316 16:07:01.795315 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:07:01 crc kubenswrapper[5120]: I0316 16:07:01.796494 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a-rabbitmq-confd\") pod \"rabbitmq-cell1-server-0\" (UID: \"de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:07:01 crc kubenswrapper[5120]: I0316 16:07:01.796868 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a-pod-info\") pod \"rabbitmq-cell1-server-0\" (UID: \"de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:07:01 crc kubenswrapper[5120]: I0316 16:07:01.796902 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a-plugins-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:07:01 crc kubenswrapper[5120]: I0316 16:07:01.797052 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a-rabbitmq-tls\") pod \"rabbitmq-cell1-server-0\" (UID: \"de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:07:01 crc kubenswrapper[5120]: I0316 16:07:01.797193 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-22p8p\" (UniqueName: \"kubernetes.io/projected/de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a-kube-api-access-22p8p\") pod \"rabbitmq-cell1-server-0\" (UID: \"de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:07:01 crc kubenswrapper[5120]: I0316 16:07:01.797492 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a-erlang-cookie-secret\") pod \"rabbitmq-cell1-server-0\" (UID: \"de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:07:01 crc kubenswrapper[5120]: I0316 16:07:01.797643 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a-server-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:07:01 crc kubenswrapper[5120]: I0316 16:07:01.797797 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a-rabbitmq-erlang-cookie\") pod \"rabbitmq-cell1-server-0\" (UID: \"de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:07:01 crc kubenswrapper[5120]: I0316 16:07:01.797824 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a-rabbitmq-plugins\") pod \"rabbitmq-cell1-server-0\" (UID: \"de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:07:01 crc kubenswrapper[5120]: I0316 16:07:01.798083 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a-config-data\") pod \"rabbitmq-cell1-server-0\" (UID: \"de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:07:01 crc kubenswrapper[5120]: I0316 16:07:01.796232 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a\") device mount path \"/mnt/openstack/pv04\"" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:07:01 crc kubenswrapper[5120]: I0316 16:07:01.802182 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a-config-data\") pod \"rabbitmq-cell1-server-0\" (UID: \"de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:07:01 crc kubenswrapper[5120]: I0316 16:07:01.808381 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a-plugins-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:07:01 crc kubenswrapper[5120]: I0316 16:07:01.808595 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a-server-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:07:01 crc kubenswrapper[5120]: I0316 16:07:01.808989 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a-rabbitmq-erlang-cookie\") pod \"rabbitmq-cell1-server-0\" (UID: \"de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:07:01 crc kubenswrapper[5120]: I0316 16:07:01.809265 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a-rabbitmq-plugins\") pod \"rabbitmq-cell1-server-0\" (UID: \"de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:07:01 crc kubenswrapper[5120]: I0316 16:07:01.817267 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a-pod-info\") pod \"rabbitmq-cell1-server-0\" (UID: \"de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:07:01 crc kubenswrapper[5120]: I0316 16:07:01.817281 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a-erlang-cookie-secret\") pod \"rabbitmq-cell1-server-0\" (UID: \"de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:07:01 crc kubenswrapper[5120]: I0316 16:07:01.820251 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a-rabbitmq-tls\") pod \"rabbitmq-cell1-server-0\" (UID: \"de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:07:01 crc kubenswrapper[5120]: I0316 16:07:01.822677 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-22p8p\" (UniqueName: \"kubernetes.io/projected/de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a-kube-api-access-22p8p\") pod \"rabbitmq-cell1-server-0\" (UID: \"de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:07:01 crc kubenswrapper[5120]: I0316 16:07:01.825718 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a-rabbitmq-confd\") pod \"rabbitmq-cell1-server-0\" (UID: \"de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:07:01 crc kubenswrapper[5120]: I0316 16:07:01.829294 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:07:01 crc kubenswrapper[5120]: I0316 16:07:01.897277 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:07:02 crc kubenswrapper[5120]: I0316 16:07:02.116263 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 16:07:02 crc kubenswrapper[5120]: I0316 16:07:02.437570 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 16:07:02 crc kubenswrapper[5120]: W0316 16:07:02.449529 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde7d9d18_7bc7_4e3e_bf9a_eb2b54cf459a.slice/crio-299e30efddf37a965a735c3b82b811281659827b794fcfaea5d8f8370c8fd82b WatchSource:0}: Error finding container 299e30efddf37a965a735c3b82b811281659827b794fcfaea5d8f8370c8fd82b: Status 404 returned error can't find the container with id 299e30efddf37a965a735c3b82b811281659827b794fcfaea5d8f8370c8fd82b Mar 16 16:07:02 crc kubenswrapper[5120]: I0316 16:07:02.831685 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a","Type":"ContainerStarted","Data":"299e30efddf37a965a735c3b82b811281659827b794fcfaea5d8f8370c8fd82b"} Mar 16 16:07:02 crc kubenswrapper[5120]: I0316 16:07:02.834383 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab","Type":"ContainerStarted","Data":"4d9ca0da5a353326d763c24165b002eb0b3dcf27071b7c17395d81b54463d6d8"} Mar 16 16:07:03 crc kubenswrapper[5120]: I0316 16:07:03.013741 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 16:07:03 crc kubenswrapper[5120]: I0316 16:07:03.022910 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:07:03 crc kubenswrapper[5120]: I0316 16:07:03.025926 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-galera-openstack-svc\"" Mar 16 16:07:03 crc kubenswrapper[5120]: I0316 16:07:03.026506 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-config-data\"" Mar 16 16:07:03 crc kubenswrapper[5120]: I0316 16:07:03.026749 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"galera-openstack-dockercfg-dsmks\"" Mar 16 16:07:03 crc kubenswrapper[5120]: I0316 16:07:03.027468 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-scripts\"" Mar 16 16:07:03 crc kubenswrapper[5120]: I0316 16:07:03.030428 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 16:07:03 crc kubenswrapper[5120]: I0316 16:07:03.048803 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"combined-ca-bundle\"" Mar 16 16:07:03 crc kubenswrapper[5120]: I0316 16:07:03.119322 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage18-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") pod \"openstack-galera-0\" (UID: \"5c399606-817d-4a0f-b825-32da28e0491d\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:07:03 crc kubenswrapper[5120]: I0316 16:07:03.119369 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-969xw\" (UniqueName: \"kubernetes.io/projected/5c399606-817d-4a0f-b825-32da28e0491d-kube-api-access-969xw\") pod \"openstack-galera-0\" (UID: \"5c399606-817d-4a0f-b825-32da28e0491d\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:07:03 crc kubenswrapper[5120]: I0316 16:07:03.119399 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/5c399606-817d-4a0f-b825-32da28e0491d-kolla-config\") pod \"openstack-galera-0\" (UID: \"5c399606-817d-4a0f-b825-32da28e0491d\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:07:03 crc kubenswrapper[5120]: I0316 16:07:03.119451 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/5c399606-817d-4a0f-b825-32da28e0491d-config-data-default\") pod \"openstack-galera-0\" (UID: \"5c399606-817d-4a0f-b825-32da28e0491d\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:07:03 crc kubenswrapper[5120]: I0316 16:07:03.119470 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5c399606-817d-4a0f-b825-32da28e0491d-operator-scripts\") pod \"openstack-galera-0\" (UID: \"5c399606-817d-4a0f-b825-32da28e0491d\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:07:03 crc kubenswrapper[5120]: I0316 16:07:03.119592 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/5c399606-817d-4a0f-b825-32da28e0491d-config-data-generated\") pod \"openstack-galera-0\" (UID: \"5c399606-817d-4a0f-b825-32da28e0491d\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:07:03 crc kubenswrapper[5120]: I0316 16:07:03.119718 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/5c399606-817d-4a0f-b825-32da28e0491d-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"5c399606-817d-4a0f-b825-32da28e0491d\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:07:03 crc kubenswrapper[5120]: I0316 16:07:03.119946 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5c399606-817d-4a0f-b825-32da28e0491d-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"5c399606-817d-4a0f-b825-32da28e0491d\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:07:03 crc kubenswrapper[5120]: I0316 16:07:03.221491 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/5c399606-817d-4a0f-b825-32da28e0491d-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"5c399606-817d-4a0f-b825-32da28e0491d\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:07:03 crc kubenswrapper[5120]: I0316 16:07:03.221587 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5c399606-817d-4a0f-b825-32da28e0491d-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"5c399606-817d-4a0f-b825-32da28e0491d\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:07:03 crc kubenswrapper[5120]: I0316 16:07:03.221693 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage18-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") pod \"openstack-galera-0\" (UID: \"5c399606-817d-4a0f-b825-32da28e0491d\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:07:03 crc kubenswrapper[5120]: I0316 16:07:03.221723 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-969xw\" (UniqueName: \"kubernetes.io/projected/5c399606-817d-4a0f-b825-32da28e0491d-kube-api-access-969xw\") pod \"openstack-galera-0\" (UID: \"5c399606-817d-4a0f-b825-32da28e0491d\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:07:03 crc kubenswrapper[5120]: I0316 16:07:03.221775 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/5c399606-817d-4a0f-b825-32da28e0491d-kolla-config\") pod \"openstack-galera-0\" (UID: \"5c399606-817d-4a0f-b825-32da28e0491d\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:07:03 crc kubenswrapper[5120]: I0316 16:07:03.221845 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/5c399606-817d-4a0f-b825-32da28e0491d-config-data-default\") pod \"openstack-galera-0\" (UID: \"5c399606-817d-4a0f-b825-32da28e0491d\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:07:03 crc kubenswrapper[5120]: I0316 16:07:03.221868 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5c399606-817d-4a0f-b825-32da28e0491d-operator-scripts\") pod \"openstack-galera-0\" (UID: \"5c399606-817d-4a0f-b825-32da28e0491d\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:07:03 crc kubenswrapper[5120]: I0316 16:07:03.221890 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/5c399606-817d-4a0f-b825-32da28e0491d-config-data-generated\") pod \"openstack-galera-0\" (UID: \"5c399606-817d-4a0f-b825-32da28e0491d\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:07:03 crc kubenswrapper[5120]: I0316 16:07:03.222162 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage18-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") pod \"openstack-galera-0\" (UID: \"5c399606-817d-4a0f-b825-32da28e0491d\") device mount path \"/mnt/openstack/pv18\"" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:07:03 crc kubenswrapper[5120]: I0316 16:07:03.222357 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/5c399606-817d-4a0f-b825-32da28e0491d-config-data-generated\") pod \"openstack-galera-0\" (UID: \"5c399606-817d-4a0f-b825-32da28e0491d\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:07:03 crc kubenswrapper[5120]: I0316 16:07:03.223349 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/5c399606-817d-4a0f-b825-32da28e0491d-kolla-config\") pod \"openstack-galera-0\" (UID: \"5c399606-817d-4a0f-b825-32da28e0491d\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:07:03 crc kubenswrapper[5120]: I0316 16:07:03.224442 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5c399606-817d-4a0f-b825-32da28e0491d-operator-scripts\") pod \"openstack-galera-0\" (UID: \"5c399606-817d-4a0f-b825-32da28e0491d\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:07:03 crc kubenswrapper[5120]: I0316 16:07:03.224533 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/5c399606-817d-4a0f-b825-32da28e0491d-config-data-default\") pod \"openstack-galera-0\" (UID: \"5c399606-817d-4a0f-b825-32da28e0491d\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:07:03 crc kubenswrapper[5120]: I0316 16:07:03.299817 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5c399606-817d-4a0f-b825-32da28e0491d-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"5c399606-817d-4a0f-b825-32da28e0491d\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:07:03 crc kubenswrapper[5120]: I0316 16:07:03.299873 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-969xw\" (UniqueName: \"kubernetes.io/projected/5c399606-817d-4a0f-b825-32da28e0491d-kube-api-access-969xw\") pod \"openstack-galera-0\" (UID: \"5c399606-817d-4a0f-b825-32da28e0491d\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:07:03 crc kubenswrapper[5120]: I0316 16:07:03.299900 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/5c399606-817d-4a0f-b825-32da28e0491d-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"5c399606-817d-4a0f-b825-32da28e0491d\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:07:03 crc kubenswrapper[5120]: I0316 16:07:03.331595 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage18-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") pod \"openstack-galera-0\" (UID: \"5c399606-817d-4a0f-b825-32da28e0491d\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:07:03 crc kubenswrapper[5120]: I0316 16:07:03.357027 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:07:03 crc kubenswrapper[5120]: I0316 16:07:03.845965 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab","Type":"ContainerStarted","Data":"94de8c59b353553a4799b3d3ca3292a1d0b46fa43cd5dc0cd5e7d0974e74e3c0"} Mar 16 16:07:03 crc kubenswrapper[5120]: I0316 16:07:03.967792 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 16:07:03 crc kubenswrapper[5120]: W0316 16:07:03.971329 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5c399606_817d_4a0f_b825_32da28e0491d.slice/crio-01aab22ccca0bad0308acb318e107af8543b55c48bebaa3b6634b1ff4ce67831 WatchSource:0}: Error finding container 01aab22ccca0bad0308acb318e107af8543b55c48bebaa3b6634b1ff4ce67831: Status 404 returned error can't find the container with id 01aab22ccca0bad0308acb318e107af8543b55c48bebaa3b6634b1ff4ce67831 Mar 16 16:07:04 crc kubenswrapper[5120]: I0316 16:07:04.400849 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 16:07:04 crc kubenswrapper[5120]: I0316 16:07:04.409710 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:07:04 crc kubenswrapper[5120]: I0316 16:07:04.412364 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"galera-openstack-cell1-dockercfg-77k5f\"" Mar 16 16:07:04 crc kubenswrapper[5120]: I0316 16:07:04.412833 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-galera-openstack-cell1-svc\"" Mar 16 16:07:04 crc kubenswrapper[5120]: I0316 16:07:04.416315 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-cell1-scripts\"" Mar 16 16:07:04 crc kubenswrapper[5120]: I0316 16:07:04.421069 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-cell1-config-data\"" Mar 16 16:07:04 crc kubenswrapper[5120]: I0316 16:07:04.422736 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 16:07:04 crc kubenswrapper[5120]: I0316 16:07:04.548594 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/eb50beed-fd12-4d73-95bf-413136771ffe-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"eb50beed-fd12-4d73-95bf-413136771ffe\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:07:04 crc kubenswrapper[5120]: I0316 16:07:04.548960 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/eb50beed-fd12-4d73-95bf-413136771ffe-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"eb50beed-fd12-4d73-95bf-413136771ffe\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:07:04 crc kubenswrapper[5120]: I0316 16:07:04.549036 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/eb50beed-fd12-4d73-95bf-413136771ffe-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"eb50beed-fd12-4d73-95bf-413136771ffe\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:07:04 crc kubenswrapper[5120]: I0316 16:07:04.549116 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/eb50beed-fd12-4d73-95bf-413136771ffe-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"eb50beed-fd12-4d73-95bf-413136771ffe\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:07:04 crc kubenswrapper[5120]: I0316 16:07:04.549165 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"openstack-cell1-galera-0\" (UID: \"eb50beed-fd12-4d73-95bf-413136771ffe\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:07:04 crc kubenswrapper[5120]: I0316 16:07:04.549189 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eb50beed-fd12-4d73-95bf-413136771ffe-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"eb50beed-fd12-4d73-95bf-413136771ffe\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:07:04 crc kubenswrapper[5120]: I0316 16:07:04.549242 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbvr7\" (UniqueName: \"kubernetes.io/projected/eb50beed-fd12-4d73-95bf-413136771ffe-kube-api-access-dbvr7\") pod \"openstack-cell1-galera-0\" (UID: \"eb50beed-fd12-4d73-95bf-413136771ffe\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:07:04 crc kubenswrapper[5120]: I0316 16:07:04.549269 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/eb50beed-fd12-4d73-95bf-413136771ffe-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"eb50beed-fd12-4d73-95bf-413136771ffe\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:07:04 crc kubenswrapper[5120]: I0316 16:07:04.653962 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/eb50beed-fd12-4d73-95bf-413136771ffe-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"eb50beed-fd12-4d73-95bf-413136771ffe\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:07:04 crc kubenswrapper[5120]: I0316 16:07:04.654111 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/eb50beed-fd12-4d73-95bf-413136771ffe-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"eb50beed-fd12-4d73-95bf-413136771ffe\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:07:04 crc kubenswrapper[5120]: I0316 16:07:04.654206 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/eb50beed-fd12-4d73-95bf-413136771ffe-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"eb50beed-fd12-4d73-95bf-413136771ffe\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:07:04 crc kubenswrapper[5120]: I0316 16:07:04.654268 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/eb50beed-fd12-4d73-95bf-413136771ffe-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"eb50beed-fd12-4d73-95bf-413136771ffe\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:07:04 crc kubenswrapper[5120]: I0316 16:07:04.654306 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"openstack-cell1-galera-0\" (UID: \"eb50beed-fd12-4d73-95bf-413136771ffe\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:07:04 crc kubenswrapper[5120]: I0316 16:07:04.654330 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eb50beed-fd12-4d73-95bf-413136771ffe-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"eb50beed-fd12-4d73-95bf-413136771ffe\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:07:04 crc kubenswrapper[5120]: I0316 16:07:04.654391 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dbvr7\" (UniqueName: \"kubernetes.io/projected/eb50beed-fd12-4d73-95bf-413136771ffe-kube-api-access-dbvr7\") pod \"openstack-cell1-galera-0\" (UID: \"eb50beed-fd12-4d73-95bf-413136771ffe\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:07:04 crc kubenswrapper[5120]: I0316 16:07:04.654586 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/eb50beed-fd12-4d73-95bf-413136771ffe-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"eb50beed-fd12-4d73-95bf-413136771ffe\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:07:04 crc kubenswrapper[5120]: I0316 16:07:04.654646 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/eb50beed-fd12-4d73-95bf-413136771ffe-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"eb50beed-fd12-4d73-95bf-413136771ffe\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:07:04 crc kubenswrapper[5120]: I0316 16:07:04.654789 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"openstack-cell1-galera-0\" (UID: \"eb50beed-fd12-4d73-95bf-413136771ffe\") device mount path \"/mnt/openstack/pv10\"" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:07:04 crc kubenswrapper[5120]: I0316 16:07:04.654966 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/eb50beed-fd12-4d73-95bf-413136771ffe-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"eb50beed-fd12-4d73-95bf-413136771ffe\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:07:04 crc kubenswrapper[5120]: I0316 16:07:04.654993 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/eb50beed-fd12-4d73-95bf-413136771ffe-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"eb50beed-fd12-4d73-95bf-413136771ffe\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:07:04 crc kubenswrapper[5120]: I0316 16:07:04.657102 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/eb50beed-fd12-4d73-95bf-413136771ffe-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"eb50beed-fd12-4d73-95bf-413136771ffe\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:07:04 crc kubenswrapper[5120]: I0316 16:07:04.661114 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 16:07:04 crc kubenswrapper[5120]: I0316 16:07:04.670179 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eb50beed-fd12-4d73-95bf-413136771ffe-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"eb50beed-fd12-4d73-95bf-413136771ffe\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:07:04 crc kubenswrapper[5120]: I0316 16:07:04.671554 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Mar 16 16:07:04 crc kubenswrapper[5120]: I0316 16:07:04.674603 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"memcached-memcached-dockercfg-h5z2v\"" Mar 16 16:07:04 crc kubenswrapper[5120]: I0316 16:07:04.674782 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-memcached-svc\"" Mar 16 16:07:04 crc kubenswrapper[5120]: I0316 16:07:04.674876 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"memcached-config-data\"" Mar 16 16:07:04 crc kubenswrapper[5120]: I0316 16:07:04.679895 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"openstack-cell1-galera-0\" (UID: \"eb50beed-fd12-4d73-95bf-413136771ffe\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:07:04 crc kubenswrapper[5120]: I0316 16:07:04.681600 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbvr7\" (UniqueName: \"kubernetes.io/projected/eb50beed-fd12-4d73-95bf-413136771ffe-kube-api-access-dbvr7\") pod \"openstack-cell1-galera-0\" (UID: \"eb50beed-fd12-4d73-95bf-413136771ffe\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:07:04 crc kubenswrapper[5120]: I0316 16:07:04.718044 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/eb50beed-fd12-4d73-95bf-413136771ffe-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"eb50beed-fd12-4d73-95bf-413136771ffe\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:07:04 crc kubenswrapper[5120]: I0316 16:07:04.722581 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 16:07:04 crc kubenswrapper[5120]: I0316 16:07:04.746447 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:07:04 crc kubenswrapper[5120]: I0316 16:07:04.755708 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tc44g\" (UniqueName: \"kubernetes.io/projected/5470c9e3-c2c2-4294-965d-cd4ff001bd74-kube-api-access-tc44g\") pod \"memcached-0\" (UID: \"5470c9e3-c2c2-4294-965d-cd4ff001bd74\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:07:04 crc kubenswrapper[5120]: I0316 16:07:04.755792 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/5470c9e3-c2c2-4294-965d-cd4ff001bd74-config-data\") pod \"memcached-0\" (UID: \"5470c9e3-c2c2-4294-965d-cd4ff001bd74\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:07:04 crc kubenswrapper[5120]: I0316 16:07:04.755967 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5470c9e3-c2c2-4294-965d-cd4ff001bd74-combined-ca-bundle\") pod \"memcached-0\" (UID: \"5470c9e3-c2c2-4294-965d-cd4ff001bd74\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:07:04 crc kubenswrapper[5120]: I0316 16:07:04.756052 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/5470c9e3-c2c2-4294-965d-cd4ff001bd74-kolla-config\") pod \"memcached-0\" (UID: \"5470c9e3-c2c2-4294-965d-cd4ff001bd74\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:07:04 crc kubenswrapper[5120]: I0316 16:07:04.756228 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/5470c9e3-c2c2-4294-965d-cd4ff001bd74-memcached-tls-certs\") pod \"memcached-0\" (UID: \"5470c9e3-c2c2-4294-965d-cd4ff001bd74\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:07:04 crc kubenswrapper[5120]: I0316 16:07:04.858209 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tc44g\" (UniqueName: \"kubernetes.io/projected/5470c9e3-c2c2-4294-965d-cd4ff001bd74-kube-api-access-tc44g\") pod \"memcached-0\" (UID: \"5470c9e3-c2c2-4294-965d-cd4ff001bd74\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:07:04 crc kubenswrapper[5120]: I0316 16:07:04.858333 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/5470c9e3-c2c2-4294-965d-cd4ff001bd74-config-data\") pod \"memcached-0\" (UID: \"5470c9e3-c2c2-4294-965d-cd4ff001bd74\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:07:04 crc kubenswrapper[5120]: I0316 16:07:04.858431 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5470c9e3-c2c2-4294-965d-cd4ff001bd74-combined-ca-bundle\") pod \"memcached-0\" (UID: \"5470c9e3-c2c2-4294-965d-cd4ff001bd74\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:07:04 crc kubenswrapper[5120]: I0316 16:07:04.858505 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/5470c9e3-c2c2-4294-965d-cd4ff001bd74-kolla-config\") pod \"memcached-0\" (UID: \"5470c9e3-c2c2-4294-965d-cd4ff001bd74\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:07:04 crc kubenswrapper[5120]: I0316 16:07:04.858819 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/5470c9e3-c2c2-4294-965d-cd4ff001bd74-memcached-tls-certs\") pod \"memcached-0\" (UID: \"5470c9e3-c2c2-4294-965d-cd4ff001bd74\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:07:04 crc kubenswrapper[5120]: I0316 16:07:04.862043 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/5470c9e3-c2c2-4294-965d-cd4ff001bd74-kolla-config\") pod \"memcached-0\" (UID: \"5470c9e3-c2c2-4294-965d-cd4ff001bd74\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:07:04 crc kubenswrapper[5120]: I0316 16:07:04.862624 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/5470c9e3-c2c2-4294-965d-cd4ff001bd74-config-data\") pod \"memcached-0\" (UID: \"5470c9e3-c2c2-4294-965d-cd4ff001bd74\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:07:04 crc kubenswrapper[5120]: I0316 16:07:04.868950 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5470c9e3-c2c2-4294-965d-cd4ff001bd74-combined-ca-bundle\") pod \"memcached-0\" (UID: \"5470c9e3-c2c2-4294-965d-cd4ff001bd74\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:07:04 crc kubenswrapper[5120]: I0316 16:07:04.871138 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a","Type":"ContainerStarted","Data":"7d286781c85f27264a622c02590c76a23cfac9e679af6dc9a77a928f3e408dea"} Mar 16 16:07:04 crc kubenswrapper[5120]: I0316 16:07:04.871320 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/5470c9e3-c2c2-4294-965d-cd4ff001bd74-memcached-tls-certs\") pod \"memcached-0\" (UID: \"5470c9e3-c2c2-4294-965d-cd4ff001bd74\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:07:04 crc kubenswrapper[5120]: I0316 16:07:04.874837 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"5c399606-817d-4a0f-b825-32da28e0491d","Type":"ContainerStarted","Data":"cc5cd79d70b57118af25946cd4885eb3eb4823950f2fdde38bb1f744bfd87e5c"} Mar 16 16:07:04 crc kubenswrapper[5120]: I0316 16:07:04.874883 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"5c399606-817d-4a0f-b825-32da28e0491d","Type":"ContainerStarted","Data":"01aab22ccca0bad0308acb318e107af8543b55c48bebaa3b6634b1ff4ce67831"} Mar 16 16:07:04 crc kubenswrapper[5120]: I0316 16:07:04.892341 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tc44g\" (UniqueName: \"kubernetes.io/projected/5470c9e3-c2c2-4294-965d-cd4ff001bd74-kube-api-access-tc44g\") pod \"memcached-0\" (UID: \"5470c9e3-c2c2-4294-965d-cd4ff001bd74\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:07:05 crc kubenswrapper[5120]: I0316 16:07:05.068541 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Mar 16 16:07:05 crc kubenswrapper[5120]: I0316 16:07:05.250012 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 16:07:05 crc kubenswrapper[5120]: W0316 16:07:05.257784 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podeb50beed_fd12_4d73_95bf_413136771ffe.slice/crio-968484ffe3bd17ff19831a7b31b8f05fc70ab08bba227b25e768591a477eeb06 WatchSource:0}: Error finding container 968484ffe3bd17ff19831a7b31b8f05fc70ab08bba227b25e768591a477eeb06: Status 404 returned error can't find the container with id 968484ffe3bd17ff19831a7b31b8f05fc70ab08bba227b25e768591a477eeb06 Mar 16 16:07:05 crc kubenswrapper[5120]: I0316 16:07:05.530477 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 16:07:05 crc kubenswrapper[5120]: W0316 16:07:05.539315 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5470c9e3_c2c2_4294_965d_cd4ff001bd74.slice/crio-8d8bd9b5a8840e5148c09e8fa040d8a3763f13bfcf2fbdb1bb1800ef94705781 WatchSource:0}: Error finding container 8d8bd9b5a8840e5148c09e8fa040d8a3763f13bfcf2fbdb1bb1800ef94705781: Status 404 returned error can't find the container with id 8d8bd9b5a8840e5148c09e8fa040d8a3763f13bfcf2fbdb1bb1800ef94705781 Mar 16 16:07:05 crc kubenswrapper[5120]: I0316 16:07:05.883255 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"eb50beed-fd12-4d73-95bf-413136771ffe","Type":"ContainerStarted","Data":"2f5d8ac15fe5ec385cbfccabc9556cca7be517f04a77ef070196a2ea5889aa9e"} Mar 16 16:07:05 crc kubenswrapper[5120]: I0316 16:07:05.883302 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"eb50beed-fd12-4d73-95bf-413136771ffe","Type":"ContainerStarted","Data":"968484ffe3bd17ff19831a7b31b8f05fc70ab08bba227b25e768591a477eeb06"} Mar 16 16:07:05 crc kubenswrapper[5120]: I0316 16:07:05.885945 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"5470c9e3-c2c2-4294-965d-cd4ff001bd74","Type":"ContainerStarted","Data":"db98eab7a6f5d3b89669ca8e4686fdae14940910f34a7a25a27dbe1450d84302"} Mar 16 16:07:05 crc kubenswrapper[5120]: I0316 16:07:05.885992 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"5470c9e3-c2c2-4294-965d-cd4ff001bd74","Type":"ContainerStarted","Data":"8d8bd9b5a8840e5148c09e8fa040d8a3763f13bfcf2fbdb1bb1800ef94705781"} Mar 16 16:07:05 crc kubenswrapper[5120]: I0316 16:07:05.886032 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/memcached-0" Mar 16 16:07:05 crc kubenswrapper[5120]: I0316 16:07:05.939152 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/memcached-0" podStartSLOduration=1.939124173 podStartE2EDuration="1.939124173s" podCreationTimestamp="2026-03-16 16:07:04 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:07:05.929299385 +0000 UTC m=+2128.083231062" watchObservedRunningTime="2026-03-16 16:07:05.939124173 +0000 UTC m=+2128.093055850" Mar 16 16:07:06 crc kubenswrapper[5120]: I0316 16:07:06.975213 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 16:07:06 crc kubenswrapper[5120]: I0316 16:07:06.979660 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:07:06 crc kubenswrapper[5120]: I0316 16:07:06.981103 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"telemetry-ceilometer-dockercfg-n9fhj\"" Mar 16 16:07:07 crc kubenswrapper[5120]: I0316 16:07:07.006073 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 16:07:07 crc kubenswrapper[5120]: I0316 16:07:07.021718 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8ndm\" (UniqueName: \"kubernetes.io/projected/b7839695-f936-4b0c-909c-aa19e16c6ebb-kube-api-access-h8ndm\") pod \"kube-state-metrics-0\" (UID: \"b7839695-f936-4b0c-909c-aa19e16c6ebb\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:07:07 crc kubenswrapper[5120]: I0316 16:07:07.123785 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h8ndm\" (UniqueName: \"kubernetes.io/projected/b7839695-f936-4b0c-909c-aa19e16c6ebb-kube-api-access-h8ndm\") pod \"kube-state-metrics-0\" (UID: \"b7839695-f936-4b0c-909c-aa19e16c6ebb\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:07:07 crc kubenswrapper[5120]: I0316 16:07:07.152000 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8ndm\" (UniqueName: \"kubernetes.io/projected/b7839695-f936-4b0c-909c-aa19e16c6ebb-kube-api-access-h8ndm\") pod \"kube-state-metrics-0\" (UID: \"b7839695-f936-4b0c-909c-aa19e16c6ebb\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:07:07 crc kubenswrapper[5120]: I0316 16:07:07.295458 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:07:07 crc kubenswrapper[5120]: I0316 16:07:07.726308 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 16:07:07 crc kubenswrapper[5120]: W0316 16:07:07.735007 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb7839695_f936_4b0c_909c_aa19e16c6ebb.slice/crio-c92c7deb4388b11f60ce7eb5afdfc926d859e194d62eeb6235ca83232d5745d3 WatchSource:0}: Error finding container c92c7deb4388b11f60ce7eb5afdfc926d859e194d62eeb6235ca83232d5745d3: Status 404 returned error can't find the container with id c92c7deb4388b11f60ce7eb5afdfc926d859e194d62eeb6235ca83232d5745d3 Mar 16 16:07:07 crc kubenswrapper[5120]: I0316 16:07:07.903867 5120 generic.go:358] "Generic (PLEG): container finished" podID="5c399606-817d-4a0f-b825-32da28e0491d" containerID="cc5cd79d70b57118af25946cd4885eb3eb4823950f2fdde38bb1f744bfd87e5c" exitCode=0 Mar 16 16:07:07 crc kubenswrapper[5120]: I0316 16:07:07.904112 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"5c399606-817d-4a0f-b825-32da28e0491d","Type":"ContainerDied","Data":"cc5cd79d70b57118af25946cd4885eb3eb4823950f2fdde38bb1f744bfd87e5c"} Mar 16 16:07:07 crc kubenswrapper[5120]: I0316 16:07:07.905349 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"b7839695-f936-4b0c-909c-aa19e16c6ebb","Type":"ContainerStarted","Data":"c92c7deb4388b11f60ce7eb5afdfc926d859e194d62eeb6235ca83232d5745d3"} Mar 16 16:07:08 crc kubenswrapper[5120]: E0316 16:07:08.217851 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1303680 actualBytes=10240 Mar 16 16:07:08 crc kubenswrapper[5120]: I0316 16:07:08.943597 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"5c399606-817d-4a0f-b825-32da28e0491d","Type":"ContainerStarted","Data":"3b654e2f92586de226638d5cb91d375853baa73355cb33331d422696f899d8b5"} Mar 16 16:07:08 crc kubenswrapper[5120]: I0316 16:07:08.947954 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"b7839695-f936-4b0c-909c-aa19e16c6ebb","Type":"ContainerStarted","Data":"ea51e0a060ac414286f1637c4d50f53f836fd7917f38e080aa0ee279011f9d1a"} Mar 16 16:07:08 crc kubenswrapper[5120]: I0316 16:07:08.948085 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:07:08 crc kubenswrapper[5120]: I0316 16:07:08.950242 5120 generic.go:358] "Generic (PLEG): container finished" podID="eb50beed-fd12-4d73-95bf-413136771ffe" containerID="2f5d8ac15fe5ec385cbfccabc9556cca7be517f04a77ef070196a2ea5889aa9e" exitCode=0 Mar 16 16:07:08 crc kubenswrapper[5120]: I0316 16:07:08.950309 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"eb50beed-fd12-4d73-95bf-413136771ffe","Type":"ContainerDied","Data":"2f5d8ac15fe5ec385cbfccabc9556cca7be517f04a77ef070196a2ea5889aa9e"} Mar 16 16:07:08 crc kubenswrapper[5120]: I0316 16:07:08.972685 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstack-galera-0" podStartSLOduration=7.972663044 podStartE2EDuration="7.972663044s" podCreationTimestamp="2026-03-16 16:07:01 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:07:08.966185018 +0000 UTC m=+2131.120116675" watchObservedRunningTime="2026-03-16 16:07:08.972663044 +0000 UTC m=+2131.126594701" Mar 16 16:07:09 crc kubenswrapper[5120]: I0316 16:07:09.029319 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/kube-state-metrics-0" podStartSLOduration=2.632635076 podStartE2EDuration="3.02930219s" podCreationTimestamp="2026-03-16 16:07:06 +0000 UTC" firstStartedPulling="2026-03-16 16:07:07.736146805 +0000 UTC m=+2129.890078462" lastFinishedPulling="2026-03-16 16:07:08.132813919 +0000 UTC m=+2130.286745576" observedRunningTime="2026-03-16 16:07:09.025236729 +0000 UTC m=+2131.179168386" watchObservedRunningTime="2026-03-16 16:07:09.02930219 +0000 UTC m=+2131.183233847" Mar 16 16:07:09 crc kubenswrapper[5120]: I0316 16:07:09.960477 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"eb50beed-fd12-4d73-95bf-413136771ffe","Type":"ContainerStarted","Data":"c29df80bfa19e245cc53b93fec1d5af2a0b82a317df54724fdc00fcaf211edf5"} Mar 16 16:07:09 crc kubenswrapper[5120]: I0316 16:07:09.988991 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstack-cell1-galera-0" podStartSLOduration=6.988960884 podStartE2EDuration="6.988960884s" podCreationTimestamp="2026-03-16 16:07:03 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:07:09.982835168 +0000 UTC m=+2132.136766865" watchObservedRunningTime="2026-03-16 16:07:09.988960884 +0000 UTC m=+2132.142892581" Mar 16 16:07:11 crc kubenswrapper[5120]: I0316 16:07:11.893905 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/memcached-0" Mar 16 16:07:12 crc kubenswrapper[5120]: I0316 16:07:12.220891 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 16:07:12 crc kubenswrapper[5120]: I0316 16:07:12.227004 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:07:12 crc kubenswrapper[5120]: I0316 16:07:12.229586 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ovn-metrics\"" Mar 16 16:07:12 crc kubenswrapper[5120]: I0316 16:07:12.230422 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovndbcluster-nb-scripts\"" Mar 16 16:07:12 crc kubenswrapper[5120]: I0316 16:07:12.230643 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ovndbcluster-nb-ovndbs\"" Mar 16 16:07:12 crc kubenswrapper[5120]: I0316 16:07:12.235316 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ovncluster-ovndbcluster-nb-dockercfg-brddr\"" Mar 16 16:07:12 crc kubenswrapper[5120]: I0316 16:07:12.235567 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovndbcluster-nb-config\"" Mar 16 16:07:12 crc kubenswrapper[5120]: I0316 16:07:12.236175 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 16:07:12 crc kubenswrapper[5120]: I0316 16:07:12.333606 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/30d44474-74de-4982-8e48-31038a50607f-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"30d44474-74de-4982-8e48-31038a50607f\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:07:12 crc kubenswrapper[5120]: I0316 16:07:12.333752 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5gm2\" (UniqueName: \"kubernetes.io/projected/30d44474-74de-4982-8e48-31038a50607f-kube-api-access-h5gm2\") pod \"ovsdbserver-nb-0\" (UID: \"30d44474-74de-4982-8e48-31038a50607f\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:07:12 crc kubenswrapper[5120]: I0316 16:07:12.333927 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/30d44474-74de-4982-8e48-31038a50607f-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"30d44474-74de-4982-8e48-31038a50607f\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:07:12 crc kubenswrapper[5120]: I0316 16:07:12.333980 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/30d44474-74de-4982-8e48-31038a50607f-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"30d44474-74de-4982-8e48-31038a50607f\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:07:12 crc kubenswrapper[5120]: I0316 16:07:12.334228 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/30d44474-74de-4982-8e48-31038a50607f-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"30d44474-74de-4982-8e48-31038a50607f\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:07:12 crc kubenswrapper[5120]: I0316 16:07:12.334344 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/30d44474-74de-4982-8e48-31038a50607f-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"30d44474-74de-4982-8e48-31038a50607f\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:07:12 crc kubenswrapper[5120]: I0316 16:07:12.334778 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"ovsdbserver-nb-0\" (UID: \"30d44474-74de-4982-8e48-31038a50607f\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:07:12 crc kubenswrapper[5120]: I0316 16:07:12.334873 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/30d44474-74de-4982-8e48-31038a50607f-config\") pod \"ovsdbserver-nb-0\" (UID: \"30d44474-74de-4982-8e48-31038a50607f\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:07:12 crc kubenswrapper[5120]: I0316 16:07:12.386628 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 16:07:12 crc kubenswrapper[5120]: I0316 16:07:12.391471 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:07:12 crc kubenswrapper[5120]: I0316 16:07:12.396129 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ovncluster-ovndbcluster-sb-dockercfg-lwptm\"" Mar 16 16:07:12 crc kubenswrapper[5120]: I0316 16:07:12.396556 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovndbcluster-sb-config\"" Mar 16 16:07:12 crc kubenswrapper[5120]: I0316 16:07:12.397182 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ovndbcluster-sb-ovndbs\"" Mar 16 16:07:12 crc kubenswrapper[5120]: I0316 16:07:12.397385 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovndbcluster-sb-scripts\"" Mar 16 16:07:12 crc kubenswrapper[5120]: I0316 16:07:12.438044 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 16:07:12 crc kubenswrapper[5120]: I0316 16:07:12.440353 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/14074bd5-5aa2-44f1-b48f-1d091538fe99-config\") pod \"ovsdbserver-sb-0\" (UID: \"14074bd5-5aa2-44f1-b48f-1d091538fe99\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:07:12 crc kubenswrapper[5120]: I0316 16:07:12.440405 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"ovsdbserver-nb-0\" (UID: \"30d44474-74de-4982-8e48-31038a50607f\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:07:12 crc kubenswrapper[5120]: I0316 16:07:12.440431 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"ovsdbserver-sb-0\" (UID: \"14074bd5-5aa2-44f1-b48f-1d091538fe99\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:07:12 crc kubenswrapper[5120]: I0316 16:07:12.440453 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twbbf\" (UniqueName: \"kubernetes.io/projected/14074bd5-5aa2-44f1-b48f-1d091538fe99-kube-api-access-twbbf\") pod \"ovsdbserver-sb-0\" (UID: \"14074bd5-5aa2-44f1-b48f-1d091538fe99\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:07:12 crc kubenswrapper[5120]: I0316 16:07:12.440564 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/30d44474-74de-4982-8e48-31038a50607f-config\") pod \"ovsdbserver-nb-0\" (UID: \"30d44474-74de-4982-8e48-31038a50607f\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:07:12 crc kubenswrapper[5120]: I0316 16:07:12.440649 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/14074bd5-5aa2-44f1-b48f-1d091538fe99-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"14074bd5-5aa2-44f1-b48f-1d091538fe99\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:07:12 crc kubenswrapper[5120]: I0316 16:07:12.440777 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/30d44474-74de-4982-8e48-31038a50607f-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"30d44474-74de-4982-8e48-31038a50607f\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:07:12 crc kubenswrapper[5120]: I0316 16:07:12.440813 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h5gm2\" (UniqueName: \"kubernetes.io/projected/30d44474-74de-4982-8e48-31038a50607f-kube-api-access-h5gm2\") pod \"ovsdbserver-nb-0\" (UID: \"30d44474-74de-4982-8e48-31038a50607f\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:07:12 crc kubenswrapper[5120]: I0316 16:07:12.440884 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/30d44474-74de-4982-8e48-31038a50607f-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"30d44474-74de-4982-8e48-31038a50607f\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:07:12 crc kubenswrapper[5120]: I0316 16:07:12.441339 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/30d44474-74de-4982-8e48-31038a50607f-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"30d44474-74de-4982-8e48-31038a50607f\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:07:12 crc kubenswrapper[5120]: I0316 16:07:12.441398 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"ovsdbserver-nb-0\" (UID: \"30d44474-74de-4982-8e48-31038a50607f\") device mount path \"/mnt/openstack/pv05\"" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:07:12 crc kubenswrapper[5120]: I0316 16:07:12.441601 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/14074bd5-5aa2-44f1-b48f-1d091538fe99-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"14074bd5-5aa2-44f1-b48f-1d091538fe99\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:07:12 crc kubenswrapper[5120]: I0316 16:07:12.441766 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/14074bd5-5aa2-44f1-b48f-1d091538fe99-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"14074bd5-5aa2-44f1-b48f-1d091538fe99\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:07:12 crc kubenswrapper[5120]: I0316 16:07:12.441976 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/30d44474-74de-4982-8e48-31038a50607f-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"30d44474-74de-4982-8e48-31038a50607f\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:07:12 crc kubenswrapper[5120]: I0316 16:07:12.442004 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/30d44474-74de-4982-8e48-31038a50607f-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"30d44474-74de-4982-8e48-31038a50607f\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:07:12 crc kubenswrapper[5120]: I0316 16:07:12.442087 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/14074bd5-5aa2-44f1-b48f-1d091538fe99-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"14074bd5-5aa2-44f1-b48f-1d091538fe99\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:07:12 crc kubenswrapper[5120]: I0316 16:07:12.442423 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/30d44474-74de-4982-8e48-31038a50607f-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"30d44474-74de-4982-8e48-31038a50607f\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:07:12 crc kubenswrapper[5120]: I0316 16:07:12.442724 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/30d44474-74de-4982-8e48-31038a50607f-config\") pod \"ovsdbserver-nb-0\" (UID: \"30d44474-74de-4982-8e48-31038a50607f\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:07:12 crc kubenswrapper[5120]: I0316 16:07:12.442610 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/14074bd5-5aa2-44f1-b48f-1d091538fe99-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"14074bd5-5aa2-44f1-b48f-1d091538fe99\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:07:12 crc kubenswrapper[5120]: I0316 16:07:12.443955 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/30d44474-74de-4982-8e48-31038a50607f-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"30d44474-74de-4982-8e48-31038a50607f\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:07:12 crc kubenswrapper[5120]: I0316 16:07:12.449001 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/30d44474-74de-4982-8e48-31038a50607f-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"30d44474-74de-4982-8e48-31038a50607f\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:07:12 crc kubenswrapper[5120]: I0316 16:07:12.449822 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/30d44474-74de-4982-8e48-31038a50607f-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"30d44474-74de-4982-8e48-31038a50607f\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:07:12 crc kubenswrapper[5120]: I0316 16:07:12.463966 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/30d44474-74de-4982-8e48-31038a50607f-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"30d44474-74de-4982-8e48-31038a50607f\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:07:12 crc kubenswrapper[5120]: I0316 16:07:12.464648 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"ovsdbserver-nb-0\" (UID: \"30d44474-74de-4982-8e48-31038a50607f\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:07:12 crc kubenswrapper[5120]: I0316 16:07:12.472737 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5gm2\" (UniqueName: \"kubernetes.io/projected/30d44474-74de-4982-8e48-31038a50607f-kube-api-access-h5gm2\") pod \"ovsdbserver-nb-0\" (UID: \"30d44474-74de-4982-8e48-31038a50607f\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:07:12 crc kubenswrapper[5120]: I0316 16:07:12.544523 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/14074bd5-5aa2-44f1-b48f-1d091538fe99-config\") pod \"ovsdbserver-sb-0\" (UID: \"14074bd5-5aa2-44f1-b48f-1d091538fe99\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:07:12 crc kubenswrapper[5120]: I0316 16:07:12.544570 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"ovsdbserver-sb-0\" (UID: \"14074bd5-5aa2-44f1-b48f-1d091538fe99\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:07:12 crc kubenswrapper[5120]: I0316 16:07:12.544593 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-twbbf\" (UniqueName: \"kubernetes.io/projected/14074bd5-5aa2-44f1-b48f-1d091538fe99-kube-api-access-twbbf\") pod \"ovsdbserver-sb-0\" (UID: \"14074bd5-5aa2-44f1-b48f-1d091538fe99\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:07:12 crc kubenswrapper[5120]: I0316 16:07:12.544613 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/14074bd5-5aa2-44f1-b48f-1d091538fe99-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"14074bd5-5aa2-44f1-b48f-1d091538fe99\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:07:12 crc kubenswrapper[5120]: I0316 16:07:12.544675 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/14074bd5-5aa2-44f1-b48f-1d091538fe99-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"14074bd5-5aa2-44f1-b48f-1d091538fe99\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:07:12 crc kubenswrapper[5120]: I0316 16:07:12.544702 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/14074bd5-5aa2-44f1-b48f-1d091538fe99-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"14074bd5-5aa2-44f1-b48f-1d091538fe99\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:07:12 crc kubenswrapper[5120]: I0316 16:07:12.544775 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/14074bd5-5aa2-44f1-b48f-1d091538fe99-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"14074bd5-5aa2-44f1-b48f-1d091538fe99\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:07:12 crc kubenswrapper[5120]: I0316 16:07:12.544798 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/14074bd5-5aa2-44f1-b48f-1d091538fe99-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"14074bd5-5aa2-44f1-b48f-1d091538fe99\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:07:12 crc kubenswrapper[5120]: I0316 16:07:12.545676 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/14074bd5-5aa2-44f1-b48f-1d091538fe99-config\") pod \"ovsdbserver-sb-0\" (UID: \"14074bd5-5aa2-44f1-b48f-1d091538fe99\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:07:12 crc kubenswrapper[5120]: I0316 16:07:12.545794 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"ovsdbserver-sb-0\" (UID: \"14074bd5-5aa2-44f1-b48f-1d091538fe99\") device mount path \"/mnt/openstack/pv02\"" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:07:12 crc kubenswrapper[5120]: I0316 16:07:12.545828 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/14074bd5-5aa2-44f1-b48f-1d091538fe99-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"14074bd5-5aa2-44f1-b48f-1d091538fe99\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:07:12 crc kubenswrapper[5120]: I0316 16:07:12.545693 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/14074bd5-5aa2-44f1-b48f-1d091538fe99-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"14074bd5-5aa2-44f1-b48f-1d091538fe99\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:07:12 crc kubenswrapper[5120]: I0316 16:07:12.549581 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/14074bd5-5aa2-44f1-b48f-1d091538fe99-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"14074bd5-5aa2-44f1-b48f-1d091538fe99\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:07:12 crc kubenswrapper[5120]: I0316 16:07:12.550271 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/14074bd5-5aa2-44f1-b48f-1d091538fe99-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"14074bd5-5aa2-44f1-b48f-1d091538fe99\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:07:12 crc kubenswrapper[5120]: I0316 16:07:12.550501 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/14074bd5-5aa2-44f1-b48f-1d091538fe99-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"14074bd5-5aa2-44f1-b48f-1d091538fe99\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:07:12 crc kubenswrapper[5120]: I0316 16:07:12.554437 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:07:12 crc kubenswrapper[5120]: I0316 16:07:12.566445 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-twbbf\" (UniqueName: \"kubernetes.io/projected/14074bd5-5aa2-44f1-b48f-1d091538fe99-kube-api-access-twbbf\") pod \"ovsdbserver-sb-0\" (UID: \"14074bd5-5aa2-44f1-b48f-1d091538fe99\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:07:12 crc kubenswrapper[5120]: I0316 16:07:12.579644 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"ovsdbserver-sb-0\" (UID: \"14074bd5-5aa2-44f1-b48f-1d091538fe99\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:07:12 crc kubenswrapper[5120]: I0316 16:07:12.715794 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:07:13 crc kubenswrapper[5120]: I0316 16:07:13.034314 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 16:07:13 crc kubenswrapper[5120]: I0316 16:07:13.164237 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 16:07:13 crc kubenswrapper[5120]: W0316 16:07:13.169079 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod14074bd5_5aa2_44f1_b48f_1d091538fe99.slice/crio-ba6e3dca8705a7932bf7eecbcb75a11ba5fd3ca23df983630373151493f83575 WatchSource:0}: Error finding container ba6e3dca8705a7932bf7eecbcb75a11ba5fd3ca23df983630373151493f83575: Status 404 returned error can't find the container with id ba6e3dca8705a7932bf7eecbcb75a11ba5fd3ca23df983630373151493f83575 Mar 16 16:07:13 crc kubenswrapper[5120]: I0316 16:07:13.357241 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:07:13 crc kubenswrapper[5120]: I0316 16:07:13.357286 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:07:14 crc kubenswrapper[5120]: I0316 16:07:14.004552 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"30d44474-74de-4982-8e48-31038a50607f","Type":"ContainerStarted","Data":"fbbfd6f0fd64c190f248274deb1940fd09e15076025138df16cb70d5ebc9868a"} Mar 16 16:07:14 crc kubenswrapper[5120]: I0316 16:07:14.004598 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"30d44474-74de-4982-8e48-31038a50607f","Type":"ContainerStarted","Data":"820cf0b744b014f72ef8c35261feee7d781834c65a720335f779bb77e8523fe4"} Mar 16 16:07:14 crc kubenswrapper[5120]: I0316 16:07:14.004611 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"30d44474-74de-4982-8e48-31038a50607f","Type":"ContainerStarted","Data":"f3957484545fb3102bfbc2042d12e9d149f6ddd98600492ca221d0b8bcdde9c3"} Mar 16 16:07:14 crc kubenswrapper[5120]: I0316 16:07:14.007516 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"14074bd5-5aa2-44f1-b48f-1d091538fe99","Type":"ContainerStarted","Data":"6e20c63b4f89ca3830a2ba939de00438e53cce4885447c83c5f138a24aad4498"} Mar 16 16:07:14 crc kubenswrapper[5120]: I0316 16:07:14.007564 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"14074bd5-5aa2-44f1-b48f-1d091538fe99","Type":"ContainerStarted","Data":"1f965ee3a33f3366a6e93fba345fc49e5fd735d0a812c244327a2f9e0c3cff26"} Mar 16 16:07:14 crc kubenswrapper[5120]: I0316 16:07:14.007583 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"14074bd5-5aa2-44f1-b48f-1d091538fe99","Type":"ContainerStarted","Data":"ba6e3dca8705a7932bf7eecbcb75a11ba5fd3ca23df983630373151493f83575"} Mar 16 16:07:14 crc kubenswrapper[5120]: I0316 16:07:14.035587 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podStartSLOduration=3.035558898 podStartE2EDuration="3.035558898s" podCreationTimestamp="2026-03-16 16:07:11 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:07:14.025141954 +0000 UTC m=+2136.179073631" watchObservedRunningTime="2026-03-16 16:07:14.035558898 +0000 UTC m=+2136.189490595" Mar 16 16:07:14 crc kubenswrapper[5120]: I0316 16:07:14.054354 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podStartSLOduration=3.05433287 podStartE2EDuration="3.05433287s" podCreationTimestamp="2026-03-16 16:07:11 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:07:14.048625465 +0000 UTC m=+2136.202557122" watchObservedRunningTime="2026-03-16 16:07:14.05433287 +0000 UTC m=+2136.208264527" Mar 16 16:07:14 crc kubenswrapper[5120]: I0316 16:07:14.747630 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:07:14 crc kubenswrapper[5120]: I0316 16:07:14.747689 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:07:15 crc kubenswrapper[5120]: I0316 16:07:15.555115 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:07:15 crc kubenswrapper[5120]: I0316 16:07:15.674807 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:07:15 crc kubenswrapper[5120]: I0316 16:07:15.716066 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:07:15 crc kubenswrapper[5120]: I0316 16:07:15.778460 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:07:16 crc kubenswrapper[5120]: I0316 16:07:16.271385 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-db-create-p6pvm"] Mar 16 16:07:16 crc kubenswrapper[5120]: I0316 16:07:16.279649 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-db-create-p6pvm"] Mar 16 16:07:16 crc kubenswrapper[5120]: I0316 16:07:16.279778 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-create-p6pvm" Mar 16 16:07:16 crc kubenswrapper[5120]: I0316 16:07:16.337141 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-6623-account-create-update-5brmz"] Mar 16 16:07:16 crc kubenswrapper[5120]: I0316 16:07:16.341846 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-6623-account-create-update-5brmz" Mar 16 16:07:16 crc kubenswrapper[5120]: I0316 16:07:16.342522 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-6623-account-create-update-5brmz"] Mar 16 16:07:16 crc kubenswrapper[5120]: I0316 16:07:16.344058 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-db-secret\"" Mar 16 16:07:16 crc kubenswrapper[5120]: I0316 16:07:16.427964 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-db-create-2qzvs"] Mar 16 16:07:16 crc kubenswrapper[5120]: I0316 16:07:16.434297 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znpc7\" (UniqueName: \"kubernetes.io/projected/37366a24-b946-4076-8334-f35f69f94f66-kube-api-access-znpc7\") pod \"keystone-db-create-p6pvm\" (UID: \"37366a24-b946-4076-8334-f35f69f94f66\") " pod="openstack-kuttl-tests/keystone-db-create-p6pvm" Mar 16 16:07:16 crc kubenswrapper[5120]: I0316 16:07:16.434484 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/97a45f5d-2fa4-4585-ac54-f36d71dab06d-operator-scripts\") pod \"keystone-6623-account-create-update-5brmz\" (UID: \"97a45f5d-2fa4-4585-ac54-f36d71dab06d\") " pod="openstack-kuttl-tests/keystone-6623-account-create-update-5brmz" Mar 16 16:07:16 crc kubenswrapper[5120]: I0316 16:07:16.434603 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/37366a24-b946-4076-8334-f35f69f94f66-operator-scripts\") pod \"keystone-db-create-p6pvm\" (UID: \"37366a24-b946-4076-8334-f35f69f94f66\") " pod="openstack-kuttl-tests/keystone-db-create-p6pvm" Mar 16 16:07:16 crc kubenswrapper[5120]: I0316 16:07:16.434718 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hsss8\" (UniqueName: \"kubernetes.io/projected/97a45f5d-2fa4-4585-ac54-f36d71dab06d-kube-api-access-hsss8\") pod \"keystone-6623-account-create-update-5brmz\" (UID: \"97a45f5d-2fa4-4585-ac54-f36d71dab06d\") " pod="openstack-kuttl-tests/keystone-6623-account-create-update-5brmz" Mar 16 16:07:16 crc kubenswrapper[5120]: I0316 16:07:16.434808 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-create-2qzvs" Mar 16 16:07:16 crc kubenswrapper[5120]: I0316 16:07:16.440268 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-db-create-2qzvs"] Mar 16 16:07:16 crc kubenswrapper[5120]: I0316 16:07:16.539422 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hsss8\" (UniqueName: \"kubernetes.io/projected/97a45f5d-2fa4-4585-ac54-f36d71dab06d-kube-api-access-hsss8\") pod \"keystone-6623-account-create-update-5brmz\" (UID: \"97a45f5d-2fa4-4585-ac54-f36d71dab06d\") " pod="openstack-kuttl-tests/keystone-6623-account-create-update-5brmz" Mar 16 16:07:16 crc kubenswrapper[5120]: I0316 16:07:16.539547 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l59vz\" (UniqueName: \"kubernetes.io/projected/470f5778-f4dd-45ce-8057-44b18c9cd5b3-kube-api-access-l59vz\") pod \"placement-db-create-2qzvs\" (UID: \"470f5778-f4dd-45ce-8057-44b18c9cd5b3\") " pod="openstack-kuttl-tests/placement-db-create-2qzvs" Mar 16 16:07:16 crc kubenswrapper[5120]: I0316 16:07:16.539666 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-znpc7\" (UniqueName: \"kubernetes.io/projected/37366a24-b946-4076-8334-f35f69f94f66-kube-api-access-znpc7\") pod \"keystone-db-create-p6pvm\" (UID: \"37366a24-b946-4076-8334-f35f69f94f66\") " pod="openstack-kuttl-tests/keystone-db-create-p6pvm" Mar 16 16:07:16 crc kubenswrapper[5120]: I0316 16:07:16.539751 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/97a45f5d-2fa4-4585-ac54-f36d71dab06d-operator-scripts\") pod \"keystone-6623-account-create-update-5brmz\" (UID: \"97a45f5d-2fa4-4585-ac54-f36d71dab06d\") " pod="openstack-kuttl-tests/keystone-6623-account-create-update-5brmz" Mar 16 16:07:16 crc kubenswrapper[5120]: I0316 16:07:16.539798 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/470f5778-f4dd-45ce-8057-44b18c9cd5b3-operator-scripts\") pod \"placement-db-create-2qzvs\" (UID: \"470f5778-f4dd-45ce-8057-44b18c9cd5b3\") " pod="openstack-kuttl-tests/placement-db-create-2qzvs" Mar 16 16:07:16 crc kubenswrapper[5120]: I0316 16:07:16.539840 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/37366a24-b946-4076-8334-f35f69f94f66-operator-scripts\") pod \"keystone-db-create-p6pvm\" (UID: \"37366a24-b946-4076-8334-f35f69f94f66\") " pod="openstack-kuttl-tests/keystone-db-create-p6pvm" Mar 16 16:07:16 crc kubenswrapper[5120]: I0316 16:07:16.540751 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/37366a24-b946-4076-8334-f35f69f94f66-operator-scripts\") pod \"keystone-db-create-p6pvm\" (UID: \"37366a24-b946-4076-8334-f35f69f94f66\") " pod="openstack-kuttl-tests/keystone-db-create-p6pvm" Mar 16 16:07:16 crc kubenswrapper[5120]: I0316 16:07:16.540920 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/97a45f5d-2fa4-4585-ac54-f36d71dab06d-operator-scripts\") pod \"keystone-6623-account-create-update-5brmz\" (UID: \"97a45f5d-2fa4-4585-ac54-f36d71dab06d\") " pod="openstack-kuttl-tests/keystone-6623-account-create-update-5brmz" Mar 16 16:07:16 crc kubenswrapper[5120]: I0316 16:07:16.550135 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-4e5e-account-create-update-d4lhk"] Mar 16 16:07:16 crc kubenswrapper[5120]: I0316 16:07:16.557573 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-4e5e-account-create-update-d4lhk"] Mar 16 16:07:16 crc kubenswrapper[5120]: I0316 16:07:16.557756 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-4e5e-account-create-update-d4lhk" Mar 16 16:07:16 crc kubenswrapper[5120]: I0316 16:07:16.562949 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-db-secret\"" Mar 16 16:07:16 crc kubenswrapper[5120]: I0316 16:07:16.570379 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-znpc7\" (UniqueName: \"kubernetes.io/projected/37366a24-b946-4076-8334-f35f69f94f66-kube-api-access-znpc7\") pod \"keystone-db-create-p6pvm\" (UID: \"37366a24-b946-4076-8334-f35f69f94f66\") " pod="openstack-kuttl-tests/keystone-db-create-p6pvm" Mar 16 16:07:16 crc kubenswrapper[5120]: I0316 16:07:16.580642 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hsss8\" (UniqueName: \"kubernetes.io/projected/97a45f5d-2fa4-4585-ac54-f36d71dab06d-kube-api-access-hsss8\") pod \"keystone-6623-account-create-update-5brmz\" (UID: \"97a45f5d-2fa4-4585-ac54-f36d71dab06d\") " pod="openstack-kuttl-tests/keystone-6623-account-create-update-5brmz" Mar 16 16:07:16 crc kubenswrapper[5120]: I0316 16:07:16.602371 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-create-p6pvm" Mar 16 16:07:16 crc kubenswrapper[5120]: I0316 16:07:16.641869 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/eed07ed8-afbf-4c01-8a27-678404cb17e1-operator-scripts\") pod \"placement-4e5e-account-create-update-d4lhk\" (UID: \"eed07ed8-afbf-4c01-8a27-678404cb17e1\") " pod="openstack-kuttl-tests/placement-4e5e-account-create-update-d4lhk" Mar 16 16:07:16 crc kubenswrapper[5120]: I0316 16:07:16.641995 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/470f5778-f4dd-45ce-8057-44b18c9cd5b3-operator-scripts\") pod \"placement-db-create-2qzvs\" (UID: \"470f5778-f4dd-45ce-8057-44b18c9cd5b3\") " pod="openstack-kuttl-tests/placement-db-create-2qzvs" Mar 16 16:07:16 crc kubenswrapper[5120]: I0316 16:07:16.642145 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjfsn\" (UniqueName: \"kubernetes.io/projected/eed07ed8-afbf-4c01-8a27-678404cb17e1-kube-api-access-jjfsn\") pod \"placement-4e5e-account-create-update-d4lhk\" (UID: \"eed07ed8-afbf-4c01-8a27-678404cb17e1\") " pod="openstack-kuttl-tests/placement-4e5e-account-create-update-d4lhk" Mar 16 16:07:16 crc kubenswrapper[5120]: I0316 16:07:16.642232 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l59vz\" (UniqueName: \"kubernetes.io/projected/470f5778-f4dd-45ce-8057-44b18c9cd5b3-kube-api-access-l59vz\") pod \"placement-db-create-2qzvs\" (UID: \"470f5778-f4dd-45ce-8057-44b18c9cd5b3\") " pod="openstack-kuttl-tests/placement-db-create-2qzvs" Mar 16 16:07:16 crc kubenswrapper[5120]: I0316 16:07:16.643310 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/470f5778-f4dd-45ce-8057-44b18c9cd5b3-operator-scripts\") pod \"placement-db-create-2qzvs\" (UID: \"470f5778-f4dd-45ce-8057-44b18c9cd5b3\") " pod="openstack-kuttl-tests/placement-db-create-2qzvs" Mar 16 16:07:16 crc kubenswrapper[5120]: I0316 16:07:16.656335 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-6623-account-create-update-5brmz" Mar 16 16:07:16 crc kubenswrapper[5120]: I0316 16:07:16.663501 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l59vz\" (UniqueName: \"kubernetes.io/projected/470f5778-f4dd-45ce-8057-44b18c9cd5b3-kube-api-access-l59vz\") pod \"placement-db-create-2qzvs\" (UID: \"470f5778-f4dd-45ce-8057-44b18c9cd5b3\") " pod="openstack-kuttl-tests/placement-db-create-2qzvs" Mar 16 16:07:16 crc kubenswrapper[5120]: I0316 16:07:16.743292 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/eed07ed8-afbf-4c01-8a27-678404cb17e1-operator-scripts\") pod \"placement-4e5e-account-create-update-d4lhk\" (UID: \"eed07ed8-afbf-4c01-8a27-678404cb17e1\") " pod="openstack-kuttl-tests/placement-4e5e-account-create-update-d4lhk" Mar 16 16:07:16 crc kubenswrapper[5120]: I0316 16:07:16.746114 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jjfsn\" (UniqueName: \"kubernetes.io/projected/eed07ed8-afbf-4c01-8a27-678404cb17e1-kube-api-access-jjfsn\") pod \"placement-4e5e-account-create-update-d4lhk\" (UID: \"eed07ed8-afbf-4c01-8a27-678404cb17e1\") " pod="openstack-kuttl-tests/placement-4e5e-account-create-update-d4lhk" Mar 16 16:07:16 crc kubenswrapper[5120]: I0316 16:07:16.747074 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/eed07ed8-afbf-4c01-8a27-678404cb17e1-operator-scripts\") pod \"placement-4e5e-account-create-update-d4lhk\" (UID: \"eed07ed8-afbf-4c01-8a27-678404cb17e1\") " pod="openstack-kuttl-tests/placement-4e5e-account-create-update-d4lhk" Mar 16 16:07:16 crc kubenswrapper[5120]: I0316 16:07:16.751937 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-create-2qzvs" Mar 16 16:07:16 crc kubenswrapper[5120]: I0316 16:07:16.769155 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjfsn\" (UniqueName: \"kubernetes.io/projected/eed07ed8-afbf-4c01-8a27-678404cb17e1-kube-api-access-jjfsn\") pod \"placement-4e5e-account-create-update-d4lhk\" (UID: \"eed07ed8-afbf-4c01-8a27-678404cb17e1\") " pod="openstack-kuttl-tests/placement-4e5e-account-create-update-d4lhk" Mar 16 16:07:17 crc kubenswrapper[5120]: I0316 16:07:17.043584 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-4e5e-account-create-update-d4lhk" Mar 16 16:07:17 crc kubenswrapper[5120]: I0316 16:07:17.100820 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-db-create-p6pvm"] Mar 16 16:07:17 crc kubenswrapper[5120]: W0316 16:07:17.119267 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod37366a24_b946_4076_8334_f35f69f94f66.slice/crio-d0eef005e2130b8c6ba253592ace567c2914a414869391aedf40bfce596ffed3 WatchSource:0}: Error finding container d0eef005e2130b8c6ba253592ace567c2914a414869391aedf40bfce596ffed3: Status 404 returned error can't find the container with id d0eef005e2130b8c6ba253592ace567c2914a414869391aedf40bfce596ffed3 Mar 16 16:07:17 crc kubenswrapper[5120]: I0316 16:07:17.191779 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:07:17 crc kubenswrapper[5120]: I0316 16:07:17.208563 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-db-create-2qzvs"] Mar 16 16:07:17 crc kubenswrapper[5120]: I0316 16:07:17.213572 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-6623-account-create-update-5brmz"] Mar 16 16:07:17 crc kubenswrapper[5120]: W0316 16:07:17.222624 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod470f5778_f4dd_45ce_8057_44b18c9cd5b3.slice/crio-2a4be544caf92d3b938ba6312c00d9ef1edb3f7776da66b3e621674abb1b560d WatchSource:0}: Error finding container 2a4be544caf92d3b938ba6312c00d9ef1edb3f7776da66b3e621674abb1b560d: Status 404 returned error can't find the container with id 2a4be544caf92d3b938ba6312c00d9ef1edb3f7776da66b3e621674abb1b560d Mar 16 16:07:17 crc kubenswrapper[5120]: I0316 16:07:17.411479 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:07:17 crc kubenswrapper[5120]: I0316 16:07:17.555504 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:07:17 crc kubenswrapper[5120]: I0316 16:07:17.641493 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-4e5e-account-create-update-d4lhk"] Mar 16 16:07:17 crc kubenswrapper[5120]: W0316 16:07:17.642781 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podeed07ed8_afbf_4c01_8a27_678404cb17e1.slice/crio-89b14a2adff0b11a492f0cd4efcb27f6a502dad0080d6ce995a18def3ea06742 WatchSource:0}: Error finding container 89b14a2adff0b11a492f0cd4efcb27f6a502dad0080d6ce995a18def3ea06742: Status 404 returned error can't find the container with id 89b14a2adff0b11a492f0cd4efcb27f6a502dad0080d6ce995a18def3ea06742 Mar 16 16:07:17 crc kubenswrapper[5120]: I0316 16:07:17.716737 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:07:18 crc kubenswrapper[5120]: I0316 16:07:18.049058 5120 generic.go:358] "Generic (PLEG): container finished" podID="37366a24-b946-4076-8334-f35f69f94f66" containerID="ffedaffbade6df37a8d8a3da00b5d9977022cb3e37f20b1857eb81e9ff8a1136" exitCode=0 Mar 16 16:07:18 crc kubenswrapper[5120]: I0316 16:07:18.049378 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-create-p6pvm" event={"ID":"37366a24-b946-4076-8334-f35f69f94f66","Type":"ContainerDied","Data":"ffedaffbade6df37a8d8a3da00b5d9977022cb3e37f20b1857eb81e9ff8a1136"} Mar 16 16:07:18 crc kubenswrapper[5120]: I0316 16:07:18.049434 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-create-p6pvm" event={"ID":"37366a24-b946-4076-8334-f35f69f94f66","Type":"ContainerStarted","Data":"d0eef005e2130b8c6ba253592ace567c2914a414869391aedf40bfce596ffed3"} Mar 16 16:07:18 crc kubenswrapper[5120]: I0316 16:07:18.051456 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-4e5e-account-create-update-d4lhk" event={"ID":"eed07ed8-afbf-4c01-8a27-678404cb17e1","Type":"ContainerStarted","Data":"a68a9f1bcee3f9292438f3541515799be30bb3c1b173dfc589fb7dd822c38072"} Mar 16 16:07:18 crc kubenswrapper[5120]: I0316 16:07:18.051483 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-4e5e-account-create-update-d4lhk" event={"ID":"eed07ed8-afbf-4c01-8a27-678404cb17e1","Type":"ContainerStarted","Data":"89b14a2adff0b11a492f0cd4efcb27f6a502dad0080d6ce995a18def3ea06742"} Mar 16 16:07:18 crc kubenswrapper[5120]: I0316 16:07:18.053396 5120 generic.go:358] "Generic (PLEG): container finished" podID="470f5778-f4dd-45ce-8057-44b18c9cd5b3" containerID="1a146f32466038e8a40da411b6f8f77338a06e13e67f898cb41a1358ec59794d" exitCode=0 Mar 16 16:07:18 crc kubenswrapper[5120]: I0316 16:07:18.053451 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-create-2qzvs" event={"ID":"470f5778-f4dd-45ce-8057-44b18c9cd5b3","Type":"ContainerDied","Data":"1a146f32466038e8a40da411b6f8f77338a06e13e67f898cb41a1358ec59794d"} Mar 16 16:07:18 crc kubenswrapper[5120]: I0316 16:07:18.053470 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-create-2qzvs" event={"ID":"470f5778-f4dd-45ce-8057-44b18c9cd5b3","Type":"ContainerStarted","Data":"2a4be544caf92d3b938ba6312c00d9ef1edb3f7776da66b3e621674abb1b560d"} Mar 16 16:07:18 crc kubenswrapper[5120]: I0316 16:07:18.055408 5120 generic.go:358] "Generic (PLEG): container finished" podID="97a45f5d-2fa4-4585-ac54-f36d71dab06d" containerID="0f8959e0bb7d95f5a292464465e9f5dc554f1e3aa6decc3a6b2c24f1d5d177aa" exitCode=0 Mar 16 16:07:18 crc kubenswrapper[5120]: I0316 16:07:18.056047 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-6623-account-create-update-5brmz" event={"ID":"97a45f5d-2fa4-4585-ac54-f36d71dab06d","Type":"ContainerDied","Data":"0f8959e0bb7d95f5a292464465e9f5dc554f1e3aa6decc3a6b2c24f1d5d177aa"} Mar 16 16:07:18 crc kubenswrapper[5120]: I0316 16:07:18.056072 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-6623-account-create-update-5brmz" event={"ID":"97a45f5d-2fa4-4585-ac54-f36d71dab06d","Type":"ContainerStarted","Data":"df8b7fe90922441abfe5b9e3248d68616640761f29c2f95a92db41952a615ec8"} Mar 16 16:07:18 crc kubenswrapper[5120]: I0316 16:07:18.093662 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-4e5e-account-create-update-d4lhk" podStartSLOduration=2.093645905 podStartE2EDuration="2.093645905s" podCreationTimestamp="2026-03-16 16:07:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:07:18.086528301 +0000 UTC m=+2140.240459978" watchObservedRunningTime="2026-03-16 16:07:18.093645905 +0000 UTC m=+2140.247577562" Mar 16 16:07:18 crc kubenswrapper[5120]: I0316 16:07:18.317327 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 16:07:18 crc kubenswrapper[5120]: I0316 16:07:18.334126 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:07:18 crc kubenswrapper[5120]: I0316 16:07:18.336657 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"swift-ring-files\"" Mar 16 16:07:18 crc kubenswrapper[5120]: I0316 16:07:18.337208 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"swift-swift-dockercfg-sz7zw\"" Mar 16 16:07:18 crc kubenswrapper[5120]: I0316 16:07:18.337368 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"swift-storage-config-data\"" Mar 16 16:07:18 crc kubenswrapper[5120]: I0316 16:07:18.339016 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"swift-conf\"" Mar 16 16:07:18 crc kubenswrapper[5120]: I0316 16:07:18.344154 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 16:07:18 crc kubenswrapper[5120]: I0316 16:07:18.481359 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/48f884c6-8a4f-4581-8b21-6e4db79ae424-combined-ca-bundle\") pod \"swift-storage-0\" (UID: \"48f884c6-8a4f-4581-8b21-6e4db79ae424\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:07:18 crc kubenswrapper[5120]: I0316 16:07:18.481448 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/48f884c6-8a4f-4581-8b21-6e4db79ae424-etc-swift\") pod \"swift-storage-0\" (UID: \"48f884c6-8a4f-4581-8b21-6e4db79ae424\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:07:18 crc kubenswrapper[5120]: I0316 16:07:18.481600 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wd7zm\" (UniqueName: \"kubernetes.io/projected/48f884c6-8a4f-4581-8b21-6e4db79ae424-kube-api-access-wd7zm\") pod \"swift-storage-0\" (UID: \"48f884c6-8a4f-4581-8b21-6e4db79ae424\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:07:18 crc kubenswrapper[5120]: I0316 16:07:18.481707 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") pod \"swift-storage-0\" (UID: \"48f884c6-8a4f-4581-8b21-6e4db79ae424\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:07:18 crc kubenswrapper[5120]: I0316 16:07:18.481899 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/48f884c6-8a4f-4581-8b21-6e4db79ae424-cache\") pod \"swift-storage-0\" (UID: \"48f884c6-8a4f-4581-8b21-6e4db79ae424\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:07:18 crc kubenswrapper[5120]: I0316 16:07:18.482051 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/48f884c6-8a4f-4581-8b21-6e4db79ae424-lock\") pod \"swift-storage-0\" (UID: \"48f884c6-8a4f-4581-8b21-6e4db79ae424\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:07:18 crc kubenswrapper[5120]: I0316 16:07:18.583362 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/48f884c6-8a4f-4581-8b21-6e4db79ae424-lock\") pod \"swift-storage-0\" (UID: \"48f884c6-8a4f-4581-8b21-6e4db79ae424\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:07:18 crc kubenswrapper[5120]: I0316 16:07:18.583448 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/48f884c6-8a4f-4581-8b21-6e4db79ae424-combined-ca-bundle\") pod \"swift-storage-0\" (UID: \"48f884c6-8a4f-4581-8b21-6e4db79ae424\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:07:18 crc kubenswrapper[5120]: I0316 16:07:18.583482 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/48f884c6-8a4f-4581-8b21-6e4db79ae424-etc-swift\") pod \"swift-storage-0\" (UID: \"48f884c6-8a4f-4581-8b21-6e4db79ae424\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:07:18 crc kubenswrapper[5120]: I0316 16:07:18.583538 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wd7zm\" (UniqueName: \"kubernetes.io/projected/48f884c6-8a4f-4581-8b21-6e4db79ae424-kube-api-access-wd7zm\") pod \"swift-storage-0\" (UID: \"48f884c6-8a4f-4581-8b21-6e4db79ae424\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:07:18 crc kubenswrapper[5120]: I0316 16:07:18.583564 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") pod \"swift-storage-0\" (UID: \"48f884c6-8a4f-4581-8b21-6e4db79ae424\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:07:18 crc kubenswrapper[5120]: I0316 16:07:18.583622 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/48f884c6-8a4f-4581-8b21-6e4db79ae424-cache\") pod \"swift-storage-0\" (UID: \"48f884c6-8a4f-4581-8b21-6e4db79ae424\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:07:18 crc kubenswrapper[5120]: E0316 16:07:18.583711 5120 projected.go:289] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Mar 16 16:07:18 crc kubenswrapper[5120]: E0316 16:07:18.583747 5120 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Mar 16 16:07:18 crc kubenswrapper[5120]: E0316 16:07:18.583816 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/48f884c6-8a4f-4581-8b21-6e4db79ae424-etc-swift podName:48f884c6-8a4f-4581-8b21-6e4db79ae424 nodeName:}" failed. No retries permitted until 2026-03-16 16:07:19.083798699 +0000 UTC m=+2141.237730356 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/48f884c6-8a4f-4581-8b21-6e4db79ae424-etc-swift") pod "swift-storage-0" (UID: "48f884c6-8a4f-4581-8b21-6e4db79ae424") : configmap "swift-ring-files" not found Mar 16 16:07:18 crc kubenswrapper[5120]: I0316 16:07:18.583923 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") pod \"swift-storage-0\" (UID: \"48f884c6-8a4f-4581-8b21-6e4db79ae424\") device mount path \"/mnt/openstack/pv11\"" pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:07:18 crc kubenswrapper[5120]: I0316 16:07:18.584105 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/48f884c6-8a4f-4581-8b21-6e4db79ae424-cache\") pod \"swift-storage-0\" (UID: \"48f884c6-8a4f-4581-8b21-6e4db79ae424\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:07:18 crc kubenswrapper[5120]: I0316 16:07:18.584132 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/48f884c6-8a4f-4581-8b21-6e4db79ae424-lock\") pod \"swift-storage-0\" (UID: \"48f884c6-8a4f-4581-8b21-6e4db79ae424\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:07:18 crc kubenswrapper[5120]: I0316 16:07:18.596939 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/48f884c6-8a4f-4581-8b21-6e4db79ae424-combined-ca-bundle\") pod \"swift-storage-0\" (UID: \"48f884c6-8a4f-4581-8b21-6e4db79ae424\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:07:18 crc kubenswrapper[5120]: I0316 16:07:18.608598 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") pod \"swift-storage-0\" (UID: \"48f884c6-8a4f-4581-8b21-6e4db79ae424\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:07:18 crc kubenswrapper[5120]: I0316 16:07:18.611911 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wd7zm\" (UniqueName: \"kubernetes.io/projected/48f884c6-8a4f-4581-8b21-6e4db79ae424-kube-api-access-wd7zm\") pod \"swift-storage-0\" (UID: \"48f884c6-8a4f-4581-8b21-6e4db79ae424\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:07:18 crc kubenswrapper[5120]: I0316 16:07:18.616890 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:07:18 crc kubenswrapper[5120]: I0316 16:07:18.677812 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:07:18 crc kubenswrapper[5120]: I0316 16:07:18.765789 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:07:18 crc kubenswrapper[5120]: I0316 16:07:18.815992 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:07:18 crc kubenswrapper[5120]: I0316 16:07:18.979394 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 16:07:18 crc kubenswrapper[5120]: I0316 16:07:18.988918 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:07:18 crc kubenswrapper[5120]: I0316 16:07:18.992146 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ovnnorthd-ovnnorthd-dockercfg-7fr5c\"" Mar 16 16:07:18 crc kubenswrapper[5120]: I0316 16:07:18.992412 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ovnnorthd-ovndbs\"" Mar 16 16:07:18 crc kubenswrapper[5120]: I0316 16:07:18.994033 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovnnorthd-config\"" Mar 16 16:07:18 crc kubenswrapper[5120]: I0316 16:07:18.996531 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovnnorthd-scripts\"" Mar 16 16:07:19 crc kubenswrapper[5120]: I0316 16:07:19.004788 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 16:07:19 crc kubenswrapper[5120]: I0316 16:07:19.068308 5120 generic.go:358] "Generic (PLEG): container finished" podID="eed07ed8-afbf-4c01-8a27-678404cb17e1" containerID="a68a9f1bcee3f9292438f3541515799be30bb3c1b173dfc589fb7dd822c38072" exitCode=0 Mar 16 16:07:19 crc kubenswrapper[5120]: I0316 16:07:19.069146 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-4e5e-account-create-update-d4lhk" event={"ID":"eed07ed8-afbf-4c01-8a27-678404cb17e1","Type":"ContainerDied","Data":"a68a9f1bcee3f9292438f3541515799be30bb3c1b173dfc589fb7dd822c38072"} Mar 16 16:07:19 crc kubenswrapper[5120]: I0316 16:07:19.097052 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6d9a26b4-a091-43f5-8625-2194e901021c-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"6d9a26b4-a091-43f5-8625-2194e901021c\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:07:19 crc kubenswrapper[5120]: I0316 16:07:19.097104 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6d9a26b4-a091-43f5-8625-2194e901021c-config\") pod \"ovn-northd-0\" (UID: \"6d9a26b4-a091-43f5-8625-2194e901021c\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:07:19 crc kubenswrapper[5120]: I0316 16:07:19.097141 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/6d9a26b4-a091-43f5-8625-2194e901021c-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"6d9a26b4-a091-43f5-8625-2194e901021c\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:07:19 crc kubenswrapper[5120]: I0316 16:07:19.097226 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/6d9a26b4-a091-43f5-8625-2194e901021c-scripts\") pod \"ovn-northd-0\" (UID: \"6d9a26b4-a091-43f5-8625-2194e901021c\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:07:19 crc kubenswrapper[5120]: I0316 16:07:19.097294 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/48f884c6-8a4f-4581-8b21-6e4db79ae424-etc-swift\") pod \"swift-storage-0\" (UID: \"48f884c6-8a4f-4581-8b21-6e4db79ae424\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:07:19 crc kubenswrapper[5120]: I0316 16:07:19.097360 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/6d9a26b4-a091-43f5-8625-2194e901021c-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"6d9a26b4-a091-43f5-8625-2194e901021c\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:07:19 crc kubenswrapper[5120]: I0316 16:07:19.097429 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckhcf\" (UniqueName: \"kubernetes.io/projected/6d9a26b4-a091-43f5-8625-2194e901021c-kube-api-access-ckhcf\") pod \"ovn-northd-0\" (UID: \"6d9a26b4-a091-43f5-8625-2194e901021c\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:07:19 crc kubenswrapper[5120]: I0316 16:07:19.097484 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/6d9a26b4-a091-43f5-8625-2194e901021c-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"6d9a26b4-a091-43f5-8625-2194e901021c\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:07:19 crc kubenswrapper[5120]: E0316 16:07:19.097774 5120 projected.go:289] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Mar 16 16:07:19 crc kubenswrapper[5120]: E0316 16:07:19.097793 5120 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Mar 16 16:07:19 crc kubenswrapper[5120]: E0316 16:07:19.097846 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/48f884c6-8a4f-4581-8b21-6e4db79ae424-etc-swift podName:48f884c6-8a4f-4581-8b21-6e4db79ae424 nodeName:}" failed. No retries permitted until 2026-03-16 16:07:20.097827024 +0000 UTC m=+2142.251758681 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/48f884c6-8a4f-4581-8b21-6e4db79ae424-etc-swift") pod "swift-storage-0" (UID: "48f884c6-8a4f-4581-8b21-6e4db79ae424") : configmap "swift-ring-files" not found Mar 16 16:07:19 crc kubenswrapper[5120]: I0316 16:07:19.199211 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ckhcf\" (UniqueName: \"kubernetes.io/projected/6d9a26b4-a091-43f5-8625-2194e901021c-kube-api-access-ckhcf\") pod \"ovn-northd-0\" (UID: \"6d9a26b4-a091-43f5-8625-2194e901021c\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:07:19 crc kubenswrapper[5120]: I0316 16:07:19.199511 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/6d9a26b4-a091-43f5-8625-2194e901021c-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"6d9a26b4-a091-43f5-8625-2194e901021c\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:07:19 crc kubenswrapper[5120]: I0316 16:07:19.199650 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6d9a26b4-a091-43f5-8625-2194e901021c-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"6d9a26b4-a091-43f5-8625-2194e901021c\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:07:19 crc kubenswrapper[5120]: I0316 16:07:19.199673 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6d9a26b4-a091-43f5-8625-2194e901021c-config\") pod \"ovn-northd-0\" (UID: \"6d9a26b4-a091-43f5-8625-2194e901021c\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:07:19 crc kubenswrapper[5120]: I0316 16:07:19.199713 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/6d9a26b4-a091-43f5-8625-2194e901021c-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"6d9a26b4-a091-43f5-8625-2194e901021c\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:07:19 crc kubenswrapper[5120]: I0316 16:07:19.199821 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/6d9a26b4-a091-43f5-8625-2194e901021c-scripts\") pod \"ovn-northd-0\" (UID: \"6d9a26b4-a091-43f5-8625-2194e901021c\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:07:19 crc kubenswrapper[5120]: I0316 16:07:19.199933 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/6d9a26b4-a091-43f5-8625-2194e901021c-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"6d9a26b4-a091-43f5-8625-2194e901021c\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:07:19 crc kubenswrapper[5120]: I0316 16:07:19.201053 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6d9a26b4-a091-43f5-8625-2194e901021c-config\") pod \"ovn-northd-0\" (UID: \"6d9a26b4-a091-43f5-8625-2194e901021c\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:07:19 crc kubenswrapper[5120]: I0316 16:07:19.201190 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/6d9a26b4-a091-43f5-8625-2194e901021c-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"6d9a26b4-a091-43f5-8625-2194e901021c\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:07:19 crc kubenswrapper[5120]: I0316 16:07:19.201545 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/6d9a26b4-a091-43f5-8625-2194e901021c-scripts\") pod \"ovn-northd-0\" (UID: \"6d9a26b4-a091-43f5-8625-2194e901021c\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:07:19 crc kubenswrapper[5120]: I0316 16:07:19.205139 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/6d9a26b4-a091-43f5-8625-2194e901021c-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"6d9a26b4-a091-43f5-8625-2194e901021c\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:07:19 crc kubenswrapper[5120]: I0316 16:07:19.205337 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/6d9a26b4-a091-43f5-8625-2194e901021c-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"6d9a26b4-a091-43f5-8625-2194e901021c\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:07:19 crc kubenswrapper[5120]: I0316 16:07:19.206888 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6d9a26b4-a091-43f5-8625-2194e901021c-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"6d9a26b4-a091-43f5-8625-2194e901021c\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:07:19 crc kubenswrapper[5120]: I0316 16:07:19.230179 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckhcf\" (UniqueName: \"kubernetes.io/projected/6d9a26b4-a091-43f5-8625-2194e901021c-kube-api-access-ckhcf\") pod \"ovn-northd-0\" (UID: \"6d9a26b4-a091-43f5-8625-2194e901021c\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:07:19 crc kubenswrapper[5120]: I0316 16:07:19.305073 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:07:19 crc kubenswrapper[5120]: I0316 16:07:19.481796 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-create-2qzvs" Mar 16 16:07:19 crc kubenswrapper[5120]: I0316 16:07:19.610609 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l59vz\" (UniqueName: \"kubernetes.io/projected/470f5778-f4dd-45ce-8057-44b18c9cd5b3-kube-api-access-l59vz\") pod \"470f5778-f4dd-45ce-8057-44b18c9cd5b3\" (UID: \"470f5778-f4dd-45ce-8057-44b18c9cd5b3\") " Mar 16 16:07:19 crc kubenswrapper[5120]: I0316 16:07:19.611058 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/470f5778-f4dd-45ce-8057-44b18c9cd5b3-operator-scripts\") pod \"470f5778-f4dd-45ce-8057-44b18c9cd5b3\" (UID: \"470f5778-f4dd-45ce-8057-44b18c9cd5b3\") " Mar 16 16:07:19 crc kubenswrapper[5120]: I0316 16:07:19.612351 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/470f5778-f4dd-45ce-8057-44b18c9cd5b3-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "470f5778-f4dd-45ce-8057-44b18c9cd5b3" (UID: "470f5778-f4dd-45ce-8057-44b18c9cd5b3"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:07:19 crc kubenswrapper[5120]: I0316 16:07:19.617260 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/470f5778-f4dd-45ce-8057-44b18c9cd5b3-kube-api-access-l59vz" (OuterVolumeSpecName: "kube-api-access-l59vz") pod "470f5778-f4dd-45ce-8057-44b18c9cd5b3" (UID: "470f5778-f4dd-45ce-8057-44b18c9cd5b3"). InnerVolumeSpecName "kube-api-access-l59vz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:07:19 crc kubenswrapper[5120]: I0316 16:07:19.699928 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-6623-account-create-update-5brmz" Mar 16 16:07:19 crc kubenswrapper[5120]: I0316 16:07:19.705661 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-create-p6pvm" Mar 16 16:07:19 crc kubenswrapper[5120]: I0316 16:07:19.716579 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/470f5778-f4dd-45ce-8057-44b18c9cd5b3-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:07:19 crc kubenswrapper[5120]: I0316 16:07:19.716848 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l59vz\" (UniqueName: \"kubernetes.io/projected/470f5778-f4dd-45ce-8057-44b18c9cd5b3-kube-api-access-l59vz\") on node \"crc\" DevicePath \"\"" Mar 16 16:07:19 crc kubenswrapper[5120]: I0316 16:07:19.817866 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/37366a24-b946-4076-8334-f35f69f94f66-operator-scripts\") pod \"37366a24-b946-4076-8334-f35f69f94f66\" (UID: \"37366a24-b946-4076-8334-f35f69f94f66\") " Mar 16 16:07:19 crc kubenswrapper[5120]: I0316 16:07:19.817987 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hsss8\" (UniqueName: \"kubernetes.io/projected/97a45f5d-2fa4-4585-ac54-f36d71dab06d-kube-api-access-hsss8\") pod \"97a45f5d-2fa4-4585-ac54-f36d71dab06d\" (UID: \"97a45f5d-2fa4-4585-ac54-f36d71dab06d\") " Mar 16 16:07:19 crc kubenswrapper[5120]: I0316 16:07:19.818137 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-znpc7\" (UniqueName: \"kubernetes.io/projected/37366a24-b946-4076-8334-f35f69f94f66-kube-api-access-znpc7\") pod \"37366a24-b946-4076-8334-f35f69f94f66\" (UID: \"37366a24-b946-4076-8334-f35f69f94f66\") " Mar 16 16:07:19 crc kubenswrapper[5120]: I0316 16:07:19.818199 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/97a45f5d-2fa4-4585-ac54-f36d71dab06d-operator-scripts\") pod \"97a45f5d-2fa4-4585-ac54-f36d71dab06d\" (UID: \"97a45f5d-2fa4-4585-ac54-f36d71dab06d\") " Mar 16 16:07:19 crc kubenswrapper[5120]: I0316 16:07:19.818400 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37366a24-b946-4076-8334-f35f69f94f66-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "37366a24-b946-4076-8334-f35f69f94f66" (UID: "37366a24-b946-4076-8334-f35f69f94f66"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:07:19 crc kubenswrapper[5120]: I0316 16:07:19.818920 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/97a45f5d-2fa4-4585-ac54-f36d71dab06d-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "97a45f5d-2fa4-4585-ac54-f36d71dab06d" (UID: "97a45f5d-2fa4-4585-ac54-f36d71dab06d"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:07:19 crc kubenswrapper[5120]: I0316 16:07:19.819998 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/37366a24-b946-4076-8334-f35f69f94f66-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:07:19 crc kubenswrapper[5120]: I0316 16:07:19.820033 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/97a45f5d-2fa4-4585-ac54-f36d71dab06d-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:07:19 crc kubenswrapper[5120]: I0316 16:07:19.822348 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97a45f5d-2fa4-4585-ac54-f36d71dab06d-kube-api-access-hsss8" (OuterVolumeSpecName: "kube-api-access-hsss8") pod "97a45f5d-2fa4-4585-ac54-f36d71dab06d" (UID: "97a45f5d-2fa4-4585-ac54-f36d71dab06d"). InnerVolumeSpecName "kube-api-access-hsss8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:07:19 crc kubenswrapper[5120]: I0316 16:07:19.823700 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37366a24-b946-4076-8334-f35f69f94f66-kube-api-access-znpc7" (OuterVolumeSpecName: "kube-api-access-znpc7") pod "37366a24-b946-4076-8334-f35f69f94f66" (UID: "37366a24-b946-4076-8334-f35f69f94f66"). InnerVolumeSpecName "kube-api-access-znpc7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:07:19 crc kubenswrapper[5120]: I0316 16:07:19.849035 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 16:07:19 crc kubenswrapper[5120]: W0316 16:07:19.859067 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6d9a26b4_a091_43f5_8625_2194e901021c.slice/crio-772d2e4723c386b87da97ac651a6ffa12062d93c1123f14c2062d11c2c0736f4 WatchSource:0}: Error finding container 772d2e4723c386b87da97ac651a6ffa12062d93c1123f14c2062d11c2c0736f4: Status 404 returned error can't find the container with id 772d2e4723c386b87da97ac651a6ffa12062d93c1123f14c2062d11c2c0736f4 Mar 16 16:07:19 crc kubenswrapper[5120]: I0316 16:07:19.921573 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hsss8\" (UniqueName: \"kubernetes.io/projected/97a45f5d-2fa4-4585-ac54-f36d71dab06d-kube-api-access-hsss8\") on node \"crc\" DevicePath \"\"" Mar 16 16:07:19 crc kubenswrapper[5120]: I0316 16:07:19.921607 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-znpc7\" (UniqueName: \"kubernetes.io/projected/37366a24-b946-4076-8334-f35f69f94f66-kube-api-access-znpc7\") on node \"crc\" DevicePath \"\"" Mar 16 16:07:19 crc kubenswrapper[5120]: I0316 16:07:19.968069 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:07:20 crc kubenswrapper[5120]: I0316 16:07:20.079035 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"6d9a26b4-a091-43f5-8625-2194e901021c","Type":"ContainerStarted","Data":"772d2e4723c386b87da97ac651a6ffa12062d93c1123f14c2062d11c2c0736f4"} Mar 16 16:07:20 crc kubenswrapper[5120]: I0316 16:07:20.081260 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-create-2qzvs" event={"ID":"470f5778-f4dd-45ce-8057-44b18c9cd5b3","Type":"ContainerDied","Data":"2a4be544caf92d3b938ba6312c00d9ef1edb3f7776da66b3e621674abb1b560d"} Mar 16 16:07:20 crc kubenswrapper[5120]: I0316 16:07:20.081317 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2a4be544caf92d3b938ba6312c00d9ef1edb3f7776da66b3e621674abb1b560d" Mar 16 16:07:20 crc kubenswrapper[5120]: I0316 16:07:20.081430 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-create-2qzvs" Mar 16 16:07:20 crc kubenswrapper[5120]: I0316 16:07:20.085583 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-6623-account-create-update-5brmz" event={"ID":"97a45f5d-2fa4-4585-ac54-f36d71dab06d","Type":"ContainerDied","Data":"df8b7fe90922441abfe5b9e3248d68616640761f29c2f95a92db41952a615ec8"} Mar 16 16:07:20 crc kubenswrapper[5120]: I0316 16:07:20.085620 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="df8b7fe90922441abfe5b9e3248d68616640761f29c2f95a92db41952a615ec8" Mar 16 16:07:20 crc kubenswrapper[5120]: I0316 16:07:20.085636 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-6623-account-create-update-5brmz" Mar 16 16:07:20 crc kubenswrapper[5120]: I0316 16:07:20.095000 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-create-p6pvm" event={"ID":"37366a24-b946-4076-8334-f35f69f94f66","Type":"ContainerDied","Data":"d0eef005e2130b8c6ba253592ace567c2914a414869391aedf40bfce596ffed3"} Mar 16 16:07:20 crc kubenswrapper[5120]: I0316 16:07:20.095039 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d0eef005e2130b8c6ba253592ace567c2914a414869391aedf40bfce596ffed3" Mar 16 16:07:20 crc kubenswrapper[5120]: I0316 16:07:20.095276 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-create-p6pvm" Mar 16 16:07:20 crc kubenswrapper[5120]: I0316 16:07:20.129795 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/48f884c6-8a4f-4581-8b21-6e4db79ae424-etc-swift\") pod \"swift-storage-0\" (UID: \"48f884c6-8a4f-4581-8b21-6e4db79ae424\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:07:20 crc kubenswrapper[5120]: E0316 16:07:20.130139 5120 projected.go:289] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Mar 16 16:07:20 crc kubenswrapper[5120]: E0316 16:07:20.130162 5120 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Mar 16 16:07:20 crc kubenswrapper[5120]: E0316 16:07:20.130227 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/48f884c6-8a4f-4581-8b21-6e4db79ae424-etc-swift podName:48f884c6-8a4f-4581-8b21-6e4db79ae424 nodeName:}" failed. No retries permitted until 2026-03-16 16:07:22.130207913 +0000 UTC m=+2144.284139590 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/48f884c6-8a4f-4581-8b21-6e4db79ae424-etc-swift") pod "swift-storage-0" (UID: "48f884c6-8a4f-4581-8b21-6e4db79ae424") : configmap "swift-ring-files" not found Mar 16 16:07:20 crc kubenswrapper[5120]: I0316 16:07:20.364434 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-4e5e-account-create-update-d4lhk" Mar 16 16:07:20 crc kubenswrapper[5120]: I0316 16:07:20.433983 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jjfsn\" (UniqueName: \"kubernetes.io/projected/eed07ed8-afbf-4c01-8a27-678404cb17e1-kube-api-access-jjfsn\") pod \"eed07ed8-afbf-4c01-8a27-678404cb17e1\" (UID: \"eed07ed8-afbf-4c01-8a27-678404cb17e1\") " Mar 16 16:07:20 crc kubenswrapper[5120]: I0316 16:07:20.434196 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/eed07ed8-afbf-4c01-8a27-678404cb17e1-operator-scripts\") pod \"eed07ed8-afbf-4c01-8a27-678404cb17e1\" (UID: \"eed07ed8-afbf-4c01-8a27-678404cb17e1\") " Mar 16 16:07:20 crc kubenswrapper[5120]: I0316 16:07:20.434626 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eed07ed8-afbf-4c01-8a27-678404cb17e1-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "eed07ed8-afbf-4c01-8a27-678404cb17e1" (UID: "eed07ed8-afbf-4c01-8a27-678404cb17e1"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:07:20 crc kubenswrapper[5120]: I0316 16:07:20.434890 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/eed07ed8-afbf-4c01-8a27-678404cb17e1-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:07:20 crc kubenswrapper[5120]: I0316 16:07:20.438865 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eed07ed8-afbf-4c01-8a27-678404cb17e1-kube-api-access-jjfsn" (OuterVolumeSpecName: "kube-api-access-jjfsn") pod "eed07ed8-afbf-4c01-8a27-678404cb17e1" (UID: "eed07ed8-afbf-4c01-8a27-678404cb17e1"). InnerVolumeSpecName "kube-api-access-jjfsn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:07:20 crc kubenswrapper[5120]: I0316 16:07:20.536492 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jjfsn\" (UniqueName: \"kubernetes.io/projected/eed07ed8-afbf-4c01-8a27-678404cb17e1-kube-api-access-jjfsn\") on node \"crc\" DevicePath \"\"" Mar 16 16:07:21 crc kubenswrapper[5120]: I0316 16:07:21.107783 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-4e5e-account-create-update-d4lhk" event={"ID":"eed07ed8-afbf-4c01-8a27-678404cb17e1","Type":"ContainerDied","Data":"89b14a2adff0b11a492f0cd4efcb27f6a502dad0080d6ce995a18def3ea06742"} Mar 16 16:07:21 crc kubenswrapper[5120]: I0316 16:07:21.109258 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="89b14a2adff0b11a492f0cd4efcb27f6a502dad0080d6ce995a18def3ea06742" Mar 16 16:07:21 crc kubenswrapper[5120]: I0316 16:07:21.107879 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-4e5e-account-create-update-d4lhk" Mar 16 16:07:21 crc kubenswrapper[5120]: I0316 16:07:21.110448 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"6d9a26b4-a091-43f5-8625-2194e901021c","Type":"ContainerStarted","Data":"8ecd82c1669b50dc83fc2647cd97edc7c58898ad565a8f6fd97dffcaf6c2a4ea"} Mar 16 16:07:21 crc kubenswrapper[5120]: I0316 16:07:21.110511 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"6d9a26b4-a091-43f5-8625-2194e901021c","Type":"ContainerStarted","Data":"aab293db17585f8a42a939cc07e5b97a9fcea6413f5ca264b304c81a0bf0c22c"} Mar 16 16:07:21 crc kubenswrapper[5120]: I0316 16:07:21.110545 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:07:21 crc kubenswrapper[5120]: I0316 16:07:21.138663 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovn-northd-0" podStartSLOduration=3.138640978 podStartE2EDuration="3.138640978s" podCreationTimestamp="2026-03-16 16:07:18 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:07:21.131464073 +0000 UTC m=+2143.285395760" watchObservedRunningTime="2026-03-16 16:07:21.138640978 +0000 UTC m=+2143.292572645" Mar 16 16:07:21 crc kubenswrapper[5120]: I0316 16:07:21.991392 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/root-account-create-update-plwmc"] Mar 16 16:07:21 crc kubenswrapper[5120]: I0316 16:07:21.992614 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="470f5778-f4dd-45ce-8057-44b18c9cd5b3" containerName="mariadb-database-create" Mar 16 16:07:21 crc kubenswrapper[5120]: I0316 16:07:21.992638 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="470f5778-f4dd-45ce-8057-44b18c9cd5b3" containerName="mariadb-database-create" Mar 16 16:07:21 crc kubenswrapper[5120]: I0316 16:07:21.992682 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97a45f5d-2fa4-4585-ac54-f36d71dab06d" containerName="mariadb-account-create-update" Mar 16 16:07:21 crc kubenswrapper[5120]: I0316 16:07:21.992691 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="97a45f5d-2fa4-4585-ac54-f36d71dab06d" containerName="mariadb-account-create-update" Mar 16 16:07:21 crc kubenswrapper[5120]: I0316 16:07:21.992724 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37366a24-b946-4076-8334-f35f69f94f66" containerName="mariadb-database-create" Mar 16 16:07:21 crc kubenswrapper[5120]: I0316 16:07:21.992732 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="37366a24-b946-4076-8334-f35f69f94f66" containerName="mariadb-database-create" Mar 16 16:07:21 crc kubenswrapper[5120]: I0316 16:07:21.992748 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eed07ed8-afbf-4c01-8a27-678404cb17e1" containerName="mariadb-account-create-update" Mar 16 16:07:21 crc kubenswrapper[5120]: I0316 16:07:21.992755 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="eed07ed8-afbf-4c01-8a27-678404cb17e1" containerName="mariadb-account-create-update" Mar 16 16:07:21 crc kubenswrapper[5120]: I0316 16:07:21.992963 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="97a45f5d-2fa4-4585-ac54-f36d71dab06d" containerName="mariadb-account-create-update" Mar 16 16:07:21 crc kubenswrapper[5120]: I0316 16:07:21.992988 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="eed07ed8-afbf-4c01-8a27-678404cb17e1" containerName="mariadb-account-create-update" Mar 16 16:07:21 crc kubenswrapper[5120]: I0316 16:07:21.992997 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="37366a24-b946-4076-8334-f35f69f94f66" containerName="mariadb-database-create" Mar 16 16:07:21 crc kubenswrapper[5120]: I0316 16:07:21.993009 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="470f5778-f4dd-45ce-8057-44b18c9cd5b3" containerName="mariadb-database-create" Mar 16 16:07:22 crc kubenswrapper[5120]: I0316 16:07:22.002691 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-plwmc" Mar 16 16:07:22 crc kubenswrapper[5120]: I0316 16:07:22.003483 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-plwmc"] Mar 16 16:07:22 crc kubenswrapper[5120]: I0316 16:07:22.026972 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"openstack-mariadb-root-db-secret\"" Mar 16 16:07:22 crc kubenswrapper[5120]: I0316 16:07:22.038736 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-db-create-ltdxc"] Mar 16 16:07:22 crc kubenswrapper[5120]: I0316 16:07:22.045892 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-create-ltdxc" Mar 16 16:07:22 crc kubenswrapper[5120]: I0316 16:07:22.051196 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-db-create-ltdxc"] Mar 16 16:07:22 crc kubenswrapper[5120]: I0316 16:07:22.136673 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-n9m9r"] Mar 16 16:07:22 crc kubenswrapper[5120]: I0316 16:07:22.146772 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-50f3-account-create-update-2jq2l"] Mar 16 16:07:22 crc kubenswrapper[5120]: I0316 16:07:22.146917 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-n9m9r" Mar 16 16:07:22 crc kubenswrapper[5120]: I0316 16:07:22.149114 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"swift-proxy-config-data\"" Mar 16 16:07:22 crc kubenswrapper[5120]: I0316 16:07:22.149147 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"swift-ring-scripts\"" Mar 16 16:07:22 crc kubenswrapper[5120]: I0316 16:07:22.160191 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-n9m9r"] Mar 16 16:07:22 crc kubenswrapper[5120]: I0316 16:07:22.160338 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-50f3-account-create-update-2jq2l" Mar 16 16:07:22 crc kubenswrapper[5120]: I0316 16:07:22.160714 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-50f3-account-create-update-2jq2l"] Mar 16 16:07:22 crc kubenswrapper[5120]: I0316 16:07:22.162035 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"swift-ring-config-data\"" Mar 16 16:07:22 crc kubenswrapper[5120]: I0316 16:07:22.164233 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-db-secret\"" Mar 16 16:07:22 crc kubenswrapper[5120]: I0316 16:07:22.178749 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9ff13503-936e-40c0-a53b-f7aba6d18207-operator-scripts\") pod \"glance-db-create-ltdxc\" (UID: \"9ff13503-936e-40c0-a53b-f7aba6d18207\") " pod="openstack-kuttl-tests/glance-db-create-ltdxc" Mar 16 16:07:22 crc kubenswrapper[5120]: I0316 16:07:22.178971 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e9907b81-310c-410a-b641-81464ba1eef2-operator-scripts\") pod \"root-account-create-update-plwmc\" (UID: \"e9907b81-310c-410a-b641-81464ba1eef2\") " pod="openstack-kuttl-tests/root-account-create-update-plwmc" Mar 16 16:07:22 crc kubenswrapper[5120]: I0316 16:07:22.178993 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhkk9\" (UniqueName: \"kubernetes.io/projected/9ff13503-936e-40c0-a53b-f7aba6d18207-kube-api-access-dhkk9\") pod \"glance-db-create-ltdxc\" (UID: \"9ff13503-936e-40c0-a53b-f7aba6d18207\") " pod="openstack-kuttl-tests/glance-db-create-ltdxc" Mar 16 16:07:22 crc kubenswrapper[5120]: I0316 16:07:22.179070 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/48f884c6-8a4f-4581-8b21-6e4db79ae424-etc-swift\") pod \"swift-storage-0\" (UID: \"48f884c6-8a4f-4581-8b21-6e4db79ae424\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:07:22 crc kubenswrapper[5120]: I0316 16:07:22.179117 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jz22r\" (UniqueName: \"kubernetes.io/projected/e9907b81-310c-410a-b641-81464ba1eef2-kube-api-access-jz22r\") pod \"root-account-create-update-plwmc\" (UID: \"e9907b81-310c-410a-b641-81464ba1eef2\") " pod="openstack-kuttl-tests/root-account-create-update-plwmc" Mar 16 16:07:22 crc kubenswrapper[5120]: E0316 16:07:22.179267 5120 projected.go:289] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Mar 16 16:07:22 crc kubenswrapper[5120]: E0316 16:07:22.179286 5120 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Mar 16 16:07:22 crc kubenswrapper[5120]: E0316 16:07:22.179328 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/48f884c6-8a4f-4581-8b21-6e4db79ae424-etc-swift podName:48f884c6-8a4f-4581-8b21-6e4db79ae424 nodeName:}" failed. No retries permitted until 2026-03-16 16:07:26.179314454 +0000 UTC m=+2148.333246101 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/48f884c6-8a4f-4581-8b21-6e4db79ae424-etc-swift") pod "swift-storage-0" (UID: "48f884c6-8a4f-4581-8b21-6e4db79ae424") : configmap "swift-ring-files" not found Mar 16 16:07:22 crc kubenswrapper[5120]: I0316 16:07:22.280431 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e9907b81-310c-410a-b641-81464ba1eef2-operator-scripts\") pod \"root-account-create-update-plwmc\" (UID: \"e9907b81-310c-410a-b641-81464ba1eef2\") " pod="openstack-kuttl-tests/root-account-create-update-plwmc" Mar 16 16:07:22 crc kubenswrapper[5120]: I0316 16:07:22.280482 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dhkk9\" (UniqueName: \"kubernetes.io/projected/9ff13503-936e-40c0-a53b-f7aba6d18207-kube-api-access-dhkk9\") pod \"glance-db-create-ltdxc\" (UID: \"9ff13503-936e-40c0-a53b-f7aba6d18207\") " pod="openstack-kuttl-tests/glance-db-create-ltdxc" Mar 16 16:07:22 crc kubenswrapper[5120]: I0316 16:07:22.280514 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/0b4120b5-aa8b-4c93-a209-e3769c0069d3-swiftconf\") pod \"swift-ring-rebalance-n9m9r\" (UID: \"0b4120b5-aa8b-4c93-a209-e3769c0069d3\") " pod="openstack-kuttl-tests/swift-ring-rebalance-n9m9r" Mar 16 16:07:22 crc kubenswrapper[5120]: I0316 16:07:22.280568 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/0b4120b5-aa8b-4c93-a209-e3769c0069d3-etc-swift\") pod \"swift-ring-rebalance-n9m9r\" (UID: \"0b4120b5-aa8b-4c93-a209-e3769c0069d3\") " pod="openstack-kuttl-tests/swift-ring-rebalance-n9m9r" Mar 16 16:07:22 crc kubenswrapper[5120]: I0316 16:07:22.280753 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/0b4120b5-aa8b-4c93-a209-e3769c0069d3-dispersionconf\") pod \"swift-ring-rebalance-n9m9r\" (UID: \"0b4120b5-aa8b-4c93-a209-e3769c0069d3\") " pod="openstack-kuttl-tests/swift-ring-rebalance-n9m9r" Mar 16 16:07:22 crc kubenswrapper[5120]: I0316 16:07:22.280887 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jz22r\" (UniqueName: \"kubernetes.io/projected/e9907b81-310c-410a-b641-81464ba1eef2-kube-api-access-jz22r\") pod \"root-account-create-update-plwmc\" (UID: \"e9907b81-310c-410a-b641-81464ba1eef2\") " pod="openstack-kuttl-tests/root-account-create-update-plwmc" Mar 16 16:07:22 crc kubenswrapper[5120]: I0316 16:07:22.280914 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/0b4120b5-aa8b-4c93-a209-e3769c0069d3-ring-data-devices\") pod \"swift-ring-rebalance-n9m9r\" (UID: \"0b4120b5-aa8b-4c93-a209-e3769c0069d3\") " pod="openstack-kuttl-tests/swift-ring-rebalance-n9m9r" Mar 16 16:07:22 crc kubenswrapper[5120]: I0316 16:07:22.280935 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9ff13503-936e-40c0-a53b-f7aba6d18207-operator-scripts\") pod \"glance-db-create-ltdxc\" (UID: \"9ff13503-936e-40c0-a53b-f7aba6d18207\") " pod="openstack-kuttl-tests/glance-db-create-ltdxc" Mar 16 16:07:22 crc kubenswrapper[5120]: I0316 16:07:22.281053 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9a3b4da1-9cf7-4528-ac87-31dee1cd7afb-operator-scripts\") pod \"glance-50f3-account-create-update-2jq2l\" (UID: \"9a3b4da1-9cf7-4528-ac87-31dee1cd7afb\") " pod="openstack-kuttl-tests/glance-50f3-account-create-update-2jq2l" Mar 16 16:07:22 crc kubenswrapper[5120]: I0316 16:07:22.281162 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e9907b81-310c-410a-b641-81464ba1eef2-operator-scripts\") pod \"root-account-create-update-plwmc\" (UID: \"e9907b81-310c-410a-b641-81464ba1eef2\") " pod="openstack-kuttl-tests/root-account-create-update-plwmc" Mar 16 16:07:22 crc kubenswrapper[5120]: I0316 16:07:22.281240 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0b4120b5-aa8b-4c93-a209-e3769c0069d3-combined-ca-bundle\") pod \"swift-ring-rebalance-n9m9r\" (UID: \"0b4120b5-aa8b-4c93-a209-e3769c0069d3\") " pod="openstack-kuttl-tests/swift-ring-rebalance-n9m9r" Mar 16 16:07:22 crc kubenswrapper[5120]: I0316 16:07:22.281273 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/0b4120b5-aa8b-4c93-a209-e3769c0069d3-scripts\") pod \"swift-ring-rebalance-n9m9r\" (UID: \"0b4120b5-aa8b-4c93-a209-e3769c0069d3\") " pod="openstack-kuttl-tests/swift-ring-rebalance-n9m9r" Mar 16 16:07:22 crc kubenswrapper[5120]: I0316 16:07:22.281314 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zlcqx\" (UniqueName: \"kubernetes.io/projected/0b4120b5-aa8b-4c93-a209-e3769c0069d3-kube-api-access-zlcqx\") pod \"swift-ring-rebalance-n9m9r\" (UID: \"0b4120b5-aa8b-4c93-a209-e3769c0069d3\") " pod="openstack-kuttl-tests/swift-ring-rebalance-n9m9r" Mar 16 16:07:22 crc kubenswrapper[5120]: I0316 16:07:22.281629 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9ff13503-936e-40c0-a53b-f7aba6d18207-operator-scripts\") pod \"glance-db-create-ltdxc\" (UID: \"9ff13503-936e-40c0-a53b-f7aba6d18207\") " pod="openstack-kuttl-tests/glance-db-create-ltdxc" Mar 16 16:07:22 crc kubenswrapper[5120]: I0316 16:07:22.282107 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8vbf\" (UniqueName: \"kubernetes.io/projected/9a3b4da1-9cf7-4528-ac87-31dee1cd7afb-kube-api-access-d8vbf\") pod \"glance-50f3-account-create-update-2jq2l\" (UID: \"9a3b4da1-9cf7-4528-ac87-31dee1cd7afb\") " pod="openstack-kuttl-tests/glance-50f3-account-create-update-2jq2l" Mar 16 16:07:22 crc kubenswrapper[5120]: I0316 16:07:22.305158 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jz22r\" (UniqueName: \"kubernetes.io/projected/e9907b81-310c-410a-b641-81464ba1eef2-kube-api-access-jz22r\") pod \"root-account-create-update-plwmc\" (UID: \"e9907b81-310c-410a-b641-81464ba1eef2\") " pod="openstack-kuttl-tests/root-account-create-update-plwmc" Mar 16 16:07:22 crc kubenswrapper[5120]: I0316 16:07:22.309409 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhkk9\" (UniqueName: \"kubernetes.io/projected/9ff13503-936e-40c0-a53b-f7aba6d18207-kube-api-access-dhkk9\") pod \"glance-db-create-ltdxc\" (UID: \"9ff13503-936e-40c0-a53b-f7aba6d18207\") " pod="openstack-kuttl-tests/glance-db-create-ltdxc" Mar 16 16:07:22 crc kubenswrapper[5120]: I0316 16:07:22.334653 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-plwmc" Mar 16 16:07:22 crc kubenswrapper[5120]: I0316 16:07:22.370709 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-create-ltdxc" Mar 16 16:07:22 crc kubenswrapper[5120]: I0316 16:07:22.384112 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0b4120b5-aa8b-4c93-a209-e3769c0069d3-combined-ca-bundle\") pod \"swift-ring-rebalance-n9m9r\" (UID: \"0b4120b5-aa8b-4c93-a209-e3769c0069d3\") " pod="openstack-kuttl-tests/swift-ring-rebalance-n9m9r" Mar 16 16:07:22 crc kubenswrapper[5120]: I0316 16:07:22.384183 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/0b4120b5-aa8b-4c93-a209-e3769c0069d3-scripts\") pod \"swift-ring-rebalance-n9m9r\" (UID: \"0b4120b5-aa8b-4c93-a209-e3769c0069d3\") " pod="openstack-kuttl-tests/swift-ring-rebalance-n9m9r" Mar 16 16:07:22 crc kubenswrapper[5120]: I0316 16:07:22.384239 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zlcqx\" (UniqueName: \"kubernetes.io/projected/0b4120b5-aa8b-4c93-a209-e3769c0069d3-kube-api-access-zlcqx\") pod \"swift-ring-rebalance-n9m9r\" (UID: \"0b4120b5-aa8b-4c93-a209-e3769c0069d3\") " pod="openstack-kuttl-tests/swift-ring-rebalance-n9m9r" Mar 16 16:07:22 crc kubenswrapper[5120]: I0316 16:07:22.384330 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d8vbf\" (UniqueName: \"kubernetes.io/projected/9a3b4da1-9cf7-4528-ac87-31dee1cd7afb-kube-api-access-d8vbf\") pod \"glance-50f3-account-create-update-2jq2l\" (UID: \"9a3b4da1-9cf7-4528-ac87-31dee1cd7afb\") " pod="openstack-kuttl-tests/glance-50f3-account-create-update-2jq2l" Mar 16 16:07:22 crc kubenswrapper[5120]: I0316 16:07:22.384388 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/0b4120b5-aa8b-4c93-a209-e3769c0069d3-swiftconf\") pod \"swift-ring-rebalance-n9m9r\" (UID: \"0b4120b5-aa8b-4c93-a209-e3769c0069d3\") " pod="openstack-kuttl-tests/swift-ring-rebalance-n9m9r" Mar 16 16:07:22 crc kubenswrapper[5120]: I0316 16:07:22.384450 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/0b4120b5-aa8b-4c93-a209-e3769c0069d3-etc-swift\") pod \"swift-ring-rebalance-n9m9r\" (UID: \"0b4120b5-aa8b-4c93-a209-e3769c0069d3\") " pod="openstack-kuttl-tests/swift-ring-rebalance-n9m9r" Mar 16 16:07:22 crc kubenswrapper[5120]: I0316 16:07:22.384507 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/0b4120b5-aa8b-4c93-a209-e3769c0069d3-dispersionconf\") pod \"swift-ring-rebalance-n9m9r\" (UID: \"0b4120b5-aa8b-4c93-a209-e3769c0069d3\") " pod="openstack-kuttl-tests/swift-ring-rebalance-n9m9r" Mar 16 16:07:22 crc kubenswrapper[5120]: I0316 16:07:22.384707 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/0b4120b5-aa8b-4c93-a209-e3769c0069d3-ring-data-devices\") pod \"swift-ring-rebalance-n9m9r\" (UID: \"0b4120b5-aa8b-4c93-a209-e3769c0069d3\") " pod="openstack-kuttl-tests/swift-ring-rebalance-n9m9r" Mar 16 16:07:22 crc kubenswrapper[5120]: I0316 16:07:22.384835 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9a3b4da1-9cf7-4528-ac87-31dee1cd7afb-operator-scripts\") pod \"glance-50f3-account-create-update-2jq2l\" (UID: \"9a3b4da1-9cf7-4528-ac87-31dee1cd7afb\") " pod="openstack-kuttl-tests/glance-50f3-account-create-update-2jq2l" Mar 16 16:07:22 crc kubenswrapper[5120]: I0316 16:07:22.385249 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/0b4120b5-aa8b-4c93-a209-e3769c0069d3-etc-swift\") pod \"swift-ring-rebalance-n9m9r\" (UID: \"0b4120b5-aa8b-4c93-a209-e3769c0069d3\") " pod="openstack-kuttl-tests/swift-ring-rebalance-n9m9r" Mar 16 16:07:22 crc kubenswrapper[5120]: I0316 16:07:22.385684 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/0b4120b5-aa8b-4c93-a209-e3769c0069d3-scripts\") pod \"swift-ring-rebalance-n9m9r\" (UID: \"0b4120b5-aa8b-4c93-a209-e3769c0069d3\") " pod="openstack-kuttl-tests/swift-ring-rebalance-n9m9r" Mar 16 16:07:22 crc kubenswrapper[5120]: I0316 16:07:22.385704 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9a3b4da1-9cf7-4528-ac87-31dee1cd7afb-operator-scripts\") pod \"glance-50f3-account-create-update-2jq2l\" (UID: \"9a3b4da1-9cf7-4528-ac87-31dee1cd7afb\") " pod="openstack-kuttl-tests/glance-50f3-account-create-update-2jq2l" Mar 16 16:07:22 crc kubenswrapper[5120]: I0316 16:07:22.385865 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/0b4120b5-aa8b-4c93-a209-e3769c0069d3-ring-data-devices\") pod \"swift-ring-rebalance-n9m9r\" (UID: \"0b4120b5-aa8b-4c93-a209-e3769c0069d3\") " pod="openstack-kuttl-tests/swift-ring-rebalance-n9m9r" Mar 16 16:07:22 crc kubenswrapper[5120]: I0316 16:07:22.391157 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/0b4120b5-aa8b-4c93-a209-e3769c0069d3-dispersionconf\") pod \"swift-ring-rebalance-n9m9r\" (UID: \"0b4120b5-aa8b-4c93-a209-e3769c0069d3\") " pod="openstack-kuttl-tests/swift-ring-rebalance-n9m9r" Mar 16 16:07:22 crc kubenswrapper[5120]: I0316 16:07:22.391795 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0b4120b5-aa8b-4c93-a209-e3769c0069d3-combined-ca-bundle\") pod \"swift-ring-rebalance-n9m9r\" (UID: \"0b4120b5-aa8b-4c93-a209-e3769c0069d3\") " pod="openstack-kuttl-tests/swift-ring-rebalance-n9m9r" Mar 16 16:07:22 crc kubenswrapper[5120]: I0316 16:07:22.392645 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/0b4120b5-aa8b-4c93-a209-e3769c0069d3-swiftconf\") pod \"swift-ring-rebalance-n9m9r\" (UID: \"0b4120b5-aa8b-4c93-a209-e3769c0069d3\") " pod="openstack-kuttl-tests/swift-ring-rebalance-n9m9r" Mar 16 16:07:22 crc kubenswrapper[5120]: I0316 16:07:22.410657 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8vbf\" (UniqueName: \"kubernetes.io/projected/9a3b4da1-9cf7-4528-ac87-31dee1cd7afb-kube-api-access-d8vbf\") pod \"glance-50f3-account-create-update-2jq2l\" (UID: \"9a3b4da1-9cf7-4528-ac87-31dee1cd7afb\") " pod="openstack-kuttl-tests/glance-50f3-account-create-update-2jq2l" Mar 16 16:07:22 crc kubenswrapper[5120]: I0316 16:07:22.425140 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zlcqx\" (UniqueName: \"kubernetes.io/projected/0b4120b5-aa8b-4c93-a209-e3769c0069d3-kube-api-access-zlcqx\") pod \"swift-ring-rebalance-n9m9r\" (UID: \"0b4120b5-aa8b-4c93-a209-e3769c0069d3\") " pod="openstack-kuttl-tests/swift-ring-rebalance-n9m9r" Mar 16 16:07:22 crc kubenswrapper[5120]: I0316 16:07:22.479033 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-n9m9r" Mar 16 16:07:22 crc kubenswrapper[5120]: I0316 16:07:22.496158 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-50f3-account-create-update-2jq2l" Mar 16 16:07:22 crc kubenswrapper[5120]: I0316 16:07:22.773667 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-plwmc"] Mar 16 16:07:22 crc kubenswrapper[5120]: I0316 16:07:22.897659 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-db-create-ltdxc"] Mar 16 16:07:22 crc kubenswrapper[5120]: W0316 16:07:22.905207 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9ff13503_936e_40c0_a53b_f7aba6d18207.slice/crio-aa0de2bde6c94d7ed1d6f6df1bd23d7b1c51759492924caa0fb3a9093414ab30 WatchSource:0}: Error finding container aa0de2bde6c94d7ed1d6f6df1bd23d7b1c51759492924caa0fb3a9093414ab30: Status 404 returned error can't find the container with id aa0de2bde6c94d7ed1d6f6df1bd23d7b1c51759492924caa0fb3a9093414ab30 Mar 16 16:07:22 crc kubenswrapper[5120]: I0316 16:07:22.996245 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-50f3-account-create-update-2jq2l"] Mar 16 16:07:23 crc kubenswrapper[5120]: W0316 16:07:23.003168 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9a3b4da1_9cf7_4528_ac87_31dee1cd7afb.slice/crio-5c45349ebb6aa7c9cb63e47204a43ea6062b7f57f460e3f19adba35d90cab129 WatchSource:0}: Error finding container 5c45349ebb6aa7c9cb63e47204a43ea6062b7f57f460e3f19adba35d90cab129: Status 404 returned error can't find the container with id 5c45349ebb6aa7c9cb63e47204a43ea6062b7f57f460e3f19adba35d90cab129 Mar 16 16:07:23 crc kubenswrapper[5120]: I0316 16:07:23.004778 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-n9m9r"] Mar 16 16:07:23 crc kubenswrapper[5120]: I0316 16:07:23.138607 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-50f3-account-create-update-2jq2l" event={"ID":"9a3b4da1-9cf7-4528-ac87-31dee1cd7afb","Type":"ContainerStarted","Data":"338a4c6e64d209ed4d346929a28dc2143b3211f5409248ed277e37b3256fb3bb"} Mar 16 16:07:23 crc kubenswrapper[5120]: I0316 16:07:23.138668 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-50f3-account-create-update-2jq2l" event={"ID":"9a3b4da1-9cf7-4528-ac87-31dee1cd7afb","Type":"ContainerStarted","Data":"5c45349ebb6aa7c9cb63e47204a43ea6062b7f57f460e3f19adba35d90cab129"} Mar 16 16:07:23 crc kubenswrapper[5120]: I0316 16:07:23.141184 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-n9m9r" event={"ID":"0b4120b5-aa8b-4c93-a209-e3769c0069d3","Type":"ContainerStarted","Data":"47d633177181c4dfaa6f5c8f860b40d6c1dbb447d6a33bdfe9b86521ad9f220a"} Mar 16 16:07:23 crc kubenswrapper[5120]: I0316 16:07:23.143733 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-create-ltdxc" event={"ID":"9ff13503-936e-40c0-a53b-f7aba6d18207","Type":"ContainerStarted","Data":"46ae5a5cbe875d392d93e2aa52d34a36d06631d65696ef319b2ce14949187170"} Mar 16 16:07:23 crc kubenswrapper[5120]: I0316 16:07:23.143807 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-create-ltdxc" event={"ID":"9ff13503-936e-40c0-a53b-f7aba6d18207","Type":"ContainerStarted","Data":"aa0de2bde6c94d7ed1d6f6df1bd23d7b1c51759492924caa0fb3a9093414ab30"} Mar 16 16:07:23 crc kubenswrapper[5120]: I0316 16:07:23.147209 5120 generic.go:358] "Generic (PLEG): container finished" podID="e9907b81-310c-410a-b641-81464ba1eef2" containerID="bb807065494461dabeab9e186ea493043b77e0f1742a89c1e691ebc8d1336a32" exitCode=0 Mar 16 16:07:23 crc kubenswrapper[5120]: I0316 16:07:23.147364 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-plwmc" event={"ID":"e9907b81-310c-410a-b641-81464ba1eef2","Type":"ContainerDied","Data":"bb807065494461dabeab9e186ea493043b77e0f1742a89c1e691ebc8d1336a32"} Mar 16 16:07:23 crc kubenswrapper[5120]: I0316 16:07:23.147418 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-plwmc" event={"ID":"e9907b81-310c-410a-b641-81464ba1eef2","Type":"ContainerStarted","Data":"8be9afdb3629c5987a817b029a192c68862c1a9b96f1868d94b7bde288d19998"} Mar 16 16:07:23 crc kubenswrapper[5120]: I0316 16:07:23.153883 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-50f3-account-create-update-2jq2l" podStartSLOduration=1.153863745 podStartE2EDuration="1.153863745s" podCreationTimestamp="2026-03-16 16:07:22 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:07:23.151083579 +0000 UTC m=+2145.305015236" watchObservedRunningTime="2026-03-16 16:07:23.153863745 +0000 UTC m=+2145.307795402" Mar 16 16:07:23 crc kubenswrapper[5120]: I0316 16:07:23.168396 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-db-create-ltdxc" podStartSLOduration=1.168374051 podStartE2EDuration="1.168374051s" podCreationTimestamp="2026-03-16 16:07:22 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:07:23.164523735 +0000 UTC m=+2145.318455392" watchObservedRunningTime="2026-03-16 16:07:23.168374051 +0000 UTC m=+2145.322305708" Mar 16 16:07:24 crc kubenswrapper[5120]: I0316 16:07:24.160894 5120 generic.go:358] "Generic (PLEG): container finished" podID="9a3b4da1-9cf7-4528-ac87-31dee1cd7afb" containerID="338a4c6e64d209ed4d346929a28dc2143b3211f5409248ed277e37b3256fb3bb" exitCode=0 Mar 16 16:07:24 crc kubenswrapper[5120]: I0316 16:07:24.160966 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-50f3-account-create-update-2jq2l" event={"ID":"9a3b4da1-9cf7-4528-ac87-31dee1cd7afb","Type":"ContainerDied","Data":"338a4c6e64d209ed4d346929a28dc2143b3211f5409248ed277e37b3256fb3bb"} Mar 16 16:07:24 crc kubenswrapper[5120]: I0316 16:07:24.164524 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-n9m9r" event={"ID":"0b4120b5-aa8b-4c93-a209-e3769c0069d3","Type":"ContainerStarted","Data":"4c9bf2a4036100b44427b712e056877a7288adad770792d826877af6b30e4386"} Mar 16 16:07:24 crc kubenswrapper[5120]: I0316 16:07:24.167612 5120 generic.go:358] "Generic (PLEG): container finished" podID="9ff13503-936e-40c0-a53b-f7aba6d18207" containerID="46ae5a5cbe875d392d93e2aa52d34a36d06631d65696ef319b2ce14949187170" exitCode=0 Mar 16 16:07:24 crc kubenswrapper[5120]: I0316 16:07:24.167815 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-create-ltdxc" event={"ID":"9ff13503-936e-40c0-a53b-f7aba6d18207","Type":"ContainerDied","Data":"46ae5a5cbe875d392d93e2aa52d34a36d06631d65696ef319b2ce14949187170"} Mar 16 16:07:24 crc kubenswrapper[5120]: I0316 16:07:24.224695 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/swift-ring-rebalance-n9m9r" podStartSLOduration=2.224672633 podStartE2EDuration="2.224672633s" podCreationTimestamp="2026-03-16 16:07:22 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:07:24.218838353 +0000 UTC m=+2146.372770010" watchObservedRunningTime="2026-03-16 16:07:24.224672633 +0000 UTC m=+2146.378604290" Mar 16 16:07:24 crc kubenswrapper[5120]: I0316 16:07:24.624090 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-plwmc" Mar 16 16:07:24 crc kubenswrapper[5120]: I0316 16:07:24.741492 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e9907b81-310c-410a-b641-81464ba1eef2-operator-scripts\") pod \"e9907b81-310c-410a-b641-81464ba1eef2\" (UID: \"e9907b81-310c-410a-b641-81464ba1eef2\") " Mar 16 16:07:24 crc kubenswrapper[5120]: I0316 16:07:24.741837 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jz22r\" (UniqueName: \"kubernetes.io/projected/e9907b81-310c-410a-b641-81464ba1eef2-kube-api-access-jz22r\") pod \"e9907b81-310c-410a-b641-81464ba1eef2\" (UID: \"e9907b81-310c-410a-b641-81464ba1eef2\") " Mar 16 16:07:24 crc kubenswrapper[5120]: I0316 16:07:24.742138 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e9907b81-310c-410a-b641-81464ba1eef2-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "e9907b81-310c-410a-b641-81464ba1eef2" (UID: "e9907b81-310c-410a-b641-81464ba1eef2"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:07:24 crc kubenswrapper[5120]: I0316 16:07:24.742302 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e9907b81-310c-410a-b641-81464ba1eef2-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:07:24 crc kubenswrapper[5120]: I0316 16:07:24.747900 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9907b81-310c-410a-b641-81464ba1eef2-kube-api-access-jz22r" (OuterVolumeSpecName: "kube-api-access-jz22r") pod "e9907b81-310c-410a-b641-81464ba1eef2" (UID: "e9907b81-310c-410a-b641-81464ba1eef2"). InnerVolumeSpecName "kube-api-access-jz22r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:07:24 crc kubenswrapper[5120]: I0316 16:07:24.843671 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jz22r\" (UniqueName: \"kubernetes.io/projected/e9907b81-310c-410a-b641-81464ba1eef2-kube-api-access-jz22r\") on node \"crc\" DevicePath \"\"" Mar 16 16:07:25 crc kubenswrapper[5120]: I0316 16:07:25.182196 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-plwmc" Mar 16 16:07:25 crc kubenswrapper[5120]: I0316 16:07:25.182229 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-plwmc" event={"ID":"e9907b81-310c-410a-b641-81464ba1eef2","Type":"ContainerDied","Data":"8be9afdb3629c5987a817b029a192c68862c1a9b96f1868d94b7bde288d19998"} Mar 16 16:07:25 crc kubenswrapper[5120]: I0316 16:07:25.182314 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8be9afdb3629c5987a817b029a192c68862c1a9b96f1868d94b7bde288d19998" Mar 16 16:07:25 crc kubenswrapper[5120]: I0316 16:07:25.776191 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-create-ltdxc" Mar 16 16:07:25 crc kubenswrapper[5120]: I0316 16:07:25.781381 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-50f3-account-create-update-2jq2l" Mar 16 16:07:25 crc kubenswrapper[5120]: I0316 16:07:25.867262 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9ff13503-936e-40c0-a53b-f7aba6d18207-operator-scripts\") pod \"9ff13503-936e-40c0-a53b-f7aba6d18207\" (UID: \"9ff13503-936e-40c0-a53b-f7aba6d18207\") " Mar 16 16:07:25 crc kubenswrapper[5120]: I0316 16:07:25.867484 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dhkk9\" (UniqueName: \"kubernetes.io/projected/9ff13503-936e-40c0-a53b-f7aba6d18207-kube-api-access-dhkk9\") pod \"9ff13503-936e-40c0-a53b-f7aba6d18207\" (UID: \"9ff13503-936e-40c0-a53b-f7aba6d18207\") " Mar 16 16:07:25 crc kubenswrapper[5120]: I0316 16:07:25.867571 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9a3b4da1-9cf7-4528-ac87-31dee1cd7afb-operator-scripts\") pod \"9a3b4da1-9cf7-4528-ac87-31dee1cd7afb\" (UID: \"9a3b4da1-9cf7-4528-ac87-31dee1cd7afb\") " Mar 16 16:07:25 crc kubenswrapper[5120]: I0316 16:07:25.867599 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d8vbf\" (UniqueName: \"kubernetes.io/projected/9a3b4da1-9cf7-4528-ac87-31dee1cd7afb-kube-api-access-d8vbf\") pod \"9a3b4da1-9cf7-4528-ac87-31dee1cd7afb\" (UID: \"9a3b4da1-9cf7-4528-ac87-31dee1cd7afb\") " Mar 16 16:07:25 crc kubenswrapper[5120]: I0316 16:07:25.867855 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ff13503-936e-40c0-a53b-f7aba6d18207-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "9ff13503-936e-40c0-a53b-f7aba6d18207" (UID: "9ff13503-936e-40c0-a53b-f7aba6d18207"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:07:25 crc kubenswrapper[5120]: I0316 16:07:25.868304 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9ff13503-936e-40c0-a53b-f7aba6d18207-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:07:25 crc kubenswrapper[5120]: I0316 16:07:25.868463 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a3b4da1-9cf7-4528-ac87-31dee1cd7afb-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "9a3b4da1-9cf7-4528-ac87-31dee1cd7afb" (UID: "9a3b4da1-9cf7-4528-ac87-31dee1cd7afb"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:07:25 crc kubenswrapper[5120]: I0316 16:07:25.872450 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a3b4da1-9cf7-4528-ac87-31dee1cd7afb-kube-api-access-d8vbf" (OuterVolumeSpecName: "kube-api-access-d8vbf") pod "9a3b4da1-9cf7-4528-ac87-31dee1cd7afb" (UID: "9a3b4da1-9cf7-4528-ac87-31dee1cd7afb"). InnerVolumeSpecName "kube-api-access-d8vbf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:07:25 crc kubenswrapper[5120]: I0316 16:07:25.879016 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ff13503-936e-40c0-a53b-f7aba6d18207-kube-api-access-dhkk9" (OuterVolumeSpecName: "kube-api-access-dhkk9") pod "9ff13503-936e-40c0-a53b-f7aba6d18207" (UID: "9ff13503-936e-40c0-a53b-f7aba6d18207"). InnerVolumeSpecName "kube-api-access-dhkk9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:07:25 crc kubenswrapper[5120]: I0316 16:07:25.969896 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dhkk9\" (UniqueName: \"kubernetes.io/projected/9ff13503-936e-40c0-a53b-f7aba6d18207-kube-api-access-dhkk9\") on node \"crc\" DevicePath \"\"" Mar 16 16:07:25 crc kubenswrapper[5120]: I0316 16:07:25.969933 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9a3b4da1-9cf7-4528-ac87-31dee1cd7afb-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:07:25 crc kubenswrapper[5120]: I0316 16:07:25.969944 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d8vbf\" (UniqueName: \"kubernetes.io/projected/9a3b4da1-9cf7-4528-ac87-31dee1cd7afb-kube-api-access-d8vbf\") on node \"crc\" DevicePath \"\"" Mar 16 16:07:26 crc kubenswrapper[5120]: I0316 16:07:26.192193 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-50f3-account-create-update-2jq2l" Mar 16 16:07:26 crc kubenswrapper[5120]: I0316 16:07:26.192198 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-50f3-account-create-update-2jq2l" event={"ID":"9a3b4da1-9cf7-4528-ac87-31dee1cd7afb","Type":"ContainerDied","Data":"5c45349ebb6aa7c9cb63e47204a43ea6062b7f57f460e3f19adba35d90cab129"} Mar 16 16:07:26 crc kubenswrapper[5120]: I0316 16:07:26.192245 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5c45349ebb6aa7c9cb63e47204a43ea6062b7f57f460e3f19adba35d90cab129" Mar 16 16:07:26 crc kubenswrapper[5120]: I0316 16:07:26.194453 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-create-ltdxc" Mar 16 16:07:26 crc kubenswrapper[5120]: I0316 16:07:26.194492 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-create-ltdxc" event={"ID":"9ff13503-936e-40c0-a53b-f7aba6d18207","Type":"ContainerDied","Data":"aa0de2bde6c94d7ed1d6f6df1bd23d7b1c51759492924caa0fb3a9093414ab30"} Mar 16 16:07:26 crc kubenswrapper[5120]: I0316 16:07:26.194543 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="aa0de2bde6c94d7ed1d6f6df1bd23d7b1c51759492924caa0fb3a9093414ab30" Mar 16 16:07:26 crc kubenswrapper[5120]: I0316 16:07:26.276875 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/48f884c6-8a4f-4581-8b21-6e4db79ae424-etc-swift\") pod \"swift-storage-0\" (UID: \"48f884c6-8a4f-4581-8b21-6e4db79ae424\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:07:26 crc kubenswrapper[5120]: E0316 16:07:26.277122 5120 projected.go:289] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Mar 16 16:07:26 crc kubenswrapper[5120]: E0316 16:07:26.277149 5120 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Mar 16 16:07:26 crc kubenswrapper[5120]: E0316 16:07:26.277217 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/48f884c6-8a4f-4581-8b21-6e4db79ae424-etc-swift podName:48f884c6-8a4f-4581-8b21-6e4db79ae424 nodeName:}" failed. No retries permitted until 2026-03-16 16:07:34.277195136 +0000 UTC m=+2156.431126803 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/48f884c6-8a4f-4581-8b21-6e4db79ae424-etc-swift") pod "swift-storage-0" (UID: "48f884c6-8a4f-4581-8b21-6e4db79ae424") : configmap "swift-ring-files" not found Mar 16 16:07:27 crc kubenswrapper[5120]: I0316 16:07:27.359217 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-db-sync-p9g8j"] Mar 16 16:07:27 crc kubenswrapper[5120]: I0316 16:07:27.360710 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a3b4da1-9cf7-4528-ac87-31dee1cd7afb" containerName="mariadb-account-create-update" Mar 16 16:07:27 crc kubenswrapper[5120]: I0316 16:07:27.360728 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a3b4da1-9cf7-4528-ac87-31dee1cd7afb" containerName="mariadb-account-create-update" Mar 16 16:07:27 crc kubenswrapper[5120]: I0316 16:07:27.360775 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9907b81-310c-410a-b641-81464ba1eef2" containerName="mariadb-account-create-update" Mar 16 16:07:27 crc kubenswrapper[5120]: I0316 16:07:27.360784 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9907b81-310c-410a-b641-81464ba1eef2" containerName="mariadb-account-create-update" Mar 16 16:07:27 crc kubenswrapper[5120]: I0316 16:07:27.360802 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ff13503-936e-40c0-a53b-f7aba6d18207" containerName="mariadb-database-create" Mar 16 16:07:27 crc kubenswrapper[5120]: I0316 16:07:27.360810 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ff13503-936e-40c0-a53b-f7aba6d18207" containerName="mariadb-database-create" Mar 16 16:07:27 crc kubenswrapper[5120]: I0316 16:07:27.369148 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="9a3b4da1-9cf7-4528-ac87-31dee1cd7afb" containerName="mariadb-account-create-update" Mar 16 16:07:27 crc kubenswrapper[5120]: I0316 16:07:27.369219 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="9ff13503-936e-40c0-a53b-f7aba6d18207" containerName="mariadb-database-create" Mar 16 16:07:27 crc kubenswrapper[5120]: I0316 16:07:27.369237 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e9907b81-310c-410a-b641-81464ba1eef2" containerName="mariadb-account-create-update" Mar 16 16:07:27 crc kubenswrapper[5120]: I0316 16:07:27.376697 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-p9g8j" Mar 16 16:07:27 crc kubenswrapper[5120]: I0316 16:07:27.381555 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-config-data\"" Mar 16 16:07:27 crc kubenswrapper[5120]: I0316 16:07:27.381797 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-glance-dockercfg-4kfq2\"" Mar 16 16:07:27 crc kubenswrapper[5120]: I0316 16:07:27.389700 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-p9g8j"] Mar 16 16:07:27 crc kubenswrapper[5120]: I0316 16:07:27.499990 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bclhs\" (UniqueName: \"kubernetes.io/projected/2ea6a8e2-a7a3-4ba1-8d0a-84869664dbea-kube-api-access-bclhs\") pod \"glance-db-sync-p9g8j\" (UID: \"2ea6a8e2-a7a3-4ba1-8d0a-84869664dbea\") " pod="openstack-kuttl-tests/glance-db-sync-p9g8j" Mar 16 16:07:27 crc kubenswrapper[5120]: I0316 16:07:27.500051 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/2ea6a8e2-a7a3-4ba1-8d0a-84869664dbea-db-sync-config-data\") pod \"glance-db-sync-p9g8j\" (UID: \"2ea6a8e2-a7a3-4ba1-8d0a-84869664dbea\") " pod="openstack-kuttl-tests/glance-db-sync-p9g8j" Mar 16 16:07:27 crc kubenswrapper[5120]: I0316 16:07:27.500070 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2ea6a8e2-a7a3-4ba1-8d0a-84869664dbea-config-data\") pod \"glance-db-sync-p9g8j\" (UID: \"2ea6a8e2-a7a3-4ba1-8d0a-84869664dbea\") " pod="openstack-kuttl-tests/glance-db-sync-p9g8j" Mar 16 16:07:27 crc kubenswrapper[5120]: I0316 16:07:27.500291 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2ea6a8e2-a7a3-4ba1-8d0a-84869664dbea-combined-ca-bundle\") pod \"glance-db-sync-p9g8j\" (UID: \"2ea6a8e2-a7a3-4ba1-8d0a-84869664dbea\") " pod="openstack-kuttl-tests/glance-db-sync-p9g8j" Mar 16 16:07:27 crc kubenswrapper[5120]: I0316 16:07:27.602256 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bclhs\" (UniqueName: \"kubernetes.io/projected/2ea6a8e2-a7a3-4ba1-8d0a-84869664dbea-kube-api-access-bclhs\") pod \"glance-db-sync-p9g8j\" (UID: \"2ea6a8e2-a7a3-4ba1-8d0a-84869664dbea\") " pod="openstack-kuttl-tests/glance-db-sync-p9g8j" Mar 16 16:07:27 crc kubenswrapper[5120]: I0316 16:07:27.602348 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/2ea6a8e2-a7a3-4ba1-8d0a-84869664dbea-db-sync-config-data\") pod \"glance-db-sync-p9g8j\" (UID: \"2ea6a8e2-a7a3-4ba1-8d0a-84869664dbea\") " pod="openstack-kuttl-tests/glance-db-sync-p9g8j" Mar 16 16:07:27 crc kubenswrapper[5120]: I0316 16:07:27.602371 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2ea6a8e2-a7a3-4ba1-8d0a-84869664dbea-config-data\") pod \"glance-db-sync-p9g8j\" (UID: \"2ea6a8e2-a7a3-4ba1-8d0a-84869664dbea\") " pod="openstack-kuttl-tests/glance-db-sync-p9g8j" Mar 16 16:07:27 crc kubenswrapper[5120]: I0316 16:07:27.602449 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2ea6a8e2-a7a3-4ba1-8d0a-84869664dbea-combined-ca-bundle\") pod \"glance-db-sync-p9g8j\" (UID: \"2ea6a8e2-a7a3-4ba1-8d0a-84869664dbea\") " pod="openstack-kuttl-tests/glance-db-sync-p9g8j" Mar 16 16:07:27 crc kubenswrapper[5120]: I0316 16:07:27.609538 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2ea6a8e2-a7a3-4ba1-8d0a-84869664dbea-combined-ca-bundle\") pod \"glance-db-sync-p9g8j\" (UID: \"2ea6a8e2-a7a3-4ba1-8d0a-84869664dbea\") " pod="openstack-kuttl-tests/glance-db-sync-p9g8j" Mar 16 16:07:27 crc kubenswrapper[5120]: I0316 16:07:27.609549 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/2ea6a8e2-a7a3-4ba1-8d0a-84869664dbea-db-sync-config-data\") pod \"glance-db-sync-p9g8j\" (UID: \"2ea6a8e2-a7a3-4ba1-8d0a-84869664dbea\") " pod="openstack-kuttl-tests/glance-db-sync-p9g8j" Mar 16 16:07:27 crc kubenswrapper[5120]: I0316 16:07:27.610105 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2ea6a8e2-a7a3-4ba1-8d0a-84869664dbea-config-data\") pod \"glance-db-sync-p9g8j\" (UID: \"2ea6a8e2-a7a3-4ba1-8d0a-84869664dbea\") " pod="openstack-kuttl-tests/glance-db-sync-p9g8j" Mar 16 16:07:27 crc kubenswrapper[5120]: I0316 16:07:27.633819 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bclhs\" (UniqueName: \"kubernetes.io/projected/2ea6a8e2-a7a3-4ba1-8d0a-84869664dbea-kube-api-access-bclhs\") pod \"glance-db-sync-p9g8j\" (UID: \"2ea6a8e2-a7a3-4ba1-8d0a-84869664dbea\") " pod="openstack-kuttl-tests/glance-db-sync-p9g8j" Mar 16 16:07:27 crc kubenswrapper[5120]: I0316 16:07:27.716576 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-p9g8j" Mar 16 16:07:28 crc kubenswrapper[5120]: I0316 16:07:28.172071 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-p9g8j"] Mar 16 16:07:28 crc kubenswrapper[5120]: I0316 16:07:28.227662 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-p9g8j" event={"ID":"2ea6a8e2-a7a3-4ba1-8d0a-84869664dbea","Type":"ContainerStarted","Data":"784a62490d5ecfcec3ae76baa3b6933a36e38f2c8c3f6559445ce3855294ba2f"} Mar 16 16:07:28 crc kubenswrapper[5120]: I0316 16:07:28.418185 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-plwmc"] Mar 16 16:07:28 crc kubenswrapper[5120]: I0316 16:07:28.428217 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-plwmc"] Mar 16 16:07:28 crc kubenswrapper[5120]: I0316 16:07:28.696086 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e9907b81-310c-410a-b641-81464ba1eef2" path="/var/lib/kubelet/pods/e9907b81-310c-410a-b641-81464ba1eef2/volumes" Mar 16 16:07:29 crc kubenswrapper[5120]: I0316 16:07:29.239169 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-p9g8j" event={"ID":"2ea6a8e2-a7a3-4ba1-8d0a-84869664dbea","Type":"ContainerStarted","Data":"6060d2b9c2cbedb1a777ad8436125f9d2123d7f0cd501d724bf438032f344b6b"} Mar 16 16:07:30 crc kubenswrapper[5120]: I0316 16:07:30.253464 5120 generic.go:358] "Generic (PLEG): container finished" podID="0b4120b5-aa8b-4c93-a209-e3769c0069d3" containerID="4c9bf2a4036100b44427b712e056877a7288adad770792d826877af6b30e4386" exitCode=0 Mar 16 16:07:30 crc kubenswrapper[5120]: I0316 16:07:30.253534 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-n9m9r" event={"ID":"0b4120b5-aa8b-4c93-a209-e3769c0069d3","Type":"ContainerDied","Data":"4c9bf2a4036100b44427b712e056877a7288adad770792d826877af6b30e4386"} Mar 16 16:07:30 crc kubenswrapper[5120]: I0316 16:07:30.276200 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-db-sync-p9g8j" podStartSLOduration=3.276171421 podStartE2EDuration="3.276171421s" podCreationTimestamp="2026-03-16 16:07:27 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:07:29.265054111 +0000 UTC m=+2151.418985778" watchObservedRunningTime="2026-03-16 16:07:30.276171421 +0000 UTC m=+2152.430103118" Mar 16 16:07:31 crc kubenswrapper[5120]: I0316 16:07:31.682250 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-n9m9r" Mar 16 16:07:31 crc kubenswrapper[5120]: I0316 16:07:31.710649 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0b4120b5-aa8b-4c93-a209-e3769c0069d3-combined-ca-bundle\") pod \"0b4120b5-aa8b-4c93-a209-e3769c0069d3\" (UID: \"0b4120b5-aa8b-4c93-a209-e3769c0069d3\") " Mar 16 16:07:31 crc kubenswrapper[5120]: I0316 16:07:31.710906 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/0b4120b5-aa8b-4c93-a209-e3769c0069d3-scripts\") pod \"0b4120b5-aa8b-4c93-a209-e3769c0069d3\" (UID: \"0b4120b5-aa8b-4c93-a209-e3769c0069d3\") " Mar 16 16:07:31 crc kubenswrapper[5120]: I0316 16:07:31.710989 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/0b4120b5-aa8b-4c93-a209-e3769c0069d3-etc-swift\") pod \"0b4120b5-aa8b-4c93-a209-e3769c0069d3\" (UID: \"0b4120b5-aa8b-4c93-a209-e3769c0069d3\") " Mar 16 16:07:31 crc kubenswrapper[5120]: I0316 16:07:31.711104 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/0b4120b5-aa8b-4c93-a209-e3769c0069d3-swiftconf\") pod \"0b4120b5-aa8b-4c93-a209-e3769c0069d3\" (UID: \"0b4120b5-aa8b-4c93-a209-e3769c0069d3\") " Mar 16 16:07:31 crc kubenswrapper[5120]: I0316 16:07:31.711324 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/0b4120b5-aa8b-4c93-a209-e3769c0069d3-ring-data-devices\") pod \"0b4120b5-aa8b-4c93-a209-e3769c0069d3\" (UID: \"0b4120b5-aa8b-4c93-a209-e3769c0069d3\") " Mar 16 16:07:31 crc kubenswrapper[5120]: I0316 16:07:31.711441 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zlcqx\" (UniqueName: \"kubernetes.io/projected/0b4120b5-aa8b-4c93-a209-e3769c0069d3-kube-api-access-zlcqx\") pod \"0b4120b5-aa8b-4c93-a209-e3769c0069d3\" (UID: \"0b4120b5-aa8b-4c93-a209-e3769c0069d3\") " Mar 16 16:07:31 crc kubenswrapper[5120]: I0316 16:07:31.711490 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/0b4120b5-aa8b-4c93-a209-e3769c0069d3-dispersionconf\") pod \"0b4120b5-aa8b-4c93-a209-e3769c0069d3\" (UID: \"0b4120b5-aa8b-4c93-a209-e3769c0069d3\") " Mar 16 16:07:31 crc kubenswrapper[5120]: I0316 16:07:31.712544 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b4120b5-aa8b-4c93-a209-e3769c0069d3-ring-data-devices" (OuterVolumeSpecName: "ring-data-devices") pod "0b4120b5-aa8b-4c93-a209-e3769c0069d3" (UID: "0b4120b5-aa8b-4c93-a209-e3769c0069d3"). InnerVolumeSpecName "ring-data-devices". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:07:31 crc kubenswrapper[5120]: I0316 16:07:31.714114 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b4120b5-aa8b-4c93-a209-e3769c0069d3-etc-swift" (OuterVolumeSpecName: "etc-swift") pod "0b4120b5-aa8b-4c93-a209-e3769c0069d3" (UID: "0b4120b5-aa8b-4c93-a209-e3769c0069d3"). InnerVolumeSpecName "etc-swift". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:07:31 crc kubenswrapper[5120]: I0316 16:07:31.714493 5120 reconciler_common.go:299] "Volume detached for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/0b4120b5-aa8b-4c93-a209-e3769c0069d3-ring-data-devices\") on node \"crc\" DevicePath \"\"" Mar 16 16:07:31 crc kubenswrapper[5120]: I0316 16:07:31.719837 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b4120b5-aa8b-4c93-a209-e3769c0069d3-kube-api-access-zlcqx" (OuterVolumeSpecName: "kube-api-access-zlcqx") pod "0b4120b5-aa8b-4c93-a209-e3769c0069d3" (UID: "0b4120b5-aa8b-4c93-a209-e3769c0069d3"). InnerVolumeSpecName "kube-api-access-zlcqx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:07:31 crc kubenswrapper[5120]: I0316 16:07:31.722253 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b4120b5-aa8b-4c93-a209-e3769c0069d3-dispersionconf" (OuterVolumeSpecName: "dispersionconf") pod "0b4120b5-aa8b-4c93-a209-e3769c0069d3" (UID: "0b4120b5-aa8b-4c93-a209-e3769c0069d3"). InnerVolumeSpecName "dispersionconf". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:07:31 crc kubenswrapper[5120]: I0316 16:07:31.737798 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b4120b5-aa8b-4c93-a209-e3769c0069d3-scripts" (OuterVolumeSpecName: "scripts") pod "0b4120b5-aa8b-4c93-a209-e3769c0069d3" (UID: "0b4120b5-aa8b-4c93-a209-e3769c0069d3"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:07:31 crc kubenswrapper[5120]: I0316 16:07:31.752548 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b4120b5-aa8b-4c93-a209-e3769c0069d3-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "0b4120b5-aa8b-4c93-a209-e3769c0069d3" (UID: "0b4120b5-aa8b-4c93-a209-e3769c0069d3"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:07:31 crc kubenswrapper[5120]: I0316 16:07:31.753037 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b4120b5-aa8b-4c93-a209-e3769c0069d3-swiftconf" (OuterVolumeSpecName: "swiftconf") pod "0b4120b5-aa8b-4c93-a209-e3769c0069d3" (UID: "0b4120b5-aa8b-4c93-a209-e3769c0069d3"). InnerVolumeSpecName "swiftconf". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:07:31 crc kubenswrapper[5120]: I0316 16:07:31.817965 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zlcqx\" (UniqueName: \"kubernetes.io/projected/0b4120b5-aa8b-4c93-a209-e3769c0069d3-kube-api-access-zlcqx\") on node \"crc\" DevicePath \"\"" Mar 16 16:07:31 crc kubenswrapper[5120]: I0316 16:07:31.818002 5120 reconciler_common.go:299] "Volume detached for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/0b4120b5-aa8b-4c93-a209-e3769c0069d3-dispersionconf\") on node \"crc\" DevicePath \"\"" Mar 16 16:07:31 crc kubenswrapper[5120]: I0316 16:07:31.818015 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0b4120b5-aa8b-4c93-a209-e3769c0069d3-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:07:31 crc kubenswrapper[5120]: I0316 16:07:31.818026 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/0b4120b5-aa8b-4c93-a209-e3769c0069d3-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:07:31 crc kubenswrapper[5120]: I0316 16:07:31.818038 5120 reconciler_common.go:299] "Volume detached for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/0b4120b5-aa8b-4c93-a209-e3769c0069d3-etc-swift\") on node \"crc\" DevicePath \"\"" Mar 16 16:07:31 crc kubenswrapper[5120]: I0316 16:07:31.818049 5120 reconciler_common.go:299] "Volume detached for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/0b4120b5-aa8b-4c93-a209-e3769c0069d3-swiftconf\") on node \"crc\" DevicePath \"\"" Mar 16 16:07:32 crc kubenswrapper[5120]: I0316 16:07:32.229550 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:07:32 crc kubenswrapper[5120]: I0316 16:07:32.293995 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-n9m9r" event={"ID":"0b4120b5-aa8b-4c93-a209-e3769c0069d3","Type":"ContainerDied","Data":"47d633177181c4dfaa6f5c8f860b40d6c1dbb447d6a33bdfe9b86521ad9f220a"} Mar 16 16:07:32 crc kubenswrapper[5120]: I0316 16:07:32.294040 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="47d633177181c4dfaa6f5c8f860b40d6c1dbb447d6a33bdfe9b86521ad9f220a" Mar 16 16:07:32 crc kubenswrapper[5120]: I0316 16:07:32.295693 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-n9m9r" Mar 16 16:07:33 crc kubenswrapper[5120]: I0316 16:07:33.425402 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/root-account-create-update-zx8b6"] Mar 16 16:07:33 crc kubenswrapper[5120]: I0316 16:07:33.427380 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b4120b5-aa8b-4c93-a209-e3769c0069d3" containerName="swift-ring-rebalance" Mar 16 16:07:33 crc kubenswrapper[5120]: I0316 16:07:33.427457 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b4120b5-aa8b-4c93-a209-e3769c0069d3" containerName="swift-ring-rebalance" Mar 16 16:07:33 crc kubenswrapper[5120]: I0316 16:07:33.427950 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="0b4120b5-aa8b-4c93-a209-e3769c0069d3" containerName="swift-ring-rebalance" Mar 16 16:07:33 crc kubenswrapper[5120]: I0316 16:07:33.433706 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-zx8b6" Mar 16 16:07:33 crc kubenswrapper[5120]: I0316 16:07:33.486564 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"openstack-cell1-mariadb-root-db-secret\"" Mar 16 16:07:33 crc kubenswrapper[5120]: I0316 16:07:33.487286 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-zx8b6"] Mar 16 16:07:33 crc kubenswrapper[5120]: I0316 16:07:33.583465 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vlhsn\" (UniqueName: \"kubernetes.io/projected/5456d112-8c46-47d8-ad8f-ea7c98f258e9-kube-api-access-vlhsn\") pod \"root-account-create-update-zx8b6\" (UID: \"5456d112-8c46-47d8-ad8f-ea7c98f258e9\") " pod="openstack-kuttl-tests/root-account-create-update-zx8b6" Mar 16 16:07:33 crc kubenswrapper[5120]: I0316 16:07:33.584006 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5456d112-8c46-47d8-ad8f-ea7c98f258e9-operator-scripts\") pod \"root-account-create-update-zx8b6\" (UID: \"5456d112-8c46-47d8-ad8f-ea7c98f258e9\") " pod="openstack-kuttl-tests/root-account-create-update-zx8b6" Mar 16 16:07:33 crc kubenswrapper[5120]: I0316 16:07:33.686359 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5456d112-8c46-47d8-ad8f-ea7c98f258e9-operator-scripts\") pod \"root-account-create-update-zx8b6\" (UID: \"5456d112-8c46-47d8-ad8f-ea7c98f258e9\") " pod="openstack-kuttl-tests/root-account-create-update-zx8b6" Mar 16 16:07:33 crc kubenswrapper[5120]: I0316 16:07:33.686523 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vlhsn\" (UniqueName: \"kubernetes.io/projected/5456d112-8c46-47d8-ad8f-ea7c98f258e9-kube-api-access-vlhsn\") pod \"root-account-create-update-zx8b6\" (UID: \"5456d112-8c46-47d8-ad8f-ea7c98f258e9\") " pod="openstack-kuttl-tests/root-account-create-update-zx8b6" Mar 16 16:07:33 crc kubenswrapper[5120]: I0316 16:07:33.688405 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5456d112-8c46-47d8-ad8f-ea7c98f258e9-operator-scripts\") pod \"root-account-create-update-zx8b6\" (UID: \"5456d112-8c46-47d8-ad8f-ea7c98f258e9\") " pod="openstack-kuttl-tests/root-account-create-update-zx8b6" Mar 16 16:07:33 crc kubenswrapper[5120]: I0316 16:07:33.706478 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vlhsn\" (UniqueName: \"kubernetes.io/projected/5456d112-8c46-47d8-ad8f-ea7c98f258e9-kube-api-access-vlhsn\") pod \"root-account-create-update-zx8b6\" (UID: \"5456d112-8c46-47d8-ad8f-ea7c98f258e9\") " pod="openstack-kuttl-tests/root-account-create-update-zx8b6" Mar 16 16:07:33 crc kubenswrapper[5120]: I0316 16:07:33.793439 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-zx8b6" Mar 16 16:07:34 crc kubenswrapper[5120]: I0316 16:07:34.246235 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-zx8b6"] Mar 16 16:07:34 crc kubenswrapper[5120]: W0316 16:07:34.251794 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5456d112_8c46_47d8_ad8f_ea7c98f258e9.slice/crio-09bf2d88c61414cc2a8eb71e1299fbf89c4b9a18d439180c5df07a82be5d8fc5 WatchSource:0}: Error finding container 09bf2d88c61414cc2a8eb71e1299fbf89c4b9a18d439180c5df07a82be5d8fc5: Status 404 returned error can't find the container with id 09bf2d88c61414cc2a8eb71e1299fbf89c4b9a18d439180c5df07a82be5d8fc5 Mar 16 16:07:34 crc kubenswrapper[5120]: I0316 16:07:34.298849 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/48f884c6-8a4f-4581-8b21-6e4db79ae424-etc-swift\") pod \"swift-storage-0\" (UID: \"48f884c6-8a4f-4581-8b21-6e4db79ae424\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:07:34 crc kubenswrapper[5120]: I0316 16:07:34.305091 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/48f884c6-8a4f-4581-8b21-6e4db79ae424-etc-swift\") pod \"swift-storage-0\" (UID: \"48f884c6-8a4f-4581-8b21-6e4db79ae424\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:07:34 crc kubenswrapper[5120]: I0316 16:07:34.312717 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-zx8b6" event={"ID":"5456d112-8c46-47d8-ad8f-ea7c98f258e9","Type":"ContainerStarted","Data":"09bf2d88c61414cc2a8eb71e1299fbf89c4b9a18d439180c5df07a82be5d8fc5"} Mar 16 16:07:34 crc kubenswrapper[5120]: I0316 16:07:34.599746 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:07:35 crc kubenswrapper[5120]: I0316 16:07:35.134040 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 16:07:35 crc kubenswrapper[5120]: I0316 16:07:35.323806 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"48f884c6-8a4f-4581-8b21-6e4db79ae424","Type":"ContainerStarted","Data":"7f52beabfcff3227464395535efe06bcce13fd954b9eb69868803bda7c0f42b8"} Mar 16 16:07:35 crc kubenswrapper[5120]: I0316 16:07:35.324394 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"48f884c6-8a4f-4581-8b21-6e4db79ae424","Type":"ContainerStarted","Data":"6d7b4186c898fe068943e79be73641fcf9c14cb56c0750d17ebe0c2be442a952"} Mar 16 16:07:35 crc kubenswrapper[5120]: I0316 16:07:35.325181 5120 generic.go:358] "Generic (PLEG): container finished" podID="5456d112-8c46-47d8-ad8f-ea7c98f258e9" containerID="ef034b0dc3688c457c0d09580ee4ff2656fb6c3a4fa9faae91c39e03fbeb13d3" exitCode=0 Mar 16 16:07:35 crc kubenswrapper[5120]: I0316 16:07:35.325279 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-zx8b6" event={"ID":"5456d112-8c46-47d8-ad8f-ea7c98f258e9","Type":"ContainerDied","Data":"ef034b0dc3688c457c0d09580ee4ff2656fb6c3a4fa9faae91c39e03fbeb13d3"} Mar 16 16:07:35 crc kubenswrapper[5120]: I0316 16:07:35.326622 5120 generic.go:358] "Generic (PLEG): container finished" podID="2ea6a8e2-a7a3-4ba1-8d0a-84869664dbea" containerID="6060d2b9c2cbedb1a777ad8436125f9d2123d7f0cd501d724bf438032f344b6b" exitCode=0 Mar 16 16:07:35 crc kubenswrapper[5120]: I0316 16:07:35.326708 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-p9g8j" event={"ID":"2ea6a8e2-a7a3-4ba1-8d0a-84869664dbea","Type":"ContainerDied","Data":"6060d2b9c2cbedb1a777ad8436125f9d2123d7f0cd501d724bf438032f344b6b"} Mar 16 16:07:36 crc kubenswrapper[5120]: I0316 16:07:36.335837 5120 generic.go:358] "Generic (PLEG): container finished" podID="ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab" containerID="94de8c59b353553a4799b3d3ca3292a1d0b46fa43cd5dc0cd5e7d0974e74e3c0" exitCode=0 Mar 16 16:07:36 crc kubenswrapper[5120]: I0316 16:07:36.335897 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab","Type":"ContainerDied","Data":"94de8c59b353553a4799b3d3ca3292a1d0b46fa43cd5dc0cd5e7d0974e74e3c0"} Mar 16 16:07:36 crc kubenswrapper[5120]: I0316 16:07:36.340899 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"48f884c6-8a4f-4581-8b21-6e4db79ae424","Type":"ContainerStarted","Data":"bd5bde381422aec36b49a27e33e7df18130a58904e5277a758731159e4602f17"} Mar 16 16:07:36 crc kubenswrapper[5120]: I0316 16:07:36.340969 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"48f884c6-8a4f-4581-8b21-6e4db79ae424","Type":"ContainerStarted","Data":"51d5b8b2b99674a1960ad863d81ad3a57a5eb88f5643007686739c6718ac88e6"} Mar 16 16:07:36 crc kubenswrapper[5120]: I0316 16:07:36.340991 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"48f884c6-8a4f-4581-8b21-6e4db79ae424","Type":"ContainerStarted","Data":"c68e0b66544e05eeafb40a0ede57f1aaffd7e86fe267efb1d86740b24f029cd4"} Mar 16 16:07:36 crc kubenswrapper[5120]: I0316 16:07:36.341009 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"48f884c6-8a4f-4581-8b21-6e4db79ae424","Type":"ContainerStarted","Data":"4bce9c9cadac21d7a22c0911253a06b757eab3c3a10ee9e0b5056d5ddc880b03"} Mar 16 16:07:36 crc kubenswrapper[5120]: I0316 16:07:36.341025 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"48f884c6-8a4f-4581-8b21-6e4db79ae424","Type":"ContainerStarted","Data":"d15b7b1dedfc5e0bf45e87214537c30c6e63e98b399564a5d04a921d97d3ee71"} Mar 16 16:07:36 crc kubenswrapper[5120]: I0316 16:07:36.906802 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-p9g8j" Mar 16 16:07:36 crc kubenswrapper[5120]: I0316 16:07:36.911377 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-zx8b6" Mar 16 16:07:37 crc kubenswrapper[5120]: I0316 16:07:37.052570 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2ea6a8e2-a7a3-4ba1-8d0a-84869664dbea-combined-ca-bundle\") pod \"2ea6a8e2-a7a3-4ba1-8d0a-84869664dbea\" (UID: \"2ea6a8e2-a7a3-4ba1-8d0a-84869664dbea\") " Mar 16 16:07:37 crc kubenswrapper[5120]: I0316 16:07:37.052697 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5456d112-8c46-47d8-ad8f-ea7c98f258e9-operator-scripts\") pod \"5456d112-8c46-47d8-ad8f-ea7c98f258e9\" (UID: \"5456d112-8c46-47d8-ad8f-ea7c98f258e9\") " Mar 16 16:07:37 crc kubenswrapper[5120]: I0316 16:07:37.052823 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2ea6a8e2-a7a3-4ba1-8d0a-84869664dbea-config-data\") pod \"2ea6a8e2-a7a3-4ba1-8d0a-84869664dbea\" (UID: \"2ea6a8e2-a7a3-4ba1-8d0a-84869664dbea\") " Mar 16 16:07:37 crc kubenswrapper[5120]: I0316 16:07:37.052855 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vlhsn\" (UniqueName: \"kubernetes.io/projected/5456d112-8c46-47d8-ad8f-ea7c98f258e9-kube-api-access-vlhsn\") pod \"5456d112-8c46-47d8-ad8f-ea7c98f258e9\" (UID: \"5456d112-8c46-47d8-ad8f-ea7c98f258e9\") " Mar 16 16:07:37 crc kubenswrapper[5120]: I0316 16:07:37.052929 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bclhs\" (UniqueName: \"kubernetes.io/projected/2ea6a8e2-a7a3-4ba1-8d0a-84869664dbea-kube-api-access-bclhs\") pod \"2ea6a8e2-a7a3-4ba1-8d0a-84869664dbea\" (UID: \"2ea6a8e2-a7a3-4ba1-8d0a-84869664dbea\") " Mar 16 16:07:37 crc kubenswrapper[5120]: I0316 16:07:37.052969 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/2ea6a8e2-a7a3-4ba1-8d0a-84869664dbea-db-sync-config-data\") pod \"2ea6a8e2-a7a3-4ba1-8d0a-84869664dbea\" (UID: \"2ea6a8e2-a7a3-4ba1-8d0a-84869664dbea\") " Mar 16 16:07:37 crc kubenswrapper[5120]: I0316 16:07:37.053152 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5456d112-8c46-47d8-ad8f-ea7c98f258e9-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "5456d112-8c46-47d8-ad8f-ea7c98f258e9" (UID: "5456d112-8c46-47d8-ad8f-ea7c98f258e9"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:07:37 crc kubenswrapper[5120]: I0316 16:07:37.053553 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5456d112-8c46-47d8-ad8f-ea7c98f258e9-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:07:37 crc kubenswrapper[5120]: I0316 16:07:37.056971 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2ea6a8e2-a7a3-4ba1-8d0a-84869664dbea-db-sync-config-data" (OuterVolumeSpecName: "db-sync-config-data") pod "2ea6a8e2-a7a3-4ba1-8d0a-84869664dbea" (UID: "2ea6a8e2-a7a3-4ba1-8d0a-84869664dbea"). InnerVolumeSpecName "db-sync-config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:07:37 crc kubenswrapper[5120]: I0316 16:07:37.057017 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5456d112-8c46-47d8-ad8f-ea7c98f258e9-kube-api-access-vlhsn" (OuterVolumeSpecName: "kube-api-access-vlhsn") pod "5456d112-8c46-47d8-ad8f-ea7c98f258e9" (UID: "5456d112-8c46-47d8-ad8f-ea7c98f258e9"). InnerVolumeSpecName "kube-api-access-vlhsn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:07:37 crc kubenswrapper[5120]: I0316 16:07:37.058275 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ea6a8e2-a7a3-4ba1-8d0a-84869664dbea-kube-api-access-bclhs" (OuterVolumeSpecName: "kube-api-access-bclhs") pod "2ea6a8e2-a7a3-4ba1-8d0a-84869664dbea" (UID: "2ea6a8e2-a7a3-4ba1-8d0a-84869664dbea"). InnerVolumeSpecName "kube-api-access-bclhs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:07:37 crc kubenswrapper[5120]: I0316 16:07:37.085290 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2ea6a8e2-a7a3-4ba1-8d0a-84869664dbea-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "2ea6a8e2-a7a3-4ba1-8d0a-84869664dbea" (UID: "2ea6a8e2-a7a3-4ba1-8d0a-84869664dbea"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:07:37 crc kubenswrapper[5120]: I0316 16:07:37.095595 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2ea6a8e2-a7a3-4ba1-8d0a-84869664dbea-config-data" (OuterVolumeSpecName: "config-data") pod "2ea6a8e2-a7a3-4ba1-8d0a-84869664dbea" (UID: "2ea6a8e2-a7a3-4ba1-8d0a-84869664dbea"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:07:37 crc kubenswrapper[5120]: I0316 16:07:37.156068 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2ea6a8e2-a7a3-4ba1-8d0a-84869664dbea-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:07:37 crc kubenswrapper[5120]: I0316 16:07:37.156367 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vlhsn\" (UniqueName: \"kubernetes.io/projected/5456d112-8c46-47d8-ad8f-ea7c98f258e9-kube-api-access-vlhsn\") on node \"crc\" DevicePath \"\"" Mar 16 16:07:37 crc kubenswrapper[5120]: I0316 16:07:37.156500 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bclhs\" (UniqueName: \"kubernetes.io/projected/2ea6a8e2-a7a3-4ba1-8d0a-84869664dbea-kube-api-access-bclhs\") on node \"crc\" DevicePath \"\"" Mar 16 16:07:37 crc kubenswrapper[5120]: I0316 16:07:37.156651 5120 reconciler_common.go:299] "Volume detached for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/2ea6a8e2-a7a3-4ba1-8d0a-84869664dbea-db-sync-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:07:37 crc kubenswrapper[5120]: I0316 16:07:37.156829 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2ea6a8e2-a7a3-4ba1-8d0a-84869664dbea-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:07:37 crc kubenswrapper[5120]: I0316 16:07:37.365974 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-p9g8j" Mar 16 16:07:37 crc kubenswrapper[5120]: I0316 16:07:37.366073 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-p9g8j" event={"ID":"2ea6a8e2-a7a3-4ba1-8d0a-84869664dbea","Type":"ContainerDied","Data":"784a62490d5ecfcec3ae76baa3b6933a36e38f2c8c3f6559445ce3855294ba2f"} Mar 16 16:07:37 crc kubenswrapper[5120]: I0316 16:07:37.366429 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="784a62490d5ecfcec3ae76baa3b6933a36e38f2c8c3f6559445ce3855294ba2f" Mar 16 16:07:37 crc kubenswrapper[5120]: I0316 16:07:37.373324 5120 generic.go:358] "Generic (PLEG): container finished" podID="de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a" containerID="7d286781c85f27264a622c02590c76a23cfac9e679af6dc9a77a928f3e408dea" exitCode=0 Mar 16 16:07:37 crc kubenswrapper[5120]: I0316 16:07:37.373403 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a","Type":"ContainerDied","Data":"7d286781c85f27264a622c02590c76a23cfac9e679af6dc9a77a928f3e408dea"} Mar 16 16:07:37 crc kubenswrapper[5120]: I0316 16:07:37.413160 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"48f884c6-8a4f-4581-8b21-6e4db79ae424","Type":"ContainerStarted","Data":"0a908a6be3baace96c3eef973eb82131e5167c3067b1203a7c21f2622485ee33"} Mar 16 16:07:37 crc kubenswrapper[5120]: I0316 16:07:37.413202 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"48f884c6-8a4f-4581-8b21-6e4db79ae424","Type":"ContainerStarted","Data":"85fba775e10e93053a28f47416e4fab8a8d74704457a1dcaa326ca7d97b5b71f"} Mar 16 16:07:37 crc kubenswrapper[5120]: I0316 16:07:37.413212 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"48f884c6-8a4f-4581-8b21-6e4db79ae424","Type":"ContainerStarted","Data":"0f89eb629ca87b8f3c4dc3a654ad9be3b3dbf2b9befef91351aef67313564f2a"} Mar 16 16:07:37 crc kubenswrapper[5120]: I0316 16:07:37.413220 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"48f884c6-8a4f-4581-8b21-6e4db79ae424","Type":"ContainerStarted","Data":"f1f5ef3a1ae4a49a755f7af35d2f4253955831c27a90812260b878eecdda0e64"} Mar 16 16:07:37 crc kubenswrapper[5120]: I0316 16:07:37.413229 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"48f884c6-8a4f-4581-8b21-6e4db79ae424","Type":"ContainerStarted","Data":"f9a925d5514cb6701f37d65b406ab354233d03c77e454fdee7f9de6e3c4f2ec2"} Mar 16 16:07:37 crc kubenswrapper[5120]: I0316 16:07:37.413241 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"48f884c6-8a4f-4581-8b21-6e4db79ae424","Type":"ContainerStarted","Data":"c0e4c801b2d8158c5198a10ed551d4bc0bd991a66fd9a3696cf629419472d00b"} Mar 16 16:07:37 crc kubenswrapper[5120]: I0316 16:07:37.426482 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab","Type":"ContainerStarted","Data":"77ffbd2a006faa2311265374def09aab4240f2b98fa437187ccdbc91b27f6851"} Mar 16 16:07:37 crc kubenswrapper[5120]: I0316 16:07:37.427692 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:07:37 crc kubenswrapper[5120]: I0316 16:07:37.429743 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-zx8b6" event={"ID":"5456d112-8c46-47d8-ad8f-ea7c98f258e9","Type":"ContainerDied","Data":"09bf2d88c61414cc2a8eb71e1299fbf89c4b9a18d439180c5df07a82be5d8fc5"} Mar 16 16:07:37 crc kubenswrapper[5120]: I0316 16:07:37.429833 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="09bf2d88c61414cc2a8eb71e1299fbf89c4b9a18d439180c5df07a82be5d8fc5" Mar 16 16:07:37 crc kubenswrapper[5120]: I0316 16:07:37.429848 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-zx8b6" Mar 16 16:07:37 crc kubenswrapper[5120]: I0316 16:07:37.457459 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/rabbitmq-server-0" podStartSLOduration=37.457443496 podStartE2EDuration="37.457443496s" podCreationTimestamp="2026-03-16 16:07:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:07:37.45395792 +0000 UTC m=+2159.607889577" watchObservedRunningTime="2026-03-16 16:07:37.457443496 +0000 UTC m=+2159.611375153" Mar 16 16:07:38 crc kubenswrapper[5120]: I0316 16:07:38.441457 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a","Type":"ContainerStarted","Data":"3e1a51a3ccfec99f9c00ec78bcede498befec5590f2c8e330edc09f99539166d"} Mar 16 16:07:38 crc kubenswrapper[5120]: I0316 16:07:38.442161 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:07:38 crc kubenswrapper[5120]: I0316 16:07:38.451449 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"48f884c6-8a4f-4581-8b21-6e4db79ae424","Type":"ContainerStarted","Data":"6ebaa174af16709eabdeaa272a12557155a953a5695f9c4f45bdbbba7bbe258c"} Mar 16 16:07:38 crc kubenswrapper[5120]: I0316 16:07:38.451507 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"48f884c6-8a4f-4581-8b21-6e4db79ae424","Type":"ContainerStarted","Data":"db519ba940e3ae10789232d021fe52325581ff3785213c9476636fdeaec31312"} Mar 16 16:07:38 crc kubenswrapper[5120]: I0316 16:07:38.451528 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"48f884c6-8a4f-4581-8b21-6e4db79ae424","Type":"ContainerStarted","Data":"758c2ce99e07b0ccc53b089f1c58cd33db77d7df92e3795e3715aeb0c2df8a47"} Mar 16 16:07:38 crc kubenswrapper[5120]: I0316 16:07:38.470479 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" podStartSLOduration=38.470458125 podStartE2EDuration="38.470458125s" podCreationTimestamp="2026-03-16 16:07:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:07:38.467521585 +0000 UTC m=+2160.621453252" watchObservedRunningTime="2026-03-16 16:07:38.470458125 +0000 UTC m=+2160.624389792" Mar 16 16:07:38 crc kubenswrapper[5120]: I0316 16:07:38.514384 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/swift-storage-0" podStartSLOduration=21.514364643 podStartE2EDuration="21.514364643s" podCreationTimestamp="2026-03-16 16:07:17 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:07:38.507691662 +0000 UTC m=+2160.661623319" watchObservedRunningTime="2026-03-16 16:07:38.514364643 +0000 UTC m=+2160.668296300" Mar 16 16:07:38 crc kubenswrapper[5120]: I0316 16:07:38.682582 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-5885f554cc-qwxkj"] Mar 16 16:07:38 crc kubenswrapper[5120]: I0316 16:07:38.683723 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5456d112-8c46-47d8-ad8f-ea7c98f258e9" containerName="mariadb-account-create-update" Mar 16 16:07:38 crc kubenswrapper[5120]: I0316 16:07:38.683743 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="5456d112-8c46-47d8-ad8f-ea7c98f258e9" containerName="mariadb-account-create-update" Mar 16 16:07:38 crc kubenswrapper[5120]: I0316 16:07:38.683778 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ea6a8e2-a7a3-4ba1-8d0a-84869664dbea" containerName="glance-db-sync" Mar 16 16:07:38 crc kubenswrapper[5120]: I0316 16:07:38.683785 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ea6a8e2-a7a3-4ba1-8d0a-84869664dbea" containerName="glance-db-sync" Mar 16 16:07:38 crc kubenswrapper[5120]: I0316 16:07:38.683919 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="2ea6a8e2-a7a3-4ba1-8d0a-84869664dbea" containerName="glance-db-sync" Mar 16 16:07:38 crc kubenswrapper[5120]: I0316 16:07:38.683930 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="5456d112-8c46-47d8-ad8f-ea7c98f258e9" containerName="mariadb-account-create-update" Mar 16 16:07:38 crc kubenswrapper[5120]: I0316 16:07:38.692222 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-5885f554cc-qwxkj"] Mar 16 16:07:38 crc kubenswrapper[5120]: I0316 16:07:38.692349 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5885f554cc-qwxkj" Mar 16 16:07:38 crc kubenswrapper[5120]: I0316 16:07:38.694169 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"dns-swift-storage-0\"" Mar 16 16:07:38 crc kubenswrapper[5120]: I0316 16:07:38.787357 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6m5x\" (UniqueName: \"kubernetes.io/projected/5243aba2-b42a-4e8f-8e9e-22ebe215585e-kube-api-access-w6m5x\") pod \"dnsmasq-dnsmasq-5885f554cc-qwxkj\" (UID: \"5243aba2-b42a-4e8f-8e9e-22ebe215585e\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5885f554cc-qwxkj" Mar 16 16:07:38 crc kubenswrapper[5120]: I0316 16:07:38.787420 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/5243aba2-b42a-4e8f-8e9e-22ebe215585e-dns-swift-storage-0\") pod \"dnsmasq-dnsmasq-5885f554cc-qwxkj\" (UID: \"5243aba2-b42a-4e8f-8e9e-22ebe215585e\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5885f554cc-qwxkj" Mar 16 16:07:38 crc kubenswrapper[5120]: I0316 16:07:38.787730 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5243aba2-b42a-4e8f-8e9e-22ebe215585e-config\") pod \"dnsmasq-dnsmasq-5885f554cc-qwxkj\" (UID: \"5243aba2-b42a-4e8f-8e9e-22ebe215585e\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5885f554cc-qwxkj" Mar 16 16:07:38 crc kubenswrapper[5120]: I0316 16:07:38.787857 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/5243aba2-b42a-4e8f-8e9e-22ebe215585e-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-5885f554cc-qwxkj\" (UID: \"5243aba2-b42a-4e8f-8e9e-22ebe215585e\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5885f554cc-qwxkj" Mar 16 16:07:38 crc kubenswrapper[5120]: I0316 16:07:38.889149 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5243aba2-b42a-4e8f-8e9e-22ebe215585e-config\") pod \"dnsmasq-dnsmasq-5885f554cc-qwxkj\" (UID: \"5243aba2-b42a-4e8f-8e9e-22ebe215585e\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5885f554cc-qwxkj" Mar 16 16:07:38 crc kubenswrapper[5120]: I0316 16:07:38.889245 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/5243aba2-b42a-4e8f-8e9e-22ebe215585e-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-5885f554cc-qwxkj\" (UID: \"5243aba2-b42a-4e8f-8e9e-22ebe215585e\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5885f554cc-qwxkj" Mar 16 16:07:38 crc kubenswrapper[5120]: I0316 16:07:38.889472 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w6m5x\" (UniqueName: \"kubernetes.io/projected/5243aba2-b42a-4e8f-8e9e-22ebe215585e-kube-api-access-w6m5x\") pod \"dnsmasq-dnsmasq-5885f554cc-qwxkj\" (UID: \"5243aba2-b42a-4e8f-8e9e-22ebe215585e\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5885f554cc-qwxkj" Mar 16 16:07:38 crc kubenswrapper[5120]: I0316 16:07:38.889573 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/5243aba2-b42a-4e8f-8e9e-22ebe215585e-dns-swift-storage-0\") pod \"dnsmasq-dnsmasq-5885f554cc-qwxkj\" (UID: \"5243aba2-b42a-4e8f-8e9e-22ebe215585e\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5885f554cc-qwxkj" Mar 16 16:07:38 crc kubenswrapper[5120]: I0316 16:07:38.890116 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5243aba2-b42a-4e8f-8e9e-22ebe215585e-config\") pod \"dnsmasq-dnsmasq-5885f554cc-qwxkj\" (UID: \"5243aba2-b42a-4e8f-8e9e-22ebe215585e\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5885f554cc-qwxkj" Mar 16 16:07:38 crc kubenswrapper[5120]: I0316 16:07:38.890140 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/5243aba2-b42a-4e8f-8e9e-22ebe215585e-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-5885f554cc-qwxkj\" (UID: \"5243aba2-b42a-4e8f-8e9e-22ebe215585e\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5885f554cc-qwxkj" Mar 16 16:07:38 crc kubenswrapper[5120]: I0316 16:07:38.890479 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/5243aba2-b42a-4e8f-8e9e-22ebe215585e-dns-swift-storage-0\") pod \"dnsmasq-dnsmasq-5885f554cc-qwxkj\" (UID: \"5243aba2-b42a-4e8f-8e9e-22ebe215585e\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5885f554cc-qwxkj" Mar 16 16:07:38 crc kubenswrapper[5120]: I0316 16:07:38.907136 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6m5x\" (UniqueName: \"kubernetes.io/projected/5243aba2-b42a-4e8f-8e9e-22ebe215585e-kube-api-access-w6m5x\") pod \"dnsmasq-dnsmasq-5885f554cc-qwxkj\" (UID: \"5243aba2-b42a-4e8f-8e9e-22ebe215585e\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5885f554cc-qwxkj" Mar 16 16:07:39 crc kubenswrapper[5120]: I0316 16:07:39.016000 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5885f554cc-qwxkj" Mar 16 16:07:39 crc kubenswrapper[5120]: I0316 16:07:39.534924 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-5885f554cc-qwxkj"] Mar 16 16:07:40 crc kubenswrapper[5120]: I0316 16:07:40.477976 5120 generic.go:358] "Generic (PLEG): container finished" podID="5243aba2-b42a-4e8f-8e9e-22ebe215585e" containerID="4a26930fda821322f4a86ee8d32b6d51dfcc2737a5692c286fd2a8b121104552" exitCode=0 Mar 16 16:07:40 crc kubenswrapper[5120]: I0316 16:07:40.478024 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5885f554cc-qwxkj" event={"ID":"5243aba2-b42a-4e8f-8e9e-22ebe215585e","Type":"ContainerDied","Data":"4a26930fda821322f4a86ee8d32b6d51dfcc2737a5692c286fd2a8b121104552"} Mar 16 16:07:40 crc kubenswrapper[5120]: I0316 16:07:40.478589 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5885f554cc-qwxkj" event={"ID":"5243aba2-b42a-4e8f-8e9e-22ebe215585e","Type":"ContainerStarted","Data":"15f2444b22f0c036de31d84b1fd55a4143b42e6f19f3fdd9e31f656200b7b380"} Mar 16 16:07:41 crc kubenswrapper[5120]: I0316 16:07:41.490191 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5885f554cc-qwxkj" event={"ID":"5243aba2-b42a-4e8f-8e9e-22ebe215585e","Type":"ContainerStarted","Data":"c01a04ee6d2c12d188d4c5d55213b4b0c038752d142bf15efe8bee2938820f71"} Mar 16 16:07:41 crc kubenswrapper[5120]: I0316 16:07:41.490493 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5885f554cc-qwxkj" Mar 16 16:07:41 crc kubenswrapper[5120]: I0316 16:07:41.518229 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5885f554cc-qwxkj" podStartSLOduration=3.518208465 podStartE2EDuration="3.518208465s" podCreationTimestamp="2026-03-16 16:07:38 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:07:41.513221498 +0000 UTC m=+2163.667153155" watchObservedRunningTime="2026-03-16 16:07:41.518208465 +0000 UTC m=+2163.672140122" Mar 16 16:07:47 crc kubenswrapper[5120]: I0316 16:07:47.515599 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5885f554cc-qwxkj" Mar 16 16:07:47 crc kubenswrapper[5120]: I0316 16:07:47.591526 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-l8vn4"] Mar 16 16:07:47 crc kubenswrapper[5120]: I0316 16:07:47.591882 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-l8vn4" podUID="26cb0730-b6af-4f60-baa0-3ce77a180060" containerName="dnsmasq-dns" containerID="cri-o://c4923841e960725d0debbe505df5dfd0ea3b5ba0b3dd1e99f961ab5ade2ebc47" gracePeriod=10 Mar 16 16:07:48 crc kubenswrapper[5120]: I0316 16:07:48.163009 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-l8vn4" Mar 16 16:07:48 crc kubenswrapper[5120]: I0316 16:07:48.193069 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/26cb0730-b6af-4f60-baa0-3ce77a180060-dnsmasq-svc\") pod \"26cb0730-b6af-4f60-baa0-3ce77a180060\" (UID: \"26cb0730-b6af-4f60-baa0-3ce77a180060\") " Mar 16 16:07:48 crc kubenswrapper[5120]: I0316 16:07:48.193307 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/26cb0730-b6af-4f60-baa0-3ce77a180060-config\") pod \"26cb0730-b6af-4f60-baa0-3ce77a180060\" (UID: \"26cb0730-b6af-4f60-baa0-3ce77a180060\") " Mar 16 16:07:48 crc kubenswrapper[5120]: I0316 16:07:48.193420 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xmfwc\" (UniqueName: \"kubernetes.io/projected/26cb0730-b6af-4f60-baa0-3ce77a180060-kube-api-access-xmfwc\") pod \"26cb0730-b6af-4f60-baa0-3ce77a180060\" (UID: \"26cb0730-b6af-4f60-baa0-3ce77a180060\") " Mar 16 16:07:48 crc kubenswrapper[5120]: I0316 16:07:48.202097 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26cb0730-b6af-4f60-baa0-3ce77a180060-kube-api-access-xmfwc" (OuterVolumeSpecName: "kube-api-access-xmfwc") pod "26cb0730-b6af-4f60-baa0-3ce77a180060" (UID: "26cb0730-b6af-4f60-baa0-3ce77a180060"). InnerVolumeSpecName "kube-api-access-xmfwc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:07:48 crc kubenswrapper[5120]: I0316 16:07:48.258868 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/26cb0730-b6af-4f60-baa0-3ce77a180060-config" (OuterVolumeSpecName: "config") pod "26cb0730-b6af-4f60-baa0-3ce77a180060" (UID: "26cb0730-b6af-4f60-baa0-3ce77a180060"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:07:48 crc kubenswrapper[5120]: I0316 16:07:48.259417 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/26cb0730-b6af-4f60-baa0-3ce77a180060-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "26cb0730-b6af-4f60-baa0-3ce77a180060" (UID: "26cb0730-b6af-4f60-baa0-3ce77a180060"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:07:48 crc kubenswrapper[5120]: I0316 16:07:48.295399 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xmfwc\" (UniqueName: \"kubernetes.io/projected/26cb0730-b6af-4f60-baa0-3ce77a180060-kube-api-access-xmfwc\") on node \"crc\" DevicePath \"\"" Mar 16 16:07:48 crc kubenswrapper[5120]: I0316 16:07:48.295425 5120 reconciler_common.go:299] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/26cb0730-b6af-4f60-baa0-3ce77a180060-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Mar 16 16:07:48 crc kubenswrapper[5120]: I0316 16:07:48.295439 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/26cb0730-b6af-4f60-baa0-3ce77a180060-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:07:48 crc kubenswrapper[5120]: I0316 16:07:48.457355 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:07:48 crc kubenswrapper[5120]: I0316 16:07:48.575352 5120 generic.go:358] "Generic (PLEG): container finished" podID="26cb0730-b6af-4f60-baa0-3ce77a180060" containerID="c4923841e960725d0debbe505df5dfd0ea3b5ba0b3dd1e99f961ab5ade2ebc47" exitCode=0 Mar 16 16:07:48 crc kubenswrapper[5120]: I0316 16:07:48.575469 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-l8vn4" Mar 16 16:07:48 crc kubenswrapper[5120]: I0316 16:07:48.575473 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-l8vn4" event={"ID":"26cb0730-b6af-4f60-baa0-3ce77a180060","Type":"ContainerDied","Data":"c4923841e960725d0debbe505df5dfd0ea3b5ba0b3dd1e99f961ab5ade2ebc47"} Mar 16 16:07:48 crc kubenswrapper[5120]: I0316 16:07:48.575650 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-l8vn4" event={"ID":"26cb0730-b6af-4f60-baa0-3ce77a180060","Type":"ContainerDied","Data":"802b4aae9cb24fe7d40aabbdf7d527409c92b9e8da55c54271cc4565e6c0860e"} Mar 16 16:07:48 crc kubenswrapper[5120]: I0316 16:07:48.575684 5120 scope.go:117] "RemoveContainer" containerID="c4923841e960725d0debbe505df5dfd0ea3b5ba0b3dd1e99f961ab5ade2ebc47" Mar 16 16:07:48 crc kubenswrapper[5120]: I0316 16:07:48.605707 5120 scope.go:117] "RemoveContainer" containerID="a12e212cfd35e0f82f763be81ea2f0d9a0e7b1d3d8b36718315a116a76f1cf0a" Mar 16 16:07:48 crc kubenswrapper[5120]: I0316 16:07:48.633675 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-l8vn4"] Mar 16 16:07:48 crc kubenswrapper[5120]: I0316 16:07:48.648084 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-l8vn4"] Mar 16 16:07:48 crc kubenswrapper[5120]: I0316 16:07:48.669106 5120 scope.go:117] "RemoveContainer" containerID="c4923841e960725d0debbe505df5dfd0ea3b5ba0b3dd1e99f961ab5ade2ebc47" Mar 16 16:07:48 crc kubenswrapper[5120]: E0316 16:07:48.674849 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c4923841e960725d0debbe505df5dfd0ea3b5ba0b3dd1e99f961ab5ade2ebc47\": container with ID starting with c4923841e960725d0debbe505df5dfd0ea3b5ba0b3dd1e99f961ab5ade2ebc47 not found: ID does not exist" containerID="c4923841e960725d0debbe505df5dfd0ea3b5ba0b3dd1e99f961ab5ade2ebc47" Mar 16 16:07:48 crc kubenswrapper[5120]: I0316 16:07:48.674904 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4923841e960725d0debbe505df5dfd0ea3b5ba0b3dd1e99f961ab5ade2ebc47"} err="failed to get container status \"c4923841e960725d0debbe505df5dfd0ea3b5ba0b3dd1e99f961ab5ade2ebc47\": rpc error: code = NotFound desc = could not find container \"c4923841e960725d0debbe505df5dfd0ea3b5ba0b3dd1e99f961ab5ade2ebc47\": container with ID starting with c4923841e960725d0debbe505df5dfd0ea3b5ba0b3dd1e99f961ab5ade2ebc47 not found: ID does not exist" Mar 16 16:07:48 crc kubenswrapper[5120]: I0316 16:07:48.674932 5120 scope.go:117] "RemoveContainer" containerID="a12e212cfd35e0f82f763be81ea2f0d9a0e7b1d3d8b36718315a116a76f1cf0a" Mar 16 16:07:48 crc kubenswrapper[5120]: E0316 16:07:48.675201 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a12e212cfd35e0f82f763be81ea2f0d9a0e7b1d3d8b36718315a116a76f1cf0a\": container with ID starting with a12e212cfd35e0f82f763be81ea2f0d9a0e7b1d3d8b36718315a116a76f1cf0a not found: ID does not exist" containerID="a12e212cfd35e0f82f763be81ea2f0d9a0e7b1d3d8b36718315a116a76f1cf0a" Mar 16 16:07:48 crc kubenswrapper[5120]: I0316 16:07:48.675239 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a12e212cfd35e0f82f763be81ea2f0d9a0e7b1d3d8b36718315a116a76f1cf0a"} err="failed to get container status \"a12e212cfd35e0f82f763be81ea2f0d9a0e7b1d3d8b36718315a116a76f1cf0a\": rpc error: code = NotFound desc = could not find container \"a12e212cfd35e0f82f763be81ea2f0d9a0e7b1d3d8b36718315a116a76f1cf0a\": container with ID starting with a12e212cfd35e0f82f763be81ea2f0d9a0e7b1d3d8b36718315a116a76f1cf0a not found: ID does not exist" Mar 16 16:07:48 crc kubenswrapper[5120]: I0316 16:07:48.683854 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="26cb0730-b6af-4f60-baa0-3ce77a180060" path="/var/lib/kubelet/pods/26cb0730-b6af-4f60-baa0-3ce77a180060/volumes" Mar 16 16:07:48 crc kubenswrapper[5120]: I0316 16:07:48.842022 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-db-create-tsb2s"] Mar 16 16:07:48 crc kubenswrapper[5120]: I0316 16:07:48.842860 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26cb0730-b6af-4f60-baa0-3ce77a180060" containerName="dnsmasq-dns" Mar 16 16:07:48 crc kubenswrapper[5120]: I0316 16:07:48.842878 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="26cb0730-b6af-4f60-baa0-3ce77a180060" containerName="dnsmasq-dns" Mar 16 16:07:48 crc kubenswrapper[5120]: I0316 16:07:48.842935 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26cb0730-b6af-4f60-baa0-3ce77a180060" containerName="init" Mar 16 16:07:48 crc kubenswrapper[5120]: I0316 16:07:48.842942 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="26cb0730-b6af-4f60-baa0-3ce77a180060" containerName="init" Mar 16 16:07:48 crc kubenswrapper[5120]: I0316 16:07:48.843083 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="26cb0730-b6af-4f60-baa0-3ce77a180060" containerName="dnsmasq-dns" Mar 16 16:07:48 crc kubenswrapper[5120]: I0316 16:07:48.850189 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-create-tsb2s" Mar 16 16:07:48 crc kubenswrapper[5120]: I0316 16:07:48.856925 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-f09c-account-create-update-c5rvl"] Mar 16 16:07:48 crc kubenswrapper[5120]: I0316 16:07:48.863700 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-db-create-tsb2s"] Mar 16 16:07:48 crc kubenswrapper[5120]: I0316 16:07:48.863862 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-f09c-account-create-update-c5rvl" Mar 16 16:07:48 crc kubenswrapper[5120]: I0316 16:07:48.893244 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-db-secret\"" Mar 16 16:07:48 crc kubenswrapper[5120]: I0316 16:07:48.906824 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/db2e0899-ea7d-4d2b-a32b-86633648d762-operator-scripts\") pod \"cinder-f09c-account-create-update-c5rvl\" (UID: \"db2e0899-ea7d-4d2b-a32b-86633648d762\") " pod="openstack-kuttl-tests/cinder-f09c-account-create-update-c5rvl" Mar 16 16:07:48 crc kubenswrapper[5120]: I0316 16:07:48.906900 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/7d156ff3-9ed3-4e45-81f4-5c0f0115833e-operator-scripts\") pod \"cinder-db-create-tsb2s\" (UID: \"7d156ff3-9ed3-4e45-81f4-5c0f0115833e\") " pod="openstack-kuttl-tests/cinder-db-create-tsb2s" Mar 16 16:07:48 crc kubenswrapper[5120]: I0316 16:07:48.906922 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mk7c\" (UniqueName: \"kubernetes.io/projected/7d156ff3-9ed3-4e45-81f4-5c0f0115833e-kube-api-access-9mk7c\") pod \"cinder-db-create-tsb2s\" (UID: \"7d156ff3-9ed3-4e45-81f4-5c0f0115833e\") " pod="openstack-kuttl-tests/cinder-db-create-tsb2s" Mar 16 16:07:48 crc kubenswrapper[5120]: I0316 16:07:48.906947 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwl97\" (UniqueName: \"kubernetes.io/projected/db2e0899-ea7d-4d2b-a32b-86633648d762-kube-api-access-pwl97\") pod \"cinder-f09c-account-create-update-c5rvl\" (UID: \"db2e0899-ea7d-4d2b-a32b-86633648d762\") " pod="openstack-kuttl-tests/cinder-f09c-account-create-update-c5rvl" Mar 16 16:07:48 crc kubenswrapper[5120]: I0316 16:07:48.908920 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-f09c-account-create-update-c5rvl"] Mar 16 16:07:48 crc kubenswrapper[5120]: I0316 16:07:48.971630 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-db-create-cps55"] Mar 16 16:07:48 crc kubenswrapper[5120]: I0316 16:07:48.978345 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-create-cps55" Mar 16 16:07:48 crc kubenswrapper[5120]: I0316 16:07:48.983920 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-db-create-cps55"] Mar 16 16:07:49 crc kubenswrapper[5120]: I0316 16:07:49.009895 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pwl97\" (UniqueName: \"kubernetes.io/projected/db2e0899-ea7d-4d2b-a32b-86633648d762-kube-api-access-pwl97\") pod \"cinder-f09c-account-create-update-c5rvl\" (UID: \"db2e0899-ea7d-4d2b-a32b-86633648d762\") " pod="openstack-kuttl-tests/cinder-f09c-account-create-update-c5rvl" Mar 16 16:07:49 crc kubenswrapper[5120]: I0316 16:07:49.010056 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/98d8925d-4997-48e0-a674-abb5bdb026dd-operator-scripts\") pod \"neutron-db-create-cps55\" (UID: \"98d8925d-4997-48e0-a674-abb5bdb026dd\") " pod="openstack-kuttl-tests/neutron-db-create-cps55" Mar 16 16:07:49 crc kubenswrapper[5120]: I0316 16:07:49.010436 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/db2e0899-ea7d-4d2b-a32b-86633648d762-operator-scripts\") pod \"cinder-f09c-account-create-update-c5rvl\" (UID: \"db2e0899-ea7d-4d2b-a32b-86633648d762\") " pod="openstack-kuttl-tests/cinder-f09c-account-create-update-c5rvl" Mar 16 16:07:49 crc kubenswrapper[5120]: I0316 16:07:49.010479 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zc7q\" (UniqueName: \"kubernetes.io/projected/98d8925d-4997-48e0-a674-abb5bdb026dd-kube-api-access-6zc7q\") pod \"neutron-db-create-cps55\" (UID: \"98d8925d-4997-48e0-a674-abb5bdb026dd\") " pod="openstack-kuttl-tests/neutron-db-create-cps55" Mar 16 16:07:49 crc kubenswrapper[5120]: I0316 16:07:49.010569 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/7d156ff3-9ed3-4e45-81f4-5c0f0115833e-operator-scripts\") pod \"cinder-db-create-tsb2s\" (UID: \"7d156ff3-9ed3-4e45-81f4-5c0f0115833e\") " pod="openstack-kuttl-tests/cinder-db-create-tsb2s" Mar 16 16:07:49 crc kubenswrapper[5120]: I0316 16:07:49.010598 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9mk7c\" (UniqueName: \"kubernetes.io/projected/7d156ff3-9ed3-4e45-81f4-5c0f0115833e-kube-api-access-9mk7c\") pod \"cinder-db-create-tsb2s\" (UID: \"7d156ff3-9ed3-4e45-81f4-5c0f0115833e\") " pod="openstack-kuttl-tests/cinder-db-create-tsb2s" Mar 16 16:07:49 crc kubenswrapper[5120]: I0316 16:07:49.011832 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/7d156ff3-9ed3-4e45-81f4-5c0f0115833e-operator-scripts\") pod \"cinder-db-create-tsb2s\" (UID: \"7d156ff3-9ed3-4e45-81f4-5c0f0115833e\") " pod="openstack-kuttl-tests/cinder-db-create-tsb2s" Mar 16 16:07:49 crc kubenswrapper[5120]: I0316 16:07:49.011889 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/db2e0899-ea7d-4d2b-a32b-86633648d762-operator-scripts\") pod \"cinder-f09c-account-create-update-c5rvl\" (UID: \"db2e0899-ea7d-4d2b-a32b-86633648d762\") " pod="openstack-kuttl-tests/cinder-f09c-account-create-update-c5rvl" Mar 16 16:07:49 crc kubenswrapper[5120]: I0316 16:07:49.042136 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mk7c\" (UniqueName: \"kubernetes.io/projected/7d156ff3-9ed3-4e45-81f4-5c0f0115833e-kube-api-access-9mk7c\") pod \"cinder-db-create-tsb2s\" (UID: \"7d156ff3-9ed3-4e45-81f4-5c0f0115833e\") " pod="openstack-kuttl-tests/cinder-db-create-tsb2s" Mar 16 16:07:49 crc kubenswrapper[5120]: I0316 16:07:49.045152 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwl97\" (UniqueName: \"kubernetes.io/projected/db2e0899-ea7d-4d2b-a32b-86633648d762-kube-api-access-pwl97\") pod \"cinder-f09c-account-create-update-c5rvl\" (UID: \"db2e0899-ea7d-4d2b-a32b-86633648d762\") " pod="openstack-kuttl-tests/cinder-f09c-account-create-update-c5rvl" Mar 16 16:07:49 crc kubenswrapper[5120]: I0316 16:07:49.077332 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-db-create-sb9g5"] Mar 16 16:07:49 crc kubenswrapper[5120]: I0316 16:07:49.083606 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-create-sb9g5" Mar 16 16:07:49 crc kubenswrapper[5120]: I0316 16:07:49.084167 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-db-create-sb9g5"] Mar 16 16:07:49 crc kubenswrapper[5120]: I0316 16:07:49.113646 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvgfz\" (UniqueName: \"kubernetes.io/projected/87bfd7ec-53c8-49c4-b69b-e3f39ba9f3ec-kube-api-access-zvgfz\") pod \"barbican-db-create-sb9g5\" (UID: \"87bfd7ec-53c8-49c4-b69b-e3f39ba9f3ec\") " pod="openstack-kuttl-tests/barbican-db-create-sb9g5" Mar 16 16:07:49 crc kubenswrapper[5120]: I0316 16:07:49.113784 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/98d8925d-4997-48e0-a674-abb5bdb026dd-operator-scripts\") pod \"neutron-db-create-cps55\" (UID: \"98d8925d-4997-48e0-a674-abb5bdb026dd\") " pod="openstack-kuttl-tests/neutron-db-create-cps55" Mar 16 16:07:49 crc kubenswrapper[5120]: I0316 16:07:49.113868 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/87bfd7ec-53c8-49c4-b69b-e3f39ba9f3ec-operator-scripts\") pod \"barbican-db-create-sb9g5\" (UID: \"87bfd7ec-53c8-49c4-b69b-e3f39ba9f3ec\") " pod="openstack-kuttl-tests/barbican-db-create-sb9g5" Mar 16 16:07:49 crc kubenswrapper[5120]: I0316 16:07:49.114023 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6zc7q\" (UniqueName: \"kubernetes.io/projected/98d8925d-4997-48e0-a674-abb5bdb026dd-kube-api-access-6zc7q\") pod \"neutron-db-create-cps55\" (UID: \"98d8925d-4997-48e0-a674-abb5bdb026dd\") " pod="openstack-kuttl-tests/neutron-db-create-cps55" Mar 16 16:07:49 crc kubenswrapper[5120]: I0316 16:07:49.114608 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/98d8925d-4997-48e0-a674-abb5bdb026dd-operator-scripts\") pod \"neutron-db-create-cps55\" (UID: \"98d8925d-4997-48e0-a674-abb5bdb026dd\") " pod="openstack-kuttl-tests/neutron-db-create-cps55" Mar 16 16:07:49 crc kubenswrapper[5120]: I0316 16:07:49.125746 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-r2gv8"] Mar 16 16:07:49 crc kubenswrapper[5120]: I0316 16:07:49.138337 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-r2gv8" Mar 16 16:07:49 crc kubenswrapper[5120]: I0316 16:07:49.147996 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-scripts\"" Mar 16 16:07:49 crc kubenswrapper[5120]: I0316 16:07:49.148226 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-config-data\"" Mar 16 16:07:49 crc kubenswrapper[5120]: I0316 16:07:49.148388 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-keystone-dockercfg-h8dlj\"" Mar 16 16:07:49 crc kubenswrapper[5120]: I0316 16:07:49.148513 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone\"" Mar 16 16:07:49 crc kubenswrapper[5120]: I0316 16:07:49.158034 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-r2gv8"] Mar 16 16:07:49 crc kubenswrapper[5120]: I0316 16:07:49.158316 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zc7q\" (UniqueName: \"kubernetes.io/projected/98d8925d-4997-48e0-a674-abb5bdb026dd-kube-api-access-6zc7q\") pod \"neutron-db-create-cps55\" (UID: \"98d8925d-4997-48e0-a674-abb5bdb026dd\") " pod="openstack-kuttl-tests/neutron-db-create-cps55" Mar 16 16:07:49 crc kubenswrapper[5120]: I0316 16:07:49.180333 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-2fe2-account-create-update-m9b9k"] Mar 16 16:07:49 crc kubenswrapper[5120]: I0316 16:07:49.186093 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-2fe2-account-create-update-m9b9k" Mar 16 16:07:49 crc kubenswrapper[5120]: I0316 16:07:49.188238 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-db-secret\"" Mar 16 16:07:49 crc kubenswrapper[5120]: I0316 16:07:49.204147 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-2fe2-account-create-update-m9b9k"] Mar 16 16:07:49 crc kubenswrapper[5120]: I0316 16:07:49.208098 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-create-tsb2s" Mar 16 16:07:49 crc kubenswrapper[5120]: I0316 16:07:49.214879 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-f09c-account-create-update-c5rvl" Mar 16 16:07:49 crc kubenswrapper[5120]: I0316 16:07:49.215725 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d6dce3c7-a168-4f7b-8f35-b18f6de810e8-operator-scripts\") pod \"neutron-2fe2-account-create-update-m9b9k\" (UID: \"d6dce3c7-a168-4f7b-8f35-b18f6de810e8\") " pod="openstack-kuttl-tests/neutron-2fe2-account-create-update-m9b9k" Mar 16 16:07:49 crc kubenswrapper[5120]: I0316 16:07:49.215797 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/82c11055-585b-4f89-b75a-b396389fa715-combined-ca-bundle\") pod \"keystone-db-sync-r2gv8\" (UID: \"82c11055-585b-4f89-b75a-b396389fa715\") " pod="openstack-kuttl-tests/keystone-db-sync-r2gv8" Mar 16 16:07:49 crc kubenswrapper[5120]: I0316 16:07:49.215834 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76bqf\" (UniqueName: \"kubernetes.io/projected/d6dce3c7-a168-4f7b-8f35-b18f6de810e8-kube-api-access-76bqf\") pod \"neutron-2fe2-account-create-update-m9b9k\" (UID: \"d6dce3c7-a168-4f7b-8f35-b18f6de810e8\") " pod="openstack-kuttl-tests/neutron-2fe2-account-create-update-m9b9k" Mar 16 16:07:49 crc kubenswrapper[5120]: I0316 16:07:49.215889 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zvgfz\" (UniqueName: \"kubernetes.io/projected/87bfd7ec-53c8-49c4-b69b-e3f39ba9f3ec-kube-api-access-zvgfz\") pod \"barbican-db-create-sb9g5\" (UID: \"87bfd7ec-53c8-49c4-b69b-e3f39ba9f3ec\") " pod="openstack-kuttl-tests/barbican-db-create-sb9g5" Mar 16 16:07:49 crc kubenswrapper[5120]: I0316 16:07:49.215943 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhcvm\" (UniqueName: \"kubernetes.io/projected/82c11055-585b-4f89-b75a-b396389fa715-kube-api-access-nhcvm\") pod \"keystone-db-sync-r2gv8\" (UID: \"82c11055-585b-4f89-b75a-b396389fa715\") " pod="openstack-kuttl-tests/keystone-db-sync-r2gv8" Mar 16 16:07:49 crc kubenswrapper[5120]: I0316 16:07:49.216181 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/87bfd7ec-53c8-49c4-b69b-e3f39ba9f3ec-operator-scripts\") pod \"barbican-db-create-sb9g5\" (UID: \"87bfd7ec-53c8-49c4-b69b-e3f39ba9f3ec\") " pod="openstack-kuttl-tests/barbican-db-create-sb9g5" Mar 16 16:07:49 crc kubenswrapper[5120]: I0316 16:07:49.216269 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/82c11055-585b-4f89-b75a-b396389fa715-config-data\") pod \"keystone-db-sync-r2gv8\" (UID: \"82c11055-585b-4f89-b75a-b396389fa715\") " pod="openstack-kuttl-tests/keystone-db-sync-r2gv8" Mar 16 16:07:49 crc kubenswrapper[5120]: I0316 16:07:49.217190 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/87bfd7ec-53c8-49c4-b69b-e3f39ba9f3ec-operator-scripts\") pod \"barbican-db-create-sb9g5\" (UID: \"87bfd7ec-53c8-49c4-b69b-e3f39ba9f3ec\") " pod="openstack-kuttl-tests/barbican-db-create-sb9g5" Mar 16 16:07:49 crc kubenswrapper[5120]: I0316 16:07:49.242478 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvgfz\" (UniqueName: \"kubernetes.io/projected/87bfd7ec-53c8-49c4-b69b-e3f39ba9f3ec-kube-api-access-zvgfz\") pod \"barbican-db-create-sb9g5\" (UID: \"87bfd7ec-53c8-49c4-b69b-e3f39ba9f3ec\") " pod="openstack-kuttl-tests/barbican-db-create-sb9g5" Mar 16 16:07:49 crc kubenswrapper[5120]: I0316 16:07:49.259962 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-6c05-account-create-update-9n5cf"] Mar 16 16:07:49 crc kubenswrapper[5120]: I0316 16:07:49.265909 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-6c05-account-create-update-9n5cf" Mar 16 16:07:49 crc kubenswrapper[5120]: I0316 16:07:49.273788 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-db-secret\"" Mar 16 16:07:49 crc kubenswrapper[5120]: I0316 16:07:49.289430 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-6c05-account-create-update-9n5cf"] Mar 16 16:07:49 crc kubenswrapper[5120]: I0316 16:07:49.299245 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-create-cps55" Mar 16 16:07:49 crc kubenswrapper[5120]: I0316 16:07:49.318099 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/82c11055-585b-4f89-b75a-b396389fa715-config-data\") pod \"keystone-db-sync-r2gv8\" (UID: \"82c11055-585b-4f89-b75a-b396389fa715\") " pod="openstack-kuttl-tests/keystone-db-sync-r2gv8" Mar 16 16:07:49 crc kubenswrapper[5120]: I0316 16:07:49.318291 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/615124f9-52d4-4054-8321-42f5226ca83b-operator-scripts\") pod \"barbican-6c05-account-create-update-9n5cf\" (UID: \"615124f9-52d4-4054-8321-42f5226ca83b\") " pod="openstack-kuttl-tests/barbican-6c05-account-create-update-9n5cf" Mar 16 16:07:49 crc kubenswrapper[5120]: I0316 16:07:49.318348 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d6dce3c7-a168-4f7b-8f35-b18f6de810e8-operator-scripts\") pod \"neutron-2fe2-account-create-update-m9b9k\" (UID: \"d6dce3c7-a168-4f7b-8f35-b18f6de810e8\") " pod="openstack-kuttl-tests/neutron-2fe2-account-create-update-m9b9k" Mar 16 16:07:49 crc kubenswrapper[5120]: I0316 16:07:49.318385 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/82c11055-585b-4f89-b75a-b396389fa715-combined-ca-bundle\") pod \"keystone-db-sync-r2gv8\" (UID: \"82c11055-585b-4f89-b75a-b396389fa715\") " pod="openstack-kuttl-tests/keystone-db-sync-r2gv8" Mar 16 16:07:49 crc kubenswrapper[5120]: I0316 16:07:49.318427 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-76bqf\" (UniqueName: \"kubernetes.io/projected/d6dce3c7-a168-4f7b-8f35-b18f6de810e8-kube-api-access-76bqf\") pod \"neutron-2fe2-account-create-update-m9b9k\" (UID: \"d6dce3c7-a168-4f7b-8f35-b18f6de810e8\") " pod="openstack-kuttl-tests/neutron-2fe2-account-create-update-m9b9k" Mar 16 16:07:49 crc kubenswrapper[5120]: I0316 16:07:49.318507 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nhcvm\" (UniqueName: \"kubernetes.io/projected/82c11055-585b-4f89-b75a-b396389fa715-kube-api-access-nhcvm\") pod \"keystone-db-sync-r2gv8\" (UID: \"82c11055-585b-4f89-b75a-b396389fa715\") " pod="openstack-kuttl-tests/keystone-db-sync-r2gv8" Mar 16 16:07:49 crc kubenswrapper[5120]: I0316 16:07:49.318564 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jb4vl\" (UniqueName: \"kubernetes.io/projected/615124f9-52d4-4054-8321-42f5226ca83b-kube-api-access-jb4vl\") pod \"barbican-6c05-account-create-update-9n5cf\" (UID: \"615124f9-52d4-4054-8321-42f5226ca83b\") " pod="openstack-kuttl-tests/barbican-6c05-account-create-update-9n5cf" Mar 16 16:07:49 crc kubenswrapper[5120]: I0316 16:07:49.320070 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d6dce3c7-a168-4f7b-8f35-b18f6de810e8-operator-scripts\") pod \"neutron-2fe2-account-create-update-m9b9k\" (UID: \"d6dce3c7-a168-4f7b-8f35-b18f6de810e8\") " pod="openstack-kuttl-tests/neutron-2fe2-account-create-update-m9b9k" Mar 16 16:07:49 crc kubenswrapper[5120]: I0316 16:07:49.329105 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/82c11055-585b-4f89-b75a-b396389fa715-combined-ca-bundle\") pod \"keystone-db-sync-r2gv8\" (UID: \"82c11055-585b-4f89-b75a-b396389fa715\") " pod="openstack-kuttl-tests/keystone-db-sync-r2gv8" Mar 16 16:07:49 crc kubenswrapper[5120]: I0316 16:07:49.329207 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/82c11055-585b-4f89-b75a-b396389fa715-config-data\") pod \"keystone-db-sync-r2gv8\" (UID: \"82c11055-585b-4f89-b75a-b396389fa715\") " pod="openstack-kuttl-tests/keystone-db-sync-r2gv8" Mar 16 16:07:49 crc kubenswrapper[5120]: I0316 16:07:49.342465 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-76bqf\" (UniqueName: \"kubernetes.io/projected/d6dce3c7-a168-4f7b-8f35-b18f6de810e8-kube-api-access-76bqf\") pod \"neutron-2fe2-account-create-update-m9b9k\" (UID: \"d6dce3c7-a168-4f7b-8f35-b18f6de810e8\") " pod="openstack-kuttl-tests/neutron-2fe2-account-create-update-m9b9k" Mar 16 16:07:49 crc kubenswrapper[5120]: I0316 16:07:49.343007 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhcvm\" (UniqueName: \"kubernetes.io/projected/82c11055-585b-4f89-b75a-b396389fa715-kube-api-access-nhcvm\") pod \"keystone-db-sync-r2gv8\" (UID: \"82c11055-585b-4f89-b75a-b396389fa715\") " pod="openstack-kuttl-tests/keystone-db-sync-r2gv8" Mar 16 16:07:49 crc kubenswrapper[5120]: I0316 16:07:49.420654 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jb4vl\" (UniqueName: \"kubernetes.io/projected/615124f9-52d4-4054-8321-42f5226ca83b-kube-api-access-jb4vl\") pod \"barbican-6c05-account-create-update-9n5cf\" (UID: \"615124f9-52d4-4054-8321-42f5226ca83b\") " pod="openstack-kuttl-tests/barbican-6c05-account-create-update-9n5cf" Mar 16 16:07:49 crc kubenswrapper[5120]: I0316 16:07:49.420871 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/615124f9-52d4-4054-8321-42f5226ca83b-operator-scripts\") pod \"barbican-6c05-account-create-update-9n5cf\" (UID: \"615124f9-52d4-4054-8321-42f5226ca83b\") " pod="openstack-kuttl-tests/barbican-6c05-account-create-update-9n5cf" Mar 16 16:07:49 crc kubenswrapper[5120]: I0316 16:07:49.422050 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/615124f9-52d4-4054-8321-42f5226ca83b-operator-scripts\") pod \"barbican-6c05-account-create-update-9n5cf\" (UID: \"615124f9-52d4-4054-8321-42f5226ca83b\") " pod="openstack-kuttl-tests/barbican-6c05-account-create-update-9n5cf" Mar 16 16:07:49 crc kubenswrapper[5120]: I0316 16:07:49.432036 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-create-sb9g5" Mar 16 16:07:49 crc kubenswrapper[5120]: I0316 16:07:49.442918 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jb4vl\" (UniqueName: \"kubernetes.io/projected/615124f9-52d4-4054-8321-42f5226ca83b-kube-api-access-jb4vl\") pod \"barbican-6c05-account-create-update-9n5cf\" (UID: \"615124f9-52d4-4054-8321-42f5226ca83b\") " pod="openstack-kuttl-tests/barbican-6c05-account-create-update-9n5cf" Mar 16 16:07:49 crc kubenswrapper[5120]: I0316 16:07:49.472270 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:07:49 crc kubenswrapper[5120]: I0316 16:07:49.505238 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-r2gv8" Mar 16 16:07:49 crc kubenswrapper[5120]: I0316 16:07:49.513736 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-2fe2-account-create-update-m9b9k" Mar 16 16:07:49 crc kubenswrapper[5120]: I0316 16:07:49.606049 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-6c05-account-create-update-9n5cf" Mar 16 16:07:49 crc kubenswrapper[5120]: I0316 16:07:49.778620 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-db-create-tsb2s"] Mar 16 16:07:49 crc kubenswrapper[5120]: I0316 16:07:49.790518 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-f09c-account-create-update-c5rvl"] Mar 16 16:07:49 crc kubenswrapper[5120]: W0316 16:07:49.805990 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddb2e0899_ea7d_4d2b_a32b_86633648d762.slice/crio-e9ae943f538aac8ae2cd40a017033bd8042ddc978081c399ef38e35882cf0cfc WatchSource:0}: Error finding container e9ae943f538aac8ae2cd40a017033bd8042ddc978081c399ef38e35882cf0cfc: Status 404 returned error can't find the container with id e9ae943f538aac8ae2cd40a017033bd8042ddc978081c399ef38e35882cf0cfc Mar 16 16:07:49 crc kubenswrapper[5120]: I0316 16:07:49.891471 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-db-create-cps55"] Mar 16 16:07:50 crc kubenswrapper[5120]: I0316 16:07:50.023689 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-db-create-sb9g5"] Mar 16 16:07:50 crc kubenswrapper[5120]: I0316 16:07:50.147825 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-2fe2-account-create-update-m9b9k"] Mar 16 16:07:50 crc kubenswrapper[5120]: W0316 16:07:50.150528 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd6dce3c7_a168_4f7b_8f35_b18f6de810e8.slice/crio-95d963c9f5b0c4b7f33571ccf1c3904fc839e5a002a73d6255b284edc4bcf162 WatchSource:0}: Error finding container 95d963c9f5b0c4b7f33571ccf1c3904fc839e5a002a73d6255b284edc4bcf162: Status 404 returned error can't find the container with id 95d963c9f5b0c4b7f33571ccf1c3904fc839e5a002a73d6255b284edc4bcf162 Mar 16 16:07:50 crc kubenswrapper[5120]: I0316 16:07:50.160797 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-r2gv8"] Mar 16 16:07:50 crc kubenswrapper[5120]: I0316 16:07:50.169055 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-6c05-account-create-update-9n5cf"] Mar 16 16:07:50 crc kubenswrapper[5120]: I0316 16:07:50.600398 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-r2gv8" event={"ID":"82c11055-585b-4f89-b75a-b396389fa715","Type":"ContainerStarted","Data":"32a5fae783c49e06b1845498e8a9937d7600c43ddfc4063f7a9eebd7ee19e9a2"} Mar 16 16:07:50 crc kubenswrapper[5120]: I0316 16:07:50.600449 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-r2gv8" event={"ID":"82c11055-585b-4f89-b75a-b396389fa715","Type":"ContainerStarted","Data":"df36376b9237da13d0202b0731975eb399af1c0b61b74205fb4fd3a2111c3b8f"} Mar 16 16:07:50 crc kubenswrapper[5120]: I0316 16:07:50.604346 5120 generic.go:358] "Generic (PLEG): container finished" podID="87bfd7ec-53c8-49c4-b69b-e3f39ba9f3ec" containerID="1166bb317bd3ed873a568ab0d94e3ba29fd576093029920d956796b746df2c9f" exitCode=0 Mar 16 16:07:50 crc kubenswrapper[5120]: I0316 16:07:50.604468 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-create-sb9g5" event={"ID":"87bfd7ec-53c8-49c4-b69b-e3f39ba9f3ec","Type":"ContainerDied","Data":"1166bb317bd3ed873a568ab0d94e3ba29fd576093029920d956796b746df2c9f"} Mar 16 16:07:50 crc kubenswrapper[5120]: I0316 16:07:50.604488 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-create-sb9g5" event={"ID":"87bfd7ec-53c8-49c4-b69b-e3f39ba9f3ec","Type":"ContainerStarted","Data":"d05673ac3c920e18c9857668bd75517e01c5f43aa2133cd312f25423b9035c02"} Mar 16 16:07:50 crc kubenswrapper[5120]: I0316 16:07:50.605947 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-6c05-account-create-update-9n5cf" event={"ID":"615124f9-52d4-4054-8321-42f5226ca83b","Type":"ContainerStarted","Data":"a7c91baa90a3eb95b3ddf6bf687af022b77802349ad1dca2e29118c8e3459d92"} Mar 16 16:07:50 crc kubenswrapper[5120]: I0316 16:07:50.605971 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-6c05-account-create-update-9n5cf" event={"ID":"615124f9-52d4-4054-8321-42f5226ca83b","Type":"ContainerStarted","Data":"2c5c1967c2e7dfd64b9ea227b5b88fc4ba3cd1e16b0b27340a4a023d5cbd6783"} Mar 16 16:07:50 crc kubenswrapper[5120]: I0316 16:07:50.608246 5120 generic.go:358] "Generic (PLEG): container finished" podID="98d8925d-4997-48e0-a674-abb5bdb026dd" containerID="879540ab869cd27f4b041f1e8a911f07267554649bd939260638fad424f1356b" exitCode=0 Mar 16 16:07:50 crc kubenswrapper[5120]: I0316 16:07:50.608294 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-create-cps55" event={"ID":"98d8925d-4997-48e0-a674-abb5bdb026dd","Type":"ContainerDied","Data":"879540ab869cd27f4b041f1e8a911f07267554649bd939260638fad424f1356b"} Mar 16 16:07:50 crc kubenswrapper[5120]: I0316 16:07:50.608309 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-create-cps55" event={"ID":"98d8925d-4997-48e0-a674-abb5bdb026dd","Type":"ContainerStarted","Data":"20fb8eca246ffc31ce1df8a2957cd81eed89aba2b3489ee011659efbf18a8c29"} Mar 16 16:07:50 crc kubenswrapper[5120]: I0316 16:07:50.610066 5120 generic.go:358] "Generic (PLEG): container finished" podID="d6dce3c7-a168-4f7b-8f35-b18f6de810e8" containerID="3ddeddcf41ed8d971498d46d59f340d31b7ccd8e30ccce4f36314a38b3c73f02" exitCode=0 Mar 16 16:07:50 crc kubenswrapper[5120]: I0316 16:07:50.610190 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-2fe2-account-create-update-m9b9k" event={"ID":"d6dce3c7-a168-4f7b-8f35-b18f6de810e8","Type":"ContainerDied","Data":"3ddeddcf41ed8d971498d46d59f340d31b7ccd8e30ccce4f36314a38b3c73f02"} Mar 16 16:07:50 crc kubenswrapper[5120]: I0316 16:07:50.610218 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-2fe2-account-create-update-m9b9k" event={"ID":"d6dce3c7-a168-4f7b-8f35-b18f6de810e8","Type":"ContainerStarted","Data":"95d963c9f5b0c4b7f33571ccf1c3904fc839e5a002a73d6255b284edc4bcf162"} Mar 16 16:07:50 crc kubenswrapper[5120]: I0316 16:07:50.612259 5120 generic.go:358] "Generic (PLEG): container finished" podID="7d156ff3-9ed3-4e45-81f4-5c0f0115833e" containerID="476779e448aa12a75638697201eb9c6dd3916e48dedaefee1ce3643a9123432a" exitCode=0 Mar 16 16:07:50 crc kubenswrapper[5120]: I0316 16:07:50.612367 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-create-tsb2s" event={"ID":"7d156ff3-9ed3-4e45-81f4-5c0f0115833e","Type":"ContainerDied","Data":"476779e448aa12a75638697201eb9c6dd3916e48dedaefee1ce3643a9123432a"} Mar 16 16:07:50 crc kubenswrapper[5120]: I0316 16:07:50.612411 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-create-tsb2s" event={"ID":"7d156ff3-9ed3-4e45-81f4-5c0f0115833e","Type":"ContainerStarted","Data":"df7bf9ba9e71928399a3b90a738ad05e8675acc4643e0d340c270031b089c3fc"} Mar 16 16:07:50 crc kubenswrapper[5120]: I0316 16:07:50.613641 5120 generic.go:358] "Generic (PLEG): container finished" podID="db2e0899-ea7d-4d2b-a32b-86633648d762" containerID="51d350c9a910e9073ccc4d4a467f2cfa9789914dde4173e918043b83b3b0a920" exitCode=0 Mar 16 16:07:50 crc kubenswrapper[5120]: I0316 16:07:50.613710 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-f09c-account-create-update-c5rvl" event={"ID":"db2e0899-ea7d-4d2b-a32b-86633648d762","Type":"ContainerDied","Data":"51d350c9a910e9073ccc4d4a467f2cfa9789914dde4173e918043b83b3b0a920"} Mar 16 16:07:50 crc kubenswrapper[5120]: I0316 16:07:50.613725 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-f09c-account-create-update-c5rvl" event={"ID":"db2e0899-ea7d-4d2b-a32b-86633648d762","Type":"ContainerStarted","Data":"e9ae943f538aac8ae2cd40a017033bd8042ddc978081c399ef38e35882cf0cfc"} Mar 16 16:07:50 crc kubenswrapper[5120]: I0316 16:07:50.629749 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-db-sync-r2gv8" podStartSLOduration=1.6297128459999999 podStartE2EDuration="1.629712846s" podCreationTimestamp="2026-03-16 16:07:49 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:07:50.621294756 +0000 UTC m=+2172.775226413" watchObservedRunningTime="2026-03-16 16:07:50.629712846 +0000 UTC m=+2172.783644513" Mar 16 16:07:50 crc kubenswrapper[5120]: I0316 16:07:50.703801 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-6c05-account-create-update-9n5cf" podStartSLOduration=1.703748976 podStartE2EDuration="1.703748976s" podCreationTimestamp="2026-03-16 16:07:49 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:07:50.699600263 +0000 UTC m=+2172.853531920" watchObservedRunningTime="2026-03-16 16:07:50.703748976 +0000 UTC m=+2172.857680643" Mar 16 16:07:51 crc kubenswrapper[5120]: I0316 16:07:51.630146 5120 generic.go:358] "Generic (PLEG): container finished" podID="615124f9-52d4-4054-8321-42f5226ca83b" containerID="a7c91baa90a3eb95b3ddf6bf687af022b77802349ad1dca2e29118c8e3459d92" exitCode=0 Mar 16 16:07:51 crc kubenswrapper[5120]: I0316 16:07:51.630389 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-6c05-account-create-update-9n5cf" event={"ID":"615124f9-52d4-4054-8321-42f5226ca83b","Type":"ContainerDied","Data":"a7c91baa90a3eb95b3ddf6bf687af022b77802349ad1dca2e29118c8e3459d92"} Mar 16 16:07:52 crc kubenswrapper[5120]: I0316 16:07:52.008069 5120 patch_prober.go:28] interesting pod/machine-config-daemon-7bf76 container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 16:07:52 crc kubenswrapper[5120]: I0316 16:07:52.008464 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 16:07:52 crc kubenswrapper[5120]: I0316 16:07:52.320192 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-f09c-account-create-update-c5rvl" Mar 16 16:07:52 crc kubenswrapper[5120]: I0316 16:07:52.368629 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-create-sb9g5" Mar 16 16:07:52 crc kubenswrapper[5120]: I0316 16:07:52.384445 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-2fe2-account-create-update-m9b9k" Mar 16 16:07:52 crc kubenswrapper[5120]: I0316 16:07:52.388364 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/db2e0899-ea7d-4d2b-a32b-86633648d762-operator-scripts\") pod \"db2e0899-ea7d-4d2b-a32b-86633648d762\" (UID: \"db2e0899-ea7d-4d2b-a32b-86633648d762\") " Mar 16 16:07:52 crc kubenswrapper[5120]: I0316 16:07:52.388656 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pwl97\" (UniqueName: \"kubernetes.io/projected/db2e0899-ea7d-4d2b-a32b-86633648d762-kube-api-access-pwl97\") pod \"db2e0899-ea7d-4d2b-a32b-86633648d762\" (UID: \"db2e0899-ea7d-4d2b-a32b-86633648d762\") " Mar 16 16:07:52 crc kubenswrapper[5120]: I0316 16:07:52.389121 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/db2e0899-ea7d-4d2b-a32b-86633648d762-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "db2e0899-ea7d-4d2b-a32b-86633648d762" (UID: "db2e0899-ea7d-4d2b-a32b-86633648d762"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:07:52 crc kubenswrapper[5120]: I0316 16:07:52.396845 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db2e0899-ea7d-4d2b-a32b-86633648d762-kube-api-access-pwl97" (OuterVolumeSpecName: "kube-api-access-pwl97") pod "db2e0899-ea7d-4d2b-a32b-86633648d762" (UID: "db2e0899-ea7d-4d2b-a32b-86633648d762"). InnerVolumeSpecName "kube-api-access-pwl97". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:07:52 crc kubenswrapper[5120]: I0316 16:07:52.400745 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-create-tsb2s" Mar 16 16:07:52 crc kubenswrapper[5120]: I0316 16:07:52.417612 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-create-cps55" Mar 16 16:07:52 crc kubenswrapper[5120]: I0316 16:07:52.491254 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9mk7c\" (UniqueName: \"kubernetes.io/projected/7d156ff3-9ed3-4e45-81f4-5c0f0115833e-kube-api-access-9mk7c\") pod \"7d156ff3-9ed3-4e45-81f4-5c0f0115833e\" (UID: \"7d156ff3-9ed3-4e45-81f4-5c0f0115833e\") " Mar 16 16:07:52 crc kubenswrapper[5120]: I0316 16:07:52.491390 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zvgfz\" (UniqueName: \"kubernetes.io/projected/87bfd7ec-53c8-49c4-b69b-e3f39ba9f3ec-kube-api-access-zvgfz\") pod \"87bfd7ec-53c8-49c4-b69b-e3f39ba9f3ec\" (UID: \"87bfd7ec-53c8-49c4-b69b-e3f39ba9f3ec\") " Mar 16 16:07:52 crc kubenswrapper[5120]: I0316 16:07:52.491433 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/87bfd7ec-53c8-49c4-b69b-e3f39ba9f3ec-operator-scripts\") pod \"87bfd7ec-53c8-49c4-b69b-e3f39ba9f3ec\" (UID: \"87bfd7ec-53c8-49c4-b69b-e3f39ba9f3ec\") " Mar 16 16:07:52 crc kubenswrapper[5120]: I0316 16:07:52.491499 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6zc7q\" (UniqueName: \"kubernetes.io/projected/98d8925d-4997-48e0-a674-abb5bdb026dd-kube-api-access-6zc7q\") pod \"98d8925d-4997-48e0-a674-abb5bdb026dd\" (UID: \"98d8925d-4997-48e0-a674-abb5bdb026dd\") " Mar 16 16:07:52 crc kubenswrapper[5120]: I0316 16:07:52.491524 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/7d156ff3-9ed3-4e45-81f4-5c0f0115833e-operator-scripts\") pod \"7d156ff3-9ed3-4e45-81f4-5c0f0115833e\" (UID: \"7d156ff3-9ed3-4e45-81f4-5c0f0115833e\") " Mar 16 16:07:52 crc kubenswrapper[5120]: I0316 16:07:52.491631 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d6dce3c7-a168-4f7b-8f35-b18f6de810e8-operator-scripts\") pod \"d6dce3c7-a168-4f7b-8f35-b18f6de810e8\" (UID: \"d6dce3c7-a168-4f7b-8f35-b18f6de810e8\") " Mar 16 16:07:52 crc kubenswrapper[5120]: I0316 16:07:52.491686 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-76bqf\" (UniqueName: \"kubernetes.io/projected/d6dce3c7-a168-4f7b-8f35-b18f6de810e8-kube-api-access-76bqf\") pod \"d6dce3c7-a168-4f7b-8f35-b18f6de810e8\" (UID: \"d6dce3c7-a168-4f7b-8f35-b18f6de810e8\") " Mar 16 16:07:52 crc kubenswrapper[5120]: I0316 16:07:52.491743 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/98d8925d-4997-48e0-a674-abb5bdb026dd-operator-scripts\") pod \"98d8925d-4997-48e0-a674-abb5bdb026dd\" (UID: \"98d8925d-4997-48e0-a674-abb5bdb026dd\") " Mar 16 16:07:52 crc kubenswrapper[5120]: I0316 16:07:52.492107 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/db2e0899-ea7d-4d2b-a32b-86633648d762-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:07:52 crc kubenswrapper[5120]: I0316 16:07:52.492125 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pwl97\" (UniqueName: \"kubernetes.io/projected/db2e0899-ea7d-4d2b-a32b-86633648d762-kube-api-access-pwl97\") on node \"crc\" DevicePath \"\"" Mar 16 16:07:52 crc kubenswrapper[5120]: I0316 16:07:52.492831 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/98d8925d-4997-48e0-a674-abb5bdb026dd-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "98d8925d-4997-48e0-a674-abb5bdb026dd" (UID: "98d8925d-4997-48e0-a674-abb5bdb026dd"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:07:52 crc kubenswrapper[5120]: I0316 16:07:52.493235 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d156ff3-9ed3-4e45-81f4-5c0f0115833e-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "7d156ff3-9ed3-4e45-81f4-5c0f0115833e" (UID: "7d156ff3-9ed3-4e45-81f4-5c0f0115833e"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:07:52 crc kubenswrapper[5120]: I0316 16:07:52.493574 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6dce3c7-a168-4f7b-8f35-b18f6de810e8-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "d6dce3c7-a168-4f7b-8f35-b18f6de810e8" (UID: "d6dce3c7-a168-4f7b-8f35-b18f6de810e8"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:07:52 crc kubenswrapper[5120]: I0316 16:07:52.495744 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98d8925d-4997-48e0-a674-abb5bdb026dd-kube-api-access-6zc7q" (OuterVolumeSpecName: "kube-api-access-6zc7q") pod "98d8925d-4997-48e0-a674-abb5bdb026dd" (UID: "98d8925d-4997-48e0-a674-abb5bdb026dd"). InnerVolumeSpecName "kube-api-access-6zc7q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:07:52 crc kubenswrapper[5120]: I0316 16:07:52.496227 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/87bfd7ec-53c8-49c4-b69b-e3f39ba9f3ec-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "87bfd7ec-53c8-49c4-b69b-e3f39ba9f3ec" (UID: "87bfd7ec-53c8-49c4-b69b-e3f39ba9f3ec"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:07:52 crc kubenswrapper[5120]: I0316 16:07:52.505302 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d156ff3-9ed3-4e45-81f4-5c0f0115833e-kube-api-access-9mk7c" (OuterVolumeSpecName: "kube-api-access-9mk7c") pod "7d156ff3-9ed3-4e45-81f4-5c0f0115833e" (UID: "7d156ff3-9ed3-4e45-81f4-5c0f0115833e"). InnerVolumeSpecName "kube-api-access-9mk7c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:07:52 crc kubenswrapper[5120]: I0316 16:07:52.508163 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87bfd7ec-53c8-49c4-b69b-e3f39ba9f3ec-kube-api-access-zvgfz" (OuterVolumeSpecName: "kube-api-access-zvgfz") pod "87bfd7ec-53c8-49c4-b69b-e3f39ba9f3ec" (UID: "87bfd7ec-53c8-49c4-b69b-e3f39ba9f3ec"). InnerVolumeSpecName "kube-api-access-zvgfz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:07:52 crc kubenswrapper[5120]: I0316 16:07:52.516589 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6dce3c7-a168-4f7b-8f35-b18f6de810e8-kube-api-access-76bqf" (OuterVolumeSpecName: "kube-api-access-76bqf") pod "d6dce3c7-a168-4f7b-8f35-b18f6de810e8" (UID: "d6dce3c7-a168-4f7b-8f35-b18f6de810e8"). InnerVolumeSpecName "kube-api-access-76bqf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:07:52 crc kubenswrapper[5120]: I0316 16:07:52.593272 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d6dce3c7-a168-4f7b-8f35-b18f6de810e8-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:07:52 crc kubenswrapper[5120]: I0316 16:07:52.593309 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-76bqf\" (UniqueName: \"kubernetes.io/projected/d6dce3c7-a168-4f7b-8f35-b18f6de810e8-kube-api-access-76bqf\") on node \"crc\" DevicePath \"\"" Mar 16 16:07:52 crc kubenswrapper[5120]: I0316 16:07:52.593320 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/98d8925d-4997-48e0-a674-abb5bdb026dd-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:07:52 crc kubenswrapper[5120]: I0316 16:07:52.593330 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9mk7c\" (UniqueName: \"kubernetes.io/projected/7d156ff3-9ed3-4e45-81f4-5c0f0115833e-kube-api-access-9mk7c\") on node \"crc\" DevicePath \"\"" Mar 16 16:07:52 crc kubenswrapper[5120]: I0316 16:07:52.593339 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zvgfz\" (UniqueName: \"kubernetes.io/projected/87bfd7ec-53c8-49c4-b69b-e3f39ba9f3ec-kube-api-access-zvgfz\") on node \"crc\" DevicePath \"\"" Mar 16 16:07:52 crc kubenswrapper[5120]: I0316 16:07:52.593353 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/87bfd7ec-53c8-49c4-b69b-e3f39ba9f3ec-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:07:52 crc kubenswrapper[5120]: I0316 16:07:52.593362 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6zc7q\" (UniqueName: \"kubernetes.io/projected/98d8925d-4997-48e0-a674-abb5bdb026dd-kube-api-access-6zc7q\") on node \"crc\" DevicePath \"\"" Mar 16 16:07:52 crc kubenswrapper[5120]: I0316 16:07:52.593370 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/7d156ff3-9ed3-4e45-81f4-5c0f0115833e-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:07:52 crc kubenswrapper[5120]: I0316 16:07:52.641352 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-create-tsb2s" event={"ID":"7d156ff3-9ed3-4e45-81f4-5c0f0115833e","Type":"ContainerDied","Data":"df7bf9ba9e71928399a3b90a738ad05e8675acc4643e0d340c270031b089c3fc"} Mar 16 16:07:52 crc kubenswrapper[5120]: I0316 16:07:52.641400 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-create-tsb2s" Mar 16 16:07:52 crc kubenswrapper[5120]: I0316 16:07:52.641396 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="df7bf9ba9e71928399a3b90a738ad05e8675acc4643e0d340c270031b089c3fc" Mar 16 16:07:52 crc kubenswrapper[5120]: I0316 16:07:52.643529 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-f09c-account-create-update-c5rvl" Mar 16 16:07:52 crc kubenswrapper[5120]: I0316 16:07:52.643624 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-f09c-account-create-update-c5rvl" event={"ID":"db2e0899-ea7d-4d2b-a32b-86633648d762","Type":"ContainerDied","Data":"e9ae943f538aac8ae2cd40a017033bd8042ddc978081c399ef38e35882cf0cfc"} Mar 16 16:07:52 crc kubenswrapper[5120]: I0316 16:07:52.643716 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e9ae943f538aac8ae2cd40a017033bd8042ddc978081c399ef38e35882cf0cfc" Mar 16 16:07:52 crc kubenswrapper[5120]: I0316 16:07:52.645706 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-create-sb9g5" event={"ID":"87bfd7ec-53c8-49c4-b69b-e3f39ba9f3ec","Type":"ContainerDied","Data":"d05673ac3c920e18c9857668bd75517e01c5f43aa2133cd312f25423b9035c02"} Mar 16 16:07:52 crc kubenswrapper[5120]: I0316 16:07:52.645781 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-create-sb9g5" Mar 16 16:07:52 crc kubenswrapper[5120]: I0316 16:07:52.645813 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d05673ac3c920e18c9857668bd75517e01c5f43aa2133cd312f25423b9035c02" Mar 16 16:07:52 crc kubenswrapper[5120]: I0316 16:07:52.647205 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-create-cps55" event={"ID":"98d8925d-4997-48e0-a674-abb5bdb026dd","Type":"ContainerDied","Data":"20fb8eca246ffc31ce1df8a2957cd81eed89aba2b3489ee011659efbf18a8c29"} Mar 16 16:07:52 crc kubenswrapper[5120]: I0316 16:07:52.647320 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="20fb8eca246ffc31ce1df8a2957cd81eed89aba2b3489ee011659efbf18a8c29" Mar 16 16:07:52 crc kubenswrapper[5120]: I0316 16:07:52.647256 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-create-cps55" Mar 16 16:07:52 crc kubenswrapper[5120]: I0316 16:07:52.648614 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-2fe2-account-create-update-m9b9k" Mar 16 16:07:52 crc kubenswrapper[5120]: I0316 16:07:52.648656 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-2fe2-account-create-update-m9b9k" event={"ID":"d6dce3c7-a168-4f7b-8f35-b18f6de810e8","Type":"ContainerDied","Data":"95d963c9f5b0c4b7f33571ccf1c3904fc839e5a002a73d6255b284edc4bcf162"} Mar 16 16:07:52 crc kubenswrapper[5120]: I0316 16:07:52.648732 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="95d963c9f5b0c4b7f33571ccf1c3904fc839e5a002a73d6255b284edc4bcf162" Mar 16 16:07:52 crc kubenswrapper[5120]: I0316 16:07:52.960205 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-6c05-account-create-update-9n5cf" Mar 16 16:07:52 crc kubenswrapper[5120]: I0316 16:07:52.999547 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/615124f9-52d4-4054-8321-42f5226ca83b-operator-scripts\") pod \"615124f9-52d4-4054-8321-42f5226ca83b\" (UID: \"615124f9-52d4-4054-8321-42f5226ca83b\") " Mar 16 16:07:53 crc kubenswrapper[5120]: I0316 16:07:53.000878 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/615124f9-52d4-4054-8321-42f5226ca83b-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "615124f9-52d4-4054-8321-42f5226ca83b" (UID: "615124f9-52d4-4054-8321-42f5226ca83b"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:07:53 crc kubenswrapper[5120]: I0316 16:07:53.000941 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jb4vl\" (UniqueName: \"kubernetes.io/projected/615124f9-52d4-4054-8321-42f5226ca83b-kube-api-access-jb4vl\") pod \"615124f9-52d4-4054-8321-42f5226ca83b\" (UID: \"615124f9-52d4-4054-8321-42f5226ca83b\") " Mar 16 16:07:53 crc kubenswrapper[5120]: I0316 16:07:53.001539 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/615124f9-52d4-4054-8321-42f5226ca83b-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:07:53 crc kubenswrapper[5120]: I0316 16:07:53.009271 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/615124f9-52d4-4054-8321-42f5226ca83b-kube-api-access-jb4vl" (OuterVolumeSpecName: "kube-api-access-jb4vl") pod "615124f9-52d4-4054-8321-42f5226ca83b" (UID: "615124f9-52d4-4054-8321-42f5226ca83b"). InnerVolumeSpecName "kube-api-access-jb4vl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:07:53 crc kubenswrapper[5120]: I0316 16:07:53.013308 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-l8vn4" podUID="26cb0730-b6af-4f60-baa0-3ce77a180060" containerName="dnsmasq-dns" probeResult="failure" output="dial tcp 10.217.1.204:5353: i/o timeout" Mar 16 16:07:53 crc kubenswrapper[5120]: I0316 16:07:53.103467 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jb4vl\" (UniqueName: \"kubernetes.io/projected/615124f9-52d4-4054-8321-42f5226ca83b-kube-api-access-jb4vl\") on node \"crc\" DevicePath \"\"" Mar 16 16:07:53 crc kubenswrapper[5120]: I0316 16:07:53.672436 5120 generic.go:358] "Generic (PLEG): container finished" podID="82c11055-585b-4f89-b75a-b396389fa715" containerID="32a5fae783c49e06b1845498e8a9937d7600c43ddfc4063f7a9eebd7ee19e9a2" exitCode=0 Mar 16 16:07:53 crc kubenswrapper[5120]: I0316 16:07:53.672821 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-r2gv8" event={"ID":"82c11055-585b-4f89-b75a-b396389fa715","Type":"ContainerDied","Data":"32a5fae783c49e06b1845498e8a9937d7600c43ddfc4063f7a9eebd7ee19e9a2"} Mar 16 16:07:53 crc kubenswrapper[5120]: I0316 16:07:53.677713 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-6c05-account-create-update-9n5cf" event={"ID":"615124f9-52d4-4054-8321-42f5226ca83b","Type":"ContainerDied","Data":"2c5c1967c2e7dfd64b9ea227b5b88fc4ba3cd1e16b0b27340a4a023d5cbd6783"} Mar 16 16:07:53 crc kubenswrapper[5120]: I0316 16:07:53.678030 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2c5c1967c2e7dfd64b9ea227b5b88fc4ba3cd1e16b0b27340a4a023d5cbd6783" Mar 16 16:07:53 crc kubenswrapper[5120]: I0316 16:07:53.677999 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-6c05-account-create-update-9n5cf" Mar 16 16:07:55 crc kubenswrapper[5120]: I0316 16:07:55.055040 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-r2gv8" Mar 16 16:07:55 crc kubenswrapper[5120]: I0316 16:07:55.143370 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nhcvm\" (UniqueName: \"kubernetes.io/projected/82c11055-585b-4f89-b75a-b396389fa715-kube-api-access-nhcvm\") pod \"82c11055-585b-4f89-b75a-b396389fa715\" (UID: \"82c11055-585b-4f89-b75a-b396389fa715\") " Mar 16 16:07:55 crc kubenswrapper[5120]: I0316 16:07:55.143428 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/82c11055-585b-4f89-b75a-b396389fa715-combined-ca-bundle\") pod \"82c11055-585b-4f89-b75a-b396389fa715\" (UID: \"82c11055-585b-4f89-b75a-b396389fa715\") " Mar 16 16:07:55 crc kubenswrapper[5120]: I0316 16:07:55.143545 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/82c11055-585b-4f89-b75a-b396389fa715-config-data\") pod \"82c11055-585b-4f89-b75a-b396389fa715\" (UID: \"82c11055-585b-4f89-b75a-b396389fa715\") " Mar 16 16:07:55 crc kubenswrapper[5120]: I0316 16:07:55.149085 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82c11055-585b-4f89-b75a-b396389fa715-kube-api-access-nhcvm" (OuterVolumeSpecName: "kube-api-access-nhcvm") pod "82c11055-585b-4f89-b75a-b396389fa715" (UID: "82c11055-585b-4f89-b75a-b396389fa715"). InnerVolumeSpecName "kube-api-access-nhcvm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:07:55 crc kubenswrapper[5120]: I0316 16:07:55.175385 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/82c11055-585b-4f89-b75a-b396389fa715-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "82c11055-585b-4f89-b75a-b396389fa715" (UID: "82c11055-585b-4f89-b75a-b396389fa715"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:07:55 crc kubenswrapper[5120]: I0316 16:07:55.182518 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/82c11055-585b-4f89-b75a-b396389fa715-config-data" (OuterVolumeSpecName: "config-data") pod "82c11055-585b-4f89-b75a-b396389fa715" (UID: "82c11055-585b-4f89-b75a-b396389fa715"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:07:55 crc kubenswrapper[5120]: I0316 16:07:55.247317 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nhcvm\" (UniqueName: \"kubernetes.io/projected/82c11055-585b-4f89-b75a-b396389fa715-kube-api-access-nhcvm\") on node \"crc\" DevicePath \"\"" Mar 16 16:07:55 crc kubenswrapper[5120]: I0316 16:07:55.247387 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/82c11055-585b-4f89-b75a-b396389fa715-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:07:55 crc kubenswrapper[5120]: I0316 16:07:55.247413 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/82c11055-585b-4f89-b75a-b396389fa715-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:07:55 crc kubenswrapper[5120]: I0316 16:07:55.705402 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-r2gv8" event={"ID":"82c11055-585b-4f89-b75a-b396389fa715","Type":"ContainerDied","Data":"df36376b9237da13d0202b0731975eb399af1c0b61b74205fb4fd3a2111c3b8f"} Mar 16 16:07:55 crc kubenswrapper[5120]: I0316 16:07:55.705803 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="df36376b9237da13d0202b0731975eb399af1c0b61b74205fb4fd3a2111c3b8f" Mar 16 16:07:55 crc kubenswrapper[5120]: I0316 16:07:55.705704 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-r2gv8" Mar 16 16:07:55 crc kubenswrapper[5120]: I0316 16:07:55.887013 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-8lrsq"] Mar 16 16:07:55 crc kubenswrapper[5120]: I0316 16:07:55.888140 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82c11055-585b-4f89-b75a-b396389fa715" containerName="keystone-db-sync" Mar 16 16:07:55 crc kubenswrapper[5120]: I0316 16:07:55.888167 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="82c11055-585b-4f89-b75a-b396389fa715" containerName="keystone-db-sync" Mar 16 16:07:55 crc kubenswrapper[5120]: I0316 16:07:55.888184 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="615124f9-52d4-4054-8321-42f5226ca83b" containerName="mariadb-account-create-update" Mar 16 16:07:55 crc kubenswrapper[5120]: I0316 16:07:55.888197 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="615124f9-52d4-4054-8321-42f5226ca83b" containerName="mariadb-account-create-update" Mar 16 16:07:55 crc kubenswrapper[5120]: I0316 16:07:55.888223 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98d8925d-4997-48e0-a674-abb5bdb026dd" containerName="mariadb-database-create" Mar 16 16:07:55 crc kubenswrapper[5120]: I0316 16:07:55.888231 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="98d8925d-4997-48e0-a674-abb5bdb026dd" containerName="mariadb-database-create" Mar 16 16:07:55 crc kubenswrapper[5120]: I0316 16:07:55.888246 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d156ff3-9ed3-4e45-81f4-5c0f0115833e" containerName="mariadb-database-create" Mar 16 16:07:55 crc kubenswrapper[5120]: I0316 16:07:55.888254 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d156ff3-9ed3-4e45-81f4-5c0f0115833e" containerName="mariadb-database-create" Mar 16 16:07:55 crc kubenswrapper[5120]: I0316 16:07:55.888263 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6dce3c7-a168-4f7b-8f35-b18f6de810e8" containerName="mariadb-account-create-update" Mar 16 16:07:55 crc kubenswrapper[5120]: I0316 16:07:55.888270 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6dce3c7-a168-4f7b-8f35-b18f6de810e8" containerName="mariadb-account-create-update" Mar 16 16:07:55 crc kubenswrapper[5120]: I0316 16:07:55.888327 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87bfd7ec-53c8-49c4-b69b-e3f39ba9f3ec" containerName="mariadb-database-create" Mar 16 16:07:55 crc kubenswrapper[5120]: I0316 16:07:55.888335 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="87bfd7ec-53c8-49c4-b69b-e3f39ba9f3ec" containerName="mariadb-database-create" Mar 16 16:07:55 crc kubenswrapper[5120]: I0316 16:07:55.888345 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db2e0899-ea7d-4d2b-a32b-86633648d762" containerName="mariadb-account-create-update" Mar 16 16:07:55 crc kubenswrapper[5120]: I0316 16:07:55.888354 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="db2e0899-ea7d-4d2b-a32b-86633648d762" containerName="mariadb-account-create-update" Mar 16 16:07:55 crc kubenswrapper[5120]: I0316 16:07:55.888536 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7d156ff3-9ed3-4e45-81f4-5c0f0115833e" containerName="mariadb-database-create" Mar 16 16:07:55 crc kubenswrapper[5120]: I0316 16:07:55.888558 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="87bfd7ec-53c8-49c4-b69b-e3f39ba9f3ec" containerName="mariadb-database-create" Mar 16 16:07:55 crc kubenswrapper[5120]: I0316 16:07:55.888569 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="db2e0899-ea7d-4d2b-a32b-86633648d762" containerName="mariadb-account-create-update" Mar 16 16:07:55 crc kubenswrapper[5120]: I0316 16:07:55.888583 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="82c11055-585b-4f89-b75a-b396389fa715" containerName="keystone-db-sync" Mar 16 16:07:55 crc kubenswrapper[5120]: I0316 16:07:55.888596 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="d6dce3c7-a168-4f7b-8f35-b18f6de810e8" containerName="mariadb-account-create-update" Mar 16 16:07:55 crc kubenswrapper[5120]: I0316 16:07:55.888606 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="98d8925d-4997-48e0-a674-abb5bdb026dd" containerName="mariadb-database-create" Mar 16 16:07:55 crc kubenswrapper[5120]: I0316 16:07:55.888621 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="615124f9-52d4-4054-8321-42f5226ca83b" containerName="mariadb-account-create-update" Mar 16 16:07:55 crc kubenswrapper[5120]: I0316 16:07:55.900956 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-8lrsq"] Mar 16 16:07:55 crc kubenswrapper[5120]: I0316 16:07:55.901109 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-8lrsq" Mar 16 16:07:55 crc kubenswrapper[5120]: I0316 16:07:55.905647 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-config-data\"" Mar 16 16:07:55 crc kubenswrapper[5120]: I0316 16:07:55.906164 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-scripts\"" Mar 16 16:07:55 crc kubenswrapper[5120]: I0316 16:07:55.906413 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone\"" Mar 16 16:07:55 crc kubenswrapper[5120]: I0316 16:07:55.906538 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-keystone-dockercfg-h8dlj\"" Mar 16 16:07:55 crc kubenswrapper[5120]: I0316 16:07:55.906679 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"osp-secret\"" Mar 16 16:07:55 crc kubenswrapper[5120]: I0316 16:07:55.961287 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/ff364e62-5da8-4005-89e0-48e3dbfa5222-fernet-keys\") pod \"keystone-bootstrap-8lrsq\" (UID: \"ff364e62-5da8-4005-89e0-48e3dbfa5222\") " pod="openstack-kuttl-tests/keystone-bootstrap-8lrsq" Mar 16 16:07:55 crc kubenswrapper[5120]: I0316 16:07:55.961327 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qlzls\" (UniqueName: \"kubernetes.io/projected/ff364e62-5da8-4005-89e0-48e3dbfa5222-kube-api-access-qlzls\") pod \"keystone-bootstrap-8lrsq\" (UID: \"ff364e62-5da8-4005-89e0-48e3dbfa5222\") " pod="openstack-kuttl-tests/keystone-bootstrap-8lrsq" Mar 16 16:07:55 crc kubenswrapper[5120]: I0316 16:07:55.961361 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ff364e62-5da8-4005-89e0-48e3dbfa5222-scripts\") pod \"keystone-bootstrap-8lrsq\" (UID: \"ff364e62-5da8-4005-89e0-48e3dbfa5222\") " pod="openstack-kuttl-tests/keystone-bootstrap-8lrsq" Mar 16 16:07:55 crc kubenswrapper[5120]: I0316 16:07:55.961437 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/ff364e62-5da8-4005-89e0-48e3dbfa5222-credential-keys\") pod \"keystone-bootstrap-8lrsq\" (UID: \"ff364e62-5da8-4005-89e0-48e3dbfa5222\") " pod="openstack-kuttl-tests/keystone-bootstrap-8lrsq" Mar 16 16:07:55 crc kubenswrapper[5120]: I0316 16:07:55.961477 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ff364e62-5da8-4005-89e0-48e3dbfa5222-combined-ca-bundle\") pod \"keystone-bootstrap-8lrsq\" (UID: \"ff364e62-5da8-4005-89e0-48e3dbfa5222\") " pod="openstack-kuttl-tests/keystone-bootstrap-8lrsq" Mar 16 16:07:55 crc kubenswrapper[5120]: I0316 16:07:55.961552 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ff364e62-5da8-4005-89e0-48e3dbfa5222-config-data\") pod \"keystone-bootstrap-8lrsq\" (UID: \"ff364e62-5da8-4005-89e0-48e3dbfa5222\") " pod="openstack-kuttl-tests/keystone-bootstrap-8lrsq" Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.026084 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.036601 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.039185 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.040161 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.042645 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.062834 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ff364e62-5da8-4005-89e0-48e3dbfa5222-config-data\") pod \"keystone-bootstrap-8lrsq\" (UID: \"ff364e62-5da8-4005-89e0-48e3dbfa5222\") " pod="openstack-kuttl-tests/keystone-bootstrap-8lrsq" Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.062953 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/ff364e62-5da8-4005-89e0-48e3dbfa5222-fernet-keys\") pod \"keystone-bootstrap-8lrsq\" (UID: \"ff364e62-5da8-4005-89e0-48e3dbfa5222\") " pod="openstack-kuttl-tests/keystone-bootstrap-8lrsq" Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.062973 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qlzls\" (UniqueName: \"kubernetes.io/projected/ff364e62-5da8-4005-89e0-48e3dbfa5222-kube-api-access-qlzls\") pod \"keystone-bootstrap-8lrsq\" (UID: \"ff364e62-5da8-4005-89e0-48e3dbfa5222\") " pod="openstack-kuttl-tests/keystone-bootstrap-8lrsq" Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.063001 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ff364e62-5da8-4005-89e0-48e3dbfa5222-scripts\") pod \"keystone-bootstrap-8lrsq\" (UID: \"ff364e62-5da8-4005-89e0-48e3dbfa5222\") " pod="openstack-kuttl-tests/keystone-bootstrap-8lrsq" Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.063050 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/ff364e62-5da8-4005-89e0-48e3dbfa5222-credential-keys\") pod \"keystone-bootstrap-8lrsq\" (UID: \"ff364e62-5da8-4005-89e0-48e3dbfa5222\") " pod="openstack-kuttl-tests/keystone-bootstrap-8lrsq" Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.063088 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ff364e62-5da8-4005-89e0-48e3dbfa5222-combined-ca-bundle\") pod \"keystone-bootstrap-8lrsq\" (UID: \"ff364e62-5da8-4005-89e0-48e3dbfa5222\") " pod="openstack-kuttl-tests/keystone-bootstrap-8lrsq" Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.068249 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/ff364e62-5da8-4005-89e0-48e3dbfa5222-credential-keys\") pod \"keystone-bootstrap-8lrsq\" (UID: \"ff364e62-5da8-4005-89e0-48e3dbfa5222\") " pod="openstack-kuttl-tests/keystone-bootstrap-8lrsq" Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.070315 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/ff364e62-5da8-4005-89e0-48e3dbfa5222-fernet-keys\") pod \"keystone-bootstrap-8lrsq\" (UID: \"ff364e62-5da8-4005-89e0-48e3dbfa5222\") " pod="openstack-kuttl-tests/keystone-bootstrap-8lrsq" Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.070966 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ff364e62-5da8-4005-89e0-48e3dbfa5222-config-data\") pod \"keystone-bootstrap-8lrsq\" (UID: \"ff364e62-5da8-4005-89e0-48e3dbfa5222\") " pod="openstack-kuttl-tests/keystone-bootstrap-8lrsq" Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.082526 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ff364e62-5da8-4005-89e0-48e3dbfa5222-scripts\") pod \"keystone-bootstrap-8lrsq\" (UID: \"ff364e62-5da8-4005-89e0-48e3dbfa5222\") " pod="openstack-kuttl-tests/keystone-bootstrap-8lrsq" Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.091150 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ff364e62-5da8-4005-89e0-48e3dbfa5222-combined-ca-bundle\") pod \"keystone-bootstrap-8lrsq\" (UID: \"ff364e62-5da8-4005-89e0-48e3dbfa5222\") " pod="openstack-kuttl-tests/keystone-bootstrap-8lrsq" Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.091195 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qlzls\" (UniqueName: \"kubernetes.io/projected/ff364e62-5da8-4005-89e0-48e3dbfa5222-kube-api-access-qlzls\") pod \"keystone-bootstrap-8lrsq\" (UID: \"ff364e62-5da8-4005-89e0-48e3dbfa5222\") " pod="openstack-kuttl-tests/keystone-bootstrap-8lrsq" Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.154460 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-gqvqz"] Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.160993 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-gqvqz" Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.166202 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-cinder-dockercfg-bsw7q\"" Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.166646 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/42f516f0-04ae-4acc-83dd-4245872ac0c9-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"42f516f0-04ae-4acc-83dd-4245872ac0c9\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.167951 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/42f516f0-04ae-4acc-83dd-4245872ac0c9-log-httpd\") pod \"ceilometer-0\" (UID: \"42f516f0-04ae-4acc-83dd-4245872ac0c9\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.167992 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/42f516f0-04ae-4acc-83dd-4245872ac0c9-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"42f516f0-04ae-4acc-83dd-4245872ac0c9\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.168030 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/42f516f0-04ae-4acc-83dd-4245872ac0c9-scripts\") pod \"ceilometer-0\" (UID: \"42f516f0-04ae-4acc-83dd-4245872ac0c9\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.168068 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/42f516f0-04ae-4acc-83dd-4245872ac0c9-config-data\") pod \"ceilometer-0\" (UID: \"42f516f0-04ae-4acc-83dd-4245872ac0c9\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.168084 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/42f516f0-04ae-4acc-83dd-4245872ac0c9-run-httpd\") pod \"ceilometer-0\" (UID: \"42f516f0-04ae-4acc-83dd-4245872ac0c9\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.168116 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2sbm7\" (UniqueName: \"kubernetes.io/projected/42f516f0-04ae-4acc-83dd-4245872ac0c9-kube-api-access-2sbm7\") pod \"ceilometer-0\" (UID: \"42f516f0-04ae-4acc-83dd-4245872ac0c9\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.166954 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-config-data\"" Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.167013 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-scripts\"" Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.172623 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-wz6tz"] Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.192373 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-wz6tz" Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.195095 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-httpd-config\"" Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.195351 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-config\"" Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.195533 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-neutron-dockercfg-j55dl\"" Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.195634 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-gqvqz"] Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.216682 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-wz6tz"] Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.224146 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-db-sync-ghc6c"] Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.232884 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-ghc6c" Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.234203 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-8lrsq" Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.238576 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-placement-dockercfg-dpblk\"" Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.238799 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-scripts\"" Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.239280 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-config-data\"" Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.254501 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-ghc6c"] Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.269121 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/745660ab-e0e8-433c-b1ef-405de9b26576-etc-machine-id\") pod \"cinder-db-sync-gqvqz\" (UID: \"745660ab-e0e8-433c-b1ef-405de9b26576\") " pod="openstack-kuttl-tests/cinder-db-sync-gqvqz" Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.269165 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvl2m\" (UniqueName: \"kubernetes.io/projected/eb1e112a-eec6-4aef-93fb-f809f1c7e6be-kube-api-access-wvl2m\") pod \"neutron-db-sync-wz6tz\" (UID: \"eb1e112a-eec6-4aef-93fb-f809f1c7e6be\") " pod="openstack-kuttl-tests/neutron-db-sync-wz6tz" Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.269206 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/745660ab-e0e8-433c-b1ef-405de9b26576-combined-ca-bundle\") pod \"cinder-db-sync-gqvqz\" (UID: \"745660ab-e0e8-433c-b1ef-405de9b26576\") " pod="openstack-kuttl-tests/cinder-db-sync-gqvqz" Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.269248 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/42f516f0-04ae-4acc-83dd-4245872ac0c9-log-httpd\") pod \"ceilometer-0\" (UID: \"42f516f0-04ae-4acc-83dd-4245872ac0c9\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.269266 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/745660ab-e0e8-433c-b1ef-405de9b26576-db-sync-config-data\") pod \"cinder-db-sync-gqvqz\" (UID: \"745660ab-e0e8-433c-b1ef-405de9b26576\") " pod="openstack-kuttl-tests/cinder-db-sync-gqvqz" Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.269288 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/eb1e112a-eec6-4aef-93fb-f809f1c7e6be-config\") pod \"neutron-db-sync-wz6tz\" (UID: \"eb1e112a-eec6-4aef-93fb-f809f1c7e6be\") " pod="openstack-kuttl-tests/neutron-db-sync-wz6tz" Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.269312 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/745660ab-e0e8-433c-b1ef-405de9b26576-scripts\") pod \"cinder-db-sync-gqvqz\" (UID: \"745660ab-e0e8-433c-b1ef-405de9b26576\") " pod="openstack-kuttl-tests/cinder-db-sync-gqvqz" Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.269331 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/42f516f0-04ae-4acc-83dd-4245872ac0c9-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"42f516f0-04ae-4acc-83dd-4245872ac0c9\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.269368 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/42f516f0-04ae-4acc-83dd-4245872ac0c9-scripts\") pod \"ceilometer-0\" (UID: \"42f516f0-04ae-4acc-83dd-4245872ac0c9\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.269397 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eb1e112a-eec6-4aef-93fb-f809f1c7e6be-combined-ca-bundle\") pod \"neutron-db-sync-wz6tz\" (UID: \"eb1e112a-eec6-4aef-93fb-f809f1c7e6be\") " pod="openstack-kuttl-tests/neutron-db-sync-wz6tz" Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.269424 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/42f516f0-04ae-4acc-83dd-4245872ac0c9-config-data\") pod \"ceilometer-0\" (UID: \"42f516f0-04ae-4acc-83dd-4245872ac0c9\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.269438 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/42f516f0-04ae-4acc-83dd-4245872ac0c9-run-httpd\") pod \"ceilometer-0\" (UID: \"42f516f0-04ae-4acc-83dd-4245872ac0c9\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.269461 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6km57\" (UniqueName: \"kubernetes.io/projected/745660ab-e0e8-433c-b1ef-405de9b26576-kube-api-access-6km57\") pod \"cinder-db-sync-gqvqz\" (UID: \"745660ab-e0e8-433c-b1ef-405de9b26576\") " pod="openstack-kuttl-tests/cinder-db-sync-gqvqz" Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.269486 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2sbm7\" (UniqueName: \"kubernetes.io/projected/42f516f0-04ae-4acc-83dd-4245872ac0c9-kube-api-access-2sbm7\") pod \"ceilometer-0\" (UID: \"42f516f0-04ae-4acc-83dd-4245872ac0c9\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.269543 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/745660ab-e0e8-433c-b1ef-405de9b26576-config-data\") pod \"cinder-db-sync-gqvqz\" (UID: \"745660ab-e0e8-433c-b1ef-405de9b26576\") " pod="openstack-kuttl-tests/cinder-db-sync-gqvqz" Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.269558 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/42f516f0-04ae-4acc-83dd-4245872ac0c9-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"42f516f0-04ae-4acc-83dd-4245872ac0c9\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.271534 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/42f516f0-04ae-4acc-83dd-4245872ac0c9-log-httpd\") pod \"ceilometer-0\" (UID: \"42f516f0-04ae-4acc-83dd-4245872ac0c9\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.271696 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/42f516f0-04ae-4acc-83dd-4245872ac0c9-run-httpd\") pod \"ceilometer-0\" (UID: \"42f516f0-04ae-4acc-83dd-4245872ac0c9\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.280564 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/42f516f0-04ae-4acc-83dd-4245872ac0c9-scripts\") pod \"ceilometer-0\" (UID: \"42f516f0-04ae-4acc-83dd-4245872ac0c9\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.280961 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/42f516f0-04ae-4acc-83dd-4245872ac0c9-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"42f516f0-04ae-4acc-83dd-4245872ac0c9\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.280974 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/42f516f0-04ae-4acc-83dd-4245872ac0c9-config-data\") pod \"ceilometer-0\" (UID: \"42f516f0-04ae-4acc-83dd-4245872ac0c9\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.283923 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/42f516f0-04ae-4acc-83dd-4245872ac0c9-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"42f516f0-04ae-4acc-83dd-4245872ac0c9\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.293890 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2sbm7\" (UniqueName: \"kubernetes.io/projected/42f516f0-04ae-4acc-83dd-4245872ac0c9-kube-api-access-2sbm7\") pod \"ceilometer-0\" (UID: \"42f516f0-04ae-4acc-83dd-4245872ac0c9\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.322261 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-g56h7"] Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.332251 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-g56h7" Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.344295 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-barbican-dockercfg-mts9v\"" Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.344684 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-config-data\"" Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.347422 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-g56h7"] Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.355122 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.371910 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6km57\" (UniqueName: \"kubernetes.io/projected/745660ab-e0e8-433c-b1ef-405de9b26576-kube-api-access-6km57\") pod \"cinder-db-sync-gqvqz\" (UID: \"745660ab-e0e8-433c-b1ef-405de9b26576\") " pod="openstack-kuttl-tests/cinder-db-sync-gqvqz" Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.372244 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/745660ab-e0e8-433c-b1ef-405de9b26576-config-data\") pod \"cinder-db-sync-gqvqz\" (UID: \"745660ab-e0e8-433c-b1ef-405de9b26576\") " pod="openstack-kuttl-tests/cinder-db-sync-gqvqz" Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.372396 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d247de94-c318-4161-a382-99a79cf7758c-combined-ca-bundle\") pod \"placement-db-sync-ghc6c\" (UID: \"d247de94-c318-4161-a382-99a79cf7758c\") " pod="openstack-kuttl-tests/placement-db-sync-ghc6c" Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.373532 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d247de94-c318-4161-a382-99a79cf7758c-scripts\") pod \"placement-db-sync-ghc6c\" (UID: \"d247de94-c318-4161-a382-99a79cf7758c\") " pod="openstack-kuttl-tests/placement-db-sync-ghc6c" Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.373641 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/745660ab-e0e8-433c-b1ef-405de9b26576-etc-machine-id\") pod \"cinder-db-sync-gqvqz\" (UID: \"745660ab-e0e8-433c-b1ef-405de9b26576\") " pod="openstack-kuttl-tests/cinder-db-sync-gqvqz" Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.373797 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wvl2m\" (UniqueName: \"kubernetes.io/projected/eb1e112a-eec6-4aef-93fb-f809f1c7e6be-kube-api-access-wvl2m\") pod \"neutron-db-sync-wz6tz\" (UID: \"eb1e112a-eec6-4aef-93fb-f809f1c7e6be\") " pod="openstack-kuttl-tests/neutron-db-sync-wz6tz" Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.373923 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/745660ab-e0e8-433c-b1ef-405de9b26576-combined-ca-bundle\") pod \"cinder-db-sync-gqvqz\" (UID: \"745660ab-e0e8-433c-b1ef-405de9b26576\") " pod="openstack-kuttl-tests/cinder-db-sync-gqvqz" Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.374020 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22mrc\" (UniqueName: \"kubernetes.io/projected/d247de94-c318-4161-a382-99a79cf7758c-kube-api-access-22mrc\") pod \"placement-db-sync-ghc6c\" (UID: \"d247de94-c318-4161-a382-99a79cf7758c\") " pod="openstack-kuttl-tests/placement-db-sync-ghc6c" Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.374136 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/745660ab-e0e8-433c-b1ef-405de9b26576-db-sync-config-data\") pod \"cinder-db-sync-gqvqz\" (UID: \"745660ab-e0e8-433c-b1ef-405de9b26576\") " pod="openstack-kuttl-tests/cinder-db-sync-gqvqz" Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.374218 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d247de94-c318-4161-a382-99a79cf7758c-logs\") pod \"placement-db-sync-ghc6c\" (UID: \"d247de94-c318-4161-a382-99a79cf7758c\") " pod="openstack-kuttl-tests/placement-db-sync-ghc6c" Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.374318 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/eb1e112a-eec6-4aef-93fb-f809f1c7e6be-config\") pod \"neutron-db-sync-wz6tz\" (UID: \"eb1e112a-eec6-4aef-93fb-f809f1c7e6be\") " pod="openstack-kuttl-tests/neutron-db-sync-wz6tz" Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.374406 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/745660ab-e0e8-433c-b1ef-405de9b26576-scripts\") pod \"cinder-db-sync-gqvqz\" (UID: \"745660ab-e0e8-433c-b1ef-405de9b26576\") " pod="openstack-kuttl-tests/cinder-db-sync-gqvqz" Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.375232 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/745660ab-e0e8-433c-b1ef-405de9b26576-etc-machine-id\") pod \"cinder-db-sync-gqvqz\" (UID: \"745660ab-e0e8-433c-b1ef-405de9b26576\") " pod="openstack-kuttl-tests/cinder-db-sync-gqvqz" Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.375445 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eb1e112a-eec6-4aef-93fb-f809f1c7e6be-combined-ca-bundle\") pod \"neutron-db-sync-wz6tz\" (UID: \"eb1e112a-eec6-4aef-93fb-f809f1c7e6be\") " pod="openstack-kuttl-tests/neutron-db-sync-wz6tz" Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.375487 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d247de94-c318-4161-a382-99a79cf7758c-config-data\") pod \"placement-db-sync-ghc6c\" (UID: \"d247de94-c318-4161-a382-99a79cf7758c\") " pod="openstack-kuttl-tests/placement-db-sync-ghc6c" Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.376484 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/745660ab-e0e8-433c-b1ef-405de9b26576-config-data\") pod \"cinder-db-sync-gqvqz\" (UID: \"745660ab-e0e8-433c-b1ef-405de9b26576\") " pod="openstack-kuttl-tests/cinder-db-sync-gqvqz" Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.377614 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/745660ab-e0e8-433c-b1ef-405de9b26576-db-sync-config-data\") pod \"cinder-db-sync-gqvqz\" (UID: \"745660ab-e0e8-433c-b1ef-405de9b26576\") " pod="openstack-kuttl-tests/cinder-db-sync-gqvqz" Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.380056 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/745660ab-e0e8-433c-b1ef-405de9b26576-scripts\") pod \"cinder-db-sync-gqvqz\" (UID: \"745660ab-e0e8-433c-b1ef-405de9b26576\") " pod="openstack-kuttl-tests/cinder-db-sync-gqvqz" Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.380201 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/745660ab-e0e8-433c-b1ef-405de9b26576-combined-ca-bundle\") pod \"cinder-db-sync-gqvqz\" (UID: \"745660ab-e0e8-433c-b1ef-405de9b26576\") " pod="openstack-kuttl-tests/cinder-db-sync-gqvqz" Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.382443 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/eb1e112a-eec6-4aef-93fb-f809f1c7e6be-config\") pod \"neutron-db-sync-wz6tz\" (UID: \"eb1e112a-eec6-4aef-93fb-f809f1c7e6be\") " pod="openstack-kuttl-tests/neutron-db-sync-wz6tz" Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.383609 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eb1e112a-eec6-4aef-93fb-f809f1c7e6be-combined-ca-bundle\") pod \"neutron-db-sync-wz6tz\" (UID: \"eb1e112a-eec6-4aef-93fb-f809f1c7e6be\") " pod="openstack-kuttl-tests/neutron-db-sync-wz6tz" Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.399164 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6km57\" (UniqueName: \"kubernetes.io/projected/745660ab-e0e8-433c-b1ef-405de9b26576-kube-api-access-6km57\") pod \"cinder-db-sync-gqvqz\" (UID: \"745660ab-e0e8-433c-b1ef-405de9b26576\") " pod="openstack-kuttl-tests/cinder-db-sync-gqvqz" Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.399267 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvl2m\" (UniqueName: \"kubernetes.io/projected/eb1e112a-eec6-4aef-93fb-f809f1c7e6be-kube-api-access-wvl2m\") pod \"neutron-db-sync-wz6tz\" (UID: \"eb1e112a-eec6-4aef-93fb-f809f1c7e6be\") " pod="openstack-kuttl-tests/neutron-db-sync-wz6tz" Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.476948 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mgxr\" (UniqueName: \"kubernetes.io/projected/0008a48f-3c91-43dc-be3f-6ba3697e01dc-kube-api-access-4mgxr\") pod \"barbican-db-sync-g56h7\" (UID: \"0008a48f-3c91-43dc-be3f-6ba3697e01dc\") " pod="openstack-kuttl-tests/barbican-db-sync-g56h7" Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.477533 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d247de94-c318-4161-a382-99a79cf7758c-combined-ca-bundle\") pod \"placement-db-sync-ghc6c\" (UID: \"d247de94-c318-4161-a382-99a79cf7758c\") " pod="openstack-kuttl-tests/placement-db-sync-ghc6c" Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.477622 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0008a48f-3c91-43dc-be3f-6ba3697e01dc-combined-ca-bundle\") pod \"barbican-db-sync-g56h7\" (UID: \"0008a48f-3c91-43dc-be3f-6ba3697e01dc\") " pod="openstack-kuttl-tests/barbican-db-sync-g56h7" Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.477708 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d247de94-c318-4161-a382-99a79cf7758c-scripts\") pod \"placement-db-sync-ghc6c\" (UID: \"d247de94-c318-4161-a382-99a79cf7758c\") " pod="openstack-kuttl-tests/placement-db-sync-ghc6c" Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.477884 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-22mrc\" (UniqueName: \"kubernetes.io/projected/d247de94-c318-4161-a382-99a79cf7758c-kube-api-access-22mrc\") pod \"placement-db-sync-ghc6c\" (UID: \"d247de94-c318-4161-a382-99a79cf7758c\") " pod="openstack-kuttl-tests/placement-db-sync-ghc6c" Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.477983 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d247de94-c318-4161-a382-99a79cf7758c-logs\") pod \"placement-db-sync-ghc6c\" (UID: \"d247de94-c318-4161-a382-99a79cf7758c\") " pod="openstack-kuttl-tests/placement-db-sync-ghc6c" Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.478107 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d247de94-c318-4161-a382-99a79cf7758c-config-data\") pod \"placement-db-sync-ghc6c\" (UID: \"d247de94-c318-4161-a382-99a79cf7758c\") " pod="openstack-kuttl-tests/placement-db-sync-ghc6c" Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.478198 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/0008a48f-3c91-43dc-be3f-6ba3697e01dc-db-sync-config-data\") pod \"barbican-db-sync-g56h7\" (UID: \"0008a48f-3c91-43dc-be3f-6ba3697e01dc\") " pod="openstack-kuttl-tests/barbican-db-sync-g56h7" Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.479792 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d247de94-c318-4161-a382-99a79cf7758c-logs\") pod \"placement-db-sync-ghc6c\" (UID: \"d247de94-c318-4161-a382-99a79cf7758c\") " pod="openstack-kuttl-tests/placement-db-sync-ghc6c" Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.488247 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d247de94-c318-4161-a382-99a79cf7758c-scripts\") pod \"placement-db-sync-ghc6c\" (UID: \"d247de94-c318-4161-a382-99a79cf7758c\") " pod="openstack-kuttl-tests/placement-db-sync-ghc6c" Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.488563 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d247de94-c318-4161-a382-99a79cf7758c-config-data\") pod \"placement-db-sync-ghc6c\" (UID: \"d247de94-c318-4161-a382-99a79cf7758c\") " pod="openstack-kuttl-tests/placement-db-sync-ghc6c" Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.488682 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d247de94-c318-4161-a382-99a79cf7758c-combined-ca-bundle\") pod \"placement-db-sync-ghc6c\" (UID: \"d247de94-c318-4161-a382-99a79cf7758c\") " pod="openstack-kuttl-tests/placement-db-sync-ghc6c" Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.496664 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-gqvqz" Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.500489 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-22mrc\" (UniqueName: \"kubernetes.io/projected/d247de94-c318-4161-a382-99a79cf7758c-kube-api-access-22mrc\") pod \"placement-db-sync-ghc6c\" (UID: \"d247de94-c318-4161-a382-99a79cf7758c\") " pod="openstack-kuttl-tests/placement-db-sync-ghc6c" Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.515432 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-wz6tz" Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.553596 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-ghc6c" Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.579775 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/0008a48f-3c91-43dc-be3f-6ba3697e01dc-db-sync-config-data\") pod \"barbican-db-sync-g56h7\" (UID: \"0008a48f-3c91-43dc-be3f-6ba3697e01dc\") " pod="openstack-kuttl-tests/barbican-db-sync-g56h7" Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.579896 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4mgxr\" (UniqueName: \"kubernetes.io/projected/0008a48f-3c91-43dc-be3f-6ba3697e01dc-kube-api-access-4mgxr\") pod \"barbican-db-sync-g56h7\" (UID: \"0008a48f-3c91-43dc-be3f-6ba3697e01dc\") " pod="openstack-kuttl-tests/barbican-db-sync-g56h7" Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.579959 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0008a48f-3c91-43dc-be3f-6ba3697e01dc-combined-ca-bundle\") pod \"barbican-db-sync-g56h7\" (UID: \"0008a48f-3c91-43dc-be3f-6ba3697e01dc\") " pod="openstack-kuttl-tests/barbican-db-sync-g56h7" Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.583409 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/0008a48f-3c91-43dc-be3f-6ba3697e01dc-db-sync-config-data\") pod \"barbican-db-sync-g56h7\" (UID: \"0008a48f-3c91-43dc-be3f-6ba3697e01dc\") " pod="openstack-kuttl-tests/barbican-db-sync-g56h7" Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.584233 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0008a48f-3c91-43dc-be3f-6ba3697e01dc-combined-ca-bundle\") pod \"barbican-db-sync-g56h7\" (UID: \"0008a48f-3c91-43dc-be3f-6ba3697e01dc\") " pod="openstack-kuttl-tests/barbican-db-sync-g56h7" Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.600094 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mgxr\" (UniqueName: \"kubernetes.io/projected/0008a48f-3c91-43dc-be3f-6ba3697e01dc-kube-api-access-4mgxr\") pod \"barbican-db-sync-g56h7\" (UID: \"0008a48f-3c91-43dc-be3f-6ba3697e01dc\") " pod="openstack-kuttl-tests/barbican-db-sync-g56h7" Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.672944 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-g56h7" Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.788920 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-8lrsq"] Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.807964 5120 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Mar 16 16:07:56 crc kubenswrapper[5120]: W0316 16:07:56.857594 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod42f516f0_04ae_4acc_83dd_4245872ac0c9.slice/crio-e1017b5ee2c4ffa6fbbe029a9d56dca4e7c992b9218336ff126d9f3f3964e1b0 WatchSource:0}: Error finding container e1017b5ee2c4ffa6fbbe029a9d56dca4e7c992b9218336ff126d9f3f3964e1b0: Status 404 returned error can't find the container with id e1017b5ee2c4ffa6fbbe029a9d56dca4e7c992b9218336ff126d9f3f3964e1b0 Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.860667 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.967610 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.976981 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.977271 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.981112 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-scripts\"" Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.981213 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-internal-config-data\"" Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.993367 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-internal-svc\"" Mar 16 16:07:56 crc kubenswrapper[5120]: I0316 16:07:56.993481 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-glance-dockercfg-4kfq2\"" Mar 16 16:07:57 crc kubenswrapper[5120]: I0316 16:07:57.055222 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-gqvqz"] Mar 16 16:07:57 crc kubenswrapper[5120]: I0316 16:07:57.055270 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:07:57 crc kubenswrapper[5120]: I0316 16:07:57.063587 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:07:57 crc kubenswrapper[5120]: I0316 16:07:57.073142 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-external-config-data\"" Mar 16 16:07:57 crc kubenswrapper[5120]: I0316 16:07:57.073523 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-public-svc\"" Mar 16 16:07:57 crc kubenswrapper[5120]: W0316 16:07:57.081070 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod745660ab_e0e8_433c_b1ef_405de9b26576.slice/crio-2965c9721dace934fa470b41bd912c319f55c1b75f8b5390a7b0aadbdf27a9f3 WatchSource:0}: Error finding container 2965c9721dace934fa470b41bd912c319f55c1b75f8b5390a7b0aadbdf27a9f3: Status 404 returned error can't find the container with id 2965c9721dace934fa470b41bd912c319f55c1b75f8b5390a7b0aadbdf27a9f3 Mar 16 16:07:57 crc kubenswrapper[5120]: I0316 16:07:57.096779 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f8d91b46-e486-4be8-ad35-2c9d3d8fb671-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"f8d91b46-e486-4be8-ad35-2c9d3d8fb671\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:07:57 crc kubenswrapper[5120]: I0316 16:07:57.097130 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/f8d91b46-e486-4be8-ad35-2c9d3d8fb671-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"f8d91b46-e486-4be8-ad35-2c9d3d8fb671\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:07:57 crc kubenswrapper[5120]: I0316 16:07:57.097170 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jgh5\" (UniqueName: \"kubernetes.io/projected/f8d91b46-e486-4be8-ad35-2c9d3d8fb671-kube-api-access-5jgh5\") pod \"glance-default-internal-api-0\" (UID: \"f8d91b46-e486-4be8-ad35-2c9d3d8fb671\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:07:57 crc kubenswrapper[5120]: I0316 16:07:57.097209 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") pod \"glance-default-internal-api-0\" (UID: \"f8d91b46-e486-4be8-ad35-2c9d3d8fb671\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:07:57 crc kubenswrapper[5120]: I0316 16:07:57.097229 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f8d91b46-e486-4be8-ad35-2c9d3d8fb671-config-data\") pod \"glance-default-internal-api-0\" (UID: \"f8d91b46-e486-4be8-ad35-2c9d3d8fb671\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:07:57 crc kubenswrapper[5120]: I0316 16:07:57.097252 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f8d91b46-e486-4be8-ad35-2c9d3d8fb671-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"f8d91b46-e486-4be8-ad35-2c9d3d8fb671\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:07:57 crc kubenswrapper[5120]: I0316 16:07:57.097393 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f8d91b46-e486-4be8-ad35-2c9d3d8fb671-scripts\") pod \"glance-default-internal-api-0\" (UID: \"f8d91b46-e486-4be8-ad35-2c9d3d8fb671\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:07:57 crc kubenswrapper[5120]: I0316 16:07:57.097548 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f8d91b46-e486-4be8-ad35-2c9d3d8fb671-logs\") pod \"glance-default-internal-api-0\" (UID: \"f8d91b46-e486-4be8-ad35-2c9d3d8fb671\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:07:57 crc kubenswrapper[5120]: I0316 16:07:57.108271 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:07:57 crc kubenswrapper[5120]: I0316 16:07:57.149976 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-wz6tz"] Mar 16 16:07:57 crc kubenswrapper[5120]: I0316 16:07:57.199235 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkxts\" (UniqueName: \"kubernetes.io/projected/6563d4eb-7942-48f6-bcad-15604c886133-kube-api-access-kkxts\") pod \"glance-default-external-api-0\" (UID: \"6563d4eb-7942-48f6-bcad-15604c886133\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:07:57 crc kubenswrapper[5120]: I0316 16:07:57.199303 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f8d91b46-e486-4be8-ad35-2c9d3d8fb671-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"f8d91b46-e486-4be8-ad35-2c9d3d8fb671\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:07:57 crc kubenswrapper[5120]: I0316 16:07:57.199354 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/f8d91b46-e486-4be8-ad35-2c9d3d8fb671-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"f8d91b46-e486-4be8-ad35-2c9d3d8fb671\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:07:57 crc kubenswrapper[5120]: I0316 16:07:57.199383 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5jgh5\" (UniqueName: \"kubernetes.io/projected/f8d91b46-e486-4be8-ad35-2c9d3d8fb671-kube-api-access-5jgh5\") pod \"glance-default-internal-api-0\" (UID: \"f8d91b46-e486-4be8-ad35-2c9d3d8fb671\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:07:57 crc kubenswrapper[5120]: I0316 16:07:57.199415 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") pod \"glance-default-internal-api-0\" (UID: \"f8d91b46-e486-4be8-ad35-2c9d3d8fb671\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:07:57 crc kubenswrapper[5120]: I0316 16:07:57.199435 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f8d91b46-e486-4be8-ad35-2c9d3d8fb671-config-data\") pod \"glance-default-internal-api-0\" (UID: \"f8d91b46-e486-4be8-ad35-2c9d3d8fb671\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:07:57 crc kubenswrapper[5120]: I0316 16:07:57.199458 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage15-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage15-crc\") pod \"glance-default-external-api-0\" (UID: \"6563d4eb-7942-48f6-bcad-15604c886133\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:07:57 crc kubenswrapper[5120]: I0316 16:07:57.199484 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f8d91b46-e486-4be8-ad35-2c9d3d8fb671-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"f8d91b46-e486-4be8-ad35-2c9d3d8fb671\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:07:57 crc kubenswrapper[5120]: I0316 16:07:57.199542 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6563d4eb-7942-48f6-bcad-15604c886133-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"6563d4eb-7942-48f6-bcad-15604c886133\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:07:57 crc kubenswrapper[5120]: I0316 16:07:57.199640 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f8d91b46-e486-4be8-ad35-2c9d3d8fb671-scripts\") pod \"glance-default-internal-api-0\" (UID: \"f8d91b46-e486-4be8-ad35-2c9d3d8fb671\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:07:57 crc kubenswrapper[5120]: I0316 16:07:57.199716 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/6563d4eb-7942-48f6-bcad-15604c886133-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"6563d4eb-7942-48f6-bcad-15604c886133\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:07:57 crc kubenswrapper[5120]: I0316 16:07:57.200856 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6563d4eb-7942-48f6-bcad-15604c886133-config-data\") pod \"glance-default-external-api-0\" (UID: \"6563d4eb-7942-48f6-bcad-15604c886133\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:07:57 crc kubenswrapper[5120]: I0316 16:07:57.201261 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6563d4eb-7942-48f6-bcad-15604c886133-logs\") pod \"glance-default-external-api-0\" (UID: \"6563d4eb-7942-48f6-bcad-15604c886133\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:07:57 crc kubenswrapper[5120]: I0316 16:07:57.201350 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6563d4eb-7942-48f6-bcad-15604c886133-scripts\") pod \"glance-default-external-api-0\" (UID: \"6563d4eb-7942-48f6-bcad-15604c886133\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:07:57 crc kubenswrapper[5120]: I0316 16:07:57.201389 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f8d91b46-e486-4be8-ad35-2c9d3d8fb671-logs\") pod \"glance-default-internal-api-0\" (UID: \"f8d91b46-e486-4be8-ad35-2c9d3d8fb671\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:07:57 crc kubenswrapper[5120]: I0316 16:07:57.201423 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6563d4eb-7942-48f6-bcad-15604c886133-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"6563d4eb-7942-48f6-bcad-15604c886133\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:07:57 crc kubenswrapper[5120]: I0316 16:07:57.202688 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/f8d91b46-e486-4be8-ad35-2c9d3d8fb671-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"f8d91b46-e486-4be8-ad35-2c9d3d8fb671\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:07:57 crc kubenswrapper[5120]: I0316 16:07:57.208440 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f8d91b46-e486-4be8-ad35-2c9d3d8fb671-logs\") pod \"glance-default-internal-api-0\" (UID: \"f8d91b46-e486-4be8-ad35-2c9d3d8fb671\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:07:57 crc kubenswrapper[5120]: I0316 16:07:57.208864 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") pod \"glance-default-internal-api-0\" (UID: \"f8d91b46-e486-4be8-ad35-2c9d3d8fb671\") device mount path \"/mnt/openstack/pv14\"" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:07:57 crc kubenswrapper[5120]: I0316 16:07:57.210958 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f8d91b46-e486-4be8-ad35-2c9d3d8fb671-config-data\") pod \"glance-default-internal-api-0\" (UID: \"f8d91b46-e486-4be8-ad35-2c9d3d8fb671\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:07:57 crc kubenswrapper[5120]: I0316 16:07:57.215390 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f8d91b46-e486-4be8-ad35-2c9d3d8fb671-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"f8d91b46-e486-4be8-ad35-2c9d3d8fb671\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:07:57 crc kubenswrapper[5120]: I0316 16:07:57.215858 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f8d91b46-e486-4be8-ad35-2c9d3d8fb671-scripts\") pod \"glance-default-internal-api-0\" (UID: \"f8d91b46-e486-4be8-ad35-2c9d3d8fb671\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:07:57 crc kubenswrapper[5120]: I0316 16:07:57.220114 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-ghc6c"] Mar 16 16:07:57 crc kubenswrapper[5120]: I0316 16:07:57.221611 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f8d91b46-e486-4be8-ad35-2c9d3d8fb671-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"f8d91b46-e486-4be8-ad35-2c9d3d8fb671\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:07:57 crc kubenswrapper[5120]: I0316 16:07:57.227251 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jgh5\" (UniqueName: \"kubernetes.io/projected/f8d91b46-e486-4be8-ad35-2c9d3d8fb671-kube-api-access-5jgh5\") pod \"glance-default-internal-api-0\" (UID: \"f8d91b46-e486-4be8-ad35-2c9d3d8fb671\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:07:57 crc kubenswrapper[5120]: I0316 16:07:57.231318 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-g56h7"] Mar 16 16:07:57 crc kubenswrapper[5120]: W0316 16:07:57.236881 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0008a48f_3c91_43dc_be3f_6ba3697e01dc.slice/crio-66ae01d0f18b14e689b978da007c1036e0c727c7c73019306b78f95e4b34e54d WatchSource:0}: Error finding container 66ae01d0f18b14e689b978da007c1036e0c727c7c73019306b78f95e4b34e54d: Status 404 returned error can't find the container with id 66ae01d0f18b14e689b978da007c1036e0c727c7c73019306b78f95e4b34e54d Mar 16 16:07:57 crc kubenswrapper[5120]: I0316 16:07:57.252390 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") pod \"glance-default-internal-api-0\" (UID: \"f8d91b46-e486-4be8-ad35-2c9d3d8fb671\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:07:57 crc kubenswrapper[5120]: I0316 16:07:57.301464 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:07:57 crc kubenswrapper[5120]: I0316 16:07:57.302655 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6563d4eb-7942-48f6-bcad-15604c886133-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"6563d4eb-7942-48f6-bcad-15604c886133\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:07:57 crc kubenswrapper[5120]: I0316 16:07:57.303264 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kkxts\" (UniqueName: \"kubernetes.io/projected/6563d4eb-7942-48f6-bcad-15604c886133-kube-api-access-kkxts\") pod \"glance-default-external-api-0\" (UID: \"6563d4eb-7942-48f6-bcad-15604c886133\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:07:57 crc kubenswrapper[5120]: I0316 16:07:57.303330 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage15-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage15-crc\") pod \"glance-default-external-api-0\" (UID: \"6563d4eb-7942-48f6-bcad-15604c886133\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:07:57 crc kubenswrapper[5120]: I0316 16:07:57.303387 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6563d4eb-7942-48f6-bcad-15604c886133-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"6563d4eb-7942-48f6-bcad-15604c886133\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:07:57 crc kubenswrapper[5120]: I0316 16:07:57.303962 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage15-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage15-crc\") pod \"glance-default-external-api-0\" (UID: \"6563d4eb-7942-48f6-bcad-15604c886133\") device mount path \"/mnt/openstack/pv15\"" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:07:57 crc kubenswrapper[5120]: I0316 16:07:57.304202 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/6563d4eb-7942-48f6-bcad-15604c886133-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"6563d4eb-7942-48f6-bcad-15604c886133\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:07:57 crc kubenswrapper[5120]: I0316 16:07:57.304360 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6563d4eb-7942-48f6-bcad-15604c886133-config-data\") pod \"glance-default-external-api-0\" (UID: \"6563d4eb-7942-48f6-bcad-15604c886133\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:07:57 crc kubenswrapper[5120]: I0316 16:07:57.304401 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6563d4eb-7942-48f6-bcad-15604c886133-logs\") pod \"glance-default-external-api-0\" (UID: \"6563d4eb-7942-48f6-bcad-15604c886133\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:07:57 crc kubenswrapper[5120]: I0316 16:07:57.304461 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6563d4eb-7942-48f6-bcad-15604c886133-scripts\") pod \"glance-default-external-api-0\" (UID: \"6563d4eb-7942-48f6-bcad-15604c886133\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:07:57 crc kubenswrapper[5120]: I0316 16:07:57.305068 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/6563d4eb-7942-48f6-bcad-15604c886133-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"6563d4eb-7942-48f6-bcad-15604c886133\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:07:57 crc kubenswrapper[5120]: I0316 16:07:57.305910 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6563d4eb-7942-48f6-bcad-15604c886133-logs\") pod \"glance-default-external-api-0\" (UID: \"6563d4eb-7942-48f6-bcad-15604c886133\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:07:57 crc kubenswrapper[5120]: I0316 16:07:57.307856 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6563d4eb-7942-48f6-bcad-15604c886133-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"6563d4eb-7942-48f6-bcad-15604c886133\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:07:57 crc kubenswrapper[5120]: I0316 16:07:57.307970 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6563d4eb-7942-48f6-bcad-15604c886133-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"6563d4eb-7942-48f6-bcad-15604c886133\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:07:57 crc kubenswrapper[5120]: I0316 16:07:57.310475 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6563d4eb-7942-48f6-bcad-15604c886133-scripts\") pod \"glance-default-external-api-0\" (UID: \"6563d4eb-7942-48f6-bcad-15604c886133\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:07:57 crc kubenswrapper[5120]: I0316 16:07:57.310722 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6563d4eb-7942-48f6-bcad-15604c886133-config-data\") pod \"glance-default-external-api-0\" (UID: \"6563d4eb-7942-48f6-bcad-15604c886133\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:07:57 crc kubenswrapper[5120]: I0316 16:07:57.320704 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkxts\" (UniqueName: \"kubernetes.io/projected/6563d4eb-7942-48f6-bcad-15604c886133-kube-api-access-kkxts\") pod \"glance-default-external-api-0\" (UID: \"6563d4eb-7942-48f6-bcad-15604c886133\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:07:57 crc kubenswrapper[5120]: I0316 16:07:57.342235 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage15-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage15-crc\") pod \"glance-default-external-api-0\" (UID: \"6563d4eb-7942-48f6-bcad-15604c886133\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:07:57 crc kubenswrapper[5120]: I0316 16:07:57.412426 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:07:57 crc kubenswrapper[5120]: I0316 16:07:57.771149 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-8lrsq" event={"ID":"ff364e62-5da8-4005-89e0-48e3dbfa5222","Type":"ContainerStarted","Data":"cfe157cc8dcdbc92540f19f958bb6b85a3026d72bae9fd54deb5f193d808da86"} Mar 16 16:07:57 crc kubenswrapper[5120]: I0316 16:07:57.771557 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-8lrsq" event={"ID":"ff364e62-5da8-4005-89e0-48e3dbfa5222","Type":"ContainerStarted","Data":"1dcea7f9f352279eaafb8ff529d9e29812173e8e5e4645aeed567dafdfbcab39"} Mar 16 16:07:57 crc kubenswrapper[5120]: I0316 16:07:57.791406 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-g56h7" event={"ID":"0008a48f-3c91-43dc-be3f-6ba3697e01dc","Type":"ContainerStarted","Data":"1797654748c2f46782a5a7d0be292f62299666e2cbead383368cb1f914247684"} Mar 16 16:07:57 crc kubenswrapper[5120]: I0316 16:07:57.791458 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-g56h7" event={"ID":"0008a48f-3c91-43dc-be3f-6ba3697e01dc","Type":"ContainerStarted","Data":"66ae01d0f18b14e689b978da007c1036e0c727c7c73019306b78f95e4b34e54d"} Mar 16 16:07:57 crc kubenswrapper[5120]: I0316 16:07:57.808216 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:07:57 crc kubenswrapper[5120]: I0316 16:07:57.809399 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-bootstrap-8lrsq" podStartSLOduration=2.809381437 podStartE2EDuration="2.809381437s" podCreationTimestamp="2026-03-16 16:07:55 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:07:57.788874987 +0000 UTC m=+2179.942806654" watchObservedRunningTime="2026-03-16 16:07:57.809381437 +0000 UTC m=+2179.963313094" Mar 16 16:07:57 crc kubenswrapper[5120]: W0316 16:07:57.813524 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf8d91b46_e486_4be8_ad35_2c9d3d8fb671.slice/crio-0ae4cb43a9069a8b67de4e4370b2023f710c6a76199b673dc4eb346abd933f00 WatchSource:0}: Error finding container 0ae4cb43a9069a8b67de4e4370b2023f710c6a76199b673dc4eb346abd933f00: Status 404 returned error can't find the container with id 0ae4cb43a9069a8b67de4e4370b2023f710c6a76199b673dc4eb346abd933f00 Mar 16 16:07:57 crc kubenswrapper[5120]: I0316 16:07:57.822894 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-wz6tz" event={"ID":"eb1e112a-eec6-4aef-93fb-f809f1c7e6be","Type":"ContainerStarted","Data":"71b738fa5abb74599f1af84a27985cc6034f03854d7df7ddd1a81542eeb16682"} Mar 16 16:07:57 crc kubenswrapper[5120]: I0316 16:07:57.822930 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-wz6tz" event={"ID":"eb1e112a-eec6-4aef-93fb-f809f1c7e6be","Type":"ContainerStarted","Data":"861e027c0e724b4123c3373e5338d7de57fc2bdddef5d2bb8d0ff60fa967d4fa"} Mar 16 16:07:57 crc kubenswrapper[5120]: I0316 16:07:57.830118 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-gqvqz" event={"ID":"745660ab-e0e8-433c-b1ef-405de9b26576","Type":"ContainerStarted","Data":"2965c9721dace934fa470b41bd912c319f55c1b75f8b5390a7b0aadbdf27a9f3"} Mar 16 16:07:57 crc kubenswrapper[5120]: I0316 16:07:57.832006 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-ghc6c" event={"ID":"d247de94-c318-4161-a382-99a79cf7758c","Type":"ContainerStarted","Data":"930906d616c3e368fe99e940b9bb46df4bc2935bcaa185bf48c9102276c8923a"} Mar 16 16:07:57 crc kubenswrapper[5120]: I0316 16:07:57.832031 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-ghc6c" event={"ID":"d247de94-c318-4161-a382-99a79cf7758c","Type":"ContainerStarted","Data":"dda28a28f0fe2bc7b035fb641f7d14cb47d9462ef40e00f06673d04d0f9d6694"} Mar 16 16:07:57 crc kubenswrapper[5120]: I0316 16:07:57.832855 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-db-sync-g56h7" podStartSLOduration=1.832836197 podStartE2EDuration="1.832836197s" podCreationTimestamp="2026-03-16 16:07:56 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:07:57.808191304 +0000 UTC m=+2179.962122961" watchObservedRunningTime="2026-03-16 16:07:57.832836197 +0000 UTC m=+2179.986767854" Mar 16 16:07:57 crc kubenswrapper[5120]: I0316 16:07:57.833316 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"42f516f0-04ae-4acc-83dd-4245872ac0c9","Type":"ContainerStarted","Data":"e3708fe808135cd024acab9cceab38489fdc15b8e2f9c487c33960f4e6a6bf27"} Mar 16 16:07:57 crc kubenswrapper[5120]: I0316 16:07:57.833374 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"42f516f0-04ae-4acc-83dd-4245872ac0c9","Type":"ContainerStarted","Data":"e1017b5ee2c4ffa6fbbe029a9d56dca4e7c992b9218336ff126d9f3f3964e1b0"} Mar 16 16:07:57 crc kubenswrapper[5120]: I0316 16:07:57.843386 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-db-sync-wz6tz" podStartSLOduration=1.843367614 podStartE2EDuration="1.843367614s" podCreationTimestamp="2026-03-16 16:07:56 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:07:57.841949935 +0000 UTC m=+2179.995881592" watchObservedRunningTime="2026-03-16 16:07:57.843367614 +0000 UTC m=+2179.997299271" Mar 16 16:07:57 crc kubenswrapper[5120]: I0316 16:07:57.862947 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-db-sync-ghc6c" podStartSLOduration=1.8629280879999999 podStartE2EDuration="1.862928088s" podCreationTimestamp="2026-03-16 16:07:56 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:07:57.856269587 +0000 UTC m=+2180.010201244" watchObservedRunningTime="2026-03-16 16:07:57.862928088 +0000 UTC m=+2180.016859745" Mar 16 16:07:57 crc kubenswrapper[5120]: I0316 16:07:57.986172 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:07:57 crc kubenswrapper[5120]: W0316 16:07:57.994140 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6563d4eb_7942_48f6_bcad_15604c886133.slice/crio-52a643a3d532b5dfcf80d643c7ffc0ffb0c7e13ca582d3e24c8bdd541f7be6b3 WatchSource:0}: Error finding container 52a643a3d532b5dfcf80d643c7ffc0ffb0c7e13ca582d3e24c8bdd541f7be6b3: Status 404 returned error can't find the container with id 52a643a3d532b5dfcf80d643c7ffc0ffb0c7e13ca582d3e24c8bdd541f7be6b3 Mar 16 16:07:58 crc kubenswrapper[5120]: I0316 16:07:58.187234 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:07:58 crc kubenswrapper[5120]: I0316 16:07:58.278080 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:07:58 crc kubenswrapper[5120]: I0316 16:07:58.290251 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:07:58 crc kubenswrapper[5120]: I0316 16:07:58.521988 5120 scope.go:117] "RemoveContainer" containerID="4be499829974498a3593cb68f355bd6ce58f7cff3d72a82bc9ff36b4e8bf6444" Mar 16 16:07:58 crc kubenswrapper[5120]: I0316 16:07:58.824462 5120 scope.go:117] "RemoveContainer" containerID="e4b657e87642950e7d0629e7df318da4076909475a6699f0084d91ea38aea3f5" Mar 16 16:07:58 crc kubenswrapper[5120]: I0316 16:07:58.859494 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"6563d4eb-7942-48f6-bcad-15604c886133","Type":"ContainerStarted","Data":"52a643a3d532b5dfcf80d643c7ffc0ffb0c7e13ca582d3e24c8bdd541f7be6b3"} Mar 16 16:07:58 crc kubenswrapper[5120]: I0316 16:07:58.874717 5120 scope.go:117] "RemoveContainer" containerID="ca216a86a8eef0b726ed0a1ab53ae38717fb398ddff0b8e08396f18c889c6736" Mar 16 16:07:58 crc kubenswrapper[5120]: I0316 16:07:58.876826 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"42f516f0-04ae-4acc-83dd-4245872ac0c9","Type":"ContainerStarted","Data":"cf4716dd0f71bf27f400a87b06ea844dfe76cfa671c68ed66f46925bdccf99f2"} Mar 16 16:07:58 crc kubenswrapper[5120]: I0316 16:07:58.888313 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"f8d91b46-e486-4be8-ad35-2c9d3d8fb671","Type":"ContainerStarted","Data":"0ae4cb43a9069a8b67de4e4370b2023f710c6a76199b673dc4eb346abd933f00"} Mar 16 16:07:58 crc kubenswrapper[5120]: I0316 16:07:58.937810 5120 scope.go:117] "RemoveContainer" containerID="374687a984677454959d9a99ee25012a0eebddf3bda36b96383e078d8babf88a" Mar 16 16:07:58 crc kubenswrapper[5120]: I0316 16:07:58.981102 5120 scope.go:117] "RemoveContainer" containerID="4382fea5dbe6b85d4dc988022ec8b60e2bcaab495ee9e1477677db109aeebc8a" Mar 16 16:07:59 crc kubenswrapper[5120]: I0316 16:07:59.025439 5120 scope.go:117] "RemoveContainer" containerID="ec574936dd64772983c355077af1e5d59d440ef6beaaa6bcd54ab720321b17d9" Mar 16 16:07:59 crc kubenswrapper[5120]: I0316 16:07:59.049293 5120 scope.go:117] "RemoveContainer" containerID="38f10edbc59577636e63ddd998d2af67bcd6eec978d300e177c41f50ecfff93c" Mar 16 16:07:59 crc kubenswrapper[5120]: I0316 16:07:59.160503 5120 scope.go:117] "RemoveContainer" containerID="69e8b5c1a82de42011f2d24bc136981987055996eed6ad28b0095859c38c297c" Mar 16 16:07:59 crc kubenswrapper[5120]: I0316 16:07:59.291933 5120 scope.go:117] "RemoveContainer" containerID="10baea670a97077476383cd124db93cfdc5f80794052434fdcc277de47cd3b97" Mar 16 16:07:59 crc kubenswrapper[5120]: I0316 16:07:59.362695 5120 scope.go:117] "RemoveContainer" containerID="74121ce6a7efc39e5beb3f3cec5a3d5d6cb0386878d19b45d751d804a50ae1c2" Mar 16 16:07:59 crc kubenswrapper[5120]: I0316 16:07:59.416467 5120 scope.go:117] "RemoveContainer" containerID="99e3ec545996bb94f68d714fc428ffb531b50020d515a649c749101075591fad" Mar 16 16:07:59 crc kubenswrapper[5120]: I0316 16:07:59.492586 5120 scope.go:117] "RemoveContainer" containerID="848ee717d057a223c0dd69521fd03ec0d5b6a1e844b8b8426ade07bb51602f5f" Mar 16 16:07:59 crc kubenswrapper[5120]: I0316 16:07:59.530693 5120 scope.go:117] "RemoveContainer" containerID="16bde90c3e45e8d6500e401af0a24d833ac7893e1b965074bc2ae3914db36645" Mar 16 16:07:59 crc kubenswrapper[5120]: I0316 16:07:59.555756 5120 scope.go:117] "RemoveContainer" containerID="83d52eae0e241c4594c601b1ef1e637a0cae05c8be254ed7c8590df70de76616" Mar 16 16:07:59 crc kubenswrapper[5120]: I0316 16:07:59.688924 5120 scope.go:117] "RemoveContainer" containerID="f36a1e34c2933a69a17e6610a2776c77bda37cc9b6f76e51ea55b6db39f66f7a" Mar 16 16:07:59 crc kubenswrapper[5120]: I0316 16:07:59.736269 5120 scope.go:117] "RemoveContainer" containerID="1268c5acd57c4e702314b2f2fd4d0dafc97e71135f5bbc840bd3532131c04a0a" Mar 16 16:07:59 crc kubenswrapper[5120]: I0316 16:07:59.827356 5120 scope.go:117] "RemoveContainer" containerID="786c94e304b470f789693f51f55f154d8a32456e15f398d7e70a8d0aa150ce38" Mar 16 16:07:59 crc kubenswrapper[5120]: I0316 16:07:59.907017 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-gqvqz" event={"ID":"745660ab-e0e8-433c-b1ef-405de9b26576","Type":"ContainerStarted","Data":"5c6d2c7450b267f4c1acfc758171fbdd29e7a3edeababbab4b687a32ec128193"} Mar 16 16:07:59 crc kubenswrapper[5120]: I0316 16:07:59.912299 5120 scope.go:117] "RemoveContainer" containerID="33f96d08c13b95912b968beea058dc4aa708af2cce8d5ddb775b2dd276281ca7" Mar 16 16:07:59 crc kubenswrapper[5120]: I0316 16:07:59.917473 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"6563d4eb-7942-48f6-bcad-15604c886133","Type":"ContainerStarted","Data":"dca0888e9bc666d4bd37dc2b29a8c8d115ded7f56a8ae489c6b87ef1bf0cc107"} Mar 16 16:07:59 crc kubenswrapper[5120]: I0316 16:07:59.937862 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-db-sync-gqvqz" podStartSLOduration=3.9378438129999997 podStartE2EDuration="3.937843813s" podCreationTimestamp="2026-03-16 16:07:56 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:07:59.928111537 +0000 UTC m=+2182.082043194" watchObservedRunningTime="2026-03-16 16:07:59.937843813 +0000 UTC m=+2182.091775470" Mar 16 16:07:59 crc kubenswrapper[5120]: I0316 16:07:59.975325 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"f8d91b46-e486-4be8-ad35-2c9d3d8fb671","Type":"ContainerStarted","Data":"4f7ad952d3db167aecbb26d3cb6cbc860193fe6eeee89f9fd4ce093e5292f05c"} Mar 16 16:08:00 crc kubenswrapper[5120]: I0316 16:08:00.102171 5120 scope.go:117] "RemoveContainer" containerID="b596a836467f9f921d44bf550a977ae900b2598b5af55895745f8cea3e68edd6" Mar 16 16:08:00 crc kubenswrapper[5120]: I0316 16:08:00.141703 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-infra/auto-csr-approver-29561288-b6gpk"] Mar 16 16:08:00 crc kubenswrapper[5120]: I0316 16:08:00.147734 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561288-b6gpk" Mar 16 16:08:00 crc kubenswrapper[5120]: I0316 16:08:00.151277 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-infra\"/\"csr-approver-sa-dockercfg-x2nsz\"" Mar 16 16:08:00 crc kubenswrapper[5120]: I0316 16:08:00.151532 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"openshift-service-ca.crt\"" Mar 16 16:08:00 crc kubenswrapper[5120]: I0316 16:08:00.151682 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"kube-root-ca.crt\"" Mar 16 16:08:00 crc kubenswrapper[5120]: I0316 16:08:00.155339 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561288-b6gpk"] Mar 16 16:08:00 crc kubenswrapper[5120]: I0316 16:08:00.181819 5120 scope.go:117] "RemoveContainer" containerID="071d93a4083043fa8df551c6e89a4bd717d8d4b20b8c899f3e888f1fffe234d0" Mar 16 16:08:00 crc kubenswrapper[5120]: I0316 16:08:00.231375 5120 scope.go:117] "RemoveContainer" containerID="7ffd77e31eea93d1e7ace0a0cdb54f98533fbfa2077af168290652e54a75978c" Mar 16 16:08:00 crc kubenswrapper[5120]: I0316 16:08:00.267908 5120 scope.go:117] "RemoveContainer" containerID="d87b91b98b90b71a6d1afb6d3e439a81b8646bc3845168578f549adecd3d4799" Mar 16 16:08:00 crc kubenswrapper[5120]: I0316 16:08:00.290184 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7vqd\" (UniqueName: \"kubernetes.io/projected/b4e69343-fd94-436a-b5ab-dcc02f48c06b-kube-api-access-t7vqd\") pod \"auto-csr-approver-29561288-b6gpk\" (UID: \"b4e69343-fd94-436a-b5ab-dcc02f48c06b\") " pod="openshift-infra/auto-csr-approver-29561288-b6gpk" Mar 16 16:08:00 crc kubenswrapper[5120]: I0316 16:08:00.362591 5120 scope.go:117] "RemoveContainer" containerID="ed742a5e26665a3d71316c608103962365a9a35c0a127813e4c4f824e7da4849" Mar 16 16:08:00 crc kubenswrapper[5120]: I0316 16:08:00.392462 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t7vqd\" (UniqueName: \"kubernetes.io/projected/b4e69343-fd94-436a-b5ab-dcc02f48c06b-kube-api-access-t7vqd\") pod \"auto-csr-approver-29561288-b6gpk\" (UID: \"b4e69343-fd94-436a-b5ab-dcc02f48c06b\") " pod="openshift-infra/auto-csr-approver-29561288-b6gpk" Mar 16 16:08:00 crc kubenswrapper[5120]: I0316 16:08:00.412126 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7vqd\" (UniqueName: \"kubernetes.io/projected/b4e69343-fd94-436a-b5ab-dcc02f48c06b-kube-api-access-t7vqd\") pod \"auto-csr-approver-29561288-b6gpk\" (UID: \"b4e69343-fd94-436a-b5ab-dcc02f48c06b\") " pod="openshift-infra/auto-csr-approver-29561288-b6gpk" Mar 16 16:08:00 crc kubenswrapper[5120]: E0316 16:08:00.447475 5120 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd247de94_c318_4161_a382_99a79cf7758c.slice/crio-930906d616c3e368fe99e940b9bb46df4bc2935bcaa185bf48c9102276c8923a.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd247de94_c318_4161_a382_99a79cf7758c.slice/crio-conmon-930906d616c3e368fe99e940b9bb46df4bc2935bcaa185bf48c9102276c8923a.scope\": RecentStats: unable to find data in memory cache]" Mar 16 16:08:00 crc kubenswrapper[5120]: I0316 16:08:00.505102 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561288-b6gpk" Mar 16 16:08:00 crc kubenswrapper[5120]: I0316 16:08:00.967751 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561288-b6gpk"] Mar 16 16:08:01 crc kubenswrapper[5120]: I0316 16:08:01.059224 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="f8d91b46-e486-4be8-ad35-2c9d3d8fb671" containerName="glance-log" containerID="cri-o://4f7ad952d3db167aecbb26d3cb6cbc860193fe6eeee89f9fd4ce093e5292f05c" gracePeriod=30 Mar 16 16:08:01 crc kubenswrapper[5120]: I0316 16:08:01.059576 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"f8d91b46-e486-4be8-ad35-2c9d3d8fb671","Type":"ContainerStarted","Data":"f60ede070c7e409af540d4925ecc5f9f61f604a860dd2517953dd7babeffcfa8"} Mar 16 16:08:01 crc kubenswrapper[5120]: I0316 16:08:01.059955 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="f8d91b46-e486-4be8-ad35-2c9d3d8fb671" containerName="glance-httpd" containerID="cri-o://f60ede070c7e409af540d4925ecc5f9f61f604a860dd2517953dd7babeffcfa8" gracePeriod=30 Mar 16 16:08:01 crc kubenswrapper[5120]: I0316 16:08:01.072201 5120 generic.go:358] "Generic (PLEG): container finished" podID="0008a48f-3c91-43dc-be3f-6ba3697e01dc" containerID="1797654748c2f46782a5a7d0be292f62299666e2cbead383368cb1f914247684" exitCode=0 Mar 16 16:08:01 crc kubenswrapper[5120]: I0316 16:08:01.072305 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-g56h7" event={"ID":"0008a48f-3c91-43dc-be3f-6ba3697e01dc","Type":"ContainerDied","Data":"1797654748c2f46782a5a7d0be292f62299666e2cbead383368cb1f914247684"} Mar 16 16:08:01 crc kubenswrapper[5120]: I0316 16:08:01.098155 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-internal-api-0" podStartSLOduration=6.098133992 podStartE2EDuration="6.098133992s" podCreationTimestamp="2026-03-16 16:07:55 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:08:01.090905745 +0000 UTC m=+2183.244837402" watchObservedRunningTime="2026-03-16 16:08:01.098133992 +0000 UTC m=+2183.252065649" Mar 16 16:08:01 crc kubenswrapper[5120]: I0316 16:08:01.134944 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"6563d4eb-7942-48f6-bcad-15604c886133","Type":"ContainerStarted","Data":"8551571f71a70398433dff49b8883ddccfb14b4f9053c7e561442aca055e3bda"} Mar 16 16:08:01 crc kubenswrapper[5120]: I0316 16:08:01.135326 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="6563d4eb-7942-48f6-bcad-15604c886133" containerName="glance-log" containerID="cri-o://dca0888e9bc666d4bd37dc2b29a8c8d115ded7f56a8ae489c6b87ef1bf0cc107" gracePeriod=30 Mar 16 16:08:01 crc kubenswrapper[5120]: I0316 16:08:01.135904 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="6563d4eb-7942-48f6-bcad-15604c886133" containerName="glance-httpd" containerID="cri-o://8551571f71a70398433dff49b8883ddccfb14b4f9053c7e561442aca055e3bda" gracePeriod=30 Mar 16 16:08:01 crc kubenswrapper[5120]: I0316 16:08:01.140695 5120 generic.go:358] "Generic (PLEG): container finished" podID="d247de94-c318-4161-a382-99a79cf7758c" containerID="930906d616c3e368fe99e940b9bb46df4bc2935bcaa185bf48c9102276c8923a" exitCode=0 Mar 16 16:08:01 crc kubenswrapper[5120]: I0316 16:08:01.140833 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-ghc6c" event={"ID":"d247de94-c318-4161-a382-99a79cf7758c","Type":"ContainerDied","Data":"930906d616c3e368fe99e940b9bb46df4bc2935bcaa185bf48c9102276c8923a"} Mar 16 16:08:01 crc kubenswrapper[5120]: I0316 16:08:01.142521 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"42f516f0-04ae-4acc-83dd-4245872ac0c9","Type":"ContainerStarted","Data":"eaf3a26e2353b85e4d76484c2dc9e0b3839d41444994942c2fd11311fe70f9b4"} Mar 16 16:08:01 crc kubenswrapper[5120]: I0316 16:08:01.143806 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561288-b6gpk" event={"ID":"b4e69343-fd94-436a-b5ab-dcc02f48c06b","Type":"ContainerStarted","Data":"be4ee7721f7d71baff5d5dc7f5961973d46f5690edc3aee2bb4142c9dbf4f9d1"} Mar 16 16:08:01 crc kubenswrapper[5120]: I0316 16:08:01.211079 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-external-api-0" podStartSLOduration=5.211054484 podStartE2EDuration="5.211054484s" podCreationTimestamp="2026-03-16 16:07:56 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:08:01.168076251 +0000 UTC m=+2183.322007898" watchObservedRunningTime="2026-03-16 16:08:01.211054484 +0000 UTC m=+2183.364986131" Mar 16 16:08:01 crc kubenswrapper[5120]: I0316 16:08:01.963352 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.042602 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6563d4eb-7942-48f6-bcad-15604c886133-public-tls-certs\") pod \"6563d4eb-7942-48f6-bcad-15604c886133\" (UID: \"6563d4eb-7942-48f6-bcad-15604c886133\") " Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.042687 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6563d4eb-7942-48f6-bcad-15604c886133-combined-ca-bundle\") pod \"6563d4eb-7942-48f6-bcad-15604c886133\" (UID: \"6563d4eb-7942-48f6-bcad-15604c886133\") " Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.042749 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage15-crc\") pod \"6563d4eb-7942-48f6-bcad-15604c886133\" (UID: \"6563d4eb-7942-48f6-bcad-15604c886133\") " Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.042906 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6563d4eb-7942-48f6-bcad-15604c886133-config-data\") pod \"6563d4eb-7942-48f6-bcad-15604c886133\" (UID: \"6563d4eb-7942-48f6-bcad-15604c886133\") " Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.042933 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6563d4eb-7942-48f6-bcad-15604c886133-logs\") pod \"6563d4eb-7942-48f6-bcad-15604c886133\" (UID: \"6563d4eb-7942-48f6-bcad-15604c886133\") " Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.043109 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kkxts\" (UniqueName: \"kubernetes.io/projected/6563d4eb-7942-48f6-bcad-15604c886133-kube-api-access-kkxts\") pod \"6563d4eb-7942-48f6-bcad-15604c886133\" (UID: \"6563d4eb-7942-48f6-bcad-15604c886133\") " Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.043171 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/6563d4eb-7942-48f6-bcad-15604c886133-httpd-run\") pod \"6563d4eb-7942-48f6-bcad-15604c886133\" (UID: \"6563d4eb-7942-48f6-bcad-15604c886133\") " Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.043200 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6563d4eb-7942-48f6-bcad-15604c886133-scripts\") pod \"6563d4eb-7942-48f6-bcad-15604c886133\" (UID: \"6563d4eb-7942-48f6-bcad-15604c886133\") " Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.044010 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6563d4eb-7942-48f6-bcad-15604c886133-logs" (OuterVolumeSpecName: "logs") pod "6563d4eb-7942-48f6-bcad-15604c886133" (UID: "6563d4eb-7942-48f6-bcad-15604c886133"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.044171 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6563d4eb-7942-48f6-bcad-15604c886133-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "6563d4eb-7942-48f6-bcad-15604c886133" (UID: "6563d4eb-7942-48f6-bcad-15604c886133"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.052270 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6563d4eb-7942-48f6-bcad-15604c886133-kube-api-access-kkxts" (OuterVolumeSpecName: "kube-api-access-kkxts") pod "6563d4eb-7942-48f6-bcad-15604c886133" (UID: "6563d4eb-7942-48f6-bcad-15604c886133"). InnerVolumeSpecName "kube-api-access-kkxts". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.055151 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6563d4eb-7942-48f6-bcad-15604c886133-scripts" (OuterVolumeSpecName: "scripts") pod "6563d4eb-7942-48f6-bcad-15604c886133" (UID: "6563d4eb-7942-48f6-bcad-15604c886133"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.059928 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage15-crc" (OuterVolumeSpecName: "glance") pod "6563d4eb-7942-48f6-bcad-15604c886133" (UID: "6563d4eb-7942-48f6-bcad-15604c886133"). InnerVolumeSpecName "local-storage15-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.089391 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6563d4eb-7942-48f6-bcad-15604c886133-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "6563d4eb-7942-48f6-bcad-15604c886133" (UID: "6563d4eb-7942-48f6-bcad-15604c886133"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.104912 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6563d4eb-7942-48f6-bcad-15604c886133-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "6563d4eb-7942-48f6-bcad-15604c886133" (UID: "6563d4eb-7942-48f6-bcad-15604c886133"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.128095 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6563d4eb-7942-48f6-bcad-15604c886133-config-data" (OuterVolumeSpecName: "config-data") pod "6563d4eb-7942-48f6-bcad-15604c886133" (UID: "6563d4eb-7942-48f6-bcad-15604c886133"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.148080 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kkxts\" (UniqueName: \"kubernetes.io/projected/6563d4eb-7942-48f6-bcad-15604c886133-kube-api-access-kkxts\") on node \"crc\" DevicePath \"\"" Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.148114 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/6563d4eb-7942-48f6-bcad-15604c886133-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.148122 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6563d4eb-7942-48f6-bcad-15604c886133-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.148132 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6563d4eb-7942-48f6-bcad-15604c886133-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.148141 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6563d4eb-7942-48f6-bcad-15604c886133-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.148182 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage15-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage15-crc\") on node \"crc\" " Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.148190 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6563d4eb-7942-48f6-bcad-15604c886133-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.148198 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6563d4eb-7942-48f6-bcad-15604c886133-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.158836 5120 generic.go:358] "Generic (PLEG): container finished" podID="6563d4eb-7942-48f6-bcad-15604c886133" containerID="8551571f71a70398433dff49b8883ddccfb14b4f9053c7e561442aca055e3bda" exitCode=0 Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.158865 5120 generic.go:358] "Generic (PLEG): container finished" podID="6563d4eb-7942-48f6-bcad-15604c886133" containerID="dca0888e9bc666d4bd37dc2b29a8c8d115ded7f56a8ae489c6b87ef1bf0cc107" exitCode=143 Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.159009 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"6563d4eb-7942-48f6-bcad-15604c886133","Type":"ContainerDied","Data":"8551571f71a70398433dff49b8883ddccfb14b4f9053c7e561442aca055e3bda"} Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.159037 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"6563d4eb-7942-48f6-bcad-15604c886133","Type":"ContainerDied","Data":"dca0888e9bc666d4bd37dc2b29a8c8d115ded7f56a8ae489c6b87ef1bf0cc107"} Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.159048 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"6563d4eb-7942-48f6-bcad-15604c886133","Type":"ContainerDied","Data":"52a643a3d532b5dfcf80d643c7ffc0ffb0c7e13ca582d3e24c8bdd541f7be6b3"} Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.159062 5120 scope.go:117] "RemoveContainer" containerID="8551571f71a70398433dff49b8883ddccfb14b4f9053c7e561442aca055e3bda" Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.159195 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.166225 5120 generic.go:358] "Generic (PLEG): container finished" podID="f8d91b46-e486-4be8-ad35-2c9d3d8fb671" containerID="f60ede070c7e409af540d4925ecc5f9f61f604a860dd2517953dd7babeffcfa8" exitCode=0 Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.166253 5120 generic.go:358] "Generic (PLEG): container finished" podID="f8d91b46-e486-4be8-ad35-2c9d3d8fb671" containerID="4f7ad952d3db167aecbb26d3cb6cbc860193fe6eeee89f9fd4ce093e5292f05c" exitCode=143 Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.166314 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"f8d91b46-e486-4be8-ad35-2c9d3d8fb671","Type":"ContainerDied","Data":"f60ede070c7e409af540d4925ecc5f9f61f604a860dd2517953dd7babeffcfa8"} Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.166363 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"f8d91b46-e486-4be8-ad35-2c9d3d8fb671","Type":"ContainerDied","Data":"4f7ad952d3db167aecbb26d3cb6cbc860193fe6eeee89f9fd4ce093e5292f05c"} Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.168897 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage15-crc" (UniqueName: "kubernetes.io/local-volume/local-storage15-crc") on node "crc" Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.171090 5120 generic.go:358] "Generic (PLEG): container finished" podID="ff364e62-5da8-4005-89e0-48e3dbfa5222" containerID="cfe157cc8dcdbc92540f19f958bb6b85a3026d72bae9fd54deb5f193d808da86" exitCode=0 Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.171374 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-8lrsq" event={"ID":"ff364e62-5da8-4005-89e0-48e3dbfa5222","Type":"ContainerDied","Data":"cfe157cc8dcdbc92540f19f958bb6b85a3026d72bae9fd54deb5f193d808da86"} Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.250158 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage15-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage15-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.321531 5120 scope.go:117] "RemoveContainer" containerID="dca0888e9bc666d4bd37dc2b29a8c8d115ded7f56a8ae489c6b87ef1bf0cc107" Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.350239 5120 scope.go:117] "RemoveContainer" containerID="8551571f71a70398433dff49b8883ddccfb14b4f9053c7e561442aca055e3bda" Mar 16 16:08:02 crc kubenswrapper[5120]: E0316 16:08:02.350679 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8551571f71a70398433dff49b8883ddccfb14b4f9053c7e561442aca055e3bda\": container with ID starting with 8551571f71a70398433dff49b8883ddccfb14b4f9053c7e561442aca055e3bda not found: ID does not exist" containerID="8551571f71a70398433dff49b8883ddccfb14b4f9053c7e561442aca055e3bda" Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.350709 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8551571f71a70398433dff49b8883ddccfb14b4f9053c7e561442aca055e3bda"} err="failed to get container status \"8551571f71a70398433dff49b8883ddccfb14b4f9053c7e561442aca055e3bda\": rpc error: code = NotFound desc = could not find container \"8551571f71a70398433dff49b8883ddccfb14b4f9053c7e561442aca055e3bda\": container with ID starting with 8551571f71a70398433dff49b8883ddccfb14b4f9053c7e561442aca055e3bda not found: ID does not exist" Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.350728 5120 scope.go:117] "RemoveContainer" containerID="dca0888e9bc666d4bd37dc2b29a8c8d115ded7f56a8ae489c6b87ef1bf0cc107" Mar 16 16:08:02 crc kubenswrapper[5120]: E0316 16:08:02.351107 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dca0888e9bc666d4bd37dc2b29a8c8d115ded7f56a8ae489c6b87ef1bf0cc107\": container with ID starting with dca0888e9bc666d4bd37dc2b29a8c8d115ded7f56a8ae489c6b87ef1bf0cc107 not found: ID does not exist" containerID="dca0888e9bc666d4bd37dc2b29a8c8d115ded7f56a8ae489c6b87ef1bf0cc107" Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.351150 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dca0888e9bc666d4bd37dc2b29a8c8d115ded7f56a8ae489c6b87ef1bf0cc107"} err="failed to get container status \"dca0888e9bc666d4bd37dc2b29a8c8d115ded7f56a8ae489c6b87ef1bf0cc107\": rpc error: code = NotFound desc = could not find container \"dca0888e9bc666d4bd37dc2b29a8c8d115ded7f56a8ae489c6b87ef1bf0cc107\": container with ID starting with dca0888e9bc666d4bd37dc2b29a8c8d115ded7f56a8ae489c6b87ef1bf0cc107 not found: ID does not exist" Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.351180 5120 scope.go:117] "RemoveContainer" containerID="8551571f71a70398433dff49b8883ddccfb14b4f9053c7e561442aca055e3bda" Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.352004 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8551571f71a70398433dff49b8883ddccfb14b4f9053c7e561442aca055e3bda"} err="failed to get container status \"8551571f71a70398433dff49b8883ddccfb14b4f9053c7e561442aca055e3bda\": rpc error: code = NotFound desc = could not find container \"8551571f71a70398433dff49b8883ddccfb14b4f9053c7e561442aca055e3bda\": container with ID starting with 8551571f71a70398433dff49b8883ddccfb14b4f9053c7e561442aca055e3bda not found: ID does not exist" Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.352056 5120 scope.go:117] "RemoveContainer" containerID="dca0888e9bc666d4bd37dc2b29a8c8d115ded7f56a8ae489c6b87ef1bf0cc107" Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.352444 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dca0888e9bc666d4bd37dc2b29a8c8d115ded7f56a8ae489c6b87ef1bf0cc107"} err="failed to get container status \"dca0888e9bc666d4bd37dc2b29a8c8d115ded7f56a8ae489c6b87ef1bf0cc107\": rpc error: code = NotFound desc = could not find container \"dca0888e9bc666d4bd37dc2b29a8c8d115ded7f56a8ae489c6b87ef1bf0cc107\": container with ID starting with dca0888e9bc666d4bd37dc2b29a8c8d115ded7f56a8ae489c6b87ef1bf0cc107 not found: ID does not exist" Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.414043 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.453692 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5jgh5\" (UniqueName: \"kubernetes.io/projected/f8d91b46-e486-4be8-ad35-2c9d3d8fb671-kube-api-access-5jgh5\") pod \"f8d91b46-e486-4be8-ad35-2c9d3d8fb671\" (UID: \"f8d91b46-e486-4be8-ad35-2c9d3d8fb671\") " Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.453813 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f8d91b46-e486-4be8-ad35-2c9d3d8fb671-logs\") pod \"f8d91b46-e486-4be8-ad35-2c9d3d8fb671\" (UID: \"f8d91b46-e486-4be8-ad35-2c9d3d8fb671\") " Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.454029 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f8d91b46-e486-4be8-ad35-2c9d3d8fb671-combined-ca-bundle\") pod \"f8d91b46-e486-4be8-ad35-2c9d3d8fb671\" (UID: \"f8d91b46-e486-4be8-ad35-2c9d3d8fb671\") " Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.454057 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/f8d91b46-e486-4be8-ad35-2c9d3d8fb671-httpd-run\") pod \"f8d91b46-e486-4be8-ad35-2c9d3d8fb671\" (UID: \"f8d91b46-e486-4be8-ad35-2c9d3d8fb671\") " Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.454070 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f8d91b46-e486-4be8-ad35-2c9d3d8fb671-scripts\") pod \"f8d91b46-e486-4be8-ad35-2c9d3d8fb671\" (UID: \"f8d91b46-e486-4be8-ad35-2c9d3d8fb671\") " Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.454127 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") pod \"f8d91b46-e486-4be8-ad35-2c9d3d8fb671\" (UID: \"f8d91b46-e486-4be8-ad35-2c9d3d8fb671\") " Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.454280 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f8d91b46-e486-4be8-ad35-2c9d3d8fb671-config-data\") pod \"f8d91b46-e486-4be8-ad35-2c9d3d8fb671\" (UID: \"f8d91b46-e486-4be8-ad35-2c9d3d8fb671\") " Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.454300 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f8d91b46-e486-4be8-ad35-2c9d3d8fb671-internal-tls-certs\") pod \"f8d91b46-e486-4be8-ad35-2c9d3d8fb671\" (UID: \"f8d91b46-e486-4be8-ad35-2c9d3d8fb671\") " Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.459843 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8d91b46-e486-4be8-ad35-2c9d3d8fb671-logs" (OuterVolumeSpecName: "logs") pod "f8d91b46-e486-4be8-ad35-2c9d3d8fb671" (UID: "f8d91b46-e486-4be8-ad35-2c9d3d8fb671"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.461315 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8d91b46-e486-4be8-ad35-2c9d3d8fb671-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "f8d91b46-e486-4be8-ad35-2c9d3d8fb671" (UID: "f8d91b46-e486-4be8-ad35-2c9d3d8fb671"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.473803 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f8d91b46-e486-4be8-ad35-2c9d3d8fb671-scripts" (OuterVolumeSpecName: "scripts") pod "f8d91b46-e486-4be8-ad35-2c9d3d8fb671" (UID: "f8d91b46-e486-4be8-ad35-2c9d3d8fb671"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.503752 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage14-crc" (OuterVolumeSpecName: "glance") pod "f8d91b46-e486-4be8-ad35-2c9d3d8fb671" (UID: "f8d91b46-e486-4be8-ad35-2c9d3d8fb671"). InnerVolumeSpecName "local-storage14-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.506396 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8d91b46-e486-4be8-ad35-2c9d3d8fb671-kube-api-access-5jgh5" (OuterVolumeSpecName: "kube-api-access-5jgh5") pod "f8d91b46-e486-4be8-ad35-2c9d3d8fb671" (UID: "f8d91b46-e486-4be8-ad35-2c9d3d8fb671"). InnerVolumeSpecName "kube-api-access-5jgh5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.512005 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.532394 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.537891 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.540616 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6563d4eb-7942-48f6-bcad-15604c886133" containerName="glance-log" Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.540665 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="6563d4eb-7942-48f6-bcad-15604c886133" containerName="glance-log" Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.540715 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8d91b46-e486-4be8-ad35-2c9d3d8fb671" containerName="glance-httpd" Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.540741 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8d91b46-e486-4be8-ad35-2c9d3d8fb671" containerName="glance-httpd" Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.540825 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6563d4eb-7942-48f6-bcad-15604c886133" containerName="glance-httpd" Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.540837 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="6563d4eb-7942-48f6-bcad-15604c886133" containerName="glance-httpd" Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.540856 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8d91b46-e486-4be8-ad35-2c9d3d8fb671" containerName="glance-log" Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.540865 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8d91b46-e486-4be8-ad35-2c9d3d8fb671" containerName="glance-log" Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.541099 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f8d91b46-e486-4be8-ad35-2c9d3d8fb671" containerName="glance-log" Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.541130 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="6563d4eb-7942-48f6-bcad-15604c886133" containerName="glance-log" Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.541142 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f8d91b46-e486-4be8-ad35-2c9d3d8fb671" containerName="glance-httpd" Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.541149 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="6563d4eb-7942-48f6-bcad-15604c886133" containerName="glance-httpd" Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.548346 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.553168 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-external-config-data\"" Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.553360 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-public-svc\"" Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.556287 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/f8d91b46-e486-4be8-ad35-2c9d3d8fb671-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.556319 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f8d91b46-e486-4be8-ad35-2c9d3d8fb671-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.556346 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") on node \"crc\" " Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.556359 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5jgh5\" (UniqueName: \"kubernetes.io/projected/f8d91b46-e486-4be8-ad35-2c9d3d8fb671-kube-api-access-5jgh5\") on node \"crc\" DevicePath \"\"" Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.556375 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f8d91b46-e486-4be8-ad35-2c9d3d8fb671-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.584561 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.621539 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage14-crc" (UniqueName: "kubernetes.io/local-volume/local-storage14-crc") on node "crc" Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.659015 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage15-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage15-crc\") pod \"glance-default-external-api-0\" (UID: \"7e0d7a3d-971e-438a-b4de-702b49c20f0d\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.659367 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7e0d7a3d-971e-438a-b4de-702b49c20f0d-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"7e0d7a3d-971e-438a-b4de-702b49c20f0d\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.659396 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/7e0d7a3d-971e-438a-b4de-702b49c20f0d-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"7e0d7a3d-971e-438a-b4de-702b49c20f0d\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.659471 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/7e0d7a3d-971e-438a-b4de-702b49c20f0d-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"7e0d7a3d-971e-438a-b4de-702b49c20f0d\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.659534 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2z5jp\" (UniqueName: \"kubernetes.io/projected/7e0d7a3d-971e-438a-b4de-702b49c20f0d-kube-api-access-2z5jp\") pod \"glance-default-external-api-0\" (UID: \"7e0d7a3d-971e-438a-b4de-702b49c20f0d\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.659628 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7e0d7a3d-971e-438a-b4de-702b49c20f0d-config-data\") pod \"glance-default-external-api-0\" (UID: \"7e0d7a3d-971e-438a-b4de-702b49c20f0d\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.659665 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7e0d7a3d-971e-438a-b4de-702b49c20f0d-logs\") pod \"glance-default-external-api-0\" (UID: \"7e0d7a3d-971e-438a-b4de-702b49c20f0d\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.659684 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7e0d7a3d-971e-438a-b4de-702b49c20f0d-scripts\") pod \"glance-default-external-api-0\" (UID: \"7e0d7a3d-971e-438a-b4de-702b49c20f0d\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.659740 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.681526 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6563d4eb-7942-48f6-bcad-15604c886133" path="/var/lib/kubelet/pods/6563d4eb-7942-48f6-bcad-15604c886133/volumes" Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.697348 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f8d91b46-e486-4be8-ad35-2c9d3d8fb671-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f8d91b46-e486-4be8-ad35-2c9d3d8fb671" (UID: "f8d91b46-e486-4be8-ad35-2c9d3d8fb671"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.701653 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-ghc6c" Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.726662 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-g56h7" Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.737991 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f8d91b46-e486-4be8-ad35-2c9d3d8fb671-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "f8d91b46-e486-4be8-ad35-2c9d3d8fb671" (UID: "f8d91b46-e486-4be8-ad35-2c9d3d8fb671"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.760743 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d247de94-c318-4161-a382-99a79cf7758c-scripts\") pod \"d247de94-c318-4161-a382-99a79cf7758c\" (UID: \"d247de94-c318-4161-a382-99a79cf7758c\") " Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.760883 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/0008a48f-3c91-43dc-be3f-6ba3697e01dc-db-sync-config-data\") pod \"0008a48f-3c91-43dc-be3f-6ba3697e01dc\" (UID: \"0008a48f-3c91-43dc-be3f-6ba3697e01dc\") " Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.760991 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d247de94-c318-4161-a382-99a79cf7758c-combined-ca-bundle\") pod \"d247de94-c318-4161-a382-99a79cf7758c\" (UID: \"d247de94-c318-4161-a382-99a79cf7758c\") " Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.761087 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d247de94-c318-4161-a382-99a79cf7758c-logs\") pod \"d247de94-c318-4161-a382-99a79cf7758c\" (UID: \"d247de94-c318-4161-a382-99a79cf7758c\") " Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.761183 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d247de94-c318-4161-a382-99a79cf7758c-config-data\") pod \"d247de94-c318-4161-a382-99a79cf7758c\" (UID: \"d247de94-c318-4161-a382-99a79cf7758c\") " Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.761270 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4mgxr\" (UniqueName: \"kubernetes.io/projected/0008a48f-3c91-43dc-be3f-6ba3697e01dc-kube-api-access-4mgxr\") pod \"0008a48f-3c91-43dc-be3f-6ba3697e01dc\" (UID: \"0008a48f-3c91-43dc-be3f-6ba3697e01dc\") " Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.761300 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0008a48f-3c91-43dc-be3f-6ba3697e01dc-combined-ca-bundle\") pod \"0008a48f-3c91-43dc-be3f-6ba3697e01dc\" (UID: \"0008a48f-3c91-43dc-be3f-6ba3697e01dc\") " Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.761374 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-22mrc\" (UniqueName: \"kubernetes.io/projected/d247de94-c318-4161-a382-99a79cf7758c-kube-api-access-22mrc\") pod \"d247de94-c318-4161-a382-99a79cf7758c\" (UID: \"d247de94-c318-4161-a382-99a79cf7758c\") " Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.761518 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage15-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage15-crc\") pod \"glance-default-external-api-0\" (UID: \"7e0d7a3d-971e-438a-b4de-702b49c20f0d\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.761558 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7e0d7a3d-971e-438a-b4de-702b49c20f0d-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"7e0d7a3d-971e-438a-b4de-702b49c20f0d\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.761595 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/7e0d7a3d-971e-438a-b4de-702b49c20f0d-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"7e0d7a3d-971e-438a-b4de-702b49c20f0d\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.761694 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/7e0d7a3d-971e-438a-b4de-702b49c20f0d-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"7e0d7a3d-971e-438a-b4de-702b49c20f0d\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.761833 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2z5jp\" (UniqueName: \"kubernetes.io/projected/7e0d7a3d-971e-438a-b4de-702b49c20f0d-kube-api-access-2z5jp\") pod \"glance-default-external-api-0\" (UID: \"7e0d7a3d-971e-438a-b4de-702b49c20f0d\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.761947 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7e0d7a3d-971e-438a-b4de-702b49c20f0d-config-data\") pod \"glance-default-external-api-0\" (UID: \"7e0d7a3d-971e-438a-b4de-702b49c20f0d\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.761985 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7e0d7a3d-971e-438a-b4de-702b49c20f0d-logs\") pod \"glance-default-external-api-0\" (UID: \"7e0d7a3d-971e-438a-b4de-702b49c20f0d\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.762009 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7e0d7a3d-971e-438a-b4de-702b49c20f0d-scripts\") pod \"glance-default-external-api-0\" (UID: \"7e0d7a3d-971e-438a-b4de-702b49c20f0d\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.762205 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f8d91b46-e486-4be8-ad35-2c9d3d8fb671-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.762226 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f8d91b46-e486-4be8-ad35-2c9d3d8fb671-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.763868 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f8d91b46-e486-4be8-ad35-2c9d3d8fb671-config-data" (OuterVolumeSpecName: "config-data") pod "f8d91b46-e486-4be8-ad35-2c9d3d8fb671" (UID: "f8d91b46-e486-4be8-ad35-2c9d3d8fb671"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.764445 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0008a48f-3c91-43dc-be3f-6ba3697e01dc-db-sync-config-data" (OuterVolumeSpecName: "db-sync-config-data") pod "0008a48f-3c91-43dc-be3f-6ba3697e01dc" (UID: "0008a48f-3c91-43dc-be3f-6ba3697e01dc"). InnerVolumeSpecName "db-sync-config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.764452 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/7e0d7a3d-971e-438a-b4de-702b49c20f0d-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"7e0d7a3d-971e-438a-b4de-702b49c20f0d\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.764660 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7e0d7a3d-971e-438a-b4de-702b49c20f0d-logs\") pod \"glance-default-external-api-0\" (UID: \"7e0d7a3d-971e-438a-b4de-702b49c20f0d\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.764696 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d247de94-c318-4161-a382-99a79cf7758c-logs" (OuterVolumeSpecName: "logs") pod "d247de94-c318-4161-a382-99a79cf7758c" (UID: "d247de94-c318-4161-a382-99a79cf7758c"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.764673 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage15-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage15-crc\") pod \"glance-default-external-api-0\" (UID: \"7e0d7a3d-971e-438a-b4de-702b49c20f0d\") device mount path \"/mnt/openstack/pv15\"" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.765120 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d247de94-c318-4161-a382-99a79cf7758c-scripts" (OuterVolumeSpecName: "scripts") pod "d247de94-c318-4161-a382-99a79cf7758c" (UID: "d247de94-c318-4161-a382-99a79cf7758c"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.771077 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0008a48f-3c91-43dc-be3f-6ba3697e01dc-kube-api-access-4mgxr" (OuterVolumeSpecName: "kube-api-access-4mgxr") pod "0008a48f-3c91-43dc-be3f-6ba3697e01dc" (UID: "0008a48f-3c91-43dc-be3f-6ba3697e01dc"). InnerVolumeSpecName "kube-api-access-4mgxr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.771406 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d247de94-c318-4161-a382-99a79cf7758c-kube-api-access-22mrc" (OuterVolumeSpecName: "kube-api-access-22mrc") pod "d247de94-c318-4161-a382-99a79cf7758c" (UID: "d247de94-c318-4161-a382-99a79cf7758c"). InnerVolumeSpecName "kube-api-access-22mrc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.772449 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7e0d7a3d-971e-438a-b4de-702b49c20f0d-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"7e0d7a3d-971e-438a-b4de-702b49c20f0d\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.776403 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/7e0d7a3d-971e-438a-b4de-702b49c20f0d-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"7e0d7a3d-971e-438a-b4de-702b49c20f0d\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.792889 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7e0d7a3d-971e-438a-b4de-702b49c20f0d-scripts\") pod \"glance-default-external-api-0\" (UID: \"7e0d7a3d-971e-438a-b4de-702b49c20f0d\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.792966 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7e0d7a3d-971e-438a-b4de-702b49c20f0d-config-data\") pod \"glance-default-external-api-0\" (UID: \"7e0d7a3d-971e-438a-b4de-702b49c20f0d\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.797270 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage15-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage15-crc\") pod \"glance-default-external-api-0\" (UID: \"7e0d7a3d-971e-438a-b4de-702b49c20f0d\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.803040 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d247de94-c318-4161-a382-99a79cf7758c-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "d247de94-c318-4161-a382-99a79cf7758c" (UID: "d247de94-c318-4161-a382-99a79cf7758c"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.803615 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2z5jp\" (UniqueName: \"kubernetes.io/projected/7e0d7a3d-971e-438a-b4de-702b49c20f0d-kube-api-access-2z5jp\") pod \"glance-default-external-api-0\" (UID: \"7e0d7a3d-971e-438a-b4de-702b49c20f0d\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.815379 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d247de94-c318-4161-a382-99a79cf7758c-config-data" (OuterVolumeSpecName: "config-data") pod "d247de94-c318-4161-a382-99a79cf7758c" (UID: "d247de94-c318-4161-a382-99a79cf7758c"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.822964 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0008a48f-3c91-43dc-be3f-6ba3697e01dc-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "0008a48f-3c91-43dc-be3f-6ba3697e01dc" (UID: "0008a48f-3c91-43dc-be3f-6ba3697e01dc"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.863875 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d247de94-c318-4161-a382-99a79cf7758c-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.864130 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4mgxr\" (UniqueName: \"kubernetes.io/projected/0008a48f-3c91-43dc-be3f-6ba3697e01dc-kube-api-access-4mgxr\") on node \"crc\" DevicePath \"\"" Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.864195 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0008a48f-3c91-43dc-be3f-6ba3697e01dc-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.864265 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-22mrc\" (UniqueName: \"kubernetes.io/projected/d247de94-c318-4161-a382-99a79cf7758c-kube-api-access-22mrc\") on node \"crc\" DevicePath \"\"" Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.864334 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d247de94-c318-4161-a382-99a79cf7758c-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.864392 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f8d91b46-e486-4be8-ad35-2c9d3d8fb671-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.864458 5120 reconciler_common.go:299] "Volume detached for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/0008a48f-3c91-43dc-be3f-6ba3697e01dc-db-sync-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.864517 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d247de94-c318-4161-a382-99a79cf7758c-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.864574 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d247de94-c318-4161-a382-99a79cf7758c-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:08:02 crc kubenswrapper[5120]: I0316 16:08:02.887231 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.179969 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-g56h7" event={"ID":"0008a48f-3c91-43dc-be3f-6ba3697e01dc","Type":"ContainerDied","Data":"66ae01d0f18b14e689b978da007c1036e0c727c7c73019306b78f95e4b34e54d"} Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.180049 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="66ae01d0f18b14e689b978da007c1036e0c727c7c73019306b78f95e4b34e54d" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.179995 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-g56h7" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.185045 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-ghc6c" event={"ID":"d247de94-c318-4161-a382-99a79cf7758c","Type":"ContainerDied","Data":"dda28a28f0fe2bc7b035fb641f7d14cb47d9462ef40e00f06673d04d0f9d6694"} Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.185082 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dda28a28f0fe2bc7b035fb641f7d14cb47d9462ef40e00f06673d04d0f9d6694" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.185401 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-ghc6c" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.188731 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"42f516f0-04ae-4acc-83dd-4245872ac0c9","Type":"ContainerStarted","Data":"2636dbe8ef3da534a10254d81208e37ba5b17328c954ad683c9c53f30f7bb132"} Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.188913 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="42f516f0-04ae-4acc-83dd-4245872ac0c9" containerName="ceilometer-central-agent" containerID="cri-o://e3708fe808135cd024acab9cceab38489fdc15b8e2f9c487c33960f4e6a6bf27" gracePeriod=30 Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.189005 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.189139 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="42f516f0-04ae-4acc-83dd-4245872ac0c9" containerName="ceilometer-notification-agent" containerID="cri-o://cf4716dd0f71bf27f400a87b06ea844dfe76cfa671c68ed66f46925bdccf99f2" gracePeriod=30 Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.189124 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="42f516f0-04ae-4acc-83dd-4245872ac0c9" containerName="sg-core" containerID="cri-o://eaf3a26e2353b85e4d76484c2dc9e0b3839d41444994942c2fd11311fe70f9b4" gracePeriod=30 Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.189248 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="42f516f0-04ae-4acc-83dd-4245872ac0c9" containerName="proxy-httpd" containerID="cri-o://2636dbe8ef3da534a10254d81208e37ba5b17328c954ad683c9c53f30f7bb132" gracePeriod=30 Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.195441 5120 generic.go:358] "Generic (PLEG): container finished" podID="b4e69343-fd94-436a-b5ab-dcc02f48c06b" containerID="764f38d02b98666d18a8940288b633132283989377d9bb21dbcecb338091ffc3" exitCode=0 Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.195657 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561288-b6gpk" event={"ID":"b4e69343-fd94-436a-b5ab-dcc02f48c06b","Type":"ContainerDied","Data":"764f38d02b98666d18a8940288b633132283989377d9bb21dbcecb338091ffc3"} Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.204052 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.204098 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"f8d91b46-e486-4be8-ad35-2c9d3d8fb671","Type":"ContainerDied","Data":"0ae4cb43a9069a8b67de4e4370b2023f710c6a76199b673dc4eb346abd933f00"} Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.204132 5120 scope.go:117] "RemoveContainer" containerID="f60ede070c7e409af540d4925ecc5f9f61f604a860dd2517953dd7babeffcfa8" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.242805 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=1.89820154 podStartE2EDuration="7.24278501s" podCreationTimestamp="2026-03-16 16:07:56 +0000 UTC" firstStartedPulling="2026-03-16 16:07:56.861638667 +0000 UTC m=+2179.015570324" lastFinishedPulling="2026-03-16 16:08:02.206222137 +0000 UTC m=+2184.360153794" observedRunningTime="2026-03-16 16:08:03.219951177 +0000 UTC m=+2185.373882824" watchObservedRunningTime="2026-03-16 16:08:03.24278501 +0000 UTC m=+2185.396716677" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.375150 5120 scope.go:117] "RemoveContainer" containerID="4f7ad952d3db167aecbb26d3cb6cbc860193fe6eeee89f9fd4ce093e5292f05c" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.497808 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-765f7c8474-fjhth"] Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.499134 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d247de94-c318-4161-a382-99a79cf7758c" containerName="placement-db-sync" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.499149 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="d247de94-c318-4161-a382-99a79cf7758c" containerName="placement-db-sync" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.499182 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0008a48f-3c91-43dc-be3f-6ba3697e01dc" containerName="barbican-db-sync" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.499188 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="0008a48f-3c91-43dc-be3f-6ba3697e01dc" containerName="barbican-db-sync" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.499324 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="0008a48f-3c91-43dc-be3f-6ba3697e01dc" containerName="barbican-db-sync" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.499347 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="d247de94-c318-4161-a382-99a79cf7758c" containerName="placement-db-sync" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.510506 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-765f7c8474-fjhth" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.512388 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-barbican-dockercfg-mts9v\"" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.513639 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-keystone-listener-config-data\"" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.514146 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-config-data\"" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.517401 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-worker-57f4878fd7-lxcgl"] Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.524250 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-57f4878fd7-lxcgl" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.529139 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-worker-config-data\"" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.545855 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-765f7c8474-fjhth"] Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.572330 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-57f4878fd7-lxcgl"] Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.579028 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-df4bb598-d5scs"] Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.586019 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/1339c179-889a-4734-8a78-ccc684103c8a-config-data-custom\") pod \"barbican-keystone-listener-765f7c8474-fjhth\" (UID: \"1339c179-889a-4734-8a78-ccc684103c8a\") " pod="openstack-kuttl-tests/barbican-keystone-listener-765f7c8474-fjhth" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.586063 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dn5g\" (UniqueName: \"kubernetes.io/projected/1339c179-889a-4734-8a78-ccc684103c8a-kube-api-access-7dn5g\") pod \"barbican-keystone-listener-765f7c8474-fjhth\" (UID: \"1339c179-889a-4734-8a78-ccc684103c8a\") " pod="openstack-kuttl-tests/barbican-keystone-listener-765f7c8474-fjhth" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.586094 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/1339c179-889a-4734-8a78-ccc684103c8a-logs\") pod \"barbican-keystone-listener-765f7c8474-fjhth\" (UID: \"1339c179-889a-4734-8a78-ccc684103c8a\") " pod="openstack-kuttl-tests/barbican-keystone-listener-765f7c8474-fjhth" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.586170 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8f5b15fe-8fe8-40b3-b546-351cbd1bcd9e-logs\") pod \"barbican-worker-57f4878fd7-lxcgl\" (UID: \"8f5b15fe-8fe8-40b3-b546-351cbd1bcd9e\") " pod="openstack-kuttl-tests/barbican-worker-57f4878fd7-lxcgl" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.586222 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1339c179-889a-4734-8a78-ccc684103c8a-combined-ca-bundle\") pod \"barbican-keystone-listener-765f7c8474-fjhth\" (UID: \"1339c179-889a-4734-8a78-ccc684103c8a\") " pod="openstack-kuttl-tests/barbican-keystone-listener-765f7c8474-fjhth" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.586251 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8n74\" (UniqueName: \"kubernetes.io/projected/8f5b15fe-8fe8-40b3-b546-351cbd1bcd9e-kube-api-access-n8n74\") pod \"barbican-worker-57f4878fd7-lxcgl\" (UID: \"8f5b15fe-8fe8-40b3-b546-351cbd1bcd9e\") " pod="openstack-kuttl-tests/barbican-worker-57f4878fd7-lxcgl" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.586268 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8f5b15fe-8fe8-40b3-b546-351cbd1bcd9e-config-data\") pod \"barbican-worker-57f4878fd7-lxcgl\" (UID: \"8f5b15fe-8fe8-40b3-b546-351cbd1bcd9e\") " pod="openstack-kuttl-tests/barbican-worker-57f4878fd7-lxcgl" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.586285 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1339c179-889a-4734-8a78-ccc684103c8a-config-data\") pod \"barbican-keystone-listener-765f7c8474-fjhth\" (UID: \"1339c179-889a-4734-8a78-ccc684103c8a\") " pod="openstack-kuttl-tests/barbican-keystone-listener-765f7c8474-fjhth" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.586300 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8f5b15fe-8fe8-40b3-b546-351cbd1bcd9e-combined-ca-bundle\") pod \"barbican-worker-57f4878fd7-lxcgl\" (UID: \"8f5b15fe-8fe8-40b3-b546-351cbd1bcd9e\") " pod="openstack-kuttl-tests/barbican-worker-57f4878fd7-lxcgl" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.586337 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/8f5b15fe-8fe8-40b3-b546-351cbd1bcd9e-config-data-custom\") pod \"barbican-worker-57f4878fd7-lxcgl\" (UID: \"8f5b15fe-8fe8-40b3-b546-351cbd1bcd9e\") " pod="openstack-kuttl-tests/barbican-worker-57f4878fd7-lxcgl" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.588320 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-df4bb598-d5scs" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.591311 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-scripts\"" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.592357 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-placement-internal-svc\"" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.592447 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-df4bb598-d5scs"] Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.593051 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-config-data\"" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.593279 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-placement-public-svc\"" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.593581 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-placement-dockercfg-dpblk\"" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.602083 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-api-6877f8555d-c7rkf"] Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.609230 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-6877f8555d-c7rkf" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.614504 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-api-config-data\"" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.621075 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.637056 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-6877f8555d-c7rkf"] Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.649386 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.657542 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.666922 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.673292 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.675598 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-internal-config-data\"" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.676131 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-internal-svc\"" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.677201 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.688074 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/8f5b15fe-8fe8-40b3-b546-351cbd1bcd9e-config-data-custom\") pod \"barbican-worker-57f4878fd7-lxcgl\" (UID: \"8f5b15fe-8fe8-40b3-b546-351cbd1bcd9e\") " pod="openstack-kuttl-tests/barbican-worker-57f4878fd7-lxcgl" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.688334 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/1339c179-889a-4734-8a78-ccc684103c8a-config-data-custom\") pod \"barbican-keystone-listener-765f7c8474-fjhth\" (UID: \"1339c179-889a-4734-8a78-ccc684103c8a\") " pod="openstack-kuttl-tests/barbican-keystone-listener-765f7c8474-fjhth" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.688506 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7dn5g\" (UniqueName: \"kubernetes.io/projected/1339c179-889a-4734-8a78-ccc684103c8a-kube-api-access-7dn5g\") pod \"barbican-keystone-listener-765f7c8474-fjhth\" (UID: \"1339c179-889a-4734-8a78-ccc684103c8a\") " pod="openstack-kuttl-tests/barbican-keystone-listener-765f7c8474-fjhth" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.688597 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/1339c179-889a-4734-8a78-ccc684103c8a-logs\") pod \"barbican-keystone-listener-765f7c8474-fjhth\" (UID: \"1339c179-889a-4734-8a78-ccc684103c8a\") " pod="openstack-kuttl-tests/barbican-keystone-listener-765f7c8474-fjhth" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.688876 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8f5b15fe-8fe8-40b3-b546-351cbd1bcd9e-logs\") pod \"barbican-worker-57f4878fd7-lxcgl\" (UID: \"8f5b15fe-8fe8-40b3-b546-351cbd1bcd9e\") " pod="openstack-kuttl-tests/barbican-worker-57f4878fd7-lxcgl" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.688965 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1339c179-889a-4734-8a78-ccc684103c8a-combined-ca-bundle\") pod \"barbican-keystone-listener-765f7c8474-fjhth\" (UID: \"1339c179-889a-4734-8a78-ccc684103c8a\") " pod="openstack-kuttl-tests/barbican-keystone-listener-765f7c8474-fjhth" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.689013 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n8n74\" (UniqueName: \"kubernetes.io/projected/8f5b15fe-8fe8-40b3-b546-351cbd1bcd9e-kube-api-access-n8n74\") pod \"barbican-worker-57f4878fd7-lxcgl\" (UID: \"8f5b15fe-8fe8-40b3-b546-351cbd1bcd9e\") " pod="openstack-kuttl-tests/barbican-worker-57f4878fd7-lxcgl" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.689033 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8f5b15fe-8fe8-40b3-b546-351cbd1bcd9e-config-data\") pod \"barbican-worker-57f4878fd7-lxcgl\" (UID: \"8f5b15fe-8fe8-40b3-b546-351cbd1bcd9e\") " pod="openstack-kuttl-tests/barbican-worker-57f4878fd7-lxcgl" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.689053 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1339c179-889a-4734-8a78-ccc684103c8a-config-data\") pod \"barbican-keystone-listener-765f7c8474-fjhth\" (UID: \"1339c179-889a-4734-8a78-ccc684103c8a\") " pod="openstack-kuttl-tests/barbican-keystone-listener-765f7c8474-fjhth" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.689068 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8f5b15fe-8fe8-40b3-b546-351cbd1bcd9e-combined-ca-bundle\") pod \"barbican-worker-57f4878fd7-lxcgl\" (UID: \"8f5b15fe-8fe8-40b3-b546-351cbd1bcd9e\") " pod="openstack-kuttl-tests/barbican-worker-57f4878fd7-lxcgl" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.689619 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/1339c179-889a-4734-8a78-ccc684103c8a-logs\") pod \"barbican-keystone-listener-765f7c8474-fjhth\" (UID: \"1339c179-889a-4734-8a78-ccc684103c8a\") " pod="openstack-kuttl-tests/barbican-keystone-listener-765f7c8474-fjhth" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.690011 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8f5b15fe-8fe8-40b3-b546-351cbd1bcd9e-logs\") pod \"barbican-worker-57f4878fd7-lxcgl\" (UID: \"8f5b15fe-8fe8-40b3-b546-351cbd1bcd9e\") " pod="openstack-kuttl-tests/barbican-worker-57f4878fd7-lxcgl" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.696748 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1339c179-889a-4734-8a78-ccc684103c8a-combined-ca-bundle\") pod \"barbican-keystone-listener-765f7c8474-fjhth\" (UID: \"1339c179-889a-4734-8a78-ccc684103c8a\") " pod="openstack-kuttl-tests/barbican-keystone-listener-765f7c8474-fjhth" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.696745 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/8f5b15fe-8fe8-40b3-b546-351cbd1bcd9e-config-data-custom\") pod \"barbican-worker-57f4878fd7-lxcgl\" (UID: \"8f5b15fe-8fe8-40b3-b546-351cbd1bcd9e\") " pod="openstack-kuttl-tests/barbican-worker-57f4878fd7-lxcgl" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.715233 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dn5g\" (UniqueName: \"kubernetes.io/projected/1339c179-889a-4734-8a78-ccc684103c8a-kube-api-access-7dn5g\") pod \"barbican-keystone-listener-765f7c8474-fjhth\" (UID: \"1339c179-889a-4734-8a78-ccc684103c8a\") " pod="openstack-kuttl-tests/barbican-keystone-listener-765f7c8474-fjhth" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.721636 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8n74\" (UniqueName: \"kubernetes.io/projected/8f5b15fe-8fe8-40b3-b546-351cbd1bcd9e-kube-api-access-n8n74\") pod \"barbican-worker-57f4878fd7-lxcgl\" (UID: \"8f5b15fe-8fe8-40b3-b546-351cbd1bcd9e\") " pod="openstack-kuttl-tests/barbican-worker-57f4878fd7-lxcgl" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.735698 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/1339c179-889a-4734-8a78-ccc684103c8a-config-data-custom\") pod \"barbican-keystone-listener-765f7c8474-fjhth\" (UID: \"1339c179-889a-4734-8a78-ccc684103c8a\") " pod="openstack-kuttl-tests/barbican-keystone-listener-765f7c8474-fjhth" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.736919 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8f5b15fe-8fe8-40b3-b546-351cbd1bcd9e-combined-ca-bundle\") pod \"barbican-worker-57f4878fd7-lxcgl\" (UID: \"8f5b15fe-8fe8-40b3-b546-351cbd1bcd9e\") " pod="openstack-kuttl-tests/barbican-worker-57f4878fd7-lxcgl" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.737790 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8f5b15fe-8fe8-40b3-b546-351cbd1bcd9e-config-data\") pod \"barbican-worker-57f4878fd7-lxcgl\" (UID: \"8f5b15fe-8fe8-40b3-b546-351cbd1bcd9e\") " pod="openstack-kuttl-tests/barbican-worker-57f4878fd7-lxcgl" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.738582 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1339c179-889a-4734-8a78-ccc684103c8a-config-data\") pod \"barbican-keystone-listener-765f7c8474-fjhth\" (UID: \"1339c179-889a-4734-8a78-ccc684103c8a\") " pod="openstack-kuttl-tests/barbican-keystone-listener-765f7c8474-fjhth" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.761338 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-8lrsq" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.790980 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/cbc2cc5a-7563-470f-8e52-9db1448b2669-config-data-custom\") pod \"barbican-api-6877f8555d-c7rkf\" (UID: \"cbc2cc5a-7563-470f-8e52-9db1448b2669\") " pod="openstack-kuttl-tests/barbican-api-6877f8555d-c7rkf" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.791062 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/cbc2cc5a-7563-470f-8e52-9db1448b2669-logs\") pod \"barbican-api-6877f8555d-c7rkf\" (UID: \"cbc2cc5a-7563-470f-8e52-9db1448b2669\") " pod="openstack-kuttl-tests/barbican-api-6877f8555d-c7rkf" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.791103 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cbc2cc5a-7563-470f-8e52-9db1448b2669-combined-ca-bundle\") pod \"barbican-api-6877f8555d-c7rkf\" (UID: \"cbc2cc5a-7563-470f-8e52-9db1448b2669\") " pod="openstack-kuttl-tests/barbican-api-6877f8555d-c7rkf" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.791123 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ctvn\" (UniqueName: \"kubernetes.io/projected/c5593ae2-7a56-4d09-8f88-a54b43c2be0c-kube-api-access-9ctvn\") pod \"glance-default-internal-api-0\" (UID: \"c5593ae2-7a56-4d09-8f88-a54b43c2be0c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.791151 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/39058b27-360b-4aa6-b04b-d415e907df29-config-data\") pod \"placement-df4bb598-d5scs\" (UID: \"39058b27-360b-4aa6-b04b-d415e907df29\") " pod="openstack-kuttl-tests/placement-df4bb598-d5scs" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.791174 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c5593ae2-7a56-4d09-8f88-a54b43c2be0c-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"c5593ae2-7a56-4d09-8f88-a54b43c2be0c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.791197 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/39058b27-360b-4aa6-b04b-d415e907df29-scripts\") pod \"placement-df4bb598-d5scs\" (UID: \"39058b27-360b-4aa6-b04b-d415e907df29\") " pod="openstack-kuttl-tests/placement-df4bb598-d5scs" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.791214 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/39058b27-360b-4aa6-b04b-d415e907df29-public-tls-certs\") pod \"placement-df4bb598-d5scs\" (UID: \"39058b27-360b-4aa6-b04b-d415e907df29\") " pod="openstack-kuttl-tests/placement-df4bb598-d5scs" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.791234 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zd7b6\" (UniqueName: \"kubernetes.io/projected/39058b27-360b-4aa6-b04b-d415e907df29-kube-api-access-zd7b6\") pod \"placement-df4bb598-d5scs\" (UID: \"39058b27-360b-4aa6-b04b-d415e907df29\") " pod="openstack-kuttl-tests/placement-df4bb598-d5scs" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.791267 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/39058b27-360b-4aa6-b04b-d415e907df29-logs\") pod \"placement-df4bb598-d5scs\" (UID: \"39058b27-360b-4aa6-b04b-d415e907df29\") " pod="openstack-kuttl-tests/placement-df4bb598-d5scs" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.791454 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/c5593ae2-7a56-4d09-8f88-a54b43c2be0c-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"c5593ae2-7a56-4d09-8f88-a54b43c2be0c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.791523 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c5593ae2-7a56-4d09-8f88-a54b43c2be0c-logs\") pod \"glance-default-internal-api-0\" (UID: \"c5593ae2-7a56-4d09-8f88-a54b43c2be0c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.791543 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cbc2cc5a-7563-470f-8e52-9db1448b2669-config-data\") pod \"barbican-api-6877f8555d-c7rkf\" (UID: \"cbc2cc5a-7563-470f-8e52-9db1448b2669\") " pod="openstack-kuttl-tests/barbican-api-6877f8555d-c7rkf" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.791582 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") pod \"glance-default-internal-api-0\" (UID: \"c5593ae2-7a56-4d09-8f88-a54b43c2be0c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.791618 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/39058b27-360b-4aa6-b04b-d415e907df29-combined-ca-bundle\") pod \"placement-df4bb598-d5scs\" (UID: \"39058b27-360b-4aa6-b04b-d415e907df29\") " pod="openstack-kuttl-tests/placement-df4bb598-d5scs" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.791655 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c5593ae2-7a56-4d09-8f88-a54b43c2be0c-config-data\") pod \"glance-default-internal-api-0\" (UID: \"c5593ae2-7a56-4d09-8f88-a54b43c2be0c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.791683 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kj9nm\" (UniqueName: \"kubernetes.io/projected/cbc2cc5a-7563-470f-8e52-9db1448b2669-kube-api-access-kj9nm\") pod \"barbican-api-6877f8555d-c7rkf\" (UID: \"cbc2cc5a-7563-470f-8e52-9db1448b2669\") " pod="openstack-kuttl-tests/barbican-api-6877f8555d-c7rkf" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.791728 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/c5593ae2-7a56-4d09-8f88-a54b43c2be0c-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"c5593ae2-7a56-4d09-8f88-a54b43c2be0c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.791858 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c5593ae2-7a56-4d09-8f88-a54b43c2be0c-scripts\") pod \"glance-default-internal-api-0\" (UID: \"c5593ae2-7a56-4d09-8f88-a54b43c2be0c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.791896 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/39058b27-360b-4aa6-b04b-d415e907df29-internal-tls-certs\") pod \"placement-df4bb598-d5scs\" (UID: \"39058b27-360b-4aa6-b04b-d415e907df29\") " pod="openstack-kuttl-tests/placement-df4bb598-d5scs" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.849859 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-765f7c8474-fjhth" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.893655 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/ff364e62-5da8-4005-89e0-48e3dbfa5222-credential-keys\") pod \"ff364e62-5da8-4005-89e0-48e3dbfa5222\" (UID: \"ff364e62-5da8-4005-89e0-48e3dbfa5222\") " Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.895311 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ff364e62-5da8-4005-89e0-48e3dbfa5222-scripts\") pod \"ff364e62-5da8-4005-89e0-48e3dbfa5222\" (UID: \"ff364e62-5da8-4005-89e0-48e3dbfa5222\") " Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.895504 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ff364e62-5da8-4005-89e0-48e3dbfa5222-combined-ca-bundle\") pod \"ff364e62-5da8-4005-89e0-48e3dbfa5222\" (UID: \"ff364e62-5da8-4005-89e0-48e3dbfa5222\") " Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.895679 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ff364e62-5da8-4005-89e0-48e3dbfa5222-config-data\") pod \"ff364e62-5da8-4005-89e0-48e3dbfa5222\" (UID: \"ff364e62-5da8-4005-89e0-48e3dbfa5222\") " Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.896139 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qlzls\" (UniqueName: \"kubernetes.io/projected/ff364e62-5da8-4005-89e0-48e3dbfa5222-kube-api-access-qlzls\") pod \"ff364e62-5da8-4005-89e0-48e3dbfa5222\" (UID: \"ff364e62-5da8-4005-89e0-48e3dbfa5222\") " Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.896365 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/ff364e62-5da8-4005-89e0-48e3dbfa5222-fernet-keys\") pod \"ff364e62-5da8-4005-89e0-48e3dbfa5222\" (UID: \"ff364e62-5da8-4005-89e0-48e3dbfa5222\") " Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.896592 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/39058b27-360b-4aa6-b04b-d415e907df29-logs\") pod \"placement-df4bb598-d5scs\" (UID: \"39058b27-360b-4aa6-b04b-d415e907df29\") " pod="openstack-kuttl-tests/placement-df4bb598-d5scs" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.896856 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/c5593ae2-7a56-4d09-8f88-a54b43c2be0c-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"c5593ae2-7a56-4d09-8f88-a54b43c2be0c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.898326 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c5593ae2-7a56-4d09-8f88-a54b43c2be0c-logs\") pod \"glance-default-internal-api-0\" (UID: \"c5593ae2-7a56-4d09-8f88-a54b43c2be0c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.898379 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cbc2cc5a-7563-470f-8e52-9db1448b2669-config-data\") pod \"barbican-api-6877f8555d-c7rkf\" (UID: \"cbc2cc5a-7563-470f-8e52-9db1448b2669\") " pod="openstack-kuttl-tests/barbican-api-6877f8555d-c7rkf" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.898455 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") pod \"glance-default-internal-api-0\" (UID: \"c5593ae2-7a56-4d09-8f88-a54b43c2be0c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.898832 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/39058b27-360b-4aa6-b04b-d415e907df29-combined-ca-bundle\") pod \"placement-df4bb598-d5scs\" (UID: \"39058b27-360b-4aa6-b04b-d415e907df29\") " pod="openstack-kuttl-tests/placement-df4bb598-d5scs" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.898904 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c5593ae2-7a56-4d09-8f88-a54b43c2be0c-config-data\") pod \"glance-default-internal-api-0\" (UID: \"c5593ae2-7a56-4d09-8f88-a54b43c2be0c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.898946 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kj9nm\" (UniqueName: \"kubernetes.io/projected/cbc2cc5a-7563-470f-8e52-9db1448b2669-kube-api-access-kj9nm\") pod \"barbican-api-6877f8555d-c7rkf\" (UID: \"cbc2cc5a-7563-470f-8e52-9db1448b2669\") " pod="openstack-kuttl-tests/barbican-api-6877f8555d-c7rkf" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.898997 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/c5593ae2-7a56-4d09-8f88-a54b43c2be0c-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"c5593ae2-7a56-4d09-8f88-a54b43c2be0c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.899089 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c5593ae2-7a56-4d09-8f88-a54b43c2be0c-scripts\") pod \"glance-default-internal-api-0\" (UID: \"c5593ae2-7a56-4d09-8f88-a54b43c2be0c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.899131 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/39058b27-360b-4aa6-b04b-d415e907df29-internal-tls-certs\") pod \"placement-df4bb598-d5scs\" (UID: \"39058b27-360b-4aa6-b04b-d415e907df29\") " pod="openstack-kuttl-tests/placement-df4bb598-d5scs" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.899189 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/cbc2cc5a-7563-470f-8e52-9db1448b2669-config-data-custom\") pod \"barbican-api-6877f8555d-c7rkf\" (UID: \"cbc2cc5a-7563-470f-8e52-9db1448b2669\") " pod="openstack-kuttl-tests/barbican-api-6877f8555d-c7rkf" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.899301 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/cbc2cc5a-7563-470f-8e52-9db1448b2669-logs\") pod \"barbican-api-6877f8555d-c7rkf\" (UID: \"cbc2cc5a-7563-470f-8e52-9db1448b2669\") " pod="openstack-kuttl-tests/barbican-api-6877f8555d-c7rkf" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.899452 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cbc2cc5a-7563-470f-8e52-9db1448b2669-combined-ca-bundle\") pod \"barbican-api-6877f8555d-c7rkf\" (UID: \"cbc2cc5a-7563-470f-8e52-9db1448b2669\") " pod="openstack-kuttl-tests/barbican-api-6877f8555d-c7rkf" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.899550 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9ctvn\" (UniqueName: \"kubernetes.io/projected/c5593ae2-7a56-4d09-8f88-a54b43c2be0c-kube-api-access-9ctvn\") pod \"glance-default-internal-api-0\" (UID: \"c5593ae2-7a56-4d09-8f88-a54b43c2be0c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.899685 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/39058b27-360b-4aa6-b04b-d415e907df29-config-data\") pod \"placement-df4bb598-d5scs\" (UID: \"39058b27-360b-4aa6-b04b-d415e907df29\") " pod="openstack-kuttl-tests/placement-df4bb598-d5scs" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.899982 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c5593ae2-7a56-4d09-8f88-a54b43c2be0c-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"c5593ae2-7a56-4d09-8f88-a54b43c2be0c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.900125 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/39058b27-360b-4aa6-b04b-d415e907df29-scripts\") pod \"placement-df4bb598-d5scs\" (UID: \"39058b27-360b-4aa6-b04b-d415e907df29\") " pod="openstack-kuttl-tests/placement-df4bb598-d5scs" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.900243 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/39058b27-360b-4aa6-b04b-d415e907df29-public-tls-certs\") pod \"placement-df4bb598-d5scs\" (UID: \"39058b27-360b-4aa6-b04b-d415e907df29\") " pod="openstack-kuttl-tests/placement-df4bb598-d5scs" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.900380 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zd7b6\" (UniqueName: \"kubernetes.io/projected/39058b27-360b-4aa6-b04b-d415e907df29-kube-api-access-zd7b6\") pod \"placement-df4bb598-d5scs\" (UID: \"39058b27-360b-4aa6-b04b-d415e907df29\") " pod="openstack-kuttl-tests/placement-df4bb598-d5scs" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.901177 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c5593ae2-7a56-4d09-8f88-a54b43c2be0c-logs\") pod \"glance-default-internal-api-0\" (UID: \"c5593ae2-7a56-4d09-8f88-a54b43c2be0c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.899915 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/c5593ae2-7a56-4d09-8f88-a54b43c2be0c-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"c5593ae2-7a56-4d09-8f88-a54b43c2be0c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.899332 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff364e62-5da8-4005-89e0-48e3dbfa5222-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "ff364e62-5da8-4005-89e0-48e3dbfa5222" (UID: "ff364e62-5da8-4005-89e0-48e3dbfa5222"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.903443 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/39058b27-360b-4aa6-b04b-d415e907df29-logs\") pod \"placement-df4bb598-d5scs\" (UID: \"39058b27-360b-4aa6-b04b-d415e907df29\") " pod="openstack-kuttl-tests/placement-df4bb598-d5scs" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.913954 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/c5593ae2-7a56-4d09-8f88-a54b43c2be0c-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"c5593ae2-7a56-4d09-8f88-a54b43c2be0c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.914193 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff364e62-5da8-4005-89e0-48e3dbfa5222-kube-api-access-qlzls" (OuterVolumeSpecName: "kube-api-access-qlzls") pod "ff364e62-5da8-4005-89e0-48e3dbfa5222" (UID: "ff364e62-5da8-4005-89e0-48e3dbfa5222"). InnerVolumeSpecName "kube-api-access-qlzls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.914659 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c5593ae2-7a56-4d09-8f88-a54b43c2be0c-config-data\") pod \"glance-default-internal-api-0\" (UID: \"c5593ae2-7a56-4d09-8f88-a54b43c2be0c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.915146 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") pod \"glance-default-internal-api-0\" (UID: \"c5593ae2-7a56-4d09-8f88-a54b43c2be0c\") device mount path \"/mnt/openstack/pv14\"" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.915209 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/cbc2cc5a-7563-470f-8e52-9db1448b2669-logs\") pod \"barbican-api-6877f8555d-c7rkf\" (UID: \"cbc2cc5a-7563-470f-8e52-9db1448b2669\") " pod="openstack-kuttl-tests/barbican-api-6877f8555d-c7rkf" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.918773 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff364e62-5da8-4005-89e0-48e3dbfa5222-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "ff364e62-5da8-4005-89e0-48e3dbfa5222" (UID: "ff364e62-5da8-4005-89e0-48e3dbfa5222"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.918869 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff364e62-5da8-4005-89e0-48e3dbfa5222-scripts" (OuterVolumeSpecName: "scripts") pod "ff364e62-5da8-4005-89e0-48e3dbfa5222" (UID: "ff364e62-5da8-4005-89e0-48e3dbfa5222"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.919259 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/39058b27-360b-4aa6-b04b-d415e907df29-scripts\") pod \"placement-df4bb598-d5scs\" (UID: \"39058b27-360b-4aa6-b04b-d415e907df29\") " pod="openstack-kuttl-tests/placement-df4bb598-d5scs" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.919473 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/39058b27-360b-4aa6-b04b-d415e907df29-internal-tls-certs\") pod \"placement-df4bb598-d5scs\" (UID: \"39058b27-360b-4aa6-b04b-d415e907df29\") " pod="openstack-kuttl-tests/placement-df4bb598-d5scs" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.921874 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cbc2cc5a-7563-470f-8e52-9db1448b2669-config-data\") pod \"barbican-api-6877f8555d-c7rkf\" (UID: \"cbc2cc5a-7563-470f-8e52-9db1448b2669\") " pod="openstack-kuttl-tests/barbican-api-6877f8555d-c7rkf" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.922686 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/cbc2cc5a-7563-470f-8e52-9db1448b2669-config-data-custom\") pod \"barbican-api-6877f8555d-c7rkf\" (UID: \"cbc2cc5a-7563-470f-8e52-9db1448b2669\") " pod="openstack-kuttl-tests/barbican-api-6877f8555d-c7rkf" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.924132 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c5593ae2-7a56-4d09-8f88-a54b43c2be0c-scripts\") pod \"glance-default-internal-api-0\" (UID: \"c5593ae2-7a56-4d09-8f88-a54b43c2be0c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.933697 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/39058b27-360b-4aa6-b04b-d415e907df29-combined-ca-bundle\") pod \"placement-df4bb598-d5scs\" (UID: \"39058b27-360b-4aa6-b04b-d415e907df29\") " pod="openstack-kuttl-tests/placement-df4bb598-d5scs" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.933970 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c5593ae2-7a56-4d09-8f88-a54b43c2be0c-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"c5593ae2-7a56-4d09-8f88-a54b43c2be0c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.934181 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zd7b6\" (UniqueName: \"kubernetes.io/projected/39058b27-360b-4aa6-b04b-d415e907df29-kube-api-access-zd7b6\") pod \"placement-df4bb598-d5scs\" (UID: \"39058b27-360b-4aa6-b04b-d415e907df29\") " pod="openstack-kuttl-tests/placement-df4bb598-d5scs" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.934840 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/39058b27-360b-4aa6-b04b-d415e907df29-config-data\") pod \"placement-df4bb598-d5scs\" (UID: \"39058b27-360b-4aa6-b04b-d415e907df29\") " pod="openstack-kuttl-tests/placement-df4bb598-d5scs" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.936259 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cbc2cc5a-7563-470f-8e52-9db1448b2669-combined-ca-bundle\") pod \"barbican-api-6877f8555d-c7rkf\" (UID: \"cbc2cc5a-7563-470f-8e52-9db1448b2669\") " pod="openstack-kuttl-tests/barbican-api-6877f8555d-c7rkf" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.937829 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ctvn\" (UniqueName: \"kubernetes.io/projected/c5593ae2-7a56-4d09-8f88-a54b43c2be0c-kube-api-access-9ctvn\") pod \"glance-default-internal-api-0\" (UID: \"c5593ae2-7a56-4d09-8f88-a54b43c2be0c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.940523 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/39058b27-360b-4aa6-b04b-d415e907df29-public-tls-certs\") pod \"placement-df4bb598-d5scs\" (UID: \"39058b27-360b-4aa6-b04b-d415e907df29\") " pod="openstack-kuttl-tests/placement-df4bb598-d5scs" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.941096 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kj9nm\" (UniqueName: \"kubernetes.io/projected/cbc2cc5a-7563-470f-8e52-9db1448b2669-kube-api-access-kj9nm\") pod \"barbican-api-6877f8555d-c7rkf\" (UID: \"cbc2cc5a-7563-470f-8e52-9db1448b2669\") " pod="openstack-kuttl-tests/barbican-api-6877f8555d-c7rkf" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.948567 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-57f4878fd7-lxcgl" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.950158 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff364e62-5da8-4005-89e0-48e3dbfa5222-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ff364e62-5da8-4005-89e0-48e3dbfa5222" (UID: "ff364e62-5da8-4005-89e0-48e3dbfa5222"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.950391 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff364e62-5da8-4005-89e0-48e3dbfa5222-config-data" (OuterVolumeSpecName: "config-data") pod "ff364e62-5da8-4005-89e0-48e3dbfa5222" (UID: "ff364e62-5da8-4005-89e0-48e3dbfa5222"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:08:03 crc kubenswrapper[5120]: I0316 16:08:03.992948 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") pod \"glance-default-internal-api-0\" (UID: \"c5593ae2-7a56-4d09-8f88-a54b43c2be0c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.009452 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ff364e62-5da8-4005-89e0-48e3dbfa5222-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.009490 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ff364e62-5da8-4005-89e0-48e3dbfa5222-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.009499 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ff364e62-5da8-4005-89e0-48e3dbfa5222-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.009508 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qlzls\" (UniqueName: \"kubernetes.io/projected/ff364e62-5da8-4005-89e0-48e3dbfa5222-kube-api-access-qlzls\") on node \"crc\" DevicePath \"\"" Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.009518 5120 reconciler_common.go:299] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/ff364e62-5da8-4005-89e0-48e3dbfa5222-fernet-keys\") on node \"crc\" DevicePath \"\"" Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.009526 5120 reconciler_common.go:299] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/ff364e62-5da8-4005-89e0-48e3dbfa5222-credential-keys\") on node \"crc\" DevicePath \"\"" Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.027780 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-df4bb598-d5scs" Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.039581 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-6877f8555d-c7rkf" Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.044713 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.062056 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.117316 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/42f516f0-04ae-4acc-83dd-4245872ac0c9-run-httpd\") pod \"42f516f0-04ae-4acc-83dd-4245872ac0c9\" (UID: \"42f516f0-04ae-4acc-83dd-4245872ac0c9\") " Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.117558 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/42f516f0-04ae-4acc-83dd-4245872ac0c9-sg-core-conf-yaml\") pod \"42f516f0-04ae-4acc-83dd-4245872ac0c9\" (UID: \"42f516f0-04ae-4acc-83dd-4245872ac0c9\") " Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.117637 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2sbm7\" (UniqueName: \"kubernetes.io/projected/42f516f0-04ae-4acc-83dd-4245872ac0c9-kube-api-access-2sbm7\") pod \"42f516f0-04ae-4acc-83dd-4245872ac0c9\" (UID: \"42f516f0-04ae-4acc-83dd-4245872ac0c9\") " Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.117658 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/42f516f0-04ae-4acc-83dd-4245872ac0c9-config-data\") pod \"42f516f0-04ae-4acc-83dd-4245872ac0c9\" (UID: \"42f516f0-04ae-4acc-83dd-4245872ac0c9\") " Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.117690 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/42f516f0-04ae-4acc-83dd-4245872ac0c9-scripts\") pod \"42f516f0-04ae-4acc-83dd-4245872ac0c9\" (UID: \"42f516f0-04ae-4acc-83dd-4245872ac0c9\") " Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.117702 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42f516f0-04ae-4acc-83dd-4245872ac0c9-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "42f516f0-04ae-4acc-83dd-4245872ac0c9" (UID: "42f516f0-04ae-4acc-83dd-4245872ac0c9"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.117911 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/42f516f0-04ae-4acc-83dd-4245872ac0c9-combined-ca-bundle\") pod \"42f516f0-04ae-4acc-83dd-4245872ac0c9\" (UID: \"42f516f0-04ae-4acc-83dd-4245872ac0c9\") " Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.119695 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/42f516f0-04ae-4acc-83dd-4245872ac0c9-log-httpd\") pod \"42f516f0-04ae-4acc-83dd-4245872ac0c9\" (UID: \"42f516f0-04ae-4acc-83dd-4245872ac0c9\") " Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.120548 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/42f516f0-04ae-4acc-83dd-4245872ac0c9-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.123381 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/42f516f0-04ae-4acc-83dd-4245872ac0c9-scripts" (OuterVolumeSpecName: "scripts") pod "42f516f0-04ae-4acc-83dd-4245872ac0c9" (UID: "42f516f0-04ae-4acc-83dd-4245872ac0c9"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.125005 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42f516f0-04ae-4acc-83dd-4245872ac0c9-kube-api-access-2sbm7" (OuterVolumeSpecName: "kube-api-access-2sbm7") pod "42f516f0-04ae-4acc-83dd-4245872ac0c9" (UID: "42f516f0-04ae-4acc-83dd-4245872ac0c9"). InnerVolumeSpecName "kube-api-access-2sbm7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.127854 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42f516f0-04ae-4acc-83dd-4245872ac0c9-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "42f516f0-04ae-4acc-83dd-4245872ac0c9" (UID: "42f516f0-04ae-4acc-83dd-4245872ac0c9"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.140818 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/42f516f0-04ae-4acc-83dd-4245872ac0c9-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "42f516f0-04ae-4acc-83dd-4245872ac0c9" (UID: "42f516f0-04ae-4acc-83dd-4245872ac0c9"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.206386 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/42f516f0-04ae-4acc-83dd-4245872ac0c9-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "42f516f0-04ae-4acc-83dd-4245872ac0c9" (UID: "42f516f0-04ae-4acc-83dd-4245872ac0c9"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.222577 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/42f516f0-04ae-4acc-83dd-4245872ac0c9-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.222627 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/42f516f0-04ae-4acc-83dd-4245872ac0c9-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.222636 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/42f516f0-04ae-4acc-83dd-4245872ac0c9-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.222645 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2sbm7\" (UniqueName: \"kubernetes.io/projected/42f516f0-04ae-4acc-83dd-4245872ac0c9-kube-api-access-2sbm7\") on node \"crc\" DevicePath \"\"" Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.222656 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/42f516f0-04ae-4acc-83dd-4245872ac0c9-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.266746 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-8lrsq" Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.267220 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-8lrsq" event={"ID":"ff364e62-5da8-4005-89e0-48e3dbfa5222","Type":"ContainerDied","Data":"1dcea7f9f352279eaafb8ff529d9e29812173e8e5e4645aeed567dafdfbcab39"} Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.267271 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1dcea7f9f352279eaafb8ff529d9e29812173e8e5e4645aeed567dafdfbcab39" Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.274180 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"7e0d7a3d-971e-438a-b4de-702b49c20f0d","Type":"ContainerStarted","Data":"62635aed2fe142cf795473dae5c77f219fd51260c35ff8e6eb3056c6073497d4"} Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.282903 5120 generic.go:358] "Generic (PLEG): container finished" podID="42f516f0-04ae-4acc-83dd-4245872ac0c9" containerID="2636dbe8ef3da534a10254d81208e37ba5b17328c954ad683c9c53f30f7bb132" exitCode=0 Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.282929 5120 generic.go:358] "Generic (PLEG): container finished" podID="42f516f0-04ae-4acc-83dd-4245872ac0c9" containerID="eaf3a26e2353b85e4d76484c2dc9e0b3839d41444994942c2fd11311fe70f9b4" exitCode=2 Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.282937 5120 generic.go:358] "Generic (PLEG): container finished" podID="42f516f0-04ae-4acc-83dd-4245872ac0c9" containerID="cf4716dd0f71bf27f400a87b06ea844dfe76cfa671c68ed66f46925bdccf99f2" exitCode=0 Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.282943 5120 generic.go:358] "Generic (PLEG): container finished" podID="42f516f0-04ae-4acc-83dd-4245872ac0c9" containerID="e3708fe808135cd024acab9cceab38489fdc15b8e2f9c487c33960f4e6a6bf27" exitCode=0 Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.283224 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.283612 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"42f516f0-04ae-4acc-83dd-4245872ac0c9","Type":"ContainerDied","Data":"2636dbe8ef3da534a10254d81208e37ba5b17328c954ad683c9c53f30f7bb132"} Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.283636 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"42f516f0-04ae-4acc-83dd-4245872ac0c9","Type":"ContainerDied","Data":"eaf3a26e2353b85e4d76484c2dc9e0b3839d41444994942c2fd11311fe70f9b4"} Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.283659 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"42f516f0-04ae-4acc-83dd-4245872ac0c9","Type":"ContainerDied","Data":"cf4716dd0f71bf27f400a87b06ea844dfe76cfa671c68ed66f46925bdccf99f2"} Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.283667 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"42f516f0-04ae-4acc-83dd-4245872ac0c9","Type":"ContainerDied","Data":"e3708fe808135cd024acab9cceab38489fdc15b8e2f9c487c33960f4e6a6bf27"} Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.283675 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"42f516f0-04ae-4acc-83dd-4245872ac0c9","Type":"ContainerDied","Data":"e1017b5ee2c4ffa6fbbe029a9d56dca4e7c992b9218336ff126d9f3f3964e1b0"} Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.283689 5120 scope.go:117] "RemoveContainer" containerID="2636dbe8ef3da534a10254d81208e37ba5b17328c954ad683c9c53f30f7bb132" Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.295748 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/42f516f0-04ae-4acc-83dd-4245872ac0c9-config-data" (OuterVolumeSpecName: "config-data") pod "42f516f0-04ae-4acc-83dd-4245872ac0c9" (UID: "42f516f0-04ae-4acc-83dd-4245872ac0c9"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.326578 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/42f516f0-04ae-4acc-83dd-4245872ac0c9-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.355647 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-8lrsq"] Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.363621 5120 status_manager.go:895] "Failed to get status for pod" podUID="ff364e62-5da8-4005-89e0-48e3dbfa5222" pod="openstack-kuttl-tests/keystone-bootstrap-8lrsq" err="pods \"keystone-bootstrap-8lrsq\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.368335 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-8lrsq"] Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.374388 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-765f7c8474-fjhth"] Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.390032 5120 scope.go:117] "RemoveContainer" containerID="eaf3a26e2353b85e4d76484c2dc9e0b3839d41444994942c2fd11311fe70f9b4" Mar 16 16:08:04 crc kubenswrapper[5120]: W0316 16:08:04.394328 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1339c179_889a_4734_8a78_ccc684103c8a.slice/crio-3bb72298baef853bba4a41a1e835d50e6f85213ec124b9352d2a5c843566dadc WatchSource:0}: Error finding container 3bb72298baef853bba4a41a1e835d50e6f85213ec124b9352d2a5c843566dadc: Status 404 returned error can't find the container with id 3bb72298baef853bba4a41a1e835d50e6f85213ec124b9352d2a5c843566dadc Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.412803 5120 scope.go:117] "RemoveContainer" containerID="cf4716dd0f71bf27f400a87b06ea844dfe76cfa671c68ed66f46925bdccf99f2" Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.454589 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-qcgqn"] Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.456507 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42f516f0-04ae-4acc-83dd-4245872ac0c9" containerName="sg-core" Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.456527 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="42f516f0-04ae-4acc-83dd-4245872ac0c9" containerName="sg-core" Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.456557 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42f516f0-04ae-4acc-83dd-4245872ac0c9" containerName="proxy-httpd" Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.456563 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="42f516f0-04ae-4acc-83dd-4245872ac0c9" containerName="proxy-httpd" Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.456586 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff364e62-5da8-4005-89e0-48e3dbfa5222" containerName="keystone-bootstrap" Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.456594 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff364e62-5da8-4005-89e0-48e3dbfa5222" containerName="keystone-bootstrap" Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.456625 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42f516f0-04ae-4acc-83dd-4245872ac0c9" containerName="ceilometer-central-agent" Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.456631 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="42f516f0-04ae-4acc-83dd-4245872ac0c9" containerName="ceilometer-central-agent" Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.456641 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42f516f0-04ae-4acc-83dd-4245872ac0c9" containerName="ceilometer-notification-agent" Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.456647 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="42f516f0-04ae-4acc-83dd-4245872ac0c9" containerName="ceilometer-notification-agent" Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.457013 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="42f516f0-04ae-4acc-83dd-4245872ac0c9" containerName="sg-core" Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.457030 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="42f516f0-04ae-4acc-83dd-4245872ac0c9" containerName="ceilometer-central-agent" Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.457040 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ff364e62-5da8-4005-89e0-48e3dbfa5222" containerName="keystone-bootstrap" Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.457052 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="42f516f0-04ae-4acc-83dd-4245872ac0c9" containerName="proxy-httpd" Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.457060 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="42f516f0-04ae-4acc-83dd-4245872ac0c9" containerName="ceilometer-notification-agent" Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.462490 5120 scope.go:117] "RemoveContainer" containerID="e3708fe808135cd024acab9cceab38489fdc15b8e2f9c487c33960f4e6a6bf27" Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.471925 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-qcgqn" Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.474403 5120 status_manager.go:895] "Failed to get status for pod" podUID="ff364e62-5da8-4005-89e0-48e3dbfa5222" pod="openstack-kuttl-tests/keystone-bootstrap-8lrsq" err="pods \"keystone-bootstrap-8lrsq\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.475064 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-scripts\"" Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.476243 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-config-data\"" Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.476339 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone\"" Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.476421 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-keystone-dockercfg-h8dlj\"" Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.476565 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"osp-secret\"" Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.485543 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-qcgqn"] Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.519123 5120 scope.go:117] "RemoveContainer" containerID="2636dbe8ef3da534a10254d81208e37ba5b17328c954ad683c9c53f30f7bb132" Mar 16 16:08:04 crc kubenswrapper[5120]: E0316 16:08:04.524049 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2636dbe8ef3da534a10254d81208e37ba5b17328c954ad683c9c53f30f7bb132\": container with ID starting with 2636dbe8ef3da534a10254d81208e37ba5b17328c954ad683c9c53f30f7bb132 not found: ID does not exist" containerID="2636dbe8ef3da534a10254d81208e37ba5b17328c954ad683c9c53f30f7bb132" Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.524096 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2636dbe8ef3da534a10254d81208e37ba5b17328c954ad683c9c53f30f7bb132"} err="failed to get container status \"2636dbe8ef3da534a10254d81208e37ba5b17328c954ad683c9c53f30f7bb132\": rpc error: code = NotFound desc = could not find container \"2636dbe8ef3da534a10254d81208e37ba5b17328c954ad683c9c53f30f7bb132\": container with ID starting with 2636dbe8ef3da534a10254d81208e37ba5b17328c954ad683c9c53f30f7bb132 not found: ID does not exist" Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.524137 5120 scope.go:117] "RemoveContainer" containerID="eaf3a26e2353b85e4d76484c2dc9e0b3839d41444994942c2fd11311fe70f9b4" Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.525743 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-57f4878fd7-lxcgl"] Mar 16 16:08:04 crc kubenswrapper[5120]: E0316 16:08:04.526533 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eaf3a26e2353b85e4d76484c2dc9e0b3839d41444994942c2fd11311fe70f9b4\": container with ID starting with eaf3a26e2353b85e4d76484c2dc9e0b3839d41444994942c2fd11311fe70f9b4 not found: ID does not exist" containerID="eaf3a26e2353b85e4d76484c2dc9e0b3839d41444994942c2fd11311fe70f9b4" Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.526588 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eaf3a26e2353b85e4d76484c2dc9e0b3839d41444994942c2fd11311fe70f9b4"} err="failed to get container status \"eaf3a26e2353b85e4d76484c2dc9e0b3839d41444994942c2fd11311fe70f9b4\": rpc error: code = NotFound desc = could not find container \"eaf3a26e2353b85e4d76484c2dc9e0b3839d41444994942c2fd11311fe70f9b4\": container with ID starting with eaf3a26e2353b85e4d76484c2dc9e0b3839d41444994942c2fd11311fe70f9b4 not found: ID does not exist" Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.526613 5120 scope.go:117] "RemoveContainer" containerID="cf4716dd0f71bf27f400a87b06ea844dfe76cfa671c68ed66f46925bdccf99f2" Mar 16 16:08:04 crc kubenswrapper[5120]: E0316 16:08:04.527199 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cf4716dd0f71bf27f400a87b06ea844dfe76cfa671c68ed66f46925bdccf99f2\": container with ID starting with cf4716dd0f71bf27f400a87b06ea844dfe76cfa671c68ed66f46925bdccf99f2 not found: ID does not exist" containerID="cf4716dd0f71bf27f400a87b06ea844dfe76cfa671c68ed66f46925bdccf99f2" Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.527276 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf4716dd0f71bf27f400a87b06ea844dfe76cfa671c68ed66f46925bdccf99f2"} err="failed to get container status \"cf4716dd0f71bf27f400a87b06ea844dfe76cfa671c68ed66f46925bdccf99f2\": rpc error: code = NotFound desc = could not find container \"cf4716dd0f71bf27f400a87b06ea844dfe76cfa671c68ed66f46925bdccf99f2\": container with ID starting with cf4716dd0f71bf27f400a87b06ea844dfe76cfa671c68ed66f46925bdccf99f2 not found: ID does not exist" Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.527335 5120 scope.go:117] "RemoveContainer" containerID="e3708fe808135cd024acab9cceab38489fdc15b8e2f9c487c33960f4e6a6bf27" Mar 16 16:08:04 crc kubenswrapper[5120]: E0316 16:08:04.527652 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e3708fe808135cd024acab9cceab38489fdc15b8e2f9c487c33960f4e6a6bf27\": container with ID starting with e3708fe808135cd024acab9cceab38489fdc15b8e2f9c487c33960f4e6a6bf27 not found: ID does not exist" containerID="e3708fe808135cd024acab9cceab38489fdc15b8e2f9c487c33960f4e6a6bf27" Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.527687 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3708fe808135cd024acab9cceab38489fdc15b8e2f9c487c33960f4e6a6bf27"} err="failed to get container status \"e3708fe808135cd024acab9cceab38489fdc15b8e2f9c487c33960f4e6a6bf27\": rpc error: code = NotFound desc = could not find container \"e3708fe808135cd024acab9cceab38489fdc15b8e2f9c487c33960f4e6a6bf27\": container with ID starting with e3708fe808135cd024acab9cceab38489fdc15b8e2f9c487c33960f4e6a6bf27 not found: ID does not exist" Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.527719 5120 scope.go:117] "RemoveContainer" containerID="2636dbe8ef3da534a10254d81208e37ba5b17328c954ad683c9c53f30f7bb132" Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.528040 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2636dbe8ef3da534a10254d81208e37ba5b17328c954ad683c9c53f30f7bb132"} err="failed to get container status \"2636dbe8ef3da534a10254d81208e37ba5b17328c954ad683c9c53f30f7bb132\": rpc error: code = NotFound desc = could not find container \"2636dbe8ef3da534a10254d81208e37ba5b17328c954ad683c9c53f30f7bb132\": container with ID starting with 2636dbe8ef3da534a10254d81208e37ba5b17328c954ad683c9c53f30f7bb132 not found: ID does not exist" Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.528064 5120 scope.go:117] "RemoveContainer" containerID="eaf3a26e2353b85e4d76484c2dc9e0b3839d41444994942c2fd11311fe70f9b4" Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.528395 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eaf3a26e2353b85e4d76484c2dc9e0b3839d41444994942c2fd11311fe70f9b4"} err="failed to get container status \"eaf3a26e2353b85e4d76484c2dc9e0b3839d41444994942c2fd11311fe70f9b4\": rpc error: code = NotFound desc = could not find container \"eaf3a26e2353b85e4d76484c2dc9e0b3839d41444994942c2fd11311fe70f9b4\": container with ID starting with eaf3a26e2353b85e4d76484c2dc9e0b3839d41444994942c2fd11311fe70f9b4 not found: ID does not exist" Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.528426 5120 scope.go:117] "RemoveContainer" containerID="cf4716dd0f71bf27f400a87b06ea844dfe76cfa671c68ed66f46925bdccf99f2" Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.528610 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf4716dd0f71bf27f400a87b06ea844dfe76cfa671c68ed66f46925bdccf99f2"} err="failed to get container status \"cf4716dd0f71bf27f400a87b06ea844dfe76cfa671c68ed66f46925bdccf99f2\": rpc error: code = NotFound desc = could not find container \"cf4716dd0f71bf27f400a87b06ea844dfe76cfa671c68ed66f46925bdccf99f2\": container with ID starting with cf4716dd0f71bf27f400a87b06ea844dfe76cfa671c68ed66f46925bdccf99f2 not found: ID does not exist" Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.528628 5120 scope.go:117] "RemoveContainer" containerID="e3708fe808135cd024acab9cceab38489fdc15b8e2f9c487c33960f4e6a6bf27" Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.528903 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3708fe808135cd024acab9cceab38489fdc15b8e2f9c487c33960f4e6a6bf27"} err="failed to get container status \"e3708fe808135cd024acab9cceab38489fdc15b8e2f9c487c33960f4e6a6bf27\": rpc error: code = NotFound desc = could not find container \"e3708fe808135cd024acab9cceab38489fdc15b8e2f9c487c33960f4e6a6bf27\": container with ID starting with e3708fe808135cd024acab9cceab38489fdc15b8e2f9c487c33960f4e6a6bf27 not found: ID does not exist" Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.528926 5120 scope.go:117] "RemoveContainer" containerID="2636dbe8ef3da534a10254d81208e37ba5b17328c954ad683c9c53f30f7bb132" Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.529176 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2636dbe8ef3da534a10254d81208e37ba5b17328c954ad683c9c53f30f7bb132"} err="failed to get container status \"2636dbe8ef3da534a10254d81208e37ba5b17328c954ad683c9c53f30f7bb132\": rpc error: code = NotFound desc = could not find container \"2636dbe8ef3da534a10254d81208e37ba5b17328c954ad683c9c53f30f7bb132\": container with ID starting with 2636dbe8ef3da534a10254d81208e37ba5b17328c954ad683c9c53f30f7bb132 not found: ID does not exist" Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.529215 5120 scope.go:117] "RemoveContainer" containerID="eaf3a26e2353b85e4d76484c2dc9e0b3839d41444994942c2fd11311fe70f9b4" Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.529859 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eaf3a26e2353b85e4d76484c2dc9e0b3839d41444994942c2fd11311fe70f9b4"} err="failed to get container status \"eaf3a26e2353b85e4d76484c2dc9e0b3839d41444994942c2fd11311fe70f9b4\": rpc error: code = NotFound desc = could not find container \"eaf3a26e2353b85e4d76484c2dc9e0b3839d41444994942c2fd11311fe70f9b4\": container with ID starting with eaf3a26e2353b85e4d76484c2dc9e0b3839d41444994942c2fd11311fe70f9b4 not found: ID does not exist" Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.529886 5120 scope.go:117] "RemoveContainer" containerID="cf4716dd0f71bf27f400a87b06ea844dfe76cfa671c68ed66f46925bdccf99f2" Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.530099 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf4716dd0f71bf27f400a87b06ea844dfe76cfa671c68ed66f46925bdccf99f2"} err="failed to get container status \"cf4716dd0f71bf27f400a87b06ea844dfe76cfa671c68ed66f46925bdccf99f2\": rpc error: code = NotFound desc = could not find container \"cf4716dd0f71bf27f400a87b06ea844dfe76cfa671c68ed66f46925bdccf99f2\": container with ID starting with cf4716dd0f71bf27f400a87b06ea844dfe76cfa671c68ed66f46925bdccf99f2 not found: ID does not exist" Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.530119 5120 scope.go:117] "RemoveContainer" containerID="e3708fe808135cd024acab9cceab38489fdc15b8e2f9c487c33960f4e6a6bf27" Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.530423 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3708fe808135cd024acab9cceab38489fdc15b8e2f9c487c33960f4e6a6bf27"} err="failed to get container status \"e3708fe808135cd024acab9cceab38489fdc15b8e2f9c487c33960f4e6a6bf27\": rpc error: code = NotFound desc = could not find container \"e3708fe808135cd024acab9cceab38489fdc15b8e2f9c487c33960f4e6a6bf27\": container with ID starting with e3708fe808135cd024acab9cceab38489fdc15b8e2f9c487c33960f4e6a6bf27 not found: ID does not exist" Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.530466 5120 scope.go:117] "RemoveContainer" containerID="2636dbe8ef3da534a10254d81208e37ba5b17328c954ad683c9c53f30f7bb132" Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.535098 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a3634a26-805b-489d-9f26-36aef6f9239f-combined-ca-bundle\") pod \"keystone-bootstrap-qcgqn\" (UID: \"a3634a26-805b-489d-9f26-36aef6f9239f\") " pod="openstack-kuttl-tests/keystone-bootstrap-qcgqn" Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.535153 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a3634a26-805b-489d-9f26-36aef6f9239f-scripts\") pod \"keystone-bootstrap-qcgqn\" (UID: \"a3634a26-805b-489d-9f26-36aef6f9239f\") " pod="openstack-kuttl-tests/keystone-bootstrap-qcgqn" Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.535236 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/a3634a26-805b-489d-9f26-36aef6f9239f-credential-keys\") pod \"keystone-bootstrap-qcgqn\" (UID: \"a3634a26-805b-489d-9f26-36aef6f9239f\") " pod="openstack-kuttl-tests/keystone-bootstrap-qcgqn" Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.535296 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a3634a26-805b-489d-9f26-36aef6f9239f-config-data\") pod \"keystone-bootstrap-qcgqn\" (UID: \"a3634a26-805b-489d-9f26-36aef6f9239f\") " pod="openstack-kuttl-tests/keystone-bootstrap-qcgqn" Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.535334 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47kvd\" (UniqueName: \"kubernetes.io/projected/a3634a26-805b-489d-9f26-36aef6f9239f-kube-api-access-47kvd\") pod \"keystone-bootstrap-qcgqn\" (UID: \"a3634a26-805b-489d-9f26-36aef6f9239f\") " pod="openstack-kuttl-tests/keystone-bootstrap-qcgqn" Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.538426 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/a3634a26-805b-489d-9f26-36aef6f9239f-fernet-keys\") pod \"keystone-bootstrap-qcgqn\" (UID: \"a3634a26-805b-489d-9f26-36aef6f9239f\") " pod="openstack-kuttl-tests/keystone-bootstrap-qcgqn" Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.549190 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2636dbe8ef3da534a10254d81208e37ba5b17328c954ad683c9c53f30f7bb132"} err="failed to get container status \"2636dbe8ef3da534a10254d81208e37ba5b17328c954ad683c9c53f30f7bb132\": rpc error: code = NotFound desc = could not find container \"2636dbe8ef3da534a10254d81208e37ba5b17328c954ad683c9c53f30f7bb132\": container with ID starting with 2636dbe8ef3da534a10254d81208e37ba5b17328c954ad683c9c53f30f7bb132 not found: ID does not exist" Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.549259 5120 scope.go:117] "RemoveContainer" containerID="eaf3a26e2353b85e4d76484c2dc9e0b3839d41444994942c2fd11311fe70f9b4" Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.550127 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eaf3a26e2353b85e4d76484c2dc9e0b3839d41444994942c2fd11311fe70f9b4"} err="failed to get container status \"eaf3a26e2353b85e4d76484c2dc9e0b3839d41444994942c2fd11311fe70f9b4\": rpc error: code = NotFound desc = could not find container \"eaf3a26e2353b85e4d76484c2dc9e0b3839d41444994942c2fd11311fe70f9b4\": container with ID starting with eaf3a26e2353b85e4d76484c2dc9e0b3839d41444994942c2fd11311fe70f9b4 not found: ID does not exist" Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.550164 5120 scope.go:117] "RemoveContainer" containerID="cf4716dd0f71bf27f400a87b06ea844dfe76cfa671c68ed66f46925bdccf99f2" Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.550718 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf4716dd0f71bf27f400a87b06ea844dfe76cfa671c68ed66f46925bdccf99f2"} err="failed to get container status \"cf4716dd0f71bf27f400a87b06ea844dfe76cfa671c68ed66f46925bdccf99f2\": rpc error: code = NotFound desc = could not find container \"cf4716dd0f71bf27f400a87b06ea844dfe76cfa671c68ed66f46925bdccf99f2\": container with ID starting with cf4716dd0f71bf27f400a87b06ea844dfe76cfa671c68ed66f46925bdccf99f2 not found: ID does not exist" Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.550800 5120 scope.go:117] "RemoveContainer" containerID="e3708fe808135cd024acab9cceab38489fdc15b8e2f9c487c33960f4e6a6bf27" Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.551379 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3708fe808135cd024acab9cceab38489fdc15b8e2f9c487c33960f4e6a6bf27"} err="failed to get container status \"e3708fe808135cd024acab9cceab38489fdc15b8e2f9c487c33960f4e6a6bf27\": rpc error: code = NotFound desc = could not find container \"e3708fe808135cd024acab9cceab38489fdc15b8e2f9c487c33960f4e6a6bf27\": container with ID starting with e3708fe808135cd024acab9cceab38489fdc15b8e2f9c487c33960f4e6a6bf27 not found: ID does not exist" Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.612961 5120 status_manager.go:895] "Failed to get status for pod" podUID="ff364e62-5da8-4005-89e0-48e3dbfa5222" pod="openstack-kuttl-tests/keystone-bootstrap-8lrsq" err="pods \"keystone-bootstrap-8lrsq\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.650634 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.651673 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/a3634a26-805b-489d-9f26-36aef6f9239f-fernet-keys\") pod \"keystone-bootstrap-qcgqn\" (UID: \"a3634a26-805b-489d-9f26-36aef6f9239f\") " pod="openstack-kuttl-tests/keystone-bootstrap-qcgqn" Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.651800 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a3634a26-805b-489d-9f26-36aef6f9239f-combined-ca-bundle\") pod \"keystone-bootstrap-qcgqn\" (UID: \"a3634a26-805b-489d-9f26-36aef6f9239f\") " pod="openstack-kuttl-tests/keystone-bootstrap-qcgqn" Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.651848 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a3634a26-805b-489d-9f26-36aef6f9239f-scripts\") pod \"keystone-bootstrap-qcgqn\" (UID: \"a3634a26-805b-489d-9f26-36aef6f9239f\") " pod="openstack-kuttl-tests/keystone-bootstrap-qcgqn" Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.651953 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/a3634a26-805b-489d-9f26-36aef6f9239f-credential-keys\") pod \"keystone-bootstrap-qcgqn\" (UID: \"a3634a26-805b-489d-9f26-36aef6f9239f\") " pod="openstack-kuttl-tests/keystone-bootstrap-qcgqn" Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.652022 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a3634a26-805b-489d-9f26-36aef6f9239f-config-data\") pod \"keystone-bootstrap-qcgqn\" (UID: \"a3634a26-805b-489d-9f26-36aef6f9239f\") " pod="openstack-kuttl-tests/keystone-bootstrap-qcgqn" Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.652090 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-47kvd\" (UniqueName: \"kubernetes.io/projected/a3634a26-805b-489d-9f26-36aef6f9239f-kube-api-access-47kvd\") pod \"keystone-bootstrap-qcgqn\" (UID: \"a3634a26-805b-489d-9f26-36aef6f9239f\") " pod="openstack-kuttl-tests/keystone-bootstrap-qcgqn" Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.658046 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/a3634a26-805b-489d-9f26-36aef6f9239f-fernet-keys\") pod \"keystone-bootstrap-qcgqn\" (UID: \"a3634a26-805b-489d-9f26-36aef6f9239f\") " pod="openstack-kuttl-tests/keystone-bootstrap-qcgqn" Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.659363 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a3634a26-805b-489d-9f26-36aef6f9239f-combined-ca-bundle\") pod \"keystone-bootstrap-qcgqn\" (UID: \"a3634a26-805b-489d-9f26-36aef6f9239f\") " pod="openstack-kuttl-tests/keystone-bootstrap-qcgqn" Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.659523 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a3634a26-805b-489d-9f26-36aef6f9239f-scripts\") pod \"keystone-bootstrap-qcgqn\" (UID: \"a3634a26-805b-489d-9f26-36aef6f9239f\") " pod="openstack-kuttl-tests/keystone-bootstrap-qcgqn" Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.662035 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/a3634a26-805b-489d-9f26-36aef6f9239f-credential-keys\") pod \"keystone-bootstrap-qcgqn\" (UID: \"a3634a26-805b-489d-9f26-36aef6f9239f\") " pod="openstack-kuttl-tests/keystone-bootstrap-qcgqn" Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.667331 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a3634a26-805b-489d-9f26-36aef6f9239f-config-data\") pod \"keystone-bootstrap-qcgqn\" (UID: \"a3634a26-805b-489d-9f26-36aef6f9239f\") " pod="openstack-kuttl-tests/keystone-bootstrap-qcgqn" Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.681553 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-47kvd\" (UniqueName: \"kubernetes.io/projected/a3634a26-805b-489d-9f26-36aef6f9239f-kube-api-access-47kvd\") pod \"keystone-bootstrap-qcgqn\" (UID: \"a3634a26-805b-489d-9f26-36aef6f9239f\") " pod="openstack-kuttl-tests/keystone-bootstrap-qcgqn" Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.688000 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f8d91b46-e486-4be8-ad35-2c9d3d8fb671" path="/var/lib/kubelet/pods/f8d91b46-e486-4be8-ad35-2c9d3d8fb671/volumes" Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.688903 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ff364e62-5da8-4005-89e0-48e3dbfa5222" path="/var/lib/kubelet/pods/ff364e62-5da8-4005-89e0-48e3dbfa5222/volumes" Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.699540 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.708495 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.739080 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.739222 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.744372 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.744844 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.788301 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-qcgqn" Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.810186 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-6877f8555d-c7rkf"] Mar 16 16:08:04 crc kubenswrapper[5120]: W0316 16:08:04.825735 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcbc2cc5a_7563_470f_8e52_9db1448b2669.slice/crio-c6eda61aadc858e01fb1a3d48fb580257c690b96ff81f465ce4f1efd1f776a88 WatchSource:0}: Error finding container c6eda61aadc858e01fb1a3d48fb580257c690b96ff81f465ce4f1efd1f776a88: Status 404 returned error can't find the container with id c6eda61aadc858e01fb1a3d48fb580257c690b96ff81f465ce4f1efd1f776a88 Mar 16 16:08:04 crc kubenswrapper[5120]: I0316 16:08:04.834222 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561288-b6gpk" Mar 16 16:08:05 crc kubenswrapper[5120]: I0316 16:08:05.273224 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t7vqd\" (UniqueName: \"kubernetes.io/projected/b4e69343-fd94-436a-b5ab-dcc02f48c06b-kube-api-access-t7vqd\") pod \"b4e69343-fd94-436a-b5ab-dcc02f48c06b\" (UID: \"b4e69343-fd94-436a-b5ab-dcc02f48c06b\") " Mar 16 16:08:05 crc kubenswrapper[5120]: I0316 16:08:05.273483 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/b0c8669e-9bed-4d78-b8aa-2387c52883dc-log-httpd\") pod \"ceilometer-0\" (UID: \"b0c8669e-9bed-4d78-b8aa-2387c52883dc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:08:05 crc kubenswrapper[5120]: I0316 16:08:05.273507 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/b0c8669e-9bed-4d78-b8aa-2387c52883dc-run-httpd\") pod \"ceilometer-0\" (UID: \"b0c8669e-9bed-4d78-b8aa-2387c52883dc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:08:05 crc kubenswrapper[5120]: I0316 16:08:05.273546 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b0c8669e-9bed-4d78-b8aa-2387c52883dc-config-data\") pod \"ceilometer-0\" (UID: \"b0c8669e-9bed-4d78-b8aa-2387c52883dc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:08:05 crc kubenswrapper[5120]: I0316 16:08:05.273579 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prdkt\" (UniqueName: \"kubernetes.io/projected/b0c8669e-9bed-4d78-b8aa-2387c52883dc-kube-api-access-prdkt\") pod \"ceilometer-0\" (UID: \"b0c8669e-9bed-4d78-b8aa-2387c52883dc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:08:05 crc kubenswrapper[5120]: I0316 16:08:05.273627 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/b0c8669e-9bed-4d78-b8aa-2387c52883dc-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"b0c8669e-9bed-4d78-b8aa-2387c52883dc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:08:05 crc kubenswrapper[5120]: I0316 16:08:05.273658 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b0c8669e-9bed-4d78-b8aa-2387c52883dc-scripts\") pod \"ceilometer-0\" (UID: \"b0c8669e-9bed-4d78-b8aa-2387c52883dc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:08:05 crc kubenswrapper[5120]: I0316 16:08:05.273829 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b0c8669e-9bed-4d78-b8aa-2387c52883dc-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"b0c8669e-9bed-4d78-b8aa-2387c52883dc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:08:05 crc kubenswrapper[5120]: I0316 16:08:05.287956 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4e69343-fd94-436a-b5ab-dcc02f48c06b-kube-api-access-t7vqd" (OuterVolumeSpecName: "kube-api-access-t7vqd") pod "b4e69343-fd94-436a-b5ab-dcc02f48c06b" (UID: "b4e69343-fd94-436a-b5ab-dcc02f48c06b"). InnerVolumeSpecName "kube-api-access-t7vqd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:08:05 crc kubenswrapper[5120]: I0316 16:08:05.325118 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-765f7c8474-fjhth" event={"ID":"1339c179-889a-4734-8a78-ccc684103c8a","Type":"ContainerStarted","Data":"80420b2ef2a986e48e3d4bd9a977534343b5d7ce81ba0dcd2c2a0107bc2e7383"} Mar 16 16:08:05 crc kubenswrapper[5120]: I0316 16:08:05.325282 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-765f7c8474-fjhth" event={"ID":"1339c179-889a-4734-8a78-ccc684103c8a","Type":"ContainerStarted","Data":"3bb72298baef853bba4a41a1e835d50e6f85213ec124b9352d2a5c843566dadc"} Mar 16 16:08:05 crc kubenswrapper[5120]: I0316 16:08:05.346021 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-df4bb598-d5scs"] Mar 16 16:08:05 crc kubenswrapper[5120]: I0316 16:08:05.354184 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:08:05 crc kubenswrapper[5120]: I0316 16:08:05.360103 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561288-b6gpk" event={"ID":"b4e69343-fd94-436a-b5ab-dcc02f48c06b","Type":"ContainerDied","Data":"be4ee7721f7d71baff5d5dc7f5961973d46f5690edc3aee2bb4142c9dbf4f9d1"} Mar 16 16:08:05 crc kubenswrapper[5120]: I0316 16:08:05.360135 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="be4ee7721f7d71baff5d5dc7f5961973d46f5690edc3aee2bb4142c9dbf4f9d1" Mar 16 16:08:05 crc kubenswrapper[5120]: I0316 16:08:05.360195 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561288-b6gpk" Mar 16 16:08:05 crc kubenswrapper[5120]: I0316 16:08:05.363325 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-57f4878fd7-lxcgl" event={"ID":"8f5b15fe-8fe8-40b3-b546-351cbd1bcd9e","Type":"ContainerStarted","Data":"250d96f1a254f198dbeb6c27eac08ebb3daa423871a4e136fd45e251bd0d5c6f"} Mar 16 16:08:05 crc kubenswrapper[5120]: I0316 16:08:05.369628 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-6877f8555d-c7rkf" event={"ID":"cbc2cc5a-7563-470f-8e52-9db1448b2669","Type":"ContainerStarted","Data":"c6eda61aadc858e01fb1a3d48fb580257c690b96ff81f465ce4f1efd1f776a88"} Mar 16 16:08:05 crc kubenswrapper[5120]: I0316 16:08:05.370950 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"7e0d7a3d-971e-438a-b4de-702b49c20f0d","Type":"ContainerStarted","Data":"4a8771b3412fc9a1671ab83c880c09c103f113f8fb725989a45041e0a4345e69"} Mar 16 16:08:05 crc kubenswrapper[5120]: I0316 16:08:05.382836 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b0c8669e-9bed-4d78-b8aa-2387c52883dc-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"b0c8669e-9bed-4d78-b8aa-2387c52883dc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:08:05 crc kubenswrapper[5120]: I0316 16:08:05.382927 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/b0c8669e-9bed-4d78-b8aa-2387c52883dc-log-httpd\") pod \"ceilometer-0\" (UID: \"b0c8669e-9bed-4d78-b8aa-2387c52883dc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:08:05 crc kubenswrapper[5120]: I0316 16:08:05.382949 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/b0c8669e-9bed-4d78-b8aa-2387c52883dc-run-httpd\") pod \"ceilometer-0\" (UID: \"b0c8669e-9bed-4d78-b8aa-2387c52883dc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:08:05 crc kubenswrapper[5120]: I0316 16:08:05.382987 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b0c8669e-9bed-4d78-b8aa-2387c52883dc-config-data\") pod \"ceilometer-0\" (UID: \"b0c8669e-9bed-4d78-b8aa-2387c52883dc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:08:05 crc kubenswrapper[5120]: I0316 16:08:05.383019 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-prdkt\" (UniqueName: \"kubernetes.io/projected/b0c8669e-9bed-4d78-b8aa-2387c52883dc-kube-api-access-prdkt\") pod \"ceilometer-0\" (UID: \"b0c8669e-9bed-4d78-b8aa-2387c52883dc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:08:05 crc kubenswrapper[5120]: I0316 16:08:05.383048 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/b0c8669e-9bed-4d78-b8aa-2387c52883dc-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"b0c8669e-9bed-4d78-b8aa-2387c52883dc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:08:05 crc kubenswrapper[5120]: I0316 16:08:05.383080 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b0c8669e-9bed-4d78-b8aa-2387c52883dc-scripts\") pod \"ceilometer-0\" (UID: \"b0c8669e-9bed-4d78-b8aa-2387c52883dc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:08:05 crc kubenswrapper[5120]: I0316 16:08:05.383189 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t7vqd\" (UniqueName: \"kubernetes.io/projected/b4e69343-fd94-436a-b5ab-dcc02f48c06b-kube-api-access-t7vqd\") on node \"crc\" DevicePath \"\"" Mar 16 16:08:05 crc kubenswrapper[5120]: I0316 16:08:05.389244 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/b0c8669e-9bed-4d78-b8aa-2387c52883dc-run-httpd\") pod \"ceilometer-0\" (UID: \"b0c8669e-9bed-4d78-b8aa-2387c52883dc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:08:05 crc kubenswrapper[5120]: I0316 16:08:05.389522 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b0c8669e-9bed-4d78-b8aa-2387c52883dc-scripts\") pod \"ceilometer-0\" (UID: \"b0c8669e-9bed-4d78-b8aa-2387c52883dc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:08:05 crc kubenswrapper[5120]: I0316 16:08:05.391279 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/b0c8669e-9bed-4d78-b8aa-2387c52883dc-log-httpd\") pod \"ceilometer-0\" (UID: \"b0c8669e-9bed-4d78-b8aa-2387c52883dc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:08:05 crc kubenswrapper[5120]: I0316 16:08:05.400253 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/b0c8669e-9bed-4d78-b8aa-2387c52883dc-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"b0c8669e-9bed-4d78-b8aa-2387c52883dc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:08:05 crc kubenswrapper[5120]: I0316 16:08:05.412389 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b0c8669e-9bed-4d78-b8aa-2387c52883dc-config-data\") pod \"ceilometer-0\" (UID: \"b0c8669e-9bed-4d78-b8aa-2387c52883dc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:08:05 crc kubenswrapper[5120]: W0316 16:08:05.417355 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod39058b27_360b_4aa6_b04b_d415e907df29.slice/crio-beb47fe150cb72dac728a1eb20ded24a0cf421857bbe5f944d70d83d415380b6 WatchSource:0}: Error finding container beb47fe150cb72dac728a1eb20ded24a0cf421857bbe5f944d70d83d415380b6: Status 404 returned error can't find the container with id beb47fe150cb72dac728a1eb20ded24a0cf421857bbe5f944d70d83d415380b6 Mar 16 16:08:05 crc kubenswrapper[5120]: I0316 16:08:05.420296 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b0c8669e-9bed-4d78-b8aa-2387c52883dc-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"b0c8669e-9bed-4d78-b8aa-2387c52883dc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:08:05 crc kubenswrapper[5120]: I0316 16:08:05.420567 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-prdkt\" (UniqueName: \"kubernetes.io/projected/b0c8669e-9bed-4d78-b8aa-2387c52883dc-kube-api-access-prdkt\") pod \"ceilometer-0\" (UID: \"b0c8669e-9bed-4d78-b8aa-2387c52883dc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:08:05 crc kubenswrapper[5120]: I0316 16:08:05.688913 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:08:05 crc kubenswrapper[5120]: I0316 16:08:05.719162 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-qcgqn"] Mar 16 16:08:06 crc kubenswrapper[5120]: I0316 16:08:06.221317 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:08:06 crc kubenswrapper[5120]: I0316 16:08:06.392971 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-infra/auto-csr-approver-29561282-7mmmh"] Mar 16 16:08:06 crc kubenswrapper[5120]: I0316 16:08:06.401415 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-infra/auto-csr-approver-29561282-7mmmh"] Mar 16 16:08:06 crc kubenswrapper[5120]: I0316 16:08:06.404781 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-765f7c8474-fjhth" event={"ID":"1339c179-889a-4734-8a78-ccc684103c8a","Type":"ContainerStarted","Data":"95d11f790bf0c2a9ba49fa9fd181a60d7ff9b6173550d60af6bf33986a6ad151"} Mar 16 16:08:06 crc kubenswrapper[5120]: I0316 16:08:06.410039 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"b0c8669e-9bed-4d78-b8aa-2387c52883dc","Type":"ContainerStarted","Data":"b2935213d7656084dd33cfa6ebf711308bdc13f55c6a63059287c4975ae01a24"} Mar 16 16:08:06 crc kubenswrapper[5120]: I0316 16:08:06.411788 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-qcgqn" event={"ID":"a3634a26-805b-489d-9f26-36aef6f9239f","Type":"ContainerStarted","Data":"bfe7238fdbbf7d4fefe2181f3c7d19e051d2f95564a4bd73db5a8da5df6bca9b"} Mar 16 16:08:06 crc kubenswrapper[5120]: I0316 16:08:06.411836 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-qcgqn" event={"ID":"a3634a26-805b-489d-9f26-36aef6f9239f","Type":"ContainerStarted","Data":"c99cc3e08f5cc469558a9e3f497a5bd9158860dad0845bd5d2bda56d25c2912d"} Mar 16 16:08:06 crc kubenswrapper[5120]: I0316 16:08:06.428697 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-df4bb598-d5scs" event={"ID":"39058b27-360b-4aa6-b04b-d415e907df29","Type":"ContainerStarted","Data":"37e194ad8a30a98af1597f7dce377c841c508bbfe625e5ee61e2d2b7fe21cd14"} Mar 16 16:08:06 crc kubenswrapper[5120]: I0316 16:08:06.428746 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-df4bb598-d5scs" event={"ID":"39058b27-360b-4aa6-b04b-d415e907df29","Type":"ContainerStarted","Data":"908ac0ddea49d57cf17d783feebfb997e6d915e4bf8fda0f394d64bfc625357a"} Mar 16 16:08:06 crc kubenswrapper[5120]: I0316 16:08:06.428756 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-df4bb598-d5scs" event={"ID":"39058b27-360b-4aa6-b04b-d415e907df29","Type":"ContainerStarted","Data":"beb47fe150cb72dac728a1eb20ded24a0cf421857bbe5f944d70d83d415380b6"} Mar 16 16:08:06 crc kubenswrapper[5120]: I0316 16:08:06.429049 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-df4bb598-d5scs" Mar 16 16:08:06 crc kubenswrapper[5120]: I0316 16:08:06.429476 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-df4bb598-d5scs" Mar 16 16:08:06 crc kubenswrapper[5120]: I0316 16:08:06.455402 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-keystone-listener-765f7c8474-fjhth" podStartSLOduration=3.455385467 podStartE2EDuration="3.455385467s" podCreationTimestamp="2026-03-16 16:08:03 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:08:06.4221316 +0000 UTC m=+2188.576063257" watchObservedRunningTime="2026-03-16 16:08:06.455385467 +0000 UTC m=+2188.609317124" Mar 16 16:08:06 crc kubenswrapper[5120]: I0316 16:08:06.463883 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-bootstrap-qcgqn" podStartSLOduration=2.463818007 podStartE2EDuration="2.463818007s" podCreationTimestamp="2026-03-16 16:08:04 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:08:06.449896267 +0000 UTC m=+2188.603827924" watchObservedRunningTime="2026-03-16 16:08:06.463818007 +0000 UTC m=+2188.617749654" Mar 16 16:08:06 crc kubenswrapper[5120]: I0316 16:08:06.485340 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-57f4878fd7-lxcgl" event={"ID":"8f5b15fe-8fe8-40b3-b546-351cbd1bcd9e","Type":"ContainerStarted","Data":"ff0cc891023bde91631dcefae737dc009401ca109960f5b3141e38337b4cbd9a"} Mar 16 16:08:06 crc kubenswrapper[5120]: I0316 16:08:06.485388 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-57f4878fd7-lxcgl" event={"ID":"8f5b15fe-8fe8-40b3-b546-351cbd1bcd9e","Type":"ContainerStarted","Data":"c95bbb28388887138f78292e51f23f55c27b0502f92ef4d75dbee96f4c389106"} Mar 16 16:08:06 crc kubenswrapper[5120]: I0316 16:08:06.488084 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-df4bb598-d5scs" podStartSLOduration=3.48806242 podStartE2EDuration="3.48806242s" podCreationTimestamp="2026-03-16 16:08:03 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:08:06.483908706 +0000 UTC m=+2188.637840353" watchObservedRunningTime="2026-03-16 16:08:06.48806242 +0000 UTC m=+2188.641994077" Mar 16 16:08:06 crc kubenswrapper[5120]: I0316 16:08:06.495904 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-6877f8555d-c7rkf" event={"ID":"cbc2cc5a-7563-470f-8e52-9db1448b2669","Type":"ContainerStarted","Data":"f747953ede284c55b3bb324d98468d5b79d84c2792253cb155bd5bc0d697b958"} Mar 16 16:08:06 crc kubenswrapper[5120]: I0316 16:08:06.495967 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-6877f8555d-c7rkf" event={"ID":"cbc2cc5a-7563-470f-8e52-9db1448b2669","Type":"ContainerStarted","Data":"7bd798d237201adbb2f16896bd4fc9a684e30f05923ed8468e74a41f9b0f0c18"} Mar 16 16:08:06 crc kubenswrapper[5120]: I0316 16:08:06.496650 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-6877f8555d-c7rkf" Mar 16 16:08:06 crc kubenswrapper[5120]: I0316 16:08:06.496688 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-6877f8555d-c7rkf" Mar 16 16:08:06 crc kubenswrapper[5120]: I0316 16:08:06.504840 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"c5593ae2-7a56-4d09-8f88-a54b43c2be0c","Type":"ContainerStarted","Data":"047eec0013cada9bc1768aac8af82d95870075ec52f3cdcb2d119a77a1b49356"} Mar 16 16:08:06 crc kubenswrapper[5120]: I0316 16:08:06.504882 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"c5593ae2-7a56-4d09-8f88-a54b43c2be0c","Type":"ContainerStarted","Data":"5d0993f4849a9d3c1208effceeb03313bc60bf156a675ba90c5efd1c336fc40a"} Mar 16 16:08:06 crc kubenswrapper[5120]: I0316 16:08:06.515938 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"7e0d7a3d-971e-438a-b4de-702b49c20f0d","Type":"ContainerStarted","Data":"305602f49b8bc5828166013f91c905447c75c4e1d4f76c99bc2f070df93fd919"} Mar 16 16:08:06 crc kubenswrapper[5120]: I0316 16:08:06.520508 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-worker-57f4878fd7-lxcgl" podStartSLOduration=3.520483754 podStartE2EDuration="3.520483754s" podCreationTimestamp="2026-03-16 16:08:03 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:08:06.515193919 +0000 UTC m=+2188.669125576" watchObservedRunningTime="2026-03-16 16:08:06.520483754 +0000 UTC m=+2188.674415451" Mar 16 16:08:06 crc kubenswrapper[5120]: I0316 16:08:06.544288 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-api-6877f8555d-c7rkf" podStartSLOduration=3.544266903 podStartE2EDuration="3.544266903s" podCreationTimestamp="2026-03-16 16:08:03 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:08:06.537495828 +0000 UTC m=+2188.691427485" watchObservedRunningTime="2026-03-16 16:08:06.544266903 +0000 UTC m=+2188.698198560" Mar 16 16:08:06 crc kubenswrapper[5120]: I0316 16:08:06.571983 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-external-api-0" podStartSLOduration=4.571962138 podStartE2EDuration="4.571962138s" podCreationTimestamp="2026-03-16 16:08:02 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:08:06.562110199 +0000 UTC m=+2188.716041876" watchObservedRunningTime="2026-03-16 16:08:06.571962138 +0000 UTC m=+2188.725893795" Mar 16 16:08:06 crc kubenswrapper[5120]: I0316 16:08:06.704630 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="42f516f0-04ae-4acc-83dd-4245872ac0c9" path="/var/lib/kubelet/pods/42f516f0-04ae-4acc-83dd-4245872ac0c9/volumes" Mar 16 16:08:06 crc kubenswrapper[5120]: I0316 16:08:06.705456 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a4260b1-b93d-446f-80f7-63725b47a94e" path="/var/lib/kubelet/pods/8a4260b1-b93d-446f-80f7-63725b47a94e/volumes" Mar 16 16:08:06 crc kubenswrapper[5120]: I0316 16:08:06.706204 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-api-57f8f7777b-s7zn5"] Mar 16 16:08:06 crc kubenswrapper[5120]: I0316 16:08:06.707943 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4e69343-fd94-436a-b5ab-dcc02f48c06b" containerName="oc" Mar 16 16:08:06 crc kubenswrapper[5120]: I0316 16:08:06.707967 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4e69343-fd94-436a-b5ab-dcc02f48c06b" containerName="oc" Mar 16 16:08:06 crc kubenswrapper[5120]: I0316 16:08:06.708163 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="b4e69343-fd94-436a-b5ab-dcc02f48c06b" containerName="oc" Mar 16 16:08:06 crc kubenswrapper[5120]: I0316 16:08:06.720436 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-57f8f7777b-s7zn5"] Mar 16 16:08:06 crc kubenswrapper[5120]: I0316 16:08:06.720582 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-57f8f7777b-s7zn5" Mar 16 16:08:06 crc kubenswrapper[5120]: I0316 16:08:06.724385 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-barbican-internal-svc\"" Mar 16 16:08:06 crc kubenswrapper[5120]: I0316 16:08:06.725638 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-barbican-public-svc\"" Mar 16 16:08:06 crc kubenswrapper[5120]: I0316 16:08:06.822212 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/c04f4eb6-ad5d-4996-a59e-c26968e5439a-config-data-custom\") pod \"barbican-api-57f8f7777b-s7zn5\" (UID: \"c04f4eb6-ad5d-4996-a59e-c26968e5439a\") " pod="openstack-kuttl-tests/barbican-api-57f8f7777b-s7zn5" Mar 16 16:08:06 crc kubenswrapper[5120]: I0316 16:08:06.822313 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/c04f4eb6-ad5d-4996-a59e-c26968e5439a-public-tls-certs\") pod \"barbican-api-57f8f7777b-s7zn5\" (UID: \"c04f4eb6-ad5d-4996-a59e-c26968e5439a\") " pod="openstack-kuttl-tests/barbican-api-57f8f7777b-s7zn5" Mar 16 16:08:06 crc kubenswrapper[5120]: I0316 16:08:06.822505 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c04f4eb6-ad5d-4996-a59e-c26968e5439a-combined-ca-bundle\") pod \"barbican-api-57f8f7777b-s7zn5\" (UID: \"c04f4eb6-ad5d-4996-a59e-c26968e5439a\") " pod="openstack-kuttl-tests/barbican-api-57f8f7777b-s7zn5" Mar 16 16:08:06 crc kubenswrapper[5120]: I0316 16:08:06.822540 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xspgj\" (UniqueName: \"kubernetes.io/projected/c04f4eb6-ad5d-4996-a59e-c26968e5439a-kube-api-access-xspgj\") pod \"barbican-api-57f8f7777b-s7zn5\" (UID: \"c04f4eb6-ad5d-4996-a59e-c26968e5439a\") " pod="openstack-kuttl-tests/barbican-api-57f8f7777b-s7zn5" Mar 16 16:08:06 crc kubenswrapper[5120]: I0316 16:08:06.822556 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/c04f4eb6-ad5d-4996-a59e-c26968e5439a-internal-tls-certs\") pod \"barbican-api-57f8f7777b-s7zn5\" (UID: \"c04f4eb6-ad5d-4996-a59e-c26968e5439a\") " pod="openstack-kuttl-tests/barbican-api-57f8f7777b-s7zn5" Mar 16 16:08:06 crc kubenswrapper[5120]: I0316 16:08:06.822608 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c04f4eb6-ad5d-4996-a59e-c26968e5439a-config-data\") pod \"barbican-api-57f8f7777b-s7zn5\" (UID: \"c04f4eb6-ad5d-4996-a59e-c26968e5439a\") " pod="openstack-kuttl-tests/barbican-api-57f8f7777b-s7zn5" Mar 16 16:08:06 crc kubenswrapper[5120]: I0316 16:08:06.822671 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c04f4eb6-ad5d-4996-a59e-c26968e5439a-logs\") pod \"barbican-api-57f8f7777b-s7zn5\" (UID: \"c04f4eb6-ad5d-4996-a59e-c26968e5439a\") " pod="openstack-kuttl-tests/barbican-api-57f8f7777b-s7zn5" Mar 16 16:08:06 crc kubenswrapper[5120]: I0316 16:08:06.924117 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c04f4eb6-ad5d-4996-a59e-c26968e5439a-combined-ca-bundle\") pod \"barbican-api-57f8f7777b-s7zn5\" (UID: \"c04f4eb6-ad5d-4996-a59e-c26968e5439a\") " pod="openstack-kuttl-tests/barbican-api-57f8f7777b-s7zn5" Mar 16 16:08:06 crc kubenswrapper[5120]: I0316 16:08:06.924181 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xspgj\" (UniqueName: \"kubernetes.io/projected/c04f4eb6-ad5d-4996-a59e-c26968e5439a-kube-api-access-xspgj\") pod \"barbican-api-57f8f7777b-s7zn5\" (UID: \"c04f4eb6-ad5d-4996-a59e-c26968e5439a\") " pod="openstack-kuttl-tests/barbican-api-57f8f7777b-s7zn5" Mar 16 16:08:06 crc kubenswrapper[5120]: I0316 16:08:06.924225 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/c04f4eb6-ad5d-4996-a59e-c26968e5439a-internal-tls-certs\") pod \"barbican-api-57f8f7777b-s7zn5\" (UID: \"c04f4eb6-ad5d-4996-a59e-c26968e5439a\") " pod="openstack-kuttl-tests/barbican-api-57f8f7777b-s7zn5" Mar 16 16:08:06 crc kubenswrapper[5120]: I0316 16:08:06.924260 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c04f4eb6-ad5d-4996-a59e-c26968e5439a-config-data\") pod \"barbican-api-57f8f7777b-s7zn5\" (UID: \"c04f4eb6-ad5d-4996-a59e-c26968e5439a\") " pod="openstack-kuttl-tests/barbican-api-57f8f7777b-s7zn5" Mar 16 16:08:06 crc kubenswrapper[5120]: I0316 16:08:06.924303 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c04f4eb6-ad5d-4996-a59e-c26968e5439a-logs\") pod \"barbican-api-57f8f7777b-s7zn5\" (UID: \"c04f4eb6-ad5d-4996-a59e-c26968e5439a\") " pod="openstack-kuttl-tests/barbican-api-57f8f7777b-s7zn5" Mar 16 16:08:06 crc kubenswrapper[5120]: I0316 16:08:06.924372 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/c04f4eb6-ad5d-4996-a59e-c26968e5439a-config-data-custom\") pod \"barbican-api-57f8f7777b-s7zn5\" (UID: \"c04f4eb6-ad5d-4996-a59e-c26968e5439a\") " pod="openstack-kuttl-tests/barbican-api-57f8f7777b-s7zn5" Mar 16 16:08:06 crc kubenswrapper[5120]: I0316 16:08:06.924411 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/c04f4eb6-ad5d-4996-a59e-c26968e5439a-public-tls-certs\") pod \"barbican-api-57f8f7777b-s7zn5\" (UID: \"c04f4eb6-ad5d-4996-a59e-c26968e5439a\") " pod="openstack-kuttl-tests/barbican-api-57f8f7777b-s7zn5" Mar 16 16:08:06 crc kubenswrapper[5120]: I0316 16:08:06.926250 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c04f4eb6-ad5d-4996-a59e-c26968e5439a-logs\") pod \"barbican-api-57f8f7777b-s7zn5\" (UID: \"c04f4eb6-ad5d-4996-a59e-c26968e5439a\") " pod="openstack-kuttl-tests/barbican-api-57f8f7777b-s7zn5" Mar 16 16:08:06 crc kubenswrapper[5120]: I0316 16:08:06.930682 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/c04f4eb6-ad5d-4996-a59e-c26968e5439a-internal-tls-certs\") pod \"barbican-api-57f8f7777b-s7zn5\" (UID: \"c04f4eb6-ad5d-4996-a59e-c26968e5439a\") " pod="openstack-kuttl-tests/barbican-api-57f8f7777b-s7zn5" Mar 16 16:08:06 crc kubenswrapper[5120]: I0316 16:08:06.932128 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c04f4eb6-ad5d-4996-a59e-c26968e5439a-config-data\") pod \"barbican-api-57f8f7777b-s7zn5\" (UID: \"c04f4eb6-ad5d-4996-a59e-c26968e5439a\") " pod="openstack-kuttl-tests/barbican-api-57f8f7777b-s7zn5" Mar 16 16:08:06 crc kubenswrapper[5120]: I0316 16:08:06.932783 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/c04f4eb6-ad5d-4996-a59e-c26968e5439a-public-tls-certs\") pod \"barbican-api-57f8f7777b-s7zn5\" (UID: \"c04f4eb6-ad5d-4996-a59e-c26968e5439a\") " pod="openstack-kuttl-tests/barbican-api-57f8f7777b-s7zn5" Mar 16 16:08:06 crc kubenswrapper[5120]: I0316 16:08:06.933544 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c04f4eb6-ad5d-4996-a59e-c26968e5439a-combined-ca-bundle\") pod \"barbican-api-57f8f7777b-s7zn5\" (UID: \"c04f4eb6-ad5d-4996-a59e-c26968e5439a\") " pod="openstack-kuttl-tests/barbican-api-57f8f7777b-s7zn5" Mar 16 16:08:06 crc kubenswrapper[5120]: I0316 16:08:06.944928 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/c04f4eb6-ad5d-4996-a59e-c26968e5439a-config-data-custom\") pod \"barbican-api-57f8f7777b-s7zn5\" (UID: \"c04f4eb6-ad5d-4996-a59e-c26968e5439a\") " pod="openstack-kuttl-tests/barbican-api-57f8f7777b-s7zn5" Mar 16 16:08:06 crc kubenswrapper[5120]: I0316 16:08:06.949361 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xspgj\" (UniqueName: \"kubernetes.io/projected/c04f4eb6-ad5d-4996-a59e-c26968e5439a-kube-api-access-xspgj\") pod \"barbican-api-57f8f7777b-s7zn5\" (UID: \"c04f4eb6-ad5d-4996-a59e-c26968e5439a\") " pod="openstack-kuttl-tests/barbican-api-57f8f7777b-s7zn5" Mar 16 16:08:07 crc kubenswrapper[5120]: I0316 16:08:07.050530 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-57f8f7777b-s7zn5" Mar 16 16:08:07 crc kubenswrapper[5120]: I0316 16:08:07.543063 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"b0c8669e-9bed-4d78-b8aa-2387c52883dc","Type":"ContainerStarted","Data":"3fb635153db3db49485fd01f65fa7b1de81669992480520d53a133d41a73ec11"} Mar 16 16:08:07 crc kubenswrapper[5120]: I0316 16:08:07.546023 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"c5593ae2-7a56-4d09-8f88-a54b43c2be0c","Type":"ContainerStarted","Data":"16cfa2634d38d4f0aac174cea17bf8487cb7107a948e6c49443a719a68fd92b4"} Mar 16 16:08:07 crc kubenswrapper[5120]: I0316 16:08:07.551349 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-57f8f7777b-s7zn5"] Mar 16 16:08:07 crc kubenswrapper[5120]: I0316 16:08:07.565771 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-internal-api-0" podStartSLOduration=4.565722973 podStartE2EDuration="4.565722973s" podCreationTimestamp="2026-03-16 16:08:03 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:08:07.561412716 +0000 UTC m=+2189.715344373" watchObservedRunningTime="2026-03-16 16:08:07.565722973 +0000 UTC m=+2189.719654630" Mar 16 16:08:07 crc kubenswrapper[5120]: I0316 16:08:07.573265 5120 generic.go:358] "Generic (PLEG): container finished" podID="745660ab-e0e8-433c-b1ef-405de9b26576" containerID="5c6d2c7450b267f4c1acfc758171fbdd29e7a3edeababbab4b687a32ec128193" exitCode=0 Mar 16 16:08:07 crc kubenswrapper[5120]: I0316 16:08:07.573524 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-gqvqz" event={"ID":"745660ab-e0e8-433c-b1ef-405de9b26576","Type":"ContainerDied","Data":"5c6d2c7450b267f4c1acfc758171fbdd29e7a3edeababbab4b687a32ec128193"} Mar 16 16:08:08 crc kubenswrapper[5120]: E0316 16:08:08.351400 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1580332 actualBytes=10240 Mar 16 16:08:08 crc kubenswrapper[5120]: I0316 16:08:08.591365 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-57f8f7777b-s7zn5" event={"ID":"c04f4eb6-ad5d-4996-a59e-c26968e5439a","Type":"ContainerStarted","Data":"ed5b76468decf3d0970fe991b7842f6cd57f0b2740f7bd9e44e27a86bb568652"} Mar 16 16:08:08 crc kubenswrapper[5120]: I0316 16:08:08.591504 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-57f8f7777b-s7zn5" event={"ID":"c04f4eb6-ad5d-4996-a59e-c26968e5439a","Type":"ContainerStarted","Data":"08c398795e3394c5a740a16d4d39c55a16da4356f66cdcff6ba806ae8d19251d"} Mar 16 16:08:08 crc kubenswrapper[5120]: I0316 16:08:08.591530 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-57f8f7777b-s7zn5" Mar 16 16:08:08 crc kubenswrapper[5120]: I0316 16:08:08.591780 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-57f8f7777b-s7zn5" Mar 16 16:08:08 crc kubenswrapper[5120]: I0316 16:08:08.591847 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-57f8f7777b-s7zn5" event={"ID":"c04f4eb6-ad5d-4996-a59e-c26968e5439a","Type":"ContainerStarted","Data":"4de071851200414869fa41878d1dfa8131e203844915bb3a9bd8fb768ca5b28f"} Mar 16 16:08:08 crc kubenswrapper[5120]: I0316 16:08:08.632101 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-api-57f8f7777b-s7zn5" podStartSLOduration=2.63208167 podStartE2EDuration="2.63208167s" podCreationTimestamp="2026-03-16 16:08:06 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:08:08.614729296 +0000 UTC m=+2190.768660993" watchObservedRunningTime="2026-03-16 16:08:08.63208167 +0000 UTC m=+2190.786013327" Mar 16 16:08:09 crc kubenswrapper[5120]: I0316 16:08:09.007353 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-gqvqz" Mar 16 16:08:09 crc kubenswrapper[5120]: I0316 16:08:09.076667 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/745660ab-e0e8-433c-b1ef-405de9b26576-scripts\") pod \"745660ab-e0e8-433c-b1ef-405de9b26576\" (UID: \"745660ab-e0e8-433c-b1ef-405de9b26576\") " Mar 16 16:08:09 crc kubenswrapper[5120]: I0316 16:08:09.076809 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/745660ab-e0e8-433c-b1ef-405de9b26576-etc-machine-id\") pod \"745660ab-e0e8-433c-b1ef-405de9b26576\" (UID: \"745660ab-e0e8-433c-b1ef-405de9b26576\") " Mar 16 16:08:09 crc kubenswrapper[5120]: I0316 16:08:09.076839 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6km57\" (UniqueName: \"kubernetes.io/projected/745660ab-e0e8-433c-b1ef-405de9b26576-kube-api-access-6km57\") pod \"745660ab-e0e8-433c-b1ef-405de9b26576\" (UID: \"745660ab-e0e8-433c-b1ef-405de9b26576\") " Mar 16 16:08:09 crc kubenswrapper[5120]: I0316 16:08:09.076879 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/745660ab-e0e8-433c-b1ef-405de9b26576-config-data\") pod \"745660ab-e0e8-433c-b1ef-405de9b26576\" (UID: \"745660ab-e0e8-433c-b1ef-405de9b26576\") " Mar 16 16:08:09 crc kubenswrapper[5120]: I0316 16:08:09.076883 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/745660ab-e0e8-433c-b1ef-405de9b26576-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "745660ab-e0e8-433c-b1ef-405de9b26576" (UID: "745660ab-e0e8-433c-b1ef-405de9b26576"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 16:08:09 crc kubenswrapper[5120]: I0316 16:08:09.076917 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/745660ab-e0e8-433c-b1ef-405de9b26576-combined-ca-bundle\") pod \"745660ab-e0e8-433c-b1ef-405de9b26576\" (UID: \"745660ab-e0e8-433c-b1ef-405de9b26576\") " Mar 16 16:08:09 crc kubenswrapper[5120]: I0316 16:08:09.076990 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/745660ab-e0e8-433c-b1ef-405de9b26576-db-sync-config-data\") pod \"745660ab-e0e8-433c-b1ef-405de9b26576\" (UID: \"745660ab-e0e8-433c-b1ef-405de9b26576\") " Mar 16 16:08:09 crc kubenswrapper[5120]: I0316 16:08:09.077593 5120 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/745660ab-e0e8-433c-b1ef-405de9b26576-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 16:08:09 crc kubenswrapper[5120]: I0316 16:08:09.091647 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/745660ab-e0e8-433c-b1ef-405de9b26576-db-sync-config-data" (OuterVolumeSpecName: "db-sync-config-data") pod "745660ab-e0e8-433c-b1ef-405de9b26576" (UID: "745660ab-e0e8-433c-b1ef-405de9b26576"). InnerVolumeSpecName "db-sync-config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:08:09 crc kubenswrapper[5120]: I0316 16:08:09.096028 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/745660ab-e0e8-433c-b1ef-405de9b26576-scripts" (OuterVolumeSpecName: "scripts") pod "745660ab-e0e8-433c-b1ef-405de9b26576" (UID: "745660ab-e0e8-433c-b1ef-405de9b26576"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:08:09 crc kubenswrapper[5120]: I0316 16:08:09.098677 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/745660ab-e0e8-433c-b1ef-405de9b26576-kube-api-access-6km57" (OuterVolumeSpecName: "kube-api-access-6km57") pod "745660ab-e0e8-433c-b1ef-405de9b26576" (UID: "745660ab-e0e8-433c-b1ef-405de9b26576"). InnerVolumeSpecName "kube-api-access-6km57". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:08:09 crc kubenswrapper[5120]: I0316 16:08:09.115049 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/745660ab-e0e8-433c-b1ef-405de9b26576-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "745660ab-e0e8-433c-b1ef-405de9b26576" (UID: "745660ab-e0e8-433c-b1ef-405de9b26576"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:08:09 crc kubenswrapper[5120]: I0316 16:08:09.125072 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/745660ab-e0e8-433c-b1ef-405de9b26576-config-data" (OuterVolumeSpecName: "config-data") pod "745660ab-e0e8-433c-b1ef-405de9b26576" (UID: "745660ab-e0e8-433c-b1ef-405de9b26576"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:08:09 crc kubenswrapper[5120]: I0316 16:08:09.179884 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/745660ab-e0e8-433c-b1ef-405de9b26576-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:08:09 crc kubenswrapper[5120]: I0316 16:08:09.179947 5120 reconciler_common.go:299] "Volume detached for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/745660ab-e0e8-433c-b1ef-405de9b26576-db-sync-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:08:09 crc kubenswrapper[5120]: I0316 16:08:09.179968 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/745660ab-e0e8-433c-b1ef-405de9b26576-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:08:09 crc kubenswrapper[5120]: I0316 16:08:09.179986 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6km57\" (UniqueName: \"kubernetes.io/projected/745660ab-e0e8-433c-b1ef-405de9b26576-kube-api-access-6km57\") on node \"crc\" DevicePath \"\"" Mar 16 16:08:09 crc kubenswrapper[5120]: I0316 16:08:09.180010 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/745660ab-e0e8-433c-b1ef-405de9b26576-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:08:09 crc kubenswrapper[5120]: I0316 16:08:09.609306 5120 generic.go:358] "Generic (PLEG): container finished" podID="a3634a26-805b-489d-9f26-36aef6f9239f" containerID="bfe7238fdbbf7d4fefe2181f3c7d19e051d2f95564a4bd73db5a8da5df6bca9b" exitCode=0 Mar 16 16:08:09 crc kubenswrapper[5120]: I0316 16:08:09.609844 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-qcgqn" event={"ID":"a3634a26-805b-489d-9f26-36aef6f9239f","Type":"ContainerDied","Data":"bfe7238fdbbf7d4fefe2181f3c7d19e051d2f95564a4bd73db5a8da5df6bca9b"} Mar 16 16:08:09 crc kubenswrapper[5120]: I0316 16:08:09.614377 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-gqvqz" event={"ID":"745660ab-e0e8-433c-b1ef-405de9b26576","Type":"ContainerDied","Data":"2965c9721dace934fa470b41bd912c319f55c1b75f8b5390a7b0aadbdf27a9f3"} Mar 16 16:08:09 crc kubenswrapper[5120]: I0316 16:08:09.614459 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2965c9721dace934fa470b41bd912c319f55c1b75f8b5390a7b0aadbdf27a9f3" Mar 16 16:08:09 crc kubenswrapper[5120]: I0316 16:08:09.614469 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-gqvqz" Mar 16 16:08:09 crc kubenswrapper[5120]: I0316 16:08:09.759611 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:08:09 crc kubenswrapper[5120]: I0316 16:08:09.761099 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="745660ab-e0e8-433c-b1ef-405de9b26576" containerName="cinder-db-sync" Mar 16 16:08:09 crc kubenswrapper[5120]: I0316 16:08:09.761123 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="745660ab-e0e8-433c-b1ef-405de9b26576" containerName="cinder-db-sync" Mar 16 16:08:09 crc kubenswrapper[5120]: I0316 16:08:09.761280 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="745660ab-e0e8-433c-b1ef-405de9b26576" containerName="cinder-db-sync" Mar 16 16:08:09 crc kubenswrapper[5120]: I0316 16:08:09.788025 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:08:09 crc kubenswrapper[5120]: I0316 16:08:09.795056 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-config-data\"" Mar 16 16:08:09 crc kubenswrapper[5120]: I0316 16:08:09.795380 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-scripts\"" Mar 16 16:08:09 crc kubenswrapper[5120]: I0316 16:08:09.795386 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/2eb7df4e-20b6-4d77-bdac-4031fdb1f508-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"2eb7df4e-20b6-4d77-bdac-4031fdb1f508\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:08:09 crc kubenswrapper[5120]: I0316 16:08:09.795511 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2eb7df4e-20b6-4d77-bdac-4031fdb1f508-scripts\") pod \"cinder-scheduler-0\" (UID: \"2eb7df4e-20b6-4d77-bdac-4031fdb1f508\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:08:09 crc kubenswrapper[5120]: I0316 16:08:09.795531 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2eb7df4e-20b6-4d77-bdac-4031fdb1f508-config-data\") pod \"cinder-scheduler-0\" (UID: \"2eb7df4e-20b6-4d77-bdac-4031fdb1f508\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:08:09 crc kubenswrapper[5120]: I0316 16:08:09.795551 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/2eb7df4e-20b6-4d77-bdac-4031fdb1f508-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"2eb7df4e-20b6-4d77-bdac-4031fdb1f508\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:08:09 crc kubenswrapper[5120]: I0316 16:08:09.795570 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-cinder-dockercfg-bsw7q\"" Mar 16 16:08:09 crc kubenswrapper[5120]: I0316 16:08:09.795654 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r742w\" (UniqueName: \"kubernetes.io/projected/2eb7df4e-20b6-4d77-bdac-4031fdb1f508-kube-api-access-r742w\") pod \"cinder-scheduler-0\" (UID: \"2eb7df4e-20b6-4d77-bdac-4031fdb1f508\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:08:09 crc kubenswrapper[5120]: I0316 16:08:09.795702 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2eb7df4e-20b6-4d77-bdac-4031fdb1f508-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"2eb7df4e-20b6-4d77-bdac-4031fdb1f508\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:08:09 crc kubenswrapper[5120]: I0316 16:08:09.795772 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-scheduler-config-data\"" Mar 16 16:08:09 crc kubenswrapper[5120]: I0316 16:08:09.833341 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:08:09 crc kubenswrapper[5120]: I0316 16:08:09.880949 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:08:09 crc kubenswrapper[5120]: I0316 16:08:09.887787 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:08:09 crc kubenswrapper[5120]: I0316 16:08:09.889716 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-api-config-data\"" Mar 16 16:08:09 crc kubenswrapper[5120]: I0316 16:08:09.894550 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:08:09 crc kubenswrapper[5120]: I0316 16:08:09.898133 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7bc08750-9598-442b-bcf1-832c03bd9432-logs\") pod \"cinder-api-0\" (UID: \"7bc08750-9598-442b-bcf1-832c03bd9432\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:08:09 crc kubenswrapper[5120]: I0316 16:08:09.898189 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7bc08750-9598-442b-bcf1-832c03bd9432-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"7bc08750-9598-442b-bcf1-832c03bd9432\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:08:09 crc kubenswrapper[5120]: I0316 16:08:09.898272 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r742w\" (UniqueName: \"kubernetes.io/projected/2eb7df4e-20b6-4d77-bdac-4031fdb1f508-kube-api-access-r742w\") pod \"cinder-scheduler-0\" (UID: \"2eb7df4e-20b6-4d77-bdac-4031fdb1f508\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:08:09 crc kubenswrapper[5120]: I0316 16:08:09.898411 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2eb7df4e-20b6-4d77-bdac-4031fdb1f508-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"2eb7df4e-20b6-4d77-bdac-4031fdb1f508\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:08:09 crc kubenswrapper[5120]: I0316 16:08:09.898550 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/7bc08750-9598-442b-bcf1-832c03bd9432-etc-machine-id\") pod \"cinder-api-0\" (UID: \"7bc08750-9598-442b-bcf1-832c03bd9432\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:08:09 crc kubenswrapper[5120]: I0316 16:08:09.898571 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/7bc08750-9598-442b-bcf1-832c03bd9432-config-data-custom\") pod \"cinder-api-0\" (UID: \"7bc08750-9598-442b-bcf1-832c03bd9432\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:08:09 crc kubenswrapper[5120]: I0316 16:08:09.898655 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/2eb7df4e-20b6-4d77-bdac-4031fdb1f508-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"2eb7df4e-20b6-4d77-bdac-4031fdb1f508\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:08:09 crc kubenswrapper[5120]: I0316 16:08:09.898948 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7bc08750-9598-442b-bcf1-832c03bd9432-config-data\") pod \"cinder-api-0\" (UID: \"7bc08750-9598-442b-bcf1-832c03bd9432\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:08:09 crc kubenswrapper[5120]: I0316 16:08:09.898987 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9g7g\" (UniqueName: \"kubernetes.io/projected/7bc08750-9598-442b-bcf1-832c03bd9432-kube-api-access-l9g7g\") pod \"cinder-api-0\" (UID: \"7bc08750-9598-442b-bcf1-832c03bd9432\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:08:09 crc kubenswrapper[5120]: I0316 16:08:09.899067 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2eb7df4e-20b6-4d77-bdac-4031fdb1f508-scripts\") pod \"cinder-scheduler-0\" (UID: \"2eb7df4e-20b6-4d77-bdac-4031fdb1f508\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:08:09 crc kubenswrapper[5120]: I0316 16:08:09.899082 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2eb7df4e-20b6-4d77-bdac-4031fdb1f508-config-data\") pod \"cinder-scheduler-0\" (UID: \"2eb7df4e-20b6-4d77-bdac-4031fdb1f508\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:08:09 crc kubenswrapper[5120]: I0316 16:08:09.910148 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/2eb7df4e-20b6-4d77-bdac-4031fdb1f508-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"2eb7df4e-20b6-4d77-bdac-4031fdb1f508\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:08:09 crc kubenswrapper[5120]: I0316 16:08:09.910314 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7bc08750-9598-442b-bcf1-832c03bd9432-scripts\") pod \"cinder-api-0\" (UID: \"7bc08750-9598-442b-bcf1-832c03bd9432\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:08:09 crc kubenswrapper[5120]: I0316 16:08:09.910553 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/2eb7df4e-20b6-4d77-bdac-4031fdb1f508-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"2eb7df4e-20b6-4d77-bdac-4031fdb1f508\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:08:09 crc kubenswrapper[5120]: I0316 16:08:09.917722 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2eb7df4e-20b6-4d77-bdac-4031fdb1f508-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"2eb7df4e-20b6-4d77-bdac-4031fdb1f508\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:08:09 crc kubenswrapper[5120]: I0316 16:08:09.918292 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2eb7df4e-20b6-4d77-bdac-4031fdb1f508-scripts\") pod \"cinder-scheduler-0\" (UID: \"2eb7df4e-20b6-4d77-bdac-4031fdb1f508\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:08:09 crc kubenswrapper[5120]: I0316 16:08:09.921351 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2eb7df4e-20b6-4d77-bdac-4031fdb1f508-config-data\") pod \"cinder-scheduler-0\" (UID: \"2eb7df4e-20b6-4d77-bdac-4031fdb1f508\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:08:09 crc kubenswrapper[5120]: I0316 16:08:09.921961 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/2eb7df4e-20b6-4d77-bdac-4031fdb1f508-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"2eb7df4e-20b6-4d77-bdac-4031fdb1f508\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:08:09 crc kubenswrapper[5120]: I0316 16:08:09.923786 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r742w\" (UniqueName: \"kubernetes.io/projected/2eb7df4e-20b6-4d77-bdac-4031fdb1f508-kube-api-access-r742w\") pod \"cinder-scheduler-0\" (UID: \"2eb7df4e-20b6-4d77-bdac-4031fdb1f508\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:08:10 crc kubenswrapper[5120]: I0316 16:08:10.012395 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7bc08750-9598-442b-bcf1-832c03bd9432-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"7bc08750-9598-442b-bcf1-832c03bd9432\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:08:10 crc kubenswrapper[5120]: I0316 16:08:10.012555 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/7bc08750-9598-442b-bcf1-832c03bd9432-etc-machine-id\") pod \"cinder-api-0\" (UID: \"7bc08750-9598-442b-bcf1-832c03bd9432\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:08:10 crc kubenswrapper[5120]: I0316 16:08:10.012581 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/7bc08750-9598-442b-bcf1-832c03bd9432-config-data-custom\") pod \"cinder-api-0\" (UID: \"7bc08750-9598-442b-bcf1-832c03bd9432\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:08:10 crc kubenswrapper[5120]: I0316 16:08:10.012690 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7bc08750-9598-442b-bcf1-832c03bd9432-config-data\") pod \"cinder-api-0\" (UID: \"7bc08750-9598-442b-bcf1-832c03bd9432\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:08:10 crc kubenswrapper[5120]: I0316 16:08:10.012728 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l9g7g\" (UniqueName: \"kubernetes.io/projected/7bc08750-9598-442b-bcf1-832c03bd9432-kube-api-access-l9g7g\") pod \"cinder-api-0\" (UID: \"7bc08750-9598-442b-bcf1-832c03bd9432\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:08:10 crc kubenswrapper[5120]: I0316 16:08:10.012822 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7bc08750-9598-442b-bcf1-832c03bd9432-scripts\") pod \"cinder-api-0\" (UID: \"7bc08750-9598-442b-bcf1-832c03bd9432\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:08:10 crc kubenswrapper[5120]: I0316 16:08:10.012915 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7bc08750-9598-442b-bcf1-832c03bd9432-logs\") pod \"cinder-api-0\" (UID: \"7bc08750-9598-442b-bcf1-832c03bd9432\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:08:10 crc kubenswrapper[5120]: I0316 16:08:10.017904 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/7bc08750-9598-442b-bcf1-832c03bd9432-etc-machine-id\") pod \"cinder-api-0\" (UID: \"7bc08750-9598-442b-bcf1-832c03bd9432\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:08:10 crc kubenswrapper[5120]: I0316 16:08:10.019121 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7bc08750-9598-442b-bcf1-832c03bd9432-logs\") pod \"cinder-api-0\" (UID: \"7bc08750-9598-442b-bcf1-832c03bd9432\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:08:10 crc kubenswrapper[5120]: I0316 16:08:10.019509 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7bc08750-9598-442b-bcf1-832c03bd9432-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"7bc08750-9598-442b-bcf1-832c03bd9432\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:08:10 crc kubenswrapper[5120]: I0316 16:08:10.019858 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7bc08750-9598-442b-bcf1-832c03bd9432-config-data\") pod \"cinder-api-0\" (UID: \"7bc08750-9598-442b-bcf1-832c03bd9432\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:08:10 crc kubenswrapper[5120]: I0316 16:08:10.026331 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7bc08750-9598-442b-bcf1-832c03bd9432-scripts\") pod \"cinder-api-0\" (UID: \"7bc08750-9598-442b-bcf1-832c03bd9432\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:08:10 crc kubenswrapper[5120]: I0316 16:08:10.026504 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/7bc08750-9598-442b-bcf1-832c03bd9432-config-data-custom\") pod \"cinder-api-0\" (UID: \"7bc08750-9598-442b-bcf1-832c03bd9432\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:08:10 crc kubenswrapper[5120]: I0316 16:08:10.036604 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9g7g\" (UniqueName: \"kubernetes.io/projected/7bc08750-9598-442b-bcf1-832c03bd9432-kube-api-access-l9g7g\") pod \"cinder-api-0\" (UID: \"7bc08750-9598-442b-bcf1-832c03bd9432\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:08:10 crc kubenswrapper[5120]: I0316 16:08:10.134353 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:08:10 crc kubenswrapper[5120]: I0316 16:08:10.204160 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:08:10 crc kubenswrapper[5120]: I0316 16:08:10.637357 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"b0c8669e-9bed-4d78-b8aa-2387c52883dc","Type":"ContainerStarted","Data":"9532fd324ce6895773a690c6c8a01fa2a5a4bd2b1862161397f01c796cfb112c"} Mar 16 16:08:10 crc kubenswrapper[5120]: I0316 16:08:10.736400 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:08:10 crc kubenswrapper[5120]: I0316 16:08:10.840980 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:08:10 crc kubenswrapper[5120]: I0316 16:08:10.895287 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-qcgqn" Mar 16 16:08:10 crc kubenswrapper[5120]: I0316 16:08:10.927882 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-47kvd\" (UniqueName: \"kubernetes.io/projected/a3634a26-805b-489d-9f26-36aef6f9239f-kube-api-access-47kvd\") pod \"a3634a26-805b-489d-9f26-36aef6f9239f\" (UID: \"a3634a26-805b-489d-9f26-36aef6f9239f\") " Mar 16 16:08:10 crc kubenswrapper[5120]: I0316 16:08:10.928043 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a3634a26-805b-489d-9f26-36aef6f9239f-combined-ca-bundle\") pod \"a3634a26-805b-489d-9f26-36aef6f9239f\" (UID: \"a3634a26-805b-489d-9f26-36aef6f9239f\") " Mar 16 16:08:10 crc kubenswrapper[5120]: I0316 16:08:10.928108 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a3634a26-805b-489d-9f26-36aef6f9239f-scripts\") pod \"a3634a26-805b-489d-9f26-36aef6f9239f\" (UID: \"a3634a26-805b-489d-9f26-36aef6f9239f\") " Mar 16 16:08:10 crc kubenswrapper[5120]: I0316 16:08:10.928136 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a3634a26-805b-489d-9f26-36aef6f9239f-config-data\") pod \"a3634a26-805b-489d-9f26-36aef6f9239f\" (UID: \"a3634a26-805b-489d-9f26-36aef6f9239f\") " Mar 16 16:08:10 crc kubenswrapper[5120]: I0316 16:08:10.928157 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/a3634a26-805b-489d-9f26-36aef6f9239f-credential-keys\") pod \"a3634a26-805b-489d-9f26-36aef6f9239f\" (UID: \"a3634a26-805b-489d-9f26-36aef6f9239f\") " Mar 16 16:08:10 crc kubenswrapper[5120]: I0316 16:08:10.928395 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/a3634a26-805b-489d-9f26-36aef6f9239f-fernet-keys\") pod \"a3634a26-805b-489d-9f26-36aef6f9239f\" (UID: \"a3634a26-805b-489d-9f26-36aef6f9239f\") " Mar 16 16:08:10 crc kubenswrapper[5120]: I0316 16:08:10.934921 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3634a26-805b-489d-9f26-36aef6f9239f-kube-api-access-47kvd" (OuterVolumeSpecName: "kube-api-access-47kvd") pod "a3634a26-805b-489d-9f26-36aef6f9239f" (UID: "a3634a26-805b-489d-9f26-36aef6f9239f"). InnerVolumeSpecName "kube-api-access-47kvd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:08:10 crc kubenswrapper[5120]: I0316 16:08:10.937258 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a3634a26-805b-489d-9f26-36aef6f9239f-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "a3634a26-805b-489d-9f26-36aef6f9239f" (UID: "a3634a26-805b-489d-9f26-36aef6f9239f"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:08:10 crc kubenswrapper[5120]: I0316 16:08:10.938941 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a3634a26-805b-489d-9f26-36aef6f9239f-scripts" (OuterVolumeSpecName: "scripts") pod "a3634a26-805b-489d-9f26-36aef6f9239f" (UID: "a3634a26-805b-489d-9f26-36aef6f9239f"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:08:10 crc kubenswrapper[5120]: I0316 16:08:10.943677 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a3634a26-805b-489d-9f26-36aef6f9239f-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "a3634a26-805b-489d-9f26-36aef6f9239f" (UID: "a3634a26-805b-489d-9f26-36aef6f9239f"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:08:10 crc kubenswrapper[5120]: I0316 16:08:10.969719 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a3634a26-805b-489d-9f26-36aef6f9239f-config-data" (OuterVolumeSpecName: "config-data") pod "a3634a26-805b-489d-9f26-36aef6f9239f" (UID: "a3634a26-805b-489d-9f26-36aef6f9239f"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:08:10 crc kubenswrapper[5120]: I0316 16:08:10.972635 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a3634a26-805b-489d-9f26-36aef6f9239f-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "a3634a26-805b-489d-9f26-36aef6f9239f" (UID: "a3634a26-805b-489d-9f26-36aef6f9239f"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:08:11 crc kubenswrapper[5120]: I0316 16:08:11.030653 5120 reconciler_common.go:299] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/a3634a26-805b-489d-9f26-36aef6f9239f-fernet-keys\") on node \"crc\" DevicePath \"\"" Mar 16 16:08:11 crc kubenswrapper[5120]: I0316 16:08:11.030684 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-47kvd\" (UniqueName: \"kubernetes.io/projected/a3634a26-805b-489d-9f26-36aef6f9239f-kube-api-access-47kvd\") on node \"crc\" DevicePath \"\"" Mar 16 16:08:11 crc kubenswrapper[5120]: I0316 16:08:11.030693 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a3634a26-805b-489d-9f26-36aef6f9239f-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:08:11 crc kubenswrapper[5120]: I0316 16:08:11.030702 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a3634a26-805b-489d-9f26-36aef6f9239f-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:08:11 crc kubenswrapper[5120]: I0316 16:08:11.030712 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a3634a26-805b-489d-9f26-36aef6f9239f-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:08:11 crc kubenswrapper[5120]: I0316 16:08:11.030719 5120 reconciler_common.go:299] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/a3634a26-805b-489d-9f26-36aef6f9239f-credential-keys\") on node \"crc\" DevicePath \"\"" Mar 16 16:08:11 crc kubenswrapper[5120]: I0316 16:08:11.648619 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"2eb7df4e-20b6-4d77-bdac-4031fdb1f508","Type":"ContainerStarted","Data":"83ad742b6a794e926ebd6b4ba4fe3f656a498a949e391b07e4ab58973fb73519"} Mar 16 16:08:11 crc kubenswrapper[5120]: I0316 16:08:11.651238 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"b0c8669e-9bed-4d78-b8aa-2387c52883dc","Type":"ContainerStarted","Data":"1c29f1213ef135fa32af90b552238ff2243862beed0351fffd01d96f8ba35ca2"} Mar 16 16:08:11 crc kubenswrapper[5120]: I0316 16:08:11.653310 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-qcgqn" Mar 16 16:08:11 crc kubenswrapper[5120]: I0316 16:08:11.653440 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-qcgqn" event={"ID":"a3634a26-805b-489d-9f26-36aef6f9239f","Type":"ContainerDied","Data":"c99cc3e08f5cc469558a9e3f497a5bd9158860dad0845bd5d2bda56d25c2912d"} Mar 16 16:08:11 crc kubenswrapper[5120]: I0316 16:08:11.653492 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c99cc3e08f5cc469558a9e3f497a5bd9158860dad0845bd5d2bda56d25c2912d" Mar 16 16:08:11 crc kubenswrapper[5120]: I0316 16:08:11.661366 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"7bc08750-9598-442b-bcf1-832c03bd9432","Type":"ContainerStarted","Data":"763ea76ada7319bb1b68b4f630fa306f94e1094af757d729db8cb9a0674b0f4f"} Mar 16 16:08:11 crc kubenswrapper[5120]: I0316 16:08:11.774374 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-78bffc6747-6kvnb"] Mar 16 16:08:11 crc kubenswrapper[5120]: I0316 16:08:11.775741 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3634a26-805b-489d-9f26-36aef6f9239f" containerName="keystone-bootstrap" Mar 16 16:08:11 crc kubenswrapper[5120]: I0316 16:08:11.775766 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3634a26-805b-489d-9f26-36aef6f9239f" containerName="keystone-bootstrap" Mar 16 16:08:11 crc kubenswrapper[5120]: I0316 16:08:11.776235 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="a3634a26-805b-489d-9f26-36aef6f9239f" containerName="keystone-bootstrap" Mar 16 16:08:11 crc kubenswrapper[5120]: I0316 16:08:11.802271 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-78bffc6747-6kvnb" Mar 16 16:08:11 crc kubenswrapper[5120]: I0316 16:08:11.807207 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-78bffc6747-6kvnb"] Mar 16 16:08:11 crc kubenswrapper[5120]: I0316 16:08:11.809344 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone\"" Mar 16 16:08:11 crc kubenswrapper[5120]: I0316 16:08:11.809603 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-config-data\"" Mar 16 16:08:11 crc kubenswrapper[5120]: I0316 16:08:11.809723 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-keystone-dockercfg-h8dlj\"" Mar 16 16:08:11 crc kubenswrapper[5120]: I0316 16:08:11.810291 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-keystone-internal-svc\"" Mar 16 16:08:11 crc kubenswrapper[5120]: I0316 16:08:11.810410 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-keystone-public-svc\"" Mar 16 16:08:11 crc kubenswrapper[5120]: I0316 16:08:11.810515 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-scripts\"" Mar 16 16:08:11 crc kubenswrapper[5120]: I0316 16:08:11.847604 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/5e5ad3cf-0d96-43a2-b8cb-38e7210af15a-internal-tls-certs\") pod \"keystone-78bffc6747-6kvnb\" (UID: \"5e5ad3cf-0d96-43a2-b8cb-38e7210af15a\") " pod="openstack-kuttl-tests/keystone-78bffc6747-6kvnb" Mar 16 16:08:11 crc kubenswrapper[5120]: I0316 16:08:11.847654 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5e5ad3cf-0d96-43a2-b8cb-38e7210af15a-scripts\") pod \"keystone-78bffc6747-6kvnb\" (UID: \"5e5ad3cf-0d96-43a2-b8cb-38e7210af15a\") " pod="openstack-kuttl-tests/keystone-78bffc6747-6kvnb" Mar 16 16:08:11 crc kubenswrapper[5120]: I0316 16:08:11.847754 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q95kc\" (UniqueName: \"kubernetes.io/projected/5e5ad3cf-0d96-43a2-b8cb-38e7210af15a-kube-api-access-q95kc\") pod \"keystone-78bffc6747-6kvnb\" (UID: \"5e5ad3cf-0d96-43a2-b8cb-38e7210af15a\") " pod="openstack-kuttl-tests/keystone-78bffc6747-6kvnb" Mar 16 16:08:11 crc kubenswrapper[5120]: I0316 16:08:11.847841 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5e5ad3cf-0d96-43a2-b8cb-38e7210af15a-config-data\") pod \"keystone-78bffc6747-6kvnb\" (UID: \"5e5ad3cf-0d96-43a2-b8cb-38e7210af15a\") " pod="openstack-kuttl-tests/keystone-78bffc6747-6kvnb" Mar 16 16:08:11 crc kubenswrapper[5120]: I0316 16:08:11.847886 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/5e5ad3cf-0d96-43a2-b8cb-38e7210af15a-credential-keys\") pod \"keystone-78bffc6747-6kvnb\" (UID: \"5e5ad3cf-0d96-43a2-b8cb-38e7210af15a\") " pod="openstack-kuttl-tests/keystone-78bffc6747-6kvnb" Mar 16 16:08:11 crc kubenswrapper[5120]: I0316 16:08:11.847935 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/5e5ad3cf-0d96-43a2-b8cb-38e7210af15a-public-tls-certs\") pod \"keystone-78bffc6747-6kvnb\" (UID: \"5e5ad3cf-0d96-43a2-b8cb-38e7210af15a\") " pod="openstack-kuttl-tests/keystone-78bffc6747-6kvnb" Mar 16 16:08:11 crc kubenswrapper[5120]: I0316 16:08:11.848115 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/5e5ad3cf-0d96-43a2-b8cb-38e7210af15a-fernet-keys\") pod \"keystone-78bffc6747-6kvnb\" (UID: \"5e5ad3cf-0d96-43a2-b8cb-38e7210af15a\") " pod="openstack-kuttl-tests/keystone-78bffc6747-6kvnb" Mar 16 16:08:11 crc kubenswrapper[5120]: I0316 16:08:11.848283 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5e5ad3cf-0d96-43a2-b8cb-38e7210af15a-combined-ca-bundle\") pod \"keystone-78bffc6747-6kvnb\" (UID: \"5e5ad3cf-0d96-43a2-b8cb-38e7210af15a\") " pod="openstack-kuttl-tests/keystone-78bffc6747-6kvnb" Mar 16 16:08:11 crc kubenswrapper[5120]: I0316 16:08:11.951861 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/5e5ad3cf-0d96-43a2-b8cb-38e7210af15a-internal-tls-certs\") pod \"keystone-78bffc6747-6kvnb\" (UID: \"5e5ad3cf-0d96-43a2-b8cb-38e7210af15a\") " pod="openstack-kuttl-tests/keystone-78bffc6747-6kvnb" Mar 16 16:08:11 crc kubenswrapper[5120]: I0316 16:08:11.952261 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5e5ad3cf-0d96-43a2-b8cb-38e7210af15a-scripts\") pod \"keystone-78bffc6747-6kvnb\" (UID: \"5e5ad3cf-0d96-43a2-b8cb-38e7210af15a\") " pod="openstack-kuttl-tests/keystone-78bffc6747-6kvnb" Mar 16 16:08:11 crc kubenswrapper[5120]: I0316 16:08:11.952397 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q95kc\" (UniqueName: \"kubernetes.io/projected/5e5ad3cf-0d96-43a2-b8cb-38e7210af15a-kube-api-access-q95kc\") pod \"keystone-78bffc6747-6kvnb\" (UID: \"5e5ad3cf-0d96-43a2-b8cb-38e7210af15a\") " pod="openstack-kuttl-tests/keystone-78bffc6747-6kvnb" Mar 16 16:08:11 crc kubenswrapper[5120]: I0316 16:08:11.952483 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5e5ad3cf-0d96-43a2-b8cb-38e7210af15a-config-data\") pod \"keystone-78bffc6747-6kvnb\" (UID: \"5e5ad3cf-0d96-43a2-b8cb-38e7210af15a\") " pod="openstack-kuttl-tests/keystone-78bffc6747-6kvnb" Mar 16 16:08:11 crc kubenswrapper[5120]: I0316 16:08:11.952523 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/5e5ad3cf-0d96-43a2-b8cb-38e7210af15a-credential-keys\") pod \"keystone-78bffc6747-6kvnb\" (UID: \"5e5ad3cf-0d96-43a2-b8cb-38e7210af15a\") " pod="openstack-kuttl-tests/keystone-78bffc6747-6kvnb" Mar 16 16:08:11 crc kubenswrapper[5120]: I0316 16:08:11.952582 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/5e5ad3cf-0d96-43a2-b8cb-38e7210af15a-public-tls-certs\") pod \"keystone-78bffc6747-6kvnb\" (UID: \"5e5ad3cf-0d96-43a2-b8cb-38e7210af15a\") " pod="openstack-kuttl-tests/keystone-78bffc6747-6kvnb" Mar 16 16:08:11 crc kubenswrapper[5120]: I0316 16:08:11.952628 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/5e5ad3cf-0d96-43a2-b8cb-38e7210af15a-fernet-keys\") pod \"keystone-78bffc6747-6kvnb\" (UID: \"5e5ad3cf-0d96-43a2-b8cb-38e7210af15a\") " pod="openstack-kuttl-tests/keystone-78bffc6747-6kvnb" Mar 16 16:08:11 crc kubenswrapper[5120]: I0316 16:08:11.952664 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5e5ad3cf-0d96-43a2-b8cb-38e7210af15a-combined-ca-bundle\") pod \"keystone-78bffc6747-6kvnb\" (UID: \"5e5ad3cf-0d96-43a2-b8cb-38e7210af15a\") " pod="openstack-kuttl-tests/keystone-78bffc6747-6kvnb" Mar 16 16:08:11 crc kubenswrapper[5120]: I0316 16:08:11.962619 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/5e5ad3cf-0d96-43a2-b8cb-38e7210af15a-internal-tls-certs\") pod \"keystone-78bffc6747-6kvnb\" (UID: \"5e5ad3cf-0d96-43a2-b8cb-38e7210af15a\") " pod="openstack-kuttl-tests/keystone-78bffc6747-6kvnb" Mar 16 16:08:11 crc kubenswrapper[5120]: I0316 16:08:11.970944 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/5e5ad3cf-0d96-43a2-b8cb-38e7210af15a-fernet-keys\") pod \"keystone-78bffc6747-6kvnb\" (UID: \"5e5ad3cf-0d96-43a2-b8cb-38e7210af15a\") " pod="openstack-kuttl-tests/keystone-78bffc6747-6kvnb" Mar 16 16:08:11 crc kubenswrapper[5120]: I0316 16:08:11.973932 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/5e5ad3cf-0d96-43a2-b8cb-38e7210af15a-credential-keys\") pod \"keystone-78bffc6747-6kvnb\" (UID: \"5e5ad3cf-0d96-43a2-b8cb-38e7210af15a\") " pod="openstack-kuttl-tests/keystone-78bffc6747-6kvnb" Mar 16 16:08:11 crc kubenswrapper[5120]: I0316 16:08:11.985402 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q95kc\" (UniqueName: \"kubernetes.io/projected/5e5ad3cf-0d96-43a2-b8cb-38e7210af15a-kube-api-access-q95kc\") pod \"keystone-78bffc6747-6kvnb\" (UID: \"5e5ad3cf-0d96-43a2-b8cb-38e7210af15a\") " pod="openstack-kuttl-tests/keystone-78bffc6747-6kvnb" Mar 16 16:08:11 crc kubenswrapper[5120]: I0316 16:08:11.992328 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/5e5ad3cf-0d96-43a2-b8cb-38e7210af15a-public-tls-certs\") pod \"keystone-78bffc6747-6kvnb\" (UID: \"5e5ad3cf-0d96-43a2-b8cb-38e7210af15a\") " pod="openstack-kuttl-tests/keystone-78bffc6747-6kvnb" Mar 16 16:08:11 crc kubenswrapper[5120]: I0316 16:08:11.995258 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5e5ad3cf-0d96-43a2-b8cb-38e7210af15a-config-data\") pod \"keystone-78bffc6747-6kvnb\" (UID: \"5e5ad3cf-0d96-43a2-b8cb-38e7210af15a\") " pod="openstack-kuttl-tests/keystone-78bffc6747-6kvnb" Mar 16 16:08:12 crc kubenswrapper[5120]: I0316 16:08:12.008800 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5e5ad3cf-0d96-43a2-b8cb-38e7210af15a-scripts\") pod \"keystone-78bffc6747-6kvnb\" (UID: \"5e5ad3cf-0d96-43a2-b8cb-38e7210af15a\") " pod="openstack-kuttl-tests/keystone-78bffc6747-6kvnb" Mar 16 16:08:12 crc kubenswrapper[5120]: I0316 16:08:12.009164 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5e5ad3cf-0d96-43a2-b8cb-38e7210af15a-combined-ca-bundle\") pod \"keystone-78bffc6747-6kvnb\" (UID: \"5e5ad3cf-0d96-43a2-b8cb-38e7210af15a\") " pod="openstack-kuttl-tests/keystone-78bffc6747-6kvnb" Mar 16 16:08:12 crc kubenswrapper[5120]: I0316 16:08:12.024437 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:08:12 crc kubenswrapper[5120]: I0316 16:08:12.204350 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-78bffc6747-6kvnb" Mar 16 16:08:12 crc kubenswrapper[5120]: I0316 16:08:12.528032 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:08:12 crc kubenswrapper[5120]: I0316 16:08:12.692672 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"2eb7df4e-20b6-4d77-bdac-4031fdb1f508","Type":"ContainerStarted","Data":"8deacf4f9b8757e17d89c32f7e90e72a60014782120e9a079eff886acea301e1"} Mar 16 16:08:12 crc kubenswrapper[5120]: I0316 16:08:12.696558 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"7bc08750-9598-442b-bcf1-832c03bd9432","Type":"ContainerStarted","Data":"e29ea48cfbd5c5f6265d16d7108d84e1dd034a46ccc40d0d9d7fd08ed2e5da63"} Mar 16 16:08:12 crc kubenswrapper[5120]: I0316 16:08:12.742100 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-78bffc6747-6kvnb"] Mar 16 16:08:12 crc kubenswrapper[5120]: W0316 16:08:12.750646 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5e5ad3cf_0d96_43a2_b8cb_38e7210af15a.slice/crio-63b5a49d2e4b838a689a8649f979202cbbabfd19252305bc0d63d60d8f17703f WatchSource:0}: Error finding container 63b5a49d2e4b838a689a8649f979202cbbabfd19252305bc0d63d60d8f17703f: Status 404 returned error can't find the container with id 63b5a49d2e4b838a689a8649f979202cbbabfd19252305bc0d63d60d8f17703f Mar 16 16:08:12 crc kubenswrapper[5120]: I0316 16:08:12.889494 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:08:12 crc kubenswrapper[5120]: I0316 16:08:12.889531 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:08:12 crc kubenswrapper[5120]: I0316 16:08:12.940097 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:08:12 crc kubenswrapper[5120]: I0316 16:08:12.943683 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:08:13 crc kubenswrapper[5120]: I0316 16:08:13.706352 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-78bffc6747-6kvnb" event={"ID":"5e5ad3cf-0d96-43a2-b8cb-38e7210af15a","Type":"ContainerStarted","Data":"ba03d7a9aa13d3fbfdb1a3d6582a793bbd788100c52fcb6baa98e4ee06d7e9a1"} Mar 16 16:08:13 crc kubenswrapper[5120]: I0316 16:08:13.706698 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/keystone-78bffc6747-6kvnb" Mar 16 16:08:13 crc kubenswrapper[5120]: I0316 16:08:13.706713 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-78bffc6747-6kvnb" event={"ID":"5e5ad3cf-0d96-43a2-b8cb-38e7210af15a","Type":"ContainerStarted","Data":"63b5a49d2e4b838a689a8649f979202cbbabfd19252305bc0d63d60d8f17703f"} Mar 16 16:08:13 crc kubenswrapper[5120]: I0316 16:08:13.709294 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"7bc08750-9598-442b-bcf1-832c03bd9432","Type":"ContainerStarted","Data":"47a4697567e393eacb347c53b75205266abf3b34d4f39f985f621b4b619fd3a5"} Mar 16 16:08:13 crc kubenswrapper[5120]: I0316 16:08:13.709408 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="7bc08750-9598-442b-bcf1-832c03bd9432" containerName="cinder-api-log" containerID="cri-o://e29ea48cfbd5c5f6265d16d7108d84e1dd034a46ccc40d0d9d7fd08ed2e5da63" gracePeriod=30 Mar 16 16:08:13 crc kubenswrapper[5120]: I0316 16:08:13.709461 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="7bc08750-9598-442b-bcf1-832c03bd9432" containerName="cinder-api" containerID="cri-o://47a4697567e393eacb347c53b75205266abf3b34d4f39f985f621b4b619fd3a5" gracePeriod=30 Mar 16 16:08:13 crc kubenswrapper[5120]: I0316 16:08:13.709426 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:08:13 crc kubenswrapper[5120]: I0316 16:08:13.712705 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"2eb7df4e-20b6-4d77-bdac-4031fdb1f508","Type":"ContainerStarted","Data":"f9a2ba8327e3d14325c56002c5cd800d88fffa53d313223aa185d25f6a73f808"} Mar 16 16:08:13 crc kubenswrapper[5120]: I0316 16:08:13.719686 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"b0c8669e-9bed-4d78-b8aa-2387c52883dc","Type":"ContainerStarted","Data":"67a82f51ede00e20ec89f6a8768ba01afa7639101cb9e4bcd88951308f73672d"} Mar 16 16:08:13 crc kubenswrapper[5120]: I0316 16:08:13.719817 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="b0c8669e-9bed-4d78-b8aa-2387c52883dc" containerName="ceilometer-central-agent" containerID="cri-o://3fb635153db3db49485fd01f65fa7b1de81669992480520d53a133d41a73ec11" gracePeriod=30 Mar 16 16:08:13 crc kubenswrapper[5120]: I0316 16:08:13.719880 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="b0c8669e-9bed-4d78-b8aa-2387c52883dc" containerName="sg-core" containerID="cri-o://1c29f1213ef135fa32af90b552238ff2243862beed0351fffd01d96f8ba35ca2" gracePeriod=30 Mar 16 16:08:13 crc kubenswrapper[5120]: I0316 16:08:13.719901 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="b0c8669e-9bed-4d78-b8aa-2387c52883dc" containerName="ceilometer-notification-agent" containerID="cri-o://9532fd324ce6895773a690c6c8a01fa2a5a4bd2b1862161397f01c796cfb112c" gracePeriod=30 Mar 16 16:08:13 crc kubenswrapper[5120]: I0316 16:08:13.719957 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="b0c8669e-9bed-4d78-b8aa-2387c52883dc" containerName="proxy-httpd" containerID="cri-o://67a82f51ede00e20ec89f6a8768ba01afa7639101cb9e4bcd88951308f73672d" gracePeriod=30 Mar 16 16:08:13 crc kubenswrapper[5120]: I0316 16:08:13.720315 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:08:13 crc kubenswrapper[5120]: I0316 16:08:13.720437 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:08:13 crc kubenswrapper[5120]: I0316 16:08:13.720459 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:08:13 crc kubenswrapper[5120]: I0316 16:08:13.751439 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-78bffc6747-6kvnb" podStartSLOduration=2.751419973 podStartE2EDuration="2.751419973s" podCreationTimestamp="2026-03-16 16:08:11 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:08:13.727993244 +0000 UTC m=+2195.881924901" watchObservedRunningTime="2026-03-16 16:08:13.751419973 +0000 UTC m=+2195.905351630" Mar 16 16:08:13 crc kubenswrapper[5120]: I0316 16:08:13.758180 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-scheduler-0" podStartSLOduration=4.758161787 podStartE2EDuration="4.758161787s" podCreationTimestamp="2026-03-16 16:08:09 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:08:13.751215238 +0000 UTC m=+2195.905146895" watchObservedRunningTime="2026-03-16 16:08:13.758161787 +0000 UTC m=+2195.912093444" Mar 16 16:08:13 crc kubenswrapper[5120]: I0316 16:08:13.784585 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=3.421928931 podStartE2EDuration="9.784242379s" podCreationTimestamp="2026-03-16 16:08:04 +0000 UTC" firstStartedPulling="2026-03-16 16:08:06.238584742 +0000 UTC m=+2188.392516399" lastFinishedPulling="2026-03-16 16:08:12.60089819 +0000 UTC m=+2194.754829847" observedRunningTime="2026-03-16 16:08:13.776728234 +0000 UTC m=+2195.930659891" watchObservedRunningTime="2026-03-16 16:08:13.784242379 +0000 UTC m=+2195.938174036" Mar 16 16:08:13 crc kubenswrapper[5120]: I0316 16:08:13.799673 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-api-0" podStartSLOduration=4.79965489 podStartE2EDuration="4.79965489s" podCreationTimestamp="2026-03-16 16:08:09 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:08:13.792441812 +0000 UTC m=+2195.946373469" watchObservedRunningTime="2026-03-16 16:08:13.79965489 +0000 UTC m=+2195.953586547" Mar 16 16:08:14 crc kubenswrapper[5120]: I0316 16:08:14.045719 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:08:14 crc kubenswrapper[5120]: I0316 16:08:14.045950 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:08:14 crc kubenswrapper[5120]: I0316 16:08:14.102979 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:08:14 crc kubenswrapper[5120]: I0316 16:08:14.115111 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:08:14 crc kubenswrapper[5120]: I0316 16:08:14.678138 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:08:14 crc kubenswrapper[5120]: I0316 16:08:14.751429 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7bc08750-9598-442b-bcf1-832c03bd9432-scripts\") pod \"7bc08750-9598-442b-bcf1-832c03bd9432\" (UID: \"7bc08750-9598-442b-bcf1-832c03bd9432\") " Mar 16 16:08:14 crc kubenswrapper[5120]: I0316 16:08:14.751853 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7bc08750-9598-442b-bcf1-832c03bd9432-combined-ca-bundle\") pod \"7bc08750-9598-442b-bcf1-832c03bd9432\" (UID: \"7bc08750-9598-442b-bcf1-832c03bd9432\") " Mar 16 16:08:14 crc kubenswrapper[5120]: I0316 16:08:14.751920 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/7bc08750-9598-442b-bcf1-832c03bd9432-etc-machine-id\") pod \"7bc08750-9598-442b-bcf1-832c03bd9432\" (UID: \"7bc08750-9598-442b-bcf1-832c03bd9432\") " Mar 16 16:08:14 crc kubenswrapper[5120]: I0316 16:08:14.751954 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/7bc08750-9598-442b-bcf1-832c03bd9432-config-data-custom\") pod \"7bc08750-9598-442b-bcf1-832c03bd9432\" (UID: \"7bc08750-9598-442b-bcf1-832c03bd9432\") " Mar 16 16:08:14 crc kubenswrapper[5120]: I0316 16:08:14.752055 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7bc08750-9598-442b-bcf1-832c03bd9432-logs\") pod \"7bc08750-9598-442b-bcf1-832c03bd9432\" (UID: \"7bc08750-9598-442b-bcf1-832c03bd9432\") " Mar 16 16:08:14 crc kubenswrapper[5120]: I0316 16:08:14.752179 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l9g7g\" (UniqueName: \"kubernetes.io/projected/7bc08750-9598-442b-bcf1-832c03bd9432-kube-api-access-l9g7g\") pod \"7bc08750-9598-442b-bcf1-832c03bd9432\" (UID: \"7bc08750-9598-442b-bcf1-832c03bd9432\") " Mar 16 16:08:14 crc kubenswrapper[5120]: I0316 16:08:14.752234 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7bc08750-9598-442b-bcf1-832c03bd9432-config-data\") pod \"7bc08750-9598-442b-bcf1-832c03bd9432\" (UID: \"7bc08750-9598-442b-bcf1-832c03bd9432\") " Mar 16 16:08:14 crc kubenswrapper[5120]: I0316 16:08:14.752951 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/7bc08750-9598-442b-bcf1-832c03bd9432-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "7bc08750-9598-442b-bcf1-832c03bd9432" (UID: "7bc08750-9598-442b-bcf1-832c03bd9432"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 16:08:14 crc kubenswrapper[5120]: I0316 16:08:14.756141 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7bc08750-9598-442b-bcf1-832c03bd9432-logs" (OuterVolumeSpecName: "logs") pod "7bc08750-9598-442b-bcf1-832c03bd9432" (UID: "7bc08750-9598-442b-bcf1-832c03bd9432"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:08:14 crc kubenswrapper[5120]: I0316 16:08:14.763011 5120 generic.go:358] "Generic (PLEG): container finished" podID="b0c8669e-9bed-4d78-b8aa-2387c52883dc" containerID="67a82f51ede00e20ec89f6a8768ba01afa7639101cb9e4bcd88951308f73672d" exitCode=0 Mar 16 16:08:14 crc kubenswrapper[5120]: I0316 16:08:14.763048 5120 generic.go:358] "Generic (PLEG): container finished" podID="b0c8669e-9bed-4d78-b8aa-2387c52883dc" containerID="1c29f1213ef135fa32af90b552238ff2243862beed0351fffd01d96f8ba35ca2" exitCode=2 Mar 16 16:08:14 crc kubenswrapper[5120]: I0316 16:08:14.763056 5120 generic.go:358] "Generic (PLEG): container finished" podID="b0c8669e-9bed-4d78-b8aa-2387c52883dc" containerID="9532fd324ce6895773a690c6c8a01fa2a5a4bd2b1862161397f01c796cfb112c" exitCode=0 Mar 16 16:08:14 crc kubenswrapper[5120]: I0316 16:08:14.763063 5120 generic.go:358] "Generic (PLEG): container finished" podID="b0c8669e-9bed-4d78-b8aa-2387c52883dc" containerID="3fb635153db3db49485fd01f65fa7b1de81669992480520d53a133d41a73ec11" exitCode=0 Mar 16 16:08:14 crc kubenswrapper[5120]: I0316 16:08:14.763480 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"b0c8669e-9bed-4d78-b8aa-2387c52883dc","Type":"ContainerDied","Data":"67a82f51ede00e20ec89f6a8768ba01afa7639101cb9e4bcd88951308f73672d"} Mar 16 16:08:14 crc kubenswrapper[5120]: I0316 16:08:14.763515 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"b0c8669e-9bed-4d78-b8aa-2387c52883dc","Type":"ContainerDied","Data":"1c29f1213ef135fa32af90b552238ff2243862beed0351fffd01d96f8ba35ca2"} Mar 16 16:08:14 crc kubenswrapper[5120]: I0316 16:08:14.763530 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"b0c8669e-9bed-4d78-b8aa-2387c52883dc","Type":"ContainerDied","Data":"9532fd324ce6895773a690c6c8a01fa2a5a4bd2b1862161397f01c796cfb112c"} Mar 16 16:08:14 crc kubenswrapper[5120]: I0316 16:08:14.763543 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"b0c8669e-9bed-4d78-b8aa-2387c52883dc","Type":"ContainerDied","Data":"3fb635153db3db49485fd01f65fa7b1de81669992480520d53a133d41a73ec11"} Mar 16 16:08:14 crc kubenswrapper[5120]: I0316 16:08:14.766900 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7bc08750-9598-442b-bcf1-832c03bd9432-kube-api-access-l9g7g" (OuterVolumeSpecName: "kube-api-access-l9g7g") pod "7bc08750-9598-442b-bcf1-832c03bd9432" (UID: "7bc08750-9598-442b-bcf1-832c03bd9432"). InnerVolumeSpecName "kube-api-access-l9g7g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:08:14 crc kubenswrapper[5120]: I0316 16:08:14.767075 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7bc08750-9598-442b-bcf1-832c03bd9432-scripts" (OuterVolumeSpecName: "scripts") pod "7bc08750-9598-442b-bcf1-832c03bd9432" (UID: "7bc08750-9598-442b-bcf1-832c03bd9432"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:08:14 crc kubenswrapper[5120]: I0316 16:08:14.768170 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7bc08750-9598-442b-bcf1-832c03bd9432-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "7bc08750-9598-442b-bcf1-832c03bd9432" (UID: "7bc08750-9598-442b-bcf1-832c03bd9432"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:08:14 crc kubenswrapper[5120]: I0316 16:08:14.784228 5120 generic.go:358] "Generic (PLEG): container finished" podID="7bc08750-9598-442b-bcf1-832c03bd9432" containerID="47a4697567e393eacb347c53b75205266abf3b34d4f39f985f621b4b619fd3a5" exitCode=0 Mar 16 16:08:14 crc kubenswrapper[5120]: I0316 16:08:14.784267 5120 generic.go:358] "Generic (PLEG): container finished" podID="7bc08750-9598-442b-bcf1-832c03bd9432" containerID="e29ea48cfbd5c5f6265d16d7108d84e1dd034a46ccc40d0d9d7fd08ed2e5da63" exitCode=143 Mar 16 16:08:14 crc kubenswrapper[5120]: I0316 16:08:14.786175 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:08:14 crc kubenswrapper[5120]: I0316 16:08:14.786770 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"7bc08750-9598-442b-bcf1-832c03bd9432","Type":"ContainerDied","Data":"47a4697567e393eacb347c53b75205266abf3b34d4f39f985f621b4b619fd3a5"} Mar 16 16:08:14 crc kubenswrapper[5120]: I0316 16:08:14.786822 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"7bc08750-9598-442b-bcf1-832c03bd9432","Type":"ContainerDied","Data":"e29ea48cfbd5c5f6265d16d7108d84e1dd034a46ccc40d0d9d7fd08ed2e5da63"} Mar 16 16:08:14 crc kubenswrapper[5120]: I0316 16:08:14.786842 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:08:14 crc kubenswrapper[5120]: I0316 16:08:14.786858 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"7bc08750-9598-442b-bcf1-832c03bd9432","Type":"ContainerDied","Data":"763ea76ada7319bb1b68b4f630fa306f94e1094af757d729db8cb9a0674b0f4f"} Mar 16 16:08:14 crc kubenswrapper[5120]: I0316 16:08:14.786878 5120 scope.go:117] "RemoveContainer" containerID="47a4697567e393eacb347c53b75205266abf3b34d4f39f985f621b4b619fd3a5" Mar 16 16:08:14 crc kubenswrapper[5120]: I0316 16:08:14.789727 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7bc08750-9598-442b-bcf1-832c03bd9432-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "7bc08750-9598-442b-bcf1-832c03bd9432" (UID: "7bc08750-9598-442b-bcf1-832c03bd9432"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:08:14 crc kubenswrapper[5120]: I0316 16:08:14.789924 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:08:14 crc kubenswrapper[5120]: I0316 16:08:14.847577 5120 scope.go:117] "RemoveContainer" containerID="e29ea48cfbd5c5f6265d16d7108d84e1dd034a46ccc40d0d9d7fd08ed2e5da63" Mar 16 16:08:14 crc kubenswrapper[5120]: I0316 16:08:14.854732 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7bc08750-9598-442b-bcf1-832c03bd9432-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:08:14 crc kubenswrapper[5120]: I0316 16:08:14.854764 5120 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/7bc08750-9598-442b-bcf1-832c03bd9432-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 16:08:14 crc kubenswrapper[5120]: I0316 16:08:14.854775 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/7bc08750-9598-442b-bcf1-832c03bd9432-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:08:14 crc kubenswrapper[5120]: I0316 16:08:14.854798 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7bc08750-9598-442b-bcf1-832c03bd9432-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:08:14 crc kubenswrapper[5120]: I0316 16:08:14.854811 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l9g7g\" (UniqueName: \"kubernetes.io/projected/7bc08750-9598-442b-bcf1-832c03bd9432-kube-api-access-l9g7g\") on node \"crc\" DevicePath \"\"" Mar 16 16:08:14 crc kubenswrapper[5120]: I0316 16:08:14.854821 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7bc08750-9598-442b-bcf1-832c03bd9432-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:08:14 crc kubenswrapper[5120]: I0316 16:08:14.870833 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7bc08750-9598-442b-bcf1-832c03bd9432-config-data" (OuterVolumeSpecName: "config-data") pod "7bc08750-9598-442b-bcf1-832c03bd9432" (UID: "7bc08750-9598-442b-bcf1-832c03bd9432"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:08:14 crc kubenswrapper[5120]: I0316 16:08:14.879939 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:08:14 crc kubenswrapper[5120]: I0316 16:08:14.912022 5120 scope.go:117] "RemoveContainer" containerID="47a4697567e393eacb347c53b75205266abf3b34d4f39f985f621b4b619fd3a5" Mar 16 16:08:14 crc kubenswrapper[5120]: E0316 16:08:14.914167 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"47a4697567e393eacb347c53b75205266abf3b34d4f39f985f621b4b619fd3a5\": container with ID starting with 47a4697567e393eacb347c53b75205266abf3b34d4f39f985f621b4b619fd3a5 not found: ID does not exist" containerID="47a4697567e393eacb347c53b75205266abf3b34d4f39f985f621b4b619fd3a5" Mar 16 16:08:14 crc kubenswrapper[5120]: I0316 16:08:14.914291 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47a4697567e393eacb347c53b75205266abf3b34d4f39f985f621b4b619fd3a5"} err="failed to get container status \"47a4697567e393eacb347c53b75205266abf3b34d4f39f985f621b4b619fd3a5\": rpc error: code = NotFound desc = could not find container \"47a4697567e393eacb347c53b75205266abf3b34d4f39f985f621b4b619fd3a5\": container with ID starting with 47a4697567e393eacb347c53b75205266abf3b34d4f39f985f621b4b619fd3a5 not found: ID does not exist" Mar 16 16:08:14 crc kubenswrapper[5120]: I0316 16:08:14.914358 5120 scope.go:117] "RemoveContainer" containerID="e29ea48cfbd5c5f6265d16d7108d84e1dd034a46ccc40d0d9d7fd08ed2e5da63" Mar 16 16:08:14 crc kubenswrapper[5120]: E0316 16:08:14.915945 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e29ea48cfbd5c5f6265d16d7108d84e1dd034a46ccc40d0d9d7fd08ed2e5da63\": container with ID starting with e29ea48cfbd5c5f6265d16d7108d84e1dd034a46ccc40d0d9d7fd08ed2e5da63 not found: ID does not exist" containerID="e29ea48cfbd5c5f6265d16d7108d84e1dd034a46ccc40d0d9d7fd08ed2e5da63" Mar 16 16:08:14 crc kubenswrapper[5120]: I0316 16:08:14.916019 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e29ea48cfbd5c5f6265d16d7108d84e1dd034a46ccc40d0d9d7fd08ed2e5da63"} err="failed to get container status \"e29ea48cfbd5c5f6265d16d7108d84e1dd034a46ccc40d0d9d7fd08ed2e5da63\": rpc error: code = NotFound desc = could not find container \"e29ea48cfbd5c5f6265d16d7108d84e1dd034a46ccc40d0d9d7fd08ed2e5da63\": container with ID starting with e29ea48cfbd5c5f6265d16d7108d84e1dd034a46ccc40d0d9d7fd08ed2e5da63 not found: ID does not exist" Mar 16 16:08:14 crc kubenswrapper[5120]: I0316 16:08:14.916109 5120 scope.go:117] "RemoveContainer" containerID="47a4697567e393eacb347c53b75205266abf3b34d4f39f985f621b4b619fd3a5" Mar 16 16:08:14 crc kubenswrapper[5120]: I0316 16:08:14.918007 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47a4697567e393eacb347c53b75205266abf3b34d4f39f985f621b4b619fd3a5"} err="failed to get container status \"47a4697567e393eacb347c53b75205266abf3b34d4f39f985f621b4b619fd3a5\": rpc error: code = NotFound desc = could not find container \"47a4697567e393eacb347c53b75205266abf3b34d4f39f985f621b4b619fd3a5\": container with ID starting with 47a4697567e393eacb347c53b75205266abf3b34d4f39f985f621b4b619fd3a5 not found: ID does not exist" Mar 16 16:08:14 crc kubenswrapper[5120]: I0316 16:08:14.918056 5120 scope.go:117] "RemoveContainer" containerID="e29ea48cfbd5c5f6265d16d7108d84e1dd034a46ccc40d0d9d7fd08ed2e5da63" Mar 16 16:08:14 crc kubenswrapper[5120]: I0316 16:08:14.918356 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e29ea48cfbd5c5f6265d16d7108d84e1dd034a46ccc40d0d9d7fd08ed2e5da63"} err="failed to get container status \"e29ea48cfbd5c5f6265d16d7108d84e1dd034a46ccc40d0d9d7fd08ed2e5da63\": rpc error: code = NotFound desc = could not find container \"e29ea48cfbd5c5f6265d16d7108d84e1dd034a46ccc40d0d9d7fd08ed2e5da63\": container with ID starting with e29ea48cfbd5c5f6265d16d7108d84e1dd034a46ccc40d0d9d7fd08ed2e5da63 not found: ID does not exist" Mar 16 16:08:14 crc kubenswrapper[5120]: I0316 16:08:14.955518 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b0c8669e-9bed-4d78-b8aa-2387c52883dc-combined-ca-bundle\") pod \"b0c8669e-9bed-4d78-b8aa-2387c52883dc\" (UID: \"b0c8669e-9bed-4d78-b8aa-2387c52883dc\") " Mar 16 16:08:14 crc kubenswrapper[5120]: I0316 16:08:14.955676 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/b0c8669e-9bed-4d78-b8aa-2387c52883dc-run-httpd\") pod \"b0c8669e-9bed-4d78-b8aa-2387c52883dc\" (UID: \"b0c8669e-9bed-4d78-b8aa-2387c52883dc\") " Mar 16 16:08:14 crc kubenswrapper[5120]: I0316 16:08:14.955735 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-prdkt\" (UniqueName: \"kubernetes.io/projected/b0c8669e-9bed-4d78-b8aa-2387c52883dc-kube-api-access-prdkt\") pod \"b0c8669e-9bed-4d78-b8aa-2387c52883dc\" (UID: \"b0c8669e-9bed-4d78-b8aa-2387c52883dc\") " Mar 16 16:08:14 crc kubenswrapper[5120]: I0316 16:08:14.955853 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/b0c8669e-9bed-4d78-b8aa-2387c52883dc-sg-core-conf-yaml\") pod \"b0c8669e-9bed-4d78-b8aa-2387c52883dc\" (UID: \"b0c8669e-9bed-4d78-b8aa-2387c52883dc\") " Mar 16 16:08:14 crc kubenswrapper[5120]: I0316 16:08:14.955888 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b0c8669e-9bed-4d78-b8aa-2387c52883dc-config-data\") pod \"b0c8669e-9bed-4d78-b8aa-2387c52883dc\" (UID: \"b0c8669e-9bed-4d78-b8aa-2387c52883dc\") " Mar 16 16:08:14 crc kubenswrapper[5120]: I0316 16:08:14.956015 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b0c8669e-9bed-4d78-b8aa-2387c52883dc-scripts\") pod \"b0c8669e-9bed-4d78-b8aa-2387c52883dc\" (UID: \"b0c8669e-9bed-4d78-b8aa-2387c52883dc\") " Mar 16 16:08:14 crc kubenswrapper[5120]: I0316 16:08:14.956068 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/b0c8669e-9bed-4d78-b8aa-2387c52883dc-log-httpd\") pod \"b0c8669e-9bed-4d78-b8aa-2387c52883dc\" (UID: \"b0c8669e-9bed-4d78-b8aa-2387c52883dc\") " Mar 16 16:08:14 crc kubenswrapper[5120]: I0316 16:08:14.956490 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7bc08750-9598-442b-bcf1-832c03bd9432-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:08:14 crc kubenswrapper[5120]: I0316 16:08:14.957685 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0c8669e-9bed-4d78-b8aa-2387c52883dc-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "b0c8669e-9bed-4d78-b8aa-2387c52883dc" (UID: "b0c8669e-9bed-4d78-b8aa-2387c52883dc"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:08:14 crc kubenswrapper[5120]: I0316 16:08:14.958133 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0c8669e-9bed-4d78-b8aa-2387c52883dc-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "b0c8669e-9bed-4d78-b8aa-2387c52883dc" (UID: "b0c8669e-9bed-4d78-b8aa-2387c52883dc"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:08:14 crc kubenswrapper[5120]: I0316 16:08:14.972734 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0c8669e-9bed-4d78-b8aa-2387c52883dc-kube-api-access-prdkt" (OuterVolumeSpecName: "kube-api-access-prdkt") pod "b0c8669e-9bed-4d78-b8aa-2387c52883dc" (UID: "b0c8669e-9bed-4d78-b8aa-2387c52883dc"). InnerVolumeSpecName "kube-api-access-prdkt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:08:14 crc kubenswrapper[5120]: I0316 16:08:14.987269 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b0c8669e-9bed-4d78-b8aa-2387c52883dc-scripts" (OuterVolumeSpecName: "scripts") pod "b0c8669e-9bed-4d78-b8aa-2387c52883dc" (UID: "b0c8669e-9bed-4d78-b8aa-2387c52883dc"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:08:15 crc kubenswrapper[5120]: I0316 16:08:15.000022 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b0c8669e-9bed-4d78-b8aa-2387c52883dc-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "b0c8669e-9bed-4d78-b8aa-2387c52883dc" (UID: "b0c8669e-9bed-4d78-b8aa-2387c52883dc"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:08:15 crc kubenswrapper[5120]: I0316 16:08:15.058134 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/b0c8669e-9bed-4d78-b8aa-2387c52883dc-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:08:15 crc kubenswrapper[5120]: I0316 16:08:15.058174 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-prdkt\" (UniqueName: \"kubernetes.io/projected/b0c8669e-9bed-4d78-b8aa-2387c52883dc-kube-api-access-prdkt\") on node \"crc\" DevicePath \"\"" Mar 16 16:08:15 crc kubenswrapper[5120]: I0316 16:08:15.058184 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/b0c8669e-9bed-4d78-b8aa-2387c52883dc-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 16:08:15 crc kubenswrapper[5120]: I0316 16:08:15.058194 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b0c8669e-9bed-4d78-b8aa-2387c52883dc-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:08:15 crc kubenswrapper[5120]: I0316 16:08:15.058205 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/b0c8669e-9bed-4d78-b8aa-2387c52883dc-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:08:15 crc kubenswrapper[5120]: I0316 16:08:15.071294 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b0c8669e-9bed-4d78-b8aa-2387c52883dc-config-data" (OuterVolumeSpecName: "config-data") pod "b0c8669e-9bed-4d78-b8aa-2387c52883dc" (UID: "b0c8669e-9bed-4d78-b8aa-2387c52883dc"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:08:15 crc kubenswrapper[5120]: I0316 16:08:15.135895 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:08:15 crc kubenswrapper[5120]: I0316 16:08:15.152566 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:08:15 crc kubenswrapper[5120]: I0316 16:08:15.161887 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:08:15 crc kubenswrapper[5120]: I0316 16:08:15.164034 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b0c8669e-9bed-4d78-b8aa-2387c52883dc-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:08:15 crc kubenswrapper[5120]: I0316 16:08:15.183126 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:08:15 crc kubenswrapper[5120]: I0316 16:08:15.196454 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7bc08750-9598-442b-bcf1-832c03bd9432" containerName="cinder-api" Mar 16 16:08:15 crc kubenswrapper[5120]: I0316 16:08:15.196497 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bc08750-9598-442b-bcf1-832c03bd9432" containerName="cinder-api" Mar 16 16:08:15 crc kubenswrapper[5120]: I0316 16:08:15.196518 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0c8669e-9bed-4d78-b8aa-2387c52883dc" containerName="ceilometer-notification-agent" Mar 16 16:08:15 crc kubenswrapper[5120]: I0316 16:08:15.196525 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0c8669e-9bed-4d78-b8aa-2387c52883dc" containerName="ceilometer-notification-agent" Mar 16 16:08:15 crc kubenswrapper[5120]: I0316 16:08:15.196539 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0c8669e-9bed-4d78-b8aa-2387c52883dc" containerName="ceilometer-central-agent" Mar 16 16:08:15 crc kubenswrapper[5120]: I0316 16:08:15.196545 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0c8669e-9bed-4d78-b8aa-2387c52883dc" containerName="ceilometer-central-agent" Mar 16 16:08:15 crc kubenswrapper[5120]: I0316 16:08:15.196560 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0c8669e-9bed-4d78-b8aa-2387c52883dc" containerName="sg-core" Mar 16 16:08:15 crc kubenswrapper[5120]: I0316 16:08:15.196566 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0c8669e-9bed-4d78-b8aa-2387c52883dc" containerName="sg-core" Mar 16 16:08:15 crc kubenswrapper[5120]: I0316 16:08:15.196576 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0c8669e-9bed-4d78-b8aa-2387c52883dc" containerName="proxy-httpd" Mar 16 16:08:15 crc kubenswrapper[5120]: I0316 16:08:15.196581 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0c8669e-9bed-4d78-b8aa-2387c52883dc" containerName="proxy-httpd" Mar 16 16:08:15 crc kubenswrapper[5120]: I0316 16:08:15.196614 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7bc08750-9598-442b-bcf1-832c03bd9432" containerName="cinder-api-log" Mar 16 16:08:15 crc kubenswrapper[5120]: I0316 16:08:15.196620 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bc08750-9598-442b-bcf1-832c03bd9432" containerName="cinder-api-log" Mar 16 16:08:15 crc kubenswrapper[5120]: I0316 16:08:15.196768 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="b0c8669e-9bed-4d78-b8aa-2387c52883dc" containerName="ceilometer-central-agent" Mar 16 16:08:15 crc kubenswrapper[5120]: I0316 16:08:15.196797 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7bc08750-9598-442b-bcf1-832c03bd9432" containerName="cinder-api-log" Mar 16 16:08:15 crc kubenswrapper[5120]: I0316 16:08:15.196809 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="b0c8669e-9bed-4d78-b8aa-2387c52883dc" containerName="proxy-httpd" Mar 16 16:08:15 crc kubenswrapper[5120]: I0316 16:08:15.196818 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="b0c8669e-9bed-4d78-b8aa-2387c52883dc" containerName="ceilometer-notification-agent" Mar 16 16:08:15 crc kubenswrapper[5120]: I0316 16:08:15.196830 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="b0c8669e-9bed-4d78-b8aa-2387c52883dc" containerName="sg-core" Mar 16 16:08:15 crc kubenswrapper[5120]: I0316 16:08:15.196839 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7bc08750-9598-442b-bcf1-832c03bd9432" containerName="cinder-api" Mar 16 16:08:15 crc kubenswrapper[5120]: I0316 16:08:15.214967 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:08:15 crc kubenswrapper[5120]: I0316 16:08:15.215115 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:08:15 crc kubenswrapper[5120]: I0316 16:08:15.221425 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-cinder-internal-svc\"" Mar 16 16:08:15 crc kubenswrapper[5120]: I0316 16:08:15.221626 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-api-config-data\"" Mar 16 16:08:15 crc kubenswrapper[5120]: I0316 16:08:15.221654 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-cinder-public-svc\"" Mar 16 16:08:15 crc kubenswrapper[5120]: I0316 16:08:15.240233 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b0c8669e-9bed-4d78-b8aa-2387c52883dc-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "b0c8669e-9bed-4d78-b8aa-2387c52883dc" (UID: "b0c8669e-9bed-4d78-b8aa-2387c52883dc"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:08:15 crc kubenswrapper[5120]: I0316 16:08:15.266576 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47pl7\" (UniqueName: \"kubernetes.io/projected/06f34d35-9700-4048-9f1a-e773e02efbd6-kube-api-access-47pl7\") pod \"cinder-api-0\" (UID: \"06f34d35-9700-4048-9f1a-e773e02efbd6\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:08:15 crc kubenswrapper[5120]: I0316 16:08:15.266745 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/06f34d35-9700-4048-9f1a-e773e02efbd6-config-data\") pod \"cinder-api-0\" (UID: \"06f34d35-9700-4048-9f1a-e773e02efbd6\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:08:15 crc kubenswrapper[5120]: I0316 16:08:15.266811 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/06f34d35-9700-4048-9f1a-e773e02efbd6-etc-machine-id\") pod \"cinder-api-0\" (UID: \"06f34d35-9700-4048-9f1a-e773e02efbd6\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:08:15 crc kubenswrapper[5120]: I0316 16:08:15.266920 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/06f34d35-9700-4048-9f1a-e773e02efbd6-logs\") pod \"cinder-api-0\" (UID: \"06f34d35-9700-4048-9f1a-e773e02efbd6\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:08:15 crc kubenswrapper[5120]: I0316 16:08:15.266991 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/06f34d35-9700-4048-9f1a-e773e02efbd6-scripts\") pod \"cinder-api-0\" (UID: \"06f34d35-9700-4048-9f1a-e773e02efbd6\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:08:15 crc kubenswrapper[5120]: I0316 16:08:15.267052 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/06f34d35-9700-4048-9f1a-e773e02efbd6-public-tls-certs\") pod \"cinder-api-0\" (UID: \"06f34d35-9700-4048-9f1a-e773e02efbd6\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:08:15 crc kubenswrapper[5120]: I0316 16:08:15.267093 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/06f34d35-9700-4048-9f1a-e773e02efbd6-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"06f34d35-9700-4048-9f1a-e773e02efbd6\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:08:15 crc kubenswrapper[5120]: I0316 16:08:15.267172 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/06f34d35-9700-4048-9f1a-e773e02efbd6-config-data-custom\") pod \"cinder-api-0\" (UID: \"06f34d35-9700-4048-9f1a-e773e02efbd6\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:08:15 crc kubenswrapper[5120]: I0316 16:08:15.267264 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/06f34d35-9700-4048-9f1a-e773e02efbd6-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"06f34d35-9700-4048-9f1a-e773e02efbd6\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:08:15 crc kubenswrapper[5120]: I0316 16:08:15.267331 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b0c8669e-9bed-4d78-b8aa-2387c52883dc-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:08:15 crc kubenswrapper[5120]: I0316 16:08:15.372032 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/06f34d35-9700-4048-9f1a-e773e02efbd6-config-data\") pod \"cinder-api-0\" (UID: \"06f34d35-9700-4048-9f1a-e773e02efbd6\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:08:15 crc kubenswrapper[5120]: I0316 16:08:15.372088 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/06f34d35-9700-4048-9f1a-e773e02efbd6-etc-machine-id\") pod \"cinder-api-0\" (UID: \"06f34d35-9700-4048-9f1a-e773e02efbd6\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:08:15 crc kubenswrapper[5120]: I0316 16:08:15.372161 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/06f34d35-9700-4048-9f1a-e773e02efbd6-logs\") pod \"cinder-api-0\" (UID: \"06f34d35-9700-4048-9f1a-e773e02efbd6\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:08:15 crc kubenswrapper[5120]: I0316 16:08:15.372204 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/06f34d35-9700-4048-9f1a-e773e02efbd6-scripts\") pod \"cinder-api-0\" (UID: \"06f34d35-9700-4048-9f1a-e773e02efbd6\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:08:15 crc kubenswrapper[5120]: I0316 16:08:15.372240 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/06f34d35-9700-4048-9f1a-e773e02efbd6-public-tls-certs\") pod \"cinder-api-0\" (UID: \"06f34d35-9700-4048-9f1a-e773e02efbd6\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:08:15 crc kubenswrapper[5120]: I0316 16:08:15.372280 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/06f34d35-9700-4048-9f1a-e773e02efbd6-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"06f34d35-9700-4048-9f1a-e773e02efbd6\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:08:15 crc kubenswrapper[5120]: I0316 16:08:15.372306 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/06f34d35-9700-4048-9f1a-e773e02efbd6-config-data-custom\") pod \"cinder-api-0\" (UID: \"06f34d35-9700-4048-9f1a-e773e02efbd6\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:08:15 crc kubenswrapper[5120]: I0316 16:08:15.372383 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/06f34d35-9700-4048-9f1a-e773e02efbd6-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"06f34d35-9700-4048-9f1a-e773e02efbd6\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:08:15 crc kubenswrapper[5120]: I0316 16:08:15.372448 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-47pl7\" (UniqueName: \"kubernetes.io/projected/06f34d35-9700-4048-9f1a-e773e02efbd6-kube-api-access-47pl7\") pod \"cinder-api-0\" (UID: \"06f34d35-9700-4048-9f1a-e773e02efbd6\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:08:15 crc kubenswrapper[5120]: I0316 16:08:15.374020 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/06f34d35-9700-4048-9f1a-e773e02efbd6-logs\") pod \"cinder-api-0\" (UID: \"06f34d35-9700-4048-9f1a-e773e02efbd6\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:08:15 crc kubenswrapper[5120]: I0316 16:08:15.374166 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/06f34d35-9700-4048-9f1a-e773e02efbd6-etc-machine-id\") pod \"cinder-api-0\" (UID: \"06f34d35-9700-4048-9f1a-e773e02efbd6\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:08:15 crc kubenswrapper[5120]: I0316 16:08:15.382385 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/06f34d35-9700-4048-9f1a-e773e02efbd6-scripts\") pod \"cinder-api-0\" (UID: \"06f34d35-9700-4048-9f1a-e773e02efbd6\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:08:15 crc kubenswrapper[5120]: I0316 16:08:15.384733 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/06f34d35-9700-4048-9f1a-e773e02efbd6-config-data\") pod \"cinder-api-0\" (UID: \"06f34d35-9700-4048-9f1a-e773e02efbd6\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:08:15 crc kubenswrapper[5120]: I0316 16:08:15.400365 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/06f34d35-9700-4048-9f1a-e773e02efbd6-config-data-custom\") pod \"cinder-api-0\" (UID: \"06f34d35-9700-4048-9f1a-e773e02efbd6\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:08:15 crc kubenswrapper[5120]: I0316 16:08:15.400717 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/06f34d35-9700-4048-9f1a-e773e02efbd6-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"06f34d35-9700-4048-9f1a-e773e02efbd6\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:08:15 crc kubenswrapper[5120]: I0316 16:08:15.402175 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/06f34d35-9700-4048-9f1a-e773e02efbd6-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"06f34d35-9700-4048-9f1a-e773e02efbd6\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:08:15 crc kubenswrapper[5120]: I0316 16:08:15.415544 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/06f34d35-9700-4048-9f1a-e773e02efbd6-public-tls-certs\") pod \"cinder-api-0\" (UID: \"06f34d35-9700-4048-9f1a-e773e02efbd6\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:08:15 crc kubenswrapper[5120]: I0316 16:08:15.415614 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-47pl7\" (UniqueName: \"kubernetes.io/projected/06f34d35-9700-4048-9f1a-e773e02efbd6-kube-api-access-47pl7\") pod \"cinder-api-0\" (UID: \"06f34d35-9700-4048-9f1a-e773e02efbd6\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:08:15 crc kubenswrapper[5120]: I0316 16:08:15.620223 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-6877f8555d-c7rkf" Mar 16 16:08:15 crc kubenswrapper[5120]: I0316 16:08:15.622674 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:08:15 crc kubenswrapper[5120]: I0316 16:08:15.846607 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"b0c8669e-9bed-4d78-b8aa-2387c52883dc","Type":"ContainerDied","Data":"b2935213d7656084dd33cfa6ebf711308bdc13f55c6a63059287c4975ae01a24"} Mar 16 16:08:15 crc kubenswrapper[5120]: I0316 16:08:15.846675 5120 scope.go:117] "RemoveContainer" containerID="67a82f51ede00e20ec89f6a8768ba01afa7639101cb9e4bcd88951308f73672d" Mar 16 16:08:15 crc kubenswrapper[5120]: I0316 16:08:15.849690 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:08:15 crc kubenswrapper[5120]: I0316 16:08:15.910999 5120 scope.go:117] "RemoveContainer" containerID="1c29f1213ef135fa32af90b552238ff2243862beed0351fffd01d96f8ba35ca2" Mar 16 16:08:15 crc kubenswrapper[5120]: I0316 16:08:15.911328 5120 generic.go:358] "Generic (PLEG): container finished" podID="eb1e112a-eec6-4aef-93fb-f809f1c7e6be" containerID="71b738fa5abb74599f1af84a27985cc6034f03854d7df7ddd1a81542eeb16682" exitCode=0 Mar 16 16:08:15 crc kubenswrapper[5120]: I0316 16:08:15.912648 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-wz6tz" event={"ID":"eb1e112a-eec6-4aef-93fb-f809f1c7e6be","Type":"ContainerDied","Data":"71b738fa5abb74599f1af84a27985cc6034f03854d7df7ddd1a81542eeb16682"} Mar 16 16:08:15 crc kubenswrapper[5120]: I0316 16:08:15.951891 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:08:15 crc kubenswrapper[5120]: W0316 16:08:15.969501 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod06f34d35_9700_4048_9f1a_e773e02efbd6.slice/crio-243fc1d5fe4ecdd4bc27a2c69824bbdae7b2fb757493a1962cdb83fbb75f3125 WatchSource:0}: Error finding container 243fc1d5fe4ecdd4bc27a2c69824bbdae7b2fb757493a1962cdb83fbb75f3125: Status 404 returned error can't find the container with id 243fc1d5fe4ecdd4bc27a2c69824bbdae7b2fb757493a1962cdb83fbb75f3125 Mar 16 16:08:15 crc kubenswrapper[5120]: I0316 16:08:15.987845 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:08:15 crc kubenswrapper[5120]: I0316 16:08:15.993005 5120 scope.go:117] "RemoveContainer" containerID="9532fd324ce6895773a690c6c8a01fa2a5a4bd2b1862161397f01c796cfb112c" Mar 16 16:08:16 crc kubenswrapper[5120]: I0316 16:08:16.016830 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:08:16 crc kubenswrapper[5120]: I0316 16:08:16.028431 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:08:16 crc kubenswrapper[5120]: I0316 16:08:16.035424 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:08:16 crc kubenswrapper[5120]: I0316 16:08:16.037923 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 16:08:16 crc kubenswrapper[5120]: I0316 16:08:16.038168 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 16:08:16 crc kubenswrapper[5120]: I0316 16:08:16.047832 5120 scope.go:117] "RemoveContainer" containerID="3fb635153db3db49485fd01f65fa7b1de81669992480520d53a133d41a73ec11" Mar 16 16:08:16 crc kubenswrapper[5120]: I0316 16:08:16.078861 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:08:16 crc kubenswrapper[5120]: I0316 16:08:16.101842 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48-config-data\") pod \"ceilometer-0\" (UID: \"0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:08:16 crc kubenswrapper[5120]: I0316 16:08:16.101898 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48-log-httpd\") pod \"ceilometer-0\" (UID: \"0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:08:16 crc kubenswrapper[5120]: I0316 16:08:16.101947 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:08:16 crc kubenswrapper[5120]: I0316 16:08:16.102110 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45xzf\" (UniqueName: \"kubernetes.io/projected/0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48-kube-api-access-45xzf\") pod \"ceilometer-0\" (UID: \"0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:08:16 crc kubenswrapper[5120]: I0316 16:08:16.102236 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:08:16 crc kubenswrapper[5120]: I0316 16:08:16.102834 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48-run-httpd\") pod \"ceilometer-0\" (UID: \"0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:08:16 crc kubenswrapper[5120]: I0316 16:08:16.102886 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48-scripts\") pod \"ceilometer-0\" (UID: \"0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:08:16 crc kubenswrapper[5120]: I0316 16:08:16.121114 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-6877f8555d-c7rkf" Mar 16 16:08:16 crc kubenswrapper[5120]: I0316 16:08:16.207932 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-45xzf\" (UniqueName: \"kubernetes.io/projected/0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48-kube-api-access-45xzf\") pod \"ceilometer-0\" (UID: \"0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:08:16 crc kubenswrapper[5120]: I0316 16:08:16.208213 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:08:16 crc kubenswrapper[5120]: I0316 16:08:16.208355 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48-run-httpd\") pod \"ceilometer-0\" (UID: \"0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:08:16 crc kubenswrapper[5120]: I0316 16:08:16.208410 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48-scripts\") pod \"ceilometer-0\" (UID: \"0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:08:16 crc kubenswrapper[5120]: I0316 16:08:16.208434 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48-config-data\") pod \"ceilometer-0\" (UID: \"0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:08:16 crc kubenswrapper[5120]: I0316 16:08:16.208469 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48-log-httpd\") pod \"ceilometer-0\" (UID: \"0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:08:16 crc kubenswrapper[5120]: I0316 16:08:16.208559 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:08:16 crc kubenswrapper[5120]: I0316 16:08:16.210672 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48-run-httpd\") pod \"ceilometer-0\" (UID: \"0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:08:16 crc kubenswrapper[5120]: I0316 16:08:16.210963 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48-log-httpd\") pod \"ceilometer-0\" (UID: \"0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:08:16 crc kubenswrapper[5120]: I0316 16:08:16.225710 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48-config-data\") pod \"ceilometer-0\" (UID: \"0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:08:16 crc kubenswrapper[5120]: I0316 16:08:16.229348 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:08:16 crc kubenswrapper[5120]: I0316 16:08:16.233326 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:08:16 crc kubenswrapper[5120]: I0316 16:08:16.236723 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48-scripts\") pod \"ceilometer-0\" (UID: \"0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:08:16 crc kubenswrapper[5120]: I0316 16:08:16.243559 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-45xzf\" (UniqueName: \"kubernetes.io/projected/0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48-kube-api-access-45xzf\") pod \"ceilometer-0\" (UID: \"0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:08:16 crc kubenswrapper[5120]: I0316 16:08:16.341591 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-7cbc6f47fd-sq9tz"] Mar 16 16:08:16 crc kubenswrapper[5120]: I0316 16:08:16.362758 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:08:16 crc kubenswrapper[5120]: I0316 16:08:16.363467 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-7cbc6f47fd-sq9tz" Mar 16 16:08:16 crc kubenswrapper[5120]: I0316 16:08:16.373589 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-7cbc6f47fd-sq9tz"] Mar 16 16:08:16 crc kubenswrapper[5120]: I0316 16:08:16.386088 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-worker-5566b7bdc5-j8gmc"] Mar 16 16:08:16 crc kubenswrapper[5120]: I0316 16:08:16.406264 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-5566b7bdc5-j8gmc"] Mar 16 16:08:16 crc kubenswrapper[5120]: I0316 16:08:16.407245 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-5566b7bdc5-j8gmc" Mar 16 16:08:16 crc kubenswrapper[5120]: I0316 16:08:16.418962 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/78af3e38-08bb-4b78-89aa-8d76d361e2bc-logs\") pod \"barbican-keystone-listener-7cbc6f47fd-sq9tz\" (UID: \"78af3e38-08bb-4b78-89aa-8d76d361e2bc\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7cbc6f47fd-sq9tz" Mar 16 16:08:16 crc kubenswrapper[5120]: I0316 16:08:16.419059 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/78af3e38-08bb-4b78-89aa-8d76d361e2bc-config-data-custom\") pod \"barbican-keystone-listener-7cbc6f47fd-sq9tz\" (UID: \"78af3e38-08bb-4b78-89aa-8d76d361e2bc\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7cbc6f47fd-sq9tz" Mar 16 16:08:16 crc kubenswrapper[5120]: I0316 16:08:16.419105 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/78af3e38-08bb-4b78-89aa-8d76d361e2bc-combined-ca-bundle\") pod \"barbican-keystone-listener-7cbc6f47fd-sq9tz\" (UID: \"78af3e38-08bb-4b78-89aa-8d76d361e2bc\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7cbc6f47fd-sq9tz" Mar 16 16:08:16 crc kubenswrapper[5120]: I0316 16:08:16.419164 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lws72\" (UniqueName: \"kubernetes.io/projected/78af3e38-08bb-4b78-89aa-8d76d361e2bc-kube-api-access-lws72\") pod \"barbican-keystone-listener-7cbc6f47fd-sq9tz\" (UID: \"78af3e38-08bb-4b78-89aa-8d76d361e2bc\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7cbc6f47fd-sq9tz" Mar 16 16:08:16 crc kubenswrapper[5120]: I0316 16:08:16.419238 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/78af3e38-08bb-4b78-89aa-8d76d361e2bc-config-data\") pod \"barbican-keystone-listener-7cbc6f47fd-sq9tz\" (UID: \"78af3e38-08bb-4b78-89aa-8d76d361e2bc\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7cbc6f47fd-sq9tz" Mar 16 16:08:16 crc kubenswrapper[5120]: I0316 16:08:16.523102 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/78af3e38-08bb-4b78-89aa-8d76d361e2bc-logs\") pod \"barbican-keystone-listener-7cbc6f47fd-sq9tz\" (UID: \"78af3e38-08bb-4b78-89aa-8d76d361e2bc\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7cbc6f47fd-sq9tz" Mar 16 16:08:16 crc kubenswrapper[5120]: I0316 16:08:16.523206 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/78af3e38-08bb-4b78-89aa-8d76d361e2bc-config-data-custom\") pod \"barbican-keystone-listener-7cbc6f47fd-sq9tz\" (UID: \"78af3e38-08bb-4b78-89aa-8d76d361e2bc\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7cbc6f47fd-sq9tz" Mar 16 16:08:16 crc kubenswrapper[5120]: I0316 16:08:16.523240 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rx8c\" (UniqueName: \"kubernetes.io/projected/663dca84-6d86-4d19-a614-6f4fb2f04e2e-kube-api-access-8rx8c\") pod \"barbican-worker-5566b7bdc5-j8gmc\" (UID: \"663dca84-6d86-4d19-a614-6f4fb2f04e2e\") " pod="openstack-kuttl-tests/barbican-worker-5566b7bdc5-j8gmc" Mar 16 16:08:16 crc kubenswrapper[5120]: I0316 16:08:16.523268 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/663dca84-6d86-4d19-a614-6f4fb2f04e2e-config-data-custom\") pod \"barbican-worker-5566b7bdc5-j8gmc\" (UID: \"663dca84-6d86-4d19-a614-6f4fb2f04e2e\") " pod="openstack-kuttl-tests/barbican-worker-5566b7bdc5-j8gmc" Mar 16 16:08:16 crc kubenswrapper[5120]: I0316 16:08:16.523296 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/78af3e38-08bb-4b78-89aa-8d76d361e2bc-combined-ca-bundle\") pod \"barbican-keystone-listener-7cbc6f47fd-sq9tz\" (UID: \"78af3e38-08bb-4b78-89aa-8d76d361e2bc\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7cbc6f47fd-sq9tz" Mar 16 16:08:16 crc kubenswrapper[5120]: I0316 16:08:16.523322 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/663dca84-6d86-4d19-a614-6f4fb2f04e2e-config-data\") pod \"barbican-worker-5566b7bdc5-j8gmc\" (UID: \"663dca84-6d86-4d19-a614-6f4fb2f04e2e\") " pod="openstack-kuttl-tests/barbican-worker-5566b7bdc5-j8gmc" Mar 16 16:08:16 crc kubenswrapper[5120]: I0316 16:08:16.523380 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lws72\" (UniqueName: \"kubernetes.io/projected/78af3e38-08bb-4b78-89aa-8d76d361e2bc-kube-api-access-lws72\") pod \"barbican-keystone-listener-7cbc6f47fd-sq9tz\" (UID: \"78af3e38-08bb-4b78-89aa-8d76d361e2bc\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7cbc6f47fd-sq9tz" Mar 16 16:08:16 crc kubenswrapper[5120]: I0316 16:08:16.523397 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/663dca84-6d86-4d19-a614-6f4fb2f04e2e-combined-ca-bundle\") pod \"barbican-worker-5566b7bdc5-j8gmc\" (UID: \"663dca84-6d86-4d19-a614-6f4fb2f04e2e\") " pod="openstack-kuttl-tests/barbican-worker-5566b7bdc5-j8gmc" Mar 16 16:08:16 crc kubenswrapper[5120]: I0316 16:08:16.523440 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/663dca84-6d86-4d19-a614-6f4fb2f04e2e-logs\") pod \"barbican-worker-5566b7bdc5-j8gmc\" (UID: \"663dca84-6d86-4d19-a614-6f4fb2f04e2e\") " pod="openstack-kuttl-tests/barbican-worker-5566b7bdc5-j8gmc" Mar 16 16:08:16 crc kubenswrapper[5120]: I0316 16:08:16.523498 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/78af3e38-08bb-4b78-89aa-8d76d361e2bc-config-data\") pod \"barbican-keystone-listener-7cbc6f47fd-sq9tz\" (UID: \"78af3e38-08bb-4b78-89aa-8d76d361e2bc\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7cbc6f47fd-sq9tz" Mar 16 16:08:16 crc kubenswrapper[5120]: I0316 16:08:16.535068 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/78af3e38-08bb-4b78-89aa-8d76d361e2bc-config-data\") pod \"barbican-keystone-listener-7cbc6f47fd-sq9tz\" (UID: \"78af3e38-08bb-4b78-89aa-8d76d361e2bc\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7cbc6f47fd-sq9tz" Mar 16 16:08:16 crc kubenswrapper[5120]: I0316 16:08:16.535950 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-57f8f7777b-s7zn5"] Mar 16 16:08:16 crc kubenswrapper[5120]: I0316 16:08:16.536243 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-57f8f7777b-s7zn5" podUID="c04f4eb6-ad5d-4996-a59e-c26968e5439a" containerName="barbican-api-log" containerID="cri-o://08c398795e3394c5a740a16d4d39c55a16da4356f66cdcff6ba806ae8d19251d" gracePeriod=30 Mar 16 16:08:16 crc kubenswrapper[5120]: I0316 16:08:16.536689 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-57f8f7777b-s7zn5" podUID="c04f4eb6-ad5d-4996-a59e-c26968e5439a" containerName="barbican-api" containerID="cri-o://ed5b76468decf3d0970fe991b7842f6cd57f0b2740f7bd9e44e27a86bb568652" gracePeriod=30 Mar 16 16:08:16 crc kubenswrapper[5120]: I0316 16:08:16.549872 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/78af3e38-08bb-4b78-89aa-8d76d361e2bc-logs\") pod \"barbican-keystone-listener-7cbc6f47fd-sq9tz\" (UID: \"78af3e38-08bb-4b78-89aa-8d76d361e2bc\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7cbc6f47fd-sq9tz" Mar 16 16:08:16 crc kubenswrapper[5120]: I0316 16:08:16.549930 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-api-f9bc678f8-6p72p"] Mar 16 16:08:16 crc kubenswrapper[5120]: I0316 16:08:16.553333 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/78af3e38-08bb-4b78-89aa-8d76d361e2bc-config-data-custom\") pod \"barbican-keystone-listener-7cbc6f47fd-sq9tz\" (UID: \"78af3e38-08bb-4b78-89aa-8d76d361e2bc\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7cbc6f47fd-sq9tz" Mar 16 16:08:16 crc kubenswrapper[5120]: I0316 16:08:16.553830 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/78af3e38-08bb-4b78-89aa-8d76d361e2bc-combined-ca-bundle\") pod \"barbican-keystone-listener-7cbc6f47fd-sq9tz\" (UID: \"78af3e38-08bb-4b78-89aa-8d76d361e2bc\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7cbc6f47fd-sq9tz" Mar 16 16:08:16 crc kubenswrapper[5120]: I0316 16:08:16.554096 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-57f8f7777b-s7zn5" podUID="c04f4eb6-ad5d-4996-a59e-c26968e5439a" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.0.19:9311/healthcheck\": EOF" Mar 16 16:08:16 crc kubenswrapper[5120]: I0316 16:08:16.556031 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-57f8f7777b-s7zn5" podUID="c04f4eb6-ad5d-4996-a59e-c26968e5439a" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.0.19:9311/healthcheck\": EOF" Mar 16 16:08:16 crc kubenswrapper[5120]: I0316 16:08:16.556328 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openstack-kuttl-tests/barbican-api-57f8f7777b-s7zn5" podUID="c04f4eb6-ad5d-4996-a59e-c26968e5439a" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.0.19:9311/healthcheck\": EOF" Mar 16 16:08:16 crc kubenswrapper[5120]: I0316 16:08:16.556642 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openstack-kuttl-tests/barbican-api-57f8f7777b-s7zn5" podUID="c04f4eb6-ad5d-4996-a59e-c26968e5439a" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.0.19:9311/healthcheck\": EOF" Mar 16 16:08:16 crc kubenswrapper[5120]: I0316 16:08:16.572402 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lws72\" (UniqueName: \"kubernetes.io/projected/78af3e38-08bb-4b78-89aa-8d76d361e2bc-kube-api-access-lws72\") pod \"barbican-keystone-listener-7cbc6f47fd-sq9tz\" (UID: \"78af3e38-08bb-4b78-89aa-8d76d361e2bc\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7cbc6f47fd-sq9tz" Mar 16 16:08:16 crc kubenswrapper[5120]: I0316 16:08:16.576283 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-f9bc678f8-6p72p"] Mar 16 16:08:16 crc kubenswrapper[5120]: I0316 16:08:16.576437 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-f9bc678f8-6p72p" Mar 16 16:08:16 crc kubenswrapper[5120]: I0316 16:08:16.632827 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/241ac7ce-90fa-4222-a274-ee00c4ba33a3-logs\") pod \"barbican-api-f9bc678f8-6p72p\" (UID: \"241ac7ce-90fa-4222-a274-ee00c4ba33a3\") " pod="openstack-kuttl-tests/barbican-api-f9bc678f8-6p72p" Mar 16 16:08:16 crc kubenswrapper[5120]: I0316 16:08:16.632874 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/241ac7ce-90fa-4222-a274-ee00c4ba33a3-config-data-custom\") pod \"barbican-api-f9bc678f8-6p72p\" (UID: \"241ac7ce-90fa-4222-a274-ee00c4ba33a3\") " pod="openstack-kuttl-tests/barbican-api-f9bc678f8-6p72p" Mar 16 16:08:16 crc kubenswrapper[5120]: I0316 16:08:16.632911 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8rx8c\" (UniqueName: \"kubernetes.io/projected/663dca84-6d86-4d19-a614-6f4fb2f04e2e-kube-api-access-8rx8c\") pod \"barbican-worker-5566b7bdc5-j8gmc\" (UID: \"663dca84-6d86-4d19-a614-6f4fb2f04e2e\") " pod="openstack-kuttl-tests/barbican-worker-5566b7bdc5-j8gmc" Mar 16 16:08:16 crc kubenswrapper[5120]: I0316 16:08:16.632940 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/663dca84-6d86-4d19-a614-6f4fb2f04e2e-config-data-custom\") pod \"barbican-worker-5566b7bdc5-j8gmc\" (UID: \"663dca84-6d86-4d19-a614-6f4fb2f04e2e\") " pod="openstack-kuttl-tests/barbican-worker-5566b7bdc5-j8gmc" Mar 16 16:08:16 crc kubenswrapper[5120]: I0316 16:08:16.632973 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/663dca84-6d86-4d19-a614-6f4fb2f04e2e-config-data\") pod \"barbican-worker-5566b7bdc5-j8gmc\" (UID: \"663dca84-6d86-4d19-a614-6f4fb2f04e2e\") " pod="openstack-kuttl-tests/barbican-worker-5566b7bdc5-j8gmc" Mar 16 16:08:16 crc kubenswrapper[5120]: I0316 16:08:16.633028 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/663dca84-6d86-4d19-a614-6f4fb2f04e2e-combined-ca-bundle\") pod \"barbican-worker-5566b7bdc5-j8gmc\" (UID: \"663dca84-6d86-4d19-a614-6f4fb2f04e2e\") " pod="openstack-kuttl-tests/barbican-worker-5566b7bdc5-j8gmc" Mar 16 16:08:16 crc kubenswrapper[5120]: I0316 16:08:16.633046 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q29hj\" (UniqueName: \"kubernetes.io/projected/241ac7ce-90fa-4222-a274-ee00c4ba33a3-kube-api-access-q29hj\") pod \"barbican-api-f9bc678f8-6p72p\" (UID: \"241ac7ce-90fa-4222-a274-ee00c4ba33a3\") " pod="openstack-kuttl-tests/barbican-api-f9bc678f8-6p72p" Mar 16 16:08:16 crc kubenswrapper[5120]: I0316 16:08:16.633081 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/663dca84-6d86-4d19-a614-6f4fb2f04e2e-logs\") pod \"barbican-worker-5566b7bdc5-j8gmc\" (UID: \"663dca84-6d86-4d19-a614-6f4fb2f04e2e\") " pod="openstack-kuttl-tests/barbican-worker-5566b7bdc5-j8gmc" Mar 16 16:08:16 crc kubenswrapper[5120]: I0316 16:08:16.633098 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/241ac7ce-90fa-4222-a274-ee00c4ba33a3-internal-tls-certs\") pod \"barbican-api-f9bc678f8-6p72p\" (UID: \"241ac7ce-90fa-4222-a274-ee00c4ba33a3\") " pod="openstack-kuttl-tests/barbican-api-f9bc678f8-6p72p" Mar 16 16:08:16 crc kubenswrapper[5120]: I0316 16:08:16.633167 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/241ac7ce-90fa-4222-a274-ee00c4ba33a3-public-tls-certs\") pod \"barbican-api-f9bc678f8-6p72p\" (UID: \"241ac7ce-90fa-4222-a274-ee00c4ba33a3\") " pod="openstack-kuttl-tests/barbican-api-f9bc678f8-6p72p" Mar 16 16:08:16 crc kubenswrapper[5120]: I0316 16:08:16.633229 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/241ac7ce-90fa-4222-a274-ee00c4ba33a3-combined-ca-bundle\") pod \"barbican-api-f9bc678f8-6p72p\" (UID: \"241ac7ce-90fa-4222-a274-ee00c4ba33a3\") " pod="openstack-kuttl-tests/barbican-api-f9bc678f8-6p72p" Mar 16 16:08:16 crc kubenswrapper[5120]: I0316 16:08:16.633283 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/241ac7ce-90fa-4222-a274-ee00c4ba33a3-config-data\") pod \"barbican-api-f9bc678f8-6p72p\" (UID: \"241ac7ce-90fa-4222-a274-ee00c4ba33a3\") " pod="openstack-kuttl-tests/barbican-api-f9bc678f8-6p72p" Mar 16 16:08:16 crc kubenswrapper[5120]: I0316 16:08:16.636678 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/663dca84-6d86-4d19-a614-6f4fb2f04e2e-logs\") pod \"barbican-worker-5566b7bdc5-j8gmc\" (UID: \"663dca84-6d86-4d19-a614-6f4fb2f04e2e\") " pod="openstack-kuttl-tests/barbican-worker-5566b7bdc5-j8gmc" Mar 16 16:08:16 crc kubenswrapper[5120]: I0316 16:08:16.649647 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/663dca84-6d86-4d19-a614-6f4fb2f04e2e-config-data\") pod \"barbican-worker-5566b7bdc5-j8gmc\" (UID: \"663dca84-6d86-4d19-a614-6f4fb2f04e2e\") " pod="openstack-kuttl-tests/barbican-worker-5566b7bdc5-j8gmc" Mar 16 16:08:16 crc kubenswrapper[5120]: I0316 16:08:16.656345 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/663dca84-6d86-4d19-a614-6f4fb2f04e2e-combined-ca-bundle\") pod \"barbican-worker-5566b7bdc5-j8gmc\" (UID: \"663dca84-6d86-4d19-a614-6f4fb2f04e2e\") " pod="openstack-kuttl-tests/barbican-worker-5566b7bdc5-j8gmc" Mar 16 16:08:16 crc kubenswrapper[5120]: I0316 16:08:16.656432 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/663dca84-6d86-4d19-a614-6f4fb2f04e2e-config-data-custom\") pod \"barbican-worker-5566b7bdc5-j8gmc\" (UID: \"663dca84-6d86-4d19-a614-6f4fb2f04e2e\") " pod="openstack-kuttl-tests/barbican-worker-5566b7bdc5-j8gmc" Mar 16 16:08:16 crc kubenswrapper[5120]: I0316 16:08:16.670260 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rx8c\" (UniqueName: \"kubernetes.io/projected/663dca84-6d86-4d19-a614-6f4fb2f04e2e-kube-api-access-8rx8c\") pod \"barbican-worker-5566b7bdc5-j8gmc\" (UID: \"663dca84-6d86-4d19-a614-6f4fb2f04e2e\") " pod="openstack-kuttl-tests/barbican-worker-5566b7bdc5-j8gmc" Mar 16 16:08:16 crc kubenswrapper[5120]: I0316 16:08:16.687033 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7bc08750-9598-442b-bcf1-832c03bd9432" path="/var/lib/kubelet/pods/7bc08750-9598-442b-bcf1-832c03bd9432/volumes" Mar 16 16:08:16 crc kubenswrapper[5120]: I0316 16:08:16.687797 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b0c8669e-9bed-4d78-b8aa-2387c52883dc" path="/var/lib/kubelet/pods/b0c8669e-9bed-4d78-b8aa-2387c52883dc/volumes" Mar 16 16:08:16 crc kubenswrapper[5120]: I0316 16:08:16.735918 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/241ac7ce-90fa-4222-a274-ee00c4ba33a3-combined-ca-bundle\") pod \"barbican-api-f9bc678f8-6p72p\" (UID: \"241ac7ce-90fa-4222-a274-ee00c4ba33a3\") " pod="openstack-kuttl-tests/barbican-api-f9bc678f8-6p72p" Mar 16 16:08:16 crc kubenswrapper[5120]: I0316 16:08:16.735996 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/241ac7ce-90fa-4222-a274-ee00c4ba33a3-config-data\") pod \"barbican-api-f9bc678f8-6p72p\" (UID: \"241ac7ce-90fa-4222-a274-ee00c4ba33a3\") " pod="openstack-kuttl-tests/barbican-api-f9bc678f8-6p72p" Mar 16 16:08:16 crc kubenswrapper[5120]: I0316 16:08:16.736049 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/241ac7ce-90fa-4222-a274-ee00c4ba33a3-logs\") pod \"barbican-api-f9bc678f8-6p72p\" (UID: \"241ac7ce-90fa-4222-a274-ee00c4ba33a3\") " pod="openstack-kuttl-tests/barbican-api-f9bc678f8-6p72p" Mar 16 16:08:16 crc kubenswrapper[5120]: I0316 16:08:16.736072 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/241ac7ce-90fa-4222-a274-ee00c4ba33a3-config-data-custom\") pod \"barbican-api-f9bc678f8-6p72p\" (UID: \"241ac7ce-90fa-4222-a274-ee00c4ba33a3\") " pod="openstack-kuttl-tests/barbican-api-f9bc678f8-6p72p" Mar 16 16:08:16 crc kubenswrapper[5120]: I0316 16:08:16.736158 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q29hj\" (UniqueName: \"kubernetes.io/projected/241ac7ce-90fa-4222-a274-ee00c4ba33a3-kube-api-access-q29hj\") pod \"barbican-api-f9bc678f8-6p72p\" (UID: \"241ac7ce-90fa-4222-a274-ee00c4ba33a3\") " pod="openstack-kuttl-tests/barbican-api-f9bc678f8-6p72p" Mar 16 16:08:16 crc kubenswrapper[5120]: I0316 16:08:16.736215 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/241ac7ce-90fa-4222-a274-ee00c4ba33a3-internal-tls-certs\") pod \"barbican-api-f9bc678f8-6p72p\" (UID: \"241ac7ce-90fa-4222-a274-ee00c4ba33a3\") " pod="openstack-kuttl-tests/barbican-api-f9bc678f8-6p72p" Mar 16 16:08:16 crc kubenswrapper[5120]: I0316 16:08:16.736273 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/241ac7ce-90fa-4222-a274-ee00c4ba33a3-public-tls-certs\") pod \"barbican-api-f9bc678f8-6p72p\" (UID: \"241ac7ce-90fa-4222-a274-ee00c4ba33a3\") " pod="openstack-kuttl-tests/barbican-api-f9bc678f8-6p72p" Mar 16 16:08:16 crc kubenswrapper[5120]: I0316 16:08:16.739216 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/241ac7ce-90fa-4222-a274-ee00c4ba33a3-logs\") pod \"barbican-api-f9bc678f8-6p72p\" (UID: \"241ac7ce-90fa-4222-a274-ee00c4ba33a3\") " pod="openstack-kuttl-tests/barbican-api-f9bc678f8-6p72p" Mar 16 16:08:16 crc kubenswrapper[5120]: I0316 16:08:16.742442 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/241ac7ce-90fa-4222-a274-ee00c4ba33a3-public-tls-certs\") pod \"barbican-api-f9bc678f8-6p72p\" (UID: \"241ac7ce-90fa-4222-a274-ee00c4ba33a3\") " pod="openstack-kuttl-tests/barbican-api-f9bc678f8-6p72p" Mar 16 16:08:16 crc kubenswrapper[5120]: I0316 16:08:16.743740 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/241ac7ce-90fa-4222-a274-ee00c4ba33a3-config-data\") pod \"barbican-api-f9bc678f8-6p72p\" (UID: \"241ac7ce-90fa-4222-a274-ee00c4ba33a3\") " pod="openstack-kuttl-tests/barbican-api-f9bc678f8-6p72p" Mar 16 16:08:16 crc kubenswrapper[5120]: I0316 16:08:16.747604 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-7cbc6f47fd-sq9tz" Mar 16 16:08:16 crc kubenswrapper[5120]: I0316 16:08:16.751279 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/241ac7ce-90fa-4222-a274-ee00c4ba33a3-config-data-custom\") pod \"barbican-api-f9bc678f8-6p72p\" (UID: \"241ac7ce-90fa-4222-a274-ee00c4ba33a3\") " pod="openstack-kuttl-tests/barbican-api-f9bc678f8-6p72p" Mar 16 16:08:16 crc kubenswrapper[5120]: I0316 16:08:16.751688 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/241ac7ce-90fa-4222-a274-ee00c4ba33a3-internal-tls-certs\") pod \"barbican-api-f9bc678f8-6p72p\" (UID: \"241ac7ce-90fa-4222-a274-ee00c4ba33a3\") " pod="openstack-kuttl-tests/barbican-api-f9bc678f8-6p72p" Mar 16 16:08:16 crc kubenswrapper[5120]: I0316 16:08:16.751730 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/241ac7ce-90fa-4222-a274-ee00c4ba33a3-combined-ca-bundle\") pod \"barbican-api-f9bc678f8-6p72p\" (UID: \"241ac7ce-90fa-4222-a274-ee00c4ba33a3\") " pod="openstack-kuttl-tests/barbican-api-f9bc678f8-6p72p" Mar 16 16:08:16 crc kubenswrapper[5120]: I0316 16:08:16.757266 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q29hj\" (UniqueName: \"kubernetes.io/projected/241ac7ce-90fa-4222-a274-ee00c4ba33a3-kube-api-access-q29hj\") pod \"barbican-api-f9bc678f8-6p72p\" (UID: \"241ac7ce-90fa-4222-a274-ee00c4ba33a3\") " pod="openstack-kuttl-tests/barbican-api-f9bc678f8-6p72p" Mar 16 16:08:16 crc kubenswrapper[5120]: I0316 16:08:16.821123 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-5566b7bdc5-j8gmc" Mar 16 16:08:16 crc kubenswrapper[5120]: I0316 16:08:16.928126 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:08:16 crc kubenswrapper[5120]: I0316 16:08:16.935781 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-f9bc678f8-6p72p" Mar 16 16:08:16 crc kubenswrapper[5120]: I0316 16:08:16.957877 5120 generic.go:358] "Generic (PLEG): container finished" podID="c04f4eb6-ad5d-4996-a59e-c26968e5439a" containerID="08c398795e3394c5a740a16d4d39c55a16da4356f66cdcff6ba806ae8d19251d" exitCode=143 Mar 16 16:08:16 crc kubenswrapper[5120]: I0316 16:08:16.958091 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-57f8f7777b-s7zn5" event={"ID":"c04f4eb6-ad5d-4996-a59e-c26968e5439a","Type":"ContainerDied","Data":"08c398795e3394c5a740a16d4d39c55a16da4356f66cdcff6ba806ae8d19251d"} Mar 16 16:08:16 crc kubenswrapper[5120]: I0316 16:08:16.967181 5120 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Mar 16 16:08:16 crc kubenswrapper[5120]: I0316 16:08:16.968019 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"06f34d35-9700-4048-9f1a-e773e02efbd6","Type":"ContainerStarted","Data":"243fc1d5fe4ecdd4bc27a2c69824bbdae7b2fb757493a1962cdb83fbb75f3125"} Mar 16 16:08:16 crc kubenswrapper[5120]: I0316 16:08:16.972328 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:08:16 crc kubenswrapper[5120]: I0316 16:08:16.972452 5120 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Mar 16 16:08:17 crc kubenswrapper[5120]: I0316 16:08:17.051302 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:08:17 crc kubenswrapper[5120]: I0316 16:08:17.248264 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:08:17 crc kubenswrapper[5120]: I0316 16:08:17.376692 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-7cbc6f47fd-sq9tz"] Mar 16 16:08:17 crc kubenswrapper[5120]: I0316 16:08:17.399160 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-5566b7bdc5-j8gmc"] Mar 16 16:08:17 crc kubenswrapper[5120]: W0316 16:08:17.407602 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod663dca84_6d86_4d19_a614_6f4fb2f04e2e.slice/crio-bbc4593621ef9783c4973fb5cee3d52980a5d49c74f4a0d22154ee60033a53fe WatchSource:0}: Error finding container bbc4593621ef9783c4973fb5cee3d52980a5d49c74f4a0d22154ee60033a53fe: Status 404 returned error can't find the container with id bbc4593621ef9783c4973fb5cee3d52980a5d49c74f4a0d22154ee60033a53fe Mar 16 16:08:17 crc kubenswrapper[5120]: I0316 16:08:17.612179 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-wz6tz" Mar 16 16:08:17 crc kubenswrapper[5120]: I0316 16:08:17.674512 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-f9bc678f8-6p72p"] Mar 16 16:08:17 crc kubenswrapper[5120]: I0316 16:08:17.683996 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eb1e112a-eec6-4aef-93fb-f809f1c7e6be-combined-ca-bundle\") pod \"eb1e112a-eec6-4aef-93fb-f809f1c7e6be\" (UID: \"eb1e112a-eec6-4aef-93fb-f809f1c7e6be\") " Mar 16 16:08:17 crc kubenswrapper[5120]: I0316 16:08:17.684082 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wvl2m\" (UniqueName: \"kubernetes.io/projected/eb1e112a-eec6-4aef-93fb-f809f1c7e6be-kube-api-access-wvl2m\") pod \"eb1e112a-eec6-4aef-93fb-f809f1c7e6be\" (UID: \"eb1e112a-eec6-4aef-93fb-f809f1c7e6be\") " Mar 16 16:08:17 crc kubenswrapper[5120]: I0316 16:08:17.684104 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/eb1e112a-eec6-4aef-93fb-f809f1c7e6be-config\") pod \"eb1e112a-eec6-4aef-93fb-f809f1c7e6be\" (UID: \"eb1e112a-eec6-4aef-93fb-f809f1c7e6be\") " Mar 16 16:08:17 crc kubenswrapper[5120]: I0316 16:08:17.697601 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb1e112a-eec6-4aef-93fb-f809f1c7e6be-kube-api-access-wvl2m" (OuterVolumeSpecName: "kube-api-access-wvl2m") pod "eb1e112a-eec6-4aef-93fb-f809f1c7e6be" (UID: "eb1e112a-eec6-4aef-93fb-f809f1c7e6be"). InnerVolumeSpecName "kube-api-access-wvl2m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:08:17 crc kubenswrapper[5120]: I0316 16:08:17.723807 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:08:17 crc kubenswrapper[5120]: I0316 16:08:17.790944 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eb1e112a-eec6-4aef-93fb-f809f1c7e6be-config" (OuterVolumeSpecName: "config") pod "eb1e112a-eec6-4aef-93fb-f809f1c7e6be" (UID: "eb1e112a-eec6-4aef-93fb-f809f1c7e6be"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:08:17 crc kubenswrapper[5120]: I0316 16:08:17.798440 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wvl2m\" (UniqueName: \"kubernetes.io/projected/eb1e112a-eec6-4aef-93fb-f809f1c7e6be-kube-api-access-wvl2m\") on node \"crc\" DevicePath \"\"" Mar 16 16:08:17 crc kubenswrapper[5120]: I0316 16:08:17.798472 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/eb1e112a-eec6-4aef-93fb-f809f1c7e6be-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:08:17 crc kubenswrapper[5120]: I0316 16:08:17.799167 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eb1e112a-eec6-4aef-93fb-f809f1c7e6be-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "eb1e112a-eec6-4aef-93fb-f809f1c7e6be" (UID: "eb1e112a-eec6-4aef-93fb-f809f1c7e6be"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:08:17 crc kubenswrapper[5120]: I0316 16:08:17.900424 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eb1e112a-eec6-4aef-93fb-f809f1c7e6be-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:08:17 crc kubenswrapper[5120]: I0316 16:08:17.990390 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48","Type":"ContainerStarted","Data":"bb4e47606fe1dbd6968e56b302b0cca4c6c753419c7615c49ddff398289a5d68"} Mar 16 16:08:17 crc kubenswrapper[5120]: I0316 16:08:17.990434 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48","Type":"ContainerStarted","Data":"4ee399a7335dda8250cda5831b0db769154db956d97665896f763de12a82f3e1"} Mar 16 16:08:18 crc kubenswrapper[5120]: I0316 16:08:18.033322 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-5566b7bdc5-j8gmc" event={"ID":"663dca84-6d86-4d19-a614-6f4fb2f04e2e","Type":"ContainerStarted","Data":"817eba962a106429a987b1357e3063e8c28061cee33b51e65bc388fae18238dc"} Mar 16 16:08:18 crc kubenswrapper[5120]: I0316 16:08:18.033365 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-5566b7bdc5-j8gmc" event={"ID":"663dca84-6d86-4d19-a614-6f4fb2f04e2e","Type":"ContainerStarted","Data":"bbc4593621ef9783c4973fb5cee3d52980a5d49c74f4a0d22154ee60033a53fe"} Mar 16 16:08:18 crc kubenswrapper[5120]: I0316 16:08:18.038399 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"06f34d35-9700-4048-9f1a-e773e02efbd6","Type":"ContainerStarted","Data":"8aea814127603d95cd34517e152cdf39284d9a351843f196cfaf6129c64a2a9d"} Mar 16 16:08:18 crc kubenswrapper[5120]: I0316 16:08:18.042223 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-wz6tz" event={"ID":"eb1e112a-eec6-4aef-93fb-f809f1c7e6be","Type":"ContainerDied","Data":"861e027c0e724b4123c3373e5338d7de57fc2bdddef5d2bb8d0ff60fa967d4fa"} Mar 16 16:08:18 crc kubenswrapper[5120]: I0316 16:08:18.042273 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="861e027c0e724b4123c3373e5338d7de57fc2bdddef5d2bb8d0ff60fa967d4fa" Mar 16 16:08:18 crc kubenswrapper[5120]: I0316 16:08:18.042364 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-wz6tz" Mar 16 16:08:18 crc kubenswrapper[5120]: I0316 16:08:18.049976 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-7cbc6f47fd-sq9tz" event={"ID":"78af3e38-08bb-4b78-89aa-8d76d361e2bc","Type":"ContainerStarted","Data":"2b1607efd8a45ba58c6a4a77229af5d4110ccc7491735de70a5f1fd0ddcd119e"} Mar 16 16:08:18 crc kubenswrapper[5120]: I0316 16:08:18.050032 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-7cbc6f47fd-sq9tz" event={"ID":"78af3e38-08bb-4b78-89aa-8d76d361e2bc","Type":"ContainerStarted","Data":"0dff2016eb71385defa1f3faf5f950ad4934ab38828e061517e96e62065f2f63"} Mar 16 16:08:18 crc kubenswrapper[5120]: I0316 16:08:18.096814 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-f9bc678f8-6p72p" event={"ID":"241ac7ce-90fa-4222-a274-ee00c4ba33a3","Type":"ContainerStarted","Data":"0dadea8ab408f64e9e344819b50787a4d1b4f746bfbe3d5362a281c253d2b9e2"} Mar 16 16:08:18 crc kubenswrapper[5120]: I0316 16:08:18.096869 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-f9bc678f8-6p72p" event={"ID":"241ac7ce-90fa-4222-a274-ee00c4ba33a3","Type":"ContainerStarted","Data":"109846b33f3d0b9563ef155d7d4862eec6426141f5bd2a94c4b722ea43636d4a"} Mar 16 16:08:18 crc kubenswrapper[5120]: I0316 16:08:18.149174 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-6966b7489-j4l28"] Mar 16 16:08:18 crc kubenswrapper[5120]: I0316 16:08:18.150484 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb1e112a-eec6-4aef-93fb-f809f1c7e6be" containerName="neutron-db-sync" Mar 16 16:08:18 crc kubenswrapper[5120]: I0316 16:08:18.150503 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb1e112a-eec6-4aef-93fb-f809f1c7e6be" containerName="neutron-db-sync" Mar 16 16:08:18 crc kubenswrapper[5120]: I0316 16:08:18.150809 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="eb1e112a-eec6-4aef-93fb-f809f1c7e6be" containerName="neutron-db-sync" Mar 16 16:08:18 crc kubenswrapper[5120]: I0316 16:08:18.167671 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-6966b7489-j4l28"] Mar 16 16:08:18 crc kubenswrapper[5120]: I0316 16:08:18.167804 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-6966b7489-j4l28" Mar 16 16:08:18 crc kubenswrapper[5120]: I0316 16:08:18.174154 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-httpd-config\"" Mar 16 16:08:18 crc kubenswrapper[5120]: I0316 16:08:18.174271 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-config\"" Mar 16 16:08:18 crc kubenswrapper[5120]: I0316 16:08:18.174814 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-neutron-ovndbs\"" Mar 16 16:08:18 crc kubenswrapper[5120]: I0316 16:08:18.174992 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-neutron-dockercfg-j55dl\"" Mar 16 16:08:18 crc kubenswrapper[5120]: I0316 16:08:18.208710 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/ddb7fdf9-5c27-4d59-b778-ff2a95f45bec-httpd-config\") pod \"neutron-6966b7489-j4l28\" (UID: \"ddb7fdf9-5c27-4d59-b778-ff2a95f45bec\") " pod="openstack-kuttl-tests/neutron-6966b7489-j4l28" Mar 16 16:08:18 crc kubenswrapper[5120]: I0316 16:08:18.208886 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ddb7fdf9-5c27-4d59-b778-ff2a95f45bec-config\") pod \"neutron-6966b7489-j4l28\" (UID: \"ddb7fdf9-5c27-4d59-b778-ff2a95f45bec\") " pod="openstack-kuttl-tests/neutron-6966b7489-j4l28" Mar 16 16:08:18 crc kubenswrapper[5120]: I0316 16:08:18.209062 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/ddb7fdf9-5c27-4d59-b778-ff2a95f45bec-ovndb-tls-certs\") pod \"neutron-6966b7489-j4l28\" (UID: \"ddb7fdf9-5c27-4d59-b778-ff2a95f45bec\") " pod="openstack-kuttl-tests/neutron-6966b7489-j4l28" Mar 16 16:08:18 crc kubenswrapper[5120]: I0316 16:08:18.209085 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ddb7fdf9-5c27-4d59-b778-ff2a95f45bec-combined-ca-bundle\") pod \"neutron-6966b7489-j4l28\" (UID: \"ddb7fdf9-5c27-4d59-b778-ff2a95f45bec\") " pod="openstack-kuttl-tests/neutron-6966b7489-j4l28" Mar 16 16:08:18 crc kubenswrapper[5120]: I0316 16:08:18.209195 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9ggf\" (UniqueName: \"kubernetes.io/projected/ddb7fdf9-5c27-4d59-b778-ff2a95f45bec-kube-api-access-g9ggf\") pod \"neutron-6966b7489-j4l28\" (UID: \"ddb7fdf9-5c27-4d59-b778-ff2a95f45bec\") " pod="openstack-kuttl-tests/neutron-6966b7489-j4l28" Mar 16 16:08:18 crc kubenswrapper[5120]: I0316 16:08:18.311276 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ddb7fdf9-5c27-4d59-b778-ff2a95f45bec-config\") pod \"neutron-6966b7489-j4l28\" (UID: \"ddb7fdf9-5c27-4d59-b778-ff2a95f45bec\") " pod="openstack-kuttl-tests/neutron-6966b7489-j4l28" Mar 16 16:08:18 crc kubenswrapper[5120]: I0316 16:08:18.311410 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/ddb7fdf9-5c27-4d59-b778-ff2a95f45bec-ovndb-tls-certs\") pod \"neutron-6966b7489-j4l28\" (UID: \"ddb7fdf9-5c27-4d59-b778-ff2a95f45bec\") " pod="openstack-kuttl-tests/neutron-6966b7489-j4l28" Mar 16 16:08:18 crc kubenswrapper[5120]: I0316 16:08:18.311435 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ddb7fdf9-5c27-4d59-b778-ff2a95f45bec-combined-ca-bundle\") pod \"neutron-6966b7489-j4l28\" (UID: \"ddb7fdf9-5c27-4d59-b778-ff2a95f45bec\") " pod="openstack-kuttl-tests/neutron-6966b7489-j4l28" Mar 16 16:08:18 crc kubenswrapper[5120]: I0316 16:08:18.311499 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g9ggf\" (UniqueName: \"kubernetes.io/projected/ddb7fdf9-5c27-4d59-b778-ff2a95f45bec-kube-api-access-g9ggf\") pod \"neutron-6966b7489-j4l28\" (UID: \"ddb7fdf9-5c27-4d59-b778-ff2a95f45bec\") " pod="openstack-kuttl-tests/neutron-6966b7489-j4l28" Mar 16 16:08:18 crc kubenswrapper[5120]: I0316 16:08:18.311532 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/ddb7fdf9-5c27-4d59-b778-ff2a95f45bec-httpd-config\") pod \"neutron-6966b7489-j4l28\" (UID: \"ddb7fdf9-5c27-4d59-b778-ff2a95f45bec\") " pod="openstack-kuttl-tests/neutron-6966b7489-j4l28" Mar 16 16:08:18 crc kubenswrapper[5120]: I0316 16:08:18.320973 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/ddb7fdf9-5c27-4d59-b778-ff2a95f45bec-ovndb-tls-certs\") pod \"neutron-6966b7489-j4l28\" (UID: \"ddb7fdf9-5c27-4d59-b778-ff2a95f45bec\") " pod="openstack-kuttl-tests/neutron-6966b7489-j4l28" Mar 16 16:08:18 crc kubenswrapper[5120]: I0316 16:08:18.321333 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/ddb7fdf9-5c27-4d59-b778-ff2a95f45bec-config\") pod \"neutron-6966b7489-j4l28\" (UID: \"ddb7fdf9-5c27-4d59-b778-ff2a95f45bec\") " pod="openstack-kuttl-tests/neutron-6966b7489-j4l28" Mar 16 16:08:18 crc kubenswrapper[5120]: I0316 16:08:18.325542 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ddb7fdf9-5c27-4d59-b778-ff2a95f45bec-combined-ca-bundle\") pod \"neutron-6966b7489-j4l28\" (UID: \"ddb7fdf9-5c27-4d59-b778-ff2a95f45bec\") " pod="openstack-kuttl-tests/neutron-6966b7489-j4l28" Mar 16 16:08:18 crc kubenswrapper[5120]: I0316 16:08:18.325791 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/ddb7fdf9-5c27-4d59-b778-ff2a95f45bec-httpd-config\") pod \"neutron-6966b7489-j4l28\" (UID: \"ddb7fdf9-5c27-4d59-b778-ff2a95f45bec\") " pod="openstack-kuttl-tests/neutron-6966b7489-j4l28" Mar 16 16:08:18 crc kubenswrapper[5120]: I0316 16:08:18.340907 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9ggf\" (UniqueName: \"kubernetes.io/projected/ddb7fdf9-5c27-4d59-b778-ff2a95f45bec-kube-api-access-g9ggf\") pod \"neutron-6966b7489-j4l28\" (UID: \"ddb7fdf9-5c27-4d59-b778-ff2a95f45bec\") " pod="openstack-kuttl-tests/neutron-6966b7489-j4l28" Mar 16 16:08:18 crc kubenswrapper[5120]: I0316 16:08:18.516223 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-6966b7489-j4l28" Mar 16 16:08:19 crc kubenswrapper[5120]: I0316 16:08:19.107630 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-7cbc6f47fd-sq9tz" event={"ID":"78af3e38-08bb-4b78-89aa-8d76d361e2bc","Type":"ContainerStarted","Data":"b5ece7bb7787fcdd951d74e24ecfeafefae53d0cfce909f6180df1607ff10785"} Mar 16 16:08:19 crc kubenswrapper[5120]: I0316 16:08:19.112228 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-f9bc678f8-6p72p" event={"ID":"241ac7ce-90fa-4222-a274-ee00c4ba33a3","Type":"ContainerStarted","Data":"12dc36279bce82525ae4b3823badcb4f88e30f5db4b097ec7671d740068dbe6c"} Mar 16 16:08:19 crc kubenswrapper[5120]: I0316 16:08:19.113112 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-f9bc678f8-6p72p" Mar 16 16:08:19 crc kubenswrapper[5120]: I0316 16:08:19.113321 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-f9bc678f8-6p72p" Mar 16 16:08:19 crc kubenswrapper[5120]: I0316 16:08:19.116804 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-6966b7489-j4l28"] Mar 16 16:08:19 crc kubenswrapper[5120]: I0316 16:08:19.124532 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48","Type":"ContainerStarted","Data":"c3164b9bd12f7a4e47b7ddac80da24cf9238f6b9414e91953b196a7de4faaa57"} Mar 16 16:08:19 crc kubenswrapper[5120]: I0316 16:08:19.143786 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-keystone-listener-7cbc6f47fd-sq9tz" podStartSLOduration=3.143749754 podStartE2EDuration="3.143749754s" podCreationTimestamp="2026-03-16 16:08:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:08:19.139163949 +0000 UTC m=+2201.293095606" watchObservedRunningTime="2026-03-16 16:08:19.143749754 +0000 UTC m=+2201.297681411" Mar 16 16:08:19 crc kubenswrapper[5120]: I0316 16:08:19.146499 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-5566b7bdc5-j8gmc" event={"ID":"663dca84-6d86-4d19-a614-6f4fb2f04e2e","Type":"ContainerStarted","Data":"0f7e4d3d356dabd8558578635e70db345e5e1f7a9e0eefd96da90458af3b664f"} Mar 16 16:08:19 crc kubenswrapper[5120]: I0316 16:08:19.154991 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"06f34d35-9700-4048-9f1a-e773e02efbd6","Type":"ContainerStarted","Data":"0e48369a2928b368bee18bb2e0e6fda041243ea298480650d5a5bbcc7df07b9b"} Mar 16 16:08:19 crc kubenswrapper[5120]: I0316 16:08:19.209170 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-api-f9bc678f8-6p72p" podStartSLOduration=3.209150819 podStartE2EDuration="3.209150819s" podCreationTimestamp="2026-03-16 16:08:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:08:19.176257352 +0000 UTC m=+2201.330189009" watchObservedRunningTime="2026-03-16 16:08:19.209150819 +0000 UTC m=+2201.363082476" Mar 16 16:08:19 crc kubenswrapper[5120]: I0316 16:08:19.228829 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-765f7c8474-fjhth"] Mar 16 16:08:19 crc kubenswrapper[5120]: I0316 16:08:19.228925 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-api-0" podStartSLOduration=4.228903648 podStartE2EDuration="4.228903648s" podCreationTimestamp="2026-03-16 16:08:15 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:08:19.226236145 +0000 UTC m=+2201.380167802" watchObservedRunningTime="2026-03-16 16:08:19.228903648 +0000 UTC m=+2201.382835305" Mar 16 16:08:19 crc kubenswrapper[5120]: I0316 16:08:19.229118 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-765f7c8474-fjhth" podUID="1339c179-889a-4734-8a78-ccc684103c8a" containerName="barbican-keystone-listener-log" containerID="cri-o://80420b2ef2a986e48e3d4bd9a977534343b5d7ce81ba0dcd2c2a0107bc2e7383" gracePeriod=30 Mar 16 16:08:19 crc kubenswrapper[5120]: I0316 16:08:19.229163 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-765f7c8474-fjhth" podUID="1339c179-889a-4734-8a78-ccc684103c8a" containerName="barbican-keystone-listener" containerID="cri-o://95d11f790bf0c2a9ba49fa9fd181a60d7ff9b6173550d60af6bf33986a6ad151" gracePeriod=30 Mar 16 16:08:19 crc kubenswrapper[5120]: I0316 16:08:19.281596 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-worker-5566b7bdc5-j8gmc" podStartSLOduration=3.281578355 podStartE2EDuration="3.281578355s" podCreationTimestamp="2026-03-16 16:08:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:08:19.25498352 +0000 UTC m=+2201.408915177" watchObservedRunningTime="2026-03-16 16:08:19.281578355 +0000 UTC m=+2201.435510012" Mar 16 16:08:19 crc kubenswrapper[5120]: I0316 16:08:19.301616 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-57f4878fd7-lxcgl"] Mar 16 16:08:19 crc kubenswrapper[5120]: I0316 16:08:19.301886 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-57f4878fd7-lxcgl" podUID="8f5b15fe-8fe8-40b3-b546-351cbd1bcd9e" containerName="barbican-worker-log" containerID="cri-o://ff0cc891023bde91631dcefae737dc009401ca109960f5b3141e38337b4cbd9a" gracePeriod=30 Mar 16 16:08:19 crc kubenswrapper[5120]: I0316 16:08:19.301999 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-57f4878fd7-lxcgl" podUID="8f5b15fe-8fe8-40b3-b546-351cbd1bcd9e" containerName="barbican-worker" containerID="cri-o://c95bbb28388887138f78292e51f23f55c27b0502f92ef4d75dbee96f4c389106" gracePeriod=30 Mar 16 16:08:20 crc kubenswrapper[5120]: I0316 16:08:20.167128 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-6966b7489-j4l28" event={"ID":"ddb7fdf9-5c27-4d59-b778-ff2a95f45bec","Type":"ContainerStarted","Data":"17477a9134c8df5798f09943b7308bf44123114575842c97afe67f8d53c7c73d"} Mar 16 16:08:20 crc kubenswrapper[5120]: I0316 16:08:20.167422 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-6966b7489-j4l28" event={"ID":"ddb7fdf9-5c27-4d59-b778-ff2a95f45bec","Type":"ContainerStarted","Data":"d4b438f64f506b89949a8c4147ee8c86bc3432e11f87ea5243983b43429bf5cd"} Mar 16 16:08:20 crc kubenswrapper[5120]: I0316 16:08:20.167433 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-6966b7489-j4l28" event={"ID":"ddb7fdf9-5c27-4d59-b778-ff2a95f45bec","Type":"ContainerStarted","Data":"8067d7545d3917fa688a1cd7169307cda39a94b47967cd15182c16553e39efb2"} Mar 16 16:08:20 crc kubenswrapper[5120]: I0316 16:08:20.167449 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/neutron-6966b7489-j4l28" Mar 16 16:08:20 crc kubenswrapper[5120]: I0316 16:08:20.169761 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48","Type":"ContainerStarted","Data":"aef9233d03cb7ffcfb571167c97488b99e9b815478de044c3d0881b1833c44c2"} Mar 16 16:08:20 crc kubenswrapper[5120]: I0316 16:08:20.172534 5120 generic.go:358] "Generic (PLEG): container finished" podID="8f5b15fe-8fe8-40b3-b546-351cbd1bcd9e" containerID="ff0cc891023bde91631dcefae737dc009401ca109960f5b3141e38337b4cbd9a" exitCode=143 Mar 16 16:08:20 crc kubenswrapper[5120]: I0316 16:08:20.172627 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-57f4878fd7-lxcgl" event={"ID":"8f5b15fe-8fe8-40b3-b546-351cbd1bcd9e","Type":"ContainerDied","Data":"ff0cc891023bde91631dcefae737dc009401ca109960f5b3141e38337b4cbd9a"} Mar 16 16:08:20 crc kubenswrapper[5120]: I0316 16:08:20.175141 5120 generic.go:358] "Generic (PLEG): container finished" podID="1339c179-889a-4734-8a78-ccc684103c8a" containerID="80420b2ef2a986e48e3d4bd9a977534343b5d7ce81ba0dcd2c2a0107bc2e7383" exitCode=143 Mar 16 16:08:20 crc kubenswrapper[5120]: I0316 16:08:20.175277 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-765f7c8474-fjhth" event={"ID":"1339c179-889a-4734-8a78-ccc684103c8a","Type":"ContainerDied","Data":"80420b2ef2a986e48e3d4bd9a977534343b5d7ce81ba0dcd2c2a0107bc2e7383"} Mar 16 16:08:20 crc kubenswrapper[5120]: I0316 16:08:20.175894 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:08:20 crc kubenswrapper[5120]: I0316 16:08:20.194208 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-6966b7489-j4l28" podStartSLOduration=2.194189056 podStartE2EDuration="2.194189056s" podCreationTimestamp="2026-03-16 16:08:18 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:08:20.189491328 +0000 UTC m=+2202.343422985" watchObservedRunningTime="2026-03-16 16:08:20.194189056 +0000 UTC m=+2202.348120713" Mar 16 16:08:20 crc kubenswrapper[5120]: I0316 16:08:20.382322 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:08:20 crc kubenswrapper[5120]: I0316 16:08:20.435327 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:08:20 crc kubenswrapper[5120]: I0316 16:08:20.930799 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-cb8df78d6-4gf8s"] Mar 16 16:08:20 crc kubenswrapper[5120]: I0316 16:08:20.937245 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-cb8df78d6-4gf8s" Mar 16 16:08:20 crc kubenswrapper[5120]: I0316 16:08:20.939617 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-neutron-internal-svc\"" Mar 16 16:08:20 crc kubenswrapper[5120]: I0316 16:08:20.940043 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-neutron-public-svc\"" Mar 16 16:08:20 crc kubenswrapper[5120]: I0316 16:08:20.963808 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-cb8df78d6-4gf8s"] Mar 16 16:08:20 crc kubenswrapper[5120]: I0316 16:08:20.996976 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/5cf58a8f-dfb4-4a0a-b96c-000333125dd0-public-tls-certs\") pod \"neutron-cb8df78d6-4gf8s\" (UID: \"5cf58a8f-dfb4-4a0a-b96c-000333125dd0\") " pod="openstack-kuttl-tests/neutron-cb8df78d6-4gf8s" Mar 16 16:08:20 crc kubenswrapper[5120]: I0316 16:08:20.997050 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kfnvv\" (UniqueName: \"kubernetes.io/projected/5cf58a8f-dfb4-4a0a-b96c-000333125dd0-kube-api-access-kfnvv\") pod \"neutron-cb8df78d6-4gf8s\" (UID: \"5cf58a8f-dfb4-4a0a-b96c-000333125dd0\") " pod="openstack-kuttl-tests/neutron-cb8df78d6-4gf8s" Mar 16 16:08:20 crc kubenswrapper[5120]: I0316 16:08:20.997082 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/5cf58a8f-dfb4-4a0a-b96c-000333125dd0-httpd-config\") pod \"neutron-cb8df78d6-4gf8s\" (UID: \"5cf58a8f-dfb4-4a0a-b96c-000333125dd0\") " pod="openstack-kuttl-tests/neutron-cb8df78d6-4gf8s" Mar 16 16:08:20 crc kubenswrapper[5120]: I0316 16:08:20.997097 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/5cf58a8f-dfb4-4a0a-b96c-000333125dd0-internal-tls-certs\") pod \"neutron-cb8df78d6-4gf8s\" (UID: \"5cf58a8f-dfb4-4a0a-b96c-000333125dd0\") " pod="openstack-kuttl-tests/neutron-cb8df78d6-4gf8s" Mar 16 16:08:20 crc kubenswrapper[5120]: I0316 16:08:20.997198 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5cf58a8f-dfb4-4a0a-b96c-000333125dd0-config\") pod \"neutron-cb8df78d6-4gf8s\" (UID: \"5cf58a8f-dfb4-4a0a-b96c-000333125dd0\") " pod="openstack-kuttl-tests/neutron-cb8df78d6-4gf8s" Mar 16 16:08:20 crc kubenswrapper[5120]: I0316 16:08:20.997247 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5cf58a8f-dfb4-4a0a-b96c-000333125dd0-combined-ca-bundle\") pod \"neutron-cb8df78d6-4gf8s\" (UID: \"5cf58a8f-dfb4-4a0a-b96c-000333125dd0\") " pod="openstack-kuttl-tests/neutron-cb8df78d6-4gf8s" Mar 16 16:08:20 crc kubenswrapper[5120]: I0316 16:08:20.997283 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/5cf58a8f-dfb4-4a0a-b96c-000333125dd0-ovndb-tls-certs\") pod \"neutron-cb8df78d6-4gf8s\" (UID: \"5cf58a8f-dfb4-4a0a-b96c-000333125dd0\") " pod="openstack-kuttl-tests/neutron-cb8df78d6-4gf8s" Mar 16 16:08:21 crc kubenswrapper[5120]: I0316 16:08:21.105244 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/5cf58a8f-dfb4-4a0a-b96c-000333125dd0-public-tls-certs\") pod \"neutron-cb8df78d6-4gf8s\" (UID: \"5cf58a8f-dfb4-4a0a-b96c-000333125dd0\") " pod="openstack-kuttl-tests/neutron-cb8df78d6-4gf8s" Mar 16 16:08:21 crc kubenswrapper[5120]: I0316 16:08:21.105383 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kfnvv\" (UniqueName: \"kubernetes.io/projected/5cf58a8f-dfb4-4a0a-b96c-000333125dd0-kube-api-access-kfnvv\") pod \"neutron-cb8df78d6-4gf8s\" (UID: \"5cf58a8f-dfb4-4a0a-b96c-000333125dd0\") " pod="openstack-kuttl-tests/neutron-cb8df78d6-4gf8s" Mar 16 16:08:21 crc kubenswrapper[5120]: I0316 16:08:21.105428 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/5cf58a8f-dfb4-4a0a-b96c-000333125dd0-httpd-config\") pod \"neutron-cb8df78d6-4gf8s\" (UID: \"5cf58a8f-dfb4-4a0a-b96c-000333125dd0\") " pod="openstack-kuttl-tests/neutron-cb8df78d6-4gf8s" Mar 16 16:08:21 crc kubenswrapper[5120]: I0316 16:08:21.105461 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/5cf58a8f-dfb4-4a0a-b96c-000333125dd0-internal-tls-certs\") pod \"neutron-cb8df78d6-4gf8s\" (UID: \"5cf58a8f-dfb4-4a0a-b96c-000333125dd0\") " pod="openstack-kuttl-tests/neutron-cb8df78d6-4gf8s" Mar 16 16:08:21 crc kubenswrapper[5120]: I0316 16:08:21.105504 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5cf58a8f-dfb4-4a0a-b96c-000333125dd0-config\") pod \"neutron-cb8df78d6-4gf8s\" (UID: \"5cf58a8f-dfb4-4a0a-b96c-000333125dd0\") " pod="openstack-kuttl-tests/neutron-cb8df78d6-4gf8s" Mar 16 16:08:21 crc kubenswrapper[5120]: I0316 16:08:21.105548 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5cf58a8f-dfb4-4a0a-b96c-000333125dd0-combined-ca-bundle\") pod \"neutron-cb8df78d6-4gf8s\" (UID: \"5cf58a8f-dfb4-4a0a-b96c-000333125dd0\") " pod="openstack-kuttl-tests/neutron-cb8df78d6-4gf8s" Mar 16 16:08:21 crc kubenswrapper[5120]: I0316 16:08:21.105576 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/5cf58a8f-dfb4-4a0a-b96c-000333125dd0-ovndb-tls-certs\") pod \"neutron-cb8df78d6-4gf8s\" (UID: \"5cf58a8f-dfb4-4a0a-b96c-000333125dd0\") " pod="openstack-kuttl-tests/neutron-cb8df78d6-4gf8s" Mar 16 16:08:21 crc kubenswrapper[5120]: I0316 16:08:21.114958 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/5cf58a8f-dfb4-4a0a-b96c-000333125dd0-httpd-config\") pod \"neutron-cb8df78d6-4gf8s\" (UID: \"5cf58a8f-dfb4-4a0a-b96c-000333125dd0\") " pod="openstack-kuttl-tests/neutron-cb8df78d6-4gf8s" Mar 16 16:08:21 crc kubenswrapper[5120]: I0316 16:08:21.116026 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5cf58a8f-dfb4-4a0a-b96c-000333125dd0-combined-ca-bundle\") pod \"neutron-cb8df78d6-4gf8s\" (UID: \"5cf58a8f-dfb4-4a0a-b96c-000333125dd0\") " pod="openstack-kuttl-tests/neutron-cb8df78d6-4gf8s" Mar 16 16:08:21 crc kubenswrapper[5120]: I0316 16:08:21.116070 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/5cf58a8f-dfb4-4a0a-b96c-000333125dd0-config\") pod \"neutron-cb8df78d6-4gf8s\" (UID: \"5cf58a8f-dfb4-4a0a-b96c-000333125dd0\") " pod="openstack-kuttl-tests/neutron-cb8df78d6-4gf8s" Mar 16 16:08:21 crc kubenswrapper[5120]: I0316 16:08:21.116698 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/5cf58a8f-dfb4-4a0a-b96c-000333125dd0-ovndb-tls-certs\") pod \"neutron-cb8df78d6-4gf8s\" (UID: \"5cf58a8f-dfb4-4a0a-b96c-000333125dd0\") " pod="openstack-kuttl-tests/neutron-cb8df78d6-4gf8s" Mar 16 16:08:21 crc kubenswrapper[5120]: I0316 16:08:21.116756 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/5cf58a8f-dfb4-4a0a-b96c-000333125dd0-internal-tls-certs\") pod \"neutron-cb8df78d6-4gf8s\" (UID: \"5cf58a8f-dfb4-4a0a-b96c-000333125dd0\") " pod="openstack-kuttl-tests/neutron-cb8df78d6-4gf8s" Mar 16 16:08:21 crc kubenswrapper[5120]: I0316 16:08:21.117506 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/5cf58a8f-dfb4-4a0a-b96c-000333125dd0-public-tls-certs\") pod \"neutron-cb8df78d6-4gf8s\" (UID: \"5cf58a8f-dfb4-4a0a-b96c-000333125dd0\") " pod="openstack-kuttl-tests/neutron-cb8df78d6-4gf8s" Mar 16 16:08:21 crc kubenswrapper[5120]: I0316 16:08:21.134196 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kfnvv\" (UniqueName: \"kubernetes.io/projected/5cf58a8f-dfb4-4a0a-b96c-000333125dd0-kube-api-access-kfnvv\") pod \"neutron-cb8df78d6-4gf8s\" (UID: \"5cf58a8f-dfb4-4a0a-b96c-000333125dd0\") " pod="openstack-kuttl-tests/neutron-cb8df78d6-4gf8s" Mar 16 16:08:21 crc kubenswrapper[5120]: I0316 16:08:21.199437 5120 generic.go:358] "Generic (PLEG): container finished" podID="8f5b15fe-8fe8-40b3-b546-351cbd1bcd9e" containerID="c95bbb28388887138f78292e51f23f55c27b0502f92ef4d75dbee96f4c389106" exitCode=0 Mar 16 16:08:21 crc kubenswrapper[5120]: I0316 16:08:21.199545 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-57f4878fd7-lxcgl" event={"ID":"8f5b15fe-8fe8-40b3-b546-351cbd1bcd9e","Type":"ContainerDied","Data":"c95bbb28388887138f78292e51f23f55c27b0502f92ef4d75dbee96f4c389106"} Mar 16 16:08:21 crc kubenswrapper[5120]: I0316 16:08:21.200231 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="2eb7df4e-20b6-4d77-bdac-4031fdb1f508" containerName="cinder-scheduler" containerID="cri-o://8deacf4f9b8757e17d89c32f7e90e72a60014782120e9a079eff886acea301e1" gracePeriod=30 Mar 16 16:08:21 crc kubenswrapper[5120]: I0316 16:08:21.200608 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="2eb7df4e-20b6-4d77-bdac-4031fdb1f508" containerName="probe" containerID="cri-o://f9a2ba8327e3d14325c56002c5cd800d88fffa53d313223aa185d25f6a73f808" gracePeriod=30 Mar 16 16:08:21 crc kubenswrapper[5120]: I0316 16:08:21.307274 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-cb8df78d6-4gf8s" Mar 16 16:08:21 crc kubenswrapper[5120]: I0316 16:08:21.426226 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-57f4878fd7-lxcgl" Mar 16 16:08:21 crc kubenswrapper[5120]: I0316 16:08:21.518180 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n8n74\" (UniqueName: \"kubernetes.io/projected/8f5b15fe-8fe8-40b3-b546-351cbd1bcd9e-kube-api-access-n8n74\") pod \"8f5b15fe-8fe8-40b3-b546-351cbd1bcd9e\" (UID: \"8f5b15fe-8fe8-40b3-b546-351cbd1bcd9e\") " Mar 16 16:08:21 crc kubenswrapper[5120]: I0316 16:08:21.518465 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8f5b15fe-8fe8-40b3-b546-351cbd1bcd9e-config-data\") pod \"8f5b15fe-8fe8-40b3-b546-351cbd1bcd9e\" (UID: \"8f5b15fe-8fe8-40b3-b546-351cbd1bcd9e\") " Mar 16 16:08:21 crc kubenswrapper[5120]: I0316 16:08:21.518608 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8f5b15fe-8fe8-40b3-b546-351cbd1bcd9e-logs\") pod \"8f5b15fe-8fe8-40b3-b546-351cbd1bcd9e\" (UID: \"8f5b15fe-8fe8-40b3-b546-351cbd1bcd9e\") " Mar 16 16:08:21 crc kubenswrapper[5120]: I0316 16:08:21.518654 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/8f5b15fe-8fe8-40b3-b546-351cbd1bcd9e-config-data-custom\") pod \"8f5b15fe-8fe8-40b3-b546-351cbd1bcd9e\" (UID: \"8f5b15fe-8fe8-40b3-b546-351cbd1bcd9e\") " Mar 16 16:08:21 crc kubenswrapper[5120]: I0316 16:08:21.518899 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8f5b15fe-8fe8-40b3-b546-351cbd1bcd9e-combined-ca-bundle\") pod \"8f5b15fe-8fe8-40b3-b546-351cbd1bcd9e\" (UID: \"8f5b15fe-8fe8-40b3-b546-351cbd1bcd9e\") " Mar 16 16:08:21 crc kubenswrapper[5120]: I0316 16:08:21.519297 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f5b15fe-8fe8-40b3-b546-351cbd1bcd9e-logs" (OuterVolumeSpecName: "logs") pod "8f5b15fe-8fe8-40b3-b546-351cbd1bcd9e" (UID: "8f5b15fe-8fe8-40b3-b546-351cbd1bcd9e"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:08:21 crc kubenswrapper[5120]: I0316 16:08:21.519487 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8f5b15fe-8fe8-40b3-b546-351cbd1bcd9e-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:08:21 crc kubenswrapper[5120]: I0316 16:08:21.529957 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f5b15fe-8fe8-40b3-b546-351cbd1bcd9e-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "8f5b15fe-8fe8-40b3-b546-351cbd1bcd9e" (UID: "8f5b15fe-8fe8-40b3-b546-351cbd1bcd9e"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:08:21 crc kubenswrapper[5120]: I0316 16:08:21.531459 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f5b15fe-8fe8-40b3-b546-351cbd1bcd9e-kube-api-access-n8n74" (OuterVolumeSpecName: "kube-api-access-n8n74") pod "8f5b15fe-8fe8-40b3-b546-351cbd1bcd9e" (UID: "8f5b15fe-8fe8-40b3-b546-351cbd1bcd9e"). InnerVolumeSpecName "kube-api-access-n8n74". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:08:21 crc kubenswrapper[5120]: I0316 16:08:21.542169 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f5b15fe-8fe8-40b3-b546-351cbd1bcd9e-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "8f5b15fe-8fe8-40b3-b546-351cbd1bcd9e" (UID: "8f5b15fe-8fe8-40b3-b546-351cbd1bcd9e"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:08:21 crc kubenswrapper[5120]: I0316 16:08:21.554302 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-57f8f7777b-s7zn5" podUID="c04f4eb6-ad5d-4996-a59e-c26968e5439a" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.0.19:9311/healthcheck\": context deadline exceeded" Mar 16 16:08:21 crc kubenswrapper[5120]: I0316 16:08:21.563543 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-57f8f7777b-s7zn5" podUID="c04f4eb6-ad5d-4996-a59e-c26968e5439a" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.0.19:9311/healthcheck\": context deadline exceeded" Mar 16 16:08:21 crc kubenswrapper[5120]: I0316 16:08:21.590874 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f5b15fe-8fe8-40b3-b546-351cbd1bcd9e-config-data" (OuterVolumeSpecName: "config-data") pod "8f5b15fe-8fe8-40b3-b546-351cbd1bcd9e" (UID: "8f5b15fe-8fe8-40b3-b546-351cbd1bcd9e"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:08:21 crc kubenswrapper[5120]: I0316 16:08:21.621175 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8f5b15fe-8fe8-40b3-b546-351cbd1bcd9e-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:08:21 crc kubenswrapper[5120]: I0316 16:08:21.621205 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n8n74\" (UniqueName: \"kubernetes.io/projected/8f5b15fe-8fe8-40b3-b546-351cbd1bcd9e-kube-api-access-n8n74\") on node \"crc\" DevicePath \"\"" Mar 16 16:08:21 crc kubenswrapper[5120]: I0316 16:08:21.621216 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8f5b15fe-8fe8-40b3-b546-351cbd1bcd9e-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:08:21 crc kubenswrapper[5120]: I0316 16:08:21.621226 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/8f5b15fe-8fe8-40b3-b546-351cbd1bcd9e-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:08:21 crc kubenswrapper[5120]: I0316 16:08:21.745353 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-cb8df78d6-4gf8s"] Mar 16 16:08:21 crc kubenswrapper[5120]: W0316 16:08:21.752772 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5cf58a8f_dfb4_4a0a_b96c_000333125dd0.slice/crio-04ad1d3cf12f56d1e6198b289cd6f8587f4ccab4fa54d82499dd834786008224 WatchSource:0}: Error finding container 04ad1d3cf12f56d1e6198b289cd6f8587f4ccab4fa54d82499dd834786008224: Status 404 returned error can't find the container with id 04ad1d3cf12f56d1e6198b289cd6f8587f4ccab4fa54d82499dd834786008224 Mar 16 16:08:22 crc kubenswrapper[5120]: I0316 16:08:22.008117 5120 patch_prober.go:28] interesting pod/machine-config-daemon-7bf76 container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 16:08:22 crc kubenswrapper[5120]: I0316 16:08:22.008195 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 16:08:22 crc kubenswrapper[5120]: I0316 16:08:22.167847 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-57f8f7777b-s7zn5" podUID="c04f4eb6-ad5d-4996-a59e-c26968e5439a" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.0.19:9311/healthcheck\": read tcp 10.217.0.2:38478->10.217.0.19:9311: read: connection reset by peer" Mar 16 16:08:22 crc kubenswrapper[5120]: I0316 16:08:22.168028 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-57f8f7777b-s7zn5" podUID="c04f4eb6-ad5d-4996-a59e-c26968e5439a" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.0.19:9311/healthcheck\": read tcp 10.217.0.2:38488->10.217.0.19:9311: read: connection reset by peer" Mar 16 16:08:22 crc kubenswrapper[5120]: I0316 16:08:22.208852 5120 generic.go:358] "Generic (PLEG): container finished" podID="1339c179-889a-4734-8a78-ccc684103c8a" containerID="95d11f790bf0c2a9ba49fa9fd181a60d7ff9b6173550d60af6bf33986a6ad151" exitCode=0 Mar 16 16:08:22 crc kubenswrapper[5120]: I0316 16:08:22.208932 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-765f7c8474-fjhth" event={"ID":"1339c179-889a-4734-8a78-ccc684103c8a","Type":"ContainerDied","Data":"95d11f790bf0c2a9ba49fa9fd181a60d7ff9b6173550d60af6bf33986a6ad151"} Mar 16 16:08:22 crc kubenswrapper[5120]: I0316 16:08:22.213788 5120 generic.go:358] "Generic (PLEG): container finished" podID="2eb7df4e-20b6-4d77-bdac-4031fdb1f508" containerID="f9a2ba8327e3d14325c56002c5cd800d88fffa53d313223aa185d25f6a73f808" exitCode=0 Mar 16 16:08:22 crc kubenswrapper[5120]: I0316 16:08:22.213967 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"2eb7df4e-20b6-4d77-bdac-4031fdb1f508","Type":"ContainerDied","Data":"f9a2ba8327e3d14325c56002c5cd800d88fffa53d313223aa185d25f6a73f808"} Mar 16 16:08:22 crc kubenswrapper[5120]: I0316 16:08:22.220860 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48","Type":"ContainerStarted","Data":"4ec36bdc47754196e72c5081f292ee68be776a2b0d2247436870ae3d007598f1"} Mar 16 16:08:22 crc kubenswrapper[5120]: I0316 16:08:22.221279 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:08:22 crc kubenswrapper[5120]: I0316 16:08:22.225427 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-57f4878fd7-lxcgl" event={"ID":"8f5b15fe-8fe8-40b3-b546-351cbd1bcd9e","Type":"ContainerDied","Data":"250d96f1a254f198dbeb6c27eac08ebb3daa423871a4e136fd45e251bd0d5c6f"} Mar 16 16:08:22 crc kubenswrapper[5120]: I0316 16:08:22.225461 5120 scope.go:117] "RemoveContainer" containerID="c95bbb28388887138f78292e51f23f55c27b0502f92ef4d75dbee96f4c389106" Mar 16 16:08:22 crc kubenswrapper[5120]: I0316 16:08:22.225591 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-57f4878fd7-lxcgl" Mar 16 16:08:22 crc kubenswrapper[5120]: I0316 16:08:22.250158 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-cb8df78d6-4gf8s" event={"ID":"5cf58a8f-dfb4-4a0a-b96c-000333125dd0","Type":"ContainerStarted","Data":"2af07be619d918d455ab3453bb4c324e7039b7c37a76d4c43b38c031fb72a931"} Mar 16 16:08:22 crc kubenswrapper[5120]: I0316 16:08:22.250244 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-cb8df78d6-4gf8s" event={"ID":"5cf58a8f-dfb4-4a0a-b96c-000333125dd0","Type":"ContainerStarted","Data":"04ad1d3cf12f56d1e6198b289cd6f8587f4ccab4fa54d82499dd834786008224"} Mar 16 16:08:22 crc kubenswrapper[5120]: I0316 16:08:22.251632 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=3.071985441 podStartE2EDuration="7.251614474s" podCreationTimestamp="2026-03-16 16:08:15 +0000 UTC" firstStartedPulling="2026-03-16 16:08:17.074899775 +0000 UTC m=+2199.228831432" lastFinishedPulling="2026-03-16 16:08:21.254528808 +0000 UTC m=+2203.408460465" observedRunningTime="2026-03-16 16:08:22.245997111 +0000 UTC m=+2204.399928838" watchObservedRunningTime="2026-03-16 16:08:22.251614474 +0000 UTC m=+2204.405546131" Mar 16 16:08:22 crc kubenswrapper[5120]: I0316 16:08:22.387589 5120 scope.go:117] "RemoveContainer" containerID="ff0cc891023bde91631dcefae737dc009401ca109960f5b3141e38337b4cbd9a" Mar 16 16:08:22 crc kubenswrapper[5120]: I0316 16:08:22.396667 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-57f4878fd7-lxcgl"] Mar 16 16:08:22 crc kubenswrapper[5120]: I0316 16:08:22.403903 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-worker-57f4878fd7-lxcgl"] Mar 16 16:08:22 crc kubenswrapper[5120]: I0316 16:08:22.678393 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8f5b15fe-8fe8-40b3-b546-351cbd1bcd9e" path="/var/lib/kubelet/pods/8f5b15fe-8fe8-40b3-b546-351cbd1bcd9e/volumes" Mar 16 16:08:22 crc kubenswrapper[5120]: I0316 16:08:22.715448 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-765f7c8474-fjhth" Mar 16 16:08:22 crc kubenswrapper[5120]: I0316 16:08:22.722501 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-57f8f7777b-s7zn5" Mar 16 16:08:22 crc kubenswrapper[5120]: I0316 16:08:22.848829 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/1339c179-889a-4734-8a78-ccc684103c8a-logs\") pod \"1339c179-889a-4734-8a78-ccc684103c8a\" (UID: \"1339c179-889a-4734-8a78-ccc684103c8a\") " Mar 16 16:08:22 crc kubenswrapper[5120]: I0316 16:08:22.848903 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1339c179-889a-4734-8a78-ccc684103c8a-combined-ca-bundle\") pod \"1339c179-889a-4734-8a78-ccc684103c8a\" (UID: \"1339c179-889a-4734-8a78-ccc684103c8a\") " Mar 16 16:08:22 crc kubenswrapper[5120]: I0316 16:08:22.848923 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xspgj\" (UniqueName: \"kubernetes.io/projected/c04f4eb6-ad5d-4996-a59e-c26968e5439a-kube-api-access-xspgj\") pod \"c04f4eb6-ad5d-4996-a59e-c26968e5439a\" (UID: \"c04f4eb6-ad5d-4996-a59e-c26968e5439a\") " Mar 16 16:08:22 crc kubenswrapper[5120]: I0316 16:08:22.848957 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/1339c179-889a-4734-8a78-ccc684103c8a-config-data-custom\") pod \"1339c179-889a-4734-8a78-ccc684103c8a\" (UID: \"1339c179-889a-4734-8a78-ccc684103c8a\") " Mar 16 16:08:22 crc kubenswrapper[5120]: I0316 16:08:22.849029 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/c04f4eb6-ad5d-4996-a59e-c26968e5439a-config-data-custom\") pod \"c04f4eb6-ad5d-4996-a59e-c26968e5439a\" (UID: \"c04f4eb6-ad5d-4996-a59e-c26968e5439a\") " Mar 16 16:08:22 crc kubenswrapper[5120]: I0316 16:08:22.849071 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c04f4eb6-ad5d-4996-a59e-c26968e5439a-logs\") pod \"c04f4eb6-ad5d-4996-a59e-c26968e5439a\" (UID: \"c04f4eb6-ad5d-4996-a59e-c26968e5439a\") " Mar 16 16:08:22 crc kubenswrapper[5120]: I0316 16:08:22.849286 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1339c179-889a-4734-8a78-ccc684103c8a-logs" (OuterVolumeSpecName: "logs") pod "1339c179-889a-4734-8a78-ccc684103c8a" (UID: "1339c179-889a-4734-8a78-ccc684103c8a"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:08:22 crc kubenswrapper[5120]: I0316 16:08:22.850102 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/c04f4eb6-ad5d-4996-a59e-c26968e5439a-internal-tls-certs\") pod \"c04f4eb6-ad5d-4996-a59e-c26968e5439a\" (UID: \"c04f4eb6-ad5d-4996-a59e-c26968e5439a\") " Mar 16 16:08:22 crc kubenswrapper[5120]: I0316 16:08:22.850143 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c04f4eb6-ad5d-4996-a59e-c26968e5439a-config-data\") pod \"c04f4eb6-ad5d-4996-a59e-c26968e5439a\" (UID: \"c04f4eb6-ad5d-4996-a59e-c26968e5439a\") " Mar 16 16:08:22 crc kubenswrapper[5120]: I0316 16:08:22.850256 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1339c179-889a-4734-8a78-ccc684103c8a-config-data\") pod \"1339c179-889a-4734-8a78-ccc684103c8a\" (UID: \"1339c179-889a-4734-8a78-ccc684103c8a\") " Mar 16 16:08:22 crc kubenswrapper[5120]: I0316 16:08:22.850349 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c04f4eb6-ad5d-4996-a59e-c26968e5439a-combined-ca-bundle\") pod \"c04f4eb6-ad5d-4996-a59e-c26968e5439a\" (UID: \"c04f4eb6-ad5d-4996-a59e-c26968e5439a\") " Mar 16 16:08:22 crc kubenswrapper[5120]: I0316 16:08:22.850455 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/c04f4eb6-ad5d-4996-a59e-c26968e5439a-public-tls-certs\") pod \"c04f4eb6-ad5d-4996-a59e-c26968e5439a\" (UID: \"c04f4eb6-ad5d-4996-a59e-c26968e5439a\") " Mar 16 16:08:22 crc kubenswrapper[5120]: I0316 16:08:22.850516 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7dn5g\" (UniqueName: \"kubernetes.io/projected/1339c179-889a-4734-8a78-ccc684103c8a-kube-api-access-7dn5g\") pod \"1339c179-889a-4734-8a78-ccc684103c8a\" (UID: \"1339c179-889a-4734-8a78-ccc684103c8a\") " Mar 16 16:08:22 crc kubenswrapper[5120]: I0316 16:08:22.852029 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c04f4eb6-ad5d-4996-a59e-c26968e5439a-logs" (OuterVolumeSpecName: "logs") pod "c04f4eb6-ad5d-4996-a59e-c26968e5439a" (UID: "c04f4eb6-ad5d-4996-a59e-c26968e5439a"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:08:22 crc kubenswrapper[5120]: I0316 16:08:22.852386 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c04f4eb6-ad5d-4996-a59e-c26968e5439a-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:08:22 crc kubenswrapper[5120]: I0316 16:08:22.852406 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/1339c179-889a-4734-8a78-ccc684103c8a-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:08:22 crc kubenswrapper[5120]: I0316 16:08:22.855349 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c04f4eb6-ad5d-4996-a59e-c26968e5439a-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "c04f4eb6-ad5d-4996-a59e-c26968e5439a" (UID: "c04f4eb6-ad5d-4996-a59e-c26968e5439a"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:08:22 crc kubenswrapper[5120]: I0316 16:08:22.855890 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1339c179-889a-4734-8a78-ccc684103c8a-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "1339c179-889a-4734-8a78-ccc684103c8a" (UID: "1339c179-889a-4734-8a78-ccc684103c8a"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:08:22 crc kubenswrapper[5120]: I0316 16:08:22.870027 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c04f4eb6-ad5d-4996-a59e-c26968e5439a-kube-api-access-xspgj" (OuterVolumeSpecName: "kube-api-access-xspgj") pod "c04f4eb6-ad5d-4996-a59e-c26968e5439a" (UID: "c04f4eb6-ad5d-4996-a59e-c26968e5439a"). InnerVolumeSpecName "kube-api-access-xspgj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:08:22 crc kubenswrapper[5120]: I0316 16:08:22.870119 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1339c179-889a-4734-8a78-ccc684103c8a-kube-api-access-7dn5g" (OuterVolumeSpecName: "kube-api-access-7dn5g") pod "1339c179-889a-4734-8a78-ccc684103c8a" (UID: "1339c179-889a-4734-8a78-ccc684103c8a"). InnerVolumeSpecName "kube-api-access-7dn5g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:08:22 crc kubenswrapper[5120]: I0316 16:08:22.878195 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1339c179-889a-4734-8a78-ccc684103c8a-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "1339c179-889a-4734-8a78-ccc684103c8a" (UID: "1339c179-889a-4734-8a78-ccc684103c8a"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:08:22 crc kubenswrapper[5120]: I0316 16:08:22.895320 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c04f4eb6-ad5d-4996-a59e-c26968e5439a-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "c04f4eb6-ad5d-4996-a59e-c26968e5439a" (UID: "c04f4eb6-ad5d-4996-a59e-c26968e5439a"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:08:22 crc kubenswrapper[5120]: I0316 16:08:22.917271 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1339c179-889a-4734-8a78-ccc684103c8a-config-data" (OuterVolumeSpecName: "config-data") pod "1339c179-889a-4734-8a78-ccc684103c8a" (UID: "1339c179-889a-4734-8a78-ccc684103c8a"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:08:22 crc kubenswrapper[5120]: I0316 16:08:22.928326 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c04f4eb6-ad5d-4996-a59e-c26968e5439a-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "c04f4eb6-ad5d-4996-a59e-c26968e5439a" (UID: "c04f4eb6-ad5d-4996-a59e-c26968e5439a"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:08:22 crc kubenswrapper[5120]: I0316 16:08:22.933616 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c04f4eb6-ad5d-4996-a59e-c26968e5439a-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "c04f4eb6-ad5d-4996-a59e-c26968e5439a" (UID: "c04f4eb6-ad5d-4996-a59e-c26968e5439a"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:08:22 crc kubenswrapper[5120]: I0316 16:08:22.942024 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c04f4eb6-ad5d-4996-a59e-c26968e5439a-config-data" (OuterVolumeSpecName: "config-data") pod "c04f4eb6-ad5d-4996-a59e-c26968e5439a" (UID: "c04f4eb6-ad5d-4996-a59e-c26968e5439a"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:08:22 crc kubenswrapper[5120]: I0316 16:08:22.955366 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/c04f4eb6-ad5d-4996-a59e-c26968e5439a-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:08:22 crc kubenswrapper[5120]: I0316 16:08:22.955611 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7dn5g\" (UniqueName: \"kubernetes.io/projected/1339c179-889a-4734-8a78-ccc684103c8a-kube-api-access-7dn5g\") on node \"crc\" DevicePath \"\"" Mar 16 16:08:22 crc kubenswrapper[5120]: I0316 16:08:22.955872 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1339c179-889a-4734-8a78-ccc684103c8a-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:08:22 crc kubenswrapper[5120]: I0316 16:08:22.956093 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xspgj\" (UniqueName: \"kubernetes.io/projected/c04f4eb6-ad5d-4996-a59e-c26968e5439a-kube-api-access-xspgj\") on node \"crc\" DevicePath \"\"" Mar 16 16:08:22 crc kubenswrapper[5120]: I0316 16:08:22.956195 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/1339c179-889a-4734-8a78-ccc684103c8a-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:08:22 crc kubenswrapper[5120]: I0316 16:08:22.956292 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/c04f4eb6-ad5d-4996-a59e-c26968e5439a-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:08:22 crc kubenswrapper[5120]: I0316 16:08:22.956389 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/c04f4eb6-ad5d-4996-a59e-c26968e5439a-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:08:22 crc kubenswrapper[5120]: I0316 16:08:22.956473 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c04f4eb6-ad5d-4996-a59e-c26968e5439a-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:08:22 crc kubenswrapper[5120]: I0316 16:08:22.956557 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1339c179-889a-4734-8a78-ccc684103c8a-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:08:22 crc kubenswrapper[5120]: I0316 16:08:22.956654 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c04f4eb6-ad5d-4996-a59e-c26968e5439a-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:08:23 crc kubenswrapper[5120]: I0316 16:08:23.268310 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-cb8df78d6-4gf8s" event={"ID":"5cf58a8f-dfb4-4a0a-b96c-000333125dd0","Type":"ContainerStarted","Data":"773740d0b4fcf1873d3b8d878cfa118bc3e28448d6a770da23e0930fde30d6cc"} Mar 16 16:08:23 crc kubenswrapper[5120]: I0316 16:08:23.268389 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/neutron-cb8df78d6-4gf8s" Mar 16 16:08:23 crc kubenswrapper[5120]: I0316 16:08:23.271041 5120 generic.go:358] "Generic (PLEG): container finished" podID="c04f4eb6-ad5d-4996-a59e-c26968e5439a" containerID="ed5b76468decf3d0970fe991b7842f6cd57f0b2740f7bd9e44e27a86bb568652" exitCode=0 Mar 16 16:08:23 crc kubenswrapper[5120]: I0316 16:08:23.271165 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-57f8f7777b-s7zn5" event={"ID":"c04f4eb6-ad5d-4996-a59e-c26968e5439a","Type":"ContainerDied","Data":"ed5b76468decf3d0970fe991b7842f6cd57f0b2740f7bd9e44e27a86bb568652"} Mar 16 16:08:23 crc kubenswrapper[5120]: I0316 16:08:23.271180 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-57f8f7777b-s7zn5" event={"ID":"c04f4eb6-ad5d-4996-a59e-c26968e5439a","Type":"ContainerDied","Data":"4de071851200414869fa41878d1dfa8131e203844915bb3a9bd8fb768ca5b28f"} Mar 16 16:08:23 crc kubenswrapper[5120]: I0316 16:08:23.271197 5120 scope.go:117] "RemoveContainer" containerID="ed5b76468decf3d0970fe991b7842f6cd57f0b2740f7bd9e44e27a86bb568652" Mar 16 16:08:23 crc kubenswrapper[5120]: I0316 16:08:23.271289 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-57f8f7777b-s7zn5" Mar 16 16:08:23 crc kubenswrapper[5120]: I0316 16:08:23.277589 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-765f7c8474-fjhth" Mar 16 16:08:23 crc kubenswrapper[5120]: I0316 16:08:23.277881 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-765f7c8474-fjhth" event={"ID":"1339c179-889a-4734-8a78-ccc684103c8a","Type":"ContainerDied","Data":"3bb72298baef853bba4a41a1e835d50e6f85213ec124b9352d2a5c843566dadc"} Mar 16 16:08:23 crc kubenswrapper[5120]: I0316 16:08:23.292516 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-cb8df78d6-4gf8s" podStartSLOduration=3.292496464 podStartE2EDuration="3.292496464s" podCreationTimestamp="2026-03-16 16:08:20 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:08:23.28862588 +0000 UTC m=+2205.442557547" watchObservedRunningTime="2026-03-16 16:08:23.292496464 +0000 UTC m=+2205.446428131" Mar 16 16:08:23 crc kubenswrapper[5120]: I0316 16:08:23.320986 5120 scope.go:117] "RemoveContainer" containerID="08c398795e3394c5a740a16d4d39c55a16da4356f66cdcff6ba806ae8d19251d" Mar 16 16:08:23 crc kubenswrapper[5120]: I0316 16:08:23.338245 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-57f8f7777b-s7zn5"] Mar 16 16:08:23 crc kubenswrapper[5120]: I0316 16:08:23.347672 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-api-57f8f7777b-s7zn5"] Mar 16 16:08:23 crc kubenswrapper[5120]: I0316 16:08:23.376955 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-765f7c8474-fjhth"] Mar 16 16:08:23 crc kubenswrapper[5120]: I0316 16:08:23.382997 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-765f7c8474-fjhth"] Mar 16 16:08:23 crc kubenswrapper[5120]: I0316 16:08:23.386421 5120 scope.go:117] "RemoveContainer" containerID="ed5b76468decf3d0970fe991b7842f6cd57f0b2740f7bd9e44e27a86bb568652" Mar 16 16:08:23 crc kubenswrapper[5120]: E0316 16:08:23.392076 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ed5b76468decf3d0970fe991b7842f6cd57f0b2740f7bd9e44e27a86bb568652\": container with ID starting with ed5b76468decf3d0970fe991b7842f6cd57f0b2740f7bd9e44e27a86bb568652 not found: ID does not exist" containerID="ed5b76468decf3d0970fe991b7842f6cd57f0b2740f7bd9e44e27a86bb568652" Mar 16 16:08:23 crc kubenswrapper[5120]: I0316 16:08:23.392112 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed5b76468decf3d0970fe991b7842f6cd57f0b2740f7bd9e44e27a86bb568652"} err="failed to get container status \"ed5b76468decf3d0970fe991b7842f6cd57f0b2740f7bd9e44e27a86bb568652\": rpc error: code = NotFound desc = could not find container \"ed5b76468decf3d0970fe991b7842f6cd57f0b2740f7bd9e44e27a86bb568652\": container with ID starting with ed5b76468decf3d0970fe991b7842f6cd57f0b2740f7bd9e44e27a86bb568652 not found: ID does not exist" Mar 16 16:08:23 crc kubenswrapper[5120]: I0316 16:08:23.392135 5120 scope.go:117] "RemoveContainer" containerID="08c398795e3394c5a740a16d4d39c55a16da4356f66cdcff6ba806ae8d19251d" Mar 16 16:08:23 crc kubenswrapper[5120]: E0316 16:08:23.392612 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"08c398795e3394c5a740a16d4d39c55a16da4356f66cdcff6ba806ae8d19251d\": container with ID starting with 08c398795e3394c5a740a16d4d39c55a16da4356f66cdcff6ba806ae8d19251d not found: ID does not exist" containerID="08c398795e3394c5a740a16d4d39c55a16da4356f66cdcff6ba806ae8d19251d" Mar 16 16:08:23 crc kubenswrapper[5120]: I0316 16:08:23.392646 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08c398795e3394c5a740a16d4d39c55a16da4356f66cdcff6ba806ae8d19251d"} err="failed to get container status \"08c398795e3394c5a740a16d4d39c55a16da4356f66cdcff6ba806ae8d19251d\": rpc error: code = NotFound desc = could not find container \"08c398795e3394c5a740a16d4d39c55a16da4356f66cdcff6ba806ae8d19251d\": container with ID starting with 08c398795e3394c5a740a16d4d39c55a16da4356f66cdcff6ba806ae8d19251d not found: ID does not exist" Mar 16 16:08:23 crc kubenswrapper[5120]: I0316 16:08:23.392667 5120 scope.go:117] "RemoveContainer" containerID="95d11f790bf0c2a9ba49fa9fd181a60d7ff9b6173550d60af6bf33986a6ad151" Mar 16 16:08:23 crc kubenswrapper[5120]: I0316 16:08:23.433599 5120 scope.go:117] "RemoveContainer" containerID="80420b2ef2a986e48e3d4bd9a977534343b5d7ce81ba0dcd2c2a0107bc2e7383" Mar 16 16:08:24 crc kubenswrapper[5120]: I0316 16:08:24.173039 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:08:24 crc kubenswrapper[5120]: I0316 16:08:24.286617 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/2eb7df4e-20b6-4d77-bdac-4031fdb1f508-etc-machine-id\") pod \"2eb7df4e-20b6-4d77-bdac-4031fdb1f508\" (UID: \"2eb7df4e-20b6-4d77-bdac-4031fdb1f508\") " Mar 16 16:08:24 crc kubenswrapper[5120]: I0316 16:08:24.286697 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/2eb7df4e-20b6-4d77-bdac-4031fdb1f508-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "2eb7df4e-20b6-4d77-bdac-4031fdb1f508" (UID: "2eb7df4e-20b6-4d77-bdac-4031fdb1f508"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 16:08:24 crc kubenswrapper[5120]: I0316 16:08:24.286750 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2eb7df4e-20b6-4d77-bdac-4031fdb1f508-scripts\") pod \"2eb7df4e-20b6-4d77-bdac-4031fdb1f508\" (UID: \"2eb7df4e-20b6-4d77-bdac-4031fdb1f508\") " Mar 16 16:08:24 crc kubenswrapper[5120]: I0316 16:08:24.286811 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2eb7df4e-20b6-4d77-bdac-4031fdb1f508-config-data\") pod \"2eb7df4e-20b6-4d77-bdac-4031fdb1f508\" (UID: \"2eb7df4e-20b6-4d77-bdac-4031fdb1f508\") " Mar 16 16:08:24 crc kubenswrapper[5120]: I0316 16:08:24.286847 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2eb7df4e-20b6-4d77-bdac-4031fdb1f508-combined-ca-bundle\") pod \"2eb7df4e-20b6-4d77-bdac-4031fdb1f508\" (UID: \"2eb7df4e-20b6-4d77-bdac-4031fdb1f508\") " Mar 16 16:08:24 crc kubenswrapper[5120]: I0316 16:08:24.287057 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r742w\" (UniqueName: \"kubernetes.io/projected/2eb7df4e-20b6-4d77-bdac-4031fdb1f508-kube-api-access-r742w\") pod \"2eb7df4e-20b6-4d77-bdac-4031fdb1f508\" (UID: \"2eb7df4e-20b6-4d77-bdac-4031fdb1f508\") " Mar 16 16:08:24 crc kubenswrapper[5120]: I0316 16:08:24.287241 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/2eb7df4e-20b6-4d77-bdac-4031fdb1f508-config-data-custom\") pod \"2eb7df4e-20b6-4d77-bdac-4031fdb1f508\" (UID: \"2eb7df4e-20b6-4d77-bdac-4031fdb1f508\") " Mar 16 16:08:24 crc kubenswrapper[5120]: I0316 16:08:24.287914 5120 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/2eb7df4e-20b6-4d77-bdac-4031fdb1f508-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 16:08:24 crc kubenswrapper[5120]: I0316 16:08:24.293150 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2eb7df4e-20b6-4d77-bdac-4031fdb1f508-scripts" (OuterVolumeSpecName: "scripts") pod "2eb7df4e-20b6-4d77-bdac-4031fdb1f508" (UID: "2eb7df4e-20b6-4d77-bdac-4031fdb1f508"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:08:24 crc kubenswrapper[5120]: I0316 16:08:24.296138 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2eb7df4e-20b6-4d77-bdac-4031fdb1f508-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "2eb7df4e-20b6-4d77-bdac-4031fdb1f508" (UID: "2eb7df4e-20b6-4d77-bdac-4031fdb1f508"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:08:24 crc kubenswrapper[5120]: I0316 16:08:24.296237 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2eb7df4e-20b6-4d77-bdac-4031fdb1f508-kube-api-access-r742w" (OuterVolumeSpecName: "kube-api-access-r742w") pod "2eb7df4e-20b6-4d77-bdac-4031fdb1f508" (UID: "2eb7df4e-20b6-4d77-bdac-4031fdb1f508"). InnerVolumeSpecName "kube-api-access-r742w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:08:24 crc kubenswrapper[5120]: I0316 16:08:24.313064 5120 generic.go:358] "Generic (PLEG): container finished" podID="2eb7df4e-20b6-4d77-bdac-4031fdb1f508" containerID="8deacf4f9b8757e17d89c32f7e90e72a60014782120e9a079eff886acea301e1" exitCode=0 Mar 16 16:08:24 crc kubenswrapper[5120]: I0316 16:08:24.314307 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:08:24 crc kubenswrapper[5120]: I0316 16:08:24.314365 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"2eb7df4e-20b6-4d77-bdac-4031fdb1f508","Type":"ContainerDied","Data":"8deacf4f9b8757e17d89c32f7e90e72a60014782120e9a079eff886acea301e1"} Mar 16 16:08:24 crc kubenswrapper[5120]: I0316 16:08:24.314410 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"2eb7df4e-20b6-4d77-bdac-4031fdb1f508","Type":"ContainerDied","Data":"83ad742b6a794e926ebd6b4ba4fe3f656a498a949e391b07e4ab58973fb73519"} Mar 16 16:08:24 crc kubenswrapper[5120]: I0316 16:08:24.314428 5120 scope.go:117] "RemoveContainer" containerID="f9a2ba8327e3d14325c56002c5cd800d88fffa53d313223aa185d25f6a73f808" Mar 16 16:08:24 crc kubenswrapper[5120]: I0316 16:08:24.356054 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2eb7df4e-20b6-4d77-bdac-4031fdb1f508-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "2eb7df4e-20b6-4d77-bdac-4031fdb1f508" (UID: "2eb7df4e-20b6-4d77-bdac-4031fdb1f508"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:08:24 crc kubenswrapper[5120]: I0316 16:08:24.389421 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2eb7df4e-20b6-4d77-bdac-4031fdb1f508-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:08:24 crc kubenswrapper[5120]: I0316 16:08:24.389451 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r742w\" (UniqueName: \"kubernetes.io/projected/2eb7df4e-20b6-4d77-bdac-4031fdb1f508-kube-api-access-r742w\") on node \"crc\" DevicePath \"\"" Mar 16 16:08:24 crc kubenswrapper[5120]: I0316 16:08:24.389462 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/2eb7df4e-20b6-4d77-bdac-4031fdb1f508-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:08:24 crc kubenswrapper[5120]: I0316 16:08:24.389470 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2eb7df4e-20b6-4d77-bdac-4031fdb1f508-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:08:24 crc kubenswrapper[5120]: I0316 16:08:24.401884 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2eb7df4e-20b6-4d77-bdac-4031fdb1f508-config-data" (OuterVolumeSpecName: "config-data") pod "2eb7df4e-20b6-4d77-bdac-4031fdb1f508" (UID: "2eb7df4e-20b6-4d77-bdac-4031fdb1f508"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:08:24 crc kubenswrapper[5120]: I0316 16:08:24.459330 5120 scope.go:117] "RemoveContainer" containerID="8deacf4f9b8757e17d89c32f7e90e72a60014782120e9a079eff886acea301e1" Mar 16 16:08:24 crc kubenswrapper[5120]: I0316 16:08:24.481925 5120 scope.go:117] "RemoveContainer" containerID="f9a2ba8327e3d14325c56002c5cd800d88fffa53d313223aa185d25f6a73f808" Mar 16 16:08:24 crc kubenswrapper[5120]: E0316 16:08:24.482407 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f9a2ba8327e3d14325c56002c5cd800d88fffa53d313223aa185d25f6a73f808\": container with ID starting with f9a2ba8327e3d14325c56002c5cd800d88fffa53d313223aa185d25f6a73f808 not found: ID does not exist" containerID="f9a2ba8327e3d14325c56002c5cd800d88fffa53d313223aa185d25f6a73f808" Mar 16 16:08:24 crc kubenswrapper[5120]: I0316 16:08:24.482448 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9a2ba8327e3d14325c56002c5cd800d88fffa53d313223aa185d25f6a73f808"} err="failed to get container status \"f9a2ba8327e3d14325c56002c5cd800d88fffa53d313223aa185d25f6a73f808\": rpc error: code = NotFound desc = could not find container \"f9a2ba8327e3d14325c56002c5cd800d88fffa53d313223aa185d25f6a73f808\": container with ID starting with f9a2ba8327e3d14325c56002c5cd800d88fffa53d313223aa185d25f6a73f808 not found: ID does not exist" Mar 16 16:08:24 crc kubenswrapper[5120]: I0316 16:08:24.482496 5120 scope.go:117] "RemoveContainer" containerID="8deacf4f9b8757e17d89c32f7e90e72a60014782120e9a079eff886acea301e1" Mar 16 16:08:24 crc kubenswrapper[5120]: E0316 16:08:24.482878 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8deacf4f9b8757e17d89c32f7e90e72a60014782120e9a079eff886acea301e1\": container with ID starting with 8deacf4f9b8757e17d89c32f7e90e72a60014782120e9a079eff886acea301e1 not found: ID does not exist" containerID="8deacf4f9b8757e17d89c32f7e90e72a60014782120e9a079eff886acea301e1" Mar 16 16:08:24 crc kubenswrapper[5120]: I0316 16:08:24.482912 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8deacf4f9b8757e17d89c32f7e90e72a60014782120e9a079eff886acea301e1"} err="failed to get container status \"8deacf4f9b8757e17d89c32f7e90e72a60014782120e9a079eff886acea301e1\": rpc error: code = NotFound desc = could not find container \"8deacf4f9b8757e17d89c32f7e90e72a60014782120e9a079eff886acea301e1\": container with ID starting with 8deacf4f9b8757e17d89c32f7e90e72a60014782120e9a079eff886acea301e1 not found: ID does not exist" Mar 16 16:08:24 crc kubenswrapper[5120]: I0316 16:08:24.492143 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2eb7df4e-20b6-4d77-bdac-4031fdb1f508-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:08:24 crc kubenswrapper[5120]: I0316 16:08:24.648053 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:08:24 crc kubenswrapper[5120]: I0316 16:08:24.657440 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:08:24 crc kubenswrapper[5120]: I0316 16:08:24.684417 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1339c179-889a-4734-8a78-ccc684103c8a" path="/var/lib/kubelet/pods/1339c179-889a-4734-8a78-ccc684103c8a/volumes" Mar 16 16:08:24 crc kubenswrapper[5120]: I0316 16:08:24.685163 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2eb7df4e-20b6-4d77-bdac-4031fdb1f508" path="/var/lib/kubelet/pods/2eb7df4e-20b6-4d77-bdac-4031fdb1f508/volumes" Mar 16 16:08:24 crc kubenswrapper[5120]: I0316 16:08:24.685775 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c04f4eb6-ad5d-4996-a59e-c26968e5439a" path="/var/lib/kubelet/pods/c04f4eb6-ad5d-4996-a59e-c26968e5439a/volumes" Mar 16 16:08:24 crc kubenswrapper[5120]: I0316 16:08:24.686970 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:08:24 crc kubenswrapper[5120]: I0316 16:08:24.687748 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1339c179-889a-4734-8a78-ccc684103c8a" containerName="barbican-keystone-listener-log" Mar 16 16:08:24 crc kubenswrapper[5120]: I0316 16:08:24.687894 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1339c179-889a-4734-8a78-ccc684103c8a" containerName="barbican-keystone-listener-log" Mar 16 16:08:24 crc kubenswrapper[5120]: I0316 16:08:24.687913 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2eb7df4e-20b6-4d77-bdac-4031fdb1f508" containerName="cinder-scheduler" Mar 16 16:08:24 crc kubenswrapper[5120]: I0316 16:08:24.687919 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="2eb7df4e-20b6-4d77-bdac-4031fdb1f508" containerName="cinder-scheduler" Mar 16 16:08:24 crc kubenswrapper[5120]: I0316 16:08:24.687937 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c04f4eb6-ad5d-4996-a59e-c26968e5439a" containerName="barbican-api-log" Mar 16 16:08:24 crc kubenswrapper[5120]: I0316 16:08:24.687944 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c04f4eb6-ad5d-4996-a59e-c26968e5439a" containerName="barbican-api-log" Mar 16 16:08:24 crc kubenswrapper[5120]: I0316 16:08:24.687977 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2eb7df4e-20b6-4d77-bdac-4031fdb1f508" containerName="probe" Mar 16 16:08:24 crc kubenswrapper[5120]: I0316 16:08:24.687982 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="2eb7df4e-20b6-4d77-bdac-4031fdb1f508" containerName="probe" Mar 16 16:08:24 crc kubenswrapper[5120]: I0316 16:08:24.687993 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1339c179-889a-4734-8a78-ccc684103c8a" containerName="barbican-keystone-listener" Mar 16 16:08:24 crc kubenswrapper[5120]: I0316 16:08:24.687998 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1339c179-889a-4734-8a78-ccc684103c8a" containerName="barbican-keystone-listener" Mar 16 16:08:24 crc kubenswrapper[5120]: I0316 16:08:24.688011 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c04f4eb6-ad5d-4996-a59e-c26968e5439a" containerName="barbican-api" Mar 16 16:08:24 crc kubenswrapper[5120]: I0316 16:08:24.688015 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c04f4eb6-ad5d-4996-a59e-c26968e5439a" containerName="barbican-api" Mar 16 16:08:24 crc kubenswrapper[5120]: I0316 16:08:24.688023 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f5b15fe-8fe8-40b3-b546-351cbd1bcd9e" containerName="barbican-worker" Mar 16 16:08:24 crc kubenswrapper[5120]: I0316 16:08:24.688042 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f5b15fe-8fe8-40b3-b546-351cbd1bcd9e" containerName="barbican-worker" Mar 16 16:08:24 crc kubenswrapper[5120]: I0316 16:08:24.688052 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f5b15fe-8fe8-40b3-b546-351cbd1bcd9e" containerName="barbican-worker-log" Mar 16 16:08:24 crc kubenswrapper[5120]: I0316 16:08:24.688058 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f5b15fe-8fe8-40b3-b546-351cbd1bcd9e" containerName="barbican-worker-log" Mar 16 16:08:24 crc kubenswrapper[5120]: I0316 16:08:24.688215 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="8f5b15fe-8fe8-40b3-b546-351cbd1bcd9e" containerName="barbican-worker" Mar 16 16:08:24 crc kubenswrapper[5120]: I0316 16:08:24.688224 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1339c179-889a-4734-8a78-ccc684103c8a" containerName="barbican-keystone-listener-log" Mar 16 16:08:24 crc kubenswrapper[5120]: I0316 16:08:24.688234 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="2eb7df4e-20b6-4d77-bdac-4031fdb1f508" containerName="cinder-scheduler" Mar 16 16:08:24 crc kubenswrapper[5120]: I0316 16:08:24.688244 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c04f4eb6-ad5d-4996-a59e-c26968e5439a" containerName="barbican-api-log" Mar 16 16:08:24 crc kubenswrapper[5120]: I0316 16:08:24.688252 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c04f4eb6-ad5d-4996-a59e-c26968e5439a" containerName="barbican-api" Mar 16 16:08:24 crc kubenswrapper[5120]: I0316 16:08:24.688265 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1339c179-889a-4734-8a78-ccc684103c8a" containerName="barbican-keystone-listener" Mar 16 16:08:24 crc kubenswrapper[5120]: I0316 16:08:24.688277 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="8f5b15fe-8fe8-40b3-b546-351cbd1bcd9e" containerName="barbican-worker-log" Mar 16 16:08:24 crc kubenswrapper[5120]: I0316 16:08:24.688288 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="2eb7df4e-20b6-4d77-bdac-4031fdb1f508" containerName="probe" Mar 16 16:08:24 crc kubenswrapper[5120]: I0316 16:08:24.692613 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:08:24 crc kubenswrapper[5120]: I0316 16:08:24.692730 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:08:24 crc kubenswrapper[5120]: I0316 16:08:24.699132 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-scheduler-config-data\"" Mar 16 16:08:24 crc kubenswrapper[5120]: I0316 16:08:24.797094 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/96650b1e-b94e-4f53-9fe6-7b45f224d366-scripts\") pod \"cinder-scheduler-0\" (UID: \"96650b1e-b94e-4f53-9fe6-7b45f224d366\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:08:24 crc kubenswrapper[5120]: I0316 16:08:24.797209 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/96650b1e-b94e-4f53-9fe6-7b45f224d366-config-data\") pod \"cinder-scheduler-0\" (UID: \"96650b1e-b94e-4f53-9fe6-7b45f224d366\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:08:24 crc kubenswrapper[5120]: I0316 16:08:24.797295 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2nqzp\" (UniqueName: \"kubernetes.io/projected/96650b1e-b94e-4f53-9fe6-7b45f224d366-kube-api-access-2nqzp\") pod \"cinder-scheduler-0\" (UID: \"96650b1e-b94e-4f53-9fe6-7b45f224d366\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:08:24 crc kubenswrapper[5120]: I0316 16:08:24.797395 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/96650b1e-b94e-4f53-9fe6-7b45f224d366-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"96650b1e-b94e-4f53-9fe6-7b45f224d366\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:08:24 crc kubenswrapper[5120]: I0316 16:08:24.797552 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/96650b1e-b94e-4f53-9fe6-7b45f224d366-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"96650b1e-b94e-4f53-9fe6-7b45f224d366\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:08:24 crc kubenswrapper[5120]: I0316 16:08:24.797749 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/96650b1e-b94e-4f53-9fe6-7b45f224d366-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"96650b1e-b94e-4f53-9fe6-7b45f224d366\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:08:24 crc kubenswrapper[5120]: I0316 16:08:24.899987 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/96650b1e-b94e-4f53-9fe6-7b45f224d366-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"96650b1e-b94e-4f53-9fe6-7b45f224d366\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:08:24 crc kubenswrapper[5120]: I0316 16:08:24.900270 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/96650b1e-b94e-4f53-9fe6-7b45f224d366-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"96650b1e-b94e-4f53-9fe6-7b45f224d366\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:08:24 crc kubenswrapper[5120]: I0316 16:08:24.900738 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/96650b1e-b94e-4f53-9fe6-7b45f224d366-scripts\") pod \"cinder-scheduler-0\" (UID: \"96650b1e-b94e-4f53-9fe6-7b45f224d366\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:08:24 crc kubenswrapper[5120]: I0316 16:08:24.900812 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/96650b1e-b94e-4f53-9fe6-7b45f224d366-config-data\") pod \"cinder-scheduler-0\" (UID: \"96650b1e-b94e-4f53-9fe6-7b45f224d366\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:08:24 crc kubenswrapper[5120]: I0316 16:08:24.900864 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2nqzp\" (UniqueName: \"kubernetes.io/projected/96650b1e-b94e-4f53-9fe6-7b45f224d366-kube-api-access-2nqzp\") pod \"cinder-scheduler-0\" (UID: \"96650b1e-b94e-4f53-9fe6-7b45f224d366\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:08:24 crc kubenswrapper[5120]: I0316 16:08:24.900904 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/96650b1e-b94e-4f53-9fe6-7b45f224d366-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"96650b1e-b94e-4f53-9fe6-7b45f224d366\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:08:24 crc kubenswrapper[5120]: I0316 16:08:24.901028 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/96650b1e-b94e-4f53-9fe6-7b45f224d366-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"96650b1e-b94e-4f53-9fe6-7b45f224d366\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:08:24 crc kubenswrapper[5120]: I0316 16:08:24.905259 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/96650b1e-b94e-4f53-9fe6-7b45f224d366-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"96650b1e-b94e-4f53-9fe6-7b45f224d366\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:08:24 crc kubenswrapper[5120]: I0316 16:08:24.905566 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/96650b1e-b94e-4f53-9fe6-7b45f224d366-scripts\") pod \"cinder-scheduler-0\" (UID: \"96650b1e-b94e-4f53-9fe6-7b45f224d366\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:08:24 crc kubenswrapper[5120]: I0316 16:08:24.907290 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/96650b1e-b94e-4f53-9fe6-7b45f224d366-config-data\") pod \"cinder-scheduler-0\" (UID: \"96650b1e-b94e-4f53-9fe6-7b45f224d366\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:08:24 crc kubenswrapper[5120]: I0316 16:08:24.922210 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2nqzp\" (UniqueName: \"kubernetes.io/projected/96650b1e-b94e-4f53-9fe6-7b45f224d366-kube-api-access-2nqzp\") pod \"cinder-scheduler-0\" (UID: \"96650b1e-b94e-4f53-9fe6-7b45f224d366\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:08:24 crc kubenswrapper[5120]: I0316 16:08:24.926440 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/96650b1e-b94e-4f53-9fe6-7b45f224d366-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"96650b1e-b94e-4f53-9fe6-7b45f224d366\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:08:25 crc kubenswrapper[5120]: I0316 16:08:25.018240 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:08:25 crc kubenswrapper[5120]: I0316 16:08:25.473969 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:08:25 crc kubenswrapper[5120]: W0316 16:08:25.474628 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod96650b1e_b94e_4f53_9fe6_7b45f224d366.slice/crio-1a83749657f92033aa774faa7dea35e71e3124599409d48a48784e31dbb84c44 WatchSource:0}: Error finding container 1a83749657f92033aa774faa7dea35e71e3124599409d48a48784e31dbb84c44: Status 404 returned error can't find the container with id 1a83749657f92033aa774faa7dea35e71e3124599409d48a48784e31dbb84c44 Mar 16 16:08:26 crc kubenswrapper[5120]: I0316 16:08:26.364160 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"96650b1e-b94e-4f53-9fe6-7b45f224d366","Type":"ContainerStarted","Data":"0785b4a9b254fac39873ffa5eac708f11945743fc473976a54d6afa7092e256e"} Mar 16 16:08:26 crc kubenswrapper[5120]: I0316 16:08:26.364736 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"96650b1e-b94e-4f53-9fe6-7b45f224d366","Type":"ContainerStarted","Data":"1a83749657f92033aa774faa7dea35e71e3124599409d48a48784e31dbb84c44"} Mar 16 16:08:26 crc kubenswrapper[5120]: I0316 16:08:26.544675 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-f9bc678f8-6p72p" Mar 16 16:08:26 crc kubenswrapper[5120]: I0316 16:08:26.580772 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-f9bc678f8-6p72p" Mar 16 16:08:26 crc kubenswrapper[5120]: I0316 16:08:26.647590 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-6877f8555d-c7rkf"] Mar 16 16:08:26 crc kubenswrapper[5120]: I0316 16:08:26.647884 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-6877f8555d-c7rkf" podUID="cbc2cc5a-7563-470f-8e52-9db1448b2669" containerName="barbican-api" containerID="cri-o://f747953ede284c55b3bb324d98468d5b79d84c2792253cb155bd5bc0d697b958" gracePeriod=30 Mar 16 16:08:26 crc kubenswrapper[5120]: I0316 16:08:26.648246 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-6877f8555d-c7rkf" podUID="cbc2cc5a-7563-470f-8e52-9db1448b2669" containerName="barbican-api-log" containerID="cri-o://7bd798d237201adbb2f16896bd4fc9a684e30f05923ed8468e74a41f9b0f0c18" gracePeriod=30 Mar 16 16:08:27 crc kubenswrapper[5120]: I0316 16:08:27.393966 5120 generic.go:358] "Generic (PLEG): container finished" podID="cbc2cc5a-7563-470f-8e52-9db1448b2669" containerID="7bd798d237201adbb2f16896bd4fc9a684e30f05923ed8468e74a41f9b0f0c18" exitCode=143 Mar 16 16:08:27 crc kubenswrapper[5120]: I0316 16:08:27.394441 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-6877f8555d-c7rkf" event={"ID":"cbc2cc5a-7563-470f-8e52-9db1448b2669","Type":"ContainerDied","Data":"7bd798d237201adbb2f16896bd4fc9a684e30f05923ed8468e74a41f9b0f0c18"} Mar 16 16:08:27 crc kubenswrapper[5120]: I0316 16:08:27.399049 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"96650b1e-b94e-4f53-9fe6-7b45f224d366","Type":"ContainerStarted","Data":"016d7acb984498c2d879192f8a4e4df1aa89b0840d16269d8685afb1663e4fb3"} Mar 16 16:08:27 crc kubenswrapper[5120]: I0316 16:08:27.416094 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-scheduler-0" podStartSLOduration=3.416075259 podStartE2EDuration="3.416075259s" podCreationTimestamp="2026-03-16 16:08:24 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:08:27.413908919 +0000 UTC m=+2209.567840576" watchObservedRunningTime="2026-03-16 16:08:27.416075259 +0000 UTC m=+2209.570006916" Mar 16 16:08:28 crc kubenswrapper[5120]: I0316 16:08:28.208686 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:08:29 crc kubenswrapper[5120]: I0316 16:08:29.838170 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-6877f8555d-c7rkf" podUID="cbc2cc5a-7563-470f-8e52-9db1448b2669" containerName="barbican-api" probeResult="failure" output="Get \"http://10.217.1.252:9311/healthcheck\": read tcp 10.217.0.2:40714->10.217.1.252:9311: read: connection reset by peer" Mar 16 16:08:30 crc kubenswrapper[5120]: I0316 16:08:30.018931 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:08:30 crc kubenswrapper[5120]: I0316 16:08:30.300066 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-6877f8555d-c7rkf" Mar 16 16:08:30 crc kubenswrapper[5120]: I0316 16:08:30.418263 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kj9nm\" (UniqueName: \"kubernetes.io/projected/cbc2cc5a-7563-470f-8e52-9db1448b2669-kube-api-access-kj9nm\") pod \"cbc2cc5a-7563-470f-8e52-9db1448b2669\" (UID: \"cbc2cc5a-7563-470f-8e52-9db1448b2669\") " Mar 16 16:08:30 crc kubenswrapper[5120]: I0316 16:08:30.418396 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cbc2cc5a-7563-470f-8e52-9db1448b2669-combined-ca-bundle\") pod \"cbc2cc5a-7563-470f-8e52-9db1448b2669\" (UID: \"cbc2cc5a-7563-470f-8e52-9db1448b2669\") " Mar 16 16:08:30 crc kubenswrapper[5120]: I0316 16:08:30.418544 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cbc2cc5a-7563-470f-8e52-9db1448b2669-config-data\") pod \"cbc2cc5a-7563-470f-8e52-9db1448b2669\" (UID: \"cbc2cc5a-7563-470f-8e52-9db1448b2669\") " Mar 16 16:08:30 crc kubenswrapper[5120]: I0316 16:08:30.418896 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/cbc2cc5a-7563-470f-8e52-9db1448b2669-config-data-custom\") pod \"cbc2cc5a-7563-470f-8e52-9db1448b2669\" (UID: \"cbc2cc5a-7563-470f-8e52-9db1448b2669\") " Mar 16 16:08:30 crc kubenswrapper[5120]: I0316 16:08:30.419057 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/cbc2cc5a-7563-470f-8e52-9db1448b2669-logs\") pod \"cbc2cc5a-7563-470f-8e52-9db1448b2669\" (UID: \"cbc2cc5a-7563-470f-8e52-9db1448b2669\") " Mar 16 16:08:30 crc kubenswrapper[5120]: I0316 16:08:30.419629 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cbc2cc5a-7563-470f-8e52-9db1448b2669-logs" (OuterVolumeSpecName: "logs") pod "cbc2cc5a-7563-470f-8e52-9db1448b2669" (UID: "cbc2cc5a-7563-470f-8e52-9db1448b2669"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:08:30 crc kubenswrapper[5120]: I0316 16:08:30.424165 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cbc2cc5a-7563-470f-8e52-9db1448b2669-kube-api-access-kj9nm" (OuterVolumeSpecName: "kube-api-access-kj9nm") pod "cbc2cc5a-7563-470f-8e52-9db1448b2669" (UID: "cbc2cc5a-7563-470f-8e52-9db1448b2669"). InnerVolumeSpecName "kube-api-access-kj9nm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:08:30 crc kubenswrapper[5120]: I0316 16:08:30.425700 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cbc2cc5a-7563-470f-8e52-9db1448b2669-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "cbc2cc5a-7563-470f-8e52-9db1448b2669" (UID: "cbc2cc5a-7563-470f-8e52-9db1448b2669"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:08:30 crc kubenswrapper[5120]: I0316 16:08:30.435479 5120 generic.go:358] "Generic (PLEG): container finished" podID="cbc2cc5a-7563-470f-8e52-9db1448b2669" containerID="f747953ede284c55b3bb324d98468d5b79d84c2792253cb155bd5bc0d697b958" exitCode=0 Mar 16 16:08:30 crc kubenswrapper[5120]: I0316 16:08:30.435678 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-6877f8555d-c7rkf" event={"ID":"cbc2cc5a-7563-470f-8e52-9db1448b2669","Type":"ContainerDied","Data":"f747953ede284c55b3bb324d98468d5b79d84c2792253cb155bd5bc0d697b958"} Mar 16 16:08:30 crc kubenswrapper[5120]: I0316 16:08:30.435711 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-6877f8555d-c7rkf" event={"ID":"cbc2cc5a-7563-470f-8e52-9db1448b2669","Type":"ContainerDied","Data":"c6eda61aadc858e01fb1a3d48fb580257c690b96ff81f465ce4f1efd1f776a88"} Mar 16 16:08:30 crc kubenswrapper[5120]: I0316 16:08:30.435727 5120 scope.go:117] "RemoveContainer" containerID="f747953ede284c55b3bb324d98468d5b79d84c2792253cb155bd5bc0d697b958" Mar 16 16:08:30 crc kubenswrapper[5120]: I0316 16:08:30.435877 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-6877f8555d-c7rkf" Mar 16 16:08:30 crc kubenswrapper[5120]: I0316 16:08:30.450731 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cbc2cc5a-7563-470f-8e52-9db1448b2669-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "cbc2cc5a-7563-470f-8e52-9db1448b2669" (UID: "cbc2cc5a-7563-470f-8e52-9db1448b2669"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:08:30 crc kubenswrapper[5120]: I0316 16:08:30.490584 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cbc2cc5a-7563-470f-8e52-9db1448b2669-config-data" (OuterVolumeSpecName: "config-data") pod "cbc2cc5a-7563-470f-8e52-9db1448b2669" (UID: "cbc2cc5a-7563-470f-8e52-9db1448b2669"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:08:30 crc kubenswrapper[5120]: I0316 16:08:30.521778 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cbc2cc5a-7563-470f-8e52-9db1448b2669-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:08:30 crc kubenswrapper[5120]: I0316 16:08:30.521831 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cbc2cc5a-7563-470f-8e52-9db1448b2669-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:08:30 crc kubenswrapper[5120]: I0316 16:08:30.521849 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/cbc2cc5a-7563-470f-8e52-9db1448b2669-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:08:30 crc kubenswrapper[5120]: I0316 16:08:30.521866 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/cbc2cc5a-7563-470f-8e52-9db1448b2669-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:08:30 crc kubenswrapper[5120]: I0316 16:08:30.521886 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kj9nm\" (UniqueName: \"kubernetes.io/projected/cbc2cc5a-7563-470f-8e52-9db1448b2669-kube-api-access-kj9nm\") on node \"crc\" DevicePath \"\"" Mar 16 16:08:30 crc kubenswrapper[5120]: I0316 16:08:30.522858 5120 scope.go:117] "RemoveContainer" containerID="7bd798d237201adbb2f16896bd4fc9a684e30f05923ed8468e74a41f9b0f0c18" Mar 16 16:08:30 crc kubenswrapper[5120]: I0316 16:08:30.549953 5120 scope.go:117] "RemoveContainer" containerID="f747953ede284c55b3bb324d98468d5b79d84c2792253cb155bd5bc0d697b958" Mar 16 16:08:30 crc kubenswrapper[5120]: E0316 16:08:30.550378 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f747953ede284c55b3bb324d98468d5b79d84c2792253cb155bd5bc0d697b958\": container with ID starting with f747953ede284c55b3bb324d98468d5b79d84c2792253cb155bd5bc0d697b958 not found: ID does not exist" containerID="f747953ede284c55b3bb324d98468d5b79d84c2792253cb155bd5bc0d697b958" Mar 16 16:08:30 crc kubenswrapper[5120]: I0316 16:08:30.550417 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f747953ede284c55b3bb324d98468d5b79d84c2792253cb155bd5bc0d697b958"} err="failed to get container status \"f747953ede284c55b3bb324d98468d5b79d84c2792253cb155bd5bc0d697b958\": rpc error: code = NotFound desc = could not find container \"f747953ede284c55b3bb324d98468d5b79d84c2792253cb155bd5bc0d697b958\": container with ID starting with f747953ede284c55b3bb324d98468d5b79d84c2792253cb155bd5bc0d697b958 not found: ID does not exist" Mar 16 16:08:30 crc kubenswrapper[5120]: I0316 16:08:30.550443 5120 scope.go:117] "RemoveContainer" containerID="7bd798d237201adbb2f16896bd4fc9a684e30f05923ed8468e74a41f9b0f0c18" Mar 16 16:08:30 crc kubenswrapper[5120]: E0316 16:08:30.550755 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7bd798d237201adbb2f16896bd4fc9a684e30f05923ed8468e74a41f9b0f0c18\": container with ID starting with 7bd798d237201adbb2f16896bd4fc9a684e30f05923ed8468e74a41f9b0f0c18 not found: ID does not exist" containerID="7bd798d237201adbb2f16896bd4fc9a684e30f05923ed8468e74a41f9b0f0c18" Mar 16 16:08:30 crc kubenswrapper[5120]: I0316 16:08:30.550890 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7bd798d237201adbb2f16896bd4fc9a684e30f05923ed8468e74a41f9b0f0c18"} err="failed to get container status \"7bd798d237201adbb2f16896bd4fc9a684e30f05923ed8468e74a41f9b0f0c18\": rpc error: code = NotFound desc = could not find container \"7bd798d237201adbb2f16896bd4fc9a684e30f05923ed8468e74a41f9b0f0c18\": container with ID starting with 7bd798d237201adbb2f16896bd4fc9a684e30f05923ed8468e74a41f9b0f0c18 not found: ID does not exist" Mar 16 16:08:30 crc kubenswrapper[5120]: I0316 16:08:30.778122 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-6877f8555d-c7rkf"] Mar 16 16:08:30 crc kubenswrapper[5120]: I0316 16:08:30.789623 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-api-6877f8555d-c7rkf"] Mar 16 16:08:32 crc kubenswrapper[5120]: I0316 16:08:32.683833 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cbc2cc5a-7563-470f-8e52-9db1448b2669" path="/var/lib/kubelet/pods/cbc2cc5a-7563-470f-8e52-9db1448b2669/volumes" Mar 16 16:08:35 crc kubenswrapper[5120]: I0316 16:08:35.195805 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:08:38 crc kubenswrapper[5120]: I0316 16:08:38.603683 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/placement-df4bb598-d5scs" Mar 16 16:08:39 crc kubenswrapper[5120]: I0316 16:08:39.466063 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/placement-df4bb598-d5scs" Mar 16 16:08:39 crc kubenswrapper[5120]: I0316 16:08:39.705705 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-595564474-m6lrq"] Mar 16 16:08:39 crc kubenswrapper[5120]: I0316 16:08:39.707545 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cbc2cc5a-7563-470f-8e52-9db1448b2669" containerName="barbican-api-log" Mar 16 16:08:39 crc kubenswrapper[5120]: I0316 16:08:39.707582 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="cbc2cc5a-7563-470f-8e52-9db1448b2669" containerName="barbican-api-log" Mar 16 16:08:39 crc kubenswrapper[5120]: I0316 16:08:39.707610 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cbc2cc5a-7563-470f-8e52-9db1448b2669" containerName="barbican-api" Mar 16 16:08:39 crc kubenswrapper[5120]: I0316 16:08:39.707618 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="cbc2cc5a-7563-470f-8e52-9db1448b2669" containerName="barbican-api" Mar 16 16:08:39 crc kubenswrapper[5120]: I0316 16:08:39.707873 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="cbc2cc5a-7563-470f-8e52-9db1448b2669" containerName="barbican-api-log" Mar 16 16:08:39 crc kubenswrapper[5120]: I0316 16:08:39.707893 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="cbc2cc5a-7563-470f-8e52-9db1448b2669" containerName="barbican-api" Mar 16 16:08:39 crc kubenswrapper[5120]: I0316 16:08:39.715890 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-595564474-m6lrq" Mar 16 16:08:39 crc kubenswrapper[5120]: I0316 16:08:39.736253 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-595564474-m6lrq"] Mar 16 16:08:39 crc kubenswrapper[5120]: I0316 16:08:39.777336 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eefef8ba-a54a-4ee8-9c31-757cc07a6ab3-combined-ca-bundle\") pod \"placement-595564474-m6lrq\" (UID: \"eefef8ba-a54a-4ee8-9c31-757cc07a6ab3\") " pod="openstack-kuttl-tests/placement-595564474-m6lrq" Mar 16 16:08:39 crc kubenswrapper[5120]: I0316 16:08:39.777489 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/eefef8ba-a54a-4ee8-9c31-757cc07a6ab3-logs\") pod \"placement-595564474-m6lrq\" (UID: \"eefef8ba-a54a-4ee8-9c31-757cc07a6ab3\") " pod="openstack-kuttl-tests/placement-595564474-m6lrq" Mar 16 16:08:39 crc kubenswrapper[5120]: I0316 16:08:39.777590 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/eefef8ba-a54a-4ee8-9c31-757cc07a6ab3-scripts\") pod \"placement-595564474-m6lrq\" (UID: \"eefef8ba-a54a-4ee8-9c31-757cc07a6ab3\") " pod="openstack-kuttl-tests/placement-595564474-m6lrq" Mar 16 16:08:39 crc kubenswrapper[5120]: I0316 16:08:39.777942 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/eefef8ba-a54a-4ee8-9c31-757cc07a6ab3-config-data\") pod \"placement-595564474-m6lrq\" (UID: \"eefef8ba-a54a-4ee8-9c31-757cc07a6ab3\") " pod="openstack-kuttl-tests/placement-595564474-m6lrq" Mar 16 16:08:39 crc kubenswrapper[5120]: I0316 16:08:39.778051 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/eefef8ba-a54a-4ee8-9c31-757cc07a6ab3-public-tls-certs\") pod \"placement-595564474-m6lrq\" (UID: \"eefef8ba-a54a-4ee8-9c31-757cc07a6ab3\") " pod="openstack-kuttl-tests/placement-595564474-m6lrq" Mar 16 16:08:39 crc kubenswrapper[5120]: I0316 16:08:39.778158 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/eefef8ba-a54a-4ee8-9c31-757cc07a6ab3-internal-tls-certs\") pod \"placement-595564474-m6lrq\" (UID: \"eefef8ba-a54a-4ee8-9c31-757cc07a6ab3\") " pod="openstack-kuttl-tests/placement-595564474-m6lrq" Mar 16 16:08:39 crc kubenswrapper[5120]: I0316 16:08:39.778187 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6pkhz\" (UniqueName: \"kubernetes.io/projected/eefef8ba-a54a-4ee8-9c31-757cc07a6ab3-kube-api-access-6pkhz\") pod \"placement-595564474-m6lrq\" (UID: \"eefef8ba-a54a-4ee8-9c31-757cc07a6ab3\") " pod="openstack-kuttl-tests/placement-595564474-m6lrq" Mar 16 16:08:39 crc kubenswrapper[5120]: I0316 16:08:39.880301 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eefef8ba-a54a-4ee8-9c31-757cc07a6ab3-combined-ca-bundle\") pod \"placement-595564474-m6lrq\" (UID: \"eefef8ba-a54a-4ee8-9c31-757cc07a6ab3\") " pod="openstack-kuttl-tests/placement-595564474-m6lrq" Mar 16 16:08:39 crc kubenswrapper[5120]: I0316 16:08:39.880421 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/eefef8ba-a54a-4ee8-9c31-757cc07a6ab3-logs\") pod \"placement-595564474-m6lrq\" (UID: \"eefef8ba-a54a-4ee8-9c31-757cc07a6ab3\") " pod="openstack-kuttl-tests/placement-595564474-m6lrq" Mar 16 16:08:39 crc kubenswrapper[5120]: I0316 16:08:39.880462 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/eefef8ba-a54a-4ee8-9c31-757cc07a6ab3-scripts\") pod \"placement-595564474-m6lrq\" (UID: \"eefef8ba-a54a-4ee8-9c31-757cc07a6ab3\") " pod="openstack-kuttl-tests/placement-595564474-m6lrq" Mar 16 16:08:39 crc kubenswrapper[5120]: I0316 16:08:39.880901 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/eefef8ba-a54a-4ee8-9c31-757cc07a6ab3-logs\") pod \"placement-595564474-m6lrq\" (UID: \"eefef8ba-a54a-4ee8-9c31-757cc07a6ab3\") " pod="openstack-kuttl-tests/placement-595564474-m6lrq" Mar 16 16:08:39 crc kubenswrapper[5120]: I0316 16:08:39.880953 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/eefef8ba-a54a-4ee8-9c31-757cc07a6ab3-config-data\") pod \"placement-595564474-m6lrq\" (UID: \"eefef8ba-a54a-4ee8-9c31-757cc07a6ab3\") " pod="openstack-kuttl-tests/placement-595564474-m6lrq" Mar 16 16:08:39 crc kubenswrapper[5120]: I0316 16:08:39.881001 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/eefef8ba-a54a-4ee8-9c31-757cc07a6ab3-public-tls-certs\") pod \"placement-595564474-m6lrq\" (UID: \"eefef8ba-a54a-4ee8-9c31-757cc07a6ab3\") " pod="openstack-kuttl-tests/placement-595564474-m6lrq" Mar 16 16:08:39 crc kubenswrapper[5120]: I0316 16:08:39.881106 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/eefef8ba-a54a-4ee8-9c31-757cc07a6ab3-internal-tls-certs\") pod \"placement-595564474-m6lrq\" (UID: \"eefef8ba-a54a-4ee8-9c31-757cc07a6ab3\") " pod="openstack-kuttl-tests/placement-595564474-m6lrq" Mar 16 16:08:39 crc kubenswrapper[5120]: I0316 16:08:39.881528 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6pkhz\" (UniqueName: \"kubernetes.io/projected/eefef8ba-a54a-4ee8-9c31-757cc07a6ab3-kube-api-access-6pkhz\") pod \"placement-595564474-m6lrq\" (UID: \"eefef8ba-a54a-4ee8-9c31-757cc07a6ab3\") " pod="openstack-kuttl-tests/placement-595564474-m6lrq" Mar 16 16:08:39 crc kubenswrapper[5120]: I0316 16:08:39.886351 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/eefef8ba-a54a-4ee8-9c31-757cc07a6ab3-internal-tls-certs\") pod \"placement-595564474-m6lrq\" (UID: \"eefef8ba-a54a-4ee8-9c31-757cc07a6ab3\") " pod="openstack-kuttl-tests/placement-595564474-m6lrq" Mar 16 16:08:39 crc kubenswrapper[5120]: I0316 16:08:39.887070 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eefef8ba-a54a-4ee8-9c31-757cc07a6ab3-combined-ca-bundle\") pod \"placement-595564474-m6lrq\" (UID: \"eefef8ba-a54a-4ee8-9c31-757cc07a6ab3\") " pod="openstack-kuttl-tests/placement-595564474-m6lrq" Mar 16 16:08:39 crc kubenswrapper[5120]: I0316 16:08:39.887211 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/eefef8ba-a54a-4ee8-9c31-757cc07a6ab3-config-data\") pod \"placement-595564474-m6lrq\" (UID: \"eefef8ba-a54a-4ee8-9c31-757cc07a6ab3\") " pod="openstack-kuttl-tests/placement-595564474-m6lrq" Mar 16 16:08:39 crc kubenswrapper[5120]: I0316 16:08:39.887232 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/eefef8ba-a54a-4ee8-9c31-757cc07a6ab3-public-tls-certs\") pod \"placement-595564474-m6lrq\" (UID: \"eefef8ba-a54a-4ee8-9c31-757cc07a6ab3\") " pod="openstack-kuttl-tests/placement-595564474-m6lrq" Mar 16 16:08:39 crc kubenswrapper[5120]: I0316 16:08:39.890221 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/eefef8ba-a54a-4ee8-9c31-757cc07a6ab3-scripts\") pod \"placement-595564474-m6lrq\" (UID: \"eefef8ba-a54a-4ee8-9c31-757cc07a6ab3\") " pod="openstack-kuttl-tests/placement-595564474-m6lrq" Mar 16 16:08:39 crc kubenswrapper[5120]: I0316 16:08:39.901688 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6pkhz\" (UniqueName: \"kubernetes.io/projected/eefef8ba-a54a-4ee8-9c31-757cc07a6ab3-kube-api-access-6pkhz\") pod \"placement-595564474-m6lrq\" (UID: \"eefef8ba-a54a-4ee8-9c31-757cc07a6ab3\") " pod="openstack-kuttl-tests/placement-595564474-m6lrq" Mar 16 16:08:40 crc kubenswrapper[5120]: I0316 16:08:40.048194 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-595564474-m6lrq" Mar 16 16:08:40 crc kubenswrapper[5120]: I0316 16:08:40.551026 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-595564474-m6lrq"] Mar 16 16:08:40 crc kubenswrapper[5120]: W0316 16:08:40.557590 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podeefef8ba_a54a_4ee8_9c31_757cc07a6ab3.slice/crio-493ee67b98558fff522cdd98d9cd0a189f9ed8fa6647564ce5b5396df370c4af WatchSource:0}: Error finding container 493ee67b98558fff522cdd98d9cd0a189f9ed8fa6647564ce5b5396df370c4af: Status 404 returned error can't find the container with id 493ee67b98558fff522cdd98d9cd0a189f9ed8fa6647564ce5b5396df370c4af Mar 16 16:08:40 crc kubenswrapper[5120]: I0316 16:08:40.606063 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-595564474-m6lrq" event={"ID":"eefef8ba-a54a-4ee8-9c31-757cc07a6ab3","Type":"ContainerStarted","Data":"493ee67b98558fff522cdd98d9cd0a189f9ed8fa6647564ce5b5396df370c4af"} Mar 16 16:08:41 crc kubenswrapper[5120]: I0316 16:08:41.619107 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-595564474-m6lrq" event={"ID":"eefef8ba-a54a-4ee8-9c31-757cc07a6ab3","Type":"ContainerStarted","Data":"8a72a823ca221dc9900f87e4a72727ccf8445b5e8cb9e21be9e5da2737ba7e71"} Mar 16 16:08:41 crc kubenswrapper[5120]: I0316 16:08:41.620416 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-595564474-m6lrq" event={"ID":"eefef8ba-a54a-4ee8-9c31-757cc07a6ab3","Type":"ContainerStarted","Data":"95e121ce2779586c5c19af119fb8c0edefa3209e5d09f88db3f67f068079313c"} Mar 16 16:08:41 crc kubenswrapper[5120]: I0316 16:08:41.620447 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-595564474-m6lrq" Mar 16 16:08:41 crc kubenswrapper[5120]: I0316 16:08:41.620463 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-595564474-m6lrq" Mar 16 16:08:41 crc kubenswrapper[5120]: I0316 16:08:41.658786 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-595564474-m6lrq" podStartSLOduration=2.658734737 podStartE2EDuration="2.658734737s" podCreationTimestamp="2026-03-16 16:08:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:08:41.645484815 +0000 UTC m=+2223.799416472" watchObservedRunningTime="2026-03-16 16:08:41.658734737 +0000 UTC m=+2223.812666404" Mar 16 16:08:46 crc kubenswrapper[5120]: I0316 16:08:46.128173 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/keystone-78bffc6747-6kvnb" Mar 16 16:08:46 crc kubenswrapper[5120]: I0316 16:08:46.678174 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 16:08:46 crc kubenswrapper[5120]: I0316 16:08:46.683369 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Mar 16 16:08:46 crc kubenswrapper[5120]: I0316 16:08:46.685552 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"openstack-config-secret\"" Mar 16 16:08:46 crc kubenswrapper[5120]: I0316 16:08:46.688244 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-config\"" Mar 16 16:08:46 crc kubenswrapper[5120]: I0316 16:08:46.688536 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"openstackclient-openstackclient-dockercfg-vm8sw\"" Mar 16 16:08:46 crc kubenswrapper[5120]: I0316 16:08:46.696490 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 16:08:46 crc kubenswrapper[5120]: I0316 16:08:46.844772 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a8389bad-6789-42fe-8506-5ac83ff9514f-combined-ca-bundle\") pod \"openstackclient\" (UID: \"a8389bad-6789-42fe-8506-5ac83ff9514f\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:08:46 crc kubenswrapper[5120]: I0316 16:08:46.844877 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/a8389bad-6789-42fe-8506-5ac83ff9514f-openstack-config\") pod \"openstackclient\" (UID: \"a8389bad-6789-42fe-8506-5ac83ff9514f\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:08:46 crc kubenswrapper[5120]: I0316 16:08:46.844970 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-25zwk\" (UniqueName: \"kubernetes.io/projected/a8389bad-6789-42fe-8506-5ac83ff9514f-kube-api-access-25zwk\") pod \"openstackclient\" (UID: \"a8389bad-6789-42fe-8506-5ac83ff9514f\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:08:46 crc kubenswrapper[5120]: I0316 16:08:46.845149 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/a8389bad-6789-42fe-8506-5ac83ff9514f-openstack-config-secret\") pod \"openstackclient\" (UID: \"a8389bad-6789-42fe-8506-5ac83ff9514f\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:08:46 crc kubenswrapper[5120]: I0316 16:08:46.947738 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a8389bad-6789-42fe-8506-5ac83ff9514f-combined-ca-bundle\") pod \"openstackclient\" (UID: \"a8389bad-6789-42fe-8506-5ac83ff9514f\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:08:46 crc kubenswrapper[5120]: I0316 16:08:46.948315 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/a8389bad-6789-42fe-8506-5ac83ff9514f-openstack-config\") pod \"openstackclient\" (UID: \"a8389bad-6789-42fe-8506-5ac83ff9514f\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:08:46 crc kubenswrapper[5120]: I0316 16:08:46.949530 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/a8389bad-6789-42fe-8506-5ac83ff9514f-openstack-config\") pod \"openstackclient\" (UID: \"a8389bad-6789-42fe-8506-5ac83ff9514f\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:08:46 crc kubenswrapper[5120]: I0316 16:08:46.950046 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-25zwk\" (UniqueName: \"kubernetes.io/projected/a8389bad-6789-42fe-8506-5ac83ff9514f-kube-api-access-25zwk\") pod \"openstackclient\" (UID: \"a8389bad-6789-42fe-8506-5ac83ff9514f\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:08:46 crc kubenswrapper[5120]: I0316 16:08:46.950569 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/a8389bad-6789-42fe-8506-5ac83ff9514f-openstack-config-secret\") pod \"openstackclient\" (UID: \"a8389bad-6789-42fe-8506-5ac83ff9514f\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:08:46 crc kubenswrapper[5120]: I0316 16:08:46.952832 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a8389bad-6789-42fe-8506-5ac83ff9514f-combined-ca-bundle\") pod \"openstackclient\" (UID: \"a8389bad-6789-42fe-8506-5ac83ff9514f\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:08:46 crc kubenswrapper[5120]: I0316 16:08:46.958765 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/a8389bad-6789-42fe-8506-5ac83ff9514f-openstack-config-secret\") pod \"openstackclient\" (UID: \"a8389bad-6789-42fe-8506-5ac83ff9514f\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:08:46 crc kubenswrapper[5120]: I0316 16:08:46.974095 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-25zwk\" (UniqueName: \"kubernetes.io/projected/a8389bad-6789-42fe-8506-5ac83ff9514f-kube-api-access-25zwk\") pod \"openstackclient\" (UID: \"a8389bad-6789-42fe-8506-5ac83ff9514f\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:08:47 crc kubenswrapper[5120]: I0316 16:08:47.044397 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Mar 16 16:08:47 crc kubenswrapper[5120]: I0316 16:08:47.489808 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 16:08:47 crc kubenswrapper[5120]: I0316 16:08:47.759031 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstackclient" event={"ID":"a8389bad-6789-42fe-8506-5ac83ff9514f","Type":"ContainerStarted","Data":"2fa42e597db80f165871a57845e4e2ef64e3229a4086efd36ecbeea07cd1fa0c"} Mar 16 16:08:47 crc kubenswrapper[5120]: I0316 16:08:47.759729 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstackclient" event={"ID":"a8389bad-6789-42fe-8506-5ac83ff9514f","Type":"ContainerStarted","Data":"b7295ab2348e930f3b84f200376cecd5b888c497828953ffdc74e4c19b3bc2cb"} Mar 16 16:08:47 crc kubenswrapper[5120]: I0316 16:08:47.793149 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstackclient" podStartSLOduration=1.793121466 podStartE2EDuration="1.793121466s" podCreationTimestamp="2026-03-16 16:08:46 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:08:47.781732606 +0000 UTC m=+2229.935664273" watchObservedRunningTime="2026-03-16 16:08:47.793121466 +0000 UTC m=+2229.947053153" Mar 16 16:08:49 crc kubenswrapper[5120]: I0316 16:08:49.734393 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/certified-operators-6pnfb"] Mar 16 16:08:49 crc kubenswrapper[5120]: I0316 16:08:49.742075 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-6pnfb" Mar 16 16:08:49 crc kubenswrapper[5120]: I0316 16:08:49.747659 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/certified-operators-6pnfb"] Mar 16 16:08:49 crc kubenswrapper[5120]: I0316 16:08:49.787841 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/swift-proxy-7d679bc546-fx2h2"] Mar 16 16:08:49 crc kubenswrapper[5120]: I0316 16:08:49.794283 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-7d679bc546-fx2h2" Mar 16 16:08:49 crc kubenswrapper[5120]: I0316 16:08:49.798602 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-swift-internal-svc\"" Mar 16 16:08:49 crc kubenswrapper[5120]: I0316 16:08:49.798657 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-swift-public-svc\"" Mar 16 16:08:49 crc kubenswrapper[5120]: I0316 16:08:49.799272 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"swift-proxy-config-data\"" Mar 16 16:08:49 crc kubenswrapper[5120]: I0316 16:08:49.813410 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/057b7da4-d510-491e-bde1-76e1d4e427ff-utilities\") pod \"certified-operators-6pnfb\" (UID: \"057b7da4-d510-491e-bde1-76e1d4e427ff\") " pod="openshift-marketplace/certified-operators-6pnfb" Mar 16 16:08:49 crc kubenswrapper[5120]: I0316 16:08:49.813635 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ld7n7\" (UniqueName: \"kubernetes.io/projected/057b7da4-d510-491e-bde1-76e1d4e427ff-kube-api-access-ld7n7\") pod \"certified-operators-6pnfb\" (UID: \"057b7da4-d510-491e-bde1-76e1d4e427ff\") " pod="openshift-marketplace/certified-operators-6pnfb" Mar 16 16:08:49 crc kubenswrapper[5120]: I0316 16:08:49.813761 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/057b7da4-d510-491e-bde1-76e1d4e427ff-catalog-content\") pod \"certified-operators-6pnfb\" (UID: \"057b7da4-d510-491e-bde1-76e1d4e427ff\") " pod="openshift-marketplace/certified-operators-6pnfb" Mar 16 16:08:49 crc kubenswrapper[5120]: I0316 16:08:49.820059 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-proxy-7d679bc546-fx2h2"] Mar 16 16:08:49 crc kubenswrapper[5120]: I0316 16:08:49.915230 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5whvb\" (UniqueName: \"kubernetes.io/projected/9c8fe017-e320-4b3e-894e-f4258e8d265f-kube-api-access-5whvb\") pod \"swift-proxy-7d679bc546-fx2h2\" (UID: \"9c8fe017-e320-4b3e-894e-f4258e8d265f\") " pod="openstack-kuttl-tests/swift-proxy-7d679bc546-fx2h2" Mar 16 16:08:49 crc kubenswrapper[5120]: I0316 16:08:49.915326 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/9c8fe017-e320-4b3e-894e-f4258e8d265f-etc-swift\") pod \"swift-proxy-7d679bc546-fx2h2\" (UID: \"9c8fe017-e320-4b3e-894e-f4258e8d265f\") " pod="openstack-kuttl-tests/swift-proxy-7d679bc546-fx2h2" Mar 16 16:08:49 crc kubenswrapper[5120]: I0316 16:08:49.915541 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/9c8fe017-e320-4b3e-894e-f4258e8d265f-internal-tls-certs\") pod \"swift-proxy-7d679bc546-fx2h2\" (UID: \"9c8fe017-e320-4b3e-894e-f4258e8d265f\") " pod="openstack-kuttl-tests/swift-proxy-7d679bc546-fx2h2" Mar 16 16:08:49 crc kubenswrapper[5120]: I0316 16:08:49.916153 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/9c8fe017-e320-4b3e-894e-f4258e8d265f-log-httpd\") pod \"swift-proxy-7d679bc546-fx2h2\" (UID: \"9c8fe017-e320-4b3e-894e-f4258e8d265f\") " pod="openstack-kuttl-tests/swift-proxy-7d679bc546-fx2h2" Mar 16 16:08:49 crc kubenswrapper[5120]: I0316 16:08:49.916283 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/9c8fe017-e320-4b3e-894e-f4258e8d265f-public-tls-certs\") pod \"swift-proxy-7d679bc546-fx2h2\" (UID: \"9c8fe017-e320-4b3e-894e-f4258e8d265f\") " pod="openstack-kuttl-tests/swift-proxy-7d679bc546-fx2h2" Mar 16 16:08:49 crc kubenswrapper[5120]: I0316 16:08:49.916359 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/057b7da4-d510-491e-bde1-76e1d4e427ff-utilities\") pod \"certified-operators-6pnfb\" (UID: \"057b7da4-d510-491e-bde1-76e1d4e427ff\") " pod="openshift-marketplace/certified-operators-6pnfb" Mar 16 16:08:49 crc kubenswrapper[5120]: I0316 16:08:49.916381 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ld7n7\" (UniqueName: \"kubernetes.io/projected/057b7da4-d510-491e-bde1-76e1d4e427ff-kube-api-access-ld7n7\") pod \"certified-operators-6pnfb\" (UID: \"057b7da4-d510-491e-bde1-76e1d4e427ff\") " pod="openshift-marketplace/certified-operators-6pnfb" Mar 16 16:08:49 crc kubenswrapper[5120]: I0316 16:08:49.916415 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/057b7da4-d510-491e-bde1-76e1d4e427ff-catalog-content\") pod \"certified-operators-6pnfb\" (UID: \"057b7da4-d510-491e-bde1-76e1d4e427ff\") " pod="openshift-marketplace/certified-operators-6pnfb" Mar 16 16:08:49 crc kubenswrapper[5120]: I0316 16:08:49.916474 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/9c8fe017-e320-4b3e-894e-f4258e8d265f-run-httpd\") pod \"swift-proxy-7d679bc546-fx2h2\" (UID: \"9c8fe017-e320-4b3e-894e-f4258e8d265f\") " pod="openstack-kuttl-tests/swift-proxy-7d679bc546-fx2h2" Mar 16 16:08:49 crc kubenswrapper[5120]: I0316 16:08:49.916584 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9c8fe017-e320-4b3e-894e-f4258e8d265f-combined-ca-bundle\") pod \"swift-proxy-7d679bc546-fx2h2\" (UID: \"9c8fe017-e320-4b3e-894e-f4258e8d265f\") " pod="openstack-kuttl-tests/swift-proxy-7d679bc546-fx2h2" Mar 16 16:08:49 crc kubenswrapper[5120]: I0316 16:08:49.916681 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9c8fe017-e320-4b3e-894e-f4258e8d265f-config-data\") pod \"swift-proxy-7d679bc546-fx2h2\" (UID: \"9c8fe017-e320-4b3e-894e-f4258e8d265f\") " pod="openstack-kuttl-tests/swift-proxy-7d679bc546-fx2h2" Mar 16 16:08:49 crc kubenswrapper[5120]: I0316 16:08:49.917539 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/057b7da4-d510-491e-bde1-76e1d4e427ff-utilities\") pod \"certified-operators-6pnfb\" (UID: \"057b7da4-d510-491e-bde1-76e1d4e427ff\") " pod="openshift-marketplace/certified-operators-6pnfb" Mar 16 16:08:49 crc kubenswrapper[5120]: I0316 16:08:49.917932 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/057b7da4-d510-491e-bde1-76e1d4e427ff-catalog-content\") pod \"certified-operators-6pnfb\" (UID: \"057b7da4-d510-491e-bde1-76e1d4e427ff\") " pod="openshift-marketplace/certified-operators-6pnfb" Mar 16 16:08:49 crc kubenswrapper[5120]: I0316 16:08:49.948377 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ld7n7\" (UniqueName: \"kubernetes.io/projected/057b7da4-d510-491e-bde1-76e1d4e427ff-kube-api-access-ld7n7\") pod \"certified-operators-6pnfb\" (UID: \"057b7da4-d510-491e-bde1-76e1d4e427ff\") " pod="openshift-marketplace/certified-operators-6pnfb" Mar 16 16:08:50 crc kubenswrapper[5120]: I0316 16:08:50.047703 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5whvb\" (UniqueName: \"kubernetes.io/projected/9c8fe017-e320-4b3e-894e-f4258e8d265f-kube-api-access-5whvb\") pod \"swift-proxy-7d679bc546-fx2h2\" (UID: \"9c8fe017-e320-4b3e-894e-f4258e8d265f\") " pod="openstack-kuttl-tests/swift-proxy-7d679bc546-fx2h2" Mar 16 16:08:50 crc kubenswrapper[5120]: I0316 16:08:50.047915 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/9c8fe017-e320-4b3e-894e-f4258e8d265f-etc-swift\") pod \"swift-proxy-7d679bc546-fx2h2\" (UID: \"9c8fe017-e320-4b3e-894e-f4258e8d265f\") " pod="openstack-kuttl-tests/swift-proxy-7d679bc546-fx2h2" Mar 16 16:08:50 crc kubenswrapper[5120]: I0316 16:08:50.047993 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/9c8fe017-e320-4b3e-894e-f4258e8d265f-internal-tls-certs\") pod \"swift-proxy-7d679bc546-fx2h2\" (UID: \"9c8fe017-e320-4b3e-894e-f4258e8d265f\") " pod="openstack-kuttl-tests/swift-proxy-7d679bc546-fx2h2" Mar 16 16:08:50 crc kubenswrapper[5120]: I0316 16:08:50.048024 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/9c8fe017-e320-4b3e-894e-f4258e8d265f-log-httpd\") pod \"swift-proxy-7d679bc546-fx2h2\" (UID: \"9c8fe017-e320-4b3e-894e-f4258e8d265f\") " pod="openstack-kuttl-tests/swift-proxy-7d679bc546-fx2h2" Mar 16 16:08:50 crc kubenswrapper[5120]: I0316 16:08:50.048069 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/9c8fe017-e320-4b3e-894e-f4258e8d265f-public-tls-certs\") pod \"swift-proxy-7d679bc546-fx2h2\" (UID: \"9c8fe017-e320-4b3e-894e-f4258e8d265f\") " pod="openstack-kuttl-tests/swift-proxy-7d679bc546-fx2h2" Mar 16 16:08:50 crc kubenswrapper[5120]: I0316 16:08:50.048171 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/9c8fe017-e320-4b3e-894e-f4258e8d265f-run-httpd\") pod \"swift-proxy-7d679bc546-fx2h2\" (UID: \"9c8fe017-e320-4b3e-894e-f4258e8d265f\") " pod="openstack-kuttl-tests/swift-proxy-7d679bc546-fx2h2" Mar 16 16:08:50 crc kubenswrapper[5120]: I0316 16:08:50.048241 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9c8fe017-e320-4b3e-894e-f4258e8d265f-combined-ca-bundle\") pod \"swift-proxy-7d679bc546-fx2h2\" (UID: \"9c8fe017-e320-4b3e-894e-f4258e8d265f\") " pod="openstack-kuttl-tests/swift-proxy-7d679bc546-fx2h2" Mar 16 16:08:50 crc kubenswrapper[5120]: I0316 16:08:50.048307 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9c8fe017-e320-4b3e-894e-f4258e8d265f-config-data\") pod \"swift-proxy-7d679bc546-fx2h2\" (UID: \"9c8fe017-e320-4b3e-894e-f4258e8d265f\") " pod="openstack-kuttl-tests/swift-proxy-7d679bc546-fx2h2" Mar 16 16:08:50 crc kubenswrapper[5120]: I0316 16:08:50.049253 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/9c8fe017-e320-4b3e-894e-f4258e8d265f-log-httpd\") pod \"swift-proxy-7d679bc546-fx2h2\" (UID: \"9c8fe017-e320-4b3e-894e-f4258e8d265f\") " pod="openstack-kuttl-tests/swift-proxy-7d679bc546-fx2h2" Mar 16 16:08:50 crc kubenswrapper[5120]: I0316 16:08:50.051220 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/9c8fe017-e320-4b3e-894e-f4258e8d265f-run-httpd\") pod \"swift-proxy-7d679bc546-fx2h2\" (UID: \"9c8fe017-e320-4b3e-894e-f4258e8d265f\") " pod="openstack-kuttl-tests/swift-proxy-7d679bc546-fx2h2" Mar 16 16:08:50 crc kubenswrapper[5120]: I0316 16:08:50.053554 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9c8fe017-e320-4b3e-894e-f4258e8d265f-config-data\") pod \"swift-proxy-7d679bc546-fx2h2\" (UID: \"9c8fe017-e320-4b3e-894e-f4258e8d265f\") " pod="openstack-kuttl-tests/swift-proxy-7d679bc546-fx2h2" Mar 16 16:08:50 crc kubenswrapper[5120]: I0316 16:08:50.054566 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/9c8fe017-e320-4b3e-894e-f4258e8d265f-etc-swift\") pod \"swift-proxy-7d679bc546-fx2h2\" (UID: \"9c8fe017-e320-4b3e-894e-f4258e8d265f\") " pod="openstack-kuttl-tests/swift-proxy-7d679bc546-fx2h2" Mar 16 16:08:50 crc kubenswrapper[5120]: I0316 16:08:50.055168 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/9c8fe017-e320-4b3e-894e-f4258e8d265f-internal-tls-certs\") pod \"swift-proxy-7d679bc546-fx2h2\" (UID: \"9c8fe017-e320-4b3e-894e-f4258e8d265f\") " pod="openstack-kuttl-tests/swift-proxy-7d679bc546-fx2h2" Mar 16 16:08:50 crc kubenswrapper[5120]: I0316 16:08:50.059353 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/9c8fe017-e320-4b3e-894e-f4258e8d265f-public-tls-certs\") pod \"swift-proxy-7d679bc546-fx2h2\" (UID: \"9c8fe017-e320-4b3e-894e-f4258e8d265f\") " pod="openstack-kuttl-tests/swift-proxy-7d679bc546-fx2h2" Mar 16 16:08:50 crc kubenswrapper[5120]: I0316 16:08:50.061377 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9c8fe017-e320-4b3e-894e-f4258e8d265f-combined-ca-bundle\") pod \"swift-proxy-7d679bc546-fx2h2\" (UID: \"9c8fe017-e320-4b3e-894e-f4258e8d265f\") " pod="openstack-kuttl-tests/swift-proxy-7d679bc546-fx2h2" Mar 16 16:08:50 crc kubenswrapper[5120]: I0316 16:08:50.061818 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-6pnfb" Mar 16 16:08:50 crc kubenswrapper[5120]: I0316 16:08:50.107537 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5whvb\" (UniqueName: \"kubernetes.io/projected/9c8fe017-e320-4b3e-894e-f4258e8d265f-kube-api-access-5whvb\") pod \"swift-proxy-7d679bc546-fx2h2\" (UID: \"9c8fe017-e320-4b3e-894e-f4258e8d265f\") " pod="openstack-kuttl-tests/swift-proxy-7d679bc546-fx2h2" Mar 16 16:08:50 crc kubenswrapper[5120]: I0316 16:08:50.120371 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-7d679bc546-fx2h2" Mar 16 16:08:50 crc kubenswrapper[5120]: I0316 16:08:50.621448 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/certified-operators-6pnfb"] Mar 16 16:08:50 crc kubenswrapper[5120]: W0316 16:08:50.622057 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod057b7da4_d510_491e_bde1_76e1d4e427ff.slice/crio-17c355d6c66de1786531d3092155b4900389869f60b1cd3e4311e3cb75aac5c0 WatchSource:0}: Error finding container 17c355d6c66de1786531d3092155b4900389869f60b1cd3e4311e3cb75aac5c0: Status 404 returned error can't find the container with id 17c355d6c66de1786531d3092155b4900389869f60b1cd3e4311e3cb75aac5c0 Mar 16 16:08:50 crc kubenswrapper[5120]: I0316 16:08:50.690592 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-proxy-7d679bc546-fx2h2"] Mar 16 16:08:50 crc kubenswrapper[5120]: W0316 16:08:50.698939 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9c8fe017_e320_4b3e_894e_f4258e8d265f.slice/crio-ec521c6821242d79dac240ea60314d5ce9d0d5566ed3cd6f46648bfed0cd4c6e WatchSource:0}: Error finding container ec521c6821242d79dac240ea60314d5ce9d0d5566ed3cd6f46648bfed0cd4c6e: Status 404 returned error can't find the container with id ec521c6821242d79dac240ea60314d5ce9d0d5566ed3cd6f46648bfed0cd4c6e Mar 16 16:08:50 crc kubenswrapper[5120]: I0316 16:08:50.801216 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-7d679bc546-fx2h2" event={"ID":"9c8fe017-e320-4b3e-894e-f4258e8d265f","Type":"ContainerStarted","Data":"ec521c6821242d79dac240ea60314d5ce9d0d5566ed3cd6f46648bfed0cd4c6e"} Mar 16 16:08:50 crc kubenswrapper[5120]: I0316 16:08:50.806938 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-6pnfb" event={"ID":"057b7da4-d510-491e-bde1-76e1d4e427ff","Type":"ContainerStarted","Data":"b63fca20f7305772eddeb8ae3f9b7934d1976920901776d85c4e069caf33685c"} Mar 16 16:08:50 crc kubenswrapper[5120]: I0316 16:08:50.806977 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-6pnfb" event={"ID":"057b7da4-d510-491e-bde1-76e1d4e427ff","Type":"ContainerStarted","Data":"17c355d6c66de1786531d3092155b4900389869f60b1cd3e4311e3cb75aac5c0"} Mar 16 16:08:51 crc kubenswrapper[5120]: I0316 16:08:51.206301 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/neutron-6966b7489-j4l28" Mar 16 16:08:51 crc kubenswrapper[5120]: I0316 16:08:51.818198 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-7d679bc546-fx2h2" event={"ID":"9c8fe017-e320-4b3e-894e-f4258e8d265f","Type":"ContainerStarted","Data":"3db74fc31cc9f68950b009f39db6e01dd25ecf398c5a0a5c2f3f7b6f2dff8aa1"} Mar 16 16:08:51 crc kubenswrapper[5120]: I0316 16:08:51.818243 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-7d679bc546-fx2h2" event={"ID":"9c8fe017-e320-4b3e-894e-f4258e8d265f","Type":"ContainerStarted","Data":"aecc9216eb6521d29e54b5a9aff4540ad9357da77ec5dc2ccefbc0aa24d52e41"} Mar 16 16:08:51 crc kubenswrapper[5120]: I0316 16:08:51.819377 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/swift-proxy-7d679bc546-fx2h2" Mar 16 16:08:51 crc kubenswrapper[5120]: I0316 16:08:51.819404 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/swift-proxy-7d679bc546-fx2h2" Mar 16 16:08:51 crc kubenswrapper[5120]: I0316 16:08:51.821020 5120 generic.go:358] "Generic (PLEG): container finished" podID="057b7da4-d510-491e-bde1-76e1d4e427ff" containerID="b63fca20f7305772eddeb8ae3f9b7934d1976920901776d85c4e069caf33685c" exitCode=0 Mar 16 16:08:51 crc kubenswrapper[5120]: I0316 16:08:51.821294 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-6pnfb" event={"ID":"057b7da4-d510-491e-bde1-76e1d4e427ff","Type":"ContainerDied","Data":"b63fca20f7305772eddeb8ae3f9b7934d1976920901776d85c4e069caf33685c"} Mar 16 16:08:51 crc kubenswrapper[5120]: I0316 16:08:51.845906 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/swift-proxy-7d679bc546-fx2h2" podStartSLOduration=2.8458886679999997 podStartE2EDuration="2.845888668s" podCreationTimestamp="2026-03-16 16:08:49 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:08:51.840288496 +0000 UTC m=+2233.994220153" watchObservedRunningTime="2026-03-16 16:08:51.845888668 +0000 UTC m=+2233.999820325" Mar 16 16:08:52 crc kubenswrapper[5120]: I0316 16:08:52.007718 5120 patch_prober.go:28] interesting pod/machine-config-daemon-7bf76 container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 16:08:52 crc kubenswrapper[5120]: I0316 16:08:52.007812 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 16:08:52 crc kubenswrapper[5120]: I0316 16:08:52.008036 5120 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" Mar 16 16:08:52 crc kubenswrapper[5120]: I0316 16:08:52.008532 5120 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="machine-config-daemon" containerStatusID={"Type":"cri-o","ID":"bc2df124cc6ad146d7c7dd2115ac815986fb62978d38895f6d345a4a9b14dbd8"} pod="openshift-machine-config-operator/machine-config-daemon-7bf76" containerMessage="Container machine-config-daemon failed liveness probe, will be restarted" Mar 16 16:08:52 crc kubenswrapper[5120]: I0316 16:08:52.008596 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" containerID="cri-o://bc2df124cc6ad146d7c7dd2115ac815986fb62978d38895f6d345a4a9b14dbd8" gracePeriod=600 Mar 16 16:08:52 crc kubenswrapper[5120]: I0316 16:08:52.085938 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:08:52 crc kubenswrapper[5120]: I0316 16:08:52.086211 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48" containerName="ceilometer-central-agent" containerID="cri-o://bb4e47606fe1dbd6968e56b302b0cca4c6c753419c7615c49ddff398289a5d68" gracePeriod=30 Mar 16 16:08:52 crc kubenswrapper[5120]: I0316 16:08:52.086497 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48" containerName="sg-core" containerID="cri-o://aef9233d03cb7ffcfb571167c97488b99e9b815478de044c3d0881b1833c44c2" gracePeriod=30 Mar 16 16:08:52 crc kubenswrapper[5120]: I0316 16:08:52.086497 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48" containerName="ceilometer-notification-agent" containerID="cri-o://c3164b9bd12f7a4e47b7ddac80da24cf9238f6b9414e91953b196a7de4faaa57" gracePeriod=30 Mar 16 16:08:52 crc kubenswrapper[5120]: I0316 16:08:52.086503 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48" containerName="proxy-httpd" containerID="cri-o://4ec36bdc47754196e72c5081f292ee68be776a2b0d2247436870ae3d007598f1" gracePeriod=30 Mar 16 16:08:52 crc kubenswrapper[5120]: I0316 16:08:52.095111 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/ceilometer-0" podUID="0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48" containerName="proxy-httpd" probeResult="failure" output="Get \"http://10.217.0.49:3000/\": EOF" Mar 16 16:08:52 crc kubenswrapper[5120]: E0316 16:08:52.156532 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:08:52 crc kubenswrapper[5120]: I0316 16:08:52.341891 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-marketplace-lrwk8"] Mar 16 16:08:52 crc kubenswrapper[5120]: I0316 16:08:52.359015 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-lrwk8" Mar 16 16:08:52 crc kubenswrapper[5120]: I0316 16:08:52.367785 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-lrwk8"] Mar 16 16:08:52 crc kubenswrapper[5120]: I0316 16:08:52.504878 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7bnv\" (UniqueName: \"kubernetes.io/projected/9f77fc46-483c-462c-b8ce-75b212e3e2f0-kube-api-access-t7bnv\") pod \"redhat-marketplace-lrwk8\" (UID: \"9f77fc46-483c-462c-b8ce-75b212e3e2f0\") " pod="openshift-marketplace/redhat-marketplace-lrwk8" Mar 16 16:08:52 crc kubenswrapper[5120]: I0316 16:08:52.505010 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/9f77fc46-483c-462c-b8ce-75b212e3e2f0-catalog-content\") pod \"redhat-marketplace-lrwk8\" (UID: \"9f77fc46-483c-462c-b8ce-75b212e3e2f0\") " pod="openshift-marketplace/redhat-marketplace-lrwk8" Mar 16 16:08:52 crc kubenswrapper[5120]: I0316 16:08:52.505149 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/9f77fc46-483c-462c-b8ce-75b212e3e2f0-utilities\") pod \"redhat-marketplace-lrwk8\" (UID: \"9f77fc46-483c-462c-b8ce-75b212e3e2f0\") " pod="openshift-marketplace/redhat-marketplace-lrwk8" Mar 16 16:08:52 crc kubenswrapper[5120]: I0316 16:08:52.607216 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/9f77fc46-483c-462c-b8ce-75b212e3e2f0-catalog-content\") pod \"redhat-marketplace-lrwk8\" (UID: \"9f77fc46-483c-462c-b8ce-75b212e3e2f0\") " pod="openshift-marketplace/redhat-marketplace-lrwk8" Mar 16 16:08:52 crc kubenswrapper[5120]: I0316 16:08:52.607377 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/9f77fc46-483c-462c-b8ce-75b212e3e2f0-utilities\") pod \"redhat-marketplace-lrwk8\" (UID: \"9f77fc46-483c-462c-b8ce-75b212e3e2f0\") " pod="openshift-marketplace/redhat-marketplace-lrwk8" Mar 16 16:08:52 crc kubenswrapper[5120]: I0316 16:08:52.607433 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t7bnv\" (UniqueName: \"kubernetes.io/projected/9f77fc46-483c-462c-b8ce-75b212e3e2f0-kube-api-access-t7bnv\") pod \"redhat-marketplace-lrwk8\" (UID: \"9f77fc46-483c-462c-b8ce-75b212e3e2f0\") " pod="openshift-marketplace/redhat-marketplace-lrwk8" Mar 16 16:08:52 crc kubenswrapper[5120]: I0316 16:08:52.608119 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/9f77fc46-483c-462c-b8ce-75b212e3e2f0-catalog-content\") pod \"redhat-marketplace-lrwk8\" (UID: \"9f77fc46-483c-462c-b8ce-75b212e3e2f0\") " pod="openshift-marketplace/redhat-marketplace-lrwk8" Mar 16 16:08:52 crc kubenswrapper[5120]: I0316 16:08:52.608191 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/9f77fc46-483c-462c-b8ce-75b212e3e2f0-utilities\") pod \"redhat-marketplace-lrwk8\" (UID: \"9f77fc46-483c-462c-b8ce-75b212e3e2f0\") " pod="openshift-marketplace/redhat-marketplace-lrwk8" Mar 16 16:08:52 crc kubenswrapper[5120]: I0316 16:08:52.629469 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7bnv\" (UniqueName: \"kubernetes.io/projected/9f77fc46-483c-462c-b8ce-75b212e3e2f0-kube-api-access-t7bnv\") pod \"redhat-marketplace-lrwk8\" (UID: \"9f77fc46-483c-462c-b8ce-75b212e3e2f0\") " pod="openshift-marketplace/redhat-marketplace-lrwk8" Mar 16 16:08:52 crc kubenswrapper[5120]: I0316 16:08:52.681230 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-lrwk8" Mar 16 16:08:52 crc kubenswrapper[5120]: I0316 16:08:52.846025 5120 generic.go:358] "Generic (PLEG): container finished" podID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerID="bc2df124cc6ad146d7c7dd2115ac815986fb62978d38895f6d345a4a9b14dbd8" exitCode=0 Mar 16 16:08:52 crc kubenswrapper[5120]: I0316 16:08:52.846048 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" event={"ID":"e2275cb4-4905-4d66-a87e-8010120db2bd","Type":"ContainerDied","Data":"bc2df124cc6ad146d7c7dd2115ac815986fb62978d38895f6d345a4a9b14dbd8"} Mar 16 16:08:52 crc kubenswrapper[5120]: I0316 16:08:52.846086 5120 scope.go:117] "RemoveContainer" containerID="41e926ecd1efaa1bb8aa66a8225167ca401bb54b97dbde9a5efe2bfb869a8032" Mar 16 16:08:52 crc kubenswrapper[5120]: I0316 16:08:52.846564 5120 scope.go:117] "RemoveContainer" containerID="bc2df124cc6ad146d7c7dd2115ac815986fb62978d38895f6d345a4a9b14dbd8" Mar 16 16:08:52 crc kubenswrapper[5120]: E0316 16:08:52.846884 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:08:52 crc kubenswrapper[5120]: I0316 16:08:52.856148 5120 generic.go:358] "Generic (PLEG): container finished" podID="0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48" containerID="4ec36bdc47754196e72c5081f292ee68be776a2b0d2247436870ae3d007598f1" exitCode=0 Mar 16 16:08:52 crc kubenswrapper[5120]: I0316 16:08:52.856169 5120 generic.go:358] "Generic (PLEG): container finished" podID="0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48" containerID="aef9233d03cb7ffcfb571167c97488b99e9b815478de044c3d0881b1833c44c2" exitCode=2 Mar 16 16:08:52 crc kubenswrapper[5120]: I0316 16:08:52.856175 5120 generic.go:358] "Generic (PLEG): container finished" podID="0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48" containerID="c3164b9bd12f7a4e47b7ddac80da24cf9238f6b9414e91953b196a7de4faaa57" exitCode=0 Mar 16 16:08:52 crc kubenswrapper[5120]: I0316 16:08:52.856181 5120 generic.go:358] "Generic (PLEG): container finished" podID="0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48" containerID="bb4e47606fe1dbd6968e56b302b0cca4c6c753419c7615c49ddff398289a5d68" exitCode=0 Mar 16 16:08:52 crc kubenswrapper[5120]: I0316 16:08:52.856939 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48","Type":"ContainerDied","Data":"4ec36bdc47754196e72c5081f292ee68be776a2b0d2247436870ae3d007598f1"} Mar 16 16:08:52 crc kubenswrapper[5120]: I0316 16:08:52.856968 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48","Type":"ContainerDied","Data":"aef9233d03cb7ffcfb571167c97488b99e9b815478de044c3d0881b1833c44c2"} Mar 16 16:08:52 crc kubenswrapper[5120]: I0316 16:08:52.856979 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48","Type":"ContainerDied","Data":"c3164b9bd12f7a4e47b7ddac80da24cf9238f6b9414e91953b196a7de4faaa57"} Mar 16 16:08:52 crc kubenswrapper[5120]: I0316 16:08:52.856987 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48","Type":"ContainerDied","Data":"bb4e47606fe1dbd6968e56b302b0cca4c6c753419c7615c49ddff398289a5d68"} Mar 16 16:08:53 crc kubenswrapper[5120]: I0316 16:08:53.111480 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-lrwk8"] Mar 16 16:08:53 crc kubenswrapper[5120]: I0316 16:08:53.286164 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:08:53 crc kubenswrapper[5120]: I0316 16:08:53.334299 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48-combined-ca-bundle\") pod \"0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48\" (UID: \"0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48\") " Mar 16 16:08:53 crc kubenswrapper[5120]: I0316 16:08:53.338041 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48-config-data\") pod \"0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48\" (UID: \"0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48\") " Mar 16 16:08:53 crc kubenswrapper[5120]: I0316 16:08:53.338079 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48-scripts\") pod \"0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48\" (UID: \"0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48\") " Mar 16 16:08:53 crc kubenswrapper[5120]: I0316 16:08:53.338175 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-45xzf\" (UniqueName: \"kubernetes.io/projected/0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48-kube-api-access-45xzf\") pod \"0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48\" (UID: \"0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48\") " Mar 16 16:08:53 crc kubenswrapper[5120]: I0316 16:08:53.338318 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48-run-httpd\") pod \"0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48\" (UID: \"0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48\") " Mar 16 16:08:53 crc kubenswrapper[5120]: I0316 16:08:53.338358 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48-log-httpd\") pod \"0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48\" (UID: \"0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48\") " Mar 16 16:08:53 crc kubenswrapper[5120]: I0316 16:08:53.338377 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48-sg-core-conf-yaml\") pod \"0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48\" (UID: \"0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48\") " Mar 16 16:08:53 crc kubenswrapper[5120]: I0316 16:08:53.338849 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48" (UID: "0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:08:53 crc kubenswrapper[5120]: I0316 16:08:53.339387 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:08:53 crc kubenswrapper[5120]: I0316 16:08:53.339535 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48" (UID: "0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:08:53 crc kubenswrapper[5120]: I0316 16:08:53.351140 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48-scripts" (OuterVolumeSpecName: "scripts") pod "0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48" (UID: "0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:08:53 crc kubenswrapper[5120]: I0316 16:08:53.356449 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48-kube-api-access-45xzf" (OuterVolumeSpecName: "kube-api-access-45xzf") pod "0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48" (UID: "0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48"). InnerVolumeSpecName "kube-api-access-45xzf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:08:53 crc kubenswrapper[5120]: I0316 16:08:53.430286 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48" (UID: "0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:08:53 crc kubenswrapper[5120]: I0316 16:08:53.441482 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:08:53 crc kubenswrapper[5120]: I0316 16:08:53.441839 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-45xzf\" (UniqueName: \"kubernetes.io/projected/0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48-kube-api-access-45xzf\") on node \"crc\" DevicePath \"\"" Mar 16 16:08:53 crc kubenswrapper[5120]: I0316 16:08:53.441857 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:08:53 crc kubenswrapper[5120]: I0316 16:08:53.441873 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 16:08:53 crc kubenswrapper[5120]: I0316 16:08:53.470735 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48" (UID: "0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:08:53 crc kubenswrapper[5120]: I0316 16:08:53.498824 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48-config-data" (OuterVolumeSpecName: "config-data") pod "0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48" (UID: "0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:08:53 crc kubenswrapper[5120]: I0316 16:08:53.543744 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:08:53 crc kubenswrapper[5120]: I0316 16:08:53.543819 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:08:53 crc kubenswrapper[5120]: I0316 16:08:53.716311 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-dwlmc"] Mar 16 16:08:53 crc kubenswrapper[5120]: I0316 16:08:53.717489 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48" containerName="ceilometer-central-agent" Mar 16 16:08:53 crc kubenswrapper[5120]: I0316 16:08:53.717511 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48" containerName="ceilometer-central-agent" Mar 16 16:08:53 crc kubenswrapper[5120]: I0316 16:08:53.717545 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48" containerName="ceilometer-notification-agent" Mar 16 16:08:53 crc kubenswrapper[5120]: I0316 16:08:53.717555 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48" containerName="ceilometer-notification-agent" Mar 16 16:08:53 crc kubenswrapper[5120]: I0316 16:08:53.717582 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48" containerName="sg-core" Mar 16 16:08:53 crc kubenswrapper[5120]: I0316 16:08:53.717590 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48" containerName="sg-core" Mar 16 16:08:53 crc kubenswrapper[5120]: I0316 16:08:53.717609 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48" containerName="proxy-httpd" Mar 16 16:08:53 crc kubenswrapper[5120]: I0316 16:08:53.717617 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48" containerName="proxy-httpd" Mar 16 16:08:53 crc kubenswrapper[5120]: I0316 16:08:53.717862 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48" containerName="ceilometer-central-agent" Mar 16 16:08:53 crc kubenswrapper[5120]: I0316 16:08:53.717878 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48" containerName="sg-core" Mar 16 16:08:53 crc kubenswrapper[5120]: I0316 16:08:53.717894 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48" containerName="proxy-httpd" Mar 16 16:08:53 crc kubenswrapper[5120]: I0316 16:08:53.717909 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48" containerName="ceilometer-notification-agent" Mar 16 16:08:53 crc kubenswrapper[5120]: I0316 16:08:53.737042 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-dwlmc"] Mar 16 16:08:53 crc kubenswrapper[5120]: I0316 16:08:53.737152 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-db-create-dwlmc" Mar 16 16:08:53 crc kubenswrapper[5120]: I0316 16:08:53.747629 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bt625\" (UniqueName: \"kubernetes.io/projected/572b636c-c02b-40bc-9255-913cdba7b65d-kube-api-access-bt625\") pod \"nova-api-db-create-dwlmc\" (UID: \"572b636c-c02b-40bc-9255-913cdba7b65d\") " pod="openstack-kuttl-tests/nova-api-db-create-dwlmc" Mar 16 16:08:53 crc kubenswrapper[5120]: I0316 16:08:53.747889 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/572b636c-c02b-40bc-9255-913cdba7b65d-operator-scripts\") pod \"nova-api-db-create-dwlmc\" (UID: \"572b636c-c02b-40bc-9255-913cdba7b65d\") " pod="openstack-kuttl-tests/nova-api-db-create-dwlmc" Mar 16 16:08:53 crc kubenswrapper[5120]: I0316 16:08:53.820491 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-m2mv9"] Mar 16 16:08:53 crc kubenswrapper[5120]: I0316 16:08:53.826626 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-db-create-m2mv9" Mar 16 16:08:53 crc kubenswrapper[5120]: I0316 16:08:53.829657 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-2002-account-create-update-stfd4"] Mar 16 16:08:53 crc kubenswrapper[5120]: I0316 16:08:53.835058 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-2002-account-create-update-stfd4" Mar 16 16:08:53 crc kubenswrapper[5120]: I0316 16:08:53.840049 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-db-secret\"" Mar 16 16:08:53 crc kubenswrapper[5120]: I0316 16:08:53.843469 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-m2mv9"] Mar 16 16:08:53 crc kubenswrapper[5120]: I0316 16:08:53.851944 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-2002-account-create-update-stfd4"] Mar 16 16:08:53 crc kubenswrapper[5120]: I0316 16:08:53.853153 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bt625\" (UniqueName: \"kubernetes.io/projected/572b636c-c02b-40bc-9255-913cdba7b65d-kube-api-access-bt625\") pod \"nova-api-db-create-dwlmc\" (UID: \"572b636c-c02b-40bc-9255-913cdba7b65d\") " pod="openstack-kuttl-tests/nova-api-db-create-dwlmc" Mar 16 16:08:53 crc kubenswrapper[5120]: I0316 16:08:53.853640 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2d1f257e-85ac-4cb3-9991-645d525d9dee-operator-scripts\") pod \"nova-api-2002-account-create-update-stfd4\" (UID: \"2d1f257e-85ac-4cb3-9991-645d525d9dee\") " pod="openstack-kuttl-tests/nova-api-2002-account-create-update-stfd4" Mar 16 16:08:53 crc kubenswrapper[5120]: I0316 16:08:53.853785 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6gph\" (UniqueName: \"kubernetes.io/projected/2d1f257e-85ac-4cb3-9991-645d525d9dee-kube-api-access-z6gph\") pod \"nova-api-2002-account-create-update-stfd4\" (UID: \"2d1f257e-85ac-4cb3-9991-645d525d9dee\") " pod="openstack-kuttl-tests/nova-api-2002-account-create-update-stfd4" Mar 16 16:08:53 crc kubenswrapper[5120]: I0316 16:08:53.854028 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7nn9x\" (UniqueName: \"kubernetes.io/projected/c2f18d16-d2de-496a-b894-947a5c23f857-kube-api-access-7nn9x\") pod \"nova-cell0-db-create-m2mv9\" (UID: \"c2f18d16-d2de-496a-b894-947a5c23f857\") " pod="openstack-kuttl-tests/nova-cell0-db-create-m2mv9" Mar 16 16:08:53 crc kubenswrapper[5120]: I0316 16:08:53.854237 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/572b636c-c02b-40bc-9255-913cdba7b65d-operator-scripts\") pod \"nova-api-db-create-dwlmc\" (UID: \"572b636c-c02b-40bc-9255-913cdba7b65d\") " pod="openstack-kuttl-tests/nova-api-db-create-dwlmc" Mar 16 16:08:53 crc kubenswrapper[5120]: I0316 16:08:53.854324 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c2f18d16-d2de-496a-b894-947a5c23f857-operator-scripts\") pod \"nova-cell0-db-create-m2mv9\" (UID: \"c2f18d16-d2de-496a-b894-947a5c23f857\") " pod="openstack-kuttl-tests/nova-cell0-db-create-m2mv9" Mar 16 16:08:53 crc kubenswrapper[5120]: I0316 16:08:53.855044 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/572b636c-c02b-40bc-9255-913cdba7b65d-operator-scripts\") pod \"nova-api-db-create-dwlmc\" (UID: \"572b636c-c02b-40bc-9255-913cdba7b65d\") " pod="openstack-kuttl-tests/nova-api-db-create-dwlmc" Mar 16 16:08:53 crc kubenswrapper[5120]: I0316 16:08:53.869774 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48","Type":"ContainerDied","Data":"4ee399a7335dda8250cda5831b0db769154db956d97665896f763de12a82f3e1"} Mar 16 16:08:53 crc kubenswrapper[5120]: I0316 16:08:53.869824 5120 scope.go:117] "RemoveContainer" containerID="4ec36bdc47754196e72c5081f292ee68be776a2b0d2247436870ae3d007598f1" Mar 16 16:08:53 crc kubenswrapper[5120]: I0316 16:08:53.869966 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:08:53 crc kubenswrapper[5120]: I0316 16:08:53.873703 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bt625\" (UniqueName: \"kubernetes.io/projected/572b636c-c02b-40bc-9255-913cdba7b65d-kube-api-access-bt625\") pod \"nova-api-db-create-dwlmc\" (UID: \"572b636c-c02b-40bc-9255-913cdba7b65d\") " pod="openstack-kuttl-tests/nova-api-db-create-dwlmc" Mar 16 16:08:53 crc kubenswrapper[5120]: I0316 16:08:53.876880 5120 generic.go:358] "Generic (PLEG): container finished" podID="057b7da4-d510-491e-bde1-76e1d4e427ff" containerID="42a7bfc26f8a6cf5b0cd8119a2b9e78583fc89e500cc9bb9bb23c738d8b9bed1" exitCode=0 Mar 16 16:08:53 crc kubenswrapper[5120]: I0316 16:08:53.877056 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-6pnfb" event={"ID":"057b7da4-d510-491e-bde1-76e1d4e427ff","Type":"ContainerDied","Data":"42a7bfc26f8a6cf5b0cd8119a2b9e78583fc89e500cc9bb9bb23c738d8b9bed1"} Mar 16 16:08:53 crc kubenswrapper[5120]: I0316 16:08:53.889138 5120 generic.go:358] "Generic (PLEG): container finished" podID="9f77fc46-483c-462c-b8ce-75b212e3e2f0" containerID="b5413aa6bb779cb8b5d8beb14130c40441530e777b4bbc768ced1d43814b34a4" exitCode=0 Mar 16 16:08:53 crc kubenswrapper[5120]: I0316 16:08:53.891850 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-lrwk8" event={"ID":"9f77fc46-483c-462c-b8ce-75b212e3e2f0","Type":"ContainerDied","Data":"b5413aa6bb779cb8b5d8beb14130c40441530e777b4bbc768ced1d43814b34a4"} Mar 16 16:08:53 crc kubenswrapper[5120]: I0316 16:08:53.891884 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-lrwk8" event={"ID":"9f77fc46-483c-462c-b8ce-75b212e3e2f0","Type":"ContainerStarted","Data":"10ba62614e33373a0bdf86dfb7be51cf01ce40c81dc720a3dde448b8435aa8a9"} Mar 16 16:08:53 crc kubenswrapper[5120]: I0316 16:08:53.909926 5120 scope.go:117] "RemoveContainer" containerID="aef9233d03cb7ffcfb571167c97488b99e9b815478de044c3d0881b1833c44c2" Mar 16 16:08:53 crc kubenswrapper[5120]: I0316 16:08:53.946039 5120 scope.go:117] "RemoveContainer" containerID="c3164b9bd12f7a4e47b7ddac80da24cf9238f6b9414e91953b196a7de4faaa57" Mar 16 16:08:53 crc kubenswrapper[5120]: I0316 16:08:53.950025 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:08:53 crc kubenswrapper[5120]: I0316 16:08:53.958952 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c2f18d16-d2de-496a-b894-947a5c23f857-operator-scripts\") pod \"nova-cell0-db-create-m2mv9\" (UID: \"c2f18d16-d2de-496a-b894-947a5c23f857\") " pod="openstack-kuttl-tests/nova-cell0-db-create-m2mv9" Mar 16 16:08:53 crc kubenswrapper[5120]: I0316 16:08:53.960352 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c2f18d16-d2de-496a-b894-947a5c23f857-operator-scripts\") pod \"nova-cell0-db-create-m2mv9\" (UID: \"c2f18d16-d2de-496a-b894-947a5c23f857\") " pod="openstack-kuttl-tests/nova-cell0-db-create-m2mv9" Mar 16 16:08:53 crc kubenswrapper[5120]: I0316 16:08:53.961322 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:08:53 crc kubenswrapper[5120]: I0316 16:08:53.966253 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2d1f257e-85ac-4cb3-9991-645d525d9dee-operator-scripts\") pod \"nova-api-2002-account-create-update-stfd4\" (UID: \"2d1f257e-85ac-4cb3-9991-645d525d9dee\") " pod="openstack-kuttl-tests/nova-api-2002-account-create-update-stfd4" Mar 16 16:08:53 crc kubenswrapper[5120]: I0316 16:08:53.966331 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z6gph\" (UniqueName: \"kubernetes.io/projected/2d1f257e-85ac-4cb3-9991-645d525d9dee-kube-api-access-z6gph\") pod \"nova-api-2002-account-create-update-stfd4\" (UID: \"2d1f257e-85ac-4cb3-9991-645d525d9dee\") " pod="openstack-kuttl-tests/nova-api-2002-account-create-update-stfd4" Mar 16 16:08:53 crc kubenswrapper[5120]: I0316 16:08:53.966433 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7nn9x\" (UniqueName: \"kubernetes.io/projected/c2f18d16-d2de-496a-b894-947a5c23f857-kube-api-access-7nn9x\") pod \"nova-cell0-db-create-m2mv9\" (UID: \"c2f18d16-d2de-496a-b894-947a5c23f857\") " pod="openstack-kuttl-tests/nova-cell0-db-create-m2mv9" Mar 16 16:08:53 crc kubenswrapper[5120]: I0316 16:08:53.967687 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2d1f257e-85ac-4cb3-9991-645d525d9dee-operator-scripts\") pod \"nova-api-2002-account-create-update-stfd4\" (UID: \"2d1f257e-85ac-4cb3-9991-645d525d9dee\") " pod="openstack-kuttl-tests/nova-api-2002-account-create-update-stfd4" Mar 16 16:08:53 crc kubenswrapper[5120]: I0316 16:08:53.975498 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:08:53 crc kubenswrapper[5120]: I0316 16:08:53.991821 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6gph\" (UniqueName: \"kubernetes.io/projected/2d1f257e-85ac-4cb3-9991-645d525d9dee-kube-api-access-z6gph\") pod \"nova-api-2002-account-create-update-stfd4\" (UID: \"2d1f257e-85ac-4cb3-9991-645d525d9dee\") " pod="openstack-kuttl-tests/nova-api-2002-account-create-update-stfd4" Mar 16 16:08:53 crc kubenswrapper[5120]: I0316 16:08:53.997695 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7nn9x\" (UniqueName: \"kubernetes.io/projected/c2f18d16-d2de-496a-b894-947a5c23f857-kube-api-access-7nn9x\") pod \"nova-cell0-db-create-m2mv9\" (UID: \"c2f18d16-d2de-496a-b894-947a5c23f857\") " pod="openstack-kuttl-tests/nova-cell0-db-create-m2mv9" Mar 16 16:08:53 crc kubenswrapper[5120]: I0316 16:08:53.998090 5120 scope.go:117] "RemoveContainer" containerID="bb4e47606fe1dbd6968e56b302b0cca4c6c753419c7615c49ddff398289a5d68" Mar 16 16:08:54 crc kubenswrapper[5120]: I0316 16:08:54.013083 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:08:54 crc kubenswrapper[5120]: I0316 16:08:54.013223 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:08:54 crc kubenswrapper[5120]: I0316 16:08:54.024967 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 16:08:54 crc kubenswrapper[5120]: I0316 16:08:54.025199 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 16:08:54 crc kubenswrapper[5120]: I0316 16:08:54.031314 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-lx25w"] Mar 16 16:08:54 crc kubenswrapper[5120]: I0316 16:08:54.040636 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-db-create-lx25w" Mar 16 16:08:54 crc kubenswrapper[5120]: I0316 16:08:54.051703 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-ecee-account-create-update-h24qw"] Mar 16 16:08:54 crc kubenswrapper[5120]: I0316 16:08:54.058812 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-ecee-account-create-update-h24qw" Mar 16 16:08:54 crc kubenswrapper[5120]: I0316 16:08:54.061710 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-db-secret\"" Mar 16 16:08:54 crc kubenswrapper[5120]: I0316 16:08:54.066567 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-db-create-dwlmc" Mar 16 16:08:54 crc kubenswrapper[5120]: I0316 16:08:54.067886 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8m7l\" (UniqueName: \"kubernetes.io/projected/7cd1f19e-4f42-46d6-9271-eb1d9fd7c52e-kube-api-access-p8m7l\") pod \"ceilometer-0\" (UID: \"7cd1f19e-4f42-46d6-9271-eb1d9fd7c52e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:08:54 crc kubenswrapper[5120]: I0316 16:08:54.067922 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/7cd1f19e-4f42-46d6-9271-eb1d9fd7c52e-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"7cd1f19e-4f42-46d6-9271-eb1d9fd7c52e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:08:54 crc kubenswrapper[5120]: I0316 16:08:54.067945 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7cd1f19e-4f42-46d6-9271-eb1d9fd7c52e-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"7cd1f19e-4f42-46d6-9271-eb1d9fd7c52e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:08:54 crc kubenswrapper[5120]: I0316 16:08:54.067966 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7cd1f19e-4f42-46d6-9271-eb1d9fd7c52e-run-httpd\") pod \"ceilometer-0\" (UID: \"7cd1f19e-4f42-46d6-9271-eb1d9fd7c52e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:08:54 crc kubenswrapper[5120]: I0316 16:08:54.068003 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7cd1f19e-4f42-46d6-9271-eb1d9fd7c52e-scripts\") pod \"ceilometer-0\" (UID: \"7cd1f19e-4f42-46d6-9271-eb1d9fd7c52e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:08:54 crc kubenswrapper[5120]: I0316 16:08:54.068095 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djmwm\" (UniqueName: \"kubernetes.io/projected/0ce65374-bf0f-4c93-b907-2c89f76a7109-kube-api-access-djmwm\") pod \"nova-cell1-db-create-lx25w\" (UID: \"0ce65374-bf0f-4c93-b907-2c89f76a7109\") " pod="openstack-kuttl-tests/nova-cell1-db-create-lx25w" Mar 16 16:08:54 crc kubenswrapper[5120]: I0316 16:08:54.068117 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7cd1f19e-4f42-46d6-9271-eb1d9fd7c52e-config-data\") pod \"ceilometer-0\" (UID: \"7cd1f19e-4f42-46d6-9271-eb1d9fd7c52e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:08:54 crc kubenswrapper[5120]: I0316 16:08:54.068223 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0ce65374-bf0f-4c93-b907-2c89f76a7109-operator-scripts\") pod \"nova-cell1-db-create-lx25w\" (UID: \"0ce65374-bf0f-4c93-b907-2c89f76a7109\") " pod="openstack-kuttl-tests/nova-cell1-db-create-lx25w" Mar 16 16:08:54 crc kubenswrapper[5120]: I0316 16:08:54.068269 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7cd1f19e-4f42-46d6-9271-eb1d9fd7c52e-log-httpd\") pod \"ceilometer-0\" (UID: \"7cd1f19e-4f42-46d6-9271-eb1d9fd7c52e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:08:54 crc kubenswrapper[5120]: I0316 16:08:54.069017 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-lx25w"] Mar 16 16:08:54 crc kubenswrapper[5120]: I0316 16:08:54.100228 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-ecee-account-create-update-h24qw"] Mar 16 16:08:54 crc kubenswrapper[5120]: I0316 16:08:54.147995 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-db-create-m2mv9" Mar 16 16:08:54 crc kubenswrapper[5120]: I0316 16:08:54.163306 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-2002-account-create-update-stfd4" Mar 16 16:08:54 crc kubenswrapper[5120]: I0316 16:08:54.171093 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-djmwm\" (UniqueName: \"kubernetes.io/projected/0ce65374-bf0f-4c93-b907-2c89f76a7109-kube-api-access-djmwm\") pod \"nova-cell1-db-create-lx25w\" (UID: \"0ce65374-bf0f-4c93-b907-2c89f76a7109\") " pod="openstack-kuttl-tests/nova-cell1-db-create-lx25w" Mar 16 16:08:54 crc kubenswrapper[5120]: I0316 16:08:54.171129 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7cd1f19e-4f42-46d6-9271-eb1d9fd7c52e-config-data\") pod \"ceilometer-0\" (UID: \"7cd1f19e-4f42-46d6-9271-eb1d9fd7c52e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:08:54 crc kubenswrapper[5120]: I0316 16:08:54.171201 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/559241a9-026f-4ede-ac27-e2fbad0e21cf-operator-scripts\") pod \"nova-cell0-ecee-account-create-update-h24qw\" (UID: \"559241a9-026f-4ede-ac27-e2fbad0e21cf\") " pod="openstack-kuttl-tests/nova-cell0-ecee-account-create-update-h24qw" Mar 16 16:08:54 crc kubenswrapper[5120]: I0316 16:08:54.171247 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0ce65374-bf0f-4c93-b907-2c89f76a7109-operator-scripts\") pod \"nova-cell1-db-create-lx25w\" (UID: \"0ce65374-bf0f-4c93-b907-2c89f76a7109\") " pod="openstack-kuttl-tests/nova-cell1-db-create-lx25w" Mar 16 16:08:54 crc kubenswrapper[5120]: I0316 16:08:54.171294 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7cd1f19e-4f42-46d6-9271-eb1d9fd7c52e-log-httpd\") pod \"ceilometer-0\" (UID: \"7cd1f19e-4f42-46d6-9271-eb1d9fd7c52e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:08:54 crc kubenswrapper[5120]: I0316 16:08:54.171322 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhmxx\" (UniqueName: \"kubernetes.io/projected/559241a9-026f-4ede-ac27-e2fbad0e21cf-kube-api-access-qhmxx\") pod \"nova-cell0-ecee-account-create-update-h24qw\" (UID: \"559241a9-026f-4ede-ac27-e2fbad0e21cf\") " pod="openstack-kuttl-tests/nova-cell0-ecee-account-create-update-h24qw" Mar 16 16:08:54 crc kubenswrapper[5120]: I0316 16:08:54.171348 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p8m7l\" (UniqueName: \"kubernetes.io/projected/7cd1f19e-4f42-46d6-9271-eb1d9fd7c52e-kube-api-access-p8m7l\") pod \"ceilometer-0\" (UID: \"7cd1f19e-4f42-46d6-9271-eb1d9fd7c52e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:08:54 crc kubenswrapper[5120]: I0316 16:08:54.173373 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7cd1f19e-4f42-46d6-9271-eb1d9fd7c52e-log-httpd\") pod \"ceilometer-0\" (UID: \"7cd1f19e-4f42-46d6-9271-eb1d9fd7c52e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:08:54 crc kubenswrapper[5120]: I0316 16:08:54.171375 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/7cd1f19e-4f42-46d6-9271-eb1d9fd7c52e-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"7cd1f19e-4f42-46d6-9271-eb1d9fd7c52e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:08:54 crc kubenswrapper[5120]: I0316 16:08:54.174054 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7cd1f19e-4f42-46d6-9271-eb1d9fd7c52e-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"7cd1f19e-4f42-46d6-9271-eb1d9fd7c52e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:08:54 crc kubenswrapper[5120]: I0316 16:08:54.174113 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7cd1f19e-4f42-46d6-9271-eb1d9fd7c52e-run-httpd\") pod \"ceilometer-0\" (UID: \"7cd1f19e-4f42-46d6-9271-eb1d9fd7c52e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:08:54 crc kubenswrapper[5120]: I0316 16:08:54.174202 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7cd1f19e-4f42-46d6-9271-eb1d9fd7c52e-scripts\") pod \"ceilometer-0\" (UID: \"7cd1f19e-4f42-46d6-9271-eb1d9fd7c52e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:08:54 crc kubenswrapper[5120]: I0316 16:08:54.176977 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7cd1f19e-4f42-46d6-9271-eb1d9fd7c52e-run-httpd\") pod \"ceilometer-0\" (UID: \"7cd1f19e-4f42-46d6-9271-eb1d9fd7c52e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:08:54 crc kubenswrapper[5120]: I0316 16:08:54.177866 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/7cd1f19e-4f42-46d6-9271-eb1d9fd7c52e-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"7cd1f19e-4f42-46d6-9271-eb1d9fd7c52e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:08:54 crc kubenswrapper[5120]: I0316 16:08:54.178459 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7cd1f19e-4f42-46d6-9271-eb1d9fd7c52e-scripts\") pod \"ceilometer-0\" (UID: \"7cd1f19e-4f42-46d6-9271-eb1d9fd7c52e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:08:54 crc kubenswrapper[5120]: I0316 16:08:54.180202 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0ce65374-bf0f-4c93-b907-2c89f76a7109-operator-scripts\") pod \"nova-cell1-db-create-lx25w\" (UID: \"0ce65374-bf0f-4c93-b907-2c89f76a7109\") " pod="openstack-kuttl-tests/nova-cell1-db-create-lx25w" Mar 16 16:08:54 crc kubenswrapper[5120]: I0316 16:08:54.188934 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7cd1f19e-4f42-46d6-9271-eb1d9fd7c52e-config-data\") pod \"ceilometer-0\" (UID: \"7cd1f19e-4f42-46d6-9271-eb1d9fd7c52e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:08:54 crc kubenswrapper[5120]: I0316 16:08:54.206889 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7cd1f19e-4f42-46d6-9271-eb1d9fd7c52e-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"7cd1f19e-4f42-46d6-9271-eb1d9fd7c52e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:08:54 crc kubenswrapper[5120]: I0316 16:08:54.208439 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8m7l\" (UniqueName: \"kubernetes.io/projected/7cd1f19e-4f42-46d6-9271-eb1d9fd7c52e-kube-api-access-p8m7l\") pod \"ceilometer-0\" (UID: \"7cd1f19e-4f42-46d6-9271-eb1d9fd7c52e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:08:54 crc kubenswrapper[5120]: I0316 16:08:54.210986 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-djmwm\" (UniqueName: \"kubernetes.io/projected/0ce65374-bf0f-4c93-b907-2c89f76a7109-kube-api-access-djmwm\") pod \"nova-cell1-db-create-lx25w\" (UID: \"0ce65374-bf0f-4c93-b907-2c89f76a7109\") " pod="openstack-kuttl-tests/nova-cell1-db-create-lx25w" Mar 16 16:08:54 crc kubenswrapper[5120]: I0316 16:08:54.246687 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-917a-account-create-update-6sckt"] Mar 16 16:08:54 crc kubenswrapper[5120]: I0316 16:08:54.258034 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-917a-account-create-update-6sckt" Mar 16 16:08:54 crc kubenswrapper[5120]: I0316 16:08:54.260949 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-917a-account-create-update-6sckt"] Mar 16 16:08:54 crc kubenswrapper[5120]: I0316 16:08:54.265111 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-db-secret\"" Mar 16 16:08:54 crc kubenswrapper[5120]: I0316 16:08:54.276808 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/559241a9-026f-4ede-ac27-e2fbad0e21cf-operator-scripts\") pod \"nova-cell0-ecee-account-create-update-h24qw\" (UID: \"559241a9-026f-4ede-ac27-e2fbad0e21cf\") " pod="openstack-kuttl-tests/nova-cell0-ecee-account-create-update-h24qw" Mar 16 16:08:54 crc kubenswrapper[5120]: I0316 16:08:54.276917 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qhmxx\" (UniqueName: \"kubernetes.io/projected/559241a9-026f-4ede-ac27-e2fbad0e21cf-kube-api-access-qhmxx\") pod \"nova-cell0-ecee-account-create-update-h24qw\" (UID: \"559241a9-026f-4ede-ac27-e2fbad0e21cf\") " pod="openstack-kuttl-tests/nova-cell0-ecee-account-create-update-h24qw" Mar 16 16:08:54 crc kubenswrapper[5120]: I0316 16:08:54.277847 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/559241a9-026f-4ede-ac27-e2fbad0e21cf-operator-scripts\") pod \"nova-cell0-ecee-account-create-update-h24qw\" (UID: \"559241a9-026f-4ede-ac27-e2fbad0e21cf\") " pod="openstack-kuttl-tests/nova-cell0-ecee-account-create-update-h24qw" Mar 16 16:08:54 crc kubenswrapper[5120]: I0316 16:08:54.307410 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhmxx\" (UniqueName: \"kubernetes.io/projected/559241a9-026f-4ede-ac27-e2fbad0e21cf-kube-api-access-qhmxx\") pod \"nova-cell0-ecee-account-create-update-h24qw\" (UID: \"559241a9-026f-4ede-ac27-e2fbad0e21cf\") " pod="openstack-kuttl-tests/nova-cell0-ecee-account-create-update-h24qw" Mar 16 16:08:54 crc kubenswrapper[5120]: I0316 16:08:54.340047 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/neutron-cb8df78d6-4gf8s" Mar 16 16:08:54 crc kubenswrapper[5120]: I0316 16:08:54.351093 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:08:54 crc kubenswrapper[5120]: I0316 16:08:54.369799 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-db-create-lx25w" Mar 16 16:08:54 crc kubenswrapper[5120]: I0316 16:08:54.378891 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddglk\" (UniqueName: \"kubernetes.io/projected/807be2e6-5651-4f26-a39a-4a11e91d9472-kube-api-access-ddglk\") pod \"nova-cell1-917a-account-create-update-6sckt\" (UID: \"807be2e6-5651-4f26-a39a-4a11e91d9472\") " pod="openstack-kuttl-tests/nova-cell1-917a-account-create-update-6sckt" Mar 16 16:08:54 crc kubenswrapper[5120]: I0316 16:08:54.379041 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/807be2e6-5651-4f26-a39a-4a11e91d9472-operator-scripts\") pod \"nova-cell1-917a-account-create-update-6sckt\" (UID: \"807be2e6-5651-4f26-a39a-4a11e91d9472\") " pod="openstack-kuttl-tests/nova-cell1-917a-account-create-update-6sckt" Mar 16 16:08:54 crc kubenswrapper[5120]: I0316 16:08:54.396393 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-ecee-account-create-update-h24qw" Mar 16 16:08:54 crc kubenswrapper[5120]: I0316 16:08:54.412489 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-6966b7489-j4l28"] Mar 16 16:08:54 crc kubenswrapper[5120]: I0316 16:08:54.412745 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-6966b7489-j4l28" podUID="ddb7fdf9-5c27-4d59-b778-ff2a95f45bec" containerName="neutron-api" containerID="cri-o://d4b438f64f506b89949a8c4147ee8c86bc3432e11f87ea5243983b43429bf5cd" gracePeriod=30 Mar 16 16:08:54 crc kubenswrapper[5120]: I0316 16:08:54.413190 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-6966b7489-j4l28" podUID="ddb7fdf9-5c27-4d59-b778-ff2a95f45bec" containerName="neutron-httpd" containerID="cri-o://17477a9134c8df5798f09943b7308bf44123114575842c97afe67f8d53c7c73d" gracePeriod=30 Mar 16 16:08:54 crc kubenswrapper[5120]: I0316 16:08:54.481587 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/807be2e6-5651-4f26-a39a-4a11e91d9472-operator-scripts\") pod \"nova-cell1-917a-account-create-update-6sckt\" (UID: \"807be2e6-5651-4f26-a39a-4a11e91d9472\") " pod="openstack-kuttl-tests/nova-cell1-917a-account-create-update-6sckt" Mar 16 16:08:54 crc kubenswrapper[5120]: I0316 16:08:54.482323 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ddglk\" (UniqueName: \"kubernetes.io/projected/807be2e6-5651-4f26-a39a-4a11e91d9472-kube-api-access-ddglk\") pod \"nova-cell1-917a-account-create-update-6sckt\" (UID: \"807be2e6-5651-4f26-a39a-4a11e91d9472\") " pod="openstack-kuttl-tests/nova-cell1-917a-account-create-update-6sckt" Mar 16 16:08:54 crc kubenswrapper[5120]: I0316 16:08:54.483250 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/807be2e6-5651-4f26-a39a-4a11e91d9472-operator-scripts\") pod \"nova-cell1-917a-account-create-update-6sckt\" (UID: \"807be2e6-5651-4f26-a39a-4a11e91d9472\") " pod="openstack-kuttl-tests/nova-cell1-917a-account-create-update-6sckt" Mar 16 16:08:54 crc kubenswrapper[5120]: I0316 16:08:54.501474 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddglk\" (UniqueName: \"kubernetes.io/projected/807be2e6-5651-4f26-a39a-4a11e91d9472-kube-api-access-ddglk\") pod \"nova-cell1-917a-account-create-update-6sckt\" (UID: \"807be2e6-5651-4f26-a39a-4a11e91d9472\") " pod="openstack-kuttl-tests/nova-cell1-917a-account-create-update-6sckt" Mar 16 16:08:54 crc kubenswrapper[5120]: I0316 16:08:54.619918 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-dwlmc"] Mar 16 16:08:54 crc kubenswrapper[5120]: W0316 16:08:54.640834 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod572b636c_c02b_40bc_9255_913cdba7b65d.slice/crio-3979d39600dc5a260c13fbe73602de0f6aad21f454c708496f9c85a241b40725 WatchSource:0}: Error finding container 3979d39600dc5a260c13fbe73602de0f6aad21f454c708496f9c85a241b40725: Status 404 returned error can't find the container with id 3979d39600dc5a260c13fbe73602de0f6aad21f454c708496f9c85a241b40725 Mar 16 16:08:54 crc kubenswrapper[5120]: I0316 16:08:54.666045 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-917a-account-create-update-6sckt" Mar 16 16:08:54 crc kubenswrapper[5120]: I0316 16:08:54.732743 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48" path="/var/lib/kubelet/pods/0d79ec7a-eb08-4ad9-bd14-a1abdbcf7a48/volumes" Mar 16 16:08:54 crc kubenswrapper[5120]: I0316 16:08:54.736333 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:08:54 crc kubenswrapper[5120]: I0316 16:08:54.786516 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-m2mv9"] Mar 16 16:08:54 crc kubenswrapper[5120]: I0316 16:08:54.802441 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-2002-account-create-update-stfd4"] Mar 16 16:08:54 crc kubenswrapper[5120]: I0316 16:08:54.928146 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-6pnfb" event={"ID":"057b7da4-d510-491e-bde1-76e1d4e427ff","Type":"ContainerStarted","Data":"276e2b0e861103439a5999509cf84de3ad76c14b52e19d8ed85ddb54f732cb69"} Mar 16 16:08:54 crc kubenswrapper[5120]: I0316 16:08:54.939671 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-db-create-m2mv9" event={"ID":"c2f18d16-d2de-496a-b894-947a5c23f857","Type":"ContainerStarted","Data":"3aae68efebe65d694baa055e135ce7456a9164ecb7d50579e5cd02f8bda03652"} Mar 16 16:08:54 crc kubenswrapper[5120]: I0316 16:08:54.943073 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-2002-account-create-update-stfd4" event={"ID":"2d1f257e-85ac-4cb3-9991-645d525d9dee","Type":"ContainerStarted","Data":"18d1c80f14ab23dcf8605f797da9490d6c9ea71b172c6ce82ab66fef5c1d9237"} Mar 16 16:08:54 crc kubenswrapper[5120]: I0316 16:08:54.944465 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-db-create-dwlmc" event={"ID":"572b636c-c02b-40bc-9255-913cdba7b65d","Type":"ContainerStarted","Data":"3979d39600dc5a260c13fbe73602de0f6aad21f454c708496f9c85a241b40725"} Mar 16 16:08:54 crc kubenswrapper[5120]: I0316 16:08:54.951188 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/certified-operators-6pnfb" podStartSLOduration=4.85444032 podStartE2EDuration="5.951165436s" podCreationTimestamp="2026-03-16 16:08:49 +0000 UTC" firstStartedPulling="2026-03-16 16:08:51.821877562 +0000 UTC m=+2233.975809219" lastFinishedPulling="2026-03-16 16:08:52.918602678 +0000 UTC m=+2235.072534335" observedRunningTime="2026-03-16 16:08:54.946754286 +0000 UTC m=+2237.100685973" watchObservedRunningTime="2026-03-16 16:08:54.951165436 +0000 UTC m=+2237.105097093" Mar 16 16:08:54 crc kubenswrapper[5120]: I0316 16:08:54.961586 5120 generic.go:358] "Generic (PLEG): container finished" podID="ddb7fdf9-5c27-4d59-b778-ff2a95f45bec" containerID="17477a9134c8df5798f09943b7308bf44123114575842c97afe67f8d53c7c73d" exitCode=0 Mar 16 16:08:54 crc kubenswrapper[5120]: I0316 16:08:54.961707 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-6966b7489-j4l28" event={"ID":"ddb7fdf9-5c27-4d59-b778-ff2a95f45bec","Type":"ContainerDied","Data":"17477a9134c8df5798f09943b7308bf44123114575842c97afe67f8d53c7c73d"} Mar 16 16:08:54 crc kubenswrapper[5120]: I0316 16:08:54.985588 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-db-create-dwlmc" podStartSLOduration=1.985568075 podStartE2EDuration="1.985568075s" podCreationTimestamp="2026-03-16 16:08:53 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:08:54.967972875 +0000 UTC m=+2237.121904532" watchObservedRunningTime="2026-03-16 16:08:54.985568075 +0000 UTC m=+2237.139499732" Mar 16 16:08:55 crc kubenswrapper[5120]: I0316 16:08:55.029738 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-lx25w"] Mar 16 16:08:55 crc kubenswrapper[5120]: I0316 16:08:55.040194 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:08:55 crc kubenswrapper[5120]: I0316 16:08:55.181852 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-ecee-account-create-update-h24qw"] Mar 16 16:08:55 crc kubenswrapper[5120]: I0316 16:08:55.355001 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-917a-account-create-update-6sckt"] Mar 16 16:08:55 crc kubenswrapper[5120]: W0316 16:08:55.369364 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod807be2e6_5651_4f26_a39a_4a11e91d9472.slice/crio-5402ff105848905dc784da436b54823c3ebed6daadb3ec3c58cbed59e9f23e39 WatchSource:0}: Error finding container 5402ff105848905dc784da436b54823c3ebed6daadb3ec3c58cbed59e9f23e39: Status 404 returned error can't find the container with id 5402ff105848905dc784da436b54823c3ebed6daadb3ec3c58cbed59e9f23e39 Mar 16 16:08:55 crc kubenswrapper[5120]: I0316 16:08:55.972162 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-ecee-account-create-update-h24qw" event={"ID":"559241a9-026f-4ede-ac27-e2fbad0e21cf","Type":"ContainerStarted","Data":"86f83fca6ab075b38eca89e7c7ced5eb1b4d050e98a0ee12c759951c4731d841"} Mar 16 16:08:55 crc kubenswrapper[5120]: I0316 16:08:55.972423 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-ecee-account-create-update-h24qw" event={"ID":"559241a9-026f-4ede-ac27-e2fbad0e21cf","Type":"ContainerStarted","Data":"b32f3d94e7b7e52583991e003e2dba88a6a85924e13e16989d6fc43d34fbfddf"} Mar 16 16:08:55 crc kubenswrapper[5120]: I0316 16:08:55.974035 5120 generic.go:358] "Generic (PLEG): container finished" podID="c2f18d16-d2de-496a-b894-947a5c23f857" containerID="b8d4df20eca7354223b17e86bfe07f5dcc7be3fff45ab9861cdabc4513225847" exitCode=0 Mar 16 16:08:55 crc kubenswrapper[5120]: I0316 16:08:55.974082 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-db-create-m2mv9" event={"ID":"c2f18d16-d2de-496a-b894-947a5c23f857","Type":"ContainerDied","Data":"b8d4df20eca7354223b17e86bfe07f5dcc7be3fff45ab9861cdabc4513225847"} Mar 16 16:08:55 crc kubenswrapper[5120]: I0316 16:08:55.975351 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7cd1f19e-4f42-46d6-9271-eb1d9fd7c52e","Type":"ContainerStarted","Data":"756fb30d7e31c1515cd9d14a5eb8f7399595478b32449d5a4e9e788877bdd3e8"} Mar 16 16:08:55 crc kubenswrapper[5120]: I0316 16:08:55.977022 5120 generic.go:358] "Generic (PLEG): container finished" podID="2d1f257e-85ac-4cb3-9991-645d525d9dee" containerID="5813f766891baa0d21ad038919f53549776bb35485e31262155001d6d5ba2fd9" exitCode=0 Mar 16 16:08:55 crc kubenswrapper[5120]: I0316 16:08:55.977090 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-2002-account-create-update-stfd4" event={"ID":"2d1f257e-85ac-4cb3-9991-645d525d9dee","Type":"ContainerDied","Data":"5813f766891baa0d21ad038919f53549776bb35485e31262155001d6d5ba2fd9"} Mar 16 16:08:55 crc kubenswrapper[5120]: I0316 16:08:55.978719 5120 generic.go:358] "Generic (PLEG): container finished" podID="572b636c-c02b-40bc-9255-913cdba7b65d" containerID="34480a0ef3a968b5b94e3aef00c1fe143e4c18f8f2076c9099a585f6662cd78a" exitCode=0 Mar 16 16:08:55 crc kubenswrapper[5120]: I0316 16:08:55.978888 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-db-create-dwlmc" event={"ID":"572b636c-c02b-40bc-9255-913cdba7b65d","Type":"ContainerDied","Data":"34480a0ef3a968b5b94e3aef00c1fe143e4c18f8f2076c9099a585f6662cd78a"} Mar 16 16:08:55 crc kubenswrapper[5120]: I0316 16:08:55.981033 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-db-create-lx25w" event={"ID":"0ce65374-bf0f-4c93-b907-2c89f76a7109","Type":"ContainerStarted","Data":"f20e53be4930446a7325c8d5f2ec0356ea085590fcee934d4890c0947460f962"} Mar 16 16:08:55 crc kubenswrapper[5120]: I0316 16:08:55.981056 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-db-create-lx25w" event={"ID":"0ce65374-bf0f-4c93-b907-2c89f76a7109","Type":"ContainerStarted","Data":"2209dae76d7dc24073454d606aaabb4751f6c4b4e5895942b6059470e682eb1b"} Mar 16 16:08:55 crc kubenswrapper[5120]: I0316 16:08:55.983289 5120 generic.go:358] "Generic (PLEG): container finished" podID="807be2e6-5651-4f26-a39a-4a11e91d9472" containerID="4a1af8f8ddbcd4d20b7d3b73b0026ade416b5bbb2231196831b5d08f6a06c21c" exitCode=0 Mar 16 16:08:55 crc kubenswrapper[5120]: I0316 16:08:55.983875 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-917a-account-create-update-6sckt" event={"ID":"807be2e6-5651-4f26-a39a-4a11e91d9472","Type":"ContainerDied","Data":"4a1af8f8ddbcd4d20b7d3b73b0026ade416b5bbb2231196831b5d08f6a06c21c"} Mar 16 16:08:55 crc kubenswrapper[5120]: I0316 16:08:55.983896 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-917a-account-create-update-6sckt" event={"ID":"807be2e6-5651-4f26-a39a-4a11e91d9472","Type":"ContainerStarted","Data":"5402ff105848905dc784da436b54823c3ebed6daadb3ec3c58cbed59e9f23e39"} Mar 16 16:08:56 crc kubenswrapper[5120]: I0316 16:08:56.002114 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-ecee-account-create-update-h24qw" podStartSLOduration=2.002096022 podStartE2EDuration="2.002096022s" podCreationTimestamp="2026-03-16 16:08:54 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:08:55.994145434 +0000 UTC m=+2238.148077091" watchObservedRunningTime="2026-03-16 16:08:56.002096022 +0000 UTC m=+2238.156027679" Mar 16 16:08:56 crc kubenswrapper[5120]: I0316 16:08:56.079922 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-db-create-lx25w" podStartSLOduration=3.079898035 podStartE2EDuration="3.079898035s" podCreationTimestamp="2026-03-16 16:08:53 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:08:56.075373821 +0000 UTC m=+2238.229305478" watchObservedRunningTime="2026-03-16 16:08:56.079898035 +0000 UTC m=+2238.233829692" Mar 16 16:08:56 crc kubenswrapper[5120]: I0316 16:08:56.995800 5120 generic.go:358] "Generic (PLEG): container finished" podID="9f77fc46-483c-462c-b8ce-75b212e3e2f0" containerID="5e7b5fae4c9b50ff0ff21db22ef8bd6266b7d2888e440fccd439058e5bc929b5" exitCode=0 Mar 16 16:08:56 crc kubenswrapper[5120]: I0316 16:08:56.995903 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-lrwk8" event={"ID":"9f77fc46-483c-462c-b8ce-75b212e3e2f0","Type":"ContainerDied","Data":"5e7b5fae4c9b50ff0ff21db22ef8bd6266b7d2888e440fccd439058e5bc929b5"} Mar 16 16:08:57 crc kubenswrapper[5120]: I0316 16:08:57.002135 5120 generic.go:358] "Generic (PLEG): container finished" podID="0ce65374-bf0f-4c93-b907-2c89f76a7109" containerID="f20e53be4930446a7325c8d5f2ec0356ea085590fcee934d4890c0947460f962" exitCode=0 Mar 16 16:08:57 crc kubenswrapper[5120]: I0316 16:08:57.002650 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-db-create-lx25w" event={"ID":"0ce65374-bf0f-4c93-b907-2c89f76a7109","Type":"ContainerDied","Data":"f20e53be4930446a7325c8d5f2ec0356ea085590fcee934d4890c0947460f962"} Mar 16 16:08:57 crc kubenswrapper[5120]: I0316 16:08:57.006376 5120 generic.go:358] "Generic (PLEG): container finished" podID="559241a9-026f-4ede-ac27-e2fbad0e21cf" containerID="86f83fca6ab075b38eca89e7c7ced5eb1b4d050e98a0ee12c759951c4731d841" exitCode=0 Mar 16 16:08:57 crc kubenswrapper[5120]: I0316 16:08:57.006516 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-ecee-account-create-update-h24qw" event={"ID":"559241a9-026f-4ede-ac27-e2fbad0e21cf","Type":"ContainerDied","Data":"86f83fca6ab075b38eca89e7c7ced5eb1b4d050e98a0ee12c759951c4731d841"} Mar 16 16:08:57 crc kubenswrapper[5120]: I0316 16:08:57.009448 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7cd1f19e-4f42-46d6-9271-eb1d9fd7c52e","Type":"ContainerStarted","Data":"9f496d6fbdcfbd6fc07376d0ab068a3fec1af56cff769d29812ad1fec9e4e9f2"} Mar 16 16:08:57 crc kubenswrapper[5120]: I0316 16:08:57.498778 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-2002-account-create-update-stfd4" Mar 16 16:08:57 crc kubenswrapper[5120]: I0316 16:08:57.595186 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z6gph\" (UniqueName: \"kubernetes.io/projected/2d1f257e-85ac-4cb3-9991-645d525d9dee-kube-api-access-z6gph\") pod \"2d1f257e-85ac-4cb3-9991-645d525d9dee\" (UID: \"2d1f257e-85ac-4cb3-9991-645d525d9dee\") " Mar 16 16:08:57 crc kubenswrapper[5120]: I0316 16:08:57.596721 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2d1f257e-85ac-4cb3-9991-645d525d9dee-operator-scripts\") pod \"2d1f257e-85ac-4cb3-9991-645d525d9dee\" (UID: \"2d1f257e-85ac-4cb3-9991-645d525d9dee\") " Mar 16 16:08:57 crc kubenswrapper[5120]: I0316 16:08:57.598794 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d1f257e-85ac-4cb3-9991-645d525d9dee-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "2d1f257e-85ac-4cb3-9991-645d525d9dee" (UID: "2d1f257e-85ac-4cb3-9991-645d525d9dee"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:08:57 crc kubenswrapper[5120]: I0316 16:08:57.602139 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d1f257e-85ac-4cb3-9991-645d525d9dee-kube-api-access-z6gph" (OuterVolumeSpecName: "kube-api-access-z6gph") pod "2d1f257e-85ac-4cb3-9991-645d525d9dee" (UID: "2d1f257e-85ac-4cb3-9991-645d525d9dee"). InnerVolumeSpecName "kube-api-access-z6gph". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:08:57 crc kubenswrapper[5120]: I0316 16:08:57.666434 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-917a-account-create-update-6sckt" Mar 16 16:08:57 crc kubenswrapper[5120]: I0316 16:08:57.671621 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-db-create-m2mv9" Mar 16 16:08:57 crc kubenswrapper[5120]: I0316 16:08:57.683060 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-db-create-dwlmc" Mar 16 16:08:57 crc kubenswrapper[5120]: I0316 16:08:57.699396 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z6gph\" (UniqueName: \"kubernetes.io/projected/2d1f257e-85ac-4cb3-9991-645d525d9dee-kube-api-access-z6gph\") on node \"crc\" DevicePath \"\"" Mar 16 16:08:57 crc kubenswrapper[5120]: I0316 16:08:57.699418 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2d1f257e-85ac-4cb3-9991-645d525d9dee-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:08:57 crc kubenswrapper[5120]: I0316 16:08:57.800504 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c2f18d16-d2de-496a-b894-947a5c23f857-operator-scripts\") pod \"c2f18d16-d2de-496a-b894-947a5c23f857\" (UID: \"c2f18d16-d2de-496a-b894-947a5c23f857\") " Mar 16 16:08:57 crc kubenswrapper[5120]: I0316 16:08:57.801017 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/807be2e6-5651-4f26-a39a-4a11e91d9472-operator-scripts\") pod \"807be2e6-5651-4f26-a39a-4a11e91d9472\" (UID: \"807be2e6-5651-4f26-a39a-4a11e91d9472\") " Mar 16 16:08:57 crc kubenswrapper[5120]: I0316 16:08:57.801112 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bt625\" (UniqueName: \"kubernetes.io/projected/572b636c-c02b-40bc-9255-913cdba7b65d-kube-api-access-bt625\") pod \"572b636c-c02b-40bc-9255-913cdba7b65d\" (UID: \"572b636c-c02b-40bc-9255-913cdba7b65d\") " Mar 16 16:08:57 crc kubenswrapper[5120]: I0316 16:08:57.801190 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c2f18d16-d2de-496a-b894-947a5c23f857-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "c2f18d16-d2de-496a-b894-947a5c23f857" (UID: "c2f18d16-d2de-496a-b894-947a5c23f857"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:08:57 crc kubenswrapper[5120]: I0316 16:08:57.801449 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/572b636c-c02b-40bc-9255-913cdba7b65d-operator-scripts\") pod \"572b636c-c02b-40bc-9255-913cdba7b65d\" (UID: \"572b636c-c02b-40bc-9255-913cdba7b65d\") " Mar 16 16:08:57 crc kubenswrapper[5120]: I0316 16:08:57.801515 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ddglk\" (UniqueName: \"kubernetes.io/projected/807be2e6-5651-4f26-a39a-4a11e91d9472-kube-api-access-ddglk\") pod \"807be2e6-5651-4f26-a39a-4a11e91d9472\" (UID: \"807be2e6-5651-4f26-a39a-4a11e91d9472\") " Mar 16 16:08:57 crc kubenswrapper[5120]: I0316 16:08:57.801517 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/807be2e6-5651-4f26-a39a-4a11e91d9472-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "807be2e6-5651-4f26-a39a-4a11e91d9472" (UID: "807be2e6-5651-4f26-a39a-4a11e91d9472"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:08:57 crc kubenswrapper[5120]: I0316 16:08:57.801596 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7nn9x\" (UniqueName: \"kubernetes.io/projected/c2f18d16-d2de-496a-b894-947a5c23f857-kube-api-access-7nn9x\") pod \"c2f18d16-d2de-496a-b894-947a5c23f857\" (UID: \"c2f18d16-d2de-496a-b894-947a5c23f857\") " Mar 16 16:08:57 crc kubenswrapper[5120]: I0316 16:08:57.801977 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/572b636c-c02b-40bc-9255-913cdba7b65d-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "572b636c-c02b-40bc-9255-913cdba7b65d" (UID: "572b636c-c02b-40bc-9255-913cdba7b65d"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:08:57 crc kubenswrapper[5120]: I0316 16:08:57.802918 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c2f18d16-d2de-496a-b894-947a5c23f857-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:08:57 crc kubenswrapper[5120]: I0316 16:08:57.802933 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/807be2e6-5651-4f26-a39a-4a11e91d9472-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:08:57 crc kubenswrapper[5120]: I0316 16:08:57.802943 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/572b636c-c02b-40bc-9255-913cdba7b65d-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:08:57 crc kubenswrapper[5120]: I0316 16:08:57.810654 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2f18d16-d2de-496a-b894-947a5c23f857-kube-api-access-7nn9x" (OuterVolumeSpecName: "kube-api-access-7nn9x") pod "c2f18d16-d2de-496a-b894-947a5c23f857" (UID: "c2f18d16-d2de-496a-b894-947a5c23f857"). InnerVolumeSpecName "kube-api-access-7nn9x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:08:57 crc kubenswrapper[5120]: I0316 16:08:57.811096 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/572b636c-c02b-40bc-9255-913cdba7b65d-kube-api-access-bt625" (OuterVolumeSpecName: "kube-api-access-bt625") pod "572b636c-c02b-40bc-9255-913cdba7b65d" (UID: "572b636c-c02b-40bc-9255-913cdba7b65d"). InnerVolumeSpecName "kube-api-access-bt625". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:08:57 crc kubenswrapper[5120]: I0316 16:08:57.812936 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/807be2e6-5651-4f26-a39a-4a11e91d9472-kube-api-access-ddglk" (OuterVolumeSpecName: "kube-api-access-ddglk") pod "807be2e6-5651-4f26-a39a-4a11e91d9472" (UID: "807be2e6-5651-4f26-a39a-4a11e91d9472"). InnerVolumeSpecName "kube-api-access-ddglk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:08:57 crc kubenswrapper[5120]: I0316 16:08:57.905283 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bt625\" (UniqueName: \"kubernetes.io/projected/572b636c-c02b-40bc-9255-913cdba7b65d-kube-api-access-bt625\") on node \"crc\" DevicePath \"\"" Mar 16 16:08:57 crc kubenswrapper[5120]: I0316 16:08:57.905449 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ddglk\" (UniqueName: \"kubernetes.io/projected/807be2e6-5651-4f26-a39a-4a11e91d9472-kube-api-access-ddglk\") on node \"crc\" DevicePath \"\"" Mar 16 16:08:57 crc kubenswrapper[5120]: I0316 16:08:57.905513 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7nn9x\" (UniqueName: \"kubernetes.io/projected/c2f18d16-d2de-496a-b894-947a5c23f857-kube-api-access-7nn9x\") on node \"crc\" DevicePath \"\"" Mar 16 16:08:58 crc kubenswrapper[5120]: I0316 16:08:58.019470 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-db-create-m2mv9" event={"ID":"c2f18d16-d2de-496a-b894-947a5c23f857","Type":"ContainerDied","Data":"3aae68efebe65d694baa055e135ce7456a9164ecb7d50579e5cd02f8bda03652"} Mar 16 16:08:58 crc kubenswrapper[5120]: I0316 16:08:58.019507 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3aae68efebe65d694baa055e135ce7456a9164ecb7d50579e5cd02f8bda03652" Mar 16 16:08:58 crc kubenswrapper[5120]: I0316 16:08:58.019484 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-db-create-m2mv9" Mar 16 16:08:58 crc kubenswrapper[5120]: I0316 16:08:58.022087 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7cd1f19e-4f42-46d6-9271-eb1d9fd7c52e","Type":"ContainerStarted","Data":"f1311a2bfb13a7c3b653ead3df7480fc96b719fee2c791d0851c854b4aba4915"} Mar 16 16:08:58 crc kubenswrapper[5120]: I0316 16:08:58.023667 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-2002-account-create-update-stfd4" event={"ID":"2d1f257e-85ac-4cb3-9991-645d525d9dee","Type":"ContainerDied","Data":"18d1c80f14ab23dcf8605f797da9490d6c9ea71b172c6ce82ab66fef5c1d9237"} Mar 16 16:08:58 crc kubenswrapper[5120]: I0316 16:08:58.023689 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="18d1c80f14ab23dcf8605f797da9490d6c9ea71b172c6ce82ab66fef5c1d9237" Mar 16 16:08:58 crc kubenswrapper[5120]: I0316 16:08:58.023697 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-2002-account-create-update-stfd4" Mar 16 16:08:58 crc kubenswrapper[5120]: I0316 16:08:58.025482 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-db-create-dwlmc" event={"ID":"572b636c-c02b-40bc-9255-913cdba7b65d","Type":"ContainerDied","Data":"3979d39600dc5a260c13fbe73602de0f6aad21f454c708496f9c85a241b40725"} Mar 16 16:08:58 crc kubenswrapper[5120]: I0316 16:08:58.025523 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3979d39600dc5a260c13fbe73602de0f6aad21f454c708496f9c85a241b40725" Mar 16 16:08:58 crc kubenswrapper[5120]: I0316 16:08:58.025602 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-db-create-dwlmc" Mar 16 16:08:58 crc kubenswrapper[5120]: I0316 16:08:58.029273 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-lrwk8" event={"ID":"9f77fc46-483c-462c-b8ce-75b212e3e2f0","Type":"ContainerStarted","Data":"ae34d5dbda52118e3bf9d9bd2c2c3c024256915c100c75a649c45b001698a4fc"} Mar 16 16:08:58 crc kubenswrapper[5120]: I0316 16:08:58.030823 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-917a-account-create-update-6sckt" Mar 16 16:08:58 crc kubenswrapper[5120]: I0316 16:08:58.033801 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-917a-account-create-update-6sckt" event={"ID":"807be2e6-5651-4f26-a39a-4a11e91d9472","Type":"ContainerDied","Data":"5402ff105848905dc784da436b54823c3ebed6daadb3ec3c58cbed59e9f23e39"} Mar 16 16:08:58 crc kubenswrapper[5120]: I0316 16:08:58.033838 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5402ff105848905dc784da436b54823c3ebed6daadb3ec3c58cbed59e9f23e39" Mar 16 16:08:58 crc kubenswrapper[5120]: I0316 16:08:58.066551 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/redhat-marketplace-lrwk8" podStartSLOduration=3.480973341 podStartE2EDuration="6.06653036s" podCreationTimestamp="2026-03-16 16:08:52 +0000 UTC" firstStartedPulling="2026-03-16 16:08:53.891864923 +0000 UTC m=+2236.045796580" lastFinishedPulling="2026-03-16 16:08:56.477421942 +0000 UTC m=+2238.631353599" observedRunningTime="2026-03-16 16:08:58.05369136 +0000 UTC m=+2240.207623017" watchObservedRunningTime="2026-03-16 16:08:58.06653036 +0000 UTC m=+2240.220462017" Mar 16 16:08:58 crc kubenswrapper[5120]: I0316 16:08:58.256798 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-db-create-lx25w" Mar 16 16:08:58 crc kubenswrapper[5120]: I0316 16:08:58.414662 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-djmwm\" (UniqueName: \"kubernetes.io/projected/0ce65374-bf0f-4c93-b907-2c89f76a7109-kube-api-access-djmwm\") pod \"0ce65374-bf0f-4c93-b907-2c89f76a7109\" (UID: \"0ce65374-bf0f-4c93-b907-2c89f76a7109\") " Mar 16 16:08:58 crc kubenswrapper[5120]: I0316 16:08:58.415356 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0ce65374-bf0f-4c93-b907-2c89f76a7109-operator-scripts\") pod \"0ce65374-bf0f-4c93-b907-2c89f76a7109\" (UID: \"0ce65374-bf0f-4c93-b907-2c89f76a7109\") " Mar 16 16:08:58 crc kubenswrapper[5120]: I0316 16:08:58.416579 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ce65374-bf0f-4c93-b907-2c89f76a7109-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "0ce65374-bf0f-4c93-b907-2c89f76a7109" (UID: "0ce65374-bf0f-4c93-b907-2c89f76a7109"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:08:58 crc kubenswrapper[5120]: I0316 16:08:58.421365 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ce65374-bf0f-4c93-b907-2c89f76a7109-kube-api-access-djmwm" (OuterVolumeSpecName: "kube-api-access-djmwm") pod "0ce65374-bf0f-4c93-b907-2c89f76a7109" (UID: "0ce65374-bf0f-4c93-b907-2c89f76a7109"). InnerVolumeSpecName "kube-api-access-djmwm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:08:58 crc kubenswrapper[5120]: I0316 16:08:58.497983 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-ecee-account-create-update-h24qw" Mar 16 16:08:58 crc kubenswrapper[5120]: I0316 16:08:58.517313 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0ce65374-bf0f-4c93-b907-2c89f76a7109-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:08:58 crc kubenswrapper[5120]: I0316 16:08:58.517347 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-djmwm\" (UniqueName: \"kubernetes.io/projected/0ce65374-bf0f-4c93-b907-2c89f76a7109-kube-api-access-djmwm\") on node \"crc\" DevicePath \"\"" Mar 16 16:08:58 crc kubenswrapper[5120]: I0316 16:08:58.618483 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qhmxx\" (UniqueName: \"kubernetes.io/projected/559241a9-026f-4ede-ac27-e2fbad0e21cf-kube-api-access-qhmxx\") pod \"559241a9-026f-4ede-ac27-e2fbad0e21cf\" (UID: \"559241a9-026f-4ede-ac27-e2fbad0e21cf\") " Mar 16 16:08:58 crc kubenswrapper[5120]: I0316 16:08:58.619029 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/559241a9-026f-4ede-ac27-e2fbad0e21cf-operator-scripts\") pod \"559241a9-026f-4ede-ac27-e2fbad0e21cf\" (UID: \"559241a9-026f-4ede-ac27-e2fbad0e21cf\") " Mar 16 16:08:58 crc kubenswrapper[5120]: I0316 16:08:58.619644 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/559241a9-026f-4ede-ac27-e2fbad0e21cf-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "559241a9-026f-4ede-ac27-e2fbad0e21cf" (UID: "559241a9-026f-4ede-ac27-e2fbad0e21cf"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:08:58 crc kubenswrapper[5120]: I0316 16:08:58.622144 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/559241a9-026f-4ede-ac27-e2fbad0e21cf-kube-api-access-qhmxx" (OuterVolumeSpecName: "kube-api-access-qhmxx") pod "559241a9-026f-4ede-ac27-e2fbad0e21cf" (UID: "559241a9-026f-4ede-ac27-e2fbad0e21cf"). InnerVolumeSpecName "kube-api-access-qhmxx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:08:58 crc kubenswrapper[5120]: I0316 16:08:58.721320 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/559241a9-026f-4ede-ac27-e2fbad0e21cf-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:08:58 crc kubenswrapper[5120]: I0316 16:08:58.721345 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qhmxx\" (UniqueName: \"kubernetes.io/projected/559241a9-026f-4ede-ac27-e2fbad0e21cf-kube-api-access-qhmxx\") on node \"crc\" DevicePath \"\"" Mar 16 16:08:58 crc kubenswrapper[5120]: I0316 16:08:58.896850 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/swift-proxy-7d679bc546-fx2h2" Mar 16 16:08:58 crc kubenswrapper[5120]: I0316 16:08:58.909998 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/swift-proxy-7d679bc546-fx2h2" Mar 16 16:08:59 crc kubenswrapper[5120]: I0316 16:08:59.040917 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-db-create-lx25w" event={"ID":"0ce65374-bf0f-4c93-b907-2c89f76a7109","Type":"ContainerDied","Data":"2209dae76d7dc24073454d606aaabb4751f6c4b4e5895942b6059470e682eb1b"} Mar 16 16:08:59 crc kubenswrapper[5120]: I0316 16:08:59.040955 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2209dae76d7dc24073454d606aaabb4751f6c4b4e5895942b6059470e682eb1b" Mar 16 16:08:59 crc kubenswrapper[5120]: I0316 16:08:59.040919 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-db-create-lx25w" Mar 16 16:08:59 crc kubenswrapper[5120]: I0316 16:08:59.043028 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-ecee-account-create-update-h24qw" event={"ID":"559241a9-026f-4ede-ac27-e2fbad0e21cf","Type":"ContainerDied","Data":"b32f3d94e7b7e52583991e003e2dba88a6a85924e13e16989d6fc43d34fbfddf"} Mar 16 16:08:59 crc kubenswrapper[5120]: I0316 16:08:59.043073 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b32f3d94e7b7e52583991e003e2dba88a6a85924e13e16989d6fc43d34fbfddf" Mar 16 16:08:59 crc kubenswrapper[5120]: I0316 16:08:59.043120 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-ecee-account-create-update-h24qw" Mar 16 16:09:00 crc kubenswrapper[5120]: I0316 16:09:00.063209 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-marketplace/certified-operators-6pnfb" Mar 16 16:09:00 crc kubenswrapper[5120]: I0316 16:09:00.063517 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/certified-operators-6pnfb" Mar 16 16:09:00 crc kubenswrapper[5120]: I0316 16:09:00.113467 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:09:00 crc kubenswrapper[5120]: I0316 16:09:00.113822 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="7e0d7a3d-971e-438a-b4de-702b49c20f0d" containerName="glance-httpd" containerID="cri-o://305602f49b8bc5828166013f91c905447c75c4e1d4f76c99bc2f070df93fd919" gracePeriod=30 Mar 16 16:09:00 crc kubenswrapper[5120]: I0316 16:09:00.114100 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="7e0d7a3d-971e-438a-b4de-702b49c20f0d" containerName="glance-log" containerID="cri-o://4a8771b3412fc9a1671ab83c880c09c103f113f8fb725989a45041e0a4345e69" gracePeriod=30 Mar 16 16:09:00 crc kubenswrapper[5120]: I0316 16:09:00.143436 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/certified-operators-6pnfb" Mar 16 16:09:00 crc kubenswrapper[5120]: I0316 16:09:00.991464 5120 scope.go:117] "RemoveContainer" containerID="a10f652c6f9dd13d1cefdaca4624cc5853fabb476bdc810aa820dd9d740d209d" Mar 16 16:09:01 crc kubenswrapper[5120]: I0316 16:09:01.031611 5120 scope.go:117] "RemoveContainer" containerID="b0b9d5ea808914c8c7613e8d3780917d9f9be56b3aaa7ca8367dfcf4cd686e1e" Mar 16 16:09:01 crc kubenswrapper[5120]: I0316 16:09:01.047529 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-6966b7489-j4l28" Mar 16 16:09:01 crc kubenswrapper[5120]: I0316 16:09:01.059344 5120 scope.go:117] "RemoveContainer" containerID="d270654e145e433239ceb2fac4c35672645df61ff2d8d5f57bea05589e31474e" Mar 16 16:09:01 crc kubenswrapper[5120]: I0316 16:09:01.062484 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7cd1f19e-4f42-46d6-9271-eb1d9fd7c52e","Type":"ContainerStarted","Data":"ad6c6406ebe11ee3ab1df16db560a0fc7f749e4197421facce2c3679d68ed09a"} Mar 16 16:09:01 crc kubenswrapper[5120]: I0316 16:09:01.076671 5120 generic.go:358] "Generic (PLEG): container finished" podID="7e0d7a3d-971e-438a-b4de-702b49c20f0d" containerID="4a8771b3412fc9a1671ab83c880c09c103f113f8fb725989a45041e0a4345e69" exitCode=143 Mar 16 16:09:01 crc kubenswrapper[5120]: I0316 16:09:01.076873 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"7e0d7a3d-971e-438a-b4de-702b49c20f0d","Type":"ContainerDied","Data":"4a8771b3412fc9a1671ab83c880c09c103f113f8fb725989a45041e0a4345e69"} Mar 16 16:09:01 crc kubenswrapper[5120]: I0316 16:09:01.080995 5120 generic.go:358] "Generic (PLEG): container finished" podID="ddb7fdf9-5c27-4d59-b778-ff2a95f45bec" containerID="d4b438f64f506b89949a8c4147ee8c86bc3432e11f87ea5243983b43429bf5cd" exitCode=0 Mar 16 16:09:01 crc kubenswrapper[5120]: I0316 16:09:01.082106 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-6966b7489-j4l28" Mar 16 16:09:01 crc kubenswrapper[5120]: I0316 16:09:01.082495 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-6966b7489-j4l28" event={"ID":"ddb7fdf9-5c27-4d59-b778-ff2a95f45bec","Type":"ContainerDied","Data":"d4b438f64f506b89949a8c4147ee8c86bc3432e11f87ea5243983b43429bf5cd"} Mar 16 16:09:01 crc kubenswrapper[5120]: I0316 16:09:01.082526 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-6966b7489-j4l28" event={"ID":"ddb7fdf9-5c27-4d59-b778-ff2a95f45bec","Type":"ContainerDied","Data":"8067d7545d3917fa688a1cd7169307cda39a94b47967cd15182c16553e39efb2"} Mar 16 16:09:01 crc kubenswrapper[5120]: I0316 16:09:01.082544 5120 scope.go:117] "RemoveContainer" containerID="17477a9134c8df5798f09943b7308bf44123114575842c97afe67f8d53c7c73d" Mar 16 16:09:01 crc kubenswrapper[5120]: I0316 16:09:01.145284 5120 scope.go:117] "RemoveContainer" containerID="05692c439c74f95df50502628c3694f08cb930b68321ec30298196ce2dd57c8c" Mar 16 16:09:01 crc kubenswrapper[5120]: I0316 16:09:01.159233 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/certified-operators-6pnfb" Mar 16 16:09:01 crc kubenswrapper[5120]: I0316 16:09:01.171343 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/ddb7fdf9-5c27-4d59-b778-ff2a95f45bec-httpd-config\") pod \"ddb7fdf9-5c27-4d59-b778-ff2a95f45bec\" (UID: \"ddb7fdf9-5c27-4d59-b778-ff2a95f45bec\") " Mar 16 16:09:01 crc kubenswrapper[5120]: I0316 16:09:01.171483 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/ddb7fdf9-5c27-4d59-b778-ff2a95f45bec-ovndb-tls-certs\") pod \"ddb7fdf9-5c27-4d59-b778-ff2a95f45bec\" (UID: \"ddb7fdf9-5c27-4d59-b778-ff2a95f45bec\") " Mar 16 16:09:01 crc kubenswrapper[5120]: I0316 16:09:01.171728 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ddb7fdf9-5c27-4d59-b778-ff2a95f45bec-config\") pod \"ddb7fdf9-5c27-4d59-b778-ff2a95f45bec\" (UID: \"ddb7fdf9-5c27-4d59-b778-ff2a95f45bec\") " Mar 16 16:09:01 crc kubenswrapper[5120]: I0316 16:09:01.171774 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g9ggf\" (UniqueName: \"kubernetes.io/projected/ddb7fdf9-5c27-4d59-b778-ff2a95f45bec-kube-api-access-g9ggf\") pod \"ddb7fdf9-5c27-4d59-b778-ff2a95f45bec\" (UID: \"ddb7fdf9-5c27-4d59-b778-ff2a95f45bec\") " Mar 16 16:09:01 crc kubenswrapper[5120]: I0316 16:09:01.171807 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ddb7fdf9-5c27-4d59-b778-ff2a95f45bec-combined-ca-bundle\") pod \"ddb7fdf9-5c27-4d59-b778-ff2a95f45bec\" (UID: \"ddb7fdf9-5c27-4d59-b778-ff2a95f45bec\") " Mar 16 16:09:01 crc kubenswrapper[5120]: I0316 16:09:01.178811 5120 scope.go:117] "RemoveContainer" containerID="d4b438f64f506b89949a8c4147ee8c86bc3432e11f87ea5243983b43429bf5cd" Mar 16 16:09:01 crc kubenswrapper[5120]: I0316 16:09:01.179658 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ddb7fdf9-5c27-4d59-b778-ff2a95f45bec-kube-api-access-g9ggf" (OuterVolumeSpecName: "kube-api-access-g9ggf") pod "ddb7fdf9-5c27-4d59-b778-ff2a95f45bec" (UID: "ddb7fdf9-5c27-4d59-b778-ff2a95f45bec"). InnerVolumeSpecName "kube-api-access-g9ggf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:09:01 crc kubenswrapper[5120]: I0316 16:09:01.181134 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ddb7fdf9-5c27-4d59-b778-ff2a95f45bec-httpd-config" (OuterVolumeSpecName: "httpd-config") pod "ddb7fdf9-5c27-4d59-b778-ff2a95f45bec" (UID: "ddb7fdf9-5c27-4d59-b778-ff2a95f45bec"). InnerVolumeSpecName "httpd-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:09:01 crc kubenswrapper[5120]: I0316 16:09:01.209324 5120 scope.go:117] "RemoveContainer" containerID="d60742166250557579b355a079a259e60dc389a623241387971ff86264ec58f3" Mar 16 16:09:01 crc kubenswrapper[5120]: I0316 16:09:01.222192 5120 scope.go:117] "RemoveContainer" containerID="17477a9134c8df5798f09943b7308bf44123114575842c97afe67f8d53c7c73d" Mar 16 16:09:01 crc kubenswrapper[5120]: I0316 16:09:01.222419 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ddb7fdf9-5c27-4d59-b778-ff2a95f45bec-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ddb7fdf9-5c27-4d59-b778-ff2a95f45bec" (UID: "ddb7fdf9-5c27-4d59-b778-ff2a95f45bec"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:09:01 crc kubenswrapper[5120]: E0316 16:09:01.223679 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"17477a9134c8df5798f09943b7308bf44123114575842c97afe67f8d53c7c73d\": container with ID starting with 17477a9134c8df5798f09943b7308bf44123114575842c97afe67f8d53c7c73d not found: ID does not exist" containerID="17477a9134c8df5798f09943b7308bf44123114575842c97afe67f8d53c7c73d" Mar 16 16:09:01 crc kubenswrapper[5120]: I0316 16:09:01.223827 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17477a9134c8df5798f09943b7308bf44123114575842c97afe67f8d53c7c73d"} err="failed to get container status \"17477a9134c8df5798f09943b7308bf44123114575842c97afe67f8d53c7c73d\": rpc error: code = NotFound desc = could not find container \"17477a9134c8df5798f09943b7308bf44123114575842c97afe67f8d53c7c73d\": container with ID starting with 17477a9134c8df5798f09943b7308bf44123114575842c97afe67f8d53c7c73d not found: ID does not exist" Mar 16 16:09:01 crc kubenswrapper[5120]: I0316 16:09:01.223936 5120 scope.go:117] "RemoveContainer" containerID="d4b438f64f506b89949a8c4147ee8c86bc3432e11f87ea5243983b43429bf5cd" Mar 16 16:09:01 crc kubenswrapper[5120]: E0316 16:09:01.224882 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d4b438f64f506b89949a8c4147ee8c86bc3432e11f87ea5243983b43429bf5cd\": container with ID starting with d4b438f64f506b89949a8c4147ee8c86bc3432e11f87ea5243983b43429bf5cd not found: ID does not exist" containerID="d4b438f64f506b89949a8c4147ee8c86bc3432e11f87ea5243983b43429bf5cd" Mar 16 16:09:01 crc kubenswrapper[5120]: I0316 16:09:01.224918 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4b438f64f506b89949a8c4147ee8c86bc3432e11f87ea5243983b43429bf5cd"} err="failed to get container status \"d4b438f64f506b89949a8c4147ee8c86bc3432e11f87ea5243983b43429bf5cd\": rpc error: code = NotFound desc = could not find container \"d4b438f64f506b89949a8c4147ee8c86bc3432e11f87ea5243983b43429bf5cd\": container with ID starting with d4b438f64f506b89949a8c4147ee8c86bc3432e11f87ea5243983b43429bf5cd not found: ID does not exist" Mar 16 16:09:01 crc kubenswrapper[5120]: I0316 16:09:01.236968 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ddb7fdf9-5c27-4d59-b778-ff2a95f45bec-config" (OuterVolumeSpecName: "config") pod "ddb7fdf9-5c27-4d59-b778-ff2a95f45bec" (UID: "ddb7fdf9-5c27-4d59-b778-ff2a95f45bec"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:09:01 crc kubenswrapper[5120]: I0316 16:09:01.241174 5120 scope.go:117] "RemoveContainer" containerID="fcac69ec6ee9fe77546a1a5134f2d123d3a1a9780f58876c2e6686c4e99f71f8" Mar 16 16:09:01 crc kubenswrapper[5120]: I0316 16:09:01.254923 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ddb7fdf9-5c27-4d59-b778-ff2a95f45bec-ovndb-tls-certs" (OuterVolumeSpecName: "ovndb-tls-certs") pod "ddb7fdf9-5c27-4d59-b778-ff2a95f45bec" (UID: "ddb7fdf9-5c27-4d59-b778-ff2a95f45bec"). InnerVolumeSpecName "ovndb-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:09:01 crc kubenswrapper[5120]: I0316 16:09:01.275807 5120 reconciler_common.go:299] "Volume detached for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/ddb7fdf9-5c27-4d59-b778-ff2a95f45bec-ovndb-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:09:01 crc kubenswrapper[5120]: I0316 16:09:01.275840 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/ddb7fdf9-5c27-4d59-b778-ff2a95f45bec-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:09:01 crc kubenswrapper[5120]: I0316 16:09:01.275854 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g9ggf\" (UniqueName: \"kubernetes.io/projected/ddb7fdf9-5c27-4d59-b778-ff2a95f45bec-kube-api-access-g9ggf\") on node \"crc\" DevicePath \"\"" Mar 16 16:09:01 crc kubenswrapper[5120]: I0316 16:09:01.275866 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ddb7fdf9-5c27-4d59-b778-ff2a95f45bec-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:09:01 crc kubenswrapper[5120]: I0316 16:09:01.275875 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/ddb7fdf9-5c27-4d59-b778-ff2a95f45bec-httpd-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:09:01 crc kubenswrapper[5120]: I0316 16:09:01.340799 5120 scope.go:117] "RemoveContainer" containerID="d7e5e30c61b09a69c95923f05ac16a77beb58bdaed6db16f9297e00dc08129ce" Mar 16 16:09:01 crc kubenswrapper[5120]: I0316 16:09:01.379539 5120 scope.go:117] "RemoveContainer" containerID="afad04760bdd0af215c87e7b8b243a24c1a39f569edf6c17dc353cb96619dc0c" Mar 16 16:09:01 crc kubenswrapper[5120]: I0316 16:09:01.404207 5120 scope.go:117] "RemoveContainer" containerID="117cb0ae762127f90136bce221457081f536a88b4829b05dca9eced2b9c97a5a" Mar 16 16:09:01 crc kubenswrapper[5120]: I0316 16:09:01.418137 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-6966b7489-j4l28"] Mar 16 16:09:01 crc kubenswrapper[5120]: I0316 16:09:01.428050 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-6966b7489-j4l28"] Mar 16 16:09:01 crc kubenswrapper[5120]: I0316 16:09:01.456252 5120 scope.go:117] "RemoveContainer" containerID="1baba62653ca28a6e2a3f3c314e39af94092f9fe8166b8c9fe0e71e5269c26bc" Mar 16 16:09:01 crc kubenswrapper[5120]: I0316 16:09:01.478412 5120 scope.go:117] "RemoveContainer" containerID="4a7007fb9f175a2ab2bee26800be3637c8503787cc6533808c06e3b06faaddad" Mar 16 16:09:02 crc kubenswrapper[5120]: I0316 16:09:02.675348 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ddb7fdf9-5c27-4d59-b778-ff2a95f45bec" path="/var/lib/kubelet/pods/ddb7fdf9-5c27-4d59-b778-ff2a95f45bec/volumes" Mar 16 16:09:02 crc kubenswrapper[5120]: I0316 16:09:02.682145 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-marketplace-lrwk8" Mar 16 16:09:02 crc kubenswrapper[5120]: I0316 16:09:02.682188 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-marketplace/redhat-marketplace-lrwk8" Mar 16 16:09:02 crc kubenswrapper[5120]: I0316 16:09:02.727057 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-marketplace-lrwk8" Mar 16 16:09:03 crc kubenswrapper[5120]: I0316 16:09:03.103370 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7cd1f19e-4f42-46d6-9271-eb1d9fd7c52e","Type":"ContainerStarted","Data":"7ea9c30f402a1ce7827153b958f8c99c886c7edd477c6c93bfd0ec284eebf54a"} Mar 16 16:09:03 crc kubenswrapper[5120]: I0316 16:09:03.103589 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:09:03 crc kubenswrapper[5120]: I0316 16:09:03.103481 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="7cd1f19e-4f42-46d6-9271-eb1d9fd7c52e" containerName="sg-core" containerID="cri-o://ad6c6406ebe11ee3ab1df16db560a0fc7f749e4197421facce2c3679d68ed09a" gracePeriod=30 Mar 16 16:09:03 crc kubenswrapper[5120]: I0316 16:09:03.103435 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="7cd1f19e-4f42-46d6-9271-eb1d9fd7c52e" containerName="ceilometer-central-agent" containerID="cri-o://9f496d6fbdcfbd6fc07376d0ab068a3fec1af56cff769d29812ad1fec9e4e9f2" gracePeriod=30 Mar 16 16:09:03 crc kubenswrapper[5120]: I0316 16:09:03.103536 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="7cd1f19e-4f42-46d6-9271-eb1d9fd7c52e" containerName="proxy-httpd" containerID="cri-o://7ea9c30f402a1ce7827153b958f8c99c886c7edd477c6c93bfd0ec284eebf54a" gracePeriod=30 Mar 16 16:09:03 crc kubenswrapper[5120]: I0316 16:09:03.103551 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="7cd1f19e-4f42-46d6-9271-eb1d9fd7c52e" containerName="ceilometer-notification-agent" containerID="cri-o://f1311a2bfb13a7c3b653ead3df7480fc96b719fee2c791d0851c854b4aba4915" gracePeriod=30 Mar 16 16:09:03 crc kubenswrapper[5120]: I0316 16:09:03.134156 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.6428564789999998 podStartE2EDuration="10.134137083s" podCreationTimestamp="2026-03-16 16:08:53 +0000 UTC" firstStartedPulling="2026-03-16 16:08:55.038002915 +0000 UTC m=+2237.191934572" lastFinishedPulling="2026-03-16 16:09:02.529283519 +0000 UTC m=+2244.683215176" observedRunningTime="2026-03-16 16:09:03.126284938 +0000 UTC m=+2245.280216605" watchObservedRunningTime="2026-03-16 16:09:03.134137083 +0000 UTC m=+2245.288068740" Mar 16 16:09:03 crc kubenswrapper[5120]: I0316 16:09:03.179656 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:09:03 crc kubenswrapper[5120]: I0316 16:09:03.180108 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="c5593ae2-7a56-4d09-8f88-a54b43c2be0c" containerName="glance-log" containerID="cri-o://047eec0013cada9bc1768aac8af82d95870075ec52f3cdcb2d119a77a1b49356" gracePeriod=30 Mar 16 16:09:03 crc kubenswrapper[5120]: I0316 16:09:03.180632 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="c5593ae2-7a56-4d09-8f88-a54b43c2be0c" containerName="glance-httpd" containerID="cri-o://16cfa2634d38d4f0aac174cea17bf8487cb7107a948e6c49443a719a68fd92b4" gracePeriod=30 Mar 16 16:09:03 crc kubenswrapper[5120]: I0316 16:09:03.193883 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-marketplace-lrwk8" Mar 16 16:09:03 crc kubenswrapper[5120]: I0316 16:09:03.920866 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:09:03 crc kubenswrapper[5120]: I0316 16:09:03.935532 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7e0d7a3d-971e-438a-b4de-702b49c20f0d-scripts\") pod \"7e0d7a3d-971e-438a-b4de-702b49c20f0d\" (UID: \"7e0d7a3d-971e-438a-b4de-702b49c20f0d\") " Mar 16 16:09:03 crc kubenswrapper[5120]: I0316 16:09:03.935667 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7e0d7a3d-971e-438a-b4de-702b49c20f0d-logs\") pod \"7e0d7a3d-971e-438a-b4de-702b49c20f0d\" (UID: \"7e0d7a3d-971e-438a-b4de-702b49c20f0d\") " Mar 16 16:09:03 crc kubenswrapper[5120]: I0316 16:09:03.935848 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage15-crc\") pod \"7e0d7a3d-971e-438a-b4de-702b49c20f0d\" (UID: \"7e0d7a3d-971e-438a-b4de-702b49c20f0d\") " Mar 16 16:09:03 crc kubenswrapper[5120]: I0316 16:09:03.936002 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7e0d7a3d-971e-438a-b4de-702b49c20f0d-config-data\") pod \"7e0d7a3d-971e-438a-b4de-702b49c20f0d\" (UID: \"7e0d7a3d-971e-438a-b4de-702b49c20f0d\") " Mar 16 16:09:03 crc kubenswrapper[5120]: I0316 16:09:03.936064 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2z5jp\" (UniqueName: \"kubernetes.io/projected/7e0d7a3d-971e-438a-b4de-702b49c20f0d-kube-api-access-2z5jp\") pod \"7e0d7a3d-971e-438a-b4de-702b49c20f0d\" (UID: \"7e0d7a3d-971e-438a-b4de-702b49c20f0d\") " Mar 16 16:09:03 crc kubenswrapper[5120]: I0316 16:09:03.936174 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7e0d7a3d-971e-438a-b4de-702b49c20f0d-combined-ca-bundle\") pod \"7e0d7a3d-971e-438a-b4de-702b49c20f0d\" (UID: \"7e0d7a3d-971e-438a-b4de-702b49c20f0d\") " Mar 16 16:09:03 crc kubenswrapper[5120]: I0316 16:09:03.936271 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/7e0d7a3d-971e-438a-b4de-702b49c20f0d-httpd-run\") pod \"7e0d7a3d-971e-438a-b4de-702b49c20f0d\" (UID: \"7e0d7a3d-971e-438a-b4de-702b49c20f0d\") " Mar 16 16:09:03 crc kubenswrapper[5120]: I0316 16:09:03.936359 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/7e0d7a3d-971e-438a-b4de-702b49c20f0d-public-tls-certs\") pod \"7e0d7a3d-971e-438a-b4de-702b49c20f0d\" (UID: \"7e0d7a3d-971e-438a-b4de-702b49c20f0d\") " Mar 16 16:09:03 crc kubenswrapper[5120]: I0316 16:09:03.938404 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e0d7a3d-971e-438a-b4de-702b49c20f0d-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "7e0d7a3d-971e-438a-b4de-702b49c20f0d" (UID: "7e0d7a3d-971e-438a-b4de-702b49c20f0d"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:09:03 crc kubenswrapper[5120]: I0316 16:09:03.938946 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e0d7a3d-971e-438a-b4de-702b49c20f0d-logs" (OuterVolumeSpecName: "logs") pod "7e0d7a3d-971e-438a-b4de-702b49c20f0d" (UID: "7e0d7a3d-971e-438a-b4de-702b49c20f0d"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:09:03 crc kubenswrapper[5120]: I0316 16:09:03.944268 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage15-crc" (OuterVolumeSpecName: "glance") pod "7e0d7a3d-971e-438a-b4de-702b49c20f0d" (UID: "7e0d7a3d-971e-438a-b4de-702b49c20f0d"). InnerVolumeSpecName "local-storage15-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:09:03 crc kubenswrapper[5120]: I0316 16:09:03.944867 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e0d7a3d-971e-438a-b4de-702b49c20f0d-kube-api-access-2z5jp" (OuterVolumeSpecName: "kube-api-access-2z5jp") pod "7e0d7a3d-971e-438a-b4de-702b49c20f0d" (UID: "7e0d7a3d-971e-438a-b4de-702b49c20f0d"). InnerVolumeSpecName "kube-api-access-2z5jp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:09:03 crc kubenswrapper[5120]: I0316 16:09:03.949862 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e0d7a3d-971e-438a-b4de-702b49c20f0d-scripts" (OuterVolumeSpecName: "scripts") pod "7e0d7a3d-971e-438a-b4de-702b49c20f0d" (UID: "7e0d7a3d-971e-438a-b4de-702b49c20f0d"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.040025 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage15-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage15-crc\") on node \"crc\" " Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.040055 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2z5jp\" (UniqueName: \"kubernetes.io/projected/7e0d7a3d-971e-438a-b4de-702b49c20f0d-kube-api-access-2z5jp\") on node \"crc\" DevicePath \"\"" Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.040072 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/7e0d7a3d-971e-438a-b4de-702b49c20f0d-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.040083 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7e0d7a3d-971e-438a-b4de-702b49c20f0d-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.040091 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7e0d7a3d-971e-438a-b4de-702b49c20f0d-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.056324 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e0d7a3d-971e-438a-b4de-702b49c20f0d-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "7e0d7a3d-971e-438a-b4de-702b49c20f0d" (UID: "7e0d7a3d-971e-438a-b4de-702b49c20f0d"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.066068 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e0d7a3d-971e-438a-b4de-702b49c20f0d-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "7e0d7a3d-971e-438a-b4de-702b49c20f0d" (UID: "7e0d7a3d-971e-438a-b4de-702b49c20f0d"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.076625 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage15-crc" (UniqueName: "kubernetes.io/local-volume/local-storage15-crc") on node "crc" Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.092977 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e0d7a3d-971e-438a-b4de-702b49c20f0d-config-data" (OuterVolumeSpecName: "config-data") pod "7e0d7a3d-971e-438a-b4de-702b49c20f0d" (UID: "7e0d7a3d-971e-438a-b4de-702b49c20f0d"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.150893 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage15-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage15-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.150927 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7e0d7a3d-971e-438a-b4de-702b49c20f0d-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.150940 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7e0d7a3d-971e-438a-b4de-702b49c20f0d-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.150950 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/7e0d7a3d-971e-438a-b4de-702b49c20f0d-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.158676 5120 generic.go:358] "Generic (PLEG): container finished" podID="7e0d7a3d-971e-438a-b4de-702b49c20f0d" containerID="305602f49b8bc5828166013f91c905447c75c4e1d4f76c99bc2f070df93fd919" exitCode=0 Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.158726 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"7e0d7a3d-971e-438a-b4de-702b49c20f0d","Type":"ContainerDied","Data":"305602f49b8bc5828166013f91c905447c75c4e1d4f76c99bc2f070df93fd919"} Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.158810 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"7e0d7a3d-971e-438a-b4de-702b49c20f0d","Type":"ContainerDied","Data":"62635aed2fe142cf795473dae5c77f219fd51260c35ff8e6eb3056c6073497d4"} Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.158816 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.158831 5120 scope.go:117] "RemoveContainer" containerID="305602f49b8bc5828166013f91c905447c75c4e1d4f76c99bc2f070df93fd919" Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.171170 5120 generic.go:358] "Generic (PLEG): container finished" podID="7cd1f19e-4f42-46d6-9271-eb1d9fd7c52e" containerID="7ea9c30f402a1ce7827153b958f8c99c886c7edd477c6c93bfd0ec284eebf54a" exitCode=0 Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.171190 5120 generic.go:358] "Generic (PLEG): container finished" podID="7cd1f19e-4f42-46d6-9271-eb1d9fd7c52e" containerID="ad6c6406ebe11ee3ab1df16db560a0fc7f749e4197421facce2c3679d68ed09a" exitCode=2 Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.171196 5120 generic.go:358] "Generic (PLEG): container finished" podID="7cd1f19e-4f42-46d6-9271-eb1d9fd7c52e" containerID="f1311a2bfb13a7c3b653ead3df7480fc96b719fee2c791d0851c854b4aba4915" exitCode=0 Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.171201 5120 generic.go:358] "Generic (PLEG): container finished" podID="7cd1f19e-4f42-46d6-9271-eb1d9fd7c52e" containerID="9f496d6fbdcfbd6fc07376d0ab068a3fec1af56cff769d29812ad1fec9e4e9f2" exitCode=0 Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.171262 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7cd1f19e-4f42-46d6-9271-eb1d9fd7c52e","Type":"ContainerDied","Data":"7ea9c30f402a1ce7827153b958f8c99c886c7edd477c6c93bfd0ec284eebf54a"} Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.173713 5120 generic.go:358] "Generic (PLEG): container finished" podID="c5593ae2-7a56-4d09-8f88-a54b43c2be0c" containerID="047eec0013cada9bc1768aac8af82d95870075ec52f3cdcb2d119a77a1b49356" exitCode=143 Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.190925 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7cd1f19e-4f42-46d6-9271-eb1d9fd7c52e","Type":"ContainerDied","Data":"ad6c6406ebe11ee3ab1df16db560a0fc7f749e4197421facce2c3679d68ed09a"} Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.190959 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7cd1f19e-4f42-46d6-9271-eb1d9fd7c52e","Type":"ContainerDied","Data":"f1311a2bfb13a7c3b653ead3df7480fc96b719fee2c791d0851c854b4aba4915"} Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.190973 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7cd1f19e-4f42-46d6-9271-eb1d9fd7c52e","Type":"ContainerDied","Data":"9f496d6fbdcfbd6fc07376d0ab068a3fec1af56cff769d29812ad1fec9e4e9f2"} Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.190984 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"c5593ae2-7a56-4d09-8f88-a54b43c2be0c","Type":"ContainerDied","Data":"047eec0013cada9bc1768aac8af82d95870075ec52f3cdcb2d119a77a1b49356"} Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.205876 5120 scope.go:117] "RemoveContainer" containerID="4a8771b3412fc9a1671ab83c880c09c103f113f8fb725989a45041e0a4345e69" Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.213362 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.224814 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.235450 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.236616 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2f18d16-d2de-496a-b894-947a5c23f857" containerName="mariadb-database-create" Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.236637 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2f18d16-d2de-496a-b894-947a5c23f857" containerName="mariadb-database-create" Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.236648 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ddb7fdf9-5c27-4d59-b778-ff2a95f45bec" containerName="neutron-api" Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.236654 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ddb7fdf9-5c27-4d59-b778-ff2a95f45bec" containerName="neutron-api" Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.236679 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e0d7a3d-971e-438a-b4de-702b49c20f0d" containerName="glance-log" Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.236685 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e0d7a3d-971e-438a-b4de-702b49c20f0d" containerName="glance-log" Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.236701 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ce65374-bf0f-4c93-b907-2c89f76a7109" containerName="mariadb-database-create" Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.236706 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ce65374-bf0f-4c93-b907-2c89f76a7109" containerName="mariadb-database-create" Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.236717 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e0d7a3d-971e-438a-b4de-702b49c20f0d" containerName="glance-httpd" Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.236725 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e0d7a3d-971e-438a-b4de-702b49c20f0d" containerName="glance-httpd" Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.236745 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="807be2e6-5651-4f26-a39a-4a11e91d9472" containerName="mariadb-account-create-update" Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.236753 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="807be2e6-5651-4f26-a39a-4a11e91d9472" containerName="mariadb-account-create-update" Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.236781 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ddb7fdf9-5c27-4d59-b778-ff2a95f45bec" containerName="neutron-httpd" Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.236787 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ddb7fdf9-5c27-4d59-b778-ff2a95f45bec" containerName="neutron-httpd" Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.236813 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="559241a9-026f-4ede-ac27-e2fbad0e21cf" containerName="mariadb-account-create-update" Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.236819 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="559241a9-026f-4ede-ac27-e2fbad0e21cf" containerName="mariadb-account-create-update" Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.236827 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="572b636c-c02b-40bc-9255-913cdba7b65d" containerName="mariadb-database-create" Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.236833 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="572b636c-c02b-40bc-9255-913cdba7b65d" containerName="mariadb-database-create" Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.236848 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d1f257e-85ac-4cb3-9991-645d525d9dee" containerName="mariadb-account-create-update" Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.236854 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d1f257e-85ac-4cb3-9991-645d525d9dee" containerName="mariadb-account-create-update" Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.236999 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ddb7fdf9-5c27-4d59-b778-ff2a95f45bec" containerName="neutron-httpd" Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.237015 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c2f18d16-d2de-496a-b894-947a5c23f857" containerName="mariadb-database-create" Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.237028 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="572b636c-c02b-40bc-9255-913cdba7b65d" containerName="mariadb-database-create" Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.237039 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7e0d7a3d-971e-438a-b4de-702b49c20f0d" containerName="glance-httpd" Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.237047 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="2d1f257e-85ac-4cb3-9991-645d525d9dee" containerName="mariadb-account-create-update" Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.237057 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="0ce65374-bf0f-4c93-b907-2c89f76a7109" containerName="mariadb-database-create" Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.237065 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="807be2e6-5651-4f26-a39a-4a11e91d9472" containerName="mariadb-account-create-update" Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.237074 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7e0d7a3d-971e-438a-b4de-702b49c20f0d" containerName="glance-log" Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.237086 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ddb7fdf9-5c27-4d59-b778-ff2a95f45bec" containerName="neutron-api" Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.237097 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="559241a9-026f-4ede-ac27-e2fbad0e21cf" containerName="mariadb-account-create-update" Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.238779 5120 scope.go:117] "RemoveContainer" containerID="305602f49b8bc5828166013f91c905447c75c4e1d4f76c99bc2f070df93fd919" Mar 16 16:09:04 crc kubenswrapper[5120]: E0316 16:09:04.241167 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"305602f49b8bc5828166013f91c905447c75c4e1d4f76c99bc2f070df93fd919\": container with ID starting with 305602f49b8bc5828166013f91c905447c75c4e1d4f76c99bc2f070df93fd919 not found: ID does not exist" containerID="305602f49b8bc5828166013f91c905447c75c4e1d4f76c99bc2f070df93fd919" Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.241209 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"305602f49b8bc5828166013f91c905447c75c4e1d4f76c99bc2f070df93fd919"} err="failed to get container status \"305602f49b8bc5828166013f91c905447c75c4e1d4f76c99bc2f070df93fd919\": rpc error: code = NotFound desc = could not find container \"305602f49b8bc5828166013f91c905447c75c4e1d4f76c99bc2f070df93fd919\": container with ID starting with 305602f49b8bc5828166013f91c905447c75c4e1d4f76c99bc2f070df93fd919 not found: ID does not exist" Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.241229 5120 scope.go:117] "RemoveContainer" containerID="4a8771b3412fc9a1671ab83c880c09c103f113f8fb725989a45041e0a4345e69" Mar 16 16:09:04 crc kubenswrapper[5120]: E0316 16:09:04.241641 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4a8771b3412fc9a1671ab83c880c09c103f113f8fb725989a45041e0a4345e69\": container with ID starting with 4a8771b3412fc9a1671ab83c880c09c103f113f8fb725989a45041e0a4345e69 not found: ID does not exist" containerID="4a8771b3412fc9a1671ab83c880c09c103f113f8fb725989a45041e0a4345e69" Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.241662 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a8771b3412fc9a1671ab83c880c09c103f113f8fb725989a45041e0a4345e69"} err="failed to get container status \"4a8771b3412fc9a1671ab83c880c09c103f113f8fb725989a45041e0a4345e69\": rpc error: code = NotFound desc = could not find container \"4a8771b3412fc9a1671ab83c880c09c103f113f8fb725989a45041e0a4345e69\": container with ID starting with 4a8771b3412fc9a1671ab83c880c09c103f113f8fb725989a45041e0a4345e69 not found: ID does not exist" Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.248799 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.248955 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.251983 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-external-config-data\"" Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.252216 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-public-svc\"" Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.336402 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-marketplace-lrwk8"] Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.354149 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/70cb8e52-8e41-40dd-9988-d9aef87fadd6-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"70cb8e52-8e41-40dd-9988-d9aef87fadd6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.354298 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage15-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage15-crc\") pod \"glance-default-external-api-0\" (UID: \"70cb8e52-8e41-40dd-9988-d9aef87fadd6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.354501 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/70cb8e52-8e41-40dd-9988-d9aef87fadd6-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"70cb8e52-8e41-40dd-9988-d9aef87fadd6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.354645 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/70cb8e52-8e41-40dd-9988-d9aef87fadd6-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"70cb8e52-8e41-40dd-9988-d9aef87fadd6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.354703 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/70cb8e52-8e41-40dd-9988-d9aef87fadd6-config-data\") pod \"glance-default-external-api-0\" (UID: \"70cb8e52-8e41-40dd-9988-d9aef87fadd6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.355124 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2nwkp\" (UniqueName: \"kubernetes.io/projected/70cb8e52-8e41-40dd-9988-d9aef87fadd6-kube-api-access-2nwkp\") pod \"glance-default-external-api-0\" (UID: \"70cb8e52-8e41-40dd-9988-d9aef87fadd6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.355151 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/70cb8e52-8e41-40dd-9988-d9aef87fadd6-logs\") pod \"glance-default-external-api-0\" (UID: \"70cb8e52-8e41-40dd-9988-d9aef87fadd6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.355223 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/70cb8e52-8e41-40dd-9988-d9aef87fadd6-scripts\") pod \"glance-default-external-api-0\" (UID: \"70cb8e52-8e41-40dd-9988-d9aef87fadd6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.358829 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.455966 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p8m7l\" (UniqueName: \"kubernetes.io/projected/7cd1f19e-4f42-46d6-9271-eb1d9fd7c52e-kube-api-access-p8m7l\") pod \"7cd1f19e-4f42-46d6-9271-eb1d9fd7c52e\" (UID: \"7cd1f19e-4f42-46d6-9271-eb1d9fd7c52e\") " Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.456251 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7cd1f19e-4f42-46d6-9271-eb1d9fd7c52e-scripts\") pod \"7cd1f19e-4f42-46d6-9271-eb1d9fd7c52e\" (UID: \"7cd1f19e-4f42-46d6-9271-eb1d9fd7c52e\") " Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.456387 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/7cd1f19e-4f42-46d6-9271-eb1d9fd7c52e-sg-core-conf-yaml\") pod \"7cd1f19e-4f42-46d6-9271-eb1d9fd7c52e\" (UID: \"7cd1f19e-4f42-46d6-9271-eb1d9fd7c52e\") " Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.456552 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7cd1f19e-4f42-46d6-9271-eb1d9fd7c52e-log-httpd\") pod \"7cd1f19e-4f42-46d6-9271-eb1d9fd7c52e\" (UID: \"7cd1f19e-4f42-46d6-9271-eb1d9fd7c52e\") " Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.456649 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7cd1f19e-4f42-46d6-9271-eb1d9fd7c52e-run-httpd\") pod \"7cd1f19e-4f42-46d6-9271-eb1d9fd7c52e\" (UID: \"7cd1f19e-4f42-46d6-9271-eb1d9fd7c52e\") " Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.456703 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7cd1f19e-4f42-46d6-9271-eb1d9fd7c52e-combined-ca-bundle\") pod \"7cd1f19e-4f42-46d6-9271-eb1d9fd7c52e\" (UID: \"7cd1f19e-4f42-46d6-9271-eb1d9fd7c52e\") " Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.456807 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7cd1f19e-4f42-46d6-9271-eb1d9fd7c52e-config-data\") pod \"7cd1f19e-4f42-46d6-9271-eb1d9fd7c52e\" (UID: \"7cd1f19e-4f42-46d6-9271-eb1d9fd7c52e\") " Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.456951 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/70cb8e52-8e41-40dd-9988-d9aef87fadd6-scripts\") pod \"glance-default-external-api-0\" (UID: \"70cb8e52-8e41-40dd-9988-d9aef87fadd6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.457034 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/70cb8e52-8e41-40dd-9988-d9aef87fadd6-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"70cb8e52-8e41-40dd-9988-d9aef87fadd6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.457272 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage15-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage15-crc\") pod \"glance-default-external-api-0\" (UID: \"70cb8e52-8e41-40dd-9988-d9aef87fadd6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.457024 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7cd1f19e-4f42-46d6-9271-eb1d9fd7c52e-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "7cd1f19e-4f42-46d6-9271-eb1d9fd7c52e" (UID: "7cd1f19e-4f42-46d6-9271-eb1d9fd7c52e"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.457481 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage15-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage15-crc\") pod \"glance-default-external-api-0\" (UID: \"70cb8e52-8e41-40dd-9988-d9aef87fadd6\") device mount path \"/mnt/openstack/pv15\"" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.457536 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/70cb8e52-8e41-40dd-9988-d9aef87fadd6-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"70cb8e52-8e41-40dd-9988-d9aef87fadd6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.457668 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/70cb8e52-8e41-40dd-9988-d9aef87fadd6-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"70cb8e52-8e41-40dd-9988-d9aef87fadd6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.457723 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/70cb8e52-8e41-40dd-9988-d9aef87fadd6-config-data\") pod \"glance-default-external-api-0\" (UID: \"70cb8e52-8e41-40dd-9988-d9aef87fadd6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.457814 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2nwkp\" (UniqueName: \"kubernetes.io/projected/70cb8e52-8e41-40dd-9988-d9aef87fadd6-kube-api-access-2nwkp\") pod \"glance-default-external-api-0\" (UID: \"70cb8e52-8e41-40dd-9988-d9aef87fadd6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.457839 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/70cb8e52-8e41-40dd-9988-d9aef87fadd6-logs\") pod \"glance-default-external-api-0\" (UID: \"70cb8e52-8e41-40dd-9988-d9aef87fadd6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.457931 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7cd1f19e-4f42-46d6-9271-eb1d9fd7c52e-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.458252 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/70cb8e52-8e41-40dd-9988-d9aef87fadd6-logs\") pod \"glance-default-external-api-0\" (UID: \"70cb8e52-8e41-40dd-9988-d9aef87fadd6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.457158 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7cd1f19e-4f42-46d6-9271-eb1d9fd7c52e-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "7cd1f19e-4f42-46d6-9271-eb1d9fd7c52e" (UID: "7cd1f19e-4f42-46d6-9271-eb1d9fd7c52e"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.458515 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/70cb8e52-8e41-40dd-9988-d9aef87fadd6-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"70cb8e52-8e41-40dd-9988-d9aef87fadd6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.464698 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/70cb8e52-8e41-40dd-9988-d9aef87fadd6-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"70cb8e52-8e41-40dd-9988-d9aef87fadd6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.464976 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/70cb8e52-8e41-40dd-9988-d9aef87fadd6-config-data\") pod \"glance-default-external-api-0\" (UID: \"70cb8e52-8e41-40dd-9988-d9aef87fadd6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.465989 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7cd1f19e-4f42-46d6-9271-eb1d9fd7c52e-kube-api-access-p8m7l" (OuterVolumeSpecName: "kube-api-access-p8m7l") pod "7cd1f19e-4f42-46d6-9271-eb1d9fd7c52e" (UID: "7cd1f19e-4f42-46d6-9271-eb1d9fd7c52e"). InnerVolumeSpecName "kube-api-access-p8m7l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.467087 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/70cb8e52-8e41-40dd-9988-d9aef87fadd6-scripts\") pod \"glance-default-external-api-0\" (UID: \"70cb8e52-8e41-40dd-9988-d9aef87fadd6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.472421 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7cd1f19e-4f42-46d6-9271-eb1d9fd7c52e-scripts" (OuterVolumeSpecName: "scripts") pod "7cd1f19e-4f42-46d6-9271-eb1d9fd7c52e" (UID: "7cd1f19e-4f42-46d6-9271-eb1d9fd7c52e"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.474722 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/70cb8e52-8e41-40dd-9988-d9aef87fadd6-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"70cb8e52-8e41-40dd-9988-d9aef87fadd6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.478691 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2nwkp\" (UniqueName: \"kubernetes.io/projected/70cb8e52-8e41-40dd-9988-d9aef87fadd6-kube-api-access-2nwkp\") pod \"glance-default-external-api-0\" (UID: \"70cb8e52-8e41-40dd-9988-d9aef87fadd6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.509795 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage15-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage15-crc\") pod \"glance-default-external-api-0\" (UID: \"70cb8e52-8e41-40dd-9988-d9aef87fadd6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.533027 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7cd1f19e-4f42-46d6-9271-eb1d9fd7c52e-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "7cd1f19e-4f42-46d6-9271-eb1d9fd7c52e" (UID: "7cd1f19e-4f42-46d6-9271-eb1d9fd7c52e"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.539335 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-6h5nj"] Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.540245 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7cd1f19e-4f42-46d6-9271-eb1d9fd7c52e" containerName="ceilometer-central-agent" Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.540264 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7cd1f19e-4f42-46d6-9271-eb1d9fd7c52e" containerName="ceilometer-central-agent" Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.540273 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7cd1f19e-4f42-46d6-9271-eb1d9fd7c52e" containerName="proxy-httpd" Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.540280 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7cd1f19e-4f42-46d6-9271-eb1d9fd7c52e" containerName="proxy-httpd" Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.540301 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7cd1f19e-4f42-46d6-9271-eb1d9fd7c52e" containerName="ceilometer-notification-agent" Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.540307 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7cd1f19e-4f42-46d6-9271-eb1d9fd7c52e" containerName="ceilometer-notification-agent" Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.540326 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7cd1f19e-4f42-46d6-9271-eb1d9fd7c52e" containerName="sg-core" Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.540331 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7cd1f19e-4f42-46d6-9271-eb1d9fd7c52e" containerName="sg-core" Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.540500 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7cd1f19e-4f42-46d6-9271-eb1d9fd7c52e" containerName="proxy-httpd" Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.540512 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7cd1f19e-4f42-46d6-9271-eb1d9fd7c52e" containerName="ceilometer-notification-agent" Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.540525 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7cd1f19e-4f42-46d6-9271-eb1d9fd7c52e" containerName="ceilometer-central-agent" Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.540535 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7cd1f19e-4f42-46d6-9271-eb1d9fd7c52e" containerName="sg-core" Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.551289 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-6h5nj" Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.560160 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-conductor-config-data\"" Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.560249 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-conductor-scripts\"" Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.560494 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-nova-dockercfg-c26lm\"" Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.561051 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7cd1f19e-4f42-46d6-9271-eb1d9fd7c52e-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.561070 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p8m7l\" (UniqueName: \"kubernetes.io/projected/7cd1f19e-4f42-46d6-9271-eb1d9fd7c52e-kube-api-access-p8m7l\") on node \"crc\" DevicePath \"\"" Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.561079 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7cd1f19e-4f42-46d6-9271-eb1d9fd7c52e-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.561086 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/7cd1f19e-4f42-46d6-9271-eb1d9fd7c52e-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.565419 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7cd1f19e-4f42-46d6-9271-eb1d9fd7c52e-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "7cd1f19e-4f42-46d6-9271-eb1d9fd7c52e" (UID: "7cd1f19e-4f42-46d6-9271-eb1d9fd7c52e"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.566656 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-6h5nj"] Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.566728 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.613835 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7cd1f19e-4f42-46d6-9271-eb1d9fd7c52e-config-data" (OuterVolumeSpecName: "config-data") pod "7cd1f19e-4f42-46d6-9271-eb1d9fd7c52e" (UID: "7cd1f19e-4f42-46d6-9271-eb1d9fd7c52e"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.662985 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8dcc9838-517a-4250-b576-c87878365fa2-config-data\") pod \"nova-cell0-conductor-db-sync-6h5nj\" (UID: \"8dcc9838-517a-4250-b576-c87878365fa2\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-6h5nj" Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.663041 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8dcc9838-517a-4250-b576-c87878365fa2-combined-ca-bundle\") pod \"nova-cell0-conductor-db-sync-6h5nj\" (UID: \"8dcc9838-517a-4250-b576-c87878365fa2\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-6h5nj" Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.663109 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8dcc9838-517a-4250-b576-c87878365fa2-scripts\") pod \"nova-cell0-conductor-db-sync-6h5nj\" (UID: \"8dcc9838-517a-4250-b576-c87878365fa2\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-6h5nj" Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.663284 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjfbd\" (UniqueName: \"kubernetes.io/projected/8dcc9838-517a-4250-b576-c87878365fa2-kube-api-access-jjfbd\") pod \"nova-cell0-conductor-db-sync-6h5nj\" (UID: \"8dcc9838-517a-4250-b576-c87878365fa2\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-6h5nj" Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.663809 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7cd1f19e-4f42-46d6-9271-eb1d9fd7c52e-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.663923 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7cd1f19e-4f42-46d6-9271-eb1d9fd7c52e-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.674439 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7e0d7a3d-971e-438a-b4de-702b49c20f0d" path="/var/lib/kubelet/pods/7e0d7a3d-971e-438a-b4de-702b49c20f0d/volumes" Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.769221 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8dcc9838-517a-4250-b576-c87878365fa2-scripts\") pod \"nova-cell0-conductor-db-sync-6h5nj\" (UID: \"8dcc9838-517a-4250-b576-c87878365fa2\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-6h5nj" Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.769662 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jjfbd\" (UniqueName: \"kubernetes.io/projected/8dcc9838-517a-4250-b576-c87878365fa2-kube-api-access-jjfbd\") pod \"nova-cell0-conductor-db-sync-6h5nj\" (UID: \"8dcc9838-517a-4250-b576-c87878365fa2\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-6h5nj" Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.770274 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8dcc9838-517a-4250-b576-c87878365fa2-config-data\") pod \"nova-cell0-conductor-db-sync-6h5nj\" (UID: \"8dcc9838-517a-4250-b576-c87878365fa2\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-6h5nj" Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.770371 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8dcc9838-517a-4250-b576-c87878365fa2-combined-ca-bundle\") pod \"nova-cell0-conductor-db-sync-6h5nj\" (UID: \"8dcc9838-517a-4250-b576-c87878365fa2\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-6h5nj" Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.775448 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8dcc9838-517a-4250-b576-c87878365fa2-scripts\") pod \"nova-cell0-conductor-db-sync-6h5nj\" (UID: \"8dcc9838-517a-4250-b576-c87878365fa2\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-6h5nj" Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.787147 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjfbd\" (UniqueName: \"kubernetes.io/projected/8dcc9838-517a-4250-b576-c87878365fa2-kube-api-access-jjfbd\") pod \"nova-cell0-conductor-db-sync-6h5nj\" (UID: \"8dcc9838-517a-4250-b576-c87878365fa2\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-6h5nj" Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.791465 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8dcc9838-517a-4250-b576-c87878365fa2-config-data\") pod \"nova-cell0-conductor-db-sync-6h5nj\" (UID: \"8dcc9838-517a-4250-b576-c87878365fa2\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-6h5nj" Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.792501 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8dcc9838-517a-4250-b576-c87878365fa2-combined-ca-bundle\") pod \"nova-cell0-conductor-db-sync-6h5nj\" (UID: \"8dcc9838-517a-4250-b576-c87878365fa2\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-6h5nj" Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.923091 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/certified-operators-6pnfb"] Mar 16 16:09:04 crc kubenswrapper[5120]: I0316 16:09:04.923393 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-marketplace/certified-operators-6pnfb" podUID="057b7da4-d510-491e-bde1-76e1d4e427ff" containerName="registry-server" containerID="cri-o://276e2b0e861103439a5999509cf84de3ad76c14b52e19d8ed85ddb54f732cb69" gracePeriod=2 Mar 16 16:09:05 crc kubenswrapper[5120]: I0316 16:09:05.022481 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-6h5nj" Mar 16 16:09:05 crc kubenswrapper[5120]: I0316 16:09:05.048577 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:09:05 crc kubenswrapper[5120]: W0316 16:09:05.055381 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod70cb8e52_8e41_40dd_9988_d9aef87fadd6.slice/crio-4f21ea7f24dd57d014c66a8d9d21e902ffcbc10ec5b0b5bb41c24800a83a4d20 WatchSource:0}: Error finding container 4f21ea7f24dd57d014c66a8d9d21e902ffcbc10ec5b0b5bb41c24800a83a4d20: Status 404 returned error can't find the container with id 4f21ea7f24dd57d014c66a8d9d21e902ffcbc10ec5b0b5bb41c24800a83a4d20 Mar 16 16:09:05 crc kubenswrapper[5120]: I0316 16:09:05.191214 5120 generic.go:358] "Generic (PLEG): container finished" podID="057b7da4-d510-491e-bde1-76e1d4e427ff" containerID="276e2b0e861103439a5999509cf84de3ad76c14b52e19d8ed85ddb54f732cb69" exitCode=0 Mar 16 16:09:05 crc kubenswrapper[5120]: I0316 16:09:05.191297 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-6pnfb" event={"ID":"057b7da4-d510-491e-bde1-76e1d4e427ff","Type":"ContainerDied","Data":"276e2b0e861103439a5999509cf84de3ad76c14b52e19d8ed85ddb54f732cb69"} Mar 16 16:09:05 crc kubenswrapper[5120]: I0316 16:09:05.210928 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7cd1f19e-4f42-46d6-9271-eb1d9fd7c52e","Type":"ContainerDied","Data":"756fb30d7e31c1515cd9d14a5eb8f7399595478b32449d5a4e9e788877bdd3e8"} Mar 16 16:09:05 crc kubenswrapper[5120]: I0316 16:09:05.210978 5120 scope.go:117] "RemoveContainer" containerID="7ea9c30f402a1ce7827153b958f8c99c886c7edd477c6c93bfd0ec284eebf54a" Mar 16 16:09:05 crc kubenswrapper[5120]: I0316 16:09:05.211096 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:09:05 crc kubenswrapper[5120]: I0316 16:09:05.213888 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"70cb8e52-8e41-40dd-9988-d9aef87fadd6","Type":"ContainerStarted","Data":"4f21ea7f24dd57d014c66a8d9d21e902ffcbc10ec5b0b5bb41c24800a83a4d20"} Mar 16 16:09:05 crc kubenswrapper[5120]: I0316 16:09:05.214954 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-marketplace/redhat-marketplace-lrwk8" podUID="9f77fc46-483c-462c-b8ce-75b212e3e2f0" containerName="registry-server" containerID="cri-o://ae34d5dbda52118e3bf9d9bd2c2c3c024256915c100c75a649c45b001698a4fc" gracePeriod=2 Mar 16 16:09:05 crc kubenswrapper[5120]: I0316 16:09:05.258392 5120 scope.go:117] "RemoveContainer" containerID="ad6c6406ebe11ee3ab1df16db560a0fc7f749e4197421facce2c3679d68ed09a" Mar 16 16:09:05 crc kubenswrapper[5120]: I0316 16:09:05.260806 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:09:05 crc kubenswrapper[5120]: I0316 16:09:05.268600 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:09:05 crc kubenswrapper[5120]: I0316 16:09:05.297161 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:09:05 crc kubenswrapper[5120]: I0316 16:09:05.306328 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:09:05 crc kubenswrapper[5120]: I0316 16:09:05.310608 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:09:05 crc kubenswrapper[5120]: I0316 16:09:05.311783 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 16:09:05 crc kubenswrapper[5120]: I0316 16:09:05.312294 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 16:09:05 crc kubenswrapper[5120]: I0316 16:09:05.316803 5120 scope.go:117] "RemoveContainer" containerID="f1311a2bfb13a7c3b653ead3df7480fc96b719fee2c791d0851c854b4aba4915" Mar 16 16:09:05 crc kubenswrapper[5120]: I0316 16:09:05.345977 5120 scope.go:117] "RemoveContainer" containerID="9f496d6fbdcfbd6fc07376d0ab068a3fec1af56cff769d29812ad1fec9e4e9f2" Mar 16 16:09:05 crc kubenswrapper[5120]: I0316 16:09:05.384505 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/edab59f1-ba45-44c9-ace6-b54ab84f1f62-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"edab59f1-ba45-44c9-ace6-b54ab84f1f62\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:09:05 crc kubenswrapper[5120]: I0316 16:09:05.384557 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/edab59f1-ba45-44c9-ace6-b54ab84f1f62-scripts\") pod \"ceilometer-0\" (UID: \"edab59f1-ba45-44c9-ace6-b54ab84f1f62\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:09:05 crc kubenswrapper[5120]: I0316 16:09:05.384597 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/edab59f1-ba45-44c9-ace6-b54ab84f1f62-config-data\") pod \"ceilometer-0\" (UID: \"edab59f1-ba45-44c9-ace6-b54ab84f1f62\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:09:05 crc kubenswrapper[5120]: I0316 16:09:05.384641 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/edab59f1-ba45-44c9-ace6-b54ab84f1f62-run-httpd\") pod \"ceilometer-0\" (UID: \"edab59f1-ba45-44c9-ace6-b54ab84f1f62\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:09:05 crc kubenswrapper[5120]: I0316 16:09:05.384697 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/edab59f1-ba45-44c9-ace6-b54ab84f1f62-log-httpd\") pod \"ceilometer-0\" (UID: \"edab59f1-ba45-44c9-ace6-b54ab84f1f62\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:09:05 crc kubenswrapper[5120]: I0316 16:09:05.384816 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/edab59f1-ba45-44c9-ace6-b54ab84f1f62-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"edab59f1-ba45-44c9-ace6-b54ab84f1f62\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:09:05 crc kubenswrapper[5120]: I0316 16:09:05.384911 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cgt6n\" (UniqueName: \"kubernetes.io/projected/edab59f1-ba45-44c9-ace6-b54ab84f1f62-kube-api-access-cgt6n\") pod \"ceilometer-0\" (UID: \"edab59f1-ba45-44c9-ace6-b54ab84f1f62\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:09:05 crc kubenswrapper[5120]: I0316 16:09:05.390219 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-6pnfb" Mar 16 16:09:05 crc kubenswrapper[5120]: I0316 16:09:05.488349 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/057b7da4-d510-491e-bde1-76e1d4e427ff-utilities\") pod \"057b7da4-d510-491e-bde1-76e1d4e427ff\" (UID: \"057b7da4-d510-491e-bde1-76e1d4e427ff\") " Mar 16 16:09:05 crc kubenswrapper[5120]: I0316 16:09:05.488573 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ld7n7\" (UniqueName: \"kubernetes.io/projected/057b7da4-d510-491e-bde1-76e1d4e427ff-kube-api-access-ld7n7\") pod \"057b7da4-d510-491e-bde1-76e1d4e427ff\" (UID: \"057b7da4-d510-491e-bde1-76e1d4e427ff\") " Mar 16 16:09:05 crc kubenswrapper[5120]: I0316 16:09:05.489904 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/057b7da4-d510-491e-bde1-76e1d4e427ff-catalog-content\") pod \"057b7da4-d510-491e-bde1-76e1d4e427ff\" (UID: \"057b7da4-d510-491e-bde1-76e1d4e427ff\") " Mar 16 16:09:05 crc kubenswrapper[5120]: I0316 16:09:05.490145 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/edab59f1-ba45-44c9-ace6-b54ab84f1f62-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"edab59f1-ba45-44c9-ace6-b54ab84f1f62\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:09:05 crc kubenswrapper[5120]: I0316 16:09:05.490179 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/edab59f1-ba45-44c9-ace6-b54ab84f1f62-scripts\") pod \"ceilometer-0\" (UID: \"edab59f1-ba45-44c9-ace6-b54ab84f1f62\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:09:05 crc kubenswrapper[5120]: I0316 16:09:05.490214 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/edab59f1-ba45-44c9-ace6-b54ab84f1f62-config-data\") pod \"ceilometer-0\" (UID: \"edab59f1-ba45-44c9-ace6-b54ab84f1f62\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:09:05 crc kubenswrapper[5120]: I0316 16:09:05.490266 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/edab59f1-ba45-44c9-ace6-b54ab84f1f62-run-httpd\") pod \"ceilometer-0\" (UID: \"edab59f1-ba45-44c9-ace6-b54ab84f1f62\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:09:05 crc kubenswrapper[5120]: I0316 16:09:05.490327 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/edab59f1-ba45-44c9-ace6-b54ab84f1f62-log-httpd\") pod \"ceilometer-0\" (UID: \"edab59f1-ba45-44c9-ace6-b54ab84f1f62\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:09:05 crc kubenswrapper[5120]: I0316 16:09:05.490408 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/edab59f1-ba45-44c9-ace6-b54ab84f1f62-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"edab59f1-ba45-44c9-ace6-b54ab84f1f62\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:09:05 crc kubenswrapper[5120]: I0316 16:09:05.490505 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cgt6n\" (UniqueName: \"kubernetes.io/projected/edab59f1-ba45-44c9-ace6-b54ab84f1f62-kube-api-access-cgt6n\") pod \"ceilometer-0\" (UID: \"edab59f1-ba45-44c9-ace6-b54ab84f1f62\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:09:05 crc kubenswrapper[5120]: I0316 16:09:05.491974 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/edab59f1-ba45-44c9-ace6-b54ab84f1f62-run-httpd\") pod \"ceilometer-0\" (UID: \"edab59f1-ba45-44c9-ace6-b54ab84f1f62\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:09:05 crc kubenswrapper[5120]: I0316 16:09:05.493203 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/edab59f1-ba45-44c9-ace6-b54ab84f1f62-log-httpd\") pod \"ceilometer-0\" (UID: \"edab59f1-ba45-44c9-ace6-b54ab84f1f62\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:09:05 crc kubenswrapper[5120]: I0316 16:09:05.500299 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/edab59f1-ba45-44c9-ace6-b54ab84f1f62-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"edab59f1-ba45-44c9-ace6-b54ab84f1f62\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:09:05 crc kubenswrapper[5120]: I0316 16:09:05.501000 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/057b7da4-d510-491e-bde1-76e1d4e427ff-kube-api-access-ld7n7" (OuterVolumeSpecName: "kube-api-access-ld7n7") pod "057b7da4-d510-491e-bde1-76e1d4e427ff" (UID: "057b7da4-d510-491e-bde1-76e1d4e427ff"). InnerVolumeSpecName "kube-api-access-ld7n7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:09:05 crc kubenswrapper[5120]: I0316 16:09:05.504281 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/057b7da4-d510-491e-bde1-76e1d4e427ff-utilities" (OuterVolumeSpecName: "utilities") pod "057b7da4-d510-491e-bde1-76e1d4e427ff" (UID: "057b7da4-d510-491e-bde1-76e1d4e427ff"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:09:05 crc kubenswrapper[5120]: I0316 16:09:05.504373 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/edab59f1-ba45-44c9-ace6-b54ab84f1f62-scripts\") pod \"ceilometer-0\" (UID: \"edab59f1-ba45-44c9-ace6-b54ab84f1f62\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:09:05 crc kubenswrapper[5120]: I0316 16:09:05.507073 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/edab59f1-ba45-44c9-ace6-b54ab84f1f62-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"edab59f1-ba45-44c9-ace6-b54ab84f1f62\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:09:05 crc kubenswrapper[5120]: I0316 16:09:05.509346 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cgt6n\" (UniqueName: \"kubernetes.io/projected/edab59f1-ba45-44c9-ace6-b54ab84f1f62-kube-api-access-cgt6n\") pod \"ceilometer-0\" (UID: \"edab59f1-ba45-44c9-ace6-b54ab84f1f62\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:09:05 crc kubenswrapper[5120]: I0316 16:09:05.510902 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/edab59f1-ba45-44c9-ace6-b54ab84f1f62-config-data\") pod \"ceilometer-0\" (UID: \"edab59f1-ba45-44c9-ace6-b54ab84f1f62\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:09:05 crc kubenswrapper[5120]: I0316 16:09:05.534568 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/057b7da4-d510-491e-bde1-76e1d4e427ff-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "057b7da4-d510-491e-bde1-76e1d4e427ff" (UID: "057b7da4-d510-491e-bde1-76e1d4e427ff"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:09:05 crc kubenswrapper[5120]: I0316 16:09:05.577536 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-6h5nj"] Mar 16 16:09:05 crc kubenswrapper[5120]: W0316 16:09:05.579134 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8dcc9838_517a_4250_b576_c87878365fa2.slice/crio-6e6da3e300d6823335f7594b922bdea69d4bcbda1f4705a7cb0f74a5177205ff WatchSource:0}: Error finding container 6e6da3e300d6823335f7594b922bdea69d4bcbda1f4705a7cb0f74a5177205ff: Status 404 returned error can't find the container with id 6e6da3e300d6823335f7594b922bdea69d4bcbda1f4705a7cb0f74a5177205ff Mar 16 16:09:05 crc kubenswrapper[5120]: I0316 16:09:05.609179 5120 reconciler_common.go:299] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/057b7da4-d510-491e-bde1-76e1d4e427ff-catalog-content\") on node \"crc\" DevicePath \"\"" Mar 16 16:09:05 crc kubenswrapper[5120]: I0316 16:09:05.609209 5120 reconciler_common.go:299] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/057b7da4-d510-491e-bde1-76e1d4e427ff-utilities\") on node \"crc\" DevicePath \"\"" Mar 16 16:09:05 crc kubenswrapper[5120]: I0316 16:09:05.609220 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ld7n7\" (UniqueName: \"kubernetes.io/projected/057b7da4-d510-491e-bde1-76e1d4e427ff-kube-api-access-ld7n7\") on node \"crc\" DevicePath \"\"" Mar 16 16:09:05 crc kubenswrapper[5120]: I0316 16:09:05.627054 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:09:06 crc kubenswrapper[5120]: I0316 16:09:06.213817 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-lrwk8" Mar 16 16:09:06 crc kubenswrapper[5120]: I0316 16:09:06.230784 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t7bnv\" (UniqueName: \"kubernetes.io/projected/9f77fc46-483c-462c-b8ce-75b212e3e2f0-kube-api-access-t7bnv\") pod \"9f77fc46-483c-462c-b8ce-75b212e3e2f0\" (UID: \"9f77fc46-483c-462c-b8ce-75b212e3e2f0\") " Mar 16 16:09:06 crc kubenswrapper[5120]: I0316 16:09:06.231220 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/9f77fc46-483c-462c-b8ce-75b212e3e2f0-utilities\") pod \"9f77fc46-483c-462c-b8ce-75b212e3e2f0\" (UID: \"9f77fc46-483c-462c-b8ce-75b212e3e2f0\") " Mar 16 16:09:06 crc kubenswrapper[5120]: I0316 16:09:06.231321 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/9f77fc46-483c-462c-b8ce-75b212e3e2f0-catalog-content\") pod \"9f77fc46-483c-462c-b8ce-75b212e3e2f0\" (UID: \"9f77fc46-483c-462c-b8ce-75b212e3e2f0\") " Mar 16 16:09:06 crc kubenswrapper[5120]: I0316 16:09:06.234258 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f77fc46-483c-462c-b8ce-75b212e3e2f0-utilities" (OuterVolumeSpecName: "utilities") pod "9f77fc46-483c-462c-b8ce-75b212e3e2f0" (UID: "9f77fc46-483c-462c-b8ce-75b212e3e2f0"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:09:06 crc kubenswrapper[5120]: I0316 16:09:06.235789 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-6h5nj" event={"ID":"8dcc9838-517a-4250-b576-c87878365fa2","Type":"ContainerStarted","Data":"6e6da3e300d6823335f7594b922bdea69d4bcbda1f4705a7cb0f74a5177205ff"} Mar 16 16:09:06 crc kubenswrapper[5120]: I0316 16:09:06.239374 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f77fc46-483c-462c-b8ce-75b212e3e2f0-kube-api-access-t7bnv" (OuterVolumeSpecName: "kube-api-access-t7bnv") pod "9f77fc46-483c-462c-b8ce-75b212e3e2f0" (UID: "9f77fc46-483c-462c-b8ce-75b212e3e2f0"). InnerVolumeSpecName "kube-api-access-t7bnv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:09:06 crc kubenswrapper[5120]: I0316 16:09:06.240287 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-6pnfb" event={"ID":"057b7da4-d510-491e-bde1-76e1d4e427ff","Type":"ContainerDied","Data":"17c355d6c66de1786531d3092155b4900389869f60b1cd3e4311e3cb75aac5c0"} Mar 16 16:09:06 crc kubenswrapper[5120]: I0316 16:09:06.240352 5120 scope.go:117] "RemoveContainer" containerID="276e2b0e861103439a5999509cf84de3ad76c14b52e19d8ed85ddb54f732cb69" Mar 16 16:09:06 crc kubenswrapper[5120]: I0316 16:09:06.240843 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-6pnfb" Mar 16 16:09:06 crc kubenswrapper[5120]: I0316 16:09:06.253446 5120 generic.go:358] "Generic (PLEG): container finished" podID="9f77fc46-483c-462c-b8ce-75b212e3e2f0" containerID="ae34d5dbda52118e3bf9d9bd2c2c3c024256915c100c75a649c45b001698a4fc" exitCode=0 Mar 16 16:09:06 crc kubenswrapper[5120]: I0316 16:09:06.253652 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-lrwk8" Mar 16 16:09:06 crc kubenswrapper[5120]: I0316 16:09:06.253831 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-lrwk8" event={"ID":"9f77fc46-483c-462c-b8ce-75b212e3e2f0","Type":"ContainerDied","Data":"ae34d5dbda52118e3bf9d9bd2c2c3c024256915c100c75a649c45b001698a4fc"} Mar 16 16:09:06 crc kubenswrapper[5120]: I0316 16:09:06.253873 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-lrwk8" event={"ID":"9f77fc46-483c-462c-b8ce-75b212e3e2f0","Type":"ContainerDied","Data":"10ba62614e33373a0bdf86dfb7be51cf01ce40c81dc720a3dde448b8435aa8a9"} Mar 16 16:09:06 crc kubenswrapper[5120]: I0316 16:09:06.270005 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f77fc46-483c-462c-b8ce-75b212e3e2f0-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "9f77fc46-483c-462c-b8ce-75b212e3e2f0" (UID: "9f77fc46-483c-462c-b8ce-75b212e3e2f0"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:09:06 crc kubenswrapper[5120]: I0316 16:09:06.333276 5120 reconciler_common.go:299] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/9f77fc46-483c-462c-b8ce-75b212e3e2f0-utilities\") on node \"crc\" DevicePath \"\"" Mar 16 16:09:06 crc kubenswrapper[5120]: I0316 16:09:06.333313 5120 reconciler_common.go:299] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/9f77fc46-483c-462c-b8ce-75b212e3e2f0-catalog-content\") on node \"crc\" DevicePath \"\"" Mar 16 16:09:06 crc kubenswrapper[5120]: I0316 16:09:06.333324 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t7bnv\" (UniqueName: \"kubernetes.io/projected/9f77fc46-483c-462c-b8ce-75b212e3e2f0-kube-api-access-t7bnv\") on node \"crc\" DevicePath \"\"" Mar 16 16:09:06 crc kubenswrapper[5120]: I0316 16:09:06.333341 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/certified-operators-6pnfb"] Mar 16 16:09:06 crc kubenswrapper[5120]: I0316 16:09:06.348122 5120 scope.go:117] "RemoveContainer" containerID="42a7bfc26f8a6cf5b0cd8119a2b9e78583fc89e500cc9bb9bb23c738d8b9bed1" Mar 16 16:09:06 crc kubenswrapper[5120]: I0316 16:09:06.352588 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/certified-operators-6pnfb"] Mar 16 16:09:06 crc kubenswrapper[5120]: I0316 16:09:06.367350 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:09:06 crc kubenswrapper[5120]: I0316 16:09:06.388604 5120 scope.go:117] "RemoveContainer" containerID="b63fca20f7305772eddeb8ae3f9b7934d1976920901776d85c4e069caf33685c" Mar 16 16:09:06 crc kubenswrapper[5120]: I0316 16:09:06.438498 5120 scope.go:117] "RemoveContainer" containerID="ae34d5dbda52118e3bf9d9bd2c2c3c024256915c100c75a649c45b001698a4fc" Mar 16 16:09:06 crc kubenswrapper[5120]: I0316 16:09:06.463884 5120 scope.go:117] "RemoveContainer" containerID="5e7b5fae4c9b50ff0ff21db22ef8bd6266b7d2888e440fccd439058e5bc929b5" Mar 16 16:09:06 crc kubenswrapper[5120]: I0316 16:09:06.487151 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:09:06 crc kubenswrapper[5120]: W0316 16:09:06.493381 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podedab59f1_ba45_44c9_ace6_b54ab84f1f62.slice/crio-253b460b089efc249fb6f6e8acf5eb5c4fbc29a7bad7b8fff5cd3fa26271772a WatchSource:0}: Error finding container 253b460b089efc249fb6f6e8acf5eb5c4fbc29a7bad7b8fff5cd3fa26271772a: Status 404 returned error can't find the container with id 253b460b089efc249fb6f6e8acf5eb5c4fbc29a7bad7b8fff5cd3fa26271772a Mar 16 16:09:06 crc kubenswrapper[5120]: I0316 16:09:06.508413 5120 scope.go:117] "RemoveContainer" containerID="b5413aa6bb779cb8b5d8beb14130c40441530e777b4bbc768ced1d43814b34a4" Mar 16 16:09:06 crc kubenswrapper[5120]: I0316 16:09:06.610093 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-marketplace-lrwk8"] Mar 16 16:09:06 crc kubenswrapper[5120]: I0316 16:09:06.618036 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/redhat-marketplace-lrwk8"] Mar 16 16:09:06 crc kubenswrapper[5120]: I0316 16:09:06.651528 5120 scope.go:117] "RemoveContainer" containerID="ae34d5dbda52118e3bf9d9bd2c2c3c024256915c100c75a649c45b001698a4fc" Mar 16 16:09:06 crc kubenswrapper[5120]: E0316 16:09:06.652579 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ae34d5dbda52118e3bf9d9bd2c2c3c024256915c100c75a649c45b001698a4fc\": container with ID starting with ae34d5dbda52118e3bf9d9bd2c2c3c024256915c100c75a649c45b001698a4fc not found: ID does not exist" containerID="ae34d5dbda52118e3bf9d9bd2c2c3c024256915c100c75a649c45b001698a4fc" Mar 16 16:09:06 crc kubenswrapper[5120]: I0316 16:09:06.652622 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae34d5dbda52118e3bf9d9bd2c2c3c024256915c100c75a649c45b001698a4fc"} err="failed to get container status \"ae34d5dbda52118e3bf9d9bd2c2c3c024256915c100c75a649c45b001698a4fc\": rpc error: code = NotFound desc = could not find container \"ae34d5dbda52118e3bf9d9bd2c2c3c024256915c100c75a649c45b001698a4fc\": container with ID starting with ae34d5dbda52118e3bf9d9bd2c2c3c024256915c100c75a649c45b001698a4fc not found: ID does not exist" Mar 16 16:09:06 crc kubenswrapper[5120]: I0316 16:09:06.652646 5120 scope.go:117] "RemoveContainer" containerID="5e7b5fae4c9b50ff0ff21db22ef8bd6266b7d2888e440fccd439058e5bc929b5" Mar 16 16:09:06 crc kubenswrapper[5120]: E0316 16:09:06.652897 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5e7b5fae4c9b50ff0ff21db22ef8bd6266b7d2888e440fccd439058e5bc929b5\": container with ID starting with 5e7b5fae4c9b50ff0ff21db22ef8bd6266b7d2888e440fccd439058e5bc929b5 not found: ID does not exist" containerID="5e7b5fae4c9b50ff0ff21db22ef8bd6266b7d2888e440fccd439058e5bc929b5" Mar 16 16:09:06 crc kubenswrapper[5120]: I0316 16:09:06.652923 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e7b5fae4c9b50ff0ff21db22ef8bd6266b7d2888e440fccd439058e5bc929b5"} err="failed to get container status \"5e7b5fae4c9b50ff0ff21db22ef8bd6266b7d2888e440fccd439058e5bc929b5\": rpc error: code = NotFound desc = could not find container \"5e7b5fae4c9b50ff0ff21db22ef8bd6266b7d2888e440fccd439058e5bc929b5\": container with ID starting with 5e7b5fae4c9b50ff0ff21db22ef8bd6266b7d2888e440fccd439058e5bc929b5 not found: ID does not exist" Mar 16 16:09:06 crc kubenswrapper[5120]: I0316 16:09:06.652938 5120 scope.go:117] "RemoveContainer" containerID="b5413aa6bb779cb8b5d8beb14130c40441530e777b4bbc768ced1d43814b34a4" Mar 16 16:09:06 crc kubenswrapper[5120]: E0316 16:09:06.653132 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b5413aa6bb779cb8b5d8beb14130c40441530e777b4bbc768ced1d43814b34a4\": container with ID starting with b5413aa6bb779cb8b5d8beb14130c40441530e777b4bbc768ced1d43814b34a4 not found: ID does not exist" containerID="b5413aa6bb779cb8b5d8beb14130c40441530e777b4bbc768ced1d43814b34a4" Mar 16 16:09:06 crc kubenswrapper[5120]: I0316 16:09:06.653161 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5413aa6bb779cb8b5d8beb14130c40441530e777b4bbc768ced1d43814b34a4"} err="failed to get container status \"b5413aa6bb779cb8b5d8beb14130c40441530e777b4bbc768ced1d43814b34a4\": rpc error: code = NotFound desc = could not find container \"b5413aa6bb779cb8b5d8beb14130c40441530e777b4bbc768ced1d43814b34a4\": container with ID starting with b5413aa6bb779cb8b5d8beb14130c40441530e777b4bbc768ced1d43814b34a4 not found: ID does not exist" Mar 16 16:09:06 crc kubenswrapper[5120]: I0316 16:09:06.700603 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="057b7da4-d510-491e-bde1-76e1d4e427ff" path="/var/lib/kubelet/pods/057b7da4-d510-491e-bde1-76e1d4e427ff/volumes" Mar 16 16:09:06 crc kubenswrapper[5120]: I0316 16:09:06.701388 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7cd1f19e-4f42-46d6-9271-eb1d9fd7c52e" path="/var/lib/kubelet/pods/7cd1f19e-4f42-46d6-9271-eb1d9fd7c52e/volumes" Mar 16 16:09:06 crc kubenswrapper[5120]: I0316 16:09:06.703807 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f77fc46-483c-462c-b8ce-75b212e3e2f0" path="/var/lib/kubelet/pods/9f77fc46-483c-462c-b8ce-75b212e3e2f0/volumes" Mar 16 16:09:06 crc kubenswrapper[5120]: I0316 16:09:06.705824 5120 scope.go:117] "RemoveContainer" containerID="bc2df124cc6ad146d7c7dd2115ac815986fb62978d38895f6d345a4a9b14dbd8" Mar 16 16:09:06 crc kubenswrapper[5120]: E0316 16:09:06.706270 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:09:06 crc kubenswrapper[5120]: I0316 16:09:06.965843 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:09:07 crc kubenswrapper[5120]: I0316 16:09:07.053693 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c5593ae2-7a56-4d09-8f88-a54b43c2be0c-logs\") pod \"c5593ae2-7a56-4d09-8f88-a54b43c2be0c\" (UID: \"c5593ae2-7a56-4d09-8f88-a54b43c2be0c\") " Mar 16 16:09:07 crc kubenswrapper[5120]: I0316 16:09:07.053844 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c5593ae2-7a56-4d09-8f88-a54b43c2be0c-scripts\") pod \"c5593ae2-7a56-4d09-8f88-a54b43c2be0c\" (UID: \"c5593ae2-7a56-4d09-8f88-a54b43c2be0c\") " Mar 16 16:09:07 crc kubenswrapper[5120]: I0316 16:09:07.053933 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/c5593ae2-7a56-4d09-8f88-a54b43c2be0c-httpd-run\") pod \"c5593ae2-7a56-4d09-8f88-a54b43c2be0c\" (UID: \"c5593ae2-7a56-4d09-8f88-a54b43c2be0c\") " Mar 16 16:09:07 crc kubenswrapper[5120]: I0316 16:09:07.054016 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c5593ae2-7a56-4d09-8f88-a54b43c2be0c-combined-ca-bundle\") pod \"c5593ae2-7a56-4d09-8f88-a54b43c2be0c\" (UID: \"c5593ae2-7a56-4d09-8f88-a54b43c2be0c\") " Mar 16 16:09:07 crc kubenswrapper[5120]: I0316 16:09:07.054074 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9ctvn\" (UniqueName: \"kubernetes.io/projected/c5593ae2-7a56-4d09-8f88-a54b43c2be0c-kube-api-access-9ctvn\") pod \"c5593ae2-7a56-4d09-8f88-a54b43c2be0c\" (UID: \"c5593ae2-7a56-4d09-8f88-a54b43c2be0c\") " Mar 16 16:09:07 crc kubenswrapper[5120]: I0316 16:09:07.054146 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5593ae2-7a56-4d09-8f88-a54b43c2be0c-logs" (OuterVolumeSpecName: "logs") pod "c5593ae2-7a56-4d09-8f88-a54b43c2be0c" (UID: "c5593ae2-7a56-4d09-8f88-a54b43c2be0c"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:09:07 crc kubenswrapper[5120]: I0316 16:09:07.054263 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/c5593ae2-7a56-4d09-8f88-a54b43c2be0c-internal-tls-certs\") pod \"c5593ae2-7a56-4d09-8f88-a54b43c2be0c\" (UID: \"c5593ae2-7a56-4d09-8f88-a54b43c2be0c\") " Mar 16 16:09:07 crc kubenswrapper[5120]: I0316 16:09:07.054301 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c5593ae2-7a56-4d09-8f88-a54b43c2be0c-config-data\") pod \"c5593ae2-7a56-4d09-8f88-a54b43c2be0c\" (UID: \"c5593ae2-7a56-4d09-8f88-a54b43c2be0c\") " Mar 16 16:09:07 crc kubenswrapper[5120]: I0316 16:09:07.054358 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") pod \"c5593ae2-7a56-4d09-8f88-a54b43c2be0c\" (UID: \"c5593ae2-7a56-4d09-8f88-a54b43c2be0c\") " Mar 16 16:09:07 crc kubenswrapper[5120]: I0316 16:09:07.055512 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c5593ae2-7a56-4d09-8f88-a54b43c2be0c-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:09:07 crc kubenswrapper[5120]: I0316 16:09:07.059407 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage14-crc" (OuterVolumeSpecName: "glance") pod "c5593ae2-7a56-4d09-8f88-a54b43c2be0c" (UID: "c5593ae2-7a56-4d09-8f88-a54b43c2be0c"). InnerVolumeSpecName "local-storage14-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:09:07 crc kubenswrapper[5120]: I0316 16:09:07.060176 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5593ae2-7a56-4d09-8f88-a54b43c2be0c-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "c5593ae2-7a56-4d09-8f88-a54b43c2be0c" (UID: "c5593ae2-7a56-4d09-8f88-a54b43c2be0c"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:09:07 crc kubenswrapper[5120]: I0316 16:09:07.060571 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5593ae2-7a56-4d09-8f88-a54b43c2be0c-kube-api-access-9ctvn" (OuterVolumeSpecName: "kube-api-access-9ctvn") pod "c5593ae2-7a56-4d09-8f88-a54b43c2be0c" (UID: "c5593ae2-7a56-4d09-8f88-a54b43c2be0c"). InnerVolumeSpecName "kube-api-access-9ctvn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:09:07 crc kubenswrapper[5120]: I0316 16:09:07.067978 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c5593ae2-7a56-4d09-8f88-a54b43c2be0c-scripts" (OuterVolumeSpecName: "scripts") pod "c5593ae2-7a56-4d09-8f88-a54b43c2be0c" (UID: "c5593ae2-7a56-4d09-8f88-a54b43c2be0c"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:09:07 crc kubenswrapper[5120]: I0316 16:09:07.106270 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c5593ae2-7a56-4d09-8f88-a54b43c2be0c-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "c5593ae2-7a56-4d09-8f88-a54b43c2be0c" (UID: "c5593ae2-7a56-4d09-8f88-a54b43c2be0c"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:09:07 crc kubenswrapper[5120]: I0316 16:09:07.128975 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c5593ae2-7a56-4d09-8f88-a54b43c2be0c-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "c5593ae2-7a56-4d09-8f88-a54b43c2be0c" (UID: "c5593ae2-7a56-4d09-8f88-a54b43c2be0c"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:09:07 crc kubenswrapper[5120]: I0316 16:09:07.150581 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c5593ae2-7a56-4d09-8f88-a54b43c2be0c-config-data" (OuterVolumeSpecName: "config-data") pod "c5593ae2-7a56-4d09-8f88-a54b43c2be0c" (UID: "c5593ae2-7a56-4d09-8f88-a54b43c2be0c"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:09:07 crc kubenswrapper[5120]: I0316 16:09:07.157545 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c5593ae2-7a56-4d09-8f88-a54b43c2be0c-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:09:07 crc kubenswrapper[5120]: I0316 16:09:07.157579 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/c5593ae2-7a56-4d09-8f88-a54b43c2be0c-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 16:09:07 crc kubenswrapper[5120]: I0316 16:09:07.157590 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c5593ae2-7a56-4d09-8f88-a54b43c2be0c-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:09:07 crc kubenswrapper[5120]: I0316 16:09:07.157600 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9ctvn\" (UniqueName: \"kubernetes.io/projected/c5593ae2-7a56-4d09-8f88-a54b43c2be0c-kube-api-access-9ctvn\") on node \"crc\" DevicePath \"\"" Mar 16 16:09:07 crc kubenswrapper[5120]: I0316 16:09:07.157612 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/c5593ae2-7a56-4d09-8f88-a54b43c2be0c-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:09:07 crc kubenswrapper[5120]: I0316 16:09:07.157621 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c5593ae2-7a56-4d09-8f88-a54b43c2be0c-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:09:07 crc kubenswrapper[5120]: I0316 16:09:07.157652 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") on node \"crc\" " Mar 16 16:09:07 crc kubenswrapper[5120]: I0316 16:09:07.177568 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage14-crc" (UniqueName: "kubernetes.io/local-volume/local-storage14-crc") on node "crc" Mar 16 16:09:07 crc kubenswrapper[5120]: I0316 16:09:07.259082 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:09:07 crc kubenswrapper[5120]: I0316 16:09:07.339416 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-6h5nj" event={"ID":"8dcc9838-517a-4250-b576-c87878365fa2","Type":"ContainerStarted","Data":"dd23bc6bdc8475b15802b3822e2533e7d87c582efa0f5640fb7647f5ae171e0b"} Mar 16 16:09:07 crc kubenswrapper[5120]: I0316 16:09:07.345583 5120 generic.go:358] "Generic (PLEG): container finished" podID="c5593ae2-7a56-4d09-8f88-a54b43c2be0c" containerID="16cfa2634d38d4f0aac174cea17bf8487cb7107a948e6c49443a719a68fd92b4" exitCode=0 Mar 16 16:09:07 crc kubenswrapper[5120]: I0316 16:09:07.345707 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"c5593ae2-7a56-4d09-8f88-a54b43c2be0c","Type":"ContainerDied","Data":"16cfa2634d38d4f0aac174cea17bf8487cb7107a948e6c49443a719a68fd92b4"} Mar 16 16:09:07 crc kubenswrapper[5120]: I0316 16:09:07.345733 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"c5593ae2-7a56-4d09-8f88-a54b43c2be0c","Type":"ContainerDied","Data":"5d0993f4849a9d3c1208effceeb03313bc60bf156a675ba90c5efd1c336fc40a"} Mar 16 16:09:07 crc kubenswrapper[5120]: I0316 16:09:07.345752 5120 scope.go:117] "RemoveContainer" containerID="16cfa2634d38d4f0aac174cea17bf8487cb7107a948e6c49443a719a68fd92b4" Mar 16 16:09:07 crc kubenswrapper[5120]: I0316 16:09:07.345876 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:09:07 crc kubenswrapper[5120]: I0316 16:09:07.372619 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-6h5nj" podStartSLOduration=3.3725981210000002 podStartE2EDuration="3.372598121s" podCreationTimestamp="2026-03-16 16:09:04 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:09:07.355143465 +0000 UTC m=+2249.509075122" watchObservedRunningTime="2026-03-16 16:09:07.372598121 +0000 UTC m=+2249.526529778" Mar 16 16:09:07 crc kubenswrapper[5120]: I0316 16:09:07.431110 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"70cb8e52-8e41-40dd-9988-d9aef87fadd6","Type":"ContainerStarted","Data":"07a4e9dbf0143df0475464b81a622cfeb916120ecf755e170ba1c70fb1ce953d"} Mar 16 16:09:07 crc kubenswrapper[5120]: I0316 16:09:07.434970 5120 scope.go:117] "RemoveContainer" containerID="047eec0013cada9bc1768aac8af82d95870075ec52f3cdcb2d119a77a1b49356" Mar 16 16:09:07 crc kubenswrapper[5120]: I0316 16:09:07.437902 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:09:07 crc kubenswrapper[5120]: I0316 16:09:07.447875 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"edab59f1-ba45-44c9-ace6-b54ab84f1f62","Type":"ContainerStarted","Data":"253b460b089efc249fb6f6e8acf5eb5c4fbc29a7bad7b8fff5cd3fa26271772a"} Mar 16 16:09:07 crc kubenswrapper[5120]: I0316 16:09:07.466824 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:09:07 crc kubenswrapper[5120]: I0316 16:09:07.502141 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:09:07 crc kubenswrapper[5120]: I0316 16:09:07.516005 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5593ae2-7a56-4d09-8f88-a54b43c2be0c" containerName="glance-log" Mar 16 16:09:07 crc kubenswrapper[5120]: I0316 16:09:07.516033 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5593ae2-7a56-4d09-8f88-a54b43c2be0c" containerName="glance-log" Mar 16 16:09:07 crc kubenswrapper[5120]: I0316 16:09:07.516050 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f77fc46-483c-462c-b8ce-75b212e3e2f0" containerName="registry-server" Mar 16 16:09:07 crc kubenswrapper[5120]: I0316 16:09:07.516056 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f77fc46-483c-462c-b8ce-75b212e3e2f0" containerName="registry-server" Mar 16 16:09:07 crc kubenswrapper[5120]: I0316 16:09:07.516069 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="057b7da4-d510-491e-bde1-76e1d4e427ff" containerName="registry-server" Mar 16 16:09:07 crc kubenswrapper[5120]: I0316 16:09:07.516074 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="057b7da4-d510-491e-bde1-76e1d4e427ff" containerName="registry-server" Mar 16 16:09:07 crc kubenswrapper[5120]: I0316 16:09:07.516081 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f77fc46-483c-462c-b8ce-75b212e3e2f0" containerName="extract-utilities" Mar 16 16:09:07 crc kubenswrapper[5120]: I0316 16:09:07.516087 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f77fc46-483c-462c-b8ce-75b212e3e2f0" containerName="extract-utilities" Mar 16 16:09:07 crc kubenswrapper[5120]: I0316 16:09:07.516128 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5593ae2-7a56-4d09-8f88-a54b43c2be0c" containerName="glance-httpd" Mar 16 16:09:07 crc kubenswrapper[5120]: I0316 16:09:07.516133 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5593ae2-7a56-4d09-8f88-a54b43c2be0c" containerName="glance-httpd" Mar 16 16:09:07 crc kubenswrapper[5120]: I0316 16:09:07.516162 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f77fc46-483c-462c-b8ce-75b212e3e2f0" containerName="extract-content" Mar 16 16:09:07 crc kubenswrapper[5120]: I0316 16:09:07.516167 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f77fc46-483c-462c-b8ce-75b212e3e2f0" containerName="extract-content" Mar 16 16:09:07 crc kubenswrapper[5120]: I0316 16:09:07.516177 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="057b7da4-d510-491e-bde1-76e1d4e427ff" containerName="extract-utilities" Mar 16 16:09:07 crc kubenswrapper[5120]: I0316 16:09:07.516184 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="057b7da4-d510-491e-bde1-76e1d4e427ff" containerName="extract-utilities" Mar 16 16:09:07 crc kubenswrapper[5120]: I0316 16:09:07.516193 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="057b7da4-d510-491e-bde1-76e1d4e427ff" containerName="extract-content" Mar 16 16:09:07 crc kubenswrapper[5120]: I0316 16:09:07.516200 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="057b7da4-d510-491e-bde1-76e1d4e427ff" containerName="extract-content" Mar 16 16:09:07 crc kubenswrapper[5120]: I0316 16:09:07.516447 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="9f77fc46-483c-462c-b8ce-75b212e3e2f0" containerName="registry-server" Mar 16 16:09:07 crc kubenswrapper[5120]: I0316 16:09:07.516459 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="057b7da4-d510-491e-bde1-76e1d4e427ff" containerName="registry-server" Mar 16 16:09:07 crc kubenswrapper[5120]: I0316 16:09:07.516467 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c5593ae2-7a56-4d09-8f88-a54b43c2be0c" containerName="glance-httpd" Mar 16 16:09:07 crc kubenswrapper[5120]: I0316 16:09:07.516480 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c5593ae2-7a56-4d09-8f88-a54b43c2be0c" containerName="glance-log" Mar 16 16:09:07 crc kubenswrapper[5120]: I0316 16:09:07.530212 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:09:07 crc kubenswrapper[5120]: I0316 16:09:07.533744 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-internal-config-data\"" Mar 16 16:09:07 crc kubenswrapper[5120]: I0316 16:09:07.540021 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-internal-svc\"" Mar 16 16:09:07 crc kubenswrapper[5120]: I0316 16:09:07.580736 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/d7cb016a-477e-4e1d-9cea-b3308c3821ad-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"d7cb016a-477e-4e1d-9cea-b3308c3821ad\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:09:07 crc kubenswrapper[5120]: I0316 16:09:07.580851 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87bbn\" (UniqueName: \"kubernetes.io/projected/d7cb016a-477e-4e1d-9cea-b3308c3821ad-kube-api-access-87bbn\") pod \"glance-default-internal-api-0\" (UID: \"d7cb016a-477e-4e1d-9cea-b3308c3821ad\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:09:07 crc kubenswrapper[5120]: I0316 16:09:07.580926 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d7cb016a-477e-4e1d-9cea-b3308c3821ad-config-data\") pod \"glance-default-internal-api-0\" (UID: \"d7cb016a-477e-4e1d-9cea-b3308c3821ad\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:09:07 crc kubenswrapper[5120]: I0316 16:09:07.580947 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d7cb016a-477e-4e1d-9cea-b3308c3821ad-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"d7cb016a-477e-4e1d-9cea-b3308c3821ad\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:09:07 crc kubenswrapper[5120]: I0316 16:09:07.580965 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d7cb016a-477e-4e1d-9cea-b3308c3821ad-logs\") pod \"glance-default-internal-api-0\" (UID: \"d7cb016a-477e-4e1d-9cea-b3308c3821ad\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:09:07 crc kubenswrapper[5120]: I0316 16:09:07.580995 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d7cb016a-477e-4e1d-9cea-b3308c3821ad-scripts\") pod \"glance-default-internal-api-0\" (UID: \"d7cb016a-477e-4e1d-9cea-b3308c3821ad\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:09:07 crc kubenswrapper[5120]: I0316 16:09:07.581019 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/d7cb016a-477e-4e1d-9cea-b3308c3821ad-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"d7cb016a-477e-4e1d-9cea-b3308c3821ad\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:09:07 crc kubenswrapper[5120]: I0316 16:09:07.581084 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") pod \"glance-default-internal-api-0\" (UID: \"d7cb016a-477e-4e1d-9cea-b3308c3821ad\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:09:07 crc kubenswrapper[5120]: I0316 16:09:07.582730 5120 scope.go:117] "RemoveContainer" containerID="16cfa2634d38d4f0aac174cea17bf8487cb7107a948e6c49443a719a68fd92b4" Mar 16 16:09:07 crc kubenswrapper[5120]: I0316 16:09:07.582969 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:09:07 crc kubenswrapper[5120]: E0316 16:09:07.584991 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"16cfa2634d38d4f0aac174cea17bf8487cb7107a948e6c49443a719a68fd92b4\": container with ID starting with 16cfa2634d38d4f0aac174cea17bf8487cb7107a948e6c49443a719a68fd92b4 not found: ID does not exist" containerID="16cfa2634d38d4f0aac174cea17bf8487cb7107a948e6c49443a719a68fd92b4" Mar 16 16:09:07 crc kubenswrapper[5120]: I0316 16:09:07.585036 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16cfa2634d38d4f0aac174cea17bf8487cb7107a948e6c49443a719a68fd92b4"} err="failed to get container status \"16cfa2634d38d4f0aac174cea17bf8487cb7107a948e6c49443a719a68fd92b4\": rpc error: code = NotFound desc = could not find container \"16cfa2634d38d4f0aac174cea17bf8487cb7107a948e6c49443a719a68fd92b4\": container with ID starting with 16cfa2634d38d4f0aac174cea17bf8487cb7107a948e6c49443a719a68fd92b4 not found: ID does not exist" Mar 16 16:09:07 crc kubenswrapper[5120]: I0316 16:09:07.585064 5120 scope.go:117] "RemoveContainer" containerID="047eec0013cada9bc1768aac8af82d95870075ec52f3cdcb2d119a77a1b49356" Mar 16 16:09:07 crc kubenswrapper[5120]: E0316 16:09:07.588695 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"047eec0013cada9bc1768aac8af82d95870075ec52f3cdcb2d119a77a1b49356\": container with ID starting with 047eec0013cada9bc1768aac8af82d95870075ec52f3cdcb2d119a77a1b49356 not found: ID does not exist" containerID="047eec0013cada9bc1768aac8af82d95870075ec52f3cdcb2d119a77a1b49356" Mar 16 16:09:07 crc kubenswrapper[5120]: I0316 16:09:07.588732 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"047eec0013cada9bc1768aac8af82d95870075ec52f3cdcb2d119a77a1b49356"} err="failed to get container status \"047eec0013cada9bc1768aac8af82d95870075ec52f3cdcb2d119a77a1b49356\": rpc error: code = NotFound desc = could not find container \"047eec0013cada9bc1768aac8af82d95870075ec52f3cdcb2d119a77a1b49356\": container with ID starting with 047eec0013cada9bc1768aac8af82d95870075ec52f3cdcb2d119a77a1b49356 not found: ID does not exist" Mar 16 16:09:07 crc kubenswrapper[5120]: I0316 16:09:07.682557 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-87bbn\" (UniqueName: \"kubernetes.io/projected/d7cb016a-477e-4e1d-9cea-b3308c3821ad-kube-api-access-87bbn\") pod \"glance-default-internal-api-0\" (UID: \"d7cb016a-477e-4e1d-9cea-b3308c3821ad\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:09:07 crc kubenswrapper[5120]: I0316 16:09:07.682659 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d7cb016a-477e-4e1d-9cea-b3308c3821ad-config-data\") pod \"glance-default-internal-api-0\" (UID: \"d7cb016a-477e-4e1d-9cea-b3308c3821ad\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:09:07 crc kubenswrapper[5120]: I0316 16:09:07.682679 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d7cb016a-477e-4e1d-9cea-b3308c3821ad-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"d7cb016a-477e-4e1d-9cea-b3308c3821ad\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:09:07 crc kubenswrapper[5120]: I0316 16:09:07.682695 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d7cb016a-477e-4e1d-9cea-b3308c3821ad-logs\") pod \"glance-default-internal-api-0\" (UID: \"d7cb016a-477e-4e1d-9cea-b3308c3821ad\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:09:07 crc kubenswrapper[5120]: I0316 16:09:07.682728 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d7cb016a-477e-4e1d-9cea-b3308c3821ad-scripts\") pod \"glance-default-internal-api-0\" (UID: \"d7cb016a-477e-4e1d-9cea-b3308c3821ad\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:09:07 crc kubenswrapper[5120]: I0316 16:09:07.682824 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/d7cb016a-477e-4e1d-9cea-b3308c3821ad-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"d7cb016a-477e-4e1d-9cea-b3308c3821ad\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:09:07 crc kubenswrapper[5120]: I0316 16:09:07.682891 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") pod \"glance-default-internal-api-0\" (UID: \"d7cb016a-477e-4e1d-9cea-b3308c3821ad\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:09:07 crc kubenswrapper[5120]: I0316 16:09:07.682954 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/d7cb016a-477e-4e1d-9cea-b3308c3821ad-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"d7cb016a-477e-4e1d-9cea-b3308c3821ad\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:09:07 crc kubenswrapper[5120]: I0316 16:09:07.683967 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") pod \"glance-default-internal-api-0\" (UID: \"d7cb016a-477e-4e1d-9cea-b3308c3821ad\") device mount path \"/mnt/openstack/pv14\"" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:09:07 crc kubenswrapper[5120]: I0316 16:09:07.684564 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d7cb016a-477e-4e1d-9cea-b3308c3821ad-logs\") pod \"glance-default-internal-api-0\" (UID: \"d7cb016a-477e-4e1d-9cea-b3308c3821ad\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:09:07 crc kubenswrapper[5120]: I0316 16:09:07.688038 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/d7cb016a-477e-4e1d-9cea-b3308c3821ad-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"d7cb016a-477e-4e1d-9cea-b3308c3821ad\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:09:07 crc kubenswrapper[5120]: I0316 16:09:07.688524 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d7cb016a-477e-4e1d-9cea-b3308c3821ad-scripts\") pod \"glance-default-internal-api-0\" (UID: \"d7cb016a-477e-4e1d-9cea-b3308c3821ad\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:09:07 crc kubenswrapper[5120]: I0316 16:09:07.688712 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/d7cb016a-477e-4e1d-9cea-b3308c3821ad-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"d7cb016a-477e-4e1d-9cea-b3308c3821ad\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:09:07 crc kubenswrapper[5120]: I0316 16:09:07.689353 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d7cb016a-477e-4e1d-9cea-b3308c3821ad-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"d7cb016a-477e-4e1d-9cea-b3308c3821ad\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:09:07 crc kubenswrapper[5120]: I0316 16:09:07.699196 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-87bbn\" (UniqueName: \"kubernetes.io/projected/d7cb016a-477e-4e1d-9cea-b3308c3821ad-kube-api-access-87bbn\") pod \"glance-default-internal-api-0\" (UID: \"d7cb016a-477e-4e1d-9cea-b3308c3821ad\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:09:07 crc kubenswrapper[5120]: I0316 16:09:07.705319 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d7cb016a-477e-4e1d-9cea-b3308c3821ad-config-data\") pod \"glance-default-internal-api-0\" (UID: \"d7cb016a-477e-4e1d-9cea-b3308c3821ad\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:09:07 crc kubenswrapper[5120]: I0316 16:09:07.725527 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") pod \"glance-default-internal-api-0\" (UID: \"d7cb016a-477e-4e1d-9cea-b3308c3821ad\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:09:07 crc kubenswrapper[5120]: I0316 16:09:07.925967 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:09:08 crc kubenswrapper[5120]: I0316 16:09:08.414258 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:09:08 crc kubenswrapper[5120]: I0316 16:09:08.482316 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"70cb8e52-8e41-40dd-9988-d9aef87fadd6","Type":"ContainerStarted","Data":"af2ce2874b2f1d01dd56d1c2b54cf07657cd9a5a00b4da8859b79d3b71d3c3db"} Mar 16 16:09:08 crc kubenswrapper[5120]: I0316 16:09:08.494195 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"edab59f1-ba45-44c9-ace6-b54ab84f1f62","Type":"ContainerStarted","Data":"e6ee9dfced1a84454826499cb495e9f46ded5b57f7de975114641b9799ebd95d"} Mar 16 16:09:08 crc kubenswrapper[5120]: I0316 16:09:08.494238 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"edab59f1-ba45-44c9-ace6-b54ab84f1f62","Type":"ContainerStarted","Data":"1c5ab1274a2bf4758d8e21e842c18283f1eea05778b887701a9aa3edeac3879b"} Mar 16 16:09:08 crc kubenswrapper[5120]: I0316 16:09:08.497111 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"d7cb016a-477e-4e1d-9cea-b3308c3821ad","Type":"ContainerStarted","Data":"102a96ea1120a8adec6103d741452f29af4b77bd0a0a51d171ab930a97632f2c"} Mar 16 16:09:08 crc kubenswrapper[5120]: I0316 16:09:08.515274 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-external-api-0" podStartSLOduration=4.515251999 podStartE2EDuration="4.515251999s" podCreationTimestamp="2026-03-16 16:09:04 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:09:08.504005752 +0000 UTC m=+2250.657937409" watchObservedRunningTime="2026-03-16 16:09:08.515251999 +0000 UTC m=+2250.669183656" Mar 16 16:09:08 crc kubenswrapper[5120]: E0316 16:09:08.648386 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1684338 actualBytes=10240 Mar 16 16:09:08 crc kubenswrapper[5120]: I0316 16:09:08.682155 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c5593ae2-7a56-4d09-8f88-a54b43c2be0c" path="/var/lib/kubelet/pods/c5593ae2-7a56-4d09-8f88-a54b43c2be0c/volumes" Mar 16 16:09:09 crc kubenswrapper[5120]: I0316 16:09:09.512474 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"d7cb016a-477e-4e1d-9cea-b3308c3821ad","Type":"ContainerStarted","Data":"4dc7ce8bb329cfeb8f8033e6f81228b46afd17e26b66c1812301a3a2252a4437"} Mar 16 16:09:09 crc kubenswrapper[5120]: I0316 16:09:09.521079 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"edab59f1-ba45-44c9-ace6-b54ab84f1f62","Type":"ContainerStarted","Data":"7cf51fb5d8dea78ff30e09e4560afa5a8e8341b0240db99db5ac693f703cc8aa"} Mar 16 16:09:10 crc kubenswrapper[5120]: I0316 16:09:10.542940 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"d7cb016a-477e-4e1d-9cea-b3308c3821ad","Type":"ContainerStarted","Data":"0cfd497da29acd1fc4546472dd55ced91b08bd116de4265889cd689922d77e6a"} Mar 16 16:09:10 crc kubenswrapper[5120]: I0316 16:09:10.572954 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-internal-api-0" podStartSLOduration=3.572935744 podStartE2EDuration="3.572935744s" podCreationTimestamp="2026-03-16 16:09:07 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:09:10.561747529 +0000 UTC m=+2252.715679186" watchObservedRunningTime="2026-03-16 16:09:10.572935744 +0000 UTC m=+2252.726867391" Mar 16 16:09:11 crc kubenswrapper[5120]: I0316 16:09:11.577375 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="edab59f1-ba45-44c9-ace6-b54ab84f1f62" containerName="ceilometer-central-agent" containerID="cri-o://e6ee9dfced1a84454826499cb495e9f46ded5b57f7de975114641b9799ebd95d" gracePeriod=30 Mar 16 16:09:11 crc kubenswrapper[5120]: I0316 16:09:11.577619 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"edab59f1-ba45-44c9-ace6-b54ab84f1f62","Type":"ContainerStarted","Data":"ea140255d5475f2a35004006a6ced7cafbc3643fd219764f617fd7ba6ddd06fa"} Mar 16 16:09:11 crc kubenswrapper[5120]: I0316 16:09:11.577881 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="edab59f1-ba45-44c9-ace6-b54ab84f1f62" containerName="proxy-httpd" containerID="cri-o://ea140255d5475f2a35004006a6ced7cafbc3643fd219764f617fd7ba6ddd06fa" gracePeriod=30 Mar 16 16:09:11 crc kubenswrapper[5120]: I0316 16:09:11.578014 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="edab59f1-ba45-44c9-ace6-b54ab84f1f62" containerName="ceilometer-notification-agent" containerID="cri-o://1c5ab1274a2bf4758d8e21e842c18283f1eea05778b887701a9aa3edeac3879b" gracePeriod=30 Mar 16 16:09:11 crc kubenswrapper[5120]: I0316 16:09:11.578086 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="edab59f1-ba45-44c9-ace6-b54ab84f1f62" containerName="sg-core" containerID="cri-o://7cf51fb5d8dea78ff30e09e4560afa5a8e8341b0240db99db5ac693f703cc8aa" gracePeriod=30 Mar 16 16:09:11 crc kubenswrapper[5120]: I0316 16:09:11.578190 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:09:11 crc kubenswrapper[5120]: I0316 16:09:11.618431 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.594246899 podStartE2EDuration="6.6184083s" podCreationTimestamp="2026-03-16 16:09:05 +0000 UTC" firstStartedPulling="2026-03-16 16:09:06.496085905 +0000 UTC m=+2248.650017562" lastFinishedPulling="2026-03-16 16:09:10.520247296 +0000 UTC m=+2252.674178963" observedRunningTime="2026-03-16 16:09:11.614062091 +0000 UTC m=+2253.767993758" watchObservedRunningTime="2026-03-16 16:09:11.6184083 +0000 UTC m=+2253.772339957" Mar 16 16:09:12 crc kubenswrapper[5120]: E0316 16:09:12.113042 5120 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podedab59f1_ba45_44c9_ace6_b54ab84f1f62.slice/crio-1c5ab1274a2bf4758d8e21e842c18283f1eea05778b887701a9aa3edeac3879b.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podedab59f1_ba45_44c9_ace6_b54ab84f1f62.slice/crio-conmon-1c5ab1274a2bf4758d8e21e842c18283f1eea05778b887701a9aa3edeac3879b.scope\": RecentStats: unable to find data in memory cache]" Mar 16 16:09:12 crc kubenswrapper[5120]: I0316 16:09:12.338363 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:09:12 crc kubenswrapper[5120]: I0316 16:09:12.400536 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/edab59f1-ba45-44c9-ace6-b54ab84f1f62-scripts\") pod \"edab59f1-ba45-44c9-ace6-b54ab84f1f62\" (UID: \"edab59f1-ba45-44c9-ace6-b54ab84f1f62\") " Mar 16 16:09:12 crc kubenswrapper[5120]: I0316 16:09:12.400638 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/edab59f1-ba45-44c9-ace6-b54ab84f1f62-log-httpd\") pod \"edab59f1-ba45-44c9-ace6-b54ab84f1f62\" (UID: \"edab59f1-ba45-44c9-ace6-b54ab84f1f62\") " Mar 16 16:09:12 crc kubenswrapper[5120]: I0316 16:09:12.400689 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/edab59f1-ba45-44c9-ace6-b54ab84f1f62-sg-core-conf-yaml\") pod \"edab59f1-ba45-44c9-ace6-b54ab84f1f62\" (UID: \"edab59f1-ba45-44c9-ace6-b54ab84f1f62\") " Mar 16 16:09:12 crc kubenswrapper[5120]: I0316 16:09:12.400848 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/edab59f1-ba45-44c9-ace6-b54ab84f1f62-run-httpd\") pod \"edab59f1-ba45-44c9-ace6-b54ab84f1f62\" (UID: \"edab59f1-ba45-44c9-ace6-b54ab84f1f62\") " Mar 16 16:09:12 crc kubenswrapper[5120]: I0316 16:09:12.400902 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cgt6n\" (UniqueName: \"kubernetes.io/projected/edab59f1-ba45-44c9-ace6-b54ab84f1f62-kube-api-access-cgt6n\") pod \"edab59f1-ba45-44c9-ace6-b54ab84f1f62\" (UID: \"edab59f1-ba45-44c9-ace6-b54ab84f1f62\") " Mar 16 16:09:12 crc kubenswrapper[5120]: I0316 16:09:12.400942 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/edab59f1-ba45-44c9-ace6-b54ab84f1f62-combined-ca-bundle\") pod \"edab59f1-ba45-44c9-ace6-b54ab84f1f62\" (UID: \"edab59f1-ba45-44c9-ace6-b54ab84f1f62\") " Mar 16 16:09:12 crc kubenswrapper[5120]: I0316 16:09:12.401060 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/edab59f1-ba45-44c9-ace6-b54ab84f1f62-config-data\") pod \"edab59f1-ba45-44c9-ace6-b54ab84f1f62\" (UID: \"edab59f1-ba45-44c9-ace6-b54ab84f1f62\") " Mar 16 16:09:12 crc kubenswrapper[5120]: I0316 16:09:12.403441 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/edab59f1-ba45-44c9-ace6-b54ab84f1f62-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "edab59f1-ba45-44c9-ace6-b54ab84f1f62" (UID: "edab59f1-ba45-44c9-ace6-b54ab84f1f62"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:09:12 crc kubenswrapper[5120]: I0316 16:09:12.404698 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/edab59f1-ba45-44c9-ace6-b54ab84f1f62-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "edab59f1-ba45-44c9-ace6-b54ab84f1f62" (UID: "edab59f1-ba45-44c9-ace6-b54ab84f1f62"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:09:12 crc kubenswrapper[5120]: I0316 16:09:12.408198 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/edab59f1-ba45-44c9-ace6-b54ab84f1f62-kube-api-access-cgt6n" (OuterVolumeSpecName: "kube-api-access-cgt6n") pod "edab59f1-ba45-44c9-ace6-b54ab84f1f62" (UID: "edab59f1-ba45-44c9-ace6-b54ab84f1f62"). InnerVolumeSpecName "kube-api-access-cgt6n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:09:12 crc kubenswrapper[5120]: I0316 16:09:12.408233 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/edab59f1-ba45-44c9-ace6-b54ab84f1f62-scripts" (OuterVolumeSpecName: "scripts") pod "edab59f1-ba45-44c9-ace6-b54ab84f1f62" (UID: "edab59f1-ba45-44c9-ace6-b54ab84f1f62"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:09:12 crc kubenswrapper[5120]: I0316 16:09:12.437662 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/edab59f1-ba45-44c9-ace6-b54ab84f1f62-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "edab59f1-ba45-44c9-ace6-b54ab84f1f62" (UID: "edab59f1-ba45-44c9-ace6-b54ab84f1f62"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:09:12 crc kubenswrapper[5120]: I0316 16:09:12.493939 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/edab59f1-ba45-44c9-ace6-b54ab84f1f62-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "edab59f1-ba45-44c9-ace6-b54ab84f1f62" (UID: "edab59f1-ba45-44c9-ace6-b54ab84f1f62"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:09:12 crc kubenswrapper[5120]: I0316 16:09:12.503695 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/edab59f1-ba45-44c9-ace6-b54ab84f1f62-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:09:12 crc kubenswrapper[5120]: I0316 16:09:12.503740 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/edab59f1-ba45-44c9-ace6-b54ab84f1f62-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:09:12 crc kubenswrapper[5120]: I0316 16:09:12.503753 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/edab59f1-ba45-44c9-ace6-b54ab84f1f62-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:09:12 crc kubenswrapper[5120]: I0316 16:09:12.503785 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/edab59f1-ba45-44c9-ace6-b54ab84f1f62-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 16:09:12 crc kubenswrapper[5120]: I0316 16:09:12.503798 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/edab59f1-ba45-44c9-ace6-b54ab84f1f62-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:09:12 crc kubenswrapper[5120]: I0316 16:09:12.503812 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cgt6n\" (UniqueName: \"kubernetes.io/projected/edab59f1-ba45-44c9-ace6-b54ab84f1f62-kube-api-access-cgt6n\") on node \"crc\" DevicePath \"\"" Mar 16 16:09:12 crc kubenswrapper[5120]: I0316 16:09:12.519394 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/edab59f1-ba45-44c9-ace6-b54ab84f1f62-config-data" (OuterVolumeSpecName: "config-data") pod "edab59f1-ba45-44c9-ace6-b54ab84f1f62" (UID: "edab59f1-ba45-44c9-ace6-b54ab84f1f62"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:09:12 crc kubenswrapper[5120]: I0316 16:09:12.598951 5120 generic.go:358] "Generic (PLEG): container finished" podID="edab59f1-ba45-44c9-ace6-b54ab84f1f62" containerID="ea140255d5475f2a35004006a6ced7cafbc3643fd219764f617fd7ba6ddd06fa" exitCode=0 Mar 16 16:09:12 crc kubenswrapper[5120]: I0316 16:09:12.598994 5120 generic.go:358] "Generic (PLEG): container finished" podID="edab59f1-ba45-44c9-ace6-b54ab84f1f62" containerID="7cf51fb5d8dea78ff30e09e4560afa5a8e8341b0240db99db5ac693f703cc8aa" exitCode=2 Mar 16 16:09:12 crc kubenswrapper[5120]: I0316 16:09:12.599010 5120 generic.go:358] "Generic (PLEG): container finished" podID="edab59f1-ba45-44c9-ace6-b54ab84f1f62" containerID="1c5ab1274a2bf4758d8e21e842c18283f1eea05778b887701a9aa3edeac3879b" exitCode=0 Mar 16 16:09:12 crc kubenswrapper[5120]: I0316 16:09:12.599023 5120 generic.go:358] "Generic (PLEG): container finished" podID="edab59f1-ba45-44c9-ace6-b54ab84f1f62" containerID="e6ee9dfced1a84454826499cb495e9f46ded5b57f7de975114641b9799ebd95d" exitCode=0 Mar 16 16:09:12 crc kubenswrapper[5120]: I0316 16:09:12.599135 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:09:12 crc kubenswrapper[5120]: I0316 16:09:12.599270 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"edab59f1-ba45-44c9-ace6-b54ab84f1f62","Type":"ContainerDied","Data":"ea140255d5475f2a35004006a6ced7cafbc3643fd219764f617fd7ba6ddd06fa"} Mar 16 16:09:12 crc kubenswrapper[5120]: I0316 16:09:12.599335 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"edab59f1-ba45-44c9-ace6-b54ab84f1f62","Type":"ContainerDied","Data":"7cf51fb5d8dea78ff30e09e4560afa5a8e8341b0240db99db5ac693f703cc8aa"} Mar 16 16:09:12 crc kubenswrapper[5120]: I0316 16:09:12.599360 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"edab59f1-ba45-44c9-ace6-b54ab84f1f62","Type":"ContainerDied","Data":"1c5ab1274a2bf4758d8e21e842c18283f1eea05778b887701a9aa3edeac3879b"} Mar 16 16:09:12 crc kubenswrapper[5120]: I0316 16:09:12.599381 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"edab59f1-ba45-44c9-ace6-b54ab84f1f62","Type":"ContainerDied","Data":"e6ee9dfced1a84454826499cb495e9f46ded5b57f7de975114641b9799ebd95d"} Mar 16 16:09:12 crc kubenswrapper[5120]: I0316 16:09:12.599399 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"edab59f1-ba45-44c9-ace6-b54ab84f1f62","Type":"ContainerDied","Data":"253b460b089efc249fb6f6e8acf5eb5c4fbc29a7bad7b8fff5cd3fa26271772a"} Mar 16 16:09:12 crc kubenswrapper[5120]: I0316 16:09:12.599426 5120 scope.go:117] "RemoveContainer" containerID="ea140255d5475f2a35004006a6ced7cafbc3643fd219764f617fd7ba6ddd06fa" Mar 16 16:09:12 crc kubenswrapper[5120]: I0316 16:09:12.607036 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/edab59f1-ba45-44c9-ace6-b54ab84f1f62-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:09:12 crc kubenswrapper[5120]: I0316 16:09:12.636259 5120 scope.go:117] "RemoveContainer" containerID="7cf51fb5d8dea78ff30e09e4560afa5a8e8341b0240db99db5ac693f703cc8aa" Mar 16 16:09:12 crc kubenswrapper[5120]: I0316 16:09:12.653551 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:09:12 crc kubenswrapper[5120]: I0316 16:09:12.656507 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/placement-595564474-m6lrq" Mar 16 16:09:12 crc kubenswrapper[5120]: I0316 16:09:12.680378 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:09:12 crc kubenswrapper[5120]: I0316 16:09:12.680395 5120 scope.go:117] "RemoveContainer" containerID="1c5ab1274a2bf4758d8e21e842c18283f1eea05778b887701a9aa3edeac3879b" Mar 16 16:09:12 crc kubenswrapper[5120]: I0316 16:09:12.694334 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:09:12 crc kubenswrapper[5120]: I0316 16:09:12.695616 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="edab59f1-ba45-44c9-ace6-b54ab84f1f62" containerName="ceilometer-central-agent" Mar 16 16:09:12 crc kubenswrapper[5120]: I0316 16:09:12.695639 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="edab59f1-ba45-44c9-ace6-b54ab84f1f62" containerName="ceilometer-central-agent" Mar 16 16:09:12 crc kubenswrapper[5120]: I0316 16:09:12.695673 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="edab59f1-ba45-44c9-ace6-b54ab84f1f62" containerName="ceilometer-notification-agent" Mar 16 16:09:12 crc kubenswrapper[5120]: I0316 16:09:12.695683 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="edab59f1-ba45-44c9-ace6-b54ab84f1f62" containerName="ceilometer-notification-agent" Mar 16 16:09:12 crc kubenswrapper[5120]: I0316 16:09:12.695744 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="edab59f1-ba45-44c9-ace6-b54ab84f1f62" containerName="sg-core" Mar 16 16:09:12 crc kubenswrapper[5120]: I0316 16:09:12.695753 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="edab59f1-ba45-44c9-ace6-b54ab84f1f62" containerName="sg-core" Mar 16 16:09:12 crc kubenswrapper[5120]: I0316 16:09:12.695784 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="edab59f1-ba45-44c9-ace6-b54ab84f1f62" containerName="proxy-httpd" Mar 16 16:09:12 crc kubenswrapper[5120]: I0316 16:09:12.695790 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="edab59f1-ba45-44c9-ace6-b54ab84f1f62" containerName="proxy-httpd" Mar 16 16:09:12 crc kubenswrapper[5120]: I0316 16:09:12.695986 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="edab59f1-ba45-44c9-ace6-b54ab84f1f62" containerName="ceilometer-central-agent" Mar 16 16:09:12 crc kubenswrapper[5120]: I0316 16:09:12.696003 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="edab59f1-ba45-44c9-ace6-b54ab84f1f62" containerName="sg-core" Mar 16 16:09:12 crc kubenswrapper[5120]: I0316 16:09:12.696017 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="edab59f1-ba45-44c9-ace6-b54ab84f1f62" containerName="ceilometer-notification-agent" Mar 16 16:09:12 crc kubenswrapper[5120]: I0316 16:09:12.696029 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="edab59f1-ba45-44c9-ace6-b54ab84f1f62" containerName="proxy-httpd" Mar 16 16:09:12 crc kubenswrapper[5120]: I0316 16:09:12.703178 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:09:12 crc kubenswrapper[5120]: I0316 16:09:12.710717 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 16:09:12 crc kubenswrapper[5120]: I0316 16:09:12.710818 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 16:09:12 crc kubenswrapper[5120]: I0316 16:09:12.727372 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:09:12 crc kubenswrapper[5120]: I0316 16:09:12.769795 5120 scope.go:117] "RemoveContainer" containerID="e6ee9dfced1a84454826499cb495e9f46ded5b57f7de975114641b9799ebd95d" Mar 16 16:09:12 crc kubenswrapper[5120]: I0316 16:09:12.792208 5120 scope.go:117] "RemoveContainer" containerID="ea140255d5475f2a35004006a6ced7cafbc3643fd219764f617fd7ba6ddd06fa" Mar 16 16:09:12 crc kubenswrapper[5120]: E0316 16:09:12.792803 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea140255d5475f2a35004006a6ced7cafbc3643fd219764f617fd7ba6ddd06fa\": container with ID starting with ea140255d5475f2a35004006a6ced7cafbc3643fd219764f617fd7ba6ddd06fa not found: ID does not exist" containerID="ea140255d5475f2a35004006a6ced7cafbc3643fd219764f617fd7ba6ddd06fa" Mar 16 16:09:12 crc kubenswrapper[5120]: I0316 16:09:12.792849 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea140255d5475f2a35004006a6ced7cafbc3643fd219764f617fd7ba6ddd06fa"} err="failed to get container status \"ea140255d5475f2a35004006a6ced7cafbc3643fd219764f617fd7ba6ddd06fa\": rpc error: code = NotFound desc = could not find container \"ea140255d5475f2a35004006a6ced7cafbc3643fd219764f617fd7ba6ddd06fa\": container with ID starting with ea140255d5475f2a35004006a6ced7cafbc3643fd219764f617fd7ba6ddd06fa not found: ID does not exist" Mar 16 16:09:12 crc kubenswrapper[5120]: I0316 16:09:12.792873 5120 scope.go:117] "RemoveContainer" containerID="7cf51fb5d8dea78ff30e09e4560afa5a8e8341b0240db99db5ac693f703cc8aa" Mar 16 16:09:12 crc kubenswrapper[5120]: E0316 16:09:12.793414 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7cf51fb5d8dea78ff30e09e4560afa5a8e8341b0240db99db5ac693f703cc8aa\": container with ID starting with 7cf51fb5d8dea78ff30e09e4560afa5a8e8341b0240db99db5ac693f703cc8aa not found: ID does not exist" containerID="7cf51fb5d8dea78ff30e09e4560afa5a8e8341b0240db99db5ac693f703cc8aa" Mar 16 16:09:12 crc kubenswrapper[5120]: I0316 16:09:12.793451 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7cf51fb5d8dea78ff30e09e4560afa5a8e8341b0240db99db5ac693f703cc8aa"} err="failed to get container status \"7cf51fb5d8dea78ff30e09e4560afa5a8e8341b0240db99db5ac693f703cc8aa\": rpc error: code = NotFound desc = could not find container \"7cf51fb5d8dea78ff30e09e4560afa5a8e8341b0240db99db5ac693f703cc8aa\": container with ID starting with 7cf51fb5d8dea78ff30e09e4560afa5a8e8341b0240db99db5ac693f703cc8aa not found: ID does not exist" Mar 16 16:09:12 crc kubenswrapper[5120]: I0316 16:09:12.793515 5120 scope.go:117] "RemoveContainer" containerID="1c5ab1274a2bf4758d8e21e842c18283f1eea05778b887701a9aa3edeac3879b" Mar 16 16:09:12 crc kubenswrapper[5120]: E0316 16:09:12.793850 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c5ab1274a2bf4758d8e21e842c18283f1eea05778b887701a9aa3edeac3879b\": container with ID starting with 1c5ab1274a2bf4758d8e21e842c18283f1eea05778b887701a9aa3edeac3879b not found: ID does not exist" containerID="1c5ab1274a2bf4758d8e21e842c18283f1eea05778b887701a9aa3edeac3879b" Mar 16 16:09:12 crc kubenswrapper[5120]: I0316 16:09:12.793870 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c5ab1274a2bf4758d8e21e842c18283f1eea05778b887701a9aa3edeac3879b"} err="failed to get container status \"1c5ab1274a2bf4758d8e21e842c18283f1eea05778b887701a9aa3edeac3879b\": rpc error: code = NotFound desc = could not find container \"1c5ab1274a2bf4758d8e21e842c18283f1eea05778b887701a9aa3edeac3879b\": container with ID starting with 1c5ab1274a2bf4758d8e21e842c18283f1eea05778b887701a9aa3edeac3879b not found: ID does not exist" Mar 16 16:09:12 crc kubenswrapper[5120]: I0316 16:09:12.793881 5120 scope.go:117] "RemoveContainer" containerID="e6ee9dfced1a84454826499cb495e9f46ded5b57f7de975114641b9799ebd95d" Mar 16 16:09:12 crc kubenswrapper[5120]: E0316 16:09:12.794487 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e6ee9dfced1a84454826499cb495e9f46ded5b57f7de975114641b9799ebd95d\": container with ID starting with e6ee9dfced1a84454826499cb495e9f46ded5b57f7de975114641b9799ebd95d not found: ID does not exist" containerID="e6ee9dfced1a84454826499cb495e9f46ded5b57f7de975114641b9799ebd95d" Mar 16 16:09:12 crc kubenswrapper[5120]: I0316 16:09:12.794535 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6ee9dfced1a84454826499cb495e9f46ded5b57f7de975114641b9799ebd95d"} err="failed to get container status \"e6ee9dfced1a84454826499cb495e9f46ded5b57f7de975114641b9799ebd95d\": rpc error: code = NotFound desc = could not find container \"e6ee9dfced1a84454826499cb495e9f46ded5b57f7de975114641b9799ebd95d\": container with ID starting with e6ee9dfced1a84454826499cb495e9f46ded5b57f7de975114641b9799ebd95d not found: ID does not exist" Mar 16 16:09:12 crc kubenswrapper[5120]: I0316 16:09:12.794548 5120 scope.go:117] "RemoveContainer" containerID="ea140255d5475f2a35004006a6ced7cafbc3643fd219764f617fd7ba6ddd06fa" Mar 16 16:09:12 crc kubenswrapper[5120]: I0316 16:09:12.794884 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea140255d5475f2a35004006a6ced7cafbc3643fd219764f617fd7ba6ddd06fa"} err="failed to get container status \"ea140255d5475f2a35004006a6ced7cafbc3643fd219764f617fd7ba6ddd06fa\": rpc error: code = NotFound desc = could not find container \"ea140255d5475f2a35004006a6ced7cafbc3643fd219764f617fd7ba6ddd06fa\": container with ID starting with ea140255d5475f2a35004006a6ced7cafbc3643fd219764f617fd7ba6ddd06fa not found: ID does not exist" Mar 16 16:09:12 crc kubenswrapper[5120]: I0316 16:09:12.794922 5120 scope.go:117] "RemoveContainer" containerID="7cf51fb5d8dea78ff30e09e4560afa5a8e8341b0240db99db5ac693f703cc8aa" Mar 16 16:09:12 crc kubenswrapper[5120]: I0316 16:09:12.795603 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7cf51fb5d8dea78ff30e09e4560afa5a8e8341b0240db99db5ac693f703cc8aa"} err="failed to get container status \"7cf51fb5d8dea78ff30e09e4560afa5a8e8341b0240db99db5ac693f703cc8aa\": rpc error: code = NotFound desc = could not find container \"7cf51fb5d8dea78ff30e09e4560afa5a8e8341b0240db99db5ac693f703cc8aa\": container with ID starting with 7cf51fb5d8dea78ff30e09e4560afa5a8e8341b0240db99db5ac693f703cc8aa not found: ID does not exist" Mar 16 16:09:12 crc kubenswrapper[5120]: I0316 16:09:12.795628 5120 scope.go:117] "RemoveContainer" containerID="1c5ab1274a2bf4758d8e21e842c18283f1eea05778b887701a9aa3edeac3879b" Mar 16 16:09:12 crc kubenswrapper[5120]: I0316 16:09:12.795891 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c5ab1274a2bf4758d8e21e842c18283f1eea05778b887701a9aa3edeac3879b"} err="failed to get container status \"1c5ab1274a2bf4758d8e21e842c18283f1eea05778b887701a9aa3edeac3879b\": rpc error: code = NotFound desc = could not find container \"1c5ab1274a2bf4758d8e21e842c18283f1eea05778b887701a9aa3edeac3879b\": container with ID starting with 1c5ab1274a2bf4758d8e21e842c18283f1eea05778b887701a9aa3edeac3879b not found: ID does not exist" Mar 16 16:09:12 crc kubenswrapper[5120]: I0316 16:09:12.795909 5120 scope.go:117] "RemoveContainer" containerID="e6ee9dfced1a84454826499cb495e9f46ded5b57f7de975114641b9799ebd95d" Mar 16 16:09:12 crc kubenswrapper[5120]: I0316 16:09:12.796182 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6ee9dfced1a84454826499cb495e9f46ded5b57f7de975114641b9799ebd95d"} err="failed to get container status \"e6ee9dfced1a84454826499cb495e9f46ded5b57f7de975114641b9799ebd95d\": rpc error: code = NotFound desc = could not find container \"e6ee9dfced1a84454826499cb495e9f46ded5b57f7de975114641b9799ebd95d\": container with ID starting with e6ee9dfced1a84454826499cb495e9f46ded5b57f7de975114641b9799ebd95d not found: ID does not exist" Mar 16 16:09:12 crc kubenswrapper[5120]: I0316 16:09:12.796204 5120 scope.go:117] "RemoveContainer" containerID="ea140255d5475f2a35004006a6ced7cafbc3643fd219764f617fd7ba6ddd06fa" Mar 16 16:09:12 crc kubenswrapper[5120]: I0316 16:09:12.796412 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea140255d5475f2a35004006a6ced7cafbc3643fd219764f617fd7ba6ddd06fa"} err="failed to get container status \"ea140255d5475f2a35004006a6ced7cafbc3643fd219764f617fd7ba6ddd06fa\": rpc error: code = NotFound desc = could not find container \"ea140255d5475f2a35004006a6ced7cafbc3643fd219764f617fd7ba6ddd06fa\": container with ID starting with ea140255d5475f2a35004006a6ced7cafbc3643fd219764f617fd7ba6ddd06fa not found: ID does not exist" Mar 16 16:09:12 crc kubenswrapper[5120]: I0316 16:09:12.796428 5120 scope.go:117] "RemoveContainer" containerID="7cf51fb5d8dea78ff30e09e4560afa5a8e8341b0240db99db5ac693f703cc8aa" Mar 16 16:09:12 crc kubenswrapper[5120]: I0316 16:09:12.796717 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7cf51fb5d8dea78ff30e09e4560afa5a8e8341b0240db99db5ac693f703cc8aa"} err="failed to get container status \"7cf51fb5d8dea78ff30e09e4560afa5a8e8341b0240db99db5ac693f703cc8aa\": rpc error: code = NotFound desc = could not find container \"7cf51fb5d8dea78ff30e09e4560afa5a8e8341b0240db99db5ac693f703cc8aa\": container with ID starting with 7cf51fb5d8dea78ff30e09e4560afa5a8e8341b0240db99db5ac693f703cc8aa not found: ID does not exist" Mar 16 16:09:12 crc kubenswrapper[5120]: I0316 16:09:12.796771 5120 scope.go:117] "RemoveContainer" containerID="1c5ab1274a2bf4758d8e21e842c18283f1eea05778b887701a9aa3edeac3879b" Mar 16 16:09:12 crc kubenswrapper[5120]: I0316 16:09:12.797072 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c5ab1274a2bf4758d8e21e842c18283f1eea05778b887701a9aa3edeac3879b"} err="failed to get container status \"1c5ab1274a2bf4758d8e21e842c18283f1eea05778b887701a9aa3edeac3879b\": rpc error: code = NotFound desc = could not find container \"1c5ab1274a2bf4758d8e21e842c18283f1eea05778b887701a9aa3edeac3879b\": container with ID starting with 1c5ab1274a2bf4758d8e21e842c18283f1eea05778b887701a9aa3edeac3879b not found: ID does not exist" Mar 16 16:09:12 crc kubenswrapper[5120]: I0316 16:09:12.797091 5120 scope.go:117] "RemoveContainer" containerID="e6ee9dfced1a84454826499cb495e9f46ded5b57f7de975114641b9799ebd95d" Mar 16 16:09:12 crc kubenswrapper[5120]: I0316 16:09:12.797272 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6ee9dfced1a84454826499cb495e9f46ded5b57f7de975114641b9799ebd95d"} err="failed to get container status \"e6ee9dfced1a84454826499cb495e9f46ded5b57f7de975114641b9799ebd95d\": rpc error: code = NotFound desc = could not find container \"e6ee9dfced1a84454826499cb495e9f46ded5b57f7de975114641b9799ebd95d\": container with ID starting with e6ee9dfced1a84454826499cb495e9f46ded5b57f7de975114641b9799ebd95d not found: ID does not exist" Mar 16 16:09:12 crc kubenswrapper[5120]: I0316 16:09:12.797289 5120 scope.go:117] "RemoveContainer" containerID="ea140255d5475f2a35004006a6ced7cafbc3643fd219764f617fd7ba6ddd06fa" Mar 16 16:09:12 crc kubenswrapper[5120]: I0316 16:09:12.797493 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea140255d5475f2a35004006a6ced7cafbc3643fd219764f617fd7ba6ddd06fa"} err="failed to get container status \"ea140255d5475f2a35004006a6ced7cafbc3643fd219764f617fd7ba6ddd06fa\": rpc error: code = NotFound desc = could not find container \"ea140255d5475f2a35004006a6ced7cafbc3643fd219764f617fd7ba6ddd06fa\": container with ID starting with ea140255d5475f2a35004006a6ced7cafbc3643fd219764f617fd7ba6ddd06fa not found: ID does not exist" Mar 16 16:09:12 crc kubenswrapper[5120]: I0316 16:09:12.797519 5120 scope.go:117] "RemoveContainer" containerID="7cf51fb5d8dea78ff30e09e4560afa5a8e8341b0240db99db5ac693f703cc8aa" Mar 16 16:09:12 crc kubenswrapper[5120]: I0316 16:09:12.797728 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7cf51fb5d8dea78ff30e09e4560afa5a8e8341b0240db99db5ac693f703cc8aa"} err="failed to get container status \"7cf51fb5d8dea78ff30e09e4560afa5a8e8341b0240db99db5ac693f703cc8aa\": rpc error: code = NotFound desc = could not find container \"7cf51fb5d8dea78ff30e09e4560afa5a8e8341b0240db99db5ac693f703cc8aa\": container with ID starting with 7cf51fb5d8dea78ff30e09e4560afa5a8e8341b0240db99db5ac693f703cc8aa not found: ID does not exist" Mar 16 16:09:12 crc kubenswrapper[5120]: I0316 16:09:12.797746 5120 scope.go:117] "RemoveContainer" containerID="1c5ab1274a2bf4758d8e21e842c18283f1eea05778b887701a9aa3edeac3879b" Mar 16 16:09:12 crc kubenswrapper[5120]: I0316 16:09:12.797952 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c5ab1274a2bf4758d8e21e842c18283f1eea05778b887701a9aa3edeac3879b"} err="failed to get container status \"1c5ab1274a2bf4758d8e21e842c18283f1eea05778b887701a9aa3edeac3879b\": rpc error: code = NotFound desc = could not find container \"1c5ab1274a2bf4758d8e21e842c18283f1eea05778b887701a9aa3edeac3879b\": container with ID starting with 1c5ab1274a2bf4758d8e21e842c18283f1eea05778b887701a9aa3edeac3879b not found: ID does not exist" Mar 16 16:09:12 crc kubenswrapper[5120]: I0316 16:09:12.797979 5120 scope.go:117] "RemoveContainer" containerID="e6ee9dfced1a84454826499cb495e9f46ded5b57f7de975114641b9799ebd95d" Mar 16 16:09:12 crc kubenswrapper[5120]: I0316 16:09:12.798502 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6ee9dfced1a84454826499cb495e9f46ded5b57f7de975114641b9799ebd95d"} err="failed to get container status \"e6ee9dfced1a84454826499cb495e9f46ded5b57f7de975114641b9799ebd95d\": rpc error: code = NotFound desc = could not find container \"e6ee9dfced1a84454826499cb495e9f46ded5b57f7de975114641b9799ebd95d\": container with ID starting with e6ee9dfced1a84454826499cb495e9f46ded5b57f7de975114641b9799ebd95d not found: ID does not exist" Mar 16 16:09:12 crc kubenswrapper[5120]: I0316 16:09:12.814099 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/541f727f-0029-478f-8d85-5564ebf69e39-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"541f727f-0029-478f-8d85-5564ebf69e39\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:09:12 crc kubenswrapper[5120]: I0316 16:09:12.814142 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/541f727f-0029-478f-8d85-5564ebf69e39-run-httpd\") pod \"ceilometer-0\" (UID: \"541f727f-0029-478f-8d85-5564ebf69e39\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:09:12 crc kubenswrapper[5120]: I0316 16:09:12.814178 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/541f727f-0029-478f-8d85-5564ebf69e39-config-data\") pod \"ceilometer-0\" (UID: \"541f727f-0029-478f-8d85-5564ebf69e39\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:09:12 crc kubenswrapper[5120]: I0316 16:09:12.814256 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/541f727f-0029-478f-8d85-5564ebf69e39-log-httpd\") pod \"ceilometer-0\" (UID: \"541f727f-0029-478f-8d85-5564ebf69e39\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:09:12 crc kubenswrapper[5120]: I0316 16:09:12.814335 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/541f727f-0029-478f-8d85-5564ebf69e39-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"541f727f-0029-478f-8d85-5564ebf69e39\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:09:12 crc kubenswrapper[5120]: I0316 16:09:12.814370 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/541f727f-0029-478f-8d85-5564ebf69e39-scripts\") pod \"ceilometer-0\" (UID: \"541f727f-0029-478f-8d85-5564ebf69e39\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:09:12 crc kubenswrapper[5120]: I0316 16:09:12.814411 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xj7pp\" (UniqueName: \"kubernetes.io/projected/541f727f-0029-478f-8d85-5564ebf69e39-kube-api-access-xj7pp\") pod \"ceilometer-0\" (UID: \"541f727f-0029-478f-8d85-5564ebf69e39\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:09:12 crc kubenswrapper[5120]: I0316 16:09:12.916530 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/541f727f-0029-478f-8d85-5564ebf69e39-config-data\") pod \"ceilometer-0\" (UID: \"541f727f-0029-478f-8d85-5564ebf69e39\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:09:12 crc kubenswrapper[5120]: I0316 16:09:12.916620 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/541f727f-0029-478f-8d85-5564ebf69e39-log-httpd\") pod \"ceilometer-0\" (UID: \"541f727f-0029-478f-8d85-5564ebf69e39\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:09:12 crc kubenswrapper[5120]: I0316 16:09:12.916689 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/541f727f-0029-478f-8d85-5564ebf69e39-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"541f727f-0029-478f-8d85-5564ebf69e39\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:09:12 crc kubenswrapper[5120]: I0316 16:09:12.916709 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/541f727f-0029-478f-8d85-5564ebf69e39-scripts\") pod \"ceilometer-0\" (UID: \"541f727f-0029-478f-8d85-5564ebf69e39\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:09:12 crc kubenswrapper[5120]: I0316 16:09:12.916738 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xj7pp\" (UniqueName: \"kubernetes.io/projected/541f727f-0029-478f-8d85-5564ebf69e39-kube-api-access-xj7pp\") pod \"ceilometer-0\" (UID: \"541f727f-0029-478f-8d85-5564ebf69e39\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:09:12 crc kubenswrapper[5120]: I0316 16:09:12.916872 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/541f727f-0029-478f-8d85-5564ebf69e39-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"541f727f-0029-478f-8d85-5564ebf69e39\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:09:12 crc kubenswrapper[5120]: I0316 16:09:12.916887 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/541f727f-0029-478f-8d85-5564ebf69e39-run-httpd\") pod \"ceilometer-0\" (UID: \"541f727f-0029-478f-8d85-5564ebf69e39\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:09:12 crc kubenswrapper[5120]: I0316 16:09:12.917193 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/541f727f-0029-478f-8d85-5564ebf69e39-log-httpd\") pod \"ceilometer-0\" (UID: \"541f727f-0029-478f-8d85-5564ebf69e39\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:09:12 crc kubenswrapper[5120]: I0316 16:09:12.917295 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/541f727f-0029-478f-8d85-5564ebf69e39-run-httpd\") pod \"ceilometer-0\" (UID: \"541f727f-0029-478f-8d85-5564ebf69e39\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:09:12 crc kubenswrapper[5120]: I0316 16:09:12.921325 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/541f727f-0029-478f-8d85-5564ebf69e39-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"541f727f-0029-478f-8d85-5564ebf69e39\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:09:12 crc kubenswrapper[5120]: I0316 16:09:12.921338 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/541f727f-0029-478f-8d85-5564ebf69e39-scripts\") pod \"ceilometer-0\" (UID: \"541f727f-0029-478f-8d85-5564ebf69e39\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:09:12 crc kubenswrapper[5120]: I0316 16:09:12.921473 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/541f727f-0029-478f-8d85-5564ebf69e39-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"541f727f-0029-478f-8d85-5564ebf69e39\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:09:12 crc kubenswrapper[5120]: I0316 16:09:12.921682 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/541f727f-0029-478f-8d85-5564ebf69e39-config-data\") pod \"ceilometer-0\" (UID: \"541f727f-0029-478f-8d85-5564ebf69e39\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:09:12 crc kubenswrapper[5120]: I0316 16:09:12.940559 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xj7pp\" (UniqueName: \"kubernetes.io/projected/541f727f-0029-478f-8d85-5564ebf69e39-kube-api-access-xj7pp\") pod \"ceilometer-0\" (UID: \"541f727f-0029-478f-8d85-5564ebf69e39\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:09:13 crc kubenswrapper[5120]: I0316 16:09:13.067267 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:09:13 crc kubenswrapper[5120]: I0316 16:09:13.555199 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:09:13 crc kubenswrapper[5120]: I0316 16:09:13.568154 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/placement-595564474-m6lrq" Mar 16 16:09:13 crc kubenswrapper[5120]: I0316 16:09:13.612588 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"541f727f-0029-478f-8d85-5564ebf69e39","Type":"ContainerStarted","Data":"55c1198eb5ae9e23b7dcfe1c1e62f50ea08c647d9664ab4e7d701f24440f685f"} Mar 16 16:09:13 crc kubenswrapper[5120]: I0316 16:09:13.642881 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-df4bb598-d5scs"] Mar 16 16:09:13 crc kubenswrapper[5120]: I0316 16:09:13.643144 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-df4bb598-d5scs" podUID="39058b27-360b-4aa6-b04b-d415e907df29" containerName="placement-log" containerID="cri-o://908ac0ddea49d57cf17d783feebfb997e6d915e4bf8fda0f394d64bfc625357a" gracePeriod=30 Mar 16 16:09:13 crc kubenswrapper[5120]: I0316 16:09:13.643825 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-df4bb598-d5scs" podUID="39058b27-360b-4aa6-b04b-d415e907df29" containerName="placement-api" containerID="cri-o://37e194ad8a30a98af1597f7dce377c841c508bbfe625e5ee61e2d2b7fe21cd14" gracePeriod=30 Mar 16 16:09:14 crc kubenswrapper[5120]: I0316 16:09:14.567609 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:09:14 crc kubenswrapper[5120]: I0316 16:09:14.568351 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:09:14 crc kubenswrapper[5120]: I0316 16:09:14.613796 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:09:14 crc kubenswrapper[5120]: I0316 16:09:14.629582 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"541f727f-0029-478f-8d85-5564ebf69e39","Type":"ContainerStarted","Data":"68813e8245964d0ccc074d5958d5b9ea4111eb9c427efae0d2cd4f41a1b706c9"} Mar 16 16:09:14 crc kubenswrapper[5120]: I0316 16:09:14.632483 5120 generic.go:358] "Generic (PLEG): container finished" podID="39058b27-360b-4aa6-b04b-d415e907df29" containerID="908ac0ddea49d57cf17d783feebfb997e6d915e4bf8fda0f394d64bfc625357a" exitCode=143 Mar 16 16:09:14 crc kubenswrapper[5120]: I0316 16:09:14.634255 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-df4bb598-d5scs" event={"ID":"39058b27-360b-4aa6-b04b-d415e907df29","Type":"ContainerDied","Data":"908ac0ddea49d57cf17d783feebfb997e6d915e4bf8fda0f394d64bfc625357a"} Mar 16 16:09:14 crc kubenswrapper[5120]: I0316 16:09:14.634325 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:09:14 crc kubenswrapper[5120]: I0316 16:09:14.636904 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:09:14 crc kubenswrapper[5120]: I0316 16:09:14.681626 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="edab59f1-ba45-44c9-ace6-b54ab84f1f62" path="/var/lib/kubelet/pods/edab59f1-ba45-44c9-ace6-b54ab84f1f62/volumes" Mar 16 16:09:15 crc kubenswrapper[5120]: I0316 16:09:15.645690 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"541f727f-0029-478f-8d85-5564ebf69e39","Type":"ContainerStarted","Data":"a6f0693285376eec11844789c00548cbeb181d7bebd74408be2d664549125136"} Mar 16 16:09:15 crc kubenswrapper[5120]: I0316 16:09:15.646215 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:09:16 crc kubenswrapper[5120]: I0316 16:09:16.660036 5120 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Mar 16 16:09:16 crc kubenswrapper[5120]: I0316 16:09:16.661021 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"541f727f-0029-478f-8d85-5564ebf69e39","Type":"ContainerStarted","Data":"03099613dfca2741e4b69b0a978834647f02bfb4047659d45d1f738a4e71d529"} Mar 16 16:09:16 crc kubenswrapper[5120]: I0316 16:09:16.800422 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:09:16 crc kubenswrapper[5120]: I0316 16:09:16.806171 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:09:17 crc kubenswrapper[5120]: I0316 16:09:17.204456 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-df4bb598-d5scs" Mar 16 16:09:17 crc kubenswrapper[5120]: I0316 16:09:17.332050 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/39058b27-360b-4aa6-b04b-d415e907df29-logs\") pod \"39058b27-360b-4aa6-b04b-d415e907df29\" (UID: \"39058b27-360b-4aa6-b04b-d415e907df29\") " Mar 16 16:09:17 crc kubenswrapper[5120]: I0316 16:09:17.332402 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/39058b27-360b-4aa6-b04b-d415e907df29-config-data\") pod \"39058b27-360b-4aa6-b04b-d415e907df29\" (UID: \"39058b27-360b-4aa6-b04b-d415e907df29\") " Mar 16 16:09:17 crc kubenswrapper[5120]: I0316 16:09:17.332480 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/39058b27-360b-4aa6-b04b-d415e907df29-public-tls-certs\") pod \"39058b27-360b-4aa6-b04b-d415e907df29\" (UID: \"39058b27-360b-4aa6-b04b-d415e907df29\") " Mar 16 16:09:17 crc kubenswrapper[5120]: I0316 16:09:17.332567 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/39058b27-360b-4aa6-b04b-d415e907df29-scripts\") pod \"39058b27-360b-4aa6-b04b-d415e907df29\" (UID: \"39058b27-360b-4aa6-b04b-d415e907df29\") " Mar 16 16:09:17 crc kubenswrapper[5120]: I0316 16:09:17.332585 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/39058b27-360b-4aa6-b04b-d415e907df29-combined-ca-bundle\") pod \"39058b27-360b-4aa6-b04b-d415e907df29\" (UID: \"39058b27-360b-4aa6-b04b-d415e907df29\") " Mar 16 16:09:17 crc kubenswrapper[5120]: I0316 16:09:17.332646 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zd7b6\" (UniqueName: \"kubernetes.io/projected/39058b27-360b-4aa6-b04b-d415e907df29-kube-api-access-zd7b6\") pod \"39058b27-360b-4aa6-b04b-d415e907df29\" (UID: \"39058b27-360b-4aa6-b04b-d415e907df29\") " Mar 16 16:09:17 crc kubenswrapper[5120]: I0316 16:09:17.332781 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/39058b27-360b-4aa6-b04b-d415e907df29-internal-tls-certs\") pod \"39058b27-360b-4aa6-b04b-d415e907df29\" (UID: \"39058b27-360b-4aa6-b04b-d415e907df29\") " Mar 16 16:09:17 crc kubenswrapper[5120]: I0316 16:09:17.332639 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39058b27-360b-4aa6-b04b-d415e907df29-logs" (OuterVolumeSpecName: "logs") pod "39058b27-360b-4aa6-b04b-d415e907df29" (UID: "39058b27-360b-4aa6-b04b-d415e907df29"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:09:17 crc kubenswrapper[5120]: I0316 16:09:17.337830 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/39058b27-360b-4aa6-b04b-d415e907df29-scripts" (OuterVolumeSpecName: "scripts") pod "39058b27-360b-4aa6-b04b-d415e907df29" (UID: "39058b27-360b-4aa6-b04b-d415e907df29"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:09:17 crc kubenswrapper[5120]: I0316 16:09:17.341975 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39058b27-360b-4aa6-b04b-d415e907df29-kube-api-access-zd7b6" (OuterVolumeSpecName: "kube-api-access-zd7b6") pod "39058b27-360b-4aa6-b04b-d415e907df29" (UID: "39058b27-360b-4aa6-b04b-d415e907df29"). InnerVolumeSpecName "kube-api-access-zd7b6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:09:17 crc kubenswrapper[5120]: I0316 16:09:17.394874 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/39058b27-360b-4aa6-b04b-d415e907df29-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "39058b27-360b-4aa6-b04b-d415e907df29" (UID: "39058b27-360b-4aa6-b04b-d415e907df29"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:09:17 crc kubenswrapper[5120]: I0316 16:09:17.395988 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/39058b27-360b-4aa6-b04b-d415e907df29-config-data" (OuterVolumeSpecName: "config-data") pod "39058b27-360b-4aa6-b04b-d415e907df29" (UID: "39058b27-360b-4aa6-b04b-d415e907df29"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:09:17 crc kubenswrapper[5120]: I0316 16:09:17.431149 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/39058b27-360b-4aa6-b04b-d415e907df29-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "39058b27-360b-4aa6-b04b-d415e907df29" (UID: "39058b27-360b-4aa6-b04b-d415e907df29"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:09:17 crc kubenswrapper[5120]: I0316 16:09:17.434558 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/39058b27-360b-4aa6-b04b-d415e907df29-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "39058b27-360b-4aa6-b04b-d415e907df29" (UID: "39058b27-360b-4aa6-b04b-d415e907df29"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:09:17 crc kubenswrapper[5120]: I0316 16:09:17.434995 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/39058b27-360b-4aa6-b04b-d415e907df29-internal-tls-certs\") pod \"39058b27-360b-4aa6-b04b-d415e907df29\" (UID: \"39058b27-360b-4aa6-b04b-d415e907df29\") " Mar 16 16:09:17 crc kubenswrapper[5120]: W0316 16:09:17.435161 5120 empty_dir.go:511] Warning: Unmount skipped because path does not exist: /var/lib/kubelet/pods/39058b27-360b-4aa6-b04b-d415e907df29/volumes/kubernetes.io~secret/internal-tls-certs Mar 16 16:09:17 crc kubenswrapper[5120]: I0316 16:09:17.435181 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/39058b27-360b-4aa6-b04b-d415e907df29-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "39058b27-360b-4aa6-b04b-d415e907df29" (UID: "39058b27-360b-4aa6-b04b-d415e907df29"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:09:17 crc kubenswrapper[5120]: I0316 16:09:17.435516 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/39058b27-360b-4aa6-b04b-d415e907df29-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:09:17 crc kubenswrapper[5120]: I0316 16:09:17.435535 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zd7b6\" (UniqueName: \"kubernetes.io/projected/39058b27-360b-4aa6-b04b-d415e907df29-kube-api-access-zd7b6\") on node \"crc\" DevicePath \"\"" Mar 16 16:09:17 crc kubenswrapper[5120]: I0316 16:09:17.435547 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/39058b27-360b-4aa6-b04b-d415e907df29-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:09:17 crc kubenswrapper[5120]: I0316 16:09:17.435558 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/39058b27-360b-4aa6-b04b-d415e907df29-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:09:17 crc kubenswrapper[5120]: I0316 16:09:17.435568 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/39058b27-360b-4aa6-b04b-d415e907df29-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:09:17 crc kubenswrapper[5120]: I0316 16:09:17.435577 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/39058b27-360b-4aa6-b04b-d415e907df29-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:09:17 crc kubenswrapper[5120]: I0316 16:09:17.435587 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/39058b27-360b-4aa6-b04b-d415e907df29-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:09:17 crc kubenswrapper[5120]: I0316 16:09:17.664568 5120 scope.go:117] "RemoveContainer" containerID="bc2df124cc6ad146d7c7dd2115ac815986fb62978d38895f6d345a4a9b14dbd8" Mar 16 16:09:17 crc kubenswrapper[5120]: E0316 16:09:17.665041 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:09:17 crc kubenswrapper[5120]: I0316 16:09:17.671902 5120 generic.go:358] "Generic (PLEG): container finished" podID="39058b27-360b-4aa6-b04b-d415e907df29" containerID="37e194ad8a30a98af1597f7dce377c841c508bbfe625e5ee61e2d2b7fe21cd14" exitCode=0 Mar 16 16:09:17 crc kubenswrapper[5120]: I0316 16:09:17.671995 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-df4bb598-d5scs" event={"ID":"39058b27-360b-4aa6-b04b-d415e907df29","Type":"ContainerDied","Data":"37e194ad8a30a98af1597f7dce377c841c508bbfe625e5ee61e2d2b7fe21cd14"} Mar 16 16:09:17 crc kubenswrapper[5120]: I0316 16:09:17.672021 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-df4bb598-d5scs" event={"ID":"39058b27-360b-4aa6-b04b-d415e907df29","Type":"ContainerDied","Data":"beb47fe150cb72dac728a1eb20ded24a0cf421857bbe5f944d70d83d415380b6"} Mar 16 16:09:17 crc kubenswrapper[5120]: I0316 16:09:17.672039 5120 scope.go:117] "RemoveContainer" containerID="37e194ad8a30a98af1597f7dce377c841c508bbfe625e5ee61e2d2b7fe21cd14" Mar 16 16:09:17 crc kubenswrapper[5120]: I0316 16:09:17.672163 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-df4bb598-d5scs" Mar 16 16:09:17 crc kubenswrapper[5120]: I0316 16:09:17.687302 5120 generic.go:358] "Generic (PLEG): container finished" podID="8dcc9838-517a-4250-b576-c87878365fa2" containerID="dd23bc6bdc8475b15802b3822e2533e7d87c582efa0f5640fb7647f5ae171e0b" exitCode=0 Mar 16 16:09:17 crc kubenswrapper[5120]: I0316 16:09:17.687386 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-6h5nj" event={"ID":"8dcc9838-517a-4250-b576-c87878365fa2","Type":"ContainerDied","Data":"dd23bc6bdc8475b15802b3822e2533e7d87c582efa0f5640fb7647f5ae171e0b"} Mar 16 16:09:17 crc kubenswrapper[5120]: I0316 16:09:17.725529 5120 scope.go:117] "RemoveContainer" containerID="908ac0ddea49d57cf17d783feebfb997e6d915e4bf8fda0f394d64bfc625357a" Mar 16 16:09:17 crc kubenswrapper[5120]: I0316 16:09:17.754203 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-df4bb598-d5scs"] Mar 16 16:09:17 crc kubenswrapper[5120]: I0316 16:09:17.758206 5120 scope.go:117] "RemoveContainer" containerID="37e194ad8a30a98af1597f7dce377c841c508bbfe625e5ee61e2d2b7fe21cd14" Mar 16 16:09:17 crc kubenswrapper[5120]: E0316 16:09:17.758727 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"37e194ad8a30a98af1597f7dce377c841c508bbfe625e5ee61e2d2b7fe21cd14\": container with ID starting with 37e194ad8a30a98af1597f7dce377c841c508bbfe625e5ee61e2d2b7fe21cd14 not found: ID does not exist" containerID="37e194ad8a30a98af1597f7dce377c841c508bbfe625e5ee61e2d2b7fe21cd14" Mar 16 16:09:17 crc kubenswrapper[5120]: I0316 16:09:17.758786 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37e194ad8a30a98af1597f7dce377c841c508bbfe625e5ee61e2d2b7fe21cd14"} err="failed to get container status \"37e194ad8a30a98af1597f7dce377c841c508bbfe625e5ee61e2d2b7fe21cd14\": rpc error: code = NotFound desc = could not find container \"37e194ad8a30a98af1597f7dce377c841c508bbfe625e5ee61e2d2b7fe21cd14\": container with ID starting with 37e194ad8a30a98af1597f7dce377c841c508bbfe625e5ee61e2d2b7fe21cd14 not found: ID does not exist" Mar 16 16:09:17 crc kubenswrapper[5120]: I0316 16:09:17.758816 5120 scope.go:117] "RemoveContainer" containerID="908ac0ddea49d57cf17d783feebfb997e6d915e4bf8fda0f394d64bfc625357a" Mar 16 16:09:17 crc kubenswrapper[5120]: E0316 16:09:17.759154 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"908ac0ddea49d57cf17d783feebfb997e6d915e4bf8fda0f394d64bfc625357a\": container with ID starting with 908ac0ddea49d57cf17d783feebfb997e6d915e4bf8fda0f394d64bfc625357a not found: ID does not exist" containerID="908ac0ddea49d57cf17d783feebfb997e6d915e4bf8fda0f394d64bfc625357a" Mar 16 16:09:17 crc kubenswrapper[5120]: I0316 16:09:17.759212 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"908ac0ddea49d57cf17d783feebfb997e6d915e4bf8fda0f394d64bfc625357a"} err="failed to get container status \"908ac0ddea49d57cf17d783feebfb997e6d915e4bf8fda0f394d64bfc625357a\": rpc error: code = NotFound desc = could not find container \"908ac0ddea49d57cf17d783feebfb997e6d915e4bf8fda0f394d64bfc625357a\": container with ID starting with 908ac0ddea49d57cf17d783feebfb997e6d915e4bf8fda0f394d64bfc625357a not found: ID does not exist" Mar 16 16:09:17 crc kubenswrapper[5120]: I0316 16:09:17.765283 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-df4bb598-d5scs"] Mar 16 16:09:17 crc kubenswrapper[5120]: I0316 16:09:17.926636 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:09:17 crc kubenswrapper[5120]: I0316 16:09:17.926718 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:09:17 crc kubenswrapper[5120]: I0316 16:09:17.960152 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:09:17 crc kubenswrapper[5120]: I0316 16:09:17.982847 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:09:18 crc kubenswrapper[5120]: I0316 16:09:18.684994 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="39058b27-360b-4aa6-b04b-d415e907df29" path="/var/lib/kubelet/pods/39058b27-360b-4aa6-b04b-d415e907df29/volumes" Mar 16 16:09:18 crc kubenswrapper[5120]: I0316 16:09:18.701806 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:09:18 crc kubenswrapper[5120]: I0316 16:09:18.702149 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:09:19 crc kubenswrapper[5120]: I0316 16:09:19.083730 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-6h5nj" Mar 16 16:09:19 crc kubenswrapper[5120]: I0316 16:09:19.172620 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8dcc9838-517a-4250-b576-c87878365fa2-scripts\") pod \"8dcc9838-517a-4250-b576-c87878365fa2\" (UID: \"8dcc9838-517a-4250-b576-c87878365fa2\") " Mar 16 16:09:19 crc kubenswrapper[5120]: I0316 16:09:19.172834 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8dcc9838-517a-4250-b576-c87878365fa2-config-data\") pod \"8dcc9838-517a-4250-b576-c87878365fa2\" (UID: \"8dcc9838-517a-4250-b576-c87878365fa2\") " Mar 16 16:09:19 crc kubenswrapper[5120]: I0316 16:09:19.172906 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8dcc9838-517a-4250-b576-c87878365fa2-combined-ca-bundle\") pod \"8dcc9838-517a-4250-b576-c87878365fa2\" (UID: \"8dcc9838-517a-4250-b576-c87878365fa2\") " Mar 16 16:09:19 crc kubenswrapper[5120]: I0316 16:09:19.173151 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jjfbd\" (UniqueName: \"kubernetes.io/projected/8dcc9838-517a-4250-b576-c87878365fa2-kube-api-access-jjfbd\") pod \"8dcc9838-517a-4250-b576-c87878365fa2\" (UID: \"8dcc9838-517a-4250-b576-c87878365fa2\") " Mar 16 16:09:19 crc kubenswrapper[5120]: I0316 16:09:19.182890 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8dcc9838-517a-4250-b576-c87878365fa2-kube-api-access-jjfbd" (OuterVolumeSpecName: "kube-api-access-jjfbd") pod "8dcc9838-517a-4250-b576-c87878365fa2" (UID: "8dcc9838-517a-4250-b576-c87878365fa2"). InnerVolumeSpecName "kube-api-access-jjfbd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:09:19 crc kubenswrapper[5120]: I0316 16:09:19.189969 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8dcc9838-517a-4250-b576-c87878365fa2-scripts" (OuterVolumeSpecName: "scripts") pod "8dcc9838-517a-4250-b576-c87878365fa2" (UID: "8dcc9838-517a-4250-b576-c87878365fa2"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:09:19 crc kubenswrapper[5120]: I0316 16:09:19.212936 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8dcc9838-517a-4250-b576-c87878365fa2-config-data" (OuterVolumeSpecName: "config-data") pod "8dcc9838-517a-4250-b576-c87878365fa2" (UID: "8dcc9838-517a-4250-b576-c87878365fa2"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:09:19 crc kubenswrapper[5120]: I0316 16:09:19.227848 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8dcc9838-517a-4250-b576-c87878365fa2-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "8dcc9838-517a-4250-b576-c87878365fa2" (UID: "8dcc9838-517a-4250-b576-c87878365fa2"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:09:19 crc kubenswrapper[5120]: I0316 16:09:19.275203 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jjfbd\" (UniqueName: \"kubernetes.io/projected/8dcc9838-517a-4250-b576-c87878365fa2-kube-api-access-jjfbd\") on node \"crc\" DevicePath \"\"" Mar 16 16:09:19 crc kubenswrapper[5120]: I0316 16:09:19.275236 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8dcc9838-517a-4250-b576-c87878365fa2-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:09:19 crc kubenswrapper[5120]: I0316 16:09:19.275246 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8dcc9838-517a-4250-b576-c87878365fa2-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:09:19 crc kubenswrapper[5120]: I0316 16:09:19.275254 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8dcc9838-517a-4250-b576-c87878365fa2-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:09:19 crc kubenswrapper[5120]: I0316 16:09:19.711240 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-6h5nj" event={"ID":"8dcc9838-517a-4250-b576-c87878365fa2","Type":"ContainerDied","Data":"6e6da3e300d6823335f7594b922bdea69d4bcbda1f4705a7cb0f74a5177205ff"} Mar 16 16:09:19 crc kubenswrapper[5120]: I0316 16:09:19.711567 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6e6da3e300d6823335f7594b922bdea69d4bcbda1f4705a7cb0f74a5177205ff" Mar 16 16:09:19 crc kubenswrapper[5120]: I0316 16:09:19.711537 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-6h5nj" Mar 16 16:09:19 crc kubenswrapper[5120]: I0316 16:09:19.715994 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"541f727f-0029-478f-8d85-5564ebf69e39","Type":"ContainerStarted","Data":"9b2894bf94fd0a5f629c27c18b9dc39ee6b5891b17eb82e4f2aa4c143642560c"} Mar 16 16:09:19 crc kubenswrapper[5120]: I0316 16:09:19.716071 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:09:19 crc kubenswrapper[5120]: I0316 16:09:19.761173 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.039723538 podStartE2EDuration="7.761147509s" podCreationTimestamp="2026-03-16 16:09:12 +0000 UTC" firstStartedPulling="2026-03-16 16:09:13.559300629 +0000 UTC m=+2255.713232286" lastFinishedPulling="2026-03-16 16:09:19.2807246 +0000 UTC m=+2261.434656257" observedRunningTime="2026-03-16 16:09:19.740852575 +0000 UTC m=+2261.894784222" watchObservedRunningTime="2026-03-16 16:09:19.761147509 +0000 UTC m=+2261.915079166" Mar 16 16:09:19 crc kubenswrapper[5120]: I0316 16:09:19.781012 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:09:19 crc kubenswrapper[5120]: I0316 16:09:19.781951 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8dcc9838-517a-4250-b576-c87878365fa2" containerName="nova-cell0-conductor-db-sync" Mar 16 16:09:19 crc kubenswrapper[5120]: I0316 16:09:19.781969 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8dcc9838-517a-4250-b576-c87878365fa2" containerName="nova-cell0-conductor-db-sync" Mar 16 16:09:19 crc kubenswrapper[5120]: I0316 16:09:19.781983 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39058b27-360b-4aa6-b04b-d415e907df29" containerName="placement-api" Mar 16 16:09:19 crc kubenswrapper[5120]: I0316 16:09:19.781989 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="39058b27-360b-4aa6-b04b-d415e907df29" containerName="placement-api" Mar 16 16:09:19 crc kubenswrapper[5120]: I0316 16:09:19.782024 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39058b27-360b-4aa6-b04b-d415e907df29" containerName="placement-log" Mar 16 16:09:19 crc kubenswrapper[5120]: I0316 16:09:19.782031 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="39058b27-360b-4aa6-b04b-d415e907df29" containerName="placement-log" Mar 16 16:09:19 crc kubenswrapper[5120]: I0316 16:09:19.782202 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="39058b27-360b-4aa6-b04b-d415e907df29" containerName="placement-log" Mar 16 16:09:19 crc kubenswrapper[5120]: I0316 16:09:19.782226 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="8dcc9838-517a-4250-b576-c87878365fa2" containerName="nova-cell0-conductor-db-sync" Mar 16 16:09:19 crc kubenswrapper[5120]: I0316 16:09:19.782234 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="39058b27-360b-4aa6-b04b-d415e907df29" containerName="placement-api" Mar 16 16:09:19 crc kubenswrapper[5120]: I0316 16:09:19.791071 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:09:19 crc kubenswrapper[5120]: I0316 16:09:19.793508 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:09:19 crc kubenswrapper[5120]: I0316 16:09:19.794544 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-nova-dockercfg-c26lm\"" Mar 16 16:09:19 crc kubenswrapper[5120]: I0316 16:09:19.810439 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-conductor-config-data\"" Mar 16 16:09:19 crc kubenswrapper[5120]: I0316 16:09:19.890503 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ee5ec352-b355-48cc-b7b4-8782a1af4455-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"ee5ec352-b355-48cc-b7b4-8782a1af4455\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:09:19 crc kubenswrapper[5120]: I0316 16:09:19.890613 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ee5ec352-b355-48cc-b7b4-8782a1af4455-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"ee5ec352-b355-48cc-b7b4-8782a1af4455\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:09:19 crc kubenswrapper[5120]: I0316 16:09:19.890793 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddl4p\" (UniqueName: \"kubernetes.io/projected/ee5ec352-b355-48cc-b7b4-8782a1af4455-kube-api-access-ddl4p\") pod \"nova-cell0-conductor-0\" (UID: \"ee5ec352-b355-48cc-b7b4-8782a1af4455\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:09:19 crc kubenswrapper[5120]: I0316 16:09:19.992524 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ee5ec352-b355-48cc-b7b4-8782a1af4455-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"ee5ec352-b355-48cc-b7b4-8782a1af4455\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:09:19 crc kubenswrapper[5120]: I0316 16:09:19.992641 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ddl4p\" (UniqueName: \"kubernetes.io/projected/ee5ec352-b355-48cc-b7b4-8782a1af4455-kube-api-access-ddl4p\") pod \"nova-cell0-conductor-0\" (UID: \"ee5ec352-b355-48cc-b7b4-8782a1af4455\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:09:19 crc kubenswrapper[5120]: I0316 16:09:19.993136 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ee5ec352-b355-48cc-b7b4-8782a1af4455-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"ee5ec352-b355-48cc-b7b4-8782a1af4455\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:09:19 crc kubenswrapper[5120]: I0316 16:09:19.999149 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ee5ec352-b355-48cc-b7b4-8782a1af4455-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"ee5ec352-b355-48cc-b7b4-8782a1af4455\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:09:19 crc kubenswrapper[5120]: I0316 16:09:19.999214 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ee5ec352-b355-48cc-b7b4-8782a1af4455-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"ee5ec352-b355-48cc-b7b4-8782a1af4455\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:09:20 crc kubenswrapper[5120]: I0316 16:09:20.014306 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddl4p\" (UniqueName: \"kubernetes.io/projected/ee5ec352-b355-48cc-b7b4-8782a1af4455-kube-api-access-ddl4p\") pod \"nova-cell0-conductor-0\" (UID: \"ee5ec352-b355-48cc-b7b4-8782a1af4455\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:09:20 crc kubenswrapper[5120]: I0316 16:09:20.123295 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:09:20 crc kubenswrapper[5120]: I0316 16:09:20.510942 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:09:20 crc kubenswrapper[5120]: I0316 16:09:20.625015 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:09:20 crc kubenswrapper[5120]: W0316 16:09:20.630512 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podee5ec352_b355_48cc_b7b4_8782a1af4455.slice/crio-c5f957c7da877de0bc9bbb4bd4ac0fd8a7be8a6c8f1c3772b3b139419d38699d WatchSource:0}: Error finding container c5f957c7da877de0bc9bbb4bd4ac0fd8a7be8a6c8f1c3772b3b139419d38699d: Status 404 returned error can't find the container with id c5f957c7da877de0bc9bbb4bd4ac0fd8a7be8a6c8f1c3772b3b139419d38699d Mar 16 16:09:20 crc kubenswrapper[5120]: I0316 16:09:20.728676 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"ee5ec352-b355-48cc-b7b4-8782a1af4455","Type":"ContainerStarted","Data":"c5f957c7da877de0bc9bbb4bd4ac0fd8a7be8a6c8f1c3772b3b139419d38699d"} Mar 16 16:09:20 crc kubenswrapper[5120]: I0316 16:09:20.728903 5120 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Mar 16 16:09:20 crc kubenswrapper[5120]: I0316 16:09:20.907835 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:09:21 crc kubenswrapper[5120]: I0316 16:09:21.742455 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"ee5ec352-b355-48cc-b7b4-8782a1af4455","Type":"ContainerStarted","Data":"351c7a67d3aa6228907222bfffa25dcf043c7b755c16b8c257937cb2598ffa74"} Mar 16 16:09:21 crc kubenswrapper[5120]: I0316 16:09:21.742850 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:09:21 crc kubenswrapper[5120]: I0316 16:09:21.766376 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podStartSLOduration=2.766351691 podStartE2EDuration="2.766351691s" podCreationTimestamp="2026-03-16 16:09:19 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:09:21.757544271 +0000 UTC m=+2263.911475968" watchObservedRunningTime="2026-03-16 16:09:21.766351691 +0000 UTC m=+2263.920283358" Mar 16 16:09:23 crc kubenswrapper[5120]: I0316 16:09:23.338740 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:09:23 crc kubenswrapper[5120]: I0316 16:09:23.758890 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="ee5ec352-b355-48cc-b7b4-8782a1af4455" containerName="nova-cell0-conductor-conductor" containerID="cri-o://351c7a67d3aa6228907222bfffa25dcf043c7b755c16b8c257937cb2598ffa74" gracePeriod=30 Mar 16 16:09:24 crc kubenswrapper[5120]: I0316 16:09:24.592713 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:09:24 crc kubenswrapper[5120]: I0316 16:09:24.689849 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ddl4p\" (UniqueName: \"kubernetes.io/projected/ee5ec352-b355-48cc-b7b4-8782a1af4455-kube-api-access-ddl4p\") pod \"ee5ec352-b355-48cc-b7b4-8782a1af4455\" (UID: \"ee5ec352-b355-48cc-b7b4-8782a1af4455\") " Mar 16 16:09:24 crc kubenswrapper[5120]: I0316 16:09:24.689929 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ee5ec352-b355-48cc-b7b4-8782a1af4455-config-data\") pod \"ee5ec352-b355-48cc-b7b4-8782a1af4455\" (UID: \"ee5ec352-b355-48cc-b7b4-8782a1af4455\") " Mar 16 16:09:24 crc kubenswrapper[5120]: I0316 16:09:24.690234 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ee5ec352-b355-48cc-b7b4-8782a1af4455-combined-ca-bundle\") pod \"ee5ec352-b355-48cc-b7b4-8782a1af4455\" (UID: \"ee5ec352-b355-48cc-b7b4-8782a1af4455\") " Mar 16 16:09:24 crc kubenswrapper[5120]: I0316 16:09:24.695439 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee5ec352-b355-48cc-b7b4-8782a1af4455-kube-api-access-ddl4p" (OuterVolumeSpecName: "kube-api-access-ddl4p") pod "ee5ec352-b355-48cc-b7b4-8782a1af4455" (UID: "ee5ec352-b355-48cc-b7b4-8782a1af4455"). InnerVolumeSpecName "kube-api-access-ddl4p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:09:24 crc kubenswrapper[5120]: I0316 16:09:24.718066 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ee5ec352-b355-48cc-b7b4-8782a1af4455-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ee5ec352-b355-48cc-b7b4-8782a1af4455" (UID: "ee5ec352-b355-48cc-b7b4-8782a1af4455"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:09:24 crc kubenswrapper[5120]: I0316 16:09:24.727086 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ee5ec352-b355-48cc-b7b4-8782a1af4455-config-data" (OuterVolumeSpecName: "config-data") pod "ee5ec352-b355-48cc-b7b4-8782a1af4455" (UID: "ee5ec352-b355-48cc-b7b4-8782a1af4455"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:09:24 crc kubenswrapper[5120]: I0316 16:09:24.770926 5120 generic.go:358] "Generic (PLEG): container finished" podID="ee5ec352-b355-48cc-b7b4-8782a1af4455" containerID="351c7a67d3aa6228907222bfffa25dcf043c7b755c16b8c257937cb2598ffa74" exitCode=0 Mar 16 16:09:24 crc kubenswrapper[5120]: I0316 16:09:24.771005 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"ee5ec352-b355-48cc-b7b4-8782a1af4455","Type":"ContainerDied","Data":"351c7a67d3aa6228907222bfffa25dcf043c7b755c16b8c257937cb2598ffa74"} Mar 16 16:09:24 crc kubenswrapper[5120]: I0316 16:09:24.771030 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"ee5ec352-b355-48cc-b7b4-8782a1af4455","Type":"ContainerDied","Data":"c5f957c7da877de0bc9bbb4bd4ac0fd8a7be8a6c8f1c3772b3b139419d38699d"} Mar 16 16:09:24 crc kubenswrapper[5120]: I0316 16:09:24.771045 5120 scope.go:117] "RemoveContainer" containerID="351c7a67d3aa6228907222bfffa25dcf043c7b755c16b8c257937cb2598ffa74" Mar 16 16:09:24 crc kubenswrapper[5120]: I0316 16:09:24.771184 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:09:24 crc kubenswrapper[5120]: I0316 16:09:24.792591 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ee5ec352-b355-48cc-b7b4-8782a1af4455-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:09:24 crc kubenswrapper[5120]: I0316 16:09:24.792621 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ee5ec352-b355-48cc-b7b4-8782a1af4455-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:09:24 crc kubenswrapper[5120]: I0316 16:09:24.792633 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ddl4p\" (UniqueName: \"kubernetes.io/projected/ee5ec352-b355-48cc-b7b4-8782a1af4455-kube-api-access-ddl4p\") on node \"crc\" DevicePath \"\"" Mar 16 16:09:24 crc kubenswrapper[5120]: I0316 16:09:24.806367 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:09:24 crc kubenswrapper[5120]: I0316 16:09:24.808037 5120 scope.go:117] "RemoveContainer" containerID="351c7a67d3aa6228907222bfffa25dcf043c7b755c16b8c257937cb2598ffa74" Mar 16 16:09:24 crc kubenswrapper[5120]: E0316 16:09:24.808343 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"351c7a67d3aa6228907222bfffa25dcf043c7b755c16b8c257937cb2598ffa74\": container with ID starting with 351c7a67d3aa6228907222bfffa25dcf043c7b755c16b8c257937cb2598ffa74 not found: ID does not exist" containerID="351c7a67d3aa6228907222bfffa25dcf043c7b755c16b8c257937cb2598ffa74" Mar 16 16:09:24 crc kubenswrapper[5120]: I0316 16:09:24.808374 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"351c7a67d3aa6228907222bfffa25dcf043c7b755c16b8c257937cb2598ffa74"} err="failed to get container status \"351c7a67d3aa6228907222bfffa25dcf043c7b755c16b8c257937cb2598ffa74\": rpc error: code = NotFound desc = could not find container \"351c7a67d3aa6228907222bfffa25dcf043c7b755c16b8c257937cb2598ffa74\": container with ID starting with 351c7a67d3aa6228907222bfffa25dcf043c7b755c16b8c257937cb2598ffa74 not found: ID does not exist" Mar 16 16:09:24 crc kubenswrapper[5120]: I0316 16:09:24.820925 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:09:24 crc kubenswrapper[5120]: I0316 16:09:24.833910 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:09:24 crc kubenswrapper[5120]: I0316 16:09:24.834883 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee5ec352-b355-48cc-b7b4-8782a1af4455" containerName="nova-cell0-conductor-conductor" Mar 16 16:09:24 crc kubenswrapper[5120]: I0316 16:09:24.834904 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee5ec352-b355-48cc-b7b4-8782a1af4455" containerName="nova-cell0-conductor-conductor" Mar 16 16:09:24 crc kubenswrapper[5120]: I0316 16:09:24.835101 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ee5ec352-b355-48cc-b7b4-8782a1af4455" containerName="nova-cell0-conductor-conductor" Mar 16 16:09:24 crc kubenswrapper[5120]: I0316 16:09:24.844228 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:09:24 crc kubenswrapper[5120]: I0316 16:09:24.849309 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:09:24 crc kubenswrapper[5120]: I0316 16:09:24.855247 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-nova-dockercfg-c26lm\"" Mar 16 16:09:24 crc kubenswrapper[5120]: I0316 16:09:24.855892 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-conductor-config-data\"" Mar 16 16:09:24 crc kubenswrapper[5120]: I0316 16:09:24.894474 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2bffb613-2e18-4306-a611-5ff4541a74fa-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"2bffb613-2e18-4306-a611-5ff4541a74fa\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:09:24 crc kubenswrapper[5120]: I0316 16:09:24.894595 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9wdg\" (UniqueName: \"kubernetes.io/projected/2bffb613-2e18-4306-a611-5ff4541a74fa-kube-api-access-d9wdg\") pod \"nova-cell0-conductor-0\" (UID: \"2bffb613-2e18-4306-a611-5ff4541a74fa\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:09:24 crc kubenswrapper[5120]: I0316 16:09:24.894629 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2bffb613-2e18-4306-a611-5ff4541a74fa-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"2bffb613-2e18-4306-a611-5ff4541a74fa\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:09:24 crc kubenswrapper[5120]: I0316 16:09:24.995857 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d9wdg\" (UniqueName: \"kubernetes.io/projected/2bffb613-2e18-4306-a611-5ff4541a74fa-kube-api-access-d9wdg\") pod \"nova-cell0-conductor-0\" (UID: \"2bffb613-2e18-4306-a611-5ff4541a74fa\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:09:24 crc kubenswrapper[5120]: I0316 16:09:24.995908 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2bffb613-2e18-4306-a611-5ff4541a74fa-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"2bffb613-2e18-4306-a611-5ff4541a74fa\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:09:24 crc kubenswrapper[5120]: I0316 16:09:24.996076 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2bffb613-2e18-4306-a611-5ff4541a74fa-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"2bffb613-2e18-4306-a611-5ff4541a74fa\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:09:25 crc kubenswrapper[5120]: I0316 16:09:25.000741 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2bffb613-2e18-4306-a611-5ff4541a74fa-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"2bffb613-2e18-4306-a611-5ff4541a74fa\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:09:25 crc kubenswrapper[5120]: I0316 16:09:25.008004 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2bffb613-2e18-4306-a611-5ff4541a74fa-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"2bffb613-2e18-4306-a611-5ff4541a74fa\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:09:25 crc kubenswrapper[5120]: I0316 16:09:25.011983 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9wdg\" (UniqueName: \"kubernetes.io/projected/2bffb613-2e18-4306-a611-5ff4541a74fa-kube-api-access-d9wdg\") pod \"nova-cell0-conductor-0\" (UID: \"2bffb613-2e18-4306-a611-5ff4541a74fa\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:09:25 crc kubenswrapper[5120]: I0316 16:09:25.171444 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:09:25 crc kubenswrapper[5120]: I0316 16:09:25.175817 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:09:25 crc kubenswrapper[5120]: I0316 16:09:25.176106 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="541f727f-0029-478f-8d85-5564ebf69e39" containerName="ceilometer-central-agent" containerID="cri-o://68813e8245964d0ccc074d5958d5b9ea4111eb9c427efae0d2cd4f41a1b706c9" gracePeriod=30 Mar 16 16:09:25 crc kubenswrapper[5120]: I0316 16:09:25.176164 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="541f727f-0029-478f-8d85-5564ebf69e39" containerName="proxy-httpd" containerID="cri-o://9b2894bf94fd0a5f629c27c18b9dc39ee6b5891b17eb82e4f2aa4c143642560c" gracePeriod=30 Mar 16 16:09:25 crc kubenswrapper[5120]: I0316 16:09:25.176212 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="541f727f-0029-478f-8d85-5564ebf69e39" containerName="sg-core" containerID="cri-o://03099613dfca2741e4b69b0a978834647f02bfb4047659d45d1f738a4e71d529" gracePeriod=30 Mar 16 16:09:25 crc kubenswrapper[5120]: I0316 16:09:25.176231 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="541f727f-0029-478f-8d85-5564ebf69e39" containerName="ceilometer-notification-agent" containerID="cri-o://a6f0693285376eec11844789c00548cbeb181d7bebd74408be2d664549125136" gracePeriod=30 Mar 16 16:09:25 crc kubenswrapper[5120]: I0316 16:09:25.340883 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:09:25 crc kubenswrapper[5120]: I0316 16:09:25.659865 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:09:25 crc kubenswrapper[5120]: I0316 16:09:25.787615 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"2bffb613-2e18-4306-a611-5ff4541a74fa","Type":"ContainerStarted","Data":"f2472769c9ca2611ed2b9c95196f075126645a99a3b4943fd39694d766349c79"} Mar 16 16:09:25 crc kubenswrapper[5120]: I0316 16:09:25.799342 5120 generic.go:358] "Generic (PLEG): container finished" podID="541f727f-0029-478f-8d85-5564ebf69e39" containerID="9b2894bf94fd0a5f629c27c18b9dc39ee6b5891b17eb82e4f2aa4c143642560c" exitCode=0 Mar 16 16:09:25 crc kubenswrapper[5120]: I0316 16:09:25.799375 5120 generic.go:358] "Generic (PLEG): container finished" podID="541f727f-0029-478f-8d85-5564ebf69e39" containerID="03099613dfca2741e4b69b0a978834647f02bfb4047659d45d1f738a4e71d529" exitCode=2 Mar 16 16:09:25 crc kubenswrapper[5120]: I0316 16:09:25.799383 5120 generic.go:358] "Generic (PLEG): container finished" podID="541f727f-0029-478f-8d85-5564ebf69e39" containerID="a6f0693285376eec11844789c00548cbeb181d7bebd74408be2d664549125136" exitCode=0 Mar 16 16:09:25 crc kubenswrapper[5120]: I0316 16:09:25.799389 5120 generic.go:358] "Generic (PLEG): container finished" podID="541f727f-0029-478f-8d85-5564ebf69e39" containerID="68813e8245964d0ccc074d5958d5b9ea4111eb9c427efae0d2cd4f41a1b706c9" exitCode=0 Mar 16 16:09:25 crc kubenswrapper[5120]: I0316 16:09:25.799444 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"541f727f-0029-478f-8d85-5564ebf69e39","Type":"ContainerDied","Data":"9b2894bf94fd0a5f629c27c18b9dc39ee6b5891b17eb82e4f2aa4c143642560c"} Mar 16 16:09:25 crc kubenswrapper[5120]: I0316 16:09:25.799494 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"541f727f-0029-478f-8d85-5564ebf69e39","Type":"ContainerDied","Data":"03099613dfca2741e4b69b0a978834647f02bfb4047659d45d1f738a4e71d529"} Mar 16 16:09:25 crc kubenswrapper[5120]: I0316 16:09:25.799508 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"541f727f-0029-478f-8d85-5564ebf69e39","Type":"ContainerDied","Data":"a6f0693285376eec11844789c00548cbeb181d7bebd74408be2d664549125136"} Mar 16 16:09:25 crc kubenswrapper[5120]: I0316 16:09:25.799521 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"541f727f-0029-478f-8d85-5564ebf69e39","Type":"ContainerDied","Data":"68813e8245964d0ccc074d5958d5b9ea4111eb9c427efae0d2cd4f41a1b706c9"} Mar 16 16:09:25 crc kubenswrapper[5120]: I0316 16:09:25.882856 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:09:26 crc kubenswrapper[5120]: I0316 16:09:26.016357 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/541f727f-0029-478f-8d85-5564ebf69e39-scripts\") pod \"541f727f-0029-478f-8d85-5564ebf69e39\" (UID: \"541f727f-0029-478f-8d85-5564ebf69e39\") " Mar 16 16:09:26 crc kubenswrapper[5120]: I0316 16:09:26.016467 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/541f727f-0029-478f-8d85-5564ebf69e39-config-data\") pod \"541f727f-0029-478f-8d85-5564ebf69e39\" (UID: \"541f727f-0029-478f-8d85-5564ebf69e39\") " Mar 16 16:09:26 crc kubenswrapper[5120]: I0316 16:09:26.016595 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/541f727f-0029-478f-8d85-5564ebf69e39-log-httpd\") pod \"541f727f-0029-478f-8d85-5564ebf69e39\" (UID: \"541f727f-0029-478f-8d85-5564ebf69e39\") " Mar 16 16:09:26 crc kubenswrapper[5120]: I0316 16:09:26.016637 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/541f727f-0029-478f-8d85-5564ebf69e39-combined-ca-bundle\") pod \"541f727f-0029-478f-8d85-5564ebf69e39\" (UID: \"541f727f-0029-478f-8d85-5564ebf69e39\") " Mar 16 16:09:26 crc kubenswrapper[5120]: I0316 16:09:26.016656 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xj7pp\" (UniqueName: \"kubernetes.io/projected/541f727f-0029-478f-8d85-5564ebf69e39-kube-api-access-xj7pp\") pod \"541f727f-0029-478f-8d85-5564ebf69e39\" (UID: \"541f727f-0029-478f-8d85-5564ebf69e39\") " Mar 16 16:09:26 crc kubenswrapper[5120]: I0316 16:09:26.016826 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/541f727f-0029-478f-8d85-5564ebf69e39-sg-core-conf-yaml\") pod \"541f727f-0029-478f-8d85-5564ebf69e39\" (UID: \"541f727f-0029-478f-8d85-5564ebf69e39\") " Mar 16 16:09:26 crc kubenswrapper[5120]: I0316 16:09:26.016938 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/541f727f-0029-478f-8d85-5564ebf69e39-run-httpd\") pod \"541f727f-0029-478f-8d85-5564ebf69e39\" (UID: \"541f727f-0029-478f-8d85-5564ebf69e39\") " Mar 16 16:09:26 crc kubenswrapper[5120]: I0316 16:09:26.017494 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/541f727f-0029-478f-8d85-5564ebf69e39-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "541f727f-0029-478f-8d85-5564ebf69e39" (UID: "541f727f-0029-478f-8d85-5564ebf69e39"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:09:26 crc kubenswrapper[5120]: I0316 16:09:26.017718 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/541f727f-0029-478f-8d85-5564ebf69e39-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "541f727f-0029-478f-8d85-5564ebf69e39" (UID: "541f727f-0029-478f-8d85-5564ebf69e39"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:09:26 crc kubenswrapper[5120]: I0316 16:09:26.022619 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/541f727f-0029-478f-8d85-5564ebf69e39-kube-api-access-xj7pp" (OuterVolumeSpecName: "kube-api-access-xj7pp") pod "541f727f-0029-478f-8d85-5564ebf69e39" (UID: "541f727f-0029-478f-8d85-5564ebf69e39"). InnerVolumeSpecName "kube-api-access-xj7pp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:09:26 crc kubenswrapper[5120]: I0316 16:09:26.022642 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/541f727f-0029-478f-8d85-5564ebf69e39-scripts" (OuterVolumeSpecName: "scripts") pod "541f727f-0029-478f-8d85-5564ebf69e39" (UID: "541f727f-0029-478f-8d85-5564ebf69e39"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:09:26 crc kubenswrapper[5120]: I0316 16:09:26.043276 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/541f727f-0029-478f-8d85-5564ebf69e39-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "541f727f-0029-478f-8d85-5564ebf69e39" (UID: "541f727f-0029-478f-8d85-5564ebf69e39"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:09:26 crc kubenswrapper[5120]: I0316 16:09:26.090301 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/541f727f-0029-478f-8d85-5564ebf69e39-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "541f727f-0029-478f-8d85-5564ebf69e39" (UID: "541f727f-0029-478f-8d85-5564ebf69e39"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:09:26 crc kubenswrapper[5120]: I0316 16:09:26.112364 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/541f727f-0029-478f-8d85-5564ebf69e39-config-data" (OuterVolumeSpecName: "config-data") pod "541f727f-0029-478f-8d85-5564ebf69e39" (UID: "541f727f-0029-478f-8d85-5564ebf69e39"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:09:26 crc kubenswrapper[5120]: I0316 16:09:26.119881 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/541f727f-0029-478f-8d85-5564ebf69e39-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:09:26 crc kubenswrapper[5120]: I0316 16:09:26.119915 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/541f727f-0029-478f-8d85-5564ebf69e39-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:09:26 crc kubenswrapper[5120]: I0316 16:09:26.119926 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xj7pp\" (UniqueName: \"kubernetes.io/projected/541f727f-0029-478f-8d85-5564ebf69e39-kube-api-access-xj7pp\") on node \"crc\" DevicePath \"\"" Mar 16 16:09:26 crc kubenswrapper[5120]: I0316 16:09:26.119936 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/541f727f-0029-478f-8d85-5564ebf69e39-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 16:09:26 crc kubenswrapper[5120]: I0316 16:09:26.119946 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/541f727f-0029-478f-8d85-5564ebf69e39-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:09:26 crc kubenswrapper[5120]: I0316 16:09:26.119954 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/541f727f-0029-478f-8d85-5564ebf69e39-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:09:26 crc kubenswrapper[5120]: I0316 16:09:26.119964 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/541f727f-0029-478f-8d85-5564ebf69e39-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:09:26 crc kubenswrapper[5120]: I0316 16:09:26.688041 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ee5ec352-b355-48cc-b7b4-8782a1af4455" path="/var/lib/kubelet/pods/ee5ec352-b355-48cc-b7b4-8782a1af4455/volumes" Mar 16 16:09:26 crc kubenswrapper[5120]: I0316 16:09:26.809265 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"2bffb613-2e18-4306-a611-5ff4541a74fa","Type":"ContainerStarted","Data":"2dfb7015f6cedd8bf6b512a23ecaeb094fb4bc91be51c745345aa9e371156357"} Mar 16 16:09:26 crc kubenswrapper[5120]: I0316 16:09:26.809323 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="2bffb613-2e18-4306-a611-5ff4541a74fa" containerName="nova-cell0-conductor-conductor" containerID="cri-o://2dfb7015f6cedd8bf6b512a23ecaeb094fb4bc91be51c745345aa9e371156357" gracePeriod=30 Mar 16 16:09:26 crc kubenswrapper[5120]: I0316 16:09:26.809373 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:09:26 crc kubenswrapper[5120]: I0316 16:09:26.818868 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"541f727f-0029-478f-8d85-5564ebf69e39","Type":"ContainerDied","Data":"55c1198eb5ae9e23b7dcfe1c1e62f50ea08c647d9664ab4e7d701f24440f685f"} Mar 16 16:09:26 crc kubenswrapper[5120]: I0316 16:09:26.818934 5120 scope.go:117] "RemoveContainer" containerID="9b2894bf94fd0a5f629c27c18b9dc39ee6b5891b17eb82e4f2aa4c143642560c" Mar 16 16:09:26 crc kubenswrapper[5120]: I0316 16:09:26.819108 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:09:26 crc kubenswrapper[5120]: I0316 16:09:26.843706 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podStartSLOduration=2.843681628 podStartE2EDuration="2.843681628s" podCreationTimestamp="2026-03-16 16:09:24 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:09:26.830252573 +0000 UTC m=+2268.984184230" watchObservedRunningTime="2026-03-16 16:09:26.843681628 +0000 UTC m=+2268.997613285" Mar 16 16:09:26 crc kubenswrapper[5120]: I0316 16:09:26.847580 5120 scope.go:117] "RemoveContainer" containerID="03099613dfca2741e4b69b0a978834647f02bfb4047659d45d1f738a4e71d529" Mar 16 16:09:26 crc kubenswrapper[5120]: I0316 16:09:26.858285 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:09:26 crc kubenswrapper[5120]: I0316 16:09:26.868264 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:09:26 crc kubenswrapper[5120]: I0316 16:09:26.874090 5120 scope.go:117] "RemoveContainer" containerID="a6f0693285376eec11844789c00548cbeb181d7bebd74408be2d664549125136" Mar 16 16:09:26 crc kubenswrapper[5120]: I0316 16:09:26.883226 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:09:26 crc kubenswrapper[5120]: I0316 16:09:26.884204 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="541f727f-0029-478f-8d85-5564ebf69e39" containerName="proxy-httpd" Mar 16 16:09:26 crc kubenswrapper[5120]: I0316 16:09:26.884225 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="541f727f-0029-478f-8d85-5564ebf69e39" containerName="proxy-httpd" Mar 16 16:09:26 crc kubenswrapper[5120]: I0316 16:09:26.884250 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="541f727f-0029-478f-8d85-5564ebf69e39" containerName="ceilometer-central-agent" Mar 16 16:09:26 crc kubenswrapper[5120]: I0316 16:09:26.884256 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="541f727f-0029-478f-8d85-5564ebf69e39" containerName="ceilometer-central-agent" Mar 16 16:09:26 crc kubenswrapper[5120]: I0316 16:09:26.884278 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="541f727f-0029-478f-8d85-5564ebf69e39" containerName="ceilometer-notification-agent" Mar 16 16:09:26 crc kubenswrapper[5120]: I0316 16:09:26.884284 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="541f727f-0029-478f-8d85-5564ebf69e39" containerName="ceilometer-notification-agent" Mar 16 16:09:26 crc kubenswrapper[5120]: I0316 16:09:26.884317 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="541f727f-0029-478f-8d85-5564ebf69e39" containerName="sg-core" Mar 16 16:09:26 crc kubenswrapper[5120]: I0316 16:09:26.884323 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="541f727f-0029-478f-8d85-5564ebf69e39" containerName="sg-core" Mar 16 16:09:26 crc kubenswrapper[5120]: I0316 16:09:26.884459 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="541f727f-0029-478f-8d85-5564ebf69e39" containerName="ceilometer-notification-agent" Mar 16 16:09:26 crc kubenswrapper[5120]: I0316 16:09:26.884468 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="541f727f-0029-478f-8d85-5564ebf69e39" containerName="proxy-httpd" Mar 16 16:09:26 crc kubenswrapper[5120]: I0316 16:09:26.884477 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="541f727f-0029-478f-8d85-5564ebf69e39" containerName="ceilometer-central-agent" Mar 16 16:09:26 crc kubenswrapper[5120]: I0316 16:09:26.884486 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="541f727f-0029-478f-8d85-5564ebf69e39" containerName="sg-core" Mar 16 16:09:26 crc kubenswrapper[5120]: I0316 16:09:26.890080 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:09:26 crc kubenswrapper[5120]: I0316 16:09:26.893170 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 16:09:26 crc kubenswrapper[5120]: I0316 16:09:26.899062 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 16:09:26 crc kubenswrapper[5120]: I0316 16:09:26.903443 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:09:26 crc kubenswrapper[5120]: I0316 16:09:26.927217 5120 scope.go:117] "RemoveContainer" containerID="68813e8245964d0ccc074d5958d5b9ea4111eb9c427efae0d2cd4f41a1b706c9" Mar 16 16:09:27 crc kubenswrapper[5120]: I0316 16:09:27.038503 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/dcd54792-0a6d-4ca3-b647-cb137f34c2e8-log-httpd\") pod \"ceilometer-0\" (UID: \"dcd54792-0a6d-4ca3-b647-cb137f34c2e8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:09:27 crc kubenswrapper[5120]: I0316 16:09:27.038615 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/dcd54792-0a6d-4ca3-b647-cb137f34c2e8-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"dcd54792-0a6d-4ca3-b647-cb137f34c2e8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:09:27 crc kubenswrapper[5120]: I0316 16:09:27.038650 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46dv8\" (UniqueName: \"kubernetes.io/projected/dcd54792-0a6d-4ca3-b647-cb137f34c2e8-kube-api-access-46dv8\") pod \"ceilometer-0\" (UID: \"dcd54792-0a6d-4ca3-b647-cb137f34c2e8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:09:27 crc kubenswrapper[5120]: I0316 16:09:27.038699 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dcd54792-0a6d-4ca3-b647-cb137f34c2e8-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"dcd54792-0a6d-4ca3-b647-cb137f34c2e8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:09:27 crc kubenswrapper[5120]: I0316 16:09:27.038799 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/dcd54792-0a6d-4ca3-b647-cb137f34c2e8-scripts\") pod \"ceilometer-0\" (UID: \"dcd54792-0a6d-4ca3-b647-cb137f34c2e8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:09:27 crc kubenswrapper[5120]: I0316 16:09:27.038825 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/dcd54792-0a6d-4ca3-b647-cb137f34c2e8-run-httpd\") pod \"ceilometer-0\" (UID: \"dcd54792-0a6d-4ca3-b647-cb137f34c2e8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:09:27 crc kubenswrapper[5120]: I0316 16:09:27.039006 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dcd54792-0a6d-4ca3-b647-cb137f34c2e8-config-data\") pod \"ceilometer-0\" (UID: \"dcd54792-0a6d-4ca3-b647-cb137f34c2e8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:09:27 crc kubenswrapper[5120]: I0316 16:09:27.133477 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:09:27 crc kubenswrapper[5120]: E0316 16:09:27.134333 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[combined-ca-bundle config-data kube-api-access-46dv8 log-httpd run-httpd scripts sg-core-conf-yaml], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openstack-kuttl-tests/ceilometer-0" podUID="dcd54792-0a6d-4ca3-b647-cb137f34c2e8" Mar 16 16:09:27 crc kubenswrapper[5120]: I0316 16:09:27.141247 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/dcd54792-0a6d-4ca3-b647-cb137f34c2e8-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"dcd54792-0a6d-4ca3-b647-cb137f34c2e8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:09:27 crc kubenswrapper[5120]: I0316 16:09:27.142355 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-46dv8\" (UniqueName: \"kubernetes.io/projected/dcd54792-0a6d-4ca3-b647-cb137f34c2e8-kube-api-access-46dv8\") pod \"ceilometer-0\" (UID: \"dcd54792-0a6d-4ca3-b647-cb137f34c2e8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:09:27 crc kubenswrapper[5120]: I0316 16:09:27.142546 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dcd54792-0a6d-4ca3-b647-cb137f34c2e8-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"dcd54792-0a6d-4ca3-b647-cb137f34c2e8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:09:27 crc kubenswrapper[5120]: I0316 16:09:27.142829 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/dcd54792-0a6d-4ca3-b647-cb137f34c2e8-scripts\") pod \"ceilometer-0\" (UID: \"dcd54792-0a6d-4ca3-b647-cb137f34c2e8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:09:27 crc kubenswrapper[5120]: I0316 16:09:27.142986 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/dcd54792-0a6d-4ca3-b647-cb137f34c2e8-run-httpd\") pod \"ceilometer-0\" (UID: \"dcd54792-0a6d-4ca3-b647-cb137f34c2e8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:09:27 crc kubenswrapper[5120]: I0316 16:09:27.143306 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dcd54792-0a6d-4ca3-b647-cb137f34c2e8-config-data\") pod \"ceilometer-0\" (UID: \"dcd54792-0a6d-4ca3-b647-cb137f34c2e8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:09:27 crc kubenswrapper[5120]: I0316 16:09:27.143450 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/dcd54792-0a6d-4ca3-b647-cb137f34c2e8-run-httpd\") pod \"ceilometer-0\" (UID: \"dcd54792-0a6d-4ca3-b647-cb137f34c2e8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:09:27 crc kubenswrapper[5120]: I0316 16:09:27.143462 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/dcd54792-0a6d-4ca3-b647-cb137f34c2e8-log-httpd\") pod \"ceilometer-0\" (UID: \"dcd54792-0a6d-4ca3-b647-cb137f34c2e8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:09:27 crc kubenswrapper[5120]: I0316 16:09:27.144045 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/dcd54792-0a6d-4ca3-b647-cb137f34c2e8-log-httpd\") pod \"ceilometer-0\" (UID: \"dcd54792-0a6d-4ca3-b647-cb137f34c2e8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:09:27 crc kubenswrapper[5120]: I0316 16:09:27.147346 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/dcd54792-0a6d-4ca3-b647-cb137f34c2e8-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"dcd54792-0a6d-4ca3-b647-cb137f34c2e8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:09:27 crc kubenswrapper[5120]: I0316 16:09:27.148628 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dcd54792-0a6d-4ca3-b647-cb137f34c2e8-config-data\") pod \"ceilometer-0\" (UID: \"dcd54792-0a6d-4ca3-b647-cb137f34c2e8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:09:27 crc kubenswrapper[5120]: I0316 16:09:27.149441 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/dcd54792-0a6d-4ca3-b647-cb137f34c2e8-scripts\") pod \"ceilometer-0\" (UID: \"dcd54792-0a6d-4ca3-b647-cb137f34c2e8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:09:27 crc kubenswrapper[5120]: I0316 16:09:27.156116 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dcd54792-0a6d-4ca3-b647-cb137f34c2e8-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"dcd54792-0a6d-4ca3-b647-cb137f34c2e8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:09:27 crc kubenswrapper[5120]: I0316 16:09:27.158797 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-46dv8\" (UniqueName: \"kubernetes.io/projected/dcd54792-0a6d-4ca3-b647-cb137f34c2e8-kube-api-access-46dv8\") pod \"ceilometer-0\" (UID: \"dcd54792-0a6d-4ca3-b647-cb137f34c2e8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:09:27 crc kubenswrapper[5120]: I0316 16:09:27.834082 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:09:27 crc kubenswrapper[5120]: I0316 16:09:27.848952 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:09:27 crc kubenswrapper[5120]: I0316 16:09:27.959921 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-46dv8\" (UniqueName: \"kubernetes.io/projected/dcd54792-0a6d-4ca3-b647-cb137f34c2e8-kube-api-access-46dv8\") pod \"dcd54792-0a6d-4ca3-b647-cb137f34c2e8\" (UID: \"dcd54792-0a6d-4ca3-b647-cb137f34c2e8\") " Mar 16 16:09:27 crc kubenswrapper[5120]: I0316 16:09:27.960031 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/dcd54792-0a6d-4ca3-b647-cb137f34c2e8-log-httpd\") pod \"dcd54792-0a6d-4ca3-b647-cb137f34c2e8\" (UID: \"dcd54792-0a6d-4ca3-b647-cb137f34c2e8\") " Mar 16 16:09:27 crc kubenswrapper[5120]: I0316 16:09:27.960106 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dcd54792-0a6d-4ca3-b647-cb137f34c2e8-config-data\") pod \"dcd54792-0a6d-4ca3-b647-cb137f34c2e8\" (UID: \"dcd54792-0a6d-4ca3-b647-cb137f34c2e8\") " Mar 16 16:09:27 crc kubenswrapper[5120]: I0316 16:09:27.960148 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/dcd54792-0a6d-4ca3-b647-cb137f34c2e8-scripts\") pod \"dcd54792-0a6d-4ca3-b647-cb137f34c2e8\" (UID: \"dcd54792-0a6d-4ca3-b647-cb137f34c2e8\") " Mar 16 16:09:27 crc kubenswrapper[5120]: I0316 16:09:27.960205 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/dcd54792-0a6d-4ca3-b647-cb137f34c2e8-sg-core-conf-yaml\") pod \"dcd54792-0a6d-4ca3-b647-cb137f34c2e8\" (UID: \"dcd54792-0a6d-4ca3-b647-cb137f34c2e8\") " Mar 16 16:09:27 crc kubenswrapper[5120]: I0316 16:09:27.960246 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/dcd54792-0a6d-4ca3-b647-cb137f34c2e8-run-httpd\") pod \"dcd54792-0a6d-4ca3-b647-cb137f34c2e8\" (UID: \"dcd54792-0a6d-4ca3-b647-cb137f34c2e8\") " Mar 16 16:09:27 crc kubenswrapper[5120]: I0316 16:09:27.960294 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dcd54792-0a6d-4ca3-b647-cb137f34c2e8-combined-ca-bundle\") pod \"dcd54792-0a6d-4ca3-b647-cb137f34c2e8\" (UID: \"dcd54792-0a6d-4ca3-b647-cb137f34c2e8\") " Mar 16 16:09:27 crc kubenswrapper[5120]: I0316 16:09:27.960546 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dcd54792-0a6d-4ca3-b647-cb137f34c2e8-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "dcd54792-0a6d-4ca3-b647-cb137f34c2e8" (UID: "dcd54792-0a6d-4ca3-b647-cb137f34c2e8"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:09:27 crc kubenswrapper[5120]: I0316 16:09:27.960744 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dcd54792-0a6d-4ca3-b647-cb137f34c2e8-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "dcd54792-0a6d-4ca3-b647-cb137f34c2e8" (UID: "dcd54792-0a6d-4ca3-b647-cb137f34c2e8"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:09:27 crc kubenswrapper[5120]: I0316 16:09:27.961055 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/dcd54792-0a6d-4ca3-b647-cb137f34c2e8-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:09:27 crc kubenswrapper[5120]: I0316 16:09:27.961073 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/dcd54792-0a6d-4ca3-b647-cb137f34c2e8-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:09:27 crc kubenswrapper[5120]: I0316 16:09:27.965912 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dcd54792-0a6d-4ca3-b647-cb137f34c2e8-config-data" (OuterVolumeSpecName: "config-data") pod "dcd54792-0a6d-4ca3-b647-cb137f34c2e8" (UID: "dcd54792-0a6d-4ca3-b647-cb137f34c2e8"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:09:27 crc kubenswrapper[5120]: I0316 16:09:27.966901 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dcd54792-0a6d-4ca3-b647-cb137f34c2e8-scripts" (OuterVolumeSpecName: "scripts") pod "dcd54792-0a6d-4ca3-b647-cb137f34c2e8" (UID: "dcd54792-0a6d-4ca3-b647-cb137f34c2e8"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:09:27 crc kubenswrapper[5120]: I0316 16:09:27.966954 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dcd54792-0a6d-4ca3-b647-cb137f34c2e8-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "dcd54792-0a6d-4ca3-b647-cb137f34c2e8" (UID: "dcd54792-0a6d-4ca3-b647-cb137f34c2e8"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:09:27 crc kubenswrapper[5120]: I0316 16:09:27.968853 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dcd54792-0a6d-4ca3-b647-cb137f34c2e8-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "dcd54792-0a6d-4ca3-b647-cb137f34c2e8" (UID: "dcd54792-0a6d-4ca3-b647-cb137f34c2e8"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:09:27 crc kubenswrapper[5120]: I0316 16:09:27.969414 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dcd54792-0a6d-4ca3-b647-cb137f34c2e8-kube-api-access-46dv8" (OuterVolumeSpecName: "kube-api-access-46dv8") pod "dcd54792-0a6d-4ca3-b647-cb137f34c2e8" (UID: "dcd54792-0a6d-4ca3-b647-cb137f34c2e8"). InnerVolumeSpecName "kube-api-access-46dv8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:09:28 crc kubenswrapper[5120]: I0316 16:09:28.065248 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-46dv8\" (UniqueName: \"kubernetes.io/projected/dcd54792-0a6d-4ca3-b647-cb137f34c2e8-kube-api-access-46dv8\") on node \"crc\" DevicePath \"\"" Mar 16 16:09:28 crc kubenswrapper[5120]: I0316 16:09:28.065591 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dcd54792-0a6d-4ca3-b647-cb137f34c2e8-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:09:28 crc kubenswrapper[5120]: I0316 16:09:28.065755 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/dcd54792-0a6d-4ca3-b647-cb137f34c2e8-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:09:28 crc kubenswrapper[5120]: I0316 16:09:28.065960 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/dcd54792-0a6d-4ca3-b647-cb137f34c2e8-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 16:09:28 crc kubenswrapper[5120]: I0316 16:09:28.066151 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dcd54792-0a6d-4ca3-b647-cb137f34c2e8-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:09:28 crc kubenswrapper[5120]: I0316 16:09:28.688411 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="541f727f-0029-478f-8d85-5564ebf69e39" path="/var/lib/kubelet/pods/541f727f-0029-478f-8d85-5564ebf69e39/volumes" Mar 16 16:09:28 crc kubenswrapper[5120]: I0316 16:09:28.691837 5120 scope.go:117] "RemoveContainer" containerID="bc2df124cc6ad146d7c7dd2115ac815986fb62978d38895f6d345a4a9b14dbd8" Mar 16 16:09:28 crc kubenswrapper[5120]: E0316 16:09:28.692227 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:09:28 crc kubenswrapper[5120]: I0316 16:09:28.846929 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:09:28 crc kubenswrapper[5120]: I0316 16:09:28.904981 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:09:28 crc kubenswrapper[5120]: I0316 16:09:28.912215 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:09:28 crc kubenswrapper[5120]: I0316 16:09:28.939195 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:09:28 crc kubenswrapper[5120]: I0316 16:09:28.958137 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:09:28 crc kubenswrapper[5120]: I0316 16:09:28.958250 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:09:28 crc kubenswrapper[5120]: I0316 16:09:28.960698 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 16:09:28 crc kubenswrapper[5120]: I0316 16:09:28.961236 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 16:09:29 crc kubenswrapper[5120]: I0316 16:09:29.094120 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/73733c44-4d3b-4797-b839-cacdffc714a8-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"73733c44-4d3b-4797-b839-cacdffc714a8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:09:29 crc kubenswrapper[5120]: I0316 16:09:29.094232 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/73733c44-4d3b-4797-b839-cacdffc714a8-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"73733c44-4d3b-4797-b839-cacdffc714a8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:09:29 crc kubenswrapper[5120]: I0316 16:09:29.094264 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/73733c44-4d3b-4797-b839-cacdffc714a8-config-data\") pod \"ceilometer-0\" (UID: \"73733c44-4d3b-4797-b839-cacdffc714a8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:09:29 crc kubenswrapper[5120]: I0316 16:09:29.094340 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/73733c44-4d3b-4797-b839-cacdffc714a8-run-httpd\") pod \"ceilometer-0\" (UID: \"73733c44-4d3b-4797-b839-cacdffc714a8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:09:29 crc kubenswrapper[5120]: I0316 16:09:29.094397 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/73733c44-4d3b-4797-b839-cacdffc714a8-log-httpd\") pod \"ceilometer-0\" (UID: \"73733c44-4d3b-4797-b839-cacdffc714a8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:09:29 crc kubenswrapper[5120]: I0316 16:09:29.094435 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4nxsr\" (UniqueName: \"kubernetes.io/projected/73733c44-4d3b-4797-b839-cacdffc714a8-kube-api-access-4nxsr\") pod \"ceilometer-0\" (UID: \"73733c44-4d3b-4797-b839-cacdffc714a8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:09:29 crc kubenswrapper[5120]: I0316 16:09:29.094609 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/73733c44-4d3b-4797-b839-cacdffc714a8-scripts\") pod \"ceilometer-0\" (UID: \"73733c44-4d3b-4797-b839-cacdffc714a8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:09:29 crc kubenswrapper[5120]: I0316 16:09:29.197473 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/73733c44-4d3b-4797-b839-cacdffc714a8-log-httpd\") pod \"ceilometer-0\" (UID: \"73733c44-4d3b-4797-b839-cacdffc714a8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:09:29 crc kubenswrapper[5120]: I0316 16:09:29.197575 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4nxsr\" (UniqueName: \"kubernetes.io/projected/73733c44-4d3b-4797-b839-cacdffc714a8-kube-api-access-4nxsr\") pod \"ceilometer-0\" (UID: \"73733c44-4d3b-4797-b839-cacdffc714a8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:09:29 crc kubenswrapper[5120]: I0316 16:09:29.197702 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/73733c44-4d3b-4797-b839-cacdffc714a8-scripts\") pod \"ceilometer-0\" (UID: \"73733c44-4d3b-4797-b839-cacdffc714a8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:09:29 crc kubenswrapper[5120]: I0316 16:09:29.197856 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/73733c44-4d3b-4797-b839-cacdffc714a8-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"73733c44-4d3b-4797-b839-cacdffc714a8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:09:29 crc kubenswrapper[5120]: I0316 16:09:29.198101 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/73733c44-4d3b-4797-b839-cacdffc714a8-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"73733c44-4d3b-4797-b839-cacdffc714a8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:09:29 crc kubenswrapper[5120]: I0316 16:09:29.198146 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/73733c44-4d3b-4797-b839-cacdffc714a8-config-data\") pod \"ceilometer-0\" (UID: \"73733c44-4d3b-4797-b839-cacdffc714a8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:09:29 crc kubenswrapper[5120]: I0316 16:09:29.198210 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/73733c44-4d3b-4797-b839-cacdffc714a8-run-httpd\") pod \"ceilometer-0\" (UID: \"73733c44-4d3b-4797-b839-cacdffc714a8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:09:29 crc kubenswrapper[5120]: I0316 16:09:29.199521 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/73733c44-4d3b-4797-b839-cacdffc714a8-run-httpd\") pod \"ceilometer-0\" (UID: \"73733c44-4d3b-4797-b839-cacdffc714a8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:09:29 crc kubenswrapper[5120]: I0316 16:09:29.200878 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/73733c44-4d3b-4797-b839-cacdffc714a8-log-httpd\") pod \"ceilometer-0\" (UID: \"73733c44-4d3b-4797-b839-cacdffc714a8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:09:29 crc kubenswrapper[5120]: I0316 16:09:29.204740 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/73733c44-4d3b-4797-b839-cacdffc714a8-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"73733c44-4d3b-4797-b839-cacdffc714a8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:09:29 crc kubenswrapper[5120]: I0316 16:09:29.206385 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/73733c44-4d3b-4797-b839-cacdffc714a8-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"73733c44-4d3b-4797-b839-cacdffc714a8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:09:29 crc kubenswrapper[5120]: I0316 16:09:29.214492 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/73733c44-4d3b-4797-b839-cacdffc714a8-scripts\") pod \"ceilometer-0\" (UID: \"73733c44-4d3b-4797-b839-cacdffc714a8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:09:29 crc kubenswrapper[5120]: I0316 16:09:29.216667 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/73733c44-4d3b-4797-b839-cacdffc714a8-config-data\") pod \"ceilometer-0\" (UID: \"73733c44-4d3b-4797-b839-cacdffc714a8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:09:29 crc kubenswrapper[5120]: I0316 16:09:29.222328 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4nxsr\" (UniqueName: \"kubernetes.io/projected/73733c44-4d3b-4797-b839-cacdffc714a8-kube-api-access-4nxsr\") pod \"ceilometer-0\" (UID: \"73733c44-4d3b-4797-b839-cacdffc714a8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:09:29 crc kubenswrapper[5120]: I0316 16:09:29.275173 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:09:29 crc kubenswrapper[5120]: I0316 16:09:29.741966 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:09:29 crc kubenswrapper[5120]: W0316 16:09:29.753330 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod73733c44_4d3b_4797_b839_cacdffc714a8.slice/crio-343a9bea0bea158f29baa06aeeb2c819969e759f1a7f41b9214199b99d393b15 WatchSource:0}: Error finding container 343a9bea0bea158f29baa06aeeb2c819969e759f1a7f41b9214199b99d393b15: Status 404 returned error can't find the container with id 343a9bea0bea158f29baa06aeeb2c819969e759f1a7f41b9214199b99d393b15 Mar 16 16:09:29 crc kubenswrapper[5120]: I0316 16:09:29.862332 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"73733c44-4d3b-4797-b839-cacdffc714a8","Type":"ContainerStarted","Data":"343a9bea0bea158f29baa06aeeb2c819969e759f1a7f41b9214199b99d393b15"} Mar 16 16:09:30 crc kubenswrapper[5120]: I0316 16:09:30.681017 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dcd54792-0a6d-4ca3-b647-cb137f34c2e8" path="/var/lib/kubelet/pods/dcd54792-0a6d-4ca3-b647-cb137f34c2e8/volumes" Mar 16 16:09:30 crc kubenswrapper[5120]: I0316 16:09:30.881084 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"73733c44-4d3b-4797-b839-cacdffc714a8","Type":"ContainerStarted","Data":"6caf8b4bdc94e7e8a301f80e8e8b264137575e0a23c83ab620fa8ddf06787833"} Mar 16 16:09:31 crc kubenswrapper[5120]: E0316 16:09:31.813070 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="2dfb7015f6cedd8bf6b512a23ecaeb094fb4bc91be51c745345aa9e371156357" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:09:31 crc kubenswrapper[5120]: E0316 16:09:31.815246 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="2dfb7015f6cedd8bf6b512a23ecaeb094fb4bc91be51c745345aa9e371156357" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:09:31 crc kubenswrapper[5120]: E0316 16:09:31.817337 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="2dfb7015f6cedd8bf6b512a23ecaeb094fb4bc91be51c745345aa9e371156357" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:09:31 crc kubenswrapper[5120]: E0316 16:09:31.817428 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="2bffb613-2e18-4306-a611-5ff4541a74fa" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 16:09:32 crc kubenswrapper[5120]: I0316 16:09:32.920656 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"73733c44-4d3b-4797-b839-cacdffc714a8","Type":"ContainerStarted","Data":"e48aaa1b751c1b2afbdd9bdda084b4bd4c3d36caeac98b068ee965a33fa85ee0"} Mar 16 16:09:32 crc kubenswrapper[5120]: I0316 16:09:32.921309 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"73733c44-4d3b-4797-b839-cacdffc714a8","Type":"ContainerStarted","Data":"28ad945a4f00825a33604975a1201b4961f99d0ef1130ff20963ef1abf8d7343"} Mar 16 16:09:35 crc kubenswrapper[5120]: I0316 16:09:35.953504 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"73733c44-4d3b-4797-b839-cacdffc714a8","Type":"ContainerStarted","Data":"03a6a9abd07f8b62f69dab65419dd7dbe5c9dcb24e6f22ff10017e9d32a11780"} Mar 16 16:09:35 crc kubenswrapper[5120]: I0316 16:09:35.956051 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:09:35 crc kubenswrapper[5120]: I0316 16:09:35.978347 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.320298934 podStartE2EDuration="7.978216195s" podCreationTimestamp="2026-03-16 16:09:28 +0000 UTC" firstStartedPulling="2026-03-16 16:09:29.75590626 +0000 UTC m=+2271.909837907" lastFinishedPulling="2026-03-16 16:09:35.413823481 +0000 UTC m=+2277.567755168" observedRunningTime="2026-03-16 16:09:35.97803915 +0000 UTC m=+2278.131970847" watchObservedRunningTime="2026-03-16 16:09:35.978216195 +0000 UTC m=+2278.132147892" Mar 16 16:09:36 crc kubenswrapper[5120]: E0316 16:09:36.812269 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="2dfb7015f6cedd8bf6b512a23ecaeb094fb4bc91be51c745345aa9e371156357" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:09:36 crc kubenswrapper[5120]: E0316 16:09:36.814742 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="2dfb7015f6cedd8bf6b512a23ecaeb094fb4bc91be51c745345aa9e371156357" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:09:36 crc kubenswrapper[5120]: E0316 16:09:36.817028 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="2dfb7015f6cedd8bf6b512a23ecaeb094fb4bc91be51c745345aa9e371156357" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:09:36 crc kubenswrapper[5120]: E0316 16:09:36.817066 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="2bffb613-2e18-4306-a611-5ff4541a74fa" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 16:09:41 crc kubenswrapper[5120]: E0316 16:09:41.813177 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="2dfb7015f6cedd8bf6b512a23ecaeb094fb4bc91be51c745345aa9e371156357" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:09:41 crc kubenswrapper[5120]: E0316 16:09:41.816279 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="2dfb7015f6cedd8bf6b512a23ecaeb094fb4bc91be51c745345aa9e371156357" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:09:41 crc kubenswrapper[5120]: E0316 16:09:41.818257 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="2dfb7015f6cedd8bf6b512a23ecaeb094fb4bc91be51c745345aa9e371156357" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:09:41 crc kubenswrapper[5120]: E0316 16:09:41.818320 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="2bffb613-2e18-4306-a611-5ff4541a74fa" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 16:09:42 crc kubenswrapper[5120]: I0316 16:09:42.664483 5120 scope.go:117] "RemoveContainer" containerID="bc2df124cc6ad146d7c7dd2115ac815986fb62978d38895f6d345a4a9b14dbd8" Mar 16 16:09:42 crc kubenswrapper[5120]: E0316 16:09:42.665737 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:09:46 crc kubenswrapper[5120]: E0316 16:09:46.813613 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="2dfb7015f6cedd8bf6b512a23ecaeb094fb4bc91be51c745345aa9e371156357" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:09:46 crc kubenswrapper[5120]: E0316 16:09:46.816635 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="2dfb7015f6cedd8bf6b512a23ecaeb094fb4bc91be51c745345aa9e371156357" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:09:46 crc kubenswrapper[5120]: E0316 16:09:46.819351 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="2dfb7015f6cedd8bf6b512a23ecaeb094fb4bc91be51c745345aa9e371156357" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:09:46 crc kubenswrapper[5120]: E0316 16:09:46.819405 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="2bffb613-2e18-4306-a611-5ff4541a74fa" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 16:09:51 crc kubenswrapper[5120]: E0316 16:09:51.813302 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="2dfb7015f6cedd8bf6b512a23ecaeb094fb4bc91be51c745345aa9e371156357" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:09:51 crc kubenswrapper[5120]: E0316 16:09:51.816604 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="2dfb7015f6cedd8bf6b512a23ecaeb094fb4bc91be51c745345aa9e371156357" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:09:51 crc kubenswrapper[5120]: E0316 16:09:51.818851 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="2dfb7015f6cedd8bf6b512a23ecaeb094fb4bc91be51c745345aa9e371156357" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:09:51 crc kubenswrapper[5120]: E0316 16:09:51.818925 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="2bffb613-2e18-4306-a611-5ff4541a74fa" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 16:09:53 crc kubenswrapper[5120]: I0316 16:09:53.665560 5120 scope.go:117] "RemoveContainer" containerID="bc2df124cc6ad146d7c7dd2115ac815986fb62978d38895f6d345a4a9b14dbd8" Mar 16 16:09:53 crc kubenswrapper[5120]: E0316 16:09:53.666250 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:09:56 crc kubenswrapper[5120]: E0316 16:09:56.812131 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="2dfb7015f6cedd8bf6b512a23ecaeb094fb4bc91be51c745345aa9e371156357" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:09:56 crc kubenswrapper[5120]: E0316 16:09:56.813698 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="2dfb7015f6cedd8bf6b512a23ecaeb094fb4bc91be51c745345aa9e371156357" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:09:56 crc kubenswrapper[5120]: E0316 16:09:56.815296 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="2dfb7015f6cedd8bf6b512a23ecaeb094fb4bc91be51c745345aa9e371156357" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:09:56 crc kubenswrapper[5120]: E0316 16:09:56.815332 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="2bffb613-2e18-4306-a611-5ff4541a74fa" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 16:09:57 crc kubenswrapper[5120]: I0316 16:09:57.187829 5120 generic.go:358] "Generic (PLEG): container finished" podID="2bffb613-2e18-4306-a611-5ff4541a74fa" containerID="2dfb7015f6cedd8bf6b512a23ecaeb094fb4bc91be51c745345aa9e371156357" exitCode=137 Mar 16 16:09:57 crc kubenswrapper[5120]: I0316 16:09:57.187961 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"2bffb613-2e18-4306-a611-5ff4541a74fa","Type":"ContainerDied","Data":"2dfb7015f6cedd8bf6b512a23ecaeb094fb4bc91be51c745345aa9e371156357"} Mar 16 16:09:57 crc kubenswrapper[5120]: I0316 16:09:57.317343 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:09:57 crc kubenswrapper[5120]: I0316 16:09:57.402411 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2bffb613-2e18-4306-a611-5ff4541a74fa-combined-ca-bundle\") pod \"2bffb613-2e18-4306-a611-5ff4541a74fa\" (UID: \"2bffb613-2e18-4306-a611-5ff4541a74fa\") " Mar 16 16:09:57 crc kubenswrapper[5120]: I0316 16:09:57.402577 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2bffb613-2e18-4306-a611-5ff4541a74fa-config-data\") pod \"2bffb613-2e18-4306-a611-5ff4541a74fa\" (UID: \"2bffb613-2e18-4306-a611-5ff4541a74fa\") " Mar 16 16:09:57 crc kubenswrapper[5120]: I0316 16:09:57.402746 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d9wdg\" (UniqueName: \"kubernetes.io/projected/2bffb613-2e18-4306-a611-5ff4541a74fa-kube-api-access-d9wdg\") pod \"2bffb613-2e18-4306-a611-5ff4541a74fa\" (UID: \"2bffb613-2e18-4306-a611-5ff4541a74fa\") " Mar 16 16:09:57 crc kubenswrapper[5120]: I0316 16:09:57.408678 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2bffb613-2e18-4306-a611-5ff4541a74fa-kube-api-access-d9wdg" (OuterVolumeSpecName: "kube-api-access-d9wdg") pod "2bffb613-2e18-4306-a611-5ff4541a74fa" (UID: "2bffb613-2e18-4306-a611-5ff4541a74fa"). InnerVolumeSpecName "kube-api-access-d9wdg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:09:57 crc kubenswrapper[5120]: I0316 16:09:57.429132 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2bffb613-2e18-4306-a611-5ff4541a74fa-config-data" (OuterVolumeSpecName: "config-data") pod "2bffb613-2e18-4306-a611-5ff4541a74fa" (UID: "2bffb613-2e18-4306-a611-5ff4541a74fa"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:09:57 crc kubenswrapper[5120]: I0316 16:09:57.434432 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2bffb613-2e18-4306-a611-5ff4541a74fa-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "2bffb613-2e18-4306-a611-5ff4541a74fa" (UID: "2bffb613-2e18-4306-a611-5ff4541a74fa"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:09:57 crc kubenswrapper[5120]: I0316 16:09:57.505785 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d9wdg\" (UniqueName: \"kubernetes.io/projected/2bffb613-2e18-4306-a611-5ff4541a74fa-kube-api-access-d9wdg\") on node \"crc\" DevicePath \"\"" Mar 16 16:09:57 crc kubenswrapper[5120]: I0316 16:09:57.505825 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2bffb613-2e18-4306-a611-5ff4541a74fa-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:09:57 crc kubenswrapper[5120]: I0316 16:09:57.505840 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2bffb613-2e18-4306-a611-5ff4541a74fa-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:09:58 crc kubenswrapper[5120]: I0316 16:09:58.205614 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:09:58 crc kubenswrapper[5120]: I0316 16:09:58.205648 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"2bffb613-2e18-4306-a611-5ff4541a74fa","Type":"ContainerDied","Data":"f2472769c9ca2611ed2b9c95196f075126645a99a3b4943fd39694d766349c79"} Mar 16 16:09:58 crc kubenswrapper[5120]: I0316 16:09:58.205741 5120 scope.go:117] "RemoveContainer" containerID="2dfb7015f6cedd8bf6b512a23ecaeb094fb4bc91be51c745345aa9e371156357" Mar 16 16:09:58 crc kubenswrapper[5120]: I0316 16:09:58.243664 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:09:58 crc kubenswrapper[5120]: I0316 16:09:58.262186 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:09:58 crc kubenswrapper[5120]: I0316 16:09:58.291731 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:09:58 crc kubenswrapper[5120]: I0316 16:09:58.292808 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2bffb613-2e18-4306-a611-5ff4541a74fa" containerName="nova-cell0-conductor-conductor" Mar 16 16:09:58 crc kubenswrapper[5120]: I0316 16:09:58.292833 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bffb613-2e18-4306-a611-5ff4541a74fa" containerName="nova-cell0-conductor-conductor" Mar 16 16:09:58 crc kubenswrapper[5120]: I0316 16:09:58.293040 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="2bffb613-2e18-4306-a611-5ff4541a74fa" containerName="nova-cell0-conductor-conductor" Mar 16 16:09:58 crc kubenswrapper[5120]: I0316 16:09:58.301676 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:09:58 crc kubenswrapper[5120]: I0316 16:09:58.306646 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-conductor-config-data\"" Mar 16 16:09:58 crc kubenswrapper[5120]: I0316 16:09:58.306872 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-nova-dockercfg-c26lm\"" Mar 16 16:09:58 crc kubenswrapper[5120]: I0316 16:09:58.308846 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:09:58 crc kubenswrapper[5120]: I0316 16:09:58.329105 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llvdt\" (UniqueName: \"kubernetes.io/projected/3e95e501-6a44-4736-aa20-72fe1a2bb1a8-kube-api-access-llvdt\") pod \"nova-cell0-conductor-0\" (UID: \"3e95e501-6a44-4736-aa20-72fe1a2bb1a8\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:09:58 crc kubenswrapper[5120]: I0316 16:09:58.329192 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3e95e501-6a44-4736-aa20-72fe1a2bb1a8-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"3e95e501-6a44-4736-aa20-72fe1a2bb1a8\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:09:58 crc kubenswrapper[5120]: I0316 16:09:58.329253 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3e95e501-6a44-4736-aa20-72fe1a2bb1a8-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"3e95e501-6a44-4736-aa20-72fe1a2bb1a8\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:09:58 crc kubenswrapper[5120]: I0316 16:09:58.431517 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-llvdt\" (UniqueName: \"kubernetes.io/projected/3e95e501-6a44-4736-aa20-72fe1a2bb1a8-kube-api-access-llvdt\") pod \"nova-cell0-conductor-0\" (UID: \"3e95e501-6a44-4736-aa20-72fe1a2bb1a8\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:09:58 crc kubenswrapper[5120]: I0316 16:09:58.431579 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3e95e501-6a44-4736-aa20-72fe1a2bb1a8-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"3e95e501-6a44-4736-aa20-72fe1a2bb1a8\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:09:58 crc kubenswrapper[5120]: I0316 16:09:58.431625 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3e95e501-6a44-4736-aa20-72fe1a2bb1a8-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"3e95e501-6a44-4736-aa20-72fe1a2bb1a8\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:09:58 crc kubenswrapper[5120]: I0316 16:09:58.438034 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3e95e501-6a44-4736-aa20-72fe1a2bb1a8-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"3e95e501-6a44-4736-aa20-72fe1a2bb1a8\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:09:58 crc kubenswrapper[5120]: I0316 16:09:58.438219 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3e95e501-6a44-4736-aa20-72fe1a2bb1a8-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"3e95e501-6a44-4736-aa20-72fe1a2bb1a8\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:09:58 crc kubenswrapper[5120]: I0316 16:09:58.452067 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-llvdt\" (UniqueName: \"kubernetes.io/projected/3e95e501-6a44-4736-aa20-72fe1a2bb1a8-kube-api-access-llvdt\") pod \"nova-cell0-conductor-0\" (UID: \"3e95e501-6a44-4736-aa20-72fe1a2bb1a8\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:09:58 crc kubenswrapper[5120]: I0316 16:09:58.640299 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:09:58 crc kubenswrapper[5120]: I0316 16:09:58.698358 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2bffb613-2e18-4306-a611-5ff4541a74fa" path="/var/lib/kubelet/pods/2bffb613-2e18-4306-a611-5ff4541a74fa/volumes" Mar 16 16:09:59 crc kubenswrapper[5120]: W0316 16:09:59.130414 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3e95e501_6a44_4736_aa20_72fe1a2bb1a8.slice/crio-2c66c59c6322d20003b51f1ccb91a8a721d0aa5c8c240427bfb5cf5d6c70698c WatchSource:0}: Error finding container 2c66c59c6322d20003b51f1ccb91a8a721d0aa5c8c240427bfb5cf5d6c70698c: Status 404 returned error can't find the container with id 2c66c59c6322d20003b51f1ccb91a8a721d0aa5c8c240427bfb5cf5d6c70698c Mar 16 16:09:59 crc kubenswrapper[5120]: I0316 16:09:59.134546 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:09:59 crc kubenswrapper[5120]: I0316 16:09:59.222830 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"3e95e501-6a44-4736-aa20-72fe1a2bb1a8","Type":"ContainerStarted","Data":"2c66c59c6322d20003b51f1ccb91a8a721d0aa5c8c240427bfb5cf5d6c70698c"} Mar 16 16:10:00 crc kubenswrapper[5120]: I0316 16:10:00.142984 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-infra/auto-csr-approver-29561290-dff9h"] Mar 16 16:10:00 crc kubenswrapper[5120]: I0316 16:10:00.150413 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561290-dff9h" Mar 16 16:10:00 crc kubenswrapper[5120]: I0316 16:10:00.153192 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561290-dff9h"] Mar 16 16:10:00 crc kubenswrapper[5120]: I0316 16:10:00.158585 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"kube-root-ca.crt\"" Mar 16 16:10:00 crc kubenswrapper[5120]: I0316 16:10:00.158959 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"openshift-service-ca.crt\"" Mar 16 16:10:00 crc kubenswrapper[5120]: I0316 16:10:00.159061 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-infra\"/\"csr-approver-sa-dockercfg-x2nsz\"" Mar 16 16:10:00 crc kubenswrapper[5120]: I0316 16:10:00.240209 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"3e95e501-6a44-4736-aa20-72fe1a2bb1a8","Type":"ContainerStarted","Data":"31a2fce1e20c5b62f2a74ffb53802354c75a971f977ab88fe1d0d2ac24820f8d"} Mar 16 16:10:00 crc kubenswrapper[5120]: I0316 16:10:00.240940 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:10:00 crc kubenswrapper[5120]: I0316 16:10:00.269900 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podStartSLOduration=2.269880619 podStartE2EDuration="2.269880619s" podCreationTimestamp="2026-03-16 16:09:58 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:10:00.254220514 +0000 UTC m=+2302.408152191" watchObservedRunningTime="2026-03-16 16:10:00.269880619 +0000 UTC m=+2302.423812276" Mar 16 16:10:00 crc kubenswrapper[5120]: I0316 16:10:00.274255 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqldb\" (UniqueName: \"kubernetes.io/projected/8b0556b7-9ad7-41d6-afd7-f1853c53d0aa-kube-api-access-xqldb\") pod \"auto-csr-approver-29561290-dff9h\" (UID: \"8b0556b7-9ad7-41d6-afd7-f1853c53d0aa\") " pod="openshift-infra/auto-csr-approver-29561290-dff9h" Mar 16 16:10:00 crc kubenswrapper[5120]: I0316 16:10:00.376367 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xqldb\" (UniqueName: \"kubernetes.io/projected/8b0556b7-9ad7-41d6-afd7-f1853c53d0aa-kube-api-access-xqldb\") pod \"auto-csr-approver-29561290-dff9h\" (UID: \"8b0556b7-9ad7-41d6-afd7-f1853c53d0aa\") " pod="openshift-infra/auto-csr-approver-29561290-dff9h" Mar 16 16:10:00 crc kubenswrapper[5120]: I0316 16:10:00.410691 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqldb\" (UniqueName: \"kubernetes.io/projected/8b0556b7-9ad7-41d6-afd7-f1853c53d0aa-kube-api-access-xqldb\") pod \"auto-csr-approver-29561290-dff9h\" (UID: \"8b0556b7-9ad7-41d6-afd7-f1853c53d0aa\") " pod="openshift-infra/auto-csr-approver-29561290-dff9h" Mar 16 16:10:00 crc kubenswrapper[5120]: I0316 16:10:00.484603 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561290-dff9h" Mar 16 16:10:00 crc kubenswrapper[5120]: I0316 16:10:00.978499 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561290-dff9h"] Mar 16 16:10:01 crc kubenswrapper[5120]: I0316 16:10:01.252325 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561290-dff9h" event={"ID":"8b0556b7-9ad7-41d6-afd7-f1853c53d0aa","Type":"ContainerStarted","Data":"2607ba1e17964631f9bdf55a82625507b6db9762cb1f51f0365908403ae0bd49"} Mar 16 16:10:01 crc kubenswrapper[5120]: I0316 16:10:01.903311 5120 scope.go:117] "RemoveContainer" containerID="4332146db136bb0f7c8338516ee5e78eea0c4e33906493f9ac0fc28c73e1b585" Mar 16 16:10:01 crc kubenswrapper[5120]: I0316 16:10:01.930939 5120 scope.go:117] "RemoveContainer" containerID="0adc4c6a96adb90fb734129ae943d50e79b0e6e457fe8f3e8d125e60e78f5908" Mar 16 16:10:01 crc kubenswrapper[5120]: I0316 16:10:01.974697 5120 scope.go:117] "RemoveContainer" containerID="028a09947c0847095e60707c2ea9b516a2fe50c377455be0ff8782b5e885df95" Mar 16 16:10:03 crc kubenswrapper[5120]: I0316 16:10:03.274705 5120 generic.go:358] "Generic (PLEG): container finished" podID="8b0556b7-9ad7-41d6-afd7-f1853c53d0aa" containerID="3045f1ee7ec0dab437ed2fef6fb5bc64b10f78943640e4007f7e41fe05c275cc" exitCode=0 Mar 16 16:10:03 crc kubenswrapper[5120]: I0316 16:10:03.274796 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561290-dff9h" event={"ID":"8b0556b7-9ad7-41d6-afd7-f1853c53d0aa","Type":"ContainerDied","Data":"3045f1ee7ec0dab437ed2fef6fb5bc64b10f78943640e4007f7e41fe05c275cc"} Mar 16 16:10:04 crc kubenswrapper[5120]: I0316 16:10:04.685872 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561290-dff9h" Mar 16 16:10:04 crc kubenswrapper[5120]: I0316 16:10:04.776896 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xqldb\" (UniqueName: \"kubernetes.io/projected/8b0556b7-9ad7-41d6-afd7-f1853c53d0aa-kube-api-access-xqldb\") pod \"8b0556b7-9ad7-41d6-afd7-f1853c53d0aa\" (UID: \"8b0556b7-9ad7-41d6-afd7-f1853c53d0aa\") " Mar 16 16:10:04 crc kubenswrapper[5120]: I0316 16:10:04.782578 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b0556b7-9ad7-41d6-afd7-f1853c53d0aa-kube-api-access-xqldb" (OuterVolumeSpecName: "kube-api-access-xqldb") pod "8b0556b7-9ad7-41d6-afd7-f1853c53d0aa" (UID: "8b0556b7-9ad7-41d6-afd7-f1853c53d0aa"). InnerVolumeSpecName "kube-api-access-xqldb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:10:04 crc kubenswrapper[5120]: I0316 16:10:04.879659 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xqldb\" (UniqueName: \"kubernetes.io/projected/8b0556b7-9ad7-41d6-afd7-f1853c53d0aa-kube-api-access-xqldb\") on node \"crc\" DevicePath \"\"" Mar 16 16:10:05 crc kubenswrapper[5120]: I0316 16:10:05.298038 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561290-dff9h" Mar 16 16:10:05 crc kubenswrapper[5120]: I0316 16:10:05.298050 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561290-dff9h" event={"ID":"8b0556b7-9ad7-41d6-afd7-f1853c53d0aa","Type":"ContainerDied","Data":"2607ba1e17964631f9bdf55a82625507b6db9762cb1f51f0365908403ae0bd49"} Mar 16 16:10:05 crc kubenswrapper[5120]: I0316 16:10:05.298114 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2607ba1e17964631f9bdf55a82625507b6db9762cb1f51f0365908403ae0bd49" Mar 16 16:10:05 crc kubenswrapper[5120]: I0316 16:10:05.764417 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-infra/auto-csr-approver-29561284-dwp8z"] Mar 16 16:10:05 crc kubenswrapper[5120]: I0316 16:10:05.772829 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-infra/auto-csr-approver-29561284-dwp8z"] Mar 16 16:10:06 crc kubenswrapper[5120]: I0316 16:10:06.290053 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:10:06 crc kubenswrapper[5120]: I0316 16:10:06.663459 5120 scope.go:117] "RemoveContainer" containerID="bc2df124cc6ad146d7c7dd2115ac815986fb62978d38895f6d345a4a9b14dbd8" Mar 16 16:10:06 crc kubenswrapper[5120]: E0316 16:10:06.663779 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:10:06 crc kubenswrapper[5120]: I0316 16:10:06.675337 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cdea2a15-eb34-4b5c-8c3f-e40fd48b5081" path="/var/lib/kubelet/pods/cdea2a15-eb34-4b5c-8c3f-e40fd48b5081/volumes" Mar 16 16:10:06 crc kubenswrapper[5120]: I0316 16:10:06.755512 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-qm2tb"] Mar 16 16:10:06 crc kubenswrapper[5120]: I0316 16:10:06.756639 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b0556b7-9ad7-41d6-afd7-f1853c53d0aa" containerName="oc" Mar 16 16:10:06 crc kubenswrapper[5120]: I0316 16:10:06.756661 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b0556b7-9ad7-41d6-afd7-f1853c53d0aa" containerName="oc" Mar 16 16:10:06 crc kubenswrapper[5120]: I0316 16:10:06.756949 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="8b0556b7-9ad7-41d6-afd7-f1853c53d0aa" containerName="oc" Mar 16 16:10:06 crc kubenswrapper[5120]: I0316 16:10:06.763766 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-qm2tb" Mar 16 16:10:06 crc kubenswrapper[5120]: I0316 16:10:06.767112 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-qm2tb"] Mar 16 16:10:06 crc kubenswrapper[5120]: I0316 16:10:06.767947 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-manage-scripts\"" Mar 16 16:10:06 crc kubenswrapper[5120]: I0316 16:10:06.768007 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-manage-config-data\"" Mar 16 16:10:06 crc kubenswrapper[5120]: I0316 16:10:06.832661 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrlv6\" (UniqueName: \"kubernetes.io/projected/f9c983a9-b335-4d5a-91a7-d8f4d332ba77-kube-api-access-rrlv6\") pod \"nova-cell0-cell-mapping-qm2tb\" (UID: \"f9c983a9-b335-4d5a-91a7-d8f4d332ba77\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-qm2tb" Mar 16 16:10:06 crc kubenswrapper[5120]: I0316 16:10:06.832786 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f9c983a9-b335-4d5a-91a7-d8f4d332ba77-config-data\") pod \"nova-cell0-cell-mapping-qm2tb\" (UID: \"f9c983a9-b335-4d5a-91a7-d8f4d332ba77\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-qm2tb" Mar 16 16:10:06 crc kubenswrapper[5120]: I0316 16:10:06.832877 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f9c983a9-b335-4d5a-91a7-d8f4d332ba77-scripts\") pod \"nova-cell0-cell-mapping-qm2tb\" (UID: \"f9c983a9-b335-4d5a-91a7-d8f4d332ba77\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-qm2tb" Mar 16 16:10:06 crc kubenswrapper[5120]: I0316 16:10:06.832975 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f9c983a9-b335-4d5a-91a7-d8f4d332ba77-combined-ca-bundle\") pod \"nova-cell0-cell-mapping-qm2tb\" (UID: \"f9c983a9-b335-4d5a-91a7-d8f4d332ba77\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-qm2tb" Mar 16 16:10:06 crc kubenswrapper[5120]: I0316 16:10:06.900775 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:10:06 crc kubenswrapper[5120]: I0316 16:10:06.908277 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:10:06 crc kubenswrapper[5120]: I0316 16:10:06.913236 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-config-data\"" Mar 16 16:10:06 crc kubenswrapper[5120]: I0316 16:10:06.924223 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:10:06 crc kubenswrapper[5120]: I0316 16:10:06.934287 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/031c7932-9816-4571-8397-f517a70caf41-logs\") pod \"nova-api-0\" (UID: \"031c7932-9816-4571-8397-f517a70caf41\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:10:06 crc kubenswrapper[5120]: I0316 16:10:06.935608 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rrlv6\" (UniqueName: \"kubernetes.io/projected/f9c983a9-b335-4d5a-91a7-d8f4d332ba77-kube-api-access-rrlv6\") pod \"nova-cell0-cell-mapping-qm2tb\" (UID: \"f9c983a9-b335-4d5a-91a7-d8f4d332ba77\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-qm2tb" Mar 16 16:10:06 crc kubenswrapper[5120]: I0316 16:10:06.935812 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rw6fb\" (UniqueName: \"kubernetes.io/projected/031c7932-9816-4571-8397-f517a70caf41-kube-api-access-rw6fb\") pod \"nova-api-0\" (UID: \"031c7932-9816-4571-8397-f517a70caf41\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:10:06 crc kubenswrapper[5120]: I0316 16:10:06.936013 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f9c983a9-b335-4d5a-91a7-d8f4d332ba77-config-data\") pod \"nova-cell0-cell-mapping-qm2tb\" (UID: \"f9c983a9-b335-4d5a-91a7-d8f4d332ba77\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-qm2tb" Mar 16 16:10:06 crc kubenswrapper[5120]: I0316 16:10:06.936184 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f9c983a9-b335-4d5a-91a7-d8f4d332ba77-scripts\") pod \"nova-cell0-cell-mapping-qm2tb\" (UID: \"f9c983a9-b335-4d5a-91a7-d8f4d332ba77\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-qm2tb" Mar 16 16:10:06 crc kubenswrapper[5120]: I0316 16:10:06.936384 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/031c7932-9816-4571-8397-f517a70caf41-config-data\") pod \"nova-api-0\" (UID: \"031c7932-9816-4571-8397-f517a70caf41\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:10:06 crc kubenswrapper[5120]: I0316 16:10:06.936495 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f9c983a9-b335-4d5a-91a7-d8f4d332ba77-combined-ca-bundle\") pod \"nova-cell0-cell-mapping-qm2tb\" (UID: \"f9c983a9-b335-4d5a-91a7-d8f4d332ba77\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-qm2tb" Mar 16 16:10:06 crc kubenswrapper[5120]: I0316 16:10:06.936657 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/031c7932-9816-4571-8397-f517a70caf41-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"031c7932-9816-4571-8397-f517a70caf41\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:10:06 crc kubenswrapper[5120]: I0316 16:10:06.953424 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f9c983a9-b335-4d5a-91a7-d8f4d332ba77-config-data\") pod \"nova-cell0-cell-mapping-qm2tb\" (UID: \"f9c983a9-b335-4d5a-91a7-d8f4d332ba77\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-qm2tb" Mar 16 16:10:06 crc kubenswrapper[5120]: I0316 16:10:06.954374 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f9c983a9-b335-4d5a-91a7-d8f4d332ba77-combined-ca-bundle\") pod \"nova-cell0-cell-mapping-qm2tb\" (UID: \"f9c983a9-b335-4d5a-91a7-d8f4d332ba77\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-qm2tb" Mar 16 16:10:06 crc kubenswrapper[5120]: I0316 16:10:06.959017 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f9c983a9-b335-4d5a-91a7-d8f4d332ba77-scripts\") pod \"nova-cell0-cell-mapping-qm2tb\" (UID: \"f9c983a9-b335-4d5a-91a7-d8f4d332ba77\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-qm2tb" Mar 16 16:10:06 crc kubenswrapper[5120]: I0316 16:10:06.964912 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrlv6\" (UniqueName: \"kubernetes.io/projected/f9c983a9-b335-4d5a-91a7-d8f4d332ba77-kube-api-access-rrlv6\") pod \"nova-cell0-cell-mapping-qm2tb\" (UID: \"f9c983a9-b335-4d5a-91a7-d8f4d332ba77\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-qm2tb" Mar 16 16:10:06 crc kubenswrapper[5120]: I0316 16:10:06.973797 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:10:07 crc kubenswrapper[5120]: I0316 16:10:07.002960 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:10:07 crc kubenswrapper[5120]: I0316 16:10:07.010115 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-scheduler-config-data\"" Mar 16 16:10:07 crc kubenswrapper[5120]: I0316 16:10:07.032083 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:10:07 crc kubenswrapper[5120]: I0316 16:10:07.049389 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/031c7932-9816-4571-8397-f517a70caf41-logs\") pod \"nova-api-0\" (UID: \"031c7932-9816-4571-8397-f517a70caf41\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:10:07 crc kubenswrapper[5120]: I0316 16:10:07.049454 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rw6fb\" (UniqueName: \"kubernetes.io/projected/031c7932-9816-4571-8397-f517a70caf41-kube-api-access-rw6fb\") pod \"nova-api-0\" (UID: \"031c7932-9816-4571-8397-f517a70caf41\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:10:07 crc kubenswrapper[5120]: I0316 16:10:07.049480 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6vk9\" (UniqueName: \"kubernetes.io/projected/28e5ecb8-7c04-4dbc-a8eb-981851f81690-kube-api-access-w6vk9\") pod \"nova-scheduler-0\" (UID: \"28e5ecb8-7c04-4dbc-a8eb-981851f81690\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:10:07 crc kubenswrapper[5120]: I0316 16:10:07.049560 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/28e5ecb8-7c04-4dbc-a8eb-981851f81690-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"28e5ecb8-7c04-4dbc-a8eb-981851f81690\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:10:07 crc kubenswrapper[5120]: I0316 16:10:07.049976 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/031c7932-9816-4571-8397-f517a70caf41-logs\") pod \"nova-api-0\" (UID: \"031c7932-9816-4571-8397-f517a70caf41\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:10:07 crc kubenswrapper[5120]: I0316 16:10:07.050032 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/031c7932-9816-4571-8397-f517a70caf41-config-data\") pod \"nova-api-0\" (UID: \"031c7932-9816-4571-8397-f517a70caf41\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:10:07 crc kubenswrapper[5120]: I0316 16:10:07.050124 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/28e5ecb8-7c04-4dbc-a8eb-981851f81690-config-data\") pod \"nova-scheduler-0\" (UID: \"28e5ecb8-7c04-4dbc-a8eb-981851f81690\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:10:07 crc kubenswrapper[5120]: I0316 16:10:07.050242 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/031c7932-9816-4571-8397-f517a70caf41-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"031c7932-9816-4571-8397-f517a70caf41\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:10:07 crc kubenswrapper[5120]: I0316 16:10:07.062780 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/031c7932-9816-4571-8397-f517a70caf41-config-data\") pod \"nova-api-0\" (UID: \"031c7932-9816-4571-8397-f517a70caf41\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:10:07 crc kubenswrapper[5120]: I0316 16:10:07.067246 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:10:07 crc kubenswrapper[5120]: I0316 16:10:07.074559 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/031c7932-9816-4571-8397-f517a70caf41-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"031c7932-9816-4571-8397-f517a70caf41\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:10:07 crc kubenswrapper[5120]: I0316 16:10:07.075621 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rw6fb\" (UniqueName: \"kubernetes.io/projected/031c7932-9816-4571-8397-f517a70caf41-kube-api-access-rw6fb\") pod \"nova-api-0\" (UID: \"031c7932-9816-4571-8397-f517a70caf41\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:10:07 crc kubenswrapper[5120]: I0316 16:10:07.084527 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:10:07 crc kubenswrapper[5120]: I0316 16:10:07.086783 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-metadata-config-data\"" Mar 16 16:10:07 crc kubenswrapper[5120]: I0316 16:10:07.097704 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:10:07 crc kubenswrapper[5120]: I0316 16:10:07.112415 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-qm2tb" Mar 16 16:10:07 crc kubenswrapper[5120]: I0316 16:10:07.154075 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5fcff8de-c0b5-4d91-ab9d-2aa62341c696-config-data\") pod \"nova-metadata-0\" (UID: \"5fcff8de-c0b5-4d91-ab9d-2aa62341c696\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:10:07 crc kubenswrapper[5120]: I0316 16:10:07.154162 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5fcff8de-c0b5-4d91-ab9d-2aa62341c696-logs\") pod \"nova-metadata-0\" (UID: \"5fcff8de-c0b5-4d91-ab9d-2aa62341c696\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:10:07 crc kubenswrapper[5120]: I0316 16:10:07.154216 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/28e5ecb8-7c04-4dbc-a8eb-981851f81690-config-data\") pod \"nova-scheduler-0\" (UID: \"28e5ecb8-7c04-4dbc-a8eb-981851f81690\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:10:07 crc kubenswrapper[5120]: I0316 16:10:07.154315 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5fcff8de-c0b5-4d91-ab9d-2aa62341c696-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"5fcff8de-c0b5-4d91-ab9d-2aa62341c696\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:10:07 crc kubenswrapper[5120]: I0316 16:10:07.154378 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w6vk9\" (UniqueName: \"kubernetes.io/projected/28e5ecb8-7c04-4dbc-a8eb-981851f81690-kube-api-access-w6vk9\") pod \"nova-scheduler-0\" (UID: \"28e5ecb8-7c04-4dbc-a8eb-981851f81690\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:10:07 crc kubenswrapper[5120]: I0316 16:10:07.154449 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/28e5ecb8-7c04-4dbc-a8eb-981851f81690-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"28e5ecb8-7c04-4dbc-a8eb-981851f81690\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:10:07 crc kubenswrapper[5120]: I0316 16:10:07.154518 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q79xq\" (UniqueName: \"kubernetes.io/projected/5fcff8de-c0b5-4d91-ab9d-2aa62341c696-kube-api-access-q79xq\") pod \"nova-metadata-0\" (UID: \"5fcff8de-c0b5-4d91-ab9d-2aa62341c696\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:10:07 crc kubenswrapper[5120]: I0316 16:10:07.166688 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/28e5ecb8-7c04-4dbc-a8eb-981851f81690-config-data\") pod \"nova-scheduler-0\" (UID: \"28e5ecb8-7c04-4dbc-a8eb-981851f81690\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:10:07 crc kubenswrapper[5120]: I0316 16:10:07.171010 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/28e5ecb8-7c04-4dbc-a8eb-981851f81690-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"28e5ecb8-7c04-4dbc-a8eb-981851f81690\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:10:07 crc kubenswrapper[5120]: I0316 16:10:07.188109 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6vk9\" (UniqueName: \"kubernetes.io/projected/28e5ecb8-7c04-4dbc-a8eb-981851f81690-kube-api-access-w6vk9\") pod \"nova-scheduler-0\" (UID: \"28e5ecb8-7c04-4dbc-a8eb-981851f81690\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:10:07 crc kubenswrapper[5120]: I0316 16:10:07.191954 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:10:07 crc kubenswrapper[5120]: I0316 16:10:07.207456 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:10:07 crc kubenswrapper[5120]: I0316 16:10:07.209644 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-novncproxy-config-data\"" Mar 16 16:10:07 crc kubenswrapper[5120]: I0316 16:10:07.215988 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:10:07 crc kubenswrapper[5120]: I0316 16:10:07.221717 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:10:07 crc kubenswrapper[5120]: I0316 16:10:07.256806 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d54d349f-9fad-4d35-a08d-88fab46700ce-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"d54d349f-9fad-4d35-a08d-88fab46700ce\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:10:07 crc kubenswrapper[5120]: I0316 16:10:07.256881 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q79xq\" (UniqueName: \"kubernetes.io/projected/5fcff8de-c0b5-4d91-ab9d-2aa62341c696-kube-api-access-q79xq\") pod \"nova-metadata-0\" (UID: \"5fcff8de-c0b5-4d91-ab9d-2aa62341c696\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:10:07 crc kubenswrapper[5120]: I0316 16:10:07.256929 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5fcff8de-c0b5-4d91-ab9d-2aa62341c696-config-data\") pod \"nova-metadata-0\" (UID: \"5fcff8de-c0b5-4d91-ab9d-2aa62341c696\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:10:07 crc kubenswrapper[5120]: I0316 16:10:07.256961 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d54d349f-9fad-4d35-a08d-88fab46700ce-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"d54d349f-9fad-4d35-a08d-88fab46700ce\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:10:07 crc kubenswrapper[5120]: I0316 16:10:07.256999 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5fcff8de-c0b5-4d91-ab9d-2aa62341c696-logs\") pod \"nova-metadata-0\" (UID: \"5fcff8de-c0b5-4d91-ab9d-2aa62341c696\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:10:07 crc kubenswrapper[5120]: I0316 16:10:07.257085 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldqh8\" (UniqueName: \"kubernetes.io/projected/d54d349f-9fad-4d35-a08d-88fab46700ce-kube-api-access-ldqh8\") pod \"nova-cell1-novncproxy-0\" (UID: \"d54d349f-9fad-4d35-a08d-88fab46700ce\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:10:07 crc kubenswrapper[5120]: I0316 16:10:07.257132 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5fcff8de-c0b5-4d91-ab9d-2aa62341c696-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"5fcff8de-c0b5-4d91-ab9d-2aa62341c696\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:10:07 crc kubenswrapper[5120]: I0316 16:10:07.257871 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5fcff8de-c0b5-4d91-ab9d-2aa62341c696-logs\") pod \"nova-metadata-0\" (UID: \"5fcff8de-c0b5-4d91-ab9d-2aa62341c696\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:10:07 crc kubenswrapper[5120]: I0316 16:10:07.262620 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5fcff8de-c0b5-4d91-ab9d-2aa62341c696-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"5fcff8de-c0b5-4d91-ab9d-2aa62341c696\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:10:07 crc kubenswrapper[5120]: I0316 16:10:07.271318 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5fcff8de-c0b5-4d91-ab9d-2aa62341c696-config-data\") pod \"nova-metadata-0\" (UID: \"5fcff8de-c0b5-4d91-ab9d-2aa62341c696\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:10:07 crc kubenswrapper[5120]: I0316 16:10:07.280825 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q79xq\" (UniqueName: \"kubernetes.io/projected/5fcff8de-c0b5-4d91-ab9d-2aa62341c696-kube-api-access-q79xq\") pod \"nova-metadata-0\" (UID: \"5fcff8de-c0b5-4d91-ab9d-2aa62341c696\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:10:07 crc kubenswrapper[5120]: I0316 16:10:07.342561 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:10:07 crc kubenswrapper[5120]: I0316 16:10:07.361905 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d54d349f-9fad-4d35-a08d-88fab46700ce-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"d54d349f-9fad-4d35-a08d-88fab46700ce\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:10:07 crc kubenswrapper[5120]: I0316 16:10:07.362188 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d54d349f-9fad-4d35-a08d-88fab46700ce-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"d54d349f-9fad-4d35-a08d-88fab46700ce\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:10:07 crc kubenswrapper[5120]: I0316 16:10:07.362429 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ldqh8\" (UniqueName: \"kubernetes.io/projected/d54d349f-9fad-4d35-a08d-88fab46700ce-kube-api-access-ldqh8\") pod \"nova-cell1-novncproxy-0\" (UID: \"d54d349f-9fad-4d35-a08d-88fab46700ce\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:10:07 crc kubenswrapper[5120]: I0316 16:10:07.368492 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d54d349f-9fad-4d35-a08d-88fab46700ce-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"d54d349f-9fad-4d35-a08d-88fab46700ce\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:10:07 crc kubenswrapper[5120]: I0316 16:10:07.373278 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d54d349f-9fad-4d35-a08d-88fab46700ce-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"d54d349f-9fad-4d35-a08d-88fab46700ce\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:10:07 crc kubenswrapper[5120]: I0316 16:10:07.389932 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldqh8\" (UniqueName: \"kubernetes.io/projected/d54d349f-9fad-4d35-a08d-88fab46700ce-kube-api-access-ldqh8\") pod \"nova-cell1-novncproxy-0\" (UID: \"d54d349f-9fad-4d35-a08d-88fab46700ce\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:10:07 crc kubenswrapper[5120]: I0316 16:10:07.598142 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:10:07 crc kubenswrapper[5120]: I0316 16:10:07.598845 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:10:07 crc kubenswrapper[5120]: I0316 16:10:07.859236 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:10:07 crc kubenswrapper[5120]: I0316 16:10:07.879077 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-qm2tb"] Mar 16 16:10:07 crc kubenswrapper[5120]: I0316 16:10:07.894479 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:10:07 crc kubenswrapper[5120]: W0316 16:10:07.897008 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf9c983a9_b335_4d5a_91a7_d8f4d332ba77.slice/crio-d4bd782de1492b0a50d9d137d560ff9fd9f587fc4ae35e582200ac9b92763cf7 WatchSource:0}: Error finding container d4bd782de1492b0a50d9d137d560ff9fd9f587fc4ae35e582200ac9b92763cf7: Status 404 returned error can't find the container with id d4bd782de1492b0a50d9d137d560ff9fd9f587fc4ae35e582200ac9b92763cf7 Mar 16 16:10:07 crc kubenswrapper[5120]: I0316 16:10:07.979252 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-62x2t"] Mar 16 16:10:07 crc kubenswrapper[5120]: I0316 16:10:07.988009 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:10:07 crc kubenswrapper[5120]: I0316 16:10:07.988136 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-62x2t" Mar 16 16:10:07 crc kubenswrapper[5120]: I0316 16:10:07.988242 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-62x2t"] Mar 16 16:10:07 crc kubenswrapper[5120]: I0316 16:10:07.990395 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-conductor-scripts\"" Mar 16 16:10:07 crc kubenswrapper[5120]: I0316 16:10:07.990455 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-conductor-config-data\"" Mar 16 16:10:08 crc kubenswrapper[5120]: I0316 16:10:08.117339 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/bc25453e-6c18-4b92-9056-03885c683487-scripts\") pod \"nova-cell1-conductor-db-sync-62x2t\" (UID: \"bc25453e-6c18-4b92-9056-03885c683487\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-62x2t" Mar 16 16:10:08 crc kubenswrapper[5120]: I0316 16:10:08.117617 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bc25453e-6c18-4b92-9056-03885c683487-config-data\") pod \"nova-cell1-conductor-db-sync-62x2t\" (UID: \"bc25453e-6c18-4b92-9056-03885c683487\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-62x2t" Mar 16 16:10:08 crc kubenswrapper[5120]: I0316 16:10:08.117749 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kj9sq\" (UniqueName: \"kubernetes.io/projected/bc25453e-6c18-4b92-9056-03885c683487-kube-api-access-kj9sq\") pod \"nova-cell1-conductor-db-sync-62x2t\" (UID: \"bc25453e-6c18-4b92-9056-03885c683487\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-62x2t" Mar 16 16:10:08 crc kubenswrapper[5120]: I0316 16:10:08.118016 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bc25453e-6c18-4b92-9056-03885c683487-combined-ca-bundle\") pod \"nova-cell1-conductor-db-sync-62x2t\" (UID: \"bc25453e-6c18-4b92-9056-03885c683487\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-62x2t" Mar 16 16:10:08 crc kubenswrapper[5120]: I0316 16:10:08.221849 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/bc25453e-6c18-4b92-9056-03885c683487-scripts\") pod \"nova-cell1-conductor-db-sync-62x2t\" (UID: \"bc25453e-6c18-4b92-9056-03885c683487\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-62x2t" Mar 16 16:10:08 crc kubenswrapper[5120]: I0316 16:10:08.221963 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bc25453e-6c18-4b92-9056-03885c683487-config-data\") pod \"nova-cell1-conductor-db-sync-62x2t\" (UID: \"bc25453e-6c18-4b92-9056-03885c683487\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-62x2t" Mar 16 16:10:08 crc kubenswrapper[5120]: I0316 16:10:08.222003 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kj9sq\" (UniqueName: \"kubernetes.io/projected/bc25453e-6c18-4b92-9056-03885c683487-kube-api-access-kj9sq\") pod \"nova-cell1-conductor-db-sync-62x2t\" (UID: \"bc25453e-6c18-4b92-9056-03885c683487\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-62x2t" Mar 16 16:10:08 crc kubenswrapper[5120]: I0316 16:10:08.222092 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bc25453e-6c18-4b92-9056-03885c683487-combined-ca-bundle\") pod \"nova-cell1-conductor-db-sync-62x2t\" (UID: \"bc25453e-6c18-4b92-9056-03885c683487\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-62x2t" Mar 16 16:10:08 crc kubenswrapper[5120]: I0316 16:10:08.238050 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bc25453e-6c18-4b92-9056-03885c683487-config-data\") pod \"nova-cell1-conductor-db-sync-62x2t\" (UID: \"bc25453e-6c18-4b92-9056-03885c683487\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-62x2t" Mar 16 16:10:08 crc kubenswrapper[5120]: I0316 16:10:08.242465 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:10:08 crc kubenswrapper[5120]: I0316 16:10:08.243312 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kj9sq\" (UniqueName: \"kubernetes.io/projected/bc25453e-6c18-4b92-9056-03885c683487-kube-api-access-kj9sq\") pod \"nova-cell1-conductor-db-sync-62x2t\" (UID: \"bc25453e-6c18-4b92-9056-03885c683487\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-62x2t" Mar 16 16:10:08 crc kubenswrapper[5120]: I0316 16:10:08.245450 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/bc25453e-6c18-4b92-9056-03885c683487-scripts\") pod \"nova-cell1-conductor-db-sync-62x2t\" (UID: \"bc25453e-6c18-4b92-9056-03885c683487\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-62x2t" Mar 16 16:10:08 crc kubenswrapper[5120]: I0316 16:10:08.257661 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bc25453e-6c18-4b92-9056-03885c683487-combined-ca-bundle\") pod \"nova-cell1-conductor-db-sync-62x2t\" (UID: \"bc25453e-6c18-4b92-9056-03885c683487\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-62x2t" Mar 16 16:10:08 crc kubenswrapper[5120]: I0316 16:10:08.335211 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-62x2t" Mar 16 16:10:08 crc kubenswrapper[5120]: I0316 16:10:08.340365 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"031c7932-9816-4571-8397-f517a70caf41","Type":"ContainerStarted","Data":"270a86ff4b83c24e50a283564563e027f0f5441636b64f91ea97f8c2f9033d11"} Mar 16 16:10:08 crc kubenswrapper[5120]: I0316 16:10:08.341579 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-qm2tb" event={"ID":"f9c983a9-b335-4d5a-91a7-d8f4d332ba77","Type":"ContainerStarted","Data":"2964d6eb95f5debfdfb4ed8f1a05caf29f7abb417eef506fc6a7729a0163939d"} Mar 16 16:10:08 crc kubenswrapper[5120]: I0316 16:10:08.341611 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-qm2tb" event={"ID":"f9c983a9-b335-4d5a-91a7-d8f4d332ba77","Type":"ContainerStarted","Data":"d4bd782de1492b0a50d9d137d560ff9fd9f587fc4ae35e582200ac9b92763cf7"} Mar 16 16:10:08 crc kubenswrapper[5120]: I0316 16:10:08.349338 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"5fcff8de-c0b5-4d91-ab9d-2aa62341c696","Type":"ContainerStarted","Data":"7b01a1812b93c9c29fb4def7f9b80166d88ad8b981111fcc42c869e980e9bf3d"} Mar 16 16:10:08 crc kubenswrapper[5120]: I0316 16:10:08.351800 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"28e5ecb8-7c04-4dbc-a8eb-981851f81690","Type":"ContainerStarted","Data":"56f248dd37b784b59dedd559f671f3a12a31c2e66b76b0c27e8f87423464d0d2"} Mar 16 16:10:08 crc kubenswrapper[5120]: I0316 16:10:08.372898 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-qm2tb" podStartSLOduration=2.372749441 podStartE2EDuration="2.372749441s" podCreationTimestamp="2026-03-16 16:10:06 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:10:08.35763147 +0000 UTC m=+2310.511563127" watchObservedRunningTime="2026-03-16 16:10:08.372749441 +0000 UTC m=+2310.526681098" Mar 16 16:10:08 crc kubenswrapper[5120]: I0316 16:10:08.459493 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:10:08 crc kubenswrapper[5120]: I0316 16:10:08.876285 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-62x2t"] Mar 16 16:10:09 crc kubenswrapper[5120]: I0316 16:10:09.361595 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"031c7932-9816-4571-8397-f517a70caf41","Type":"ContainerStarted","Data":"d63aa185f89b094e212f4b9c1e6a47eba5f4c1879b7497a04e1756dd958d9e0b"} Mar 16 16:10:09 crc kubenswrapper[5120]: I0316 16:10:09.361644 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"031c7932-9816-4571-8397-f517a70caf41","Type":"ContainerStarted","Data":"78382554d9c208bba61834a431de97fc207b284ff5c8f388eb91ae7ea5bbbe8d"} Mar 16 16:10:09 crc kubenswrapper[5120]: I0316 16:10:09.364302 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-62x2t" event={"ID":"bc25453e-6c18-4b92-9056-03885c683487","Type":"ContainerStarted","Data":"ea8deddd73fde4c5ea23f81fa45539ab89c9921aa9ad9bb0430924396bb773e6"} Mar 16 16:10:09 crc kubenswrapper[5120]: I0316 16:10:09.364331 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-62x2t" event={"ID":"bc25453e-6c18-4b92-9056-03885c683487","Type":"ContainerStarted","Data":"18753a6f88659ff40ce50f0aa6ac3e0bcc05e0f8fe4dd986f05fc65c9338ee78"} Mar 16 16:10:09 crc kubenswrapper[5120]: I0316 16:10:09.366724 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"5fcff8de-c0b5-4d91-ab9d-2aa62341c696","Type":"ContainerStarted","Data":"ce425b4cf3be96d919c811f3b4ee21c6e50312bc4dfca97e84a0926df521c3f0"} Mar 16 16:10:09 crc kubenswrapper[5120]: I0316 16:10:09.366770 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"5fcff8de-c0b5-4d91-ab9d-2aa62341c696","Type":"ContainerStarted","Data":"4833f84dcc2264a7f5dc1ffaec11bd22c1fdd94de0a15290a0bf9e10210f18af"} Mar 16 16:10:09 crc kubenswrapper[5120]: I0316 16:10:09.368493 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"d54d349f-9fad-4d35-a08d-88fab46700ce","Type":"ContainerStarted","Data":"7b055d7fa95759a701561fe757f274f56db0609dc8d6a12cb3d00e61400758bb"} Mar 16 16:10:09 crc kubenswrapper[5120]: I0316 16:10:09.368518 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"d54d349f-9fad-4d35-a08d-88fab46700ce","Type":"ContainerStarted","Data":"9b4abb3b3437b0d1a14dbe308f8d7abc721ba82e6db9e62bb85a1c2eb9d858a4"} Mar 16 16:10:09 crc kubenswrapper[5120]: I0316 16:10:09.370472 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"28e5ecb8-7c04-4dbc-a8eb-981851f81690","Type":"ContainerStarted","Data":"ea7571be774b77bc67ff84d1b00accab166ea6986167b5b147b2fbb4667fe6de"} Mar 16 16:10:09 crc kubenswrapper[5120]: I0316 16:10:09.386507 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=3.386490297 podStartE2EDuration="3.386490297s" podCreationTimestamp="2026-03-16 16:10:06 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:10:09.381742569 +0000 UTC m=+2311.535674226" watchObservedRunningTime="2026-03-16 16:10:09.386490297 +0000 UTC m=+2311.540421954" Mar 16 16:10:09 crc kubenswrapper[5120]: I0316 16:10:09.404374 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-62x2t" podStartSLOduration=2.404349272 podStartE2EDuration="2.404349272s" podCreationTimestamp="2026-03-16 16:10:07 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:10:09.397203708 +0000 UTC m=+2311.551135375" watchObservedRunningTime="2026-03-16 16:10:09.404349272 +0000 UTC m=+2311.558280929" Mar 16 16:10:09 crc kubenswrapper[5120]: I0316 16:10:09.420644 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-scheduler-0" podStartSLOduration=3.420624273 podStartE2EDuration="3.420624273s" podCreationTimestamp="2026-03-16 16:10:06 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:10:09.417051347 +0000 UTC m=+2311.570983004" watchObservedRunningTime="2026-03-16 16:10:09.420624273 +0000 UTC m=+2311.574555930" Mar 16 16:10:09 crc kubenswrapper[5120]: I0316 16:10:09.448100 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=3.448077318 podStartE2EDuration="3.448077318s" podCreationTimestamp="2026-03-16 16:10:06 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:10:09.438520649 +0000 UTC m=+2311.592452316" watchObservedRunningTime="2026-03-16 16:10:09.448077318 +0000 UTC m=+2311.602008975" Mar 16 16:10:09 crc kubenswrapper[5120]: I0316 16:10:09.461573 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podStartSLOduration=2.461559425 podStartE2EDuration="2.461559425s" podCreationTimestamp="2026-03-16 16:10:07 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:10:09.458233944 +0000 UTC m=+2311.612165601" watchObservedRunningTime="2026-03-16 16:10:09.461559425 +0000 UTC m=+2311.615491082" Mar 16 16:10:09 crc kubenswrapper[5120]: I0316 16:10:09.646210 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:10:09 crc kubenswrapper[5120]: I0316 16:10:09.664934 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:10:09 crc kubenswrapper[5120]: E0316 16:10:09.693818 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1616300 actualBytes=10240 Mar 16 16:10:11 crc kubenswrapper[5120]: I0316 16:10:11.387311 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="5fcff8de-c0b5-4d91-ab9d-2aa62341c696" containerName="nova-metadata-log" containerID="cri-o://4833f84dcc2264a7f5dc1ffaec11bd22c1fdd94de0a15290a0bf9e10210f18af" gracePeriod=30 Mar 16 16:10:11 crc kubenswrapper[5120]: I0316 16:10:11.387392 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="5fcff8de-c0b5-4d91-ab9d-2aa62341c696" containerName="nova-metadata-metadata" containerID="cri-o://ce425b4cf3be96d919c811f3b4ee21c6e50312bc4dfca97e84a0926df521c3f0" gracePeriod=30 Mar 16 16:10:11 crc kubenswrapper[5120]: I0316 16:10:11.387446 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podUID="d54d349f-9fad-4d35-a08d-88fab46700ce" containerName="nova-cell1-novncproxy-novncproxy" containerID="cri-o://7b055d7fa95759a701561fe757f274f56db0609dc8d6a12cb3d00e61400758bb" gracePeriod=30 Mar 16 16:10:11 crc kubenswrapper[5120]: I0316 16:10:11.957086 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:10:12 crc kubenswrapper[5120]: I0316 16:10:12.024048 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5fcff8de-c0b5-4d91-ab9d-2aa62341c696-combined-ca-bundle\") pod \"5fcff8de-c0b5-4d91-ab9d-2aa62341c696\" (UID: \"5fcff8de-c0b5-4d91-ab9d-2aa62341c696\") " Mar 16 16:10:12 crc kubenswrapper[5120]: I0316 16:10:12.024314 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5fcff8de-c0b5-4d91-ab9d-2aa62341c696-config-data\") pod \"5fcff8de-c0b5-4d91-ab9d-2aa62341c696\" (UID: \"5fcff8de-c0b5-4d91-ab9d-2aa62341c696\") " Mar 16 16:10:12 crc kubenswrapper[5120]: I0316 16:10:12.024344 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5fcff8de-c0b5-4d91-ab9d-2aa62341c696-logs\") pod \"5fcff8de-c0b5-4d91-ab9d-2aa62341c696\" (UID: \"5fcff8de-c0b5-4d91-ab9d-2aa62341c696\") " Mar 16 16:10:12 crc kubenswrapper[5120]: I0316 16:10:12.024555 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q79xq\" (UniqueName: \"kubernetes.io/projected/5fcff8de-c0b5-4d91-ab9d-2aa62341c696-kube-api-access-q79xq\") pod \"5fcff8de-c0b5-4d91-ab9d-2aa62341c696\" (UID: \"5fcff8de-c0b5-4d91-ab9d-2aa62341c696\") " Mar 16 16:10:12 crc kubenswrapper[5120]: I0316 16:10:12.025501 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5fcff8de-c0b5-4d91-ab9d-2aa62341c696-logs" (OuterVolumeSpecName: "logs") pod "5fcff8de-c0b5-4d91-ab9d-2aa62341c696" (UID: "5fcff8de-c0b5-4d91-ab9d-2aa62341c696"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:10:12 crc kubenswrapper[5120]: I0316 16:10:12.033957 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5fcff8de-c0b5-4d91-ab9d-2aa62341c696-kube-api-access-q79xq" (OuterVolumeSpecName: "kube-api-access-q79xq") pod "5fcff8de-c0b5-4d91-ab9d-2aa62341c696" (UID: "5fcff8de-c0b5-4d91-ab9d-2aa62341c696"). InnerVolumeSpecName "kube-api-access-q79xq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:10:12 crc kubenswrapper[5120]: I0316 16:10:12.062898 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5fcff8de-c0b5-4d91-ab9d-2aa62341c696-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "5fcff8de-c0b5-4d91-ab9d-2aa62341c696" (UID: "5fcff8de-c0b5-4d91-ab9d-2aa62341c696"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:10:12 crc kubenswrapper[5120]: I0316 16:10:12.065941 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5fcff8de-c0b5-4d91-ab9d-2aa62341c696-config-data" (OuterVolumeSpecName: "config-data") pod "5fcff8de-c0b5-4d91-ab9d-2aa62341c696" (UID: "5fcff8de-c0b5-4d91-ab9d-2aa62341c696"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:10:12 crc kubenswrapper[5120]: I0316 16:10:12.127909 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q79xq\" (UniqueName: \"kubernetes.io/projected/5fcff8de-c0b5-4d91-ab9d-2aa62341c696-kube-api-access-q79xq\") on node \"crc\" DevicePath \"\"" Mar 16 16:10:12 crc kubenswrapper[5120]: I0316 16:10:12.127944 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5fcff8de-c0b5-4d91-ab9d-2aa62341c696-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:10:12 crc kubenswrapper[5120]: I0316 16:10:12.127954 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5fcff8de-c0b5-4d91-ab9d-2aa62341c696-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:10:12 crc kubenswrapper[5120]: I0316 16:10:12.127982 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5fcff8de-c0b5-4d91-ab9d-2aa62341c696-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:10:12 crc kubenswrapper[5120]: I0316 16:10:12.145410 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:10:12 crc kubenswrapper[5120]: I0316 16:10:12.217176 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:10:12 crc kubenswrapper[5120]: I0316 16:10:12.229781 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ldqh8\" (UniqueName: \"kubernetes.io/projected/d54d349f-9fad-4d35-a08d-88fab46700ce-kube-api-access-ldqh8\") pod \"d54d349f-9fad-4d35-a08d-88fab46700ce\" (UID: \"d54d349f-9fad-4d35-a08d-88fab46700ce\") " Mar 16 16:10:12 crc kubenswrapper[5120]: I0316 16:10:12.230015 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d54d349f-9fad-4d35-a08d-88fab46700ce-combined-ca-bundle\") pod \"d54d349f-9fad-4d35-a08d-88fab46700ce\" (UID: \"d54d349f-9fad-4d35-a08d-88fab46700ce\") " Mar 16 16:10:12 crc kubenswrapper[5120]: I0316 16:10:12.230161 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d54d349f-9fad-4d35-a08d-88fab46700ce-config-data\") pod \"d54d349f-9fad-4d35-a08d-88fab46700ce\" (UID: \"d54d349f-9fad-4d35-a08d-88fab46700ce\") " Mar 16 16:10:12 crc kubenswrapper[5120]: I0316 16:10:12.246241 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d54d349f-9fad-4d35-a08d-88fab46700ce-kube-api-access-ldqh8" (OuterVolumeSpecName: "kube-api-access-ldqh8") pod "d54d349f-9fad-4d35-a08d-88fab46700ce" (UID: "d54d349f-9fad-4d35-a08d-88fab46700ce"). InnerVolumeSpecName "kube-api-access-ldqh8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:10:12 crc kubenswrapper[5120]: I0316 16:10:12.252293 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 16:10:12 crc kubenswrapper[5120]: I0316 16:10:12.252522 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/kube-state-metrics-0" podUID="b7839695-f936-4b0c-909c-aa19e16c6ebb" containerName="kube-state-metrics" containerID="cri-o://ea51e0a060ac414286f1637c4d50f53f836fd7917f38e080aa0ee279011f9d1a" gracePeriod=30 Mar 16 16:10:12 crc kubenswrapper[5120]: I0316 16:10:12.257932 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d54d349f-9fad-4d35-a08d-88fab46700ce-config-data" (OuterVolumeSpecName: "config-data") pod "d54d349f-9fad-4d35-a08d-88fab46700ce" (UID: "d54d349f-9fad-4d35-a08d-88fab46700ce"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:10:12 crc kubenswrapper[5120]: I0316 16:10:12.260788 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d54d349f-9fad-4d35-a08d-88fab46700ce-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "d54d349f-9fad-4d35-a08d-88fab46700ce" (UID: "d54d349f-9fad-4d35-a08d-88fab46700ce"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:10:12 crc kubenswrapper[5120]: I0316 16:10:12.333526 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ldqh8\" (UniqueName: \"kubernetes.io/projected/d54d349f-9fad-4d35-a08d-88fab46700ce-kube-api-access-ldqh8\") on node \"crc\" DevicePath \"\"" Mar 16 16:10:12 crc kubenswrapper[5120]: I0316 16:10:12.333576 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d54d349f-9fad-4d35-a08d-88fab46700ce-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:10:12 crc kubenswrapper[5120]: I0316 16:10:12.333596 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d54d349f-9fad-4d35-a08d-88fab46700ce-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:10:12 crc kubenswrapper[5120]: I0316 16:10:12.410726 5120 generic.go:358] "Generic (PLEG): container finished" podID="d54d349f-9fad-4d35-a08d-88fab46700ce" containerID="7b055d7fa95759a701561fe757f274f56db0609dc8d6a12cb3d00e61400758bb" exitCode=0 Mar 16 16:10:12 crc kubenswrapper[5120]: I0316 16:10:12.410795 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"d54d349f-9fad-4d35-a08d-88fab46700ce","Type":"ContainerDied","Data":"7b055d7fa95759a701561fe757f274f56db0609dc8d6a12cb3d00e61400758bb"} Mar 16 16:10:12 crc kubenswrapper[5120]: I0316 16:10:12.411175 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"d54d349f-9fad-4d35-a08d-88fab46700ce","Type":"ContainerDied","Data":"9b4abb3b3437b0d1a14dbe308f8d7abc721ba82e6db9e62bb85a1c2eb9d858a4"} Mar 16 16:10:12 crc kubenswrapper[5120]: I0316 16:10:12.411206 5120 scope.go:117] "RemoveContainer" containerID="7b055d7fa95759a701561fe757f274f56db0609dc8d6a12cb3d00e61400758bb" Mar 16 16:10:12 crc kubenswrapper[5120]: I0316 16:10:12.410831 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:10:12 crc kubenswrapper[5120]: I0316 16:10:12.415587 5120 generic.go:358] "Generic (PLEG): container finished" podID="b7839695-f936-4b0c-909c-aa19e16c6ebb" containerID="ea51e0a060ac414286f1637c4d50f53f836fd7917f38e080aa0ee279011f9d1a" exitCode=2 Mar 16 16:10:12 crc kubenswrapper[5120]: I0316 16:10:12.415846 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"b7839695-f936-4b0c-909c-aa19e16c6ebb","Type":"ContainerDied","Data":"ea51e0a060ac414286f1637c4d50f53f836fd7917f38e080aa0ee279011f9d1a"} Mar 16 16:10:12 crc kubenswrapper[5120]: I0316 16:10:12.419026 5120 generic.go:358] "Generic (PLEG): container finished" podID="5fcff8de-c0b5-4d91-ab9d-2aa62341c696" containerID="ce425b4cf3be96d919c811f3b4ee21c6e50312bc4dfca97e84a0926df521c3f0" exitCode=0 Mar 16 16:10:12 crc kubenswrapper[5120]: I0316 16:10:12.419055 5120 generic.go:358] "Generic (PLEG): container finished" podID="5fcff8de-c0b5-4d91-ab9d-2aa62341c696" containerID="4833f84dcc2264a7f5dc1ffaec11bd22c1fdd94de0a15290a0bf9e10210f18af" exitCode=143 Mar 16 16:10:12 crc kubenswrapper[5120]: I0316 16:10:12.419092 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"5fcff8de-c0b5-4d91-ab9d-2aa62341c696","Type":"ContainerDied","Data":"ce425b4cf3be96d919c811f3b4ee21c6e50312bc4dfca97e84a0926df521c3f0"} Mar 16 16:10:12 crc kubenswrapper[5120]: I0316 16:10:12.419116 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"5fcff8de-c0b5-4d91-ab9d-2aa62341c696","Type":"ContainerDied","Data":"4833f84dcc2264a7f5dc1ffaec11bd22c1fdd94de0a15290a0bf9e10210f18af"} Mar 16 16:10:12 crc kubenswrapper[5120]: I0316 16:10:12.419129 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"5fcff8de-c0b5-4d91-ab9d-2aa62341c696","Type":"ContainerDied","Data":"7b01a1812b93c9c29fb4def7f9b80166d88ad8b981111fcc42c869e980e9bf3d"} Mar 16 16:10:12 crc kubenswrapper[5120]: I0316 16:10:12.419206 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:10:12 crc kubenswrapper[5120]: I0316 16:10:12.463980 5120 scope.go:117] "RemoveContainer" containerID="7b055d7fa95759a701561fe757f274f56db0609dc8d6a12cb3d00e61400758bb" Mar 16 16:10:12 crc kubenswrapper[5120]: E0316 16:10:12.466706 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7b055d7fa95759a701561fe757f274f56db0609dc8d6a12cb3d00e61400758bb\": container with ID starting with 7b055d7fa95759a701561fe757f274f56db0609dc8d6a12cb3d00e61400758bb not found: ID does not exist" containerID="7b055d7fa95759a701561fe757f274f56db0609dc8d6a12cb3d00e61400758bb" Mar 16 16:10:12 crc kubenswrapper[5120]: I0316 16:10:12.466836 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b055d7fa95759a701561fe757f274f56db0609dc8d6a12cb3d00e61400758bb"} err="failed to get container status \"7b055d7fa95759a701561fe757f274f56db0609dc8d6a12cb3d00e61400758bb\": rpc error: code = NotFound desc = could not find container \"7b055d7fa95759a701561fe757f274f56db0609dc8d6a12cb3d00e61400758bb\": container with ID starting with 7b055d7fa95759a701561fe757f274f56db0609dc8d6a12cb3d00e61400758bb not found: ID does not exist" Mar 16 16:10:12 crc kubenswrapper[5120]: I0316 16:10:12.466875 5120 scope.go:117] "RemoveContainer" containerID="ce425b4cf3be96d919c811f3b4ee21c6e50312bc4dfca97e84a0926df521c3f0" Mar 16 16:10:12 crc kubenswrapper[5120]: I0316 16:10:12.470323 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:10:12 crc kubenswrapper[5120]: I0316 16:10:12.479620 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:10:12 crc kubenswrapper[5120]: I0316 16:10:12.524191 5120 scope.go:117] "RemoveContainer" containerID="4833f84dcc2264a7f5dc1ffaec11bd22c1fdd94de0a15290a0bf9e10210f18af" Mar 16 16:10:12 crc kubenswrapper[5120]: I0316 16:10:12.563889 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:10:12 crc kubenswrapper[5120]: I0316 16:10:12.569664 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5fcff8de-c0b5-4d91-ab9d-2aa62341c696" containerName="nova-metadata-log" Mar 16 16:10:12 crc kubenswrapper[5120]: I0316 16:10:12.569697 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="5fcff8de-c0b5-4d91-ab9d-2aa62341c696" containerName="nova-metadata-log" Mar 16 16:10:12 crc kubenswrapper[5120]: I0316 16:10:12.569735 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d54d349f-9fad-4d35-a08d-88fab46700ce" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 16:10:12 crc kubenswrapper[5120]: I0316 16:10:12.569741 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="d54d349f-9fad-4d35-a08d-88fab46700ce" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 16:10:12 crc kubenswrapper[5120]: I0316 16:10:12.569771 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5fcff8de-c0b5-4d91-ab9d-2aa62341c696" containerName="nova-metadata-metadata" Mar 16 16:10:12 crc kubenswrapper[5120]: I0316 16:10:12.569777 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="5fcff8de-c0b5-4d91-ab9d-2aa62341c696" containerName="nova-metadata-metadata" Mar 16 16:10:12 crc kubenswrapper[5120]: I0316 16:10:12.570012 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="5fcff8de-c0b5-4d91-ab9d-2aa62341c696" containerName="nova-metadata-log" Mar 16 16:10:12 crc kubenswrapper[5120]: I0316 16:10:12.570033 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="d54d349f-9fad-4d35-a08d-88fab46700ce" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 16:10:12 crc kubenswrapper[5120]: I0316 16:10:12.570048 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="5fcff8de-c0b5-4d91-ab9d-2aa62341c696" containerName="nova-metadata-metadata" Mar 16 16:10:12 crc kubenswrapper[5120]: I0316 16:10:12.580920 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:10:12 crc kubenswrapper[5120]: I0316 16:10:12.581038 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:10:12 crc kubenswrapper[5120]: I0316 16:10:12.583020 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-novncproxy-cell1-vencrypt\"" Mar 16 16:10:12 crc kubenswrapper[5120]: I0316 16:10:12.583025 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:10:12 crc kubenswrapper[5120]: I0316 16:10:12.583228 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-novncproxy-config-data\"" Mar 16 16:10:12 crc kubenswrapper[5120]: I0316 16:10:12.583627 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-novncproxy-cell1-public-svc\"" Mar 16 16:10:12 crc kubenswrapper[5120]: I0316 16:10:12.590375 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:10:12 crc kubenswrapper[5120]: I0316 16:10:12.597945 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:10:12 crc kubenswrapper[5120]: I0316 16:10:12.620913 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:10:12 crc kubenswrapper[5120]: I0316 16:10:12.621040 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:10:12 crc kubenswrapper[5120]: I0316 16:10:12.625549 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-metadata-internal-svc\"" Mar 16 16:10:12 crc kubenswrapper[5120]: I0316 16:10:12.626450 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-metadata-config-data\"" Mar 16 16:10:12 crc kubenswrapper[5120]: I0316 16:10:12.629035 5120 scope.go:117] "RemoveContainer" containerID="ce425b4cf3be96d919c811f3b4ee21c6e50312bc4dfca97e84a0926df521c3f0" Mar 16 16:10:12 crc kubenswrapper[5120]: E0316 16:10:12.629458 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce425b4cf3be96d919c811f3b4ee21c6e50312bc4dfca97e84a0926df521c3f0\": container with ID starting with ce425b4cf3be96d919c811f3b4ee21c6e50312bc4dfca97e84a0926df521c3f0 not found: ID does not exist" containerID="ce425b4cf3be96d919c811f3b4ee21c6e50312bc4dfca97e84a0926df521c3f0" Mar 16 16:10:12 crc kubenswrapper[5120]: I0316 16:10:12.629503 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce425b4cf3be96d919c811f3b4ee21c6e50312bc4dfca97e84a0926df521c3f0"} err="failed to get container status \"ce425b4cf3be96d919c811f3b4ee21c6e50312bc4dfca97e84a0926df521c3f0\": rpc error: code = NotFound desc = could not find container \"ce425b4cf3be96d919c811f3b4ee21c6e50312bc4dfca97e84a0926df521c3f0\": container with ID starting with ce425b4cf3be96d919c811f3b4ee21c6e50312bc4dfca97e84a0926df521c3f0 not found: ID does not exist" Mar 16 16:10:12 crc kubenswrapper[5120]: I0316 16:10:12.629539 5120 scope.go:117] "RemoveContainer" containerID="4833f84dcc2264a7f5dc1ffaec11bd22c1fdd94de0a15290a0bf9e10210f18af" Mar 16 16:10:12 crc kubenswrapper[5120]: E0316 16:10:12.629841 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4833f84dcc2264a7f5dc1ffaec11bd22c1fdd94de0a15290a0bf9e10210f18af\": container with ID starting with 4833f84dcc2264a7f5dc1ffaec11bd22c1fdd94de0a15290a0bf9e10210f18af not found: ID does not exist" containerID="4833f84dcc2264a7f5dc1ffaec11bd22c1fdd94de0a15290a0bf9e10210f18af" Mar 16 16:10:12 crc kubenswrapper[5120]: I0316 16:10:12.629865 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4833f84dcc2264a7f5dc1ffaec11bd22c1fdd94de0a15290a0bf9e10210f18af"} err="failed to get container status \"4833f84dcc2264a7f5dc1ffaec11bd22c1fdd94de0a15290a0bf9e10210f18af\": rpc error: code = NotFound desc = could not find container \"4833f84dcc2264a7f5dc1ffaec11bd22c1fdd94de0a15290a0bf9e10210f18af\": container with ID starting with 4833f84dcc2264a7f5dc1ffaec11bd22c1fdd94de0a15290a0bf9e10210f18af not found: ID does not exist" Mar 16 16:10:12 crc kubenswrapper[5120]: I0316 16:10:12.629890 5120 scope.go:117] "RemoveContainer" containerID="ce425b4cf3be96d919c811f3b4ee21c6e50312bc4dfca97e84a0926df521c3f0" Mar 16 16:10:12 crc kubenswrapper[5120]: I0316 16:10:12.630160 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce425b4cf3be96d919c811f3b4ee21c6e50312bc4dfca97e84a0926df521c3f0"} err="failed to get container status \"ce425b4cf3be96d919c811f3b4ee21c6e50312bc4dfca97e84a0926df521c3f0\": rpc error: code = NotFound desc = could not find container \"ce425b4cf3be96d919c811f3b4ee21c6e50312bc4dfca97e84a0926df521c3f0\": container with ID starting with ce425b4cf3be96d919c811f3b4ee21c6e50312bc4dfca97e84a0926df521c3f0 not found: ID does not exist" Mar 16 16:10:12 crc kubenswrapper[5120]: I0316 16:10:12.630207 5120 scope.go:117] "RemoveContainer" containerID="4833f84dcc2264a7f5dc1ffaec11bd22c1fdd94de0a15290a0bf9e10210f18af" Mar 16 16:10:12 crc kubenswrapper[5120]: I0316 16:10:12.630460 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4833f84dcc2264a7f5dc1ffaec11bd22c1fdd94de0a15290a0bf9e10210f18af"} err="failed to get container status \"4833f84dcc2264a7f5dc1ffaec11bd22c1fdd94de0a15290a0bf9e10210f18af\": rpc error: code = NotFound desc = could not find container \"4833f84dcc2264a7f5dc1ffaec11bd22c1fdd94de0a15290a0bf9e10210f18af\": container with ID starting with 4833f84dcc2264a7f5dc1ffaec11bd22c1fdd94de0a15290a0bf9e10210f18af not found: ID does not exist" Mar 16 16:10:12 crc kubenswrapper[5120]: I0316 16:10:12.645537 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/601bff35-3d2b-4301-abdc-17ddf2e2b9eb-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"601bff35-3d2b-4301-abdc-17ddf2e2b9eb\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:10:12 crc kubenswrapper[5120]: I0316 16:10:12.645625 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrtpv\" (UniqueName: \"kubernetes.io/projected/601bff35-3d2b-4301-abdc-17ddf2e2b9eb-kube-api-access-lrtpv\") pod \"nova-cell1-novncproxy-0\" (UID: \"601bff35-3d2b-4301-abdc-17ddf2e2b9eb\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:10:12 crc kubenswrapper[5120]: I0316 16:10:12.645695 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/601bff35-3d2b-4301-abdc-17ddf2e2b9eb-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"601bff35-3d2b-4301-abdc-17ddf2e2b9eb\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:10:12 crc kubenswrapper[5120]: I0316 16:10:12.645717 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/601bff35-3d2b-4301-abdc-17ddf2e2b9eb-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"601bff35-3d2b-4301-abdc-17ddf2e2b9eb\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:10:12 crc kubenswrapper[5120]: I0316 16:10:12.645944 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/601bff35-3d2b-4301-abdc-17ddf2e2b9eb-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"601bff35-3d2b-4301-abdc-17ddf2e2b9eb\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:10:12 crc kubenswrapper[5120]: I0316 16:10:12.685579 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5fcff8de-c0b5-4d91-ab9d-2aa62341c696" path="/var/lib/kubelet/pods/5fcff8de-c0b5-4d91-ab9d-2aa62341c696/volumes" Mar 16 16:10:12 crc kubenswrapper[5120]: I0316 16:10:12.686172 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d54d349f-9fad-4d35-a08d-88fab46700ce" path="/var/lib/kubelet/pods/d54d349f-9fad-4d35-a08d-88fab46700ce/volumes" Mar 16 16:10:12 crc kubenswrapper[5120]: I0316 16:10:12.747384 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/601bff35-3d2b-4301-abdc-17ddf2e2b9eb-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"601bff35-3d2b-4301-abdc-17ddf2e2b9eb\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:10:12 crc kubenswrapper[5120]: I0316 16:10:12.747478 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/25f31d35-683c-46f1-b80a-ee5b06665073-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"25f31d35-683c-46f1-b80a-ee5b06665073\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:10:12 crc kubenswrapper[5120]: I0316 16:10:12.747514 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/601bff35-3d2b-4301-abdc-17ddf2e2b9eb-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"601bff35-3d2b-4301-abdc-17ddf2e2b9eb\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:10:12 crc kubenswrapper[5120]: I0316 16:10:12.747532 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/25f31d35-683c-46f1-b80a-ee5b06665073-logs\") pod \"nova-metadata-0\" (UID: \"25f31d35-683c-46f1-b80a-ee5b06665073\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:10:12 crc kubenswrapper[5120]: I0316 16:10:12.747628 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktc4b\" (UniqueName: \"kubernetes.io/projected/25f31d35-683c-46f1-b80a-ee5b06665073-kube-api-access-ktc4b\") pod \"nova-metadata-0\" (UID: \"25f31d35-683c-46f1-b80a-ee5b06665073\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:10:12 crc kubenswrapper[5120]: I0316 16:10:12.747713 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/601bff35-3d2b-4301-abdc-17ddf2e2b9eb-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"601bff35-3d2b-4301-abdc-17ddf2e2b9eb\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:10:12 crc kubenswrapper[5120]: I0316 16:10:12.747785 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lrtpv\" (UniqueName: \"kubernetes.io/projected/601bff35-3d2b-4301-abdc-17ddf2e2b9eb-kube-api-access-lrtpv\") pod \"nova-cell1-novncproxy-0\" (UID: \"601bff35-3d2b-4301-abdc-17ddf2e2b9eb\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:10:12 crc kubenswrapper[5120]: I0316 16:10:12.747805 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/25f31d35-683c-46f1-b80a-ee5b06665073-config-data\") pod \"nova-metadata-0\" (UID: \"25f31d35-683c-46f1-b80a-ee5b06665073\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:10:12 crc kubenswrapper[5120]: I0316 16:10:12.747851 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/25f31d35-683c-46f1-b80a-ee5b06665073-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"25f31d35-683c-46f1-b80a-ee5b06665073\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:10:12 crc kubenswrapper[5120]: I0316 16:10:12.747892 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/601bff35-3d2b-4301-abdc-17ddf2e2b9eb-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"601bff35-3d2b-4301-abdc-17ddf2e2b9eb\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:10:12 crc kubenswrapper[5120]: I0316 16:10:12.753041 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/601bff35-3d2b-4301-abdc-17ddf2e2b9eb-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"601bff35-3d2b-4301-abdc-17ddf2e2b9eb\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:10:12 crc kubenswrapper[5120]: I0316 16:10:12.755023 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/601bff35-3d2b-4301-abdc-17ddf2e2b9eb-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"601bff35-3d2b-4301-abdc-17ddf2e2b9eb\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:10:12 crc kubenswrapper[5120]: I0316 16:10:12.757706 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/601bff35-3d2b-4301-abdc-17ddf2e2b9eb-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"601bff35-3d2b-4301-abdc-17ddf2e2b9eb\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:10:12 crc kubenswrapper[5120]: I0316 16:10:12.759061 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/601bff35-3d2b-4301-abdc-17ddf2e2b9eb-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"601bff35-3d2b-4301-abdc-17ddf2e2b9eb\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:10:12 crc kubenswrapper[5120]: I0316 16:10:12.767934 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrtpv\" (UniqueName: \"kubernetes.io/projected/601bff35-3d2b-4301-abdc-17ddf2e2b9eb-kube-api-access-lrtpv\") pod \"nova-cell1-novncproxy-0\" (UID: \"601bff35-3d2b-4301-abdc-17ddf2e2b9eb\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:10:12 crc kubenswrapper[5120]: I0316 16:10:12.836586 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:10:12 crc kubenswrapper[5120]: I0316 16:10:12.849111 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/25f31d35-683c-46f1-b80a-ee5b06665073-config-data\") pod \"nova-metadata-0\" (UID: \"25f31d35-683c-46f1-b80a-ee5b06665073\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:10:12 crc kubenswrapper[5120]: I0316 16:10:12.849296 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/25f31d35-683c-46f1-b80a-ee5b06665073-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"25f31d35-683c-46f1-b80a-ee5b06665073\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:10:12 crc kubenswrapper[5120]: I0316 16:10:12.849393 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/25f31d35-683c-46f1-b80a-ee5b06665073-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"25f31d35-683c-46f1-b80a-ee5b06665073\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:10:12 crc kubenswrapper[5120]: I0316 16:10:12.849424 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/25f31d35-683c-46f1-b80a-ee5b06665073-logs\") pod \"nova-metadata-0\" (UID: \"25f31d35-683c-46f1-b80a-ee5b06665073\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:10:12 crc kubenswrapper[5120]: I0316 16:10:12.849528 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ktc4b\" (UniqueName: \"kubernetes.io/projected/25f31d35-683c-46f1-b80a-ee5b06665073-kube-api-access-ktc4b\") pod \"nova-metadata-0\" (UID: \"25f31d35-683c-46f1-b80a-ee5b06665073\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:10:12 crc kubenswrapper[5120]: I0316 16:10:12.850055 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/25f31d35-683c-46f1-b80a-ee5b06665073-logs\") pod \"nova-metadata-0\" (UID: \"25f31d35-683c-46f1-b80a-ee5b06665073\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:10:12 crc kubenswrapper[5120]: I0316 16:10:12.856629 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/25f31d35-683c-46f1-b80a-ee5b06665073-config-data\") pod \"nova-metadata-0\" (UID: \"25f31d35-683c-46f1-b80a-ee5b06665073\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:10:12 crc kubenswrapper[5120]: I0316 16:10:12.857053 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/25f31d35-683c-46f1-b80a-ee5b06665073-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"25f31d35-683c-46f1-b80a-ee5b06665073\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:10:12 crc kubenswrapper[5120]: I0316 16:10:12.858773 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/25f31d35-683c-46f1-b80a-ee5b06665073-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"25f31d35-683c-46f1-b80a-ee5b06665073\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:10:12 crc kubenswrapper[5120]: I0316 16:10:12.883750 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktc4b\" (UniqueName: \"kubernetes.io/projected/25f31d35-683c-46f1-b80a-ee5b06665073-kube-api-access-ktc4b\") pod \"nova-metadata-0\" (UID: \"25f31d35-683c-46f1-b80a-ee5b06665073\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:10:12 crc kubenswrapper[5120]: I0316 16:10:12.917438 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:10:12 crc kubenswrapper[5120]: I0316 16:10:12.938280 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:10:12 crc kubenswrapper[5120]: I0316 16:10:12.957150 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h8ndm\" (UniqueName: \"kubernetes.io/projected/b7839695-f936-4b0c-909c-aa19e16c6ebb-kube-api-access-h8ndm\") pod \"b7839695-f936-4b0c-909c-aa19e16c6ebb\" (UID: \"b7839695-f936-4b0c-909c-aa19e16c6ebb\") " Mar 16 16:10:12 crc kubenswrapper[5120]: I0316 16:10:12.963332 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7839695-f936-4b0c-909c-aa19e16c6ebb-kube-api-access-h8ndm" (OuterVolumeSpecName: "kube-api-access-h8ndm") pod "b7839695-f936-4b0c-909c-aa19e16c6ebb" (UID: "b7839695-f936-4b0c-909c-aa19e16c6ebb"). InnerVolumeSpecName "kube-api-access-h8ndm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:10:13 crc kubenswrapper[5120]: I0316 16:10:13.065327 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h8ndm\" (UniqueName: \"kubernetes.io/projected/b7839695-f936-4b0c-909c-aa19e16c6ebb-kube-api-access-h8ndm\") on node \"crc\" DevicePath \"\"" Mar 16 16:10:13 crc kubenswrapper[5120]: W0316 16:10:13.392140 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod601bff35_3d2b_4301_abdc_17ddf2e2b9eb.slice/crio-9b1653ebcb78902e6fa6f71e8a98a4338ef464f889f7cdc16b06ca0bb3b534df WatchSource:0}: Error finding container 9b1653ebcb78902e6fa6f71e8a98a4338ef464f889f7cdc16b06ca0bb3b534df: Status 404 returned error can't find the container with id 9b1653ebcb78902e6fa6f71e8a98a4338ef464f889f7cdc16b06ca0bb3b534df Mar 16 16:10:13 crc kubenswrapper[5120]: I0316 16:10:13.402115 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:10:13 crc kubenswrapper[5120]: I0316 16:10:13.435046 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"b7839695-f936-4b0c-909c-aa19e16c6ebb","Type":"ContainerDied","Data":"c92c7deb4388b11f60ce7eb5afdfc926d859e194d62eeb6235ca83232d5745d3"} Mar 16 16:10:13 crc kubenswrapper[5120]: I0316 16:10:13.435098 5120 scope.go:117] "RemoveContainer" containerID="ea51e0a060ac414286f1637c4d50f53f836fd7917f38e080aa0ee279011f9d1a" Mar 16 16:10:13 crc kubenswrapper[5120]: I0316 16:10:13.435246 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:10:13 crc kubenswrapper[5120]: I0316 16:10:13.438563 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"601bff35-3d2b-4301-abdc-17ddf2e2b9eb","Type":"ContainerStarted","Data":"9b1653ebcb78902e6fa6f71e8a98a4338ef464f889f7cdc16b06ca0bb3b534df"} Mar 16 16:10:13 crc kubenswrapper[5120]: I0316 16:10:13.480075 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:10:13 crc kubenswrapper[5120]: W0316 16:10:13.489130 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod25f31d35_683c_46f1_b80a_ee5b06665073.slice/crio-66c5849a65ba589fbb398cc9e61ab3fa4209404381655e75eeb8b63632478258 WatchSource:0}: Error finding container 66c5849a65ba589fbb398cc9e61ab3fa4209404381655e75eeb8b63632478258: Status 404 returned error can't find the container with id 66c5849a65ba589fbb398cc9e61ab3fa4209404381655e75eeb8b63632478258 Mar 16 16:10:13 crc kubenswrapper[5120]: I0316 16:10:13.530771 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 16:10:13 crc kubenswrapper[5120]: I0316 16:10:13.542293 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 16:10:13 crc kubenswrapper[5120]: I0316 16:10:13.551101 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 16:10:13 crc kubenswrapper[5120]: I0316 16:10:13.552257 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7839695-f936-4b0c-909c-aa19e16c6ebb" containerName="kube-state-metrics" Mar 16 16:10:13 crc kubenswrapper[5120]: I0316 16:10:13.552272 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7839695-f936-4b0c-909c-aa19e16c6ebb" containerName="kube-state-metrics" Mar 16 16:10:13 crc kubenswrapper[5120]: I0316 16:10:13.552453 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="b7839695-f936-4b0c-909c-aa19e16c6ebb" containerName="kube-state-metrics" Mar 16 16:10:13 crc kubenswrapper[5120]: I0316 16:10:13.565084 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 16:10:13 crc kubenswrapper[5120]: I0316 16:10:13.565199 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:10:13 crc kubenswrapper[5120]: I0316 16:10:13.568671 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-kube-state-metrics-svc\"" Mar 16 16:10:13 crc kubenswrapper[5120]: I0316 16:10:13.568952 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"kube-state-metrics-tls-config\"" Mar 16 16:10:13 crc kubenswrapper[5120]: E0316 16:10:13.611452 5120 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb7839695_f936_4b0c_909c_aa19e16c6ebb.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb7839695_f936_4b0c_909c_aa19e16c6ebb.slice/crio-c92c7deb4388b11f60ce7eb5afdfc926d859e194d62eeb6235ca83232d5745d3\": RecentStats: unable to find data in memory cache]" Mar 16 16:10:13 crc kubenswrapper[5120]: I0316 16:10:13.676384 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbbmf\" (UniqueName: \"kubernetes.io/projected/bebb35a6-a910-4c16-8fa3-5462afb3341a-kube-api-access-sbbmf\") pod \"kube-state-metrics-0\" (UID: \"bebb35a6-a910-4c16-8fa3-5462afb3341a\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:10:13 crc kubenswrapper[5120]: I0316 16:10:13.676658 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/bebb35a6-a910-4c16-8fa3-5462afb3341a-kube-state-metrics-tls-config\") pod \"kube-state-metrics-0\" (UID: \"bebb35a6-a910-4c16-8fa3-5462afb3341a\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:10:13 crc kubenswrapper[5120]: I0316 16:10:13.676693 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/bebb35a6-a910-4c16-8fa3-5462afb3341a-kube-state-metrics-tls-certs\") pod \"kube-state-metrics-0\" (UID: \"bebb35a6-a910-4c16-8fa3-5462afb3341a\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:10:13 crc kubenswrapper[5120]: I0316 16:10:13.677025 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bebb35a6-a910-4c16-8fa3-5462afb3341a-combined-ca-bundle\") pod \"kube-state-metrics-0\" (UID: \"bebb35a6-a910-4c16-8fa3-5462afb3341a\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:10:13 crc kubenswrapper[5120]: I0316 16:10:13.778838 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sbbmf\" (UniqueName: \"kubernetes.io/projected/bebb35a6-a910-4c16-8fa3-5462afb3341a-kube-api-access-sbbmf\") pod \"kube-state-metrics-0\" (UID: \"bebb35a6-a910-4c16-8fa3-5462afb3341a\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:10:13 crc kubenswrapper[5120]: I0316 16:10:13.778959 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/bebb35a6-a910-4c16-8fa3-5462afb3341a-kube-state-metrics-tls-config\") pod \"kube-state-metrics-0\" (UID: \"bebb35a6-a910-4c16-8fa3-5462afb3341a\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:10:13 crc kubenswrapper[5120]: I0316 16:10:13.778997 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/bebb35a6-a910-4c16-8fa3-5462afb3341a-kube-state-metrics-tls-certs\") pod \"kube-state-metrics-0\" (UID: \"bebb35a6-a910-4c16-8fa3-5462afb3341a\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:10:13 crc kubenswrapper[5120]: I0316 16:10:13.779279 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bebb35a6-a910-4c16-8fa3-5462afb3341a-combined-ca-bundle\") pod \"kube-state-metrics-0\" (UID: \"bebb35a6-a910-4c16-8fa3-5462afb3341a\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:10:13 crc kubenswrapper[5120]: I0316 16:10:13.783344 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/bebb35a6-a910-4c16-8fa3-5462afb3341a-kube-state-metrics-tls-config\") pod \"kube-state-metrics-0\" (UID: \"bebb35a6-a910-4c16-8fa3-5462afb3341a\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:10:13 crc kubenswrapper[5120]: I0316 16:10:13.783737 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/bebb35a6-a910-4c16-8fa3-5462afb3341a-kube-state-metrics-tls-certs\") pod \"kube-state-metrics-0\" (UID: \"bebb35a6-a910-4c16-8fa3-5462afb3341a\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:10:13 crc kubenswrapper[5120]: I0316 16:10:13.794527 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bebb35a6-a910-4c16-8fa3-5462afb3341a-combined-ca-bundle\") pod \"kube-state-metrics-0\" (UID: \"bebb35a6-a910-4c16-8fa3-5462afb3341a\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:10:13 crc kubenswrapper[5120]: I0316 16:10:13.803623 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbbmf\" (UniqueName: \"kubernetes.io/projected/bebb35a6-a910-4c16-8fa3-5462afb3341a-kube-api-access-sbbmf\") pod \"kube-state-metrics-0\" (UID: \"bebb35a6-a910-4c16-8fa3-5462afb3341a\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:10:14 crc kubenswrapper[5120]: I0316 16:10:14.001400 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:10:14 crc kubenswrapper[5120]: I0316 16:10:14.396911 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:10:14 crc kubenswrapper[5120]: I0316 16:10:14.397611 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="73733c44-4d3b-4797-b839-cacdffc714a8" containerName="ceilometer-central-agent" containerID="cri-o://6caf8b4bdc94e7e8a301f80e8e8b264137575e0a23c83ab620fa8ddf06787833" gracePeriod=30 Mar 16 16:10:14 crc kubenswrapper[5120]: I0316 16:10:14.397715 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="73733c44-4d3b-4797-b839-cacdffc714a8" containerName="ceilometer-notification-agent" containerID="cri-o://28ad945a4f00825a33604975a1201b4961f99d0ef1130ff20963ef1abf8d7343" gracePeriod=30 Mar 16 16:10:14 crc kubenswrapper[5120]: I0316 16:10:14.397778 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="73733c44-4d3b-4797-b839-cacdffc714a8" containerName="proxy-httpd" containerID="cri-o://03a6a9abd07f8b62f69dab65419dd7dbe5c9dcb24e6f22ff10017e9d32a11780" gracePeriod=30 Mar 16 16:10:14 crc kubenswrapper[5120]: I0316 16:10:14.398021 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="73733c44-4d3b-4797-b839-cacdffc714a8" containerName="sg-core" containerID="cri-o://e48aaa1b751c1b2afbdd9bdda084b4bd4c3d36caeac98b068ee965a33fa85ee0" gracePeriod=30 Mar 16 16:10:14 crc kubenswrapper[5120]: I0316 16:10:14.433035 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 16:10:14 crc kubenswrapper[5120]: W0316 16:10:14.434724 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbebb35a6_a910_4c16_8fa3_5462afb3341a.slice/crio-2d68510cfff2262472612253f576ff6e7b3b1a656cec754457aaa9d8a5384e3e WatchSource:0}: Error finding container 2d68510cfff2262472612253f576ff6e7b3b1a656cec754457aaa9d8a5384e3e: Status 404 returned error can't find the container with id 2d68510cfff2262472612253f576ff6e7b3b1a656cec754457aaa9d8a5384e3e Mar 16 16:10:14 crc kubenswrapper[5120]: I0316 16:10:14.456410 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"bebb35a6-a910-4c16-8fa3-5462afb3341a","Type":"ContainerStarted","Data":"2d68510cfff2262472612253f576ff6e7b3b1a656cec754457aaa9d8a5384e3e"} Mar 16 16:10:14 crc kubenswrapper[5120]: I0316 16:10:14.460514 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"601bff35-3d2b-4301-abdc-17ddf2e2b9eb","Type":"ContainerStarted","Data":"1fb5c938a8cc434d5d6acbf8795148fc1d15481e3ef51a7665017c74c309e1f4"} Mar 16 16:10:14 crc kubenswrapper[5120]: I0316 16:10:14.462471 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"25f31d35-683c-46f1-b80a-ee5b06665073","Type":"ContainerStarted","Data":"2b5c0ae05ab1173c641baf5bde397c4c5da3b83712008de7089ed6928f8ce2b8"} Mar 16 16:10:14 crc kubenswrapper[5120]: I0316 16:10:14.462508 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"25f31d35-683c-46f1-b80a-ee5b06665073","Type":"ContainerStarted","Data":"ae8d8acc81c4fa4c6f80620713b70fdfe04ee9dfea262eefc13de9961ba0c1bc"} Mar 16 16:10:14 crc kubenswrapper[5120]: I0316 16:10:14.462517 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"25f31d35-683c-46f1-b80a-ee5b06665073","Type":"ContainerStarted","Data":"66c5849a65ba589fbb398cc9e61ab3fa4209404381655e75eeb8b63632478258"} Mar 16 16:10:14 crc kubenswrapper[5120]: I0316 16:10:14.481858 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podStartSLOduration=2.481840693 podStartE2EDuration="2.481840693s" podCreationTimestamp="2026-03-16 16:10:12 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:10:14.474450412 +0000 UTC m=+2316.628382069" watchObservedRunningTime="2026-03-16 16:10:14.481840693 +0000 UTC m=+2316.635772350" Mar 16 16:10:14 crc kubenswrapper[5120]: I0316 16:10:14.502098 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=2.502079822 podStartE2EDuration="2.502079822s" podCreationTimestamp="2026-03-16 16:10:12 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:10:14.49388518 +0000 UTC m=+2316.647816837" watchObservedRunningTime="2026-03-16 16:10:14.502079822 +0000 UTC m=+2316.656011479" Mar 16 16:10:14 crc kubenswrapper[5120]: I0316 16:10:14.676350 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b7839695-f936-4b0c-909c-aa19e16c6ebb" path="/var/lib/kubelet/pods/b7839695-f936-4b0c-909c-aa19e16c6ebb/volumes" Mar 16 16:10:15 crc kubenswrapper[5120]: I0316 16:10:15.486428 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"bebb35a6-a910-4c16-8fa3-5462afb3341a","Type":"ContainerStarted","Data":"6cb705b6a3d152dced9b3cb6c4835a2490bbfadb24078d18afa5685f5ddd1a97"} Mar 16 16:10:15 crc kubenswrapper[5120]: I0316 16:10:15.487973 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:10:15 crc kubenswrapper[5120]: I0316 16:10:15.509325 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/kube-state-metrics-0" podStartSLOduration=2.020686773 podStartE2EDuration="2.509284951s" podCreationTimestamp="2026-03-16 16:10:13 +0000 UTC" firstStartedPulling="2026-03-16 16:10:14.436858862 +0000 UTC m=+2316.590790509" lastFinishedPulling="2026-03-16 16:10:14.92545703 +0000 UTC m=+2317.079388687" observedRunningTime="2026-03-16 16:10:15.508231543 +0000 UTC m=+2317.662163210" watchObservedRunningTime="2026-03-16 16:10:15.509284951 +0000 UTC m=+2317.663216608" Mar 16 16:10:15 crc kubenswrapper[5120]: I0316 16:10:15.509477 5120 generic.go:358] "Generic (PLEG): container finished" podID="73733c44-4d3b-4797-b839-cacdffc714a8" containerID="03a6a9abd07f8b62f69dab65419dd7dbe5c9dcb24e6f22ff10017e9d32a11780" exitCode=0 Mar 16 16:10:15 crc kubenswrapper[5120]: I0316 16:10:15.509501 5120 generic.go:358] "Generic (PLEG): container finished" podID="73733c44-4d3b-4797-b839-cacdffc714a8" containerID="e48aaa1b751c1b2afbdd9bdda084b4bd4c3d36caeac98b068ee965a33fa85ee0" exitCode=2 Mar 16 16:10:15 crc kubenswrapper[5120]: I0316 16:10:15.509509 5120 generic.go:358] "Generic (PLEG): container finished" podID="73733c44-4d3b-4797-b839-cacdffc714a8" containerID="6caf8b4bdc94e7e8a301f80e8e8b264137575e0a23c83ab620fa8ddf06787833" exitCode=0 Mar 16 16:10:15 crc kubenswrapper[5120]: I0316 16:10:15.509864 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"73733c44-4d3b-4797-b839-cacdffc714a8","Type":"ContainerDied","Data":"03a6a9abd07f8b62f69dab65419dd7dbe5c9dcb24e6f22ff10017e9d32a11780"} Mar 16 16:10:15 crc kubenswrapper[5120]: I0316 16:10:15.509901 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"73733c44-4d3b-4797-b839-cacdffc714a8","Type":"ContainerDied","Data":"e48aaa1b751c1b2afbdd9bdda084b4bd4c3d36caeac98b068ee965a33fa85ee0"} Mar 16 16:10:15 crc kubenswrapper[5120]: I0316 16:10:15.509914 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"73733c44-4d3b-4797-b839-cacdffc714a8","Type":"ContainerDied","Data":"6caf8b4bdc94e7e8a301f80e8e8b264137575e0a23c83ab620fa8ddf06787833"} Mar 16 16:10:16 crc kubenswrapper[5120]: I0316 16:10:16.518503 5120 generic.go:358] "Generic (PLEG): container finished" podID="bc25453e-6c18-4b92-9056-03885c683487" containerID="ea8deddd73fde4c5ea23f81fa45539ab89c9921aa9ad9bb0430924396bb773e6" exitCode=0 Mar 16 16:10:16 crc kubenswrapper[5120]: I0316 16:10:16.518555 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-62x2t" event={"ID":"bc25453e-6c18-4b92-9056-03885c683487","Type":"ContainerDied","Data":"ea8deddd73fde4c5ea23f81fa45539ab89c9921aa9ad9bb0430924396bb773e6"} Mar 16 16:10:16 crc kubenswrapper[5120]: I0316 16:10:16.522237 5120 generic.go:358] "Generic (PLEG): container finished" podID="f9c983a9-b335-4d5a-91a7-d8f4d332ba77" containerID="2964d6eb95f5debfdfb4ed8f1a05caf29f7abb417eef506fc6a7729a0163939d" exitCode=0 Mar 16 16:10:16 crc kubenswrapper[5120]: I0316 16:10:16.523284 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-qm2tb" event={"ID":"f9c983a9-b335-4d5a-91a7-d8f4d332ba77","Type":"ContainerDied","Data":"2964d6eb95f5debfdfb4ed8f1a05caf29f7abb417eef506fc6a7729a0163939d"} Mar 16 16:10:17 crc kubenswrapper[5120]: I0316 16:10:17.217463 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:10:17 crc kubenswrapper[5120]: I0316 16:10:17.264803 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:10:17 crc kubenswrapper[5120]: I0316 16:10:17.343950 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:10:17 crc kubenswrapper[5120]: I0316 16:10:17.344020 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:10:17 crc kubenswrapper[5120]: I0316 16:10:17.577516 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:10:17 crc kubenswrapper[5120]: I0316 16:10:17.918088 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:10:17 crc kubenswrapper[5120]: I0316 16:10:17.994330 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-62x2t" Mar 16 16:10:18 crc kubenswrapper[5120]: I0316 16:10:18.001551 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-qm2tb" Mar 16 16:10:18 crc kubenswrapper[5120]: I0316 16:10:18.180053 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kj9sq\" (UniqueName: \"kubernetes.io/projected/bc25453e-6c18-4b92-9056-03885c683487-kube-api-access-kj9sq\") pod \"bc25453e-6c18-4b92-9056-03885c683487\" (UID: \"bc25453e-6c18-4b92-9056-03885c683487\") " Mar 16 16:10:18 crc kubenswrapper[5120]: I0316 16:10:18.180188 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f9c983a9-b335-4d5a-91a7-d8f4d332ba77-config-data\") pod \"f9c983a9-b335-4d5a-91a7-d8f4d332ba77\" (UID: \"f9c983a9-b335-4d5a-91a7-d8f4d332ba77\") " Mar 16 16:10:18 crc kubenswrapper[5120]: I0316 16:10:18.180300 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f9c983a9-b335-4d5a-91a7-d8f4d332ba77-combined-ca-bundle\") pod \"f9c983a9-b335-4d5a-91a7-d8f4d332ba77\" (UID: \"f9c983a9-b335-4d5a-91a7-d8f4d332ba77\") " Mar 16 16:10:18 crc kubenswrapper[5120]: I0316 16:10:18.180336 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f9c983a9-b335-4d5a-91a7-d8f4d332ba77-scripts\") pod \"f9c983a9-b335-4d5a-91a7-d8f4d332ba77\" (UID: \"f9c983a9-b335-4d5a-91a7-d8f4d332ba77\") " Mar 16 16:10:18 crc kubenswrapper[5120]: I0316 16:10:18.180413 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bc25453e-6c18-4b92-9056-03885c683487-config-data\") pod \"bc25453e-6c18-4b92-9056-03885c683487\" (UID: \"bc25453e-6c18-4b92-9056-03885c683487\") " Mar 16 16:10:18 crc kubenswrapper[5120]: I0316 16:10:18.180536 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/bc25453e-6c18-4b92-9056-03885c683487-scripts\") pod \"bc25453e-6c18-4b92-9056-03885c683487\" (UID: \"bc25453e-6c18-4b92-9056-03885c683487\") " Mar 16 16:10:18 crc kubenswrapper[5120]: I0316 16:10:18.180614 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rrlv6\" (UniqueName: \"kubernetes.io/projected/f9c983a9-b335-4d5a-91a7-d8f4d332ba77-kube-api-access-rrlv6\") pod \"f9c983a9-b335-4d5a-91a7-d8f4d332ba77\" (UID: \"f9c983a9-b335-4d5a-91a7-d8f4d332ba77\") " Mar 16 16:10:18 crc kubenswrapper[5120]: I0316 16:10:18.180644 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bc25453e-6c18-4b92-9056-03885c683487-combined-ca-bundle\") pod \"bc25453e-6c18-4b92-9056-03885c683487\" (UID: \"bc25453e-6c18-4b92-9056-03885c683487\") " Mar 16 16:10:18 crc kubenswrapper[5120]: I0316 16:10:18.185702 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bc25453e-6c18-4b92-9056-03885c683487-scripts" (OuterVolumeSpecName: "scripts") pod "bc25453e-6c18-4b92-9056-03885c683487" (UID: "bc25453e-6c18-4b92-9056-03885c683487"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:10:18 crc kubenswrapper[5120]: I0316 16:10:18.188847 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f9c983a9-b335-4d5a-91a7-d8f4d332ba77-scripts" (OuterVolumeSpecName: "scripts") pod "f9c983a9-b335-4d5a-91a7-d8f4d332ba77" (UID: "f9c983a9-b335-4d5a-91a7-d8f4d332ba77"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:10:18 crc kubenswrapper[5120]: I0316 16:10:18.197559 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f9c983a9-b335-4d5a-91a7-d8f4d332ba77-kube-api-access-rrlv6" (OuterVolumeSpecName: "kube-api-access-rrlv6") pod "f9c983a9-b335-4d5a-91a7-d8f4d332ba77" (UID: "f9c983a9-b335-4d5a-91a7-d8f4d332ba77"). InnerVolumeSpecName "kube-api-access-rrlv6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:10:18 crc kubenswrapper[5120]: I0316 16:10:18.219948 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bc25453e-6c18-4b92-9056-03885c683487-config-data" (OuterVolumeSpecName: "config-data") pod "bc25453e-6c18-4b92-9056-03885c683487" (UID: "bc25453e-6c18-4b92-9056-03885c683487"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:10:18 crc kubenswrapper[5120]: I0316 16:10:18.219966 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc25453e-6c18-4b92-9056-03885c683487-kube-api-access-kj9sq" (OuterVolumeSpecName: "kube-api-access-kj9sq") pod "bc25453e-6c18-4b92-9056-03885c683487" (UID: "bc25453e-6c18-4b92-9056-03885c683487"). InnerVolumeSpecName "kube-api-access-kj9sq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:10:18 crc kubenswrapper[5120]: I0316 16:10:18.225847 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f9c983a9-b335-4d5a-91a7-d8f4d332ba77-config-data" (OuterVolumeSpecName: "config-data") pod "f9c983a9-b335-4d5a-91a7-d8f4d332ba77" (UID: "f9c983a9-b335-4d5a-91a7-d8f4d332ba77"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:10:18 crc kubenswrapper[5120]: I0316 16:10:18.241027 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bc25453e-6c18-4b92-9056-03885c683487-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "bc25453e-6c18-4b92-9056-03885c683487" (UID: "bc25453e-6c18-4b92-9056-03885c683487"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:10:18 crc kubenswrapper[5120]: I0316 16:10:18.243492 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f9c983a9-b335-4d5a-91a7-d8f4d332ba77-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f9c983a9-b335-4d5a-91a7-d8f4d332ba77" (UID: "f9c983a9-b335-4d5a-91a7-d8f4d332ba77"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:10:18 crc kubenswrapper[5120]: I0316 16:10:18.283416 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bc25453e-6c18-4b92-9056-03885c683487-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:10:18 crc kubenswrapper[5120]: I0316 16:10:18.283449 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kj9sq\" (UniqueName: \"kubernetes.io/projected/bc25453e-6c18-4b92-9056-03885c683487-kube-api-access-kj9sq\") on node \"crc\" DevicePath \"\"" Mar 16 16:10:18 crc kubenswrapper[5120]: I0316 16:10:18.283462 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f9c983a9-b335-4d5a-91a7-d8f4d332ba77-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:10:18 crc kubenswrapper[5120]: I0316 16:10:18.283470 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f9c983a9-b335-4d5a-91a7-d8f4d332ba77-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:10:18 crc kubenswrapper[5120]: I0316 16:10:18.283478 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f9c983a9-b335-4d5a-91a7-d8f4d332ba77-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:10:18 crc kubenswrapper[5120]: I0316 16:10:18.283487 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bc25453e-6c18-4b92-9056-03885c683487-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:10:18 crc kubenswrapper[5120]: I0316 16:10:18.283494 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/bc25453e-6c18-4b92-9056-03885c683487-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:10:18 crc kubenswrapper[5120]: I0316 16:10:18.283502 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rrlv6\" (UniqueName: \"kubernetes.io/projected/f9c983a9-b335-4d5a-91a7-d8f4d332ba77-kube-api-access-rrlv6\") on node \"crc\" DevicePath \"\"" Mar 16 16:10:18 crc kubenswrapper[5120]: I0316 16:10:18.384893 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="031c7932-9816-4571-8397-f517a70caf41" containerName="nova-api-log" probeResult="failure" output="Get \"http://10.217.0.121:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 16:10:18 crc kubenswrapper[5120]: I0316 16:10:18.384945 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="031c7932-9816-4571-8397-f517a70caf41" containerName="nova-api-api" probeResult="failure" output="Get \"http://10.217.0.121:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 16:10:18 crc kubenswrapper[5120]: I0316 16:10:18.545865 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-62x2t" Mar 16 16:10:18 crc kubenswrapper[5120]: I0316 16:10:18.545882 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-62x2t" event={"ID":"bc25453e-6c18-4b92-9056-03885c683487","Type":"ContainerDied","Data":"18753a6f88659ff40ce50f0aa6ac3e0bcc05e0f8fe4dd986f05fc65c9338ee78"} Mar 16 16:10:18 crc kubenswrapper[5120]: I0316 16:10:18.546278 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="18753a6f88659ff40ce50f0aa6ac3e0bcc05e0f8fe4dd986f05fc65c9338ee78" Mar 16 16:10:18 crc kubenswrapper[5120]: I0316 16:10:18.549086 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-qm2tb" Mar 16 16:10:18 crc kubenswrapper[5120]: I0316 16:10:18.549103 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-qm2tb" event={"ID":"f9c983a9-b335-4d5a-91a7-d8f4d332ba77","Type":"ContainerDied","Data":"d4bd782de1492b0a50d9d137d560ff9fd9f587fc4ae35e582200ac9b92763cf7"} Mar 16 16:10:18 crc kubenswrapper[5120]: I0316 16:10:18.549147 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d4bd782de1492b0a50d9d137d560ff9fd9f587fc4ae35e582200ac9b92763cf7" Mar 16 16:10:18 crc kubenswrapper[5120]: I0316 16:10:18.635463 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 16:10:18 crc kubenswrapper[5120]: I0316 16:10:18.636855 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc25453e-6c18-4b92-9056-03885c683487" containerName="nova-cell1-conductor-db-sync" Mar 16 16:10:18 crc kubenswrapper[5120]: I0316 16:10:18.636882 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc25453e-6c18-4b92-9056-03885c683487" containerName="nova-cell1-conductor-db-sync" Mar 16 16:10:18 crc kubenswrapper[5120]: I0316 16:10:18.636961 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9c983a9-b335-4d5a-91a7-d8f4d332ba77" containerName="nova-manage" Mar 16 16:10:18 crc kubenswrapper[5120]: I0316 16:10:18.636971 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9c983a9-b335-4d5a-91a7-d8f4d332ba77" containerName="nova-manage" Mar 16 16:10:18 crc kubenswrapper[5120]: I0316 16:10:18.637195 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="bc25453e-6c18-4b92-9056-03885c683487" containerName="nova-cell1-conductor-db-sync" Mar 16 16:10:18 crc kubenswrapper[5120]: I0316 16:10:18.637224 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f9c983a9-b335-4d5a-91a7-d8f4d332ba77" containerName="nova-manage" Mar 16 16:10:18 crc kubenswrapper[5120]: I0316 16:10:18.643072 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 16:10:18 crc kubenswrapper[5120]: I0316 16:10:18.643222 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:10:18 crc kubenswrapper[5120]: I0316 16:10:18.647153 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-conductor-config-data\"" Mar 16 16:10:18 crc kubenswrapper[5120]: I0316 16:10:18.762415 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:10:18 crc kubenswrapper[5120]: I0316 16:10:18.770891 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:10:18 crc kubenswrapper[5120]: I0316 16:10:18.771149 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="031c7932-9816-4571-8397-f517a70caf41" containerName="nova-api-log" containerID="cri-o://78382554d9c208bba61834a431de97fc207b284ff5c8f388eb91ae7ea5bbbe8d" gracePeriod=30 Mar 16 16:10:18 crc kubenswrapper[5120]: I0316 16:10:18.771288 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="031c7932-9816-4571-8397-f517a70caf41" containerName="nova-api-api" containerID="cri-o://d63aa185f89b094e212f4b9c1e6a47eba5f4c1879b7497a04e1756dd958d9e0b" gracePeriod=30 Mar 16 16:10:18 crc kubenswrapper[5120]: I0316 16:10:18.795031 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/12b38435-0635-409b-8888-94cdc5433388-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"12b38435-0635-409b-8888-94cdc5433388\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:10:18 crc kubenswrapper[5120]: I0316 16:10:18.795251 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wf2s2\" (UniqueName: \"kubernetes.io/projected/12b38435-0635-409b-8888-94cdc5433388-kube-api-access-wf2s2\") pod \"nova-cell1-conductor-0\" (UID: \"12b38435-0635-409b-8888-94cdc5433388\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:10:18 crc kubenswrapper[5120]: I0316 16:10:18.795284 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/12b38435-0635-409b-8888-94cdc5433388-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"12b38435-0635-409b-8888-94cdc5433388\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:10:18 crc kubenswrapper[5120]: I0316 16:10:18.829819 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:10:18 crc kubenswrapper[5120]: I0316 16:10:18.830271 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="25f31d35-683c-46f1-b80a-ee5b06665073" containerName="nova-metadata-log" containerID="cri-o://ae8d8acc81c4fa4c6f80620713b70fdfe04ee9dfea262eefc13de9961ba0c1bc" gracePeriod=30 Mar 16 16:10:18 crc kubenswrapper[5120]: I0316 16:10:18.830343 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="25f31d35-683c-46f1-b80a-ee5b06665073" containerName="nova-metadata-metadata" containerID="cri-o://2b5c0ae05ab1173c641baf5bde397c4c5da3b83712008de7089ed6928f8ce2b8" gracePeriod=30 Mar 16 16:10:18 crc kubenswrapper[5120]: I0316 16:10:18.896547 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/12b38435-0635-409b-8888-94cdc5433388-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"12b38435-0635-409b-8888-94cdc5433388\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:10:18 crc kubenswrapper[5120]: I0316 16:10:18.896697 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wf2s2\" (UniqueName: \"kubernetes.io/projected/12b38435-0635-409b-8888-94cdc5433388-kube-api-access-wf2s2\") pod \"nova-cell1-conductor-0\" (UID: \"12b38435-0635-409b-8888-94cdc5433388\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:10:18 crc kubenswrapper[5120]: I0316 16:10:18.896726 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/12b38435-0635-409b-8888-94cdc5433388-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"12b38435-0635-409b-8888-94cdc5433388\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:10:18 crc kubenswrapper[5120]: I0316 16:10:18.908859 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/12b38435-0635-409b-8888-94cdc5433388-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"12b38435-0635-409b-8888-94cdc5433388\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:10:18 crc kubenswrapper[5120]: I0316 16:10:18.908904 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/12b38435-0635-409b-8888-94cdc5433388-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"12b38435-0635-409b-8888-94cdc5433388\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:10:18 crc kubenswrapper[5120]: I0316 16:10:18.918284 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wf2s2\" (UniqueName: \"kubernetes.io/projected/12b38435-0635-409b-8888-94cdc5433388-kube-api-access-wf2s2\") pod \"nova-cell1-conductor-0\" (UID: \"12b38435-0635-409b-8888-94cdc5433388\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:10:18 crc kubenswrapper[5120]: I0316 16:10:18.961976 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.201140 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.306163 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/73733c44-4d3b-4797-b839-cacdffc714a8-sg-core-conf-yaml\") pod \"73733c44-4d3b-4797-b839-cacdffc714a8\" (UID: \"73733c44-4d3b-4797-b839-cacdffc714a8\") " Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.306375 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/73733c44-4d3b-4797-b839-cacdffc714a8-log-httpd\") pod \"73733c44-4d3b-4797-b839-cacdffc714a8\" (UID: \"73733c44-4d3b-4797-b839-cacdffc714a8\") " Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.306430 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/73733c44-4d3b-4797-b839-cacdffc714a8-scripts\") pod \"73733c44-4d3b-4797-b839-cacdffc714a8\" (UID: \"73733c44-4d3b-4797-b839-cacdffc714a8\") " Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.306488 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/73733c44-4d3b-4797-b839-cacdffc714a8-config-data\") pod \"73733c44-4d3b-4797-b839-cacdffc714a8\" (UID: \"73733c44-4d3b-4797-b839-cacdffc714a8\") " Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.306527 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/73733c44-4d3b-4797-b839-cacdffc714a8-combined-ca-bundle\") pod \"73733c44-4d3b-4797-b839-cacdffc714a8\" (UID: \"73733c44-4d3b-4797-b839-cacdffc714a8\") " Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.306571 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/73733c44-4d3b-4797-b839-cacdffc714a8-run-httpd\") pod \"73733c44-4d3b-4797-b839-cacdffc714a8\" (UID: \"73733c44-4d3b-4797-b839-cacdffc714a8\") " Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.306589 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4nxsr\" (UniqueName: \"kubernetes.io/projected/73733c44-4d3b-4797-b839-cacdffc714a8-kube-api-access-4nxsr\") pod \"73733c44-4d3b-4797-b839-cacdffc714a8\" (UID: \"73733c44-4d3b-4797-b839-cacdffc714a8\") " Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.308847 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73733c44-4d3b-4797-b839-cacdffc714a8-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "73733c44-4d3b-4797-b839-cacdffc714a8" (UID: "73733c44-4d3b-4797-b839-cacdffc714a8"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.310100 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73733c44-4d3b-4797-b839-cacdffc714a8-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "73733c44-4d3b-4797-b839-cacdffc714a8" (UID: "73733c44-4d3b-4797-b839-cacdffc714a8"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.315983 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73733c44-4d3b-4797-b839-cacdffc714a8-kube-api-access-4nxsr" (OuterVolumeSpecName: "kube-api-access-4nxsr") pod "73733c44-4d3b-4797-b839-cacdffc714a8" (UID: "73733c44-4d3b-4797-b839-cacdffc714a8"). InnerVolumeSpecName "kube-api-access-4nxsr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.321857 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/73733c44-4d3b-4797-b839-cacdffc714a8-scripts" (OuterVolumeSpecName: "scripts") pod "73733c44-4d3b-4797-b839-cacdffc714a8" (UID: "73733c44-4d3b-4797-b839-cacdffc714a8"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.351132 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/73733c44-4d3b-4797-b839-cacdffc714a8-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "73733c44-4d3b-4797-b839-cacdffc714a8" (UID: "73733c44-4d3b-4797-b839-cacdffc714a8"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.390867 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.398689 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/73733c44-4d3b-4797-b839-cacdffc714a8-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "73733c44-4d3b-4797-b839-cacdffc714a8" (UID: "73733c44-4d3b-4797-b839-cacdffc714a8"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.415360 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ktc4b\" (UniqueName: \"kubernetes.io/projected/25f31d35-683c-46f1-b80a-ee5b06665073-kube-api-access-ktc4b\") pod \"25f31d35-683c-46f1-b80a-ee5b06665073\" (UID: \"25f31d35-683c-46f1-b80a-ee5b06665073\") " Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.415534 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/25f31d35-683c-46f1-b80a-ee5b06665073-nova-metadata-tls-certs\") pod \"25f31d35-683c-46f1-b80a-ee5b06665073\" (UID: \"25f31d35-683c-46f1-b80a-ee5b06665073\") " Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.415629 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/25f31d35-683c-46f1-b80a-ee5b06665073-combined-ca-bundle\") pod \"25f31d35-683c-46f1-b80a-ee5b06665073\" (UID: \"25f31d35-683c-46f1-b80a-ee5b06665073\") " Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.415695 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/25f31d35-683c-46f1-b80a-ee5b06665073-config-data\") pod \"25f31d35-683c-46f1-b80a-ee5b06665073\" (UID: \"25f31d35-683c-46f1-b80a-ee5b06665073\") " Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.415731 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/25f31d35-683c-46f1-b80a-ee5b06665073-logs\") pod \"25f31d35-683c-46f1-b80a-ee5b06665073\" (UID: \"25f31d35-683c-46f1-b80a-ee5b06665073\") " Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.416449 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/73733c44-4d3b-4797-b839-cacdffc714a8-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.416461 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/73733c44-4d3b-4797-b839-cacdffc714a8-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.416469 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/73733c44-4d3b-4797-b839-cacdffc714a8-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.416477 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/73733c44-4d3b-4797-b839-cacdffc714a8-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.416486 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/73733c44-4d3b-4797-b839-cacdffc714a8-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.416497 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4nxsr\" (UniqueName: \"kubernetes.io/projected/73733c44-4d3b-4797-b839-cacdffc714a8-kube-api-access-4nxsr\") on node \"crc\" DevicePath \"\"" Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.416753 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25f31d35-683c-46f1-b80a-ee5b06665073-logs" (OuterVolumeSpecName: "logs") pod "25f31d35-683c-46f1-b80a-ee5b06665073" (UID: "25f31d35-683c-46f1-b80a-ee5b06665073"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.429300 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25f31d35-683c-46f1-b80a-ee5b06665073-kube-api-access-ktc4b" (OuterVolumeSpecName: "kube-api-access-ktc4b") pod "25f31d35-683c-46f1-b80a-ee5b06665073" (UID: "25f31d35-683c-46f1-b80a-ee5b06665073"). InnerVolumeSpecName "kube-api-access-ktc4b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.449906 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/25f31d35-683c-46f1-b80a-ee5b06665073-config-data" (OuterVolumeSpecName: "config-data") pod "25f31d35-683c-46f1-b80a-ee5b06665073" (UID: "25f31d35-683c-46f1-b80a-ee5b06665073"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.453976 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/73733c44-4d3b-4797-b839-cacdffc714a8-config-data" (OuterVolumeSpecName: "config-data") pod "73733c44-4d3b-4797-b839-cacdffc714a8" (UID: "73733c44-4d3b-4797-b839-cacdffc714a8"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.457875 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/25f31d35-683c-46f1-b80a-ee5b06665073-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "25f31d35-683c-46f1-b80a-ee5b06665073" (UID: "25f31d35-683c-46f1-b80a-ee5b06665073"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.486951 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/25f31d35-683c-46f1-b80a-ee5b06665073-nova-metadata-tls-certs" (OuterVolumeSpecName: "nova-metadata-tls-certs") pod "25f31d35-683c-46f1-b80a-ee5b06665073" (UID: "25f31d35-683c-46f1-b80a-ee5b06665073"). InnerVolumeSpecName "nova-metadata-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.517926 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/25f31d35-683c-46f1-b80a-ee5b06665073-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.517958 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/25f31d35-683c-46f1-b80a-ee5b06665073-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.517969 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/25f31d35-683c-46f1-b80a-ee5b06665073-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.517977 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/73733c44-4d3b-4797-b839-cacdffc714a8-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.517985 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ktc4b\" (UniqueName: \"kubernetes.io/projected/25f31d35-683c-46f1-b80a-ee5b06665073-kube-api-access-ktc4b\") on node \"crc\" DevicePath \"\"" Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.517996 5120 reconciler_common.go:299] "Volume detached for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/25f31d35-683c-46f1-b80a-ee5b06665073-nova-metadata-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.525975 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 16:10:19 crc kubenswrapper[5120]: W0316 16:10:19.527714 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod12b38435_0635_409b_8888_94cdc5433388.slice/crio-3a595cbaa88d998a80d51b2a84efdf608501b49bbbde671663f29b71fd75054c WatchSource:0}: Error finding container 3a595cbaa88d998a80d51b2a84efdf608501b49bbbde671663f29b71fd75054c: Status 404 returned error can't find the container with id 3a595cbaa88d998a80d51b2a84efdf608501b49bbbde671663f29b71fd75054c Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.557607 5120 generic.go:358] "Generic (PLEG): container finished" podID="25f31d35-683c-46f1-b80a-ee5b06665073" containerID="2b5c0ae05ab1173c641baf5bde397c4c5da3b83712008de7089ed6928f8ce2b8" exitCode=0 Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.557635 5120 generic.go:358] "Generic (PLEG): container finished" podID="25f31d35-683c-46f1-b80a-ee5b06665073" containerID="ae8d8acc81c4fa4c6f80620713b70fdfe04ee9dfea262eefc13de9961ba0c1bc" exitCode=143 Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.557783 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"25f31d35-683c-46f1-b80a-ee5b06665073","Type":"ContainerDied","Data":"2b5c0ae05ab1173c641baf5bde397c4c5da3b83712008de7089ed6928f8ce2b8"} Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.557809 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"25f31d35-683c-46f1-b80a-ee5b06665073","Type":"ContainerDied","Data":"ae8d8acc81c4fa4c6f80620713b70fdfe04ee9dfea262eefc13de9961ba0c1bc"} Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.557819 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"25f31d35-683c-46f1-b80a-ee5b06665073","Type":"ContainerDied","Data":"66c5849a65ba589fbb398cc9e61ab3fa4209404381655e75eeb8b63632478258"} Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.557833 5120 scope.go:117] "RemoveContainer" containerID="2b5c0ae05ab1173c641baf5bde397c4c5da3b83712008de7089ed6928f8ce2b8" Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.557956 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.561683 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"12b38435-0635-409b-8888-94cdc5433388","Type":"ContainerStarted","Data":"3a595cbaa88d998a80d51b2a84efdf608501b49bbbde671663f29b71fd75054c"} Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.566228 5120 generic.go:358] "Generic (PLEG): container finished" podID="73733c44-4d3b-4797-b839-cacdffc714a8" containerID="28ad945a4f00825a33604975a1201b4961f99d0ef1130ff20963ef1abf8d7343" exitCode=0 Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.566467 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"73733c44-4d3b-4797-b839-cacdffc714a8","Type":"ContainerDied","Data":"28ad945a4f00825a33604975a1201b4961f99d0ef1130ff20963ef1abf8d7343"} Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.566503 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"73733c44-4d3b-4797-b839-cacdffc714a8","Type":"ContainerDied","Data":"343a9bea0bea158f29baa06aeeb2c819969e759f1a7f41b9214199b99d393b15"} Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.566600 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.574606 5120 generic.go:358] "Generic (PLEG): container finished" podID="031c7932-9816-4571-8397-f517a70caf41" containerID="78382554d9c208bba61834a431de97fc207b284ff5c8f388eb91ae7ea5bbbe8d" exitCode=143 Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.575834 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"031c7932-9816-4571-8397-f517a70caf41","Type":"ContainerDied","Data":"78382554d9c208bba61834a431de97fc207b284ff5c8f388eb91ae7ea5bbbe8d"} Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.577928 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="28e5ecb8-7c04-4dbc-a8eb-981851f81690" containerName="nova-scheduler-scheduler" containerID="cri-o://ea7571be774b77bc67ff84d1b00accab166ea6986167b5b147b2fbb4667fe6de" gracePeriod=30 Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.596910 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.610395 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.616482 5120 scope.go:117] "RemoveContainer" containerID="ae8d8acc81c4fa4c6f80620713b70fdfe04ee9dfea262eefc13de9961ba0c1bc" Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.675325 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.680863 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73733c44-4d3b-4797-b839-cacdffc714a8" containerName="proxy-httpd" Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.681079 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="73733c44-4d3b-4797-b839-cacdffc714a8" containerName="proxy-httpd" Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.681180 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73733c44-4d3b-4797-b839-cacdffc714a8" containerName="ceilometer-notification-agent" Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.681240 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="73733c44-4d3b-4797-b839-cacdffc714a8" containerName="ceilometer-notification-agent" Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.681352 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25f31d35-683c-46f1-b80a-ee5b06665073" containerName="nova-metadata-log" Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.681418 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="25f31d35-683c-46f1-b80a-ee5b06665073" containerName="nova-metadata-log" Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.681499 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73733c44-4d3b-4797-b839-cacdffc714a8" containerName="ceilometer-central-agent" Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.681563 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="73733c44-4d3b-4797-b839-cacdffc714a8" containerName="ceilometer-central-agent" Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.681651 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25f31d35-683c-46f1-b80a-ee5b06665073" containerName="nova-metadata-metadata" Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.681712 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="25f31d35-683c-46f1-b80a-ee5b06665073" containerName="nova-metadata-metadata" Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.681831 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73733c44-4d3b-4797-b839-cacdffc714a8" containerName="sg-core" Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.681893 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="73733c44-4d3b-4797-b839-cacdffc714a8" containerName="sg-core" Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.682411 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="73733c44-4d3b-4797-b839-cacdffc714a8" containerName="proxy-httpd" Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.682504 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="25f31d35-683c-46f1-b80a-ee5b06665073" containerName="nova-metadata-metadata" Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.682585 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="25f31d35-683c-46f1-b80a-ee5b06665073" containerName="nova-metadata-log" Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.682654 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="73733c44-4d3b-4797-b839-cacdffc714a8" containerName="sg-core" Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.682726 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="73733c44-4d3b-4797-b839-cacdffc714a8" containerName="ceilometer-central-agent" Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.682818 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="73733c44-4d3b-4797-b839-cacdffc714a8" containerName="ceilometer-notification-agent" Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.692284 5120 scope.go:117] "RemoveContainer" containerID="2b5c0ae05ab1173c641baf5bde397c4c5da3b83712008de7089ed6928f8ce2b8" Mar 16 16:10:19 crc kubenswrapper[5120]: E0316 16:10:19.695806 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b5c0ae05ab1173c641baf5bde397c4c5da3b83712008de7089ed6928f8ce2b8\": container with ID starting with 2b5c0ae05ab1173c641baf5bde397c4c5da3b83712008de7089ed6928f8ce2b8 not found: ID does not exist" containerID="2b5c0ae05ab1173c641baf5bde397c4c5da3b83712008de7089ed6928f8ce2b8" Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.695841 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b5c0ae05ab1173c641baf5bde397c4c5da3b83712008de7089ed6928f8ce2b8"} err="failed to get container status \"2b5c0ae05ab1173c641baf5bde397c4c5da3b83712008de7089ed6928f8ce2b8\": rpc error: code = NotFound desc = could not find container \"2b5c0ae05ab1173c641baf5bde397c4c5da3b83712008de7089ed6928f8ce2b8\": container with ID starting with 2b5c0ae05ab1173c641baf5bde397c4c5da3b83712008de7089ed6928f8ce2b8 not found: ID does not exist" Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.695874 5120 scope.go:117] "RemoveContainer" containerID="ae8d8acc81c4fa4c6f80620713b70fdfe04ee9dfea262eefc13de9961ba0c1bc" Mar 16 16:10:19 crc kubenswrapper[5120]: E0316 16:10:19.696864 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ae8d8acc81c4fa4c6f80620713b70fdfe04ee9dfea262eefc13de9961ba0c1bc\": container with ID starting with ae8d8acc81c4fa4c6f80620713b70fdfe04ee9dfea262eefc13de9961ba0c1bc not found: ID does not exist" containerID="ae8d8acc81c4fa4c6f80620713b70fdfe04ee9dfea262eefc13de9961ba0c1bc" Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.696888 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae8d8acc81c4fa4c6f80620713b70fdfe04ee9dfea262eefc13de9961ba0c1bc"} err="failed to get container status \"ae8d8acc81c4fa4c6f80620713b70fdfe04ee9dfea262eefc13de9961ba0c1bc\": rpc error: code = NotFound desc = could not find container \"ae8d8acc81c4fa4c6f80620713b70fdfe04ee9dfea262eefc13de9961ba0c1bc\": container with ID starting with ae8d8acc81c4fa4c6f80620713b70fdfe04ee9dfea262eefc13de9961ba0c1bc not found: ID does not exist" Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.696902 5120 scope.go:117] "RemoveContainer" containerID="2b5c0ae05ab1173c641baf5bde397c4c5da3b83712008de7089ed6928f8ce2b8" Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.710726 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b5c0ae05ab1173c641baf5bde397c4c5da3b83712008de7089ed6928f8ce2b8"} err="failed to get container status \"2b5c0ae05ab1173c641baf5bde397c4c5da3b83712008de7089ed6928f8ce2b8\": rpc error: code = NotFound desc = could not find container \"2b5c0ae05ab1173c641baf5bde397c4c5da3b83712008de7089ed6928f8ce2b8\": container with ID starting with 2b5c0ae05ab1173c641baf5bde397c4c5da3b83712008de7089ed6928f8ce2b8 not found: ID does not exist" Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.710792 5120 scope.go:117] "RemoveContainer" containerID="ae8d8acc81c4fa4c6f80620713b70fdfe04ee9dfea262eefc13de9961ba0c1bc" Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.712287 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae8d8acc81c4fa4c6f80620713b70fdfe04ee9dfea262eefc13de9961ba0c1bc"} err="failed to get container status \"ae8d8acc81c4fa4c6f80620713b70fdfe04ee9dfea262eefc13de9961ba0c1bc\": rpc error: code = NotFound desc = could not find container \"ae8d8acc81c4fa4c6f80620713b70fdfe04ee9dfea262eefc13de9961ba0c1bc\": container with ID starting with ae8d8acc81c4fa4c6f80620713b70fdfe04ee9dfea262eefc13de9961ba0c1bc not found: ID does not exist" Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.712331 5120 scope.go:117] "RemoveContainer" containerID="03a6a9abd07f8b62f69dab65419dd7dbe5c9dcb24e6f22ff10017e9d32a11780" Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.716029 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.716108 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.716212 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.719671 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-metadata-config-data\"" Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.719868 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-metadata-internal-svc\"" Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.726336 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.737015 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.743841 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.746577 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.747035 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ceilometer-internal-svc\"" Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.747744 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.747958 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.756655 5120 scope.go:117] "RemoveContainer" containerID="e48aaa1b751c1b2afbdd9bdda084b4bd4c3d36caeac98b068ee965a33fa85ee0" Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.783939 5120 scope.go:117] "RemoveContainer" containerID="28ad945a4f00825a33604975a1201b4961f99d0ef1130ff20963ef1abf8d7343" Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.813534 5120 scope.go:117] "RemoveContainer" containerID="6caf8b4bdc94e7e8a301f80e8e8b264137575e0a23c83ab620fa8ddf06787833" Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.837799 5120 scope.go:117] "RemoveContainer" containerID="03a6a9abd07f8b62f69dab65419dd7dbe5c9dcb24e6f22ff10017e9d32a11780" Mar 16 16:10:19 crc kubenswrapper[5120]: E0316 16:10:19.838550 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"03a6a9abd07f8b62f69dab65419dd7dbe5c9dcb24e6f22ff10017e9d32a11780\": container with ID starting with 03a6a9abd07f8b62f69dab65419dd7dbe5c9dcb24e6f22ff10017e9d32a11780 not found: ID does not exist" containerID="03a6a9abd07f8b62f69dab65419dd7dbe5c9dcb24e6f22ff10017e9d32a11780" Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.838595 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03a6a9abd07f8b62f69dab65419dd7dbe5c9dcb24e6f22ff10017e9d32a11780"} err="failed to get container status \"03a6a9abd07f8b62f69dab65419dd7dbe5c9dcb24e6f22ff10017e9d32a11780\": rpc error: code = NotFound desc = could not find container \"03a6a9abd07f8b62f69dab65419dd7dbe5c9dcb24e6f22ff10017e9d32a11780\": container with ID starting with 03a6a9abd07f8b62f69dab65419dd7dbe5c9dcb24e6f22ff10017e9d32a11780 not found: ID does not exist" Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.838621 5120 scope.go:117] "RemoveContainer" containerID="e48aaa1b751c1b2afbdd9bdda084b4bd4c3d36caeac98b068ee965a33fa85ee0" Mar 16 16:10:19 crc kubenswrapper[5120]: E0316 16:10:19.838914 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e48aaa1b751c1b2afbdd9bdda084b4bd4c3d36caeac98b068ee965a33fa85ee0\": container with ID starting with e48aaa1b751c1b2afbdd9bdda084b4bd4c3d36caeac98b068ee965a33fa85ee0 not found: ID does not exist" containerID="e48aaa1b751c1b2afbdd9bdda084b4bd4c3d36caeac98b068ee965a33fa85ee0" Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.838957 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e48aaa1b751c1b2afbdd9bdda084b4bd4c3d36caeac98b068ee965a33fa85ee0"} err="failed to get container status \"e48aaa1b751c1b2afbdd9bdda084b4bd4c3d36caeac98b068ee965a33fa85ee0\": rpc error: code = NotFound desc = could not find container \"e48aaa1b751c1b2afbdd9bdda084b4bd4c3d36caeac98b068ee965a33fa85ee0\": container with ID starting with e48aaa1b751c1b2afbdd9bdda084b4bd4c3d36caeac98b068ee965a33fa85ee0 not found: ID does not exist" Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.838987 5120 scope.go:117] "RemoveContainer" containerID="28ad945a4f00825a33604975a1201b4961f99d0ef1130ff20963ef1abf8d7343" Mar 16 16:10:19 crc kubenswrapper[5120]: E0316 16:10:19.839486 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"28ad945a4f00825a33604975a1201b4961f99d0ef1130ff20963ef1abf8d7343\": container with ID starting with 28ad945a4f00825a33604975a1201b4961f99d0ef1130ff20963ef1abf8d7343 not found: ID does not exist" containerID="28ad945a4f00825a33604975a1201b4961f99d0ef1130ff20963ef1abf8d7343" Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.839506 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28ad945a4f00825a33604975a1201b4961f99d0ef1130ff20963ef1abf8d7343"} err="failed to get container status \"28ad945a4f00825a33604975a1201b4961f99d0ef1130ff20963ef1abf8d7343\": rpc error: code = NotFound desc = could not find container \"28ad945a4f00825a33604975a1201b4961f99d0ef1130ff20963ef1abf8d7343\": container with ID starting with 28ad945a4f00825a33604975a1201b4961f99d0ef1130ff20963ef1abf8d7343 not found: ID does not exist" Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.839520 5120 scope.go:117] "RemoveContainer" containerID="6caf8b4bdc94e7e8a301f80e8e8b264137575e0a23c83ab620fa8ddf06787833" Mar 16 16:10:19 crc kubenswrapper[5120]: E0316 16:10:19.839949 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6caf8b4bdc94e7e8a301f80e8e8b264137575e0a23c83ab620fa8ddf06787833\": container with ID starting with 6caf8b4bdc94e7e8a301f80e8e8b264137575e0a23c83ab620fa8ddf06787833 not found: ID does not exist" containerID="6caf8b4bdc94e7e8a301f80e8e8b264137575e0a23c83ab620fa8ddf06787833" Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.839974 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6caf8b4bdc94e7e8a301f80e8e8b264137575e0a23c83ab620fa8ddf06787833"} err="failed to get container status \"6caf8b4bdc94e7e8a301f80e8e8b264137575e0a23c83ab620fa8ddf06787833\": rpc error: code = NotFound desc = could not find container \"6caf8b4bdc94e7e8a301f80e8e8b264137575e0a23c83ab620fa8ddf06787833\": container with ID starting with 6caf8b4bdc94e7e8a301f80e8e8b264137575e0a23c83ab620fa8ddf06787833 not found: ID does not exist" Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.840114 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1bceee6d-467e-4467-9fde-423caa4df7bc-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"1bceee6d-467e-4467-9fde-423caa4df7bc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.840153 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npdkv\" (UniqueName: \"kubernetes.io/projected/1bceee6d-467e-4467-9fde-423caa4df7bc-kube-api-access-npdkv\") pod \"ceilometer-0\" (UID: \"1bceee6d-467e-4467-9fde-423caa4df7bc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.840175 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/d1bbd676-9277-435f-822c-d066c95bc08a-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"d1bbd676-9277-435f-822c-d066c95bc08a\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.840239 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1bceee6d-467e-4467-9fde-423caa4df7bc-run-httpd\") pod \"ceilometer-0\" (UID: \"1bceee6d-467e-4467-9fde-423caa4df7bc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.840262 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d1bbd676-9277-435f-822c-d066c95bc08a-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"d1bbd676-9277-435f-822c-d066c95bc08a\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.840302 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/1bceee6d-467e-4467-9fde-423caa4df7bc-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"1bceee6d-467e-4467-9fde-423caa4df7bc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.840320 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1bceee6d-467e-4467-9fde-423caa4df7bc-scripts\") pod \"ceilometer-0\" (UID: \"1bceee6d-467e-4467-9fde-423caa4df7bc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.840342 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d1bbd676-9277-435f-822c-d066c95bc08a-logs\") pod \"nova-metadata-0\" (UID: \"d1bbd676-9277-435f-822c-d066c95bc08a\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.840378 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/1bceee6d-467e-4467-9fde-423caa4df7bc-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"1bceee6d-467e-4467-9fde-423caa4df7bc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.840413 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d1bbd676-9277-435f-822c-d066c95bc08a-config-data\") pod \"nova-metadata-0\" (UID: \"d1bbd676-9277-435f-822c-d066c95bc08a\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.840470 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1bceee6d-467e-4467-9fde-423caa4df7bc-config-data\") pod \"ceilometer-0\" (UID: \"1bceee6d-467e-4467-9fde-423caa4df7bc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.840490 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1bceee6d-467e-4467-9fde-423caa4df7bc-log-httpd\") pod \"ceilometer-0\" (UID: \"1bceee6d-467e-4467-9fde-423caa4df7bc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.840621 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4wlc\" (UniqueName: \"kubernetes.io/projected/d1bbd676-9277-435f-822c-d066c95bc08a-kube-api-access-w4wlc\") pod \"nova-metadata-0\" (UID: \"d1bbd676-9277-435f-822c-d066c95bc08a\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.942901 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w4wlc\" (UniqueName: \"kubernetes.io/projected/d1bbd676-9277-435f-822c-d066c95bc08a-kube-api-access-w4wlc\") pod \"nova-metadata-0\" (UID: \"d1bbd676-9277-435f-822c-d066c95bc08a\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.942960 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1bceee6d-467e-4467-9fde-423caa4df7bc-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"1bceee6d-467e-4467-9fde-423caa4df7bc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.943125 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-npdkv\" (UniqueName: \"kubernetes.io/projected/1bceee6d-467e-4467-9fde-423caa4df7bc-kube-api-access-npdkv\") pod \"ceilometer-0\" (UID: \"1bceee6d-467e-4467-9fde-423caa4df7bc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.943181 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/d1bbd676-9277-435f-822c-d066c95bc08a-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"d1bbd676-9277-435f-822c-d066c95bc08a\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.943319 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1bceee6d-467e-4467-9fde-423caa4df7bc-run-httpd\") pod \"ceilometer-0\" (UID: \"1bceee6d-467e-4467-9fde-423caa4df7bc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.943361 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d1bbd676-9277-435f-822c-d066c95bc08a-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"d1bbd676-9277-435f-822c-d066c95bc08a\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.943417 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/1bceee6d-467e-4467-9fde-423caa4df7bc-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"1bceee6d-467e-4467-9fde-423caa4df7bc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.943436 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1bceee6d-467e-4467-9fde-423caa4df7bc-scripts\") pod \"ceilometer-0\" (UID: \"1bceee6d-467e-4467-9fde-423caa4df7bc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.943465 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d1bbd676-9277-435f-822c-d066c95bc08a-logs\") pod \"nova-metadata-0\" (UID: \"d1bbd676-9277-435f-822c-d066c95bc08a\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.943522 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/1bceee6d-467e-4467-9fde-423caa4df7bc-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"1bceee6d-467e-4467-9fde-423caa4df7bc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.943540 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d1bbd676-9277-435f-822c-d066c95bc08a-config-data\") pod \"nova-metadata-0\" (UID: \"d1bbd676-9277-435f-822c-d066c95bc08a\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.943639 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1bceee6d-467e-4467-9fde-423caa4df7bc-config-data\") pod \"ceilometer-0\" (UID: \"1bceee6d-467e-4467-9fde-423caa4df7bc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.943667 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1bceee6d-467e-4467-9fde-423caa4df7bc-log-httpd\") pod \"ceilometer-0\" (UID: \"1bceee6d-467e-4467-9fde-423caa4df7bc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.944090 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1bceee6d-467e-4467-9fde-423caa4df7bc-run-httpd\") pod \"ceilometer-0\" (UID: \"1bceee6d-467e-4467-9fde-423caa4df7bc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.944413 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1bceee6d-467e-4467-9fde-423caa4df7bc-log-httpd\") pod \"ceilometer-0\" (UID: \"1bceee6d-467e-4467-9fde-423caa4df7bc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.944624 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d1bbd676-9277-435f-822c-d066c95bc08a-logs\") pod \"nova-metadata-0\" (UID: \"d1bbd676-9277-435f-822c-d066c95bc08a\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.949556 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1bceee6d-467e-4467-9fde-423caa4df7bc-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"1bceee6d-467e-4467-9fde-423caa4df7bc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.949560 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/d1bbd676-9277-435f-822c-d066c95bc08a-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"d1bbd676-9277-435f-822c-d066c95bc08a\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.950040 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d1bbd676-9277-435f-822c-d066c95bc08a-config-data\") pod \"nova-metadata-0\" (UID: \"d1bbd676-9277-435f-822c-d066c95bc08a\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.950281 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d1bbd676-9277-435f-822c-d066c95bc08a-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"d1bbd676-9277-435f-822c-d066c95bc08a\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.954818 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1bceee6d-467e-4467-9fde-423caa4df7bc-config-data\") pod \"ceilometer-0\" (UID: \"1bceee6d-467e-4467-9fde-423caa4df7bc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.955477 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/1bceee6d-467e-4467-9fde-423caa4df7bc-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"1bceee6d-467e-4467-9fde-423caa4df7bc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.962254 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1bceee6d-467e-4467-9fde-423caa4df7bc-scripts\") pod \"ceilometer-0\" (UID: \"1bceee6d-467e-4467-9fde-423caa4df7bc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.962428 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/1bceee6d-467e-4467-9fde-423caa4df7bc-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"1bceee6d-467e-4467-9fde-423caa4df7bc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.967536 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-npdkv\" (UniqueName: \"kubernetes.io/projected/1bceee6d-467e-4467-9fde-423caa4df7bc-kube-api-access-npdkv\") pod \"ceilometer-0\" (UID: \"1bceee6d-467e-4467-9fde-423caa4df7bc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:10:19 crc kubenswrapper[5120]: I0316 16:10:19.971316 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4wlc\" (UniqueName: \"kubernetes.io/projected/d1bbd676-9277-435f-822c-d066c95bc08a-kube-api-access-w4wlc\") pod \"nova-metadata-0\" (UID: \"d1bbd676-9277-435f-822c-d066c95bc08a\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:10:20 crc kubenswrapper[5120]: I0316 16:10:20.071951 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:10:20 crc kubenswrapper[5120]: I0316 16:10:20.086138 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:10:20 crc kubenswrapper[5120]: I0316 16:10:20.550511 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:10:20 crc kubenswrapper[5120]: I0316 16:10:20.584637 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"12b38435-0635-409b-8888-94cdc5433388","Type":"ContainerStarted","Data":"cf7a9dd6bfa88e8fccaa1a621f03d0b496debb8fa72832274da01cb03305c90a"} Mar 16 16:10:20 crc kubenswrapper[5120]: I0316 16:10:20.585024 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:10:20 crc kubenswrapper[5120]: I0316 16:10:20.589981 5120 generic.go:358] "Generic (PLEG): container finished" podID="28e5ecb8-7c04-4dbc-a8eb-981851f81690" containerID="ea7571be774b77bc67ff84d1b00accab166ea6986167b5b147b2fbb4667fe6de" exitCode=0 Mar 16 16:10:20 crc kubenswrapper[5120]: I0316 16:10:20.590062 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:10:20 crc kubenswrapper[5120]: I0316 16:10:20.590073 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"28e5ecb8-7c04-4dbc-a8eb-981851f81690","Type":"ContainerDied","Data":"ea7571be774b77bc67ff84d1b00accab166ea6986167b5b147b2fbb4667fe6de"} Mar 16 16:10:20 crc kubenswrapper[5120]: I0316 16:10:20.590171 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"28e5ecb8-7c04-4dbc-a8eb-981851f81690","Type":"ContainerDied","Data":"56f248dd37b784b59dedd559f671f3a12a31c2e66b76b0c27e8f87423464d0d2"} Mar 16 16:10:20 crc kubenswrapper[5120]: I0316 16:10:20.590190 5120 scope.go:117] "RemoveContainer" containerID="ea7571be774b77bc67ff84d1b00accab166ea6986167b5b147b2fbb4667fe6de" Mar 16 16:10:20 crc kubenswrapper[5120]: I0316 16:10:20.617157 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podStartSLOduration=2.617125136 podStartE2EDuration="2.617125136s" podCreationTimestamp="2026-03-16 16:10:18 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:10:20.60951866 +0000 UTC m=+2322.763450317" watchObservedRunningTime="2026-03-16 16:10:20.617125136 +0000 UTC m=+2322.771056793" Mar 16 16:10:20 crc kubenswrapper[5120]: I0316 16:10:20.650129 5120 scope.go:117] "RemoveContainer" containerID="ea7571be774b77bc67ff84d1b00accab166ea6986167b5b147b2fbb4667fe6de" Mar 16 16:10:20 crc kubenswrapper[5120]: E0316 16:10:20.650785 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea7571be774b77bc67ff84d1b00accab166ea6986167b5b147b2fbb4667fe6de\": container with ID starting with ea7571be774b77bc67ff84d1b00accab166ea6986167b5b147b2fbb4667fe6de not found: ID does not exist" containerID="ea7571be774b77bc67ff84d1b00accab166ea6986167b5b147b2fbb4667fe6de" Mar 16 16:10:20 crc kubenswrapper[5120]: I0316 16:10:20.650814 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea7571be774b77bc67ff84d1b00accab166ea6986167b5b147b2fbb4667fe6de"} err="failed to get container status \"ea7571be774b77bc67ff84d1b00accab166ea6986167b5b147b2fbb4667fe6de\": rpc error: code = NotFound desc = could not find container \"ea7571be774b77bc67ff84d1b00accab166ea6986167b5b147b2fbb4667fe6de\": container with ID starting with ea7571be774b77bc67ff84d1b00accab166ea6986167b5b147b2fbb4667fe6de not found: ID does not exist" Mar 16 16:10:20 crc kubenswrapper[5120]: I0316 16:10:20.659666 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/28e5ecb8-7c04-4dbc-a8eb-981851f81690-config-data\") pod \"28e5ecb8-7c04-4dbc-a8eb-981851f81690\" (UID: \"28e5ecb8-7c04-4dbc-a8eb-981851f81690\") " Mar 16 16:10:20 crc kubenswrapper[5120]: I0316 16:10:20.660243 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/28e5ecb8-7c04-4dbc-a8eb-981851f81690-combined-ca-bundle\") pod \"28e5ecb8-7c04-4dbc-a8eb-981851f81690\" (UID: \"28e5ecb8-7c04-4dbc-a8eb-981851f81690\") " Mar 16 16:10:20 crc kubenswrapper[5120]: I0316 16:10:20.660479 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w6vk9\" (UniqueName: \"kubernetes.io/projected/28e5ecb8-7c04-4dbc-a8eb-981851f81690-kube-api-access-w6vk9\") pod \"28e5ecb8-7c04-4dbc-a8eb-981851f81690\" (UID: \"28e5ecb8-7c04-4dbc-a8eb-981851f81690\") " Mar 16 16:10:20 crc kubenswrapper[5120]: I0316 16:10:20.668908 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28e5ecb8-7c04-4dbc-a8eb-981851f81690-kube-api-access-w6vk9" (OuterVolumeSpecName: "kube-api-access-w6vk9") pod "28e5ecb8-7c04-4dbc-a8eb-981851f81690" (UID: "28e5ecb8-7c04-4dbc-a8eb-981851f81690"). InnerVolumeSpecName "kube-api-access-w6vk9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:10:20 crc kubenswrapper[5120]: I0316 16:10:20.690642 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="25f31d35-683c-46f1-b80a-ee5b06665073" path="/var/lib/kubelet/pods/25f31d35-683c-46f1-b80a-ee5b06665073/volumes" Mar 16 16:10:20 crc kubenswrapper[5120]: I0316 16:10:20.691727 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="73733c44-4d3b-4797-b839-cacdffc714a8" path="/var/lib/kubelet/pods/73733c44-4d3b-4797-b839-cacdffc714a8/volumes" Mar 16 16:10:20 crc kubenswrapper[5120]: I0316 16:10:20.696951 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:10:20 crc kubenswrapper[5120]: I0316 16:10:20.697550 5120 scope.go:117] "RemoveContainer" containerID="bc2df124cc6ad146d7c7dd2115ac815986fb62978d38895f6d345a4a9b14dbd8" Mar 16 16:10:20 crc kubenswrapper[5120]: E0316 16:10:20.698082 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:10:20 crc kubenswrapper[5120]: W0316 16:10:20.698906 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1bceee6d_467e_4467_9fde_423caa4df7bc.slice/crio-fc3b5eb735a13f837d03db536eee2d66cb14c3ee8e89369a83ee42eea4ee7322 WatchSource:0}: Error finding container fc3b5eb735a13f837d03db536eee2d66cb14c3ee8e89369a83ee42eea4ee7322: Status 404 returned error can't find the container with id fc3b5eb735a13f837d03db536eee2d66cb14c3ee8e89369a83ee42eea4ee7322 Mar 16 16:10:20 crc kubenswrapper[5120]: I0316 16:10:20.703299 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/28e5ecb8-7c04-4dbc-a8eb-981851f81690-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "28e5ecb8-7c04-4dbc-a8eb-981851f81690" (UID: "28e5ecb8-7c04-4dbc-a8eb-981851f81690"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:10:20 crc kubenswrapper[5120]: I0316 16:10:20.703451 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/28e5ecb8-7c04-4dbc-a8eb-981851f81690-config-data" (OuterVolumeSpecName: "config-data") pod "28e5ecb8-7c04-4dbc-a8eb-981851f81690" (UID: "28e5ecb8-7c04-4dbc-a8eb-981851f81690"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:10:20 crc kubenswrapper[5120]: I0316 16:10:20.723693 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:10:20 crc kubenswrapper[5120]: I0316 16:10:20.763463 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/28e5ecb8-7c04-4dbc-a8eb-981851f81690-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:10:20 crc kubenswrapper[5120]: I0316 16:10:20.764206 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w6vk9\" (UniqueName: \"kubernetes.io/projected/28e5ecb8-7c04-4dbc-a8eb-981851f81690-kube-api-access-w6vk9\") on node \"crc\" DevicePath \"\"" Mar 16 16:10:20 crc kubenswrapper[5120]: I0316 16:10:20.764339 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/28e5ecb8-7c04-4dbc-a8eb-981851f81690-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:10:21 crc kubenswrapper[5120]: I0316 16:10:21.056614 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:10:21 crc kubenswrapper[5120]: I0316 16:10:21.064464 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:10:21 crc kubenswrapper[5120]: I0316 16:10:21.074047 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:10:21 crc kubenswrapper[5120]: I0316 16:10:21.076202 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28e5ecb8-7c04-4dbc-a8eb-981851f81690" containerName="nova-scheduler-scheduler" Mar 16 16:10:21 crc kubenswrapper[5120]: I0316 16:10:21.076239 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="28e5ecb8-7c04-4dbc-a8eb-981851f81690" containerName="nova-scheduler-scheduler" Mar 16 16:10:21 crc kubenswrapper[5120]: I0316 16:10:21.076598 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="28e5ecb8-7c04-4dbc-a8eb-981851f81690" containerName="nova-scheduler-scheduler" Mar 16 16:10:21 crc kubenswrapper[5120]: I0316 16:10:21.088080 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:10:21 crc kubenswrapper[5120]: I0316 16:10:21.088239 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:10:21 crc kubenswrapper[5120]: I0316 16:10:21.094810 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-scheduler-config-data\"" Mar 16 16:10:21 crc kubenswrapper[5120]: I0316 16:10:21.172340 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jfsd\" (UniqueName: \"kubernetes.io/projected/30599259-2ec1-45a4-b3f3-4864be53216e-kube-api-access-2jfsd\") pod \"nova-scheduler-0\" (UID: \"30599259-2ec1-45a4-b3f3-4864be53216e\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:10:21 crc kubenswrapper[5120]: I0316 16:10:21.172547 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/30599259-2ec1-45a4-b3f3-4864be53216e-config-data\") pod \"nova-scheduler-0\" (UID: \"30599259-2ec1-45a4-b3f3-4864be53216e\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:10:21 crc kubenswrapper[5120]: I0316 16:10:21.172973 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/30599259-2ec1-45a4-b3f3-4864be53216e-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"30599259-2ec1-45a4-b3f3-4864be53216e\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:10:21 crc kubenswrapper[5120]: I0316 16:10:21.274454 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/30599259-2ec1-45a4-b3f3-4864be53216e-config-data\") pod \"nova-scheduler-0\" (UID: \"30599259-2ec1-45a4-b3f3-4864be53216e\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:10:21 crc kubenswrapper[5120]: I0316 16:10:21.275154 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/30599259-2ec1-45a4-b3f3-4864be53216e-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"30599259-2ec1-45a4-b3f3-4864be53216e\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:10:21 crc kubenswrapper[5120]: I0316 16:10:21.275213 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2jfsd\" (UniqueName: \"kubernetes.io/projected/30599259-2ec1-45a4-b3f3-4864be53216e-kube-api-access-2jfsd\") pod \"nova-scheduler-0\" (UID: \"30599259-2ec1-45a4-b3f3-4864be53216e\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:10:21 crc kubenswrapper[5120]: I0316 16:10:21.280529 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/30599259-2ec1-45a4-b3f3-4864be53216e-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"30599259-2ec1-45a4-b3f3-4864be53216e\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:10:21 crc kubenswrapper[5120]: I0316 16:10:21.283872 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/30599259-2ec1-45a4-b3f3-4864be53216e-config-data\") pod \"nova-scheduler-0\" (UID: \"30599259-2ec1-45a4-b3f3-4864be53216e\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:10:21 crc kubenswrapper[5120]: I0316 16:10:21.292643 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jfsd\" (UniqueName: \"kubernetes.io/projected/30599259-2ec1-45a4-b3f3-4864be53216e-kube-api-access-2jfsd\") pod \"nova-scheduler-0\" (UID: \"30599259-2ec1-45a4-b3f3-4864be53216e\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:10:21 crc kubenswrapper[5120]: I0316 16:10:21.407524 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:10:21 crc kubenswrapper[5120]: I0316 16:10:21.609560 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"d1bbd676-9277-435f-822c-d066c95bc08a","Type":"ContainerStarted","Data":"9e3485a856ac7d307aa914ada907031a10b8b14ff5063e3ee26edfa2735f1b68"} Mar 16 16:10:21 crc kubenswrapper[5120]: I0316 16:10:21.609909 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"d1bbd676-9277-435f-822c-d066c95bc08a","Type":"ContainerStarted","Data":"26f6aeeea3303ad035786f00ff622a4972a4263c120d8930bf8c45b07295810d"} Mar 16 16:10:21 crc kubenswrapper[5120]: I0316 16:10:21.609925 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"d1bbd676-9277-435f-822c-d066c95bc08a","Type":"ContainerStarted","Data":"09716e73e110ee9550e54ab9c1320582c2816b869106e3fbaf005b9f1ef6b6cd"} Mar 16 16:10:21 crc kubenswrapper[5120]: I0316 16:10:21.611987 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1bceee6d-467e-4467-9fde-423caa4df7bc","Type":"ContainerStarted","Data":"fc3b5eb735a13f837d03db536eee2d66cb14c3ee8e89369a83ee42eea4ee7322"} Mar 16 16:10:21 crc kubenswrapper[5120]: I0316 16:10:21.650138 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=2.650117776 podStartE2EDuration="2.650117776s" podCreationTimestamp="2026-03-16 16:10:19 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:10:21.63222942 +0000 UTC m=+2323.786161077" watchObservedRunningTime="2026-03-16 16:10:21.650117776 +0000 UTC m=+2323.804049433" Mar 16 16:10:21 crc kubenswrapper[5120]: I0316 16:10:21.939568 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:10:22 crc kubenswrapper[5120]: I0316 16:10:22.655237 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"30599259-2ec1-45a4-b3f3-4864be53216e","Type":"ContainerStarted","Data":"22f98661349cd2b8494e4f14650d19248c5d21314847ce42c84ede45b43589ff"} Mar 16 16:10:22 crc kubenswrapper[5120]: I0316 16:10:22.658994 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"30599259-2ec1-45a4-b3f3-4864be53216e","Type":"ContainerStarted","Data":"552ea34b2ee4a1e4719cc7b58b3f5d9652ff22cc59d736852deabf0b8bab3cba"} Mar 16 16:10:22 crc kubenswrapper[5120]: I0316 16:10:22.676974 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-scheduler-0" podStartSLOduration=1.6769581869999999 podStartE2EDuration="1.676958187s" podCreationTimestamp="2026-03-16 16:10:21 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:10:22.676029683 +0000 UTC m=+2324.829961340" watchObservedRunningTime="2026-03-16 16:10:22.676958187 +0000 UTC m=+2324.830889844" Mar 16 16:10:22 crc kubenswrapper[5120]: I0316 16:10:22.682893 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="28e5ecb8-7c04-4dbc-a8eb-981851f81690" path="/var/lib/kubelet/pods/28e5ecb8-7c04-4dbc-a8eb-981851f81690/volumes" Mar 16 16:10:22 crc kubenswrapper[5120]: I0316 16:10:22.683477 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1bceee6d-467e-4467-9fde-423caa4df7bc","Type":"ContainerStarted","Data":"87fa9c39ad3d07a568dd348a106dade5889df97841fd678260ef690d22bd64c0"} Mar 16 16:10:22 crc kubenswrapper[5120]: I0316 16:10:22.683504 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1bceee6d-467e-4467-9fde-423caa4df7bc","Type":"ContainerStarted","Data":"707d6cc0f07eeb1804fa54ceaefd5ac76f884cf673517f6e2bcefe1a5832ddae"} Mar 16 16:10:22 crc kubenswrapper[5120]: I0316 16:10:22.917819 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:10:22 crc kubenswrapper[5120]: I0316 16:10:22.936950 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:10:23 crc kubenswrapper[5120]: I0316 16:10:23.677443 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1bceee6d-467e-4467-9fde-423caa4df7bc","Type":"ContainerStarted","Data":"c764557ae1600b8ad72326a3b1f87ef91fd51acf422188c2bc2eee7d74d965e7"} Mar 16 16:10:23 crc kubenswrapper[5120]: I0316 16:10:23.697103 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:10:24 crc kubenswrapper[5120]: I0316 16:10:24.689625 5120 generic.go:358] "Generic (PLEG): container finished" podID="031c7932-9816-4571-8397-f517a70caf41" containerID="d63aa185f89b094e212f4b9c1e6a47eba5f4c1879b7497a04e1756dd958d9e0b" exitCode=0 Mar 16 16:10:24 crc kubenswrapper[5120]: I0316 16:10:24.689637 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"031c7932-9816-4571-8397-f517a70caf41","Type":"ContainerDied","Data":"d63aa185f89b094e212f4b9c1e6a47eba5f4c1879b7497a04e1756dd958d9e0b"} Mar 16 16:10:24 crc kubenswrapper[5120]: I0316 16:10:24.690269 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"031c7932-9816-4571-8397-f517a70caf41","Type":"ContainerDied","Data":"270a86ff4b83c24e50a283564563e027f0f5441636b64f91ea97f8c2f9033d11"} Mar 16 16:10:24 crc kubenswrapper[5120]: I0316 16:10:24.690286 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="270a86ff4b83c24e50a283564563e027f0f5441636b64f91ea97f8c2f9033d11" Mar 16 16:10:24 crc kubenswrapper[5120]: I0316 16:10:24.698318 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:10:24 crc kubenswrapper[5120]: I0316 16:10:24.854469 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rw6fb\" (UniqueName: \"kubernetes.io/projected/031c7932-9816-4571-8397-f517a70caf41-kube-api-access-rw6fb\") pod \"031c7932-9816-4571-8397-f517a70caf41\" (UID: \"031c7932-9816-4571-8397-f517a70caf41\") " Mar 16 16:10:24 crc kubenswrapper[5120]: I0316 16:10:24.854923 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/031c7932-9816-4571-8397-f517a70caf41-config-data\") pod \"031c7932-9816-4571-8397-f517a70caf41\" (UID: \"031c7932-9816-4571-8397-f517a70caf41\") " Mar 16 16:10:24 crc kubenswrapper[5120]: I0316 16:10:24.855109 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/031c7932-9816-4571-8397-f517a70caf41-logs\") pod \"031c7932-9816-4571-8397-f517a70caf41\" (UID: \"031c7932-9816-4571-8397-f517a70caf41\") " Mar 16 16:10:24 crc kubenswrapper[5120]: I0316 16:10:24.855709 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/031c7932-9816-4571-8397-f517a70caf41-logs" (OuterVolumeSpecName: "logs") pod "031c7932-9816-4571-8397-f517a70caf41" (UID: "031c7932-9816-4571-8397-f517a70caf41"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:10:24 crc kubenswrapper[5120]: I0316 16:10:24.855988 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/031c7932-9816-4571-8397-f517a70caf41-combined-ca-bundle\") pod \"031c7932-9816-4571-8397-f517a70caf41\" (UID: \"031c7932-9816-4571-8397-f517a70caf41\") " Mar 16 16:10:24 crc kubenswrapper[5120]: I0316 16:10:24.860075 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/031c7932-9816-4571-8397-f517a70caf41-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:10:24 crc kubenswrapper[5120]: I0316 16:10:24.867717 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/031c7932-9816-4571-8397-f517a70caf41-kube-api-access-rw6fb" (OuterVolumeSpecName: "kube-api-access-rw6fb") pod "031c7932-9816-4571-8397-f517a70caf41" (UID: "031c7932-9816-4571-8397-f517a70caf41"). InnerVolumeSpecName "kube-api-access-rw6fb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:10:24 crc kubenswrapper[5120]: I0316 16:10:24.887032 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/031c7932-9816-4571-8397-f517a70caf41-config-data" (OuterVolumeSpecName: "config-data") pod "031c7932-9816-4571-8397-f517a70caf41" (UID: "031c7932-9816-4571-8397-f517a70caf41"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:10:24 crc kubenswrapper[5120]: I0316 16:10:24.895998 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/031c7932-9816-4571-8397-f517a70caf41-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "031c7932-9816-4571-8397-f517a70caf41" (UID: "031c7932-9816-4571-8397-f517a70caf41"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:10:24 crc kubenswrapper[5120]: I0316 16:10:24.962374 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/031c7932-9816-4571-8397-f517a70caf41-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:10:24 crc kubenswrapper[5120]: I0316 16:10:24.962407 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/031c7932-9816-4571-8397-f517a70caf41-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:10:24 crc kubenswrapper[5120]: I0316 16:10:24.962421 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rw6fb\" (UniqueName: \"kubernetes.io/projected/031c7932-9816-4571-8397-f517a70caf41-kube-api-access-rw6fb\") on node \"crc\" DevicePath \"\"" Mar 16 16:10:25 crc kubenswrapper[5120]: I0316 16:10:25.701381 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:10:25 crc kubenswrapper[5120]: I0316 16:10:25.736228 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:10:25 crc kubenswrapper[5120]: I0316 16:10:25.762630 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:10:25 crc kubenswrapper[5120]: I0316 16:10:25.774897 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:10:25 crc kubenswrapper[5120]: I0316 16:10:25.775872 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="031c7932-9816-4571-8397-f517a70caf41" containerName="nova-api-log" Mar 16 16:10:25 crc kubenswrapper[5120]: I0316 16:10:25.775893 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="031c7932-9816-4571-8397-f517a70caf41" containerName="nova-api-log" Mar 16 16:10:25 crc kubenswrapper[5120]: I0316 16:10:25.775933 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="031c7932-9816-4571-8397-f517a70caf41" containerName="nova-api-api" Mar 16 16:10:25 crc kubenswrapper[5120]: I0316 16:10:25.775940 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="031c7932-9816-4571-8397-f517a70caf41" containerName="nova-api-api" Mar 16 16:10:25 crc kubenswrapper[5120]: I0316 16:10:25.776130 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="031c7932-9816-4571-8397-f517a70caf41" containerName="nova-api-api" Mar 16 16:10:25 crc kubenswrapper[5120]: I0316 16:10:25.776151 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="031c7932-9816-4571-8397-f517a70caf41" containerName="nova-api-log" Mar 16 16:10:25 crc kubenswrapper[5120]: I0316 16:10:25.780808 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:10:25 crc kubenswrapper[5120]: I0316 16:10:25.783427 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-config-data\"" Mar 16 16:10:25 crc kubenswrapper[5120]: I0316 16:10:25.784422 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:10:25 crc kubenswrapper[5120]: I0316 16:10:25.911496 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cd4dc738-60ac-4265-baad-54cf712e938f-config-data\") pod \"nova-api-0\" (UID: \"cd4dc738-60ac-4265-baad-54cf712e938f\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:10:25 crc kubenswrapper[5120]: I0316 16:10:25.911658 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/cd4dc738-60ac-4265-baad-54cf712e938f-logs\") pod \"nova-api-0\" (UID: \"cd4dc738-60ac-4265-baad-54cf712e938f\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:10:25 crc kubenswrapper[5120]: I0316 16:10:25.911846 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cd4dc738-60ac-4265-baad-54cf712e938f-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"cd4dc738-60ac-4265-baad-54cf712e938f\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:10:25 crc kubenswrapper[5120]: I0316 16:10:25.912026 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxhm7\" (UniqueName: \"kubernetes.io/projected/cd4dc738-60ac-4265-baad-54cf712e938f-kube-api-access-cxhm7\") pod \"nova-api-0\" (UID: \"cd4dc738-60ac-4265-baad-54cf712e938f\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:10:26 crc kubenswrapper[5120]: I0316 16:10:26.013122 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/cd4dc738-60ac-4265-baad-54cf712e938f-logs\") pod \"nova-api-0\" (UID: \"cd4dc738-60ac-4265-baad-54cf712e938f\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:10:26 crc kubenswrapper[5120]: I0316 16:10:26.013196 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cd4dc738-60ac-4265-baad-54cf712e938f-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"cd4dc738-60ac-4265-baad-54cf712e938f\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:10:26 crc kubenswrapper[5120]: I0316 16:10:26.013267 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cxhm7\" (UniqueName: \"kubernetes.io/projected/cd4dc738-60ac-4265-baad-54cf712e938f-kube-api-access-cxhm7\") pod \"nova-api-0\" (UID: \"cd4dc738-60ac-4265-baad-54cf712e938f\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:10:26 crc kubenswrapper[5120]: I0316 16:10:26.013415 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cd4dc738-60ac-4265-baad-54cf712e938f-config-data\") pod \"nova-api-0\" (UID: \"cd4dc738-60ac-4265-baad-54cf712e938f\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:10:26 crc kubenswrapper[5120]: I0316 16:10:26.013525 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/cd4dc738-60ac-4265-baad-54cf712e938f-logs\") pod \"nova-api-0\" (UID: \"cd4dc738-60ac-4265-baad-54cf712e938f\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:10:26 crc kubenswrapper[5120]: I0316 16:10:26.018192 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cd4dc738-60ac-4265-baad-54cf712e938f-config-data\") pod \"nova-api-0\" (UID: \"cd4dc738-60ac-4265-baad-54cf712e938f\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:10:26 crc kubenswrapper[5120]: I0316 16:10:26.022307 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cd4dc738-60ac-4265-baad-54cf712e938f-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"cd4dc738-60ac-4265-baad-54cf712e938f\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:10:26 crc kubenswrapper[5120]: I0316 16:10:26.030328 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxhm7\" (UniqueName: \"kubernetes.io/projected/cd4dc738-60ac-4265-baad-54cf712e938f-kube-api-access-cxhm7\") pod \"nova-api-0\" (UID: \"cd4dc738-60ac-4265-baad-54cf712e938f\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:10:26 crc kubenswrapper[5120]: I0316 16:10:26.101512 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:10:26 crc kubenswrapper[5120]: I0316 16:10:26.408561 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:10:26 crc kubenswrapper[5120]: I0316 16:10:26.553691 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:10:26 crc kubenswrapper[5120]: W0316 16:10:26.570415 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcd4dc738_60ac_4265_baad_54cf712e938f.slice/crio-ef34081915f2182f5573de17f458b36a00e9ad16dca5a714e521a71bab9b4a63 WatchSource:0}: Error finding container ef34081915f2182f5573de17f458b36a00e9ad16dca5a714e521a71bab9b4a63: Status 404 returned error can't find the container with id ef34081915f2182f5573de17f458b36a00e9ad16dca5a714e521a71bab9b4a63 Mar 16 16:10:26 crc kubenswrapper[5120]: I0316 16:10:26.656274 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:10:26 crc kubenswrapper[5120]: I0316 16:10:26.680832 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="031c7932-9816-4571-8397-f517a70caf41" path="/var/lib/kubelet/pods/031c7932-9816-4571-8397-f517a70caf41/volumes" Mar 16 16:10:26 crc kubenswrapper[5120]: I0316 16:10:26.730426 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"cd4dc738-60ac-4265-baad-54cf712e938f","Type":"ContainerStarted","Data":"ef34081915f2182f5573de17f458b36a00e9ad16dca5a714e521a71bab9b4a63"} Mar 16 16:10:27 crc kubenswrapper[5120]: I0316 16:10:27.164630 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-srzmb"] Mar 16 16:10:27 crc kubenswrapper[5120]: I0316 16:10:27.170691 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-srzmb" Mar 16 16:10:27 crc kubenswrapper[5120]: I0316 16:10:27.173262 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-manage-scripts\"" Mar 16 16:10:27 crc kubenswrapper[5120]: I0316 16:10:27.174162 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-manage-config-data\"" Mar 16 16:10:27 crc kubenswrapper[5120]: I0316 16:10:27.176423 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-srzmb"] Mar 16 16:10:27 crc kubenswrapper[5120]: I0316 16:10:27.238041 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8c16742b-29b5-4435-b031-600996c395a6-config-data\") pod \"nova-cell1-cell-mapping-srzmb\" (UID: \"8c16742b-29b5-4435-b031-600996c395a6\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-srzmb" Mar 16 16:10:27 crc kubenswrapper[5120]: I0316 16:10:27.238432 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rs2bf\" (UniqueName: \"kubernetes.io/projected/8c16742b-29b5-4435-b031-600996c395a6-kube-api-access-rs2bf\") pod \"nova-cell1-cell-mapping-srzmb\" (UID: \"8c16742b-29b5-4435-b031-600996c395a6\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-srzmb" Mar 16 16:10:27 crc kubenswrapper[5120]: I0316 16:10:27.238622 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8c16742b-29b5-4435-b031-600996c395a6-combined-ca-bundle\") pod \"nova-cell1-cell-mapping-srzmb\" (UID: \"8c16742b-29b5-4435-b031-600996c395a6\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-srzmb" Mar 16 16:10:27 crc kubenswrapper[5120]: I0316 16:10:27.238668 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8c16742b-29b5-4435-b031-600996c395a6-scripts\") pod \"nova-cell1-cell-mapping-srzmb\" (UID: \"8c16742b-29b5-4435-b031-600996c395a6\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-srzmb" Mar 16 16:10:27 crc kubenswrapper[5120]: I0316 16:10:27.339996 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8c16742b-29b5-4435-b031-600996c395a6-config-data\") pod \"nova-cell1-cell-mapping-srzmb\" (UID: \"8c16742b-29b5-4435-b031-600996c395a6\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-srzmb" Mar 16 16:10:27 crc kubenswrapper[5120]: I0316 16:10:27.340053 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rs2bf\" (UniqueName: \"kubernetes.io/projected/8c16742b-29b5-4435-b031-600996c395a6-kube-api-access-rs2bf\") pod \"nova-cell1-cell-mapping-srzmb\" (UID: \"8c16742b-29b5-4435-b031-600996c395a6\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-srzmb" Mar 16 16:10:27 crc kubenswrapper[5120]: I0316 16:10:27.340192 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8c16742b-29b5-4435-b031-600996c395a6-combined-ca-bundle\") pod \"nova-cell1-cell-mapping-srzmb\" (UID: \"8c16742b-29b5-4435-b031-600996c395a6\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-srzmb" Mar 16 16:10:27 crc kubenswrapper[5120]: I0316 16:10:27.340232 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8c16742b-29b5-4435-b031-600996c395a6-scripts\") pod \"nova-cell1-cell-mapping-srzmb\" (UID: \"8c16742b-29b5-4435-b031-600996c395a6\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-srzmb" Mar 16 16:10:27 crc kubenswrapper[5120]: I0316 16:10:27.345569 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8c16742b-29b5-4435-b031-600996c395a6-config-data\") pod \"nova-cell1-cell-mapping-srzmb\" (UID: \"8c16742b-29b5-4435-b031-600996c395a6\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-srzmb" Mar 16 16:10:27 crc kubenswrapper[5120]: I0316 16:10:27.345588 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8c16742b-29b5-4435-b031-600996c395a6-combined-ca-bundle\") pod \"nova-cell1-cell-mapping-srzmb\" (UID: \"8c16742b-29b5-4435-b031-600996c395a6\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-srzmb" Mar 16 16:10:27 crc kubenswrapper[5120]: I0316 16:10:27.352595 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8c16742b-29b5-4435-b031-600996c395a6-scripts\") pod \"nova-cell1-cell-mapping-srzmb\" (UID: \"8c16742b-29b5-4435-b031-600996c395a6\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-srzmb" Mar 16 16:10:27 crc kubenswrapper[5120]: I0316 16:10:27.357054 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rs2bf\" (UniqueName: \"kubernetes.io/projected/8c16742b-29b5-4435-b031-600996c395a6-kube-api-access-rs2bf\") pod \"nova-cell1-cell-mapping-srzmb\" (UID: \"8c16742b-29b5-4435-b031-600996c395a6\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-srzmb" Mar 16 16:10:27 crc kubenswrapper[5120]: I0316 16:10:27.517123 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-srzmb" Mar 16 16:10:27 crc kubenswrapper[5120]: I0316 16:10:27.550962 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:10:27 crc kubenswrapper[5120]: I0316 16:10:27.743354 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"cd4dc738-60ac-4265-baad-54cf712e938f","Type":"ContainerStarted","Data":"c8eab066859b11c7c511bd98a85965c36c688c330649679eeb15be84b7b10bc1"} Mar 16 16:10:27 crc kubenswrapper[5120]: I0316 16:10:27.743990 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"cd4dc738-60ac-4265-baad-54cf712e938f","Type":"ContainerStarted","Data":"b564ce1b63c5d759cc5b30974c2e8d8aa68e99ab8256c7f8e988eb767afdb101"} Mar 16 16:10:27 crc kubenswrapper[5120]: I0316 16:10:27.748210 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1bceee6d-467e-4467-9fde-423caa4df7bc","Type":"ContainerStarted","Data":"0c98a49fef90099092130d3ff4d464058056ddc8395b8761048c97d0afc96778"} Mar 16 16:10:27 crc kubenswrapper[5120]: I0316 16:10:27.748375 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:10:27 crc kubenswrapper[5120]: I0316 16:10:27.767698 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=2.767680248 podStartE2EDuration="2.767680248s" podCreationTimestamp="2026-03-16 16:10:25 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:10:27.764172153 +0000 UTC m=+2329.918103820" watchObservedRunningTime="2026-03-16 16:10:27.767680248 +0000 UTC m=+2329.921611915" Mar 16 16:10:28 crc kubenswrapper[5120]: I0316 16:10:28.055629 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=3.20747101 podStartE2EDuration="9.055609221s" podCreationTimestamp="2026-03-16 16:10:19 +0000 UTC" firstStartedPulling="2026-03-16 16:10:20.700341185 +0000 UTC m=+2322.854272852" lastFinishedPulling="2026-03-16 16:10:26.548479406 +0000 UTC m=+2328.702411063" observedRunningTime="2026-03-16 16:10:27.800936271 +0000 UTC m=+2329.954868008" watchObservedRunningTime="2026-03-16 16:10:28.055609221 +0000 UTC m=+2330.209540888" Mar 16 16:10:28 crc kubenswrapper[5120]: I0316 16:10:28.057979 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-srzmb"] Mar 16 16:10:28 crc kubenswrapper[5120]: I0316 16:10:28.758663 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-srzmb" event={"ID":"8c16742b-29b5-4435-b031-600996c395a6","Type":"ContainerStarted","Data":"599f011088e503f3e11d98f29b50e5be3ac4f59b95d2bee1aad84fffd8081a06"} Mar 16 16:10:28 crc kubenswrapper[5120]: I0316 16:10:28.759094 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-srzmb" event={"ID":"8c16742b-29b5-4435-b031-600996c395a6","Type":"ContainerStarted","Data":"ca881e1570ce685e23574e7e26c76f031676c5e19fafeda61e4c84a9b2b6e8c6"} Mar 16 16:10:28 crc kubenswrapper[5120]: I0316 16:10:28.783679 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-srzmb" podStartSLOduration=1.7836596359999999 podStartE2EDuration="1.783659636s" podCreationTimestamp="2026-03-16 16:10:27 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:10:28.777740454 +0000 UTC m=+2330.931672121" watchObservedRunningTime="2026-03-16 16:10:28.783659636 +0000 UTC m=+2330.937591303" Mar 16 16:10:30 crc kubenswrapper[5120]: I0316 16:10:30.072933 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:10:30 crc kubenswrapper[5120]: I0316 16:10:30.073024 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:10:31 crc kubenswrapper[5120]: I0316 16:10:31.079966 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="d1bbd676-9277-435f-822c-d066c95bc08a" containerName="nova-metadata-log" probeResult="failure" output="Get \"https://10.217.0.130:8775/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 16:10:31 crc kubenswrapper[5120]: I0316 16:10:31.079984 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="d1bbd676-9277-435f-822c-d066c95bc08a" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"https://10.217.0.130:8775/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Mar 16 16:10:31 crc kubenswrapper[5120]: I0316 16:10:31.407971 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:10:31 crc kubenswrapper[5120]: I0316 16:10:31.445413 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:10:31 crc kubenswrapper[5120]: I0316 16:10:31.860409 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:10:32 crc kubenswrapper[5120]: I0316 16:10:32.815838 5120 generic.go:358] "Generic (PLEG): container finished" podID="8c16742b-29b5-4435-b031-600996c395a6" containerID="599f011088e503f3e11d98f29b50e5be3ac4f59b95d2bee1aad84fffd8081a06" exitCode=0 Mar 16 16:10:32 crc kubenswrapper[5120]: I0316 16:10:32.815958 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-srzmb" event={"ID":"8c16742b-29b5-4435-b031-600996c395a6","Type":"ContainerDied","Data":"599f011088e503f3e11d98f29b50e5be3ac4f59b95d2bee1aad84fffd8081a06"} Mar 16 16:10:34 crc kubenswrapper[5120]: I0316 16:10:34.236163 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-srzmb" Mar 16 16:10:34 crc kubenswrapper[5120]: I0316 16:10:34.336670 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8c16742b-29b5-4435-b031-600996c395a6-combined-ca-bundle\") pod \"8c16742b-29b5-4435-b031-600996c395a6\" (UID: \"8c16742b-29b5-4435-b031-600996c395a6\") " Mar 16 16:10:34 crc kubenswrapper[5120]: I0316 16:10:34.337089 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8c16742b-29b5-4435-b031-600996c395a6-config-data\") pod \"8c16742b-29b5-4435-b031-600996c395a6\" (UID: \"8c16742b-29b5-4435-b031-600996c395a6\") " Mar 16 16:10:34 crc kubenswrapper[5120]: I0316 16:10:34.337117 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8c16742b-29b5-4435-b031-600996c395a6-scripts\") pod \"8c16742b-29b5-4435-b031-600996c395a6\" (UID: \"8c16742b-29b5-4435-b031-600996c395a6\") " Mar 16 16:10:34 crc kubenswrapper[5120]: I0316 16:10:34.337441 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rs2bf\" (UniqueName: \"kubernetes.io/projected/8c16742b-29b5-4435-b031-600996c395a6-kube-api-access-rs2bf\") pod \"8c16742b-29b5-4435-b031-600996c395a6\" (UID: \"8c16742b-29b5-4435-b031-600996c395a6\") " Mar 16 16:10:34 crc kubenswrapper[5120]: I0316 16:10:34.355042 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c16742b-29b5-4435-b031-600996c395a6-kube-api-access-rs2bf" (OuterVolumeSpecName: "kube-api-access-rs2bf") pod "8c16742b-29b5-4435-b031-600996c395a6" (UID: "8c16742b-29b5-4435-b031-600996c395a6"). InnerVolumeSpecName "kube-api-access-rs2bf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:10:34 crc kubenswrapper[5120]: I0316 16:10:34.355056 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c16742b-29b5-4435-b031-600996c395a6-scripts" (OuterVolumeSpecName: "scripts") pod "8c16742b-29b5-4435-b031-600996c395a6" (UID: "8c16742b-29b5-4435-b031-600996c395a6"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:10:34 crc kubenswrapper[5120]: I0316 16:10:34.362567 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c16742b-29b5-4435-b031-600996c395a6-config-data" (OuterVolumeSpecName: "config-data") pod "8c16742b-29b5-4435-b031-600996c395a6" (UID: "8c16742b-29b5-4435-b031-600996c395a6"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:10:34 crc kubenswrapper[5120]: I0316 16:10:34.363029 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c16742b-29b5-4435-b031-600996c395a6-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "8c16742b-29b5-4435-b031-600996c395a6" (UID: "8c16742b-29b5-4435-b031-600996c395a6"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:10:34 crc kubenswrapper[5120]: I0316 16:10:34.442997 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8c16742b-29b5-4435-b031-600996c395a6-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:10:34 crc kubenswrapper[5120]: I0316 16:10:34.443032 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8c16742b-29b5-4435-b031-600996c395a6-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:10:34 crc kubenswrapper[5120]: I0316 16:10:34.443041 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8c16742b-29b5-4435-b031-600996c395a6-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:10:34 crc kubenswrapper[5120]: I0316 16:10:34.443058 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rs2bf\" (UniqueName: \"kubernetes.io/projected/8c16742b-29b5-4435-b031-600996c395a6-kube-api-access-rs2bf\") on node \"crc\" DevicePath \"\"" Mar 16 16:10:34 crc kubenswrapper[5120]: I0316 16:10:34.664901 5120 scope.go:117] "RemoveContainer" containerID="bc2df124cc6ad146d7c7dd2115ac815986fb62978d38895f6d345a4a9b14dbd8" Mar 16 16:10:34 crc kubenswrapper[5120]: E0316 16:10:34.665429 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:10:34 crc kubenswrapper[5120]: I0316 16:10:34.848145 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-srzmb" Mar 16 16:10:34 crc kubenswrapper[5120]: I0316 16:10:34.848155 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-srzmb" event={"ID":"8c16742b-29b5-4435-b031-600996c395a6","Type":"ContainerDied","Data":"ca881e1570ce685e23574e7e26c76f031676c5e19fafeda61e4c84a9b2b6e8c6"} Mar 16 16:10:34 crc kubenswrapper[5120]: I0316 16:10:34.848335 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ca881e1570ce685e23574e7e26c76f031676c5e19fafeda61e4c84a9b2b6e8c6" Mar 16 16:10:35 crc kubenswrapper[5120]: I0316 16:10:35.050599 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:10:35 crc kubenswrapper[5120]: I0316 16:10:35.051015 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="30599259-2ec1-45a4-b3f3-4864be53216e" containerName="nova-scheduler-scheduler" containerID="cri-o://22f98661349cd2b8494e4f14650d19248c5d21314847ce42c84ede45b43589ff" gracePeriod=30 Mar 16 16:10:35 crc kubenswrapper[5120]: I0316 16:10:35.066120 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:10:35 crc kubenswrapper[5120]: I0316 16:10:35.066433 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="cd4dc738-60ac-4265-baad-54cf712e938f" containerName="nova-api-log" containerID="cri-o://b564ce1b63c5d759cc5b30974c2e8d8aa68e99ab8256c7f8e988eb767afdb101" gracePeriod=30 Mar 16 16:10:35 crc kubenswrapper[5120]: I0316 16:10:35.066568 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="cd4dc738-60ac-4265-baad-54cf712e938f" containerName="nova-api-api" containerID="cri-o://c8eab066859b11c7c511bd98a85965c36c688c330649679eeb15be84b7b10bc1" gracePeriod=30 Mar 16 16:10:35 crc kubenswrapper[5120]: I0316 16:10:35.139042 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:10:35 crc kubenswrapper[5120]: I0316 16:10:35.140010 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="d1bbd676-9277-435f-822c-d066c95bc08a" containerName="nova-metadata-log" containerID="cri-o://26f6aeeea3303ad035786f00ff622a4972a4263c120d8930bf8c45b07295810d" gracePeriod=30 Mar 16 16:10:35 crc kubenswrapper[5120]: I0316 16:10:35.140104 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="d1bbd676-9277-435f-822c-d066c95bc08a" containerName="nova-metadata-metadata" containerID="cri-o://9e3485a856ac7d307aa914ada907031a10b8b14ff5063e3ee26edfa2735f1b68" gracePeriod=30 Mar 16 16:10:35 crc kubenswrapper[5120]: I0316 16:10:35.694449 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:10:35 crc kubenswrapper[5120]: I0316 16:10:35.863109 5120 generic.go:358] "Generic (PLEG): container finished" podID="cd4dc738-60ac-4265-baad-54cf712e938f" containerID="c8eab066859b11c7c511bd98a85965c36c688c330649679eeb15be84b7b10bc1" exitCode=0 Mar 16 16:10:35 crc kubenswrapper[5120]: I0316 16:10:35.863142 5120 generic.go:358] "Generic (PLEG): container finished" podID="cd4dc738-60ac-4265-baad-54cf712e938f" containerID="b564ce1b63c5d759cc5b30974c2e8d8aa68e99ab8256c7f8e988eb767afdb101" exitCode=143 Mar 16 16:10:35 crc kubenswrapper[5120]: I0316 16:10:35.863154 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"cd4dc738-60ac-4265-baad-54cf712e938f","Type":"ContainerDied","Data":"c8eab066859b11c7c511bd98a85965c36c688c330649679eeb15be84b7b10bc1"} Mar 16 16:10:35 crc kubenswrapper[5120]: I0316 16:10:35.863188 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:10:35 crc kubenswrapper[5120]: I0316 16:10:35.863202 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"cd4dc738-60ac-4265-baad-54cf712e938f","Type":"ContainerDied","Data":"b564ce1b63c5d759cc5b30974c2e8d8aa68e99ab8256c7f8e988eb767afdb101"} Mar 16 16:10:35 crc kubenswrapper[5120]: I0316 16:10:35.863213 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"cd4dc738-60ac-4265-baad-54cf712e938f","Type":"ContainerDied","Data":"ef34081915f2182f5573de17f458b36a00e9ad16dca5a714e521a71bab9b4a63"} Mar 16 16:10:35 crc kubenswrapper[5120]: I0316 16:10:35.863228 5120 scope.go:117] "RemoveContainer" containerID="c8eab066859b11c7c511bd98a85965c36c688c330649679eeb15be84b7b10bc1" Mar 16 16:10:35 crc kubenswrapper[5120]: I0316 16:10:35.866283 5120 generic.go:358] "Generic (PLEG): container finished" podID="d1bbd676-9277-435f-822c-d066c95bc08a" containerID="26f6aeeea3303ad035786f00ff622a4972a4263c120d8930bf8c45b07295810d" exitCode=143 Mar 16 16:10:35 crc kubenswrapper[5120]: I0316 16:10:35.866309 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"d1bbd676-9277-435f-822c-d066c95bc08a","Type":"ContainerDied","Data":"26f6aeeea3303ad035786f00ff622a4972a4263c120d8930bf8c45b07295810d"} Mar 16 16:10:35 crc kubenswrapper[5120]: I0316 16:10:35.877157 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cd4dc738-60ac-4265-baad-54cf712e938f-config-data\") pod \"cd4dc738-60ac-4265-baad-54cf712e938f\" (UID: \"cd4dc738-60ac-4265-baad-54cf712e938f\") " Mar 16 16:10:35 crc kubenswrapper[5120]: I0316 16:10:35.877267 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cd4dc738-60ac-4265-baad-54cf712e938f-combined-ca-bundle\") pod \"cd4dc738-60ac-4265-baad-54cf712e938f\" (UID: \"cd4dc738-60ac-4265-baad-54cf712e938f\") " Mar 16 16:10:35 crc kubenswrapper[5120]: I0316 16:10:35.877561 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cxhm7\" (UniqueName: \"kubernetes.io/projected/cd4dc738-60ac-4265-baad-54cf712e938f-kube-api-access-cxhm7\") pod \"cd4dc738-60ac-4265-baad-54cf712e938f\" (UID: \"cd4dc738-60ac-4265-baad-54cf712e938f\") " Mar 16 16:10:35 crc kubenswrapper[5120]: I0316 16:10:35.877635 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/cd4dc738-60ac-4265-baad-54cf712e938f-logs\") pod \"cd4dc738-60ac-4265-baad-54cf712e938f\" (UID: \"cd4dc738-60ac-4265-baad-54cf712e938f\") " Mar 16 16:10:35 crc kubenswrapper[5120]: I0316 16:10:35.878237 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd4dc738-60ac-4265-baad-54cf712e938f-logs" (OuterVolumeSpecName: "logs") pod "cd4dc738-60ac-4265-baad-54cf712e938f" (UID: "cd4dc738-60ac-4265-baad-54cf712e938f"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:10:35 crc kubenswrapper[5120]: I0316 16:10:35.890025 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd4dc738-60ac-4265-baad-54cf712e938f-kube-api-access-cxhm7" (OuterVolumeSpecName: "kube-api-access-cxhm7") pod "cd4dc738-60ac-4265-baad-54cf712e938f" (UID: "cd4dc738-60ac-4265-baad-54cf712e938f"). InnerVolumeSpecName "kube-api-access-cxhm7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:10:35 crc kubenswrapper[5120]: I0316 16:10:35.898078 5120 scope.go:117] "RemoveContainer" containerID="b564ce1b63c5d759cc5b30974c2e8d8aa68e99ab8256c7f8e988eb767afdb101" Mar 16 16:10:35 crc kubenswrapper[5120]: I0316 16:10:35.908884 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd4dc738-60ac-4265-baad-54cf712e938f-config-data" (OuterVolumeSpecName: "config-data") pod "cd4dc738-60ac-4265-baad-54cf712e938f" (UID: "cd4dc738-60ac-4265-baad-54cf712e938f"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:10:35 crc kubenswrapper[5120]: I0316 16:10:35.912447 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd4dc738-60ac-4265-baad-54cf712e938f-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "cd4dc738-60ac-4265-baad-54cf712e938f" (UID: "cd4dc738-60ac-4265-baad-54cf712e938f"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:10:35 crc kubenswrapper[5120]: I0316 16:10:35.940801 5120 scope.go:117] "RemoveContainer" containerID="c8eab066859b11c7c511bd98a85965c36c688c330649679eeb15be84b7b10bc1" Mar 16 16:10:35 crc kubenswrapper[5120]: E0316 16:10:35.941620 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c8eab066859b11c7c511bd98a85965c36c688c330649679eeb15be84b7b10bc1\": container with ID starting with c8eab066859b11c7c511bd98a85965c36c688c330649679eeb15be84b7b10bc1 not found: ID does not exist" containerID="c8eab066859b11c7c511bd98a85965c36c688c330649679eeb15be84b7b10bc1" Mar 16 16:10:35 crc kubenswrapper[5120]: I0316 16:10:35.941657 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8eab066859b11c7c511bd98a85965c36c688c330649679eeb15be84b7b10bc1"} err="failed to get container status \"c8eab066859b11c7c511bd98a85965c36c688c330649679eeb15be84b7b10bc1\": rpc error: code = NotFound desc = could not find container \"c8eab066859b11c7c511bd98a85965c36c688c330649679eeb15be84b7b10bc1\": container with ID starting with c8eab066859b11c7c511bd98a85965c36c688c330649679eeb15be84b7b10bc1 not found: ID does not exist" Mar 16 16:10:35 crc kubenswrapper[5120]: I0316 16:10:35.941682 5120 scope.go:117] "RemoveContainer" containerID="b564ce1b63c5d759cc5b30974c2e8d8aa68e99ab8256c7f8e988eb767afdb101" Mar 16 16:10:35 crc kubenswrapper[5120]: E0316 16:10:35.942353 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b564ce1b63c5d759cc5b30974c2e8d8aa68e99ab8256c7f8e988eb767afdb101\": container with ID starting with b564ce1b63c5d759cc5b30974c2e8d8aa68e99ab8256c7f8e988eb767afdb101 not found: ID does not exist" containerID="b564ce1b63c5d759cc5b30974c2e8d8aa68e99ab8256c7f8e988eb767afdb101" Mar 16 16:10:35 crc kubenswrapper[5120]: I0316 16:10:35.942379 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b564ce1b63c5d759cc5b30974c2e8d8aa68e99ab8256c7f8e988eb767afdb101"} err="failed to get container status \"b564ce1b63c5d759cc5b30974c2e8d8aa68e99ab8256c7f8e988eb767afdb101\": rpc error: code = NotFound desc = could not find container \"b564ce1b63c5d759cc5b30974c2e8d8aa68e99ab8256c7f8e988eb767afdb101\": container with ID starting with b564ce1b63c5d759cc5b30974c2e8d8aa68e99ab8256c7f8e988eb767afdb101 not found: ID does not exist" Mar 16 16:10:35 crc kubenswrapper[5120]: I0316 16:10:35.942397 5120 scope.go:117] "RemoveContainer" containerID="c8eab066859b11c7c511bd98a85965c36c688c330649679eeb15be84b7b10bc1" Mar 16 16:10:35 crc kubenswrapper[5120]: I0316 16:10:35.942727 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8eab066859b11c7c511bd98a85965c36c688c330649679eeb15be84b7b10bc1"} err="failed to get container status \"c8eab066859b11c7c511bd98a85965c36c688c330649679eeb15be84b7b10bc1\": rpc error: code = NotFound desc = could not find container \"c8eab066859b11c7c511bd98a85965c36c688c330649679eeb15be84b7b10bc1\": container with ID starting with c8eab066859b11c7c511bd98a85965c36c688c330649679eeb15be84b7b10bc1 not found: ID does not exist" Mar 16 16:10:35 crc kubenswrapper[5120]: I0316 16:10:35.942749 5120 scope.go:117] "RemoveContainer" containerID="b564ce1b63c5d759cc5b30974c2e8d8aa68e99ab8256c7f8e988eb767afdb101" Mar 16 16:10:35 crc kubenswrapper[5120]: I0316 16:10:35.943048 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b564ce1b63c5d759cc5b30974c2e8d8aa68e99ab8256c7f8e988eb767afdb101"} err="failed to get container status \"b564ce1b63c5d759cc5b30974c2e8d8aa68e99ab8256c7f8e988eb767afdb101\": rpc error: code = NotFound desc = could not find container \"b564ce1b63c5d759cc5b30974c2e8d8aa68e99ab8256c7f8e988eb767afdb101\": container with ID starting with b564ce1b63c5d759cc5b30974c2e8d8aa68e99ab8256c7f8e988eb767afdb101 not found: ID does not exist" Mar 16 16:10:35 crc kubenswrapper[5120]: I0316 16:10:35.979963 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cd4dc738-60ac-4265-baad-54cf712e938f-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:10:35 crc kubenswrapper[5120]: I0316 16:10:35.980000 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cd4dc738-60ac-4265-baad-54cf712e938f-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:10:35 crc kubenswrapper[5120]: I0316 16:10:35.980017 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cxhm7\" (UniqueName: \"kubernetes.io/projected/cd4dc738-60ac-4265-baad-54cf712e938f-kube-api-access-cxhm7\") on node \"crc\" DevicePath \"\"" Mar 16 16:10:35 crc kubenswrapper[5120]: I0316 16:10:35.980029 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/cd4dc738-60ac-4265-baad-54cf712e938f-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:10:36 crc kubenswrapper[5120]: I0316 16:10:36.271023 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:10:36 crc kubenswrapper[5120]: I0316 16:10:36.285593 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:10:36 crc kubenswrapper[5120]: I0316 16:10:36.316410 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:10:36 crc kubenswrapper[5120]: I0316 16:10:36.317826 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd4dc738-60ac-4265-baad-54cf712e938f" containerName="nova-api-log" Mar 16 16:10:36 crc kubenswrapper[5120]: I0316 16:10:36.317853 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd4dc738-60ac-4265-baad-54cf712e938f" containerName="nova-api-log" Mar 16 16:10:36 crc kubenswrapper[5120]: I0316 16:10:36.317883 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c16742b-29b5-4435-b031-600996c395a6" containerName="nova-manage" Mar 16 16:10:36 crc kubenswrapper[5120]: I0316 16:10:36.317892 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c16742b-29b5-4435-b031-600996c395a6" containerName="nova-manage" Mar 16 16:10:36 crc kubenswrapper[5120]: I0316 16:10:36.317922 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd4dc738-60ac-4265-baad-54cf712e938f" containerName="nova-api-api" Mar 16 16:10:36 crc kubenswrapper[5120]: I0316 16:10:36.317931 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd4dc738-60ac-4265-baad-54cf712e938f" containerName="nova-api-api" Mar 16 16:10:36 crc kubenswrapper[5120]: I0316 16:10:36.318241 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="cd4dc738-60ac-4265-baad-54cf712e938f" containerName="nova-api-api" Mar 16 16:10:36 crc kubenswrapper[5120]: I0316 16:10:36.318286 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="cd4dc738-60ac-4265-baad-54cf712e938f" containerName="nova-api-log" Mar 16 16:10:36 crc kubenswrapper[5120]: I0316 16:10:36.318319 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="8c16742b-29b5-4435-b031-600996c395a6" containerName="nova-manage" Mar 16 16:10:36 crc kubenswrapper[5120]: I0316 16:10:36.329817 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:10:36 crc kubenswrapper[5120]: I0316 16:10:36.329876 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:10:36 crc kubenswrapper[5120]: I0316 16:10:36.333361 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-config-data\"" Mar 16 16:10:36 crc kubenswrapper[5120]: I0316 16:10:36.492533 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6vnk\" (UniqueName: \"kubernetes.io/projected/a01d3bde-7444-4f22-a765-4b288facd718-kube-api-access-r6vnk\") pod \"nova-api-0\" (UID: \"a01d3bde-7444-4f22-a765-4b288facd718\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:10:36 crc kubenswrapper[5120]: I0316 16:10:36.492625 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a01d3bde-7444-4f22-a765-4b288facd718-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"a01d3bde-7444-4f22-a765-4b288facd718\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:10:36 crc kubenswrapper[5120]: I0316 16:10:36.493392 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a01d3bde-7444-4f22-a765-4b288facd718-logs\") pod \"nova-api-0\" (UID: \"a01d3bde-7444-4f22-a765-4b288facd718\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:10:36 crc kubenswrapper[5120]: I0316 16:10:36.493884 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a01d3bde-7444-4f22-a765-4b288facd718-config-data\") pod \"nova-api-0\" (UID: \"a01d3bde-7444-4f22-a765-4b288facd718\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:10:36 crc kubenswrapper[5120]: I0316 16:10:36.595747 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a01d3bde-7444-4f22-a765-4b288facd718-logs\") pod \"nova-api-0\" (UID: \"a01d3bde-7444-4f22-a765-4b288facd718\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:10:36 crc kubenswrapper[5120]: I0316 16:10:36.595952 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a01d3bde-7444-4f22-a765-4b288facd718-config-data\") pod \"nova-api-0\" (UID: \"a01d3bde-7444-4f22-a765-4b288facd718\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:10:36 crc kubenswrapper[5120]: I0316 16:10:36.596005 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r6vnk\" (UniqueName: \"kubernetes.io/projected/a01d3bde-7444-4f22-a765-4b288facd718-kube-api-access-r6vnk\") pod \"nova-api-0\" (UID: \"a01d3bde-7444-4f22-a765-4b288facd718\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:10:36 crc kubenswrapper[5120]: I0316 16:10:36.596059 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a01d3bde-7444-4f22-a765-4b288facd718-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"a01d3bde-7444-4f22-a765-4b288facd718\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:10:36 crc kubenswrapper[5120]: I0316 16:10:36.596506 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a01d3bde-7444-4f22-a765-4b288facd718-logs\") pod \"nova-api-0\" (UID: \"a01d3bde-7444-4f22-a765-4b288facd718\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:10:36 crc kubenswrapper[5120]: I0316 16:10:36.600488 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a01d3bde-7444-4f22-a765-4b288facd718-config-data\") pod \"nova-api-0\" (UID: \"a01d3bde-7444-4f22-a765-4b288facd718\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:10:36 crc kubenswrapper[5120]: I0316 16:10:36.602565 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a01d3bde-7444-4f22-a765-4b288facd718-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"a01d3bde-7444-4f22-a765-4b288facd718\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:10:36 crc kubenswrapper[5120]: I0316 16:10:36.623157 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6vnk\" (UniqueName: \"kubernetes.io/projected/a01d3bde-7444-4f22-a765-4b288facd718-kube-api-access-r6vnk\") pod \"nova-api-0\" (UID: \"a01d3bde-7444-4f22-a765-4b288facd718\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:10:36 crc kubenswrapper[5120]: I0316 16:10:36.647050 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:10:36 crc kubenswrapper[5120]: I0316 16:10:36.677134 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cd4dc738-60ac-4265-baad-54cf712e938f" path="/var/lib/kubelet/pods/cd4dc738-60ac-4265-baad-54cf712e938f/volumes" Mar 16 16:10:36 crc kubenswrapper[5120]: E0316 16:10:36.809677 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="22f98661349cd2b8494e4f14650d19248c5d21314847ce42c84ede45b43589ff" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:10:36 crc kubenswrapper[5120]: E0316 16:10:36.812558 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="22f98661349cd2b8494e4f14650d19248c5d21314847ce42c84ede45b43589ff" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:10:36 crc kubenswrapper[5120]: E0316 16:10:36.814079 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="22f98661349cd2b8494e4f14650d19248c5d21314847ce42c84ede45b43589ff" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:10:36 crc kubenswrapper[5120]: E0316 16:10:36.814161 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="30599259-2ec1-45a4-b3f3-4864be53216e" containerName="nova-scheduler-scheduler" probeResult="unknown" Mar 16 16:10:37 crc kubenswrapper[5120]: I0316 16:10:37.149237 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:10:37 crc kubenswrapper[5120]: I0316 16:10:37.890311 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"a01d3bde-7444-4f22-a765-4b288facd718","Type":"ContainerStarted","Data":"202abe946a848514b780f06cd12662af401911b080df5a73758cde99142f89d1"} Mar 16 16:10:37 crc kubenswrapper[5120]: I0316 16:10:37.890895 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"a01d3bde-7444-4f22-a765-4b288facd718","Type":"ContainerStarted","Data":"00425a355012e42e4f88b09792e7955d89358c418372d4aeb4e834ff747c861f"} Mar 16 16:10:37 crc kubenswrapper[5120]: I0316 16:10:37.890907 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"a01d3bde-7444-4f22-a765-4b288facd718","Type":"ContainerStarted","Data":"b403d7e6151cc0c8b941967109638500d5ec68204294512773dc5fb9f8986ee4"} Mar 16 16:10:37 crc kubenswrapper[5120]: I0316 16:10:37.906408 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=1.906385599 podStartE2EDuration="1.906385599s" podCreationTimestamp="2026-03-16 16:10:36 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:10:37.903929664 +0000 UTC m=+2340.057861321" watchObservedRunningTime="2026-03-16 16:10:37.906385599 +0000 UTC m=+2340.060317256" Mar 16 16:10:38 crc kubenswrapper[5120]: I0316 16:10:38.072213 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:10:38 crc kubenswrapper[5120]: I0316 16:10:38.072269 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:10:38 crc kubenswrapper[5120]: I0316 16:10:38.780863 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:10:38 crc kubenswrapper[5120]: I0316 16:10:38.853335 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/d1bbd676-9277-435f-822c-d066c95bc08a-nova-metadata-tls-certs\") pod \"d1bbd676-9277-435f-822c-d066c95bc08a\" (UID: \"d1bbd676-9277-435f-822c-d066c95bc08a\") " Mar 16 16:10:38 crc kubenswrapper[5120]: I0316 16:10:38.853586 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d1bbd676-9277-435f-822c-d066c95bc08a-combined-ca-bundle\") pod \"d1bbd676-9277-435f-822c-d066c95bc08a\" (UID: \"d1bbd676-9277-435f-822c-d066c95bc08a\") " Mar 16 16:10:38 crc kubenswrapper[5120]: I0316 16:10:38.853655 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d1bbd676-9277-435f-822c-d066c95bc08a-logs\") pod \"d1bbd676-9277-435f-822c-d066c95bc08a\" (UID: \"d1bbd676-9277-435f-822c-d066c95bc08a\") " Mar 16 16:10:38 crc kubenswrapper[5120]: I0316 16:10:38.853698 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d1bbd676-9277-435f-822c-d066c95bc08a-config-data\") pod \"d1bbd676-9277-435f-822c-d066c95bc08a\" (UID: \"d1bbd676-9277-435f-822c-d066c95bc08a\") " Mar 16 16:10:38 crc kubenswrapper[5120]: I0316 16:10:38.853908 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w4wlc\" (UniqueName: \"kubernetes.io/projected/d1bbd676-9277-435f-822c-d066c95bc08a-kube-api-access-w4wlc\") pod \"d1bbd676-9277-435f-822c-d066c95bc08a\" (UID: \"d1bbd676-9277-435f-822c-d066c95bc08a\") " Mar 16 16:10:38 crc kubenswrapper[5120]: I0316 16:10:38.855394 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1bbd676-9277-435f-822c-d066c95bc08a-logs" (OuterVolumeSpecName: "logs") pod "d1bbd676-9277-435f-822c-d066c95bc08a" (UID: "d1bbd676-9277-435f-822c-d066c95bc08a"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:10:38 crc kubenswrapper[5120]: I0316 16:10:38.861894 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1bbd676-9277-435f-822c-d066c95bc08a-kube-api-access-w4wlc" (OuterVolumeSpecName: "kube-api-access-w4wlc") pod "d1bbd676-9277-435f-822c-d066c95bc08a" (UID: "d1bbd676-9277-435f-822c-d066c95bc08a"). InnerVolumeSpecName "kube-api-access-w4wlc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:10:38 crc kubenswrapper[5120]: I0316 16:10:38.880798 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d1bbd676-9277-435f-822c-d066c95bc08a-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "d1bbd676-9277-435f-822c-d066c95bc08a" (UID: "d1bbd676-9277-435f-822c-d066c95bc08a"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:10:38 crc kubenswrapper[5120]: I0316 16:10:38.882651 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d1bbd676-9277-435f-822c-d066c95bc08a-config-data" (OuterVolumeSpecName: "config-data") pod "d1bbd676-9277-435f-822c-d066c95bc08a" (UID: "d1bbd676-9277-435f-822c-d066c95bc08a"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:10:38 crc kubenswrapper[5120]: I0316 16:10:38.887700 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:10:38 crc kubenswrapper[5120]: I0316 16:10:38.899795 5120 generic.go:358] "Generic (PLEG): container finished" podID="30599259-2ec1-45a4-b3f3-4864be53216e" containerID="22f98661349cd2b8494e4f14650d19248c5d21314847ce42c84ede45b43589ff" exitCode=0 Mar 16 16:10:38 crc kubenswrapper[5120]: I0316 16:10:38.899952 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:10:38 crc kubenswrapper[5120]: I0316 16:10:38.899979 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"30599259-2ec1-45a4-b3f3-4864be53216e","Type":"ContainerDied","Data":"22f98661349cd2b8494e4f14650d19248c5d21314847ce42c84ede45b43589ff"} Mar 16 16:10:38 crc kubenswrapper[5120]: I0316 16:10:38.900062 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"30599259-2ec1-45a4-b3f3-4864be53216e","Type":"ContainerDied","Data":"552ea34b2ee4a1e4719cc7b58b3f5d9652ff22cc59d736852deabf0b8bab3cba"} Mar 16 16:10:38 crc kubenswrapper[5120]: I0316 16:10:38.900082 5120 scope.go:117] "RemoveContainer" containerID="22f98661349cd2b8494e4f14650d19248c5d21314847ce42c84ede45b43589ff" Mar 16 16:10:38 crc kubenswrapper[5120]: I0316 16:10:38.911595 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d1bbd676-9277-435f-822c-d066c95bc08a-nova-metadata-tls-certs" (OuterVolumeSpecName: "nova-metadata-tls-certs") pod "d1bbd676-9277-435f-822c-d066c95bc08a" (UID: "d1bbd676-9277-435f-822c-d066c95bc08a"). InnerVolumeSpecName "nova-metadata-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:10:38 crc kubenswrapper[5120]: I0316 16:10:38.915832 5120 generic.go:358] "Generic (PLEG): container finished" podID="d1bbd676-9277-435f-822c-d066c95bc08a" containerID="9e3485a856ac7d307aa914ada907031a10b8b14ff5063e3ee26edfa2735f1b68" exitCode=0 Mar 16 16:10:38 crc kubenswrapper[5120]: I0316 16:10:38.916702 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:10:38 crc kubenswrapper[5120]: I0316 16:10:38.917212 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"d1bbd676-9277-435f-822c-d066c95bc08a","Type":"ContainerDied","Data":"9e3485a856ac7d307aa914ada907031a10b8b14ff5063e3ee26edfa2735f1b68"} Mar 16 16:10:38 crc kubenswrapper[5120]: I0316 16:10:38.917252 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"d1bbd676-9277-435f-822c-d066c95bc08a","Type":"ContainerDied","Data":"09716e73e110ee9550e54ab9c1320582c2816b869106e3fbaf005b9f1ef6b6cd"} Mar 16 16:10:38 crc kubenswrapper[5120]: I0316 16:10:38.937157 5120 scope.go:117] "RemoveContainer" containerID="22f98661349cd2b8494e4f14650d19248c5d21314847ce42c84ede45b43589ff" Mar 16 16:10:38 crc kubenswrapper[5120]: E0316 16:10:38.937966 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"22f98661349cd2b8494e4f14650d19248c5d21314847ce42c84ede45b43589ff\": container with ID starting with 22f98661349cd2b8494e4f14650d19248c5d21314847ce42c84ede45b43589ff not found: ID does not exist" containerID="22f98661349cd2b8494e4f14650d19248c5d21314847ce42c84ede45b43589ff" Mar 16 16:10:38 crc kubenswrapper[5120]: I0316 16:10:38.938019 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22f98661349cd2b8494e4f14650d19248c5d21314847ce42c84ede45b43589ff"} err="failed to get container status \"22f98661349cd2b8494e4f14650d19248c5d21314847ce42c84ede45b43589ff\": rpc error: code = NotFound desc = could not find container \"22f98661349cd2b8494e4f14650d19248c5d21314847ce42c84ede45b43589ff\": container with ID starting with 22f98661349cd2b8494e4f14650d19248c5d21314847ce42c84ede45b43589ff not found: ID does not exist" Mar 16 16:10:38 crc kubenswrapper[5120]: I0316 16:10:38.938044 5120 scope.go:117] "RemoveContainer" containerID="9e3485a856ac7d307aa914ada907031a10b8b14ff5063e3ee26edfa2735f1b68" Mar 16 16:10:38 crc kubenswrapper[5120]: I0316 16:10:38.956107 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2jfsd\" (UniqueName: \"kubernetes.io/projected/30599259-2ec1-45a4-b3f3-4864be53216e-kube-api-access-2jfsd\") pod \"30599259-2ec1-45a4-b3f3-4864be53216e\" (UID: \"30599259-2ec1-45a4-b3f3-4864be53216e\") " Mar 16 16:10:38 crc kubenswrapper[5120]: I0316 16:10:38.956311 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/30599259-2ec1-45a4-b3f3-4864be53216e-config-data\") pod \"30599259-2ec1-45a4-b3f3-4864be53216e\" (UID: \"30599259-2ec1-45a4-b3f3-4864be53216e\") " Mar 16 16:10:38 crc kubenswrapper[5120]: I0316 16:10:38.956406 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/30599259-2ec1-45a4-b3f3-4864be53216e-combined-ca-bundle\") pod \"30599259-2ec1-45a4-b3f3-4864be53216e\" (UID: \"30599259-2ec1-45a4-b3f3-4864be53216e\") " Mar 16 16:10:38 crc kubenswrapper[5120]: I0316 16:10:38.957154 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w4wlc\" (UniqueName: \"kubernetes.io/projected/d1bbd676-9277-435f-822c-d066c95bc08a-kube-api-access-w4wlc\") on node \"crc\" DevicePath \"\"" Mar 16 16:10:38 crc kubenswrapper[5120]: I0316 16:10:38.957181 5120 reconciler_common.go:299] "Volume detached for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/d1bbd676-9277-435f-822c-d066c95bc08a-nova-metadata-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:10:38 crc kubenswrapper[5120]: I0316 16:10:38.957193 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d1bbd676-9277-435f-822c-d066c95bc08a-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:10:38 crc kubenswrapper[5120]: I0316 16:10:38.957205 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d1bbd676-9277-435f-822c-d066c95bc08a-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:10:38 crc kubenswrapper[5120]: I0316 16:10:38.957217 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d1bbd676-9277-435f-822c-d066c95bc08a-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:10:38 crc kubenswrapper[5120]: I0316 16:10:38.959999 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:10:38 crc kubenswrapper[5120]: I0316 16:10:38.962058 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30599259-2ec1-45a4-b3f3-4864be53216e-kube-api-access-2jfsd" (OuterVolumeSpecName: "kube-api-access-2jfsd") pod "30599259-2ec1-45a4-b3f3-4864be53216e" (UID: "30599259-2ec1-45a4-b3f3-4864be53216e"). InnerVolumeSpecName "kube-api-access-2jfsd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:10:38 crc kubenswrapper[5120]: I0316 16:10:38.973449 5120 scope.go:117] "RemoveContainer" containerID="26f6aeeea3303ad035786f00ff622a4972a4263c120d8930bf8c45b07295810d" Mar 16 16:10:38 crc kubenswrapper[5120]: I0316 16:10:38.983561 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:10:38 crc kubenswrapper[5120]: I0316 16:10:38.987980 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/30599259-2ec1-45a4-b3f3-4864be53216e-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "30599259-2ec1-45a4-b3f3-4864be53216e" (UID: "30599259-2ec1-45a4-b3f3-4864be53216e"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:10:38 crc kubenswrapper[5120]: I0316 16:10:38.992567 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/30599259-2ec1-45a4-b3f3-4864be53216e-config-data" (OuterVolumeSpecName: "config-data") pod "30599259-2ec1-45a4-b3f3-4864be53216e" (UID: "30599259-2ec1-45a4-b3f3-4864be53216e"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:10:39 crc kubenswrapper[5120]: I0316 16:10:38.997150 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:10:39 crc kubenswrapper[5120]: I0316 16:10:38.997270 5120 scope.go:117] "RemoveContainer" containerID="9e3485a856ac7d307aa914ada907031a10b8b14ff5063e3ee26edfa2735f1b68" Mar 16 16:10:39 crc kubenswrapper[5120]: I0316 16:10:39.002071 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1bbd676-9277-435f-822c-d066c95bc08a" containerName="nova-metadata-log" Mar 16 16:10:39 crc kubenswrapper[5120]: I0316 16:10:39.002111 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1bbd676-9277-435f-822c-d066c95bc08a" containerName="nova-metadata-log" Mar 16 16:10:39 crc kubenswrapper[5120]: I0316 16:10:39.002216 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30599259-2ec1-45a4-b3f3-4864be53216e" containerName="nova-scheduler-scheduler" Mar 16 16:10:39 crc kubenswrapper[5120]: I0316 16:10:39.002227 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="30599259-2ec1-45a4-b3f3-4864be53216e" containerName="nova-scheduler-scheduler" Mar 16 16:10:39 crc kubenswrapper[5120]: I0316 16:10:39.002253 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1bbd676-9277-435f-822c-d066c95bc08a" containerName="nova-metadata-metadata" Mar 16 16:10:39 crc kubenswrapper[5120]: I0316 16:10:39.002261 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1bbd676-9277-435f-822c-d066c95bc08a" containerName="nova-metadata-metadata" Mar 16 16:10:39 crc kubenswrapper[5120]: I0316 16:10:39.002589 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="30599259-2ec1-45a4-b3f3-4864be53216e" containerName="nova-scheduler-scheduler" Mar 16 16:10:39 crc kubenswrapper[5120]: I0316 16:10:39.002617 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="d1bbd676-9277-435f-822c-d066c95bc08a" containerName="nova-metadata-log" Mar 16 16:10:39 crc kubenswrapper[5120]: I0316 16:10:39.002631 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="d1bbd676-9277-435f-822c-d066c95bc08a" containerName="nova-metadata-metadata" Mar 16 16:10:39 crc kubenswrapper[5120]: E0316 16:10:39.005400 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9e3485a856ac7d307aa914ada907031a10b8b14ff5063e3ee26edfa2735f1b68\": container with ID starting with 9e3485a856ac7d307aa914ada907031a10b8b14ff5063e3ee26edfa2735f1b68 not found: ID does not exist" containerID="9e3485a856ac7d307aa914ada907031a10b8b14ff5063e3ee26edfa2735f1b68" Mar 16 16:10:39 crc kubenswrapper[5120]: I0316 16:10:39.005437 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e3485a856ac7d307aa914ada907031a10b8b14ff5063e3ee26edfa2735f1b68"} err="failed to get container status \"9e3485a856ac7d307aa914ada907031a10b8b14ff5063e3ee26edfa2735f1b68\": rpc error: code = NotFound desc = could not find container \"9e3485a856ac7d307aa914ada907031a10b8b14ff5063e3ee26edfa2735f1b68\": container with ID starting with 9e3485a856ac7d307aa914ada907031a10b8b14ff5063e3ee26edfa2735f1b68 not found: ID does not exist" Mar 16 16:10:39 crc kubenswrapper[5120]: I0316 16:10:39.005461 5120 scope.go:117] "RemoveContainer" containerID="26f6aeeea3303ad035786f00ff622a4972a4263c120d8930bf8c45b07295810d" Mar 16 16:10:39 crc kubenswrapper[5120]: E0316 16:10:39.007824 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"26f6aeeea3303ad035786f00ff622a4972a4263c120d8930bf8c45b07295810d\": container with ID starting with 26f6aeeea3303ad035786f00ff622a4972a4263c120d8930bf8c45b07295810d not found: ID does not exist" containerID="26f6aeeea3303ad035786f00ff622a4972a4263c120d8930bf8c45b07295810d" Mar 16 16:10:39 crc kubenswrapper[5120]: I0316 16:10:39.007893 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26f6aeeea3303ad035786f00ff622a4972a4263c120d8930bf8c45b07295810d"} err="failed to get container status \"26f6aeeea3303ad035786f00ff622a4972a4263c120d8930bf8c45b07295810d\": rpc error: code = NotFound desc = could not find container \"26f6aeeea3303ad035786f00ff622a4972a4263c120d8930bf8c45b07295810d\": container with ID starting with 26f6aeeea3303ad035786f00ff622a4972a4263c120d8930bf8c45b07295810d not found: ID does not exist" Mar 16 16:10:39 crc kubenswrapper[5120]: I0316 16:10:39.012649 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:10:39 crc kubenswrapper[5120]: I0316 16:10:39.012809 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:10:39 crc kubenswrapper[5120]: I0316 16:10:39.014775 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-metadata-internal-svc\"" Mar 16 16:10:39 crc kubenswrapper[5120]: I0316 16:10:39.015250 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-metadata-config-data\"" Mar 16 16:10:39 crc kubenswrapper[5120]: I0316 16:10:39.058726 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dc31395d-0cfc-48ae-b26d-276e4a8afb77-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"dc31395d-0cfc-48ae-b26d-276e4a8afb77\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:10:39 crc kubenswrapper[5120]: I0316 16:10:39.058909 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dc31395d-0cfc-48ae-b26d-276e4a8afb77-config-data\") pod \"nova-metadata-0\" (UID: \"dc31395d-0cfc-48ae-b26d-276e4a8afb77\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:10:39 crc kubenswrapper[5120]: I0316 16:10:39.059098 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/dc31395d-0cfc-48ae-b26d-276e4a8afb77-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"dc31395d-0cfc-48ae-b26d-276e4a8afb77\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:10:39 crc kubenswrapper[5120]: I0316 16:10:39.059125 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/dc31395d-0cfc-48ae-b26d-276e4a8afb77-logs\") pod \"nova-metadata-0\" (UID: \"dc31395d-0cfc-48ae-b26d-276e4a8afb77\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:10:39 crc kubenswrapper[5120]: I0316 16:10:39.059201 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5d2f\" (UniqueName: \"kubernetes.io/projected/dc31395d-0cfc-48ae-b26d-276e4a8afb77-kube-api-access-r5d2f\") pod \"nova-metadata-0\" (UID: \"dc31395d-0cfc-48ae-b26d-276e4a8afb77\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:10:39 crc kubenswrapper[5120]: I0316 16:10:39.059361 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2jfsd\" (UniqueName: \"kubernetes.io/projected/30599259-2ec1-45a4-b3f3-4864be53216e-kube-api-access-2jfsd\") on node \"crc\" DevicePath \"\"" Mar 16 16:10:39 crc kubenswrapper[5120]: I0316 16:10:39.059375 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/30599259-2ec1-45a4-b3f3-4864be53216e-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:10:39 crc kubenswrapper[5120]: I0316 16:10:39.059384 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/30599259-2ec1-45a4-b3f3-4864be53216e-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:10:39 crc kubenswrapper[5120]: I0316 16:10:39.160887 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/dc31395d-0cfc-48ae-b26d-276e4a8afb77-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"dc31395d-0cfc-48ae-b26d-276e4a8afb77\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:10:39 crc kubenswrapper[5120]: I0316 16:10:39.160936 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/dc31395d-0cfc-48ae-b26d-276e4a8afb77-logs\") pod \"nova-metadata-0\" (UID: \"dc31395d-0cfc-48ae-b26d-276e4a8afb77\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:10:39 crc kubenswrapper[5120]: I0316 16:10:39.161112 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r5d2f\" (UniqueName: \"kubernetes.io/projected/dc31395d-0cfc-48ae-b26d-276e4a8afb77-kube-api-access-r5d2f\") pod \"nova-metadata-0\" (UID: \"dc31395d-0cfc-48ae-b26d-276e4a8afb77\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:10:39 crc kubenswrapper[5120]: I0316 16:10:39.161219 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dc31395d-0cfc-48ae-b26d-276e4a8afb77-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"dc31395d-0cfc-48ae-b26d-276e4a8afb77\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:10:39 crc kubenswrapper[5120]: I0316 16:10:39.161338 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dc31395d-0cfc-48ae-b26d-276e4a8afb77-config-data\") pod \"nova-metadata-0\" (UID: \"dc31395d-0cfc-48ae-b26d-276e4a8afb77\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:10:39 crc kubenswrapper[5120]: I0316 16:10:39.161417 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/dc31395d-0cfc-48ae-b26d-276e4a8afb77-logs\") pod \"nova-metadata-0\" (UID: \"dc31395d-0cfc-48ae-b26d-276e4a8afb77\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:10:39 crc kubenswrapper[5120]: I0316 16:10:39.164451 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/dc31395d-0cfc-48ae-b26d-276e4a8afb77-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"dc31395d-0cfc-48ae-b26d-276e4a8afb77\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:10:39 crc kubenswrapper[5120]: I0316 16:10:39.165377 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dc31395d-0cfc-48ae-b26d-276e4a8afb77-config-data\") pod \"nova-metadata-0\" (UID: \"dc31395d-0cfc-48ae-b26d-276e4a8afb77\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:10:39 crc kubenswrapper[5120]: I0316 16:10:39.165563 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dc31395d-0cfc-48ae-b26d-276e4a8afb77-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"dc31395d-0cfc-48ae-b26d-276e4a8afb77\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:10:39 crc kubenswrapper[5120]: I0316 16:10:39.180424 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5d2f\" (UniqueName: \"kubernetes.io/projected/dc31395d-0cfc-48ae-b26d-276e4a8afb77-kube-api-access-r5d2f\") pod \"nova-metadata-0\" (UID: \"dc31395d-0cfc-48ae-b26d-276e4a8afb77\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:10:39 crc kubenswrapper[5120]: I0316 16:10:39.242533 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:10:39 crc kubenswrapper[5120]: I0316 16:10:39.259076 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:10:39 crc kubenswrapper[5120]: I0316 16:10:39.280232 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:10:39 crc kubenswrapper[5120]: I0316 16:10:39.287282 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:10:39 crc kubenswrapper[5120]: I0316 16:10:39.287373 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:10:39 crc kubenswrapper[5120]: I0316 16:10:39.301875 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-scheduler-config-data\"" Mar 16 16:10:39 crc kubenswrapper[5120]: I0316 16:10:39.333157 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:10:39 crc kubenswrapper[5120]: I0316 16:10:39.403453 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxd77\" (UniqueName: \"kubernetes.io/projected/7b459444-a6b1-4f69-a8f9-3db6c84580b7-kube-api-access-kxd77\") pod \"nova-scheduler-0\" (UID: \"7b459444-a6b1-4f69-a8f9-3db6c84580b7\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:10:39 crc kubenswrapper[5120]: I0316 16:10:39.403585 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7b459444-a6b1-4f69-a8f9-3db6c84580b7-config-data\") pod \"nova-scheduler-0\" (UID: \"7b459444-a6b1-4f69-a8f9-3db6c84580b7\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:10:39 crc kubenswrapper[5120]: I0316 16:10:39.403665 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7b459444-a6b1-4f69-a8f9-3db6c84580b7-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"7b459444-a6b1-4f69-a8f9-3db6c84580b7\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:10:39 crc kubenswrapper[5120]: I0316 16:10:39.505383 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7b459444-a6b1-4f69-a8f9-3db6c84580b7-config-data\") pod \"nova-scheduler-0\" (UID: \"7b459444-a6b1-4f69-a8f9-3db6c84580b7\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:10:39 crc kubenswrapper[5120]: I0316 16:10:39.505487 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7b459444-a6b1-4f69-a8f9-3db6c84580b7-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"7b459444-a6b1-4f69-a8f9-3db6c84580b7\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:10:39 crc kubenswrapper[5120]: I0316 16:10:39.505611 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kxd77\" (UniqueName: \"kubernetes.io/projected/7b459444-a6b1-4f69-a8f9-3db6c84580b7-kube-api-access-kxd77\") pod \"nova-scheduler-0\" (UID: \"7b459444-a6b1-4f69-a8f9-3db6c84580b7\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:10:39 crc kubenswrapper[5120]: I0316 16:10:39.515312 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7b459444-a6b1-4f69-a8f9-3db6c84580b7-config-data\") pod \"nova-scheduler-0\" (UID: \"7b459444-a6b1-4f69-a8f9-3db6c84580b7\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:10:39 crc kubenswrapper[5120]: I0316 16:10:39.527728 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7b459444-a6b1-4f69-a8f9-3db6c84580b7-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"7b459444-a6b1-4f69-a8f9-3db6c84580b7\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:10:39 crc kubenswrapper[5120]: I0316 16:10:39.528020 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxd77\" (UniqueName: \"kubernetes.io/projected/7b459444-a6b1-4f69-a8f9-3db6c84580b7-kube-api-access-kxd77\") pod \"nova-scheduler-0\" (UID: \"7b459444-a6b1-4f69-a8f9-3db6c84580b7\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:10:39 crc kubenswrapper[5120]: I0316 16:10:39.575606 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:10:39 crc kubenswrapper[5120]: W0316 16:10:39.579278 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddc31395d_0cfc_48ae_b26d_276e4a8afb77.slice/crio-bf8ab5ecea5344a3eef64cb95e00eb4778fffde7e68e86dd4c0ebf1f8b27a6a1 WatchSource:0}: Error finding container bf8ab5ecea5344a3eef64cb95e00eb4778fffde7e68e86dd4c0ebf1f8b27a6a1: Status 404 returned error can't find the container with id bf8ab5ecea5344a3eef64cb95e00eb4778fffde7e68e86dd4c0ebf1f8b27a6a1 Mar 16 16:10:39 crc kubenswrapper[5120]: I0316 16:10:39.619743 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:10:39 crc kubenswrapper[5120]: I0316 16:10:39.928298 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"dc31395d-0cfc-48ae-b26d-276e4a8afb77","Type":"ContainerStarted","Data":"bfce43255f6c59061a51cab3e762c65baa0ffac66c9aa102ffb5e4300d48d346"} Mar 16 16:10:39 crc kubenswrapper[5120]: I0316 16:10:39.928635 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"dc31395d-0cfc-48ae-b26d-276e4a8afb77","Type":"ContainerStarted","Data":"bf8ab5ecea5344a3eef64cb95e00eb4778fffde7e68e86dd4c0ebf1f8b27a6a1"} Mar 16 16:10:40 crc kubenswrapper[5120]: W0316 16:10:40.068973 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7b459444_a6b1_4f69_a8f9_3db6c84580b7.slice/crio-6322e8de539c56ba135a5b1a1cebb22c5cdbda0de669f687a2f9a419f433de15 WatchSource:0}: Error finding container 6322e8de539c56ba135a5b1a1cebb22c5cdbda0de669f687a2f9a419f433de15: Status 404 returned error can't find the container with id 6322e8de539c56ba135a5b1a1cebb22c5cdbda0de669f687a2f9a419f433de15 Mar 16 16:10:40 crc kubenswrapper[5120]: I0316 16:10:40.078866 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:10:40 crc kubenswrapper[5120]: I0316 16:10:40.675617 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="30599259-2ec1-45a4-b3f3-4864be53216e" path="/var/lib/kubelet/pods/30599259-2ec1-45a4-b3f3-4864be53216e/volumes" Mar 16 16:10:40 crc kubenswrapper[5120]: I0316 16:10:40.676411 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d1bbd676-9277-435f-822c-d066c95bc08a" path="/var/lib/kubelet/pods/d1bbd676-9277-435f-822c-d066c95bc08a/volumes" Mar 16 16:10:40 crc kubenswrapper[5120]: I0316 16:10:40.951476 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"7b459444-a6b1-4f69-a8f9-3db6c84580b7","Type":"ContainerStarted","Data":"5363c5c946a8766cf3a14a7db019b0865f8cc1a4abb2aae6db3b4186297ec6ec"} Mar 16 16:10:40 crc kubenswrapper[5120]: I0316 16:10:40.951540 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"7b459444-a6b1-4f69-a8f9-3db6c84580b7","Type":"ContainerStarted","Data":"6322e8de539c56ba135a5b1a1cebb22c5cdbda0de669f687a2f9a419f433de15"} Mar 16 16:10:40 crc kubenswrapper[5120]: I0316 16:10:40.957676 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"dc31395d-0cfc-48ae-b26d-276e4a8afb77","Type":"ContainerStarted","Data":"c38a7fbc35daa920db9ed63c28348595217d447afe24b3556aefd8ce48a85207"} Mar 16 16:10:40 crc kubenswrapper[5120]: I0316 16:10:40.982562 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-scheduler-0" podStartSLOduration=1.982534497 podStartE2EDuration="1.982534497s" podCreationTimestamp="2026-03-16 16:10:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:10:40.974139629 +0000 UTC m=+2343.128071326" watchObservedRunningTime="2026-03-16 16:10:40.982534497 +0000 UTC m=+2343.136466164" Mar 16 16:10:41 crc kubenswrapper[5120]: I0316 16:10:41.005966 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=3.005946442 podStartE2EDuration="3.005946442s" podCreationTimestamp="2026-03-16 16:10:38 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:10:40.996529537 +0000 UTC m=+2343.150461204" watchObservedRunningTime="2026-03-16 16:10:41.005946442 +0000 UTC m=+2343.159878109" Mar 16 16:10:44 crc kubenswrapper[5120]: I0316 16:10:44.620107 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:10:46 crc kubenswrapper[5120]: I0316 16:10:46.648959 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:10:46 crc kubenswrapper[5120]: I0316 16:10:46.649386 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:10:47 crc kubenswrapper[5120]: I0316 16:10:47.690999 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="a01d3bde-7444-4f22-a765-4b288facd718" containerName="nova-api-api" probeResult="failure" output="Get \"http://10.217.0.135:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 16:10:47 crc kubenswrapper[5120]: I0316 16:10:47.691063 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="a01d3bde-7444-4f22-a765-4b288facd718" containerName="nova-api-log" probeResult="failure" output="Get \"http://10.217.0.135:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 16:10:48 crc kubenswrapper[5120]: I0316 16:10:48.686980 5120 scope.go:117] "RemoveContainer" containerID="bc2df124cc6ad146d7c7dd2115ac815986fb62978d38895f6d345a4a9b14dbd8" Mar 16 16:10:48 crc kubenswrapper[5120]: E0316 16:10:48.688066 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:10:49 crc kubenswrapper[5120]: I0316 16:10:49.334983 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:10:49 crc kubenswrapper[5120]: I0316 16:10:49.335071 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:10:49 crc kubenswrapper[5120]: I0316 16:10:49.621236 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:10:49 crc kubenswrapper[5120]: I0316 16:10:49.654228 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:10:50 crc kubenswrapper[5120]: I0316 16:10:50.129297 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:10:50 crc kubenswrapper[5120]: I0316 16:10:50.341975 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="dc31395d-0cfc-48ae-b26d-276e4a8afb77" containerName="nova-metadata-log" probeResult="failure" output="Get \"https://10.217.0.136:8775/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Mar 16 16:10:50 crc kubenswrapper[5120]: I0316 16:10:50.341992 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="dc31395d-0cfc-48ae-b26d-276e4a8afb77" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"https://10.217.0.136:8775/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Mar 16 16:10:54 crc kubenswrapper[5120]: I0316 16:10:54.648031 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:10:54 crc kubenswrapper[5120]: I0316 16:10:54.648718 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:10:56 crc kubenswrapper[5120]: I0316 16:10:56.653726 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:10:56 crc kubenswrapper[5120]: I0316 16:10:56.657262 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:10:56 crc kubenswrapper[5120]: I0316 16:10:56.659140 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:10:57 crc kubenswrapper[5120]: I0316 16:10:57.152632 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:10:57 crc kubenswrapper[5120]: I0316 16:10:57.334092 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:10:57 crc kubenswrapper[5120]: I0316 16:10:57.334138 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:10:58 crc kubenswrapper[5120]: I0316 16:10:58.779694 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:10:59 crc kubenswrapper[5120]: I0316 16:10:59.093333 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:10:59 crc kubenswrapper[5120]: I0316 16:10:59.166368 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="1bceee6d-467e-4467-9fde-423caa4df7bc" containerName="ceilometer-central-agent" containerID="cri-o://707d6cc0f07eeb1804fa54ceaefd5ac76f884cf673517f6e2bcefe1a5832ddae" gracePeriod=30 Mar 16 16:10:59 crc kubenswrapper[5120]: I0316 16:10:59.166482 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="1bceee6d-467e-4467-9fde-423caa4df7bc" containerName="proxy-httpd" containerID="cri-o://0c98a49fef90099092130d3ff4d464058056ddc8395b8761048c97d0afc96778" gracePeriod=30 Mar 16 16:10:59 crc kubenswrapper[5120]: I0316 16:10:59.166531 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="1bceee6d-467e-4467-9fde-423caa4df7bc" containerName="ceilometer-notification-agent" containerID="cri-o://87fa9c39ad3d07a568dd348a106dade5889df97841fd678260ef690d22bd64c0" gracePeriod=30 Mar 16 16:10:59 crc kubenswrapper[5120]: I0316 16:10:59.166695 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="1bceee6d-467e-4467-9fde-423caa4df7bc" containerName="sg-core" containerID="cri-o://c764557ae1600b8ad72326a3b1f87ef91fd51acf422188c2bc2eee7d74d965e7" gracePeriod=30 Mar 16 16:10:59 crc kubenswrapper[5120]: I0316 16:10:59.340196 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:10:59 crc kubenswrapper[5120]: I0316 16:10:59.348135 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:10:59 crc kubenswrapper[5120]: I0316 16:10:59.349508 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:10:59 crc kubenswrapper[5120]: I0316 16:10:59.411184 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:10:59 crc kubenswrapper[5120]: I0316 16:10:59.897964 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:10:59 crc kubenswrapper[5120]: I0316 16:10:59.921117 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1bceee6d-467e-4467-9fde-423caa4df7bc-combined-ca-bundle\") pod \"1bceee6d-467e-4467-9fde-423caa4df7bc\" (UID: \"1bceee6d-467e-4467-9fde-423caa4df7bc\") " Mar 16 16:10:59 crc kubenswrapper[5120]: I0316 16:10:59.921222 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1bceee6d-467e-4467-9fde-423caa4df7bc-config-data\") pod \"1bceee6d-467e-4467-9fde-423caa4df7bc\" (UID: \"1bceee6d-467e-4467-9fde-423caa4df7bc\") " Mar 16 16:10:59 crc kubenswrapper[5120]: I0316 16:10:59.921368 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1bceee6d-467e-4467-9fde-423caa4df7bc-log-httpd\") pod \"1bceee6d-467e-4467-9fde-423caa4df7bc\" (UID: \"1bceee6d-467e-4467-9fde-423caa4df7bc\") " Mar 16 16:10:59 crc kubenswrapper[5120]: I0316 16:10:59.921536 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/1bceee6d-467e-4467-9fde-423caa4df7bc-ceilometer-tls-certs\") pod \"1bceee6d-467e-4467-9fde-423caa4df7bc\" (UID: \"1bceee6d-467e-4467-9fde-423caa4df7bc\") " Mar 16 16:10:59 crc kubenswrapper[5120]: I0316 16:10:59.921571 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1bceee6d-467e-4467-9fde-423caa4df7bc-run-httpd\") pod \"1bceee6d-467e-4467-9fde-423caa4df7bc\" (UID: \"1bceee6d-467e-4467-9fde-423caa4df7bc\") " Mar 16 16:10:59 crc kubenswrapper[5120]: I0316 16:10:59.921618 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/1bceee6d-467e-4467-9fde-423caa4df7bc-sg-core-conf-yaml\") pod \"1bceee6d-467e-4467-9fde-423caa4df7bc\" (UID: \"1bceee6d-467e-4467-9fde-423caa4df7bc\") " Mar 16 16:10:59 crc kubenswrapper[5120]: I0316 16:10:59.921670 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-npdkv\" (UniqueName: \"kubernetes.io/projected/1bceee6d-467e-4467-9fde-423caa4df7bc-kube-api-access-npdkv\") pod \"1bceee6d-467e-4467-9fde-423caa4df7bc\" (UID: \"1bceee6d-467e-4467-9fde-423caa4df7bc\") " Mar 16 16:10:59 crc kubenswrapper[5120]: I0316 16:10:59.921705 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1bceee6d-467e-4467-9fde-423caa4df7bc-scripts\") pod \"1bceee6d-467e-4467-9fde-423caa4df7bc\" (UID: \"1bceee6d-467e-4467-9fde-423caa4df7bc\") " Mar 16 16:10:59 crc kubenswrapper[5120]: I0316 16:10:59.922087 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1bceee6d-467e-4467-9fde-423caa4df7bc-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "1bceee6d-467e-4467-9fde-423caa4df7bc" (UID: "1bceee6d-467e-4467-9fde-423caa4df7bc"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:10:59 crc kubenswrapper[5120]: I0316 16:10:59.922549 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1bceee6d-467e-4467-9fde-423caa4df7bc-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "1bceee6d-467e-4467-9fde-423caa4df7bc" (UID: "1bceee6d-467e-4467-9fde-423caa4df7bc"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:10:59 crc kubenswrapper[5120]: I0316 16:10:59.929980 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1bceee6d-467e-4467-9fde-423caa4df7bc-kube-api-access-npdkv" (OuterVolumeSpecName: "kube-api-access-npdkv") pod "1bceee6d-467e-4467-9fde-423caa4df7bc" (UID: "1bceee6d-467e-4467-9fde-423caa4df7bc"). InnerVolumeSpecName "kube-api-access-npdkv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:10:59 crc kubenswrapper[5120]: I0316 16:10:59.943223 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1bceee6d-467e-4467-9fde-423caa4df7bc-scripts" (OuterVolumeSpecName: "scripts") pod "1bceee6d-467e-4467-9fde-423caa4df7bc" (UID: "1bceee6d-467e-4467-9fde-423caa4df7bc"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:10:59 crc kubenswrapper[5120]: I0316 16:10:59.951806 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1bceee6d-467e-4467-9fde-423caa4df7bc-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "1bceee6d-467e-4467-9fde-423caa4df7bc" (UID: "1bceee6d-467e-4467-9fde-423caa4df7bc"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:10:59 crc kubenswrapper[5120]: I0316 16:10:59.995396 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1bceee6d-467e-4467-9fde-423caa4df7bc-ceilometer-tls-certs" (OuterVolumeSpecName: "ceilometer-tls-certs") pod "1bceee6d-467e-4467-9fde-423caa4df7bc" (UID: "1bceee6d-467e-4467-9fde-423caa4df7bc"). InnerVolumeSpecName "ceilometer-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:11:00 crc kubenswrapper[5120]: I0316 16:11:00.024346 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/1bceee6d-467e-4467-9fde-423caa4df7bc-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 16:11:00 crc kubenswrapper[5120]: I0316 16:11:00.024386 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-npdkv\" (UniqueName: \"kubernetes.io/projected/1bceee6d-467e-4467-9fde-423caa4df7bc-kube-api-access-npdkv\") on node \"crc\" DevicePath \"\"" Mar 16 16:11:00 crc kubenswrapper[5120]: I0316 16:11:00.024402 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1bceee6d-467e-4467-9fde-423caa4df7bc-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:11:00 crc kubenswrapper[5120]: I0316 16:11:00.024416 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1bceee6d-467e-4467-9fde-423caa4df7bc-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:11:00 crc kubenswrapper[5120]: I0316 16:11:00.024428 5120 reconciler_common.go:299] "Volume detached for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/1bceee6d-467e-4467-9fde-423caa4df7bc-ceilometer-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:11:00 crc kubenswrapper[5120]: I0316 16:11:00.024439 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1bceee6d-467e-4467-9fde-423caa4df7bc-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:11:00 crc kubenswrapper[5120]: I0316 16:11:00.036609 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1bceee6d-467e-4467-9fde-423caa4df7bc-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "1bceee6d-467e-4467-9fde-423caa4df7bc" (UID: "1bceee6d-467e-4467-9fde-423caa4df7bc"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:11:00 crc kubenswrapper[5120]: I0316 16:11:00.056839 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1bceee6d-467e-4467-9fde-423caa4df7bc-config-data" (OuterVolumeSpecName: "config-data") pod "1bceee6d-467e-4467-9fde-423caa4df7bc" (UID: "1bceee6d-467e-4467-9fde-423caa4df7bc"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:11:00 crc kubenswrapper[5120]: I0316 16:11:00.126198 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1bceee6d-467e-4467-9fde-423caa4df7bc-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:11:00 crc kubenswrapper[5120]: I0316 16:11:00.126233 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1bceee6d-467e-4467-9fde-423caa4df7bc-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:11:00 crc kubenswrapper[5120]: I0316 16:11:00.195324 5120 generic.go:358] "Generic (PLEG): container finished" podID="1bceee6d-467e-4467-9fde-423caa4df7bc" containerID="0c98a49fef90099092130d3ff4d464058056ddc8395b8761048c97d0afc96778" exitCode=0 Mar 16 16:11:00 crc kubenswrapper[5120]: I0316 16:11:00.195366 5120 generic.go:358] "Generic (PLEG): container finished" podID="1bceee6d-467e-4467-9fde-423caa4df7bc" containerID="c764557ae1600b8ad72326a3b1f87ef91fd51acf422188c2bc2eee7d74d965e7" exitCode=2 Mar 16 16:11:00 crc kubenswrapper[5120]: I0316 16:11:00.195374 5120 generic.go:358] "Generic (PLEG): container finished" podID="1bceee6d-467e-4467-9fde-423caa4df7bc" containerID="87fa9c39ad3d07a568dd348a106dade5889df97841fd678260ef690d22bd64c0" exitCode=0 Mar 16 16:11:00 crc kubenswrapper[5120]: I0316 16:11:00.195381 5120 generic.go:358] "Generic (PLEG): container finished" podID="1bceee6d-467e-4467-9fde-423caa4df7bc" containerID="707d6cc0f07eeb1804fa54ceaefd5ac76f884cf673517f6e2bcefe1a5832ddae" exitCode=0 Mar 16 16:11:00 crc kubenswrapper[5120]: I0316 16:11:00.195428 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:11:00 crc kubenswrapper[5120]: I0316 16:11:00.195422 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1bceee6d-467e-4467-9fde-423caa4df7bc","Type":"ContainerDied","Data":"0c98a49fef90099092130d3ff4d464058056ddc8395b8761048c97d0afc96778"} Mar 16 16:11:00 crc kubenswrapper[5120]: I0316 16:11:00.195590 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1bceee6d-467e-4467-9fde-423caa4df7bc","Type":"ContainerDied","Data":"c764557ae1600b8ad72326a3b1f87ef91fd51acf422188c2bc2eee7d74d965e7"} Mar 16 16:11:00 crc kubenswrapper[5120]: I0316 16:11:00.195605 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1bceee6d-467e-4467-9fde-423caa4df7bc","Type":"ContainerDied","Data":"87fa9c39ad3d07a568dd348a106dade5889df97841fd678260ef690d22bd64c0"} Mar 16 16:11:00 crc kubenswrapper[5120]: I0316 16:11:00.195672 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1bceee6d-467e-4467-9fde-423caa4df7bc","Type":"ContainerDied","Data":"707d6cc0f07eeb1804fa54ceaefd5ac76f884cf673517f6e2bcefe1a5832ddae"} Mar 16 16:11:00 crc kubenswrapper[5120]: I0316 16:11:00.195684 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1bceee6d-467e-4467-9fde-423caa4df7bc","Type":"ContainerDied","Data":"fc3b5eb735a13f837d03db536eee2d66cb14c3ee8e89369a83ee42eea4ee7322"} Mar 16 16:11:00 crc kubenswrapper[5120]: I0316 16:11:00.195652 5120 scope.go:117] "RemoveContainer" containerID="0c98a49fef90099092130d3ff4d464058056ddc8395b8761048c97d0afc96778" Mar 16 16:11:00 crc kubenswrapper[5120]: I0316 16:11:00.196399 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="a01d3bde-7444-4f22-a765-4b288facd718" containerName="nova-api-log" containerID="cri-o://00425a355012e42e4f88b09792e7955d89358c418372d4aeb4e834ff747c861f" gracePeriod=30 Mar 16 16:11:00 crc kubenswrapper[5120]: I0316 16:11:00.196421 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="a01d3bde-7444-4f22-a765-4b288facd718" containerName="nova-api-api" containerID="cri-o://202abe946a848514b780f06cd12662af401911b080df5a73758cde99142f89d1" gracePeriod=30 Mar 16 16:11:00 crc kubenswrapper[5120]: I0316 16:11:00.205146 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:11:00 crc kubenswrapper[5120]: I0316 16:11:00.234419 5120 scope.go:117] "RemoveContainer" containerID="c764557ae1600b8ad72326a3b1f87ef91fd51acf422188c2bc2eee7d74d965e7" Mar 16 16:11:00 crc kubenswrapper[5120]: I0316 16:11:00.268011 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:11:00 crc kubenswrapper[5120]: I0316 16:11:00.271727 5120 scope.go:117] "RemoveContainer" containerID="87fa9c39ad3d07a568dd348a106dade5889df97841fd678260ef690d22bd64c0" Mar 16 16:11:00 crc kubenswrapper[5120]: I0316 16:11:00.289449 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:11:00 crc kubenswrapper[5120]: I0316 16:11:00.300680 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:11:00 crc kubenswrapper[5120]: I0316 16:11:00.301895 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1bceee6d-467e-4467-9fde-423caa4df7bc" containerName="proxy-httpd" Mar 16 16:11:00 crc kubenswrapper[5120]: I0316 16:11:00.301915 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1bceee6d-467e-4467-9fde-423caa4df7bc" containerName="proxy-httpd" Mar 16 16:11:00 crc kubenswrapper[5120]: I0316 16:11:00.301930 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1bceee6d-467e-4467-9fde-423caa4df7bc" containerName="sg-core" Mar 16 16:11:00 crc kubenswrapper[5120]: I0316 16:11:00.301936 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1bceee6d-467e-4467-9fde-423caa4df7bc" containerName="sg-core" Mar 16 16:11:00 crc kubenswrapper[5120]: I0316 16:11:00.301954 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1bceee6d-467e-4467-9fde-423caa4df7bc" containerName="ceilometer-central-agent" Mar 16 16:11:00 crc kubenswrapper[5120]: I0316 16:11:00.301960 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1bceee6d-467e-4467-9fde-423caa4df7bc" containerName="ceilometer-central-agent" Mar 16 16:11:00 crc kubenswrapper[5120]: I0316 16:11:00.301980 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1bceee6d-467e-4467-9fde-423caa4df7bc" containerName="ceilometer-notification-agent" Mar 16 16:11:00 crc kubenswrapper[5120]: I0316 16:11:00.301996 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1bceee6d-467e-4467-9fde-423caa4df7bc" containerName="ceilometer-notification-agent" Mar 16 16:11:00 crc kubenswrapper[5120]: I0316 16:11:00.302203 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1bceee6d-467e-4467-9fde-423caa4df7bc" containerName="ceilometer-notification-agent" Mar 16 16:11:00 crc kubenswrapper[5120]: I0316 16:11:00.302220 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1bceee6d-467e-4467-9fde-423caa4df7bc" containerName="sg-core" Mar 16 16:11:00 crc kubenswrapper[5120]: I0316 16:11:00.302233 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1bceee6d-467e-4467-9fde-423caa4df7bc" containerName="proxy-httpd" Mar 16 16:11:00 crc kubenswrapper[5120]: I0316 16:11:00.302243 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1bceee6d-467e-4467-9fde-423caa4df7bc" containerName="ceilometer-central-agent" Mar 16 16:11:00 crc kubenswrapper[5120]: I0316 16:11:00.310145 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:11:00 crc kubenswrapper[5120]: I0316 16:11:00.317702 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 16:11:00 crc kubenswrapper[5120]: I0316 16:11:00.318400 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 16:11:00 crc kubenswrapper[5120]: I0316 16:11:00.318490 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ceilometer-internal-svc\"" Mar 16 16:11:00 crc kubenswrapper[5120]: I0316 16:11:00.319261 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:11:00 crc kubenswrapper[5120]: I0316 16:11:00.332031 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ad786ce6-f0e7-4a07-8d35-7972b6b76bae-config-data\") pod \"ceilometer-0\" (UID: \"ad786ce6-f0e7-4a07-8d35-7972b6b76bae\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:11:00 crc kubenswrapper[5120]: I0316 16:11:00.332279 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/ad786ce6-f0e7-4a07-8d35-7972b6b76bae-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"ad786ce6-f0e7-4a07-8d35-7972b6b76bae\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:11:00 crc kubenswrapper[5120]: I0316 16:11:00.332470 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ad786ce6-f0e7-4a07-8d35-7972b6b76bae-run-httpd\") pod \"ceilometer-0\" (UID: \"ad786ce6-f0e7-4a07-8d35-7972b6b76bae\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:11:00 crc kubenswrapper[5120]: I0316 16:11:00.332628 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ad786ce6-f0e7-4a07-8d35-7972b6b76bae-log-httpd\") pod \"ceilometer-0\" (UID: \"ad786ce6-f0e7-4a07-8d35-7972b6b76bae\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:11:00 crc kubenswrapper[5120]: I0316 16:11:00.332869 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llsrw\" (UniqueName: \"kubernetes.io/projected/ad786ce6-f0e7-4a07-8d35-7972b6b76bae-kube-api-access-llsrw\") pod \"ceilometer-0\" (UID: \"ad786ce6-f0e7-4a07-8d35-7972b6b76bae\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:11:00 crc kubenswrapper[5120]: I0316 16:11:00.333018 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ad786ce6-f0e7-4a07-8d35-7972b6b76bae-scripts\") pod \"ceilometer-0\" (UID: \"ad786ce6-f0e7-4a07-8d35-7972b6b76bae\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:11:00 crc kubenswrapper[5120]: I0316 16:11:00.333267 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/ad786ce6-f0e7-4a07-8d35-7972b6b76bae-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"ad786ce6-f0e7-4a07-8d35-7972b6b76bae\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:11:00 crc kubenswrapper[5120]: I0316 16:11:00.333477 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ad786ce6-f0e7-4a07-8d35-7972b6b76bae-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"ad786ce6-f0e7-4a07-8d35-7972b6b76bae\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:11:00 crc kubenswrapper[5120]: I0316 16:11:00.383053 5120 scope.go:117] "RemoveContainer" containerID="707d6cc0f07eeb1804fa54ceaefd5ac76f884cf673517f6e2bcefe1a5832ddae" Mar 16 16:11:00 crc kubenswrapper[5120]: I0316 16:11:00.405006 5120 scope.go:117] "RemoveContainer" containerID="0c98a49fef90099092130d3ff4d464058056ddc8395b8761048c97d0afc96778" Mar 16 16:11:00 crc kubenswrapper[5120]: E0316 16:11:00.405383 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c98a49fef90099092130d3ff4d464058056ddc8395b8761048c97d0afc96778\": container with ID starting with 0c98a49fef90099092130d3ff4d464058056ddc8395b8761048c97d0afc96778 not found: ID does not exist" containerID="0c98a49fef90099092130d3ff4d464058056ddc8395b8761048c97d0afc96778" Mar 16 16:11:00 crc kubenswrapper[5120]: I0316 16:11:00.405437 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c98a49fef90099092130d3ff4d464058056ddc8395b8761048c97d0afc96778"} err="failed to get container status \"0c98a49fef90099092130d3ff4d464058056ddc8395b8761048c97d0afc96778\": rpc error: code = NotFound desc = could not find container \"0c98a49fef90099092130d3ff4d464058056ddc8395b8761048c97d0afc96778\": container with ID starting with 0c98a49fef90099092130d3ff4d464058056ddc8395b8761048c97d0afc96778 not found: ID does not exist" Mar 16 16:11:00 crc kubenswrapper[5120]: I0316 16:11:00.405472 5120 scope.go:117] "RemoveContainer" containerID="c764557ae1600b8ad72326a3b1f87ef91fd51acf422188c2bc2eee7d74d965e7" Mar 16 16:11:00 crc kubenswrapper[5120]: E0316 16:11:00.405888 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c764557ae1600b8ad72326a3b1f87ef91fd51acf422188c2bc2eee7d74d965e7\": container with ID starting with c764557ae1600b8ad72326a3b1f87ef91fd51acf422188c2bc2eee7d74d965e7 not found: ID does not exist" containerID="c764557ae1600b8ad72326a3b1f87ef91fd51acf422188c2bc2eee7d74d965e7" Mar 16 16:11:00 crc kubenswrapper[5120]: I0316 16:11:00.405927 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c764557ae1600b8ad72326a3b1f87ef91fd51acf422188c2bc2eee7d74d965e7"} err="failed to get container status \"c764557ae1600b8ad72326a3b1f87ef91fd51acf422188c2bc2eee7d74d965e7\": rpc error: code = NotFound desc = could not find container \"c764557ae1600b8ad72326a3b1f87ef91fd51acf422188c2bc2eee7d74d965e7\": container with ID starting with c764557ae1600b8ad72326a3b1f87ef91fd51acf422188c2bc2eee7d74d965e7 not found: ID does not exist" Mar 16 16:11:00 crc kubenswrapper[5120]: I0316 16:11:00.405947 5120 scope.go:117] "RemoveContainer" containerID="87fa9c39ad3d07a568dd348a106dade5889df97841fd678260ef690d22bd64c0" Mar 16 16:11:00 crc kubenswrapper[5120]: E0316 16:11:00.406144 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"87fa9c39ad3d07a568dd348a106dade5889df97841fd678260ef690d22bd64c0\": container with ID starting with 87fa9c39ad3d07a568dd348a106dade5889df97841fd678260ef690d22bd64c0 not found: ID does not exist" containerID="87fa9c39ad3d07a568dd348a106dade5889df97841fd678260ef690d22bd64c0" Mar 16 16:11:00 crc kubenswrapper[5120]: I0316 16:11:00.406166 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87fa9c39ad3d07a568dd348a106dade5889df97841fd678260ef690d22bd64c0"} err="failed to get container status \"87fa9c39ad3d07a568dd348a106dade5889df97841fd678260ef690d22bd64c0\": rpc error: code = NotFound desc = could not find container \"87fa9c39ad3d07a568dd348a106dade5889df97841fd678260ef690d22bd64c0\": container with ID starting with 87fa9c39ad3d07a568dd348a106dade5889df97841fd678260ef690d22bd64c0 not found: ID does not exist" Mar 16 16:11:00 crc kubenswrapper[5120]: I0316 16:11:00.406182 5120 scope.go:117] "RemoveContainer" containerID="707d6cc0f07eeb1804fa54ceaefd5ac76f884cf673517f6e2bcefe1a5832ddae" Mar 16 16:11:00 crc kubenswrapper[5120]: E0316 16:11:00.406460 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"707d6cc0f07eeb1804fa54ceaefd5ac76f884cf673517f6e2bcefe1a5832ddae\": container with ID starting with 707d6cc0f07eeb1804fa54ceaefd5ac76f884cf673517f6e2bcefe1a5832ddae not found: ID does not exist" containerID="707d6cc0f07eeb1804fa54ceaefd5ac76f884cf673517f6e2bcefe1a5832ddae" Mar 16 16:11:00 crc kubenswrapper[5120]: I0316 16:11:00.406485 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"707d6cc0f07eeb1804fa54ceaefd5ac76f884cf673517f6e2bcefe1a5832ddae"} err="failed to get container status \"707d6cc0f07eeb1804fa54ceaefd5ac76f884cf673517f6e2bcefe1a5832ddae\": rpc error: code = NotFound desc = could not find container \"707d6cc0f07eeb1804fa54ceaefd5ac76f884cf673517f6e2bcefe1a5832ddae\": container with ID starting with 707d6cc0f07eeb1804fa54ceaefd5ac76f884cf673517f6e2bcefe1a5832ddae not found: ID does not exist" Mar 16 16:11:00 crc kubenswrapper[5120]: I0316 16:11:00.406502 5120 scope.go:117] "RemoveContainer" containerID="0c98a49fef90099092130d3ff4d464058056ddc8395b8761048c97d0afc96778" Mar 16 16:11:00 crc kubenswrapper[5120]: I0316 16:11:00.406694 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c98a49fef90099092130d3ff4d464058056ddc8395b8761048c97d0afc96778"} err="failed to get container status \"0c98a49fef90099092130d3ff4d464058056ddc8395b8761048c97d0afc96778\": rpc error: code = NotFound desc = could not find container \"0c98a49fef90099092130d3ff4d464058056ddc8395b8761048c97d0afc96778\": container with ID starting with 0c98a49fef90099092130d3ff4d464058056ddc8395b8761048c97d0afc96778 not found: ID does not exist" Mar 16 16:11:00 crc kubenswrapper[5120]: I0316 16:11:00.406714 5120 scope.go:117] "RemoveContainer" containerID="c764557ae1600b8ad72326a3b1f87ef91fd51acf422188c2bc2eee7d74d965e7" Mar 16 16:11:00 crc kubenswrapper[5120]: I0316 16:11:00.406892 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c764557ae1600b8ad72326a3b1f87ef91fd51acf422188c2bc2eee7d74d965e7"} err="failed to get container status \"c764557ae1600b8ad72326a3b1f87ef91fd51acf422188c2bc2eee7d74d965e7\": rpc error: code = NotFound desc = could not find container \"c764557ae1600b8ad72326a3b1f87ef91fd51acf422188c2bc2eee7d74d965e7\": container with ID starting with c764557ae1600b8ad72326a3b1f87ef91fd51acf422188c2bc2eee7d74d965e7 not found: ID does not exist" Mar 16 16:11:00 crc kubenswrapper[5120]: I0316 16:11:00.406914 5120 scope.go:117] "RemoveContainer" containerID="87fa9c39ad3d07a568dd348a106dade5889df97841fd678260ef690d22bd64c0" Mar 16 16:11:00 crc kubenswrapper[5120]: I0316 16:11:00.407074 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87fa9c39ad3d07a568dd348a106dade5889df97841fd678260ef690d22bd64c0"} err="failed to get container status \"87fa9c39ad3d07a568dd348a106dade5889df97841fd678260ef690d22bd64c0\": rpc error: code = NotFound desc = could not find container \"87fa9c39ad3d07a568dd348a106dade5889df97841fd678260ef690d22bd64c0\": container with ID starting with 87fa9c39ad3d07a568dd348a106dade5889df97841fd678260ef690d22bd64c0 not found: ID does not exist" Mar 16 16:11:00 crc kubenswrapper[5120]: I0316 16:11:00.407092 5120 scope.go:117] "RemoveContainer" containerID="707d6cc0f07eeb1804fa54ceaefd5ac76f884cf673517f6e2bcefe1a5832ddae" Mar 16 16:11:00 crc kubenswrapper[5120]: I0316 16:11:00.407258 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"707d6cc0f07eeb1804fa54ceaefd5ac76f884cf673517f6e2bcefe1a5832ddae"} err="failed to get container status \"707d6cc0f07eeb1804fa54ceaefd5ac76f884cf673517f6e2bcefe1a5832ddae\": rpc error: code = NotFound desc = could not find container \"707d6cc0f07eeb1804fa54ceaefd5ac76f884cf673517f6e2bcefe1a5832ddae\": container with ID starting with 707d6cc0f07eeb1804fa54ceaefd5ac76f884cf673517f6e2bcefe1a5832ddae not found: ID does not exist" Mar 16 16:11:00 crc kubenswrapper[5120]: I0316 16:11:00.407283 5120 scope.go:117] "RemoveContainer" containerID="0c98a49fef90099092130d3ff4d464058056ddc8395b8761048c97d0afc96778" Mar 16 16:11:00 crc kubenswrapper[5120]: I0316 16:11:00.407452 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c98a49fef90099092130d3ff4d464058056ddc8395b8761048c97d0afc96778"} err="failed to get container status \"0c98a49fef90099092130d3ff4d464058056ddc8395b8761048c97d0afc96778\": rpc error: code = NotFound desc = could not find container \"0c98a49fef90099092130d3ff4d464058056ddc8395b8761048c97d0afc96778\": container with ID starting with 0c98a49fef90099092130d3ff4d464058056ddc8395b8761048c97d0afc96778 not found: ID does not exist" Mar 16 16:11:00 crc kubenswrapper[5120]: I0316 16:11:00.407471 5120 scope.go:117] "RemoveContainer" containerID="c764557ae1600b8ad72326a3b1f87ef91fd51acf422188c2bc2eee7d74d965e7" Mar 16 16:11:00 crc kubenswrapper[5120]: I0316 16:11:00.407661 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c764557ae1600b8ad72326a3b1f87ef91fd51acf422188c2bc2eee7d74d965e7"} err="failed to get container status \"c764557ae1600b8ad72326a3b1f87ef91fd51acf422188c2bc2eee7d74d965e7\": rpc error: code = NotFound desc = could not find container \"c764557ae1600b8ad72326a3b1f87ef91fd51acf422188c2bc2eee7d74d965e7\": container with ID starting with c764557ae1600b8ad72326a3b1f87ef91fd51acf422188c2bc2eee7d74d965e7 not found: ID does not exist" Mar 16 16:11:00 crc kubenswrapper[5120]: I0316 16:11:00.407680 5120 scope.go:117] "RemoveContainer" containerID="87fa9c39ad3d07a568dd348a106dade5889df97841fd678260ef690d22bd64c0" Mar 16 16:11:00 crc kubenswrapper[5120]: I0316 16:11:00.407874 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87fa9c39ad3d07a568dd348a106dade5889df97841fd678260ef690d22bd64c0"} err="failed to get container status \"87fa9c39ad3d07a568dd348a106dade5889df97841fd678260ef690d22bd64c0\": rpc error: code = NotFound desc = could not find container \"87fa9c39ad3d07a568dd348a106dade5889df97841fd678260ef690d22bd64c0\": container with ID starting with 87fa9c39ad3d07a568dd348a106dade5889df97841fd678260ef690d22bd64c0 not found: ID does not exist" Mar 16 16:11:00 crc kubenswrapper[5120]: I0316 16:11:00.407903 5120 scope.go:117] "RemoveContainer" containerID="707d6cc0f07eeb1804fa54ceaefd5ac76f884cf673517f6e2bcefe1a5832ddae" Mar 16 16:11:00 crc kubenswrapper[5120]: I0316 16:11:00.409230 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"707d6cc0f07eeb1804fa54ceaefd5ac76f884cf673517f6e2bcefe1a5832ddae"} err="failed to get container status \"707d6cc0f07eeb1804fa54ceaefd5ac76f884cf673517f6e2bcefe1a5832ddae\": rpc error: code = NotFound desc = could not find container \"707d6cc0f07eeb1804fa54ceaefd5ac76f884cf673517f6e2bcefe1a5832ddae\": container with ID starting with 707d6cc0f07eeb1804fa54ceaefd5ac76f884cf673517f6e2bcefe1a5832ddae not found: ID does not exist" Mar 16 16:11:00 crc kubenswrapper[5120]: I0316 16:11:00.409386 5120 scope.go:117] "RemoveContainer" containerID="0c98a49fef90099092130d3ff4d464058056ddc8395b8761048c97d0afc96778" Mar 16 16:11:00 crc kubenswrapper[5120]: I0316 16:11:00.410173 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c98a49fef90099092130d3ff4d464058056ddc8395b8761048c97d0afc96778"} err="failed to get container status \"0c98a49fef90099092130d3ff4d464058056ddc8395b8761048c97d0afc96778\": rpc error: code = NotFound desc = could not find container \"0c98a49fef90099092130d3ff4d464058056ddc8395b8761048c97d0afc96778\": container with ID starting with 0c98a49fef90099092130d3ff4d464058056ddc8395b8761048c97d0afc96778 not found: ID does not exist" Mar 16 16:11:00 crc kubenswrapper[5120]: I0316 16:11:00.410209 5120 scope.go:117] "RemoveContainer" containerID="c764557ae1600b8ad72326a3b1f87ef91fd51acf422188c2bc2eee7d74d965e7" Mar 16 16:11:00 crc kubenswrapper[5120]: I0316 16:11:00.410418 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c764557ae1600b8ad72326a3b1f87ef91fd51acf422188c2bc2eee7d74d965e7"} err="failed to get container status \"c764557ae1600b8ad72326a3b1f87ef91fd51acf422188c2bc2eee7d74d965e7\": rpc error: code = NotFound desc = could not find container \"c764557ae1600b8ad72326a3b1f87ef91fd51acf422188c2bc2eee7d74d965e7\": container with ID starting with c764557ae1600b8ad72326a3b1f87ef91fd51acf422188c2bc2eee7d74d965e7 not found: ID does not exist" Mar 16 16:11:00 crc kubenswrapper[5120]: I0316 16:11:00.410434 5120 scope.go:117] "RemoveContainer" containerID="87fa9c39ad3d07a568dd348a106dade5889df97841fd678260ef690d22bd64c0" Mar 16 16:11:00 crc kubenswrapper[5120]: I0316 16:11:00.410633 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87fa9c39ad3d07a568dd348a106dade5889df97841fd678260ef690d22bd64c0"} err="failed to get container status \"87fa9c39ad3d07a568dd348a106dade5889df97841fd678260ef690d22bd64c0\": rpc error: code = NotFound desc = could not find container \"87fa9c39ad3d07a568dd348a106dade5889df97841fd678260ef690d22bd64c0\": container with ID starting with 87fa9c39ad3d07a568dd348a106dade5889df97841fd678260ef690d22bd64c0 not found: ID does not exist" Mar 16 16:11:00 crc kubenswrapper[5120]: I0316 16:11:00.410652 5120 scope.go:117] "RemoveContainer" containerID="707d6cc0f07eeb1804fa54ceaefd5ac76f884cf673517f6e2bcefe1a5832ddae" Mar 16 16:11:00 crc kubenswrapper[5120]: I0316 16:11:00.410862 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"707d6cc0f07eeb1804fa54ceaefd5ac76f884cf673517f6e2bcefe1a5832ddae"} err="failed to get container status \"707d6cc0f07eeb1804fa54ceaefd5ac76f884cf673517f6e2bcefe1a5832ddae\": rpc error: code = NotFound desc = could not find container \"707d6cc0f07eeb1804fa54ceaefd5ac76f884cf673517f6e2bcefe1a5832ddae\": container with ID starting with 707d6cc0f07eeb1804fa54ceaefd5ac76f884cf673517f6e2bcefe1a5832ddae not found: ID does not exist" Mar 16 16:11:00 crc kubenswrapper[5120]: I0316 16:11:00.436074 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/ad786ce6-f0e7-4a07-8d35-7972b6b76bae-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"ad786ce6-f0e7-4a07-8d35-7972b6b76bae\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:11:00 crc kubenswrapper[5120]: I0316 16:11:00.436169 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ad786ce6-f0e7-4a07-8d35-7972b6b76bae-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"ad786ce6-f0e7-4a07-8d35-7972b6b76bae\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:11:00 crc kubenswrapper[5120]: I0316 16:11:00.436225 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ad786ce6-f0e7-4a07-8d35-7972b6b76bae-config-data\") pod \"ceilometer-0\" (UID: \"ad786ce6-f0e7-4a07-8d35-7972b6b76bae\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:11:00 crc kubenswrapper[5120]: I0316 16:11:00.436297 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/ad786ce6-f0e7-4a07-8d35-7972b6b76bae-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"ad786ce6-f0e7-4a07-8d35-7972b6b76bae\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:11:00 crc kubenswrapper[5120]: I0316 16:11:00.436396 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ad786ce6-f0e7-4a07-8d35-7972b6b76bae-run-httpd\") pod \"ceilometer-0\" (UID: \"ad786ce6-f0e7-4a07-8d35-7972b6b76bae\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:11:00 crc kubenswrapper[5120]: I0316 16:11:00.436489 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ad786ce6-f0e7-4a07-8d35-7972b6b76bae-log-httpd\") pod \"ceilometer-0\" (UID: \"ad786ce6-f0e7-4a07-8d35-7972b6b76bae\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:11:00 crc kubenswrapper[5120]: I0316 16:11:00.436522 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-llsrw\" (UniqueName: \"kubernetes.io/projected/ad786ce6-f0e7-4a07-8d35-7972b6b76bae-kube-api-access-llsrw\") pod \"ceilometer-0\" (UID: \"ad786ce6-f0e7-4a07-8d35-7972b6b76bae\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:11:00 crc kubenswrapper[5120]: I0316 16:11:00.436548 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ad786ce6-f0e7-4a07-8d35-7972b6b76bae-scripts\") pod \"ceilometer-0\" (UID: \"ad786ce6-f0e7-4a07-8d35-7972b6b76bae\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:11:00 crc kubenswrapper[5120]: I0316 16:11:00.437268 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ad786ce6-f0e7-4a07-8d35-7972b6b76bae-log-httpd\") pod \"ceilometer-0\" (UID: \"ad786ce6-f0e7-4a07-8d35-7972b6b76bae\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:11:00 crc kubenswrapper[5120]: I0316 16:11:00.437587 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ad786ce6-f0e7-4a07-8d35-7972b6b76bae-run-httpd\") pod \"ceilometer-0\" (UID: \"ad786ce6-f0e7-4a07-8d35-7972b6b76bae\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:11:00 crc kubenswrapper[5120]: I0316 16:11:00.441735 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ad786ce6-f0e7-4a07-8d35-7972b6b76bae-config-data\") pod \"ceilometer-0\" (UID: \"ad786ce6-f0e7-4a07-8d35-7972b6b76bae\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:11:00 crc kubenswrapper[5120]: I0316 16:11:00.443928 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ad786ce6-f0e7-4a07-8d35-7972b6b76bae-scripts\") pod \"ceilometer-0\" (UID: \"ad786ce6-f0e7-4a07-8d35-7972b6b76bae\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:11:00 crc kubenswrapper[5120]: I0316 16:11:00.444365 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/ad786ce6-f0e7-4a07-8d35-7972b6b76bae-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"ad786ce6-f0e7-4a07-8d35-7972b6b76bae\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:11:00 crc kubenswrapper[5120]: I0316 16:11:00.448015 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/ad786ce6-f0e7-4a07-8d35-7972b6b76bae-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"ad786ce6-f0e7-4a07-8d35-7972b6b76bae\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:11:00 crc kubenswrapper[5120]: I0316 16:11:00.454179 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ad786ce6-f0e7-4a07-8d35-7972b6b76bae-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"ad786ce6-f0e7-4a07-8d35-7972b6b76bae\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:11:00 crc kubenswrapper[5120]: I0316 16:11:00.458356 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-llsrw\" (UniqueName: \"kubernetes.io/projected/ad786ce6-f0e7-4a07-8d35-7972b6b76bae-kube-api-access-llsrw\") pod \"ceilometer-0\" (UID: \"ad786ce6-f0e7-4a07-8d35-7972b6b76bae\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:11:00 crc kubenswrapper[5120]: I0316 16:11:00.665419 5120 scope.go:117] "RemoveContainer" containerID="bc2df124cc6ad146d7c7dd2115ac815986fb62978d38895f6d345a4a9b14dbd8" Mar 16 16:11:00 crc kubenswrapper[5120]: E0316 16:11:00.665628 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:11:00 crc kubenswrapper[5120]: I0316 16:11:00.676412 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1bceee6d-467e-4467-9fde-423caa4df7bc" path="/var/lib/kubelet/pods/1bceee6d-467e-4467-9fde-423caa4df7bc/volumes" Mar 16 16:11:00 crc kubenswrapper[5120]: I0316 16:11:00.686265 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:11:00 crc kubenswrapper[5120]: I0316 16:11:00.872381 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:11:01 crc kubenswrapper[5120]: I0316 16:11:01.180619 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:11:01 crc kubenswrapper[5120]: I0316 16:11:01.207057 5120 generic.go:358] "Generic (PLEG): container finished" podID="a01d3bde-7444-4f22-a765-4b288facd718" containerID="00425a355012e42e4f88b09792e7955d89358c418372d4aeb4e834ff747c861f" exitCode=143 Mar 16 16:11:01 crc kubenswrapper[5120]: I0316 16:11:01.207147 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"a01d3bde-7444-4f22-a765-4b288facd718","Type":"ContainerDied","Data":"00425a355012e42e4f88b09792e7955d89358c418372d4aeb4e834ff747c861f"} Mar 16 16:11:01 crc kubenswrapper[5120]: I0316 16:11:01.210815 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ad786ce6-f0e7-4a07-8d35-7972b6b76bae","Type":"ContainerStarted","Data":"5a392f03152258b4fa8569442dcbdca60e84b01747be5c645ba0321c8b2b3779"} Mar 16 16:11:02 crc kubenswrapper[5120]: I0316 16:11:02.220878 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ad786ce6-f0e7-4a07-8d35-7972b6b76bae","Type":"ContainerStarted","Data":"daea0af5a03868b69a4267a30574934b11d985068c01f22136a936b2dc4ece31"} Mar 16 16:11:02 crc kubenswrapper[5120]: I0316 16:11:02.260713 5120 scope.go:117] "RemoveContainer" containerID="82bbb6ccca17d71e282ef2e46f6279fe406d5f8c97fc1cf7ecf828e9ef042e9f" Mar 16 16:11:02 crc kubenswrapper[5120]: I0316 16:11:02.304613 5120 scope.go:117] "RemoveContainer" containerID="03bfdb11d2885c4fd03a8617f7a9dc51003ba407e3a4fc8ee01cbc966adcebf4" Mar 16 16:11:03 crc kubenswrapper[5120]: I0316 16:11:03.238660 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ad786ce6-f0e7-4a07-8d35-7972b6b76bae","Type":"ContainerStarted","Data":"f6bc59b3e9a8ce19eda2001f4a87e24a4f1a6a99a64e6fa5dbf5e99c269cb8ff"} Mar 16 16:11:03 crc kubenswrapper[5120]: I0316 16:11:03.877087 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:11:04 crc kubenswrapper[5120]: I0316 16:11:04.023028 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a01d3bde-7444-4f22-a765-4b288facd718-combined-ca-bundle\") pod \"a01d3bde-7444-4f22-a765-4b288facd718\" (UID: \"a01d3bde-7444-4f22-a765-4b288facd718\") " Mar 16 16:11:04 crc kubenswrapper[5120]: I0316 16:11:04.023112 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a01d3bde-7444-4f22-a765-4b288facd718-logs\") pod \"a01d3bde-7444-4f22-a765-4b288facd718\" (UID: \"a01d3bde-7444-4f22-a765-4b288facd718\") " Mar 16 16:11:04 crc kubenswrapper[5120]: I0316 16:11:04.023204 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r6vnk\" (UniqueName: \"kubernetes.io/projected/a01d3bde-7444-4f22-a765-4b288facd718-kube-api-access-r6vnk\") pod \"a01d3bde-7444-4f22-a765-4b288facd718\" (UID: \"a01d3bde-7444-4f22-a765-4b288facd718\") " Mar 16 16:11:04 crc kubenswrapper[5120]: I0316 16:11:04.023303 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a01d3bde-7444-4f22-a765-4b288facd718-config-data\") pod \"a01d3bde-7444-4f22-a765-4b288facd718\" (UID: \"a01d3bde-7444-4f22-a765-4b288facd718\") " Mar 16 16:11:04 crc kubenswrapper[5120]: I0316 16:11:04.023671 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a01d3bde-7444-4f22-a765-4b288facd718-logs" (OuterVolumeSpecName: "logs") pod "a01d3bde-7444-4f22-a765-4b288facd718" (UID: "a01d3bde-7444-4f22-a765-4b288facd718"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:11:04 crc kubenswrapper[5120]: I0316 16:11:04.024359 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a01d3bde-7444-4f22-a765-4b288facd718-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:11:04 crc kubenswrapper[5120]: I0316 16:11:04.031618 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a01d3bde-7444-4f22-a765-4b288facd718-kube-api-access-r6vnk" (OuterVolumeSpecName: "kube-api-access-r6vnk") pod "a01d3bde-7444-4f22-a765-4b288facd718" (UID: "a01d3bde-7444-4f22-a765-4b288facd718"). InnerVolumeSpecName "kube-api-access-r6vnk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:11:04 crc kubenswrapper[5120]: I0316 16:11:04.065415 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a01d3bde-7444-4f22-a765-4b288facd718-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "a01d3bde-7444-4f22-a765-4b288facd718" (UID: "a01d3bde-7444-4f22-a765-4b288facd718"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:11:04 crc kubenswrapper[5120]: I0316 16:11:04.065443 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a01d3bde-7444-4f22-a765-4b288facd718-config-data" (OuterVolumeSpecName: "config-data") pod "a01d3bde-7444-4f22-a765-4b288facd718" (UID: "a01d3bde-7444-4f22-a765-4b288facd718"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:11:04 crc kubenswrapper[5120]: I0316 16:11:04.126576 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a01d3bde-7444-4f22-a765-4b288facd718-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:11:04 crc kubenswrapper[5120]: I0316 16:11:04.126610 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r6vnk\" (UniqueName: \"kubernetes.io/projected/a01d3bde-7444-4f22-a765-4b288facd718-kube-api-access-r6vnk\") on node \"crc\" DevicePath \"\"" Mar 16 16:11:04 crc kubenswrapper[5120]: I0316 16:11:04.126620 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a01d3bde-7444-4f22-a765-4b288facd718-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:11:04 crc kubenswrapper[5120]: I0316 16:11:04.250108 5120 generic.go:358] "Generic (PLEG): container finished" podID="a01d3bde-7444-4f22-a765-4b288facd718" containerID="202abe946a848514b780f06cd12662af401911b080df5a73758cde99142f89d1" exitCode=0 Mar 16 16:11:04 crc kubenswrapper[5120]: I0316 16:11:04.250455 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"a01d3bde-7444-4f22-a765-4b288facd718","Type":"ContainerDied","Data":"202abe946a848514b780f06cd12662af401911b080df5a73758cde99142f89d1"} Mar 16 16:11:04 crc kubenswrapper[5120]: I0316 16:11:04.250484 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"a01d3bde-7444-4f22-a765-4b288facd718","Type":"ContainerDied","Data":"b403d7e6151cc0c8b941967109638500d5ec68204294512773dc5fb9f8986ee4"} Mar 16 16:11:04 crc kubenswrapper[5120]: I0316 16:11:04.250503 5120 scope.go:117] "RemoveContainer" containerID="202abe946a848514b780f06cd12662af401911b080df5a73758cde99142f89d1" Mar 16 16:11:04 crc kubenswrapper[5120]: I0316 16:11:04.250661 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:11:04 crc kubenswrapper[5120]: I0316 16:11:04.286463 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:11:04 crc kubenswrapper[5120]: I0316 16:11:04.292032 5120 scope.go:117] "RemoveContainer" containerID="00425a355012e42e4f88b09792e7955d89358c418372d4aeb4e834ff747c861f" Mar 16 16:11:04 crc kubenswrapper[5120]: I0316 16:11:04.310458 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:11:04 crc kubenswrapper[5120]: I0316 16:11:04.322072 5120 scope.go:117] "RemoveContainer" containerID="202abe946a848514b780f06cd12662af401911b080df5a73758cde99142f89d1" Mar 16 16:11:04 crc kubenswrapper[5120]: E0316 16:11:04.322496 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"202abe946a848514b780f06cd12662af401911b080df5a73758cde99142f89d1\": container with ID starting with 202abe946a848514b780f06cd12662af401911b080df5a73758cde99142f89d1 not found: ID does not exist" containerID="202abe946a848514b780f06cd12662af401911b080df5a73758cde99142f89d1" Mar 16 16:11:04 crc kubenswrapper[5120]: I0316 16:11:04.322530 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"202abe946a848514b780f06cd12662af401911b080df5a73758cde99142f89d1"} err="failed to get container status \"202abe946a848514b780f06cd12662af401911b080df5a73758cde99142f89d1\": rpc error: code = NotFound desc = could not find container \"202abe946a848514b780f06cd12662af401911b080df5a73758cde99142f89d1\": container with ID starting with 202abe946a848514b780f06cd12662af401911b080df5a73758cde99142f89d1 not found: ID does not exist" Mar 16 16:11:04 crc kubenswrapper[5120]: I0316 16:11:04.322573 5120 scope.go:117] "RemoveContainer" containerID="00425a355012e42e4f88b09792e7955d89358c418372d4aeb4e834ff747c861f" Mar 16 16:11:04 crc kubenswrapper[5120]: E0316 16:11:04.322796 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"00425a355012e42e4f88b09792e7955d89358c418372d4aeb4e834ff747c861f\": container with ID starting with 00425a355012e42e4f88b09792e7955d89358c418372d4aeb4e834ff747c861f not found: ID does not exist" containerID="00425a355012e42e4f88b09792e7955d89358c418372d4aeb4e834ff747c861f" Mar 16 16:11:04 crc kubenswrapper[5120]: I0316 16:11:04.322824 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00425a355012e42e4f88b09792e7955d89358c418372d4aeb4e834ff747c861f"} err="failed to get container status \"00425a355012e42e4f88b09792e7955d89358c418372d4aeb4e834ff747c861f\": rpc error: code = NotFound desc = could not find container \"00425a355012e42e4f88b09792e7955d89358c418372d4aeb4e834ff747c861f\": container with ID starting with 00425a355012e42e4f88b09792e7955d89358c418372d4aeb4e834ff747c861f not found: ID does not exist" Mar 16 16:11:04 crc kubenswrapper[5120]: I0316 16:11:04.335384 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:11:04 crc kubenswrapper[5120]: I0316 16:11:04.341184 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a01d3bde-7444-4f22-a765-4b288facd718" containerName="nova-api-log" Mar 16 16:11:04 crc kubenswrapper[5120]: I0316 16:11:04.341213 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a01d3bde-7444-4f22-a765-4b288facd718" containerName="nova-api-log" Mar 16 16:11:04 crc kubenswrapper[5120]: I0316 16:11:04.341237 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a01d3bde-7444-4f22-a765-4b288facd718" containerName="nova-api-api" Mar 16 16:11:04 crc kubenswrapper[5120]: I0316 16:11:04.341242 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a01d3bde-7444-4f22-a765-4b288facd718" containerName="nova-api-api" Mar 16 16:11:04 crc kubenswrapper[5120]: I0316 16:11:04.341608 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="a01d3bde-7444-4f22-a765-4b288facd718" containerName="nova-api-api" Mar 16 16:11:04 crc kubenswrapper[5120]: I0316 16:11:04.341635 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="a01d3bde-7444-4f22-a765-4b288facd718" containerName="nova-api-log" Mar 16 16:11:04 crc kubenswrapper[5120]: I0316 16:11:04.348270 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:11:04 crc kubenswrapper[5120]: I0316 16:11:04.350615 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-config-data\"" Mar 16 16:11:04 crc kubenswrapper[5120]: I0316 16:11:04.351042 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-internal-svc\"" Mar 16 16:11:04 crc kubenswrapper[5120]: I0316 16:11:04.351234 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-public-svc\"" Mar 16 16:11:04 crc kubenswrapper[5120]: I0316 16:11:04.378448 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:11:04 crc kubenswrapper[5120]: I0316 16:11:04.434294 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/a4afa8e8-c485-4903-b53b-864c0517374e-public-tls-certs\") pod \"nova-api-0\" (UID: \"a4afa8e8-c485-4903-b53b-864c0517374e\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:11:04 crc kubenswrapper[5120]: I0316 16:11:04.434483 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/a4afa8e8-c485-4903-b53b-864c0517374e-internal-tls-certs\") pod \"nova-api-0\" (UID: \"a4afa8e8-c485-4903-b53b-864c0517374e\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:11:04 crc kubenswrapper[5120]: I0316 16:11:04.434548 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a4afa8e8-c485-4903-b53b-864c0517374e-config-data\") pod \"nova-api-0\" (UID: \"a4afa8e8-c485-4903-b53b-864c0517374e\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:11:04 crc kubenswrapper[5120]: I0316 16:11:04.434710 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a4afa8e8-c485-4903-b53b-864c0517374e-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"a4afa8e8-c485-4903-b53b-864c0517374e\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:11:04 crc kubenswrapper[5120]: I0316 16:11:04.434960 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a4afa8e8-c485-4903-b53b-864c0517374e-logs\") pod \"nova-api-0\" (UID: \"a4afa8e8-c485-4903-b53b-864c0517374e\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:11:04 crc kubenswrapper[5120]: I0316 16:11:04.435188 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fpcj8\" (UniqueName: \"kubernetes.io/projected/a4afa8e8-c485-4903-b53b-864c0517374e-kube-api-access-fpcj8\") pod \"nova-api-0\" (UID: \"a4afa8e8-c485-4903-b53b-864c0517374e\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:11:04 crc kubenswrapper[5120]: I0316 16:11:04.536539 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fpcj8\" (UniqueName: \"kubernetes.io/projected/a4afa8e8-c485-4903-b53b-864c0517374e-kube-api-access-fpcj8\") pod \"nova-api-0\" (UID: \"a4afa8e8-c485-4903-b53b-864c0517374e\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:11:04 crc kubenswrapper[5120]: I0316 16:11:04.536614 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/a4afa8e8-c485-4903-b53b-864c0517374e-public-tls-certs\") pod \"nova-api-0\" (UID: \"a4afa8e8-c485-4903-b53b-864c0517374e\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:11:04 crc kubenswrapper[5120]: I0316 16:11:04.536696 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/a4afa8e8-c485-4903-b53b-864c0517374e-internal-tls-certs\") pod \"nova-api-0\" (UID: \"a4afa8e8-c485-4903-b53b-864c0517374e\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:11:04 crc kubenswrapper[5120]: I0316 16:11:04.536718 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a4afa8e8-c485-4903-b53b-864c0517374e-config-data\") pod \"nova-api-0\" (UID: \"a4afa8e8-c485-4903-b53b-864c0517374e\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:11:04 crc kubenswrapper[5120]: I0316 16:11:04.537789 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a4afa8e8-c485-4903-b53b-864c0517374e-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"a4afa8e8-c485-4903-b53b-864c0517374e\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:11:04 crc kubenswrapper[5120]: I0316 16:11:04.537882 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a4afa8e8-c485-4903-b53b-864c0517374e-logs\") pod \"nova-api-0\" (UID: \"a4afa8e8-c485-4903-b53b-864c0517374e\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:11:04 crc kubenswrapper[5120]: I0316 16:11:04.538208 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a4afa8e8-c485-4903-b53b-864c0517374e-logs\") pod \"nova-api-0\" (UID: \"a4afa8e8-c485-4903-b53b-864c0517374e\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:11:04 crc kubenswrapper[5120]: I0316 16:11:04.548977 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/a4afa8e8-c485-4903-b53b-864c0517374e-public-tls-certs\") pod \"nova-api-0\" (UID: \"a4afa8e8-c485-4903-b53b-864c0517374e\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:11:04 crc kubenswrapper[5120]: I0316 16:11:04.549032 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a4afa8e8-c485-4903-b53b-864c0517374e-config-data\") pod \"nova-api-0\" (UID: \"a4afa8e8-c485-4903-b53b-864c0517374e\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:11:04 crc kubenswrapper[5120]: I0316 16:11:04.549519 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a4afa8e8-c485-4903-b53b-864c0517374e-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"a4afa8e8-c485-4903-b53b-864c0517374e\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:11:04 crc kubenswrapper[5120]: I0316 16:11:04.549678 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/a4afa8e8-c485-4903-b53b-864c0517374e-internal-tls-certs\") pod \"nova-api-0\" (UID: \"a4afa8e8-c485-4903-b53b-864c0517374e\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:11:04 crc kubenswrapper[5120]: I0316 16:11:04.552209 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fpcj8\" (UniqueName: \"kubernetes.io/projected/a4afa8e8-c485-4903-b53b-864c0517374e-kube-api-access-fpcj8\") pod \"nova-api-0\" (UID: \"a4afa8e8-c485-4903-b53b-864c0517374e\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:11:04 crc kubenswrapper[5120]: I0316 16:11:04.673943 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:11:04 crc kubenswrapper[5120]: I0316 16:11:04.678858 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a01d3bde-7444-4f22-a765-4b288facd718" path="/var/lib/kubelet/pods/a01d3bde-7444-4f22-a765-4b288facd718/volumes" Mar 16 16:11:05 crc kubenswrapper[5120]: I0316 16:11:05.172976 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:11:05 crc kubenswrapper[5120]: W0316 16:11:05.173790 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda4afa8e8_c485_4903_b53b_864c0517374e.slice/crio-b609db94eb8d185a6012c0d1a59e01bdd301fcbbd016446ebef220d0337c7555 WatchSource:0}: Error finding container b609db94eb8d185a6012c0d1a59e01bdd301fcbbd016446ebef220d0337c7555: Status 404 returned error can't find the container with id b609db94eb8d185a6012c0d1a59e01bdd301fcbbd016446ebef220d0337c7555 Mar 16 16:11:05 crc kubenswrapper[5120]: I0316 16:11:05.271602 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ad786ce6-f0e7-4a07-8d35-7972b6b76bae","Type":"ContainerStarted","Data":"90e6f0797e479ce88727e0250b689b32909d507152efba7cad3cd8e3f840b0ba"} Mar 16 16:11:05 crc kubenswrapper[5120]: I0316 16:11:05.273650 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"a4afa8e8-c485-4903-b53b-864c0517374e","Type":"ContainerStarted","Data":"b609db94eb8d185a6012c0d1a59e01bdd301fcbbd016446ebef220d0337c7555"} Mar 16 16:11:06 crc kubenswrapper[5120]: I0316 16:11:06.314177 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"a4afa8e8-c485-4903-b53b-864c0517374e","Type":"ContainerStarted","Data":"6a907d0329f6b418b5bde43c5425cd88ecfc1c1e43364b1c1ce7a0c7b6ed814d"} Mar 16 16:11:06 crc kubenswrapper[5120]: I0316 16:11:06.314529 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"a4afa8e8-c485-4903-b53b-864c0517374e","Type":"ContainerStarted","Data":"d0da62bc52626fc919ec76a1ec38c2dc40f8a9e294470ae9689ac38cd086ec67"} Mar 16 16:11:06 crc kubenswrapper[5120]: I0316 16:11:06.349421 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=2.3493991149999998 podStartE2EDuration="2.349399115s" podCreationTimestamp="2026-03-16 16:11:04 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:11:06.337177973 +0000 UTC m=+2368.491109630" watchObservedRunningTime="2026-03-16 16:11:06.349399115 +0000 UTC m=+2368.503330772" Mar 16 16:11:07 crc kubenswrapper[5120]: E0316 16:11:07.856681 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1764249 actualBytes=10240 Mar 16 16:11:08 crc kubenswrapper[5120]: I0316 16:11:08.389260 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ad786ce6-f0e7-4a07-8d35-7972b6b76bae","Type":"ContainerStarted","Data":"d99d3c3ccd7eb8662aa4384f2a00d1628523e332ebbb62bc1c5d78624d0d71cf"} Mar 16 16:11:08 crc kubenswrapper[5120]: I0316 16:11:08.389634 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="ad786ce6-f0e7-4a07-8d35-7972b6b76bae" containerName="ceilometer-central-agent" containerID="cri-o://daea0af5a03868b69a4267a30574934b11d985068c01f22136a936b2dc4ece31" gracePeriod=30 Mar 16 16:11:08 crc kubenswrapper[5120]: I0316 16:11:08.389701 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:11:08 crc kubenswrapper[5120]: I0316 16:11:08.389877 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="ad786ce6-f0e7-4a07-8d35-7972b6b76bae" containerName="proxy-httpd" containerID="cri-o://d99d3c3ccd7eb8662aa4384f2a00d1628523e332ebbb62bc1c5d78624d0d71cf" gracePeriod=30 Mar 16 16:11:08 crc kubenswrapper[5120]: I0316 16:11:08.389928 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="ad786ce6-f0e7-4a07-8d35-7972b6b76bae" containerName="sg-core" containerID="cri-o://90e6f0797e479ce88727e0250b689b32909d507152efba7cad3cd8e3f840b0ba" gracePeriod=30 Mar 16 16:11:08 crc kubenswrapper[5120]: I0316 16:11:08.390011 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="ad786ce6-f0e7-4a07-8d35-7972b6b76bae" containerName="ceilometer-notification-agent" containerID="cri-o://f6bc59b3e9a8ce19eda2001f4a87e24a4f1a6a99a64e6fa5dbf5e99c269cb8ff" gracePeriod=30 Mar 16 16:11:08 crc kubenswrapper[5120]: I0316 16:11:08.430528 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.342965836 podStartE2EDuration="8.430486542s" podCreationTimestamp="2026-03-16 16:11:00 +0000 UTC" firstStartedPulling="2026-03-16 16:11:01.185601532 +0000 UTC m=+2363.339533189" lastFinishedPulling="2026-03-16 16:11:07.273122208 +0000 UTC m=+2369.427053895" observedRunningTime="2026-03-16 16:11:08.422321321 +0000 UTC m=+2370.576252998" watchObservedRunningTime="2026-03-16 16:11:08.430486542 +0000 UTC m=+2370.584418219" Mar 16 16:11:09 crc kubenswrapper[5120]: I0316 16:11:09.238008 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:11:09 crc kubenswrapper[5120]: I0316 16:11:09.351732 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ad786ce6-f0e7-4a07-8d35-7972b6b76bae-combined-ca-bundle\") pod \"ad786ce6-f0e7-4a07-8d35-7972b6b76bae\" (UID: \"ad786ce6-f0e7-4a07-8d35-7972b6b76bae\") " Mar 16 16:11:09 crc kubenswrapper[5120]: I0316 16:11:09.351854 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ad786ce6-f0e7-4a07-8d35-7972b6b76bae-scripts\") pod \"ad786ce6-f0e7-4a07-8d35-7972b6b76bae\" (UID: \"ad786ce6-f0e7-4a07-8d35-7972b6b76bae\") " Mar 16 16:11:09 crc kubenswrapper[5120]: I0316 16:11:09.351900 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-llsrw\" (UniqueName: \"kubernetes.io/projected/ad786ce6-f0e7-4a07-8d35-7972b6b76bae-kube-api-access-llsrw\") pod \"ad786ce6-f0e7-4a07-8d35-7972b6b76bae\" (UID: \"ad786ce6-f0e7-4a07-8d35-7972b6b76bae\") " Mar 16 16:11:09 crc kubenswrapper[5120]: I0316 16:11:09.351938 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ad786ce6-f0e7-4a07-8d35-7972b6b76bae-log-httpd\") pod \"ad786ce6-f0e7-4a07-8d35-7972b6b76bae\" (UID: \"ad786ce6-f0e7-4a07-8d35-7972b6b76bae\") " Mar 16 16:11:09 crc kubenswrapper[5120]: I0316 16:11:09.351992 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ad786ce6-f0e7-4a07-8d35-7972b6b76bae-config-data\") pod \"ad786ce6-f0e7-4a07-8d35-7972b6b76bae\" (UID: \"ad786ce6-f0e7-4a07-8d35-7972b6b76bae\") " Mar 16 16:11:09 crc kubenswrapper[5120]: I0316 16:11:09.352059 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/ad786ce6-f0e7-4a07-8d35-7972b6b76bae-ceilometer-tls-certs\") pod \"ad786ce6-f0e7-4a07-8d35-7972b6b76bae\" (UID: \"ad786ce6-f0e7-4a07-8d35-7972b6b76bae\") " Mar 16 16:11:09 crc kubenswrapper[5120]: I0316 16:11:09.352149 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/ad786ce6-f0e7-4a07-8d35-7972b6b76bae-sg-core-conf-yaml\") pod \"ad786ce6-f0e7-4a07-8d35-7972b6b76bae\" (UID: \"ad786ce6-f0e7-4a07-8d35-7972b6b76bae\") " Mar 16 16:11:09 crc kubenswrapper[5120]: I0316 16:11:09.352179 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ad786ce6-f0e7-4a07-8d35-7972b6b76bae-run-httpd\") pod \"ad786ce6-f0e7-4a07-8d35-7972b6b76bae\" (UID: \"ad786ce6-f0e7-4a07-8d35-7972b6b76bae\") " Mar 16 16:11:09 crc kubenswrapper[5120]: I0316 16:11:09.353446 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad786ce6-f0e7-4a07-8d35-7972b6b76bae-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "ad786ce6-f0e7-4a07-8d35-7972b6b76bae" (UID: "ad786ce6-f0e7-4a07-8d35-7972b6b76bae"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:11:09 crc kubenswrapper[5120]: I0316 16:11:09.354395 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad786ce6-f0e7-4a07-8d35-7972b6b76bae-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "ad786ce6-f0e7-4a07-8d35-7972b6b76bae" (UID: "ad786ce6-f0e7-4a07-8d35-7972b6b76bae"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:11:09 crc kubenswrapper[5120]: I0316 16:11:09.360925 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad786ce6-f0e7-4a07-8d35-7972b6b76bae-kube-api-access-llsrw" (OuterVolumeSpecName: "kube-api-access-llsrw") pod "ad786ce6-f0e7-4a07-8d35-7972b6b76bae" (UID: "ad786ce6-f0e7-4a07-8d35-7972b6b76bae"). InnerVolumeSpecName "kube-api-access-llsrw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:11:09 crc kubenswrapper[5120]: I0316 16:11:09.361872 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad786ce6-f0e7-4a07-8d35-7972b6b76bae-scripts" (OuterVolumeSpecName: "scripts") pod "ad786ce6-f0e7-4a07-8d35-7972b6b76bae" (UID: "ad786ce6-f0e7-4a07-8d35-7972b6b76bae"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:11:09 crc kubenswrapper[5120]: I0316 16:11:09.400375 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad786ce6-f0e7-4a07-8d35-7972b6b76bae-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "ad786ce6-f0e7-4a07-8d35-7972b6b76bae" (UID: "ad786ce6-f0e7-4a07-8d35-7972b6b76bae"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:11:09 crc kubenswrapper[5120]: I0316 16:11:09.402313 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad786ce6-f0e7-4a07-8d35-7972b6b76bae-ceilometer-tls-certs" (OuterVolumeSpecName: "ceilometer-tls-certs") pod "ad786ce6-f0e7-4a07-8d35-7972b6b76bae" (UID: "ad786ce6-f0e7-4a07-8d35-7972b6b76bae"). InnerVolumeSpecName "ceilometer-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:11:09 crc kubenswrapper[5120]: I0316 16:11:09.403825 5120 generic.go:358] "Generic (PLEG): container finished" podID="ad786ce6-f0e7-4a07-8d35-7972b6b76bae" containerID="d99d3c3ccd7eb8662aa4384f2a00d1628523e332ebbb62bc1c5d78624d0d71cf" exitCode=0 Mar 16 16:11:09 crc kubenswrapper[5120]: I0316 16:11:09.403882 5120 generic.go:358] "Generic (PLEG): container finished" podID="ad786ce6-f0e7-4a07-8d35-7972b6b76bae" containerID="90e6f0797e479ce88727e0250b689b32909d507152efba7cad3cd8e3f840b0ba" exitCode=2 Mar 16 16:11:09 crc kubenswrapper[5120]: I0316 16:11:09.403901 5120 generic.go:358] "Generic (PLEG): container finished" podID="ad786ce6-f0e7-4a07-8d35-7972b6b76bae" containerID="f6bc59b3e9a8ce19eda2001f4a87e24a4f1a6a99a64e6fa5dbf5e99c269cb8ff" exitCode=0 Mar 16 16:11:09 crc kubenswrapper[5120]: I0316 16:11:09.403916 5120 generic.go:358] "Generic (PLEG): container finished" podID="ad786ce6-f0e7-4a07-8d35-7972b6b76bae" containerID="daea0af5a03868b69a4267a30574934b11d985068c01f22136a936b2dc4ece31" exitCode=0 Mar 16 16:11:09 crc kubenswrapper[5120]: I0316 16:11:09.403935 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ad786ce6-f0e7-4a07-8d35-7972b6b76bae","Type":"ContainerDied","Data":"d99d3c3ccd7eb8662aa4384f2a00d1628523e332ebbb62bc1c5d78624d0d71cf"} Mar 16 16:11:09 crc kubenswrapper[5120]: I0316 16:11:09.403970 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:11:09 crc kubenswrapper[5120]: I0316 16:11:09.403988 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ad786ce6-f0e7-4a07-8d35-7972b6b76bae","Type":"ContainerDied","Data":"90e6f0797e479ce88727e0250b689b32909d507152efba7cad3cd8e3f840b0ba"} Mar 16 16:11:09 crc kubenswrapper[5120]: I0316 16:11:09.404001 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ad786ce6-f0e7-4a07-8d35-7972b6b76bae","Type":"ContainerDied","Data":"f6bc59b3e9a8ce19eda2001f4a87e24a4f1a6a99a64e6fa5dbf5e99c269cb8ff"} Mar 16 16:11:09 crc kubenswrapper[5120]: I0316 16:11:09.404012 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ad786ce6-f0e7-4a07-8d35-7972b6b76bae","Type":"ContainerDied","Data":"daea0af5a03868b69a4267a30574934b11d985068c01f22136a936b2dc4ece31"} Mar 16 16:11:09 crc kubenswrapper[5120]: I0316 16:11:09.404024 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ad786ce6-f0e7-4a07-8d35-7972b6b76bae","Type":"ContainerDied","Data":"5a392f03152258b4fa8569442dcbdca60e84b01747be5c645ba0321c8b2b3779"} Mar 16 16:11:09 crc kubenswrapper[5120]: I0316 16:11:09.404043 5120 scope.go:117] "RemoveContainer" containerID="d99d3c3ccd7eb8662aa4384f2a00d1628523e332ebbb62bc1c5d78624d0d71cf" Mar 16 16:11:09 crc kubenswrapper[5120]: I0316 16:11:09.434672 5120 scope.go:117] "RemoveContainer" containerID="90e6f0797e479ce88727e0250b689b32909d507152efba7cad3cd8e3f840b0ba" Mar 16 16:11:09 crc kubenswrapper[5120]: I0316 16:11:09.436893 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad786ce6-f0e7-4a07-8d35-7972b6b76bae-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ad786ce6-f0e7-4a07-8d35-7972b6b76bae" (UID: "ad786ce6-f0e7-4a07-8d35-7972b6b76bae"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:11:09 crc kubenswrapper[5120]: I0316 16:11:09.455031 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ad786ce6-f0e7-4a07-8d35-7972b6b76bae-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:11:09 crc kubenswrapper[5120]: I0316 16:11:09.455072 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ad786ce6-f0e7-4a07-8d35-7972b6b76bae-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:11:09 crc kubenswrapper[5120]: I0316 16:11:09.455085 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-llsrw\" (UniqueName: \"kubernetes.io/projected/ad786ce6-f0e7-4a07-8d35-7972b6b76bae-kube-api-access-llsrw\") on node \"crc\" DevicePath \"\"" Mar 16 16:11:09 crc kubenswrapper[5120]: I0316 16:11:09.455099 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ad786ce6-f0e7-4a07-8d35-7972b6b76bae-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:11:09 crc kubenswrapper[5120]: I0316 16:11:09.455111 5120 reconciler_common.go:299] "Volume detached for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/ad786ce6-f0e7-4a07-8d35-7972b6b76bae-ceilometer-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:11:09 crc kubenswrapper[5120]: I0316 16:11:09.455126 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/ad786ce6-f0e7-4a07-8d35-7972b6b76bae-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 16:11:09 crc kubenswrapper[5120]: I0316 16:11:09.455138 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ad786ce6-f0e7-4a07-8d35-7972b6b76bae-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:11:09 crc kubenswrapper[5120]: I0316 16:11:09.455401 5120 scope.go:117] "RemoveContainer" containerID="f6bc59b3e9a8ce19eda2001f4a87e24a4f1a6a99a64e6fa5dbf5e99c269cb8ff" Mar 16 16:11:09 crc kubenswrapper[5120]: I0316 16:11:09.456094 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad786ce6-f0e7-4a07-8d35-7972b6b76bae-config-data" (OuterVolumeSpecName: "config-data") pod "ad786ce6-f0e7-4a07-8d35-7972b6b76bae" (UID: "ad786ce6-f0e7-4a07-8d35-7972b6b76bae"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:11:09 crc kubenswrapper[5120]: I0316 16:11:09.474082 5120 scope.go:117] "RemoveContainer" containerID="daea0af5a03868b69a4267a30574934b11d985068c01f22136a936b2dc4ece31" Mar 16 16:11:09 crc kubenswrapper[5120]: I0316 16:11:09.495500 5120 scope.go:117] "RemoveContainer" containerID="d99d3c3ccd7eb8662aa4384f2a00d1628523e332ebbb62bc1c5d78624d0d71cf" Mar 16 16:11:09 crc kubenswrapper[5120]: E0316 16:11:09.495965 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d99d3c3ccd7eb8662aa4384f2a00d1628523e332ebbb62bc1c5d78624d0d71cf\": container with ID starting with d99d3c3ccd7eb8662aa4384f2a00d1628523e332ebbb62bc1c5d78624d0d71cf not found: ID does not exist" containerID="d99d3c3ccd7eb8662aa4384f2a00d1628523e332ebbb62bc1c5d78624d0d71cf" Mar 16 16:11:09 crc kubenswrapper[5120]: I0316 16:11:09.496019 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d99d3c3ccd7eb8662aa4384f2a00d1628523e332ebbb62bc1c5d78624d0d71cf"} err="failed to get container status \"d99d3c3ccd7eb8662aa4384f2a00d1628523e332ebbb62bc1c5d78624d0d71cf\": rpc error: code = NotFound desc = could not find container \"d99d3c3ccd7eb8662aa4384f2a00d1628523e332ebbb62bc1c5d78624d0d71cf\": container with ID starting with d99d3c3ccd7eb8662aa4384f2a00d1628523e332ebbb62bc1c5d78624d0d71cf not found: ID does not exist" Mar 16 16:11:09 crc kubenswrapper[5120]: I0316 16:11:09.496094 5120 scope.go:117] "RemoveContainer" containerID="90e6f0797e479ce88727e0250b689b32909d507152efba7cad3cd8e3f840b0ba" Mar 16 16:11:09 crc kubenswrapper[5120]: E0316 16:11:09.496405 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"90e6f0797e479ce88727e0250b689b32909d507152efba7cad3cd8e3f840b0ba\": container with ID starting with 90e6f0797e479ce88727e0250b689b32909d507152efba7cad3cd8e3f840b0ba not found: ID does not exist" containerID="90e6f0797e479ce88727e0250b689b32909d507152efba7cad3cd8e3f840b0ba" Mar 16 16:11:09 crc kubenswrapper[5120]: I0316 16:11:09.496444 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90e6f0797e479ce88727e0250b689b32909d507152efba7cad3cd8e3f840b0ba"} err="failed to get container status \"90e6f0797e479ce88727e0250b689b32909d507152efba7cad3cd8e3f840b0ba\": rpc error: code = NotFound desc = could not find container \"90e6f0797e479ce88727e0250b689b32909d507152efba7cad3cd8e3f840b0ba\": container with ID starting with 90e6f0797e479ce88727e0250b689b32909d507152efba7cad3cd8e3f840b0ba not found: ID does not exist" Mar 16 16:11:09 crc kubenswrapper[5120]: I0316 16:11:09.496475 5120 scope.go:117] "RemoveContainer" containerID="f6bc59b3e9a8ce19eda2001f4a87e24a4f1a6a99a64e6fa5dbf5e99c269cb8ff" Mar 16 16:11:09 crc kubenswrapper[5120]: E0316 16:11:09.496737 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f6bc59b3e9a8ce19eda2001f4a87e24a4f1a6a99a64e6fa5dbf5e99c269cb8ff\": container with ID starting with f6bc59b3e9a8ce19eda2001f4a87e24a4f1a6a99a64e6fa5dbf5e99c269cb8ff not found: ID does not exist" containerID="f6bc59b3e9a8ce19eda2001f4a87e24a4f1a6a99a64e6fa5dbf5e99c269cb8ff" Mar 16 16:11:09 crc kubenswrapper[5120]: I0316 16:11:09.496872 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6bc59b3e9a8ce19eda2001f4a87e24a4f1a6a99a64e6fa5dbf5e99c269cb8ff"} err="failed to get container status \"f6bc59b3e9a8ce19eda2001f4a87e24a4f1a6a99a64e6fa5dbf5e99c269cb8ff\": rpc error: code = NotFound desc = could not find container \"f6bc59b3e9a8ce19eda2001f4a87e24a4f1a6a99a64e6fa5dbf5e99c269cb8ff\": container with ID starting with f6bc59b3e9a8ce19eda2001f4a87e24a4f1a6a99a64e6fa5dbf5e99c269cb8ff not found: ID does not exist" Mar 16 16:11:09 crc kubenswrapper[5120]: I0316 16:11:09.496895 5120 scope.go:117] "RemoveContainer" containerID="daea0af5a03868b69a4267a30574934b11d985068c01f22136a936b2dc4ece31" Mar 16 16:11:09 crc kubenswrapper[5120]: E0316 16:11:09.497541 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"daea0af5a03868b69a4267a30574934b11d985068c01f22136a936b2dc4ece31\": container with ID starting with daea0af5a03868b69a4267a30574934b11d985068c01f22136a936b2dc4ece31 not found: ID does not exist" containerID="daea0af5a03868b69a4267a30574934b11d985068c01f22136a936b2dc4ece31" Mar 16 16:11:09 crc kubenswrapper[5120]: I0316 16:11:09.497574 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"daea0af5a03868b69a4267a30574934b11d985068c01f22136a936b2dc4ece31"} err="failed to get container status \"daea0af5a03868b69a4267a30574934b11d985068c01f22136a936b2dc4ece31\": rpc error: code = NotFound desc = could not find container \"daea0af5a03868b69a4267a30574934b11d985068c01f22136a936b2dc4ece31\": container with ID starting with daea0af5a03868b69a4267a30574934b11d985068c01f22136a936b2dc4ece31 not found: ID does not exist" Mar 16 16:11:09 crc kubenswrapper[5120]: I0316 16:11:09.497593 5120 scope.go:117] "RemoveContainer" containerID="d99d3c3ccd7eb8662aa4384f2a00d1628523e332ebbb62bc1c5d78624d0d71cf" Mar 16 16:11:09 crc kubenswrapper[5120]: I0316 16:11:09.498235 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d99d3c3ccd7eb8662aa4384f2a00d1628523e332ebbb62bc1c5d78624d0d71cf"} err="failed to get container status \"d99d3c3ccd7eb8662aa4384f2a00d1628523e332ebbb62bc1c5d78624d0d71cf\": rpc error: code = NotFound desc = could not find container \"d99d3c3ccd7eb8662aa4384f2a00d1628523e332ebbb62bc1c5d78624d0d71cf\": container with ID starting with d99d3c3ccd7eb8662aa4384f2a00d1628523e332ebbb62bc1c5d78624d0d71cf not found: ID does not exist" Mar 16 16:11:09 crc kubenswrapper[5120]: I0316 16:11:09.498259 5120 scope.go:117] "RemoveContainer" containerID="90e6f0797e479ce88727e0250b689b32909d507152efba7cad3cd8e3f840b0ba" Mar 16 16:11:09 crc kubenswrapper[5120]: I0316 16:11:09.498607 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90e6f0797e479ce88727e0250b689b32909d507152efba7cad3cd8e3f840b0ba"} err="failed to get container status \"90e6f0797e479ce88727e0250b689b32909d507152efba7cad3cd8e3f840b0ba\": rpc error: code = NotFound desc = could not find container \"90e6f0797e479ce88727e0250b689b32909d507152efba7cad3cd8e3f840b0ba\": container with ID starting with 90e6f0797e479ce88727e0250b689b32909d507152efba7cad3cd8e3f840b0ba not found: ID does not exist" Mar 16 16:11:09 crc kubenswrapper[5120]: I0316 16:11:09.498638 5120 scope.go:117] "RemoveContainer" containerID="f6bc59b3e9a8ce19eda2001f4a87e24a4f1a6a99a64e6fa5dbf5e99c269cb8ff" Mar 16 16:11:09 crc kubenswrapper[5120]: I0316 16:11:09.499064 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6bc59b3e9a8ce19eda2001f4a87e24a4f1a6a99a64e6fa5dbf5e99c269cb8ff"} err="failed to get container status \"f6bc59b3e9a8ce19eda2001f4a87e24a4f1a6a99a64e6fa5dbf5e99c269cb8ff\": rpc error: code = NotFound desc = could not find container \"f6bc59b3e9a8ce19eda2001f4a87e24a4f1a6a99a64e6fa5dbf5e99c269cb8ff\": container with ID starting with f6bc59b3e9a8ce19eda2001f4a87e24a4f1a6a99a64e6fa5dbf5e99c269cb8ff not found: ID does not exist" Mar 16 16:11:09 crc kubenswrapper[5120]: I0316 16:11:09.499115 5120 scope.go:117] "RemoveContainer" containerID="daea0af5a03868b69a4267a30574934b11d985068c01f22136a936b2dc4ece31" Mar 16 16:11:09 crc kubenswrapper[5120]: I0316 16:11:09.499453 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"daea0af5a03868b69a4267a30574934b11d985068c01f22136a936b2dc4ece31"} err="failed to get container status \"daea0af5a03868b69a4267a30574934b11d985068c01f22136a936b2dc4ece31\": rpc error: code = NotFound desc = could not find container \"daea0af5a03868b69a4267a30574934b11d985068c01f22136a936b2dc4ece31\": container with ID starting with daea0af5a03868b69a4267a30574934b11d985068c01f22136a936b2dc4ece31 not found: ID does not exist" Mar 16 16:11:09 crc kubenswrapper[5120]: I0316 16:11:09.499481 5120 scope.go:117] "RemoveContainer" containerID="d99d3c3ccd7eb8662aa4384f2a00d1628523e332ebbb62bc1c5d78624d0d71cf" Mar 16 16:11:09 crc kubenswrapper[5120]: I0316 16:11:09.499843 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d99d3c3ccd7eb8662aa4384f2a00d1628523e332ebbb62bc1c5d78624d0d71cf"} err="failed to get container status \"d99d3c3ccd7eb8662aa4384f2a00d1628523e332ebbb62bc1c5d78624d0d71cf\": rpc error: code = NotFound desc = could not find container \"d99d3c3ccd7eb8662aa4384f2a00d1628523e332ebbb62bc1c5d78624d0d71cf\": container with ID starting with d99d3c3ccd7eb8662aa4384f2a00d1628523e332ebbb62bc1c5d78624d0d71cf not found: ID does not exist" Mar 16 16:11:09 crc kubenswrapper[5120]: I0316 16:11:09.499866 5120 scope.go:117] "RemoveContainer" containerID="90e6f0797e479ce88727e0250b689b32909d507152efba7cad3cd8e3f840b0ba" Mar 16 16:11:09 crc kubenswrapper[5120]: I0316 16:11:09.500210 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90e6f0797e479ce88727e0250b689b32909d507152efba7cad3cd8e3f840b0ba"} err="failed to get container status \"90e6f0797e479ce88727e0250b689b32909d507152efba7cad3cd8e3f840b0ba\": rpc error: code = NotFound desc = could not find container \"90e6f0797e479ce88727e0250b689b32909d507152efba7cad3cd8e3f840b0ba\": container with ID starting with 90e6f0797e479ce88727e0250b689b32909d507152efba7cad3cd8e3f840b0ba not found: ID does not exist" Mar 16 16:11:09 crc kubenswrapper[5120]: I0316 16:11:09.500256 5120 scope.go:117] "RemoveContainer" containerID="f6bc59b3e9a8ce19eda2001f4a87e24a4f1a6a99a64e6fa5dbf5e99c269cb8ff" Mar 16 16:11:09 crc kubenswrapper[5120]: I0316 16:11:09.500601 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6bc59b3e9a8ce19eda2001f4a87e24a4f1a6a99a64e6fa5dbf5e99c269cb8ff"} err="failed to get container status \"f6bc59b3e9a8ce19eda2001f4a87e24a4f1a6a99a64e6fa5dbf5e99c269cb8ff\": rpc error: code = NotFound desc = could not find container \"f6bc59b3e9a8ce19eda2001f4a87e24a4f1a6a99a64e6fa5dbf5e99c269cb8ff\": container with ID starting with f6bc59b3e9a8ce19eda2001f4a87e24a4f1a6a99a64e6fa5dbf5e99c269cb8ff not found: ID does not exist" Mar 16 16:11:09 crc kubenswrapper[5120]: I0316 16:11:09.500627 5120 scope.go:117] "RemoveContainer" containerID="daea0af5a03868b69a4267a30574934b11d985068c01f22136a936b2dc4ece31" Mar 16 16:11:09 crc kubenswrapper[5120]: I0316 16:11:09.500972 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"daea0af5a03868b69a4267a30574934b11d985068c01f22136a936b2dc4ece31"} err="failed to get container status \"daea0af5a03868b69a4267a30574934b11d985068c01f22136a936b2dc4ece31\": rpc error: code = NotFound desc = could not find container \"daea0af5a03868b69a4267a30574934b11d985068c01f22136a936b2dc4ece31\": container with ID starting with daea0af5a03868b69a4267a30574934b11d985068c01f22136a936b2dc4ece31 not found: ID does not exist" Mar 16 16:11:09 crc kubenswrapper[5120]: I0316 16:11:09.500997 5120 scope.go:117] "RemoveContainer" containerID="d99d3c3ccd7eb8662aa4384f2a00d1628523e332ebbb62bc1c5d78624d0d71cf" Mar 16 16:11:09 crc kubenswrapper[5120]: I0316 16:11:09.501244 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d99d3c3ccd7eb8662aa4384f2a00d1628523e332ebbb62bc1c5d78624d0d71cf"} err="failed to get container status \"d99d3c3ccd7eb8662aa4384f2a00d1628523e332ebbb62bc1c5d78624d0d71cf\": rpc error: code = NotFound desc = could not find container \"d99d3c3ccd7eb8662aa4384f2a00d1628523e332ebbb62bc1c5d78624d0d71cf\": container with ID starting with d99d3c3ccd7eb8662aa4384f2a00d1628523e332ebbb62bc1c5d78624d0d71cf not found: ID does not exist" Mar 16 16:11:09 crc kubenswrapper[5120]: I0316 16:11:09.501275 5120 scope.go:117] "RemoveContainer" containerID="90e6f0797e479ce88727e0250b689b32909d507152efba7cad3cd8e3f840b0ba" Mar 16 16:11:09 crc kubenswrapper[5120]: I0316 16:11:09.501529 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90e6f0797e479ce88727e0250b689b32909d507152efba7cad3cd8e3f840b0ba"} err="failed to get container status \"90e6f0797e479ce88727e0250b689b32909d507152efba7cad3cd8e3f840b0ba\": rpc error: code = NotFound desc = could not find container \"90e6f0797e479ce88727e0250b689b32909d507152efba7cad3cd8e3f840b0ba\": container with ID starting with 90e6f0797e479ce88727e0250b689b32909d507152efba7cad3cd8e3f840b0ba not found: ID does not exist" Mar 16 16:11:09 crc kubenswrapper[5120]: I0316 16:11:09.501561 5120 scope.go:117] "RemoveContainer" containerID="f6bc59b3e9a8ce19eda2001f4a87e24a4f1a6a99a64e6fa5dbf5e99c269cb8ff" Mar 16 16:11:09 crc kubenswrapper[5120]: I0316 16:11:09.501984 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6bc59b3e9a8ce19eda2001f4a87e24a4f1a6a99a64e6fa5dbf5e99c269cb8ff"} err="failed to get container status \"f6bc59b3e9a8ce19eda2001f4a87e24a4f1a6a99a64e6fa5dbf5e99c269cb8ff\": rpc error: code = NotFound desc = could not find container \"f6bc59b3e9a8ce19eda2001f4a87e24a4f1a6a99a64e6fa5dbf5e99c269cb8ff\": container with ID starting with f6bc59b3e9a8ce19eda2001f4a87e24a4f1a6a99a64e6fa5dbf5e99c269cb8ff not found: ID does not exist" Mar 16 16:11:09 crc kubenswrapper[5120]: I0316 16:11:09.502008 5120 scope.go:117] "RemoveContainer" containerID="daea0af5a03868b69a4267a30574934b11d985068c01f22136a936b2dc4ece31" Mar 16 16:11:09 crc kubenswrapper[5120]: I0316 16:11:09.502314 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"daea0af5a03868b69a4267a30574934b11d985068c01f22136a936b2dc4ece31"} err="failed to get container status \"daea0af5a03868b69a4267a30574934b11d985068c01f22136a936b2dc4ece31\": rpc error: code = NotFound desc = could not find container \"daea0af5a03868b69a4267a30574934b11d985068c01f22136a936b2dc4ece31\": container with ID starting with daea0af5a03868b69a4267a30574934b11d985068c01f22136a936b2dc4ece31 not found: ID does not exist" Mar 16 16:11:09 crc kubenswrapper[5120]: I0316 16:11:09.557893 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ad786ce6-f0e7-4a07-8d35-7972b6b76bae-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:11:09 crc kubenswrapper[5120]: I0316 16:11:09.753290 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:11:09 crc kubenswrapper[5120]: I0316 16:11:09.773574 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:11:09 crc kubenswrapper[5120]: I0316 16:11:09.794335 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:11:09 crc kubenswrapper[5120]: I0316 16:11:09.795370 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad786ce6-f0e7-4a07-8d35-7972b6b76bae" containerName="ceilometer-notification-agent" Mar 16 16:11:09 crc kubenswrapper[5120]: I0316 16:11:09.795394 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad786ce6-f0e7-4a07-8d35-7972b6b76bae" containerName="ceilometer-notification-agent" Mar 16 16:11:09 crc kubenswrapper[5120]: I0316 16:11:09.795423 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad786ce6-f0e7-4a07-8d35-7972b6b76bae" containerName="ceilometer-central-agent" Mar 16 16:11:09 crc kubenswrapper[5120]: I0316 16:11:09.795431 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad786ce6-f0e7-4a07-8d35-7972b6b76bae" containerName="ceilometer-central-agent" Mar 16 16:11:09 crc kubenswrapper[5120]: I0316 16:11:09.795452 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad786ce6-f0e7-4a07-8d35-7972b6b76bae" containerName="sg-core" Mar 16 16:11:09 crc kubenswrapper[5120]: I0316 16:11:09.795458 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad786ce6-f0e7-4a07-8d35-7972b6b76bae" containerName="sg-core" Mar 16 16:11:09 crc kubenswrapper[5120]: I0316 16:11:09.795479 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad786ce6-f0e7-4a07-8d35-7972b6b76bae" containerName="proxy-httpd" Mar 16 16:11:09 crc kubenswrapper[5120]: I0316 16:11:09.795485 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad786ce6-f0e7-4a07-8d35-7972b6b76bae" containerName="proxy-httpd" Mar 16 16:11:09 crc kubenswrapper[5120]: I0316 16:11:09.795645 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ad786ce6-f0e7-4a07-8d35-7972b6b76bae" containerName="ceilometer-central-agent" Mar 16 16:11:09 crc kubenswrapper[5120]: I0316 16:11:09.795658 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ad786ce6-f0e7-4a07-8d35-7972b6b76bae" containerName="proxy-httpd" Mar 16 16:11:09 crc kubenswrapper[5120]: I0316 16:11:09.795675 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ad786ce6-f0e7-4a07-8d35-7972b6b76bae" containerName="ceilometer-notification-agent" Mar 16 16:11:09 crc kubenswrapper[5120]: I0316 16:11:09.795684 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ad786ce6-f0e7-4a07-8d35-7972b6b76bae" containerName="sg-core" Mar 16 16:11:09 crc kubenswrapper[5120]: I0316 16:11:09.807128 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:11:09 crc kubenswrapper[5120]: I0316 16:11:09.811156 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 16:11:09 crc kubenswrapper[5120]: I0316 16:11:09.811470 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ceilometer-internal-svc\"" Mar 16 16:11:09 crc kubenswrapper[5120]: I0316 16:11:09.812088 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 16:11:09 crc kubenswrapper[5120]: I0316 16:11:09.817414 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:11:09 crc kubenswrapper[5120]: I0316 16:11:09.975818 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ea333be7-b49f-446b-9c1c-f7c538731523-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"ea333be7-b49f-446b-9c1c-f7c538731523\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:11:09 crc kubenswrapper[5120]: I0316 16:11:09.976049 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ea333be7-b49f-446b-9c1c-f7c538731523-run-httpd\") pod \"ceilometer-0\" (UID: \"ea333be7-b49f-446b-9c1c-f7c538731523\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:11:09 crc kubenswrapper[5120]: I0316 16:11:09.976208 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ea333be7-b49f-446b-9c1c-f7c538731523-config-data\") pod \"ceilometer-0\" (UID: \"ea333be7-b49f-446b-9c1c-f7c538731523\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:11:09 crc kubenswrapper[5120]: I0316 16:11:09.976274 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/ea333be7-b49f-446b-9c1c-f7c538731523-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"ea333be7-b49f-446b-9c1c-f7c538731523\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:11:09 crc kubenswrapper[5120]: I0316 16:11:09.976618 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ea333be7-b49f-446b-9c1c-f7c538731523-scripts\") pod \"ceilometer-0\" (UID: \"ea333be7-b49f-446b-9c1c-f7c538731523\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:11:09 crc kubenswrapper[5120]: I0316 16:11:09.977130 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ea333be7-b49f-446b-9c1c-f7c538731523-log-httpd\") pod \"ceilometer-0\" (UID: \"ea333be7-b49f-446b-9c1c-f7c538731523\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:11:09 crc kubenswrapper[5120]: I0316 16:11:09.977236 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-blvth\" (UniqueName: \"kubernetes.io/projected/ea333be7-b49f-446b-9c1c-f7c538731523-kube-api-access-blvth\") pod \"ceilometer-0\" (UID: \"ea333be7-b49f-446b-9c1c-f7c538731523\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:11:09 crc kubenswrapper[5120]: I0316 16:11:09.977328 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/ea333be7-b49f-446b-9c1c-f7c538731523-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"ea333be7-b49f-446b-9c1c-f7c538731523\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:11:10 crc kubenswrapper[5120]: I0316 16:11:10.079569 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ea333be7-b49f-446b-9c1c-f7c538731523-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"ea333be7-b49f-446b-9c1c-f7c538731523\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:11:10 crc kubenswrapper[5120]: I0316 16:11:10.079708 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ea333be7-b49f-446b-9c1c-f7c538731523-run-httpd\") pod \"ceilometer-0\" (UID: \"ea333be7-b49f-446b-9c1c-f7c538731523\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:11:10 crc kubenswrapper[5120]: I0316 16:11:10.080049 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ea333be7-b49f-446b-9c1c-f7c538731523-config-data\") pod \"ceilometer-0\" (UID: \"ea333be7-b49f-446b-9c1c-f7c538731523\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:11:10 crc kubenswrapper[5120]: I0316 16:11:10.080107 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/ea333be7-b49f-446b-9c1c-f7c538731523-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"ea333be7-b49f-446b-9c1c-f7c538731523\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:11:10 crc kubenswrapper[5120]: I0316 16:11:10.080263 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ea333be7-b49f-446b-9c1c-f7c538731523-scripts\") pod \"ceilometer-0\" (UID: \"ea333be7-b49f-446b-9c1c-f7c538731523\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:11:10 crc kubenswrapper[5120]: I0316 16:11:10.080442 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ea333be7-b49f-446b-9c1c-f7c538731523-log-httpd\") pod \"ceilometer-0\" (UID: \"ea333be7-b49f-446b-9c1c-f7c538731523\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:11:10 crc kubenswrapper[5120]: I0316 16:11:10.080475 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-blvth\" (UniqueName: \"kubernetes.io/projected/ea333be7-b49f-446b-9c1c-f7c538731523-kube-api-access-blvth\") pod \"ceilometer-0\" (UID: \"ea333be7-b49f-446b-9c1c-f7c538731523\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:11:10 crc kubenswrapper[5120]: I0316 16:11:10.080537 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/ea333be7-b49f-446b-9c1c-f7c538731523-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"ea333be7-b49f-446b-9c1c-f7c538731523\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:11:10 crc kubenswrapper[5120]: I0316 16:11:10.082843 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ea333be7-b49f-446b-9c1c-f7c538731523-log-httpd\") pod \"ceilometer-0\" (UID: \"ea333be7-b49f-446b-9c1c-f7c538731523\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:11:10 crc kubenswrapper[5120]: I0316 16:11:10.083052 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ea333be7-b49f-446b-9c1c-f7c538731523-run-httpd\") pod \"ceilometer-0\" (UID: \"ea333be7-b49f-446b-9c1c-f7c538731523\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:11:10 crc kubenswrapper[5120]: I0316 16:11:10.086153 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/ea333be7-b49f-446b-9c1c-f7c538731523-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"ea333be7-b49f-446b-9c1c-f7c538731523\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:11:10 crc kubenswrapper[5120]: I0316 16:11:10.090372 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ea333be7-b49f-446b-9c1c-f7c538731523-config-data\") pod \"ceilometer-0\" (UID: \"ea333be7-b49f-446b-9c1c-f7c538731523\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:11:10 crc kubenswrapper[5120]: I0316 16:11:10.091658 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ea333be7-b49f-446b-9c1c-f7c538731523-scripts\") pod \"ceilometer-0\" (UID: \"ea333be7-b49f-446b-9c1c-f7c538731523\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:11:10 crc kubenswrapper[5120]: I0316 16:11:10.091857 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ea333be7-b49f-446b-9c1c-f7c538731523-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"ea333be7-b49f-446b-9c1c-f7c538731523\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:11:10 crc kubenswrapper[5120]: I0316 16:11:10.093328 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/ea333be7-b49f-446b-9c1c-f7c538731523-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"ea333be7-b49f-446b-9c1c-f7c538731523\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:11:10 crc kubenswrapper[5120]: I0316 16:11:10.105439 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-blvth\" (UniqueName: \"kubernetes.io/projected/ea333be7-b49f-446b-9c1c-f7c538731523-kube-api-access-blvth\") pod \"ceilometer-0\" (UID: \"ea333be7-b49f-446b-9c1c-f7c538731523\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:11:10 crc kubenswrapper[5120]: I0316 16:11:10.134455 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:11:10 crc kubenswrapper[5120]: I0316 16:11:10.657734 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:11:10 crc kubenswrapper[5120]: I0316 16:11:10.682301 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ad786ce6-f0e7-4a07-8d35-7972b6b76bae" path="/var/lib/kubelet/pods/ad786ce6-f0e7-4a07-8d35-7972b6b76bae/volumes" Mar 16 16:11:11 crc kubenswrapper[5120]: I0316 16:11:11.424995 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ea333be7-b49f-446b-9c1c-f7c538731523","Type":"ContainerStarted","Data":"55ce353d6a8518607d6830f49878df64aff34c5acbd20679e5581433ff056336"} Mar 16 16:11:11 crc kubenswrapper[5120]: I0316 16:11:11.425040 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ea333be7-b49f-446b-9c1c-f7c538731523","Type":"ContainerStarted","Data":"25834ff30ca8b5874d31efc301bf104aa27c6227a9d4fb79c34fb014635831d8"} Mar 16 16:11:12 crc kubenswrapper[5120]: I0316 16:11:12.439138 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ea333be7-b49f-446b-9c1c-f7c538731523","Type":"ContainerStarted","Data":"3fda142fc9e38b9e4f20fb452296b328ade551384a9581f9ee8f94fdcc898382"} Mar 16 16:11:13 crc kubenswrapper[5120]: I0316 16:11:13.451262 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ea333be7-b49f-446b-9c1c-f7c538731523","Type":"ContainerStarted","Data":"7dcb41eedd2287e418500866f49c86f0302b137b182a1dc21742e0720e3d0e7a"} Mar 16 16:11:13 crc kubenswrapper[5120]: I0316 16:11:13.664969 5120 scope.go:117] "RemoveContainer" containerID="bc2df124cc6ad146d7c7dd2115ac815986fb62978d38895f6d345a4a9b14dbd8" Mar 16 16:11:13 crc kubenswrapper[5120]: E0316 16:11:13.665431 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:11:14 crc kubenswrapper[5120]: I0316 16:11:14.699531 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:11:14 crc kubenswrapper[5120]: I0316 16:11:14.700491 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:11:15 crc kubenswrapper[5120]: I0316 16:11:15.485270 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ea333be7-b49f-446b-9c1c-f7c538731523","Type":"ContainerStarted","Data":"81bfa47e99a4ff0b06d1d87f88486430467c0459105dd9da4f44ca9a3fbf2b31"} Mar 16 16:11:15 crc kubenswrapper[5120]: I0316 16:11:15.485699 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:11:15 crc kubenswrapper[5120]: I0316 16:11:15.527626 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.512955702 podStartE2EDuration="6.527605044s" podCreationTimestamp="2026-03-16 16:11:09 +0000 UTC" firstStartedPulling="2026-03-16 16:11:10.667543023 +0000 UTC m=+2372.821474680" lastFinishedPulling="2026-03-16 16:11:14.682192345 +0000 UTC m=+2376.836124022" observedRunningTime="2026-03-16 16:11:15.508386273 +0000 UTC m=+2377.662317940" watchObservedRunningTime="2026-03-16 16:11:15.527605044 +0000 UTC m=+2377.681536711" Mar 16 16:11:15 crc kubenswrapper[5120]: I0316 16:11:15.684934 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="a4afa8e8-c485-4903-b53b-864c0517374e" containerName="nova-api-api" probeResult="failure" output="Get \"https://10.217.0.139:8774/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Mar 16 16:11:15 crc kubenswrapper[5120]: I0316 16:11:15.685225 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="a4afa8e8-c485-4903-b53b-864c0517374e" containerName="nova-api-log" probeResult="failure" output="Get \"https://10.217.0.139:8774/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Mar 16 16:11:22 crc kubenswrapper[5120]: I0316 16:11:22.674943 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:11:22 crc kubenswrapper[5120]: I0316 16:11:22.675408 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:11:24 crc kubenswrapper[5120]: I0316 16:11:24.683907 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:11:24 crc kubenswrapper[5120]: I0316 16:11:24.685459 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:11:24 crc kubenswrapper[5120]: I0316 16:11:24.703323 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:11:25 crc kubenswrapper[5120]: I0316 16:11:25.604623 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:11:27 crc kubenswrapper[5120]: I0316 16:11:27.663506 5120 scope.go:117] "RemoveContainer" containerID="bc2df124cc6ad146d7c7dd2115ac815986fb62978d38895f6d345a4a9b14dbd8" Mar 16 16:11:27 crc kubenswrapper[5120]: E0316 16:11:27.663880 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:11:40 crc kubenswrapper[5120]: I0316 16:11:40.682088 5120 scope.go:117] "RemoveContainer" containerID="bc2df124cc6ad146d7c7dd2115ac815986fb62978d38895f6d345a4a9b14dbd8" Mar 16 16:11:40 crc kubenswrapper[5120]: E0316 16:11:40.683122 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:11:43 crc kubenswrapper[5120]: I0316 16:11:43.291868 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-v822j_ac55471d-4e42-475f-a082-50f611571482/kube-multus/0.log" Mar 16 16:11:43 crc kubenswrapper[5120]: I0316 16:11:43.295290 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-v822j_ac55471d-4e42-475f-a082-50f611571482/kube-multus/0.log" Mar 16 16:11:43 crc kubenswrapper[5120]: I0316 16:11:43.297300 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-crc_9f0bc7fcb0822a2c13eb2d22cd8c0641/kube-controller-manager/0.log" Mar 16 16:11:43 crc kubenswrapper[5120]: I0316 16:11:43.301134 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-crc_9f0bc7fcb0822a2c13eb2d22cd8c0641/kube-controller-manager/0.log" Mar 16 16:11:46 crc kubenswrapper[5120]: I0316 16:11:46.509541 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:11:51 crc kubenswrapper[5120]: I0316 16:11:51.664129 5120 scope.go:117] "RemoveContainer" containerID="bc2df124cc6ad146d7c7dd2115ac815986fb62978d38895f6d345a4a9b14dbd8" Mar 16 16:11:51 crc kubenswrapper[5120]: E0316 16:11:51.665203 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:11:52 crc kubenswrapper[5120]: I0316 16:11:52.692135 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-6fdfb9ff54-xgv7p"] Mar 16 16:11:52 crc kubenswrapper[5120]: I0316 16:11:52.704433 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-6fdfb9ff54-xgv7p" Mar 16 16:11:52 crc kubenswrapper[5120]: I0316 16:11:52.709355 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-6fdfb9ff54-xgv7p"] Mar 16 16:11:52 crc kubenswrapper[5120]: I0316 16:11:52.783204 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/cfa04300-3658-439c-bbe6-7971cb7ca630-logs\") pod \"placement-6fdfb9ff54-xgv7p\" (UID: \"cfa04300-3658-439c-bbe6-7971cb7ca630\") " pod="openstack-kuttl-tests/placement-6fdfb9ff54-xgv7p" Mar 16 16:11:52 crc kubenswrapper[5120]: I0316 16:11:52.783280 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6lr4k\" (UniqueName: \"kubernetes.io/projected/cfa04300-3658-439c-bbe6-7971cb7ca630-kube-api-access-6lr4k\") pod \"placement-6fdfb9ff54-xgv7p\" (UID: \"cfa04300-3658-439c-bbe6-7971cb7ca630\") " pod="openstack-kuttl-tests/placement-6fdfb9ff54-xgv7p" Mar 16 16:11:52 crc kubenswrapper[5120]: I0316 16:11:52.783691 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/cfa04300-3658-439c-bbe6-7971cb7ca630-internal-tls-certs\") pod \"placement-6fdfb9ff54-xgv7p\" (UID: \"cfa04300-3658-439c-bbe6-7971cb7ca630\") " pod="openstack-kuttl-tests/placement-6fdfb9ff54-xgv7p" Mar 16 16:11:52 crc kubenswrapper[5120]: I0316 16:11:52.783890 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cfa04300-3658-439c-bbe6-7971cb7ca630-config-data\") pod \"placement-6fdfb9ff54-xgv7p\" (UID: \"cfa04300-3658-439c-bbe6-7971cb7ca630\") " pod="openstack-kuttl-tests/placement-6fdfb9ff54-xgv7p" Mar 16 16:11:52 crc kubenswrapper[5120]: I0316 16:11:52.784167 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/cfa04300-3658-439c-bbe6-7971cb7ca630-scripts\") pod \"placement-6fdfb9ff54-xgv7p\" (UID: \"cfa04300-3658-439c-bbe6-7971cb7ca630\") " pod="openstack-kuttl-tests/placement-6fdfb9ff54-xgv7p" Mar 16 16:11:52 crc kubenswrapper[5120]: I0316 16:11:52.784312 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/cfa04300-3658-439c-bbe6-7971cb7ca630-public-tls-certs\") pod \"placement-6fdfb9ff54-xgv7p\" (UID: \"cfa04300-3658-439c-bbe6-7971cb7ca630\") " pod="openstack-kuttl-tests/placement-6fdfb9ff54-xgv7p" Mar 16 16:11:52 crc kubenswrapper[5120]: I0316 16:11:52.784340 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cfa04300-3658-439c-bbe6-7971cb7ca630-combined-ca-bundle\") pod \"placement-6fdfb9ff54-xgv7p\" (UID: \"cfa04300-3658-439c-bbe6-7971cb7ca630\") " pod="openstack-kuttl-tests/placement-6fdfb9ff54-xgv7p" Mar 16 16:11:52 crc kubenswrapper[5120]: I0316 16:11:52.886622 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cfa04300-3658-439c-bbe6-7971cb7ca630-config-data\") pod \"placement-6fdfb9ff54-xgv7p\" (UID: \"cfa04300-3658-439c-bbe6-7971cb7ca630\") " pod="openstack-kuttl-tests/placement-6fdfb9ff54-xgv7p" Mar 16 16:11:52 crc kubenswrapper[5120]: I0316 16:11:52.886997 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/cfa04300-3658-439c-bbe6-7971cb7ca630-scripts\") pod \"placement-6fdfb9ff54-xgv7p\" (UID: \"cfa04300-3658-439c-bbe6-7971cb7ca630\") " pod="openstack-kuttl-tests/placement-6fdfb9ff54-xgv7p" Mar 16 16:11:52 crc kubenswrapper[5120]: I0316 16:11:52.887043 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/cfa04300-3658-439c-bbe6-7971cb7ca630-public-tls-certs\") pod \"placement-6fdfb9ff54-xgv7p\" (UID: \"cfa04300-3658-439c-bbe6-7971cb7ca630\") " pod="openstack-kuttl-tests/placement-6fdfb9ff54-xgv7p" Mar 16 16:11:52 crc kubenswrapper[5120]: I0316 16:11:52.887061 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cfa04300-3658-439c-bbe6-7971cb7ca630-combined-ca-bundle\") pod \"placement-6fdfb9ff54-xgv7p\" (UID: \"cfa04300-3658-439c-bbe6-7971cb7ca630\") " pod="openstack-kuttl-tests/placement-6fdfb9ff54-xgv7p" Mar 16 16:11:52 crc kubenswrapper[5120]: I0316 16:11:52.887107 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/cfa04300-3658-439c-bbe6-7971cb7ca630-logs\") pod \"placement-6fdfb9ff54-xgv7p\" (UID: \"cfa04300-3658-439c-bbe6-7971cb7ca630\") " pod="openstack-kuttl-tests/placement-6fdfb9ff54-xgv7p" Mar 16 16:11:52 crc kubenswrapper[5120]: I0316 16:11:52.887147 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6lr4k\" (UniqueName: \"kubernetes.io/projected/cfa04300-3658-439c-bbe6-7971cb7ca630-kube-api-access-6lr4k\") pod \"placement-6fdfb9ff54-xgv7p\" (UID: \"cfa04300-3658-439c-bbe6-7971cb7ca630\") " pod="openstack-kuttl-tests/placement-6fdfb9ff54-xgv7p" Mar 16 16:11:52 crc kubenswrapper[5120]: I0316 16:11:52.887245 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/cfa04300-3658-439c-bbe6-7971cb7ca630-internal-tls-certs\") pod \"placement-6fdfb9ff54-xgv7p\" (UID: \"cfa04300-3658-439c-bbe6-7971cb7ca630\") " pod="openstack-kuttl-tests/placement-6fdfb9ff54-xgv7p" Mar 16 16:11:52 crc kubenswrapper[5120]: I0316 16:11:52.888213 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/cfa04300-3658-439c-bbe6-7971cb7ca630-logs\") pod \"placement-6fdfb9ff54-xgv7p\" (UID: \"cfa04300-3658-439c-bbe6-7971cb7ca630\") " pod="openstack-kuttl-tests/placement-6fdfb9ff54-xgv7p" Mar 16 16:11:52 crc kubenswrapper[5120]: I0316 16:11:52.892929 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/cfa04300-3658-439c-bbe6-7971cb7ca630-internal-tls-certs\") pod \"placement-6fdfb9ff54-xgv7p\" (UID: \"cfa04300-3658-439c-bbe6-7971cb7ca630\") " pod="openstack-kuttl-tests/placement-6fdfb9ff54-xgv7p" Mar 16 16:11:52 crc kubenswrapper[5120]: I0316 16:11:52.893192 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/cfa04300-3658-439c-bbe6-7971cb7ca630-scripts\") pod \"placement-6fdfb9ff54-xgv7p\" (UID: \"cfa04300-3658-439c-bbe6-7971cb7ca630\") " pod="openstack-kuttl-tests/placement-6fdfb9ff54-xgv7p" Mar 16 16:11:52 crc kubenswrapper[5120]: I0316 16:11:52.901927 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cfa04300-3658-439c-bbe6-7971cb7ca630-combined-ca-bundle\") pod \"placement-6fdfb9ff54-xgv7p\" (UID: \"cfa04300-3658-439c-bbe6-7971cb7ca630\") " pod="openstack-kuttl-tests/placement-6fdfb9ff54-xgv7p" Mar 16 16:11:52 crc kubenswrapper[5120]: I0316 16:11:52.902038 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cfa04300-3658-439c-bbe6-7971cb7ca630-config-data\") pod \"placement-6fdfb9ff54-xgv7p\" (UID: \"cfa04300-3658-439c-bbe6-7971cb7ca630\") " pod="openstack-kuttl-tests/placement-6fdfb9ff54-xgv7p" Mar 16 16:11:52 crc kubenswrapper[5120]: I0316 16:11:52.902107 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/cfa04300-3658-439c-bbe6-7971cb7ca630-public-tls-certs\") pod \"placement-6fdfb9ff54-xgv7p\" (UID: \"cfa04300-3658-439c-bbe6-7971cb7ca630\") " pod="openstack-kuttl-tests/placement-6fdfb9ff54-xgv7p" Mar 16 16:11:52 crc kubenswrapper[5120]: I0316 16:11:52.905028 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6lr4k\" (UniqueName: \"kubernetes.io/projected/cfa04300-3658-439c-bbe6-7971cb7ca630-kube-api-access-6lr4k\") pod \"placement-6fdfb9ff54-xgv7p\" (UID: \"cfa04300-3658-439c-bbe6-7971cb7ca630\") " pod="openstack-kuttl-tests/placement-6fdfb9ff54-xgv7p" Mar 16 16:11:53 crc kubenswrapper[5120]: I0316 16:11:53.030729 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-6fdfb9ff54-xgv7p" Mar 16 16:11:53 crc kubenswrapper[5120]: I0316 16:11:53.262958 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-6fdfb9ff54-xgv7p"] Mar 16 16:11:53 crc kubenswrapper[5120]: I0316 16:11:53.319351 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-6c44998f84-78gpn"] Mar 16 16:11:53 crc kubenswrapper[5120]: I0316 16:11:53.333976 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-6c44998f84-78gpn"] Mar 16 16:11:53 crc kubenswrapper[5120]: I0316 16:11:53.334196 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-6c44998f84-78gpn" Mar 16 16:11:53 crc kubenswrapper[5120]: I0316 16:11:53.503916 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fb47226c-c927-43f1-9028-cfdc5dcd2e89-config-data\") pod \"placement-6c44998f84-78gpn\" (UID: \"fb47226c-c927-43f1-9028-cfdc5dcd2e89\") " pod="openstack-kuttl-tests/placement-6c44998f84-78gpn" Mar 16 16:11:53 crc kubenswrapper[5120]: I0316 16:11:53.504062 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/fb47226c-c927-43f1-9028-cfdc5dcd2e89-internal-tls-certs\") pod \"placement-6c44998f84-78gpn\" (UID: \"fb47226c-c927-43f1-9028-cfdc5dcd2e89\") " pod="openstack-kuttl-tests/placement-6c44998f84-78gpn" Mar 16 16:11:53 crc kubenswrapper[5120]: I0316 16:11:53.504095 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/fb47226c-c927-43f1-9028-cfdc5dcd2e89-scripts\") pod \"placement-6c44998f84-78gpn\" (UID: \"fb47226c-c927-43f1-9028-cfdc5dcd2e89\") " pod="openstack-kuttl-tests/placement-6c44998f84-78gpn" Mar 16 16:11:53 crc kubenswrapper[5120]: I0316 16:11:53.504117 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4c227\" (UniqueName: \"kubernetes.io/projected/fb47226c-c927-43f1-9028-cfdc5dcd2e89-kube-api-access-4c227\") pod \"placement-6c44998f84-78gpn\" (UID: \"fb47226c-c927-43f1-9028-cfdc5dcd2e89\") " pod="openstack-kuttl-tests/placement-6c44998f84-78gpn" Mar 16 16:11:53 crc kubenswrapper[5120]: I0316 16:11:53.504216 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/fb47226c-c927-43f1-9028-cfdc5dcd2e89-public-tls-certs\") pod \"placement-6c44998f84-78gpn\" (UID: \"fb47226c-c927-43f1-9028-cfdc5dcd2e89\") " pod="openstack-kuttl-tests/placement-6c44998f84-78gpn" Mar 16 16:11:53 crc kubenswrapper[5120]: I0316 16:11:53.504331 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fb47226c-c927-43f1-9028-cfdc5dcd2e89-combined-ca-bundle\") pod \"placement-6c44998f84-78gpn\" (UID: \"fb47226c-c927-43f1-9028-cfdc5dcd2e89\") " pod="openstack-kuttl-tests/placement-6c44998f84-78gpn" Mar 16 16:11:53 crc kubenswrapper[5120]: I0316 16:11:53.504369 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/fb47226c-c927-43f1-9028-cfdc5dcd2e89-logs\") pod \"placement-6c44998f84-78gpn\" (UID: \"fb47226c-c927-43f1-9028-cfdc5dcd2e89\") " pod="openstack-kuttl-tests/placement-6c44998f84-78gpn" Mar 16 16:11:53 crc kubenswrapper[5120]: I0316 16:11:53.531831 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-6fdfb9ff54-xgv7p"] Mar 16 16:11:53 crc kubenswrapper[5120]: I0316 16:11:53.607080 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/fb47226c-c927-43f1-9028-cfdc5dcd2e89-internal-tls-certs\") pod \"placement-6c44998f84-78gpn\" (UID: \"fb47226c-c927-43f1-9028-cfdc5dcd2e89\") " pod="openstack-kuttl-tests/placement-6c44998f84-78gpn" Mar 16 16:11:53 crc kubenswrapper[5120]: I0316 16:11:53.607434 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/fb47226c-c927-43f1-9028-cfdc5dcd2e89-scripts\") pod \"placement-6c44998f84-78gpn\" (UID: \"fb47226c-c927-43f1-9028-cfdc5dcd2e89\") " pod="openstack-kuttl-tests/placement-6c44998f84-78gpn" Mar 16 16:11:53 crc kubenswrapper[5120]: I0316 16:11:53.607457 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4c227\" (UniqueName: \"kubernetes.io/projected/fb47226c-c927-43f1-9028-cfdc5dcd2e89-kube-api-access-4c227\") pod \"placement-6c44998f84-78gpn\" (UID: \"fb47226c-c927-43f1-9028-cfdc5dcd2e89\") " pod="openstack-kuttl-tests/placement-6c44998f84-78gpn" Mar 16 16:11:53 crc kubenswrapper[5120]: I0316 16:11:53.607477 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/fb47226c-c927-43f1-9028-cfdc5dcd2e89-public-tls-certs\") pod \"placement-6c44998f84-78gpn\" (UID: \"fb47226c-c927-43f1-9028-cfdc5dcd2e89\") " pod="openstack-kuttl-tests/placement-6c44998f84-78gpn" Mar 16 16:11:53 crc kubenswrapper[5120]: I0316 16:11:53.607511 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fb47226c-c927-43f1-9028-cfdc5dcd2e89-combined-ca-bundle\") pod \"placement-6c44998f84-78gpn\" (UID: \"fb47226c-c927-43f1-9028-cfdc5dcd2e89\") " pod="openstack-kuttl-tests/placement-6c44998f84-78gpn" Mar 16 16:11:53 crc kubenswrapper[5120]: I0316 16:11:53.607530 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/fb47226c-c927-43f1-9028-cfdc5dcd2e89-logs\") pod \"placement-6c44998f84-78gpn\" (UID: \"fb47226c-c927-43f1-9028-cfdc5dcd2e89\") " pod="openstack-kuttl-tests/placement-6c44998f84-78gpn" Mar 16 16:11:53 crc kubenswrapper[5120]: I0316 16:11:53.607751 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fb47226c-c927-43f1-9028-cfdc5dcd2e89-config-data\") pod \"placement-6c44998f84-78gpn\" (UID: \"fb47226c-c927-43f1-9028-cfdc5dcd2e89\") " pod="openstack-kuttl-tests/placement-6c44998f84-78gpn" Mar 16 16:11:53 crc kubenswrapper[5120]: I0316 16:11:53.609033 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/fb47226c-c927-43f1-9028-cfdc5dcd2e89-logs\") pod \"placement-6c44998f84-78gpn\" (UID: \"fb47226c-c927-43f1-9028-cfdc5dcd2e89\") " pod="openstack-kuttl-tests/placement-6c44998f84-78gpn" Mar 16 16:11:53 crc kubenswrapper[5120]: I0316 16:11:53.611820 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/fb47226c-c927-43f1-9028-cfdc5dcd2e89-internal-tls-certs\") pod \"placement-6c44998f84-78gpn\" (UID: \"fb47226c-c927-43f1-9028-cfdc5dcd2e89\") " pod="openstack-kuttl-tests/placement-6c44998f84-78gpn" Mar 16 16:11:53 crc kubenswrapper[5120]: I0316 16:11:53.612107 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/fb47226c-c927-43f1-9028-cfdc5dcd2e89-public-tls-certs\") pod \"placement-6c44998f84-78gpn\" (UID: \"fb47226c-c927-43f1-9028-cfdc5dcd2e89\") " pod="openstack-kuttl-tests/placement-6c44998f84-78gpn" Mar 16 16:11:53 crc kubenswrapper[5120]: I0316 16:11:53.612878 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fb47226c-c927-43f1-9028-cfdc5dcd2e89-combined-ca-bundle\") pod \"placement-6c44998f84-78gpn\" (UID: \"fb47226c-c927-43f1-9028-cfdc5dcd2e89\") " pod="openstack-kuttl-tests/placement-6c44998f84-78gpn" Mar 16 16:11:53 crc kubenswrapper[5120]: I0316 16:11:53.612988 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/fb47226c-c927-43f1-9028-cfdc5dcd2e89-scripts\") pod \"placement-6c44998f84-78gpn\" (UID: \"fb47226c-c927-43f1-9028-cfdc5dcd2e89\") " pod="openstack-kuttl-tests/placement-6c44998f84-78gpn" Mar 16 16:11:53 crc kubenswrapper[5120]: I0316 16:11:53.619390 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fb47226c-c927-43f1-9028-cfdc5dcd2e89-config-data\") pod \"placement-6c44998f84-78gpn\" (UID: \"fb47226c-c927-43f1-9028-cfdc5dcd2e89\") " pod="openstack-kuttl-tests/placement-6c44998f84-78gpn" Mar 16 16:11:53 crc kubenswrapper[5120]: I0316 16:11:53.634392 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4c227\" (UniqueName: \"kubernetes.io/projected/fb47226c-c927-43f1-9028-cfdc5dcd2e89-kube-api-access-4c227\") pod \"placement-6c44998f84-78gpn\" (UID: \"fb47226c-c927-43f1-9028-cfdc5dcd2e89\") " pod="openstack-kuttl-tests/placement-6c44998f84-78gpn" Mar 16 16:11:53 crc kubenswrapper[5120]: I0316 16:11:53.658665 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-6c44998f84-78gpn" Mar 16 16:11:53 crc kubenswrapper[5120]: I0316 16:11:53.932552 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-6fdfb9ff54-xgv7p" event={"ID":"cfa04300-3658-439c-bbe6-7971cb7ca630","Type":"ContainerStarted","Data":"47ad76eaa3ccef7852b7ae34bae358001bcc86331d5812ad7c12d1295a4daaec"} Mar 16 16:11:53 crc kubenswrapper[5120]: I0316 16:11:53.933025 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-6fdfb9ff54-xgv7p" event={"ID":"cfa04300-3658-439c-bbe6-7971cb7ca630","Type":"ContainerStarted","Data":"8363f575101e22de0d95b893104a031ccf322e274e7dd1e32654b94578ae2d8d"} Mar 16 16:11:54 crc kubenswrapper[5120]: I0316 16:11:54.069088 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:11:54 crc kubenswrapper[5120]: I0316 16:11:54.069403 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="70cb8e52-8e41-40dd-9988-d9aef87fadd6" containerName="glance-log" containerID="cri-o://07a4e9dbf0143df0475464b81a622cfeb916120ecf755e170ba1c70fb1ce953d" gracePeriod=30 Mar 16 16:11:54 crc kubenswrapper[5120]: I0316 16:11:54.069463 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="70cb8e52-8e41-40dd-9988-d9aef87fadd6" containerName="glance-httpd" containerID="cri-o://af2ce2874b2f1d01dd56d1c2b54cf07657cd9a5a00b4da8859b79d3b71d3c3db" gracePeriod=30 Mar 16 16:11:54 crc kubenswrapper[5120]: I0316 16:11:54.140065 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-6c44998f84-78gpn"] Mar 16 16:11:54 crc kubenswrapper[5120]: I0316 16:11:54.165864 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:11:54 crc kubenswrapper[5120]: I0316 16:11:54.166373 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="d7cb016a-477e-4e1d-9cea-b3308c3821ad" containerName="glance-log" containerID="cri-o://4dc7ce8bb329cfeb8f8033e6f81228b46afd17e26b66c1812301a3a2252a4437" gracePeriod=30 Mar 16 16:11:54 crc kubenswrapper[5120]: I0316 16:11:54.166431 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="d7cb016a-477e-4e1d-9cea-b3308c3821ad" containerName="glance-httpd" containerID="cri-o://0cfd497da29acd1fc4546472dd55ced91b08bd116de4265889cd689922d77e6a" gracePeriod=30 Mar 16 16:11:54 crc kubenswrapper[5120]: I0316 16:11:54.943813 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-6c44998f84-78gpn" event={"ID":"fb47226c-c927-43f1-9028-cfdc5dcd2e89","Type":"ContainerStarted","Data":"60324513292e67399e801c3f75048966767e12abc6a9079d9c7f31847ad746a3"} Mar 16 16:11:54 crc kubenswrapper[5120]: I0316 16:11:54.944224 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-6c44998f84-78gpn" event={"ID":"fb47226c-c927-43f1-9028-cfdc5dcd2e89","Type":"ContainerStarted","Data":"8b6fcf540a2852e7e2a452076d8c5ea6c757bd608aac9d175bb0875ea173bfc2"} Mar 16 16:11:54 crc kubenswrapper[5120]: I0316 16:11:54.944240 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-6c44998f84-78gpn" event={"ID":"fb47226c-c927-43f1-9028-cfdc5dcd2e89","Type":"ContainerStarted","Data":"e3b5a8f99e86cb0d0ca7fe8d81cc45cfa19bcef8bac1b218184f31e896aefdd2"} Mar 16 16:11:54 crc kubenswrapper[5120]: I0316 16:11:54.944400 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-6c44998f84-78gpn" Mar 16 16:11:54 crc kubenswrapper[5120]: I0316 16:11:54.946114 5120 generic.go:358] "Generic (PLEG): container finished" podID="70cb8e52-8e41-40dd-9988-d9aef87fadd6" containerID="07a4e9dbf0143df0475464b81a622cfeb916120ecf755e170ba1c70fb1ce953d" exitCode=143 Mar 16 16:11:54 crc kubenswrapper[5120]: I0316 16:11:54.946190 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"70cb8e52-8e41-40dd-9988-d9aef87fadd6","Type":"ContainerDied","Data":"07a4e9dbf0143df0475464b81a622cfeb916120ecf755e170ba1c70fb1ce953d"} Mar 16 16:11:54 crc kubenswrapper[5120]: I0316 16:11:54.948444 5120 generic.go:358] "Generic (PLEG): container finished" podID="d7cb016a-477e-4e1d-9cea-b3308c3821ad" containerID="4dc7ce8bb329cfeb8f8033e6f81228b46afd17e26b66c1812301a3a2252a4437" exitCode=143 Mar 16 16:11:54 crc kubenswrapper[5120]: I0316 16:11:54.948529 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"d7cb016a-477e-4e1d-9cea-b3308c3821ad","Type":"ContainerDied","Data":"4dc7ce8bb329cfeb8f8033e6f81228b46afd17e26b66c1812301a3a2252a4437"} Mar 16 16:11:54 crc kubenswrapper[5120]: I0316 16:11:54.950677 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-6fdfb9ff54-xgv7p" event={"ID":"cfa04300-3658-439c-bbe6-7971cb7ca630","Type":"ContainerStarted","Data":"536e844e2ac0e14a2d2b4a46e25020dba51a4cec2f2cc3ed78a929c820d50b21"} Mar 16 16:11:54 crc kubenswrapper[5120]: I0316 16:11:54.950826 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-6fdfb9ff54-xgv7p" podUID="cfa04300-3658-439c-bbe6-7971cb7ca630" containerName="placement-log" containerID="cri-o://47ad76eaa3ccef7852b7ae34bae358001bcc86331d5812ad7c12d1295a4daaec" gracePeriod=30 Mar 16 16:11:54 crc kubenswrapper[5120]: I0316 16:11:54.950881 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-6fdfb9ff54-xgv7p" Mar 16 16:11:54 crc kubenswrapper[5120]: I0316 16:11:54.950902 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-6fdfb9ff54-xgv7p" Mar 16 16:11:54 crc kubenswrapper[5120]: I0316 16:11:54.950893 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-6fdfb9ff54-xgv7p" podUID="cfa04300-3658-439c-bbe6-7971cb7ca630" containerName="placement-api" containerID="cri-o://536e844e2ac0e14a2d2b4a46e25020dba51a4cec2f2cc3ed78a929c820d50b21" gracePeriod=30 Mar 16 16:11:54 crc kubenswrapper[5120]: I0316 16:11:54.982926 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-6c44998f84-78gpn" podStartSLOduration=1.982909152 podStartE2EDuration="1.982909152s" podCreationTimestamp="2026-03-16 16:11:53 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:11:54.973880717 +0000 UTC m=+2417.127812374" watchObservedRunningTime="2026-03-16 16:11:54.982909152 +0000 UTC m=+2417.136840799" Mar 16 16:11:55 crc kubenswrapper[5120]: I0316 16:11:55.043143 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-6fdfb9ff54-xgv7p" podStartSLOduration=3.043122845 podStartE2EDuration="3.043122845s" podCreationTimestamp="2026-03-16 16:11:52 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:11:55.003548642 +0000 UTC m=+2417.157480299" watchObservedRunningTime="2026-03-16 16:11:55.043122845 +0000 UTC m=+2417.197054502" Mar 16 16:11:55 crc kubenswrapper[5120]: I0316 16:11:55.044432 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:11:55 crc kubenswrapper[5120]: I0316 16:11:55.044852 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="96650b1e-b94e-4f53-9fe6-7b45f224d366" containerName="probe" containerID="cri-o://016d7acb984498c2d879192f8a4e4df1aa89b0840d16269d8685afb1663e4fb3" gracePeriod=30 Mar 16 16:11:55 crc kubenswrapper[5120]: I0316 16:11:55.044798 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="96650b1e-b94e-4f53-9fe6-7b45f224d366" containerName="cinder-scheduler" containerID="cri-o://0785b4a9b254fac39873ffa5eac708f11945743fc473976a54d6afa7092e256e" gracePeriod=30 Mar 16 16:11:55 crc kubenswrapper[5120]: I0316 16:11:55.077618 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:11:55 crc kubenswrapper[5120]: I0316 16:11:55.077951 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="06f34d35-9700-4048-9f1a-e773e02efbd6" containerName="cinder-api-log" containerID="cri-o://8aea814127603d95cd34517e152cdf39284d9a351843f196cfaf6129c64a2a9d" gracePeriod=30 Mar 16 16:11:55 crc kubenswrapper[5120]: I0316 16:11:55.078122 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="06f34d35-9700-4048-9f1a-e773e02efbd6" containerName="cinder-api" containerID="cri-o://0e48369a2928b368bee18bb2e0e6fda041243ea298480650d5a5bbcc7df07b9b" gracePeriod=30 Mar 16 16:11:55 crc kubenswrapper[5120]: I0316 16:11:55.652075 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-6fdfb9ff54-xgv7p" Mar 16 16:11:55 crc kubenswrapper[5120]: I0316 16:11:55.761394 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cfa04300-3658-439c-bbe6-7971cb7ca630-combined-ca-bundle\") pod \"cfa04300-3658-439c-bbe6-7971cb7ca630\" (UID: \"cfa04300-3658-439c-bbe6-7971cb7ca630\") " Mar 16 16:11:55 crc kubenswrapper[5120]: I0316 16:11:55.761657 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/cfa04300-3658-439c-bbe6-7971cb7ca630-internal-tls-certs\") pod \"cfa04300-3658-439c-bbe6-7971cb7ca630\" (UID: \"cfa04300-3658-439c-bbe6-7971cb7ca630\") " Mar 16 16:11:55 crc kubenswrapper[5120]: I0316 16:11:55.761693 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/cfa04300-3658-439c-bbe6-7971cb7ca630-scripts\") pod \"cfa04300-3658-439c-bbe6-7971cb7ca630\" (UID: \"cfa04300-3658-439c-bbe6-7971cb7ca630\") " Mar 16 16:11:55 crc kubenswrapper[5120]: I0316 16:11:55.761824 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/cfa04300-3658-439c-bbe6-7971cb7ca630-logs\") pod \"cfa04300-3658-439c-bbe6-7971cb7ca630\" (UID: \"cfa04300-3658-439c-bbe6-7971cb7ca630\") " Mar 16 16:11:55 crc kubenswrapper[5120]: I0316 16:11:55.761952 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6lr4k\" (UniqueName: \"kubernetes.io/projected/cfa04300-3658-439c-bbe6-7971cb7ca630-kube-api-access-6lr4k\") pod \"cfa04300-3658-439c-bbe6-7971cb7ca630\" (UID: \"cfa04300-3658-439c-bbe6-7971cb7ca630\") " Mar 16 16:11:55 crc kubenswrapper[5120]: I0316 16:11:55.761981 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/cfa04300-3658-439c-bbe6-7971cb7ca630-public-tls-certs\") pod \"cfa04300-3658-439c-bbe6-7971cb7ca630\" (UID: \"cfa04300-3658-439c-bbe6-7971cb7ca630\") " Mar 16 16:11:55 crc kubenswrapper[5120]: I0316 16:11:55.763214 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cfa04300-3658-439c-bbe6-7971cb7ca630-logs" (OuterVolumeSpecName: "logs") pod "cfa04300-3658-439c-bbe6-7971cb7ca630" (UID: "cfa04300-3658-439c-bbe6-7971cb7ca630"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:11:55 crc kubenswrapper[5120]: I0316 16:11:55.765015 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cfa04300-3658-439c-bbe6-7971cb7ca630-config-data\") pod \"cfa04300-3658-439c-bbe6-7971cb7ca630\" (UID: \"cfa04300-3658-439c-bbe6-7971cb7ca630\") " Mar 16 16:11:55 crc kubenswrapper[5120]: I0316 16:11:55.766051 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/cfa04300-3658-439c-bbe6-7971cb7ca630-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:11:55 crc kubenswrapper[5120]: I0316 16:11:55.769922 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cfa04300-3658-439c-bbe6-7971cb7ca630-scripts" (OuterVolumeSpecName: "scripts") pod "cfa04300-3658-439c-bbe6-7971cb7ca630" (UID: "cfa04300-3658-439c-bbe6-7971cb7ca630"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:11:55 crc kubenswrapper[5120]: I0316 16:11:55.773128 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cfa04300-3658-439c-bbe6-7971cb7ca630-kube-api-access-6lr4k" (OuterVolumeSpecName: "kube-api-access-6lr4k") pod "cfa04300-3658-439c-bbe6-7971cb7ca630" (UID: "cfa04300-3658-439c-bbe6-7971cb7ca630"). InnerVolumeSpecName "kube-api-access-6lr4k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:11:55 crc kubenswrapper[5120]: I0316 16:11:55.817255 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cfa04300-3658-439c-bbe6-7971cb7ca630-config-data" (OuterVolumeSpecName: "config-data") pod "cfa04300-3658-439c-bbe6-7971cb7ca630" (UID: "cfa04300-3658-439c-bbe6-7971cb7ca630"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:11:55 crc kubenswrapper[5120]: I0316 16:11:55.838188 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cfa04300-3658-439c-bbe6-7971cb7ca630-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "cfa04300-3658-439c-bbe6-7971cb7ca630" (UID: "cfa04300-3658-439c-bbe6-7971cb7ca630"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:11:55 crc kubenswrapper[5120]: I0316 16:11:55.858100 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cfa04300-3658-439c-bbe6-7971cb7ca630-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "cfa04300-3658-439c-bbe6-7971cb7ca630" (UID: "cfa04300-3658-439c-bbe6-7971cb7ca630"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:11:55 crc kubenswrapper[5120]: I0316 16:11:55.862657 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cfa04300-3658-439c-bbe6-7971cb7ca630-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "cfa04300-3658-439c-bbe6-7971cb7ca630" (UID: "cfa04300-3658-439c-bbe6-7971cb7ca630"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:11:55 crc kubenswrapper[5120]: I0316 16:11:55.868123 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/cfa04300-3658-439c-bbe6-7971cb7ca630-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:11:55 crc kubenswrapper[5120]: I0316 16:11:55.868149 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/cfa04300-3658-439c-bbe6-7971cb7ca630-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:11:55 crc kubenswrapper[5120]: I0316 16:11:55.868159 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6lr4k\" (UniqueName: \"kubernetes.io/projected/cfa04300-3658-439c-bbe6-7971cb7ca630-kube-api-access-6lr4k\") on node \"crc\" DevicePath \"\"" Mar 16 16:11:55 crc kubenswrapper[5120]: I0316 16:11:55.868172 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/cfa04300-3658-439c-bbe6-7971cb7ca630-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:11:55 crc kubenswrapper[5120]: I0316 16:11:55.868180 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cfa04300-3658-439c-bbe6-7971cb7ca630-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:11:55 crc kubenswrapper[5120]: I0316 16:11:55.868188 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cfa04300-3658-439c-bbe6-7971cb7ca630-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:11:55 crc kubenswrapper[5120]: I0316 16:11:55.962415 5120 generic.go:358] "Generic (PLEG): container finished" podID="cfa04300-3658-439c-bbe6-7971cb7ca630" containerID="536e844e2ac0e14a2d2b4a46e25020dba51a4cec2f2cc3ed78a929c820d50b21" exitCode=0 Mar 16 16:11:55 crc kubenswrapper[5120]: I0316 16:11:55.962445 5120 generic.go:358] "Generic (PLEG): container finished" podID="cfa04300-3658-439c-bbe6-7971cb7ca630" containerID="47ad76eaa3ccef7852b7ae34bae358001bcc86331d5812ad7c12d1295a4daaec" exitCode=143 Mar 16 16:11:55 crc kubenswrapper[5120]: I0316 16:11:55.962468 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-6fdfb9ff54-xgv7p" event={"ID":"cfa04300-3658-439c-bbe6-7971cb7ca630","Type":"ContainerDied","Data":"536e844e2ac0e14a2d2b4a46e25020dba51a4cec2f2cc3ed78a929c820d50b21"} Mar 16 16:11:55 crc kubenswrapper[5120]: I0316 16:11:55.962515 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-6fdfb9ff54-xgv7p" Mar 16 16:11:55 crc kubenswrapper[5120]: I0316 16:11:55.962527 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-6fdfb9ff54-xgv7p" event={"ID":"cfa04300-3658-439c-bbe6-7971cb7ca630","Type":"ContainerDied","Data":"47ad76eaa3ccef7852b7ae34bae358001bcc86331d5812ad7c12d1295a4daaec"} Mar 16 16:11:55 crc kubenswrapper[5120]: I0316 16:11:55.962542 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-6fdfb9ff54-xgv7p" event={"ID":"cfa04300-3658-439c-bbe6-7971cb7ca630","Type":"ContainerDied","Data":"8363f575101e22de0d95b893104a031ccf322e274e7dd1e32654b94578ae2d8d"} Mar 16 16:11:55 crc kubenswrapper[5120]: I0316 16:11:55.962561 5120 scope.go:117] "RemoveContainer" containerID="536e844e2ac0e14a2d2b4a46e25020dba51a4cec2f2cc3ed78a929c820d50b21" Mar 16 16:11:55 crc kubenswrapper[5120]: I0316 16:11:55.965887 5120 generic.go:358] "Generic (PLEG): container finished" podID="06f34d35-9700-4048-9f1a-e773e02efbd6" containerID="8aea814127603d95cd34517e152cdf39284d9a351843f196cfaf6129c64a2a9d" exitCode=143 Mar 16 16:11:55 crc kubenswrapper[5120]: I0316 16:11:55.966197 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"06f34d35-9700-4048-9f1a-e773e02efbd6","Type":"ContainerDied","Data":"8aea814127603d95cd34517e152cdf39284d9a351843f196cfaf6129c64a2a9d"} Mar 16 16:11:55 crc kubenswrapper[5120]: I0316 16:11:55.966254 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-6c44998f84-78gpn" Mar 16 16:11:56 crc kubenswrapper[5120]: I0316 16:11:56.001966 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-6fdfb9ff54-xgv7p"] Mar 16 16:11:56 crc kubenswrapper[5120]: I0316 16:11:56.005625 5120 scope.go:117] "RemoveContainer" containerID="47ad76eaa3ccef7852b7ae34bae358001bcc86331d5812ad7c12d1295a4daaec" Mar 16 16:11:56 crc kubenswrapper[5120]: I0316 16:11:56.009600 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-6fdfb9ff54-xgv7p"] Mar 16 16:11:56 crc kubenswrapper[5120]: I0316 16:11:56.023095 5120 scope.go:117] "RemoveContainer" containerID="536e844e2ac0e14a2d2b4a46e25020dba51a4cec2f2cc3ed78a929c820d50b21" Mar 16 16:11:56 crc kubenswrapper[5120]: E0316 16:11:56.023597 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"536e844e2ac0e14a2d2b4a46e25020dba51a4cec2f2cc3ed78a929c820d50b21\": container with ID starting with 536e844e2ac0e14a2d2b4a46e25020dba51a4cec2f2cc3ed78a929c820d50b21 not found: ID does not exist" containerID="536e844e2ac0e14a2d2b4a46e25020dba51a4cec2f2cc3ed78a929c820d50b21" Mar 16 16:11:56 crc kubenswrapper[5120]: I0316 16:11:56.023660 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"536e844e2ac0e14a2d2b4a46e25020dba51a4cec2f2cc3ed78a929c820d50b21"} err="failed to get container status \"536e844e2ac0e14a2d2b4a46e25020dba51a4cec2f2cc3ed78a929c820d50b21\": rpc error: code = NotFound desc = could not find container \"536e844e2ac0e14a2d2b4a46e25020dba51a4cec2f2cc3ed78a929c820d50b21\": container with ID starting with 536e844e2ac0e14a2d2b4a46e25020dba51a4cec2f2cc3ed78a929c820d50b21 not found: ID does not exist" Mar 16 16:11:56 crc kubenswrapper[5120]: I0316 16:11:56.023686 5120 scope.go:117] "RemoveContainer" containerID="47ad76eaa3ccef7852b7ae34bae358001bcc86331d5812ad7c12d1295a4daaec" Mar 16 16:11:56 crc kubenswrapper[5120]: E0316 16:11:56.024033 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"47ad76eaa3ccef7852b7ae34bae358001bcc86331d5812ad7c12d1295a4daaec\": container with ID starting with 47ad76eaa3ccef7852b7ae34bae358001bcc86331d5812ad7c12d1295a4daaec not found: ID does not exist" containerID="47ad76eaa3ccef7852b7ae34bae358001bcc86331d5812ad7c12d1295a4daaec" Mar 16 16:11:56 crc kubenswrapper[5120]: I0316 16:11:56.024069 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47ad76eaa3ccef7852b7ae34bae358001bcc86331d5812ad7c12d1295a4daaec"} err="failed to get container status \"47ad76eaa3ccef7852b7ae34bae358001bcc86331d5812ad7c12d1295a4daaec\": rpc error: code = NotFound desc = could not find container \"47ad76eaa3ccef7852b7ae34bae358001bcc86331d5812ad7c12d1295a4daaec\": container with ID starting with 47ad76eaa3ccef7852b7ae34bae358001bcc86331d5812ad7c12d1295a4daaec not found: ID does not exist" Mar 16 16:11:56 crc kubenswrapper[5120]: I0316 16:11:56.024095 5120 scope.go:117] "RemoveContainer" containerID="536e844e2ac0e14a2d2b4a46e25020dba51a4cec2f2cc3ed78a929c820d50b21" Mar 16 16:11:56 crc kubenswrapper[5120]: I0316 16:11:56.024403 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"536e844e2ac0e14a2d2b4a46e25020dba51a4cec2f2cc3ed78a929c820d50b21"} err="failed to get container status \"536e844e2ac0e14a2d2b4a46e25020dba51a4cec2f2cc3ed78a929c820d50b21\": rpc error: code = NotFound desc = could not find container \"536e844e2ac0e14a2d2b4a46e25020dba51a4cec2f2cc3ed78a929c820d50b21\": container with ID starting with 536e844e2ac0e14a2d2b4a46e25020dba51a4cec2f2cc3ed78a929c820d50b21 not found: ID does not exist" Mar 16 16:11:56 crc kubenswrapper[5120]: I0316 16:11:56.024426 5120 scope.go:117] "RemoveContainer" containerID="47ad76eaa3ccef7852b7ae34bae358001bcc86331d5812ad7c12d1295a4daaec" Mar 16 16:11:56 crc kubenswrapper[5120]: I0316 16:11:56.024688 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47ad76eaa3ccef7852b7ae34bae358001bcc86331d5812ad7c12d1295a4daaec"} err="failed to get container status \"47ad76eaa3ccef7852b7ae34bae358001bcc86331d5812ad7c12d1295a4daaec\": rpc error: code = NotFound desc = could not find container \"47ad76eaa3ccef7852b7ae34bae358001bcc86331d5812ad7c12d1295a4daaec\": container with ID starting with 47ad76eaa3ccef7852b7ae34bae358001bcc86331d5812ad7c12d1295a4daaec not found: ID does not exist" Mar 16 16:11:56 crc kubenswrapper[5120]: I0316 16:11:56.683105 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cfa04300-3658-439c-bbe6-7971cb7ca630" path="/var/lib/kubelet/pods/cfa04300-3658-439c-bbe6-7971cb7ca630/volumes" Mar 16 16:11:56 crc kubenswrapper[5120]: I0316 16:11:56.877953 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-574f788578-gbqkk"] Mar 16 16:11:56 crc kubenswrapper[5120]: I0316 16:11:56.879254 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cfa04300-3658-439c-bbe6-7971cb7ca630" containerName="placement-log" Mar 16 16:11:56 crc kubenswrapper[5120]: I0316 16:11:56.879280 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="cfa04300-3658-439c-bbe6-7971cb7ca630" containerName="placement-log" Mar 16 16:11:56 crc kubenswrapper[5120]: I0316 16:11:56.879307 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cfa04300-3658-439c-bbe6-7971cb7ca630" containerName="placement-api" Mar 16 16:11:56 crc kubenswrapper[5120]: I0316 16:11:56.879315 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="cfa04300-3658-439c-bbe6-7971cb7ca630" containerName="placement-api" Mar 16 16:11:56 crc kubenswrapper[5120]: I0316 16:11:56.879833 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="cfa04300-3658-439c-bbe6-7971cb7ca630" containerName="placement-log" Mar 16 16:11:56 crc kubenswrapper[5120]: I0316 16:11:56.879880 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="cfa04300-3658-439c-bbe6-7971cb7ca630" containerName="placement-api" Mar 16 16:11:56 crc kubenswrapper[5120]: I0316 16:11:56.885331 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-574f788578-gbqkk" Mar 16 16:11:56 crc kubenswrapper[5120]: I0316 16:11:56.892021 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-574f788578-gbqkk"] Mar 16 16:11:56 crc kubenswrapper[5120]: I0316 16:11:56.978498 5120 generic.go:358] "Generic (PLEG): container finished" podID="96650b1e-b94e-4f53-9fe6-7b45f224d366" containerID="016d7acb984498c2d879192f8a4e4df1aa89b0840d16269d8685afb1663e4fb3" exitCode=0 Mar 16 16:11:56 crc kubenswrapper[5120]: I0316 16:11:56.978563 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"96650b1e-b94e-4f53-9fe6-7b45f224d366","Type":"ContainerDied","Data":"016d7acb984498c2d879192f8a4e4df1aa89b0840d16269d8685afb1663e4fb3"} Mar 16 16:11:57 crc kubenswrapper[5120]: I0316 16:11:57.015178 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f632160f-f5b5-4ffe-be8e-798d54d5b530-internal-tls-certs\") pod \"neutron-574f788578-gbqkk\" (UID: \"f632160f-f5b5-4ffe-be8e-798d54d5b530\") " pod="openstack-kuttl-tests/neutron-574f788578-gbqkk" Mar 16 16:11:57 crc kubenswrapper[5120]: I0316 16:11:57.015253 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f632160f-f5b5-4ffe-be8e-798d54d5b530-combined-ca-bundle\") pod \"neutron-574f788578-gbqkk\" (UID: \"f632160f-f5b5-4ffe-be8e-798d54d5b530\") " pod="openstack-kuttl-tests/neutron-574f788578-gbqkk" Mar 16 16:11:57 crc kubenswrapper[5120]: I0316 16:11:57.015398 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/f632160f-f5b5-4ffe-be8e-798d54d5b530-httpd-config\") pod \"neutron-574f788578-gbqkk\" (UID: \"f632160f-f5b5-4ffe-be8e-798d54d5b530\") " pod="openstack-kuttl-tests/neutron-574f788578-gbqkk" Mar 16 16:11:57 crc kubenswrapper[5120]: I0316 16:11:57.015420 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/f632160f-f5b5-4ffe-be8e-798d54d5b530-ovndb-tls-certs\") pod \"neutron-574f788578-gbqkk\" (UID: \"f632160f-f5b5-4ffe-be8e-798d54d5b530\") " pod="openstack-kuttl-tests/neutron-574f788578-gbqkk" Mar 16 16:11:57 crc kubenswrapper[5120]: I0316 16:11:57.015455 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f632160f-f5b5-4ffe-be8e-798d54d5b530-config\") pod \"neutron-574f788578-gbqkk\" (UID: \"f632160f-f5b5-4ffe-be8e-798d54d5b530\") " pod="openstack-kuttl-tests/neutron-574f788578-gbqkk" Mar 16 16:11:57 crc kubenswrapper[5120]: I0316 16:11:57.015584 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9wff\" (UniqueName: \"kubernetes.io/projected/f632160f-f5b5-4ffe-be8e-798d54d5b530-kube-api-access-q9wff\") pod \"neutron-574f788578-gbqkk\" (UID: \"f632160f-f5b5-4ffe-be8e-798d54d5b530\") " pod="openstack-kuttl-tests/neutron-574f788578-gbqkk" Mar 16 16:11:57 crc kubenswrapper[5120]: I0316 16:11:57.015619 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f632160f-f5b5-4ffe-be8e-798d54d5b530-public-tls-certs\") pod \"neutron-574f788578-gbqkk\" (UID: \"f632160f-f5b5-4ffe-be8e-798d54d5b530\") " pod="openstack-kuttl-tests/neutron-574f788578-gbqkk" Mar 16 16:11:57 crc kubenswrapper[5120]: I0316 16:11:57.118522 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/f632160f-f5b5-4ffe-be8e-798d54d5b530-httpd-config\") pod \"neutron-574f788578-gbqkk\" (UID: \"f632160f-f5b5-4ffe-be8e-798d54d5b530\") " pod="openstack-kuttl-tests/neutron-574f788578-gbqkk" Mar 16 16:11:57 crc kubenswrapper[5120]: I0316 16:11:57.118581 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/f632160f-f5b5-4ffe-be8e-798d54d5b530-ovndb-tls-certs\") pod \"neutron-574f788578-gbqkk\" (UID: \"f632160f-f5b5-4ffe-be8e-798d54d5b530\") " pod="openstack-kuttl-tests/neutron-574f788578-gbqkk" Mar 16 16:11:57 crc kubenswrapper[5120]: I0316 16:11:57.118655 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f632160f-f5b5-4ffe-be8e-798d54d5b530-config\") pod \"neutron-574f788578-gbqkk\" (UID: \"f632160f-f5b5-4ffe-be8e-798d54d5b530\") " pod="openstack-kuttl-tests/neutron-574f788578-gbqkk" Mar 16 16:11:57 crc kubenswrapper[5120]: I0316 16:11:57.118900 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q9wff\" (UniqueName: \"kubernetes.io/projected/f632160f-f5b5-4ffe-be8e-798d54d5b530-kube-api-access-q9wff\") pod \"neutron-574f788578-gbqkk\" (UID: \"f632160f-f5b5-4ffe-be8e-798d54d5b530\") " pod="openstack-kuttl-tests/neutron-574f788578-gbqkk" Mar 16 16:11:57 crc kubenswrapper[5120]: I0316 16:11:57.118964 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f632160f-f5b5-4ffe-be8e-798d54d5b530-public-tls-certs\") pod \"neutron-574f788578-gbqkk\" (UID: \"f632160f-f5b5-4ffe-be8e-798d54d5b530\") " pod="openstack-kuttl-tests/neutron-574f788578-gbqkk" Mar 16 16:11:57 crc kubenswrapper[5120]: I0316 16:11:57.119206 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f632160f-f5b5-4ffe-be8e-798d54d5b530-internal-tls-certs\") pod \"neutron-574f788578-gbqkk\" (UID: \"f632160f-f5b5-4ffe-be8e-798d54d5b530\") " pod="openstack-kuttl-tests/neutron-574f788578-gbqkk" Mar 16 16:11:57 crc kubenswrapper[5120]: I0316 16:11:57.119271 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f632160f-f5b5-4ffe-be8e-798d54d5b530-combined-ca-bundle\") pod \"neutron-574f788578-gbqkk\" (UID: \"f632160f-f5b5-4ffe-be8e-798d54d5b530\") " pod="openstack-kuttl-tests/neutron-574f788578-gbqkk" Mar 16 16:11:57 crc kubenswrapper[5120]: I0316 16:11:57.124535 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/f632160f-f5b5-4ffe-be8e-798d54d5b530-ovndb-tls-certs\") pod \"neutron-574f788578-gbqkk\" (UID: \"f632160f-f5b5-4ffe-be8e-798d54d5b530\") " pod="openstack-kuttl-tests/neutron-574f788578-gbqkk" Mar 16 16:11:57 crc kubenswrapper[5120]: I0316 16:11:57.130192 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f632160f-f5b5-4ffe-be8e-798d54d5b530-combined-ca-bundle\") pod \"neutron-574f788578-gbqkk\" (UID: \"f632160f-f5b5-4ffe-be8e-798d54d5b530\") " pod="openstack-kuttl-tests/neutron-574f788578-gbqkk" Mar 16 16:11:57 crc kubenswrapper[5120]: I0316 16:11:57.131465 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/f632160f-f5b5-4ffe-be8e-798d54d5b530-httpd-config\") pod \"neutron-574f788578-gbqkk\" (UID: \"f632160f-f5b5-4ffe-be8e-798d54d5b530\") " pod="openstack-kuttl-tests/neutron-574f788578-gbqkk" Mar 16 16:11:57 crc kubenswrapper[5120]: I0316 16:11:57.131934 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/f632160f-f5b5-4ffe-be8e-798d54d5b530-config\") pod \"neutron-574f788578-gbqkk\" (UID: \"f632160f-f5b5-4ffe-be8e-798d54d5b530\") " pod="openstack-kuttl-tests/neutron-574f788578-gbqkk" Mar 16 16:11:57 crc kubenswrapper[5120]: I0316 16:11:57.132314 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f632160f-f5b5-4ffe-be8e-798d54d5b530-internal-tls-certs\") pod \"neutron-574f788578-gbqkk\" (UID: \"f632160f-f5b5-4ffe-be8e-798d54d5b530\") " pod="openstack-kuttl-tests/neutron-574f788578-gbqkk" Mar 16 16:11:57 crc kubenswrapper[5120]: I0316 16:11:57.132354 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f632160f-f5b5-4ffe-be8e-798d54d5b530-public-tls-certs\") pod \"neutron-574f788578-gbqkk\" (UID: \"f632160f-f5b5-4ffe-be8e-798d54d5b530\") " pod="openstack-kuttl-tests/neutron-574f788578-gbqkk" Mar 16 16:11:57 crc kubenswrapper[5120]: I0316 16:11:57.142670 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9wff\" (UniqueName: \"kubernetes.io/projected/f632160f-f5b5-4ffe-be8e-798d54d5b530-kube-api-access-q9wff\") pod \"neutron-574f788578-gbqkk\" (UID: \"f632160f-f5b5-4ffe-be8e-798d54d5b530\") " pod="openstack-kuttl-tests/neutron-574f788578-gbqkk" Mar 16 16:11:57 crc kubenswrapper[5120]: I0316 16:11:57.204579 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-574f788578-gbqkk" Mar 16 16:11:57 crc kubenswrapper[5120]: I0316 16:11:57.686475 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:11:57 crc kubenswrapper[5120]: I0316 16:11:57.705659 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-574f788578-gbqkk"] Mar 16 16:11:57 crc kubenswrapper[5120]: I0316 16:11:57.834647 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:11:57 crc kubenswrapper[5120]: I0316 16:11:57.834900 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/70cb8e52-8e41-40dd-9988-d9aef87fadd6-public-tls-certs\") pod \"70cb8e52-8e41-40dd-9988-d9aef87fadd6\" (UID: \"70cb8e52-8e41-40dd-9988-d9aef87fadd6\") " Mar 16 16:11:57 crc kubenswrapper[5120]: I0316 16:11:57.835155 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/70cb8e52-8e41-40dd-9988-d9aef87fadd6-config-data\") pod \"70cb8e52-8e41-40dd-9988-d9aef87fadd6\" (UID: \"70cb8e52-8e41-40dd-9988-d9aef87fadd6\") " Mar 16 16:11:57 crc kubenswrapper[5120]: I0316 16:11:57.835309 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/70cb8e52-8e41-40dd-9988-d9aef87fadd6-logs\") pod \"70cb8e52-8e41-40dd-9988-d9aef87fadd6\" (UID: \"70cb8e52-8e41-40dd-9988-d9aef87fadd6\") " Mar 16 16:11:57 crc kubenswrapper[5120]: I0316 16:11:57.835361 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/70cb8e52-8e41-40dd-9988-d9aef87fadd6-httpd-run\") pod \"70cb8e52-8e41-40dd-9988-d9aef87fadd6\" (UID: \"70cb8e52-8e41-40dd-9988-d9aef87fadd6\") " Mar 16 16:11:57 crc kubenswrapper[5120]: I0316 16:11:57.835397 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2nwkp\" (UniqueName: \"kubernetes.io/projected/70cb8e52-8e41-40dd-9988-d9aef87fadd6-kube-api-access-2nwkp\") pod \"70cb8e52-8e41-40dd-9988-d9aef87fadd6\" (UID: \"70cb8e52-8e41-40dd-9988-d9aef87fadd6\") " Mar 16 16:11:57 crc kubenswrapper[5120]: I0316 16:11:57.835632 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/70cb8e52-8e41-40dd-9988-d9aef87fadd6-scripts\") pod \"70cb8e52-8e41-40dd-9988-d9aef87fadd6\" (UID: \"70cb8e52-8e41-40dd-9988-d9aef87fadd6\") " Mar 16 16:11:57 crc kubenswrapper[5120]: I0316 16:11:57.835664 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/70cb8e52-8e41-40dd-9988-d9aef87fadd6-combined-ca-bundle\") pod \"70cb8e52-8e41-40dd-9988-d9aef87fadd6\" (UID: \"70cb8e52-8e41-40dd-9988-d9aef87fadd6\") " Mar 16 16:11:57 crc kubenswrapper[5120]: I0316 16:11:57.835804 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage15-crc\") pod \"70cb8e52-8e41-40dd-9988-d9aef87fadd6\" (UID: \"70cb8e52-8e41-40dd-9988-d9aef87fadd6\") " Mar 16 16:11:57 crc kubenswrapper[5120]: I0316 16:11:57.835804 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70cb8e52-8e41-40dd-9988-d9aef87fadd6-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "70cb8e52-8e41-40dd-9988-d9aef87fadd6" (UID: "70cb8e52-8e41-40dd-9988-d9aef87fadd6"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:11:57 crc kubenswrapper[5120]: I0316 16:11:57.835975 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70cb8e52-8e41-40dd-9988-d9aef87fadd6-logs" (OuterVolumeSpecName: "logs") pod "70cb8e52-8e41-40dd-9988-d9aef87fadd6" (UID: "70cb8e52-8e41-40dd-9988-d9aef87fadd6"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:11:57 crc kubenswrapper[5120]: I0316 16:11:57.836664 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/70cb8e52-8e41-40dd-9988-d9aef87fadd6-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:11:57 crc kubenswrapper[5120]: I0316 16:11:57.836680 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/70cb8e52-8e41-40dd-9988-d9aef87fadd6-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 16:11:57 crc kubenswrapper[5120]: I0316 16:11:57.845495 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/70cb8e52-8e41-40dd-9988-d9aef87fadd6-scripts" (OuterVolumeSpecName: "scripts") pod "70cb8e52-8e41-40dd-9988-d9aef87fadd6" (UID: "70cb8e52-8e41-40dd-9988-d9aef87fadd6"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:11:57 crc kubenswrapper[5120]: I0316 16:11:57.845545 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70cb8e52-8e41-40dd-9988-d9aef87fadd6-kube-api-access-2nwkp" (OuterVolumeSpecName: "kube-api-access-2nwkp") pod "70cb8e52-8e41-40dd-9988-d9aef87fadd6" (UID: "70cb8e52-8e41-40dd-9988-d9aef87fadd6"). InnerVolumeSpecName "kube-api-access-2nwkp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:11:57 crc kubenswrapper[5120]: I0316 16:11:57.845545 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage15-crc" (OuterVolumeSpecName: "glance") pod "70cb8e52-8e41-40dd-9988-d9aef87fadd6" (UID: "70cb8e52-8e41-40dd-9988-d9aef87fadd6"). InnerVolumeSpecName "local-storage15-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:11:57 crc kubenswrapper[5120]: I0316 16:11:57.902728 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/70cb8e52-8e41-40dd-9988-d9aef87fadd6-config-data" (OuterVolumeSpecName: "config-data") pod "70cb8e52-8e41-40dd-9988-d9aef87fadd6" (UID: "70cb8e52-8e41-40dd-9988-d9aef87fadd6"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:11:57 crc kubenswrapper[5120]: I0316 16:11:57.903443 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/70cb8e52-8e41-40dd-9988-d9aef87fadd6-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "70cb8e52-8e41-40dd-9988-d9aef87fadd6" (UID: "70cb8e52-8e41-40dd-9988-d9aef87fadd6"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:11:57 crc kubenswrapper[5120]: I0316 16:11:57.929181 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/70cb8e52-8e41-40dd-9988-d9aef87fadd6-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "70cb8e52-8e41-40dd-9988-d9aef87fadd6" (UID: "70cb8e52-8e41-40dd-9988-d9aef87fadd6"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:11:57 crc kubenswrapper[5120]: I0316 16:11:57.937953 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d7cb016a-477e-4e1d-9cea-b3308c3821ad-logs\") pod \"d7cb016a-477e-4e1d-9cea-b3308c3821ad\" (UID: \"d7cb016a-477e-4e1d-9cea-b3308c3821ad\") " Mar 16 16:11:57 crc kubenswrapper[5120]: I0316 16:11:57.938105 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") pod \"d7cb016a-477e-4e1d-9cea-b3308c3821ad\" (UID: \"d7cb016a-477e-4e1d-9cea-b3308c3821ad\") " Mar 16 16:11:57 crc kubenswrapper[5120]: I0316 16:11:57.938229 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d7cb016a-477e-4e1d-9cea-b3308c3821ad-combined-ca-bundle\") pod \"d7cb016a-477e-4e1d-9cea-b3308c3821ad\" (UID: \"d7cb016a-477e-4e1d-9cea-b3308c3821ad\") " Mar 16 16:11:57 crc kubenswrapper[5120]: I0316 16:11:57.938288 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d7cb016a-477e-4e1d-9cea-b3308c3821ad-config-data\") pod \"d7cb016a-477e-4e1d-9cea-b3308c3821ad\" (UID: \"d7cb016a-477e-4e1d-9cea-b3308c3821ad\") " Mar 16 16:11:57 crc kubenswrapper[5120]: I0316 16:11:57.938371 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d7cb016a-477e-4e1d-9cea-b3308c3821ad-scripts\") pod \"d7cb016a-477e-4e1d-9cea-b3308c3821ad\" (UID: \"d7cb016a-477e-4e1d-9cea-b3308c3821ad\") " Mar 16 16:11:57 crc kubenswrapper[5120]: I0316 16:11:57.938396 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/d7cb016a-477e-4e1d-9cea-b3308c3821ad-internal-tls-certs\") pod \"d7cb016a-477e-4e1d-9cea-b3308c3821ad\" (UID: \"d7cb016a-477e-4e1d-9cea-b3308c3821ad\") " Mar 16 16:11:57 crc kubenswrapper[5120]: I0316 16:11:57.938439 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/d7cb016a-477e-4e1d-9cea-b3308c3821ad-httpd-run\") pod \"d7cb016a-477e-4e1d-9cea-b3308c3821ad\" (UID: \"d7cb016a-477e-4e1d-9cea-b3308c3821ad\") " Mar 16 16:11:57 crc kubenswrapper[5120]: I0316 16:11:57.938459 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-87bbn\" (UniqueName: \"kubernetes.io/projected/d7cb016a-477e-4e1d-9cea-b3308c3821ad-kube-api-access-87bbn\") pod \"d7cb016a-477e-4e1d-9cea-b3308c3821ad\" (UID: \"d7cb016a-477e-4e1d-9cea-b3308c3821ad\") " Mar 16 16:11:57 crc kubenswrapper[5120]: I0316 16:11:57.938743 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7cb016a-477e-4e1d-9cea-b3308c3821ad-logs" (OuterVolumeSpecName: "logs") pod "d7cb016a-477e-4e1d-9cea-b3308c3821ad" (UID: "d7cb016a-477e-4e1d-9cea-b3308c3821ad"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:11:57 crc kubenswrapper[5120]: I0316 16:11:57.939347 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d7cb016a-477e-4e1d-9cea-b3308c3821ad-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:11:57 crc kubenswrapper[5120]: I0316 16:11:57.939376 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2nwkp\" (UniqueName: \"kubernetes.io/projected/70cb8e52-8e41-40dd-9988-d9aef87fadd6-kube-api-access-2nwkp\") on node \"crc\" DevicePath \"\"" Mar 16 16:11:57 crc kubenswrapper[5120]: I0316 16:11:57.939394 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/70cb8e52-8e41-40dd-9988-d9aef87fadd6-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:11:57 crc kubenswrapper[5120]: I0316 16:11:57.939407 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/70cb8e52-8e41-40dd-9988-d9aef87fadd6-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:11:57 crc kubenswrapper[5120]: I0316 16:11:57.939435 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage15-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage15-crc\") on node \"crc\" " Mar 16 16:11:57 crc kubenswrapper[5120]: I0316 16:11:57.939451 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/70cb8e52-8e41-40dd-9988-d9aef87fadd6-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:11:57 crc kubenswrapper[5120]: I0316 16:11:57.939464 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/70cb8e52-8e41-40dd-9988-d9aef87fadd6-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:11:57 crc kubenswrapper[5120]: I0316 16:11:57.942201 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7cb016a-477e-4e1d-9cea-b3308c3821ad-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "d7cb016a-477e-4e1d-9cea-b3308c3821ad" (UID: "d7cb016a-477e-4e1d-9cea-b3308c3821ad"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:11:57 crc kubenswrapper[5120]: I0316 16:11:57.943551 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7cb016a-477e-4e1d-9cea-b3308c3821ad-kube-api-access-87bbn" (OuterVolumeSpecName: "kube-api-access-87bbn") pod "d7cb016a-477e-4e1d-9cea-b3308c3821ad" (UID: "d7cb016a-477e-4e1d-9cea-b3308c3821ad"). InnerVolumeSpecName "kube-api-access-87bbn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:11:57 crc kubenswrapper[5120]: I0316 16:11:57.945238 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage14-crc" (OuterVolumeSpecName: "glance") pod "d7cb016a-477e-4e1d-9cea-b3308c3821ad" (UID: "d7cb016a-477e-4e1d-9cea-b3308c3821ad"). InnerVolumeSpecName "local-storage14-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:11:57 crc kubenswrapper[5120]: I0316 16:11:57.948723 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d7cb016a-477e-4e1d-9cea-b3308c3821ad-scripts" (OuterVolumeSpecName: "scripts") pod "d7cb016a-477e-4e1d-9cea-b3308c3821ad" (UID: "d7cb016a-477e-4e1d-9cea-b3308c3821ad"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:11:57 crc kubenswrapper[5120]: I0316 16:11:57.963793 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage15-crc" (UniqueName: "kubernetes.io/local-volume/local-storage15-crc") on node "crc" Mar 16 16:11:57 crc kubenswrapper[5120]: I0316 16:11:57.979143 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d7cb016a-477e-4e1d-9cea-b3308c3821ad-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "d7cb016a-477e-4e1d-9cea-b3308c3821ad" (UID: "d7cb016a-477e-4e1d-9cea-b3308c3821ad"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:11:57 crc kubenswrapper[5120]: I0316 16:11:57.993683 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d7cb016a-477e-4e1d-9cea-b3308c3821ad-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "d7cb016a-477e-4e1d-9cea-b3308c3821ad" (UID: "d7cb016a-477e-4e1d-9cea-b3308c3821ad"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.002092 5120 generic.go:358] "Generic (PLEG): container finished" podID="70cb8e52-8e41-40dd-9988-d9aef87fadd6" containerID="af2ce2874b2f1d01dd56d1c2b54cf07657cd9a5a00b4da8859b79d3b71d3c3db" exitCode=0 Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.002282 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"70cb8e52-8e41-40dd-9988-d9aef87fadd6","Type":"ContainerDied","Data":"af2ce2874b2f1d01dd56d1c2b54cf07657cd9a5a00b4da8859b79d3b71d3c3db"} Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.002312 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"70cb8e52-8e41-40dd-9988-d9aef87fadd6","Type":"ContainerDied","Data":"4f21ea7f24dd57d014c66a8d9d21e902ffcbc10ec5b0b5bb41c24800a83a4d20"} Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.002328 5120 scope.go:117] "RemoveContainer" containerID="af2ce2874b2f1d01dd56d1c2b54cf07657cd9a5a00b4da8859b79d3b71d3c3db" Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.002461 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.012862 5120 generic.go:358] "Generic (PLEG): container finished" podID="d7cb016a-477e-4e1d-9cea-b3308c3821ad" containerID="0cfd497da29acd1fc4546472dd55ced91b08bd116de4265889cd689922d77e6a" exitCode=0 Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.013058 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.013073 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"d7cb016a-477e-4e1d-9cea-b3308c3821ad","Type":"ContainerDied","Data":"0cfd497da29acd1fc4546472dd55ced91b08bd116de4265889cd689922d77e6a"} Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.013143 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"d7cb016a-477e-4e1d-9cea-b3308c3821ad","Type":"ContainerDied","Data":"102a96ea1120a8adec6103d741452f29af4b77bd0a0a51d171ab930a97632f2c"} Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.016207 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-574f788578-gbqkk" event={"ID":"f632160f-f5b5-4ffe-be8e-798d54d5b530","Type":"ContainerStarted","Data":"b8c747755c95c125fe33105920ff58829e6a9d33efdbda08966390674c74e4e1"} Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.016248 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-574f788578-gbqkk" event={"ID":"f632160f-f5b5-4ffe-be8e-798d54d5b530","Type":"ContainerStarted","Data":"bb47e8ff143b7ef37f7b713f8840e2b10d5ef6416c132211b4f7e7bdfc4df094"} Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.034943 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d7cb016a-477e-4e1d-9cea-b3308c3821ad-config-data" (OuterVolumeSpecName: "config-data") pod "d7cb016a-477e-4e1d-9cea-b3308c3821ad" (UID: "d7cb016a-477e-4e1d-9cea-b3308c3821ad"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.039096 5120 scope.go:117] "RemoveContainer" containerID="07a4e9dbf0143df0475464b81a622cfeb916120ecf755e170ba1c70fb1ce953d" Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.041530 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d7cb016a-477e-4e1d-9cea-b3308c3821ad-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.041716 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d7cb016a-477e-4e1d-9cea-b3308c3821ad-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.042994 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage15-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage15-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.043176 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d7cb016a-477e-4e1d-9cea-b3308c3821ad-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.043343 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/d7cb016a-477e-4e1d-9cea-b3308c3821ad-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.043501 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/d7cb016a-477e-4e1d-9cea-b3308c3821ad-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.044097 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-87bbn\" (UniqueName: \"kubernetes.io/projected/d7cb016a-477e-4e1d-9cea-b3308c3821ad-kube-api-access-87bbn\") on node \"crc\" DevicePath \"\"" Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.044259 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") on node \"crc\" " Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.042531 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.060836 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.073206 5120 scope.go:117] "RemoveContainer" containerID="af2ce2874b2f1d01dd56d1c2b54cf07657cd9a5a00b4da8859b79d3b71d3c3db" Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.073296 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.074266 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70cb8e52-8e41-40dd-9988-d9aef87fadd6" containerName="glance-httpd" Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.074286 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="70cb8e52-8e41-40dd-9988-d9aef87fadd6" containerName="glance-httpd" Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.074327 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70cb8e52-8e41-40dd-9988-d9aef87fadd6" containerName="glance-log" Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.074333 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="70cb8e52-8e41-40dd-9988-d9aef87fadd6" containerName="glance-log" Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.074363 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7cb016a-477e-4e1d-9cea-b3308c3821ad" containerName="glance-httpd" Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.074370 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7cb016a-477e-4e1d-9cea-b3308c3821ad" containerName="glance-httpd" Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.074381 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7cb016a-477e-4e1d-9cea-b3308c3821ad" containerName="glance-log" Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.074387 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7cb016a-477e-4e1d-9cea-b3308c3821ad" containerName="glance-log" Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.074576 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="70cb8e52-8e41-40dd-9988-d9aef87fadd6" containerName="glance-log" Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.074593 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="d7cb016a-477e-4e1d-9cea-b3308c3821ad" containerName="glance-httpd" Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.074604 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="d7cb016a-477e-4e1d-9cea-b3308c3821ad" containerName="glance-log" Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.074617 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="70cb8e52-8e41-40dd-9988-d9aef87fadd6" containerName="glance-httpd" Mar 16 16:11:58 crc kubenswrapper[5120]: E0316 16:11:58.077224 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af2ce2874b2f1d01dd56d1c2b54cf07657cd9a5a00b4da8859b79d3b71d3c3db\": container with ID starting with af2ce2874b2f1d01dd56d1c2b54cf07657cd9a5a00b4da8859b79d3b71d3c3db not found: ID does not exist" containerID="af2ce2874b2f1d01dd56d1c2b54cf07657cd9a5a00b4da8859b79d3b71d3c3db" Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.077254 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af2ce2874b2f1d01dd56d1c2b54cf07657cd9a5a00b4da8859b79d3b71d3c3db"} err="failed to get container status \"af2ce2874b2f1d01dd56d1c2b54cf07657cd9a5a00b4da8859b79d3b71d3c3db\": rpc error: code = NotFound desc = could not find container \"af2ce2874b2f1d01dd56d1c2b54cf07657cd9a5a00b4da8859b79d3b71d3c3db\": container with ID starting with af2ce2874b2f1d01dd56d1c2b54cf07657cd9a5a00b4da8859b79d3b71d3c3db not found: ID does not exist" Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.077273 5120 scope.go:117] "RemoveContainer" containerID="07a4e9dbf0143df0475464b81a622cfeb916120ecf755e170ba1c70fb1ce953d" Mar 16 16:11:58 crc kubenswrapper[5120]: E0316 16:11:58.078478 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"07a4e9dbf0143df0475464b81a622cfeb916120ecf755e170ba1c70fb1ce953d\": container with ID starting with 07a4e9dbf0143df0475464b81a622cfeb916120ecf755e170ba1c70fb1ce953d not found: ID does not exist" containerID="07a4e9dbf0143df0475464b81a622cfeb916120ecf755e170ba1c70fb1ce953d" Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.078532 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07a4e9dbf0143df0475464b81a622cfeb916120ecf755e170ba1c70fb1ce953d"} err="failed to get container status \"07a4e9dbf0143df0475464b81a622cfeb916120ecf755e170ba1c70fb1ce953d\": rpc error: code = NotFound desc = could not find container \"07a4e9dbf0143df0475464b81a622cfeb916120ecf755e170ba1c70fb1ce953d\": container with ID starting with 07a4e9dbf0143df0475464b81a622cfeb916120ecf755e170ba1c70fb1ce953d not found: ID does not exist" Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.078569 5120 scope.go:117] "RemoveContainer" containerID="0cfd497da29acd1fc4546472dd55ced91b08bd116de4265889cd689922d77e6a" Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.081292 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage14-crc" (UniqueName: "kubernetes.io/local-volume/local-storage14-crc") on node "crc" Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.101726 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.101930 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.104400 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-external-config-data\"" Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.105486 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-public-svc\"" Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.120600 5120 scope.go:117] "RemoveContainer" containerID="4dc7ce8bb329cfeb8f8033e6f81228b46afd17e26b66c1812301a3a2252a4437" Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.146681 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.232125 5120 scope.go:117] "RemoveContainer" containerID="0cfd497da29acd1fc4546472dd55ced91b08bd116de4265889cd689922d77e6a" Mar 16 16:11:58 crc kubenswrapper[5120]: E0316 16:11:58.233900 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0cfd497da29acd1fc4546472dd55ced91b08bd116de4265889cd689922d77e6a\": container with ID starting with 0cfd497da29acd1fc4546472dd55ced91b08bd116de4265889cd689922d77e6a not found: ID does not exist" containerID="0cfd497da29acd1fc4546472dd55ced91b08bd116de4265889cd689922d77e6a" Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.234002 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0cfd497da29acd1fc4546472dd55ced91b08bd116de4265889cd689922d77e6a"} err="failed to get container status \"0cfd497da29acd1fc4546472dd55ced91b08bd116de4265889cd689922d77e6a\": rpc error: code = NotFound desc = could not find container \"0cfd497da29acd1fc4546472dd55ced91b08bd116de4265889cd689922d77e6a\": container with ID starting with 0cfd497da29acd1fc4546472dd55ced91b08bd116de4265889cd689922d77e6a not found: ID does not exist" Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.234056 5120 scope.go:117] "RemoveContainer" containerID="4dc7ce8bb329cfeb8f8033e6f81228b46afd17e26b66c1812301a3a2252a4437" Mar 16 16:11:58 crc kubenswrapper[5120]: E0316 16:11:58.235635 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4dc7ce8bb329cfeb8f8033e6f81228b46afd17e26b66c1812301a3a2252a4437\": container with ID starting with 4dc7ce8bb329cfeb8f8033e6f81228b46afd17e26b66c1812301a3a2252a4437 not found: ID does not exist" containerID="4dc7ce8bb329cfeb8f8033e6f81228b46afd17e26b66c1812301a3a2252a4437" Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.235685 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4dc7ce8bb329cfeb8f8033e6f81228b46afd17e26b66c1812301a3a2252a4437"} err="failed to get container status \"4dc7ce8bb329cfeb8f8033e6f81228b46afd17e26b66c1812301a3a2252a4437\": rpc error: code = NotFound desc = could not find container \"4dc7ce8bb329cfeb8f8033e6f81228b46afd17e26b66c1812301a3a2252a4437\": container with ID starting with 4dc7ce8bb329cfeb8f8033e6f81228b46afd17e26b66c1812301a3a2252a4437 not found: ID does not exist" Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.236837 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/cinder-api-0" podUID="06f34d35-9700-4048-9f1a-e773e02efbd6" containerName="cinder-api" probeResult="failure" output="Get \"https://10.217.0.48:8776/healthcheck\": read tcp 10.217.0.2:52960->10.217.0.48:8776: read: connection reset by peer" Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.248161 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/5aa11a39-e139-4791-92ce-2771b0277a8b-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"5aa11a39-e139-4791-92ce-2771b0277a8b\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.248339 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5aa11a39-e139-4791-92ce-2771b0277a8b-scripts\") pod \"glance-default-external-api-0\" (UID: \"5aa11a39-e139-4791-92ce-2771b0277a8b\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.248490 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5aa11a39-e139-4791-92ce-2771b0277a8b-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"5aa11a39-e139-4791-92ce-2771b0277a8b\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.248571 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5aa11a39-e139-4791-92ce-2771b0277a8b-config-data\") pod \"glance-default-external-api-0\" (UID: \"5aa11a39-e139-4791-92ce-2771b0277a8b\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.248639 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5aa11a39-e139-4791-92ce-2771b0277a8b-logs\") pod \"glance-default-external-api-0\" (UID: \"5aa11a39-e139-4791-92ce-2771b0277a8b\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.248729 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tn47w\" (UniqueName: \"kubernetes.io/projected/5aa11a39-e139-4791-92ce-2771b0277a8b-kube-api-access-tn47w\") pod \"glance-default-external-api-0\" (UID: \"5aa11a39-e139-4791-92ce-2771b0277a8b\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.248911 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/5aa11a39-e139-4791-92ce-2771b0277a8b-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"5aa11a39-e139-4791-92ce-2771b0277a8b\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.248992 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage15-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage15-crc\") pod \"glance-default-external-api-0\" (UID: \"5aa11a39-e139-4791-92ce-2771b0277a8b\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.351541 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/5aa11a39-e139-4791-92ce-2771b0277a8b-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"5aa11a39-e139-4791-92ce-2771b0277a8b\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.351612 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage15-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage15-crc\") pod \"glance-default-external-api-0\" (UID: \"5aa11a39-e139-4791-92ce-2771b0277a8b\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.351854 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/5aa11a39-e139-4791-92ce-2771b0277a8b-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"5aa11a39-e139-4791-92ce-2771b0277a8b\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.351938 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5aa11a39-e139-4791-92ce-2771b0277a8b-scripts\") pod \"glance-default-external-api-0\" (UID: \"5aa11a39-e139-4791-92ce-2771b0277a8b\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.352009 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5aa11a39-e139-4791-92ce-2771b0277a8b-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"5aa11a39-e139-4791-92ce-2771b0277a8b\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.352050 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5aa11a39-e139-4791-92ce-2771b0277a8b-config-data\") pod \"glance-default-external-api-0\" (UID: \"5aa11a39-e139-4791-92ce-2771b0277a8b\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.352082 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5aa11a39-e139-4791-92ce-2771b0277a8b-logs\") pod \"glance-default-external-api-0\" (UID: \"5aa11a39-e139-4791-92ce-2771b0277a8b\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.352149 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tn47w\" (UniqueName: \"kubernetes.io/projected/5aa11a39-e139-4791-92ce-2771b0277a8b-kube-api-access-tn47w\") pod \"glance-default-external-api-0\" (UID: \"5aa11a39-e139-4791-92ce-2771b0277a8b\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.352172 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage15-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage15-crc\") pod \"glance-default-external-api-0\" (UID: \"5aa11a39-e139-4791-92ce-2771b0277a8b\") device mount path \"/mnt/openstack/pv15\"" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.353261 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/5aa11a39-e139-4791-92ce-2771b0277a8b-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"5aa11a39-e139-4791-92ce-2771b0277a8b\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.354827 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5aa11a39-e139-4791-92ce-2771b0277a8b-logs\") pod \"glance-default-external-api-0\" (UID: \"5aa11a39-e139-4791-92ce-2771b0277a8b\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.357108 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5aa11a39-e139-4791-92ce-2771b0277a8b-scripts\") pod \"glance-default-external-api-0\" (UID: \"5aa11a39-e139-4791-92ce-2771b0277a8b\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.358716 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5aa11a39-e139-4791-92ce-2771b0277a8b-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"5aa11a39-e139-4791-92ce-2771b0277a8b\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.358841 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/5aa11a39-e139-4791-92ce-2771b0277a8b-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"5aa11a39-e139-4791-92ce-2771b0277a8b\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.365313 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5aa11a39-e139-4791-92ce-2771b0277a8b-config-data\") pod \"glance-default-external-api-0\" (UID: \"5aa11a39-e139-4791-92ce-2771b0277a8b\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.370559 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tn47w\" (UniqueName: \"kubernetes.io/projected/5aa11a39-e139-4791-92ce-2771b0277a8b-kube-api-access-tn47w\") pod \"glance-default-external-api-0\" (UID: \"5aa11a39-e139-4791-92ce-2771b0277a8b\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.389198 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage15-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage15-crc\") pod \"glance-default-external-api-0\" (UID: \"5aa11a39-e139-4791-92ce-2771b0277a8b\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.458321 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.458538 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="3e95e501-6a44-4736-aa20-72fe1a2bb1a8" containerName="nova-cell0-conductor-conductor" containerID="cri-o://31a2fce1e20c5b62f2a74ffb53802354c75a971f977ab88fe1d0d2ac24820f8d" gracePeriod=30 Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.478251 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.489487 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.513646 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.521002 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.523480 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.524422 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-internal-config-data\"" Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.525044 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-internal-svc\"" Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.535306 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.643513 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.644065 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="a4afa8e8-c485-4903-b53b-864c0517374e" containerName="nova-api-log" containerID="cri-o://d0da62bc52626fc919ec76a1ec38c2dc40f8a9e294470ae9689ac38cd086ec67" gracePeriod=30 Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.644531 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="a4afa8e8-c485-4903-b53b-864c0517374e" containerName="nova-api-api" containerID="cri-o://6a907d0329f6b418b5bde43c5425cd88ecfc1c1e43364b1c1ce7a0c7b6ed814d" gracePeriod=30 Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.660838 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.661094 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="dc31395d-0cfc-48ae-b26d-276e4a8afb77" containerName="nova-metadata-log" containerID="cri-o://bfce43255f6c59061a51cab3e762c65baa0ffac66c9aa102ffb5e4300d48d346" gracePeriod=30 Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.661609 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="dc31395d-0cfc-48ae-b26d-276e4a8afb77" containerName="nova-metadata-metadata" containerID="cri-o://c38a7fbc35daa920db9ed63c28348595217d447afe24b3556aefd8ce48a85207" gracePeriod=30 Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.664526 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0bbb1bbc-8c14-4046-bd63-cce793589d4d-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"0bbb1bbc-8c14-4046-bd63-cce793589d4d\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.664620 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") pod \"glance-default-internal-api-0\" (UID: \"0bbb1bbc-8c14-4046-bd63-cce793589d4d\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.664711 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/0bbb1bbc-8c14-4046-bd63-cce793589d4d-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"0bbb1bbc-8c14-4046-bd63-cce793589d4d\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.664744 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0bbb1bbc-8c14-4046-bd63-cce793589d4d-scripts\") pod \"glance-default-internal-api-0\" (UID: \"0bbb1bbc-8c14-4046-bd63-cce793589d4d\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.664809 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0bbb1bbc-8c14-4046-bd63-cce793589d4d-config-data\") pod \"glance-default-internal-api-0\" (UID: \"0bbb1bbc-8c14-4046-bd63-cce793589d4d\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.664860 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4nwc4\" (UniqueName: \"kubernetes.io/projected/0bbb1bbc-8c14-4046-bd63-cce793589d4d-kube-api-access-4nwc4\") pod \"glance-default-internal-api-0\" (UID: \"0bbb1bbc-8c14-4046-bd63-cce793589d4d\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.664893 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/0bbb1bbc-8c14-4046-bd63-cce793589d4d-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"0bbb1bbc-8c14-4046-bd63-cce793589d4d\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.664911 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0bbb1bbc-8c14-4046-bd63-cce793589d4d-logs\") pod \"glance-default-internal-api-0\" (UID: \"0bbb1bbc-8c14-4046-bd63-cce793589d4d\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.690823 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="70cb8e52-8e41-40dd-9988-d9aef87fadd6" path="/var/lib/kubelet/pods/70cb8e52-8e41-40dd-9988-d9aef87fadd6/volumes" Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.691705 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d7cb016a-477e-4e1d-9cea-b3308c3821ad" path="/var/lib/kubelet/pods/d7cb016a-477e-4e1d-9cea-b3308c3821ad/volumes" Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.692648 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.692680 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.692941 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podUID="601bff35-3d2b-4301-abdc-17ddf2e2b9eb" containerName="nova-cell1-novncproxy-novncproxy" containerID="cri-o://1fb5c938a8cc434d5d6acbf8795148fc1d15481e3ef51a7665017c74c309e1f4" gracePeriod=30 Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.693159 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="7b459444-a6b1-4f69-a8f9-3db6c84580b7" containerName="nova-scheduler-scheduler" containerID="cri-o://5363c5c946a8766cf3a14a7db019b0865f8cc1a4abb2aae6db3b4186297ec6ec" gracePeriod=30 Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.726162 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podUID="601bff35-3d2b-4301-abdc-17ddf2e2b9eb" containerName="nova-cell1-novncproxy-novncproxy" probeResult="failure" output="Get \"https://10.217.0.126:6080/vnc_lite.html\": EOF" Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.773548 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0bbb1bbc-8c14-4046-bd63-cce793589d4d-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"0bbb1bbc-8c14-4046-bd63-cce793589d4d\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.773977 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") pod \"glance-default-internal-api-0\" (UID: \"0bbb1bbc-8c14-4046-bd63-cce793589d4d\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.774166 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/0bbb1bbc-8c14-4046-bd63-cce793589d4d-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"0bbb1bbc-8c14-4046-bd63-cce793589d4d\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.774287 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0bbb1bbc-8c14-4046-bd63-cce793589d4d-scripts\") pod \"glance-default-internal-api-0\" (UID: \"0bbb1bbc-8c14-4046-bd63-cce793589d4d\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.774575 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0bbb1bbc-8c14-4046-bd63-cce793589d4d-config-data\") pod \"glance-default-internal-api-0\" (UID: \"0bbb1bbc-8c14-4046-bd63-cce793589d4d\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.775073 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/0bbb1bbc-8c14-4046-bd63-cce793589d4d-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"0bbb1bbc-8c14-4046-bd63-cce793589d4d\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.775872 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4nwc4\" (UniqueName: \"kubernetes.io/projected/0bbb1bbc-8c14-4046-bd63-cce793589d4d-kube-api-access-4nwc4\") pod \"glance-default-internal-api-0\" (UID: \"0bbb1bbc-8c14-4046-bd63-cce793589d4d\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.775997 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/0bbb1bbc-8c14-4046-bd63-cce793589d4d-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"0bbb1bbc-8c14-4046-bd63-cce793589d4d\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.776050 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0bbb1bbc-8c14-4046-bd63-cce793589d4d-logs\") pod \"glance-default-internal-api-0\" (UID: \"0bbb1bbc-8c14-4046-bd63-cce793589d4d\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.776149 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") pod \"glance-default-internal-api-0\" (UID: \"0bbb1bbc-8c14-4046-bd63-cce793589d4d\") device mount path \"/mnt/openstack/pv14\"" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.781437 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0bbb1bbc-8c14-4046-bd63-cce793589d4d-scripts\") pod \"glance-default-internal-api-0\" (UID: \"0bbb1bbc-8c14-4046-bd63-cce793589d4d\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.781597 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0bbb1bbc-8c14-4046-bd63-cce793589d4d-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"0bbb1bbc-8c14-4046-bd63-cce793589d4d\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.782853 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/0bbb1bbc-8c14-4046-bd63-cce793589d4d-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"0bbb1bbc-8c14-4046-bd63-cce793589d4d\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.787132 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0bbb1bbc-8c14-4046-bd63-cce793589d4d-logs\") pod \"glance-default-internal-api-0\" (UID: \"0bbb1bbc-8c14-4046-bd63-cce793589d4d\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.788636 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0bbb1bbc-8c14-4046-bd63-cce793589d4d-config-data\") pod \"glance-default-internal-api-0\" (UID: \"0bbb1bbc-8c14-4046-bd63-cce793589d4d\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.794478 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4nwc4\" (UniqueName: \"kubernetes.io/projected/0bbb1bbc-8c14-4046-bd63-cce793589d4d-kube-api-access-4nwc4\") pod \"glance-default-internal-api-0\" (UID: \"0bbb1bbc-8c14-4046-bd63-cce793589d4d\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.812286 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") pod \"glance-default-internal-api-0\" (UID: \"0bbb1bbc-8c14-4046-bd63-cce793589d4d\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.912003 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.940996 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.979615 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/06f34d35-9700-4048-9f1a-e773e02efbd6-scripts\") pod \"06f34d35-9700-4048-9f1a-e773e02efbd6\" (UID: \"06f34d35-9700-4048-9f1a-e773e02efbd6\") " Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.979723 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/06f34d35-9700-4048-9f1a-e773e02efbd6-public-tls-certs\") pod \"06f34d35-9700-4048-9f1a-e773e02efbd6\" (UID: \"06f34d35-9700-4048-9f1a-e773e02efbd6\") " Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.979906 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/06f34d35-9700-4048-9f1a-e773e02efbd6-combined-ca-bundle\") pod \"06f34d35-9700-4048-9f1a-e773e02efbd6\" (UID: \"06f34d35-9700-4048-9f1a-e773e02efbd6\") " Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.980059 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/06f34d35-9700-4048-9f1a-e773e02efbd6-config-data\") pod \"06f34d35-9700-4048-9f1a-e773e02efbd6\" (UID: \"06f34d35-9700-4048-9f1a-e773e02efbd6\") " Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.980115 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/06f34d35-9700-4048-9f1a-e773e02efbd6-etc-machine-id\") pod \"06f34d35-9700-4048-9f1a-e773e02efbd6\" (UID: \"06f34d35-9700-4048-9f1a-e773e02efbd6\") " Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.980142 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-47pl7\" (UniqueName: \"kubernetes.io/projected/06f34d35-9700-4048-9f1a-e773e02efbd6-kube-api-access-47pl7\") pod \"06f34d35-9700-4048-9f1a-e773e02efbd6\" (UID: \"06f34d35-9700-4048-9f1a-e773e02efbd6\") " Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.980273 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/06f34d35-9700-4048-9f1a-e773e02efbd6-internal-tls-certs\") pod \"06f34d35-9700-4048-9f1a-e773e02efbd6\" (UID: \"06f34d35-9700-4048-9f1a-e773e02efbd6\") " Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.980309 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/06f34d35-9700-4048-9f1a-e773e02efbd6-logs\") pod \"06f34d35-9700-4048-9f1a-e773e02efbd6\" (UID: \"06f34d35-9700-4048-9f1a-e773e02efbd6\") " Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.980325 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/06f34d35-9700-4048-9f1a-e773e02efbd6-config-data-custom\") pod \"06f34d35-9700-4048-9f1a-e773e02efbd6\" (UID: \"06f34d35-9700-4048-9f1a-e773e02efbd6\") " Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.983020 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06f34d35-9700-4048-9f1a-e773e02efbd6-logs" (OuterVolumeSpecName: "logs") pod "06f34d35-9700-4048-9f1a-e773e02efbd6" (UID: "06f34d35-9700-4048-9f1a-e773e02efbd6"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.987994 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/06f34d35-9700-4048-9f1a-e773e02efbd6-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "06f34d35-9700-4048-9f1a-e773e02efbd6" (UID: "06f34d35-9700-4048-9f1a-e773e02efbd6"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.989913 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06f34d35-9700-4048-9f1a-e773e02efbd6-scripts" (OuterVolumeSpecName: "scripts") pod "06f34d35-9700-4048-9f1a-e773e02efbd6" (UID: "06f34d35-9700-4048-9f1a-e773e02efbd6"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.992453 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06f34d35-9700-4048-9f1a-e773e02efbd6-kube-api-access-47pl7" (OuterVolumeSpecName: "kube-api-access-47pl7") pod "06f34d35-9700-4048-9f1a-e773e02efbd6" (UID: "06f34d35-9700-4048-9f1a-e773e02efbd6"). InnerVolumeSpecName "kube-api-access-47pl7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:11:58 crc kubenswrapper[5120]: I0316 16:11:58.992998 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06f34d35-9700-4048-9f1a-e773e02efbd6-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "06f34d35-9700-4048-9f1a-e773e02efbd6" (UID: "06f34d35-9700-4048-9f1a-e773e02efbd6"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:11:59 crc kubenswrapper[5120]: I0316 16:11:59.033154 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06f34d35-9700-4048-9f1a-e773e02efbd6-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "06f34d35-9700-4048-9f1a-e773e02efbd6" (UID: "06f34d35-9700-4048-9f1a-e773e02efbd6"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:11:59 crc kubenswrapper[5120]: I0316 16:11:59.051639 5120 generic.go:358] "Generic (PLEG): container finished" podID="dc31395d-0cfc-48ae-b26d-276e4a8afb77" containerID="bfce43255f6c59061a51cab3e762c65baa0ffac66c9aa102ffb5e4300d48d346" exitCode=143 Mar 16 16:11:59 crc kubenswrapper[5120]: I0316 16:11:59.051821 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"dc31395d-0cfc-48ae-b26d-276e4a8afb77","Type":"ContainerDied","Data":"bfce43255f6c59061a51cab3e762c65baa0ffac66c9aa102ffb5e4300d48d346"} Mar 16 16:11:59 crc kubenswrapper[5120]: I0316 16:11:59.053679 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-574f788578-gbqkk" event={"ID":"f632160f-f5b5-4ffe-be8e-798d54d5b530","Type":"ContainerStarted","Data":"cc88aafe27855d27722c7a0a73e087a02562cfb1c968f5c4c5ecf7a927b36c24"} Mar 16 16:11:59 crc kubenswrapper[5120]: I0316 16:11:59.054712 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/neutron-574f788578-gbqkk" Mar 16 16:11:59 crc kubenswrapper[5120]: I0316 16:11:59.073442 5120 generic.go:358] "Generic (PLEG): container finished" podID="06f34d35-9700-4048-9f1a-e773e02efbd6" containerID="0e48369a2928b368bee18bb2e0e6fda041243ea298480650d5a5bbcc7df07b9b" exitCode=0 Mar 16 16:11:59 crc kubenswrapper[5120]: I0316 16:11:59.073752 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06f34d35-9700-4048-9f1a-e773e02efbd6-config-data" (OuterVolumeSpecName: "config-data") pod "06f34d35-9700-4048-9f1a-e773e02efbd6" (UID: "06f34d35-9700-4048-9f1a-e773e02efbd6"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:11:59 crc kubenswrapper[5120]: I0316 16:11:59.073935 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:11:59 crc kubenswrapper[5120]: I0316 16:11:59.073945 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"06f34d35-9700-4048-9f1a-e773e02efbd6","Type":"ContainerDied","Data":"0e48369a2928b368bee18bb2e0e6fda041243ea298480650d5a5bbcc7df07b9b"} Mar 16 16:11:59 crc kubenswrapper[5120]: I0316 16:11:59.074110 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"06f34d35-9700-4048-9f1a-e773e02efbd6","Type":"ContainerDied","Data":"243fc1d5fe4ecdd4bc27a2c69824bbdae7b2fb757493a1962cdb83fbb75f3125"} Mar 16 16:11:59 crc kubenswrapper[5120]: I0316 16:11:59.074182 5120 scope.go:117] "RemoveContainer" containerID="0e48369a2928b368bee18bb2e0e6fda041243ea298480650d5a5bbcc7df07b9b" Mar 16 16:11:59 crc kubenswrapper[5120]: I0316 16:11:59.076624 5120 generic.go:358] "Generic (PLEG): container finished" podID="a4afa8e8-c485-4903-b53b-864c0517374e" containerID="d0da62bc52626fc919ec76a1ec38c2dc40f8a9e294470ae9689ac38cd086ec67" exitCode=143 Mar 16 16:11:59 crc kubenswrapper[5120]: I0316 16:11:59.076645 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"a4afa8e8-c485-4903-b53b-864c0517374e","Type":"ContainerDied","Data":"d0da62bc52626fc919ec76a1ec38c2dc40f8a9e294470ae9689ac38cd086ec67"} Mar 16 16:11:59 crc kubenswrapper[5120]: I0316 16:11:59.087102 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/06f34d35-9700-4048-9f1a-e773e02efbd6-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:11:59 crc kubenswrapper[5120]: I0316 16:11:59.087351 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/06f34d35-9700-4048-9f1a-e773e02efbd6-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:11:59 crc kubenswrapper[5120]: I0316 16:11:59.087437 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/06f34d35-9700-4048-9f1a-e773e02efbd6-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:11:59 crc kubenswrapper[5120]: I0316 16:11:59.087514 5120 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/06f34d35-9700-4048-9f1a-e773e02efbd6-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 16:11:59 crc kubenswrapper[5120]: I0316 16:11:59.087589 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-47pl7\" (UniqueName: \"kubernetes.io/projected/06f34d35-9700-4048-9f1a-e773e02efbd6-kube-api-access-47pl7\") on node \"crc\" DevicePath \"\"" Mar 16 16:11:59 crc kubenswrapper[5120]: I0316 16:11:59.087653 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/06f34d35-9700-4048-9f1a-e773e02efbd6-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:11:59 crc kubenswrapper[5120]: I0316 16:11:59.087715 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/06f34d35-9700-4048-9f1a-e773e02efbd6-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:11:59 crc kubenswrapper[5120]: I0316 16:11:59.154052 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-574f788578-gbqkk" podStartSLOduration=3.15402705 podStartE2EDuration="3.15402705s" podCreationTimestamp="2026-03-16 16:11:56 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:11:59.093130178 +0000 UTC m=+2421.247061825" watchObservedRunningTime="2026-03-16 16:11:59.15402705 +0000 UTC m=+2421.307958707" Mar 16 16:11:59 crc kubenswrapper[5120]: I0316 16:11:59.169466 5120 scope.go:117] "RemoveContainer" containerID="8aea814127603d95cd34517e152cdf39284d9a351843f196cfaf6129c64a2a9d" Mar 16 16:11:59 crc kubenswrapper[5120]: I0316 16:11:59.183665 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06f34d35-9700-4048-9f1a-e773e02efbd6-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "06f34d35-9700-4048-9f1a-e773e02efbd6" (UID: "06f34d35-9700-4048-9f1a-e773e02efbd6"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:11:59 crc kubenswrapper[5120]: I0316 16:11:59.184132 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06f34d35-9700-4048-9f1a-e773e02efbd6-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "06f34d35-9700-4048-9f1a-e773e02efbd6" (UID: "06f34d35-9700-4048-9f1a-e773e02efbd6"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:11:59 crc kubenswrapper[5120]: I0316 16:11:59.189305 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/06f34d35-9700-4048-9f1a-e773e02efbd6-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:11:59 crc kubenswrapper[5120]: I0316 16:11:59.189329 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/06f34d35-9700-4048-9f1a-e773e02efbd6-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:11:59 crc kubenswrapper[5120]: I0316 16:11:59.277209 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:11:59 crc kubenswrapper[5120]: I0316 16:11:59.404996 5120 scope.go:117] "RemoveContainer" containerID="0e48369a2928b368bee18bb2e0e6fda041243ea298480650d5a5bbcc7df07b9b" Mar 16 16:11:59 crc kubenswrapper[5120]: E0316 16:11:59.418083 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0e48369a2928b368bee18bb2e0e6fda041243ea298480650d5a5bbcc7df07b9b\": container with ID starting with 0e48369a2928b368bee18bb2e0e6fda041243ea298480650d5a5bbcc7df07b9b not found: ID does not exist" containerID="0e48369a2928b368bee18bb2e0e6fda041243ea298480650d5a5bbcc7df07b9b" Mar 16 16:11:59 crc kubenswrapper[5120]: I0316 16:11:59.418144 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e48369a2928b368bee18bb2e0e6fda041243ea298480650d5a5bbcc7df07b9b"} err="failed to get container status \"0e48369a2928b368bee18bb2e0e6fda041243ea298480650d5a5bbcc7df07b9b\": rpc error: code = NotFound desc = could not find container \"0e48369a2928b368bee18bb2e0e6fda041243ea298480650d5a5bbcc7df07b9b\": container with ID starting with 0e48369a2928b368bee18bb2e0e6fda041243ea298480650d5a5bbcc7df07b9b not found: ID does not exist" Mar 16 16:11:59 crc kubenswrapper[5120]: I0316 16:11:59.418180 5120 scope.go:117] "RemoveContainer" containerID="8aea814127603d95cd34517e152cdf39284d9a351843f196cfaf6129c64a2a9d" Mar 16 16:11:59 crc kubenswrapper[5120]: E0316 16:11:59.418871 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8aea814127603d95cd34517e152cdf39284d9a351843f196cfaf6129c64a2a9d\": container with ID starting with 8aea814127603d95cd34517e152cdf39284d9a351843f196cfaf6129c64a2a9d not found: ID does not exist" containerID="8aea814127603d95cd34517e152cdf39284d9a351843f196cfaf6129c64a2a9d" Mar 16 16:11:59 crc kubenswrapper[5120]: I0316 16:11:59.418976 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8aea814127603d95cd34517e152cdf39284d9a351843f196cfaf6129c64a2a9d"} err="failed to get container status \"8aea814127603d95cd34517e152cdf39284d9a351843f196cfaf6129c64a2a9d\": rpc error: code = NotFound desc = could not find container \"8aea814127603d95cd34517e152cdf39284d9a351843f196cfaf6129c64a2a9d\": container with ID starting with 8aea814127603d95cd34517e152cdf39284d9a351843f196cfaf6129c64a2a9d not found: ID does not exist" Mar 16 16:11:59 crc kubenswrapper[5120]: I0316 16:11:59.471891 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:11:59 crc kubenswrapper[5120]: I0316 16:11:59.479564 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:11:59 crc kubenswrapper[5120]: I0316 16:11:59.488707 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:11:59 crc kubenswrapper[5120]: I0316 16:11:59.511887 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:11:59 crc kubenswrapper[5120]: I0316 16:11:59.512884 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06f34d35-9700-4048-9f1a-e773e02efbd6" containerName="cinder-api-log" Mar 16 16:11:59 crc kubenswrapper[5120]: I0316 16:11:59.512901 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="06f34d35-9700-4048-9f1a-e773e02efbd6" containerName="cinder-api-log" Mar 16 16:11:59 crc kubenswrapper[5120]: I0316 16:11:59.512924 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06f34d35-9700-4048-9f1a-e773e02efbd6" containerName="cinder-api" Mar 16 16:11:59 crc kubenswrapper[5120]: I0316 16:11:59.512942 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="06f34d35-9700-4048-9f1a-e773e02efbd6" containerName="cinder-api" Mar 16 16:11:59 crc kubenswrapper[5120]: I0316 16:11:59.513162 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="06f34d35-9700-4048-9f1a-e773e02efbd6" containerName="cinder-api-log" Mar 16 16:11:59 crc kubenswrapper[5120]: I0316 16:11:59.513176 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="06f34d35-9700-4048-9f1a-e773e02efbd6" containerName="cinder-api" Mar 16 16:11:59 crc kubenswrapper[5120]: I0316 16:11:59.524557 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:11:59 crc kubenswrapper[5120]: I0316 16:11:59.531378 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:11:59 crc kubenswrapper[5120]: I0316 16:11:59.533031 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-cinder-public-svc\"" Mar 16 16:11:59 crc kubenswrapper[5120]: I0316 16:11:59.533272 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-cinder-internal-svc\"" Mar 16 16:11:59 crc kubenswrapper[5120]: I0316 16:11:59.533589 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-api-config-data\"" Mar 16 16:11:59 crc kubenswrapper[5120]: I0316 16:11:59.636047 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/4fce708d-9952-41be-95e4-de815da4d75a-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"4fce708d-9952-41be-95e4-de815da4d75a\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:11:59 crc kubenswrapper[5120]: I0316 16:11:59.636111 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4fce708d-9952-41be-95e4-de815da4d75a-scripts\") pod \"cinder-api-0\" (UID: \"4fce708d-9952-41be-95e4-de815da4d75a\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:11:59 crc kubenswrapper[5120]: I0316 16:11:59.636133 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4fce708d-9952-41be-95e4-de815da4d75a-logs\") pod \"cinder-api-0\" (UID: \"4fce708d-9952-41be-95e4-de815da4d75a\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:11:59 crc kubenswrapper[5120]: I0316 16:11:59.636148 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/4fce708d-9952-41be-95e4-de815da4d75a-public-tls-certs\") pod \"cinder-api-0\" (UID: \"4fce708d-9952-41be-95e4-de815da4d75a\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:11:59 crc kubenswrapper[5120]: I0316 16:11:59.636566 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/4fce708d-9952-41be-95e4-de815da4d75a-config-data-custom\") pod \"cinder-api-0\" (UID: \"4fce708d-9952-41be-95e4-de815da4d75a\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:11:59 crc kubenswrapper[5120]: I0316 16:11:59.636667 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4fce708d-9952-41be-95e4-de815da4d75a-config-data\") pod \"cinder-api-0\" (UID: \"4fce708d-9952-41be-95e4-de815da4d75a\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:11:59 crc kubenswrapper[5120]: I0316 16:11:59.636708 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4fce708d-9952-41be-95e4-de815da4d75a-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"4fce708d-9952-41be-95e4-de815da4d75a\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:11:59 crc kubenswrapper[5120]: I0316 16:11:59.636855 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/4fce708d-9952-41be-95e4-de815da4d75a-etc-machine-id\") pod \"cinder-api-0\" (UID: \"4fce708d-9952-41be-95e4-de815da4d75a\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:11:59 crc kubenswrapper[5120]: I0316 16:11:59.637014 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdmtg\" (UniqueName: \"kubernetes.io/projected/4fce708d-9952-41be-95e4-de815da4d75a-kube-api-access-vdmtg\") pod \"cinder-api-0\" (UID: \"4fce708d-9952-41be-95e4-de815da4d75a\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:11:59 crc kubenswrapper[5120]: I0316 16:11:59.739159 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vdmtg\" (UniqueName: \"kubernetes.io/projected/4fce708d-9952-41be-95e4-de815da4d75a-kube-api-access-vdmtg\") pod \"cinder-api-0\" (UID: \"4fce708d-9952-41be-95e4-de815da4d75a\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:11:59 crc kubenswrapper[5120]: I0316 16:11:59.739303 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/4fce708d-9952-41be-95e4-de815da4d75a-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"4fce708d-9952-41be-95e4-de815da4d75a\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:11:59 crc kubenswrapper[5120]: I0316 16:11:59.739386 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4fce708d-9952-41be-95e4-de815da4d75a-scripts\") pod \"cinder-api-0\" (UID: \"4fce708d-9952-41be-95e4-de815da4d75a\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:11:59 crc kubenswrapper[5120]: I0316 16:11:59.739488 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4fce708d-9952-41be-95e4-de815da4d75a-logs\") pod \"cinder-api-0\" (UID: \"4fce708d-9952-41be-95e4-de815da4d75a\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:11:59 crc kubenswrapper[5120]: I0316 16:11:59.739516 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/4fce708d-9952-41be-95e4-de815da4d75a-public-tls-certs\") pod \"cinder-api-0\" (UID: \"4fce708d-9952-41be-95e4-de815da4d75a\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:11:59 crc kubenswrapper[5120]: I0316 16:11:59.739702 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/4fce708d-9952-41be-95e4-de815da4d75a-config-data-custom\") pod \"cinder-api-0\" (UID: \"4fce708d-9952-41be-95e4-de815da4d75a\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:11:59 crc kubenswrapper[5120]: I0316 16:11:59.739751 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4fce708d-9952-41be-95e4-de815da4d75a-config-data\") pod \"cinder-api-0\" (UID: \"4fce708d-9952-41be-95e4-de815da4d75a\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:11:59 crc kubenswrapper[5120]: I0316 16:11:59.739804 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4fce708d-9952-41be-95e4-de815da4d75a-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"4fce708d-9952-41be-95e4-de815da4d75a\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:11:59 crc kubenswrapper[5120]: I0316 16:11:59.739897 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/4fce708d-9952-41be-95e4-de815da4d75a-etc-machine-id\") pod \"cinder-api-0\" (UID: \"4fce708d-9952-41be-95e4-de815da4d75a\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:11:59 crc kubenswrapper[5120]: I0316 16:11:59.739995 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/4fce708d-9952-41be-95e4-de815da4d75a-etc-machine-id\") pod \"cinder-api-0\" (UID: \"4fce708d-9952-41be-95e4-de815da4d75a\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:11:59 crc kubenswrapper[5120]: I0316 16:11:59.740648 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4fce708d-9952-41be-95e4-de815da4d75a-logs\") pod \"cinder-api-0\" (UID: \"4fce708d-9952-41be-95e4-de815da4d75a\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:11:59 crc kubenswrapper[5120]: I0316 16:11:59.750983 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4fce708d-9952-41be-95e4-de815da4d75a-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"4fce708d-9952-41be-95e4-de815da4d75a\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:11:59 crc kubenswrapper[5120]: I0316 16:11:59.751036 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/4fce708d-9952-41be-95e4-de815da4d75a-public-tls-certs\") pod \"cinder-api-0\" (UID: \"4fce708d-9952-41be-95e4-de815da4d75a\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:11:59 crc kubenswrapper[5120]: I0316 16:11:59.754694 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4fce708d-9952-41be-95e4-de815da4d75a-config-data\") pod \"cinder-api-0\" (UID: \"4fce708d-9952-41be-95e4-de815da4d75a\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:11:59 crc kubenswrapper[5120]: I0316 16:11:59.756373 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/4fce708d-9952-41be-95e4-de815da4d75a-config-data-custom\") pod \"cinder-api-0\" (UID: \"4fce708d-9952-41be-95e4-de815da4d75a\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:11:59 crc kubenswrapper[5120]: I0316 16:11:59.760584 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4fce708d-9952-41be-95e4-de815da4d75a-scripts\") pod \"cinder-api-0\" (UID: \"4fce708d-9952-41be-95e4-de815da4d75a\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:11:59 crc kubenswrapper[5120]: I0316 16:11:59.760809 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdmtg\" (UniqueName: \"kubernetes.io/projected/4fce708d-9952-41be-95e4-de815da4d75a-kube-api-access-vdmtg\") pod \"cinder-api-0\" (UID: \"4fce708d-9952-41be-95e4-de815da4d75a\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:11:59 crc kubenswrapper[5120]: I0316 16:11:59.761412 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/4fce708d-9952-41be-95e4-de815da4d75a-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"4fce708d-9952-41be-95e4-de815da4d75a\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:11:59 crc kubenswrapper[5120]: I0316 16:11:59.901675 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:12:00 crc kubenswrapper[5120]: E0316 16:12:00.087733 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="5363c5c946a8766cf3a14a7db019b0865f8cc1a4abb2aae6db3b4186297ec6ec" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:12:00 crc kubenswrapper[5120]: E0316 16:12:00.095946 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="5363c5c946a8766cf3a14a7db019b0865f8cc1a4abb2aae6db3b4186297ec6ec" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:12:00 crc kubenswrapper[5120]: E0316 16:12:00.100395 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="5363c5c946a8766cf3a14a7db019b0865f8cc1a4abb2aae6db3b4186297ec6ec" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:12:00 crc kubenswrapper[5120]: E0316 16:12:00.100442 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="7b459444-a6b1-4f69-a8f9-3db6c84580b7" containerName="nova-scheduler-scheduler" probeResult="unknown" Mar 16 16:12:00 crc kubenswrapper[5120]: I0316 16:12:00.135147 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"0bbb1bbc-8c14-4046-bd63-cce793589d4d","Type":"ContainerStarted","Data":"0a09872867ecf2c507f1fd2bf2e09c2a571a09f9070d27013b498f0c9aaf0aaf"} Mar 16 16:12:00 crc kubenswrapper[5120]: I0316 16:12:00.156605 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"5aa11a39-e139-4791-92ce-2771b0277a8b","Type":"ContainerStarted","Data":"7b2f2889906dd67fe1ba5a6937f7d7025c5d727c057145569157dd2e70cdcae6"} Mar 16 16:12:00 crc kubenswrapper[5120]: I0316 16:12:00.156940 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-infra/auto-csr-approver-29561292-z2wqq"] Mar 16 16:12:00 crc kubenswrapper[5120]: I0316 16:12:00.173080 5120 generic.go:358] "Generic (PLEG): container finished" podID="601bff35-3d2b-4301-abdc-17ddf2e2b9eb" containerID="1fb5c938a8cc434d5d6acbf8795148fc1d15481e3ef51a7665017c74c309e1f4" exitCode=0 Mar 16 16:12:00 crc kubenswrapper[5120]: I0316 16:12:00.173658 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"601bff35-3d2b-4301-abdc-17ddf2e2b9eb","Type":"ContainerDied","Data":"1fb5c938a8cc434d5d6acbf8795148fc1d15481e3ef51a7665017c74c309e1f4"} Mar 16 16:12:00 crc kubenswrapper[5120]: I0316 16:12:00.173831 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561292-z2wqq" Mar 16 16:12:00 crc kubenswrapper[5120]: I0316 16:12:00.177512 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-infra\"/\"csr-approver-sa-dockercfg-x2nsz\"" Mar 16 16:12:00 crc kubenswrapper[5120]: I0316 16:12:00.178383 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561292-z2wqq"] Mar 16 16:12:00 crc kubenswrapper[5120]: I0316 16:12:00.178868 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"kube-root-ca.crt\"" Mar 16 16:12:00 crc kubenswrapper[5120]: I0316 16:12:00.180070 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"openshift-service-ca.crt\"" Mar 16 16:12:00 crc kubenswrapper[5120]: I0316 16:12:00.255000 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fns9v\" (UniqueName: \"kubernetes.io/projected/ad803ce8-2d88-44d8-a717-aaec85ce871c-kube-api-access-fns9v\") pod \"auto-csr-approver-29561292-z2wqq\" (UID: \"ad803ce8-2d88-44d8-a717-aaec85ce871c\") " pod="openshift-infra/auto-csr-approver-29561292-z2wqq" Mar 16 16:12:00 crc kubenswrapper[5120]: I0316 16:12:00.361185 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fns9v\" (UniqueName: \"kubernetes.io/projected/ad803ce8-2d88-44d8-a717-aaec85ce871c-kube-api-access-fns9v\") pod \"auto-csr-approver-29561292-z2wqq\" (UID: \"ad803ce8-2d88-44d8-a717-aaec85ce871c\") " pod="openshift-infra/auto-csr-approver-29561292-z2wqq" Mar 16 16:12:00 crc kubenswrapper[5120]: I0316 16:12:00.383519 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fns9v\" (UniqueName: \"kubernetes.io/projected/ad803ce8-2d88-44d8-a717-aaec85ce871c-kube-api-access-fns9v\") pod \"auto-csr-approver-29561292-z2wqq\" (UID: \"ad803ce8-2d88-44d8-a717-aaec85ce871c\") " pod="openshift-infra/auto-csr-approver-29561292-z2wqq" Mar 16 16:12:00 crc kubenswrapper[5120]: I0316 16:12:00.422827 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:12:00 crc kubenswrapper[5120]: W0316 16:12:00.456430 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4fce708d_9952_41be_95e4_de815da4d75a.slice/crio-e6adb6aa278524b21809ea635d79dd070b619cb7e9db829e8e806fea4f7e69e7 WatchSource:0}: Error finding container e6adb6aa278524b21809ea635d79dd070b619cb7e9db829e8e806fea4f7e69e7: Status 404 returned error can't find the container with id e6adb6aa278524b21809ea635d79dd070b619cb7e9db829e8e806fea4f7e69e7 Mar 16 16:12:00 crc kubenswrapper[5120]: I0316 16:12:00.456478 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:12:00 crc kubenswrapper[5120]: I0316 16:12:00.511510 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561292-z2wqq" Mar 16 16:12:00 crc kubenswrapper[5120]: I0316 16:12:00.567741 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/601bff35-3d2b-4301-abdc-17ddf2e2b9eb-config-data\") pod \"601bff35-3d2b-4301-abdc-17ddf2e2b9eb\" (UID: \"601bff35-3d2b-4301-abdc-17ddf2e2b9eb\") " Mar 16 16:12:00 crc kubenswrapper[5120]: I0316 16:12:00.568067 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lrtpv\" (UniqueName: \"kubernetes.io/projected/601bff35-3d2b-4301-abdc-17ddf2e2b9eb-kube-api-access-lrtpv\") pod \"601bff35-3d2b-4301-abdc-17ddf2e2b9eb\" (UID: \"601bff35-3d2b-4301-abdc-17ddf2e2b9eb\") " Mar 16 16:12:00 crc kubenswrapper[5120]: I0316 16:12:00.568251 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/601bff35-3d2b-4301-abdc-17ddf2e2b9eb-vencrypt-tls-certs\") pod \"601bff35-3d2b-4301-abdc-17ddf2e2b9eb\" (UID: \"601bff35-3d2b-4301-abdc-17ddf2e2b9eb\") " Mar 16 16:12:00 crc kubenswrapper[5120]: I0316 16:12:00.568705 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/601bff35-3d2b-4301-abdc-17ddf2e2b9eb-combined-ca-bundle\") pod \"601bff35-3d2b-4301-abdc-17ddf2e2b9eb\" (UID: \"601bff35-3d2b-4301-abdc-17ddf2e2b9eb\") " Mar 16 16:12:00 crc kubenswrapper[5120]: I0316 16:12:00.569313 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/601bff35-3d2b-4301-abdc-17ddf2e2b9eb-nova-novncproxy-tls-certs\") pod \"601bff35-3d2b-4301-abdc-17ddf2e2b9eb\" (UID: \"601bff35-3d2b-4301-abdc-17ddf2e2b9eb\") " Mar 16 16:12:00 crc kubenswrapper[5120]: I0316 16:12:00.595332 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/601bff35-3d2b-4301-abdc-17ddf2e2b9eb-kube-api-access-lrtpv" (OuterVolumeSpecName: "kube-api-access-lrtpv") pod "601bff35-3d2b-4301-abdc-17ddf2e2b9eb" (UID: "601bff35-3d2b-4301-abdc-17ddf2e2b9eb"). InnerVolumeSpecName "kube-api-access-lrtpv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:12:00 crc kubenswrapper[5120]: I0316 16:12:00.651948 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/601bff35-3d2b-4301-abdc-17ddf2e2b9eb-config-data" (OuterVolumeSpecName: "config-data") pod "601bff35-3d2b-4301-abdc-17ddf2e2b9eb" (UID: "601bff35-3d2b-4301-abdc-17ddf2e2b9eb"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:00 crc kubenswrapper[5120]: I0316 16:12:00.663380 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/601bff35-3d2b-4301-abdc-17ddf2e2b9eb-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "601bff35-3d2b-4301-abdc-17ddf2e2b9eb" (UID: "601bff35-3d2b-4301-abdc-17ddf2e2b9eb"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:00 crc kubenswrapper[5120]: I0316 16:12:00.675968 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/601bff35-3d2b-4301-abdc-17ddf2e2b9eb-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:00 crc kubenswrapper[5120]: I0316 16:12:00.676009 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lrtpv\" (UniqueName: \"kubernetes.io/projected/601bff35-3d2b-4301-abdc-17ddf2e2b9eb-kube-api-access-lrtpv\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:00 crc kubenswrapper[5120]: I0316 16:12:00.676027 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/601bff35-3d2b-4301-abdc-17ddf2e2b9eb-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:00 crc kubenswrapper[5120]: I0316 16:12:00.707263 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/601bff35-3d2b-4301-abdc-17ddf2e2b9eb-nova-novncproxy-tls-certs" (OuterVolumeSpecName: "nova-novncproxy-tls-certs") pod "601bff35-3d2b-4301-abdc-17ddf2e2b9eb" (UID: "601bff35-3d2b-4301-abdc-17ddf2e2b9eb"). InnerVolumeSpecName "nova-novncproxy-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:00 crc kubenswrapper[5120]: I0316 16:12:00.718825 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="06f34d35-9700-4048-9f1a-e773e02efbd6" path="/var/lib/kubelet/pods/06f34d35-9700-4048-9f1a-e773e02efbd6/volumes" Mar 16 16:12:00 crc kubenswrapper[5120]: I0316 16:12:00.726390 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/601bff35-3d2b-4301-abdc-17ddf2e2b9eb-vencrypt-tls-certs" (OuterVolumeSpecName: "vencrypt-tls-certs") pod "601bff35-3d2b-4301-abdc-17ddf2e2b9eb" (UID: "601bff35-3d2b-4301-abdc-17ddf2e2b9eb"). InnerVolumeSpecName "vencrypt-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:00 crc kubenswrapper[5120]: I0316 16:12:00.791887 5120 reconciler_common.go:299] "Volume detached for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/601bff35-3d2b-4301-abdc-17ddf2e2b9eb-vencrypt-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:00 crc kubenswrapper[5120]: I0316 16:12:00.792162 5120 reconciler_common.go:299] "Volume detached for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/601bff35-3d2b-4301-abdc-17ddf2e2b9eb-nova-novncproxy-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:01 crc kubenswrapper[5120]: I0316 16:12:01.077787 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-worker-744867f48f-8dw6x"] Mar 16 16:12:01 crc kubenswrapper[5120]: I0316 16:12:01.078797 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="601bff35-3d2b-4301-abdc-17ddf2e2b9eb" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 16:12:01 crc kubenswrapper[5120]: I0316 16:12:01.078815 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="601bff35-3d2b-4301-abdc-17ddf2e2b9eb" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 16:12:01 crc kubenswrapper[5120]: I0316 16:12:01.078976 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="601bff35-3d2b-4301-abdc-17ddf2e2b9eb" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 16:12:01 crc kubenswrapper[5120]: I0316 16:12:01.116028 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-74b77cc694-lzqfl"] Mar 16 16:12:01 crc kubenswrapper[5120]: I0316 16:12:01.117006 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-744867f48f-8dw6x" Mar 16 16:12:01 crc kubenswrapper[5120]: I0316 16:12:01.143879 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-74b77cc694-lzqfl" Mar 16 16:12:01 crc kubenswrapper[5120]: I0316 16:12:01.144051 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-744867f48f-8dw6x"] Mar 16 16:12:01 crc kubenswrapper[5120]: I0316 16:12:01.194219 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-74b77cc694-lzqfl"] Mar 16 16:12:01 crc kubenswrapper[5120]: I0316 16:12:01.209235 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561292-z2wqq"] Mar 16 16:12:01 crc kubenswrapper[5120]: I0316 16:12:01.240559 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-api-6fccf8d5b-2gznd"] Mar 16 16:12:01 crc kubenswrapper[5120]: I0316 16:12:01.259572 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-6fccf8d5b-2gznd"] Mar 16 16:12:01 crc kubenswrapper[5120]: I0316 16:12:01.259922 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-6fccf8d5b-2gznd" Mar 16 16:12:01 crc kubenswrapper[5120]: I0316 16:12:01.264487 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"4fce708d-9952-41be-95e4-de815da4d75a","Type":"ContainerStarted","Data":"e6adb6aa278524b21809ea635d79dd070b619cb7e9db829e8e806fea4f7e69e7"} Mar 16 16:12:01 crc kubenswrapper[5120]: E0316 16:12:01.267305 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="31a2fce1e20c5b62f2a74ffb53802354c75a971f977ab88fe1d0d2ac24820f8d" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:12:01 crc kubenswrapper[5120]: E0316 16:12:01.279618 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="31a2fce1e20c5b62f2a74ffb53802354c75a971f977ab88fe1d0d2ac24820f8d" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:12:01 crc kubenswrapper[5120]: I0316 16:12:01.282974 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"0bbb1bbc-8c14-4046-bd63-cce793589d4d","Type":"ContainerStarted","Data":"9d0eb7f54ad73e5e0176f83bb44308788c3b7db237e47e155f80722c12eb04ab"} Mar 16 16:12:01 crc kubenswrapper[5120]: E0316 16:12:01.284616 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="31a2fce1e20c5b62f2a74ffb53802354c75a971f977ab88fe1d0d2ac24820f8d" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:12:01 crc kubenswrapper[5120]: E0316 16:12:01.284684 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="3e95e501-6a44-4736-aa20-72fe1a2bb1a8" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 16:12:01 crc kubenswrapper[5120]: I0316 16:12:01.304393 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"5aa11a39-e139-4791-92ce-2771b0277a8b","Type":"ContainerStarted","Data":"11f81caa83f0c9ef60769664b8c971b68ba4bc25cc7de3bb33d429ea3b426e32"} Mar 16 16:12:01 crc kubenswrapper[5120]: I0316 16:12:01.308797 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:12:01 crc kubenswrapper[5120]: I0316 16:12:01.309005 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"601bff35-3d2b-4301-abdc-17ddf2e2b9eb","Type":"ContainerDied","Data":"9b1653ebcb78902e6fa6f71e8a98a4338ef464f889f7cdc16b06ca0bb3b534df"} Mar 16 16:12:01 crc kubenswrapper[5120]: I0316 16:12:01.309071 5120 scope.go:117] "RemoveContainer" containerID="1fb5c938a8cc434d5d6acbf8795148fc1d15481e3ef51a7665017c74c309e1f4" Mar 16 16:12:01 crc kubenswrapper[5120]: I0316 16:12:01.310546 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/8f51149f-2af3-4bb8-ab7a-1b94ca6754e5-config-data-custom\") pod \"barbican-keystone-listener-74b77cc694-lzqfl\" (UID: \"8f51149f-2af3-4bb8-ab7a-1b94ca6754e5\") " pod="openstack-kuttl-tests/barbican-keystone-listener-74b77cc694-lzqfl" Mar 16 16:12:01 crc kubenswrapper[5120]: I0316 16:12:01.310687 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkxn7\" (UniqueName: \"kubernetes.io/projected/8f51149f-2af3-4bb8-ab7a-1b94ca6754e5-kube-api-access-nkxn7\") pod \"barbican-keystone-listener-74b77cc694-lzqfl\" (UID: \"8f51149f-2af3-4bb8-ab7a-1b94ca6754e5\") " pod="openstack-kuttl-tests/barbican-keystone-listener-74b77cc694-lzqfl" Mar 16 16:12:01 crc kubenswrapper[5120]: I0316 16:12:01.310990 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0df9d7ea-2a19-45b4-b350-7c0e91a5d960-logs\") pod \"barbican-worker-744867f48f-8dw6x\" (UID: \"0df9d7ea-2a19-45b4-b350-7c0e91a5d960\") " pod="openstack-kuttl-tests/barbican-worker-744867f48f-8dw6x" Mar 16 16:12:01 crc kubenswrapper[5120]: I0316 16:12:01.311176 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hq7c5\" (UniqueName: \"kubernetes.io/projected/0df9d7ea-2a19-45b4-b350-7c0e91a5d960-kube-api-access-hq7c5\") pod \"barbican-worker-744867f48f-8dw6x\" (UID: \"0df9d7ea-2a19-45b4-b350-7c0e91a5d960\") " pod="openstack-kuttl-tests/barbican-worker-744867f48f-8dw6x" Mar 16 16:12:01 crc kubenswrapper[5120]: I0316 16:12:01.311280 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8f51149f-2af3-4bb8-ab7a-1b94ca6754e5-config-data\") pod \"barbican-keystone-listener-74b77cc694-lzqfl\" (UID: \"8f51149f-2af3-4bb8-ab7a-1b94ca6754e5\") " pod="openstack-kuttl-tests/barbican-keystone-listener-74b77cc694-lzqfl" Mar 16 16:12:01 crc kubenswrapper[5120]: I0316 16:12:01.311643 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8f51149f-2af3-4bb8-ab7a-1b94ca6754e5-logs\") pod \"barbican-keystone-listener-74b77cc694-lzqfl\" (UID: \"8f51149f-2af3-4bb8-ab7a-1b94ca6754e5\") " pod="openstack-kuttl-tests/barbican-keystone-listener-74b77cc694-lzqfl" Mar 16 16:12:01 crc kubenswrapper[5120]: I0316 16:12:01.311716 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/0df9d7ea-2a19-45b4-b350-7c0e91a5d960-config-data-custom\") pod \"barbican-worker-744867f48f-8dw6x\" (UID: \"0df9d7ea-2a19-45b4-b350-7c0e91a5d960\") " pod="openstack-kuttl-tests/barbican-worker-744867f48f-8dw6x" Mar 16 16:12:01 crc kubenswrapper[5120]: I0316 16:12:01.312037 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0df9d7ea-2a19-45b4-b350-7c0e91a5d960-combined-ca-bundle\") pod \"barbican-worker-744867f48f-8dw6x\" (UID: \"0df9d7ea-2a19-45b4-b350-7c0e91a5d960\") " pod="openstack-kuttl-tests/barbican-worker-744867f48f-8dw6x" Mar 16 16:12:01 crc kubenswrapper[5120]: I0316 16:12:01.312117 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0df9d7ea-2a19-45b4-b350-7c0e91a5d960-config-data\") pod \"barbican-worker-744867f48f-8dw6x\" (UID: \"0df9d7ea-2a19-45b4-b350-7c0e91a5d960\") " pod="openstack-kuttl-tests/barbican-worker-744867f48f-8dw6x" Mar 16 16:12:01 crc kubenswrapper[5120]: I0316 16:12:01.312200 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8f51149f-2af3-4bb8-ab7a-1b94ca6754e5-combined-ca-bundle\") pod \"barbican-keystone-listener-74b77cc694-lzqfl\" (UID: \"8f51149f-2af3-4bb8-ab7a-1b94ca6754e5\") " pod="openstack-kuttl-tests/barbican-keystone-listener-74b77cc694-lzqfl" Mar 16 16:12:01 crc kubenswrapper[5120]: I0316 16:12:01.365025 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:12:01 crc kubenswrapper[5120]: I0316 16:12:01.384351 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:12:01 crc kubenswrapper[5120]: I0316 16:12:01.414014 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8f51149f-2af3-4bb8-ab7a-1b94ca6754e5-config-data\") pod \"barbican-keystone-listener-74b77cc694-lzqfl\" (UID: \"8f51149f-2af3-4bb8-ab7a-1b94ca6754e5\") " pod="openstack-kuttl-tests/barbican-keystone-listener-74b77cc694-lzqfl" Mar 16 16:12:01 crc kubenswrapper[5120]: I0316 16:12:01.414179 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e69accdc-df7e-43d7-a3f4-63e6157a9721-internal-tls-certs\") pod \"barbican-api-6fccf8d5b-2gznd\" (UID: \"e69accdc-df7e-43d7-a3f4-63e6157a9721\") " pod="openstack-kuttl-tests/barbican-api-6fccf8d5b-2gznd" Mar 16 16:12:01 crc kubenswrapper[5120]: I0316 16:12:01.414207 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8f51149f-2af3-4bb8-ab7a-1b94ca6754e5-logs\") pod \"barbican-keystone-listener-74b77cc694-lzqfl\" (UID: \"8f51149f-2af3-4bb8-ab7a-1b94ca6754e5\") " pod="openstack-kuttl-tests/barbican-keystone-listener-74b77cc694-lzqfl" Mar 16 16:12:01 crc kubenswrapper[5120]: I0316 16:12:01.414230 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/0df9d7ea-2a19-45b4-b350-7c0e91a5d960-config-data-custom\") pod \"barbican-worker-744867f48f-8dw6x\" (UID: \"0df9d7ea-2a19-45b4-b350-7c0e91a5d960\") " pod="openstack-kuttl-tests/barbican-worker-744867f48f-8dw6x" Mar 16 16:12:01 crc kubenswrapper[5120]: I0316 16:12:01.414286 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0df9d7ea-2a19-45b4-b350-7c0e91a5d960-combined-ca-bundle\") pod \"barbican-worker-744867f48f-8dw6x\" (UID: \"0df9d7ea-2a19-45b4-b350-7c0e91a5d960\") " pod="openstack-kuttl-tests/barbican-worker-744867f48f-8dw6x" Mar 16 16:12:01 crc kubenswrapper[5120]: I0316 16:12:01.414309 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e69accdc-df7e-43d7-a3f4-63e6157a9721-logs\") pod \"barbican-api-6fccf8d5b-2gznd\" (UID: \"e69accdc-df7e-43d7-a3f4-63e6157a9721\") " pod="openstack-kuttl-tests/barbican-api-6fccf8d5b-2gznd" Mar 16 16:12:01 crc kubenswrapper[5120]: I0316 16:12:01.415333 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0df9d7ea-2a19-45b4-b350-7c0e91a5d960-config-data\") pod \"barbican-worker-744867f48f-8dw6x\" (UID: \"0df9d7ea-2a19-45b4-b350-7c0e91a5d960\") " pod="openstack-kuttl-tests/barbican-worker-744867f48f-8dw6x" Mar 16 16:12:01 crc kubenswrapper[5120]: I0316 16:12:01.415361 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nsdzc\" (UniqueName: \"kubernetes.io/projected/e69accdc-df7e-43d7-a3f4-63e6157a9721-kube-api-access-nsdzc\") pod \"barbican-api-6fccf8d5b-2gznd\" (UID: \"e69accdc-df7e-43d7-a3f4-63e6157a9721\") " pod="openstack-kuttl-tests/barbican-api-6fccf8d5b-2gznd" Mar 16 16:12:01 crc kubenswrapper[5120]: I0316 16:12:01.415386 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8f51149f-2af3-4bb8-ab7a-1b94ca6754e5-combined-ca-bundle\") pod \"barbican-keystone-listener-74b77cc694-lzqfl\" (UID: \"8f51149f-2af3-4bb8-ab7a-1b94ca6754e5\") " pod="openstack-kuttl-tests/barbican-keystone-listener-74b77cc694-lzqfl" Mar 16 16:12:01 crc kubenswrapper[5120]: I0316 16:12:01.415383 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8f51149f-2af3-4bb8-ab7a-1b94ca6754e5-logs\") pod \"barbican-keystone-listener-74b77cc694-lzqfl\" (UID: \"8f51149f-2af3-4bb8-ab7a-1b94ca6754e5\") " pod="openstack-kuttl-tests/barbican-keystone-listener-74b77cc694-lzqfl" Mar 16 16:12:01 crc kubenswrapper[5120]: I0316 16:12:01.415507 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/8f51149f-2af3-4bb8-ab7a-1b94ca6754e5-config-data-custom\") pod \"barbican-keystone-listener-74b77cc694-lzqfl\" (UID: \"8f51149f-2af3-4bb8-ab7a-1b94ca6754e5\") " pod="openstack-kuttl-tests/barbican-keystone-listener-74b77cc694-lzqfl" Mar 16 16:12:01 crc kubenswrapper[5120]: I0316 16:12:01.415557 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e69accdc-df7e-43d7-a3f4-63e6157a9721-config-data\") pod \"barbican-api-6fccf8d5b-2gznd\" (UID: \"e69accdc-df7e-43d7-a3f4-63e6157a9721\") " pod="openstack-kuttl-tests/barbican-api-6fccf8d5b-2gznd" Mar 16 16:12:01 crc kubenswrapper[5120]: I0316 16:12:01.415596 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nkxn7\" (UniqueName: \"kubernetes.io/projected/8f51149f-2af3-4bb8-ab7a-1b94ca6754e5-kube-api-access-nkxn7\") pod \"barbican-keystone-listener-74b77cc694-lzqfl\" (UID: \"8f51149f-2af3-4bb8-ab7a-1b94ca6754e5\") " pod="openstack-kuttl-tests/barbican-keystone-listener-74b77cc694-lzqfl" Mar 16 16:12:01 crc kubenswrapper[5120]: I0316 16:12:01.415724 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e69accdc-df7e-43d7-a3f4-63e6157a9721-public-tls-certs\") pod \"barbican-api-6fccf8d5b-2gznd\" (UID: \"e69accdc-df7e-43d7-a3f4-63e6157a9721\") " pod="openstack-kuttl-tests/barbican-api-6fccf8d5b-2gznd" Mar 16 16:12:01 crc kubenswrapper[5120]: I0316 16:12:01.415790 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0df9d7ea-2a19-45b4-b350-7c0e91a5d960-logs\") pod \"barbican-worker-744867f48f-8dw6x\" (UID: \"0df9d7ea-2a19-45b4-b350-7c0e91a5d960\") " pod="openstack-kuttl-tests/barbican-worker-744867f48f-8dw6x" Mar 16 16:12:01 crc kubenswrapper[5120]: I0316 16:12:01.416476 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0df9d7ea-2a19-45b4-b350-7c0e91a5d960-logs\") pod \"barbican-worker-744867f48f-8dw6x\" (UID: \"0df9d7ea-2a19-45b4-b350-7c0e91a5d960\") " pod="openstack-kuttl-tests/barbican-worker-744867f48f-8dw6x" Mar 16 16:12:01 crc kubenswrapper[5120]: I0316 16:12:01.416563 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hq7c5\" (UniqueName: \"kubernetes.io/projected/0df9d7ea-2a19-45b4-b350-7c0e91a5d960-kube-api-access-hq7c5\") pod \"barbican-worker-744867f48f-8dw6x\" (UID: \"0df9d7ea-2a19-45b4-b350-7c0e91a5d960\") " pod="openstack-kuttl-tests/barbican-worker-744867f48f-8dw6x" Mar 16 16:12:01 crc kubenswrapper[5120]: I0316 16:12:01.416585 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/e69accdc-df7e-43d7-a3f4-63e6157a9721-config-data-custom\") pod \"barbican-api-6fccf8d5b-2gznd\" (UID: \"e69accdc-df7e-43d7-a3f4-63e6157a9721\") " pod="openstack-kuttl-tests/barbican-api-6fccf8d5b-2gznd" Mar 16 16:12:01 crc kubenswrapper[5120]: I0316 16:12:01.416606 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e69accdc-df7e-43d7-a3f4-63e6157a9721-combined-ca-bundle\") pod \"barbican-api-6fccf8d5b-2gznd\" (UID: \"e69accdc-df7e-43d7-a3f4-63e6157a9721\") " pod="openstack-kuttl-tests/barbican-api-6fccf8d5b-2gznd" Mar 16 16:12:01 crc kubenswrapper[5120]: I0316 16:12:01.419952 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:12:01 crc kubenswrapper[5120]: I0316 16:12:01.422492 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0df9d7ea-2a19-45b4-b350-7c0e91a5d960-config-data\") pod \"barbican-worker-744867f48f-8dw6x\" (UID: \"0df9d7ea-2a19-45b4-b350-7c0e91a5d960\") " pod="openstack-kuttl-tests/barbican-worker-744867f48f-8dw6x" Mar 16 16:12:01 crc kubenswrapper[5120]: I0316 16:12:01.423257 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8f51149f-2af3-4bb8-ab7a-1b94ca6754e5-combined-ca-bundle\") pod \"barbican-keystone-listener-74b77cc694-lzqfl\" (UID: \"8f51149f-2af3-4bb8-ab7a-1b94ca6754e5\") " pod="openstack-kuttl-tests/barbican-keystone-listener-74b77cc694-lzqfl" Mar 16 16:12:01 crc kubenswrapper[5120]: I0316 16:12:01.424610 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/0df9d7ea-2a19-45b4-b350-7c0e91a5d960-config-data-custom\") pod \"barbican-worker-744867f48f-8dw6x\" (UID: \"0df9d7ea-2a19-45b4-b350-7c0e91a5d960\") " pod="openstack-kuttl-tests/barbican-worker-744867f48f-8dw6x" Mar 16 16:12:01 crc kubenswrapper[5120]: I0316 16:12:01.428553 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/8f51149f-2af3-4bb8-ab7a-1b94ca6754e5-config-data-custom\") pod \"barbican-keystone-listener-74b77cc694-lzqfl\" (UID: \"8f51149f-2af3-4bb8-ab7a-1b94ca6754e5\") " pod="openstack-kuttl-tests/barbican-keystone-listener-74b77cc694-lzqfl" Mar 16 16:12:01 crc kubenswrapper[5120]: I0316 16:12:01.430503 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8f51149f-2af3-4bb8-ab7a-1b94ca6754e5-config-data\") pod \"barbican-keystone-listener-74b77cc694-lzqfl\" (UID: \"8f51149f-2af3-4bb8-ab7a-1b94ca6754e5\") " pod="openstack-kuttl-tests/barbican-keystone-listener-74b77cc694-lzqfl" Mar 16 16:12:01 crc kubenswrapper[5120]: I0316 16:12:01.434975 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkxn7\" (UniqueName: \"kubernetes.io/projected/8f51149f-2af3-4bb8-ab7a-1b94ca6754e5-kube-api-access-nkxn7\") pod \"barbican-keystone-listener-74b77cc694-lzqfl\" (UID: \"8f51149f-2af3-4bb8-ab7a-1b94ca6754e5\") " pod="openstack-kuttl-tests/barbican-keystone-listener-74b77cc694-lzqfl" Mar 16 16:12:01 crc kubenswrapper[5120]: I0316 16:12:01.436138 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:12:01 crc kubenswrapper[5120]: I0316 16:12:01.437489 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0df9d7ea-2a19-45b4-b350-7c0e91a5d960-combined-ca-bundle\") pod \"barbican-worker-744867f48f-8dw6x\" (UID: \"0df9d7ea-2a19-45b4-b350-7c0e91a5d960\") " pod="openstack-kuttl-tests/barbican-worker-744867f48f-8dw6x" Mar 16 16:12:01 crc kubenswrapper[5120]: I0316 16:12:01.440579 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hq7c5\" (UniqueName: \"kubernetes.io/projected/0df9d7ea-2a19-45b4-b350-7c0e91a5d960-kube-api-access-hq7c5\") pod \"barbican-worker-744867f48f-8dw6x\" (UID: \"0df9d7ea-2a19-45b4-b350-7c0e91a5d960\") " pod="openstack-kuttl-tests/barbican-worker-744867f48f-8dw6x" Mar 16 16:12:01 crc kubenswrapper[5120]: I0316 16:12:01.443247 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-novncproxy-config-data\"" Mar 16 16:12:01 crc kubenswrapper[5120]: I0316 16:12:01.443344 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-novncproxy-cell1-vencrypt\"" Mar 16 16:12:01 crc kubenswrapper[5120]: I0316 16:12:01.443248 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-novncproxy-cell1-public-svc\"" Mar 16 16:12:01 crc kubenswrapper[5120]: I0316 16:12:01.482068 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:12:01 crc kubenswrapper[5120]: I0316 16:12:01.517974 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nsdzc\" (UniqueName: \"kubernetes.io/projected/e69accdc-df7e-43d7-a3f4-63e6157a9721-kube-api-access-nsdzc\") pod \"barbican-api-6fccf8d5b-2gznd\" (UID: \"e69accdc-df7e-43d7-a3f4-63e6157a9721\") " pod="openstack-kuttl-tests/barbican-api-6fccf8d5b-2gznd" Mar 16 16:12:01 crc kubenswrapper[5120]: I0316 16:12:01.518063 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e69accdc-df7e-43d7-a3f4-63e6157a9721-config-data\") pod \"barbican-api-6fccf8d5b-2gznd\" (UID: \"e69accdc-df7e-43d7-a3f4-63e6157a9721\") " pod="openstack-kuttl-tests/barbican-api-6fccf8d5b-2gznd" Mar 16 16:12:01 crc kubenswrapper[5120]: I0316 16:12:01.518122 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e69accdc-df7e-43d7-a3f4-63e6157a9721-public-tls-certs\") pod \"barbican-api-6fccf8d5b-2gznd\" (UID: \"e69accdc-df7e-43d7-a3f4-63e6157a9721\") " pod="openstack-kuttl-tests/barbican-api-6fccf8d5b-2gznd" Mar 16 16:12:01 crc kubenswrapper[5120]: I0316 16:12:01.518167 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/e69accdc-df7e-43d7-a3f4-63e6157a9721-config-data-custom\") pod \"barbican-api-6fccf8d5b-2gznd\" (UID: \"e69accdc-df7e-43d7-a3f4-63e6157a9721\") " pod="openstack-kuttl-tests/barbican-api-6fccf8d5b-2gznd" Mar 16 16:12:01 crc kubenswrapper[5120]: I0316 16:12:01.518190 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e69accdc-df7e-43d7-a3f4-63e6157a9721-combined-ca-bundle\") pod \"barbican-api-6fccf8d5b-2gznd\" (UID: \"e69accdc-df7e-43d7-a3f4-63e6157a9721\") " pod="openstack-kuttl-tests/barbican-api-6fccf8d5b-2gznd" Mar 16 16:12:01 crc kubenswrapper[5120]: I0316 16:12:01.518286 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e69accdc-df7e-43d7-a3f4-63e6157a9721-internal-tls-certs\") pod \"barbican-api-6fccf8d5b-2gznd\" (UID: \"e69accdc-df7e-43d7-a3f4-63e6157a9721\") " pod="openstack-kuttl-tests/barbican-api-6fccf8d5b-2gznd" Mar 16 16:12:01 crc kubenswrapper[5120]: I0316 16:12:01.518358 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e69accdc-df7e-43d7-a3f4-63e6157a9721-logs\") pod \"barbican-api-6fccf8d5b-2gznd\" (UID: \"e69accdc-df7e-43d7-a3f4-63e6157a9721\") " pod="openstack-kuttl-tests/barbican-api-6fccf8d5b-2gznd" Mar 16 16:12:01 crc kubenswrapper[5120]: I0316 16:12:01.518803 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e69accdc-df7e-43d7-a3f4-63e6157a9721-logs\") pod \"barbican-api-6fccf8d5b-2gznd\" (UID: \"e69accdc-df7e-43d7-a3f4-63e6157a9721\") " pod="openstack-kuttl-tests/barbican-api-6fccf8d5b-2gznd" Mar 16 16:12:01 crc kubenswrapper[5120]: I0316 16:12:01.528313 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e69accdc-df7e-43d7-a3f4-63e6157a9721-config-data\") pod \"barbican-api-6fccf8d5b-2gznd\" (UID: \"e69accdc-df7e-43d7-a3f4-63e6157a9721\") " pod="openstack-kuttl-tests/barbican-api-6fccf8d5b-2gznd" Mar 16 16:12:01 crc kubenswrapper[5120]: I0316 16:12:01.531777 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e69accdc-df7e-43d7-a3f4-63e6157a9721-public-tls-certs\") pod \"barbican-api-6fccf8d5b-2gznd\" (UID: \"e69accdc-df7e-43d7-a3f4-63e6157a9721\") " pod="openstack-kuttl-tests/barbican-api-6fccf8d5b-2gznd" Mar 16 16:12:01 crc kubenswrapper[5120]: I0316 16:12:01.531955 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/e69accdc-df7e-43d7-a3f4-63e6157a9721-config-data-custom\") pod \"barbican-api-6fccf8d5b-2gznd\" (UID: \"e69accdc-df7e-43d7-a3f4-63e6157a9721\") " pod="openstack-kuttl-tests/barbican-api-6fccf8d5b-2gznd" Mar 16 16:12:01 crc kubenswrapper[5120]: I0316 16:12:01.533252 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e69accdc-df7e-43d7-a3f4-63e6157a9721-combined-ca-bundle\") pod \"barbican-api-6fccf8d5b-2gznd\" (UID: \"e69accdc-df7e-43d7-a3f4-63e6157a9721\") " pod="openstack-kuttl-tests/barbican-api-6fccf8d5b-2gznd" Mar 16 16:12:01 crc kubenswrapper[5120]: I0316 16:12:01.541052 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e69accdc-df7e-43d7-a3f4-63e6157a9721-internal-tls-certs\") pod \"barbican-api-6fccf8d5b-2gznd\" (UID: \"e69accdc-df7e-43d7-a3f4-63e6157a9721\") " pod="openstack-kuttl-tests/barbican-api-6fccf8d5b-2gznd" Mar 16 16:12:01 crc kubenswrapper[5120]: I0316 16:12:01.544561 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nsdzc\" (UniqueName: \"kubernetes.io/projected/e69accdc-df7e-43d7-a3f4-63e6157a9721-kube-api-access-nsdzc\") pod \"barbican-api-6fccf8d5b-2gznd\" (UID: \"e69accdc-df7e-43d7-a3f4-63e6157a9721\") " pod="openstack-kuttl-tests/barbican-api-6fccf8d5b-2gznd" Mar 16 16:12:01 crc kubenswrapper[5120]: I0316 16:12:01.584112 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-744867f48f-8dw6x" Mar 16 16:12:01 crc kubenswrapper[5120]: I0316 16:12:01.589179 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-74b77cc694-lzqfl" Mar 16 16:12:01 crc kubenswrapper[5120]: I0316 16:12:01.599773 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-6fccf8d5b-2gznd" Mar 16 16:12:01 crc kubenswrapper[5120]: I0316 16:12:01.621547 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dae19557-6584-433e-a345-c373d9e8a4ae-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"dae19557-6584-433e-a345-c373d9e8a4ae\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:12:01 crc kubenswrapper[5120]: I0316 16:12:01.621675 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/dae19557-6584-433e-a345-c373d9e8a4ae-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"dae19557-6584-433e-a345-c373d9e8a4ae\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:12:01 crc kubenswrapper[5120]: I0316 16:12:01.621810 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtq4k\" (UniqueName: \"kubernetes.io/projected/dae19557-6584-433e-a345-c373d9e8a4ae-kube-api-access-wtq4k\") pod \"nova-cell1-novncproxy-0\" (UID: \"dae19557-6584-433e-a345-c373d9e8a4ae\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:12:01 crc kubenswrapper[5120]: I0316 16:12:01.621898 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dae19557-6584-433e-a345-c373d9e8a4ae-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"dae19557-6584-433e-a345-c373d9e8a4ae\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:12:01 crc kubenswrapper[5120]: I0316 16:12:01.621951 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/dae19557-6584-433e-a345-c373d9e8a4ae-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"dae19557-6584-433e-a345-c373d9e8a4ae\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:12:01 crc kubenswrapper[5120]: I0316 16:12:01.723791 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dae19557-6584-433e-a345-c373d9e8a4ae-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"dae19557-6584-433e-a345-c373d9e8a4ae\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:12:01 crc kubenswrapper[5120]: I0316 16:12:01.723873 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/dae19557-6584-433e-a345-c373d9e8a4ae-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"dae19557-6584-433e-a345-c373d9e8a4ae\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:12:01 crc kubenswrapper[5120]: I0316 16:12:01.723957 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wtq4k\" (UniqueName: \"kubernetes.io/projected/dae19557-6584-433e-a345-c373d9e8a4ae-kube-api-access-wtq4k\") pod \"nova-cell1-novncproxy-0\" (UID: \"dae19557-6584-433e-a345-c373d9e8a4ae\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:12:01 crc kubenswrapper[5120]: I0316 16:12:01.724018 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dae19557-6584-433e-a345-c373d9e8a4ae-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"dae19557-6584-433e-a345-c373d9e8a4ae\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:12:01 crc kubenswrapper[5120]: I0316 16:12:01.724050 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/dae19557-6584-433e-a345-c373d9e8a4ae-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"dae19557-6584-433e-a345-c373d9e8a4ae\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:12:01 crc kubenswrapper[5120]: I0316 16:12:01.730357 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/dae19557-6584-433e-a345-c373d9e8a4ae-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"dae19557-6584-433e-a345-c373d9e8a4ae\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:12:01 crc kubenswrapper[5120]: I0316 16:12:01.730471 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dae19557-6584-433e-a345-c373d9e8a4ae-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"dae19557-6584-433e-a345-c373d9e8a4ae\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:12:01 crc kubenswrapper[5120]: I0316 16:12:01.732847 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/dae19557-6584-433e-a345-c373d9e8a4ae-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"dae19557-6584-433e-a345-c373d9e8a4ae\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:12:01 crc kubenswrapper[5120]: I0316 16:12:01.752330 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtq4k\" (UniqueName: \"kubernetes.io/projected/dae19557-6584-433e-a345-c373d9e8a4ae-kube-api-access-wtq4k\") pod \"nova-cell1-novncproxy-0\" (UID: \"dae19557-6584-433e-a345-c373d9e8a4ae\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:12:01 crc kubenswrapper[5120]: I0316 16:12:01.752945 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dae19557-6584-433e-a345-c373d9e8a4ae-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"dae19557-6584-433e-a345-c373d9e8a4ae\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:12:01 crc kubenswrapper[5120]: I0316 16:12:01.791104 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-74b77cc694-lzqfl"] Mar 16 16:12:01 crc kubenswrapper[5120]: I0316 16:12:01.831134 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-744867f48f-8dw6x"] Mar 16 16:12:01 crc kubenswrapper[5120]: I0316 16:12:01.864443 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-999b785fd-fgwkp"] Mar 16 16:12:01 crc kubenswrapper[5120]: I0316 16:12:01.877208 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:12:01 crc kubenswrapper[5120]: I0316 16:12:01.894937 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-999b785fd-fgwkp"] Mar 16 16:12:01 crc kubenswrapper[5120]: I0316 16:12:01.895080 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-999b785fd-fgwkp" Mar 16 16:12:01 crc kubenswrapper[5120]: I0316 16:12:01.908664 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-6fccf8d5b-2gznd"] Mar 16 16:12:01 crc kubenswrapper[5120]: I0316 16:12:01.908996 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/nova-api-0" podUID="a4afa8e8-c485-4903-b53b-864c0517374e" containerName="nova-api-api" probeResult="failure" output="Get \"https://10.217.0.139:8774/\": read tcp 10.217.0.2:48782->10.217.0.139:8774: read: connection reset by peer" Mar 16 16:12:01 crc kubenswrapper[5120]: I0316 16:12:01.915919 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/nova-api-0" podUID="a4afa8e8-c485-4903-b53b-864c0517374e" containerName="nova-api-log" probeResult="failure" output="Get \"https://10.217.0.139:8774/\": read tcp 10.217.0.2:48794->10.217.0.139:8774: read: connection reset by peer" Mar 16 16:12:01 crc kubenswrapper[5120]: I0316 16:12:01.929799 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-worker-5c69df9cf-mtvpx"] Mar 16 16:12:01 crc kubenswrapper[5120]: I0316 16:12:01.942341 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/e929a717-3e1e-4481-9e69-3705d47c1d87-config-data-custom\") pod \"barbican-keystone-listener-999b785fd-fgwkp\" (UID: \"e929a717-3e1e-4481-9e69-3705d47c1d87\") " pod="openstack-kuttl-tests/barbican-keystone-listener-999b785fd-fgwkp" Mar 16 16:12:01 crc kubenswrapper[5120]: I0316 16:12:01.942411 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e929a717-3e1e-4481-9e69-3705d47c1d87-combined-ca-bundle\") pod \"barbican-keystone-listener-999b785fd-fgwkp\" (UID: \"e929a717-3e1e-4481-9e69-3705d47c1d87\") " pod="openstack-kuttl-tests/barbican-keystone-listener-999b785fd-fgwkp" Mar 16 16:12:01 crc kubenswrapper[5120]: I0316 16:12:01.942442 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dpzjx\" (UniqueName: \"kubernetes.io/projected/e929a717-3e1e-4481-9e69-3705d47c1d87-kube-api-access-dpzjx\") pod \"barbican-keystone-listener-999b785fd-fgwkp\" (UID: \"e929a717-3e1e-4481-9e69-3705d47c1d87\") " pod="openstack-kuttl-tests/barbican-keystone-listener-999b785fd-fgwkp" Mar 16 16:12:01 crc kubenswrapper[5120]: I0316 16:12:01.942474 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e929a717-3e1e-4481-9e69-3705d47c1d87-config-data\") pod \"barbican-keystone-listener-999b785fd-fgwkp\" (UID: \"e929a717-3e1e-4481-9e69-3705d47c1d87\") " pod="openstack-kuttl-tests/barbican-keystone-listener-999b785fd-fgwkp" Mar 16 16:12:01 crc kubenswrapper[5120]: I0316 16:12:01.946985 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e929a717-3e1e-4481-9e69-3705d47c1d87-logs\") pod \"barbican-keystone-listener-999b785fd-fgwkp\" (UID: \"e929a717-3e1e-4481-9e69-3705d47c1d87\") " pod="openstack-kuttl-tests/barbican-keystone-listener-999b785fd-fgwkp" Mar 16 16:12:01 crc kubenswrapper[5120]: I0316 16:12:01.947473 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-5c69df9cf-mtvpx"] Mar 16 16:12:01 crc kubenswrapper[5120]: I0316 16:12:01.947582 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-5c69df9cf-mtvpx" Mar 16 16:12:01 crc kubenswrapper[5120]: I0316 16:12:01.964979 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-api-69787fc498-jx88k"] Mar 16 16:12:01 crc kubenswrapper[5120]: I0316 16:12:01.981915 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-69787fc498-jx88k"] Mar 16 16:12:01 crc kubenswrapper[5120]: I0316 16:12:01.982084 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-69787fc498-jx88k" Mar 16 16:12:02 crc kubenswrapper[5120]: I0316 16:12:02.000896 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 16:12:02 crc kubenswrapper[5120]: I0316 16:12:02.001106 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="12b38435-0635-409b-8888-94cdc5433388" containerName="nova-cell1-conductor-conductor" containerID="cri-o://cf7a9dd6bfa88e8fccaa1a621f03d0b496debb8fa72832274da01cb03305c90a" gracePeriod=30 Mar 16 16:12:02 crc kubenswrapper[5120]: I0316 16:12:02.052235 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4b1fbfd4-c276-42c0-8419-fbe793f89ad7-logs\") pod \"barbican-worker-5c69df9cf-mtvpx\" (UID: \"4b1fbfd4-c276-42c0-8419-fbe793f89ad7\") " pod="openstack-kuttl-tests/barbican-worker-5c69df9cf-mtvpx" Mar 16 16:12:02 crc kubenswrapper[5120]: I0316 16:12:02.052360 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/4b1fbfd4-c276-42c0-8419-fbe793f89ad7-config-data-custom\") pod \"barbican-worker-5c69df9cf-mtvpx\" (UID: \"4b1fbfd4-c276-42c0-8419-fbe793f89ad7\") " pod="openstack-kuttl-tests/barbican-worker-5c69df9cf-mtvpx" Mar 16 16:12:02 crc kubenswrapper[5120]: I0316 16:12:02.052406 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75xjs\" (UniqueName: \"kubernetes.io/projected/4b1fbfd4-c276-42c0-8419-fbe793f89ad7-kube-api-access-75xjs\") pod \"barbican-worker-5c69df9cf-mtvpx\" (UID: \"4b1fbfd4-c276-42c0-8419-fbe793f89ad7\") " pod="openstack-kuttl-tests/barbican-worker-5c69df9cf-mtvpx" Mar 16 16:12:02 crc kubenswrapper[5120]: I0316 16:12:02.052532 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/34da2089-cc88-4d8c-97da-68aadf7f2c03-config-data-custom\") pod \"barbican-api-69787fc498-jx88k\" (UID: \"34da2089-cc88-4d8c-97da-68aadf7f2c03\") " pod="openstack-kuttl-tests/barbican-api-69787fc498-jx88k" Mar 16 16:12:02 crc kubenswrapper[5120]: I0316 16:12:02.052631 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/34da2089-cc88-4d8c-97da-68aadf7f2c03-public-tls-certs\") pod \"barbican-api-69787fc498-jx88k\" (UID: \"34da2089-cc88-4d8c-97da-68aadf7f2c03\") " pod="openstack-kuttl-tests/barbican-api-69787fc498-jx88k" Mar 16 16:12:02 crc kubenswrapper[5120]: I0316 16:12:02.052732 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/e929a717-3e1e-4481-9e69-3705d47c1d87-config-data-custom\") pod \"barbican-keystone-listener-999b785fd-fgwkp\" (UID: \"e929a717-3e1e-4481-9e69-3705d47c1d87\") " pod="openstack-kuttl-tests/barbican-keystone-listener-999b785fd-fgwkp" Mar 16 16:12:02 crc kubenswrapper[5120]: I0316 16:12:02.052872 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4b1fbfd4-c276-42c0-8419-fbe793f89ad7-config-data\") pod \"barbican-worker-5c69df9cf-mtvpx\" (UID: \"4b1fbfd4-c276-42c0-8419-fbe793f89ad7\") " pod="openstack-kuttl-tests/barbican-worker-5c69df9cf-mtvpx" Mar 16 16:12:02 crc kubenswrapper[5120]: I0316 16:12:02.052961 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e929a717-3e1e-4481-9e69-3705d47c1d87-combined-ca-bundle\") pod \"barbican-keystone-listener-999b785fd-fgwkp\" (UID: \"e929a717-3e1e-4481-9e69-3705d47c1d87\") " pod="openstack-kuttl-tests/barbican-keystone-listener-999b785fd-fgwkp" Mar 16 16:12:02 crc kubenswrapper[5120]: I0316 16:12:02.052981 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/34da2089-cc88-4d8c-97da-68aadf7f2c03-internal-tls-certs\") pod \"barbican-api-69787fc498-jx88k\" (UID: \"34da2089-cc88-4d8c-97da-68aadf7f2c03\") " pod="openstack-kuttl-tests/barbican-api-69787fc498-jx88k" Mar 16 16:12:02 crc kubenswrapper[5120]: I0316 16:12:02.053049 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dpzjx\" (UniqueName: \"kubernetes.io/projected/e929a717-3e1e-4481-9e69-3705d47c1d87-kube-api-access-dpzjx\") pod \"barbican-keystone-listener-999b785fd-fgwkp\" (UID: \"e929a717-3e1e-4481-9e69-3705d47c1d87\") " pod="openstack-kuttl-tests/barbican-keystone-listener-999b785fd-fgwkp" Mar 16 16:12:02 crc kubenswrapper[5120]: I0316 16:12:02.053110 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e929a717-3e1e-4481-9e69-3705d47c1d87-config-data\") pod \"barbican-keystone-listener-999b785fd-fgwkp\" (UID: \"e929a717-3e1e-4481-9e69-3705d47c1d87\") " pod="openstack-kuttl-tests/barbican-keystone-listener-999b785fd-fgwkp" Mar 16 16:12:02 crc kubenswrapper[5120]: I0316 16:12:02.053131 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/34da2089-cc88-4d8c-97da-68aadf7f2c03-logs\") pod \"barbican-api-69787fc498-jx88k\" (UID: \"34da2089-cc88-4d8c-97da-68aadf7f2c03\") " pod="openstack-kuttl-tests/barbican-api-69787fc498-jx88k" Mar 16 16:12:02 crc kubenswrapper[5120]: I0316 16:12:02.053193 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/34da2089-cc88-4d8c-97da-68aadf7f2c03-combined-ca-bundle\") pod \"barbican-api-69787fc498-jx88k\" (UID: \"34da2089-cc88-4d8c-97da-68aadf7f2c03\") " pod="openstack-kuttl-tests/barbican-api-69787fc498-jx88k" Mar 16 16:12:02 crc kubenswrapper[5120]: I0316 16:12:02.053219 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/34da2089-cc88-4d8c-97da-68aadf7f2c03-config-data\") pod \"barbican-api-69787fc498-jx88k\" (UID: \"34da2089-cc88-4d8c-97da-68aadf7f2c03\") " pod="openstack-kuttl-tests/barbican-api-69787fc498-jx88k" Mar 16 16:12:02 crc kubenswrapper[5120]: I0316 16:12:02.053293 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4b1fbfd4-c276-42c0-8419-fbe793f89ad7-combined-ca-bundle\") pod \"barbican-worker-5c69df9cf-mtvpx\" (UID: \"4b1fbfd4-c276-42c0-8419-fbe793f89ad7\") " pod="openstack-kuttl-tests/barbican-worker-5c69df9cf-mtvpx" Mar 16 16:12:02 crc kubenswrapper[5120]: I0316 16:12:02.053343 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e929a717-3e1e-4481-9e69-3705d47c1d87-logs\") pod \"barbican-keystone-listener-999b785fd-fgwkp\" (UID: \"e929a717-3e1e-4481-9e69-3705d47c1d87\") " pod="openstack-kuttl-tests/barbican-keystone-listener-999b785fd-fgwkp" Mar 16 16:12:02 crc kubenswrapper[5120]: I0316 16:12:02.053374 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxbnw\" (UniqueName: \"kubernetes.io/projected/34da2089-cc88-4d8c-97da-68aadf7f2c03-kube-api-access-rxbnw\") pod \"barbican-api-69787fc498-jx88k\" (UID: \"34da2089-cc88-4d8c-97da-68aadf7f2c03\") " pod="openstack-kuttl-tests/barbican-api-69787fc498-jx88k" Mar 16 16:12:02 crc kubenswrapper[5120]: I0316 16:12:02.055174 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e929a717-3e1e-4481-9e69-3705d47c1d87-logs\") pod \"barbican-keystone-listener-999b785fd-fgwkp\" (UID: \"e929a717-3e1e-4481-9e69-3705d47c1d87\") " pod="openstack-kuttl-tests/barbican-keystone-listener-999b785fd-fgwkp" Mar 16 16:12:02 crc kubenswrapper[5120]: I0316 16:12:02.065529 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e929a717-3e1e-4481-9e69-3705d47c1d87-combined-ca-bundle\") pod \"barbican-keystone-listener-999b785fd-fgwkp\" (UID: \"e929a717-3e1e-4481-9e69-3705d47c1d87\") " pod="openstack-kuttl-tests/barbican-keystone-listener-999b785fd-fgwkp" Mar 16 16:12:02 crc kubenswrapper[5120]: I0316 16:12:02.145335 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dpzjx\" (UniqueName: \"kubernetes.io/projected/e929a717-3e1e-4481-9e69-3705d47c1d87-kube-api-access-dpzjx\") pod \"barbican-keystone-listener-999b785fd-fgwkp\" (UID: \"e929a717-3e1e-4481-9e69-3705d47c1d87\") " pod="openstack-kuttl-tests/barbican-keystone-listener-999b785fd-fgwkp" Mar 16 16:12:02 crc kubenswrapper[5120]: I0316 16:12:02.155849 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/34da2089-cc88-4d8c-97da-68aadf7f2c03-config-data-custom\") pod \"barbican-api-69787fc498-jx88k\" (UID: \"34da2089-cc88-4d8c-97da-68aadf7f2c03\") " pod="openstack-kuttl-tests/barbican-api-69787fc498-jx88k" Mar 16 16:12:02 crc kubenswrapper[5120]: I0316 16:12:02.155925 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/34da2089-cc88-4d8c-97da-68aadf7f2c03-public-tls-certs\") pod \"barbican-api-69787fc498-jx88k\" (UID: \"34da2089-cc88-4d8c-97da-68aadf7f2c03\") " pod="openstack-kuttl-tests/barbican-api-69787fc498-jx88k" Mar 16 16:12:02 crc kubenswrapper[5120]: I0316 16:12:02.156000 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4b1fbfd4-c276-42c0-8419-fbe793f89ad7-config-data\") pod \"barbican-worker-5c69df9cf-mtvpx\" (UID: \"4b1fbfd4-c276-42c0-8419-fbe793f89ad7\") " pod="openstack-kuttl-tests/barbican-worker-5c69df9cf-mtvpx" Mar 16 16:12:02 crc kubenswrapper[5120]: I0316 16:12:02.156046 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/34da2089-cc88-4d8c-97da-68aadf7f2c03-internal-tls-certs\") pod \"barbican-api-69787fc498-jx88k\" (UID: \"34da2089-cc88-4d8c-97da-68aadf7f2c03\") " pod="openstack-kuttl-tests/barbican-api-69787fc498-jx88k" Mar 16 16:12:02 crc kubenswrapper[5120]: I0316 16:12:02.156083 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/34da2089-cc88-4d8c-97da-68aadf7f2c03-logs\") pod \"barbican-api-69787fc498-jx88k\" (UID: \"34da2089-cc88-4d8c-97da-68aadf7f2c03\") " pod="openstack-kuttl-tests/barbican-api-69787fc498-jx88k" Mar 16 16:12:02 crc kubenswrapper[5120]: I0316 16:12:02.156113 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/34da2089-cc88-4d8c-97da-68aadf7f2c03-combined-ca-bundle\") pod \"barbican-api-69787fc498-jx88k\" (UID: \"34da2089-cc88-4d8c-97da-68aadf7f2c03\") " pod="openstack-kuttl-tests/barbican-api-69787fc498-jx88k" Mar 16 16:12:02 crc kubenswrapper[5120]: I0316 16:12:02.156139 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/34da2089-cc88-4d8c-97da-68aadf7f2c03-config-data\") pod \"barbican-api-69787fc498-jx88k\" (UID: \"34da2089-cc88-4d8c-97da-68aadf7f2c03\") " pod="openstack-kuttl-tests/barbican-api-69787fc498-jx88k" Mar 16 16:12:02 crc kubenswrapper[5120]: I0316 16:12:02.156178 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4b1fbfd4-c276-42c0-8419-fbe793f89ad7-combined-ca-bundle\") pod \"barbican-worker-5c69df9cf-mtvpx\" (UID: \"4b1fbfd4-c276-42c0-8419-fbe793f89ad7\") " pod="openstack-kuttl-tests/barbican-worker-5c69df9cf-mtvpx" Mar 16 16:12:02 crc kubenswrapper[5120]: I0316 16:12:02.156203 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rxbnw\" (UniqueName: \"kubernetes.io/projected/34da2089-cc88-4d8c-97da-68aadf7f2c03-kube-api-access-rxbnw\") pod \"barbican-api-69787fc498-jx88k\" (UID: \"34da2089-cc88-4d8c-97da-68aadf7f2c03\") " pod="openstack-kuttl-tests/barbican-api-69787fc498-jx88k" Mar 16 16:12:02 crc kubenswrapper[5120]: I0316 16:12:02.156280 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4b1fbfd4-c276-42c0-8419-fbe793f89ad7-logs\") pod \"barbican-worker-5c69df9cf-mtvpx\" (UID: \"4b1fbfd4-c276-42c0-8419-fbe793f89ad7\") " pod="openstack-kuttl-tests/barbican-worker-5c69df9cf-mtvpx" Mar 16 16:12:02 crc kubenswrapper[5120]: I0316 16:12:02.156319 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/4b1fbfd4-c276-42c0-8419-fbe793f89ad7-config-data-custom\") pod \"barbican-worker-5c69df9cf-mtvpx\" (UID: \"4b1fbfd4-c276-42c0-8419-fbe793f89ad7\") " pod="openstack-kuttl-tests/barbican-worker-5c69df9cf-mtvpx" Mar 16 16:12:02 crc kubenswrapper[5120]: I0316 16:12:02.156341 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-75xjs\" (UniqueName: \"kubernetes.io/projected/4b1fbfd4-c276-42c0-8419-fbe793f89ad7-kube-api-access-75xjs\") pod \"barbican-worker-5c69df9cf-mtvpx\" (UID: \"4b1fbfd4-c276-42c0-8419-fbe793f89ad7\") " pod="openstack-kuttl-tests/barbican-worker-5c69df9cf-mtvpx" Mar 16 16:12:02 crc kubenswrapper[5120]: I0316 16:12:02.163962 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e929a717-3e1e-4481-9e69-3705d47c1d87-config-data\") pod \"barbican-keystone-listener-999b785fd-fgwkp\" (UID: \"e929a717-3e1e-4481-9e69-3705d47c1d87\") " pod="openstack-kuttl-tests/barbican-keystone-listener-999b785fd-fgwkp" Mar 16 16:12:02 crc kubenswrapper[5120]: I0316 16:12:02.164595 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/e929a717-3e1e-4481-9e69-3705d47c1d87-config-data-custom\") pod \"barbican-keystone-listener-999b785fd-fgwkp\" (UID: \"e929a717-3e1e-4481-9e69-3705d47c1d87\") " pod="openstack-kuttl-tests/barbican-keystone-listener-999b785fd-fgwkp" Mar 16 16:12:02 crc kubenswrapper[5120]: I0316 16:12:02.168090 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4b1fbfd4-c276-42c0-8419-fbe793f89ad7-combined-ca-bundle\") pod \"barbican-worker-5c69df9cf-mtvpx\" (UID: \"4b1fbfd4-c276-42c0-8419-fbe793f89ad7\") " pod="openstack-kuttl-tests/barbican-worker-5c69df9cf-mtvpx" Mar 16 16:12:02 crc kubenswrapper[5120]: I0316 16:12:02.168378 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4b1fbfd4-c276-42c0-8419-fbe793f89ad7-logs\") pod \"barbican-worker-5c69df9cf-mtvpx\" (UID: \"4b1fbfd4-c276-42c0-8419-fbe793f89ad7\") " pod="openstack-kuttl-tests/barbican-worker-5c69df9cf-mtvpx" Mar 16 16:12:02 crc kubenswrapper[5120]: I0316 16:12:02.168613 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/34da2089-cc88-4d8c-97da-68aadf7f2c03-logs\") pod \"barbican-api-69787fc498-jx88k\" (UID: \"34da2089-cc88-4d8c-97da-68aadf7f2c03\") " pod="openstack-kuttl-tests/barbican-api-69787fc498-jx88k" Mar 16 16:12:02 crc kubenswrapper[5120]: I0316 16:12:02.181577 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4b1fbfd4-c276-42c0-8419-fbe793f89ad7-config-data\") pod \"barbican-worker-5c69df9cf-mtvpx\" (UID: \"4b1fbfd4-c276-42c0-8419-fbe793f89ad7\") " pod="openstack-kuttl-tests/barbican-worker-5c69df9cf-mtvpx" Mar 16 16:12:02 crc kubenswrapper[5120]: I0316 16:12:02.183547 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/34da2089-cc88-4d8c-97da-68aadf7f2c03-combined-ca-bundle\") pod \"barbican-api-69787fc498-jx88k\" (UID: \"34da2089-cc88-4d8c-97da-68aadf7f2c03\") " pod="openstack-kuttl-tests/barbican-api-69787fc498-jx88k" Mar 16 16:12:02 crc kubenswrapper[5120]: I0316 16:12:02.192600 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/4b1fbfd4-c276-42c0-8419-fbe793f89ad7-config-data-custom\") pod \"barbican-worker-5c69df9cf-mtvpx\" (UID: \"4b1fbfd4-c276-42c0-8419-fbe793f89ad7\") " pod="openstack-kuttl-tests/barbican-worker-5c69df9cf-mtvpx" Mar 16 16:12:02 crc kubenswrapper[5120]: I0316 16:12:02.198446 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/34da2089-cc88-4d8c-97da-68aadf7f2c03-config-data-custom\") pod \"barbican-api-69787fc498-jx88k\" (UID: \"34da2089-cc88-4d8c-97da-68aadf7f2c03\") " pod="openstack-kuttl-tests/barbican-api-69787fc498-jx88k" Mar 16 16:12:02 crc kubenswrapper[5120]: I0316 16:12:02.200685 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/34da2089-cc88-4d8c-97da-68aadf7f2c03-config-data\") pod \"barbican-api-69787fc498-jx88k\" (UID: \"34da2089-cc88-4d8c-97da-68aadf7f2c03\") " pod="openstack-kuttl-tests/barbican-api-69787fc498-jx88k" Mar 16 16:12:02 crc kubenswrapper[5120]: I0316 16:12:02.215562 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-744867f48f-8dw6x"] Mar 16 16:12:02 crc kubenswrapper[5120]: I0316 16:12:02.219660 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxbnw\" (UniqueName: \"kubernetes.io/projected/34da2089-cc88-4d8c-97da-68aadf7f2c03-kube-api-access-rxbnw\") pod \"barbican-api-69787fc498-jx88k\" (UID: \"34da2089-cc88-4d8c-97da-68aadf7f2c03\") " pod="openstack-kuttl-tests/barbican-api-69787fc498-jx88k" Mar 16 16:12:02 crc kubenswrapper[5120]: I0316 16:12:02.228210 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-75xjs\" (UniqueName: \"kubernetes.io/projected/4b1fbfd4-c276-42c0-8419-fbe793f89ad7-kube-api-access-75xjs\") pod \"barbican-worker-5c69df9cf-mtvpx\" (UID: \"4b1fbfd4-c276-42c0-8419-fbe793f89ad7\") " pod="openstack-kuttl-tests/barbican-worker-5c69df9cf-mtvpx" Mar 16 16:12:02 crc kubenswrapper[5120]: I0316 16:12:02.230883 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/34da2089-cc88-4d8c-97da-68aadf7f2c03-internal-tls-certs\") pod \"barbican-api-69787fc498-jx88k\" (UID: \"34da2089-cc88-4d8c-97da-68aadf7f2c03\") " pod="openstack-kuttl-tests/barbican-api-69787fc498-jx88k" Mar 16 16:12:02 crc kubenswrapper[5120]: I0316 16:12:02.242144 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/34da2089-cc88-4d8c-97da-68aadf7f2c03-public-tls-certs\") pod \"barbican-api-69787fc498-jx88k\" (UID: \"34da2089-cc88-4d8c-97da-68aadf7f2c03\") " pod="openstack-kuttl-tests/barbican-api-69787fc498-jx88k" Mar 16 16:12:02 crc kubenswrapper[5120]: I0316 16:12:02.244461 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-999b785fd-fgwkp" Mar 16 16:12:02 crc kubenswrapper[5120]: I0316 16:12:02.355445 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561292-z2wqq" event={"ID":"ad803ce8-2d88-44d8-a717-aaec85ce871c","Type":"ContainerStarted","Data":"8b20ec1344ef2ab8c6a8c4b8ba728cb1c0dbb8b5c7fb23f790058ec1204660b2"} Mar 16 16:12:02 crc kubenswrapper[5120]: I0316 16:12:02.360774 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"4fce708d-9952-41be-95e4-de815da4d75a","Type":"ContainerStarted","Data":"c4dca286f55be50ee11220e99e46fb4fbff8df572374c30f96ad63432819c510"} Mar 16 16:12:02 crc kubenswrapper[5120]: I0316 16:12:02.369281 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-5c69df9cf-mtvpx" Mar 16 16:12:02 crc kubenswrapper[5120]: I0316 16:12:02.373488 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-74b77cc694-lzqfl"] Mar 16 16:12:02 crc kubenswrapper[5120]: I0316 16:12:02.389203 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"0bbb1bbc-8c14-4046-bd63-cce793589d4d","Type":"ContainerStarted","Data":"3f9df4f7990f5d597db9e3cfa8764dc31f137f73c9769afb56a3bbe5c31ce33d"} Mar 16 16:12:02 crc kubenswrapper[5120]: I0316 16:12:02.403113 5120 generic.go:358] "Generic (PLEG): container finished" podID="a4afa8e8-c485-4903-b53b-864c0517374e" containerID="6a907d0329f6b418b5bde43c5425cd88ecfc1c1e43364b1c1ce7a0c7b6ed814d" exitCode=0 Mar 16 16:12:02 crc kubenswrapper[5120]: I0316 16:12:02.403216 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"a4afa8e8-c485-4903-b53b-864c0517374e","Type":"ContainerDied","Data":"6a907d0329f6b418b5bde43c5425cd88ecfc1c1e43364b1c1ce7a0c7b6ed814d"} Mar 16 16:12:02 crc kubenswrapper[5120]: I0316 16:12:02.428576 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"5aa11a39-e139-4791-92ce-2771b0277a8b","Type":"ContainerStarted","Data":"b8adae27cb47fa8c07b0445649495ea94709c8815ea94e345953af8d7bd93388"} Mar 16 16:12:02 crc kubenswrapper[5120]: I0316 16:12:02.435601 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-744867f48f-8dw6x" event={"ID":"0df9d7ea-2a19-45b4-b350-7c0e91a5d960","Type":"ContainerStarted","Data":"5e6e98273fac7d289d1814f487137aa6a3ca1c4e3e6f8d0bb8e9c07e5ec3f387"} Mar 16 16:12:02 crc kubenswrapper[5120]: I0316 16:12:02.438061 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-internal-api-0" podStartSLOduration=4.438041238 podStartE2EDuration="4.438041238s" podCreationTimestamp="2026-03-16 16:11:58 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:12:02.417201593 +0000 UTC m=+2424.571133250" watchObservedRunningTime="2026-03-16 16:12:02.438041238 +0000 UTC m=+2424.591972895" Mar 16 16:12:02 crc kubenswrapper[5120]: I0316 16:12:02.442282 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-69787fc498-jx88k" Mar 16 16:12:02 crc kubenswrapper[5120]: I0316 16:12:02.461671 5120 generic.go:358] "Generic (PLEG): container finished" podID="dc31395d-0cfc-48ae-b26d-276e4a8afb77" containerID="c38a7fbc35daa920db9ed63c28348595217d447afe24b3556aefd8ce48a85207" exitCode=0 Mar 16 16:12:02 crc kubenswrapper[5120]: I0316 16:12:02.461825 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"dc31395d-0cfc-48ae-b26d-276e4a8afb77","Type":"ContainerDied","Data":"c38a7fbc35daa920db9ed63c28348595217d447afe24b3556aefd8ce48a85207"} Mar 16 16:12:02 crc kubenswrapper[5120]: I0316 16:12:02.462255 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-external-api-0" podStartSLOduration=4.462238084 podStartE2EDuration="4.462238084s" podCreationTimestamp="2026-03-16 16:11:58 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:12:02.450711692 +0000 UTC m=+2424.604643349" watchObservedRunningTime="2026-03-16 16:12:02.462238084 +0000 UTC m=+2424.616169741" Mar 16 16:12:02 crc kubenswrapper[5120]: I0316 16:12:02.500518 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-6fccf8d5b-2gznd"] Mar 16 16:12:02 crc kubenswrapper[5120]: I0316 16:12:02.606572 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:12:02 crc kubenswrapper[5120]: I0316 16:12:02.693024 5120 scope.go:117] "RemoveContainer" containerID="55f7c0a8dd3fb411516491f25d8f37988d6b1a6048217e2cb2d9a1a04990ab30" Mar 16 16:12:02 crc kubenswrapper[5120]: I0316 16:12:02.726056 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:12:02 crc kubenswrapper[5120]: I0316 16:12:02.746323 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="601bff35-3d2b-4301-abdc-17ddf2e2b9eb" path="/var/lib/kubelet/pods/601bff35-3d2b-4301-abdc-17ddf2e2b9eb/volumes" Mar 16 16:12:02 crc kubenswrapper[5120]: I0316 16:12:02.755184 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:12:02 crc kubenswrapper[5120]: I0316 16:12:02.779869 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a4afa8e8-c485-4903-b53b-864c0517374e-config-data\") pod \"a4afa8e8-c485-4903-b53b-864c0517374e\" (UID: \"a4afa8e8-c485-4903-b53b-864c0517374e\") " Mar 16 16:12:02 crc kubenswrapper[5120]: I0316 16:12:02.780211 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/a4afa8e8-c485-4903-b53b-864c0517374e-public-tls-certs\") pod \"a4afa8e8-c485-4903-b53b-864c0517374e\" (UID: \"a4afa8e8-c485-4903-b53b-864c0517374e\") " Mar 16 16:12:02 crc kubenswrapper[5120]: I0316 16:12:02.780276 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a4afa8e8-c485-4903-b53b-864c0517374e-combined-ca-bundle\") pod \"a4afa8e8-c485-4903-b53b-864c0517374e\" (UID: \"a4afa8e8-c485-4903-b53b-864c0517374e\") " Mar 16 16:12:02 crc kubenswrapper[5120]: I0316 16:12:02.780304 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a4afa8e8-c485-4903-b53b-864c0517374e-logs\") pod \"a4afa8e8-c485-4903-b53b-864c0517374e\" (UID: \"a4afa8e8-c485-4903-b53b-864c0517374e\") " Mar 16 16:12:02 crc kubenswrapper[5120]: I0316 16:12:02.780332 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fpcj8\" (UniqueName: \"kubernetes.io/projected/a4afa8e8-c485-4903-b53b-864c0517374e-kube-api-access-fpcj8\") pod \"a4afa8e8-c485-4903-b53b-864c0517374e\" (UID: \"a4afa8e8-c485-4903-b53b-864c0517374e\") " Mar 16 16:12:02 crc kubenswrapper[5120]: I0316 16:12:02.780360 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/a4afa8e8-c485-4903-b53b-864c0517374e-internal-tls-certs\") pod \"a4afa8e8-c485-4903-b53b-864c0517374e\" (UID: \"a4afa8e8-c485-4903-b53b-864c0517374e\") " Mar 16 16:12:02 crc kubenswrapper[5120]: I0316 16:12:02.788045 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a4afa8e8-c485-4903-b53b-864c0517374e-logs" (OuterVolumeSpecName: "logs") pod "a4afa8e8-c485-4903-b53b-864c0517374e" (UID: "a4afa8e8-c485-4903-b53b-864c0517374e"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:12:02 crc kubenswrapper[5120]: I0316 16:12:02.835662 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a4afa8e8-c485-4903-b53b-864c0517374e-kube-api-access-fpcj8" (OuterVolumeSpecName: "kube-api-access-fpcj8") pod "a4afa8e8-c485-4903-b53b-864c0517374e" (UID: "a4afa8e8-c485-4903-b53b-864c0517374e"). InnerVolumeSpecName "kube-api-access-fpcj8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:12:02 crc kubenswrapper[5120]: I0316 16:12:02.882985 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a4afa8e8-c485-4903-b53b-864c0517374e-config-data" (OuterVolumeSpecName: "config-data") pod "a4afa8e8-c485-4903-b53b-864c0517374e" (UID: "a4afa8e8-c485-4903-b53b-864c0517374e"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:02 crc kubenswrapper[5120]: I0316 16:12:02.882991 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dc31395d-0cfc-48ae-b26d-276e4a8afb77-config-data\") pod \"dc31395d-0cfc-48ae-b26d-276e4a8afb77\" (UID: \"dc31395d-0cfc-48ae-b26d-276e4a8afb77\") " Mar 16 16:12:02 crc kubenswrapper[5120]: I0316 16:12:02.883252 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/dc31395d-0cfc-48ae-b26d-276e4a8afb77-logs\") pod \"dc31395d-0cfc-48ae-b26d-276e4a8afb77\" (UID: \"dc31395d-0cfc-48ae-b26d-276e4a8afb77\") " Mar 16 16:12:02 crc kubenswrapper[5120]: I0316 16:12:02.883438 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/dc31395d-0cfc-48ae-b26d-276e4a8afb77-nova-metadata-tls-certs\") pod \"dc31395d-0cfc-48ae-b26d-276e4a8afb77\" (UID: \"dc31395d-0cfc-48ae-b26d-276e4a8afb77\") " Mar 16 16:12:02 crc kubenswrapper[5120]: I0316 16:12:02.883581 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r5d2f\" (UniqueName: \"kubernetes.io/projected/dc31395d-0cfc-48ae-b26d-276e4a8afb77-kube-api-access-r5d2f\") pod \"dc31395d-0cfc-48ae-b26d-276e4a8afb77\" (UID: \"dc31395d-0cfc-48ae-b26d-276e4a8afb77\") " Mar 16 16:12:02 crc kubenswrapper[5120]: I0316 16:12:02.883616 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dc31395d-0cfc-48ae-b26d-276e4a8afb77-combined-ca-bundle\") pod \"dc31395d-0cfc-48ae-b26d-276e4a8afb77\" (UID: \"dc31395d-0cfc-48ae-b26d-276e4a8afb77\") " Mar 16 16:12:02 crc kubenswrapper[5120]: I0316 16:12:02.884540 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a4afa8e8-c485-4903-b53b-864c0517374e-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:02 crc kubenswrapper[5120]: I0316 16:12:02.884561 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a4afa8e8-c485-4903-b53b-864c0517374e-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:02 crc kubenswrapper[5120]: I0316 16:12:02.884571 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fpcj8\" (UniqueName: \"kubernetes.io/projected/a4afa8e8-c485-4903-b53b-864c0517374e-kube-api-access-fpcj8\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:02 crc kubenswrapper[5120]: I0316 16:12:02.885235 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc31395d-0cfc-48ae-b26d-276e4a8afb77-logs" (OuterVolumeSpecName: "logs") pod "dc31395d-0cfc-48ae-b26d-276e4a8afb77" (UID: "dc31395d-0cfc-48ae-b26d-276e4a8afb77"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:12:02 crc kubenswrapper[5120]: I0316 16:12:02.903209 5120 scope.go:117] "RemoveContainer" containerID="0c16f787f148c1a8396186623c178c7e2406248d3427a3c9a19308855b44a4cb" Mar 16 16:12:02 crc kubenswrapper[5120]: I0316 16:12:02.929275 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc31395d-0cfc-48ae-b26d-276e4a8afb77-kube-api-access-r5d2f" (OuterVolumeSpecName: "kube-api-access-r5d2f") pod "dc31395d-0cfc-48ae-b26d-276e4a8afb77" (UID: "dc31395d-0cfc-48ae-b26d-276e4a8afb77"). InnerVolumeSpecName "kube-api-access-r5d2f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:12:02 crc kubenswrapper[5120]: I0316 16:12:02.975452 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-999b785fd-fgwkp"] Mar 16 16:12:02 crc kubenswrapper[5120]: I0316 16:12:02.990702 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r5d2f\" (UniqueName: \"kubernetes.io/projected/dc31395d-0cfc-48ae-b26d-276e4a8afb77-kube-api-access-r5d2f\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:02 crc kubenswrapper[5120]: I0316 16:12:02.990730 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/dc31395d-0cfc-48ae-b26d-276e4a8afb77-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:03 crc kubenswrapper[5120]: I0316 16:12:03.053249 5120 scope.go:117] "RemoveContainer" containerID="c95e062c78b43ac61bfb1ce3d6158aededf0d14a169d8cab5f5143628863dce1" Mar 16 16:12:03 crc kubenswrapper[5120]: I0316 16:12:03.191138 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-69787fc498-jx88k"] Mar 16 16:12:03 crc kubenswrapper[5120]: I0316 16:12:03.221209 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:12:03 crc kubenswrapper[5120]: I0316 16:12:03.221631 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="ea333be7-b49f-446b-9c1c-f7c538731523" containerName="ceilometer-central-agent" containerID="cri-o://55ce353d6a8518607d6830f49878df64aff34c5acbd20679e5581433ff056336" gracePeriod=30 Mar 16 16:12:03 crc kubenswrapper[5120]: I0316 16:12:03.222415 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="ea333be7-b49f-446b-9c1c-f7c538731523" containerName="sg-core" containerID="cri-o://7dcb41eedd2287e418500866f49c86f0302b137b182a1dc21742e0720e3d0e7a" gracePeriod=30 Mar 16 16:12:03 crc kubenswrapper[5120]: I0316 16:12:03.222663 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="ea333be7-b49f-446b-9c1c-f7c538731523" containerName="proxy-httpd" containerID="cri-o://81bfa47e99a4ff0b06d1d87f88486430467c0459105dd9da4f44ca9a3fbf2b31" gracePeriod=30 Mar 16 16:12:03 crc kubenswrapper[5120]: I0316 16:12:03.222747 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="ea333be7-b49f-446b-9c1c-f7c538731523" containerName="ceilometer-notification-agent" containerID="cri-o://3fda142fc9e38b9e4f20fb452296b328ade551384a9581f9ee8f94fdcc898382" gracePeriod=30 Mar 16 16:12:03 crc kubenswrapper[5120]: I0316 16:12:03.237185 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a4afa8e8-c485-4903-b53b-864c0517374e-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "a4afa8e8-c485-4903-b53b-864c0517374e" (UID: "a4afa8e8-c485-4903-b53b-864c0517374e"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:03 crc kubenswrapper[5120]: I0316 16:12:03.303469 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a4afa8e8-c485-4903-b53b-864c0517374e-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:03 crc kubenswrapper[5120]: I0316 16:12:03.345066 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-5c69df9cf-mtvpx"] Mar 16 16:12:03 crc kubenswrapper[5120]: I0316 16:12:03.414908 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc31395d-0cfc-48ae-b26d-276e4a8afb77-config-data" (OuterVolumeSpecName: "config-data") pod "dc31395d-0cfc-48ae-b26d-276e4a8afb77" (UID: "dc31395d-0cfc-48ae-b26d-276e4a8afb77"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:03 crc kubenswrapper[5120]: I0316 16:12:03.484089 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-6fccf8d5b-2gznd" event={"ID":"e69accdc-df7e-43d7-a3f4-63e6157a9721","Type":"ContainerStarted","Data":"357475a776832562772cc06ac6fd0297643bf5d6d54fd032e824a0cc200a2bab"} Mar 16 16:12:03 crc kubenswrapper[5120]: W0316 16:12:03.484211 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4b1fbfd4_c276_42c0_8419_fbe793f89ad7.slice/crio-1fdc2b81bfeaead5ce02246204e3f304d116b307daff3082676038ab2e1ed81b WatchSource:0}: Error finding container 1fdc2b81bfeaead5ce02246204e3f304d116b307daff3082676038ab2e1ed81b: Status 404 returned error can't find the container with id 1fdc2b81bfeaead5ce02246204e3f304d116b307daff3082676038ab2e1ed81b Mar 16 16:12:03 crc kubenswrapper[5120]: I0316 16:12:03.506031 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"a4afa8e8-c485-4903-b53b-864c0517374e","Type":"ContainerDied","Data":"b609db94eb8d185a6012c0d1a59e01bdd301fcbbd016446ebef220d0337c7555"} Mar 16 16:12:03 crc kubenswrapper[5120]: I0316 16:12:03.506424 5120 scope.go:117] "RemoveContainer" containerID="6a907d0329f6b418b5bde43c5425cd88ecfc1c1e43364b1c1ce7a0c7b6ed814d" Mar 16 16:12:03 crc kubenswrapper[5120]: I0316 16:12:03.507750 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:12:03 crc kubenswrapper[5120]: I0316 16:12:03.509690 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dc31395d-0cfc-48ae-b26d-276e4a8afb77-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:03 crc kubenswrapper[5120]: I0316 16:12:03.558225 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a4afa8e8-c485-4903-b53b-864c0517374e-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "a4afa8e8-c485-4903-b53b-864c0517374e" (UID: "a4afa8e8-c485-4903-b53b-864c0517374e"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:03 crc kubenswrapper[5120]: I0316 16:12:03.561373 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a4afa8e8-c485-4903-b53b-864c0517374e-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "a4afa8e8-c485-4903-b53b-864c0517374e" (UID: "a4afa8e8-c485-4903-b53b-864c0517374e"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:03 crc kubenswrapper[5120]: I0316 16:12:03.568732 5120 generic.go:358] "Generic (PLEG): container finished" podID="ea333be7-b49f-446b-9c1c-f7c538731523" containerID="81bfa47e99a4ff0b06d1d87f88486430467c0459105dd9da4f44ca9a3fbf2b31" exitCode=0 Mar 16 16:12:03 crc kubenswrapper[5120]: I0316 16:12:03.568844 5120 generic.go:358] "Generic (PLEG): container finished" podID="ea333be7-b49f-446b-9c1c-f7c538731523" containerID="7dcb41eedd2287e418500866f49c86f0302b137b182a1dc21742e0720e3d0e7a" exitCode=2 Mar 16 16:12:03 crc kubenswrapper[5120]: I0316 16:12:03.568981 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ea333be7-b49f-446b-9c1c-f7c538731523","Type":"ContainerDied","Data":"81bfa47e99a4ff0b06d1d87f88486430467c0459105dd9da4f44ca9a3fbf2b31"} Mar 16 16:12:03 crc kubenswrapper[5120]: I0316 16:12:03.569015 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ea333be7-b49f-446b-9c1c-f7c538731523","Type":"ContainerDied","Data":"7dcb41eedd2287e418500866f49c86f0302b137b182a1dc21742e0720e3d0e7a"} Mar 16 16:12:03 crc kubenswrapper[5120]: I0316 16:12:03.570239 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc31395d-0cfc-48ae-b26d-276e4a8afb77-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "dc31395d-0cfc-48ae-b26d-276e4a8afb77" (UID: "dc31395d-0cfc-48ae-b26d-276e4a8afb77"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:03 crc kubenswrapper[5120]: I0316 16:12:03.580891 5120 generic.go:358] "Generic (PLEG): container finished" podID="12b38435-0635-409b-8888-94cdc5433388" containerID="cf7a9dd6bfa88e8fccaa1a621f03d0b496debb8fa72832274da01cb03305c90a" exitCode=0 Mar 16 16:12:03 crc kubenswrapper[5120]: I0316 16:12:03.580969 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"12b38435-0635-409b-8888-94cdc5433388","Type":"ContainerDied","Data":"cf7a9dd6bfa88e8fccaa1a621f03d0b496debb8fa72832274da01cb03305c90a"} Mar 16 16:12:03 crc kubenswrapper[5120]: I0316 16:12:03.586404 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-999b785fd-fgwkp" event={"ID":"e929a717-3e1e-4481-9e69-3705d47c1d87","Type":"ContainerStarted","Data":"0d48afeb256429b8b15505c6fa4da3b28f0d520d9c36f9564e1f2fa7d9beb6cc"} Mar 16 16:12:03 crc kubenswrapper[5120]: I0316 16:12:03.595797 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-69787fc498-jx88k" event={"ID":"34da2089-cc88-4d8c-97da-68aadf7f2c03","Type":"ContainerStarted","Data":"5795b88f56788bc9abc1b52859eed1f486f2105b257928374815dac4b14c89f1"} Mar 16 16:12:03 crc kubenswrapper[5120]: I0316 16:12:03.610876 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-744867f48f-8dw6x" event={"ID":"0df9d7ea-2a19-45b4-b350-7c0e91a5d960","Type":"ContainerStarted","Data":"10cfc1214c4cb2003680313fe2c02a4e30f09769b0b3e1e139eb0865bb174e51"} Mar 16 16:12:03 crc kubenswrapper[5120]: I0316 16:12:03.611078 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-744867f48f-8dw6x" podUID="0df9d7ea-2a19-45b4-b350-7c0e91a5d960" containerName="barbican-worker-log" containerID="cri-o://10cfc1214c4cb2003680313fe2c02a4e30f09769b0b3e1e139eb0865bb174e51" gracePeriod=30 Mar 16 16:12:03 crc kubenswrapper[5120]: I0316 16:12:03.611988 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-744867f48f-8dw6x" podUID="0df9d7ea-2a19-45b4-b350-7c0e91a5d960" containerName="barbican-worker" containerID="cri-o://8df698b6cb3c091ed64b52203e2b60664ba4adfd3d06071c513279d2f35200db" gracePeriod=30 Mar 16 16:12:03 crc kubenswrapper[5120]: I0316 16:12:03.625719 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dc31395d-0cfc-48ae-b26d-276e4a8afb77-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:03 crc kubenswrapper[5120]: I0316 16:12:03.629518 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/a4afa8e8-c485-4903-b53b-864c0517374e-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:03 crc kubenswrapper[5120]: I0316 16:12:03.629643 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/a4afa8e8-c485-4903-b53b-864c0517374e-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:03 crc kubenswrapper[5120]: I0316 16:12:03.626007 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc31395d-0cfc-48ae-b26d-276e4a8afb77-nova-metadata-tls-certs" (OuterVolumeSpecName: "nova-metadata-tls-certs") pod "dc31395d-0cfc-48ae-b26d-276e4a8afb77" (UID: "dc31395d-0cfc-48ae-b26d-276e4a8afb77"). InnerVolumeSpecName "nova-metadata-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:03 crc kubenswrapper[5120]: I0316 16:12:03.652308 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"dc31395d-0cfc-48ae-b26d-276e4a8afb77","Type":"ContainerDied","Data":"bf8ab5ecea5344a3eef64cb95e00eb4778fffde7e68e86dd4c0ebf1f8b27a6a1"} Mar 16 16:12:03 crc kubenswrapper[5120]: I0316 16:12:03.652465 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:12:03 crc kubenswrapper[5120]: I0316 16:12:03.669931 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-worker-744867f48f-8dw6x" podStartSLOduration=2.669911974 podStartE2EDuration="2.669911974s" podCreationTimestamp="2026-03-16 16:12:01 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:12:03.649463499 +0000 UTC m=+2425.803395156" watchObservedRunningTime="2026-03-16 16:12:03.669911974 +0000 UTC m=+2425.823843621" Mar 16 16:12:03 crc kubenswrapper[5120]: I0316 16:12:03.672811 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"dae19557-6584-433e-a345-c373d9e8a4ae","Type":"ContainerStarted","Data":"6363bdf8ead3321cb7d1b439acc12451f93ddf659b78ce5f68a700f217892a50"} Mar 16 16:12:03 crc kubenswrapper[5120]: I0316 16:12:03.676586 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-74b77cc694-lzqfl" event={"ID":"8f51149f-2af3-4bb8-ab7a-1b94ca6754e5","Type":"ContainerStarted","Data":"f51657860a93464c474c6250eb0e7edd01c80756a4dd39fe9f29602c9058027d"} Mar 16 16:12:03 crc kubenswrapper[5120]: I0316 16:12:03.676634 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-74b77cc694-lzqfl" event={"ID":"8f51149f-2af3-4bb8-ab7a-1b94ca6754e5","Type":"ContainerStarted","Data":"7bf4ebb0a06adf7468b5b33f6834dd10e17444e396d4d88a028fb4f1e5ded7f1"} Mar 16 16:12:03 crc kubenswrapper[5120]: I0316 16:12:03.736998 5120 reconciler_common.go:299] "Volume detached for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/dc31395d-0cfc-48ae-b26d-276e4a8afb77-nova-metadata-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.064801 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.079552 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.084986 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.086080 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc31395d-0cfc-48ae-b26d-276e4a8afb77" containerName="nova-metadata-log" Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.086101 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc31395d-0cfc-48ae-b26d-276e4a8afb77" containerName="nova-metadata-log" Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.086121 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4afa8e8-c485-4903-b53b-864c0517374e" containerName="nova-api-api" Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.086130 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4afa8e8-c485-4903-b53b-864c0517374e" containerName="nova-api-api" Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.086146 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc31395d-0cfc-48ae-b26d-276e4a8afb77" containerName="nova-metadata-metadata" Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.086152 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc31395d-0cfc-48ae-b26d-276e4a8afb77" containerName="nova-metadata-metadata" Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.086175 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4afa8e8-c485-4903-b53b-864c0517374e" containerName="nova-api-log" Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.086182 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4afa8e8-c485-4903-b53b-864c0517374e" containerName="nova-api-log" Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.086369 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="a4afa8e8-c485-4903-b53b-864c0517374e" containerName="nova-api-log" Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.086390 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="dc31395d-0cfc-48ae-b26d-276e4a8afb77" containerName="nova-metadata-metadata" Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.086413 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="dc31395d-0cfc-48ae-b26d-276e4a8afb77" containerName="nova-metadata-log" Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.086424 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="a4afa8e8-c485-4903-b53b-864c0517374e" containerName="nova-api-api" Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.091385 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.102469 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.107974 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-config-data\"" Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.108285 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-internal-svc\"" Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.108497 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-public-svc\"" Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.169513 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6ghf\" (UniqueName: \"kubernetes.io/projected/10ec5605-2810-4b8c-9a6a-e5cfc3b33706-kube-api-access-h6ghf\") pod \"nova-api-0\" (UID: \"10ec5605-2810-4b8c-9a6a-e5cfc3b33706\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.169595 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/10ec5605-2810-4b8c-9a6a-e5cfc3b33706-public-tls-certs\") pod \"nova-api-0\" (UID: \"10ec5605-2810-4b8c-9a6a-e5cfc3b33706\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.169695 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/10ec5605-2810-4b8c-9a6a-e5cfc3b33706-config-data\") pod \"nova-api-0\" (UID: \"10ec5605-2810-4b8c-9a6a-e5cfc3b33706\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.169800 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/10ec5605-2810-4b8c-9a6a-e5cfc3b33706-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"10ec5605-2810-4b8c-9a6a-e5cfc3b33706\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.169844 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/10ec5605-2810-4b8c-9a6a-e5cfc3b33706-logs\") pod \"nova-api-0\" (UID: \"10ec5605-2810-4b8c-9a6a-e5cfc3b33706\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.169911 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/10ec5605-2810-4b8c-9a6a-e5cfc3b33706-internal-tls-certs\") pod \"nova-api-0\" (UID: \"10ec5605-2810-4b8c-9a6a-e5cfc3b33706\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.206656 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.217994 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.226870 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.273257 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h6ghf\" (UniqueName: \"kubernetes.io/projected/10ec5605-2810-4b8c-9a6a-e5cfc3b33706-kube-api-access-h6ghf\") pod \"nova-api-0\" (UID: \"10ec5605-2810-4b8c-9a6a-e5cfc3b33706\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.273329 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/10ec5605-2810-4b8c-9a6a-e5cfc3b33706-public-tls-certs\") pod \"nova-api-0\" (UID: \"10ec5605-2810-4b8c-9a6a-e5cfc3b33706\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.273428 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/10ec5605-2810-4b8c-9a6a-e5cfc3b33706-config-data\") pod \"nova-api-0\" (UID: \"10ec5605-2810-4b8c-9a6a-e5cfc3b33706\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.273528 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/10ec5605-2810-4b8c-9a6a-e5cfc3b33706-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"10ec5605-2810-4b8c-9a6a-e5cfc3b33706\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.273571 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/10ec5605-2810-4b8c-9a6a-e5cfc3b33706-logs\") pod \"nova-api-0\" (UID: \"10ec5605-2810-4b8c-9a6a-e5cfc3b33706\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.273635 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/10ec5605-2810-4b8c-9a6a-e5cfc3b33706-internal-tls-certs\") pod \"nova-api-0\" (UID: \"10ec5605-2810-4b8c-9a6a-e5cfc3b33706\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.276748 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/10ec5605-2810-4b8c-9a6a-e5cfc3b33706-logs\") pod \"nova-api-0\" (UID: \"10ec5605-2810-4b8c-9a6a-e5cfc3b33706\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.281409 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/10ec5605-2810-4b8c-9a6a-e5cfc3b33706-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"10ec5605-2810-4b8c-9a6a-e5cfc3b33706\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.281476 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/10ec5605-2810-4b8c-9a6a-e5cfc3b33706-public-tls-certs\") pod \"nova-api-0\" (UID: \"10ec5605-2810-4b8c-9a6a-e5cfc3b33706\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.282346 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/10ec5605-2810-4b8c-9a6a-e5cfc3b33706-config-data\") pod \"nova-api-0\" (UID: \"10ec5605-2810-4b8c-9a6a-e5cfc3b33706\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.283937 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/10ec5605-2810-4b8c-9a6a-e5cfc3b33706-internal-tls-certs\") pod \"nova-api-0\" (UID: \"10ec5605-2810-4b8c-9a6a-e5cfc3b33706\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.288438 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6ghf\" (UniqueName: \"kubernetes.io/projected/10ec5605-2810-4b8c-9a6a-e5cfc3b33706-kube-api-access-h6ghf\") pod \"nova-api-0\" (UID: \"10ec5605-2810-4b8c-9a6a-e5cfc3b33706\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.288613 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.288737 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.290843 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-metadata-config-data\"" Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.290952 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-metadata-internal-svc\"" Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.300690 5120 scope.go:117] "RemoveContainer" containerID="d0da62bc52626fc919ec76a1ec38c2dc40f8a9e294470ae9689ac38cd086ec67" Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.375106 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/17b2138c-b3ca-4538-a7d7-0dc6756650bf-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"17b2138c-b3ca-4538-a7d7-0dc6756650bf\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.375450 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/17b2138c-b3ca-4538-a7d7-0dc6756650bf-config-data\") pod \"nova-metadata-0\" (UID: \"17b2138c-b3ca-4538-a7d7-0dc6756650bf\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.375500 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r67sp\" (UniqueName: \"kubernetes.io/projected/17b2138c-b3ca-4538-a7d7-0dc6756650bf-kube-api-access-r67sp\") pod \"nova-metadata-0\" (UID: \"17b2138c-b3ca-4538-a7d7-0dc6756650bf\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.375560 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/17b2138c-b3ca-4538-a7d7-0dc6756650bf-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"17b2138c-b3ca-4538-a7d7-0dc6756650bf\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.375626 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/17b2138c-b3ca-4538-a7d7-0dc6756650bf-logs\") pod \"nova-metadata-0\" (UID: \"17b2138c-b3ca-4538-a7d7-0dc6756650bf\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.476946 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.477182 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/17b2138c-b3ca-4538-a7d7-0dc6756650bf-logs\") pod \"nova-metadata-0\" (UID: \"17b2138c-b3ca-4538-a7d7-0dc6756650bf\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.477307 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/17b2138c-b3ca-4538-a7d7-0dc6756650bf-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"17b2138c-b3ca-4538-a7d7-0dc6756650bf\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.477396 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/17b2138c-b3ca-4538-a7d7-0dc6756650bf-config-data\") pod \"nova-metadata-0\" (UID: \"17b2138c-b3ca-4538-a7d7-0dc6756650bf\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.477443 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r67sp\" (UniqueName: \"kubernetes.io/projected/17b2138c-b3ca-4538-a7d7-0dc6756650bf-kube-api-access-r67sp\") pod \"nova-metadata-0\" (UID: \"17b2138c-b3ca-4538-a7d7-0dc6756650bf\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.477505 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/17b2138c-b3ca-4538-a7d7-0dc6756650bf-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"17b2138c-b3ca-4538-a7d7-0dc6756650bf\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.478296 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/17b2138c-b3ca-4538-a7d7-0dc6756650bf-logs\") pod \"nova-metadata-0\" (UID: \"17b2138c-b3ca-4538-a7d7-0dc6756650bf\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.488434 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/17b2138c-b3ca-4538-a7d7-0dc6756650bf-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"17b2138c-b3ca-4538-a7d7-0dc6756650bf\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.488977 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/17b2138c-b3ca-4538-a7d7-0dc6756650bf-config-data\") pod \"nova-metadata-0\" (UID: \"17b2138c-b3ca-4538-a7d7-0dc6756650bf\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.497949 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.499684 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.502986 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/17b2138c-b3ca-4538-a7d7-0dc6756650bf-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"17b2138c-b3ca-4538-a7d7-0dc6756650bf\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.506517 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r67sp\" (UniqueName: \"kubernetes.io/projected/17b2138c-b3ca-4538-a7d7-0dc6756650bf-kube-api-access-r67sp\") pod \"nova-metadata-0\" (UID: \"17b2138c-b3ca-4538-a7d7-0dc6756650bf\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.544469 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.552578 5120 scope.go:117] "RemoveContainer" containerID="c38a7fbc35daa920db9ed63c28348595217d447afe24b3556aefd8ce48a85207" Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.578521 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/12b38435-0635-409b-8888-94cdc5433388-config-data\") pod \"12b38435-0635-409b-8888-94cdc5433388\" (UID: \"12b38435-0635-409b-8888-94cdc5433388\") " Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.578677 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/12b38435-0635-409b-8888-94cdc5433388-combined-ca-bundle\") pod \"12b38435-0635-409b-8888-94cdc5433388\" (UID: \"12b38435-0635-409b-8888-94cdc5433388\") " Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.578743 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wf2s2\" (UniqueName: \"kubernetes.io/projected/12b38435-0635-409b-8888-94cdc5433388-kube-api-access-wf2s2\") pod \"12b38435-0635-409b-8888-94cdc5433388\" (UID: \"12b38435-0635-409b-8888-94cdc5433388\") " Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.578837 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7b459444-a6b1-4f69-a8f9-3db6c84580b7-combined-ca-bundle\") pod \"7b459444-a6b1-4f69-a8f9-3db6c84580b7\" (UID: \"7b459444-a6b1-4f69-a8f9-3db6c84580b7\") " Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.578955 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7b459444-a6b1-4f69-a8f9-3db6c84580b7-config-data\") pod \"7b459444-a6b1-4f69-a8f9-3db6c84580b7\" (UID: \"7b459444-a6b1-4f69-a8f9-3db6c84580b7\") " Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.579122 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kxd77\" (UniqueName: \"kubernetes.io/projected/7b459444-a6b1-4f69-a8f9-3db6c84580b7-kube-api-access-kxd77\") pod \"7b459444-a6b1-4f69-a8f9-3db6c84580b7\" (UID: \"7b459444-a6b1-4f69-a8f9-3db6c84580b7\") " Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.627396 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12b38435-0635-409b-8888-94cdc5433388-kube-api-access-wf2s2" (OuterVolumeSpecName: "kube-api-access-wf2s2") pod "12b38435-0635-409b-8888-94cdc5433388" (UID: "12b38435-0635-409b-8888-94cdc5433388"). InnerVolumeSpecName "kube-api-access-wf2s2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.627740 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b459444-a6b1-4f69-a8f9-3db6c84580b7-kube-api-access-kxd77" (OuterVolumeSpecName: "kube-api-access-kxd77") pod "7b459444-a6b1-4f69-a8f9-3db6c84580b7" (UID: "7b459444-a6b1-4f69-a8f9-3db6c84580b7"). InnerVolumeSpecName "kube-api-access-kxd77". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.662674 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.682176 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kxd77\" (UniqueName: \"kubernetes.io/projected/7b459444-a6b1-4f69-a8f9-3db6c84580b7-kube-api-access-kxd77\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.682210 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wf2s2\" (UniqueName: \"kubernetes.io/projected/12b38435-0635-409b-8888-94cdc5433388-kube-api-access-wf2s2\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.684159 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a4afa8e8-c485-4903-b53b-864c0517374e" path="/var/lib/kubelet/pods/a4afa8e8-c485-4903-b53b-864c0517374e/volumes" Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.690239 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc31395d-0cfc-48ae-b26d-276e4a8afb77" path="/var/lib/kubelet/pods/dc31395d-0cfc-48ae-b26d-276e4a8afb77/volumes" Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.720125 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"12b38435-0635-409b-8888-94cdc5433388","Type":"ContainerDied","Data":"3a595cbaa88d998a80d51b2a84efdf608501b49bbbde671663f29b71fd75054c"} Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.720202 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.726059 5120 generic.go:358] "Generic (PLEG): container finished" podID="0df9d7ea-2a19-45b4-b350-7c0e91a5d960" containerID="10cfc1214c4cb2003680313fe2c02a4e30f09769b0b3e1e139eb0865bb174e51" exitCode=143 Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.726235 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-744867f48f-8dw6x" event={"ID":"0df9d7ea-2a19-45b4-b350-7c0e91a5d960","Type":"ContainerDied","Data":"10cfc1214c4cb2003680313fe2c02a4e30f09769b0b3e1e139eb0865bb174e51"} Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.726271 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-744867f48f-8dw6x" event={"ID":"0df9d7ea-2a19-45b4-b350-7c0e91a5d960","Type":"ContainerStarted","Data":"8df698b6cb3c091ed64b52203e2b60664ba4adfd3d06071c513279d2f35200db"} Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.736126 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.736405 5120 generic.go:358] "Generic (PLEG): container finished" podID="96650b1e-b94e-4f53-9fe6-7b45f224d366" containerID="0785b4a9b254fac39873ffa5eac708f11945743fc473976a54d6afa7092e256e" exitCode=0 Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.736399 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"96650b1e-b94e-4f53-9fe6-7b45f224d366","Type":"ContainerDied","Data":"0785b4a9b254fac39873ffa5eac708f11945743fc473976a54d6afa7092e256e"} Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.736617 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"96650b1e-b94e-4f53-9fe6-7b45f224d366","Type":"ContainerDied","Data":"1a83749657f92033aa774faa7dea35e71e3124599409d48a48784e31dbb84c44"} Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.754234 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.757108 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"4fce708d-9952-41be-95e4-de815da4d75a","Type":"ContainerStarted","Data":"827a28a46d1c890951e8220149569dccb0bcd86b23bd5503ade8c62f8991d36a"} Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.758106 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.784408 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-blvth\" (UniqueName: \"kubernetes.io/projected/ea333be7-b49f-446b-9c1c-f7c538731523-kube-api-access-blvth\") pod \"ea333be7-b49f-446b-9c1c-f7c538731523\" (UID: \"ea333be7-b49f-446b-9c1c-f7c538731523\") " Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.784495 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ea333be7-b49f-446b-9c1c-f7c538731523-run-httpd\") pod \"ea333be7-b49f-446b-9c1c-f7c538731523\" (UID: \"ea333be7-b49f-446b-9c1c-f7c538731523\") " Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.784599 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2nqzp\" (UniqueName: \"kubernetes.io/projected/96650b1e-b94e-4f53-9fe6-7b45f224d366-kube-api-access-2nqzp\") pod \"96650b1e-b94e-4f53-9fe6-7b45f224d366\" (UID: \"96650b1e-b94e-4f53-9fe6-7b45f224d366\") " Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.784785 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/ea333be7-b49f-446b-9c1c-f7c538731523-ceilometer-tls-certs\") pod \"ea333be7-b49f-446b-9c1c-f7c538731523\" (UID: \"ea333be7-b49f-446b-9c1c-f7c538731523\") " Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.784838 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/96650b1e-b94e-4f53-9fe6-7b45f224d366-scripts\") pod \"96650b1e-b94e-4f53-9fe6-7b45f224d366\" (UID: \"96650b1e-b94e-4f53-9fe6-7b45f224d366\") " Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.784872 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/ea333be7-b49f-446b-9c1c-f7c538731523-sg-core-conf-yaml\") pod \"ea333be7-b49f-446b-9c1c-f7c538731523\" (UID: \"ea333be7-b49f-446b-9c1c-f7c538731523\") " Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.784972 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/96650b1e-b94e-4f53-9fe6-7b45f224d366-config-data\") pod \"96650b1e-b94e-4f53-9fe6-7b45f224d366\" (UID: \"96650b1e-b94e-4f53-9fe6-7b45f224d366\") " Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.785051 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/96650b1e-b94e-4f53-9fe6-7b45f224d366-etc-machine-id\") pod \"96650b1e-b94e-4f53-9fe6-7b45f224d366\" (UID: \"96650b1e-b94e-4f53-9fe6-7b45f224d366\") " Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.785068 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/96650b1e-b94e-4f53-9fe6-7b45f224d366-combined-ca-bundle\") pod \"96650b1e-b94e-4f53-9fe6-7b45f224d366\" (UID: \"96650b1e-b94e-4f53-9fe6-7b45f224d366\") " Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.786616 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ea333be7-b49f-446b-9c1c-f7c538731523-config-data\") pod \"ea333be7-b49f-446b-9c1c-f7c538731523\" (UID: \"ea333be7-b49f-446b-9c1c-f7c538731523\") " Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.786653 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ea333be7-b49f-446b-9c1c-f7c538731523-combined-ca-bundle\") pod \"ea333be7-b49f-446b-9c1c-f7c538731523\" (UID: \"ea333be7-b49f-446b-9c1c-f7c538731523\") " Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.786681 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ea333be7-b49f-446b-9c1c-f7c538731523-log-httpd\") pod \"ea333be7-b49f-446b-9c1c-f7c538731523\" (UID: \"ea333be7-b49f-446b-9c1c-f7c538731523\") " Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.786703 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ea333be7-b49f-446b-9c1c-f7c538731523-scripts\") pod \"ea333be7-b49f-446b-9c1c-f7c538731523\" (UID: \"ea333be7-b49f-446b-9c1c-f7c538731523\") " Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.786808 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/96650b1e-b94e-4f53-9fe6-7b45f224d366-config-data-custom\") pod \"96650b1e-b94e-4f53-9fe6-7b45f224d366\" (UID: \"96650b1e-b94e-4f53-9fe6-7b45f224d366\") " Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.791054 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea333be7-b49f-446b-9c1c-f7c538731523-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "ea333be7-b49f-446b-9c1c-f7c538731523" (UID: "ea333be7-b49f-446b-9c1c-f7c538731523"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.791454 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/96650b1e-b94e-4f53-9fe6-7b45f224d366-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "96650b1e-b94e-4f53-9fe6-7b45f224d366" (UID: "96650b1e-b94e-4f53-9fe6-7b45f224d366"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.794959 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea333be7-b49f-446b-9c1c-f7c538731523-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "ea333be7-b49f-446b-9c1c-f7c538731523" (UID: "ea333be7-b49f-446b-9c1c-f7c538731523"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.822048 5120 generic.go:358] "Generic (PLEG): container finished" podID="7b459444-a6b1-4f69-a8f9-3db6c84580b7" containerID="5363c5c946a8766cf3a14a7db019b0865f8cc1a4abb2aae6db3b4186297ec6ec" exitCode=0 Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.822210 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"7b459444-a6b1-4f69-a8f9-3db6c84580b7","Type":"ContainerDied","Data":"5363c5c946a8766cf3a14a7db019b0865f8cc1a4abb2aae6db3b4186297ec6ec"} Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.822262 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"7b459444-a6b1-4f69-a8f9-3db6c84580b7","Type":"ContainerDied","Data":"6322e8de539c56ba135a5b1a1cebb22c5cdbda0de669f687a2f9a419f433de15"} Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.822305 5120 scope.go:117] "RemoveContainer" containerID="bfce43255f6c59061a51cab3e762c65baa0ffac66c9aa102ffb5e4300d48d346" Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.822502 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.834341 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-api-0" podStartSLOduration=5.834318918 podStartE2EDuration="5.834318918s" podCreationTimestamp="2026-03-16 16:11:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:12:04.81449296 +0000 UTC m=+2426.968424617" watchObservedRunningTime="2026-03-16 16:12:04.834318918 +0000 UTC m=+2426.988250575" Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.855982 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-5c69df9cf-mtvpx" event={"ID":"4b1fbfd4-c276-42c0-8419-fbe793f89ad7","Type":"ContainerStarted","Data":"1fdc2b81bfeaead5ce02246204e3f304d116b307daff3082676038ab2e1ed81b"} Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.862976 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-6fccf8d5b-2gznd" event={"ID":"e69accdc-df7e-43d7-a3f4-63e6157a9721","Type":"ContainerStarted","Data":"8aee7ea8283e1286cdf8fb09bccdae16f26180b65dcd64d36c57b0a97ca7b47c"} Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.863118 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96650b1e-b94e-4f53-9fe6-7b45f224d366-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "96650b1e-b94e-4f53-9fe6-7b45f224d366" (UID: "96650b1e-b94e-4f53-9fe6-7b45f224d366"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:04 crc kubenswrapper[5120]: E0316 16:12:04.866205 5120 kuberuntime_gc.go:389] "Failed to remove container log dead symlink" err="remove /var/log/containers/nova-metadata-0_openstack-kuttl-tests_nova-metadata-log-bfce43255f6c59061a51cab3e762c65baa0ffac66c9aa102ffb5e4300d48d346.log: no such file or directory" path="/var/log/containers/nova-metadata-0_openstack-kuttl-tests_nova-metadata-log-bfce43255f6c59061a51cab3e762c65baa0ffac66c9aa102ffb5e4300d48d346.log" Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.866882 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96650b1e-b94e-4f53-9fe6-7b45f224d366-scripts" (OuterVolumeSpecName: "scripts") pod "96650b1e-b94e-4f53-9fe6-7b45f224d366" (UID: "96650b1e-b94e-4f53-9fe6-7b45f224d366"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.871250 5120 generic.go:358] "Generic (PLEG): container finished" podID="ea333be7-b49f-446b-9c1c-f7c538731523" containerID="3fda142fc9e38b9e4f20fb452296b328ade551384a9581f9ee8f94fdcc898382" exitCode=0 Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.872732 5120 generic.go:358] "Generic (PLEG): container finished" podID="ea333be7-b49f-446b-9c1c-f7c538731523" containerID="55ce353d6a8518607d6830f49878df64aff34c5acbd20679e5581433ff056336" exitCode=0 Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.871367 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.871273 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ea333be7-b49f-446b-9c1c-f7c538731523","Type":"ContainerDied","Data":"3fda142fc9e38b9e4f20fb452296b328ade551384a9581f9ee8f94fdcc898382"} Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.873282 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ea333be7-b49f-446b-9c1c-f7c538731523","Type":"ContainerDied","Data":"55ce353d6a8518607d6830f49878df64aff34c5acbd20679e5581433ff056336"} Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.873334 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea333be7-b49f-446b-9c1c-f7c538731523-scripts" (OuterVolumeSpecName: "scripts") pod "ea333be7-b49f-446b-9c1c-f7c538731523" (UID: "ea333be7-b49f-446b-9c1c-f7c538731523"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.874348 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea333be7-b49f-446b-9c1c-f7c538731523-kube-api-access-blvth" (OuterVolumeSpecName: "kube-api-access-blvth") pod "ea333be7-b49f-446b-9c1c-f7c538731523" (UID: "ea333be7-b49f-446b-9c1c-f7c538731523"). InnerVolumeSpecName "kube-api-access-blvth". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.874445 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96650b1e-b94e-4f53-9fe6-7b45f224d366-kube-api-access-2nqzp" (OuterVolumeSpecName: "kube-api-access-2nqzp") pod "96650b1e-b94e-4f53-9fe6-7b45f224d366" (UID: "96650b1e-b94e-4f53-9fe6-7b45f224d366"). InnerVolumeSpecName "kube-api-access-2nqzp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.886222 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b459444-a6b1-4f69-a8f9-3db6c84580b7-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "7b459444-a6b1-4f69-a8f9-3db6c84580b7" (UID: "7b459444-a6b1-4f69-a8f9-3db6c84580b7"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.890719 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/96650b1e-b94e-4f53-9fe6-7b45f224d366-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.890870 5120 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/96650b1e-b94e-4f53-9fe6-7b45f224d366-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.890885 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ea333be7-b49f-446b-9c1c-f7c538731523-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.890894 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ea333be7-b49f-446b-9c1c-f7c538731523-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.890903 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7b459444-a6b1-4f69-a8f9-3db6c84580b7-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.890912 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/96650b1e-b94e-4f53-9fe6-7b45f224d366-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.890921 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-blvth\" (UniqueName: \"kubernetes.io/projected/ea333be7-b49f-446b-9c1c-f7c538731523-kube-api-access-blvth\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.890929 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ea333be7-b49f-446b-9c1c-f7c538731523-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.890940 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2nqzp\" (UniqueName: \"kubernetes.io/projected/96650b1e-b94e-4f53-9fe6-7b45f224d366-kube-api-access-2nqzp\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.905674 5120 scope.go:117] "RemoveContainer" containerID="cf7a9dd6bfa88e8fccaa1a621f03d0b496debb8fa72832274da01cb03305c90a" Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.944083 5120 scope.go:117] "RemoveContainer" containerID="016d7acb984498c2d879192f8a4e4df1aa89b0840d16269d8685afb1663e4fb3" Mar 16 16:12:04 crc kubenswrapper[5120]: I0316 16:12:04.973437 5120 scope.go:117] "RemoveContainer" containerID="0785b4a9b254fac39873ffa5eac708f11945743fc473976a54d6afa7092e256e" Mar 16 16:12:05 crc kubenswrapper[5120]: I0316 16:12:05.003369 5120 scope.go:117] "RemoveContainer" containerID="016d7acb984498c2d879192f8a4e4df1aa89b0840d16269d8685afb1663e4fb3" Mar 16 16:12:05 crc kubenswrapper[5120]: E0316 16:12:05.003951 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"016d7acb984498c2d879192f8a4e4df1aa89b0840d16269d8685afb1663e4fb3\": container with ID starting with 016d7acb984498c2d879192f8a4e4df1aa89b0840d16269d8685afb1663e4fb3 not found: ID does not exist" containerID="016d7acb984498c2d879192f8a4e4df1aa89b0840d16269d8685afb1663e4fb3" Mar 16 16:12:05 crc kubenswrapper[5120]: I0316 16:12:05.004006 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"016d7acb984498c2d879192f8a4e4df1aa89b0840d16269d8685afb1663e4fb3"} err="failed to get container status \"016d7acb984498c2d879192f8a4e4df1aa89b0840d16269d8685afb1663e4fb3\": rpc error: code = NotFound desc = could not find container \"016d7acb984498c2d879192f8a4e4df1aa89b0840d16269d8685afb1663e4fb3\": container with ID starting with 016d7acb984498c2d879192f8a4e4df1aa89b0840d16269d8685afb1663e4fb3 not found: ID does not exist" Mar 16 16:12:05 crc kubenswrapper[5120]: I0316 16:12:05.004047 5120 scope.go:117] "RemoveContainer" containerID="0785b4a9b254fac39873ffa5eac708f11945743fc473976a54d6afa7092e256e" Mar 16 16:12:05 crc kubenswrapper[5120]: E0316 16:12:05.004456 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0785b4a9b254fac39873ffa5eac708f11945743fc473976a54d6afa7092e256e\": container with ID starting with 0785b4a9b254fac39873ffa5eac708f11945743fc473976a54d6afa7092e256e not found: ID does not exist" containerID="0785b4a9b254fac39873ffa5eac708f11945743fc473976a54d6afa7092e256e" Mar 16 16:12:05 crc kubenswrapper[5120]: I0316 16:12:05.004498 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0785b4a9b254fac39873ffa5eac708f11945743fc473976a54d6afa7092e256e"} err="failed to get container status \"0785b4a9b254fac39873ffa5eac708f11945743fc473976a54d6afa7092e256e\": rpc error: code = NotFound desc = could not find container \"0785b4a9b254fac39873ffa5eac708f11945743fc473976a54d6afa7092e256e\": container with ID starting with 0785b4a9b254fac39873ffa5eac708f11945743fc473976a54d6afa7092e256e not found: ID does not exist" Mar 16 16:12:05 crc kubenswrapper[5120]: I0316 16:12:05.004525 5120 scope.go:117] "RemoveContainer" containerID="5363c5c946a8766cf3a14a7db019b0865f8cc1a4abb2aae6db3b4186297ec6ec" Mar 16 16:12:05 crc kubenswrapper[5120]: I0316 16:12:05.070555 5120 scope.go:117] "RemoveContainer" containerID="5363c5c946a8766cf3a14a7db019b0865f8cc1a4abb2aae6db3b4186297ec6ec" Mar 16 16:12:05 crc kubenswrapper[5120]: E0316 16:12:05.070937 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5363c5c946a8766cf3a14a7db019b0865f8cc1a4abb2aae6db3b4186297ec6ec\": container with ID starting with 5363c5c946a8766cf3a14a7db019b0865f8cc1a4abb2aae6db3b4186297ec6ec not found: ID does not exist" containerID="5363c5c946a8766cf3a14a7db019b0865f8cc1a4abb2aae6db3b4186297ec6ec" Mar 16 16:12:05 crc kubenswrapper[5120]: I0316 16:12:05.070964 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5363c5c946a8766cf3a14a7db019b0865f8cc1a4abb2aae6db3b4186297ec6ec"} err="failed to get container status \"5363c5c946a8766cf3a14a7db019b0865f8cc1a4abb2aae6db3b4186297ec6ec\": rpc error: code = NotFound desc = could not find container \"5363c5c946a8766cf3a14a7db019b0865f8cc1a4abb2aae6db3b4186297ec6ec\": container with ID starting with 5363c5c946a8766cf3a14a7db019b0865f8cc1a4abb2aae6db3b4186297ec6ec not found: ID does not exist" Mar 16 16:12:05 crc kubenswrapper[5120]: I0316 16:12:05.070982 5120 scope.go:117] "RemoveContainer" containerID="81bfa47e99a4ff0b06d1d87f88486430467c0459105dd9da4f44ca9a3fbf2b31" Mar 16 16:12:05 crc kubenswrapper[5120]: I0316 16:12:05.104367 5120 scope.go:117] "RemoveContainer" containerID="7dcb41eedd2287e418500866f49c86f0302b137b182a1dc21742e0720e3d0e7a" Mar 16 16:12:05 crc kubenswrapper[5120]: I0316 16:12:05.127496 5120 scope.go:117] "RemoveContainer" containerID="3fda142fc9e38b9e4f20fb452296b328ade551384a9581f9ee8f94fdcc898382" Mar 16 16:12:05 crc kubenswrapper[5120]: I0316 16:12:05.201491 5120 scope.go:117] "RemoveContainer" containerID="55ce353d6a8518607d6830f49878df64aff34c5acbd20679e5581433ff056336" Mar 16 16:12:05 crc kubenswrapper[5120]: I0316 16:12:05.230328 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:12:05 crc kubenswrapper[5120]: I0316 16:12:05.330355 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:12:05 crc kubenswrapper[5120]: W0316 16:12:05.344928 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod10ec5605_2810_4b8c_9a6a_e5cfc3b33706.slice/crio-61c0b6f1c7f9b1c6b23da38c23bc14ee9585d510025174a276ae481ae532d98f WatchSource:0}: Error finding container 61c0b6f1c7f9b1c6b23da38c23bc14ee9585d510025174a276ae481ae532d98f: Status 404 returned error can't find the container with id 61c0b6f1c7f9b1c6b23da38c23bc14ee9585d510025174a276ae481ae532d98f Mar 16 16:12:05 crc kubenswrapper[5120]: I0316 16:12:05.379699 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/12b38435-0635-409b-8888-94cdc5433388-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "12b38435-0635-409b-8888-94cdc5433388" (UID: "12b38435-0635-409b-8888-94cdc5433388"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:05 crc kubenswrapper[5120]: I0316 16:12:05.407844 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/12b38435-0635-409b-8888-94cdc5433388-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:05 crc kubenswrapper[5120]: I0316 16:12:05.418235 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b459444-a6b1-4f69-a8f9-3db6c84580b7-config-data" (OuterVolumeSpecName: "config-data") pod "7b459444-a6b1-4f69-a8f9-3db6c84580b7" (UID: "7b459444-a6b1-4f69-a8f9-3db6c84580b7"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:05 crc kubenswrapper[5120]: I0316 16:12:05.437997 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/12b38435-0635-409b-8888-94cdc5433388-config-data" (OuterVolumeSpecName: "config-data") pod "12b38435-0635-409b-8888-94cdc5433388" (UID: "12b38435-0635-409b-8888-94cdc5433388"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:05 crc kubenswrapper[5120]: I0316 16:12:05.480447 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea333be7-b49f-446b-9c1c-f7c538731523-ceilometer-tls-certs" (OuterVolumeSpecName: "ceilometer-tls-certs") pod "ea333be7-b49f-446b-9c1c-f7c538731523" (UID: "ea333be7-b49f-446b-9c1c-f7c538731523"). InnerVolumeSpecName "ceilometer-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:05 crc kubenswrapper[5120]: I0316 16:12:05.510673 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7b459444-a6b1-4f69-a8f9-3db6c84580b7-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:05 crc kubenswrapper[5120]: I0316 16:12:05.510703 5120 reconciler_common.go:299] "Volume detached for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/ea333be7-b49f-446b-9c1c-f7c538731523-ceilometer-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:05 crc kubenswrapper[5120]: I0316 16:12:05.510714 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/12b38435-0635-409b-8888-94cdc5433388-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:05 crc kubenswrapper[5120]: I0316 16:12:05.522968 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea333be7-b49f-446b-9c1c-f7c538731523-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "ea333be7-b49f-446b-9c1c-f7c538731523" (UID: "ea333be7-b49f-446b-9c1c-f7c538731523"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:05 crc kubenswrapper[5120]: I0316 16:12:05.579020 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea333be7-b49f-446b-9c1c-f7c538731523-config-data" (OuterVolumeSpecName: "config-data") pod "ea333be7-b49f-446b-9c1c-f7c538731523" (UID: "ea333be7-b49f-446b-9c1c-f7c538731523"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:05 crc kubenswrapper[5120]: I0316 16:12:05.587868 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea333be7-b49f-446b-9c1c-f7c538731523-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ea333be7-b49f-446b-9c1c-f7c538731523" (UID: "ea333be7-b49f-446b-9c1c-f7c538731523"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:05 crc kubenswrapper[5120]: I0316 16:12:05.616331 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/ea333be7-b49f-446b-9c1c-f7c538731523-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:05 crc kubenswrapper[5120]: I0316 16:12:05.616481 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ea333be7-b49f-446b-9c1c-f7c538731523-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:05 crc kubenswrapper[5120]: I0316 16:12:05.616544 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ea333be7-b49f-446b-9c1c-f7c538731523-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:05 crc kubenswrapper[5120]: I0316 16:12:05.639529 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96650b1e-b94e-4f53-9fe6-7b45f224d366-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "96650b1e-b94e-4f53-9fe6-7b45f224d366" (UID: "96650b1e-b94e-4f53-9fe6-7b45f224d366"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:05 crc kubenswrapper[5120]: I0316 16:12:05.666024 5120 scope.go:117] "RemoveContainer" containerID="bc2df124cc6ad146d7c7dd2115ac815986fb62978d38895f6d345a4a9b14dbd8" Mar 16 16:12:05 crc kubenswrapper[5120]: E0316 16:12:05.666622 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:12:05 crc kubenswrapper[5120]: I0316 16:12:05.687972 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96650b1e-b94e-4f53-9fe6-7b45f224d366-config-data" (OuterVolumeSpecName: "config-data") pod "96650b1e-b94e-4f53-9fe6-7b45f224d366" (UID: "96650b1e-b94e-4f53-9fe6-7b45f224d366"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:05 crc kubenswrapper[5120]: I0316 16:12:05.732811 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/96650b1e-b94e-4f53-9fe6-7b45f224d366-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:05 crc kubenswrapper[5120]: I0316 16:12:05.732853 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/96650b1e-b94e-4f53-9fe6-7b45f224d366-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:05 crc kubenswrapper[5120]: I0316 16:12:05.743883 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 16:12:05 crc kubenswrapper[5120]: I0316 16:12:05.759979 5120 scope.go:117] "RemoveContainer" containerID="81bfa47e99a4ff0b06d1d87f88486430467c0459105dd9da4f44ca9a3fbf2b31" Mar 16 16:12:05 crc kubenswrapper[5120]: E0316 16:12:05.764040 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"81bfa47e99a4ff0b06d1d87f88486430467c0459105dd9da4f44ca9a3fbf2b31\": container with ID starting with 81bfa47e99a4ff0b06d1d87f88486430467c0459105dd9da4f44ca9a3fbf2b31 not found: ID does not exist" containerID="81bfa47e99a4ff0b06d1d87f88486430467c0459105dd9da4f44ca9a3fbf2b31" Mar 16 16:12:05 crc kubenswrapper[5120]: I0316 16:12:05.764089 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81bfa47e99a4ff0b06d1d87f88486430467c0459105dd9da4f44ca9a3fbf2b31"} err="failed to get container status \"81bfa47e99a4ff0b06d1d87f88486430467c0459105dd9da4f44ca9a3fbf2b31\": rpc error: code = NotFound desc = could not find container \"81bfa47e99a4ff0b06d1d87f88486430467c0459105dd9da4f44ca9a3fbf2b31\": container with ID starting with 81bfa47e99a4ff0b06d1d87f88486430467c0459105dd9da4f44ca9a3fbf2b31 not found: ID does not exist" Mar 16 16:12:05 crc kubenswrapper[5120]: I0316 16:12:05.764119 5120 scope.go:117] "RemoveContainer" containerID="7dcb41eedd2287e418500866f49c86f0302b137b182a1dc21742e0720e3d0e7a" Mar 16 16:12:05 crc kubenswrapper[5120]: E0316 16:12:05.766165 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7dcb41eedd2287e418500866f49c86f0302b137b182a1dc21742e0720e3d0e7a\": container with ID starting with 7dcb41eedd2287e418500866f49c86f0302b137b182a1dc21742e0720e3d0e7a not found: ID does not exist" containerID="7dcb41eedd2287e418500866f49c86f0302b137b182a1dc21742e0720e3d0e7a" Mar 16 16:12:05 crc kubenswrapper[5120]: I0316 16:12:05.766203 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7dcb41eedd2287e418500866f49c86f0302b137b182a1dc21742e0720e3d0e7a"} err="failed to get container status \"7dcb41eedd2287e418500866f49c86f0302b137b182a1dc21742e0720e3d0e7a\": rpc error: code = NotFound desc = could not find container \"7dcb41eedd2287e418500866f49c86f0302b137b182a1dc21742e0720e3d0e7a\": container with ID starting with 7dcb41eedd2287e418500866f49c86f0302b137b182a1dc21742e0720e3d0e7a not found: ID does not exist" Mar 16 16:12:05 crc kubenswrapper[5120]: I0316 16:12:05.766231 5120 scope.go:117] "RemoveContainer" containerID="3fda142fc9e38b9e4f20fb452296b328ade551384a9581f9ee8f94fdcc898382" Mar 16 16:12:05 crc kubenswrapper[5120]: E0316 16:12:05.774090 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3fda142fc9e38b9e4f20fb452296b328ade551384a9581f9ee8f94fdcc898382\": container with ID starting with 3fda142fc9e38b9e4f20fb452296b328ade551384a9581f9ee8f94fdcc898382 not found: ID does not exist" containerID="3fda142fc9e38b9e4f20fb452296b328ade551384a9581f9ee8f94fdcc898382" Mar 16 16:12:05 crc kubenswrapper[5120]: I0316 16:12:05.774141 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3fda142fc9e38b9e4f20fb452296b328ade551384a9581f9ee8f94fdcc898382"} err="failed to get container status \"3fda142fc9e38b9e4f20fb452296b328ade551384a9581f9ee8f94fdcc898382\": rpc error: code = NotFound desc = could not find container \"3fda142fc9e38b9e4f20fb452296b328ade551384a9581f9ee8f94fdcc898382\": container with ID starting with 3fda142fc9e38b9e4f20fb452296b328ade551384a9581f9ee8f94fdcc898382 not found: ID does not exist" Mar 16 16:12:05 crc kubenswrapper[5120]: I0316 16:12:05.774177 5120 scope.go:117] "RemoveContainer" containerID="55ce353d6a8518607d6830f49878df64aff34c5acbd20679e5581433ff056336" Mar 16 16:12:05 crc kubenswrapper[5120]: E0316 16:12:05.779202 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"55ce353d6a8518607d6830f49878df64aff34c5acbd20679e5581433ff056336\": container with ID starting with 55ce353d6a8518607d6830f49878df64aff34c5acbd20679e5581433ff056336 not found: ID does not exist" containerID="55ce353d6a8518607d6830f49878df64aff34c5acbd20679e5581433ff056336" Mar 16 16:12:05 crc kubenswrapper[5120]: I0316 16:12:05.779252 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55ce353d6a8518607d6830f49878df64aff34c5acbd20679e5581433ff056336"} err="failed to get container status \"55ce353d6a8518607d6830f49878df64aff34c5acbd20679e5581433ff056336\": rpc error: code = NotFound desc = could not find container \"55ce353d6a8518607d6830f49878df64aff34c5acbd20679e5581433ff056336\": container with ID starting with 55ce353d6a8518607d6830f49878df64aff34c5acbd20679e5581433ff056336 not found: ID does not exist" Mar 16 16:12:05 crc kubenswrapper[5120]: I0316 16:12:05.785855 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 16:12:05 crc kubenswrapper[5120]: I0316 16:12:05.798206 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:12:05 crc kubenswrapper[5120]: I0316 16:12:05.816845 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:12:05 crc kubenswrapper[5120]: I0316 16:12:05.840859 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 16:12:05 crc kubenswrapper[5120]: I0316 16:12:05.841885 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea333be7-b49f-446b-9c1c-f7c538731523" containerName="ceilometer-central-agent" Mar 16 16:12:05 crc kubenswrapper[5120]: I0316 16:12:05.841903 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea333be7-b49f-446b-9c1c-f7c538731523" containerName="ceilometer-central-agent" Mar 16 16:12:05 crc kubenswrapper[5120]: I0316 16:12:05.841938 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea333be7-b49f-446b-9c1c-f7c538731523" containerName="ceilometer-notification-agent" Mar 16 16:12:05 crc kubenswrapper[5120]: I0316 16:12:05.841945 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea333be7-b49f-446b-9c1c-f7c538731523" containerName="ceilometer-notification-agent" Mar 16 16:12:05 crc kubenswrapper[5120]: I0316 16:12:05.842935 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96650b1e-b94e-4f53-9fe6-7b45f224d366" containerName="cinder-scheduler" Mar 16 16:12:05 crc kubenswrapper[5120]: I0316 16:12:05.842950 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="96650b1e-b94e-4f53-9fe6-7b45f224d366" containerName="cinder-scheduler" Mar 16 16:12:05 crc kubenswrapper[5120]: I0316 16:12:05.842963 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea333be7-b49f-446b-9c1c-f7c538731523" containerName="sg-core" Mar 16 16:12:05 crc kubenswrapper[5120]: I0316 16:12:05.842969 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea333be7-b49f-446b-9c1c-f7c538731523" containerName="sg-core" Mar 16 16:12:05 crc kubenswrapper[5120]: I0316 16:12:05.842989 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96650b1e-b94e-4f53-9fe6-7b45f224d366" containerName="probe" Mar 16 16:12:05 crc kubenswrapper[5120]: I0316 16:12:05.842994 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="96650b1e-b94e-4f53-9fe6-7b45f224d366" containerName="probe" Mar 16 16:12:05 crc kubenswrapper[5120]: I0316 16:12:05.843007 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12b38435-0635-409b-8888-94cdc5433388" containerName="nova-cell1-conductor-conductor" Mar 16 16:12:05 crc kubenswrapper[5120]: I0316 16:12:05.843012 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="12b38435-0635-409b-8888-94cdc5433388" containerName="nova-cell1-conductor-conductor" Mar 16 16:12:05 crc kubenswrapper[5120]: I0316 16:12:05.843022 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b459444-a6b1-4f69-a8f9-3db6c84580b7" containerName="nova-scheduler-scheduler" Mar 16 16:12:05 crc kubenswrapper[5120]: I0316 16:12:05.843027 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b459444-a6b1-4f69-a8f9-3db6c84580b7" containerName="nova-scheduler-scheduler" Mar 16 16:12:05 crc kubenswrapper[5120]: I0316 16:12:05.843042 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea333be7-b49f-446b-9c1c-f7c538731523" containerName="proxy-httpd" Mar 16 16:12:05 crc kubenswrapper[5120]: I0316 16:12:05.843047 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea333be7-b49f-446b-9c1c-f7c538731523" containerName="proxy-httpd" Mar 16 16:12:05 crc kubenswrapper[5120]: I0316 16:12:05.843236 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7b459444-a6b1-4f69-a8f9-3db6c84580b7" containerName="nova-scheduler-scheduler" Mar 16 16:12:05 crc kubenswrapper[5120]: I0316 16:12:05.843251 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ea333be7-b49f-446b-9c1c-f7c538731523" containerName="ceilometer-notification-agent" Mar 16 16:12:05 crc kubenswrapper[5120]: I0316 16:12:05.843258 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="96650b1e-b94e-4f53-9fe6-7b45f224d366" containerName="probe" Mar 16 16:12:05 crc kubenswrapper[5120]: I0316 16:12:05.843265 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="12b38435-0635-409b-8888-94cdc5433388" containerName="nova-cell1-conductor-conductor" Mar 16 16:12:05 crc kubenswrapper[5120]: I0316 16:12:05.843281 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ea333be7-b49f-446b-9c1c-f7c538731523" containerName="ceilometer-central-agent" Mar 16 16:12:05 crc kubenswrapper[5120]: I0316 16:12:05.843288 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ea333be7-b49f-446b-9c1c-f7c538731523" containerName="proxy-httpd" Mar 16 16:12:05 crc kubenswrapper[5120]: I0316 16:12:05.843300 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ea333be7-b49f-446b-9c1c-f7c538731523" containerName="sg-core" Mar 16 16:12:05 crc kubenswrapper[5120]: I0316 16:12:05.843309 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="96650b1e-b94e-4f53-9fe6-7b45f224d366" containerName="cinder-scheduler" Mar 16 16:12:05 crc kubenswrapper[5120]: I0316 16:12:05.866517 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:12:05 crc kubenswrapper[5120]: I0316 16:12:05.872083 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-conductor-config-data\"" Mar 16 16:12:05 crc kubenswrapper[5120]: I0316 16:12:05.883270 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 16:12:05 crc kubenswrapper[5120]: I0316 16:12:05.898102 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:12:05 crc kubenswrapper[5120]: I0316 16:12:05.913645 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:12:05 crc kubenswrapper[5120]: I0316 16:12:05.928218 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-scheduler-config-data\"" Mar 16 16:12:05 crc kubenswrapper[5120]: I0316 16:12:05.929967 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:12:05 crc kubenswrapper[5120]: I0316 16:12:05.935520 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-74b77cc694-lzqfl" event={"ID":"8f51149f-2af3-4bb8-ab7a-1b94ca6754e5","Type":"ContainerStarted","Data":"a303d469a3addcf7c18b6951abfbc9df1ca852f6f924702095cd0344e3fbcec2"} Mar 16 16:12:05 crc kubenswrapper[5120]: I0316 16:12:05.935789 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-74b77cc694-lzqfl" podUID="8f51149f-2af3-4bb8-ab7a-1b94ca6754e5" containerName="barbican-keystone-listener-log" containerID="cri-o://f51657860a93464c474c6250eb0e7edd01c80756a4dd39fe9f29602c9058027d" gracePeriod=30 Mar 16 16:12:05 crc kubenswrapper[5120]: I0316 16:12:05.935940 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-74b77cc694-lzqfl" podUID="8f51149f-2af3-4bb8-ab7a-1b94ca6754e5" containerName="barbican-keystone-listener" containerID="cri-o://a303d469a3addcf7c18b6951abfbc9df1ca852f6f924702095cd0344e3fbcec2" gracePeriod=30 Mar 16 16:12:05 crc kubenswrapper[5120]: I0316 16:12:05.942783 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bce71378-f7b0-4b73-8b4a-711353734319-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"bce71378-f7b0-4b73-8b4a-711353734319\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:12:05 crc kubenswrapper[5120]: I0316 16:12:05.943021 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bce71378-f7b0-4b73-8b4a-711353734319-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"bce71378-f7b0-4b73-8b4a-711353734319\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:12:05 crc kubenswrapper[5120]: I0316 16:12:05.943068 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xkps\" (UniqueName: \"kubernetes.io/projected/bce71378-f7b0-4b73-8b4a-711353734319-kube-api-access-5xkps\") pod \"nova-cell1-conductor-0\" (UID: \"bce71378-f7b0-4b73-8b4a-711353734319\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:12:05 crc kubenswrapper[5120]: I0316 16:12:05.943245 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"10ec5605-2810-4b8c-9a6a-e5cfc3b33706","Type":"ContainerStarted","Data":"61c0b6f1c7f9b1c6b23da38c23bc14ee9585d510025174a276ae481ae532d98f"} Mar 16 16:12:05 crc kubenswrapper[5120]: I0316 16:12:05.953074 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"17b2138c-b3ca-4538-a7d7-0dc6756650bf","Type":"ContainerStarted","Data":"ae8828fc37a6c384c3bc2873b8ad9f7bb59a62f9a80346627a4cf4f5926c1a33"} Mar 16 16:12:05 crc kubenswrapper[5120]: I0316 16:12:05.965241 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561292-z2wqq" event={"ID":"ad803ce8-2d88-44d8-a717-aaec85ce871c","Type":"ContainerStarted","Data":"e09ca476407ec729cd1111e5cc4d786a923c7f7a46f6062fd777ae7956a01722"} Mar 16 16:12:05 crc kubenswrapper[5120]: I0316 16:12:05.971163 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:12:05 crc kubenswrapper[5120]: I0316 16:12:05.980852 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-5c69df9cf-mtvpx" event={"ID":"4b1fbfd4-c276-42c0-8419-fbe793f89ad7","Type":"ContainerStarted","Data":"8e1c2b48df0636163c4f4b058904caa37d9e2fd89f8f859f7317813866b37ece"} Mar 16 16:12:05 crc kubenswrapper[5120]: I0316 16:12:05.998086 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:12:06 crc kubenswrapper[5120]: I0316 16:12:06.054943 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-6fccf8d5b-2gznd" event={"ID":"e69accdc-df7e-43d7-a3f4-63e6157a9721","Type":"ContainerStarted","Data":"58d9e300c31d95e5a4064dea51869cfe2c0f3d0081ea9a8e24c55faae1c4334a"} Mar 16 16:12:06 crc kubenswrapper[5120]: I0316 16:12:06.055100 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-6fccf8d5b-2gznd" podUID="e69accdc-df7e-43d7-a3f4-63e6157a9721" containerName="barbican-api-log" containerID="cri-o://8aee7ea8283e1286cdf8fb09bccdae16f26180b65dcd64d36c57b0a97ca7b47c" gracePeriod=30 Mar 16 16:12:06 crc kubenswrapper[5120]: I0316 16:12:06.055177 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-6fccf8d5b-2gznd" Mar 16 16:12:06 crc kubenswrapper[5120]: I0316 16:12:06.055199 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-6fccf8d5b-2gznd" Mar 16 16:12:06 crc kubenswrapper[5120]: I0316 16:12:06.055574 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-6fccf8d5b-2gznd" podUID="e69accdc-df7e-43d7-a3f4-63e6157a9721" containerName="barbican-api" containerID="cri-o://58d9e300c31d95e5a4064dea51869cfe2c0f3d0081ea9a8e24c55faae1c4334a" gracePeriod=30 Mar 16 16:12:06 crc kubenswrapper[5120]: I0316 16:12:06.057431 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bba65a98-1383-4c8c-995a-b212b232d1f8-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"bba65a98-1383-4c8c-995a-b212b232d1f8\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:12:06 crc kubenswrapper[5120]: I0316 16:12:06.057588 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bba65a98-1383-4c8c-995a-b212b232d1f8-config-data\") pod \"nova-scheduler-0\" (UID: \"bba65a98-1383-4c8c-995a-b212b232d1f8\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:12:06 crc kubenswrapper[5120]: I0316 16:12:06.057674 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bce71378-f7b0-4b73-8b4a-711353734319-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"bce71378-f7b0-4b73-8b4a-711353734319\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:12:06 crc kubenswrapper[5120]: I0316 16:12:06.058655 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnpgr\" (UniqueName: \"kubernetes.io/projected/bba65a98-1383-4c8c-995a-b212b232d1f8-kube-api-access-qnpgr\") pod \"nova-scheduler-0\" (UID: \"bba65a98-1383-4c8c-995a-b212b232d1f8\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:12:06 crc kubenswrapper[5120]: I0316 16:12:06.058856 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bce71378-f7b0-4b73-8b4a-711353734319-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"bce71378-f7b0-4b73-8b4a-711353734319\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:12:06 crc kubenswrapper[5120]: I0316 16:12:06.059017 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5xkps\" (UniqueName: \"kubernetes.io/projected/bce71378-f7b0-4b73-8b4a-711353734319-kube-api-access-5xkps\") pod \"nova-cell1-conductor-0\" (UID: \"bce71378-f7b0-4b73-8b4a-711353734319\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:12:06 crc kubenswrapper[5120]: I0316 16:12:06.063155 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bce71378-f7b0-4b73-8b4a-711353734319-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"bce71378-f7b0-4b73-8b4a-711353734319\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:12:06 crc kubenswrapper[5120]: I0316 16:12:06.068882 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bce71378-f7b0-4b73-8b4a-711353734319-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"bce71378-f7b0-4b73-8b4a-711353734319\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:12:06 crc kubenswrapper[5120]: I0316 16:12:06.082647 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-999b785fd-fgwkp" event={"ID":"e929a717-3e1e-4481-9e69-3705d47c1d87","Type":"ContainerStarted","Data":"ce61368d5cd8052546a7ed15f5aa10f7e088e78f6ddea239cb0d9b4ae4383626"} Mar 16 16:12:06 crc kubenswrapper[5120]: I0316 16:12:06.086407 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xkps\" (UniqueName: \"kubernetes.io/projected/bce71378-f7b0-4b73-8b4a-711353734319-kube-api-access-5xkps\") pod \"nova-cell1-conductor-0\" (UID: \"bce71378-f7b0-4b73-8b4a-711353734319\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:12:06 crc kubenswrapper[5120]: I0316 16:12:06.089836 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-69787fc498-jx88k" event={"ID":"34da2089-cc88-4d8c-97da-68aadf7f2c03","Type":"ContainerStarted","Data":"76d367745a5b0b62a2045aa1d05a31b674319fe60957e9cfd4510f19426260cb"} Mar 16 16:12:06 crc kubenswrapper[5120]: I0316 16:12:06.091706 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-69787fc498-jx88k" Mar 16 16:12:06 crc kubenswrapper[5120]: I0316 16:12:06.091802 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-69787fc498-jx88k" Mar 16 16:12:06 crc kubenswrapper[5120]: I0316 16:12:06.103896 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:12:06 crc kubenswrapper[5120]: I0316 16:12:06.111126 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:12:06 crc kubenswrapper[5120]: I0316 16:12:06.117135 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ceilometer-internal-svc\"" Mar 16 16:12:06 crc kubenswrapper[5120]: I0316 16:12:06.117325 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 16:12:06 crc kubenswrapper[5120]: I0316 16:12:06.117473 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"dae19557-6584-433e-a345-c373d9e8a4ae","Type":"ContainerStarted","Data":"a45d41b1d9d4e8e8b46bd068b4409058a847b35aec00d30d3d8619af44323cbf"} Mar 16 16:12:06 crc kubenswrapper[5120]: I0316 16:12:06.121121 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 16:12:06 crc kubenswrapper[5120]: I0316 16:12:06.158974 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:12:06 crc kubenswrapper[5120]: I0316 16:12:06.161417 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bba65a98-1383-4c8c-995a-b212b232d1f8-config-data\") pod \"nova-scheduler-0\" (UID: \"bba65a98-1383-4c8c-995a-b212b232d1f8\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:12:06 crc kubenswrapper[5120]: I0316 16:12:06.161581 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qnpgr\" (UniqueName: \"kubernetes.io/projected/bba65a98-1383-4c8c-995a-b212b232d1f8-kube-api-access-qnpgr\") pod \"nova-scheduler-0\" (UID: \"bba65a98-1383-4c8c-995a-b212b232d1f8\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:12:06 crc kubenswrapper[5120]: I0316 16:12:06.161751 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bba65a98-1383-4c8c-995a-b212b232d1f8-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"bba65a98-1383-4c8c-995a-b212b232d1f8\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:12:06 crc kubenswrapper[5120]: I0316 16:12:06.169426 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bba65a98-1383-4c8c-995a-b212b232d1f8-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"bba65a98-1383-4c8c-995a-b212b232d1f8\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:12:06 crc kubenswrapper[5120]: I0316 16:12:06.177290 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnpgr\" (UniqueName: \"kubernetes.io/projected/bba65a98-1383-4c8c-995a-b212b232d1f8-kube-api-access-qnpgr\") pod \"nova-scheduler-0\" (UID: \"bba65a98-1383-4c8c-995a-b212b232d1f8\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:12:06 crc kubenswrapper[5120]: I0316 16:12:06.188538 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bba65a98-1383-4c8c-995a-b212b232d1f8-config-data\") pod \"nova-scheduler-0\" (UID: \"bba65a98-1383-4c8c-995a-b212b232d1f8\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:12:06 crc kubenswrapper[5120]: I0316 16:12:06.230009 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-keystone-listener-74b77cc694-lzqfl" podStartSLOduration=5.229983648 podStartE2EDuration="5.229983648s" podCreationTimestamp="2026-03-16 16:12:01 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:12:06.010961725 +0000 UTC m=+2428.164893382" watchObservedRunningTime="2026-03-16 16:12:06.229983648 +0000 UTC m=+2428.383915305" Mar 16 16:12:06 crc kubenswrapper[5120]: I0316 16:12:06.257470 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-api-6fccf8d5b-2gznd" podStartSLOduration=5.257291639 podStartE2EDuration="5.257291639s" podCreationTimestamp="2026-03-16 16:12:01 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:12:06.081611982 +0000 UTC m=+2428.235543639" watchObservedRunningTime="2026-03-16 16:12:06.257291639 +0000 UTC m=+2428.411223296" Mar 16 16:12:06 crc kubenswrapper[5120]: E0316 16:12:06.262131 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="31a2fce1e20c5b62f2a74ffb53802354c75a971f977ab88fe1d0d2ac24820f8d" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:12:06 crc kubenswrapper[5120]: I0316 16:12:06.263055 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:12:06 crc kubenswrapper[5120]: I0316 16:12:06.263261 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxg57\" (UniqueName: \"kubernetes.io/projected/f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5-kube-api-access-fxg57\") pod \"ceilometer-0\" (UID: \"f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:12:06 crc kubenswrapper[5120]: I0316 16:12:06.263293 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:12:06 crc kubenswrapper[5120]: I0316 16:12:06.263353 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:12:06 crc kubenswrapper[5120]: I0316 16:12:06.263373 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5-run-httpd\") pod \"ceilometer-0\" (UID: \"f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:12:06 crc kubenswrapper[5120]: I0316 16:12:06.263500 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5-log-httpd\") pod \"ceilometer-0\" (UID: \"f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:12:06 crc kubenswrapper[5120]: I0316 16:12:06.263540 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5-scripts\") pod \"ceilometer-0\" (UID: \"f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:12:06 crc kubenswrapper[5120]: I0316 16:12:06.263567 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5-config-data\") pod \"ceilometer-0\" (UID: \"f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:12:06 crc kubenswrapper[5120]: E0316 16:12:06.267564 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="31a2fce1e20c5b62f2a74ffb53802354c75a971f977ab88fe1d0d2ac24820f8d" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:12:06 crc kubenswrapper[5120]: E0316 16:12:06.269511 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="31a2fce1e20c5b62f2a74ffb53802354c75a971f977ab88fe1d0d2ac24820f8d" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:12:06 crc kubenswrapper[5120]: E0316 16:12:06.269566 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="3e95e501-6a44-4736-aa20-72fe1a2bb1a8" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 16:12:06 crc kubenswrapper[5120]: I0316 16:12:06.272684 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-api-69787fc498-jx88k" podStartSLOduration=5.272672706 podStartE2EDuration="5.272672706s" podCreationTimestamp="2026-03-16 16:12:01 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:12:06.116614501 +0000 UTC m=+2428.270546158" watchObservedRunningTime="2026-03-16 16:12:06.272672706 +0000 UTC m=+2428.426604363" Mar 16 16:12:06 crc kubenswrapper[5120]: I0316 16:12:06.289075 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podStartSLOduration=5.28905005 podStartE2EDuration="5.28905005s" podCreationTimestamp="2026-03-16 16:12:01 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:12:06.155447915 +0000 UTC m=+2428.309379572" watchObservedRunningTime="2026-03-16 16:12:06.28905005 +0000 UTC m=+2428.442981707" Mar 16 16:12:06 crc kubenswrapper[5120]: I0316 16:12:06.365968 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5-log-httpd\") pod \"ceilometer-0\" (UID: \"f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:12:06 crc kubenswrapper[5120]: I0316 16:12:06.366044 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5-scripts\") pod \"ceilometer-0\" (UID: \"f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:12:06 crc kubenswrapper[5120]: I0316 16:12:06.366072 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5-config-data\") pod \"ceilometer-0\" (UID: \"f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:12:06 crc kubenswrapper[5120]: I0316 16:12:06.366133 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:12:06 crc kubenswrapper[5120]: I0316 16:12:06.366258 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fxg57\" (UniqueName: \"kubernetes.io/projected/f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5-kube-api-access-fxg57\") pod \"ceilometer-0\" (UID: \"f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:12:06 crc kubenswrapper[5120]: I0316 16:12:06.366287 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:12:06 crc kubenswrapper[5120]: I0316 16:12:06.366325 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:12:06 crc kubenswrapper[5120]: I0316 16:12:06.366345 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5-run-httpd\") pod \"ceilometer-0\" (UID: \"f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:12:06 crc kubenswrapper[5120]: I0316 16:12:06.367142 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5-run-httpd\") pod \"ceilometer-0\" (UID: \"f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:12:06 crc kubenswrapper[5120]: I0316 16:12:06.368203 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5-log-httpd\") pod \"ceilometer-0\" (UID: \"f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:12:06 crc kubenswrapper[5120]: I0316 16:12:06.372191 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:12:06 crc kubenswrapper[5120]: I0316 16:12:06.374499 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5-scripts\") pod \"ceilometer-0\" (UID: \"f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:12:06 crc kubenswrapper[5120]: I0316 16:12:06.374528 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5-config-data\") pod \"ceilometer-0\" (UID: \"f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:12:06 crc kubenswrapper[5120]: I0316 16:12:06.374944 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:12:06 crc kubenswrapper[5120]: I0316 16:12:06.376783 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:12:06 crc kubenswrapper[5120]: I0316 16:12:06.385675 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxg57\" (UniqueName: \"kubernetes.io/projected/f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5-kube-api-access-fxg57\") pod \"ceilometer-0\" (UID: \"f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:12:06 crc kubenswrapper[5120]: I0316 16:12:06.691562 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="12b38435-0635-409b-8888-94cdc5433388" path="/var/lib/kubelet/pods/12b38435-0635-409b-8888-94cdc5433388/volumes" Mar 16 16:12:06 crc kubenswrapper[5120]: I0316 16:12:06.692470 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7b459444-a6b1-4f69-a8f9-3db6c84580b7" path="/var/lib/kubelet/pods/7b459444-a6b1-4f69-a8f9-3db6c84580b7/volumes" Mar 16 16:12:06 crc kubenswrapper[5120]: I0316 16:12:06.693087 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ea333be7-b49f-446b-9c1c-f7c538731523" path="/var/lib/kubelet/pods/ea333be7-b49f-446b-9c1c-f7c538731523/volumes" Mar 16 16:12:06 crc kubenswrapper[5120]: E0316 16:12:06.717420 5120 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode69accdc_df7e_43d7_a3f4_63e6157a9721.slice/crio-conmon-58d9e300c31d95e5a4064dea51869cfe2c0f3d0081ea9a8e24c55faae1c4334a.scope\": RecentStats: unable to find data in memory cache]" Mar 16 16:12:06 crc kubenswrapper[5120]: I0316 16:12:06.805713 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:12:06 crc kubenswrapper[5120]: I0316 16:12:06.807949 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:12:06 crc kubenswrapper[5120]: I0316 16:12:06.854386 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:12:06 crc kubenswrapper[5120]: I0316 16:12:06.858743 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:12:06 crc kubenswrapper[5120]: I0316 16:12:06.869935 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:12:06 crc kubenswrapper[5120]: I0316 16:12:06.895828 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:12:06 crc kubenswrapper[5120]: I0316 16:12:06.895964 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:12:06 crc kubenswrapper[5120]: I0316 16:12:06.900524 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-scheduler-config-data\"" Mar 16 16:12:06 crc kubenswrapper[5120]: I0316 16:12:06.901318 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:12:07 crc kubenswrapper[5120]: I0316 16:12:07.016549 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:12:07 crc kubenswrapper[5120]: I0316 16:12:07.023194 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/96d66c8e-8cdb-462c-a302-c85e581db5ad-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"96d66c8e-8cdb-462c-a302-c85e581db5ad\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:12:07 crc kubenswrapper[5120]: I0316 16:12:07.023328 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/96d66c8e-8cdb-462c-a302-c85e581db5ad-config-data\") pod \"cinder-scheduler-0\" (UID: \"96d66c8e-8cdb-462c-a302-c85e581db5ad\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:12:07 crc kubenswrapper[5120]: I0316 16:12:07.023355 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdc5z\" (UniqueName: \"kubernetes.io/projected/96d66c8e-8cdb-462c-a302-c85e581db5ad-kube-api-access-mdc5z\") pod \"cinder-scheduler-0\" (UID: \"96d66c8e-8cdb-462c-a302-c85e581db5ad\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:12:07 crc kubenswrapper[5120]: I0316 16:12:07.023441 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/96d66c8e-8cdb-462c-a302-c85e581db5ad-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"96d66c8e-8cdb-462c-a302-c85e581db5ad\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:12:07 crc kubenswrapper[5120]: I0316 16:12:07.023471 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/96d66c8e-8cdb-462c-a302-c85e581db5ad-scripts\") pod \"cinder-scheduler-0\" (UID: \"96d66c8e-8cdb-462c-a302-c85e581db5ad\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:12:07 crc kubenswrapper[5120]: I0316 16:12:07.023545 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/96d66c8e-8cdb-462c-a302-c85e581db5ad-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"96d66c8e-8cdb-462c-a302-c85e581db5ad\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:12:07 crc kubenswrapper[5120]: I0316 16:12:07.131056 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/96d66c8e-8cdb-462c-a302-c85e581db5ad-config-data\") pod \"cinder-scheduler-0\" (UID: \"96d66c8e-8cdb-462c-a302-c85e581db5ad\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:12:07 crc kubenswrapper[5120]: I0316 16:12:07.131124 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mdc5z\" (UniqueName: \"kubernetes.io/projected/96d66c8e-8cdb-462c-a302-c85e581db5ad-kube-api-access-mdc5z\") pod \"cinder-scheduler-0\" (UID: \"96d66c8e-8cdb-462c-a302-c85e581db5ad\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:12:07 crc kubenswrapper[5120]: I0316 16:12:07.131228 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/96d66c8e-8cdb-462c-a302-c85e581db5ad-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"96d66c8e-8cdb-462c-a302-c85e581db5ad\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:12:07 crc kubenswrapper[5120]: I0316 16:12:07.131268 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/96d66c8e-8cdb-462c-a302-c85e581db5ad-scripts\") pod \"cinder-scheduler-0\" (UID: \"96d66c8e-8cdb-462c-a302-c85e581db5ad\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:12:07 crc kubenswrapper[5120]: I0316 16:12:07.131336 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/96d66c8e-8cdb-462c-a302-c85e581db5ad-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"96d66c8e-8cdb-462c-a302-c85e581db5ad\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:12:07 crc kubenswrapper[5120]: I0316 16:12:07.131398 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/96d66c8e-8cdb-462c-a302-c85e581db5ad-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"96d66c8e-8cdb-462c-a302-c85e581db5ad\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:12:07 crc kubenswrapper[5120]: I0316 16:12:07.138646 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/96d66c8e-8cdb-462c-a302-c85e581db5ad-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"96d66c8e-8cdb-462c-a302-c85e581db5ad\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:12:07 crc kubenswrapper[5120]: I0316 16:12:07.148929 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/96d66c8e-8cdb-462c-a302-c85e581db5ad-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"96d66c8e-8cdb-462c-a302-c85e581db5ad\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:12:07 crc kubenswrapper[5120]: I0316 16:12:07.152705 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/96d66c8e-8cdb-462c-a302-c85e581db5ad-config-data\") pod \"cinder-scheduler-0\" (UID: \"96d66c8e-8cdb-462c-a302-c85e581db5ad\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:12:07 crc kubenswrapper[5120]: I0316 16:12:07.158390 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/96d66c8e-8cdb-462c-a302-c85e581db5ad-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"96d66c8e-8cdb-462c-a302-c85e581db5ad\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:12:07 crc kubenswrapper[5120]: I0316 16:12:07.160507 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/96d66c8e-8cdb-462c-a302-c85e581db5ad-scripts\") pod \"cinder-scheduler-0\" (UID: \"96d66c8e-8cdb-462c-a302-c85e581db5ad\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:12:07 crc kubenswrapper[5120]: I0316 16:12:07.165170 5120 generic.go:358] "Generic (PLEG): container finished" podID="e69accdc-df7e-43d7-a3f4-63e6157a9721" containerID="58d9e300c31d95e5a4064dea51869cfe2c0f3d0081ea9a8e24c55faae1c4334a" exitCode=0 Mar 16 16:12:07 crc kubenswrapper[5120]: I0316 16:12:07.165195 5120 generic.go:358] "Generic (PLEG): container finished" podID="e69accdc-df7e-43d7-a3f4-63e6157a9721" containerID="8aee7ea8283e1286cdf8fb09bccdae16f26180b65dcd64d36c57b0a97ca7b47c" exitCode=143 Mar 16 16:12:07 crc kubenswrapper[5120]: I0316 16:12:07.165604 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-6fccf8d5b-2gznd" event={"ID":"e69accdc-df7e-43d7-a3f4-63e6157a9721","Type":"ContainerDied","Data":"58d9e300c31d95e5a4064dea51869cfe2c0f3d0081ea9a8e24c55faae1c4334a"} Mar 16 16:12:07 crc kubenswrapper[5120]: I0316 16:12:07.165657 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-6fccf8d5b-2gznd" event={"ID":"e69accdc-df7e-43d7-a3f4-63e6157a9721","Type":"ContainerDied","Data":"8aee7ea8283e1286cdf8fb09bccdae16f26180b65dcd64d36c57b0a97ca7b47c"} Mar 16 16:12:07 crc kubenswrapper[5120]: I0316 16:12:07.178510 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-999b785fd-fgwkp" event={"ID":"e929a717-3e1e-4481-9e69-3705d47c1d87","Type":"ContainerStarted","Data":"757edeedd6106fcf5ec09e0e1ab4674498c354be39e305b54c20803a262a9fcf"} Mar 16 16:12:07 crc kubenswrapper[5120]: I0316 16:12:07.186484 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdc5z\" (UniqueName: \"kubernetes.io/projected/96d66c8e-8cdb-462c-a302-c85e581db5ad-kube-api-access-mdc5z\") pod \"cinder-scheduler-0\" (UID: \"96d66c8e-8cdb-462c-a302-c85e581db5ad\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:12:07 crc kubenswrapper[5120]: I0316 16:12:07.214353 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-69787fc498-jx88k" event={"ID":"34da2089-cc88-4d8c-97da-68aadf7f2c03","Type":"ContainerStarted","Data":"937834673f5ee947e2dce3e8165bec6e100d62a9a8ac1a43a10f874df812f3f4"} Mar 16 16:12:07 crc kubenswrapper[5120]: I0316 16:12:07.216611 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-keystone-listener-999b785fd-fgwkp" podStartSLOduration=6.216601719 podStartE2EDuration="6.216601719s" podCreationTimestamp="2026-03-16 16:12:01 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:12:07.214026908 +0000 UTC m=+2429.367958565" watchObservedRunningTime="2026-03-16 16:12:07.216601719 +0000 UTC m=+2429.370533376" Mar 16 16:12:07 crc kubenswrapper[5120]: I0316 16:12:07.227620 5120 generic.go:358] "Generic (PLEG): container finished" podID="8f51149f-2af3-4bb8-ab7a-1b94ca6754e5" containerID="f51657860a93464c474c6250eb0e7edd01c80756a4dd39fe9f29602c9058027d" exitCode=143 Mar 16 16:12:07 crc kubenswrapper[5120]: I0316 16:12:07.227715 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-74b77cc694-lzqfl" event={"ID":"8f51149f-2af3-4bb8-ab7a-1b94ca6754e5","Type":"ContainerDied","Data":"f51657860a93464c474c6250eb0e7edd01c80756a4dd39fe9f29602c9058027d"} Mar 16 16:12:07 crc kubenswrapper[5120]: I0316 16:12:07.248043 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"10ec5605-2810-4b8c-9a6a-e5cfc3b33706","Type":"ContainerStarted","Data":"30cb524b702792b5b0d1c7e920fa43fe3cffd8cfa340a919cb3c394fe3d72112"} Mar 16 16:12:07 crc kubenswrapper[5120]: I0316 16:12:07.253532 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"17b2138c-b3ca-4538-a7d7-0dc6756650bf","Type":"ContainerStarted","Data":"ea430835f1beb9f77ac042d234c65b501734c5b7323a6b25a1db8b17b727e6b5"} Mar 16 16:12:07 crc kubenswrapper[5120]: I0316 16:12:07.259099 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-7cbc6f47fd-sq9tz"] Mar 16 16:12:07 crc kubenswrapper[5120]: I0316 16:12:07.259328 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-7cbc6f47fd-sq9tz" podUID="78af3e38-08bb-4b78-89aa-8d76d361e2bc" containerName="barbican-keystone-listener-log" containerID="cri-o://2b1607efd8a45ba58c6a4a77229af5d4110ccc7491735de70a5f1fd0ddcd119e" gracePeriod=30 Mar 16 16:12:07 crc kubenswrapper[5120]: I0316 16:12:07.259740 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-7cbc6f47fd-sq9tz" podUID="78af3e38-08bb-4b78-89aa-8d76d361e2bc" containerName="barbican-keystone-listener" containerID="cri-o://b5ece7bb7787fcdd951d74e24ecfeafefae53d0cfce909f6180df1607ff10785" gracePeriod=30 Mar 16 16:12:07 crc kubenswrapper[5120]: I0316 16:12:07.282930 5120 generic.go:358] "Generic (PLEG): container finished" podID="ad803ce8-2d88-44d8-a717-aaec85ce871c" containerID="e09ca476407ec729cd1111e5cc4d786a923c7f7a46f6062fd777ae7956a01722" exitCode=0 Mar 16 16:12:07 crc kubenswrapper[5120]: I0316 16:12:07.283354 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561292-z2wqq" event={"ID":"ad803ce8-2d88-44d8-a717-aaec85ce871c","Type":"ContainerDied","Data":"e09ca476407ec729cd1111e5cc4d786a923c7f7a46f6062fd777ae7956a01722"} Mar 16 16:12:07 crc kubenswrapper[5120]: I0316 16:12:07.297364 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-5c69df9cf-mtvpx" event={"ID":"4b1fbfd4-c276-42c0-8419-fbe793f89ad7","Type":"ContainerStarted","Data":"6f4be8a5ecf88b8d0d422e8fabb7af3e217f95c44c7d86badc71a556e77761be"} Mar 16 16:12:07 crc kubenswrapper[5120]: I0316 16:12:07.329955 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-worker-5c69df9cf-mtvpx" podStartSLOduration=6.329939794 podStartE2EDuration="6.329939794s" podCreationTimestamp="2026-03-16 16:12:01 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:12:07.327404065 +0000 UTC m=+2429.481335722" watchObservedRunningTime="2026-03-16 16:12:07.329939794 +0000 UTC m=+2429.483871451" Mar 16 16:12:07 crc kubenswrapper[5120]: I0316 16:12:07.352022 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-6fccf8d5b-2gznd" Mar 16 16:12:07 crc kubenswrapper[5120]: I0316 16:12:07.379387 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:12:07 crc kubenswrapper[5120]: I0316 16:12:07.385841 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-5566b7bdc5-j8gmc"] Mar 16 16:12:07 crc kubenswrapper[5120]: I0316 16:12:07.386228 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-5566b7bdc5-j8gmc" podUID="663dca84-6d86-4d19-a614-6f4fb2f04e2e" containerName="barbican-worker-log" containerID="cri-o://817eba962a106429a987b1357e3063e8c28061cee33b51e65bc388fae18238dc" gracePeriod=30 Mar 16 16:12:07 crc kubenswrapper[5120]: I0316 16:12:07.386742 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-5566b7bdc5-j8gmc" podUID="663dca84-6d86-4d19-a614-6f4fb2f04e2e" containerName="barbican-worker" containerID="cri-o://0f7e4d3d356dabd8558578635e70db345e5e1f7a9e0eefd96da90458af3b664f" gracePeriod=30 Mar 16 16:12:07 crc kubenswrapper[5120]: I0316 16:12:07.444171 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e69accdc-df7e-43d7-a3f4-63e6157a9721-internal-tls-certs\") pod \"e69accdc-df7e-43d7-a3f4-63e6157a9721\" (UID: \"e69accdc-df7e-43d7-a3f4-63e6157a9721\") " Mar 16 16:12:07 crc kubenswrapper[5120]: I0316 16:12:07.444771 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e69accdc-df7e-43d7-a3f4-63e6157a9721-logs\") pod \"e69accdc-df7e-43d7-a3f4-63e6157a9721\" (UID: \"e69accdc-df7e-43d7-a3f4-63e6157a9721\") " Mar 16 16:12:07 crc kubenswrapper[5120]: I0316 16:12:07.446041 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/e69accdc-df7e-43d7-a3f4-63e6157a9721-config-data-custom\") pod \"e69accdc-df7e-43d7-a3f4-63e6157a9721\" (UID: \"e69accdc-df7e-43d7-a3f4-63e6157a9721\") " Mar 16 16:12:07 crc kubenswrapper[5120]: I0316 16:12:07.446191 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e69accdc-df7e-43d7-a3f4-63e6157a9721-combined-ca-bundle\") pod \"e69accdc-df7e-43d7-a3f4-63e6157a9721\" (UID: \"e69accdc-df7e-43d7-a3f4-63e6157a9721\") " Mar 16 16:12:07 crc kubenswrapper[5120]: I0316 16:12:07.446230 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e69accdc-df7e-43d7-a3f4-63e6157a9721-config-data\") pod \"e69accdc-df7e-43d7-a3f4-63e6157a9721\" (UID: \"e69accdc-df7e-43d7-a3f4-63e6157a9721\") " Mar 16 16:12:07 crc kubenswrapper[5120]: I0316 16:12:07.446508 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nsdzc\" (UniqueName: \"kubernetes.io/projected/e69accdc-df7e-43d7-a3f4-63e6157a9721-kube-api-access-nsdzc\") pod \"e69accdc-df7e-43d7-a3f4-63e6157a9721\" (UID: \"e69accdc-df7e-43d7-a3f4-63e6157a9721\") " Mar 16 16:12:07 crc kubenswrapper[5120]: I0316 16:12:07.446602 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e69accdc-df7e-43d7-a3f4-63e6157a9721-public-tls-certs\") pod \"e69accdc-df7e-43d7-a3f4-63e6157a9721\" (UID: \"e69accdc-df7e-43d7-a3f4-63e6157a9721\") " Mar 16 16:12:07 crc kubenswrapper[5120]: I0316 16:12:07.460044 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e69accdc-df7e-43d7-a3f4-63e6157a9721-logs" (OuterVolumeSpecName: "logs") pod "e69accdc-df7e-43d7-a3f4-63e6157a9721" (UID: "e69accdc-df7e-43d7-a3f4-63e6157a9721"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:12:07 crc kubenswrapper[5120]: I0316 16:12:07.462359 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e69accdc-df7e-43d7-a3f4-63e6157a9721-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:07 crc kubenswrapper[5120]: I0316 16:12:07.468388 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e69accdc-df7e-43d7-a3f4-63e6157a9721-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "e69accdc-df7e-43d7-a3f4-63e6157a9721" (UID: "e69accdc-df7e-43d7-a3f4-63e6157a9721"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:07 crc kubenswrapper[5120]: I0316 16:12:07.482598 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e69accdc-df7e-43d7-a3f4-63e6157a9721-kube-api-access-nsdzc" (OuterVolumeSpecName: "kube-api-access-nsdzc") pod "e69accdc-df7e-43d7-a3f4-63e6157a9721" (UID: "e69accdc-df7e-43d7-a3f4-63e6157a9721"). InnerVolumeSpecName "kube-api-access-nsdzc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:12:07 crc kubenswrapper[5120]: I0316 16:12:07.542406 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e69accdc-df7e-43d7-a3f4-63e6157a9721-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e69accdc-df7e-43d7-a3f4-63e6157a9721" (UID: "e69accdc-df7e-43d7-a3f4-63e6157a9721"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:07 crc kubenswrapper[5120]: I0316 16:12:07.601858 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e69accdc-df7e-43d7-a3f4-63e6157a9721-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "e69accdc-df7e-43d7-a3f4-63e6157a9721" (UID: "e69accdc-df7e-43d7-a3f4-63e6157a9721"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:07 crc kubenswrapper[5120]: I0316 16:12:07.603573 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e69accdc-df7e-43d7-a3f4-63e6157a9721-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:07 crc kubenswrapper[5120]: I0316 16:12:07.603606 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nsdzc\" (UniqueName: \"kubernetes.io/projected/e69accdc-df7e-43d7-a3f4-63e6157a9721-kube-api-access-nsdzc\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:07 crc kubenswrapper[5120]: I0316 16:12:07.603622 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/e69accdc-df7e-43d7-a3f4-63e6157a9721-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:07 crc kubenswrapper[5120]: I0316 16:12:07.604923 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e69accdc-df7e-43d7-a3f4-63e6157a9721-config-data" (OuterVolumeSpecName: "config-data") pod "e69accdc-df7e-43d7-a3f4-63e6157a9721" (UID: "e69accdc-df7e-43d7-a3f4-63e6157a9721"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:07 crc kubenswrapper[5120]: I0316 16:12:07.609743 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 16:12:07 crc kubenswrapper[5120]: I0316 16:12:07.655087 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:12:07 crc kubenswrapper[5120]: I0316 16:12:07.662907 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e69accdc-df7e-43d7-a3f4-63e6157a9721-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "e69accdc-df7e-43d7-a3f4-63e6157a9721" (UID: "e69accdc-df7e-43d7-a3f4-63e6157a9721"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:07 crc kubenswrapper[5120]: I0316 16:12:07.711239 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e69accdc-df7e-43d7-a3f4-63e6157a9721-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:07 crc kubenswrapper[5120]: I0316 16:12:07.711474 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e69accdc-df7e-43d7-a3f4-63e6157a9721-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:07 crc kubenswrapper[5120]: I0316 16:12:07.711566 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e69accdc-df7e-43d7-a3f4-63e6157a9721-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:07 crc kubenswrapper[5120]: I0316 16:12:07.876732 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:12:07 crc kubenswrapper[5120]: W0316 16:12:07.908428 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf42fe4a8_5b71_4d39_964b_a3e2aab4b8e5.slice/crio-4c48e48c864bb8847a7e5e63fa7db9ad40281d4084e0d178e15d88639def9e3d WatchSource:0}: Error finding container 4c48e48c864bb8847a7e5e63fa7db9ad40281d4084e0d178e15d88639def9e3d: Status 404 returned error can't find the container with id 4c48e48c864bb8847a7e5e63fa7db9ad40281d4084e0d178e15d88639def9e3d Mar 16 16:12:07 crc kubenswrapper[5120]: I0316 16:12:07.927022 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561292-z2wqq" Mar 16 16:12:08 crc kubenswrapper[5120]: I0316 16:12:08.047582 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fns9v\" (UniqueName: \"kubernetes.io/projected/ad803ce8-2d88-44d8-a717-aaec85ce871c-kube-api-access-fns9v\") pod \"ad803ce8-2d88-44d8-a717-aaec85ce871c\" (UID: \"ad803ce8-2d88-44d8-a717-aaec85ce871c\") " Mar 16 16:12:08 crc kubenswrapper[5120]: I0316 16:12:08.054965 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad803ce8-2d88-44d8-a717-aaec85ce871c-kube-api-access-fns9v" (OuterVolumeSpecName: "kube-api-access-fns9v") pod "ad803ce8-2d88-44d8-a717-aaec85ce871c" (UID: "ad803ce8-2d88-44d8-a717-aaec85ce871c"). InnerVolumeSpecName "kube-api-access-fns9v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:12:08 crc kubenswrapper[5120]: I0316 16:12:08.096276 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:12:08 crc kubenswrapper[5120]: I0316 16:12:08.137017 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:12:08 crc kubenswrapper[5120]: I0316 16:12:08.150208 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fns9v\" (UniqueName: \"kubernetes.io/projected/ad803ce8-2d88-44d8-a717-aaec85ce871c-kube-api-access-fns9v\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:08 crc kubenswrapper[5120]: I0316 16:12:08.251571 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3e95e501-6a44-4736-aa20-72fe1a2bb1a8-combined-ca-bundle\") pod \"3e95e501-6a44-4736-aa20-72fe1a2bb1a8\" (UID: \"3e95e501-6a44-4736-aa20-72fe1a2bb1a8\") " Mar 16 16:12:08 crc kubenswrapper[5120]: I0316 16:12:08.251950 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3e95e501-6a44-4736-aa20-72fe1a2bb1a8-config-data\") pod \"3e95e501-6a44-4736-aa20-72fe1a2bb1a8\" (UID: \"3e95e501-6a44-4736-aa20-72fe1a2bb1a8\") " Mar 16 16:12:08 crc kubenswrapper[5120]: I0316 16:12:08.251973 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-llvdt\" (UniqueName: \"kubernetes.io/projected/3e95e501-6a44-4736-aa20-72fe1a2bb1a8-kube-api-access-llvdt\") pod \"3e95e501-6a44-4736-aa20-72fe1a2bb1a8\" (UID: \"3e95e501-6a44-4736-aa20-72fe1a2bb1a8\") " Mar 16 16:12:08 crc kubenswrapper[5120]: I0316 16:12:08.258724 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e95e501-6a44-4736-aa20-72fe1a2bb1a8-kube-api-access-llvdt" (OuterVolumeSpecName: "kube-api-access-llvdt") pod "3e95e501-6a44-4736-aa20-72fe1a2bb1a8" (UID: "3e95e501-6a44-4736-aa20-72fe1a2bb1a8"). InnerVolumeSpecName "kube-api-access-llvdt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:12:08 crc kubenswrapper[5120]: I0316 16:12:08.307279 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e95e501-6a44-4736-aa20-72fe1a2bb1a8-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "3e95e501-6a44-4736-aa20-72fe1a2bb1a8" (UID: "3e95e501-6a44-4736-aa20-72fe1a2bb1a8"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:08 crc kubenswrapper[5120]: I0316 16:12:08.310048 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e95e501-6a44-4736-aa20-72fe1a2bb1a8-config-data" (OuterVolumeSpecName: "config-data") pod "3e95e501-6a44-4736-aa20-72fe1a2bb1a8" (UID: "3e95e501-6a44-4736-aa20-72fe1a2bb1a8"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:08 crc kubenswrapper[5120]: I0316 16:12:08.326537 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"bba65a98-1383-4c8c-995a-b212b232d1f8","Type":"ContainerStarted","Data":"0694d284d33b8f4728b5b5db2443c16f6b7c4ab92062463e2013167e4b4a7dc6"} Mar 16 16:12:08 crc kubenswrapper[5120]: I0316 16:12:08.326876 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"bba65a98-1383-4c8c-995a-b212b232d1f8","Type":"ContainerStarted","Data":"20d3428884c65ee0eee4c6ccc087ee84862e2cb78d70c3394dfd864f14bb0d36"} Mar 16 16:12:08 crc kubenswrapper[5120]: I0316 16:12:08.337510 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5","Type":"ContainerStarted","Data":"4c48e48c864bb8847a7e5e63fa7db9ad40281d4084e0d178e15d88639def9e3d"} Mar 16 16:12:08 crc kubenswrapper[5120]: I0316 16:12:08.349649 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-scheduler-0" podStartSLOduration=3.349624462 podStartE2EDuration="3.349624462s" podCreationTimestamp="2026-03-16 16:12:05 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:12:08.342671833 +0000 UTC m=+2430.496603490" watchObservedRunningTime="2026-03-16 16:12:08.349624462 +0000 UTC m=+2430.503556119" Mar 16 16:12:08 crc kubenswrapper[5120]: I0316 16:12:08.353896 5120 generic.go:358] "Generic (PLEG): container finished" podID="78af3e38-08bb-4b78-89aa-8d76d361e2bc" containerID="2b1607efd8a45ba58c6a4a77229af5d4110ccc7491735de70a5f1fd0ddcd119e" exitCode=143 Mar 16 16:12:08 crc kubenswrapper[5120]: I0316 16:12:08.353984 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-7cbc6f47fd-sq9tz" event={"ID":"78af3e38-08bb-4b78-89aa-8d76d361e2bc","Type":"ContainerDied","Data":"2b1607efd8a45ba58c6a4a77229af5d4110ccc7491735de70a5f1fd0ddcd119e"} Mar 16 16:12:08 crc kubenswrapper[5120]: I0316 16:12:08.354298 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3e95e501-6a44-4736-aa20-72fe1a2bb1a8-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:08 crc kubenswrapper[5120]: I0316 16:12:08.354327 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3e95e501-6a44-4736-aa20-72fe1a2bb1a8-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:08 crc kubenswrapper[5120]: I0316 16:12:08.354337 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-llvdt\" (UniqueName: \"kubernetes.io/projected/3e95e501-6a44-4736-aa20-72fe1a2bb1a8-kube-api-access-llvdt\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:08 crc kubenswrapper[5120]: I0316 16:12:08.360034 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"10ec5605-2810-4b8c-9a6a-e5cfc3b33706","Type":"ContainerStarted","Data":"8c7afa10201bb4e86903115fd27c78f30865b73d10743ea051ae56c76c2ea814"} Mar 16 16:12:08 crc kubenswrapper[5120]: I0316 16:12:08.368902 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"17b2138c-b3ca-4538-a7d7-0dc6756650bf","Type":"ContainerStarted","Data":"46862529c1989fabbd8a3c6c982324fb04976c3d04492a4676f4f8667ef55b0b"} Mar 16 16:12:08 crc kubenswrapper[5120]: I0316 16:12:08.379935 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=4.379918044 podStartE2EDuration="4.379918044s" podCreationTimestamp="2026-03-16 16:12:04 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:12:08.375435881 +0000 UTC m=+2430.529367548" watchObservedRunningTime="2026-03-16 16:12:08.379918044 +0000 UTC m=+2430.533849701" Mar 16 16:12:08 crc kubenswrapper[5120]: I0316 16:12:08.380542 5120 generic.go:358] "Generic (PLEG): container finished" podID="3e95e501-6a44-4736-aa20-72fe1a2bb1a8" containerID="31a2fce1e20c5b62f2a74ffb53802354c75a971f977ab88fe1d0d2ac24820f8d" exitCode=0 Mar 16 16:12:08 crc kubenswrapper[5120]: I0316 16:12:08.380627 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"3e95e501-6a44-4736-aa20-72fe1a2bb1a8","Type":"ContainerDied","Data":"31a2fce1e20c5b62f2a74ffb53802354c75a971f977ab88fe1d0d2ac24820f8d"} Mar 16 16:12:08 crc kubenswrapper[5120]: I0316 16:12:08.380655 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"3e95e501-6a44-4736-aa20-72fe1a2bb1a8","Type":"ContainerDied","Data":"2c66c59c6322d20003b51f1ccb91a8a721d0aa5c8c240427bfb5cf5d6c70698c"} Mar 16 16:12:08 crc kubenswrapper[5120]: I0316 16:12:08.380672 5120 scope.go:117] "RemoveContainer" containerID="31a2fce1e20c5b62f2a74ffb53802354c75a971f977ab88fe1d0d2ac24820f8d" Mar 16 16:12:08 crc kubenswrapper[5120]: I0316 16:12:08.380834 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:12:08 crc kubenswrapper[5120]: I0316 16:12:08.395152 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561292-z2wqq" event={"ID":"ad803ce8-2d88-44d8-a717-aaec85ce871c","Type":"ContainerDied","Data":"8b20ec1344ef2ab8c6a8c4b8ba728cb1c0dbb8b5c7fb23f790058ec1204660b2"} Mar 16 16:12:08 crc kubenswrapper[5120]: I0316 16:12:08.395191 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8b20ec1344ef2ab8c6a8c4b8ba728cb1c0dbb8b5c7fb23f790058ec1204660b2" Mar 16 16:12:08 crc kubenswrapper[5120]: I0316 16:12:08.395251 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561292-z2wqq" Mar 16 16:12:08 crc kubenswrapper[5120]: I0316 16:12:08.402709 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=4.402694192 podStartE2EDuration="4.402694192s" podCreationTimestamp="2026-03-16 16:12:04 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:12:08.401116699 +0000 UTC m=+2430.555048356" watchObservedRunningTime="2026-03-16 16:12:08.402694192 +0000 UTC m=+2430.556625849" Mar 16 16:12:08 crc kubenswrapper[5120]: I0316 16:12:08.413254 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"bce71378-f7b0-4b73-8b4a-711353734319","Type":"ContainerStarted","Data":"db11af3fe6b07413600ae44f79a3df378f43385bd524e92444794183d150e508"} Mar 16 16:12:08 crc kubenswrapper[5120]: I0316 16:12:08.413302 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"bce71378-f7b0-4b73-8b4a-711353734319","Type":"ContainerStarted","Data":"4f46a3ba665637a0e692425604d96b6d751f78b3507578f417d25d74726103eb"} Mar 16 16:12:08 crc kubenswrapper[5120]: I0316 16:12:08.413343 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:12:08 crc kubenswrapper[5120]: I0316 16:12:08.466331 5120 generic.go:358] "Generic (PLEG): container finished" podID="663dca84-6d86-4d19-a614-6f4fb2f04e2e" containerID="817eba962a106429a987b1357e3063e8c28061cee33b51e65bc388fae18238dc" exitCode=143 Mar 16 16:12:08 crc kubenswrapper[5120]: I0316 16:12:08.467321 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-5566b7bdc5-j8gmc" event={"ID":"663dca84-6d86-4d19-a614-6f4fb2f04e2e","Type":"ContainerDied","Data":"817eba962a106429a987b1357e3063e8c28061cee33b51e65bc388fae18238dc"} Mar 16 16:12:08 crc kubenswrapper[5120]: I0316 16:12:08.477042 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podStartSLOduration=3.477017268 podStartE2EDuration="3.477017268s" podCreationTimestamp="2026-03-16 16:12:05 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:12:08.428412609 +0000 UTC m=+2430.582344266" watchObservedRunningTime="2026-03-16 16:12:08.477017268 +0000 UTC m=+2430.630948945" Mar 16 16:12:08 crc kubenswrapper[5120]: I0316 16:12:08.482261 5120 scope.go:117] "RemoveContainer" containerID="31a2fce1e20c5b62f2a74ffb53802354c75a971f977ab88fe1d0d2ac24820f8d" Mar 16 16:12:08 crc kubenswrapper[5120]: E0316 16:12:08.489513 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"31a2fce1e20c5b62f2a74ffb53802354c75a971f977ab88fe1d0d2ac24820f8d\": container with ID starting with 31a2fce1e20c5b62f2a74ffb53802354c75a971f977ab88fe1d0d2ac24820f8d not found: ID does not exist" containerID="31a2fce1e20c5b62f2a74ffb53802354c75a971f977ab88fe1d0d2ac24820f8d" Mar 16 16:12:08 crc kubenswrapper[5120]: I0316 16:12:08.489724 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31a2fce1e20c5b62f2a74ffb53802354c75a971f977ab88fe1d0d2ac24820f8d"} err="failed to get container status \"31a2fce1e20c5b62f2a74ffb53802354c75a971f977ab88fe1d0d2ac24820f8d\": rpc error: code = NotFound desc = could not find container \"31a2fce1e20c5b62f2a74ffb53802354c75a971f977ab88fe1d0d2ac24820f8d\": container with ID starting with 31a2fce1e20c5b62f2a74ffb53802354c75a971f977ab88fe1d0d2ac24820f8d not found: ID does not exist" Mar 16 16:12:08 crc kubenswrapper[5120]: I0316 16:12:08.491651 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-6fccf8d5b-2gznd" event={"ID":"e69accdc-df7e-43d7-a3f4-63e6157a9721","Type":"ContainerDied","Data":"357475a776832562772cc06ac6fd0297643bf5d6d54fd032e824a0cc200a2bab"} Mar 16 16:12:08 crc kubenswrapper[5120]: I0316 16:12:08.491703 5120 scope.go:117] "RemoveContainer" containerID="58d9e300c31d95e5a4064dea51869cfe2c0f3d0081ea9a8e24c55faae1c4334a" Mar 16 16:12:08 crc kubenswrapper[5120]: I0316 16:12:08.491872 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-6fccf8d5b-2gznd" Mar 16 16:12:08 crc kubenswrapper[5120]: I0316 16:12:08.509459 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:12:08 crc kubenswrapper[5120]: I0316 16:12:08.523526 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"96d66c8e-8cdb-462c-a302-c85e581db5ad","Type":"ContainerStarted","Data":"9c01f931eb233ff798516b1c8be37bfb13b5260be3ab6f8082e0e9f8bf91acc0"} Mar 16 16:12:08 crc kubenswrapper[5120]: I0316 16:12:08.524541 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:12:08 crc kubenswrapper[5120]: I0316 16:12:08.524567 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:12:08 crc kubenswrapper[5120]: I0316 16:12:08.535819 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:12:08 crc kubenswrapper[5120]: I0316 16:12:08.560826 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:12:08 crc kubenswrapper[5120]: I0316 16:12:08.570497 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:12:08 crc kubenswrapper[5120]: I0316 16:12:08.570942 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:12:08 crc kubenswrapper[5120]: I0316 16:12:08.572044 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad803ce8-2d88-44d8-a717-aaec85ce871c" containerName="oc" Mar 16 16:12:08 crc kubenswrapper[5120]: I0316 16:12:08.572775 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad803ce8-2d88-44d8-a717-aaec85ce871c" containerName="oc" Mar 16 16:12:08 crc kubenswrapper[5120]: I0316 16:12:08.572797 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e69accdc-df7e-43d7-a3f4-63e6157a9721" containerName="barbican-api" Mar 16 16:12:08 crc kubenswrapper[5120]: I0316 16:12:08.572804 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e69accdc-df7e-43d7-a3f4-63e6157a9721" containerName="barbican-api" Mar 16 16:12:08 crc kubenswrapper[5120]: I0316 16:12:08.572840 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e95e501-6a44-4736-aa20-72fe1a2bb1a8" containerName="nova-cell0-conductor-conductor" Mar 16 16:12:08 crc kubenswrapper[5120]: I0316 16:12:08.572847 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e95e501-6a44-4736-aa20-72fe1a2bb1a8" containerName="nova-cell0-conductor-conductor" Mar 16 16:12:08 crc kubenswrapper[5120]: I0316 16:12:08.572859 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e69accdc-df7e-43d7-a3f4-63e6157a9721" containerName="barbican-api-log" Mar 16 16:12:08 crc kubenswrapper[5120]: I0316 16:12:08.572865 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e69accdc-df7e-43d7-a3f4-63e6157a9721" containerName="barbican-api-log" Mar 16 16:12:08 crc kubenswrapper[5120]: I0316 16:12:08.573065 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="3e95e501-6a44-4736-aa20-72fe1a2bb1a8" containerName="nova-cell0-conductor-conductor" Mar 16 16:12:08 crc kubenswrapper[5120]: I0316 16:12:08.573074 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e69accdc-df7e-43d7-a3f4-63e6157a9721" containerName="barbican-api-log" Mar 16 16:12:08 crc kubenswrapper[5120]: I0316 16:12:08.573087 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ad803ce8-2d88-44d8-a717-aaec85ce871c" containerName="oc" Mar 16 16:12:08 crc kubenswrapper[5120]: I0316 16:12:08.573102 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e69accdc-df7e-43d7-a3f4-63e6157a9721" containerName="barbican-api" Mar 16 16:12:08 crc kubenswrapper[5120]: I0316 16:12:08.600041 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:12:08 crc kubenswrapper[5120]: I0316 16:12:08.600363 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:12:08 crc kubenswrapper[5120]: I0316 16:12:08.608095 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-conductor-config-data\"" Mar 16 16:12:08 crc kubenswrapper[5120]: I0316 16:12:08.638707 5120 scope.go:117] "RemoveContainer" containerID="8aee7ea8283e1286cdf8fb09bccdae16f26180b65dcd64d36c57b0a97ca7b47c" Mar 16 16:12:08 crc kubenswrapper[5120]: I0316 16:12:08.680412 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3e95e501-6a44-4736-aa20-72fe1a2bb1a8" path="/var/lib/kubelet/pods/3e95e501-6a44-4736-aa20-72fe1a2bb1a8/volumes" Mar 16 16:12:08 crc kubenswrapper[5120]: I0316 16:12:08.680929 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="96650b1e-b94e-4f53-9fe6-7b45f224d366" path="/var/lib/kubelet/pods/96650b1e-b94e-4f53-9fe6-7b45f224d366/volumes" Mar 16 16:12:08 crc kubenswrapper[5120]: I0316 16:12:08.745374 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-6fccf8d5b-2gznd"] Mar 16 16:12:08 crc kubenswrapper[5120]: I0316 16:12:08.764835 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-api-6fccf8d5b-2gznd"] Mar 16 16:12:08 crc kubenswrapper[5120]: I0316 16:12:08.776213 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6a869ae4-5dd4-47d8-aa7e-e519981ee01f-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"6a869ae4-5dd4-47d8-aa7e-e519981ee01f\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:12:08 crc kubenswrapper[5120]: I0316 16:12:08.776623 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6a869ae4-5dd4-47d8-aa7e-e519981ee01f-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"6a869ae4-5dd4-47d8-aa7e-e519981ee01f\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:12:08 crc kubenswrapper[5120]: I0316 16:12:08.776656 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjmfw\" (UniqueName: \"kubernetes.io/projected/6a869ae4-5dd4-47d8-aa7e-e519981ee01f-kube-api-access-kjmfw\") pod \"nova-cell0-conductor-0\" (UID: \"6a869ae4-5dd4-47d8-aa7e-e519981ee01f\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:12:08 crc kubenswrapper[5120]: I0316 16:12:08.824063 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/swift-proxy-6d59599fcd-hn254"] Mar 16 16:12:08 crc kubenswrapper[5120]: I0316 16:12:08.841378 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-proxy-6d59599fcd-hn254"] Mar 16 16:12:08 crc kubenswrapper[5120]: I0316 16:12:08.841519 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-6d59599fcd-hn254" Mar 16 16:12:08 crc kubenswrapper[5120]: I0316 16:12:08.887579 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6a869ae4-5dd4-47d8-aa7e-e519981ee01f-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"6a869ae4-5dd4-47d8-aa7e-e519981ee01f\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:12:08 crc kubenswrapper[5120]: I0316 16:12:08.887623 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kjmfw\" (UniqueName: \"kubernetes.io/projected/6a869ae4-5dd4-47d8-aa7e-e519981ee01f-kube-api-access-kjmfw\") pod \"nova-cell0-conductor-0\" (UID: \"6a869ae4-5dd4-47d8-aa7e-e519981ee01f\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:12:08 crc kubenswrapper[5120]: I0316 16:12:08.887696 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6a869ae4-5dd4-47d8-aa7e-e519981ee01f-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"6a869ae4-5dd4-47d8-aa7e-e519981ee01f\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:12:08 crc kubenswrapper[5120]: I0316 16:12:08.892658 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6a869ae4-5dd4-47d8-aa7e-e519981ee01f-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"6a869ae4-5dd4-47d8-aa7e-e519981ee01f\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:12:08 crc kubenswrapper[5120]: I0316 16:12:08.895445 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6a869ae4-5dd4-47d8-aa7e-e519981ee01f-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"6a869ae4-5dd4-47d8-aa7e-e519981ee01f\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:12:08 crc kubenswrapper[5120]: I0316 16:12:08.929230 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjmfw\" (UniqueName: \"kubernetes.io/projected/6a869ae4-5dd4-47d8-aa7e-e519981ee01f-kube-api-access-kjmfw\") pod \"nova-cell0-conductor-0\" (UID: \"6a869ae4-5dd4-47d8-aa7e-e519981ee01f\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:12:08 crc kubenswrapper[5120]: I0316 16:12:08.942887 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:12:08 crc kubenswrapper[5120]: I0316 16:12:08.942939 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:12:08 crc kubenswrapper[5120]: I0316 16:12:08.979655 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:12:08 crc kubenswrapper[5120]: I0316 16:12:08.990168 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/fe2105ae-76c1-452b-bee1-074d323c076f-etc-swift\") pod \"swift-proxy-6d59599fcd-hn254\" (UID: \"fe2105ae-76c1-452b-bee1-074d323c076f\") " pod="openstack-kuttl-tests/swift-proxy-6d59599fcd-hn254" Mar 16 16:12:08 crc kubenswrapper[5120]: I0316 16:12:08.990249 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/fe2105ae-76c1-452b-bee1-074d323c076f-internal-tls-certs\") pod \"swift-proxy-6d59599fcd-hn254\" (UID: \"fe2105ae-76c1-452b-bee1-074d323c076f\") " pod="openstack-kuttl-tests/swift-proxy-6d59599fcd-hn254" Mar 16 16:12:08 crc kubenswrapper[5120]: I0316 16:12:08.990287 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/fe2105ae-76c1-452b-bee1-074d323c076f-public-tls-certs\") pod \"swift-proxy-6d59599fcd-hn254\" (UID: \"fe2105ae-76c1-452b-bee1-074d323c076f\") " pod="openstack-kuttl-tests/swift-proxy-6d59599fcd-hn254" Mar 16 16:12:08 crc kubenswrapper[5120]: I0316 16:12:08.990304 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fe2105ae-76c1-452b-bee1-074d323c076f-combined-ca-bundle\") pod \"swift-proxy-6d59599fcd-hn254\" (UID: \"fe2105ae-76c1-452b-bee1-074d323c076f\") " pod="openstack-kuttl-tests/swift-proxy-6d59599fcd-hn254" Mar 16 16:12:08 crc kubenswrapper[5120]: I0316 16:12:08.990356 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fe2105ae-76c1-452b-bee1-074d323c076f-config-data\") pod \"swift-proxy-6d59599fcd-hn254\" (UID: \"fe2105ae-76c1-452b-bee1-074d323c076f\") " pod="openstack-kuttl-tests/swift-proxy-6d59599fcd-hn254" Mar 16 16:12:08 crc kubenswrapper[5120]: I0316 16:12:08.990376 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/fe2105ae-76c1-452b-bee1-074d323c076f-log-httpd\") pod \"swift-proxy-6d59599fcd-hn254\" (UID: \"fe2105ae-76c1-452b-bee1-074d323c076f\") " pod="openstack-kuttl-tests/swift-proxy-6d59599fcd-hn254" Mar 16 16:12:08 crc kubenswrapper[5120]: I0316 16:12:08.990403 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/fe2105ae-76c1-452b-bee1-074d323c076f-run-httpd\") pod \"swift-proxy-6d59599fcd-hn254\" (UID: \"fe2105ae-76c1-452b-bee1-074d323c076f\") " pod="openstack-kuttl-tests/swift-proxy-6d59599fcd-hn254" Mar 16 16:12:08 crc kubenswrapper[5120]: I0316 16:12:08.990507 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8b6z\" (UniqueName: \"kubernetes.io/projected/fe2105ae-76c1-452b-bee1-074d323c076f-kube-api-access-n8b6z\") pod \"swift-proxy-6d59599fcd-hn254\" (UID: \"fe2105ae-76c1-452b-bee1-074d323c076f\") " pod="openstack-kuttl-tests/swift-proxy-6d59599fcd-hn254" Mar 16 16:12:09 crc kubenswrapper[5120]: I0316 16:12:09.005065 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:12:09 crc kubenswrapper[5120]: I0316 16:12:09.014392 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-infra/auto-csr-approver-29561286-2qjw6"] Mar 16 16:12:09 crc kubenswrapper[5120]: I0316 16:12:09.023195 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-infra/auto-csr-approver-29561286-2qjw6"] Mar 16 16:12:09 crc kubenswrapper[5120]: I0316 16:12:09.049577 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:12:09 crc kubenswrapper[5120]: I0316 16:12:09.100469 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n8b6z\" (UniqueName: \"kubernetes.io/projected/fe2105ae-76c1-452b-bee1-074d323c076f-kube-api-access-n8b6z\") pod \"swift-proxy-6d59599fcd-hn254\" (UID: \"fe2105ae-76c1-452b-bee1-074d323c076f\") " pod="openstack-kuttl-tests/swift-proxy-6d59599fcd-hn254" Mar 16 16:12:09 crc kubenswrapper[5120]: I0316 16:12:09.100895 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/fe2105ae-76c1-452b-bee1-074d323c076f-etc-swift\") pod \"swift-proxy-6d59599fcd-hn254\" (UID: \"fe2105ae-76c1-452b-bee1-074d323c076f\") " pod="openstack-kuttl-tests/swift-proxy-6d59599fcd-hn254" Mar 16 16:12:09 crc kubenswrapper[5120]: I0316 16:12:09.100983 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/fe2105ae-76c1-452b-bee1-074d323c076f-internal-tls-certs\") pod \"swift-proxy-6d59599fcd-hn254\" (UID: \"fe2105ae-76c1-452b-bee1-074d323c076f\") " pod="openstack-kuttl-tests/swift-proxy-6d59599fcd-hn254" Mar 16 16:12:09 crc kubenswrapper[5120]: I0316 16:12:09.101020 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/fe2105ae-76c1-452b-bee1-074d323c076f-public-tls-certs\") pod \"swift-proxy-6d59599fcd-hn254\" (UID: \"fe2105ae-76c1-452b-bee1-074d323c076f\") " pod="openstack-kuttl-tests/swift-proxy-6d59599fcd-hn254" Mar 16 16:12:09 crc kubenswrapper[5120]: I0316 16:12:09.101280 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fe2105ae-76c1-452b-bee1-074d323c076f-combined-ca-bundle\") pod \"swift-proxy-6d59599fcd-hn254\" (UID: \"fe2105ae-76c1-452b-bee1-074d323c076f\") " pod="openstack-kuttl-tests/swift-proxy-6d59599fcd-hn254" Mar 16 16:12:09 crc kubenswrapper[5120]: I0316 16:12:09.101343 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fe2105ae-76c1-452b-bee1-074d323c076f-config-data\") pod \"swift-proxy-6d59599fcd-hn254\" (UID: \"fe2105ae-76c1-452b-bee1-074d323c076f\") " pod="openstack-kuttl-tests/swift-proxy-6d59599fcd-hn254" Mar 16 16:12:09 crc kubenswrapper[5120]: I0316 16:12:09.101362 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/fe2105ae-76c1-452b-bee1-074d323c076f-log-httpd\") pod \"swift-proxy-6d59599fcd-hn254\" (UID: \"fe2105ae-76c1-452b-bee1-074d323c076f\") " pod="openstack-kuttl-tests/swift-proxy-6d59599fcd-hn254" Mar 16 16:12:09 crc kubenswrapper[5120]: I0316 16:12:09.101390 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/fe2105ae-76c1-452b-bee1-074d323c076f-run-httpd\") pod \"swift-proxy-6d59599fcd-hn254\" (UID: \"fe2105ae-76c1-452b-bee1-074d323c076f\") " pod="openstack-kuttl-tests/swift-proxy-6d59599fcd-hn254" Mar 16 16:12:09 crc kubenswrapper[5120]: I0316 16:12:09.103468 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/fe2105ae-76c1-452b-bee1-074d323c076f-log-httpd\") pod \"swift-proxy-6d59599fcd-hn254\" (UID: \"fe2105ae-76c1-452b-bee1-074d323c076f\") " pod="openstack-kuttl-tests/swift-proxy-6d59599fcd-hn254" Mar 16 16:12:09 crc kubenswrapper[5120]: I0316 16:12:09.104169 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/fe2105ae-76c1-452b-bee1-074d323c076f-run-httpd\") pod \"swift-proxy-6d59599fcd-hn254\" (UID: \"fe2105ae-76c1-452b-bee1-074d323c076f\") " pod="openstack-kuttl-tests/swift-proxy-6d59599fcd-hn254" Mar 16 16:12:09 crc kubenswrapper[5120]: I0316 16:12:09.110531 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/fe2105ae-76c1-452b-bee1-074d323c076f-internal-tls-certs\") pod \"swift-proxy-6d59599fcd-hn254\" (UID: \"fe2105ae-76c1-452b-bee1-074d323c076f\") " pod="openstack-kuttl-tests/swift-proxy-6d59599fcd-hn254" Mar 16 16:12:09 crc kubenswrapper[5120]: I0316 16:12:09.111332 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/fe2105ae-76c1-452b-bee1-074d323c076f-public-tls-certs\") pod \"swift-proxy-6d59599fcd-hn254\" (UID: \"fe2105ae-76c1-452b-bee1-074d323c076f\") " pod="openstack-kuttl-tests/swift-proxy-6d59599fcd-hn254" Mar 16 16:12:09 crc kubenswrapper[5120]: I0316 16:12:09.111394 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fe2105ae-76c1-452b-bee1-074d323c076f-config-data\") pod \"swift-proxy-6d59599fcd-hn254\" (UID: \"fe2105ae-76c1-452b-bee1-074d323c076f\") " pod="openstack-kuttl-tests/swift-proxy-6d59599fcd-hn254" Mar 16 16:12:09 crc kubenswrapper[5120]: I0316 16:12:09.111809 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/fe2105ae-76c1-452b-bee1-074d323c076f-etc-swift\") pod \"swift-proxy-6d59599fcd-hn254\" (UID: \"fe2105ae-76c1-452b-bee1-074d323c076f\") " pod="openstack-kuttl-tests/swift-proxy-6d59599fcd-hn254" Mar 16 16:12:09 crc kubenswrapper[5120]: I0316 16:12:09.115409 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fe2105ae-76c1-452b-bee1-074d323c076f-combined-ca-bundle\") pod \"swift-proxy-6d59599fcd-hn254\" (UID: \"fe2105ae-76c1-452b-bee1-074d323c076f\") " pod="openstack-kuttl-tests/swift-proxy-6d59599fcd-hn254" Mar 16 16:12:09 crc kubenswrapper[5120]: I0316 16:12:09.122526 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8b6z\" (UniqueName: \"kubernetes.io/projected/fe2105ae-76c1-452b-bee1-074d323c076f-kube-api-access-n8b6z\") pod \"swift-proxy-6d59599fcd-hn254\" (UID: \"fe2105ae-76c1-452b-bee1-074d323c076f\") " pod="openstack-kuttl-tests/swift-proxy-6d59599fcd-hn254" Mar 16 16:12:09 crc kubenswrapper[5120]: I0316 16:12:09.185301 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:12:09 crc kubenswrapper[5120]: I0316 16:12:09.248611 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:12:09 crc kubenswrapper[5120]: I0316 16:12:09.293229 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-6d59599fcd-hn254" Mar 16 16:12:09 crc kubenswrapper[5120]: I0316 16:12:09.298334 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:12:09 crc kubenswrapper[5120]: W0316 16:12:09.302072 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6a869ae4_5dd4_47d8_aa7e_e519981ee01f.slice/crio-77550a8e88cc4fdbfaadf6f569f054357afcf32a664420e7aa8c95084cd4c27d WatchSource:0}: Error finding container 77550a8e88cc4fdbfaadf6f569f054357afcf32a664420e7aa8c95084cd4c27d: Status 404 returned error can't find the container with id 77550a8e88cc4fdbfaadf6f569f054357afcf32a664420e7aa8c95084cd4c27d Mar 16 16:12:09 crc kubenswrapper[5120]: I0316 16:12:09.572933 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5","Type":"ContainerStarted","Data":"f23a5e504b736c5521e9e56ab980b7e85624440220852c3fe893ee02d1581dca"} Mar 16 16:12:09 crc kubenswrapper[5120]: I0316 16:12:09.574863 5120 generic.go:358] "Generic (PLEG): container finished" podID="78af3e38-08bb-4b78-89aa-8d76d361e2bc" containerID="b5ece7bb7787fcdd951d74e24ecfeafefae53d0cfce909f6180df1607ff10785" exitCode=0 Mar 16 16:12:09 crc kubenswrapper[5120]: I0316 16:12:09.574953 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-7cbc6f47fd-sq9tz" event={"ID":"78af3e38-08bb-4b78-89aa-8d76d361e2bc","Type":"ContainerDied","Data":"b5ece7bb7787fcdd951d74e24ecfeafefae53d0cfce909f6180df1607ff10785"} Mar 16 16:12:09 crc kubenswrapper[5120]: I0316 16:12:09.612785 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"96d66c8e-8cdb-462c-a302-c85e581db5ad","Type":"ContainerStarted","Data":"80448d2f177c589508fc45988bee032c0821389406369ddd7f6d2a419c63e5be"} Mar 16 16:12:09 crc kubenswrapper[5120]: I0316 16:12:09.628985 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"6a869ae4-5dd4-47d8-aa7e-e519981ee01f","Type":"ContainerStarted","Data":"77550a8e88cc4fdbfaadf6f569f054357afcf32a664420e7aa8c95084cd4c27d"} Mar 16 16:12:09 crc kubenswrapper[5120]: I0316 16:12:09.630116 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:12:09 crc kubenswrapper[5120]: I0316 16:12:09.630250 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:12:09 crc kubenswrapper[5120]: I0316 16:12:09.631663 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:12:09 crc kubenswrapper[5120]: I0316 16:12:09.631698 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:12:09 crc kubenswrapper[5120]: I0316 16:12:09.926358 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-proxy-6d59599fcd-hn254"] Mar 16 16:12:09 crc kubenswrapper[5120]: W0316 16:12:09.949653 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfe2105ae_76c1_452b_bee1_074d323c076f.slice/crio-f03edefa4ca37f1f83c6db88731bad032b653e8f80a658ea60d6aa1310e72a45 WatchSource:0}: Error finding container f03edefa4ca37f1f83c6db88731bad032b653e8f80a658ea60d6aa1310e72a45: Status 404 returned error can't find the container with id f03edefa4ca37f1f83c6db88731bad032b653e8f80a658ea60d6aa1310e72a45 Mar 16 16:12:10 crc kubenswrapper[5120]: I0316 16:12:10.112868 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-7cbc6f47fd-sq9tz" Mar 16 16:12:10 crc kubenswrapper[5120]: I0316 16:12:10.147347 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lws72\" (UniqueName: \"kubernetes.io/projected/78af3e38-08bb-4b78-89aa-8d76d361e2bc-kube-api-access-lws72\") pod \"78af3e38-08bb-4b78-89aa-8d76d361e2bc\" (UID: \"78af3e38-08bb-4b78-89aa-8d76d361e2bc\") " Mar 16 16:12:10 crc kubenswrapper[5120]: I0316 16:12:10.147576 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/78af3e38-08bb-4b78-89aa-8d76d361e2bc-logs\") pod \"78af3e38-08bb-4b78-89aa-8d76d361e2bc\" (UID: \"78af3e38-08bb-4b78-89aa-8d76d361e2bc\") " Mar 16 16:12:10 crc kubenswrapper[5120]: I0316 16:12:10.147630 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/78af3e38-08bb-4b78-89aa-8d76d361e2bc-combined-ca-bundle\") pod \"78af3e38-08bb-4b78-89aa-8d76d361e2bc\" (UID: \"78af3e38-08bb-4b78-89aa-8d76d361e2bc\") " Mar 16 16:12:10 crc kubenswrapper[5120]: I0316 16:12:10.147908 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/78af3e38-08bb-4b78-89aa-8d76d361e2bc-config-data\") pod \"78af3e38-08bb-4b78-89aa-8d76d361e2bc\" (UID: \"78af3e38-08bb-4b78-89aa-8d76d361e2bc\") " Mar 16 16:12:10 crc kubenswrapper[5120]: I0316 16:12:10.147926 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/78af3e38-08bb-4b78-89aa-8d76d361e2bc-config-data-custom\") pod \"78af3e38-08bb-4b78-89aa-8d76d361e2bc\" (UID: \"78af3e38-08bb-4b78-89aa-8d76d361e2bc\") " Mar 16 16:12:10 crc kubenswrapper[5120]: I0316 16:12:10.148439 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/78af3e38-08bb-4b78-89aa-8d76d361e2bc-logs" (OuterVolumeSpecName: "logs") pod "78af3e38-08bb-4b78-89aa-8d76d361e2bc" (UID: "78af3e38-08bb-4b78-89aa-8d76d361e2bc"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:12:10 crc kubenswrapper[5120]: I0316 16:12:10.159148 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/78af3e38-08bb-4b78-89aa-8d76d361e2bc-kube-api-access-lws72" (OuterVolumeSpecName: "kube-api-access-lws72") pod "78af3e38-08bb-4b78-89aa-8d76d361e2bc" (UID: "78af3e38-08bb-4b78-89aa-8d76d361e2bc"). InnerVolumeSpecName "kube-api-access-lws72". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:12:10 crc kubenswrapper[5120]: I0316 16:12:10.166937 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/78af3e38-08bb-4b78-89aa-8d76d361e2bc-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "78af3e38-08bb-4b78-89aa-8d76d361e2bc" (UID: "78af3e38-08bb-4b78-89aa-8d76d361e2bc"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:10 crc kubenswrapper[5120]: I0316 16:12:10.182927 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/78af3e38-08bb-4b78-89aa-8d76d361e2bc-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "78af3e38-08bb-4b78-89aa-8d76d361e2bc" (UID: "78af3e38-08bb-4b78-89aa-8d76d361e2bc"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:10 crc kubenswrapper[5120]: I0316 16:12:10.234950 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/78af3e38-08bb-4b78-89aa-8d76d361e2bc-config-data" (OuterVolumeSpecName: "config-data") pod "78af3e38-08bb-4b78-89aa-8d76d361e2bc" (UID: "78af3e38-08bb-4b78-89aa-8d76d361e2bc"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:10 crc kubenswrapper[5120]: I0316 16:12:10.252438 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/78af3e38-08bb-4b78-89aa-8d76d361e2bc-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:10 crc kubenswrapper[5120]: I0316 16:12:10.252466 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/78af3e38-08bb-4b78-89aa-8d76d361e2bc-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:10 crc kubenswrapper[5120]: I0316 16:12:10.252477 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lws72\" (UniqueName: \"kubernetes.io/projected/78af3e38-08bb-4b78-89aa-8d76d361e2bc-kube-api-access-lws72\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:10 crc kubenswrapper[5120]: I0316 16:12:10.252485 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/78af3e38-08bb-4b78-89aa-8d76d361e2bc-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:10 crc kubenswrapper[5120]: I0316 16:12:10.252494 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/78af3e38-08bb-4b78-89aa-8d76d361e2bc-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:10 crc kubenswrapper[5120]: I0316 16:12:10.696299 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d908918a-f75b-405a-8ba3-5faa341a849a" path="/var/lib/kubelet/pods/d908918a-f75b-405a-8ba3-5faa341a849a/volumes" Mar 16 16:12:10 crc kubenswrapper[5120]: I0316 16:12:10.697955 5120 generic.go:358] "Generic (PLEG): container finished" podID="663dca84-6d86-4d19-a614-6f4fb2f04e2e" containerID="0f7e4d3d356dabd8558578635e70db345e5e1f7a9e0eefd96da90458af3b664f" exitCode=0 Mar 16 16:12:10 crc kubenswrapper[5120]: I0316 16:12:10.700059 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e69accdc-df7e-43d7-a3f4-63e6157a9721" path="/var/lib/kubelet/pods/e69accdc-df7e-43d7-a3f4-63e6157a9721/volumes" Mar 16 16:12:10 crc kubenswrapper[5120]: I0316 16:12:10.701086 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-6d59599fcd-hn254" event={"ID":"fe2105ae-76c1-452b-bee1-074d323c076f","Type":"ContainerStarted","Data":"ad75fdb465731a2e6536f1029248278779f84cd84ec9a9c1660f3efb1189e033"} Mar 16 16:12:10 crc kubenswrapper[5120]: I0316 16:12:10.701111 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-6d59599fcd-hn254" event={"ID":"fe2105ae-76c1-452b-bee1-074d323c076f","Type":"ContainerStarted","Data":"f03edefa4ca37f1f83c6db88731bad032b653e8f80a658ea60d6aa1310e72a45"} Mar 16 16:12:10 crc kubenswrapper[5120]: I0316 16:12:10.704988 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-5566b7bdc5-j8gmc" event={"ID":"663dca84-6d86-4d19-a614-6f4fb2f04e2e","Type":"ContainerDied","Data":"0f7e4d3d356dabd8558578635e70db345e5e1f7a9e0eefd96da90458af3b664f"} Mar 16 16:12:10 crc kubenswrapper[5120]: I0316 16:12:10.726409 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"6a869ae4-5dd4-47d8-aa7e-e519981ee01f","Type":"ContainerStarted","Data":"37accdb48c73bda606e0755923e4c375ae91d06251e5bc9a66dc8f1c54f97f2e"} Mar 16 16:12:10 crc kubenswrapper[5120]: I0316 16:12:10.726610 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:12:10 crc kubenswrapper[5120]: I0316 16:12:10.731916 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5","Type":"ContainerStarted","Data":"5659e4bf80f0be1a407d06d3ba6dc5bc6f3128381585870fdde39acc6b1637fe"} Mar 16 16:12:10 crc kubenswrapper[5120]: I0316 16:12:10.738397 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="5aa11a39-e139-4791-92ce-2771b0277a8b" containerName="glance-log" containerID="cri-o://11f81caa83f0c9ef60769664b8c971b68ba4bc25cc7de3bb33d429ea3b426e32" gracePeriod=30 Mar 16 16:12:10 crc kubenswrapper[5120]: I0316 16:12:10.738453 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-7cbc6f47fd-sq9tz" Mar 16 16:12:10 crc kubenswrapper[5120]: I0316 16:12:10.738511 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-7cbc6f47fd-sq9tz" event={"ID":"78af3e38-08bb-4b78-89aa-8d76d361e2bc","Type":"ContainerDied","Data":"0dff2016eb71385defa1f3faf5f950ad4934ab38828e061517e96e62065f2f63"} Mar 16 16:12:10 crc kubenswrapper[5120]: I0316 16:12:10.738550 5120 scope.go:117] "RemoveContainer" containerID="b5ece7bb7787fcdd951d74e24ecfeafefae53d0cfce909f6180df1607ff10785" Mar 16 16:12:10 crc kubenswrapper[5120]: I0316 16:12:10.738790 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="0bbb1bbc-8c14-4046-bd63-cce793589d4d" containerName="glance-log" containerID="cri-o://9d0eb7f54ad73e5e0176f83bb44308788c3b7db237e47e155f80722c12eb04ab" gracePeriod=30 Mar 16 16:12:10 crc kubenswrapper[5120]: I0316 16:12:10.738892 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="5aa11a39-e139-4791-92ce-2771b0277a8b" containerName="glance-httpd" containerID="cri-o://b8adae27cb47fa8c07b0445649495ea94709c8815ea94e345953af8d7bd93388" gracePeriod=30 Mar 16 16:12:10 crc kubenswrapper[5120]: I0316 16:12:10.739204 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="0bbb1bbc-8c14-4046-bd63-cce793589d4d" containerName="glance-httpd" containerID="cri-o://3f9df4f7990f5d597db9e3cfa8764dc31f137f73c9769afb56a3bbe5c31ce33d" gracePeriod=30 Mar 16 16:12:10 crc kubenswrapper[5120]: I0316 16:12:10.747410 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podStartSLOduration=2.747393272 podStartE2EDuration="2.747393272s" podCreationTimestamp="2026-03-16 16:12:08 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:12:10.746408476 +0000 UTC m=+2432.900340133" watchObservedRunningTime="2026-03-16 16:12:10.747393272 +0000 UTC m=+2432.901324929" Mar 16 16:12:10 crc kubenswrapper[5120]: I0316 16:12:10.762674 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="5aa11a39-e139-4791-92ce-2771b0277a8b" containerName="glance-log" probeResult="failure" output="Get \"https://10.217.0.144:9292/healthcheck\": EOF" Mar 16 16:12:10 crc kubenswrapper[5120]: I0316 16:12:10.762982 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="5aa11a39-e139-4791-92ce-2771b0277a8b" containerName="glance-httpd" probeResult="failure" output="Get \"https://10.217.0.144:9292/healthcheck\": EOF" Mar 16 16:12:10 crc kubenswrapper[5120]: I0316 16:12:10.794029 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="0bbb1bbc-8c14-4046-bd63-cce793589d4d" containerName="glance-log" probeResult="failure" output="Get \"https://10.217.0.145:9292/healthcheck\": EOF" Mar 16 16:12:10 crc kubenswrapper[5120]: I0316 16:12:10.794900 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="0bbb1bbc-8c14-4046-bd63-cce793589d4d" containerName="glance-httpd" probeResult="failure" output="Get \"https://10.217.0.145:9292/healthcheck\": EOF" Mar 16 16:12:10 crc kubenswrapper[5120]: I0316 16:12:10.809031 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="0bbb1bbc-8c14-4046-bd63-cce793589d4d" containerName="glance-httpd" probeResult="failure" output="Get \"https://10.217.0.145:9292/healthcheck\": EOF" Mar 16 16:12:10 crc kubenswrapper[5120]: I0316 16:12:10.809426 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="0bbb1bbc-8c14-4046-bd63-cce793589d4d" containerName="glance-log" probeResult="failure" output="Get \"https://10.217.0.145:9292/healthcheck\": read tcp 10.217.0.2:37214->10.217.0.145:9292: read: connection reset by peer" Mar 16 16:12:10 crc kubenswrapper[5120]: I0316 16:12:10.850073 5120 scope.go:117] "RemoveContainer" containerID="2b1607efd8a45ba58c6a4a77229af5d4110ccc7491735de70a5f1fd0ddcd119e" Mar 16 16:12:11 crc kubenswrapper[5120]: I0316 16:12:11.021821 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-7cbc6f47fd-sq9tz"] Mar 16 16:12:11 crc kubenswrapper[5120]: I0316 16:12:11.066239 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-7cbc6f47fd-sq9tz"] Mar 16 16:12:11 crc kubenswrapper[5120]: I0316 16:12:11.078812 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-6c44998f84-78gpn"] Mar 16 16:12:11 crc kubenswrapper[5120]: I0316 16:12:11.079129 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-6c44998f84-78gpn" podUID="fb47226c-c927-43f1-9028-cfdc5dcd2e89" containerName="placement-log" containerID="cri-o://8b6fcf540a2852e7e2a452076d8c5ea6c757bd608aac9d175bb0875ea173bfc2" gracePeriod=30 Mar 16 16:12:11 crc kubenswrapper[5120]: I0316 16:12:11.079975 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-6c44998f84-78gpn" podUID="fb47226c-c927-43f1-9028-cfdc5dcd2e89" containerName="placement-api" containerID="cri-o://60324513292e67399e801c3f75048966767e12abc6a9079d9c7f31847ad746a3" gracePeriod=30 Mar 16 16:12:11 crc kubenswrapper[5120]: I0316 16:12:11.093051 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:12:11 crc kubenswrapper[5120]: I0316 16:12:11.093491 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="4fce708d-9952-41be-95e4-de815da4d75a" containerName="cinder-api-log" containerID="cri-o://c4dca286f55be50ee11220e99e46fb4fbff8df572374c30f96ad63432819c510" gracePeriod=30 Mar 16 16:12:11 crc kubenswrapper[5120]: I0316 16:12:11.094269 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="4fce708d-9952-41be-95e4-de815da4d75a" containerName="cinder-api" containerID="cri-o://827a28a46d1c890951e8220149569dccb0bcd86b23bd5503ade8c62f8991d36a" gracePeriod=30 Mar 16 16:12:11 crc kubenswrapper[5120]: I0316 16:12:11.284868 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-574f788578-gbqkk"] Mar 16 16:12:11 crc kubenswrapper[5120]: I0316 16:12:11.285313 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-574f788578-gbqkk" podUID="f632160f-f5b5-4ffe-be8e-798d54d5b530" containerName="neutron-api" containerID="cri-o://b8c747755c95c125fe33105920ff58829e6a9d33efdbda08966390674c74e4e1" gracePeriod=30 Mar 16 16:12:11 crc kubenswrapper[5120]: I0316 16:12:11.285981 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-574f788578-gbqkk" podUID="f632160f-f5b5-4ffe-be8e-798d54d5b530" containerName="neutron-httpd" containerID="cri-o://cc88aafe27855d27722c7a0a73e087a02562cfb1c968f5c4c5ecf7a927b36c24" gracePeriod=30 Mar 16 16:12:11 crc kubenswrapper[5120]: I0316 16:12:11.313386 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/neutron-574f788578-gbqkk" Mar 16 16:12:11 crc kubenswrapper[5120]: I0316 16:12:11.380228 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:12:11 crc kubenswrapper[5120]: I0316 16:12:11.427855 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-5566b7bdc5-j8gmc" Mar 16 16:12:11 crc kubenswrapper[5120]: I0316 16:12:11.533488 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/663dca84-6d86-4d19-a614-6f4fb2f04e2e-logs\") pod \"663dca84-6d86-4d19-a614-6f4fb2f04e2e\" (UID: \"663dca84-6d86-4d19-a614-6f4fb2f04e2e\") " Mar 16 16:12:11 crc kubenswrapper[5120]: I0316 16:12:11.533618 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/663dca84-6d86-4d19-a614-6f4fb2f04e2e-config-data-custom\") pod \"663dca84-6d86-4d19-a614-6f4fb2f04e2e\" (UID: \"663dca84-6d86-4d19-a614-6f4fb2f04e2e\") " Mar 16 16:12:11 crc kubenswrapper[5120]: I0316 16:12:11.533923 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/663dca84-6d86-4d19-a614-6f4fb2f04e2e-logs" (OuterVolumeSpecName: "logs") pod "663dca84-6d86-4d19-a614-6f4fb2f04e2e" (UID: "663dca84-6d86-4d19-a614-6f4fb2f04e2e"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:12:11 crc kubenswrapper[5120]: I0316 16:12:11.533961 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/663dca84-6d86-4d19-a614-6f4fb2f04e2e-config-data\") pod \"663dca84-6d86-4d19-a614-6f4fb2f04e2e\" (UID: \"663dca84-6d86-4d19-a614-6f4fb2f04e2e\") " Mar 16 16:12:11 crc kubenswrapper[5120]: I0316 16:12:11.534052 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8rx8c\" (UniqueName: \"kubernetes.io/projected/663dca84-6d86-4d19-a614-6f4fb2f04e2e-kube-api-access-8rx8c\") pod \"663dca84-6d86-4d19-a614-6f4fb2f04e2e\" (UID: \"663dca84-6d86-4d19-a614-6f4fb2f04e2e\") " Mar 16 16:12:11 crc kubenswrapper[5120]: I0316 16:12:11.534271 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/663dca84-6d86-4d19-a614-6f4fb2f04e2e-combined-ca-bundle\") pod \"663dca84-6d86-4d19-a614-6f4fb2f04e2e\" (UID: \"663dca84-6d86-4d19-a614-6f4fb2f04e2e\") " Mar 16 16:12:11 crc kubenswrapper[5120]: I0316 16:12:11.534963 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/663dca84-6d86-4d19-a614-6f4fb2f04e2e-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:11 crc kubenswrapper[5120]: I0316 16:12:11.539667 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/663dca84-6d86-4d19-a614-6f4fb2f04e2e-kube-api-access-8rx8c" (OuterVolumeSpecName: "kube-api-access-8rx8c") pod "663dca84-6d86-4d19-a614-6f4fb2f04e2e" (UID: "663dca84-6d86-4d19-a614-6f4fb2f04e2e"). InnerVolumeSpecName "kube-api-access-8rx8c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:12:11 crc kubenswrapper[5120]: I0316 16:12:11.542886 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/663dca84-6d86-4d19-a614-6f4fb2f04e2e-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "663dca84-6d86-4d19-a614-6f4fb2f04e2e" (UID: "663dca84-6d86-4d19-a614-6f4fb2f04e2e"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:11 crc kubenswrapper[5120]: I0316 16:12:11.598912 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/663dca84-6d86-4d19-a614-6f4fb2f04e2e-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "663dca84-6d86-4d19-a614-6f4fb2f04e2e" (UID: "663dca84-6d86-4d19-a614-6f4fb2f04e2e"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:11 crc kubenswrapper[5120]: I0316 16:12:11.623892 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/663dca84-6d86-4d19-a614-6f4fb2f04e2e-config-data" (OuterVolumeSpecName: "config-data") pod "663dca84-6d86-4d19-a614-6f4fb2f04e2e" (UID: "663dca84-6d86-4d19-a614-6f4fb2f04e2e"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:11 crc kubenswrapper[5120]: I0316 16:12:11.643999 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/663dca84-6d86-4d19-a614-6f4fb2f04e2e-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:11 crc kubenswrapper[5120]: I0316 16:12:11.644042 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/663dca84-6d86-4d19-a614-6f4fb2f04e2e-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:11 crc kubenswrapper[5120]: I0316 16:12:11.644057 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8rx8c\" (UniqueName: \"kubernetes.io/projected/663dca84-6d86-4d19-a614-6f4fb2f04e2e-kube-api-access-8rx8c\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:11 crc kubenswrapper[5120]: I0316 16:12:11.644070 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/663dca84-6d86-4d19-a614-6f4fb2f04e2e-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:11 crc kubenswrapper[5120]: I0316 16:12:11.672940 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/cinder-api-0" podUID="4fce708d-9952-41be-95e4-de815da4d75a" containerName="cinder-api" probeResult="failure" output="Get \"https://10.217.0.146:8776/healthcheck\": read tcp 10.217.0.2:57024->10.217.0.146:8776: read: connection reset by peer" Mar 16 16:12:11 crc kubenswrapper[5120]: I0316 16:12:11.787864 5120 generic.go:358] "Generic (PLEG): container finished" podID="4fce708d-9952-41be-95e4-de815da4d75a" containerID="827a28a46d1c890951e8220149569dccb0bcd86b23bd5503ade8c62f8991d36a" exitCode=0 Mar 16 16:12:11 crc kubenswrapper[5120]: I0316 16:12:11.787895 5120 generic.go:358] "Generic (PLEG): container finished" podID="4fce708d-9952-41be-95e4-de815da4d75a" containerID="c4dca286f55be50ee11220e99e46fb4fbff8df572374c30f96ad63432819c510" exitCode=143 Mar 16 16:12:11 crc kubenswrapper[5120]: I0316 16:12:11.787989 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"4fce708d-9952-41be-95e4-de815da4d75a","Type":"ContainerDied","Data":"827a28a46d1c890951e8220149569dccb0bcd86b23bd5503ade8c62f8991d36a"} Mar 16 16:12:11 crc kubenswrapper[5120]: I0316 16:12:11.788017 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"4fce708d-9952-41be-95e4-de815da4d75a","Type":"ContainerDied","Data":"c4dca286f55be50ee11220e99e46fb4fbff8df572374c30f96ad63432819c510"} Mar 16 16:12:11 crc kubenswrapper[5120]: I0316 16:12:11.799008 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-5566b7bdc5-j8gmc" event={"ID":"663dca84-6d86-4d19-a614-6f4fb2f04e2e","Type":"ContainerDied","Data":"bbc4593621ef9783c4973fb5cee3d52980a5d49c74f4a0d22154ee60033a53fe"} Mar 16 16:12:11 crc kubenswrapper[5120]: I0316 16:12:11.799062 5120 scope.go:117] "RemoveContainer" containerID="0f7e4d3d356dabd8558578635e70db345e5e1f7a9e0eefd96da90458af3b664f" Mar 16 16:12:11 crc kubenswrapper[5120]: I0316 16:12:11.799219 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-5566b7bdc5-j8gmc" Mar 16 16:12:11 crc kubenswrapper[5120]: I0316 16:12:11.839131 5120 generic.go:358] "Generic (PLEG): container finished" podID="0bbb1bbc-8c14-4046-bd63-cce793589d4d" containerID="9d0eb7f54ad73e5e0176f83bb44308788c3b7db237e47e155f80722c12eb04ab" exitCode=143 Mar 16 16:12:11 crc kubenswrapper[5120]: I0316 16:12:11.839278 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"0bbb1bbc-8c14-4046-bd63-cce793589d4d","Type":"ContainerDied","Data":"9d0eb7f54ad73e5e0176f83bb44308788c3b7db237e47e155f80722c12eb04ab"} Mar 16 16:12:11 crc kubenswrapper[5120]: I0316 16:12:11.847512 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"96d66c8e-8cdb-462c-a302-c85e581db5ad","Type":"ContainerStarted","Data":"d4b6b76b9c5320477843bd780ebb20cf97063725b2d9c08ddb68df6a0c0cf879"} Mar 16 16:12:11 crc kubenswrapper[5120]: I0316 16:12:11.859805 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:12:11 crc kubenswrapper[5120]: I0316 16:12:11.872026 5120 generic.go:358] "Generic (PLEG): container finished" podID="5aa11a39-e139-4791-92ce-2771b0277a8b" containerID="11f81caa83f0c9ef60769664b8c971b68ba4bc25cc7de3bb33d429ea3b426e32" exitCode=143 Mar 16 16:12:11 crc kubenswrapper[5120]: I0316 16:12:11.872197 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"5aa11a39-e139-4791-92ce-2771b0277a8b","Type":"ContainerDied","Data":"11f81caa83f0c9ef60769664b8c971b68ba4bc25cc7de3bb33d429ea3b426e32"} Mar 16 16:12:11 crc kubenswrapper[5120]: I0316 16:12:11.879535 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:12:11 crc kubenswrapper[5120]: I0316 16:12:11.880414 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-5566b7bdc5-j8gmc"] Mar 16 16:12:11 crc kubenswrapper[5120]: I0316 16:12:11.886991 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5","Type":"ContainerStarted","Data":"ef0d85dafcbfd3191d70121e50e81623c612e9907822eea5b7266da0a9d3455f"} Mar 16 16:12:11 crc kubenswrapper[5120]: I0316 16:12:11.908835 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-worker-5566b7bdc5-j8gmc"] Mar 16 16:12:11 crc kubenswrapper[5120]: I0316 16:12:11.915017 5120 generic.go:358] "Generic (PLEG): container finished" podID="f632160f-f5b5-4ffe-be8e-798d54d5b530" containerID="cc88aafe27855d27722c7a0a73e087a02562cfb1c968f5c4c5ecf7a927b36c24" exitCode=0 Mar 16 16:12:11 crc kubenswrapper[5120]: I0316 16:12:11.915131 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-574f788578-gbqkk" event={"ID":"f632160f-f5b5-4ffe-be8e-798d54d5b530","Type":"ContainerDied","Data":"cc88aafe27855d27722c7a0a73e087a02562cfb1c968f5c4c5ecf7a927b36c24"} Mar 16 16:12:11 crc kubenswrapper[5120]: I0316 16:12:11.936053 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-7cbc6f47fd-xhhn9"] Mar 16 16:12:11 crc kubenswrapper[5120]: I0316 16:12:11.937421 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="663dca84-6d86-4d19-a614-6f4fb2f04e2e" containerName="barbican-worker" Mar 16 16:12:11 crc kubenswrapper[5120]: I0316 16:12:11.937554 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="663dca84-6d86-4d19-a614-6f4fb2f04e2e" containerName="barbican-worker" Mar 16 16:12:11 crc kubenswrapper[5120]: I0316 16:12:11.937623 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78af3e38-08bb-4b78-89aa-8d76d361e2bc" containerName="barbican-keystone-listener" Mar 16 16:12:11 crc kubenswrapper[5120]: I0316 16:12:11.937680 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="78af3e38-08bb-4b78-89aa-8d76d361e2bc" containerName="barbican-keystone-listener" Mar 16 16:12:11 crc kubenswrapper[5120]: I0316 16:12:11.937812 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="663dca84-6d86-4d19-a614-6f4fb2f04e2e" containerName="barbican-worker-log" Mar 16 16:12:11 crc kubenswrapper[5120]: I0316 16:12:11.937884 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="663dca84-6d86-4d19-a614-6f4fb2f04e2e" containerName="barbican-worker-log" Mar 16 16:12:11 crc kubenswrapper[5120]: I0316 16:12:11.937981 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78af3e38-08bb-4b78-89aa-8d76d361e2bc" containerName="barbican-keystone-listener-log" Mar 16 16:12:11 crc kubenswrapper[5120]: I0316 16:12:11.938047 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="78af3e38-08bb-4b78-89aa-8d76d361e2bc" containerName="barbican-keystone-listener-log" Mar 16 16:12:11 crc kubenswrapper[5120]: I0316 16:12:11.938298 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="78af3e38-08bb-4b78-89aa-8d76d361e2bc" containerName="barbican-keystone-listener-log" Mar 16 16:12:11 crc kubenswrapper[5120]: I0316 16:12:11.938378 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="663dca84-6d86-4d19-a614-6f4fb2f04e2e" containerName="barbican-worker-log" Mar 16 16:12:11 crc kubenswrapper[5120]: I0316 16:12:11.938457 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="663dca84-6d86-4d19-a614-6f4fb2f04e2e" containerName="barbican-worker" Mar 16 16:12:11 crc kubenswrapper[5120]: I0316 16:12:11.938523 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="78af3e38-08bb-4b78-89aa-8d76d361e2bc" containerName="barbican-keystone-listener" Mar 16 16:12:11 crc kubenswrapper[5120]: I0316 16:12:11.955249 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-7cbc6f47fd-xhhn9" Mar 16 16:12:11 crc kubenswrapper[5120]: I0316 16:12:11.975182 5120 generic.go:358] "Generic (PLEG): container finished" podID="fb47226c-c927-43f1-9028-cfdc5dcd2e89" containerID="8b6fcf540a2852e7e2a452076d8c5ea6c757bd608aac9d175bb0875ea173bfc2" exitCode=143 Mar 16 16:12:11 crc kubenswrapper[5120]: I0316 16:12:11.975248 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-7cbc6f47fd-xhhn9"] Mar 16 16:12:11 crc kubenswrapper[5120]: I0316 16:12:11.975283 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-6c44998f84-78gpn" event={"ID":"fb47226c-c927-43f1-9028-cfdc5dcd2e89","Type":"ContainerDied","Data":"8b6fcf540a2852e7e2a452076d8c5ea6c757bd608aac9d175bb0875ea173bfc2"} Mar 16 16:12:11 crc kubenswrapper[5120]: I0316 16:12:11.978986 5120 scope.go:117] "RemoveContainer" containerID="817eba962a106429a987b1357e3063e8c28061cee33b51e65bc388fae18238dc" Mar 16 16:12:11 crc kubenswrapper[5120]: I0316 16:12:11.983264 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-scheduler-0" podStartSLOduration=5.983244315 podStartE2EDuration="5.983244315s" podCreationTimestamp="2026-03-16 16:12:06 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:12:11.880820776 +0000 UTC m=+2434.034752433" watchObservedRunningTime="2026-03-16 16:12:11.983244315 +0000 UTC m=+2434.137175972" Mar 16 16:12:12 crc kubenswrapper[5120]: I0316 16:12:12.013283 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:12:12 crc kubenswrapper[5120]: I0316 16:12:12.018636 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-6d59599fcd-hn254" event={"ID":"fe2105ae-76c1-452b-bee1-074d323c076f","Type":"ContainerStarted","Data":"33458ed69c10a0a03c3eb77b97ded5f81bf1b3bcb75d28603bc14dde98be5d90"} Mar 16 16:12:12 crc kubenswrapper[5120]: I0316 16:12:12.018683 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/swift-proxy-6d59599fcd-hn254" Mar 16 16:12:12 crc kubenswrapper[5120]: I0316 16:12:12.018708 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/swift-proxy-6d59599fcd-hn254" Mar 16 16:12:12 crc kubenswrapper[5120]: I0316 16:12:12.019436 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-worker-5566b7bdc5-47bld"] Mar 16 16:12:12 crc kubenswrapper[5120]: I0316 16:12:12.034137 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-5566b7bdc5-47bld"] Mar 16 16:12:12 crc kubenswrapper[5120]: I0316 16:12:12.034281 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-5566b7bdc5-47bld" Mar 16 16:12:12 crc kubenswrapper[5120]: I0316 16:12:12.048852 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-69787fc498-jx88k"] Mar 16 16:12:12 crc kubenswrapper[5120]: I0316 16:12:12.049119 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-69787fc498-jx88k" podUID="34da2089-cc88-4d8c-97da-68aadf7f2c03" containerName="barbican-api-log" containerID="cri-o://76d367745a5b0b62a2045aa1d05a31b674319fe60957e9cfd4510f19426260cb" gracePeriod=30 Mar 16 16:12:12 crc kubenswrapper[5120]: I0316 16:12:12.049656 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-69787fc498-jx88k" podUID="34da2089-cc88-4d8c-97da-68aadf7f2c03" containerName="barbican-api" containerID="cri-o://937834673f5ee947e2dce3e8165bec6e100d62a9a8ac1a43a10f874df812f3f4" gracePeriod=30 Mar 16 16:12:12 crc kubenswrapper[5120]: I0316 16:12:12.056648 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/28ea8203-158a-4c89-8ae6-647d230c21ff-config-data-custom\") pod \"barbican-keystone-listener-7cbc6f47fd-xhhn9\" (UID: \"28ea8203-158a-4c89-8ae6-647d230c21ff\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7cbc6f47fd-xhhn9" Mar 16 16:12:12 crc kubenswrapper[5120]: I0316 16:12:12.056697 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/28ea8203-158a-4c89-8ae6-647d230c21ff-combined-ca-bundle\") pod \"barbican-keystone-listener-7cbc6f47fd-xhhn9\" (UID: \"28ea8203-158a-4c89-8ae6-647d230c21ff\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7cbc6f47fd-xhhn9" Mar 16 16:12:12 crc kubenswrapper[5120]: I0316 16:12:12.056723 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/28ea8203-158a-4c89-8ae6-647d230c21ff-config-data\") pod \"barbican-keystone-listener-7cbc6f47fd-xhhn9\" (UID: \"28ea8203-158a-4c89-8ae6-647d230c21ff\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7cbc6f47fd-xhhn9" Mar 16 16:12:12 crc kubenswrapper[5120]: I0316 16:12:12.056868 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jp9n6\" (UniqueName: \"kubernetes.io/projected/28ea8203-158a-4c89-8ae6-647d230c21ff-kube-api-access-jp9n6\") pod \"barbican-keystone-listener-7cbc6f47fd-xhhn9\" (UID: \"28ea8203-158a-4c89-8ae6-647d230c21ff\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7cbc6f47fd-xhhn9" Mar 16 16:12:12 crc kubenswrapper[5120]: I0316 16:12:12.056923 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/28ea8203-158a-4c89-8ae6-647d230c21ff-logs\") pod \"barbican-keystone-listener-7cbc6f47fd-xhhn9\" (UID: \"28ea8203-158a-4c89-8ae6-647d230c21ff\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7cbc6f47fd-xhhn9" Mar 16 16:12:12 crc kubenswrapper[5120]: I0316 16:12:12.076991 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openstack-kuttl-tests/barbican-api-69787fc498-jx88k" podUID="34da2089-cc88-4d8c-97da-68aadf7f2c03" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.0.154:9311/healthcheck\": EOF" Mar 16 16:12:12 crc kubenswrapper[5120]: I0316 16:12:12.077032 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-69787fc498-jx88k" podUID="34da2089-cc88-4d8c-97da-68aadf7f2c03" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.0.154:9311/healthcheck\": EOF" Mar 16 16:12:12 crc kubenswrapper[5120]: I0316 16:12:12.077073 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openstack-kuttl-tests/barbican-api-69787fc498-jx88k" podUID="34da2089-cc88-4d8c-97da-68aadf7f2c03" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.0.154:9311/healthcheck\": EOF" Mar 16 16:12:12 crc kubenswrapper[5120]: I0316 16:12:12.077075 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-69787fc498-jx88k" podUID="34da2089-cc88-4d8c-97da-68aadf7f2c03" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.0.154:9311/healthcheck\": EOF" Mar 16 16:12:12 crc kubenswrapper[5120]: I0316 16:12:12.081568 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/swift-proxy-6d59599fcd-hn254" podStartSLOduration=4.081532732 podStartE2EDuration="4.081532732s" podCreationTimestamp="2026-03-16 16:12:08 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:12:12.054292583 +0000 UTC m=+2434.208224250" watchObservedRunningTime="2026-03-16 16:12:12.081532732 +0000 UTC m=+2434.235464389" Mar 16 16:12:12 crc kubenswrapper[5120]: I0316 16:12:12.158675 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/28ea8203-158a-4c89-8ae6-647d230c21ff-config-data\") pod \"barbican-keystone-listener-7cbc6f47fd-xhhn9\" (UID: \"28ea8203-158a-4c89-8ae6-647d230c21ff\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7cbc6f47fd-xhhn9" Mar 16 16:12:12 crc kubenswrapper[5120]: I0316 16:12:12.158997 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cb4b4078-46df-4b50-aa4a-81adbbd15e52-combined-ca-bundle\") pod \"barbican-worker-5566b7bdc5-47bld\" (UID: \"cb4b4078-46df-4b50-aa4a-81adbbd15e52\") " pod="openstack-kuttl-tests/barbican-worker-5566b7bdc5-47bld" Mar 16 16:12:12 crc kubenswrapper[5120]: I0316 16:12:12.159027 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/cb4b4078-46df-4b50-aa4a-81adbbd15e52-logs\") pod \"barbican-worker-5566b7bdc5-47bld\" (UID: \"cb4b4078-46df-4b50-aa4a-81adbbd15e52\") " pod="openstack-kuttl-tests/barbican-worker-5566b7bdc5-47bld" Mar 16 16:12:12 crc kubenswrapper[5120]: I0316 16:12:12.159092 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jp9n6\" (UniqueName: \"kubernetes.io/projected/28ea8203-158a-4c89-8ae6-647d230c21ff-kube-api-access-jp9n6\") pod \"barbican-keystone-listener-7cbc6f47fd-xhhn9\" (UID: \"28ea8203-158a-4c89-8ae6-647d230c21ff\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7cbc6f47fd-xhhn9" Mar 16 16:12:12 crc kubenswrapper[5120]: I0316 16:12:12.159147 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/cb4b4078-46df-4b50-aa4a-81adbbd15e52-config-data-custom\") pod \"barbican-worker-5566b7bdc5-47bld\" (UID: \"cb4b4078-46df-4b50-aa4a-81adbbd15e52\") " pod="openstack-kuttl-tests/barbican-worker-5566b7bdc5-47bld" Mar 16 16:12:12 crc kubenswrapper[5120]: I0316 16:12:12.159232 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrjh6\" (UniqueName: \"kubernetes.io/projected/cb4b4078-46df-4b50-aa4a-81adbbd15e52-kube-api-access-hrjh6\") pod \"barbican-worker-5566b7bdc5-47bld\" (UID: \"cb4b4078-46df-4b50-aa4a-81adbbd15e52\") " pod="openstack-kuttl-tests/barbican-worker-5566b7bdc5-47bld" Mar 16 16:12:12 crc kubenswrapper[5120]: I0316 16:12:12.159268 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/28ea8203-158a-4c89-8ae6-647d230c21ff-logs\") pod \"barbican-keystone-listener-7cbc6f47fd-xhhn9\" (UID: \"28ea8203-158a-4c89-8ae6-647d230c21ff\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7cbc6f47fd-xhhn9" Mar 16 16:12:12 crc kubenswrapper[5120]: I0316 16:12:12.163150 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/28ea8203-158a-4c89-8ae6-647d230c21ff-logs\") pod \"barbican-keystone-listener-7cbc6f47fd-xhhn9\" (UID: \"28ea8203-158a-4c89-8ae6-647d230c21ff\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7cbc6f47fd-xhhn9" Mar 16 16:12:12 crc kubenswrapper[5120]: I0316 16:12:12.164037 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/28ea8203-158a-4c89-8ae6-647d230c21ff-config-data-custom\") pod \"barbican-keystone-listener-7cbc6f47fd-xhhn9\" (UID: \"28ea8203-158a-4c89-8ae6-647d230c21ff\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7cbc6f47fd-xhhn9" Mar 16 16:12:12 crc kubenswrapper[5120]: I0316 16:12:12.164098 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cb4b4078-46df-4b50-aa4a-81adbbd15e52-config-data\") pod \"barbican-worker-5566b7bdc5-47bld\" (UID: \"cb4b4078-46df-4b50-aa4a-81adbbd15e52\") " pod="openstack-kuttl-tests/barbican-worker-5566b7bdc5-47bld" Mar 16 16:12:12 crc kubenswrapper[5120]: I0316 16:12:12.164141 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/28ea8203-158a-4c89-8ae6-647d230c21ff-combined-ca-bundle\") pod \"barbican-keystone-listener-7cbc6f47fd-xhhn9\" (UID: \"28ea8203-158a-4c89-8ae6-647d230c21ff\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7cbc6f47fd-xhhn9" Mar 16 16:12:12 crc kubenswrapper[5120]: I0316 16:12:12.182705 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/28ea8203-158a-4c89-8ae6-647d230c21ff-combined-ca-bundle\") pod \"barbican-keystone-listener-7cbc6f47fd-xhhn9\" (UID: \"28ea8203-158a-4c89-8ae6-647d230c21ff\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7cbc6f47fd-xhhn9" Mar 16 16:12:12 crc kubenswrapper[5120]: I0316 16:12:12.186804 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/28ea8203-158a-4c89-8ae6-647d230c21ff-config-data\") pod \"barbican-keystone-listener-7cbc6f47fd-xhhn9\" (UID: \"28ea8203-158a-4c89-8ae6-647d230c21ff\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7cbc6f47fd-xhhn9" Mar 16 16:12:12 crc kubenswrapper[5120]: I0316 16:12:12.187381 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/28ea8203-158a-4c89-8ae6-647d230c21ff-config-data-custom\") pod \"barbican-keystone-listener-7cbc6f47fd-xhhn9\" (UID: \"28ea8203-158a-4c89-8ae6-647d230c21ff\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7cbc6f47fd-xhhn9" Mar 16 16:12:12 crc kubenswrapper[5120]: I0316 16:12:12.211314 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jp9n6\" (UniqueName: \"kubernetes.io/projected/28ea8203-158a-4c89-8ae6-647d230c21ff-kube-api-access-jp9n6\") pod \"barbican-keystone-listener-7cbc6f47fd-xhhn9\" (UID: \"28ea8203-158a-4c89-8ae6-647d230c21ff\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7cbc6f47fd-xhhn9" Mar 16 16:12:12 crc kubenswrapper[5120]: I0316 16:12:12.268405 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/cb4b4078-46df-4b50-aa4a-81adbbd15e52-config-data-custom\") pod \"barbican-worker-5566b7bdc5-47bld\" (UID: \"cb4b4078-46df-4b50-aa4a-81adbbd15e52\") " pod="openstack-kuttl-tests/barbican-worker-5566b7bdc5-47bld" Mar 16 16:12:12 crc kubenswrapper[5120]: I0316 16:12:12.268467 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hrjh6\" (UniqueName: \"kubernetes.io/projected/cb4b4078-46df-4b50-aa4a-81adbbd15e52-kube-api-access-hrjh6\") pod \"barbican-worker-5566b7bdc5-47bld\" (UID: \"cb4b4078-46df-4b50-aa4a-81adbbd15e52\") " pod="openstack-kuttl-tests/barbican-worker-5566b7bdc5-47bld" Mar 16 16:12:12 crc kubenswrapper[5120]: I0316 16:12:12.268589 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cb4b4078-46df-4b50-aa4a-81adbbd15e52-config-data\") pod \"barbican-worker-5566b7bdc5-47bld\" (UID: \"cb4b4078-46df-4b50-aa4a-81adbbd15e52\") " pod="openstack-kuttl-tests/barbican-worker-5566b7bdc5-47bld" Mar 16 16:12:12 crc kubenswrapper[5120]: I0316 16:12:12.268726 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cb4b4078-46df-4b50-aa4a-81adbbd15e52-combined-ca-bundle\") pod \"barbican-worker-5566b7bdc5-47bld\" (UID: \"cb4b4078-46df-4b50-aa4a-81adbbd15e52\") " pod="openstack-kuttl-tests/barbican-worker-5566b7bdc5-47bld" Mar 16 16:12:12 crc kubenswrapper[5120]: I0316 16:12:12.268743 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/cb4b4078-46df-4b50-aa4a-81adbbd15e52-logs\") pod \"barbican-worker-5566b7bdc5-47bld\" (UID: \"cb4b4078-46df-4b50-aa4a-81adbbd15e52\") " pod="openstack-kuttl-tests/barbican-worker-5566b7bdc5-47bld" Mar 16 16:12:12 crc kubenswrapper[5120]: I0316 16:12:12.269138 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/cb4b4078-46df-4b50-aa4a-81adbbd15e52-logs\") pod \"barbican-worker-5566b7bdc5-47bld\" (UID: \"cb4b4078-46df-4b50-aa4a-81adbbd15e52\") " pod="openstack-kuttl-tests/barbican-worker-5566b7bdc5-47bld" Mar 16 16:12:12 crc kubenswrapper[5120]: I0316 16:12:12.278988 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cb4b4078-46df-4b50-aa4a-81adbbd15e52-combined-ca-bundle\") pod \"barbican-worker-5566b7bdc5-47bld\" (UID: \"cb4b4078-46df-4b50-aa4a-81adbbd15e52\") " pod="openstack-kuttl-tests/barbican-worker-5566b7bdc5-47bld" Mar 16 16:12:12 crc kubenswrapper[5120]: I0316 16:12:12.279945 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cb4b4078-46df-4b50-aa4a-81adbbd15e52-config-data\") pod \"barbican-worker-5566b7bdc5-47bld\" (UID: \"cb4b4078-46df-4b50-aa4a-81adbbd15e52\") " pod="openstack-kuttl-tests/barbican-worker-5566b7bdc5-47bld" Mar 16 16:12:12 crc kubenswrapper[5120]: I0316 16:12:12.284332 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/cb4b4078-46df-4b50-aa4a-81adbbd15e52-config-data-custom\") pod \"barbican-worker-5566b7bdc5-47bld\" (UID: \"cb4b4078-46df-4b50-aa4a-81adbbd15e52\") " pod="openstack-kuttl-tests/barbican-worker-5566b7bdc5-47bld" Mar 16 16:12:12 crc kubenswrapper[5120]: I0316 16:12:12.291319 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrjh6\" (UniqueName: \"kubernetes.io/projected/cb4b4078-46df-4b50-aa4a-81adbbd15e52-kube-api-access-hrjh6\") pod \"barbican-worker-5566b7bdc5-47bld\" (UID: \"cb4b4078-46df-4b50-aa4a-81adbbd15e52\") " pod="openstack-kuttl-tests/barbican-worker-5566b7bdc5-47bld" Mar 16 16:12:12 crc kubenswrapper[5120]: I0316 16:12:12.308132 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-7cbc6f47fd-xhhn9" Mar 16 16:12:12 crc kubenswrapper[5120]: I0316 16:12:12.362223 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-5566b7bdc5-47bld" Mar 16 16:12:12 crc kubenswrapper[5120]: I0316 16:12:12.380923 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:12:12 crc kubenswrapper[5120]: I0316 16:12:12.616689 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:12:12 crc kubenswrapper[5120]: I0316 16:12:12.689612 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="663dca84-6d86-4d19-a614-6f4fb2f04e2e" path="/var/lib/kubelet/pods/663dca84-6d86-4d19-a614-6f4fb2f04e2e/volumes" Mar 16 16:12:12 crc kubenswrapper[5120]: I0316 16:12:12.690366 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="78af3e38-08bb-4b78-89aa-8d76d361e2bc" path="/var/lib/kubelet/pods/78af3e38-08bb-4b78-89aa-8d76d361e2bc/volumes" Mar 16 16:12:12 crc kubenswrapper[5120]: I0316 16:12:12.802858 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4fce708d-9952-41be-95e4-de815da4d75a-config-data\") pod \"4fce708d-9952-41be-95e4-de815da4d75a\" (UID: \"4fce708d-9952-41be-95e4-de815da4d75a\") " Mar 16 16:12:12 crc kubenswrapper[5120]: I0316 16:12:12.802954 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/4fce708d-9952-41be-95e4-de815da4d75a-internal-tls-certs\") pod \"4fce708d-9952-41be-95e4-de815da4d75a\" (UID: \"4fce708d-9952-41be-95e4-de815da4d75a\") " Mar 16 16:12:12 crc kubenswrapper[5120]: I0316 16:12:12.802998 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4fce708d-9952-41be-95e4-de815da4d75a-scripts\") pod \"4fce708d-9952-41be-95e4-de815da4d75a\" (UID: \"4fce708d-9952-41be-95e4-de815da4d75a\") " Mar 16 16:12:12 crc kubenswrapper[5120]: I0316 16:12:12.803172 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/4fce708d-9952-41be-95e4-de815da4d75a-etc-machine-id\") pod \"4fce708d-9952-41be-95e4-de815da4d75a\" (UID: \"4fce708d-9952-41be-95e4-de815da4d75a\") " Mar 16 16:12:12 crc kubenswrapper[5120]: I0316 16:12:12.803302 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/4fce708d-9952-41be-95e4-de815da4d75a-public-tls-certs\") pod \"4fce708d-9952-41be-95e4-de815da4d75a\" (UID: \"4fce708d-9952-41be-95e4-de815da4d75a\") " Mar 16 16:12:12 crc kubenswrapper[5120]: I0316 16:12:12.803324 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4fce708d-9952-41be-95e4-de815da4d75a-combined-ca-bundle\") pod \"4fce708d-9952-41be-95e4-de815da4d75a\" (UID: \"4fce708d-9952-41be-95e4-de815da4d75a\") " Mar 16 16:12:12 crc kubenswrapper[5120]: I0316 16:12:12.803413 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4fce708d-9952-41be-95e4-de815da4d75a-logs\") pod \"4fce708d-9952-41be-95e4-de815da4d75a\" (UID: \"4fce708d-9952-41be-95e4-de815da4d75a\") " Mar 16 16:12:12 crc kubenswrapper[5120]: I0316 16:12:12.803449 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/4fce708d-9952-41be-95e4-de815da4d75a-config-data-custom\") pod \"4fce708d-9952-41be-95e4-de815da4d75a\" (UID: \"4fce708d-9952-41be-95e4-de815da4d75a\") " Mar 16 16:12:12 crc kubenswrapper[5120]: I0316 16:12:12.803523 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vdmtg\" (UniqueName: \"kubernetes.io/projected/4fce708d-9952-41be-95e4-de815da4d75a-kube-api-access-vdmtg\") pod \"4fce708d-9952-41be-95e4-de815da4d75a\" (UID: \"4fce708d-9952-41be-95e4-de815da4d75a\") " Mar 16 16:12:12 crc kubenswrapper[5120]: I0316 16:12:12.809117 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4fce708d-9952-41be-95e4-de815da4d75a-logs" (OuterVolumeSpecName: "logs") pod "4fce708d-9952-41be-95e4-de815da4d75a" (UID: "4fce708d-9952-41be-95e4-de815da4d75a"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:12:12 crc kubenswrapper[5120]: I0316 16:12:12.810387 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/4fce708d-9952-41be-95e4-de815da4d75a-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "4fce708d-9952-41be-95e4-de815da4d75a" (UID: "4fce708d-9952-41be-95e4-de815da4d75a"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 16:12:12 crc kubenswrapper[5120]: I0316 16:12:12.826832 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4fce708d-9952-41be-95e4-de815da4d75a-scripts" (OuterVolumeSpecName: "scripts") pod "4fce708d-9952-41be-95e4-de815da4d75a" (UID: "4fce708d-9952-41be-95e4-de815da4d75a"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:12 crc kubenswrapper[5120]: I0316 16:12:12.826955 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4fce708d-9952-41be-95e4-de815da4d75a-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "4fce708d-9952-41be-95e4-de815da4d75a" (UID: "4fce708d-9952-41be-95e4-de815da4d75a"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:12 crc kubenswrapper[5120]: I0316 16:12:12.876948 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4fce708d-9952-41be-95e4-de815da4d75a-kube-api-access-vdmtg" (OuterVolumeSpecName: "kube-api-access-vdmtg") pod "4fce708d-9952-41be-95e4-de815da4d75a" (UID: "4fce708d-9952-41be-95e4-de815da4d75a"). InnerVolumeSpecName "kube-api-access-vdmtg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:12:12 crc kubenswrapper[5120]: I0316 16:12:12.913195 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vdmtg\" (UniqueName: \"kubernetes.io/projected/4fce708d-9952-41be-95e4-de815da4d75a-kube-api-access-vdmtg\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:12 crc kubenswrapper[5120]: I0316 16:12:12.913225 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4fce708d-9952-41be-95e4-de815da4d75a-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:12 crc kubenswrapper[5120]: I0316 16:12:12.913234 5120 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/4fce708d-9952-41be-95e4-de815da4d75a-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:12 crc kubenswrapper[5120]: I0316 16:12:12.913242 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4fce708d-9952-41be-95e4-de815da4d75a-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:12 crc kubenswrapper[5120]: I0316 16:12:12.913250 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/4fce708d-9952-41be-95e4-de815da4d75a-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:12 crc kubenswrapper[5120]: I0316 16:12:12.914256 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-7cbc6f47fd-xhhn9"] Mar 16 16:12:12 crc kubenswrapper[5120]: I0316 16:12:12.967974 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4fce708d-9952-41be-95e4-de815da4d75a-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "4fce708d-9952-41be-95e4-de815da4d75a" (UID: "4fce708d-9952-41be-95e4-de815da4d75a"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:12 crc kubenswrapper[5120]: I0316 16:12:12.985332 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4fce708d-9952-41be-95e4-de815da4d75a-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "4fce708d-9952-41be-95e4-de815da4d75a" (UID: "4fce708d-9952-41be-95e4-de815da4d75a"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:13 crc kubenswrapper[5120]: E0316 16:12:13.005429 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1869692 actualBytes=10240 Mar 16 16:12:13 crc kubenswrapper[5120]: I0316 16:12:13.014719 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/4fce708d-9952-41be-95e4-de815da4d75a-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:13 crc kubenswrapper[5120]: I0316 16:12:13.014903 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4fce708d-9952-41be-95e4-de815da4d75a-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:13 crc kubenswrapper[5120]: I0316 16:12:13.024238 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4fce708d-9952-41be-95e4-de815da4d75a-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "4fce708d-9952-41be-95e4-de815da4d75a" (UID: "4fce708d-9952-41be-95e4-de815da4d75a"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:13 crc kubenswrapper[5120]: I0316 16:12:13.041425 5120 generic.go:358] "Generic (PLEG): container finished" podID="34da2089-cc88-4d8c-97da-68aadf7f2c03" containerID="76d367745a5b0b62a2045aa1d05a31b674319fe60957e9cfd4510f19426260cb" exitCode=143 Mar 16 16:12:13 crc kubenswrapper[5120]: I0316 16:12:13.041668 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-69787fc498-jx88k" event={"ID":"34da2089-cc88-4d8c-97da-68aadf7f2c03","Type":"ContainerDied","Data":"76d367745a5b0b62a2045aa1d05a31b674319fe60957e9cfd4510f19426260cb"} Mar 16 16:12:13 crc kubenswrapper[5120]: I0316 16:12:13.061232 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-7cbc6f47fd-xhhn9" event={"ID":"28ea8203-158a-4c89-8ae6-647d230c21ff","Type":"ContainerStarted","Data":"c30a8449eabbe5d6204da8afa9be14d960147620cb1dc5787867a2dc823dd02b"} Mar 16 16:12:13 crc kubenswrapper[5120]: I0316 16:12:13.078908 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4fce708d-9952-41be-95e4-de815da4d75a-config-data" (OuterVolumeSpecName: "config-data") pod "4fce708d-9952-41be-95e4-de815da4d75a" (UID: "4fce708d-9952-41be-95e4-de815da4d75a"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:13 crc kubenswrapper[5120]: I0316 16:12:13.089493 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"4fce708d-9952-41be-95e4-de815da4d75a","Type":"ContainerDied","Data":"e6adb6aa278524b21809ea635d79dd070b619cb7e9db829e8e806fea4f7e69e7"} Mar 16 16:12:13 crc kubenswrapper[5120]: I0316 16:12:13.089542 5120 scope.go:117] "RemoveContainer" containerID="827a28a46d1c890951e8220149569dccb0bcd86b23bd5503ade8c62f8991d36a" Mar 16 16:12:13 crc kubenswrapper[5120]: I0316 16:12:13.089654 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:12:13 crc kubenswrapper[5120]: I0316 16:12:13.095844 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-5566b7bdc5-47bld"] Mar 16 16:12:13 crc kubenswrapper[5120]: I0316 16:12:13.127495 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/4fce708d-9952-41be-95e4-de815da4d75a-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:13 crc kubenswrapper[5120]: I0316 16:12:13.127828 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4fce708d-9952-41be-95e4-de815da4d75a-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:13 crc kubenswrapper[5120]: I0316 16:12:13.136273 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="6a869ae4-5dd4-47d8-aa7e-e519981ee01f" containerName="nova-cell0-conductor-conductor" containerID="cri-o://37accdb48c73bda606e0755923e4c375ae91d06251e5bc9a66dc8f1c54f97f2e" gracePeriod=30 Mar 16 16:12:13 crc kubenswrapper[5120]: I0316 16:12:13.165373 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:12:13 crc kubenswrapper[5120]: I0316 16:12:13.235395 5120 scope.go:117] "RemoveContainer" containerID="c4dca286f55be50ee11220e99e46fb4fbff8df572374c30f96ad63432819c510" Mar 16 16:12:13 crc kubenswrapper[5120]: I0316 16:12:13.289042 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:12:13 crc kubenswrapper[5120]: I0316 16:12:13.332043 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:12:13 crc kubenswrapper[5120]: I0316 16:12:13.401417 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:12:13 crc kubenswrapper[5120]: I0316 16:12:13.410547 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4fce708d-9952-41be-95e4-de815da4d75a" containerName="cinder-api-log" Mar 16 16:12:13 crc kubenswrapper[5120]: I0316 16:12:13.410585 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="4fce708d-9952-41be-95e4-de815da4d75a" containerName="cinder-api-log" Mar 16 16:12:13 crc kubenswrapper[5120]: I0316 16:12:13.410676 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4fce708d-9952-41be-95e4-de815da4d75a" containerName="cinder-api" Mar 16 16:12:13 crc kubenswrapper[5120]: I0316 16:12:13.410693 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="4fce708d-9952-41be-95e4-de815da4d75a" containerName="cinder-api" Mar 16 16:12:13 crc kubenswrapper[5120]: I0316 16:12:13.420454 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="4fce708d-9952-41be-95e4-de815da4d75a" containerName="cinder-api-log" Mar 16 16:12:13 crc kubenswrapper[5120]: I0316 16:12:13.420532 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="4fce708d-9952-41be-95e4-de815da4d75a" containerName="cinder-api" Mar 16 16:12:13 crc kubenswrapper[5120]: I0316 16:12:13.456264 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:12:13 crc kubenswrapper[5120]: I0316 16:12:13.471012 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-api-config-data\"" Mar 16 16:12:13 crc kubenswrapper[5120]: I0316 16:12:13.471287 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-cinder-public-svc\"" Mar 16 16:12:13 crc kubenswrapper[5120]: I0316 16:12:13.471371 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-cinder-internal-svc\"" Mar 16 16:12:13 crc kubenswrapper[5120]: I0316 16:12:13.476961 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:12:13 crc kubenswrapper[5120]: I0316 16:12:13.544974 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/88c64b50-c653-4d39-a87a-ac9a49eaf06e-scripts\") pod \"cinder-api-0\" (UID: \"88c64b50-c653-4d39-a87a-ac9a49eaf06e\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:12:13 crc kubenswrapper[5120]: I0316 16:12:13.545061 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/88c64b50-c653-4d39-a87a-ac9a49eaf06e-public-tls-certs\") pod \"cinder-api-0\" (UID: \"88c64b50-c653-4d39-a87a-ac9a49eaf06e\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:12:13 crc kubenswrapper[5120]: I0316 16:12:13.545101 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/88c64b50-c653-4d39-a87a-ac9a49eaf06e-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"88c64b50-c653-4d39-a87a-ac9a49eaf06e\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:12:13 crc kubenswrapper[5120]: I0316 16:12:13.545148 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/88c64b50-c653-4d39-a87a-ac9a49eaf06e-config-data-custom\") pod \"cinder-api-0\" (UID: \"88c64b50-c653-4d39-a87a-ac9a49eaf06e\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:12:13 crc kubenswrapper[5120]: I0316 16:12:13.545200 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/88c64b50-c653-4d39-a87a-ac9a49eaf06e-config-data\") pod \"cinder-api-0\" (UID: \"88c64b50-c653-4d39-a87a-ac9a49eaf06e\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:12:13 crc kubenswrapper[5120]: I0316 16:12:13.545284 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/88c64b50-c653-4d39-a87a-ac9a49eaf06e-etc-machine-id\") pod \"cinder-api-0\" (UID: \"88c64b50-c653-4d39-a87a-ac9a49eaf06e\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:12:13 crc kubenswrapper[5120]: I0316 16:12:13.545336 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqwkj\" (UniqueName: \"kubernetes.io/projected/88c64b50-c653-4d39-a87a-ac9a49eaf06e-kube-api-access-mqwkj\") pod \"cinder-api-0\" (UID: \"88c64b50-c653-4d39-a87a-ac9a49eaf06e\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:12:13 crc kubenswrapper[5120]: I0316 16:12:13.545394 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/88c64b50-c653-4d39-a87a-ac9a49eaf06e-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"88c64b50-c653-4d39-a87a-ac9a49eaf06e\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:12:13 crc kubenswrapper[5120]: I0316 16:12:13.545441 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/88c64b50-c653-4d39-a87a-ac9a49eaf06e-logs\") pod \"cinder-api-0\" (UID: \"88c64b50-c653-4d39-a87a-ac9a49eaf06e\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:12:13 crc kubenswrapper[5120]: I0316 16:12:13.647073 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mqwkj\" (UniqueName: \"kubernetes.io/projected/88c64b50-c653-4d39-a87a-ac9a49eaf06e-kube-api-access-mqwkj\") pod \"cinder-api-0\" (UID: \"88c64b50-c653-4d39-a87a-ac9a49eaf06e\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:12:13 crc kubenswrapper[5120]: I0316 16:12:13.647131 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/88c64b50-c653-4d39-a87a-ac9a49eaf06e-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"88c64b50-c653-4d39-a87a-ac9a49eaf06e\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:12:13 crc kubenswrapper[5120]: I0316 16:12:13.647169 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/88c64b50-c653-4d39-a87a-ac9a49eaf06e-logs\") pod \"cinder-api-0\" (UID: \"88c64b50-c653-4d39-a87a-ac9a49eaf06e\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:12:13 crc kubenswrapper[5120]: I0316 16:12:13.647224 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/88c64b50-c653-4d39-a87a-ac9a49eaf06e-scripts\") pod \"cinder-api-0\" (UID: \"88c64b50-c653-4d39-a87a-ac9a49eaf06e\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:12:13 crc kubenswrapper[5120]: I0316 16:12:13.647300 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/88c64b50-c653-4d39-a87a-ac9a49eaf06e-public-tls-certs\") pod \"cinder-api-0\" (UID: \"88c64b50-c653-4d39-a87a-ac9a49eaf06e\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:12:13 crc kubenswrapper[5120]: I0316 16:12:13.647340 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/88c64b50-c653-4d39-a87a-ac9a49eaf06e-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"88c64b50-c653-4d39-a87a-ac9a49eaf06e\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:12:13 crc kubenswrapper[5120]: I0316 16:12:13.647393 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/88c64b50-c653-4d39-a87a-ac9a49eaf06e-config-data-custom\") pod \"cinder-api-0\" (UID: \"88c64b50-c653-4d39-a87a-ac9a49eaf06e\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:12:13 crc kubenswrapper[5120]: I0316 16:12:13.647473 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/88c64b50-c653-4d39-a87a-ac9a49eaf06e-config-data\") pod \"cinder-api-0\" (UID: \"88c64b50-c653-4d39-a87a-ac9a49eaf06e\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:12:13 crc kubenswrapper[5120]: I0316 16:12:13.647602 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/88c64b50-c653-4d39-a87a-ac9a49eaf06e-etc-machine-id\") pod \"cinder-api-0\" (UID: \"88c64b50-c653-4d39-a87a-ac9a49eaf06e\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:12:13 crc kubenswrapper[5120]: I0316 16:12:13.647692 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/88c64b50-c653-4d39-a87a-ac9a49eaf06e-etc-machine-id\") pod \"cinder-api-0\" (UID: \"88c64b50-c653-4d39-a87a-ac9a49eaf06e\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:12:13 crc kubenswrapper[5120]: I0316 16:12:13.663374 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/88c64b50-c653-4d39-a87a-ac9a49eaf06e-scripts\") pod \"cinder-api-0\" (UID: \"88c64b50-c653-4d39-a87a-ac9a49eaf06e\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:12:13 crc kubenswrapper[5120]: I0316 16:12:13.664632 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/88c64b50-c653-4d39-a87a-ac9a49eaf06e-logs\") pod \"cinder-api-0\" (UID: \"88c64b50-c653-4d39-a87a-ac9a49eaf06e\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:12:13 crc kubenswrapper[5120]: I0316 16:12:13.668234 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/88c64b50-c653-4d39-a87a-ac9a49eaf06e-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"88c64b50-c653-4d39-a87a-ac9a49eaf06e\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:12:13 crc kubenswrapper[5120]: I0316 16:12:13.673743 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/88c64b50-c653-4d39-a87a-ac9a49eaf06e-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"88c64b50-c653-4d39-a87a-ac9a49eaf06e\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:12:13 crc kubenswrapper[5120]: I0316 16:12:13.674093 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqwkj\" (UniqueName: \"kubernetes.io/projected/88c64b50-c653-4d39-a87a-ac9a49eaf06e-kube-api-access-mqwkj\") pod \"cinder-api-0\" (UID: \"88c64b50-c653-4d39-a87a-ac9a49eaf06e\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:12:13 crc kubenswrapper[5120]: I0316 16:12:13.674695 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/88c64b50-c653-4d39-a87a-ac9a49eaf06e-public-tls-certs\") pod \"cinder-api-0\" (UID: \"88c64b50-c653-4d39-a87a-ac9a49eaf06e\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:12:13 crc kubenswrapper[5120]: I0316 16:12:13.700258 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/88c64b50-c653-4d39-a87a-ac9a49eaf06e-config-data-custom\") pod \"cinder-api-0\" (UID: \"88c64b50-c653-4d39-a87a-ac9a49eaf06e\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:12:13 crc kubenswrapper[5120]: I0316 16:12:13.701036 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/88c64b50-c653-4d39-a87a-ac9a49eaf06e-config-data\") pod \"cinder-api-0\" (UID: \"88c64b50-c653-4d39-a87a-ac9a49eaf06e\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:12:13 crc kubenswrapper[5120]: I0316 16:12:13.810468 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:12:14 crc kubenswrapper[5120]: I0316 16:12:14.181095 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5","Type":"ContainerStarted","Data":"da584e6bdd5f6d1ceaf64b1de15d36cf92d4ec19aa56b2e4705b2d6f7c89c834"} Mar 16 16:12:14 crc kubenswrapper[5120]: I0316 16:12:14.181963 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:12:14 crc kubenswrapper[5120]: I0316 16:12:14.211619 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-7cbc6f47fd-xhhn9" event={"ID":"28ea8203-158a-4c89-8ae6-647d230c21ff","Type":"ContainerStarted","Data":"5b0aa275ade968085f1b9c47c4e4571ba1ab8d6cb51953a996db3a2e2dc99e74"} Mar 16 16:12:14 crc kubenswrapper[5120]: I0316 16:12:14.237163 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-5566b7bdc5-47bld" event={"ID":"cb4b4078-46df-4b50-aa4a-81adbbd15e52","Type":"ContainerStarted","Data":"59d38b77c648623aa3b83892cf22dde220f840ba2589672899727a34b307c0ba"} Mar 16 16:12:14 crc kubenswrapper[5120]: I0316 16:12:14.237219 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-5566b7bdc5-47bld" event={"ID":"cb4b4078-46df-4b50-aa4a-81adbbd15e52","Type":"ContainerStarted","Data":"8728ba35424b9a5d8a4b3621d85384f1d6c8ad9d19138f32c2b737c7b57ac97b"} Mar 16 16:12:14 crc kubenswrapper[5120]: I0316 16:12:14.272929 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=3.6453412739999997 podStartE2EDuration="9.272909432s" podCreationTimestamp="2026-03-16 16:12:05 +0000 UTC" firstStartedPulling="2026-03-16 16:12:07.916297503 +0000 UTC m=+2430.070229160" lastFinishedPulling="2026-03-16 16:12:13.543865661 +0000 UTC m=+2435.697797318" observedRunningTime="2026-03-16 16:12:14.21200562 +0000 UTC m=+2436.365937277" watchObservedRunningTime="2026-03-16 16:12:14.272909432 +0000 UTC m=+2436.426841079" Mar 16 16:12:14 crc kubenswrapper[5120]: I0316 16:12:14.282313 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:12:14 crc kubenswrapper[5120]: I0316 16:12:14.408224 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/placement-6c44998f84-78gpn" Mar 16 16:12:14 crc kubenswrapper[5120]: I0316 16:12:14.478124 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:12:14 crc kubenswrapper[5120]: I0316 16:12:14.479020 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:12:14 crc kubenswrapper[5120]: I0316 16:12:14.545826 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:12:14 crc kubenswrapper[5120]: I0316 16:12:14.546363 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:12:14 crc kubenswrapper[5120]: I0316 16:12:14.676133 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4fce708d-9952-41be-95e4-de815da4d75a" path="/var/lib/kubelet/pods/4fce708d-9952-41be-95e4-de815da4d75a/volumes" Mar 16 16:12:14 crc kubenswrapper[5120]: I0316 16:12:14.680888 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:12:15 crc kubenswrapper[5120]: I0316 16:12:15.037474 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/placement-6c44998f84-78gpn" Mar 16 16:12:15 crc kubenswrapper[5120]: I0316 16:12:15.274992 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-7cbc6f47fd-xhhn9" event={"ID":"28ea8203-158a-4c89-8ae6-647d230c21ff","Type":"ContainerStarted","Data":"022fe2c06ece58fc57ef1d4dc8c366a6e5e260f72b9eaf2412cc117df1f26631"} Mar 16 16:12:15 crc kubenswrapper[5120]: I0316 16:12:15.287289 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-5566b7bdc5-47bld" event={"ID":"cb4b4078-46df-4b50-aa4a-81adbbd15e52","Type":"ContainerStarted","Data":"c6264f1560432f3ea47f3e712f72dc705f1d96eeaa1e8dbf34ce818578d90dc4"} Mar 16 16:12:15 crc kubenswrapper[5120]: I0316 16:12:15.290051 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"88c64b50-c653-4d39-a87a-ac9a49eaf06e","Type":"ContainerStarted","Data":"0e35b819aef3d4426a75fc7b3411f2f69295ee38a2b78d45c31f69922419379d"} Mar 16 16:12:15 crc kubenswrapper[5120]: I0316 16:12:15.296398 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-keystone-listener-7cbc6f47fd-xhhn9" podStartSLOduration=4.296384773 podStartE2EDuration="4.296384773s" podCreationTimestamp="2026-03-16 16:12:11 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:12:15.293638969 +0000 UTC m=+2437.447570626" watchObservedRunningTime="2026-03-16 16:12:15.296384773 +0000 UTC m=+2437.450316430" Mar 16 16:12:15 crc kubenswrapper[5120]: I0316 16:12:15.340553 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-worker-5566b7bdc5-47bld" podStartSLOduration=4.340536342 podStartE2EDuration="4.340536342s" podCreationTimestamp="2026-03-16 16:12:11 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:12:15.333130521 +0000 UTC m=+2437.487062178" watchObservedRunningTime="2026-03-16 16:12:15.340536342 +0000 UTC m=+2437.494467999" Mar 16 16:12:15 crc kubenswrapper[5120]: I0316 16:12:15.358976 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-999b785fd-fgwkp"] Mar 16 16:12:15 crc kubenswrapper[5120]: I0316 16:12:15.359294 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-999b785fd-fgwkp" podUID="e929a717-3e1e-4481-9e69-3705d47c1d87" containerName="barbican-keystone-listener-log" containerID="cri-o://ce61368d5cd8052546a7ed15f5aa10f7e088e78f6ddea239cb0d9b4ae4383626" gracePeriod=30 Mar 16 16:12:15 crc kubenswrapper[5120]: I0316 16:12:15.359698 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-999b785fd-fgwkp" podUID="e929a717-3e1e-4481-9e69-3705d47c1d87" containerName="barbican-keystone-listener" containerID="cri-o://757edeedd6106fcf5ec09e0e1ab4674498c354be39e305b54c20803a262a9fcf" gracePeriod=30 Mar 16 16:12:15 crc kubenswrapper[5120]: I0316 16:12:15.369525 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-5c69df9cf-mtvpx"] Mar 16 16:12:15 crc kubenswrapper[5120]: I0316 16:12:15.369726 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-5c69df9cf-mtvpx" podUID="4b1fbfd4-c276-42c0-8419-fbe793f89ad7" containerName="barbican-worker-log" containerID="cri-o://8e1c2b48df0636163c4f4b058904caa37d9e2fd89f8f859f7317813866b37ece" gracePeriod=30 Mar 16 16:12:15 crc kubenswrapper[5120]: I0316 16:12:15.370114 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-5c69df9cf-mtvpx" podUID="4b1fbfd4-c276-42c0-8419-fbe793f89ad7" containerName="barbican-worker" containerID="cri-o://6f4be8a5ecf88b8d0d422e8fabb7af3e217f95c44c7d86badc71a556e77761be" gracePeriod=30 Mar 16 16:12:15 crc kubenswrapper[5120]: I0316 16:12:15.418487 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:12:15 crc kubenswrapper[5120]: I0316 16:12:15.486029 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="10ec5605-2810-4b8c-9a6a-e5cfc3b33706" containerName="nova-api-api" probeResult="failure" output="Get \"https://10.217.0.155:8774/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Mar 16 16:12:15 crc kubenswrapper[5120]: I0316 16:12:15.488560 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="10ec5605-2810-4b8c-9a6a-e5cfc3b33706" containerName="nova-api-log" probeResult="failure" output="Get \"https://10.217.0.155:8774/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Mar 16 16:12:15 crc kubenswrapper[5120]: I0316 16:12:15.547231 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="17b2138c-b3ca-4538-a7d7-0dc6756650bf" containerName="nova-metadata-log" probeResult="failure" output="Get \"https://10.217.0.156:8775/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Mar 16 16:12:15 crc kubenswrapper[5120]: I0316 16:12:15.552474 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="17b2138c-b3ca-4538-a7d7-0dc6756650bf" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"https://10.217.0.156:8775/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 16:12:15 crc kubenswrapper[5120]: I0316 16:12:15.601195 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:12:15 crc kubenswrapper[5120]: I0316 16:12:15.800227 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-574f788578-gbqkk" Mar 16 16:12:15 crc kubenswrapper[5120]: I0316 16:12:15.913988 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/f632160f-f5b5-4ffe-be8e-798d54d5b530-ovndb-tls-certs\") pod \"f632160f-f5b5-4ffe-be8e-798d54d5b530\" (UID: \"f632160f-f5b5-4ffe-be8e-798d54d5b530\") " Mar 16 16:12:15 crc kubenswrapper[5120]: I0316 16:12:15.914402 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f632160f-f5b5-4ffe-be8e-798d54d5b530-config\") pod \"f632160f-f5b5-4ffe-be8e-798d54d5b530\" (UID: \"f632160f-f5b5-4ffe-be8e-798d54d5b530\") " Mar 16 16:12:15 crc kubenswrapper[5120]: I0316 16:12:15.914589 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f632160f-f5b5-4ffe-be8e-798d54d5b530-combined-ca-bundle\") pod \"f632160f-f5b5-4ffe-be8e-798d54d5b530\" (UID: \"f632160f-f5b5-4ffe-be8e-798d54d5b530\") " Mar 16 16:12:15 crc kubenswrapper[5120]: I0316 16:12:15.914646 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f632160f-f5b5-4ffe-be8e-798d54d5b530-public-tls-certs\") pod \"f632160f-f5b5-4ffe-be8e-798d54d5b530\" (UID: \"f632160f-f5b5-4ffe-be8e-798d54d5b530\") " Mar 16 16:12:15 crc kubenswrapper[5120]: I0316 16:12:15.914776 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q9wff\" (UniqueName: \"kubernetes.io/projected/f632160f-f5b5-4ffe-be8e-798d54d5b530-kube-api-access-q9wff\") pod \"f632160f-f5b5-4ffe-be8e-798d54d5b530\" (UID: \"f632160f-f5b5-4ffe-be8e-798d54d5b530\") " Mar 16 16:12:15 crc kubenswrapper[5120]: I0316 16:12:15.914904 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/f632160f-f5b5-4ffe-be8e-798d54d5b530-httpd-config\") pod \"f632160f-f5b5-4ffe-be8e-798d54d5b530\" (UID: \"f632160f-f5b5-4ffe-be8e-798d54d5b530\") " Mar 16 16:12:15 crc kubenswrapper[5120]: I0316 16:12:15.914930 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f632160f-f5b5-4ffe-be8e-798d54d5b530-internal-tls-certs\") pod \"f632160f-f5b5-4ffe-be8e-798d54d5b530\" (UID: \"f632160f-f5b5-4ffe-be8e-798d54d5b530\") " Mar 16 16:12:15 crc kubenswrapper[5120]: I0316 16:12:15.927899 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f632160f-f5b5-4ffe-be8e-798d54d5b530-httpd-config" (OuterVolumeSpecName: "httpd-config") pod "f632160f-f5b5-4ffe-be8e-798d54d5b530" (UID: "f632160f-f5b5-4ffe-be8e-798d54d5b530"). InnerVolumeSpecName "httpd-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:15 crc kubenswrapper[5120]: I0316 16:12:15.934839 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f632160f-f5b5-4ffe-be8e-798d54d5b530-kube-api-access-q9wff" (OuterVolumeSpecName: "kube-api-access-q9wff") pod "f632160f-f5b5-4ffe-be8e-798d54d5b530" (UID: "f632160f-f5b5-4ffe-be8e-798d54d5b530"). InnerVolumeSpecName "kube-api-access-q9wff". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:12:15 crc kubenswrapper[5120]: I0316 16:12:15.989019 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f632160f-f5b5-4ffe-be8e-798d54d5b530-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f632160f-f5b5-4ffe-be8e-798d54d5b530" (UID: "f632160f-f5b5-4ffe-be8e-798d54d5b530"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:16 crc kubenswrapper[5120]: I0316 16:12:16.011904 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f632160f-f5b5-4ffe-be8e-798d54d5b530-config" (OuterVolumeSpecName: "config") pod "f632160f-f5b5-4ffe-be8e-798d54d5b530" (UID: "f632160f-f5b5-4ffe-be8e-798d54d5b530"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:16 crc kubenswrapper[5120]: I0316 16:12:16.017675 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f632160f-f5b5-4ffe-be8e-798d54d5b530-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:16 crc kubenswrapper[5120]: I0316 16:12:16.017713 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q9wff\" (UniqueName: \"kubernetes.io/projected/f632160f-f5b5-4ffe-be8e-798d54d5b530-kube-api-access-q9wff\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:16 crc kubenswrapper[5120]: I0316 16:12:16.017725 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/f632160f-f5b5-4ffe-be8e-798d54d5b530-httpd-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:16 crc kubenswrapper[5120]: I0316 16:12:16.017736 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/f632160f-f5b5-4ffe-be8e-798d54d5b530-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:16 crc kubenswrapper[5120]: I0316 16:12:16.021504 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f632160f-f5b5-4ffe-be8e-798d54d5b530-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "f632160f-f5b5-4ffe-be8e-798d54d5b530" (UID: "f632160f-f5b5-4ffe-be8e-798d54d5b530"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:16 crc kubenswrapper[5120]: I0316 16:12:16.036010 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f632160f-f5b5-4ffe-be8e-798d54d5b530-ovndb-tls-certs" (OuterVolumeSpecName: "ovndb-tls-certs") pod "f632160f-f5b5-4ffe-be8e-798d54d5b530" (UID: "f632160f-f5b5-4ffe-be8e-798d54d5b530"). InnerVolumeSpecName "ovndb-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:16 crc kubenswrapper[5120]: I0316 16:12:16.047960 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f632160f-f5b5-4ffe-be8e-798d54d5b530-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "f632160f-f5b5-4ffe-be8e-798d54d5b530" (UID: "f632160f-f5b5-4ffe-be8e-798d54d5b530"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:16 crc kubenswrapper[5120]: I0316 16:12:16.119237 5120 reconciler_common.go:299] "Volume detached for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/f632160f-f5b5-4ffe-be8e-798d54d5b530-ovndb-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:16 crc kubenswrapper[5120]: I0316 16:12:16.119284 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f632160f-f5b5-4ffe-be8e-798d54d5b530-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:16 crc kubenswrapper[5120]: I0316 16:12:16.119298 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f632160f-f5b5-4ffe-be8e-798d54d5b530-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:16 crc kubenswrapper[5120]: I0316 16:12:16.313464 5120 generic.go:358] "Generic (PLEG): container finished" podID="4b1fbfd4-c276-42c0-8419-fbe793f89ad7" containerID="8e1c2b48df0636163c4f4b058904caa37d9e2fd89f8f859f7317813866b37ece" exitCode=143 Mar 16 16:12:16 crc kubenswrapper[5120]: I0316 16:12:16.313886 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-5c69df9cf-mtvpx" event={"ID":"4b1fbfd4-c276-42c0-8419-fbe793f89ad7","Type":"ContainerDied","Data":"8e1c2b48df0636163c4f4b058904caa37d9e2fd89f8f859f7317813866b37ece"} Mar 16 16:12:16 crc kubenswrapper[5120]: I0316 16:12:16.333276 5120 generic.go:358] "Generic (PLEG): container finished" podID="e929a717-3e1e-4481-9e69-3705d47c1d87" containerID="ce61368d5cd8052546a7ed15f5aa10f7e088e78f6ddea239cb0d9b4ae4383626" exitCode=143 Mar 16 16:12:16 crc kubenswrapper[5120]: I0316 16:12:16.333372 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-999b785fd-fgwkp" event={"ID":"e929a717-3e1e-4481-9e69-3705d47c1d87","Type":"ContainerDied","Data":"ce61368d5cd8052546a7ed15f5aa10f7e088e78f6ddea239cb0d9b4ae4383626"} Mar 16 16:12:16 crc kubenswrapper[5120]: I0316 16:12:16.345813 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"88c64b50-c653-4d39-a87a-ac9a49eaf06e","Type":"ContainerStarted","Data":"eb495c2e7830f9730c3d0cdf54a0d0956d58edbd9ce6ca99ce491ce9855f3e3d"} Mar 16 16:12:16 crc kubenswrapper[5120]: I0316 16:12:16.352335 5120 generic.go:358] "Generic (PLEG): container finished" podID="f632160f-f5b5-4ffe-be8e-798d54d5b530" containerID="b8c747755c95c125fe33105920ff58829e6a9d33efdbda08966390674c74e4e1" exitCode=0 Mar 16 16:12:16 crc kubenswrapper[5120]: I0316 16:12:16.352719 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-574f788578-gbqkk" event={"ID":"f632160f-f5b5-4ffe-be8e-798d54d5b530","Type":"ContainerDied","Data":"b8c747755c95c125fe33105920ff58829e6a9d33efdbda08966390674c74e4e1"} Mar 16 16:12:16 crc kubenswrapper[5120]: I0316 16:12:16.352801 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-574f788578-gbqkk" event={"ID":"f632160f-f5b5-4ffe-be8e-798d54d5b530","Type":"ContainerDied","Data":"bb47e8ff143b7ef37f7b713f8840e2b10d5ef6416c132211b4f7e7bdfc4df094"} Mar 16 16:12:16 crc kubenswrapper[5120]: I0316 16:12:16.352824 5120 scope.go:117] "RemoveContainer" containerID="cc88aafe27855d27722c7a0a73e087a02562cfb1c968f5c4c5ecf7a927b36c24" Mar 16 16:12:16 crc kubenswrapper[5120]: I0316 16:12:16.352955 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-574f788578-gbqkk" Mar 16 16:12:16 crc kubenswrapper[5120]: I0316 16:12:16.389809 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-574f788578-gbqkk"] Mar 16 16:12:16 crc kubenswrapper[5120]: I0316 16:12:16.401593 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-574f788578-gbqkk"] Mar 16 16:12:16 crc kubenswrapper[5120]: I0316 16:12:16.430557 5120 scope.go:117] "RemoveContainer" containerID="b8c747755c95c125fe33105920ff58829e6a9d33efdbda08966390674c74e4e1" Mar 16 16:12:16 crc kubenswrapper[5120]: I0316 16:12:16.487378 5120 scope.go:117] "RemoveContainer" containerID="cc88aafe27855d27722c7a0a73e087a02562cfb1c968f5c4c5ecf7a927b36c24" Mar 16 16:12:16 crc kubenswrapper[5120]: E0316 16:12:16.488105 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc88aafe27855d27722c7a0a73e087a02562cfb1c968f5c4c5ecf7a927b36c24\": container with ID starting with cc88aafe27855d27722c7a0a73e087a02562cfb1c968f5c4c5ecf7a927b36c24 not found: ID does not exist" containerID="cc88aafe27855d27722c7a0a73e087a02562cfb1c968f5c4c5ecf7a927b36c24" Mar 16 16:12:16 crc kubenswrapper[5120]: I0316 16:12:16.488134 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc88aafe27855d27722c7a0a73e087a02562cfb1c968f5c4c5ecf7a927b36c24"} err="failed to get container status \"cc88aafe27855d27722c7a0a73e087a02562cfb1c968f5c4c5ecf7a927b36c24\": rpc error: code = NotFound desc = could not find container \"cc88aafe27855d27722c7a0a73e087a02562cfb1c968f5c4c5ecf7a927b36c24\": container with ID starting with cc88aafe27855d27722c7a0a73e087a02562cfb1c968f5c4c5ecf7a927b36c24 not found: ID does not exist" Mar 16 16:12:16 crc kubenswrapper[5120]: I0316 16:12:16.488153 5120 scope.go:117] "RemoveContainer" containerID="b8c747755c95c125fe33105920ff58829e6a9d33efdbda08966390674c74e4e1" Mar 16 16:12:16 crc kubenswrapper[5120]: E0316 16:12:16.488510 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b8c747755c95c125fe33105920ff58829e6a9d33efdbda08966390674c74e4e1\": container with ID starting with b8c747755c95c125fe33105920ff58829e6a9d33efdbda08966390674c74e4e1 not found: ID does not exist" containerID="b8c747755c95c125fe33105920ff58829e6a9d33efdbda08966390674c74e4e1" Mar 16 16:12:16 crc kubenswrapper[5120]: I0316 16:12:16.488553 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8c747755c95c125fe33105920ff58829e6a9d33efdbda08966390674c74e4e1"} err="failed to get container status \"b8c747755c95c125fe33105920ff58829e6a9d33efdbda08966390674c74e4e1\": rpc error: code = NotFound desc = could not find container \"b8c747755c95c125fe33105920ff58829e6a9d33efdbda08966390674c74e4e1\": container with ID starting with b8c747755c95c125fe33105920ff58829e6a9d33efdbda08966390674c74e4e1 not found: ID does not exist" Mar 16 16:12:16 crc kubenswrapper[5120]: I0316 16:12:16.703025 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f632160f-f5b5-4ffe-be8e-798d54d5b530" path="/var/lib/kubelet/pods/f632160f-f5b5-4ffe-be8e-798d54d5b530/volumes" Mar 16 16:12:16 crc kubenswrapper[5120]: I0316 16:12:16.856090 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:12:16 crc kubenswrapper[5120]: I0316 16:12:16.920447 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:12:16 crc kubenswrapper[5120]: I0316 16:12:16.969122 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-999b785fd-fgwkp" Mar 16 16:12:17 crc kubenswrapper[5120]: I0316 16:12:17.053343 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e929a717-3e1e-4481-9e69-3705d47c1d87-logs\") pod \"e929a717-3e1e-4481-9e69-3705d47c1d87\" (UID: \"e929a717-3e1e-4481-9e69-3705d47c1d87\") " Mar 16 16:12:17 crc kubenswrapper[5120]: I0316 16:12:17.053777 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e929a717-3e1e-4481-9e69-3705d47c1d87-combined-ca-bundle\") pod \"e929a717-3e1e-4481-9e69-3705d47c1d87\" (UID: \"e929a717-3e1e-4481-9e69-3705d47c1d87\") " Mar 16 16:12:17 crc kubenswrapper[5120]: I0316 16:12:17.053856 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dpzjx\" (UniqueName: \"kubernetes.io/projected/e929a717-3e1e-4481-9e69-3705d47c1d87-kube-api-access-dpzjx\") pod \"e929a717-3e1e-4481-9e69-3705d47c1d87\" (UID: \"e929a717-3e1e-4481-9e69-3705d47c1d87\") " Mar 16 16:12:17 crc kubenswrapper[5120]: I0316 16:12:17.053969 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/e929a717-3e1e-4481-9e69-3705d47c1d87-config-data-custom\") pod \"e929a717-3e1e-4481-9e69-3705d47c1d87\" (UID: \"e929a717-3e1e-4481-9e69-3705d47c1d87\") " Mar 16 16:12:17 crc kubenswrapper[5120]: I0316 16:12:17.054211 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e929a717-3e1e-4481-9e69-3705d47c1d87-config-data\") pod \"e929a717-3e1e-4481-9e69-3705d47c1d87\" (UID: \"e929a717-3e1e-4481-9e69-3705d47c1d87\") " Mar 16 16:12:17 crc kubenswrapper[5120]: I0316 16:12:17.055040 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e929a717-3e1e-4481-9e69-3705d47c1d87-logs" (OuterVolumeSpecName: "logs") pod "e929a717-3e1e-4481-9e69-3705d47c1d87" (UID: "e929a717-3e1e-4481-9e69-3705d47c1d87"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:12:17 crc kubenswrapper[5120]: I0316 16:12:17.060178 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e929a717-3e1e-4481-9e69-3705d47c1d87-kube-api-access-dpzjx" (OuterVolumeSpecName: "kube-api-access-dpzjx") pod "e929a717-3e1e-4481-9e69-3705d47c1d87" (UID: "e929a717-3e1e-4481-9e69-3705d47c1d87"). InnerVolumeSpecName "kube-api-access-dpzjx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:12:17 crc kubenswrapper[5120]: I0316 16:12:17.072783 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e929a717-3e1e-4481-9e69-3705d47c1d87-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "e929a717-3e1e-4481-9e69-3705d47c1d87" (UID: "e929a717-3e1e-4481-9e69-3705d47c1d87"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:17 crc kubenswrapper[5120]: I0316 16:12:17.110310 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e929a717-3e1e-4481-9e69-3705d47c1d87-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e929a717-3e1e-4481-9e69-3705d47c1d87" (UID: "e929a717-3e1e-4481-9e69-3705d47c1d87"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:17 crc kubenswrapper[5120]: I0316 16:12:17.160786 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e929a717-3e1e-4481-9e69-3705d47c1d87-config-data" (OuterVolumeSpecName: "config-data") pod "e929a717-3e1e-4481-9e69-3705d47c1d87" (UID: "e929a717-3e1e-4481-9e69-3705d47c1d87"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:17 crc kubenswrapper[5120]: I0316 16:12:17.164565 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/e929a717-3e1e-4481-9e69-3705d47c1d87-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:17 crc kubenswrapper[5120]: I0316 16:12:17.164611 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e929a717-3e1e-4481-9e69-3705d47c1d87-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:17 crc kubenswrapper[5120]: I0316 16:12:17.164626 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e929a717-3e1e-4481-9e69-3705d47c1d87-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:17 crc kubenswrapper[5120]: I0316 16:12:17.164635 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e929a717-3e1e-4481-9e69-3705d47c1d87-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:17 crc kubenswrapper[5120]: I0316 16:12:17.164643 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dpzjx\" (UniqueName: \"kubernetes.io/projected/e929a717-3e1e-4481-9e69-3705d47c1d87-kube-api-access-dpzjx\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:17 crc kubenswrapper[5120]: I0316 16:12:17.264563 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-5c69df9cf-mtvpx" Mar 16 16:12:17 crc kubenswrapper[5120]: E0316 16:12:17.317458 5120 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4b1fbfd4_c276_42c0_8419_fbe793f89ad7.slice/crio-conmon-6f4be8a5ecf88b8d0d422e8fabb7af3e217f95c44c7d86badc71a556e77761be.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4b1fbfd4_c276_42c0_8419_fbe793f89ad7.slice/crio-6f4be8a5ecf88b8d0d422e8fabb7af3e217f95c44c7d86badc71a556e77761be.scope\": RecentStats: unable to find data in memory cache]" Mar 16 16:12:17 crc kubenswrapper[5120]: I0316 16:12:17.367567 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4b1fbfd4-c276-42c0-8419-fbe793f89ad7-logs\") pod \"4b1fbfd4-c276-42c0-8419-fbe793f89ad7\" (UID: \"4b1fbfd4-c276-42c0-8419-fbe793f89ad7\") " Mar 16 16:12:17 crc kubenswrapper[5120]: I0316 16:12:17.368107 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-75xjs\" (UniqueName: \"kubernetes.io/projected/4b1fbfd4-c276-42c0-8419-fbe793f89ad7-kube-api-access-75xjs\") pod \"4b1fbfd4-c276-42c0-8419-fbe793f89ad7\" (UID: \"4b1fbfd4-c276-42c0-8419-fbe793f89ad7\") " Mar 16 16:12:17 crc kubenswrapper[5120]: I0316 16:12:17.368177 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4b1fbfd4-c276-42c0-8419-fbe793f89ad7-config-data\") pod \"4b1fbfd4-c276-42c0-8419-fbe793f89ad7\" (UID: \"4b1fbfd4-c276-42c0-8419-fbe793f89ad7\") " Mar 16 16:12:17 crc kubenswrapper[5120]: I0316 16:12:17.368336 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b1fbfd4-c276-42c0-8419-fbe793f89ad7-logs" (OuterVolumeSpecName: "logs") pod "4b1fbfd4-c276-42c0-8419-fbe793f89ad7" (UID: "4b1fbfd4-c276-42c0-8419-fbe793f89ad7"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:12:17 crc kubenswrapper[5120]: I0316 16:12:17.368981 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/4b1fbfd4-c276-42c0-8419-fbe793f89ad7-config-data-custom\") pod \"4b1fbfd4-c276-42c0-8419-fbe793f89ad7\" (UID: \"4b1fbfd4-c276-42c0-8419-fbe793f89ad7\") " Mar 16 16:12:17 crc kubenswrapper[5120]: I0316 16:12:17.369129 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4b1fbfd4-c276-42c0-8419-fbe793f89ad7-combined-ca-bundle\") pod \"4b1fbfd4-c276-42c0-8419-fbe793f89ad7\" (UID: \"4b1fbfd4-c276-42c0-8419-fbe793f89ad7\") " Mar 16 16:12:17 crc kubenswrapper[5120]: I0316 16:12:17.369666 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4b1fbfd4-c276-42c0-8419-fbe793f89ad7-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:17 crc kubenswrapper[5120]: I0316 16:12:17.374418 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b1fbfd4-c276-42c0-8419-fbe793f89ad7-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "4b1fbfd4-c276-42c0-8419-fbe793f89ad7" (UID: "4b1fbfd4-c276-42c0-8419-fbe793f89ad7"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:17 crc kubenswrapper[5120]: I0316 16:12:17.375213 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b1fbfd4-c276-42c0-8419-fbe793f89ad7-kube-api-access-75xjs" (OuterVolumeSpecName: "kube-api-access-75xjs") pod "4b1fbfd4-c276-42c0-8419-fbe793f89ad7" (UID: "4b1fbfd4-c276-42c0-8419-fbe793f89ad7"). InnerVolumeSpecName "kube-api-access-75xjs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:12:17 crc kubenswrapper[5120]: I0316 16:12:17.377704 5120 generic.go:358] "Generic (PLEG): container finished" podID="4b1fbfd4-c276-42c0-8419-fbe793f89ad7" containerID="6f4be8a5ecf88b8d0d422e8fabb7af3e217f95c44c7d86badc71a556e77761be" exitCode=0 Mar 16 16:12:17 crc kubenswrapper[5120]: I0316 16:12:17.377783 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-5c69df9cf-mtvpx" event={"ID":"4b1fbfd4-c276-42c0-8419-fbe793f89ad7","Type":"ContainerDied","Data":"6f4be8a5ecf88b8d0d422e8fabb7af3e217f95c44c7d86badc71a556e77761be"} Mar 16 16:12:17 crc kubenswrapper[5120]: I0316 16:12:17.377806 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-5c69df9cf-mtvpx" Mar 16 16:12:17 crc kubenswrapper[5120]: I0316 16:12:17.377821 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-5c69df9cf-mtvpx" event={"ID":"4b1fbfd4-c276-42c0-8419-fbe793f89ad7","Type":"ContainerDied","Data":"1fdc2b81bfeaead5ce02246204e3f304d116b307daff3082676038ab2e1ed81b"} Mar 16 16:12:17 crc kubenswrapper[5120]: I0316 16:12:17.377839 5120 scope.go:117] "RemoveContainer" containerID="6f4be8a5ecf88b8d0d422e8fabb7af3e217f95c44c7d86badc71a556e77761be" Mar 16 16:12:17 crc kubenswrapper[5120]: I0316 16:12:17.397985 5120 generic.go:358] "Generic (PLEG): container finished" podID="e929a717-3e1e-4481-9e69-3705d47c1d87" containerID="757edeedd6106fcf5ec09e0e1ab4674498c354be39e305b54c20803a262a9fcf" exitCode=0 Mar 16 16:12:17 crc kubenswrapper[5120]: I0316 16:12:17.398084 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-999b785fd-fgwkp" event={"ID":"e929a717-3e1e-4481-9e69-3705d47c1d87","Type":"ContainerDied","Data":"757edeedd6106fcf5ec09e0e1ab4674498c354be39e305b54c20803a262a9fcf"} Mar 16 16:12:17 crc kubenswrapper[5120]: I0316 16:12:17.398117 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-999b785fd-fgwkp" event={"ID":"e929a717-3e1e-4481-9e69-3705d47c1d87","Type":"ContainerDied","Data":"0d48afeb256429b8b15505c6fa4da3b28f0d520d9c36f9564e1f2fa7d9beb6cc"} Mar 16 16:12:17 crc kubenswrapper[5120]: I0316 16:12:17.398280 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-999b785fd-fgwkp" Mar 16 16:12:17 crc kubenswrapper[5120]: I0316 16:12:17.405514 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"88c64b50-c653-4d39-a87a-ac9a49eaf06e","Type":"ContainerStarted","Data":"259a1c164b3bbbddd52006aa2c23dfa16d68542525700e849cf3e51465cc36d9"} Mar 16 16:12:17 crc kubenswrapper[5120]: I0316 16:12:17.405629 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:12:17 crc kubenswrapper[5120]: I0316 16:12:17.435014 5120 scope.go:117] "RemoveContainer" containerID="8e1c2b48df0636163c4f4b058904caa37d9e2fd89f8f859f7317813866b37ece" Mar 16 16:12:17 crc kubenswrapper[5120]: I0316 16:12:17.452454 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-api-0" podStartSLOduration=4.452433305 podStartE2EDuration="4.452433305s" podCreationTimestamp="2026-03-16 16:12:13 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:12:17.435441354 +0000 UTC m=+2439.589373021" watchObservedRunningTime="2026-03-16 16:12:17.452433305 +0000 UTC m=+2439.606364962" Mar 16 16:12:17 crc kubenswrapper[5120]: I0316 16:12:17.454167 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:12:17 crc kubenswrapper[5120]: I0316 16:12:17.454682 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b1fbfd4-c276-42c0-8419-fbe793f89ad7-config-data" (OuterVolumeSpecName: "config-data") pod "4b1fbfd4-c276-42c0-8419-fbe793f89ad7" (UID: "4b1fbfd4-c276-42c0-8419-fbe793f89ad7"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:17 crc kubenswrapper[5120]: I0316 16:12:17.457285 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b1fbfd4-c276-42c0-8419-fbe793f89ad7-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "4b1fbfd4-c276-42c0-8419-fbe793f89ad7" (UID: "4b1fbfd4-c276-42c0-8419-fbe793f89ad7"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:17 crc kubenswrapper[5120]: I0316 16:12:17.471602 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-75xjs\" (UniqueName: \"kubernetes.io/projected/4b1fbfd4-c276-42c0-8419-fbe793f89ad7-kube-api-access-75xjs\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:17 crc kubenswrapper[5120]: I0316 16:12:17.471633 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4b1fbfd4-c276-42c0-8419-fbe793f89ad7-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:17 crc kubenswrapper[5120]: I0316 16:12:17.471642 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/4b1fbfd4-c276-42c0-8419-fbe793f89ad7-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:17 crc kubenswrapper[5120]: I0316 16:12:17.471652 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4b1fbfd4-c276-42c0-8419-fbe793f89ad7-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:17 crc kubenswrapper[5120]: I0316 16:12:17.497911 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-999b785fd-fgwkp"] Mar 16 16:12:17 crc kubenswrapper[5120]: I0316 16:12:17.516558 5120 scope.go:117] "RemoveContainer" containerID="6f4be8a5ecf88b8d0d422e8fabb7af3e217f95c44c7d86badc71a556e77761be" Mar 16 16:12:17 crc kubenswrapper[5120]: E0316 16:12:17.517618 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f4be8a5ecf88b8d0d422e8fabb7af3e217f95c44c7d86badc71a556e77761be\": container with ID starting with 6f4be8a5ecf88b8d0d422e8fabb7af3e217f95c44c7d86badc71a556e77761be not found: ID does not exist" containerID="6f4be8a5ecf88b8d0d422e8fabb7af3e217f95c44c7d86badc71a556e77761be" Mar 16 16:12:17 crc kubenswrapper[5120]: I0316 16:12:17.517652 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f4be8a5ecf88b8d0d422e8fabb7af3e217f95c44c7d86badc71a556e77761be"} err="failed to get container status \"6f4be8a5ecf88b8d0d422e8fabb7af3e217f95c44c7d86badc71a556e77761be\": rpc error: code = NotFound desc = could not find container \"6f4be8a5ecf88b8d0d422e8fabb7af3e217f95c44c7d86badc71a556e77761be\": container with ID starting with 6f4be8a5ecf88b8d0d422e8fabb7af3e217f95c44c7d86badc71a556e77761be not found: ID does not exist" Mar 16 16:12:17 crc kubenswrapper[5120]: I0316 16:12:17.517669 5120 scope.go:117] "RemoveContainer" containerID="8e1c2b48df0636163c4f4b058904caa37d9e2fd89f8f859f7317813866b37ece" Mar 16 16:12:17 crc kubenswrapper[5120]: E0316 16:12:17.518051 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e1c2b48df0636163c4f4b058904caa37d9e2fd89f8f859f7317813866b37ece\": container with ID starting with 8e1c2b48df0636163c4f4b058904caa37d9e2fd89f8f859f7317813866b37ece not found: ID does not exist" containerID="8e1c2b48df0636163c4f4b058904caa37d9e2fd89f8f859f7317813866b37ece" Mar 16 16:12:17 crc kubenswrapper[5120]: I0316 16:12:17.518077 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e1c2b48df0636163c4f4b058904caa37d9e2fd89f8f859f7317813866b37ece"} err="failed to get container status \"8e1c2b48df0636163c4f4b058904caa37d9e2fd89f8f859f7317813866b37ece\": rpc error: code = NotFound desc = could not find container \"8e1c2b48df0636163c4f4b058904caa37d9e2fd89f8f859f7317813866b37ece\": container with ID starting with 8e1c2b48df0636163c4f4b058904caa37d9e2fd89f8f859f7317813866b37ece not found: ID does not exist" Mar 16 16:12:17 crc kubenswrapper[5120]: I0316 16:12:17.518090 5120 scope.go:117] "RemoveContainer" containerID="757edeedd6106fcf5ec09e0e1ab4674498c354be39e305b54c20803a262a9fcf" Mar 16 16:12:17 crc kubenswrapper[5120]: I0316 16:12:17.521164 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-999b785fd-fgwkp"] Mar 16 16:12:17 crc kubenswrapper[5120]: I0316 16:12:17.548456 5120 scope.go:117] "RemoveContainer" containerID="ce61368d5cd8052546a7ed15f5aa10f7e088e78f6ddea239cb0d9b4ae4383626" Mar 16 16:12:17 crc kubenswrapper[5120]: I0316 16:12:17.579001 5120 scope.go:117] "RemoveContainer" containerID="757edeedd6106fcf5ec09e0e1ab4674498c354be39e305b54c20803a262a9fcf" Mar 16 16:12:17 crc kubenswrapper[5120]: E0316 16:12:17.579458 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"757edeedd6106fcf5ec09e0e1ab4674498c354be39e305b54c20803a262a9fcf\": container with ID starting with 757edeedd6106fcf5ec09e0e1ab4674498c354be39e305b54c20803a262a9fcf not found: ID does not exist" containerID="757edeedd6106fcf5ec09e0e1ab4674498c354be39e305b54c20803a262a9fcf" Mar 16 16:12:17 crc kubenswrapper[5120]: I0316 16:12:17.579498 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"757edeedd6106fcf5ec09e0e1ab4674498c354be39e305b54c20803a262a9fcf"} err="failed to get container status \"757edeedd6106fcf5ec09e0e1ab4674498c354be39e305b54c20803a262a9fcf\": rpc error: code = NotFound desc = could not find container \"757edeedd6106fcf5ec09e0e1ab4674498c354be39e305b54c20803a262a9fcf\": container with ID starting with 757edeedd6106fcf5ec09e0e1ab4674498c354be39e305b54c20803a262a9fcf not found: ID does not exist" Mar 16 16:12:17 crc kubenswrapper[5120]: I0316 16:12:17.579523 5120 scope.go:117] "RemoveContainer" containerID="ce61368d5cd8052546a7ed15f5aa10f7e088e78f6ddea239cb0d9b4ae4383626" Mar 16 16:12:17 crc kubenswrapper[5120]: E0316 16:12:17.579978 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce61368d5cd8052546a7ed15f5aa10f7e088e78f6ddea239cb0d9b4ae4383626\": container with ID starting with ce61368d5cd8052546a7ed15f5aa10f7e088e78f6ddea239cb0d9b4ae4383626 not found: ID does not exist" containerID="ce61368d5cd8052546a7ed15f5aa10f7e088e78f6ddea239cb0d9b4ae4383626" Mar 16 16:12:17 crc kubenswrapper[5120]: I0316 16:12:17.580009 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce61368d5cd8052546a7ed15f5aa10f7e088e78f6ddea239cb0d9b4ae4383626"} err="failed to get container status \"ce61368d5cd8052546a7ed15f5aa10f7e088e78f6ddea239cb0d9b4ae4383626\": rpc error: code = NotFound desc = could not find container \"ce61368d5cd8052546a7ed15f5aa10f7e088e78f6ddea239cb0d9b4ae4383626\": container with ID starting with ce61368d5cd8052546a7ed15f5aa10f7e088e78f6ddea239cb0d9b4ae4383626 not found: ID does not exist" Mar 16 16:12:17 crc kubenswrapper[5120]: I0316 16:12:17.730631 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-5c69df9cf-mtvpx"] Mar 16 16:12:17 crc kubenswrapper[5120]: I0316 16:12:17.740566 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-worker-5c69df9cf-mtvpx"] Mar 16 16:12:17 crc kubenswrapper[5120]: I0316 16:12:17.849204 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/root-account-create-update-5h578"] Mar 16 16:12:17 crc kubenswrapper[5120]: I0316 16:12:17.850535 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b1fbfd4-c276-42c0-8419-fbe793f89ad7" containerName="barbican-worker-log" Mar 16 16:12:17 crc kubenswrapper[5120]: I0316 16:12:17.850563 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b1fbfd4-c276-42c0-8419-fbe793f89ad7" containerName="barbican-worker-log" Mar 16 16:12:17 crc kubenswrapper[5120]: I0316 16:12:17.850582 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e929a717-3e1e-4481-9e69-3705d47c1d87" containerName="barbican-keystone-listener" Mar 16 16:12:17 crc kubenswrapper[5120]: I0316 16:12:17.850592 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e929a717-3e1e-4481-9e69-3705d47c1d87" containerName="barbican-keystone-listener" Mar 16 16:12:17 crc kubenswrapper[5120]: I0316 16:12:17.850622 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b1fbfd4-c276-42c0-8419-fbe793f89ad7" containerName="barbican-worker" Mar 16 16:12:17 crc kubenswrapper[5120]: I0316 16:12:17.850633 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b1fbfd4-c276-42c0-8419-fbe793f89ad7" containerName="barbican-worker" Mar 16 16:12:17 crc kubenswrapper[5120]: I0316 16:12:17.850661 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f632160f-f5b5-4ffe-be8e-798d54d5b530" containerName="neutron-httpd" Mar 16 16:12:17 crc kubenswrapper[5120]: I0316 16:12:17.850669 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f632160f-f5b5-4ffe-be8e-798d54d5b530" containerName="neutron-httpd" Mar 16 16:12:17 crc kubenswrapper[5120]: I0316 16:12:17.850727 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f632160f-f5b5-4ffe-be8e-798d54d5b530" containerName="neutron-api" Mar 16 16:12:17 crc kubenswrapper[5120]: I0316 16:12:17.850737 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f632160f-f5b5-4ffe-be8e-798d54d5b530" containerName="neutron-api" Mar 16 16:12:17 crc kubenswrapper[5120]: I0316 16:12:17.850815 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e929a717-3e1e-4481-9e69-3705d47c1d87" containerName="barbican-keystone-listener-log" Mar 16 16:12:17 crc kubenswrapper[5120]: I0316 16:12:17.850826 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e929a717-3e1e-4481-9e69-3705d47c1d87" containerName="barbican-keystone-listener-log" Mar 16 16:12:17 crc kubenswrapper[5120]: I0316 16:12:17.851024 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e929a717-3e1e-4481-9e69-3705d47c1d87" containerName="barbican-keystone-listener" Mar 16 16:12:17 crc kubenswrapper[5120]: I0316 16:12:17.851051 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="4b1fbfd4-c276-42c0-8419-fbe793f89ad7" containerName="barbican-worker-log" Mar 16 16:12:17 crc kubenswrapper[5120]: I0316 16:12:17.851066 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f632160f-f5b5-4ffe-be8e-798d54d5b530" containerName="neutron-httpd" Mar 16 16:12:17 crc kubenswrapper[5120]: I0316 16:12:17.851085 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e929a717-3e1e-4481-9e69-3705d47c1d87" containerName="barbican-keystone-listener-log" Mar 16 16:12:17 crc kubenswrapper[5120]: I0316 16:12:17.851097 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f632160f-f5b5-4ffe-be8e-798d54d5b530" containerName="neutron-api" Mar 16 16:12:17 crc kubenswrapper[5120]: I0316 16:12:17.851112 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="4b1fbfd4-c276-42c0-8419-fbe793f89ad7" containerName="barbican-worker" Mar 16 16:12:17 crc kubenswrapper[5120]: I0316 16:12:17.863150 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-5h578" Mar 16 16:12:17 crc kubenswrapper[5120]: I0316 16:12:17.868175 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"openstack-cell1-mariadb-root-db-secret\"" Mar 16 16:12:17 crc kubenswrapper[5120]: I0316 16:12:17.881889 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c959g\" (UniqueName: \"kubernetes.io/projected/60e80199-56f5-4a0c-b023-da9c28b1051f-kube-api-access-c959g\") pod \"root-account-create-update-5h578\" (UID: \"60e80199-56f5-4a0c-b023-da9c28b1051f\") " pod="openstack-kuttl-tests/root-account-create-update-5h578" Mar 16 16:12:17 crc kubenswrapper[5120]: I0316 16:12:17.881940 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/60e80199-56f5-4a0c-b023-da9c28b1051f-operator-scripts\") pod \"root-account-create-update-5h578\" (UID: \"60e80199-56f5-4a0c-b023-da9c28b1051f\") " pod="openstack-kuttl-tests/root-account-create-update-5h578" Mar 16 16:12:17 crc kubenswrapper[5120]: I0316 16:12:17.895520 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-5h578"] Mar 16 16:12:17 crc kubenswrapper[5120]: I0316 16:12:17.984244 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c959g\" (UniqueName: \"kubernetes.io/projected/60e80199-56f5-4a0c-b023-da9c28b1051f-kube-api-access-c959g\") pod \"root-account-create-update-5h578\" (UID: \"60e80199-56f5-4a0c-b023-da9c28b1051f\") " pod="openstack-kuttl-tests/root-account-create-update-5h578" Mar 16 16:12:17 crc kubenswrapper[5120]: I0316 16:12:17.984300 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/60e80199-56f5-4a0c-b023-da9c28b1051f-operator-scripts\") pod \"root-account-create-update-5h578\" (UID: \"60e80199-56f5-4a0c-b023-da9c28b1051f\") " pod="openstack-kuttl-tests/root-account-create-update-5h578" Mar 16 16:12:17 crc kubenswrapper[5120]: I0316 16:12:17.985065 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/60e80199-56f5-4a0c-b023-da9c28b1051f-operator-scripts\") pod \"root-account-create-update-5h578\" (UID: \"60e80199-56f5-4a0c-b023-da9c28b1051f\") " pod="openstack-kuttl-tests/root-account-create-update-5h578" Mar 16 16:12:17 crc kubenswrapper[5120]: I0316 16:12:17.996802 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 16:12:18 crc kubenswrapper[5120]: I0316 16:12:18.020597 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c959g\" (UniqueName: \"kubernetes.io/projected/60e80199-56f5-4a0c-b023-da9c28b1051f-kube-api-access-c959g\") pod \"root-account-create-update-5h578\" (UID: \"60e80199-56f5-4a0c-b023-da9c28b1051f\") " pod="openstack-kuttl-tests/root-account-create-update-5h578" Mar 16 16:12:18 crc kubenswrapper[5120]: I0316 16:12:18.037916 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-zx8b6"] Mar 16 16:12:18 crc kubenswrapper[5120]: I0316 16:12:18.059817 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-zx8b6"] Mar 16 16:12:18 crc kubenswrapper[5120]: I0316 16:12:18.077510 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 16:12:18 crc kubenswrapper[5120]: I0316 16:12:18.077769 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/openstackclient" podUID="a8389bad-6789-42fe-8506-5ac83ff9514f" containerName="openstackclient" containerID="cri-o://2fa42e597db80f165871a57845e4e2ef64e3229a4086efd36ecbeea07cd1fa0c" gracePeriod=2 Mar 16 16:12:18 crc kubenswrapper[5120]: I0316 16:12:18.086908 5120 status_manager.go:895] "Failed to get status for pod" podUID="a8389bad-6789-42fe-8506-5ac83ff9514f" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 16:12:18 crc kubenswrapper[5120]: I0316 16:12:18.107256 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 16:12:18 crc kubenswrapper[5120]: I0316 16:12:18.118457 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-4e5e-account-create-update-ft8f9"] Mar 16 16:12:18 crc kubenswrapper[5120]: I0316 16:12:18.119569 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8389bad-6789-42fe-8506-5ac83ff9514f" containerName="openstackclient" Mar 16 16:12:18 crc kubenswrapper[5120]: I0316 16:12:18.119593 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8389bad-6789-42fe-8506-5ac83ff9514f" containerName="openstackclient" Mar 16 16:12:18 crc kubenswrapper[5120]: I0316 16:12:18.131977 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="a8389bad-6789-42fe-8506-5ac83ff9514f" containerName="openstackclient" Mar 16 16:12:18 crc kubenswrapper[5120]: E0316 16:12:18.148556 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="37accdb48c73bda606e0755923e4c375ae91d06251e5bc9a66dc8f1c54f97f2e" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:12:18 crc kubenswrapper[5120]: E0316 16:12:18.154597 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="37accdb48c73bda606e0755923e4c375ae91d06251e5bc9a66dc8f1c54f97f2e" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:12:18 crc kubenswrapper[5120]: I0316 16:12:18.171531 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-4e5e-account-create-update-ft8f9"] Mar 16 16:12:18 crc kubenswrapper[5120]: I0316 16:12:18.171574 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 16:12:18 crc kubenswrapper[5120]: I0316 16:12:18.171947 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-4e5e-account-create-update-ft8f9" Mar 16 16:12:18 crc kubenswrapper[5120]: I0316 16:12:18.173274 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podUID="14074bd5-5aa2-44f1-b48f-1d091538fe99" containerName="openstack-network-exporter" containerID="cri-o://6e20c63b4f89ca3830a2ba939de00438e53cce4885447c83c5f138a24aad4498" gracePeriod=300 Mar 16 16:12:18 crc kubenswrapper[5120]: I0316 16:12:18.183146 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-db-secret\"" Mar 16 16:12:18 crc kubenswrapper[5120]: E0316 16:12:18.184424 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="37accdb48c73bda606e0755923e4c375ae91d06251e5bc9a66dc8f1c54f97f2e" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:12:18 crc kubenswrapper[5120]: E0316 16:12:18.184467 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="6a869ae4-5dd4-47d8-aa7e-e519981ee01f" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 16:12:18 crc kubenswrapper[5120]: I0316 16:12:18.191158 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-5h578" Mar 16 16:12:18 crc kubenswrapper[5120]: E0316 16:12:18.197384 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-config-data: configmap "rabbitmq-config-data" not found Mar 16 16:12:18 crc kubenswrapper[5120]: E0316 16:12:18.197446 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab-config-data podName:ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab nodeName:}" failed. No retries permitted until 2026-03-16 16:12:18.69743015 +0000 UTC m=+2440.851361807 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab-config-data") pod "rabbitmq-server-0" (UID: "ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab") : configmap "rabbitmq-config-data" not found Mar 16 16:12:18 crc kubenswrapper[5120]: I0316 16:12:18.211818 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-4e5e-account-create-update-d4lhk"] Mar 16 16:12:18 crc kubenswrapper[5120]: I0316 16:12:18.242259 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-4e5e-account-create-update-d4lhk"] Mar 16 16:12:18 crc kubenswrapper[5120]: I0316 16:12:18.260197 5120 status_manager.go:895] "Failed to get status for pod" podUID="a8389bad-6789-42fe-8506-5ac83ff9514f" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 16:12:18 crc kubenswrapper[5120]: I0316 16:12:18.316384 5120 status_manager.go:895] "Failed to get status for pod" podUID="a8389bad-6789-42fe-8506-5ac83ff9514f" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 16:12:18 crc kubenswrapper[5120]: I0316 16:12:18.317676 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/972b610c-1005-4b7a-be77-72b7d63cab89-operator-scripts\") pod \"placement-4e5e-account-create-update-ft8f9\" (UID: \"972b610c-1005-4b7a-be77-72b7d63cab89\") " pod="openstack-kuttl-tests/placement-4e5e-account-create-update-ft8f9" Mar 16 16:12:18 crc kubenswrapper[5120]: I0316 16:12:18.317837 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8sk9\" (UniqueName: \"kubernetes.io/projected/972b610c-1005-4b7a-be77-72b7d63cab89-kube-api-access-t8sk9\") pod \"placement-4e5e-account-create-update-ft8f9\" (UID: \"972b610c-1005-4b7a-be77-72b7d63cab89\") " pod="openstack-kuttl-tests/placement-4e5e-account-create-update-ft8f9" Mar 16 16:12:18 crc kubenswrapper[5120]: I0316 16:12:18.420944 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/972b610c-1005-4b7a-be77-72b7d63cab89-operator-scripts\") pod \"placement-4e5e-account-create-update-ft8f9\" (UID: \"972b610c-1005-4b7a-be77-72b7d63cab89\") " pod="openstack-kuttl-tests/placement-4e5e-account-create-update-ft8f9" Mar 16 16:12:18 crc kubenswrapper[5120]: I0316 16:12:18.421308 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t8sk9\" (UniqueName: \"kubernetes.io/projected/972b610c-1005-4b7a-be77-72b7d63cab89-kube-api-access-t8sk9\") pod \"placement-4e5e-account-create-update-ft8f9\" (UID: \"972b610c-1005-4b7a-be77-72b7d63cab89\") " pod="openstack-kuttl-tests/placement-4e5e-account-create-update-ft8f9" Mar 16 16:12:18 crc kubenswrapper[5120]: I0316 16:12:18.422411 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/972b610c-1005-4b7a-be77-72b7d63cab89-operator-scripts\") pod \"placement-4e5e-account-create-update-ft8f9\" (UID: \"972b610c-1005-4b7a-be77-72b7d63cab89\") " pod="openstack-kuttl-tests/placement-4e5e-account-create-update-ft8f9" Mar 16 16:12:18 crc kubenswrapper[5120]: I0316 16:12:18.474400 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-2fe2-account-create-update-m9b9k"] Mar 16 16:12:18 crc kubenswrapper[5120]: I0316 16:12:18.527476 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8sk9\" (UniqueName: \"kubernetes.io/projected/972b610c-1005-4b7a-be77-72b7d63cab89-kube-api-access-t8sk9\") pod \"placement-4e5e-account-create-update-ft8f9\" (UID: \"972b610c-1005-4b7a-be77-72b7d63cab89\") " pod="openstack-kuttl-tests/placement-4e5e-account-create-update-ft8f9" Mar 16 16:12:18 crc kubenswrapper[5120]: I0316 16:12:18.535136 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-2fe2-account-create-update-b6c5t"] Mar 16 16:12:18 crc kubenswrapper[5120]: I0316 16:12:18.578545 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-2fe2-account-create-update-m9b9k"] Mar 16 16:12:18 crc kubenswrapper[5120]: I0316 16:12:18.579660 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-2fe2-account-create-update-b6c5t" Mar 16 16:12:18 crc kubenswrapper[5120]: I0316 16:12:18.593213 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-db-secret\"" Mar 16 16:12:18 crc kubenswrapper[5120]: I0316 16:12:18.601601 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 16:12:18 crc kubenswrapper[5120]: I0316 16:12:18.613126 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podUID="14074bd5-5aa2-44f1-b48f-1d091538fe99" containerName="ovsdbserver-sb" containerID="cri-o://1f965ee3a33f3366a6e93fba345fc49e5fd735d0a812c244327a2f9e0c3cff26" gracePeriod=300 Mar 16 16:12:18 crc kubenswrapper[5120]: I0316 16:12:18.635730 5120 status_manager.go:895] "Failed to get status for pod" podUID="a8389bad-6789-42fe-8506-5ac83ff9514f" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 16:12:18 crc kubenswrapper[5120]: I0316 16:12:18.646286 5120 kubelet_pods.go:1019] "Unable to retrieve pull secret, the image pull may not succeed." pod="openstack-kuttl-tests/cinder-api-0" secret="" err="secret \"cinder-cinder-dockercfg-bsw7q\" not found" Mar 16 16:12:18 crc kubenswrapper[5120]: I0316 16:12:18.646979 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-gqvqz"] Mar 16 16:12:18 crc kubenswrapper[5120]: I0316 16:12:18.665830 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-gqvqz"] Mar 16 16:12:18 crc kubenswrapper[5120]: I0316 16:12:18.693232 5120 status_manager.go:895] "Failed to get status for pod" podUID="a8389bad-6789-42fe-8506-5ac83ff9514f" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 16:12:18 crc kubenswrapper[5120]: I0316 16:12:18.733280 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjdmv\" (UniqueName: \"kubernetes.io/projected/0d9bf89c-b546-4753-8e17-963b6dd4720b-kube-api-access-sjdmv\") pod \"neutron-2fe2-account-create-update-b6c5t\" (UID: \"0d9bf89c-b546-4753-8e17-963b6dd4720b\") " pod="openstack-kuttl-tests/neutron-2fe2-account-create-update-b6c5t" Mar 16 16:12:18 crc kubenswrapper[5120]: E0316 16:12:18.736884 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Mar 16 16:12:18 crc kubenswrapper[5120]: E0316 16:12:18.736966 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a-config-data podName:de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a nodeName:}" failed. No retries permitted until 2026-03-16 16:12:19.236947819 +0000 UTC m=+2441.390879466 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a-config-data") pod "rabbitmq-cell1-server-0" (UID: "de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a") : configmap "rabbitmq-cell1-config-data" not found Mar 16 16:12:18 crc kubenswrapper[5120]: E0316 16:12:18.737065 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cinder-scripts: secret "cinder-scripts" not found Mar 16 16:12:18 crc kubenswrapper[5120]: E0316 16:12:18.737091 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88c64b50-c653-4d39-a87a-ac9a49eaf06e-scripts podName:88c64b50-c653-4d39-a87a-ac9a49eaf06e nodeName:}" failed. No retries permitted until 2026-03-16 16:12:19.237084533 +0000 UTC m=+2441.391016190 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "scripts" (UniqueName: "kubernetes.io/secret/88c64b50-c653-4d39-a87a-ac9a49eaf06e-scripts") pod "cinder-api-0" (UID: "88c64b50-c653-4d39-a87a-ac9a49eaf06e") : secret "cinder-scripts" not found Mar 16 16:12:18 crc kubenswrapper[5120]: E0316 16:12:18.737503 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 16:12:18 crc kubenswrapper[5120]: E0316 16:12:18.737533 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bba65a98-1383-4c8c-995a-b212b232d1f8-combined-ca-bundle podName:bba65a98-1383-4c8c-995a-b212b232d1f8 nodeName:}" failed. No retries permitted until 2026-03-16 16:12:19.237525765 +0000 UTC m=+2441.391457412 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/bba65a98-1383-4c8c-995a-b212b232d1f8-combined-ca-bundle") pod "nova-scheduler-0" (UID: "bba65a98-1383-4c8c-995a-b212b232d1f8") : secret "combined-ca-bundle" not found Mar 16 16:12:18 crc kubenswrapper[5120]: E0316 16:12:18.737565 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-config-data: configmap "rabbitmq-config-data" not found Mar 16 16:12:18 crc kubenswrapper[5120]: E0316 16:12:18.737582 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab-config-data podName:ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab nodeName:}" failed. No retries permitted until 2026-03-16 16:12:19.737577146 +0000 UTC m=+2441.891508803 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab-config-data") pod "rabbitmq-server-0" (UID: "ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab") : configmap "rabbitmq-config-data" not found Mar 16 16:12:18 crc kubenswrapper[5120]: E0316 16:12:18.737614 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cinder-api-config-data: secret "cinder-api-config-data" not found Mar 16 16:12:18 crc kubenswrapper[5120]: E0316 16:12:18.737633 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88c64b50-c653-4d39-a87a-ac9a49eaf06e-config-data-custom podName:88c64b50-c653-4d39-a87a-ac9a49eaf06e nodeName:}" failed. No retries permitted until 2026-03-16 16:12:19.237627217 +0000 UTC m=+2441.391558874 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "config-data-custom" (UniqueName: "kubernetes.io/secret/88c64b50-c653-4d39-a87a-ac9a49eaf06e-config-data-custom") pod "cinder-api-0" (UID: "88c64b50-c653-4d39-a87a-ac9a49eaf06e") : secret "cinder-api-config-data" not found Mar 16 16:12:18 crc kubenswrapper[5120]: E0316 16:12:18.737897 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 16:12:18 crc kubenswrapper[5120]: E0316 16:12:18.737929 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-cinder-public-svc: secret "cert-cinder-public-svc" not found Mar 16 16:12:18 crc kubenswrapper[5120]: E0316 16:12:18.737977 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88c64b50-c653-4d39-a87a-ac9a49eaf06e-combined-ca-bundle podName:88c64b50-c653-4d39-a87a-ac9a49eaf06e nodeName:}" failed. No retries permitted until 2026-03-16 16:12:19.237956386 +0000 UTC m=+2441.391888033 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/88c64b50-c653-4d39-a87a-ac9a49eaf06e-combined-ca-bundle") pod "cinder-api-0" (UID: "88c64b50-c653-4d39-a87a-ac9a49eaf06e") : secret "combined-ca-bundle" not found Mar 16 16:12:18 crc kubenswrapper[5120]: E0316 16:12:18.738016 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88c64b50-c653-4d39-a87a-ac9a49eaf06e-public-tls-certs podName:88c64b50-c653-4d39-a87a-ac9a49eaf06e nodeName:}" failed. No retries permitted until 2026-03-16 16:12:19.237993917 +0000 UTC m=+2441.391925574 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/88c64b50-c653-4d39-a87a-ac9a49eaf06e-public-tls-certs") pod "cinder-api-0" (UID: "88c64b50-c653-4d39-a87a-ac9a49eaf06e") : secret "cert-cinder-public-svc" not found Mar 16 16:12:18 crc kubenswrapper[5120]: E0316 16:12:18.738258 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cinder-config-data: secret "cinder-config-data" not found Mar 16 16:12:18 crc kubenswrapper[5120]: E0316 16:12:18.738283 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88c64b50-c653-4d39-a87a-ac9a49eaf06e-config-data podName:88c64b50-c653-4d39-a87a-ac9a49eaf06e nodeName:}" failed. No retries permitted until 2026-03-16 16:12:19.238276635 +0000 UTC m=+2441.392208292 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/secret/88c64b50-c653-4d39-a87a-ac9a49eaf06e-config-data") pod "cinder-api-0" (UID: "88c64b50-c653-4d39-a87a-ac9a49eaf06e") : secret "cinder-config-data" not found Mar 16 16:12:18 crc kubenswrapper[5120]: I0316 16:12:18.738868 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0d9bf89c-b546-4753-8e17-963b6dd4720b-operator-scripts\") pod \"neutron-2fe2-account-create-update-b6c5t\" (UID: \"0d9bf89c-b546-4753-8e17-963b6dd4720b\") " pod="openstack-kuttl-tests/neutron-2fe2-account-create-update-b6c5t" Mar 16 16:12:18 crc kubenswrapper[5120]: E0316 16:12:18.740010 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-cinder-internal-svc: secret "cert-cinder-internal-svc" not found Mar 16 16:12:18 crc kubenswrapper[5120]: E0316 16:12:18.740088 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88c64b50-c653-4d39-a87a-ac9a49eaf06e-internal-tls-certs podName:88c64b50-c653-4d39-a87a-ac9a49eaf06e nodeName:}" failed. No retries permitted until 2026-03-16 16:12:19.240070304 +0000 UTC m=+2441.394001961 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/88c64b50-c653-4d39-a87a-ac9a49eaf06e-internal-tls-certs") pod "cinder-api-0" (UID: "88c64b50-c653-4d39-a87a-ac9a49eaf06e") : secret "cert-cinder-internal-svc" not found Mar 16 16:12:18 crc kubenswrapper[5120]: E0316 16:12:18.781179 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="1f965ee3a33f3366a6e93fba345fc49e5fd735d0a812c244327a2f9e0c3cff26" cmd=["/usr/bin/pidof","ovsdb-server"] Mar 16 16:12:18 crc kubenswrapper[5120]: E0316 16:12:18.788402 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="1f965ee3a33f3366a6e93fba345fc49e5fd735d0a812c244327a2f9e0c3cff26" cmd=["/usr/bin/pidof","ovsdb-server"] Mar 16 16:12:18 crc kubenswrapper[5120]: E0316 16:12:18.792450 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="1f965ee3a33f3366a6e93fba345fc49e5fd735d0a812c244327a2f9e0c3cff26" cmd=["/usr/bin/pidof","ovsdb-server"] Mar 16 16:12:18 crc kubenswrapper[5120]: E0316 16:12:18.792509 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podUID="14074bd5-5aa2-44f1-b48f-1d091538fe99" containerName="ovsdbserver-sb" probeResult="unknown" Mar 16 16:12:18 crc kubenswrapper[5120]: I0316 16:12:18.812085 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-4e5e-account-create-update-ft8f9" Mar 16 16:12:18 crc kubenswrapper[5120]: I0316 16:12:18.846385 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0d9bf89c-b546-4753-8e17-963b6dd4720b-operator-scripts\") pod \"neutron-2fe2-account-create-update-b6c5t\" (UID: \"0d9bf89c-b546-4753-8e17-963b6dd4720b\") " pod="openstack-kuttl-tests/neutron-2fe2-account-create-update-b6c5t" Mar 16 16:12:18 crc kubenswrapper[5120]: I0316 16:12:18.846514 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sjdmv\" (UniqueName: \"kubernetes.io/projected/0d9bf89c-b546-4753-8e17-963b6dd4720b-kube-api-access-sjdmv\") pod \"neutron-2fe2-account-create-update-b6c5t\" (UID: \"0d9bf89c-b546-4753-8e17-963b6dd4720b\") " pod="openstack-kuttl-tests/neutron-2fe2-account-create-update-b6c5t" Mar 16 16:12:18 crc kubenswrapper[5120]: I0316 16:12:18.847548 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0d9bf89c-b546-4753-8e17-963b6dd4720b-operator-scripts\") pod \"neutron-2fe2-account-create-update-b6c5t\" (UID: \"0d9bf89c-b546-4753-8e17-963b6dd4720b\") " pod="openstack-kuttl-tests/neutron-2fe2-account-create-update-b6c5t" Mar 16 16:12:18 crc kubenswrapper[5120]: I0316 16:12:18.905845 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjdmv\" (UniqueName: \"kubernetes.io/projected/0d9bf89c-b546-4753-8e17-963b6dd4720b-kube-api-access-sjdmv\") pod \"neutron-2fe2-account-create-update-b6c5t\" (UID: \"0d9bf89c-b546-4753-8e17-963b6dd4720b\") " pod="openstack-kuttl-tests/neutron-2fe2-account-create-update-b6c5t" Mar 16 16:12:18 crc kubenswrapper[5120]: I0316 16:12:18.921599 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b1fbfd4-c276-42c0-8419-fbe793f89ad7" path="/var/lib/kubelet/pods/4b1fbfd4-c276-42c0-8419-fbe793f89ad7/volumes" Mar 16 16:12:18 crc kubenswrapper[5120]: I0316 16:12:18.922242 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5456d112-8c46-47d8-ad8f-ea7c98f258e9" path="/var/lib/kubelet/pods/5456d112-8c46-47d8-ad8f-ea7c98f258e9/volumes" Mar 16 16:12:18 crc kubenswrapper[5120]: I0316 16:12:18.922712 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="745660ab-e0e8-433c-b1ef-405de9b26576" path="/var/lib/kubelet/pods/745660ab-e0e8-433c-b1ef-405de9b26576/volumes" Mar 16 16:12:18 crc kubenswrapper[5120]: I0316 16:12:18.924377 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d6dce3c7-a168-4f7b-8f35-b18f6de810e8" path="/var/lib/kubelet/pods/d6dce3c7-a168-4f7b-8f35-b18f6de810e8/volumes" Mar 16 16:12:18 crc kubenswrapper[5120]: I0316 16:12:18.925500 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e929a717-3e1e-4481-9e69-3705d47c1d87" path="/var/lib/kubelet/pods/e929a717-3e1e-4481-9e69-3705d47c1d87/volumes" Mar 16 16:12:18 crc kubenswrapper[5120]: I0316 16:12:18.926059 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eed07ed8-afbf-4c01-8a27-678404cb17e1" path="/var/lib/kubelet/pods/eed07ed8-afbf-4c01-8a27-678404cb17e1/volumes" Mar 16 16:12:18 crc kubenswrapper[5120]: I0316 16:12:18.926719 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:12:18 crc kubenswrapper[5120]: I0316 16:12:18.926931 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-2fe2-account-create-update-b6c5t"] Mar 16 16:12:18 crc kubenswrapper[5120]: I0316 16:12:18.926956 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 16:12:18 crc kubenswrapper[5120]: I0316 16:12:18.926972 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-p9g8j"] Mar 16 16:12:18 crc kubenswrapper[5120]: I0316 16:12:18.926981 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 16:12:18 crc kubenswrapper[5120]: I0316 16:12:18.926994 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-p9g8j"] Mar 16 16:12:18 crc kubenswrapper[5120]: I0316 16:12:18.927015 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-ghc6c"] Mar 16 16:12:18 crc kubenswrapper[5120]: I0316 16:12:18.927024 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-ghc6c"] Mar 16 16:12:18 crc kubenswrapper[5120]: I0316 16:12:18.927217 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovn-northd-0" podUID="6d9a26b4-a091-43f5-8625-2194e901021c" containerName="ovn-northd" containerID="cri-o://8ecd82c1669b50dc83fc2647cd97edc7c58898ad565a8f6fd97dffcaf6c2a4ea" gracePeriod=30 Mar 16 16:12:18 crc kubenswrapper[5120]: I0316 16:12:18.928344 5120 kubelet_pods.go:1019] "Unable to retrieve pull secret, the image pull may not succeed." pod="openstack-kuttl-tests/cinder-scheduler-0" secret="" err="secret \"cinder-cinder-dockercfg-bsw7q\" not found" Mar 16 16:12:18 crc kubenswrapper[5120]: I0316 16:12:18.928988 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovn-northd-0" podUID="6d9a26b4-a091-43f5-8625-2194e901021c" containerName="openstack-network-exporter" containerID="cri-o://aab293db17585f8a42a939cc07e5b97a9fcea6413f5ca264b304c81a0bf0c22c" gracePeriod=30 Mar 16 16:12:18 crc kubenswrapper[5120]: I0316 16:12:18.929206 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podUID="30d44474-74de-4982-8e48-31038a50607f" containerName="openstack-network-exporter" containerID="cri-o://fbbfd6f0fd64c190f248274deb1940fd09e15076025138df16cb70d5ebc9868a" gracePeriod=300 Mar 16 16:12:18 crc kubenswrapper[5120]: I0316 16:12:18.931789 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-2002-account-create-update-sg6jt"] Mar 16 16:12:18 crc kubenswrapper[5120]: I0316 16:12:18.939369 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-2002-account-create-update-sg6jt" Mar 16 16:12:18 crc kubenswrapper[5120]: I0316 16:12:18.940551 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-ecee-account-create-update-vpjvm"] Mar 16 16:12:18 crc kubenswrapper[5120]: I0316 16:12:18.945619 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-db-secret\"" Mar 16 16:12:18 crc kubenswrapper[5120]: I0316 16:12:18.951475 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-ecee-account-create-update-vpjvm" Mar 16 16:12:18 crc kubenswrapper[5120]: I0316 16:12:18.955335 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-2002-account-create-update-sg6jt"] Mar 16 16:12:18 crc kubenswrapper[5120]: I0316 16:12:18.955601 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-db-secret\"" Mar 16 16:12:18 crc kubenswrapper[5120]: I0316 16:12:18.970804 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-917a-account-create-update-942tp"] Mar 16 16:12:18 crc kubenswrapper[5120]: I0316 16:12:18.984103 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-917a-account-create-update-942tp" Mar 16 16:12:18 crc kubenswrapper[5120]: I0316 16:12:18.986720 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-ecee-account-create-update-vpjvm"] Mar 16 16:12:18 crc kubenswrapper[5120]: I0316 16:12:18.989633 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-db-secret\"" Mar 16 16:12:19 crc kubenswrapper[5120]: I0316 16:12:19.000899 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-g56h7"] Mar 16 16:12:19 crc kubenswrapper[5120]: I0316 16:12:19.012948 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-g56h7"] Mar 16 16:12:19 crc kubenswrapper[5120]: I0316 16:12:19.024407 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-917a-account-create-update-942tp"] Mar 16 16:12:19 crc kubenswrapper[5120]: I0316 16:12:19.032260 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podUID="30d44474-74de-4982-8e48-31038a50607f" containerName="ovsdbserver-nb" containerID="cri-o://820cf0b744b014f72ef8c35261feee7d781834c65a720335f779bb77e8523fe4" gracePeriod=300 Mar 16 16:12:19 crc kubenswrapper[5120]: I0316 16:12:19.034318 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-n9m9r"] Mar 16 16:12:19 crc kubenswrapper[5120]: I0316 16:12:19.056947 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/dc6aec24-261d-49c7-8306-704614644eaf-operator-scripts\") pod \"nova-api-2002-account-create-update-sg6jt\" (UID: \"dc6aec24-261d-49c7-8306-704614644eaf\") " pod="openstack-kuttl-tests/nova-api-2002-account-create-update-sg6jt" Mar 16 16:12:19 crc kubenswrapper[5120]: I0316 16:12:19.057091 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7t5dc\" (UniqueName: \"kubernetes.io/projected/a0d48ffc-4eac-4602-b2e3-902e4a80c6a3-kube-api-access-7t5dc\") pod \"nova-cell0-ecee-account-create-update-vpjvm\" (UID: \"a0d48ffc-4eac-4602-b2e3-902e4a80c6a3\") " pod="openstack-kuttl-tests/nova-cell0-ecee-account-create-update-vpjvm" Mar 16 16:12:19 crc kubenswrapper[5120]: I0316 16:12:19.057169 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a0d48ffc-4eac-4602-b2e3-902e4a80c6a3-operator-scripts\") pod \"nova-cell0-ecee-account-create-update-vpjvm\" (UID: \"a0d48ffc-4eac-4602-b2e3-902e4a80c6a3\") " pod="openstack-kuttl-tests/nova-cell0-ecee-account-create-update-vpjvm" Mar 16 16:12:19 crc kubenswrapper[5120]: I0316 16:12:19.057240 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvh2v\" (UniqueName: \"kubernetes.io/projected/dc6aec24-261d-49c7-8306-704614644eaf-kube-api-access-dvh2v\") pod \"nova-api-2002-account-create-update-sg6jt\" (UID: \"dc6aec24-261d-49c7-8306-704614644eaf\") " pod="openstack-kuttl-tests/nova-api-2002-account-create-update-sg6jt" Mar 16 16:12:19 crc kubenswrapper[5120]: E0316 16:12:19.057487 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cinder-scheduler-config-data: secret "cinder-scheduler-config-data" not found Mar 16 16:12:19 crc kubenswrapper[5120]: E0316 16:12:19.057549 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96d66c8e-8cdb-462c-a302-c85e581db5ad-config-data-custom podName:96d66c8e-8cdb-462c-a302-c85e581db5ad nodeName:}" failed. No retries permitted until 2026-03-16 16:12:19.557534518 +0000 UTC m=+2441.711466175 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "config-data-custom" (UniqueName: "kubernetes.io/secret/96d66c8e-8cdb-462c-a302-c85e581db5ad-config-data-custom") pod "cinder-scheduler-0" (UID: "96d66c8e-8cdb-462c-a302-c85e581db5ad") : secret "cinder-scheduler-config-data" not found Mar 16 16:12:19 crc kubenswrapper[5120]: E0316 16:12:19.057790 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cinder-scripts: secret "cinder-scripts" not found Mar 16 16:12:19 crc kubenswrapper[5120]: E0316 16:12:19.057814 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96d66c8e-8cdb-462c-a302-c85e581db5ad-scripts podName:96d66c8e-8cdb-462c-a302-c85e581db5ad nodeName:}" failed. No retries permitted until 2026-03-16 16:12:19.557807435 +0000 UTC m=+2441.711739092 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "scripts" (UniqueName: "kubernetes.io/secret/96d66c8e-8cdb-462c-a302-c85e581db5ad-scripts") pod "cinder-scheduler-0" (UID: "96d66c8e-8cdb-462c-a302-c85e581db5ad") : secret "cinder-scripts" not found Mar 16 16:12:19 crc kubenswrapper[5120]: E0316 16:12:19.057854 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 16:12:19 crc kubenswrapper[5120]: E0316 16:12:19.057877 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96d66c8e-8cdb-462c-a302-c85e581db5ad-combined-ca-bundle podName:96d66c8e-8cdb-462c-a302-c85e581db5ad nodeName:}" failed. No retries permitted until 2026-03-16 16:12:19.557870447 +0000 UTC m=+2441.711802104 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/96d66c8e-8cdb-462c-a302-c85e581db5ad-combined-ca-bundle") pod "cinder-scheduler-0" (UID: "96d66c8e-8cdb-462c-a302-c85e581db5ad") : secret "combined-ca-bundle" not found Mar 16 16:12:19 crc kubenswrapper[5120]: E0316 16:12:19.057912 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cinder-config-data: secret "cinder-config-data" not found Mar 16 16:12:19 crc kubenswrapper[5120]: E0316 16:12:19.057930 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96d66c8e-8cdb-462c-a302-c85e581db5ad-config-data podName:96d66c8e-8cdb-462c-a302-c85e581db5ad nodeName:}" failed. No retries permitted until 2026-03-16 16:12:19.557924818 +0000 UTC m=+2441.711856475 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/secret/96d66c8e-8cdb-462c-a302-c85e581db5ad-config-data") pod "cinder-scheduler-0" (UID: "96d66c8e-8cdb-462c-a302-c85e581db5ad") : secret "cinder-config-data" not found Mar 16 16:12:19 crc kubenswrapper[5120]: I0316 16:12:19.062804 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-n9m9r"] Mar 16 16:12:19 crc kubenswrapper[5120]: I0316 16:12:19.083511 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-wz6tz"] Mar 16 16:12:19 crc kubenswrapper[5120]: I0316 16:12:19.086718 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-2fe2-account-create-update-b6c5t" Mar 16 16:12:19 crc kubenswrapper[5120]: I0316 16:12:19.101771 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-wz6tz"] Mar 16 16:12:19 crc kubenswrapper[5120]: I0316 16:12:19.162337 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7t5dc\" (UniqueName: \"kubernetes.io/projected/a0d48ffc-4eac-4602-b2e3-902e4a80c6a3-kube-api-access-7t5dc\") pod \"nova-cell0-ecee-account-create-update-vpjvm\" (UID: \"a0d48ffc-4eac-4602-b2e3-902e4a80c6a3\") " pod="openstack-kuttl-tests/nova-cell0-ecee-account-create-update-vpjvm" Mar 16 16:12:19 crc kubenswrapper[5120]: I0316 16:12:19.162633 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/1d95fd75-2d15-48f7-9605-2d1980ebeff2-operator-scripts\") pod \"nova-cell1-917a-account-create-update-942tp\" (UID: \"1d95fd75-2d15-48f7-9605-2d1980ebeff2\") " pod="openstack-kuttl-tests/nova-cell1-917a-account-create-update-942tp" Mar 16 16:12:19 crc kubenswrapper[5120]: I0316 16:12:19.162708 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a0d48ffc-4eac-4602-b2e3-902e4a80c6a3-operator-scripts\") pod \"nova-cell0-ecee-account-create-update-vpjvm\" (UID: \"a0d48ffc-4eac-4602-b2e3-902e4a80c6a3\") " pod="openstack-kuttl-tests/nova-cell0-ecee-account-create-update-vpjvm" Mar 16 16:12:19 crc kubenswrapper[5120]: I0316 16:12:19.162996 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dvh2v\" (UniqueName: \"kubernetes.io/projected/dc6aec24-261d-49c7-8306-704614644eaf-kube-api-access-dvh2v\") pod \"nova-api-2002-account-create-update-sg6jt\" (UID: \"dc6aec24-261d-49c7-8306-704614644eaf\") " pod="openstack-kuttl-tests/nova-api-2002-account-create-update-sg6jt" Mar 16 16:12:19 crc kubenswrapper[5120]: I0316 16:12:19.163157 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5h7bs\" (UniqueName: \"kubernetes.io/projected/1d95fd75-2d15-48f7-9605-2d1980ebeff2-kube-api-access-5h7bs\") pod \"nova-cell1-917a-account-create-update-942tp\" (UID: \"1d95fd75-2d15-48f7-9605-2d1980ebeff2\") " pod="openstack-kuttl-tests/nova-cell1-917a-account-create-update-942tp" Mar 16 16:12:19 crc kubenswrapper[5120]: I0316 16:12:19.163466 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/dc6aec24-261d-49c7-8306-704614644eaf-operator-scripts\") pod \"nova-api-2002-account-create-update-sg6jt\" (UID: \"dc6aec24-261d-49c7-8306-704614644eaf\") " pod="openstack-kuttl-tests/nova-api-2002-account-create-update-sg6jt" Mar 16 16:12:19 crc kubenswrapper[5120]: I0316 16:12:19.163986 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a0d48ffc-4eac-4602-b2e3-902e4a80c6a3-operator-scripts\") pod \"nova-cell0-ecee-account-create-update-vpjvm\" (UID: \"a0d48ffc-4eac-4602-b2e3-902e4a80c6a3\") " pod="openstack-kuttl-tests/nova-cell0-ecee-account-create-update-vpjvm" Mar 16 16:12:19 crc kubenswrapper[5120]: I0316 16:12:19.164364 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/dc6aec24-261d-49c7-8306-704614644eaf-operator-scripts\") pod \"nova-api-2002-account-create-update-sg6jt\" (UID: \"dc6aec24-261d-49c7-8306-704614644eaf\") " pod="openstack-kuttl-tests/nova-api-2002-account-create-update-sg6jt" Mar 16 16:12:19 crc kubenswrapper[5120]: I0316 16:12:19.209981 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7t5dc\" (UniqueName: \"kubernetes.io/projected/a0d48ffc-4eac-4602-b2e3-902e4a80c6a3-kube-api-access-7t5dc\") pod \"nova-cell0-ecee-account-create-update-vpjvm\" (UID: \"a0d48ffc-4eac-4602-b2e3-902e4a80c6a3\") " pod="openstack-kuttl-tests/nova-cell0-ecee-account-create-update-vpjvm" Mar 16 16:12:19 crc kubenswrapper[5120]: I0316 16:12:19.218012 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvh2v\" (UniqueName: \"kubernetes.io/projected/dc6aec24-261d-49c7-8306-704614644eaf-kube-api-access-dvh2v\") pod \"nova-api-2002-account-create-update-sg6jt\" (UID: \"dc6aec24-261d-49c7-8306-704614644eaf\") " pod="openstack-kuttl-tests/nova-api-2002-account-create-update-sg6jt" Mar 16 16:12:19 crc kubenswrapper[5120]: I0316 16:12:19.254356 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-2002-account-create-update-sg6jt" Mar 16 16:12:19 crc kubenswrapper[5120]: I0316 16:12:19.275623 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/1d95fd75-2d15-48f7-9605-2d1980ebeff2-operator-scripts\") pod \"nova-cell1-917a-account-create-update-942tp\" (UID: \"1d95fd75-2d15-48f7-9605-2d1980ebeff2\") " pod="openstack-kuttl-tests/nova-cell1-917a-account-create-update-942tp" Mar 16 16:12:19 crc kubenswrapper[5120]: I0316 16:12:19.275991 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5h7bs\" (UniqueName: \"kubernetes.io/projected/1d95fd75-2d15-48f7-9605-2d1980ebeff2-kube-api-access-5h7bs\") pod \"nova-cell1-917a-account-create-update-942tp\" (UID: \"1d95fd75-2d15-48f7-9605-2d1980ebeff2\") " pod="openstack-kuttl-tests/nova-cell1-917a-account-create-update-942tp" Mar 16 16:12:19 crc kubenswrapper[5120]: E0316 16:12:19.276502 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 16:12:19 crc kubenswrapper[5120]: E0316 16:12:19.276564 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88c64b50-c653-4d39-a87a-ac9a49eaf06e-combined-ca-bundle podName:88c64b50-c653-4d39-a87a-ac9a49eaf06e nodeName:}" failed. No retries permitted until 2026-03-16 16:12:20.27654344 +0000 UTC m=+2442.430475097 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/88c64b50-c653-4d39-a87a-ac9a49eaf06e-combined-ca-bundle") pod "cinder-api-0" (UID: "88c64b50-c653-4d39-a87a-ac9a49eaf06e") : secret "combined-ca-bundle" not found Mar 16 16:12:19 crc kubenswrapper[5120]: E0316 16:12:19.277147 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cinder-api-config-data: secret "cinder-api-config-data" not found Mar 16 16:12:19 crc kubenswrapper[5120]: E0316 16:12:19.277552 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cinder-scripts: secret "cinder-scripts" not found Mar 16 16:12:19 crc kubenswrapper[5120]: E0316 16:12:19.277577 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cinder-config-data: secret "cinder-config-data" not found Mar 16 16:12:19 crc kubenswrapper[5120]: E0316 16:12:19.277659 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-cinder-internal-svc: secret "cert-cinder-internal-svc" not found Mar 16 16:12:19 crc kubenswrapper[5120]: E0316 16:12:19.277665 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-cinder-public-svc: secret "cert-cinder-public-svc" not found Mar 16 16:12:19 crc kubenswrapper[5120]: E0316 16:12:19.277720 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 16:12:19 crc kubenswrapper[5120]: E0316 16:12:19.277721 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Mar 16 16:12:19 crc kubenswrapper[5120]: I0316 16:12:19.278438 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/1d95fd75-2d15-48f7-9605-2d1980ebeff2-operator-scripts\") pod \"nova-cell1-917a-account-create-update-942tp\" (UID: \"1d95fd75-2d15-48f7-9605-2d1980ebeff2\") " pod="openstack-kuttl-tests/nova-cell1-917a-account-create-update-942tp" Mar 16 16:12:19 crc kubenswrapper[5120]: E0316 16:12:19.282927 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88c64b50-c653-4d39-a87a-ac9a49eaf06e-config-data-custom podName:88c64b50-c653-4d39-a87a-ac9a49eaf06e nodeName:}" failed. No retries permitted until 2026-03-16 16:12:20.277176938 +0000 UTC m=+2442.431108595 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "config-data-custom" (UniqueName: "kubernetes.io/secret/88c64b50-c653-4d39-a87a-ac9a49eaf06e-config-data-custom") pod "cinder-api-0" (UID: "88c64b50-c653-4d39-a87a-ac9a49eaf06e") : secret "cinder-api-config-data" not found Mar 16 16:12:19 crc kubenswrapper[5120]: E0316 16:12:19.282990 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88c64b50-c653-4d39-a87a-ac9a49eaf06e-scripts podName:88c64b50-c653-4d39-a87a-ac9a49eaf06e nodeName:}" failed. No retries permitted until 2026-03-16 16:12:20.282972195 +0000 UTC m=+2442.436903852 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "scripts" (UniqueName: "kubernetes.io/secret/88c64b50-c653-4d39-a87a-ac9a49eaf06e-scripts") pod "cinder-api-0" (UID: "88c64b50-c653-4d39-a87a-ac9a49eaf06e") : secret "cinder-scripts" not found Mar 16 16:12:19 crc kubenswrapper[5120]: E0316 16:12:19.283012 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88c64b50-c653-4d39-a87a-ac9a49eaf06e-config-data podName:88c64b50-c653-4d39-a87a-ac9a49eaf06e nodeName:}" failed. No retries permitted until 2026-03-16 16:12:20.282998856 +0000 UTC m=+2442.436930513 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/secret/88c64b50-c653-4d39-a87a-ac9a49eaf06e-config-data") pod "cinder-api-0" (UID: "88c64b50-c653-4d39-a87a-ac9a49eaf06e") : secret "cinder-config-data" not found Mar 16 16:12:19 crc kubenswrapper[5120]: E0316 16:12:19.283047 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88c64b50-c653-4d39-a87a-ac9a49eaf06e-internal-tls-certs podName:88c64b50-c653-4d39-a87a-ac9a49eaf06e nodeName:}" failed. No retries permitted until 2026-03-16 16:12:20.283036667 +0000 UTC m=+2442.436968324 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/88c64b50-c653-4d39-a87a-ac9a49eaf06e-internal-tls-certs") pod "cinder-api-0" (UID: "88c64b50-c653-4d39-a87a-ac9a49eaf06e") : secret "cert-cinder-internal-svc" not found Mar 16 16:12:19 crc kubenswrapper[5120]: E0316 16:12:19.283067 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88c64b50-c653-4d39-a87a-ac9a49eaf06e-public-tls-certs podName:88c64b50-c653-4d39-a87a-ac9a49eaf06e nodeName:}" failed. No retries permitted until 2026-03-16 16:12:20.283054567 +0000 UTC m=+2442.436986224 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/88c64b50-c653-4d39-a87a-ac9a49eaf06e-public-tls-certs") pod "cinder-api-0" (UID: "88c64b50-c653-4d39-a87a-ac9a49eaf06e") : secret "cert-cinder-public-svc" not found Mar 16 16:12:19 crc kubenswrapper[5120]: E0316 16:12:19.283092 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bba65a98-1383-4c8c-995a-b212b232d1f8-combined-ca-bundle podName:bba65a98-1383-4c8c-995a-b212b232d1f8 nodeName:}" failed. No retries permitted until 2026-03-16 16:12:20.283075908 +0000 UTC m=+2442.437007565 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/bba65a98-1383-4c8c-995a-b212b232d1f8-combined-ca-bundle") pod "nova-scheduler-0" (UID: "bba65a98-1383-4c8c-995a-b212b232d1f8") : secret "combined-ca-bundle" not found Mar 16 16:12:19 crc kubenswrapper[5120]: E0316 16:12:19.283107 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a-config-data podName:de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a nodeName:}" failed. No retries permitted until 2026-03-16 16:12:20.283099988 +0000 UTC m=+2442.437031655 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a-config-data") pod "rabbitmq-cell1-server-0" (UID: "de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a") : configmap "rabbitmq-cell1-config-data" not found Mar 16 16:12:19 crc kubenswrapper[5120]: I0316 16:12:19.307108 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/swift-proxy-6d59599fcd-hn254" Mar 16 16:12:19 crc kubenswrapper[5120]: I0316 16:12:19.307622 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/swift-proxy-6d59599fcd-hn254" Mar 16 16:12:19 crc kubenswrapper[5120]: I0316 16:12:19.311078 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5h7bs\" (UniqueName: \"kubernetes.io/projected/1d95fd75-2d15-48f7-9605-2d1980ebeff2-kube-api-access-5h7bs\") pod \"nova-cell1-917a-account-create-update-942tp\" (UID: \"1d95fd75-2d15-48f7-9605-2d1980ebeff2\") " pod="openstack-kuttl-tests/nova-cell1-917a-account-create-update-942tp" Mar 16 16:12:19 crc kubenswrapper[5120]: I0316 16:12:19.424490 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 16:12:19 crc kubenswrapper[5120]: I0316 16:12:19.425231 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="48f884c6-8a4f-4581-8b21-6e4db79ae424" containerName="account-server" containerID="cri-o://7f52beabfcff3227464395535efe06bcce13fd954b9eb69868803bda7c0f42b8" gracePeriod=30 Mar 16 16:12:19 crc kubenswrapper[5120]: I0316 16:12:19.432032 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="48f884c6-8a4f-4581-8b21-6e4db79ae424" containerName="object-updater" containerID="cri-o://0a908a6be3baace96c3eef973eb82131e5167c3067b1203a7c21f2622485ee33" gracePeriod=30 Mar 16 16:12:19 crc kubenswrapper[5120]: I0316 16:12:19.432080 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="48f884c6-8a4f-4581-8b21-6e4db79ae424" containerName="object-auditor" containerID="cri-o://85fba775e10e93053a28f47416e4fab8a8d74704457a1dcaa326ca7d97b5b71f" gracePeriod=30 Mar 16 16:12:19 crc kubenswrapper[5120]: I0316 16:12:19.432174 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="48f884c6-8a4f-4581-8b21-6e4db79ae424" containerName="swift-recon-cron" containerID="cri-o://6ebaa174af16709eabdeaa272a12557155a953a5695f9c4f45bdbbba7bbe258c" gracePeriod=30 Mar 16 16:12:19 crc kubenswrapper[5120]: I0316 16:12:19.432206 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="48f884c6-8a4f-4581-8b21-6e4db79ae424" containerName="object-replicator" containerID="cri-o://0f89eb629ca87b8f3c4dc3a654ad9be3b3dbf2b9befef91351aef67313564f2a" gracePeriod=30 Mar 16 16:12:19 crc kubenswrapper[5120]: I0316 16:12:19.432219 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="48f884c6-8a4f-4581-8b21-6e4db79ae424" containerName="rsync" containerID="cri-o://db519ba940e3ae10789232d021fe52325581ff3785213c9476636fdeaec31312" gracePeriod=30 Mar 16 16:12:19 crc kubenswrapper[5120]: I0316 16:12:19.432262 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="48f884c6-8a4f-4581-8b21-6e4db79ae424" containerName="object-expirer" containerID="cri-o://758c2ce99e07b0ccc53b089f1c58cd33db77d7df92e3795e3715aeb0c2df8a47" gracePeriod=30 Mar 16 16:12:19 crc kubenswrapper[5120]: I0316 16:12:19.432273 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="48f884c6-8a4f-4581-8b21-6e4db79ae424" containerName="object-server" containerID="cri-o://f1f5ef3a1ae4a49a755f7af35d2f4253955831c27a90812260b878eecdda0e64" gracePeriod=30 Mar 16 16:12:19 crc kubenswrapper[5120]: I0316 16:12:19.432033 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="48f884c6-8a4f-4581-8b21-6e4db79ae424" containerName="container-updater" containerID="cri-o://f9a925d5514cb6701f37d65b406ab354233d03c77e454fdee7f9de6e3c4f2ec2" gracePeriod=30 Mar 16 16:12:19 crc kubenswrapper[5120]: I0316 16:12:19.432317 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="48f884c6-8a4f-4581-8b21-6e4db79ae424" containerName="account-reaper" containerID="cri-o://c68e0b66544e05eeafb40a0ede57f1aaffd7e86fe267efb1d86740b24f029cd4" gracePeriod=30 Mar 16 16:12:19 crc kubenswrapper[5120]: I0316 16:12:19.432333 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="48f884c6-8a4f-4581-8b21-6e4db79ae424" containerName="account-replicator" containerID="cri-o://d15b7b1dedfc5e0bf45e87214537c30c6e63e98b399564a5d04a921d97d3ee71" gracePeriod=30 Mar 16 16:12:19 crc kubenswrapper[5120]: I0316 16:12:19.432357 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="48f884c6-8a4f-4581-8b21-6e4db79ae424" containerName="container-auditor" containerID="cri-o://c0e4c801b2d8158c5198a10ed551d4bc0bd991a66fd9a3696cf629419472d00b" gracePeriod=30 Mar 16 16:12:19 crc kubenswrapper[5120]: I0316 16:12:19.432366 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="48f884c6-8a4f-4581-8b21-6e4db79ae424" containerName="account-auditor" containerID="cri-o://4bce9c9cadac21d7a22c0911253a06b757eab3c3a10ee9e0b5056d5ddc880b03" gracePeriod=30 Mar 16 16:12:19 crc kubenswrapper[5120]: I0316 16:12:19.432400 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="48f884c6-8a4f-4581-8b21-6e4db79ae424" containerName="container-replicator" containerID="cri-o://bd5bde381422aec36b49a27e33e7df18130a58904e5277a758731159e4602f17" gracePeriod=30 Mar 16 16:12:19 crc kubenswrapper[5120]: I0316 16:12:19.432406 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="48f884c6-8a4f-4581-8b21-6e4db79ae424" containerName="container-server" containerID="cri-o://51d5b8b2b99674a1960ad863d81ad3a57a5eb88f5643007686739c6718ac88e6" gracePeriod=30 Mar 16 16:12:19 crc kubenswrapper[5120]: I0316 16:12:19.445631 5120 kubelet_pods.go:1019] "Unable to retrieve pull secret, the image pull may not succeed." pod="openstack-kuttl-tests/swift-proxy-6d59599fcd-hn254" secret="" err="secret \"swift-swift-dockercfg-sz7zw\" not found" Mar 16 16:12:19 crc kubenswrapper[5120]: I0316 16:12:19.482293 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-5h578"] Mar 16 16:12:19 crc kubenswrapper[5120]: I0316 16:12:19.492854 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-qwsw8"] Mar 16 16:12:19 crc kubenswrapper[5120]: I0316 16:12:19.517534 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-qwsw8" Mar 16 16:12:19 crc kubenswrapper[5120]: I0316 16:12:19.526979 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-qwsw8"] Mar 16 16:12:19 crc kubenswrapper[5120]: I0316 16:12:19.536717 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-db-create-tsb2s"] Mar 16 16:12:19 crc kubenswrapper[5120]: E0316 16:12:19.588299 5120 projected.go:264] Couldn't get secret openstack-kuttl-tests/swift-conf: secret "swift-conf" not found Mar 16 16:12:19 crc kubenswrapper[5120]: E0316 16:12:19.588452 5120 projected.go:289] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Mar 16 16:12:19 crc kubenswrapper[5120]: E0316 16:12:19.588468 5120 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-proxy-6d59599fcd-hn254: [secret "swift-conf" not found, configmap "swift-ring-files" not found] Mar 16 16:12:19 crc kubenswrapper[5120]: E0316 16:12:19.588572 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fe2105ae-76c1-452b-bee1-074d323c076f-etc-swift podName:fe2105ae-76c1-452b-bee1-074d323c076f nodeName:}" failed. No retries permitted until 2026-03-16 16:12:20.088552286 +0000 UTC m=+2442.242483933 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/fe2105ae-76c1-452b-bee1-074d323c076f-etc-swift") pod "swift-proxy-6d59599fcd-hn254" (UID: "fe2105ae-76c1-452b-bee1-074d323c076f") : [secret "swift-conf" not found, configmap "swift-ring-files" not found] Mar 16 16:12:19 crc kubenswrapper[5120]: E0316 16:12:19.588634 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cinder-scripts: secret "cinder-scripts" not found Mar 16 16:12:19 crc kubenswrapper[5120]: E0316 16:12:19.588657 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96d66c8e-8cdb-462c-a302-c85e581db5ad-scripts podName:96d66c8e-8cdb-462c-a302-c85e581db5ad nodeName:}" failed. No retries permitted until 2026-03-16 16:12:20.588650999 +0000 UTC m=+2442.742582656 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "scripts" (UniqueName: "kubernetes.io/secret/96d66c8e-8cdb-462c-a302-c85e581db5ad-scripts") pod "cinder-scheduler-0" (UID: "96d66c8e-8cdb-462c-a302-c85e581db5ad") : secret "cinder-scripts" not found Mar 16 16:12:19 crc kubenswrapper[5120]: E0316 16:12:19.588335 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-swift-internal-svc: secret "cert-swift-internal-svc" not found Mar 16 16:12:19 crc kubenswrapper[5120]: E0316 16:12:19.588682 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe2105ae-76c1-452b-bee1-074d323c076f-internal-tls-certs podName:fe2105ae-76c1-452b-bee1-074d323c076f nodeName:}" failed. No retries permitted until 2026-03-16 16:12:20.08867765 +0000 UTC m=+2442.242609307 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/fe2105ae-76c1-452b-bee1-074d323c076f-internal-tls-certs") pod "swift-proxy-6d59599fcd-hn254" (UID: "fe2105ae-76c1-452b-bee1-074d323c076f") : secret "cert-swift-internal-svc" not found Mar 16 16:12:19 crc kubenswrapper[5120]: E0316 16:12:19.588365 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 16:12:19 crc kubenswrapper[5120]: E0316 16:12:19.588399 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cinder-scheduler-config-data: secret "cinder-scheduler-config-data" not found Mar 16 16:12:19 crc kubenswrapper[5120]: E0316 16:12:19.589103 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96d66c8e-8cdb-462c-a302-c85e581db5ad-combined-ca-bundle podName:96d66c8e-8cdb-462c-a302-c85e581db5ad nodeName:}" failed. No retries permitted until 2026-03-16 16:12:20.589094351 +0000 UTC m=+2442.743026008 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/96d66c8e-8cdb-462c-a302-c85e581db5ad-combined-ca-bundle") pod "cinder-scheduler-0" (UID: "96d66c8e-8cdb-462c-a302-c85e581db5ad") : secret "combined-ca-bundle" not found Mar 16 16:12:19 crc kubenswrapper[5120]: E0316 16:12:19.589464 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cinder-config-data: secret "cinder-config-data" not found Mar 16 16:12:19 crc kubenswrapper[5120]: E0316 16:12:19.589485 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96d66c8e-8cdb-462c-a302-c85e581db5ad-config-data podName:96d66c8e-8cdb-462c-a302-c85e581db5ad nodeName:}" failed. No retries permitted until 2026-03-16 16:12:20.589479132 +0000 UTC m=+2442.743410789 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/secret/96d66c8e-8cdb-462c-a302-c85e581db5ad-config-data") pod "cinder-scheduler-0" (UID: "96d66c8e-8cdb-462c-a302-c85e581db5ad") : secret "cinder-config-data" not found Mar 16 16:12:19 crc kubenswrapper[5120]: E0316 16:12:19.589516 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 16:12:19 crc kubenswrapper[5120]: E0316 16:12:19.589535 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe2105ae-76c1-452b-bee1-074d323c076f-combined-ca-bundle podName:fe2105ae-76c1-452b-bee1-074d323c076f nodeName:}" failed. No retries permitted until 2026-03-16 16:12:20.089530003 +0000 UTC m=+2442.243461660 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/fe2105ae-76c1-452b-bee1-074d323c076f-combined-ca-bundle") pod "swift-proxy-6d59599fcd-hn254" (UID: "fe2105ae-76c1-452b-bee1-074d323c076f") : secret "combined-ca-bundle" not found Mar 16 16:12:19 crc kubenswrapper[5120]: E0316 16:12:19.589568 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-swift-public-svc: secret "cert-swift-public-svc" not found Mar 16 16:12:19 crc kubenswrapper[5120]: E0316 16:12:19.590584 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96d66c8e-8cdb-462c-a302-c85e581db5ad-config-data-custom podName:96d66c8e-8cdb-462c-a302-c85e581db5ad nodeName:}" failed. No retries permitted until 2026-03-16 16:12:20.589551724 +0000 UTC m=+2442.743483371 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "config-data-custom" (UniqueName: "kubernetes.io/secret/96d66c8e-8cdb-462c-a302-c85e581db5ad-config-data-custom") pod "cinder-scheduler-0" (UID: "96d66c8e-8cdb-462c-a302-c85e581db5ad") : secret "cinder-scheduler-config-data" not found Mar 16 16:12:19 crc kubenswrapper[5120]: E0316 16:12:19.590618 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe2105ae-76c1-452b-bee1-074d323c076f-public-tls-certs podName:fe2105ae-76c1-452b-bee1-074d323c076f nodeName:}" failed. No retries permitted until 2026-03-16 16:12:20.090608052 +0000 UTC m=+2442.244539709 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/fe2105ae-76c1-452b-bee1-074d323c076f-public-tls-certs") pod "swift-proxy-6d59599fcd-hn254" (UID: "fe2105ae-76c1-452b-bee1-074d323c076f") : secret "cert-swift-public-svc" not found Mar 16 16:12:19 crc kubenswrapper[5120]: I0316 16:12:19.617236 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-db-create-tsb2s"] Mar 16 16:12:19 crc kubenswrapper[5120]: I0316 16:12:19.646972 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-f09c-account-create-update-c5rvl"] Mar 16 16:12:19 crc kubenswrapper[5120]: I0316 16:12:19.649408 5120 generic.go:358] "Generic (PLEG): container finished" podID="fb47226c-c927-43f1-9028-cfdc5dcd2e89" containerID="60324513292e67399e801c3f75048966767e12abc6a9079d9c7f31847ad746a3" exitCode=0 Mar 16 16:12:19 crc kubenswrapper[5120]: I0316 16:12:19.649476 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-6c44998f84-78gpn" event={"ID":"fb47226c-c927-43f1-9028-cfdc5dcd2e89","Type":"ContainerDied","Data":"60324513292e67399e801c3f75048966767e12abc6a9079d9c7f31847ad746a3"} Mar 16 16:12:19 crc kubenswrapper[5120]: I0316 16:12:19.656502 5120 generic.go:358] "Generic (PLEG): container finished" podID="0bbb1bbc-8c14-4046-bd63-cce793589d4d" containerID="3f9df4f7990f5d597db9e3cfa8764dc31f137f73c9769afb56a3bbe5c31ce33d" exitCode=0 Mar 16 16:12:19 crc kubenswrapper[5120]: I0316 16:12:19.656655 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"0bbb1bbc-8c14-4046-bd63-cce793589d4d","Type":"ContainerDied","Data":"3f9df4f7990f5d597db9e3cfa8764dc31f137f73c9769afb56a3bbe5c31ce33d"} Mar 16 16:12:19 crc kubenswrapper[5120]: I0316 16:12:19.667913 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-f09c-account-create-update-c5rvl"] Mar 16 16:12:19 crc kubenswrapper[5120]: I0316 16:12:19.682881 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:12:19 crc kubenswrapper[5120]: I0316 16:12:19.688377 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_30d44474-74de-4982-8e48-31038a50607f/ovsdbserver-nb/0.log" Mar 16 16:12:19 crc kubenswrapper[5120]: I0316 16:12:19.688418 5120 generic.go:358] "Generic (PLEG): container finished" podID="30d44474-74de-4982-8e48-31038a50607f" containerID="fbbfd6f0fd64c190f248274deb1940fd09e15076025138df16cb70d5ebc9868a" exitCode=2 Mar 16 16:12:19 crc kubenswrapper[5120]: I0316 16:12:19.688433 5120 generic.go:358] "Generic (PLEG): container finished" podID="30d44474-74de-4982-8e48-31038a50607f" containerID="820cf0b744b014f72ef8c35261feee7d781834c65a720335f779bb77e8523fe4" exitCode=143 Mar 16 16:12:19 crc kubenswrapper[5120]: I0316 16:12:19.689501 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"30d44474-74de-4982-8e48-31038a50607f","Type":"ContainerDied","Data":"fbbfd6f0fd64c190f248274deb1940fd09e15076025138df16cb70d5ebc9868a"} Mar 16 16:12:19 crc kubenswrapper[5120]: I0316 16:12:19.689549 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"30d44474-74de-4982-8e48-31038a50607f","Type":"ContainerDied","Data":"820cf0b744b014f72ef8c35261feee7d781834c65a720335f779bb77e8523fe4"} Mar 16 16:12:19 crc kubenswrapper[5120]: I0316 16:12:19.691161 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/234493a1-61e6-4b74-a15a-888b6cee3dff-config\") pod \"dnsmasq-dnsmasq-79dcd846c5-qwsw8\" (UID: \"234493a1-61e6-4b74-a15a-888b6cee3dff\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-qwsw8" Mar 16 16:12:19 crc kubenswrapper[5120]: I0316 16:12:19.691282 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pg9n8\" (UniqueName: \"kubernetes.io/projected/234493a1-61e6-4b74-a15a-888b6cee3dff-kube-api-access-pg9n8\") pod \"dnsmasq-dnsmasq-79dcd846c5-qwsw8\" (UID: \"234493a1-61e6-4b74-a15a-888b6cee3dff\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-qwsw8" Mar 16 16:12:19 crc kubenswrapper[5120]: I0316 16:12:19.691325 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/234493a1-61e6-4b74-a15a-888b6cee3dff-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-79dcd846c5-qwsw8\" (UID: \"234493a1-61e6-4b74-a15a-888b6cee3dff\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-qwsw8" Mar 16 16:12:19 crc kubenswrapper[5120]: I0316 16:12:19.696572 5120 generic.go:358] "Generic (PLEG): container finished" podID="5aa11a39-e139-4791-92ce-2771b0277a8b" containerID="b8adae27cb47fa8c07b0445649495ea94709c8815ea94e345953af8d7bd93388" exitCode=0 Mar 16 16:12:19 crc kubenswrapper[5120]: I0316 16:12:19.696710 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"5aa11a39-e139-4791-92ce-2771b0277a8b","Type":"ContainerDied","Data":"b8adae27cb47fa8c07b0445649495ea94709c8815ea94e345953af8d7bd93388"} Mar 16 16:12:19 crc kubenswrapper[5120]: I0316 16:12:19.745262 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_14074bd5-5aa2-44f1-b48f-1d091538fe99/ovsdbserver-sb/0.log" Mar 16 16:12:19 crc kubenswrapper[5120]: I0316 16:12:19.745306 5120 generic.go:358] "Generic (PLEG): container finished" podID="14074bd5-5aa2-44f1-b48f-1d091538fe99" containerID="6e20c63b4f89ca3830a2ba939de00438e53cce4885447c83c5f138a24aad4498" exitCode=2 Mar 16 16:12:19 crc kubenswrapper[5120]: I0316 16:12:19.745321 5120 generic.go:358] "Generic (PLEG): container finished" podID="14074bd5-5aa2-44f1-b48f-1d091538fe99" containerID="1f965ee3a33f3366a6e93fba345fc49e5fd735d0a812c244327a2f9e0c3cff26" exitCode=143 Mar 16 16:12:19 crc kubenswrapper[5120]: I0316 16:12:19.745435 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"14074bd5-5aa2-44f1-b48f-1d091538fe99","Type":"ContainerDied","Data":"6e20c63b4f89ca3830a2ba939de00438e53cce4885447c83c5f138a24aad4498"} Mar 16 16:12:19 crc kubenswrapper[5120]: I0316 16:12:19.745478 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"14074bd5-5aa2-44f1-b48f-1d091538fe99","Type":"ContainerDied","Data":"1f965ee3a33f3366a6e93fba345fc49e5fd735d0a812c244327a2f9e0c3cff26"} Mar 16 16:12:19 crc kubenswrapper[5120]: I0316 16:12:19.753064 5120 scope.go:117] "RemoveContainer" containerID="bc2df124cc6ad146d7c7dd2115ac815986fb62978d38895f6d345a4a9b14dbd8" Mar 16 16:12:19 crc kubenswrapper[5120]: E0316 16:12:19.753431 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:12:19 crc kubenswrapper[5120]: I0316 16:12:19.764997 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-2002-account-create-update-stfd4"] Mar 16 16:12:19 crc kubenswrapper[5120]: I0316 16:12:19.792996 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-2002-account-create-update-stfd4"] Mar 16 16:12:19 crc kubenswrapper[5120]: I0316 16:12:19.797590 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pg9n8\" (UniqueName: \"kubernetes.io/projected/234493a1-61e6-4b74-a15a-888b6cee3dff-kube-api-access-pg9n8\") pod \"dnsmasq-dnsmasq-79dcd846c5-qwsw8\" (UID: \"234493a1-61e6-4b74-a15a-888b6cee3dff\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-qwsw8" Mar 16 16:12:19 crc kubenswrapper[5120]: I0316 16:12:19.797673 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/234493a1-61e6-4b74-a15a-888b6cee3dff-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-79dcd846c5-qwsw8\" (UID: \"234493a1-61e6-4b74-a15a-888b6cee3dff\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-qwsw8" Mar 16 16:12:19 crc kubenswrapper[5120]: I0316 16:12:19.798233 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/234493a1-61e6-4b74-a15a-888b6cee3dff-config\") pod \"dnsmasq-dnsmasq-79dcd846c5-qwsw8\" (UID: \"234493a1-61e6-4b74-a15a-888b6cee3dff\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-qwsw8" Mar 16 16:12:19 crc kubenswrapper[5120]: I0316 16:12:19.801961 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/234493a1-61e6-4b74-a15a-888b6cee3dff-config\") pod \"dnsmasq-dnsmasq-79dcd846c5-qwsw8\" (UID: \"234493a1-61e6-4b74-a15a-888b6cee3dff\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-qwsw8" Mar 16 16:12:19 crc kubenswrapper[5120]: E0316 16:12:19.802256 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-config-data: configmap "rabbitmq-config-data" not found Mar 16 16:12:19 crc kubenswrapper[5120]: E0316 16:12:19.802309 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab-config-data podName:ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab nodeName:}" failed. No retries permitted until 2026-03-16 16:12:21.802296196 +0000 UTC m=+2443.956227853 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab-config-data") pod "rabbitmq-server-0" (UID: "ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab") : configmap "rabbitmq-config-data" not found Mar 16 16:12:19 crc kubenswrapper[5120]: I0316 16:12:19.802943 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/234493a1-61e6-4b74-a15a-888b6cee3dff-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-79dcd846c5-qwsw8\" (UID: \"234493a1-61e6-4b74-a15a-888b6cee3dff\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-qwsw8" Mar 16 16:12:19 crc kubenswrapper[5120]: I0316 16:12:19.805777 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-595564474-m6lrq"] Mar 16 16:12:19 crc kubenswrapper[5120]: I0316 16:12:19.806026 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-595564474-m6lrq" podUID="eefef8ba-a54a-4ee8-9c31-757cc07a6ab3" containerName="placement-log" containerID="cri-o://95e121ce2779586c5c19af119fb8c0edefa3209e5d09f88db3f67f068079313c" gracePeriod=30 Mar 16 16:12:19 crc kubenswrapper[5120]: I0316 16:12:19.806389 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-595564474-m6lrq" podUID="eefef8ba-a54a-4ee8-9c31-757cc07a6ab3" containerName="placement-api" containerID="cri-o://8a72a823ca221dc9900f87e4a72727ccf8445b5e8cb9e21be9e5da2737ba7e71" gracePeriod=30 Mar 16 16:12:19 crc kubenswrapper[5120]: I0316 16:12:19.823958 5120 generic.go:358] "Generic (PLEG): container finished" podID="48f884c6-8a4f-4581-8b21-6e4db79ae424" containerID="758c2ce99e07b0ccc53b089f1c58cd33db77d7df92e3795e3715aeb0c2df8a47" exitCode=0 Mar 16 16:12:19 crc kubenswrapper[5120]: I0316 16:12:19.824098 5120 generic.go:358] "Generic (PLEG): container finished" podID="48f884c6-8a4f-4581-8b21-6e4db79ae424" containerID="0a908a6be3baace96c3eef973eb82131e5167c3067b1203a7c21f2622485ee33" exitCode=0 Mar 16 16:12:19 crc kubenswrapper[5120]: I0316 16:12:19.824168 5120 generic.go:358] "Generic (PLEG): container finished" podID="48f884c6-8a4f-4581-8b21-6e4db79ae424" containerID="85fba775e10e93053a28f47416e4fab8a8d74704457a1dcaa326ca7d97b5b71f" exitCode=0 Mar 16 16:12:19 crc kubenswrapper[5120]: I0316 16:12:19.824225 5120 generic.go:358] "Generic (PLEG): container finished" podID="48f884c6-8a4f-4581-8b21-6e4db79ae424" containerID="0f89eb629ca87b8f3c4dc3a654ad9be3b3dbf2b9befef91351aef67313564f2a" exitCode=0 Mar 16 16:12:19 crc kubenswrapper[5120]: I0316 16:12:19.824287 5120 generic.go:358] "Generic (PLEG): container finished" podID="48f884c6-8a4f-4581-8b21-6e4db79ae424" containerID="f9a925d5514cb6701f37d65b406ab354233d03c77e454fdee7f9de6e3c4f2ec2" exitCode=0 Mar 16 16:12:19 crc kubenswrapper[5120]: I0316 16:12:19.824349 5120 generic.go:358] "Generic (PLEG): container finished" podID="48f884c6-8a4f-4581-8b21-6e4db79ae424" containerID="c0e4c801b2d8158c5198a10ed551d4bc0bd991a66fd9a3696cf629419472d00b" exitCode=0 Mar 16 16:12:19 crc kubenswrapper[5120]: I0316 16:12:19.824411 5120 generic.go:358] "Generic (PLEG): container finished" podID="48f884c6-8a4f-4581-8b21-6e4db79ae424" containerID="bd5bde381422aec36b49a27e33e7df18130a58904e5277a758731159e4602f17" exitCode=0 Mar 16 16:12:19 crc kubenswrapper[5120]: I0316 16:12:19.824474 5120 generic.go:358] "Generic (PLEG): container finished" podID="48f884c6-8a4f-4581-8b21-6e4db79ae424" containerID="c68e0b66544e05eeafb40a0ede57f1aaffd7e86fe267efb1d86740b24f029cd4" exitCode=0 Mar 16 16:12:19 crc kubenswrapper[5120]: I0316 16:12:19.824529 5120 generic.go:358] "Generic (PLEG): container finished" podID="48f884c6-8a4f-4581-8b21-6e4db79ae424" containerID="4bce9c9cadac21d7a22c0911253a06b757eab3c3a10ee9e0b5056d5ddc880b03" exitCode=0 Mar 16 16:12:19 crc kubenswrapper[5120]: I0316 16:12:19.824628 5120 generic.go:358] "Generic (PLEG): container finished" podID="48f884c6-8a4f-4581-8b21-6e4db79ae424" containerID="d15b7b1dedfc5e0bf45e87214537c30c6e63e98b399564a5d04a921d97d3ee71" exitCode=0 Mar 16 16:12:19 crc kubenswrapper[5120]: I0316 16:12:19.825095 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"48f884c6-8a4f-4581-8b21-6e4db79ae424","Type":"ContainerDied","Data":"758c2ce99e07b0ccc53b089f1c58cd33db77d7df92e3795e3715aeb0c2df8a47"} Mar 16 16:12:19 crc kubenswrapper[5120]: I0316 16:12:19.825194 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"48f884c6-8a4f-4581-8b21-6e4db79ae424","Type":"ContainerDied","Data":"0a908a6be3baace96c3eef973eb82131e5167c3067b1203a7c21f2622485ee33"} Mar 16 16:12:19 crc kubenswrapper[5120]: I0316 16:12:19.825261 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"48f884c6-8a4f-4581-8b21-6e4db79ae424","Type":"ContainerDied","Data":"85fba775e10e93053a28f47416e4fab8a8d74704457a1dcaa326ca7d97b5b71f"} Mar 16 16:12:19 crc kubenswrapper[5120]: I0316 16:12:19.825331 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"48f884c6-8a4f-4581-8b21-6e4db79ae424","Type":"ContainerDied","Data":"0f89eb629ca87b8f3c4dc3a654ad9be3b3dbf2b9befef91351aef67313564f2a"} Mar 16 16:12:19 crc kubenswrapper[5120]: I0316 16:12:19.825432 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"48f884c6-8a4f-4581-8b21-6e4db79ae424","Type":"ContainerDied","Data":"f9a925d5514cb6701f37d65b406ab354233d03c77e454fdee7f9de6e3c4f2ec2"} Mar 16 16:12:19 crc kubenswrapper[5120]: I0316 16:12:19.825508 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"48f884c6-8a4f-4581-8b21-6e4db79ae424","Type":"ContainerDied","Data":"c0e4c801b2d8158c5198a10ed551d4bc0bd991a66fd9a3696cf629419472d00b"} Mar 16 16:12:19 crc kubenswrapper[5120]: I0316 16:12:19.827569 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"48f884c6-8a4f-4581-8b21-6e4db79ae424","Type":"ContainerDied","Data":"bd5bde381422aec36b49a27e33e7df18130a58904e5277a758731159e4602f17"} Mar 16 16:12:19 crc kubenswrapper[5120]: I0316 16:12:19.827656 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"48f884c6-8a4f-4581-8b21-6e4db79ae424","Type":"ContainerDied","Data":"c68e0b66544e05eeafb40a0ede57f1aaffd7e86fe267efb1d86740b24f029cd4"} Mar 16 16:12:19 crc kubenswrapper[5120]: I0316 16:12:19.827730 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"48f884c6-8a4f-4581-8b21-6e4db79ae424","Type":"ContainerDied","Data":"4bce9c9cadac21d7a22c0911253a06b757eab3c3a10ee9e0b5056d5ddc880b03"} Mar 16 16:12:19 crc kubenswrapper[5120]: I0316 16:12:19.827836 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"48f884c6-8a4f-4581-8b21-6e4db79ae424","Type":"ContainerDied","Data":"d15b7b1dedfc5e0bf45e87214537c30c6e63e98b399564a5d04a921d97d3ee71"} Mar 16 16:12:19 crc kubenswrapper[5120]: I0316 16:12:19.832216 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-proxy-7d679bc546-fx2h2"] Mar 16 16:12:19 crc kubenswrapper[5120]: I0316 16:12:19.832819 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-proxy-7d679bc546-fx2h2" podUID="9c8fe017-e320-4b3e-894e-f4258e8d265f" containerName="proxy-httpd" containerID="cri-o://aecc9216eb6521d29e54b5a9aff4540ad9357da77ec5dc2ccefbc0aa24d52e41" gracePeriod=30 Mar 16 16:12:19 crc kubenswrapper[5120]: I0316 16:12:19.833410 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-proxy-7d679bc546-fx2h2" podUID="9c8fe017-e320-4b3e-894e-f4258e8d265f" containerName="proxy-server" containerID="cri-o://3db74fc31cc9f68950b009f39db6e01dd25ecf398c5a0a5c2f3f7b6f2dff8aa1" gracePeriod=30 Mar 16 16:12:19 crc kubenswrapper[5120]: W0316 16:12:19.839885 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod60e80199_56f5_4a0c_b023_da9c28b1051f.slice/crio-8cfb852a86a5fc4f10d3dcf4ce72a3ef22f5d91c9b4cf53f48371db345bc1a07 WatchSource:0}: Error finding container 8cfb852a86a5fc4f10d3dcf4ce72a3ef22f5d91c9b4cf53f48371db345bc1a07: Status 404 returned error can't find the container with id 8cfb852a86a5fc4f10d3dcf4ce72a3ef22f5d91c9b4cf53f48371db345bc1a07 Mar 16 16:12:19 crc kubenswrapper[5120]: I0316 16:12:19.839892 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pg9n8\" (UniqueName: \"kubernetes.io/projected/234493a1-61e6-4b74-a15a-888b6cee3dff-kube-api-access-pg9n8\") pod \"dnsmasq-dnsmasq-79dcd846c5-qwsw8\" (UID: \"234493a1-61e6-4b74-a15a-888b6cee3dff\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-qwsw8" Mar 16 16:12:19 crc kubenswrapper[5120]: I0316 16:12:19.842583 5120 generic.go:358] "Generic (PLEG): container finished" podID="6d9a26b4-a091-43f5-8625-2194e901021c" containerID="aab293db17585f8a42a939cc07e5b97a9fcea6413f5ca264b304c81a0bf0c22c" exitCode=2 Mar 16 16:12:19 crc kubenswrapper[5120]: I0316 16:12:19.842924 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="96d66c8e-8cdb-462c-a302-c85e581db5ad" containerName="cinder-scheduler" containerID="cri-o://80448d2f177c589508fc45988bee032c0821389406369ddd7f6d2a419c63e5be" gracePeriod=30 Mar 16 16:12:19 crc kubenswrapper[5120]: I0316 16:12:19.844097 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="96d66c8e-8cdb-462c-a302-c85e581db5ad" containerName="probe" containerID="cri-o://d4b6b76b9c5320477843bd780ebb20cf97063725b2d9c08ddb68df6a0c0cf879" gracePeriod=30 Mar 16 16:12:19 crc kubenswrapper[5120]: I0316 16:12:19.844709 5120 kubelet_pods.go:1019] "Unable to retrieve pull secret, the image pull may not succeed." pod="openstack-kuttl-tests/swift-proxy-6d59599fcd-hn254" secret="" err="secret \"swift-swift-dockercfg-sz7zw\" not found" Mar 16 16:12:19 crc kubenswrapper[5120]: I0316 16:12:19.843966 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"6d9a26b4-a091-43f5-8625-2194e901021c","Type":"ContainerDied","Data":"aab293db17585f8a42a939cc07e5b97a9fcea6413f5ca264b304c81a0bf0c22c"} Mar 16 16:12:19 crc kubenswrapper[5120]: I0316 16:12:19.864082 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:12:19 crc kubenswrapper[5120]: I0316 16:12:19.864422 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="88c64b50-c653-4d39-a87a-ac9a49eaf06e" containerName="cinder-api-log" containerID="cri-o://eb495c2e7830f9730c3d0cdf54a0d0956d58edbd9ce6ca99ce491ce9855f3e3d" gracePeriod=30 Mar 16 16:12:19 crc kubenswrapper[5120]: I0316 16:12:19.865140 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="88c64b50-c653-4d39-a87a-ac9a49eaf06e" containerName="cinder-api" containerID="cri-o://259a1c164b3bbbddd52006aa2c23dfa16d68542525700e849cf3e51465cc36d9" gracePeriod=30 Mar 16 16:12:19 crc kubenswrapper[5120]: I0316 16:12:19.889503 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-ecee-account-create-update-h24qw"] Mar 16 16:12:19 crc kubenswrapper[5120]: I0316 16:12:19.916384 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-ecee-account-create-update-h24qw"] Mar 16 16:12:19 crc kubenswrapper[5120]: E0316 16:12:19.923338 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-cell1-config-data: configmap "openstack-cell1-config-data" not found Mar 16 16:12:19 crc kubenswrapper[5120]: E0316 16:12:19.925422 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 16:12:19 crc kubenswrapper[5120]: E0316 16:12:19.925601 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb50beed-fd12-4d73-95bf-413136771ffe-combined-ca-bundle podName:eb50beed-fd12-4d73-95bf-413136771ffe nodeName:}" failed. No retries permitted until 2026-03-16 16:12:20.425558981 +0000 UTC m=+2442.579490638 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/eb50beed-fd12-4d73-95bf-413136771ffe-combined-ca-bundle") pod "openstack-cell1-galera-0" (UID: "eb50beed-fd12-4d73-95bf-413136771ffe") : secret "combined-ca-bundle" not found Mar 16 16:12:19 crc kubenswrapper[5120]: E0316 16:12:19.925702 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/eb50beed-fd12-4d73-95bf-413136771ffe-config-data-default podName:eb50beed-fd12-4d73-95bf-413136771ffe nodeName:}" failed. No retries permitted until 2026-03-16 16:12:20.425692994 +0000 UTC m=+2442.579624641 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "config-data-default" (UniqueName: "kubernetes.io/configmap/eb50beed-fd12-4d73-95bf-413136771ffe-config-data-default") pod "openstack-cell1-galera-0" (UID: "eb50beed-fd12-4d73-95bf-413136771ffe") : configmap "openstack-cell1-config-data" not found Mar 16 16:12:19 crc kubenswrapper[5120]: E0316 16:12:19.925833 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-cell1-config-data: configmap "openstack-cell1-config-data" not found Mar 16 16:12:19 crc kubenswrapper[5120]: E0316 16:12:19.925934 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/eb50beed-fd12-4d73-95bf-413136771ffe-kolla-config podName:eb50beed-fd12-4d73-95bf-413136771ffe nodeName:}" failed. No retries permitted until 2026-03-16 16:12:20.425924981 +0000 UTC m=+2442.579856638 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kolla-config" (UniqueName: "kubernetes.io/configmap/eb50beed-fd12-4d73-95bf-413136771ffe-kolla-config") pod "openstack-cell1-galera-0" (UID: "eb50beed-fd12-4d73-95bf-413136771ffe") : configmap "openstack-cell1-config-data" not found Mar 16 16:12:19 crc kubenswrapper[5120]: E0316 16:12:19.926205 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-galera-openstack-cell1-svc: secret "cert-galera-openstack-cell1-svc" not found Mar 16 16:12:19 crc kubenswrapper[5120]: E0316 16:12:19.937934 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb50beed-fd12-4d73-95bf-413136771ffe-galera-tls-certs podName:eb50beed-fd12-4d73-95bf-413136771ffe nodeName:}" failed. No retries permitted until 2026-03-16 16:12:20.437904035 +0000 UTC m=+2442.591835682 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "galera-tls-certs" (UniqueName: "kubernetes.io/secret/eb50beed-fd12-4d73-95bf-413136771ffe-galera-tls-certs") pod "openstack-cell1-galera-0" (UID: "eb50beed-fd12-4d73-95bf-413136771ffe") : secret "cert-galera-openstack-cell1-svc" not found Mar 16 16:12:19 crc kubenswrapper[5120]: I0316 16:12:19.972798 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 16:12:19 crc kubenswrapper[5120]: I0316 16:12:19.991459 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-917a-account-create-update-6sckt"] Mar 16 16:12:20 crc kubenswrapper[5120]: I0316 16:12:20.031740 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-917a-account-create-update-6sckt"] Mar 16 16:12:20 crc kubenswrapper[5120]: I0316 16:12:20.076996 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-50f3-account-create-update-2jq2l"] Mar 16 16:12:20 crc kubenswrapper[5120]: I0316 16:12:20.114831 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-50f3-account-create-update-2jq2l"] Mar 16 16:12:20 crc kubenswrapper[5120]: E0316 16:12:20.136107 5120 projected.go:264] Couldn't get secret openstack-kuttl-tests/swift-proxy-config-data: secret "swift-proxy-config-data" not found Mar 16 16:12:20 crc kubenswrapper[5120]: E0316 16:12:20.136420 5120 projected.go:264] Couldn't get secret openstack-kuttl-tests/swift-conf: secret "swift-conf" not found Mar 16 16:12:20 crc kubenswrapper[5120]: E0316 16:12:20.136431 5120 projected.go:289] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Mar 16 16:12:20 crc kubenswrapper[5120]: E0316 16:12:20.136442 5120 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-proxy-6d59599fcd-hn254: [secret "swift-proxy-config-data" not found, secret "swift-conf" not found, configmap "swift-ring-files" not found] Mar 16 16:12:20 crc kubenswrapper[5120]: E0316 16:12:20.136495 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fe2105ae-76c1-452b-bee1-074d323c076f-etc-swift podName:fe2105ae-76c1-452b-bee1-074d323c076f nodeName:}" failed. No retries permitted until 2026-03-16 16:12:21.136480723 +0000 UTC m=+2443.290412380 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/fe2105ae-76c1-452b-bee1-074d323c076f-etc-swift") pod "swift-proxy-6d59599fcd-hn254" (UID: "fe2105ae-76c1-452b-bee1-074d323c076f") : [secret "swift-proxy-config-data" not found, secret "swift-conf" not found, configmap "swift-ring-files" not found] Mar 16 16:12:20 crc kubenswrapper[5120]: E0316 16:12:20.136783 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-swift-internal-svc: secret "cert-swift-internal-svc" not found Mar 16 16:12:20 crc kubenswrapper[5120]: E0316 16:12:20.136811 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe2105ae-76c1-452b-bee1-074d323c076f-internal-tls-certs podName:fe2105ae-76c1-452b-bee1-074d323c076f nodeName:}" failed. No retries permitted until 2026-03-16 16:12:21.136801642 +0000 UTC m=+2443.290733299 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/fe2105ae-76c1-452b-bee1-074d323c076f-internal-tls-certs") pod "swift-proxy-6d59599fcd-hn254" (UID: "fe2105ae-76c1-452b-bee1-074d323c076f") : secret "cert-swift-internal-svc" not found Mar 16 16:12:20 crc kubenswrapper[5120]: E0316 16:12:20.136848 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-swift-public-svc: secret "cert-swift-public-svc" not found Mar 16 16:12:20 crc kubenswrapper[5120]: E0316 16:12:20.136868 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe2105ae-76c1-452b-bee1-074d323c076f-public-tls-certs podName:fe2105ae-76c1-452b-bee1-074d323c076f nodeName:}" failed. No retries permitted until 2026-03-16 16:12:21.136861664 +0000 UTC m=+2443.290793321 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/fe2105ae-76c1-452b-bee1-074d323c076f-public-tls-certs") pod "swift-proxy-6d59599fcd-hn254" (UID: "fe2105ae-76c1-452b-bee1-074d323c076f") : secret "cert-swift-public-svc" not found Mar 16 16:12:20 crc kubenswrapper[5120]: E0316 16:12:20.136898 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 16:12:20 crc kubenswrapper[5120]: E0316 16:12:20.136918 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe2105ae-76c1-452b-bee1-074d323c076f-combined-ca-bundle podName:fe2105ae-76c1-452b-bee1-074d323c076f nodeName:}" failed. No retries permitted until 2026-03-16 16:12:21.136912626 +0000 UTC m=+2443.290844283 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/fe2105ae-76c1-452b-bee1-074d323c076f-combined-ca-bundle") pod "swift-proxy-6d59599fcd-hn254" (UID: "fe2105ae-76c1-452b-bee1-074d323c076f") : secret "combined-ca-bundle" not found Mar 16 16:12:20 crc kubenswrapper[5120]: I0316 16:12:20.140060 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-db-create-ltdxc"] Mar 16 16:12:20 crc kubenswrapper[5120]: I0316 16:12:20.151926 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-db-create-ltdxc"] Mar 16 16:12:20 crc kubenswrapper[5120]: I0316 16:12:20.155681 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/rabbitmq-server-0" podUID="ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab" containerName="rabbitmq" containerID="cri-o://77ffbd2a006faa2311265374def09aab4240f2b98fa437187ccdbc91b27f6851" gracePeriod=604800 Mar 16 16:12:20 crc kubenswrapper[5120]: I0316 16:12:20.165354 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-db-create-2qzvs"] Mar 16 16:12:20 crc kubenswrapper[5120]: I0316 16:12:20.188233 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-db-create-2qzvs"] Mar 16 16:12:20 crc kubenswrapper[5120]: I0316 16:12:20.217148 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-cb8df78d6-4gf8s"] Mar 16 16:12:20 crc kubenswrapper[5120]: I0316 16:12:20.217520 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-cb8df78d6-4gf8s" podUID="5cf58a8f-dfb4-4a0a-b96c-000333125dd0" containerName="neutron-api" containerID="cri-o://2af07be619d918d455ab3453bb4c324e7039b7c37a76d4c43b38c031fb72a931" gracePeriod=30 Mar 16 16:12:20 crc kubenswrapper[5120]: I0316 16:12:20.218223 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-cb8df78d6-4gf8s" podUID="5cf58a8f-dfb4-4a0a-b96c-000333125dd0" containerName="neutron-httpd" containerID="cri-o://773740d0b4fcf1873d3b8d878cfa118bc3e28448d6a770da23e0930fde30d6cc" gracePeriod=30 Mar 16 16:12:20 crc kubenswrapper[5120]: I0316 16:12:20.221067 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-4e5e-account-create-update-ft8f9"] Mar 16 16:12:20 crc kubenswrapper[5120]: I0316 16:12:20.285829 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-db-create-sb9g5"] Mar 16 16:12:20 crc kubenswrapper[5120]: I0316 16:12:20.347113 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-ecee-account-create-update-vpjvm" Mar 16 16:12:20 crc kubenswrapper[5120]: I0316 16:12:20.356856 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-qm2tb"] Mar 16 16:12:20 crc kubenswrapper[5120]: E0316 16:12:20.368441 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cinder-api-config-data: secret "cinder-api-config-data" not found Mar 16 16:12:20 crc kubenswrapper[5120]: E0316 16:12:20.372872 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88c64b50-c653-4d39-a87a-ac9a49eaf06e-config-data-custom podName:88c64b50-c653-4d39-a87a-ac9a49eaf06e nodeName:}" failed. No retries permitted until 2026-03-16 16:12:22.372853337 +0000 UTC m=+2444.526784994 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "config-data-custom" (UniqueName: "kubernetes.io/secret/88c64b50-c653-4d39-a87a-ac9a49eaf06e-config-data-custom") pod "cinder-api-0" (UID: "88c64b50-c653-4d39-a87a-ac9a49eaf06e") : secret "cinder-api-config-data" not found Mar 16 16:12:20 crc kubenswrapper[5120]: E0316 16:12:20.372873 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-cinder-public-svc: secret "cert-cinder-public-svc" not found Mar 16 16:12:20 crc kubenswrapper[5120]: E0316 16:12:20.373081 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88c64b50-c653-4d39-a87a-ac9a49eaf06e-public-tls-certs podName:88c64b50-c653-4d39-a87a-ac9a49eaf06e nodeName:}" failed. No retries permitted until 2026-03-16 16:12:22.373070563 +0000 UTC m=+2444.527002220 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/88c64b50-c653-4d39-a87a-ac9a49eaf06e-public-tls-certs") pod "cinder-api-0" (UID: "88c64b50-c653-4d39-a87a-ac9a49eaf06e") : secret "cert-cinder-public-svc" not found Mar 16 16:12:20 crc kubenswrapper[5120]: E0316 16:12:20.370872 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cinder-config-data: secret "cinder-config-data" not found Mar 16 16:12:20 crc kubenswrapper[5120]: E0316 16:12:20.373241 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88c64b50-c653-4d39-a87a-ac9a49eaf06e-config-data podName:88c64b50-c653-4d39-a87a-ac9a49eaf06e nodeName:}" failed. No retries permitted until 2026-03-16 16:12:22.373232187 +0000 UTC m=+2444.527163844 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/secret/88c64b50-c653-4d39-a87a-ac9a49eaf06e-config-data") pod "cinder-api-0" (UID: "88c64b50-c653-4d39-a87a-ac9a49eaf06e") : secret "cinder-config-data" not found Mar 16 16:12:20 crc kubenswrapper[5120]: E0316 16:12:20.370930 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-cinder-internal-svc: secret "cert-cinder-internal-svc" not found Mar 16 16:12:20 crc kubenswrapper[5120]: E0316 16:12:20.373399 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88c64b50-c653-4d39-a87a-ac9a49eaf06e-internal-tls-certs podName:88c64b50-c653-4d39-a87a-ac9a49eaf06e nodeName:}" failed. No retries permitted until 2026-03-16 16:12:22.373389751 +0000 UTC m=+2444.527321408 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/88c64b50-c653-4d39-a87a-ac9a49eaf06e-internal-tls-certs") pod "cinder-api-0" (UID: "88c64b50-c653-4d39-a87a-ac9a49eaf06e") : secret "cert-cinder-internal-svc" not found Mar 16 16:12:20 crc kubenswrapper[5120]: E0316 16:12:20.370977 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 16:12:20 crc kubenswrapper[5120]: E0316 16:12:20.373564 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bba65a98-1383-4c8c-995a-b212b232d1f8-combined-ca-bundle podName:bba65a98-1383-4c8c-995a-b212b232d1f8 nodeName:}" failed. No retries permitted until 2026-03-16 16:12:22.373554707 +0000 UTC m=+2444.527486364 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/bba65a98-1383-4c8c-995a-b212b232d1f8-combined-ca-bundle") pod "nova-scheduler-0" (UID: "bba65a98-1383-4c8c-995a-b212b232d1f8") : secret "combined-ca-bundle" not found Mar 16 16:12:20 crc kubenswrapper[5120]: E0316 16:12:20.371017 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Mar 16 16:12:20 crc kubenswrapper[5120]: E0316 16:12:20.373728 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a-config-data podName:de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a nodeName:}" failed. No retries permitted until 2026-03-16 16:12:22.373717061 +0000 UTC m=+2444.527648718 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a-config-data") pod "rabbitmq-cell1-server-0" (UID: "de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a") : configmap "rabbitmq-cell1-config-data" not found Mar 16 16:12:20 crc kubenswrapper[5120]: E0316 16:12:20.371061 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 16:12:20 crc kubenswrapper[5120]: E0316 16:12:20.373952 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88c64b50-c653-4d39-a87a-ac9a49eaf06e-combined-ca-bundle podName:88c64b50-c653-4d39-a87a-ac9a49eaf06e nodeName:}" failed. No retries permitted until 2026-03-16 16:12:22.373943747 +0000 UTC m=+2444.527875404 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/88c64b50-c653-4d39-a87a-ac9a49eaf06e-combined-ca-bundle") pod "cinder-api-0" (UID: "88c64b50-c653-4d39-a87a-ac9a49eaf06e") : secret "combined-ca-bundle" not found Mar 16 16:12:20 crc kubenswrapper[5120]: E0316 16:12:20.369625 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cinder-scripts: secret "cinder-scripts" not found Mar 16 16:12:20 crc kubenswrapper[5120]: E0316 16:12:20.374123 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88c64b50-c653-4d39-a87a-ac9a49eaf06e-scripts podName:88c64b50-c653-4d39-a87a-ac9a49eaf06e nodeName:}" failed. No retries permitted until 2026-03-16 16:12:22.374109041 +0000 UTC m=+2444.528040698 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "scripts" (UniqueName: "kubernetes.io/secret/88c64b50-c653-4d39-a87a-ac9a49eaf06e-scripts") pod "cinder-api-0" (UID: "88c64b50-c653-4d39-a87a-ac9a49eaf06e") : secret "cinder-scripts" not found Mar 16 16:12:20 crc kubenswrapper[5120]: I0316 16:12:20.412117 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-db-create-sb9g5"] Mar 16 16:12:20 crc kubenswrapper[5120]: I0316 16:12:20.468981 5120 kubelet_pods.go:1019] "Unable to retrieve pull secret, the image pull may not succeed." pod="openstack-kuttl-tests/nova-cell1-917a-account-create-update-942tp" secret="" err="secret \"galera-openstack-cell1-dockercfg-77k5f\" not found" Mar 16 16:12:20 crc kubenswrapper[5120]: I0316 16:12:20.469033 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-917a-account-create-update-942tp" Mar 16 16:12:20 crc kubenswrapper[5120]: E0316 16:12:20.473148 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-cell1-config-data: configmap "openstack-cell1-config-data" not found Mar 16 16:12:20 crc kubenswrapper[5120]: E0316 16:12:20.473223 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/eb50beed-fd12-4d73-95bf-413136771ffe-config-data-default podName:eb50beed-fd12-4d73-95bf-413136771ffe nodeName:}" failed. No retries permitted until 2026-03-16 16:12:21.473208661 +0000 UTC m=+2443.627140318 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "config-data-default" (UniqueName: "kubernetes.io/configmap/eb50beed-fd12-4d73-95bf-413136771ffe-config-data-default") pod "openstack-cell1-galera-0" (UID: "eb50beed-fd12-4d73-95bf-413136771ffe") : configmap "openstack-cell1-config-data" not found Mar 16 16:12:20 crc kubenswrapper[5120]: E0316 16:12:20.476904 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-cell1-config-data: configmap "openstack-cell1-config-data" not found Mar 16 16:12:20 crc kubenswrapper[5120]: E0316 16:12:20.476994 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/eb50beed-fd12-4d73-95bf-413136771ffe-kolla-config podName:eb50beed-fd12-4d73-95bf-413136771ffe nodeName:}" failed. No retries permitted until 2026-03-16 16:12:21.476975712 +0000 UTC m=+2443.630907369 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kolla-config" (UniqueName: "kubernetes.io/configmap/eb50beed-fd12-4d73-95bf-413136771ffe-kolla-config") pod "openstack-cell1-galera-0" (UID: "eb50beed-fd12-4d73-95bf-413136771ffe") : configmap "openstack-cell1-config-data" not found Mar 16 16:12:20 crc kubenswrapper[5120]: E0316 16:12:20.477572 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-galera-openstack-cell1-svc: secret "cert-galera-openstack-cell1-svc" not found Mar 16 16:12:20 crc kubenswrapper[5120]: E0316 16:12:20.477602 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb50beed-fd12-4d73-95bf-413136771ffe-galera-tls-certs podName:eb50beed-fd12-4d73-95bf-413136771ffe nodeName:}" failed. No retries permitted until 2026-03-16 16:12:21.47759472 +0000 UTC m=+2443.631526377 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "galera-tls-certs" (UniqueName: "kubernetes.io/secret/eb50beed-fd12-4d73-95bf-413136771ffe-galera-tls-certs") pod "openstack-cell1-galera-0" (UID: "eb50beed-fd12-4d73-95bf-413136771ffe") : secret "cert-galera-openstack-cell1-svc" not found Mar 16 16:12:20 crc kubenswrapper[5120]: E0316 16:12:20.477646 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 16:12:20 crc kubenswrapper[5120]: E0316 16:12:20.477668 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb50beed-fd12-4d73-95bf-413136771ffe-combined-ca-bundle podName:eb50beed-fd12-4d73-95bf-413136771ffe nodeName:}" failed. No retries permitted until 2026-03-16 16:12:21.477662421 +0000 UTC m=+2443.631594078 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/eb50beed-fd12-4d73-95bf-413136771ffe-combined-ca-bundle") pod "openstack-cell1-galera-0" (UID: "eb50beed-fd12-4d73-95bf-413136771ffe") : secret "combined-ca-bundle" not found Mar 16 16:12:20 crc kubenswrapper[5120]: I0316 16:12:20.574516 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-qm2tb"] Mar 16 16:12:20 crc kubenswrapper[5120]: E0316 16:12:20.576544 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-cell1-scripts: configmap "openstack-cell1-scripts" not found Mar 16 16:12:20 crc kubenswrapper[5120]: E0316 16:12:20.576599 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1d95fd75-2d15-48f7-9605-2d1980ebeff2-operator-scripts podName:1d95fd75-2d15-48f7-9605-2d1980ebeff2 nodeName:}" failed. No retries permitted until 2026-03-16 16:12:21.076584566 +0000 UTC m=+2443.230516223 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/1d95fd75-2d15-48f7-9605-2d1980ebeff2-operator-scripts") pod "nova-cell1-917a-account-create-update-942tp" (UID: "1d95fd75-2d15-48f7-9605-2d1980ebeff2") : configmap "openstack-cell1-scripts" not found Mar 16 16:12:20 crc kubenswrapper[5120]: I0316 16:12:20.608402 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-qwsw8" Mar 16 16:12:20 crc kubenswrapper[5120]: I0316 16:12:20.641245 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_14074bd5-5aa2-44f1-b48f-1d091538fe99/ovsdbserver-sb/0.log" Mar 16 16:12:20 crc kubenswrapper[5120]: I0316 16:12:20.641326 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:12:20 crc kubenswrapper[5120]: I0316 16:12:20.644437 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-srzmb"] Mar 16 16:12:20 crc kubenswrapper[5120]: I0316 16:12:20.650991 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-srzmb"] Mar 16 16:12:20 crc kubenswrapper[5120]: I0316 16:12:20.659390 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-6c05-account-create-update-9n5cf"] Mar 16 16:12:20 crc kubenswrapper[5120]: E0316 16:12:20.679808 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cinder-scripts: secret "cinder-scripts" not found Mar 16 16:12:20 crc kubenswrapper[5120]: E0316 16:12:20.679880 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96d66c8e-8cdb-462c-a302-c85e581db5ad-scripts podName:96d66c8e-8cdb-462c-a302-c85e581db5ad nodeName:}" failed. No retries permitted until 2026-03-16 16:12:22.679865667 +0000 UTC m=+2444.833797324 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "scripts" (UniqueName: "kubernetes.io/secret/96d66c8e-8cdb-462c-a302-c85e581db5ad-scripts") pod "cinder-scheduler-0" (UID: "96d66c8e-8cdb-462c-a302-c85e581db5ad") : secret "cinder-scripts" not found Mar 16 16:12:20 crc kubenswrapper[5120]: E0316 16:12:20.680430 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 16:12:20 crc kubenswrapper[5120]: E0316 16:12:20.680459 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96d66c8e-8cdb-462c-a302-c85e581db5ad-combined-ca-bundle podName:96d66c8e-8cdb-462c-a302-c85e581db5ad nodeName:}" failed. No retries permitted until 2026-03-16 16:12:22.680451404 +0000 UTC m=+2444.834383061 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/96d66c8e-8cdb-462c-a302-c85e581db5ad-combined-ca-bundle") pod "cinder-scheduler-0" (UID: "96d66c8e-8cdb-462c-a302-c85e581db5ad") : secret "combined-ca-bundle" not found Mar 16 16:12:20 crc kubenswrapper[5120]: E0316 16:12:20.704319 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cinder-config-data: secret "cinder-config-data" not found Mar 16 16:12:20 crc kubenswrapper[5120]: E0316 16:12:20.704379 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96d66c8e-8cdb-462c-a302-c85e581db5ad-config-data podName:96d66c8e-8cdb-462c-a302-c85e581db5ad nodeName:}" failed. No retries permitted until 2026-03-16 16:12:22.704362853 +0000 UTC m=+2444.858294510 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/secret/96d66c8e-8cdb-462c-a302-c85e581db5ad-config-data") pod "cinder-scheduler-0" (UID: "96d66c8e-8cdb-462c-a302-c85e581db5ad") : secret "cinder-config-data" not found Mar 16 16:12:20 crc kubenswrapper[5120]: E0316 16:12:20.704415 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cinder-scheduler-config-data: secret "cinder-scheduler-config-data" not found Mar 16 16:12:20 crc kubenswrapper[5120]: E0316 16:12:20.704436 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96d66c8e-8cdb-462c-a302-c85e581db5ad-config-data-custom podName:96d66c8e-8cdb-462c-a302-c85e581db5ad nodeName:}" failed. No retries permitted until 2026-03-16 16:12:22.704428614 +0000 UTC m=+2444.858360271 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "config-data-custom" (UniqueName: "kubernetes.io/secret/96d66c8e-8cdb-462c-a302-c85e581db5ad-config-data-custom") pod "cinder-scheduler-0" (UID: "96d66c8e-8cdb-462c-a302-c85e581db5ad") : secret "cinder-scheduler-config-data" not found Mar 16 16:12:20 crc kubenswrapper[5120]: I0316 16:12:20.706188 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-69787fc498-jx88k" podUID="34da2089-cc88-4d8c-97da-68aadf7f2c03" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.0.154:9311/healthcheck\": read tcp 10.217.0.2:45052->10.217.0.154:9311: read: connection reset by peer" Mar 16 16:12:20 crc kubenswrapper[5120]: I0316 16:12:20.706256 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-69787fc498-jx88k" podUID="34da2089-cc88-4d8c-97da-68aadf7f2c03" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.0.154:9311/healthcheck\": read tcp 10.217.0.2:45050->10.217.0.154:9311: read: connection reset by peer" Mar 16 16:12:20 crc kubenswrapper[5120]: I0316 16:12:20.708719 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0008a48f-3c91-43dc-be3f-6ba3697e01dc" path="/var/lib/kubelet/pods/0008a48f-3c91-43dc-be3f-6ba3697e01dc/volumes" Mar 16 16:12:20 crc kubenswrapper[5120]: I0316 16:12:20.734926 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b4120b5-aa8b-4c93-a209-e3769c0069d3" path="/var/lib/kubelet/pods/0b4120b5-aa8b-4c93-a209-e3769c0069d3/volumes" Mar 16 16:12:20 crc kubenswrapper[5120]: I0316 16:12:20.735704 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2d1f257e-85ac-4cb3-9991-645d525d9dee" path="/var/lib/kubelet/pods/2d1f257e-85ac-4cb3-9991-645d525d9dee/volumes" Mar 16 16:12:20 crc kubenswrapper[5120]: I0316 16:12:20.736202 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2ea6a8e2-a7a3-4ba1-8d0a-84869664dbea" path="/var/lib/kubelet/pods/2ea6a8e2-a7a3-4ba1-8d0a-84869664dbea/volumes" Mar 16 16:12:20 crc kubenswrapper[5120]: I0316 16:12:20.740665 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="470f5778-f4dd-45ce-8057-44b18c9cd5b3" path="/var/lib/kubelet/pods/470f5778-f4dd-45ce-8057-44b18c9cd5b3/volumes" Mar 16 16:12:20 crc kubenswrapper[5120]: I0316 16:12:20.741432 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="559241a9-026f-4ede-ac27-e2fbad0e21cf" path="/var/lib/kubelet/pods/559241a9-026f-4ede-ac27-e2fbad0e21cf/volumes" Mar 16 16:12:20 crc kubenswrapper[5120]: I0316 16:12:20.749629 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7d156ff3-9ed3-4e45-81f4-5c0f0115833e" path="/var/lib/kubelet/pods/7d156ff3-9ed3-4e45-81f4-5c0f0115833e/volumes" Mar 16 16:12:20 crc kubenswrapper[5120]: I0316 16:12:20.750254 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="807be2e6-5651-4f26-a39a-4a11e91d9472" path="/var/lib/kubelet/pods/807be2e6-5651-4f26-a39a-4a11e91d9472/volumes" Mar 16 16:12:20 crc kubenswrapper[5120]: I0316 16:12:20.750740 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="87bfd7ec-53c8-49c4-b69b-e3f39ba9f3ec" path="/var/lib/kubelet/pods/87bfd7ec-53c8-49c4-b69b-e3f39ba9f3ec/volumes" Mar 16 16:12:20 crc kubenswrapper[5120]: I0316 16:12:20.752127 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8c16742b-29b5-4435-b031-600996c395a6" path="/var/lib/kubelet/pods/8c16742b-29b5-4435-b031-600996c395a6/volumes" Mar 16 16:12:20 crc kubenswrapper[5120]: I0316 16:12:20.754403 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a3b4da1-9cf7-4528-ac87-31dee1cd7afb" path="/var/lib/kubelet/pods/9a3b4da1-9cf7-4528-ac87-31dee1cd7afb/volumes" Mar 16 16:12:20 crc kubenswrapper[5120]: I0316 16:12:20.754936 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ff13503-936e-40c0-a53b-f7aba6d18207" path="/var/lib/kubelet/pods/9ff13503-936e-40c0-a53b-f7aba6d18207/volumes" Mar 16 16:12:20 crc kubenswrapper[5120]: I0316 16:12:20.794457 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-twbbf\" (UniqueName: \"kubernetes.io/projected/14074bd5-5aa2-44f1-b48f-1d091538fe99-kube-api-access-twbbf\") pod \"14074bd5-5aa2-44f1-b48f-1d091538fe99\" (UID: \"14074bd5-5aa2-44f1-b48f-1d091538fe99\") " Mar 16 16:12:20 crc kubenswrapper[5120]: I0316 16:12:20.794526 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/14074bd5-5aa2-44f1-b48f-1d091538fe99-ovsdb-rundir\") pod \"14074bd5-5aa2-44f1-b48f-1d091538fe99\" (UID: \"14074bd5-5aa2-44f1-b48f-1d091538fe99\") " Mar 16 16:12:20 crc kubenswrapper[5120]: I0316 16:12:20.794632 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/14074bd5-5aa2-44f1-b48f-1d091538fe99-scripts\") pod \"14074bd5-5aa2-44f1-b48f-1d091538fe99\" (UID: \"14074bd5-5aa2-44f1-b48f-1d091538fe99\") " Mar 16 16:12:20 crc kubenswrapper[5120]: I0316 16:12:20.794805 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/14074bd5-5aa2-44f1-b48f-1d091538fe99-metrics-certs-tls-certs\") pod \"14074bd5-5aa2-44f1-b48f-1d091538fe99\" (UID: \"14074bd5-5aa2-44f1-b48f-1d091538fe99\") " Mar 16 16:12:20 crc kubenswrapper[5120]: I0316 16:12:20.794921 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovndbcluster-sb-etc-ovn\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"14074bd5-5aa2-44f1-b48f-1d091538fe99\" (UID: \"14074bd5-5aa2-44f1-b48f-1d091538fe99\") " Mar 16 16:12:20 crc kubenswrapper[5120]: I0316 16:12:20.795059 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/14074bd5-5aa2-44f1-b48f-1d091538fe99-config\") pod \"14074bd5-5aa2-44f1-b48f-1d091538fe99\" (UID: \"14074bd5-5aa2-44f1-b48f-1d091538fe99\") " Mar 16 16:12:20 crc kubenswrapper[5120]: I0316 16:12:20.795158 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/14074bd5-5aa2-44f1-b48f-1d091538fe99-combined-ca-bundle\") pod \"14074bd5-5aa2-44f1-b48f-1d091538fe99\" (UID: \"14074bd5-5aa2-44f1-b48f-1d091538fe99\") " Mar 16 16:12:20 crc kubenswrapper[5120]: I0316 16:12:20.795354 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/14074bd5-5aa2-44f1-b48f-1d091538fe99-ovsdbserver-sb-tls-certs\") pod \"14074bd5-5aa2-44f1-b48f-1d091538fe99\" (UID: \"14074bd5-5aa2-44f1-b48f-1d091538fe99\") " Mar 16 16:12:20 crc kubenswrapper[5120]: I0316 16:12:20.815175 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14074bd5-5aa2-44f1-b48f-1d091538fe99-config" (OuterVolumeSpecName: "config") pod "14074bd5-5aa2-44f1-b48f-1d091538fe99" (UID: "14074bd5-5aa2-44f1-b48f-1d091538fe99"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:12:20 crc kubenswrapper[5120]: I0316 16:12:20.821345 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14074bd5-5aa2-44f1-b48f-1d091538fe99-ovsdb-rundir" (OuterVolumeSpecName: "ovsdb-rundir") pod "14074bd5-5aa2-44f1-b48f-1d091538fe99" (UID: "14074bd5-5aa2-44f1-b48f-1d091538fe99"). InnerVolumeSpecName "ovsdb-rundir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:12:20 crc kubenswrapper[5120]: I0316 16:12:20.822745 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14074bd5-5aa2-44f1-b48f-1d091538fe99-scripts" (OuterVolumeSpecName: "scripts") pod "14074bd5-5aa2-44f1-b48f-1d091538fe99" (UID: "14074bd5-5aa2-44f1-b48f-1d091538fe99"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:12:20 crc kubenswrapper[5120]: I0316 16:12:20.823481 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d247de94-c318-4161-a382-99a79cf7758c" path="/var/lib/kubelet/pods/d247de94-c318-4161-a382-99a79cf7758c/volumes" Mar 16 16:12:20 crc kubenswrapper[5120]: I0316 16:12:20.835418 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="db2e0899-ea7d-4d2b-a32b-86633648d762" path="/var/lib/kubelet/pods/db2e0899-ea7d-4d2b-a32b-86633648d762/volumes" Mar 16 16:12:20 crc kubenswrapper[5120]: I0316 16:12:20.840256 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eb1e112a-eec6-4aef-93fb-f809f1c7e6be" path="/var/lib/kubelet/pods/eb1e112a-eec6-4aef-93fb-f809f1c7e6be/volumes" Mar 16 16:12:20 crc kubenswrapper[5120]: I0316 16:12:20.840804 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f9c983a9-b335-4d5a-91a7-d8f4d332ba77" path="/var/lib/kubelet/pods/f9c983a9-b335-4d5a-91a7-d8f4d332ba77/volumes" Mar 16 16:12:20 crc kubenswrapper[5120]: I0316 16:12:20.853697 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage02-crc" (OuterVolumeSpecName: "ovndbcluster-sb-etc-ovn") pod "14074bd5-5aa2-44f1-b48f-1d091538fe99" (UID: "14074bd5-5aa2-44f1-b48f-1d091538fe99"). InnerVolumeSpecName "local-storage02-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:12:20 crc kubenswrapper[5120]: I0316 16:12:20.910412 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14074bd5-5aa2-44f1-b48f-1d091538fe99-kube-api-access-twbbf" (OuterVolumeSpecName: "kube-api-access-twbbf") pod "14074bd5-5aa2-44f1-b48f-1d091538fe99" (UID: "14074bd5-5aa2-44f1-b48f-1d091538fe99"). InnerVolumeSpecName "kube-api-access-twbbf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:12:20 crc kubenswrapper[5120]: I0316 16:12:20.930642 5120 generic.go:358] "Generic (PLEG): container finished" podID="a8389bad-6789-42fe-8506-5ac83ff9514f" containerID="2fa42e597db80f165871a57845e4e2ef64e3229a4086efd36ecbeea07cd1fa0c" exitCode=137 Mar 16 16:12:20 crc kubenswrapper[5120]: I0316 16:12:20.937155 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-twbbf\" (UniqueName: \"kubernetes.io/projected/14074bd5-5aa2-44f1-b48f-1d091538fe99-kube-api-access-twbbf\") pod \"14074bd5-5aa2-44f1-b48f-1d091538fe99\" (UID: \"14074bd5-5aa2-44f1-b48f-1d091538fe99\") " Mar 16 16:12:20 crc kubenswrapper[5120]: I0316 16:12:20.938126 5120 generic.go:358] "Generic (PLEG): container finished" podID="9c8fe017-e320-4b3e-894e-f4258e8d265f" containerID="aecc9216eb6521d29e54b5a9aff4540ad9357da77ec5dc2ccefbc0aa24d52e41" exitCode=0 Mar 16 16:12:20 crc kubenswrapper[5120]: W0316 16:12:20.938424 5120 empty_dir.go:511] Warning: Unmount skipped because path does not exist: /var/lib/kubelet/pods/14074bd5-5aa2-44f1-b48f-1d091538fe99/volumes/kubernetes.io~projected/kube-api-access-twbbf Mar 16 16:12:20 crc kubenswrapper[5120]: I0316 16:12:20.938489 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14074bd5-5aa2-44f1-b48f-1d091538fe99-kube-api-access-twbbf" (OuterVolumeSpecName: "kube-api-access-twbbf") pod "14074bd5-5aa2-44f1-b48f-1d091538fe99" (UID: "14074bd5-5aa2-44f1-b48f-1d091538fe99"). InnerVolumeSpecName "kube-api-access-twbbf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:12:20 crc kubenswrapper[5120]: I0316 16:12:20.968633 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-twbbf\" (UniqueName: \"kubernetes.io/projected/14074bd5-5aa2-44f1-b48f-1d091538fe99-kube-api-access-twbbf\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:20 crc kubenswrapper[5120]: I0316 16:12:20.968948 5120 reconciler_common.go:299] "Volume detached for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/14074bd5-5aa2-44f1-b48f-1d091538fe99-ovsdb-rundir\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:20 crc kubenswrapper[5120]: I0316 16:12:20.968960 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/14074bd5-5aa2-44f1-b48f-1d091538fe99-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:20 crc kubenswrapper[5120]: I0316 16:12:20.968981 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") on node \"crc\" " Mar 16 16:12:20 crc kubenswrapper[5120]: I0316 16:12:20.968992 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/14074bd5-5aa2-44f1-b48f-1d091538fe99-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:20 crc kubenswrapper[5120]: I0316 16:12:20.972698 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-7d679bc546-fx2h2" event={"ID":"9c8fe017-e320-4b3e-894e-f4258e8d265f","Type":"ContainerDied","Data":"aecc9216eb6521d29e54b5a9aff4540ad9357da77ec5dc2ccefbc0aa24d52e41"} Mar 16 16:12:20 crc kubenswrapper[5120]: I0316 16:12:20.972739 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-6c05-account-create-update-9n5cf"] Mar 16 16:12:20 crc kubenswrapper[5120]: I0316 16:12:20.972783 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-db-create-cps55"] Mar 16 16:12:20 crc kubenswrapper[5120]: I0316 16:12:20.972793 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-db-create-cps55"] Mar 16 16:12:20 crc kubenswrapper[5120]: I0316 16:12:20.972805 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-2fe2-account-create-update-b6c5t"] Mar 16 16:12:20 crc kubenswrapper[5120]: I0316 16:12:20.972816 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-7cbc6f47fd-xhhn9"] Mar 16 16:12:20 crc kubenswrapper[5120]: I0316 16:12:20.972828 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-5566b7bdc5-47bld"] Mar 16 16:12:20 crc kubenswrapper[5120]: I0316 16:12:20.972838 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-f9bc678f8-6p72p"] Mar 16 16:12:20 crc kubenswrapper[5120]: I0316 16:12:20.972847 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 16:12:20 crc kubenswrapper[5120]: I0316 16:12:20.972858 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-2002-account-create-update-sg6jt"] Mar 16 16:12:20 crc kubenswrapper[5120]: I0316 16:12:20.972868 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:12:20 crc kubenswrapper[5120]: I0316 16:12:20.972877 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-dwlmc"] Mar 16 16:12:20 crc kubenswrapper[5120]: I0316 16:12:20.973086 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="10ec5605-2810-4b8c-9a6a-e5cfc3b33706" containerName="nova-api-log" containerID="cri-o://30cb524b702792b5b0d1c7e920fa43fe3cffd8cfa340a919cb3c394fe3d72112" gracePeriod=30 Mar 16 16:12:20 crc kubenswrapper[5120]: I0316 16:12:20.975198 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-7cbc6f47fd-xhhn9" podUID="28ea8203-158a-4c89-8ae6-647d230c21ff" containerName="barbican-keystone-listener-log" containerID="cri-o://5b0aa275ade968085f1b9c47c4e4571ba1ab8d6cb51953a996db3a2e2dc99e74" gracePeriod=30 Mar 16 16:12:20 crc kubenswrapper[5120]: I0316 16:12:20.975364 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-5566b7bdc5-47bld" podUID="cb4b4078-46df-4b50-aa4a-81adbbd15e52" containerName="barbican-worker-log" containerID="cri-o://59d38b77c648623aa3b83892cf22dde220f840ba2589672899727a34b307c0ba" gracePeriod=30 Mar 16 16:12:20 crc kubenswrapper[5120]: I0316 16:12:20.975504 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-f9bc678f8-6p72p" podUID="241ac7ce-90fa-4222-a274-ee00c4ba33a3" containerName="barbican-api-log" containerID="cri-o://0dadea8ab408f64e9e344819b50787a4d1b4f746bfbe3d5362a281c253d2b9e2" gracePeriod=30 Mar 16 16:12:20 crc kubenswrapper[5120]: I0316 16:12:20.976308 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="10ec5605-2810-4b8c-9a6a-e5cfc3b33706" containerName="nova-api-api" containerID="cri-o://8c7afa10201bb4e86903115fd27c78f30865b73d10743ea051ae56c76c2ea814" gracePeriod=30 Mar 16 16:12:20 crc kubenswrapper[5120]: I0316 16:12:20.976369 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-7cbc6f47fd-xhhn9" podUID="28ea8203-158a-4c89-8ae6-647d230c21ff" containerName="barbican-keystone-listener" containerID="cri-o://022fe2c06ece58fc57ef1d4dc8c366a6e5e260f72b9eaf2412cc117df1f26631" gracePeriod=30 Mar 16 16:12:20 crc kubenswrapper[5120]: I0316 16:12:20.976452 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-5566b7bdc5-47bld" podUID="cb4b4078-46df-4b50-aa4a-81adbbd15e52" containerName="barbican-worker" containerID="cri-o://c6264f1560432f3ea47f3e712f72dc705f1d96eeaa1e8dbf34ce818578d90dc4" gracePeriod=30 Mar 16 16:12:20 crc kubenswrapper[5120]: I0316 16:12:20.976554 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-f9bc678f8-6p72p" podUID="241ac7ce-90fa-4222-a274-ee00c4ba33a3" containerName="barbican-api" containerID="cri-o://12dc36279bce82525ae4b3823badcb4f88e30f5db4b097ec7671d740068dbe6c" gracePeriod=30 Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.027220 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-dwlmc"] Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.083460 5120 generic.go:358] "Generic (PLEG): container finished" podID="eefef8ba-a54a-4ee8-9c31-757cc07a6ab3" containerID="95e121ce2779586c5c19af119fb8c0edefa3209e5d09f88db3f67f068079313c" exitCode=143 Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.084660 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-595564474-m6lrq" event={"ID":"eefef8ba-a54a-4ee8-9c31-757cc07a6ab3","Type":"ContainerDied","Data":"95e121ce2779586c5c19af119fb8c0edefa3209e5d09f88db3f67f068079313c"} Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.100124 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-6c44998f84-78gpn" Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.106379 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.115379 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-m2mv9"] Mar 16 16:12:21 crc kubenswrapper[5120]: E0316 16:12:21.124904 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-cell1-scripts: configmap "openstack-cell1-scripts" not found Mar 16 16:12:21 crc kubenswrapper[5120]: E0316 16:12:21.125057 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1d95fd75-2d15-48f7-9605-2d1980ebeff2-operator-scripts podName:1d95fd75-2d15-48f7-9605-2d1980ebeff2 nodeName:}" failed. No retries permitted until 2026-03-16 16:12:22.125038647 +0000 UTC m=+2444.278970304 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/1d95fd75-2d15-48f7-9605-2d1980ebeff2-operator-scripts") pod "nova-cell1-917a-account-create-update-942tp" (UID: "1d95fd75-2d15-48f7-9605-2d1980ebeff2") : configmap "openstack-cell1-scripts" not found Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.163983 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/14074bd5-5aa2-44f1-b48f-1d091538fe99-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "14074bd5-5aa2-44f1-b48f-1d091538fe99" (UID: "14074bd5-5aa2-44f1-b48f-1d091538fe99"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.166726 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"0bbb1bbc-8c14-4046-bd63-cce793589d4d","Type":"ContainerDied","Data":"0a09872867ecf2c507f1fd2bf2e09c2a571a09f9070d27013b498f0c9aaf0aaf"} Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.168532 5120 scope.go:117] "RemoveContainer" containerID="3f9df4f7990f5d597db9e3cfa8764dc31f137f73c9769afb56a3bbe5c31ce33d" Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.231258 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4c227\" (UniqueName: \"kubernetes.io/projected/fb47226c-c927-43f1-9028-cfdc5dcd2e89-kube-api-access-4c227\") pod \"fb47226c-c927-43f1-9028-cfdc5dcd2e89\" (UID: \"fb47226c-c927-43f1-9028-cfdc5dcd2e89\") " Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.231545 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/fb47226c-c927-43f1-9028-cfdc5dcd2e89-scripts\") pod \"fb47226c-c927-43f1-9028-cfdc5dcd2e89\" (UID: \"fb47226c-c927-43f1-9028-cfdc5dcd2e89\") " Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.231594 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4nwc4\" (UniqueName: \"kubernetes.io/projected/0bbb1bbc-8c14-4046-bd63-cce793589d4d-kube-api-access-4nwc4\") pod \"0bbb1bbc-8c14-4046-bd63-cce793589d4d\" (UID: \"0bbb1bbc-8c14-4046-bd63-cce793589d4d\") " Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.231695 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fb47226c-c927-43f1-9028-cfdc5dcd2e89-combined-ca-bundle\") pod \"fb47226c-c927-43f1-9028-cfdc5dcd2e89\" (UID: \"fb47226c-c927-43f1-9028-cfdc5dcd2e89\") " Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.231747 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0bbb1bbc-8c14-4046-bd63-cce793589d4d-combined-ca-bundle\") pod \"0bbb1bbc-8c14-4046-bd63-cce793589d4d\" (UID: \"0bbb1bbc-8c14-4046-bd63-cce793589d4d\") " Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.231863 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/fb47226c-c927-43f1-9028-cfdc5dcd2e89-logs\") pod \"fb47226c-c927-43f1-9028-cfdc5dcd2e89\" (UID: \"fb47226c-c927-43f1-9028-cfdc5dcd2e89\") " Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.231930 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fb47226c-c927-43f1-9028-cfdc5dcd2e89-config-data\") pod \"fb47226c-c927-43f1-9028-cfdc5dcd2e89\" (UID: \"fb47226c-c927-43f1-9028-cfdc5dcd2e89\") " Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.231964 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/fb47226c-c927-43f1-9028-cfdc5dcd2e89-public-tls-certs\") pod \"fb47226c-c927-43f1-9028-cfdc5dcd2e89\" (UID: \"fb47226c-c927-43f1-9028-cfdc5dcd2e89\") " Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.232073 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/0bbb1bbc-8c14-4046-bd63-cce793589d4d-internal-tls-certs\") pod \"0bbb1bbc-8c14-4046-bd63-cce793589d4d\" (UID: \"0bbb1bbc-8c14-4046-bd63-cce793589d4d\") " Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.232219 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0bbb1bbc-8c14-4046-bd63-cce793589d4d-scripts\") pod \"0bbb1bbc-8c14-4046-bd63-cce793589d4d\" (UID: \"0bbb1bbc-8c14-4046-bd63-cce793589d4d\") " Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.232273 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0bbb1bbc-8c14-4046-bd63-cce793589d4d-config-data\") pod \"0bbb1bbc-8c14-4046-bd63-cce793589d4d\" (UID: \"0bbb1bbc-8c14-4046-bd63-cce793589d4d\") " Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.232297 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/0bbb1bbc-8c14-4046-bd63-cce793589d4d-httpd-run\") pod \"0bbb1bbc-8c14-4046-bd63-cce793589d4d\" (UID: \"0bbb1bbc-8c14-4046-bd63-cce793589d4d\") " Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.232314 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") pod \"0bbb1bbc-8c14-4046-bd63-cce793589d4d\" (UID: \"0bbb1bbc-8c14-4046-bd63-cce793589d4d\") " Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.232364 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/fb47226c-c927-43f1-9028-cfdc5dcd2e89-internal-tls-certs\") pod \"fb47226c-c927-43f1-9028-cfdc5dcd2e89\" (UID: \"fb47226c-c927-43f1-9028-cfdc5dcd2e89\") " Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.232499 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0bbb1bbc-8c14-4046-bd63-cce793589d4d-logs\") pod \"0bbb1bbc-8c14-4046-bd63-cce793589d4d\" (UID: \"0bbb1bbc-8c14-4046-bd63-cce793589d4d\") " Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.234181 5120 generic.go:358] "Generic (PLEG): container finished" podID="88c64b50-c653-4d39-a87a-ac9a49eaf06e" containerID="eb495c2e7830f9730c3d0cdf54a0d0956d58edbd9ce6ca99ce491ce9855f3e3d" exitCode=143 Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.234264 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"88c64b50-c653-4d39-a87a-ac9a49eaf06e","Type":"ContainerDied","Data":"eb495c2e7830f9730c3d0cdf54a0d0956d58edbd9ce6ca99ce491ce9855f3e3d"} Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.235941 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/14074bd5-5aa2-44f1-b48f-1d091538fe99-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:21 crc kubenswrapper[5120]: E0316 16:12:21.236029 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 16:12:21 crc kubenswrapper[5120]: E0316 16:12:21.236075 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe2105ae-76c1-452b-bee1-074d323c076f-combined-ca-bundle podName:fe2105ae-76c1-452b-bee1-074d323c076f nodeName:}" failed. No retries permitted until 2026-03-16 16:12:23.23606044 +0000 UTC m=+2445.389992097 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/fe2105ae-76c1-452b-bee1-074d323c076f-combined-ca-bundle") pod "swift-proxy-6d59599fcd-hn254" (UID: "fe2105ae-76c1-452b-bee1-074d323c076f") : secret "combined-ca-bundle" not found Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.251543 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-m2mv9"] Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.256322 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb47226c-c927-43f1-9028-cfdc5dcd2e89-logs" (OuterVolumeSpecName: "logs") pod "fb47226c-c927-43f1-9028-cfdc5dcd2e89" (UID: "fb47226c-c927-43f1-9028-cfdc5dcd2e89"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:12:21 crc kubenswrapper[5120]: E0316 16:12:21.257879 5120 projected.go:264] Couldn't get secret openstack-kuttl-tests/swift-proxy-config-data: secret "swift-proxy-config-data" not found Mar 16 16:12:21 crc kubenswrapper[5120]: E0316 16:12:21.257896 5120 projected.go:264] Couldn't get secret openstack-kuttl-tests/swift-conf: secret "swift-conf" not found Mar 16 16:12:21 crc kubenswrapper[5120]: E0316 16:12:21.257905 5120 projected.go:289] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Mar 16 16:12:21 crc kubenswrapper[5120]: E0316 16:12:21.257916 5120 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-proxy-6d59599fcd-hn254: [secret "swift-proxy-config-data" not found, secret "swift-conf" not found, configmap "swift-ring-files" not found] Mar 16 16:12:21 crc kubenswrapper[5120]: E0316 16:12:21.257968 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fe2105ae-76c1-452b-bee1-074d323c076f-etc-swift podName:fe2105ae-76c1-452b-bee1-074d323c076f nodeName:}" failed. No retries permitted until 2026-03-16 16:12:23.257949933 +0000 UTC m=+2445.411881590 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/fe2105ae-76c1-452b-bee1-074d323c076f-etc-swift") pod "swift-proxy-6d59599fcd-hn254" (UID: "fe2105ae-76c1-452b-bee1-074d323c076f") : [secret "swift-proxy-config-data" not found, secret "swift-conf" not found, configmap "swift-ring-files" not found] Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.259596 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0bbb1bbc-8c14-4046-bd63-cce793589d4d-scripts" (OuterVolumeSpecName: "scripts") pod "0bbb1bbc-8c14-4046-bd63-cce793589d4d" (UID: "0bbb1bbc-8c14-4046-bd63-cce793589d4d"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.266331 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage02-crc" (UniqueName: "kubernetes.io/local-volume/local-storage02-crc") on node "crc" Mar 16 16:12:21 crc kubenswrapper[5120]: E0316 16:12:21.267369 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-swift-internal-svc: secret "cert-swift-internal-svc" not found Mar 16 16:12:21 crc kubenswrapper[5120]: E0316 16:12:21.267643 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe2105ae-76c1-452b-bee1-074d323c076f-internal-tls-certs podName:fe2105ae-76c1-452b-bee1-074d323c076f nodeName:}" failed. No retries permitted until 2026-03-16 16:12:23.267621306 +0000 UTC m=+2445.421552963 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/fe2105ae-76c1-452b-bee1-074d323c076f-internal-tls-certs") pod "swift-proxy-6d59599fcd-hn254" (UID: "fe2105ae-76c1-452b-bee1-074d323c076f") : secret "cert-swift-internal-svc" not found Mar 16 16:12:21 crc kubenswrapper[5120]: E0316 16:12:21.267716 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-swift-public-svc: secret "cert-swift-public-svc" not found Mar 16 16:12:21 crc kubenswrapper[5120]: E0316 16:12:21.267741 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe2105ae-76c1-452b-bee1-074d323c076f-public-tls-certs podName:fe2105ae-76c1-452b-bee1-074d323c076f nodeName:}" failed. No retries permitted until 2026-03-16 16:12:23.267733909 +0000 UTC m=+2445.421665566 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/fe2105ae-76c1-452b-bee1-074d323c076f-public-tls-certs") pod "swift-proxy-6d59599fcd-hn254" (UID: "fe2105ae-76c1-452b-bee1-074d323c076f") : secret "cert-swift-public-svc" not found Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.280016 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-ecee-account-create-update-vpjvm"] Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.282733 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0bbb1bbc-8c14-4046-bd63-cce793589d4d-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "0bbb1bbc-8c14-4046-bd63-cce793589d4d" (UID: "0bbb1bbc-8c14-4046-bd63-cce793589d4d"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.289158 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0bbb1bbc-8c14-4046-bd63-cce793589d4d-logs" (OuterVolumeSpecName: "logs") pod "0bbb1bbc-8c14-4046-bd63-cce793589d4d" (UID: "0bbb1bbc-8c14-4046-bd63-cce793589d4d"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.289874 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0bbb1bbc-8c14-4046-bd63-cce793589d4d-kube-api-access-4nwc4" (OuterVolumeSpecName: "kube-api-access-4nwc4") pod "0bbb1bbc-8c14-4046-bd63-cce793589d4d" (UID: "0bbb1bbc-8c14-4046-bd63-cce793589d4d"). InnerVolumeSpecName "kube-api-access-4nwc4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.290416 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb47226c-c927-43f1-9028-cfdc5dcd2e89-scripts" (OuterVolumeSpecName: "scripts") pod "fb47226c-c927-43f1-9028-cfdc5dcd2e89" (UID: "fb47226c-c927-43f1-9028-cfdc5dcd2e89"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.290593 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.290851 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb47226c-c927-43f1-9028-cfdc5dcd2e89-kube-api-access-4c227" (OuterVolumeSpecName: "kube-api-access-4c227") pod "fb47226c-c927-43f1-9028-cfdc5dcd2e89" (UID: "fb47226c-c927-43f1-9028-cfdc5dcd2e89"). InnerVolumeSpecName "kube-api-access-4c227". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.319035 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage14-crc" (OuterVolumeSpecName: "glance") pod "0bbb1bbc-8c14-4046-bd63-cce793589d4d" (UID: "0bbb1bbc-8c14-4046-bd63-cce793589d4d"). InnerVolumeSpecName "local-storage14-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.337487 5120 generic.go:358] "Generic (PLEG): container finished" podID="34da2089-cc88-4d8c-97da-68aadf7f2c03" containerID="937834673f5ee947e2dce3e8165bec6e100d62a9a8ac1a43a10f874df812f3f4" exitCode=0 Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.337603 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-69787fc498-jx88k" event={"ID":"34da2089-cc88-4d8c-97da-68aadf7f2c03","Type":"ContainerDied","Data":"937834673f5ee947e2dce3e8165bec6e100d62a9a8ac1a43a10f874df812f3f4"} Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.342081 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.342359 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="17b2138c-b3ca-4538-a7d7-0dc6756650bf" containerName="nova-metadata-log" containerID="cri-o://ea430835f1beb9f77ac042d234c65b501734c5b7323a6b25a1db8b17b727e6b5" gracePeriod=30 Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.342865 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="17b2138c-b3ca-4538-a7d7-0dc6756650bf" containerName="nova-metadata-metadata" containerID="cri-o://46862529c1989fabbd8a3c6c982324fb04976c3d04492a4676f4f8667ef55b0b" gracePeriod=30 Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.354520 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0bbb1bbc-8c14-4046-bd63-cce793589d4d-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.354718 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.354728 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4c227\" (UniqueName: \"kubernetes.io/projected/fb47226c-c927-43f1-9028-cfdc5dcd2e89-kube-api-access-4c227\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.354739 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/fb47226c-c927-43f1-9028-cfdc5dcd2e89-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.354750 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4nwc4\" (UniqueName: \"kubernetes.io/projected/0bbb1bbc-8c14-4046-bd63-cce793589d4d-kube-api-access-4nwc4\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.354782 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/fb47226c-c927-43f1-9028-cfdc5dcd2e89-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.354790 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0bbb1bbc-8c14-4046-bd63-cce793589d4d-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.354798 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/0bbb1bbc-8c14-4046-bd63-cce793589d4d-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.354820 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") on node \"crc\" " Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.361668 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" podUID="de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a" containerName="rabbitmq" containerID="cri-o://3e1a51a3ccfec99f9c00ec78bcede498befec5590f2c8e330edc09f99539166d" gracePeriod=604800 Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.362008 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/14074bd5-5aa2-44f1-b48f-1d091538fe99-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "14074bd5-5aa2-44f1-b48f-1d091538fe99" (UID: "14074bd5-5aa2-44f1-b48f-1d091538fe99"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.370799 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_14074bd5-5aa2-44f1-b48f-1d091538fe99/ovsdbserver-sb/0.log" Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.370910 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"14074bd5-5aa2-44f1-b48f-1d091538fe99","Type":"ContainerDied","Data":"ba6e3dca8705a7932bf7eecbcb75a11ba5fd3ca23df983630373151493f83575"} Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.371084 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.386833 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-917a-account-create-update-942tp"] Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.396768 5120 generic.go:358] "Generic (PLEG): container finished" podID="48f884c6-8a4f-4581-8b21-6e4db79ae424" containerID="db519ba940e3ae10789232d021fe52325581ff3785213c9476636fdeaec31312" exitCode=0 Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.396791 5120 generic.go:358] "Generic (PLEG): container finished" podID="48f884c6-8a4f-4581-8b21-6e4db79ae424" containerID="f1f5ef3a1ae4a49a755f7af35d2f4253955831c27a90812260b878eecdda0e64" exitCode=0 Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.396799 5120 generic.go:358] "Generic (PLEG): container finished" podID="48f884c6-8a4f-4581-8b21-6e4db79ae424" containerID="51d5b8b2b99674a1960ad863d81ad3a57a5eb88f5643007686739c6718ac88e6" exitCode=0 Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.396931 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"48f884c6-8a4f-4581-8b21-6e4db79ae424","Type":"ContainerDied","Data":"db519ba940e3ae10789232d021fe52325581ff3785213c9476636fdeaec31312"} Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.396955 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"48f884c6-8a4f-4581-8b21-6e4db79ae424","Type":"ContainerDied","Data":"f1f5ef3a1ae4a49a755f7af35d2f4253955831c27a90812260b878eecdda0e64"} Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.396966 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"48f884c6-8a4f-4581-8b21-6e4db79ae424","Type":"ContainerDied","Data":"51d5b8b2b99674a1960ad863d81ad3a57a5eb88f5643007686739c6718ac88e6"} Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.398029 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-lx25w"] Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.405075 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-6c44998f84-78gpn" event={"ID":"fb47226c-c927-43f1-9028-cfdc5dcd2e89","Type":"ContainerDied","Data":"e3b5a8f99e86cb0d0ca7fe8d81cc45cfa19bcef8bac1b218184f31e896aefdd2"} Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.405184 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-6c44998f84-78gpn" Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.408147 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-5h578" event={"ID":"60e80199-56f5-4a0c-b023-da9c28b1051f","Type":"ContainerStarted","Data":"8cfb852a86a5fc4f10d3dcf4ce72a3ef22f5d91c9b4cf53f48371db345bc1a07"} Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.419028 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-lx25w"] Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.427804 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-62x2t"] Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.448656 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/14074bd5-5aa2-44f1-b48f-1d091538fe99-ovsdbserver-sb-tls-certs" (OuterVolumeSpecName: "ovsdbserver-sb-tls-certs") pod "14074bd5-5aa2-44f1-b48f-1d091538fe99" (UID: "14074bd5-5aa2-44f1-b48f-1d091538fe99"). InnerVolumeSpecName "ovsdbserver-sb-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.454430 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-5h578"] Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.463028 5120 reconciler_common.go:299] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/14074bd5-5aa2-44f1-b48f-1d091538fe99-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.463060 5120 reconciler_common.go:299] "Volume detached for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/14074bd5-5aa2-44f1-b48f-1d091538fe99-ovsdbserver-sb-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.474301 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-62x2t"] Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.486627 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.486985 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="bce71378-f7b0-4b73-8b4a-711353734319" containerName="nova-cell1-conductor-conductor" containerID="cri-o://db11af3fe6b07413600ae44f79a3df378f43385bd524e92444794183d150e508" gracePeriod=30 Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.530204 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.533441 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podUID="dae19557-6584-433e-a345-c373d9e8a4ae" containerName="nova-cell1-novncproxy-novncproxy" containerID="cri-o://a45d41b1d9d4e8e8b46bd068b4409058a847b35aec00d30d3d8619af44323cbf" gracePeriod=30 Mar 16 16:12:21 crc kubenswrapper[5120]: E0316 16:12:21.610879 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-cell1-config-data: configmap "openstack-cell1-config-data" not found Mar 16 16:12:21 crc kubenswrapper[5120]: E0316 16:12:21.611208 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/eb50beed-fd12-4d73-95bf-413136771ffe-kolla-config podName:eb50beed-fd12-4d73-95bf-413136771ffe nodeName:}" failed. No retries permitted until 2026-03-16 16:12:23.611191358 +0000 UTC m=+2445.765123015 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kolla-config" (UniqueName: "kubernetes.io/configmap/eb50beed-fd12-4d73-95bf-413136771ffe-kolla-config") pod "openstack-cell1-galera-0" (UID: "eb50beed-fd12-4d73-95bf-413136771ffe") : configmap "openstack-cell1-config-data" not found Mar 16 16:12:21 crc kubenswrapper[5120]: E0316 16:12:21.610963 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 16:12:21 crc kubenswrapper[5120]: E0316 16:12:21.611580 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb50beed-fd12-4d73-95bf-413136771ffe-combined-ca-bundle podName:eb50beed-fd12-4d73-95bf-413136771ffe nodeName:}" failed. No retries permitted until 2026-03-16 16:12:23.611571519 +0000 UTC m=+2445.765503176 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/eb50beed-fd12-4d73-95bf-413136771ffe-combined-ca-bundle") pod "openstack-cell1-galera-0" (UID: "eb50beed-fd12-4d73-95bf-413136771ffe") : secret "combined-ca-bundle" not found Mar 16 16:12:21 crc kubenswrapper[5120]: E0316 16:12:21.611007 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-galera-openstack-cell1-svc: secret "cert-galera-openstack-cell1-svc" not found Mar 16 16:12:21 crc kubenswrapper[5120]: E0316 16:12:21.611609 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb50beed-fd12-4d73-95bf-413136771ffe-galera-tls-certs podName:eb50beed-fd12-4d73-95bf-413136771ffe nodeName:}" failed. No retries permitted until 2026-03-16 16:12:23.61160419 +0000 UTC m=+2445.765535847 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "galera-tls-certs" (UniqueName: "kubernetes.io/secret/eb50beed-fd12-4d73-95bf-413136771ffe-galera-tls-certs") pod "openstack-cell1-galera-0" (UID: "eb50beed-fd12-4d73-95bf-413136771ffe") : secret "cert-galera-openstack-cell1-svc" not found Mar 16 16:12:21 crc kubenswrapper[5120]: E0316 16:12:21.611044 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-cell1-config-data: configmap "openstack-cell1-config-data" not found Mar 16 16:12:21 crc kubenswrapper[5120]: E0316 16:12:21.611631 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/eb50beed-fd12-4d73-95bf-413136771ffe-config-data-default podName:eb50beed-fd12-4d73-95bf-413136771ffe nodeName:}" failed. No retries permitted until 2026-03-16 16:12:23.61162693 +0000 UTC m=+2445.765558587 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "config-data-default" (UniqueName: "kubernetes.io/configmap/eb50beed-fd12-4d73-95bf-413136771ffe-config-data-default") pod "openstack-cell1-galera-0" (UID: "eb50beed-fd12-4d73-95bf-413136771ffe") : configmap "openstack-cell1-config-data" not found Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.644452 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0bbb1bbc-8c14-4046-bd63-cce793589d4d-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "0bbb1bbc-8c14-4046-bd63-cce793589d4d" (UID: "0bbb1bbc-8c14-4046-bd63-cce793589d4d"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.662572 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-6h5nj"] Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.676911 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage14-crc" (UniqueName: "kubernetes.io/local-volume/local-storage14-crc") on node "crc" Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.687502 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-6h5nj"] Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.697585 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-proxy-6d59599fcd-hn254"] Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.697830 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-proxy-6d59599fcd-hn254" podUID="fe2105ae-76c1-452b-bee1-074d323c076f" containerName="proxy-httpd" containerID="cri-o://ad75fdb465731a2e6536f1029248278779f84cd84ec9a9c1660f3efb1189e033" gracePeriod=30 Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.697945 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-proxy-6d59599fcd-hn254" podUID="fe2105ae-76c1-452b-bee1-074d323c076f" containerName="proxy-server" containerID="cri-o://33458ed69c10a0a03c3eb77b97ded5f81bf1b3bcb75d28603bc14dde98be5d90" gracePeriod=30 Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.710058 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.710435 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5" containerName="ceilometer-central-agent" containerID="cri-o://f23a5e504b736c5521e9e56ab980b7e85624440220852c3fe893ee02d1581dca" gracePeriod=30 Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.711081 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5" containerName="proxy-httpd" containerID="cri-o://da584e6bdd5f6d1ceaf64b1de15d36cf92d4ec19aa56b2e4705b2d6f7c89c834" gracePeriod=30 Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.711243 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5" containerName="ceilometer-notification-agent" containerID="cri-o://5659e4bf80f0be1a407d06d3ba6dc5bc6f3128381585870fdde39acc6b1637fe" gracePeriod=30 Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.713641 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.713659 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0bbb1bbc-8c14-4046-bd63-cce793589d4d-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.711121 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5" containerName="sg-core" containerID="cri-o://ef0d85dafcbfd3191d70121e50e81623c612e9907822eea5b7266da0a9d3455f" gracePeriod=30 Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.721245 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.729320 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/kube-state-metrics-0" podUID="bebb35a6-a910-4c16-8fa3-5462afb3341a" containerName="kube-state-metrics" containerID="cri-o://6cb705b6a3d152dced9b3cb6c4835a2490bbfadb24078d18afa5685f5ddd1a97" gracePeriod=30 Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.730133 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-6623-account-create-update-5brmz"] Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.738163 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0bbb1bbc-8c14-4046-bd63-cce793589d4d-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "0bbb1bbc-8c14-4046-bd63-cce793589d4d" (UID: "0bbb1bbc-8c14-4046-bd63-cce793589d4d"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.743598 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-6623-account-create-update-5brmz"] Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.750594 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-6623-account-create-update-5q5c8"] Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.756382 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14074bd5-5aa2-44f1-b48f-1d091538fe99" containerName="openstack-network-exporter" Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.756406 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="14074bd5-5aa2-44f1-b48f-1d091538fe99" containerName="openstack-network-exporter" Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.756421 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0bbb1bbc-8c14-4046-bd63-cce793589d4d" containerName="glance-httpd" Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.756427 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="0bbb1bbc-8c14-4046-bd63-cce793589d4d" containerName="glance-httpd" Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.756450 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb47226c-c927-43f1-9028-cfdc5dcd2e89" containerName="placement-log" Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.756455 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb47226c-c927-43f1-9028-cfdc5dcd2e89" containerName="placement-log" Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.756487 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0bbb1bbc-8c14-4046-bd63-cce793589d4d" containerName="glance-log" Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.756493 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="0bbb1bbc-8c14-4046-bd63-cce793589d4d" containerName="glance-log" Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.756513 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb47226c-c927-43f1-9028-cfdc5dcd2e89" containerName="placement-api" Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.756518 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb47226c-c927-43f1-9028-cfdc5dcd2e89" containerName="placement-api" Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.756534 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14074bd5-5aa2-44f1-b48f-1d091538fe99" containerName="ovsdbserver-sb" Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.756540 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="14074bd5-5aa2-44f1-b48f-1d091538fe99" containerName="ovsdbserver-sb" Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.756691 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="14074bd5-5aa2-44f1-b48f-1d091538fe99" containerName="openstack-network-exporter" Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.756703 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="fb47226c-c927-43f1-9028-cfdc5dcd2e89" containerName="placement-log" Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.756713 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="fb47226c-c927-43f1-9028-cfdc5dcd2e89" containerName="placement-api" Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.756721 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="0bbb1bbc-8c14-4046-bd63-cce793589d4d" containerName="glance-httpd" Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.756732 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="14074bd5-5aa2-44f1-b48f-1d091538fe99" containerName="ovsdbserver-sb" Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.756740 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="0bbb1bbc-8c14-4046-bd63-cce793589d4d" containerName="glance-log" Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.765720 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-6623-account-create-update-5q5c8" Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.767293 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-db-secret\"" Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.808111 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb47226c-c927-43f1-9028-cfdc5dcd2e89-config-data" (OuterVolumeSpecName: "config-data") pod "fb47226c-c927-43f1-9028-cfdc5dcd2e89" (UID: "fb47226c-c927-43f1-9028-cfdc5dcd2e89"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.810700 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-6623-account-create-update-5q5c8"] Mar 16 16:12:21 crc kubenswrapper[5120]: E0316 16:12:21.818862 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-config-data: configmap "rabbitmq-config-data" not found Mar 16 16:12:21 crc kubenswrapper[5120]: E0316 16:12:21.818947 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab-config-data podName:ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab nodeName:}" failed. No retries permitted until 2026-03-16 16:12:25.818925915 +0000 UTC m=+2447.972857572 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab-config-data") pod "rabbitmq-server-0" (UID: "ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab") : configmap "rabbitmq-config-data" not found Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.819279 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/dca01bf3-3d87-4d0e-9cf7-481863c6144d-operator-scripts\") pod \"keystone-6623-account-create-update-5q5c8\" (UID: \"dca01bf3-3d87-4d0e-9cf7-481863c6144d\") " pod="openstack-kuttl-tests/keystone-6623-account-create-update-5q5c8" Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.819425 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9bd8k\" (UniqueName: \"kubernetes.io/projected/dca01bf3-3d87-4d0e-9cf7-481863c6144d-kube-api-access-9bd8k\") pod \"keystone-6623-account-create-update-5q5c8\" (UID: \"dca01bf3-3d87-4d0e-9cf7-481863c6144d\") " pod="openstack-kuttl-tests/keystone-6623-account-create-update-5q5c8" Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.819683 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fb47226c-c927-43f1-9028-cfdc5dcd2e89-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.819695 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/0bbb1bbc-8c14-4046-bd63-cce793589d4d-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.843866 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-qcgqn"] Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.866178 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-r2gv8"] Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.872929 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0bbb1bbc-8c14-4046-bd63-cce793589d4d-config-data" (OuterVolumeSpecName: "config-data") pod "0bbb1bbc-8c14-4046-bd63-cce793589d4d" (UID: "0bbb1bbc-8c14-4046-bd63-cce793589d4d"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.891166 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-r2gv8"] Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.891448 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb47226c-c927-43f1-9028-cfdc5dcd2e89-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "fb47226c-c927-43f1-9028-cfdc5dcd2e89" (UID: "fb47226c-c927-43f1-9028-cfdc5dcd2e89"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.910272 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb47226c-c927-43f1-9028-cfdc5dcd2e89-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "fb47226c-c927-43f1-9028-cfdc5dcd2e89" (UID: "fb47226c-c927-43f1-9028-cfdc5dcd2e89"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.912168 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-qcgqn"] Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.927632 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/dca01bf3-3d87-4d0e-9cf7-481863c6144d-operator-scripts\") pod \"keystone-6623-account-create-update-5q5c8\" (UID: \"dca01bf3-3d87-4d0e-9cf7-481863c6144d\") " pod="openstack-kuttl-tests/keystone-6623-account-create-update-5q5c8" Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.927767 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9bd8k\" (UniqueName: \"kubernetes.io/projected/dca01bf3-3d87-4d0e-9cf7-481863c6144d-kube-api-access-9bd8k\") pod \"keystone-6623-account-create-update-5q5c8\" (UID: \"dca01bf3-3d87-4d0e-9cf7-481863c6144d\") " pod="openstack-kuttl-tests/keystone-6623-account-create-update-5q5c8" Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.928183 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/fb47226c-c927-43f1-9028-cfdc5dcd2e89-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.928201 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0bbb1bbc-8c14-4046-bd63-cce793589d4d-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.928214 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fb47226c-c927-43f1-9028-cfdc5dcd2e89-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:21 crc kubenswrapper[5120]: E0316 16:12:21.928527 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Mar 16 16:12:21 crc kubenswrapper[5120]: E0316 16:12:21.928572 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dca01bf3-3d87-4d0e-9cf7-481863c6144d-operator-scripts podName:dca01bf3-3d87-4d0e-9cf7-481863c6144d nodeName:}" failed. No retries permitted until 2026-03-16 16:12:22.428556609 +0000 UTC m=+2444.582488266 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/dca01bf3-3d87-4d0e-9cf7-481863c6144d-operator-scripts") pod "keystone-6623-account-create-update-5q5c8" (UID: "dca01bf3-3d87-4d0e-9cf7-481863c6144d") : configmap "openstack-scripts" not found Mar 16 16:12:21 crc kubenswrapper[5120]: E0316 16:12:21.934629 5120 projected.go:194] Error preparing data for projected volume kube-api-access-9bd8k for pod openstack-kuttl-tests/keystone-6623-account-create-update-5q5c8: failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 16:12:21 crc kubenswrapper[5120]: E0316 16:12:21.934754 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dca01bf3-3d87-4d0e-9cf7-481863c6144d-kube-api-access-9bd8k podName:dca01bf3-3d87-4d0e-9cf7-481863c6144d nodeName:}" failed. No retries permitted until 2026-03-16 16:12:22.434717157 +0000 UTC m=+2444.588648814 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-9bd8k" (UniqueName: "kubernetes.io/projected/dca01bf3-3d87-4d0e-9cf7-481863c6144d-kube-api-access-9bd8k") pod "keystone-6623-account-create-update-5q5c8" (UID: "dca01bf3-3d87-4d0e-9cf7-481863c6144d") : failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.944322 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.999628 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-78bffc6747-6kvnb"] Mar 16 16:12:21 crc kubenswrapper[5120]: I0316 16:12:21.999918 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/keystone-78bffc6747-6kvnb" podUID="5e5ad3cf-0d96-43a2-b8cb-38e7210af15a" containerName="keystone-api" containerID="cri-o://ba03d7a9aa13d3fbfdb1a3d6582a793bbd788100c52fcb6baa98e4ee06d7e9a1" gracePeriod=30 Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.001934 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb47226c-c927-43f1-9028-cfdc5dcd2e89-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "fb47226c-c927-43f1-9028-cfdc5dcd2e89" (UID: "fb47226c-c927-43f1-9028-cfdc5dcd2e89"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.031242 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/fb47226c-c927-43f1-9028-cfdc5dcd2e89-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.037842 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-db-create-p6pvm"] Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.048572 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-6623-account-create-update-5q5c8"] Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.055537 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-db-create-p6pvm"] Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.062110 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.062353 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/memcached-0" podUID="5470c9e3-c2c2-4294-965d-cd4ff001bd74" containerName="memcached" containerID="cri-o://db98eab7a6f5d3b89669ca8e4686fdae14940910f34a7a25a27dbe1450d84302" gracePeriod=30 Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.071869 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.072079 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="bba65a98-1383-4c8c-995a-b212b232d1f8" containerName="nova-scheduler-scheduler" containerID="cri-o://0694d284d33b8f4728b5b5db2443c16f6b7c4ab92062463e2013167e4b4a7dc6" gracePeriod=30 Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.086314 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/openstack-cell1-galera-0" podUID="eb50beed-fd12-4d73-95bf-413136771ffe" containerName="galera" containerID="cri-o://c29df80bfa19e245cc53b93fec1d5af2a0b82a317df54724fdc00fcaf211edf5" gracePeriod=30 Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.088744 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-2fe2-account-create-update-b6c5t"] Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.093696 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-4e5e-account-create-update-ft8f9"] Mar 16 16:12:22 crc kubenswrapper[5120]: E0316 16:12:22.133233 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-cell1-scripts: configmap "openstack-cell1-scripts" not found Mar 16 16:12:22 crc kubenswrapper[5120]: E0316 16:12:22.133313 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1d95fd75-2d15-48f7-9605-2d1980ebeff2-operator-scripts podName:1d95fd75-2d15-48f7-9605-2d1980ebeff2 nodeName:}" failed. No retries permitted until 2026-03-16 16:12:24.133293104 +0000 UTC m=+2446.287224761 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/1d95fd75-2d15-48f7-9605-2d1980ebeff2-operator-scripts") pod "nova-cell1-917a-account-create-update-942tp" (UID: "1d95fd75-2d15-48f7-9605-2d1980ebeff2") : configmap "openstack-cell1-scripts" not found Mar 16 16:12:22 crc kubenswrapper[5120]: E0316 16:12:22.134132 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="8ecd82c1669b50dc83fc2647cd97edc7c58898ad565a8f6fd97dffcaf6c2a4ea" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Mar 16 16:12:22 crc kubenswrapper[5120]: E0316 16:12:22.136120 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="8ecd82c1669b50dc83fc2647cd97edc7c58898ad565a8f6fd97dffcaf6c2a4ea" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Mar 16 16:12:22 crc kubenswrapper[5120]: E0316 16:12:22.138388 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="8ecd82c1669b50dc83fc2647cd97edc7c58898ad565a8f6fd97dffcaf6c2a4ea" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Mar 16 16:12:22 crc kubenswrapper[5120]: E0316 16:12:22.138450 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/ovn-northd-0" podUID="6d9a26b4-a091-43f5-8625-2194e901021c" containerName="ovn-northd" probeResult="unknown" Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.208538 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-2002-account-create-update-sg6jt"] Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.246593 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-ecee-account-create-update-vpjvm"] Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.262946 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_30d44474-74de-4982-8e48-31038a50607f/ovsdbserver-nb/0.log" Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.263024 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.266634 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.276020 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 16:12:22 crc kubenswrapper[5120]: E0316 16:12:22.279684 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-9bd8k operator-scripts], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openstack-kuttl-tests/keystone-6623-account-create-update-5q5c8" podUID="dca01bf3-3d87-4d0e-9cf7-481863c6144d" Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.282271 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.283201 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-6c44998f84-78gpn"] Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.289241 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-6c44998f84-78gpn"] Mar 16 16:12:22 crc kubenswrapper[5120]: W0316 16:12:22.321822 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod972b610c_1005_4b7a_be77_72b7d63cab89.slice/crio-d6958fa1eb24f86d268e2f88cebb71ac91887f0429d467c7d785925b0d5a0dbd WatchSource:0}: Error finding container d6958fa1eb24f86d268e2f88cebb71ac91887f0429d467c7d785925b0d5a0dbd: Status 404 returned error can't find the container with id d6958fa1eb24f86d268e2f88cebb71ac91887f0429d467c7d785925b0d5a0dbd Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.346042 5120 scope.go:117] "RemoveContainer" containerID="9d0eb7f54ad73e5e0176f83bb44308788c3b7db237e47e155f80722c12eb04ab" Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.346839 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/30d44474-74de-4982-8e48-31038a50607f-metrics-certs-tls-certs\") pod \"30d44474-74de-4982-8e48-31038a50607f\" (UID: \"30d44474-74de-4982-8e48-31038a50607f\") " Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.347262 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovndbcluster-nb-etc-ovn\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"30d44474-74de-4982-8e48-31038a50607f\" (UID: \"30d44474-74de-4982-8e48-31038a50607f\") " Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.347444 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tn47w\" (UniqueName: \"kubernetes.io/projected/5aa11a39-e139-4791-92ce-2771b0277a8b-kube-api-access-tn47w\") pod \"5aa11a39-e139-4791-92ce-2771b0277a8b\" (UID: \"5aa11a39-e139-4791-92ce-2771b0277a8b\") " Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.347502 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5aa11a39-e139-4791-92ce-2771b0277a8b-config-data\") pod \"5aa11a39-e139-4791-92ce-2771b0277a8b\" (UID: \"5aa11a39-e139-4791-92ce-2771b0277a8b\") " Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.347521 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/30d44474-74de-4982-8e48-31038a50607f-ovsdbserver-nb-tls-certs\") pod \"30d44474-74de-4982-8e48-31038a50607f\" (UID: \"30d44474-74de-4982-8e48-31038a50607f\") " Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.347567 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5aa11a39-e139-4791-92ce-2771b0277a8b-combined-ca-bundle\") pod \"5aa11a39-e139-4791-92ce-2771b0277a8b\" (UID: \"5aa11a39-e139-4791-92ce-2771b0277a8b\") " Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.347670 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5aa11a39-e139-4791-92ce-2771b0277a8b-logs\") pod \"5aa11a39-e139-4791-92ce-2771b0277a8b\" (UID: \"5aa11a39-e139-4791-92ce-2771b0277a8b\") " Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.347735 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/5aa11a39-e139-4791-92ce-2771b0277a8b-public-tls-certs\") pod \"5aa11a39-e139-4791-92ce-2771b0277a8b\" (UID: \"5aa11a39-e139-4791-92ce-2771b0277a8b\") " Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.347770 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage15-crc\") pod \"5aa11a39-e139-4791-92ce-2771b0277a8b\" (UID: \"5aa11a39-e139-4791-92ce-2771b0277a8b\") " Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.348190 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h5gm2\" (UniqueName: \"kubernetes.io/projected/30d44474-74de-4982-8e48-31038a50607f-kube-api-access-h5gm2\") pod \"30d44474-74de-4982-8e48-31038a50607f\" (UID: \"30d44474-74de-4982-8e48-31038a50607f\") " Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.348231 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/30d44474-74de-4982-8e48-31038a50607f-config\") pod \"30d44474-74de-4982-8e48-31038a50607f\" (UID: \"30d44474-74de-4982-8e48-31038a50607f\") " Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.348266 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/30d44474-74de-4982-8e48-31038a50607f-combined-ca-bundle\") pod \"30d44474-74de-4982-8e48-31038a50607f\" (UID: \"30d44474-74de-4982-8e48-31038a50607f\") " Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.348285 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/5aa11a39-e139-4791-92ce-2771b0277a8b-httpd-run\") pod \"5aa11a39-e139-4791-92ce-2771b0277a8b\" (UID: \"5aa11a39-e139-4791-92ce-2771b0277a8b\") " Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.348392 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/30d44474-74de-4982-8e48-31038a50607f-ovsdb-rundir\") pod \"30d44474-74de-4982-8e48-31038a50607f\" (UID: \"30d44474-74de-4982-8e48-31038a50607f\") " Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.348414 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/30d44474-74de-4982-8e48-31038a50607f-scripts\") pod \"30d44474-74de-4982-8e48-31038a50607f\" (UID: \"30d44474-74de-4982-8e48-31038a50607f\") " Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.348467 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5aa11a39-e139-4791-92ce-2771b0277a8b-scripts\") pod \"5aa11a39-e139-4791-92ce-2771b0277a8b\" (UID: \"5aa11a39-e139-4791-92ce-2771b0277a8b\") " Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.354465 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/30d44474-74de-4982-8e48-31038a50607f-ovsdb-rundir" (OuterVolumeSpecName: "ovsdb-rundir") pod "30d44474-74de-4982-8e48-31038a50607f" (UID: "30d44474-74de-4982-8e48-31038a50607f"). InnerVolumeSpecName "ovsdb-rundir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.354508 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/30d44474-74de-4982-8e48-31038a50607f-scripts" (OuterVolumeSpecName: "scripts") pod "30d44474-74de-4982-8e48-31038a50607f" (UID: "30d44474-74de-4982-8e48-31038a50607f"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.354774 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5aa11a39-e139-4791-92ce-2771b0277a8b-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "5aa11a39-e139-4791-92ce-2771b0277a8b" (UID: "5aa11a39-e139-4791-92ce-2771b0277a8b"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.354967 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5aa11a39-e139-4791-92ce-2771b0277a8b-scripts" (OuterVolumeSpecName: "scripts") pod "5aa11a39-e139-4791-92ce-2771b0277a8b" (UID: "5aa11a39-e139-4791-92ce-2771b0277a8b"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.355067 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/30d44474-74de-4982-8e48-31038a50607f-config" (OuterVolumeSpecName: "config") pod "30d44474-74de-4982-8e48-31038a50607f" (UID: "30d44474-74de-4982-8e48-31038a50607f"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.356117 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-qwsw8"] Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.360003 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5aa11a39-e139-4791-92ce-2771b0277a8b-kube-api-access-tn47w" (OuterVolumeSpecName: "kube-api-access-tn47w") pod "5aa11a39-e139-4791-92ce-2771b0277a8b" (UID: "5aa11a39-e139-4791-92ce-2771b0277a8b"). InnerVolumeSpecName "kube-api-access-tn47w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.362054 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage15-crc" (OuterVolumeSpecName: "glance") pod "5aa11a39-e139-4791-92ce-2771b0277a8b" (UID: "5aa11a39-e139-4791-92ce-2771b0277a8b"). InnerVolumeSpecName "local-storage15-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.362971 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5aa11a39-e139-4791-92ce-2771b0277a8b-logs" (OuterVolumeSpecName: "logs") pod "5aa11a39-e139-4791-92ce-2771b0277a8b" (UID: "5aa11a39-e139-4791-92ce-2771b0277a8b"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.367369 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage05-crc" (OuterVolumeSpecName: "ovndbcluster-nb-etc-ovn") pod "30d44474-74de-4982-8e48-31038a50607f" (UID: "30d44474-74de-4982-8e48-31038a50607f"). InnerVolumeSpecName "local-storage05-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.373080 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Mar 16 16:12:22 crc kubenswrapper[5120]: E0316 16:12:22.425443 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="0694d284d33b8f4728b5b5db2443c16f6b7c4ab92062463e2013167e4b4a7dc6" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.427049 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30d44474-74de-4982-8e48-31038a50607f-kube-api-access-h5gm2" (OuterVolumeSpecName: "kube-api-access-h5gm2") pod "30d44474-74de-4982-8e48-31038a50607f" (UID: "30d44474-74de-4982-8e48-31038a50607f"). InnerVolumeSpecName "kube-api-access-h5gm2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.428071 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5aa11a39-e139-4791-92ce-2771b0277a8b-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "5aa11a39-e139-4791-92ce-2771b0277a8b" (UID: "5aa11a39-e139-4791-92ce-2771b0277a8b"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.449431 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/30d44474-74de-4982-8e48-31038a50607f-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "30d44474-74de-4982-8e48-31038a50607f" (UID: "30d44474-74de-4982-8e48-31038a50607f"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.450511 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/a8389bad-6789-42fe-8506-5ac83ff9514f-openstack-config-secret\") pod \"a8389bad-6789-42fe-8506-5ac83ff9514f\" (UID: \"a8389bad-6789-42fe-8506-5ac83ff9514f\") " Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.450552 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-25zwk\" (UniqueName: \"kubernetes.io/projected/a8389bad-6789-42fe-8506-5ac83ff9514f-kube-api-access-25zwk\") pod \"a8389bad-6789-42fe-8506-5ac83ff9514f\" (UID: \"a8389bad-6789-42fe-8506-5ac83ff9514f\") " Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.451241 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a8389bad-6789-42fe-8506-5ac83ff9514f-combined-ca-bundle\") pod \"a8389bad-6789-42fe-8506-5ac83ff9514f\" (UID: \"a8389bad-6789-42fe-8506-5ac83ff9514f\") " Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.451286 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/a8389bad-6789-42fe-8506-5ac83ff9514f-openstack-config\") pod \"a8389bad-6789-42fe-8506-5ac83ff9514f\" (UID: \"a8389bad-6789-42fe-8506-5ac83ff9514f\") " Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.452664 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/dca01bf3-3d87-4d0e-9cf7-481863c6144d-operator-scripts\") pod \"keystone-6623-account-create-update-5q5c8\" (UID: \"dca01bf3-3d87-4d0e-9cf7-481863c6144d\") " pod="openstack-kuttl-tests/keystone-6623-account-create-update-5q5c8" Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.452780 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9bd8k\" (UniqueName: \"kubernetes.io/projected/dca01bf3-3d87-4d0e-9cf7-481863c6144d-kube-api-access-9bd8k\") pod \"keystone-6623-account-create-update-5q5c8\" (UID: \"dca01bf3-3d87-4d0e-9cf7-481863c6144d\") " pod="openstack-kuttl-tests/keystone-6623-account-create-update-5q5c8" Mar 16 16:12:22 crc kubenswrapper[5120]: E0316 16:12:22.453914 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-cinder-internal-svc: secret "cert-cinder-internal-svc" not found Mar 16 16:12:22 crc kubenswrapper[5120]: E0316 16:12:22.453924 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-cinder-public-svc: secret "cert-cinder-public-svc" not found Mar 16 16:12:22 crc kubenswrapper[5120]: E0316 16:12:22.453996 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88c64b50-c653-4d39-a87a-ac9a49eaf06e-internal-tls-certs podName:88c64b50-c653-4d39-a87a-ac9a49eaf06e nodeName:}" failed. No retries permitted until 2026-03-16 16:12:26.453953995 +0000 UTC m=+2448.607885652 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/88c64b50-c653-4d39-a87a-ac9a49eaf06e-internal-tls-certs") pod "cinder-api-0" (UID: "88c64b50-c653-4d39-a87a-ac9a49eaf06e") : secret "cert-cinder-internal-svc" not found Mar 16 16:12:22 crc kubenswrapper[5120]: E0316 16:12:22.454013 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88c64b50-c653-4d39-a87a-ac9a49eaf06e-public-tls-certs podName:88c64b50-c653-4d39-a87a-ac9a49eaf06e nodeName:}" failed. No retries permitted until 2026-03-16 16:12:26.454006137 +0000 UTC m=+2448.607937794 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/88c64b50-c653-4d39-a87a-ac9a49eaf06e-public-tls-certs") pod "cinder-api-0" (UID: "88c64b50-c653-4d39-a87a-ac9a49eaf06e") : secret "cert-cinder-public-svc" not found Mar 16 16:12:22 crc kubenswrapper[5120]: E0316 16:12:22.454018 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cinder-scripts: secret "cinder-scripts" not found Mar 16 16:12:22 crc kubenswrapper[5120]: E0316 16:12:22.454053 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88c64b50-c653-4d39-a87a-ac9a49eaf06e-scripts podName:88c64b50-c653-4d39-a87a-ac9a49eaf06e nodeName:}" failed. No retries permitted until 2026-03-16 16:12:26.454033697 +0000 UTC m=+2448.607965354 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "scripts" (UniqueName: "kubernetes.io/secret/88c64b50-c653-4d39-a87a-ac9a49eaf06e-scripts") pod "cinder-api-0" (UID: "88c64b50-c653-4d39-a87a-ac9a49eaf06e") : secret "cinder-scripts" not found Mar 16 16:12:22 crc kubenswrapper[5120]: E0316 16:12:22.454083 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Mar 16 16:12:22 crc kubenswrapper[5120]: E0316 16:12:22.454090 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 16:12:22 crc kubenswrapper[5120]: E0316 16:12:22.454119 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bba65a98-1383-4c8c-995a-b212b232d1f8-combined-ca-bundle podName:bba65a98-1383-4c8c-995a-b212b232d1f8 nodeName:}" failed. No retries permitted until 2026-03-16 16:12:26.45411273 +0000 UTC m=+2448.608044377 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/bba65a98-1383-4c8c-995a-b212b232d1f8-combined-ca-bundle") pod "nova-scheduler-0" (UID: "bba65a98-1383-4c8c-995a-b212b232d1f8") : secret "combined-ca-bundle" not found Mar 16 16:12:22 crc kubenswrapper[5120]: E0316 16:12:22.454140 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a-config-data podName:de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a nodeName:}" failed. No retries permitted until 2026-03-16 16:12:26.454135591 +0000 UTC m=+2448.608067248 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a-config-data") pod "rabbitmq-cell1-server-0" (UID: "de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a") : configmap "rabbitmq-cell1-config-data" not found Mar 16 16:12:22 crc kubenswrapper[5120]: E0316 16:12:22.454152 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Mar 16 16:12:22 crc kubenswrapper[5120]: E0316 16:12:22.454169 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cinder-api-config-data: secret "cinder-api-config-data" not found Mar 16 16:12:22 crc kubenswrapper[5120]: E0316 16:12:22.454190 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 16:12:22 crc kubenswrapper[5120]: E0316 16:12:22.454177 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dca01bf3-3d87-4d0e-9cf7-481863c6144d-operator-scripts podName:dca01bf3-3d87-4d0e-9cf7-481863c6144d nodeName:}" failed. No retries permitted until 2026-03-16 16:12:23.454166652 +0000 UTC m=+2445.608098309 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/dca01bf3-3d87-4d0e-9cf7-481863c6144d-operator-scripts") pod "keystone-6623-account-create-update-5q5c8" (UID: "dca01bf3-3d87-4d0e-9cf7-481863c6144d") : configmap "openstack-scripts" not found Mar 16 16:12:22 crc kubenswrapper[5120]: E0316 16:12:22.454215 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88c64b50-c653-4d39-a87a-ac9a49eaf06e-config-data-custom podName:88c64b50-c653-4d39-a87a-ac9a49eaf06e nodeName:}" failed. No retries permitted until 2026-03-16 16:12:26.454206163 +0000 UTC m=+2448.608137820 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "config-data-custom" (UniqueName: "kubernetes.io/secret/88c64b50-c653-4d39-a87a-ac9a49eaf06e-config-data-custom") pod "cinder-api-0" (UID: "88c64b50-c653-4d39-a87a-ac9a49eaf06e") : secret "cinder-api-config-data" not found Mar 16 16:12:22 crc kubenswrapper[5120]: E0316 16:12:22.454234 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cinder-config-data: secret "cinder-config-data" not found Mar 16 16:12:22 crc kubenswrapper[5120]: E0316 16:12:22.454238 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88c64b50-c653-4d39-a87a-ac9a49eaf06e-combined-ca-bundle podName:88c64b50-c653-4d39-a87a-ac9a49eaf06e nodeName:}" failed. No retries permitted until 2026-03-16 16:12:26.454231543 +0000 UTC m=+2448.608163200 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/88c64b50-c653-4d39-a87a-ac9a49eaf06e-combined-ca-bundle") pod "cinder-api-0" (UID: "88c64b50-c653-4d39-a87a-ac9a49eaf06e") : secret "combined-ca-bundle" not found Mar 16 16:12:22 crc kubenswrapper[5120]: E0316 16:12:22.454253 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88c64b50-c653-4d39-a87a-ac9a49eaf06e-config-data podName:88c64b50-c653-4d39-a87a-ac9a49eaf06e nodeName:}" failed. No retries permitted until 2026-03-16 16:12:26.454247354 +0000 UTC m=+2448.608179001 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/secret/88c64b50-c653-4d39-a87a-ac9a49eaf06e-config-data") pod "cinder-api-0" (UID: "88c64b50-c653-4d39-a87a-ac9a49eaf06e") : secret "cinder-config-data" not found Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.454490 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") on node \"crc\" " Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.454504 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tn47w\" (UniqueName: \"kubernetes.io/projected/5aa11a39-e139-4791-92ce-2771b0277a8b-kube-api-access-tn47w\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.454515 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5aa11a39-e139-4791-92ce-2771b0277a8b-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.454524 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5aa11a39-e139-4791-92ce-2771b0277a8b-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.454538 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage15-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage15-crc\") on node \"crc\" " Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.454547 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h5gm2\" (UniqueName: \"kubernetes.io/projected/30d44474-74de-4982-8e48-31038a50607f-kube-api-access-h5gm2\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.454555 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/30d44474-74de-4982-8e48-31038a50607f-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.454564 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/30d44474-74de-4982-8e48-31038a50607f-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.454572 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/5aa11a39-e139-4791-92ce-2771b0277a8b-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.454582 5120 reconciler_common.go:299] "Volume detached for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/30d44474-74de-4982-8e48-31038a50607f-ovsdb-rundir\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.454590 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/30d44474-74de-4982-8e48-31038a50607f-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.454599 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5aa11a39-e139-4791-92ce-2771b0277a8b-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:22 crc kubenswrapper[5120]: E0316 16:12:22.457778 5120 projected.go:194] Error preparing data for projected volume kube-api-access-9bd8k for pod openstack-kuttl-tests/keystone-6623-account-create-update-5q5c8: failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 16:12:22 crc kubenswrapper[5120]: E0316 16:12:22.457934 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dca01bf3-3d87-4d0e-9cf7-481863c6144d-kube-api-access-9bd8k podName:dca01bf3-3d87-4d0e-9cf7-481863c6144d nodeName:}" failed. No retries permitted until 2026-03-16 16:12:23.457913993 +0000 UTC m=+2445.611845650 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-9bd8k" (UniqueName: "kubernetes.io/projected/dca01bf3-3d87-4d0e-9cf7-481863c6144d-kube-api-access-9bd8k") pod "keystone-6623-account-create-update-5q5c8" (UID: "dca01bf3-3d87-4d0e-9cf7-481863c6144d") : failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.468802 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8389bad-6789-42fe-8506-5ac83ff9514f-kube-api-access-25zwk" (OuterVolumeSpecName: "kube-api-access-25zwk") pod "a8389bad-6789-42fe-8506-5ac83ff9514f" (UID: "a8389bad-6789-42fe-8506-5ac83ff9514f"). InnerVolumeSpecName "kube-api-access-25zwk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.477615 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.477665 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:12:22 crc kubenswrapper[5120]: E0316 16:12:22.489313 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="0694d284d33b8f4728b5b5db2443c16f6b7c4ab92062463e2013167e4b4a7dc6" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:12:22 crc kubenswrapper[5120]: E0316 16:12:22.491514 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="0694d284d33b8f4728b5b5db2443c16f6b7c4ab92062463e2013167e4b4a7dc6" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:12:22 crc kubenswrapper[5120]: E0316 16:12:22.491584 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="bba65a98-1383-4c8c-995a-b212b232d1f8" containerName="nova-scheduler-scheduler" probeResult="unknown" Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.502993 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_30d44474-74de-4982-8e48-31038a50607f/ovsdbserver-nb/0.log" Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.503275 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.504250 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"30d44474-74de-4982-8e48-31038a50607f","Type":"ContainerDied","Data":"f3957484545fb3102bfbc2042d12e9d149f6ddd98600492ca221d0b8bcdde9c3"} Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.508140 5120 generic.go:358] "Generic (PLEG): container finished" podID="96d66c8e-8cdb-462c-a302-c85e581db5ad" containerID="d4b6b76b9c5320477843bd780ebb20cf97063725b2d9c08ddb68df6a0c0cf879" exitCode=0 Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.508233 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"96d66c8e-8cdb-462c-a302-c85e581db5ad","Type":"ContainerDied","Data":"d4b6b76b9c5320477843bd780ebb20cf97063725b2d9c08ddb68df6a0c0cf879"} Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.513154 5120 generic.go:358] "Generic (PLEG): container finished" podID="5cf58a8f-dfb4-4a0a-b96c-000333125dd0" containerID="773740d0b4fcf1873d3b8d878cfa118bc3e28448d6a770da23e0930fde30d6cc" exitCode=0 Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.513230 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-cb8df78d6-4gf8s" event={"ID":"5cf58a8f-dfb4-4a0a-b96c-000333125dd0","Type":"ContainerDied","Data":"773740d0b4fcf1873d3b8d878cfa118bc3e28448d6a770da23e0930fde30d6cc"} Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.515450 5120 generic.go:358] "Generic (PLEG): container finished" podID="bebb35a6-a910-4c16-8fa3-5462afb3341a" containerID="6cb705b6a3d152dced9b3cb6c4835a2490bbfadb24078d18afa5685f5ddd1a97" exitCode=2 Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.515524 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"bebb35a6-a910-4c16-8fa3-5462afb3341a","Type":"ContainerDied","Data":"6cb705b6a3d152dced9b3cb6c4835a2490bbfadb24078d18afa5685f5ddd1a97"} Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.517544 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"5aa11a39-e139-4791-92ce-2771b0277a8b","Type":"ContainerDied","Data":"7b2f2889906dd67fe1ba5a6937f7d7025c5d727c057145569157dd2e70cdcae6"} Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.517623 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.520127 5120 generic.go:358] "Generic (PLEG): container finished" podID="88c64b50-c653-4d39-a87a-ac9a49eaf06e" containerID="259a1c164b3bbbddd52006aa2c23dfa16d68542525700e849cf3e51465cc36d9" exitCode=0 Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.520315 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"88c64b50-c653-4d39-a87a-ac9a49eaf06e","Type":"ContainerDied","Data":"259a1c164b3bbbddd52006aa2c23dfa16d68542525700e849cf3e51465cc36d9"} Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.548023 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.548105 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.558264 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-25zwk\" (UniqueName: \"kubernetes.io/projected/a8389bad-6789-42fe-8506-5ac83ff9514f-kube-api-access-25zwk\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.568705 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-917a-account-create-update-942tp"] Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.569789 5120 generic.go:358] "Generic (PLEG): container finished" podID="48f884c6-8a4f-4581-8b21-6e4db79ae424" containerID="7f52beabfcff3227464395535efe06bcce13fd954b9eb69868803bda7c0f42b8" exitCode=0 Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.569879 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"48f884c6-8a4f-4581-8b21-6e4db79ae424","Type":"ContainerDied","Data":"7f52beabfcff3227464395535efe06bcce13fd954b9eb69868803bda7c0f42b8"} Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.578442 5120 generic.go:358] "Generic (PLEG): container finished" podID="f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5" containerID="da584e6bdd5f6d1ceaf64b1de15d36cf92d4ec19aa56b2e4705b2d6f7c89c834" exitCode=0 Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.578474 5120 generic.go:358] "Generic (PLEG): container finished" podID="f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5" containerID="ef0d85dafcbfd3191d70121e50e81623c612e9907822eea5b7266da0a9d3455f" exitCode=2 Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.578481 5120 generic.go:358] "Generic (PLEG): container finished" podID="f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5" containerID="5659e4bf80f0be1a407d06d3ba6dc5bc6f3128381585870fdde39acc6b1637fe" exitCode=0 Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.578567 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5","Type":"ContainerDied","Data":"da584e6bdd5f6d1ceaf64b1de15d36cf92d4ec19aa56b2e4705b2d6f7c89c834"} Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.578593 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5","Type":"ContainerDied","Data":"ef0d85dafcbfd3191d70121e50e81623c612e9907822eea5b7266da0a9d3455f"} Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.578603 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5","Type":"ContainerDied","Data":"5659e4bf80f0be1a407d06d3ba6dc5bc6f3128381585870fdde39acc6b1637fe"} Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.589822 5120 generic.go:358] "Generic (PLEG): container finished" podID="dae19557-6584-433e-a345-c373d9e8a4ae" containerID="a45d41b1d9d4e8e8b46bd068b4409058a847b35aec00d30d3d8619af44323cbf" exitCode=0 Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.589959 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"dae19557-6584-433e-a345-c373d9e8a4ae","Type":"ContainerDied","Data":"a45d41b1d9d4e8e8b46bd068b4409058a847b35aec00d30d3d8619af44323cbf"} Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.596262 5120 generic.go:358] "Generic (PLEG): container finished" podID="28ea8203-158a-4c89-8ae6-647d230c21ff" containerID="5b0aa275ade968085f1b9c47c4e4571ba1ab8d6cb51953a996db3a2e2dc99e74" exitCode=143 Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.596357 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-7cbc6f47fd-xhhn9" event={"ID":"28ea8203-158a-4c89-8ae6-647d230c21ff","Type":"ContainerDied","Data":"5b0aa275ade968085f1b9c47c4e4571ba1ab8d6cb51953a996db3a2e2dc99e74"} Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.598671 5120 generic.go:358] "Generic (PLEG): container finished" podID="60e80199-56f5-4a0c-b023-da9c28b1051f" containerID="9acf328d9dac47c6472154637a380c8aee452334380f2fbe63f5b4b0bbfe0475" exitCode=1 Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.598846 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-5h578" event={"ID":"60e80199-56f5-4a0c-b023-da9c28b1051f","Type":"ContainerDied","Data":"9acf328d9dac47c6472154637a380c8aee452334380f2fbe63f5b4b0bbfe0475"} Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.600378 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage15-crc" (UniqueName: "kubernetes.io/local-volume/local-storage15-crc") on node "crc" Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.607114 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-4e5e-account-create-update-ft8f9" event={"ID":"972b610c-1005-4b7a-be77-72b7d63cab89","Type":"ContainerStarted","Data":"d6958fa1eb24f86d268e2f88cebb71ac91887f0429d467c7d785925b0d5a0dbd"} Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.619894 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5aa11a39-e139-4791-92ce-2771b0277a8b-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "5aa11a39-e139-4791-92ce-2771b0277a8b" (UID: "5aa11a39-e139-4791-92ce-2771b0277a8b"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:22 crc kubenswrapper[5120]: E0316 16:12:22.624227 5120 kuberuntime_manager.go:1358] "Unhandled Error" err=< Mar 16 16:12:22 crc kubenswrapper[5120]: container &Container{Name:mariadb-account-create-update,Image:quay.io/podified-antelope-centos9/openstack-mariadb@sha256:4caef2b55e01b9a7ee88a22bc69db1893521a91d95c7ad4c8e593f14f17a5f95,Command:[/bin/sh -c #!/bin/bash Mar 16 16:12:22 crc kubenswrapper[5120]: Mar 16 16:12:22 crc kubenswrapper[5120]: MYSQL_REMOTE_HOST="" source /var/lib/operator-scripts/mysql_root_auth.sh Mar 16 16:12:22 crc kubenswrapper[5120]: Mar 16 16:12:22 crc kubenswrapper[5120]: export DatabasePassword=${DatabasePassword:?"Please specify a DatabasePassword variable."} Mar 16 16:12:22 crc kubenswrapper[5120]: Mar 16 16:12:22 crc kubenswrapper[5120]: MYSQL_CMD="mysql -h -u root -P 3306" Mar 16 16:12:22 crc kubenswrapper[5120]: Mar 16 16:12:22 crc kubenswrapper[5120]: if [ -n "neutron" ]; then Mar 16 16:12:22 crc kubenswrapper[5120]: GRANT_DATABASE="neutron" Mar 16 16:12:22 crc kubenswrapper[5120]: else Mar 16 16:12:22 crc kubenswrapper[5120]: GRANT_DATABASE="*" Mar 16 16:12:22 crc kubenswrapper[5120]: fi Mar 16 16:12:22 crc kubenswrapper[5120]: Mar 16 16:12:22 crc kubenswrapper[5120]: # going for maximum compatibility here: Mar 16 16:12:22 crc kubenswrapper[5120]: # 1. MySQL 8 no longer allows implicit create user when GRANT is used Mar 16 16:12:22 crc kubenswrapper[5120]: # 2. MariaDB has "CREATE OR REPLACE", but MySQL does not Mar 16 16:12:22 crc kubenswrapper[5120]: # 3. create user with CREATE but then do all password and TLS with ALTER to Mar 16 16:12:22 crc kubenswrapper[5120]: # support updates Mar 16 16:12:22 crc kubenswrapper[5120]: Mar 16 16:12:22 crc kubenswrapper[5120]: $MYSQL_CMD < logger="UnhandledError" Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.624505 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage05-crc" (UniqueName: "kubernetes.io/local-volume/local-storage05-crc") on node "crc" Mar 16 16:12:22 crc kubenswrapper[5120]: E0316 16:12:22.626333 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"mariadb-account-create-update\" with CreateContainerConfigError: \"secret \\\"neutron-db-secret\\\" not found\"" pod="openstack-kuttl-tests/neutron-2fe2-account-create-update-b6c5t" podUID="0d9bf89c-b546-4753-8e17-963b6dd4720b" Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.632244 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a8389bad-6789-42fe-8506-5ac83ff9514f-openstack-config" (OuterVolumeSpecName: "openstack-config") pod "a8389bad-6789-42fe-8506-5ac83ff9514f" (UID: "a8389bad-6789-42fe-8506-5ac83ff9514f"). InnerVolumeSpecName "openstack-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.633793 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.639151 5120 generic.go:358] "Generic (PLEG): container finished" podID="10ec5605-2810-4b8c-9a6a-e5cfc3b33706" containerID="30cb524b702792b5b0d1c7e920fa43fe3cffd8cfa340a919cb3c394fe3d72112" exitCode=143 Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.639229 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"10ec5605-2810-4b8c-9a6a-e5cfc3b33706","Type":"ContainerDied","Data":"30cb524b702792b5b0d1c7e920fa43fe3cffd8cfa340a919cb3c394fe3d72112"} Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.641894 5120 generic.go:358] "Generic (PLEG): container finished" podID="17b2138c-b3ca-4538-a7d7-0dc6756650bf" containerID="ea430835f1beb9f77ac042d234c65b501734c5b7323a6b25a1db8b17b727e6b5" exitCode=143 Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.641967 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"17b2138c-b3ca-4538-a7d7-0dc6756650bf","Type":"ContainerDied","Data":"ea430835f1beb9f77ac042d234c65b501734c5b7323a6b25a1db8b17b727e6b5"} Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.643256 5120 generic.go:358] "Generic (PLEG): container finished" podID="cb4b4078-46df-4b50-aa4a-81adbbd15e52" containerID="c6264f1560432f3ea47f3e712f72dc705f1d96eeaa1e8dbf34ce818578d90dc4" exitCode=0 Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.643268 5120 generic.go:358] "Generic (PLEG): container finished" podID="cb4b4078-46df-4b50-aa4a-81adbbd15e52" containerID="59d38b77c648623aa3b83892cf22dde220f840ba2589672899727a34b307c0ba" exitCode=143 Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.643327 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-5566b7bdc5-47bld" event={"ID":"cb4b4078-46df-4b50-aa4a-81adbbd15e52","Type":"ContainerDied","Data":"c6264f1560432f3ea47f3e712f72dc705f1d96eeaa1e8dbf34ce818578d90dc4"} Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.643343 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-5566b7bdc5-47bld" event={"ID":"cb4b4078-46df-4b50-aa4a-81adbbd15e52","Type":"ContainerDied","Data":"59d38b77c648623aa3b83892cf22dde220f840ba2589672899727a34b307c0ba"} Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.644447 5120 generic.go:358] "Generic (PLEG): container finished" podID="fe2105ae-76c1-452b-bee1-074d323c076f" containerID="33458ed69c10a0a03c3eb77b97ded5f81bf1b3bcb75d28603bc14dde98be5d90" exitCode=0 Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.644458 5120 generic.go:358] "Generic (PLEG): container finished" podID="fe2105ae-76c1-452b-bee1-074d323c076f" containerID="ad75fdb465731a2e6536f1029248278779f84cd84ec9a9c1660f3efb1189e033" exitCode=0 Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.644513 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-6d59599fcd-hn254" event={"ID":"fe2105ae-76c1-452b-bee1-074d323c076f","Type":"ContainerDied","Data":"33458ed69c10a0a03c3eb77b97ded5f81bf1b3bcb75d28603bc14dde98be5d90"} Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.644526 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-6d59599fcd-hn254" event={"ID":"fe2105ae-76c1-452b-bee1-074d323c076f","Type":"ContainerDied","Data":"ad75fdb465731a2e6536f1029248278779f84cd84ec9a9c1660f3efb1189e033"} Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.646058 5120 generic.go:358] "Generic (PLEG): container finished" podID="241ac7ce-90fa-4222-a274-ee00c4ba33a3" containerID="0dadea8ab408f64e9e344819b50787a4d1b4f746bfbe3d5362a281c253d2b9e2" exitCode=143 Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.646090 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-f9bc678f8-6p72p" event={"ID":"241ac7ce-90fa-4222-a274-ee00c4ba33a3","Type":"ContainerDied","Data":"0dadea8ab408f64e9e344819b50787a4d1b4f746bfbe3d5362a281c253d2b9e2"} Mar 16 16:12:22 crc kubenswrapper[5120]: E0316 16:12:22.658995 5120 kuberuntime_manager.go:1358] "Unhandled Error" err=< Mar 16 16:12:22 crc kubenswrapper[5120]: container &Container{Name:mariadb-account-create-update,Image:quay.io/podified-antelope-centos9/openstack-mariadb@sha256:4caef2b55e01b9a7ee88a22bc69db1893521a91d95c7ad4c8e593f14f17a5f95,Command:[/bin/sh -c #!/bin/bash Mar 16 16:12:22 crc kubenswrapper[5120]: Mar 16 16:12:22 crc kubenswrapper[5120]: MYSQL_REMOTE_HOST="" source /var/lib/operator-scripts/mysql_root_auth.sh Mar 16 16:12:22 crc kubenswrapper[5120]: Mar 16 16:12:22 crc kubenswrapper[5120]: export DatabasePassword=${DatabasePassword:?"Please specify a DatabasePassword variable."} Mar 16 16:12:22 crc kubenswrapper[5120]: Mar 16 16:12:22 crc kubenswrapper[5120]: MYSQL_CMD="mysql -h -u root -P 3306" Mar 16 16:12:22 crc kubenswrapper[5120]: Mar 16 16:12:22 crc kubenswrapper[5120]: if [ -n "placement" ]; then Mar 16 16:12:22 crc kubenswrapper[5120]: GRANT_DATABASE="placement" Mar 16 16:12:22 crc kubenswrapper[5120]: else Mar 16 16:12:22 crc kubenswrapper[5120]: GRANT_DATABASE="*" Mar 16 16:12:22 crc kubenswrapper[5120]: fi Mar 16 16:12:22 crc kubenswrapper[5120]: Mar 16 16:12:22 crc kubenswrapper[5120]: # going for maximum compatibility here: Mar 16 16:12:22 crc kubenswrapper[5120]: # 1. MySQL 8 no longer allows implicit create user when GRANT is used Mar 16 16:12:22 crc kubenswrapper[5120]: # 2. MariaDB has "CREATE OR REPLACE", but MySQL does not Mar 16 16:12:22 crc kubenswrapper[5120]: # 3. create user with CREATE but then do all password and TLS with ALTER to Mar 16 16:12:22 crc kubenswrapper[5120]: # support updates Mar 16 16:12:22 crc kubenswrapper[5120]: Mar 16 16:12:22 crc kubenswrapper[5120]: $MYSQL_CMD < logger="UnhandledError" Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.660979 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/5aa11a39-e139-4791-92ce-2771b0277a8b-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.660998 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage15-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage15-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.661007 5120 reconciler_common.go:299] "Volume detached for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/a8389bad-6789-42fe-8506-5ac83ff9514f-openstack-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.661016 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:22 crc kubenswrapper[5120]: E0316 16:12:22.661045 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"mariadb-account-create-update\" with CreateContainerConfigError: \"secret \\\"placement-db-secret\\\" not found\"" pod="openstack-kuttl-tests/placement-4e5e-account-create-update-ft8f9" podUID="972b610c-1005-4b7a-be77-72b7d63cab89" Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.675202 5120 generic.go:358] "Generic (PLEG): container finished" podID="9c8fe017-e320-4b3e-894e-f4258e8d265f" containerID="3db74fc31cc9f68950b009f39db6e01dd25ecf398c5a0a5c2f3f7b6f2dff8aa1" exitCode=0 Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.697541 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.699344 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ce65374-bf0f-4c93-b907-2c89f76a7109" path="/var/lib/kubelet/pods/0ce65374-bf0f-4c93-b907-2c89f76a7109/volumes" Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.703076 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="14074bd5-5aa2-44f1-b48f-1d091538fe99" path="/var/lib/kubelet/pods/14074bd5-5aa2-44f1-b48f-1d091538fe99/volumes" Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.703422 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-6623-account-create-update-5q5c8" Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.703829 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8389bad-6789-42fe-8506-5ac83ff9514f-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "a8389bad-6789-42fe-8506-5ac83ff9514f" (UID: "a8389bad-6789-42fe-8506-5ac83ff9514f"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.704220 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="37366a24-b946-4076-8334-f35f69f94f66" path="/var/lib/kubelet/pods/37366a24-b946-4076-8334-f35f69f94f66/volumes" Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.704709 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="572b636c-c02b-40bc-9255-913cdba7b65d" path="/var/lib/kubelet/pods/572b636c-c02b-40bc-9255-913cdba7b65d/volumes" Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.708719 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="615124f9-52d4-4054-8321-42f5226ca83b" path="/var/lib/kubelet/pods/615124f9-52d4-4054-8321-42f5226ca83b/volumes" Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.709864 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="82c11055-585b-4f89-b75a-b396389fa715" path="/var/lib/kubelet/pods/82c11055-585b-4f89-b75a-b396389fa715/volumes" Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.710352 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8dcc9838-517a-4250-b576-c87878365fa2" path="/var/lib/kubelet/pods/8dcc9838-517a-4250-b576-c87878365fa2/volumes" Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.710873 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="97a45f5d-2fa4-4585-ac54-f36d71dab06d" path="/var/lib/kubelet/pods/97a45f5d-2fa4-4585-ac54-f36d71dab06d/volumes" Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.711984 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="98d8925d-4997-48e0-a674-abb5bdb026dd" path="/var/lib/kubelet/pods/98d8925d-4997-48e0-a674-abb5bdb026dd/volumes" Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.712473 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a3634a26-805b-489d-9f26-36aef6f9239f" path="/var/lib/kubelet/pods/a3634a26-805b-489d-9f26-36aef6f9239f/volumes" Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.713171 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc25453e-6c18-4b92-9056-03885c683487" path="/var/lib/kubelet/pods/bc25453e-6c18-4b92-9056-03885c683487/volumes" Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.713644 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c2f18d16-d2de-496a-b894-947a5c23f857" path="/var/lib/kubelet/pods/c2f18d16-d2de-496a-b894-947a5c23f857/volumes" Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.716195 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fb47226c-c927-43f1-9028-cfdc5dcd2e89" path="/var/lib/kubelet/pods/fb47226c-c927-43f1-9028-cfdc5dcd2e89/volumes" Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.755865 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/30d44474-74de-4982-8e48-31038a50607f-ovsdbserver-nb-tls-certs" (OuterVolumeSpecName: "ovsdbserver-nb-tls-certs") pod "30d44474-74de-4982-8e48-31038a50607f" (UID: "30d44474-74de-4982-8e48-31038a50607f"). InnerVolumeSpecName "ovsdbserver-nb-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:22 crc kubenswrapper[5120]: W0316 16:12:22.759383 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1d95fd75_2d15_48f7_9605_2d1980ebeff2.slice/crio-33a92981f1c39d0a8f281c95986c42a900c4017761d547153c4b729d9ba09ac1 WatchSource:0}: Error finding container 33a92981f1c39d0a8f281c95986c42a900c4017761d547153c4b729d9ba09ac1: Status 404 returned error can't find the container with id 33a92981f1c39d0a8f281c95986c42a900c4017761d547153c4b729d9ba09ac1 Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.765361 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8389bad-6789-42fe-8506-5ac83ff9514f-openstack-config-secret" (OuterVolumeSpecName: "openstack-config-secret") pod "a8389bad-6789-42fe-8506-5ac83ff9514f" (UID: "a8389bad-6789-42fe-8506-5ac83ff9514f"). InnerVolumeSpecName "openstack-config-secret". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:22 crc kubenswrapper[5120]: E0316 16:12:22.765568 5120 kuberuntime_manager.go:1358] "Unhandled Error" err=< Mar 16 16:12:22 crc kubenswrapper[5120]: container &Container{Name:mariadb-account-create-update,Image:quay.io/podified-antelope-centos9/openstack-mariadb@sha256:4caef2b55e01b9a7ee88a22bc69db1893521a91d95c7ad4c8e593f14f17a5f95,Command:[/bin/sh -c #!/bin/bash Mar 16 16:12:22 crc kubenswrapper[5120]: Mar 16 16:12:22 crc kubenswrapper[5120]: MYSQL_REMOTE_HOST="" source /var/lib/operator-scripts/mysql_root_auth.sh Mar 16 16:12:22 crc kubenswrapper[5120]: Mar 16 16:12:22 crc kubenswrapper[5120]: export DatabasePassword=${DatabasePassword:?"Please specify a DatabasePassword variable."} Mar 16 16:12:22 crc kubenswrapper[5120]: Mar 16 16:12:22 crc kubenswrapper[5120]: MYSQL_CMD="mysql -h -u root -P 3306" Mar 16 16:12:22 crc kubenswrapper[5120]: Mar 16 16:12:22 crc kubenswrapper[5120]: if [ -n "nova_cell0" ]; then Mar 16 16:12:22 crc kubenswrapper[5120]: GRANT_DATABASE="nova_cell0" Mar 16 16:12:22 crc kubenswrapper[5120]: else Mar 16 16:12:22 crc kubenswrapper[5120]: GRANT_DATABASE="*" Mar 16 16:12:22 crc kubenswrapper[5120]: fi Mar 16 16:12:22 crc kubenswrapper[5120]: Mar 16 16:12:22 crc kubenswrapper[5120]: # going for maximum compatibility here: Mar 16 16:12:22 crc kubenswrapper[5120]: # 1. MySQL 8 no longer allows implicit create user when GRANT is used Mar 16 16:12:22 crc kubenswrapper[5120]: # 2. MariaDB has "CREATE OR REPLACE", but MySQL does not Mar 16 16:12:22 crc kubenswrapper[5120]: # 3. create user with CREATE but then do all password and TLS with ALTER to Mar 16 16:12:22 crc kubenswrapper[5120]: # support updates Mar 16 16:12:22 crc kubenswrapper[5120]: Mar 16 16:12:22 crc kubenswrapper[5120]: $MYSQL_CMD < logger="UnhandledError" Mar 16 16:12:22 crc kubenswrapper[5120]: E0316 16:12:22.766093 5120 kuberuntime_manager.go:1358] "Unhandled Error" err=< Mar 16 16:12:22 crc kubenswrapper[5120]: container &Container{Name:mariadb-account-create-update,Image:quay.io/podified-antelope-centos9/openstack-mariadb@sha256:4caef2b55e01b9a7ee88a22bc69db1893521a91d95c7ad4c8e593f14f17a5f95,Command:[/bin/sh -c #!/bin/bash Mar 16 16:12:22 crc kubenswrapper[5120]: Mar 16 16:12:22 crc kubenswrapper[5120]: MYSQL_REMOTE_HOST="" source /var/lib/operator-scripts/mysql_root_auth.sh Mar 16 16:12:22 crc kubenswrapper[5120]: Mar 16 16:12:22 crc kubenswrapper[5120]: export DatabasePassword=${DatabasePassword:?"Please specify a DatabasePassword variable."} Mar 16 16:12:22 crc kubenswrapper[5120]: Mar 16 16:12:22 crc kubenswrapper[5120]: MYSQL_CMD="mysql -h -u root -P 3306" Mar 16 16:12:22 crc kubenswrapper[5120]: Mar 16 16:12:22 crc kubenswrapper[5120]: if [ -n "nova_api" ]; then Mar 16 16:12:22 crc kubenswrapper[5120]: GRANT_DATABASE="nova_api" Mar 16 16:12:22 crc kubenswrapper[5120]: else Mar 16 16:12:22 crc kubenswrapper[5120]: GRANT_DATABASE="*" Mar 16 16:12:22 crc kubenswrapper[5120]: fi Mar 16 16:12:22 crc kubenswrapper[5120]: Mar 16 16:12:22 crc kubenswrapper[5120]: # going for maximum compatibility here: Mar 16 16:12:22 crc kubenswrapper[5120]: # 1. MySQL 8 no longer allows implicit create user when GRANT is used Mar 16 16:12:22 crc kubenswrapper[5120]: # 2. MariaDB has "CREATE OR REPLACE", but MySQL does not Mar 16 16:12:22 crc kubenswrapper[5120]: # 3. create user with CREATE but then do all password and TLS with ALTER to Mar 16 16:12:22 crc kubenswrapper[5120]: # support updates Mar 16 16:12:22 crc kubenswrapper[5120]: Mar 16 16:12:22 crc kubenswrapper[5120]: $MYSQL_CMD < logger="UnhandledError" Mar 16 16:12:22 crc kubenswrapper[5120]: E0316 16:12:22.767041 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"mariadb-account-create-update\" with CreateContainerConfigError: \"secret \\\"nova-cell0-db-secret\\\" not found\"" pod="openstack-kuttl-tests/nova-cell0-ecee-account-create-update-vpjvm" podUID="a0d48ffc-4eac-4602-b2e3-902e4a80c6a3" Mar 16 16:12:22 crc kubenswrapper[5120]: E0316 16:12:22.768200 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"mariadb-account-create-update\" with CreateContainerConfigError: \"secret \\\"nova-api-db-secret\\\" not found\"" pod="openstack-kuttl-tests/nova-api-2002-account-create-update-sg6jt" podUID="dc6aec24-261d-49c7-8306-704614644eaf" Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.774237 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/a8389bad-6789-42fe-8506-5ac83ff9514f-openstack-config-secret\") pod \"a8389bad-6789-42fe-8506-5ac83ff9514f\" (UID: \"a8389bad-6789-42fe-8506-5ac83ff9514f\") " Mar 16 16:12:22 crc kubenswrapper[5120]: W0316 16:12:22.774706 5120 empty_dir.go:511] Warning: Unmount skipped because path does not exist: /var/lib/kubelet/pods/a8389bad-6789-42fe-8506-5ac83ff9514f/volumes/kubernetes.io~secret/openstack-config-secret Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.802469 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8389bad-6789-42fe-8506-5ac83ff9514f-openstack-config-secret" (OuterVolumeSpecName: "openstack-config-secret") pod "a8389bad-6789-42fe-8506-5ac83ff9514f" (UID: "a8389bad-6789-42fe-8506-5ac83ff9514f"). InnerVolumeSpecName "openstack-config-secret". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.784245 5120 scope.go:117] "RemoveContainer" containerID="6e20c63b4f89ca3830a2ba939de00438e53cce4885447c83c5f138a24aad4498" Mar 16 16:12:22 crc kubenswrapper[5120]: E0316 16:12:22.807257 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cinder-config-data: secret "cinder-config-data" not found Mar 16 16:12:22 crc kubenswrapper[5120]: E0316 16:12:22.807656 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cinder-scheduler-config-data: secret "cinder-scheduler-config-data" not found Mar 16 16:12:22 crc kubenswrapper[5120]: E0316 16:12:22.807738 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cinder-scripts: secret "cinder-scripts" not found Mar 16 16:12:22 crc kubenswrapper[5120]: E0316 16:12:22.810380 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 16:12:22 crc kubenswrapper[5120]: E0316 16:12:22.810416 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96d66c8e-8cdb-462c-a302-c85e581db5ad-config-data podName:96d66c8e-8cdb-462c-a302-c85e581db5ad nodeName:}" failed. No retries permitted until 2026-03-16 16:12:26.810373747 +0000 UTC m=+2448.964305394 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/secret/96d66c8e-8cdb-462c-a302-c85e581db5ad-config-data") pod "cinder-scheduler-0" (UID: "96d66c8e-8cdb-462c-a302-c85e581db5ad") : secret "cinder-config-data" not found Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.811247 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/30d44474-74de-4982-8e48-31038a50607f-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "30d44474-74de-4982-8e48-31038a50607f" (UID: "30d44474-74de-4982-8e48-31038a50607f"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.814591 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5aa11a39-e139-4791-92ce-2771b0277a8b-config-data" (OuterVolumeSpecName: "config-data") pod "5aa11a39-e139-4791-92ce-2771b0277a8b" (UID: "5aa11a39-e139-4791-92ce-2771b0277a8b"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:22 crc kubenswrapper[5120]: E0316 16:12:22.819544 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96d66c8e-8cdb-462c-a302-c85e581db5ad-config-data-custom podName:96d66c8e-8cdb-462c-a302-c85e581db5ad nodeName:}" failed. No retries permitted until 2026-03-16 16:12:26.819523954 +0000 UTC m=+2448.973455611 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "config-data-custom" (UniqueName: "kubernetes.io/secret/96d66c8e-8cdb-462c-a302-c85e581db5ad-config-data-custom") pod "cinder-scheduler-0" (UID: "96d66c8e-8cdb-462c-a302-c85e581db5ad") : secret "cinder-scheduler-config-data" not found Mar 16 16:12:22 crc kubenswrapper[5120]: E0316 16:12:22.820121 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96d66c8e-8cdb-462c-a302-c85e581db5ad-scripts podName:96d66c8e-8cdb-462c-a302-c85e581db5ad nodeName:}" failed. No retries permitted until 2026-03-16 16:12:26.820092 +0000 UTC m=+2448.974023657 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "scripts" (UniqueName: "kubernetes.io/secret/96d66c8e-8cdb-462c-a302-c85e581db5ad-scripts") pod "cinder-scheduler-0" (UID: "96d66c8e-8cdb-462c-a302-c85e581db5ad") : secret "cinder-scripts" not found Mar 16 16:12:22 crc kubenswrapper[5120]: E0316 16:12:22.820661 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96d66c8e-8cdb-462c-a302-c85e581db5ad-combined-ca-bundle podName:96d66c8e-8cdb-462c-a302-c85e581db5ad nodeName:}" failed. No retries permitted until 2026-03-16 16:12:26.820646395 +0000 UTC m=+2448.974578052 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/96d66c8e-8cdb-462c-a302-c85e581db5ad-combined-ca-bundle") pod "cinder-scheduler-0" (UID: "96d66c8e-8cdb-462c-a302-c85e581db5ad") : secret "combined-ca-bundle" not found Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.821966 5120 reconciler_common.go:299] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/30d44474-74de-4982-8e48-31038a50607f-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.824389 5120 reconciler_common.go:299] "Volume detached for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/a8389bad-6789-42fe-8506-5ac83ff9514f-openstack-config-secret\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.824490 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5aa11a39-e139-4791-92ce-2771b0277a8b-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.824560 5120 reconciler_common.go:299] "Volume detached for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/30d44474-74de-4982-8e48-31038a50607f-ovsdbserver-nb-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.824627 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a8389bad-6789-42fe-8506-5ac83ff9514f-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:22 crc kubenswrapper[5120]: I0316 16:12:22.874319 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/openstack-galera-0" podUID="5c399606-817d-4a0f-b825-32da28e0491d" containerName="galera" containerID="cri-o://3b654e2f92586de226638d5cb91d375853baa73355cb33331d422696f899d8b5" gracePeriod=30 Mar 16 16:12:22 crc kubenswrapper[5120]: E0316 16:12:22.887698 5120 kuberuntime_manager.go:1358] "Unhandled Error" err=< Mar 16 16:12:22 crc kubenswrapper[5120]: container &Container{Name:mariadb-account-create-update,Image:quay.io/podified-antelope-centos9/openstack-mariadb@sha256:4caef2b55e01b9a7ee88a22bc69db1893521a91d95c7ad4c8e593f14f17a5f95,Command:[/bin/sh -c #!/bin/bash Mar 16 16:12:22 crc kubenswrapper[5120]: Mar 16 16:12:22 crc kubenswrapper[5120]: MYSQL_REMOTE_HOST="" source /var/lib/operator-scripts/mysql_root_auth.sh Mar 16 16:12:22 crc kubenswrapper[5120]: Mar 16 16:12:22 crc kubenswrapper[5120]: export DatabasePassword=${DatabasePassword:?"Please specify a DatabasePassword variable."} Mar 16 16:12:22 crc kubenswrapper[5120]: Mar 16 16:12:22 crc kubenswrapper[5120]: MYSQL_CMD="mysql -h -u root -P 3306" Mar 16 16:12:22 crc kubenswrapper[5120]: Mar 16 16:12:22 crc kubenswrapper[5120]: if [ -n "nova_cell1" ]; then Mar 16 16:12:22 crc kubenswrapper[5120]: GRANT_DATABASE="nova_cell1" Mar 16 16:12:22 crc kubenswrapper[5120]: else Mar 16 16:12:22 crc kubenswrapper[5120]: GRANT_DATABASE="*" Mar 16 16:12:22 crc kubenswrapper[5120]: fi Mar 16 16:12:22 crc kubenswrapper[5120]: Mar 16 16:12:22 crc kubenswrapper[5120]: # going for maximum compatibility here: Mar 16 16:12:22 crc kubenswrapper[5120]: # 1. MySQL 8 no longer allows implicit create user when GRANT is used Mar 16 16:12:22 crc kubenswrapper[5120]: # 2. MariaDB has "CREATE OR REPLACE", but MySQL does not Mar 16 16:12:22 crc kubenswrapper[5120]: # 3. create user with CREATE but then do all password and TLS with ALTER to Mar 16 16:12:22 crc kubenswrapper[5120]: # support updates Mar 16 16:12:22 crc kubenswrapper[5120]: Mar 16 16:12:22 crc kubenswrapper[5120]: $MYSQL_CMD < logger="UnhandledError" Mar 16 16:12:22 crc kubenswrapper[5120]: E0316 16:12:22.889412 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"mariadb-account-create-update\" with CreateContainerConfigError: \"secret \\\"nova-cell1-db-secret\\\" not found\"" pod="openstack-kuttl-tests/nova-cell1-917a-account-create-update-942tp" podUID="1d95fd75-2d15-48f7-9605-2d1980ebeff2" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.027084 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-7d679bc546-fx2h2" event={"ID":"9c8fe017-e320-4b3e-894e-f4258e8d265f","Type":"ContainerDied","Data":"3db74fc31cc9f68950b009f39db6e01dd25ecf398c5a0a5c2f3f7b6f2dff8aa1"} Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.027141 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-2fe2-account-create-update-b6c5t" event={"ID":"0d9bf89c-b546-4753-8e17-963b6dd4720b","Type":"ContainerStarted","Data":"dcf463f84d72b266cd87ac81a67359278b64b82729b246f56e60a17ca38eb9e7"} Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.047068 5120 scope.go:117] "RemoveContainer" containerID="1f965ee3a33f3366a6e93fba345fc49e5fd735d0a812c244327a2f9e0c3cff26" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.093159 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-7d679bc546-fx2h2" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.120430 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-69787fc498-jx88k" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.127415 5120 scope.go:117] "RemoveContainer" containerID="60324513292e67399e801c3f75048966767e12abc6a9079d9c7f31847ad746a3" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.162645 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-6623-account-create-update-5q5c8" Mar 16 16:12:23 crc kubenswrapper[5120]: E0316 16:12:23.162658 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="37accdb48c73bda606e0755923e4c375ae91d06251e5bc9a66dc8f1c54f97f2e" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:12:23 crc kubenswrapper[5120]: E0316 16:12:23.170984 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="37accdb48c73bda606e0755923e4c375ae91d06251e5bc9a66dc8f1c54f97f2e" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.179507 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:12:23 crc kubenswrapper[5120]: E0316 16:12:23.191346 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="37accdb48c73bda606e0755923e4c375ae91d06251e5bc9a66dc8f1c54f97f2e" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:12:23 crc kubenswrapper[5120]: E0316 16:12:23.191404 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="6a869ae4-5dd4-47d8-aa7e-e519981ee01f" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.198677 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-5566b7bdc5-47bld" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.198806 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.199619 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.207215 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.211133 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.231493 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.234485 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9c8fe017-e320-4b3e-894e-f4258e8d265f-combined-ca-bundle\") pod \"9c8fe017-e320-4b3e-894e-f4258e8d265f\" (UID: \"9c8fe017-e320-4b3e-894e-f4258e8d265f\") " Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.234579 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/34da2089-cc88-4d8c-97da-68aadf7f2c03-config-data\") pod \"34da2089-cc88-4d8c-97da-68aadf7f2c03\" (UID: \"34da2089-cc88-4d8c-97da-68aadf7f2c03\") " Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.234612 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5whvb\" (UniqueName: \"kubernetes.io/projected/9c8fe017-e320-4b3e-894e-f4258e8d265f-kube-api-access-5whvb\") pod \"9c8fe017-e320-4b3e-894e-f4258e8d265f\" (UID: \"9c8fe017-e320-4b3e-894e-f4258e8d265f\") " Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.234649 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/9c8fe017-e320-4b3e-894e-f4258e8d265f-run-httpd\") pod \"9c8fe017-e320-4b3e-894e-f4258e8d265f\" (UID: \"9c8fe017-e320-4b3e-894e-f4258e8d265f\") " Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.234705 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/34da2089-cc88-4d8c-97da-68aadf7f2c03-config-data-custom\") pod \"34da2089-cc88-4d8c-97da-68aadf7f2c03\" (UID: \"34da2089-cc88-4d8c-97da-68aadf7f2c03\") " Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.234724 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/34da2089-cc88-4d8c-97da-68aadf7f2c03-internal-tls-certs\") pod \"34da2089-cc88-4d8c-97da-68aadf7f2c03\" (UID: \"34da2089-cc88-4d8c-97da-68aadf7f2c03\") " Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.234780 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/9c8fe017-e320-4b3e-894e-f4258e8d265f-etc-swift\") pod \"9c8fe017-e320-4b3e-894e-f4258e8d265f\" (UID: \"9c8fe017-e320-4b3e-894e-f4258e8d265f\") " Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.234803 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9c8fe017-e320-4b3e-894e-f4258e8d265f-config-data\") pod \"9c8fe017-e320-4b3e-894e-f4258e8d265f\" (UID: \"9c8fe017-e320-4b3e-894e-f4258e8d265f\") " Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.234839 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/9c8fe017-e320-4b3e-894e-f4258e8d265f-log-httpd\") pod \"9c8fe017-e320-4b3e-894e-f4258e8d265f\" (UID: \"9c8fe017-e320-4b3e-894e-f4258e8d265f\") " Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.234925 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rxbnw\" (UniqueName: \"kubernetes.io/projected/34da2089-cc88-4d8c-97da-68aadf7f2c03-kube-api-access-rxbnw\") pod \"34da2089-cc88-4d8c-97da-68aadf7f2c03\" (UID: \"34da2089-cc88-4d8c-97da-68aadf7f2c03\") " Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.235032 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/34da2089-cc88-4d8c-97da-68aadf7f2c03-logs\") pod \"34da2089-cc88-4d8c-97da-68aadf7f2c03\" (UID: \"34da2089-cc88-4d8c-97da-68aadf7f2c03\") " Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.235144 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/9c8fe017-e320-4b3e-894e-f4258e8d265f-internal-tls-certs\") pod \"9c8fe017-e320-4b3e-894e-f4258e8d265f\" (UID: \"9c8fe017-e320-4b3e-894e-f4258e8d265f\") " Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.235183 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/34da2089-cc88-4d8c-97da-68aadf7f2c03-public-tls-certs\") pod \"34da2089-cc88-4d8c-97da-68aadf7f2c03\" (UID: \"34da2089-cc88-4d8c-97da-68aadf7f2c03\") " Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.235234 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/9c8fe017-e320-4b3e-894e-f4258e8d265f-public-tls-certs\") pod \"9c8fe017-e320-4b3e-894e-f4258e8d265f\" (UID: \"9c8fe017-e320-4b3e-894e-f4258e8d265f\") " Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.235258 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/34da2089-cc88-4d8c-97da-68aadf7f2c03-combined-ca-bundle\") pod \"34da2089-cc88-4d8c-97da-68aadf7f2c03\" (UID: \"34da2089-cc88-4d8c-97da-68aadf7f2c03\") " Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.236587 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c8fe017-e320-4b3e-894e-f4258e8d265f-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "9c8fe017-e320-4b3e-894e-f4258e8d265f" (UID: "9c8fe017-e320-4b3e-894e-f4258e8d265f"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.240083 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c8fe017-e320-4b3e-894e-f4258e8d265f-kube-api-access-5whvb" (OuterVolumeSpecName: "kube-api-access-5whvb") pod "9c8fe017-e320-4b3e-894e-f4258e8d265f" (UID: "9c8fe017-e320-4b3e-894e-f4258e8d265f"). InnerVolumeSpecName "kube-api-access-5whvb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.243474 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/34da2089-cc88-4d8c-97da-68aadf7f2c03-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "34da2089-cc88-4d8c-97da-68aadf7f2c03" (UID: "34da2089-cc88-4d8c-97da-68aadf7f2c03"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.252460 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34da2089-cc88-4d8c-97da-68aadf7f2c03-logs" (OuterVolumeSpecName: "logs") pod "34da2089-cc88-4d8c-97da-68aadf7f2c03" (UID: "34da2089-cc88-4d8c-97da-68aadf7f2c03"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:12:23 crc kubenswrapper[5120]: E0316 16:12:23.260777 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 16:12:23 crc kubenswrapper[5120]: E0316 16:12:23.260862 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe2105ae-76c1-452b-bee1-074d323c076f-combined-ca-bundle podName:fe2105ae-76c1-452b-bee1-074d323c076f nodeName:}" failed. No retries permitted until 2026-03-16 16:12:27.26084546 +0000 UTC m=+2449.414777117 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/fe2105ae-76c1-452b-bee1-074d323c076f-combined-ca-bundle") pod "swift-proxy-6d59599fcd-hn254" (UID: "fe2105ae-76c1-452b-bee1-074d323c076f") : secret "combined-ca-bundle" not found Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.264364 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c8fe017-e320-4b3e-894e-f4258e8d265f-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "9c8fe017-e320-4b3e-894e-f4258e8d265f" (UID: "9c8fe017-e320-4b3e-894e-f4258e8d265f"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.268875 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c8fe017-e320-4b3e-894e-f4258e8d265f-etc-swift" (OuterVolumeSpecName: "etc-swift") pod "9c8fe017-e320-4b3e-894e-f4258e8d265f" (UID: "9c8fe017-e320-4b3e-894e-f4258e8d265f"). InnerVolumeSpecName "etc-swift". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.269901 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34da2089-cc88-4d8c-97da-68aadf7f2c03-kube-api-access-rxbnw" (OuterVolumeSpecName: "kube-api-access-rxbnw") pod "34da2089-cc88-4d8c-97da-68aadf7f2c03" (UID: "34da2089-cc88-4d8c-97da-68aadf7f2c03"). InnerVolumeSpecName "kube-api-access-rxbnw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.295853 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/34da2089-cc88-4d8c-97da-68aadf7f2c03-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "34da2089-cc88-4d8c-97da-68aadf7f2c03" (UID: "34da2089-cc88-4d8c-97da-68aadf7f2c03"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.301905 5120 scope.go:117] "RemoveContainer" containerID="8b6fcf540a2852e7e2a452076d8c5ea6c757bd608aac9d175bb0875ea173bfc2" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.345134 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/34da2089-cc88-4d8c-97da-68aadf7f2c03-config-data" (OuterVolumeSpecName: "config-data") pod "34da2089-cc88-4d8c-97da-68aadf7f2c03" (UID: "34da2089-cc88-4d8c-97da-68aadf7f2c03"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.361020 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-5h578" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.374170 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/bebb35a6-a910-4c16-8fa3-5462afb3341a-kube-state-metrics-tls-config\") pod \"bebb35a6-a910-4c16-8fa3-5462afb3341a\" (UID: \"bebb35a6-a910-4c16-8fa3-5462afb3341a\") " Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.374671 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/cb4b4078-46df-4b50-aa4a-81adbbd15e52-config-data-custom\") pod \"cb4b4078-46df-4b50-aa4a-81adbbd15e52\" (UID: \"cb4b4078-46df-4b50-aa4a-81adbbd15e52\") " Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.374734 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/88c64b50-c653-4d39-a87a-ac9a49eaf06e-public-tls-certs\") pod \"88c64b50-c653-4d39-a87a-ac9a49eaf06e\" (UID: \"88c64b50-c653-4d39-a87a-ac9a49eaf06e\") " Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.375176 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bebb35a6-a910-4c16-8fa3-5462afb3341a-combined-ca-bundle\") pod \"bebb35a6-a910-4c16-8fa3-5462afb3341a\" (UID: \"bebb35a6-a910-4c16-8fa3-5462afb3341a\") " Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.375243 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/cb4b4078-46df-4b50-aa4a-81adbbd15e52-logs\") pod \"cb4b4078-46df-4b50-aa4a-81adbbd15e52\" (UID: \"cb4b4078-46df-4b50-aa4a-81adbbd15e52\") " Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.375307 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/88c64b50-c653-4d39-a87a-ac9a49eaf06e-config-data-custom\") pod \"88c64b50-c653-4d39-a87a-ac9a49eaf06e\" (UID: \"88c64b50-c653-4d39-a87a-ac9a49eaf06e\") " Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.375339 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/88c64b50-c653-4d39-a87a-ac9a49eaf06e-logs\") pod \"88c64b50-c653-4d39-a87a-ac9a49eaf06e\" (UID: \"88c64b50-c653-4d39-a87a-ac9a49eaf06e\") " Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.375487 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/60e80199-56f5-4a0c-b023-da9c28b1051f-operator-scripts\") pod \"60e80199-56f5-4a0c-b023-da9c28b1051f\" (UID: \"60e80199-56f5-4a0c-b023-da9c28b1051f\") " Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.375521 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cb4b4078-46df-4b50-aa4a-81adbbd15e52-combined-ca-bundle\") pod \"cb4b4078-46df-4b50-aa4a-81adbbd15e52\" (UID: \"cb4b4078-46df-4b50-aa4a-81adbbd15e52\") " Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.375546 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.375549 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/88c64b50-c653-4d39-a87a-ac9a49eaf06e-scripts\") pod \"88c64b50-c653-4d39-a87a-ac9a49eaf06e\" (UID: \"88c64b50-c653-4d39-a87a-ac9a49eaf06e\") " Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.375711 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/88c64b50-c653-4d39-a87a-ac9a49eaf06e-combined-ca-bundle\") pod \"88c64b50-c653-4d39-a87a-ac9a49eaf06e\" (UID: \"88c64b50-c653-4d39-a87a-ac9a49eaf06e\") " Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.375778 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/88c64b50-c653-4d39-a87a-ac9a49eaf06e-internal-tls-certs\") pod \"88c64b50-c653-4d39-a87a-ac9a49eaf06e\" (UID: \"88c64b50-c653-4d39-a87a-ac9a49eaf06e\") " Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.375821 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/88c64b50-c653-4d39-a87a-ac9a49eaf06e-config-data\") pod \"88c64b50-c653-4d39-a87a-ac9a49eaf06e\" (UID: \"88c64b50-c653-4d39-a87a-ac9a49eaf06e\") " Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.375917 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c959g\" (UniqueName: \"kubernetes.io/projected/60e80199-56f5-4a0c-b023-da9c28b1051f-kube-api-access-c959g\") pod \"60e80199-56f5-4a0c-b023-da9c28b1051f\" (UID: \"60e80199-56f5-4a0c-b023-da9c28b1051f\") " Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.375980 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sbbmf\" (UniqueName: \"kubernetes.io/projected/bebb35a6-a910-4c16-8fa3-5462afb3341a-kube-api-access-sbbmf\") pod \"bebb35a6-a910-4c16-8fa3-5462afb3341a\" (UID: \"bebb35a6-a910-4c16-8fa3-5462afb3341a\") " Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.376005 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/bebb35a6-a910-4c16-8fa3-5462afb3341a-kube-state-metrics-tls-certs\") pod \"bebb35a6-a910-4c16-8fa3-5462afb3341a\" (UID: \"bebb35a6-a910-4c16-8fa3-5462afb3341a\") " Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.376095 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/88c64b50-c653-4d39-a87a-ac9a49eaf06e-etc-machine-id\") pod \"88c64b50-c653-4d39-a87a-ac9a49eaf06e\" (UID: \"88c64b50-c653-4d39-a87a-ac9a49eaf06e\") " Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.376260 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cb4b4078-46df-4b50-aa4a-81adbbd15e52-config-data\") pod \"cb4b4078-46df-4b50-aa4a-81adbbd15e52\" (UID: \"cb4b4078-46df-4b50-aa4a-81adbbd15e52\") " Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.376365 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mqwkj\" (UniqueName: \"kubernetes.io/projected/88c64b50-c653-4d39-a87a-ac9a49eaf06e-kube-api-access-mqwkj\") pod \"88c64b50-c653-4d39-a87a-ac9a49eaf06e\" (UID: \"88c64b50-c653-4d39-a87a-ac9a49eaf06e\") " Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.376412 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hrjh6\" (UniqueName: \"kubernetes.io/projected/cb4b4078-46df-4b50-aa4a-81adbbd15e52-kube-api-access-hrjh6\") pod \"cb4b4078-46df-4b50-aa4a-81adbbd15e52\" (UID: \"cb4b4078-46df-4b50-aa4a-81adbbd15e52\") " Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.377896 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/34da2089-cc88-4d8c-97da-68aadf7f2c03-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.377916 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/34da2089-cc88-4d8c-97da-68aadf7f2c03-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.377926 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5whvb\" (UniqueName: \"kubernetes.io/projected/9c8fe017-e320-4b3e-894e-f4258e8d265f-kube-api-access-5whvb\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.377937 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/9c8fe017-e320-4b3e-894e-f4258e8d265f-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.377946 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/34da2089-cc88-4d8c-97da-68aadf7f2c03-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.377957 5120 reconciler_common.go:299] "Volume detached for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/9c8fe017-e320-4b3e-894e-f4258e8d265f-etc-swift\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.377964 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/9c8fe017-e320-4b3e-894e-f4258e8d265f-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.377974 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rxbnw\" (UniqueName: \"kubernetes.io/projected/34da2089-cc88-4d8c-97da-68aadf7f2c03-kube-api-access-rxbnw\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.377982 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/34da2089-cc88-4d8c-97da-68aadf7f2c03-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:23 crc kubenswrapper[5120]: E0316 16:12:23.378069 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-swift-public-svc: secret "cert-swift-public-svc" not found Mar 16 16:12:23 crc kubenswrapper[5120]: E0316 16:12:23.378119 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe2105ae-76c1-452b-bee1-074d323c076f-public-tls-certs podName:fe2105ae-76c1-452b-bee1-074d323c076f nodeName:}" failed. No retries permitted until 2026-03-16 16:12:27.378105901 +0000 UTC m=+2449.532037558 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/fe2105ae-76c1-452b-bee1-074d323c076f-public-tls-certs") pod "swift-proxy-6d59599fcd-hn254" (UID: "fe2105ae-76c1-452b-bee1-074d323c076f") : secret "cert-swift-public-svc" not found Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.378476 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/60e80199-56f5-4a0c-b023-da9c28b1051f-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "60e80199-56f5-4a0c-b023-da9c28b1051f" (UID: "60e80199-56f5-4a0c-b023-da9c28b1051f"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.378517 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/88c64b50-c653-4d39-a87a-ac9a49eaf06e-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "88c64b50-c653-4d39-a87a-ac9a49eaf06e" (UID: "88c64b50-c653-4d39-a87a-ac9a49eaf06e"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.378652 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88c64b50-c653-4d39-a87a-ac9a49eaf06e-logs" (OuterVolumeSpecName: "logs") pod "88c64b50-c653-4d39-a87a-ac9a49eaf06e" (UID: "88c64b50-c653-4d39-a87a-ac9a49eaf06e"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.378850 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/34da2089-cc88-4d8c-97da-68aadf7f2c03-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "34da2089-cc88-4d8c-97da-68aadf7f2c03" (UID: "34da2089-cc88-4d8c-97da-68aadf7f2c03"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:23 crc kubenswrapper[5120]: E0316 16:12:23.379149 5120 projected.go:264] Couldn't get secret openstack-kuttl-tests/swift-proxy-config-data: secret "swift-proxy-config-data" not found Mar 16 16:12:23 crc kubenswrapper[5120]: E0316 16:12:23.379214 5120 projected.go:264] Couldn't get secret openstack-kuttl-tests/swift-conf: secret "swift-conf" not found Mar 16 16:12:23 crc kubenswrapper[5120]: E0316 16:12:23.379228 5120 projected.go:289] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Mar 16 16:12:23 crc kubenswrapper[5120]: E0316 16:12:23.379238 5120 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-proxy-6d59599fcd-hn254: [secret "swift-proxy-config-data" not found, secret "swift-conf" not found, configmap "swift-ring-files" not found] Mar 16 16:12:23 crc kubenswrapper[5120]: E0316 16:12:23.379269 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fe2105ae-76c1-452b-bee1-074d323c076f-etc-swift podName:fe2105ae-76c1-452b-bee1-074d323c076f nodeName:}" failed. No retries permitted until 2026-03-16 16:12:27.379259602 +0000 UTC m=+2449.533191259 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/fe2105ae-76c1-452b-bee1-074d323c076f-etc-swift") pod "swift-proxy-6d59599fcd-hn254" (UID: "fe2105ae-76c1-452b-bee1-074d323c076f") : [secret "swift-proxy-config-data" not found, secret "swift-conf" not found, configmap "swift-ring-files" not found] Mar 16 16:12:23 crc kubenswrapper[5120]: E0316 16:12:23.380248 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-swift-internal-svc: secret "cert-swift-internal-svc" not found Mar 16 16:12:23 crc kubenswrapper[5120]: E0316 16:12:23.380306 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe2105ae-76c1-452b-bee1-074d323c076f-internal-tls-certs podName:fe2105ae-76c1-452b-bee1-074d323c076f nodeName:}" failed. No retries permitted until 2026-03-16 16:12:27.380290321 +0000 UTC m=+2449.534221968 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/fe2105ae-76c1-452b-bee1-074d323c076f-internal-tls-certs") pod "swift-proxy-6d59599fcd-hn254" (UID: "fe2105ae-76c1-452b-bee1-074d323c076f") : secret "cert-swift-internal-svc" not found Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.386692 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb4b4078-46df-4b50-aa4a-81adbbd15e52-logs" (OuterVolumeSpecName: "logs") pod "cb4b4078-46df-4b50-aa4a-81adbbd15e52" (UID: "cb4b4078-46df-4b50-aa4a-81adbbd15e52"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.393895 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.393977 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-2fe2-account-create-update-b6c5t" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.396632 5120 scope.go:117] "RemoveContainer" containerID="fbbfd6f0fd64c190f248274deb1940fd09e15076025138df16cb70d5ebc9868a" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.422953 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb4b4078-46df-4b50-aa4a-81adbbd15e52-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "cb4b4078-46df-4b50-aa4a-81adbbd15e52" (UID: "cb4b4078-46df-4b50-aa4a-81adbbd15e52"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.422999 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60e80199-56f5-4a0c-b023-da9c28b1051f-kube-api-access-c959g" (OuterVolumeSpecName: "kube-api-access-c959g") pod "60e80199-56f5-4a0c-b023-da9c28b1051f" (UID: "60e80199-56f5-4a0c-b023-da9c28b1051f"). InnerVolumeSpecName "kube-api-access-c959g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.423052 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/88c64b50-c653-4d39-a87a-ac9a49eaf06e-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "88c64b50-c653-4d39-a87a-ac9a49eaf06e" (UID: "88c64b50-c653-4d39-a87a-ac9a49eaf06e"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.423087 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/88c64b50-c653-4d39-a87a-ac9a49eaf06e-scripts" (OuterVolumeSpecName: "scripts") pod "88c64b50-c653-4d39-a87a-ac9a49eaf06e" (UID: "88c64b50-c653-4d39-a87a-ac9a49eaf06e"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.423095 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88c64b50-c653-4d39-a87a-ac9a49eaf06e-kube-api-access-mqwkj" (OuterVolumeSpecName: "kube-api-access-mqwkj") pod "88c64b50-c653-4d39-a87a-ac9a49eaf06e" (UID: "88c64b50-c653-4d39-a87a-ac9a49eaf06e"). InnerVolumeSpecName "kube-api-access-mqwkj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.423136 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bebb35a6-a910-4c16-8fa3-5462afb3341a-kube-api-access-sbbmf" (OuterVolumeSpecName: "kube-api-access-sbbmf") pod "bebb35a6-a910-4c16-8fa3-5462afb3341a" (UID: "bebb35a6-a910-4c16-8fa3-5462afb3341a"). InnerVolumeSpecName "kube-api-access-sbbmf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.423158 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb4b4078-46df-4b50-aa4a-81adbbd15e52-kube-api-access-hrjh6" (OuterVolumeSpecName: "kube-api-access-hrjh6") pod "cb4b4078-46df-4b50-aa4a-81adbbd15e52" (UID: "cb4b4078-46df-4b50-aa4a-81adbbd15e52"). InnerVolumeSpecName "kube-api-access-hrjh6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.436032 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-6d59599fcd-hn254" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.452883 5120 scope.go:117] "RemoveContainer" containerID="820cf0b744b014f72ef8c35261feee7d781834c65a720335f779bb77e8523fe4" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.456718 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/34da2089-cc88-4d8c-97da-68aadf7f2c03-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "34da2089-cc88-4d8c-97da-68aadf7f2c03" (UID: "34da2089-cc88-4d8c-97da-68aadf7f2c03"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.462028 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9c8fe017-e320-4b3e-894e-f4258e8d265f-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "9c8fe017-e320-4b3e-894e-f4258e8d265f" (UID: "9c8fe017-e320-4b3e-894e-f4258e8d265f"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.478903 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/5470c9e3-c2c2-4294-965d-cd4ff001bd74-kolla-config\") pod \"5470c9e3-c2c2-4294-965d-cd4ff001bd74\" (UID: \"5470c9e3-c2c2-4294-965d-cd4ff001bd74\") " Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.479500 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/5470c9e3-c2c2-4294-965d-cd4ff001bd74-config-data\") pod \"5470c9e3-c2c2-4294-965d-cd4ff001bd74\" (UID: \"5470c9e3-c2c2-4294-965d-cd4ff001bd74\") " Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.479557 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/5470c9e3-c2c2-4294-965d-cd4ff001bd74-memcached-tls-certs\") pod \"5470c9e3-c2c2-4294-965d-cd4ff001bd74\" (UID: \"5470c9e3-c2c2-4294-965d-cd4ff001bd74\") " Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.479573 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5470c9e3-c2c2-4294-965d-cd4ff001bd74-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "5470c9e3-c2c2-4294-965d-cd4ff001bd74" (UID: "5470c9e3-c2c2-4294-965d-cd4ff001bd74"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.479937 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/dae19557-6584-433e-a345-c373d9e8a4ae-vencrypt-tls-certs\") pod \"dae19557-6584-433e-a345-c373d9e8a4ae\" (UID: \"dae19557-6584-433e-a345-c373d9e8a4ae\") " Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.479976 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0d9bf89c-b546-4753-8e17-963b6dd4720b-operator-scripts\") pod \"0d9bf89c-b546-4753-8e17-963b6dd4720b\" (UID: \"0d9bf89c-b546-4753-8e17-963b6dd4720b\") " Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.480034 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/fe2105ae-76c1-452b-bee1-074d323c076f-log-httpd\") pod \"fe2105ae-76c1-452b-bee1-074d323c076f\" (UID: \"fe2105ae-76c1-452b-bee1-074d323c076f\") " Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.480090 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/fe2105ae-76c1-452b-bee1-074d323c076f-etc-swift\") pod \"fe2105ae-76c1-452b-bee1-074d323c076f\" (UID: \"fe2105ae-76c1-452b-bee1-074d323c076f\") " Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.480110 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fe2105ae-76c1-452b-bee1-074d323c076f-config-data\") pod \"fe2105ae-76c1-452b-bee1-074d323c076f\" (UID: \"fe2105ae-76c1-452b-bee1-074d323c076f\") " Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.480164 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n8b6z\" (UniqueName: \"kubernetes.io/projected/fe2105ae-76c1-452b-bee1-074d323c076f-kube-api-access-n8b6z\") pod \"fe2105ae-76c1-452b-bee1-074d323c076f\" (UID: \"fe2105ae-76c1-452b-bee1-074d323c076f\") " Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.480196 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tc44g\" (UniqueName: \"kubernetes.io/projected/5470c9e3-c2c2-4294-965d-cd4ff001bd74-kube-api-access-tc44g\") pod \"5470c9e3-c2c2-4294-965d-cd4ff001bd74\" (UID: \"5470c9e3-c2c2-4294-965d-cd4ff001bd74\") " Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.480217 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/fe2105ae-76c1-452b-bee1-074d323c076f-run-httpd\") pod \"fe2105ae-76c1-452b-bee1-074d323c076f\" (UID: \"fe2105ae-76c1-452b-bee1-074d323c076f\") " Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.480251 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5470c9e3-c2c2-4294-965d-cd4ff001bd74-combined-ca-bundle\") pod \"5470c9e3-c2c2-4294-965d-cd4ff001bd74\" (UID: \"5470c9e3-c2c2-4294-965d-cd4ff001bd74\") " Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.480361 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fe2105ae-76c1-452b-bee1-074d323c076f-combined-ca-bundle\") pod \"fe2105ae-76c1-452b-bee1-074d323c076f\" (UID: \"fe2105ae-76c1-452b-bee1-074d323c076f\") " Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.480408 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/fe2105ae-76c1-452b-bee1-074d323c076f-internal-tls-certs\") pod \"fe2105ae-76c1-452b-bee1-074d323c076f\" (UID: \"fe2105ae-76c1-452b-bee1-074d323c076f\") " Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.480428 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dae19557-6584-433e-a345-c373d9e8a4ae-config-data\") pod \"dae19557-6584-433e-a345-c373d9e8a4ae\" (UID: \"dae19557-6584-433e-a345-c373d9e8a4ae\") " Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.480454 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/dae19557-6584-433e-a345-c373d9e8a4ae-nova-novncproxy-tls-certs\") pod \"dae19557-6584-433e-a345-c373d9e8a4ae\" (UID: \"dae19557-6584-433e-a345-c373d9e8a4ae\") " Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.480503 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dae19557-6584-433e-a345-c373d9e8a4ae-combined-ca-bundle\") pod \"dae19557-6584-433e-a345-c373d9e8a4ae\" (UID: \"dae19557-6584-433e-a345-c373d9e8a4ae\") " Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.480565 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sjdmv\" (UniqueName: \"kubernetes.io/projected/0d9bf89c-b546-4753-8e17-963b6dd4720b-kube-api-access-sjdmv\") pod \"0d9bf89c-b546-4753-8e17-963b6dd4720b\" (UID: \"0d9bf89c-b546-4753-8e17-963b6dd4720b\") " Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.480638 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wtq4k\" (UniqueName: \"kubernetes.io/projected/dae19557-6584-433e-a345-c373d9e8a4ae-kube-api-access-wtq4k\") pod \"dae19557-6584-433e-a345-c373d9e8a4ae\" (UID: \"dae19557-6584-433e-a345-c373d9e8a4ae\") " Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.480669 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/fe2105ae-76c1-452b-bee1-074d323c076f-public-tls-certs\") pod \"fe2105ae-76c1-452b-bee1-074d323c076f\" (UID: \"fe2105ae-76c1-452b-bee1-074d323c076f\") " Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.481925 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5470c9e3-c2c2-4294-965d-cd4ff001bd74-config-data" (OuterVolumeSpecName: "config-data") pod "5470c9e3-c2c2-4294-965d-cd4ff001bd74" (UID: "5470c9e3-c2c2-4294-965d-cd4ff001bd74"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.482197 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe2105ae-76c1-452b-bee1-074d323c076f-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "fe2105ae-76c1-452b-bee1-074d323c076f" (UID: "fe2105ae-76c1-452b-bee1-074d323c076f"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.483189 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d9bf89c-b546-4753-8e17-963b6dd4720b-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "0d9bf89c-b546-4753-8e17-963b6dd4720b" (UID: "0d9bf89c-b546-4753-8e17-963b6dd4720b"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.483829 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe2105ae-76c1-452b-bee1-074d323c076f-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "fe2105ae-76c1-452b-bee1-074d323c076f" (UID: "fe2105ae-76c1-452b-bee1-074d323c076f"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.485810 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/88c64b50-c653-4d39-a87a-ac9a49eaf06e-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "88c64b50-c653-4d39-a87a-ac9a49eaf06e" (UID: "88c64b50-c653-4d39-a87a-ac9a49eaf06e"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.486550 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/dca01bf3-3d87-4d0e-9cf7-481863c6144d-operator-scripts\") pod \"keystone-6623-account-create-update-5q5c8\" (UID: \"dca01bf3-3d87-4d0e-9cf7-481863c6144d\") " pod="openstack-kuttl-tests/keystone-6623-account-create-update-5q5c8" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.486751 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9bd8k\" (UniqueName: \"kubernetes.io/projected/dca01bf3-3d87-4d0e-9cf7-481863c6144d-kube-api-access-9bd8k\") pod \"keystone-6623-account-create-update-5q5c8\" (UID: \"dca01bf3-3d87-4d0e-9cf7-481863c6144d\") " pod="openstack-kuttl-tests/keystone-6623-account-create-update-5q5c8" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.486976 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/cb4b4078-46df-4b50-aa4a-81adbbd15e52-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.487001 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/34da2089-cc88-4d8c-97da-68aadf7f2c03-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.487014 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/cb4b4078-46df-4b50-aa4a-81adbbd15e52-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.487028 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/88c64b50-c653-4d39-a87a-ac9a49eaf06e-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.487040 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/88c64b50-c653-4d39-a87a-ac9a49eaf06e-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.487051 5120 reconciler_common.go:299] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/5470c9e3-c2c2-4294-965d-cd4ff001bd74-kolla-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.487064 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/60e80199-56f5-4a0c-b023-da9c28b1051f-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.487076 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/88c64b50-c653-4d39-a87a-ac9a49eaf06e-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.487088 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/88c64b50-c653-4d39-a87a-ac9a49eaf06e-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.487099 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/5470c9e3-c2c2-4294-965d-cd4ff001bd74-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.487112 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c959g\" (UniqueName: \"kubernetes.io/projected/60e80199-56f5-4a0c-b023-da9c28b1051f-kube-api-access-c959g\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.487125 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sbbmf\" (UniqueName: \"kubernetes.io/projected/bebb35a6-a910-4c16-8fa3-5462afb3341a-kube-api-access-sbbmf\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.487138 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9c8fe017-e320-4b3e-894e-f4258e8d265f-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.487149 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0d9bf89c-b546-4753-8e17-963b6dd4720b-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.487161 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/fe2105ae-76c1-452b-bee1-074d323c076f-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.487172 5120 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/88c64b50-c653-4d39-a87a-ac9a49eaf06e-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.487186 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/34da2089-cc88-4d8c-97da-68aadf7f2c03-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.487198 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/fe2105ae-76c1-452b-bee1-074d323c076f-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.487211 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mqwkj\" (UniqueName: \"kubernetes.io/projected/88c64b50-c653-4d39-a87a-ac9a49eaf06e-kube-api-access-mqwkj\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.487223 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hrjh6\" (UniqueName: \"kubernetes.io/projected/cb4b4078-46df-4b50-aa4a-81adbbd15e52-kube-api-access-hrjh6\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:23 crc kubenswrapper[5120]: E0316 16:12:23.487595 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Mar 16 16:12:23 crc kubenswrapper[5120]: E0316 16:12:23.487648 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dca01bf3-3d87-4d0e-9cf7-481863c6144d-operator-scripts podName:dca01bf3-3d87-4d0e-9cf7-481863c6144d nodeName:}" failed. No retries permitted until 2026-03-16 16:12:25.487630924 +0000 UTC m=+2447.641562591 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/dca01bf3-3d87-4d0e-9cf7-481863c6144d-operator-scripts") pod "keystone-6623-account-create-update-5q5c8" (UID: "dca01bf3-3d87-4d0e-9cf7-481863c6144d") : configmap "openstack-scripts" not found Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.490899 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bebb35a6-a910-4c16-8fa3-5462afb3341a-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "bebb35a6-a910-4c16-8fa3-5462afb3341a" (UID: "bebb35a6-a910-4c16-8fa3-5462afb3341a"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:23 crc kubenswrapper[5120]: E0316 16:12:23.491823 5120 projected.go:194] Error preparing data for projected volume kube-api-access-9bd8k for pod openstack-kuttl-tests/keystone-6623-account-create-update-5q5c8: failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 16:12:23 crc kubenswrapper[5120]: E0316 16:12:23.491905 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dca01bf3-3d87-4d0e-9cf7-481863c6144d-kube-api-access-9bd8k podName:dca01bf3-3d87-4d0e-9cf7-481863c6144d nodeName:}" failed. No retries permitted until 2026-03-16 16:12:25.491885979 +0000 UTC m=+2447.645817636 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-9bd8k" (UniqueName: "kubernetes.io/projected/dca01bf3-3d87-4d0e-9cf7-481863c6144d-kube-api-access-9bd8k") pod "keystone-6623-account-create-update-5q5c8" (UID: "dca01bf3-3d87-4d0e-9cf7-481863c6144d") : failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.499436 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe2105ae-76c1-452b-bee1-074d323c076f-kube-api-access-n8b6z" (OuterVolumeSpecName: "kube-api-access-n8b6z") pod "fe2105ae-76c1-452b-bee1-074d323c076f" (UID: "fe2105ae-76c1-452b-bee1-074d323c076f"). InnerVolumeSpecName "kube-api-access-n8b6z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.499888 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5470c9e3-c2c2-4294-965d-cd4ff001bd74-kube-api-access-tc44g" (OuterVolumeSpecName: "kube-api-access-tc44g") pod "5470c9e3-c2c2-4294-965d-cd4ff001bd74" (UID: "5470c9e3-c2c2-4294-965d-cd4ff001bd74"). InnerVolumeSpecName "kube-api-access-tc44g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.500836 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe2105ae-76c1-452b-bee1-074d323c076f-etc-swift" (OuterVolumeSpecName: "etc-swift") pod "fe2105ae-76c1-452b-bee1-074d323c076f" (UID: "fe2105ae-76c1-452b-bee1-074d323c076f"). InnerVolumeSpecName "etc-swift". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.504411 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dae19557-6584-433e-a345-c373d9e8a4ae-kube-api-access-wtq4k" (OuterVolumeSpecName: "kube-api-access-wtq4k") pod "dae19557-6584-433e-a345-c373d9e8a4ae" (UID: "dae19557-6584-433e-a345-c373d9e8a4ae"). InnerVolumeSpecName "kube-api-access-wtq4k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.510914 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9c8fe017-e320-4b3e-894e-f4258e8d265f-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "9c8fe017-e320-4b3e-894e-f4258e8d265f" (UID: "9c8fe017-e320-4b3e-894e-f4258e8d265f"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.512519 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d9bf89c-b546-4753-8e17-963b6dd4720b-kube-api-access-sjdmv" (OuterVolumeSpecName: "kube-api-access-sjdmv") pod "0d9bf89c-b546-4753-8e17-963b6dd4720b" (UID: "0d9bf89c-b546-4753-8e17-963b6dd4720b"). InnerVolumeSpecName "kube-api-access-sjdmv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.522284 5120 scope.go:117] "RemoveContainer" containerID="b8adae27cb47fa8c07b0445649495ea94709c8815ea94e345953af8d7bd93388" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.526852 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb4b4078-46df-4b50-aa4a-81adbbd15e52-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "cb4b4078-46df-4b50-aa4a-81adbbd15e52" (UID: "cb4b4078-46df-4b50-aa4a-81adbbd15e52"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.527685 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bebb35a6-a910-4c16-8fa3-5462afb3341a-kube-state-metrics-tls-config" (OuterVolumeSpecName: "kube-state-metrics-tls-config") pod "bebb35a6-a910-4c16-8fa3-5462afb3341a" (UID: "bebb35a6-a910-4c16-8fa3-5462afb3341a"). InnerVolumeSpecName "kube-state-metrics-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.529002 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9c8fe017-e320-4b3e-894e-f4258e8d265f-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "9c8fe017-e320-4b3e-894e-f4258e8d265f" (UID: "9c8fe017-e320-4b3e-894e-f4258e8d265f"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.556451 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.566913 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5470c9e3-c2c2-4294-965d-cd4ff001bd74-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "5470c9e3-c2c2-4294-965d-cd4ff001bd74" (UID: "5470c9e3-c2c2-4294-965d-cd4ff001bd74"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.585898 5120 scope.go:117] "RemoveContainer" containerID="11f81caa83f0c9ef60769664b8c971b68ba4bc25cc7de3bb33d429ea3b426e32" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.588123 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/eb50beed-fd12-4d73-95bf-413136771ffe-config-data-default\") pod \"eb50beed-fd12-4d73-95bf-413136771ffe\" (UID: \"eb50beed-fd12-4d73-95bf-413136771ffe\") " Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.588186 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"mysql-db\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"eb50beed-fd12-4d73-95bf-413136771ffe\" (UID: \"eb50beed-fd12-4d73-95bf-413136771ffe\") " Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.588305 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eb50beed-fd12-4d73-95bf-413136771ffe-combined-ca-bundle\") pod \"eb50beed-fd12-4d73-95bf-413136771ffe\" (UID: \"eb50beed-fd12-4d73-95bf-413136771ffe\") " Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.588353 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/eb50beed-fd12-4d73-95bf-413136771ffe-kolla-config\") pod \"eb50beed-fd12-4d73-95bf-413136771ffe\" (UID: \"eb50beed-fd12-4d73-95bf-413136771ffe\") " Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.588427 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dbvr7\" (UniqueName: \"kubernetes.io/projected/eb50beed-fd12-4d73-95bf-413136771ffe-kube-api-access-dbvr7\") pod \"eb50beed-fd12-4d73-95bf-413136771ffe\" (UID: \"eb50beed-fd12-4d73-95bf-413136771ffe\") " Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.589079 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/eb50beed-fd12-4d73-95bf-413136771ffe-operator-scripts\") pod \"eb50beed-fd12-4d73-95bf-413136771ffe\" (UID: \"eb50beed-fd12-4d73-95bf-413136771ffe\") " Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.589155 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/eb50beed-fd12-4d73-95bf-413136771ffe-config-data-generated\") pod \"eb50beed-fd12-4d73-95bf-413136771ffe\" (UID: \"eb50beed-fd12-4d73-95bf-413136771ffe\") " Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.589467 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/eb50beed-fd12-4d73-95bf-413136771ffe-galera-tls-certs\") pod \"eb50beed-fd12-4d73-95bf-413136771ffe\" (UID: \"eb50beed-fd12-4d73-95bf-413136771ffe\") " Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.590275 5120 reconciler_common.go:299] "Volume detached for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/bebb35a6-a910-4c16-8fa3-5462afb3341a-kube-state-metrics-tls-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.590302 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sjdmv\" (UniqueName: \"kubernetes.io/projected/0d9bf89c-b546-4753-8e17-963b6dd4720b-kube-api-access-sjdmv\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.590317 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wtq4k\" (UniqueName: \"kubernetes.io/projected/dae19557-6584-433e-a345-c373d9e8a4ae-kube-api-access-wtq4k\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.590329 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/9c8fe017-e320-4b3e-894e-f4258e8d265f-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.590343 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bebb35a6-a910-4c16-8fa3-5462afb3341a-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.590356 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/9c8fe017-e320-4b3e-894e-f4258e8d265f-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.590371 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cb4b4078-46df-4b50-aa4a-81adbbd15e52-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.590383 5120 reconciler_common.go:299] "Volume detached for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/fe2105ae-76c1-452b-bee1-074d323c076f-etc-swift\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.590394 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n8b6z\" (UniqueName: \"kubernetes.io/projected/fe2105ae-76c1-452b-bee1-074d323c076f-kube-api-access-n8b6z\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.590408 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tc44g\" (UniqueName: \"kubernetes.io/projected/5470c9e3-c2c2-4294-965d-cd4ff001bd74-kube-api-access-tc44g\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.590421 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5470c9e3-c2c2-4294-965d-cd4ff001bd74-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.591213 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eb50beed-fd12-4d73-95bf-413136771ffe-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "eb50beed-fd12-4d73-95bf-413136771ffe" (UID: "eb50beed-fd12-4d73-95bf-413136771ffe"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.591307 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb50beed-fd12-4d73-95bf-413136771ffe-config-data-generated" (OuterVolumeSpecName: "config-data-generated") pod "eb50beed-fd12-4d73-95bf-413136771ffe" (UID: "eb50beed-fd12-4d73-95bf-413136771ffe"). InnerVolumeSpecName "config-data-generated". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.591572 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eb50beed-fd12-4d73-95bf-413136771ffe-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "eb50beed-fd12-4d73-95bf-413136771ffe" (UID: "eb50beed-fd12-4d73-95bf-413136771ffe"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.592062 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eb50beed-fd12-4d73-95bf-413136771ffe-config-data-default" (OuterVolumeSpecName: "config-data-default") pod "eb50beed-fd12-4d73-95bf-413136771ffe" (UID: "eb50beed-fd12-4d73-95bf-413136771ffe"). InnerVolumeSpecName "config-data-default". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.598830 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5470c9e3-c2c2-4294-965d-cd4ff001bd74-memcached-tls-certs" (OuterVolumeSpecName: "memcached-tls-certs") pod "5470c9e3-c2c2-4294-965d-cd4ff001bd74" (UID: "5470c9e3-c2c2-4294-965d-cd4ff001bd74"). InnerVolumeSpecName "memcached-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.614615 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb50beed-fd12-4d73-95bf-413136771ffe-kube-api-access-dbvr7" (OuterVolumeSpecName: "kube-api-access-dbvr7") pod "eb50beed-fd12-4d73-95bf-413136771ffe" (UID: "eb50beed-fd12-4d73-95bf-413136771ffe"). InnerVolumeSpecName "kube-api-access-dbvr7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.623780 5120 scope.go:117] "RemoveContainer" containerID="2fa42e597db80f165871a57845e4e2ef64e3229a4086efd36ecbeea07cd1fa0c" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.624657 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9c8fe017-e320-4b3e-894e-f4258e8d265f-config-data" (OuterVolumeSpecName: "config-data") pod "9c8fe017-e320-4b3e-894e-f4258e8d265f" (UID: "9c8fe017-e320-4b3e-894e-f4258e8d265f"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.634938 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/88c64b50-c653-4d39-a87a-ac9a49eaf06e-config-data" (OuterVolumeSpecName: "config-data") pod "88c64b50-c653-4d39-a87a-ac9a49eaf06e" (UID: "88c64b50-c653-4d39-a87a-ac9a49eaf06e"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.636259 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bebb35a6-a910-4c16-8fa3-5462afb3341a-kube-state-metrics-tls-certs" (OuterVolumeSpecName: "kube-state-metrics-tls-certs") pod "bebb35a6-a910-4c16-8fa3-5462afb3341a" (UID: "bebb35a6-a910-4c16-8fa3-5462afb3341a"). InnerVolumeSpecName "kube-state-metrics-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.645644 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage10-crc" (OuterVolumeSpecName: "mysql-db") pod "eb50beed-fd12-4d73-95bf-413136771ffe" (UID: "eb50beed-fd12-4d73-95bf-413136771ffe"). InnerVolumeSpecName "local-storage10-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.653036 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dae19557-6584-433e-a345-c373d9e8a4ae-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "dae19557-6584-433e-a345-c373d9e8a4ae" (UID: "dae19557-6584-433e-a345-c373d9e8a4ae"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.657138 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb4b4078-46df-4b50-aa4a-81adbbd15e52-config-data" (OuterVolumeSpecName: "config-data") pod "cb4b4078-46df-4b50-aa4a-81adbbd15e52" (UID: "cb4b4078-46df-4b50-aa4a-81adbbd15e52"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.677913 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe2105ae-76c1-452b-bee1-074d323c076f-config-data" (OuterVolumeSpecName: "config-data") pod "fe2105ae-76c1-452b-bee1-074d323c076f" (UID: "fe2105ae-76c1-452b-bee1-074d323c076f"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.680846 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe2105ae-76c1-452b-bee1-074d323c076f-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "fe2105ae-76c1-452b-bee1-074d323c076f" (UID: "fe2105ae-76c1-452b-bee1-074d323c076f"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.687298 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dae19557-6584-433e-a345-c373d9e8a4ae-config-data" (OuterVolumeSpecName: "config-data") pod "dae19557-6584-433e-a345-c373d9e8a4ae" (UID: "dae19557-6584-433e-a345-c373d9e8a4ae"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.693065 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dae19557-6584-433e-a345-c373d9e8a4ae-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.693095 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/eb50beed-fd12-4d73-95bf-413136771ffe-config-data-default\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.693121 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") on node \"crc\" " Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.693130 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dae19557-6584-433e-a345-c373d9e8a4ae-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.693139 5120 reconciler_common.go:299] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/eb50beed-fd12-4d73-95bf-413136771ffe-kolla-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.693150 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dbvr7\" (UniqueName: \"kubernetes.io/projected/eb50beed-fd12-4d73-95bf-413136771ffe-kube-api-access-dbvr7\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.693159 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/fe2105ae-76c1-452b-bee1-074d323c076f-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.693169 5120 reconciler_common.go:299] "Volume detached for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/5470c9e3-c2c2-4294-965d-cd4ff001bd74-memcached-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.693178 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/88c64b50-c653-4d39-a87a-ac9a49eaf06e-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.693188 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/eb50beed-fd12-4d73-95bf-413136771ffe-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.693198 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/eb50beed-fd12-4d73-95bf-413136771ffe-config-data-generated\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.693208 5120 reconciler_common.go:299] "Volume detached for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/bebb35a6-a910-4c16-8fa3-5462afb3341a-kube-state-metrics-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.693217 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fe2105ae-76c1-452b-bee1-074d323c076f-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.693226 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9c8fe017-e320-4b3e-894e-f4258e8d265f-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.693234 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cb4b4078-46df-4b50-aa4a-81adbbd15e52-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.705140 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/88c64b50-c653-4d39-a87a-ac9a49eaf06e-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "88c64b50-c653-4d39-a87a-ac9a49eaf06e" (UID: "88c64b50-c653-4d39-a87a-ac9a49eaf06e"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.713977 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe2105ae-76c1-452b-bee1-074d323c076f-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "fe2105ae-76c1-452b-bee1-074d323c076f" (UID: "fe2105ae-76c1-452b-bee1-074d323c076f"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.719403 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-ecee-account-create-update-vpjvm" event={"ID":"a0d48ffc-4eac-4602-b2e3-902e4a80c6a3","Type":"ContainerStarted","Data":"348aaa4ab299bb2d488847552015a28ead8c8ba3eb345812e801edf04b78c1be"} Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.735193 5120 generic.go:358] "Generic (PLEG): container finished" podID="eefef8ba-a54a-4ee8-9c31-757cc07a6ab3" containerID="8a72a823ca221dc9900f87e4a72727ccf8445b5e8cb9e21be9e5da2737ba7e71" exitCode=0 Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.735290 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-595564474-m6lrq" event={"ID":"eefef8ba-a54a-4ee8-9c31-757cc07a6ab3","Type":"ContainerDied","Data":"8a72a823ca221dc9900f87e4a72727ccf8445b5e8cb9e21be9e5da2737ba7e71"} Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.737059 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dae19557-6584-433e-a345-c373d9e8a4ae-nova-novncproxy-tls-certs" (OuterVolumeSpecName: "nova-novncproxy-tls-certs") pod "dae19557-6584-433e-a345-c373d9e8a4ae" (UID: "dae19557-6584-433e-a345-c373d9e8a4ae"). InnerVolumeSpecName "nova-novncproxy-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.738469 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dae19557-6584-433e-a345-c373d9e8a4ae-vencrypt-tls-certs" (OuterVolumeSpecName: "vencrypt-tls-certs") pod "dae19557-6584-433e-a345-c373d9e8a4ae" (UID: "dae19557-6584-433e-a345-c373d9e8a4ae"). InnerVolumeSpecName "vencrypt-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.743078 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage10-crc" (UniqueName: "kubernetes.io/local-volume/local-storage10-crc") on node "crc" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.748899 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe2105ae-76c1-452b-bee1-074d323c076f-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "fe2105ae-76c1-452b-bee1-074d323c076f" (UID: "fe2105ae-76c1-452b-bee1-074d323c076f"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.748959 5120 generic.go:358] "Generic (PLEG): container finished" podID="234493a1-61e6-4b74-a15a-888b6cee3dff" containerID="d4470c95354463ae7bef07e64e7ce90b12f9fb90cabd9d81cf8b1e208517201a" exitCode=0 Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.749078 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-qwsw8" event={"ID":"234493a1-61e6-4b74-a15a-888b6cee3dff","Type":"ContainerDied","Data":"d4470c95354463ae7bef07e64e7ce90b12f9fb90cabd9d81cf8b1e208517201a"} Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.749110 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-qwsw8" event={"ID":"234493a1-61e6-4b74-a15a-888b6cee3dff","Type":"ContainerStarted","Data":"a93be19d3ffbfe1757b5ff7ed2811daba2abb8a0e4be7107613ee435ea358c07"} Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.769575 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/88c64b50-c653-4d39-a87a-ac9a49eaf06e-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "88c64b50-c653-4d39-a87a-ac9a49eaf06e" (UID: "88c64b50-c653-4d39-a87a-ac9a49eaf06e"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.771964 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-2fe2-account-create-update-b6c5t" event={"ID":"0d9bf89c-b546-4753-8e17-963b6dd4720b","Type":"ContainerDied","Data":"dcf463f84d72b266cd87ac81a67359278b64b82729b246f56e60a17ca38eb9e7"} Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.772056 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-2fe2-account-create-update-b6c5t" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.790884 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.791971 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"bebb35a6-a910-4c16-8fa3-5462afb3341a","Type":"ContainerDied","Data":"2d68510cfff2262472612253f576ff6e7b3b1a656cec754457aaa9d8a5384e3e"} Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.792027 5120 scope.go:117] "RemoveContainer" containerID="6cb705b6a3d152dced9b3cb6c4835a2490bbfadb24078d18afa5685f5ddd1a97" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.794981 5120 reconciler_common.go:299] "Volume detached for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/dae19557-6584-433e-a345-c373d9e8a4ae-vencrypt-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.795001 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fe2105ae-76c1-452b-bee1-074d323c076f-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.795011 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/fe2105ae-76c1-452b-bee1-074d323c076f-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.795020 5120 reconciler_common.go:299] "Volume detached for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/dae19557-6584-433e-a345-c373d9e8a4ae-nova-novncproxy-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.795030 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.795040 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/88c64b50-c653-4d39-a87a-ac9a49eaf06e-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.795050 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/88c64b50-c653-4d39-a87a-ac9a49eaf06e-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.795042 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-2002-account-create-update-sg6jt" event={"ID":"dc6aec24-261d-49c7-8306-704614644eaf","Type":"ContainerStarted","Data":"571f610a4cd5dd6165962c23af04835afecef500516733c96214fb3912e97b82"} Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.805124 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eb50beed-fd12-4d73-95bf-413136771ffe-galera-tls-certs" (OuterVolumeSpecName: "galera-tls-certs") pod "eb50beed-fd12-4d73-95bf-413136771ffe" (UID: "eb50beed-fd12-4d73-95bf-413136771ffe"). InnerVolumeSpecName "galera-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.810927 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eb50beed-fd12-4d73-95bf-413136771ffe-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "eb50beed-fd12-4d73-95bf-413136771ffe" (UID: "eb50beed-fd12-4d73-95bf-413136771ffe"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.812324 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"88c64b50-c653-4d39-a87a-ac9a49eaf06e","Type":"ContainerDied","Data":"0e35b819aef3d4426a75fc7b3411f2f69295ee38a2b78d45c31f69922419379d"} Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.812456 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.823078 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-69787fc498-jx88k" event={"ID":"34da2089-cc88-4d8c-97da-68aadf7f2c03","Type":"ContainerDied","Data":"5795b88f56788bc9abc1b52859eed1f486f2105b257928374815dac4b14c89f1"} Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.823385 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-69787fc498-jx88k" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.837583 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"dae19557-6584-433e-a345-c373d9e8a4ae","Type":"ContainerDied","Data":"6363bdf8ead3321cb7d1b439acc12451f93ddf659b78ce5f68a700f217892a50"} Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.837749 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.844801 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-917a-account-create-update-942tp" event={"ID":"1d95fd75-2d15-48f7-9605-2d1980ebeff2","Type":"ContainerStarted","Data":"33a92981f1c39d0a8f281c95986c42a900c4017761d547153c4b729d9ba09ac1"} Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.868368 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-5h578" event={"ID":"60e80199-56f5-4a0c-b023-da9c28b1051f","Type":"ContainerDied","Data":"8cfb852a86a5fc4f10d3dcf4ce72a3ef22f5d91c9b4cf53f48371db345bc1a07"} Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.868681 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-5h578" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.874077 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-5566b7bdc5-47bld" event={"ID":"cb4b4078-46df-4b50-aa4a-81adbbd15e52","Type":"ContainerDied","Data":"8728ba35424b9a5d8a4b3621d85384f1d6c8ad9d19138f32c2b737c7b57ac97b"} Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.874376 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-5566b7bdc5-47bld" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.928723 5120 reconciler_common.go:299] "Volume detached for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/eb50beed-fd12-4d73-95bf-413136771ffe-galera-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.928746 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eb50beed-fd12-4d73-95bf-413136771ffe-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.929954 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-6d59599fcd-hn254" event={"ID":"fe2105ae-76c1-452b-bee1-074d323c076f","Type":"ContainerDied","Data":"f03edefa4ca37f1f83c6db88731bad032b653e8f80a658ea60d6aa1310e72a45"} Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.932050 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-6d59599fcd-hn254" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.945449 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-7d679bc546-fx2h2" event={"ID":"9c8fe017-e320-4b3e-894e-f4258e8d265f","Type":"ContainerDied","Data":"ec521c6821242d79dac240ea60314d5ce9d0d5566ed3cd6f46648bfed0cd4c6e"} Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.945632 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-7d679bc546-fx2h2" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.958945 5120 generic.go:358] "Generic (PLEG): container finished" podID="eb50beed-fd12-4d73-95bf-413136771ffe" containerID="c29df80bfa19e245cc53b93fec1d5af2a0b82a317df54724fdc00fcaf211edf5" exitCode=0 Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.959030 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"eb50beed-fd12-4d73-95bf-413136771ffe","Type":"ContainerDied","Data":"c29df80bfa19e245cc53b93fec1d5af2a0b82a317df54724fdc00fcaf211edf5"} Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.959053 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"eb50beed-fd12-4d73-95bf-413136771ffe","Type":"ContainerDied","Data":"968484ffe3bd17ff19831a7b31b8f05fc70ab08bba227b25e768591a477eeb06"} Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.959132 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.970264 5120 generic.go:358] "Generic (PLEG): container finished" podID="5470c9e3-c2c2-4294-965d-cd4ff001bd74" containerID="db98eab7a6f5d3b89669ca8e4686fdae14940910f34a7a25a27dbe1450d84302" exitCode=0 Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.970966 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.971105 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"5470c9e3-c2c2-4294-965d-cd4ff001bd74","Type":"ContainerDied","Data":"db98eab7a6f5d3b89669ca8e4686fdae14940910f34a7a25a27dbe1450d84302"} Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.971802 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"5470c9e3-c2c2-4294-965d-cd4ff001bd74","Type":"ContainerDied","Data":"8d8bd9b5a8840e5148c09e8fa040d8a3763f13bfcf2fbdb1bb1800ef94705781"} Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.971230 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-6623-account-create-update-5q5c8" Mar 16 16:12:23 crc kubenswrapper[5120]: I0316 16:12:23.976141 5120 scope.go:117] "RemoveContainer" containerID="259a1c164b3bbbddd52006aa2c23dfa16d68542525700e849cf3e51465cc36d9" Mar 16 16:12:24 crc kubenswrapper[5120]: E0316 16:12:24.146230 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-cell1-scripts: configmap "openstack-cell1-scripts" not found Mar 16 16:12:24 crc kubenswrapper[5120]: E0316 16:12:24.146521 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1d95fd75-2d15-48f7-9605-2d1980ebeff2-operator-scripts podName:1d95fd75-2d15-48f7-9605-2d1980ebeff2 nodeName:}" failed. No retries permitted until 2026-03-16 16:12:28.146506351 +0000 UTC m=+2450.300438008 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/1d95fd75-2d15-48f7-9605-2d1980ebeff2-operator-scripts") pod "nova-cell1-917a-account-create-update-942tp" (UID: "1d95fd75-2d15-48f7-9605-2d1980ebeff2") : configmap "openstack-cell1-scripts" not found Mar 16 16:12:24 crc kubenswrapper[5120]: I0316 16:12:24.169634 5120 scope.go:117] "RemoveContainer" containerID="eb495c2e7830f9730c3d0cdf54a0d0956d58edbd9ce6ca99ce491ce9855f3e3d" Mar 16 16:12:24 crc kubenswrapper[5120]: I0316 16:12:24.170483 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-595564474-m6lrq" Mar 16 16:12:24 crc kubenswrapper[5120]: I0316 16:12:24.196078 5120 scope.go:117] "RemoveContainer" containerID="937834673f5ee947e2dce3e8165bec6e100d62a9a8ac1a43a10f874df812f3f4" Mar 16 16:12:24 crc kubenswrapper[5120]: I0316 16:12:24.202215 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-ecee-account-create-update-vpjvm" Mar 16 16:12:24 crc kubenswrapper[5120]: I0316 16:12:24.237554 5120 scope.go:117] "RemoveContainer" containerID="76d367745a5b0b62a2045aa1d05a31b674319fe60957e9cfd4510f19426260cb" Mar 16 16:12:24 crc kubenswrapper[5120]: I0316 16:12:24.248948 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7t5dc\" (UniqueName: \"kubernetes.io/projected/a0d48ffc-4eac-4602-b2e3-902e4a80c6a3-kube-api-access-7t5dc\") pod \"a0d48ffc-4eac-4602-b2e3-902e4a80c6a3\" (UID: \"a0d48ffc-4eac-4602-b2e3-902e4a80c6a3\") " Mar 16 16:12:24 crc kubenswrapper[5120]: I0316 16:12:24.248997 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/eefef8ba-a54a-4ee8-9c31-757cc07a6ab3-config-data\") pod \"eefef8ba-a54a-4ee8-9c31-757cc07a6ab3\" (UID: \"eefef8ba-a54a-4ee8-9c31-757cc07a6ab3\") " Mar 16 16:12:24 crc kubenswrapper[5120]: I0316 16:12:24.249024 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/eefef8ba-a54a-4ee8-9c31-757cc07a6ab3-internal-tls-certs\") pod \"eefef8ba-a54a-4ee8-9c31-757cc07a6ab3\" (UID: \"eefef8ba-a54a-4ee8-9c31-757cc07a6ab3\") " Mar 16 16:12:24 crc kubenswrapper[5120]: I0316 16:12:24.249228 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eefef8ba-a54a-4ee8-9c31-757cc07a6ab3-combined-ca-bundle\") pod \"eefef8ba-a54a-4ee8-9c31-757cc07a6ab3\" (UID: \"eefef8ba-a54a-4ee8-9c31-757cc07a6ab3\") " Mar 16 16:12:24 crc kubenswrapper[5120]: I0316 16:12:24.249244 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6pkhz\" (UniqueName: \"kubernetes.io/projected/eefef8ba-a54a-4ee8-9c31-757cc07a6ab3-kube-api-access-6pkhz\") pod \"eefef8ba-a54a-4ee8-9c31-757cc07a6ab3\" (UID: \"eefef8ba-a54a-4ee8-9c31-757cc07a6ab3\") " Mar 16 16:12:24 crc kubenswrapper[5120]: I0316 16:12:24.249343 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/eefef8ba-a54a-4ee8-9c31-757cc07a6ab3-scripts\") pod \"eefef8ba-a54a-4ee8-9c31-757cc07a6ab3\" (UID: \"eefef8ba-a54a-4ee8-9c31-757cc07a6ab3\") " Mar 16 16:12:24 crc kubenswrapper[5120]: I0316 16:12:24.249377 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/eefef8ba-a54a-4ee8-9c31-757cc07a6ab3-logs\") pod \"eefef8ba-a54a-4ee8-9c31-757cc07a6ab3\" (UID: \"eefef8ba-a54a-4ee8-9c31-757cc07a6ab3\") " Mar 16 16:12:24 crc kubenswrapper[5120]: I0316 16:12:24.249422 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a0d48ffc-4eac-4602-b2e3-902e4a80c6a3-operator-scripts\") pod \"a0d48ffc-4eac-4602-b2e3-902e4a80c6a3\" (UID: \"a0d48ffc-4eac-4602-b2e3-902e4a80c6a3\") " Mar 16 16:12:24 crc kubenswrapper[5120]: I0316 16:12:24.249466 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/eefef8ba-a54a-4ee8-9c31-757cc07a6ab3-public-tls-certs\") pod \"eefef8ba-a54a-4ee8-9c31-757cc07a6ab3\" (UID: \"eefef8ba-a54a-4ee8-9c31-757cc07a6ab3\") " Mar 16 16:12:24 crc kubenswrapper[5120]: I0316 16:12:24.250157 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eefef8ba-a54a-4ee8-9c31-757cc07a6ab3-logs" (OuterVolumeSpecName: "logs") pod "eefef8ba-a54a-4ee8-9c31-757cc07a6ab3" (UID: "eefef8ba-a54a-4ee8-9c31-757cc07a6ab3"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:12:24 crc kubenswrapper[5120]: I0316 16:12:24.250442 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a0d48ffc-4eac-4602-b2e3-902e4a80c6a3-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "a0d48ffc-4eac-4602-b2e3-902e4a80c6a3" (UID: "a0d48ffc-4eac-4602-b2e3-902e4a80c6a3"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:12:24 crc kubenswrapper[5120]: I0316 16:12:24.254175 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0d48ffc-4eac-4602-b2e3-902e4a80c6a3-kube-api-access-7t5dc" (OuterVolumeSpecName: "kube-api-access-7t5dc") pod "a0d48ffc-4eac-4602-b2e3-902e4a80c6a3" (UID: "a0d48ffc-4eac-4602-b2e3-902e4a80c6a3"). InnerVolumeSpecName "kube-api-access-7t5dc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:12:24 crc kubenswrapper[5120]: I0316 16:12:24.260942 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:12:24 crc kubenswrapper[5120]: I0316 16:12:24.262507 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eefef8ba-a54a-4ee8-9c31-757cc07a6ab3-kube-api-access-6pkhz" (OuterVolumeSpecName: "kube-api-access-6pkhz") pod "eefef8ba-a54a-4ee8-9c31-757cc07a6ab3" (UID: "eefef8ba-a54a-4ee8-9c31-757cc07a6ab3"). InnerVolumeSpecName "kube-api-access-6pkhz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:12:24 crc kubenswrapper[5120]: I0316 16:12:24.268417 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eefef8ba-a54a-4ee8-9c31-757cc07a6ab3-scripts" (OuterVolumeSpecName: "scripts") pod "eefef8ba-a54a-4ee8-9c31-757cc07a6ab3" (UID: "eefef8ba-a54a-4ee8-9c31-757cc07a6ab3"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:24 crc kubenswrapper[5120]: I0316 16:12:24.269829 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:12:24 crc kubenswrapper[5120]: I0316 16:12:24.274989 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-69787fc498-jx88k"] Mar 16 16:12:24 crc kubenswrapper[5120]: I0316 16:12:24.279920 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-api-69787fc498-jx88k"] Mar 16 16:12:24 crc kubenswrapper[5120]: I0316 16:12:24.284800 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-5566b7bdc5-47bld"] Mar 16 16:12:24 crc kubenswrapper[5120]: I0316 16:12:24.290905 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-worker-5566b7bdc5-47bld"] Mar 16 16:12:24 crc kubenswrapper[5120]: I0316 16:12:24.300815 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-5h578"] Mar 16 16:12:24 crc kubenswrapper[5120]: I0316 16:12:24.305956 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-5h578"] Mar 16 16:12:24 crc kubenswrapper[5120]: I0316 16:12:24.328702 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-917a-account-create-update-942tp" Mar 16 16:12:24 crc kubenswrapper[5120]: I0316 16:12:24.328740 5120 scope.go:117] "RemoveContainer" containerID="a45d41b1d9d4e8e8b46bd068b4409058a847b35aec00d30d3d8619af44323cbf" Mar 16 16:12:24 crc kubenswrapper[5120]: I0316 16:12:24.330520 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/neutron-cb8df78d6-4gf8s" podUID="5cf58a8f-dfb4-4a0a-b96c-000333125dd0" containerName="neutron-httpd" probeResult="failure" output="Get \"https://10.217.0.67:9696/\": dial tcp 10.217.0.67:9696: connect: connection refused" Mar 16 16:12:24 crc kubenswrapper[5120]: I0316 16:12:24.335102 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 16:12:24 crc kubenswrapper[5120]: I0316 16:12:24.348339 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 16:12:24 crc kubenswrapper[5120]: I0316 16:12:24.352202 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/1d95fd75-2d15-48f7-9605-2d1980ebeff2-operator-scripts\") pod \"1d95fd75-2d15-48f7-9605-2d1980ebeff2\" (UID: \"1d95fd75-2d15-48f7-9605-2d1980ebeff2\") " Mar 16 16:12:24 crc kubenswrapper[5120]: I0316 16:12:24.352495 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5h7bs\" (UniqueName: \"kubernetes.io/projected/1d95fd75-2d15-48f7-9605-2d1980ebeff2-kube-api-access-5h7bs\") pod \"1d95fd75-2d15-48f7-9605-2d1980ebeff2\" (UID: \"1d95fd75-2d15-48f7-9605-2d1980ebeff2\") " Mar 16 16:12:24 crc kubenswrapper[5120]: I0316 16:12:24.354330 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1d95fd75-2d15-48f7-9605-2d1980ebeff2-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "1d95fd75-2d15-48f7-9605-2d1980ebeff2" (UID: "1d95fd75-2d15-48f7-9605-2d1980ebeff2"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:12:24 crc kubenswrapper[5120]: I0316 16:12:24.354734 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6pkhz\" (UniqueName: \"kubernetes.io/projected/eefef8ba-a54a-4ee8-9c31-757cc07a6ab3-kube-api-access-6pkhz\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:24 crc kubenswrapper[5120]: I0316 16:12:24.354866 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/eefef8ba-a54a-4ee8-9c31-757cc07a6ab3-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:24 crc kubenswrapper[5120]: I0316 16:12:24.354930 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/eefef8ba-a54a-4ee8-9c31-757cc07a6ab3-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:24 crc kubenswrapper[5120]: I0316 16:12:24.354989 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a0d48ffc-4eac-4602-b2e3-902e4a80c6a3-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:24 crc kubenswrapper[5120]: I0316 16:12:24.355054 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/1d95fd75-2d15-48f7-9605-2d1980ebeff2-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:24 crc kubenswrapper[5120]: I0316 16:12:24.355113 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7t5dc\" (UniqueName: \"kubernetes.io/projected/a0d48ffc-4eac-4602-b2e3-902e4a80c6a3-kube-api-access-7t5dc\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:24 crc kubenswrapper[5120]: I0316 16:12:24.356506 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-proxy-7d679bc546-fx2h2"] Mar 16 16:12:24 crc kubenswrapper[5120]: I0316 16:12:24.357090 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eefef8ba-a54a-4ee8-9c31-757cc07a6ab3-config-data" (OuterVolumeSpecName: "config-data") pod "eefef8ba-a54a-4ee8-9c31-757cc07a6ab3" (UID: "eefef8ba-a54a-4ee8-9c31-757cc07a6ab3"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:24 crc kubenswrapper[5120]: I0316 16:12:24.361342 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/swift-proxy-7d679bc546-fx2h2"] Mar 16 16:12:24 crc kubenswrapper[5120]: I0316 16:12:24.365681 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d95fd75-2d15-48f7-9605-2d1980ebeff2-kube-api-access-5h7bs" (OuterVolumeSpecName: "kube-api-access-5h7bs") pod "1d95fd75-2d15-48f7-9605-2d1980ebeff2" (UID: "1d95fd75-2d15-48f7-9605-2d1980ebeff2"). InnerVolumeSpecName "kube-api-access-5h7bs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:12:24 crc kubenswrapper[5120]: I0316 16:12:24.367236 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 16:12:24 crc kubenswrapper[5120]: I0316 16:12:24.372325 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 16:12:24 crc kubenswrapper[5120]: I0316 16:12:24.373602 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eefef8ba-a54a-4ee8-9c31-757cc07a6ab3-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "eefef8ba-a54a-4ee8-9c31-757cc07a6ab3" (UID: "eefef8ba-a54a-4ee8-9c31-757cc07a6ab3"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:24 crc kubenswrapper[5120]: I0316 16:12:24.380803 5120 scope.go:117] "RemoveContainer" containerID="9acf328d9dac47c6472154637a380c8aee452334380f2fbe63f5b4b0bbfe0475" Mar 16 16:12:24 crc kubenswrapper[5120]: I0316 16:12:24.381426 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-6623-account-create-update-5q5c8"] Mar 16 16:12:24 crc kubenswrapper[5120]: I0316 16:12:24.388188 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-6623-account-create-update-5q5c8"] Mar 16 16:12:24 crc kubenswrapper[5120]: I0316 16:12:24.417799 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 16:12:24 crc kubenswrapper[5120]: I0316 16:12:24.421000 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-2002-account-create-update-sg6jt" Mar 16 16:12:24 crc kubenswrapper[5120]: I0316 16:12:24.423491 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 16:12:24 crc kubenswrapper[5120]: I0316 16:12:24.431265 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-4e5e-account-create-update-ft8f9" Mar 16 16:12:24 crc kubenswrapper[5120]: I0316 16:12:24.438636 5120 scope.go:117] "RemoveContainer" containerID="c6264f1560432f3ea47f3e712f72dc705f1d96eeaa1e8dbf34ce818578d90dc4" Mar 16 16:12:24 crc kubenswrapper[5120]: I0316 16:12:24.450844 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-proxy-6d59599fcd-hn254"] Mar 16 16:12:24 crc kubenswrapper[5120]: I0316 16:12:24.456017 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/972b610c-1005-4b7a-be77-72b7d63cab89-operator-scripts\") pod \"972b610c-1005-4b7a-be77-72b7d63cab89\" (UID: \"972b610c-1005-4b7a-be77-72b7d63cab89\") " Mar 16 16:12:24 crc kubenswrapper[5120]: I0316 16:12:24.456131 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dvh2v\" (UniqueName: \"kubernetes.io/projected/dc6aec24-261d-49c7-8306-704614644eaf-kube-api-access-dvh2v\") pod \"dc6aec24-261d-49c7-8306-704614644eaf\" (UID: \"dc6aec24-261d-49c7-8306-704614644eaf\") " Mar 16 16:12:24 crc kubenswrapper[5120]: I0316 16:12:24.456178 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t8sk9\" (UniqueName: \"kubernetes.io/projected/972b610c-1005-4b7a-be77-72b7d63cab89-kube-api-access-t8sk9\") pod \"972b610c-1005-4b7a-be77-72b7d63cab89\" (UID: \"972b610c-1005-4b7a-be77-72b7d63cab89\") " Mar 16 16:12:24 crc kubenswrapper[5120]: I0316 16:12:24.456435 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/dc6aec24-261d-49c7-8306-704614644eaf-operator-scripts\") pod \"dc6aec24-261d-49c7-8306-704614644eaf\" (UID: \"dc6aec24-261d-49c7-8306-704614644eaf\") " Mar 16 16:12:24 crc kubenswrapper[5120]: I0316 16:12:24.457255 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/eefef8ba-a54a-4ee8-9c31-757cc07a6ab3-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:24 crc kubenswrapper[5120]: I0316 16:12:24.457276 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9bd8k\" (UniqueName: \"kubernetes.io/projected/dca01bf3-3d87-4d0e-9cf7-481863c6144d-kube-api-access-9bd8k\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:24 crc kubenswrapper[5120]: I0316 16:12:24.457292 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5h7bs\" (UniqueName: \"kubernetes.io/projected/1d95fd75-2d15-48f7-9605-2d1980ebeff2-kube-api-access-5h7bs\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:24 crc kubenswrapper[5120]: I0316 16:12:24.457301 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/dca01bf3-3d87-4d0e-9cf7-481863c6144d-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:24 crc kubenswrapper[5120]: I0316 16:12:24.457309 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eefef8ba-a54a-4ee8-9c31-757cc07a6ab3-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:24 crc kubenswrapper[5120]: I0316 16:12:24.457786 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc6aec24-261d-49c7-8306-704614644eaf-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "dc6aec24-261d-49c7-8306-704614644eaf" (UID: "dc6aec24-261d-49c7-8306-704614644eaf"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:12:24 crc kubenswrapper[5120]: I0316 16:12:24.457943 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/972b610c-1005-4b7a-be77-72b7d63cab89-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "972b610c-1005-4b7a-be77-72b7d63cab89" (UID: "972b610c-1005-4b7a-be77-72b7d63cab89"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:12:24 crc kubenswrapper[5120]: I0316 16:12:24.462058 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/972b610c-1005-4b7a-be77-72b7d63cab89-kube-api-access-t8sk9" (OuterVolumeSpecName: "kube-api-access-t8sk9") pod "972b610c-1005-4b7a-be77-72b7d63cab89" (UID: "972b610c-1005-4b7a-be77-72b7d63cab89"). InnerVolumeSpecName "kube-api-access-t8sk9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:12:24 crc kubenswrapper[5120]: I0316 16:12:24.470622 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/swift-proxy-6d59599fcd-hn254"] Mar 16 16:12:24 crc kubenswrapper[5120]: I0316 16:12:24.475062 5120 scope.go:117] "RemoveContainer" containerID="59d38b77c648623aa3b83892cf22dde220f840ba2589672899727a34b307c0ba" Mar 16 16:12:24 crc kubenswrapper[5120]: I0316 16:12:24.479613 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc6aec24-261d-49c7-8306-704614644eaf-kube-api-access-dvh2v" (OuterVolumeSpecName: "kube-api-access-dvh2v") pod "dc6aec24-261d-49c7-8306-704614644eaf" (UID: "dc6aec24-261d-49c7-8306-704614644eaf"). InnerVolumeSpecName "kube-api-access-dvh2v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:12:24 crc kubenswrapper[5120]: I0316 16:12:24.488173 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-2fe2-account-create-update-b6c5t"] Mar 16 16:12:24 crc kubenswrapper[5120]: I0316 16:12:24.500334 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eefef8ba-a54a-4ee8-9c31-757cc07a6ab3-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "eefef8ba-a54a-4ee8-9c31-757cc07a6ab3" (UID: "eefef8ba-a54a-4ee8-9c31-757cc07a6ab3"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:24 crc kubenswrapper[5120]: I0316 16:12:24.501418 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-2fe2-account-create-update-b6c5t"] Mar 16 16:12:24 crc kubenswrapper[5120]: I0316 16:12:24.529342 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eefef8ba-a54a-4ee8-9c31-757cc07a6ab3-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "eefef8ba-a54a-4ee8-9c31-757cc07a6ab3" (UID: "eefef8ba-a54a-4ee8-9c31-757cc07a6ab3"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:24 crc kubenswrapper[5120]: I0316 16:12:24.530882 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:12:24 crc kubenswrapper[5120]: I0316 16:12:24.543443 5120 scope.go:117] "RemoveContainer" containerID="33458ed69c10a0a03c3eb77b97ded5f81bf1b3bcb75d28603bc14dde98be5d90" Mar 16 16:12:24 crc kubenswrapper[5120]: I0316 16:12:24.547353 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:12:24 crc kubenswrapper[5120]: I0316 16:12:24.559733 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/eefef8ba-a54a-4ee8-9c31-757cc07a6ab3-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:24 crc kubenswrapper[5120]: I0316 16:12:24.559788 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/972b610c-1005-4b7a-be77-72b7d63cab89-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:24 crc kubenswrapper[5120]: I0316 16:12:24.559801 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dvh2v\" (UniqueName: \"kubernetes.io/projected/dc6aec24-261d-49c7-8306-704614644eaf-kube-api-access-dvh2v\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:24 crc kubenswrapper[5120]: I0316 16:12:24.559815 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t8sk9\" (UniqueName: \"kubernetes.io/projected/972b610c-1005-4b7a-be77-72b7d63cab89-kube-api-access-t8sk9\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:24 crc kubenswrapper[5120]: I0316 16:12:24.559826 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/eefef8ba-a54a-4ee8-9c31-757cc07a6ab3-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:24 crc kubenswrapper[5120]: I0316 16:12:24.559837 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/dc6aec24-261d-49c7-8306-704614644eaf-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:24 crc kubenswrapper[5120]: I0316 16:12:24.563224 5120 scope.go:117] "RemoveContainer" containerID="ad75fdb465731a2e6536f1029248278779f84cd84ec9a9c1660f3efb1189e033" Mar 16 16:12:24 crc kubenswrapper[5120]: I0316 16:12:24.567983 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-f9bc678f8-6p72p" podUID="241ac7ce-90fa-4222-a274-ee00c4ba33a3" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.0.55:9311/healthcheck\": read tcp 10.217.0.2:56056->10.217.0.55:9311: read: connection reset by peer" Mar 16 16:12:24 crc kubenswrapper[5120]: E0316 16:12:24.633500 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="db11af3fe6b07413600ae44f79a3df378f43385bd524e92444794183d150e508" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:12:24 crc kubenswrapper[5120]: E0316 16:12:24.635259 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="db11af3fe6b07413600ae44f79a3df378f43385bd524e92444794183d150e508" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:12:24 crc kubenswrapper[5120]: E0316 16:12:24.637375 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="db11af3fe6b07413600ae44f79a3df378f43385bd524e92444794183d150e508" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:12:24 crc kubenswrapper[5120]: E0316 16:12:24.637500 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="bce71378-f7b0-4b73-8b4a-711353734319" containerName="nova-cell1-conductor-conductor" probeResult="unknown" Mar 16 16:12:24 crc kubenswrapper[5120]: I0316 16:12:24.712995 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0bbb1bbc-8c14-4046-bd63-cce793589d4d" path="/var/lib/kubelet/pods/0bbb1bbc-8c14-4046-bd63-cce793589d4d/volumes" Mar 16 16:12:24 crc kubenswrapper[5120]: I0316 16:12:24.713707 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d9bf89c-b546-4753-8e17-963b6dd4720b" path="/var/lib/kubelet/pods/0d9bf89c-b546-4753-8e17-963b6dd4720b/volumes" Mar 16 16:12:24 crc kubenswrapper[5120]: I0316 16:12:24.722732 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="30d44474-74de-4982-8e48-31038a50607f" path="/var/lib/kubelet/pods/30d44474-74de-4982-8e48-31038a50607f/volumes" Mar 16 16:12:24 crc kubenswrapper[5120]: I0316 16:12:24.723508 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="34da2089-cc88-4d8c-97da-68aadf7f2c03" path="/var/lib/kubelet/pods/34da2089-cc88-4d8c-97da-68aadf7f2c03/volumes" Mar 16 16:12:24 crc kubenswrapper[5120]: I0316 16:12:24.731922 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5470c9e3-c2c2-4294-965d-cd4ff001bd74" path="/var/lib/kubelet/pods/5470c9e3-c2c2-4294-965d-cd4ff001bd74/volumes" Mar 16 16:12:24 crc kubenswrapper[5120]: I0316 16:12:24.732715 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="60e80199-56f5-4a0c-b023-da9c28b1051f" path="/var/lib/kubelet/pods/60e80199-56f5-4a0c-b023-da9c28b1051f/volumes" Mar 16 16:12:24 crc kubenswrapper[5120]: I0316 16:12:24.733285 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="88c64b50-c653-4d39-a87a-ac9a49eaf06e" path="/var/lib/kubelet/pods/88c64b50-c653-4d39-a87a-ac9a49eaf06e/volumes" Mar 16 16:12:24 crc kubenswrapper[5120]: I0316 16:12:24.734880 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c8fe017-e320-4b3e-894e-f4258e8d265f" path="/var/lib/kubelet/pods/9c8fe017-e320-4b3e-894e-f4258e8d265f/volumes" Mar 16 16:12:24 crc kubenswrapper[5120]: I0316 16:12:24.735482 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a8389bad-6789-42fe-8506-5ac83ff9514f" path="/var/lib/kubelet/pods/a8389bad-6789-42fe-8506-5ac83ff9514f/volumes" Mar 16 16:12:24 crc kubenswrapper[5120]: I0316 16:12:24.736398 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bebb35a6-a910-4c16-8fa3-5462afb3341a" path="/var/lib/kubelet/pods/bebb35a6-a910-4c16-8fa3-5462afb3341a/volumes" Mar 16 16:12:24 crc kubenswrapper[5120]: I0316 16:12:24.737488 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb4b4078-46df-4b50-aa4a-81adbbd15e52" path="/var/lib/kubelet/pods/cb4b4078-46df-4b50-aa4a-81adbbd15e52/volumes" Mar 16 16:12:24 crc kubenswrapper[5120]: I0316 16:12:24.738252 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dae19557-6584-433e-a345-c373d9e8a4ae" path="/var/lib/kubelet/pods/dae19557-6584-433e-a345-c373d9e8a4ae/volumes" Mar 16 16:12:24 crc kubenswrapper[5120]: I0316 16:12:24.738614 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dca01bf3-3d87-4d0e-9cf7-481863c6144d" path="/var/lib/kubelet/pods/dca01bf3-3d87-4d0e-9cf7-481863c6144d/volumes" Mar 16 16:12:24 crc kubenswrapper[5120]: I0316 16:12:24.739004 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eb50beed-fd12-4d73-95bf-413136771ffe" path="/var/lib/kubelet/pods/eb50beed-fd12-4d73-95bf-413136771ffe/volumes" Mar 16 16:12:24 crc kubenswrapper[5120]: I0316 16:12:24.740147 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe2105ae-76c1-452b-bee1-074d323c076f" path="/var/lib/kubelet/pods/fe2105ae-76c1-452b-bee1-074d323c076f/volumes" Mar 16 16:12:24 crc kubenswrapper[5120]: I0316 16:12:24.810566 5120 scope.go:117] "RemoveContainer" containerID="3db74fc31cc9f68950b009f39db6e01dd25ecf398c5a0a5c2f3f7b6f2dff8aa1" Mar 16 16:12:24 crc kubenswrapper[5120]: I0316 16:12:24.902479 5120 scope.go:117] "RemoveContainer" containerID="aecc9216eb6521d29e54b5a9aff4540ad9357da77ec5dc2ccefbc0aa24d52e41" Mar 16 16:12:24 crc kubenswrapper[5120]: I0316 16:12:24.903562 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:12:24 crc kubenswrapper[5120]: I0316 16:12:24.936250 5120 scope.go:117] "RemoveContainer" containerID="c29df80bfa19e245cc53b93fec1d5af2a0b82a317df54724fdc00fcaf211edf5" Mar 16 16:12:24 crc kubenswrapper[5120]: I0316 16:12:24.992311 5120 scope.go:117] "RemoveContainer" containerID="2f5d8ac15fe5ec385cbfccabc9556cca7be517f04a77ef070196a2ea5889aa9e" Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.000774 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/5c399606-817d-4a0f-b825-32da28e0491d-kolla-config\") pod \"5c399606-817d-4a0f-b825-32da28e0491d\" (UID: \"5c399606-817d-4a0f-b825-32da28e0491d\") " Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.002147 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/5c399606-817d-4a0f-b825-32da28e0491d-config-data-generated\") pod \"5c399606-817d-4a0f-b825-32da28e0491d\" (UID: \"5c399606-817d-4a0f-b825-32da28e0491d\") " Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.002188 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-969xw\" (UniqueName: \"kubernetes.io/projected/5c399606-817d-4a0f-b825-32da28e0491d-kube-api-access-969xw\") pod \"5c399606-817d-4a0f-b825-32da28e0491d\" (UID: \"5c399606-817d-4a0f-b825-32da28e0491d\") " Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.002236 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5c399606-817d-4a0f-b825-32da28e0491d-operator-scripts\") pod \"5c399606-817d-4a0f-b825-32da28e0491d\" (UID: \"5c399606-817d-4a0f-b825-32da28e0491d\") " Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.002269 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"mysql-db\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") pod \"5c399606-817d-4a0f-b825-32da28e0491d\" (UID: \"5c399606-817d-4a0f-b825-32da28e0491d\") " Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.002345 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/5c399606-817d-4a0f-b825-32da28e0491d-config-data-default\") pod \"5c399606-817d-4a0f-b825-32da28e0491d\" (UID: \"5c399606-817d-4a0f-b825-32da28e0491d\") " Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.002343 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c399606-817d-4a0f-b825-32da28e0491d-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "5c399606-817d-4a0f-b825-32da28e0491d" (UID: "5c399606-817d-4a0f-b825-32da28e0491d"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.002377 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/5c399606-817d-4a0f-b825-32da28e0491d-galera-tls-certs\") pod \"5c399606-817d-4a0f-b825-32da28e0491d\" (UID: \"5c399606-817d-4a0f-b825-32da28e0491d\") " Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.002448 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5c399606-817d-4a0f-b825-32da28e0491d-combined-ca-bundle\") pod \"5c399606-817d-4a0f-b825-32da28e0491d\" (UID: \"5c399606-817d-4a0f-b825-32da28e0491d\") " Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.003246 5120 reconciler_common.go:299] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/5c399606-817d-4a0f-b825-32da28e0491d-kolla-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.003517 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c399606-817d-4a0f-b825-32da28e0491d-config-data-generated" (OuterVolumeSpecName: "config-data-generated") pod "5c399606-817d-4a0f-b825-32da28e0491d" (UID: "5c399606-817d-4a0f-b825-32da28e0491d"). InnerVolumeSpecName "config-data-generated". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.004217 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c399606-817d-4a0f-b825-32da28e0491d-config-data-default" (OuterVolumeSpecName: "config-data-default") pod "5c399606-817d-4a0f-b825-32da28e0491d" (UID: "5c399606-817d-4a0f-b825-32da28e0491d"). InnerVolumeSpecName "config-data-default". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.004620 5120 generic.go:358] "Generic (PLEG): container finished" podID="5c399606-817d-4a0f-b825-32da28e0491d" containerID="3b654e2f92586de226638d5cb91d375853baa73355cb33331d422696f899d8b5" exitCode=0 Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.004697 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"5c399606-817d-4a0f-b825-32da28e0491d","Type":"ContainerDied","Data":"3b654e2f92586de226638d5cb91d375853baa73355cb33331d422696f899d8b5"} Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.004728 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"5c399606-817d-4a0f-b825-32da28e0491d","Type":"ContainerDied","Data":"01aab22ccca0bad0308acb318e107af8543b55c48bebaa3b6634b1ff4ce67831"} Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.004833 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.005521 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c399606-817d-4a0f-b825-32da28e0491d-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "5c399606-817d-4a0f-b825-32da28e0491d" (UID: "5c399606-817d-4a0f-b825-32da28e0491d"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.009349 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c399606-817d-4a0f-b825-32da28e0491d-kube-api-access-969xw" (OuterVolumeSpecName: "kube-api-access-969xw") pod "5c399606-817d-4a0f-b825-32da28e0491d" (UID: "5c399606-817d-4a0f-b825-32da28e0491d"). InnerVolumeSpecName "kube-api-access-969xw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.009347 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-917a-account-create-update-942tp" event={"ID":"1d95fd75-2d15-48f7-9605-2d1980ebeff2","Type":"ContainerDied","Data":"33a92981f1c39d0a8f281c95986c42a900c4017761d547153c4b729d9ba09ac1"} Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.010006 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-917a-account-create-update-942tp" Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.013220 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-4e5e-account-create-update-ft8f9" event={"ID":"972b610c-1005-4b7a-be77-72b7d63cab89","Type":"ContainerDied","Data":"d6958fa1eb24f86d268e2f88cebb71ac91887f0429d467c7d785925b0d5a0dbd"} Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.013254 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-4e5e-account-create-update-ft8f9" Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.014901 5120 generic.go:358] "Generic (PLEG): container finished" podID="17b2138c-b3ca-4538-a7d7-0dc6756650bf" containerID="46862529c1989fabbd8a3c6c982324fb04976c3d04492a4676f4f8667ef55b0b" exitCode=0 Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.014964 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"17b2138c-b3ca-4538-a7d7-0dc6756650bf","Type":"ContainerDied","Data":"46862529c1989fabbd8a3c6c982324fb04976c3d04492a4676f4f8667ef55b0b"} Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.025404 5120 generic.go:358] "Generic (PLEG): container finished" podID="241ac7ce-90fa-4222-a274-ee00c4ba33a3" containerID="12dc36279bce82525ae4b3823badcb4f88e30f5db4b097ec7671d740068dbe6c" exitCode=0 Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.025560 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-f9bc678f8-6p72p" event={"ID":"241ac7ce-90fa-4222-a274-ee00c4ba33a3","Type":"ContainerDied","Data":"12dc36279bce82525ae4b3823badcb4f88e30f5db4b097ec7671d740068dbe6c"} Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.026211 5120 scope.go:117] "RemoveContainer" containerID="c29df80bfa19e245cc53b93fec1d5af2a0b82a317df54724fdc00fcaf211edf5" Mar 16 16:12:25 crc kubenswrapper[5120]: E0316 16:12:25.026663 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c29df80bfa19e245cc53b93fec1d5af2a0b82a317df54724fdc00fcaf211edf5\": container with ID starting with c29df80bfa19e245cc53b93fec1d5af2a0b82a317df54724fdc00fcaf211edf5 not found: ID does not exist" containerID="c29df80bfa19e245cc53b93fec1d5af2a0b82a317df54724fdc00fcaf211edf5" Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.026726 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c29df80bfa19e245cc53b93fec1d5af2a0b82a317df54724fdc00fcaf211edf5"} err="failed to get container status \"c29df80bfa19e245cc53b93fec1d5af2a0b82a317df54724fdc00fcaf211edf5\": rpc error: code = NotFound desc = could not find container \"c29df80bfa19e245cc53b93fec1d5af2a0b82a317df54724fdc00fcaf211edf5\": container with ID starting with c29df80bfa19e245cc53b93fec1d5af2a0b82a317df54724fdc00fcaf211edf5 not found: ID does not exist" Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.026848 5120 scope.go:117] "RemoveContainer" containerID="2f5d8ac15fe5ec385cbfccabc9556cca7be517f04a77ef070196a2ea5889aa9e" Mar 16 16:12:25 crc kubenswrapper[5120]: E0316 16:12:25.027150 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2f5d8ac15fe5ec385cbfccabc9556cca7be517f04a77ef070196a2ea5889aa9e\": container with ID starting with 2f5d8ac15fe5ec385cbfccabc9556cca7be517f04a77ef070196a2ea5889aa9e not found: ID does not exist" containerID="2f5d8ac15fe5ec385cbfccabc9556cca7be517f04a77ef070196a2ea5889aa9e" Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.027176 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f5d8ac15fe5ec385cbfccabc9556cca7be517f04a77ef070196a2ea5889aa9e"} err="failed to get container status \"2f5d8ac15fe5ec385cbfccabc9556cca7be517f04a77ef070196a2ea5889aa9e\": rpc error: code = NotFound desc = could not find container \"2f5d8ac15fe5ec385cbfccabc9556cca7be517f04a77ef070196a2ea5889aa9e\": container with ID starting with 2f5d8ac15fe5ec385cbfccabc9556cca7be517f04a77ef070196a2ea5889aa9e not found: ID does not exist" Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.027190 5120 scope.go:117] "RemoveContainer" containerID="db98eab7a6f5d3b89669ca8e4686fdae14940910f34a7a25a27dbe1450d84302" Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.030387 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage18-crc" (OuterVolumeSpecName: "mysql-db") pod "5c399606-817d-4a0f-b825-32da28e0491d" (UID: "5c399606-817d-4a0f-b825-32da28e0491d"). InnerVolumeSpecName "local-storage18-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.031337 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-ecee-account-create-update-vpjvm" event={"ID":"a0d48ffc-4eac-4602-b2e3-902e4a80c6a3","Type":"ContainerDied","Data":"348aaa4ab299bb2d488847552015a28ead8c8ba3eb345812e801edf04b78c1be"} Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.031392 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-ecee-account-create-update-vpjvm" Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.036573 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-595564474-m6lrq" event={"ID":"eefef8ba-a54a-4ee8-9c31-757cc07a6ab3","Type":"ContainerDied","Data":"493ee67b98558fff522cdd98d9cd0a189f9ed8fa6647564ce5b5396df370c4af"} Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.036722 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-595564474-m6lrq" Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.046215 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c399606-817d-4a0f-b825-32da28e0491d-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "5c399606-817d-4a0f-b825-32da28e0491d" (UID: "5c399606-817d-4a0f-b825-32da28e0491d"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.054179 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-qwsw8" event={"ID":"234493a1-61e6-4b74-a15a-888b6cee3dff","Type":"ContainerStarted","Data":"773ccd13c8bb6668c7bed483102ccc70d496ef36860e67bae38546e80dae3bc5"} Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.054315 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-qwsw8" Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.059379 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-2002-account-create-update-sg6jt" Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.059406 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-2002-account-create-update-sg6jt" event={"ID":"dc6aec24-261d-49c7-8306-704614644eaf","Type":"ContainerDied","Data":"571f610a4cd5dd6165962c23af04835afecef500516733c96214fb3912e97b82"} Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.071185 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c399606-817d-4a0f-b825-32da28e0491d-galera-tls-certs" (OuterVolumeSpecName: "galera-tls-certs") pod "5c399606-817d-4a0f-b825-32da28e0491d" (UID: "5c399606-817d-4a0f-b825-32da28e0491d"). InnerVolumeSpecName "galera-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.079414 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-qwsw8" podStartSLOduration=6.079394954 podStartE2EDuration="6.079394954s" podCreationTimestamp="2026-03-16 16:12:19 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:12:25.070471631 +0000 UTC m=+2447.224403288" watchObservedRunningTime="2026-03-16 16:12:25.079394954 +0000 UTC m=+2447.233326611" Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.101391 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.104653 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/5c399606-817d-4a0f-b825-32da28e0491d-config-data-generated\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.104681 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-969xw\" (UniqueName: \"kubernetes.io/projected/5c399606-817d-4a0f-b825-32da28e0491d-kube-api-access-969xw\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.104690 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5c399606-817d-4a0f-b825-32da28e0491d-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.104714 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage18-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") on node \"crc\" " Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.104803 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/5c399606-817d-4a0f-b825-32da28e0491d-config-data-default\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.104814 5120 reconciler_common.go:299] "Volume detached for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/5c399606-817d-4a0f-b825-32da28e0491d-galera-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.104823 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5c399606-817d-4a0f-b825-32da28e0491d-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.114243 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-f9bc678f8-6p72p" Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.125822 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage18-crc" (UniqueName: "kubernetes.io/local-volume/local-storage18-crc") on node "crc" Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.127024 5120 scope.go:117] "RemoveContainer" containerID="db98eab7a6f5d3b89669ca8e4686fdae14940910f34a7a25a27dbe1450d84302" Mar 16 16:12:25 crc kubenswrapper[5120]: E0316 16:12:25.127718 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db98eab7a6f5d3b89669ca8e4686fdae14940910f34a7a25a27dbe1450d84302\": container with ID starting with db98eab7a6f5d3b89669ca8e4686fdae14940910f34a7a25a27dbe1450d84302 not found: ID does not exist" containerID="db98eab7a6f5d3b89669ca8e4686fdae14940910f34a7a25a27dbe1450d84302" Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.127748 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db98eab7a6f5d3b89669ca8e4686fdae14940910f34a7a25a27dbe1450d84302"} err="failed to get container status \"db98eab7a6f5d3b89669ca8e4686fdae14940910f34a7a25a27dbe1450d84302\": rpc error: code = NotFound desc = could not find container \"db98eab7a6f5d3b89669ca8e4686fdae14940910f34a7a25a27dbe1450d84302\": container with ID starting with db98eab7a6f5d3b89669ca8e4686fdae14940910f34a7a25a27dbe1450d84302 not found: ID does not exist" Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.127782 5120 scope.go:117] "RemoveContainer" containerID="3b654e2f92586de226638d5cb91d375853baa73355cb33331d422696f899d8b5" Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.172202 5120 scope.go:117] "RemoveContainer" containerID="cc5cd79d70b57118af25946cd4885eb3eb4823950f2fdde38bb1f744bfd87e5c" Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.194046 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-ecee-account-create-update-vpjvm"] Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.201937 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-ecee-account-create-update-vpjvm"] Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.206559 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/17b2138c-b3ca-4538-a7d7-0dc6756650bf-config-data\") pod \"17b2138c-b3ca-4538-a7d7-0dc6756650bf\" (UID: \"17b2138c-b3ca-4538-a7d7-0dc6756650bf\") " Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.206611 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/17b2138c-b3ca-4538-a7d7-0dc6756650bf-logs\") pod \"17b2138c-b3ca-4538-a7d7-0dc6756650bf\" (UID: \"17b2138c-b3ca-4538-a7d7-0dc6756650bf\") " Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.206667 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/241ac7ce-90fa-4222-a274-ee00c4ba33a3-combined-ca-bundle\") pod \"241ac7ce-90fa-4222-a274-ee00c4ba33a3\" (UID: \"241ac7ce-90fa-4222-a274-ee00c4ba33a3\") " Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.206709 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q29hj\" (UniqueName: \"kubernetes.io/projected/241ac7ce-90fa-4222-a274-ee00c4ba33a3-kube-api-access-q29hj\") pod \"241ac7ce-90fa-4222-a274-ee00c4ba33a3\" (UID: \"241ac7ce-90fa-4222-a274-ee00c4ba33a3\") " Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.206734 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r67sp\" (UniqueName: \"kubernetes.io/projected/17b2138c-b3ca-4538-a7d7-0dc6756650bf-kube-api-access-r67sp\") pod \"17b2138c-b3ca-4538-a7d7-0dc6756650bf\" (UID: \"17b2138c-b3ca-4538-a7d7-0dc6756650bf\") " Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.206817 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/241ac7ce-90fa-4222-a274-ee00c4ba33a3-config-data-custom\") pod \"241ac7ce-90fa-4222-a274-ee00c4ba33a3\" (UID: \"241ac7ce-90fa-4222-a274-ee00c4ba33a3\") " Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.206834 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/17b2138c-b3ca-4538-a7d7-0dc6756650bf-combined-ca-bundle\") pod \"17b2138c-b3ca-4538-a7d7-0dc6756650bf\" (UID: \"17b2138c-b3ca-4538-a7d7-0dc6756650bf\") " Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.206854 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/17b2138c-b3ca-4538-a7d7-0dc6756650bf-nova-metadata-tls-certs\") pod \"17b2138c-b3ca-4538-a7d7-0dc6756650bf\" (UID: \"17b2138c-b3ca-4538-a7d7-0dc6756650bf\") " Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.206964 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/241ac7ce-90fa-4222-a274-ee00c4ba33a3-public-tls-certs\") pod \"241ac7ce-90fa-4222-a274-ee00c4ba33a3\" (UID: \"241ac7ce-90fa-4222-a274-ee00c4ba33a3\") " Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.207001 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/241ac7ce-90fa-4222-a274-ee00c4ba33a3-logs\") pod \"241ac7ce-90fa-4222-a274-ee00c4ba33a3\" (UID: \"241ac7ce-90fa-4222-a274-ee00c4ba33a3\") " Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.207028 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/241ac7ce-90fa-4222-a274-ee00c4ba33a3-config-data\") pod \"241ac7ce-90fa-4222-a274-ee00c4ba33a3\" (UID: \"241ac7ce-90fa-4222-a274-ee00c4ba33a3\") " Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.207152 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/241ac7ce-90fa-4222-a274-ee00c4ba33a3-internal-tls-certs\") pod \"241ac7ce-90fa-4222-a274-ee00c4ba33a3\" (UID: \"241ac7ce-90fa-4222-a274-ee00c4ba33a3\") " Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.207648 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage18-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.207882 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17b2138c-b3ca-4538-a7d7-0dc6756650bf-logs" (OuterVolumeSpecName: "logs") pod "17b2138c-b3ca-4538-a7d7-0dc6756650bf" (UID: "17b2138c-b3ca-4538-a7d7-0dc6756650bf"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.218163 5120 scope.go:117] "RemoveContainer" containerID="3b654e2f92586de226638d5cb91d375853baa73355cb33331d422696f899d8b5" Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.218785 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/241ac7ce-90fa-4222-a274-ee00c4ba33a3-logs" (OuterVolumeSpecName: "logs") pod "241ac7ce-90fa-4222-a274-ee00c4ba33a3" (UID: "241ac7ce-90fa-4222-a274-ee00c4ba33a3"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:12:25 crc kubenswrapper[5120]: E0316 16:12:25.226771 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b654e2f92586de226638d5cb91d375853baa73355cb33331d422696f899d8b5\": container with ID starting with 3b654e2f92586de226638d5cb91d375853baa73355cb33331d422696f899d8b5 not found: ID does not exist" containerID="3b654e2f92586de226638d5cb91d375853baa73355cb33331d422696f899d8b5" Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.226830 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b654e2f92586de226638d5cb91d375853baa73355cb33331d422696f899d8b5"} err="failed to get container status \"3b654e2f92586de226638d5cb91d375853baa73355cb33331d422696f899d8b5\": rpc error: code = NotFound desc = could not find container \"3b654e2f92586de226638d5cb91d375853baa73355cb33331d422696f899d8b5\": container with ID starting with 3b654e2f92586de226638d5cb91d375853baa73355cb33331d422696f899d8b5 not found: ID does not exist" Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.226855 5120 scope.go:117] "RemoveContainer" containerID="cc5cd79d70b57118af25946cd4885eb3eb4823950f2fdde38bb1f744bfd87e5c" Mar 16 16:12:25 crc kubenswrapper[5120]: E0316 16:12:25.228634 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc5cd79d70b57118af25946cd4885eb3eb4823950f2fdde38bb1f744bfd87e5c\": container with ID starting with cc5cd79d70b57118af25946cd4885eb3eb4823950f2fdde38bb1f744bfd87e5c not found: ID does not exist" containerID="cc5cd79d70b57118af25946cd4885eb3eb4823950f2fdde38bb1f744bfd87e5c" Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.228680 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc5cd79d70b57118af25946cd4885eb3eb4823950f2fdde38bb1f744bfd87e5c"} err="failed to get container status \"cc5cd79d70b57118af25946cd4885eb3eb4823950f2fdde38bb1f744bfd87e5c\": rpc error: code = NotFound desc = could not find container \"cc5cd79d70b57118af25946cd4885eb3eb4823950f2fdde38bb1f744bfd87e5c\": container with ID starting with cc5cd79d70b57118af25946cd4885eb3eb4823950f2fdde38bb1f744bfd87e5c not found: ID does not exist" Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.228736 5120 scope.go:117] "RemoveContainer" containerID="8a72a823ca221dc9900f87e4a72727ccf8445b5e8cb9e21be9e5da2737ba7e71" Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.238004 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17b2138c-b3ca-4538-a7d7-0dc6756650bf-kube-api-access-r67sp" (OuterVolumeSpecName: "kube-api-access-r67sp") pod "17b2138c-b3ca-4538-a7d7-0dc6756650bf" (UID: "17b2138c-b3ca-4538-a7d7-0dc6756650bf"). InnerVolumeSpecName "kube-api-access-r67sp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.244689 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/241ac7ce-90fa-4222-a274-ee00c4ba33a3-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "241ac7ce-90fa-4222-a274-ee00c4ba33a3" (UID: "241ac7ce-90fa-4222-a274-ee00c4ba33a3"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.248478 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-917a-account-create-update-942tp"] Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.249047 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/241ac7ce-90fa-4222-a274-ee00c4ba33a3-kube-api-access-q29hj" (OuterVolumeSpecName: "kube-api-access-q29hj") pod "241ac7ce-90fa-4222-a274-ee00c4ba33a3" (UID: "241ac7ce-90fa-4222-a274-ee00c4ba33a3"). InnerVolumeSpecName "kube-api-access-q29hj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.256504 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-917a-account-create-update-942tp"] Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.277174 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/17b2138c-b3ca-4538-a7d7-0dc6756650bf-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "17b2138c-b3ca-4538-a7d7-0dc6756650bf" (UID: "17b2138c-b3ca-4538-a7d7-0dc6756650bf"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.278825 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-4e5e-account-create-update-ft8f9"] Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.282202 5120 scope.go:117] "RemoveContainer" containerID="95e121ce2779586c5c19af119fb8c0edefa3209e5d09f88db3f67f068079313c" Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.290301 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/17b2138c-b3ca-4538-a7d7-0dc6756650bf-config-data" (OuterVolumeSpecName: "config-data") pod "17b2138c-b3ca-4538-a7d7-0dc6756650bf" (UID: "17b2138c-b3ca-4538-a7d7-0dc6756650bf"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.291808 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/241ac7ce-90fa-4222-a274-ee00c4ba33a3-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "241ac7ce-90fa-4222-a274-ee00c4ba33a3" (UID: "241ac7ce-90fa-4222-a274-ee00c4ba33a3"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.293096 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-4e5e-account-create-update-ft8f9"] Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.307270 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/17b2138c-b3ca-4538-a7d7-0dc6756650bf-nova-metadata-tls-certs" (OuterVolumeSpecName: "nova-metadata-tls-certs") pod "17b2138c-b3ca-4538-a7d7-0dc6756650bf" (UID: "17b2138c-b3ca-4538-a7d7-0dc6756650bf"). InnerVolumeSpecName "nova-metadata-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.307330 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-595564474-m6lrq"] Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.307926 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/241ac7ce-90fa-4222-a274-ee00c4ba33a3-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "241ac7ce-90fa-4222-a274-ee00c4ba33a3" (UID: "241ac7ce-90fa-4222-a274-ee00c4ba33a3"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.309314 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/241ac7ce-90fa-4222-a274-ee00c4ba33a3-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.309337 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/17b2138c-b3ca-4538-a7d7-0dc6756650bf-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.309347 5120 reconciler_common.go:299] "Volume detached for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/17b2138c-b3ca-4538-a7d7-0dc6756650bf-nova-metadata-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.309357 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/241ac7ce-90fa-4222-a274-ee00c4ba33a3-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.309365 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/241ac7ce-90fa-4222-a274-ee00c4ba33a3-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.309402 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/17b2138c-b3ca-4538-a7d7-0dc6756650bf-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.309413 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/17b2138c-b3ca-4538-a7d7-0dc6756650bf-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.309422 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/241ac7ce-90fa-4222-a274-ee00c4ba33a3-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.309432 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q29hj\" (UniqueName: \"kubernetes.io/projected/241ac7ce-90fa-4222-a274-ee00c4ba33a3-kube-api-access-q29hj\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.309443 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r67sp\" (UniqueName: \"kubernetes.io/projected/17b2138c-b3ca-4538-a7d7-0dc6756650bf-kube-api-access-r67sp\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.313826 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-595564474-m6lrq"] Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.323180 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/241ac7ce-90fa-4222-a274-ee00c4ba33a3-config-data" (OuterVolumeSpecName: "config-data") pod "241ac7ce-90fa-4222-a274-ee00c4ba33a3" (UID: "241ac7ce-90fa-4222-a274-ee00c4ba33a3"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.339909 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/241ac7ce-90fa-4222-a274-ee00c4ba33a3-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "241ac7ce-90fa-4222-a274-ee00c4ba33a3" (UID: "241ac7ce-90fa-4222-a274-ee00c4ba33a3"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.346574 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-2002-account-create-update-sg6jt"] Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.354330 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-2002-account-create-update-sg6jt"] Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.361047 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.368252 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.411383 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/241ac7ce-90fa-4222-a274-ee00c4ba33a3-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.411417 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/241ac7ce-90fa-4222-a274-ee00c4ba33a3-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.424475 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-7cbc6f47fd-xhhn9" Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.512187 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/28ea8203-158a-4c89-8ae6-647d230c21ff-combined-ca-bundle\") pod \"28ea8203-158a-4c89-8ae6-647d230c21ff\" (UID: \"28ea8203-158a-4c89-8ae6-647d230c21ff\") " Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.512546 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/28ea8203-158a-4c89-8ae6-647d230c21ff-logs\") pod \"28ea8203-158a-4c89-8ae6-647d230c21ff\" (UID: \"28ea8203-158a-4c89-8ae6-647d230c21ff\") " Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.512565 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/28ea8203-158a-4c89-8ae6-647d230c21ff-config-data-custom\") pod \"28ea8203-158a-4c89-8ae6-647d230c21ff\" (UID: \"28ea8203-158a-4c89-8ae6-647d230c21ff\") " Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.512647 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jp9n6\" (UniqueName: \"kubernetes.io/projected/28ea8203-158a-4c89-8ae6-647d230c21ff-kube-api-access-jp9n6\") pod \"28ea8203-158a-4c89-8ae6-647d230c21ff\" (UID: \"28ea8203-158a-4c89-8ae6-647d230c21ff\") " Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.512841 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/28ea8203-158a-4c89-8ae6-647d230c21ff-config-data\") pod \"28ea8203-158a-4c89-8ae6-647d230c21ff\" (UID: \"28ea8203-158a-4c89-8ae6-647d230c21ff\") " Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.513061 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28ea8203-158a-4c89-8ae6-647d230c21ff-logs" (OuterVolumeSpecName: "logs") pod "28ea8203-158a-4c89-8ae6-647d230c21ff" (UID: "28ea8203-158a-4c89-8ae6-647d230c21ff"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.513628 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/28ea8203-158a-4c89-8ae6-647d230c21ff-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.518910 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/28ea8203-158a-4c89-8ae6-647d230c21ff-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "28ea8203-158a-4c89-8ae6-647d230c21ff" (UID: "28ea8203-158a-4c89-8ae6-647d230c21ff"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.518954 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28ea8203-158a-4c89-8ae6-647d230c21ff-kube-api-access-jp9n6" (OuterVolumeSpecName: "kube-api-access-jp9n6") pod "28ea8203-158a-4c89-8ae6-647d230c21ff" (UID: "28ea8203-158a-4c89-8ae6-647d230c21ff"). InnerVolumeSpecName "kube-api-access-jp9n6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.551153 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/28ea8203-158a-4c89-8ae6-647d230c21ff-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "28ea8203-158a-4c89-8ae6-647d230c21ff" (UID: "28ea8203-158a-4c89-8ae6-647d230c21ff"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.556353 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/28ea8203-158a-4c89-8ae6-647d230c21ff-config-data" (OuterVolumeSpecName: "config-data") pod "28ea8203-158a-4c89-8ae6-647d230c21ff" (UID: "28ea8203-158a-4c89-8ae6-647d230c21ff"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.607384 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-78bffc6747-6kvnb" Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.616011 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/28ea8203-158a-4c89-8ae6-647d230c21ff-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.616032 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jp9n6\" (UniqueName: \"kubernetes.io/projected/28ea8203-158a-4c89-8ae6-647d230c21ff-kube-api-access-jp9n6\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.616041 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/28ea8203-158a-4c89-8ae6-647d230c21ff-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.616052 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/28ea8203-158a-4c89-8ae6-647d230c21ff-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.717392 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5e5ad3cf-0d96-43a2-b8cb-38e7210af15a-scripts\") pod \"5e5ad3cf-0d96-43a2-b8cb-38e7210af15a\" (UID: \"5e5ad3cf-0d96-43a2-b8cb-38e7210af15a\") " Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.717473 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/5e5ad3cf-0d96-43a2-b8cb-38e7210af15a-public-tls-certs\") pod \"5e5ad3cf-0d96-43a2-b8cb-38e7210af15a\" (UID: \"5e5ad3cf-0d96-43a2-b8cb-38e7210af15a\") " Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.717845 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q95kc\" (UniqueName: \"kubernetes.io/projected/5e5ad3cf-0d96-43a2-b8cb-38e7210af15a-kube-api-access-q95kc\") pod \"5e5ad3cf-0d96-43a2-b8cb-38e7210af15a\" (UID: \"5e5ad3cf-0d96-43a2-b8cb-38e7210af15a\") " Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.718074 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5e5ad3cf-0d96-43a2-b8cb-38e7210af15a-combined-ca-bundle\") pod \"5e5ad3cf-0d96-43a2-b8cb-38e7210af15a\" (UID: \"5e5ad3cf-0d96-43a2-b8cb-38e7210af15a\") " Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.718274 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/5e5ad3cf-0d96-43a2-b8cb-38e7210af15a-internal-tls-certs\") pod \"5e5ad3cf-0d96-43a2-b8cb-38e7210af15a\" (UID: \"5e5ad3cf-0d96-43a2-b8cb-38e7210af15a\") " Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.718455 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/5e5ad3cf-0d96-43a2-b8cb-38e7210af15a-fernet-keys\") pod \"5e5ad3cf-0d96-43a2-b8cb-38e7210af15a\" (UID: \"5e5ad3cf-0d96-43a2-b8cb-38e7210af15a\") " Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.718536 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5e5ad3cf-0d96-43a2-b8cb-38e7210af15a-config-data\") pod \"5e5ad3cf-0d96-43a2-b8cb-38e7210af15a\" (UID: \"5e5ad3cf-0d96-43a2-b8cb-38e7210af15a\") " Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.718622 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/5e5ad3cf-0d96-43a2-b8cb-38e7210af15a-credential-keys\") pod \"5e5ad3cf-0d96-43a2-b8cb-38e7210af15a\" (UID: \"5e5ad3cf-0d96-43a2-b8cb-38e7210af15a\") " Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.722398 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e5ad3cf-0d96-43a2-b8cb-38e7210af15a-scripts" (OuterVolumeSpecName: "scripts") pod "5e5ad3cf-0d96-43a2-b8cb-38e7210af15a" (UID: "5e5ad3cf-0d96-43a2-b8cb-38e7210af15a"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.727538 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e5ad3cf-0d96-43a2-b8cb-38e7210af15a-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "5e5ad3cf-0d96-43a2-b8cb-38e7210af15a" (UID: "5e5ad3cf-0d96-43a2-b8cb-38e7210af15a"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.727712 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e5ad3cf-0d96-43a2-b8cb-38e7210af15a-kube-api-access-q95kc" (OuterVolumeSpecName: "kube-api-access-q95kc") pod "5e5ad3cf-0d96-43a2-b8cb-38e7210af15a" (UID: "5e5ad3cf-0d96-43a2-b8cb-38e7210af15a"). InnerVolumeSpecName "kube-api-access-q95kc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.743094 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e5ad3cf-0d96-43a2-b8cb-38e7210af15a-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "5e5ad3cf-0d96-43a2-b8cb-38e7210af15a" (UID: "5e5ad3cf-0d96-43a2-b8cb-38e7210af15a"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.786990 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e5ad3cf-0d96-43a2-b8cb-38e7210af15a-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "5e5ad3cf-0d96-43a2-b8cb-38e7210af15a" (UID: "5e5ad3cf-0d96-43a2-b8cb-38e7210af15a"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.806685 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e5ad3cf-0d96-43a2-b8cb-38e7210af15a-config-data" (OuterVolumeSpecName: "config-data") pod "5e5ad3cf-0d96-43a2-b8cb-38e7210af15a" (UID: "5e5ad3cf-0d96-43a2-b8cb-38e7210af15a"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.821723 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5e5ad3cf-0d96-43a2-b8cb-38e7210af15a-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.821768 5120 reconciler_common.go:299] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/5e5ad3cf-0d96-43a2-b8cb-38e7210af15a-fernet-keys\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.821778 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5e5ad3cf-0d96-43a2-b8cb-38e7210af15a-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.821786 5120 reconciler_common.go:299] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/5e5ad3cf-0d96-43a2-b8cb-38e7210af15a-credential-keys\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.821795 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5e5ad3cf-0d96-43a2-b8cb-38e7210af15a-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.821804 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q95kc\" (UniqueName: \"kubernetes.io/projected/5e5ad3cf-0d96-43a2-b8cb-38e7210af15a-kube-api-access-q95kc\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:25 crc kubenswrapper[5120]: E0316 16:12:25.821957 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-config-data: configmap "rabbitmq-config-data" not found Mar 16 16:12:25 crc kubenswrapper[5120]: E0316 16:12:25.822074 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab-config-data podName:ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab nodeName:}" failed. No retries permitted until 2026-03-16 16:12:33.822045285 +0000 UTC m=+2455.975976952 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab-config-data") pod "rabbitmq-server-0" (UID: "ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab") : configmap "rabbitmq-config-data" not found Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.827755 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e5ad3cf-0d96-43a2-b8cb-38e7210af15a-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "5e5ad3cf-0d96-43a2-b8cb-38e7210af15a" (UID: "5e5ad3cf-0d96-43a2-b8cb-38e7210af15a"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.830657 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e5ad3cf-0d96-43a2-b8cb-38e7210af15a-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "5e5ad3cf-0d96-43a2-b8cb-38e7210af15a" (UID: "5e5ad3cf-0d96-43a2-b8cb-38e7210af15a"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.910149 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.923537 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/5e5ad3cf-0d96-43a2-b8cb-38e7210af15a-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:25 crc kubenswrapper[5120]: I0316 16:12:25.923558 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/5e5ad3cf-0d96-43a2-b8cb-38e7210af15a-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:26 crc kubenswrapper[5120]: I0316 16:12:26.024336 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/10ec5605-2810-4b8c-9a6a-e5cfc3b33706-config-data\") pod \"10ec5605-2810-4b8c-9a6a-e5cfc3b33706\" (UID: \"10ec5605-2810-4b8c-9a6a-e5cfc3b33706\") " Mar 16 16:12:26 crc kubenswrapper[5120]: I0316 16:12:26.024494 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/10ec5605-2810-4b8c-9a6a-e5cfc3b33706-combined-ca-bundle\") pod \"10ec5605-2810-4b8c-9a6a-e5cfc3b33706\" (UID: \"10ec5605-2810-4b8c-9a6a-e5cfc3b33706\") " Mar 16 16:12:26 crc kubenswrapper[5120]: I0316 16:12:26.024608 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/10ec5605-2810-4b8c-9a6a-e5cfc3b33706-internal-tls-certs\") pod \"10ec5605-2810-4b8c-9a6a-e5cfc3b33706\" (UID: \"10ec5605-2810-4b8c-9a6a-e5cfc3b33706\") " Mar 16 16:12:26 crc kubenswrapper[5120]: I0316 16:12:26.024690 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h6ghf\" (UniqueName: \"kubernetes.io/projected/10ec5605-2810-4b8c-9a6a-e5cfc3b33706-kube-api-access-h6ghf\") pod \"10ec5605-2810-4b8c-9a6a-e5cfc3b33706\" (UID: \"10ec5605-2810-4b8c-9a6a-e5cfc3b33706\") " Mar 16 16:12:26 crc kubenswrapper[5120]: I0316 16:12:26.024727 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/10ec5605-2810-4b8c-9a6a-e5cfc3b33706-logs\") pod \"10ec5605-2810-4b8c-9a6a-e5cfc3b33706\" (UID: \"10ec5605-2810-4b8c-9a6a-e5cfc3b33706\") " Mar 16 16:12:26 crc kubenswrapper[5120]: I0316 16:12:26.024782 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/10ec5605-2810-4b8c-9a6a-e5cfc3b33706-public-tls-certs\") pod \"10ec5605-2810-4b8c-9a6a-e5cfc3b33706\" (UID: \"10ec5605-2810-4b8c-9a6a-e5cfc3b33706\") " Mar 16 16:12:26 crc kubenswrapper[5120]: I0316 16:12:26.027188 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10ec5605-2810-4b8c-9a6a-e5cfc3b33706-logs" (OuterVolumeSpecName: "logs") pod "10ec5605-2810-4b8c-9a6a-e5cfc3b33706" (UID: "10ec5605-2810-4b8c-9a6a-e5cfc3b33706"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:12:26 crc kubenswrapper[5120]: I0316 16:12:26.029982 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10ec5605-2810-4b8c-9a6a-e5cfc3b33706-kube-api-access-h6ghf" (OuterVolumeSpecName: "kube-api-access-h6ghf") pod "10ec5605-2810-4b8c-9a6a-e5cfc3b33706" (UID: "10ec5605-2810-4b8c-9a6a-e5cfc3b33706"). InnerVolumeSpecName "kube-api-access-h6ghf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:12:26 crc kubenswrapper[5120]: I0316 16:12:26.045793 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/10ec5605-2810-4b8c-9a6a-e5cfc3b33706-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "10ec5605-2810-4b8c-9a6a-e5cfc3b33706" (UID: "10ec5605-2810-4b8c-9a6a-e5cfc3b33706"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:26 crc kubenswrapper[5120]: I0316 16:12:26.053930 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/10ec5605-2810-4b8c-9a6a-e5cfc3b33706-config-data" (OuterVolumeSpecName: "config-data") pod "10ec5605-2810-4b8c-9a6a-e5cfc3b33706" (UID: "10ec5605-2810-4b8c-9a6a-e5cfc3b33706"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:26 crc kubenswrapper[5120]: I0316 16:12:26.065776 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/10ec5605-2810-4b8c-9a6a-e5cfc3b33706-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "10ec5605-2810-4b8c-9a6a-e5cfc3b33706" (UID: "10ec5605-2810-4b8c-9a6a-e5cfc3b33706"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:26 crc kubenswrapper[5120]: I0316 16:12:26.077386 5120 generic.go:358] "Generic (PLEG): container finished" podID="5e5ad3cf-0d96-43a2-b8cb-38e7210af15a" containerID="ba03d7a9aa13d3fbfdb1a3d6582a793bbd788100c52fcb6baa98e4ee06d7e9a1" exitCode=0 Mar 16 16:12:26 crc kubenswrapper[5120]: I0316 16:12:26.077438 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-78bffc6747-6kvnb" event={"ID":"5e5ad3cf-0d96-43a2-b8cb-38e7210af15a","Type":"ContainerDied","Data":"ba03d7a9aa13d3fbfdb1a3d6582a793bbd788100c52fcb6baa98e4ee06d7e9a1"} Mar 16 16:12:26 crc kubenswrapper[5120]: I0316 16:12:26.077687 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-78bffc6747-6kvnb" event={"ID":"5e5ad3cf-0d96-43a2-b8cb-38e7210af15a","Type":"ContainerDied","Data":"63b5a49d2e4b838a689a8649f979202cbbabfd19252305bc0d63d60d8f17703f"} Mar 16 16:12:26 crc kubenswrapper[5120]: I0316 16:12:26.077459 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-78bffc6747-6kvnb" Mar 16 16:12:26 crc kubenswrapper[5120]: I0316 16:12:26.077717 5120 scope.go:117] "RemoveContainer" containerID="ba03d7a9aa13d3fbfdb1a3d6582a793bbd788100c52fcb6baa98e4ee06d7e9a1" Mar 16 16:12:26 crc kubenswrapper[5120]: I0316 16:12:26.082591 5120 generic.go:358] "Generic (PLEG): container finished" podID="28ea8203-158a-4c89-8ae6-647d230c21ff" containerID="022fe2c06ece58fc57ef1d4dc8c366a6e5e260f72b9eaf2412cc117df1f26631" exitCode=0 Mar 16 16:12:26 crc kubenswrapper[5120]: I0316 16:12:26.082681 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-7cbc6f47fd-xhhn9" event={"ID":"28ea8203-158a-4c89-8ae6-647d230c21ff","Type":"ContainerDied","Data":"022fe2c06ece58fc57ef1d4dc8c366a6e5e260f72b9eaf2412cc117df1f26631"} Mar 16 16:12:26 crc kubenswrapper[5120]: I0316 16:12:26.082709 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-7cbc6f47fd-xhhn9" event={"ID":"28ea8203-158a-4c89-8ae6-647d230c21ff","Type":"ContainerDied","Data":"c30a8449eabbe5d6204da8afa9be14d960147620cb1dc5787867a2dc823dd02b"} Mar 16 16:12:26 crc kubenswrapper[5120]: I0316 16:12:26.082728 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-7cbc6f47fd-xhhn9" Mar 16 16:12:26 crc kubenswrapper[5120]: I0316 16:12:26.087021 5120 generic.go:358] "Generic (PLEG): container finished" podID="10ec5605-2810-4b8c-9a6a-e5cfc3b33706" containerID="8c7afa10201bb4e86903115fd27c78f30865b73d10743ea051ae56c76c2ea814" exitCode=0 Mar 16 16:12:26 crc kubenswrapper[5120]: I0316 16:12:26.087080 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:12:26 crc kubenswrapper[5120]: I0316 16:12:26.087071 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"10ec5605-2810-4b8c-9a6a-e5cfc3b33706","Type":"ContainerDied","Data":"8c7afa10201bb4e86903115fd27c78f30865b73d10743ea051ae56c76c2ea814"} Mar 16 16:12:26 crc kubenswrapper[5120]: I0316 16:12:26.087620 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"10ec5605-2810-4b8c-9a6a-e5cfc3b33706","Type":"ContainerDied","Data":"61c0b6f1c7f9b1c6b23da38c23bc14ee9585d510025174a276ae481ae532d98f"} Mar 16 16:12:26 crc kubenswrapper[5120]: I0316 16:12:26.090594 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"17b2138c-b3ca-4538-a7d7-0dc6756650bf","Type":"ContainerDied","Data":"ae8828fc37a6c384c3bc2873b8ad9f7bb59a62f9a80346627a4cf4f5926c1a33"} Mar 16 16:12:26 crc kubenswrapper[5120]: I0316 16:12:26.090695 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:12:26 crc kubenswrapper[5120]: I0316 16:12:26.094795 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-f9bc678f8-6p72p" Mar 16 16:12:26 crc kubenswrapper[5120]: I0316 16:12:26.095517 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-f9bc678f8-6p72p" event={"ID":"241ac7ce-90fa-4222-a274-ee00c4ba33a3","Type":"ContainerDied","Data":"109846b33f3d0b9563ef155d7d4862eec6426141f5bd2a94c4b722ea43636d4a"} Mar 16 16:12:26 crc kubenswrapper[5120]: I0316 16:12:26.105925 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/10ec5605-2810-4b8c-9a6a-e5cfc3b33706-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "10ec5605-2810-4b8c-9a6a-e5cfc3b33706" (UID: "10ec5605-2810-4b8c-9a6a-e5cfc3b33706"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:26 crc kubenswrapper[5120]: I0316 16:12:26.105984 5120 scope.go:117] "RemoveContainer" containerID="ba03d7a9aa13d3fbfdb1a3d6582a793bbd788100c52fcb6baa98e4ee06d7e9a1" Mar 16 16:12:26 crc kubenswrapper[5120]: E0316 16:12:26.106388 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba03d7a9aa13d3fbfdb1a3d6582a793bbd788100c52fcb6baa98e4ee06d7e9a1\": container with ID starting with ba03d7a9aa13d3fbfdb1a3d6582a793bbd788100c52fcb6baa98e4ee06d7e9a1 not found: ID does not exist" containerID="ba03d7a9aa13d3fbfdb1a3d6582a793bbd788100c52fcb6baa98e4ee06d7e9a1" Mar 16 16:12:26 crc kubenswrapper[5120]: I0316 16:12:26.106433 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba03d7a9aa13d3fbfdb1a3d6582a793bbd788100c52fcb6baa98e4ee06d7e9a1"} err="failed to get container status \"ba03d7a9aa13d3fbfdb1a3d6582a793bbd788100c52fcb6baa98e4ee06d7e9a1\": rpc error: code = NotFound desc = could not find container \"ba03d7a9aa13d3fbfdb1a3d6582a793bbd788100c52fcb6baa98e4ee06d7e9a1\": container with ID starting with ba03d7a9aa13d3fbfdb1a3d6582a793bbd788100c52fcb6baa98e4ee06d7e9a1 not found: ID does not exist" Mar 16 16:12:26 crc kubenswrapper[5120]: I0316 16:12:26.106461 5120 scope.go:117] "RemoveContainer" containerID="022fe2c06ece58fc57ef1d4dc8c366a6e5e260f72b9eaf2412cc117df1f26631" Mar 16 16:12:26 crc kubenswrapper[5120]: I0316 16:12:26.131334 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/10ec5605-2810-4b8c-9a6a-e5cfc3b33706-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:26 crc kubenswrapper[5120]: I0316 16:12:26.131359 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/10ec5605-2810-4b8c-9a6a-e5cfc3b33706-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:26 crc kubenswrapper[5120]: I0316 16:12:26.131392 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h6ghf\" (UniqueName: \"kubernetes.io/projected/10ec5605-2810-4b8c-9a6a-e5cfc3b33706-kube-api-access-h6ghf\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:26 crc kubenswrapper[5120]: I0316 16:12:26.131402 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/10ec5605-2810-4b8c-9a6a-e5cfc3b33706-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:26 crc kubenswrapper[5120]: I0316 16:12:26.131411 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/10ec5605-2810-4b8c-9a6a-e5cfc3b33706-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:26 crc kubenswrapper[5120]: I0316 16:12:26.131420 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/10ec5605-2810-4b8c-9a6a-e5cfc3b33706-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:26 crc kubenswrapper[5120]: I0316 16:12:26.156738 5120 scope.go:117] "RemoveContainer" containerID="5b0aa275ade968085f1b9c47c4e4571ba1ab8d6cb51953a996db3a2e2dc99e74" Mar 16 16:12:26 crc kubenswrapper[5120]: I0316 16:12:26.156921 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-78bffc6747-6kvnb"] Mar 16 16:12:26 crc kubenswrapper[5120]: I0316 16:12:26.175814 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-78bffc6747-6kvnb"] Mar 16 16:12:26 crc kubenswrapper[5120]: I0316 16:12:26.181868 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:12:26 crc kubenswrapper[5120]: I0316 16:12:26.191405 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:12:26 crc kubenswrapper[5120]: I0316 16:12:26.206229 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-7cbc6f47fd-xhhn9"] Mar 16 16:12:26 crc kubenswrapper[5120]: I0316 16:12:26.207392 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-7cbc6f47fd-xhhn9"] Mar 16 16:12:26 crc kubenswrapper[5120]: I0316 16:12:26.214731 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-f9bc678f8-6p72p"] Mar 16 16:12:26 crc kubenswrapper[5120]: I0316 16:12:26.221924 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-api-f9bc678f8-6p72p"] Mar 16 16:12:26 crc kubenswrapper[5120]: I0316 16:12:26.233451 5120 scope.go:117] "RemoveContainer" containerID="022fe2c06ece58fc57ef1d4dc8c366a6e5e260f72b9eaf2412cc117df1f26631" Mar 16 16:12:26 crc kubenswrapper[5120]: E0316 16:12:26.233959 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"022fe2c06ece58fc57ef1d4dc8c366a6e5e260f72b9eaf2412cc117df1f26631\": container with ID starting with 022fe2c06ece58fc57ef1d4dc8c366a6e5e260f72b9eaf2412cc117df1f26631 not found: ID does not exist" containerID="022fe2c06ece58fc57ef1d4dc8c366a6e5e260f72b9eaf2412cc117df1f26631" Mar 16 16:12:26 crc kubenswrapper[5120]: I0316 16:12:26.234019 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"022fe2c06ece58fc57ef1d4dc8c366a6e5e260f72b9eaf2412cc117df1f26631"} err="failed to get container status \"022fe2c06ece58fc57ef1d4dc8c366a6e5e260f72b9eaf2412cc117df1f26631\": rpc error: code = NotFound desc = could not find container \"022fe2c06ece58fc57ef1d4dc8c366a6e5e260f72b9eaf2412cc117df1f26631\": container with ID starting with 022fe2c06ece58fc57ef1d4dc8c366a6e5e260f72b9eaf2412cc117df1f26631 not found: ID does not exist" Mar 16 16:12:26 crc kubenswrapper[5120]: I0316 16:12:26.234046 5120 scope.go:117] "RemoveContainer" containerID="5b0aa275ade968085f1b9c47c4e4571ba1ab8d6cb51953a996db3a2e2dc99e74" Mar 16 16:12:26 crc kubenswrapper[5120]: E0316 16:12:26.234410 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b0aa275ade968085f1b9c47c4e4571ba1ab8d6cb51953a996db3a2e2dc99e74\": container with ID starting with 5b0aa275ade968085f1b9c47c4e4571ba1ab8d6cb51953a996db3a2e2dc99e74 not found: ID does not exist" containerID="5b0aa275ade968085f1b9c47c4e4571ba1ab8d6cb51953a996db3a2e2dc99e74" Mar 16 16:12:26 crc kubenswrapper[5120]: I0316 16:12:26.234438 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b0aa275ade968085f1b9c47c4e4571ba1ab8d6cb51953a996db3a2e2dc99e74"} err="failed to get container status \"5b0aa275ade968085f1b9c47c4e4571ba1ab8d6cb51953a996db3a2e2dc99e74\": rpc error: code = NotFound desc = could not find container \"5b0aa275ade968085f1b9c47c4e4571ba1ab8d6cb51953a996db3a2e2dc99e74\": container with ID starting with 5b0aa275ade968085f1b9c47c4e4571ba1ab8d6cb51953a996db3a2e2dc99e74 not found: ID does not exist" Mar 16 16:12:26 crc kubenswrapper[5120]: I0316 16:12:26.234452 5120 scope.go:117] "RemoveContainer" containerID="8c7afa10201bb4e86903115fd27c78f30865b73d10743ea051ae56c76c2ea814" Mar 16 16:12:26 crc kubenswrapper[5120]: I0316 16:12:26.256476 5120 scope.go:117] "RemoveContainer" containerID="30cb524b702792b5b0d1c7e920fa43fe3cffd8cfa340a919cb3c394fe3d72112" Mar 16 16:12:26 crc kubenswrapper[5120]: I0316 16:12:26.296915 5120 scope.go:117] "RemoveContainer" containerID="8c7afa10201bb4e86903115fd27c78f30865b73d10743ea051ae56c76c2ea814" Mar 16 16:12:26 crc kubenswrapper[5120]: E0316 16:12:26.298959 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c7afa10201bb4e86903115fd27c78f30865b73d10743ea051ae56c76c2ea814\": container with ID starting with 8c7afa10201bb4e86903115fd27c78f30865b73d10743ea051ae56c76c2ea814 not found: ID does not exist" containerID="8c7afa10201bb4e86903115fd27c78f30865b73d10743ea051ae56c76c2ea814" Mar 16 16:12:26 crc kubenswrapper[5120]: I0316 16:12:26.298989 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c7afa10201bb4e86903115fd27c78f30865b73d10743ea051ae56c76c2ea814"} err="failed to get container status \"8c7afa10201bb4e86903115fd27c78f30865b73d10743ea051ae56c76c2ea814\": rpc error: code = NotFound desc = could not find container \"8c7afa10201bb4e86903115fd27c78f30865b73d10743ea051ae56c76c2ea814\": container with ID starting with 8c7afa10201bb4e86903115fd27c78f30865b73d10743ea051ae56c76c2ea814 not found: ID does not exist" Mar 16 16:12:26 crc kubenswrapper[5120]: I0316 16:12:26.299008 5120 scope.go:117] "RemoveContainer" containerID="30cb524b702792b5b0d1c7e920fa43fe3cffd8cfa340a919cb3c394fe3d72112" Mar 16 16:12:26 crc kubenswrapper[5120]: E0316 16:12:26.299350 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"30cb524b702792b5b0d1c7e920fa43fe3cffd8cfa340a919cb3c394fe3d72112\": container with ID starting with 30cb524b702792b5b0d1c7e920fa43fe3cffd8cfa340a919cb3c394fe3d72112 not found: ID does not exist" containerID="30cb524b702792b5b0d1c7e920fa43fe3cffd8cfa340a919cb3c394fe3d72112" Mar 16 16:12:26 crc kubenswrapper[5120]: I0316 16:12:26.299405 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30cb524b702792b5b0d1c7e920fa43fe3cffd8cfa340a919cb3c394fe3d72112"} err="failed to get container status \"30cb524b702792b5b0d1c7e920fa43fe3cffd8cfa340a919cb3c394fe3d72112\": rpc error: code = NotFound desc = could not find container \"30cb524b702792b5b0d1c7e920fa43fe3cffd8cfa340a919cb3c394fe3d72112\": container with ID starting with 30cb524b702792b5b0d1c7e920fa43fe3cffd8cfa340a919cb3c394fe3d72112 not found: ID does not exist" Mar 16 16:12:26 crc kubenswrapper[5120]: I0316 16:12:26.299437 5120 scope.go:117] "RemoveContainer" containerID="46862529c1989fabbd8a3c6c982324fb04976c3d04492a4676f4f8667ef55b0b" Mar 16 16:12:26 crc kubenswrapper[5120]: I0316 16:12:26.316402 5120 scope.go:117] "RemoveContainer" containerID="ea430835f1beb9f77ac042d234c65b501734c5b7323a6b25a1db8b17b727e6b5" Mar 16 16:12:26 crc kubenswrapper[5120]: I0316 16:12:26.341613 5120 scope.go:117] "RemoveContainer" containerID="12dc36279bce82525ae4b3823badcb4f88e30f5db4b097ec7671d740068dbe6c" Mar 16 16:12:26 crc kubenswrapper[5120]: I0316 16:12:26.359331 5120 scope.go:117] "RemoveContainer" containerID="0dadea8ab408f64e9e344819b50787a4d1b4f746bfbe3d5362a281c253d2b9e2" Mar 16 16:12:26 crc kubenswrapper[5120]: I0316 16:12:26.428735 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:12:26 crc kubenswrapper[5120]: I0316 16:12:26.434219 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-northd-0_6d9a26b4-a091-43f5-8625-2194e901021c/ovn-northd/0.log" Mar 16 16:12:26 crc kubenswrapper[5120]: I0316 16:12:26.434291 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:12:26 crc kubenswrapper[5120]: I0316 16:12:26.436839 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:12:26 crc kubenswrapper[5120]: I0316 16:12:26.539753 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/6d9a26b4-a091-43f5-8625-2194e901021c-ovn-rundir\") pod \"6d9a26b4-a091-43f5-8625-2194e901021c\" (UID: \"6d9a26b4-a091-43f5-8625-2194e901021c\") " Mar 16 16:12:26 crc kubenswrapper[5120]: I0316 16:12:26.539873 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/6d9a26b4-a091-43f5-8625-2194e901021c-scripts\") pod \"6d9a26b4-a091-43f5-8625-2194e901021c\" (UID: \"6d9a26b4-a091-43f5-8625-2194e901021c\") " Mar 16 16:12:26 crc kubenswrapper[5120]: I0316 16:12:26.539973 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6d9a26b4-a091-43f5-8625-2194e901021c-combined-ca-bundle\") pod \"6d9a26b4-a091-43f5-8625-2194e901021c\" (UID: \"6d9a26b4-a091-43f5-8625-2194e901021c\") " Mar 16 16:12:26 crc kubenswrapper[5120]: I0316 16:12:26.540058 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/6d9a26b4-a091-43f5-8625-2194e901021c-metrics-certs-tls-certs\") pod \"6d9a26b4-a091-43f5-8625-2194e901021c\" (UID: \"6d9a26b4-a091-43f5-8625-2194e901021c\") " Mar 16 16:12:26 crc kubenswrapper[5120]: I0316 16:12:26.540108 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6d9a26b4-a091-43f5-8625-2194e901021c-config\") pod \"6d9a26b4-a091-43f5-8625-2194e901021c\" (UID: \"6d9a26b4-a091-43f5-8625-2194e901021c\") " Mar 16 16:12:26 crc kubenswrapper[5120]: I0316 16:12:26.540183 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/6d9a26b4-a091-43f5-8625-2194e901021c-ovn-northd-tls-certs\") pod \"6d9a26b4-a091-43f5-8625-2194e901021c\" (UID: \"6d9a26b4-a091-43f5-8625-2194e901021c\") " Mar 16 16:12:26 crc kubenswrapper[5120]: I0316 16:12:26.540391 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ckhcf\" (UniqueName: \"kubernetes.io/projected/6d9a26b4-a091-43f5-8625-2194e901021c-kube-api-access-ckhcf\") pod \"6d9a26b4-a091-43f5-8625-2194e901021c\" (UID: \"6d9a26b4-a091-43f5-8625-2194e901021c\") " Mar 16 16:12:26 crc kubenswrapper[5120]: I0316 16:12:26.540718 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6d9a26b4-a091-43f5-8625-2194e901021c-config" (OuterVolumeSpecName: "config") pod "6d9a26b4-a091-43f5-8625-2194e901021c" (UID: "6d9a26b4-a091-43f5-8625-2194e901021c"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:12:26 crc kubenswrapper[5120]: I0316 16:12:26.541164 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d9a26b4-a091-43f5-8625-2194e901021c-ovn-rundir" (OuterVolumeSpecName: "ovn-rundir") pod "6d9a26b4-a091-43f5-8625-2194e901021c" (UID: "6d9a26b4-a091-43f5-8625-2194e901021c"). InnerVolumeSpecName "ovn-rundir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:12:26 crc kubenswrapper[5120]: E0316 16:12:26.541654 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Mar 16 16:12:26 crc kubenswrapper[5120]: I0316 16:12:26.541702 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6d9a26b4-a091-43f5-8625-2194e901021c-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:26 crc kubenswrapper[5120]: I0316 16:12:26.541723 5120 reconciler_common.go:299] "Volume detached for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/6d9a26b4-a091-43f5-8625-2194e901021c-ovn-rundir\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:26 crc kubenswrapper[5120]: E0316 16:12:26.541777 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a-config-data podName:de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a nodeName:}" failed. No retries permitted until 2026-03-16 16:12:34.541743413 +0000 UTC m=+2456.695675070 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a-config-data") pod "rabbitmq-cell1-server-0" (UID: "de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a") : configmap "rabbitmq-cell1-config-data" not found Mar 16 16:12:26 crc kubenswrapper[5120]: E0316 16:12:26.542227 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 16:12:26 crc kubenswrapper[5120]: E0316 16:12:26.542334 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bba65a98-1383-4c8c-995a-b212b232d1f8-combined-ca-bundle podName:bba65a98-1383-4c8c-995a-b212b232d1f8 nodeName:}" failed. No retries permitted until 2026-03-16 16:12:34.542309278 +0000 UTC m=+2456.696240975 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/bba65a98-1383-4c8c-995a-b212b232d1f8-combined-ca-bundle") pod "nova-scheduler-0" (UID: "bba65a98-1383-4c8c-995a-b212b232d1f8") : secret "combined-ca-bundle" not found Mar 16 16:12:26 crc kubenswrapper[5120]: I0316 16:12:26.542948 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6d9a26b4-a091-43f5-8625-2194e901021c-scripts" (OuterVolumeSpecName: "scripts") pod "6d9a26b4-a091-43f5-8625-2194e901021c" (UID: "6d9a26b4-a091-43f5-8625-2194e901021c"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:12:26 crc kubenswrapper[5120]: I0316 16:12:26.544750 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d9a26b4-a091-43f5-8625-2194e901021c-kube-api-access-ckhcf" (OuterVolumeSpecName: "kube-api-access-ckhcf") pod "6d9a26b4-a091-43f5-8625-2194e901021c" (UID: "6d9a26b4-a091-43f5-8625-2194e901021c"). InnerVolumeSpecName "kube-api-access-ckhcf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:12:26 crc kubenswrapper[5120]: I0316 16:12:26.572739 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d9a26b4-a091-43f5-8625-2194e901021c-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "6d9a26b4-a091-43f5-8625-2194e901021c" (UID: "6d9a26b4-a091-43f5-8625-2194e901021c"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:26 crc kubenswrapper[5120]: I0316 16:12:26.605683 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d9a26b4-a091-43f5-8625-2194e901021c-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "6d9a26b4-a091-43f5-8625-2194e901021c" (UID: "6d9a26b4-a091-43f5-8625-2194e901021c"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:26 crc kubenswrapper[5120]: I0316 16:12:26.612782 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d9a26b4-a091-43f5-8625-2194e901021c-ovn-northd-tls-certs" (OuterVolumeSpecName: "ovn-northd-tls-certs") pod "6d9a26b4-a091-43f5-8625-2194e901021c" (UID: "6d9a26b4-a091-43f5-8625-2194e901021c"). InnerVolumeSpecName "ovn-northd-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:26 crc kubenswrapper[5120]: I0316 16:12:26.643710 5120 reconciler_common.go:299] "Volume detached for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/6d9a26b4-a091-43f5-8625-2194e901021c-ovn-northd-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:26 crc kubenswrapper[5120]: I0316 16:12:26.643748 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ckhcf\" (UniqueName: \"kubernetes.io/projected/6d9a26b4-a091-43f5-8625-2194e901021c-kube-api-access-ckhcf\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:26 crc kubenswrapper[5120]: I0316 16:12:26.643892 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/6d9a26b4-a091-43f5-8625-2194e901021c-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:26 crc kubenswrapper[5120]: I0316 16:12:26.643905 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6d9a26b4-a091-43f5-8625-2194e901021c-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:26 crc kubenswrapper[5120]: I0316 16:12:26.643917 5120 reconciler_common.go:299] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/6d9a26b4-a091-43f5-8625-2194e901021c-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:26 crc kubenswrapper[5120]: I0316 16:12:26.675578 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="10ec5605-2810-4b8c-9a6a-e5cfc3b33706" path="/var/lib/kubelet/pods/10ec5605-2810-4b8c-9a6a-e5cfc3b33706/volumes" Mar 16 16:12:26 crc kubenswrapper[5120]: I0316 16:12:26.676494 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="17b2138c-b3ca-4538-a7d7-0dc6756650bf" path="/var/lib/kubelet/pods/17b2138c-b3ca-4538-a7d7-0dc6756650bf/volumes" Mar 16 16:12:26 crc kubenswrapper[5120]: I0316 16:12:26.677189 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1d95fd75-2d15-48f7-9605-2d1980ebeff2" path="/var/lib/kubelet/pods/1d95fd75-2d15-48f7-9605-2d1980ebeff2/volumes" Mar 16 16:12:26 crc kubenswrapper[5120]: I0316 16:12:26.678109 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="241ac7ce-90fa-4222-a274-ee00c4ba33a3" path="/var/lib/kubelet/pods/241ac7ce-90fa-4222-a274-ee00c4ba33a3/volumes" Mar 16 16:12:26 crc kubenswrapper[5120]: I0316 16:12:26.678676 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="28ea8203-158a-4c89-8ae6-647d230c21ff" path="/var/lib/kubelet/pods/28ea8203-158a-4c89-8ae6-647d230c21ff/volumes" Mar 16 16:12:26 crc kubenswrapper[5120]: I0316 16:12:26.679329 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c399606-817d-4a0f-b825-32da28e0491d" path="/var/lib/kubelet/pods/5c399606-817d-4a0f-b825-32da28e0491d/volumes" Mar 16 16:12:26 crc kubenswrapper[5120]: I0316 16:12:26.680306 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5e5ad3cf-0d96-43a2-b8cb-38e7210af15a" path="/var/lib/kubelet/pods/5e5ad3cf-0d96-43a2-b8cb-38e7210af15a/volumes" Mar 16 16:12:26 crc kubenswrapper[5120]: I0316 16:12:26.680744 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="972b610c-1005-4b7a-be77-72b7d63cab89" path="/var/lib/kubelet/pods/972b610c-1005-4b7a-be77-72b7d63cab89/volumes" Mar 16 16:12:26 crc kubenswrapper[5120]: I0316 16:12:26.681082 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a0d48ffc-4eac-4602-b2e3-902e4a80c6a3" path="/var/lib/kubelet/pods/a0d48ffc-4eac-4602-b2e3-902e4a80c6a3/volumes" Mar 16 16:12:26 crc kubenswrapper[5120]: I0316 16:12:26.681430 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc6aec24-261d-49c7-8306-704614644eaf" path="/var/lib/kubelet/pods/dc6aec24-261d-49c7-8306-704614644eaf/volumes" Mar 16 16:12:26 crc kubenswrapper[5120]: I0316 16:12:26.682237 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eefef8ba-a54a-4ee8-9c31-757cc07a6ab3" path="/var/lib/kubelet/pods/eefef8ba-a54a-4ee8-9c31-757cc07a6ab3/volumes" Mar 16 16:12:26 crc kubenswrapper[5120]: E0316 16:12:26.847587 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cinder-scheduler-config-data: secret "cinder-scheduler-config-data" not found Mar 16 16:12:26 crc kubenswrapper[5120]: E0316 16:12:26.847609 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cinder-config-data: secret "cinder-config-data" not found Mar 16 16:12:26 crc kubenswrapper[5120]: E0316 16:12:26.847659 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96d66c8e-8cdb-462c-a302-c85e581db5ad-config-data-custom podName:96d66c8e-8cdb-462c-a302-c85e581db5ad nodeName:}" failed. No retries permitted until 2026-03-16 16:12:34.847639472 +0000 UTC m=+2457.001571129 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "config-data-custom" (UniqueName: "kubernetes.io/secret/96d66c8e-8cdb-462c-a302-c85e581db5ad-config-data-custom") pod "cinder-scheduler-0" (UID: "96d66c8e-8cdb-462c-a302-c85e581db5ad") : secret "cinder-scheduler-config-data" not found Mar 16 16:12:26 crc kubenswrapper[5120]: E0316 16:12:26.847695 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 16:12:26 crc kubenswrapper[5120]: E0316 16:12:26.847713 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96d66c8e-8cdb-462c-a302-c85e581db5ad-config-data podName:96d66c8e-8cdb-462c-a302-c85e581db5ad nodeName:}" failed. No retries permitted until 2026-03-16 16:12:34.847682594 +0000 UTC m=+2457.001614281 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/secret/96d66c8e-8cdb-462c-a302-c85e581db5ad-config-data") pod "cinder-scheduler-0" (UID: "96d66c8e-8cdb-462c-a302-c85e581db5ad") : secret "cinder-config-data" not found Mar 16 16:12:26 crc kubenswrapper[5120]: E0316 16:12:26.847782 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96d66c8e-8cdb-462c-a302-c85e581db5ad-combined-ca-bundle podName:96d66c8e-8cdb-462c-a302-c85e581db5ad nodeName:}" failed. No retries permitted until 2026-03-16 16:12:34.847748675 +0000 UTC m=+2457.001680332 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/96d66c8e-8cdb-462c-a302-c85e581db5ad-combined-ca-bundle") pod "cinder-scheduler-0" (UID: "96d66c8e-8cdb-462c-a302-c85e581db5ad") : secret "combined-ca-bundle" not found Mar 16 16:12:26 crc kubenswrapper[5120]: E0316 16:12:26.847807 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cinder-scripts: secret "cinder-scripts" not found Mar 16 16:12:26 crc kubenswrapper[5120]: E0316 16:12:26.847924 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96d66c8e-8cdb-462c-a302-c85e581db5ad-scripts podName:96d66c8e-8cdb-462c-a302-c85e581db5ad nodeName:}" failed. No retries permitted until 2026-03-16 16:12:34.84789984 +0000 UTC m=+2457.001831507 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "scripts" (UniqueName: "kubernetes.io/secret/96d66c8e-8cdb-462c-a302-c85e581db5ad-scripts") pod "cinder-scheduler-0" (UID: "96d66c8e-8cdb-462c-a302-c85e581db5ad") : secret "cinder-scripts" not found Mar 16 16:12:26 crc kubenswrapper[5120]: I0316 16:12:26.920596 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:12:27 crc kubenswrapper[5120]: I0316 16:12:27.050031 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-69787fc498-jx88k" podUID="34da2089-cc88-4d8c-97da-68aadf7f2c03" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.0.154:9311/healthcheck\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Mar 16 16:12:27 crc kubenswrapper[5120]: I0316 16:12:27.050420 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab-rabbitmq-erlang-cookie\") pod \"ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab\" (UID: \"ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab\") " Mar 16 16:12:27 crc kubenswrapper[5120]: I0316 16:12:27.050522 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab-erlang-cookie-secret\") pod \"ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab\" (UID: \"ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab\") " Mar 16 16:12:27 crc kubenswrapper[5120]: I0316 16:12:27.050575 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab-server-conf\") pod \"ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab\" (UID: \"ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab\") " Mar 16 16:12:27 crc kubenswrapper[5120]: I0316 16:12:27.050636 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab-config-data\") pod \"ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab\" (UID: \"ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab\") " Mar 16 16:12:27 crc kubenswrapper[5120]: I0316 16:12:27.050773 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab-pod-info\") pod \"ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab\" (UID: \"ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab\") " Mar 16 16:12:27 crc kubenswrapper[5120]: I0316 16:12:27.050804 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab-rabbitmq-confd\") pod \"ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab\" (UID: \"ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab\") " Mar 16 16:12:27 crc kubenswrapper[5120]: I0316 16:12:27.050894 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"persistence\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab\" (UID: \"ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab\") " Mar 16 16:12:27 crc kubenswrapper[5120]: I0316 16:12:27.050935 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vz574\" (UniqueName: \"kubernetes.io/projected/ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab-kube-api-access-vz574\") pod \"ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab\" (UID: \"ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab\") " Mar 16 16:12:27 crc kubenswrapper[5120]: I0316 16:12:27.050938 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab-rabbitmq-erlang-cookie" (OuterVolumeSpecName: "rabbitmq-erlang-cookie") pod "ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab" (UID: "ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab"). InnerVolumeSpecName "rabbitmq-erlang-cookie". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:12:27 crc kubenswrapper[5120]: I0316 16:12:27.051009 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab-rabbitmq-plugins\") pod \"ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab\" (UID: \"ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab\") " Mar 16 16:12:27 crc kubenswrapper[5120]: I0316 16:12:27.051077 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab-plugins-conf\") pod \"ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab\" (UID: \"ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab\") " Mar 16 16:12:27 crc kubenswrapper[5120]: I0316 16:12:27.051159 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab-rabbitmq-tls\") pod \"ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab\" (UID: \"ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab\") " Mar 16 16:12:27 crc kubenswrapper[5120]: I0316 16:12:27.050405 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-69787fc498-jx88k" podUID="34da2089-cc88-4d8c-97da-68aadf7f2c03" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.0.154:9311/healthcheck\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Mar 16 16:12:27 crc kubenswrapper[5120]: I0316 16:12:27.051834 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab-rabbitmq-plugins" (OuterVolumeSpecName: "rabbitmq-plugins") pod "ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab" (UID: "ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab"). InnerVolumeSpecName "rabbitmq-plugins". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:12:27 crc kubenswrapper[5120]: I0316 16:12:27.052305 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab-plugins-conf" (OuterVolumeSpecName: "plugins-conf") pod "ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab" (UID: "ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab"). InnerVolumeSpecName "plugins-conf". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:12:27 crc kubenswrapper[5120]: I0316 16:12:27.054317 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab-kube-api-access-vz574" (OuterVolumeSpecName: "kube-api-access-vz574") pod "ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab" (UID: "ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab"). InnerVolumeSpecName "kube-api-access-vz574". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:12:27 crc kubenswrapper[5120]: I0316 16:12:27.054435 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab-rabbitmq-erlang-cookie\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:27 crc kubenswrapper[5120]: I0316 16:12:27.054469 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab-rabbitmq-plugins\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:27 crc kubenswrapper[5120]: I0316 16:12:27.054483 5120 reconciler_common.go:299] "Volume detached for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab-plugins-conf\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:27 crc kubenswrapper[5120]: I0316 16:12:27.054711 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab-erlang-cookie-secret" (OuterVolumeSpecName: "erlang-cookie-secret") pod "ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab" (UID: "ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab"). InnerVolumeSpecName "erlang-cookie-secret". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:27 crc kubenswrapper[5120]: I0316 16:12:27.056388 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab-rabbitmq-tls" (OuterVolumeSpecName: "rabbitmq-tls") pod "ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab" (UID: "ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab"). InnerVolumeSpecName "rabbitmq-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:12:27 crc kubenswrapper[5120]: I0316 16:12:27.056464 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage03-crc" (OuterVolumeSpecName: "persistence") pod "ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab" (UID: "ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab"). InnerVolumeSpecName "local-storage03-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:12:27 crc kubenswrapper[5120]: I0316 16:12:27.057081 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab-pod-info" (OuterVolumeSpecName: "pod-info") pod "ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab" (UID: "ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab"). InnerVolumeSpecName "pod-info". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Mar 16 16:12:27 crc kubenswrapper[5120]: I0316 16:12:27.078115 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab-config-data" (OuterVolumeSpecName: "config-data") pod "ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab" (UID: "ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:12:27 crc kubenswrapper[5120]: I0316 16:12:27.109703 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-northd-0_6d9a26b4-a091-43f5-8625-2194e901021c/ovn-northd/0.log" Mar 16 16:12:27 crc kubenswrapper[5120]: I0316 16:12:27.110004 5120 generic.go:358] "Generic (PLEG): container finished" podID="6d9a26b4-a091-43f5-8625-2194e901021c" containerID="8ecd82c1669b50dc83fc2647cd97edc7c58898ad565a8f6fd97dffcaf6c2a4ea" exitCode=139 Mar 16 16:12:27 crc kubenswrapper[5120]: I0316 16:12:27.110109 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:12:27 crc kubenswrapper[5120]: I0316 16:12:27.110064 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"6d9a26b4-a091-43f5-8625-2194e901021c","Type":"ContainerDied","Data":"8ecd82c1669b50dc83fc2647cd97edc7c58898ad565a8f6fd97dffcaf6c2a4ea"} Mar 16 16:12:27 crc kubenswrapper[5120]: I0316 16:12:27.110251 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"6d9a26b4-a091-43f5-8625-2194e901021c","Type":"ContainerDied","Data":"772d2e4723c386b87da97ac651a6ffa12062d93c1123f14c2062d11c2c0736f4"} Mar 16 16:12:27 crc kubenswrapper[5120]: I0316 16:12:27.110271 5120 scope.go:117] "RemoveContainer" containerID="aab293db17585f8a42a939cc07e5b97a9fcea6413f5ca264b304c81a0bf0c22c" Mar 16 16:12:27 crc kubenswrapper[5120]: I0316 16:12:27.122275 5120 generic.go:358] "Generic (PLEG): container finished" podID="ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab" containerID="77ffbd2a006faa2311265374def09aab4240f2b98fa437187ccdbc91b27f6851" exitCode=0 Mar 16 16:12:27 crc kubenswrapper[5120]: I0316 16:12:27.122491 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab","Type":"ContainerDied","Data":"77ffbd2a006faa2311265374def09aab4240f2b98fa437187ccdbc91b27f6851"} Mar 16 16:12:27 crc kubenswrapper[5120]: I0316 16:12:27.122519 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab","Type":"ContainerDied","Data":"4d9ca0da5a353326d763c24165b002eb0b3dcf27071b7c17395d81b54463d6d8"} Mar 16 16:12:27 crc kubenswrapper[5120]: I0316 16:12:27.122792 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:12:27 crc kubenswrapper[5120]: I0316 16:12:27.131573 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab-server-conf" (OuterVolumeSpecName: "server-conf") pod "ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab" (UID: "ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab"). InnerVolumeSpecName "server-conf". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:12:27 crc kubenswrapper[5120]: I0316 16:12:27.132104 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab-rabbitmq-confd" (OuterVolumeSpecName: "rabbitmq-confd") pod "ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab" (UID: "ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab"). InnerVolumeSpecName "rabbitmq-confd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:12:27 crc kubenswrapper[5120]: I0316 16:12:27.148914 5120 scope.go:117] "RemoveContainer" containerID="8ecd82c1669b50dc83fc2647cd97edc7c58898ad565a8f6fd97dffcaf6c2a4ea" Mar 16 16:12:27 crc kubenswrapper[5120]: I0316 16:12:27.156462 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab-rabbitmq-tls\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:27 crc kubenswrapper[5120]: I0316 16:12:27.156495 5120 reconciler_common.go:299] "Volume detached for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab-erlang-cookie-secret\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:27 crc kubenswrapper[5120]: I0316 16:12:27.156504 5120 reconciler_common.go:299] "Volume detached for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab-server-conf\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:27 crc kubenswrapper[5120]: I0316 16:12:27.156513 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:27 crc kubenswrapper[5120]: I0316 16:12:27.156522 5120 reconciler_common.go:299] "Volume detached for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab-pod-info\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:27 crc kubenswrapper[5120]: I0316 16:12:27.156529 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab-rabbitmq-confd\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:27 crc kubenswrapper[5120]: I0316 16:12:27.156547 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") on node \"crc\" " Mar 16 16:12:27 crc kubenswrapper[5120]: I0316 16:12:27.156558 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vz574\" (UniqueName: \"kubernetes.io/projected/ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab-kube-api-access-vz574\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:27 crc kubenswrapper[5120]: I0316 16:12:27.164296 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 16:12:27 crc kubenswrapper[5120]: I0316 16:12:27.170411 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 16:12:27 crc kubenswrapper[5120]: I0316 16:12:27.172022 5120 scope.go:117] "RemoveContainer" containerID="aab293db17585f8a42a939cc07e5b97a9fcea6413f5ca264b304c81a0bf0c22c" Mar 16 16:12:27 crc kubenswrapper[5120]: E0316 16:12:27.172451 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aab293db17585f8a42a939cc07e5b97a9fcea6413f5ca264b304c81a0bf0c22c\": container with ID starting with aab293db17585f8a42a939cc07e5b97a9fcea6413f5ca264b304c81a0bf0c22c not found: ID does not exist" containerID="aab293db17585f8a42a939cc07e5b97a9fcea6413f5ca264b304c81a0bf0c22c" Mar 16 16:12:27 crc kubenswrapper[5120]: I0316 16:12:27.172477 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aab293db17585f8a42a939cc07e5b97a9fcea6413f5ca264b304c81a0bf0c22c"} err="failed to get container status \"aab293db17585f8a42a939cc07e5b97a9fcea6413f5ca264b304c81a0bf0c22c\": rpc error: code = NotFound desc = could not find container \"aab293db17585f8a42a939cc07e5b97a9fcea6413f5ca264b304c81a0bf0c22c\": container with ID starting with aab293db17585f8a42a939cc07e5b97a9fcea6413f5ca264b304c81a0bf0c22c not found: ID does not exist" Mar 16 16:12:27 crc kubenswrapper[5120]: I0316 16:12:27.172495 5120 scope.go:117] "RemoveContainer" containerID="8ecd82c1669b50dc83fc2647cd97edc7c58898ad565a8f6fd97dffcaf6c2a4ea" Mar 16 16:12:27 crc kubenswrapper[5120]: E0316 16:12:27.172743 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ecd82c1669b50dc83fc2647cd97edc7c58898ad565a8f6fd97dffcaf6c2a4ea\": container with ID starting with 8ecd82c1669b50dc83fc2647cd97edc7c58898ad565a8f6fd97dffcaf6c2a4ea not found: ID does not exist" containerID="8ecd82c1669b50dc83fc2647cd97edc7c58898ad565a8f6fd97dffcaf6c2a4ea" Mar 16 16:12:27 crc kubenswrapper[5120]: I0316 16:12:27.172879 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ecd82c1669b50dc83fc2647cd97edc7c58898ad565a8f6fd97dffcaf6c2a4ea"} err="failed to get container status \"8ecd82c1669b50dc83fc2647cd97edc7c58898ad565a8f6fd97dffcaf6c2a4ea\": rpc error: code = NotFound desc = could not find container \"8ecd82c1669b50dc83fc2647cd97edc7c58898ad565a8f6fd97dffcaf6c2a4ea\": container with ID starting with 8ecd82c1669b50dc83fc2647cd97edc7c58898ad565a8f6fd97dffcaf6c2a4ea not found: ID does not exist" Mar 16 16:12:27 crc kubenswrapper[5120]: I0316 16:12:27.173011 5120 scope.go:117] "RemoveContainer" containerID="77ffbd2a006faa2311265374def09aab4240f2b98fa437187ccdbc91b27f6851" Mar 16 16:12:27 crc kubenswrapper[5120]: I0316 16:12:27.174304 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage03-crc" (UniqueName: "kubernetes.io/local-volume/local-storage03-crc") on node "crc" Mar 16 16:12:27 crc kubenswrapper[5120]: I0316 16:12:27.191949 5120 scope.go:117] "RemoveContainer" containerID="94de8c59b353553a4799b3d3ca3292a1d0b46fa43cd5dc0cd5e7d0974e74e3c0" Mar 16 16:12:27 crc kubenswrapper[5120]: I0316 16:12:27.210501 5120 scope.go:117] "RemoveContainer" containerID="77ffbd2a006faa2311265374def09aab4240f2b98fa437187ccdbc91b27f6851" Mar 16 16:12:27 crc kubenswrapper[5120]: E0316 16:12:27.211020 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"77ffbd2a006faa2311265374def09aab4240f2b98fa437187ccdbc91b27f6851\": container with ID starting with 77ffbd2a006faa2311265374def09aab4240f2b98fa437187ccdbc91b27f6851 not found: ID does not exist" containerID="77ffbd2a006faa2311265374def09aab4240f2b98fa437187ccdbc91b27f6851" Mar 16 16:12:27 crc kubenswrapper[5120]: I0316 16:12:27.211059 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77ffbd2a006faa2311265374def09aab4240f2b98fa437187ccdbc91b27f6851"} err="failed to get container status \"77ffbd2a006faa2311265374def09aab4240f2b98fa437187ccdbc91b27f6851\": rpc error: code = NotFound desc = could not find container \"77ffbd2a006faa2311265374def09aab4240f2b98fa437187ccdbc91b27f6851\": container with ID starting with 77ffbd2a006faa2311265374def09aab4240f2b98fa437187ccdbc91b27f6851 not found: ID does not exist" Mar 16 16:12:27 crc kubenswrapper[5120]: I0316 16:12:27.211155 5120 scope.go:117] "RemoveContainer" containerID="94de8c59b353553a4799b3d3ca3292a1d0b46fa43cd5dc0cd5e7d0974e74e3c0" Mar 16 16:12:27 crc kubenswrapper[5120]: E0316 16:12:27.211374 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"94de8c59b353553a4799b3d3ca3292a1d0b46fa43cd5dc0cd5e7d0974e74e3c0\": container with ID starting with 94de8c59b353553a4799b3d3ca3292a1d0b46fa43cd5dc0cd5e7d0974e74e3c0 not found: ID does not exist" containerID="94de8c59b353553a4799b3d3ca3292a1d0b46fa43cd5dc0cd5e7d0974e74e3c0" Mar 16 16:12:27 crc kubenswrapper[5120]: I0316 16:12:27.211397 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94de8c59b353553a4799b3d3ca3292a1d0b46fa43cd5dc0cd5e7d0974e74e3c0"} err="failed to get container status \"94de8c59b353553a4799b3d3ca3292a1d0b46fa43cd5dc0cd5e7d0974e74e3c0\": rpc error: code = NotFound desc = could not find container \"94de8c59b353553a4799b3d3ca3292a1d0b46fa43cd5dc0cd5e7d0974e74e3c0\": container with ID starting with 94de8c59b353553a4799b3d3ca3292a1d0b46fa43cd5dc0cd5e7d0974e74e3c0 not found: ID does not exist" Mar 16 16:12:27 crc kubenswrapper[5120]: I0316 16:12:27.257727 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:27 crc kubenswrapper[5120]: E0316 16:12:27.407679 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="0694d284d33b8f4728b5b5db2443c16f6b7c4ab92062463e2013167e4b4a7dc6" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:12:27 crc kubenswrapper[5120]: E0316 16:12:27.408986 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="0694d284d33b8f4728b5b5db2443c16f6b7c4ab92062463e2013167e4b4a7dc6" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:12:27 crc kubenswrapper[5120]: E0316 16:12:27.411462 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="0694d284d33b8f4728b5b5db2443c16f6b7c4ab92062463e2013167e4b4a7dc6" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:12:27 crc kubenswrapper[5120]: E0316 16:12:27.411726 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="bba65a98-1383-4c8c-995a-b212b232d1f8" containerName="nova-scheduler-scheduler" probeResult="unknown" Mar 16 16:12:27 crc kubenswrapper[5120]: I0316 16:12:27.461691 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 16:12:27 crc kubenswrapper[5120]: I0316 16:12:27.467349 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 16:12:27 crc kubenswrapper[5120]: I0316 16:12:27.964539 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:12:28 crc kubenswrapper[5120]: I0316 16:12:28.070450 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a-plugins-conf\") pod \"de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a\" (UID: \"de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a\") " Mar 16 16:12:28 crc kubenswrapper[5120]: I0316 16:12:28.070560 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a-rabbitmq-confd\") pod \"de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a\" (UID: \"de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a\") " Mar 16 16:12:28 crc kubenswrapper[5120]: I0316 16:12:28.070693 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a-rabbitmq-erlang-cookie\") pod \"de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a\" (UID: \"de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a\") " Mar 16 16:12:28 crc kubenswrapper[5120]: I0316 16:12:28.070794 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a-erlang-cookie-secret\") pod \"de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a\" (UID: \"de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a\") " Mar 16 16:12:28 crc kubenswrapper[5120]: I0316 16:12:28.070908 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a-config-data\") pod \"de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a\" (UID: \"de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a\") " Mar 16 16:12:28 crc kubenswrapper[5120]: I0316 16:12:28.071417 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a-server-conf\") pod \"de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a\" (UID: \"de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a\") " Mar 16 16:12:28 crc kubenswrapper[5120]: I0316 16:12:28.071444 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a-rabbitmq-erlang-cookie" (OuterVolumeSpecName: "rabbitmq-erlang-cookie") pod "de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a" (UID: "de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a"). InnerVolumeSpecName "rabbitmq-erlang-cookie". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:12:28 crc kubenswrapper[5120]: I0316 16:12:28.071506 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a-rabbitmq-tls\") pod \"de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a\" (UID: \"de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a\") " Mar 16 16:12:28 crc kubenswrapper[5120]: I0316 16:12:28.071538 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a-pod-info\") pod \"de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a\" (UID: \"de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a\") " Mar 16 16:12:28 crc kubenswrapper[5120]: I0316 16:12:28.071567 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a-rabbitmq-plugins\") pod \"de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a\" (UID: \"de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a\") " Mar 16 16:12:28 crc kubenswrapper[5120]: I0316 16:12:28.071641 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-22p8p\" (UniqueName: \"kubernetes.io/projected/de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a-kube-api-access-22p8p\") pod \"de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a\" (UID: \"de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a\") " Mar 16 16:12:28 crc kubenswrapper[5120]: I0316 16:12:28.071719 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"persistence\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a\" (UID: \"de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a\") " Mar 16 16:12:28 crc kubenswrapper[5120]: I0316 16:12:28.072077 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a-plugins-conf" (OuterVolumeSpecName: "plugins-conf") pod "de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a" (UID: "de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a"). InnerVolumeSpecName "plugins-conf". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:12:28 crc kubenswrapper[5120]: I0316 16:12:28.072444 5120 reconciler_common.go:299] "Volume detached for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a-plugins-conf\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:28 crc kubenswrapper[5120]: I0316 16:12:28.072468 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a-rabbitmq-erlang-cookie\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:28 crc kubenswrapper[5120]: I0316 16:12:28.072866 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a-rabbitmq-plugins" (OuterVolumeSpecName: "rabbitmq-plugins") pod "de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a" (UID: "de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a"). InnerVolumeSpecName "rabbitmq-plugins". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:12:28 crc kubenswrapper[5120]: I0316 16:12:28.076164 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage04-crc" (OuterVolumeSpecName: "persistence") pod "de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a" (UID: "de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a"). InnerVolumeSpecName "local-storage04-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:12:28 crc kubenswrapper[5120]: I0316 16:12:28.076259 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a-rabbitmq-tls" (OuterVolumeSpecName: "rabbitmq-tls") pod "de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a" (UID: "de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a"). InnerVolumeSpecName "rabbitmq-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:12:28 crc kubenswrapper[5120]: I0316 16:12:28.078275 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a-pod-info" (OuterVolumeSpecName: "pod-info") pod "de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a" (UID: "de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a"). InnerVolumeSpecName "pod-info". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Mar 16 16:12:28 crc kubenswrapper[5120]: I0316 16:12:28.078335 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a-erlang-cookie-secret" (OuterVolumeSpecName: "erlang-cookie-secret") pod "de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a" (UID: "de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a"). InnerVolumeSpecName "erlang-cookie-secret". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:28 crc kubenswrapper[5120]: I0316 16:12:28.080292 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a-kube-api-access-22p8p" (OuterVolumeSpecName: "kube-api-access-22p8p") pod "de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a" (UID: "de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a"). InnerVolumeSpecName "kube-api-access-22p8p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:12:28 crc kubenswrapper[5120]: I0316 16:12:28.106058 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a-config-data" (OuterVolumeSpecName: "config-data") pod "de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a" (UID: "de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:12:28 crc kubenswrapper[5120]: I0316 16:12:28.120985 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a-server-conf" (OuterVolumeSpecName: "server-conf") pod "de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a" (UID: "de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a"). InnerVolumeSpecName "server-conf". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:12:28 crc kubenswrapper[5120]: I0316 16:12:28.140456 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podUID="dae19557-6584-433e-a345-c373d9e8a4ae" containerName="nova-cell1-novncproxy-novncproxy" probeResult="failure" output="Get \"https://10.217.0.151:6080/vnc_lite.html\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Mar 16 16:12:28 crc kubenswrapper[5120]: I0316 16:12:28.141173 5120 generic.go:358] "Generic (PLEG): container finished" podID="de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a" containerID="3e1a51a3ccfec99f9c00ec78bcede498befec5590f2c8e330edc09f99539166d" exitCode=0 Mar 16 16:12:28 crc kubenswrapper[5120]: I0316 16:12:28.141218 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a","Type":"ContainerDied","Data":"3e1a51a3ccfec99f9c00ec78bcede498befec5590f2c8e330edc09f99539166d"} Mar 16 16:12:28 crc kubenswrapper[5120]: I0316 16:12:28.141275 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a","Type":"ContainerDied","Data":"299e30efddf37a965a735c3b82b811281659827b794fcfaea5d8f8370c8fd82b"} Mar 16 16:12:28 crc kubenswrapper[5120]: I0316 16:12:28.141329 5120 scope.go:117] "RemoveContainer" containerID="3e1a51a3ccfec99f9c00ec78bcede498befec5590f2c8e330edc09f99539166d" Mar 16 16:12:28 crc kubenswrapper[5120]: I0316 16:12:28.141448 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:12:28 crc kubenswrapper[5120]: E0316 16:12:28.143500 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="37accdb48c73bda606e0755923e4c375ae91d06251e5bc9a66dc8f1c54f97f2e" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:12:28 crc kubenswrapper[5120]: E0316 16:12:28.149323 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="37accdb48c73bda606e0755923e4c375ae91d06251e5bc9a66dc8f1c54f97f2e" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:12:28 crc kubenswrapper[5120]: E0316 16:12:28.151009 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="37accdb48c73bda606e0755923e4c375ae91d06251e5bc9a66dc8f1c54f97f2e" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:12:28 crc kubenswrapper[5120]: E0316 16:12:28.151291 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="6a869ae4-5dd4-47d8-aa7e-e519981ee01f" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 16:12:28 crc kubenswrapper[5120]: I0316 16:12:28.168741 5120 scope.go:117] "RemoveContainer" containerID="7d286781c85f27264a622c02590c76a23cfac9e679af6dc9a77a928f3e408dea" Mar 16 16:12:28 crc kubenswrapper[5120]: I0316 16:12:28.174719 5120 reconciler_common.go:299] "Volume detached for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a-erlang-cookie-secret\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:28 crc kubenswrapper[5120]: I0316 16:12:28.174781 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:28 crc kubenswrapper[5120]: I0316 16:12:28.174802 5120 reconciler_common.go:299] "Volume detached for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a-server-conf\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:28 crc kubenswrapper[5120]: I0316 16:12:28.174819 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a-rabbitmq-tls\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:28 crc kubenswrapper[5120]: I0316 16:12:28.174841 5120 reconciler_common.go:299] "Volume detached for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a-pod-info\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:28 crc kubenswrapper[5120]: I0316 16:12:28.174939 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a-rabbitmq-plugins\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:28 crc kubenswrapper[5120]: I0316 16:12:28.174962 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-22p8p\" (UniqueName: \"kubernetes.io/projected/de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a-kube-api-access-22p8p\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:28 crc kubenswrapper[5120]: I0316 16:12:28.175009 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") on node \"crc\" " Mar 16 16:12:28 crc kubenswrapper[5120]: I0316 16:12:28.196453 5120 scope.go:117] "RemoveContainer" containerID="3e1a51a3ccfec99f9c00ec78bcede498befec5590f2c8e330edc09f99539166d" Mar 16 16:12:28 crc kubenswrapper[5120]: E0316 16:12:28.198367 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e1a51a3ccfec99f9c00ec78bcede498befec5590f2c8e330edc09f99539166d\": container with ID starting with 3e1a51a3ccfec99f9c00ec78bcede498befec5590f2c8e330edc09f99539166d not found: ID does not exist" containerID="3e1a51a3ccfec99f9c00ec78bcede498befec5590f2c8e330edc09f99539166d" Mar 16 16:12:28 crc kubenswrapper[5120]: I0316 16:12:28.198446 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e1a51a3ccfec99f9c00ec78bcede498befec5590f2c8e330edc09f99539166d"} err="failed to get container status \"3e1a51a3ccfec99f9c00ec78bcede498befec5590f2c8e330edc09f99539166d\": rpc error: code = NotFound desc = could not find container \"3e1a51a3ccfec99f9c00ec78bcede498befec5590f2c8e330edc09f99539166d\": container with ID starting with 3e1a51a3ccfec99f9c00ec78bcede498befec5590f2c8e330edc09f99539166d not found: ID does not exist" Mar 16 16:12:28 crc kubenswrapper[5120]: I0316 16:12:28.198517 5120 scope.go:117] "RemoveContainer" containerID="7d286781c85f27264a622c02590c76a23cfac9e679af6dc9a77a928f3e408dea" Mar 16 16:12:28 crc kubenswrapper[5120]: E0316 16:12:28.199125 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d286781c85f27264a622c02590c76a23cfac9e679af6dc9a77a928f3e408dea\": container with ID starting with 7d286781c85f27264a622c02590c76a23cfac9e679af6dc9a77a928f3e408dea not found: ID does not exist" containerID="7d286781c85f27264a622c02590c76a23cfac9e679af6dc9a77a928f3e408dea" Mar 16 16:12:28 crc kubenswrapper[5120]: I0316 16:12:28.199203 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d286781c85f27264a622c02590c76a23cfac9e679af6dc9a77a928f3e408dea"} err="failed to get container status \"7d286781c85f27264a622c02590c76a23cfac9e679af6dc9a77a928f3e408dea\": rpc error: code = NotFound desc = could not find container \"7d286781c85f27264a622c02590c76a23cfac9e679af6dc9a77a928f3e408dea\": container with ID starting with 7d286781c85f27264a622c02590c76a23cfac9e679af6dc9a77a928f3e408dea not found: ID does not exist" Mar 16 16:12:28 crc kubenswrapper[5120]: I0316 16:12:28.208953 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a-rabbitmq-confd" (OuterVolumeSpecName: "rabbitmq-confd") pod "de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a" (UID: "de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a"). InnerVolumeSpecName "rabbitmq-confd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:12:28 crc kubenswrapper[5120]: I0316 16:12:28.211901 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage04-crc" (UniqueName: "kubernetes.io/local-volume/local-storage04-crc") on node "crc" Mar 16 16:12:28 crc kubenswrapper[5120]: I0316 16:12:28.277695 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:28 crc kubenswrapper[5120]: I0316 16:12:28.277744 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a-rabbitmq-confd\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:28 crc kubenswrapper[5120]: I0316 16:12:28.489604 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 16:12:28 crc kubenswrapper[5120]: I0316 16:12:28.500791 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 16:12:28 crc kubenswrapper[5120]: I0316 16:12:28.701617 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6d9a26b4-a091-43f5-8625-2194e901021c" path="/var/lib/kubelet/pods/6d9a26b4-a091-43f5-8625-2194e901021c/volumes" Mar 16 16:12:28 crc kubenswrapper[5120]: I0316 16:12:28.703432 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab" path="/var/lib/kubelet/pods/ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab/volumes" Mar 16 16:12:28 crc kubenswrapper[5120]: I0316 16:12:28.706273 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a" path="/var/lib/kubelet/pods/de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a/volumes" Mar 16 16:12:29 crc kubenswrapper[5120]: E0316 16:12:29.633921 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="db11af3fe6b07413600ae44f79a3df378f43385bd524e92444794183d150e508" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:12:29 crc kubenswrapper[5120]: E0316 16:12:29.636736 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="db11af3fe6b07413600ae44f79a3df378f43385bd524e92444794183d150e508" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:12:29 crc kubenswrapper[5120]: E0316 16:12:29.639348 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="db11af3fe6b07413600ae44f79a3df378f43385bd524e92444794183d150e508" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:12:29 crc kubenswrapper[5120]: E0316 16:12:29.639380 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="bce71378-f7b0-4b73-8b4a-711353734319" containerName="nova-cell1-conductor-conductor" probeResult="unknown" Mar 16 16:12:29 crc kubenswrapper[5120]: E0316 16:12:29.812580 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/dns-swift-storage-0: configmap "dns-swift-storage-0" not found Mar 16 16:12:29 crc kubenswrapper[5120]: E0316 16:12:29.812698 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5243aba2-b42a-4e8f-8e9e-22ebe215585e-dns-swift-storage-0 podName:5243aba2-b42a-4e8f-8e9e-22ebe215585e nodeName:}" failed. No retries permitted until 2026-03-16 16:12:30.312668185 +0000 UTC m=+2452.466599872 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "dns-swift-storage-0" (UniqueName: "kubernetes.io/configmap/5243aba2-b42a-4e8f-8e9e-22ebe215585e-dns-swift-storage-0") pod "dnsmasq-dnsmasq-5885f554cc-qwxkj" (UID: "5243aba2-b42a-4e8f-8e9e-22ebe215585e") : configmap "dns-swift-storage-0" not found Mar 16 16:12:30 crc kubenswrapper[5120]: E0316 16:12:30.324445 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/dns-swift-storage-0: configmap "dns-swift-storage-0" not found Mar 16 16:12:30 crc kubenswrapper[5120]: E0316 16:12:30.324526 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5243aba2-b42a-4e8f-8e9e-22ebe215585e-dns-swift-storage-0 podName:5243aba2-b42a-4e8f-8e9e-22ebe215585e nodeName:}" failed. No retries permitted until 2026-03-16 16:12:31.324510144 +0000 UTC m=+2453.478441801 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "dns-swift-storage-0" (UniqueName: "kubernetes.io/configmap/5243aba2-b42a-4e8f-8e9e-22ebe215585e-dns-swift-storage-0") pod "dnsmasq-dnsmasq-5885f554cc-qwxkj" (UID: "5243aba2-b42a-4e8f-8e9e-22ebe215585e") : configmap "dns-swift-storage-0" not found Mar 16 16:12:31 crc kubenswrapper[5120]: I0316 16:12:31.097048 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-qwsw8" Mar 16 16:12:31 crc kubenswrapper[5120]: I0316 16:12:31.193898 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-5885f554cc-qwxkj"] Mar 16 16:12:31 crc kubenswrapper[5120]: I0316 16:12:31.194167 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5885f554cc-qwxkj" podUID="5243aba2-b42a-4e8f-8e9e-22ebe215585e" containerName="dnsmasq-dns" containerID="cri-o://c01a04ee6d2c12d188d4c5d55213b4b0c038752d142bf15efe8bee2938820f71" gracePeriod=10 Mar 16 16:12:31 crc kubenswrapper[5120]: E0316 16:12:31.352258 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/dns-swift-storage-0: configmap "dns-swift-storage-0" not found Mar 16 16:12:31 crc kubenswrapper[5120]: E0316 16:12:31.352551 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5243aba2-b42a-4e8f-8e9e-22ebe215585e-dns-swift-storage-0 podName:5243aba2-b42a-4e8f-8e9e-22ebe215585e nodeName:}" failed. No retries permitted until 2026-03-16 16:12:33.352531268 +0000 UTC m=+2455.506462925 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "dns-swift-storage-0" (UniqueName: "kubernetes.io/configmap/5243aba2-b42a-4e8f-8e9e-22ebe215585e-dns-swift-storage-0") pod "dnsmasq-dnsmasq-5885f554cc-qwxkj" (UID: "5243aba2-b42a-4e8f-8e9e-22ebe215585e") : configmap "dns-swift-storage-0" not found Mar 16 16:12:31 crc kubenswrapper[5120]: I0316 16:12:31.664059 5120 scope.go:117] "RemoveContainer" containerID="bc2df124cc6ad146d7c7dd2115ac815986fb62978d38895f6d345a4a9b14dbd8" Mar 16 16:12:31 crc kubenswrapper[5120]: E0316 16:12:31.664413 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:12:31 crc kubenswrapper[5120]: I0316 16:12:31.691369 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5885f554cc-qwxkj" Mar 16 16:12:31 crc kubenswrapper[5120]: I0316 16:12:31.761687 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/5243aba2-b42a-4e8f-8e9e-22ebe215585e-dns-swift-storage-0\") pod \"5243aba2-b42a-4e8f-8e9e-22ebe215585e\" (UID: \"5243aba2-b42a-4e8f-8e9e-22ebe215585e\") " Mar 16 16:12:31 crc kubenswrapper[5120]: I0316 16:12:31.761801 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/5243aba2-b42a-4e8f-8e9e-22ebe215585e-dnsmasq-svc\") pod \"5243aba2-b42a-4e8f-8e9e-22ebe215585e\" (UID: \"5243aba2-b42a-4e8f-8e9e-22ebe215585e\") " Mar 16 16:12:31 crc kubenswrapper[5120]: I0316 16:12:31.762141 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5243aba2-b42a-4e8f-8e9e-22ebe215585e-config\") pod \"5243aba2-b42a-4e8f-8e9e-22ebe215585e\" (UID: \"5243aba2-b42a-4e8f-8e9e-22ebe215585e\") " Mar 16 16:12:31 crc kubenswrapper[5120]: I0316 16:12:31.762213 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w6m5x\" (UniqueName: \"kubernetes.io/projected/5243aba2-b42a-4e8f-8e9e-22ebe215585e-kube-api-access-w6m5x\") pod \"5243aba2-b42a-4e8f-8e9e-22ebe215585e\" (UID: \"5243aba2-b42a-4e8f-8e9e-22ebe215585e\") " Mar 16 16:12:31 crc kubenswrapper[5120]: I0316 16:12:31.775025 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5243aba2-b42a-4e8f-8e9e-22ebe215585e-kube-api-access-w6m5x" (OuterVolumeSpecName: "kube-api-access-w6m5x") pod "5243aba2-b42a-4e8f-8e9e-22ebe215585e" (UID: "5243aba2-b42a-4e8f-8e9e-22ebe215585e"). InnerVolumeSpecName "kube-api-access-w6m5x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:12:31 crc kubenswrapper[5120]: I0316 16:12:31.817035 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5243aba2-b42a-4e8f-8e9e-22ebe215585e-config" (OuterVolumeSpecName: "config") pod "5243aba2-b42a-4e8f-8e9e-22ebe215585e" (UID: "5243aba2-b42a-4e8f-8e9e-22ebe215585e"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:12:31 crc kubenswrapper[5120]: I0316 16:12:31.817244 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5243aba2-b42a-4e8f-8e9e-22ebe215585e-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "5243aba2-b42a-4e8f-8e9e-22ebe215585e" (UID: "5243aba2-b42a-4e8f-8e9e-22ebe215585e"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:12:31 crc kubenswrapper[5120]: I0316 16:12:31.822210 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5243aba2-b42a-4e8f-8e9e-22ebe215585e-dns-swift-storage-0" (OuterVolumeSpecName: "dns-swift-storage-0") pod "5243aba2-b42a-4e8f-8e9e-22ebe215585e" (UID: "5243aba2-b42a-4e8f-8e9e-22ebe215585e"). InnerVolumeSpecName "dns-swift-storage-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:12:31 crc kubenswrapper[5120]: I0316 16:12:31.865080 5120 reconciler_common.go:299] "Volume detached for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/5243aba2-b42a-4e8f-8e9e-22ebe215585e-dns-swift-storage-0\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:31 crc kubenswrapper[5120]: I0316 16:12:31.865108 5120 reconciler_common.go:299] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/5243aba2-b42a-4e8f-8e9e-22ebe215585e-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:31 crc kubenswrapper[5120]: I0316 16:12:31.865117 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5243aba2-b42a-4e8f-8e9e-22ebe215585e-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:31 crc kubenswrapper[5120]: I0316 16:12:31.865125 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w6m5x\" (UniqueName: \"kubernetes.io/projected/5243aba2-b42a-4e8f-8e9e-22ebe215585e-kube-api-access-w6m5x\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:32 crc kubenswrapper[5120]: I0316 16:12:32.201164 5120 generic.go:358] "Generic (PLEG): container finished" podID="5243aba2-b42a-4e8f-8e9e-22ebe215585e" containerID="c01a04ee6d2c12d188d4c5d55213b4b0c038752d142bf15efe8bee2938820f71" exitCode=0 Mar 16 16:12:32 crc kubenswrapper[5120]: I0316 16:12:32.201279 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5885f554cc-qwxkj" event={"ID":"5243aba2-b42a-4e8f-8e9e-22ebe215585e","Type":"ContainerDied","Data":"c01a04ee6d2c12d188d4c5d55213b4b0c038752d142bf15efe8bee2938820f71"} Mar 16 16:12:32 crc kubenswrapper[5120]: I0316 16:12:32.201371 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5885f554cc-qwxkj" event={"ID":"5243aba2-b42a-4e8f-8e9e-22ebe215585e","Type":"ContainerDied","Data":"15f2444b22f0c036de31d84b1fd55a4143b42e6f19f3fdd9e31f656200b7b380"} Mar 16 16:12:32 crc kubenswrapper[5120]: I0316 16:12:32.201368 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5885f554cc-qwxkj" Mar 16 16:12:32 crc kubenswrapper[5120]: I0316 16:12:32.201424 5120 scope.go:117] "RemoveContainer" containerID="c01a04ee6d2c12d188d4c5d55213b4b0c038752d142bf15efe8bee2938820f71" Mar 16 16:12:32 crc kubenswrapper[5120]: I0316 16:12:32.235563 5120 scope.go:117] "RemoveContainer" containerID="4a26930fda821322f4a86ee8d32b6d51dfcc2737a5692c286fd2a8b121104552" Mar 16 16:12:32 crc kubenswrapper[5120]: I0316 16:12:32.261813 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-5885f554cc-qwxkj"] Mar 16 16:12:32 crc kubenswrapper[5120]: I0316 16:12:32.275176 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-5885f554cc-qwxkj"] Mar 16 16:12:32 crc kubenswrapper[5120]: I0316 16:12:32.279747 5120 scope.go:117] "RemoveContainer" containerID="c01a04ee6d2c12d188d4c5d55213b4b0c038752d142bf15efe8bee2938820f71" Mar 16 16:12:32 crc kubenswrapper[5120]: E0316 16:12:32.280218 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c01a04ee6d2c12d188d4c5d55213b4b0c038752d142bf15efe8bee2938820f71\": container with ID starting with c01a04ee6d2c12d188d4c5d55213b4b0c038752d142bf15efe8bee2938820f71 not found: ID does not exist" containerID="c01a04ee6d2c12d188d4c5d55213b4b0c038752d142bf15efe8bee2938820f71" Mar 16 16:12:32 crc kubenswrapper[5120]: I0316 16:12:32.280278 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c01a04ee6d2c12d188d4c5d55213b4b0c038752d142bf15efe8bee2938820f71"} err="failed to get container status \"c01a04ee6d2c12d188d4c5d55213b4b0c038752d142bf15efe8bee2938820f71\": rpc error: code = NotFound desc = could not find container \"c01a04ee6d2c12d188d4c5d55213b4b0c038752d142bf15efe8bee2938820f71\": container with ID starting with c01a04ee6d2c12d188d4c5d55213b4b0c038752d142bf15efe8bee2938820f71 not found: ID does not exist" Mar 16 16:12:32 crc kubenswrapper[5120]: I0316 16:12:32.280312 5120 scope.go:117] "RemoveContainer" containerID="4a26930fda821322f4a86ee8d32b6d51dfcc2737a5692c286fd2a8b121104552" Mar 16 16:12:32 crc kubenswrapper[5120]: E0316 16:12:32.280714 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4a26930fda821322f4a86ee8d32b6d51dfcc2737a5692c286fd2a8b121104552\": container with ID starting with 4a26930fda821322f4a86ee8d32b6d51dfcc2737a5692c286fd2a8b121104552 not found: ID does not exist" containerID="4a26930fda821322f4a86ee8d32b6d51dfcc2737a5692c286fd2a8b121104552" Mar 16 16:12:32 crc kubenswrapper[5120]: I0316 16:12:32.280822 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a26930fda821322f4a86ee8d32b6d51dfcc2737a5692c286fd2a8b121104552"} err="failed to get container status \"4a26930fda821322f4a86ee8d32b6d51dfcc2737a5692c286fd2a8b121104552\": rpc error: code = NotFound desc = could not find container \"4a26930fda821322f4a86ee8d32b6d51dfcc2737a5692c286fd2a8b121104552\": container with ID starting with 4a26930fda821322f4a86ee8d32b6d51dfcc2737a5692c286fd2a8b121104552 not found: ID does not exist" Mar 16 16:12:32 crc kubenswrapper[5120]: E0316 16:12:32.408079 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="0694d284d33b8f4728b5b5db2443c16f6b7c4ab92062463e2013167e4b4a7dc6" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:12:32 crc kubenswrapper[5120]: E0316 16:12:32.410499 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="0694d284d33b8f4728b5b5db2443c16f6b7c4ab92062463e2013167e4b4a7dc6" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:12:32 crc kubenswrapper[5120]: E0316 16:12:32.412736 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="0694d284d33b8f4728b5b5db2443c16f6b7c4ab92062463e2013167e4b4a7dc6" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:12:32 crc kubenswrapper[5120]: E0316 16:12:32.412815 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="bba65a98-1383-4c8c-995a-b212b232d1f8" containerName="nova-scheduler-scheduler" probeResult="unknown" Mar 16 16:12:32 crc kubenswrapper[5120]: I0316 16:12:32.677872 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5243aba2-b42a-4e8f-8e9e-22ebe215585e" path="/var/lib/kubelet/pods/5243aba2-b42a-4e8f-8e9e-22ebe215585e/volumes" Mar 16 16:12:33 crc kubenswrapper[5120]: E0316 16:12:33.141473 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="37accdb48c73bda606e0755923e4c375ae91d06251e5bc9a66dc8f1c54f97f2e" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:12:33 crc kubenswrapper[5120]: E0316 16:12:33.143702 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="37accdb48c73bda606e0755923e4c375ae91d06251e5bc9a66dc8f1c54f97f2e" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:12:33 crc kubenswrapper[5120]: E0316 16:12:33.146301 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="37accdb48c73bda606e0755923e4c375ae91d06251e5bc9a66dc8f1c54f97f2e" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:12:33 crc kubenswrapper[5120]: E0316 16:12:33.146798 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="6a869ae4-5dd4-47d8-aa7e-e519981ee01f" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 16:12:34 crc kubenswrapper[5120]: I0316 16:12:34.133314 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-744867f48f-8dw6x" Mar 16 16:12:34 crc kubenswrapper[5120]: I0316 16:12:34.231251 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0df9d7ea-2a19-45b4-b350-7c0e91a5d960-logs\") pod \"0df9d7ea-2a19-45b4-b350-7c0e91a5d960\" (UID: \"0df9d7ea-2a19-45b4-b350-7c0e91a5d960\") " Mar 16 16:12:34 crc kubenswrapper[5120]: I0316 16:12:34.231471 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0df9d7ea-2a19-45b4-b350-7c0e91a5d960-config-data\") pod \"0df9d7ea-2a19-45b4-b350-7c0e91a5d960\" (UID: \"0df9d7ea-2a19-45b4-b350-7c0e91a5d960\") " Mar 16 16:12:34 crc kubenswrapper[5120]: I0316 16:12:34.231499 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/0df9d7ea-2a19-45b4-b350-7c0e91a5d960-config-data-custom\") pod \"0df9d7ea-2a19-45b4-b350-7c0e91a5d960\" (UID: \"0df9d7ea-2a19-45b4-b350-7c0e91a5d960\") " Mar 16 16:12:34 crc kubenswrapper[5120]: I0316 16:12:34.231521 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hq7c5\" (UniqueName: \"kubernetes.io/projected/0df9d7ea-2a19-45b4-b350-7c0e91a5d960-kube-api-access-hq7c5\") pod \"0df9d7ea-2a19-45b4-b350-7c0e91a5d960\" (UID: \"0df9d7ea-2a19-45b4-b350-7c0e91a5d960\") " Mar 16 16:12:34 crc kubenswrapper[5120]: I0316 16:12:34.231654 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0df9d7ea-2a19-45b4-b350-7c0e91a5d960-combined-ca-bundle\") pod \"0df9d7ea-2a19-45b4-b350-7c0e91a5d960\" (UID: \"0df9d7ea-2a19-45b4-b350-7c0e91a5d960\") " Mar 16 16:12:34 crc kubenswrapper[5120]: I0316 16:12:34.232126 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0df9d7ea-2a19-45b4-b350-7c0e91a5d960-logs" (OuterVolumeSpecName: "logs") pod "0df9d7ea-2a19-45b4-b350-7c0e91a5d960" (UID: "0df9d7ea-2a19-45b4-b350-7c0e91a5d960"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:12:34 crc kubenswrapper[5120]: I0316 16:12:34.233883 5120 generic.go:358] "Generic (PLEG): container finished" podID="0df9d7ea-2a19-45b4-b350-7c0e91a5d960" containerID="8df698b6cb3c091ed64b52203e2b60664ba4adfd3d06071c513279d2f35200db" exitCode=137 Mar 16 16:12:34 crc kubenswrapper[5120]: I0316 16:12:34.234010 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-744867f48f-8dw6x" Mar 16 16:12:34 crc kubenswrapper[5120]: I0316 16:12:34.234239 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-744867f48f-8dw6x" event={"ID":"0df9d7ea-2a19-45b4-b350-7c0e91a5d960","Type":"ContainerDied","Data":"8df698b6cb3c091ed64b52203e2b60664ba4adfd3d06071c513279d2f35200db"} Mar 16 16:12:34 crc kubenswrapper[5120]: I0316 16:12:34.234274 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-744867f48f-8dw6x" event={"ID":"0df9d7ea-2a19-45b4-b350-7c0e91a5d960","Type":"ContainerDied","Data":"5e6e98273fac7d289d1814f487137aa6a3ca1c4e3e6f8d0bb8e9c07e5ec3f387"} Mar 16 16:12:34 crc kubenswrapper[5120]: I0316 16:12:34.234294 5120 scope.go:117] "RemoveContainer" containerID="8df698b6cb3c091ed64b52203e2b60664ba4adfd3d06071c513279d2f35200db" Mar 16 16:12:34 crc kubenswrapper[5120]: I0316 16:12:34.247640 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0df9d7ea-2a19-45b4-b350-7c0e91a5d960-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "0df9d7ea-2a19-45b4-b350-7c0e91a5d960" (UID: "0df9d7ea-2a19-45b4-b350-7c0e91a5d960"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:34 crc kubenswrapper[5120]: I0316 16:12:34.248193 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0df9d7ea-2a19-45b4-b350-7c0e91a5d960-kube-api-access-hq7c5" (OuterVolumeSpecName: "kube-api-access-hq7c5") pod "0df9d7ea-2a19-45b4-b350-7c0e91a5d960" (UID: "0df9d7ea-2a19-45b4-b350-7c0e91a5d960"). InnerVolumeSpecName "kube-api-access-hq7c5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:12:34 crc kubenswrapper[5120]: I0316 16:12:34.262413 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0df9d7ea-2a19-45b4-b350-7c0e91a5d960-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "0df9d7ea-2a19-45b4-b350-7c0e91a5d960" (UID: "0df9d7ea-2a19-45b4-b350-7c0e91a5d960"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:34 crc kubenswrapper[5120]: I0316 16:12:34.319878 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0df9d7ea-2a19-45b4-b350-7c0e91a5d960-config-data" (OuterVolumeSpecName: "config-data") pod "0df9d7ea-2a19-45b4-b350-7c0e91a5d960" (UID: "0df9d7ea-2a19-45b4-b350-7c0e91a5d960"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:34 crc kubenswrapper[5120]: I0316 16:12:34.328320 5120 scope.go:117] "RemoveContainer" containerID="10cfc1214c4cb2003680313fe2c02a4e30f09769b0b3e1e139eb0865bb174e51" Mar 16 16:12:34 crc kubenswrapper[5120]: I0316 16:12:34.333675 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0df9d7ea-2a19-45b4-b350-7c0e91a5d960-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:34 crc kubenswrapper[5120]: I0316 16:12:34.333709 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/0df9d7ea-2a19-45b4-b350-7c0e91a5d960-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:34 crc kubenswrapper[5120]: I0316 16:12:34.333726 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hq7c5\" (UniqueName: \"kubernetes.io/projected/0df9d7ea-2a19-45b4-b350-7c0e91a5d960-kube-api-access-hq7c5\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:34 crc kubenswrapper[5120]: I0316 16:12:34.333739 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0df9d7ea-2a19-45b4-b350-7c0e91a5d960-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:34 crc kubenswrapper[5120]: I0316 16:12:34.333750 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0df9d7ea-2a19-45b4-b350-7c0e91a5d960-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:34 crc kubenswrapper[5120]: I0316 16:12:34.354482 5120 scope.go:117] "RemoveContainer" containerID="8df698b6cb3c091ed64b52203e2b60664ba4adfd3d06071c513279d2f35200db" Mar 16 16:12:34 crc kubenswrapper[5120]: E0316 16:12:34.354913 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8df698b6cb3c091ed64b52203e2b60664ba4adfd3d06071c513279d2f35200db\": container with ID starting with 8df698b6cb3c091ed64b52203e2b60664ba4adfd3d06071c513279d2f35200db not found: ID does not exist" containerID="8df698b6cb3c091ed64b52203e2b60664ba4adfd3d06071c513279d2f35200db" Mar 16 16:12:34 crc kubenswrapper[5120]: I0316 16:12:34.354985 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8df698b6cb3c091ed64b52203e2b60664ba4adfd3d06071c513279d2f35200db"} err="failed to get container status \"8df698b6cb3c091ed64b52203e2b60664ba4adfd3d06071c513279d2f35200db\": rpc error: code = NotFound desc = could not find container \"8df698b6cb3c091ed64b52203e2b60664ba4adfd3d06071c513279d2f35200db\": container with ID starting with 8df698b6cb3c091ed64b52203e2b60664ba4adfd3d06071c513279d2f35200db not found: ID does not exist" Mar 16 16:12:34 crc kubenswrapper[5120]: I0316 16:12:34.355027 5120 scope.go:117] "RemoveContainer" containerID="10cfc1214c4cb2003680313fe2c02a4e30f09769b0b3e1e139eb0865bb174e51" Mar 16 16:12:34 crc kubenswrapper[5120]: E0316 16:12:34.355526 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"10cfc1214c4cb2003680313fe2c02a4e30f09769b0b3e1e139eb0865bb174e51\": container with ID starting with 10cfc1214c4cb2003680313fe2c02a4e30f09769b0b3e1e139eb0865bb174e51 not found: ID does not exist" containerID="10cfc1214c4cb2003680313fe2c02a4e30f09769b0b3e1e139eb0865bb174e51" Mar 16 16:12:34 crc kubenswrapper[5120]: I0316 16:12:34.355559 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10cfc1214c4cb2003680313fe2c02a4e30f09769b0b3e1e139eb0865bb174e51"} err="failed to get container status \"10cfc1214c4cb2003680313fe2c02a4e30f09769b0b3e1e139eb0865bb174e51\": rpc error: code = NotFound desc = could not find container \"10cfc1214c4cb2003680313fe2c02a4e30f09769b0b3e1e139eb0865bb174e51\": container with ID starting with 10cfc1214c4cb2003680313fe2c02a4e30f09769b0b3e1e139eb0865bb174e51 not found: ID does not exist" Mar 16 16:12:34 crc kubenswrapper[5120]: I0316 16:12:34.572104 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-744867f48f-8dw6x"] Mar 16 16:12:34 crc kubenswrapper[5120]: I0316 16:12:34.580464 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-worker-744867f48f-8dw6x"] Mar 16 16:12:34 crc kubenswrapper[5120]: E0316 16:12:34.633309 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="db11af3fe6b07413600ae44f79a3df378f43385bd524e92444794183d150e508" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:12:34 crc kubenswrapper[5120]: E0316 16:12:34.635340 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="db11af3fe6b07413600ae44f79a3df378f43385bd524e92444794183d150e508" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:12:34 crc kubenswrapper[5120]: E0316 16:12:34.636819 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="db11af3fe6b07413600ae44f79a3df378f43385bd524e92444794183d150e508" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:12:34 crc kubenswrapper[5120]: E0316 16:12:34.636855 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="bce71378-f7b0-4b73-8b4a-711353734319" containerName="nova-cell1-conductor-conductor" probeResult="unknown" Mar 16 16:12:34 crc kubenswrapper[5120]: E0316 16:12:34.642846 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 16:12:34 crc kubenswrapper[5120]: E0316 16:12:34.642943 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bba65a98-1383-4c8c-995a-b212b232d1f8-combined-ca-bundle podName:bba65a98-1383-4c8c-995a-b212b232d1f8 nodeName:}" failed. No retries permitted until 2026-03-16 16:12:50.642917759 +0000 UTC m=+2472.796849436 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/bba65a98-1383-4c8c-995a-b212b232d1f8-combined-ca-bundle") pod "nova-scheduler-0" (UID: "bba65a98-1383-4c8c-995a-b212b232d1f8") : secret "combined-ca-bundle" not found Mar 16 16:12:34 crc kubenswrapper[5120]: I0316 16:12:34.674319 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0df9d7ea-2a19-45b4-b350-7c0e91a5d960" path="/var/lib/kubelet/pods/0df9d7ea-2a19-45b4-b350-7c0e91a5d960/volumes" Mar 16 16:12:34 crc kubenswrapper[5120]: E0316 16:12:34.949022 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 16:12:34 crc kubenswrapper[5120]: E0316 16:12:34.949171 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cinder-scheduler-config-data: secret "cinder-scheduler-config-data" not found Mar 16 16:12:34 crc kubenswrapper[5120]: E0316 16:12:34.949219 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cinder-scripts: secret "cinder-scripts" not found Mar 16 16:12:34 crc kubenswrapper[5120]: E0316 16:12:34.949183 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96d66c8e-8cdb-462c-a302-c85e581db5ad-combined-ca-bundle podName:96d66c8e-8cdb-462c-a302-c85e581db5ad nodeName:}" failed. No retries permitted until 2026-03-16 16:12:50.949149488 +0000 UTC m=+2473.103081175 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/96d66c8e-8cdb-462c-a302-c85e581db5ad-combined-ca-bundle") pod "cinder-scheduler-0" (UID: "96d66c8e-8cdb-462c-a302-c85e581db5ad") : secret "combined-ca-bundle" not found Mar 16 16:12:34 crc kubenswrapper[5120]: E0316 16:12:34.949270 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96d66c8e-8cdb-462c-a302-c85e581db5ad-config-data-custom podName:96d66c8e-8cdb-462c-a302-c85e581db5ad nodeName:}" failed. No retries permitted until 2026-03-16 16:12:50.949249341 +0000 UTC m=+2473.103180998 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "config-data-custom" (UniqueName: "kubernetes.io/secret/96d66c8e-8cdb-462c-a302-c85e581db5ad-config-data-custom") pod "cinder-scheduler-0" (UID: "96d66c8e-8cdb-462c-a302-c85e581db5ad") : secret "cinder-scheduler-config-data" not found Mar 16 16:12:34 crc kubenswrapper[5120]: E0316 16:12:34.949056 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cinder-config-data: secret "cinder-config-data" not found Mar 16 16:12:34 crc kubenswrapper[5120]: E0316 16:12:34.949310 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96d66c8e-8cdb-462c-a302-c85e581db5ad-scripts podName:96d66c8e-8cdb-462c-a302-c85e581db5ad nodeName:}" failed. No retries permitted until 2026-03-16 16:12:50.949303072 +0000 UTC m=+2473.103234729 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "scripts" (UniqueName: "kubernetes.io/secret/96d66c8e-8cdb-462c-a302-c85e581db5ad-scripts") pod "cinder-scheduler-0" (UID: "96d66c8e-8cdb-462c-a302-c85e581db5ad") : secret "cinder-scripts" not found Mar 16 16:12:34 crc kubenswrapper[5120]: E0316 16:12:34.949320 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96d66c8e-8cdb-462c-a302-c85e581db5ad-config-data podName:96d66c8e-8cdb-462c-a302-c85e581db5ad nodeName:}" failed. No retries permitted until 2026-03-16 16:12:50.949316062 +0000 UTC m=+2473.103247719 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/secret/96d66c8e-8cdb-462c-a302-c85e581db5ad-config-data") pod "cinder-scheduler-0" (UID: "96d66c8e-8cdb-462c-a302-c85e581db5ad") : secret "cinder-config-data" not found Mar 16 16:12:36 crc kubenswrapper[5120]: I0316 16:12:36.260577 5120 generic.go:358] "Generic (PLEG): container finished" podID="8f51149f-2af3-4bb8-ab7a-1b94ca6754e5" containerID="a303d469a3addcf7c18b6951abfbc9df1ca852f6f924702095cd0344e3fbcec2" exitCode=137 Mar 16 16:12:36 crc kubenswrapper[5120]: I0316 16:12:36.260729 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-74b77cc694-lzqfl" event={"ID":"8f51149f-2af3-4bb8-ab7a-1b94ca6754e5","Type":"ContainerDied","Data":"a303d469a3addcf7c18b6951abfbc9df1ca852f6f924702095cd0344e3fbcec2"} Mar 16 16:12:36 crc kubenswrapper[5120]: I0316 16:12:36.437635 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-74b77cc694-lzqfl" Mar 16 16:12:36 crc kubenswrapper[5120]: I0316 16:12:36.580115 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8f51149f-2af3-4bb8-ab7a-1b94ca6754e5-combined-ca-bundle\") pod \"8f51149f-2af3-4bb8-ab7a-1b94ca6754e5\" (UID: \"8f51149f-2af3-4bb8-ab7a-1b94ca6754e5\") " Mar 16 16:12:36 crc kubenswrapper[5120]: I0316 16:12:36.580270 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/8f51149f-2af3-4bb8-ab7a-1b94ca6754e5-config-data-custom\") pod \"8f51149f-2af3-4bb8-ab7a-1b94ca6754e5\" (UID: \"8f51149f-2af3-4bb8-ab7a-1b94ca6754e5\") " Mar 16 16:12:36 crc kubenswrapper[5120]: I0316 16:12:36.580362 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nkxn7\" (UniqueName: \"kubernetes.io/projected/8f51149f-2af3-4bb8-ab7a-1b94ca6754e5-kube-api-access-nkxn7\") pod \"8f51149f-2af3-4bb8-ab7a-1b94ca6754e5\" (UID: \"8f51149f-2af3-4bb8-ab7a-1b94ca6754e5\") " Mar 16 16:12:36 crc kubenswrapper[5120]: I0316 16:12:36.580422 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8f51149f-2af3-4bb8-ab7a-1b94ca6754e5-logs\") pod \"8f51149f-2af3-4bb8-ab7a-1b94ca6754e5\" (UID: \"8f51149f-2af3-4bb8-ab7a-1b94ca6754e5\") " Mar 16 16:12:36 crc kubenswrapper[5120]: I0316 16:12:36.580651 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8f51149f-2af3-4bb8-ab7a-1b94ca6754e5-config-data\") pod \"8f51149f-2af3-4bb8-ab7a-1b94ca6754e5\" (UID: \"8f51149f-2af3-4bb8-ab7a-1b94ca6754e5\") " Mar 16 16:12:36 crc kubenswrapper[5120]: I0316 16:12:36.581338 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f51149f-2af3-4bb8-ab7a-1b94ca6754e5-logs" (OuterVolumeSpecName: "logs") pod "8f51149f-2af3-4bb8-ab7a-1b94ca6754e5" (UID: "8f51149f-2af3-4bb8-ab7a-1b94ca6754e5"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:12:36 crc kubenswrapper[5120]: I0316 16:12:36.599215 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f51149f-2af3-4bb8-ab7a-1b94ca6754e5-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "8f51149f-2af3-4bb8-ab7a-1b94ca6754e5" (UID: "8f51149f-2af3-4bb8-ab7a-1b94ca6754e5"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:36 crc kubenswrapper[5120]: I0316 16:12:36.601153 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f51149f-2af3-4bb8-ab7a-1b94ca6754e5-kube-api-access-nkxn7" (OuterVolumeSpecName: "kube-api-access-nkxn7") pod "8f51149f-2af3-4bb8-ab7a-1b94ca6754e5" (UID: "8f51149f-2af3-4bb8-ab7a-1b94ca6754e5"). InnerVolumeSpecName "kube-api-access-nkxn7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:12:36 crc kubenswrapper[5120]: I0316 16:12:36.608971 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f51149f-2af3-4bb8-ab7a-1b94ca6754e5-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "8f51149f-2af3-4bb8-ab7a-1b94ca6754e5" (UID: "8f51149f-2af3-4bb8-ab7a-1b94ca6754e5"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:36 crc kubenswrapper[5120]: I0316 16:12:36.637228 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f51149f-2af3-4bb8-ab7a-1b94ca6754e5-config-data" (OuterVolumeSpecName: "config-data") pod "8f51149f-2af3-4bb8-ab7a-1b94ca6754e5" (UID: "8f51149f-2af3-4bb8-ab7a-1b94ca6754e5"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:36 crc kubenswrapper[5120]: I0316 16:12:36.685475 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8f51149f-2af3-4bb8-ab7a-1b94ca6754e5-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:36 crc kubenswrapper[5120]: I0316 16:12:36.685519 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/8f51149f-2af3-4bb8-ab7a-1b94ca6754e5-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:36 crc kubenswrapper[5120]: I0316 16:12:36.685538 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nkxn7\" (UniqueName: \"kubernetes.io/projected/8f51149f-2af3-4bb8-ab7a-1b94ca6754e5-kube-api-access-nkxn7\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:36 crc kubenswrapper[5120]: I0316 16:12:36.685555 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8f51149f-2af3-4bb8-ab7a-1b94ca6754e5-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:36 crc kubenswrapper[5120]: I0316 16:12:36.685572 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8f51149f-2af3-4bb8-ab7a-1b94ca6754e5-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:37 crc kubenswrapper[5120]: I0316 16:12:37.278223 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-74b77cc694-lzqfl" event={"ID":"8f51149f-2af3-4bb8-ab7a-1b94ca6754e5","Type":"ContainerDied","Data":"7bf4ebb0a06adf7468b5b33f6834dd10e17444e396d4d88a028fb4f1e5ded7f1"} Mar 16 16:12:37 crc kubenswrapper[5120]: I0316 16:12:37.278309 5120 scope.go:117] "RemoveContainer" containerID="a303d469a3addcf7c18b6951abfbc9df1ca852f6f924702095cd0344e3fbcec2" Mar 16 16:12:37 crc kubenswrapper[5120]: I0316 16:12:37.278498 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-74b77cc694-lzqfl" Mar 16 16:12:37 crc kubenswrapper[5120]: I0316 16:12:37.317372 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-74b77cc694-lzqfl"] Mar 16 16:12:37 crc kubenswrapper[5120]: I0316 16:12:37.330355 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-74b77cc694-lzqfl"] Mar 16 16:12:37 crc kubenswrapper[5120]: I0316 16:12:37.331406 5120 scope.go:117] "RemoveContainer" containerID="f51657860a93464c474c6250eb0e7edd01c80756a4dd39fe9f29602c9058027d" Mar 16 16:12:37 crc kubenswrapper[5120]: E0316 16:12:37.409059 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="0694d284d33b8f4728b5b5db2443c16f6b7c4ab92062463e2013167e4b4a7dc6" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:12:37 crc kubenswrapper[5120]: E0316 16:12:37.411577 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="0694d284d33b8f4728b5b5db2443c16f6b7c4ab92062463e2013167e4b4a7dc6" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:12:37 crc kubenswrapper[5120]: E0316 16:12:37.413435 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="0694d284d33b8f4728b5b5db2443c16f6b7c4ab92062463e2013167e4b4a7dc6" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:12:37 crc kubenswrapper[5120]: E0316 16:12:37.413563 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="bba65a98-1383-4c8c-995a-b212b232d1f8" containerName="nova-scheduler-scheduler" probeResult="unknown" Mar 16 16:12:38 crc kubenswrapper[5120]: E0316 16:12:38.142074 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="37accdb48c73bda606e0755923e4c375ae91d06251e5bc9a66dc8f1c54f97f2e" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:12:38 crc kubenswrapper[5120]: E0316 16:12:38.143578 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="37accdb48c73bda606e0755923e4c375ae91d06251e5bc9a66dc8f1c54f97f2e" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:12:38 crc kubenswrapper[5120]: E0316 16:12:38.144738 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="37accdb48c73bda606e0755923e4c375ae91d06251e5bc9a66dc8f1c54f97f2e" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:12:38 crc kubenswrapper[5120]: E0316 16:12:38.144785 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="6a869ae4-5dd4-47d8-aa7e-e519981ee01f" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 16:12:38 crc kubenswrapper[5120]: I0316 16:12:38.690690 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8f51149f-2af3-4bb8-ab7a-1b94ca6754e5" path="/var/lib/kubelet/pods/8f51149f-2af3-4bb8-ab7a-1b94ca6754e5/volumes" Mar 16 16:12:39 crc kubenswrapper[5120]: E0316 16:12:39.635578 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="db11af3fe6b07413600ae44f79a3df378f43385bd524e92444794183d150e508" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:12:39 crc kubenswrapper[5120]: E0316 16:12:39.637965 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="db11af3fe6b07413600ae44f79a3df378f43385bd524e92444794183d150e508" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:12:39 crc kubenswrapper[5120]: E0316 16:12:39.640405 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="db11af3fe6b07413600ae44f79a3df378f43385bd524e92444794183d150e508" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:12:39 crc kubenswrapper[5120]: E0316 16:12:39.640471 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="bce71378-f7b0-4b73-8b4a-711353734319" containerName="nova-cell1-conductor-conductor" probeResult="unknown" Mar 16 16:12:42 crc kubenswrapper[5120]: E0316 16:12:42.409539 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="0694d284d33b8f4728b5b5db2443c16f6b7c4ab92062463e2013167e4b4a7dc6" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:12:42 crc kubenswrapper[5120]: E0316 16:12:42.412484 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="0694d284d33b8f4728b5b5db2443c16f6b7c4ab92062463e2013167e4b4a7dc6" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:12:42 crc kubenswrapper[5120]: E0316 16:12:42.415206 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="0694d284d33b8f4728b5b5db2443c16f6b7c4ab92062463e2013167e4b4a7dc6" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:12:42 crc kubenswrapper[5120]: E0316 16:12:42.415270 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="bba65a98-1383-4c8c-995a-b212b232d1f8" containerName="nova-scheduler-scheduler" probeResult="unknown" Mar 16 16:12:43 crc kubenswrapper[5120]: E0316 16:12:43.141822 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="37accdb48c73bda606e0755923e4c375ae91d06251e5bc9a66dc8f1c54f97f2e" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:12:43 crc kubenswrapper[5120]: E0316 16:12:43.143205 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="37accdb48c73bda606e0755923e4c375ae91d06251e5bc9a66dc8f1c54f97f2e" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:12:43 crc kubenswrapper[5120]: E0316 16:12:43.144894 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="37accdb48c73bda606e0755923e4c375ae91d06251e5bc9a66dc8f1c54f97f2e" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:12:43 crc kubenswrapper[5120]: E0316 16:12:43.144939 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="6a869ae4-5dd4-47d8-aa7e-e519981ee01f" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 16:12:43 crc kubenswrapper[5120]: I0316 16:12:43.382991 5120 generic.go:358] "Generic (PLEG): container finished" podID="6a869ae4-5dd4-47d8-aa7e-e519981ee01f" containerID="37accdb48c73bda606e0755923e4c375ae91d06251e5bc9a66dc8f1c54f97f2e" exitCode=137 Mar 16 16:12:43 crc kubenswrapper[5120]: I0316 16:12:43.383089 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"6a869ae4-5dd4-47d8-aa7e-e519981ee01f","Type":"ContainerDied","Data":"37accdb48c73bda606e0755923e4c375ae91d06251e5bc9a66dc8f1c54f97f2e"} Mar 16 16:12:43 crc kubenswrapper[5120]: I0316 16:12:43.638814 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:12:43 crc kubenswrapper[5120]: I0316 16:12:43.776590 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6a869ae4-5dd4-47d8-aa7e-e519981ee01f-config-data\") pod \"6a869ae4-5dd4-47d8-aa7e-e519981ee01f\" (UID: \"6a869ae4-5dd4-47d8-aa7e-e519981ee01f\") " Mar 16 16:12:43 crc kubenswrapper[5120]: I0316 16:12:43.776673 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kjmfw\" (UniqueName: \"kubernetes.io/projected/6a869ae4-5dd4-47d8-aa7e-e519981ee01f-kube-api-access-kjmfw\") pod \"6a869ae4-5dd4-47d8-aa7e-e519981ee01f\" (UID: \"6a869ae4-5dd4-47d8-aa7e-e519981ee01f\") " Mar 16 16:12:43 crc kubenswrapper[5120]: I0316 16:12:43.776838 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6a869ae4-5dd4-47d8-aa7e-e519981ee01f-combined-ca-bundle\") pod \"6a869ae4-5dd4-47d8-aa7e-e519981ee01f\" (UID: \"6a869ae4-5dd4-47d8-aa7e-e519981ee01f\") " Mar 16 16:12:43 crc kubenswrapper[5120]: I0316 16:12:43.783287 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a869ae4-5dd4-47d8-aa7e-e519981ee01f-kube-api-access-kjmfw" (OuterVolumeSpecName: "kube-api-access-kjmfw") pod "6a869ae4-5dd4-47d8-aa7e-e519981ee01f" (UID: "6a869ae4-5dd4-47d8-aa7e-e519981ee01f"). InnerVolumeSpecName "kube-api-access-kjmfw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:12:43 crc kubenswrapper[5120]: I0316 16:12:43.809701 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a869ae4-5dd4-47d8-aa7e-e519981ee01f-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "6a869ae4-5dd4-47d8-aa7e-e519981ee01f" (UID: "6a869ae4-5dd4-47d8-aa7e-e519981ee01f"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:43 crc kubenswrapper[5120]: I0316 16:12:43.818398 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a869ae4-5dd4-47d8-aa7e-e519981ee01f-config-data" (OuterVolumeSpecName: "config-data") pod "6a869ae4-5dd4-47d8-aa7e-e519981ee01f" (UID: "6a869ae4-5dd4-47d8-aa7e-e519981ee01f"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:43 crc kubenswrapper[5120]: I0316 16:12:43.881137 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6a869ae4-5dd4-47d8-aa7e-e519981ee01f-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:43 crc kubenswrapper[5120]: I0316 16:12:43.881196 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kjmfw\" (UniqueName: \"kubernetes.io/projected/6a869ae4-5dd4-47d8-aa7e-e519981ee01f-kube-api-access-kjmfw\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:43 crc kubenswrapper[5120]: I0316 16:12:43.881216 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6a869ae4-5dd4-47d8-aa7e-e519981ee01f-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:44 crc kubenswrapper[5120]: I0316 16:12:44.397420 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:12:44 crc kubenswrapper[5120]: I0316 16:12:44.397482 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"6a869ae4-5dd4-47d8-aa7e-e519981ee01f","Type":"ContainerDied","Data":"77550a8e88cc4fdbfaadf6f569f054357afcf32a664420e7aa8c95084cd4c27d"} Mar 16 16:12:44 crc kubenswrapper[5120]: I0316 16:12:44.397563 5120 scope.go:117] "RemoveContainer" containerID="37accdb48c73bda606e0755923e4c375ae91d06251e5bc9a66dc8f1c54f97f2e" Mar 16 16:12:44 crc kubenswrapper[5120]: I0316 16:12:44.435849 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:12:44 crc kubenswrapper[5120]: I0316 16:12:44.448737 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:12:44 crc kubenswrapper[5120]: E0316 16:12:44.634226 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="db11af3fe6b07413600ae44f79a3df378f43385bd524e92444794183d150e508" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:12:44 crc kubenswrapper[5120]: E0316 16:12:44.636025 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="db11af3fe6b07413600ae44f79a3df378f43385bd524e92444794183d150e508" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:12:44 crc kubenswrapper[5120]: E0316 16:12:44.637816 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="db11af3fe6b07413600ae44f79a3df378f43385bd524e92444794183d150e508" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:12:44 crc kubenswrapper[5120]: E0316 16:12:44.637856 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="bce71378-f7b0-4b73-8b4a-711353734319" containerName="nova-cell1-conductor-conductor" probeResult="unknown" Mar 16 16:12:44 crc kubenswrapper[5120]: I0316 16:12:44.691326 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a869ae4-5dd4-47d8-aa7e-e519981ee01f" path="/var/lib/kubelet/pods/6a869ae4-5dd4-47d8-aa7e-e519981ee01f/volumes" Mar 16 16:12:45 crc kubenswrapper[5120]: I0316 16:12:45.664108 5120 scope.go:117] "RemoveContainer" containerID="bc2df124cc6ad146d7c7dd2115ac815986fb62978d38895f6d345a4a9b14dbd8" Mar 16 16:12:45 crc kubenswrapper[5120]: E0316 16:12:45.664521 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:12:47 crc kubenswrapper[5120]: E0316 16:12:47.409250 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="0694d284d33b8f4728b5b5db2443c16f6b7c4ab92062463e2013167e4b4a7dc6" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:12:47 crc kubenswrapper[5120]: E0316 16:12:47.412979 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="0694d284d33b8f4728b5b5db2443c16f6b7c4ab92062463e2013167e4b4a7dc6" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:12:47 crc kubenswrapper[5120]: E0316 16:12:47.415419 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="0694d284d33b8f4728b5b5db2443c16f6b7c4ab92062463e2013167e4b4a7dc6" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:12:47 crc kubenswrapper[5120]: E0316 16:12:47.415472 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="bba65a98-1383-4c8c-995a-b212b232d1f8" containerName="nova-scheduler-scheduler" probeResult="unknown" Mar 16 16:12:49 crc kubenswrapper[5120]: E0316 16:12:49.633471 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="db11af3fe6b07413600ae44f79a3df378f43385bd524e92444794183d150e508" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:12:49 crc kubenswrapper[5120]: E0316 16:12:49.635319 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="db11af3fe6b07413600ae44f79a3df378f43385bd524e92444794183d150e508" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:12:49 crc kubenswrapper[5120]: E0316 16:12:49.637300 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="db11af3fe6b07413600ae44f79a3df378f43385bd524e92444794183d150e508" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:12:49 crc kubenswrapper[5120]: E0316 16:12:49.637351 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="bce71378-f7b0-4b73-8b4a-711353734319" containerName="nova-cell1-conductor-conductor" probeResult="unknown" Mar 16 16:12:49 crc kubenswrapper[5120]: I0316 16:12:49.844847 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:12:49 crc kubenswrapper[5120]: I0316 16:12:49.922293 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/48f884c6-8a4f-4581-8b21-6e4db79ae424-cache\") pod \"48f884c6-8a4f-4581-8b21-6e4db79ae424\" (UID: \"48f884c6-8a4f-4581-8b21-6e4db79ae424\") " Mar 16 16:12:49 crc kubenswrapper[5120]: I0316 16:12:49.922865 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/48f884c6-8a4f-4581-8b21-6e4db79ae424-lock\") pod \"48f884c6-8a4f-4581-8b21-6e4db79ae424\" (UID: \"48f884c6-8a4f-4581-8b21-6e4db79ae424\") " Mar 16 16:12:49 crc kubenswrapper[5120]: I0316 16:12:49.922902 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/48f884c6-8a4f-4581-8b21-6e4db79ae424-combined-ca-bundle\") pod \"48f884c6-8a4f-4581-8b21-6e4db79ae424\" (UID: \"48f884c6-8a4f-4581-8b21-6e4db79ae424\") " Mar 16 16:12:49 crc kubenswrapper[5120]: I0316 16:12:49.922941 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/48f884c6-8a4f-4581-8b21-6e4db79ae424-etc-swift\") pod \"48f884c6-8a4f-4581-8b21-6e4db79ae424\" (UID: \"48f884c6-8a4f-4581-8b21-6e4db79ae424\") " Mar 16 16:12:49 crc kubenswrapper[5120]: I0316 16:12:49.923098 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"swift\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") pod \"48f884c6-8a4f-4581-8b21-6e4db79ae424\" (UID: \"48f884c6-8a4f-4581-8b21-6e4db79ae424\") " Mar 16 16:12:49 crc kubenswrapper[5120]: I0316 16:12:49.923161 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wd7zm\" (UniqueName: \"kubernetes.io/projected/48f884c6-8a4f-4581-8b21-6e4db79ae424-kube-api-access-wd7zm\") pod \"48f884c6-8a4f-4581-8b21-6e4db79ae424\" (UID: \"48f884c6-8a4f-4581-8b21-6e4db79ae424\") " Mar 16 16:12:49 crc kubenswrapper[5120]: I0316 16:12:49.923481 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48f884c6-8a4f-4581-8b21-6e4db79ae424-lock" (OuterVolumeSpecName: "lock") pod "48f884c6-8a4f-4581-8b21-6e4db79ae424" (UID: "48f884c6-8a4f-4581-8b21-6e4db79ae424"). InnerVolumeSpecName "lock". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:12:49 crc kubenswrapper[5120]: I0316 16:12:49.923790 5120 reconciler_common.go:299] "Volume detached for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/48f884c6-8a4f-4581-8b21-6e4db79ae424-lock\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:49 crc kubenswrapper[5120]: I0316 16:12:49.924257 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48f884c6-8a4f-4581-8b21-6e4db79ae424-cache" (OuterVolumeSpecName: "cache") pod "48f884c6-8a4f-4581-8b21-6e4db79ae424" (UID: "48f884c6-8a4f-4581-8b21-6e4db79ae424"). InnerVolumeSpecName "cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:12:49 crc kubenswrapper[5120]: I0316 16:12:49.932906 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage11-crc" (OuterVolumeSpecName: "swift") pod "48f884c6-8a4f-4581-8b21-6e4db79ae424" (UID: "48f884c6-8a4f-4581-8b21-6e4db79ae424"). InnerVolumeSpecName "local-storage11-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:12:49 crc kubenswrapper[5120]: I0316 16:12:49.932929 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48f884c6-8a4f-4581-8b21-6e4db79ae424-kube-api-access-wd7zm" (OuterVolumeSpecName: "kube-api-access-wd7zm") pod "48f884c6-8a4f-4581-8b21-6e4db79ae424" (UID: "48f884c6-8a4f-4581-8b21-6e4db79ae424"). InnerVolumeSpecName "kube-api-access-wd7zm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:12:49 crc kubenswrapper[5120]: I0316 16:12:49.933149 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48f884c6-8a4f-4581-8b21-6e4db79ae424-etc-swift" (OuterVolumeSpecName: "etc-swift") pod "48f884c6-8a4f-4581-8b21-6e4db79ae424" (UID: "48f884c6-8a4f-4581-8b21-6e4db79ae424"). InnerVolumeSpecName "etc-swift". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:12:50 crc kubenswrapper[5120]: I0316 16:12:50.026045 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") on node \"crc\" " Mar 16 16:12:50 crc kubenswrapper[5120]: I0316 16:12:50.026090 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wd7zm\" (UniqueName: \"kubernetes.io/projected/48f884c6-8a4f-4581-8b21-6e4db79ae424-kube-api-access-wd7zm\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:50 crc kubenswrapper[5120]: I0316 16:12:50.026104 5120 reconciler_common.go:299] "Volume detached for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/48f884c6-8a4f-4581-8b21-6e4db79ae424-cache\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:50 crc kubenswrapper[5120]: I0316 16:12:50.026118 5120 reconciler_common.go:299] "Volume detached for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/48f884c6-8a4f-4581-8b21-6e4db79ae424-etc-swift\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:50 crc kubenswrapper[5120]: I0316 16:12:50.041615 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage11-crc" (UniqueName: "kubernetes.io/local-volume/local-storage11-crc") on node "crc" Mar 16 16:12:50 crc kubenswrapper[5120]: I0316 16:12:50.128060 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:50 crc kubenswrapper[5120]: I0316 16:12:50.220131 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48f884c6-8a4f-4581-8b21-6e4db79ae424-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "48f884c6-8a4f-4581-8b21-6e4db79ae424" (UID: "48f884c6-8a4f-4581-8b21-6e4db79ae424"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:50 crc kubenswrapper[5120]: I0316 16:12:50.229729 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/48f884c6-8a4f-4581-8b21-6e4db79ae424-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:50 crc kubenswrapper[5120]: I0316 16:12:50.300623 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:12:50 crc kubenswrapper[5120]: I0316 16:12:50.435095 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/96d66c8e-8cdb-462c-a302-c85e581db5ad-combined-ca-bundle\") pod \"96d66c8e-8cdb-462c-a302-c85e581db5ad\" (UID: \"96d66c8e-8cdb-462c-a302-c85e581db5ad\") " Mar 16 16:12:50 crc kubenswrapper[5120]: I0316 16:12:50.435177 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/96d66c8e-8cdb-462c-a302-c85e581db5ad-etc-machine-id\") pod \"96d66c8e-8cdb-462c-a302-c85e581db5ad\" (UID: \"96d66c8e-8cdb-462c-a302-c85e581db5ad\") " Mar 16 16:12:50 crc kubenswrapper[5120]: I0316 16:12:50.435308 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mdc5z\" (UniqueName: \"kubernetes.io/projected/96d66c8e-8cdb-462c-a302-c85e581db5ad-kube-api-access-mdc5z\") pod \"96d66c8e-8cdb-462c-a302-c85e581db5ad\" (UID: \"96d66c8e-8cdb-462c-a302-c85e581db5ad\") " Mar 16 16:12:50 crc kubenswrapper[5120]: I0316 16:12:50.435347 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/96d66c8e-8cdb-462c-a302-c85e581db5ad-config-data-custom\") pod \"96d66c8e-8cdb-462c-a302-c85e581db5ad\" (UID: \"96d66c8e-8cdb-462c-a302-c85e581db5ad\") " Mar 16 16:12:50 crc kubenswrapper[5120]: I0316 16:12:50.435548 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/96d66c8e-8cdb-462c-a302-c85e581db5ad-config-data\") pod \"96d66c8e-8cdb-462c-a302-c85e581db5ad\" (UID: \"96d66c8e-8cdb-462c-a302-c85e581db5ad\") " Mar 16 16:12:50 crc kubenswrapper[5120]: I0316 16:12:50.435597 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/96d66c8e-8cdb-462c-a302-c85e581db5ad-scripts\") pod \"96d66c8e-8cdb-462c-a302-c85e581db5ad\" (UID: \"96d66c8e-8cdb-462c-a302-c85e581db5ad\") " Mar 16 16:12:50 crc kubenswrapper[5120]: I0316 16:12:50.446804 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/96d66c8e-8cdb-462c-a302-c85e581db5ad-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "96d66c8e-8cdb-462c-a302-c85e581db5ad" (UID: "96d66c8e-8cdb-462c-a302-c85e581db5ad"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 16:12:50 crc kubenswrapper[5120]: I0316 16:12:50.448834 5120 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/96d66c8e-8cdb-462c-a302-c85e581db5ad-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:50 crc kubenswrapper[5120]: I0316 16:12:50.453524 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96d66c8e-8cdb-462c-a302-c85e581db5ad-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "96d66c8e-8cdb-462c-a302-c85e581db5ad" (UID: "96d66c8e-8cdb-462c-a302-c85e581db5ad"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:50 crc kubenswrapper[5120]: I0316 16:12:50.453579 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96d66c8e-8cdb-462c-a302-c85e581db5ad-kube-api-access-mdc5z" (OuterVolumeSpecName: "kube-api-access-mdc5z") pod "96d66c8e-8cdb-462c-a302-c85e581db5ad" (UID: "96d66c8e-8cdb-462c-a302-c85e581db5ad"). InnerVolumeSpecName "kube-api-access-mdc5z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:12:50 crc kubenswrapper[5120]: I0316 16:12:50.454353 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96d66c8e-8cdb-462c-a302-c85e581db5ad-scripts" (OuterVolumeSpecName: "scripts") pod "96d66c8e-8cdb-462c-a302-c85e581db5ad" (UID: "96d66c8e-8cdb-462c-a302-c85e581db5ad"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:50 crc kubenswrapper[5120]: I0316 16:12:50.459138 5120 generic.go:358] "Generic (PLEG): container finished" podID="96d66c8e-8cdb-462c-a302-c85e581db5ad" containerID="80448d2f177c589508fc45988bee032c0821389406369ddd7f6d2a419c63e5be" exitCode=137 Mar 16 16:12:50 crc kubenswrapper[5120]: I0316 16:12:50.459242 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"96d66c8e-8cdb-462c-a302-c85e581db5ad","Type":"ContainerDied","Data":"80448d2f177c589508fc45988bee032c0821389406369ddd7f6d2a419c63e5be"} Mar 16 16:12:50 crc kubenswrapper[5120]: I0316 16:12:50.459273 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"96d66c8e-8cdb-462c-a302-c85e581db5ad","Type":"ContainerDied","Data":"9c01f931eb233ff798516b1c8be37bfb13b5260be3ab6f8082e0e9f8bf91acc0"} Mar 16 16:12:50 crc kubenswrapper[5120]: I0316 16:12:50.459290 5120 scope.go:117] "RemoveContainer" containerID="d4b6b76b9c5320477843bd780ebb20cf97063725b2d9c08ddb68df6a0c0cf879" Mar 16 16:12:50 crc kubenswrapper[5120]: I0316 16:12:50.459402 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:12:50 crc kubenswrapper[5120]: I0316 16:12:50.462246 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-cb8df78d6-4gf8s_5cf58a8f-dfb4-4a0a-b96c-000333125dd0/neutron-api/0.log" Mar 16 16:12:50 crc kubenswrapper[5120]: I0316 16:12:50.462337 5120 generic.go:358] "Generic (PLEG): container finished" podID="5cf58a8f-dfb4-4a0a-b96c-000333125dd0" containerID="2af07be619d918d455ab3453bb4c324e7039b7c37a76d4c43b38c031fb72a931" exitCode=137 Mar 16 16:12:50 crc kubenswrapper[5120]: I0316 16:12:50.462418 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-cb8df78d6-4gf8s" event={"ID":"5cf58a8f-dfb4-4a0a-b96c-000333125dd0","Type":"ContainerDied","Data":"2af07be619d918d455ab3453bb4c324e7039b7c37a76d4c43b38c031fb72a931"} Mar 16 16:12:50 crc kubenswrapper[5120]: I0316 16:12:50.470695 5120 generic.go:358] "Generic (PLEG): container finished" podID="48f884c6-8a4f-4581-8b21-6e4db79ae424" containerID="6ebaa174af16709eabdeaa272a12557155a953a5695f9c4f45bdbbba7bbe258c" exitCode=137 Mar 16 16:12:50 crc kubenswrapper[5120]: I0316 16:12:50.470786 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"48f884c6-8a4f-4581-8b21-6e4db79ae424","Type":"ContainerDied","Data":"6ebaa174af16709eabdeaa272a12557155a953a5695f9c4f45bdbbba7bbe258c"} Mar 16 16:12:50 crc kubenswrapper[5120]: I0316 16:12:50.470819 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"48f884c6-8a4f-4581-8b21-6e4db79ae424","Type":"ContainerDied","Data":"6d7b4186c898fe068943e79be73641fcf9c14cb56c0750d17ebe0c2be442a952"} Mar 16 16:12:50 crc kubenswrapper[5120]: I0316 16:12:50.470851 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:12:50 crc kubenswrapper[5120]: I0316 16:12:50.478161 5120 scope.go:117] "RemoveContainer" containerID="80448d2f177c589508fc45988bee032c0821389406369ddd7f6d2a419c63e5be" Mar 16 16:12:50 crc kubenswrapper[5120]: I0316 16:12:50.497317 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96d66c8e-8cdb-462c-a302-c85e581db5ad-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "96d66c8e-8cdb-462c-a302-c85e581db5ad" (UID: "96d66c8e-8cdb-462c-a302-c85e581db5ad"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:50 crc kubenswrapper[5120]: I0316 16:12:50.507311 5120 scope.go:117] "RemoveContainer" containerID="d4b6b76b9c5320477843bd780ebb20cf97063725b2d9c08ddb68df6a0c0cf879" Mar 16 16:12:50 crc kubenswrapper[5120]: E0316 16:12:50.507743 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d4b6b76b9c5320477843bd780ebb20cf97063725b2d9c08ddb68df6a0c0cf879\": container with ID starting with d4b6b76b9c5320477843bd780ebb20cf97063725b2d9c08ddb68df6a0c0cf879 not found: ID does not exist" containerID="d4b6b76b9c5320477843bd780ebb20cf97063725b2d9c08ddb68df6a0c0cf879" Mar 16 16:12:50 crc kubenswrapper[5120]: I0316 16:12:50.507798 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4b6b76b9c5320477843bd780ebb20cf97063725b2d9c08ddb68df6a0c0cf879"} err="failed to get container status \"d4b6b76b9c5320477843bd780ebb20cf97063725b2d9c08ddb68df6a0c0cf879\": rpc error: code = NotFound desc = could not find container \"d4b6b76b9c5320477843bd780ebb20cf97063725b2d9c08ddb68df6a0c0cf879\": container with ID starting with d4b6b76b9c5320477843bd780ebb20cf97063725b2d9c08ddb68df6a0c0cf879 not found: ID does not exist" Mar 16 16:12:50 crc kubenswrapper[5120]: I0316 16:12:50.507822 5120 scope.go:117] "RemoveContainer" containerID="80448d2f177c589508fc45988bee032c0821389406369ddd7f6d2a419c63e5be" Mar 16 16:12:50 crc kubenswrapper[5120]: E0316 16:12:50.513081 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"80448d2f177c589508fc45988bee032c0821389406369ddd7f6d2a419c63e5be\": container with ID starting with 80448d2f177c589508fc45988bee032c0821389406369ddd7f6d2a419c63e5be not found: ID does not exist" containerID="80448d2f177c589508fc45988bee032c0821389406369ddd7f6d2a419c63e5be" Mar 16 16:12:50 crc kubenswrapper[5120]: I0316 16:12:50.513131 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80448d2f177c589508fc45988bee032c0821389406369ddd7f6d2a419c63e5be"} err="failed to get container status \"80448d2f177c589508fc45988bee032c0821389406369ddd7f6d2a419c63e5be\": rpc error: code = NotFound desc = could not find container \"80448d2f177c589508fc45988bee032c0821389406369ddd7f6d2a419c63e5be\": container with ID starting with 80448d2f177c589508fc45988bee032c0821389406369ddd7f6d2a419c63e5be not found: ID does not exist" Mar 16 16:12:50 crc kubenswrapper[5120]: I0316 16:12:50.513246 5120 scope.go:117] "RemoveContainer" containerID="6ebaa174af16709eabdeaa272a12557155a953a5695f9c4f45bdbbba7bbe258c" Mar 16 16:12:50 crc kubenswrapper[5120]: I0316 16:12:50.517348 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 16:12:50 crc kubenswrapper[5120]: I0316 16:12:50.522883 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 16:12:50 crc kubenswrapper[5120]: I0316 16:12:50.537403 5120 scope.go:117] "RemoveContainer" containerID="db519ba940e3ae10789232d021fe52325581ff3785213c9476636fdeaec31312" Mar 16 16:12:50 crc kubenswrapper[5120]: I0316 16:12:50.549997 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/96d66c8e-8cdb-462c-a302-c85e581db5ad-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:50 crc kubenswrapper[5120]: I0316 16:12:50.550023 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/96d66c8e-8cdb-462c-a302-c85e581db5ad-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:50 crc kubenswrapper[5120]: I0316 16:12:50.550036 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mdc5z\" (UniqueName: \"kubernetes.io/projected/96d66c8e-8cdb-462c-a302-c85e581db5ad-kube-api-access-mdc5z\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:50 crc kubenswrapper[5120]: I0316 16:12:50.550045 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/96d66c8e-8cdb-462c-a302-c85e581db5ad-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:50 crc kubenswrapper[5120]: I0316 16:12:50.571960 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96d66c8e-8cdb-462c-a302-c85e581db5ad-config-data" (OuterVolumeSpecName: "config-data") pod "96d66c8e-8cdb-462c-a302-c85e581db5ad" (UID: "96d66c8e-8cdb-462c-a302-c85e581db5ad"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:50 crc kubenswrapper[5120]: I0316 16:12:50.637649 5120 scope.go:117] "RemoveContainer" containerID="758c2ce99e07b0ccc53b089f1c58cd33db77d7df92e3795e3715aeb0c2df8a47" Mar 16 16:12:50 crc kubenswrapper[5120]: I0316 16:12:50.653486 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/96d66c8e-8cdb-462c-a302-c85e581db5ad-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:50 crc kubenswrapper[5120]: E0316 16:12:50.653492 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 16:12:50 crc kubenswrapper[5120]: E0316 16:12:50.653593 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bba65a98-1383-4c8c-995a-b212b232d1f8-combined-ca-bundle podName:bba65a98-1383-4c8c-995a-b212b232d1f8 nodeName:}" failed. No retries permitted until 2026-03-16 16:13:22.653573848 +0000 UTC m=+2504.807505505 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/bba65a98-1383-4c8c-995a-b212b232d1f8-combined-ca-bundle") pod "nova-scheduler-0" (UID: "bba65a98-1383-4c8c-995a-b212b232d1f8") : secret "combined-ca-bundle" not found Mar 16 16:12:50 crc kubenswrapper[5120]: I0316 16:12:50.691250 5120 scope.go:117] "RemoveContainer" containerID="0a908a6be3baace96c3eef973eb82131e5167c3067b1203a7c21f2622485ee33" Mar 16 16:12:50 crc kubenswrapper[5120]: I0316 16:12:50.698352 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="48f884c6-8a4f-4581-8b21-6e4db79ae424" path="/var/lib/kubelet/pods/48f884c6-8a4f-4581-8b21-6e4db79ae424/volumes" Mar 16 16:12:50 crc kubenswrapper[5120]: I0316 16:12:50.705940 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-cb8df78d6-4gf8s_5cf58a8f-dfb4-4a0a-b96c-000333125dd0/neutron-api/0.log" Mar 16 16:12:50 crc kubenswrapper[5120]: I0316 16:12:50.706013 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-cb8df78d6-4gf8s" Mar 16 16:12:50 crc kubenswrapper[5120]: I0316 16:12:50.714652 5120 scope.go:117] "RemoveContainer" containerID="85fba775e10e93053a28f47416e4fab8a8d74704457a1dcaa326ca7d97b5b71f" Mar 16 16:12:50 crc kubenswrapper[5120]: I0316 16:12:50.755036 5120 scope.go:117] "RemoveContainer" containerID="0f89eb629ca87b8f3c4dc3a654ad9be3b3dbf2b9befef91351aef67313564f2a" Mar 16 16:12:50 crc kubenswrapper[5120]: I0316 16:12:50.783078 5120 scope.go:117] "RemoveContainer" containerID="f1f5ef3a1ae4a49a755f7af35d2f4253955831c27a90812260b878eecdda0e64" Mar 16 16:12:50 crc kubenswrapper[5120]: I0316 16:12:50.783744 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:12:50 crc kubenswrapper[5120]: I0316 16:12:50.789148 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:12:50 crc kubenswrapper[5120]: I0316 16:12:50.798664 5120 scope.go:117] "RemoveContainer" containerID="f9a925d5514cb6701f37d65b406ab354233d03c77e454fdee7f9de6e3c4f2ec2" Mar 16 16:12:50 crc kubenswrapper[5120]: I0316 16:12:50.819198 5120 scope.go:117] "RemoveContainer" containerID="c0e4c801b2d8158c5198a10ed551d4bc0bd991a66fd9a3696cf629419472d00b" Mar 16 16:12:50 crc kubenswrapper[5120]: I0316 16:12:50.835310 5120 scope.go:117] "RemoveContainer" containerID="bd5bde381422aec36b49a27e33e7df18130a58904e5277a758731159e4602f17" Mar 16 16:12:50 crc kubenswrapper[5120]: I0316 16:12:50.851715 5120 scope.go:117] "RemoveContainer" containerID="51d5b8b2b99674a1960ad863d81ad3a57a5eb88f5643007686739c6718ac88e6" Mar 16 16:12:50 crc kubenswrapper[5120]: I0316 16:12:50.855552 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5cf58a8f-dfb4-4a0a-b96c-000333125dd0-config\") pod \"5cf58a8f-dfb4-4a0a-b96c-000333125dd0\" (UID: \"5cf58a8f-dfb4-4a0a-b96c-000333125dd0\") " Mar 16 16:12:50 crc kubenswrapper[5120]: I0316 16:12:50.855582 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5cf58a8f-dfb4-4a0a-b96c-000333125dd0-combined-ca-bundle\") pod \"5cf58a8f-dfb4-4a0a-b96c-000333125dd0\" (UID: \"5cf58a8f-dfb4-4a0a-b96c-000333125dd0\") " Mar 16 16:12:50 crc kubenswrapper[5120]: I0316 16:12:50.855807 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/5cf58a8f-dfb4-4a0a-b96c-000333125dd0-public-tls-certs\") pod \"5cf58a8f-dfb4-4a0a-b96c-000333125dd0\" (UID: \"5cf58a8f-dfb4-4a0a-b96c-000333125dd0\") " Mar 16 16:12:50 crc kubenswrapper[5120]: I0316 16:12:50.855846 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kfnvv\" (UniqueName: \"kubernetes.io/projected/5cf58a8f-dfb4-4a0a-b96c-000333125dd0-kube-api-access-kfnvv\") pod \"5cf58a8f-dfb4-4a0a-b96c-000333125dd0\" (UID: \"5cf58a8f-dfb4-4a0a-b96c-000333125dd0\") " Mar 16 16:12:50 crc kubenswrapper[5120]: I0316 16:12:50.855906 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/5cf58a8f-dfb4-4a0a-b96c-000333125dd0-internal-tls-certs\") pod \"5cf58a8f-dfb4-4a0a-b96c-000333125dd0\" (UID: \"5cf58a8f-dfb4-4a0a-b96c-000333125dd0\") " Mar 16 16:12:50 crc kubenswrapper[5120]: I0316 16:12:50.855922 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/5cf58a8f-dfb4-4a0a-b96c-000333125dd0-httpd-config\") pod \"5cf58a8f-dfb4-4a0a-b96c-000333125dd0\" (UID: \"5cf58a8f-dfb4-4a0a-b96c-000333125dd0\") " Mar 16 16:12:50 crc kubenswrapper[5120]: I0316 16:12:50.855956 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/5cf58a8f-dfb4-4a0a-b96c-000333125dd0-ovndb-tls-certs\") pod \"5cf58a8f-dfb4-4a0a-b96c-000333125dd0\" (UID: \"5cf58a8f-dfb4-4a0a-b96c-000333125dd0\") " Mar 16 16:12:50 crc kubenswrapper[5120]: I0316 16:12:50.859540 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5cf58a8f-dfb4-4a0a-b96c-000333125dd0-kube-api-access-kfnvv" (OuterVolumeSpecName: "kube-api-access-kfnvv") pod "5cf58a8f-dfb4-4a0a-b96c-000333125dd0" (UID: "5cf58a8f-dfb4-4a0a-b96c-000333125dd0"). InnerVolumeSpecName "kube-api-access-kfnvv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:12:50 crc kubenswrapper[5120]: I0316 16:12:50.859685 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5cf58a8f-dfb4-4a0a-b96c-000333125dd0-httpd-config" (OuterVolumeSpecName: "httpd-config") pod "5cf58a8f-dfb4-4a0a-b96c-000333125dd0" (UID: "5cf58a8f-dfb4-4a0a-b96c-000333125dd0"). InnerVolumeSpecName "httpd-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:50 crc kubenswrapper[5120]: I0316 16:12:50.868406 5120 scope.go:117] "RemoveContainer" containerID="c68e0b66544e05eeafb40a0ede57f1aaffd7e86fe267efb1d86740b24f029cd4" Mar 16 16:12:50 crc kubenswrapper[5120]: I0316 16:12:50.890252 5120 scope.go:117] "RemoveContainer" containerID="4bce9c9cadac21d7a22c0911253a06b757eab3c3a10ee9e0b5056d5ddc880b03" Mar 16 16:12:50 crc kubenswrapper[5120]: I0316 16:12:50.896200 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5cf58a8f-dfb4-4a0a-b96c-000333125dd0-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "5cf58a8f-dfb4-4a0a-b96c-000333125dd0" (UID: "5cf58a8f-dfb4-4a0a-b96c-000333125dd0"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:50 crc kubenswrapper[5120]: I0316 16:12:50.896731 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5cf58a8f-dfb4-4a0a-b96c-000333125dd0-config" (OuterVolumeSpecName: "config") pod "5cf58a8f-dfb4-4a0a-b96c-000333125dd0" (UID: "5cf58a8f-dfb4-4a0a-b96c-000333125dd0"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:50 crc kubenswrapper[5120]: I0316 16:12:50.898448 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5cf58a8f-dfb4-4a0a-b96c-000333125dd0-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "5cf58a8f-dfb4-4a0a-b96c-000333125dd0" (UID: "5cf58a8f-dfb4-4a0a-b96c-000333125dd0"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:50 crc kubenswrapper[5120]: I0316 16:12:50.900121 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5cf58a8f-dfb4-4a0a-b96c-000333125dd0-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "5cf58a8f-dfb4-4a0a-b96c-000333125dd0" (UID: "5cf58a8f-dfb4-4a0a-b96c-000333125dd0"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:50 crc kubenswrapper[5120]: I0316 16:12:50.907890 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5cf58a8f-dfb4-4a0a-b96c-000333125dd0-ovndb-tls-certs" (OuterVolumeSpecName: "ovndb-tls-certs") pod "5cf58a8f-dfb4-4a0a-b96c-000333125dd0" (UID: "5cf58a8f-dfb4-4a0a-b96c-000333125dd0"). InnerVolumeSpecName "ovndb-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:50 crc kubenswrapper[5120]: I0316 16:12:50.908088 5120 scope.go:117] "RemoveContainer" containerID="d15b7b1dedfc5e0bf45e87214537c30c6e63e98b399564a5d04a921d97d3ee71" Mar 16 16:12:50 crc kubenswrapper[5120]: I0316 16:12:50.925134 5120 scope.go:117] "RemoveContainer" containerID="7f52beabfcff3227464395535efe06bcce13fd954b9eb69868803bda7c0f42b8" Mar 16 16:12:50 crc kubenswrapper[5120]: I0316 16:12:50.941866 5120 scope.go:117] "RemoveContainer" containerID="6ebaa174af16709eabdeaa272a12557155a953a5695f9c4f45bdbbba7bbe258c" Mar 16 16:12:50 crc kubenswrapper[5120]: E0316 16:12:50.942208 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6ebaa174af16709eabdeaa272a12557155a953a5695f9c4f45bdbbba7bbe258c\": container with ID starting with 6ebaa174af16709eabdeaa272a12557155a953a5695f9c4f45bdbbba7bbe258c not found: ID does not exist" containerID="6ebaa174af16709eabdeaa272a12557155a953a5695f9c4f45bdbbba7bbe258c" Mar 16 16:12:50 crc kubenswrapper[5120]: I0316 16:12:50.942246 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ebaa174af16709eabdeaa272a12557155a953a5695f9c4f45bdbbba7bbe258c"} err="failed to get container status \"6ebaa174af16709eabdeaa272a12557155a953a5695f9c4f45bdbbba7bbe258c\": rpc error: code = NotFound desc = could not find container \"6ebaa174af16709eabdeaa272a12557155a953a5695f9c4f45bdbbba7bbe258c\": container with ID starting with 6ebaa174af16709eabdeaa272a12557155a953a5695f9c4f45bdbbba7bbe258c not found: ID does not exist" Mar 16 16:12:50 crc kubenswrapper[5120]: I0316 16:12:50.942270 5120 scope.go:117] "RemoveContainer" containerID="db519ba940e3ae10789232d021fe52325581ff3785213c9476636fdeaec31312" Mar 16 16:12:50 crc kubenswrapper[5120]: E0316 16:12:50.942749 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db519ba940e3ae10789232d021fe52325581ff3785213c9476636fdeaec31312\": container with ID starting with db519ba940e3ae10789232d021fe52325581ff3785213c9476636fdeaec31312 not found: ID does not exist" containerID="db519ba940e3ae10789232d021fe52325581ff3785213c9476636fdeaec31312" Mar 16 16:12:50 crc kubenswrapper[5120]: I0316 16:12:50.942810 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db519ba940e3ae10789232d021fe52325581ff3785213c9476636fdeaec31312"} err="failed to get container status \"db519ba940e3ae10789232d021fe52325581ff3785213c9476636fdeaec31312\": rpc error: code = NotFound desc = could not find container \"db519ba940e3ae10789232d021fe52325581ff3785213c9476636fdeaec31312\": container with ID starting with db519ba940e3ae10789232d021fe52325581ff3785213c9476636fdeaec31312 not found: ID does not exist" Mar 16 16:12:50 crc kubenswrapper[5120]: I0316 16:12:50.942839 5120 scope.go:117] "RemoveContainer" containerID="758c2ce99e07b0ccc53b089f1c58cd33db77d7df92e3795e3715aeb0c2df8a47" Mar 16 16:12:50 crc kubenswrapper[5120]: E0316 16:12:50.943136 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"758c2ce99e07b0ccc53b089f1c58cd33db77d7df92e3795e3715aeb0c2df8a47\": container with ID starting with 758c2ce99e07b0ccc53b089f1c58cd33db77d7df92e3795e3715aeb0c2df8a47 not found: ID does not exist" containerID="758c2ce99e07b0ccc53b089f1c58cd33db77d7df92e3795e3715aeb0c2df8a47" Mar 16 16:12:50 crc kubenswrapper[5120]: I0316 16:12:50.943178 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"758c2ce99e07b0ccc53b089f1c58cd33db77d7df92e3795e3715aeb0c2df8a47"} err="failed to get container status \"758c2ce99e07b0ccc53b089f1c58cd33db77d7df92e3795e3715aeb0c2df8a47\": rpc error: code = NotFound desc = could not find container \"758c2ce99e07b0ccc53b089f1c58cd33db77d7df92e3795e3715aeb0c2df8a47\": container with ID starting with 758c2ce99e07b0ccc53b089f1c58cd33db77d7df92e3795e3715aeb0c2df8a47 not found: ID does not exist" Mar 16 16:12:50 crc kubenswrapper[5120]: I0316 16:12:50.943200 5120 scope.go:117] "RemoveContainer" containerID="0a908a6be3baace96c3eef973eb82131e5167c3067b1203a7c21f2622485ee33" Mar 16 16:12:50 crc kubenswrapper[5120]: E0316 16:12:50.943525 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a908a6be3baace96c3eef973eb82131e5167c3067b1203a7c21f2622485ee33\": container with ID starting with 0a908a6be3baace96c3eef973eb82131e5167c3067b1203a7c21f2622485ee33 not found: ID does not exist" containerID="0a908a6be3baace96c3eef973eb82131e5167c3067b1203a7c21f2622485ee33" Mar 16 16:12:50 crc kubenswrapper[5120]: I0316 16:12:50.943549 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a908a6be3baace96c3eef973eb82131e5167c3067b1203a7c21f2622485ee33"} err="failed to get container status \"0a908a6be3baace96c3eef973eb82131e5167c3067b1203a7c21f2622485ee33\": rpc error: code = NotFound desc = could not find container \"0a908a6be3baace96c3eef973eb82131e5167c3067b1203a7c21f2622485ee33\": container with ID starting with 0a908a6be3baace96c3eef973eb82131e5167c3067b1203a7c21f2622485ee33 not found: ID does not exist" Mar 16 16:12:50 crc kubenswrapper[5120]: I0316 16:12:50.943562 5120 scope.go:117] "RemoveContainer" containerID="85fba775e10e93053a28f47416e4fab8a8d74704457a1dcaa326ca7d97b5b71f" Mar 16 16:12:50 crc kubenswrapper[5120]: E0316 16:12:50.944033 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"85fba775e10e93053a28f47416e4fab8a8d74704457a1dcaa326ca7d97b5b71f\": container with ID starting with 85fba775e10e93053a28f47416e4fab8a8d74704457a1dcaa326ca7d97b5b71f not found: ID does not exist" containerID="85fba775e10e93053a28f47416e4fab8a8d74704457a1dcaa326ca7d97b5b71f" Mar 16 16:12:50 crc kubenswrapper[5120]: I0316 16:12:50.944069 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85fba775e10e93053a28f47416e4fab8a8d74704457a1dcaa326ca7d97b5b71f"} err="failed to get container status \"85fba775e10e93053a28f47416e4fab8a8d74704457a1dcaa326ca7d97b5b71f\": rpc error: code = NotFound desc = could not find container \"85fba775e10e93053a28f47416e4fab8a8d74704457a1dcaa326ca7d97b5b71f\": container with ID starting with 85fba775e10e93053a28f47416e4fab8a8d74704457a1dcaa326ca7d97b5b71f not found: ID does not exist" Mar 16 16:12:50 crc kubenswrapper[5120]: I0316 16:12:50.944089 5120 scope.go:117] "RemoveContainer" containerID="0f89eb629ca87b8f3c4dc3a654ad9be3b3dbf2b9befef91351aef67313564f2a" Mar 16 16:12:50 crc kubenswrapper[5120]: E0316 16:12:50.944454 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f89eb629ca87b8f3c4dc3a654ad9be3b3dbf2b9befef91351aef67313564f2a\": container with ID starting with 0f89eb629ca87b8f3c4dc3a654ad9be3b3dbf2b9befef91351aef67313564f2a not found: ID does not exist" containerID="0f89eb629ca87b8f3c4dc3a654ad9be3b3dbf2b9befef91351aef67313564f2a" Mar 16 16:12:50 crc kubenswrapper[5120]: I0316 16:12:50.944483 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f89eb629ca87b8f3c4dc3a654ad9be3b3dbf2b9befef91351aef67313564f2a"} err="failed to get container status \"0f89eb629ca87b8f3c4dc3a654ad9be3b3dbf2b9befef91351aef67313564f2a\": rpc error: code = NotFound desc = could not find container \"0f89eb629ca87b8f3c4dc3a654ad9be3b3dbf2b9befef91351aef67313564f2a\": container with ID starting with 0f89eb629ca87b8f3c4dc3a654ad9be3b3dbf2b9befef91351aef67313564f2a not found: ID does not exist" Mar 16 16:12:50 crc kubenswrapper[5120]: I0316 16:12:50.944535 5120 scope.go:117] "RemoveContainer" containerID="f1f5ef3a1ae4a49a755f7af35d2f4253955831c27a90812260b878eecdda0e64" Mar 16 16:12:50 crc kubenswrapper[5120]: E0316 16:12:50.944864 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f1f5ef3a1ae4a49a755f7af35d2f4253955831c27a90812260b878eecdda0e64\": container with ID starting with f1f5ef3a1ae4a49a755f7af35d2f4253955831c27a90812260b878eecdda0e64 not found: ID does not exist" containerID="f1f5ef3a1ae4a49a755f7af35d2f4253955831c27a90812260b878eecdda0e64" Mar 16 16:12:50 crc kubenswrapper[5120]: I0316 16:12:50.944898 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1f5ef3a1ae4a49a755f7af35d2f4253955831c27a90812260b878eecdda0e64"} err="failed to get container status \"f1f5ef3a1ae4a49a755f7af35d2f4253955831c27a90812260b878eecdda0e64\": rpc error: code = NotFound desc = could not find container \"f1f5ef3a1ae4a49a755f7af35d2f4253955831c27a90812260b878eecdda0e64\": container with ID starting with f1f5ef3a1ae4a49a755f7af35d2f4253955831c27a90812260b878eecdda0e64 not found: ID does not exist" Mar 16 16:12:50 crc kubenswrapper[5120]: I0316 16:12:50.944917 5120 scope.go:117] "RemoveContainer" containerID="f9a925d5514cb6701f37d65b406ab354233d03c77e454fdee7f9de6e3c4f2ec2" Mar 16 16:12:50 crc kubenswrapper[5120]: E0316 16:12:50.945262 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f9a925d5514cb6701f37d65b406ab354233d03c77e454fdee7f9de6e3c4f2ec2\": container with ID starting with f9a925d5514cb6701f37d65b406ab354233d03c77e454fdee7f9de6e3c4f2ec2 not found: ID does not exist" containerID="f9a925d5514cb6701f37d65b406ab354233d03c77e454fdee7f9de6e3c4f2ec2" Mar 16 16:12:50 crc kubenswrapper[5120]: I0316 16:12:50.945293 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9a925d5514cb6701f37d65b406ab354233d03c77e454fdee7f9de6e3c4f2ec2"} err="failed to get container status \"f9a925d5514cb6701f37d65b406ab354233d03c77e454fdee7f9de6e3c4f2ec2\": rpc error: code = NotFound desc = could not find container \"f9a925d5514cb6701f37d65b406ab354233d03c77e454fdee7f9de6e3c4f2ec2\": container with ID starting with f9a925d5514cb6701f37d65b406ab354233d03c77e454fdee7f9de6e3c4f2ec2 not found: ID does not exist" Mar 16 16:12:50 crc kubenswrapper[5120]: I0316 16:12:50.945311 5120 scope.go:117] "RemoveContainer" containerID="c0e4c801b2d8158c5198a10ed551d4bc0bd991a66fd9a3696cf629419472d00b" Mar 16 16:12:50 crc kubenswrapper[5120]: E0316 16:12:50.945627 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c0e4c801b2d8158c5198a10ed551d4bc0bd991a66fd9a3696cf629419472d00b\": container with ID starting with c0e4c801b2d8158c5198a10ed551d4bc0bd991a66fd9a3696cf629419472d00b not found: ID does not exist" containerID="c0e4c801b2d8158c5198a10ed551d4bc0bd991a66fd9a3696cf629419472d00b" Mar 16 16:12:50 crc kubenswrapper[5120]: I0316 16:12:50.945665 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0e4c801b2d8158c5198a10ed551d4bc0bd991a66fd9a3696cf629419472d00b"} err="failed to get container status \"c0e4c801b2d8158c5198a10ed551d4bc0bd991a66fd9a3696cf629419472d00b\": rpc error: code = NotFound desc = could not find container \"c0e4c801b2d8158c5198a10ed551d4bc0bd991a66fd9a3696cf629419472d00b\": container with ID starting with c0e4c801b2d8158c5198a10ed551d4bc0bd991a66fd9a3696cf629419472d00b not found: ID does not exist" Mar 16 16:12:50 crc kubenswrapper[5120]: I0316 16:12:50.945684 5120 scope.go:117] "RemoveContainer" containerID="bd5bde381422aec36b49a27e33e7df18130a58904e5277a758731159e4602f17" Mar 16 16:12:50 crc kubenswrapper[5120]: E0316 16:12:50.946069 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd5bde381422aec36b49a27e33e7df18130a58904e5277a758731159e4602f17\": container with ID starting with bd5bde381422aec36b49a27e33e7df18130a58904e5277a758731159e4602f17 not found: ID does not exist" containerID="bd5bde381422aec36b49a27e33e7df18130a58904e5277a758731159e4602f17" Mar 16 16:12:50 crc kubenswrapper[5120]: I0316 16:12:50.946093 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd5bde381422aec36b49a27e33e7df18130a58904e5277a758731159e4602f17"} err="failed to get container status \"bd5bde381422aec36b49a27e33e7df18130a58904e5277a758731159e4602f17\": rpc error: code = NotFound desc = could not find container \"bd5bde381422aec36b49a27e33e7df18130a58904e5277a758731159e4602f17\": container with ID starting with bd5bde381422aec36b49a27e33e7df18130a58904e5277a758731159e4602f17 not found: ID does not exist" Mar 16 16:12:50 crc kubenswrapper[5120]: I0316 16:12:50.946106 5120 scope.go:117] "RemoveContainer" containerID="51d5b8b2b99674a1960ad863d81ad3a57a5eb88f5643007686739c6718ac88e6" Mar 16 16:12:50 crc kubenswrapper[5120]: E0316 16:12:50.946455 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"51d5b8b2b99674a1960ad863d81ad3a57a5eb88f5643007686739c6718ac88e6\": container with ID starting with 51d5b8b2b99674a1960ad863d81ad3a57a5eb88f5643007686739c6718ac88e6 not found: ID does not exist" containerID="51d5b8b2b99674a1960ad863d81ad3a57a5eb88f5643007686739c6718ac88e6" Mar 16 16:12:50 crc kubenswrapper[5120]: I0316 16:12:50.946488 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51d5b8b2b99674a1960ad863d81ad3a57a5eb88f5643007686739c6718ac88e6"} err="failed to get container status \"51d5b8b2b99674a1960ad863d81ad3a57a5eb88f5643007686739c6718ac88e6\": rpc error: code = NotFound desc = could not find container \"51d5b8b2b99674a1960ad863d81ad3a57a5eb88f5643007686739c6718ac88e6\": container with ID starting with 51d5b8b2b99674a1960ad863d81ad3a57a5eb88f5643007686739c6718ac88e6 not found: ID does not exist" Mar 16 16:12:50 crc kubenswrapper[5120]: I0316 16:12:50.946506 5120 scope.go:117] "RemoveContainer" containerID="c68e0b66544e05eeafb40a0ede57f1aaffd7e86fe267efb1d86740b24f029cd4" Mar 16 16:12:50 crc kubenswrapper[5120]: E0316 16:12:50.946993 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c68e0b66544e05eeafb40a0ede57f1aaffd7e86fe267efb1d86740b24f029cd4\": container with ID starting with c68e0b66544e05eeafb40a0ede57f1aaffd7e86fe267efb1d86740b24f029cd4 not found: ID does not exist" containerID="c68e0b66544e05eeafb40a0ede57f1aaffd7e86fe267efb1d86740b24f029cd4" Mar 16 16:12:50 crc kubenswrapper[5120]: I0316 16:12:50.947014 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c68e0b66544e05eeafb40a0ede57f1aaffd7e86fe267efb1d86740b24f029cd4"} err="failed to get container status \"c68e0b66544e05eeafb40a0ede57f1aaffd7e86fe267efb1d86740b24f029cd4\": rpc error: code = NotFound desc = could not find container \"c68e0b66544e05eeafb40a0ede57f1aaffd7e86fe267efb1d86740b24f029cd4\": container with ID starting with c68e0b66544e05eeafb40a0ede57f1aaffd7e86fe267efb1d86740b24f029cd4 not found: ID does not exist" Mar 16 16:12:50 crc kubenswrapper[5120]: I0316 16:12:50.947028 5120 scope.go:117] "RemoveContainer" containerID="4bce9c9cadac21d7a22c0911253a06b757eab3c3a10ee9e0b5056d5ddc880b03" Mar 16 16:12:50 crc kubenswrapper[5120]: E0316 16:12:50.947310 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4bce9c9cadac21d7a22c0911253a06b757eab3c3a10ee9e0b5056d5ddc880b03\": container with ID starting with 4bce9c9cadac21d7a22c0911253a06b757eab3c3a10ee9e0b5056d5ddc880b03 not found: ID does not exist" containerID="4bce9c9cadac21d7a22c0911253a06b757eab3c3a10ee9e0b5056d5ddc880b03" Mar 16 16:12:50 crc kubenswrapper[5120]: I0316 16:12:50.947335 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4bce9c9cadac21d7a22c0911253a06b757eab3c3a10ee9e0b5056d5ddc880b03"} err="failed to get container status \"4bce9c9cadac21d7a22c0911253a06b757eab3c3a10ee9e0b5056d5ddc880b03\": rpc error: code = NotFound desc = could not find container \"4bce9c9cadac21d7a22c0911253a06b757eab3c3a10ee9e0b5056d5ddc880b03\": container with ID starting with 4bce9c9cadac21d7a22c0911253a06b757eab3c3a10ee9e0b5056d5ddc880b03 not found: ID does not exist" Mar 16 16:12:50 crc kubenswrapper[5120]: I0316 16:12:50.947349 5120 scope.go:117] "RemoveContainer" containerID="d15b7b1dedfc5e0bf45e87214537c30c6e63e98b399564a5d04a921d97d3ee71" Mar 16 16:12:50 crc kubenswrapper[5120]: E0316 16:12:50.947632 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d15b7b1dedfc5e0bf45e87214537c30c6e63e98b399564a5d04a921d97d3ee71\": container with ID starting with d15b7b1dedfc5e0bf45e87214537c30c6e63e98b399564a5d04a921d97d3ee71 not found: ID does not exist" containerID="d15b7b1dedfc5e0bf45e87214537c30c6e63e98b399564a5d04a921d97d3ee71" Mar 16 16:12:50 crc kubenswrapper[5120]: I0316 16:12:50.947649 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d15b7b1dedfc5e0bf45e87214537c30c6e63e98b399564a5d04a921d97d3ee71"} err="failed to get container status \"d15b7b1dedfc5e0bf45e87214537c30c6e63e98b399564a5d04a921d97d3ee71\": rpc error: code = NotFound desc = could not find container \"d15b7b1dedfc5e0bf45e87214537c30c6e63e98b399564a5d04a921d97d3ee71\": container with ID starting with d15b7b1dedfc5e0bf45e87214537c30c6e63e98b399564a5d04a921d97d3ee71 not found: ID does not exist" Mar 16 16:12:50 crc kubenswrapper[5120]: I0316 16:12:50.947661 5120 scope.go:117] "RemoveContainer" containerID="7f52beabfcff3227464395535efe06bcce13fd954b9eb69868803bda7c0f42b8" Mar 16 16:12:50 crc kubenswrapper[5120]: E0316 16:12:50.948048 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f52beabfcff3227464395535efe06bcce13fd954b9eb69868803bda7c0f42b8\": container with ID starting with 7f52beabfcff3227464395535efe06bcce13fd954b9eb69868803bda7c0f42b8 not found: ID does not exist" containerID="7f52beabfcff3227464395535efe06bcce13fd954b9eb69868803bda7c0f42b8" Mar 16 16:12:50 crc kubenswrapper[5120]: I0316 16:12:50.948096 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f52beabfcff3227464395535efe06bcce13fd954b9eb69868803bda7c0f42b8"} err="failed to get container status \"7f52beabfcff3227464395535efe06bcce13fd954b9eb69868803bda7c0f42b8\": rpc error: code = NotFound desc = could not find container \"7f52beabfcff3227464395535efe06bcce13fd954b9eb69868803bda7c0f42b8\": container with ID starting with 7f52beabfcff3227464395535efe06bcce13fd954b9eb69868803bda7c0f42b8 not found: ID does not exist" Mar 16 16:12:50 crc kubenswrapper[5120]: I0316 16:12:50.957856 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/5cf58a8f-dfb4-4a0a-b96c-000333125dd0-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:50 crc kubenswrapper[5120]: I0316 16:12:50.957881 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5cf58a8f-dfb4-4a0a-b96c-000333125dd0-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:50 crc kubenswrapper[5120]: I0316 16:12:50.957907 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/5cf58a8f-dfb4-4a0a-b96c-000333125dd0-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:50 crc kubenswrapper[5120]: I0316 16:12:50.957917 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kfnvv\" (UniqueName: \"kubernetes.io/projected/5cf58a8f-dfb4-4a0a-b96c-000333125dd0-kube-api-access-kfnvv\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:50 crc kubenswrapper[5120]: I0316 16:12:50.957926 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/5cf58a8f-dfb4-4a0a-b96c-000333125dd0-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:50 crc kubenswrapper[5120]: I0316 16:12:50.957934 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/5cf58a8f-dfb4-4a0a-b96c-000333125dd0-httpd-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:50 crc kubenswrapper[5120]: I0316 16:12:50.957942 5120 reconciler_common.go:299] "Volume detached for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/5cf58a8f-dfb4-4a0a-b96c-000333125dd0-ovndb-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:51 crc kubenswrapper[5120]: I0316 16:12:51.490600 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-cb8df78d6-4gf8s_5cf58a8f-dfb4-4a0a-b96c-000333125dd0/neutron-api/0.log" Mar 16 16:12:51 crc kubenswrapper[5120]: I0316 16:12:51.490706 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-cb8df78d6-4gf8s" event={"ID":"5cf58a8f-dfb4-4a0a-b96c-000333125dd0","Type":"ContainerDied","Data":"04ad1d3cf12f56d1e6198b289cd6f8587f4ccab4fa54d82499dd834786008224"} Mar 16 16:12:51 crc kubenswrapper[5120]: I0316 16:12:51.490751 5120 scope.go:117] "RemoveContainer" containerID="773740d0b4fcf1873d3b8d878cfa118bc3e28448d6a770da23e0930fde30d6cc" Mar 16 16:12:51 crc kubenswrapper[5120]: I0316 16:12:51.490921 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-cb8df78d6-4gf8s" Mar 16 16:12:51 crc kubenswrapper[5120]: I0316 16:12:51.530520 5120 scope.go:117] "RemoveContainer" containerID="2af07be619d918d455ab3453bb4c324e7039b7c37a76d4c43b38c031fb72a931" Mar 16 16:12:51 crc kubenswrapper[5120]: I0316 16:12:51.545361 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-cb8df78d6-4gf8s"] Mar 16 16:12:51 crc kubenswrapper[5120]: I0316 16:12:51.550438 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-cb8df78d6-4gf8s"] Mar 16 16:12:51 crc kubenswrapper[5120]: I0316 16:12:51.714507 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/ceilometer-0" podUID="f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5" containerName="proxy-httpd" probeResult="failure" output="Get \"https://10.217.0.159:3000/\": dial tcp 10.217.0.159:3000: connect: connection refused" Mar 16 16:12:52 crc kubenswrapper[5120]: I0316 16:12:52.032494 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:12:52 crc kubenswrapper[5120]: I0316 16:12:52.077019 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bce71378-f7b0-4b73-8b4a-711353734319-config-data\") pod \"bce71378-f7b0-4b73-8b4a-711353734319\" (UID: \"bce71378-f7b0-4b73-8b4a-711353734319\") " Mar 16 16:12:52 crc kubenswrapper[5120]: I0316 16:12:52.077086 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bce71378-f7b0-4b73-8b4a-711353734319-combined-ca-bundle\") pod \"bce71378-f7b0-4b73-8b4a-711353734319\" (UID: \"bce71378-f7b0-4b73-8b4a-711353734319\") " Mar 16 16:12:52 crc kubenswrapper[5120]: I0316 16:12:52.077344 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5xkps\" (UniqueName: \"kubernetes.io/projected/bce71378-f7b0-4b73-8b4a-711353734319-kube-api-access-5xkps\") pod \"bce71378-f7b0-4b73-8b4a-711353734319\" (UID: \"bce71378-f7b0-4b73-8b4a-711353734319\") " Mar 16 16:12:52 crc kubenswrapper[5120]: I0316 16:12:52.081855 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bce71378-f7b0-4b73-8b4a-711353734319-kube-api-access-5xkps" (OuterVolumeSpecName: "kube-api-access-5xkps") pod "bce71378-f7b0-4b73-8b4a-711353734319" (UID: "bce71378-f7b0-4b73-8b4a-711353734319"). InnerVolumeSpecName "kube-api-access-5xkps". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:12:52 crc kubenswrapper[5120]: I0316 16:12:52.088566 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:12:52 crc kubenswrapper[5120]: I0316 16:12:52.100307 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bce71378-f7b0-4b73-8b4a-711353734319-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "bce71378-f7b0-4b73-8b4a-711353734319" (UID: "bce71378-f7b0-4b73-8b4a-711353734319"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:52 crc kubenswrapper[5120]: I0316 16:12:52.108084 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bce71378-f7b0-4b73-8b4a-711353734319-config-data" (OuterVolumeSpecName: "config-data") pod "bce71378-f7b0-4b73-8b4a-711353734319" (UID: "bce71378-f7b0-4b73-8b4a-711353734319"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:52 crc kubenswrapper[5120]: I0316 16:12:52.178570 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5-sg-core-conf-yaml\") pod \"f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5\" (UID: \"f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5\") " Mar 16 16:12:52 crc kubenswrapper[5120]: I0316 16:12:52.178678 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fxg57\" (UniqueName: \"kubernetes.io/projected/f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5-kube-api-access-fxg57\") pod \"f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5\" (UID: \"f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5\") " Mar 16 16:12:52 crc kubenswrapper[5120]: I0316 16:12:52.179240 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5-scripts\") pod \"f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5\" (UID: \"f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5\") " Mar 16 16:12:52 crc kubenswrapper[5120]: I0316 16:12:52.179302 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5-run-httpd\") pod \"f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5\" (UID: \"f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5\") " Mar 16 16:12:52 crc kubenswrapper[5120]: I0316 16:12:52.179323 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5-config-data\") pod \"f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5\" (UID: \"f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5\") " Mar 16 16:12:52 crc kubenswrapper[5120]: I0316 16:12:52.179365 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5-combined-ca-bundle\") pod \"f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5\" (UID: \"f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5\") " Mar 16 16:12:52 crc kubenswrapper[5120]: I0316 16:12:52.179441 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5-ceilometer-tls-certs\") pod \"f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5\" (UID: \"f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5\") " Mar 16 16:12:52 crc kubenswrapper[5120]: I0316 16:12:52.179523 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5-log-httpd\") pod \"f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5\" (UID: \"f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5\") " Mar 16 16:12:52 crc kubenswrapper[5120]: I0316 16:12:52.179631 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5" (UID: "f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:12:52 crc kubenswrapper[5120]: I0316 16:12:52.179952 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5" (UID: "f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:12:52 crc kubenswrapper[5120]: I0316 16:12:52.180278 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bce71378-f7b0-4b73-8b4a-711353734319-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:52 crc kubenswrapper[5120]: I0316 16:12:52.180301 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bce71378-f7b0-4b73-8b4a-711353734319-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:52 crc kubenswrapper[5120]: I0316 16:12:52.180315 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:52 crc kubenswrapper[5120]: I0316 16:12:52.180328 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5xkps\" (UniqueName: \"kubernetes.io/projected/bce71378-f7b0-4b73-8b4a-711353734319-kube-api-access-5xkps\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:52 crc kubenswrapper[5120]: I0316 16:12:52.180339 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:52 crc kubenswrapper[5120]: I0316 16:12:52.182188 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5-kube-api-access-fxg57" (OuterVolumeSpecName: "kube-api-access-fxg57") pod "f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5" (UID: "f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5"). InnerVolumeSpecName "kube-api-access-fxg57". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:12:52 crc kubenswrapper[5120]: I0316 16:12:52.183052 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5-scripts" (OuterVolumeSpecName: "scripts") pod "f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5" (UID: "f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:52 crc kubenswrapper[5120]: I0316 16:12:52.204900 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5" (UID: "f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:52 crc kubenswrapper[5120]: I0316 16:12:52.230207 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5-ceilometer-tls-certs" (OuterVolumeSpecName: "ceilometer-tls-certs") pod "f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5" (UID: "f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5"). InnerVolumeSpecName "ceilometer-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:52 crc kubenswrapper[5120]: I0316 16:12:52.239956 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5" (UID: "f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:52 crc kubenswrapper[5120]: I0316 16:12:52.263979 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5-config-data" (OuterVolumeSpecName: "config-data") pod "f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5" (UID: "f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:52 crc kubenswrapper[5120]: I0316 16:12:52.282255 5120 reconciler_common.go:299] "Volume detached for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5-ceilometer-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:52 crc kubenswrapper[5120]: I0316 16:12:52.282288 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:52 crc kubenswrapper[5120]: I0316 16:12:52.282299 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fxg57\" (UniqueName: \"kubernetes.io/projected/f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5-kube-api-access-fxg57\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:52 crc kubenswrapper[5120]: I0316 16:12:52.282311 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:52 crc kubenswrapper[5120]: I0316 16:12:52.282340 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:52 crc kubenswrapper[5120]: I0316 16:12:52.282350 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:52 crc kubenswrapper[5120]: E0316 16:12:52.406882 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 0694d284d33b8f4728b5b5db2443c16f6b7c4ab92062463e2013167e4b4a7dc6 is running failed: container process not found" containerID="0694d284d33b8f4728b5b5db2443c16f6b7c4ab92062463e2013167e4b4a7dc6" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:12:52 crc kubenswrapper[5120]: E0316 16:12:52.407465 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 0694d284d33b8f4728b5b5db2443c16f6b7c4ab92062463e2013167e4b4a7dc6 is running failed: container process not found" containerID="0694d284d33b8f4728b5b5db2443c16f6b7c4ab92062463e2013167e4b4a7dc6" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:12:52 crc kubenswrapper[5120]: E0316 16:12:52.407740 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 0694d284d33b8f4728b5b5db2443c16f6b7c4ab92062463e2013167e4b4a7dc6 is running failed: container process not found" containerID="0694d284d33b8f4728b5b5db2443c16f6b7c4ab92062463e2013167e4b4a7dc6" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:12:52 crc kubenswrapper[5120]: E0316 16:12:52.407844 5120 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 0694d284d33b8f4728b5b5db2443c16f6b7c4ab92062463e2013167e4b4a7dc6 is running failed: container process not found" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="bba65a98-1383-4c8c-995a-b212b232d1f8" containerName="nova-scheduler-scheduler" probeResult="unknown" Mar 16 16:12:52 crc kubenswrapper[5120]: I0316 16:12:52.414845 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:12:52 crc kubenswrapper[5120]: I0316 16:12:52.485462 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bba65a98-1383-4c8c-995a-b212b232d1f8-config-data\") pod \"bba65a98-1383-4c8c-995a-b212b232d1f8\" (UID: \"bba65a98-1383-4c8c-995a-b212b232d1f8\") " Mar 16 16:12:52 crc kubenswrapper[5120]: I0316 16:12:52.485537 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qnpgr\" (UniqueName: \"kubernetes.io/projected/bba65a98-1383-4c8c-995a-b212b232d1f8-kube-api-access-qnpgr\") pod \"bba65a98-1383-4c8c-995a-b212b232d1f8\" (UID: \"bba65a98-1383-4c8c-995a-b212b232d1f8\") " Mar 16 16:12:52 crc kubenswrapper[5120]: I0316 16:12:52.485622 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bba65a98-1383-4c8c-995a-b212b232d1f8-combined-ca-bundle\") pod \"bba65a98-1383-4c8c-995a-b212b232d1f8\" (UID: \"bba65a98-1383-4c8c-995a-b212b232d1f8\") " Mar 16 16:12:52 crc kubenswrapper[5120]: I0316 16:12:52.491614 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bba65a98-1383-4c8c-995a-b212b232d1f8-kube-api-access-qnpgr" (OuterVolumeSpecName: "kube-api-access-qnpgr") pod "bba65a98-1383-4c8c-995a-b212b232d1f8" (UID: "bba65a98-1383-4c8c-995a-b212b232d1f8"). InnerVolumeSpecName "kube-api-access-qnpgr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:12:52 crc kubenswrapper[5120]: I0316 16:12:52.503579 5120 generic.go:358] "Generic (PLEG): container finished" podID="bba65a98-1383-4c8c-995a-b212b232d1f8" containerID="0694d284d33b8f4728b5b5db2443c16f6b7c4ab92062463e2013167e4b4a7dc6" exitCode=137 Mar 16 16:12:52 crc kubenswrapper[5120]: I0316 16:12:52.503673 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:12:52 crc kubenswrapper[5120]: I0316 16:12:52.503688 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"bba65a98-1383-4c8c-995a-b212b232d1f8","Type":"ContainerDied","Data":"0694d284d33b8f4728b5b5db2443c16f6b7c4ab92062463e2013167e4b4a7dc6"} Mar 16 16:12:52 crc kubenswrapper[5120]: I0316 16:12:52.503716 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"bba65a98-1383-4c8c-995a-b212b232d1f8","Type":"ContainerDied","Data":"20d3428884c65ee0eee4c6ccc087ee84862e2cb78d70c3394dfd864f14bb0d36"} Mar 16 16:12:52 crc kubenswrapper[5120]: I0316 16:12:52.503734 5120 scope.go:117] "RemoveContainer" containerID="0694d284d33b8f4728b5b5db2443c16f6b7c4ab92062463e2013167e4b4a7dc6" Mar 16 16:12:52 crc kubenswrapper[5120]: E0316 16:12:52.507445 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bba65a98-1383-4c8c-995a-b212b232d1f8-combined-ca-bundle podName:bba65a98-1383-4c8c-995a-b212b232d1f8 nodeName:}" failed. No retries permitted until 2026-03-16 16:12:53.007396239 +0000 UTC m=+2475.161327896 (durationBeforeRetry 500ms). Error: error cleaning subPath mounts for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/bba65a98-1383-4c8c-995a-b212b232d1f8-combined-ca-bundle") pod "bba65a98-1383-4c8c-995a-b212b232d1f8" (UID: "bba65a98-1383-4c8c-995a-b212b232d1f8") : error deleting /var/lib/kubelet/pods/bba65a98-1383-4c8c-995a-b212b232d1f8/volume-subpaths: remove /var/lib/kubelet/pods/bba65a98-1383-4c8c-995a-b212b232d1f8/volume-subpaths: no such file or directory Mar 16 16:12:52 crc kubenswrapper[5120]: I0316 16:12:52.509152 5120 generic.go:358] "Generic (PLEG): container finished" podID="f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5" containerID="f23a5e504b736c5521e9e56ab980b7e85624440220852c3fe893ee02d1581dca" exitCode=137 Mar 16 16:12:52 crc kubenswrapper[5120]: I0316 16:12:52.509283 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:12:52 crc kubenswrapper[5120]: I0316 16:12:52.509452 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5","Type":"ContainerDied","Data":"f23a5e504b736c5521e9e56ab980b7e85624440220852c3fe893ee02d1581dca"} Mar 16 16:12:52 crc kubenswrapper[5120]: I0316 16:12:52.509494 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5","Type":"ContainerDied","Data":"4c48e48c864bb8847a7e5e63fa7db9ad40281d4084e0d178e15d88639def9e3d"} Mar 16 16:12:52 crc kubenswrapper[5120]: I0316 16:12:52.510544 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bba65a98-1383-4c8c-995a-b212b232d1f8-config-data" (OuterVolumeSpecName: "config-data") pod "bba65a98-1383-4c8c-995a-b212b232d1f8" (UID: "bba65a98-1383-4c8c-995a-b212b232d1f8"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:52 crc kubenswrapper[5120]: I0316 16:12:52.514653 5120 generic.go:358] "Generic (PLEG): container finished" podID="bce71378-f7b0-4b73-8b4a-711353734319" containerID="db11af3fe6b07413600ae44f79a3df378f43385bd524e92444794183d150e508" exitCode=137 Mar 16 16:12:52 crc kubenswrapper[5120]: I0316 16:12:52.514716 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:12:52 crc kubenswrapper[5120]: I0316 16:12:52.514732 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"bce71378-f7b0-4b73-8b4a-711353734319","Type":"ContainerDied","Data":"db11af3fe6b07413600ae44f79a3df378f43385bd524e92444794183d150e508"} Mar 16 16:12:52 crc kubenswrapper[5120]: I0316 16:12:52.514795 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"bce71378-f7b0-4b73-8b4a-711353734319","Type":"ContainerDied","Data":"4f46a3ba665637a0e692425604d96b6d751f78b3507578f417d25d74726103eb"} Mar 16 16:12:52 crc kubenswrapper[5120]: I0316 16:12:52.528373 5120 scope.go:117] "RemoveContainer" containerID="0694d284d33b8f4728b5b5db2443c16f6b7c4ab92062463e2013167e4b4a7dc6" Mar 16 16:12:52 crc kubenswrapper[5120]: E0316 16:12:52.528994 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0694d284d33b8f4728b5b5db2443c16f6b7c4ab92062463e2013167e4b4a7dc6\": container with ID starting with 0694d284d33b8f4728b5b5db2443c16f6b7c4ab92062463e2013167e4b4a7dc6 not found: ID does not exist" containerID="0694d284d33b8f4728b5b5db2443c16f6b7c4ab92062463e2013167e4b4a7dc6" Mar 16 16:12:52 crc kubenswrapper[5120]: I0316 16:12:52.529038 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0694d284d33b8f4728b5b5db2443c16f6b7c4ab92062463e2013167e4b4a7dc6"} err="failed to get container status \"0694d284d33b8f4728b5b5db2443c16f6b7c4ab92062463e2013167e4b4a7dc6\": rpc error: code = NotFound desc = could not find container \"0694d284d33b8f4728b5b5db2443c16f6b7c4ab92062463e2013167e4b4a7dc6\": container with ID starting with 0694d284d33b8f4728b5b5db2443c16f6b7c4ab92062463e2013167e4b4a7dc6 not found: ID does not exist" Mar 16 16:12:52 crc kubenswrapper[5120]: I0316 16:12:52.529057 5120 scope.go:117] "RemoveContainer" containerID="da584e6bdd5f6d1ceaf64b1de15d36cf92d4ec19aa56b2e4705b2d6f7c89c834" Mar 16 16:12:52 crc kubenswrapper[5120]: I0316 16:12:52.587430 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bba65a98-1383-4c8c-995a-b212b232d1f8-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:52 crc kubenswrapper[5120]: I0316 16:12:52.587461 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qnpgr\" (UniqueName: \"kubernetes.io/projected/bba65a98-1383-4c8c-995a-b212b232d1f8-kube-api-access-qnpgr\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:52 crc kubenswrapper[5120]: I0316 16:12:52.617961 5120 scope.go:117] "RemoveContainer" containerID="ef0d85dafcbfd3191d70121e50e81623c612e9907822eea5b7266da0a9d3455f" Mar 16 16:12:52 crc kubenswrapper[5120]: I0316 16:12:52.634535 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 16:12:52 crc kubenswrapper[5120]: I0316 16:12:52.639223 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 16:12:52 crc kubenswrapper[5120]: I0316 16:12:52.643910 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:12:52 crc kubenswrapper[5120]: I0316 16:12:52.648566 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:12:52 crc kubenswrapper[5120]: I0316 16:12:52.649198 5120 scope.go:117] "RemoveContainer" containerID="5659e4bf80f0be1a407d06d3ba6dc5bc6f3128381585870fdde39acc6b1637fe" Mar 16 16:12:52 crc kubenswrapper[5120]: I0316 16:12:52.670896 5120 scope.go:117] "RemoveContainer" containerID="f23a5e504b736c5521e9e56ab980b7e85624440220852c3fe893ee02d1581dca" Mar 16 16:12:52 crc kubenswrapper[5120]: I0316 16:12:52.673805 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5cf58a8f-dfb4-4a0a-b96c-000333125dd0" path="/var/lib/kubelet/pods/5cf58a8f-dfb4-4a0a-b96c-000333125dd0/volumes" Mar 16 16:12:52 crc kubenswrapper[5120]: I0316 16:12:52.674355 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="96d66c8e-8cdb-462c-a302-c85e581db5ad" path="/var/lib/kubelet/pods/96d66c8e-8cdb-462c-a302-c85e581db5ad/volumes" Mar 16 16:12:52 crc kubenswrapper[5120]: I0316 16:12:52.675100 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bce71378-f7b0-4b73-8b4a-711353734319" path="/var/lib/kubelet/pods/bce71378-f7b0-4b73-8b4a-711353734319/volumes" Mar 16 16:12:52 crc kubenswrapper[5120]: I0316 16:12:52.676062 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5" path="/var/lib/kubelet/pods/f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5/volumes" Mar 16 16:12:52 crc kubenswrapper[5120]: I0316 16:12:52.696494 5120 scope.go:117] "RemoveContainer" containerID="da584e6bdd5f6d1ceaf64b1de15d36cf92d4ec19aa56b2e4705b2d6f7c89c834" Mar 16 16:12:52 crc kubenswrapper[5120]: E0316 16:12:52.696851 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da584e6bdd5f6d1ceaf64b1de15d36cf92d4ec19aa56b2e4705b2d6f7c89c834\": container with ID starting with da584e6bdd5f6d1ceaf64b1de15d36cf92d4ec19aa56b2e4705b2d6f7c89c834 not found: ID does not exist" containerID="da584e6bdd5f6d1ceaf64b1de15d36cf92d4ec19aa56b2e4705b2d6f7c89c834" Mar 16 16:12:52 crc kubenswrapper[5120]: I0316 16:12:52.696876 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da584e6bdd5f6d1ceaf64b1de15d36cf92d4ec19aa56b2e4705b2d6f7c89c834"} err="failed to get container status \"da584e6bdd5f6d1ceaf64b1de15d36cf92d4ec19aa56b2e4705b2d6f7c89c834\": rpc error: code = NotFound desc = could not find container \"da584e6bdd5f6d1ceaf64b1de15d36cf92d4ec19aa56b2e4705b2d6f7c89c834\": container with ID starting with da584e6bdd5f6d1ceaf64b1de15d36cf92d4ec19aa56b2e4705b2d6f7c89c834 not found: ID does not exist" Mar 16 16:12:52 crc kubenswrapper[5120]: I0316 16:12:52.696895 5120 scope.go:117] "RemoveContainer" containerID="ef0d85dafcbfd3191d70121e50e81623c612e9907822eea5b7266da0a9d3455f" Mar 16 16:12:52 crc kubenswrapper[5120]: E0316 16:12:52.697244 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ef0d85dafcbfd3191d70121e50e81623c612e9907822eea5b7266da0a9d3455f\": container with ID starting with ef0d85dafcbfd3191d70121e50e81623c612e9907822eea5b7266da0a9d3455f not found: ID does not exist" containerID="ef0d85dafcbfd3191d70121e50e81623c612e9907822eea5b7266da0a9d3455f" Mar 16 16:12:52 crc kubenswrapper[5120]: I0316 16:12:52.697295 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef0d85dafcbfd3191d70121e50e81623c612e9907822eea5b7266da0a9d3455f"} err="failed to get container status \"ef0d85dafcbfd3191d70121e50e81623c612e9907822eea5b7266da0a9d3455f\": rpc error: code = NotFound desc = could not find container \"ef0d85dafcbfd3191d70121e50e81623c612e9907822eea5b7266da0a9d3455f\": container with ID starting with ef0d85dafcbfd3191d70121e50e81623c612e9907822eea5b7266da0a9d3455f not found: ID does not exist" Mar 16 16:12:52 crc kubenswrapper[5120]: I0316 16:12:52.697321 5120 scope.go:117] "RemoveContainer" containerID="5659e4bf80f0be1a407d06d3ba6dc5bc6f3128381585870fdde39acc6b1637fe" Mar 16 16:12:52 crc kubenswrapper[5120]: E0316 16:12:52.697683 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5659e4bf80f0be1a407d06d3ba6dc5bc6f3128381585870fdde39acc6b1637fe\": container with ID starting with 5659e4bf80f0be1a407d06d3ba6dc5bc6f3128381585870fdde39acc6b1637fe not found: ID does not exist" containerID="5659e4bf80f0be1a407d06d3ba6dc5bc6f3128381585870fdde39acc6b1637fe" Mar 16 16:12:52 crc kubenswrapper[5120]: I0316 16:12:52.697728 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5659e4bf80f0be1a407d06d3ba6dc5bc6f3128381585870fdde39acc6b1637fe"} err="failed to get container status \"5659e4bf80f0be1a407d06d3ba6dc5bc6f3128381585870fdde39acc6b1637fe\": rpc error: code = NotFound desc = could not find container \"5659e4bf80f0be1a407d06d3ba6dc5bc6f3128381585870fdde39acc6b1637fe\": container with ID starting with 5659e4bf80f0be1a407d06d3ba6dc5bc6f3128381585870fdde39acc6b1637fe not found: ID does not exist" Mar 16 16:12:52 crc kubenswrapper[5120]: I0316 16:12:52.697996 5120 scope.go:117] "RemoveContainer" containerID="f23a5e504b736c5521e9e56ab980b7e85624440220852c3fe893ee02d1581dca" Mar 16 16:12:52 crc kubenswrapper[5120]: E0316 16:12:52.698478 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f23a5e504b736c5521e9e56ab980b7e85624440220852c3fe893ee02d1581dca\": container with ID starting with f23a5e504b736c5521e9e56ab980b7e85624440220852c3fe893ee02d1581dca not found: ID does not exist" containerID="f23a5e504b736c5521e9e56ab980b7e85624440220852c3fe893ee02d1581dca" Mar 16 16:12:52 crc kubenswrapper[5120]: I0316 16:12:52.698515 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f23a5e504b736c5521e9e56ab980b7e85624440220852c3fe893ee02d1581dca"} err="failed to get container status \"f23a5e504b736c5521e9e56ab980b7e85624440220852c3fe893ee02d1581dca\": rpc error: code = NotFound desc = could not find container \"f23a5e504b736c5521e9e56ab980b7e85624440220852c3fe893ee02d1581dca\": container with ID starting with f23a5e504b736c5521e9e56ab980b7e85624440220852c3fe893ee02d1581dca not found: ID does not exist" Mar 16 16:12:52 crc kubenswrapper[5120]: I0316 16:12:52.698540 5120 scope.go:117] "RemoveContainer" containerID="db11af3fe6b07413600ae44f79a3df378f43385bd524e92444794183d150e508" Mar 16 16:12:52 crc kubenswrapper[5120]: I0316 16:12:52.716506 5120 scope.go:117] "RemoveContainer" containerID="db11af3fe6b07413600ae44f79a3df378f43385bd524e92444794183d150e508" Mar 16 16:12:52 crc kubenswrapper[5120]: E0316 16:12:52.717592 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db11af3fe6b07413600ae44f79a3df378f43385bd524e92444794183d150e508\": container with ID starting with db11af3fe6b07413600ae44f79a3df378f43385bd524e92444794183d150e508 not found: ID does not exist" containerID="db11af3fe6b07413600ae44f79a3df378f43385bd524e92444794183d150e508" Mar 16 16:12:52 crc kubenswrapper[5120]: I0316 16:12:52.717645 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db11af3fe6b07413600ae44f79a3df378f43385bd524e92444794183d150e508"} err="failed to get container status \"db11af3fe6b07413600ae44f79a3df378f43385bd524e92444794183d150e508\": rpc error: code = NotFound desc = could not find container \"db11af3fe6b07413600ae44f79a3df378f43385bd524e92444794183d150e508\": container with ID starting with db11af3fe6b07413600ae44f79a3df378f43385bd524e92444794183d150e508 not found: ID does not exist" Mar 16 16:12:53 crc kubenswrapper[5120]: I0316 16:12:53.091687 5120 pod_container_manager_linux.go:217] "Failed to delete cgroup paths" cgroupName=["kubepods","besteffort","pod5aa11a39-e139-4791-92ce-2771b0277a8b"] err="unable to destroy cgroup paths for cgroup [kubepods besteffort pod5aa11a39-e139-4791-92ce-2771b0277a8b] : Timed out while waiting for systemd to remove kubepods-besteffort-pod5aa11a39_e139_4791_92ce_2771b0277a8b.slice" Mar 16 16:12:53 crc kubenswrapper[5120]: E0316 16:12:53.091788 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to delete cgroup paths for [kubepods besteffort pod5aa11a39-e139-4791-92ce-2771b0277a8b] : unable to destroy cgroup paths for cgroup [kubepods besteffort pod5aa11a39-e139-4791-92ce-2771b0277a8b] : Timed out while waiting for systemd to remove kubepods-besteffort-pod5aa11a39_e139_4791_92ce_2771b0277a8b.slice" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="5aa11a39-e139-4791-92ce-2771b0277a8b" Mar 16 16:12:53 crc kubenswrapper[5120]: I0316 16:12:53.093941 5120 pod_container_manager_linux.go:217] "Failed to delete cgroup paths" cgroupName=["kubepods","besteffort","poda8389bad-6789-42fe-8506-5ac83ff9514f"] err="unable to destroy cgroup paths for cgroup [kubepods besteffort poda8389bad-6789-42fe-8506-5ac83ff9514f] : Timed out while waiting for systemd to remove kubepods-besteffort-poda8389bad_6789_42fe_8506_5ac83ff9514f.slice" Mar 16 16:12:53 crc kubenswrapper[5120]: E0316 16:12:53.093975 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to delete cgroup paths for [kubepods besteffort poda8389bad-6789-42fe-8506-5ac83ff9514f] : unable to destroy cgroup paths for cgroup [kubepods besteffort poda8389bad-6789-42fe-8506-5ac83ff9514f] : Timed out while waiting for systemd to remove kubepods-besteffort-poda8389bad_6789_42fe_8506_5ac83ff9514f.slice" pod="openstack-kuttl-tests/openstackclient" podUID="a8389bad-6789-42fe-8506-5ac83ff9514f" Mar 16 16:12:53 crc kubenswrapper[5120]: I0316 16:12:53.094363 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bba65a98-1383-4c8c-995a-b212b232d1f8-combined-ca-bundle\") pod \"bba65a98-1383-4c8c-995a-b212b232d1f8\" (UID: \"bba65a98-1383-4c8c-995a-b212b232d1f8\") " Mar 16 16:12:53 crc kubenswrapper[5120]: I0316 16:12:53.098191 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bba65a98-1383-4c8c-995a-b212b232d1f8-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "bba65a98-1383-4c8c-995a-b212b232d1f8" (UID: "bba65a98-1383-4c8c-995a-b212b232d1f8"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:12:53 crc kubenswrapper[5120]: I0316 16:12:53.149013 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:12:53 crc kubenswrapper[5120]: I0316 16:12:53.155447 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:12:53 crc kubenswrapper[5120]: I0316 16:12:53.196905 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bba65a98-1383-4c8c-995a-b212b232d1f8-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:12:53 crc kubenswrapper[5120]: I0316 16:12:53.550206 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Mar 16 16:12:53 crc kubenswrapper[5120]: I0316 16:12:53.550231 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:12:53 crc kubenswrapper[5120]: I0316 16:12:53.558023 5120 status_manager.go:895] "Failed to get status for pod" podUID="a8389bad-6789-42fe-8506-5ac83ff9514f" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 16:12:53 crc kubenswrapper[5120]: I0316 16:12:53.559703 5120 status_manager.go:895] "Failed to get status for pod" podUID="a8389bad-6789-42fe-8506-5ac83ff9514f" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 16:12:53 crc kubenswrapper[5120]: I0316 16:12:53.561075 5120 status_manager.go:895] "Failed to get status for pod" podUID="a8389bad-6789-42fe-8506-5ac83ff9514f" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 16:12:53 crc kubenswrapper[5120]: I0316 16:12:53.582755 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:12:53 crc kubenswrapper[5120]: I0316 16:12:53.588853 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:12:54 crc kubenswrapper[5120]: I0316 16:12:54.678170 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5aa11a39-e139-4791-92ce-2771b0277a8b" path="/var/lib/kubelet/pods/5aa11a39-e139-4791-92ce-2771b0277a8b/volumes" Mar 16 16:12:54 crc kubenswrapper[5120]: I0316 16:12:54.679816 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bba65a98-1383-4c8c-995a-b212b232d1f8" path="/var/lib/kubelet/pods/bba65a98-1383-4c8c-995a-b212b232d1f8/volumes" Mar 16 16:12:56 crc kubenswrapper[5120]: I0316 16:12:56.664443 5120 scope.go:117] "RemoveContainer" containerID="bc2df124cc6ad146d7c7dd2115ac815986fb62978d38895f6d345a4a9b14dbd8" Mar 16 16:12:56 crc kubenswrapper[5120]: E0316 16:12:56.665183 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.314342 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["crc-storage/crc-storage-crc-rl6vz"] Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.325940 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["crc-storage/crc-storage-crc-rl6vz"] Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.410041 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["crc-storage/crc-storage-crc-lmj9x"] Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.410921 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5cf58a8f-dfb4-4a0a-b96c-000333125dd0" containerName="neutron-httpd" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.410944 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="5cf58a8f-dfb4-4a0a-b96c-000333125dd0" containerName="neutron-httpd" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.410961 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab" containerName="setup-container" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.410969 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab" containerName="setup-container" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.410984 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48f884c6-8a4f-4581-8b21-6e4db79ae424" containerName="object-expirer" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.410992 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="48f884c6-8a4f-4581-8b21-6e4db79ae424" containerName="object-expirer" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.411005 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5aa11a39-e139-4791-92ce-2771b0277a8b" containerName="glance-log" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.411014 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="5aa11a39-e139-4791-92ce-2771b0277a8b" containerName="glance-log" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.411028 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab" containerName="rabbitmq" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.411034 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab" containerName="rabbitmq" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.411045 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10ec5605-2810-4b8c-9a6a-e5cfc3b33706" containerName="nova-api-log" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.411051 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="10ec5605-2810-4b8c-9a6a-e5cfc3b33706" containerName="nova-api-log" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.411065 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88c64b50-c653-4d39-a87a-ac9a49eaf06e" containerName="cinder-api-log" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.411073 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="88c64b50-c653-4d39-a87a-ac9a49eaf06e" containerName="cinder-api-log" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.411101 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48f884c6-8a4f-4581-8b21-6e4db79ae424" containerName="container-auditor" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.411109 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="48f884c6-8a4f-4581-8b21-6e4db79ae424" containerName="container-auditor" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.411118 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a869ae4-5dd4-47d8-aa7e-e519981ee01f" containerName="nova-cell0-conductor-conductor" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.411127 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a869ae4-5dd4-47d8-aa7e-e519981ee01f" containerName="nova-cell0-conductor-conductor" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.411138 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28ea8203-158a-4c89-8ae6-647d230c21ff" containerName="barbican-keystone-listener" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.411145 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="28ea8203-158a-4c89-8ae6-647d230c21ff" containerName="barbican-keystone-listener" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.411157 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34da2089-cc88-4d8c-97da-68aadf7f2c03" containerName="barbican-api-log" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.411164 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="34da2089-cc88-4d8c-97da-68aadf7f2c03" containerName="barbican-api-log" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.411179 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88c64b50-c653-4d39-a87a-ac9a49eaf06e" containerName="cinder-api" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.411186 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="88c64b50-c653-4d39-a87a-ac9a49eaf06e" containerName="cinder-api" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.411199 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48f884c6-8a4f-4581-8b21-6e4db79ae424" containerName="container-server" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.411206 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="48f884c6-8a4f-4581-8b21-6e4db79ae424" containerName="container-server" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.411215 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48f884c6-8a4f-4581-8b21-6e4db79ae424" containerName="object-auditor" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.411222 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="48f884c6-8a4f-4581-8b21-6e4db79ae424" containerName="object-auditor" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.411231 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb50beed-fd12-4d73-95bf-413136771ffe" containerName="mysql-bootstrap" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.411238 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb50beed-fd12-4d73-95bf-413136771ffe" containerName="mysql-bootstrap" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.411247 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5aa11a39-e139-4791-92ce-2771b0277a8b" containerName="glance-httpd" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.411253 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="5aa11a39-e139-4791-92ce-2771b0277a8b" containerName="glance-httpd" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.411265 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5" containerName="proxy-httpd" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.411272 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5" containerName="proxy-httpd" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.411286 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f51149f-2af3-4bb8-ab7a-1b94ca6754e5" containerName="barbican-keystone-listener" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.411293 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f51149f-2af3-4bb8-ab7a-1b94ca6754e5" containerName="barbican-keystone-listener" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.411300 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c399606-817d-4a0f-b825-32da28e0491d" containerName="galera" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.411307 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c399606-817d-4a0f-b825-32da28e0491d" containerName="galera" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.411318 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60e80199-56f5-4a0c-b023-da9c28b1051f" containerName="mariadb-account-create-update" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.411325 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="60e80199-56f5-4a0c-b023-da9c28b1051f" containerName="mariadb-account-create-update" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.411335 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30d44474-74de-4982-8e48-31038a50607f" containerName="openstack-network-exporter" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.411342 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="30d44474-74de-4982-8e48-31038a50607f" containerName="openstack-network-exporter" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.411351 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0df9d7ea-2a19-45b4-b350-7c0e91a5d960" containerName="barbican-worker-log" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.411358 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="0df9d7ea-2a19-45b4-b350-7c0e91a5d960" containerName="barbican-worker-log" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.411370 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb50beed-fd12-4d73-95bf-413136771ffe" containerName="galera" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.411378 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb50beed-fd12-4d73-95bf-413136771ffe" containerName="galera" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.411389 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5" containerName="sg-core" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.411396 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5" containerName="sg-core" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.411406 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28ea8203-158a-4c89-8ae6-647d230c21ff" containerName="barbican-keystone-listener-log" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.411412 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="28ea8203-158a-4c89-8ae6-647d230c21ff" containerName="barbican-keystone-listener-log" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.411420 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d9a26b4-a091-43f5-8625-2194e901021c" containerName="ovn-northd" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.411426 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d9a26b4-a091-43f5-8625-2194e901021c" containerName="ovn-northd" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.411439 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e5ad3cf-0d96-43a2-b8cb-38e7210af15a" containerName="keystone-api" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.411445 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e5ad3cf-0d96-43a2-b8cb-38e7210af15a" containerName="keystone-api" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.411457 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48f884c6-8a4f-4581-8b21-6e4db79ae424" containerName="container-replicator" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.411464 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="48f884c6-8a4f-4581-8b21-6e4db79ae424" containerName="container-replicator" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.411473 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5" containerName="ceilometer-notification-agent" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.411479 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5" containerName="ceilometer-notification-agent" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.411487 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48f884c6-8a4f-4581-8b21-6e4db79ae424" containerName="account-auditor" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.411493 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="48f884c6-8a4f-4581-8b21-6e4db79ae424" containerName="account-auditor" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.411505 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17b2138c-b3ca-4538-a7d7-0dc6756650bf" containerName="nova-metadata-metadata" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.411512 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="17b2138c-b3ca-4538-a7d7-0dc6756650bf" containerName="nova-metadata-metadata" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.411522 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="241ac7ce-90fa-4222-a274-ee00c4ba33a3" containerName="barbican-api-log" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.411529 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="241ac7ce-90fa-4222-a274-ee00c4ba33a3" containerName="barbican-api-log" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.411535 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0df9d7ea-2a19-45b4-b350-7c0e91a5d960" containerName="barbican-worker" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.411541 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="0df9d7ea-2a19-45b4-b350-7c0e91a5d960" containerName="barbican-worker" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.411549 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bba65a98-1383-4c8c-995a-b212b232d1f8" containerName="nova-scheduler-scheduler" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.411556 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="bba65a98-1383-4c8c-995a-b212b232d1f8" containerName="nova-scheduler-scheduler" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.411565 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c8fe017-e320-4b3e-894e-f4258e8d265f" containerName="proxy-server" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.411572 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c8fe017-e320-4b3e-894e-f4258e8d265f" containerName="proxy-server" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.411581 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10ec5605-2810-4b8c-9a6a-e5cfc3b33706" containerName="nova-api-api" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.411588 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="10ec5605-2810-4b8c-9a6a-e5cfc3b33706" containerName="nova-api-api" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.411598 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eefef8ba-a54a-4ee8-9c31-757cc07a6ab3" containerName="placement-api" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.411604 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="eefef8ba-a54a-4ee8-9c31-757cc07a6ab3" containerName="placement-api" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.411612 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96d66c8e-8cdb-462c-a302-c85e581db5ad" containerName="cinder-scheduler" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.411619 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="96d66c8e-8cdb-462c-a302-c85e581db5ad" containerName="cinder-scheduler" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.411630 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a" containerName="rabbitmq" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.411636 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a" containerName="rabbitmq" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.411648 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a" containerName="setup-container" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.411655 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a" containerName="setup-container" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.411666 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48f884c6-8a4f-4581-8b21-6e4db79ae424" containerName="account-server" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.411673 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="48f884c6-8a4f-4581-8b21-6e4db79ae424" containerName="account-server" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.411679 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48f884c6-8a4f-4581-8b21-6e4db79ae424" containerName="container-updater" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.411686 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="48f884c6-8a4f-4581-8b21-6e4db79ae424" containerName="container-updater" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.411697 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5243aba2-b42a-4e8f-8e9e-22ebe215585e" containerName="init" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.411703 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="5243aba2-b42a-4e8f-8e9e-22ebe215585e" containerName="init" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.411711 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dae19557-6584-433e-a345-c373d9e8a4ae" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.411718 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="dae19557-6584-433e-a345-c373d9e8a4ae" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.411728 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe2105ae-76c1-452b-bee1-074d323c076f" containerName="proxy-httpd" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.411735 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe2105ae-76c1-452b-bee1-074d323c076f" containerName="proxy-httpd" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.411745 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48f884c6-8a4f-4581-8b21-6e4db79ae424" containerName="object-updater" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.411752 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="48f884c6-8a4f-4581-8b21-6e4db79ae424" containerName="object-updater" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.411780 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d9a26b4-a091-43f5-8625-2194e901021c" containerName="openstack-network-exporter" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.411787 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d9a26b4-a091-43f5-8625-2194e901021c" containerName="openstack-network-exporter" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.411797 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c8fe017-e320-4b3e-894e-f4258e8d265f" containerName="proxy-httpd" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.411803 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c8fe017-e320-4b3e-894e-f4258e8d265f" containerName="proxy-httpd" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.411812 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bce71378-f7b0-4b73-8b4a-711353734319" containerName="nova-cell1-conductor-conductor" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.411819 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="bce71378-f7b0-4b73-8b4a-711353734319" containerName="nova-cell1-conductor-conductor" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.411830 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30d44474-74de-4982-8e48-31038a50607f" containerName="ovsdbserver-nb" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.411837 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="30d44474-74de-4982-8e48-31038a50607f" containerName="ovsdbserver-nb" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.411848 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe2105ae-76c1-452b-bee1-074d323c076f" containerName="proxy-server" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.411856 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe2105ae-76c1-452b-bee1-074d323c076f" containerName="proxy-server" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.411865 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb4b4078-46df-4b50-aa4a-81adbbd15e52" containerName="barbican-worker" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.411872 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb4b4078-46df-4b50-aa4a-81adbbd15e52" containerName="barbican-worker" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.411883 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5470c9e3-c2c2-4294-965d-cd4ff001bd74" containerName="memcached" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.411891 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="5470c9e3-c2c2-4294-965d-cd4ff001bd74" containerName="memcached" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.411901 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48f884c6-8a4f-4581-8b21-6e4db79ae424" containerName="account-replicator" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.411908 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="48f884c6-8a4f-4581-8b21-6e4db79ae424" containerName="account-replicator" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.411920 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48f884c6-8a4f-4581-8b21-6e4db79ae424" containerName="object-replicator" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.411927 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="48f884c6-8a4f-4581-8b21-6e4db79ae424" containerName="object-replicator" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.411938 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5cf58a8f-dfb4-4a0a-b96c-000333125dd0" containerName="neutron-api" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.411946 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="5cf58a8f-dfb4-4a0a-b96c-000333125dd0" containerName="neutron-api" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.411954 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48f884c6-8a4f-4581-8b21-6e4db79ae424" containerName="swift-recon-cron" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.411963 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="48f884c6-8a4f-4581-8b21-6e4db79ae424" containerName="swift-recon-cron" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.411972 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eefef8ba-a54a-4ee8-9c31-757cc07a6ab3" containerName="placement-log" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.411979 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="eefef8ba-a54a-4ee8-9c31-757cc07a6ab3" containerName="placement-log" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.411990 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48f884c6-8a4f-4581-8b21-6e4db79ae424" containerName="account-reaper" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.411996 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="48f884c6-8a4f-4581-8b21-6e4db79ae424" containerName="account-reaper" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.412007 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17b2138c-b3ca-4538-a7d7-0dc6756650bf" containerName="nova-metadata-log" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.412014 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="17b2138c-b3ca-4538-a7d7-0dc6756650bf" containerName="nova-metadata-log" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.412024 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb4b4078-46df-4b50-aa4a-81adbbd15e52" containerName="barbican-worker-log" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.412031 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb4b4078-46df-4b50-aa4a-81adbbd15e52" containerName="barbican-worker-log" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.412044 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c399606-817d-4a0f-b825-32da28e0491d" containerName="mysql-bootstrap" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.412050 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c399606-817d-4a0f-b825-32da28e0491d" containerName="mysql-bootstrap" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.412057 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bebb35a6-a910-4c16-8fa3-5462afb3341a" containerName="kube-state-metrics" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.412063 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="bebb35a6-a910-4c16-8fa3-5462afb3341a" containerName="kube-state-metrics" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.412072 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f51149f-2af3-4bb8-ab7a-1b94ca6754e5" containerName="barbican-keystone-listener-log" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.412081 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f51149f-2af3-4bb8-ab7a-1b94ca6754e5" containerName="barbican-keystone-listener-log" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.412090 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34da2089-cc88-4d8c-97da-68aadf7f2c03" containerName="barbican-api" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.412096 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="34da2089-cc88-4d8c-97da-68aadf7f2c03" containerName="barbican-api" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.412106 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5243aba2-b42a-4e8f-8e9e-22ebe215585e" containerName="dnsmasq-dns" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.412112 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="5243aba2-b42a-4e8f-8e9e-22ebe215585e" containerName="dnsmasq-dns" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.412123 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="241ac7ce-90fa-4222-a274-ee00c4ba33a3" containerName="barbican-api" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.412129 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="241ac7ce-90fa-4222-a274-ee00c4ba33a3" containerName="barbican-api" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.412138 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48f884c6-8a4f-4581-8b21-6e4db79ae424" containerName="rsync" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.412145 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="48f884c6-8a4f-4581-8b21-6e4db79ae424" containerName="rsync" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.412155 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5" containerName="ceilometer-central-agent" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.412162 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5" containerName="ceilometer-central-agent" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.412172 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48f884c6-8a4f-4581-8b21-6e4db79ae424" containerName="object-server" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.412179 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="48f884c6-8a4f-4581-8b21-6e4db79ae424" containerName="object-server" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.412186 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96d66c8e-8cdb-462c-a302-c85e581db5ad" containerName="probe" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.412194 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="96d66c8e-8cdb-462c-a302-c85e581db5ad" containerName="probe" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.412344 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5" containerName="proxy-httpd" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.412358 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5" containerName="sg-core" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.412368 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="48f884c6-8a4f-4581-8b21-6e4db79ae424" containerName="container-auditor" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.412377 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="5e5ad3cf-0d96-43a2-b8cb-38e7210af15a" containerName="keystone-api" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.412391 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="eefef8ba-a54a-4ee8-9c31-757cc07a6ab3" containerName="placement-api" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.412403 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="17b2138c-b3ca-4538-a7d7-0dc6756650bf" containerName="nova-metadata-log" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.412413 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="30d44474-74de-4982-8e48-31038a50607f" containerName="openstack-network-exporter" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.412419 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="9c8fe017-e320-4b3e-894e-f4258e8d265f" containerName="proxy-httpd" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.412427 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="241ac7ce-90fa-4222-a274-ee00c4ba33a3" containerName="barbican-api-log" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.412436 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="bba65a98-1383-4c8c-995a-b212b232d1f8" containerName="nova-scheduler-scheduler" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.412447 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="8f51149f-2af3-4bb8-ab7a-1b94ca6754e5" containerName="barbican-keystone-listener" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.412458 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="6d9a26b4-a091-43f5-8625-2194e901021c" containerName="openstack-network-exporter" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.412465 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ca20d54f-68b6-4b05-b62e-d6dc7b96b5ab" containerName="rabbitmq" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.412474 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="0df9d7ea-2a19-45b4-b350-7c0e91a5d960" containerName="barbican-worker-log" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.412483 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="fe2105ae-76c1-452b-bee1-074d323c076f" containerName="proxy-httpd" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.412493 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="88c64b50-c653-4d39-a87a-ac9a49eaf06e" containerName="cinder-api" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.412504 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="48f884c6-8a4f-4581-8b21-6e4db79ae424" containerName="object-server" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.412512 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="5aa11a39-e139-4791-92ce-2771b0277a8b" containerName="glance-log" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.412523 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="6d9a26b4-a091-43f5-8625-2194e901021c" containerName="ovn-northd" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.412531 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="5c399606-817d-4a0f-b825-32da28e0491d" containerName="galera" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.412539 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="5470c9e3-c2c2-4294-965d-cd4ff001bd74" containerName="memcached" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.412550 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="48f884c6-8a4f-4581-8b21-6e4db79ae424" containerName="swift-recon-cron" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.412558 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="241ac7ce-90fa-4222-a274-ee00c4ba33a3" containerName="barbican-api" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.412568 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="bebb35a6-a910-4c16-8fa3-5462afb3341a" containerName="kube-state-metrics" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.412579 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5" containerName="ceilometer-notification-agent" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.412591 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="48f884c6-8a4f-4581-8b21-6e4db79ae424" containerName="object-expirer" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.412598 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="48f884c6-8a4f-4581-8b21-6e4db79ae424" containerName="object-replicator" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.412609 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="5cf58a8f-dfb4-4a0a-b96c-000333125dd0" containerName="neutron-api" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.412617 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="eb50beed-fd12-4d73-95bf-413136771ffe" containerName="galera" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.412628 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="48f884c6-8a4f-4581-8b21-6e4db79ae424" containerName="account-server" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.412635 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="34da2089-cc88-4d8c-97da-68aadf7f2c03" containerName="barbican-api" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.412644 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="48f884c6-8a4f-4581-8b21-6e4db79ae424" containerName="object-updater" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.412654 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="48f884c6-8a4f-4581-8b21-6e4db79ae424" containerName="container-replicator" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.412665 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="cb4b4078-46df-4b50-aa4a-81adbbd15e52" containerName="barbican-worker-log" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.412674 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="48f884c6-8a4f-4581-8b21-6e4db79ae424" containerName="account-reaper" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.412683 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="10ec5605-2810-4b8c-9a6a-e5cfc3b33706" containerName="nova-api-api" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.412690 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="dae19557-6584-433e-a345-c373d9e8a4ae" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.412702 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="6a869ae4-5dd4-47d8-aa7e-e519981ee01f" containerName="nova-cell0-conductor-conductor" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.412711 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="48f884c6-8a4f-4581-8b21-6e4db79ae424" containerName="object-auditor" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.412719 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="bce71378-f7b0-4b73-8b4a-711353734319" containerName="nova-cell1-conductor-conductor" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.412730 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="cb4b4078-46df-4b50-aa4a-81adbbd15e52" containerName="barbican-worker" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.412740 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="9c8fe017-e320-4b3e-894e-f4258e8d265f" containerName="proxy-server" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.412748 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="5aa11a39-e139-4791-92ce-2771b0277a8b" containerName="glance-httpd" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.412778 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="48f884c6-8a4f-4581-8b21-6e4db79ae424" containerName="container-updater" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.412790 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="96d66c8e-8cdb-462c-a302-c85e581db5ad" containerName="cinder-scheduler" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.412800 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="30d44474-74de-4982-8e48-31038a50607f" containerName="ovsdbserver-nb" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.412809 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f42fe4a8-5b71-4d39-964b-a3e2aab4b8e5" containerName="ceilometer-central-agent" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.412820 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="48f884c6-8a4f-4581-8b21-6e4db79ae424" containerName="rsync" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.412830 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="5cf58a8f-dfb4-4a0a-b96c-000333125dd0" containerName="neutron-httpd" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.412839 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="48f884c6-8a4f-4581-8b21-6e4db79ae424" containerName="account-auditor" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.412846 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="eefef8ba-a54a-4ee8-9c31-757cc07a6ab3" containerName="placement-log" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.412857 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="fe2105ae-76c1-452b-bee1-074d323c076f" containerName="proxy-server" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.412866 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="60e80199-56f5-4a0c-b023-da9c28b1051f" containerName="mariadb-account-create-update" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.412874 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="5243aba2-b42a-4e8f-8e9e-22ebe215585e" containerName="dnsmasq-dns" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.412886 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="34da2089-cc88-4d8c-97da-68aadf7f2c03" containerName="barbican-api-log" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.412895 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="48f884c6-8a4f-4581-8b21-6e4db79ae424" containerName="container-server" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.412906 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="de7d9d18-7bc7-4e3e-bf9a-eb2b54cf459a" containerName="rabbitmq" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.412915 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="8f51149f-2af3-4bb8-ab7a-1b94ca6754e5" containerName="barbican-keystone-listener-log" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.412922 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="0df9d7ea-2a19-45b4-b350-7c0e91a5d960" containerName="barbican-worker" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.412930 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="28ea8203-158a-4c89-8ae6-647d230c21ff" containerName="barbican-keystone-listener-log" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.412942 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="96d66c8e-8cdb-462c-a302-c85e581db5ad" containerName="probe" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.412950 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="17b2138c-b3ca-4538-a7d7-0dc6756650bf" containerName="nova-metadata-metadata" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.412958 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="88c64b50-c653-4d39-a87a-ac9a49eaf06e" containerName="cinder-api-log" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.412971 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="48f884c6-8a4f-4581-8b21-6e4db79ae424" containerName="account-replicator" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.412983 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="10ec5605-2810-4b8c-9a6a-e5cfc3b33706" containerName="nova-api-log" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.412993 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="28ea8203-158a-4c89-8ae6-647d230c21ff" containerName="barbican-keystone-listener" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.427600 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-lmj9x" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.427628 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-lmj9x"] Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.432158 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"openshift-service-ca.crt\"" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.432316 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"crc-storage\"/\"crc-storage-dockercfg-s2tht\"" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.432402 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"kube-root-ca.crt\"" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.432904 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"crc-storage\"" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.495936 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k28cs\" (UniqueName: \"kubernetes.io/projected/339961fd-afdd-4e0d-ac36-1bc942a3bc87-kube-api-access-k28cs\") pod \"crc-storage-crc-lmj9x\" (UID: \"339961fd-afdd-4e0d-ac36-1bc942a3bc87\") " pod="crc-storage/crc-storage-crc-lmj9x" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.496331 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/339961fd-afdd-4e0d-ac36-1bc942a3bc87-crc-storage\") pod \"crc-storage-crc-lmj9x\" (UID: \"339961fd-afdd-4e0d-ac36-1bc942a3bc87\") " pod="crc-storage/crc-storage-crc-lmj9x" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.496585 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/339961fd-afdd-4e0d-ac36-1bc942a3bc87-node-mnt\") pod \"crc-storage-crc-lmj9x\" (UID: \"339961fd-afdd-4e0d-ac36-1bc942a3bc87\") " pod="crc-storage/crc-storage-crc-lmj9x" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.598143 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k28cs\" (UniqueName: \"kubernetes.io/projected/339961fd-afdd-4e0d-ac36-1bc942a3bc87-kube-api-access-k28cs\") pod \"crc-storage-crc-lmj9x\" (UID: \"339961fd-afdd-4e0d-ac36-1bc942a3bc87\") " pod="crc-storage/crc-storage-crc-lmj9x" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.598247 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/339961fd-afdd-4e0d-ac36-1bc942a3bc87-crc-storage\") pod \"crc-storage-crc-lmj9x\" (UID: \"339961fd-afdd-4e0d-ac36-1bc942a3bc87\") " pod="crc-storage/crc-storage-crc-lmj9x" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.598478 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/339961fd-afdd-4e0d-ac36-1bc942a3bc87-node-mnt\") pod \"crc-storage-crc-lmj9x\" (UID: \"339961fd-afdd-4e0d-ac36-1bc942a3bc87\") " pod="crc-storage/crc-storage-crc-lmj9x" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.598939 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/339961fd-afdd-4e0d-ac36-1bc942a3bc87-node-mnt\") pod \"crc-storage-crc-lmj9x\" (UID: \"339961fd-afdd-4e0d-ac36-1bc942a3bc87\") " pod="crc-storage/crc-storage-crc-lmj9x" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.599560 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/339961fd-afdd-4e0d-ac36-1bc942a3bc87-crc-storage\") pod \"crc-storage-crc-lmj9x\" (UID: \"339961fd-afdd-4e0d-ac36-1bc942a3bc87\") " pod="crc-storage/crc-storage-crc-lmj9x" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.623927 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k28cs\" (UniqueName: \"kubernetes.io/projected/339961fd-afdd-4e0d-ac36-1bc942a3bc87-kube-api-access-k28cs\") pod \"crc-storage-crc-lmj9x\" (UID: \"339961fd-afdd-4e0d-ac36-1bc942a3bc87\") " pod="crc-storage/crc-storage-crc-lmj9x" Mar 16 16:13:01 crc kubenswrapper[5120]: I0316 16:13:01.751240 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-lmj9x" Mar 16 16:13:02 crc kubenswrapper[5120]: I0316 16:13:02.162775 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-lmj9x"] Mar 16 16:13:02 crc kubenswrapper[5120]: I0316 16:13:02.167820 5120 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Mar 16 16:13:02 crc kubenswrapper[5120]: I0316 16:13:02.661927 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-lmj9x" event={"ID":"339961fd-afdd-4e0d-ac36-1bc942a3bc87","Type":"ContainerStarted","Data":"109874e1f47ce5d1b878e0df6fd5a1b89ba6ff957a55232a44cbbf707beed124"} Mar 16 16:13:02 crc kubenswrapper[5120]: I0316 16:13:02.673164 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="74a0eab3-79e7-4265-a1af-65f659f3f91d" path="/var/lib/kubelet/pods/74a0eab3-79e7-4265-a1af-65f659f3f91d/volumes" Mar 16 16:13:03 crc kubenswrapper[5120]: I0316 16:13:03.679624 5120 generic.go:358] "Generic (PLEG): container finished" podID="339961fd-afdd-4e0d-ac36-1bc942a3bc87" containerID="3dbb8b6b77f417ec85385c65e554cb7523158b245e4a90353843df1bfba0af65" exitCode=0 Mar 16 16:13:03 crc kubenswrapper[5120]: I0316 16:13:03.679710 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-lmj9x" event={"ID":"339961fd-afdd-4e0d-ac36-1bc942a3bc87","Type":"ContainerDied","Data":"3dbb8b6b77f417ec85385c65e554cb7523158b245e4a90353843df1bfba0af65"} Mar 16 16:13:04 crc kubenswrapper[5120]: I0316 16:13:04.873030 5120 scope.go:117] "RemoveContainer" containerID="5b27e0c4f8fcbb05d85a1fecfcfd66e263968479f5142e8e81a58a8db988dfef" Mar 16 16:13:04 crc kubenswrapper[5120]: I0316 16:13:04.904628 5120 scope.go:117] "RemoveContainer" containerID="21bd09901929d3bf3882c7a1caeb77b83d0d14197d81b76717966b11af63259f" Mar 16 16:13:04 crc kubenswrapper[5120]: I0316 16:13:04.944387 5120 scope.go:117] "RemoveContainer" containerID="1d6d6f83863b1764aee0eb76bb4d03a4aebdfb7d9dad3440b0ff896169247056" Mar 16 16:13:05 crc kubenswrapper[5120]: I0316 16:13:05.055482 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-lmj9x" Mar 16 16:13:05 crc kubenswrapper[5120]: I0316 16:13:05.163365 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k28cs\" (UniqueName: \"kubernetes.io/projected/339961fd-afdd-4e0d-ac36-1bc942a3bc87-kube-api-access-k28cs\") pod \"339961fd-afdd-4e0d-ac36-1bc942a3bc87\" (UID: \"339961fd-afdd-4e0d-ac36-1bc942a3bc87\") " Mar 16 16:13:05 crc kubenswrapper[5120]: I0316 16:13:05.163439 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/339961fd-afdd-4e0d-ac36-1bc942a3bc87-crc-storage\") pod \"339961fd-afdd-4e0d-ac36-1bc942a3bc87\" (UID: \"339961fd-afdd-4e0d-ac36-1bc942a3bc87\") " Mar 16 16:13:05 crc kubenswrapper[5120]: I0316 16:13:05.163502 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/339961fd-afdd-4e0d-ac36-1bc942a3bc87-node-mnt\") pod \"339961fd-afdd-4e0d-ac36-1bc942a3bc87\" (UID: \"339961fd-afdd-4e0d-ac36-1bc942a3bc87\") " Mar 16 16:13:05 crc kubenswrapper[5120]: I0316 16:13:05.163681 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/339961fd-afdd-4e0d-ac36-1bc942a3bc87-node-mnt" (OuterVolumeSpecName: "node-mnt") pod "339961fd-afdd-4e0d-ac36-1bc942a3bc87" (UID: "339961fd-afdd-4e0d-ac36-1bc942a3bc87"). InnerVolumeSpecName "node-mnt". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 16:13:05 crc kubenswrapper[5120]: I0316 16:13:05.164098 5120 reconciler_common.go:299] "Volume detached for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/339961fd-afdd-4e0d-ac36-1bc942a3bc87-node-mnt\") on node \"crc\" DevicePath \"\"" Mar 16 16:13:05 crc kubenswrapper[5120]: I0316 16:13:05.169301 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/339961fd-afdd-4e0d-ac36-1bc942a3bc87-kube-api-access-k28cs" (OuterVolumeSpecName: "kube-api-access-k28cs") pod "339961fd-afdd-4e0d-ac36-1bc942a3bc87" (UID: "339961fd-afdd-4e0d-ac36-1bc942a3bc87"). InnerVolumeSpecName "kube-api-access-k28cs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:13:05 crc kubenswrapper[5120]: I0316 16:13:05.189802 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/339961fd-afdd-4e0d-ac36-1bc942a3bc87-crc-storage" (OuterVolumeSpecName: "crc-storage") pod "339961fd-afdd-4e0d-ac36-1bc942a3bc87" (UID: "339961fd-afdd-4e0d-ac36-1bc942a3bc87"). InnerVolumeSpecName "crc-storage". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:13:05 crc kubenswrapper[5120]: I0316 16:13:05.266100 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k28cs\" (UniqueName: \"kubernetes.io/projected/339961fd-afdd-4e0d-ac36-1bc942a3bc87-kube-api-access-k28cs\") on node \"crc\" DevicePath \"\"" Mar 16 16:13:05 crc kubenswrapper[5120]: I0316 16:13:05.266148 5120 reconciler_common.go:299] "Volume detached for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/339961fd-afdd-4e0d-ac36-1bc942a3bc87-crc-storage\") on node \"crc\" DevicePath \"\"" Mar 16 16:13:05 crc kubenswrapper[5120]: I0316 16:13:05.716960 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-lmj9x" Mar 16 16:13:05 crc kubenswrapper[5120]: I0316 16:13:05.717024 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-lmj9x" event={"ID":"339961fd-afdd-4e0d-ac36-1bc942a3bc87","Type":"ContainerDied","Data":"109874e1f47ce5d1b878e0df6fd5a1b89ba6ff957a55232a44cbbf707beed124"} Mar 16 16:13:05 crc kubenswrapper[5120]: I0316 16:13:05.717328 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="109874e1f47ce5d1b878e0df6fd5a1b89ba6ff957a55232a44cbbf707beed124" Mar 16 16:13:07 crc kubenswrapper[5120]: E0316 16:13:07.533570 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1175990 actualBytes=10240 Mar 16 16:13:08 crc kubenswrapper[5120]: I0316 16:13:08.271641 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["crc-storage/crc-storage-crc-lmj9x"] Mar 16 16:13:08 crc kubenswrapper[5120]: I0316 16:13:08.277358 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["crc-storage/crc-storage-crc-lmj9x"] Mar 16 16:13:08 crc kubenswrapper[5120]: I0316 16:13:08.425422 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["crc-storage/crc-storage-crc-vqdc9"] Mar 16 16:13:08 crc kubenswrapper[5120]: I0316 16:13:08.427111 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="339961fd-afdd-4e0d-ac36-1bc942a3bc87" containerName="storage" Mar 16 16:13:08 crc kubenswrapper[5120]: I0316 16:13:08.427155 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="339961fd-afdd-4e0d-ac36-1bc942a3bc87" containerName="storage" Mar 16 16:13:08 crc kubenswrapper[5120]: I0316 16:13:08.427671 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="339961fd-afdd-4e0d-ac36-1bc942a3bc87" containerName="storage" Mar 16 16:13:08 crc kubenswrapper[5120]: I0316 16:13:08.460039 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-vqdc9"] Mar 16 16:13:08 crc kubenswrapper[5120]: I0316 16:13:08.460223 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-vqdc9" Mar 16 16:13:08 crc kubenswrapper[5120]: I0316 16:13:08.464543 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"kube-root-ca.crt\"" Mar 16 16:13:08 crc kubenswrapper[5120]: I0316 16:13:08.464628 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"crc-storage\"" Mar 16 16:13:08 crc kubenswrapper[5120]: I0316 16:13:08.465116 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"crc-storage\"/\"crc-storage-dockercfg-s2tht\"" Mar 16 16:13:08 crc kubenswrapper[5120]: I0316 16:13:08.466562 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"openshift-service-ca.crt\"" Mar 16 16:13:08 crc kubenswrapper[5120]: I0316 16:13:08.524071 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/8c1eb67e-902c-4fa5-84b5-3199caea970a-node-mnt\") pod \"crc-storage-crc-vqdc9\" (UID: \"8c1eb67e-902c-4fa5-84b5-3199caea970a\") " pod="crc-storage/crc-storage-crc-vqdc9" Mar 16 16:13:08 crc kubenswrapper[5120]: I0316 16:13:08.524220 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/8c1eb67e-902c-4fa5-84b5-3199caea970a-crc-storage\") pod \"crc-storage-crc-vqdc9\" (UID: \"8c1eb67e-902c-4fa5-84b5-3199caea970a\") " pod="crc-storage/crc-storage-crc-vqdc9" Mar 16 16:13:08 crc kubenswrapper[5120]: I0316 16:13:08.524298 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ctnt\" (UniqueName: \"kubernetes.io/projected/8c1eb67e-902c-4fa5-84b5-3199caea970a-kube-api-access-8ctnt\") pod \"crc-storage-crc-vqdc9\" (UID: \"8c1eb67e-902c-4fa5-84b5-3199caea970a\") " pod="crc-storage/crc-storage-crc-vqdc9" Mar 16 16:13:08 crc kubenswrapper[5120]: I0316 16:13:08.627285 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/8c1eb67e-902c-4fa5-84b5-3199caea970a-node-mnt\") pod \"crc-storage-crc-vqdc9\" (UID: \"8c1eb67e-902c-4fa5-84b5-3199caea970a\") " pod="crc-storage/crc-storage-crc-vqdc9" Mar 16 16:13:08 crc kubenswrapper[5120]: I0316 16:13:08.627463 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/8c1eb67e-902c-4fa5-84b5-3199caea970a-crc-storage\") pod \"crc-storage-crc-vqdc9\" (UID: \"8c1eb67e-902c-4fa5-84b5-3199caea970a\") " pod="crc-storage/crc-storage-crc-vqdc9" Mar 16 16:13:08 crc kubenswrapper[5120]: I0316 16:13:08.627690 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/8c1eb67e-902c-4fa5-84b5-3199caea970a-node-mnt\") pod \"crc-storage-crc-vqdc9\" (UID: \"8c1eb67e-902c-4fa5-84b5-3199caea970a\") " pod="crc-storage/crc-storage-crc-vqdc9" Mar 16 16:13:08 crc kubenswrapper[5120]: I0316 16:13:08.628477 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8ctnt\" (UniqueName: \"kubernetes.io/projected/8c1eb67e-902c-4fa5-84b5-3199caea970a-kube-api-access-8ctnt\") pod \"crc-storage-crc-vqdc9\" (UID: \"8c1eb67e-902c-4fa5-84b5-3199caea970a\") " pod="crc-storage/crc-storage-crc-vqdc9" Mar 16 16:13:08 crc kubenswrapper[5120]: I0316 16:13:08.628805 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/8c1eb67e-902c-4fa5-84b5-3199caea970a-crc-storage\") pod \"crc-storage-crc-vqdc9\" (UID: \"8c1eb67e-902c-4fa5-84b5-3199caea970a\") " pod="crc-storage/crc-storage-crc-vqdc9" Mar 16 16:13:08 crc kubenswrapper[5120]: I0316 16:13:08.655800 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ctnt\" (UniqueName: \"kubernetes.io/projected/8c1eb67e-902c-4fa5-84b5-3199caea970a-kube-api-access-8ctnt\") pod \"crc-storage-crc-vqdc9\" (UID: \"8c1eb67e-902c-4fa5-84b5-3199caea970a\") " pod="crc-storage/crc-storage-crc-vqdc9" Mar 16 16:13:08 crc kubenswrapper[5120]: I0316 16:13:08.679091 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="339961fd-afdd-4e0d-ac36-1bc942a3bc87" path="/var/lib/kubelet/pods/339961fd-afdd-4e0d-ac36-1bc942a3bc87/volumes" Mar 16 16:13:08 crc kubenswrapper[5120]: I0316 16:13:08.783962 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-vqdc9" Mar 16 16:13:09 crc kubenswrapper[5120]: I0316 16:13:09.035289 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-vqdc9"] Mar 16 16:13:09 crc kubenswrapper[5120]: I0316 16:13:09.754752 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-vqdc9" event={"ID":"8c1eb67e-902c-4fa5-84b5-3199caea970a","Type":"ContainerStarted","Data":"f6281514fcdc09fe25a448fd94cd7839d600f71994ece9acf799816a343e0a89"} Mar 16 16:13:10 crc kubenswrapper[5120]: I0316 16:13:10.683110 5120 scope.go:117] "RemoveContainer" containerID="bc2df124cc6ad146d7c7dd2115ac815986fb62978d38895f6d345a4a9b14dbd8" Mar 16 16:13:10 crc kubenswrapper[5120]: E0316 16:13:10.684216 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:13:10 crc kubenswrapper[5120]: I0316 16:13:10.769073 5120 generic.go:358] "Generic (PLEG): container finished" podID="8c1eb67e-902c-4fa5-84b5-3199caea970a" containerID="937e2a7efef1e2a35873822eb3a6449330bdf62ec5cf4314b81be61a4c89538c" exitCode=0 Mar 16 16:13:10 crc kubenswrapper[5120]: I0316 16:13:10.769293 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-vqdc9" event={"ID":"8c1eb67e-902c-4fa5-84b5-3199caea970a","Type":"ContainerDied","Data":"937e2a7efef1e2a35873822eb3a6449330bdf62ec5cf4314b81be61a4c89538c"} Mar 16 16:13:12 crc kubenswrapper[5120]: I0316 16:13:12.138016 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-vqdc9" Mar 16 16:13:12 crc kubenswrapper[5120]: I0316 16:13:12.208603 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/8c1eb67e-902c-4fa5-84b5-3199caea970a-node-mnt\") pod \"8c1eb67e-902c-4fa5-84b5-3199caea970a\" (UID: \"8c1eb67e-902c-4fa5-84b5-3199caea970a\") " Mar 16 16:13:12 crc kubenswrapper[5120]: I0316 16:13:12.208707 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/8c1eb67e-902c-4fa5-84b5-3199caea970a-node-mnt" (OuterVolumeSpecName: "node-mnt") pod "8c1eb67e-902c-4fa5-84b5-3199caea970a" (UID: "8c1eb67e-902c-4fa5-84b5-3199caea970a"). InnerVolumeSpecName "node-mnt". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 16:13:12 crc kubenswrapper[5120]: I0316 16:13:12.209375 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/8c1eb67e-902c-4fa5-84b5-3199caea970a-crc-storage\") pod \"8c1eb67e-902c-4fa5-84b5-3199caea970a\" (UID: \"8c1eb67e-902c-4fa5-84b5-3199caea970a\") " Mar 16 16:13:12 crc kubenswrapper[5120]: I0316 16:13:12.209405 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8ctnt\" (UniqueName: \"kubernetes.io/projected/8c1eb67e-902c-4fa5-84b5-3199caea970a-kube-api-access-8ctnt\") pod \"8c1eb67e-902c-4fa5-84b5-3199caea970a\" (UID: \"8c1eb67e-902c-4fa5-84b5-3199caea970a\") " Mar 16 16:13:12 crc kubenswrapper[5120]: I0316 16:13:12.210125 5120 reconciler_common.go:299] "Volume detached for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/8c1eb67e-902c-4fa5-84b5-3199caea970a-node-mnt\") on node \"crc\" DevicePath \"\"" Mar 16 16:13:12 crc kubenswrapper[5120]: I0316 16:13:12.220175 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c1eb67e-902c-4fa5-84b5-3199caea970a-kube-api-access-8ctnt" (OuterVolumeSpecName: "kube-api-access-8ctnt") pod "8c1eb67e-902c-4fa5-84b5-3199caea970a" (UID: "8c1eb67e-902c-4fa5-84b5-3199caea970a"). InnerVolumeSpecName "kube-api-access-8ctnt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:13:12 crc kubenswrapper[5120]: I0316 16:13:12.245740 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c1eb67e-902c-4fa5-84b5-3199caea970a-crc-storage" (OuterVolumeSpecName: "crc-storage") pod "8c1eb67e-902c-4fa5-84b5-3199caea970a" (UID: "8c1eb67e-902c-4fa5-84b5-3199caea970a"). InnerVolumeSpecName "crc-storage". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:13:12 crc kubenswrapper[5120]: I0316 16:13:12.311462 5120 reconciler_common.go:299] "Volume detached for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/8c1eb67e-902c-4fa5-84b5-3199caea970a-crc-storage\") on node \"crc\" DevicePath \"\"" Mar 16 16:13:12 crc kubenswrapper[5120]: I0316 16:13:12.311503 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8ctnt\" (UniqueName: \"kubernetes.io/projected/8c1eb67e-902c-4fa5-84b5-3199caea970a-kube-api-access-8ctnt\") on node \"crc\" DevicePath \"\"" Mar 16 16:13:12 crc kubenswrapper[5120]: I0316 16:13:12.796078 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-vqdc9" Mar 16 16:13:12 crc kubenswrapper[5120]: I0316 16:13:12.796116 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-vqdc9" event={"ID":"8c1eb67e-902c-4fa5-84b5-3199caea970a","Type":"ContainerDied","Data":"f6281514fcdc09fe25a448fd94cd7839d600f71994ece9acf799816a343e0a89"} Mar 16 16:13:12 crc kubenswrapper[5120]: I0316 16:13:12.796161 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f6281514fcdc09fe25a448fd94cd7839d600f71994ece9acf799816a343e0a89" Mar 16 16:13:23 crc kubenswrapper[5120]: I0316 16:13:23.664550 5120 scope.go:117] "RemoveContainer" containerID="bc2df124cc6ad146d7c7dd2115ac815986fb62978d38895f6d345a4a9b14dbd8" Mar 16 16:13:23 crc kubenswrapper[5120]: E0316 16:13:23.665806 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:13:25 crc kubenswrapper[5120]: I0316 16:13:25.908802 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 16:13:25 crc kubenswrapper[5120]: I0316 16:13:25.910578 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c1eb67e-902c-4fa5-84b5-3199caea970a" containerName="storage" Mar 16 16:13:25 crc kubenswrapper[5120]: I0316 16:13:25.910609 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c1eb67e-902c-4fa5-84b5-3199caea970a" containerName="storage" Mar 16 16:13:25 crc kubenswrapper[5120]: I0316 16:13:25.911037 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="8c1eb67e-902c-4fa5-84b5-3199caea970a" containerName="storage" Mar 16 16:13:25 crc kubenswrapper[5120]: I0316 16:13:25.923379 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 16:13:25 crc kubenswrapper[5120]: I0316 16:13:25.923519 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:13:25 crc kubenswrapper[5120]: I0316 16:13:25.927510 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-config-data\"" Mar 16 16:13:25 crc kubenswrapper[5120]: I0316 16:13:25.927888 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-erlang-cookie\"" Mar 16 16:13:25 crc kubenswrapper[5120]: I0316 16:13:25.927943 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-default-user\"" Mar 16 16:13:25 crc kubenswrapper[5120]: I0316 16:13:25.928364 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-rabbitmq-svc\"" Mar 16 16:13:25 crc kubenswrapper[5120]: I0316 16:13:25.928445 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-server-conf\"" Mar 16 16:13:25 crc kubenswrapper[5120]: I0316 16:13:25.928672 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-server-dockercfg-fhnx4\"" Mar 16 16:13:25 crc kubenswrapper[5120]: I0316 16:13:25.944357 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-plugins-conf\"" Mar 16 16:13:26 crc kubenswrapper[5120]: I0316 16:13:26.090687 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/51d5f0da-bcbc-492e-ab39-6189dc22fa22-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"51d5f0da-bcbc-492e-ab39-6189dc22fa22\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:13:26 crc kubenswrapper[5120]: I0316 16:13:26.090816 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/51d5f0da-bcbc-492e-ab39-6189dc22fa22-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"51d5f0da-bcbc-492e-ab39-6189dc22fa22\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:13:26 crc kubenswrapper[5120]: I0316 16:13:26.090873 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/51d5f0da-bcbc-492e-ab39-6189dc22fa22-rabbitmq-tls\") pod \"rabbitmq-server-0\" (UID: \"51d5f0da-bcbc-492e-ab39-6189dc22fa22\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:13:26 crc kubenswrapper[5120]: I0316 16:13:26.090923 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"rabbitmq-server-0\" (UID: \"51d5f0da-bcbc-492e-ab39-6189dc22fa22\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:13:26 crc kubenswrapper[5120]: I0316 16:13:26.090961 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/51d5f0da-bcbc-492e-ab39-6189dc22fa22-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"51d5f0da-bcbc-492e-ab39-6189dc22fa22\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:13:26 crc kubenswrapper[5120]: I0316 16:13:26.091116 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/51d5f0da-bcbc-492e-ab39-6189dc22fa22-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"51d5f0da-bcbc-492e-ab39-6189dc22fa22\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:13:26 crc kubenswrapper[5120]: I0316 16:13:26.091342 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nprdj\" (UniqueName: \"kubernetes.io/projected/51d5f0da-bcbc-492e-ab39-6189dc22fa22-kube-api-access-nprdj\") pod \"rabbitmq-server-0\" (UID: \"51d5f0da-bcbc-492e-ab39-6189dc22fa22\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:13:26 crc kubenswrapper[5120]: I0316 16:13:26.091402 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/51d5f0da-bcbc-492e-ab39-6189dc22fa22-server-conf\") pod \"rabbitmq-server-0\" (UID: \"51d5f0da-bcbc-492e-ab39-6189dc22fa22\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:13:26 crc kubenswrapper[5120]: I0316 16:13:26.091441 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/51d5f0da-bcbc-492e-ab39-6189dc22fa22-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"51d5f0da-bcbc-492e-ab39-6189dc22fa22\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:13:26 crc kubenswrapper[5120]: I0316 16:13:26.091662 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/51d5f0da-bcbc-492e-ab39-6189dc22fa22-pod-info\") pod \"rabbitmq-server-0\" (UID: \"51d5f0da-bcbc-492e-ab39-6189dc22fa22\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:13:26 crc kubenswrapper[5120]: I0316 16:13:26.091898 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/51d5f0da-bcbc-492e-ab39-6189dc22fa22-config-data\") pod \"rabbitmq-server-0\" (UID: \"51d5f0da-bcbc-492e-ab39-6189dc22fa22\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:13:26 crc kubenswrapper[5120]: I0316 16:13:26.193289 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"rabbitmq-server-0\" (UID: \"51d5f0da-bcbc-492e-ab39-6189dc22fa22\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:13:26 crc kubenswrapper[5120]: I0316 16:13:26.193355 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/51d5f0da-bcbc-492e-ab39-6189dc22fa22-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"51d5f0da-bcbc-492e-ab39-6189dc22fa22\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:13:26 crc kubenswrapper[5120]: I0316 16:13:26.193383 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/51d5f0da-bcbc-492e-ab39-6189dc22fa22-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"51d5f0da-bcbc-492e-ab39-6189dc22fa22\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:13:26 crc kubenswrapper[5120]: I0316 16:13:26.193430 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nprdj\" (UniqueName: \"kubernetes.io/projected/51d5f0da-bcbc-492e-ab39-6189dc22fa22-kube-api-access-nprdj\") pod \"rabbitmq-server-0\" (UID: \"51d5f0da-bcbc-492e-ab39-6189dc22fa22\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:13:26 crc kubenswrapper[5120]: I0316 16:13:26.193455 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/51d5f0da-bcbc-492e-ab39-6189dc22fa22-server-conf\") pod \"rabbitmq-server-0\" (UID: \"51d5f0da-bcbc-492e-ab39-6189dc22fa22\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:13:26 crc kubenswrapper[5120]: I0316 16:13:26.193480 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/51d5f0da-bcbc-492e-ab39-6189dc22fa22-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"51d5f0da-bcbc-492e-ab39-6189dc22fa22\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:13:26 crc kubenswrapper[5120]: I0316 16:13:26.193530 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/51d5f0da-bcbc-492e-ab39-6189dc22fa22-pod-info\") pod \"rabbitmq-server-0\" (UID: \"51d5f0da-bcbc-492e-ab39-6189dc22fa22\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:13:26 crc kubenswrapper[5120]: I0316 16:13:26.193557 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/51d5f0da-bcbc-492e-ab39-6189dc22fa22-config-data\") pod \"rabbitmq-server-0\" (UID: \"51d5f0da-bcbc-492e-ab39-6189dc22fa22\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:13:26 crc kubenswrapper[5120]: I0316 16:13:26.193607 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/51d5f0da-bcbc-492e-ab39-6189dc22fa22-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"51d5f0da-bcbc-492e-ab39-6189dc22fa22\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:13:26 crc kubenswrapper[5120]: I0316 16:13:26.193651 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/51d5f0da-bcbc-492e-ab39-6189dc22fa22-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"51d5f0da-bcbc-492e-ab39-6189dc22fa22\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:13:26 crc kubenswrapper[5120]: I0316 16:13:26.193684 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/51d5f0da-bcbc-492e-ab39-6189dc22fa22-rabbitmq-tls\") pod \"rabbitmq-server-0\" (UID: \"51d5f0da-bcbc-492e-ab39-6189dc22fa22\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:13:26 crc kubenswrapper[5120]: I0316 16:13:26.195425 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/51d5f0da-bcbc-492e-ab39-6189dc22fa22-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"51d5f0da-bcbc-492e-ab39-6189dc22fa22\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:13:26 crc kubenswrapper[5120]: I0316 16:13:26.195678 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/51d5f0da-bcbc-492e-ab39-6189dc22fa22-config-data\") pod \"rabbitmq-server-0\" (UID: \"51d5f0da-bcbc-492e-ab39-6189dc22fa22\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:13:26 crc kubenswrapper[5120]: I0316 16:13:26.196690 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/51d5f0da-bcbc-492e-ab39-6189dc22fa22-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"51d5f0da-bcbc-492e-ab39-6189dc22fa22\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:13:26 crc kubenswrapper[5120]: I0316 16:13:26.198845 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/51d5f0da-bcbc-492e-ab39-6189dc22fa22-server-conf\") pod \"rabbitmq-server-0\" (UID: \"51d5f0da-bcbc-492e-ab39-6189dc22fa22\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:13:26 crc kubenswrapper[5120]: I0316 16:13:26.200053 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"rabbitmq-server-0\" (UID: \"51d5f0da-bcbc-492e-ab39-6189dc22fa22\") device mount path \"/mnt/openstack/pv12\"" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:13:26 crc kubenswrapper[5120]: I0316 16:13:26.200368 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/51d5f0da-bcbc-492e-ab39-6189dc22fa22-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"51d5f0da-bcbc-492e-ab39-6189dc22fa22\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:13:26 crc kubenswrapper[5120]: I0316 16:13:26.201810 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/51d5f0da-bcbc-492e-ab39-6189dc22fa22-pod-info\") pod \"rabbitmq-server-0\" (UID: \"51d5f0da-bcbc-492e-ab39-6189dc22fa22\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:13:26 crc kubenswrapper[5120]: I0316 16:13:26.202417 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/51d5f0da-bcbc-492e-ab39-6189dc22fa22-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"51d5f0da-bcbc-492e-ab39-6189dc22fa22\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:13:26 crc kubenswrapper[5120]: I0316 16:13:26.202594 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/51d5f0da-bcbc-492e-ab39-6189dc22fa22-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"51d5f0da-bcbc-492e-ab39-6189dc22fa22\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:13:26 crc kubenswrapper[5120]: I0316 16:13:26.204646 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 16:13:26 crc kubenswrapper[5120]: I0316 16:13:26.212175 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/51d5f0da-bcbc-492e-ab39-6189dc22fa22-rabbitmq-tls\") pod \"rabbitmq-server-0\" (UID: \"51d5f0da-bcbc-492e-ab39-6189dc22fa22\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:13:26 crc kubenswrapper[5120]: I0316 16:13:26.218871 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 16:13:26 crc kubenswrapper[5120]: I0316 16:13:26.219108 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:13:26 crc kubenswrapper[5120]: I0316 16:13:26.223918 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-cell1-erlang-cookie\"" Mar 16 16:13:26 crc kubenswrapper[5120]: I0316 16:13:26.224521 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-rabbitmq-cell1-svc\"" Mar 16 16:13:26 crc kubenswrapper[5120]: I0316 16:13:26.224799 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-cell1-default-user\"" Mar 16 16:13:26 crc kubenswrapper[5120]: I0316 16:13:26.225951 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-cell1-server-conf\"" Mar 16 16:13:26 crc kubenswrapper[5120]: I0316 16:13:26.227705 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-cell1-server-dockercfg-z952h\"" Mar 16 16:13:26 crc kubenswrapper[5120]: I0316 16:13:26.228031 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-cell1-config-data\"" Mar 16 16:13:26 crc kubenswrapper[5120]: I0316 16:13:26.228755 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-cell1-plugins-conf\"" Mar 16 16:13:26 crc kubenswrapper[5120]: I0316 16:13:26.238975 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nprdj\" (UniqueName: \"kubernetes.io/projected/51d5f0da-bcbc-492e-ab39-6189dc22fa22-kube-api-access-nprdj\") pod \"rabbitmq-server-0\" (UID: \"51d5f0da-bcbc-492e-ab39-6189dc22fa22\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:13:26 crc kubenswrapper[5120]: I0316 16:13:26.248269 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"rabbitmq-server-0\" (UID: \"51d5f0da-bcbc-492e-ab39-6189dc22fa22\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:13:26 crc kubenswrapper[5120]: I0316 16:13:26.264065 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:13:26 crc kubenswrapper[5120]: I0316 16:13:26.397054 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/551715bc-101a-4745-955b-027ac2be9c0b-plugins-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"551715bc-101a-4745-955b-027ac2be9c0b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:13:26 crc kubenswrapper[5120]: I0316 16:13:26.397309 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/551715bc-101a-4745-955b-027ac2be9c0b-rabbitmq-tls\") pod \"rabbitmq-cell1-server-0\" (UID: \"551715bc-101a-4745-955b-027ac2be9c0b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:13:26 crc kubenswrapper[5120]: I0316 16:13:26.397342 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"551715bc-101a-4745-955b-027ac2be9c0b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:13:26 crc kubenswrapper[5120]: I0316 16:13:26.397379 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/551715bc-101a-4745-955b-027ac2be9c0b-config-data\") pod \"rabbitmq-cell1-server-0\" (UID: \"551715bc-101a-4745-955b-027ac2be9c0b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:13:26 crc kubenswrapper[5120]: I0316 16:13:26.397863 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/551715bc-101a-4745-955b-027ac2be9c0b-erlang-cookie-secret\") pod \"rabbitmq-cell1-server-0\" (UID: \"551715bc-101a-4745-955b-027ac2be9c0b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:13:26 crc kubenswrapper[5120]: I0316 16:13:26.398511 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/551715bc-101a-4745-955b-027ac2be9c0b-pod-info\") pod \"rabbitmq-cell1-server-0\" (UID: \"551715bc-101a-4745-955b-027ac2be9c0b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:13:26 crc kubenswrapper[5120]: I0316 16:13:26.398581 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/551715bc-101a-4745-955b-027ac2be9c0b-server-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"551715bc-101a-4745-955b-027ac2be9c0b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:13:26 crc kubenswrapper[5120]: I0316 16:13:26.398629 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6vgr\" (UniqueName: \"kubernetes.io/projected/551715bc-101a-4745-955b-027ac2be9c0b-kube-api-access-n6vgr\") pod \"rabbitmq-cell1-server-0\" (UID: \"551715bc-101a-4745-955b-027ac2be9c0b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:13:26 crc kubenswrapper[5120]: I0316 16:13:26.398679 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/551715bc-101a-4745-955b-027ac2be9c0b-rabbitmq-confd\") pod \"rabbitmq-cell1-server-0\" (UID: \"551715bc-101a-4745-955b-027ac2be9c0b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:13:26 crc kubenswrapper[5120]: I0316 16:13:26.398805 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/551715bc-101a-4745-955b-027ac2be9c0b-rabbitmq-plugins\") pod \"rabbitmq-cell1-server-0\" (UID: \"551715bc-101a-4745-955b-027ac2be9c0b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:13:26 crc kubenswrapper[5120]: I0316 16:13:26.398873 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/551715bc-101a-4745-955b-027ac2be9c0b-rabbitmq-erlang-cookie\") pod \"rabbitmq-cell1-server-0\" (UID: \"551715bc-101a-4745-955b-027ac2be9c0b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:13:26 crc kubenswrapper[5120]: I0316 16:13:26.500545 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n6vgr\" (UniqueName: \"kubernetes.io/projected/551715bc-101a-4745-955b-027ac2be9c0b-kube-api-access-n6vgr\") pod \"rabbitmq-cell1-server-0\" (UID: \"551715bc-101a-4745-955b-027ac2be9c0b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:13:26 crc kubenswrapper[5120]: I0316 16:13:26.500592 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/551715bc-101a-4745-955b-027ac2be9c0b-rabbitmq-confd\") pod \"rabbitmq-cell1-server-0\" (UID: \"551715bc-101a-4745-955b-027ac2be9c0b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:13:26 crc kubenswrapper[5120]: I0316 16:13:26.500623 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/551715bc-101a-4745-955b-027ac2be9c0b-rabbitmq-plugins\") pod \"rabbitmq-cell1-server-0\" (UID: \"551715bc-101a-4745-955b-027ac2be9c0b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:13:26 crc kubenswrapper[5120]: I0316 16:13:26.500647 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/551715bc-101a-4745-955b-027ac2be9c0b-rabbitmq-erlang-cookie\") pod \"rabbitmq-cell1-server-0\" (UID: \"551715bc-101a-4745-955b-027ac2be9c0b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:13:26 crc kubenswrapper[5120]: I0316 16:13:26.500724 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/551715bc-101a-4745-955b-027ac2be9c0b-plugins-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"551715bc-101a-4745-955b-027ac2be9c0b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:13:26 crc kubenswrapper[5120]: I0316 16:13:26.500747 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/551715bc-101a-4745-955b-027ac2be9c0b-rabbitmq-tls\") pod \"rabbitmq-cell1-server-0\" (UID: \"551715bc-101a-4745-955b-027ac2be9c0b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:13:26 crc kubenswrapper[5120]: I0316 16:13:26.500780 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"551715bc-101a-4745-955b-027ac2be9c0b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:13:26 crc kubenswrapper[5120]: I0316 16:13:26.500835 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/551715bc-101a-4745-955b-027ac2be9c0b-config-data\") pod \"rabbitmq-cell1-server-0\" (UID: \"551715bc-101a-4745-955b-027ac2be9c0b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:13:26 crc kubenswrapper[5120]: I0316 16:13:26.500873 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/551715bc-101a-4745-955b-027ac2be9c0b-erlang-cookie-secret\") pod \"rabbitmq-cell1-server-0\" (UID: \"551715bc-101a-4745-955b-027ac2be9c0b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:13:26 crc kubenswrapper[5120]: I0316 16:13:26.500990 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/551715bc-101a-4745-955b-027ac2be9c0b-pod-info\") pod \"rabbitmq-cell1-server-0\" (UID: \"551715bc-101a-4745-955b-027ac2be9c0b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:13:26 crc kubenswrapper[5120]: I0316 16:13:26.501009 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/551715bc-101a-4745-955b-027ac2be9c0b-server-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"551715bc-101a-4745-955b-027ac2be9c0b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:13:26 crc kubenswrapper[5120]: I0316 16:13:26.503153 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/551715bc-101a-4745-955b-027ac2be9c0b-rabbitmq-erlang-cookie\") pod \"rabbitmq-cell1-server-0\" (UID: \"551715bc-101a-4745-955b-027ac2be9c0b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:13:26 crc kubenswrapper[5120]: I0316 16:13:26.503265 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/551715bc-101a-4745-955b-027ac2be9c0b-config-data\") pod \"rabbitmq-cell1-server-0\" (UID: \"551715bc-101a-4745-955b-027ac2be9c0b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:13:26 crc kubenswrapper[5120]: I0316 16:13:26.503511 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/551715bc-101a-4745-955b-027ac2be9c0b-rabbitmq-plugins\") pod \"rabbitmq-cell1-server-0\" (UID: \"551715bc-101a-4745-955b-027ac2be9c0b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:13:26 crc kubenswrapper[5120]: I0316 16:13:26.503530 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"551715bc-101a-4745-955b-027ac2be9c0b\") device mount path \"/mnt/openstack/pv17\"" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:13:26 crc kubenswrapper[5120]: I0316 16:13:26.504362 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/551715bc-101a-4745-955b-027ac2be9c0b-plugins-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"551715bc-101a-4745-955b-027ac2be9c0b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:13:26 crc kubenswrapper[5120]: I0316 16:13:26.505601 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/551715bc-101a-4745-955b-027ac2be9c0b-server-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"551715bc-101a-4745-955b-027ac2be9c0b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:13:26 crc kubenswrapper[5120]: I0316 16:13:26.508835 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/551715bc-101a-4745-955b-027ac2be9c0b-erlang-cookie-secret\") pod \"rabbitmq-cell1-server-0\" (UID: \"551715bc-101a-4745-955b-027ac2be9c0b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:13:26 crc kubenswrapper[5120]: I0316 16:13:26.510883 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/551715bc-101a-4745-955b-027ac2be9c0b-rabbitmq-confd\") pod \"rabbitmq-cell1-server-0\" (UID: \"551715bc-101a-4745-955b-027ac2be9c0b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:13:26 crc kubenswrapper[5120]: I0316 16:13:26.511083 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/551715bc-101a-4745-955b-027ac2be9c0b-rabbitmq-tls\") pod \"rabbitmq-cell1-server-0\" (UID: \"551715bc-101a-4745-955b-027ac2be9c0b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:13:26 crc kubenswrapper[5120]: I0316 16:13:26.514624 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/551715bc-101a-4745-955b-027ac2be9c0b-pod-info\") pod \"rabbitmq-cell1-server-0\" (UID: \"551715bc-101a-4745-955b-027ac2be9c0b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:13:26 crc kubenswrapper[5120]: I0316 16:13:26.525628 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6vgr\" (UniqueName: \"kubernetes.io/projected/551715bc-101a-4745-955b-027ac2be9c0b-kube-api-access-n6vgr\") pod \"rabbitmq-cell1-server-0\" (UID: \"551715bc-101a-4745-955b-027ac2be9c0b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:13:26 crc kubenswrapper[5120]: I0316 16:13:26.534957 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"551715bc-101a-4745-955b-027ac2be9c0b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:13:26 crc kubenswrapper[5120]: I0316 16:13:26.577179 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 16:13:26 crc kubenswrapper[5120]: I0316 16:13:26.663497 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:13:26 crc kubenswrapper[5120]: I0316 16:13:26.932618 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"51d5f0da-bcbc-492e-ab39-6189dc22fa22","Type":"ContainerStarted","Data":"a4290f99426e82e7e1bb576ee2d094e599d45c679282a7447ab119fbaf9f7682"} Mar 16 16:13:27 crc kubenswrapper[5120]: I0316 16:13:27.119699 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 16:13:27 crc kubenswrapper[5120]: W0316 16:13:27.121460 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod551715bc_101a_4745_955b_027ac2be9c0b.slice/crio-55fb9de35613d1592a20a79970889fb22a27e7a62635b9d08d1363e782b1425e WatchSource:0}: Error finding container 55fb9de35613d1592a20a79970889fb22a27e7a62635b9d08d1363e782b1425e: Status 404 returned error can't find the container with id 55fb9de35613d1592a20a79970889fb22a27e7a62635b9d08d1363e782b1425e Mar 16 16:13:27 crc kubenswrapper[5120]: I0316 16:13:27.725823 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 16:13:27 crc kubenswrapper[5120]: I0316 16:13:27.735231 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:13:27 crc kubenswrapper[5120]: I0316 16:13:27.738234 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-config-data\"" Mar 16 16:13:27 crc kubenswrapper[5120]: I0316 16:13:27.739305 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 16:13:27 crc kubenswrapper[5120]: I0316 16:13:27.741211 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"galera-openstack-dockercfg-5lqvh\"" Mar 16 16:13:27 crc kubenswrapper[5120]: I0316 16:13:27.741248 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-galera-openstack-svc\"" Mar 16 16:13:27 crc kubenswrapper[5120]: I0316 16:13:27.741980 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-scripts\"" Mar 16 16:13:27 crc kubenswrapper[5120]: I0316 16:13:27.752143 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"combined-ca-bundle\"" Mar 16 16:13:27 crc kubenswrapper[5120]: I0316 16:13:27.825015 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/4885bea5-bdc7-472b-8f70-e110dd9b8c06-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"4885bea5-bdc7-472b-8f70-e110dd9b8c06\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:13:27 crc kubenswrapper[5120]: I0316 16:13:27.825312 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4885bea5-bdc7-472b-8f70-e110dd9b8c06-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"4885bea5-bdc7-472b-8f70-e110dd9b8c06\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:13:27 crc kubenswrapper[5120]: I0316 16:13:27.825406 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2f29c\" (UniqueName: \"kubernetes.io/projected/4885bea5-bdc7-472b-8f70-e110dd9b8c06-kube-api-access-2f29c\") pod \"openstack-galera-0\" (UID: \"4885bea5-bdc7-472b-8f70-e110dd9b8c06\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:13:27 crc kubenswrapper[5120]: I0316 16:13:27.825587 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/4885bea5-bdc7-472b-8f70-e110dd9b8c06-kolla-config\") pod \"openstack-galera-0\" (UID: \"4885bea5-bdc7-472b-8f70-e110dd9b8c06\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:13:27 crc kubenswrapper[5120]: I0316 16:13:27.825733 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/4885bea5-bdc7-472b-8f70-e110dd9b8c06-config-data-generated\") pod \"openstack-galera-0\" (UID: \"4885bea5-bdc7-472b-8f70-e110dd9b8c06\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:13:27 crc kubenswrapper[5120]: I0316 16:13:27.825931 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage18-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") pod \"openstack-galera-0\" (UID: \"4885bea5-bdc7-472b-8f70-e110dd9b8c06\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:13:27 crc kubenswrapper[5120]: I0316 16:13:27.826510 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/4885bea5-bdc7-472b-8f70-e110dd9b8c06-operator-scripts\") pod \"openstack-galera-0\" (UID: \"4885bea5-bdc7-472b-8f70-e110dd9b8c06\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:13:27 crc kubenswrapper[5120]: I0316 16:13:27.826828 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/4885bea5-bdc7-472b-8f70-e110dd9b8c06-config-data-default\") pod \"openstack-galera-0\" (UID: \"4885bea5-bdc7-472b-8f70-e110dd9b8c06\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:13:27 crc kubenswrapper[5120]: I0316 16:13:27.929098 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage18-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") pod \"openstack-galera-0\" (UID: \"4885bea5-bdc7-472b-8f70-e110dd9b8c06\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:13:27 crc kubenswrapper[5120]: I0316 16:13:27.929177 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/4885bea5-bdc7-472b-8f70-e110dd9b8c06-operator-scripts\") pod \"openstack-galera-0\" (UID: \"4885bea5-bdc7-472b-8f70-e110dd9b8c06\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:13:27 crc kubenswrapper[5120]: I0316 16:13:27.929252 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/4885bea5-bdc7-472b-8f70-e110dd9b8c06-config-data-default\") pod \"openstack-galera-0\" (UID: \"4885bea5-bdc7-472b-8f70-e110dd9b8c06\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:13:27 crc kubenswrapper[5120]: I0316 16:13:27.929361 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/4885bea5-bdc7-472b-8f70-e110dd9b8c06-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"4885bea5-bdc7-472b-8f70-e110dd9b8c06\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:13:27 crc kubenswrapper[5120]: I0316 16:13:27.929524 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4885bea5-bdc7-472b-8f70-e110dd9b8c06-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"4885bea5-bdc7-472b-8f70-e110dd9b8c06\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:13:27 crc kubenswrapper[5120]: I0316 16:13:27.929579 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2f29c\" (UniqueName: \"kubernetes.io/projected/4885bea5-bdc7-472b-8f70-e110dd9b8c06-kube-api-access-2f29c\") pod \"openstack-galera-0\" (UID: \"4885bea5-bdc7-472b-8f70-e110dd9b8c06\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:13:27 crc kubenswrapper[5120]: I0316 16:13:27.929890 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/4885bea5-bdc7-472b-8f70-e110dd9b8c06-kolla-config\") pod \"openstack-galera-0\" (UID: \"4885bea5-bdc7-472b-8f70-e110dd9b8c06\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:13:27 crc kubenswrapper[5120]: I0316 16:13:27.930018 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/4885bea5-bdc7-472b-8f70-e110dd9b8c06-config-data-generated\") pod \"openstack-galera-0\" (UID: \"4885bea5-bdc7-472b-8f70-e110dd9b8c06\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:13:27 crc kubenswrapper[5120]: I0316 16:13:27.930604 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/4885bea5-bdc7-472b-8f70-e110dd9b8c06-config-data-default\") pod \"openstack-galera-0\" (UID: \"4885bea5-bdc7-472b-8f70-e110dd9b8c06\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:13:27 crc kubenswrapper[5120]: I0316 16:13:27.930817 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/4885bea5-bdc7-472b-8f70-e110dd9b8c06-config-data-generated\") pod \"openstack-galera-0\" (UID: \"4885bea5-bdc7-472b-8f70-e110dd9b8c06\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:13:27 crc kubenswrapper[5120]: I0316 16:13:27.931201 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/4885bea5-bdc7-472b-8f70-e110dd9b8c06-kolla-config\") pod \"openstack-galera-0\" (UID: \"4885bea5-bdc7-472b-8f70-e110dd9b8c06\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:13:27 crc kubenswrapper[5120]: I0316 16:13:27.931395 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage18-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") pod \"openstack-galera-0\" (UID: \"4885bea5-bdc7-472b-8f70-e110dd9b8c06\") device mount path \"/mnt/openstack/pv18\"" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:13:27 crc kubenswrapper[5120]: I0316 16:13:27.931753 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/4885bea5-bdc7-472b-8f70-e110dd9b8c06-operator-scripts\") pod \"openstack-galera-0\" (UID: \"4885bea5-bdc7-472b-8f70-e110dd9b8c06\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:13:27 crc kubenswrapper[5120]: I0316 16:13:27.936550 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/4885bea5-bdc7-472b-8f70-e110dd9b8c06-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"4885bea5-bdc7-472b-8f70-e110dd9b8c06\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:13:27 crc kubenswrapper[5120]: I0316 16:13:27.944174 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"551715bc-101a-4745-955b-027ac2be9c0b","Type":"ContainerStarted","Data":"55fb9de35613d1592a20a79970889fb22a27e7a62635b9d08d1363e782b1425e"} Mar 16 16:13:27 crc kubenswrapper[5120]: I0316 16:13:27.946282 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"51d5f0da-bcbc-492e-ab39-6189dc22fa22","Type":"ContainerStarted","Data":"e6b2822e5d645128d56a9bd865e65d852149622fc008ded1e1d1554dda52b32a"} Mar 16 16:13:27 crc kubenswrapper[5120]: I0316 16:13:27.950114 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4885bea5-bdc7-472b-8f70-e110dd9b8c06-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"4885bea5-bdc7-472b-8f70-e110dd9b8c06\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:13:27 crc kubenswrapper[5120]: I0316 16:13:27.959372 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2f29c\" (UniqueName: \"kubernetes.io/projected/4885bea5-bdc7-472b-8f70-e110dd9b8c06-kube-api-access-2f29c\") pod \"openstack-galera-0\" (UID: \"4885bea5-bdc7-472b-8f70-e110dd9b8c06\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:13:27 crc kubenswrapper[5120]: I0316 16:13:27.969437 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage18-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") pod \"openstack-galera-0\" (UID: \"4885bea5-bdc7-472b-8f70-e110dd9b8c06\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:13:28 crc kubenswrapper[5120]: I0316 16:13:28.062513 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:13:28 crc kubenswrapper[5120]: I0316 16:13:28.502514 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 16:13:28 crc kubenswrapper[5120]: W0316 16:13:28.507835 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4885bea5_bdc7_472b_8f70_e110dd9b8c06.slice/crio-e5880733cde3ad118ba2636713bd344419a5c01552ec4ae5f849085e22205c3f WatchSource:0}: Error finding container e5880733cde3ad118ba2636713bd344419a5c01552ec4ae5f849085e22205c3f: Status 404 returned error can't find the container with id e5880733cde3ad118ba2636713bd344419a5c01552ec4ae5f849085e22205c3f Mar 16 16:13:28 crc kubenswrapper[5120]: I0316 16:13:28.956147 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"4885bea5-bdc7-472b-8f70-e110dd9b8c06","Type":"ContainerStarted","Data":"331f5131feda92dcfd2ae478bd7fceddc5894d75c7dcb0e5bbc21e423c1443f2"} Mar 16 16:13:28 crc kubenswrapper[5120]: I0316 16:13:28.956431 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"4885bea5-bdc7-472b-8f70-e110dd9b8c06","Type":"ContainerStarted","Data":"e5880733cde3ad118ba2636713bd344419a5c01552ec4ae5f849085e22205c3f"} Mar 16 16:13:28 crc kubenswrapper[5120]: I0316 16:13:28.958931 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"551715bc-101a-4745-955b-027ac2be9c0b","Type":"ContainerStarted","Data":"851c1660f50a90ff9d46cc70cf1f804834a4e916e5c034ce95bd2ac287850333"} Mar 16 16:13:29 crc kubenswrapper[5120]: I0316 16:13:29.184247 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 16:13:29 crc kubenswrapper[5120]: I0316 16:13:29.189747 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:13:29 crc kubenswrapper[5120]: I0316 16:13:29.192470 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-cell1-config-data\"" Mar 16 16:13:29 crc kubenswrapper[5120]: I0316 16:13:29.192637 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-galera-openstack-cell1-svc\"" Mar 16 16:13:29 crc kubenswrapper[5120]: I0316 16:13:29.192886 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"galera-openstack-cell1-dockercfg-bd5cc\"" Mar 16 16:13:29 crc kubenswrapper[5120]: I0316 16:13:29.193010 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-cell1-scripts\"" Mar 16 16:13:29 crc kubenswrapper[5120]: I0316 16:13:29.211059 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 16:13:29 crc kubenswrapper[5120]: I0316 16:13:29.254737 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"openstack-cell1-galera-0\" (UID: \"848fca26-246f-48f5-8f00-a41ecb239952\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:13:29 crc kubenswrapper[5120]: I0316 16:13:29.254872 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/848fca26-246f-48f5-8f00-a41ecb239952-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"848fca26-246f-48f5-8f00-a41ecb239952\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:13:29 crc kubenswrapper[5120]: I0316 16:13:29.254942 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/848fca26-246f-48f5-8f00-a41ecb239952-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"848fca26-246f-48f5-8f00-a41ecb239952\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:13:29 crc kubenswrapper[5120]: I0316 16:13:29.255058 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/848fca26-246f-48f5-8f00-a41ecb239952-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"848fca26-246f-48f5-8f00-a41ecb239952\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:13:29 crc kubenswrapper[5120]: I0316 16:13:29.255213 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/848fca26-246f-48f5-8f00-a41ecb239952-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"848fca26-246f-48f5-8f00-a41ecb239952\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:13:29 crc kubenswrapper[5120]: I0316 16:13:29.255389 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/848fca26-246f-48f5-8f00-a41ecb239952-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"848fca26-246f-48f5-8f00-a41ecb239952\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:13:29 crc kubenswrapper[5120]: I0316 16:13:29.255462 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/848fca26-246f-48f5-8f00-a41ecb239952-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"848fca26-246f-48f5-8f00-a41ecb239952\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:13:29 crc kubenswrapper[5120]: I0316 16:13:29.255507 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wplp2\" (UniqueName: \"kubernetes.io/projected/848fca26-246f-48f5-8f00-a41ecb239952-kube-api-access-wplp2\") pod \"openstack-cell1-galera-0\" (UID: \"848fca26-246f-48f5-8f00-a41ecb239952\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:13:29 crc kubenswrapper[5120]: I0316 16:13:29.347550 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 16:13:29 crc kubenswrapper[5120]: I0316 16:13:29.356088 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Mar 16 16:13:29 crc kubenswrapper[5120]: I0316 16:13:29.357133 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"openstack-cell1-galera-0\" (UID: \"848fca26-246f-48f5-8f00-a41ecb239952\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:13:29 crc kubenswrapper[5120]: I0316 16:13:29.357240 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/848fca26-246f-48f5-8f00-a41ecb239952-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"848fca26-246f-48f5-8f00-a41ecb239952\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:13:29 crc kubenswrapper[5120]: I0316 16:13:29.357320 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/848fca26-246f-48f5-8f00-a41ecb239952-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"848fca26-246f-48f5-8f00-a41ecb239952\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:13:29 crc kubenswrapper[5120]: I0316 16:13:29.357655 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"openstack-cell1-galera-0\" (UID: \"848fca26-246f-48f5-8f00-a41ecb239952\") device mount path \"/mnt/openstack/pv02\"" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:13:29 crc kubenswrapper[5120]: I0316 16:13:29.358264 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/848fca26-246f-48f5-8f00-a41ecb239952-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"848fca26-246f-48f5-8f00-a41ecb239952\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:13:29 crc kubenswrapper[5120]: I0316 16:13:29.358315 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/848fca26-246f-48f5-8f00-a41ecb239952-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"848fca26-246f-48f5-8f00-a41ecb239952\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:13:29 crc kubenswrapper[5120]: I0316 16:13:29.358388 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/848fca26-246f-48f5-8f00-a41ecb239952-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"848fca26-246f-48f5-8f00-a41ecb239952\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:13:29 crc kubenswrapper[5120]: I0316 16:13:29.358409 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/848fca26-246f-48f5-8f00-a41ecb239952-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"848fca26-246f-48f5-8f00-a41ecb239952\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:13:29 crc kubenswrapper[5120]: I0316 16:13:29.358434 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wplp2\" (UniqueName: \"kubernetes.io/projected/848fca26-246f-48f5-8f00-a41ecb239952-kube-api-access-wplp2\") pod \"openstack-cell1-galera-0\" (UID: \"848fca26-246f-48f5-8f00-a41ecb239952\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:13:29 crc kubenswrapper[5120]: I0316 16:13:29.359510 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/848fca26-246f-48f5-8f00-a41ecb239952-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"848fca26-246f-48f5-8f00-a41ecb239952\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:13:29 crc kubenswrapper[5120]: I0316 16:13:29.359697 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/848fca26-246f-48f5-8f00-a41ecb239952-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"848fca26-246f-48f5-8f00-a41ecb239952\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:13:29 crc kubenswrapper[5120]: I0316 16:13:29.359979 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/848fca26-246f-48f5-8f00-a41ecb239952-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"848fca26-246f-48f5-8f00-a41ecb239952\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:13:29 crc kubenswrapper[5120]: I0316 16:13:29.360035 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/848fca26-246f-48f5-8f00-a41ecb239952-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"848fca26-246f-48f5-8f00-a41ecb239952\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:13:29 crc kubenswrapper[5120]: I0316 16:13:29.361225 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 16:13:29 crc kubenswrapper[5120]: I0316 16:13:29.361867 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"memcached-config-data\"" Mar 16 16:13:29 crc kubenswrapper[5120]: I0316 16:13:29.362160 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-memcached-svc\"" Mar 16 16:13:29 crc kubenswrapper[5120]: I0316 16:13:29.385227 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"memcached-memcached-dockercfg-hrm6l\"" Mar 16 16:13:29 crc kubenswrapper[5120]: I0316 16:13:29.385750 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/848fca26-246f-48f5-8f00-a41ecb239952-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"848fca26-246f-48f5-8f00-a41ecb239952\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:13:29 crc kubenswrapper[5120]: I0316 16:13:29.388642 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/848fca26-246f-48f5-8f00-a41ecb239952-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"848fca26-246f-48f5-8f00-a41ecb239952\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:13:29 crc kubenswrapper[5120]: I0316 16:13:29.388884 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wplp2\" (UniqueName: \"kubernetes.io/projected/848fca26-246f-48f5-8f00-a41ecb239952-kube-api-access-wplp2\") pod \"openstack-cell1-galera-0\" (UID: \"848fca26-246f-48f5-8f00-a41ecb239952\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:13:29 crc kubenswrapper[5120]: I0316 16:13:29.396725 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"openstack-cell1-galera-0\" (UID: \"848fca26-246f-48f5-8f00-a41ecb239952\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:13:29 crc kubenswrapper[5120]: I0316 16:13:29.459623 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ead61fcf-891a-44f3-8867-a2adcf744d69-combined-ca-bundle\") pod \"memcached-0\" (UID: \"ead61fcf-891a-44f3-8867-a2adcf744d69\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:13:29 crc kubenswrapper[5120]: I0316 16:13:29.459703 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/ead61fcf-891a-44f3-8867-a2adcf744d69-memcached-tls-certs\") pod \"memcached-0\" (UID: \"ead61fcf-891a-44f3-8867-a2adcf744d69\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:13:29 crc kubenswrapper[5120]: I0316 16:13:29.459861 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbdcx\" (UniqueName: \"kubernetes.io/projected/ead61fcf-891a-44f3-8867-a2adcf744d69-kube-api-access-mbdcx\") pod \"memcached-0\" (UID: \"ead61fcf-891a-44f3-8867-a2adcf744d69\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:13:29 crc kubenswrapper[5120]: I0316 16:13:29.459920 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/ead61fcf-891a-44f3-8867-a2adcf744d69-kolla-config\") pod \"memcached-0\" (UID: \"ead61fcf-891a-44f3-8867-a2adcf744d69\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:13:29 crc kubenswrapper[5120]: I0316 16:13:29.459968 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/ead61fcf-891a-44f3-8867-a2adcf744d69-config-data\") pod \"memcached-0\" (UID: \"ead61fcf-891a-44f3-8867-a2adcf744d69\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:13:29 crc kubenswrapper[5120]: I0316 16:13:29.516638 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:13:29 crc kubenswrapper[5120]: I0316 16:13:29.561798 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mbdcx\" (UniqueName: \"kubernetes.io/projected/ead61fcf-891a-44f3-8867-a2adcf744d69-kube-api-access-mbdcx\") pod \"memcached-0\" (UID: \"ead61fcf-891a-44f3-8867-a2adcf744d69\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:13:29 crc kubenswrapper[5120]: I0316 16:13:29.562422 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/ead61fcf-891a-44f3-8867-a2adcf744d69-kolla-config\") pod \"memcached-0\" (UID: \"ead61fcf-891a-44f3-8867-a2adcf744d69\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:13:29 crc kubenswrapper[5120]: I0316 16:13:29.562464 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/ead61fcf-891a-44f3-8867-a2adcf744d69-config-data\") pod \"memcached-0\" (UID: \"ead61fcf-891a-44f3-8867-a2adcf744d69\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:13:29 crc kubenswrapper[5120]: I0316 16:13:29.562534 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ead61fcf-891a-44f3-8867-a2adcf744d69-combined-ca-bundle\") pod \"memcached-0\" (UID: \"ead61fcf-891a-44f3-8867-a2adcf744d69\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:13:29 crc kubenswrapper[5120]: I0316 16:13:29.562573 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/ead61fcf-891a-44f3-8867-a2adcf744d69-memcached-tls-certs\") pod \"memcached-0\" (UID: \"ead61fcf-891a-44f3-8867-a2adcf744d69\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:13:29 crc kubenswrapper[5120]: I0316 16:13:29.563196 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/ead61fcf-891a-44f3-8867-a2adcf744d69-kolla-config\") pod \"memcached-0\" (UID: \"ead61fcf-891a-44f3-8867-a2adcf744d69\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:13:29 crc kubenswrapper[5120]: I0316 16:13:29.563565 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/ead61fcf-891a-44f3-8867-a2adcf744d69-config-data\") pod \"memcached-0\" (UID: \"ead61fcf-891a-44f3-8867-a2adcf744d69\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:13:29 crc kubenswrapper[5120]: I0316 16:13:29.569778 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/ead61fcf-891a-44f3-8867-a2adcf744d69-memcached-tls-certs\") pod \"memcached-0\" (UID: \"ead61fcf-891a-44f3-8867-a2adcf744d69\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:13:29 crc kubenswrapper[5120]: I0316 16:13:29.570395 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ead61fcf-891a-44f3-8867-a2adcf744d69-combined-ca-bundle\") pod \"memcached-0\" (UID: \"ead61fcf-891a-44f3-8867-a2adcf744d69\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:13:29 crc kubenswrapper[5120]: I0316 16:13:29.579182 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbdcx\" (UniqueName: \"kubernetes.io/projected/ead61fcf-891a-44f3-8867-a2adcf744d69-kube-api-access-mbdcx\") pod \"memcached-0\" (UID: \"ead61fcf-891a-44f3-8867-a2adcf744d69\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:13:29 crc kubenswrapper[5120]: I0316 16:13:29.725049 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Mar 16 16:13:29 crc kubenswrapper[5120]: I0316 16:13:29.843176 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 16:13:29 crc kubenswrapper[5120]: W0316 16:13:29.854312 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod848fca26_246f_48f5_8f00_a41ecb239952.slice/crio-8154531de0917e89dad3ddad5cf829da3b6011299e7c5d3e48ee19fbdf3df7eb WatchSource:0}: Error finding container 8154531de0917e89dad3ddad5cf829da3b6011299e7c5d3e48ee19fbdf3df7eb: Status 404 returned error can't find the container with id 8154531de0917e89dad3ddad5cf829da3b6011299e7c5d3e48ee19fbdf3df7eb Mar 16 16:13:29 crc kubenswrapper[5120]: I0316 16:13:29.969356 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"848fca26-246f-48f5-8f00-a41ecb239952","Type":"ContainerStarted","Data":"8154531de0917e89dad3ddad5cf829da3b6011299e7c5d3e48ee19fbdf3df7eb"} Mar 16 16:13:29 crc kubenswrapper[5120]: I0316 16:13:29.986518 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 16:13:29 crc kubenswrapper[5120]: W0316 16:13:29.993248 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podead61fcf_891a_44f3_8867_a2adcf744d69.slice/crio-99ce2b2ca9b50cf26c7be433dd5e683dd52dc02bbd8b038fbe0eefbbfaf13907 WatchSource:0}: Error finding container 99ce2b2ca9b50cf26c7be433dd5e683dd52dc02bbd8b038fbe0eefbbfaf13907: Status 404 returned error can't find the container with id 99ce2b2ca9b50cf26c7be433dd5e683dd52dc02bbd8b038fbe0eefbbfaf13907 Mar 16 16:13:30 crc kubenswrapper[5120]: I0316 16:13:30.976279 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"848fca26-246f-48f5-8f00-a41ecb239952","Type":"ContainerStarted","Data":"c7f3ff7114c8325a4013354eac7abcb97615578a9e9578a4e22a4de17afb1ebc"} Mar 16 16:13:30 crc kubenswrapper[5120]: I0316 16:13:30.978306 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"ead61fcf-891a-44f3-8867-a2adcf744d69","Type":"ContainerStarted","Data":"d251b0429da624062362d8f63ad78aba4ba2e5f930e45f5add820cdf106863fd"} Mar 16 16:13:30 crc kubenswrapper[5120]: I0316 16:13:30.978347 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"ead61fcf-891a-44f3-8867-a2adcf744d69","Type":"ContainerStarted","Data":"99ce2b2ca9b50cf26c7be433dd5e683dd52dc02bbd8b038fbe0eefbbfaf13907"} Mar 16 16:13:30 crc kubenswrapper[5120]: I0316 16:13:30.978365 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/memcached-0" Mar 16 16:13:31 crc kubenswrapper[5120]: I0316 16:13:31.016884 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/memcached-0" podStartSLOduration=2.016868243 podStartE2EDuration="2.016868243s" podCreationTimestamp="2026-03-16 16:13:29 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:13:31.012553246 +0000 UTC m=+2513.166484903" watchObservedRunningTime="2026-03-16 16:13:31.016868243 +0000 UTC m=+2513.170799900" Mar 16 16:13:31 crc kubenswrapper[5120]: I0316 16:13:31.473621 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 16:13:31 crc kubenswrapper[5120]: I0316 16:13:31.479603 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:13:31 crc kubenswrapper[5120]: I0316 16:13:31.481776 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"telemetry-ceilometer-dockercfg-kkpsp\"" Mar 16 16:13:31 crc kubenswrapper[5120]: I0316 16:13:31.484015 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 16:13:31 crc kubenswrapper[5120]: I0316 16:13:31.598047 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86tc7\" (UniqueName: \"kubernetes.io/projected/da20effd-08fa-46be-81a1-d9a5074e72a2-kube-api-access-86tc7\") pod \"kube-state-metrics-0\" (UID: \"da20effd-08fa-46be-81a1-d9a5074e72a2\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:13:31 crc kubenswrapper[5120]: I0316 16:13:31.700023 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-86tc7\" (UniqueName: \"kubernetes.io/projected/da20effd-08fa-46be-81a1-d9a5074e72a2-kube-api-access-86tc7\") pod \"kube-state-metrics-0\" (UID: \"da20effd-08fa-46be-81a1-d9a5074e72a2\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:13:31 crc kubenswrapper[5120]: I0316 16:13:31.723702 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-86tc7\" (UniqueName: \"kubernetes.io/projected/da20effd-08fa-46be-81a1-d9a5074e72a2-kube-api-access-86tc7\") pod \"kube-state-metrics-0\" (UID: \"da20effd-08fa-46be-81a1-d9a5074e72a2\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:13:31 crc kubenswrapper[5120]: I0316 16:13:31.811537 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:13:32 crc kubenswrapper[5120]: I0316 16:13:32.244666 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 16:13:32 crc kubenswrapper[5120]: W0316 16:13:32.245177 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podda20effd_08fa_46be_81a1_d9a5074e72a2.slice/crio-58446e866fa7d08d3c619baba7b4eb6247cab583cae5b19a2bc2b0f59c1da64e WatchSource:0}: Error finding container 58446e866fa7d08d3c619baba7b4eb6247cab583cae5b19a2bc2b0f59c1da64e: Status 404 returned error can't find the container with id 58446e866fa7d08d3c619baba7b4eb6247cab583cae5b19a2bc2b0f59c1da64e Mar 16 16:13:32 crc kubenswrapper[5120]: I0316 16:13:32.998650 5120 generic.go:358] "Generic (PLEG): container finished" podID="4885bea5-bdc7-472b-8f70-e110dd9b8c06" containerID="331f5131feda92dcfd2ae478bd7fceddc5894d75c7dcb0e5bbc21e423c1443f2" exitCode=0 Mar 16 16:13:32 crc kubenswrapper[5120]: I0316 16:13:32.998784 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"4885bea5-bdc7-472b-8f70-e110dd9b8c06","Type":"ContainerDied","Data":"331f5131feda92dcfd2ae478bd7fceddc5894d75c7dcb0e5bbc21e423c1443f2"} Mar 16 16:13:33 crc kubenswrapper[5120]: I0316 16:13:33.001782 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"da20effd-08fa-46be-81a1-d9a5074e72a2","Type":"ContainerStarted","Data":"8cc8e36d000e2d0c2c42d12d21dbefc8ec0787382032ec5f9d372e053ee9da21"} Mar 16 16:13:33 crc kubenswrapper[5120]: I0316 16:13:33.001826 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"da20effd-08fa-46be-81a1-d9a5074e72a2","Type":"ContainerStarted","Data":"58446e866fa7d08d3c619baba7b4eb6247cab583cae5b19a2bc2b0f59c1da64e"} Mar 16 16:13:33 crc kubenswrapper[5120]: I0316 16:13:33.001921 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:13:34 crc kubenswrapper[5120]: I0316 16:13:34.019728 5120 generic.go:358] "Generic (PLEG): container finished" podID="848fca26-246f-48f5-8f00-a41ecb239952" containerID="c7f3ff7114c8325a4013354eac7abcb97615578a9e9578a4e22a4de17afb1ebc" exitCode=0 Mar 16 16:13:34 crc kubenswrapper[5120]: I0316 16:13:34.019927 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"848fca26-246f-48f5-8f00-a41ecb239952","Type":"ContainerDied","Data":"c7f3ff7114c8325a4013354eac7abcb97615578a9e9578a4e22a4de17afb1ebc"} Mar 16 16:13:34 crc kubenswrapper[5120]: I0316 16:13:34.029140 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"4885bea5-bdc7-472b-8f70-e110dd9b8c06","Type":"ContainerStarted","Data":"c833fe04b4a70d900cce526171b73ba0d1127695de57d343cd58245cc8c7ce58"} Mar 16 16:13:34 crc kubenswrapper[5120]: I0316 16:13:34.058323 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/kube-state-metrics-0" podStartSLOduration=2.664601625 podStartE2EDuration="3.058295678s" podCreationTimestamp="2026-03-16 16:13:31 +0000 UTC" firstStartedPulling="2026-03-16 16:13:32.247630578 +0000 UTC m=+2514.401562235" lastFinishedPulling="2026-03-16 16:13:32.641324631 +0000 UTC m=+2514.795256288" observedRunningTime="2026-03-16 16:13:33.037842519 +0000 UTC m=+2515.191774186" watchObservedRunningTime="2026-03-16 16:13:34.058295678 +0000 UTC m=+2516.212227355" Mar 16 16:13:34 crc kubenswrapper[5120]: I0316 16:13:34.081319 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstack-galera-0" podStartSLOduration=8.081295752 podStartE2EDuration="8.081295752s" podCreationTimestamp="2026-03-16 16:13:26 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:13:34.072553085 +0000 UTC m=+2516.226484762" watchObservedRunningTime="2026-03-16 16:13:34.081295752 +0000 UTC m=+2516.235227409" Mar 16 16:13:34 crc kubenswrapper[5120]: I0316 16:13:34.376851 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 16:13:34 crc kubenswrapper[5120]: I0316 16:13:34.382461 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:13:34 crc kubenswrapper[5120]: I0316 16:13:34.384221 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovndbcluster-nb-config\"" Mar 16 16:13:34 crc kubenswrapper[5120]: I0316 16:13:34.384594 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ovncluster-ovndbcluster-nb-dockercfg-5vtwp\"" Mar 16 16:13:34 crc kubenswrapper[5120]: I0316 16:13:34.384852 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ovn-metrics\"" Mar 16 16:13:34 crc kubenswrapper[5120]: I0316 16:13:34.385021 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovndbcluster-nb-scripts\"" Mar 16 16:13:34 crc kubenswrapper[5120]: I0316 16:13:34.385240 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ovndbcluster-nb-ovndbs\"" Mar 16 16:13:34 crc kubenswrapper[5120]: I0316 16:13:34.390572 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 16:13:34 crc kubenswrapper[5120]: I0316 16:13:34.448932 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/b82f3ed0-7b4a-4ac7-800a-40f5c2cb7242-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"b82f3ed0-7b4a-4ac7-800a-40f5c2cb7242\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:13:34 crc kubenswrapper[5120]: I0316 16:13:34.448992 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9pslm\" (UniqueName: \"kubernetes.io/projected/b82f3ed0-7b4a-4ac7-800a-40f5c2cb7242-kube-api-access-9pslm\") pod \"ovsdbserver-nb-0\" (UID: \"b82f3ed0-7b4a-4ac7-800a-40f5c2cb7242\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:13:34 crc kubenswrapper[5120]: I0316 16:13:34.449118 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b82f3ed0-7b4a-4ac7-800a-40f5c2cb7242-config\") pod \"ovsdbserver-nb-0\" (UID: \"b82f3ed0-7b4a-4ac7-800a-40f5c2cb7242\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:13:34 crc kubenswrapper[5120]: I0316 16:13:34.449198 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"ovsdbserver-nb-0\" (UID: \"b82f3ed0-7b4a-4ac7-800a-40f5c2cb7242\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:13:34 crc kubenswrapper[5120]: I0316 16:13:34.449288 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/b82f3ed0-7b4a-4ac7-800a-40f5c2cb7242-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"b82f3ed0-7b4a-4ac7-800a-40f5c2cb7242\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:13:34 crc kubenswrapper[5120]: I0316 16:13:34.449346 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/b82f3ed0-7b4a-4ac7-800a-40f5c2cb7242-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"b82f3ed0-7b4a-4ac7-800a-40f5c2cb7242\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:13:34 crc kubenswrapper[5120]: I0316 16:13:34.449535 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b82f3ed0-7b4a-4ac7-800a-40f5c2cb7242-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"b82f3ed0-7b4a-4ac7-800a-40f5c2cb7242\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:13:34 crc kubenswrapper[5120]: I0316 16:13:34.449606 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/b82f3ed0-7b4a-4ac7-800a-40f5c2cb7242-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"b82f3ed0-7b4a-4ac7-800a-40f5c2cb7242\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:13:34 crc kubenswrapper[5120]: I0316 16:13:34.551781 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/b82f3ed0-7b4a-4ac7-800a-40f5c2cb7242-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"b82f3ed0-7b4a-4ac7-800a-40f5c2cb7242\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:13:34 crc kubenswrapper[5120]: I0316 16:13:34.551856 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b82f3ed0-7b4a-4ac7-800a-40f5c2cb7242-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"b82f3ed0-7b4a-4ac7-800a-40f5c2cb7242\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:13:34 crc kubenswrapper[5120]: I0316 16:13:34.551883 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/b82f3ed0-7b4a-4ac7-800a-40f5c2cb7242-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"b82f3ed0-7b4a-4ac7-800a-40f5c2cb7242\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:13:34 crc kubenswrapper[5120]: I0316 16:13:34.551931 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/b82f3ed0-7b4a-4ac7-800a-40f5c2cb7242-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"b82f3ed0-7b4a-4ac7-800a-40f5c2cb7242\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:13:34 crc kubenswrapper[5120]: I0316 16:13:34.551987 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9pslm\" (UniqueName: \"kubernetes.io/projected/b82f3ed0-7b4a-4ac7-800a-40f5c2cb7242-kube-api-access-9pslm\") pod \"ovsdbserver-nb-0\" (UID: \"b82f3ed0-7b4a-4ac7-800a-40f5c2cb7242\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:13:34 crc kubenswrapper[5120]: I0316 16:13:34.552139 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b82f3ed0-7b4a-4ac7-800a-40f5c2cb7242-config\") pod \"ovsdbserver-nb-0\" (UID: \"b82f3ed0-7b4a-4ac7-800a-40f5c2cb7242\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:13:34 crc kubenswrapper[5120]: I0316 16:13:34.552234 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"ovsdbserver-nb-0\" (UID: \"b82f3ed0-7b4a-4ac7-800a-40f5c2cb7242\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:13:34 crc kubenswrapper[5120]: I0316 16:13:34.552324 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/b82f3ed0-7b4a-4ac7-800a-40f5c2cb7242-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"b82f3ed0-7b4a-4ac7-800a-40f5c2cb7242\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:13:34 crc kubenswrapper[5120]: I0316 16:13:34.552674 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"ovsdbserver-nb-0\" (UID: \"b82f3ed0-7b4a-4ac7-800a-40f5c2cb7242\") device mount path \"/mnt/openstack/pv03\"" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:13:34 crc kubenswrapper[5120]: I0316 16:13:34.553065 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/b82f3ed0-7b4a-4ac7-800a-40f5c2cb7242-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"b82f3ed0-7b4a-4ac7-800a-40f5c2cb7242\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:13:34 crc kubenswrapper[5120]: I0316 16:13:34.553378 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b82f3ed0-7b4a-4ac7-800a-40f5c2cb7242-config\") pod \"ovsdbserver-nb-0\" (UID: \"b82f3ed0-7b4a-4ac7-800a-40f5c2cb7242\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:13:34 crc kubenswrapper[5120]: I0316 16:13:34.553826 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/b82f3ed0-7b4a-4ac7-800a-40f5c2cb7242-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"b82f3ed0-7b4a-4ac7-800a-40f5c2cb7242\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:13:34 crc kubenswrapper[5120]: I0316 16:13:34.557427 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/b82f3ed0-7b4a-4ac7-800a-40f5c2cb7242-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"b82f3ed0-7b4a-4ac7-800a-40f5c2cb7242\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:13:34 crc kubenswrapper[5120]: I0316 16:13:34.557617 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/b82f3ed0-7b4a-4ac7-800a-40f5c2cb7242-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"b82f3ed0-7b4a-4ac7-800a-40f5c2cb7242\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:13:34 crc kubenswrapper[5120]: I0316 16:13:34.568606 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b82f3ed0-7b4a-4ac7-800a-40f5c2cb7242-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"b82f3ed0-7b4a-4ac7-800a-40f5c2cb7242\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:13:34 crc kubenswrapper[5120]: I0316 16:13:34.575745 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"ovsdbserver-nb-0\" (UID: \"b82f3ed0-7b4a-4ac7-800a-40f5c2cb7242\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:13:34 crc kubenswrapper[5120]: I0316 16:13:34.576749 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9pslm\" (UniqueName: \"kubernetes.io/projected/b82f3ed0-7b4a-4ac7-800a-40f5c2cb7242-kube-api-access-9pslm\") pod \"ovsdbserver-nb-0\" (UID: \"b82f3ed0-7b4a-4ac7-800a-40f5c2cb7242\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:13:34 crc kubenswrapper[5120]: I0316 16:13:34.753110 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:13:35 crc kubenswrapper[5120]: I0316 16:13:35.055186 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"848fca26-246f-48f5-8f00-a41ecb239952","Type":"ContainerStarted","Data":"c758fe75eb30010d3898ba0e46464704f4eaccdb5721a29379189ee1664975df"} Mar 16 16:13:35 crc kubenswrapper[5120]: I0316 16:13:35.077286 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstack-cell1-galera-0" podStartSLOduration=7.077263257 podStartE2EDuration="7.077263257s" podCreationTimestamp="2026-03-16 16:13:28 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:13:35.072587069 +0000 UTC m=+2517.226518726" watchObservedRunningTime="2026-03-16 16:13:35.077263257 +0000 UTC m=+2517.231194914" Mar 16 16:13:35 crc kubenswrapper[5120]: I0316 16:13:35.194233 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 16:13:35 crc kubenswrapper[5120]: W0316 16:13:35.194609 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb82f3ed0_7b4a_4ac7_800a_40f5c2cb7242.slice/crio-7c5bf82afa95d3206dada3c4848737e3057cea3d907251f318b9fc4d732f69e3 WatchSource:0}: Error finding container 7c5bf82afa95d3206dada3c4848737e3057cea3d907251f318b9fc4d732f69e3: Status 404 returned error can't find the container with id 7c5bf82afa95d3206dada3c4848737e3057cea3d907251f318b9fc4d732f69e3 Mar 16 16:13:35 crc kubenswrapper[5120]: I0316 16:13:35.663521 5120 scope.go:117] "RemoveContainer" containerID="bc2df124cc6ad146d7c7dd2115ac815986fb62978d38895f6d345a4a9b14dbd8" Mar 16 16:13:35 crc kubenswrapper[5120]: E0316 16:13:35.663988 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:13:36 crc kubenswrapper[5120]: I0316 16:13:36.064888 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"b82f3ed0-7b4a-4ac7-800a-40f5c2cb7242","Type":"ContainerStarted","Data":"63b5afa737f6f7747352275491173c16cae3412926aa04a8ec50d294ba0d5c7e"} Mar 16 16:13:36 crc kubenswrapper[5120]: I0316 16:13:36.064933 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"b82f3ed0-7b4a-4ac7-800a-40f5c2cb7242","Type":"ContainerStarted","Data":"80c9afe3261c93a6525f7ff404170b08abdba9d0e0d9e39fe4469ee485fc35fe"} Mar 16 16:13:36 crc kubenswrapper[5120]: I0316 16:13:36.064943 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"b82f3ed0-7b4a-4ac7-800a-40f5c2cb7242","Type":"ContainerStarted","Data":"7c5bf82afa95d3206dada3c4848737e3057cea3d907251f318b9fc4d732f69e3"} Mar 16 16:13:36 crc kubenswrapper[5120]: I0316 16:13:36.091299 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podStartSLOduration=3.091274551 podStartE2EDuration="3.091274551s" podCreationTimestamp="2026-03-16 16:13:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:13:36.09013369 +0000 UTC m=+2518.244065357" watchObservedRunningTime="2026-03-16 16:13:36.091274551 +0000 UTC m=+2518.245206208" Mar 16 16:13:36 crc kubenswrapper[5120]: I0316 16:13:36.988522 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/memcached-0" Mar 16 16:13:37 crc kubenswrapper[5120]: I0316 16:13:37.536520 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 16:13:37 crc kubenswrapper[5120]: I0316 16:13:37.546353 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:13:37 crc kubenswrapper[5120]: I0316 16:13:37.550277 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovndbcluster-sb-config\"" Mar 16 16:13:37 crc kubenswrapper[5120]: I0316 16:13:37.557074 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 16:13:37 crc kubenswrapper[5120]: I0316 16:13:37.561177 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ovncluster-ovndbcluster-sb-dockercfg-jg5fb\"" Mar 16 16:13:37 crc kubenswrapper[5120]: I0316 16:13:37.561216 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovndbcluster-sb-scripts\"" Mar 16 16:13:37 crc kubenswrapper[5120]: I0316 16:13:37.561249 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ovndbcluster-sb-ovndbs\"" Mar 16 16:13:37 crc kubenswrapper[5120]: I0316 16:13:37.606743 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/39b1a992-7cfc-4382-9263-18d430251511-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"39b1a992-7cfc-4382-9263-18d430251511\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:13:37 crc kubenswrapper[5120]: I0316 16:13:37.606919 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/39b1a992-7cfc-4382-9263-18d430251511-config\") pod \"ovsdbserver-sb-0\" (UID: \"39b1a992-7cfc-4382-9263-18d430251511\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:13:37 crc kubenswrapper[5120]: I0316 16:13:37.606999 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/39b1a992-7cfc-4382-9263-18d430251511-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"39b1a992-7cfc-4382-9263-18d430251511\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:13:37 crc kubenswrapper[5120]: I0316 16:13:37.607126 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7qtg\" (UniqueName: \"kubernetes.io/projected/39b1a992-7cfc-4382-9263-18d430251511-kube-api-access-f7qtg\") pod \"ovsdbserver-sb-0\" (UID: \"39b1a992-7cfc-4382-9263-18d430251511\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:13:37 crc kubenswrapper[5120]: I0316 16:13:37.607257 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/39b1a992-7cfc-4382-9263-18d430251511-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"39b1a992-7cfc-4382-9263-18d430251511\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:13:37 crc kubenswrapper[5120]: I0316 16:13:37.607296 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage19-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") pod \"ovsdbserver-sb-0\" (UID: \"39b1a992-7cfc-4382-9263-18d430251511\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:13:37 crc kubenswrapper[5120]: I0316 16:13:37.607470 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/39b1a992-7cfc-4382-9263-18d430251511-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"39b1a992-7cfc-4382-9263-18d430251511\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:13:37 crc kubenswrapper[5120]: I0316 16:13:37.607501 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/39b1a992-7cfc-4382-9263-18d430251511-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"39b1a992-7cfc-4382-9263-18d430251511\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:13:37 crc kubenswrapper[5120]: I0316 16:13:37.708529 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/39b1a992-7cfc-4382-9263-18d430251511-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"39b1a992-7cfc-4382-9263-18d430251511\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:13:37 crc kubenswrapper[5120]: I0316 16:13:37.708573 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/39b1a992-7cfc-4382-9263-18d430251511-config\") pod \"ovsdbserver-sb-0\" (UID: \"39b1a992-7cfc-4382-9263-18d430251511\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:13:37 crc kubenswrapper[5120]: I0316 16:13:37.708727 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/39b1a992-7cfc-4382-9263-18d430251511-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"39b1a992-7cfc-4382-9263-18d430251511\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:13:37 crc kubenswrapper[5120]: I0316 16:13:37.709399 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/39b1a992-7cfc-4382-9263-18d430251511-config\") pod \"ovsdbserver-sb-0\" (UID: \"39b1a992-7cfc-4382-9263-18d430251511\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:13:37 crc kubenswrapper[5120]: I0316 16:13:37.709731 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f7qtg\" (UniqueName: \"kubernetes.io/projected/39b1a992-7cfc-4382-9263-18d430251511-kube-api-access-f7qtg\") pod \"ovsdbserver-sb-0\" (UID: \"39b1a992-7cfc-4382-9263-18d430251511\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:13:37 crc kubenswrapper[5120]: I0316 16:13:37.709822 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/39b1a992-7cfc-4382-9263-18d430251511-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"39b1a992-7cfc-4382-9263-18d430251511\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:13:37 crc kubenswrapper[5120]: I0316 16:13:37.709853 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage19-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") pod \"ovsdbserver-sb-0\" (UID: \"39b1a992-7cfc-4382-9263-18d430251511\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:13:37 crc kubenswrapper[5120]: I0316 16:13:37.709986 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/39b1a992-7cfc-4382-9263-18d430251511-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"39b1a992-7cfc-4382-9263-18d430251511\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:13:37 crc kubenswrapper[5120]: I0316 16:13:37.710016 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/39b1a992-7cfc-4382-9263-18d430251511-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"39b1a992-7cfc-4382-9263-18d430251511\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:13:37 crc kubenswrapper[5120]: I0316 16:13:37.710437 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage19-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") pod \"ovsdbserver-sb-0\" (UID: \"39b1a992-7cfc-4382-9263-18d430251511\") device mount path \"/mnt/openstack/pv19\"" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:13:37 crc kubenswrapper[5120]: I0316 16:13:37.710882 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/39b1a992-7cfc-4382-9263-18d430251511-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"39b1a992-7cfc-4382-9263-18d430251511\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:13:37 crc kubenswrapper[5120]: I0316 16:13:37.711122 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/39b1a992-7cfc-4382-9263-18d430251511-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"39b1a992-7cfc-4382-9263-18d430251511\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:13:37 crc kubenswrapper[5120]: I0316 16:13:37.716999 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/39b1a992-7cfc-4382-9263-18d430251511-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"39b1a992-7cfc-4382-9263-18d430251511\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:13:37 crc kubenswrapper[5120]: I0316 16:13:37.719325 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/39b1a992-7cfc-4382-9263-18d430251511-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"39b1a992-7cfc-4382-9263-18d430251511\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:13:37 crc kubenswrapper[5120]: I0316 16:13:37.736496 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/39b1a992-7cfc-4382-9263-18d430251511-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"39b1a992-7cfc-4382-9263-18d430251511\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:13:37 crc kubenswrapper[5120]: I0316 16:13:37.741366 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7qtg\" (UniqueName: \"kubernetes.io/projected/39b1a992-7cfc-4382-9263-18d430251511-kube-api-access-f7qtg\") pod \"ovsdbserver-sb-0\" (UID: \"39b1a992-7cfc-4382-9263-18d430251511\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:13:37 crc kubenswrapper[5120]: I0316 16:13:37.754109 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:13:37 crc kubenswrapper[5120]: I0316 16:13:37.764438 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage19-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") pod \"ovsdbserver-sb-0\" (UID: \"39b1a992-7cfc-4382-9263-18d430251511\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:13:37 crc kubenswrapper[5120]: I0316 16:13:37.866003 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:13:38 crc kubenswrapper[5120]: I0316 16:13:38.063717 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:13:38 crc kubenswrapper[5120]: I0316 16:13:38.063779 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:13:38 crc kubenswrapper[5120]: I0316 16:13:38.136705 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:13:38 crc kubenswrapper[5120]: I0316 16:13:38.215451 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:13:38 crc kubenswrapper[5120]: I0316 16:13:38.311716 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 16:13:38 crc kubenswrapper[5120]: W0316 16:13:38.315429 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod39b1a992_7cfc_4382_9263_18d430251511.slice/crio-741adc23c987b9e7b49b829acf8ee06d2c68c97ae7f7de14051ad29d223ae155 WatchSource:0}: Error finding container 741adc23c987b9e7b49b829acf8ee06d2c68c97ae7f7de14051ad29d223ae155: Status 404 returned error can't find the container with id 741adc23c987b9e7b49b829acf8ee06d2c68c97ae7f7de14051ad29d223ae155 Mar 16 16:13:39 crc kubenswrapper[5120]: I0316 16:13:39.092036 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"39b1a992-7cfc-4382-9263-18d430251511","Type":"ContainerStarted","Data":"f24bdb846594a48104f84ee1555c401e3cab825116931065b9f832d3b9ecbacd"} Mar 16 16:13:39 crc kubenswrapper[5120]: I0316 16:13:39.093510 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"39b1a992-7cfc-4382-9263-18d430251511","Type":"ContainerStarted","Data":"b864e5a30bdd1ec09c5e8b740495f3b877525c6eb80190831e21454bd493272f"} Mar 16 16:13:39 crc kubenswrapper[5120]: I0316 16:13:39.093653 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"39b1a992-7cfc-4382-9263-18d430251511","Type":"ContainerStarted","Data":"741adc23c987b9e7b49b829acf8ee06d2c68c97ae7f7de14051ad29d223ae155"} Mar 16 16:13:39 crc kubenswrapper[5120]: I0316 16:13:39.112692 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podStartSLOduration=3.112674803 podStartE2EDuration="3.112674803s" podCreationTimestamp="2026-03-16 16:13:36 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:13:39.112314583 +0000 UTC m=+2521.266246240" watchObservedRunningTime="2026-03-16 16:13:39.112674803 +0000 UTC m=+2521.266606460" Mar 16 16:13:39 crc kubenswrapper[5120]: I0316 16:13:39.518195 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:13:39 crc kubenswrapper[5120]: I0316 16:13:39.518255 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:13:39 crc kubenswrapper[5120]: I0316 16:13:39.753441 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:13:40 crc kubenswrapper[5120]: I0316 16:13:40.697395 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-db-create-jvj4v"] Mar 16 16:13:40 crc kubenswrapper[5120]: I0316 16:13:40.705354 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-create-jvj4v" Mar 16 16:13:40 crc kubenswrapper[5120]: I0316 16:13:40.710451 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-db-create-jvj4v"] Mar 16 16:13:40 crc kubenswrapper[5120]: I0316 16:13:40.805515 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-5fac-account-create-update-m6ghj"] Mar 16 16:13:40 crc kubenswrapper[5120]: I0316 16:13:40.812191 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:13:40 crc kubenswrapper[5120]: I0316 16:13:40.812659 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-5fac-account-create-update-m6ghj" Mar 16 16:13:40 crc kubenswrapper[5120]: I0316 16:13:40.815157 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-db-secret\"" Mar 16 16:13:40 crc kubenswrapper[5120]: I0316 16:13:40.818950 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-5fac-account-create-update-m6ghj"] Mar 16 16:13:40 crc kubenswrapper[5120]: I0316 16:13:40.858041 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:13:40 crc kubenswrapper[5120]: I0316 16:13:40.866272 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:13:40 crc kubenswrapper[5120]: I0316 16:13:40.882318 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mznq6\" (UniqueName: \"kubernetes.io/projected/3b1e62ee-71b0-4dc1-acdb-c879ca6dc4f2-kube-api-access-mznq6\") pod \"keystone-db-create-jvj4v\" (UID: \"3b1e62ee-71b0-4dc1-acdb-c879ca6dc4f2\") " pod="openstack-kuttl-tests/keystone-db-create-jvj4v" Mar 16 16:13:40 crc kubenswrapper[5120]: I0316 16:13:40.882388 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3b1e62ee-71b0-4dc1-acdb-c879ca6dc4f2-operator-scripts\") pod \"keystone-db-create-jvj4v\" (UID: \"3b1e62ee-71b0-4dc1-acdb-c879ca6dc4f2\") " pod="openstack-kuttl-tests/keystone-db-create-jvj4v" Mar 16 16:13:40 crc kubenswrapper[5120]: I0316 16:13:40.984143 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gr6cp\" (UniqueName: \"kubernetes.io/projected/f9aaa51a-8e46-4554-b9eb-3b0ff4ee602b-kube-api-access-gr6cp\") pod \"keystone-5fac-account-create-update-m6ghj\" (UID: \"f9aaa51a-8e46-4554-b9eb-3b0ff4ee602b\") " pod="openstack-kuttl-tests/keystone-5fac-account-create-update-m6ghj" Mar 16 16:13:40 crc kubenswrapper[5120]: I0316 16:13:40.984588 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mznq6\" (UniqueName: \"kubernetes.io/projected/3b1e62ee-71b0-4dc1-acdb-c879ca6dc4f2-kube-api-access-mznq6\") pod \"keystone-db-create-jvj4v\" (UID: \"3b1e62ee-71b0-4dc1-acdb-c879ca6dc4f2\") " pod="openstack-kuttl-tests/keystone-db-create-jvj4v" Mar 16 16:13:40 crc kubenswrapper[5120]: I0316 16:13:40.984639 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3b1e62ee-71b0-4dc1-acdb-c879ca6dc4f2-operator-scripts\") pod \"keystone-db-create-jvj4v\" (UID: \"3b1e62ee-71b0-4dc1-acdb-c879ca6dc4f2\") " pod="openstack-kuttl-tests/keystone-db-create-jvj4v" Mar 16 16:13:40 crc kubenswrapper[5120]: I0316 16:13:40.984802 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f9aaa51a-8e46-4554-b9eb-3b0ff4ee602b-operator-scripts\") pod \"keystone-5fac-account-create-update-m6ghj\" (UID: \"f9aaa51a-8e46-4554-b9eb-3b0ff4ee602b\") " pod="openstack-kuttl-tests/keystone-5fac-account-create-update-m6ghj" Mar 16 16:13:40 crc kubenswrapper[5120]: I0316 16:13:40.985618 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3b1e62ee-71b0-4dc1-acdb-c879ca6dc4f2-operator-scripts\") pod \"keystone-db-create-jvj4v\" (UID: \"3b1e62ee-71b0-4dc1-acdb-c879ca6dc4f2\") " pod="openstack-kuttl-tests/keystone-db-create-jvj4v" Mar 16 16:13:41 crc kubenswrapper[5120]: I0316 16:13:41.007027 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-db-create-hjbrr"] Mar 16 16:13:41 crc kubenswrapper[5120]: I0316 16:13:41.012627 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-create-hjbrr" Mar 16 16:13:41 crc kubenswrapper[5120]: I0316 16:13:41.015585 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-347f-account-create-update-5mt2p"] Mar 16 16:13:41 crc kubenswrapper[5120]: I0316 16:13:41.016047 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mznq6\" (UniqueName: \"kubernetes.io/projected/3b1e62ee-71b0-4dc1-acdb-c879ca6dc4f2-kube-api-access-mznq6\") pod \"keystone-db-create-jvj4v\" (UID: \"3b1e62ee-71b0-4dc1-acdb-c879ca6dc4f2\") " pod="openstack-kuttl-tests/keystone-db-create-jvj4v" Mar 16 16:13:41 crc kubenswrapper[5120]: I0316 16:13:41.022985 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-347f-account-create-update-5mt2p" Mar 16 16:13:41 crc kubenswrapper[5120]: I0316 16:13:41.025048 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-db-secret\"" Mar 16 16:13:41 crc kubenswrapper[5120]: I0316 16:13:41.026213 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-347f-account-create-update-5mt2p"] Mar 16 16:13:41 crc kubenswrapper[5120]: I0316 16:13:41.029483 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-create-jvj4v" Mar 16 16:13:41 crc kubenswrapper[5120]: I0316 16:13:41.037541 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-db-create-hjbrr"] Mar 16 16:13:41 crc kubenswrapper[5120]: I0316 16:13:41.065890 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/community-operators-lff6h"] Mar 16 16:13:41 crc kubenswrapper[5120]: I0316 16:13:41.075642 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-lff6h" Mar 16 16:13:41 crc kubenswrapper[5120]: I0316 16:13:41.086539 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/community-operators-lff6h"] Mar 16 16:13:41 crc kubenswrapper[5120]: I0316 16:13:41.087436 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f9aaa51a-8e46-4554-b9eb-3b0ff4ee602b-operator-scripts\") pod \"keystone-5fac-account-create-update-m6ghj\" (UID: \"f9aaa51a-8e46-4554-b9eb-3b0ff4ee602b\") " pod="openstack-kuttl-tests/keystone-5fac-account-create-update-m6ghj" Mar 16 16:13:41 crc kubenswrapper[5120]: I0316 16:13:41.087551 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gr6cp\" (UniqueName: \"kubernetes.io/projected/f9aaa51a-8e46-4554-b9eb-3b0ff4ee602b-kube-api-access-gr6cp\") pod \"keystone-5fac-account-create-update-m6ghj\" (UID: \"f9aaa51a-8e46-4554-b9eb-3b0ff4ee602b\") " pod="openstack-kuttl-tests/keystone-5fac-account-create-update-m6ghj" Mar 16 16:13:41 crc kubenswrapper[5120]: I0316 16:13:41.088450 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f9aaa51a-8e46-4554-b9eb-3b0ff4ee602b-operator-scripts\") pod \"keystone-5fac-account-create-update-m6ghj\" (UID: \"f9aaa51a-8e46-4554-b9eb-3b0ff4ee602b\") " pod="openstack-kuttl-tests/keystone-5fac-account-create-update-m6ghj" Mar 16 16:13:41 crc kubenswrapper[5120]: I0316 16:13:41.113680 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gr6cp\" (UniqueName: \"kubernetes.io/projected/f9aaa51a-8e46-4554-b9eb-3b0ff4ee602b-kube-api-access-gr6cp\") pod \"keystone-5fac-account-create-update-m6ghj\" (UID: \"f9aaa51a-8e46-4554-b9eb-3b0ff4ee602b\") " pod="openstack-kuttl-tests/keystone-5fac-account-create-update-m6ghj" Mar 16 16:13:41 crc kubenswrapper[5120]: I0316 16:13:41.134711 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-5fac-account-create-update-m6ghj" Mar 16 16:13:41 crc kubenswrapper[5120]: I0316 16:13:41.189009 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/62b9615a-6258-4e79-a0dc-e77955db96f8-operator-scripts\") pod \"placement-347f-account-create-update-5mt2p\" (UID: \"62b9615a-6258-4e79-a0dc-e77955db96f8\") " pod="openstack-kuttl-tests/placement-347f-account-create-update-5mt2p" Mar 16 16:13:41 crc kubenswrapper[5120]: I0316 16:13:41.189132 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/a51ee405-feaa-48a9-88e6-b677b86ab415-utilities\") pod \"community-operators-lff6h\" (UID: \"a51ee405-feaa-48a9-88e6-b677b86ab415\") " pod="openshift-marketplace/community-operators-lff6h" Mar 16 16:13:41 crc kubenswrapper[5120]: I0316 16:13:41.189450 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgqc9\" (UniqueName: \"kubernetes.io/projected/a51ee405-feaa-48a9-88e6-b677b86ab415-kube-api-access-wgqc9\") pod \"community-operators-lff6h\" (UID: \"a51ee405-feaa-48a9-88e6-b677b86ab415\") " pod="openshift-marketplace/community-operators-lff6h" Mar 16 16:13:41 crc kubenswrapper[5120]: I0316 16:13:41.189554 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e318f613-a626-41fc-a05d-d2b0595dafca-operator-scripts\") pod \"placement-db-create-hjbrr\" (UID: \"e318f613-a626-41fc-a05d-d2b0595dafca\") " pod="openstack-kuttl-tests/placement-db-create-hjbrr" Mar 16 16:13:41 crc kubenswrapper[5120]: I0316 16:13:41.189689 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knfxr\" (UniqueName: \"kubernetes.io/projected/e318f613-a626-41fc-a05d-d2b0595dafca-kube-api-access-knfxr\") pod \"placement-db-create-hjbrr\" (UID: \"e318f613-a626-41fc-a05d-d2b0595dafca\") " pod="openstack-kuttl-tests/placement-db-create-hjbrr" Mar 16 16:13:41 crc kubenswrapper[5120]: I0316 16:13:41.189733 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/a51ee405-feaa-48a9-88e6-b677b86ab415-catalog-content\") pod \"community-operators-lff6h\" (UID: \"a51ee405-feaa-48a9-88e6-b677b86ab415\") " pod="openshift-marketplace/community-operators-lff6h" Mar 16 16:13:41 crc kubenswrapper[5120]: I0316 16:13:41.189801 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvk7f\" (UniqueName: \"kubernetes.io/projected/62b9615a-6258-4e79-a0dc-e77955db96f8-kube-api-access-bvk7f\") pod \"placement-347f-account-create-update-5mt2p\" (UID: \"62b9615a-6258-4e79-a0dc-e77955db96f8\") " pod="openstack-kuttl-tests/placement-347f-account-create-update-5mt2p" Mar 16 16:13:41 crc kubenswrapper[5120]: I0316 16:13:41.291539 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e318f613-a626-41fc-a05d-d2b0595dafca-operator-scripts\") pod \"placement-db-create-hjbrr\" (UID: \"e318f613-a626-41fc-a05d-d2b0595dafca\") " pod="openstack-kuttl-tests/placement-db-create-hjbrr" Mar 16 16:13:41 crc kubenswrapper[5120]: I0316 16:13:41.291722 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-knfxr\" (UniqueName: \"kubernetes.io/projected/e318f613-a626-41fc-a05d-d2b0595dafca-kube-api-access-knfxr\") pod \"placement-db-create-hjbrr\" (UID: \"e318f613-a626-41fc-a05d-d2b0595dafca\") " pod="openstack-kuttl-tests/placement-db-create-hjbrr" Mar 16 16:13:41 crc kubenswrapper[5120]: I0316 16:13:41.291772 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/a51ee405-feaa-48a9-88e6-b677b86ab415-catalog-content\") pod \"community-operators-lff6h\" (UID: \"a51ee405-feaa-48a9-88e6-b677b86ab415\") " pod="openshift-marketplace/community-operators-lff6h" Mar 16 16:13:41 crc kubenswrapper[5120]: I0316 16:13:41.291797 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bvk7f\" (UniqueName: \"kubernetes.io/projected/62b9615a-6258-4e79-a0dc-e77955db96f8-kube-api-access-bvk7f\") pod \"placement-347f-account-create-update-5mt2p\" (UID: \"62b9615a-6258-4e79-a0dc-e77955db96f8\") " pod="openstack-kuttl-tests/placement-347f-account-create-update-5mt2p" Mar 16 16:13:41 crc kubenswrapper[5120]: I0316 16:13:41.291858 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/62b9615a-6258-4e79-a0dc-e77955db96f8-operator-scripts\") pod \"placement-347f-account-create-update-5mt2p\" (UID: \"62b9615a-6258-4e79-a0dc-e77955db96f8\") " pod="openstack-kuttl-tests/placement-347f-account-create-update-5mt2p" Mar 16 16:13:41 crc kubenswrapper[5120]: I0316 16:13:41.291900 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/a51ee405-feaa-48a9-88e6-b677b86ab415-utilities\") pod \"community-operators-lff6h\" (UID: \"a51ee405-feaa-48a9-88e6-b677b86ab415\") " pod="openshift-marketplace/community-operators-lff6h" Mar 16 16:13:41 crc kubenswrapper[5120]: I0316 16:13:41.291959 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wgqc9\" (UniqueName: \"kubernetes.io/projected/a51ee405-feaa-48a9-88e6-b677b86ab415-kube-api-access-wgqc9\") pod \"community-operators-lff6h\" (UID: \"a51ee405-feaa-48a9-88e6-b677b86ab415\") " pod="openshift-marketplace/community-operators-lff6h" Mar 16 16:13:41 crc kubenswrapper[5120]: I0316 16:13:41.292640 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/a51ee405-feaa-48a9-88e6-b677b86ab415-utilities\") pod \"community-operators-lff6h\" (UID: \"a51ee405-feaa-48a9-88e6-b677b86ab415\") " pod="openshift-marketplace/community-operators-lff6h" Mar 16 16:13:41 crc kubenswrapper[5120]: I0316 16:13:41.292817 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e318f613-a626-41fc-a05d-d2b0595dafca-operator-scripts\") pod \"placement-db-create-hjbrr\" (UID: \"e318f613-a626-41fc-a05d-d2b0595dafca\") " pod="openstack-kuttl-tests/placement-db-create-hjbrr" Mar 16 16:13:41 crc kubenswrapper[5120]: I0316 16:13:41.293699 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/a51ee405-feaa-48a9-88e6-b677b86ab415-catalog-content\") pod \"community-operators-lff6h\" (UID: \"a51ee405-feaa-48a9-88e6-b677b86ab415\") " pod="openshift-marketplace/community-operators-lff6h" Mar 16 16:13:41 crc kubenswrapper[5120]: I0316 16:13:41.294938 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/62b9615a-6258-4e79-a0dc-e77955db96f8-operator-scripts\") pod \"placement-347f-account-create-update-5mt2p\" (UID: \"62b9615a-6258-4e79-a0dc-e77955db96f8\") " pod="openstack-kuttl-tests/placement-347f-account-create-update-5mt2p" Mar 16 16:13:41 crc kubenswrapper[5120]: I0316 16:13:41.311831 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvk7f\" (UniqueName: \"kubernetes.io/projected/62b9615a-6258-4e79-a0dc-e77955db96f8-kube-api-access-bvk7f\") pod \"placement-347f-account-create-update-5mt2p\" (UID: \"62b9615a-6258-4e79-a0dc-e77955db96f8\") " pod="openstack-kuttl-tests/placement-347f-account-create-update-5mt2p" Mar 16 16:13:41 crc kubenswrapper[5120]: I0316 16:13:41.312250 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-knfxr\" (UniqueName: \"kubernetes.io/projected/e318f613-a626-41fc-a05d-d2b0595dafca-kube-api-access-knfxr\") pod \"placement-db-create-hjbrr\" (UID: \"e318f613-a626-41fc-a05d-d2b0595dafca\") " pod="openstack-kuttl-tests/placement-db-create-hjbrr" Mar 16 16:13:41 crc kubenswrapper[5120]: I0316 16:13:41.313380 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgqc9\" (UniqueName: \"kubernetes.io/projected/a51ee405-feaa-48a9-88e6-b677b86ab415-kube-api-access-wgqc9\") pod \"community-operators-lff6h\" (UID: \"a51ee405-feaa-48a9-88e6-b677b86ab415\") " pod="openshift-marketplace/community-operators-lff6h" Mar 16 16:13:41 crc kubenswrapper[5120]: I0316 16:13:41.453639 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-create-hjbrr" Mar 16 16:13:41 crc kubenswrapper[5120]: I0316 16:13:41.493218 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-347f-account-create-update-5mt2p" Mar 16 16:13:41 crc kubenswrapper[5120]: I0316 16:13:41.504514 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-lff6h" Mar 16 16:13:41 crc kubenswrapper[5120]: I0316 16:13:41.545386 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-db-create-jvj4v"] Mar 16 16:13:41 crc kubenswrapper[5120]: W0316 16:13:41.629216 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3b1e62ee_71b0_4dc1_acdb_c879ca6dc4f2.slice/crio-23c14780e62abae054717f5202ca3d5063c9ed7b56b7629b239d6fe3f2e52a6d WatchSource:0}: Error finding container 23c14780e62abae054717f5202ca3d5063c9ed7b56b7629b239d6fe3f2e52a6d: Status 404 returned error can't find the container with id 23c14780e62abae054717f5202ca3d5063c9ed7b56b7629b239d6fe3f2e52a6d Mar 16 16:13:41 crc kubenswrapper[5120]: I0316 16:13:41.633207 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-5fac-account-create-update-m6ghj"] Mar 16 16:13:41 crc kubenswrapper[5120]: I0316 16:13:41.928143 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:13:41 crc kubenswrapper[5120]: I0316 16:13:41.978809 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-db-create-hjbrr"] Mar 16 16:13:42 crc kubenswrapper[5120]: I0316 16:13:42.050300 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:13:42 crc kubenswrapper[5120]: I0316 16:13:42.125907 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-create-hjbrr" event={"ID":"e318f613-a626-41fc-a05d-d2b0595dafca","Type":"ContainerStarted","Data":"05256d7724e2a1f4a0c0a82df12dab0692694c010c9a82646570c75c1ba08a64"} Mar 16 16:13:42 crc kubenswrapper[5120]: I0316 16:13:42.127508 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-5fac-account-create-update-m6ghj" event={"ID":"f9aaa51a-8e46-4554-b9eb-3b0ff4ee602b","Type":"ContainerStarted","Data":"055f79a6905c351bf0d70cb2881d199a03a0362607503778267a2038d7383741"} Mar 16 16:13:42 crc kubenswrapper[5120]: I0316 16:13:42.127535 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-5fac-account-create-update-m6ghj" event={"ID":"f9aaa51a-8e46-4554-b9eb-3b0ff4ee602b","Type":"ContainerStarted","Data":"554d93d998ea129b4c79552709eac8ef708cefeeb5da1f07dac86e257980817c"} Mar 16 16:13:42 crc kubenswrapper[5120]: I0316 16:13:42.129820 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-create-jvj4v" event={"ID":"3b1e62ee-71b0-4dc1-acdb-c879ca6dc4f2","Type":"ContainerStarted","Data":"cef163ac5d8903c027451833dff610868bc8ad0469d059ca1d86ddf780dfab64"} Mar 16 16:13:42 crc kubenswrapper[5120]: I0316 16:13:42.129912 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-create-jvj4v" event={"ID":"3b1e62ee-71b0-4dc1-acdb-c879ca6dc4f2","Type":"ContainerStarted","Data":"23c14780e62abae054717f5202ca3d5063c9ed7b56b7629b239d6fe3f2e52a6d"} Mar 16 16:13:42 crc kubenswrapper[5120]: I0316 16:13:42.151202 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-5fac-account-create-update-m6ghj" podStartSLOduration=2.151177259 podStartE2EDuration="2.151177259s" podCreationTimestamp="2026-03-16 16:13:40 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:13:42.142579046 +0000 UTC m=+2524.296510713" watchObservedRunningTime="2026-03-16 16:13:42.151177259 +0000 UTC m=+2524.305108916" Mar 16 16:13:42 crc kubenswrapper[5120]: I0316 16:13:42.165051 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-db-create-jvj4v" podStartSLOduration=2.165030825 podStartE2EDuration="2.165030825s" podCreationTimestamp="2026-03-16 16:13:40 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:13:42.15564963 +0000 UTC m=+2524.309581287" watchObservedRunningTime="2026-03-16 16:13:42.165030825 +0000 UTC m=+2524.318962482" Mar 16 16:13:42 crc kubenswrapper[5120]: I0316 16:13:42.178909 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/community-operators-lff6h"] Mar 16 16:13:42 crc kubenswrapper[5120]: W0316 16:13:42.212124 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda51ee405_feaa_48a9_88e6_b677b86ab415.slice/crio-d9cc52f1db9914fa191501de25d67fbfea761af38d571fedade0190ff8f5012b WatchSource:0}: Error finding container d9cc52f1db9914fa191501de25d67fbfea761af38d571fedade0190ff8f5012b: Status 404 returned error can't find the container with id d9cc52f1db9914fa191501de25d67fbfea761af38d571fedade0190ff8f5012b Mar 16 16:13:42 crc kubenswrapper[5120]: I0316 16:13:42.283938 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-347f-account-create-update-5mt2p"] Mar 16 16:13:42 crc kubenswrapper[5120]: I0316 16:13:42.866115 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:13:42 crc kubenswrapper[5120]: I0316 16:13:42.913199 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 16:13:42 crc kubenswrapper[5120]: I0316 16:13:42.929711 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:13:42 crc kubenswrapper[5120]: I0316 16:13:42.932658 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"swift-swift-dockercfg-qxcsg\"" Mar 16 16:13:42 crc kubenswrapper[5120]: I0316 16:13:42.937487 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"swift-storage-config-data\"" Mar 16 16:13:42 crc kubenswrapper[5120]: I0316 16:13:42.937728 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"swift-ring-files\"" Mar 16 16:13:42 crc kubenswrapper[5120]: I0316 16:13:42.938344 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"swift-conf\"" Mar 16 16:13:42 crc kubenswrapper[5120]: I0316 16:13:42.938367 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 16:13:43 crc kubenswrapper[5120]: I0316 16:13:43.040674 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/101749dc-c834-4d18-9d65-704af8b368a4-combined-ca-bundle\") pod \"swift-storage-0\" (UID: \"101749dc-c834-4d18-9d65-704af8b368a4\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:13:43 crc kubenswrapper[5120]: I0316 16:13:43.040716 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/101749dc-c834-4d18-9d65-704af8b368a4-etc-swift\") pod \"swift-storage-0\" (UID: \"101749dc-c834-4d18-9d65-704af8b368a4\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:13:43 crc kubenswrapper[5120]: I0316 16:13:43.040828 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/101749dc-c834-4d18-9d65-704af8b368a4-cache\") pod \"swift-storage-0\" (UID: \"101749dc-c834-4d18-9d65-704af8b368a4\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:13:43 crc kubenswrapper[5120]: I0316 16:13:43.040846 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/101749dc-c834-4d18-9d65-704af8b368a4-lock\") pod \"swift-storage-0\" (UID: \"101749dc-c834-4d18-9d65-704af8b368a4\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:13:43 crc kubenswrapper[5120]: I0316 16:13:43.040967 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"swift-storage-0\" (UID: \"101749dc-c834-4d18-9d65-704af8b368a4\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:13:43 crc kubenswrapper[5120]: I0316 16:13:43.040991 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gddfd\" (UniqueName: \"kubernetes.io/projected/101749dc-c834-4d18-9d65-704af8b368a4-kube-api-access-gddfd\") pod \"swift-storage-0\" (UID: \"101749dc-c834-4d18-9d65-704af8b368a4\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:13:43 crc kubenswrapper[5120]: I0316 16:13:43.141650 5120 generic.go:358] "Generic (PLEG): container finished" podID="3b1e62ee-71b0-4dc1-acdb-c879ca6dc4f2" containerID="cef163ac5d8903c027451833dff610868bc8ad0469d059ca1d86ddf780dfab64" exitCode=0 Mar 16 16:13:43 crc kubenswrapper[5120]: I0316 16:13:43.141714 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-create-jvj4v" event={"ID":"3b1e62ee-71b0-4dc1-acdb-c879ca6dc4f2","Type":"ContainerDied","Data":"cef163ac5d8903c027451833dff610868bc8ad0469d059ca1d86ddf780dfab64"} Mar 16 16:13:43 crc kubenswrapper[5120]: I0316 16:13:43.142831 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/101749dc-c834-4d18-9d65-704af8b368a4-cache\") pod \"swift-storage-0\" (UID: \"101749dc-c834-4d18-9d65-704af8b368a4\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:13:43 crc kubenswrapper[5120]: I0316 16:13:43.142863 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/101749dc-c834-4d18-9d65-704af8b368a4-lock\") pod \"swift-storage-0\" (UID: \"101749dc-c834-4d18-9d65-704af8b368a4\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:13:43 crc kubenswrapper[5120]: I0316 16:13:43.143029 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"swift-storage-0\" (UID: \"101749dc-c834-4d18-9d65-704af8b368a4\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:13:43 crc kubenswrapper[5120]: I0316 16:13:43.143074 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gddfd\" (UniqueName: \"kubernetes.io/projected/101749dc-c834-4d18-9d65-704af8b368a4-kube-api-access-gddfd\") pod \"swift-storage-0\" (UID: \"101749dc-c834-4d18-9d65-704af8b368a4\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:13:43 crc kubenswrapper[5120]: I0316 16:13:43.143165 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/101749dc-c834-4d18-9d65-704af8b368a4-combined-ca-bundle\") pod \"swift-storage-0\" (UID: \"101749dc-c834-4d18-9d65-704af8b368a4\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:13:43 crc kubenswrapper[5120]: I0316 16:13:43.143187 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/101749dc-c834-4d18-9d65-704af8b368a4-etc-swift\") pod \"swift-storage-0\" (UID: \"101749dc-c834-4d18-9d65-704af8b368a4\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:13:43 crc kubenswrapper[5120]: I0316 16:13:43.143595 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/101749dc-c834-4d18-9d65-704af8b368a4-cache\") pod \"swift-storage-0\" (UID: \"101749dc-c834-4d18-9d65-704af8b368a4\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:13:43 crc kubenswrapper[5120]: I0316 16:13:43.143630 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/101749dc-c834-4d18-9d65-704af8b368a4-lock\") pod \"swift-storage-0\" (UID: \"101749dc-c834-4d18-9d65-704af8b368a4\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:13:43 crc kubenswrapper[5120]: E0316 16:13:43.143627 5120 projected.go:289] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Mar 16 16:13:43 crc kubenswrapper[5120]: E0316 16:13:43.143845 5120 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Mar 16 16:13:43 crc kubenswrapper[5120]: E0316 16:13:43.143933 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/101749dc-c834-4d18-9d65-704af8b368a4-etc-swift podName:101749dc-c834-4d18-9d65-704af8b368a4 nodeName:}" failed. No retries permitted until 2026-03-16 16:13:43.643903755 +0000 UTC m=+2525.797835452 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/101749dc-c834-4d18-9d65-704af8b368a4-etc-swift") pod "swift-storage-0" (UID: "101749dc-c834-4d18-9d65-704af8b368a4") : configmap "swift-ring-files" not found Mar 16 16:13:43 crc kubenswrapper[5120]: I0316 16:13:43.143672 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"swift-storage-0\" (UID: \"101749dc-c834-4d18-9d65-704af8b368a4\") device mount path \"/mnt/openstack/pv06\"" pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:13:43 crc kubenswrapper[5120]: I0316 16:13:43.144712 5120 generic.go:358] "Generic (PLEG): container finished" podID="e318f613-a626-41fc-a05d-d2b0595dafca" containerID="8f9466afed1f7a0ef7a6f3cac7487cf1ed203ee726c32fb4e6a13a8ca68d71a1" exitCode=0 Mar 16 16:13:43 crc kubenswrapper[5120]: I0316 16:13:43.144950 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-create-hjbrr" event={"ID":"e318f613-a626-41fc-a05d-d2b0595dafca","Type":"ContainerDied","Data":"8f9466afed1f7a0ef7a6f3cac7487cf1ed203ee726c32fb4e6a13a8ca68d71a1"} Mar 16 16:13:43 crc kubenswrapper[5120]: I0316 16:13:43.148519 5120 generic.go:358] "Generic (PLEG): container finished" podID="a51ee405-feaa-48a9-88e6-b677b86ab415" containerID="dfcd593312f48006df93207939cbcac42e8683cb2de3ae877c676f39b036338d" exitCode=0 Mar 16 16:13:43 crc kubenswrapper[5120]: I0316 16:13:43.149851 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-lff6h" event={"ID":"a51ee405-feaa-48a9-88e6-b677b86ab415","Type":"ContainerDied","Data":"dfcd593312f48006df93207939cbcac42e8683cb2de3ae877c676f39b036338d"} Mar 16 16:13:43 crc kubenswrapper[5120]: I0316 16:13:43.149884 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-lff6h" event={"ID":"a51ee405-feaa-48a9-88e6-b677b86ab415","Type":"ContainerStarted","Data":"d9cc52f1db9914fa191501de25d67fbfea761af38d571fedade0190ff8f5012b"} Mar 16 16:13:43 crc kubenswrapper[5120]: I0316 16:13:43.154289 5120 generic.go:358] "Generic (PLEG): container finished" podID="62b9615a-6258-4e79-a0dc-e77955db96f8" containerID="7cddf6f9772bb6d3fb4cedcc8d62e67f7c196cf34e754082cabc8e98596326c9" exitCode=0 Mar 16 16:13:43 crc kubenswrapper[5120]: I0316 16:13:43.154631 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-347f-account-create-update-5mt2p" event={"ID":"62b9615a-6258-4e79-a0dc-e77955db96f8","Type":"ContainerDied","Data":"7cddf6f9772bb6d3fb4cedcc8d62e67f7c196cf34e754082cabc8e98596326c9"} Mar 16 16:13:43 crc kubenswrapper[5120]: I0316 16:13:43.154683 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-347f-account-create-update-5mt2p" event={"ID":"62b9615a-6258-4e79-a0dc-e77955db96f8","Type":"ContainerStarted","Data":"1b13a1103d5144db1d94eb5882c8bcb64f9e5d8724f9fcce87200b1bb7eecef1"} Mar 16 16:13:43 crc kubenswrapper[5120]: I0316 16:13:43.155370 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/101749dc-c834-4d18-9d65-704af8b368a4-combined-ca-bundle\") pod \"swift-storage-0\" (UID: \"101749dc-c834-4d18-9d65-704af8b368a4\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:13:43 crc kubenswrapper[5120]: I0316 16:13:43.160827 5120 generic.go:358] "Generic (PLEG): container finished" podID="f9aaa51a-8e46-4554-b9eb-3b0ff4ee602b" containerID="055f79a6905c351bf0d70cb2881d199a03a0362607503778267a2038d7383741" exitCode=0 Mar 16 16:13:43 crc kubenswrapper[5120]: I0316 16:13:43.161073 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-5fac-account-create-update-m6ghj" event={"ID":"f9aaa51a-8e46-4554-b9eb-3b0ff4ee602b","Type":"ContainerDied","Data":"055f79a6905c351bf0d70cb2881d199a03a0362607503778267a2038d7383741"} Mar 16 16:13:43 crc kubenswrapper[5120]: I0316 16:13:43.175531 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"swift-storage-0\" (UID: \"101749dc-c834-4d18-9d65-704af8b368a4\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:13:43 crc kubenswrapper[5120]: I0316 16:13:43.176077 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gddfd\" (UniqueName: \"kubernetes.io/projected/101749dc-c834-4d18-9d65-704af8b368a4-kube-api-access-gddfd\") pod \"swift-storage-0\" (UID: \"101749dc-c834-4d18-9d65-704af8b368a4\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:13:43 crc kubenswrapper[5120]: I0316 16:13:43.656466 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/101749dc-c834-4d18-9d65-704af8b368a4-etc-swift\") pod \"swift-storage-0\" (UID: \"101749dc-c834-4d18-9d65-704af8b368a4\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:13:43 crc kubenswrapper[5120]: E0316 16:13:43.656606 5120 projected.go:289] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Mar 16 16:13:43 crc kubenswrapper[5120]: E0316 16:13:43.656820 5120 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Mar 16 16:13:43 crc kubenswrapper[5120]: E0316 16:13:43.656896 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/101749dc-c834-4d18-9d65-704af8b368a4-etc-swift podName:101749dc-c834-4d18-9d65-704af8b368a4 nodeName:}" failed. No retries permitted until 2026-03-16 16:13:44.656880034 +0000 UTC m=+2526.810811691 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/101749dc-c834-4d18-9d65-704af8b368a4-etc-swift") pod "swift-storage-0" (UID: "101749dc-c834-4d18-9d65-704af8b368a4") : configmap "swift-ring-files" not found Mar 16 16:13:43 crc kubenswrapper[5120]: I0316 16:13:43.902648 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:13:43 crc kubenswrapper[5120]: I0316 16:13:43.938119 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:13:44 crc kubenswrapper[5120]: I0316 16:13:44.034083 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:13:44 crc kubenswrapper[5120]: I0316 16:13:44.291127 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 16:13:44 crc kubenswrapper[5120]: I0316 16:13:44.302122 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:13:44 crc kubenswrapper[5120]: I0316 16:13:44.306210 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovnnorthd-config\"" Mar 16 16:13:44 crc kubenswrapper[5120]: I0316 16:13:44.306484 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ovnnorthd-ovndbs\"" Mar 16 16:13:44 crc kubenswrapper[5120]: I0316 16:13:44.306649 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ovnnorthd-ovnnorthd-dockercfg-9v4vc\"" Mar 16 16:13:44 crc kubenswrapper[5120]: I0316 16:13:44.306739 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovnnorthd-scripts\"" Mar 16 16:13:44 crc kubenswrapper[5120]: I0316 16:13:44.311602 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 16:13:44 crc kubenswrapper[5120]: I0316 16:13:44.377720 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/43c58ec7-474a-49bc-921f-89cf47b67811-scripts\") pod \"ovn-northd-0\" (UID: \"43c58ec7-474a-49bc-921f-89cf47b67811\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:13:44 crc kubenswrapper[5120]: I0316 16:13:44.377786 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/43c58ec7-474a-49bc-921f-89cf47b67811-config\") pod \"ovn-northd-0\" (UID: \"43c58ec7-474a-49bc-921f-89cf47b67811\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:13:44 crc kubenswrapper[5120]: I0316 16:13:44.377962 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/43c58ec7-474a-49bc-921f-89cf47b67811-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"43c58ec7-474a-49bc-921f-89cf47b67811\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:13:44 crc kubenswrapper[5120]: I0316 16:13:44.378148 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/43c58ec7-474a-49bc-921f-89cf47b67811-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"43c58ec7-474a-49bc-921f-89cf47b67811\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:13:44 crc kubenswrapper[5120]: I0316 16:13:44.378217 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/43c58ec7-474a-49bc-921f-89cf47b67811-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"43c58ec7-474a-49bc-921f-89cf47b67811\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:13:44 crc kubenswrapper[5120]: I0316 16:13:44.378342 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-492g4\" (UniqueName: \"kubernetes.io/projected/43c58ec7-474a-49bc-921f-89cf47b67811-kube-api-access-492g4\") pod \"ovn-northd-0\" (UID: \"43c58ec7-474a-49bc-921f-89cf47b67811\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:13:44 crc kubenswrapper[5120]: I0316 16:13:44.378394 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/43c58ec7-474a-49bc-921f-89cf47b67811-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"43c58ec7-474a-49bc-921f-89cf47b67811\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:13:44 crc kubenswrapper[5120]: I0316 16:13:44.480362 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/43c58ec7-474a-49bc-921f-89cf47b67811-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"43c58ec7-474a-49bc-921f-89cf47b67811\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:13:44 crc kubenswrapper[5120]: I0316 16:13:44.480407 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/43c58ec7-474a-49bc-921f-89cf47b67811-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"43c58ec7-474a-49bc-921f-89cf47b67811\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:13:44 crc kubenswrapper[5120]: I0316 16:13:44.480477 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-492g4\" (UniqueName: \"kubernetes.io/projected/43c58ec7-474a-49bc-921f-89cf47b67811-kube-api-access-492g4\") pod \"ovn-northd-0\" (UID: \"43c58ec7-474a-49bc-921f-89cf47b67811\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:13:44 crc kubenswrapper[5120]: I0316 16:13:44.480504 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/43c58ec7-474a-49bc-921f-89cf47b67811-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"43c58ec7-474a-49bc-921f-89cf47b67811\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:13:44 crc kubenswrapper[5120]: I0316 16:13:44.480614 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/43c58ec7-474a-49bc-921f-89cf47b67811-scripts\") pod \"ovn-northd-0\" (UID: \"43c58ec7-474a-49bc-921f-89cf47b67811\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:13:44 crc kubenswrapper[5120]: I0316 16:13:44.480646 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/43c58ec7-474a-49bc-921f-89cf47b67811-config\") pod \"ovn-northd-0\" (UID: \"43c58ec7-474a-49bc-921f-89cf47b67811\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:13:44 crc kubenswrapper[5120]: I0316 16:13:44.480673 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/43c58ec7-474a-49bc-921f-89cf47b67811-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"43c58ec7-474a-49bc-921f-89cf47b67811\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:13:44 crc kubenswrapper[5120]: I0316 16:13:44.482184 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/43c58ec7-474a-49bc-921f-89cf47b67811-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"43c58ec7-474a-49bc-921f-89cf47b67811\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:13:44 crc kubenswrapper[5120]: I0316 16:13:44.482955 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/43c58ec7-474a-49bc-921f-89cf47b67811-config\") pod \"ovn-northd-0\" (UID: \"43c58ec7-474a-49bc-921f-89cf47b67811\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:13:44 crc kubenswrapper[5120]: I0316 16:13:44.483391 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/43c58ec7-474a-49bc-921f-89cf47b67811-scripts\") pod \"ovn-northd-0\" (UID: \"43c58ec7-474a-49bc-921f-89cf47b67811\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:13:44 crc kubenswrapper[5120]: I0316 16:13:44.487188 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/43c58ec7-474a-49bc-921f-89cf47b67811-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"43c58ec7-474a-49bc-921f-89cf47b67811\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:13:44 crc kubenswrapper[5120]: I0316 16:13:44.487783 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/43c58ec7-474a-49bc-921f-89cf47b67811-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"43c58ec7-474a-49bc-921f-89cf47b67811\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:13:44 crc kubenswrapper[5120]: I0316 16:13:44.495033 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/43c58ec7-474a-49bc-921f-89cf47b67811-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"43c58ec7-474a-49bc-921f-89cf47b67811\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:13:44 crc kubenswrapper[5120]: I0316 16:13:44.502440 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-492g4\" (UniqueName: \"kubernetes.io/projected/43c58ec7-474a-49bc-921f-89cf47b67811-kube-api-access-492g4\") pod \"ovn-northd-0\" (UID: \"43c58ec7-474a-49bc-921f-89cf47b67811\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:13:44 crc kubenswrapper[5120]: I0316 16:13:44.630647 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:13:44 crc kubenswrapper[5120]: I0316 16:13:44.683703 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/101749dc-c834-4d18-9d65-704af8b368a4-etc-swift\") pod \"swift-storage-0\" (UID: \"101749dc-c834-4d18-9d65-704af8b368a4\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:13:44 crc kubenswrapper[5120]: E0316 16:13:44.683956 5120 projected.go:289] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Mar 16 16:13:44 crc kubenswrapper[5120]: E0316 16:13:44.683968 5120 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Mar 16 16:13:44 crc kubenswrapper[5120]: E0316 16:13:44.684013 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/101749dc-c834-4d18-9d65-704af8b368a4-etc-swift podName:101749dc-c834-4d18-9d65-704af8b368a4 nodeName:}" failed. No retries permitted until 2026-03-16 16:13:46.683999234 +0000 UTC m=+2528.837930881 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/101749dc-c834-4d18-9d65-704af8b368a4-etc-swift") pod "swift-storage-0" (UID: "101749dc-c834-4d18-9d65-704af8b368a4") : configmap "swift-ring-files" not found Mar 16 16:13:44 crc kubenswrapper[5120]: I0316 16:13:44.728325 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-create-hjbrr" Mar 16 16:13:44 crc kubenswrapper[5120]: I0316 16:13:44.819962 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-347f-account-create-update-5mt2p" Mar 16 16:13:44 crc kubenswrapper[5120]: I0316 16:13:44.834813 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-5fac-account-create-update-m6ghj" Mar 16 16:13:44 crc kubenswrapper[5120]: I0316 16:13:44.848748 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-create-jvj4v" Mar 16 16:13:44 crc kubenswrapper[5120]: I0316 16:13:44.888820 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e318f613-a626-41fc-a05d-d2b0595dafca-operator-scripts\") pod \"e318f613-a626-41fc-a05d-d2b0595dafca\" (UID: \"e318f613-a626-41fc-a05d-d2b0595dafca\") " Mar 16 16:13:44 crc kubenswrapper[5120]: I0316 16:13:44.888903 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bvk7f\" (UniqueName: \"kubernetes.io/projected/62b9615a-6258-4e79-a0dc-e77955db96f8-kube-api-access-bvk7f\") pod \"62b9615a-6258-4e79-a0dc-e77955db96f8\" (UID: \"62b9615a-6258-4e79-a0dc-e77955db96f8\") " Mar 16 16:13:44 crc kubenswrapper[5120]: I0316 16:13:44.889265 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-knfxr\" (UniqueName: \"kubernetes.io/projected/e318f613-a626-41fc-a05d-d2b0595dafca-kube-api-access-knfxr\") pod \"e318f613-a626-41fc-a05d-d2b0595dafca\" (UID: \"e318f613-a626-41fc-a05d-d2b0595dafca\") " Mar 16 16:13:44 crc kubenswrapper[5120]: I0316 16:13:44.889445 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/62b9615a-6258-4e79-a0dc-e77955db96f8-operator-scripts\") pod \"62b9615a-6258-4e79-a0dc-e77955db96f8\" (UID: \"62b9615a-6258-4e79-a0dc-e77955db96f8\") " Mar 16 16:13:44 crc kubenswrapper[5120]: I0316 16:13:44.889506 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e318f613-a626-41fc-a05d-d2b0595dafca-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "e318f613-a626-41fc-a05d-d2b0595dafca" (UID: "e318f613-a626-41fc-a05d-d2b0595dafca"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:13:44 crc kubenswrapper[5120]: I0316 16:13:44.890070 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e318f613-a626-41fc-a05d-d2b0595dafca-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:13:44 crc kubenswrapper[5120]: I0316 16:13:44.890173 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/62b9615a-6258-4e79-a0dc-e77955db96f8-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "62b9615a-6258-4e79-a0dc-e77955db96f8" (UID: "62b9615a-6258-4e79-a0dc-e77955db96f8"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:13:44 crc kubenswrapper[5120]: I0316 16:13:44.894645 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62b9615a-6258-4e79-a0dc-e77955db96f8-kube-api-access-bvk7f" (OuterVolumeSpecName: "kube-api-access-bvk7f") pod "62b9615a-6258-4e79-a0dc-e77955db96f8" (UID: "62b9615a-6258-4e79-a0dc-e77955db96f8"). InnerVolumeSpecName "kube-api-access-bvk7f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:13:44 crc kubenswrapper[5120]: I0316 16:13:44.895627 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e318f613-a626-41fc-a05d-d2b0595dafca-kube-api-access-knfxr" (OuterVolumeSpecName: "kube-api-access-knfxr") pod "e318f613-a626-41fc-a05d-d2b0595dafca" (UID: "e318f613-a626-41fc-a05d-d2b0595dafca"). InnerVolumeSpecName "kube-api-access-knfxr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:13:44 crc kubenswrapper[5120]: I0316 16:13:44.990894 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f9aaa51a-8e46-4554-b9eb-3b0ff4ee602b-operator-scripts\") pod \"f9aaa51a-8e46-4554-b9eb-3b0ff4ee602b\" (UID: \"f9aaa51a-8e46-4554-b9eb-3b0ff4ee602b\") " Mar 16 16:13:44 crc kubenswrapper[5120]: I0316 16:13:44.990943 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gr6cp\" (UniqueName: \"kubernetes.io/projected/f9aaa51a-8e46-4554-b9eb-3b0ff4ee602b-kube-api-access-gr6cp\") pod \"f9aaa51a-8e46-4554-b9eb-3b0ff4ee602b\" (UID: \"f9aaa51a-8e46-4554-b9eb-3b0ff4ee602b\") " Mar 16 16:13:44 crc kubenswrapper[5120]: I0316 16:13:44.990969 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mznq6\" (UniqueName: \"kubernetes.io/projected/3b1e62ee-71b0-4dc1-acdb-c879ca6dc4f2-kube-api-access-mznq6\") pod \"3b1e62ee-71b0-4dc1-acdb-c879ca6dc4f2\" (UID: \"3b1e62ee-71b0-4dc1-acdb-c879ca6dc4f2\") " Mar 16 16:13:44 crc kubenswrapper[5120]: I0316 16:13:44.991174 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3b1e62ee-71b0-4dc1-acdb-c879ca6dc4f2-operator-scripts\") pod \"3b1e62ee-71b0-4dc1-acdb-c879ca6dc4f2\" (UID: \"3b1e62ee-71b0-4dc1-acdb-c879ca6dc4f2\") " Mar 16 16:13:44 crc kubenswrapper[5120]: I0316 16:13:44.991608 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f9aaa51a-8e46-4554-b9eb-3b0ff4ee602b-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "f9aaa51a-8e46-4554-b9eb-3b0ff4ee602b" (UID: "f9aaa51a-8e46-4554-b9eb-3b0ff4ee602b"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:13:44 crc kubenswrapper[5120]: I0316 16:13:44.991660 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bvk7f\" (UniqueName: \"kubernetes.io/projected/62b9615a-6258-4e79-a0dc-e77955db96f8-kube-api-access-bvk7f\") on node \"crc\" DevicePath \"\"" Mar 16 16:13:44 crc kubenswrapper[5120]: I0316 16:13:44.991673 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-knfxr\" (UniqueName: \"kubernetes.io/projected/e318f613-a626-41fc-a05d-d2b0595dafca-kube-api-access-knfxr\") on node \"crc\" DevicePath \"\"" Mar 16 16:13:44 crc kubenswrapper[5120]: I0316 16:13:44.991682 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/62b9615a-6258-4e79-a0dc-e77955db96f8-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:13:44 crc kubenswrapper[5120]: I0316 16:13:44.991889 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3b1e62ee-71b0-4dc1-acdb-c879ca6dc4f2-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "3b1e62ee-71b0-4dc1-acdb-c879ca6dc4f2" (UID: "3b1e62ee-71b0-4dc1-acdb-c879ca6dc4f2"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:13:44 crc kubenswrapper[5120]: I0316 16:13:44.993730 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f9aaa51a-8e46-4554-b9eb-3b0ff4ee602b-kube-api-access-gr6cp" (OuterVolumeSpecName: "kube-api-access-gr6cp") pod "f9aaa51a-8e46-4554-b9eb-3b0ff4ee602b" (UID: "f9aaa51a-8e46-4554-b9eb-3b0ff4ee602b"). InnerVolumeSpecName "kube-api-access-gr6cp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:13:45 crc kubenswrapper[5120]: I0316 16:13:45.001714 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b1e62ee-71b0-4dc1-acdb-c879ca6dc4f2-kube-api-access-mznq6" (OuterVolumeSpecName: "kube-api-access-mznq6") pod "3b1e62ee-71b0-4dc1-acdb-c879ca6dc4f2" (UID: "3b1e62ee-71b0-4dc1-acdb-c879ca6dc4f2"). InnerVolumeSpecName "kube-api-access-mznq6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:13:45 crc kubenswrapper[5120]: I0316 16:13:45.093626 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f9aaa51a-8e46-4554-b9eb-3b0ff4ee602b-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:13:45 crc kubenswrapper[5120]: I0316 16:13:45.093666 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gr6cp\" (UniqueName: \"kubernetes.io/projected/f9aaa51a-8e46-4554-b9eb-3b0ff4ee602b-kube-api-access-gr6cp\") on node \"crc\" DevicePath \"\"" Mar 16 16:13:45 crc kubenswrapper[5120]: I0316 16:13:45.093677 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mznq6\" (UniqueName: \"kubernetes.io/projected/3b1e62ee-71b0-4dc1-acdb-c879ca6dc4f2-kube-api-access-mznq6\") on node \"crc\" DevicePath \"\"" Mar 16 16:13:45 crc kubenswrapper[5120]: I0316 16:13:45.093689 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3b1e62ee-71b0-4dc1-acdb-c879ca6dc4f2-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:13:45 crc kubenswrapper[5120]: I0316 16:13:45.147168 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 16:13:45 crc kubenswrapper[5120]: I0316 16:13:45.188774 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-347f-account-create-update-5mt2p" event={"ID":"62b9615a-6258-4e79-a0dc-e77955db96f8","Type":"ContainerDied","Data":"1b13a1103d5144db1d94eb5882c8bcb64f9e5d8724f9fcce87200b1bb7eecef1"} Mar 16 16:13:45 crc kubenswrapper[5120]: I0316 16:13:45.188845 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1b13a1103d5144db1d94eb5882c8bcb64f9e5d8724f9fcce87200b1bb7eecef1" Mar 16 16:13:45 crc kubenswrapper[5120]: I0316 16:13:45.188961 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-347f-account-create-update-5mt2p" Mar 16 16:13:45 crc kubenswrapper[5120]: I0316 16:13:45.190604 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"43c58ec7-474a-49bc-921f-89cf47b67811","Type":"ContainerStarted","Data":"fdfda74e8dea1743568bff9193171e47ef9404e97f22d3c41f3b371490216c0c"} Mar 16 16:13:45 crc kubenswrapper[5120]: I0316 16:13:45.193802 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-5fac-account-create-update-m6ghj" event={"ID":"f9aaa51a-8e46-4554-b9eb-3b0ff4ee602b","Type":"ContainerDied","Data":"554d93d998ea129b4c79552709eac8ef708cefeeb5da1f07dac86e257980817c"} Mar 16 16:13:45 crc kubenswrapper[5120]: I0316 16:13:45.193847 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="554d93d998ea129b4c79552709eac8ef708cefeeb5da1f07dac86e257980817c" Mar 16 16:13:45 crc kubenswrapper[5120]: I0316 16:13:45.195271 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-5fac-account-create-update-m6ghj" Mar 16 16:13:45 crc kubenswrapper[5120]: I0316 16:13:45.195729 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-create-jvj4v" Mar 16 16:13:45 crc kubenswrapper[5120]: I0316 16:13:45.195806 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-create-jvj4v" event={"ID":"3b1e62ee-71b0-4dc1-acdb-c879ca6dc4f2","Type":"ContainerDied","Data":"23c14780e62abae054717f5202ca3d5063c9ed7b56b7629b239d6fe3f2e52a6d"} Mar 16 16:13:45 crc kubenswrapper[5120]: I0316 16:13:45.195844 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="23c14780e62abae054717f5202ca3d5063c9ed7b56b7629b239d6fe3f2e52a6d" Mar 16 16:13:45 crc kubenswrapper[5120]: I0316 16:13:45.198228 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-create-hjbrr" event={"ID":"e318f613-a626-41fc-a05d-d2b0595dafca","Type":"ContainerDied","Data":"05256d7724e2a1f4a0c0a82df12dab0692694c010c9a82646570c75c1ba08a64"} Mar 16 16:13:45 crc kubenswrapper[5120]: I0316 16:13:45.198261 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="05256d7724e2a1f4a0c0a82df12dab0692694c010c9a82646570c75c1ba08a64" Mar 16 16:13:45 crc kubenswrapper[5120]: I0316 16:13:45.198324 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-create-hjbrr" Mar 16 16:13:45 crc kubenswrapper[5120]: I0316 16:13:45.202361 5120 generic.go:358] "Generic (PLEG): container finished" podID="a51ee405-feaa-48a9-88e6-b677b86ab415" containerID="25ac2dd2da7e375fd9e7a1d50e2a6ead3d419c2749507c43fd9ec7c01ce5e1cc" exitCode=0 Mar 16 16:13:45 crc kubenswrapper[5120]: I0316 16:13:45.202414 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-lff6h" event={"ID":"a51ee405-feaa-48a9-88e6-b677b86ab415","Type":"ContainerDied","Data":"25ac2dd2da7e375fd9e7a1d50e2a6ead3d419c2749507c43fd9ec7c01ce5e1cc"} Mar 16 16:13:46 crc kubenswrapper[5120]: I0316 16:13:46.214124 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-lff6h" event={"ID":"a51ee405-feaa-48a9-88e6-b677b86ab415","Type":"ContainerStarted","Data":"ffbabe7972fa1829e67e0bf59ce6ad83bf04d4bf024e45ea7592ee2312d17499"} Mar 16 16:13:46 crc kubenswrapper[5120]: I0316 16:13:46.218370 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"43c58ec7-474a-49bc-921f-89cf47b67811","Type":"ContainerStarted","Data":"c129c8987a210dccaf5b5f1284053994d439c82b3f7a189597964833bd162b00"} Mar 16 16:13:46 crc kubenswrapper[5120]: I0316 16:13:46.218415 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"43c58ec7-474a-49bc-921f-89cf47b67811","Type":"ContainerStarted","Data":"91983d4216ebe44a593c5fc4a07bcf3d059ad912a84a5035330dd9bd796a595d"} Mar 16 16:13:46 crc kubenswrapper[5120]: I0316 16:13:46.218572 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:13:46 crc kubenswrapper[5120]: I0316 16:13:46.233935 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/community-operators-lff6h" podStartSLOduration=3.880168137 podStartE2EDuration="5.233911439s" podCreationTimestamp="2026-03-16 16:13:41 +0000 UTC" firstStartedPulling="2026-03-16 16:13:43.149669632 +0000 UTC m=+2525.303601309" lastFinishedPulling="2026-03-16 16:13:44.503412954 +0000 UTC m=+2526.657344611" observedRunningTime="2026-03-16 16:13:46.229629093 +0000 UTC m=+2528.383560760" watchObservedRunningTime="2026-03-16 16:13:46.233911439 +0000 UTC m=+2528.387843096" Mar 16 16:13:46 crc kubenswrapper[5120]: I0316 16:13:46.253880 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovn-northd-0" podStartSLOduration=2.25386385 podStartE2EDuration="2.25386385s" podCreationTimestamp="2026-03-16 16:13:44 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:13:46.247498488 +0000 UTC m=+2528.401430145" watchObservedRunningTime="2026-03-16 16:13:46.25386385 +0000 UTC m=+2528.407795507" Mar 16 16:13:46 crc kubenswrapper[5120]: I0316 16:13:46.683355 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/root-account-create-update-cg9xc"] Mar 16 16:13:46 crc kubenswrapper[5120]: I0316 16:13:46.684237 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62b9615a-6258-4e79-a0dc-e77955db96f8" containerName="mariadb-account-create-update" Mar 16 16:13:46 crc kubenswrapper[5120]: I0316 16:13:46.684251 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="62b9615a-6258-4e79-a0dc-e77955db96f8" containerName="mariadb-account-create-update" Mar 16 16:13:46 crc kubenswrapper[5120]: I0316 16:13:46.684260 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b1e62ee-71b0-4dc1-acdb-c879ca6dc4f2" containerName="mariadb-database-create" Mar 16 16:13:46 crc kubenswrapper[5120]: I0316 16:13:46.684266 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b1e62ee-71b0-4dc1-acdb-c879ca6dc4f2" containerName="mariadb-database-create" Mar 16 16:13:46 crc kubenswrapper[5120]: I0316 16:13:46.684279 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9aaa51a-8e46-4554-b9eb-3b0ff4ee602b" containerName="mariadb-account-create-update" Mar 16 16:13:46 crc kubenswrapper[5120]: I0316 16:13:46.684285 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9aaa51a-8e46-4554-b9eb-3b0ff4ee602b" containerName="mariadb-account-create-update" Mar 16 16:13:46 crc kubenswrapper[5120]: I0316 16:13:46.684300 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e318f613-a626-41fc-a05d-d2b0595dafca" containerName="mariadb-database-create" Mar 16 16:13:46 crc kubenswrapper[5120]: I0316 16:13:46.684305 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e318f613-a626-41fc-a05d-d2b0595dafca" containerName="mariadb-database-create" Mar 16 16:13:46 crc kubenswrapper[5120]: I0316 16:13:46.684440 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="3b1e62ee-71b0-4dc1-acdb-c879ca6dc4f2" containerName="mariadb-database-create" Mar 16 16:13:46 crc kubenswrapper[5120]: I0316 16:13:46.684457 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e318f613-a626-41fc-a05d-d2b0595dafca" containerName="mariadb-database-create" Mar 16 16:13:46 crc kubenswrapper[5120]: I0316 16:13:46.684465 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="62b9615a-6258-4e79-a0dc-e77955db96f8" containerName="mariadb-account-create-update" Mar 16 16:13:46 crc kubenswrapper[5120]: I0316 16:13:46.684474 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f9aaa51a-8e46-4554-b9eb-3b0ff4ee602b" containerName="mariadb-account-create-update" Mar 16 16:13:46 crc kubenswrapper[5120]: I0316 16:13:46.692969 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-cg9xc" Mar 16 16:13:46 crc kubenswrapper[5120]: I0316 16:13:46.697885 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"openstack-mariadb-root-db-secret\"" Mar 16 16:13:46 crc kubenswrapper[5120]: I0316 16:13:46.699078 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-cg9xc"] Mar 16 16:13:46 crc kubenswrapper[5120]: I0316 16:13:46.720667 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/101749dc-c834-4d18-9d65-704af8b368a4-etc-swift\") pod \"swift-storage-0\" (UID: \"101749dc-c834-4d18-9d65-704af8b368a4\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:13:46 crc kubenswrapper[5120]: E0316 16:13:46.720870 5120 projected.go:289] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Mar 16 16:13:46 crc kubenswrapper[5120]: E0316 16:13:46.720892 5120 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Mar 16 16:13:46 crc kubenswrapper[5120]: E0316 16:13:46.720942 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/101749dc-c834-4d18-9d65-704af8b368a4-etc-swift podName:101749dc-c834-4d18-9d65-704af8b368a4 nodeName:}" failed. No retries permitted until 2026-03-16 16:13:50.720924954 +0000 UTC m=+2532.874856611 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/101749dc-c834-4d18-9d65-704af8b368a4-etc-swift") pod "swift-storage-0" (UID: "101749dc-c834-4d18-9d65-704af8b368a4") : configmap "swift-ring-files" not found Mar 16 16:13:46 crc kubenswrapper[5120]: I0316 16:13:46.757339 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-7b4z9"] Mar 16 16:13:46 crc kubenswrapper[5120]: I0316 16:13:46.762682 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-7b4z9" Mar 16 16:13:46 crc kubenswrapper[5120]: I0316 16:13:46.766363 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"swift-proxy-config-data\"" Mar 16 16:13:46 crc kubenswrapper[5120]: I0316 16:13:46.766578 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"swift-ring-config-data\"" Mar 16 16:13:46 crc kubenswrapper[5120]: I0316 16:13:46.768280 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"swift-ring-scripts\"" Mar 16 16:13:46 crc kubenswrapper[5120]: I0316 16:13:46.801091 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-7b4z9"] Mar 16 16:13:46 crc kubenswrapper[5120]: E0316 16:13:46.801646 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[combined-ca-bundle dispersionconf etc-swift kube-api-access-dssn7 ring-data-devices scripts swiftconf], unattached volumes=[], failed to process volumes=[combined-ca-bundle dispersionconf etc-swift kube-api-access-dssn7 ring-data-devices scripts swiftconf]: context canceled" pod="openstack-kuttl-tests/swift-ring-rebalance-7b4z9" podUID="b42a5e9c-18f0-4abf-9c53-ef0f0156f049" Mar 16 16:13:46 crc kubenswrapper[5120]: I0316 16:13:46.808770 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-j7b48"] Mar 16 16:13:46 crc kubenswrapper[5120]: I0316 16:13:46.813420 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-j7b48" Mar 16 16:13:46 crc kubenswrapper[5120]: I0316 16:13:46.818226 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-j7b48"] Mar 16 16:13:46 crc kubenswrapper[5120]: I0316 16:13:46.831902 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-7b4z9"] Mar 16 16:13:46 crc kubenswrapper[5120]: I0316 16:13:46.835669 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzfzp\" (UniqueName: \"kubernetes.io/projected/4a80bd29-f380-41b4-88db-1c80eccb1ca8-kube-api-access-xzfzp\") pod \"root-account-create-update-cg9xc\" (UID: \"4a80bd29-f380-41b4-88db-1c80eccb1ca8\") " pod="openstack-kuttl-tests/root-account-create-update-cg9xc" Mar 16 16:13:46 crc kubenswrapper[5120]: I0316 16:13:46.835974 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/4a80bd29-f380-41b4-88db-1c80eccb1ca8-operator-scripts\") pod \"root-account-create-update-cg9xc\" (UID: \"4a80bd29-f380-41b4-88db-1c80eccb1ca8\") " pod="openstack-kuttl-tests/root-account-create-update-cg9xc" Mar 16 16:13:46 crc kubenswrapper[5120]: I0316 16:13:46.937680 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xzfzp\" (UniqueName: \"kubernetes.io/projected/4a80bd29-f380-41b4-88db-1c80eccb1ca8-kube-api-access-xzfzp\") pod \"root-account-create-update-cg9xc\" (UID: \"4a80bd29-f380-41b4-88db-1c80eccb1ca8\") " pod="openstack-kuttl-tests/root-account-create-update-cg9xc" Mar 16 16:13:46 crc kubenswrapper[5120]: I0316 16:13:46.937782 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/229b83a2-da65-44f4-933d-0b43976c171d-scripts\") pod \"swift-ring-rebalance-j7b48\" (UID: \"229b83a2-da65-44f4-933d-0b43976c171d\") " pod="openstack-kuttl-tests/swift-ring-rebalance-j7b48" Mar 16 16:13:46 crc kubenswrapper[5120]: I0316 16:13:46.937882 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/229b83a2-da65-44f4-933d-0b43976c171d-etc-swift\") pod \"swift-ring-rebalance-j7b48\" (UID: \"229b83a2-da65-44f4-933d-0b43976c171d\") " pod="openstack-kuttl-tests/swift-ring-rebalance-j7b48" Mar 16 16:13:46 crc kubenswrapper[5120]: I0316 16:13:46.937911 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/229b83a2-da65-44f4-933d-0b43976c171d-combined-ca-bundle\") pod \"swift-ring-rebalance-j7b48\" (UID: \"229b83a2-da65-44f4-933d-0b43976c171d\") " pod="openstack-kuttl-tests/swift-ring-rebalance-j7b48" Mar 16 16:13:46 crc kubenswrapper[5120]: I0316 16:13:46.937936 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/b42a5e9c-18f0-4abf-9c53-ef0f0156f049-ring-data-devices\") pod \"swift-ring-rebalance-7b4z9\" (UID: \"b42a5e9c-18f0-4abf-9c53-ef0f0156f049\") " pod="openstack-kuttl-tests/swift-ring-rebalance-7b4z9" Mar 16 16:13:46 crc kubenswrapper[5120]: I0316 16:13:46.937955 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/229b83a2-da65-44f4-933d-0b43976c171d-ring-data-devices\") pod \"swift-ring-rebalance-j7b48\" (UID: \"229b83a2-da65-44f4-933d-0b43976c171d\") " pod="openstack-kuttl-tests/swift-ring-rebalance-j7b48" Mar 16 16:13:46 crc kubenswrapper[5120]: I0316 16:13:46.938003 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/b42a5e9c-18f0-4abf-9c53-ef0f0156f049-etc-swift\") pod \"swift-ring-rebalance-7b4z9\" (UID: \"b42a5e9c-18f0-4abf-9c53-ef0f0156f049\") " pod="openstack-kuttl-tests/swift-ring-rebalance-7b4z9" Mar 16 16:13:46 crc kubenswrapper[5120]: I0316 16:13:46.938026 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dssn7\" (UniqueName: \"kubernetes.io/projected/b42a5e9c-18f0-4abf-9c53-ef0f0156f049-kube-api-access-dssn7\") pod \"swift-ring-rebalance-7b4z9\" (UID: \"b42a5e9c-18f0-4abf-9c53-ef0f0156f049\") " pod="openstack-kuttl-tests/swift-ring-rebalance-7b4z9" Mar 16 16:13:46 crc kubenswrapper[5120]: I0316 16:13:46.938046 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/229b83a2-da65-44f4-933d-0b43976c171d-swiftconf\") pod \"swift-ring-rebalance-j7b48\" (UID: \"229b83a2-da65-44f4-933d-0b43976c171d\") " pod="openstack-kuttl-tests/swift-ring-rebalance-j7b48" Mar 16 16:13:46 crc kubenswrapper[5120]: I0316 16:13:46.938090 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cq6t5\" (UniqueName: \"kubernetes.io/projected/229b83a2-da65-44f4-933d-0b43976c171d-kube-api-access-cq6t5\") pod \"swift-ring-rebalance-j7b48\" (UID: \"229b83a2-da65-44f4-933d-0b43976c171d\") " pod="openstack-kuttl-tests/swift-ring-rebalance-j7b48" Mar 16 16:13:46 crc kubenswrapper[5120]: I0316 16:13:46.938138 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/b42a5e9c-18f0-4abf-9c53-ef0f0156f049-dispersionconf\") pod \"swift-ring-rebalance-7b4z9\" (UID: \"b42a5e9c-18f0-4abf-9c53-ef0f0156f049\") " pod="openstack-kuttl-tests/swift-ring-rebalance-7b4z9" Mar 16 16:13:46 crc kubenswrapper[5120]: I0316 16:13:46.938210 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/b42a5e9c-18f0-4abf-9c53-ef0f0156f049-scripts\") pod \"swift-ring-rebalance-7b4z9\" (UID: \"b42a5e9c-18f0-4abf-9c53-ef0f0156f049\") " pod="openstack-kuttl-tests/swift-ring-rebalance-7b4z9" Mar 16 16:13:46 crc kubenswrapper[5120]: I0316 16:13:46.938469 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/4a80bd29-f380-41b4-88db-1c80eccb1ca8-operator-scripts\") pod \"root-account-create-update-cg9xc\" (UID: \"4a80bd29-f380-41b4-88db-1c80eccb1ca8\") " pod="openstack-kuttl-tests/root-account-create-update-cg9xc" Mar 16 16:13:46 crc kubenswrapper[5120]: I0316 16:13:46.938612 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b42a5e9c-18f0-4abf-9c53-ef0f0156f049-combined-ca-bundle\") pod \"swift-ring-rebalance-7b4z9\" (UID: \"b42a5e9c-18f0-4abf-9c53-ef0f0156f049\") " pod="openstack-kuttl-tests/swift-ring-rebalance-7b4z9" Mar 16 16:13:46 crc kubenswrapper[5120]: I0316 16:13:46.938642 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/229b83a2-da65-44f4-933d-0b43976c171d-dispersionconf\") pod \"swift-ring-rebalance-j7b48\" (UID: \"229b83a2-da65-44f4-933d-0b43976c171d\") " pod="openstack-kuttl-tests/swift-ring-rebalance-j7b48" Mar 16 16:13:46 crc kubenswrapper[5120]: I0316 16:13:46.938683 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/b42a5e9c-18f0-4abf-9c53-ef0f0156f049-swiftconf\") pod \"swift-ring-rebalance-7b4z9\" (UID: \"b42a5e9c-18f0-4abf-9c53-ef0f0156f049\") " pod="openstack-kuttl-tests/swift-ring-rebalance-7b4z9" Mar 16 16:13:46 crc kubenswrapper[5120]: I0316 16:13:46.939221 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/4a80bd29-f380-41b4-88db-1c80eccb1ca8-operator-scripts\") pod \"root-account-create-update-cg9xc\" (UID: \"4a80bd29-f380-41b4-88db-1c80eccb1ca8\") " pod="openstack-kuttl-tests/root-account-create-update-cg9xc" Mar 16 16:13:46 crc kubenswrapper[5120]: I0316 16:13:46.960793 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzfzp\" (UniqueName: \"kubernetes.io/projected/4a80bd29-f380-41b4-88db-1c80eccb1ca8-kube-api-access-xzfzp\") pod \"root-account-create-update-cg9xc\" (UID: \"4a80bd29-f380-41b4-88db-1c80eccb1ca8\") " pod="openstack-kuttl-tests/root-account-create-update-cg9xc" Mar 16 16:13:47 crc kubenswrapper[5120]: I0316 16:13:47.016912 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-cg9xc" Mar 16 16:13:47 crc kubenswrapper[5120]: I0316 16:13:47.039975 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b42a5e9c-18f0-4abf-9c53-ef0f0156f049-combined-ca-bundle\") pod \"swift-ring-rebalance-7b4z9\" (UID: \"b42a5e9c-18f0-4abf-9c53-ef0f0156f049\") " pod="openstack-kuttl-tests/swift-ring-rebalance-7b4z9" Mar 16 16:13:47 crc kubenswrapper[5120]: I0316 16:13:47.040194 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/229b83a2-da65-44f4-933d-0b43976c171d-dispersionconf\") pod \"swift-ring-rebalance-j7b48\" (UID: \"229b83a2-da65-44f4-933d-0b43976c171d\") " pod="openstack-kuttl-tests/swift-ring-rebalance-j7b48" Mar 16 16:13:47 crc kubenswrapper[5120]: I0316 16:13:47.040236 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/b42a5e9c-18f0-4abf-9c53-ef0f0156f049-swiftconf\") pod \"swift-ring-rebalance-7b4z9\" (UID: \"b42a5e9c-18f0-4abf-9c53-ef0f0156f049\") " pod="openstack-kuttl-tests/swift-ring-rebalance-7b4z9" Mar 16 16:13:47 crc kubenswrapper[5120]: I0316 16:13:47.040283 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/229b83a2-da65-44f4-933d-0b43976c171d-scripts\") pod \"swift-ring-rebalance-j7b48\" (UID: \"229b83a2-da65-44f4-933d-0b43976c171d\") " pod="openstack-kuttl-tests/swift-ring-rebalance-j7b48" Mar 16 16:13:47 crc kubenswrapper[5120]: I0316 16:13:47.040354 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/229b83a2-da65-44f4-933d-0b43976c171d-etc-swift\") pod \"swift-ring-rebalance-j7b48\" (UID: \"229b83a2-da65-44f4-933d-0b43976c171d\") " pod="openstack-kuttl-tests/swift-ring-rebalance-j7b48" Mar 16 16:13:47 crc kubenswrapper[5120]: I0316 16:13:47.040373 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/229b83a2-da65-44f4-933d-0b43976c171d-combined-ca-bundle\") pod \"swift-ring-rebalance-j7b48\" (UID: \"229b83a2-da65-44f4-933d-0b43976c171d\") " pod="openstack-kuttl-tests/swift-ring-rebalance-j7b48" Mar 16 16:13:47 crc kubenswrapper[5120]: I0316 16:13:47.040396 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/b42a5e9c-18f0-4abf-9c53-ef0f0156f049-ring-data-devices\") pod \"swift-ring-rebalance-7b4z9\" (UID: \"b42a5e9c-18f0-4abf-9c53-ef0f0156f049\") " pod="openstack-kuttl-tests/swift-ring-rebalance-7b4z9" Mar 16 16:13:47 crc kubenswrapper[5120]: I0316 16:13:47.040413 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/229b83a2-da65-44f4-933d-0b43976c171d-ring-data-devices\") pod \"swift-ring-rebalance-j7b48\" (UID: \"229b83a2-da65-44f4-933d-0b43976c171d\") " pod="openstack-kuttl-tests/swift-ring-rebalance-j7b48" Mar 16 16:13:47 crc kubenswrapper[5120]: I0316 16:13:47.040446 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/b42a5e9c-18f0-4abf-9c53-ef0f0156f049-etc-swift\") pod \"swift-ring-rebalance-7b4z9\" (UID: \"b42a5e9c-18f0-4abf-9c53-ef0f0156f049\") " pod="openstack-kuttl-tests/swift-ring-rebalance-7b4z9" Mar 16 16:13:47 crc kubenswrapper[5120]: I0316 16:13:47.040462 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dssn7\" (UniqueName: \"kubernetes.io/projected/b42a5e9c-18f0-4abf-9c53-ef0f0156f049-kube-api-access-dssn7\") pod \"swift-ring-rebalance-7b4z9\" (UID: \"b42a5e9c-18f0-4abf-9c53-ef0f0156f049\") " pod="openstack-kuttl-tests/swift-ring-rebalance-7b4z9" Mar 16 16:13:47 crc kubenswrapper[5120]: I0316 16:13:47.040477 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/229b83a2-da65-44f4-933d-0b43976c171d-swiftconf\") pod \"swift-ring-rebalance-j7b48\" (UID: \"229b83a2-da65-44f4-933d-0b43976c171d\") " pod="openstack-kuttl-tests/swift-ring-rebalance-j7b48" Mar 16 16:13:47 crc kubenswrapper[5120]: I0316 16:13:47.040507 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cq6t5\" (UniqueName: \"kubernetes.io/projected/229b83a2-da65-44f4-933d-0b43976c171d-kube-api-access-cq6t5\") pod \"swift-ring-rebalance-j7b48\" (UID: \"229b83a2-da65-44f4-933d-0b43976c171d\") " pod="openstack-kuttl-tests/swift-ring-rebalance-j7b48" Mar 16 16:13:47 crc kubenswrapper[5120]: I0316 16:13:47.040539 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/b42a5e9c-18f0-4abf-9c53-ef0f0156f049-dispersionconf\") pod \"swift-ring-rebalance-7b4z9\" (UID: \"b42a5e9c-18f0-4abf-9c53-ef0f0156f049\") " pod="openstack-kuttl-tests/swift-ring-rebalance-7b4z9" Mar 16 16:13:47 crc kubenswrapper[5120]: I0316 16:13:47.040584 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/b42a5e9c-18f0-4abf-9c53-ef0f0156f049-scripts\") pod \"swift-ring-rebalance-7b4z9\" (UID: \"b42a5e9c-18f0-4abf-9c53-ef0f0156f049\") " pod="openstack-kuttl-tests/swift-ring-rebalance-7b4z9" Mar 16 16:13:47 crc kubenswrapper[5120]: I0316 16:13:47.041275 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/b42a5e9c-18f0-4abf-9c53-ef0f0156f049-scripts\") pod \"swift-ring-rebalance-7b4z9\" (UID: \"b42a5e9c-18f0-4abf-9c53-ef0f0156f049\") " pod="openstack-kuttl-tests/swift-ring-rebalance-7b4z9" Mar 16 16:13:47 crc kubenswrapper[5120]: I0316 16:13:47.042135 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/229b83a2-da65-44f4-933d-0b43976c171d-ring-data-devices\") pod \"swift-ring-rebalance-j7b48\" (UID: \"229b83a2-da65-44f4-933d-0b43976c171d\") " pod="openstack-kuttl-tests/swift-ring-rebalance-j7b48" Mar 16 16:13:47 crc kubenswrapper[5120]: I0316 16:13:47.044662 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/229b83a2-da65-44f4-933d-0b43976c171d-dispersionconf\") pod \"swift-ring-rebalance-j7b48\" (UID: \"229b83a2-da65-44f4-933d-0b43976c171d\") " pod="openstack-kuttl-tests/swift-ring-rebalance-j7b48" Mar 16 16:13:47 crc kubenswrapper[5120]: I0316 16:13:47.044874 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b42a5e9c-18f0-4abf-9c53-ef0f0156f049-combined-ca-bundle\") pod \"swift-ring-rebalance-7b4z9\" (UID: \"b42a5e9c-18f0-4abf-9c53-ef0f0156f049\") " pod="openstack-kuttl-tests/swift-ring-rebalance-7b4z9" Mar 16 16:13:47 crc kubenswrapper[5120]: I0316 16:13:47.044897 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/b42a5e9c-18f0-4abf-9c53-ef0f0156f049-etc-swift\") pod \"swift-ring-rebalance-7b4z9\" (UID: \"b42a5e9c-18f0-4abf-9c53-ef0f0156f049\") " pod="openstack-kuttl-tests/swift-ring-rebalance-7b4z9" Mar 16 16:13:47 crc kubenswrapper[5120]: I0316 16:13:47.045201 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/229b83a2-da65-44f4-933d-0b43976c171d-etc-swift\") pod \"swift-ring-rebalance-j7b48\" (UID: \"229b83a2-da65-44f4-933d-0b43976c171d\") " pod="openstack-kuttl-tests/swift-ring-rebalance-j7b48" Mar 16 16:13:47 crc kubenswrapper[5120]: I0316 16:13:47.045616 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/229b83a2-da65-44f4-933d-0b43976c171d-scripts\") pod \"swift-ring-rebalance-j7b48\" (UID: \"229b83a2-da65-44f4-933d-0b43976c171d\") " pod="openstack-kuttl-tests/swift-ring-rebalance-j7b48" Mar 16 16:13:47 crc kubenswrapper[5120]: I0316 16:13:47.047943 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/b42a5e9c-18f0-4abf-9c53-ef0f0156f049-swiftconf\") pod \"swift-ring-rebalance-7b4z9\" (UID: \"b42a5e9c-18f0-4abf-9c53-ef0f0156f049\") " pod="openstack-kuttl-tests/swift-ring-rebalance-7b4z9" Mar 16 16:13:47 crc kubenswrapper[5120]: I0316 16:13:47.048379 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/b42a5e9c-18f0-4abf-9c53-ef0f0156f049-ring-data-devices\") pod \"swift-ring-rebalance-7b4z9\" (UID: \"b42a5e9c-18f0-4abf-9c53-ef0f0156f049\") " pod="openstack-kuttl-tests/swift-ring-rebalance-7b4z9" Mar 16 16:13:47 crc kubenswrapper[5120]: I0316 16:13:47.048863 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/229b83a2-da65-44f4-933d-0b43976c171d-combined-ca-bundle\") pod \"swift-ring-rebalance-j7b48\" (UID: \"229b83a2-da65-44f4-933d-0b43976c171d\") " pod="openstack-kuttl-tests/swift-ring-rebalance-j7b48" Mar 16 16:13:47 crc kubenswrapper[5120]: I0316 16:13:47.049508 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/229b83a2-da65-44f4-933d-0b43976c171d-swiftconf\") pod \"swift-ring-rebalance-j7b48\" (UID: \"229b83a2-da65-44f4-933d-0b43976c171d\") " pod="openstack-kuttl-tests/swift-ring-rebalance-j7b48" Mar 16 16:13:47 crc kubenswrapper[5120]: I0316 16:13:47.053860 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/b42a5e9c-18f0-4abf-9c53-ef0f0156f049-dispersionconf\") pod \"swift-ring-rebalance-7b4z9\" (UID: \"b42a5e9c-18f0-4abf-9c53-ef0f0156f049\") " pod="openstack-kuttl-tests/swift-ring-rebalance-7b4z9" Mar 16 16:13:47 crc kubenswrapper[5120]: I0316 16:13:47.068135 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dssn7\" (UniqueName: \"kubernetes.io/projected/b42a5e9c-18f0-4abf-9c53-ef0f0156f049-kube-api-access-dssn7\") pod \"swift-ring-rebalance-7b4z9\" (UID: \"b42a5e9c-18f0-4abf-9c53-ef0f0156f049\") " pod="openstack-kuttl-tests/swift-ring-rebalance-7b4z9" Mar 16 16:13:47 crc kubenswrapper[5120]: I0316 16:13:47.069586 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cq6t5\" (UniqueName: \"kubernetes.io/projected/229b83a2-da65-44f4-933d-0b43976c171d-kube-api-access-cq6t5\") pod \"swift-ring-rebalance-j7b48\" (UID: \"229b83a2-da65-44f4-933d-0b43976c171d\") " pod="openstack-kuttl-tests/swift-ring-rebalance-j7b48" Mar 16 16:13:47 crc kubenswrapper[5120]: I0316 16:13:47.147102 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-j7b48" Mar 16 16:13:47 crc kubenswrapper[5120]: I0316 16:13:47.168123 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-db-create-p4ngm"] Mar 16 16:13:47 crc kubenswrapper[5120]: I0316 16:13:47.185127 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-db-create-p4ngm"] Mar 16 16:13:47 crc kubenswrapper[5120]: I0316 16:13:47.185283 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-create-p4ngm" Mar 16 16:13:47 crc kubenswrapper[5120]: I0316 16:13:47.227585 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-7b4z9" Mar 16 16:13:47 crc kubenswrapper[5120]: I0316 16:13:47.236627 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-7b4z9" Mar 16 16:13:47 crc kubenswrapper[5120]: I0316 16:13:47.279109 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-e3fe-account-create-update-6gdjr"] Mar 16 16:13:47 crc kubenswrapper[5120]: I0316 16:13:47.293752 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-e3fe-account-create-update-6gdjr"] Mar 16 16:13:47 crc kubenswrapper[5120]: I0316 16:13:47.294111 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-e3fe-account-create-update-6gdjr" Mar 16 16:13:47 crc kubenswrapper[5120]: I0316 16:13:47.298392 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-db-secret\"" Mar 16 16:13:47 crc kubenswrapper[5120]: I0316 16:13:47.347181 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dssn7\" (UniqueName: \"kubernetes.io/projected/b42a5e9c-18f0-4abf-9c53-ef0f0156f049-kube-api-access-dssn7\") pod \"b42a5e9c-18f0-4abf-9c53-ef0f0156f049\" (UID: \"b42a5e9c-18f0-4abf-9c53-ef0f0156f049\") " Mar 16 16:13:47 crc kubenswrapper[5120]: I0316 16:13:47.347286 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/b42a5e9c-18f0-4abf-9c53-ef0f0156f049-etc-swift\") pod \"b42a5e9c-18f0-4abf-9c53-ef0f0156f049\" (UID: \"b42a5e9c-18f0-4abf-9c53-ef0f0156f049\") " Mar 16 16:13:47 crc kubenswrapper[5120]: I0316 16:13:47.347488 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/b42a5e9c-18f0-4abf-9c53-ef0f0156f049-scripts\") pod \"b42a5e9c-18f0-4abf-9c53-ef0f0156f049\" (UID: \"b42a5e9c-18f0-4abf-9c53-ef0f0156f049\") " Mar 16 16:13:47 crc kubenswrapper[5120]: I0316 16:13:47.347749 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b42a5e9c-18f0-4abf-9c53-ef0f0156f049-etc-swift" (OuterVolumeSpecName: "etc-swift") pod "b42a5e9c-18f0-4abf-9c53-ef0f0156f049" (UID: "b42a5e9c-18f0-4abf-9c53-ef0f0156f049"). InnerVolumeSpecName "etc-swift". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:13:47 crc kubenswrapper[5120]: I0316 16:13:47.348872 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b42a5e9c-18f0-4abf-9c53-ef0f0156f049-scripts" (OuterVolumeSpecName: "scripts") pod "b42a5e9c-18f0-4abf-9c53-ef0f0156f049" (UID: "b42a5e9c-18f0-4abf-9c53-ef0f0156f049"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:13:47 crc kubenswrapper[5120]: I0316 16:13:47.348977 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/b42a5e9c-18f0-4abf-9c53-ef0f0156f049-dispersionconf\") pod \"b42a5e9c-18f0-4abf-9c53-ef0f0156f049\" (UID: \"b42a5e9c-18f0-4abf-9c53-ef0f0156f049\") " Mar 16 16:13:47 crc kubenswrapper[5120]: I0316 16:13:47.349403 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b42a5e9c-18f0-4abf-9c53-ef0f0156f049-combined-ca-bundle\") pod \"b42a5e9c-18f0-4abf-9c53-ef0f0156f049\" (UID: \"b42a5e9c-18f0-4abf-9c53-ef0f0156f049\") " Mar 16 16:13:47 crc kubenswrapper[5120]: I0316 16:13:47.350055 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/b42a5e9c-18f0-4abf-9c53-ef0f0156f049-ring-data-devices\") pod \"b42a5e9c-18f0-4abf-9c53-ef0f0156f049\" (UID: \"b42a5e9c-18f0-4abf-9c53-ef0f0156f049\") " Mar 16 16:13:47 crc kubenswrapper[5120]: I0316 16:13:47.350184 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/b42a5e9c-18f0-4abf-9c53-ef0f0156f049-swiftconf\") pod \"b42a5e9c-18f0-4abf-9c53-ef0f0156f049\" (UID: \"b42a5e9c-18f0-4abf-9c53-ef0f0156f049\") " Mar 16 16:13:47 crc kubenswrapper[5120]: I0316 16:13:47.350470 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b42a5e9c-18f0-4abf-9c53-ef0f0156f049-ring-data-devices" (OuterVolumeSpecName: "ring-data-devices") pod "b42a5e9c-18f0-4abf-9c53-ef0f0156f049" (UID: "b42a5e9c-18f0-4abf-9c53-ef0f0156f049"). InnerVolumeSpecName "ring-data-devices". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:13:47 crc kubenswrapper[5120]: I0316 16:13:47.350789 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b0e5c34b-8582-407e-a0ce-7fe6748cf84f-operator-scripts\") pod \"glance-db-create-p4ngm\" (UID: \"b0e5c34b-8582-407e-a0ce-7fe6748cf84f\") " pod="openstack-kuttl-tests/glance-db-create-p4ngm" Mar 16 16:13:47 crc kubenswrapper[5120]: I0316 16:13:47.351303 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khzbp\" (UniqueName: \"kubernetes.io/projected/b0e5c34b-8582-407e-a0ce-7fe6748cf84f-kube-api-access-khzbp\") pod \"glance-db-create-p4ngm\" (UID: \"b0e5c34b-8582-407e-a0ce-7fe6748cf84f\") " pod="openstack-kuttl-tests/glance-db-create-p4ngm" Mar 16 16:13:47 crc kubenswrapper[5120]: I0316 16:13:47.351500 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/b42a5e9c-18f0-4abf-9c53-ef0f0156f049-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:13:47 crc kubenswrapper[5120]: I0316 16:13:47.351577 5120 reconciler_common.go:299] "Volume detached for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/b42a5e9c-18f0-4abf-9c53-ef0f0156f049-ring-data-devices\") on node \"crc\" DevicePath \"\"" Mar 16 16:13:47 crc kubenswrapper[5120]: I0316 16:13:47.351643 5120 reconciler_common.go:299] "Volume detached for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/b42a5e9c-18f0-4abf-9c53-ef0f0156f049-etc-swift\") on node \"crc\" DevicePath \"\"" Mar 16 16:13:47 crc kubenswrapper[5120]: I0316 16:13:47.352560 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b42a5e9c-18f0-4abf-9c53-ef0f0156f049-dispersionconf" (OuterVolumeSpecName: "dispersionconf") pod "b42a5e9c-18f0-4abf-9c53-ef0f0156f049" (UID: "b42a5e9c-18f0-4abf-9c53-ef0f0156f049"). InnerVolumeSpecName "dispersionconf". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:13:47 crc kubenswrapper[5120]: I0316 16:13:47.352936 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b42a5e9c-18f0-4abf-9c53-ef0f0156f049-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "b42a5e9c-18f0-4abf-9c53-ef0f0156f049" (UID: "b42a5e9c-18f0-4abf-9c53-ef0f0156f049"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:13:47 crc kubenswrapper[5120]: I0316 16:13:47.356418 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b42a5e9c-18f0-4abf-9c53-ef0f0156f049-kube-api-access-dssn7" (OuterVolumeSpecName: "kube-api-access-dssn7") pod "b42a5e9c-18f0-4abf-9c53-ef0f0156f049" (UID: "b42a5e9c-18f0-4abf-9c53-ef0f0156f049"). InnerVolumeSpecName "kube-api-access-dssn7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:13:47 crc kubenswrapper[5120]: I0316 16:13:47.357969 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b42a5e9c-18f0-4abf-9c53-ef0f0156f049-swiftconf" (OuterVolumeSpecName: "swiftconf") pod "b42a5e9c-18f0-4abf-9c53-ef0f0156f049" (UID: "b42a5e9c-18f0-4abf-9c53-ef0f0156f049"). InnerVolumeSpecName "swiftconf". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:13:47 crc kubenswrapper[5120]: I0316 16:13:47.448692 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-cg9xc"] Mar 16 16:13:47 crc kubenswrapper[5120]: I0316 16:13:47.453063 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-khzbp\" (UniqueName: \"kubernetes.io/projected/b0e5c34b-8582-407e-a0ce-7fe6748cf84f-kube-api-access-khzbp\") pod \"glance-db-create-p4ngm\" (UID: \"b0e5c34b-8582-407e-a0ce-7fe6748cf84f\") " pod="openstack-kuttl-tests/glance-db-create-p4ngm" Mar 16 16:13:47 crc kubenswrapper[5120]: I0316 16:13:47.453230 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dchm7\" (UniqueName: \"kubernetes.io/projected/b82a4dce-40fb-4e1c-85a0-5e29b900ad33-kube-api-access-dchm7\") pod \"glance-e3fe-account-create-update-6gdjr\" (UID: \"b82a4dce-40fb-4e1c-85a0-5e29b900ad33\") " pod="openstack-kuttl-tests/glance-e3fe-account-create-update-6gdjr" Mar 16 16:13:47 crc kubenswrapper[5120]: I0316 16:13:47.453265 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b0e5c34b-8582-407e-a0ce-7fe6748cf84f-operator-scripts\") pod \"glance-db-create-p4ngm\" (UID: \"b0e5c34b-8582-407e-a0ce-7fe6748cf84f\") " pod="openstack-kuttl-tests/glance-db-create-p4ngm" Mar 16 16:13:47 crc kubenswrapper[5120]: I0316 16:13:47.453484 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b82a4dce-40fb-4e1c-85a0-5e29b900ad33-operator-scripts\") pod \"glance-e3fe-account-create-update-6gdjr\" (UID: \"b82a4dce-40fb-4e1c-85a0-5e29b900ad33\") " pod="openstack-kuttl-tests/glance-e3fe-account-create-update-6gdjr" Mar 16 16:13:47 crc kubenswrapper[5120]: I0316 16:13:47.453945 5120 reconciler_common.go:299] "Volume detached for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/b42a5e9c-18f0-4abf-9c53-ef0f0156f049-dispersionconf\") on node \"crc\" DevicePath \"\"" Mar 16 16:13:47 crc kubenswrapper[5120]: I0316 16:13:47.453994 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b42a5e9c-18f0-4abf-9c53-ef0f0156f049-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:13:47 crc kubenswrapper[5120]: I0316 16:13:47.454230 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b0e5c34b-8582-407e-a0ce-7fe6748cf84f-operator-scripts\") pod \"glance-db-create-p4ngm\" (UID: \"b0e5c34b-8582-407e-a0ce-7fe6748cf84f\") " pod="openstack-kuttl-tests/glance-db-create-p4ngm" Mar 16 16:13:47 crc kubenswrapper[5120]: I0316 16:13:47.455990 5120 reconciler_common.go:299] "Volume detached for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/b42a5e9c-18f0-4abf-9c53-ef0f0156f049-swiftconf\") on node \"crc\" DevicePath \"\"" Mar 16 16:13:47 crc kubenswrapper[5120]: I0316 16:13:47.456021 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dssn7\" (UniqueName: \"kubernetes.io/projected/b42a5e9c-18f0-4abf-9c53-ef0f0156f049-kube-api-access-dssn7\") on node \"crc\" DevicePath \"\"" Mar 16 16:13:47 crc kubenswrapper[5120]: I0316 16:13:47.479411 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-khzbp\" (UniqueName: \"kubernetes.io/projected/b0e5c34b-8582-407e-a0ce-7fe6748cf84f-kube-api-access-khzbp\") pod \"glance-db-create-p4ngm\" (UID: \"b0e5c34b-8582-407e-a0ce-7fe6748cf84f\") " pod="openstack-kuttl-tests/glance-db-create-p4ngm" Mar 16 16:13:47 crc kubenswrapper[5120]: I0316 16:13:47.524935 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-create-p4ngm" Mar 16 16:13:47 crc kubenswrapper[5120]: I0316 16:13:47.556984 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b82a4dce-40fb-4e1c-85a0-5e29b900ad33-operator-scripts\") pod \"glance-e3fe-account-create-update-6gdjr\" (UID: \"b82a4dce-40fb-4e1c-85a0-5e29b900ad33\") " pod="openstack-kuttl-tests/glance-e3fe-account-create-update-6gdjr" Mar 16 16:13:47 crc kubenswrapper[5120]: I0316 16:13:47.557224 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dchm7\" (UniqueName: \"kubernetes.io/projected/b82a4dce-40fb-4e1c-85a0-5e29b900ad33-kube-api-access-dchm7\") pod \"glance-e3fe-account-create-update-6gdjr\" (UID: \"b82a4dce-40fb-4e1c-85a0-5e29b900ad33\") " pod="openstack-kuttl-tests/glance-e3fe-account-create-update-6gdjr" Mar 16 16:13:47 crc kubenswrapper[5120]: I0316 16:13:47.557867 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b82a4dce-40fb-4e1c-85a0-5e29b900ad33-operator-scripts\") pod \"glance-e3fe-account-create-update-6gdjr\" (UID: \"b82a4dce-40fb-4e1c-85a0-5e29b900ad33\") " pod="openstack-kuttl-tests/glance-e3fe-account-create-update-6gdjr" Mar 16 16:13:47 crc kubenswrapper[5120]: I0316 16:13:47.573474 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dchm7\" (UniqueName: \"kubernetes.io/projected/b82a4dce-40fb-4e1c-85a0-5e29b900ad33-kube-api-access-dchm7\") pod \"glance-e3fe-account-create-update-6gdjr\" (UID: \"b82a4dce-40fb-4e1c-85a0-5e29b900ad33\") " pod="openstack-kuttl-tests/glance-e3fe-account-create-update-6gdjr" Mar 16 16:13:47 crc kubenswrapper[5120]: I0316 16:13:47.609676 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-j7b48"] Mar 16 16:13:47 crc kubenswrapper[5120]: I0316 16:13:47.611812 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-e3fe-account-create-update-6gdjr" Mar 16 16:13:47 crc kubenswrapper[5120]: W0316 16:13:47.613388 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod229b83a2_da65_44f4_933d_0b43976c171d.slice/crio-b8b3a704a542fae3ed8283db18c3faf7c266355fdcd166002eb36598e9f359be WatchSource:0}: Error finding container b8b3a704a542fae3ed8283db18c3faf7c266355fdcd166002eb36598e9f359be: Status 404 returned error can't find the container with id b8b3a704a542fae3ed8283db18c3faf7c266355fdcd166002eb36598e9f359be Mar 16 16:13:47 crc kubenswrapper[5120]: I0316 16:13:47.663976 5120 scope.go:117] "RemoveContainer" containerID="bc2df124cc6ad146d7c7dd2115ac815986fb62978d38895f6d345a4a9b14dbd8" Mar 16 16:13:47 crc kubenswrapper[5120]: E0316 16:13:47.664700 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:13:47 crc kubenswrapper[5120]: I0316 16:13:47.995843 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-db-create-p4ngm"] Mar 16 16:13:48 crc kubenswrapper[5120]: I0316 16:13:48.098580 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-e3fe-account-create-update-6gdjr"] Mar 16 16:13:48 crc kubenswrapper[5120]: W0316 16:13:48.100812 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb82a4dce_40fb_4e1c_85a0_5e29b900ad33.slice/crio-cd150fa6b245874e6a8956136730a3fdc858e2e2b76029d3c780e242e61fa84a WatchSource:0}: Error finding container cd150fa6b245874e6a8956136730a3fdc858e2e2b76029d3c780e242e61fa84a: Status 404 returned error can't find the container with id cd150fa6b245874e6a8956136730a3fdc858e2e2b76029d3c780e242e61fa84a Mar 16 16:13:48 crc kubenswrapper[5120]: I0316 16:13:48.257524 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-e3fe-account-create-update-6gdjr" event={"ID":"b82a4dce-40fb-4e1c-85a0-5e29b900ad33","Type":"ContainerStarted","Data":"cd150fa6b245874e6a8956136730a3fdc858e2e2b76029d3c780e242e61fa84a"} Mar 16 16:13:48 crc kubenswrapper[5120]: I0316 16:13:48.259906 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-j7b48" event={"ID":"229b83a2-da65-44f4-933d-0b43976c171d","Type":"ContainerStarted","Data":"5b379a830ff9d3c0159f76782a30148b2923a1653897bee0e8b29c16d72595be"} Mar 16 16:13:48 crc kubenswrapper[5120]: I0316 16:13:48.259965 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-j7b48" event={"ID":"229b83a2-da65-44f4-933d-0b43976c171d","Type":"ContainerStarted","Data":"b8b3a704a542fae3ed8283db18c3faf7c266355fdcd166002eb36598e9f359be"} Mar 16 16:13:48 crc kubenswrapper[5120]: I0316 16:13:48.262969 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-create-p4ngm" event={"ID":"b0e5c34b-8582-407e-a0ce-7fe6748cf84f","Type":"ContainerStarted","Data":"b319fa4b2240e163b4790fe578a169ead1aec8b3e3597e2c33e865b692ec652d"} Mar 16 16:13:48 crc kubenswrapper[5120]: I0316 16:13:48.263023 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-create-p4ngm" event={"ID":"b0e5c34b-8582-407e-a0ce-7fe6748cf84f","Type":"ContainerStarted","Data":"040bc1068a887f915c5134a42c9c89d9c1ff676aab517a3d96165af69c402a98"} Mar 16 16:13:48 crc kubenswrapper[5120]: I0316 16:13:48.265861 5120 generic.go:358] "Generic (PLEG): container finished" podID="4a80bd29-f380-41b4-88db-1c80eccb1ca8" containerID="c4272cd2258dc61984015e82abc7077ec95f9adb1a627de39afe019a3a50d9d2" exitCode=0 Mar 16 16:13:48 crc kubenswrapper[5120]: I0316 16:13:48.266020 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-7b4z9" Mar 16 16:13:48 crc kubenswrapper[5120]: I0316 16:13:48.266011 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-cg9xc" event={"ID":"4a80bd29-f380-41b4-88db-1c80eccb1ca8","Type":"ContainerDied","Data":"c4272cd2258dc61984015e82abc7077ec95f9adb1a627de39afe019a3a50d9d2"} Mar 16 16:13:48 crc kubenswrapper[5120]: I0316 16:13:48.266675 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-cg9xc" event={"ID":"4a80bd29-f380-41b4-88db-1c80eccb1ca8","Type":"ContainerStarted","Data":"8bcd81f6e3218e96af89b797c64b0791c04b9622e1ba2523b42ff81e49afd564"} Mar 16 16:13:48 crc kubenswrapper[5120]: I0316 16:13:48.279567 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/swift-ring-rebalance-j7b48" podStartSLOduration=2.279549753 podStartE2EDuration="2.279549753s" podCreationTimestamp="2026-03-16 16:13:46 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:13:48.273033198 +0000 UTC m=+2530.426964875" watchObservedRunningTime="2026-03-16 16:13:48.279549753 +0000 UTC m=+2530.433481420" Mar 16 16:13:48 crc kubenswrapper[5120]: I0316 16:13:48.318226 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-db-create-p4ngm" podStartSLOduration=1.318209429 podStartE2EDuration="1.318209429s" podCreationTimestamp="2026-03-16 16:13:47 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:13:48.314015737 +0000 UTC m=+2530.467947384" watchObservedRunningTime="2026-03-16 16:13:48.318209429 +0000 UTC m=+2530.472141086" Mar 16 16:13:48 crc kubenswrapper[5120]: I0316 16:13:48.355274 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-7b4z9"] Mar 16 16:13:48 crc kubenswrapper[5120]: I0316 16:13:48.363123 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-7b4z9"] Mar 16 16:13:48 crc kubenswrapper[5120]: I0316 16:13:48.685913 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b42a5e9c-18f0-4abf-9c53-ef0f0156f049" path="/var/lib/kubelet/pods/b42a5e9c-18f0-4abf-9c53-ef0f0156f049/volumes" Mar 16 16:13:49 crc kubenswrapper[5120]: I0316 16:13:49.275947 5120 generic.go:358] "Generic (PLEG): container finished" podID="b0e5c34b-8582-407e-a0ce-7fe6748cf84f" containerID="b319fa4b2240e163b4790fe578a169ead1aec8b3e3597e2c33e865b692ec652d" exitCode=0 Mar 16 16:13:49 crc kubenswrapper[5120]: I0316 16:13:49.276058 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-create-p4ngm" event={"ID":"b0e5c34b-8582-407e-a0ce-7fe6748cf84f","Type":"ContainerDied","Data":"b319fa4b2240e163b4790fe578a169ead1aec8b3e3597e2c33e865b692ec652d"} Mar 16 16:13:49 crc kubenswrapper[5120]: I0316 16:13:49.278935 5120 generic.go:358] "Generic (PLEG): container finished" podID="b82a4dce-40fb-4e1c-85a0-5e29b900ad33" containerID="ede1108ab087ef4dcb2ebf9dc2991b85c96cd8d26d42c8467e114b88ac302f0b" exitCode=0 Mar 16 16:13:49 crc kubenswrapper[5120]: I0316 16:13:49.279746 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-e3fe-account-create-update-6gdjr" event={"ID":"b82a4dce-40fb-4e1c-85a0-5e29b900ad33","Type":"ContainerDied","Data":"ede1108ab087ef4dcb2ebf9dc2991b85c96cd8d26d42c8467e114b88ac302f0b"} Mar 16 16:13:49 crc kubenswrapper[5120]: I0316 16:13:49.635395 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-cg9xc" Mar 16 16:13:49 crc kubenswrapper[5120]: I0316 16:13:49.701468 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/4a80bd29-f380-41b4-88db-1c80eccb1ca8-operator-scripts\") pod \"4a80bd29-f380-41b4-88db-1c80eccb1ca8\" (UID: \"4a80bd29-f380-41b4-88db-1c80eccb1ca8\") " Mar 16 16:13:49 crc kubenswrapper[5120]: I0316 16:13:49.701550 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xzfzp\" (UniqueName: \"kubernetes.io/projected/4a80bd29-f380-41b4-88db-1c80eccb1ca8-kube-api-access-xzfzp\") pod \"4a80bd29-f380-41b4-88db-1c80eccb1ca8\" (UID: \"4a80bd29-f380-41b4-88db-1c80eccb1ca8\") " Mar 16 16:13:49 crc kubenswrapper[5120]: I0316 16:13:49.702103 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4a80bd29-f380-41b4-88db-1c80eccb1ca8-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "4a80bd29-f380-41b4-88db-1c80eccb1ca8" (UID: "4a80bd29-f380-41b4-88db-1c80eccb1ca8"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:13:49 crc kubenswrapper[5120]: I0316 16:13:49.709829 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a80bd29-f380-41b4-88db-1c80eccb1ca8-kube-api-access-xzfzp" (OuterVolumeSpecName: "kube-api-access-xzfzp") pod "4a80bd29-f380-41b4-88db-1c80eccb1ca8" (UID: "4a80bd29-f380-41b4-88db-1c80eccb1ca8"). InnerVolumeSpecName "kube-api-access-xzfzp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:13:49 crc kubenswrapper[5120]: I0316 16:13:49.804199 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/4a80bd29-f380-41b4-88db-1c80eccb1ca8-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:13:49 crc kubenswrapper[5120]: I0316 16:13:49.804405 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xzfzp\" (UniqueName: \"kubernetes.io/projected/4a80bd29-f380-41b4-88db-1c80eccb1ca8-kube-api-access-xzfzp\") on node \"crc\" DevicePath \"\"" Mar 16 16:13:50 crc kubenswrapper[5120]: I0316 16:13:50.317198 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-cg9xc" Mar 16 16:13:50 crc kubenswrapper[5120]: I0316 16:13:50.317193 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-cg9xc" event={"ID":"4a80bd29-f380-41b4-88db-1c80eccb1ca8","Type":"ContainerDied","Data":"8bcd81f6e3218e96af89b797c64b0791c04b9622e1ba2523b42ff81e49afd564"} Mar 16 16:13:50 crc kubenswrapper[5120]: I0316 16:13:50.317359 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8bcd81f6e3218e96af89b797c64b0791c04b9622e1ba2523b42ff81e49afd564" Mar 16 16:13:50 crc kubenswrapper[5120]: I0316 16:13:50.738918 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/101749dc-c834-4d18-9d65-704af8b368a4-etc-swift\") pod \"swift-storage-0\" (UID: \"101749dc-c834-4d18-9d65-704af8b368a4\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:13:50 crc kubenswrapper[5120]: E0316 16:13:50.739370 5120 projected.go:289] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Mar 16 16:13:50 crc kubenswrapper[5120]: E0316 16:13:50.739475 5120 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Mar 16 16:13:50 crc kubenswrapper[5120]: E0316 16:13:50.739622 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/101749dc-c834-4d18-9d65-704af8b368a4-etc-swift podName:101749dc-c834-4d18-9d65-704af8b368a4 nodeName:}" failed. No retries permitted until 2026-03-16 16:13:58.739600902 +0000 UTC m=+2540.893532559 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/101749dc-c834-4d18-9d65-704af8b368a4-etc-swift") pod "swift-storage-0" (UID: "101749dc-c834-4d18-9d65-704af8b368a4") : configmap "swift-ring-files" not found Mar 16 16:13:50 crc kubenswrapper[5120]: I0316 16:13:50.875855 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-create-p4ngm" Mar 16 16:13:50 crc kubenswrapper[5120]: I0316 16:13:50.885986 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-e3fe-account-create-update-6gdjr" Mar 16 16:13:50 crc kubenswrapper[5120]: I0316 16:13:50.942314 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dchm7\" (UniqueName: \"kubernetes.io/projected/b82a4dce-40fb-4e1c-85a0-5e29b900ad33-kube-api-access-dchm7\") pod \"b82a4dce-40fb-4e1c-85a0-5e29b900ad33\" (UID: \"b82a4dce-40fb-4e1c-85a0-5e29b900ad33\") " Mar 16 16:13:50 crc kubenswrapper[5120]: I0316 16:13:50.942653 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b82a4dce-40fb-4e1c-85a0-5e29b900ad33-operator-scripts\") pod \"b82a4dce-40fb-4e1c-85a0-5e29b900ad33\" (UID: \"b82a4dce-40fb-4e1c-85a0-5e29b900ad33\") " Mar 16 16:13:50 crc kubenswrapper[5120]: I0316 16:13:50.943111 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-khzbp\" (UniqueName: \"kubernetes.io/projected/b0e5c34b-8582-407e-a0ce-7fe6748cf84f-kube-api-access-khzbp\") pod \"b0e5c34b-8582-407e-a0ce-7fe6748cf84f\" (UID: \"b0e5c34b-8582-407e-a0ce-7fe6748cf84f\") " Mar 16 16:13:50 crc kubenswrapper[5120]: I0316 16:13:50.943405 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b0e5c34b-8582-407e-a0ce-7fe6748cf84f-operator-scripts\") pod \"b0e5c34b-8582-407e-a0ce-7fe6748cf84f\" (UID: \"b0e5c34b-8582-407e-a0ce-7fe6748cf84f\") " Mar 16 16:13:50 crc kubenswrapper[5120]: I0316 16:13:50.943412 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b82a4dce-40fb-4e1c-85a0-5e29b900ad33-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "b82a4dce-40fb-4e1c-85a0-5e29b900ad33" (UID: "b82a4dce-40fb-4e1c-85a0-5e29b900ad33"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:13:50 crc kubenswrapper[5120]: I0316 16:13:50.943820 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b0e5c34b-8582-407e-a0ce-7fe6748cf84f-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "b0e5c34b-8582-407e-a0ce-7fe6748cf84f" (UID: "b0e5c34b-8582-407e-a0ce-7fe6748cf84f"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:13:50 crc kubenswrapper[5120]: I0316 16:13:50.944126 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b82a4dce-40fb-4e1c-85a0-5e29b900ad33-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:13:50 crc kubenswrapper[5120]: I0316 16:13:50.944159 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b0e5c34b-8582-407e-a0ce-7fe6748cf84f-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:13:50 crc kubenswrapper[5120]: I0316 16:13:50.949870 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0e5c34b-8582-407e-a0ce-7fe6748cf84f-kube-api-access-khzbp" (OuterVolumeSpecName: "kube-api-access-khzbp") pod "b0e5c34b-8582-407e-a0ce-7fe6748cf84f" (UID: "b0e5c34b-8582-407e-a0ce-7fe6748cf84f"). InnerVolumeSpecName "kube-api-access-khzbp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:13:50 crc kubenswrapper[5120]: I0316 16:13:50.965443 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b82a4dce-40fb-4e1c-85a0-5e29b900ad33-kube-api-access-dchm7" (OuterVolumeSpecName: "kube-api-access-dchm7") pod "b82a4dce-40fb-4e1c-85a0-5e29b900ad33" (UID: "b82a4dce-40fb-4e1c-85a0-5e29b900ad33"). InnerVolumeSpecName "kube-api-access-dchm7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:13:51 crc kubenswrapper[5120]: I0316 16:13:51.045918 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-khzbp\" (UniqueName: \"kubernetes.io/projected/b0e5c34b-8582-407e-a0ce-7fe6748cf84f-kube-api-access-khzbp\") on node \"crc\" DevicePath \"\"" Mar 16 16:13:51 crc kubenswrapper[5120]: I0316 16:13:51.045946 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dchm7\" (UniqueName: \"kubernetes.io/projected/b82a4dce-40fb-4e1c-85a0-5e29b900ad33-kube-api-access-dchm7\") on node \"crc\" DevicePath \"\"" Mar 16 16:13:51 crc kubenswrapper[5120]: I0316 16:13:51.331710 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-create-p4ngm" Mar 16 16:13:51 crc kubenswrapper[5120]: I0316 16:13:51.331792 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-create-p4ngm" event={"ID":"b0e5c34b-8582-407e-a0ce-7fe6748cf84f","Type":"ContainerDied","Data":"040bc1068a887f915c5134a42c9c89d9c1ff676aab517a3d96165af69c402a98"} Mar 16 16:13:51 crc kubenswrapper[5120]: I0316 16:13:51.331880 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="040bc1068a887f915c5134a42c9c89d9c1ff676aab517a3d96165af69c402a98" Mar 16 16:13:51 crc kubenswrapper[5120]: I0316 16:13:51.334421 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-e3fe-account-create-update-6gdjr" Mar 16 16:13:51 crc kubenswrapper[5120]: I0316 16:13:51.334493 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-e3fe-account-create-update-6gdjr" event={"ID":"b82a4dce-40fb-4e1c-85a0-5e29b900ad33","Type":"ContainerDied","Data":"cd150fa6b245874e6a8956136730a3fdc858e2e2b76029d3c780e242e61fa84a"} Mar 16 16:13:51 crc kubenswrapper[5120]: I0316 16:13:51.334539 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cd150fa6b245874e6a8956136730a3fdc858e2e2b76029d3c780e242e61fa84a" Mar 16 16:13:51 crc kubenswrapper[5120]: I0316 16:13:51.506165 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/community-operators-lff6h" Mar 16 16:13:51 crc kubenswrapper[5120]: I0316 16:13:51.506209 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-marketplace/community-operators-lff6h" Mar 16 16:13:51 crc kubenswrapper[5120]: I0316 16:13:51.556447 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/community-operators-lff6h" Mar 16 16:13:52 crc kubenswrapper[5120]: I0316 16:13:52.425552 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/community-operators-lff6h" Mar 16 16:13:52 crc kubenswrapper[5120]: I0316 16:13:52.426210 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-db-sync-wwjzc"] Mar 16 16:13:52 crc kubenswrapper[5120]: I0316 16:13:52.427957 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0e5c34b-8582-407e-a0ce-7fe6748cf84f" containerName="mariadb-database-create" Mar 16 16:13:52 crc kubenswrapper[5120]: I0316 16:13:52.427998 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0e5c34b-8582-407e-a0ce-7fe6748cf84f" containerName="mariadb-database-create" Mar 16 16:13:52 crc kubenswrapper[5120]: I0316 16:13:52.428019 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a80bd29-f380-41b4-88db-1c80eccb1ca8" containerName="mariadb-account-create-update" Mar 16 16:13:52 crc kubenswrapper[5120]: I0316 16:13:52.428036 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a80bd29-f380-41b4-88db-1c80eccb1ca8" containerName="mariadb-account-create-update" Mar 16 16:13:52 crc kubenswrapper[5120]: I0316 16:13:52.428052 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b82a4dce-40fb-4e1c-85a0-5e29b900ad33" containerName="mariadb-account-create-update" Mar 16 16:13:52 crc kubenswrapper[5120]: I0316 16:13:52.428064 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="b82a4dce-40fb-4e1c-85a0-5e29b900ad33" containerName="mariadb-account-create-update" Mar 16 16:13:52 crc kubenswrapper[5120]: I0316 16:13:52.428393 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="b82a4dce-40fb-4e1c-85a0-5e29b900ad33" containerName="mariadb-account-create-update" Mar 16 16:13:52 crc kubenswrapper[5120]: I0316 16:13:52.428422 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="4a80bd29-f380-41b4-88db-1c80eccb1ca8" containerName="mariadb-account-create-update" Mar 16 16:13:52 crc kubenswrapper[5120]: I0316 16:13:52.428448 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="b0e5c34b-8582-407e-a0ce-7fe6748cf84f" containerName="mariadb-database-create" Mar 16 16:13:52 crc kubenswrapper[5120]: I0316 16:13:52.435057 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-wwjzc" Mar 16 16:13:52 crc kubenswrapper[5120]: I0316 16:13:52.437037 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-config-data\"" Mar 16 16:13:52 crc kubenswrapper[5120]: I0316 16:13:52.437978 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-glance-dockercfg-5rw8s\"" Mar 16 16:13:52 crc kubenswrapper[5120]: I0316 16:13:52.441517 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-wwjzc"] Mar 16 16:13:52 crc kubenswrapper[5120]: I0316 16:13:52.507223 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/community-operators-lff6h"] Mar 16 16:13:52 crc kubenswrapper[5120]: I0316 16:13:52.580909 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/aed6211e-7fe1-4037-909a-18ac2e1e2783-combined-ca-bundle\") pod \"glance-db-sync-wwjzc\" (UID: \"aed6211e-7fe1-4037-909a-18ac2e1e2783\") " pod="openstack-kuttl-tests/glance-db-sync-wwjzc" Mar 16 16:13:52 crc kubenswrapper[5120]: I0316 16:13:52.581226 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/aed6211e-7fe1-4037-909a-18ac2e1e2783-config-data\") pod \"glance-db-sync-wwjzc\" (UID: \"aed6211e-7fe1-4037-909a-18ac2e1e2783\") " pod="openstack-kuttl-tests/glance-db-sync-wwjzc" Mar 16 16:13:52 crc kubenswrapper[5120]: I0316 16:13:52.581275 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bdv8\" (UniqueName: \"kubernetes.io/projected/aed6211e-7fe1-4037-909a-18ac2e1e2783-kube-api-access-5bdv8\") pod \"glance-db-sync-wwjzc\" (UID: \"aed6211e-7fe1-4037-909a-18ac2e1e2783\") " pod="openstack-kuttl-tests/glance-db-sync-wwjzc" Mar 16 16:13:52 crc kubenswrapper[5120]: I0316 16:13:52.581356 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/aed6211e-7fe1-4037-909a-18ac2e1e2783-db-sync-config-data\") pod \"glance-db-sync-wwjzc\" (UID: \"aed6211e-7fe1-4037-909a-18ac2e1e2783\") " pod="openstack-kuttl-tests/glance-db-sync-wwjzc" Mar 16 16:13:52 crc kubenswrapper[5120]: I0316 16:13:52.682674 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/aed6211e-7fe1-4037-909a-18ac2e1e2783-config-data\") pod \"glance-db-sync-wwjzc\" (UID: \"aed6211e-7fe1-4037-909a-18ac2e1e2783\") " pod="openstack-kuttl-tests/glance-db-sync-wwjzc" Mar 16 16:13:52 crc kubenswrapper[5120]: I0316 16:13:52.682718 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5bdv8\" (UniqueName: \"kubernetes.io/projected/aed6211e-7fe1-4037-909a-18ac2e1e2783-kube-api-access-5bdv8\") pod \"glance-db-sync-wwjzc\" (UID: \"aed6211e-7fe1-4037-909a-18ac2e1e2783\") " pod="openstack-kuttl-tests/glance-db-sync-wwjzc" Mar 16 16:13:52 crc kubenswrapper[5120]: I0316 16:13:52.682776 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/aed6211e-7fe1-4037-909a-18ac2e1e2783-db-sync-config-data\") pod \"glance-db-sync-wwjzc\" (UID: \"aed6211e-7fe1-4037-909a-18ac2e1e2783\") " pod="openstack-kuttl-tests/glance-db-sync-wwjzc" Mar 16 16:13:52 crc kubenswrapper[5120]: I0316 16:13:52.682851 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/aed6211e-7fe1-4037-909a-18ac2e1e2783-combined-ca-bundle\") pod \"glance-db-sync-wwjzc\" (UID: \"aed6211e-7fe1-4037-909a-18ac2e1e2783\") " pod="openstack-kuttl-tests/glance-db-sync-wwjzc" Mar 16 16:13:52 crc kubenswrapper[5120]: I0316 16:13:52.688980 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/aed6211e-7fe1-4037-909a-18ac2e1e2783-config-data\") pod \"glance-db-sync-wwjzc\" (UID: \"aed6211e-7fe1-4037-909a-18ac2e1e2783\") " pod="openstack-kuttl-tests/glance-db-sync-wwjzc" Mar 16 16:13:52 crc kubenswrapper[5120]: I0316 16:13:52.689310 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/aed6211e-7fe1-4037-909a-18ac2e1e2783-db-sync-config-data\") pod \"glance-db-sync-wwjzc\" (UID: \"aed6211e-7fe1-4037-909a-18ac2e1e2783\") " pod="openstack-kuttl-tests/glance-db-sync-wwjzc" Mar 16 16:13:52 crc kubenswrapper[5120]: I0316 16:13:52.699841 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/aed6211e-7fe1-4037-909a-18ac2e1e2783-combined-ca-bundle\") pod \"glance-db-sync-wwjzc\" (UID: \"aed6211e-7fe1-4037-909a-18ac2e1e2783\") " pod="openstack-kuttl-tests/glance-db-sync-wwjzc" Mar 16 16:13:52 crc kubenswrapper[5120]: I0316 16:13:52.704249 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bdv8\" (UniqueName: \"kubernetes.io/projected/aed6211e-7fe1-4037-909a-18ac2e1e2783-kube-api-access-5bdv8\") pod \"glance-db-sync-wwjzc\" (UID: \"aed6211e-7fe1-4037-909a-18ac2e1e2783\") " pod="openstack-kuttl-tests/glance-db-sync-wwjzc" Mar 16 16:13:52 crc kubenswrapper[5120]: I0316 16:13:52.763290 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-wwjzc" Mar 16 16:13:53 crc kubenswrapper[5120]: I0316 16:13:53.225416 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-cg9xc"] Mar 16 16:13:53 crc kubenswrapper[5120]: I0316 16:13:53.232538 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-cg9xc"] Mar 16 16:13:53 crc kubenswrapper[5120]: I0316 16:13:53.242549 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-wwjzc"] Mar 16 16:13:53 crc kubenswrapper[5120]: W0316 16:13:53.249774 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaed6211e_7fe1_4037_909a_18ac2e1e2783.slice/crio-81d727b1ebe689ebecdfcdefe07d616770c9645b8b19ded3c9f6bc3a149476bf WatchSource:0}: Error finding container 81d727b1ebe689ebecdfcdefe07d616770c9645b8b19ded3c9f6bc3a149476bf: Status 404 returned error can't find the container with id 81d727b1ebe689ebecdfcdefe07d616770c9645b8b19ded3c9f6bc3a149476bf Mar 16 16:13:53 crc kubenswrapper[5120]: I0316 16:13:53.357361 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-wwjzc" event={"ID":"aed6211e-7fe1-4037-909a-18ac2e1e2783","Type":"ContainerStarted","Data":"81d727b1ebe689ebecdfcdefe07d616770c9645b8b19ded3c9f6bc3a149476bf"} Mar 16 16:13:54 crc kubenswrapper[5120]: I0316 16:13:54.394266 5120 generic.go:358] "Generic (PLEG): container finished" podID="229b83a2-da65-44f4-933d-0b43976c171d" containerID="5b379a830ff9d3c0159f76782a30148b2923a1653897bee0e8b29c16d72595be" exitCode=0 Mar 16 16:13:54 crc kubenswrapper[5120]: I0316 16:13:54.394363 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-j7b48" event={"ID":"229b83a2-da65-44f4-933d-0b43976c171d","Type":"ContainerDied","Data":"5b379a830ff9d3c0159f76782a30148b2923a1653897bee0e8b29c16d72595be"} Mar 16 16:13:54 crc kubenswrapper[5120]: I0316 16:13:54.399229 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-wwjzc" event={"ID":"aed6211e-7fe1-4037-909a-18ac2e1e2783","Type":"ContainerStarted","Data":"336175f6e4a413fbdc7f5d1defbe23cb6b1d219efc18fc5eac887c1f8fa43cdc"} Mar 16 16:13:54 crc kubenswrapper[5120]: I0316 16:13:54.399623 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-marketplace/community-operators-lff6h" podUID="a51ee405-feaa-48a9-88e6-b677b86ab415" containerName="registry-server" containerID="cri-o://ffbabe7972fa1829e67e0bf59ce6ad83bf04d4bf024e45ea7592ee2312d17499" gracePeriod=2 Mar 16 16:13:54 crc kubenswrapper[5120]: I0316 16:13:54.477254 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-db-sync-wwjzc" podStartSLOduration=2.477227922 podStartE2EDuration="2.477227922s" podCreationTimestamp="2026-03-16 16:13:52 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:13:54.455847948 +0000 UTC m=+2536.609779665" watchObservedRunningTime="2026-03-16 16:13:54.477227922 +0000 UTC m=+2536.631159609" Mar 16 16:13:54 crc kubenswrapper[5120]: I0316 16:13:54.677361 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4a80bd29-f380-41b4-88db-1c80eccb1ca8" path="/var/lib/kubelet/pods/4a80bd29-f380-41b4-88db-1c80eccb1ca8/volumes" Mar 16 16:13:54 crc kubenswrapper[5120]: I0316 16:13:54.951561 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-lff6h" Mar 16 16:13:55 crc kubenswrapper[5120]: I0316 16:13:55.045321 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/a51ee405-feaa-48a9-88e6-b677b86ab415-utilities\") pod \"a51ee405-feaa-48a9-88e6-b677b86ab415\" (UID: \"a51ee405-feaa-48a9-88e6-b677b86ab415\") " Mar 16 16:13:55 crc kubenswrapper[5120]: I0316 16:13:55.045556 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/a51ee405-feaa-48a9-88e6-b677b86ab415-catalog-content\") pod \"a51ee405-feaa-48a9-88e6-b677b86ab415\" (UID: \"a51ee405-feaa-48a9-88e6-b677b86ab415\") " Mar 16 16:13:55 crc kubenswrapper[5120]: I0316 16:13:55.046266 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wgqc9\" (UniqueName: \"kubernetes.io/projected/a51ee405-feaa-48a9-88e6-b677b86ab415-kube-api-access-wgqc9\") pod \"a51ee405-feaa-48a9-88e6-b677b86ab415\" (UID: \"a51ee405-feaa-48a9-88e6-b677b86ab415\") " Mar 16 16:13:55 crc kubenswrapper[5120]: I0316 16:13:55.047312 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a51ee405-feaa-48a9-88e6-b677b86ab415-utilities" (OuterVolumeSpecName: "utilities") pod "a51ee405-feaa-48a9-88e6-b677b86ab415" (UID: "a51ee405-feaa-48a9-88e6-b677b86ab415"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:13:55 crc kubenswrapper[5120]: I0316 16:13:55.055559 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a51ee405-feaa-48a9-88e6-b677b86ab415-kube-api-access-wgqc9" (OuterVolumeSpecName: "kube-api-access-wgqc9") pod "a51ee405-feaa-48a9-88e6-b677b86ab415" (UID: "a51ee405-feaa-48a9-88e6-b677b86ab415"). InnerVolumeSpecName "kube-api-access-wgqc9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:13:55 crc kubenswrapper[5120]: I0316 16:13:55.112717 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a51ee405-feaa-48a9-88e6-b677b86ab415-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "a51ee405-feaa-48a9-88e6-b677b86ab415" (UID: "a51ee405-feaa-48a9-88e6-b677b86ab415"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:13:55 crc kubenswrapper[5120]: I0316 16:13:55.149699 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wgqc9\" (UniqueName: \"kubernetes.io/projected/a51ee405-feaa-48a9-88e6-b677b86ab415-kube-api-access-wgqc9\") on node \"crc\" DevicePath \"\"" Mar 16 16:13:55 crc kubenswrapper[5120]: I0316 16:13:55.149810 5120 reconciler_common.go:299] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/a51ee405-feaa-48a9-88e6-b677b86ab415-utilities\") on node \"crc\" DevicePath \"\"" Mar 16 16:13:55 crc kubenswrapper[5120]: I0316 16:13:55.149830 5120 reconciler_common.go:299] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/a51ee405-feaa-48a9-88e6-b677b86ab415-catalog-content\") on node \"crc\" DevicePath \"\"" Mar 16 16:13:55 crc kubenswrapper[5120]: I0316 16:13:55.412707 5120 generic.go:358] "Generic (PLEG): container finished" podID="a51ee405-feaa-48a9-88e6-b677b86ab415" containerID="ffbabe7972fa1829e67e0bf59ce6ad83bf04d4bf024e45ea7592ee2312d17499" exitCode=0 Mar 16 16:13:55 crc kubenswrapper[5120]: I0316 16:13:55.412785 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-lff6h" event={"ID":"a51ee405-feaa-48a9-88e6-b677b86ab415","Type":"ContainerDied","Data":"ffbabe7972fa1829e67e0bf59ce6ad83bf04d4bf024e45ea7592ee2312d17499"} Mar 16 16:13:55 crc kubenswrapper[5120]: I0316 16:13:55.413582 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-lff6h" event={"ID":"a51ee405-feaa-48a9-88e6-b677b86ab415","Type":"ContainerDied","Data":"d9cc52f1db9914fa191501de25d67fbfea761af38d571fedade0190ff8f5012b"} Mar 16 16:13:55 crc kubenswrapper[5120]: I0316 16:13:55.412864 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-lff6h" Mar 16 16:13:55 crc kubenswrapper[5120]: I0316 16:13:55.413620 5120 scope.go:117] "RemoveContainer" containerID="ffbabe7972fa1829e67e0bf59ce6ad83bf04d4bf024e45ea7592ee2312d17499" Mar 16 16:13:55 crc kubenswrapper[5120]: I0316 16:13:55.447192 5120 scope.go:117] "RemoveContainer" containerID="25ac2dd2da7e375fd9e7a1d50e2a6ead3d419c2749507c43fd9ec7c01ce5e1cc" Mar 16 16:13:55 crc kubenswrapper[5120]: I0316 16:13:55.455439 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/community-operators-lff6h"] Mar 16 16:13:55 crc kubenswrapper[5120]: I0316 16:13:55.464170 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/community-operators-lff6h"] Mar 16 16:13:55 crc kubenswrapper[5120]: I0316 16:13:55.489801 5120 scope.go:117] "RemoveContainer" containerID="dfcd593312f48006df93207939cbcac42e8683cb2de3ae877c676f39b036338d" Mar 16 16:13:55 crc kubenswrapper[5120]: I0316 16:13:55.524067 5120 scope.go:117] "RemoveContainer" containerID="ffbabe7972fa1829e67e0bf59ce6ad83bf04d4bf024e45ea7592ee2312d17499" Mar 16 16:13:55 crc kubenswrapper[5120]: E0316 16:13:55.524437 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ffbabe7972fa1829e67e0bf59ce6ad83bf04d4bf024e45ea7592ee2312d17499\": container with ID starting with ffbabe7972fa1829e67e0bf59ce6ad83bf04d4bf024e45ea7592ee2312d17499 not found: ID does not exist" containerID="ffbabe7972fa1829e67e0bf59ce6ad83bf04d4bf024e45ea7592ee2312d17499" Mar 16 16:13:55 crc kubenswrapper[5120]: I0316 16:13:55.524468 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ffbabe7972fa1829e67e0bf59ce6ad83bf04d4bf024e45ea7592ee2312d17499"} err="failed to get container status \"ffbabe7972fa1829e67e0bf59ce6ad83bf04d4bf024e45ea7592ee2312d17499\": rpc error: code = NotFound desc = could not find container \"ffbabe7972fa1829e67e0bf59ce6ad83bf04d4bf024e45ea7592ee2312d17499\": container with ID starting with ffbabe7972fa1829e67e0bf59ce6ad83bf04d4bf024e45ea7592ee2312d17499 not found: ID does not exist" Mar 16 16:13:55 crc kubenswrapper[5120]: I0316 16:13:55.524487 5120 scope.go:117] "RemoveContainer" containerID="25ac2dd2da7e375fd9e7a1d50e2a6ead3d419c2749507c43fd9ec7c01ce5e1cc" Mar 16 16:13:55 crc kubenswrapper[5120]: E0316 16:13:55.524791 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"25ac2dd2da7e375fd9e7a1d50e2a6ead3d419c2749507c43fd9ec7c01ce5e1cc\": container with ID starting with 25ac2dd2da7e375fd9e7a1d50e2a6ead3d419c2749507c43fd9ec7c01ce5e1cc not found: ID does not exist" containerID="25ac2dd2da7e375fd9e7a1d50e2a6ead3d419c2749507c43fd9ec7c01ce5e1cc" Mar 16 16:13:55 crc kubenswrapper[5120]: I0316 16:13:55.524842 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25ac2dd2da7e375fd9e7a1d50e2a6ead3d419c2749507c43fd9ec7c01ce5e1cc"} err="failed to get container status \"25ac2dd2da7e375fd9e7a1d50e2a6ead3d419c2749507c43fd9ec7c01ce5e1cc\": rpc error: code = NotFound desc = could not find container \"25ac2dd2da7e375fd9e7a1d50e2a6ead3d419c2749507c43fd9ec7c01ce5e1cc\": container with ID starting with 25ac2dd2da7e375fd9e7a1d50e2a6ead3d419c2749507c43fd9ec7c01ce5e1cc not found: ID does not exist" Mar 16 16:13:55 crc kubenswrapper[5120]: I0316 16:13:55.524867 5120 scope.go:117] "RemoveContainer" containerID="dfcd593312f48006df93207939cbcac42e8683cb2de3ae877c676f39b036338d" Mar 16 16:13:55 crc kubenswrapper[5120]: E0316 16:13:55.525879 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dfcd593312f48006df93207939cbcac42e8683cb2de3ae877c676f39b036338d\": container with ID starting with dfcd593312f48006df93207939cbcac42e8683cb2de3ae877c676f39b036338d not found: ID does not exist" containerID="dfcd593312f48006df93207939cbcac42e8683cb2de3ae877c676f39b036338d" Mar 16 16:13:55 crc kubenswrapper[5120]: I0316 16:13:55.525913 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dfcd593312f48006df93207939cbcac42e8683cb2de3ae877c676f39b036338d"} err="failed to get container status \"dfcd593312f48006df93207939cbcac42e8683cb2de3ae877c676f39b036338d\": rpc error: code = NotFound desc = could not find container \"dfcd593312f48006df93207939cbcac42e8683cb2de3ae877c676f39b036338d\": container with ID starting with dfcd593312f48006df93207939cbcac42e8683cb2de3ae877c676f39b036338d not found: ID does not exist" Mar 16 16:13:55 crc kubenswrapper[5120]: I0316 16:13:55.751812 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-j7b48" Mar 16 16:13:55 crc kubenswrapper[5120]: I0316 16:13:55.867534 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/229b83a2-da65-44f4-933d-0b43976c171d-scripts\") pod \"229b83a2-da65-44f4-933d-0b43976c171d\" (UID: \"229b83a2-da65-44f4-933d-0b43976c171d\") " Mar 16 16:13:55 crc kubenswrapper[5120]: I0316 16:13:55.867963 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/229b83a2-da65-44f4-933d-0b43976c171d-etc-swift\") pod \"229b83a2-da65-44f4-933d-0b43976c171d\" (UID: \"229b83a2-da65-44f4-933d-0b43976c171d\") " Mar 16 16:13:55 crc kubenswrapper[5120]: I0316 16:13:55.868084 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/229b83a2-da65-44f4-933d-0b43976c171d-swiftconf\") pod \"229b83a2-da65-44f4-933d-0b43976c171d\" (UID: \"229b83a2-da65-44f4-933d-0b43976c171d\") " Mar 16 16:13:55 crc kubenswrapper[5120]: I0316 16:13:55.868150 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/229b83a2-da65-44f4-933d-0b43976c171d-combined-ca-bundle\") pod \"229b83a2-da65-44f4-933d-0b43976c171d\" (UID: \"229b83a2-da65-44f4-933d-0b43976c171d\") " Mar 16 16:13:55 crc kubenswrapper[5120]: I0316 16:13:55.868260 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/229b83a2-da65-44f4-933d-0b43976c171d-ring-data-devices\") pod \"229b83a2-da65-44f4-933d-0b43976c171d\" (UID: \"229b83a2-da65-44f4-933d-0b43976c171d\") " Mar 16 16:13:55 crc kubenswrapper[5120]: I0316 16:13:55.868400 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cq6t5\" (UniqueName: \"kubernetes.io/projected/229b83a2-da65-44f4-933d-0b43976c171d-kube-api-access-cq6t5\") pod \"229b83a2-da65-44f4-933d-0b43976c171d\" (UID: \"229b83a2-da65-44f4-933d-0b43976c171d\") " Mar 16 16:13:55 crc kubenswrapper[5120]: I0316 16:13:55.868470 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/229b83a2-da65-44f4-933d-0b43976c171d-dispersionconf\") pod \"229b83a2-da65-44f4-933d-0b43976c171d\" (UID: \"229b83a2-da65-44f4-933d-0b43976c171d\") " Mar 16 16:13:55 crc kubenswrapper[5120]: I0316 16:13:55.868791 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/229b83a2-da65-44f4-933d-0b43976c171d-ring-data-devices" (OuterVolumeSpecName: "ring-data-devices") pod "229b83a2-da65-44f4-933d-0b43976c171d" (UID: "229b83a2-da65-44f4-933d-0b43976c171d"). InnerVolumeSpecName "ring-data-devices". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:13:55 crc kubenswrapper[5120]: I0316 16:13:55.869024 5120 reconciler_common.go:299] "Volume detached for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/229b83a2-da65-44f4-933d-0b43976c171d-ring-data-devices\") on node \"crc\" DevicePath \"\"" Mar 16 16:13:55 crc kubenswrapper[5120]: I0316 16:13:55.869058 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/229b83a2-da65-44f4-933d-0b43976c171d-etc-swift" (OuterVolumeSpecName: "etc-swift") pod "229b83a2-da65-44f4-933d-0b43976c171d" (UID: "229b83a2-da65-44f4-933d-0b43976c171d"). InnerVolumeSpecName "etc-swift". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:13:55 crc kubenswrapper[5120]: I0316 16:13:55.872992 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/229b83a2-da65-44f4-933d-0b43976c171d-kube-api-access-cq6t5" (OuterVolumeSpecName: "kube-api-access-cq6t5") pod "229b83a2-da65-44f4-933d-0b43976c171d" (UID: "229b83a2-da65-44f4-933d-0b43976c171d"). InnerVolumeSpecName "kube-api-access-cq6t5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:13:55 crc kubenswrapper[5120]: I0316 16:13:55.875341 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/229b83a2-da65-44f4-933d-0b43976c171d-dispersionconf" (OuterVolumeSpecName: "dispersionconf") pod "229b83a2-da65-44f4-933d-0b43976c171d" (UID: "229b83a2-da65-44f4-933d-0b43976c171d"). InnerVolumeSpecName "dispersionconf". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:13:55 crc kubenswrapper[5120]: I0316 16:13:55.892634 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/229b83a2-da65-44f4-933d-0b43976c171d-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "229b83a2-da65-44f4-933d-0b43976c171d" (UID: "229b83a2-da65-44f4-933d-0b43976c171d"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:13:55 crc kubenswrapper[5120]: I0316 16:13:55.892649 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/229b83a2-da65-44f4-933d-0b43976c171d-swiftconf" (OuterVolumeSpecName: "swiftconf") pod "229b83a2-da65-44f4-933d-0b43976c171d" (UID: "229b83a2-da65-44f4-933d-0b43976c171d"). InnerVolumeSpecName "swiftconf". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:13:55 crc kubenswrapper[5120]: I0316 16:13:55.893937 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/229b83a2-da65-44f4-933d-0b43976c171d-scripts" (OuterVolumeSpecName: "scripts") pod "229b83a2-da65-44f4-933d-0b43976c171d" (UID: "229b83a2-da65-44f4-933d-0b43976c171d"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:13:55 crc kubenswrapper[5120]: I0316 16:13:55.971098 5120 reconciler_common.go:299] "Volume detached for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/229b83a2-da65-44f4-933d-0b43976c171d-dispersionconf\") on node \"crc\" DevicePath \"\"" Mar 16 16:13:55 crc kubenswrapper[5120]: I0316 16:13:55.971137 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/229b83a2-da65-44f4-933d-0b43976c171d-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:13:55 crc kubenswrapper[5120]: I0316 16:13:55.971150 5120 reconciler_common.go:299] "Volume detached for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/229b83a2-da65-44f4-933d-0b43976c171d-etc-swift\") on node \"crc\" DevicePath \"\"" Mar 16 16:13:55 crc kubenswrapper[5120]: I0316 16:13:55.971162 5120 reconciler_common.go:299] "Volume detached for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/229b83a2-da65-44f4-933d-0b43976c171d-swiftconf\") on node \"crc\" DevicePath \"\"" Mar 16 16:13:55 crc kubenswrapper[5120]: I0316 16:13:55.971174 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/229b83a2-da65-44f4-933d-0b43976c171d-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:13:55 crc kubenswrapper[5120]: I0316 16:13:55.971189 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cq6t5\" (UniqueName: \"kubernetes.io/projected/229b83a2-da65-44f4-933d-0b43976c171d-kube-api-access-cq6t5\") on node \"crc\" DevicePath \"\"" Mar 16 16:13:56 crc kubenswrapper[5120]: I0316 16:13:56.424581 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-j7b48" event={"ID":"229b83a2-da65-44f4-933d-0b43976c171d","Type":"ContainerDied","Data":"b8b3a704a542fae3ed8283db18c3faf7c266355fdcd166002eb36598e9f359be"} Mar 16 16:13:56 crc kubenswrapper[5120]: I0316 16:13:56.424629 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b8b3a704a542fae3ed8283db18c3faf7c266355fdcd166002eb36598e9f359be" Mar 16 16:13:56 crc kubenswrapper[5120]: I0316 16:13:56.424707 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-j7b48" Mar 16 16:13:56 crc kubenswrapper[5120]: I0316 16:13:56.675960 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a51ee405-feaa-48a9-88e6-b677b86ab415" path="/var/lib/kubelet/pods/a51ee405-feaa-48a9-88e6-b677b86ab415/volumes" Mar 16 16:13:57 crc kubenswrapper[5120]: I0316 16:13:57.282441 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:13:58 crc kubenswrapper[5120]: I0316 16:13:58.220382 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/root-account-create-update-xczfx"] Mar 16 16:13:58 crc kubenswrapper[5120]: I0316 16:13:58.221413 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a51ee405-feaa-48a9-88e6-b677b86ab415" containerName="extract-utilities" Mar 16 16:13:58 crc kubenswrapper[5120]: I0316 16:13:58.221434 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a51ee405-feaa-48a9-88e6-b677b86ab415" containerName="extract-utilities" Mar 16 16:13:58 crc kubenswrapper[5120]: I0316 16:13:58.221466 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="229b83a2-da65-44f4-933d-0b43976c171d" containerName="swift-ring-rebalance" Mar 16 16:13:58 crc kubenswrapper[5120]: I0316 16:13:58.221475 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="229b83a2-da65-44f4-933d-0b43976c171d" containerName="swift-ring-rebalance" Mar 16 16:13:58 crc kubenswrapper[5120]: I0316 16:13:58.221485 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a51ee405-feaa-48a9-88e6-b677b86ab415" containerName="extract-content" Mar 16 16:13:58 crc kubenswrapper[5120]: I0316 16:13:58.221493 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a51ee405-feaa-48a9-88e6-b677b86ab415" containerName="extract-content" Mar 16 16:13:58 crc kubenswrapper[5120]: I0316 16:13:58.221505 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a51ee405-feaa-48a9-88e6-b677b86ab415" containerName="registry-server" Mar 16 16:13:58 crc kubenswrapper[5120]: I0316 16:13:58.221511 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a51ee405-feaa-48a9-88e6-b677b86ab415" containerName="registry-server" Mar 16 16:13:58 crc kubenswrapper[5120]: I0316 16:13:58.221705 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="229b83a2-da65-44f4-933d-0b43976c171d" containerName="swift-ring-rebalance" Mar 16 16:13:58 crc kubenswrapper[5120]: I0316 16:13:58.221729 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="a51ee405-feaa-48a9-88e6-b677b86ab415" containerName="registry-server" Mar 16 16:13:58 crc kubenswrapper[5120]: I0316 16:13:58.225837 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-xczfx" Mar 16 16:13:58 crc kubenswrapper[5120]: I0316 16:13:58.228251 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"openstack-cell1-mariadb-root-db-secret\"" Mar 16 16:13:58 crc kubenswrapper[5120]: I0316 16:13:58.234300 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-xczfx"] Mar 16 16:13:58 crc kubenswrapper[5120]: I0316 16:13:58.322158 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s56xq\" (UniqueName: \"kubernetes.io/projected/a3c82ca6-cc5d-4f5d-ab18-ff0cf8187c85-kube-api-access-s56xq\") pod \"root-account-create-update-xczfx\" (UID: \"a3c82ca6-cc5d-4f5d-ab18-ff0cf8187c85\") " pod="openstack-kuttl-tests/root-account-create-update-xczfx" Mar 16 16:13:58 crc kubenswrapper[5120]: I0316 16:13:58.322376 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a3c82ca6-cc5d-4f5d-ab18-ff0cf8187c85-operator-scripts\") pod \"root-account-create-update-xczfx\" (UID: \"a3c82ca6-cc5d-4f5d-ab18-ff0cf8187c85\") " pod="openstack-kuttl-tests/root-account-create-update-xczfx" Mar 16 16:13:58 crc kubenswrapper[5120]: I0316 16:13:58.425462 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s56xq\" (UniqueName: \"kubernetes.io/projected/a3c82ca6-cc5d-4f5d-ab18-ff0cf8187c85-kube-api-access-s56xq\") pod \"root-account-create-update-xczfx\" (UID: \"a3c82ca6-cc5d-4f5d-ab18-ff0cf8187c85\") " pod="openstack-kuttl-tests/root-account-create-update-xczfx" Mar 16 16:13:58 crc kubenswrapper[5120]: I0316 16:13:58.425659 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a3c82ca6-cc5d-4f5d-ab18-ff0cf8187c85-operator-scripts\") pod \"root-account-create-update-xczfx\" (UID: \"a3c82ca6-cc5d-4f5d-ab18-ff0cf8187c85\") " pod="openstack-kuttl-tests/root-account-create-update-xczfx" Mar 16 16:13:58 crc kubenswrapper[5120]: I0316 16:13:58.426970 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a3c82ca6-cc5d-4f5d-ab18-ff0cf8187c85-operator-scripts\") pod \"root-account-create-update-xczfx\" (UID: \"a3c82ca6-cc5d-4f5d-ab18-ff0cf8187c85\") " pod="openstack-kuttl-tests/root-account-create-update-xczfx" Mar 16 16:13:58 crc kubenswrapper[5120]: I0316 16:13:58.445520 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s56xq\" (UniqueName: \"kubernetes.io/projected/a3c82ca6-cc5d-4f5d-ab18-ff0cf8187c85-kube-api-access-s56xq\") pod \"root-account-create-update-xczfx\" (UID: \"a3c82ca6-cc5d-4f5d-ab18-ff0cf8187c85\") " pod="openstack-kuttl-tests/root-account-create-update-xczfx" Mar 16 16:13:58 crc kubenswrapper[5120]: I0316 16:13:58.552663 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-xczfx" Mar 16 16:13:58 crc kubenswrapper[5120]: I0316 16:13:58.833502 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/101749dc-c834-4d18-9d65-704af8b368a4-etc-swift\") pod \"swift-storage-0\" (UID: \"101749dc-c834-4d18-9d65-704af8b368a4\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:13:58 crc kubenswrapper[5120]: I0316 16:13:58.839617 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/101749dc-c834-4d18-9d65-704af8b368a4-etc-swift\") pod \"swift-storage-0\" (UID: \"101749dc-c834-4d18-9d65-704af8b368a4\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:13:58 crc kubenswrapper[5120]: I0316 16:13:58.853863 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:13:59 crc kubenswrapper[5120]: I0316 16:13:59.029300 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-xczfx"] Mar 16 16:13:59 crc kubenswrapper[5120]: W0316 16:13:59.031691 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda3c82ca6_cc5d_4f5d_ab18_ff0cf8187c85.slice/crio-ef2d3ffdda4aca90a4d1362ab92056a50c95d281cbafcc95deb5bbf5dfe5b74e WatchSource:0}: Error finding container ef2d3ffdda4aca90a4d1362ab92056a50c95d281cbafcc95deb5bbf5dfe5b74e: Status 404 returned error can't find the container with id ef2d3ffdda4aca90a4d1362ab92056a50c95d281cbafcc95deb5bbf5dfe5b74e Mar 16 16:13:59 crc kubenswrapper[5120]: I0316 16:13:59.315392 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 16:13:59 crc kubenswrapper[5120]: W0316 16:13:59.322451 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod101749dc_c834_4d18_9d65_704af8b368a4.slice/crio-197f27f892721488b0848c325b307ad49c1fce4664f9c8cb573b750610849bb6 WatchSource:0}: Error finding container 197f27f892721488b0848c325b307ad49c1fce4664f9c8cb573b750610849bb6: Status 404 returned error can't find the container with id 197f27f892721488b0848c325b307ad49c1fce4664f9c8cb573b750610849bb6 Mar 16 16:13:59 crc kubenswrapper[5120]: I0316 16:13:59.473673 5120 generic.go:358] "Generic (PLEG): container finished" podID="aed6211e-7fe1-4037-909a-18ac2e1e2783" containerID="336175f6e4a413fbdc7f5d1defbe23cb6b1d219efc18fc5eac887c1f8fa43cdc" exitCode=0 Mar 16 16:13:59 crc kubenswrapper[5120]: I0316 16:13:59.473820 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-wwjzc" event={"ID":"aed6211e-7fe1-4037-909a-18ac2e1e2783","Type":"ContainerDied","Data":"336175f6e4a413fbdc7f5d1defbe23cb6b1d219efc18fc5eac887c1f8fa43cdc"} Mar 16 16:13:59 crc kubenswrapper[5120]: I0316 16:13:59.476308 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"101749dc-c834-4d18-9d65-704af8b368a4","Type":"ContainerStarted","Data":"197f27f892721488b0848c325b307ad49c1fce4664f9c8cb573b750610849bb6"} Mar 16 16:13:59 crc kubenswrapper[5120]: I0316 16:13:59.479693 5120 generic.go:358] "Generic (PLEG): container finished" podID="a3c82ca6-cc5d-4f5d-ab18-ff0cf8187c85" containerID="898e7e24e24ad47f5e4d28774c017ff107e537198ddac3c945dfbfd1a7ba3af8" exitCode=0 Mar 16 16:13:59 crc kubenswrapper[5120]: I0316 16:13:59.479748 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-xczfx" event={"ID":"a3c82ca6-cc5d-4f5d-ab18-ff0cf8187c85","Type":"ContainerDied","Data":"898e7e24e24ad47f5e4d28774c017ff107e537198ddac3c945dfbfd1a7ba3af8"} Mar 16 16:13:59 crc kubenswrapper[5120]: I0316 16:13:59.479789 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-xczfx" event={"ID":"a3c82ca6-cc5d-4f5d-ab18-ff0cf8187c85","Type":"ContainerStarted","Data":"ef2d3ffdda4aca90a4d1362ab92056a50c95d281cbafcc95deb5bbf5dfe5b74e"} Mar 16 16:13:59 crc kubenswrapper[5120]: I0316 16:13:59.664546 5120 scope.go:117] "RemoveContainer" containerID="bc2df124cc6ad146d7c7dd2115ac815986fb62978d38895f6d345a4a9b14dbd8" Mar 16 16:14:00 crc kubenswrapper[5120]: I0316 16:14:00.128506 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-infra/auto-csr-approver-29561294-74vpp"] Mar 16 16:14:00 crc kubenswrapper[5120]: I0316 16:14:00.138303 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561294-74vpp" Mar 16 16:14:00 crc kubenswrapper[5120]: I0316 16:14:00.139550 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561294-74vpp"] Mar 16 16:14:00 crc kubenswrapper[5120]: I0316 16:14:00.142563 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-infra\"/\"csr-approver-sa-dockercfg-x2nsz\"" Mar 16 16:14:00 crc kubenswrapper[5120]: I0316 16:14:00.142588 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"openshift-service-ca.crt\"" Mar 16 16:14:00 crc kubenswrapper[5120]: I0316 16:14:00.144350 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"kube-root-ca.crt\"" Mar 16 16:14:00 crc kubenswrapper[5120]: I0316 16:14:00.292904 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8sv2\" (UniqueName: \"kubernetes.io/projected/896c0a85-dde5-457c-8253-683e2002bea4-kube-api-access-d8sv2\") pod \"auto-csr-approver-29561294-74vpp\" (UID: \"896c0a85-dde5-457c-8253-683e2002bea4\") " pod="openshift-infra/auto-csr-approver-29561294-74vpp" Mar 16 16:14:00 crc kubenswrapper[5120]: I0316 16:14:00.395473 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d8sv2\" (UniqueName: \"kubernetes.io/projected/896c0a85-dde5-457c-8253-683e2002bea4-kube-api-access-d8sv2\") pod \"auto-csr-approver-29561294-74vpp\" (UID: \"896c0a85-dde5-457c-8253-683e2002bea4\") " pod="openshift-infra/auto-csr-approver-29561294-74vpp" Mar 16 16:14:00 crc kubenswrapper[5120]: I0316 16:14:00.411451 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8sv2\" (UniqueName: \"kubernetes.io/projected/896c0a85-dde5-457c-8253-683e2002bea4-kube-api-access-d8sv2\") pod \"auto-csr-approver-29561294-74vpp\" (UID: \"896c0a85-dde5-457c-8253-683e2002bea4\") " pod="openshift-infra/auto-csr-approver-29561294-74vpp" Mar 16 16:14:00 crc kubenswrapper[5120]: I0316 16:14:00.486739 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561294-74vpp" Mar 16 16:14:00 crc kubenswrapper[5120]: I0316 16:14:00.490291 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" event={"ID":"e2275cb4-4905-4d66-a87e-8010120db2bd","Type":"ContainerStarted","Data":"c6f2e7729551b434e995735fce26cb8624554f70ca6b56bae845f839f1f3f2df"} Mar 16 16:14:00 crc kubenswrapper[5120]: I0316 16:14:00.498815 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"101749dc-c834-4d18-9d65-704af8b368a4","Type":"ContainerStarted","Data":"01823eea0af03bb3372ba342990110a4b6c8c7fa9118b0d7d29650e99d2cd108"} Mar 16 16:14:00 crc kubenswrapper[5120]: I0316 16:14:00.498883 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"101749dc-c834-4d18-9d65-704af8b368a4","Type":"ContainerStarted","Data":"4a42fa4b365d37c495ee5ee82170ce1b235d8d672fd02b0158bdcc126237e473"} Mar 16 16:14:00 crc kubenswrapper[5120]: I0316 16:14:00.498900 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"101749dc-c834-4d18-9d65-704af8b368a4","Type":"ContainerStarted","Data":"bef2d8e8e654dd9a105c210bd37ced0c71c3d573629cb12e5d3cbd97b64421d7"} Mar 16 16:14:00 crc kubenswrapper[5120]: I0316 16:14:00.498913 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"101749dc-c834-4d18-9d65-704af8b368a4","Type":"ContainerStarted","Data":"4a42f47b6d82f13c7158ef114a3d72c3c33bdc7a2c6031a71bfddca2f3b3ca3a"} Mar 16 16:14:00 crc kubenswrapper[5120]: I0316 16:14:00.498924 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"101749dc-c834-4d18-9d65-704af8b368a4","Type":"ContainerStarted","Data":"724e698bc2647d226f34e5e375df069d0a2d87cec35127fb8ca1aa87a3e302dc"} Mar 16 16:14:00 crc kubenswrapper[5120]: I0316 16:14:00.501075 5120 generic.go:358] "Generic (PLEG): container finished" podID="551715bc-101a-4745-955b-027ac2be9c0b" containerID="851c1660f50a90ff9d46cc70cf1f804834a4e916e5c034ce95bd2ac287850333" exitCode=0 Mar 16 16:14:00 crc kubenswrapper[5120]: I0316 16:14:00.501176 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"551715bc-101a-4745-955b-027ac2be9c0b","Type":"ContainerDied","Data":"851c1660f50a90ff9d46cc70cf1f804834a4e916e5c034ce95bd2ac287850333"} Mar 16 16:14:00 crc kubenswrapper[5120]: I0316 16:14:00.503091 5120 generic.go:358] "Generic (PLEG): container finished" podID="51d5f0da-bcbc-492e-ab39-6189dc22fa22" containerID="e6b2822e5d645128d56a9bd865e65d852149622fc008ded1e1d1554dda52b32a" exitCode=0 Mar 16 16:14:00 crc kubenswrapper[5120]: I0316 16:14:00.503160 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"51d5f0da-bcbc-492e-ab39-6189dc22fa22","Type":"ContainerDied","Data":"e6b2822e5d645128d56a9bd865e65d852149622fc008ded1e1d1554dda52b32a"} Mar 16 16:14:01 crc kubenswrapper[5120]: I0316 16:14:01.003355 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-wwjzc" Mar 16 16:14:01 crc kubenswrapper[5120]: I0316 16:14:01.041717 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-xczfx" Mar 16 16:14:01 crc kubenswrapper[5120]: I0316 16:14:01.093633 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561294-74vpp"] Mar 16 16:14:01 crc kubenswrapper[5120]: I0316 16:14:01.114341 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/aed6211e-7fe1-4037-909a-18ac2e1e2783-combined-ca-bundle\") pod \"aed6211e-7fe1-4037-909a-18ac2e1e2783\" (UID: \"aed6211e-7fe1-4037-909a-18ac2e1e2783\") " Mar 16 16:14:01 crc kubenswrapper[5120]: I0316 16:14:01.114504 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/aed6211e-7fe1-4037-909a-18ac2e1e2783-config-data\") pod \"aed6211e-7fe1-4037-909a-18ac2e1e2783\" (UID: \"aed6211e-7fe1-4037-909a-18ac2e1e2783\") " Mar 16 16:14:01 crc kubenswrapper[5120]: I0316 16:14:01.114692 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/aed6211e-7fe1-4037-909a-18ac2e1e2783-db-sync-config-data\") pod \"aed6211e-7fe1-4037-909a-18ac2e1e2783\" (UID: \"aed6211e-7fe1-4037-909a-18ac2e1e2783\") " Mar 16 16:14:01 crc kubenswrapper[5120]: I0316 16:14:01.115029 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s56xq\" (UniqueName: \"kubernetes.io/projected/a3c82ca6-cc5d-4f5d-ab18-ff0cf8187c85-kube-api-access-s56xq\") pod \"a3c82ca6-cc5d-4f5d-ab18-ff0cf8187c85\" (UID: \"a3c82ca6-cc5d-4f5d-ab18-ff0cf8187c85\") " Mar 16 16:14:01 crc kubenswrapper[5120]: I0316 16:14:01.115139 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a3c82ca6-cc5d-4f5d-ab18-ff0cf8187c85-operator-scripts\") pod \"a3c82ca6-cc5d-4f5d-ab18-ff0cf8187c85\" (UID: \"a3c82ca6-cc5d-4f5d-ab18-ff0cf8187c85\") " Mar 16 16:14:01 crc kubenswrapper[5120]: I0316 16:14:01.115263 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5bdv8\" (UniqueName: \"kubernetes.io/projected/aed6211e-7fe1-4037-909a-18ac2e1e2783-kube-api-access-5bdv8\") pod \"aed6211e-7fe1-4037-909a-18ac2e1e2783\" (UID: \"aed6211e-7fe1-4037-909a-18ac2e1e2783\") " Mar 16 16:14:01 crc kubenswrapper[5120]: I0316 16:14:01.116295 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a3c82ca6-cc5d-4f5d-ab18-ff0cf8187c85-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "a3c82ca6-cc5d-4f5d-ab18-ff0cf8187c85" (UID: "a3c82ca6-cc5d-4f5d-ab18-ff0cf8187c85"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:14:01 crc kubenswrapper[5120]: I0316 16:14:01.116553 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a3c82ca6-cc5d-4f5d-ab18-ff0cf8187c85-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:14:01 crc kubenswrapper[5120]: I0316 16:14:01.121490 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aed6211e-7fe1-4037-909a-18ac2e1e2783-db-sync-config-data" (OuterVolumeSpecName: "db-sync-config-data") pod "aed6211e-7fe1-4037-909a-18ac2e1e2783" (UID: "aed6211e-7fe1-4037-909a-18ac2e1e2783"). InnerVolumeSpecName "db-sync-config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:14:01 crc kubenswrapper[5120]: I0316 16:14:01.123351 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3c82ca6-cc5d-4f5d-ab18-ff0cf8187c85-kube-api-access-s56xq" (OuterVolumeSpecName: "kube-api-access-s56xq") pod "a3c82ca6-cc5d-4f5d-ab18-ff0cf8187c85" (UID: "a3c82ca6-cc5d-4f5d-ab18-ff0cf8187c85"). InnerVolumeSpecName "kube-api-access-s56xq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:14:01 crc kubenswrapper[5120]: I0316 16:14:01.123385 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aed6211e-7fe1-4037-909a-18ac2e1e2783-kube-api-access-5bdv8" (OuterVolumeSpecName: "kube-api-access-5bdv8") pod "aed6211e-7fe1-4037-909a-18ac2e1e2783" (UID: "aed6211e-7fe1-4037-909a-18ac2e1e2783"). InnerVolumeSpecName "kube-api-access-5bdv8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:14:01 crc kubenswrapper[5120]: I0316 16:14:01.152920 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aed6211e-7fe1-4037-909a-18ac2e1e2783-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "aed6211e-7fe1-4037-909a-18ac2e1e2783" (UID: "aed6211e-7fe1-4037-909a-18ac2e1e2783"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:14:01 crc kubenswrapper[5120]: I0316 16:14:01.157430 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aed6211e-7fe1-4037-909a-18ac2e1e2783-config-data" (OuterVolumeSpecName: "config-data") pod "aed6211e-7fe1-4037-909a-18ac2e1e2783" (UID: "aed6211e-7fe1-4037-909a-18ac2e1e2783"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:14:01 crc kubenswrapper[5120]: I0316 16:14:01.217922 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s56xq\" (UniqueName: \"kubernetes.io/projected/a3c82ca6-cc5d-4f5d-ab18-ff0cf8187c85-kube-api-access-s56xq\") on node \"crc\" DevicePath \"\"" Mar 16 16:14:01 crc kubenswrapper[5120]: I0316 16:14:01.218214 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5bdv8\" (UniqueName: \"kubernetes.io/projected/aed6211e-7fe1-4037-909a-18ac2e1e2783-kube-api-access-5bdv8\") on node \"crc\" DevicePath \"\"" Mar 16 16:14:01 crc kubenswrapper[5120]: I0316 16:14:01.218223 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/aed6211e-7fe1-4037-909a-18ac2e1e2783-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:14:01 crc kubenswrapper[5120]: I0316 16:14:01.218233 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/aed6211e-7fe1-4037-909a-18ac2e1e2783-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:14:01 crc kubenswrapper[5120]: I0316 16:14:01.218242 5120 reconciler_common.go:299] "Volume detached for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/aed6211e-7fe1-4037-909a-18ac2e1e2783-db-sync-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:14:01 crc kubenswrapper[5120]: I0316 16:14:01.513179 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-xczfx" event={"ID":"a3c82ca6-cc5d-4f5d-ab18-ff0cf8187c85","Type":"ContainerDied","Data":"ef2d3ffdda4aca90a4d1362ab92056a50c95d281cbafcc95deb5bbf5dfe5b74e"} Mar 16 16:14:01 crc kubenswrapper[5120]: I0316 16:14:01.515163 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ef2d3ffdda4aca90a4d1362ab92056a50c95d281cbafcc95deb5bbf5dfe5b74e" Mar 16 16:14:01 crc kubenswrapper[5120]: I0316 16:14:01.513198 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-xczfx" Mar 16 16:14:01 crc kubenswrapper[5120]: I0316 16:14:01.520956 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"551715bc-101a-4745-955b-027ac2be9c0b","Type":"ContainerStarted","Data":"1c358da4a94182ad980d04746126744b917f3eefac12cf1b996c541e1be24f80"} Mar 16 16:14:01 crc kubenswrapper[5120]: I0316 16:14:01.521284 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:14:01 crc kubenswrapper[5120]: I0316 16:14:01.528315 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"51d5f0da-bcbc-492e-ab39-6189dc22fa22","Type":"ContainerStarted","Data":"612da3352edae9eff1f05f74b385ccf462bdc41a37210c6f1f1b0581e0b27fe9"} Mar 16 16:14:01 crc kubenswrapper[5120]: I0316 16:14:01.528815 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:14:01 crc kubenswrapper[5120]: I0316 16:14:01.538948 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561294-74vpp" event={"ID":"896c0a85-dde5-457c-8253-683e2002bea4","Type":"ContainerStarted","Data":"22c012e8a7af50db8c0d674ce979d060717b02c438efdcd569e4f412be02e2c5"} Mar 16 16:14:01 crc kubenswrapper[5120]: I0316 16:14:01.556191 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-wwjzc" event={"ID":"aed6211e-7fe1-4037-909a-18ac2e1e2783","Type":"ContainerDied","Data":"81d727b1ebe689ebecdfcdefe07d616770c9645b8b19ded3c9f6bc3a149476bf"} Mar 16 16:14:01 crc kubenswrapper[5120]: I0316 16:14:01.556435 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="81d727b1ebe689ebecdfcdefe07d616770c9645b8b19ded3c9f6bc3a149476bf" Mar 16 16:14:01 crc kubenswrapper[5120]: I0316 16:14:01.556200 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-wwjzc" Mar 16 16:14:01 crc kubenswrapper[5120]: I0316 16:14:01.566187 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"101749dc-c834-4d18-9d65-704af8b368a4","Type":"ContainerStarted","Data":"e3aa4f856a04b1edd734f731b0ff764b58f2b038b82ca0b0d4359c2b9bf86469"} Mar 16 16:14:01 crc kubenswrapper[5120]: I0316 16:14:01.566244 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"101749dc-c834-4d18-9d65-704af8b368a4","Type":"ContainerStarted","Data":"65875e7567b5b9a91bd06c5e05daccd574160efc902dcf5923e2b79b0c8d2244"} Mar 16 16:14:01 crc kubenswrapper[5120]: I0316 16:14:01.566256 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"101749dc-c834-4d18-9d65-704af8b368a4","Type":"ContainerStarted","Data":"1c5916dc01f8f4a3e1534605c444a2119e71a700b54a69e10c8bb9e635de25e8"} Mar 16 16:14:01 crc kubenswrapper[5120]: I0316 16:14:01.566264 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"101749dc-c834-4d18-9d65-704af8b368a4","Type":"ContainerStarted","Data":"51cf967532606c9ced06ad6de8648b12654ee7582414482d898f98946c9fa5fc"} Mar 16 16:14:01 crc kubenswrapper[5120]: I0316 16:14:01.566272 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"101749dc-c834-4d18-9d65-704af8b368a4","Type":"ContainerStarted","Data":"4cb9bb128aaf44f72b20395fcb3cc05e72d1adffacb345c94004414396b1d28a"} Mar 16 16:14:01 crc kubenswrapper[5120]: I0316 16:14:01.592709 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" podStartSLOduration=36.592685995 podStartE2EDuration="36.592685995s" podCreationTimestamp="2026-03-16 16:13:25 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:14:01.562419664 +0000 UTC m=+2543.716351321" watchObservedRunningTime="2026-03-16 16:14:01.592685995 +0000 UTC m=+2543.746617652" Mar 16 16:14:01 crc kubenswrapper[5120]: I0316 16:14:01.593737 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/rabbitmq-server-0" podStartSLOduration=37.593732933 podStartE2EDuration="37.593732933s" podCreationTimestamp="2026-03-16 16:13:24 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:14:01.593480397 +0000 UTC m=+2543.747412054" watchObservedRunningTime="2026-03-16 16:14:01.593732933 +0000 UTC m=+2543.747664590" Mar 16 16:14:02 crc kubenswrapper[5120]: I0316 16:14:02.618844 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"101749dc-c834-4d18-9d65-704af8b368a4","Type":"ContainerStarted","Data":"ece1a88abc1997dbb13342308b7cefe3d5da6a00ca03108092562f3d6a4f1d16"} Mar 16 16:14:02 crc kubenswrapper[5120]: I0316 16:14:02.619556 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"101749dc-c834-4d18-9d65-704af8b368a4","Type":"ContainerStarted","Data":"088d32f480158b50b622b79c86870fbb30bf7d4089dd0d34fcf8a46590f9352d"} Mar 16 16:14:02 crc kubenswrapper[5120]: I0316 16:14:02.619568 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"101749dc-c834-4d18-9d65-704af8b368a4","Type":"ContainerStarted","Data":"d3498f4c52aa0e90e0fc4d0abe76a9d9dfdd5f4ff506a2e63ee7f72189220719"} Mar 16 16:14:02 crc kubenswrapper[5120]: I0316 16:14:02.619576 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"101749dc-c834-4d18-9d65-704af8b368a4","Type":"ContainerStarted","Data":"b4ac5deaffac392f3bb392fc03b0084b602ddec296f8870f1652da6f222d4e54"} Mar 16 16:14:02 crc kubenswrapper[5120]: I0316 16:14:02.619586 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"101749dc-c834-4d18-9d65-704af8b368a4","Type":"ContainerStarted","Data":"10dfe1e92abc7a6f8ab5af868cf187ab014f8189c9aa859d23d8de692d693309"} Mar 16 16:14:02 crc kubenswrapper[5120]: I0316 16:14:02.692709 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/swift-storage-0" podStartSLOduration=21.692690976 podStartE2EDuration="21.692690976s" podCreationTimestamp="2026-03-16 16:13:41 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:14:02.68237577 +0000 UTC m=+2544.836307427" watchObservedRunningTime="2026-03-16 16:14:02.692690976 +0000 UTC m=+2544.846622633" Mar 16 16:14:02 crc kubenswrapper[5120]: I0316 16:14:02.869433 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-654d469f7f-jcvx4"] Mar 16 16:14:02 crc kubenswrapper[5120]: I0316 16:14:02.870337 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aed6211e-7fe1-4037-909a-18ac2e1e2783" containerName="glance-db-sync" Mar 16 16:14:02 crc kubenswrapper[5120]: I0316 16:14:02.870359 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="aed6211e-7fe1-4037-909a-18ac2e1e2783" containerName="glance-db-sync" Mar 16 16:14:02 crc kubenswrapper[5120]: I0316 16:14:02.870389 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3c82ca6-cc5d-4f5d-ab18-ff0cf8187c85" containerName="mariadb-account-create-update" Mar 16 16:14:02 crc kubenswrapper[5120]: I0316 16:14:02.870396 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3c82ca6-cc5d-4f5d-ab18-ff0cf8187c85" containerName="mariadb-account-create-update" Mar 16 16:14:02 crc kubenswrapper[5120]: I0316 16:14:02.870579 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="aed6211e-7fe1-4037-909a-18ac2e1e2783" containerName="glance-db-sync" Mar 16 16:14:02 crc kubenswrapper[5120]: I0316 16:14:02.870605 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="a3c82ca6-cc5d-4f5d-ab18-ff0cf8187c85" containerName="mariadb-account-create-update" Mar 16 16:14:02 crc kubenswrapper[5120]: I0316 16:14:02.878621 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-654d469f7f-jcvx4" Mar 16 16:14:02 crc kubenswrapper[5120]: I0316 16:14:02.880554 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"dns-swift-storage-0\"" Mar 16 16:14:02 crc kubenswrapper[5120]: I0316 16:14:02.887158 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-654d469f7f-jcvx4"] Mar 16 16:14:02 crc kubenswrapper[5120]: I0316 16:14:02.952672 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvvmn\" (UniqueName: \"kubernetes.io/projected/251f0648-5ccd-4e12-acbb-ced50b9ce41b-kube-api-access-cvvmn\") pod \"dnsmasq-dnsmasq-654d469f7f-jcvx4\" (UID: \"251f0648-5ccd-4e12-acbb-ced50b9ce41b\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-654d469f7f-jcvx4" Mar 16 16:14:02 crc kubenswrapper[5120]: I0316 16:14:02.952744 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/251f0648-5ccd-4e12-acbb-ced50b9ce41b-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-654d469f7f-jcvx4\" (UID: \"251f0648-5ccd-4e12-acbb-ced50b9ce41b\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-654d469f7f-jcvx4" Mar 16 16:14:02 crc kubenswrapper[5120]: I0316 16:14:02.952969 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/251f0648-5ccd-4e12-acbb-ced50b9ce41b-dns-swift-storage-0\") pod \"dnsmasq-dnsmasq-654d469f7f-jcvx4\" (UID: \"251f0648-5ccd-4e12-acbb-ced50b9ce41b\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-654d469f7f-jcvx4" Mar 16 16:14:02 crc kubenswrapper[5120]: I0316 16:14:02.953132 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/251f0648-5ccd-4e12-acbb-ced50b9ce41b-config\") pod \"dnsmasq-dnsmasq-654d469f7f-jcvx4\" (UID: \"251f0648-5ccd-4e12-acbb-ced50b9ce41b\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-654d469f7f-jcvx4" Mar 16 16:14:03 crc kubenswrapper[5120]: I0316 16:14:03.054164 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/251f0648-5ccd-4e12-acbb-ced50b9ce41b-config\") pod \"dnsmasq-dnsmasq-654d469f7f-jcvx4\" (UID: \"251f0648-5ccd-4e12-acbb-ced50b9ce41b\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-654d469f7f-jcvx4" Mar 16 16:14:03 crc kubenswrapper[5120]: I0316 16:14:03.054273 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cvvmn\" (UniqueName: \"kubernetes.io/projected/251f0648-5ccd-4e12-acbb-ced50b9ce41b-kube-api-access-cvvmn\") pod \"dnsmasq-dnsmasq-654d469f7f-jcvx4\" (UID: \"251f0648-5ccd-4e12-acbb-ced50b9ce41b\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-654d469f7f-jcvx4" Mar 16 16:14:03 crc kubenswrapper[5120]: I0316 16:14:03.054325 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/251f0648-5ccd-4e12-acbb-ced50b9ce41b-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-654d469f7f-jcvx4\" (UID: \"251f0648-5ccd-4e12-acbb-ced50b9ce41b\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-654d469f7f-jcvx4" Mar 16 16:14:03 crc kubenswrapper[5120]: I0316 16:14:03.054392 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/251f0648-5ccd-4e12-acbb-ced50b9ce41b-dns-swift-storage-0\") pod \"dnsmasq-dnsmasq-654d469f7f-jcvx4\" (UID: \"251f0648-5ccd-4e12-acbb-ced50b9ce41b\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-654d469f7f-jcvx4" Mar 16 16:14:03 crc kubenswrapper[5120]: I0316 16:14:03.055429 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/251f0648-5ccd-4e12-acbb-ced50b9ce41b-config\") pod \"dnsmasq-dnsmasq-654d469f7f-jcvx4\" (UID: \"251f0648-5ccd-4e12-acbb-ced50b9ce41b\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-654d469f7f-jcvx4" Mar 16 16:14:03 crc kubenswrapper[5120]: I0316 16:14:03.055500 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/251f0648-5ccd-4e12-acbb-ced50b9ce41b-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-654d469f7f-jcvx4\" (UID: \"251f0648-5ccd-4e12-acbb-ced50b9ce41b\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-654d469f7f-jcvx4" Mar 16 16:14:03 crc kubenswrapper[5120]: I0316 16:14:03.055540 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/251f0648-5ccd-4e12-acbb-ced50b9ce41b-dns-swift-storage-0\") pod \"dnsmasq-dnsmasq-654d469f7f-jcvx4\" (UID: \"251f0648-5ccd-4e12-acbb-ced50b9ce41b\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-654d469f7f-jcvx4" Mar 16 16:14:03 crc kubenswrapper[5120]: I0316 16:14:03.078772 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvvmn\" (UniqueName: \"kubernetes.io/projected/251f0648-5ccd-4e12-acbb-ced50b9ce41b-kube-api-access-cvvmn\") pod \"dnsmasq-dnsmasq-654d469f7f-jcvx4\" (UID: \"251f0648-5ccd-4e12-acbb-ced50b9ce41b\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-654d469f7f-jcvx4" Mar 16 16:14:03 crc kubenswrapper[5120]: I0316 16:14:03.198117 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-654d469f7f-jcvx4" Mar 16 16:14:03 crc kubenswrapper[5120]: I0316 16:14:03.627631 5120 generic.go:358] "Generic (PLEG): container finished" podID="896c0a85-dde5-457c-8253-683e2002bea4" containerID="4e8dc1d069cbac7b06e5c6e3687fcf8e8f118bb132d322174aac0b0c84a0b2a9" exitCode=0 Mar 16 16:14:03 crc kubenswrapper[5120]: I0316 16:14:03.627682 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561294-74vpp" event={"ID":"896c0a85-dde5-457c-8253-683e2002bea4","Type":"ContainerDied","Data":"4e8dc1d069cbac7b06e5c6e3687fcf8e8f118bb132d322174aac0b0c84a0b2a9"} Mar 16 16:14:03 crc kubenswrapper[5120]: W0316 16:14:03.697364 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod251f0648_5ccd_4e12_acbb_ced50b9ce41b.slice/crio-8698455c6cb902305d6d9205edc4b495ac12fc1bbe35763c23a523f2962e685e WatchSource:0}: Error finding container 8698455c6cb902305d6d9205edc4b495ac12fc1bbe35763c23a523f2962e685e: Status 404 returned error can't find the container with id 8698455c6cb902305d6d9205edc4b495ac12fc1bbe35763c23a523f2962e685e Mar 16 16:14:03 crc kubenswrapper[5120]: I0316 16:14:03.699109 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-654d469f7f-jcvx4"] Mar 16 16:14:04 crc kubenswrapper[5120]: I0316 16:14:04.639563 5120 generic.go:358] "Generic (PLEG): container finished" podID="251f0648-5ccd-4e12-acbb-ced50b9ce41b" containerID="7dbaadf663fdcc74917ddaddd7287c528dc87729b5063e138d4e863a06aa4e38" exitCode=0 Mar 16 16:14:04 crc kubenswrapper[5120]: I0316 16:14:04.639614 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-654d469f7f-jcvx4" event={"ID":"251f0648-5ccd-4e12-acbb-ced50b9ce41b","Type":"ContainerDied","Data":"7dbaadf663fdcc74917ddaddd7287c528dc87729b5063e138d4e863a06aa4e38"} Mar 16 16:14:04 crc kubenswrapper[5120]: I0316 16:14:04.640248 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-654d469f7f-jcvx4" event={"ID":"251f0648-5ccd-4e12-acbb-ced50b9ce41b","Type":"ContainerStarted","Data":"8698455c6cb902305d6d9205edc4b495ac12fc1bbe35763c23a523f2962e685e"} Mar 16 16:14:05 crc kubenswrapper[5120]: I0316 16:14:05.045129 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561294-74vpp" Mar 16 16:14:05 crc kubenswrapper[5120]: I0316 16:14:05.093935 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d8sv2\" (UniqueName: \"kubernetes.io/projected/896c0a85-dde5-457c-8253-683e2002bea4-kube-api-access-d8sv2\") pod \"896c0a85-dde5-457c-8253-683e2002bea4\" (UID: \"896c0a85-dde5-457c-8253-683e2002bea4\") " Mar 16 16:14:05 crc kubenswrapper[5120]: I0316 16:14:05.099726 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/896c0a85-dde5-457c-8253-683e2002bea4-kube-api-access-d8sv2" (OuterVolumeSpecName: "kube-api-access-d8sv2") pod "896c0a85-dde5-457c-8253-683e2002bea4" (UID: "896c0a85-dde5-457c-8253-683e2002bea4"). InnerVolumeSpecName "kube-api-access-d8sv2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:14:05 crc kubenswrapper[5120]: I0316 16:14:05.196190 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d8sv2\" (UniqueName: \"kubernetes.io/projected/896c0a85-dde5-457c-8253-683e2002bea4-kube-api-access-d8sv2\") on node \"crc\" DevicePath \"\"" Mar 16 16:14:05 crc kubenswrapper[5120]: I0316 16:14:05.903729 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-654d469f7f-jcvx4" event={"ID":"251f0648-5ccd-4e12-acbb-ced50b9ce41b","Type":"ContainerStarted","Data":"c2508f73cb4eff7625d77f71d14b9731e2712af5e9df7a2c21e1820e48d9287c"} Mar 16 16:14:05 crc kubenswrapper[5120]: I0316 16:14:05.905110 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-654d469f7f-jcvx4" Mar 16 16:14:05 crc kubenswrapper[5120]: I0316 16:14:05.908845 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561294-74vpp" event={"ID":"896c0a85-dde5-457c-8253-683e2002bea4","Type":"ContainerDied","Data":"22c012e8a7af50db8c0d674ce979d060717b02c438efdcd569e4f412be02e2c5"} Mar 16 16:14:05 crc kubenswrapper[5120]: I0316 16:14:05.908870 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="22c012e8a7af50db8c0d674ce979d060717b02c438efdcd569e4f412be02e2c5" Mar 16 16:14:05 crc kubenswrapper[5120]: I0316 16:14:05.908924 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561294-74vpp" Mar 16 16:14:05 crc kubenswrapper[5120]: I0316 16:14:05.949743 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-654d469f7f-jcvx4" podStartSLOduration=3.949725134 podStartE2EDuration="3.949725134s" podCreationTimestamp="2026-03-16 16:14:02 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:14:05.94878699 +0000 UTC m=+2548.102718657" watchObservedRunningTime="2026-03-16 16:14:05.949725134 +0000 UTC m=+2548.103656791" Mar 16 16:14:05 crc kubenswrapper[5120]: I0316 16:14:05.993481 5120 scope.go:117] "RemoveContainer" containerID="4c9bf2a4036100b44427b712e056877a7288adad770792d826877af6b30e4386" Mar 16 16:14:06 crc kubenswrapper[5120]: I0316 16:14:06.024529 5120 scope.go:117] "RemoveContainer" containerID="930906d616c3e368fe99e940b9bb46df4bc2935bcaa185bf48c9102276c8923a" Mar 16 16:14:06 crc kubenswrapper[5120]: I0316 16:14:06.088603 5120 scope.go:117] "RemoveContainer" containerID="51d350c9a910e9073ccc4d4a467f2cfa9789914dde4173e918043b83b3b0a920" Mar 16 16:14:06 crc kubenswrapper[5120]: I0316 16:14:06.108295 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-infra/auto-csr-approver-29561288-b6gpk"] Mar 16 16:14:06 crc kubenswrapper[5120]: I0316 16:14:06.114438 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-infra/auto-csr-approver-29561288-b6gpk"] Mar 16 16:14:06 crc kubenswrapper[5120]: I0316 16:14:06.139235 5120 scope.go:117] "RemoveContainer" containerID="3ddeddcf41ed8d971498d46d59f340d31b7ccd8e30ccce4f36314a38b3c73f02" Mar 16 16:14:06 crc kubenswrapper[5120]: I0316 16:14:06.158875 5120 scope.go:117] "RemoveContainer" containerID="1a146f32466038e8a40da411b6f8f77338a06e13e67f898cb41a1358ec59794d" Mar 16 16:14:06 crc kubenswrapper[5120]: I0316 16:14:06.193343 5120 scope.go:117] "RemoveContainer" containerID="1797654748c2f46782a5a7d0be292f62299666e2cbead383368cb1f914247684" Mar 16 16:14:06 crc kubenswrapper[5120]: I0316 16:14:06.230534 5120 scope.go:117] "RemoveContainer" containerID="ffedaffbade6df37a8d8a3da00b5d9977022cb3e37f20b1857eb81e9ff8a1136" Mar 16 16:14:06 crc kubenswrapper[5120]: I0316 16:14:06.247159 5120 scope.go:117] "RemoveContainer" containerID="879540ab869cd27f4b041f1e8a911f07267554649bd939260638fad424f1356b" Mar 16 16:14:06 crc kubenswrapper[5120]: I0316 16:14:06.264473 5120 scope.go:117] "RemoveContainer" containerID="bfe7238fdbbf7d4fefe2181f3c7d19e051d2f95564a4bd73db5a8da5df6bca9b" Mar 16 16:14:06 crc kubenswrapper[5120]: I0316 16:14:06.303046 5120 scope.go:117] "RemoveContainer" containerID="71b738fa5abb74599f1af84a27985cc6034f03854d7df7ddd1a81542eeb16682" Mar 16 16:14:06 crc kubenswrapper[5120]: I0316 16:14:06.343598 5120 scope.go:117] "RemoveContainer" containerID="cfe157cc8dcdbc92540f19f958bb6b85a3026d72bae9fd54deb5f193d808da86" Mar 16 16:14:06 crc kubenswrapper[5120]: I0316 16:14:06.380689 5120 scope.go:117] "RemoveContainer" containerID="bb807065494461dabeab9e186ea493043b77e0f1742a89c1e691ebc8d1336a32" Mar 16 16:14:06 crc kubenswrapper[5120]: I0316 16:14:06.398433 5120 scope.go:117] "RemoveContainer" containerID="6060d2b9c2cbedb1a777ad8436125f9d2123d7f0cd501d724bf438032f344b6b" Mar 16 16:14:06 crc kubenswrapper[5120]: I0316 16:14:06.519365 5120 scope.go:117] "RemoveContainer" containerID="1166bb317bd3ed873a568ab0d94e3ba29fd576093029920d956796b746df2c9f" Mar 16 16:14:06 crc kubenswrapper[5120]: I0316 16:14:06.539929 5120 scope.go:117] "RemoveContainer" containerID="338a4c6e64d209ed4d346929a28dc2143b3211f5409248ed277e37b3256fb3bb" Mar 16 16:14:06 crc kubenswrapper[5120]: I0316 16:14:06.562353 5120 scope.go:117] "RemoveContainer" containerID="32a5fae783c49e06b1845498e8a9937d7600c43ddfc4063f7a9eebd7ee19e9a2" Mar 16 16:14:06 crc kubenswrapper[5120]: I0316 16:14:06.593329 5120 scope.go:117] "RemoveContainer" containerID="5c6d2c7450b267f4c1acfc758171fbdd29e7a3edeababbab4b687a32ec128193" Mar 16 16:14:06 crc kubenswrapper[5120]: I0316 16:14:06.672088 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b4e69343-fd94-436a-b5ab-dcc02f48c06b" path="/var/lib/kubelet/pods/b4e69343-fd94-436a-b5ab-dcc02f48c06b/volumes" Mar 16 16:14:06 crc kubenswrapper[5120]: I0316 16:14:06.773567 5120 scope.go:117] "RemoveContainer" containerID="46ae5a5cbe875d392d93e2aa52d34a36d06631d65696ef319b2ce14949187170" Mar 16 16:14:06 crc kubenswrapper[5120]: I0316 16:14:06.794239 5120 scope.go:117] "RemoveContainer" containerID="a68a9f1bcee3f9292438f3541515799be30bb3c1b173dfc589fb7dd822c38072" Mar 16 16:14:06 crc kubenswrapper[5120]: I0316 16:14:06.813916 5120 scope.go:117] "RemoveContainer" containerID="476779e448aa12a75638697201eb9c6dd3916e48dedaefee1ce3643a9123432a" Mar 16 16:14:06 crc kubenswrapper[5120]: I0316 16:14:06.831497 5120 scope.go:117] "RemoveContainer" containerID="0f8959e0bb7d95f5a292464465e9f5dc554f1e3aa6decc3a6b2c24f1d5d177aa" Mar 16 16:14:06 crc kubenswrapper[5120]: I0316 16:14:06.849828 5120 scope.go:117] "RemoveContainer" containerID="ef034b0dc3688c457c0d09580ee4ff2656fb6c3a4fa9faae91c39e03fbeb13d3" Mar 16 16:14:06 crc kubenswrapper[5120]: I0316 16:14:06.870378 5120 scope.go:117] "RemoveContainer" containerID="a7c91baa90a3eb95b3ddf6bf687af022b77802349ad1dca2e29118c8e3459d92" Mar 16 16:14:07 crc kubenswrapper[5120]: E0316 16:14:07.851406 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1406194 actualBytes=10240 Mar 16 16:14:12 crc kubenswrapper[5120]: I0316 16:14:12.622964 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:14:12 crc kubenswrapper[5120]: I0316 16:14:12.625120 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:14:12 crc kubenswrapper[5120]: I0316 16:14:12.959317 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-654d469f7f-jcvx4" Mar 16 16:14:13 crc kubenswrapper[5120]: I0316 16:14:13.029533 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-qwsw8"] Mar 16 16:14:13 crc kubenswrapper[5120]: I0316 16:14:13.029870 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-qwsw8" podUID="234493a1-61e6-4b74-a15a-888b6cee3dff" containerName="dnsmasq-dns" containerID="cri-o://773ccd13c8bb6668c7bed483102ccc70d496ef36860e67bae38546e80dae3bc5" gracePeriod=10 Mar 16 16:14:13 crc kubenswrapper[5120]: I0316 16:14:13.503435 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-qwsw8" Mar 16 16:14:13 crc kubenswrapper[5120]: I0316 16:14:13.663840 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/234493a1-61e6-4b74-a15a-888b6cee3dff-dnsmasq-svc\") pod \"234493a1-61e6-4b74-a15a-888b6cee3dff\" (UID: \"234493a1-61e6-4b74-a15a-888b6cee3dff\") " Mar 16 16:14:13 crc kubenswrapper[5120]: I0316 16:14:13.663962 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/234493a1-61e6-4b74-a15a-888b6cee3dff-config\") pod \"234493a1-61e6-4b74-a15a-888b6cee3dff\" (UID: \"234493a1-61e6-4b74-a15a-888b6cee3dff\") " Mar 16 16:14:13 crc kubenswrapper[5120]: I0316 16:14:13.664030 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pg9n8\" (UniqueName: \"kubernetes.io/projected/234493a1-61e6-4b74-a15a-888b6cee3dff-kube-api-access-pg9n8\") pod \"234493a1-61e6-4b74-a15a-888b6cee3dff\" (UID: \"234493a1-61e6-4b74-a15a-888b6cee3dff\") " Mar 16 16:14:13 crc kubenswrapper[5120]: I0316 16:14:13.679836 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/234493a1-61e6-4b74-a15a-888b6cee3dff-kube-api-access-pg9n8" (OuterVolumeSpecName: "kube-api-access-pg9n8") pod "234493a1-61e6-4b74-a15a-888b6cee3dff" (UID: "234493a1-61e6-4b74-a15a-888b6cee3dff"). InnerVolumeSpecName "kube-api-access-pg9n8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:14:13 crc kubenswrapper[5120]: I0316 16:14:13.704353 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/234493a1-61e6-4b74-a15a-888b6cee3dff-config" (OuterVolumeSpecName: "config") pod "234493a1-61e6-4b74-a15a-888b6cee3dff" (UID: "234493a1-61e6-4b74-a15a-888b6cee3dff"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:14:13 crc kubenswrapper[5120]: I0316 16:14:13.742434 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/234493a1-61e6-4b74-a15a-888b6cee3dff-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "234493a1-61e6-4b74-a15a-888b6cee3dff" (UID: "234493a1-61e6-4b74-a15a-888b6cee3dff"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:14:13 crc kubenswrapper[5120]: I0316 16:14:13.766379 5120 reconciler_common.go:299] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/234493a1-61e6-4b74-a15a-888b6cee3dff-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Mar 16 16:14:13 crc kubenswrapper[5120]: I0316 16:14:13.766415 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/234493a1-61e6-4b74-a15a-888b6cee3dff-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:14:13 crc kubenswrapper[5120]: I0316 16:14:13.766431 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pg9n8\" (UniqueName: \"kubernetes.io/projected/234493a1-61e6-4b74-a15a-888b6cee3dff-kube-api-access-pg9n8\") on node \"crc\" DevicePath \"\"" Mar 16 16:14:14 crc kubenswrapper[5120]: I0316 16:14:14.023407 5120 generic.go:358] "Generic (PLEG): container finished" podID="234493a1-61e6-4b74-a15a-888b6cee3dff" containerID="773ccd13c8bb6668c7bed483102ccc70d496ef36860e67bae38546e80dae3bc5" exitCode=0 Mar 16 16:14:14 crc kubenswrapper[5120]: I0316 16:14:14.023491 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-qwsw8" Mar 16 16:14:14 crc kubenswrapper[5120]: I0316 16:14:14.023822 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-qwsw8" event={"ID":"234493a1-61e6-4b74-a15a-888b6cee3dff","Type":"ContainerDied","Data":"773ccd13c8bb6668c7bed483102ccc70d496ef36860e67bae38546e80dae3bc5"} Mar 16 16:14:14 crc kubenswrapper[5120]: I0316 16:14:14.023927 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-qwsw8" event={"ID":"234493a1-61e6-4b74-a15a-888b6cee3dff","Type":"ContainerDied","Data":"a93be19d3ffbfe1757b5ff7ed2811daba2abb8a0e4be7107613ee435ea358c07"} Mar 16 16:14:14 crc kubenswrapper[5120]: I0316 16:14:14.024057 5120 scope.go:117] "RemoveContainer" containerID="773ccd13c8bb6668c7bed483102ccc70d496ef36860e67bae38546e80dae3bc5" Mar 16 16:14:14 crc kubenswrapper[5120]: I0316 16:14:14.056250 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-qwsw8"] Mar 16 16:14:14 crc kubenswrapper[5120]: I0316 16:14:14.059505 5120 scope.go:117] "RemoveContainer" containerID="d4470c95354463ae7bef07e64e7ce90b12f9fb90cabd9d81cf8b1e208517201a" Mar 16 16:14:14 crc kubenswrapper[5120]: I0316 16:14:14.063646 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-qwsw8"] Mar 16 16:14:14 crc kubenswrapper[5120]: I0316 16:14:14.076114 5120 scope.go:117] "RemoveContainer" containerID="773ccd13c8bb6668c7bed483102ccc70d496ef36860e67bae38546e80dae3bc5" Mar 16 16:14:14 crc kubenswrapper[5120]: E0316 16:14:14.076484 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"773ccd13c8bb6668c7bed483102ccc70d496ef36860e67bae38546e80dae3bc5\": container with ID starting with 773ccd13c8bb6668c7bed483102ccc70d496ef36860e67bae38546e80dae3bc5 not found: ID does not exist" containerID="773ccd13c8bb6668c7bed483102ccc70d496ef36860e67bae38546e80dae3bc5" Mar 16 16:14:14 crc kubenswrapper[5120]: I0316 16:14:14.076525 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"773ccd13c8bb6668c7bed483102ccc70d496ef36860e67bae38546e80dae3bc5"} err="failed to get container status \"773ccd13c8bb6668c7bed483102ccc70d496ef36860e67bae38546e80dae3bc5\": rpc error: code = NotFound desc = could not find container \"773ccd13c8bb6668c7bed483102ccc70d496ef36860e67bae38546e80dae3bc5\": container with ID starting with 773ccd13c8bb6668c7bed483102ccc70d496ef36860e67bae38546e80dae3bc5 not found: ID does not exist" Mar 16 16:14:14 crc kubenswrapper[5120]: I0316 16:14:14.076550 5120 scope.go:117] "RemoveContainer" containerID="d4470c95354463ae7bef07e64e7ce90b12f9fb90cabd9d81cf8b1e208517201a" Mar 16 16:14:14 crc kubenswrapper[5120]: E0316 16:14:14.076903 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d4470c95354463ae7bef07e64e7ce90b12f9fb90cabd9d81cf8b1e208517201a\": container with ID starting with d4470c95354463ae7bef07e64e7ce90b12f9fb90cabd9d81cf8b1e208517201a not found: ID does not exist" containerID="d4470c95354463ae7bef07e64e7ce90b12f9fb90cabd9d81cf8b1e208517201a" Mar 16 16:14:14 crc kubenswrapper[5120]: I0316 16:14:14.076931 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4470c95354463ae7bef07e64e7ce90b12f9fb90cabd9d81cf8b1e208517201a"} err="failed to get container status \"d4470c95354463ae7bef07e64e7ce90b12f9fb90cabd9d81cf8b1e208517201a\": rpc error: code = NotFound desc = could not find container \"d4470c95354463ae7bef07e64e7ce90b12f9fb90cabd9d81cf8b1e208517201a\": container with ID starting with d4470c95354463ae7bef07e64e7ce90b12f9fb90cabd9d81cf8b1e208517201a not found: ID does not exist" Mar 16 16:14:14 crc kubenswrapper[5120]: I0316 16:14:14.512292 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-db-create-h8hbg"] Mar 16 16:14:14 crc kubenswrapper[5120]: I0316 16:14:14.513316 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="896c0a85-dde5-457c-8253-683e2002bea4" containerName="oc" Mar 16 16:14:14 crc kubenswrapper[5120]: I0316 16:14:14.513338 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="896c0a85-dde5-457c-8253-683e2002bea4" containerName="oc" Mar 16 16:14:14 crc kubenswrapper[5120]: I0316 16:14:14.513355 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="234493a1-61e6-4b74-a15a-888b6cee3dff" containerName="dnsmasq-dns" Mar 16 16:14:14 crc kubenswrapper[5120]: I0316 16:14:14.513365 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="234493a1-61e6-4b74-a15a-888b6cee3dff" containerName="dnsmasq-dns" Mar 16 16:14:14 crc kubenswrapper[5120]: I0316 16:14:14.513396 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="234493a1-61e6-4b74-a15a-888b6cee3dff" containerName="init" Mar 16 16:14:14 crc kubenswrapper[5120]: I0316 16:14:14.513404 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="234493a1-61e6-4b74-a15a-888b6cee3dff" containerName="init" Mar 16 16:14:14 crc kubenswrapper[5120]: I0316 16:14:14.513565 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="896c0a85-dde5-457c-8253-683e2002bea4" containerName="oc" Mar 16 16:14:14 crc kubenswrapper[5120]: I0316 16:14:14.513584 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="234493a1-61e6-4b74-a15a-888b6cee3dff" containerName="dnsmasq-dns" Mar 16 16:14:14 crc kubenswrapper[5120]: I0316 16:14:14.518111 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-create-h8hbg" Mar 16 16:14:14 crc kubenswrapper[5120]: I0316 16:14:14.529485 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-db-create-h8hbg"] Mar 16 16:14:14 crc kubenswrapper[5120]: I0316 16:14:14.608179 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-c034-account-create-update-vtkb4"] Mar 16 16:14:14 crc kubenswrapper[5120]: I0316 16:14:14.613369 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-c034-account-create-update-vtkb4" Mar 16 16:14:14 crc kubenswrapper[5120]: I0316 16:14:14.617829 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-c034-account-create-update-vtkb4"] Mar 16 16:14:14 crc kubenswrapper[5120]: I0316 16:14:14.628121 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-db-secret\"" Mar 16 16:14:14 crc kubenswrapper[5120]: I0316 16:14:14.673861 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="234493a1-61e6-4b74-a15a-888b6cee3dff" path="/var/lib/kubelet/pods/234493a1-61e6-4b74-a15a-888b6cee3dff/volumes" Mar 16 16:14:14 crc kubenswrapper[5120]: I0316 16:14:14.692892 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqcdk\" (UniqueName: \"kubernetes.io/projected/50ebddc2-9233-4354-b102-0c05fb7512df-kube-api-access-tqcdk\") pod \"cinder-db-create-h8hbg\" (UID: \"50ebddc2-9233-4354-b102-0c05fb7512df\") " pod="openstack-kuttl-tests/cinder-db-create-h8hbg" Mar 16 16:14:14 crc kubenswrapper[5120]: I0316 16:14:14.693571 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/50ebddc2-9233-4354-b102-0c05fb7512df-operator-scripts\") pod \"cinder-db-create-h8hbg\" (UID: \"50ebddc2-9233-4354-b102-0c05fb7512df\") " pod="openstack-kuttl-tests/cinder-db-create-h8hbg" Mar 16 16:14:14 crc kubenswrapper[5120]: I0316 16:14:14.709875 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-db-create-cdlpn"] Mar 16 16:14:14 crc kubenswrapper[5120]: I0316 16:14:14.720321 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-create-cdlpn" Mar 16 16:14:14 crc kubenswrapper[5120]: I0316 16:14:14.742272 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-9c08-account-create-update-ld8t5"] Mar 16 16:14:14 crc kubenswrapper[5120]: I0316 16:14:14.760268 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-9c08-account-create-update-ld8t5" Mar 16 16:14:14 crc kubenswrapper[5120]: I0316 16:14:14.763690 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-db-secret\"" Mar 16 16:14:14 crc kubenswrapper[5120]: I0316 16:14:14.772880 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-db-create-cdlpn"] Mar 16 16:14:14 crc kubenswrapper[5120]: I0316 16:14:14.783197 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-9c08-account-create-update-ld8t5"] Mar 16 16:14:14 crc kubenswrapper[5120]: I0316 16:14:14.795654 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/50ebddc2-9233-4354-b102-0c05fb7512df-operator-scripts\") pod \"cinder-db-create-h8hbg\" (UID: \"50ebddc2-9233-4354-b102-0c05fb7512df\") " pod="openstack-kuttl-tests/cinder-db-create-h8hbg" Mar 16 16:14:14 crc kubenswrapper[5120]: I0316 16:14:14.795715 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pq8dm\" (UniqueName: \"kubernetes.io/projected/4b4c1be7-4f3b-490b-bf6d-89281ddf8c5b-kube-api-access-pq8dm\") pod \"cinder-c034-account-create-update-vtkb4\" (UID: \"4b4c1be7-4f3b-490b-bf6d-89281ddf8c5b\") " pod="openstack-kuttl-tests/cinder-c034-account-create-update-vtkb4" Mar 16 16:14:14 crc kubenswrapper[5120]: I0316 16:14:14.795748 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tqcdk\" (UniqueName: \"kubernetes.io/projected/50ebddc2-9233-4354-b102-0c05fb7512df-kube-api-access-tqcdk\") pod \"cinder-db-create-h8hbg\" (UID: \"50ebddc2-9233-4354-b102-0c05fb7512df\") " pod="openstack-kuttl-tests/cinder-db-create-h8hbg" Mar 16 16:14:14 crc kubenswrapper[5120]: I0316 16:14:14.795824 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/4b4c1be7-4f3b-490b-bf6d-89281ddf8c5b-operator-scripts\") pod \"cinder-c034-account-create-update-vtkb4\" (UID: \"4b4c1be7-4f3b-490b-bf6d-89281ddf8c5b\") " pod="openstack-kuttl-tests/cinder-c034-account-create-update-vtkb4" Mar 16 16:14:14 crc kubenswrapper[5120]: I0316 16:14:14.796922 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/50ebddc2-9233-4354-b102-0c05fb7512df-operator-scripts\") pod \"cinder-db-create-h8hbg\" (UID: \"50ebddc2-9233-4354-b102-0c05fb7512df\") " pod="openstack-kuttl-tests/cinder-db-create-h8hbg" Mar 16 16:14:14 crc kubenswrapper[5120]: I0316 16:14:14.818668 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqcdk\" (UniqueName: \"kubernetes.io/projected/50ebddc2-9233-4354-b102-0c05fb7512df-kube-api-access-tqcdk\") pod \"cinder-db-create-h8hbg\" (UID: \"50ebddc2-9233-4354-b102-0c05fb7512df\") " pod="openstack-kuttl-tests/cinder-db-create-h8hbg" Mar 16 16:14:14 crc kubenswrapper[5120]: I0316 16:14:14.825108 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-db-create-khl7k"] Mar 16 16:14:14 crc kubenswrapper[5120]: I0316 16:14:14.832694 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-db-create-khl7k"] Mar 16 16:14:14 crc kubenswrapper[5120]: I0316 16:14:14.832849 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-create-khl7k" Mar 16 16:14:14 crc kubenswrapper[5120]: I0316 16:14:14.832846 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-create-h8hbg" Mar 16 16:14:14 crc kubenswrapper[5120]: I0316 16:14:14.887915 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-9s4rw"] Mar 16 16:14:14 crc kubenswrapper[5120]: I0316 16:14:14.894387 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-9s4rw" Mar 16 16:14:14 crc kubenswrapper[5120]: I0316 16:14:14.897899 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-scripts\"" Mar 16 16:14:14 crc kubenswrapper[5120]: I0316 16:14:14.898491 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-config-data\"" Mar 16 16:14:14 crc kubenswrapper[5120]: I0316 16:14:14.898618 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kz8pg\" (UniqueName: \"kubernetes.io/projected/177329dd-879c-4289-a817-04bd6b0d78bb-kube-api-access-kz8pg\") pod \"neutron-9c08-account-create-update-ld8t5\" (UID: \"177329dd-879c-4289-a817-04bd6b0d78bb\") " pod="openstack-kuttl-tests/neutron-9c08-account-create-update-ld8t5" Mar 16 16:14:14 crc kubenswrapper[5120]: I0316 16:14:14.898706 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/4b4c1be7-4f3b-490b-bf6d-89281ddf8c5b-operator-scripts\") pod \"cinder-c034-account-create-update-vtkb4\" (UID: \"4b4c1be7-4f3b-490b-bf6d-89281ddf8c5b\") " pod="openstack-kuttl-tests/cinder-c034-account-create-update-vtkb4" Mar 16 16:14:14 crc kubenswrapper[5120]: I0316 16:14:14.898799 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/177329dd-879c-4289-a817-04bd6b0d78bb-operator-scripts\") pod \"neutron-9c08-account-create-update-ld8t5\" (UID: \"177329dd-879c-4289-a817-04bd6b0d78bb\") " pod="openstack-kuttl-tests/neutron-9c08-account-create-update-ld8t5" Mar 16 16:14:14 crc kubenswrapper[5120]: I0316 16:14:14.898871 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/4cabd00d-52cd-410b-a721-7e6089462d6a-operator-scripts\") pod \"neutron-db-create-cdlpn\" (UID: \"4cabd00d-52cd-410b-a721-7e6089462d6a\") " pod="openstack-kuttl-tests/neutron-db-create-cdlpn" Mar 16 16:14:14 crc kubenswrapper[5120]: I0316 16:14:14.898899 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-9s4rw"] Mar 16 16:14:14 crc kubenswrapper[5120]: I0316 16:14:14.898990 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znrbv\" (UniqueName: \"kubernetes.io/projected/4cabd00d-52cd-410b-a721-7e6089462d6a-kube-api-access-znrbv\") pod \"neutron-db-create-cdlpn\" (UID: \"4cabd00d-52cd-410b-a721-7e6089462d6a\") " pod="openstack-kuttl-tests/neutron-db-create-cdlpn" Mar 16 16:14:14 crc kubenswrapper[5120]: I0316 16:14:14.899158 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pq8dm\" (UniqueName: \"kubernetes.io/projected/4b4c1be7-4f3b-490b-bf6d-89281ddf8c5b-kube-api-access-pq8dm\") pod \"cinder-c034-account-create-update-vtkb4\" (UID: \"4b4c1be7-4f3b-490b-bf6d-89281ddf8c5b\") " pod="openstack-kuttl-tests/cinder-c034-account-create-update-vtkb4" Mar 16 16:14:14 crc kubenswrapper[5120]: I0316 16:14:14.899180 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone\"" Mar 16 16:14:14 crc kubenswrapper[5120]: I0316 16:14:14.898633 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-keystone-dockercfg-96n58\"" Mar 16 16:14:14 crc kubenswrapper[5120]: I0316 16:14:14.899639 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/4b4c1be7-4f3b-490b-bf6d-89281ddf8c5b-operator-scripts\") pod \"cinder-c034-account-create-update-vtkb4\" (UID: \"4b4c1be7-4f3b-490b-bf6d-89281ddf8c5b\") " pod="openstack-kuttl-tests/cinder-c034-account-create-update-vtkb4" Mar 16 16:14:14 crc kubenswrapper[5120]: I0316 16:14:14.930582 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pq8dm\" (UniqueName: \"kubernetes.io/projected/4b4c1be7-4f3b-490b-bf6d-89281ddf8c5b-kube-api-access-pq8dm\") pod \"cinder-c034-account-create-update-vtkb4\" (UID: \"4b4c1be7-4f3b-490b-bf6d-89281ddf8c5b\") " pod="openstack-kuttl-tests/cinder-c034-account-create-update-vtkb4" Mar 16 16:14:14 crc kubenswrapper[5120]: I0316 16:14:14.936464 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-c034-account-create-update-vtkb4" Mar 16 16:14:15 crc kubenswrapper[5120]: I0316 16:14:15.001941 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/4cabd00d-52cd-410b-a721-7e6089462d6a-operator-scripts\") pod \"neutron-db-create-cdlpn\" (UID: \"4cabd00d-52cd-410b-a721-7e6089462d6a\") " pod="openstack-kuttl-tests/neutron-db-create-cdlpn" Mar 16 16:14:15 crc kubenswrapper[5120]: I0316 16:14:15.002042 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5ln8\" (UniqueName: \"kubernetes.io/projected/b3408f9f-4603-417a-b56b-63780924bc68-kube-api-access-f5ln8\") pod \"keystone-db-sync-9s4rw\" (UID: \"b3408f9f-4603-417a-b56b-63780924bc68\") " pod="openstack-kuttl-tests/keystone-db-sync-9s4rw" Mar 16 16:14:15 crc kubenswrapper[5120]: I0316 16:14:15.002065 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/23b70bd1-22f7-49c7-a28e-8972f2e8341d-operator-scripts\") pod \"barbican-db-create-khl7k\" (UID: \"23b70bd1-22f7-49c7-a28e-8972f2e8341d\") " pod="openstack-kuttl-tests/barbican-db-create-khl7k" Mar 16 16:14:15 crc kubenswrapper[5120]: I0316 16:14:15.002087 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-znrbv\" (UniqueName: \"kubernetes.io/projected/4cabd00d-52cd-410b-a721-7e6089462d6a-kube-api-access-znrbv\") pod \"neutron-db-create-cdlpn\" (UID: \"4cabd00d-52cd-410b-a721-7e6089462d6a\") " pod="openstack-kuttl-tests/neutron-db-create-cdlpn" Mar 16 16:14:15 crc kubenswrapper[5120]: I0316 16:14:15.002198 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdl6g\" (UniqueName: \"kubernetes.io/projected/23b70bd1-22f7-49c7-a28e-8972f2e8341d-kube-api-access-mdl6g\") pod \"barbican-db-create-khl7k\" (UID: \"23b70bd1-22f7-49c7-a28e-8972f2e8341d\") " pod="openstack-kuttl-tests/barbican-db-create-khl7k" Mar 16 16:14:15 crc kubenswrapper[5120]: I0316 16:14:15.002218 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b3408f9f-4603-417a-b56b-63780924bc68-combined-ca-bundle\") pod \"keystone-db-sync-9s4rw\" (UID: \"b3408f9f-4603-417a-b56b-63780924bc68\") " pod="openstack-kuttl-tests/keystone-db-sync-9s4rw" Mar 16 16:14:15 crc kubenswrapper[5120]: I0316 16:14:15.002254 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kz8pg\" (UniqueName: \"kubernetes.io/projected/177329dd-879c-4289-a817-04bd6b0d78bb-kube-api-access-kz8pg\") pod \"neutron-9c08-account-create-update-ld8t5\" (UID: \"177329dd-879c-4289-a817-04bd6b0d78bb\") " pod="openstack-kuttl-tests/neutron-9c08-account-create-update-ld8t5" Mar 16 16:14:15 crc kubenswrapper[5120]: I0316 16:14:15.002285 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b3408f9f-4603-417a-b56b-63780924bc68-config-data\") pod \"keystone-db-sync-9s4rw\" (UID: \"b3408f9f-4603-417a-b56b-63780924bc68\") " pod="openstack-kuttl-tests/keystone-db-sync-9s4rw" Mar 16 16:14:15 crc kubenswrapper[5120]: I0316 16:14:15.002335 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/177329dd-879c-4289-a817-04bd6b0d78bb-operator-scripts\") pod \"neutron-9c08-account-create-update-ld8t5\" (UID: \"177329dd-879c-4289-a817-04bd6b0d78bb\") " pod="openstack-kuttl-tests/neutron-9c08-account-create-update-ld8t5" Mar 16 16:14:15 crc kubenswrapper[5120]: I0316 16:14:15.003077 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/177329dd-879c-4289-a817-04bd6b0d78bb-operator-scripts\") pod \"neutron-9c08-account-create-update-ld8t5\" (UID: \"177329dd-879c-4289-a817-04bd6b0d78bb\") " pod="openstack-kuttl-tests/neutron-9c08-account-create-update-ld8t5" Mar 16 16:14:15 crc kubenswrapper[5120]: I0316 16:14:15.003540 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/4cabd00d-52cd-410b-a721-7e6089462d6a-operator-scripts\") pod \"neutron-db-create-cdlpn\" (UID: \"4cabd00d-52cd-410b-a721-7e6089462d6a\") " pod="openstack-kuttl-tests/neutron-db-create-cdlpn" Mar 16 16:14:15 crc kubenswrapper[5120]: I0316 16:14:15.017740 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-39eb-account-create-update-qbcgq"] Mar 16 16:14:15 crc kubenswrapper[5120]: I0316 16:14:15.026342 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-znrbv\" (UniqueName: \"kubernetes.io/projected/4cabd00d-52cd-410b-a721-7e6089462d6a-kube-api-access-znrbv\") pod \"neutron-db-create-cdlpn\" (UID: \"4cabd00d-52cd-410b-a721-7e6089462d6a\") " pod="openstack-kuttl-tests/neutron-db-create-cdlpn" Mar 16 16:14:15 crc kubenswrapper[5120]: I0316 16:14:15.029587 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kz8pg\" (UniqueName: \"kubernetes.io/projected/177329dd-879c-4289-a817-04bd6b0d78bb-kube-api-access-kz8pg\") pod \"neutron-9c08-account-create-update-ld8t5\" (UID: \"177329dd-879c-4289-a817-04bd6b0d78bb\") " pod="openstack-kuttl-tests/neutron-9c08-account-create-update-ld8t5" Mar 16 16:14:15 crc kubenswrapper[5120]: I0316 16:14:15.034364 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-39eb-account-create-update-qbcgq"] Mar 16 16:14:15 crc kubenswrapper[5120]: I0316 16:14:15.034511 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-39eb-account-create-update-qbcgq" Mar 16 16:14:15 crc kubenswrapper[5120]: I0316 16:14:15.039180 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-db-secret\"" Mar 16 16:14:15 crc kubenswrapper[5120]: I0316 16:14:15.059994 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-create-cdlpn" Mar 16 16:14:15 crc kubenswrapper[5120]: I0316 16:14:15.075144 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-9c08-account-create-update-ld8t5" Mar 16 16:14:15 crc kubenswrapper[5120]: I0316 16:14:15.104114 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mdl6g\" (UniqueName: \"kubernetes.io/projected/23b70bd1-22f7-49c7-a28e-8972f2e8341d-kube-api-access-mdl6g\") pod \"barbican-db-create-khl7k\" (UID: \"23b70bd1-22f7-49c7-a28e-8972f2e8341d\") " pod="openstack-kuttl-tests/barbican-db-create-khl7k" Mar 16 16:14:15 crc kubenswrapper[5120]: I0316 16:14:15.104156 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b3408f9f-4603-417a-b56b-63780924bc68-combined-ca-bundle\") pod \"keystone-db-sync-9s4rw\" (UID: \"b3408f9f-4603-417a-b56b-63780924bc68\") " pod="openstack-kuttl-tests/keystone-db-sync-9s4rw" Mar 16 16:14:15 crc kubenswrapper[5120]: I0316 16:14:15.104194 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b3408f9f-4603-417a-b56b-63780924bc68-config-data\") pod \"keystone-db-sync-9s4rw\" (UID: \"b3408f9f-4603-417a-b56b-63780924bc68\") " pod="openstack-kuttl-tests/keystone-db-sync-9s4rw" Mar 16 16:14:15 crc kubenswrapper[5120]: I0316 16:14:15.104298 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f5ln8\" (UniqueName: \"kubernetes.io/projected/b3408f9f-4603-417a-b56b-63780924bc68-kube-api-access-f5ln8\") pod \"keystone-db-sync-9s4rw\" (UID: \"b3408f9f-4603-417a-b56b-63780924bc68\") " pod="openstack-kuttl-tests/keystone-db-sync-9s4rw" Mar 16 16:14:15 crc kubenswrapper[5120]: I0316 16:14:15.104316 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/23b70bd1-22f7-49c7-a28e-8972f2e8341d-operator-scripts\") pod \"barbican-db-create-khl7k\" (UID: \"23b70bd1-22f7-49c7-a28e-8972f2e8341d\") " pod="openstack-kuttl-tests/barbican-db-create-khl7k" Mar 16 16:14:15 crc kubenswrapper[5120]: I0316 16:14:15.104965 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/23b70bd1-22f7-49c7-a28e-8972f2e8341d-operator-scripts\") pod \"barbican-db-create-khl7k\" (UID: \"23b70bd1-22f7-49c7-a28e-8972f2e8341d\") " pod="openstack-kuttl-tests/barbican-db-create-khl7k" Mar 16 16:14:15 crc kubenswrapper[5120]: I0316 16:14:15.111820 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b3408f9f-4603-417a-b56b-63780924bc68-combined-ca-bundle\") pod \"keystone-db-sync-9s4rw\" (UID: \"b3408f9f-4603-417a-b56b-63780924bc68\") " pod="openstack-kuttl-tests/keystone-db-sync-9s4rw" Mar 16 16:14:15 crc kubenswrapper[5120]: I0316 16:14:15.119948 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b3408f9f-4603-417a-b56b-63780924bc68-config-data\") pod \"keystone-db-sync-9s4rw\" (UID: \"b3408f9f-4603-417a-b56b-63780924bc68\") " pod="openstack-kuttl-tests/keystone-db-sync-9s4rw" Mar 16 16:14:15 crc kubenswrapper[5120]: I0316 16:14:15.130334 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-db-create-h8hbg"] Mar 16 16:14:15 crc kubenswrapper[5120]: I0316 16:14:15.133343 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5ln8\" (UniqueName: \"kubernetes.io/projected/b3408f9f-4603-417a-b56b-63780924bc68-kube-api-access-f5ln8\") pod \"keystone-db-sync-9s4rw\" (UID: \"b3408f9f-4603-417a-b56b-63780924bc68\") " pod="openstack-kuttl-tests/keystone-db-sync-9s4rw" Mar 16 16:14:15 crc kubenswrapper[5120]: I0316 16:14:15.137011 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdl6g\" (UniqueName: \"kubernetes.io/projected/23b70bd1-22f7-49c7-a28e-8972f2e8341d-kube-api-access-mdl6g\") pod \"barbican-db-create-khl7k\" (UID: \"23b70bd1-22f7-49c7-a28e-8972f2e8341d\") " pod="openstack-kuttl-tests/barbican-db-create-khl7k" Mar 16 16:14:15 crc kubenswrapper[5120]: W0316 16:14:15.153933 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod50ebddc2_9233_4354_b102_0c05fb7512df.slice/crio-c6d3ec4f0c5e7a70d55cfa8bf7ce0c994ded5dbc9f76d41e2b86366a70b10ab9 WatchSource:0}: Error finding container c6d3ec4f0c5e7a70d55cfa8bf7ce0c994ded5dbc9f76d41e2b86366a70b10ab9: Status 404 returned error can't find the container with id c6d3ec4f0c5e7a70d55cfa8bf7ce0c994ded5dbc9f76d41e2b86366a70b10ab9 Mar 16 16:14:15 crc kubenswrapper[5120]: I0316 16:14:15.205585 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/43748bda-8aea-4bf9-a3db-178c7e9da885-operator-scripts\") pod \"barbican-39eb-account-create-update-qbcgq\" (UID: \"43748bda-8aea-4bf9-a3db-178c7e9da885\") " pod="openstack-kuttl-tests/barbican-39eb-account-create-update-qbcgq" Mar 16 16:14:15 crc kubenswrapper[5120]: I0316 16:14:15.206058 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6p2f\" (UniqueName: \"kubernetes.io/projected/43748bda-8aea-4bf9-a3db-178c7e9da885-kube-api-access-k6p2f\") pod \"barbican-39eb-account-create-update-qbcgq\" (UID: \"43748bda-8aea-4bf9-a3db-178c7e9da885\") " pod="openstack-kuttl-tests/barbican-39eb-account-create-update-qbcgq" Mar 16 16:14:15 crc kubenswrapper[5120]: I0316 16:14:15.268523 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-create-khl7k" Mar 16 16:14:15 crc kubenswrapper[5120]: I0316 16:14:15.274854 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-9s4rw" Mar 16 16:14:15 crc kubenswrapper[5120]: I0316 16:14:15.309855 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/43748bda-8aea-4bf9-a3db-178c7e9da885-operator-scripts\") pod \"barbican-39eb-account-create-update-qbcgq\" (UID: \"43748bda-8aea-4bf9-a3db-178c7e9da885\") " pod="openstack-kuttl-tests/barbican-39eb-account-create-update-qbcgq" Mar 16 16:14:15 crc kubenswrapper[5120]: I0316 16:14:15.309982 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k6p2f\" (UniqueName: \"kubernetes.io/projected/43748bda-8aea-4bf9-a3db-178c7e9da885-kube-api-access-k6p2f\") pod \"barbican-39eb-account-create-update-qbcgq\" (UID: \"43748bda-8aea-4bf9-a3db-178c7e9da885\") " pod="openstack-kuttl-tests/barbican-39eb-account-create-update-qbcgq" Mar 16 16:14:15 crc kubenswrapper[5120]: I0316 16:14:15.310504 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/43748bda-8aea-4bf9-a3db-178c7e9da885-operator-scripts\") pod \"barbican-39eb-account-create-update-qbcgq\" (UID: \"43748bda-8aea-4bf9-a3db-178c7e9da885\") " pod="openstack-kuttl-tests/barbican-39eb-account-create-update-qbcgq" Mar 16 16:14:15 crc kubenswrapper[5120]: I0316 16:14:15.331082 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6p2f\" (UniqueName: \"kubernetes.io/projected/43748bda-8aea-4bf9-a3db-178c7e9da885-kube-api-access-k6p2f\") pod \"barbican-39eb-account-create-update-qbcgq\" (UID: \"43748bda-8aea-4bf9-a3db-178c7e9da885\") " pod="openstack-kuttl-tests/barbican-39eb-account-create-update-qbcgq" Mar 16 16:14:15 crc kubenswrapper[5120]: I0316 16:14:15.353255 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-39eb-account-create-update-qbcgq" Mar 16 16:14:15 crc kubenswrapper[5120]: I0316 16:14:15.408617 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-db-create-cdlpn"] Mar 16 16:14:15 crc kubenswrapper[5120]: I0316 16:14:15.512602 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-c034-account-create-update-vtkb4"] Mar 16 16:14:15 crc kubenswrapper[5120]: I0316 16:14:15.665341 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-9c08-account-create-update-ld8t5"] Mar 16 16:14:15 crc kubenswrapper[5120]: I0316 16:14:15.811688 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-db-create-khl7k"] Mar 16 16:14:15 crc kubenswrapper[5120]: W0316 16:14:15.822626 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod23b70bd1_22f7_49c7_a28e_8972f2e8341d.slice/crio-875780b164e60a563be9cbe019ff62cf5f49e0a19e5dff09150b563a6f94e964 WatchSource:0}: Error finding container 875780b164e60a563be9cbe019ff62cf5f49e0a19e5dff09150b563a6f94e964: Status 404 returned error can't find the container with id 875780b164e60a563be9cbe019ff62cf5f49e0a19e5dff09150b563a6f94e964 Mar 16 16:14:15 crc kubenswrapper[5120]: I0316 16:14:15.930942 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-9s4rw"] Mar 16 16:14:15 crc kubenswrapper[5120]: I0316 16:14:15.937672 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-39eb-account-create-update-qbcgq"] Mar 16 16:14:15 crc kubenswrapper[5120]: W0316 16:14:15.947768 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod43748bda_8aea_4bf9_a3db_178c7e9da885.slice/crio-ce6b4f90e48d34a4cf35842c38b57b6230177dd9ffb05faf64560b6276daf0ff WatchSource:0}: Error finding container ce6b4f90e48d34a4cf35842c38b57b6230177dd9ffb05faf64560b6276daf0ff: Status 404 returned error can't find the container with id ce6b4f90e48d34a4cf35842c38b57b6230177dd9ffb05faf64560b6276daf0ff Mar 16 16:14:16 crc kubenswrapper[5120]: I0316 16:14:16.055619 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-create-khl7k" event={"ID":"23b70bd1-22f7-49c7-a28e-8972f2e8341d","Type":"ContainerStarted","Data":"fb7014d82f06bd9e0b52f0b04d5b5fff1111af219f9733a27808c78985138c36"} Mar 16 16:14:16 crc kubenswrapper[5120]: I0316 16:14:16.055665 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-create-khl7k" event={"ID":"23b70bd1-22f7-49c7-a28e-8972f2e8341d","Type":"ContainerStarted","Data":"875780b164e60a563be9cbe019ff62cf5f49e0a19e5dff09150b563a6f94e964"} Mar 16 16:14:16 crc kubenswrapper[5120]: I0316 16:14:16.063268 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-39eb-account-create-update-qbcgq" event={"ID":"43748bda-8aea-4bf9-a3db-178c7e9da885","Type":"ContainerStarted","Data":"ce6b4f90e48d34a4cf35842c38b57b6230177dd9ffb05faf64560b6276daf0ff"} Mar 16 16:14:16 crc kubenswrapper[5120]: I0316 16:14:16.066915 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-9c08-account-create-update-ld8t5" event={"ID":"177329dd-879c-4289-a817-04bd6b0d78bb","Type":"ContainerStarted","Data":"f0a969484bc8b33413c7e75bd58fd4957a3d1e7b4f67181477315ecdf371d498"} Mar 16 16:14:16 crc kubenswrapper[5120]: I0316 16:14:16.066958 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-9c08-account-create-update-ld8t5" event={"ID":"177329dd-879c-4289-a817-04bd6b0d78bb","Type":"ContainerStarted","Data":"9b7f94d5128fa985a12477bb4f64a0cf100615eb6460561b5250cd03a27c1c5e"} Mar 16 16:14:16 crc kubenswrapper[5120]: I0316 16:14:16.068495 5120 generic.go:358] "Generic (PLEG): container finished" podID="4b4c1be7-4f3b-490b-bf6d-89281ddf8c5b" containerID="2b298e703ea76c468bcf7fbe09cc4b1d04236ee47d6af12a4a7e9a34e4e507e6" exitCode=0 Mar 16 16:14:16 crc kubenswrapper[5120]: I0316 16:14:16.068571 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-c034-account-create-update-vtkb4" event={"ID":"4b4c1be7-4f3b-490b-bf6d-89281ddf8c5b","Type":"ContainerDied","Data":"2b298e703ea76c468bcf7fbe09cc4b1d04236ee47d6af12a4a7e9a34e4e507e6"} Mar 16 16:14:16 crc kubenswrapper[5120]: I0316 16:14:16.068588 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-c034-account-create-update-vtkb4" event={"ID":"4b4c1be7-4f3b-490b-bf6d-89281ddf8c5b","Type":"ContainerStarted","Data":"5bf9d7c7b08539cb36683a16b99e950d4c46d50babc1b49e1d0c8dfc2b7959d1"} Mar 16 16:14:16 crc kubenswrapper[5120]: I0316 16:14:16.069710 5120 generic.go:358] "Generic (PLEG): container finished" podID="4cabd00d-52cd-410b-a721-7e6089462d6a" containerID="d9c76aa340d603643bb917bbd7c06fa96f405666621b213aa3daae966a23d7af" exitCode=0 Mar 16 16:14:16 crc kubenswrapper[5120]: I0316 16:14:16.069780 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-create-cdlpn" event={"ID":"4cabd00d-52cd-410b-a721-7e6089462d6a","Type":"ContainerDied","Data":"d9c76aa340d603643bb917bbd7c06fa96f405666621b213aa3daae966a23d7af"} Mar 16 16:14:16 crc kubenswrapper[5120]: I0316 16:14:16.069795 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-create-cdlpn" event={"ID":"4cabd00d-52cd-410b-a721-7e6089462d6a","Type":"ContainerStarted","Data":"3596fdbe3ef1ed87910defb4ed508bb5ace2ef0e00edbb58101857045c3eba23"} Mar 16 16:14:16 crc kubenswrapper[5120]: I0316 16:14:16.070552 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-9s4rw" event={"ID":"b3408f9f-4603-417a-b56b-63780924bc68","Type":"ContainerStarted","Data":"7fc9399df7034ff7906ca89683f2ecc0529cdde2fc7d7636582d83324a337b96"} Mar 16 16:14:16 crc kubenswrapper[5120]: I0316 16:14:16.071733 5120 generic.go:358] "Generic (PLEG): container finished" podID="50ebddc2-9233-4354-b102-0c05fb7512df" containerID="048ccc5a474f0a74102ffc356a269aaf83381c4a545e56c632aa7d6fab8611af" exitCode=0 Mar 16 16:14:16 crc kubenswrapper[5120]: I0316 16:14:16.071798 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-create-h8hbg" event={"ID":"50ebddc2-9233-4354-b102-0c05fb7512df","Type":"ContainerDied","Data":"048ccc5a474f0a74102ffc356a269aaf83381c4a545e56c632aa7d6fab8611af"} Mar 16 16:14:16 crc kubenswrapper[5120]: I0316 16:14:16.071818 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-create-h8hbg" event={"ID":"50ebddc2-9233-4354-b102-0c05fb7512df","Type":"ContainerStarted","Data":"c6d3ec4f0c5e7a70d55cfa8bf7ce0c994ded5dbc9f76d41e2b86366a70b10ab9"} Mar 16 16:14:16 crc kubenswrapper[5120]: I0316 16:14:16.077521 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-db-create-khl7k" podStartSLOduration=2.077505441 podStartE2EDuration="2.077505441s" podCreationTimestamp="2026-03-16 16:14:14 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:14:16.071446728 +0000 UTC m=+2558.225378385" watchObservedRunningTime="2026-03-16 16:14:16.077505441 +0000 UTC m=+2558.231437098" Mar 16 16:14:16 crc kubenswrapper[5120]: I0316 16:14:16.134713 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-9c08-account-create-update-ld8t5" podStartSLOduration=2.134695654 podStartE2EDuration="2.134695654s" podCreationTimestamp="2026-03-16 16:14:14 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:14:16.129516635 +0000 UTC m=+2558.283448292" watchObservedRunningTime="2026-03-16 16:14:16.134695654 +0000 UTC m=+2558.288627311" Mar 16 16:14:17 crc kubenswrapper[5120]: I0316 16:14:17.084796 5120 generic.go:358] "Generic (PLEG): container finished" podID="177329dd-879c-4289-a817-04bd6b0d78bb" containerID="f0a969484bc8b33413c7e75bd58fd4957a3d1e7b4f67181477315ecdf371d498" exitCode=0 Mar 16 16:14:17 crc kubenswrapper[5120]: I0316 16:14:17.084840 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-9c08-account-create-update-ld8t5" event={"ID":"177329dd-879c-4289-a817-04bd6b0d78bb","Type":"ContainerDied","Data":"f0a969484bc8b33413c7e75bd58fd4957a3d1e7b4f67181477315ecdf371d498"} Mar 16 16:14:17 crc kubenswrapper[5120]: I0316 16:14:17.087812 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-9s4rw" event={"ID":"b3408f9f-4603-417a-b56b-63780924bc68","Type":"ContainerStarted","Data":"019cbe9266c3e626b838cf930352f422ad0940ce877d1a1360b500c0918fa709"} Mar 16 16:14:17 crc kubenswrapper[5120]: I0316 16:14:17.089863 5120 generic.go:358] "Generic (PLEG): container finished" podID="23b70bd1-22f7-49c7-a28e-8972f2e8341d" containerID="fb7014d82f06bd9e0b52f0b04d5b5fff1111af219f9733a27808c78985138c36" exitCode=0 Mar 16 16:14:17 crc kubenswrapper[5120]: I0316 16:14:17.089901 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-create-khl7k" event={"ID":"23b70bd1-22f7-49c7-a28e-8972f2e8341d","Type":"ContainerDied","Data":"fb7014d82f06bd9e0b52f0b04d5b5fff1111af219f9733a27808c78985138c36"} Mar 16 16:14:17 crc kubenswrapper[5120]: I0316 16:14:17.092387 5120 generic.go:358] "Generic (PLEG): container finished" podID="43748bda-8aea-4bf9-a3db-178c7e9da885" containerID="682b0a5848aef122872540d289a695e1f370fadbcc7c61bef2d31ebc83439a1c" exitCode=0 Mar 16 16:14:17 crc kubenswrapper[5120]: I0316 16:14:17.092595 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-39eb-account-create-update-qbcgq" event={"ID":"43748bda-8aea-4bf9-a3db-178c7e9da885","Type":"ContainerDied","Data":"682b0a5848aef122872540d289a695e1f370fadbcc7c61bef2d31ebc83439a1c"} Mar 16 16:14:17 crc kubenswrapper[5120]: I0316 16:14:17.162922 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-db-sync-9s4rw" podStartSLOduration=3.162896639 podStartE2EDuration="3.162896639s" podCreationTimestamp="2026-03-16 16:14:14 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:14:17.137187951 +0000 UTC m=+2559.291119608" watchObservedRunningTime="2026-03-16 16:14:17.162896639 +0000 UTC m=+2559.316828296" Mar 16 16:14:17 crc kubenswrapper[5120]: I0316 16:14:17.513422 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-create-cdlpn" Mar 16 16:14:17 crc kubenswrapper[5120]: I0316 16:14:17.596986 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-c034-account-create-update-vtkb4" Mar 16 16:14:17 crc kubenswrapper[5120]: I0316 16:14:17.603253 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-create-h8hbg" Mar 16 16:14:17 crc kubenswrapper[5120]: I0316 16:14:17.675980 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/4cabd00d-52cd-410b-a721-7e6089462d6a-operator-scripts\") pod \"4cabd00d-52cd-410b-a721-7e6089462d6a\" (UID: \"4cabd00d-52cd-410b-a721-7e6089462d6a\") " Mar 16 16:14:17 crc kubenswrapper[5120]: I0316 16:14:17.676273 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-znrbv\" (UniqueName: \"kubernetes.io/projected/4cabd00d-52cd-410b-a721-7e6089462d6a-kube-api-access-znrbv\") pod \"4cabd00d-52cd-410b-a721-7e6089462d6a\" (UID: \"4cabd00d-52cd-410b-a721-7e6089462d6a\") " Mar 16 16:14:17 crc kubenswrapper[5120]: I0316 16:14:17.677459 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4cabd00d-52cd-410b-a721-7e6089462d6a-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "4cabd00d-52cd-410b-a721-7e6089462d6a" (UID: "4cabd00d-52cd-410b-a721-7e6089462d6a"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:14:17 crc kubenswrapper[5120]: I0316 16:14:17.683721 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4cabd00d-52cd-410b-a721-7e6089462d6a-kube-api-access-znrbv" (OuterVolumeSpecName: "kube-api-access-znrbv") pod "4cabd00d-52cd-410b-a721-7e6089462d6a" (UID: "4cabd00d-52cd-410b-a721-7e6089462d6a"). InnerVolumeSpecName "kube-api-access-znrbv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:14:17 crc kubenswrapper[5120]: I0316 16:14:17.778127 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/50ebddc2-9233-4354-b102-0c05fb7512df-operator-scripts\") pod \"50ebddc2-9233-4354-b102-0c05fb7512df\" (UID: \"50ebddc2-9233-4354-b102-0c05fb7512df\") " Mar 16 16:14:17 crc kubenswrapper[5120]: I0316 16:14:17.778584 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/4b4c1be7-4f3b-490b-bf6d-89281ddf8c5b-operator-scripts\") pod \"4b4c1be7-4f3b-490b-bf6d-89281ddf8c5b\" (UID: \"4b4c1be7-4f3b-490b-bf6d-89281ddf8c5b\") " Mar 16 16:14:17 crc kubenswrapper[5120]: I0316 16:14:17.778672 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50ebddc2-9233-4354-b102-0c05fb7512df-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "50ebddc2-9233-4354-b102-0c05fb7512df" (UID: "50ebddc2-9233-4354-b102-0c05fb7512df"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:14:17 crc kubenswrapper[5120]: I0316 16:14:17.778682 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pq8dm\" (UniqueName: \"kubernetes.io/projected/4b4c1be7-4f3b-490b-bf6d-89281ddf8c5b-kube-api-access-pq8dm\") pod \"4b4c1be7-4f3b-490b-bf6d-89281ddf8c5b\" (UID: \"4b4c1be7-4f3b-490b-bf6d-89281ddf8c5b\") " Mar 16 16:14:17 crc kubenswrapper[5120]: I0316 16:14:17.778864 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tqcdk\" (UniqueName: \"kubernetes.io/projected/50ebddc2-9233-4354-b102-0c05fb7512df-kube-api-access-tqcdk\") pod \"50ebddc2-9233-4354-b102-0c05fb7512df\" (UID: \"50ebddc2-9233-4354-b102-0c05fb7512df\") " Mar 16 16:14:17 crc kubenswrapper[5120]: I0316 16:14:17.779323 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b4c1be7-4f3b-490b-bf6d-89281ddf8c5b-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "4b4c1be7-4f3b-490b-bf6d-89281ddf8c5b" (UID: "4b4c1be7-4f3b-490b-bf6d-89281ddf8c5b"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:14:17 crc kubenswrapper[5120]: I0316 16:14:17.779912 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/4cabd00d-52cd-410b-a721-7e6089462d6a-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:14:17 crc kubenswrapper[5120]: I0316 16:14:17.780003 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/4b4c1be7-4f3b-490b-bf6d-89281ddf8c5b-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:14:17 crc kubenswrapper[5120]: I0316 16:14:17.780076 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-znrbv\" (UniqueName: \"kubernetes.io/projected/4cabd00d-52cd-410b-a721-7e6089462d6a-kube-api-access-znrbv\") on node \"crc\" DevicePath \"\"" Mar 16 16:14:17 crc kubenswrapper[5120]: I0316 16:14:17.780144 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/50ebddc2-9233-4354-b102-0c05fb7512df-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:14:17 crc kubenswrapper[5120]: I0316 16:14:17.782353 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50ebddc2-9233-4354-b102-0c05fb7512df-kube-api-access-tqcdk" (OuterVolumeSpecName: "kube-api-access-tqcdk") pod "50ebddc2-9233-4354-b102-0c05fb7512df" (UID: "50ebddc2-9233-4354-b102-0c05fb7512df"). InnerVolumeSpecName "kube-api-access-tqcdk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:14:17 crc kubenswrapper[5120]: I0316 16:14:17.782958 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b4c1be7-4f3b-490b-bf6d-89281ddf8c5b-kube-api-access-pq8dm" (OuterVolumeSpecName: "kube-api-access-pq8dm") pod "4b4c1be7-4f3b-490b-bf6d-89281ddf8c5b" (UID: "4b4c1be7-4f3b-490b-bf6d-89281ddf8c5b"). InnerVolumeSpecName "kube-api-access-pq8dm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:14:17 crc kubenswrapper[5120]: I0316 16:14:17.882667 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pq8dm\" (UniqueName: \"kubernetes.io/projected/4b4c1be7-4f3b-490b-bf6d-89281ddf8c5b-kube-api-access-pq8dm\") on node \"crc\" DevicePath \"\"" Mar 16 16:14:17 crc kubenswrapper[5120]: I0316 16:14:17.883139 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tqcdk\" (UniqueName: \"kubernetes.io/projected/50ebddc2-9233-4354-b102-0c05fb7512df-kube-api-access-tqcdk\") on node \"crc\" DevicePath \"\"" Mar 16 16:14:18 crc kubenswrapper[5120]: I0316 16:14:18.108941 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-c034-account-create-update-vtkb4" event={"ID":"4b4c1be7-4f3b-490b-bf6d-89281ddf8c5b","Type":"ContainerDied","Data":"5bf9d7c7b08539cb36683a16b99e950d4c46d50babc1b49e1d0c8dfc2b7959d1"} Mar 16 16:14:18 crc kubenswrapper[5120]: I0316 16:14:18.109025 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5bf9d7c7b08539cb36683a16b99e950d4c46d50babc1b49e1d0c8dfc2b7959d1" Mar 16 16:14:18 crc kubenswrapper[5120]: I0316 16:14:18.108977 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-c034-account-create-update-vtkb4" Mar 16 16:14:18 crc kubenswrapper[5120]: I0316 16:14:18.112624 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-create-cdlpn" Mar 16 16:14:18 crc kubenswrapper[5120]: I0316 16:14:18.112630 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-create-cdlpn" event={"ID":"4cabd00d-52cd-410b-a721-7e6089462d6a","Type":"ContainerDied","Data":"3596fdbe3ef1ed87910defb4ed508bb5ace2ef0e00edbb58101857045c3eba23"} Mar 16 16:14:18 crc kubenswrapper[5120]: I0316 16:14:18.112737 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3596fdbe3ef1ed87910defb4ed508bb5ace2ef0e00edbb58101857045c3eba23" Mar 16 16:14:18 crc kubenswrapper[5120]: I0316 16:14:18.116580 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-create-h8hbg" Mar 16 16:14:18 crc kubenswrapper[5120]: I0316 16:14:18.116663 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-create-h8hbg" event={"ID":"50ebddc2-9233-4354-b102-0c05fb7512df","Type":"ContainerDied","Data":"c6d3ec4f0c5e7a70d55cfa8bf7ce0c994ded5dbc9f76d41e2b86366a70b10ab9"} Mar 16 16:14:18 crc kubenswrapper[5120]: I0316 16:14:18.116729 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c6d3ec4f0c5e7a70d55cfa8bf7ce0c994ded5dbc9f76d41e2b86366a70b10ab9" Mar 16 16:14:18 crc kubenswrapper[5120]: I0316 16:14:18.407351 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-9c08-account-create-update-ld8t5" Mar 16 16:14:18 crc kubenswrapper[5120]: I0316 16:14:18.496864 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kz8pg\" (UniqueName: \"kubernetes.io/projected/177329dd-879c-4289-a817-04bd6b0d78bb-kube-api-access-kz8pg\") pod \"177329dd-879c-4289-a817-04bd6b0d78bb\" (UID: \"177329dd-879c-4289-a817-04bd6b0d78bb\") " Mar 16 16:14:18 crc kubenswrapper[5120]: I0316 16:14:18.497421 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/177329dd-879c-4289-a817-04bd6b0d78bb-operator-scripts\") pod \"177329dd-879c-4289-a817-04bd6b0d78bb\" (UID: \"177329dd-879c-4289-a817-04bd6b0d78bb\") " Mar 16 16:14:18 crc kubenswrapper[5120]: I0316 16:14:18.498015 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/177329dd-879c-4289-a817-04bd6b0d78bb-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "177329dd-879c-4289-a817-04bd6b0d78bb" (UID: "177329dd-879c-4289-a817-04bd6b0d78bb"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:14:18 crc kubenswrapper[5120]: I0316 16:14:18.512108 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/177329dd-879c-4289-a817-04bd6b0d78bb-kube-api-access-kz8pg" (OuterVolumeSpecName: "kube-api-access-kz8pg") pod "177329dd-879c-4289-a817-04bd6b0d78bb" (UID: "177329dd-879c-4289-a817-04bd6b0d78bb"). InnerVolumeSpecName "kube-api-access-kz8pg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:14:18 crc kubenswrapper[5120]: I0316 16:14:18.599655 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/177329dd-879c-4289-a817-04bd6b0d78bb-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:14:18 crc kubenswrapper[5120]: I0316 16:14:18.599691 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kz8pg\" (UniqueName: \"kubernetes.io/projected/177329dd-879c-4289-a817-04bd6b0d78bb-kube-api-access-kz8pg\") on node \"crc\" DevicePath \"\"" Mar 16 16:14:18 crc kubenswrapper[5120]: I0316 16:14:18.672017 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-39eb-account-create-update-qbcgq" Mar 16 16:14:18 crc kubenswrapper[5120]: I0316 16:14:18.680544 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-create-khl7k" Mar 16 16:14:18 crc kubenswrapper[5120]: I0316 16:14:18.701170 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/23b70bd1-22f7-49c7-a28e-8972f2e8341d-operator-scripts\") pod \"23b70bd1-22f7-49c7-a28e-8972f2e8341d\" (UID: \"23b70bd1-22f7-49c7-a28e-8972f2e8341d\") " Mar 16 16:14:18 crc kubenswrapper[5120]: I0316 16:14:18.701663 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k6p2f\" (UniqueName: \"kubernetes.io/projected/43748bda-8aea-4bf9-a3db-178c7e9da885-kube-api-access-k6p2f\") pod \"43748bda-8aea-4bf9-a3db-178c7e9da885\" (UID: \"43748bda-8aea-4bf9-a3db-178c7e9da885\") " Mar 16 16:14:18 crc kubenswrapper[5120]: I0316 16:14:18.703530 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mdl6g\" (UniqueName: \"kubernetes.io/projected/23b70bd1-22f7-49c7-a28e-8972f2e8341d-kube-api-access-mdl6g\") pod \"23b70bd1-22f7-49c7-a28e-8972f2e8341d\" (UID: \"23b70bd1-22f7-49c7-a28e-8972f2e8341d\") " Mar 16 16:14:18 crc kubenswrapper[5120]: I0316 16:14:18.703606 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/43748bda-8aea-4bf9-a3db-178c7e9da885-operator-scripts\") pod \"43748bda-8aea-4bf9-a3db-178c7e9da885\" (UID: \"43748bda-8aea-4bf9-a3db-178c7e9da885\") " Mar 16 16:14:18 crc kubenswrapper[5120]: I0316 16:14:18.709004 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/23b70bd1-22f7-49c7-a28e-8972f2e8341d-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "23b70bd1-22f7-49c7-a28e-8972f2e8341d" (UID: "23b70bd1-22f7-49c7-a28e-8972f2e8341d"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:14:18 crc kubenswrapper[5120]: I0316 16:14:18.709032 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/43748bda-8aea-4bf9-a3db-178c7e9da885-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "43748bda-8aea-4bf9-a3db-178c7e9da885" (UID: "43748bda-8aea-4bf9-a3db-178c7e9da885"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:14:18 crc kubenswrapper[5120]: I0316 16:14:18.713912 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/43748bda-8aea-4bf9-a3db-178c7e9da885-kube-api-access-k6p2f" (OuterVolumeSpecName: "kube-api-access-k6p2f") pod "43748bda-8aea-4bf9-a3db-178c7e9da885" (UID: "43748bda-8aea-4bf9-a3db-178c7e9da885"). InnerVolumeSpecName "kube-api-access-k6p2f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:14:18 crc kubenswrapper[5120]: I0316 16:14:18.723396 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23b70bd1-22f7-49c7-a28e-8972f2e8341d-kube-api-access-mdl6g" (OuterVolumeSpecName: "kube-api-access-mdl6g") pod "23b70bd1-22f7-49c7-a28e-8972f2e8341d" (UID: "23b70bd1-22f7-49c7-a28e-8972f2e8341d"). InnerVolumeSpecName "kube-api-access-mdl6g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:14:18 crc kubenswrapper[5120]: I0316 16:14:18.806246 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/23b70bd1-22f7-49c7-a28e-8972f2e8341d-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:14:18 crc kubenswrapper[5120]: I0316 16:14:18.806274 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k6p2f\" (UniqueName: \"kubernetes.io/projected/43748bda-8aea-4bf9-a3db-178c7e9da885-kube-api-access-k6p2f\") on node \"crc\" DevicePath \"\"" Mar 16 16:14:18 crc kubenswrapper[5120]: I0316 16:14:18.806284 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mdl6g\" (UniqueName: \"kubernetes.io/projected/23b70bd1-22f7-49c7-a28e-8972f2e8341d-kube-api-access-mdl6g\") on node \"crc\" DevicePath \"\"" Mar 16 16:14:18 crc kubenswrapper[5120]: I0316 16:14:18.806295 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/43748bda-8aea-4bf9-a3db-178c7e9da885-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:14:19 crc kubenswrapper[5120]: I0316 16:14:19.131378 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-9c08-account-create-update-ld8t5" Mar 16 16:14:19 crc kubenswrapper[5120]: I0316 16:14:19.131426 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-9c08-account-create-update-ld8t5" event={"ID":"177329dd-879c-4289-a817-04bd6b0d78bb","Type":"ContainerDied","Data":"9b7f94d5128fa985a12477bb4f64a0cf100615eb6460561b5250cd03a27c1c5e"} Mar 16 16:14:19 crc kubenswrapper[5120]: I0316 16:14:19.131487 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9b7f94d5128fa985a12477bb4f64a0cf100615eb6460561b5250cd03a27c1c5e" Mar 16 16:14:19 crc kubenswrapper[5120]: I0316 16:14:19.134207 5120 generic.go:358] "Generic (PLEG): container finished" podID="b3408f9f-4603-417a-b56b-63780924bc68" containerID="019cbe9266c3e626b838cf930352f422ad0940ce877d1a1360b500c0918fa709" exitCode=0 Mar 16 16:14:19 crc kubenswrapper[5120]: I0316 16:14:19.134322 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-9s4rw" event={"ID":"b3408f9f-4603-417a-b56b-63780924bc68","Type":"ContainerDied","Data":"019cbe9266c3e626b838cf930352f422ad0940ce877d1a1360b500c0918fa709"} Mar 16 16:14:19 crc kubenswrapper[5120]: I0316 16:14:19.138900 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-create-khl7k" event={"ID":"23b70bd1-22f7-49c7-a28e-8972f2e8341d","Type":"ContainerDied","Data":"875780b164e60a563be9cbe019ff62cf5f49e0a19e5dff09150b563a6f94e964"} Mar 16 16:14:19 crc kubenswrapper[5120]: I0316 16:14:19.139074 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="875780b164e60a563be9cbe019ff62cf5f49e0a19e5dff09150b563a6f94e964" Mar 16 16:14:19 crc kubenswrapper[5120]: I0316 16:14:19.139169 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-create-khl7k" Mar 16 16:14:19 crc kubenswrapper[5120]: I0316 16:14:19.141051 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-39eb-account-create-update-qbcgq" event={"ID":"43748bda-8aea-4bf9-a3db-178c7e9da885","Type":"ContainerDied","Data":"ce6b4f90e48d34a4cf35842c38b57b6230177dd9ffb05faf64560b6276daf0ff"} Mar 16 16:14:19 crc kubenswrapper[5120]: I0316 16:14:19.141094 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ce6b4f90e48d34a4cf35842c38b57b6230177dd9ffb05faf64560b6276daf0ff" Mar 16 16:14:19 crc kubenswrapper[5120]: I0316 16:14:19.141170 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-39eb-account-create-update-qbcgq" Mar 16 16:14:20 crc kubenswrapper[5120]: I0316 16:14:20.572919 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-9s4rw" Mar 16 16:14:20 crc kubenswrapper[5120]: I0316 16:14:20.647405 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f5ln8\" (UniqueName: \"kubernetes.io/projected/b3408f9f-4603-417a-b56b-63780924bc68-kube-api-access-f5ln8\") pod \"b3408f9f-4603-417a-b56b-63780924bc68\" (UID: \"b3408f9f-4603-417a-b56b-63780924bc68\") " Mar 16 16:14:20 crc kubenswrapper[5120]: I0316 16:14:20.647666 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b3408f9f-4603-417a-b56b-63780924bc68-config-data\") pod \"b3408f9f-4603-417a-b56b-63780924bc68\" (UID: \"b3408f9f-4603-417a-b56b-63780924bc68\") " Mar 16 16:14:20 crc kubenswrapper[5120]: I0316 16:14:20.647708 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b3408f9f-4603-417a-b56b-63780924bc68-combined-ca-bundle\") pod \"b3408f9f-4603-417a-b56b-63780924bc68\" (UID: \"b3408f9f-4603-417a-b56b-63780924bc68\") " Mar 16 16:14:20 crc kubenswrapper[5120]: I0316 16:14:20.654643 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3408f9f-4603-417a-b56b-63780924bc68-kube-api-access-f5ln8" (OuterVolumeSpecName: "kube-api-access-f5ln8") pod "b3408f9f-4603-417a-b56b-63780924bc68" (UID: "b3408f9f-4603-417a-b56b-63780924bc68"). InnerVolumeSpecName "kube-api-access-f5ln8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:14:20 crc kubenswrapper[5120]: I0316 16:14:20.673626 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b3408f9f-4603-417a-b56b-63780924bc68-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "b3408f9f-4603-417a-b56b-63780924bc68" (UID: "b3408f9f-4603-417a-b56b-63780924bc68"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:14:20 crc kubenswrapper[5120]: I0316 16:14:20.703979 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b3408f9f-4603-417a-b56b-63780924bc68-config-data" (OuterVolumeSpecName: "config-data") pod "b3408f9f-4603-417a-b56b-63780924bc68" (UID: "b3408f9f-4603-417a-b56b-63780924bc68"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:14:20 crc kubenswrapper[5120]: I0316 16:14:20.749504 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f5ln8\" (UniqueName: \"kubernetes.io/projected/b3408f9f-4603-417a-b56b-63780924bc68-kube-api-access-f5ln8\") on node \"crc\" DevicePath \"\"" Mar 16 16:14:20 crc kubenswrapper[5120]: I0316 16:14:20.749793 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b3408f9f-4603-417a-b56b-63780924bc68-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:14:20 crc kubenswrapper[5120]: I0316 16:14:20.749911 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b3408f9f-4603-417a-b56b-63780924bc68-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:14:21 crc kubenswrapper[5120]: I0316 16:14:21.166768 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-9s4rw" event={"ID":"b3408f9f-4603-417a-b56b-63780924bc68","Type":"ContainerDied","Data":"7fc9399df7034ff7906ca89683f2ecc0529cdde2fc7d7636582d83324a337b96"} Mar 16 16:14:21 crc kubenswrapper[5120]: I0316 16:14:21.166794 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-9s4rw" Mar 16 16:14:21 crc kubenswrapper[5120]: I0316 16:14:21.166811 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7fc9399df7034ff7906ca89683f2ecc0529cdde2fc7d7636582d83324a337b96" Mar 16 16:14:21 crc kubenswrapper[5120]: I0316 16:14:21.436872 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-m4lq5"] Mar 16 16:14:21 crc kubenswrapper[5120]: I0316 16:14:21.438019 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3408f9f-4603-417a-b56b-63780924bc68" containerName="keystone-db-sync" Mar 16 16:14:21 crc kubenswrapper[5120]: I0316 16:14:21.438055 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3408f9f-4603-417a-b56b-63780924bc68" containerName="keystone-db-sync" Mar 16 16:14:21 crc kubenswrapper[5120]: I0316 16:14:21.438082 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23b70bd1-22f7-49c7-a28e-8972f2e8341d" containerName="mariadb-database-create" Mar 16 16:14:21 crc kubenswrapper[5120]: I0316 16:14:21.438093 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="23b70bd1-22f7-49c7-a28e-8972f2e8341d" containerName="mariadb-database-create" Mar 16 16:14:21 crc kubenswrapper[5120]: I0316 16:14:21.438113 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b4c1be7-4f3b-490b-bf6d-89281ddf8c5b" containerName="mariadb-account-create-update" Mar 16 16:14:21 crc kubenswrapper[5120]: I0316 16:14:21.438124 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b4c1be7-4f3b-490b-bf6d-89281ddf8c5b" containerName="mariadb-account-create-update" Mar 16 16:14:21 crc kubenswrapper[5120]: I0316 16:14:21.438139 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50ebddc2-9233-4354-b102-0c05fb7512df" containerName="mariadb-database-create" Mar 16 16:14:21 crc kubenswrapper[5120]: I0316 16:14:21.438149 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="50ebddc2-9233-4354-b102-0c05fb7512df" containerName="mariadb-database-create" Mar 16 16:14:21 crc kubenswrapper[5120]: I0316 16:14:21.438163 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="177329dd-879c-4289-a817-04bd6b0d78bb" containerName="mariadb-account-create-update" Mar 16 16:14:21 crc kubenswrapper[5120]: I0316 16:14:21.438173 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="177329dd-879c-4289-a817-04bd6b0d78bb" containerName="mariadb-account-create-update" Mar 16 16:14:21 crc kubenswrapper[5120]: I0316 16:14:21.438187 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43748bda-8aea-4bf9-a3db-178c7e9da885" containerName="mariadb-account-create-update" Mar 16 16:14:21 crc kubenswrapper[5120]: I0316 16:14:21.438194 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="43748bda-8aea-4bf9-a3db-178c7e9da885" containerName="mariadb-account-create-update" Mar 16 16:14:21 crc kubenswrapper[5120]: I0316 16:14:21.438223 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4cabd00d-52cd-410b-a721-7e6089462d6a" containerName="mariadb-database-create" Mar 16 16:14:21 crc kubenswrapper[5120]: I0316 16:14:21.438230 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="4cabd00d-52cd-410b-a721-7e6089462d6a" containerName="mariadb-database-create" Mar 16 16:14:21 crc kubenswrapper[5120]: I0316 16:14:21.438441 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="177329dd-879c-4289-a817-04bd6b0d78bb" containerName="mariadb-account-create-update" Mar 16 16:14:21 crc kubenswrapper[5120]: I0316 16:14:21.438465 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="4cabd00d-52cd-410b-a721-7e6089462d6a" containerName="mariadb-database-create" Mar 16 16:14:21 crc kubenswrapper[5120]: I0316 16:14:21.438474 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="23b70bd1-22f7-49c7-a28e-8972f2e8341d" containerName="mariadb-database-create" Mar 16 16:14:21 crc kubenswrapper[5120]: I0316 16:14:21.438490 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="4b4c1be7-4f3b-490b-bf6d-89281ddf8c5b" containerName="mariadb-account-create-update" Mar 16 16:14:21 crc kubenswrapper[5120]: I0316 16:14:21.438503 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="43748bda-8aea-4bf9-a3db-178c7e9da885" containerName="mariadb-account-create-update" Mar 16 16:14:21 crc kubenswrapper[5120]: I0316 16:14:21.438517 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="50ebddc2-9233-4354-b102-0c05fb7512df" containerName="mariadb-database-create" Mar 16 16:14:21 crc kubenswrapper[5120]: I0316 16:14:21.438530 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="b3408f9f-4603-417a-b56b-63780924bc68" containerName="keystone-db-sync" Mar 16 16:14:21 crc kubenswrapper[5120]: I0316 16:14:21.450448 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-m4lq5"] Mar 16 16:14:21 crc kubenswrapper[5120]: I0316 16:14:21.450576 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-m4lq5" Mar 16 16:14:21 crc kubenswrapper[5120]: I0316 16:14:21.456205 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-keystone-dockercfg-96n58\"" Mar 16 16:14:21 crc kubenswrapper[5120]: I0316 16:14:21.456566 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"osp-secret\"" Mar 16 16:14:21 crc kubenswrapper[5120]: I0316 16:14:21.456612 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone\"" Mar 16 16:14:21 crc kubenswrapper[5120]: I0316 16:14:21.456576 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-scripts\"" Mar 16 16:14:21 crc kubenswrapper[5120]: I0316 16:14:21.456616 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-config-data\"" Mar 16 16:14:21 crc kubenswrapper[5120]: I0316 16:14:21.564017 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/67ce2cee-a80e-45e8-978a-b236ef1c8c40-config-data\") pod \"keystone-bootstrap-m4lq5\" (UID: \"67ce2cee-a80e-45e8-978a-b236ef1c8c40\") " pod="openstack-kuttl-tests/keystone-bootstrap-m4lq5" Mar 16 16:14:21 crc kubenswrapper[5120]: I0316 16:14:21.564296 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/67ce2cee-a80e-45e8-978a-b236ef1c8c40-fernet-keys\") pod \"keystone-bootstrap-m4lq5\" (UID: \"67ce2cee-a80e-45e8-978a-b236ef1c8c40\") " pod="openstack-kuttl-tests/keystone-bootstrap-m4lq5" Mar 16 16:14:21 crc kubenswrapper[5120]: I0316 16:14:21.564349 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/67ce2cee-a80e-45e8-978a-b236ef1c8c40-credential-keys\") pod \"keystone-bootstrap-m4lq5\" (UID: \"67ce2cee-a80e-45e8-978a-b236ef1c8c40\") " pod="openstack-kuttl-tests/keystone-bootstrap-m4lq5" Mar 16 16:14:21 crc kubenswrapper[5120]: I0316 16:14:21.564466 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/67ce2cee-a80e-45e8-978a-b236ef1c8c40-combined-ca-bundle\") pod \"keystone-bootstrap-m4lq5\" (UID: \"67ce2cee-a80e-45e8-978a-b236ef1c8c40\") " pod="openstack-kuttl-tests/keystone-bootstrap-m4lq5" Mar 16 16:14:21 crc kubenswrapper[5120]: I0316 16:14:21.564499 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vlqzx\" (UniqueName: \"kubernetes.io/projected/67ce2cee-a80e-45e8-978a-b236ef1c8c40-kube-api-access-vlqzx\") pod \"keystone-bootstrap-m4lq5\" (UID: \"67ce2cee-a80e-45e8-978a-b236ef1c8c40\") " pod="openstack-kuttl-tests/keystone-bootstrap-m4lq5" Mar 16 16:14:21 crc kubenswrapper[5120]: I0316 16:14:21.564543 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/67ce2cee-a80e-45e8-978a-b236ef1c8c40-scripts\") pod \"keystone-bootstrap-m4lq5\" (UID: \"67ce2cee-a80e-45e8-978a-b236ef1c8c40\") " pod="openstack-kuttl-tests/keystone-bootstrap-m4lq5" Mar 16 16:14:21 crc kubenswrapper[5120]: I0316 16:14:21.576262 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:14:21 crc kubenswrapper[5120]: I0316 16:14:21.584133 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:14:21 crc kubenswrapper[5120]: I0316 16:14:21.591478 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 16:14:21 crc kubenswrapper[5120]: I0316 16:14:21.591802 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 16:14:21 crc kubenswrapper[5120]: I0316 16:14:21.645868 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:14:21 crc kubenswrapper[5120]: I0316 16:14:21.666242 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0a87bbbf-8ee3-4693-b9b5-516b2a3b67db-log-httpd\") pod \"ceilometer-0\" (UID: \"0a87bbbf-8ee3-4693-b9b5-516b2a3b67db\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:14:21 crc kubenswrapper[5120]: I0316 16:14:21.666312 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0a87bbbf-8ee3-4693-b9b5-516b2a3b67db-scripts\") pod \"ceilometer-0\" (UID: \"0a87bbbf-8ee3-4693-b9b5-516b2a3b67db\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:14:21 crc kubenswrapper[5120]: I0316 16:14:21.666398 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krn6p\" (UniqueName: \"kubernetes.io/projected/0a87bbbf-8ee3-4693-b9b5-516b2a3b67db-kube-api-access-krn6p\") pod \"ceilometer-0\" (UID: \"0a87bbbf-8ee3-4693-b9b5-516b2a3b67db\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:14:21 crc kubenswrapper[5120]: I0316 16:14:21.666475 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/67ce2cee-a80e-45e8-978a-b236ef1c8c40-fernet-keys\") pod \"keystone-bootstrap-m4lq5\" (UID: \"67ce2cee-a80e-45e8-978a-b236ef1c8c40\") " pod="openstack-kuttl-tests/keystone-bootstrap-m4lq5" Mar 16 16:14:21 crc kubenswrapper[5120]: I0316 16:14:21.666502 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/67ce2cee-a80e-45e8-978a-b236ef1c8c40-credential-keys\") pod \"keystone-bootstrap-m4lq5\" (UID: \"67ce2cee-a80e-45e8-978a-b236ef1c8c40\") " pod="openstack-kuttl-tests/keystone-bootstrap-m4lq5" Mar 16 16:14:21 crc kubenswrapper[5120]: I0316 16:14:21.666577 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0a87bbbf-8ee3-4693-b9b5-516b2a3b67db-config-data\") pod \"ceilometer-0\" (UID: \"0a87bbbf-8ee3-4693-b9b5-516b2a3b67db\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:14:21 crc kubenswrapper[5120]: I0316 16:14:21.666597 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/67ce2cee-a80e-45e8-978a-b236ef1c8c40-combined-ca-bundle\") pod \"keystone-bootstrap-m4lq5\" (UID: \"67ce2cee-a80e-45e8-978a-b236ef1c8c40\") " pod="openstack-kuttl-tests/keystone-bootstrap-m4lq5" Mar 16 16:14:21 crc kubenswrapper[5120]: I0316 16:14:21.666615 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vlqzx\" (UniqueName: \"kubernetes.io/projected/67ce2cee-a80e-45e8-978a-b236ef1c8c40-kube-api-access-vlqzx\") pod \"keystone-bootstrap-m4lq5\" (UID: \"67ce2cee-a80e-45e8-978a-b236ef1c8c40\") " pod="openstack-kuttl-tests/keystone-bootstrap-m4lq5" Mar 16 16:14:21 crc kubenswrapper[5120]: I0316 16:14:21.666650 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/67ce2cee-a80e-45e8-978a-b236ef1c8c40-scripts\") pod \"keystone-bootstrap-m4lq5\" (UID: \"67ce2cee-a80e-45e8-978a-b236ef1c8c40\") " pod="openstack-kuttl-tests/keystone-bootstrap-m4lq5" Mar 16 16:14:21 crc kubenswrapper[5120]: I0316 16:14:21.666691 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/67ce2cee-a80e-45e8-978a-b236ef1c8c40-config-data\") pod \"keystone-bootstrap-m4lq5\" (UID: \"67ce2cee-a80e-45e8-978a-b236ef1c8c40\") " pod="openstack-kuttl-tests/keystone-bootstrap-m4lq5" Mar 16 16:14:21 crc kubenswrapper[5120]: I0316 16:14:21.666715 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/0a87bbbf-8ee3-4693-b9b5-516b2a3b67db-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"0a87bbbf-8ee3-4693-b9b5-516b2a3b67db\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:14:21 crc kubenswrapper[5120]: I0316 16:14:21.666732 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0a87bbbf-8ee3-4693-b9b5-516b2a3b67db-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"0a87bbbf-8ee3-4693-b9b5-516b2a3b67db\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:14:21 crc kubenswrapper[5120]: I0316 16:14:21.666789 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0a87bbbf-8ee3-4693-b9b5-516b2a3b67db-run-httpd\") pod \"ceilometer-0\" (UID: \"0a87bbbf-8ee3-4693-b9b5-516b2a3b67db\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:14:21 crc kubenswrapper[5120]: I0316 16:14:21.671187 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/67ce2cee-a80e-45e8-978a-b236ef1c8c40-credential-keys\") pod \"keystone-bootstrap-m4lq5\" (UID: \"67ce2cee-a80e-45e8-978a-b236ef1c8c40\") " pod="openstack-kuttl-tests/keystone-bootstrap-m4lq5" Mar 16 16:14:21 crc kubenswrapper[5120]: I0316 16:14:21.683349 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/67ce2cee-a80e-45e8-978a-b236ef1c8c40-fernet-keys\") pod \"keystone-bootstrap-m4lq5\" (UID: \"67ce2cee-a80e-45e8-978a-b236ef1c8c40\") " pod="openstack-kuttl-tests/keystone-bootstrap-m4lq5" Mar 16 16:14:21 crc kubenswrapper[5120]: I0316 16:14:21.688494 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/67ce2cee-a80e-45e8-978a-b236ef1c8c40-config-data\") pod \"keystone-bootstrap-m4lq5\" (UID: \"67ce2cee-a80e-45e8-978a-b236ef1c8c40\") " pod="openstack-kuttl-tests/keystone-bootstrap-m4lq5" Mar 16 16:14:21 crc kubenswrapper[5120]: I0316 16:14:21.689325 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/67ce2cee-a80e-45e8-978a-b236ef1c8c40-combined-ca-bundle\") pod \"keystone-bootstrap-m4lq5\" (UID: \"67ce2cee-a80e-45e8-978a-b236ef1c8c40\") " pod="openstack-kuttl-tests/keystone-bootstrap-m4lq5" Mar 16 16:14:21 crc kubenswrapper[5120]: I0316 16:14:21.696116 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/67ce2cee-a80e-45e8-978a-b236ef1c8c40-scripts\") pod \"keystone-bootstrap-m4lq5\" (UID: \"67ce2cee-a80e-45e8-978a-b236ef1c8c40\") " pod="openstack-kuttl-tests/keystone-bootstrap-m4lq5" Mar 16 16:14:21 crc kubenswrapper[5120]: I0316 16:14:21.737366 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vlqzx\" (UniqueName: \"kubernetes.io/projected/67ce2cee-a80e-45e8-978a-b236ef1c8c40-kube-api-access-vlqzx\") pod \"keystone-bootstrap-m4lq5\" (UID: \"67ce2cee-a80e-45e8-978a-b236ef1c8c40\") " pod="openstack-kuttl-tests/keystone-bootstrap-m4lq5" Mar 16 16:14:21 crc kubenswrapper[5120]: I0316 16:14:21.771871 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0a87bbbf-8ee3-4693-b9b5-516b2a3b67db-config-data\") pod \"ceilometer-0\" (UID: \"0a87bbbf-8ee3-4693-b9b5-516b2a3b67db\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:14:21 crc kubenswrapper[5120]: I0316 16:14:21.772433 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/0a87bbbf-8ee3-4693-b9b5-516b2a3b67db-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"0a87bbbf-8ee3-4693-b9b5-516b2a3b67db\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:14:21 crc kubenswrapper[5120]: I0316 16:14:21.772524 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0a87bbbf-8ee3-4693-b9b5-516b2a3b67db-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"0a87bbbf-8ee3-4693-b9b5-516b2a3b67db\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:14:21 crc kubenswrapper[5120]: I0316 16:14:21.772642 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0a87bbbf-8ee3-4693-b9b5-516b2a3b67db-run-httpd\") pod \"ceilometer-0\" (UID: \"0a87bbbf-8ee3-4693-b9b5-516b2a3b67db\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:14:21 crc kubenswrapper[5120]: I0316 16:14:21.772792 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0a87bbbf-8ee3-4693-b9b5-516b2a3b67db-log-httpd\") pod \"ceilometer-0\" (UID: \"0a87bbbf-8ee3-4693-b9b5-516b2a3b67db\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:14:21 crc kubenswrapper[5120]: I0316 16:14:21.772944 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0a87bbbf-8ee3-4693-b9b5-516b2a3b67db-scripts\") pod \"ceilometer-0\" (UID: \"0a87bbbf-8ee3-4693-b9b5-516b2a3b67db\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:14:21 crc kubenswrapper[5120]: I0316 16:14:21.773042 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-krn6p\" (UniqueName: \"kubernetes.io/projected/0a87bbbf-8ee3-4693-b9b5-516b2a3b67db-kube-api-access-krn6p\") pod \"ceilometer-0\" (UID: \"0a87bbbf-8ee3-4693-b9b5-516b2a3b67db\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:14:21 crc kubenswrapper[5120]: I0316 16:14:21.775302 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0a87bbbf-8ee3-4693-b9b5-516b2a3b67db-run-httpd\") pod \"ceilometer-0\" (UID: \"0a87bbbf-8ee3-4693-b9b5-516b2a3b67db\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:14:21 crc kubenswrapper[5120]: I0316 16:14:21.776202 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0a87bbbf-8ee3-4693-b9b5-516b2a3b67db-log-httpd\") pod \"ceilometer-0\" (UID: \"0a87bbbf-8ee3-4693-b9b5-516b2a3b67db\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:14:21 crc kubenswrapper[5120]: I0316 16:14:21.778897 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-9zjx8"] Mar 16 16:14:21 crc kubenswrapper[5120]: I0316 16:14:21.785180 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-m4lq5" Mar 16 16:14:21 crc kubenswrapper[5120]: I0316 16:14:21.790223 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/0a87bbbf-8ee3-4693-b9b5-516b2a3b67db-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"0a87bbbf-8ee3-4693-b9b5-516b2a3b67db\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:14:21 crc kubenswrapper[5120]: I0316 16:14:21.797897 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0a87bbbf-8ee3-4693-b9b5-516b2a3b67db-config-data\") pod \"ceilometer-0\" (UID: \"0a87bbbf-8ee3-4693-b9b5-516b2a3b67db\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:14:21 crc kubenswrapper[5120]: I0316 16:14:21.805748 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0a87bbbf-8ee3-4693-b9b5-516b2a3b67db-scripts\") pod \"ceilometer-0\" (UID: \"0a87bbbf-8ee3-4693-b9b5-516b2a3b67db\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:14:21 crc kubenswrapper[5120]: I0316 16:14:21.813648 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0a87bbbf-8ee3-4693-b9b5-516b2a3b67db-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"0a87bbbf-8ee3-4693-b9b5-516b2a3b67db\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:14:21 crc kubenswrapper[5120]: I0316 16:14:21.830342 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-9zjx8" Mar 16 16:14:21 crc kubenswrapper[5120]: I0316 16:14:21.845718 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-9zjx8"] Mar 16 16:14:21 crc kubenswrapper[5120]: I0316 16:14:21.866898 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-config\"" Mar 16 16:14:21 crc kubenswrapper[5120]: I0316 16:14:21.867282 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-krn6p\" (UniqueName: \"kubernetes.io/projected/0a87bbbf-8ee3-4693-b9b5-516b2a3b67db-kube-api-access-krn6p\") pod \"ceilometer-0\" (UID: \"0a87bbbf-8ee3-4693-b9b5-516b2a3b67db\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:14:21 crc kubenswrapper[5120]: I0316 16:14:21.867466 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-neutron-dockercfg-j74rz\"" Mar 16 16:14:21 crc kubenswrapper[5120]: I0316 16:14:21.867689 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-httpd-config\"" Mar 16 16:14:21 crc kubenswrapper[5120]: I0316 16:14:21.874783 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7ggs\" (UniqueName: \"kubernetes.io/projected/30317636-b1f4-4ee1-950b-6d80a890ef09-kube-api-access-w7ggs\") pod \"neutron-db-sync-9zjx8\" (UID: \"30317636-b1f4-4ee1-950b-6d80a890ef09\") " pod="openstack-kuttl-tests/neutron-db-sync-9zjx8" Mar 16 16:14:21 crc kubenswrapper[5120]: I0316 16:14:21.874930 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/30317636-b1f4-4ee1-950b-6d80a890ef09-config\") pod \"neutron-db-sync-9zjx8\" (UID: \"30317636-b1f4-4ee1-950b-6d80a890ef09\") " pod="openstack-kuttl-tests/neutron-db-sync-9zjx8" Mar 16 16:14:21 crc kubenswrapper[5120]: I0316 16:14:21.875023 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/30317636-b1f4-4ee1-950b-6d80a890ef09-combined-ca-bundle\") pod \"neutron-db-sync-9zjx8\" (UID: \"30317636-b1f4-4ee1-950b-6d80a890ef09\") " pod="openstack-kuttl-tests/neutron-db-sync-9zjx8" Mar 16 16:14:21 crc kubenswrapper[5120]: I0316 16:14:21.898293 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:14:21 crc kubenswrapper[5120]: I0316 16:14:21.913966 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-db-sync-zx6s6"] Mar 16 16:14:21 crc kubenswrapper[5120]: I0316 16:14:21.921973 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-zx6s6" Mar 16 16:14:21 crc kubenswrapper[5120]: I0316 16:14:21.932554 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-scripts\"" Mar 16 16:14:21 crc kubenswrapper[5120]: I0316 16:14:21.932624 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-config-data\"" Mar 16 16:14:21 crc kubenswrapper[5120]: I0316 16:14:21.932950 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-placement-dockercfg-pxgj6\"" Mar 16 16:14:21 crc kubenswrapper[5120]: I0316 16:14:21.941952 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-dfhwx"] Mar 16 16:14:21 crc kubenswrapper[5120]: I0316 16:14:21.976778 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/30317636-b1f4-4ee1-950b-6d80a890ef09-config\") pod \"neutron-db-sync-9zjx8\" (UID: \"30317636-b1f4-4ee1-950b-6d80a890ef09\") " pod="openstack-kuttl-tests/neutron-db-sync-9zjx8" Mar 16 16:14:21 crc kubenswrapper[5120]: I0316 16:14:21.976803 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-dfhwx" Mar 16 16:14:21 crc kubenswrapper[5120]: I0316 16:14:21.976848 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b9228df3-a073-46d0-9eb2-345a0bef33a7-combined-ca-bundle\") pod \"placement-db-sync-zx6s6\" (UID: \"b9228df3-a073-46d0-9eb2-345a0bef33a7\") " pod="openstack-kuttl-tests/placement-db-sync-zx6s6" Mar 16 16:14:21 crc kubenswrapper[5120]: I0316 16:14:21.976873 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgzzs\" (UniqueName: \"kubernetes.io/projected/b9228df3-a073-46d0-9eb2-345a0bef33a7-kube-api-access-pgzzs\") pod \"placement-db-sync-zx6s6\" (UID: \"b9228df3-a073-46d0-9eb2-345a0bef33a7\") " pod="openstack-kuttl-tests/placement-db-sync-zx6s6" Mar 16 16:14:21 crc kubenswrapper[5120]: I0316 16:14:21.976953 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/30317636-b1f4-4ee1-950b-6d80a890ef09-combined-ca-bundle\") pod \"neutron-db-sync-9zjx8\" (UID: \"30317636-b1f4-4ee1-950b-6d80a890ef09\") " pod="openstack-kuttl-tests/neutron-db-sync-9zjx8" Mar 16 16:14:21 crc kubenswrapper[5120]: I0316 16:14:21.976997 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w7ggs\" (UniqueName: \"kubernetes.io/projected/30317636-b1f4-4ee1-950b-6d80a890ef09-kube-api-access-w7ggs\") pod \"neutron-db-sync-9zjx8\" (UID: \"30317636-b1f4-4ee1-950b-6d80a890ef09\") " pod="openstack-kuttl-tests/neutron-db-sync-9zjx8" Mar 16 16:14:21 crc kubenswrapper[5120]: I0316 16:14:21.977033 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b9228df3-a073-46d0-9eb2-345a0bef33a7-config-data\") pod \"placement-db-sync-zx6s6\" (UID: \"b9228df3-a073-46d0-9eb2-345a0bef33a7\") " pod="openstack-kuttl-tests/placement-db-sync-zx6s6" Mar 16 16:14:21 crc kubenswrapper[5120]: I0316 16:14:21.977048 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b9228df3-a073-46d0-9eb2-345a0bef33a7-logs\") pod \"placement-db-sync-zx6s6\" (UID: \"b9228df3-a073-46d0-9eb2-345a0bef33a7\") " pod="openstack-kuttl-tests/placement-db-sync-zx6s6" Mar 16 16:14:21 crc kubenswrapper[5120]: I0316 16:14:21.977109 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b9228df3-a073-46d0-9eb2-345a0bef33a7-scripts\") pod \"placement-db-sync-zx6s6\" (UID: \"b9228df3-a073-46d0-9eb2-345a0bef33a7\") " pod="openstack-kuttl-tests/placement-db-sync-zx6s6" Mar 16 16:14:21 crc kubenswrapper[5120]: I0316 16:14:21.984204 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-cinder-dockercfg-dsrl5\"" Mar 16 16:14:21 crc kubenswrapper[5120]: I0316 16:14:21.984447 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-scripts\"" Mar 16 16:14:21 crc kubenswrapper[5120]: I0316 16:14:21.986384 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/30317636-b1f4-4ee1-950b-6d80a890ef09-config\") pod \"neutron-db-sync-9zjx8\" (UID: \"30317636-b1f4-4ee1-950b-6d80a890ef09\") " pod="openstack-kuttl-tests/neutron-db-sync-9zjx8" Mar 16 16:14:21 crc kubenswrapper[5120]: I0316 16:14:21.986662 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-config-data\"" Mar 16 16:14:21 crc kubenswrapper[5120]: I0316 16:14:21.991608 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/30317636-b1f4-4ee1-950b-6d80a890ef09-combined-ca-bundle\") pod \"neutron-db-sync-9zjx8\" (UID: \"30317636-b1f4-4ee1-950b-6d80a890ef09\") " pod="openstack-kuttl-tests/neutron-db-sync-9zjx8" Mar 16 16:14:22 crc kubenswrapper[5120]: I0316 16:14:21.998049 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-zx6s6"] Mar 16 16:14:22 crc kubenswrapper[5120]: I0316 16:14:22.024451 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-dfhwx"] Mar 16 16:14:22 crc kubenswrapper[5120]: I0316 16:14:22.029527 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7ggs\" (UniqueName: \"kubernetes.io/projected/30317636-b1f4-4ee1-950b-6d80a890ef09-kube-api-access-w7ggs\") pod \"neutron-db-sync-9zjx8\" (UID: \"30317636-b1f4-4ee1-950b-6d80a890ef09\") " pod="openstack-kuttl-tests/neutron-db-sync-9zjx8" Mar 16 16:14:22 crc kubenswrapper[5120]: I0316 16:14:22.047909 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-xlnnr"] Mar 16 16:14:22 crc kubenswrapper[5120]: I0316 16:14:22.054667 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-xlnnr" Mar 16 16:14:22 crc kubenswrapper[5120]: I0316 16:14:22.057401 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-barbican-dockercfg-8sgv7\"" Mar 16 16:14:22 crc kubenswrapper[5120]: I0316 16:14:22.058401 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-config-data\"" Mar 16 16:14:22 crc kubenswrapper[5120]: I0316 16:14:22.072914 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-xlnnr"] Mar 16 16:14:22 crc kubenswrapper[5120]: I0316 16:14:22.078081 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b9228df3-a073-46d0-9eb2-345a0bef33a7-combined-ca-bundle\") pod \"placement-db-sync-zx6s6\" (UID: \"b9228df3-a073-46d0-9eb2-345a0bef33a7\") " pod="openstack-kuttl-tests/placement-db-sync-zx6s6" Mar 16 16:14:22 crc kubenswrapper[5120]: I0316 16:14:22.078120 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pgzzs\" (UniqueName: \"kubernetes.io/projected/b9228df3-a073-46d0-9eb2-345a0bef33a7-kube-api-access-pgzzs\") pod \"placement-db-sync-zx6s6\" (UID: \"b9228df3-a073-46d0-9eb2-345a0bef33a7\") " pod="openstack-kuttl-tests/placement-db-sync-zx6s6" Mar 16 16:14:22 crc kubenswrapper[5120]: I0316 16:14:22.078211 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/44189db5-7f84-4e8f-9bca-59a28faf203f-combined-ca-bundle\") pod \"cinder-db-sync-dfhwx\" (UID: \"44189db5-7f84-4e8f-9bca-59a28faf203f\") " pod="openstack-kuttl-tests/cinder-db-sync-dfhwx" Mar 16 16:14:22 crc kubenswrapper[5120]: I0316 16:14:22.078234 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/44189db5-7f84-4e8f-9bca-59a28faf203f-scripts\") pod \"cinder-db-sync-dfhwx\" (UID: \"44189db5-7f84-4e8f-9bca-59a28faf203f\") " pod="openstack-kuttl-tests/cinder-db-sync-dfhwx" Mar 16 16:14:22 crc kubenswrapper[5120]: I0316 16:14:22.078269 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b9228df3-a073-46d0-9eb2-345a0bef33a7-config-data\") pod \"placement-db-sync-zx6s6\" (UID: \"b9228df3-a073-46d0-9eb2-345a0bef33a7\") " pod="openstack-kuttl-tests/placement-db-sync-zx6s6" Mar 16 16:14:22 crc kubenswrapper[5120]: I0316 16:14:22.078286 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b9228df3-a073-46d0-9eb2-345a0bef33a7-logs\") pod \"placement-db-sync-zx6s6\" (UID: \"b9228df3-a073-46d0-9eb2-345a0bef33a7\") " pod="openstack-kuttl-tests/placement-db-sync-zx6s6" Mar 16 16:14:22 crc kubenswrapper[5120]: I0316 16:14:22.078341 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/44189db5-7f84-4e8f-9bca-59a28faf203f-db-sync-config-data\") pod \"cinder-db-sync-dfhwx\" (UID: \"44189db5-7f84-4e8f-9bca-59a28faf203f\") " pod="openstack-kuttl-tests/cinder-db-sync-dfhwx" Mar 16 16:14:22 crc kubenswrapper[5120]: I0316 16:14:22.078363 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b9228df3-a073-46d0-9eb2-345a0bef33a7-scripts\") pod \"placement-db-sync-zx6s6\" (UID: \"b9228df3-a073-46d0-9eb2-345a0bef33a7\") " pod="openstack-kuttl-tests/placement-db-sync-zx6s6" Mar 16 16:14:22 crc kubenswrapper[5120]: I0316 16:14:22.078401 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/44189db5-7f84-4e8f-9bca-59a28faf203f-config-data\") pod \"cinder-db-sync-dfhwx\" (UID: \"44189db5-7f84-4e8f-9bca-59a28faf203f\") " pod="openstack-kuttl-tests/cinder-db-sync-dfhwx" Mar 16 16:14:22 crc kubenswrapper[5120]: I0316 16:14:22.078427 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/44189db5-7f84-4e8f-9bca-59a28faf203f-etc-machine-id\") pod \"cinder-db-sync-dfhwx\" (UID: \"44189db5-7f84-4e8f-9bca-59a28faf203f\") " pod="openstack-kuttl-tests/cinder-db-sync-dfhwx" Mar 16 16:14:22 crc kubenswrapper[5120]: I0316 16:14:22.078454 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7llwv\" (UniqueName: \"kubernetes.io/projected/44189db5-7f84-4e8f-9bca-59a28faf203f-kube-api-access-7llwv\") pod \"cinder-db-sync-dfhwx\" (UID: \"44189db5-7f84-4e8f-9bca-59a28faf203f\") " pod="openstack-kuttl-tests/cinder-db-sync-dfhwx" Mar 16 16:14:22 crc kubenswrapper[5120]: I0316 16:14:22.078966 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b9228df3-a073-46d0-9eb2-345a0bef33a7-logs\") pod \"placement-db-sync-zx6s6\" (UID: \"b9228df3-a073-46d0-9eb2-345a0bef33a7\") " pod="openstack-kuttl-tests/placement-db-sync-zx6s6" Mar 16 16:14:22 crc kubenswrapper[5120]: I0316 16:14:22.082510 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b9228df3-a073-46d0-9eb2-345a0bef33a7-config-data\") pod \"placement-db-sync-zx6s6\" (UID: \"b9228df3-a073-46d0-9eb2-345a0bef33a7\") " pod="openstack-kuttl-tests/placement-db-sync-zx6s6" Mar 16 16:14:22 crc kubenswrapper[5120]: I0316 16:14:22.084609 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b9228df3-a073-46d0-9eb2-345a0bef33a7-combined-ca-bundle\") pod \"placement-db-sync-zx6s6\" (UID: \"b9228df3-a073-46d0-9eb2-345a0bef33a7\") " pod="openstack-kuttl-tests/placement-db-sync-zx6s6" Mar 16 16:14:22 crc kubenswrapper[5120]: I0316 16:14:22.087723 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b9228df3-a073-46d0-9eb2-345a0bef33a7-scripts\") pod \"placement-db-sync-zx6s6\" (UID: \"b9228df3-a073-46d0-9eb2-345a0bef33a7\") " pod="openstack-kuttl-tests/placement-db-sync-zx6s6" Mar 16 16:14:22 crc kubenswrapper[5120]: I0316 16:14:22.101676 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgzzs\" (UniqueName: \"kubernetes.io/projected/b9228df3-a073-46d0-9eb2-345a0bef33a7-kube-api-access-pgzzs\") pod \"placement-db-sync-zx6s6\" (UID: \"b9228df3-a073-46d0-9eb2-345a0bef33a7\") " pod="openstack-kuttl-tests/placement-db-sync-zx6s6" Mar 16 16:14:22 crc kubenswrapper[5120]: I0316 16:14:22.179530 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/44189db5-7f84-4e8f-9bca-59a28faf203f-db-sync-config-data\") pod \"cinder-db-sync-dfhwx\" (UID: \"44189db5-7f84-4e8f-9bca-59a28faf203f\") " pod="openstack-kuttl-tests/cinder-db-sync-dfhwx" Mar 16 16:14:22 crc kubenswrapper[5120]: I0316 16:14:22.180159 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/44189db5-7f84-4e8f-9bca-59a28faf203f-config-data\") pod \"cinder-db-sync-dfhwx\" (UID: \"44189db5-7f84-4e8f-9bca-59a28faf203f\") " pod="openstack-kuttl-tests/cinder-db-sync-dfhwx" Mar 16 16:14:22 crc kubenswrapper[5120]: I0316 16:14:22.180278 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/44189db5-7f84-4e8f-9bca-59a28faf203f-etc-machine-id\") pod \"cinder-db-sync-dfhwx\" (UID: \"44189db5-7f84-4e8f-9bca-59a28faf203f\") " pod="openstack-kuttl-tests/cinder-db-sync-dfhwx" Mar 16 16:14:22 crc kubenswrapper[5120]: I0316 16:14:22.180376 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7llwv\" (UniqueName: \"kubernetes.io/projected/44189db5-7f84-4e8f-9bca-59a28faf203f-kube-api-access-7llwv\") pod \"cinder-db-sync-dfhwx\" (UID: \"44189db5-7f84-4e8f-9bca-59a28faf203f\") " pod="openstack-kuttl-tests/cinder-db-sync-dfhwx" Mar 16 16:14:22 crc kubenswrapper[5120]: I0316 16:14:22.180469 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jxf4\" (UniqueName: \"kubernetes.io/projected/dd7a06d8-8dcb-4564-98a3-71818f740edf-kube-api-access-5jxf4\") pod \"barbican-db-sync-xlnnr\" (UID: \"dd7a06d8-8dcb-4564-98a3-71818f740edf\") " pod="openstack-kuttl-tests/barbican-db-sync-xlnnr" Mar 16 16:14:22 crc kubenswrapper[5120]: I0316 16:14:22.180650 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dd7a06d8-8dcb-4564-98a3-71818f740edf-combined-ca-bundle\") pod \"barbican-db-sync-xlnnr\" (UID: \"dd7a06d8-8dcb-4564-98a3-71818f740edf\") " pod="openstack-kuttl-tests/barbican-db-sync-xlnnr" Mar 16 16:14:22 crc kubenswrapper[5120]: I0316 16:14:22.180881 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/44189db5-7f84-4e8f-9bca-59a28faf203f-combined-ca-bundle\") pod \"cinder-db-sync-dfhwx\" (UID: \"44189db5-7f84-4e8f-9bca-59a28faf203f\") " pod="openstack-kuttl-tests/cinder-db-sync-dfhwx" Mar 16 16:14:22 crc kubenswrapper[5120]: I0316 16:14:22.180997 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/dd7a06d8-8dcb-4564-98a3-71818f740edf-db-sync-config-data\") pod \"barbican-db-sync-xlnnr\" (UID: \"dd7a06d8-8dcb-4564-98a3-71818f740edf\") " pod="openstack-kuttl-tests/barbican-db-sync-xlnnr" Mar 16 16:14:22 crc kubenswrapper[5120]: I0316 16:14:22.181138 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/44189db5-7f84-4e8f-9bca-59a28faf203f-scripts\") pod \"cinder-db-sync-dfhwx\" (UID: \"44189db5-7f84-4e8f-9bca-59a28faf203f\") " pod="openstack-kuttl-tests/cinder-db-sync-dfhwx" Mar 16 16:14:22 crc kubenswrapper[5120]: I0316 16:14:22.182067 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/44189db5-7f84-4e8f-9bca-59a28faf203f-etc-machine-id\") pod \"cinder-db-sync-dfhwx\" (UID: \"44189db5-7f84-4e8f-9bca-59a28faf203f\") " pod="openstack-kuttl-tests/cinder-db-sync-dfhwx" Mar 16 16:14:22 crc kubenswrapper[5120]: I0316 16:14:22.184471 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/44189db5-7f84-4e8f-9bca-59a28faf203f-db-sync-config-data\") pod \"cinder-db-sync-dfhwx\" (UID: \"44189db5-7f84-4e8f-9bca-59a28faf203f\") " pod="openstack-kuttl-tests/cinder-db-sync-dfhwx" Mar 16 16:14:22 crc kubenswrapper[5120]: I0316 16:14:22.185556 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/44189db5-7f84-4e8f-9bca-59a28faf203f-config-data\") pod \"cinder-db-sync-dfhwx\" (UID: \"44189db5-7f84-4e8f-9bca-59a28faf203f\") " pod="openstack-kuttl-tests/cinder-db-sync-dfhwx" Mar 16 16:14:22 crc kubenswrapper[5120]: I0316 16:14:22.185694 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/44189db5-7f84-4e8f-9bca-59a28faf203f-combined-ca-bundle\") pod \"cinder-db-sync-dfhwx\" (UID: \"44189db5-7f84-4e8f-9bca-59a28faf203f\") " pod="openstack-kuttl-tests/cinder-db-sync-dfhwx" Mar 16 16:14:22 crc kubenswrapper[5120]: I0316 16:14:22.188544 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/44189db5-7f84-4e8f-9bca-59a28faf203f-scripts\") pod \"cinder-db-sync-dfhwx\" (UID: \"44189db5-7f84-4e8f-9bca-59a28faf203f\") " pod="openstack-kuttl-tests/cinder-db-sync-dfhwx" Mar 16 16:14:22 crc kubenswrapper[5120]: I0316 16:14:22.196993 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7llwv\" (UniqueName: \"kubernetes.io/projected/44189db5-7f84-4e8f-9bca-59a28faf203f-kube-api-access-7llwv\") pod \"cinder-db-sync-dfhwx\" (UID: \"44189db5-7f84-4e8f-9bca-59a28faf203f\") " pod="openstack-kuttl-tests/cinder-db-sync-dfhwx" Mar 16 16:14:22 crc kubenswrapper[5120]: I0316 16:14:22.241121 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-9zjx8" Mar 16 16:14:22 crc kubenswrapper[5120]: I0316 16:14:22.268141 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-zx6s6" Mar 16 16:14:22 crc kubenswrapper[5120]: I0316 16:14:22.282663 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dd7a06d8-8dcb-4564-98a3-71818f740edf-combined-ca-bundle\") pod \"barbican-db-sync-xlnnr\" (UID: \"dd7a06d8-8dcb-4564-98a3-71818f740edf\") " pod="openstack-kuttl-tests/barbican-db-sync-xlnnr" Mar 16 16:14:22 crc kubenswrapper[5120]: I0316 16:14:22.282773 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/dd7a06d8-8dcb-4564-98a3-71818f740edf-db-sync-config-data\") pod \"barbican-db-sync-xlnnr\" (UID: \"dd7a06d8-8dcb-4564-98a3-71818f740edf\") " pod="openstack-kuttl-tests/barbican-db-sync-xlnnr" Mar 16 16:14:22 crc kubenswrapper[5120]: I0316 16:14:22.282913 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5jxf4\" (UniqueName: \"kubernetes.io/projected/dd7a06d8-8dcb-4564-98a3-71818f740edf-kube-api-access-5jxf4\") pod \"barbican-db-sync-xlnnr\" (UID: \"dd7a06d8-8dcb-4564-98a3-71818f740edf\") " pod="openstack-kuttl-tests/barbican-db-sync-xlnnr" Mar 16 16:14:22 crc kubenswrapper[5120]: I0316 16:14:22.286202 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dd7a06d8-8dcb-4564-98a3-71818f740edf-combined-ca-bundle\") pod \"barbican-db-sync-xlnnr\" (UID: \"dd7a06d8-8dcb-4564-98a3-71818f740edf\") " pod="openstack-kuttl-tests/barbican-db-sync-xlnnr" Mar 16 16:14:22 crc kubenswrapper[5120]: I0316 16:14:22.287943 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/dd7a06d8-8dcb-4564-98a3-71818f740edf-db-sync-config-data\") pod \"barbican-db-sync-xlnnr\" (UID: \"dd7a06d8-8dcb-4564-98a3-71818f740edf\") " pod="openstack-kuttl-tests/barbican-db-sync-xlnnr" Mar 16 16:14:22 crc kubenswrapper[5120]: I0316 16:14:22.297985 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jxf4\" (UniqueName: \"kubernetes.io/projected/dd7a06d8-8dcb-4564-98a3-71818f740edf-kube-api-access-5jxf4\") pod \"barbican-db-sync-xlnnr\" (UID: \"dd7a06d8-8dcb-4564-98a3-71818f740edf\") " pod="openstack-kuttl-tests/barbican-db-sync-xlnnr" Mar 16 16:14:22 crc kubenswrapper[5120]: I0316 16:14:22.308953 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-dfhwx" Mar 16 16:14:22 crc kubenswrapper[5120]: I0316 16:14:22.383088 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-xlnnr" Mar 16 16:14:22 crc kubenswrapper[5120]: I0316 16:14:22.413893 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-m4lq5"] Mar 16 16:14:22 crc kubenswrapper[5120]: I0316 16:14:22.466428 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:14:22 crc kubenswrapper[5120]: I0316 16:14:22.530591 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:14:22 crc kubenswrapper[5120]: I0316 16:14:22.542668 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:14:22 crc kubenswrapper[5120]: I0316 16:14:22.544662 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:14:22 crc kubenswrapper[5120]: I0316 16:14:22.548289 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-scripts\"" Mar 16 16:14:22 crc kubenswrapper[5120]: I0316 16:14:22.548500 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-external-config-data\"" Mar 16 16:14:22 crc kubenswrapper[5120]: I0316 16:14:22.548615 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-glance-dockercfg-5rw8s\"" Mar 16 16:14:22 crc kubenswrapper[5120]: I0316 16:14:22.554251 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-public-svc\"" Mar 16 16:14:22 crc kubenswrapper[5120]: I0316 16:14:22.589491 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:14:22 crc kubenswrapper[5120]: I0316 16:14:22.599437 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:14:22 crc kubenswrapper[5120]: I0316 16:14:22.604191 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-internal-svc\"" Mar 16 16:14:22 crc kubenswrapper[5120]: I0316 16:14:22.604571 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-internal-config-data\"" Mar 16 16:14:22 crc kubenswrapper[5120]: I0316 16:14:22.607603 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6737c256-2811-4a34-a374-8fc5c01563de-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"6737c256-2811-4a34-a374-8fc5c01563de\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:14:22 crc kubenswrapper[5120]: I0316 16:14:22.607696 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgn7k\" (UniqueName: \"kubernetes.io/projected/6737c256-2811-4a34-a374-8fc5c01563de-kube-api-access-wgn7k\") pod \"glance-default-external-api-0\" (UID: \"6737c256-2811-4a34-a374-8fc5c01563de\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:14:22 crc kubenswrapper[5120]: I0316 16:14:22.607821 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"glance-default-external-api-0\" (UID: \"6737c256-2811-4a34-a374-8fc5c01563de\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:14:22 crc kubenswrapper[5120]: I0316 16:14:22.609260 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:14:22 crc kubenswrapper[5120]: I0316 16:14:22.609904 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6737c256-2811-4a34-a374-8fc5c01563de-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"6737c256-2811-4a34-a374-8fc5c01563de\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:14:22 crc kubenswrapper[5120]: I0316 16:14:22.610048 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6737c256-2811-4a34-a374-8fc5c01563de-logs\") pod \"glance-default-external-api-0\" (UID: \"6737c256-2811-4a34-a374-8fc5c01563de\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:14:22 crc kubenswrapper[5120]: I0316 16:14:22.610106 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/6737c256-2811-4a34-a374-8fc5c01563de-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"6737c256-2811-4a34-a374-8fc5c01563de\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:14:22 crc kubenswrapper[5120]: I0316 16:14:22.610180 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6737c256-2811-4a34-a374-8fc5c01563de-config-data\") pod \"glance-default-external-api-0\" (UID: \"6737c256-2811-4a34-a374-8fc5c01563de\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:14:22 crc kubenswrapper[5120]: I0316 16:14:22.610312 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6737c256-2811-4a34-a374-8fc5c01563de-scripts\") pod \"glance-default-external-api-0\" (UID: \"6737c256-2811-4a34-a374-8fc5c01563de\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:14:22 crc kubenswrapper[5120]: I0316 16:14:22.712483 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6737c256-2811-4a34-a374-8fc5c01563de-scripts\") pod \"glance-default-external-api-0\" (UID: \"6737c256-2811-4a34-a374-8fc5c01563de\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:14:22 crc kubenswrapper[5120]: I0316 16:14:22.712532 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6756c5c8-6f61-48dd-8edb-1af889081753-logs\") pod \"glance-default-internal-api-0\" (UID: \"6756c5c8-6f61-48dd-8edb-1af889081753\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:14:22 crc kubenswrapper[5120]: I0316 16:14:22.712592 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"glance-default-internal-api-0\" (UID: \"6756c5c8-6f61-48dd-8edb-1af889081753\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:14:22 crc kubenswrapper[5120]: I0316 16:14:22.712618 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6756c5c8-6f61-48dd-8edb-1af889081753-scripts\") pod \"glance-default-internal-api-0\" (UID: \"6756c5c8-6f61-48dd-8edb-1af889081753\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:14:22 crc kubenswrapper[5120]: I0316 16:14:22.712650 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6737c256-2811-4a34-a374-8fc5c01563de-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"6737c256-2811-4a34-a374-8fc5c01563de\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:14:22 crc kubenswrapper[5120]: I0316 16:14:22.712669 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6756c5c8-6f61-48dd-8edb-1af889081753-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"6756c5c8-6f61-48dd-8edb-1af889081753\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:14:22 crc kubenswrapper[5120]: I0316 16:14:22.712739 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/6756c5c8-6f61-48dd-8edb-1af889081753-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"6756c5c8-6f61-48dd-8edb-1af889081753\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:14:22 crc kubenswrapper[5120]: I0316 16:14:22.712791 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wgn7k\" (UniqueName: \"kubernetes.io/projected/6737c256-2811-4a34-a374-8fc5c01563de-kube-api-access-wgn7k\") pod \"glance-default-external-api-0\" (UID: \"6737c256-2811-4a34-a374-8fc5c01563de\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:14:22 crc kubenswrapper[5120]: I0316 16:14:22.712824 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"glance-default-external-api-0\" (UID: \"6737c256-2811-4a34-a374-8fc5c01563de\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:14:22 crc kubenswrapper[5120]: I0316 16:14:22.712887 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6737c256-2811-4a34-a374-8fc5c01563de-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"6737c256-2811-4a34-a374-8fc5c01563de\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:14:22 crc kubenswrapper[5120]: I0316 16:14:22.712940 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6756c5c8-6f61-48dd-8edb-1af889081753-config-data\") pod \"glance-default-internal-api-0\" (UID: \"6756c5c8-6f61-48dd-8edb-1af889081753\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:14:22 crc kubenswrapper[5120]: I0316 16:14:22.712956 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6737c256-2811-4a34-a374-8fc5c01563de-logs\") pod \"glance-default-external-api-0\" (UID: \"6737c256-2811-4a34-a374-8fc5c01563de\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:14:22 crc kubenswrapper[5120]: I0316 16:14:22.712970 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lpfv8\" (UniqueName: \"kubernetes.io/projected/6756c5c8-6f61-48dd-8edb-1af889081753-kube-api-access-lpfv8\") pod \"glance-default-internal-api-0\" (UID: \"6756c5c8-6f61-48dd-8edb-1af889081753\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:14:22 crc kubenswrapper[5120]: I0316 16:14:22.713005 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6756c5c8-6f61-48dd-8edb-1af889081753-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"6756c5c8-6f61-48dd-8edb-1af889081753\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:14:22 crc kubenswrapper[5120]: I0316 16:14:22.713025 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/6737c256-2811-4a34-a374-8fc5c01563de-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"6737c256-2811-4a34-a374-8fc5c01563de\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:14:22 crc kubenswrapper[5120]: I0316 16:14:22.713058 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6737c256-2811-4a34-a374-8fc5c01563de-config-data\") pod \"glance-default-external-api-0\" (UID: \"6737c256-2811-4a34-a374-8fc5c01563de\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:14:22 crc kubenswrapper[5120]: I0316 16:14:22.713620 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/6737c256-2811-4a34-a374-8fc5c01563de-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"6737c256-2811-4a34-a374-8fc5c01563de\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:14:22 crc kubenswrapper[5120]: I0316 16:14:22.714543 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"glance-default-external-api-0\" (UID: \"6737c256-2811-4a34-a374-8fc5c01563de\") device mount path \"/mnt/openstack/pv04\"" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:14:22 crc kubenswrapper[5120]: I0316 16:14:22.716628 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6737c256-2811-4a34-a374-8fc5c01563de-logs\") pod \"glance-default-external-api-0\" (UID: \"6737c256-2811-4a34-a374-8fc5c01563de\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:14:22 crc kubenswrapper[5120]: I0316 16:14:22.722265 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6737c256-2811-4a34-a374-8fc5c01563de-scripts\") pod \"glance-default-external-api-0\" (UID: \"6737c256-2811-4a34-a374-8fc5c01563de\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:14:22 crc kubenswrapper[5120]: I0316 16:14:22.724356 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6737c256-2811-4a34-a374-8fc5c01563de-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"6737c256-2811-4a34-a374-8fc5c01563de\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:14:22 crc kubenswrapper[5120]: I0316 16:14:22.726059 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6737c256-2811-4a34-a374-8fc5c01563de-config-data\") pod \"glance-default-external-api-0\" (UID: \"6737c256-2811-4a34-a374-8fc5c01563de\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:14:22 crc kubenswrapper[5120]: I0316 16:14:22.728330 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-9zjx8"] Mar 16 16:14:22 crc kubenswrapper[5120]: I0316 16:14:22.740224 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6737c256-2811-4a34-a374-8fc5c01563de-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"6737c256-2811-4a34-a374-8fc5c01563de\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:14:22 crc kubenswrapper[5120]: I0316 16:14:22.740632 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgn7k\" (UniqueName: \"kubernetes.io/projected/6737c256-2811-4a34-a374-8fc5c01563de-kube-api-access-wgn7k\") pod \"glance-default-external-api-0\" (UID: \"6737c256-2811-4a34-a374-8fc5c01563de\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:14:22 crc kubenswrapper[5120]: I0316 16:14:22.763899 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"glance-default-external-api-0\" (UID: \"6737c256-2811-4a34-a374-8fc5c01563de\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:14:22 crc kubenswrapper[5120]: I0316 16:14:22.818666 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/6756c5c8-6f61-48dd-8edb-1af889081753-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"6756c5c8-6f61-48dd-8edb-1af889081753\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:14:22 crc kubenswrapper[5120]: I0316 16:14:22.818799 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6756c5c8-6f61-48dd-8edb-1af889081753-config-data\") pod \"glance-default-internal-api-0\" (UID: \"6756c5c8-6f61-48dd-8edb-1af889081753\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:14:22 crc kubenswrapper[5120]: I0316 16:14:22.818819 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lpfv8\" (UniqueName: \"kubernetes.io/projected/6756c5c8-6f61-48dd-8edb-1af889081753-kube-api-access-lpfv8\") pod \"glance-default-internal-api-0\" (UID: \"6756c5c8-6f61-48dd-8edb-1af889081753\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:14:22 crc kubenswrapper[5120]: I0316 16:14:22.818847 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6756c5c8-6f61-48dd-8edb-1af889081753-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"6756c5c8-6f61-48dd-8edb-1af889081753\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:14:22 crc kubenswrapper[5120]: I0316 16:14:22.818906 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6756c5c8-6f61-48dd-8edb-1af889081753-logs\") pod \"glance-default-internal-api-0\" (UID: \"6756c5c8-6f61-48dd-8edb-1af889081753\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:14:22 crc kubenswrapper[5120]: I0316 16:14:22.818957 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"glance-default-internal-api-0\" (UID: \"6756c5c8-6f61-48dd-8edb-1af889081753\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:14:22 crc kubenswrapper[5120]: I0316 16:14:22.818984 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6756c5c8-6f61-48dd-8edb-1af889081753-scripts\") pod \"glance-default-internal-api-0\" (UID: \"6756c5c8-6f61-48dd-8edb-1af889081753\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:14:22 crc kubenswrapper[5120]: I0316 16:14:22.819010 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6756c5c8-6f61-48dd-8edb-1af889081753-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"6756c5c8-6f61-48dd-8edb-1af889081753\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:14:22 crc kubenswrapper[5120]: I0316 16:14:22.823745 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6756c5c8-6f61-48dd-8edb-1af889081753-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"6756c5c8-6f61-48dd-8edb-1af889081753\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:14:22 crc kubenswrapper[5120]: I0316 16:14:22.823956 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"glance-default-internal-api-0\" (UID: \"6756c5c8-6f61-48dd-8edb-1af889081753\") device mount path \"/mnt/openstack/pv01\"" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:14:22 crc kubenswrapper[5120]: I0316 16:14:22.824249 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-zx6s6"] Mar 16 16:14:22 crc kubenswrapper[5120]: I0316 16:14:22.827134 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6756c5c8-6f61-48dd-8edb-1af889081753-logs\") pod \"glance-default-internal-api-0\" (UID: \"6756c5c8-6f61-48dd-8edb-1af889081753\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:14:22 crc kubenswrapper[5120]: I0316 16:14:22.827161 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/6756c5c8-6f61-48dd-8edb-1af889081753-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"6756c5c8-6f61-48dd-8edb-1af889081753\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:14:22 crc kubenswrapper[5120]: I0316 16:14:22.829931 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6756c5c8-6f61-48dd-8edb-1af889081753-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"6756c5c8-6f61-48dd-8edb-1af889081753\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:14:22 crc kubenswrapper[5120]: I0316 16:14:22.831624 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6756c5c8-6f61-48dd-8edb-1af889081753-config-data\") pod \"glance-default-internal-api-0\" (UID: \"6756c5c8-6f61-48dd-8edb-1af889081753\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:14:22 crc kubenswrapper[5120]: I0316 16:14:22.845552 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6756c5c8-6f61-48dd-8edb-1af889081753-scripts\") pod \"glance-default-internal-api-0\" (UID: \"6756c5c8-6f61-48dd-8edb-1af889081753\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:14:22 crc kubenswrapper[5120]: I0316 16:14:22.850201 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lpfv8\" (UniqueName: \"kubernetes.io/projected/6756c5c8-6f61-48dd-8edb-1af889081753-kube-api-access-lpfv8\") pod \"glance-default-internal-api-0\" (UID: \"6756c5c8-6f61-48dd-8edb-1af889081753\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:14:22 crc kubenswrapper[5120]: I0316 16:14:22.863964 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"glance-default-internal-api-0\" (UID: \"6756c5c8-6f61-48dd-8edb-1af889081753\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:14:22 crc kubenswrapper[5120]: I0316 16:14:22.872022 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:14:22 crc kubenswrapper[5120]: I0316 16:14:22.917251 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-dfhwx"] Mar 16 16:14:22 crc kubenswrapper[5120]: I0316 16:14:22.924489 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:14:22 crc kubenswrapper[5120]: W0316 16:14:22.933955 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod44189db5_7f84_4e8f_9bca_59a28faf203f.slice/crio-281b149d8adfe8f5ad6888b6b93e0f0216f208e2fb9e7905e91345e6dfffd407 WatchSource:0}: Error finding container 281b149d8adfe8f5ad6888b6b93e0f0216f208e2fb9e7905e91345e6dfffd407: Status 404 returned error can't find the container with id 281b149d8adfe8f5ad6888b6b93e0f0216f208e2fb9e7905e91345e6dfffd407 Mar 16 16:14:22 crc kubenswrapper[5120]: I0316 16:14:22.995736 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-xlnnr"] Mar 16 16:14:23 crc kubenswrapper[5120]: I0316 16:14:23.198576 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-xlnnr" event={"ID":"dd7a06d8-8dcb-4564-98a3-71818f740edf","Type":"ContainerStarted","Data":"de7773ba77f86a78f37ead0524328f986e43d84f017126554438900754090596"} Mar 16 16:14:23 crc kubenswrapper[5120]: I0316 16:14:23.203305 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-m4lq5" event={"ID":"67ce2cee-a80e-45e8-978a-b236ef1c8c40","Type":"ContainerStarted","Data":"017373c958d49032144fbe318a10976807bbd78b24a245e7b5bbdf6db64b7476"} Mar 16 16:14:23 crc kubenswrapper[5120]: I0316 16:14:23.203345 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-m4lq5" event={"ID":"67ce2cee-a80e-45e8-978a-b236ef1c8c40","Type":"ContainerStarted","Data":"dfeb742c11b2a199a67179402d5e12d9be12b54e848ed649976e86eea98a7265"} Mar 16 16:14:23 crc kubenswrapper[5120]: I0316 16:14:23.211144 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-dfhwx" event={"ID":"44189db5-7f84-4e8f-9bca-59a28faf203f","Type":"ContainerStarted","Data":"281b149d8adfe8f5ad6888b6b93e0f0216f208e2fb9e7905e91345e6dfffd407"} Mar 16 16:14:23 crc kubenswrapper[5120]: I0316 16:14:23.217383 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-9zjx8" event={"ID":"30317636-b1f4-4ee1-950b-6d80a890ef09","Type":"ContainerStarted","Data":"39aeafa8666446d25a5b2e18ff2113d614f81487d6359922b45fb4d77879ff78"} Mar 16 16:14:23 crc kubenswrapper[5120]: I0316 16:14:23.217437 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-9zjx8" event={"ID":"30317636-b1f4-4ee1-950b-6d80a890ef09","Type":"ContainerStarted","Data":"6e432c820ade96d1794ee7d25721bc7d5ff01e49a1f68861684433da08e01169"} Mar 16 16:14:23 crc kubenswrapper[5120]: I0316 16:14:23.229387 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-zx6s6" event={"ID":"b9228df3-a073-46d0-9eb2-345a0bef33a7","Type":"ContainerStarted","Data":"320b88bddc9b6a83665dceba6bbbe7764ea121254e371a55cbaf212003fe9534"} Mar 16 16:14:23 crc kubenswrapper[5120]: I0316 16:14:23.229428 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-zx6s6" event={"ID":"b9228df3-a073-46d0-9eb2-345a0bef33a7","Type":"ContainerStarted","Data":"be1b60d22ea16dee97ef51505e2b65c7d867de9f0c7f3f3f354af9538d78c224"} Mar 16 16:14:23 crc kubenswrapper[5120]: I0316 16:14:23.236209 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-bootstrap-m4lq5" podStartSLOduration=2.236190525 podStartE2EDuration="2.236190525s" podCreationTimestamp="2026-03-16 16:14:21 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:14:23.224623334 +0000 UTC m=+2565.378554991" watchObservedRunningTime="2026-03-16 16:14:23.236190525 +0000 UTC m=+2565.390122182" Mar 16 16:14:23 crc kubenswrapper[5120]: I0316 16:14:23.255153 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"0a87bbbf-8ee3-4693-b9b5-516b2a3b67db","Type":"ContainerStarted","Data":"bcf130ad6a8b4e55a74434f898bbd8d38c3f35586d34405facce0dba438659d1"} Mar 16 16:14:23 crc kubenswrapper[5120]: I0316 16:14:23.257450 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-db-sync-9zjx8" podStartSLOduration=2.257430854 podStartE2EDuration="2.257430854s" podCreationTimestamp="2026-03-16 16:14:21 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:14:23.237404726 +0000 UTC m=+2565.391336393" watchObservedRunningTime="2026-03-16 16:14:23.257430854 +0000 UTC m=+2565.411362501" Mar 16 16:14:23 crc kubenswrapper[5120]: I0316 16:14:23.264987 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-db-sync-zx6s6" podStartSLOduration=2.264967526 podStartE2EDuration="2.264967526s" podCreationTimestamp="2026-03-16 16:14:21 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:14:23.251544525 +0000 UTC m=+2565.405476182" watchObservedRunningTime="2026-03-16 16:14:23.264967526 +0000 UTC m=+2565.418899183" Mar 16 16:14:23 crc kubenswrapper[5120]: I0316 16:14:23.331242 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:14:23 crc kubenswrapper[5120]: I0316 16:14:23.433914 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:14:23 crc kubenswrapper[5120]: W0316 16:14:23.450956 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6756c5c8_6f61_48dd_8edb_1af889081753.slice/crio-4303c72aebcfdd05a96f48bf0344b104813749cf3fd176c1c457bca7ef85e227 WatchSource:0}: Error finding container 4303c72aebcfdd05a96f48bf0344b104813749cf3fd176c1c457bca7ef85e227: Status 404 returned error can't find the container with id 4303c72aebcfdd05a96f48bf0344b104813749cf3fd176c1c457bca7ef85e227 Mar 16 16:14:24 crc kubenswrapper[5120]: I0316 16:14:24.267361 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"6756c5c8-6f61-48dd-8edb-1af889081753","Type":"ContainerStarted","Data":"4303c72aebcfdd05a96f48bf0344b104813749cf3fd176c1c457bca7ef85e227"} Mar 16 16:14:24 crc kubenswrapper[5120]: I0316 16:14:24.276363 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"0a87bbbf-8ee3-4693-b9b5-516b2a3b67db","Type":"ContainerStarted","Data":"79637f72d630e71184d826945a6cfef9d4ce56f998543c651ec1c860e579b64a"} Mar 16 16:14:24 crc kubenswrapper[5120]: I0316 16:14:24.288881 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-xlnnr" event={"ID":"dd7a06d8-8dcb-4564-98a3-71818f740edf","Type":"ContainerStarted","Data":"5672b998b123b9f2d2e8b222c724b426b74bdc647537a83f3254f525174e930d"} Mar 16 16:14:24 crc kubenswrapper[5120]: I0316 16:14:24.293668 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"6737c256-2811-4a34-a374-8fc5c01563de","Type":"ContainerStarted","Data":"2834d790d105a7a348436641815970b52f50b245fc1dc5463d7bf1bfcfb226cc"} Mar 16 16:14:24 crc kubenswrapper[5120]: I0316 16:14:24.304635 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-db-sync-xlnnr" podStartSLOduration=3.304613539 podStartE2EDuration="3.304613539s" podCreationTimestamp="2026-03-16 16:14:21 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:14:24.304003332 +0000 UTC m=+2566.457934989" watchObservedRunningTime="2026-03-16 16:14:24.304613539 +0000 UTC m=+2566.458545196" Mar 16 16:14:24 crc kubenswrapper[5120]: I0316 16:14:24.970558 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:14:25 crc kubenswrapper[5120]: I0316 16:14:25.033298 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:14:25 crc kubenswrapper[5120]: I0316 16:14:25.077956 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:14:25 crc kubenswrapper[5120]: I0316 16:14:25.326606 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"0a87bbbf-8ee3-4693-b9b5-516b2a3b67db","Type":"ContainerStarted","Data":"12d94346012a092ddc802ca4931d0ab66bceeb5ca24bb14d5ae95396305aa3e4"} Mar 16 16:14:25 crc kubenswrapper[5120]: I0316 16:14:25.326649 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"0a87bbbf-8ee3-4693-b9b5-516b2a3b67db","Type":"ContainerStarted","Data":"08ccfa701ccc79e179b5858e89491726e9dec73be4bb965be4c99483916a7780"} Mar 16 16:14:25 crc kubenswrapper[5120]: I0316 16:14:25.329557 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"6737c256-2811-4a34-a374-8fc5c01563de","Type":"ContainerStarted","Data":"a8487ff397c4c8226aa8f4b35b5b92d418548de849e0752068722db0744f9146"} Mar 16 16:14:25 crc kubenswrapper[5120]: I0316 16:14:25.337205 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"6756c5c8-6f61-48dd-8edb-1af889081753","Type":"ContainerStarted","Data":"1f8f16c58d8708c6c357946d282108e4514d68234072a0bd6c0934066cb4da26"} Mar 16 16:14:26 crc kubenswrapper[5120]: I0316 16:14:26.346576 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"6756c5c8-6f61-48dd-8edb-1af889081753","Type":"ContainerStarted","Data":"e3aa98ccdd4892332bade271890f0a397554578be1e110604b98305515d43560"} Mar 16 16:14:26 crc kubenswrapper[5120]: I0316 16:14:26.346739 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="6756c5c8-6f61-48dd-8edb-1af889081753" containerName="glance-log" containerID="cri-o://1f8f16c58d8708c6c357946d282108e4514d68234072a0bd6c0934066cb4da26" gracePeriod=30 Mar 16 16:14:26 crc kubenswrapper[5120]: I0316 16:14:26.346811 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="6756c5c8-6f61-48dd-8edb-1af889081753" containerName="glance-httpd" containerID="cri-o://e3aa98ccdd4892332bade271890f0a397554578be1e110604b98305515d43560" gracePeriod=30 Mar 16 16:14:26 crc kubenswrapper[5120]: I0316 16:14:26.351470 5120 generic.go:358] "Generic (PLEG): container finished" podID="b9228df3-a073-46d0-9eb2-345a0bef33a7" containerID="320b88bddc9b6a83665dceba6bbbe7764ea121254e371a55cbaf212003fe9534" exitCode=0 Mar 16 16:14:26 crc kubenswrapper[5120]: I0316 16:14:26.351555 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-zx6s6" event={"ID":"b9228df3-a073-46d0-9eb2-345a0bef33a7","Type":"ContainerDied","Data":"320b88bddc9b6a83665dceba6bbbe7764ea121254e371a55cbaf212003fe9534"} Mar 16 16:14:26 crc kubenswrapper[5120]: I0316 16:14:26.354000 5120 generic.go:358] "Generic (PLEG): container finished" podID="dd7a06d8-8dcb-4564-98a3-71818f740edf" containerID="5672b998b123b9f2d2e8b222c724b426b74bdc647537a83f3254f525174e930d" exitCode=0 Mar 16 16:14:26 crc kubenswrapper[5120]: I0316 16:14:26.354047 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-xlnnr" event={"ID":"dd7a06d8-8dcb-4564-98a3-71818f740edf","Type":"ContainerDied","Data":"5672b998b123b9f2d2e8b222c724b426b74bdc647537a83f3254f525174e930d"} Mar 16 16:14:26 crc kubenswrapper[5120]: I0316 16:14:26.358182 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-dfhwx" event={"ID":"44189db5-7f84-4e8f-9bca-59a28faf203f","Type":"ContainerStarted","Data":"5378ad34d9758a144ee943f34770e0b06832baf379ab5bffe3100e28939b0afd"} Mar 16 16:14:26 crc kubenswrapper[5120]: I0316 16:14:26.360708 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"6737c256-2811-4a34-a374-8fc5c01563de","Type":"ContainerStarted","Data":"dd20d9a1f1fe09c84be360c673075e6ac901d44fd905265d7306a9d729a3abe9"} Mar 16 16:14:26 crc kubenswrapper[5120]: I0316 16:14:26.360864 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="6737c256-2811-4a34-a374-8fc5c01563de" containerName="glance-log" containerID="cri-o://a8487ff397c4c8226aa8f4b35b5b92d418548de849e0752068722db0744f9146" gracePeriod=30 Mar 16 16:14:26 crc kubenswrapper[5120]: I0316 16:14:26.361140 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="6737c256-2811-4a34-a374-8fc5c01563de" containerName="glance-httpd" containerID="cri-o://dd20d9a1f1fe09c84be360c673075e6ac901d44fd905265d7306a9d729a3abe9" gracePeriod=30 Mar 16 16:14:26 crc kubenswrapper[5120]: I0316 16:14:26.369605 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-internal-api-0" podStartSLOduration=5.36958772 podStartE2EDuration="5.36958772s" podCreationTimestamp="2026-03-16 16:14:21 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:14:26.36846396 +0000 UTC m=+2568.522395627" watchObservedRunningTime="2026-03-16 16:14:26.36958772 +0000 UTC m=+2568.523519377" Mar 16 16:14:26 crc kubenswrapper[5120]: I0316 16:14:26.402860 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-db-sync-dfhwx" podStartSLOduration=5.402841021 podStartE2EDuration="5.402841021s" podCreationTimestamp="2026-03-16 16:14:21 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:14:26.396385189 +0000 UTC m=+2568.550316846" watchObservedRunningTime="2026-03-16 16:14:26.402841021 +0000 UTC m=+2568.556772678" Mar 16 16:14:26 crc kubenswrapper[5120]: I0316 16:14:26.434283 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-external-api-0" podStartSLOduration=5.434268054 podStartE2EDuration="5.434268054s" podCreationTimestamp="2026-03-16 16:14:21 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:14:26.432241199 +0000 UTC m=+2568.586172846" watchObservedRunningTime="2026-03-16 16:14:26.434268054 +0000 UTC m=+2568.588199701" Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.250820 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.260988 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6756c5c8-6f61-48dd-8edb-1af889081753-config-data\") pod \"6756c5c8-6f61-48dd-8edb-1af889081753\" (UID: \"6756c5c8-6f61-48dd-8edb-1af889081753\") " Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.261077 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"6756c5c8-6f61-48dd-8edb-1af889081753\" (UID: \"6756c5c8-6f61-48dd-8edb-1af889081753\") " Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.261102 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6756c5c8-6f61-48dd-8edb-1af889081753-scripts\") pod \"6756c5c8-6f61-48dd-8edb-1af889081753\" (UID: \"6756c5c8-6f61-48dd-8edb-1af889081753\") " Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.261224 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6756c5c8-6f61-48dd-8edb-1af889081753-internal-tls-certs\") pod \"6756c5c8-6f61-48dd-8edb-1af889081753\" (UID: \"6756c5c8-6f61-48dd-8edb-1af889081753\") " Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.261333 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/6756c5c8-6f61-48dd-8edb-1af889081753-httpd-run\") pod \"6756c5c8-6f61-48dd-8edb-1af889081753\" (UID: \"6756c5c8-6f61-48dd-8edb-1af889081753\") " Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.261363 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6756c5c8-6f61-48dd-8edb-1af889081753-combined-ca-bundle\") pod \"6756c5c8-6f61-48dd-8edb-1af889081753\" (UID: \"6756c5c8-6f61-48dd-8edb-1af889081753\") " Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.261390 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lpfv8\" (UniqueName: \"kubernetes.io/projected/6756c5c8-6f61-48dd-8edb-1af889081753-kube-api-access-lpfv8\") pod \"6756c5c8-6f61-48dd-8edb-1af889081753\" (UID: \"6756c5c8-6f61-48dd-8edb-1af889081753\") " Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.261459 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6756c5c8-6f61-48dd-8edb-1af889081753-logs\") pod \"6756c5c8-6f61-48dd-8edb-1af889081753\" (UID: \"6756c5c8-6f61-48dd-8edb-1af889081753\") " Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.262405 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6756c5c8-6f61-48dd-8edb-1af889081753-logs" (OuterVolumeSpecName: "logs") pod "6756c5c8-6f61-48dd-8edb-1af889081753" (UID: "6756c5c8-6f61-48dd-8edb-1af889081753"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.262505 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6756c5c8-6f61-48dd-8edb-1af889081753-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "6756c5c8-6f61-48dd-8edb-1af889081753" (UID: "6756c5c8-6f61-48dd-8edb-1af889081753"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.276154 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6756c5c8-6f61-48dd-8edb-1af889081753-kube-api-access-lpfv8" (OuterVolumeSpecName: "kube-api-access-lpfv8") pod "6756c5c8-6f61-48dd-8edb-1af889081753" (UID: "6756c5c8-6f61-48dd-8edb-1af889081753"). InnerVolumeSpecName "kube-api-access-lpfv8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.276489 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6756c5c8-6f61-48dd-8edb-1af889081753-scripts" (OuterVolumeSpecName: "scripts") pod "6756c5c8-6f61-48dd-8edb-1af889081753" (UID: "6756c5c8-6f61-48dd-8edb-1af889081753"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.283942 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage01-crc" (OuterVolumeSpecName: "glance") pod "6756c5c8-6f61-48dd-8edb-1af889081753" (UID: "6756c5c8-6f61-48dd-8edb-1af889081753"). InnerVolumeSpecName "local-storage01-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.299238 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6756c5c8-6f61-48dd-8edb-1af889081753-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "6756c5c8-6f61-48dd-8edb-1af889081753" (UID: "6756c5c8-6f61-48dd-8edb-1af889081753"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.320999 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.324396 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6756c5c8-6f61-48dd-8edb-1af889081753-config-data" (OuterVolumeSpecName: "config-data") pod "6756c5c8-6f61-48dd-8edb-1af889081753" (UID: "6756c5c8-6f61-48dd-8edb-1af889081753"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.333207 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6756c5c8-6f61-48dd-8edb-1af889081753-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "6756c5c8-6f61-48dd-8edb-1af889081753" (UID: "6756c5c8-6f61-48dd-8edb-1af889081753"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.362564 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/6737c256-2811-4a34-a374-8fc5c01563de-httpd-run\") pod \"6737c256-2811-4a34-a374-8fc5c01563de\" (UID: \"6737c256-2811-4a34-a374-8fc5c01563de\") " Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.362746 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6737c256-2811-4a34-a374-8fc5c01563de-scripts\") pod \"6737c256-2811-4a34-a374-8fc5c01563de\" (UID: \"6737c256-2811-4a34-a374-8fc5c01563de\") " Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.362816 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6737c256-2811-4a34-a374-8fc5c01563de-public-tls-certs\") pod \"6737c256-2811-4a34-a374-8fc5c01563de\" (UID: \"6737c256-2811-4a34-a374-8fc5c01563de\") " Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.362841 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6737c256-2811-4a34-a374-8fc5c01563de-logs\") pod \"6737c256-2811-4a34-a374-8fc5c01563de\" (UID: \"6737c256-2811-4a34-a374-8fc5c01563de\") " Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.362905 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6737c256-2811-4a34-a374-8fc5c01563de-config-data\") pod \"6737c256-2811-4a34-a374-8fc5c01563de\" (UID: \"6737c256-2811-4a34-a374-8fc5c01563de\") " Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.363061 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"6737c256-2811-4a34-a374-8fc5c01563de\" (UID: \"6737c256-2811-4a34-a374-8fc5c01563de\") " Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.363133 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6737c256-2811-4a34-a374-8fc5c01563de-combined-ca-bundle\") pod \"6737c256-2811-4a34-a374-8fc5c01563de\" (UID: \"6737c256-2811-4a34-a374-8fc5c01563de\") " Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.363167 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wgn7k\" (UniqueName: \"kubernetes.io/projected/6737c256-2811-4a34-a374-8fc5c01563de-kube-api-access-wgn7k\") pod \"6737c256-2811-4a34-a374-8fc5c01563de\" (UID: \"6737c256-2811-4a34-a374-8fc5c01563de\") " Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.363346 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6737c256-2811-4a34-a374-8fc5c01563de-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "6737c256-2811-4a34-a374-8fc5c01563de" (UID: "6737c256-2811-4a34-a374-8fc5c01563de"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.363364 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6737c256-2811-4a34-a374-8fc5c01563de-logs" (OuterVolumeSpecName: "logs") pod "6737c256-2811-4a34-a374-8fc5c01563de" (UID: "6737c256-2811-4a34-a374-8fc5c01563de"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.363957 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/6756c5c8-6f61-48dd-8edb-1af889081753-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.363972 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6756c5c8-6f61-48dd-8edb-1af889081753-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.363984 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lpfv8\" (UniqueName: \"kubernetes.io/projected/6756c5c8-6f61-48dd-8edb-1af889081753-kube-api-access-lpfv8\") on node \"crc\" DevicePath \"\"" Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.363994 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6737c256-2811-4a34-a374-8fc5c01563de-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.364003 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6756c5c8-6f61-48dd-8edb-1af889081753-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.364011 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6756c5c8-6f61-48dd-8edb-1af889081753-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.364033 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") on node \"crc\" " Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.364044 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6756c5c8-6f61-48dd-8edb-1af889081753-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.364054 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/6737c256-2811-4a34-a374-8fc5c01563de-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.364063 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6756c5c8-6f61-48dd-8edb-1af889081753-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.371248 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6737c256-2811-4a34-a374-8fc5c01563de-scripts" (OuterVolumeSpecName: "scripts") pod "6737c256-2811-4a34-a374-8fc5c01563de" (UID: "6737c256-2811-4a34-a374-8fc5c01563de"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.374418 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6737c256-2811-4a34-a374-8fc5c01563de-kube-api-access-wgn7k" (OuterVolumeSpecName: "kube-api-access-wgn7k") pod "6737c256-2811-4a34-a374-8fc5c01563de" (UID: "6737c256-2811-4a34-a374-8fc5c01563de"). InnerVolumeSpecName "kube-api-access-wgn7k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.374974 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage04-crc" (OuterVolumeSpecName: "glance") pod "6737c256-2811-4a34-a374-8fc5c01563de" (UID: "6737c256-2811-4a34-a374-8fc5c01563de"). InnerVolumeSpecName "local-storage04-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.380521 5120 generic.go:358] "Generic (PLEG): container finished" podID="6756c5c8-6f61-48dd-8edb-1af889081753" containerID="e3aa98ccdd4892332bade271890f0a397554578be1e110604b98305515d43560" exitCode=0 Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.380557 5120 generic.go:358] "Generic (PLEG): container finished" podID="6756c5c8-6f61-48dd-8edb-1af889081753" containerID="1f8f16c58d8708c6c357946d282108e4514d68234072a0bd6c0934066cb4da26" exitCode=143 Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.380741 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.380775 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"6756c5c8-6f61-48dd-8edb-1af889081753","Type":"ContainerDied","Data":"e3aa98ccdd4892332bade271890f0a397554578be1e110604b98305515d43560"} Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.380836 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"6756c5c8-6f61-48dd-8edb-1af889081753","Type":"ContainerDied","Data":"1f8f16c58d8708c6c357946d282108e4514d68234072a0bd6c0934066cb4da26"} Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.380854 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"6756c5c8-6f61-48dd-8edb-1af889081753","Type":"ContainerDied","Data":"4303c72aebcfdd05a96f48bf0344b104813749cf3fd176c1c457bca7ef85e227"} Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.380875 5120 scope.go:117] "RemoveContainer" containerID="e3aa98ccdd4892332bade271890f0a397554578be1e110604b98305515d43560" Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.393724 5120 generic.go:358] "Generic (PLEG): container finished" podID="67ce2cee-a80e-45e8-978a-b236ef1c8c40" containerID="017373c958d49032144fbe318a10976807bbd78b24a245e7b5bbdf6db64b7476" exitCode=0 Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.393907 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-m4lq5" event={"ID":"67ce2cee-a80e-45e8-978a-b236ef1c8c40","Type":"ContainerDied","Data":"017373c958d49032144fbe318a10976807bbd78b24a245e7b5bbdf6db64b7476"} Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.395846 5120 generic.go:358] "Generic (PLEG): container finished" podID="6737c256-2811-4a34-a374-8fc5c01563de" containerID="dd20d9a1f1fe09c84be360c673075e6ac901d44fd905265d7306a9d729a3abe9" exitCode=0 Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.395883 5120 generic.go:358] "Generic (PLEG): container finished" podID="6737c256-2811-4a34-a374-8fc5c01563de" containerID="a8487ff397c4c8226aa8f4b35b5b92d418548de849e0752068722db0744f9146" exitCode=143 Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.396385 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.396448 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"6737c256-2811-4a34-a374-8fc5c01563de","Type":"ContainerDied","Data":"dd20d9a1f1fe09c84be360c673075e6ac901d44fd905265d7306a9d729a3abe9"} Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.396517 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"6737c256-2811-4a34-a374-8fc5c01563de","Type":"ContainerDied","Data":"a8487ff397c4c8226aa8f4b35b5b92d418548de849e0752068722db0744f9146"} Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.396556 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"6737c256-2811-4a34-a374-8fc5c01563de","Type":"ContainerDied","Data":"2834d790d105a7a348436641815970b52f50b245fc1dc5463d7bf1bfcfb226cc"} Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.396890 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage01-crc" (UniqueName: "kubernetes.io/local-volume/local-storage01-crc") on node "crc" Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.446979 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6737c256-2811-4a34-a374-8fc5c01563de-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "6737c256-2811-4a34-a374-8fc5c01563de" (UID: "6737c256-2811-4a34-a374-8fc5c01563de"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.456673 5120 scope.go:117] "RemoveContainer" containerID="1f8f16c58d8708c6c357946d282108e4514d68234072a0bd6c0934066cb4da26" Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.471819 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6737c256-2811-4a34-a374-8fc5c01563de-config-data" (OuterVolumeSpecName: "config-data") pod "6737c256-2811-4a34-a374-8fc5c01563de" (UID: "6737c256-2811-4a34-a374-8fc5c01563de"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.475937 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6737c256-2811-4a34-a374-8fc5c01563de-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.475963 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6737c256-2811-4a34-a374-8fc5c01563de-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.475982 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") on node \"crc\" " Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.475992 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6737c256-2811-4a34-a374-8fc5c01563de-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.476004 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wgn7k\" (UniqueName: \"kubernetes.io/projected/6737c256-2811-4a34-a374-8fc5c01563de-kube-api-access-wgn7k\") on node \"crc\" DevicePath \"\"" Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.476014 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.493318 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.498141 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage04-crc" (UniqueName: "kubernetes.io/local-volume/local-storage04-crc") on node "crc" Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.522338 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6737c256-2811-4a34-a374-8fc5c01563de-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "6737c256-2811-4a34-a374-8fc5c01563de" (UID: "6737c256-2811-4a34-a374-8fc5c01563de"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.527086 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.540869 5120 scope.go:117] "RemoveContainer" containerID="e3aa98ccdd4892332bade271890f0a397554578be1e110604b98305515d43560" Mar 16 16:14:27 crc kubenswrapper[5120]: E0316 16:14:27.541627 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e3aa98ccdd4892332bade271890f0a397554578be1e110604b98305515d43560\": container with ID starting with e3aa98ccdd4892332bade271890f0a397554578be1e110604b98305515d43560 not found: ID does not exist" containerID="e3aa98ccdd4892332bade271890f0a397554578be1e110604b98305515d43560" Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.541664 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3aa98ccdd4892332bade271890f0a397554578be1e110604b98305515d43560"} err="failed to get container status \"e3aa98ccdd4892332bade271890f0a397554578be1e110604b98305515d43560\": rpc error: code = NotFound desc = could not find container \"e3aa98ccdd4892332bade271890f0a397554578be1e110604b98305515d43560\": container with ID starting with e3aa98ccdd4892332bade271890f0a397554578be1e110604b98305515d43560 not found: ID does not exist" Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.541683 5120 scope.go:117] "RemoveContainer" containerID="1f8f16c58d8708c6c357946d282108e4514d68234072a0bd6c0934066cb4da26" Mar 16 16:14:27 crc kubenswrapper[5120]: E0316 16:14:27.543137 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f8f16c58d8708c6c357946d282108e4514d68234072a0bd6c0934066cb4da26\": container with ID starting with 1f8f16c58d8708c6c357946d282108e4514d68234072a0bd6c0934066cb4da26 not found: ID does not exist" containerID="1f8f16c58d8708c6c357946d282108e4514d68234072a0bd6c0934066cb4da26" Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.543179 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f8f16c58d8708c6c357946d282108e4514d68234072a0bd6c0934066cb4da26"} err="failed to get container status \"1f8f16c58d8708c6c357946d282108e4514d68234072a0bd6c0934066cb4da26\": rpc error: code = NotFound desc = could not find container \"1f8f16c58d8708c6c357946d282108e4514d68234072a0bd6c0934066cb4da26\": container with ID starting with 1f8f16c58d8708c6c357946d282108e4514d68234072a0bd6c0934066cb4da26 not found: ID does not exist" Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.543227 5120 scope.go:117] "RemoveContainer" containerID="e3aa98ccdd4892332bade271890f0a397554578be1e110604b98305515d43560" Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.543499 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3aa98ccdd4892332bade271890f0a397554578be1e110604b98305515d43560"} err="failed to get container status \"e3aa98ccdd4892332bade271890f0a397554578be1e110604b98305515d43560\": rpc error: code = NotFound desc = could not find container \"e3aa98ccdd4892332bade271890f0a397554578be1e110604b98305515d43560\": container with ID starting with e3aa98ccdd4892332bade271890f0a397554578be1e110604b98305515d43560 not found: ID does not exist" Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.543523 5120 scope.go:117] "RemoveContainer" containerID="1f8f16c58d8708c6c357946d282108e4514d68234072a0bd6c0934066cb4da26" Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.543781 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f8f16c58d8708c6c357946d282108e4514d68234072a0bd6c0934066cb4da26"} err="failed to get container status \"1f8f16c58d8708c6c357946d282108e4514d68234072a0bd6c0934066cb4da26\": rpc error: code = NotFound desc = could not find container \"1f8f16c58d8708c6c357946d282108e4514d68234072a0bd6c0934066cb4da26\": container with ID starting with 1f8f16c58d8708c6c357946d282108e4514d68234072a0bd6c0934066cb4da26 not found: ID does not exist" Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.543800 5120 scope.go:117] "RemoveContainer" containerID="dd20d9a1f1fe09c84be360c673075e6ac901d44fd905265d7306a9d729a3abe9" Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.544280 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.545379 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6737c256-2811-4a34-a374-8fc5c01563de" containerName="glance-httpd" Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.545393 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="6737c256-2811-4a34-a374-8fc5c01563de" containerName="glance-httpd" Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.545431 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6737c256-2811-4a34-a374-8fc5c01563de" containerName="glance-log" Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.545437 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="6737c256-2811-4a34-a374-8fc5c01563de" containerName="glance-log" Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.545448 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6756c5c8-6f61-48dd-8edb-1af889081753" containerName="glance-httpd" Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.545454 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="6756c5c8-6f61-48dd-8edb-1af889081753" containerName="glance-httpd" Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.545473 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6756c5c8-6f61-48dd-8edb-1af889081753" containerName="glance-log" Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.545478 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="6756c5c8-6f61-48dd-8edb-1af889081753" containerName="glance-log" Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.545613 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="6737c256-2811-4a34-a374-8fc5c01563de" containerName="glance-httpd" Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.545625 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="6756c5c8-6f61-48dd-8edb-1af889081753" containerName="glance-httpd" Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.545641 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="6756c5c8-6f61-48dd-8edb-1af889081753" containerName="glance-log" Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.545650 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="6737c256-2811-4a34-a374-8fc5c01563de" containerName="glance-log" Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.549504 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.553068 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-internal-config-data\"" Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.553231 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-internal-svc\"" Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.563168 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.581064 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f332d01c-8618-4bf0-adda-5d5e90a43f7a-scripts\") pod \"glance-default-internal-api-0\" (UID: \"f332d01c-8618-4bf0-adda-5d5e90a43f7a\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.581130 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"glance-default-internal-api-0\" (UID: \"f332d01c-8618-4bf0-adda-5d5e90a43f7a\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.581154 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xl7sm\" (UniqueName: \"kubernetes.io/projected/f332d01c-8618-4bf0-adda-5d5e90a43f7a-kube-api-access-xl7sm\") pod \"glance-default-internal-api-0\" (UID: \"f332d01c-8618-4bf0-adda-5d5e90a43f7a\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.582126 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f332d01c-8618-4bf0-adda-5d5e90a43f7a-logs\") pod \"glance-default-internal-api-0\" (UID: \"f332d01c-8618-4bf0-adda-5d5e90a43f7a\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.582202 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f332d01c-8618-4bf0-adda-5d5e90a43f7a-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"f332d01c-8618-4bf0-adda-5d5e90a43f7a\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.582354 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f332d01c-8618-4bf0-adda-5d5e90a43f7a-config-data\") pod \"glance-default-internal-api-0\" (UID: \"f332d01c-8618-4bf0-adda-5d5e90a43f7a\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.582418 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/f332d01c-8618-4bf0-adda-5d5e90a43f7a-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"f332d01c-8618-4bf0-adda-5d5e90a43f7a\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.582447 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f332d01c-8618-4bf0-adda-5d5e90a43f7a-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"f332d01c-8618-4bf0-adda-5d5e90a43f7a\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.582668 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6737c256-2811-4a34-a374-8fc5c01563de-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.582684 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.593952 5120 scope.go:117] "RemoveContainer" containerID="a8487ff397c4c8226aa8f4b35b5b92d418548de849e0752068722db0744f9146" Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.611828 5120 scope.go:117] "RemoveContainer" containerID="dd20d9a1f1fe09c84be360c673075e6ac901d44fd905265d7306a9d729a3abe9" Mar 16 16:14:27 crc kubenswrapper[5120]: E0316 16:14:27.612530 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd20d9a1f1fe09c84be360c673075e6ac901d44fd905265d7306a9d729a3abe9\": container with ID starting with dd20d9a1f1fe09c84be360c673075e6ac901d44fd905265d7306a9d729a3abe9 not found: ID does not exist" containerID="dd20d9a1f1fe09c84be360c673075e6ac901d44fd905265d7306a9d729a3abe9" Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.612578 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd20d9a1f1fe09c84be360c673075e6ac901d44fd905265d7306a9d729a3abe9"} err="failed to get container status \"dd20d9a1f1fe09c84be360c673075e6ac901d44fd905265d7306a9d729a3abe9\": rpc error: code = NotFound desc = could not find container \"dd20d9a1f1fe09c84be360c673075e6ac901d44fd905265d7306a9d729a3abe9\": container with ID starting with dd20d9a1f1fe09c84be360c673075e6ac901d44fd905265d7306a9d729a3abe9 not found: ID does not exist" Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.612605 5120 scope.go:117] "RemoveContainer" containerID="a8487ff397c4c8226aa8f4b35b5b92d418548de849e0752068722db0744f9146" Mar 16 16:14:27 crc kubenswrapper[5120]: E0316 16:14:27.612922 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a8487ff397c4c8226aa8f4b35b5b92d418548de849e0752068722db0744f9146\": container with ID starting with a8487ff397c4c8226aa8f4b35b5b92d418548de849e0752068722db0744f9146 not found: ID does not exist" containerID="a8487ff397c4c8226aa8f4b35b5b92d418548de849e0752068722db0744f9146" Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.612952 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8487ff397c4c8226aa8f4b35b5b92d418548de849e0752068722db0744f9146"} err="failed to get container status \"a8487ff397c4c8226aa8f4b35b5b92d418548de849e0752068722db0744f9146\": rpc error: code = NotFound desc = could not find container \"a8487ff397c4c8226aa8f4b35b5b92d418548de849e0752068722db0744f9146\": container with ID starting with a8487ff397c4c8226aa8f4b35b5b92d418548de849e0752068722db0744f9146 not found: ID does not exist" Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.612973 5120 scope.go:117] "RemoveContainer" containerID="dd20d9a1f1fe09c84be360c673075e6ac901d44fd905265d7306a9d729a3abe9" Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.613281 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd20d9a1f1fe09c84be360c673075e6ac901d44fd905265d7306a9d729a3abe9"} err="failed to get container status \"dd20d9a1f1fe09c84be360c673075e6ac901d44fd905265d7306a9d729a3abe9\": rpc error: code = NotFound desc = could not find container \"dd20d9a1f1fe09c84be360c673075e6ac901d44fd905265d7306a9d729a3abe9\": container with ID starting with dd20d9a1f1fe09c84be360c673075e6ac901d44fd905265d7306a9d729a3abe9 not found: ID does not exist" Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.613329 5120 scope.go:117] "RemoveContainer" containerID="a8487ff397c4c8226aa8f4b35b5b92d418548de849e0752068722db0744f9146" Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.613649 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8487ff397c4c8226aa8f4b35b5b92d418548de849e0752068722db0744f9146"} err="failed to get container status \"a8487ff397c4c8226aa8f4b35b5b92d418548de849e0752068722db0744f9146\": rpc error: code = NotFound desc = could not find container \"a8487ff397c4c8226aa8f4b35b5b92d418548de849e0752068722db0744f9146\": container with ID starting with a8487ff397c4c8226aa8f4b35b5b92d418548de849e0752068722db0744f9146 not found: ID does not exist" Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.686415 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f332d01c-8618-4bf0-adda-5d5e90a43f7a-scripts\") pod \"glance-default-internal-api-0\" (UID: \"f332d01c-8618-4bf0-adda-5d5e90a43f7a\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.686502 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"glance-default-internal-api-0\" (UID: \"f332d01c-8618-4bf0-adda-5d5e90a43f7a\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.686526 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xl7sm\" (UniqueName: \"kubernetes.io/projected/f332d01c-8618-4bf0-adda-5d5e90a43f7a-kube-api-access-xl7sm\") pod \"glance-default-internal-api-0\" (UID: \"f332d01c-8618-4bf0-adda-5d5e90a43f7a\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.686640 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f332d01c-8618-4bf0-adda-5d5e90a43f7a-logs\") pod \"glance-default-internal-api-0\" (UID: \"f332d01c-8618-4bf0-adda-5d5e90a43f7a\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.686684 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f332d01c-8618-4bf0-adda-5d5e90a43f7a-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"f332d01c-8618-4bf0-adda-5d5e90a43f7a\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.686734 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f332d01c-8618-4bf0-adda-5d5e90a43f7a-config-data\") pod \"glance-default-internal-api-0\" (UID: \"f332d01c-8618-4bf0-adda-5d5e90a43f7a\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.686788 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/f332d01c-8618-4bf0-adda-5d5e90a43f7a-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"f332d01c-8618-4bf0-adda-5d5e90a43f7a\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.686807 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f332d01c-8618-4bf0-adda-5d5e90a43f7a-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"f332d01c-8618-4bf0-adda-5d5e90a43f7a\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.690029 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"glance-default-internal-api-0\" (UID: \"f332d01c-8618-4bf0-adda-5d5e90a43f7a\") device mount path \"/mnt/openstack/pv01\"" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.691914 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/f332d01c-8618-4bf0-adda-5d5e90a43f7a-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"f332d01c-8618-4bf0-adda-5d5e90a43f7a\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.692605 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f332d01c-8618-4bf0-adda-5d5e90a43f7a-logs\") pod \"glance-default-internal-api-0\" (UID: \"f332d01c-8618-4bf0-adda-5d5e90a43f7a\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.698878 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f332d01c-8618-4bf0-adda-5d5e90a43f7a-scripts\") pod \"glance-default-internal-api-0\" (UID: \"f332d01c-8618-4bf0-adda-5d5e90a43f7a\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.700604 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f332d01c-8618-4bf0-adda-5d5e90a43f7a-config-data\") pod \"glance-default-internal-api-0\" (UID: \"f332d01c-8618-4bf0-adda-5d5e90a43f7a\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.701549 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f332d01c-8618-4bf0-adda-5d5e90a43f7a-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"f332d01c-8618-4bf0-adda-5d5e90a43f7a\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.707566 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f332d01c-8618-4bf0-adda-5d5e90a43f7a-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"f332d01c-8618-4bf0-adda-5d5e90a43f7a\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.710736 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xl7sm\" (UniqueName: \"kubernetes.io/projected/f332d01c-8618-4bf0-adda-5d5e90a43f7a-kube-api-access-xl7sm\") pod \"glance-default-internal-api-0\" (UID: \"f332d01c-8618-4bf0-adda-5d5e90a43f7a\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.742734 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.759010 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.761986 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"glance-default-internal-api-0\" (UID: \"f332d01c-8618-4bf0-adda-5d5e90a43f7a\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.828810 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.835564 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.838110 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-public-svc\"" Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.839710 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.840041 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-external-config-data\"" Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.864625 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:14:27 crc kubenswrapper[5120]: I0316 16:14:27.966203 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-xlnnr" Mar 16 16:14:28 crc kubenswrapper[5120]: I0316 16:14:27.999878 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-zx6s6" Mar 16 16:14:28 crc kubenswrapper[5120]: I0316 16:14:28.001356 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e8c1b04b-5169-424c-aa78-d0ed21f9ad44-config-data\") pod \"glance-default-external-api-0\" (UID: \"e8c1b04b-5169-424c-aa78-d0ed21f9ad44\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:14:28 crc kubenswrapper[5120]: I0316 16:14:28.001429 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/e8c1b04b-5169-424c-aa78-d0ed21f9ad44-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"e8c1b04b-5169-424c-aa78-d0ed21f9ad44\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:14:28 crc kubenswrapper[5120]: I0316 16:14:28.001459 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"glance-default-external-api-0\" (UID: \"e8c1b04b-5169-424c-aa78-d0ed21f9ad44\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:14:28 crc kubenswrapper[5120]: I0316 16:14:28.001507 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e8c1b04b-5169-424c-aa78-d0ed21f9ad44-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"e8c1b04b-5169-424c-aa78-d0ed21f9ad44\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:14:28 crc kubenswrapper[5120]: I0316 16:14:28.001550 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e8c1b04b-5169-424c-aa78-d0ed21f9ad44-scripts\") pod \"glance-default-external-api-0\" (UID: \"e8c1b04b-5169-424c-aa78-d0ed21f9ad44\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:14:28 crc kubenswrapper[5120]: I0316 16:14:28.001613 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e8c1b04b-5169-424c-aa78-d0ed21f9ad44-logs\") pod \"glance-default-external-api-0\" (UID: \"e8c1b04b-5169-424c-aa78-d0ed21f9ad44\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:14:28 crc kubenswrapper[5120]: I0316 16:14:28.001633 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e8c1b04b-5169-424c-aa78-d0ed21f9ad44-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"e8c1b04b-5169-424c-aa78-d0ed21f9ad44\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:14:28 crc kubenswrapper[5120]: I0316 16:14:28.001685 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hx9rj\" (UniqueName: \"kubernetes.io/projected/e8c1b04b-5169-424c-aa78-d0ed21f9ad44-kube-api-access-hx9rj\") pod \"glance-default-external-api-0\" (UID: \"e8c1b04b-5169-424c-aa78-d0ed21f9ad44\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:14:28 crc kubenswrapper[5120]: I0316 16:14:28.103111 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5jxf4\" (UniqueName: \"kubernetes.io/projected/dd7a06d8-8dcb-4564-98a3-71818f740edf-kube-api-access-5jxf4\") pod \"dd7a06d8-8dcb-4564-98a3-71818f740edf\" (UID: \"dd7a06d8-8dcb-4564-98a3-71818f740edf\") " Mar 16 16:14:28 crc kubenswrapper[5120]: I0316 16:14:28.103253 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b9228df3-a073-46d0-9eb2-345a0bef33a7-combined-ca-bundle\") pod \"b9228df3-a073-46d0-9eb2-345a0bef33a7\" (UID: \"b9228df3-a073-46d0-9eb2-345a0bef33a7\") " Mar 16 16:14:28 crc kubenswrapper[5120]: I0316 16:14:28.103297 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dd7a06d8-8dcb-4564-98a3-71818f740edf-combined-ca-bundle\") pod \"dd7a06d8-8dcb-4564-98a3-71818f740edf\" (UID: \"dd7a06d8-8dcb-4564-98a3-71818f740edf\") " Mar 16 16:14:28 crc kubenswrapper[5120]: I0316 16:14:28.103389 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b9228df3-a073-46d0-9eb2-345a0bef33a7-logs\") pod \"b9228df3-a073-46d0-9eb2-345a0bef33a7\" (UID: \"b9228df3-a073-46d0-9eb2-345a0bef33a7\") " Mar 16 16:14:28 crc kubenswrapper[5120]: I0316 16:14:28.103698 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b9228df3-a073-46d0-9eb2-345a0bef33a7-scripts\") pod \"b9228df3-a073-46d0-9eb2-345a0bef33a7\" (UID: \"b9228df3-a073-46d0-9eb2-345a0bef33a7\") " Mar 16 16:14:28 crc kubenswrapper[5120]: I0316 16:14:28.103721 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/dd7a06d8-8dcb-4564-98a3-71818f740edf-db-sync-config-data\") pod \"dd7a06d8-8dcb-4564-98a3-71818f740edf\" (UID: \"dd7a06d8-8dcb-4564-98a3-71818f740edf\") " Mar 16 16:14:28 crc kubenswrapper[5120]: I0316 16:14:28.103908 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pgzzs\" (UniqueName: \"kubernetes.io/projected/b9228df3-a073-46d0-9eb2-345a0bef33a7-kube-api-access-pgzzs\") pod \"b9228df3-a073-46d0-9eb2-345a0bef33a7\" (UID: \"b9228df3-a073-46d0-9eb2-345a0bef33a7\") " Mar 16 16:14:28 crc kubenswrapper[5120]: I0316 16:14:28.103970 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b9228df3-a073-46d0-9eb2-345a0bef33a7-config-data\") pod \"b9228df3-a073-46d0-9eb2-345a0bef33a7\" (UID: \"b9228df3-a073-46d0-9eb2-345a0bef33a7\") " Mar 16 16:14:28 crc kubenswrapper[5120]: I0316 16:14:28.104201 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e8c1b04b-5169-424c-aa78-d0ed21f9ad44-config-data\") pod \"glance-default-external-api-0\" (UID: \"e8c1b04b-5169-424c-aa78-d0ed21f9ad44\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:14:28 crc kubenswrapper[5120]: I0316 16:14:28.104259 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9228df3-a073-46d0-9eb2-345a0bef33a7-logs" (OuterVolumeSpecName: "logs") pod "b9228df3-a073-46d0-9eb2-345a0bef33a7" (UID: "b9228df3-a073-46d0-9eb2-345a0bef33a7"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:14:28 crc kubenswrapper[5120]: I0316 16:14:28.104353 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/e8c1b04b-5169-424c-aa78-d0ed21f9ad44-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"e8c1b04b-5169-424c-aa78-d0ed21f9ad44\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:14:28 crc kubenswrapper[5120]: I0316 16:14:28.104425 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"glance-default-external-api-0\" (UID: \"e8c1b04b-5169-424c-aa78-d0ed21f9ad44\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:14:28 crc kubenswrapper[5120]: I0316 16:14:28.104565 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e8c1b04b-5169-424c-aa78-d0ed21f9ad44-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"e8c1b04b-5169-424c-aa78-d0ed21f9ad44\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:14:28 crc kubenswrapper[5120]: I0316 16:14:28.104659 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e8c1b04b-5169-424c-aa78-d0ed21f9ad44-scripts\") pod \"glance-default-external-api-0\" (UID: \"e8c1b04b-5169-424c-aa78-d0ed21f9ad44\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:14:28 crc kubenswrapper[5120]: I0316 16:14:28.104868 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e8c1b04b-5169-424c-aa78-d0ed21f9ad44-logs\") pod \"glance-default-external-api-0\" (UID: \"e8c1b04b-5169-424c-aa78-d0ed21f9ad44\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:14:28 crc kubenswrapper[5120]: I0316 16:14:28.104925 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e8c1b04b-5169-424c-aa78-d0ed21f9ad44-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"e8c1b04b-5169-424c-aa78-d0ed21f9ad44\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:14:28 crc kubenswrapper[5120]: I0316 16:14:28.105041 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hx9rj\" (UniqueName: \"kubernetes.io/projected/e8c1b04b-5169-424c-aa78-d0ed21f9ad44-kube-api-access-hx9rj\") pod \"glance-default-external-api-0\" (UID: \"e8c1b04b-5169-424c-aa78-d0ed21f9ad44\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:14:28 crc kubenswrapper[5120]: I0316 16:14:28.105177 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/e8c1b04b-5169-424c-aa78-d0ed21f9ad44-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"e8c1b04b-5169-424c-aa78-d0ed21f9ad44\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:14:28 crc kubenswrapper[5120]: I0316 16:14:28.105217 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b9228df3-a073-46d0-9eb2-345a0bef33a7-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:14:28 crc kubenswrapper[5120]: I0316 16:14:28.105907 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e8c1b04b-5169-424c-aa78-d0ed21f9ad44-logs\") pod \"glance-default-external-api-0\" (UID: \"e8c1b04b-5169-424c-aa78-d0ed21f9ad44\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:14:28 crc kubenswrapper[5120]: I0316 16:14:28.106135 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"glance-default-external-api-0\" (UID: \"e8c1b04b-5169-424c-aa78-d0ed21f9ad44\") device mount path \"/mnt/openstack/pv04\"" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:14:28 crc kubenswrapper[5120]: I0316 16:14:28.111376 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd7a06d8-8dcb-4564-98a3-71818f740edf-kube-api-access-5jxf4" (OuterVolumeSpecName: "kube-api-access-5jxf4") pod "dd7a06d8-8dcb-4564-98a3-71818f740edf" (UID: "dd7a06d8-8dcb-4564-98a3-71818f740edf"). InnerVolumeSpecName "kube-api-access-5jxf4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:14:28 crc kubenswrapper[5120]: I0316 16:14:28.112122 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9228df3-a073-46d0-9eb2-345a0bef33a7-scripts" (OuterVolumeSpecName: "scripts") pod "b9228df3-a073-46d0-9eb2-345a0bef33a7" (UID: "b9228df3-a073-46d0-9eb2-345a0bef33a7"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:14:28 crc kubenswrapper[5120]: I0316 16:14:28.113948 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e8c1b04b-5169-424c-aa78-d0ed21f9ad44-scripts\") pod \"glance-default-external-api-0\" (UID: \"e8c1b04b-5169-424c-aa78-d0ed21f9ad44\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:14:28 crc kubenswrapper[5120]: I0316 16:14:28.115115 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd7a06d8-8dcb-4564-98a3-71818f740edf-db-sync-config-data" (OuterVolumeSpecName: "db-sync-config-data") pod "dd7a06d8-8dcb-4564-98a3-71818f740edf" (UID: "dd7a06d8-8dcb-4564-98a3-71818f740edf"). InnerVolumeSpecName "db-sync-config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:14:28 crc kubenswrapper[5120]: I0316 16:14:28.116649 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e8c1b04b-5169-424c-aa78-d0ed21f9ad44-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"e8c1b04b-5169-424c-aa78-d0ed21f9ad44\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:14:28 crc kubenswrapper[5120]: I0316 16:14:28.120674 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e8c1b04b-5169-424c-aa78-d0ed21f9ad44-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"e8c1b04b-5169-424c-aa78-d0ed21f9ad44\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:14:28 crc kubenswrapper[5120]: I0316 16:14:28.127196 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hx9rj\" (UniqueName: \"kubernetes.io/projected/e8c1b04b-5169-424c-aa78-d0ed21f9ad44-kube-api-access-hx9rj\") pod \"glance-default-external-api-0\" (UID: \"e8c1b04b-5169-424c-aa78-d0ed21f9ad44\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:14:28 crc kubenswrapper[5120]: I0316 16:14:28.140774 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e8c1b04b-5169-424c-aa78-d0ed21f9ad44-config-data\") pod \"glance-default-external-api-0\" (UID: \"e8c1b04b-5169-424c-aa78-d0ed21f9ad44\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:14:28 crc kubenswrapper[5120]: I0316 16:14:28.147735 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9228df3-a073-46d0-9eb2-345a0bef33a7-kube-api-access-pgzzs" (OuterVolumeSpecName: "kube-api-access-pgzzs") pod "b9228df3-a073-46d0-9eb2-345a0bef33a7" (UID: "b9228df3-a073-46d0-9eb2-345a0bef33a7"). InnerVolumeSpecName "kube-api-access-pgzzs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:14:28 crc kubenswrapper[5120]: I0316 16:14:28.150727 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"glance-default-external-api-0\" (UID: \"e8c1b04b-5169-424c-aa78-d0ed21f9ad44\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:14:28 crc kubenswrapper[5120]: I0316 16:14:28.159461 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9228df3-a073-46d0-9eb2-345a0bef33a7-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "b9228df3-a073-46d0-9eb2-345a0bef33a7" (UID: "b9228df3-a073-46d0-9eb2-345a0bef33a7"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:14:28 crc kubenswrapper[5120]: I0316 16:14:28.160276 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd7a06d8-8dcb-4564-98a3-71818f740edf-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "dd7a06d8-8dcb-4564-98a3-71818f740edf" (UID: "dd7a06d8-8dcb-4564-98a3-71818f740edf"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:14:28 crc kubenswrapper[5120]: I0316 16:14:28.170104 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9228df3-a073-46d0-9eb2-345a0bef33a7-config-data" (OuterVolumeSpecName: "config-data") pod "b9228df3-a073-46d0-9eb2-345a0bef33a7" (UID: "b9228df3-a073-46d0-9eb2-345a0bef33a7"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:14:28 crc kubenswrapper[5120]: I0316 16:14:28.207299 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5jxf4\" (UniqueName: \"kubernetes.io/projected/dd7a06d8-8dcb-4564-98a3-71818f740edf-kube-api-access-5jxf4\") on node \"crc\" DevicePath \"\"" Mar 16 16:14:28 crc kubenswrapper[5120]: I0316 16:14:28.207484 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b9228df3-a073-46d0-9eb2-345a0bef33a7-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:14:28 crc kubenswrapper[5120]: I0316 16:14:28.207564 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dd7a06d8-8dcb-4564-98a3-71818f740edf-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:14:28 crc kubenswrapper[5120]: I0316 16:14:28.207634 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b9228df3-a073-46d0-9eb2-345a0bef33a7-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:14:28 crc kubenswrapper[5120]: I0316 16:14:28.207696 5120 reconciler_common.go:299] "Volume detached for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/dd7a06d8-8dcb-4564-98a3-71818f740edf-db-sync-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:14:28 crc kubenswrapper[5120]: I0316 16:14:28.207798 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pgzzs\" (UniqueName: \"kubernetes.io/projected/b9228df3-a073-46d0-9eb2-345a0bef33a7-kube-api-access-pgzzs\") on node \"crc\" DevicePath \"\"" Mar 16 16:14:28 crc kubenswrapper[5120]: I0316 16:14:28.207881 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b9228df3-a073-46d0-9eb2-345a0bef33a7-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:14:28 crc kubenswrapper[5120]: I0316 16:14:28.297879 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:14:28 crc kubenswrapper[5120]: I0316 16:14:28.361451 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:14:28 crc kubenswrapper[5120]: W0316 16:14:28.379067 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf332d01c_8618_4bf0_adda_5d5e90a43f7a.slice/crio-2664ad943354aac02f866578585d3cd8c45a3a8ab45f5b4ae6e9359420e9fbfe WatchSource:0}: Error finding container 2664ad943354aac02f866578585d3cd8c45a3a8ab45f5b4ae6e9359420e9fbfe: Status 404 returned error can't find the container with id 2664ad943354aac02f866578585d3cd8c45a3a8ab45f5b4ae6e9359420e9fbfe Mar 16 16:14:28 crc kubenswrapper[5120]: I0316 16:14:28.417231 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-zx6s6" Mar 16 16:14:28 crc kubenswrapper[5120]: I0316 16:14:28.417288 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-zx6s6" event={"ID":"b9228df3-a073-46d0-9eb2-345a0bef33a7","Type":"ContainerDied","Data":"be1b60d22ea16dee97ef51505e2b65c7d867de9f0c7f3f3f354af9538d78c224"} Mar 16 16:14:28 crc kubenswrapper[5120]: I0316 16:14:28.417321 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="be1b60d22ea16dee97ef51505e2b65c7d867de9f0c7f3f3f354af9538d78c224" Mar 16 16:14:28 crc kubenswrapper[5120]: I0316 16:14:28.431033 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"0a87bbbf-8ee3-4693-b9b5-516b2a3b67db","Type":"ContainerStarted","Data":"0dd30f39feb4c51ce754d8ed8226a58ef6bc9a6f0ec94ff105629e02edab3605"} Mar 16 16:14:28 crc kubenswrapper[5120]: I0316 16:14:28.431209 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="0a87bbbf-8ee3-4693-b9b5-516b2a3b67db" containerName="ceilometer-central-agent" containerID="cri-o://79637f72d630e71184d826945a6cfef9d4ce56f998543c651ec1c860e579b64a" gracePeriod=30 Mar 16 16:14:28 crc kubenswrapper[5120]: I0316 16:14:28.431446 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:14:28 crc kubenswrapper[5120]: I0316 16:14:28.431549 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="0a87bbbf-8ee3-4693-b9b5-516b2a3b67db" containerName="proxy-httpd" containerID="cri-o://0dd30f39feb4c51ce754d8ed8226a58ef6bc9a6f0ec94ff105629e02edab3605" gracePeriod=30 Mar 16 16:14:28 crc kubenswrapper[5120]: I0316 16:14:28.431652 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="0a87bbbf-8ee3-4693-b9b5-516b2a3b67db" containerName="sg-core" containerID="cri-o://12d94346012a092ddc802ca4931d0ab66bceeb5ca24bb14d5ae95396305aa3e4" gracePeriod=30 Mar 16 16:14:28 crc kubenswrapper[5120]: I0316 16:14:28.431695 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="0a87bbbf-8ee3-4693-b9b5-516b2a3b67db" containerName="ceilometer-notification-agent" containerID="cri-o://08ccfa701ccc79e179b5858e89491726e9dec73be4bb965be4c99483916a7780" gracePeriod=30 Mar 16 16:14:28 crc kubenswrapper[5120]: I0316 16:14:28.441342 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"f332d01c-8618-4bf0-adda-5d5e90a43f7a","Type":"ContainerStarted","Data":"2664ad943354aac02f866578585d3cd8c45a3a8ab45f5b4ae6e9359420e9fbfe"} Mar 16 16:14:28 crc kubenswrapper[5120]: I0316 16:14:28.466818 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-xlnnr" event={"ID":"dd7a06d8-8dcb-4564-98a3-71818f740edf","Type":"ContainerDied","Data":"de7773ba77f86a78f37ead0524328f986e43d84f017126554438900754090596"} Mar 16 16:14:28 crc kubenswrapper[5120]: I0316 16:14:28.466866 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="de7773ba77f86a78f37ead0524328f986e43d84f017126554438900754090596" Mar 16 16:14:28 crc kubenswrapper[5120]: I0316 16:14:28.466929 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-xlnnr" Mar 16 16:14:28 crc kubenswrapper[5120]: I0316 16:14:28.504961 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=1.792055862 podStartE2EDuration="7.504943018s" podCreationTimestamp="2026-03-16 16:14:21 +0000 UTC" firstStartedPulling="2026-03-16 16:14:22.48154128 +0000 UTC m=+2564.635472937" lastFinishedPulling="2026-03-16 16:14:28.194428426 +0000 UTC m=+2570.348360093" observedRunningTime="2026-03-16 16:14:28.482485546 +0000 UTC m=+2570.636417203" watchObservedRunningTime="2026-03-16 16:14:28.504943018 +0000 UTC m=+2570.658874675" Mar 16 16:14:28 crc kubenswrapper[5120]: I0316 16:14:28.575202 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-54f764f5f6-t2dpg"] Mar 16 16:14:28 crc kubenswrapper[5120]: I0316 16:14:28.576276 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd7a06d8-8dcb-4564-98a3-71818f740edf" containerName="barbican-db-sync" Mar 16 16:14:28 crc kubenswrapper[5120]: I0316 16:14:28.576291 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd7a06d8-8dcb-4564-98a3-71818f740edf" containerName="barbican-db-sync" Mar 16 16:14:28 crc kubenswrapper[5120]: I0316 16:14:28.576315 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9228df3-a073-46d0-9eb2-345a0bef33a7" containerName="placement-db-sync" Mar 16 16:14:28 crc kubenswrapper[5120]: I0316 16:14:28.576321 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9228df3-a073-46d0-9eb2-345a0bef33a7" containerName="placement-db-sync" Mar 16 16:14:28 crc kubenswrapper[5120]: I0316 16:14:28.576456 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="dd7a06d8-8dcb-4564-98a3-71818f740edf" containerName="barbican-db-sync" Mar 16 16:14:28 crc kubenswrapper[5120]: I0316 16:14:28.576477 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="b9228df3-a073-46d0-9eb2-345a0bef33a7" containerName="placement-db-sync" Mar 16 16:14:28 crc kubenswrapper[5120]: I0316 16:14:28.585002 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-54f764f5f6-t2dpg" Mar 16 16:14:28 crc kubenswrapper[5120]: I0316 16:14:28.601215 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-scripts\"" Mar 16 16:14:28 crc kubenswrapper[5120]: I0316 16:14:28.601491 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-placement-internal-svc\"" Mar 16 16:14:28 crc kubenswrapper[5120]: I0316 16:14:28.601705 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-config-data\"" Mar 16 16:14:28 crc kubenswrapper[5120]: I0316 16:14:28.604138 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-54f764f5f6-t2dpg"] Mar 16 16:14:28 crc kubenswrapper[5120]: I0316 16:14:28.621410 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brvpb\" (UniqueName: \"kubernetes.io/projected/059e3299-784b-46be-9e1b-f0b81118a979-kube-api-access-brvpb\") pod \"placement-54f764f5f6-t2dpg\" (UID: \"059e3299-784b-46be-9e1b-f0b81118a979\") " pod="openstack-kuttl-tests/placement-54f764f5f6-t2dpg" Mar 16 16:14:28 crc kubenswrapper[5120]: I0316 16:14:28.621724 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/059e3299-784b-46be-9e1b-f0b81118a979-public-tls-certs\") pod \"placement-54f764f5f6-t2dpg\" (UID: \"059e3299-784b-46be-9e1b-f0b81118a979\") " pod="openstack-kuttl-tests/placement-54f764f5f6-t2dpg" Mar 16 16:14:28 crc kubenswrapper[5120]: I0316 16:14:28.621781 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/059e3299-784b-46be-9e1b-f0b81118a979-internal-tls-certs\") pod \"placement-54f764f5f6-t2dpg\" (UID: \"059e3299-784b-46be-9e1b-f0b81118a979\") " pod="openstack-kuttl-tests/placement-54f764f5f6-t2dpg" Mar 16 16:14:28 crc kubenswrapper[5120]: I0316 16:14:28.621835 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/059e3299-784b-46be-9e1b-f0b81118a979-combined-ca-bundle\") pod \"placement-54f764f5f6-t2dpg\" (UID: \"059e3299-784b-46be-9e1b-f0b81118a979\") " pod="openstack-kuttl-tests/placement-54f764f5f6-t2dpg" Mar 16 16:14:28 crc kubenswrapper[5120]: I0316 16:14:28.621857 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/059e3299-784b-46be-9e1b-f0b81118a979-scripts\") pod \"placement-54f764f5f6-t2dpg\" (UID: \"059e3299-784b-46be-9e1b-f0b81118a979\") " pod="openstack-kuttl-tests/placement-54f764f5f6-t2dpg" Mar 16 16:14:28 crc kubenswrapper[5120]: I0316 16:14:28.621914 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/059e3299-784b-46be-9e1b-f0b81118a979-config-data\") pod \"placement-54f764f5f6-t2dpg\" (UID: \"059e3299-784b-46be-9e1b-f0b81118a979\") " pod="openstack-kuttl-tests/placement-54f764f5f6-t2dpg" Mar 16 16:14:28 crc kubenswrapper[5120]: I0316 16:14:28.621969 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/059e3299-784b-46be-9e1b-f0b81118a979-logs\") pod \"placement-54f764f5f6-t2dpg\" (UID: \"059e3299-784b-46be-9e1b-f0b81118a979\") " pod="openstack-kuttl-tests/placement-54f764f5f6-t2dpg" Mar 16 16:14:28 crc kubenswrapper[5120]: I0316 16:14:28.632104 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-placement-public-svc\"" Mar 16 16:14:28 crc kubenswrapper[5120]: I0316 16:14:28.632337 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-placement-dockercfg-pxgj6\"" Mar 16 16:14:28 crc kubenswrapper[5120]: I0316 16:14:28.723811 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-brvpb\" (UniqueName: \"kubernetes.io/projected/059e3299-784b-46be-9e1b-f0b81118a979-kube-api-access-brvpb\") pod \"placement-54f764f5f6-t2dpg\" (UID: \"059e3299-784b-46be-9e1b-f0b81118a979\") " pod="openstack-kuttl-tests/placement-54f764f5f6-t2dpg" Mar 16 16:14:28 crc kubenswrapper[5120]: I0316 16:14:28.723860 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/059e3299-784b-46be-9e1b-f0b81118a979-public-tls-certs\") pod \"placement-54f764f5f6-t2dpg\" (UID: \"059e3299-784b-46be-9e1b-f0b81118a979\") " pod="openstack-kuttl-tests/placement-54f764f5f6-t2dpg" Mar 16 16:14:28 crc kubenswrapper[5120]: I0316 16:14:28.723906 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/059e3299-784b-46be-9e1b-f0b81118a979-internal-tls-certs\") pod \"placement-54f764f5f6-t2dpg\" (UID: \"059e3299-784b-46be-9e1b-f0b81118a979\") " pod="openstack-kuttl-tests/placement-54f764f5f6-t2dpg" Mar 16 16:14:28 crc kubenswrapper[5120]: I0316 16:14:28.723958 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/059e3299-784b-46be-9e1b-f0b81118a979-combined-ca-bundle\") pod \"placement-54f764f5f6-t2dpg\" (UID: \"059e3299-784b-46be-9e1b-f0b81118a979\") " pod="openstack-kuttl-tests/placement-54f764f5f6-t2dpg" Mar 16 16:14:28 crc kubenswrapper[5120]: I0316 16:14:28.723980 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/059e3299-784b-46be-9e1b-f0b81118a979-scripts\") pod \"placement-54f764f5f6-t2dpg\" (UID: \"059e3299-784b-46be-9e1b-f0b81118a979\") " pod="openstack-kuttl-tests/placement-54f764f5f6-t2dpg" Mar 16 16:14:28 crc kubenswrapper[5120]: I0316 16:14:28.724004 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/059e3299-784b-46be-9e1b-f0b81118a979-config-data\") pod \"placement-54f764f5f6-t2dpg\" (UID: \"059e3299-784b-46be-9e1b-f0b81118a979\") " pod="openstack-kuttl-tests/placement-54f764f5f6-t2dpg" Mar 16 16:14:28 crc kubenswrapper[5120]: I0316 16:14:28.724049 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/059e3299-784b-46be-9e1b-f0b81118a979-logs\") pod \"placement-54f764f5f6-t2dpg\" (UID: \"059e3299-784b-46be-9e1b-f0b81118a979\") " pod="openstack-kuttl-tests/placement-54f764f5f6-t2dpg" Mar 16 16:14:28 crc kubenswrapper[5120]: I0316 16:14:28.724576 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/059e3299-784b-46be-9e1b-f0b81118a979-logs\") pod \"placement-54f764f5f6-t2dpg\" (UID: \"059e3299-784b-46be-9e1b-f0b81118a979\") " pod="openstack-kuttl-tests/placement-54f764f5f6-t2dpg" Mar 16 16:14:28 crc kubenswrapper[5120]: I0316 16:14:28.738086 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/059e3299-784b-46be-9e1b-f0b81118a979-scripts\") pod \"placement-54f764f5f6-t2dpg\" (UID: \"059e3299-784b-46be-9e1b-f0b81118a979\") " pod="openstack-kuttl-tests/placement-54f764f5f6-t2dpg" Mar 16 16:14:28 crc kubenswrapper[5120]: I0316 16:14:28.739455 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/059e3299-784b-46be-9e1b-f0b81118a979-combined-ca-bundle\") pod \"placement-54f764f5f6-t2dpg\" (UID: \"059e3299-784b-46be-9e1b-f0b81118a979\") " pod="openstack-kuttl-tests/placement-54f764f5f6-t2dpg" Mar 16 16:14:28 crc kubenswrapper[5120]: I0316 16:14:28.742996 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/059e3299-784b-46be-9e1b-f0b81118a979-public-tls-certs\") pod \"placement-54f764f5f6-t2dpg\" (UID: \"059e3299-784b-46be-9e1b-f0b81118a979\") " pod="openstack-kuttl-tests/placement-54f764f5f6-t2dpg" Mar 16 16:14:28 crc kubenswrapper[5120]: I0316 16:14:28.743479 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/059e3299-784b-46be-9e1b-f0b81118a979-config-data\") pod \"placement-54f764f5f6-t2dpg\" (UID: \"059e3299-784b-46be-9e1b-f0b81118a979\") " pod="openstack-kuttl-tests/placement-54f764f5f6-t2dpg" Mar 16 16:14:28 crc kubenswrapper[5120]: I0316 16:14:28.751288 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/059e3299-784b-46be-9e1b-f0b81118a979-internal-tls-certs\") pod \"placement-54f764f5f6-t2dpg\" (UID: \"059e3299-784b-46be-9e1b-f0b81118a979\") " pod="openstack-kuttl-tests/placement-54f764f5f6-t2dpg" Mar 16 16:14:28 crc kubenswrapper[5120]: I0316 16:14:28.786453 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-brvpb\" (UniqueName: \"kubernetes.io/projected/059e3299-784b-46be-9e1b-f0b81118a979-kube-api-access-brvpb\") pod \"placement-54f764f5f6-t2dpg\" (UID: \"059e3299-784b-46be-9e1b-f0b81118a979\") " pod="openstack-kuttl-tests/placement-54f764f5f6-t2dpg" Mar 16 16:14:29 crc kubenswrapper[5120]: I0316 16:14:29.240410 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6737c256-2811-4a34-a374-8fc5c01563de" path="/var/lib/kubelet/pods/6737c256-2811-4a34-a374-8fc5c01563de/volumes" Mar 16 16:14:29 crc kubenswrapper[5120]: I0316 16:14:29.242489 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6756c5c8-6f61-48dd-8edb-1af889081753" path="/var/lib/kubelet/pods/6756c5c8-6f61-48dd-8edb-1af889081753/volumes" Mar 16 16:14:29 crc kubenswrapper[5120]: I0316 16:14:29.243221 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-worker-7c468d546f-vjd49"] Mar 16 16:14:29 crc kubenswrapper[5120]: I0316 16:14:29.262723 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-7c468d546f-vjd49" Mar 16 16:14:29 crc kubenswrapper[5120]: I0316 16:14:29.262924 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-7c468d546f-vjd49"] Mar 16 16:14:29 crc kubenswrapper[5120]: I0316 16:14:29.262970 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-6c79fccb98-ccmbb"] Mar 16 16:14:29 crc kubenswrapper[5120]: I0316 16:14:29.265413 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-worker-config-data\"" Mar 16 16:14:29 crc kubenswrapper[5120]: I0316 16:14:29.265636 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-barbican-dockercfg-8sgv7\"" Mar 16 16:14:29 crc kubenswrapper[5120]: I0316 16:14:29.266851 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-config-data\"" Mar 16 16:14:29 crc kubenswrapper[5120]: I0316 16:14:29.267971 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-6c79fccb98-ccmbb"] Mar 16 16:14:29 crc kubenswrapper[5120]: I0316 16:14:29.268089 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-6c79fccb98-ccmbb" Mar 16 16:14:29 crc kubenswrapper[5120]: I0316 16:14:29.268103 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:14:29 crc kubenswrapper[5120]: I0316 16:14:29.268324 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-api-79cb59c45b-x77rt"] Mar 16 16:14:29 crc kubenswrapper[5120]: I0316 16:14:29.269417 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-keystone-listener-config-data\"" Mar 16 16:14:29 crc kubenswrapper[5120]: I0316 16:14:29.273983 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-79cb59c45b-x77rt"] Mar 16 16:14:29 crc kubenswrapper[5120]: I0316 16:14:29.274223 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-79cb59c45b-x77rt" Mar 16 16:14:29 crc kubenswrapper[5120]: I0316 16:14:29.275549 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-api-config-data\"" Mar 16 16:14:29 crc kubenswrapper[5120]: I0316 16:14:29.361456 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrvpn\" (UniqueName: \"kubernetes.io/projected/e9b63ab0-f32f-4118-9e63-b82550c1d518-kube-api-access-qrvpn\") pod \"barbican-worker-7c468d546f-vjd49\" (UID: \"e9b63ab0-f32f-4118-9e63-b82550c1d518\") " pod="openstack-kuttl-tests/barbican-worker-7c468d546f-vjd49" Mar 16 16:14:29 crc kubenswrapper[5120]: I0316 16:14:29.361550 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c2631af3-9152-470b-8aa8-2395a88ec1ab-combined-ca-bundle\") pod \"barbican-keystone-listener-6c79fccb98-ccmbb\" (UID: \"c2631af3-9152-470b-8aa8-2395a88ec1ab\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6c79fccb98-ccmbb" Mar 16 16:14:29 crc kubenswrapper[5120]: I0316 16:14:29.361594 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c2631af3-9152-470b-8aa8-2395a88ec1ab-logs\") pod \"barbican-keystone-listener-6c79fccb98-ccmbb\" (UID: \"c2631af3-9152-470b-8aa8-2395a88ec1ab\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6c79fccb98-ccmbb" Mar 16 16:14:29 crc kubenswrapper[5120]: I0316 16:14:29.361722 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e9b63ab0-f32f-4118-9e63-b82550c1d518-combined-ca-bundle\") pod \"barbican-worker-7c468d546f-vjd49\" (UID: \"e9b63ab0-f32f-4118-9e63-b82550c1d518\") " pod="openstack-kuttl-tests/barbican-worker-7c468d546f-vjd49" Mar 16 16:14:29 crc kubenswrapper[5120]: I0316 16:14:29.361844 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e9b63ab0-f32f-4118-9e63-b82550c1d518-config-data\") pod \"barbican-worker-7c468d546f-vjd49\" (UID: \"e9b63ab0-f32f-4118-9e63-b82550c1d518\") " pod="openstack-kuttl-tests/barbican-worker-7c468d546f-vjd49" Mar 16 16:14:29 crc kubenswrapper[5120]: I0316 16:14:29.361874 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e9b63ab0-f32f-4118-9e63-b82550c1d518-logs\") pod \"barbican-worker-7c468d546f-vjd49\" (UID: \"e9b63ab0-f32f-4118-9e63-b82550c1d518\") " pod="openstack-kuttl-tests/barbican-worker-7c468d546f-vjd49" Mar 16 16:14:29 crc kubenswrapper[5120]: I0316 16:14:29.361901 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c2631af3-9152-470b-8aa8-2395a88ec1ab-config-data\") pod \"barbican-keystone-listener-6c79fccb98-ccmbb\" (UID: \"c2631af3-9152-470b-8aa8-2395a88ec1ab\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6c79fccb98-ccmbb" Mar 16 16:14:29 crc kubenswrapper[5120]: I0316 16:14:29.361919 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8c8k\" (UniqueName: \"kubernetes.io/projected/c2631af3-9152-470b-8aa8-2395a88ec1ab-kube-api-access-m8c8k\") pod \"barbican-keystone-listener-6c79fccb98-ccmbb\" (UID: \"c2631af3-9152-470b-8aa8-2395a88ec1ab\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6c79fccb98-ccmbb" Mar 16 16:14:29 crc kubenswrapper[5120]: I0316 16:14:29.361937 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/e9b63ab0-f32f-4118-9e63-b82550c1d518-config-data-custom\") pod \"barbican-worker-7c468d546f-vjd49\" (UID: \"e9b63ab0-f32f-4118-9e63-b82550c1d518\") " pod="openstack-kuttl-tests/barbican-worker-7c468d546f-vjd49" Mar 16 16:14:29 crc kubenswrapper[5120]: I0316 16:14:29.362160 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/c2631af3-9152-470b-8aa8-2395a88ec1ab-config-data-custom\") pod \"barbican-keystone-listener-6c79fccb98-ccmbb\" (UID: \"c2631af3-9152-470b-8aa8-2395a88ec1ab\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6c79fccb98-ccmbb" Mar 16 16:14:29 crc kubenswrapper[5120]: I0316 16:14:29.378269 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-54f764f5f6-t2dpg" Mar 16 16:14:29 crc kubenswrapper[5120]: I0316 16:14:29.390265 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-m4lq5" Mar 16 16:14:29 crc kubenswrapper[5120]: I0316 16:14:29.464147 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghk8w\" (UniqueName: \"kubernetes.io/projected/32e01c7b-7af9-4cc6-8f41-d951345e0fe4-kube-api-access-ghk8w\") pod \"barbican-api-79cb59c45b-x77rt\" (UID: \"32e01c7b-7af9-4cc6-8f41-d951345e0fe4\") " pod="openstack-kuttl-tests/barbican-api-79cb59c45b-x77rt" Mar 16 16:14:29 crc kubenswrapper[5120]: I0316 16:14:29.464208 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/c2631af3-9152-470b-8aa8-2395a88ec1ab-config-data-custom\") pod \"barbican-keystone-listener-6c79fccb98-ccmbb\" (UID: \"c2631af3-9152-470b-8aa8-2395a88ec1ab\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6c79fccb98-ccmbb" Mar 16 16:14:29 crc kubenswrapper[5120]: I0316 16:14:29.464364 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/32e01c7b-7af9-4cc6-8f41-d951345e0fe4-config-data\") pod \"barbican-api-79cb59c45b-x77rt\" (UID: \"32e01c7b-7af9-4cc6-8f41-d951345e0fe4\") " pod="openstack-kuttl-tests/barbican-api-79cb59c45b-x77rt" Mar 16 16:14:29 crc kubenswrapper[5120]: I0316 16:14:29.464421 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/32e01c7b-7af9-4cc6-8f41-d951345e0fe4-combined-ca-bundle\") pod \"barbican-api-79cb59c45b-x77rt\" (UID: \"32e01c7b-7af9-4cc6-8f41-d951345e0fe4\") " pod="openstack-kuttl-tests/barbican-api-79cb59c45b-x77rt" Mar 16 16:14:29 crc kubenswrapper[5120]: I0316 16:14:29.464627 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qrvpn\" (UniqueName: \"kubernetes.io/projected/e9b63ab0-f32f-4118-9e63-b82550c1d518-kube-api-access-qrvpn\") pod \"barbican-worker-7c468d546f-vjd49\" (UID: \"e9b63ab0-f32f-4118-9e63-b82550c1d518\") " pod="openstack-kuttl-tests/barbican-worker-7c468d546f-vjd49" Mar 16 16:14:29 crc kubenswrapper[5120]: I0316 16:14:29.464694 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c2631af3-9152-470b-8aa8-2395a88ec1ab-combined-ca-bundle\") pod \"barbican-keystone-listener-6c79fccb98-ccmbb\" (UID: \"c2631af3-9152-470b-8aa8-2395a88ec1ab\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6c79fccb98-ccmbb" Mar 16 16:14:29 crc kubenswrapper[5120]: I0316 16:14:29.464752 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c2631af3-9152-470b-8aa8-2395a88ec1ab-logs\") pod \"barbican-keystone-listener-6c79fccb98-ccmbb\" (UID: \"c2631af3-9152-470b-8aa8-2395a88ec1ab\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6c79fccb98-ccmbb" Mar 16 16:14:29 crc kubenswrapper[5120]: I0316 16:14:29.464879 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e9b63ab0-f32f-4118-9e63-b82550c1d518-combined-ca-bundle\") pod \"barbican-worker-7c468d546f-vjd49\" (UID: \"e9b63ab0-f32f-4118-9e63-b82550c1d518\") " pod="openstack-kuttl-tests/barbican-worker-7c468d546f-vjd49" Mar 16 16:14:29 crc kubenswrapper[5120]: I0316 16:14:29.464985 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e9b63ab0-f32f-4118-9e63-b82550c1d518-config-data\") pod \"barbican-worker-7c468d546f-vjd49\" (UID: \"e9b63ab0-f32f-4118-9e63-b82550c1d518\") " pod="openstack-kuttl-tests/barbican-worker-7c468d546f-vjd49" Mar 16 16:14:29 crc kubenswrapper[5120]: I0316 16:14:29.465016 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/32e01c7b-7af9-4cc6-8f41-d951345e0fe4-config-data-custom\") pod \"barbican-api-79cb59c45b-x77rt\" (UID: \"32e01c7b-7af9-4cc6-8f41-d951345e0fe4\") " pod="openstack-kuttl-tests/barbican-api-79cb59c45b-x77rt" Mar 16 16:14:29 crc kubenswrapper[5120]: I0316 16:14:29.465039 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e9b63ab0-f32f-4118-9e63-b82550c1d518-logs\") pod \"barbican-worker-7c468d546f-vjd49\" (UID: \"e9b63ab0-f32f-4118-9e63-b82550c1d518\") " pod="openstack-kuttl-tests/barbican-worker-7c468d546f-vjd49" Mar 16 16:14:29 crc kubenswrapper[5120]: I0316 16:14:29.465602 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c2631af3-9152-470b-8aa8-2395a88ec1ab-logs\") pod \"barbican-keystone-listener-6c79fccb98-ccmbb\" (UID: \"c2631af3-9152-470b-8aa8-2395a88ec1ab\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6c79fccb98-ccmbb" Mar 16 16:14:29 crc kubenswrapper[5120]: I0316 16:14:29.465828 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e9b63ab0-f32f-4118-9e63-b82550c1d518-logs\") pod \"barbican-worker-7c468d546f-vjd49\" (UID: \"e9b63ab0-f32f-4118-9e63-b82550c1d518\") " pod="openstack-kuttl-tests/barbican-worker-7c468d546f-vjd49" Mar 16 16:14:29 crc kubenswrapper[5120]: I0316 16:14:29.466790 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c2631af3-9152-470b-8aa8-2395a88ec1ab-config-data\") pod \"barbican-keystone-listener-6c79fccb98-ccmbb\" (UID: \"c2631af3-9152-470b-8aa8-2395a88ec1ab\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6c79fccb98-ccmbb" Mar 16 16:14:29 crc kubenswrapper[5120]: I0316 16:14:29.466836 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m8c8k\" (UniqueName: \"kubernetes.io/projected/c2631af3-9152-470b-8aa8-2395a88ec1ab-kube-api-access-m8c8k\") pod \"barbican-keystone-listener-6c79fccb98-ccmbb\" (UID: \"c2631af3-9152-470b-8aa8-2395a88ec1ab\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6c79fccb98-ccmbb" Mar 16 16:14:29 crc kubenswrapper[5120]: I0316 16:14:29.466859 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/32e01c7b-7af9-4cc6-8f41-d951345e0fe4-logs\") pod \"barbican-api-79cb59c45b-x77rt\" (UID: \"32e01c7b-7af9-4cc6-8f41-d951345e0fe4\") " pod="openstack-kuttl-tests/barbican-api-79cb59c45b-x77rt" Mar 16 16:14:29 crc kubenswrapper[5120]: I0316 16:14:29.466919 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/e9b63ab0-f32f-4118-9e63-b82550c1d518-config-data-custom\") pod \"barbican-worker-7c468d546f-vjd49\" (UID: \"e9b63ab0-f32f-4118-9e63-b82550c1d518\") " pod="openstack-kuttl-tests/barbican-worker-7c468d546f-vjd49" Mar 16 16:14:29 crc kubenswrapper[5120]: I0316 16:14:29.472736 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/e9b63ab0-f32f-4118-9e63-b82550c1d518-config-data-custom\") pod \"barbican-worker-7c468d546f-vjd49\" (UID: \"e9b63ab0-f32f-4118-9e63-b82550c1d518\") " pod="openstack-kuttl-tests/barbican-worker-7c468d546f-vjd49" Mar 16 16:14:29 crc kubenswrapper[5120]: I0316 16:14:29.476424 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e9b63ab0-f32f-4118-9e63-b82550c1d518-config-data\") pod \"barbican-worker-7c468d546f-vjd49\" (UID: \"e9b63ab0-f32f-4118-9e63-b82550c1d518\") " pod="openstack-kuttl-tests/barbican-worker-7c468d546f-vjd49" Mar 16 16:14:29 crc kubenswrapper[5120]: I0316 16:14:29.477568 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e9b63ab0-f32f-4118-9e63-b82550c1d518-combined-ca-bundle\") pod \"barbican-worker-7c468d546f-vjd49\" (UID: \"e9b63ab0-f32f-4118-9e63-b82550c1d518\") " pod="openstack-kuttl-tests/barbican-worker-7c468d546f-vjd49" Mar 16 16:14:29 crc kubenswrapper[5120]: I0316 16:14:29.477858 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c2631af3-9152-470b-8aa8-2395a88ec1ab-config-data\") pod \"barbican-keystone-listener-6c79fccb98-ccmbb\" (UID: \"c2631af3-9152-470b-8aa8-2395a88ec1ab\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6c79fccb98-ccmbb" Mar 16 16:14:29 crc kubenswrapper[5120]: I0316 16:14:29.478099 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c2631af3-9152-470b-8aa8-2395a88ec1ab-combined-ca-bundle\") pod \"barbican-keystone-listener-6c79fccb98-ccmbb\" (UID: \"c2631af3-9152-470b-8aa8-2395a88ec1ab\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6c79fccb98-ccmbb" Mar 16 16:14:29 crc kubenswrapper[5120]: I0316 16:14:29.479674 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/c2631af3-9152-470b-8aa8-2395a88ec1ab-config-data-custom\") pod \"barbican-keystone-listener-6c79fccb98-ccmbb\" (UID: \"c2631af3-9152-470b-8aa8-2395a88ec1ab\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6c79fccb98-ccmbb" Mar 16 16:14:29 crc kubenswrapper[5120]: I0316 16:14:29.483981 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8c8k\" (UniqueName: \"kubernetes.io/projected/c2631af3-9152-470b-8aa8-2395a88ec1ab-kube-api-access-m8c8k\") pod \"barbican-keystone-listener-6c79fccb98-ccmbb\" (UID: \"c2631af3-9152-470b-8aa8-2395a88ec1ab\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6c79fccb98-ccmbb" Mar 16 16:14:29 crc kubenswrapper[5120]: I0316 16:14:29.488204 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrvpn\" (UniqueName: \"kubernetes.io/projected/e9b63ab0-f32f-4118-9e63-b82550c1d518-kube-api-access-qrvpn\") pod \"barbican-worker-7c468d546f-vjd49\" (UID: \"e9b63ab0-f32f-4118-9e63-b82550c1d518\") " pod="openstack-kuttl-tests/barbican-worker-7c468d546f-vjd49" Mar 16 16:14:29 crc kubenswrapper[5120]: I0316 16:14:29.504923 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-m4lq5"] Mar 16 16:14:29 crc kubenswrapper[5120]: I0316 16:14:29.510670 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"e8c1b04b-5169-424c-aa78-d0ed21f9ad44","Type":"ContainerStarted","Data":"03716c966de3b06a98abf1daffd2ca9e41d5a4950118816b8a8b38ef9bfaf786"} Mar 16 16:14:29 crc kubenswrapper[5120]: I0316 16:14:29.515854 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-m4lq5"] Mar 16 16:14:29 crc kubenswrapper[5120]: I0316 16:14:29.517785 5120 generic.go:358] "Generic (PLEG): container finished" podID="0a87bbbf-8ee3-4693-b9b5-516b2a3b67db" containerID="12d94346012a092ddc802ca4931d0ab66bceeb5ca24bb14d5ae95396305aa3e4" exitCode=2 Mar 16 16:14:29 crc kubenswrapper[5120]: I0316 16:14:29.517806 5120 generic.go:358] "Generic (PLEG): container finished" podID="0a87bbbf-8ee3-4693-b9b5-516b2a3b67db" containerID="08ccfa701ccc79e179b5858e89491726e9dec73be4bb965be4c99483916a7780" exitCode=0 Mar 16 16:14:29 crc kubenswrapper[5120]: I0316 16:14:29.517813 5120 generic.go:358] "Generic (PLEG): container finished" podID="0a87bbbf-8ee3-4693-b9b5-516b2a3b67db" containerID="79637f72d630e71184d826945a6cfef9d4ce56f998543c651ec1c860e579b64a" exitCode=0 Mar 16 16:14:29 crc kubenswrapper[5120]: I0316 16:14:29.517942 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"0a87bbbf-8ee3-4693-b9b5-516b2a3b67db","Type":"ContainerDied","Data":"12d94346012a092ddc802ca4931d0ab66bceeb5ca24bb14d5ae95396305aa3e4"} Mar 16 16:14:29 crc kubenswrapper[5120]: I0316 16:14:29.518197 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"0a87bbbf-8ee3-4693-b9b5-516b2a3b67db","Type":"ContainerDied","Data":"08ccfa701ccc79e179b5858e89491726e9dec73be4bb965be4c99483916a7780"} Mar 16 16:14:29 crc kubenswrapper[5120]: I0316 16:14:29.518232 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"0a87bbbf-8ee3-4693-b9b5-516b2a3b67db","Type":"ContainerDied","Data":"79637f72d630e71184d826945a6cfef9d4ce56f998543c651ec1c860e579b64a"} Mar 16 16:14:29 crc kubenswrapper[5120]: I0316 16:14:29.521070 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dfeb742c11b2a199a67179402d5e12d9be12b54e848ed649976e86eea98a7265" Mar 16 16:14:29 crc kubenswrapper[5120]: I0316 16:14:29.521139 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-m4lq5" Mar 16 16:14:29 crc kubenswrapper[5120]: I0316 16:14:29.568441 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/67ce2cee-a80e-45e8-978a-b236ef1c8c40-config-data\") pod \"67ce2cee-a80e-45e8-978a-b236ef1c8c40\" (UID: \"67ce2cee-a80e-45e8-978a-b236ef1c8c40\") " Mar 16 16:14:29 crc kubenswrapper[5120]: I0316 16:14:29.569408 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vlqzx\" (UniqueName: \"kubernetes.io/projected/67ce2cee-a80e-45e8-978a-b236ef1c8c40-kube-api-access-vlqzx\") pod \"67ce2cee-a80e-45e8-978a-b236ef1c8c40\" (UID: \"67ce2cee-a80e-45e8-978a-b236ef1c8c40\") " Mar 16 16:14:29 crc kubenswrapper[5120]: I0316 16:14:29.574947 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67ce2cee-a80e-45e8-978a-b236ef1c8c40-kube-api-access-vlqzx" (OuterVolumeSpecName: "kube-api-access-vlqzx") pod "67ce2cee-a80e-45e8-978a-b236ef1c8c40" (UID: "67ce2cee-a80e-45e8-978a-b236ef1c8c40"). InnerVolumeSpecName "kube-api-access-vlqzx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:14:29 crc kubenswrapper[5120]: I0316 16:14:29.586507 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/67ce2cee-a80e-45e8-978a-b236ef1c8c40-credential-keys\") pod \"67ce2cee-a80e-45e8-978a-b236ef1c8c40\" (UID: \"67ce2cee-a80e-45e8-978a-b236ef1c8c40\") " Mar 16 16:14:29 crc kubenswrapper[5120]: I0316 16:14:29.586594 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/67ce2cee-a80e-45e8-978a-b236ef1c8c40-combined-ca-bundle\") pod \"67ce2cee-a80e-45e8-978a-b236ef1c8c40\" (UID: \"67ce2cee-a80e-45e8-978a-b236ef1c8c40\") " Mar 16 16:14:29 crc kubenswrapper[5120]: I0316 16:14:29.586856 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/67ce2cee-a80e-45e8-978a-b236ef1c8c40-scripts\") pod \"67ce2cee-a80e-45e8-978a-b236ef1c8c40\" (UID: \"67ce2cee-a80e-45e8-978a-b236ef1c8c40\") " Mar 16 16:14:29 crc kubenswrapper[5120]: I0316 16:14:29.586891 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/67ce2cee-a80e-45e8-978a-b236ef1c8c40-fernet-keys\") pod \"67ce2cee-a80e-45e8-978a-b236ef1c8c40\" (UID: \"67ce2cee-a80e-45e8-978a-b236ef1c8c40\") " Mar 16 16:14:29 crc kubenswrapper[5120]: I0316 16:14:29.587290 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/32e01c7b-7af9-4cc6-8f41-d951345e0fe4-config-data-custom\") pod \"barbican-api-79cb59c45b-x77rt\" (UID: \"32e01c7b-7af9-4cc6-8f41-d951345e0fe4\") " pod="openstack-kuttl-tests/barbican-api-79cb59c45b-x77rt" Mar 16 16:14:29 crc kubenswrapper[5120]: I0316 16:14:29.587342 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/32e01c7b-7af9-4cc6-8f41-d951345e0fe4-logs\") pod \"barbican-api-79cb59c45b-x77rt\" (UID: \"32e01c7b-7af9-4cc6-8f41-d951345e0fe4\") " pod="openstack-kuttl-tests/barbican-api-79cb59c45b-x77rt" Mar 16 16:14:29 crc kubenswrapper[5120]: I0316 16:14:29.587615 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ghk8w\" (UniqueName: \"kubernetes.io/projected/32e01c7b-7af9-4cc6-8f41-d951345e0fe4-kube-api-access-ghk8w\") pod \"barbican-api-79cb59c45b-x77rt\" (UID: \"32e01c7b-7af9-4cc6-8f41-d951345e0fe4\") " pod="openstack-kuttl-tests/barbican-api-79cb59c45b-x77rt" Mar 16 16:14:29 crc kubenswrapper[5120]: I0316 16:14:29.587732 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/32e01c7b-7af9-4cc6-8f41-d951345e0fe4-config-data\") pod \"barbican-api-79cb59c45b-x77rt\" (UID: \"32e01c7b-7af9-4cc6-8f41-d951345e0fe4\") " pod="openstack-kuttl-tests/barbican-api-79cb59c45b-x77rt" Mar 16 16:14:29 crc kubenswrapper[5120]: I0316 16:14:29.587794 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/32e01c7b-7af9-4cc6-8f41-d951345e0fe4-combined-ca-bundle\") pod \"barbican-api-79cb59c45b-x77rt\" (UID: \"32e01c7b-7af9-4cc6-8f41-d951345e0fe4\") " pod="openstack-kuttl-tests/barbican-api-79cb59c45b-x77rt" Mar 16 16:14:29 crc kubenswrapper[5120]: I0316 16:14:29.588044 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vlqzx\" (UniqueName: \"kubernetes.io/projected/67ce2cee-a80e-45e8-978a-b236ef1c8c40-kube-api-access-vlqzx\") on node \"crc\" DevicePath \"\"" Mar 16 16:14:29 crc kubenswrapper[5120]: I0316 16:14:29.595298 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/32e01c7b-7af9-4cc6-8f41-d951345e0fe4-config-data-custom\") pod \"barbican-api-79cb59c45b-x77rt\" (UID: \"32e01c7b-7af9-4cc6-8f41-d951345e0fe4\") " pod="openstack-kuttl-tests/barbican-api-79cb59c45b-x77rt" Mar 16 16:14:29 crc kubenswrapper[5120]: I0316 16:14:29.595542 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/32e01c7b-7af9-4cc6-8f41-d951345e0fe4-logs\") pod \"barbican-api-79cb59c45b-x77rt\" (UID: \"32e01c7b-7af9-4cc6-8f41-d951345e0fe4\") " pod="openstack-kuttl-tests/barbican-api-79cb59c45b-x77rt" Mar 16 16:14:29 crc kubenswrapper[5120]: I0316 16:14:29.597074 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/32e01c7b-7af9-4cc6-8f41-d951345e0fe4-combined-ca-bundle\") pod \"barbican-api-79cb59c45b-x77rt\" (UID: \"32e01c7b-7af9-4cc6-8f41-d951345e0fe4\") " pod="openstack-kuttl-tests/barbican-api-79cb59c45b-x77rt" Mar 16 16:14:29 crc kubenswrapper[5120]: I0316 16:14:29.597141 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/67ce2cee-a80e-45e8-978a-b236ef1c8c40-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "67ce2cee-a80e-45e8-978a-b236ef1c8c40" (UID: "67ce2cee-a80e-45e8-978a-b236ef1c8c40"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:14:29 crc kubenswrapper[5120]: I0316 16:14:29.597542 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/67ce2cee-a80e-45e8-978a-b236ef1c8c40-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "67ce2cee-a80e-45e8-978a-b236ef1c8c40" (UID: "67ce2cee-a80e-45e8-978a-b236ef1c8c40"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:14:29 crc kubenswrapper[5120]: I0316 16:14:29.602997 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/32e01c7b-7af9-4cc6-8f41-d951345e0fe4-config-data\") pod \"barbican-api-79cb59c45b-x77rt\" (UID: \"32e01c7b-7af9-4cc6-8f41-d951345e0fe4\") " pod="openstack-kuttl-tests/barbican-api-79cb59c45b-x77rt" Mar 16 16:14:29 crc kubenswrapper[5120]: I0316 16:14:29.616254 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/67ce2cee-a80e-45e8-978a-b236ef1c8c40-scripts" (OuterVolumeSpecName: "scripts") pod "67ce2cee-a80e-45e8-978a-b236ef1c8c40" (UID: "67ce2cee-a80e-45e8-978a-b236ef1c8c40"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:14:29 crc kubenswrapper[5120]: I0316 16:14:29.617068 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghk8w\" (UniqueName: \"kubernetes.io/projected/32e01c7b-7af9-4cc6-8f41-d951345e0fe4-kube-api-access-ghk8w\") pod \"barbican-api-79cb59c45b-x77rt\" (UID: \"32e01c7b-7af9-4cc6-8f41-d951345e0fe4\") " pod="openstack-kuttl-tests/barbican-api-79cb59c45b-x77rt" Mar 16 16:14:29 crc kubenswrapper[5120]: I0316 16:14:29.618381 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-cl2jb"] Mar 16 16:14:29 crc kubenswrapper[5120]: I0316 16:14:29.621008 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/67ce2cee-a80e-45e8-978a-b236ef1c8c40-config-data" (OuterVolumeSpecName: "config-data") pod "67ce2cee-a80e-45e8-978a-b236ef1c8c40" (UID: "67ce2cee-a80e-45e8-978a-b236ef1c8c40"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:14:29 crc kubenswrapper[5120]: I0316 16:14:29.625481 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67ce2cee-a80e-45e8-978a-b236ef1c8c40" containerName="keystone-bootstrap" Mar 16 16:14:29 crc kubenswrapper[5120]: I0316 16:14:29.625506 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="67ce2cee-a80e-45e8-978a-b236ef1c8c40" containerName="keystone-bootstrap" Mar 16 16:14:29 crc kubenswrapper[5120]: I0316 16:14:29.625661 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="67ce2cee-a80e-45e8-978a-b236ef1c8c40" containerName="keystone-bootstrap" Mar 16 16:14:29 crc kubenswrapper[5120]: I0316 16:14:29.633902 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/67ce2cee-a80e-45e8-978a-b236ef1c8c40-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "67ce2cee-a80e-45e8-978a-b236ef1c8c40" (UID: "67ce2cee-a80e-45e8-978a-b236ef1c8c40"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:14:29 crc kubenswrapper[5120]: I0316 16:14:29.644165 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-cl2jb"] Mar 16 16:14:29 crc kubenswrapper[5120]: I0316 16:14:29.644284 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-cl2jb" Mar 16 16:14:29 crc kubenswrapper[5120]: I0316 16:14:29.690666 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4f1dba2e-ff26-4e74-9322-65f013a2f969-combined-ca-bundle\") pod \"keystone-bootstrap-cl2jb\" (UID: \"4f1dba2e-ff26-4e74-9322-65f013a2f969\") " pod="openstack-kuttl-tests/keystone-bootstrap-cl2jb" Mar 16 16:14:29 crc kubenswrapper[5120]: I0316 16:14:29.690856 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4f1dba2e-ff26-4e74-9322-65f013a2f969-config-data\") pod \"keystone-bootstrap-cl2jb\" (UID: \"4f1dba2e-ff26-4e74-9322-65f013a2f969\") " pod="openstack-kuttl-tests/keystone-bootstrap-cl2jb" Mar 16 16:14:29 crc kubenswrapper[5120]: I0316 16:14:29.691324 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/4f1dba2e-ff26-4e74-9322-65f013a2f969-credential-keys\") pod \"keystone-bootstrap-cl2jb\" (UID: \"4f1dba2e-ff26-4e74-9322-65f013a2f969\") " pod="openstack-kuttl-tests/keystone-bootstrap-cl2jb" Mar 16 16:14:29 crc kubenswrapper[5120]: I0316 16:14:29.691377 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4f1dba2e-ff26-4e74-9322-65f013a2f969-scripts\") pod \"keystone-bootstrap-cl2jb\" (UID: \"4f1dba2e-ff26-4e74-9322-65f013a2f969\") " pod="openstack-kuttl-tests/keystone-bootstrap-cl2jb" Mar 16 16:14:29 crc kubenswrapper[5120]: I0316 16:14:29.691479 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhkbz\" (UniqueName: \"kubernetes.io/projected/4f1dba2e-ff26-4e74-9322-65f013a2f969-kube-api-access-qhkbz\") pod \"keystone-bootstrap-cl2jb\" (UID: \"4f1dba2e-ff26-4e74-9322-65f013a2f969\") " pod="openstack-kuttl-tests/keystone-bootstrap-cl2jb" Mar 16 16:14:29 crc kubenswrapper[5120]: I0316 16:14:29.691567 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/4f1dba2e-ff26-4e74-9322-65f013a2f969-fernet-keys\") pod \"keystone-bootstrap-cl2jb\" (UID: \"4f1dba2e-ff26-4e74-9322-65f013a2f969\") " pod="openstack-kuttl-tests/keystone-bootstrap-cl2jb" Mar 16 16:14:29 crc kubenswrapper[5120]: I0316 16:14:29.691655 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/67ce2cee-a80e-45e8-978a-b236ef1c8c40-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:14:29 crc kubenswrapper[5120]: I0316 16:14:29.691668 5120 reconciler_common.go:299] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/67ce2cee-a80e-45e8-978a-b236ef1c8c40-fernet-keys\") on node \"crc\" DevicePath \"\"" Mar 16 16:14:29 crc kubenswrapper[5120]: I0316 16:14:29.691678 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/67ce2cee-a80e-45e8-978a-b236ef1c8c40-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:14:29 crc kubenswrapper[5120]: I0316 16:14:29.691686 5120 reconciler_common.go:299] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/67ce2cee-a80e-45e8-978a-b236ef1c8c40-credential-keys\") on node \"crc\" DevicePath \"\"" Mar 16 16:14:29 crc kubenswrapper[5120]: I0316 16:14:29.691697 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/67ce2cee-a80e-45e8-978a-b236ef1c8c40-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:14:29 crc kubenswrapper[5120]: I0316 16:14:29.696290 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-7c468d546f-vjd49" Mar 16 16:14:29 crc kubenswrapper[5120]: I0316 16:14:29.721681 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-6c79fccb98-ccmbb" Mar 16 16:14:29 crc kubenswrapper[5120]: I0316 16:14:29.725948 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-79cb59c45b-x77rt" Mar 16 16:14:29 crc kubenswrapper[5120]: I0316 16:14:29.794952 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4f1dba2e-ff26-4e74-9322-65f013a2f969-combined-ca-bundle\") pod \"keystone-bootstrap-cl2jb\" (UID: \"4f1dba2e-ff26-4e74-9322-65f013a2f969\") " pod="openstack-kuttl-tests/keystone-bootstrap-cl2jb" Mar 16 16:14:29 crc kubenswrapper[5120]: I0316 16:14:29.795043 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4f1dba2e-ff26-4e74-9322-65f013a2f969-config-data\") pod \"keystone-bootstrap-cl2jb\" (UID: \"4f1dba2e-ff26-4e74-9322-65f013a2f969\") " pod="openstack-kuttl-tests/keystone-bootstrap-cl2jb" Mar 16 16:14:29 crc kubenswrapper[5120]: I0316 16:14:29.795174 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/4f1dba2e-ff26-4e74-9322-65f013a2f969-credential-keys\") pod \"keystone-bootstrap-cl2jb\" (UID: \"4f1dba2e-ff26-4e74-9322-65f013a2f969\") " pod="openstack-kuttl-tests/keystone-bootstrap-cl2jb" Mar 16 16:14:29 crc kubenswrapper[5120]: I0316 16:14:29.795203 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4f1dba2e-ff26-4e74-9322-65f013a2f969-scripts\") pod \"keystone-bootstrap-cl2jb\" (UID: \"4f1dba2e-ff26-4e74-9322-65f013a2f969\") " pod="openstack-kuttl-tests/keystone-bootstrap-cl2jb" Mar 16 16:14:29 crc kubenswrapper[5120]: I0316 16:14:29.795270 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qhkbz\" (UniqueName: \"kubernetes.io/projected/4f1dba2e-ff26-4e74-9322-65f013a2f969-kube-api-access-qhkbz\") pod \"keystone-bootstrap-cl2jb\" (UID: \"4f1dba2e-ff26-4e74-9322-65f013a2f969\") " pod="openstack-kuttl-tests/keystone-bootstrap-cl2jb" Mar 16 16:14:29 crc kubenswrapper[5120]: I0316 16:14:29.795331 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/4f1dba2e-ff26-4e74-9322-65f013a2f969-fernet-keys\") pod \"keystone-bootstrap-cl2jb\" (UID: \"4f1dba2e-ff26-4e74-9322-65f013a2f969\") " pod="openstack-kuttl-tests/keystone-bootstrap-cl2jb" Mar 16 16:14:29 crc kubenswrapper[5120]: I0316 16:14:29.803932 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4f1dba2e-ff26-4e74-9322-65f013a2f969-config-data\") pod \"keystone-bootstrap-cl2jb\" (UID: \"4f1dba2e-ff26-4e74-9322-65f013a2f969\") " pod="openstack-kuttl-tests/keystone-bootstrap-cl2jb" Mar 16 16:14:29 crc kubenswrapper[5120]: I0316 16:14:29.804807 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/4f1dba2e-ff26-4e74-9322-65f013a2f969-fernet-keys\") pod \"keystone-bootstrap-cl2jb\" (UID: \"4f1dba2e-ff26-4e74-9322-65f013a2f969\") " pod="openstack-kuttl-tests/keystone-bootstrap-cl2jb" Mar 16 16:14:29 crc kubenswrapper[5120]: I0316 16:14:29.806046 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4f1dba2e-ff26-4e74-9322-65f013a2f969-combined-ca-bundle\") pod \"keystone-bootstrap-cl2jb\" (UID: \"4f1dba2e-ff26-4e74-9322-65f013a2f969\") " pod="openstack-kuttl-tests/keystone-bootstrap-cl2jb" Mar 16 16:14:29 crc kubenswrapper[5120]: I0316 16:14:29.809516 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/4f1dba2e-ff26-4e74-9322-65f013a2f969-credential-keys\") pod \"keystone-bootstrap-cl2jb\" (UID: \"4f1dba2e-ff26-4e74-9322-65f013a2f969\") " pod="openstack-kuttl-tests/keystone-bootstrap-cl2jb" Mar 16 16:14:29 crc kubenswrapper[5120]: I0316 16:14:29.819405 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhkbz\" (UniqueName: \"kubernetes.io/projected/4f1dba2e-ff26-4e74-9322-65f013a2f969-kube-api-access-qhkbz\") pod \"keystone-bootstrap-cl2jb\" (UID: \"4f1dba2e-ff26-4e74-9322-65f013a2f969\") " pod="openstack-kuttl-tests/keystone-bootstrap-cl2jb" Mar 16 16:14:29 crc kubenswrapper[5120]: I0316 16:14:29.821149 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4f1dba2e-ff26-4e74-9322-65f013a2f969-scripts\") pod \"keystone-bootstrap-cl2jb\" (UID: \"4f1dba2e-ff26-4e74-9322-65f013a2f969\") " pod="openstack-kuttl-tests/keystone-bootstrap-cl2jb" Mar 16 16:14:29 crc kubenswrapper[5120]: I0316 16:14:29.840333 5120 status_manager.go:895] "Failed to get status for pod" podUID="67ce2cee-a80e-45e8-978a-b236ef1c8c40" pod="openstack-kuttl-tests/keystone-bootstrap-m4lq5" err="pods \"keystone-bootstrap-m4lq5\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 16:14:29 crc kubenswrapper[5120]: I0316 16:14:29.966472 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-54f764f5f6-t2dpg"] Mar 16 16:14:29 crc kubenswrapper[5120]: I0316 16:14:29.968777 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-cl2jb" Mar 16 16:14:30 crc kubenswrapper[5120]: W0316 16:14:30.025347 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod059e3299_784b_46be_9e1b_f0b81118a979.slice/crio-fd9ed33f26264de8b2cd2d34cb5494f6e8f04abb8a30263606d5bf8544d686df WatchSource:0}: Error finding container fd9ed33f26264de8b2cd2d34cb5494f6e8f04abb8a30263606d5bf8544d686df: Status 404 returned error can't find the container with id fd9ed33f26264de8b2cd2d34cb5494f6e8f04abb8a30263606d5bf8544d686df Mar 16 16:14:30 crc kubenswrapper[5120]: I0316 16:14:30.302928 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-7c468d546f-vjd49"] Mar 16 16:14:30 crc kubenswrapper[5120]: W0316 16:14:30.306621 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode9b63ab0_f32f_4118_9e63_b82550c1d518.slice/crio-9e478a7bed00dac4ab7ca59f44ce85de419ff302f8c1672b34b9e449528725ed WatchSource:0}: Error finding container 9e478a7bed00dac4ab7ca59f44ce85de419ff302f8c1672b34b9e449528725ed: Status 404 returned error can't find the container with id 9e478a7bed00dac4ab7ca59f44ce85de419ff302f8c1672b34b9e449528725ed Mar 16 16:14:30 crc kubenswrapper[5120]: I0316 16:14:30.419259 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-79cb59c45b-x77rt"] Mar 16 16:14:30 crc kubenswrapper[5120]: W0316 16:14:30.428499 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod32e01c7b_7af9_4cc6_8f41_d951345e0fe4.slice/crio-4fefb13b39659c2cb40174743c9c95fc209216fe167b0b9aed191aa666592b94 WatchSource:0}: Error finding container 4fefb13b39659c2cb40174743c9c95fc209216fe167b0b9aed191aa666592b94: Status 404 returned error can't find the container with id 4fefb13b39659c2cb40174743c9c95fc209216fe167b0b9aed191aa666592b94 Mar 16 16:14:30 crc kubenswrapper[5120]: I0316 16:14:30.438534 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-6c79fccb98-ccmbb"] Mar 16 16:14:30 crc kubenswrapper[5120]: I0316 16:14:30.566884 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-54f764f5f6-t2dpg" event={"ID":"059e3299-784b-46be-9e1b-f0b81118a979","Type":"ContainerStarted","Data":"1f995c8e48ba658ba33982a0b6c2e16251b61464a914fdf7b421a8da28a25e23"} Mar 16 16:14:30 crc kubenswrapper[5120]: I0316 16:14:30.567288 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-54f764f5f6-t2dpg" event={"ID":"059e3299-784b-46be-9e1b-f0b81118a979","Type":"ContainerStarted","Data":"fd9ed33f26264de8b2cd2d34cb5494f6e8f04abb8a30263606d5bf8544d686df"} Mar 16 16:14:30 crc kubenswrapper[5120]: I0316 16:14:30.576335 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"e8c1b04b-5169-424c-aa78-d0ed21f9ad44","Type":"ContainerStarted","Data":"f1f2253aadf0697eda77b9b90b4349360ca943b2a5f09261ba0d906abdb6d76a"} Mar 16 16:14:30 crc kubenswrapper[5120]: I0316 16:14:30.582116 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-79cb59c45b-x77rt" event={"ID":"32e01c7b-7af9-4cc6-8f41-d951345e0fe4","Type":"ContainerStarted","Data":"4fefb13b39659c2cb40174743c9c95fc209216fe167b0b9aed191aa666592b94"} Mar 16 16:14:30 crc kubenswrapper[5120]: I0316 16:14:30.587494 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-7c468d546f-vjd49" event={"ID":"e9b63ab0-f32f-4118-9e63-b82550c1d518","Type":"ContainerStarted","Data":"abb64c72c7b8685ede4a429cbedcbec43a64d7a4ac6a560c46eab15bc712b901"} Mar 16 16:14:30 crc kubenswrapper[5120]: I0316 16:14:30.587537 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-7c468d546f-vjd49" event={"ID":"e9b63ab0-f32f-4118-9e63-b82550c1d518","Type":"ContainerStarted","Data":"9e478a7bed00dac4ab7ca59f44ce85de419ff302f8c1672b34b9e449528725ed"} Mar 16 16:14:30 crc kubenswrapper[5120]: I0316 16:14:30.593239 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-6c79fccb98-ccmbb" event={"ID":"c2631af3-9152-470b-8aa8-2395a88ec1ab","Type":"ContainerStarted","Data":"034ceb76c311b058f508984947b5f80e261bb10e9690b5eb3b809201bfd4b667"} Mar 16 16:14:30 crc kubenswrapper[5120]: I0316 16:14:30.597789 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"f332d01c-8618-4bf0-adda-5d5e90a43f7a","Type":"ContainerStarted","Data":"a47610b6ca8ef781ee59c32c45df41861758ff434fa31833904d994d39ad8933"} Mar 16 16:14:30 crc kubenswrapper[5120]: I0316 16:14:30.602446 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-cl2jb"] Mar 16 16:14:30 crc kubenswrapper[5120]: W0316 16:14:30.616135 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4f1dba2e_ff26_4e74_9322_65f013a2f969.slice/crio-a4c5bf46e96697155003c24985c16b3f19f7ac9c01aa34554db8965a0f90af5b WatchSource:0}: Error finding container a4c5bf46e96697155003c24985c16b3f19f7ac9c01aa34554db8965a0f90af5b: Status 404 returned error can't find the container with id a4c5bf46e96697155003c24985c16b3f19f7ac9c01aa34554db8965a0f90af5b Mar 16 16:14:30 crc kubenswrapper[5120]: I0316 16:14:30.673121 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="67ce2cee-a80e-45e8-978a-b236ef1c8c40" path="/var/lib/kubelet/pods/67ce2cee-a80e-45e8-978a-b236ef1c8c40/volumes" Mar 16 16:14:31 crc kubenswrapper[5120]: I0316 16:14:31.610476 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-54f764f5f6-t2dpg" event={"ID":"059e3299-784b-46be-9e1b-f0b81118a979","Type":"ContainerStarted","Data":"3d380b12787b3d95c1c6f7e8c7fcef06816af75aa0b3979c5d9b7dd602be12ac"} Mar 16 16:14:31 crc kubenswrapper[5120]: I0316 16:14:31.612027 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-54f764f5f6-t2dpg" Mar 16 16:14:31 crc kubenswrapper[5120]: I0316 16:14:31.612059 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-54f764f5f6-t2dpg" Mar 16 16:14:31 crc kubenswrapper[5120]: I0316 16:14:31.613578 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-cl2jb" event={"ID":"4f1dba2e-ff26-4e74-9322-65f013a2f969","Type":"ContainerStarted","Data":"cb924e1b048e7104d449d9ed5a9c19c5fb9f4a662334a0dbf25edc3eea144bdc"} Mar 16 16:14:31 crc kubenswrapper[5120]: I0316 16:14:31.613599 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-cl2jb" event={"ID":"4f1dba2e-ff26-4e74-9322-65f013a2f969","Type":"ContainerStarted","Data":"a4c5bf46e96697155003c24985c16b3f19f7ac9c01aa34554db8965a0f90af5b"} Mar 16 16:14:31 crc kubenswrapper[5120]: I0316 16:14:31.616577 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"e8c1b04b-5169-424c-aa78-d0ed21f9ad44","Type":"ContainerStarted","Data":"ca48afbf4da3994c288dd6434d0ca152b157371aac8a2f09d421e8ba98321a5b"} Mar 16 16:14:31 crc kubenswrapper[5120]: I0316 16:14:31.619562 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-79cb59c45b-x77rt" event={"ID":"32e01c7b-7af9-4cc6-8f41-d951345e0fe4","Type":"ContainerStarted","Data":"8fa70322ff2a1414a9f9ac2b6f5afaa348b8bac1dd87c59c0e6fa7c46e449148"} Mar 16 16:14:31 crc kubenswrapper[5120]: I0316 16:14:31.619801 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-79cb59c45b-x77rt" event={"ID":"32e01c7b-7af9-4cc6-8f41-d951345e0fe4","Type":"ContainerStarted","Data":"5de7ccc55c26ab41ae31a5e2511ce9cecf14323742c5e06312d2456feb2db916"} Mar 16 16:14:31 crc kubenswrapper[5120]: I0316 16:14:31.620421 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-79cb59c45b-x77rt" Mar 16 16:14:31 crc kubenswrapper[5120]: I0316 16:14:31.620578 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-79cb59c45b-x77rt" Mar 16 16:14:31 crc kubenswrapper[5120]: I0316 16:14:31.622374 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-7c468d546f-vjd49" event={"ID":"e9b63ab0-f32f-4118-9e63-b82550c1d518","Type":"ContainerStarted","Data":"9e2cd9ee31b8503ea9d68b96980216bb40b609ac1140ff9f0bdfcdaab38bfe7b"} Mar 16 16:14:31 crc kubenswrapper[5120]: I0316 16:14:31.624609 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-6c79fccb98-ccmbb" event={"ID":"c2631af3-9152-470b-8aa8-2395a88ec1ab","Type":"ContainerStarted","Data":"ec833fb04a8faa4bbb0cc46a41c1d27652f76a3891407e6aa05c62a253cacf8e"} Mar 16 16:14:31 crc kubenswrapper[5120]: I0316 16:14:31.624662 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-6c79fccb98-ccmbb" event={"ID":"c2631af3-9152-470b-8aa8-2395a88ec1ab","Type":"ContainerStarted","Data":"df6901c9ecd72698003b27fbc3b639dfb0dc3eccef59ce092d3ca1237db632cf"} Mar 16 16:14:31 crc kubenswrapper[5120]: I0316 16:14:31.626690 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"f332d01c-8618-4bf0-adda-5d5e90a43f7a","Type":"ContainerStarted","Data":"cd8b1379c58f4aa09b67615c5b735aa09b7525a1898eb7095fe9570d88902489"} Mar 16 16:14:31 crc kubenswrapper[5120]: I0316 16:14:31.640010 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-54f764f5f6-t2dpg" podStartSLOduration=3.6399913379999997 podStartE2EDuration="3.639991338s" podCreationTimestamp="2026-03-16 16:14:28 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:14:31.635712704 +0000 UTC m=+2573.789644361" watchObservedRunningTime="2026-03-16 16:14:31.639991338 +0000 UTC m=+2573.793922995" Mar 16 16:14:31 crc kubenswrapper[5120]: I0316 16:14:31.660505 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-external-api-0" podStartSLOduration=4.660484357 podStartE2EDuration="4.660484357s" podCreationTimestamp="2026-03-16 16:14:27 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:14:31.655381891 +0000 UTC m=+2573.809313548" watchObservedRunningTime="2026-03-16 16:14:31.660484357 +0000 UTC m=+2573.814416024" Mar 16 16:14:31 crc kubenswrapper[5120]: I0316 16:14:31.682581 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-keystone-listener-6c79fccb98-ccmbb" podStartSLOduration=3.682560619 podStartE2EDuration="3.682560619s" podCreationTimestamp="2026-03-16 16:14:28 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:14:31.673922697 +0000 UTC m=+2573.827854364" watchObservedRunningTime="2026-03-16 16:14:31.682560619 +0000 UTC m=+2573.836492286" Mar 16 16:14:31 crc kubenswrapper[5120]: I0316 16:14:31.699034 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-bootstrap-cl2jb" podStartSLOduration=2.6990124399999997 podStartE2EDuration="2.69901244s" podCreationTimestamp="2026-03-16 16:14:29 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:14:31.692979267 +0000 UTC m=+2573.846910924" watchObservedRunningTime="2026-03-16 16:14:31.69901244 +0000 UTC m=+2573.852944107" Mar 16 16:14:31 crc kubenswrapper[5120]: I0316 16:14:31.723307 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-internal-api-0" podStartSLOduration=4.72328785 podStartE2EDuration="4.72328785s" podCreationTimestamp="2026-03-16 16:14:27 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:14:31.714564386 +0000 UTC m=+2573.868496043" watchObservedRunningTime="2026-03-16 16:14:31.72328785 +0000 UTC m=+2573.877219507" Mar 16 16:14:31 crc kubenswrapper[5120]: I0316 16:14:31.744026 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-api-79cb59c45b-x77rt" podStartSLOduration=3.744010296 podStartE2EDuration="3.744010296s" podCreationTimestamp="2026-03-16 16:14:28 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:14:31.740110021 +0000 UTC m=+2573.894041668" watchObservedRunningTime="2026-03-16 16:14:31.744010296 +0000 UTC m=+2573.897941963" Mar 16 16:14:31 crc kubenswrapper[5120]: I0316 16:14:31.769502 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-worker-7c468d546f-vjd49" podStartSLOduration=3.769486138 podStartE2EDuration="3.769486138s" podCreationTimestamp="2026-03-16 16:14:28 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:14:31.760110807 +0000 UTC m=+2573.914042464" watchObservedRunningTime="2026-03-16 16:14:31.769486138 +0000 UTC m=+2573.923417795" Mar 16 16:14:32 crc kubenswrapper[5120]: I0316 16:14:32.637567 5120 generic.go:358] "Generic (PLEG): container finished" podID="44189db5-7f84-4e8f-9bca-59a28faf203f" containerID="5378ad34d9758a144ee943f34770e0b06832baf379ab5bffe3100e28939b0afd" exitCode=0 Mar 16 16:14:32 crc kubenswrapper[5120]: I0316 16:14:32.637668 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-dfhwx" event={"ID":"44189db5-7f84-4e8f-9bca-59a28faf203f","Type":"ContainerDied","Data":"5378ad34d9758a144ee943f34770e0b06832baf379ab5bffe3100e28939b0afd"} Mar 16 16:14:32 crc kubenswrapper[5120]: I0316 16:14:32.689659 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-api-79fb5cbbfb-46s2s"] Mar 16 16:14:32 crc kubenswrapper[5120]: I0316 16:14:32.696642 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-79fb5cbbfb-46s2s" Mar 16 16:14:32 crc kubenswrapper[5120]: I0316 16:14:32.698622 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-barbican-public-svc\"" Mar 16 16:14:32 crc kubenswrapper[5120]: I0316 16:14:32.699485 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-barbican-internal-svc\"" Mar 16 16:14:32 crc kubenswrapper[5120]: I0316 16:14:32.707324 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-79fb5cbbfb-46s2s"] Mar 16 16:14:32 crc kubenswrapper[5120]: I0316 16:14:32.788568 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/90332f2f-d386-4c90-8e67-a2c6bf57dffc-public-tls-certs\") pod \"barbican-api-79fb5cbbfb-46s2s\" (UID: \"90332f2f-d386-4c90-8e67-a2c6bf57dffc\") " pod="openstack-kuttl-tests/barbican-api-79fb5cbbfb-46s2s" Mar 16 16:14:32 crc kubenswrapper[5120]: I0316 16:14:32.788746 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/90332f2f-d386-4c90-8e67-a2c6bf57dffc-config-data-custom\") pod \"barbican-api-79fb5cbbfb-46s2s\" (UID: \"90332f2f-d386-4c90-8e67-a2c6bf57dffc\") " pod="openstack-kuttl-tests/barbican-api-79fb5cbbfb-46s2s" Mar 16 16:14:32 crc kubenswrapper[5120]: I0316 16:14:32.788782 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/90332f2f-d386-4c90-8e67-a2c6bf57dffc-logs\") pod \"barbican-api-79fb5cbbfb-46s2s\" (UID: \"90332f2f-d386-4c90-8e67-a2c6bf57dffc\") " pod="openstack-kuttl-tests/barbican-api-79fb5cbbfb-46s2s" Mar 16 16:14:32 crc kubenswrapper[5120]: I0316 16:14:32.788962 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pb5lw\" (UniqueName: \"kubernetes.io/projected/90332f2f-d386-4c90-8e67-a2c6bf57dffc-kube-api-access-pb5lw\") pod \"barbican-api-79fb5cbbfb-46s2s\" (UID: \"90332f2f-d386-4c90-8e67-a2c6bf57dffc\") " pod="openstack-kuttl-tests/barbican-api-79fb5cbbfb-46s2s" Mar 16 16:14:32 crc kubenswrapper[5120]: I0316 16:14:32.789015 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/90332f2f-d386-4c90-8e67-a2c6bf57dffc-combined-ca-bundle\") pod \"barbican-api-79fb5cbbfb-46s2s\" (UID: \"90332f2f-d386-4c90-8e67-a2c6bf57dffc\") " pod="openstack-kuttl-tests/barbican-api-79fb5cbbfb-46s2s" Mar 16 16:14:32 crc kubenswrapper[5120]: I0316 16:14:32.789158 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/90332f2f-d386-4c90-8e67-a2c6bf57dffc-internal-tls-certs\") pod \"barbican-api-79fb5cbbfb-46s2s\" (UID: \"90332f2f-d386-4c90-8e67-a2c6bf57dffc\") " pod="openstack-kuttl-tests/barbican-api-79fb5cbbfb-46s2s" Mar 16 16:14:32 crc kubenswrapper[5120]: I0316 16:14:32.789224 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/90332f2f-d386-4c90-8e67-a2c6bf57dffc-config-data\") pod \"barbican-api-79fb5cbbfb-46s2s\" (UID: \"90332f2f-d386-4c90-8e67-a2c6bf57dffc\") " pod="openstack-kuttl-tests/barbican-api-79fb5cbbfb-46s2s" Mar 16 16:14:32 crc kubenswrapper[5120]: I0316 16:14:32.891163 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/90332f2f-d386-4c90-8e67-a2c6bf57dffc-config-data-custom\") pod \"barbican-api-79fb5cbbfb-46s2s\" (UID: \"90332f2f-d386-4c90-8e67-a2c6bf57dffc\") " pod="openstack-kuttl-tests/barbican-api-79fb5cbbfb-46s2s" Mar 16 16:14:32 crc kubenswrapper[5120]: I0316 16:14:32.891205 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/90332f2f-d386-4c90-8e67-a2c6bf57dffc-logs\") pod \"barbican-api-79fb5cbbfb-46s2s\" (UID: \"90332f2f-d386-4c90-8e67-a2c6bf57dffc\") " pod="openstack-kuttl-tests/barbican-api-79fb5cbbfb-46s2s" Mar 16 16:14:32 crc kubenswrapper[5120]: I0316 16:14:32.891287 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pb5lw\" (UniqueName: \"kubernetes.io/projected/90332f2f-d386-4c90-8e67-a2c6bf57dffc-kube-api-access-pb5lw\") pod \"barbican-api-79fb5cbbfb-46s2s\" (UID: \"90332f2f-d386-4c90-8e67-a2c6bf57dffc\") " pod="openstack-kuttl-tests/barbican-api-79fb5cbbfb-46s2s" Mar 16 16:14:32 crc kubenswrapper[5120]: I0316 16:14:32.891312 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/90332f2f-d386-4c90-8e67-a2c6bf57dffc-combined-ca-bundle\") pod \"barbican-api-79fb5cbbfb-46s2s\" (UID: \"90332f2f-d386-4c90-8e67-a2c6bf57dffc\") " pod="openstack-kuttl-tests/barbican-api-79fb5cbbfb-46s2s" Mar 16 16:14:32 crc kubenswrapper[5120]: I0316 16:14:32.891837 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/90332f2f-d386-4c90-8e67-a2c6bf57dffc-logs\") pod \"barbican-api-79fb5cbbfb-46s2s\" (UID: \"90332f2f-d386-4c90-8e67-a2c6bf57dffc\") " pod="openstack-kuttl-tests/barbican-api-79fb5cbbfb-46s2s" Mar 16 16:14:32 crc kubenswrapper[5120]: I0316 16:14:32.891907 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/90332f2f-d386-4c90-8e67-a2c6bf57dffc-internal-tls-certs\") pod \"barbican-api-79fb5cbbfb-46s2s\" (UID: \"90332f2f-d386-4c90-8e67-a2c6bf57dffc\") " pod="openstack-kuttl-tests/barbican-api-79fb5cbbfb-46s2s" Mar 16 16:14:32 crc kubenswrapper[5120]: I0316 16:14:32.891983 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/90332f2f-d386-4c90-8e67-a2c6bf57dffc-config-data\") pod \"barbican-api-79fb5cbbfb-46s2s\" (UID: \"90332f2f-d386-4c90-8e67-a2c6bf57dffc\") " pod="openstack-kuttl-tests/barbican-api-79fb5cbbfb-46s2s" Mar 16 16:14:32 crc kubenswrapper[5120]: I0316 16:14:32.892151 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/90332f2f-d386-4c90-8e67-a2c6bf57dffc-public-tls-certs\") pod \"barbican-api-79fb5cbbfb-46s2s\" (UID: \"90332f2f-d386-4c90-8e67-a2c6bf57dffc\") " pod="openstack-kuttl-tests/barbican-api-79fb5cbbfb-46s2s" Mar 16 16:14:32 crc kubenswrapper[5120]: I0316 16:14:32.897576 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/90332f2f-d386-4c90-8e67-a2c6bf57dffc-config-data-custom\") pod \"barbican-api-79fb5cbbfb-46s2s\" (UID: \"90332f2f-d386-4c90-8e67-a2c6bf57dffc\") " pod="openstack-kuttl-tests/barbican-api-79fb5cbbfb-46s2s" Mar 16 16:14:32 crc kubenswrapper[5120]: I0316 16:14:32.897602 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/90332f2f-d386-4c90-8e67-a2c6bf57dffc-internal-tls-certs\") pod \"barbican-api-79fb5cbbfb-46s2s\" (UID: \"90332f2f-d386-4c90-8e67-a2c6bf57dffc\") " pod="openstack-kuttl-tests/barbican-api-79fb5cbbfb-46s2s" Mar 16 16:14:32 crc kubenswrapper[5120]: I0316 16:14:32.897925 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/90332f2f-d386-4c90-8e67-a2c6bf57dffc-config-data\") pod \"barbican-api-79fb5cbbfb-46s2s\" (UID: \"90332f2f-d386-4c90-8e67-a2c6bf57dffc\") " pod="openstack-kuttl-tests/barbican-api-79fb5cbbfb-46s2s" Mar 16 16:14:32 crc kubenswrapper[5120]: I0316 16:14:32.898921 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/90332f2f-d386-4c90-8e67-a2c6bf57dffc-public-tls-certs\") pod \"barbican-api-79fb5cbbfb-46s2s\" (UID: \"90332f2f-d386-4c90-8e67-a2c6bf57dffc\") " pod="openstack-kuttl-tests/barbican-api-79fb5cbbfb-46s2s" Mar 16 16:14:32 crc kubenswrapper[5120]: I0316 16:14:32.899820 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/90332f2f-d386-4c90-8e67-a2c6bf57dffc-combined-ca-bundle\") pod \"barbican-api-79fb5cbbfb-46s2s\" (UID: \"90332f2f-d386-4c90-8e67-a2c6bf57dffc\") " pod="openstack-kuttl-tests/barbican-api-79fb5cbbfb-46s2s" Mar 16 16:14:32 crc kubenswrapper[5120]: I0316 16:14:32.909676 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pb5lw\" (UniqueName: \"kubernetes.io/projected/90332f2f-d386-4c90-8e67-a2c6bf57dffc-kube-api-access-pb5lw\") pod \"barbican-api-79fb5cbbfb-46s2s\" (UID: \"90332f2f-d386-4c90-8e67-a2c6bf57dffc\") " pod="openstack-kuttl-tests/barbican-api-79fb5cbbfb-46s2s" Mar 16 16:14:33 crc kubenswrapper[5120]: I0316 16:14:33.012589 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-79fb5cbbfb-46s2s" Mar 16 16:14:33 crc kubenswrapper[5120]: I0316 16:14:33.456349 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-79fb5cbbfb-46s2s"] Mar 16 16:14:33 crc kubenswrapper[5120]: I0316 16:14:33.649569 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-79fb5cbbfb-46s2s" event={"ID":"90332f2f-d386-4c90-8e67-a2c6bf57dffc","Type":"ContainerStarted","Data":"2c1f65aa1fcfacbe35286250488fa1a15a9b23f37c4a5334293b705dbd5e516e"} Mar 16 16:14:33 crc kubenswrapper[5120]: I0316 16:14:33.649968 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-79fb5cbbfb-46s2s" event={"ID":"90332f2f-d386-4c90-8e67-a2c6bf57dffc","Type":"ContainerStarted","Data":"e2d733e1415db393d7211b868d1f64aea9844714aaabd132b1a36c96b5aabe85"} Mar 16 16:14:34 crc kubenswrapper[5120]: E0316 16:14:34.009658 5120 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4f1dba2e_ff26_4e74_9322_65f013a2f969.slice/crio-conmon-cb924e1b048e7104d449d9ed5a9c19c5fb9f4a662334a0dbf25edc3eea144bdc.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4f1dba2e_ff26_4e74_9322_65f013a2f969.slice/crio-cb924e1b048e7104d449d9ed5a9c19c5fb9f4a662334a0dbf25edc3eea144bdc.scope\": RecentStats: unable to find data in memory cache]" Mar 16 16:14:34 crc kubenswrapper[5120]: I0316 16:14:34.021413 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-dfhwx" Mar 16 16:14:34 crc kubenswrapper[5120]: I0316 16:14:34.121144 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7llwv\" (UniqueName: \"kubernetes.io/projected/44189db5-7f84-4e8f-9bca-59a28faf203f-kube-api-access-7llwv\") pod \"44189db5-7f84-4e8f-9bca-59a28faf203f\" (UID: \"44189db5-7f84-4e8f-9bca-59a28faf203f\") " Mar 16 16:14:34 crc kubenswrapper[5120]: I0316 16:14:34.121205 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/44189db5-7f84-4e8f-9bca-59a28faf203f-etc-machine-id\") pod \"44189db5-7f84-4e8f-9bca-59a28faf203f\" (UID: \"44189db5-7f84-4e8f-9bca-59a28faf203f\") " Mar 16 16:14:34 crc kubenswrapper[5120]: I0316 16:14:34.121250 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/44189db5-7f84-4e8f-9bca-59a28faf203f-combined-ca-bundle\") pod \"44189db5-7f84-4e8f-9bca-59a28faf203f\" (UID: \"44189db5-7f84-4e8f-9bca-59a28faf203f\") " Mar 16 16:14:34 crc kubenswrapper[5120]: I0316 16:14:34.121281 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/44189db5-7f84-4e8f-9bca-59a28faf203f-config-data\") pod \"44189db5-7f84-4e8f-9bca-59a28faf203f\" (UID: \"44189db5-7f84-4e8f-9bca-59a28faf203f\") " Mar 16 16:14:34 crc kubenswrapper[5120]: I0316 16:14:34.121335 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/44189db5-7f84-4e8f-9bca-59a28faf203f-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "44189db5-7f84-4e8f-9bca-59a28faf203f" (UID: "44189db5-7f84-4e8f-9bca-59a28faf203f"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 16:14:34 crc kubenswrapper[5120]: I0316 16:14:34.121365 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/44189db5-7f84-4e8f-9bca-59a28faf203f-scripts\") pod \"44189db5-7f84-4e8f-9bca-59a28faf203f\" (UID: \"44189db5-7f84-4e8f-9bca-59a28faf203f\") " Mar 16 16:14:34 crc kubenswrapper[5120]: I0316 16:14:34.121511 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/44189db5-7f84-4e8f-9bca-59a28faf203f-db-sync-config-data\") pod \"44189db5-7f84-4e8f-9bca-59a28faf203f\" (UID: \"44189db5-7f84-4e8f-9bca-59a28faf203f\") " Mar 16 16:14:34 crc kubenswrapper[5120]: I0316 16:14:34.122495 5120 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/44189db5-7f84-4e8f-9bca-59a28faf203f-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 16:14:34 crc kubenswrapper[5120]: I0316 16:14:34.128296 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/44189db5-7f84-4e8f-9bca-59a28faf203f-db-sync-config-data" (OuterVolumeSpecName: "db-sync-config-data") pod "44189db5-7f84-4e8f-9bca-59a28faf203f" (UID: "44189db5-7f84-4e8f-9bca-59a28faf203f"). InnerVolumeSpecName "db-sync-config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:14:34 crc kubenswrapper[5120]: I0316 16:14:34.142655 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/44189db5-7f84-4e8f-9bca-59a28faf203f-scripts" (OuterVolumeSpecName: "scripts") pod "44189db5-7f84-4e8f-9bca-59a28faf203f" (UID: "44189db5-7f84-4e8f-9bca-59a28faf203f"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:14:34 crc kubenswrapper[5120]: I0316 16:14:34.143031 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44189db5-7f84-4e8f-9bca-59a28faf203f-kube-api-access-7llwv" (OuterVolumeSpecName: "kube-api-access-7llwv") pod "44189db5-7f84-4e8f-9bca-59a28faf203f" (UID: "44189db5-7f84-4e8f-9bca-59a28faf203f"). InnerVolumeSpecName "kube-api-access-7llwv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:14:34 crc kubenswrapper[5120]: I0316 16:14:34.153503 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/44189db5-7f84-4e8f-9bca-59a28faf203f-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "44189db5-7f84-4e8f-9bca-59a28faf203f" (UID: "44189db5-7f84-4e8f-9bca-59a28faf203f"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:14:34 crc kubenswrapper[5120]: I0316 16:14:34.169516 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/44189db5-7f84-4e8f-9bca-59a28faf203f-config-data" (OuterVolumeSpecName: "config-data") pod "44189db5-7f84-4e8f-9bca-59a28faf203f" (UID: "44189db5-7f84-4e8f-9bca-59a28faf203f"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:14:34 crc kubenswrapper[5120]: I0316 16:14:34.224708 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7llwv\" (UniqueName: \"kubernetes.io/projected/44189db5-7f84-4e8f-9bca-59a28faf203f-kube-api-access-7llwv\") on node \"crc\" DevicePath \"\"" Mar 16 16:14:34 crc kubenswrapper[5120]: I0316 16:14:34.224751 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/44189db5-7f84-4e8f-9bca-59a28faf203f-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:14:34 crc kubenswrapper[5120]: I0316 16:14:34.224776 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/44189db5-7f84-4e8f-9bca-59a28faf203f-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:14:34 crc kubenswrapper[5120]: I0316 16:14:34.224785 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/44189db5-7f84-4e8f-9bca-59a28faf203f-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:14:34 crc kubenswrapper[5120]: I0316 16:14:34.224795 5120 reconciler_common.go:299] "Volume detached for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/44189db5-7f84-4e8f-9bca-59a28faf203f-db-sync-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:14:34 crc kubenswrapper[5120]: I0316 16:14:34.662129 5120 generic.go:358] "Generic (PLEG): container finished" podID="4f1dba2e-ff26-4e74-9322-65f013a2f969" containerID="cb924e1b048e7104d449d9ed5a9c19c5fb9f4a662334a0dbf25edc3eea144bdc" exitCode=0 Mar 16 16:14:34 crc kubenswrapper[5120]: I0316 16:14:34.662237 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-cl2jb" event={"ID":"4f1dba2e-ff26-4e74-9322-65f013a2f969","Type":"ContainerDied","Data":"cb924e1b048e7104d449d9ed5a9c19c5fb9f4a662334a0dbf25edc3eea144bdc"} Mar 16 16:14:34 crc kubenswrapper[5120]: I0316 16:14:34.671135 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-dfhwx" Mar 16 16:14:34 crc kubenswrapper[5120]: I0316 16:14:34.682531 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-79fb5cbbfb-46s2s" Mar 16 16:14:34 crc kubenswrapper[5120]: I0316 16:14:34.682607 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-79fb5cbbfb-46s2s" Mar 16 16:14:34 crc kubenswrapper[5120]: I0316 16:14:34.682620 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-79fb5cbbfb-46s2s" event={"ID":"90332f2f-d386-4c90-8e67-a2c6bf57dffc","Type":"ContainerStarted","Data":"0ccbe0f01e81859389bce7f3706988a037cb7c1f28016d05b59ad83e847c18de"} Mar 16 16:14:34 crc kubenswrapper[5120]: I0316 16:14:34.682664 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-dfhwx" event={"ID":"44189db5-7f84-4e8f-9bca-59a28faf203f","Type":"ContainerDied","Data":"281b149d8adfe8f5ad6888b6b93e0f0216f208e2fb9e7905e91345e6dfffd407"} Mar 16 16:14:34 crc kubenswrapper[5120]: I0316 16:14:34.682709 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="281b149d8adfe8f5ad6888b6b93e0f0216f208e2fb9e7905e91345e6dfffd407" Mar 16 16:14:34 crc kubenswrapper[5120]: I0316 16:14:34.748925 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-api-79fb5cbbfb-46s2s" podStartSLOduration=2.748904446 podStartE2EDuration="2.748904446s" podCreationTimestamp="2026-03-16 16:14:32 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:14:34.706866169 +0000 UTC m=+2576.860797856" watchObservedRunningTime="2026-03-16 16:14:34.748904446 +0000 UTC m=+2576.902836113" Mar 16 16:14:34 crc kubenswrapper[5120]: I0316 16:14:34.990916 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:14:34 crc kubenswrapper[5120]: I0316 16:14:34.996991 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44189db5-7f84-4e8f-9bca-59a28faf203f" containerName="cinder-db-sync" Mar 16 16:14:34 crc kubenswrapper[5120]: I0316 16:14:34.997014 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="44189db5-7f84-4e8f-9bca-59a28faf203f" containerName="cinder-db-sync" Mar 16 16:14:34 crc kubenswrapper[5120]: I0316 16:14:34.997202 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="44189db5-7f84-4e8f-9bca-59a28faf203f" containerName="cinder-db-sync" Mar 16 16:14:35 crc kubenswrapper[5120]: I0316 16:14:35.011511 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:14:35 crc kubenswrapper[5120]: I0316 16:14:35.013730 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-cinder-dockercfg-dsrl5\"" Mar 16 16:14:35 crc kubenswrapper[5120]: I0316 16:14:35.014149 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-config-data\"" Mar 16 16:14:35 crc kubenswrapper[5120]: I0316 16:14:35.015157 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-scripts\"" Mar 16 16:14:35 crc kubenswrapper[5120]: I0316 16:14:35.016552 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-scheduler-config-data\"" Mar 16 16:14:35 crc kubenswrapper[5120]: I0316 16:14:35.044560 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:14:35 crc kubenswrapper[5120]: I0316 16:14:35.150204 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkdf8\" (UniqueName: \"kubernetes.io/projected/4258219e-8b43-4c46-b1bb-ce0eb1a07f29-kube-api-access-rkdf8\") pod \"cinder-scheduler-0\" (UID: \"4258219e-8b43-4c46-b1bb-ce0eb1a07f29\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:14:35 crc kubenswrapper[5120]: I0316 16:14:35.150288 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4258219e-8b43-4c46-b1bb-ce0eb1a07f29-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"4258219e-8b43-4c46-b1bb-ce0eb1a07f29\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:14:35 crc kubenswrapper[5120]: I0316 16:14:35.150551 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4258219e-8b43-4c46-b1bb-ce0eb1a07f29-config-data\") pod \"cinder-scheduler-0\" (UID: \"4258219e-8b43-4c46-b1bb-ce0eb1a07f29\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:14:35 crc kubenswrapper[5120]: I0316 16:14:35.150675 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4258219e-8b43-4c46-b1bb-ce0eb1a07f29-scripts\") pod \"cinder-scheduler-0\" (UID: \"4258219e-8b43-4c46-b1bb-ce0eb1a07f29\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:14:35 crc kubenswrapper[5120]: I0316 16:14:35.150938 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/4258219e-8b43-4c46-b1bb-ce0eb1a07f29-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"4258219e-8b43-4c46-b1bb-ce0eb1a07f29\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:14:35 crc kubenswrapper[5120]: I0316 16:14:35.151013 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/4258219e-8b43-4c46-b1bb-ce0eb1a07f29-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"4258219e-8b43-4c46-b1bb-ce0eb1a07f29\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:14:35 crc kubenswrapper[5120]: I0316 16:14:35.163122 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:14:35 crc kubenswrapper[5120]: I0316 16:14:35.168647 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:14:35 crc kubenswrapper[5120]: I0316 16:14:35.170780 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-api-config-data\"" Mar 16 16:14:35 crc kubenswrapper[5120]: I0316 16:14:35.177987 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:14:35 crc kubenswrapper[5120]: I0316 16:14:35.252417 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4258219e-8b43-4c46-b1bb-ce0eb1a07f29-config-data\") pod \"cinder-scheduler-0\" (UID: \"4258219e-8b43-4c46-b1bb-ce0eb1a07f29\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:14:35 crc kubenswrapper[5120]: I0316 16:14:35.252479 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4258219e-8b43-4c46-b1bb-ce0eb1a07f29-scripts\") pod \"cinder-scheduler-0\" (UID: \"4258219e-8b43-4c46-b1bb-ce0eb1a07f29\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:14:35 crc kubenswrapper[5120]: I0316 16:14:35.252572 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/4258219e-8b43-4c46-b1bb-ce0eb1a07f29-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"4258219e-8b43-4c46-b1bb-ce0eb1a07f29\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:14:35 crc kubenswrapper[5120]: I0316 16:14:35.252601 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/4258219e-8b43-4c46-b1bb-ce0eb1a07f29-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"4258219e-8b43-4c46-b1bb-ce0eb1a07f29\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:14:35 crc kubenswrapper[5120]: I0316 16:14:35.252661 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rkdf8\" (UniqueName: \"kubernetes.io/projected/4258219e-8b43-4c46-b1bb-ce0eb1a07f29-kube-api-access-rkdf8\") pod \"cinder-scheduler-0\" (UID: \"4258219e-8b43-4c46-b1bb-ce0eb1a07f29\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:14:35 crc kubenswrapper[5120]: I0316 16:14:35.252719 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4258219e-8b43-4c46-b1bb-ce0eb1a07f29-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"4258219e-8b43-4c46-b1bb-ce0eb1a07f29\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:14:35 crc kubenswrapper[5120]: I0316 16:14:35.252798 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/4258219e-8b43-4c46-b1bb-ce0eb1a07f29-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"4258219e-8b43-4c46-b1bb-ce0eb1a07f29\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:14:35 crc kubenswrapper[5120]: I0316 16:14:35.257362 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4258219e-8b43-4c46-b1bb-ce0eb1a07f29-scripts\") pod \"cinder-scheduler-0\" (UID: \"4258219e-8b43-4c46-b1bb-ce0eb1a07f29\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:14:35 crc kubenswrapper[5120]: I0316 16:14:35.257726 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4258219e-8b43-4c46-b1bb-ce0eb1a07f29-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"4258219e-8b43-4c46-b1bb-ce0eb1a07f29\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:14:35 crc kubenswrapper[5120]: I0316 16:14:35.257986 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/4258219e-8b43-4c46-b1bb-ce0eb1a07f29-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"4258219e-8b43-4c46-b1bb-ce0eb1a07f29\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:14:35 crc kubenswrapper[5120]: I0316 16:14:35.258010 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4258219e-8b43-4c46-b1bb-ce0eb1a07f29-config-data\") pod \"cinder-scheduler-0\" (UID: \"4258219e-8b43-4c46-b1bb-ce0eb1a07f29\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:14:35 crc kubenswrapper[5120]: I0316 16:14:35.268472 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkdf8\" (UniqueName: \"kubernetes.io/projected/4258219e-8b43-4c46-b1bb-ce0eb1a07f29-kube-api-access-rkdf8\") pod \"cinder-scheduler-0\" (UID: \"4258219e-8b43-4c46-b1bb-ce0eb1a07f29\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:14:35 crc kubenswrapper[5120]: I0316 16:14:35.353974 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/20167ee9-3d5b-4ea7-9fe8-557fefbad83e-etc-machine-id\") pod \"cinder-api-0\" (UID: \"20167ee9-3d5b-4ea7-9fe8-557fefbad83e\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:14:35 crc kubenswrapper[5120]: I0316 16:14:35.354237 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/20167ee9-3d5b-4ea7-9fe8-557fefbad83e-scripts\") pod \"cinder-api-0\" (UID: \"20167ee9-3d5b-4ea7-9fe8-557fefbad83e\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:14:35 crc kubenswrapper[5120]: I0316 16:14:35.354309 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/20167ee9-3d5b-4ea7-9fe8-557fefbad83e-config-data\") pod \"cinder-api-0\" (UID: \"20167ee9-3d5b-4ea7-9fe8-557fefbad83e\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:14:35 crc kubenswrapper[5120]: I0316 16:14:35.354452 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cz6h4\" (UniqueName: \"kubernetes.io/projected/20167ee9-3d5b-4ea7-9fe8-557fefbad83e-kube-api-access-cz6h4\") pod \"cinder-api-0\" (UID: \"20167ee9-3d5b-4ea7-9fe8-557fefbad83e\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:14:35 crc kubenswrapper[5120]: I0316 16:14:35.354582 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/20167ee9-3d5b-4ea7-9fe8-557fefbad83e-config-data-custom\") pod \"cinder-api-0\" (UID: \"20167ee9-3d5b-4ea7-9fe8-557fefbad83e\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:14:35 crc kubenswrapper[5120]: I0316 16:14:35.354623 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/20167ee9-3d5b-4ea7-9fe8-557fefbad83e-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"20167ee9-3d5b-4ea7-9fe8-557fefbad83e\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:14:35 crc kubenswrapper[5120]: I0316 16:14:35.354737 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/20167ee9-3d5b-4ea7-9fe8-557fefbad83e-logs\") pod \"cinder-api-0\" (UID: \"20167ee9-3d5b-4ea7-9fe8-557fefbad83e\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:14:35 crc kubenswrapper[5120]: I0316 16:14:35.355058 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:14:35 crc kubenswrapper[5120]: I0316 16:14:35.456139 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/20167ee9-3d5b-4ea7-9fe8-557fefbad83e-config-data\") pod \"cinder-api-0\" (UID: \"20167ee9-3d5b-4ea7-9fe8-557fefbad83e\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:14:35 crc kubenswrapper[5120]: I0316 16:14:35.456477 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cz6h4\" (UniqueName: \"kubernetes.io/projected/20167ee9-3d5b-4ea7-9fe8-557fefbad83e-kube-api-access-cz6h4\") pod \"cinder-api-0\" (UID: \"20167ee9-3d5b-4ea7-9fe8-557fefbad83e\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:14:35 crc kubenswrapper[5120]: I0316 16:14:35.456575 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/20167ee9-3d5b-4ea7-9fe8-557fefbad83e-config-data-custom\") pod \"cinder-api-0\" (UID: \"20167ee9-3d5b-4ea7-9fe8-557fefbad83e\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:14:35 crc kubenswrapper[5120]: I0316 16:14:35.456599 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/20167ee9-3d5b-4ea7-9fe8-557fefbad83e-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"20167ee9-3d5b-4ea7-9fe8-557fefbad83e\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:14:35 crc kubenswrapper[5120]: I0316 16:14:35.456690 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/20167ee9-3d5b-4ea7-9fe8-557fefbad83e-logs\") pod \"cinder-api-0\" (UID: \"20167ee9-3d5b-4ea7-9fe8-557fefbad83e\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:14:35 crc kubenswrapper[5120]: I0316 16:14:35.456753 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/20167ee9-3d5b-4ea7-9fe8-557fefbad83e-etc-machine-id\") pod \"cinder-api-0\" (UID: \"20167ee9-3d5b-4ea7-9fe8-557fefbad83e\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:14:35 crc kubenswrapper[5120]: I0316 16:14:35.456925 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/20167ee9-3d5b-4ea7-9fe8-557fefbad83e-scripts\") pod \"cinder-api-0\" (UID: \"20167ee9-3d5b-4ea7-9fe8-557fefbad83e\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:14:35 crc kubenswrapper[5120]: I0316 16:14:35.457059 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/20167ee9-3d5b-4ea7-9fe8-557fefbad83e-etc-machine-id\") pod \"cinder-api-0\" (UID: \"20167ee9-3d5b-4ea7-9fe8-557fefbad83e\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:14:35 crc kubenswrapper[5120]: I0316 16:14:35.459574 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/20167ee9-3d5b-4ea7-9fe8-557fefbad83e-logs\") pod \"cinder-api-0\" (UID: \"20167ee9-3d5b-4ea7-9fe8-557fefbad83e\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:14:35 crc kubenswrapper[5120]: I0316 16:14:35.461661 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/20167ee9-3d5b-4ea7-9fe8-557fefbad83e-config-data-custom\") pod \"cinder-api-0\" (UID: \"20167ee9-3d5b-4ea7-9fe8-557fefbad83e\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:14:35 crc kubenswrapper[5120]: I0316 16:14:35.463905 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/20167ee9-3d5b-4ea7-9fe8-557fefbad83e-scripts\") pod \"cinder-api-0\" (UID: \"20167ee9-3d5b-4ea7-9fe8-557fefbad83e\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:14:35 crc kubenswrapper[5120]: I0316 16:14:35.467789 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/20167ee9-3d5b-4ea7-9fe8-557fefbad83e-config-data\") pod \"cinder-api-0\" (UID: \"20167ee9-3d5b-4ea7-9fe8-557fefbad83e\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:14:35 crc kubenswrapper[5120]: I0316 16:14:35.468071 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/20167ee9-3d5b-4ea7-9fe8-557fefbad83e-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"20167ee9-3d5b-4ea7-9fe8-557fefbad83e\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:14:35 crc kubenswrapper[5120]: I0316 16:14:35.476542 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cz6h4\" (UniqueName: \"kubernetes.io/projected/20167ee9-3d5b-4ea7-9fe8-557fefbad83e-kube-api-access-cz6h4\") pod \"cinder-api-0\" (UID: \"20167ee9-3d5b-4ea7-9fe8-557fefbad83e\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:14:35 crc kubenswrapper[5120]: I0316 16:14:35.485748 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:14:35 crc kubenswrapper[5120]: I0316 16:14:35.822216 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:14:35 crc kubenswrapper[5120]: I0316 16:14:35.942183 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-cl2jb" Mar 16 16:14:35 crc kubenswrapper[5120]: I0316 16:14:35.954280 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:14:36 crc kubenswrapper[5120]: I0316 16:14:36.068499 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4f1dba2e-ff26-4e74-9322-65f013a2f969-combined-ca-bundle\") pod \"4f1dba2e-ff26-4e74-9322-65f013a2f969\" (UID: \"4f1dba2e-ff26-4e74-9322-65f013a2f969\") " Mar 16 16:14:36 crc kubenswrapper[5120]: I0316 16:14:36.068628 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4f1dba2e-ff26-4e74-9322-65f013a2f969-config-data\") pod \"4f1dba2e-ff26-4e74-9322-65f013a2f969\" (UID: \"4f1dba2e-ff26-4e74-9322-65f013a2f969\") " Mar 16 16:14:36 crc kubenswrapper[5120]: I0316 16:14:36.068697 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4f1dba2e-ff26-4e74-9322-65f013a2f969-scripts\") pod \"4f1dba2e-ff26-4e74-9322-65f013a2f969\" (UID: \"4f1dba2e-ff26-4e74-9322-65f013a2f969\") " Mar 16 16:14:36 crc kubenswrapper[5120]: I0316 16:14:36.068781 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/4f1dba2e-ff26-4e74-9322-65f013a2f969-fernet-keys\") pod \"4f1dba2e-ff26-4e74-9322-65f013a2f969\" (UID: \"4f1dba2e-ff26-4e74-9322-65f013a2f969\") " Mar 16 16:14:36 crc kubenswrapper[5120]: I0316 16:14:36.068927 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/4f1dba2e-ff26-4e74-9322-65f013a2f969-credential-keys\") pod \"4f1dba2e-ff26-4e74-9322-65f013a2f969\" (UID: \"4f1dba2e-ff26-4e74-9322-65f013a2f969\") " Mar 16 16:14:36 crc kubenswrapper[5120]: I0316 16:14:36.069126 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qhkbz\" (UniqueName: \"kubernetes.io/projected/4f1dba2e-ff26-4e74-9322-65f013a2f969-kube-api-access-qhkbz\") pod \"4f1dba2e-ff26-4e74-9322-65f013a2f969\" (UID: \"4f1dba2e-ff26-4e74-9322-65f013a2f969\") " Mar 16 16:14:36 crc kubenswrapper[5120]: I0316 16:14:36.073253 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4f1dba2e-ff26-4e74-9322-65f013a2f969-scripts" (OuterVolumeSpecName: "scripts") pod "4f1dba2e-ff26-4e74-9322-65f013a2f969" (UID: "4f1dba2e-ff26-4e74-9322-65f013a2f969"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:14:36 crc kubenswrapper[5120]: I0316 16:14:36.076330 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4f1dba2e-ff26-4e74-9322-65f013a2f969-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "4f1dba2e-ff26-4e74-9322-65f013a2f969" (UID: "4f1dba2e-ff26-4e74-9322-65f013a2f969"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:14:36 crc kubenswrapper[5120]: I0316 16:14:36.076649 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4f1dba2e-ff26-4e74-9322-65f013a2f969-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "4f1dba2e-ff26-4e74-9322-65f013a2f969" (UID: "4f1dba2e-ff26-4e74-9322-65f013a2f969"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:14:36 crc kubenswrapper[5120]: I0316 16:14:36.080415 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f1dba2e-ff26-4e74-9322-65f013a2f969-kube-api-access-qhkbz" (OuterVolumeSpecName: "kube-api-access-qhkbz") pod "4f1dba2e-ff26-4e74-9322-65f013a2f969" (UID: "4f1dba2e-ff26-4e74-9322-65f013a2f969"). InnerVolumeSpecName "kube-api-access-qhkbz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:14:36 crc kubenswrapper[5120]: I0316 16:14:36.109796 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4f1dba2e-ff26-4e74-9322-65f013a2f969-config-data" (OuterVolumeSpecName: "config-data") pod "4f1dba2e-ff26-4e74-9322-65f013a2f969" (UID: "4f1dba2e-ff26-4e74-9322-65f013a2f969"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:14:36 crc kubenswrapper[5120]: I0316 16:14:36.111010 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4f1dba2e-ff26-4e74-9322-65f013a2f969-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "4f1dba2e-ff26-4e74-9322-65f013a2f969" (UID: "4f1dba2e-ff26-4e74-9322-65f013a2f969"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:14:36 crc kubenswrapper[5120]: I0316 16:14:36.171729 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qhkbz\" (UniqueName: \"kubernetes.io/projected/4f1dba2e-ff26-4e74-9322-65f013a2f969-kube-api-access-qhkbz\") on node \"crc\" DevicePath \"\"" Mar 16 16:14:36 crc kubenswrapper[5120]: I0316 16:14:36.171782 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4f1dba2e-ff26-4e74-9322-65f013a2f969-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:14:36 crc kubenswrapper[5120]: I0316 16:14:36.171792 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4f1dba2e-ff26-4e74-9322-65f013a2f969-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:14:36 crc kubenswrapper[5120]: I0316 16:14:36.171801 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4f1dba2e-ff26-4e74-9322-65f013a2f969-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:14:36 crc kubenswrapper[5120]: I0316 16:14:36.171809 5120 reconciler_common.go:299] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/4f1dba2e-ff26-4e74-9322-65f013a2f969-fernet-keys\") on node \"crc\" DevicePath \"\"" Mar 16 16:14:36 crc kubenswrapper[5120]: I0316 16:14:36.171820 5120 reconciler_common.go:299] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/4f1dba2e-ff26-4e74-9322-65f013a2f969-credential-keys\") on node \"crc\" DevicePath \"\"" Mar 16 16:14:36 crc kubenswrapper[5120]: I0316 16:14:36.706572 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-cl2jb" Mar 16 16:14:36 crc kubenswrapper[5120]: I0316 16:14:36.706562 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-cl2jb" event={"ID":"4f1dba2e-ff26-4e74-9322-65f013a2f969","Type":"ContainerDied","Data":"a4c5bf46e96697155003c24985c16b3f19f7ac9c01aa34554db8965a0f90af5b"} Mar 16 16:14:36 crc kubenswrapper[5120]: I0316 16:14:36.710159 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a4c5bf46e96697155003c24985c16b3f19f7ac9c01aa34554db8965a0f90af5b" Mar 16 16:14:36 crc kubenswrapper[5120]: I0316 16:14:36.728477 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"4258219e-8b43-4c46-b1bb-ce0eb1a07f29","Type":"ContainerStarted","Data":"77cd51631659630d74de4d75b68aafad2ea96cf703243aaee78708f64c6c2d23"} Mar 16 16:14:36 crc kubenswrapper[5120]: I0316 16:14:36.728523 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"4258219e-8b43-4c46-b1bb-ce0eb1a07f29","Type":"ContainerStarted","Data":"d05228cf3321032dbff28f20b61f9a13b2838d714b8f4a79bdf2abae8bdef1c6"} Mar 16 16:14:36 crc kubenswrapper[5120]: I0316 16:14:36.734423 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"20167ee9-3d5b-4ea7-9fe8-557fefbad83e","Type":"ContainerStarted","Data":"a546c9183ca0cb5f1ba75896f6ea95b11f4b08a92e44cee91bd1f95f12b34e27"} Mar 16 16:14:36 crc kubenswrapper[5120]: I0316 16:14:36.734467 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"20167ee9-3d5b-4ea7-9fe8-557fefbad83e","Type":"ContainerStarted","Data":"ea69fcda202751adbb2f47f8dfea92c09679e7086196fa1690920ac376b6b696"} Mar 16 16:14:36 crc kubenswrapper[5120]: I0316 16:14:36.903076 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-6f9485b564-dlsjq"] Mar 16 16:14:36 crc kubenswrapper[5120]: I0316 16:14:36.906632 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f1dba2e-ff26-4e74-9322-65f013a2f969" containerName="keystone-bootstrap" Mar 16 16:14:36 crc kubenswrapper[5120]: I0316 16:14:36.906656 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f1dba2e-ff26-4e74-9322-65f013a2f969" containerName="keystone-bootstrap" Mar 16 16:14:36 crc kubenswrapper[5120]: I0316 16:14:36.906831 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="4f1dba2e-ff26-4e74-9322-65f013a2f969" containerName="keystone-bootstrap" Mar 16 16:14:36 crc kubenswrapper[5120]: I0316 16:14:36.911017 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-6f9485b564-dlsjq"] Mar 16 16:14:36 crc kubenswrapper[5120]: I0316 16:14:36.911034 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-6f9485b564-dlsjq" Mar 16 16:14:36 crc kubenswrapper[5120]: I0316 16:14:36.914242 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-scripts\"" Mar 16 16:14:36 crc kubenswrapper[5120]: I0316 16:14:36.914371 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone\"" Mar 16 16:14:36 crc kubenswrapper[5120]: I0316 16:14:36.914786 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-config-data\"" Mar 16 16:14:36 crc kubenswrapper[5120]: I0316 16:14:36.914899 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-keystone-dockercfg-96n58\"" Mar 16 16:14:36 crc kubenswrapper[5120]: I0316 16:14:36.919382 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-keystone-internal-svc\"" Mar 16 16:14:36 crc kubenswrapper[5120]: I0316 16:14:36.919547 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-keystone-public-svc\"" Mar 16 16:14:37 crc kubenswrapper[5120]: I0316 16:14:37.003328 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/d762c585-b44b-475d-a371-507fa2f9439a-public-tls-certs\") pod \"keystone-6f9485b564-dlsjq\" (UID: \"d762c585-b44b-475d-a371-507fa2f9439a\") " pod="openstack-kuttl-tests/keystone-6f9485b564-dlsjq" Mar 16 16:14:37 crc kubenswrapper[5120]: I0316 16:14:37.003412 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d762c585-b44b-475d-a371-507fa2f9439a-combined-ca-bundle\") pod \"keystone-6f9485b564-dlsjq\" (UID: \"d762c585-b44b-475d-a371-507fa2f9439a\") " pod="openstack-kuttl-tests/keystone-6f9485b564-dlsjq" Mar 16 16:14:37 crc kubenswrapper[5120]: I0316 16:14:37.003493 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/d762c585-b44b-475d-a371-507fa2f9439a-credential-keys\") pod \"keystone-6f9485b564-dlsjq\" (UID: \"d762c585-b44b-475d-a371-507fa2f9439a\") " pod="openstack-kuttl-tests/keystone-6f9485b564-dlsjq" Mar 16 16:14:37 crc kubenswrapper[5120]: I0316 16:14:37.003537 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d762c585-b44b-475d-a371-507fa2f9439a-config-data\") pod \"keystone-6f9485b564-dlsjq\" (UID: \"d762c585-b44b-475d-a371-507fa2f9439a\") " pod="openstack-kuttl-tests/keystone-6f9485b564-dlsjq" Mar 16 16:14:37 crc kubenswrapper[5120]: I0316 16:14:37.003561 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kj978\" (UniqueName: \"kubernetes.io/projected/d762c585-b44b-475d-a371-507fa2f9439a-kube-api-access-kj978\") pod \"keystone-6f9485b564-dlsjq\" (UID: \"d762c585-b44b-475d-a371-507fa2f9439a\") " pod="openstack-kuttl-tests/keystone-6f9485b564-dlsjq" Mar 16 16:14:37 crc kubenswrapper[5120]: I0316 16:14:37.003594 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d762c585-b44b-475d-a371-507fa2f9439a-scripts\") pod \"keystone-6f9485b564-dlsjq\" (UID: \"d762c585-b44b-475d-a371-507fa2f9439a\") " pod="openstack-kuttl-tests/keystone-6f9485b564-dlsjq" Mar 16 16:14:37 crc kubenswrapper[5120]: I0316 16:14:37.003612 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/d762c585-b44b-475d-a371-507fa2f9439a-fernet-keys\") pod \"keystone-6f9485b564-dlsjq\" (UID: \"d762c585-b44b-475d-a371-507fa2f9439a\") " pod="openstack-kuttl-tests/keystone-6f9485b564-dlsjq" Mar 16 16:14:37 crc kubenswrapper[5120]: I0316 16:14:37.003647 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/d762c585-b44b-475d-a371-507fa2f9439a-internal-tls-certs\") pod \"keystone-6f9485b564-dlsjq\" (UID: \"d762c585-b44b-475d-a371-507fa2f9439a\") " pod="openstack-kuttl-tests/keystone-6f9485b564-dlsjq" Mar 16 16:14:37 crc kubenswrapper[5120]: I0316 16:14:37.105407 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/d762c585-b44b-475d-a371-507fa2f9439a-public-tls-certs\") pod \"keystone-6f9485b564-dlsjq\" (UID: \"d762c585-b44b-475d-a371-507fa2f9439a\") " pod="openstack-kuttl-tests/keystone-6f9485b564-dlsjq" Mar 16 16:14:37 crc kubenswrapper[5120]: I0316 16:14:37.105491 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d762c585-b44b-475d-a371-507fa2f9439a-combined-ca-bundle\") pod \"keystone-6f9485b564-dlsjq\" (UID: \"d762c585-b44b-475d-a371-507fa2f9439a\") " pod="openstack-kuttl-tests/keystone-6f9485b564-dlsjq" Mar 16 16:14:37 crc kubenswrapper[5120]: I0316 16:14:37.105746 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/d762c585-b44b-475d-a371-507fa2f9439a-credential-keys\") pod \"keystone-6f9485b564-dlsjq\" (UID: \"d762c585-b44b-475d-a371-507fa2f9439a\") " pod="openstack-kuttl-tests/keystone-6f9485b564-dlsjq" Mar 16 16:14:37 crc kubenswrapper[5120]: I0316 16:14:37.105808 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d762c585-b44b-475d-a371-507fa2f9439a-config-data\") pod \"keystone-6f9485b564-dlsjq\" (UID: \"d762c585-b44b-475d-a371-507fa2f9439a\") " pod="openstack-kuttl-tests/keystone-6f9485b564-dlsjq" Mar 16 16:14:37 crc kubenswrapper[5120]: I0316 16:14:37.109136 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kj978\" (UniqueName: \"kubernetes.io/projected/d762c585-b44b-475d-a371-507fa2f9439a-kube-api-access-kj978\") pod \"keystone-6f9485b564-dlsjq\" (UID: \"d762c585-b44b-475d-a371-507fa2f9439a\") " pod="openstack-kuttl-tests/keystone-6f9485b564-dlsjq" Mar 16 16:14:37 crc kubenswrapper[5120]: I0316 16:14:37.109188 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d762c585-b44b-475d-a371-507fa2f9439a-scripts\") pod \"keystone-6f9485b564-dlsjq\" (UID: \"d762c585-b44b-475d-a371-507fa2f9439a\") " pod="openstack-kuttl-tests/keystone-6f9485b564-dlsjq" Mar 16 16:14:37 crc kubenswrapper[5120]: I0316 16:14:37.109207 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/d762c585-b44b-475d-a371-507fa2f9439a-fernet-keys\") pod \"keystone-6f9485b564-dlsjq\" (UID: \"d762c585-b44b-475d-a371-507fa2f9439a\") " pod="openstack-kuttl-tests/keystone-6f9485b564-dlsjq" Mar 16 16:14:37 crc kubenswrapper[5120]: I0316 16:14:37.109252 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/d762c585-b44b-475d-a371-507fa2f9439a-internal-tls-certs\") pod \"keystone-6f9485b564-dlsjq\" (UID: \"d762c585-b44b-475d-a371-507fa2f9439a\") " pod="openstack-kuttl-tests/keystone-6f9485b564-dlsjq" Mar 16 16:14:37 crc kubenswrapper[5120]: I0316 16:14:37.112371 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/d762c585-b44b-475d-a371-507fa2f9439a-credential-keys\") pod \"keystone-6f9485b564-dlsjq\" (UID: \"d762c585-b44b-475d-a371-507fa2f9439a\") " pod="openstack-kuttl-tests/keystone-6f9485b564-dlsjq" Mar 16 16:14:37 crc kubenswrapper[5120]: I0316 16:14:37.113493 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/d762c585-b44b-475d-a371-507fa2f9439a-public-tls-certs\") pod \"keystone-6f9485b564-dlsjq\" (UID: \"d762c585-b44b-475d-a371-507fa2f9439a\") " pod="openstack-kuttl-tests/keystone-6f9485b564-dlsjq" Mar 16 16:14:37 crc kubenswrapper[5120]: I0316 16:14:37.117087 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d762c585-b44b-475d-a371-507fa2f9439a-config-data\") pod \"keystone-6f9485b564-dlsjq\" (UID: \"d762c585-b44b-475d-a371-507fa2f9439a\") " pod="openstack-kuttl-tests/keystone-6f9485b564-dlsjq" Mar 16 16:14:37 crc kubenswrapper[5120]: I0316 16:14:37.117249 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d762c585-b44b-475d-a371-507fa2f9439a-combined-ca-bundle\") pod \"keystone-6f9485b564-dlsjq\" (UID: \"d762c585-b44b-475d-a371-507fa2f9439a\") " pod="openstack-kuttl-tests/keystone-6f9485b564-dlsjq" Mar 16 16:14:37 crc kubenswrapper[5120]: I0316 16:14:37.122113 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d762c585-b44b-475d-a371-507fa2f9439a-scripts\") pod \"keystone-6f9485b564-dlsjq\" (UID: \"d762c585-b44b-475d-a371-507fa2f9439a\") " pod="openstack-kuttl-tests/keystone-6f9485b564-dlsjq" Mar 16 16:14:37 crc kubenswrapper[5120]: I0316 16:14:37.127569 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/d762c585-b44b-475d-a371-507fa2f9439a-fernet-keys\") pod \"keystone-6f9485b564-dlsjq\" (UID: \"d762c585-b44b-475d-a371-507fa2f9439a\") " pod="openstack-kuttl-tests/keystone-6f9485b564-dlsjq" Mar 16 16:14:37 crc kubenswrapper[5120]: I0316 16:14:37.144615 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kj978\" (UniqueName: \"kubernetes.io/projected/d762c585-b44b-475d-a371-507fa2f9439a-kube-api-access-kj978\") pod \"keystone-6f9485b564-dlsjq\" (UID: \"d762c585-b44b-475d-a371-507fa2f9439a\") " pod="openstack-kuttl-tests/keystone-6f9485b564-dlsjq" Mar 16 16:14:37 crc kubenswrapper[5120]: I0316 16:14:37.162322 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/d762c585-b44b-475d-a371-507fa2f9439a-internal-tls-certs\") pod \"keystone-6f9485b564-dlsjq\" (UID: \"d762c585-b44b-475d-a371-507fa2f9439a\") " pod="openstack-kuttl-tests/keystone-6f9485b564-dlsjq" Mar 16 16:14:37 crc kubenswrapper[5120]: I0316 16:14:37.244659 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-6f9485b564-dlsjq" Mar 16 16:14:37 crc kubenswrapper[5120]: I0316 16:14:37.262976 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:14:37 crc kubenswrapper[5120]: I0316 16:14:37.791177 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-scheduler-0" podStartSLOduration=3.791162589 podStartE2EDuration="3.791162589s" podCreationTimestamp="2026-03-16 16:14:34 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:14:37.784694555 +0000 UTC m=+2579.938626212" watchObservedRunningTime="2026-03-16 16:14:37.791162589 +0000 UTC m=+2579.945094246" Mar 16 16:14:37 crc kubenswrapper[5120]: I0316 16:14:37.865615 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:14:37 crc kubenswrapper[5120]: I0316 16:14:37.865656 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:14:37 crc kubenswrapper[5120]: I0316 16:14:37.909804 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-6f9485b564-dlsjq"] Mar 16 16:14:37 crc kubenswrapper[5120]: I0316 16:14:37.912163 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:14:37 crc kubenswrapper[5120]: I0316 16:14:37.919739 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:14:37 crc kubenswrapper[5120]: W0316 16:14:37.927168 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd762c585_b44b_475d_a371_507fa2f9439a.slice/crio-fda84fe9262bf524f54d7d849d96c19ecea9490aeea8c1a6b9d174aea9c6389b WatchSource:0}: Error finding container fda84fe9262bf524f54d7d849d96c19ecea9490aeea8c1a6b9d174aea9c6389b: Status 404 returned error can't find the container with id fda84fe9262bf524f54d7d849d96c19ecea9490aeea8c1a6b9d174aea9c6389b Mar 16 16:14:38 crc kubenswrapper[5120]: I0316 16:14:38.298265 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:14:38 crc kubenswrapper[5120]: I0316 16:14:38.298596 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:14:38 crc kubenswrapper[5120]: I0316 16:14:38.336851 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:14:38 crc kubenswrapper[5120]: I0316 16:14:38.337393 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:14:38 crc kubenswrapper[5120]: I0316 16:14:38.775599 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"4258219e-8b43-4c46-b1bb-ce0eb1a07f29","Type":"ContainerStarted","Data":"a59645931060756ef46365709024343642865406e43ee32e4fa4013b848ee1c0"} Mar 16 16:14:38 crc kubenswrapper[5120]: I0316 16:14:38.778612 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"20167ee9-3d5b-4ea7-9fe8-557fefbad83e","Type":"ContainerStarted","Data":"e53b9e7c9f67e828e8defc514fd47a8de3426a340aa58ffe7f3339466a0801fc"} Mar 16 16:14:38 crc kubenswrapper[5120]: I0316 16:14:38.778797 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="20167ee9-3d5b-4ea7-9fe8-557fefbad83e" containerName="cinder-api-log" containerID="cri-o://a546c9183ca0cb5f1ba75896f6ea95b11f4b08a92e44cee91bd1f95f12b34e27" gracePeriod=30 Mar 16 16:14:38 crc kubenswrapper[5120]: I0316 16:14:38.779080 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:14:38 crc kubenswrapper[5120]: I0316 16:14:38.779314 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="20167ee9-3d5b-4ea7-9fe8-557fefbad83e" containerName="cinder-api" containerID="cri-o://e53b9e7c9f67e828e8defc514fd47a8de3426a340aa58ffe7f3339466a0801fc" gracePeriod=30 Mar 16 16:14:38 crc kubenswrapper[5120]: I0316 16:14:38.793050 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-6f9485b564-dlsjq" event={"ID":"d762c585-b44b-475d-a371-507fa2f9439a","Type":"ContainerStarted","Data":"2dae34322c3b177952bf14227b112419b3dd714c550886bb4270633cbccfcb9d"} Mar 16 16:14:38 crc kubenswrapper[5120]: I0316 16:14:38.793091 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-6f9485b564-dlsjq" event={"ID":"d762c585-b44b-475d-a371-507fa2f9439a","Type":"ContainerStarted","Data":"fda84fe9262bf524f54d7d849d96c19ecea9490aeea8c1a6b9d174aea9c6389b"} Mar 16 16:14:38 crc kubenswrapper[5120]: I0316 16:14:38.793240 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:14:38 crc kubenswrapper[5120]: I0316 16:14:38.793286 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:14:38 crc kubenswrapper[5120]: I0316 16:14:38.793415 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/keystone-6f9485b564-dlsjq" Mar 16 16:14:38 crc kubenswrapper[5120]: I0316 16:14:38.794407 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:14:38 crc kubenswrapper[5120]: I0316 16:14:38.794437 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:14:38 crc kubenswrapper[5120]: I0316 16:14:38.800652 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-api-0" podStartSLOduration=3.800638363 podStartE2EDuration="3.800638363s" podCreationTimestamp="2026-03-16 16:14:35 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:14:38.798794324 +0000 UTC m=+2580.952725981" watchObservedRunningTime="2026-03-16 16:14:38.800638363 +0000 UTC m=+2580.954570020" Mar 16 16:14:38 crc kubenswrapper[5120]: I0316 16:14:38.848196 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-6f9485b564-dlsjq" podStartSLOduration=2.848172957 podStartE2EDuration="2.848172957s" podCreationTimestamp="2026-03-16 16:14:36 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:14:38.81957731 +0000 UTC m=+2580.973508967" watchObservedRunningTime="2026-03-16 16:14:38.848172957 +0000 UTC m=+2581.002104614" Mar 16 16:14:39 crc kubenswrapper[5120]: I0316 16:14:39.311114 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-79cb59c45b-x77rt" Mar 16 16:14:39 crc kubenswrapper[5120]: I0316 16:14:39.538902 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-79cb59c45b-x77rt" Mar 16 16:14:39 crc kubenswrapper[5120]: I0316 16:14:39.757824 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:14:39 crc kubenswrapper[5120]: I0316 16:14:39.785727 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-worker-5bfb7678f9-6dzmx"] Mar 16 16:14:39 crc kubenswrapper[5120]: I0316 16:14:39.789127 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20167ee9-3d5b-4ea7-9fe8-557fefbad83e" containerName="cinder-api" Mar 16 16:14:39 crc kubenswrapper[5120]: I0316 16:14:39.789157 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="20167ee9-3d5b-4ea7-9fe8-557fefbad83e" containerName="cinder-api" Mar 16 16:14:39 crc kubenswrapper[5120]: I0316 16:14:39.789280 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20167ee9-3d5b-4ea7-9fe8-557fefbad83e" containerName="cinder-api-log" Mar 16 16:14:39 crc kubenswrapper[5120]: I0316 16:14:39.789288 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="20167ee9-3d5b-4ea7-9fe8-557fefbad83e" containerName="cinder-api-log" Mar 16 16:14:39 crc kubenswrapper[5120]: I0316 16:14:39.790751 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="20167ee9-3d5b-4ea7-9fe8-557fefbad83e" containerName="cinder-api-log" Mar 16 16:14:39 crc kubenswrapper[5120]: I0316 16:14:39.790811 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="20167ee9-3d5b-4ea7-9fe8-557fefbad83e" containerName="cinder-api" Mar 16 16:14:39 crc kubenswrapper[5120]: I0316 16:14:39.806045 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-5bfb7678f9-6dzmx" Mar 16 16:14:39 crc kubenswrapper[5120]: I0316 16:14:39.806370 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/20167ee9-3d5b-4ea7-9fe8-557fefbad83e-config-data-custom\") pod \"20167ee9-3d5b-4ea7-9fe8-557fefbad83e\" (UID: \"20167ee9-3d5b-4ea7-9fe8-557fefbad83e\") " Mar 16 16:14:39 crc kubenswrapper[5120]: I0316 16:14:39.806484 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/20167ee9-3d5b-4ea7-9fe8-557fefbad83e-config-data\") pod \"20167ee9-3d5b-4ea7-9fe8-557fefbad83e\" (UID: \"20167ee9-3d5b-4ea7-9fe8-557fefbad83e\") " Mar 16 16:14:39 crc kubenswrapper[5120]: I0316 16:14:39.806529 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/20167ee9-3d5b-4ea7-9fe8-557fefbad83e-etc-machine-id\") pod \"20167ee9-3d5b-4ea7-9fe8-557fefbad83e\" (UID: \"20167ee9-3d5b-4ea7-9fe8-557fefbad83e\") " Mar 16 16:14:39 crc kubenswrapper[5120]: I0316 16:14:39.806614 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/20167ee9-3d5b-4ea7-9fe8-557fefbad83e-combined-ca-bundle\") pod \"20167ee9-3d5b-4ea7-9fe8-557fefbad83e\" (UID: \"20167ee9-3d5b-4ea7-9fe8-557fefbad83e\") " Mar 16 16:14:39 crc kubenswrapper[5120]: I0316 16:14:39.806649 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/20167ee9-3d5b-4ea7-9fe8-557fefbad83e-scripts\") pod \"20167ee9-3d5b-4ea7-9fe8-557fefbad83e\" (UID: \"20167ee9-3d5b-4ea7-9fe8-557fefbad83e\") " Mar 16 16:14:39 crc kubenswrapper[5120]: I0316 16:14:39.806805 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cz6h4\" (UniqueName: \"kubernetes.io/projected/20167ee9-3d5b-4ea7-9fe8-557fefbad83e-kube-api-access-cz6h4\") pod \"20167ee9-3d5b-4ea7-9fe8-557fefbad83e\" (UID: \"20167ee9-3d5b-4ea7-9fe8-557fefbad83e\") " Mar 16 16:14:39 crc kubenswrapper[5120]: I0316 16:14:39.806871 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/20167ee9-3d5b-4ea7-9fe8-557fefbad83e-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "20167ee9-3d5b-4ea7-9fe8-557fefbad83e" (UID: "20167ee9-3d5b-4ea7-9fe8-557fefbad83e"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 16:14:39 crc kubenswrapper[5120]: I0316 16:14:39.806937 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/20167ee9-3d5b-4ea7-9fe8-557fefbad83e-logs\") pod \"20167ee9-3d5b-4ea7-9fe8-557fefbad83e\" (UID: \"20167ee9-3d5b-4ea7-9fe8-557fefbad83e\") " Mar 16 16:14:39 crc kubenswrapper[5120]: I0316 16:14:39.807314 5120 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/20167ee9-3d5b-4ea7-9fe8-557fefbad83e-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 16:14:39 crc kubenswrapper[5120]: I0316 16:14:39.807660 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20167ee9-3d5b-4ea7-9fe8-557fefbad83e-logs" (OuterVolumeSpecName: "logs") pod "20167ee9-3d5b-4ea7-9fe8-557fefbad83e" (UID: "20167ee9-3d5b-4ea7-9fe8-557fefbad83e"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:14:39 crc kubenswrapper[5120]: I0316 16:14:39.823222 5120 generic.go:358] "Generic (PLEG): container finished" podID="20167ee9-3d5b-4ea7-9fe8-557fefbad83e" containerID="e53b9e7c9f67e828e8defc514fd47a8de3426a340aa58ffe7f3339466a0801fc" exitCode=0 Mar 16 16:14:39 crc kubenswrapper[5120]: I0316 16:14:39.823252 5120 generic.go:358] "Generic (PLEG): container finished" podID="20167ee9-3d5b-4ea7-9fe8-557fefbad83e" containerID="a546c9183ca0cb5f1ba75896f6ea95b11f4b08a92e44cee91bd1f95f12b34e27" exitCode=143 Mar 16 16:14:39 crc kubenswrapper[5120]: I0316 16:14:39.823336 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:14:39 crc kubenswrapper[5120]: I0316 16:14:39.823602 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"20167ee9-3d5b-4ea7-9fe8-557fefbad83e","Type":"ContainerDied","Data":"e53b9e7c9f67e828e8defc514fd47a8de3426a340aa58ffe7f3339466a0801fc"} Mar 16 16:14:39 crc kubenswrapper[5120]: I0316 16:14:39.823632 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"20167ee9-3d5b-4ea7-9fe8-557fefbad83e","Type":"ContainerDied","Data":"a546c9183ca0cb5f1ba75896f6ea95b11f4b08a92e44cee91bd1f95f12b34e27"} Mar 16 16:14:39 crc kubenswrapper[5120]: I0316 16:14:39.823642 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"20167ee9-3d5b-4ea7-9fe8-557fefbad83e","Type":"ContainerDied","Data":"ea69fcda202751adbb2f47f8dfea92c09679e7086196fa1690920ac376b6b696"} Mar 16 16:14:39 crc kubenswrapper[5120]: I0316 16:14:39.823659 5120 scope.go:117] "RemoveContainer" containerID="e53b9e7c9f67e828e8defc514fd47a8de3426a340aa58ffe7f3339466a0801fc" Mar 16 16:14:39 crc kubenswrapper[5120]: I0316 16:14:39.823745 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/20167ee9-3d5b-4ea7-9fe8-557fefbad83e-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "20167ee9-3d5b-4ea7-9fe8-557fefbad83e" (UID: "20167ee9-3d5b-4ea7-9fe8-557fefbad83e"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:14:39 crc kubenswrapper[5120]: I0316 16:14:39.826303 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-cbf797d74-8frg4"] Mar 16 16:14:39 crc kubenswrapper[5120]: I0316 16:14:39.844933 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20167ee9-3d5b-4ea7-9fe8-557fefbad83e-kube-api-access-cz6h4" (OuterVolumeSpecName: "kube-api-access-cz6h4") pod "20167ee9-3d5b-4ea7-9fe8-557fefbad83e" (UID: "20167ee9-3d5b-4ea7-9fe8-557fefbad83e"). InnerVolumeSpecName "kube-api-access-cz6h4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:14:39 crc kubenswrapper[5120]: I0316 16:14:39.846989 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/20167ee9-3d5b-4ea7-9fe8-557fefbad83e-scripts" (OuterVolumeSpecName: "scripts") pod "20167ee9-3d5b-4ea7-9fe8-557fefbad83e" (UID: "20167ee9-3d5b-4ea7-9fe8-557fefbad83e"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:14:39 crc kubenswrapper[5120]: I0316 16:14:39.849653 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-5bfb7678f9-6dzmx"] Mar 16 16:14:39 crc kubenswrapper[5120]: I0316 16:14:39.849778 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-cbf797d74-8frg4" Mar 16 16:14:39 crc kubenswrapper[5120]: I0316 16:14:39.857401 5120 generic.go:358] "Generic (PLEG): container finished" podID="30317636-b1f4-4ee1-950b-6d80a890ef09" containerID="39aeafa8666446d25a5b2e18ff2113d614f81487d6359922b45fb4d77879ff78" exitCode=0 Mar 16 16:14:39 crc kubenswrapper[5120]: I0316 16:14:39.858637 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-9zjx8" event={"ID":"30317636-b1f4-4ee1-950b-6d80a890ef09","Type":"ContainerDied","Data":"39aeafa8666446d25a5b2e18ff2113d614f81487d6359922b45fb4d77879ff78"} Mar 16 16:14:39 crc kubenswrapper[5120]: I0316 16:14:39.860178 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-cbf797d74-8frg4"] Mar 16 16:14:39 crc kubenswrapper[5120]: I0316 16:14:39.910911 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/20167ee9-3d5b-4ea7-9fe8-557fefbad83e-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "20167ee9-3d5b-4ea7-9fe8-557fefbad83e" (UID: "20167ee9-3d5b-4ea7-9fe8-557fefbad83e"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:14:39 crc kubenswrapper[5120]: I0316 16:14:39.912160 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/b2e8d0e9-fa13-49fc-b149-af0d8d1d5ef0-config-data-custom\") pod \"barbican-keystone-listener-cbf797d74-8frg4\" (UID: \"b2e8d0e9-fa13-49fc-b149-af0d8d1d5ef0\") " pod="openstack-kuttl-tests/barbican-keystone-listener-cbf797d74-8frg4" Mar 16 16:14:39 crc kubenswrapper[5120]: I0316 16:14:39.912209 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b2e8d0e9-fa13-49fc-b149-af0d8d1d5ef0-combined-ca-bundle\") pod \"barbican-keystone-listener-cbf797d74-8frg4\" (UID: \"b2e8d0e9-fa13-49fc-b149-af0d8d1d5ef0\") " pod="openstack-kuttl-tests/barbican-keystone-listener-cbf797d74-8frg4" Mar 16 16:14:39 crc kubenswrapper[5120]: I0316 16:14:39.912389 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djgjs\" (UniqueName: \"kubernetes.io/projected/b2e8d0e9-fa13-49fc-b149-af0d8d1d5ef0-kube-api-access-djgjs\") pod \"barbican-keystone-listener-cbf797d74-8frg4\" (UID: \"b2e8d0e9-fa13-49fc-b149-af0d8d1d5ef0\") " pod="openstack-kuttl-tests/barbican-keystone-listener-cbf797d74-8frg4" Mar 16 16:14:39 crc kubenswrapper[5120]: I0316 16:14:39.912444 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b2e8d0e9-fa13-49fc-b149-af0d8d1d5ef0-config-data\") pod \"barbican-keystone-listener-cbf797d74-8frg4\" (UID: \"b2e8d0e9-fa13-49fc-b149-af0d8d1d5ef0\") " pod="openstack-kuttl-tests/barbican-keystone-listener-cbf797d74-8frg4" Mar 16 16:14:39 crc kubenswrapper[5120]: I0316 16:14:39.912569 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b2e8d0e9-fa13-49fc-b149-af0d8d1d5ef0-logs\") pod \"barbican-keystone-listener-cbf797d74-8frg4\" (UID: \"b2e8d0e9-fa13-49fc-b149-af0d8d1d5ef0\") " pod="openstack-kuttl-tests/barbican-keystone-listener-cbf797d74-8frg4" Mar 16 16:14:39 crc kubenswrapper[5120]: I0316 16:14:39.912648 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/20167ee9-3d5b-4ea7-9fe8-557fefbad83e-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:14:39 crc kubenswrapper[5120]: I0316 16:14:39.912807 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/20167ee9-3d5b-4ea7-9fe8-557fefbad83e-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:14:39 crc kubenswrapper[5120]: I0316 16:14:39.912824 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/20167ee9-3d5b-4ea7-9fe8-557fefbad83e-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:14:39 crc kubenswrapper[5120]: I0316 16:14:39.912833 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cz6h4\" (UniqueName: \"kubernetes.io/projected/20167ee9-3d5b-4ea7-9fe8-557fefbad83e-kube-api-access-cz6h4\") on node \"crc\" DevicePath \"\"" Mar 16 16:14:39 crc kubenswrapper[5120]: I0316 16:14:39.912872 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/20167ee9-3d5b-4ea7-9fe8-557fefbad83e-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:14:39 crc kubenswrapper[5120]: I0316 16:14:39.956635 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-79fb5cbbfb-46s2s"] Mar 16 16:14:39 crc kubenswrapper[5120]: I0316 16:14:39.957021 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-79fb5cbbfb-46s2s" podUID="90332f2f-d386-4c90-8e67-a2c6bf57dffc" containerName="barbican-api-log" containerID="cri-o://2c1f65aa1fcfacbe35286250488fa1a15a9b23f37c4a5334293b705dbd5e516e" gracePeriod=30 Mar 16 16:14:39 crc kubenswrapper[5120]: I0316 16:14:39.958154 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-79fb5cbbfb-46s2s" podUID="90332f2f-d386-4c90-8e67-a2c6bf57dffc" containerName="barbican-api" containerID="cri-o://0ccbe0f01e81859389bce7f3706988a037cb7c1f28016d05b59ad83e847c18de" gracePeriod=30 Mar 16 16:14:39 crc kubenswrapper[5120]: I0316 16:14:39.972486 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openstack-kuttl-tests/barbican-api-79fb5cbbfb-46s2s" podUID="90332f2f-d386-4c90-8e67-a2c6bf57dffc" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.0.223:9311/healthcheck\": EOF" Mar 16 16:14:39 crc kubenswrapper[5120]: I0316 16:14:39.972509 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-79fb5cbbfb-46s2s" podUID="90332f2f-d386-4c90-8e67-a2c6bf57dffc" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.0.223:9311/healthcheck\": EOF" Mar 16 16:14:39 crc kubenswrapper[5120]: I0316 16:14:39.972659 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openstack-kuttl-tests/barbican-api-79fb5cbbfb-46s2s" podUID="90332f2f-d386-4c90-8e67-a2c6bf57dffc" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.0.223:9311/healthcheck\": EOF" Mar 16 16:14:39 crc kubenswrapper[5120]: I0316 16:14:39.983321 5120 scope.go:117] "RemoveContainer" containerID="a546c9183ca0cb5f1ba75896f6ea95b11f4b08a92e44cee91bd1f95f12b34e27" Mar 16 16:14:39 crc kubenswrapper[5120]: I0316 16:14:39.986123 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/20167ee9-3d5b-4ea7-9fe8-557fefbad83e-config-data" (OuterVolumeSpecName: "config-data") pod "20167ee9-3d5b-4ea7-9fe8-557fefbad83e" (UID: "20167ee9-3d5b-4ea7-9fe8-557fefbad83e"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:14:40 crc kubenswrapper[5120]: I0316 16:14:39.999805 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-api-796f4f9644-59hlg"] Mar 16 16:14:40 crc kubenswrapper[5120]: I0316 16:14:40.003889 5120 scope.go:117] "RemoveContainer" containerID="e53b9e7c9f67e828e8defc514fd47a8de3426a340aa58ffe7f3339466a0801fc" Mar 16 16:14:40 crc kubenswrapper[5120]: E0316 16:14:40.004322 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e53b9e7c9f67e828e8defc514fd47a8de3426a340aa58ffe7f3339466a0801fc\": container with ID starting with e53b9e7c9f67e828e8defc514fd47a8de3426a340aa58ffe7f3339466a0801fc not found: ID does not exist" containerID="e53b9e7c9f67e828e8defc514fd47a8de3426a340aa58ffe7f3339466a0801fc" Mar 16 16:14:40 crc kubenswrapper[5120]: I0316 16:14:40.004366 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e53b9e7c9f67e828e8defc514fd47a8de3426a340aa58ffe7f3339466a0801fc"} err="failed to get container status \"e53b9e7c9f67e828e8defc514fd47a8de3426a340aa58ffe7f3339466a0801fc\": rpc error: code = NotFound desc = could not find container \"e53b9e7c9f67e828e8defc514fd47a8de3426a340aa58ffe7f3339466a0801fc\": container with ID starting with e53b9e7c9f67e828e8defc514fd47a8de3426a340aa58ffe7f3339466a0801fc not found: ID does not exist" Mar 16 16:14:40 crc kubenswrapper[5120]: I0316 16:14:40.004389 5120 scope.go:117] "RemoveContainer" containerID="a546c9183ca0cb5f1ba75896f6ea95b11f4b08a92e44cee91bd1f95f12b34e27" Mar 16 16:14:40 crc kubenswrapper[5120]: E0316 16:14:40.004563 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a546c9183ca0cb5f1ba75896f6ea95b11f4b08a92e44cee91bd1f95f12b34e27\": container with ID starting with a546c9183ca0cb5f1ba75896f6ea95b11f4b08a92e44cee91bd1f95f12b34e27 not found: ID does not exist" containerID="a546c9183ca0cb5f1ba75896f6ea95b11f4b08a92e44cee91bd1f95f12b34e27" Mar 16 16:14:40 crc kubenswrapper[5120]: I0316 16:14:40.004585 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a546c9183ca0cb5f1ba75896f6ea95b11f4b08a92e44cee91bd1f95f12b34e27"} err="failed to get container status \"a546c9183ca0cb5f1ba75896f6ea95b11f4b08a92e44cee91bd1f95f12b34e27\": rpc error: code = NotFound desc = could not find container \"a546c9183ca0cb5f1ba75896f6ea95b11f4b08a92e44cee91bd1f95f12b34e27\": container with ID starting with a546c9183ca0cb5f1ba75896f6ea95b11f4b08a92e44cee91bd1f95f12b34e27 not found: ID does not exist" Mar 16 16:14:40 crc kubenswrapper[5120]: I0316 16:14:40.004599 5120 scope.go:117] "RemoveContainer" containerID="e53b9e7c9f67e828e8defc514fd47a8de3426a340aa58ffe7f3339466a0801fc" Mar 16 16:14:40 crc kubenswrapper[5120]: I0316 16:14:40.004958 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e53b9e7c9f67e828e8defc514fd47a8de3426a340aa58ffe7f3339466a0801fc"} err="failed to get container status \"e53b9e7c9f67e828e8defc514fd47a8de3426a340aa58ffe7f3339466a0801fc\": rpc error: code = NotFound desc = could not find container \"e53b9e7c9f67e828e8defc514fd47a8de3426a340aa58ffe7f3339466a0801fc\": container with ID starting with e53b9e7c9f67e828e8defc514fd47a8de3426a340aa58ffe7f3339466a0801fc not found: ID does not exist" Mar 16 16:14:40 crc kubenswrapper[5120]: I0316 16:14:40.004982 5120 scope.go:117] "RemoveContainer" containerID="a546c9183ca0cb5f1ba75896f6ea95b11f4b08a92e44cee91bd1f95f12b34e27" Mar 16 16:14:40 crc kubenswrapper[5120]: I0316 16:14:40.005177 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a546c9183ca0cb5f1ba75896f6ea95b11f4b08a92e44cee91bd1f95f12b34e27"} err="failed to get container status \"a546c9183ca0cb5f1ba75896f6ea95b11f4b08a92e44cee91bd1f95f12b34e27\": rpc error: code = NotFound desc = could not find container \"a546c9183ca0cb5f1ba75896f6ea95b11f4b08a92e44cee91bd1f95f12b34e27\": container with ID starting with a546c9183ca0cb5f1ba75896f6ea95b11f4b08a92e44cee91bd1f95f12b34e27 not found: ID does not exist" Mar 16 16:14:40 crc kubenswrapper[5120]: I0316 16:14:40.007410 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-796f4f9644-59hlg" Mar 16 16:14:40 crc kubenswrapper[5120]: I0316 16:14:40.018346 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-796f4f9644-59hlg"] Mar 16 16:14:40 crc kubenswrapper[5120]: I0316 16:14:40.018951 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7e059927-938d-4449-a260-90053be70ec9-config-data\") pod \"barbican-worker-5bfb7678f9-6dzmx\" (UID: \"7e059927-938d-4449-a260-90053be70ec9\") " pod="openstack-kuttl-tests/barbican-worker-5bfb7678f9-6dzmx" Mar 16 16:14:40 crc kubenswrapper[5120]: I0316 16:14:40.018999 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-djgjs\" (UniqueName: \"kubernetes.io/projected/b2e8d0e9-fa13-49fc-b149-af0d8d1d5ef0-kube-api-access-djgjs\") pod \"barbican-keystone-listener-cbf797d74-8frg4\" (UID: \"b2e8d0e9-fa13-49fc-b149-af0d8d1d5ef0\") " pod="openstack-kuttl-tests/barbican-keystone-listener-cbf797d74-8frg4" Mar 16 16:14:40 crc kubenswrapper[5120]: I0316 16:14:40.019070 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b2e8d0e9-fa13-49fc-b149-af0d8d1d5ef0-config-data\") pod \"barbican-keystone-listener-cbf797d74-8frg4\" (UID: \"b2e8d0e9-fa13-49fc-b149-af0d8d1d5ef0\") " pod="openstack-kuttl-tests/barbican-keystone-listener-cbf797d74-8frg4" Mar 16 16:14:40 crc kubenswrapper[5120]: I0316 16:14:40.019146 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzw8k\" (UniqueName: \"kubernetes.io/projected/7e059927-938d-4449-a260-90053be70ec9-kube-api-access-rzw8k\") pod \"barbican-worker-5bfb7678f9-6dzmx\" (UID: \"7e059927-938d-4449-a260-90053be70ec9\") " pod="openstack-kuttl-tests/barbican-worker-5bfb7678f9-6dzmx" Mar 16 16:14:40 crc kubenswrapper[5120]: I0316 16:14:40.019232 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b2e8d0e9-fa13-49fc-b149-af0d8d1d5ef0-logs\") pod \"barbican-keystone-listener-cbf797d74-8frg4\" (UID: \"b2e8d0e9-fa13-49fc-b149-af0d8d1d5ef0\") " pod="openstack-kuttl-tests/barbican-keystone-listener-cbf797d74-8frg4" Mar 16 16:14:40 crc kubenswrapper[5120]: I0316 16:14:40.019316 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/7e059927-938d-4449-a260-90053be70ec9-config-data-custom\") pod \"barbican-worker-5bfb7678f9-6dzmx\" (UID: \"7e059927-938d-4449-a260-90053be70ec9\") " pod="openstack-kuttl-tests/barbican-worker-5bfb7678f9-6dzmx" Mar 16 16:14:40 crc kubenswrapper[5120]: I0316 16:14:40.019390 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7e059927-938d-4449-a260-90053be70ec9-combined-ca-bundle\") pod \"barbican-worker-5bfb7678f9-6dzmx\" (UID: \"7e059927-938d-4449-a260-90053be70ec9\") " pod="openstack-kuttl-tests/barbican-worker-5bfb7678f9-6dzmx" Mar 16 16:14:40 crc kubenswrapper[5120]: I0316 16:14:40.019464 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/b2e8d0e9-fa13-49fc-b149-af0d8d1d5ef0-config-data-custom\") pod \"barbican-keystone-listener-cbf797d74-8frg4\" (UID: \"b2e8d0e9-fa13-49fc-b149-af0d8d1d5ef0\") " pod="openstack-kuttl-tests/barbican-keystone-listener-cbf797d74-8frg4" Mar 16 16:14:40 crc kubenswrapper[5120]: I0316 16:14:40.019522 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b2e8d0e9-fa13-49fc-b149-af0d8d1d5ef0-combined-ca-bundle\") pod \"barbican-keystone-listener-cbf797d74-8frg4\" (UID: \"b2e8d0e9-fa13-49fc-b149-af0d8d1d5ef0\") " pod="openstack-kuttl-tests/barbican-keystone-listener-cbf797d74-8frg4" Mar 16 16:14:40 crc kubenswrapper[5120]: I0316 16:14:40.019596 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7e059927-938d-4449-a260-90053be70ec9-logs\") pod \"barbican-worker-5bfb7678f9-6dzmx\" (UID: \"7e059927-938d-4449-a260-90053be70ec9\") " pod="openstack-kuttl-tests/barbican-worker-5bfb7678f9-6dzmx" Mar 16 16:14:40 crc kubenswrapper[5120]: I0316 16:14:40.019681 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/20167ee9-3d5b-4ea7-9fe8-557fefbad83e-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:14:40 crc kubenswrapper[5120]: I0316 16:14:40.022074 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b2e8d0e9-fa13-49fc-b149-af0d8d1d5ef0-logs\") pod \"barbican-keystone-listener-cbf797d74-8frg4\" (UID: \"b2e8d0e9-fa13-49fc-b149-af0d8d1d5ef0\") " pod="openstack-kuttl-tests/barbican-keystone-listener-cbf797d74-8frg4" Mar 16 16:14:40 crc kubenswrapper[5120]: I0316 16:14:40.032340 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/b2e8d0e9-fa13-49fc-b149-af0d8d1d5ef0-config-data-custom\") pod \"barbican-keystone-listener-cbf797d74-8frg4\" (UID: \"b2e8d0e9-fa13-49fc-b149-af0d8d1d5ef0\") " pod="openstack-kuttl-tests/barbican-keystone-listener-cbf797d74-8frg4" Mar 16 16:14:40 crc kubenswrapper[5120]: I0316 16:14:40.034921 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b2e8d0e9-fa13-49fc-b149-af0d8d1d5ef0-config-data\") pod \"barbican-keystone-listener-cbf797d74-8frg4\" (UID: \"b2e8d0e9-fa13-49fc-b149-af0d8d1d5ef0\") " pod="openstack-kuttl-tests/barbican-keystone-listener-cbf797d74-8frg4" Mar 16 16:14:40 crc kubenswrapper[5120]: I0316 16:14:40.037618 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b2e8d0e9-fa13-49fc-b149-af0d8d1d5ef0-combined-ca-bundle\") pod \"barbican-keystone-listener-cbf797d74-8frg4\" (UID: \"b2e8d0e9-fa13-49fc-b149-af0d8d1d5ef0\") " pod="openstack-kuttl-tests/barbican-keystone-listener-cbf797d74-8frg4" Mar 16 16:14:40 crc kubenswrapper[5120]: I0316 16:14:40.048288 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-djgjs\" (UniqueName: \"kubernetes.io/projected/b2e8d0e9-fa13-49fc-b149-af0d8d1d5ef0-kube-api-access-djgjs\") pod \"barbican-keystone-listener-cbf797d74-8frg4\" (UID: \"b2e8d0e9-fa13-49fc-b149-af0d8d1d5ef0\") " pod="openstack-kuttl-tests/barbican-keystone-listener-cbf797d74-8frg4" Mar 16 16:14:40 crc kubenswrapper[5120]: I0316 16:14:40.121813 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rzw8k\" (UniqueName: \"kubernetes.io/projected/7e059927-938d-4449-a260-90053be70ec9-kube-api-access-rzw8k\") pod \"barbican-worker-5bfb7678f9-6dzmx\" (UID: \"7e059927-938d-4449-a260-90053be70ec9\") " pod="openstack-kuttl-tests/barbican-worker-5bfb7678f9-6dzmx" Mar 16 16:14:40 crc kubenswrapper[5120]: I0316 16:14:40.121875 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9f16b3a2-bc26-4a63-8f8c-836611f0d320-config-data\") pod \"barbican-api-796f4f9644-59hlg\" (UID: \"9f16b3a2-bc26-4a63-8f8c-836611f0d320\") " pod="openstack-kuttl-tests/barbican-api-796f4f9644-59hlg" Mar 16 16:14:40 crc kubenswrapper[5120]: I0316 16:14:40.121906 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/9f16b3a2-bc26-4a63-8f8c-836611f0d320-config-data-custom\") pod \"barbican-api-796f4f9644-59hlg\" (UID: \"9f16b3a2-bc26-4a63-8f8c-836611f0d320\") " pod="openstack-kuttl-tests/barbican-api-796f4f9644-59hlg" Mar 16 16:14:40 crc kubenswrapper[5120]: I0316 16:14:40.122382 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9f16b3a2-bc26-4a63-8f8c-836611f0d320-logs\") pod \"barbican-api-796f4f9644-59hlg\" (UID: \"9f16b3a2-bc26-4a63-8f8c-836611f0d320\") " pod="openstack-kuttl-tests/barbican-api-796f4f9644-59hlg" Mar 16 16:14:40 crc kubenswrapper[5120]: I0316 16:14:40.122530 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/7e059927-938d-4449-a260-90053be70ec9-config-data-custom\") pod \"barbican-worker-5bfb7678f9-6dzmx\" (UID: \"7e059927-938d-4449-a260-90053be70ec9\") " pod="openstack-kuttl-tests/barbican-worker-5bfb7678f9-6dzmx" Mar 16 16:14:40 crc kubenswrapper[5120]: I0316 16:14:40.122571 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7e059927-938d-4449-a260-90053be70ec9-combined-ca-bundle\") pod \"barbican-worker-5bfb7678f9-6dzmx\" (UID: \"7e059927-938d-4449-a260-90053be70ec9\") " pod="openstack-kuttl-tests/barbican-worker-5bfb7678f9-6dzmx" Mar 16 16:14:40 crc kubenswrapper[5120]: I0316 16:14:40.126567 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dpdp\" (UniqueName: \"kubernetes.io/projected/9f16b3a2-bc26-4a63-8f8c-836611f0d320-kube-api-access-8dpdp\") pod \"barbican-api-796f4f9644-59hlg\" (UID: \"9f16b3a2-bc26-4a63-8f8c-836611f0d320\") " pod="openstack-kuttl-tests/barbican-api-796f4f9644-59hlg" Mar 16 16:14:40 crc kubenswrapper[5120]: I0316 16:14:40.126647 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7e059927-938d-4449-a260-90053be70ec9-logs\") pod \"barbican-worker-5bfb7678f9-6dzmx\" (UID: \"7e059927-938d-4449-a260-90053be70ec9\") " pod="openstack-kuttl-tests/barbican-worker-5bfb7678f9-6dzmx" Mar 16 16:14:40 crc kubenswrapper[5120]: I0316 16:14:40.126748 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9f16b3a2-bc26-4a63-8f8c-836611f0d320-combined-ca-bundle\") pod \"barbican-api-796f4f9644-59hlg\" (UID: \"9f16b3a2-bc26-4a63-8f8c-836611f0d320\") " pod="openstack-kuttl-tests/barbican-api-796f4f9644-59hlg" Mar 16 16:14:40 crc kubenswrapper[5120]: I0316 16:14:40.126864 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/9f16b3a2-bc26-4a63-8f8c-836611f0d320-internal-tls-certs\") pod \"barbican-api-796f4f9644-59hlg\" (UID: \"9f16b3a2-bc26-4a63-8f8c-836611f0d320\") " pod="openstack-kuttl-tests/barbican-api-796f4f9644-59hlg" Mar 16 16:14:40 crc kubenswrapper[5120]: I0316 16:14:40.126974 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/9f16b3a2-bc26-4a63-8f8c-836611f0d320-public-tls-certs\") pod \"barbican-api-796f4f9644-59hlg\" (UID: \"9f16b3a2-bc26-4a63-8f8c-836611f0d320\") " pod="openstack-kuttl-tests/barbican-api-796f4f9644-59hlg" Mar 16 16:14:40 crc kubenswrapper[5120]: I0316 16:14:40.127011 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7e059927-938d-4449-a260-90053be70ec9-config-data\") pod \"barbican-worker-5bfb7678f9-6dzmx\" (UID: \"7e059927-938d-4449-a260-90053be70ec9\") " pod="openstack-kuttl-tests/barbican-worker-5bfb7678f9-6dzmx" Mar 16 16:14:40 crc kubenswrapper[5120]: I0316 16:14:40.127501 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/7e059927-938d-4449-a260-90053be70ec9-config-data-custom\") pod \"barbican-worker-5bfb7678f9-6dzmx\" (UID: \"7e059927-938d-4449-a260-90053be70ec9\") " pod="openstack-kuttl-tests/barbican-worker-5bfb7678f9-6dzmx" Mar 16 16:14:40 crc kubenswrapper[5120]: I0316 16:14:40.127785 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7e059927-938d-4449-a260-90053be70ec9-logs\") pod \"barbican-worker-5bfb7678f9-6dzmx\" (UID: \"7e059927-938d-4449-a260-90053be70ec9\") " pod="openstack-kuttl-tests/barbican-worker-5bfb7678f9-6dzmx" Mar 16 16:14:40 crc kubenswrapper[5120]: I0316 16:14:40.130156 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7e059927-938d-4449-a260-90053be70ec9-config-data\") pod \"barbican-worker-5bfb7678f9-6dzmx\" (UID: \"7e059927-938d-4449-a260-90053be70ec9\") " pod="openstack-kuttl-tests/barbican-worker-5bfb7678f9-6dzmx" Mar 16 16:14:40 crc kubenswrapper[5120]: I0316 16:14:40.141390 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7e059927-938d-4449-a260-90053be70ec9-combined-ca-bundle\") pod \"barbican-worker-5bfb7678f9-6dzmx\" (UID: \"7e059927-938d-4449-a260-90053be70ec9\") " pod="openstack-kuttl-tests/barbican-worker-5bfb7678f9-6dzmx" Mar 16 16:14:40 crc kubenswrapper[5120]: I0316 16:14:40.143274 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzw8k\" (UniqueName: \"kubernetes.io/projected/7e059927-938d-4449-a260-90053be70ec9-kube-api-access-rzw8k\") pod \"barbican-worker-5bfb7678f9-6dzmx\" (UID: \"7e059927-938d-4449-a260-90053be70ec9\") " pod="openstack-kuttl-tests/barbican-worker-5bfb7678f9-6dzmx" Mar 16 16:14:40 crc kubenswrapper[5120]: I0316 16:14:40.173832 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:14:40 crc kubenswrapper[5120]: I0316 16:14:40.183840 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:14:40 crc kubenswrapper[5120]: I0316 16:14:40.228400 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/9f16b3a2-bc26-4a63-8f8c-836611f0d320-public-tls-certs\") pod \"barbican-api-796f4f9644-59hlg\" (UID: \"9f16b3a2-bc26-4a63-8f8c-836611f0d320\") " pod="openstack-kuttl-tests/barbican-api-796f4f9644-59hlg" Mar 16 16:14:40 crc kubenswrapper[5120]: I0316 16:14:40.228509 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9f16b3a2-bc26-4a63-8f8c-836611f0d320-config-data\") pod \"barbican-api-796f4f9644-59hlg\" (UID: \"9f16b3a2-bc26-4a63-8f8c-836611f0d320\") " pod="openstack-kuttl-tests/barbican-api-796f4f9644-59hlg" Mar 16 16:14:40 crc kubenswrapper[5120]: I0316 16:14:40.228534 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/9f16b3a2-bc26-4a63-8f8c-836611f0d320-config-data-custom\") pod \"barbican-api-796f4f9644-59hlg\" (UID: \"9f16b3a2-bc26-4a63-8f8c-836611f0d320\") " pod="openstack-kuttl-tests/barbican-api-796f4f9644-59hlg" Mar 16 16:14:40 crc kubenswrapper[5120]: I0316 16:14:40.228563 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9f16b3a2-bc26-4a63-8f8c-836611f0d320-logs\") pod \"barbican-api-796f4f9644-59hlg\" (UID: \"9f16b3a2-bc26-4a63-8f8c-836611f0d320\") " pod="openstack-kuttl-tests/barbican-api-796f4f9644-59hlg" Mar 16 16:14:40 crc kubenswrapper[5120]: I0316 16:14:40.228641 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8dpdp\" (UniqueName: \"kubernetes.io/projected/9f16b3a2-bc26-4a63-8f8c-836611f0d320-kube-api-access-8dpdp\") pod \"barbican-api-796f4f9644-59hlg\" (UID: \"9f16b3a2-bc26-4a63-8f8c-836611f0d320\") " pod="openstack-kuttl-tests/barbican-api-796f4f9644-59hlg" Mar 16 16:14:40 crc kubenswrapper[5120]: I0316 16:14:40.228706 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9f16b3a2-bc26-4a63-8f8c-836611f0d320-combined-ca-bundle\") pod \"barbican-api-796f4f9644-59hlg\" (UID: \"9f16b3a2-bc26-4a63-8f8c-836611f0d320\") " pod="openstack-kuttl-tests/barbican-api-796f4f9644-59hlg" Mar 16 16:14:40 crc kubenswrapper[5120]: I0316 16:14:40.228723 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/9f16b3a2-bc26-4a63-8f8c-836611f0d320-internal-tls-certs\") pod \"barbican-api-796f4f9644-59hlg\" (UID: \"9f16b3a2-bc26-4a63-8f8c-836611f0d320\") " pod="openstack-kuttl-tests/barbican-api-796f4f9644-59hlg" Mar 16 16:14:40 crc kubenswrapper[5120]: I0316 16:14:40.229832 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9f16b3a2-bc26-4a63-8f8c-836611f0d320-logs\") pod \"barbican-api-796f4f9644-59hlg\" (UID: \"9f16b3a2-bc26-4a63-8f8c-836611f0d320\") " pod="openstack-kuttl-tests/barbican-api-796f4f9644-59hlg" Mar 16 16:14:40 crc kubenswrapper[5120]: I0316 16:14:40.235357 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/9f16b3a2-bc26-4a63-8f8c-836611f0d320-config-data-custom\") pod \"barbican-api-796f4f9644-59hlg\" (UID: \"9f16b3a2-bc26-4a63-8f8c-836611f0d320\") " pod="openstack-kuttl-tests/barbican-api-796f4f9644-59hlg" Mar 16 16:14:40 crc kubenswrapper[5120]: I0316 16:14:40.239360 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:14:40 crc kubenswrapper[5120]: I0316 16:14:40.248192 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:14:40 crc kubenswrapper[5120]: I0316 16:14:40.255397 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/9f16b3a2-bc26-4a63-8f8c-836611f0d320-internal-tls-certs\") pod \"barbican-api-796f4f9644-59hlg\" (UID: \"9f16b3a2-bc26-4a63-8f8c-836611f0d320\") " pod="openstack-kuttl-tests/barbican-api-796f4f9644-59hlg" Mar 16 16:14:40 crc kubenswrapper[5120]: I0316 16:14:40.256197 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dpdp\" (UniqueName: \"kubernetes.io/projected/9f16b3a2-bc26-4a63-8f8c-836611f0d320-kube-api-access-8dpdp\") pod \"barbican-api-796f4f9644-59hlg\" (UID: \"9f16b3a2-bc26-4a63-8f8c-836611f0d320\") " pod="openstack-kuttl-tests/barbican-api-796f4f9644-59hlg" Mar 16 16:14:40 crc kubenswrapper[5120]: I0316 16:14:40.256567 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/9f16b3a2-bc26-4a63-8f8c-836611f0d320-public-tls-certs\") pod \"barbican-api-796f4f9644-59hlg\" (UID: \"9f16b3a2-bc26-4a63-8f8c-836611f0d320\") " pod="openstack-kuttl-tests/barbican-api-796f4f9644-59hlg" Mar 16 16:14:40 crc kubenswrapper[5120]: I0316 16:14:40.257250 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9f16b3a2-bc26-4a63-8f8c-836611f0d320-config-data\") pod \"barbican-api-796f4f9644-59hlg\" (UID: \"9f16b3a2-bc26-4a63-8f8c-836611f0d320\") " pod="openstack-kuttl-tests/barbican-api-796f4f9644-59hlg" Mar 16 16:14:40 crc kubenswrapper[5120]: I0316 16:14:40.257399 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9f16b3a2-bc26-4a63-8f8c-836611f0d320-combined-ca-bundle\") pod \"barbican-api-796f4f9644-59hlg\" (UID: \"9f16b3a2-bc26-4a63-8f8c-836611f0d320\") " pod="openstack-kuttl-tests/barbican-api-796f4f9644-59hlg" Mar 16 16:14:40 crc kubenswrapper[5120]: I0316 16:14:40.258133 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-cinder-internal-svc\"" Mar 16 16:14:40 crc kubenswrapper[5120]: I0316 16:14:40.258489 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-cinder-public-svc\"" Mar 16 16:14:40 crc kubenswrapper[5120]: I0316 16:14:40.258615 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-api-config-data\"" Mar 16 16:14:40 crc kubenswrapper[5120]: I0316 16:14:40.264047 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:14:40 crc kubenswrapper[5120]: I0316 16:14:40.288955 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-5bfb7678f9-6dzmx" Mar 16 16:14:40 crc kubenswrapper[5120]: I0316 16:14:40.310214 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-cbf797d74-8frg4" Mar 16 16:14:40 crc kubenswrapper[5120]: I0316 16:14:40.340237 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-796f4f9644-59hlg" Mar 16 16:14:40 crc kubenswrapper[5120]: I0316 16:14:40.356044 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:14:40 crc kubenswrapper[5120]: I0316 16:14:40.432816 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/60fe13eb-066c-4985-bb16-1a201e5c339c-config-data-custom\") pod \"cinder-api-0\" (UID: \"60fe13eb-066c-4985-bb16-1a201e5c339c\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:14:40 crc kubenswrapper[5120]: I0316 16:14:40.433089 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zsfkq\" (UniqueName: \"kubernetes.io/projected/60fe13eb-066c-4985-bb16-1a201e5c339c-kube-api-access-zsfkq\") pod \"cinder-api-0\" (UID: \"60fe13eb-066c-4985-bb16-1a201e5c339c\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:14:40 crc kubenswrapper[5120]: I0316 16:14:40.433139 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/60fe13eb-066c-4985-bb16-1a201e5c339c-config-data\") pod \"cinder-api-0\" (UID: \"60fe13eb-066c-4985-bb16-1a201e5c339c\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:14:40 crc kubenswrapper[5120]: I0316 16:14:40.433245 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/60fe13eb-066c-4985-bb16-1a201e5c339c-public-tls-certs\") pod \"cinder-api-0\" (UID: \"60fe13eb-066c-4985-bb16-1a201e5c339c\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:14:40 crc kubenswrapper[5120]: I0316 16:14:40.433282 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/60fe13eb-066c-4985-bb16-1a201e5c339c-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"60fe13eb-066c-4985-bb16-1a201e5c339c\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:14:40 crc kubenswrapper[5120]: I0316 16:14:40.435071 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/60fe13eb-066c-4985-bb16-1a201e5c339c-scripts\") pod \"cinder-api-0\" (UID: \"60fe13eb-066c-4985-bb16-1a201e5c339c\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:14:40 crc kubenswrapper[5120]: I0316 16:14:40.435109 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/60fe13eb-066c-4985-bb16-1a201e5c339c-etc-machine-id\") pod \"cinder-api-0\" (UID: \"60fe13eb-066c-4985-bb16-1a201e5c339c\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:14:40 crc kubenswrapper[5120]: I0316 16:14:40.435217 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/60fe13eb-066c-4985-bb16-1a201e5c339c-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"60fe13eb-066c-4985-bb16-1a201e5c339c\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:14:40 crc kubenswrapper[5120]: I0316 16:14:40.435251 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/60fe13eb-066c-4985-bb16-1a201e5c339c-logs\") pod \"cinder-api-0\" (UID: \"60fe13eb-066c-4985-bb16-1a201e5c339c\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:14:40 crc kubenswrapper[5120]: I0316 16:14:40.537179 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/60fe13eb-066c-4985-bb16-1a201e5c339c-public-tls-certs\") pod \"cinder-api-0\" (UID: \"60fe13eb-066c-4985-bb16-1a201e5c339c\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:14:40 crc kubenswrapper[5120]: I0316 16:14:40.537239 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/60fe13eb-066c-4985-bb16-1a201e5c339c-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"60fe13eb-066c-4985-bb16-1a201e5c339c\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:14:40 crc kubenswrapper[5120]: I0316 16:14:40.537301 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/60fe13eb-066c-4985-bb16-1a201e5c339c-scripts\") pod \"cinder-api-0\" (UID: \"60fe13eb-066c-4985-bb16-1a201e5c339c\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:14:40 crc kubenswrapper[5120]: I0316 16:14:40.537328 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/60fe13eb-066c-4985-bb16-1a201e5c339c-etc-machine-id\") pod \"cinder-api-0\" (UID: \"60fe13eb-066c-4985-bb16-1a201e5c339c\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:14:40 crc kubenswrapper[5120]: I0316 16:14:40.537378 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/60fe13eb-066c-4985-bb16-1a201e5c339c-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"60fe13eb-066c-4985-bb16-1a201e5c339c\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:14:40 crc kubenswrapper[5120]: I0316 16:14:40.537419 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/60fe13eb-066c-4985-bb16-1a201e5c339c-logs\") pod \"cinder-api-0\" (UID: \"60fe13eb-066c-4985-bb16-1a201e5c339c\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:14:40 crc kubenswrapper[5120]: I0316 16:14:40.537442 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/60fe13eb-066c-4985-bb16-1a201e5c339c-config-data-custom\") pod \"cinder-api-0\" (UID: \"60fe13eb-066c-4985-bb16-1a201e5c339c\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:14:40 crc kubenswrapper[5120]: I0316 16:14:40.537471 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zsfkq\" (UniqueName: \"kubernetes.io/projected/60fe13eb-066c-4985-bb16-1a201e5c339c-kube-api-access-zsfkq\") pod \"cinder-api-0\" (UID: \"60fe13eb-066c-4985-bb16-1a201e5c339c\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:14:40 crc kubenswrapper[5120]: I0316 16:14:40.537516 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/60fe13eb-066c-4985-bb16-1a201e5c339c-config-data\") pod \"cinder-api-0\" (UID: \"60fe13eb-066c-4985-bb16-1a201e5c339c\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:14:40 crc kubenswrapper[5120]: I0316 16:14:40.545893 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/60fe13eb-066c-4985-bb16-1a201e5c339c-etc-machine-id\") pod \"cinder-api-0\" (UID: \"60fe13eb-066c-4985-bb16-1a201e5c339c\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:14:40 crc kubenswrapper[5120]: I0316 16:14:40.546019 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/60fe13eb-066c-4985-bb16-1a201e5c339c-logs\") pod \"cinder-api-0\" (UID: \"60fe13eb-066c-4985-bb16-1a201e5c339c\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:14:40 crc kubenswrapper[5120]: I0316 16:14:40.550321 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/60fe13eb-066c-4985-bb16-1a201e5c339c-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"60fe13eb-066c-4985-bb16-1a201e5c339c\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:14:40 crc kubenswrapper[5120]: I0316 16:14:40.550514 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/60fe13eb-066c-4985-bb16-1a201e5c339c-config-data-custom\") pod \"cinder-api-0\" (UID: \"60fe13eb-066c-4985-bb16-1a201e5c339c\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:14:40 crc kubenswrapper[5120]: I0316 16:14:40.551417 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/60fe13eb-066c-4985-bb16-1a201e5c339c-config-data\") pod \"cinder-api-0\" (UID: \"60fe13eb-066c-4985-bb16-1a201e5c339c\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:14:40 crc kubenswrapper[5120]: I0316 16:14:40.561258 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/60fe13eb-066c-4985-bb16-1a201e5c339c-scripts\") pod \"cinder-api-0\" (UID: \"60fe13eb-066c-4985-bb16-1a201e5c339c\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:14:40 crc kubenswrapper[5120]: I0316 16:14:40.562258 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/60fe13eb-066c-4985-bb16-1a201e5c339c-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"60fe13eb-066c-4985-bb16-1a201e5c339c\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:14:40 crc kubenswrapper[5120]: I0316 16:14:40.566973 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zsfkq\" (UniqueName: \"kubernetes.io/projected/60fe13eb-066c-4985-bb16-1a201e5c339c-kube-api-access-zsfkq\") pod \"cinder-api-0\" (UID: \"60fe13eb-066c-4985-bb16-1a201e5c339c\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:14:40 crc kubenswrapper[5120]: I0316 16:14:40.570433 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/60fe13eb-066c-4985-bb16-1a201e5c339c-public-tls-certs\") pod \"cinder-api-0\" (UID: \"60fe13eb-066c-4985-bb16-1a201e5c339c\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:14:40 crc kubenswrapper[5120]: I0316 16:14:40.575210 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:14:40 crc kubenswrapper[5120]: I0316 16:14:40.707348 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="20167ee9-3d5b-4ea7-9fe8-557fefbad83e" path="/var/lib/kubelet/pods/20167ee9-3d5b-4ea7-9fe8-557fefbad83e/volumes" Mar 16 16:14:40 crc kubenswrapper[5120]: I0316 16:14:40.828409 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-5bfb7678f9-6dzmx"] Mar 16 16:14:40 crc kubenswrapper[5120]: I0316 16:14:40.908089 5120 generic.go:358] "Generic (PLEG): container finished" podID="90332f2f-d386-4c90-8e67-a2c6bf57dffc" containerID="2c1f65aa1fcfacbe35286250488fa1a15a9b23f37c4a5334293b705dbd5e516e" exitCode=143 Mar 16 16:14:40 crc kubenswrapper[5120]: I0316 16:14:40.908488 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-79fb5cbbfb-46s2s" event={"ID":"90332f2f-d386-4c90-8e67-a2c6bf57dffc","Type":"ContainerDied","Data":"2c1f65aa1fcfacbe35286250488fa1a15a9b23f37c4a5334293b705dbd5e516e"} Mar 16 16:14:40 crc kubenswrapper[5120]: I0316 16:14:40.930926 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-5bfb7678f9-6dzmx" event={"ID":"7e059927-938d-4449-a260-90053be70ec9","Type":"ContainerStarted","Data":"837165edc5cc416d379b2f8ff2be5601feb8c1103fe0aeda4578d419db1abb93"} Mar 16 16:14:40 crc kubenswrapper[5120]: I0316 16:14:40.936663 5120 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Mar 16 16:14:40 crc kubenswrapper[5120]: I0316 16:14:40.936685 5120 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Mar 16 16:14:41 crc kubenswrapper[5120]: I0316 16:14:41.015748 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-cbf797d74-8frg4"] Mar 16 16:14:41 crc kubenswrapper[5120]: I0316 16:14:41.421864 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-796f4f9644-59hlg"] Mar 16 16:14:41 crc kubenswrapper[5120]: I0316 16:14:41.423586 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-9zjx8" Mar 16 16:14:41 crc kubenswrapper[5120]: I0316 16:14:41.445688 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:14:41 crc kubenswrapper[5120]: I0316 16:14:41.539980 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:14:41 crc kubenswrapper[5120]: I0316 16:14:41.562480 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/30317636-b1f4-4ee1-950b-6d80a890ef09-config\") pod \"30317636-b1f4-4ee1-950b-6d80a890ef09\" (UID: \"30317636-b1f4-4ee1-950b-6d80a890ef09\") " Mar 16 16:14:41 crc kubenswrapper[5120]: I0316 16:14:41.562812 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/30317636-b1f4-4ee1-950b-6d80a890ef09-combined-ca-bundle\") pod \"30317636-b1f4-4ee1-950b-6d80a890ef09\" (UID: \"30317636-b1f4-4ee1-950b-6d80a890ef09\") " Mar 16 16:14:41 crc kubenswrapper[5120]: I0316 16:14:41.562857 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w7ggs\" (UniqueName: \"kubernetes.io/projected/30317636-b1f4-4ee1-950b-6d80a890ef09-kube-api-access-w7ggs\") pod \"30317636-b1f4-4ee1-950b-6d80a890ef09\" (UID: \"30317636-b1f4-4ee1-950b-6d80a890ef09\") " Mar 16 16:14:41 crc kubenswrapper[5120]: I0316 16:14:41.572305 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30317636-b1f4-4ee1-950b-6d80a890ef09-kube-api-access-w7ggs" (OuterVolumeSpecName: "kube-api-access-w7ggs") pod "30317636-b1f4-4ee1-950b-6d80a890ef09" (UID: "30317636-b1f4-4ee1-950b-6d80a890ef09"). InnerVolumeSpecName "kube-api-access-w7ggs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:14:41 crc kubenswrapper[5120]: I0316 16:14:41.611359 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/30317636-b1f4-4ee1-950b-6d80a890ef09-config" (OuterVolumeSpecName: "config") pod "30317636-b1f4-4ee1-950b-6d80a890ef09" (UID: "30317636-b1f4-4ee1-950b-6d80a890ef09"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:14:41 crc kubenswrapper[5120]: I0316 16:14:41.614887 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/30317636-b1f4-4ee1-950b-6d80a890ef09-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "30317636-b1f4-4ee1-950b-6d80a890ef09" (UID: "30317636-b1f4-4ee1-950b-6d80a890ef09"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:14:41 crc kubenswrapper[5120]: I0316 16:14:41.628213 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-79fb5cbbfb-46s2s" Mar 16 16:14:41 crc kubenswrapper[5120]: I0316 16:14:41.667190 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/30317636-b1f4-4ee1-950b-6d80a890ef09-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:14:41 crc kubenswrapper[5120]: I0316 16:14:41.667228 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w7ggs\" (UniqueName: \"kubernetes.io/projected/30317636-b1f4-4ee1-950b-6d80a890ef09-kube-api-access-w7ggs\") on node \"crc\" DevicePath \"\"" Mar 16 16:14:41 crc kubenswrapper[5120]: I0316 16:14:41.667257 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/30317636-b1f4-4ee1-950b-6d80a890ef09-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:14:41 crc kubenswrapper[5120]: I0316 16:14:41.714205 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:14:41 crc kubenswrapper[5120]: I0316 16:14:41.714326 5120 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Mar 16 16:14:41 crc kubenswrapper[5120]: I0316 16:14:41.718385 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:14:41 crc kubenswrapper[5120]: I0316 16:14:41.886108 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:14:41 crc kubenswrapper[5120]: I0316 16:14:41.984169 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-cbf797d74-8frg4" event={"ID":"b2e8d0e9-fa13-49fc-b149-af0d8d1d5ef0","Type":"ContainerStarted","Data":"39998592854bf56ef9997d1b6241d034080c653045712cd7dd3cecb1c338b3b5"} Mar 16 16:14:41 crc kubenswrapper[5120]: I0316 16:14:41.984229 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-cbf797d74-8frg4" event={"ID":"b2e8d0e9-fa13-49fc-b149-af0d8d1d5ef0","Type":"ContainerStarted","Data":"9f4ca810d0333490f7f8804535988941a3f37adb5983d0982fedf9261a9e97e6"} Mar 16 16:14:41 crc kubenswrapper[5120]: I0316 16:14:41.984239 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-cbf797d74-8frg4" event={"ID":"b2e8d0e9-fa13-49fc-b149-af0d8d1d5ef0","Type":"ContainerStarted","Data":"2d5a95850013c417952bd349e0e34ec10a5acd281a53c3aef855d2eb411dc9ed"} Mar 16 16:14:41 crc kubenswrapper[5120]: I0316 16:14:41.995195 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-9zjx8" Mar 16 16:14:41 crc kubenswrapper[5120]: I0316 16:14:41.995229 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-9zjx8" event={"ID":"30317636-b1f4-4ee1-950b-6d80a890ef09","Type":"ContainerDied","Data":"6e432c820ade96d1794ee7d25721bc7d5ff01e49a1f68861684433da08e01169"} Mar 16 16:14:41 crc kubenswrapper[5120]: I0316 16:14:41.995259 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6e432c820ade96d1794ee7d25721bc7d5ff01e49a1f68861684433da08e01169" Mar 16 16:14:42 crc kubenswrapper[5120]: I0316 16:14:42.000519 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"60fe13eb-066c-4985-bb16-1a201e5c339c","Type":"ContainerStarted","Data":"d3fc3812292aa6ea211b7d08855a1b4384ef8f553c75145fad60438d88db61e1"} Mar 16 16:14:42 crc kubenswrapper[5120]: I0316 16:14:42.036702 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-796f4f9644-59hlg" event={"ID":"9f16b3a2-bc26-4a63-8f8c-836611f0d320","Type":"ContainerStarted","Data":"3d3613157c725663b3645ab202fb54ad95ebbe067187047f60bb2b1749e436ce"} Mar 16 16:14:42 crc kubenswrapper[5120]: I0316 16:14:42.036745 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-796f4f9644-59hlg" event={"ID":"9f16b3a2-bc26-4a63-8f8c-836611f0d320","Type":"ContainerStarted","Data":"bb48372b68c9bc4066fb62520c9aabc044968dabf2c988b20d2d88ef013d62bc"} Mar 16 16:14:42 crc kubenswrapper[5120]: I0316 16:14:42.040808 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-keystone-listener-cbf797d74-8frg4" podStartSLOduration=3.040749779 podStartE2EDuration="3.040749779s" podCreationTimestamp="2026-03-16 16:14:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:14:42.0150413 +0000 UTC m=+2584.168972947" watchObservedRunningTime="2026-03-16 16:14:42.040749779 +0000 UTC m=+2584.194681476" Mar 16 16:14:42 crc kubenswrapper[5120]: I0316 16:14:42.048588 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-5bfb7678f9-6dzmx" event={"ID":"7e059927-938d-4449-a260-90053be70ec9","Type":"ContainerStarted","Data":"e38ea22442a3e5da16488296d5a4582eb3a1ae936d22b1e4246f21d7c1a26d34"} Mar 16 16:14:42 crc kubenswrapper[5120]: I0316 16:14:42.048817 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-5bfb7678f9-6dzmx" event={"ID":"7e059927-938d-4449-a260-90053be70ec9","Type":"ContainerStarted","Data":"d430d21560c12eca992abdde06e718c2e3d71e50d61e91ef2285be76ee5901bd"} Mar 16 16:14:42 crc kubenswrapper[5120]: I0316 16:14:42.084975 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-6c79fccb98-ccmbb"] Mar 16 16:14:42 crc kubenswrapper[5120]: I0316 16:14:42.085339 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-worker-5bfb7678f9-6dzmx" podStartSLOduration=3.085320843 podStartE2EDuration="3.085320843s" podCreationTimestamp="2026-03-16 16:14:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:14:42.070443724 +0000 UTC m=+2584.224375381" watchObservedRunningTime="2026-03-16 16:14:42.085320843 +0000 UTC m=+2584.239252500" Mar 16 16:14:42 crc kubenswrapper[5120]: I0316 16:14:42.093636 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-6c79fccb98-ccmbb" podUID="c2631af3-9152-470b-8aa8-2395a88ec1ab" containerName="barbican-keystone-listener-log" containerID="cri-o://df6901c9ecd72698003b27fbc3b639dfb0dc3eccef59ce092d3ca1237db632cf" gracePeriod=30 Mar 16 16:14:42 crc kubenswrapper[5120]: I0316 16:14:42.093858 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-6c79fccb98-ccmbb" podUID="c2631af3-9152-470b-8aa8-2395a88ec1ab" containerName="barbican-keystone-listener" containerID="cri-o://ec833fb04a8faa4bbb0cc46a41c1d27652f76a3891407e6aa05c62a253cacf8e" gracePeriod=30 Mar 16 16:14:42 crc kubenswrapper[5120]: I0316 16:14:42.126052 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-7c468d546f-vjd49"] Mar 16 16:14:42 crc kubenswrapper[5120]: I0316 16:14:42.126300 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-7c468d546f-vjd49" podUID="e9b63ab0-f32f-4118-9e63-b82550c1d518" containerName="barbican-worker-log" containerID="cri-o://abb64c72c7b8685ede4a429cbedcbec43a64d7a4ac6a560c46eab15bc712b901" gracePeriod=30 Mar 16 16:14:42 crc kubenswrapper[5120]: I0316 16:14:42.126701 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-7c468d546f-vjd49" podUID="e9b63ab0-f32f-4118-9e63-b82550c1d518" containerName="barbican-worker" containerID="cri-o://9e2cd9ee31b8503ea9d68b96980216bb40b609ac1140ff9f0bdfcdaab38bfe7b" gracePeriod=30 Mar 16 16:14:42 crc kubenswrapper[5120]: I0316 16:14:42.186780 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-85457c7f69-x8z6t"] Mar 16 16:14:42 crc kubenswrapper[5120]: I0316 16:14:42.187809 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30317636-b1f4-4ee1-950b-6d80a890ef09" containerName="neutron-db-sync" Mar 16 16:14:42 crc kubenswrapper[5120]: I0316 16:14:42.187830 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="30317636-b1f4-4ee1-950b-6d80a890ef09" containerName="neutron-db-sync" Mar 16 16:14:42 crc kubenswrapper[5120]: I0316 16:14:42.188038 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="30317636-b1f4-4ee1-950b-6d80a890ef09" containerName="neutron-db-sync" Mar 16 16:14:42 crc kubenswrapper[5120]: I0316 16:14:42.212188 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-85457c7f69-x8z6t" Mar 16 16:14:42 crc kubenswrapper[5120]: I0316 16:14:42.215782 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-httpd-config\"" Mar 16 16:14:42 crc kubenswrapper[5120]: I0316 16:14:42.216308 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-neutron-dockercfg-j74rz\"" Mar 16 16:14:42 crc kubenswrapper[5120]: I0316 16:14:42.216603 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-neutron-ovndbs\"" Mar 16 16:14:42 crc kubenswrapper[5120]: I0316 16:14:42.218014 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-config\"" Mar 16 16:14:42 crc kubenswrapper[5120]: I0316 16:14:42.250829 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-85457c7f69-x8z6t"] Mar 16 16:14:42 crc kubenswrapper[5120]: I0316 16:14:42.285525 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jb7sr\" (UniqueName: \"kubernetes.io/projected/d867b8f8-f632-48fb-ba66-4ac0c6f93dbe-kube-api-access-jb7sr\") pod \"neutron-85457c7f69-x8z6t\" (UID: \"d867b8f8-f632-48fb-ba66-4ac0c6f93dbe\") " pod="openstack-kuttl-tests/neutron-85457c7f69-x8z6t" Mar 16 16:14:42 crc kubenswrapper[5120]: I0316 16:14:42.285595 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d867b8f8-f632-48fb-ba66-4ac0c6f93dbe-config\") pod \"neutron-85457c7f69-x8z6t\" (UID: \"d867b8f8-f632-48fb-ba66-4ac0c6f93dbe\") " pod="openstack-kuttl-tests/neutron-85457c7f69-x8z6t" Mar 16 16:14:42 crc kubenswrapper[5120]: I0316 16:14:42.285671 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/d867b8f8-f632-48fb-ba66-4ac0c6f93dbe-ovndb-tls-certs\") pod \"neutron-85457c7f69-x8z6t\" (UID: \"d867b8f8-f632-48fb-ba66-4ac0c6f93dbe\") " pod="openstack-kuttl-tests/neutron-85457c7f69-x8z6t" Mar 16 16:14:42 crc kubenswrapper[5120]: I0316 16:14:42.285771 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d867b8f8-f632-48fb-ba66-4ac0c6f93dbe-combined-ca-bundle\") pod \"neutron-85457c7f69-x8z6t\" (UID: \"d867b8f8-f632-48fb-ba66-4ac0c6f93dbe\") " pod="openstack-kuttl-tests/neutron-85457c7f69-x8z6t" Mar 16 16:14:42 crc kubenswrapper[5120]: I0316 16:14:42.286299 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/d867b8f8-f632-48fb-ba66-4ac0c6f93dbe-httpd-config\") pod \"neutron-85457c7f69-x8z6t\" (UID: \"d867b8f8-f632-48fb-ba66-4ac0c6f93dbe\") " pod="openstack-kuttl-tests/neutron-85457c7f69-x8z6t" Mar 16 16:14:42 crc kubenswrapper[5120]: I0316 16:14:42.389862 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/d867b8f8-f632-48fb-ba66-4ac0c6f93dbe-ovndb-tls-certs\") pod \"neutron-85457c7f69-x8z6t\" (UID: \"d867b8f8-f632-48fb-ba66-4ac0c6f93dbe\") " pod="openstack-kuttl-tests/neutron-85457c7f69-x8z6t" Mar 16 16:14:42 crc kubenswrapper[5120]: I0316 16:14:42.390010 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d867b8f8-f632-48fb-ba66-4ac0c6f93dbe-combined-ca-bundle\") pod \"neutron-85457c7f69-x8z6t\" (UID: \"d867b8f8-f632-48fb-ba66-4ac0c6f93dbe\") " pod="openstack-kuttl-tests/neutron-85457c7f69-x8z6t" Mar 16 16:14:42 crc kubenswrapper[5120]: I0316 16:14:42.390077 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/d867b8f8-f632-48fb-ba66-4ac0c6f93dbe-httpd-config\") pod \"neutron-85457c7f69-x8z6t\" (UID: \"d867b8f8-f632-48fb-ba66-4ac0c6f93dbe\") " pod="openstack-kuttl-tests/neutron-85457c7f69-x8z6t" Mar 16 16:14:42 crc kubenswrapper[5120]: I0316 16:14:42.390191 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jb7sr\" (UniqueName: \"kubernetes.io/projected/d867b8f8-f632-48fb-ba66-4ac0c6f93dbe-kube-api-access-jb7sr\") pod \"neutron-85457c7f69-x8z6t\" (UID: \"d867b8f8-f632-48fb-ba66-4ac0c6f93dbe\") " pod="openstack-kuttl-tests/neutron-85457c7f69-x8z6t" Mar 16 16:14:42 crc kubenswrapper[5120]: I0316 16:14:42.390268 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d867b8f8-f632-48fb-ba66-4ac0c6f93dbe-config\") pod \"neutron-85457c7f69-x8z6t\" (UID: \"d867b8f8-f632-48fb-ba66-4ac0c6f93dbe\") " pod="openstack-kuttl-tests/neutron-85457c7f69-x8z6t" Mar 16 16:14:42 crc kubenswrapper[5120]: I0316 16:14:42.401241 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/d867b8f8-f632-48fb-ba66-4ac0c6f93dbe-httpd-config\") pod \"neutron-85457c7f69-x8z6t\" (UID: \"d867b8f8-f632-48fb-ba66-4ac0c6f93dbe\") " pod="openstack-kuttl-tests/neutron-85457c7f69-x8z6t" Mar 16 16:14:42 crc kubenswrapper[5120]: I0316 16:14:42.403881 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/d867b8f8-f632-48fb-ba66-4ac0c6f93dbe-config\") pod \"neutron-85457c7f69-x8z6t\" (UID: \"d867b8f8-f632-48fb-ba66-4ac0c6f93dbe\") " pod="openstack-kuttl-tests/neutron-85457c7f69-x8z6t" Mar 16 16:14:42 crc kubenswrapper[5120]: I0316 16:14:42.406697 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/d867b8f8-f632-48fb-ba66-4ac0c6f93dbe-ovndb-tls-certs\") pod \"neutron-85457c7f69-x8z6t\" (UID: \"d867b8f8-f632-48fb-ba66-4ac0c6f93dbe\") " pod="openstack-kuttl-tests/neutron-85457c7f69-x8z6t" Mar 16 16:14:42 crc kubenswrapper[5120]: I0316 16:14:42.407499 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d867b8f8-f632-48fb-ba66-4ac0c6f93dbe-combined-ca-bundle\") pod \"neutron-85457c7f69-x8z6t\" (UID: \"d867b8f8-f632-48fb-ba66-4ac0c6f93dbe\") " pod="openstack-kuttl-tests/neutron-85457c7f69-x8z6t" Mar 16 16:14:42 crc kubenswrapper[5120]: I0316 16:14:42.414549 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jb7sr\" (UniqueName: \"kubernetes.io/projected/d867b8f8-f632-48fb-ba66-4ac0c6f93dbe-kube-api-access-jb7sr\") pod \"neutron-85457c7f69-x8z6t\" (UID: \"d867b8f8-f632-48fb-ba66-4ac0c6f93dbe\") " pod="openstack-kuttl-tests/neutron-85457c7f69-x8z6t" Mar 16 16:14:42 crc kubenswrapper[5120]: I0316 16:14:42.581009 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-85457c7f69-x8z6t" Mar 16 16:14:43 crc kubenswrapper[5120]: I0316 16:14:43.064417 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"60fe13eb-066c-4985-bb16-1a201e5c339c","Type":"ContainerStarted","Data":"0fb5e3d8d5edd7398c14a6ea88b6ab188a65bacb06e33f6b4414f043c40c548e"} Mar 16 16:14:43 crc kubenswrapper[5120]: I0316 16:14:43.070049 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-796f4f9644-59hlg" event={"ID":"9f16b3a2-bc26-4a63-8f8c-836611f0d320","Type":"ContainerStarted","Data":"cebcd6329c9e1b957b3f4bffa93b5a65003bd9fd06134f8e8d62306f23ec1220"} Mar 16 16:14:43 crc kubenswrapper[5120]: I0316 16:14:43.070629 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-796f4f9644-59hlg" Mar 16 16:14:43 crc kubenswrapper[5120]: I0316 16:14:43.070743 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-796f4f9644-59hlg" Mar 16 16:14:43 crc kubenswrapper[5120]: I0316 16:14:43.076450 5120 generic.go:358] "Generic (PLEG): container finished" podID="e9b63ab0-f32f-4118-9e63-b82550c1d518" containerID="abb64c72c7b8685ede4a429cbedcbec43a64d7a4ac6a560c46eab15bc712b901" exitCode=143 Mar 16 16:14:43 crc kubenswrapper[5120]: I0316 16:14:43.076552 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-7c468d546f-vjd49" event={"ID":"e9b63ab0-f32f-4118-9e63-b82550c1d518","Type":"ContainerDied","Data":"abb64c72c7b8685ede4a429cbedcbec43a64d7a4ac6a560c46eab15bc712b901"} Mar 16 16:14:43 crc kubenswrapper[5120]: I0316 16:14:43.084263 5120 generic.go:358] "Generic (PLEG): container finished" podID="c2631af3-9152-470b-8aa8-2395a88ec1ab" containerID="df6901c9ecd72698003b27fbc3b639dfb0dc3eccef59ce092d3ca1237db632cf" exitCode=143 Mar 16 16:14:43 crc kubenswrapper[5120]: I0316 16:14:43.085324 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-6c79fccb98-ccmbb" event={"ID":"c2631af3-9152-470b-8aa8-2395a88ec1ab","Type":"ContainerDied","Data":"df6901c9ecd72698003b27fbc3b639dfb0dc3eccef59ce092d3ca1237db632cf"} Mar 16 16:14:43 crc kubenswrapper[5120]: I0316 16:14:43.092436 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-api-796f4f9644-59hlg" podStartSLOduration=4.092417393 podStartE2EDuration="4.092417393s" podCreationTimestamp="2026-03-16 16:14:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:14:43.09231026 +0000 UTC m=+2585.246241917" watchObservedRunningTime="2026-03-16 16:14:43.092417393 +0000 UTC m=+2585.246349050" Mar 16 16:14:43 crc kubenswrapper[5120]: I0316 16:14:43.171665 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-85457c7f69-x8z6t"] Mar 16 16:14:44 crc kubenswrapper[5120]: I0316 16:14:44.129857 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-85457c7f69-x8z6t" event={"ID":"d867b8f8-f632-48fb-ba66-4ac0c6f93dbe","Type":"ContainerStarted","Data":"eee849a431780be3c90b33e43cb28db790fb3eaa43ec492448b7d8672ee7c7cf"} Mar 16 16:14:44 crc kubenswrapper[5120]: I0316 16:14:44.130385 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-85457c7f69-x8z6t" event={"ID":"d867b8f8-f632-48fb-ba66-4ac0c6f93dbe","Type":"ContainerStarted","Data":"feece484e190c8c1d16f36f88c509346dfc6431788e86100b3cd2bd79dac71c4"} Mar 16 16:14:44 crc kubenswrapper[5120]: I0316 16:14:44.130397 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-85457c7f69-x8z6t" event={"ID":"d867b8f8-f632-48fb-ba66-4ac0c6f93dbe","Type":"ContainerStarted","Data":"63bf139c7eaa6b48f3db34111fb33737cfeeb6e97453a44cd1b6946ab5cb9159"} Mar 16 16:14:44 crc kubenswrapper[5120]: I0316 16:14:44.130602 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/neutron-85457c7f69-x8z6t" Mar 16 16:14:44 crc kubenswrapper[5120]: I0316 16:14:44.174517 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-85457c7f69-x8z6t" podStartSLOduration=2.174497233 podStartE2EDuration="2.174497233s" podCreationTimestamp="2026-03-16 16:14:42 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:14:44.159956124 +0000 UTC m=+2586.313887791" watchObservedRunningTime="2026-03-16 16:14:44.174497233 +0000 UTC m=+2586.328428880" Mar 16 16:14:44 crc kubenswrapper[5120]: I0316 16:14:44.195931 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"60fe13eb-066c-4985-bb16-1a201e5c339c","Type":"ContainerStarted","Data":"c3d6d0476f8615371dfec590da87aa17915191fd8befb1ec3bcb8fe489ed8d5c"} Mar 16 16:14:44 crc kubenswrapper[5120]: I0316 16:14:44.196058 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:14:44 crc kubenswrapper[5120]: I0316 16:14:44.271233 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-api-0" podStartSLOduration=4.271213345 podStartE2EDuration="4.271213345s" podCreationTimestamp="2026-03-16 16:14:40 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:14:44.261364641 +0000 UTC m=+2586.415296298" watchObservedRunningTime="2026-03-16 16:14:44.271213345 +0000 UTC m=+2586.425145002" Mar 16 16:14:44 crc kubenswrapper[5120]: I0316 16:14:44.305480 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-d8b74df76-z7648"] Mar 16 16:14:44 crc kubenswrapper[5120]: I0316 16:14:44.322273 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-d8b74df76-z7648" Mar 16 16:14:44 crc kubenswrapper[5120]: I0316 16:14:44.329020 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-d8b74df76-z7648"] Mar 16 16:14:44 crc kubenswrapper[5120]: I0316 16:14:44.338830 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-neutron-public-svc\"" Mar 16 16:14:44 crc kubenswrapper[5120]: I0316 16:14:44.338984 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-neutron-internal-svc\"" Mar 16 16:14:44 crc kubenswrapper[5120]: I0316 16:14:44.391790 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/9698823e-0af0-4477-b47a-a388c6264dda-internal-tls-certs\") pod \"neutron-d8b74df76-z7648\" (UID: \"9698823e-0af0-4477-b47a-a388c6264dda\") " pod="openstack-kuttl-tests/neutron-d8b74df76-z7648" Mar 16 16:14:44 crc kubenswrapper[5120]: I0316 16:14:44.392087 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9698823e-0af0-4477-b47a-a388c6264dda-combined-ca-bundle\") pod \"neutron-d8b74df76-z7648\" (UID: \"9698823e-0af0-4477-b47a-a388c6264dda\") " pod="openstack-kuttl-tests/neutron-d8b74df76-z7648" Mar 16 16:14:44 crc kubenswrapper[5120]: I0316 16:14:44.392219 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/9698823e-0af0-4477-b47a-a388c6264dda-ovndb-tls-certs\") pod \"neutron-d8b74df76-z7648\" (UID: \"9698823e-0af0-4477-b47a-a388c6264dda\") " pod="openstack-kuttl-tests/neutron-d8b74df76-z7648" Mar 16 16:14:44 crc kubenswrapper[5120]: I0316 16:14:44.392347 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/9698823e-0af0-4477-b47a-a388c6264dda-httpd-config\") pod \"neutron-d8b74df76-z7648\" (UID: \"9698823e-0af0-4477-b47a-a388c6264dda\") " pod="openstack-kuttl-tests/neutron-d8b74df76-z7648" Mar 16 16:14:44 crc kubenswrapper[5120]: I0316 16:14:44.392431 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/9698823e-0af0-4477-b47a-a388c6264dda-public-tls-certs\") pod \"neutron-d8b74df76-z7648\" (UID: \"9698823e-0af0-4477-b47a-a388c6264dda\") " pod="openstack-kuttl-tests/neutron-d8b74df76-z7648" Mar 16 16:14:44 crc kubenswrapper[5120]: I0316 16:14:44.392541 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/9698823e-0af0-4477-b47a-a388c6264dda-config\") pod \"neutron-d8b74df76-z7648\" (UID: \"9698823e-0af0-4477-b47a-a388c6264dda\") " pod="openstack-kuttl-tests/neutron-d8b74df76-z7648" Mar 16 16:14:44 crc kubenswrapper[5120]: I0316 16:14:44.392707 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pzdk\" (UniqueName: \"kubernetes.io/projected/9698823e-0af0-4477-b47a-a388c6264dda-kube-api-access-5pzdk\") pod \"neutron-d8b74df76-z7648\" (UID: \"9698823e-0af0-4477-b47a-a388c6264dda\") " pod="openstack-kuttl-tests/neutron-d8b74df76-z7648" Mar 16 16:14:44 crc kubenswrapper[5120]: I0316 16:14:44.494406 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5pzdk\" (UniqueName: \"kubernetes.io/projected/9698823e-0af0-4477-b47a-a388c6264dda-kube-api-access-5pzdk\") pod \"neutron-d8b74df76-z7648\" (UID: \"9698823e-0af0-4477-b47a-a388c6264dda\") " pod="openstack-kuttl-tests/neutron-d8b74df76-z7648" Mar 16 16:14:44 crc kubenswrapper[5120]: I0316 16:14:44.494748 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/9698823e-0af0-4477-b47a-a388c6264dda-internal-tls-certs\") pod \"neutron-d8b74df76-z7648\" (UID: \"9698823e-0af0-4477-b47a-a388c6264dda\") " pod="openstack-kuttl-tests/neutron-d8b74df76-z7648" Mar 16 16:14:44 crc kubenswrapper[5120]: I0316 16:14:44.494821 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9698823e-0af0-4477-b47a-a388c6264dda-combined-ca-bundle\") pod \"neutron-d8b74df76-z7648\" (UID: \"9698823e-0af0-4477-b47a-a388c6264dda\") " pod="openstack-kuttl-tests/neutron-d8b74df76-z7648" Mar 16 16:14:44 crc kubenswrapper[5120]: I0316 16:14:44.494859 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/9698823e-0af0-4477-b47a-a388c6264dda-ovndb-tls-certs\") pod \"neutron-d8b74df76-z7648\" (UID: \"9698823e-0af0-4477-b47a-a388c6264dda\") " pod="openstack-kuttl-tests/neutron-d8b74df76-z7648" Mar 16 16:14:44 crc kubenswrapper[5120]: I0316 16:14:44.494887 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/9698823e-0af0-4477-b47a-a388c6264dda-httpd-config\") pod \"neutron-d8b74df76-z7648\" (UID: \"9698823e-0af0-4477-b47a-a388c6264dda\") " pod="openstack-kuttl-tests/neutron-d8b74df76-z7648" Mar 16 16:14:44 crc kubenswrapper[5120]: I0316 16:14:44.494908 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/9698823e-0af0-4477-b47a-a388c6264dda-public-tls-certs\") pod \"neutron-d8b74df76-z7648\" (UID: \"9698823e-0af0-4477-b47a-a388c6264dda\") " pod="openstack-kuttl-tests/neutron-d8b74df76-z7648" Mar 16 16:14:44 crc kubenswrapper[5120]: I0316 16:14:44.494954 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/9698823e-0af0-4477-b47a-a388c6264dda-config\") pod \"neutron-d8b74df76-z7648\" (UID: \"9698823e-0af0-4477-b47a-a388c6264dda\") " pod="openstack-kuttl-tests/neutron-d8b74df76-z7648" Mar 16 16:14:44 crc kubenswrapper[5120]: I0316 16:14:44.501041 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/9698823e-0af0-4477-b47a-a388c6264dda-ovndb-tls-certs\") pod \"neutron-d8b74df76-z7648\" (UID: \"9698823e-0af0-4477-b47a-a388c6264dda\") " pod="openstack-kuttl-tests/neutron-d8b74df76-z7648" Mar 16 16:14:44 crc kubenswrapper[5120]: I0316 16:14:44.502050 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/9698823e-0af0-4477-b47a-a388c6264dda-public-tls-certs\") pod \"neutron-d8b74df76-z7648\" (UID: \"9698823e-0af0-4477-b47a-a388c6264dda\") " pod="openstack-kuttl-tests/neutron-d8b74df76-z7648" Mar 16 16:14:44 crc kubenswrapper[5120]: I0316 16:14:44.502592 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/9698823e-0af0-4477-b47a-a388c6264dda-config\") pod \"neutron-d8b74df76-z7648\" (UID: \"9698823e-0af0-4477-b47a-a388c6264dda\") " pod="openstack-kuttl-tests/neutron-d8b74df76-z7648" Mar 16 16:14:44 crc kubenswrapper[5120]: I0316 16:14:44.506408 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/9698823e-0af0-4477-b47a-a388c6264dda-httpd-config\") pod \"neutron-d8b74df76-z7648\" (UID: \"9698823e-0af0-4477-b47a-a388c6264dda\") " pod="openstack-kuttl-tests/neutron-d8b74df76-z7648" Mar 16 16:14:44 crc kubenswrapper[5120]: I0316 16:14:44.509323 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9698823e-0af0-4477-b47a-a388c6264dda-combined-ca-bundle\") pod \"neutron-d8b74df76-z7648\" (UID: \"9698823e-0af0-4477-b47a-a388c6264dda\") " pod="openstack-kuttl-tests/neutron-d8b74df76-z7648" Mar 16 16:14:44 crc kubenswrapper[5120]: I0316 16:14:44.513448 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pzdk\" (UniqueName: \"kubernetes.io/projected/9698823e-0af0-4477-b47a-a388c6264dda-kube-api-access-5pzdk\") pod \"neutron-d8b74df76-z7648\" (UID: \"9698823e-0af0-4477-b47a-a388c6264dda\") " pod="openstack-kuttl-tests/neutron-d8b74df76-z7648" Mar 16 16:14:44 crc kubenswrapper[5120]: I0316 16:14:44.515747 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/9698823e-0af0-4477-b47a-a388c6264dda-internal-tls-certs\") pod \"neutron-d8b74df76-z7648\" (UID: \"9698823e-0af0-4477-b47a-a388c6264dda\") " pod="openstack-kuttl-tests/neutron-d8b74df76-z7648" Mar 16 16:14:44 crc kubenswrapper[5120]: I0316 16:14:44.668683 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-d8b74df76-z7648" Mar 16 16:14:45 crc kubenswrapper[5120]: I0316 16:14:45.131846 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-d8b74df76-z7648"] Mar 16 16:14:45 crc kubenswrapper[5120]: I0316 16:14:45.209742 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-d8b74df76-z7648" event={"ID":"9698823e-0af0-4477-b47a-a388c6264dda","Type":"ContainerStarted","Data":"6f87c95dbbec0e10f1c7f28e7fb03bb68c90ac680d5abe9466ffa371a17a0c5c"} Mar 16 16:14:45 crc kubenswrapper[5120]: I0316 16:14:45.357406 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-79fb5cbbfb-46s2s" podUID="90332f2f-d386-4c90-8e67-a2c6bf57dffc" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.0.223:9311/healthcheck\": read tcp 10.217.0.2:59656->10.217.0.223:9311: read: connection reset by peer" Mar 16 16:14:45 crc kubenswrapper[5120]: I0316 16:14:45.357913 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-79fb5cbbfb-46s2s" podUID="90332f2f-d386-4c90-8e67-a2c6bf57dffc" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.0.223:9311/healthcheck\": read tcp 10.217.0.2:59654->10.217.0.223:9311: read: connection reset by peer" Mar 16 16:14:45 crc kubenswrapper[5120]: I0316 16:14:45.568633 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:14:45 crc kubenswrapper[5120]: I0316 16:14:45.637232 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:14:45 crc kubenswrapper[5120]: I0316 16:14:45.790232 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-79fb5cbbfb-46s2s" Mar 16 16:14:45 crc kubenswrapper[5120]: I0316 16:14:45.827024 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/90332f2f-d386-4c90-8e67-a2c6bf57dffc-internal-tls-certs\") pod \"90332f2f-d386-4c90-8e67-a2c6bf57dffc\" (UID: \"90332f2f-d386-4c90-8e67-a2c6bf57dffc\") " Mar 16 16:14:45 crc kubenswrapper[5120]: I0316 16:14:45.827078 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/90332f2f-d386-4c90-8e67-a2c6bf57dffc-combined-ca-bundle\") pod \"90332f2f-d386-4c90-8e67-a2c6bf57dffc\" (UID: \"90332f2f-d386-4c90-8e67-a2c6bf57dffc\") " Mar 16 16:14:45 crc kubenswrapper[5120]: I0316 16:14:45.827126 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/90332f2f-d386-4c90-8e67-a2c6bf57dffc-config-data-custom\") pod \"90332f2f-d386-4c90-8e67-a2c6bf57dffc\" (UID: \"90332f2f-d386-4c90-8e67-a2c6bf57dffc\") " Mar 16 16:14:45 crc kubenswrapper[5120]: I0316 16:14:45.827256 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pb5lw\" (UniqueName: \"kubernetes.io/projected/90332f2f-d386-4c90-8e67-a2c6bf57dffc-kube-api-access-pb5lw\") pod \"90332f2f-d386-4c90-8e67-a2c6bf57dffc\" (UID: \"90332f2f-d386-4c90-8e67-a2c6bf57dffc\") " Mar 16 16:14:45 crc kubenswrapper[5120]: I0316 16:14:45.827364 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/90332f2f-d386-4c90-8e67-a2c6bf57dffc-public-tls-certs\") pod \"90332f2f-d386-4c90-8e67-a2c6bf57dffc\" (UID: \"90332f2f-d386-4c90-8e67-a2c6bf57dffc\") " Mar 16 16:14:45 crc kubenswrapper[5120]: I0316 16:14:45.827481 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/90332f2f-d386-4c90-8e67-a2c6bf57dffc-logs\") pod \"90332f2f-d386-4c90-8e67-a2c6bf57dffc\" (UID: \"90332f2f-d386-4c90-8e67-a2c6bf57dffc\") " Mar 16 16:14:45 crc kubenswrapper[5120]: I0316 16:14:45.829098 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90332f2f-d386-4c90-8e67-a2c6bf57dffc-logs" (OuterVolumeSpecName: "logs") pod "90332f2f-d386-4c90-8e67-a2c6bf57dffc" (UID: "90332f2f-d386-4c90-8e67-a2c6bf57dffc"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:14:45 crc kubenswrapper[5120]: I0316 16:14:45.829140 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/90332f2f-d386-4c90-8e67-a2c6bf57dffc-config-data\") pod \"90332f2f-d386-4c90-8e67-a2c6bf57dffc\" (UID: \"90332f2f-d386-4c90-8e67-a2c6bf57dffc\") " Mar 16 16:14:45 crc kubenswrapper[5120]: I0316 16:14:45.829676 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/90332f2f-d386-4c90-8e67-a2c6bf57dffc-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:14:45 crc kubenswrapper[5120]: I0316 16:14:45.853920 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90332f2f-d386-4c90-8e67-a2c6bf57dffc-kube-api-access-pb5lw" (OuterVolumeSpecName: "kube-api-access-pb5lw") pod "90332f2f-d386-4c90-8e67-a2c6bf57dffc" (UID: "90332f2f-d386-4c90-8e67-a2c6bf57dffc"). InnerVolumeSpecName "kube-api-access-pb5lw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:14:45 crc kubenswrapper[5120]: I0316 16:14:45.871337 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/90332f2f-d386-4c90-8e67-a2c6bf57dffc-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "90332f2f-d386-4c90-8e67-a2c6bf57dffc" (UID: "90332f2f-d386-4c90-8e67-a2c6bf57dffc"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:14:45 crc kubenswrapper[5120]: I0316 16:14:45.893711 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/90332f2f-d386-4c90-8e67-a2c6bf57dffc-config-data" (OuterVolumeSpecName: "config-data") pod "90332f2f-d386-4c90-8e67-a2c6bf57dffc" (UID: "90332f2f-d386-4c90-8e67-a2c6bf57dffc"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:14:45 crc kubenswrapper[5120]: I0316 16:14:45.899817 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/90332f2f-d386-4c90-8e67-a2c6bf57dffc-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "90332f2f-d386-4c90-8e67-a2c6bf57dffc" (UID: "90332f2f-d386-4c90-8e67-a2c6bf57dffc"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:14:45 crc kubenswrapper[5120]: I0316 16:14:45.901124 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/90332f2f-d386-4c90-8e67-a2c6bf57dffc-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "90332f2f-d386-4c90-8e67-a2c6bf57dffc" (UID: "90332f2f-d386-4c90-8e67-a2c6bf57dffc"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:14:45 crc kubenswrapper[5120]: I0316 16:14:45.931583 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/90332f2f-d386-4c90-8e67-a2c6bf57dffc-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:14:45 crc kubenswrapper[5120]: I0316 16:14:45.931626 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/90332f2f-d386-4c90-8e67-a2c6bf57dffc-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:14:45 crc kubenswrapper[5120]: I0316 16:14:45.931637 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pb5lw\" (UniqueName: \"kubernetes.io/projected/90332f2f-d386-4c90-8e67-a2c6bf57dffc-kube-api-access-pb5lw\") on node \"crc\" DevicePath \"\"" Mar 16 16:14:45 crc kubenswrapper[5120]: I0316 16:14:45.931648 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/90332f2f-d386-4c90-8e67-a2c6bf57dffc-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:14:45 crc kubenswrapper[5120]: I0316 16:14:45.933027 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/90332f2f-d386-4c90-8e67-a2c6bf57dffc-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:14:45 crc kubenswrapper[5120]: I0316 16:14:45.947136 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/90332f2f-d386-4c90-8e67-a2c6bf57dffc-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "90332f2f-d386-4c90-8e67-a2c6bf57dffc" (UID: "90332f2f-d386-4c90-8e67-a2c6bf57dffc"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:14:46 crc kubenswrapper[5120]: I0316 16:14:46.035321 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/90332f2f-d386-4c90-8e67-a2c6bf57dffc-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:14:46 crc kubenswrapper[5120]: I0316 16:14:46.221633 5120 generic.go:358] "Generic (PLEG): container finished" podID="90332f2f-d386-4c90-8e67-a2c6bf57dffc" containerID="0ccbe0f01e81859389bce7f3706988a037cb7c1f28016d05b59ad83e847c18de" exitCode=0 Mar 16 16:14:46 crc kubenswrapper[5120]: I0316 16:14:46.221798 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-79fb5cbbfb-46s2s" event={"ID":"90332f2f-d386-4c90-8e67-a2c6bf57dffc","Type":"ContainerDied","Data":"0ccbe0f01e81859389bce7f3706988a037cb7c1f28016d05b59ad83e847c18de"} Mar 16 16:14:46 crc kubenswrapper[5120]: I0316 16:14:46.221829 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-79fb5cbbfb-46s2s" event={"ID":"90332f2f-d386-4c90-8e67-a2c6bf57dffc","Type":"ContainerDied","Data":"e2d733e1415db393d7211b868d1f64aea9844714aaabd132b1a36c96b5aabe85"} Mar 16 16:14:46 crc kubenswrapper[5120]: I0316 16:14:46.221865 5120 scope.go:117] "RemoveContainer" containerID="0ccbe0f01e81859389bce7f3706988a037cb7c1f28016d05b59ad83e847c18de" Mar 16 16:14:46 crc kubenswrapper[5120]: I0316 16:14:46.222080 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-79fb5cbbfb-46s2s" Mar 16 16:14:46 crc kubenswrapper[5120]: I0316 16:14:46.235104 5120 generic.go:358] "Generic (PLEG): container finished" podID="e9b63ab0-f32f-4118-9e63-b82550c1d518" containerID="9e2cd9ee31b8503ea9d68b96980216bb40b609ac1140ff9f0bdfcdaab38bfe7b" exitCode=0 Mar 16 16:14:46 crc kubenswrapper[5120]: I0316 16:14:46.235158 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-7c468d546f-vjd49" event={"ID":"e9b63ab0-f32f-4118-9e63-b82550c1d518","Type":"ContainerDied","Data":"9e2cd9ee31b8503ea9d68b96980216bb40b609ac1140ff9f0bdfcdaab38bfe7b"} Mar 16 16:14:46 crc kubenswrapper[5120]: I0316 16:14:46.244538 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="4258219e-8b43-4c46-b1bb-ce0eb1a07f29" containerName="cinder-scheduler" containerID="cri-o://77cd51631659630d74de4d75b68aafad2ea96cf703243aaee78708f64c6c2d23" gracePeriod=30 Mar 16 16:14:46 crc kubenswrapper[5120]: I0316 16:14:46.245345 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-d8b74df76-z7648" event={"ID":"9698823e-0af0-4477-b47a-a388c6264dda","Type":"ContainerStarted","Data":"5346c7728f32b0dc09b52da8b4cb5097e3f94eb1c9956ddf64dfa7f4fe5c9f0b"} Mar 16 16:14:46 crc kubenswrapper[5120]: I0316 16:14:46.245374 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-d8b74df76-z7648" event={"ID":"9698823e-0af0-4477-b47a-a388c6264dda","Type":"ContainerStarted","Data":"51ef4c7e3e0dc3d7b67115fda2c5e6d516da517af01fe5c37d48fabfd8112d2b"} Mar 16 16:14:46 crc kubenswrapper[5120]: I0316 16:14:46.245385 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/neutron-d8b74df76-z7648" Mar 16 16:14:46 crc kubenswrapper[5120]: I0316 16:14:46.245924 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="4258219e-8b43-4c46-b1bb-ce0eb1a07f29" containerName="probe" containerID="cri-o://a59645931060756ef46365709024343642865406e43ee32e4fa4013b848ee1c0" gracePeriod=30 Mar 16 16:14:46 crc kubenswrapper[5120]: I0316 16:14:46.264905 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-79fb5cbbfb-46s2s"] Mar 16 16:14:46 crc kubenswrapper[5120]: I0316 16:14:46.273846 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-api-79fb5cbbfb-46s2s"] Mar 16 16:14:46 crc kubenswrapper[5120]: I0316 16:14:46.274566 5120 scope.go:117] "RemoveContainer" containerID="2c1f65aa1fcfacbe35286250488fa1a15a9b23f37c4a5334293b705dbd5e516e" Mar 16 16:14:46 crc kubenswrapper[5120]: I0316 16:14:46.298736 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-d8b74df76-z7648" podStartSLOduration=2.298718753 podStartE2EDuration="2.298718753s" podCreationTimestamp="2026-03-16 16:14:44 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:14:46.298171478 +0000 UTC m=+2588.452103145" watchObservedRunningTime="2026-03-16 16:14:46.298718753 +0000 UTC m=+2588.452650410" Mar 16 16:14:46 crc kubenswrapper[5120]: I0316 16:14:46.304342 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-7c468d546f-vjd49" Mar 16 16:14:46 crc kubenswrapper[5120]: I0316 16:14:46.307278 5120 scope.go:117] "RemoveContainer" containerID="0ccbe0f01e81859389bce7f3706988a037cb7c1f28016d05b59ad83e847c18de" Mar 16 16:14:46 crc kubenswrapper[5120]: E0316 16:14:46.307853 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0ccbe0f01e81859389bce7f3706988a037cb7c1f28016d05b59ad83e847c18de\": container with ID starting with 0ccbe0f01e81859389bce7f3706988a037cb7c1f28016d05b59ad83e847c18de not found: ID does not exist" containerID="0ccbe0f01e81859389bce7f3706988a037cb7c1f28016d05b59ad83e847c18de" Mar 16 16:14:46 crc kubenswrapper[5120]: I0316 16:14:46.307892 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ccbe0f01e81859389bce7f3706988a037cb7c1f28016d05b59ad83e847c18de"} err="failed to get container status \"0ccbe0f01e81859389bce7f3706988a037cb7c1f28016d05b59ad83e847c18de\": rpc error: code = NotFound desc = could not find container \"0ccbe0f01e81859389bce7f3706988a037cb7c1f28016d05b59ad83e847c18de\": container with ID starting with 0ccbe0f01e81859389bce7f3706988a037cb7c1f28016d05b59ad83e847c18de not found: ID does not exist" Mar 16 16:14:46 crc kubenswrapper[5120]: I0316 16:14:46.307912 5120 scope.go:117] "RemoveContainer" containerID="2c1f65aa1fcfacbe35286250488fa1a15a9b23f37c4a5334293b705dbd5e516e" Mar 16 16:14:46 crc kubenswrapper[5120]: E0316 16:14:46.308323 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c1f65aa1fcfacbe35286250488fa1a15a9b23f37c4a5334293b705dbd5e516e\": container with ID starting with 2c1f65aa1fcfacbe35286250488fa1a15a9b23f37c4a5334293b705dbd5e516e not found: ID does not exist" containerID="2c1f65aa1fcfacbe35286250488fa1a15a9b23f37c4a5334293b705dbd5e516e" Mar 16 16:14:46 crc kubenswrapper[5120]: I0316 16:14:46.308424 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c1f65aa1fcfacbe35286250488fa1a15a9b23f37c4a5334293b705dbd5e516e"} err="failed to get container status \"2c1f65aa1fcfacbe35286250488fa1a15a9b23f37c4a5334293b705dbd5e516e\": rpc error: code = NotFound desc = could not find container \"2c1f65aa1fcfacbe35286250488fa1a15a9b23f37c4a5334293b705dbd5e516e\": container with ID starting with 2c1f65aa1fcfacbe35286250488fa1a15a9b23f37c4a5334293b705dbd5e516e not found: ID does not exist" Mar 16 16:14:46 crc kubenswrapper[5120]: I0316 16:14:46.345392 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e9b63ab0-f32f-4118-9e63-b82550c1d518-logs\") pod \"e9b63ab0-f32f-4118-9e63-b82550c1d518\" (UID: \"e9b63ab0-f32f-4118-9e63-b82550c1d518\") " Mar 16 16:14:46 crc kubenswrapper[5120]: I0316 16:14:46.345574 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e9b63ab0-f32f-4118-9e63-b82550c1d518-config-data\") pod \"e9b63ab0-f32f-4118-9e63-b82550c1d518\" (UID: \"e9b63ab0-f32f-4118-9e63-b82550c1d518\") " Mar 16 16:14:46 crc kubenswrapper[5120]: I0316 16:14:46.345641 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/e9b63ab0-f32f-4118-9e63-b82550c1d518-config-data-custom\") pod \"e9b63ab0-f32f-4118-9e63-b82550c1d518\" (UID: \"e9b63ab0-f32f-4118-9e63-b82550c1d518\") " Mar 16 16:14:46 crc kubenswrapper[5120]: I0316 16:14:46.345771 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e9b63ab0-f32f-4118-9e63-b82550c1d518-combined-ca-bundle\") pod \"e9b63ab0-f32f-4118-9e63-b82550c1d518\" (UID: \"e9b63ab0-f32f-4118-9e63-b82550c1d518\") " Mar 16 16:14:46 crc kubenswrapper[5120]: I0316 16:14:46.345977 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qrvpn\" (UniqueName: \"kubernetes.io/projected/e9b63ab0-f32f-4118-9e63-b82550c1d518-kube-api-access-qrvpn\") pod \"e9b63ab0-f32f-4118-9e63-b82550c1d518\" (UID: \"e9b63ab0-f32f-4118-9e63-b82550c1d518\") " Mar 16 16:14:46 crc kubenswrapper[5120]: I0316 16:14:46.346042 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9b63ab0-f32f-4118-9e63-b82550c1d518-logs" (OuterVolumeSpecName: "logs") pod "e9b63ab0-f32f-4118-9e63-b82550c1d518" (UID: "e9b63ab0-f32f-4118-9e63-b82550c1d518"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:14:46 crc kubenswrapper[5120]: I0316 16:14:46.346776 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e9b63ab0-f32f-4118-9e63-b82550c1d518-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:14:46 crc kubenswrapper[5120]: I0316 16:14:46.352965 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9b63ab0-f32f-4118-9e63-b82550c1d518-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "e9b63ab0-f32f-4118-9e63-b82550c1d518" (UID: "e9b63ab0-f32f-4118-9e63-b82550c1d518"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:14:46 crc kubenswrapper[5120]: I0316 16:14:46.356545 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9b63ab0-f32f-4118-9e63-b82550c1d518-kube-api-access-qrvpn" (OuterVolumeSpecName: "kube-api-access-qrvpn") pod "e9b63ab0-f32f-4118-9e63-b82550c1d518" (UID: "e9b63ab0-f32f-4118-9e63-b82550c1d518"). InnerVolumeSpecName "kube-api-access-qrvpn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:14:46 crc kubenswrapper[5120]: I0316 16:14:46.385884 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9b63ab0-f32f-4118-9e63-b82550c1d518-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e9b63ab0-f32f-4118-9e63-b82550c1d518" (UID: "e9b63ab0-f32f-4118-9e63-b82550c1d518"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:14:46 crc kubenswrapper[5120]: I0316 16:14:46.420876 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9b63ab0-f32f-4118-9e63-b82550c1d518-config-data" (OuterVolumeSpecName: "config-data") pod "e9b63ab0-f32f-4118-9e63-b82550c1d518" (UID: "e9b63ab0-f32f-4118-9e63-b82550c1d518"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:14:46 crc kubenswrapper[5120]: I0316 16:14:46.449034 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qrvpn\" (UniqueName: \"kubernetes.io/projected/e9b63ab0-f32f-4118-9e63-b82550c1d518-kube-api-access-qrvpn\") on node \"crc\" DevicePath \"\"" Mar 16 16:14:46 crc kubenswrapper[5120]: I0316 16:14:46.449074 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e9b63ab0-f32f-4118-9e63-b82550c1d518-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:14:46 crc kubenswrapper[5120]: I0316 16:14:46.449086 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/e9b63ab0-f32f-4118-9e63-b82550c1d518-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:14:46 crc kubenswrapper[5120]: I0316 16:14:46.449097 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e9b63ab0-f32f-4118-9e63-b82550c1d518-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:14:46 crc kubenswrapper[5120]: I0316 16:14:46.674665 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="90332f2f-d386-4c90-8e67-a2c6bf57dffc" path="/var/lib/kubelet/pods/90332f2f-d386-4c90-8e67-a2c6bf57dffc/volumes" Mar 16 16:14:47 crc kubenswrapper[5120]: I0316 16:14:47.262033 5120 generic.go:358] "Generic (PLEG): container finished" podID="4258219e-8b43-4c46-b1bb-ce0eb1a07f29" containerID="a59645931060756ef46365709024343642865406e43ee32e4fa4013b848ee1c0" exitCode=0 Mar 16 16:14:47 crc kubenswrapper[5120]: I0316 16:14:47.262179 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"4258219e-8b43-4c46-b1bb-ce0eb1a07f29","Type":"ContainerDied","Data":"a59645931060756ef46365709024343642865406e43ee32e4fa4013b848ee1c0"} Mar 16 16:14:47 crc kubenswrapper[5120]: I0316 16:14:47.272171 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-7c468d546f-vjd49" event={"ID":"e9b63ab0-f32f-4118-9e63-b82550c1d518","Type":"ContainerDied","Data":"9e478a7bed00dac4ab7ca59f44ce85de419ff302f8c1672b34b9e449528725ed"} Mar 16 16:14:47 crc kubenswrapper[5120]: I0316 16:14:47.272253 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-7c468d546f-vjd49" Mar 16 16:14:47 crc kubenswrapper[5120]: I0316 16:14:47.272272 5120 scope.go:117] "RemoveContainer" containerID="9e2cd9ee31b8503ea9d68b96980216bb40b609ac1140ff9f0bdfcdaab38bfe7b" Mar 16 16:14:47 crc kubenswrapper[5120]: I0316 16:14:47.279485 5120 generic.go:358] "Generic (PLEG): container finished" podID="c2631af3-9152-470b-8aa8-2395a88ec1ab" containerID="ec833fb04a8faa4bbb0cc46a41c1d27652f76a3891407e6aa05c62a253cacf8e" exitCode=0 Mar 16 16:14:47 crc kubenswrapper[5120]: I0316 16:14:47.279564 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-6c79fccb98-ccmbb" event={"ID":"c2631af3-9152-470b-8aa8-2395a88ec1ab","Type":"ContainerDied","Data":"ec833fb04a8faa4bbb0cc46a41c1d27652f76a3891407e6aa05c62a253cacf8e"} Mar 16 16:14:47 crc kubenswrapper[5120]: I0316 16:14:47.316906 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-7c468d546f-vjd49"] Mar 16 16:14:47 crc kubenswrapper[5120]: I0316 16:14:47.350492 5120 scope.go:117] "RemoveContainer" containerID="abb64c72c7b8685ede4a429cbedcbec43a64d7a4ac6a560c46eab15bc712b901" Mar 16 16:14:47 crc kubenswrapper[5120]: I0316 16:14:47.365701 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-worker-7c468d546f-vjd49"] Mar 16 16:14:47 crc kubenswrapper[5120]: I0316 16:14:47.574302 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-6c79fccb98-ccmbb" Mar 16 16:14:47 crc kubenswrapper[5120]: I0316 16:14:47.684203 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c2631af3-9152-470b-8aa8-2395a88ec1ab-combined-ca-bundle\") pod \"c2631af3-9152-470b-8aa8-2395a88ec1ab\" (UID: \"c2631af3-9152-470b-8aa8-2395a88ec1ab\") " Mar 16 16:14:47 crc kubenswrapper[5120]: I0316 16:14:47.684324 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c2631af3-9152-470b-8aa8-2395a88ec1ab-config-data\") pod \"c2631af3-9152-470b-8aa8-2395a88ec1ab\" (UID: \"c2631af3-9152-470b-8aa8-2395a88ec1ab\") " Mar 16 16:14:47 crc kubenswrapper[5120]: I0316 16:14:47.684463 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c2631af3-9152-470b-8aa8-2395a88ec1ab-logs\") pod \"c2631af3-9152-470b-8aa8-2395a88ec1ab\" (UID: \"c2631af3-9152-470b-8aa8-2395a88ec1ab\") " Mar 16 16:14:47 crc kubenswrapper[5120]: I0316 16:14:47.684597 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m8c8k\" (UniqueName: \"kubernetes.io/projected/c2631af3-9152-470b-8aa8-2395a88ec1ab-kube-api-access-m8c8k\") pod \"c2631af3-9152-470b-8aa8-2395a88ec1ab\" (UID: \"c2631af3-9152-470b-8aa8-2395a88ec1ab\") " Mar 16 16:14:47 crc kubenswrapper[5120]: I0316 16:14:47.684716 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/c2631af3-9152-470b-8aa8-2395a88ec1ab-config-data-custom\") pod \"c2631af3-9152-470b-8aa8-2395a88ec1ab\" (UID: \"c2631af3-9152-470b-8aa8-2395a88ec1ab\") " Mar 16 16:14:47 crc kubenswrapper[5120]: I0316 16:14:47.685062 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2631af3-9152-470b-8aa8-2395a88ec1ab-logs" (OuterVolumeSpecName: "logs") pod "c2631af3-9152-470b-8aa8-2395a88ec1ab" (UID: "c2631af3-9152-470b-8aa8-2395a88ec1ab"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:14:47 crc kubenswrapper[5120]: I0316 16:14:47.686081 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c2631af3-9152-470b-8aa8-2395a88ec1ab-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:14:47 crc kubenswrapper[5120]: I0316 16:14:47.693193 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c2631af3-9152-470b-8aa8-2395a88ec1ab-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "c2631af3-9152-470b-8aa8-2395a88ec1ab" (UID: "c2631af3-9152-470b-8aa8-2395a88ec1ab"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:14:47 crc kubenswrapper[5120]: I0316 16:14:47.693354 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2631af3-9152-470b-8aa8-2395a88ec1ab-kube-api-access-m8c8k" (OuterVolumeSpecName: "kube-api-access-m8c8k") pod "c2631af3-9152-470b-8aa8-2395a88ec1ab" (UID: "c2631af3-9152-470b-8aa8-2395a88ec1ab"). InnerVolumeSpecName "kube-api-access-m8c8k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:14:47 crc kubenswrapper[5120]: I0316 16:14:47.716014 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c2631af3-9152-470b-8aa8-2395a88ec1ab-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "c2631af3-9152-470b-8aa8-2395a88ec1ab" (UID: "c2631af3-9152-470b-8aa8-2395a88ec1ab"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:14:47 crc kubenswrapper[5120]: I0316 16:14:47.746675 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c2631af3-9152-470b-8aa8-2395a88ec1ab-config-data" (OuterVolumeSpecName: "config-data") pod "c2631af3-9152-470b-8aa8-2395a88ec1ab" (UID: "c2631af3-9152-470b-8aa8-2395a88ec1ab"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:14:47 crc kubenswrapper[5120]: I0316 16:14:47.788099 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/c2631af3-9152-470b-8aa8-2395a88ec1ab-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:14:47 crc kubenswrapper[5120]: I0316 16:14:47.788142 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c2631af3-9152-470b-8aa8-2395a88ec1ab-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:14:47 crc kubenswrapper[5120]: I0316 16:14:47.788156 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c2631af3-9152-470b-8aa8-2395a88ec1ab-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:14:47 crc kubenswrapper[5120]: I0316 16:14:47.788168 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m8c8k\" (UniqueName: \"kubernetes.io/projected/c2631af3-9152-470b-8aa8-2395a88ec1ab-kube-api-access-m8c8k\") on node \"crc\" DevicePath \"\"" Mar 16 16:14:48 crc kubenswrapper[5120]: I0316 16:14:48.294507 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-6c79fccb98-ccmbb" event={"ID":"c2631af3-9152-470b-8aa8-2395a88ec1ab","Type":"ContainerDied","Data":"034ceb76c311b058f508984947b5f80e261bb10e9690b5eb3b809201bfd4b667"} Mar 16 16:14:48 crc kubenswrapper[5120]: I0316 16:14:48.294568 5120 scope.go:117] "RemoveContainer" containerID="ec833fb04a8faa4bbb0cc46a41c1d27652f76a3891407e6aa05c62a253cacf8e" Mar 16 16:14:48 crc kubenswrapper[5120]: I0316 16:14:48.294705 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-6c79fccb98-ccmbb" Mar 16 16:14:48 crc kubenswrapper[5120]: I0316 16:14:48.356470 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-6c79fccb98-ccmbb"] Mar 16 16:14:48 crc kubenswrapper[5120]: I0316 16:14:48.357672 5120 scope.go:117] "RemoveContainer" containerID="df6901c9ecd72698003b27fbc3b639dfb0dc3eccef59ce092d3ca1237db632cf" Mar 16 16:14:48 crc kubenswrapper[5120]: I0316 16:14:48.366520 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-6c79fccb98-ccmbb"] Mar 16 16:14:48 crc kubenswrapper[5120]: I0316 16:14:48.678190 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c2631af3-9152-470b-8aa8-2395a88ec1ab" path="/var/lib/kubelet/pods/c2631af3-9152-470b-8aa8-2395a88ec1ab/volumes" Mar 16 16:14:48 crc kubenswrapper[5120]: I0316 16:14:48.678771 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e9b63ab0-f32f-4118-9e63-b82550c1d518" path="/var/lib/kubelet/pods/e9b63ab0-f32f-4118-9e63-b82550c1d518/volumes" Mar 16 16:14:48 crc kubenswrapper[5120]: I0316 16:14:48.866493 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:14:48 crc kubenswrapper[5120]: I0316 16:14:48.911449 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4258219e-8b43-4c46-b1bb-ce0eb1a07f29-config-data\") pod \"4258219e-8b43-4c46-b1bb-ce0eb1a07f29\" (UID: \"4258219e-8b43-4c46-b1bb-ce0eb1a07f29\") " Mar 16 16:14:48 crc kubenswrapper[5120]: I0316 16:14:48.911569 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/4258219e-8b43-4c46-b1bb-ce0eb1a07f29-etc-machine-id\") pod \"4258219e-8b43-4c46-b1bb-ce0eb1a07f29\" (UID: \"4258219e-8b43-4c46-b1bb-ce0eb1a07f29\") " Mar 16 16:14:48 crc kubenswrapper[5120]: I0316 16:14:48.911663 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4258219e-8b43-4c46-b1bb-ce0eb1a07f29-scripts\") pod \"4258219e-8b43-4c46-b1bb-ce0eb1a07f29\" (UID: \"4258219e-8b43-4c46-b1bb-ce0eb1a07f29\") " Mar 16 16:14:48 crc kubenswrapper[5120]: I0316 16:14:48.911889 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/4258219e-8b43-4c46-b1bb-ce0eb1a07f29-config-data-custom\") pod \"4258219e-8b43-4c46-b1bb-ce0eb1a07f29\" (UID: \"4258219e-8b43-4c46-b1bb-ce0eb1a07f29\") " Mar 16 16:14:48 crc kubenswrapper[5120]: I0316 16:14:48.912046 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/4258219e-8b43-4c46-b1bb-ce0eb1a07f29-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "4258219e-8b43-4c46-b1bb-ce0eb1a07f29" (UID: "4258219e-8b43-4c46-b1bb-ce0eb1a07f29"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 16:14:48 crc kubenswrapper[5120]: I0316 16:14:48.912846 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rkdf8\" (UniqueName: \"kubernetes.io/projected/4258219e-8b43-4c46-b1bb-ce0eb1a07f29-kube-api-access-rkdf8\") pod \"4258219e-8b43-4c46-b1bb-ce0eb1a07f29\" (UID: \"4258219e-8b43-4c46-b1bb-ce0eb1a07f29\") " Mar 16 16:14:48 crc kubenswrapper[5120]: I0316 16:14:48.912906 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4258219e-8b43-4c46-b1bb-ce0eb1a07f29-combined-ca-bundle\") pod \"4258219e-8b43-4c46-b1bb-ce0eb1a07f29\" (UID: \"4258219e-8b43-4c46-b1bb-ce0eb1a07f29\") " Mar 16 16:14:48 crc kubenswrapper[5120]: I0316 16:14:48.913591 5120 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/4258219e-8b43-4c46-b1bb-ce0eb1a07f29-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 16:14:48 crc kubenswrapper[5120]: I0316 16:14:48.918019 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4258219e-8b43-4c46-b1bb-ce0eb1a07f29-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "4258219e-8b43-4c46-b1bb-ce0eb1a07f29" (UID: "4258219e-8b43-4c46-b1bb-ce0eb1a07f29"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:14:48 crc kubenswrapper[5120]: I0316 16:14:48.919401 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4258219e-8b43-4c46-b1bb-ce0eb1a07f29-kube-api-access-rkdf8" (OuterVolumeSpecName: "kube-api-access-rkdf8") pod "4258219e-8b43-4c46-b1bb-ce0eb1a07f29" (UID: "4258219e-8b43-4c46-b1bb-ce0eb1a07f29"). InnerVolumeSpecName "kube-api-access-rkdf8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:14:48 crc kubenswrapper[5120]: I0316 16:14:48.933922 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4258219e-8b43-4c46-b1bb-ce0eb1a07f29-scripts" (OuterVolumeSpecName: "scripts") pod "4258219e-8b43-4c46-b1bb-ce0eb1a07f29" (UID: "4258219e-8b43-4c46-b1bb-ce0eb1a07f29"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:14:48 crc kubenswrapper[5120]: I0316 16:14:48.972591 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4258219e-8b43-4c46-b1bb-ce0eb1a07f29-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "4258219e-8b43-4c46-b1bb-ce0eb1a07f29" (UID: "4258219e-8b43-4c46-b1bb-ce0eb1a07f29"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:14:49 crc kubenswrapper[5120]: I0316 16:14:49.016315 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4258219e-8b43-4c46-b1bb-ce0eb1a07f29-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:14:49 crc kubenswrapper[5120]: I0316 16:14:49.016352 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/4258219e-8b43-4c46-b1bb-ce0eb1a07f29-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:14:49 crc kubenswrapper[5120]: I0316 16:14:49.016365 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rkdf8\" (UniqueName: \"kubernetes.io/projected/4258219e-8b43-4c46-b1bb-ce0eb1a07f29-kube-api-access-rkdf8\") on node \"crc\" DevicePath \"\"" Mar 16 16:14:49 crc kubenswrapper[5120]: I0316 16:14:49.016376 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4258219e-8b43-4c46-b1bb-ce0eb1a07f29-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:14:49 crc kubenswrapper[5120]: I0316 16:14:49.050360 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4258219e-8b43-4c46-b1bb-ce0eb1a07f29-config-data" (OuterVolumeSpecName: "config-data") pod "4258219e-8b43-4c46-b1bb-ce0eb1a07f29" (UID: "4258219e-8b43-4c46-b1bb-ce0eb1a07f29"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:14:49 crc kubenswrapper[5120]: I0316 16:14:49.118086 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4258219e-8b43-4c46-b1bb-ce0eb1a07f29-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:14:49 crc kubenswrapper[5120]: I0316 16:14:49.305110 5120 generic.go:358] "Generic (PLEG): container finished" podID="4258219e-8b43-4c46-b1bb-ce0eb1a07f29" containerID="77cd51631659630d74de4d75b68aafad2ea96cf703243aaee78708f64c6c2d23" exitCode=0 Mar 16 16:14:49 crc kubenswrapper[5120]: I0316 16:14:49.305366 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"4258219e-8b43-4c46-b1bb-ce0eb1a07f29","Type":"ContainerDied","Data":"77cd51631659630d74de4d75b68aafad2ea96cf703243aaee78708f64c6c2d23"} Mar 16 16:14:49 crc kubenswrapper[5120]: I0316 16:14:49.305401 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"4258219e-8b43-4c46-b1bb-ce0eb1a07f29","Type":"ContainerDied","Data":"d05228cf3321032dbff28f20b61f9a13b2838d714b8f4a79bdf2abae8bdef1c6"} Mar 16 16:14:49 crc kubenswrapper[5120]: I0316 16:14:49.305419 5120 scope.go:117] "RemoveContainer" containerID="a59645931060756ef46365709024343642865406e43ee32e4fa4013b848ee1c0" Mar 16 16:14:49 crc kubenswrapper[5120]: I0316 16:14:49.305563 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:14:49 crc kubenswrapper[5120]: I0316 16:14:49.335094 5120 scope.go:117] "RemoveContainer" containerID="77cd51631659630d74de4d75b68aafad2ea96cf703243aaee78708f64c6c2d23" Mar 16 16:14:49 crc kubenswrapper[5120]: I0316 16:14:49.345967 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:14:49 crc kubenswrapper[5120]: I0316 16:14:49.353308 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:14:49 crc kubenswrapper[5120]: I0316 16:14:49.366633 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:14:49 crc kubenswrapper[5120]: I0316 16:14:49.367896 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90332f2f-d386-4c90-8e67-a2c6bf57dffc" containerName="barbican-api" Mar 16 16:14:49 crc kubenswrapper[5120]: I0316 16:14:49.367919 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="90332f2f-d386-4c90-8e67-a2c6bf57dffc" containerName="barbican-api" Mar 16 16:14:49 crc kubenswrapper[5120]: I0316 16:14:49.367950 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9b63ab0-f32f-4118-9e63-b82550c1d518" containerName="barbican-worker" Mar 16 16:14:49 crc kubenswrapper[5120]: I0316 16:14:49.367961 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9b63ab0-f32f-4118-9e63-b82550c1d518" containerName="barbican-worker" Mar 16 16:14:49 crc kubenswrapper[5120]: I0316 16:14:49.367978 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2631af3-9152-470b-8aa8-2395a88ec1ab" containerName="barbican-keystone-listener" Mar 16 16:14:49 crc kubenswrapper[5120]: I0316 16:14:49.367986 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2631af3-9152-470b-8aa8-2395a88ec1ab" containerName="barbican-keystone-listener" Mar 16 16:14:49 crc kubenswrapper[5120]: I0316 16:14:49.368008 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9b63ab0-f32f-4118-9e63-b82550c1d518" containerName="barbican-worker-log" Mar 16 16:14:49 crc kubenswrapper[5120]: I0316 16:14:49.368015 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9b63ab0-f32f-4118-9e63-b82550c1d518" containerName="barbican-worker-log" Mar 16 16:14:49 crc kubenswrapper[5120]: I0316 16:14:49.368032 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2631af3-9152-470b-8aa8-2395a88ec1ab" containerName="barbican-keystone-listener-log" Mar 16 16:14:49 crc kubenswrapper[5120]: I0316 16:14:49.368041 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2631af3-9152-470b-8aa8-2395a88ec1ab" containerName="barbican-keystone-listener-log" Mar 16 16:14:49 crc kubenswrapper[5120]: I0316 16:14:49.368064 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90332f2f-d386-4c90-8e67-a2c6bf57dffc" containerName="barbican-api-log" Mar 16 16:14:49 crc kubenswrapper[5120]: I0316 16:14:49.368071 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="90332f2f-d386-4c90-8e67-a2c6bf57dffc" containerName="barbican-api-log" Mar 16 16:14:49 crc kubenswrapper[5120]: I0316 16:14:49.368086 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4258219e-8b43-4c46-b1bb-ce0eb1a07f29" containerName="cinder-scheduler" Mar 16 16:14:49 crc kubenswrapper[5120]: I0316 16:14:49.368092 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="4258219e-8b43-4c46-b1bb-ce0eb1a07f29" containerName="cinder-scheduler" Mar 16 16:14:49 crc kubenswrapper[5120]: I0316 16:14:49.368104 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4258219e-8b43-4c46-b1bb-ce0eb1a07f29" containerName="probe" Mar 16 16:14:49 crc kubenswrapper[5120]: I0316 16:14:49.368111 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="4258219e-8b43-4c46-b1bb-ce0eb1a07f29" containerName="probe" Mar 16 16:14:49 crc kubenswrapper[5120]: I0316 16:14:49.368309 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e9b63ab0-f32f-4118-9e63-b82550c1d518" containerName="barbican-worker-log" Mar 16 16:14:49 crc kubenswrapper[5120]: I0316 16:14:49.368322 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="90332f2f-d386-4c90-8e67-a2c6bf57dffc" containerName="barbican-api-log" Mar 16 16:14:49 crc kubenswrapper[5120]: I0316 16:14:49.368334 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e9b63ab0-f32f-4118-9e63-b82550c1d518" containerName="barbican-worker" Mar 16 16:14:49 crc kubenswrapper[5120]: I0316 16:14:49.368353 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c2631af3-9152-470b-8aa8-2395a88ec1ab" containerName="barbican-keystone-listener" Mar 16 16:14:49 crc kubenswrapper[5120]: I0316 16:14:49.368366 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="90332f2f-d386-4c90-8e67-a2c6bf57dffc" containerName="barbican-api" Mar 16 16:14:49 crc kubenswrapper[5120]: I0316 16:14:49.368380 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="4258219e-8b43-4c46-b1bb-ce0eb1a07f29" containerName="cinder-scheduler" Mar 16 16:14:49 crc kubenswrapper[5120]: I0316 16:14:49.368397 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c2631af3-9152-470b-8aa8-2395a88ec1ab" containerName="barbican-keystone-listener-log" Mar 16 16:14:49 crc kubenswrapper[5120]: I0316 16:14:49.368409 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="4258219e-8b43-4c46-b1bb-ce0eb1a07f29" containerName="probe" Mar 16 16:14:49 crc kubenswrapper[5120]: I0316 16:14:49.375627 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:14:49 crc kubenswrapper[5120]: I0316 16:14:49.379305 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-scheduler-config-data\"" Mar 16 16:14:49 crc kubenswrapper[5120]: I0316 16:14:49.387711 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:14:49 crc kubenswrapper[5120]: I0316 16:14:49.408122 5120 scope.go:117] "RemoveContainer" containerID="a59645931060756ef46365709024343642865406e43ee32e4fa4013b848ee1c0" Mar 16 16:14:49 crc kubenswrapper[5120]: E0316 16:14:49.409169 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a59645931060756ef46365709024343642865406e43ee32e4fa4013b848ee1c0\": container with ID starting with a59645931060756ef46365709024343642865406e43ee32e4fa4013b848ee1c0 not found: ID does not exist" containerID="a59645931060756ef46365709024343642865406e43ee32e4fa4013b848ee1c0" Mar 16 16:14:49 crc kubenswrapper[5120]: I0316 16:14:49.409203 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a59645931060756ef46365709024343642865406e43ee32e4fa4013b848ee1c0"} err="failed to get container status \"a59645931060756ef46365709024343642865406e43ee32e4fa4013b848ee1c0\": rpc error: code = NotFound desc = could not find container \"a59645931060756ef46365709024343642865406e43ee32e4fa4013b848ee1c0\": container with ID starting with a59645931060756ef46365709024343642865406e43ee32e4fa4013b848ee1c0 not found: ID does not exist" Mar 16 16:14:49 crc kubenswrapper[5120]: I0316 16:14:49.409223 5120 scope.go:117] "RemoveContainer" containerID="77cd51631659630d74de4d75b68aafad2ea96cf703243aaee78708f64c6c2d23" Mar 16 16:14:49 crc kubenswrapper[5120]: E0316 16:14:49.409571 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"77cd51631659630d74de4d75b68aafad2ea96cf703243aaee78708f64c6c2d23\": container with ID starting with 77cd51631659630d74de4d75b68aafad2ea96cf703243aaee78708f64c6c2d23 not found: ID does not exist" containerID="77cd51631659630d74de4d75b68aafad2ea96cf703243aaee78708f64c6c2d23" Mar 16 16:14:49 crc kubenswrapper[5120]: I0316 16:14:49.409589 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77cd51631659630d74de4d75b68aafad2ea96cf703243aaee78708f64c6c2d23"} err="failed to get container status \"77cd51631659630d74de4d75b68aafad2ea96cf703243aaee78708f64c6c2d23\": rpc error: code = NotFound desc = could not find container \"77cd51631659630d74de4d75b68aafad2ea96cf703243aaee78708f64c6c2d23\": container with ID starting with 77cd51631659630d74de4d75b68aafad2ea96cf703243aaee78708f64c6c2d23 not found: ID does not exist" Mar 16 16:14:49 crc kubenswrapper[5120]: I0316 16:14:49.528543 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5fl8\" (UniqueName: \"kubernetes.io/projected/1c354659-a22a-4fa3-8747-75b7241aea49-kube-api-access-r5fl8\") pod \"cinder-scheduler-0\" (UID: \"1c354659-a22a-4fa3-8747-75b7241aea49\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:14:49 crc kubenswrapper[5120]: I0316 16:14:49.528624 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1c354659-a22a-4fa3-8747-75b7241aea49-config-data\") pod \"cinder-scheduler-0\" (UID: \"1c354659-a22a-4fa3-8747-75b7241aea49\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:14:49 crc kubenswrapper[5120]: I0316 16:14:49.529047 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/1c354659-a22a-4fa3-8747-75b7241aea49-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"1c354659-a22a-4fa3-8747-75b7241aea49\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:14:49 crc kubenswrapper[5120]: I0316 16:14:49.529202 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1c354659-a22a-4fa3-8747-75b7241aea49-scripts\") pod \"cinder-scheduler-0\" (UID: \"1c354659-a22a-4fa3-8747-75b7241aea49\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:14:49 crc kubenswrapper[5120]: I0316 16:14:49.529307 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/1c354659-a22a-4fa3-8747-75b7241aea49-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"1c354659-a22a-4fa3-8747-75b7241aea49\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:14:49 crc kubenswrapper[5120]: I0316 16:14:49.529534 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1c354659-a22a-4fa3-8747-75b7241aea49-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"1c354659-a22a-4fa3-8747-75b7241aea49\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:14:49 crc kubenswrapper[5120]: I0316 16:14:49.631251 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r5fl8\" (UniqueName: \"kubernetes.io/projected/1c354659-a22a-4fa3-8747-75b7241aea49-kube-api-access-r5fl8\") pod \"cinder-scheduler-0\" (UID: \"1c354659-a22a-4fa3-8747-75b7241aea49\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:14:49 crc kubenswrapper[5120]: I0316 16:14:49.631588 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1c354659-a22a-4fa3-8747-75b7241aea49-config-data\") pod \"cinder-scheduler-0\" (UID: \"1c354659-a22a-4fa3-8747-75b7241aea49\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:14:49 crc kubenswrapper[5120]: I0316 16:14:49.631692 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/1c354659-a22a-4fa3-8747-75b7241aea49-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"1c354659-a22a-4fa3-8747-75b7241aea49\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:14:49 crc kubenswrapper[5120]: I0316 16:14:49.631784 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1c354659-a22a-4fa3-8747-75b7241aea49-scripts\") pod \"cinder-scheduler-0\" (UID: \"1c354659-a22a-4fa3-8747-75b7241aea49\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:14:49 crc kubenswrapper[5120]: I0316 16:14:49.631842 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/1c354659-a22a-4fa3-8747-75b7241aea49-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"1c354659-a22a-4fa3-8747-75b7241aea49\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:14:49 crc kubenswrapper[5120]: I0316 16:14:49.631917 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1c354659-a22a-4fa3-8747-75b7241aea49-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"1c354659-a22a-4fa3-8747-75b7241aea49\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:14:49 crc kubenswrapper[5120]: I0316 16:14:49.632794 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/1c354659-a22a-4fa3-8747-75b7241aea49-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"1c354659-a22a-4fa3-8747-75b7241aea49\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:14:49 crc kubenswrapper[5120]: I0316 16:14:49.637575 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1c354659-a22a-4fa3-8747-75b7241aea49-scripts\") pod \"cinder-scheduler-0\" (UID: \"1c354659-a22a-4fa3-8747-75b7241aea49\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:14:49 crc kubenswrapper[5120]: I0316 16:14:49.637934 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/1c354659-a22a-4fa3-8747-75b7241aea49-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"1c354659-a22a-4fa3-8747-75b7241aea49\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:14:49 crc kubenswrapper[5120]: I0316 16:14:49.639431 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1c354659-a22a-4fa3-8747-75b7241aea49-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"1c354659-a22a-4fa3-8747-75b7241aea49\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:14:49 crc kubenswrapper[5120]: I0316 16:14:49.640210 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1c354659-a22a-4fa3-8747-75b7241aea49-config-data\") pod \"cinder-scheduler-0\" (UID: \"1c354659-a22a-4fa3-8747-75b7241aea49\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:14:49 crc kubenswrapper[5120]: I0316 16:14:49.648633 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5fl8\" (UniqueName: \"kubernetes.io/projected/1c354659-a22a-4fa3-8747-75b7241aea49-kube-api-access-r5fl8\") pod \"cinder-scheduler-0\" (UID: \"1c354659-a22a-4fa3-8747-75b7241aea49\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:14:49 crc kubenswrapper[5120]: I0316 16:14:49.709686 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:14:50 crc kubenswrapper[5120]: I0316 16:14:50.180281 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:14:50 crc kubenswrapper[5120]: W0316 16:14:50.203454 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1c354659_a22a_4fa3_8747_75b7241aea49.slice/crio-56aadc758dbb1dde99eddcfe80f07a7ca65fd002a6446660bb91ec6f341094b4 WatchSource:0}: Error finding container 56aadc758dbb1dde99eddcfe80f07a7ca65fd002a6446660bb91ec6f341094b4: Status 404 returned error can't find the container with id 56aadc758dbb1dde99eddcfe80f07a7ca65fd002a6446660bb91ec6f341094b4 Mar 16 16:14:50 crc kubenswrapper[5120]: I0316 16:14:50.326426 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"1c354659-a22a-4fa3-8747-75b7241aea49","Type":"ContainerStarted","Data":"56aadc758dbb1dde99eddcfe80f07a7ca65fd002a6446660bb91ec6f341094b4"} Mar 16 16:14:50 crc kubenswrapper[5120]: I0316 16:14:50.584726 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-796f4f9644-59hlg" Mar 16 16:14:50 crc kubenswrapper[5120]: I0316 16:14:50.680418 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4258219e-8b43-4c46-b1bb-ce0eb1a07f29" path="/var/lib/kubelet/pods/4258219e-8b43-4c46-b1bb-ce0eb1a07f29/volumes" Mar 16 16:14:50 crc kubenswrapper[5120]: I0316 16:14:50.686487 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-796f4f9644-59hlg" Mar 16 16:14:50 crc kubenswrapper[5120]: I0316 16:14:50.747873 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-79cb59c45b-x77rt"] Mar 16 16:14:50 crc kubenswrapper[5120]: I0316 16:14:50.752705 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-79cb59c45b-x77rt" podUID="32e01c7b-7af9-4cc6-8f41-d951345e0fe4" containerName="barbican-api-log" containerID="cri-o://5de7ccc55c26ab41ae31a5e2511ce9cecf14323742c5e06312d2456feb2db916" gracePeriod=30 Mar 16 16:14:50 crc kubenswrapper[5120]: I0316 16:14:50.752875 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-79cb59c45b-x77rt" podUID="32e01c7b-7af9-4cc6-8f41-d951345e0fe4" containerName="barbican-api" containerID="cri-o://8fa70322ff2a1414a9f9ac2b6f5afaa348b8bac1dd87c59c0e6fa7c46e449148" gracePeriod=30 Mar 16 16:14:51 crc kubenswrapper[5120]: I0316 16:14:51.357183 5120 generic.go:358] "Generic (PLEG): container finished" podID="32e01c7b-7af9-4cc6-8f41-d951345e0fe4" containerID="5de7ccc55c26ab41ae31a5e2511ce9cecf14323742c5e06312d2456feb2db916" exitCode=143 Mar 16 16:14:51 crc kubenswrapper[5120]: I0316 16:14:51.357227 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-79cb59c45b-x77rt" event={"ID":"32e01c7b-7af9-4cc6-8f41-d951345e0fe4","Type":"ContainerDied","Data":"5de7ccc55c26ab41ae31a5e2511ce9cecf14323742c5e06312d2456feb2db916"} Mar 16 16:14:51 crc kubenswrapper[5120]: I0316 16:14:51.360847 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"1c354659-a22a-4fa3-8747-75b7241aea49","Type":"ContainerStarted","Data":"6b9790a44239640d9456c0bcdc9e4c40280465570805a0b2131ed727167a1767"} Mar 16 16:14:52 crc kubenswrapper[5120]: I0316 16:14:52.372464 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"1c354659-a22a-4fa3-8747-75b7241aea49","Type":"ContainerStarted","Data":"e7d4e3842ff2074c385862c7f0cb2ed29aa14bda35f907a94808d0d9edb150e9"} Mar 16 16:14:52 crc kubenswrapper[5120]: I0316 16:14:52.398168 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-scheduler-0" podStartSLOduration=3.398150438 podStartE2EDuration="3.398150438s" podCreationTimestamp="2026-03-16 16:14:49 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:14:52.392837957 +0000 UTC m=+2594.546769624" watchObservedRunningTime="2026-03-16 16:14:52.398150438 +0000 UTC m=+2594.552082095" Mar 16 16:14:53 crc kubenswrapper[5120]: I0316 16:14:53.112796 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:14:53 crc kubenswrapper[5120]: I0316 16:14:53.924256 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-79cb59c45b-x77rt" podUID="32e01c7b-7af9-4cc6-8f41-d951345e0fe4" containerName="barbican-api-log" probeResult="failure" output="Get \"http://10.217.0.221:9311/healthcheck\": read tcp 10.217.0.2:49982->10.217.0.221:9311: read: connection reset by peer" Mar 16 16:14:54 crc kubenswrapper[5120]: I0316 16:14:54.353846 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-79cb59c45b-x77rt" Mar 16 16:14:54 crc kubenswrapper[5120]: I0316 16:14:54.395423 5120 generic.go:358] "Generic (PLEG): container finished" podID="32e01c7b-7af9-4cc6-8f41-d951345e0fe4" containerID="8fa70322ff2a1414a9f9ac2b6f5afaa348b8bac1dd87c59c0e6fa7c46e449148" exitCode=0 Mar 16 16:14:54 crc kubenswrapper[5120]: I0316 16:14:54.395462 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-79cb59c45b-x77rt" event={"ID":"32e01c7b-7af9-4cc6-8f41-d951345e0fe4","Type":"ContainerDied","Data":"8fa70322ff2a1414a9f9ac2b6f5afaa348b8bac1dd87c59c0e6fa7c46e449148"} Mar 16 16:14:54 crc kubenswrapper[5120]: I0316 16:14:54.395515 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-79cb59c45b-x77rt" Mar 16 16:14:54 crc kubenswrapper[5120]: I0316 16:14:54.395527 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-79cb59c45b-x77rt" event={"ID":"32e01c7b-7af9-4cc6-8f41-d951345e0fe4","Type":"ContainerDied","Data":"4fefb13b39659c2cb40174743c9c95fc209216fe167b0b9aed191aa666592b94"} Mar 16 16:14:54 crc kubenswrapper[5120]: I0316 16:14:54.395551 5120 scope.go:117] "RemoveContainer" containerID="8fa70322ff2a1414a9f9ac2b6f5afaa348b8bac1dd87c59c0e6fa7c46e449148" Mar 16 16:14:54 crc kubenswrapper[5120]: I0316 16:14:54.430705 5120 scope.go:117] "RemoveContainer" containerID="5de7ccc55c26ab41ae31a5e2511ce9cecf14323742c5e06312d2456feb2db916" Mar 16 16:14:54 crc kubenswrapper[5120]: I0316 16:14:54.448208 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/32e01c7b-7af9-4cc6-8f41-d951345e0fe4-logs\") pod \"32e01c7b-7af9-4cc6-8f41-d951345e0fe4\" (UID: \"32e01c7b-7af9-4cc6-8f41-d951345e0fe4\") " Mar 16 16:14:54 crc kubenswrapper[5120]: I0316 16:14:54.448319 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/32e01c7b-7af9-4cc6-8f41-d951345e0fe4-config-data-custom\") pod \"32e01c7b-7af9-4cc6-8f41-d951345e0fe4\" (UID: \"32e01c7b-7af9-4cc6-8f41-d951345e0fe4\") " Mar 16 16:14:54 crc kubenswrapper[5120]: I0316 16:14:54.448373 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/32e01c7b-7af9-4cc6-8f41-d951345e0fe4-combined-ca-bundle\") pod \"32e01c7b-7af9-4cc6-8f41-d951345e0fe4\" (UID: \"32e01c7b-7af9-4cc6-8f41-d951345e0fe4\") " Mar 16 16:14:54 crc kubenswrapper[5120]: I0316 16:14:54.448552 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ghk8w\" (UniqueName: \"kubernetes.io/projected/32e01c7b-7af9-4cc6-8f41-d951345e0fe4-kube-api-access-ghk8w\") pod \"32e01c7b-7af9-4cc6-8f41-d951345e0fe4\" (UID: \"32e01c7b-7af9-4cc6-8f41-d951345e0fe4\") " Mar 16 16:14:54 crc kubenswrapper[5120]: I0316 16:14:54.448835 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/32e01c7b-7af9-4cc6-8f41-d951345e0fe4-config-data\") pod \"32e01c7b-7af9-4cc6-8f41-d951345e0fe4\" (UID: \"32e01c7b-7af9-4cc6-8f41-d951345e0fe4\") " Mar 16 16:14:54 crc kubenswrapper[5120]: I0316 16:14:54.449380 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32e01c7b-7af9-4cc6-8f41-d951345e0fe4-logs" (OuterVolumeSpecName: "logs") pod "32e01c7b-7af9-4cc6-8f41-d951345e0fe4" (UID: "32e01c7b-7af9-4cc6-8f41-d951345e0fe4"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:14:54 crc kubenswrapper[5120]: I0316 16:14:54.450007 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/32e01c7b-7af9-4cc6-8f41-d951345e0fe4-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:14:54 crc kubenswrapper[5120]: I0316 16:14:54.459154 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/32e01c7b-7af9-4cc6-8f41-d951345e0fe4-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "32e01c7b-7af9-4cc6-8f41-d951345e0fe4" (UID: "32e01c7b-7af9-4cc6-8f41-d951345e0fe4"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:14:54 crc kubenswrapper[5120]: I0316 16:14:54.459202 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32e01c7b-7af9-4cc6-8f41-d951345e0fe4-kube-api-access-ghk8w" (OuterVolumeSpecName: "kube-api-access-ghk8w") pod "32e01c7b-7af9-4cc6-8f41-d951345e0fe4" (UID: "32e01c7b-7af9-4cc6-8f41-d951345e0fe4"). InnerVolumeSpecName "kube-api-access-ghk8w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:14:54 crc kubenswrapper[5120]: I0316 16:14:54.460855 5120 scope.go:117] "RemoveContainer" containerID="8fa70322ff2a1414a9f9ac2b6f5afaa348b8bac1dd87c59c0e6fa7c46e449148" Mar 16 16:14:54 crc kubenswrapper[5120]: E0316 16:14:54.461653 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8fa70322ff2a1414a9f9ac2b6f5afaa348b8bac1dd87c59c0e6fa7c46e449148\": container with ID starting with 8fa70322ff2a1414a9f9ac2b6f5afaa348b8bac1dd87c59c0e6fa7c46e449148 not found: ID does not exist" containerID="8fa70322ff2a1414a9f9ac2b6f5afaa348b8bac1dd87c59c0e6fa7c46e449148" Mar 16 16:14:54 crc kubenswrapper[5120]: I0316 16:14:54.461686 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8fa70322ff2a1414a9f9ac2b6f5afaa348b8bac1dd87c59c0e6fa7c46e449148"} err="failed to get container status \"8fa70322ff2a1414a9f9ac2b6f5afaa348b8bac1dd87c59c0e6fa7c46e449148\": rpc error: code = NotFound desc = could not find container \"8fa70322ff2a1414a9f9ac2b6f5afaa348b8bac1dd87c59c0e6fa7c46e449148\": container with ID starting with 8fa70322ff2a1414a9f9ac2b6f5afaa348b8bac1dd87c59c0e6fa7c46e449148 not found: ID does not exist" Mar 16 16:14:54 crc kubenswrapper[5120]: I0316 16:14:54.461710 5120 scope.go:117] "RemoveContainer" containerID="5de7ccc55c26ab41ae31a5e2511ce9cecf14323742c5e06312d2456feb2db916" Mar 16 16:14:54 crc kubenswrapper[5120]: E0316 16:14:54.462059 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5de7ccc55c26ab41ae31a5e2511ce9cecf14323742c5e06312d2456feb2db916\": container with ID starting with 5de7ccc55c26ab41ae31a5e2511ce9cecf14323742c5e06312d2456feb2db916 not found: ID does not exist" containerID="5de7ccc55c26ab41ae31a5e2511ce9cecf14323742c5e06312d2456feb2db916" Mar 16 16:14:54 crc kubenswrapper[5120]: I0316 16:14:54.462097 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5de7ccc55c26ab41ae31a5e2511ce9cecf14323742c5e06312d2456feb2db916"} err="failed to get container status \"5de7ccc55c26ab41ae31a5e2511ce9cecf14323742c5e06312d2456feb2db916\": rpc error: code = NotFound desc = could not find container \"5de7ccc55c26ab41ae31a5e2511ce9cecf14323742c5e06312d2456feb2db916\": container with ID starting with 5de7ccc55c26ab41ae31a5e2511ce9cecf14323742c5e06312d2456feb2db916 not found: ID does not exist" Mar 16 16:14:54 crc kubenswrapper[5120]: I0316 16:14:54.488912 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/32e01c7b-7af9-4cc6-8f41-d951345e0fe4-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "32e01c7b-7af9-4cc6-8f41-d951345e0fe4" (UID: "32e01c7b-7af9-4cc6-8f41-d951345e0fe4"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:14:54 crc kubenswrapper[5120]: I0316 16:14:54.499660 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/32e01c7b-7af9-4cc6-8f41-d951345e0fe4-config-data" (OuterVolumeSpecName: "config-data") pod "32e01c7b-7af9-4cc6-8f41-d951345e0fe4" (UID: "32e01c7b-7af9-4cc6-8f41-d951345e0fe4"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:14:54 crc kubenswrapper[5120]: I0316 16:14:54.551903 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ghk8w\" (UniqueName: \"kubernetes.io/projected/32e01c7b-7af9-4cc6-8f41-d951345e0fe4-kube-api-access-ghk8w\") on node \"crc\" DevicePath \"\"" Mar 16 16:14:54 crc kubenswrapper[5120]: I0316 16:14:54.552208 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/32e01c7b-7af9-4cc6-8f41-d951345e0fe4-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:14:54 crc kubenswrapper[5120]: I0316 16:14:54.552277 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/32e01c7b-7af9-4cc6-8f41-d951345e0fe4-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:14:54 crc kubenswrapper[5120]: I0316 16:14:54.552351 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/32e01c7b-7af9-4cc6-8f41-d951345e0fe4-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:14:54 crc kubenswrapper[5120]: I0316 16:14:54.710286 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:14:54 crc kubenswrapper[5120]: I0316 16:14:54.724247 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-79cb59c45b-x77rt"] Mar 16 16:14:54 crc kubenswrapper[5120]: I0316 16:14:54.733601 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-api-79cb59c45b-x77rt"] Mar 16 16:14:56 crc kubenswrapper[5120]: I0316 16:14:56.703283 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="32e01c7b-7af9-4cc6-8f41-d951345e0fe4" path="/var/lib/kubelet/pods/32e01c7b-7af9-4cc6-8f41-d951345e0fe4/volumes" Mar 16 16:14:58 crc kubenswrapper[5120]: I0316 16:14:58.437051 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/ceilometer-0" podUID="0a87bbbf-8ee3-4693-b9b5-516b2a3b67db" containerName="proxy-httpd" probeResult="failure" output="HTTP probe failed with statuscode: 503" Mar 16 16:14:58 crc kubenswrapper[5120]: I0316 16:14:58.949705 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:14:59 crc kubenswrapper[5120]: I0316 16:14:59.083945 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0a87bbbf-8ee3-4693-b9b5-516b2a3b67db-config-data\") pod \"0a87bbbf-8ee3-4693-b9b5-516b2a3b67db\" (UID: \"0a87bbbf-8ee3-4693-b9b5-516b2a3b67db\") " Mar 16 16:14:59 crc kubenswrapper[5120]: I0316 16:14:59.084126 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/0a87bbbf-8ee3-4693-b9b5-516b2a3b67db-sg-core-conf-yaml\") pod \"0a87bbbf-8ee3-4693-b9b5-516b2a3b67db\" (UID: \"0a87bbbf-8ee3-4693-b9b5-516b2a3b67db\") " Mar 16 16:14:59 crc kubenswrapper[5120]: I0316 16:14:59.084239 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-krn6p\" (UniqueName: \"kubernetes.io/projected/0a87bbbf-8ee3-4693-b9b5-516b2a3b67db-kube-api-access-krn6p\") pod \"0a87bbbf-8ee3-4693-b9b5-516b2a3b67db\" (UID: \"0a87bbbf-8ee3-4693-b9b5-516b2a3b67db\") " Mar 16 16:14:59 crc kubenswrapper[5120]: I0316 16:14:59.084314 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0a87bbbf-8ee3-4693-b9b5-516b2a3b67db-log-httpd\") pod \"0a87bbbf-8ee3-4693-b9b5-516b2a3b67db\" (UID: \"0a87bbbf-8ee3-4693-b9b5-516b2a3b67db\") " Mar 16 16:14:59 crc kubenswrapper[5120]: I0316 16:14:59.084371 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0a87bbbf-8ee3-4693-b9b5-516b2a3b67db-run-httpd\") pod \"0a87bbbf-8ee3-4693-b9b5-516b2a3b67db\" (UID: \"0a87bbbf-8ee3-4693-b9b5-516b2a3b67db\") " Mar 16 16:14:59 crc kubenswrapper[5120]: I0316 16:14:59.085174 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a87bbbf-8ee3-4693-b9b5-516b2a3b67db-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "0a87bbbf-8ee3-4693-b9b5-516b2a3b67db" (UID: "0a87bbbf-8ee3-4693-b9b5-516b2a3b67db"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:14:59 crc kubenswrapper[5120]: I0316 16:14:59.085299 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0a87bbbf-8ee3-4693-b9b5-516b2a3b67db-scripts\") pod \"0a87bbbf-8ee3-4693-b9b5-516b2a3b67db\" (UID: \"0a87bbbf-8ee3-4693-b9b5-516b2a3b67db\") " Mar 16 16:14:59 crc kubenswrapper[5120]: I0316 16:14:59.085337 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a87bbbf-8ee3-4693-b9b5-516b2a3b67db-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "0a87bbbf-8ee3-4693-b9b5-516b2a3b67db" (UID: "0a87bbbf-8ee3-4693-b9b5-516b2a3b67db"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:14:59 crc kubenswrapper[5120]: I0316 16:14:59.086023 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0a87bbbf-8ee3-4693-b9b5-516b2a3b67db-combined-ca-bundle\") pod \"0a87bbbf-8ee3-4693-b9b5-516b2a3b67db\" (UID: \"0a87bbbf-8ee3-4693-b9b5-516b2a3b67db\") " Mar 16 16:14:59 crc kubenswrapper[5120]: I0316 16:14:59.087121 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0a87bbbf-8ee3-4693-b9b5-516b2a3b67db-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:14:59 crc kubenswrapper[5120]: I0316 16:14:59.087147 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0a87bbbf-8ee3-4693-b9b5-516b2a3b67db-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:14:59 crc kubenswrapper[5120]: I0316 16:14:59.102903 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a87bbbf-8ee3-4693-b9b5-516b2a3b67db-scripts" (OuterVolumeSpecName: "scripts") pod "0a87bbbf-8ee3-4693-b9b5-516b2a3b67db" (UID: "0a87bbbf-8ee3-4693-b9b5-516b2a3b67db"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:14:59 crc kubenswrapper[5120]: I0316 16:14:59.102975 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a87bbbf-8ee3-4693-b9b5-516b2a3b67db-kube-api-access-krn6p" (OuterVolumeSpecName: "kube-api-access-krn6p") pod "0a87bbbf-8ee3-4693-b9b5-516b2a3b67db" (UID: "0a87bbbf-8ee3-4693-b9b5-516b2a3b67db"). InnerVolumeSpecName "kube-api-access-krn6p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:14:59 crc kubenswrapper[5120]: I0316 16:14:59.114127 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a87bbbf-8ee3-4693-b9b5-516b2a3b67db-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "0a87bbbf-8ee3-4693-b9b5-516b2a3b67db" (UID: "0a87bbbf-8ee3-4693-b9b5-516b2a3b67db"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:14:59 crc kubenswrapper[5120]: I0316 16:14:59.167378 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a87bbbf-8ee3-4693-b9b5-516b2a3b67db-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "0a87bbbf-8ee3-4693-b9b5-516b2a3b67db" (UID: "0a87bbbf-8ee3-4693-b9b5-516b2a3b67db"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:14:59 crc kubenswrapper[5120]: I0316 16:14:59.188149 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a87bbbf-8ee3-4693-b9b5-516b2a3b67db-config-data" (OuterVolumeSpecName: "config-data") pod "0a87bbbf-8ee3-4693-b9b5-516b2a3b67db" (UID: "0a87bbbf-8ee3-4693-b9b5-516b2a3b67db"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:14:59 crc kubenswrapper[5120]: I0316 16:14:59.188913 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0a87bbbf-8ee3-4693-b9b5-516b2a3b67db-config-data\") pod \"0a87bbbf-8ee3-4693-b9b5-516b2a3b67db\" (UID: \"0a87bbbf-8ee3-4693-b9b5-516b2a3b67db\") " Mar 16 16:14:59 crc kubenswrapper[5120]: W0316 16:14:59.189069 5120 empty_dir.go:511] Warning: Unmount skipped because path does not exist: /var/lib/kubelet/pods/0a87bbbf-8ee3-4693-b9b5-516b2a3b67db/volumes/kubernetes.io~secret/config-data Mar 16 16:14:59 crc kubenswrapper[5120]: I0316 16:14:59.189103 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a87bbbf-8ee3-4693-b9b5-516b2a3b67db-config-data" (OuterVolumeSpecName: "config-data") pod "0a87bbbf-8ee3-4693-b9b5-516b2a3b67db" (UID: "0a87bbbf-8ee3-4693-b9b5-516b2a3b67db"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:14:59 crc kubenswrapper[5120]: I0316 16:14:59.189820 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-krn6p\" (UniqueName: \"kubernetes.io/projected/0a87bbbf-8ee3-4693-b9b5-516b2a3b67db-kube-api-access-krn6p\") on node \"crc\" DevicePath \"\"" Mar 16 16:14:59 crc kubenswrapper[5120]: I0316 16:14:59.189840 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0a87bbbf-8ee3-4693-b9b5-516b2a3b67db-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:14:59 crc kubenswrapper[5120]: I0316 16:14:59.189852 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0a87bbbf-8ee3-4693-b9b5-516b2a3b67db-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:14:59 crc kubenswrapper[5120]: I0316 16:14:59.189861 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0a87bbbf-8ee3-4693-b9b5-516b2a3b67db-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:14:59 crc kubenswrapper[5120]: I0316 16:14:59.189870 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/0a87bbbf-8ee3-4693-b9b5-516b2a3b67db-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 16:14:59 crc kubenswrapper[5120]: I0316 16:14:59.358127 5120 pod_container_manager_linux.go:217] "Failed to delete cgroup paths" cgroupName=["kubepods","besteffort","poddd7a06d8-8dcb-4564-98a3-71818f740edf"] err="unable to destroy cgroup paths for cgroup [kubepods besteffort poddd7a06d8-8dcb-4564-98a3-71818f740edf] : Timed out while waiting for systemd to remove kubepods-besteffort-poddd7a06d8_8dcb_4564_98a3_71818f740edf.slice" Mar 16 16:14:59 crc kubenswrapper[5120]: E0316 16:14:59.358403 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to delete cgroup paths for [kubepods besteffort poddd7a06d8-8dcb-4564-98a3-71818f740edf] : unable to destroy cgroup paths for cgroup [kubepods besteffort poddd7a06d8-8dcb-4564-98a3-71818f740edf] : Timed out while waiting for systemd to remove kubepods-besteffort-poddd7a06d8_8dcb_4564_98a3_71818f740edf.slice" pod="openstack-kuttl-tests/barbican-db-sync-xlnnr" podUID="dd7a06d8-8dcb-4564-98a3-71818f740edf" Mar 16 16:14:59 crc kubenswrapper[5120]: I0316 16:14:59.464634 5120 generic.go:358] "Generic (PLEG): container finished" podID="0a87bbbf-8ee3-4693-b9b5-516b2a3b67db" containerID="0dd30f39feb4c51ce754d8ed8226a58ef6bc9a6f0ec94ff105629e02edab3605" exitCode=137 Mar 16 16:14:59 crc kubenswrapper[5120]: I0316 16:14:59.464725 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:14:59 crc kubenswrapper[5120]: I0316 16:14:59.464804 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"0a87bbbf-8ee3-4693-b9b5-516b2a3b67db","Type":"ContainerDied","Data":"0dd30f39feb4c51ce754d8ed8226a58ef6bc9a6f0ec94ff105629e02edab3605"} Mar 16 16:14:59 crc kubenswrapper[5120]: I0316 16:14:59.464898 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"0a87bbbf-8ee3-4693-b9b5-516b2a3b67db","Type":"ContainerDied","Data":"bcf130ad6a8b4e55a74434f898bbd8d38c3f35586d34405facce0dba438659d1"} Mar 16 16:14:59 crc kubenswrapper[5120]: I0316 16:14:59.464940 5120 scope.go:117] "RemoveContainer" containerID="0dd30f39feb4c51ce754d8ed8226a58ef6bc9a6f0ec94ff105629e02edab3605" Mar 16 16:14:59 crc kubenswrapper[5120]: I0316 16:14:59.465017 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-xlnnr" Mar 16 16:14:59 crc kubenswrapper[5120]: I0316 16:14:59.509887 5120 scope.go:117] "RemoveContainer" containerID="12d94346012a092ddc802ca4931d0ab66bceeb5ca24bb14d5ae95396305aa3e4" Mar 16 16:14:59 crc kubenswrapper[5120]: I0316 16:14:59.519642 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:14:59 crc kubenswrapper[5120]: I0316 16:14:59.538868 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:14:59 crc kubenswrapper[5120]: I0316 16:14:59.550097 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:14:59 crc kubenswrapper[5120]: I0316 16:14:59.554837 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a87bbbf-8ee3-4693-b9b5-516b2a3b67db" containerName="ceilometer-notification-agent" Mar 16 16:14:59 crc kubenswrapper[5120]: I0316 16:14:59.554878 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a87bbbf-8ee3-4693-b9b5-516b2a3b67db" containerName="ceilometer-notification-agent" Mar 16 16:14:59 crc kubenswrapper[5120]: I0316 16:14:59.554922 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a87bbbf-8ee3-4693-b9b5-516b2a3b67db" containerName="proxy-httpd" Mar 16 16:14:59 crc kubenswrapper[5120]: I0316 16:14:59.554934 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a87bbbf-8ee3-4693-b9b5-516b2a3b67db" containerName="proxy-httpd" Mar 16 16:14:59 crc kubenswrapper[5120]: I0316 16:14:59.554973 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32e01c7b-7af9-4cc6-8f41-d951345e0fe4" containerName="barbican-api-log" Mar 16 16:14:59 crc kubenswrapper[5120]: I0316 16:14:59.554984 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="32e01c7b-7af9-4cc6-8f41-d951345e0fe4" containerName="barbican-api-log" Mar 16 16:14:59 crc kubenswrapper[5120]: I0316 16:14:59.555001 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32e01c7b-7af9-4cc6-8f41-d951345e0fe4" containerName="barbican-api" Mar 16 16:14:59 crc kubenswrapper[5120]: I0316 16:14:59.555013 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="32e01c7b-7af9-4cc6-8f41-d951345e0fe4" containerName="barbican-api" Mar 16 16:14:59 crc kubenswrapper[5120]: I0316 16:14:59.555027 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a87bbbf-8ee3-4693-b9b5-516b2a3b67db" containerName="sg-core" Mar 16 16:14:59 crc kubenswrapper[5120]: I0316 16:14:59.555042 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a87bbbf-8ee3-4693-b9b5-516b2a3b67db" containerName="sg-core" Mar 16 16:14:59 crc kubenswrapper[5120]: I0316 16:14:59.555058 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a87bbbf-8ee3-4693-b9b5-516b2a3b67db" containerName="ceilometer-central-agent" Mar 16 16:14:59 crc kubenswrapper[5120]: I0316 16:14:59.555069 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a87bbbf-8ee3-4693-b9b5-516b2a3b67db" containerName="ceilometer-central-agent" Mar 16 16:14:59 crc kubenswrapper[5120]: I0316 16:14:59.555348 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="32e01c7b-7af9-4cc6-8f41-d951345e0fe4" containerName="barbican-api-log" Mar 16 16:14:59 crc kubenswrapper[5120]: I0316 16:14:59.555376 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="0a87bbbf-8ee3-4693-b9b5-516b2a3b67db" containerName="ceilometer-central-agent" Mar 16 16:14:59 crc kubenswrapper[5120]: I0316 16:14:59.555397 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="0a87bbbf-8ee3-4693-b9b5-516b2a3b67db" containerName="sg-core" Mar 16 16:14:59 crc kubenswrapper[5120]: I0316 16:14:59.555421 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="32e01c7b-7af9-4cc6-8f41-d951345e0fe4" containerName="barbican-api" Mar 16 16:14:59 crc kubenswrapper[5120]: I0316 16:14:59.555445 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="0a87bbbf-8ee3-4693-b9b5-516b2a3b67db" containerName="ceilometer-notification-agent" Mar 16 16:14:59 crc kubenswrapper[5120]: I0316 16:14:59.555462 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="0a87bbbf-8ee3-4693-b9b5-516b2a3b67db" containerName="proxy-httpd" Mar 16 16:14:59 crc kubenswrapper[5120]: I0316 16:14:59.568348 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:14:59 crc kubenswrapper[5120]: I0316 16:14:59.568511 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:14:59 crc kubenswrapper[5120]: I0316 16:14:59.571731 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 16:14:59 crc kubenswrapper[5120]: I0316 16:14:59.572346 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 16:14:59 crc kubenswrapper[5120]: I0316 16:14:59.585677 5120 scope.go:117] "RemoveContainer" containerID="08ccfa701ccc79e179b5858e89491726e9dec73be4bb965be4c99483916a7780" Mar 16 16:14:59 crc kubenswrapper[5120]: I0316 16:14:59.628978 5120 scope.go:117] "RemoveContainer" containerID="79637f72d630e71184d826945a6cfef9d4ce56f998543c651ec1c860e579b64a" Mar 16 16:14:59 crc kubenswrapper[5120]: I0316 16:14:59.658554 5120 scope.go:117] "RemoveContainer" containerID="0dd30f39feb4c51ce754d8ed8226a58ef6bc9a6f0ec94ff105629e02edab3605" Mar 16 16:14:59 crc kubenswrapper[5120]: E0316 16:14:59.659181 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0dd30f39feb4c51ce754d8ed8226a58ef6bc9a6f0ec94ff105629e02edab3605\": container with ID starting with 0dd30f39feb4c51ce754d8ed8226a58ef6bc9a6f0ec94ff105629e02edab3605 not found: ID does not exist" containerID="0dd30f39feb4c51ce754d8ed8226a58ef6bc9a6f0ec94ff105629e02edab3605" Mar 16 16:14:59 crc kubenswrapper[5120]: I0316 16:14:59.659233 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0dd30f39feb4c51ce754d8ed8226a58ef6bc9a6f0ec94ff105629e02edab3605"} err="failed to get container status \"0dd30f39feb4c51ce754d8ed8226a58ef6bc9a6f0ec94ff105629e02edab3605\": rpc error: code = NotFound desc = could not find container \"0dd30f39feb4c51ce754d8ed8226a58ef6bc9a6f0ec94ff105629e02edab3605\": container with ID starting with 0dd30f39feb4c51ce754d8ed8226a58ef6bc9a6f0ec94ff105629e02edab3605 not found: ID does not exist" Mar 16 16:14:59 crc kubenswrapper[5120]: I0316 16:14:59.659262 5120 scope.go:117] "RemoveContainer" containerID="12d94346012a092ddc802ca4931d0ab66bceeb5ca24bb14d5ae95396305aa3e4" Mar 16 16:14:59 crc kubenswrapper[5120]: E0316 16:14:59.659675 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"12d94346012a092ddc802ca4931d0ab66bceeb5ca24bb14d5ae95396305aa3e4\": container with ID starting with 12d94346012a092ddc802ca4931d0ab66bceeb5ca24bb14d5ae95396305aa3e4 not found: ID does not exist" containerID="12d94346012a092ddc802ca4931d0ab66bceeb5ca24bb14d5ae95396305aa3e4" Mar 16 16:14:59 crc kubenswrapper[5120]: I0316 16:14:59.659709 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"12d94346012a092ddc802ca4931d0ab66bceeb5ca24bb14d5ae95396305aa3e4"} err="failed to get container status \"12d94346012a092ddc802ca4931d0ab66bceeb5ca24bb14d5ae95396305aa3e4\": rpc error: code = NotFound desc = could not find container \"12d94346012a092ddc802ca4931d0ab66bceeb5ca24bb14d5ae95396305aa3e4\": container with ID starting with 12d94346012a092ddc802ca4931d0ab66bceeb5ca24bb14d5ae95396305aa3e4 not found: ID does not exist" Mar 16 16:14:59 crc kubenswrapper[5120]: I0316 16:14:59.659727 5120 scope.go:117] "RemoveContainer" containerID="08ccfa701ccc79e179b5858e89491726e9dec73be4bb965be4c99483916a7780" Mar 16 16:14:59 crc kubenswrapper[5120]: E0316 16:14:59.660269 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"08ccfa701ccc79e179b5858e89491726e9dec73be4bb965be4c99483916a7780\": container with ID starting with 08ccfa701ccc79e179b5858e89491726e9dec73be4bb965be4c99483916a7780 not found: ID does not exist" containerID="08ccfa701ccc79e179b5858e89491726e9dec73be4bb965be4c99483916a7780" Mar 16 16:14:59 crc kubenswrapper[5120]: I0316 16:14:59.660318 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08ccfa701ccc79e179b5858e89491726e9dec73be4bb965be4c99483916a7780"} err="failed to get container status \"08ccfa701ccc79e179b5858e89491726e9dec73be4bb965be4c99483916a7780\": rpc error: code = NotFound desc = could not find container \"08ccfa701ccc79e179b5858e89491726e9dec73be4bb965be4c99483916a7780\": container with ID starting with 08ccfa701ccc79e179b5858e89491726e9dec73be4bb965be4c99483916a7780 not found: ID does not exist" Mar 16 16:14:59 crc kubenswrapper[5120]: I0316 16:14:59.660346 5120 scope.go:117] "RemoveContainer" containerID="79637f72d630e71184d826945a6cfef9d4ce56f998543c651ec1c860e579b64a" Mar 16 16:14:59 crc kubenswrapper[5120]: E0316 16:14:59.660686 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"79637f72d630e71184d826945a6cfef9d4ce56f998543c651ec1c860e579b64a\": container with ID starting with 79637f72d630e71184d826945a6cfef9d4ce56f998543c651ec1c860e579b64a not found: ID does not exist" containerID="79637f72d630e71184d826945a6cfef9d4ce56f998543c651ec1c860e579b64a" Mar 16 16:14:59 crc kubenswrapper[5120]: I0316 16:14:59.660724 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79637f72d630e71184d826945a6cfef9d4ce56f998543c651ec1c860e579b64a"} err="failed to get container status \"79637f72d630e71184d826945a6cfef9d4ce56f998543c651ec1c860e579b64a\": rpc error: code = NotFound desc = could not find container \"79637f72d630e71184d826945a6cfef9d4ce56f998543c651ec1c860e579b64a\": container with ID starting with 79637f72d630e71184d826945a6cfef9d4ce56f998543c651ec1c860e579b64a not found: ID does not exist" Mar 16 16:14:59 crc kubenswrapper[5120]: I0316 16:14:59.714623 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/70767b5f-5971-43c0-99fb-4d927737b789-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"70767b5f-5971-43c0-99fb-4d927737b789\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:14:59 crc kubenswrapper[5120]: I0316 16:14:59.714806 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/70767b5f-5971-43c0-99fb-4d927737b789-run-httpd\") pod \"ceilometer-0\" (UID: \"70767b5f-5971-43c0-99fb-4d927737b789\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:14:59 crc kubenswrapper[5120]: I0316 16:14:59.715227 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxftq\" (UniqueName: \"kubernetes.io/projected/70767b5f-5971-43c0-99fb-4d927737b789-kube-api-access-mxftq\") pod \"ceilometer-0\" (UID: \"70767b5f-5971-43c0-99fb-4d927737b789\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:14:59 crc kubenswrapper[5120]: I0316 16:14:59.715347 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/70767b5f-5971-43c0-99fb-4d927737b789-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"70767b5f-5971-43c0-99fb-4d927737b789\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:14:59 crc kubenswrapper[5120]: I0316 16:14:59.715538 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/70767b5f-5971-43c0-99fb-4d927737b789-log-httpd\") pod \"ceilometer-0\" (UID: \"70767b5f-5971-43c0-99fb-4d927737b789\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:14:59 crc kubenswrapper[5120]: I0316 16:14:59.715621 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/70767b5f-5971-43c0-99fb-4d927737b789-config-data\") pod \"ceilometer-0\" (UID: \"70767b5f-5971-43c0-99fb-4d927737b789\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:14:59 crc kubenswrapper[5120]: I0316 16:14:59.715702 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/70767b5f-5971-43c0-99fb-4d927737b789-scripts\") pod \"ceilometer-0\" (UID: \"70767b5f-5971-43c0-99fb-4d927737b789\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:14:59 crc kubenswrapper[5120]: I0316 16:14:59.818023 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mxftq\" (UniqueName: \"kubernetes.io/projected/70767b5f-5971-43c0-99fb-4d927737b789-kube-api-access-mxftq\") pod \"ceilometer-0\" (UID: \"70767b5f-5971-43c0-99fb-4d927737b789\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:14:59 crc kubenswrapper[5120]: I0316 16:14:59.818276 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/70767b5f-5971-43c0-99fb-4d927737b789-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"70767b5f-5971-43c0-99fb-4d927737b789\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:14:59 crc kubenswrapper[5120]: I0316 16:14:59.818499 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/70767b5f-5971-43c0-99fb-4d927737b789-log-httpd\") pod \"ceilometer-0\" (UID: \"70767b5f-5971-43c0-99fb-4d927737b789\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:14:59 crc kubenswrapper[5120]: I0316 16:14:59.818569 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/70767b5f-5971-43c0-99fb-4d927737b789-config-data\") pod \"ceilometer-0\" (UID: \"70767b5f-5971-43c0-99fb-4d927737b789\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:14:59 crc kubenswrapper[5120]: I0316 16:14:59.818638 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/70767b5f-5971-43c0-99fb-4d927737b789-scripts\") pod \"ceilometer-0\" (UID: \"70767b5f-5971-43c0-99fb-4d927737b789\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:14:59 crc kubenswrapper[5120]: I0316 16:14:59.818885 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/70767b5f-5971-43c0-99fb-4d927737b789-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"70767b5f-5971-43c0-99fb-4d927737b789\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:14:59 crc kubenswrapper[5120]: I0316 16:14:59.819013 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/70767b5f-5971-43c0-99fb-4d927737b789-run-httpd\") pod \"ceilometer-0\" (UID: \"70767b5f-5971-43c0-99fb-4d927737b789\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:14:59 crc kubenswrapper[5120]: I0316 16:14:59.819110 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/70767b5f-5971-43c0-99fb-4d927737b789-log-httpd\") pod \"ceilometer-0\" (UID: \"70767b5f-5971-43c0-99fb-4d927737b789\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:14:59 crc kubenswrapper[5120]: I0316 16:14:59.819351 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/70767b5f-5971-43c0-99fb-4d927737b789-run-httpd\") pod \"ceilometer-0\" (UID: \"70767b5f-5971-43c0-99fb-4d927737b789\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:14:59 crc kubenswrapper[5120]: I0316 16:14:59.825472 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/70767b5f-5971-43c0-99fb-4d927737b789-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"70767b5f-5971-43c0-99fb-4d927737b789\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:14:59 crc kubenswrapper[5120]: I0316 16:14:59.825709 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/70767b5f-5971-43c0-99fb-4d927737b789-scripts\") pod \"ceilometer-0\" (UID: \"70767b5f-5971-43c0-99fb-4d927737b789\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:14:59 crc kubenswrapper[5120]: I0316 16:14:59.826482 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/70767b5f-5971-43c0-99fb-4d927737b789-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"70767b5f-5971-43c0-99fb-4d927737b789\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:14:59 crc kubenswrapper[5120]: I0316 16:14:59.831658 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/70767b5f-5971-43c0-99fb-4d927737b789-config-data\") pod \"ceilometer-0\" (UID: \"70767b5f-5971-43c0-99fb-4d927737b789\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:14:59 crc kubenswrapper[5120]: I0316 16:14:59.841579 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxftq\" (UniqueName: \"kubernetes.io/projected/70767b5f-5971-43c0-99fb-4d927737b789-kube-api-access-mxftq\") pod \"ceilometer-0\" (UID: \"70767b5f-5971-43c0-99fb-4d927737b789\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:14:59 crc kubenswrapper[5120]: I0316 16:14:59.892429 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:14:59 crc kubenswrapper[5120]: I0316 16:14:59.932000 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:15:00 crc kubenswrapper[5120]: I0316 16:15:00.146162 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29561295-hlmm9"] Mar 16 16:15:00 crc kubenswrapper[5120]: I0316 16:15:00.155862 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29561295-hlmm9"] Mar 16 16:15:00 crc kubenswrapper[5120]: I0316 16:15:00.156017 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29561295-hlmm9" Mar 16 16:15:00 crc kubenswrapper[5120]: I0316 16:15:00.158303 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operator-lifecycle-manager\"/\"collect-profiles-config\"" Mar 16 16:15:00 crc kubenswrapper[5120]: I0316 16:15:00.159827 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operator-lifecycle-manager\"/\"collect-profiles-dockercfg-vfqp6\"" Mar 16 16:15:00 crc kubenswrapper[5120]: I0316 16:15:00.228201 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2q7q\" (UniqueName: \"kubernetes.io/projected/f2d980ac-9267-4c28-a842-ecf2e778a4f1-kube-api-access-r2q7q\") pod \"collect-profiles-29561295-hlmm9\" (UID: \"f2d980ac-9267-4c28-a842-ecf2e778a4f1\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561295-hlmm9" Mar 16 16:15:00 crc kubenswrapper[5120]: I0316 16:15:00.228455 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f2d980ac-9267-4c28-a842-ecf2e778a4f1-config-volume\") pod \"collect-profiles-29561295-hlmm9\" (UID: \"f2d980ac-9267-4c28-a842-ecf2e778a4f1\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561295-hlmm9" Mar 16 16:15:00 crc kubenswrapper[5120]: I0316 16:15:00.228500 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/f2d980ac-9267-4c28-a842-ecf2e778a4f1-secret-volume\") pod \"collect-profiles-29561295-hlmm9\" (UID: \"f2d980ac-9267-4c28-a842-ecf2e778a4f1\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561295-hlmm9" Mar 16 16:15:00 crc kubenswrapper[5120]: I0316 16:15:00.330456 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/f2d980ac-9267-4c28-a842-ecf2e778a4f1-secret-volume\") pod \"collect-profiles-29561295-hlmm9\" (UID: \"f2d980ac-9267-4c28-a842-ecf2e778a4f1\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561295-hlmm9" Mar 16 16:15:00 crc kubenswrapper[5120]: I0316 16:15:00.330643 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r2q7q\" (UniqueName: \"kubernetes.io/projected/f2d980ac-9267-4c28-a842-ecf2e778a4f1-kube-api-access-r2q7q\") pod \"collect-profiles-29561295-hlmm9\" (UID: \"f2d980ac-9267-4c28-a842-ecf2e778a4f1\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561295-hlmm9" Mar 16 16:15:00 crc kubenswrapper[5120]: I0316 16:15:00.330877 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f2d980ac-9267-4c28-a842-ecf2e778a4f1-config-volume\") pod \"collect-profiles-29561295-hlmm9\" (UID: \"f2d980ac-9267-4c28-a842-ecf2e778a4f1\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561295-hlmm9" Mar 16 16:15:00 crc kubenswrapper[5120]: I0316 16:15:00.331736 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f2d980ac-9267-4c28-a842-ecf2e778a4f1-config-volume\") pod \"collect-profiles-29561295-hlmm9\" (UID: \"f2d980ac-9267-4c28-a842-ecf2e778a4f1\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561295-hlmm9" Mar 16 16:15:00 crc kubenswrapper[5120]: I0316 16:15:00.337008 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/f2d980ac-9267-4c28-a842-ecf2e778a4f1-secret-volume\") pod \"collect-profiles-29561295-hlmm9\" (UID: \"f2d980ac-9267-4c28-a842-ecf2e778a4f1\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561295-hlmm9" Mar 16 16:15:00 crc kubenswrapper[5120]: I0316 16:15:00.348782 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2q7q\" (UniqueName: \"kubernetes.io/projected/f2d980ac-9267-4c28-a842-ecf2e778a4f1-kube-api-access-r2q7q\") pod \"collect-profiles-29561295-hlmm9\" (UID: \"f2d980ac-9267-4c28-a842-ecf2e778a4f1\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561295-hlmm9" Mar 16 16:15:00 crc kubenswrapper[5120]: I0316 16:15:00.359999 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:15:00 crc kubenswrapper[5120]: I0316 16:15:00.480247 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29561295-hlmm9" Mar 16 16:15:00 crc kubenswrapper[5120]: I0316 16:15:00.485266 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"70767b5f-5971-43c0-99fb-4d927737b789","Type":"ContainerStarted","Data":"ac799d8dbabc52c82c4f803d916a36a5619f8c78baec45d13ffac28851553225"} Mar 16 16:15:00 crc kubenswrapper[5120]: I0316 16:15:00.673020 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0a87bbbf-8ee3-4693-b9b5-516b2a3b67db" path="/var/lib/kubelet/pods/0a87bbbf-8ee3-4693-b9b5-516b2a3b67db/volumes" Mar 16 16:15:00 crc kubenswrapper[5120]: I0316 16:15:00.953265 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29561295-hlmm9"] Mar 16 16:15:00 crc kubenswrapper[5120]: W0316 16:15:00.953287 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2d980ac_9267_4c28_a842_ecf2e778a4f1.slice/crio-ef4ba933ce45fc97dd6ef0c7b3c3c68dcaeedb0285c68c0c8d1300957f68322b WatchSource:0}: Error finding container ef4ba933ce45fc97dd6ef0c7b3c3c68dcaeedb0285c68c0c8d1300957f68322b: Status 404 returned error can't find the container with id ef4ba933ce45fc97dd6ef0c7b3c3c68dcaeedb0285c68c0c8d1300957f68322b Mar 16 16:15:01 crc kubenswrapper[5120]: I0316 16:15:01.505530 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/collect-profiles-29561295-hlmm9" event={"ID":"f2d980ac-9267-4c28-a842-ecf2e778a4f1","Type":"ContainerStarted","Data":"969c0fee6f5e50a4c085ce67514e02e7f86d5f620047b6f219929078b3e9bf5e"} Mar 16 16:15:01 crc kubenswrapper[5120]: I0316 16:15:01.505968 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/collect-profiles-29561295-hlmm9" event={"ID":"f2d980ac-9267-4c28-a842-ecf2e778a4f1","Type":"ContainerStarted","Data":"ef4ba933ce45fc97dd6ef0c7b3c3c68dcaeedb0285c68c0c8d1300957f68322b"} Mar 16 16:15:01 crc kubenswrapper[5120]: I0316 16:15:01.508932 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"70767b5f-5971-43c0-99fb-4d927737b789","Type":"ContainerStarted","Data":"93a246d3cb29b6c2d08c7a61f9295bef9ed54107b2387e0ce5345ce9961a64e1"} Mar 16 16:15:01 crc kubenswrapper[5120]: I0316 16:15:01.545001 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operator-lifecycle-manager/collect-profiles-29561295-hlmm9" podStartSLOduration=1.544972285 podStartE2EDuration="1.544972285s" podCreationTimestamp="2026-03-16 16:15:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:15:01.526560881 +0000 UTC m=+2603.680492578" watchObservedRunningTime="2026-03-16 16:15:01.544972285 +0000 UTC m=+2603.698903982" Mar 16 16:15:02 crc kubenswrapper[5120]: I0316 16:15:02.539420 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"70767b5f-5971-43c0-99fb-4d927737b789","Type":"ContainerStarted","Data":"c86a759249593cfbabd1d0dd4fcd8f0b6259f6c08f7fa255c64870f14422a53a"} Mar 16 16:15:02 crc kubenswrapper[5120]: I0316 16:15:02.542313 5120 generic.go:358] "Generic (PLEG): container finished" podID="f2d980ac-9267-4c28-a842-ecf2e778a4f1" containerID="969c0fee6f5e50a4c085ce67514e02e7f86d5f620047b6f219929078b3e9bf5e" exitCode=0 Mar 16 16:15:02 crc kubenswrapper[5120]: I0316 16:15:02.542405 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/collect-profiles-29561295-hlmm9" event={"ID":"f2d980ac-9267-4c28-a842-ecf2e778a4f1","Type":"ContainerDied","Data":"969c0fee6f5e50a4c085ce67514e02e7f86d5f620047b6f219929078b3e9bf5e"} Mar 16 16:15:03 crc kubenswrapper[5120]: I0316 16:15:03.553939 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"70767b5f-5971-43c0-99fb-4d927737b789","Type":"ContainerStarted","Data":"1534d4f8f26cde409aea3e1415c7fbc4a13a3158dfc872e75efd4c0e740318d5"} Mar 16 16:15:03 crc kubenswrapper[5120]: I0316 16:15:03.671016 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/placement-54f764f5f6-t2dpg" Mar 16 16:15:03 crc kubenswrapper[5120]: I0316 16:15:03.927048 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29561295-hlmm9" Mar 16 16:15:04 crc kubenswrapper[5120]: I0316 16:15:04.025104 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/f2d980ac-9267-4c28-a842-ecf2e778a4f1-secret-volume\") pod \"f2d980ac-9267-4c28-a842-ecf2e778a4f1\" (UID: \"f2d980ac-9267-4c28-a842-ecf2e778a4f1\") " Mar 16 16:15:04 crc kubenswrapper[5120]: I0316 16:15:04.025388 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f2d980ac-9267-4c28-a842-ecf2e778a4f1-config-volume\") pod \"f2d980ac-9267-4c28-a842-ecf2e778a4f1\" (UID: \"f2d980ac-9267-4c28-a842-ecf2e778a4f1\") " Mar 16 16:15:04 crc kubenswrapper[5120]: I0316 16:15:04.025438 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r2q7q\" (UniqueName: \"kubernetes.io/projected/f2d980ac-9267-4c28-a842-ecf2e778a4f1-kube-api-access-r2q7q\") pod \"f2d980ac-9267-4c28-a842-ecf2e778a4f1\" (UID: \"f2d980ac-9267-4c28-a842-ecf2e778a4f1\") " Mar 16 16:15:04 crc kubenswrapper[5120]: I0316 16:15:04.026233 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f2d980ac-9267-4c28-a842-ecf2e778a4f1-config-volume" (OuterVolumeSpecName: "config-volume") pod "f2d980ac-9267-4c28-a842-ecf2e778a4f1" (UID: "f2d980ac-9267-4c28-a842-ecf2e778a4f1"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:15:04 crc kubenswrapper[5120]: I0316 16:15:04.032658 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2d980ac-9267-4c28-a842-ecf2e778a4f1-kube-api-access-r2q7q" (OuterVolumeSpecName: "kube-api-access-r2q7q") pod "f2d980ac-9267-4c28-a842-ecf2e778a4f1" (UID: "f2d980ac-9267-4c28-a842-ecf2e778a4f1"). InnerVolumeSpecName "kube-api-access-r2q7q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:15:04 crc kubenswrapper[5120]: I0316 16:15:04.034578 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f2d980ac-9267-4c28-a842-ecf2e778a4f1-secret-volume" (OuterVolumeSpecName: "secret-volume") pod "f2d980ac-9267-4c28-a842-ecf2e778a4f1" (UID: "f2d980ac-9267-4c28-a842-ecf2e778a4f1"). InnerVolumeSpecName "secret-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:15:04 crc kubenswrapper[5120]: I0316 16:15:04.127776 5120 reconciler_common.go:299] "Volume detached for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/f2d980ac-9267-4c28-a842-ecf2e778a4f1-secret-volume\") on node \"crc\" DevicePath \"\"" Mar 16 16:15:04 crc kubenswrapper[5120]: I0316 16:15:04.127802 5120 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f2d980ac-9267-4c28-a842-ecf2e778a4f1-config-volume\") on node \"crc\" DevicePath \"\"" Mar 16 16:15:04 crc kubenswrapper[5120]: I0316 16:15:04.127813 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r2q7q\" (UniqueName: \"kubernetes.io/projected/f2d980ac-9267-4c28-a842-ecf2e778a4f1-kube-api-access-r2q7q\") on node \"crc\" DevicePath \"\"" Mar 16 16:15:04 crc kubenswrapper[5120]: I0316 16:15:04.592963 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29561295-hlmm9" Mar 16 16:15:04 crc kubenswrapper[5120]: I0316 16:15:04.593054 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/collect-profiles-29561295-hlmm9" event={"ID":"f2d980ac-9267-4c28-a842-ecf2e778a4f1","Type":"ContainerDied","Data":"ef4ba933ce45fc97dd6ef0c7b3c3c68dcaeedb0285c68c0c8d1300957f68322b"} Mar 16 16:15:04 crc kubenswrapper[5120]: I0316 16:15:04.598446 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ef4ba933ce45fc97dd6ef0c7b3c3c68dcaeedb0285c68c0c8d1300957f68322b" Mar 16 16:15:04 crc kubenswrapper[5120]: I0316 16:15:04.617885 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29561250-7npz6"] Mar 16 16:15:04 crc kubenswrapper[5120]: I0316 16:15:04.625047 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29561250-7npz6"] Mar 16 16:15:04 crc kubenswrapper[5120]: I0316 16:15:04.658303 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/placement-54f764f5f6-t2dpg" Mar 16 16:15:04 crc kubenswrapper[5120]: I0316 16:15:04.681888 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="deae033b-c4b8-462c-b29b-5115eb40a94b" path="/var/lib/kubelet/pods/deae033b-c4b8-462c-b29b-5115eb40a94b/volumes" Mar 16 16:15:04 crc kubenswrapper[5120]: E0316 16:15:04.764058 5120 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2d980ac_9267_4c28_a842_ecf2e778a4f1.slice\": RecentStats: unable to find data in memory cache]" Mar 16 16:15:04 crc kubenswrapper[5120]: I0316 16:15:04.896653 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-77f5d87454-bxpdp"] Mar 16 16:15:04 crc kubenswrapper[5120]: I0316 16:15:04.898540 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2d980ac-9267-4c28-a842-ecf2e778a4f1" containerName="collect-profiles" Mar 16 16:15:04 crc kubenswrapper[5120]: I0316 16:15:04.898658 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2d980ac-9267-4c28-a842-ecf2e778a4f1" containerName="collect-profiles" Mar 16 16:15:04 crc kubenswrapper[5120]: I0316 16:15:04.899062 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f2d980ac-9267-4c28-a842-ecf2e778a4f1" containerName="collect-profiles" Mar 16 16:15:04 crc kubenswrapper[5120]: I0316 16:15:04.913095 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-77f5d87454-bxpdp" Mar 16 16:15:04 crc kubenswrapper[5120]: I0316 16:15:04.919692 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-77f5d87454-bxpdp"] Mar 16 16:15:04 crc kubenswrapper[5120]: I0316 16:15:04.947735 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3fe73309-f917-40c4-a606-511f1547daf4-logs\") pod \"placement-77f5d87454-bxpdp\" (UID: \"3fe73309-f917-40c4-a606-511f1547daf4\") " pod="openstack-kuttl-tests/placement-77f5d87454-bxpdp" Mar 16 16:15:04 crc kubenswrapper[5120]: I0316 16:15:04.947791 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3fe73309-f917-40c4-a606-511f1547daf4-config-data\") pod \"placement-77f5d87454-bxpdp\" (UID: \"3fe73309-f917-40c4-a606-511f1547daf4\") " pod="openstack-kuttl-tests/placement-77f5d87454-bxpdp" Mar 16 16:15:04 crc kubenswrapper[5120]: I0316 16:15:04.947895 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3fe73309-f917-40c4-a606-511f1547daf4-combined-ca-bundle\") pod \"placement-77f5d87454-bxpdp\" (UID: \"3fe73309-f917-40c4-a606-511f1547daf4\") " pod="openstack-kuttl-tests/placement-77f5d87454-bxpdp" Mar 16 16:15:04 crc kubenswrapper[5120]: I0316 16:15:04.947938 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3fe73309-f917-40c4-a606-511f1547daf4-scripts\") pod \"placement-77f5d87454-bxpdp\" (UID: \"3fe73309-f917-40c4-a606-511f1547daf4\") " pod="openstack-kuttl-tests/placement-77f5d87454-bxpdp" Mar 16 16:15:04 crc kubenswrapper[5120]: I0316 16:15:04.947961 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9k7q7\" (UniqueName: \"kubernetes.io/projected/3fe73309-f917-40c4-a606-511f1547daf4-kube-api-access-9k7q7\") pod \"placement-77f5d87454-bxpdp\" (UID: \"3fe73309-f917-40c4-a606-511f1547daf4\") " pod="openstack-kuttl-tests/placement-77f5d87454-bxpdp" Mar 16 16:15:04 crc kubenswrapper[5120]: I0316 16:15:04.947991 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/3fe73309-f917-40c4-a606-511f1547daf4-internal-tls-certs\") pod \"placement-77f5d87454-bxpdp\" (UID: \"3fe73309-f917-40c4-a606-511f1547daf4\") " pod="openstack-kuttl-tests/placement-77f5d87454-bxpdp" Mar 16 16:15:04 crc kubenswrapper[5120]: I0316 16:15:04.948037 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/3fe73309-f917-40c4-a606-511f1547daf4-public-tls-certs\") pod \"placement-77f5d87454-bxpdp\" (UID: \"3fe73309-f917-40c4-a606-511f1547daf4\") " pod="openstack-kuttl-tests/placement-77f5d87454-bxpdp" Mar 16 16:15:05 crc kubenswrapper[5120]: I0316 16:15:05.050463 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3fe73309-f917-40c4-a606-511f1547daf4-combined-ca-bundle\") pod \"placement-77f5d87454-bxpdp\" (UID: \"3fe73309-f917-40c4-a606-511f1547daf4\") " pod="openstack-kuttl-tests/placement-77f5d87454-bxpdp" Mar 16 16:15:05 crc kubenswrapper[5120]: I0316 16:15:05.050570 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3fe73309-f917-40c4-a606-511f1547daf4-scripts\") pod \"placement-77f5d87454-bxpdp\" (UID: \"3fe73309-f917-40c4-a606-511f1547daf4\") " pod="openstack-kuttl-tests/placement-77f5d87454-bxpdp" Mar 16 16:15:05 crc kubenswrapper[5120]: I0316 16:15:05.050607 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9k7q7\" (UniqueName: \"kubernetes.io/projected/3fe73309-f917-40c4-a606-511f1547daf4-kube-api-access-9k7q7\") pod \"placement-77f5d87454-bxpdp\" (UID: \"3fe73309-f917-40c4-a606-511f1547daf4\") " pod="openstack-kuttl-tests/placement-77f5d87454-bxpdp" Mar 16 16:15:05 crc kubenswrapper[5120]: I0316 16:15:05.050656 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/3fe73309-f917-40c4-a606-511f1547daf4-internal-tls-certs\") pod \"placement-77f5d87454-bxpdp\" (UID: \"3fe73309-f917-40c4-a606-511f1547daf4\") " pod="openstack-kuttl-tests/placement-77f5d87454-bxpdp" Mar 16 16:15:05 crc kubenswrapper[5120]: I0316 16:15:05.050728 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/3fe73309-f917-40c4-a606-511f1547daf4-public-tls-certs\") pod \"placement-77f5d87454-bxpdp\" (UID: \"3fe73309-f917-40c4-a606-511f1547daf4\") " pod="openstack-kuttl-tests/placement-77f5d87454-bxpdp" Mar 16 16:15:05 crc kubenswrapper[5120]: I0316 16:15:05.050929 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3fe73309-f917-40c4-a606-511f1547daf4-logs\") pod \"placement-77f5d87454-bxpdp\" (UID: \"3fe73309-f917-40c4-a606-511f1547daf4\") " pod="openstack-kuttl-tests/placement-77f5d87454-bxpdp" Mar 16 16:15:05 crc kubenswrapper[5120]: I0316 16:15:05.050961 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3fe73309-f917-40c4-a606-511f1547daf4-config-data\") pod \"placement-77f5d87454-bxpdp\" (UID: \"3fe73309-f917-40c4-a606-511f1547daf4\") " pod="openstack-kuttl-tests/placement-77f5d87454-bxpdp" Mar 16 16:15:05 crc kubenswrapper[5120]: I0316 16:15:05.051519 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3fe73309-f917-40c4-a606-511f1547daf4-logs\") pod \"placement-77f5d87454-bxpdp\" (UID: \"3fe73309-f917-40c4-a606-511f1547daf4\") " pod="openstack-kuttl-tests/placement-77f5d87454-bxpdp" Mar 16 16:15:05 crc kubenswrapper[5120]: I0316 16:15:05.055579 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/3fe73309-f917-40c4-a606-511f1547daf4-public-tls-certs\") pod \"placement-77f5d87454-bxpdp\" (UID: \"3fe73309-f917-40c4-a606-511f1547daf4\") " pod="openstack-kuttl-tests/placement-77f5d87454-bxpdp" Mar 16 16:15:05 crc kubenswrapper[5120]: I0316 16:15:05.056869 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3fe73309-f917-40c4-a606-511f1547daf4-config-data\") pod \"placement-77f5d87454-bxpdp\" (UID: \"3fe73309-f917-40c4-a606-511f1547daf4\") " pod="openstack-kuttl-tests/placement-77f5d87454-bxpdp" Mar 16 16:15:05 crc kubenswrapper[5120]: I0316 16:15:05.057495 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3fe73309-f917-40c4-a606-511f1547daf4-combined-ca-bundle\") pod \"placement-77f5d87454-bxpdp\" (UID: \"3fe73309-f917-40c4-a606-511f1547daf4\") " pod="openstack-kuttl-tests/placement-77f5d87454-bxpdp" Mar 16 16:15:05 crc kubenswrapper[5120]: I0316 16:15:05.057885 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3fe73309-f917-40c4-a606-511f1547daf4-scripts\") pod \"placement-77f5d87454-bxpdp\" (UID: \"3fe73309-f917-40c4-a606-511f1547daf4\") " pod="openstack-kuttl-tests/placement-77f5d87454-bxpdp" Mar 16 16:15:05 crc kubenswrapper[5120]: I0316 16:15:05.059153 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/3fe73309-f917-40c4-a606-511f1547daf4-internal-tls-certs\") pod \"placement-77f5d87454-bxpdp\" (UID: \"3fe73309-f917-40c4-a606-511f1547daf4\") " pod="openstack-kuttl-tests/placement-77f5d87454-bxpdp" Mar 16 16:15:05 crc kubenswrapper[5120]: I0316 16:15:05.068192 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9k7q7\" (UniqueName: \"kubernetes.io/projected/3fe73309-f917-40c4-a606-511f1547daf4-kube-api-access-9k7q7\") pod \"placement-77f5d87454-bxpdp\" (UID: \"3fe73309-f917-40c4-a606-511f1547daf4\") " pod="openstack-kuttl-tests/placement-77f5d87454-bxpdp" Mar 16 16:15:05 crc kubenswrapper[5120]: I0316 16:15:05.535566 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-77f5d87454-bxpdp" Mar 16 16:15:05 crc kubenswrapper[5120]: I0316 16:15:05.616425 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"70767b5f-5971-43c0-99fb-4d927737b789","Type":"ContainerStarted","Data":"08dd2814f009d280e6c62b373c62dcf6383267a43e9efb5d60d30a0d15d517e1"} Mar 16 16:15:05 crc kubenswrapper[5120]: I0316 16:15:05.616704 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:15:05 crc kubenswrapper[5120]: I0316 16:15:05.644424 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.10895252 podStartE2EDuration="6.64438441s" podCreationTimestamp="2026-03-16 16:14:59 +0000 UTC" firstStartedPulling="2026-03-16 16:15:00.367003015 +0000 UTC m=+2602.520934672" lastFinishedPulling="2026-03-16 16:15:04.902434905 +0000 UTC m=+2607.056366562" observedRunningTime="2026-03-16 16:15:05.641689357 +0000 UTC m=+2607.795621034" watchObservedRunningTime="2026-03-16 16:15:05.64438441 +0000 UTC m=+2607.798316077" Mar 16 16:15:06 crc kubenswrapper[5120]: I0316 16:15:06.004972 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-77f5d87454-bxpdp"] Mar 16 16:15:06 crc kubenswrapper[5120]: I0316 16:15:06.633329 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-77f5d87454-bxpdp" event={"ID":"3fe73309-f917-40c4-a606-511f1547daf4","Type":"ContainerStarted","Data":"3c1dc0476ec152189cd9cccaa8817bd8c79eb785cc5a85c7a89fc21e075d9c23"} Mar 16 16:15:06 crc kubenswrapper[5120]: I0316 16:15:06.633880 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-77f5d87454-bxpdp" Mar 16 16:15:06 crc kubenswrapper[5120]: I0316 16:15:06.633897 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-77f5d87454-bxpdp" Mar 16 16:15:06 crc kubenswrapper[5120]: I0316 16:15:06.633908 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-77f5d87454-bxpdp" event={"ID":"3fe73309-f917-40c4-a606-511f1547daf4","Type":"ContainerStarted","Data":"a636602cf9c0f74b67bfffb9ee956a50e5d2bd7168bfc08b70cd6207ef08e4c0"} Mar 16 16:15:06 crc kubenswrapper[5120]: I0316 16:15:06.633917 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-77f5d87454-bxpdp" event={"ID":"3fe73309-f917-40c4-a606-511f1547daf4","Type":"ContainerStarted","Data":"7a9f0951e2ab89eff983b7a8851442bc26d500ea04503047c86877fa3eae66eb"} Mar 16 16:15:06 crc kubenswrapper[5120]: I0316 16:15:06.662986 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-77f5d87454-bxpdp" podStartSLOduration=2.662951177 podStartE2EDuration="2.662951177s" podCreationTimestamp="2026-03-16 16:15:04 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:15:06.656181526 +0000 UTC m=+2608.810113183" watchObservedRunningTime="2026-03-16 16:15:06.662951177 +0000 UTC m=+2608.816882834" Mar 16 16:15:07 crc kubenswrapper[5120]: I0316 16:15:07.334276 5120 scope.go:117] "RemoveContainer" containerID="86f83fca6ab075b38eca89e7c7ced5eb1b4d050e98a0ee12c759951c4731d841" Mar 16 16:15:07 crc kubenswrapper[5120]: I0316 16:15:07.367636 5120 scope.go:117] "RemoveContainer" containerID="b8d4df20eca7354223b17e86bfe07f5dcc7be3fff45ab9861cdabc4513225847" Mar 16 16:15:07 crc kubenswrapper[5120]: I0316 16:15:07.422279 5120 scope.go:117] "RemoveContainer" containerID="f20e53be4930446a7325c8d5f2ec0356ea085590fcee934d4890c0947460f962" Mar 16 16:15:07 crc kubenswrapper[5120]: I0316 16:15:07.454544 5120 scope.go:117] "RemoveContainer" containerID="5813f766891baa0d21ad038919f53549776bb35485e31262155001d6d5ba2fd9" Mar 16 16:15:07 crc kubenswrapper[5120]: I0316 16:15:07.491123 5120 scope.go:117] "RemoveContainer" containerID="dd23bc6bdc8475b15802b3822e2533e7d87c582efa0f5640fb7647f5ae171e0b" Mar 16 16:15:07 crc kubenswrapper[5120]: I0316 16:15:07.545568 5120 scope.go:117] "RemoveContainer" containerID="34480a0ef3a968b5b94e3aef00c1fe143e4c18f8f2076c9099a585f6662cd78a" Mar 16 16:15:07 crc kubenswrapper[5120]: I0316 16:15:07.569069 5120 scope.go:117] "RemoveContainer" containerID="5495fdca7ff98e7d65c6e9fa4a7e7a415f3fe957b30dba968a778b5194847078" Mar 16 16:15:07 crc kubenswrapper[5120]: I0316 16:15:07.611095 5120 scope.go:117] "RemoveContainer" containerID="4a1af8f8ddbcd4d20b7d3b73b0026ade416b5bbb2231196831b5d08f6a06c21c" Mar 16 16:15:07 crc kubenswrapper[5120]: I0316 16:15:07.645789 5120 scope.go:117] "RemoveContainer" containerID="764f38d02b98666d18a8940288b633132283989377d9bb21dbcecb338091ffc3" Mar 16 16:15:08 crc kubenswrapper[5120]: E0316 16:15:08.173258 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1604243 actualBytes=10240 Mar 16 16:15:11 crc kubenswrapper[5120]: I0316 16:15:11.217448 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/keystone-6f9485b564-dlsjq" Mar 16 16:15:14 crc kubenswrapper[5120]: I0316 16:15:14.657683 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/swift-proxy-7c79cc45b-sp9b7"] Mar 16 16:15:14 crc kubenswrapper[5120]: I0316 16:15:14.665239 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-7c79cc45b-sp9b7" Mar 16 16:15:14 crc kubenswrapper[5120]: I0316 16:15:14.673559 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-swift-internal-svc\"" Mar 16 16:15:14 crc kubenswrapper[5120]: I0316 16:15:14.674677 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-swift-public-svc\"" Mar 16 16:15:14 crc kubenswrapper[5120]: I0316 16:15:14.675127 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"swift-proxy-config-data\"" Mar 16 16:15:14 crc kubenswrapper[5120]: I0316 16:15:14.708154 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/c06828a4-039e-4080-a682-0bf5a7aaf9c2-etc-swift\") pod \"swift-proxy-7c79cc45b-sp9b7\" (UID: \"c06828a4-039e-4080-a682-0bf5a7aaf9c2\") " pod="openstack-kuttl-tests/swift-proxy-7c79cc45b-sp9b7" Mar 16 16:15:14 crc kubenswrapper[5120]: I0316 16:15:14.708271 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fx6t6\" (UniqueName: \"kubernetes.io/projected/c06828a4-039e-4080-a682-0bf5a7aaf9c2-kube-api-access-fx6t6\") pod \"swift-proxy-7c79cc45b-sp9b7\" (UID: \"c06828a4-039e-4080-a682-0bf5a7aaf9c2\") " pod="openstack-kuttl-tests/swift-proxy-7c79cc45b-sp9b7" Mar 16 16:15:14 crc kubenswrapper[5120]: I0316 16:15:14.708316 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c06828a4-039e-4080-a682-0bf5a7aaf9c2-combined-ca-bundle\") pod \"swift-proxy-7c79cc45b-sp9b7\" (UID: \"c06828a4-039e-4080-a682-0bf5a7aaf9c2\") " pod="openstack-kuttl-tests/swift-proxy-7c79cc45b-sp9b7" Mar 16 16:15:14 crc kubenswrapper[5120]: I0316 16:15:14.708580 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/c06828a4-039e-4080-a682-0bf5a7aaf9c2-internal-tls-certs\") pod \"swift-proxy-7c79cc45b-sp9b7\" (UID: \"c06828a4-039e-4080-a682-0bf5a7aaf9c2\") " pod="openstack-kuttl-tests/swift-proxy-7c79cc45b-sp9b7" Mar 16 16:15:14 crc kubenswrapper[5120]: I0316 16:15:14.708836 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c06828a4-039e-4080-a682-0bf5a7aaf9c2-run-httpd\") pod \"swift-proxy-7c79cc45b-sp9b7\" (UID: \"c06828a4-039e-4080-a682-0bf5a7aaf9c2\") " pod="openstack-kuttl-tests/swift-proxy-7c79cc45b-sp9b7" Mar 16 16:15:14 crc kubenswrapper[5120]: I0316 16:15:14.710114 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/c06828a4-039e-4080-a682-0bf5a7aaf9c2-public-tls-certs\") pod \"swift-proxy-7c79cc45b-sp9b7\" (UID: \"c06828a4-039e-4080-a682-0bf5a7aaf9c2\") " pod="openstack-kuttl-tests/swift-proxy-7c79cc45b-sp9b7" Mar 16 16:15:14 crc kubenswrapper[5120]: I0316 16:15:14.710250 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c06828a4-039e-4080-a682-0bf5a7aaf9c2-config-data\") pod \"swift-proxy-7c79cc45b-sp9b7\" (UID: \"c06828a4-039e-4080-a682-0bf5a7aaf9c2\") " pod="openstack-kuttl-tests/swift-proxy-7c79cc45b-sp9b7" Mar 16 16:15:14 crc kubenswrapper[5120]: I0316 16:15:14.710381 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c06828a4-039e-4080-a682-0bf5a7aaf9c2-log-httpd\") pod \"swift-proxy-7c79cc45b-sp9b7\" (UID: \"c06828a4-039e-4080-a682-0bf5a7aaf9c2\") " pod="openstack-kuttl-tests/swift-proxy-7c79cc45b-sp9b7" Mar 16 16:15:14 crc kubenswrapper[5120]: I0316 16:15:14.717401 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-proxy-7c79cc45b-sp9b7"] Mar 16 16:15:14 crc kubenswrapper[5120]: I0316 16:15:14.812108 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/c06828a4-039e-4080-a682-0bf5a7aaf9c2-internal-tls-certs\") pod \"swift-proxy-7c79cc45b-sp9b7\" (UID: \"c06828a4-039e-4080-a682-0bf5a7aaf9c2\") " pod="openstack-kuttl-tests/swift-proxy-7c79cc45b-sp9b7" Mar 16 16:15:14 crc kubenswrapper[5120]: I0316 16:15:14.812195 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c06828a4-039e-4080-a682-0bf5a7aaf9c2-run-httpd\") pod \"swift-proxy-7c79cc45b-sp9b7\" (UID: \"c06828a4-039e-4080-a682-0bf5a7aaf9c2\") " pod="openstack-kuttl-tests/swift-proxy-7c79cc45b-sp9b7" Mar 16 16:15:14 crc kubenswrapper[5120]: I0316 16:15:14.812251 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/c06828a4-039e-4080-a682-0bf5a7aaf9c2-public-tls-certs\") pod \"swift-proxy-7c79cc45b-sp9b7\" (UID: \"c06828a4-039e-4080-a682-0bf5a7aaf9c2\") " pod="openstack-kuttl-tests/swift-proxy-7c79cc45b-sp9b7" Mar 16 16:15:14 crc kubenswrapper[5120]: I0316 16:15:14.812277 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c06828a4-039e-4080-a682-0bf5a7aaf9c2-config-data\") pod \"swift-proxy-7c79cc45b-sp9b7\" (UID: \"c06828a4-039e-4080-a682-0bf5a7aaf9c2\") " pod="openstack-kuttl-tests/swift-proxy-7c79cc45b-sp9b7" Mar 16 16:15:14 crc kubenswrapper[5120]: I0316 16:15:14.812300 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c06828a4-039e-4080-a682-0bf5a7aaf9c2-log-httpd\") pod \"swift-proxy-7c79cc45b-sp9b7\" (UID: \"c06828a4-039e-4080-a682-0bf5a7aaf9c2\") " pod="openstack-kuttl-tests/swift-proxy-7c79cc45b-sp9b7" Mar 16 16:15:14 crc kubenswrapper[5120]: I0316 16:15:14.812392 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/c06828a4-039e-4080-a682-0bf5a7aaf9c2-etc-swift\") pod \"swift-proxy-7c79cc45b-sp9b7\" (UID: \"c06828a4-039e-4080-a682-0bf5a7aaf9c2\") " pod="openstack-kuttl-tests/swift-proxy-7c79cc45b-sp9b7" Mar 16 16:15:14 crc kubenswrapper[5120]: I0316 16:15:14.812455 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fx6t6\" (UniqueName: \"kubernetes.io/projected/c06828a4-039e-4080-a682-0bf5a7aaf9c2-kube-api-access-fx6t6\") pod \"swift-proxy-7c79cc45b-sp9b7\" (UID: \"c06828a4-039e-4080-a682-0bf5a7aaf9c2\") " pod="openstack-kuttl-tests/swift-proxy-7c79cc45b-sp9b7" Mar 16 16:15:14 crc kubenswrapper[5120]: I0316 16:15:14.812483 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c06828a4-039e-4080-a682-0bf5a7aaf9c2-combined-ca-bundle\") pod \"swift-proxy-7c79cc45b-sp9b7\" (UID: \"c06828a4-039e-4080-a682-0bf5a7aaf9c2\") " pod="openstack-kuttl-tests/swift-proxy-7c79cc45b-sp9b7" Mar 16 16:15:14 crc kubenswrapper[5120]: I0316 16:15:14.812847 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c06828a4-039e-4080-a682-0bf5a7aaf9c2-run-httpd\") pod \"swift-proxy-7c79cc45b-sp9b7\" (UID: \"c06828a4-039e-4080-a682-0bf5a7aaf9c2\") " pod="openstack-kuttl-tests/swift-proxy-7c79cc45b-sp9b7" Mar 16 16:15:14 crc kubenswrapper[5120]: I0316 16:15:14.813396 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c06828a4-039e-4080-a682-0bf5a7aaf9c2-log-httpd\") pod \"swift-proxy-7c79cc45b-sp9b7\" (UID: \"c06828a4-039e-4080-a682-0bf5a7aaf9c2\") " pod="openstack-kuttl-tests/swift-proxy-7c79cc45b-sp9b7" Mar 16 16:15:14 crc kubenswrapper[5120]: I0316 16:15:14.818475 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c06828a4-039e-4080-a682-0bf5a7aaf9c2-combined-ca-bundle\") pod \"swift-proxy-7c79cc45b-sp9b7\" (UID: \"c06828a4-039e-4080-a682-0bf5a7aaf9c2\") " pod="openstack-kuttl-tests/swift-proxy-7c79cc45b-sp9b7" Mar 16 16:15:14 crc kubenswrapper[5120]: I0316 16:15:14.818855 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/c06828a4-039e-4080-a682-0bf5a7aaf9c2-public-tls-certs\") pod \"swift-proxy-7c79cc45b-sp9b7\" (UID: \"c06828a4-039e-4080-a682-0bf5a7aaf9c2\") " pod="openstack-kuttl-tests/swift-proxy-7c79cc45b-sp9b7" Mar 16 16:15:14 crc kubenswrapper[5120]: I0316 16:15:14.821471 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/c06828a4-039e-4080-a682-0bf5a7aaf9c2-internal-tls-certs\") pod \"swift-proxy-7c79cc45b-sp9b7\" (UID: \"c06828a4-039e-4080-a682-0bf5a7aaf9c2\") " pod="openstack-kuttl-tests/swift-proxy-7c79cc45b-sp9b7" Mar 16 16:15:14 crc kubenswrapper[5120]: I0316 16:15:14.821667 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c06828a4-039e-4080-a682-0bf5a7aaf9c2-config-data\") pod \"swift-proxy-7c79cc45b-sp9b7\" (UID: \"c06828a4-039e-4080-a682-0bf5a7aaf9c2\") " pod="openstack-kuttl-tests/swift-proxy-7c79cc45b-sp9b7" Mar 16 16:15:14 crc kubenswrapper[5120]: I0316 16:15:14.822149 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/c06828a4-039e-4080-a682-0bf5a7aaf9c2-etc-swift\") pod \"swift-proxy-7c79cc45b-sp9b7\" (UID: \"c06828a4-039e-4080-a682-0bf5a7aaf9c2\") " pod="openstack-kuttl-tests/swift-proxy-7c79cc45b-sp9b7" Mar 16 16:15:14 crc kubenswrapper[5120]: I0316 16:15:14.834547 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fx6t6\" (UniqueName: \"kubernetes.io/projected/c06828a4-039e-4080-a682-0bf5a7aaf9c2-kube-api-access-fx6t6\") pod \"swift-proxy-7c79cc45b-sp9b7\" (UID: \"c06828a4-039e-4080-a682-0bf5a7aaf9c2\") " pod="openstack-kuttl-tests/swift-proxy-7c79cc45b-sp9b7" Mar 16 16:15:15 crc kubenswrapper[5120]: I0316 16:15:15.010150 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-7c79cc45b-sp9b7" Mar 16 16:15:15 crc kubenswrapper[5120]: I0316 16:15:15.214102 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/neutron-85457c7f69-x8z6t" Mar 16 16:15:15 crc kubenswrapper[5120]: W0316 16:15:15.562888 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc06828a4_039e_4080_a682_0bf5a7aaf9c2.slice/crio-4761f3928e0d8a4d4f57996ffc9e16e0fdf830eaf56e2dd64b0459206bc31b71 WatchSource:0}: Error finding container 4761f3928e0d8a4d4f57996ffc9e16e0fdf830eaf56e2dd64b0459206bc31b71: Status 404 returned error can't find the container with id 4761f3928e0d8a4d4f57996ffc9e16e0fdf830eaf56e2dd64b0459206bc31b71 Mar 16 16:15:15 crc kubenswrapper[5120]: I0316 16:15:15.564193 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-proxy-7c79cc45b-sp9b7"] Mar 16 16:15:15 crc kubenswrapper[5120]: I0316 16:15:15.745251 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-7c79cc45b-sp9b7" event={"ID":"c06828a4-039e-4080-a682-0bf5a7aaf9c2","Type":"ContainerStarted","Data":"4761f3928e0d8a4d4f57996ffc9e16e0fdf830eaf56e2dd64b0459206bc31b71"} Mar 16 16:15:15 crc kubenswrapper[5120]: I0316 16:15:15.807562 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:15:15 crc kubenswrapper[5120]: I0316 16:15:15.807889 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="70767b5f-5971-43c0-99fb-4d927737b789" containerName="ceilometer-central-agent" containerID="cri-o://93a246d3cb29b6c2d08c7a61f9295bef9ed54107b2387e0ce5345ce9961a64e1" gracePeriod=30 Mar 16 16:15:15 crc kubenswrapper[5120]: I0316 16:15:15.808624 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="70767b5f-5971-43c0-99fb-4d927737b789" containerName="proxy-httpd" containerID="cri-o://08dd2814f009d280e6c62b373c62dcf6383267a43e9efb5d60d30a0d15d517e1" gracePeriod=30 Mar 16 16:15:15 crc kubenswrapper[5120]: I0316 16:15:15.808684 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="70767b5f-5971-43c0-99fb-4d927737b789" containerName="sg-core" containerID="cri-o://1534d4f8f26cde409aea3e1415c7fbc4a13a3158dfc872e75efd4c0e740318d5" gracePeriod=30 Mar 16 16:15:15 crc kubenswrapper[5120]: I0316 16:15:15.808727 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="70767b5f-5971-43c0-99fb-4d927737b789" containerName="ceilometer-notification-agent" containerID="cri-o://c86a759249593cfbabd1d0dd4fcd8f0b6259f6c08f7fa255c64870f14422a53a" gracePeriod=30 Mar 16 16:15:15 crc kubenswrapper[5120]: I0316 16:15:15.817047 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:15:16 crc kubenswrapper[5120]: I0316 16:15:16.227734 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 16:15:16 crc kubenswrapper[5120]: I0316 16:15:16.232853 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Mar 16 16:15:16 crc kubenswrapper[5120]: I0316 16:15:16.235054 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 16:15:16 crc kubenswrapper[5120]: I0316 16:15:16.242882 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2prx\" (UniqueName: \"kubernetes.io/projected/6064cc64-d619-4992-a1f6-b174b05d8ebf-kube-api-access-d2prx\") pod \"openstackclient\" (UID: \"6064cc64-d619-4992-a1f6-b174b05d8ebf\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:15:16 crc kubenswrapper[5120]: I0316 16:15:16.242931 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/6064cc64-d619-4992-a1f6-b174b05d8ebf-openstack-config\") pod \"openstackclient\" (UID: \"6064cc64-d619-4992-a1f6-b174b05d8ebf\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:15:16 crc kubenswrapper[5120]: I0316 16:15:16.243094 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/6064cc64-d619-4992-a1f6-b174b05d8ebf-openstack-config-secret\") pod \"openstackclient\" (UID: \"6064cc64-d619-4992-a1f6-b174b05d8ebf\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:15:16 crc kubenswrapper[5120]: I0316 16:15:16.243230 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6064cc64-d619-4992-a1f6-b174b05d8ebf-combined-ca-bundle\") pod \"openstackclient\" (UID: \"6064cc64-d619-4992-a1f6-b174b05d8ebf\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:15:16 crc kubenswrapper[5120]: I0316 16:15:16.271044 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"openstackclient-openstackclient-dockercfg-9ghjn\"" Mar 16 16:15:16 crc kubenswrapper[5120]: I0316 16:15:16.271300 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"openstack-config-secret\"" Mar 16 16:15:16 crc kubenswrapper[5120]: I0316 16:15:16.271451 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-config\"" Mar 16 16:15:16 crc kubenswrapper[5120]: I0316 16:15:16.345570 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/6064cc64-d619-4992-a1f6-b174b05d8ebf-openstack-config-secret\") pod \"openstackclient\" (UID: \"6064cc64-d619-4992-a1f6-b174b05d8ebf\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:15:16 crc kubenswrapper[5120]: I0316 16:15:16.346085 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6064cc64-d619-4992-a1f6-b174b05d8ebf-combined-ca-bundle\") pod \"openstackclient\" (UID: \"6064cc64-d619-4992-a1f6-b174b05d8ebf\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:15:16 crc kubenswrapper[5120]: I0316 16:15:16.346289 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d2prx\" (UniqueName: \"kubernetes.io/projected/6064cc64-d619-4992-a1f6-b174b05d8ebf-kube-api-access-d2prx\") pod \"openstackclient\" (UID: \"6064cc64-d619-4992-a1f6-b174b05d8ebf\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:15:16 crc kubenswrapper[5120]: I0316 16:15:16.346323 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/6064cc64-d619-4992-a1f6-b174b05d8ebf-openstack-config\") pod \"openstackclient\" (UID: \"6064cc64-d619-4992-a1f6-b174b05d8ebf\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:15:16 crc kubenswrapper[5120]: I0316 16:15:16.347229 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/6064cc64-d619-4992-a1f6-b174b05d8ebf-openstack-config\") pod \"openstackclient\" (UID: \"6064cc64-d619-4992-a1f6-b174b05d8ebf\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:15:16 crc kubenswrapper[5120]: I0316 16:15:16.352662 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/6064cc64-d619-4992-a1f6-b174b05d8ebf-openstack-config-secret\") pod \"openstackclient\" (UID: \"6064cc64-d619-4992-a1f6-b174b05d8ebf\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:15:16 crc kubenswrapper[5120]: I0316 16:15:16.357378 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6064cc64-d619-4992-a1f6-b174b05d8ebf-combined-ca-bundle\") pod \"openstackclient\" (UID: \"6064cc64-d619-4992-a1f6-b174b05d8ebf\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:15:16 crc kubenswrapper[5120]: I0316 16:15:16.363950 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2prx\" (UniqueName: \"kubernetes.io/projected/6064cc64-d619-4992-a1f6-b174b05d8ebf-kube-api-access-d2prx\") pod \"openstackclient\" (UID: \"6064cc64-d619-4992-a1f6-b174b05d8ebf\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:15:16 crc kubenswrapper[5120]: I0316 16:15:16.593266 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:15:16 crc kubenswrapper[5120]: I0316 16:15:16.642906 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Mar 16 16:15:16 crc kubenswrapper[5120]: I0316 16:15:16.651639 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/70767b5f-5971-43c0-99fb-4d927737b789-run-httpd\") pod \"70767b5f-5971-43c0-99fb-4d927737b789\" (UID: \"70767b5f-5971-43c0-99fb-4d927737b789\") " Mar 16 16:15:16 crc kubenswrapper[5120]: I0316 16:15:16.651699 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/70767b5f-5971-43c0-99fb-4d927737b789-sg-core-conf-yaml\") pod \"70767b5f-5971-43c0-99fb-4d927737b789\" (UID: \"70767b5f-5971-43c0-99fb-4d927737b789\") " Mar 16 16:15:16 crc kubenswrapper[5120]: I0316 16:15:16.651753 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/70767b5f-5971-43c0-99fb-4d927737b789-log-httpd\") pod \"70767b5f-5971-43c0-99fb-4d927737b789\" (UID: \"70767b5f-5971-43c0-99fb-4d927737b789\") " Mar 16 16:15:16 crc kubenswrapper[5120]: I0316 16:15:16.651965 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mxftq\" (UniqueName: \"kubernetes.io/projected/70767b5f-5971-43c0-99fb-4d927737b789-kube-api-access-mxftq\") pod \"70767b5f-5971-43c0-99fb-4d927737b789\" (UID: \"70767b5f-5971-43c0-99fb-4d927737b789\") " Mar 16 16:15:16 crc kubenswrapper[5120]: I0316 16:15:16.652098 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/70767b5f-5971-43c0-99fb-4d927737b789-config-data\") pod \"70767b5f-5971-43c0-99fb-4d927737b789\" (UID: \"70767b5f-5971-43c0-99fb-4d927737b789\") " Mar 16 16:15:16 crc kubenswrapper[5120]: I0316 16:15:16.652165 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/70767b5f-5971-43c0-99fb-4d927737b789-scripts\") pod \"70767b5f-5971-43c0-99fb-4d927737b789\" (UID: \"70767b5f-5971-43c0-99fb-4d927737b789\") " Mar 16 16:15:16 crc kubenswrapper[5120]: I0316 16:15:16.652254 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/70767b5f-5971-43c0-99fb-4d927737b789-combined-ca-bundle\") pod \"70767b5f-5971-43c0-99fb-4d927737b789\" (UID: \"70767b5f-5971-43c0-99fb-4d927737b789\") " Mar 16 16:15:16 crc kubenswrapper[5120]: I0316 16:15:16.657576 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70767b5f-5971-43c0-99fb-4d927737b789-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "70767b5f-5971-43c0-99fb-4d927737b789" (UID: "70767b5f-5971-43c0-99fb-4d927737b789"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:15:16 crc kubenswrapper[5120]: I0316 16:15:16.661542 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/70767b5f-5971-43c0-99fb-4d927737b789-scripts" (OuterVolumeSpecName: "scripts") pod "70767b5f-5971-43c0-99fb-4d927737b789" (UID: "70767b5f-5971-43c0-99fb-4d927737b789"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:15:16 crc kubenswrapper[5120]: I0316 16:15:16.661701 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70767b5f-5971-43c0-99fb-4d927737b789-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "70767b5f-5971-43c0-99fb-4d927737b789" (UID: "70767b5f-5971-43c0-99fb-4d927737b789"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:15:16 crc kubenswrapper[5120]: I0316 16:15:16.697361 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70767b5f-5971-43c0-99fb-4d927737b789-kube-api-access-mxftq" (OuterVolumeSpecName: "kube-api-access-mxftq") pod "70767b5f-5971-43c0-99fb-4d927737b789" (UID: "70767b5f-5971-43c0-99fb-4d927737b789"). InnerVolumeSpecName "kube-api-access-mxftq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:15:16 crc kubenswrapper[5120]: I0316 16:15:16.718734 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/70767b5f-5971-43c0-99fb-4d927737b789-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "70767b5f-5971-43c0-99fb-4d927737b789" (UID: "70767b5f-5971-43c0-99fb-4d927737b789"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:15:16 crc kubenswrapper[5120]: I0316 16:15:16.754859 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/70767b5f-5971-43c0-99fb-4d927737b789-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:15:16 crc kubenswrapper[5120]: I0316 16:15:16.754888 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/70767b5f-5971-43c0-99fb-4d927737b789-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:15:16 crc kubenswrapper[5120]: I0316 16:15:16.754899 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/70767b5f-5971-43c0-99fb-4d927737b789-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 16:15:16 crc kubenswrapper[5120]: I0316 16:15:16.754908 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/70767b5f-5971-43c0-99fb-4d927737b789-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:15:16 crc kubenswrapper[5120]: I0316 16:15:16.754917 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mxftq\" (UniqueName: \"kubernetes.io/projected/70767b5f-5971-43c0-99fb-4d927737b789-kube-api-access-mxftq\") on node \"crc\" DevicePath \"\"" Mar 16 16:15:16 crc kubenswrapper[5120]: I0316 16:15:16.765710 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-7c79cc45b-sp9b7" event={"ID":"c06828a4-039e-4080-a682-0bf5a7aaf9c2","Type":"ContainerStarted","Data":"b95fea81e244713a6300e6ead4faf992fc23c53c8f23c0486269773f1cf284c5"} Mar 16 16:15:16 crc kubenswrapper[5120]: I0316 16:15:16.765768 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-7c79cc45b-sp9b7" event={"ID":"c06828a4-039e-4080-a682-0bf5a7aaf9c2","Type":"ContainerStarted","Data":"d7fad27bd78b15e804b67e664c292c55fa7faee0c6fb07e878bcb9e536052264"} Mar 16 16:15:16 crc kubenswrapper[5120]: I0316 16:15:16.767272 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/swift-proxy-7c79cc45b-sp9b7" Mar 16 16:15:16 crc kubenswrapper[5120]: I0316 16:15:16.767475 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/swift-proxy-7c79cc45b-sp9b7" Mar 16 16:15:16 crc kubenswrapper[5120]: I0316 16:15:16.771350 5120 generic.go:358] "Generic (PLEG): container finished" podID="70767b5f-5971-43c0-99fb-4d927737b789" containerID="08dd2814f009d280e6c62b373c62dcf6383267a43e9efb5d60d30a0d15d517e1" exitCode=0 Mar 16 16:15:16 crc kubenswrapper[5120]: I0316 16:15:16.771374 5120 generic.go:358] "Generic (PLEG): container finished" podID="70767b5f-5971-43c0-99fb-4d927737b789" containerID="1534d4f8f26cde409aea3e1415c7fbc4a13a3158dfc872e75efd4c0e740318d5" exitCode=2 Mar 16 16:15:16 crc kubenswrapper[5120]: I0316 16:15:16.771383 5120 generic.go:358] "Generic (PLEG): container finished" podID="70767b5f-5971-43c0-99fb-4d927737b789" containerID="c86a759249593cfbabd1d0dd4fcd8f0b6259f6c08f7fa255c64870f14422a53a" exitCode=0 Mar 16 16:15:16 crc kubenswrapper[5120]: I0316 16:15:16.771388 5120 generic.go:358] "Generic (PLEG): container finished" podID="70767b5f-5971-43c0-99fb-4d927737b789" containerID="93a246d3cb29b6c2d08c7a61f9295bef9ed54107b2387e0ce5345ce9961a64e1" exitCode=0 Mar 16 16:15:16 crc kubenswrapper[5120]: I0316 16:15:16.771536 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"70767b5f-5971-43c0-99fb-4d927737b789","Type":"ContainerDied","Data":"08dd2814f009d280e6c62b373c62dcf6383267a43e9efb5d60d30a0d15d517e1"} Mar 16 16:15:16 crc kubenswrapper[5120]: I0316 16:15:16.771560 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"70767b5f-5971-43c0-99fb-4d927737b789","Type":"ContainerDied","Data":"1534d4f8f26cde409aea3e1415c7fbc4a13a3158dfc872e75efd4c0e740318d5"} Mar 16 16:15:16 crc kubenswrapper[5120]: I0316 16:15:16.771570 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"70767b5f-5971-43c0-99fb-4d927737b789","Type":"ContainerDied","Data":"c86a759249593cfbabd1d0dd4fcd8f0b6259f6c08f7fa255c64870f14422a53a"} Mar 16 16:15:16 crc kubenswrapper[5120]: I0316 16:15:16.771578 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"70767b5f-5971-43c0-99fb-4d927737b789","Type":"ContainerDied","Data":"93a246d3cb29b6c2d08c7a61f9295bef9ed54107b2387e0ce5345ce9961a64e1"} Mar 16 16:15:16 crc kubenswrapper[5120]: I0316 16:15:16.771586 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"70767b5f-5971-43c0-99fb-4d927737b789","Type":"ContainerDied","Data":"ac799d8dbabc52c82c4f803d916a36a5619f8c78baec45d13ffac28851553225"} Mar 16 16:15:16 crc kubenswrapper[5120]: I0316 16:15:16.771600 5120 scope.go:117] "RemoveContainer" containerID="08dd2814f009d280e6c62b373c62dcf6383267a43e9efb5d60d30a0d15d517e1" Mar 16 16:15:16 crc kubenswrapper[5120]: I0316 16:15:16.771771 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:15:16 crc kubenswrapper[5120]: I0316 16:15:16.801211 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/swift-proxy-7c79cc45b-sp9b7" podStartSLOduration=2.801192982 podStartE2EDuration="2.801192982s" podCreationTimestamp="2026-03-16 16:15:14 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:15:16.787470414 +0000 UTC m=+2618.941402071" watchObservedRunningTime="2026-03-16 16:15:16.801192982 +0000 UTC m=+2618.955124639" Mar 16 16:15:16 crc kubenswrapper[5120]: I0316 16:15:16.802886 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/70767b5f-5971-43c0-99fb-4d927737b789-config-data" (OuterVolumeSpecName: "config-data") pod "70767b5f-5971-43c0-99fb-4d927737b789" (UID: "70767b5f-5971-43c0-99fb-4d927737b789"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:15:16 crc kubenswrapper[5120]: I0316 16:15:16.803309 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/70767b5f-5971-43c0-99fb-4d927737b789-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "70767b5f-5971-43c0-99fb-4d927737b789" (UID: "70767b5f-5971-43c0-99fb-4d927737b789"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:15:16 crc kubenswrapper[5120]: I0316 16:15:16.819295 5120 scope.go:117] "RemoveContainer" containerID="1534d4f8f26cde409aea3e1415c7fbc4a13a3158dfc872e75efd4c0e740318d5" Mar 16 16:15:16 crc kubenswrapper[5120]: I0316 16:15:16.857972 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/70767b5f-5971-43c0-99fb-4d927737b789-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:15:16 crc kubenswrapper[5120]: I0316 16:15:16.858013 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/70767b5f-5971-43c0-99fb-4d927737b789-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:15:16 crc kubenswrapper[5120]: I0316 16:15:16.900040 5120 scope.go:117] "RemoveContainer" containerID="c86a759249593cfbabd1d0dd4fcd8f0b6259f6c08f7fa255c64870f14422a53a" Mar 16 16:15:16 crc kubenswrapper[5120]: I0316 16:15:16.932666 5120 scope.go:117] "RemoveContainer" containerID="93a246d3cb29b6c2d08c7a61f9295bef9ed54107b2387e0ce5345ce9961a64e1" Mar 16 16:15:16 crc kubenswrapper[5120]: I0316 16:15:16.953415 5120 scope.go:117] "RemoveContainer" containerID="08dd2814f009d280e6c62b373c62dcf6383267a43e9efb5d60d30a0d15d517e1" Mar 16 16:15:16 crc kubenswrapper[5120]: E0316 16:15:16.953998 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"08dd2814f009d280e6c62b373c62dcf6383267a43e9efb5d60d30a0d15d517e1\": container with ID starting with 08dd2814f009d280e6c62b373c62dcf6383267a43e9efb5d60d30a0d15d517e1 not found: ID does not exist" containerID="08dd2814f009d280e6c62b373c62dcf6383267a43e9efb5d60d30a0d15d517e1" Mar 16 16:15:16 crc kubenswrapper[5120]: I0316 16:15:16.954046 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08dd2814f009d280e6c62b373c62dcf6383267a43e9efb5d60d30a0d15d517e1"} err="failed to get container status \"08dd2814f009d280e6c62b373c62dcf6383267a43e9efb5d60d30a0d15d517e1\": rpc error: code = NotFound desc = could not find container \"08dd2814f009d280e6c62b373c62dcf6383267a43e9efb5d60d30a0d15d517e1\": container with ID starting with 08dd2814f009d280e6c62b373c62dcf6383267a43e9efb5d60d30a0d15d517e1 not found: ID does not exist" Mar 16 16:15:16 crc kubenswrapper[5120]: I0316 16:15:16.954065 5120 scope.go:117] "RemoveContainer" containerID="1534d4f8f26cde409aea3e1415c7fbc4a13a3158dfc872e75efd4c0e740318d5" Mar 16 16:15:16 crc kubenswrapper[5120]: E0316 16:15:16.954561 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1534d4f8f26cde409aea3e1415c7fbc4a13a3158dfc872e75efd4c0e740318d5\": container with ID starting with 1534d4f8f26cde409aea3e1415c7fbc4a13a3158dfc872e75efd4c0e740318d5 not found: ID does not exist" containerID="1534d4f8f26cde409aea3e1415c7fbc4a13a3158dfc872e75efd4c0e740318d5" Mar 16 16:15:16 crc kubenswrapper[5120]: I0316 16:15:16.954582 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1534d4f8f26cde409aea3e1415c7fbc4a13a3158dfc872e75efd4c0e740318d5"} err="failed to get container status \"1534d4f8f26cde409aea3e1415c7fbc4a13a3158dfc872e75efd4c0e740318d5\": rpc error: code = NotFound desc = could not find container \"1534d4f8f26cde409aea3e1415c7fbc4a13a3158dfc872e75efd4c0e740318d5\": container with ID starting with 1534d4f8f26cde409aea3e1415c7fbc4a13a3158dfc872e75efd4c0e740318d5 not found: ID does not exist" Mar 16 16:15:16 crc kubenswrapper[5120]: I0316 16:15:16.954594 5120 scope.go:117] "RemoveContainer" containerID="c86a759249593cfbabd1d0dd4fcd8f0b6259f6c08f7fa255c64870f14422a53a" Mar 16 16:15:16 crc kubenswrapper[5120]: E0316 16:15:16.955027 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c86a759249593cfbabd1d0dd4fcd8f0b6259f6c08f7fa255c64870f14422a53a\": container with ID starting with c86a759249593cfbabd1d0dd4fcd8f0b6259f6c08f7fa255c64870f14422a53a not found: ID does not exist" containerID="c86a759249593cfbabd1d0dd4fcd8f0b6259f6c08f7fa255c64870f14422a53a" Mar 16 16:15:16 crc kubenswrapper[5120]: I0316 16:15:16.955044 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c86a759249593cfbabd1d0dd4fcd8f0b6259f6c08f7fa255c64870f14422a53a"} err="failed to get container status \"c86a759249593cfbabd1d0dd4fcd8f0b6259f6c08f7fa255c64870f14422a53a\": rpc error: code = NotFound desc = could not find container \"c86a759249593cfbabd1d0dd4fcd8f0b6259f6c08f7fa255c64870f14422a53a\": container with ID starting with c86a759249593cfbabd1d0dd4fcd8f0b6259f6c08f7fa255c64870f14422a53a not found: ID does not exist" Mar 16 16:15:16 crc kubenswrapper[5120]: I0316 16:15:16.955055 5120 scope.go:117] "RemoveContainer" containerID="93a246d3cb29b6c2d08c7a61f9295bef9ed54107b2387e0ce5345ce9961a64e1" Mar 16 16:15:16 crc kubenswrapper[5120]: E0316 16:15:16.955432 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93a246d3cb29b6c2d08c7a61f9295bef9ed54107b2387e0ce5345ce9961a64e1\": container with ID starting with 93a246d3cb29b6c2d08c7a61f9295bef9ed54107b2387e0ce5345ce9961a64e1 not found: ID does not exist" containerID="93a246d3cb29b6c2d08c7a61f9295bef9ed54107b2387e0ce5345ce9961a64e1" Mar 16 16:15:16 crc kubenswrapper[5120]: I0316 16:15:16.955449 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93a246d3cb29b6c2d08c7a61f9295bef9ed54107b2387e0ce5345ce9961a64e1"} err="failed to get container status \"93a246d3cb29b6c2d08c7a61f9295bef9ed54107b2387e0ce5345ce9961a64e1\": rpc error: code = NotFound desc = could not find container \"93a246d3cb29b6c2d08c7a61f9295bef9ed54107b2387e0ce5345ce9961a64e1\": container with ID starting with 93a246d3cb29b6c2d08c7a61f9295bef9ed54107b2387e0ce5345ce9961a64e1 not found: ID does not exist" Mar 16 16:15:16 crc kubenswrapper[5120]: I0316 16:15:16.955475 5120 scope.go:117] "RemoveContainer" containerID="08dd2814f009d280e6c62b373c62dcf6383267a43e9efb5d60d30a0d15d517e1" Mar 16 16:15:16 crc kubenswrapper[5120]: I0316 16:15:16.955662 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08dd2814f009d280e6c62b373c62dcf6383267a43e9efb5d60d30a0d15d517e1"} err="failed to get container status \"08dd2814f009d280e6c62b373c62dcf6383267a43e9efb5d60d30a0d15d517e1\": rpc error: code = NotFound desc = could not find container \"08dd2814f009d280e6c62b373c62dcf6383267a43e9efb5d60d30a0d15d517e1\": container with ID starting with 08dd2814f009d280e6c62b373c62dcf6383267a43e9efb5d60d30a0d15d517e1 not found: ID does not exist" Mar 16 16:15:16 crc kubenswrapper[5120]: I0316 16:15:16.955676 5120 scope.go:117] "RemoveContainer" containerID="1534d4f8f26cde409aea3e1415c7fbc4a13a3158dfc872e75efd4c0e740318d5" Mar 16 16:15:16 crc kubenswrapper[5120]: I0316 16:15:16.955865 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1534d4f8f26cde409aea3e1415c7fbc4a13a3158dfc872e75efd4c0e740318d5"} err="failed to get container status \"1534d4f8f26cde409aea3e1415c7fbc4a13a3158dfc872e75efd4c0e740318d5\": rpc error: code = NotFound desc = could not find container \"1534d4f8f26cde409aea3e1415c7fbc4a13a3158dfc872e75efd4c0e740318d5\": container with ID starting with 1534d4f8f26cde409aea3e1415c7fbc4a13a3158dfc872e75efd4c0e740318d5 not found: ID does not exist" Mar 16 16:15:16 crc kubenswrapper[5120]: I0316 16:15:16.955879 5120 scope.go:117] "RemoveContainer" containerID="c86a759249593cfbabd1d0dd4fcd8f0b6259f6c08f7fa255c64870f14422a53a" Mar 16 16:15:16 crc kubenswrapper[5120]: I0316 16:15:16.956174 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c86a759249593cfbabd1d0dd4fcd8f0b6259f6c08f7fa255c64870f14422a53a"} err="failed to get container status \"c86a759249593cfbabd1d0dd4fcd8f0b6259f6c08f7fa255c64870f14422a53a\": rpc error: code = NotFound desc = could not find container \"c86a759249593cfbabd1d0dd4fcd8f0b6259f6c08f7fa255c64870f14422a53a\": container with ID starting with c86a759249593cfbabd1d0dd4fcd8f0b6259f6c08f7fa255c64870f14422a53a not found: ID does not exist" Mar 16 16:15:16 crc kubenswrapper[5120]: I0316 16:15:16.956189 5120 scope.go:117] "RemoveContainer" containerID="93a246d3cb29b6c2d08c7a61f9295bef9ed54107b2387e0ce5345ce9961a64e1" Mar 16 16:15:16 crc kubenswrapper[5120]: I0316 16:15:16.956489 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93a246d3cb29b6c2d08c7a61f9295bef9ed54107b2387e0ce5345ce9961a64e1"} err="failed to get container status \"93a246d3cb29b6c2d08c7a61f9295bef9ed54107b2387e0ce5345ce9961a64e1\": rpc error: code = NotFound desc = could not find container \"93a246d3cb29b6c2d08c7a61f9295bef9ed54107b2387e0ce5345ce9961a64e1\": container with ID starting with 93a246d3cb29b6c2d08c7a61f9295bef9ed54107b2387e0ce5345ce9961a64e1 not found: ID does not exist" Mar 16 16:15:16 crc kubenswrapper[5120]: I0316 16:15:16.956503 5120 scope.go:117] "RemoveContainer" containerID="08dd2814f009d280e6c62b373c62dcf6383267a43e9efb5d60d30a0d15d517e1" Mar 16 16:15:16 crc kubenswrapper[5120]: I0316 16:15:16.956811 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08dd2814f009d280e6c62b373c62dcf6383267a43e9efb5d60d30a0d15d517e1"} err="failed to get container status \"08dd2814f009d280e6c62b373c62dcf6383267a43e9efb5d60d30a0d15d517e1\": rpc error: code = NotFound desc = could not find container \"08dd2814f009d280e6c62b373c62dcf6383267a43e9efb5d60d30a0d15d517e1\": container with ID starting with 08dd2814f009d280e6c62b373c62dcf6383267a43e9efb5d60d30a0d15d517e1 not found: ID does not exist" Mar 16 16:15:16 crc kubenswrapper[5120]: I0316 16:15:16.956827 5120 scope.go:117] "RemoveContainer" containerID="1534d4f8f26cde409aea3e1415c7fbc4a13a3158dfc872e75efd4c0e740318d5" Mar 16 16:15:16 crc kubenswrapper[5120]: I0316 16:15:16.957070 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1534d4f8f26cde409aea3e1415c7fbc4a13a3158dfc872e75efd4c0e740318d5"} err="failed to get container status \"1534d4f8f26cde409aea3e1415c7fbc4a13a3158dfc872e75efd4c0e740318d5\": rpc error: code = NotFound desc = could not find container \"1534d4f8f26cde409aea3e1415c7fbc4a13a3158dfc872e75efd4c0e740318d5\": container with ID starting with 1534d4f8f26cde409aea3e1415c7fbc4a13a3158dfc872e75efd4c0e740318d5 not found: ID does not exist" Mar 16 16:15:16 crc kubenswrapper[5120]: I0316 16:15:16.957099 5120 scope.go:117] "RemoveContainer" containerID="c86a759249593cfbabd1d0dd4fcd8f0b6259f6c08f7fa255c64870f14422a53a" Mar 16 16:15:16 crc kubenswrapper[5120]: I0316 16:15:16.957346 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c86a759249593cfbabd1d0dd4fcd8f0b6259f6c08f7fa255c64870f14422a53a"} err="failed to get container status \"c86a759249593cfbabd1d0dd4fcd8f0b6259f6c08f7fa255c64870f14422a53a\": rpc error: code = NotFound desc = could not find container \"c86a759249593cfbabd1d0dd4fcd8f0b6259f6c08f7fa255c64870f14422a53a\": container with ID starting with c86a759249593cfbabd1d0dd4fcd8f0b6259f6c08f7fa255c64870f14422a53a not found: ID does not exist" Mar 16 16:15:16 crc kubenswrapper[5120]: I0316 16:15:16.957361 5120 scope.go:117] "RemoveContainer" containerID="93a246d3cb29b6c2d08c7a61f9295bef9ed54107b2387e0ce5345ce9961a64e1" Mar 16 16:15:16 crc kubenswrapper[5120]: I0316 16:15:16.957647 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93a246d3cb29b6c2d08c7a61f9295bef9ed54107b2387e0ce5345ce9961a64e1"} err="failed to get container status \"93a246d3cb29b6c2d08c7a61f9295bef9ed54107b2387e0ce5345ce9961a64e1\": rpc error: code = NotFound desc = could not find container \"93a246d3cb29b6c2d08c7a61f9295bef9ed54107b2387e0ce5345ce9961a64e1\": container with ID starting with 93a246d3cb29b6c2d08c7a61f9295bef9ed54107b2387e0ce5345ce9961a64e1 not found: ID does not exist" Mar 16 16:15:16 crc kubenswrapper[5120]: I0316 16:15:16.957659 5120 scope.go:117] "RemoveContainer" containerID="08dd2814f009d280e6c62b373c62dcf6383267a43e9efb5d60d30a0d15d517e1" Mar 16 16:15:16 crc kubenswrapper[5120]: I0316 16:15:16.957877 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08dd2814f009d280e6c62b373c62dcf6383267a43e9efb5d60d30a0d15d517e1"} err="failed to get container status \"08dd2814f009d280e6c62b373c62dcf6383267a43e9efb5d60d30a0d15d517e1\": rpc error: code = NotFound desc = could not find container \"08dd2814f009d280e6c62b373c62dcf6383267a43e9efb5d60d30a0d15d517e1\": container with ID starting with 08dd2814f009d280e6c62b373c62dcf6383267a43e9efb5d60d30a0d15d517e1 not found: ID does not exist" Mar 16 16:15:16 crc kubenswrapper[5120]: I0316 16:15:16.957892 5120 scope.go:117] "RemoveContainer" containerID="1534d4f8f26cde409aea3e1415c7fbc4a13a3158dfc872e75efd4c0e740318d5" Mar 16 16:15:16 crc kubenswrapper[5120]: I0316 16:15:16.958174 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1534d4f8f26cde409aea3e1415c7fbc4a13a3158dfc872e75efd4c0e740318d5"} err="failed to get container status \"1534d4f8f26cde409aea3e1415c7fbc4a13a3158dfc872e75efd4c0e740318d5\": rpc error: code = NotFound desc = could not find container \"1534d4f8f26cde409aea3e1415c7fbc4a13a3158dfc872e75efd4c0e740318d5\": container with ID starting with 1534d4f8f26cde409aea3e1415c7fbc4a13a3158dfc872e75efd4c0e740318d5 not found: ID does not exist" Mar 16 16:15:16 crc kubenswrapper[5120]: I0316 16:15:16.958188 5120 scope.go:117] "RemoveContainer" containerID="c86a759249593cfbabd1d0dd4fcd8f0b6259f6c08f7fa255c64870f14422a53a" Mar 16 16:15:16 crc kubenswrapper[5120]: I0316 16:15:16.958416 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c86a759249593cfbabd1d0dd4fcd8f0b6259f6c08f7fa255c64870f14422a53a"} err="failed to get container status \"c86a759249593cfbabd1d0dd4fcd8f0b6259f6c08f7fa255c64870f14422a53a\": rpc error: code = NotFound desc = could not find container \"c86a759249593cfbabd1d0dd4fcd8f0b6259f6c08f7fa255c64870f14422a53a\": container with ID starting with c86a759249593cfbabd1d0dd4fcd8f0b6259f6c08f7fa255c64870f14422a53a not found: ID does not exist" Mar 16 16:15:16 crc kubenswrapper[5120]: I0316 16:15:16.958431 5120 scope.go:117] "RemoveContainer" containerID="93a246d3cb29b6c2d08c7a61f9295bef9ed54107b2387e0ce5345ce9961a64e1" Mar 16 16:15:16 crc kubenswrapper[5120]: I0316 16:15:16.958629 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93a246d3cb29b6c2d08c7a61f9295bef9ed54107b2387e0ce5345ce9961a64e1"} err="failed to get container status \"93a246d3cb29b6c2d08c7a61f9295bef9ed54107b2387e0ce5345ce9961a64e1\": rpc error: code = NotFound desc = could not find container \"93a246d3cb29b6c2d08c7a61f9295bef9ed54107b2387e0ce5345ce9961a64e1\": container with ID starting with 93a246d3cb29b6c2d08c7a61f9295bef9ed54107b2387e0ce5345ce9961a64e1 not found: ID does not exist" Mar 16 16:15:17 crc kubenswrapper[5120]: I0316 16:15:17.117939 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:15:17 crc kubenswrapper[5120]: I0316 16:15:17.129457 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:15:17 crc kubenswrapper[5120]: I0316 16:15:17.148026 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:15:17 crc kubenswrapper[5120]: I0316 16:15:17.149037 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70767b5f-5971-43c0-99fb-4d927737b789" containerName="proxy-httpd" Mar 16 16:15:17 crc kubenswrapper[5120]: I0316 16:15:17.149054 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="70767b5f-5971-43c0-99fb-4d927737b789" containerName="proxy-httpd" Mar 16 16:15:17 crc kubenswrapper[5120]: I0316 16:15:17.149085 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70767b5f-5971-43c0-99fb-4d927737b789" containerName="sg-core" Mar 16 16:15:17 crc kubenswrapper[5120]: I0316 16:15:17.149092 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="70767b5f-5971-43c0-99fb-4d927737b789" containerName="sg-core" Mar 16 16:15:17 crc kubenswrapper[5120]: I0316 16:15:17.149112 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70767b5f-5971-43c0-99fb-4d927737b789" containerName="ceilometer-notification-agent" Mar 16 16:15:17 crc kubenswrapper[5120]: I0316 16:15:17.149118 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="70767b5f-5971-43c0-99fb-4d927737b789" containerName="ceilometer-notification-agent" Mar 16 16:15:17 crc kubenswrapper[5120]: I0316 16:15:17.149131 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70767b5f-5971-43c0-99fb-4d927737b789" containerName="ceilometer-central-agent" Mar 16 16:15:17 crc kubenswrapper[5120]: I0316 16:15:17.149139 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="70767b5f-5971-43c0-99fb-4d927737b789" containerName="ceilometer-central-agent" Mar 16 16:15:17 crc kubenswrapper[5120]: I0316 16:15:17.149299 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="70767b5f-5971-43c0-99fb-4d927737b789" containerName="proxy-httpd" Mar 16 16:15:17 crc kubenswrapper[5120]: I0316 16:15:17.149310 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="70767b5f-5971-43c0-99fb-4d927737b789" containerName="ceilometer-central-agent" Mar 16 16:15:17 crc kubenswrapper[5120]: I0316 16:15:17.149318 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="70767b5f-5971-43c0-99fb-4d927737b789" containerName="sg-core" Mar 16 16:15:17 crc kubenswrapper[5120]: I0316 16:15:17.149337 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="70767b5f-5971-43c0-99fb-4d927737b789" containerName="ceilometer-notification-agent" Mar 16 16:15:17 crc kubenswrapper[5120]: I0316 16:15:17.156697 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 16:15:17 crc kubenswrapper[5120]: I0316 16:15:17.156802 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:15:17 crc kubenswrapper[5120]: I0316 16:15:17.169816 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 16:15:17 crc kubenswrapper[5120]: I0316 16:15:17.170071 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:15:17 crc kubenswrapper[5120]: I0316 16:15:17.170208 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 16:15:17 crc kubenswrapper[5120]: I0316 16:15:17.284956 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/368fe1ce-e63a-4939-8bc3-4739e34c3ad9-scripts\") pod \"ceilometer-0\" (UID: \"368fe1ce-e63a-4939-8bc3-4739e34c3ad9\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:15:17 crc kubenswrapper[5120]: I0316 16:15:17.285140 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/368fe1ce-e63a-4939-8bc3-4739e34c3ad9-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"368fe1ce-e63a-4939-8bc3-4739e34c3ad9\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:15:17 crc kubenswrapper[5120]: I0316 16:15:17.285183 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/368fe1ce-e63a-4939-8bc3-4739e34c3ad9-run-httpd\") pod \"ceilometer-0\" (UID: \"368fe1ce-e63a-4939-8bc3-4739e34c3ad9\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:15:17 crc kubenswrapper[5120]: I0316 16:15:17.285208 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/368fe1ce-e63a-4939-8bc3-4739e34c3ad9-log-httpd\") pod \"ceilometer-0\" (UID: \"368fe1ce-e63a-4939-8bc3-4739e34c3ad9\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:15:17 crc kubenswrapper[5120]: I0316 16:15:17.285229 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/368fe1ce-e63a-4939-8bc3-4739e34c3ad9-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"368fe1ce-e63a-4939-8bc3-4739e34c3ad9\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:15:17 crc kubenswrapper[5120]: I0316 16:15:17.285268 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftdsr\" (UniqueName: \"kubernetes.io/projected/368fe1ce-e63a-4939-8bc3-4739e34c3ad9-kube-api-access-ftdsr\") pod \"ceilometer-0\" (UID: \"368fe1ce-e63a-4939-8bc3-4739e34c3ad9\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:15:17 crc kubenswrapper[5120]: I0316 16:15:17.285299 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/368fe1ce-e63a-4939-8bc3-4739e34c3ad9-config-data\") pod \"ceilometer-0\" (UID: \"368fe1ce-e63a-4939-8bc3-4739e34c3ad9\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:15:17 crc kubenswrapper[5120]: I0316 16:15:17.299295 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/neutron-d8b74df76-z7648" Mar 16 16:15:17 crc kubenswrapper[5120]: I0316 16:15:17.394247 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/368fe1ce-e63a-4939-8bc3-4739e34c3ad9-log-httpd\") pod \"ceilometer-0\" (UID: \"368fe1ce-e63a-4939-8bc3-4739e34c3ad9\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:15:17 crc kubenswrapper[5120]: I0316 16:15:17.403946 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/368fe1ce-e63a-4939-8bc3-4739e34c3ad9-log-httpd\") pod \"ceilometer-0\" (UID: \"368fe1ce-e63a-4939-8bc3-4739e34c3ad9\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:15:17 crc kubenswrapper[5120]: I0316 16:15:17.404074 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/368fe1ce-e63a-4939-8bc3-4739e34c3ad9-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"368fe1ce-e63a-4939-8bc3-4739e34c3ad9\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:15:17 crc kubenswrapper[5120]: I0316 16:15:17.404155 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ftdsr\" (UniqueName: \"kubernetes.io/projected/368fe1ce-e63a-4939-8bc3-4739e34c3ad9-kube-api-access-ftdsr\") pod \"ceilometer-0\" (UID: \"368fe1ce-e63a-4939-8bc3-4739e34c3ad9\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:15:17 crc kubenswrapper[5120]: I0316 16:15:17.404212 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/368fe1ce-e63a-4939-8bc3-4739e34c3ad9-config-data\") pod \"ceilometer-0\" (UID: \"368fe1ce-e63a-4939-8bc3-4739e34c3ad9\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:15:17 crc kubenswrapper[5120]: I0316 16:15:17.404306 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/368fe1ce-e63a-4939-8bc3-4739e34c3ad9-scripts\") pod \"ceilometer-0\" (UID: \"368fe1ce-e63a-4939-8bc3-4739e34c3ad9\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:15:17 crc kubenswrapper[5120]: I0316 16:15:17.404668 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/368fe1ce-e63a-4939-8bc3-4739e34c3ad9-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"368fe1ce-e63a-4939-8bc3-4739e34c3ad9\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:15:17 crc kubenswrapper[5120]: I0316 16:15:17.404747 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/368fe1ce-e63a-4939-8bc3-4739e34c3ad9-run-httpd\") pod \"ceilometer-0\" (UID: \"368fe1ce-e63a-4939-8bc3-4739e34c3ad9\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:15:17 crc kubenswrapper[5120]: I0316 16:15:17.405490 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/368fe1ce-e63a-4939-8bc3-4739e34c3ad9-run-httpd\") pod \"ceilometer-0\" (UID: \"368fe1ce-e63a-4939-8bc3-4739e34c3ad9\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:15:17 crc kubenswrapper[5120]: I0316 16:15:17.424491 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/368fe1ce-e63a-4939-8bc3-4739e34c3ad9-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"368fe1ce-e63a-4939-8bc3-4739e34c3ad9\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:15:17 crc kubenswrapper[5120]: I0316 16:15:17.432162 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/368fe1ce-e63a-4939-8bc3-4739e34c3ad9-config-data\") pod \"ceilometer-0\" (UID: \"368fe1ce-e63a-4939-8bc3-4739e34c3ad9\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:15:17 crc kubenswrapper[5120]: I0316 16:15:17.435426 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/368fe1ce-e63a-4939-8bc3-4739e34c3ad9-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"368fe1ce-e63a-4939-8bc3-4739e34c3ad9\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:15:17 crc kubenswrapper[5120]: I0316 16:15:17.453461 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/368fe1ce-e63a-4939-8bc3-4739e34c3ad9-scripts\") pod \"ceilometer-0\" (UID: \"368fe1ce-e63a-4939-8bc3-4739e34c3ad9\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:15:17 crc kubenswrapper[5120]: I0316 16:15:17.458573 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftdsr\" (UniqueName: \"kubernetes.io/projected/368fe1ce-e63a-4939-8bc3-4739e34c3ad9-kube-api-access-ftdsr\") pod \"ceilometer-0\" (UID: \"368fe1ce-e63a-4939-8bc3-4739e34c3ad9\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:15:17 crc kubenswrapper[5120]: I0316 16:15:17.458608 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-85457c7f69-x8z6t"] Mar 16 16:15:17 crc kubenswrapper[5120]: I0316 16:15:17.459073 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-85457c7f69-x8z6t" podUID="d867b8f8-f632-48fb-ba66-4ac0c6f93dbe" containerName="neutron-api" containerID="cri-o://feece484e190c8c1d16f36f88c509346dfc6431788e86100b3cd2bd79dac71c4" gracePeriod=30 Mar 16 16:15:17 crc kubenswrapper[5120]: I0316 16:15:17.460755 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-85457c7f69-x8z6t" podUID="d867b8f8-f632-48fb-ba66-4ac0c6f93dbe" containerName="neutron-httpd" containerID="cri-o://eee849a431780be3c90b33e43cb28db790fb3eaa43ec492448b7d8672ee7c7cf" gracePeriod=30 Mar 16 16:15:17 crc kubenswrapper[5120]: I0316 16:15:17.684656 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:15:17 crc kubenswrapper[5120]: I0316 16:15:17.791663 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstackclient" event={"ID":"6064cc64-d619-4992-a1f6-b174b05d8ebf","Type":"ContainerStarted","Data":"ad0375bf4af105fa6a34f99135b8947f56c2ad8a62f3ea28296881a4467a492c"} Mar 16 16:15:17 crc kubenswrapper[5120]: I0316 16:15:17.791703 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstackclient" event={"ID":"6064cc64-d619-4992-a1f6-b174b05d8ebf","Type":"ContainerStarted","Data":"a9ac937cd451ff3439f4f699bad11f6cfc7cae0caf1ac31a0b3a711d3379912d"} Mar 16 16:15:17 crc kubenswrapper[5120]: I0316 16:15:17.813506 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstackclient" podStartSLOduration=1.813488362 podStartE2EDuration="1.813488362s" podCreationTimestamp="2026-03-16 16:15:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:15:17.809201617 +0000 UTC m=+2619.963133274" watchObservedRunningTime="2026-03-16 16:15:17.813488362 +0000 UTC m=+2619.967420019" Mar 16 16:15:18 crc kubenswrapper[5120]: I0316 16:15:18.151661 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:15:18 crc kubenswrapper[5120]: I0316 16:15:18.679508 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="70767b5f-5971-43c0-99fb-4d927737b789" path="/var/lib/kubelet/pods/70767b5f-5971-43c0-99fb-4d927737b789/volumes" Mar 16 16:15:18 crc kubenswrapper[5120]: I0316 16:15:18.808824 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"368fe1ce-e63a-4939-8bc3-4739e34c3ad9","Type":"ContainerStarted","Data":"17e369453931a9fd3fc5e24956ea85fddca5ba10741e70d3ce3ec105b43ffda9"} Mar 16 16:15:18 crc kubenswrapper[5120]: I0316 16:15:18.808867 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"368fe1ce-e63a-4939-8bc3-4739e34c3ad9","Type":"ContainerStarted","Data":"16e4805bf9b70643fd614633d504df85803e47afa502f38f982c5b007c4a7cc9"} Mar 16 16:15:18 crc kubenswrapper[5120]: I0316 16:15:18.811250 5120 generic.go:358] "Generic (PLEG): container finished" podID="d867b8f8-f632-48fb-ba66-4ac0c6f93dbe" containerID="eee849a431780be3c90b33e43cb28db790fb3eaa43ec492448b7d8672ee7c7cf" exitCode=0 Mar 16 16:15:18 crc kubenswrapper[5120]: I0316 16:15:18.811326 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-85457c7f69-x8z6t" event={"ID":"d867b8f8-f632-48fb-ba66-4ac0c6f93dbe","Type":"ContainerDied","Data":"eee849a431780be3c90b33e43cb28db790fb3eaa43ec492448b7d8672ee7c7cf"} Mar 16 16:15:19 crc kubenswrapper[5120]: I0316 16:15:19.820353 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"368fe1ce-e63a-4939-8bc3-4739e34c3ad9","Type":"ContainerStarted","Data":"06a7e2a82bb37f7d72d4020a54a9d93a32670fed84bb29d8797f62a853b49811"} Mar 16 16:15:20 crc kubenswrapper[5120]: I0316 16:15:20.843311 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"368fe1ce-e63a-4939-8bc3-4739e34c3ad9","Type":"ContainerStarted","Data":"15ee5c9c75431b7e0782468b4e6046166295f6da3b16c4f263bb43cd8b31e864"} Mar 16 16:15:22 crc kubenswrapper[5120]: I0316 16:15:22.868376 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"368fe1ce-e63a-4939-8bc3-4739e34c3ad9","Type":"ContainerStarted","Data":"4620d7d001d6cc271e45027a7dc5eebf7e12a92f437da8a1ef97848b30b0ed4f"} Mar 16 16:15:22 crc kubenswrapper[5120]: I0316 16:15:22.869016 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:15:22 crc kubenswrapper[5120]: I0316 16:15:22.899119 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=1.9889201330000001 podStartE2EDuration="5.899097917s" podCreationTimestamp="2026-03-16 16:15:17 +0000 UTC" firstStartedPulling="2026-03-16 16:15:18.160504432 +0000 UTC m=+2620.314436089" lastFinishedPulling="2026-03-16 16:15:22.070682206 +0000 UTC m=+2624.224613873" observedRunningTime="2026-03-16 16:15:22.891852103 +0000 UTC m=+2625.045783750" watchObservedRunningTime="2026-03-16 16:15:22.899097917 +0000 UTC m=+2625.053029584" Mar 16 16:15:23 crc kubenswrapper[5120]: I0316 16:15:23.818029 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/swift-proxy-7c79cc45b-sp9b7" Mar 16 16:15:23 crc kubenswrapper[5120]: I0316 16:15:23.821319 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/swift-proxy-7c79cc45b-sp9b7" Mar 16 16:15:24 crc kubenswrapper[5120]: I0316 16:15:24.686646 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-85457c7f69-x8z6t" Mar 16 16:15:24 crc kubenswrapper[5120]: I0316 16:15:24.763168 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/d867b8f8-f632-48fb-ba66-4ac0c6f93dbe-ovndb-tls-certs\") pod \"d867b8f8-f632-48fb-ba66-4ac0c6f93dbe\" (UID: \"d867b8f8-f632-48fb-ba66-4ac0c6f93dbe\") " Mar 16 16:15:24 crc kubenswrapper[5120]: I0316 16:15:24.763244 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d867b8f8-f632-48fb-ba66-4ac0c6f93dbe-combined-ca-bundle\") pod \"d867b8f8-f632-48fb-ba66-4ac0c6f93dbe\" (UID: \"d867b8f8-f632-48fb-ba66-4ac0c6f93dbe\") " Mar 16 16:15:24 crc kubenswrapper[5120]: I0316 16:15:24.763420 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jb7sr\" (UniqueName: \"kubernetes.io/projected/d867b8f8-f632-48fb-ba66-4ac0c6f93dbe-kube-api-access-jb7sr\") pod \"d867b8f8-f632-48fb-ba66-4ac0c6f93dbe\" (UID: \"d867b8f8-f632-48fb-ba66-4ac0c6f93dbe\") " Mar 16 16:15:24 crc kubenswrapper[5120]: I0316 16:15:24.763684 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d867b8f8-f632-48fb-ba66-4ac0c6f93dbe-config\") pod \"d867b8f8-f632-48fb-ba66-4ac0c6f93dbe\" (UID: \"d867b8f8-f632-48fb-ba66-4ac0c6f93dbe\") " Mar 16 16:15:24 crc kubenswrapper[5120]: I0316 16:15:24.763878 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/d867b8f8-f632-48fb-ba66-4ac0c6f93dbe-httpd-config\") pod \"d867b8f8-f632-48fb-ba66-4ac0c6f93dbe\" (UID: \"d867b8f8-f632-48fb-ba66-4ac0c6f93dbe\") " Mar 16 16:15:24 crc kubenswrapper[5120]: I0316 16:15:24.769223 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d867b8f8-f632-48fb-ba66-4ac0c6f93dbe-httpd-config" (OuterVolumeSpecName: "httpd-config") pod "d867b8f8-f632-48fb-ba66-4ac0c6f93dbe" (UID: "d867b8f8-f632-48fb-ba66-4ac0c6f93dbe"). InnerVolumeSpecName "httpd-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:15:24 crc kubenswrapper[5120]: I0316 16:15:24.782129 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d867b8f8-f632-48fb-ba66-4ac0c6f93dbe-kube-api-access-jb7sr" (OuterVolumeSpecName: "kube-api-access-jb7sr") pod "d867b8f8-f632-48fb-ba66-4ac0c6f93dbe" (UID: "d867b8f8-f632-48fb-ba66-4ac0c6f93dbe"). InnerVolumeSpecName "kube-api-access-jb7sr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:15:24 crc kubenswrapper[5120]: I0316 16:15:24.825718 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d867b8f8-f632-48fb-ba66-4ac0c6f93dbe-config" (OuterVolumeSpecName: "config") pod "d867b8f8-f632-48fb-ba66-4ac0c6f93dbe" (UID: "d867b8f8-f632-48fb-ba66-4ac0c6f93dbe"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:15:24 crc kubenswrapper[5120]: I0316 16:15:24.850435 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d867b8f8-f632-48fb-ba66-4ac0c6f93dbe-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "d867b8f8-f632-48fb-ba66-4ac0c6f93dbe" (UID: "d867b8f8-f632-48fb-ba66-4ac0c6f93dbe"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:15:24 crc kubenswrapper[5120]: I0316 16:15:24.850573 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d867b8f8-f632-48fb-ba66-4ac0c6f93dbe-ovndb-tls-certs" (OuterVolumeSpecName: "ovndb-tls-certs") pod "d867b8f8-f632-48fb-ba66-4ac0c6f93dbe" (UID: "d867b8f8-f632-48fb-ba66-4ac0c6f93dbe"). InnerVolumeSpecName "ovndb-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:15:24 crc kubenswrapper[5120]: I0316 16:15:24.867170 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d867b8f8-f632-48fb-ba66-4ac0c6f93dbe-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:15:24 crc kubenswrapper[5120]: I0316 16:15:24.867206 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jb7sr\" (UniqueName: \"kubernetes.io/projected/d867b8f8-f632-48fb-ba66-4ac0c6f93dbe-kube-api-access-jb7sr\") on node \"crc\" DevicePath \"\"" Mar 16 16:15:24 crc kubenswrapper[5120]: I0316 16:15:24.867223 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/d867b8f8-f632-48fb-ba66-4ac0c6f93dbe-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:15:24 crc kubenswrapper[5120]: I0316 16:15:24.867240 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/d867b8f8-f632-48fb-ba66-4ac0c6f93dbe-httpd-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:15:24 crc kubenswrapper[5120]: I0316 16:15:24.867252 5120 reconciler_common.go:299] "Volume detached for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/d867b8f8-f632-48fb-ba66-4ac0c6f93dbe-ovndb-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:15:24 crc kubenswrapper[5120]: I0316 16:15:24.891389 5120 generic.go:358] "Generic (PLEG): container finished" podID="d867b8f8-f632-48fb-ba66-4ac0c6f93dbe" containerID="feece484e190c8c1d16f36f88c509346dfc6431788e86100b3cd2bd79dac71c4" exitCode=0 Mar 16 16:15:24 crc kubenswrapper[5120]: I0316 16:15:24.891974 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-85457c7f69-x8z6t" event={"ID":"d867b8f8-f632-48fb-ba66-4ac0c6f93dbe","Type":"ContainerDied","Data":"feece484e190c8c1d16f36f88c509346dfc6431788e86100b3cd2bd79dac71c4"} Mar 16 16:15:24 crc kubenswrapper[5120]: I0316 16:15:24.892011 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-85457c7f69-x8z6t" event={"ID":"d867b8f8-f632-48fb-ba66-4ac0c6f93dbe","Type":"ContainerDied","Data":"63bf139c7eaa6b48f3db34111fb33737cfeeb6e97453a44cd1b6946ab5cb9159"} Mar 16 16:15:24 crc kubenswrapper[5120]: I0316 16:15:24.892031 5120 scope.go:117] "RemoveContainer" containerID="eee849a431780be3c90b33e43cb28db790fb3eaa43ec492448b7d8672ee7c7cf" Mar 16 16:15:24 crc kubenswrapper[5120]: I0316 16:15:24.892281 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-85457c7f69-x8z6t" Mar 16 16:15:24 crc kubenswrapper[5120]: I0316 16:15:24.920932 5120 scope.go:117] "RemoveContainer" containerID="feece484e190c8c1d16f36f88c509346dfc6431788e86100b3cd2bd79dac71c4" Mar 16 16:15:24 crc kubenswrapper[5120]: I0316 16:15:24.935913 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-85457c7f69-x8z6t"] Mar 16 16:15:24 crc kubenswrapper[5120]: I0316 16:15:24.946912 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-85457c7f69-x8z6t"] Mar 16 16:15:24 crc kubenswrapper[5120]: I0316 16:15:24.949481 5120 scope.go:117] "RemoveContainer" containerID="eee849a431780be3c90b33e43cb28db790fb3eaa43ec492448b7d8672ee7c7cf" Mar 16 16:15:24 crc kubenswrapper[5120]: E0316 16:15:24.950496 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eee849a431780be3c90b33e43cb28db790fb3eaa43ec492448b7d8672ee7c7cf\": container with ID starting with eee849a431780be3c90b33e43cb28db790fb3eaa43ec492448b7d8672ee7c7cf not found: ID does not exist" containerID="eee849a431780be3c90b33e43cb28db790fb3eaa43ec492448b7d8672ee7c7cf" Mar 16 16:15:24 crc kubenswrapper[5120]: I0316 16:15:24.950543 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eee849a431780be3c90b33e43cb28db790fb3eaa43ec492448b7d8672ee7c7cf"} err="failed to get container status \"eee849a431780be3c90b33e43cb28db790fb3eaa43ec492448b7d8672ee7c7cf\": rpc error: code = NotFound desc = could not find container \"eee849a431780be3c90b33e43cb28db790fb3eaa43ec492448b7d8672ee7c7cf\": container with ID starting with eee849a431780be3c90b33e43cb28db790fb3eaa43ec492448b7d8672ee7c7cf not found: ID does not exist" Mar 16 16:15:24 crc kubenswrapper[5120]: I0316 16:15:24.950641 5120 scope.go:117] "RemoveContainer" containerID="feece484e190c8c1d16f36f88c509346dfc6431788e86100b3cd2bd79dac71c4" Mar 16 16:15:24 crc kubenswrapper[5120]: E0316 16:15:24.950926 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"feece484e190c8c1d16f36f88c509346dfc6431788e86100b3cd2bd79dac71c4\": container with ID starting with feece484e190c8c1d16f36f88c509346dfc6431788e86100b3cd2bd79dac71c4 not found: ID does not exist" containerID="feece484e190c8c1d16f36f88c509346dfc6431788e86100b3cd2bd79dac71c4" Mar 16 16:15:24 crc kubenswrapper[5120]: I0316 16:15:24.950966 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"feece484e190c8c1d16f36f88c509346dfc6431788e86100b3cd2bd79dac71c4"} err="failed to get container status \"feece484e190c8c1d16f36f88c509346dfc6431788e86100b3cd2bd79dac71c4\": rpc error: code = NotFound desc = could not find container \"feece484e190c8c1d16f36f88c509346dfc6431788e86100b3cd2bd79dac71c4\": container with ID starting with feece484e190c8c1d16f36f88c509346dfc6431788e86100b3cd2bd79dac71c4 not found: ID does not exist" Mar 16 16:15:26 crc kubenswrapper[5120]: I0316 16:15:26.679471 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d867b8f8-f632-48fb-ba66-4ac0c6f93dbe" path="/var/lib/kubelet/pods/d867b8f8-f632-48fb-ba66-4ac0c6f93dbe/volumes" Mar 16 16:15:26 crc kubenswrapper[5120]: I0316 16:15:26.775141 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:15:26 crc kubenswrapper[5120]: I0316 16:15:26.775876 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="368fe1ce-e63a-4939-8bc3-4739e34c3ad9" containerName="ceilometer-central-agent" containerID="cri-o://17e369453931a9fd3fc5e24956ea85fddca5ba10741e70d3ce3ec105b43ffda9" gracePeriod=30 Mar 16 16:15:26 crc kubenswrapper[5120]: I0316 16:15:26.776031 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="368fe1ce-e63a-4939-8bc3-4739e34c3ad9" containerName="sg-core" containerID="cri-o://15ee5c9c75431b7e0782468b4e6046166295f6da3b16c4f263bb43cd8b31e864" gracePeriod=30 Mar 16 16:15:26 crc kubenswrapper[5120]: I0316 16:15:26.776111 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="368fe1ce-e63a-4939-8bc3-4739e34c3ad9" containerName="ceilometer-notification-agent" containerID="cri-o://06a7e2a82bb37f7d72d4020a54a9d93a32670fed84bb29d8797f62a853b49811" gracePeriod=30 Mar 16 16:15:26 crc kubenswrapper[5120]: I0316 16:15:26.775952 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="368fe1ce-e63a-4939-8bc3-4739e34c3ad9" containerName="proxy-httpd" containerID="cri-o://4620d7d001d6cc271e45027a7dc5eebf7e12a92f437da8a1ef97848b30b0ed4f" gracePeriod=30 Mar 16 16:15:26 crc kubenswrapper[5120]: I0316 16:15:26.912198 5120 generic.go:358] "Generic (PLEG): container finished" podID="368fe1ce-e63a-4939-8bc3-4739e34c3ad9" containerID="15ee5c9c75431b7e0782468b4e6046166295f6da3b16c4f263bb43cd8b31e864" exitCode=2 Mar 16 16:15:26 crc kubenswrapper[5120]: I0316 16:15:26.912240 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"368fe1ce-e63a-4939-8bc3-4739e34c3ad9","Type":"ContainerDied","Data":"15ee5c9c75431b7e0782468b4e6046166295f6da3b16c4f263bb43cd8b31e864"} Mar 16 16:15:27 crc kubenswrapper[5120]: I0316 16:15:27.503382 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:15:27 crc kubenswrapper[5120]: I0316 16:15:27.621748 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/368fe1ce-e63a-4939-8bc3-4739e34c3ad9-run-httpd\") pod \"368fe1ce-e63a-4939-8bc3-4739e34c3ad9\" (UID: \"368fe1ce-e63a-4939-8bc3-4739e34c3ad9\") " Mar 16 16:15:27 crc kubenswrapper[5120]: I0316 16:15:27.621871 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/368fe1ce-e63a-4939-8bc3-4739e34c3ad9-scripts\") pod \"368fe1ce-e63a-4939-8bc3-4739e34c3ad9\" (UID: \"368fe1ce-e63a-4939-8bc3-4739e34c3ad9\") " Mar 16 16:15:27 crc kubenswrapper[5120]: I0316 16:15:27.622003 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/368fe1ce-e63a-4939-8bc3-4739e34c3ad9-sg-core-conf-yaml\") pod \"368fe1ce-e63a-4939-8bc3-4739e34c3ad9\" (UID: \"368fe1ce-e63a-4939-8bc3-4739e34c3ad9\") " Mar 16 16:15:27 crc kubenswrapper[5120]: I0316 16:15:27.622087 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/368fe1ce-e63a-4939-8bc3-4739e34c3ad9-log-httpd\") pod \"368fe1ce-e63a-4939-8bc3-4739e34c3ad9\" (UID: \"368fe1ce-e63a-4939-8bc3-4739e34c3ad9\") " Mar 16 16:15:27 crc kubenswrapper[5120]: I0316 16:15:27.622232 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/368fe1ce-e63a-4939-8bc3-4739e34c3ad9-combined-ca-bundle\") pod \"368fe1ce-e63a-4939-8bc3-4739e34c3ad9\" (UID: \"368fe1ce-e63a-4939-8bc3-4739e34c3ad9\") " Mar 16 16:15:27 crc kubenswrapper[5120]: I0316 16:15:27.622257 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/368fe1ce-e63a-4939-8bc3-4739e34c3ad9-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "368fe1ce-e63a-4939-8bc3-4739e34c3ad9" (UID: "368fe1ce-e63a-4939-8bc3-4739e34c3ad9"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:15:27 crc kubenswrapper[5120]: I0316 16:15:27.622300 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ftdsr\" (UniqueName: \"kubernetes.io/projected/368fe1ce-e63a-4939-8bc3-4739e34c3ad9-kube-api-access-ftdsr\") pod \"368fe1ce-e63a-4939-8bc3-4739e34c3ad9\" (UID: \"368fe1ce-e63a-4939-8bc3-4739e34c3ad9\") " Mar 16 16:15:27 crc kubenswrapper[5120]: I0316 16:15:27.622423 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/368fe1ce-e63a-4939-8bc3-4739e34c3ad9-config-data\") pod \"368fe1ce-e63a-4939-8bc3-4739e34c3ad9\" (UID: \"368fe1ce-e63a-4939-8bc3-4739e34c3ad9\") " Mar 16 16:15:27 crc kubenswrapper[5120]: I0316 16:15:27.622472 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/368fe1ce-e63a-4939-8bc3-4739e34c3ad9-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "368fe1ce-e63a-4939-8bc3-4739e34c3ad9" (UID: "368fe1ce-e63a-4939-8bc3-4739e34c3ad9"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:15:27 crc kubenswrapper[5120]: I0316 16:15:27.622911 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/368fe1ce-e63a-4939-8bc3-4739e34c3ad9-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:15:27 crc kubenswrapper[5120]: I0316 16:15:27.622932 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/368fe1ce-e63a-4939-8bc3-4739e34c3ad9-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:15:27 crc kubenswrapper[5120]: I0316 16:15:27.627594 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/368fe1ce-e63a-4939-8bc3-4739e34c3ad9-scripts" (OuterVolumeSpecName: "scripts") pod "368fe1ce-e63a-4939-8bc3-4739e34c3ad9" (UID: "368fe1ce-e63a-4939-8bc3-4739e34c3ad9"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:15:27 crc kubenswrapper[5120]: I0316 16:15:27.627654 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/368fe1ce-e63a-4939-8bc3-4739e34c3ad9-kube-api-access-ftdsr" (OuterVolumeSpecName: "kube-api-access-ftdsr") pod "368fe1ce-e63a-4939-8bc3-4739e34c3ad9" (UID: "368fe1ce-e63a-4939-8bc3-4739e34c3ad9"). InnerVolumeSpecName "kube-api-access-ftdsr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:15:27 crc kubenswrapper[5120]: I0316 16:15:27.667720 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/368fe1ce-e63a-4939-8bc3-4739e34c3ad9-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "368fe1ce-e63a-4939-8bc3-4739e34c3ad9" (UID: "368fe1ce-e63a-4939-8bc3-4739e34c3ad9"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:15:27 crc kubenswrapper[5120]: I0316 16:15:27.701134 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/368fe1ce-e63a-4939-8bc3-4739e34c3ad9-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "368fe1ce-e63a-4939-8bc3-4739e34c3ad9" (UID: "368fe1ce-e63a-4939-8bc3-4739e34c3ad9"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:15:27 crc kubenswrapper[5120]: I0316 16:15:27.727179 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/368fe1ce-e63a-4939-8bc3-4739e34c3ad9-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:15:27 crc kubenswrapper[5120]: I0316 16:15:27.727214 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/368fe1ce-e63a-4939-8bc3-4739e34c3ad9-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 16:15:27 crc kubenswrapper[5120]: I0316 16:15:27.727230 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/368fe1ce-e63a-4939-8bc3-4739e34c3ad9-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:15:27 crc kubenswrapper[5120]: I0316 16:15:27.727243 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ftdsr\" (UniqueName: \"kubernetes.io/projected/368fe1ce-e63a-4939-8bc3-4739e34c3ad9-kube-api-access-ftdsr\") on node \"crc\" DevicePath \"\"" Mar 16 16:15:27 crc kubenswrapper[5120]: I0316 16:15:27.731088 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/368fe1ce-e63a-4939-8bc3-4739e34c3ad9-config-data" (OuterVolumeSpecName: "config-data") pod "368fe1ce-e63a-4939-8bc3-4739e34c3ad9" (UID: "368fe1ce-e63a-4939-8bc3-4739e34c3ad9"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:15:27 crc kubenswrapper[5120]: I0316 16:15:27.830229 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/368fe1ce-e63a-4939-8bc3-4739e34c3ad9-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:15:27 crc kubenswrapper[5120]: I0316 16:15:27.925215 5120 generic.go:358] "Generic (PLEG): container finished" podID="368fe1ce-e63a-4939-8bc3-4739e34c3ad9" containerID="4620d7d001d6cc271e45027a7dc5eebf7e12a92f437da8a1ef97848b30b0ed4f" exitCode=0 Mar 16 16:15:27 crc kubenswrapper[5120]: I0316 16:15:27.925247 5120 generic.go:358] "Generic (PLEG): container finished" podID="368fe1ce-e63a-4939-8bc3-4739e34c3ad9" containerID="06a7e2a82bb37f7d72d4020a54a9d93a32670fed84bb29d8797f62a853b49811" exitCode=0 Mar 16 16:15:27 crc kubenswrapper[5120]: I0316 16:15:27.925256 5120 generic.go:358] "Generic (PLEG): container finished" podID="368fe1ce-e63a-4939-8bc3-4739e34c3ad9" containerID="17e369453931a9fd3fc5e24956ea85fddca5ba10741e70d3ce3ec105b43ffda9" exitCode=0 Mar 16 16:15:27 crc kubenswrapper[5120]: I0316 16:15:27.925310 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:15:27 crc kubenswrapper[5120]: I0316 16:15:27.925308 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"368fe1ce-e63a-4939-8bc3-4739e34c3ad9","Type":"ContainerDied","Data":"4620d7d001d6cc271e45027a7dc5eebf7e12a92f437da8a1ef97848b30b0ed4f"} Mar 16 16:15:27 crc kubenswrapper[5120]: I0316 16:15:27.925367 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"368fe1ce-e63a-4939-8bc3-4739e34c3ad9","Type":"ContainerDied","Data":"06a7e2a82bb37f7d72d4020a54a9d93a32670fed84bb29d8797f62a853b49811"} Mar 16 16:15:27 crc kubenswrapper[5120]: I0316 16:15:27.925379 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"368fe1ce-e63a-4939-8bc3-4739e34c3ad9","Type":"ContainerDied","Data":"17e369453931a9fd3fc5e24956ea85fddca5ba10741e70d3ce3ec105b43ffda9"} Mar 16 16:15:27 crc kubenswrapper[5120]: I0316 16:15:27.925391 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"368fe1ce-e63a-4939-8bc3-4739e34c3ad9","Type":"ContainerDied","Data":"16e4805bf9b70643fd614633d504df85803e47afa502f38f982c5b007c4a7cc9"} Mar 16 16:15:27 crc kubenswrapper[5120]: I0316 16:15:27.925408 5120 scope.go:117] "RemoveContainer" containerID="4620d7d001d6cc271e45027a7dc5eebf7e12a92f437da8a1ef97848b30b0ed4f" Mar 16 16:15:27 crc kubenswrapper[5120]: I0316 16:15:27.955734 5120 scope.go:117] "RemoveContainer" containerID="15ee5c9c75431b7e0782468b4e6046166295f6da3b16c4f263bb43cd8b31e864" Mar 16 16:15:27 crc kubenswrapper[5120]: I0316 16:15:27.960750 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:15:27 crc kubenswrapper[5120]: I0316 16:15:27.970137 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:15:27 crc kubenswrapper[5120]: I0316 16:15:27.987791 5120 scope.go:117] "RemoveContainer" containerID="06a7e2a82bb37f7d72d4020a54a9d93a32670fed84bb29d8797f62a853b49811" Mar 16 16:15:27 crc kubenswrapper[5120]: I0316 16:15:27.988151 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:15:27 crc kubenswrapper[5120]: I0316 16:15:27.989389 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d867b8f8-f632-48fb-ba66-4ac0c6f93dbe" containerName="neutron-httpd" Mar 16 16:15:27 crc kubenswrapper[5120]: I0316 16:15:27.989417 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="d867b8f8-f632-48fb-ba66-4ac0c6f93dbe" containerName="neutron-httpd" Mar 16 16:15:27 crc kubenswrapper[5120]: I0316 16:15:27.989436 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d867b8f8-f632-48fb-ba66-4ac0c6f93dbe" containerName="neutron-api" Mar 16 16:15:27 crc kubenswrapper[5120]: I0316 16:15:27.989446 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="d867b8f8-f632-48fb-ba66-4ac0c6f93dbe" containerName="neutron-api" Mar 16 16:15:27 crc kubenswrapper[5120]: I0316 16:15:27.989458 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="368fe1ce-e63a-4939-8bc3-4739e34c3ad9" containerName="ceilometer-central-agent" Mar 16 16:15:27 crc kubenswrapper[5120]: I0316 16:15:27.989466 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="368fe1ce-e63a-4939-8bc3-4739e34c3ad9" containerName="ceilometer-central-agent" Mar 16 16:15:27 crc kubenswrapper[5120]: I0316 16:15:27.989478 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="368fe1ce-e63a-4939-8bc3-4739e34c3ad9" containerName="proxy-httpd" Mar 16 16:15:27 crc kubenswrapper[5120]: I0316 16:15:27.989485 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="368fe1ce-e63a-4939-8bc3-4739e34c3ad9" containerName="proxy-httpd" Mar 16 16:15:27 crc kubenswrapper[5120]: I0316 16:15:27.989532 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="368fe1ce-e63a-4939-8bc3-4739e34c3ad9" containerName="ceilometer-notification-agent" Mar 16 16:15:27 crc kubenswrapper[5120]: I0316 16:15:27.989541 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="368fe1ce-e63a-4939-8bc3-4739e34c3ad9" containerName="ceilometer-notification-agent" Mar 16 16:15:27 crc kubenswrapper[5120]: I0316 16:15:27.989575 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="368fe1ce-e63a-4939-8bc3-4739e34c3ad9" containerName="sg-core" Mar 16 16:15:27 crc kubenswrapper[5120]: I0316 16:15:27.989582 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="368fe1ce-e63a-4939-8bc3-4739e34c3ad9" containerName="sg-core" Mar 16 16:15:27 crc kubenswrapper[5120]: I0316 16:15:27.993907 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="368fe1ce-e63a-4939-8bc3-4739e34c3ad9" containerName="proxy-httpd" Mar 16 16:15:27 crc kubenswrapper[5120]: I0316 16:15:27.993953 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="368fe1ce-e63a-4939-8bc3-4739e34c3ad9" containerName="sg-core" Mar 16 16:15:27 crc kubenswrapper[5120]: I0316 16:15:27.994047 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="d867b8f8-f632-48fb-ba66-4ac0c6f93dbe" containerName="neutron-httpd" Mar 16 16:15:27 crc kubenswrapper[5120]: I0316 16:15:27.994068 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="368fe1ce-e63a-4939-8bc3-4739e34c3ad9" containerName="ceilometer-notification-agent" Mar 16 16:15:27 crc kubenswrapper[5120]: I0316 16:15:27.994092 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="d867b8f8-f632-48fb-ba66-4ac0c6f93dbe" containerName="neutron-api" Mar 16 16:15:27 crc kubenswrapper[5120]: I0316 16:15:27.994118 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="368fe1ce-e63a-4939-8bc3-4739e34c3ad9" containerName="ceilometer-central-agent" Mar 16 16:15:28 crc kubenswrapper[5120]: I0316 16:15:28.010208 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:15:28 crc kubenswrapper[5120]: I0316 16:15:28.012837 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 16:15:28 crc kubenswrapper[5120]: I0316 16:15:28.013428 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 16:15:28 crc kubenswrapper[5120]: I0316 16:15:28.019843 5120 scope.go:117] "RemoveContainer" containerID="17e369453931a9fd3fc5e24956ea85fddca5ba10741e70d3ce3ec105b43ffda9" Mar 16 16:15:28 crc kubenswrapper[5120]: I0316 16:15:28.025185 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:15:28 crc kubenswrapper[5120]: I0316 16:15:28.052670 5120 scope.go:117] "RemoveContainer" containerID="4620d7d001d6cc271e45027a7dc5eebf7e12a92f437da8a1ef97848b30b0ed4f" Mar 16 16:15:28 crc kubenswrapper[5120]: E0316 16:15:28.053279 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4620d7d001d6cc271e45027a7dc5eebf7e12a92f437da8a1ef97848b30b0ed4f\": container with ID starting with 4620d7d001d6cc271e45027a7dc5eebf7e12a92f437da8a1ef97848b30b0ed4f not found: ID does not exist" containerID="4620d7d001d6cc271e45027a7dc5eebf7e12a92f437da8a1ef97848b30b0ed4f" Mar 16 16:15:28 crc kubenswrapper[5120]: I0316 16:15:28.053330 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4620d7d001d6cc271e45027a7dc5eebf7e12a92f437da8a1ef97848b30b0ed4f"} err="failed to get container status \"4620d7d001d6cc271e45027a7dc5eebf7e12a92f437da8a1ef97848b30b0ed4f\": rpc error: code = NotFound desc = could not find container \"4620d7d001d6cc271e45027a7dc5eebf7e12a92f437da8a1ef97848b30b0ed4f\": container with ID starting with 4620d7d001d6cc271e45027a7dc5eebf7e12a92f437da8a1ef97848b30b0ed4f not found: ID does not exist" Mar 16 16:15:28 crc kubenswrapper[5120]: I0316 16:15:28.053355 5120 scope.go:117] "RemoveContainer" containerID="15ee5c9c75431b7e0782468b4e6046166295f6da3b16c4f263bb43cd8b31e864" Mar 16 16:15:28 crc kubenswrapper[5120]: E0316 16:15:28.053786 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"15ee5c9c75431b7e0782468b4e6046166295f6da3b16c4f263bb43cd8b31e864\": container with ID starting with 15ee5c9c75431b7e0782468b4e6046166295f6da3b16c4f263bb43cd8b31e864 not found: ID does not exist" containerID="15ee5c9c75431b7e0782468b4e6046166295f6da3b16c4f263bb43cd8b31e864" Mar 16 16:15:28 crc kubenswrapper[5120]: I0316 16:15:28.053818 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15ee5c9c75431b7e0782468b4e6046166295f6da3b16c4f263bb43cd8b31e864"} err="failed to get container status \"15ee5c9c75431b7e0782468b4e6046166295f6da3b16c4f263bb43cd8b31e864\": rpc error: code = NotFound desc = could not find container \"15ee5c9c75431b7e0782468b4e6046166295f6da3b16c4f263bb43cd8b31e864\": container with ID starting with 15ee5c9c75431b7e0782468b4e6046166295f6da3b16c4f263bb43cd8b31e864 not found: ID does not exist" Mar 16 16:15:28 crc kubenswrapper[5120]: I0316 16:15:28.053838 5120 scope.go:117] "RemoveContainer" containerID="06a7e2a82bb37f7d72d4020a54a9d93a32670fed84bb29d8797f62a853b49811" Mar 16 16:15:28 crc kubenswrapper[5120]: E0316 16:15:28.054208 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"06a7e2a82bb37f7d72d4020a54a9d93a32670fed84bb29d8797f62a853b49811\": container with ID starting with 06a7e2a82bb37f7d72d4020a54a9d93a32670fed84bb29d8797f62a853b49811 not found: ID does not exist" containerID="06a7e2a82bb37f7d72d4020a54a9d93a32670fed84bb29d8797f62a853b49811" Mar 16 16:15:28 crc kubenswrapper[5120]: I0316 16:15:28.054229 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"06a7e2a82bb37f7d72d4020a54a9d93a32670fed84bb29d8797f62a853b49811"} err="failed to get container status \"06a7e2a82bb37f7d72d4020a54a9d93a32670fed84bb29d8797f62a853b49811\": rpc error: code = NotFound desc = could not find container \"06a7e2a82bb37f7d72d4020a54a9d93a32670fed84bb29d8797f62a853b49811\": container with ID starting with 06a7e2a82bb37f7d72d4020a54a9d93a32670fed84bb29d8797f62a853b49811 not found: ID does not exist" Mar 16 16:15:28 crc kubenswrapper[5120]: I0316 16:15:28.054241 5120 scope.go:117] "RemoveContainer" containerID="17e369453931a9fd3fc5e24956ea85fddca5ba10741e70d3ce3ec105b43ffda9" Mar 16 16:15:28 crc kubenswrapper[5120]: E0316 16:15:28.054453 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"17e369453931a9fd3fc5e24956ea85fddca5ba10741e70d3ce3ec105b43ffda9\": container with ID starting with 17e369453931a9fd3fc5e24956ea85fddca5ba10741e70d3ce3ec105b43ffda9 not found: ID does not exist" containerID="17e369453931a9fd3fc5e24956ea85fddca5ba10741e70d3ce3ec105b43ffda9" Mar 16 16:15:28 crc kubenswrapper[5120]: I0316 16:15:28.054475 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17e369453931a9fd3fc5e24956ea85fddca5ba10741e70d3ce3ec105b43ffda9"} err="failed to get container status \"17e369453931a9fd3fc5e24956ea85fddca5ba10741e70d3ce3ec105b43ffda9\": rpc error: code = NotFound desc = could not find container \"17e369453931a9fd3fc5e24956ea85fddca5ba10741e70d3ce3ec105b43ffda9\": container with ID starting with 17e369453931a9fd3fc5e24956ea85fddca5ba10741e70d3ce3ec105b43ffda9 not found: ID does not exist" Mar 16 16:15:28 crc kubenswrapper[5120]: I0316 16:15:28.054486 5120 scope.go:117] "RemoveContainer" containerID="4620d7d001d6cc271e45027a7dc5eebf7e12a92f437da8a1ef97848b30b0ed4f" Mar 16 16:15:28 crc kubenswrapper[5120]: I0316 16:15:28.054707 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4620d7d001d6cc271e45027a7dc5eebf7e12a92f437da8a1ef97848b30b0ed4f"} err="failed to get container status \"4620d7d001d6cc271e45027a7dc5eebf7e12a92f437da8a1ef97848b30b0ed4f\": rpc error: code = NotFound desc = could not find container \"4620d7d001d6cc271e45027a7dc5eebf7e12a92f437da8a1ef97848b30b0ed4f\": container with ID starting with 4620d7d001d6cc271e45027a7dc5eebf7e12a92f437da8a1ef97848b30b0ed4f not found: ID does not exist" Mar 16 16:15:28 crc kubenswrapper[5120]: I0316 16:15:28.054721 5120 scope.go:117] "RemoveContainer" containerID="15ee5c9c75431b7e0782468b4e6046166295f6da3b16c4f263bb43cd8b31e864" Mar 16 16:15:28 crc kubenswrapper[5120]: I0316 16:15:28.055021 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15ee5c9c75431b7e0782468b4e6046166295f6da3b16c4f263bb43cd8b31e864"} err="failed to get container status \"15ee5c9c75431b7e0782468b4e6046166295f6da3b16c4f263bb43cd8b31e864\": rpc error: code = NotFound desc = could not find container \"15ee5c9c75431b7e0782468b4e6046166295f6da3b16c4f263bb43cd8b31e864\": container with ID starting with 15ee5c9c75431b7e0782468b4e6046166295f6da3b16c4f263bb43cd8b31e864 not found: ID does not exist" Mar 16 16:15:28 crc kubenswrapper[5120]: I0316 16:15:28.055033 5120 scope.go:117] "RemoveContainer" containerID="06a7e2a82bb37f7d72d4020a54a9d93a32670fed84bb29d8797f62a853b49811" Mar 16 16:15:28 crc kubenswrapper[5120]: I0316 16:15:28.055336 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"06a7e2a82bb37f7d72d4020a54a9d93a32670fed84bb29d8797f62a853b49811"} err="failed to get container status \"06a7e2a82bb37f7d72d4020a54a9d93a32670fed84bb29d8797f62a853b49811\": rpc error: code = NotFound desc = could not find container \"06a7e2a82bb37f7d72d4020a54a9d93a32670fed84bb29d8797f62a853b49811\": container with ID starting with 06a7e2a82bb37f7d72d4020a54a9d93a32670fed84bb29d8797f62a853b49811 not found: ID does not exist" Mar 16 16:15:28 crc kubenswrapper[5120]: I0316 16:15:28.055371 5120 scope.go:117] "RemoveContainer" containerID="17e369453931a9fd3fc5e24956ea85fddca5ba10741e70d3ce3ec105b43ffda9" Mar 16 16:15:28 crc kubenswrapper[5120]: I0316 16:15:28.055652 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17e369453931a9fd3fc5e24956ea85fddca5ba10741e70d3ce3ec105b43ffda9"} err="failed to get container status \"17e369453931a9fd3fc5e24956ea85fddca5ba10741e70d3ce3ec105b43ffda9\": rpc error: code = NotFound desc = could not find container \"17e369453931a9fd3fc5e24956ea85fddca5ba10741e70d3ce3ec105b43ffda9\": container with ID starting with 17e369453931a9fd3fc5e24956ea85fddca5ba10741e70d3ce3ec105b43ffda9 not found: ID does not exist" Mar 16 16:15:28 crc kubenswrapper[5120]: I0316 16:15:28.055675 5120 scope.go:117] "RemoveContainer" containerID="4620d7d001d6cc271e45027a7dc5eebf7e12a92f437da8a1ef97848b30b0ed4f" Mar 16 16:15:28 crc kubenswrapper[5120]: I0316 16:15:28.055877 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4620d7d001d6cc271e45027a7dc5eebf7e12a92f437da8a1ef97848b30b0ed4f"} err="failed to get container status \"4620d7d001d6cc271e45027a7dc5eebf7e12a92f437da8a1ef97848b30b0ed4f\": rpc error: code = NotFound desc = could not find container \"4620d7d001d6cc271e45027a7dc5eebf7e12a92f437da8a1ef97848b30b0ed4f\": container with ID starting with 4620d7d001d6cc271e45027a7dc5eebf7e12a92f437da8a1ef97848b30b0ed4f not found: ID does not exist" Mar 16 16:15:28 crc kubenswrapper[5120]: I0316 16:15:28.055898 5120 scope.go:117] "RemoveContainer" containerID="15ee5c9c75431b7e0782468b4e6046166295f6da3b16c4f263bb43cd8b31e864" Mar 16 16:15:28 crc kubenswrapper[5120]: I0316 16:15:28.056248 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15ee5c9c75431b7e0782468b4e6046166295f6da3b16c4f263bb43cd8b31e864"} err="failed to get container status \"15ee5c9c75431b7e0782468b4e6046166295f6da3b16c4f263bb43cd8b31e864\": rpc error: code = NotFound desc = could not find container \"15ee5c9c75431b7e0782468b4e6046166295f6da3b16c4f263bb43cd8b31e864\": container with ID starting with 15ee5c9c75431b7e0782468b4e6046166295f6da3b16c4f263bb43cd8b31e864 not found: ID does not exist" Mar 16 16:15:28 crc kubenswrapper[5120]: I0316 16:15:28.056269 5120 scope.go:117] "RemoveContainer" containerID="06a7e2a82bb37f7d72d4020a54a9d93a32670fed84bb29d8797f62a853b49811" Mar 16 16:15:28 crc kubenswrapper[5120]: I0316 16:15:28.056471 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"06a7e2a82bb37f7d72d4020a54a9d93a32670fed84bb29d8797f62a853b49811"} err="failed to get container status \"06a7e2a82bb37f7d72d4020a54a9d93a32670fed84bb29d8797f62a853b49811\": rpc error: code = NotFound desc = could not find container \"06a7e2a82bb37f7d72d4020a54a9d93a32670fed84bb29d8797f62a853b49811\": container with ID starting with 06a7e2a82bb37f7d72d4020a54a9d93a32670fed84bb29d8797f62a853b49811 not found: ID does not exist" Mar 16 16:15:28 crc kubenswrapper[5120]: I0316 16:15:28.056493 5120 scope.go:117] "RemoveContainer" containerID="17e369453931a9fd3fc5e24956ea85fddca5ba10741e70d3ce3ec105b43ffda9" Mar 16 16:15:28 crc kubenswrapper[5120]: I0316 16:15:28.056700 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17e369453931a9fd3fc5e24956ea85fddca5ba10741e70d3ce3ec105b43ffda9"} err="failed to get container status \"17e369453931a9fd3fc5e24956ea85fddca5ba10741e70d3ce3ec105b43ffda9\": rpc error: code = NotFound desc = could not find container \"17e369453931a9fd3fc5e24956ea85fddca5ba10741e70d3ce3ec105b43ffda9\": container with ID starting with 17e369453931a9fd3fc5e24956ea85fddca5ba10741e70d3ce3ec105b43ffda9 not found: ID does not exist" Mar 16 16:15:28 crc kubenswrapper[5120]: I0316 16:15:28.142194 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/3e3a1a48-35af-43bb-ba48-263697db6cc5-log-httpd\") pod \"ceilometer-0\" (UID: \"3e3a1a48-35af-43bb-ba48-263697db6cc5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:15:28 crc kubenswrapper[5120]: I0316 16:15:28.142281 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffvx8\" (UniqueName: \"kubernetes.io/projected/3e3a1a48-35af-43bb-ba48-263697db6cc5-kube-api-access-ffvx8\") pod \"ceilometer-0\" (UID: \"3e3a1a48-35af-43bb-ba48-263697db6cc5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:15:28 crc kubenswrapper[5120]: I0316 16:15:28.142305 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3e3a1a48-35af-43bb-ba48-263697db6cc5-config-data\") pod \"ceilometer-0\" (UID: \"3e3a1a48-35af-43bb-ba48-263697db6cc5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:15:28 crc kubenswrapper[5120]: I0316 16:15:28.142419 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3e3a1a48-35af-43bb-ba48-263697db6cc5-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"3e3a1a48-35af-43bb-ba48-263697db6cc5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:15:28 crc kubenswrapper[5120]: I0316 16:15:28.142539 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/3e3a1a48-35af-43bb-ba48-263697db6cc5-run-httpd\") pod \"ceilometer-0\" (UID: \"3e3a1a48-35af-43bb-ba48-263697db6cc5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:15:28 crc kubenswrapper[5120]: I0316 16:15:28.142580 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/3e3a1a48-35af-43bb-ba48-263697db6cc5-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"3e3a1a48-35af-43bb-ba48-263697db6cc5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:15:28 crc kubenswrapper[5120]: I0316 16:15:28.142618 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3e3a1a48-35af-43bb-ba48-263697db6cc5-scripts\") pod \"ceilometer-0\" (UID: \"3e3a1a48-35af-43bb-ba48-263697db6cc5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:15:28 crc kubenswrapper[5120]: I0316 16:15:28.244751 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3e3a1a48-35af-43bb-ba48-263697db6cc5-scripts\") pod \"ceilometer-0\" (UID: \"3e3a1a48-35af-43bb-ba48-263697db6cc5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:15:28 crc kubenswrapper[5120]: I0316 16:15:28.245221 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/3e3a1a48-35af-43bb-ba48-263697db6cc5-log-httpd\") pod \"ceilometer-0\" (UID: \"3e3a1a48-35af-43bb-ba48-263697db6cc5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:15:28 crc kubenswrapper[5120]: I0316 16:15:28.245286 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ffvx8\" (UniqueName: \"kubernetes.io/projected/3e3a1a48-35af-43bb-ba48-263697db6cc5-kube-api-access-ffvx8\") pod \"ceilometer-0\" (UID: \"3e3a1a48-35af-43bb-ba48-263697db6cc5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:15:28 crc kubenswrapper[5120]: I0316 16:15:28.245308 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3e3a1a48-35af-43bb-ba48-263697db6cc5-config-data\") pod \"ceilometer-0\" (UID: \"3e3a1a48-35af-43bb-ba48-263697db6cc5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:15:28 crc kubenswrapper[5120]: I0316 16:15:28.245420 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3e3a1a48-35af-43bb-ba48-263697db6cc5-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"3e3a1a48-35af-43bb-ba48-263697db6cc5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:15:28 crc kubenswrapper[5120]: I0316 16:15:28.245558 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/3e3a1a48-35af-43bb-ba48-263697db6cc5-run-httpd\") pod \"ceilometer-0\" (UID: \"3e3a1a48-35af-43bb-ba48-263697db6cc5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:15:28 crc kubenswrapper[5120]: I0316 16:15:28.245608 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/3e3a1a48-35af-43bb-ba48-263697db6cc5-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"3e3a1a48-35af-43bb-ba48-263697db6cc5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:15:28 crc kubenswrapper[5120]: I0316 16:15:28.245917 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/3e3a1a48-35af-43bb-ba48-263697db6cc5-log-httpd\") pod \"ceilometer-0\" (UID: \"3e3a1a48-35af-43bb-ba48-263697db6cc5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:15:28 crc kubenswrapper[5120]: I0316 16:15:28.246243 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/3e3a1a48-35af-43bb-ba48-263697db6cc5-run-httpd\") pod \"ceilometer-0\" (UID: \"3e3a1a48-35af-43bb-ba48-263697db6cc5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:15:28 crc kubenswrapper[5120]: I0316 16:15:28.250807 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/3e3a1a48-35af-43bb-ba48-263697db6cc5-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"3e3a1a48-35af-43bb-ba48-263697db6cc5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:15:28 crc kubenswrapper[5120]: I0316 16:15:28.251257 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3e3a1a48-35af-43bb-ba48-263697db6cc5-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"3e3a1a48-35af-43bb-ba48-263697db6cc5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:15:28 crc kubenswrapper[5120]: I0316 16:15:28.251495 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3e3a1a48-35af-43bb-ba48-263697db6cc5-scripts\") pod \"ceilometer-0\" (UID: \"3e3a1a48-35af-43bb-ba48-263697db6cc5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:15:28 crc kubenswrapper[5120]: I0316 16:15:28.257259 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3e3a1a48-35af-43bb-ba48-263697db6cc5-config-data\") pod \"ceilometer-0\" (UID: \"3e3a1a48-35af-43bb-ba48-263697db6cc5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:15:28 crc kubenswrapper[5120]: I0316 16:15:28.264699 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffvx8\" (UniqueName: \"kubernetes.io/projected/3e3a1a48-35af-43bb-ba48-263697db6cc5-kube-api-access-ffvx8\") pod \"ceilometer-0\" (UID: \"3e3a1a48-35af-43bb-ba48-263697db6cc5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:15:28 crc kubenswrapper[5120]: I0316 16:15:28.329555 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:15:28 crc kubenswrapper[5120]: I0316 16:15:28.525331 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:15:28 crc kubenswrapper[5120]: I0316 16:15:28.674356 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="368fe1ce-e63a-4939-8bc3-4739e34c3ad9" path="/var/lib/kubelet/pods/368fe1ce-e63a-4939-8bc3-4739e34c3ad9/volumes" Mar 16 16:15:28 crc kubenswrapper[5120]: I0316 16:15:28.791726 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:15:28 crc kubenswrapper[5120]: W0316 16:15:28.796582 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3e3a1a48_35af_43bb_ba48_263697db6cc5.slice/crio-4b28cc7a17ce669aad38c0ab1dce997b805eb61d15c4019696189e1661cd30a4 WatchSource:0}: Error finding container 4b28cc7a17ce669aad38c0ab1dce997b805eb61d15c4019696189e1661cd30a4: Status 404 returned error can't find the container with id 4b28cc7a17ce669aad38c0ab1dce997b805eb61d15c4019696189e1661cd30a4 Mar 16 16:15:28 crc kubenswrapper[5120]: I0316 16:15:28.954064 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"3e3a1a48-35af-43bb-ba48-263697db6cc5","Type":"ContainerStarted","Data":"4b28cc7a17ce669aad38c0ab1dce997b805eb61d15c4019696189e1661cd30a4"} Mar 16 16:15:29 crc kubenswrapper[5120]: I0316 16:15:29.966520 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"3e3a1a48-35af-43bb-ba48-263697db6cc5","Type":"ContainerStarted","Data":"42380b678f524d53ecd974600bf119a16ddc20199e6b1fd5587b12b49b33cc61"} Mar 16 16:15:30 crc kubenswrapper[5120]: I0316 16:15:30.986053 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"3e3a1a48-35af-43bb-ba48-263697db6cc5","Type":"ContainerStarted","Data":"9408531d55cb6a1ac74d2d5c8d3f11abfbbe2c44fb1c81ce4e3b6edcb48af836"} Mar 16 16:15:31 crc kubenswrapper[5120]: I0316 16:15:31.994721 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"3e3a1a48-35af-43bb-ba48-263697db6cc5","Type":"ContainerStarted","Data":"797802849eec37703c2ba470d7ca9f4e8eeb562707348b014730a24013477f0f"} Mar 16 16:15:33 crc kubenswrapper[5120]: I0316 16:15:33.017540 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"3e3a1a48-35af-43bb-ba48-263697db6cc5","Type":"ContainerStarted","Data":"5e1f746bc2717412dc835d042a25537512dc44835951b00fa8cd18d024891b29"} Mar 16 16:15:33 crc kubenswrapper[5120]: I0316 16:15:33.020956 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:15:33 crc kubenswrapper[5120]: I0316 16:15:33.018556 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="3e3a1a48-35af-43bb-ba48-263697db6cc5" containerName="proxy-httpd" containerID="cri-o://5e1f746bc2717412dc835d042a25537512dc44835951b00fa8cd18d024891b29" gracePeriod=30 Mar 16 16:15:33 crc kubenswrapper[5120]: I0316 16:15:33.017975 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="3e3a1a48-35af-43bb-ba48-263697db6cc5" containerName="ceilometer-central-agent" containerID="cri-o://42380b678f524d53ecd974600bf119a16ddc20199e6b1fd5587b12b49b33cc61" gracePeriod=30 Mar 16 16:15:33 crc kubenswrapper[5120]: I0316 16:15:33.018588 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="3e3a1a48-35af-43bb-ba48-263697db6cc5" containerName="ceilometer-notification-agent" containerID="cri-o://9408531d55cb6a1ac74d2d5c8d3f11abfbbe2c44fb1c81ce4e3b6edcb48af836" gracePeriod=30 Mar 16 16:15:33 crc kubenswrapper[5120]: I0316 16:15:33.018574 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="3e3a1a48-35af-43bb-ba48-263697db6cc5" containerName="sg-core" containerID="cri-o://797802849eec37703c2ba470d7ca9f4e8eeb562707348b014730a24013477f0f" gracePeriod=30 Mar 16 16:15:33 crc kubenswrapper[5120]: I0316 16:15:33.059514 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-hk5sb"] Mar 16 16:15:33 crc kubenswrapper[5120]: I0316 16:15:33.065582 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-db-create-hk5sb" Mar 16 16:15:33 crc kubenswrapper[5120]: I0316 16:15:33.074191 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.264157792 podStartE2EDuration="6.074173761s" podCreationTimestamp="2026-03-16 16:15:27 +0000 UTC" firstStartedPulling="2026-03-16 16:15:28.798594755 +0000 UTC m=+2630.952526412" lastFinishedPulling="2026-03-16 16:15:32.608610694 +0000 UTC m=+2634.762542381" observedRunningTime="2026-03-16 16:15:33.05772098 +0000 UTC m=+2635.211652677" watchObservedRunningTime="2026-03-16 16:15:33.074173761 +0000 UTC m=+2635.228105418" Mar 16 16:15:33 crc kubenswrapper[5120]: I0316 16:15:33.111647 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-hk5sb"] Mar 16 16:15:33 crc kubenswrapper[5120]: I0316 16:15:33.181562 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-kcmsv"] Mar 16 16:15:33 crc kubenswrapper[5120]: I0316 16:15:33.190507 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-db-create-kcmsv" Mar 16 16:15:33 crc kubenswrapper[5120]: I0316 16:15:33.205349 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-kcmsv"] Mar 16 16:15:33 crc kubenswrapper[5120]: I0316 16:15:33.256561 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/21396f29-338c-4c63-8a5d-1a664e24899b-operator-scripts\") pod \"nova-api-db-create-hk5sb\" (UID: \"21396f29-338c-4c63-8a5d-1a664e24899b\") " pod="openstack-kuttl-tests/nova-api-db-create-hk5sb" Mar 16 16:15:33 crc kubenswrapper[5120]: I0316 16:15:33.256749 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjb4f\" (UniqueName: \"kubernetes.io/projected/21396f29-338c-4c63-8a5d-1a664e24899b-kube-api-access-xjb4f\") pod \"nova-api-db-create-hk5sb\" (UID: \"21396f29-338c-4c63-8a5d-1a664e24899b\") " pod="openstack-kuttl-tests/nova-api-db-create-hk5sb" Mar 16 16:15:33 crc kubenswrapper[5120]: I0316 16:15:33.271415 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-2d21-account-create-update-vmvmw"] Mar 16 16:15:33 crc kubenswrapper[5120]: I0316 16:15:33.305398 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-2d21-account-create-update-vmvmw" Mar 16 16:15:33 crc kubenswrapper[5120]: I0316 16:15:33.308041 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-2d21-account-create-update-vmvmw"] Mar 16 16:15:33 crc kubenswrapper[5120]: I0316 16:15:33.311301 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-db-secret\"" Mar 16 16:15:33 crc kubenswrapper[5120]: I0316 16:15:33.363552 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xjb4f\" (UniqueName: \"kubernetes.io/projected/21396f29-338c-4c63-8a5d-1a664e24899b-kube-api-access-xjb4f\") pod \"nova-api-db-create-hk5sb\" (UID: \"21396f29-338c-4c63-8a5d-1a664e24899b\") " pod="openstack-kuttl-tests/nova-api-db-create-hk5sb" Mar 16 16:15:33 crc kubenswrapper[5120]: I0316 16:15:33.363617 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sb57h\" (UniqueName: \"kubernetes.io/projected/afe6db0b-404e-4339-a3c6-94ae2fc4adc1-kube-api-access-sb57h\") pod \"nova-cell0-db-create-kcmsv\" (UID: \"afe6db0b-404e-4339-a3c6-94ae2fc4adc1\") " pod="openstack-kuttl-tests/nova-cell0-db-create-kcmsv" Mar 16 16:15:33 crc kubenswrapper[5120]: I0316 16:15:33.363707 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/21396f29-338c-4c63-8a5d-1a664e24899b-operator-scripts\") pod \"nova-api-db-create-hk5sb\" (UID: \"21396f29-338c-4c63-8a5d-1a664e24899b\") " pod="openstack-kuttl-tests/nova-api-db-create-hk5sb" Mar 16 16:15:33 crc kubenswrapper[5120]: I0316 16:15:33.363738 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/afe6db0b-404e-4339-a3c6-94ae2fc4adc1-operator-scripts\") pod \"nova-cell0-db-create-kcmsv\" (UID: \"afe6db0b-404e-4339-a3c6-94ae2fc4adc1\") " pod="openstack-kuttl-tests/nova-cell0-db-create-kcmsv" Mar 16 16:15:33 crc kubenswrapper[5120]: I0316 16:15:33.376523 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/21396f29-338c-4c63-8a5d-1a664e24899b-operator-scripts\") pod \"nova-api-db-create-hk5sb\" (UID: \"21396f29-338c-4c63-8a5d-1a664e24899b\") " pod="openstack-kuttl-tests/nova-api-db-create-hk5sb" Mar 16 16:15:33 crc kubenswrapper[5120]: I0316 16:15:33.408580 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjb4f\" (UniqueName: \"kubernetes.io/projected/21396f29-338c-4c63-8a5d-1a664e24899b-kube-api-access-xjb4f\") pod \"nova-api-db-create-hk5sb\" (UID: \"21396f29-338c-4c63-8a5d-1a664e24899b\") " pod="openstack-kuttl-tests/nova-api-db-create-hk5sb" Mar 16 16:15:33 crc kubenswrapper[5120]: I0316 16:15:33.408657 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-lcrbw"] Mar 16 16:15:33 crc kubenswrapper[5120]: I0316 16:15:33.427352 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-db-create-lcrbw" Mar 16 16:15:33 crc kubenswrapper[5120]: I0316 16:15:33.440442 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-lcrbw"] Mar 16 16:15:33 crc kubenswrapper[5120]: I0316 16:15:33.465992 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7h54f\" (UniqueName: \"kubernetes.io/projected/e3b5dae5-ebf8-404d-8514-a0bf55440fbb-kube-api-access-7h54f\") pod \"nova-api-2d21-account-create-update-vmvmw\" (UID: \"e3b5dae5-ebf8-404d-8514-a0bf55440fbb\") " pod="openstack-kuttl-tests/nova-api-2d21-account-create-update-vmvmw" Mar 16 16:15:33 crc kubenswrapper[5120]: I0316 16:15:33.466057 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e3b5dae5-ebf8-404d-8514-a0bf55440fbb-operator-scripts\") pod \"nova-api-2d21-account-create-update-vmvmw\" (UID: \"e3b5dae5-ebf8-404d-8514-a0bf55440fbb\") " pod="openstack-kuttl-tests/nova-api-2d21-account-create-update-vmvmw" Mar 16 16:15:33 crc kubenswrapper[5120]: I0316 16:15:33.466087 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sb57h\" (UniqueName: \"kubernetes.io/projected/afe6db0b-404e-4339-a3c6-94ae2fc4adc1-kube-api-access-sb57h\") pod \"nova-cell0-db-create-kcmsv\" (UID: \"afe6db0b-404e-4339-a3c6-94ae2fc4adc1\") " pod="openstack-kuttl-tests/nova-cell0-db-create-kcmsv" Mar 16 16:15:33 crc kubenswrapper[5120]: I0316 16:15:33.466180 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/afe6db0b-404e-4339-a3c6-94ae2fc4adc1-operator-scripts\") pod \"nova-cell0-db-create-kcmsv\" (UID: \"afe6db0b-404e-4339-a3c6-94ae2fc4adc1\") " pod="openstack-kuttl-tests/nova-cell0-db-create-kcmsv" Mar 16 16:15:33 crc kubenswrapper[5120]: I0316 16:15:33.468100 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/afe6db0b-404e-4339-a3c6-94ae2fc4adc1-operator-scripts\") pod \"nova-cell0-db-create-kcmsv\" (UID: \"afe6db0b-404e-4339-a3c6-94ae2fc4adc1\") " pod="openstack-kuttl-tests/nova-cell0-db-create-kcmsv" Mar 16 16:15:33 crc kubenswrapper[5120]: I0316 16:15:33.490790 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-6758-account-create-update-mb8v8"] Mar 16 16:15:33 crc kubenswrapper[5120]: I0316 16:15:33.495709 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-6758-account-create-update-mb8v8" Mar 16 16:15:33 crc kubenswrapper[5120]: I0316 16:15:33.497255 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sb57h\" (UniqueName: \"kubernetes.io/projected/afe6db0b-404e-4339-a3c6-94ae2fc4adc1-kube-api-access-sb57h\") pod \"nova-cell0-db-create-kcmsv\" (UID: \"afe6db0b-404e-4339-a3c6-94ae2fc4adc1\") " pod="openstack-kuttl-tests/nova-cell0-db-create-kcmsv" Mar 16 16:15:33 crc kubenswrapper[5120]: I0316 16:15:33.499781 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-db-secret\"" Mar 16 16:15:33 crc kubenswrapper[5120]: I0316 16:15:33.503100 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-6758-account-create-update-mb8v8"] Mar 16 16:15:33 crc kubenswrapper[5120]: I0316 16:15:33.563202 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-db-create-kcmsv" Mar 16 16:15:33 crc kubenswrapper[5120]: I0316 16:15:33.567725 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7h54f\" (UniqueName: \"kubernetes.io/projected/e3b5dae5-ebf8-404d-8514-a0bf55440fbb-kube-api-access-7h54f\") pod \"nova-api-2d21-account-create-update-vmvmw\" (UID: \"e3b5dae5-ebf8-404d-8514-a0bf55440fbb\") " pod="openstack-kuttl-tests/nova-api-2d21-account-create-update-vmvmw" Mar 16 16:15:33 crc kubenswrapper[5120]: I0316 16:15:33.567805 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e3b5dae5-ebf8-404d-8514-a0bf55440fbb-operator-scripts\") pod \"nova-api-2d21-account-create-update-vmvmw\" (UID: \"e3b5dae5-ebf8-404d-8514-a0bf55440fbb\") " pod="openstack-kuttl-tests/nova-api-2d21-account-create-update-vmvmw" Mar 16 16:15:33 crc kubenswrapper[5120]: I0316 16:15:33.567834 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/05833667-2f2c-4785-89d7-1cfaaf139ebb-operator-scripts\") pod \"nova-cell1-db-create-lcrbw\" (UID: \"05833667-2f2c-4785-89d7-1cfaaf139ebb\") " pod="openstack-kuttl-tests/nova-cell1-db-create-lcrbw" Mar 16 16:15:33 crc kubenswrapper[5120]: I0316 16:15:33.568023 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rcct5\" (UniqueName: \"kubernetes.io/projected/05833667-2f2c-4785-89d7-1cfaaf139ebb-kube-api-access-rcct5\") pod \"nova-cell1-db-create-lcrbw\" (UID: \"05833667-2f2c-4785-89d7-1cfaaf139ebb\") " pod="openstack-kuttl-tests/nova-cell1-db-create-lcrbw" Mar 16 16:15:33 crc kubenswrapper[5120]: I0316 16:15:33.568729 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e3b5dae5-ebf8-404d-8514-a0bf55440fbb-operator-scripts\") pod \"nova-api-2d21-account-create-update-vmvmw\" (UID: \"e3b5dae5-ebf8-404d-8514-a0bf55440fbb\") " pod="openstack-kuttl-tests/nova-api-2d21-account-create-update-vmvmw" Mar 16 16:15:33 crc kubenswrapper[5120]: I0316 16:15:33.589802 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7h54f\" (UniqueName: \"kubernetes.io/projected/e3b5dae5-ebf8-404d-8514-a0bf55440fbb-kube-api-access-7h54f\") pod \"nova-api-2d21-account-create-update-vmvmw\" (UID: \"e3b5dae5-ebf8-404d-8514-a0bf55440fbb\") " pod="openstack-kuttl-tests/nova-api-2d21-account-create-update-vmvmw" Mar 16 16:15:33 crc kubenswrapper[5120]: I0316 16:15:33.627598 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-2d21-account-create-update-vmvmw" Mar 16 16:15:33 crc kubenswrapper[5120]: I0316 16:15:33.669754 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rcct5\" (UniqueName: \"kubernetes.io/projected/05833667-2f2c-4785-89d7-1cfaaf139ebb-kube-api-access-rcct5\") pod \"nova-cell1-db-create-lcrbw\" (UID: \"05833667-2f2c-4785-89d7-1cfaaf139ebb\") " pod="openstack-kuttl-tests/nova-cell1-db-create-lcrbw" Mar 16 16:15:33 crc kubenswrapper[5120]: I0316 16:15:33.669871 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwb97\" (UniqueName: \"kubernetes.io/projected/acdd6b61-6a50-47b4-b7fd-8c308277843d-kube-api-access-jwb97\") pod \"nova-cell0-6758-account-create-update-mb8v8\" (UID: \"acdd6b61-6a50-47b4-b7fd-8c308277843d\") " pod="openstack-kuttl-tests/nova-cell0-6758-account-create-update-mb8v8" Mar 16 16:15:33 crc kubenswrapper[5120]: I0316 16:15:33.670016 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/acdd6b61-6a50-47b4-b7fd-8c308277843d-operator-scripts\") pod \"nova-cell0-6758-account-create-update-mb8v8\" (UID: \"acdd6b61-6a50-47b4-b7fd-8c308277843d\") " pod="openstack-kuttl-tests/nova-cell0-6758-account-create-update-mb8v8" Mar 16 16:15:33 crc kubenswrapper[5120]: I0316 16:15:33.670089 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/05833667-2f2c-4785-89d7-1cfaaf139ebb-operator-scripts\") pod \"nova-cell1-db-create-lcrbw\" (UID: \"05833667-2f2c-4785-89d7-1cfaaf139ebb\") " pod="openstack-kuttl-tests/nova-cell1-db-create-lcrbw" Mar 16 16:15:33 crc kubenswrapper[5120]: I0316 16:15:33.671343 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/05833667-2f2c-4785-89d7-1cfaaf139ebb-operator-scripts\") pod \"nova-cell1-db-create-lcrbw\" (UID: \"05833667-2f2c-4785-89d7-1cfaaf139ebb\") " pod="openstack-kuttl-tests/nova-cell1-db-create-lcrbw" Mar 16 16:15:33 crc kubenswrapper[5120]: I0316 16:15:33.675185 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-5dfe-account-create-update-wf5pw"] Mar 16 16:15:33 crc kubenswrapper[5120]: I0316 16:15:33.682562 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-5dfe-account-create-update-wf5pw" Mar 16 16:15:33 crc kubenswrapper[5120]: I0316 16:15:33.682589 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-db-create-hk5sb" Mar 16 16:15:33 crc kubenswrapper[5120]: I0316 16:15:33.686939 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-db-secret\"" Mar 16 16:15:33 crc kubenswrapper[5120]: I0316 16:15:33.692583 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-5dfe-account-create-update-wf5pw"] Mar 16 16:15:33 crc kubenswrapper[5120]: I0316 16:15:33.698171 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcct5\" (UniqueName: \"kubernetes.io/projected/05833667-2f2c-4785-89d7-1cfaaf139ebb-kube-api-access-rcct5\") pod \"nova-cell1-db-create-lcrbw\" (UID: \"05833667-2f2c-4785-89d7-1cfaaf139ebb\") " pod="openstack-kuttl-tests/nova-cell1-db-create-lcrbw" Mar 16 16:15:33 crc kubenswrapper[5120]: I0316 16:15:33.772685 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/acdd6b61-6a50-47b4-b7fd-8c308277843d-operator-scripts\") pod \"nova-cell0-6758-account-create-update-mb8v8\" (UID: \"acdd6b61-6a50-47b4-b7fd-8c308277843d\") " pod="openstack-kuttl-tests/nova-cell0-6758-account-create-update-mb8v8" Mar 16 16:15:33 crc kubenswrapper[5120]: I0316 16:15:33.773849 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7gfl\" (UniqueName: \"kubernetes.io/projected/23283298-2c56-4b32-b74b-4b84c81a14ba-kube-api-access-p7gfl\") pod \"nova-cell1-5dfe-account-create-update-wf5pw\" (UID: \"23283298-2c56-4b32-b74b-4b84c81a14ba\") " pod="openstack-kuttl-tests/nova-cell1-5dfe-account-create-update-wf5pw" Mar 16 16:15:33 crc kubenswrapper[5120]: I0316 16:15:33.774152 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jwb97\" (UniqueName: \"kubernetes.io/projected/acdd6b61-6a50-47b4-b7fd-8c308277843d-kube-api-access-jwb97\") pod \"nova-cell0-6758-account-create-update-mb8v8\" (UID: \"acdd6b61-6a50-47b4-b7fd-8c308277843d\") " pod="openstack-kuttl-tests/nova-cell0-6758-account-create-update-mb8v8" Mar 16 16:15:33 crc kubenswrapper[5120]: I0316 16:15:33.774297 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/23283298-2c56-4b32-b74b-4b84c81a14ba-operator-scripts\") pod \"nova-cell1-5dfe-account-create-update-wf5pw\" (UID: \"23283298-2c56-4b32-b74b-4b84c81a14ba\") " pod="openstack-kuttl-tests/nova-cell1-5dfe-account-create-update-wf5pw" Mar 16 16:15:33 crc kubenswrapper[5120]: I0316 16:15:33.775010 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/acdd6b61-6a50-47b4-b7fd-8c308277843d-operator-scripts\") pod \"nova-cell0-6758-account-create-update-mb8v8\" (UID: \"acdd6b61-6a50-47b4-b7fd-8c308277843d\") " pod="openstack-kuttl-tests/nova-cell0-6758-account-create-update-mb8v8" Mar 16 16:15:33 crc kubenswrapper[5120]: I0316 16:15:33.781642 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-db-create-lcrbw" Mar 16 16:15:33 crc kubenswrapper[5120]: I0316 16:15:33.796645 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwb97\" (UniqueName: \"kubernetes.io/projected/acdd6b61-6a50-47b4-b7fd-8c308277843d-kube-api-access-jwb97\") pod \"nova-cell0-6758-account-create-update-mb8v8\" (UID: \"acdd6b61-6a50-47b4-b7fd-8c308277843d\") " pod="openstack-kuttl-tests/nova-cell0-6758-account-create-update-mb8v8" Mar 16 16:15:33 crc kubenswrapper[5120]: I0316 16:15:33.809392 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-6758-account-create-update-mb8v8" Mar 16 16:15:33 crc kubenswrapper[5120]: I0316 16:15:33.877176 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/23283298-2c56-4b32-b74b-4b84c81a14ba-operator-scripts\") pod \"nova-cell1-5dfe-account-create-update-wf5pw\" (UID: \"23283298-2c56-4b32-b74b-4b84c81a14ba\") " pod="openstack-kuttl-tests/nova-cell1-5dfe-account-create-update-wf5pw" Mar 16 16:15:33 crc kubenswrapper[5120]: I0316 16:15:33.877616 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p7gfl\" (UniqueName: \"kubernetes.io/projected/23283298-2c56-4b32-b74b-4b84c81a14ba-kube-api-access-p7gfl\") pod \"nova-cell1-5dfe-account-create-update-wf5pw\" (UID: \"23283298-2c56-4b32-b74b-4b84c81a14ba\") " pod="openstack-kuttl-tests/nova-cell1-5dfe-account-create-update-wf5pw" Mar 16 16:15:33 crc kubenswrapper[5120]: I0316 16:15:33.878235 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/23283298-2c56-4b32-b74b-4b84c81a14ba-operator-scripts\") pod \"nova-cell1-5dfe-account-create-update-wf5pw\" (UID: \"23283298-2c56-4b32-b74b-4b84c81a14ba\") " pod="openstack-kuttl-tests/nova-cell1-5dfe-account-create-update-wf5pw" Mar 16 16:15:33 crc kubenswrapper[5120]: I0316 16:15:33.894687 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7gfl\" (UniqueName: \"kubernetes.io/projected/23283298-2c56-4b32-b74b-4b84c81a14ba-kube-api-access-p7gfl\") pod \"nova-cell1-5dfe-account-create-update-wf5pw\" (UID: \"23283298-2c56-4b32-b74b-4b84c81a14ba\") " pod="openstack-kuttl-tests/nova-cell1-5dfe-account-create-update-wf5pw" Mar 16 16:15:34 crc kubenswrapper[5120]: I0316 16:15:34.036061 5120 generic.go:358] "Generic (PLEG): container finished" podID="3e3a1a48-35af-43bb-ba48-263697db6cc5" containerID="5e1f746bc2717412dc835d042a25537512dc44835951b00fa8cd18d024891b29" exitCode=0 Mar 16 16:15:34 crc kubenswrapper[5120]: I0316 16:15:34.036384 5120 generic.go:358] "Generic (PLEG): container finished" podID="3e3a1a48-35af-43bb-ba48-263697db6cc5" containerID="797802849eec37703c2ba470d7ca9f4e8eeb562707348b014730a24013477f0f" exitCode=2 Mar 16 16:15:34 crc kubenswrapper[5120]: I0316 16:15:34.036391 5120 generic.go:358] "Generic (PLEG): container finished" podID="3e3a1a48-35af-43bb-ba48-263697db6cc5" containerID="9408531d55cb6a1ac74d2d5c8d3f11abfbbe2c44fb1c81ce4e3b6edcb48af836" exitCode=0 Mar 16 16:15:34 crc kubenswrapper[5120]: I0316 16:15:34.036192 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"3e3a1a48-35af-43bb-ba48-263697db6cc5","Type":"ContainerDied","Data":"5e1f746bc2717412dc835d042a25537512dc44835951b00fa8cd18d024891b29"} Mar 16 16:15:34 crc kubenswrapper[5120]: I0316 16:15:34.036543 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"3e3a1a48-35af-43bb-ba48-263697db6cc5","Type":"ContainerDied","Data":"797802849eec37703c2ba470d7ca9f4e8eeb562707348b014730a24013477f0f"} Mar 16 16:15:34 crc kubenswrapper[5120]: I0316 16:15:34.036568 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"3e3a1a48-35af-43bb-ba48-263697db6cc5","Type":"ContainerDied","Data":"9408531d55cb6a1ac74d2d5c8d3f11abfbbe2c44fb1c81ce4e3b6edcb48af836"} Mar 16 16:15:34 crc kubenswrapper[5120]: I0316 16:15:34.121346 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-kcmsv"] Mar 16 16:15:34 crc kubenswrapper[5120]: W0316 16:15:34.127507 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podafe6db0b_404e_4339_a3c6_94ae2fc4adc1.slice/crio-beb6b43290e0a7939ab58139bc7b57a736c7ecf9d63ed77a37835a73566b547b WatchSource:0}: Error finding container beb6b43290e0a7939ab58139bc7b57a736c7ecf9d63ed77a37835a73566b547b: Status 404 returned error can't find the container with id beb6b43290e0a7939ab58139bc7b57a736c7ecf9d63ed77a37835a73566b547b Mar 16 16:15:34 crc kubenswrapper[5120]: I0316 16:15:34.160998 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-5dfe-account-create-update-wf5pw" Mar 16 16:15:34 crc kubenswrapper[5120]: I0316 16:15:34.278394 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-hk5sb"] Mar 16 16:15:34 crc kubenswrapper[5120]: I0316 16:15:34.291110 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:15:34 crc kubenswrapper[5120]: I0316 16:15:34.291430 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="e8c1b04b-5169-424c-aa78-d0ed21f9ad44" containerName="glance-log" containerID="cri-o://f1f2253aadf0697eda77b9b90b4349360ca943b2a5f09261ba0d906abdb6d76a" gracePeriod=30 Mar 16 16:15:34 crc kubenswrapper[5120]: I0316 16:15:34.292097 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="e8c1b04b-5169-424c-aa78-d0ed21f9ad44" containerName="glance-httpd" containerID="cri-o://ca48afbf4da3994c288dd6434d0ca152b157371aac8a2f09d421e8ba98321a5b" gracePeriod=30 Mar 16 16:15:34 crc kubenswrapper[5120]: W0316 16:15:34.297365 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod21396f29_338c_4c63_8a5d_1a664e24899b.slice/crio-500a964092447c1d6a19eb2722f6e64d8c34be0ff7a54298142dd09426e2a1db WatchSource:0}: Error finding container 500a964092447c1d6a19eb2722f6e64d8c34be0ff7a54298142dd09426e2a1db: Status 404 returned error can't find the container with id 500a964092447c1d6a19eb2722f6e64d8c34be0ff7a54298142dd09426e2a1db Mar 16 16:15:34 crc kubenswrapper[5120]: I0316 16:15:34.303720 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-2d21-account-create-update-vmvmw"] Mar 16 16:15:34 crc kubenswrapper[5120]: W0316 16:15:34.323771 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode3b5dae5_ebf8_404d_8514_a0bf55440fbb.slice/crio-c579bb59247c1f1d338c3acfa1473dcf9f695ac80b73781e9ddbb2c3fcad2eef WatchSource:0}: Error finding container c579bb59247c1f1d338c3acfa1473dcf9f695ac80b73781e9ddbb2c3fcad2eef: Status 404 returned error can't find the container with id c579bb59247c1f1d338c3acfa1473dcf9f695ac80b73781e9ddbb2c3fcad2eef Mar 16 16:15:34 crc kubenswrapper[5120]: I0316 16:15:34.390463 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-lcrbw"] Mar 16 16:15:34 crc kubenswrapper[5120]: I0316 16:15:34.467944 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-6758-account-create-update-mb8v8"] Mar 16 16:15:34 crc kubenswrapper[5120]: I0316 16:15:34.681242 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-5dfe-account-create-update-wf5pw"] Mar 16 16:15:34 crc kubenswrapper[5120]: W0316 16:15:34.694226 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod23283298_2c56_4b32_b74b_4b84c81a14ba.slice/crio-901effdc0811cc5b889bbbc66f321444822d4d3c36b46f823cc25049a84f31f7 WatchSource:0}: Error finding container 901effdc0811cc5b889bbbc66f321444822d4d3c36b46f823cc25049a84f31f7: Status 404 returned error can't find the container with id 901effdc0811cc5b889bbbc66f321444822d4d3c36b46f823cc25049a84f31f7 Mar 16 16:15:35 crc kubenswrapper[5120]: I0316 16:15:35.046375 5120 generic.go:358] "Generic (PLEG): container finished" podID="e8c1b04b-5169-424c-aa78-d0ed21f9ad44" containerID="f1f2253aadf0697eda77b9b90b4349360ca943b2a5f09261ba0d906abdb6d76a" exitCode=143 Mar 16 16:15:35 crc kubenswrapper[5120]: I0316 16:15:35.046694 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"e8c1b04b-5169-424c-aa78-d0ed21f9ad44","Type":"ContainerDied","Data":"f1f2253aadf0697eda77b9b90b4349360ca943b2a5f09261ba0d906abdb6d76a"} Mar 16 16:15:35 crc kubenswrapper[5120]: I0316 16:15:35.048799 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-5dfe-account-create-update-wf5pw" event={"ID":"23283298-2c56-4b32-b74b-4b84c81a14ba","Type":"ContainerStarted","Data":"a10ed440c92b700107c14d3e35ad0a0112cd5f7bac5d0f25b91e51b3e11d40ff"} Mar 16 16:15:35 crc kubenswrapper[5120]: I0316 16:15:35.048857 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-5dfe-account-create-update-wf5pw" event={"ID":"23283298-2c56-4b32-b74b-4b84c81a14ba","Type":"ContainerStarted","Data":"901effdc0811cc5b889bbbc66f321444822d4d3c36b46f823cc25049a84f31f7"} Mar 16 16:15:35 crc kubenswrapper[5120]: I0316 16:15:35.050329 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-db-create-lcrbw" event={"ID":"05833667-2f2c-4785-89d7-1cfaaf139ebb","Type":"ContainerStarted","Data":"ad8f6c4dcb3659e2c4cbe189da7a816ad948ca69a309d3a2140b84893c720ed6"} Mar 16 16:15:35 crc kubenswrapper[5120]: I0316 16:15:35.050365 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-db-create-lcrbw" event={"ID":"05833667-2f2c-4785-89d7-1cfaaf139ebb","Type":"ContainerStarted","Data":"ecf6566c2d7364406cef455bbeb55535c2abd1bbb56ac109b1516b8e7eaf51df"} Mar 16 16:15:35 crc kubenswrapper[5120]: I0316 16:15:35.051787 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-6758-account-create-update-mb8v8" event={"ID":"acdd6b61-6a50-47b4-b7fd-8c308277843d","Type":"ContainerStarted","Data":"79f086e72f0b3dcc57867b036c16615a4da1d7f137461f590af97b4617e73cc4"} Mar 16 16:15:35 crc kubenswrapper[5120]: I0316 16:15:35.051835 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-6758-account-create-update-mb8v8" event={"ID":"acdd6b61-6a50-47b4-b7fd-8c308277843d","Type":"ContainerStarted","Data":"1855ce583777ed489ff7b7b4be9d6e62c4f3c0e7ad8e356271d41de967ed1da2"} Mar 16 16:15:35 crc kubenswrapper[5120]: I0316 16:15:35.056894 5120 generic.go:358] "Generic (PLEG): container finished" podID="afe6db0b-404e-4339-a3c6-94ae2fc4adc1" containerID="3d30ff5d5b126cc2a3c4857604ac839e740aeb06884d340ea105459e0cfc131b" exitCode=0 Mar 16 16:15:35 crc kubenswrapper[5120]: I0316 16:15:35.057050 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-db-create-kcmsv" event={"ID":"afe6db0b-404e-4339-a3c6-94ae2fc4adc1","Type":"ContainerDied","Data":"3d30ff5d5b126cc2a3c4857604ac839e740aeb06884d340ea105459e0cfc131b"} Mar 16 16:15:35 crc kubenswrapper[5120]: I0316 16:15:35.057093 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-db-create-kcmsv" event={"ID":"afe6db0b-404e-4339-a3c6-94ae2fc4adc1","Type":"ContainerStarted","Data":"beb6b43290e0a7939ab58139bc7b57a736c7ecf9d63ed77a37835a73566b547b"} Mar 16 16:15:35 crc kubenswrapper[5120]: I0316 16:15:35.059405 5120 generic.go:358] "Generic (PLEG): container finished" podID="21396f29-338c-4c63-8a5d-1a664e24899b" containerID="a3311cf05ee4f0b66524c04257f99504b0af3167a74573741bd8a50f6873690c" exitCode=0 Mar 16 16:15:35 crc kubenswrapper[5120]: I0316 16:15:35.059491 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-db-create-hk5sb" event={"ID":"21396f29-338c-4c63-8a5d-1a664e24899b","Type":"ContainerDied","Data":"a3311cf05ee4f0b66524c04257f99504b0af3167a74573741bd8a50f6873690c"} Mar 16 16:15:35 crc kubenswrapper[5120]: I0316 16:15:35.059541 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-db-create-hk5sb" event={"ID":"21396f29-338c-4c63-8a5d-1a664e24899b","Type":"ContainerStarted","Data":"500a964092447c1d6a19eb2722f6e64d8c34be0ff7a54298142dd09426e2a1db"} Mar 16 16:15:35 crc kubenswrapper[5120]: I0316 16:15:35.061453 5120 generic.go:358] "Generic (PLEG): container finished" podID="e3b5dae5-ebf8-404d-8514-a0bf55440fbb" containerID="725f4e686ce47597a3e0b8dd9e7330d349e62a035ac96bd7354c4a2e53d2ac39" exitCode=0 Mar 16 16:15:35 crc kubenswrapper[5120]: I0316 16:15:35.061487 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-2d21-account-create-update-vmvmw" event={"ID":"e3b5dae5-ebf8-404d-8514-a0bf55440fbb","Type":"ContainerDied","Data":"725f4e686ce47597a3e0b8dd9e7330d349e62a035ac96bd7354c4a2e53d2ac39"} Mar 16 16:15:35 crc kubenswrapper[5120]: I0316 16:15:35.061526 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-2d21-account-create-update-vmvmw" event={"ID":"e3b5dae5-ebf8-404d-8514-a0bf55440fbb","Type":"ContainerStarted","Data":"c579bb59247c1f1d338c3acfa1473dcf9f695ac80b73781e9ddbb2c3fcad2eef"} Mar 16 16:15:35 crc kubenswrapper[5120]: I0316 16:15:35.067281 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-5dfe-account-create-update-wf5pw" podStartSLOduration=2.067262736 podStartE2EDuration="2.067262736s" podCreationTimestamp="2026-03-16 16:15:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:15:35.06256268 +0000 UTC m=+2637.216494337" watchObservedRunningTime="2026-03-16 16:15:35.067262736 +0000 UTC m=+2637.221194393" Mar 16 16:15:35 crc kubenswrapper[5120]: I0316 16:15:35.099146 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-6758-account-create-update-mb8v8" podStartSLOduration=2.09912523 podStartE2EDuration="2.09912523s" podCreationTimestamp="2026-03-16 16:15:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:15:35.092204105 +0000 UTC m=+2637.246135762" watchObservedRunningTime="2026-03-16 16:15:35.09912523 +0000 UTC m=+2637.253056887" Mar 16 16:15:35 crc kubenswrapper[5120]: I0316 16:15:35.141588 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:15:35 crc kubenswrapper[5120]: I0316 16:15:35.141929 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="f332d01c-8618-4bf0-adda-5d5e90a43f7a" containerName="glance-log" containerID="cri-o://a47610b6ca8ef781ee59c32c45df41861758ff434fa31833904d994d39ad8933" gracePeriod=30 Mar 16 16:15:35 crc kubenswrapper[5120]: I0316 16:15:35.142048 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="f332d01c-8618-4bf0-adda-5d5e90a43f7a" containerName="glance-httpd" containerID="cri-o://cd8b1379c58f4aa09b67615c5b735aa09b7525a1898eb7095fe9570d88902489" gracePeriod=30 Mar 16 16:15:35 crc kubenswrapper[5120]: I0316 16:15:35.177255 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-db-create-lcrbw" podStartSLOduration=2.177235754 podStartE2EDuration="2.177235754s" podCreationTimestamp="2026-03-16 16:15:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:15:35.132154365 +0000 UTC m=+2637.286086022" watchObservedRunningTime="2026-03-16 16:15:35.177235754 +0000 UTC m=+2637.331167411" Mar 16 16:15:35 crc kubenswrapper[5120]: E0316 16:15:35.431476 5120 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod05833667_2f2c_4785_89d7_1cfaaf139ebb.slice/crio-ad8f6c4dcb3659e2c4cbe189da7a816ad948ca69a309d3a2140b84893c720ed6.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod05833667_2f2c_4785_89d7_1cfaaf139ebb.slice/crio-conmon-ad8f6c4dcb3659e2c4cbe189da7a816ad948ca69a309d3a2140b84893c720ed6.scope\": RecentStats: unable to find data in memory cache]" Mar 16 16:15:36 crc kubenswrapper[5120]: I0316 16:15:36.070313 5120 generic.go:358] "Generic (PLEG): container finished" podID="23283298-2c56-4b32-b74b-4b84c81a14ba" containerID="a10ed440c92b700107c14d3e35ad0a0112cd5f7bac5d0f25b91e51b3e11d40ff" exitCode=0 Mar 16 16:15:36 crc kubenswrapper[5120]: I0316 16:15:36.070438 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-5dfe-account-create-update-wf5pw" event={"ID":"23283298-2c56-4b32-b74b-4b84c81a14ba","Type":"ContainerDied","Data":"a10ed440c92b700107c14d3e35ad0a0112cd5f7bac5d0f25b91e51b3e11d40ff"} Mar 16 16:15:36 crc kubenswrapper[5120]: I0316 16:15:36.072113 5120 generic.go:358] "Generic (PLEG): container finished" podID="05833667-2f2c-4785-89d7-1cfaaf139ebb" containerID="ad8f6c4dcb3659e2c4cbe189da7a816ad948ca69a309d3a2140b84893c720ed6" exitCode=0 Mar 16 16:15:36 crc kubenswrapper[5120]: I0316 16:15:36.072158 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-db-create-lcrbw" event={"ID":"05833667-2f2c-4785-89d7-1cfaaf139ebb","Type":"ContainerDied","Data":"ad8f6c4dcb3659e2c4cbe189da7a816ad948ca69a309d3a2140b84893c720ed6"} Mar 16 16:15:36 crc kubenswrapper[5120]: I0316 16:15:36.073693 5120 generic.go:358] "Generic (PLEG): container finished" podID="acdd6b61-6a50-47b4-b7fd-8c308277843d" containerID="79f086e72f0b3dcc57867b036c16615a4da1d7f137461f590af97b4617e73cc4" exitCode=0 Mar 16 16:15:36 crc kubenswrapper[5120]: I0316 16:15:36.073786 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-6758-account-create-update-mb8v8" event={"ID":"acdd6b61-6a50-47b4-b7fd-8c308277843d","Type":"ContainerDied","Data":"79f086e72f0b3dcc57867b036c16615a4da1d7f137461f590af97b4617e73cc4"} Mar 16 16:15:36 crc kubenswrapper[5120]: I0316 16:15:36.075531 5120 generic.go:358] "Generic (PLEG): container finished" podID="f332d01c-8618-4bf0-adda-5d5e90a43f7a" containerID="a47610b6ca8ef781ee59c32c45df41861758ff434fa31833904d994d39ad8933" exitCode=143 Mar 16 16:15:36 crc kubenswrapper[5120]: I0316 16:15:36.075777 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"f332d01c-8618-4bf0-adda-5d5e90a43f7a","Type":"ContainerDied","Data":"a47610b6ca8ef781ee59c32c45df41861758ff434fa31833904d994d39ad8933"} Mar 16 16:15:36 crc kubenswrapper[5120]: I0316 16:15:36.531791 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-db-create-hk5sb" Mar 16 16:15:36 crc kubenswrapper[5120]: I0316 16:15:36.544875 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/21396f29-338c-4c63-8a5d-1a664e24899b-operator-scripts\") pod \"21396f29-338c-4c63-8a5d-1a664e24899b\" (UID: \"21396f29-338c-4c63-8a5d-1a664e24899b\") " Mar 16 16:15:36 crc kubenswrapper[5120]: I0316 16:15:36.544984 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xjb4f\" (UniqueName: \"kubernetes.io/projected/21396f29-338c-4c63-8a5d-1a664e24899b-kube-api-access-xjb4f\") pod \"21396f29-338c-4c63-8a5d-1a664e24899b\" (UID: \"21396f29-338c-4c63-8a5d-1a664e24899b\") " Mar 16 16:15:36 crc kubenswrapper[5120]: I0316 16:15:36.546869 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/21396f29-338c-4c63-8a5d-1a664e24899b-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "21396f29-338c-4c63-8a5d-1a664e24899b" (UID: "21396f29-338c-4c63-8a5d-1a664e24899b"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:15:36 crc kubenswrapper[5120]: I0316 16:15:36.558543 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21396f29-338c-4c63-8a5d-1a664e24899b-kube-api-access-xjb4f" (OuterVolumeSpecName: "kube-api-access-xjb4f") pod "21396f29-338c-4c63-8a5d-1a664e24899b" (UID: "21396f29-338c-4c63-8a5d-1a664e24899b"). InnerVolumeSpecName "kube-api-access-xjb4f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:15:36 crc kubenswrapper[5120]: I0316 16:15:36.634579 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-db-create-kcmsv" Mar 16 16:15:36 crc kubenswrapper[5120]: I0316 16:15:36.639688 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-2d21-account-create-update-vmvmw" Mar 16 16:15:36 crc kubenswrapper[5120]: I0316 16:15:36.646906 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7h54f\" (UniqueName: \"kubernetes.io/projected/e3b5dae5-ebf8-404d-8514-a0bf55440fbb-kube-api-access-7h54f\") pod \"e3b5dae5-ebf8-404d-8514-a0bf55440fbb\" (UID: \"e3b5dae5-ebf8-404d-8514-a0bf55440fbb\") " Mar 16 16:15:36 crc kubenswrapper[5120]: I0316 16:15:36.646951 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e3b5dae5-ebf8-404d-8514-a0bf55440fbb-operator-scripts\") pod \"e3b5dae5-ebf8-404d-8514-a0bf55440fbb\" (UID: \"e3b5dae5-ebf8-404d-8514-a0bf55440fbb\") " Mar 16 16:15:36 crc kubenswrapper[5120]: I0316 16:15:36.647176 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sb57h\" (UniqueName: \"kubernetes.io/projected/afe6db0b-404e-4339-a3c6-94ae2fc4adc1-kube-api-access-sb57h\") pod \"afe6db0b-404e-4339-a3c6-94ae2fc4adc1\" (UID: \"afe6db0b-404e-4339-a3c6-94ae2fc4adc1\") " Mar 16 16:15:36 crc kubenswrapper[5120]: I0316 16:15:36.647265 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/afe6db0b-404e-4339-a3c6-94ae2fc4adc1-operator-scripts\") pod \"afe6db0b-404e-4339-a3c6-94ae2fc4adc1\" (UID: \"afe6db0b-404e-4339-a3c6-94ae2fc4adc1\") " Mar 16 16:15:36 crc kubenswrapper[5120]: I0316 16:15:36.647650 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/21396f29-338c-4c63-8a5d-1a664e24899b-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:15:36 crc kubenswrapper[5120]: I0316 16:15:36.647661 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xjb4f\" (UniqueName: \"kubernetes.io/projected/21396f29-338c-4c63-8a5d-1a664e24899b-kube-api-access-xjb4f\") on node \"crc\" DevicePath \"\"" Mar 16 16:15:36 crc kubenswrapper[5120]: I0316 16:15:36.648030 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/afe6db0b-404e-4339-a3c6-94ae2fc4adc1-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "afe6db0b-404e-4339-a3c6-94ae2fc4adc1" (UID: "afe6db0b-404e-4339-a3c6-94ae2fc4adc1"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:15:36 crc kubenswrapper[5120]: I0316 16:15:36.650744 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e3b5dae5-ebf8-404d-8514-a0bf55440fbb-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "e3b5dae5-ebf8-404d-8514-a0bf55440fbb" (UID: "e3b5dae5-ebf8-404d-8514-a0bf55440fbb"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:15:36 crc kubenswrapper[5120]: I0316 16:15:36.654021 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3b5dae5-ebf8-404d-8514-a0bf55440fbb-kube-api-access-7h54f" (OuterVolumeSpecName: "kube-api-access-7h54f") pod "e3b5dae5-ebf8-404d-8514-a0bf55440fbb" (UID: "e3b5dae5-ebf8-404d-8514-a0bf55440fbb"). InnerVolumeSpecName "kube-api-access-7h54f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:15:36 crc kubenswrapper[5120]: I0316 16:15:36.663932 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/afe6db0b-404e-4339-a3c6-94ae2fc4adc1-kube-api-access-sb57h" (OuterVolumeSpecName: "kube-api-access-sb57h") pod "afe6db0b-404e-4339-a3c6-94ae2fc4adc1" (UID: "afe6db0b-404e-4339-a3c6-94ae2fc4adc1"). InnerVolumeSpecName "kube-api-access-sb57h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:15:36 crc kubenswrapper[5120]: I0316 16:15:36.750653 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/afe6db0b-404e-4339-a3c6-94ae2fc4adc1-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:15:36 crc kubenswrapper[5120]: I0316 16:15:36.750681 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7h54f\" (UniqueName: \"kubernetes.io/projected/e3b5dae5-ebf8-404d-8514-a0bf55440fbb-kube-api-access-7h54f\") on node \"crc\" DevicePath \"\"" Mar 16 16:15:36 crc kubenswrapper[5120]: I0316 16:15:36.750692 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e3b5dae5-ebf8-404d-8514-a0bf55440fbb-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:15:36 crc kubenswrapper[5120]: I0316 16:15:36.750710 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sb57h\" (UniqueName: \"kubernetes.io/projected/afe6db0b-404e-4339-a3c6-94ae2fc4adc1-kube-api-access-sb57h\") on node \"crc\" DevicePath \"\"" Mar 16 16:15:37 crc kubenswrapper[5120]: I0316 16:15:37.084121 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-db-create-kcmsv" event={"ID":"afe6db0b-404e-4339-a3c6-94ae2fc4adc1","Type":"ContainerDied","Data":"beb6b43290e0a7939ab58139bc7b57a736c7ecf9d63ed77a37835a73566b547b"} Mar 16 16:15:37 crc kubenswrapper[5120]: I0316 16:15:37.085268 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="beb6b43290e0a7939ab58139bc7b57a736c7ecf9d63ed77a37835a73566b547b" Mar 16 16:15:37 crc kubenswrapper[5120]: I0316 16:15:37.084404 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-db-create-kcmsv" Mar 16 16:15:37 crc kubenswrapper[5120]: I0316 16:15:37.086949 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-db-create-hk5sb" event={"ID":"21396f29-338c-4c63-8a5d-1a664e24899b","Type":"ContainerDied","Data":"500a964092447c1d6a19eb2722f6e64d8c34be0ff7a54298142dd09426e2a1db"} Mar 16 16:15:37 crc kubenswrapper[5120]: I0316 16:15:37.087062 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="500a964092447c1d6a19eb2722f6e64d8c34be0ff7a54298142dd09426e2a1db" Mar 16 16:15:37 crc kubenswrapper[5120]: I0316 16:15:37.087248 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-db-create-hk5sb" Mar 16 16:15:37 crc kubenswrapper[5120]: I0316 16:15:37.089999 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-2d21-account-create-update-vmvmw" Mar 16 16:15:37 crc kubenswrapper[5120]: I0316 16:15:37.090332 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-2d21-account-create-update-vmvmw" event={"ID":"e3b5dae5-ebf8-404d-8514-a0bf55440fbb","Type":"ContainerDied","Data":"c579bb59247c1f1d338c3acfa1473dcf9f695ac80b73781e9ddbb2c3fcad2eef"} Mar 16 16:15:37 crc kubenswrapper[5120]: I0316 16:15:37.090440 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c579bb59247c1f1d338c3acfa1473dcf9f695ac80b73781e9ddbb2c3fcad2eef" Mar 16 16:15:37 crc kubenswrapper[5120]: I0316 16:15:37.620719 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-5dfe-account-create-update-wf5pw" Mar 16 16:15:37 crc kubenswrapper[5120]: I0316 16:15:37.627680 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-6758-account-create-update-mb8v8" Mar 16 16:15:37 crc kubenswrapper[5120]: I0316 16:15:37.631506 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-db-create-lcrbw" Mar 16 16:15:37 crc kubenswrapper[5120]: I0316 16:15:37.705198 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/placement-77f5d87454-bxpdp" Mar 16 16:15:37 crc kubenswrapper[5120]: I0316 16:15:37.788329 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rcct5\" (UniqueName: \"kubernetes.io/projected/05833667-2f2c-4785-89d7-1cfaaf139ebb-kube-api-access-rcct5\") pod \"05833667-2f2c-4785-89d7-1cfaaf139ebb\" (UID: \"05833667-2f2c-4785-89d7-1cfaaf139ebb\") " Mar 16 16:15:37 crc kubenswrapper[5120]: I0316 16:15:37.788568 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/23283298-2c56-4b32-b74b-4b84c81a14ba-operator-scripts\") pod \"23283298-2c56-4b32-b74b-4b84c81a14ba\" (UID: \"23283298-2c56-4b32-b74b-4b84c81a14ba\") " Mar 16 16:15:37 crc kubenswrapper[5120]: I0316 16:15:37.788611 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/acdd6b61-6a50-47b4-b7fd-8c308277843d-operator-scripts\") pod \"acdd6b61-6a50-47b4-b7fd-8c308277843d\" (UID: \"acdd6b61-6a50-47b4-b7fd-8c308277843d\") " Mar 16 16:15:37 crc kubenswrapper[5120]: I0316 16:15:37.788638 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jwb97\" (UniqueName: \"kubernetes.io/projected/acdd6b61-6a50-47b4-b7fd-8c308277843d-kube-api-access-jwb97\") pod \"acdd6b61-6a50-47b4-b7fd-8c308277843d\" (UID: \"acdd6b61-6a50-47b4-b7fd-8c308277843d\") " Mar 16 16:15:37 crc kubenswrapper[5120]: I0316 16:15:37.788908 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p7gfl\" (UniqueName: \"kubernetes.io/projected/23283298-2c56-4b32-b74b-4b84c81a14ba-kube-api-access-p7gfl\") pod \"23283298-2c56-4b32-b74b-4b84c81a14ba\" (UID: \"23283298-2c56-4b32-b74b-4b84c81a14ba\") " Mar 16 16:15:37 crc kubenswrapper[5120]: I0316 16:15:37.788947 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/05833667-2f2c-4785-89d7-1cfaaf139ebb-operator-scripts\") pod \"05833667-2f2c-4785-89d7-1cfaaf139ebb\" (UID: \"05833667-2f2c-4785-89d7-1cfaaf139ebb\") " Mar 16 16:15:37 crc kubenswrapper[5120]: I0316 16:15:37.790182 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/05833667-2f2c-4785-89d7-1cfaaf139ebb-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "05833667-2f2c-4785-89d7-1cfaaf139ebb" (UID: "05833667-2f2c-4785-89d7-1cfaaf139ebb"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:15:37 crc kubenswrapper[5120]: I0316 16:15:37.790220 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/acdd6b61-6a50-47b4-b7fd-8c308277843d-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "acdd6b61-6a50-47b4-b7fd-8c308277843d" (UID: "acdd6b61-6a50-47b4-b7fd-8c308277843d"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:15:37 crc kubenswrapper[5120]: I0316 16:15:37.790464 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/23283298-2c56-4b32-b74b-4b84c81a14ba-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "23283298-2c56-4b32-b74b-4b84c81a14ba" (UID: "23283298-2c56-4b32-b74b-4b84c81a14ba"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:15:37 crc kubenswrapper[5120]: I0316 16:15:37.798217 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05833667-2f2c-4785-89d7-1cfaaf139ebb-kube-api-access-rcct5" (OuterVolumeSpecName: "kube-api-access-rcct5") pod "05833667-2f2c-4785-89d7-1cfaaf139ebb" (UID: "05833667-2f2c-4785-89d7-1cfaaf139ebb"). InnerVolumeSpecName "kube-api-access-rcct5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:15:37 crc kubenswrapper[5120]: I0316 16:15:37.799434 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23283298-2c56-4b32-b74b-4b84c81a14ba-kube-api-access-p7gfl" (OuterVolumeSpecName: "kube-api-access-p7gfl") pod "23283298-2c56-4b32-b74b-4b84c81a14ba" (UID: "23283298-2c56-4b32-b74b-4b84c81a14ba"). InnerVolumeSpecName "kube-api-access-p7gfl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:15:37 crc kubenswrapper[5120]: I0316 16:15:37.800152 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/acdd6b61-6a50-47b4-b7fd-8c308277843d-kube-api-access-jwb97" (OuterVolumeSpecName: "kube-api-access-jwb97") pod "acdd6b61-6a50-47b4-b7fd-8c308277843d" (UID: "acdd6b61-6a50-47b4-b7fd-8c308277843d"). InnerVolumeSpecName "kube-api-access-jwb97". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:15:37 crc kubenswrapper[5120]: I0316 16:15:37.891887 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/acdd6b61-6a50-47b4-b7fd-8c308277843d-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:15:37 crc kubenswrapper[5120]: I0316 16:15:37.891938 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jwb97\" (UniqueName: \"kubernetes.io/projected/acdd6b61-6a50-47b4-b7fd-8c308277843d-kube-api-access-jwb97\") on node \"crc\" DevicePath \"\"" Mar 16 16:15:37 crc kubenswrapper[5120]: I0316 16:15:37.891951 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p7gfl\" (UniqueName: \"kubernetes.io/projected/23283298-2c56-4b32-b74b-4b84c81a14ba-kube-api-access-p7gfl\") on node \"crc\" DevicePath \"\"" Mar 16 16:15:37 crc kubenswrapper[5120]: I0316 16:15:37.891963 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/05833667-2f2c-4785-89d7-1cfaaf139ebb-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:15:37 crc kubenswrapper[5120]: I0316 16:15:37.891976 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rcct5\" (UniqueName: \"kubernetes.io/projected/05833667-2f2c-4785-89d7-1cfaaf139ebb-kube-api-access-rcct5\") on node \"crc\" DevicePath \"\"" Mar 16 16:15:37 crc kubenswrapper[5120]: I0316 16:15:37.891987 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/23283298-2c56-4b32-b74b-4b84c81a14ba-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:15:37 crc kubenswrapper[5120]: I0316 16:15:37.976737 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:15:38 crc kubenswrapper[5120]: I0316 16:15:38.094271 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e8c1b04b-5169-424c-aa78-d0ed21f9ad44-logs\") pod \"e8c1b04b-5169-424c-aa78-d0ed21f9ad44\" (UID: \"e8c1b04b-5169-424c-aa78-d0ed21f9ad44\") " Mar 16 16:15:38 crc kubenswrapper[5120]: I0316 16:15:38.094350 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"e8c1b04b-5169-424c-aa78-d0ed21f9ad44\" (UID: \"e8c1b04b-5169-424c-aa78-d0ed21f9ad44\") " Mar 16 16:15:38 crc kubenswrapper[5120]: I0316 16:15:38.094460 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e8c1b04b-5169-424c-aa78-d0ed21f9ad44-public-tls-certs\") pod \"e8c1b04b-5169-424c-aa78-d0ed21f9ad44\" (UID: \"e8c1b04b-5169-424c-aa78-d0ed21f9ad44\") " Mar 16 16:15:38 crc kubenswrapper[5120]: I0316 16:15:38.094503 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e8c1b04b-5169-424c-aa78-d0ed21f9ad44-combined-ca-bundle\") pod \"e8c1b04b-5169-424c-aa78-d0ed21f9ad44\" (UID: \"e8c1b04b-5169-424c-aa78-d0ed21f9ad44\") " Mar 16 16:15:38 crc kubenswrapper[5120]: I0316 16:15:38.094522 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e8c1b04b-5169-424c-aa78-d0ed21f9ad44-config-data\") pod \"e8c1b04b-5169-424c-aa78-d0ed21f9ad44\" (UID: \"e8c1b04b-5169-424c-aa78-d0ed21f9ad44\") " Mar 16 16:15:38 crc kubenswrapper[5120]: I0316 16:15:38.094565 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e8c1b04b-5169-424c-aa78-d0ed21f9ad44-scripts\") pod \"e8c1b04b-5169-424c-aa78-d0ed21f9ad44\" (UID: \"e8c1b04b-5169-424c-aa78-d0ed21f9ad44\") " Mar 16 16:15:38 crc kubenswrapper[5120]: I0316 16:15:38.094645 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hx9rj\" (UniqueName: \"kubernetes.io/projected/e8c1b04b-5169-424c-aa78-d0ed21f9ad44-kube-api-access-hx9rj\") pod \"e8c1b04b-5169-424c-aa78-d0ed21f9ad44\" (UID: \"e8c1b04b-5169-424c-aa78-d0ed21f9ad44\") " Mar 16 16:15:38 crc kubenswrapper[5120]: I0316 16:15:38.095141 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/e8c1b04b-5169-424c-aa78-d0ed21f9ad44-httpd-run\") pod \"e8c1b04b-5169-424c-aa78-d0ed21f9ad44\" (UID: \"e8c1b04b-5169-424c-aa78-d0ed21f9ad44\") " Mar 16 16:15:38 crc kubenswrapper[5120]: I0316 16:15:38.094749 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8c1b04b-5169-424c-aa78-d0ed21f9ad44-logs" (OuterVolumeSpecName: "logs") pod "e8c1b04b-5169-424c-aa78-d0ed21f9ad44" (UID: "e8c1b04b-5169-424c-aa78-d0ed21f9ad44"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:15:38 crc kubenswrapper[5120]: I0316 16:15:38.096113 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8c1b04b-5169-424c-aa78-d0ed21f9ad44-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "e8c1b04b-5169-424c-aa78-d0ed21f9ad44" (UID: "e8c1b04b-5169-424c-aa78-d0ed21f9ad44"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:15:38 crc kubenswrapper[5120]: I0316 16:15:38.098013 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8c1b04b-5169-424c-aa78-d0ed21f9ad44-scripts" (OuterVolumeSpecName: "scripts") pod "e8c1b04b-5169-424c-aa78-d0ed21f9ad44" (UID: "e8c1b04b-5169-424c-aa78-d0ed21f9ad44"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:15:38 crc kubenswrapper[5120]: I0316 16:15:38.102501 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage04-crc" (OuterVolumeSpecName: "glance") pod "e8c1b04b-5169-424c-aa78-d0ed21f9ad44" (UID: "e8c1b04b-5169-424c-aa78-d0ed21f9ad44"). InnerVolumeSpecName "local-storage04-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:15:38 crc kubenswrapper[5120]: I0316 16:15:38.108254 5120 generic.go:358] "Generic (PLEG): container finished" podID="e8c1b04b-5169-424c-aa78-d0ed21f9ad44" containerID="ca48afbf4da3994c288dd6434d0ca152b157371aac8a2f09d421e8ba98321a5b" exitCode=0 Mar 16 16:15:38 crc kubenswrapper[5120]: I0316 16:15:38.108443 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"e8c1b04b-5169-424c-aa78-d0ed21f9ad44","Type":"ContainerDied","Data":"ca48afbf4da3994c288dd6434d0ca152b157371aac8a2f09d421e8ba98321a5b"} Mar 16 16:15:38 crc kubenswrapper[5120]: I0316 16:15:38.108476 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"e8c1b04b-5169-424c-aa78-d0ed21f9ad44","Type":"ContainerDied","Data":"03716c966de3b06a98abf1daffd2ca9e41d5a4950118816b8a8b38ef9bfaf786"} Mar 16 16:15:38 crc kubenswrapper[5120]: I0316 16:15:38.108499 5120 scope.go:117] "RemoveContainer" containerID="ca48afbf4da3994c288dd6434d0ca152b157371aac8a2f09d421e8ba98321a5b" Mar 16 16:15:38 crc kubenswrapper[5120]: I0316 16:15:38.108687 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:15:38 crc kubenswrapper[5120]: I0316 16:15:38.110410 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8c1b04b-5169-424c-aa78-d0ed21f9ad44-kube-api-access-hx9rj" (OuterVolumeSpecName: "kube-api-access-hx9rj") pod "e8c1b04b-5169-424c-aa78-d0ed21f9ad44" (UID: "e8c1b04b-5169-424c-aa78-d0ed21f9ad44"). InnerVolumeSpecName "kube-api-access-hx9rj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:15:38 crc kubenswrapper[5120]: I0316 16:15:38.111173 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-5dfe-account-create-update-wf5pw" event={"ID":"23283298-2c56-4b32-b74b-4b84c81a14ba","Type":"ContainerDied","Data":"901effdc0811cc5b889bbbc66f321444822d4d3c36b46f823cc25049a84f31f7"} Mar 16 16:15:38 crc kubenswrapper[5120]: I0316 16:15:38.111193 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="901effdc0811cc5b889bbbc66f321444822d4d3c36b46f823cc25049a84f31f7" Mar 16 16:15:38 crc kubenswrapper[5120]: I0316 16:15:38.111234 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-5dfe-account-create-update-wf5pw" Mar 16 16:15:38 crc kubenswrapper[5120]: I0316 16:15:38.122206 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-db-create-lcrbw" event={"ID":"05833667-2f2c-4785-89d7-1cfaaf139ebb","Type":"ContainerDied","Data":"ecf6566c2d7364406cef455bbeb55535c2abd1bbb56ac109b1516b8e7eaf51df"} Mar 16 16:15:38 crc kubenswrapper[5120]: I0316 16:15:38.122219 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-db-create-lcrbw" Mar 16 16:15:38 crc kubenswrapper[5120]: I0316 16:15:38.122245 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ecf6566c2d7364406cef455bbeb55535c2abd1bbb56ac109b1516b8e7eaf51df" Mar 16 16:15:38 crc kubenswrapper[5120]: I0316 16:15:38.132050 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-6758-account-create-update-mb8v8" event={"ID":"acdd6b61-6a50-47b4-b7fd-8c308277843d","Type":"ContainerDied","Data":"1855ce583777ed489ff7b7b4be9d6e62c4f3c0e7ad8e356271d41de967ed1da2"} Mar 16 16:15:38 crc kubenswrapper[5120]: I0316 16:15:38.132084 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1855ce583777ed489ff7b7b4be9d6e62c4f3c0e7ad8e356271d41de967ed1da2" Mar 16 16:15:38 crc kubenswrapper[5120]: I0316 16:15:38.132148 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-6758-account-create-update-mb8v8" Mar 16 16:15:38 crc kubenswrapper[5120]: I0316 16:15:38.143187 5120 scope.go:117] "RemoveContainer" containerID="f1f2253aadf0697eda77b9b90b4349360ca943b2a5f09261ba0d906abdb6d76a" Mar 16 16:15:38 crc kubenswrapper[5120]: I0316 16:15:38.155779 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8c1b04b-5169-424c-aa78-d0ed21f9ad44-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e8c1b04b-5169-424c-aa78-d0ed21f9ad44" (UID: "e8c1b04b-5169-424c-aa78-d0ed21f9ad44"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:15:38 crc kubenswrapper[5120]: I0316 16:15:38.163989 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8c1b04b-5169-424c-aa78-d0ed21f9ad44-config-data" (OuterVolumeSpecName: "config-data") pod "e8c1b04b-5169-424c-aa78-d0ed21f9ad44" (UID: "e8c1b04b-5169-424c-aa78-d0ed21f9ad44"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:15:38 crc kubenswrapper[5120]: I0316 16:15:38.181200 5120 scope.go:117] "RemoveContainer" containerID="ca48afbf4da3994c288dd6434d0ca152b157371aac8a2f09d421e8ba98321a5b" Mar 16 16:15:38 crc kubenswrapper[5120]: E0316 16:15:38.181529 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca48afbf4da3994c288dd6434d0ca152b157371aac8a2f09d421e8ba98321a5b\": container with ID starting with ca48afbf4da3994c288dd6434d0ca152b157371aac8a2f09d421e8ba98321a5b not found: ID does not exist" containerID="ca48afbf4da3994c288dd6434d0ca152b157371aac8a2f09d421e8ba98321a5b" Mar 16 16:15:38 crc kubenswrapper[5120]: I0316 16:15:38.181574 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca48afbf4da3994c288dd6434d0ca152b157371aac8a2f09d421e8ba98321a5b"} err="failed to get container status \"ca48afbf4da3994c288dd6434d0ca152b157371aac8a2f09d421e8ba98321a5b\": rpc error: code = NotFound desc = could not find container \"ca48afbf4da3994c288dd6434d0ca152b157371aac8a2f09d421e8ba98321a5b\": container with ID starting with ca48afbf4da3994c288dd6434d0ca152b157371aac8a2f09d421e8ba98321a5b not found: ID does not exist" Mar 16 16:15:38 crc kubenswrapper[5120]: I0316 16:15:38.181602 5120 scope.go:117] "RemoveContainer" containerID="f1f2253aadf0697eda77b9b90b4349360ca943b2a5f09261ba0d906abdb6d76a" Mar 16 16:15:38 crc kubenswrapper[5120]: E0316 16:15:38.182935 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f1f2253aadf0697eda77b9b90b4349360ca943b2a5f09261ba0d906abdb6d76a\": container with ID starting with f1f2253aadf0697eda77b9b90b4349360ca943b2a5f09261ba0d906abdb6d76a not found: ID does not exist" containerID="f1f2253aadf0697eda77b9b90b4349360ca943b2a5f09261ba0d906abdb6d76a" Mar 16 16:15:38 crc kubenswrapper[5120]: I0316 16:15:38.182964 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1f2253aadf0697eda77b9b90b4349360ca943b2a5f09261ba0d906abdb6d76a"} err="failed to get container status \"f1f2253aadf0697eda77b9b90b4349360ca943b2a5f09261ba0d906abdb6d76a\": rpc error: code = NotFound desc = could not find container \"f1f2253aadf0697eda77b9b90b4349360ca943b2a5f09261ba0d906abdb6d76a\": container with ID starting with f1f2253aadf0697eda77b9b90b4349360ca943b2a5f09261ba0d906abdb6d76a not found: ID does not exist" Mar 16 16:15:38 crc kubenswrapper[5120]: I0316 16:15:38.183653 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8c1b04b-5169-424c-aa78-d0ed21f9ad44-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "e8c1b04b-5169-424c-aa78-d0ed21f9ad44" (UID: "e8c1b04b-5169-424c-aa78-d0ed21f9ad44"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:15:38 crc kubenswrapper[5120]: I0316 16:15:38.198127 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/e8c1b04b-5169-424c-aa78-d0ed21f9ad44-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 16:15:38 crc kubenswrapper[5120]: I0316 16:15:38.198172 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e8c1b04b-5169-424c-aa78-d0ed21f9ad44-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:15:38 crc kubenswrapper[5120]: I0316 16:15:38.198207 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") on node \"crc\" " Mar 16 16:15:38 crc kubenswrapper[5120]: I0316 16:15:38.198216 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e8c1b04b-5169-424c-aa78-d0ed21f9ad44-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:15:38 crc kubenswrapper[5120]: I0316 16:15:38.198229 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e8c1b04b-5169-424c-aa78-d0ed21f9ad44-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:15:38 crc kubenswrapper[5120]: I0316 16:15:38.198238 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e8c1b04b-5169-424c-aa78-d0ed21f9ad44-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:15:38 crc kubenswrapper[5120]: I0316 16:15:38.198246 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e8c1b04b-5169-424c-aa78-d0ed21f9ad44-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:15:38 crc kubenswrapper[5120]: I0316 16:15:38.198254 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hx9rj\" (UniqueName: \"kubernetes.io/projected/e8c1b04b-5169-424c-aa78-d0ed21f9ad44-kube-api-access-hx9rj\") on node \"crc\" DevicePath \"\"" Mar 16 16:15:38 crc kubenswrapper[5120]: I0316 16:15:38.215314 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage04-crc" (UniqueName: "kubernetes.io/local-volume/local-storage04-crc") on node "crc" Mar 16 16:15:38 crc kubenswrapper[5120]: I0316 16:15:38.299574 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:15:38 crc kubenswrapper[5120]: I0316 16:15:38.464920 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:15:38 crc kubenswrapper[5120]: I0316 16:15:38.526447 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:15:38 crc kubenswrapper[5120]: I0316 16:15:38.550621 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:15:38 crc kubenswrapper[5120]: I0316 16:15:38.551985 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8c1b04b-5169-424c-aa78-d0ed21f9ad44" containerName="glance-httpd" Mar 16 16:15:38 crc kubenswrapper[5120]: I0316 16:15:38.552005 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8c1b04b-5169-424c-aa78-d0ed21f9ad44" containerName="glance-httpd" Mar 16 16:15:38 crc kubenswrapper[5120]: I0316 16:15:38.552018 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23283298-2c56-4b32-b74b-4b84c81a14ba" containerName="mariadb-account-create-update" Mar 16 16:15:38 crc kubenswrapper[5120]: I0316 16:15:38.552025 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="23283298-2c56-4b32-b74b-4b84c81a14ba" containerName="mariadb-account-create-update" Mar 16 16:15:38 crc kubenswrapper[5120]: I0316 16:15:38.552044 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8c1b04b-5169-424c-aa78-d0ed21f9ad44" containerName="glance-log" Mar 16 16:15:38 crc kubenswrapper[5120]: I0316 16:15:38.552049 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8c1b04b-5169-424c-aa78-d0ed21f9ad44" containerName="glance-log" Mar 16 16:15:38 crc kubenswrapper[5120]: I0316 16:15:38.552074 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="acdd6b61-6a50-47b4-b7fd-8c308277843d" containerName="mariadb-account-create-update" Mar 16 16:15:38 crc kubenswrapper[5120]: I0316 16:15:38.552080 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="acdd6b61-6a50-47b4-b7fd-8c308277843d" containerName="mariadb-account-create-update" Mar 16 16:15:38 crc kubenswrapper[5120]: I0316 16:15:38.552092 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="afe6db0b-404e-4339-a3c6-94ae2fc4adc1" containerName="mariadb-database-create" Mar 16 16:15:38 crc kubenswrapper[5120]: I0316 16:15:38.552097 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="afe6db0b-404e-4339-a3c6-94ae2fc4adc1" containerName="mariadb-database-create" Mar 16 16:15:38 crc kubenswrapper[5120]: I0316 16:15:38.552104 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05833667-2f2c-4785-89d7-1cfaaf139ebb" containerName="mariadb-database-create" Mar 16 16:15:38 crc kubenswrapper[5120]: I0316 16:15:38.552112 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="05833667-2f2c-4785-89d7-1cfaaf139ebb" containerName="mariadb-database-create" Mar 16 16:15:38 crc kubenswrapper[5120]: I0316 16:15:38.552148 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21396f29-338c-4c63-8a5d-1a664e24899b" containerName="mariadb-database-create" Mar 16 16:15:38 crc kubenswrapper[5120]: I0316 16:15:38.552155 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="21396f29-338c-4c63-8a5d-1a664e24899b" containerName="mariadb-database-create" Mar 16 16:15:38 crc kubenswrapper[5120]: I0316 16:15:38.552176 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3b5dae5-ebf8-404d-8514-a0bf55440fbb" containerName="mariadb-account-create-update" Mar 16 16:15:38 crc kubenswrapper[5120]: I0316 16:15:38.552182 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3b5dae5-ebf8-404d-8514-a0bf55440fbb" containerName="mariadb-account-create-update" Mar 16 16:15:38 crc kubenswrapper[5120]: I0316 16:15:38.552336 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e8c1b04b-5169-424c-aa78-d0ed21f9ad44" containerName="glance-log" Mar 16 16:15:38 crc kubenswrapper[5120]: I0316 16:15:38.552354 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="21396f29-338c-4c63-8a5d-1a664e24899b" containerName="mariadb-database-create" Mar 16 16:15:38 crc kubenswrapper[5120]: I0316 16:15:38.552362 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="afe6db0b-404e-4339-a3c6-94ae2fc4adc1" containerName="mariadb-database-create" Mar 16 16:15:38 crc kubenswrapper[5120]: I0316 16:15:38.552370 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e8c1b04b-5169-424c-aa78-d0ed21f9ad44" containerName="glance-httpd" Mar 16 16:15:38 crc kubenswrapper[5120]: I0316 16:15:38.552387 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="23283298-2c56-4b32-b74b-4b84c81a14ba" containerName="mariadb-account-create-update" Mar 16 16:15:38 crc kubenswrapper[5120]: I0316 16:15:38.552396 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="05833667-2f2c-4785-89d7-1cfaaf139ebb" containerName="mariadb-database-create" Mar 16 16:15:38 crc kubenswrapper[5120]: I0316 16:15:38.552402 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="acdd6b61-6a50-47b4-b7fd-8c308277843d" containerName="mariadb-account-create-update" Mar 16 16:15:38 crc kubenswrapper[5120]: I0316 16:15:38.552413 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e3b5dae5-ebf8-404d-8514-a0bf55440fbb" containerName="mariadb-account-create-update" Mar 16 16:15:38 crc kubenswrapper[5120]: I0316 16:15:38.556852 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:15:38 crc kubenswrapper[5120]: I0316 16:15:38.561562 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-external-config-data\"" Mar 16 16:15:38 crc kubenswrapper[5120]: I0316 16:15:38.563133 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:15:38 crc kubenswrapper[5120]: I0316 16:15:38.568118 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-public-svc\"" Mar 16 16:15:38 crc kubenswrapper[5120]: I0316 16:15:38.625547 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xxnv\" (UniqueName: \"kubernetes.io/projected/ff974854-15db-4188-b6dc-e330110c2427-kube-api-access-7xxnv\") pod \"glance-default-external-api-0\" (UID: \"ff974854-15db-4188-b6dc-e330110c2427\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:15:38 crc kubenswrapper[5120]: I0316 16:15:38.625637 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"glance-default-external-api-0\" (UID: \"ff974854-15db-4188-b6dc-e330110c2427\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:15:38 crc kubenswrapper[5120]: I0316 16:15:38.625731 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/ff974854-15db-4188-b6dc-e330110c2427-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"ff974854-15db-4188-b6dc-e330110c2427\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:15:38 crc kubenswrapper[5120]: I0316 16:15:38.625798 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ff974854-15db-4188-b6dc-e330110c2427-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"ff974854-15db-4188-b6dc-e330110c2427\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:15:38 crc kubenswrapper[5120]: I0316 16:15:38.625824 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ff974854-15db-4188-b6dc-e330110c2427-config-data\") pod \"glance-default-external-api-0\" (UID: \"ff974854-15db-4188-b6dc-e330110c2427\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:15:38 crc kubenswrapper[5120]: I0316 16:15:38.625897 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ff974854-15db-4188-b6dc-e330110c2427-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"ff974854-15db-4188-b6dc-e330110c2427\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:15:38 crc kubenswrapper[5120]: I0316 16:15:38.625964 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ff974854-15db-4188-b6dc-e330110c2427-logs\") pod \"glance-default-external-api-0\" (UID: \"ff974854-15db-4188-b6dc-e330110c2427\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:15:38 crc kubenswrapper[5120]: I0316 16:15:38.625998 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ff974854-15db-4188-b6dc-e330110c2427-scripts\") pod \"glance-default-external-api-0\" (UID: \"ff974854-15db-4188-b6dc-e330110c2427\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:15:38 crc kubenswrapper[5120]: I0316 16:15:38.681461 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e8c1b04b-5169-424c-aa78-d0ed21f9ad44" path="/var/lib/kubelet/pods/e8c1b04b-5169-424c-aa78-d0ed21f9ad44/volumes" Mar 16 16:15:38 crc kubenswrapper[5120]: I0316 16:15:38.729312 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ff974854-15db-4188-b6dc-e330110c2427-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"ff974854-15db-4188-b6dc-e330110c2427\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:15:38 crc kubenswrapper[5120]: I0316 16:15:38.729388 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ff974854-15db-4188-b6dc-e330110c2427-logs\") pod \"glance-default-external-api-0\" (UID: \"ff974854-15db-4188-b6dc-e330110c2427\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:15:38 crc kubenswrapper[5120]: I0316 16:15:38.729410 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ff974854-15db-4188-b6dc-e330110c2427-scripts\") pod \"glance-default-external-api-0\" (UID: \"ff974854-15db-4188-b6dc-e330110c2427\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:15:38 crc kubenswrapper[5120]: I0316 16:15:38.729495 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7xxnv\" (UniqueName: \"kubernetes.io/projected/ff974854-15db-4188-b6dc-e330110c2427-kube-api-access-7xxnv\") pod \"glance-default-external-api-0\" (UID: \"ff974854-15db-4188-b6dc-e330110c2427\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:15:38 crc kubenswrapper[5120]: I0316 16:15:38.729548 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"glance-default-external-api-0\" (UID: \"ff974854-15db-4188-b6dc-e330110c2427\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:15:38 crc kubenswrapper[5120]: I0316 16:15:38.729623 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/ff974854-15db-4188-b6dc-e330110c2427-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"ff974854-15db-4188-b6dc-e330110c2427\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:15:38 crc kubenswrapper[5120]: I0316 16:15:38.729659 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ff974854-15db-4188-b6dc-e330110c2427-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"ff974854-15db-4188-b6dc-e330110c2427\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:15:38 crc kubenswrapper[5120]: I0316 16:15:38.729679 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ff974854-15db-4188-b6dc-e330110c2427-config-data\") pod \"glance-default-external-api-0\" (UID: \"ff974854-15db-4188-b6dc-e330110c2427\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:15:38 crc kubenswrapper[5120]: I0316 16:15:38.730627 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"glance-default-external-api-0\" (UID: \"ff974854-15db-4188-b6dc-e330110c2427\") device mount path \"/mnt/openstack/pv04\"" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:15:38 crc kubenswrapper[5120]: I0316 16:15:38.732461 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ff974854-15db-4188-b6dc-e330110c2427-logs\") pod \"glance-default-external-api-0\" (UID: \"ff974854-15db-4188-b6dc-e330110c2427\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:15:38 crc kubenswrapper[5120]: I0316 16:15:38.733277 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/ff974854-15db-4188-b6dc-e330110c2427-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"ff974854-15db-4188-b6dc-e330110c2427\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:15:38 crc kubenswrapper[5120]: I0316 16:15:38.735585 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-external-config-data\"" Mar 16 16:15:38 crc kubenswrapper[5120]: I0316 16:15:38.738333 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/placement-77f5d87454-bxpdp" Mar 16 16:15:38 crc kubenswrapper[5120]: I0316 16:15:38.740114 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ff974854-15db-4188-b6dc-e330110c2427-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"ff974854-15db-4188-b6dc-e330110c2427\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:15:38 crc kubenswrapper[5120]: I0316 16:15:38.744381 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ff974854-15db-4188-b6dc-e330110c2427-config-data\") pod \"glance-default-external-api-0\" (UID: \"ff974854-15db-4188-b6dc-e330110c2427\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:15:38 crc kubenswrapper[5120]: I0316 16:15:38.758312 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ff974854-15db-4188-b6dc-e330110c2427-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"ff974854-15db-4188-b6dc-e330110c2427\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:15:38 crc kubenswrapper[5120]: I0316 16:15:38.762244 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"glance-default-external-api-0\" (UID: \"ff974854-15db-4188-b6dc-e330110c2427\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:15:38 crc kubenswrapper[5120]: I0316 16:15:38.769344 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xxnv\" (UniqueName: \"kubernetes.io/projected/ff974854-15db-4188-b6dc-e330110c2427-kube-api-access-7xxnv\") pod \"glance-default-external-api-0\" (UID: \"ff974854-15db-4188-b6dc-e330110c2427\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:15:38 crc kubenswrapper[5120]: I0316 16:15:38.786746 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ff974854-15db-4188-b6dc-e330110c2427-scripts\") pod \"glance-default-external-api-0\" (UID: \"ff974854-15db-4188-b6dc-e330110c2427\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:15:38 crc kubenswrapper[5120]: I0316 16:15:38.807196 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-54f764f5f6-t2dpg"] Mar 16 16:15:38 crc kubenswrapper[5120]: I0316 16:15:38.807602 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-54f764f5f6-t2dpg" podUID="059e3299-784b-46be-9e1b-f0b81118a979" containerName="placement-api" containerID="cri-o://3d380b12787b3d95c1c6f7e8c7fcef06816af75aa0b3979c5d9b7dd602be12ac" gracePeriod=30 Mar 16 16:15:38 crc kubenswrapper[5120]: I0316 16:15:38.809388 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-54f764f5f6-t2dpg" podUID="059e3299-784b-46be-9e1b-f0b81118a979" containerName="placement-log" containerID="cri-o://1f995c8e48ba658ba33982a0b6c2e16251b61464a914fdf7b421a8da28a25e23" gracePeriod=30 Mar 16 16:15:38 crc kubenswrapper[5120]: I0316 16:15:38.861173 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:15:38 crc kubenswrapper[5120]: I0316 16:15:38.878288 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:15:38 crc kubenswrapper[5120]: I0316 16:15:38.936270 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f332d01c-8618-4bf0-adda-5d5e90a43f7a-scripts\") pod \"f332d01c-8618-4bf0-adda-5d5e90a43f7a\" (UID: \"f332d01c-8618-4bf0-adda-5d5e90a43f7a\") " Mar 16 16:15:38 crc kubenswrapper[5120]: I0316 16:15:38.936601 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f332d01c-8618-4bf0-adda-5d5e90a43f7a-combined-ca-bundle\") pod \"f332d01c-8618-4bf0-adda-5d5e90a43f7a\" (UID: \"f332d01c-8618-4bf0-adda-5d5e90a43f7a\") " Mar 16 16:15:38 crc kubenswrapper[5120]: I0316 16:15:38.936691 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f332d01c-8618-4bf0-adda-5d5e90a43f7a-internal-tls-certs\") pod \"f332d01c-8618-4bf0-adda-5d5e90a43f7a\" (UID: \"f332d01c-8618-4bf0-adda-5d5e90a43f7a\") " Mar 16 16:15:38 crc kubenswrapper[5120]: I0316 16:15:38.936852 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"f332d01c-8618-4bf0-adda-5d5e90a43f7a\" (UID: \"f332d01c-8618-4bf0-adda-5d5e90a43f7a\") " Mar 16 16:15:38 crc kubenswrapper[5120]: I0316 16:15:38.936882 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/f332d01c-8618-4bf0-adda-5d5e90a43f7a-httpd-run\") pod \"f332d01c-8618-4bf0-adda-5d5e90a43f7a\" (UID: \"f332d01c-8618-4bf0-adda-5d5e90a43f7a\") " Mar 16 16:15:38 crc kubenswrapper[5120]: I0316 16:15:38.937035 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xl7sm\" (UniqueName: \"kubernetes.io/projected/f332d01c-8618-4bf0-adda-5d5e90a43f7a-kube-api-access-xl7sm\") pod \"f332d01c-8618-4bf0-adda-5d5e90a43f7a\" (UID: \"f332d01c-8618-4bf0-adda-5d5e90a43f7a\") " Mar 16 16:15:38 crc kubenswrapper[5120]: I0316 16:15:38.937161 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f332d01c-8618-4bf0-adda-5d5e90a43f7a-config-data\") pod \"f332d01c-8618-4bf0-adda-5d5e90a43f7a\" (UID: \"f332d01c-8618-4bf0-adda-5d5e90a43f7a\") " Mar 16 16:15:38 crc kubenswrapper[5120]: I0316 16:15:38.937204 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f332d01c-8618-4bf0-adda-5d5e90a43f7a-logs\") pod \"f332d01c-8618-4bf0-adda-5d5e90a43f7a\" (UID: \"f332d01c-8618-4bf0-adda-5d5e90a43f7a\") " Mar 16 16:15:38 crc kubenswrapper[5120]: I0316 16:15:38.943679 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f332d01c-8618-4bf0-adda-5d5e90a43f7a-logs" (OuterVolumeSpecName: "logs") pod "f332d01c-8618-4bf0-adda-5d5e90a43f7a" (UID: "f332d01c-8618-4bf0-adda-5d5e90a43f7a"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:15:38 crc kubenswrapper[5120]: I0316 16:15:38.946507 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f332d01c-8618-4bf0-adda-5d5e90a43f7a-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "f332d01c-8618-4bf0-adda-5d5e90a43f7a" (UID: "f332d01c-8618-4bf0-adda-5d5e90a43f7a"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:15:38 crc kubenswrapper[5120]: I0316 16:15:38.948872 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage01-crc" (OuterVolumeSpecName: "glance") pod "f332d01c-8618-4bf0-adda-5d5e90a43f7a" (UID: "f332d01c-8618-4bf0-adda-5d5e90a43f7a"). InnerVolumeSpecName "local-storage01-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:15:38 crc kubenswrapper[5120]: I0316 16:15:38.951213 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f332d01c-8618-4bf0-adda-5d5e90a43f7a-scripts" (OuterVolumeSpecName: "scripts") pod "f332d01c-8618-4bf0-adda-5d5e90a43f7a" (UID: "f332d01c-8618-4bf0-adda-5d5e90a43f7a"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:15:38 crc kubenswrapper[5120]: I0316 16:15:38.959995 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f332d01c-8618-4bf0-adda-5d5e90a43f7a-kube-api-access-xl7sm" (OuterVolumeSpecName: "kube-api-access-xl7sm") pod "f332d01c-8618-4bf0-adda-5d5e90a43f7a" (UID: "f332d01c-8618-4bf0-adda-5d5e90a43f7a"). InnerVolumeSpecName "kube-api-access-xl7sm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:15:39 crc kubenswrapper[5120]: I0316 16:15:39.005555 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f332d01c-8618-4bf0-adda-5d5e90a43f7a-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "f332d01c-8618-4bf0-adda-5d5e90a43f7a" (UID: "f332d01c-8618-4bf0-adda-5d5e90a43f7a"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:15:39 crc kubenswrapper[5120]: I0316 16:15:39.005856 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f332d01c-8618-4bf0-adda-5d5e90a43f7a-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f332d01c-8618-4bf0-adda-5d5e90a43f7a" (UID: "f332d01c-8618-4bf0-adda-5d5e90a43f7a"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:15:39 crc kubenswrapper[5120]: I0316 16:15:39.016542 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f332d01c-8618-4bf0-adda-5d5e90a43f7a-config-data" (OuterVolumeSpecName: "config-data") pod "f332d01c-8618-4bf0-adda-5d5e90a43f7a" (UID: "f332d01c-8618-4bf0-adda-5d5e90a43f7a"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:15:39 crc kubenswrapper[5120]: I0316 16:15:39.045217 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f332d01c-8618-4bf0-adda-5d5e90a43f7a-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:15:39 crc kubenswrapper[5120]: I0316 16:15:39.045268 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") on node \"crc\" " Mar 16 16:15:39 crc kubenswrapper[5120]: I0316 16:15:39.045278 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/f332d01c-8618-4bf0-adda-5d5e90a43f7a-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 16:15:39 crc kubenswrapper[5120]: I0316 16:15:39.045287 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xl7sm\" (UniqueName: \"kubernetes.io/projected/f332d01c-8618-4bf0-adda-5d5e90a43f7a-kube-api-access-xl7sm\") on node \"crc\" DevicePath \"\"" Mar 16 16:15:39 crc kubenswrapper[5120]: I0316 16:15:39.045300 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f332d01c-8618-4bf0-adda-5d5e90a43f7a-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:15:39 crc kubenswrapper[5120]: I0316 16:15:39.045309 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f332d01c-8618-4bf0-adda-5d5e90a43f7a-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:15:39 crc kubenswrapper[5120]: I0316 16:15:39.045318 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f332d01c-8618-4bf0-adda-5d5e90a43f7a-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:15:39 crc kubenswrapper[5120]: I0316 16:15:39.045327 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f332d01c-8618-4bf0-adda-5d5e90a43f7a-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:15:39 crc kubenswrapper[5120]: I0316 16:15:39.062863 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage01-crc" (UniqueName: "kubernetes.io/local-volume/local-storage01-crc") on node "crc" Mar 16 16:15:39 crc kubenswrapper[5120]: I0316 16:15:39.143901 5120 generic.go:358] "Generic (PLEG): container finished" podID="f332d01c-8618-4bf0-adda-5d5e90a43f7a" containerID="cd8b1379c58f4aa09b67615c5b735aa09b7525a1898eb7095fe9570d88902489" exitCode=0 Mar 16 16:15:39 crc kubenswrapper[5120]: I0316 16:15:39.144012 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"f332d01c-8618-4bf0-adda-5d5e90a43f7a","Type":"ContainerDied","Data":"cd8b1379c58f4aa09b67615c5b735aa09b7525a1898eb7095fe9570d88902489"} Mar 16 16:15:39 crc kubenswrapper[5120]: I0316 16:15:39.144036 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"f332d01c-8618-4bf0-adda-5d5e90a43f7a","Type":"ContainerDied","Data":"2664ad943354aac02f866578585d3cd8c45a3a8ab45f5b4ae6e9359420e9fbfe"} Mar 16 16:15:39 crc kubenswrapper[5120]: I0316 16:15:39.144053 5120 scope.go:117] "RemoveContainer" containerID="cd8b1379c58f4aa09b67615c5b735aa09b7525a1898eb7095fe9570d88902489" Mar 16 16:15:39 crc kubenswrapper[5120]: I0316 16:15:39.144157 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:15:39 crc kubenswrapper[5120]: I0316 16:15:39.149827 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:15:39 crc kubenswrapper[5120]: I0316 16:15:39.157013 5120 generic.go:358] "Generic (PLEG): container finished" podID="059e3299-784b-46be-9e1b-f0b81118a979" containerID="1f995c8e48ba658ba33982a0b6c2e16251b61464a914fdf7b421a8da28a25e23" exitCode=143 Mar 16 16:15:39 crc kubenswrapper[5120]: I0316 16:15:39.157134 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-54f764f5f6-t2dpg" event={"ID":"059e3299-784b-46be-9e1b-f0b81118a979","Type":"ContainerDied","Data":"1f995c8e48ba658ba33982a0b6c2e16251b61464a914fdf7b421a8da28a25e23"} Mar 16 16:15:39 crc kubenswrapper[5120]: I0316 16:15:39.174082 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:15:39 crc kubenswrapper[5120]: I0316 16:15:39.178031 5120 scope.go:117] "RemoveContainer" containerID="a47610b6ca8ef781ee59c32c45df41861758ff434fa31833904d994d39ad8933" Mar 16 16:15:39 crc kubenswrapper[5120]: I0316 16:15:39.186167 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:15:39 crc kubenswrapper[5120]: I0316 16:15:39.198130 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:15:39 crc kubenswrapper[5120]: I0316 16:15:39.199041 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f332d01c-8618-4bf0-adda-5d5e90a43f7a" containerName="glance-httpd" Mar 16 16:15:39 crc kubenswrapper[5120]: I0316 16:15:39.199056 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f332d01c-8618-4bf0-adda-5d5e90a43f7a" containerName="glance-httpd" Mar 16 16:15:39 crc kubenswrapper[5120]: I0316 16:15:39.199110 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f332d01c-8618-4bf0-adda-5d5e90a43f7a" containerName="glance-log" Mar 16 16:15:39 crc kubenswrapper[5120]: I0316 16:15:39.199115 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f332d01c-8618-4bf0-adda-5d5e90a43f7a" containerName="glance-log" Mar 16 16:15:39 crc kubenswrapper[5120]: I0316 16:15:39.199258 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f332d01c-8618-4bf0-adda-5d5e90a43f7a" containerName="glance-log" Mar 16 16:15:39 crc kubenswrapper[5120]: I0316 16:15:39.199276 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f332d01c-8618-4bf0-adda-5d5e90a43f7a" containerName="glance-httpd" Mar 16 16:15:39 crc kubenswrapper[5120]: I0316 16:15:39.204512 5120 scope.go:117] "RemoveContainer" containerID="cd8b1379c58f4aa09b67615c5b735aa09b7525a1898eb7095fe9570d88902489" Mar 16 16:15:39 crc kubenswrapper[5120]: E0316 16:15:39.205388 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd8b1379c58f4aa09b67615c5b735aa09b7525a1898eb7095fe9570d88902489\": container with ID starting with cd8b1379c58f4aa09b67615c5b735aa09b7525a1898eb7095fe9570d88902489 not found: ID does not exist" containerID="cd8b1379c58f4aa09b67615c5b735aa09b7525a1898eb7095fe9570d88902489" Mar 16 16:15:39 crc kubenswrapper[5120]: I0316 16:15:39.205442 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd8b1379c58f4aa09b67615c5b735aa09b7525a1898eb7095fe9570d88902489"} err="failed to get container status \"cd8b1379c58f4aa09b67615c5b735aa09b7525a1898eb7095fe9570d88902489\": rpc error: code = NotFound desc = could not find container \"cd8b1379c58f4aa09b67615c5b735aa09b7525a1898eb7095fe9570d88902489\": container with ID starting with cd8b1379c58f4aa09b67615c5b735aa09b7525a1898eb7095fe9570d88902489 not found: ID does not exist" Mar 16 16:15:39 crc kubenswrapper[5120]: I0316 16:15:39.205488 5120 scope.go:117] "RemoveContainer" containerID="a47610b6ca8ef781ee59c32c45df41861758ff434fa31833904d994d39ad8933" Mar 16 16:15:39 crc kubenswrapper[5120]: I0316 16:15:39.205861 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:15:39 crc kubenswrapper[5120]: E0316 16:15:39.205960 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a47610b6ca8ef781ee59c32c45df41861758ff434fa31833904d994d39ad8933\": container with ID starting with a47610b6ca8ef781ee59c32c45df41861758ff434fa31833904d994d39ad8933 not found: ID does not exist" containerID="a47610b6ca8ef781ee59c32c45df41861758ff434fa31833904d994d39ad8933" Mar 16 16:15:39 crc kubenswrapper[5120]: I0316 16:15:39.206000 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a47610b6ca8ef781ee59c32c45df41861758ff434fa31833904d994d39ad8933"} err="failed to get container status \"a47610b6ca8ef781ee59c32c45df41861758ff434fa31833904d994d39ad8933\": rpc error: code = NotFound desc = could not find container \"a47610b6ca8ef781ee59c32c45df41861758ff434fa31833904d994d39ad8933\": container with ID starting with a47610b6ca8ef781ee59c32c45df41861758ff434fa31833904d994d39ad8933 not found: ID does not exist" Mar 16 16:15:39 crc kubenswrapper[5120]: I0316 16:15:39.209016 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-internal-svc\"" Mar 16 16:15:39 crc kubenswrapper[5120]: I0316 16:15:39.209112 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-internal-config-data\"" Mar 16 16:15:39 crc kubenswrapper[5120]: I0316 16:15:39.251494 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/044996b4-e444-4486-9503-61d776ec849f-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"044996b4-e444-4486-9503-61d776ec849f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:15:39 crc kubenswrapper[5120]: I0316 16:15:39.251542 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhvrb\" (UniqueName: \"kubernetes.io/projected/044996b4-e444-4486-9503-61d776ec849f-kube-api-access-hhvrb\") pod \"glance-default-internal-api-0\" (UID: \"044996b4-e444-4486-9503-61d776ec849f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:15:39 crc kubenswrapper[5120]: I0316 16:15:39.251700 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/044996b4-e444-4486-9503-61d776ec849f-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"044996b4-e444-4486-9503-61d776ec849f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:15:39 crc kubenswrapper[5120]: I0316 16:15:39.251728 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/044996b4-e444-4486-9503-61d776ec849f-logs\") pod \"glance-default-internal-api-0\" (UID: \"044996b4-e444-4486-9503-61d776ec849f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:15:39 crc kubenswrapper[5120]: I0316 16:15:39.251798 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/044996b4-e444-4486-9503-61d776ec849f-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"044996b4-e444-4486-9503-61d776ec849f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:15:39 crc kubenswrapper[5120]: I0316 16:15:39.251822 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/044996b4-e444-4486-9503-61d776ec849f-scripts\") pod \"glance-default-internal-api-0\" (UID: \"044996b4-e444-4486-9503-61d776ec849f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:15:39 crc kubenswrapper[5120]: I0316 16:15:39.251863 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/044996b4-e444-4486-9503-61d776ec849f-config-data\") pod \"glance-default-internal-api-0\" (UID: \"044996b4-e444-4486-9503-61d776ec849f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:15:39 crc kubenswrapper[5120]: I0316 16:15:39.251937 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"glance-default-internal-api-0\" (UID: \"044996b4-e444-4486-9503-61d776ec849f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:15:39 crc kubenswrapper[5120]: I0316 16:15:39.254712 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:15:39 crc kubenswrapper[5120]: I0316 16:15:39.336073 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:15:39 crc kubenswrapper[5120]: I0316 16:15:39.353110 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/044996b4-e444-4486-9503-61d776ec849f-config-data\") pod \"glance-default-internal-api-0\" (UID: \"044996b4-e444-4486-9503-61d776ec849f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:15:39 crc kubenswrapper[5120]: I0316 16:15:39.353206 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"glance-default-internal-api-0\" (UID: \"044996b4-e444-4486-9503-61d776ec849f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:15:39 crc kubenswrapper[5120]: I0316 16:15:39.353249 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/044996b4-e444-4486-9503-61d776ec849f-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"044996b4-e444-4486-9503-61d776ec849f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:15:39 crc kubenswrapper[5120]: I0316 16:15:39.353276 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hhvrb\" (UniqueName: \"kubernetes.io/projected/044996b4-e444-4486-9503-61d776ec849f-kube-api-access-hhvrb\") pod \"glance-default-internal-api-0\" (UID: \"044996b4-e444-4486-9503-61d776ec849f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:15:39 crc kubenswrapper[5120]: I0316 16:15:39.353391 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/044996b4-e444-4486-9503-61d776ec849f-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"044996b4-e444-4486-9503-61d776ec849f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:15:39 crc kubenswrapper[5120]: I0316 16:15:39.353424 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/044996b4-e444-4486-9503-61d776ec849f-logs\") pod \"glance-default-internal-api-0\" (UID: \"044996b4-e444-4486-9503-61d776ec849f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:15:39 crc kubenswrapper[5120]: I0316 16:15:39.353477 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/044996b4-e444-4486-9503-61d776ec849f-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"044996b4-e444-4486-9503-61d776ec849f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:15:39 crc kubenswrapper[5120]: I0316 16:15:39.353501 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/044996b4-e444-4486-9503-61d776ec849f-scripts\") pod \"glance-default-internal-api-0\" (UID: \"044996b4-e444-4486-9503-61d776ec849f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:15:39 crc kubenswrapper[5120]: I0316 16:15:39.354472 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/044996b4-e444-4486-9503-61d776ec849f-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"044996b4-e444-4486-9503-61d776ec849f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:15:39 crc kubenswrapper[5120]: I0316 16:15:39.354498 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"glance-default-internal-api-0\" (UID: \"044996b4-e444-4486-9503-61d776ec849f\") device mount path \"/mnt/openstack/pv01\"" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:15:39 crc kubenswrapper[5120]: I0316 16:15:39.354561 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/044996b4-e444-4486-9503-61d776ec849f-logs\") pod \"glance-default-internal-api-0\" (UID: \"044996b4-e444-4486-9503-61d776ec849f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:15:39 crc kubenswrapper[5120]: I0316 16:15:39.359576 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/044996b4-e444-4486-9503-61d776ec849f-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"044996b4-e444-4486-9503-61d776ec849f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:15:39 crc kubenswrapper[5120]: I0316 16:15:39.359580 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/044996b4-e444-4486-9503-61d776ec849f-scripts\") pod \"glance-default-internal-api-0\" (UID: \"044996b4-e444-4486-9503-61d776ec849f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:15:39 crc kubenswrapper[5120]: I0316 16:15:39.362538 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/044996b4-e444-4486-9503-61d776ec849f-config-data\") pod \"glance-default-internal-api-0\" (UID: \"044996b4-e444-4486-9503-61d776ec849f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:15:39 crc kubenswrapper[5120]: I0316 16:15:39.367190 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/044996b4-e444-4486-9503-61d776ec849f-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"044996b4-e444-4486-9503-61d776ec849f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:15:39 crc kubenswrapper[5120]: I0316 16:15:39.384637 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhvrb\" (UniqueName: \"kubernetes.io/projected/044996b4-e444-4486-9503-61d776ec849f-kube-api-access-hhvrb\") pod \"glance-default-internal-api-0\" (UID: \"044996b4-e444-4486-9503-61d776ec849f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:15:39 crc kubenswrapper[5120]: I0316 16:15:39.398151 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"glance-default-internal-api-0\" (UID: \"044996b4-e444-4486-9503-61d776ec849f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:15:39 crc kubenswrapper[5120]: I0316 16:15:39.562382 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:15:39 crc kubenswrapper[5120]: I0316 16:15:39.708319 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:15:39 crc kubenswrapper[5120]: I0316 16:15:39.764437 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3e3a1a48-35af-43bb-ba48-263697db6cc5-combined-ca-bundle\") pod \"3e3a1a48-35af-43bb-ba48-263697db6cc5\" (UID: \"3e3a1a48-35af-43bb-ba48-263697db6cc5\") " Mar 16 16:15:39 crc kubenswrapper[5120]: I0316 16:15:39.764595 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3e3a1a48-35af-43bb-ba48-263697db6cc5-config-data\") pod \"3e3a1a48-35af-43bb-ba48-263697db6cc5\" (UID: \"3e3a1a48-35af-43bb-ba48-263697db6cc5\") " Mar 16 16:15:39 crc kubenswrapper[5120]: I0316 16:15:39.764650 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/3e3a1a48-35af-43bb-ba48-263697db6cc5-log-httpd\") pod \"3e3a1a48-35af-43bb-ba48-263697db6cc5\" (UID: \"3e3a1a48-35af-43bb-ba48-263697db6cc5\") " Mar 16 16:15:39 crc kubenswrapper[5120]: I0316 16:15:39.764821 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ffvx8\" (UniqueName: \"kubernetes.io/projected/3e3a1a48-35af-43bb-ba48-263697db6cc5-kube-api-access-ffvx8\") pod \"3e3a1a48-35af-43bb-ba48-263697db6cc5\" (UID: \"3e3a1a48-35af-43bb-ba48-263697db6cc5\") " Mar 16 16:15:39 crc kubenswrapper[5120]: I0316 16:15:39.764851 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3e3a1a48-35af-43bb-ba48-263697db6cc5-scripts\") pod \"3e3a1a48-35af-43bb-ba48-263697db6cc5\" (UID: \"3e3a1a48-35af-43bb-ba48-263697db6cc5\") " Mar 16 16:15:39 crc kubenswrapper[5120]: I0316 16:15:39.765021 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/3e3a1a48-35af-43bb-ba48-263697db6cc5-sg-core-conf-yaml\") pod \"3e3a1a48-35af-43bb-ba48-263697db6cc5\" (UID: \"3e3a1a48-35af-43bb-ba48-263697db6cc5\") " Mar 16 16:15:39 crc kubenswrapper[5120]: I0316 16:15:39.765211 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/3e3a1a48-35af-43bb-ba48-263697db6cc5-run-httpd\") pod \"3e3a1a48-35af-43bb-ba48-263697db6cc5\" (UID: \"3e3a1a48-35af-43bb-ba48-263697db6cc5\") " Mar 16 16:15:39 crc kubenswrapper[5120]: I0316 16:15:39.770247 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e3a1a48-35af-43bb-ba48-263697db6cc5-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "3e3a1a48-35af-43bb-ba48-263697db6cc5" (UID: "3e3a1a48-35af-43bb-ba48-263697db6cc5"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:15:39 crc kubenswrapper[5120]: I0316 16:15:39.771416 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e3a1a48-35af-43bb-ba48-263697db6cc5-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "3e3a1a48-35af-43bb-ba48-263697db6cc5" (UID: "3e3a1a48-35af-43bb-ba48-263697db6cc5"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:15:39 crc kubenswrapper[5120]: I0316 16:15:39.774675 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e3a1a48-35af-43bb-ba48-263697db6cc5-kube-api-access-ffvx8" (OuterVolumeSpecName: "kube-api-access-ffvx8") pod "3e3a1a48-35af-43bb-ba48-263697db6cc5" (UID: "3e3a1a48-35af-43bb-ba48-263697db6cc5"). InnerVolumeSpecName "kube-api-access-ffvx8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:15:39 crc kubenswrapper[5120]: I0316 16:15:39.774843 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e3a1a48-35af-43bb-ba48-263697db6cc5-scripts" (OuterVolumeSpecName: "scripts") pod "3e3a1a48-35af-43bb-ba48-263697db6cc5" (UID: "3e3a1a48-35af-43bb-ba48-263697db6cc5"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:15:39 crc kubenswrapper[5120]: I0316 16:15:39.804210 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e3a1a48-35af-43bb-ba48-263697db6cc5-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "3e3a1a48-35af-43bb-ba48-263697db6cc5" (UID: "3e3a1a48-35af-43bb-ba48-263697db6cc5"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:15:39 crc kubenswrapper[5120]: I0316 16:15:39.846841 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e3a1a48-35af-43bb-ba48-263697db6cc5-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "3e3a1a48-35af-43bb-ba48-263697db6cc5" (UID: "3e3a1a48-35af-43bb-ba48-263697db6cc5"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:15:39 crc kubenswrapper[5120]: I0316 16:15:39.867888 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3e3a1a48-35af-43bb-ba48-263697db6cc5-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:15:39 crc kubenswrapper[5120]: I0316 16:15:39.867921 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/3e3a1a48-35af-43bb-ba48-263697db6cc5-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:15:39 crc kubenswrapper[5120]: I0316 16:15:39.867931 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ffvx8\" (UniqueName: \"kubernetes.io/projected/3e3a1a48-35af-43bb-ba48-263697db6cc5-kube-api-access-ffvx8\") on node \"crc\" DevicePath \"\"" Mar 16 16:15:39 crc kubenswrapper[5120]: I0316 16:15:39.867944 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3e3a1a48-35af-43bb-ba48-263697db6cc5-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:15:39 crc kubenswrapper[5120]: I0316 16:15:39.867954 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/3e3a1a48-35af-43bb-ba48-263697db6cc5-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 16:15:39 crc kubenswrapper[5120]: I0316 16:15:39.867963 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/3e3a1a48-35af-43bb-ba48-263697db6cc5-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:15:39 crc kubenswrapper[5120]: I0316 16:15:39.891746 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e3a1a48-35af-43bb-ba48-263697db6cc5-config-data" (OuterVolumeSpecName: "config-data") pod "3e3a1a48-35af-43bb-ba48-263697db6cc5" (UID: "3e3a1a48-35af-43bb-ba48-263697db6cc5"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:15:39 crc kubenswrapper[5120]: I0316 16:15:39.970047 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3e3a1a48-35af-43bb-ba48-263697db6cc5-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:15:40 crc kubenswrapper[5120]: I0316 16:15:40.074595 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:15:40 crc kubenswrapper[5120]: I0316 16:15:40.186214 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"044996b4-e444-4486-9503-61d776ec849f","Type":"ContainerStarted","Data":"f257a011cef25035f6eb0ee29b2821db5b5395afa9c4ce5becc5e1bd7f99089e"} Mar 16 16:15:40 crc kubenswrapper[5120]: I0316 16:15:40.191225 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"ff974854-15db-4188-b6dc-e330110c2427","Type":"ContainerStarted","Data":"a2e438fc9999e069782ed119547c3c2d018c963e082bf48fcbbd7cc8e78719ff"} Mar 16 16:15:40 crc kubenswrapper[5120]: I0316 16:15:40.191263 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"ff974854-15db-4188-b6dc-e330110c2427","Type":"ContainerStarted","Data":"d81e77ba112e6269f39cc7ddbf703f1cdeaa54b0a25fe4f67b8da7f8a2f6b2a7"} Mar 16 16:15:40 crc kubenswrapper[5120]: I0316 16:15:40.199774 5120 generic.go:358] "Generic (PLEG): container finished" podID="3e3a1a48-35af-43bb-ba48-263697db6cc5" containerID="42380b678f524d53ecd974600bf119a16ddc20199e6b1fd5587b12b49b33cc61" exitCode=0 Mar 16 16:15:40 crc kubenswrapper[5120]: I0316 16:15:40.200018 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"3e3a1a48-35af-43bb-ba48-263697db6cc5","Type":"ContainerDied","Data":"42380b678f524d53ecd974600bf119a16ddc20199e6b1fd5587b12b49b33cc61"} Mar 16 16:15:40 crc kubenswrapper[5120]: I0316 16:15:40.200048 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"3e3a1a48-35af-43bb-ba48-263697db6cc5","Type":"ContainerDied","Data":"4b28cc7a17ce669aad38c0ab1dce997b805eb61d15c4019696189e1661cd30a4"} Mar 16 16:15:40 crc kubenswrapper[5120]: I0316 16:15:40.200067 5120 scope.go:117] "RemoveContainer" containerID="5e1f746bc2717412dc835d042a25537512dc44835951b00fa8cd18d024891b29" Mar 16 16:15:40 crc kubenswrapper[5120]: I0316 16:15:40.200182 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:15:40 crc kubenswrapper[5120]: I0316 16:15:40.233105 5120 scope.go:117] "RemoveContainer" containerID="797802849eec37703c2ba470d7ca9f4e8eeb562707348b014730a24013477f0f" Mar 16 16:15:40 crc kubenswrapper[5120]: I0316 16:15:40.316540 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:15:40 crc kubenswrapper[5120]: I0316 16:15:40.330860 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:15:40 crc kubenswrapper[5120]: I0316 16:15:40.335038 5120 scope.go:117] "RemoveContainer" containerID="9408531d55cb6a1ac74d2d5c8d3f11abfbbe2c44fb1c81ce4e3b6edcb48af836" Mar 16 16:15:40 crc kubenswrapper[5120]: I0316 16:15:40.349228 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:15:40 crc kubenswrapper[5120]: I0316 16:15:40.350477 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e3a1a48-35af-43bb-ba48-263697db6cc5" containerName="ceilometer-notification-agent" Mar 16 16:15:40 crc kubenswrapper[5120]: I0316 16:15:40.350502 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e3a1a48-35af-43bb-ba48-263697db6cc5" containerName="ceilometer-notification-agent" Mar 16 16:15:40 crc kubenswrapper[5120]: I0316 16:15:40.350557 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e3a1a48-35af-43bb-ba48-263697db6cc5" containerName="ceilometer-central-agent" Mar 16 16:15:40 crc kubenswrapper[5120]: I0316 16:15:40.350566 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e3a1a48-35af-43bb-ba48-263697db6cc5" containerName="ceilometer-central-agent" Mar 16 16:15:40 crc kubenswrapper[5120]: I0316 16:15:40.350592 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e3a1a48-35af-43bb-ba48-263697db6cc5" containerName="sg-core" Mar 16 16:15:40 crc kubenswrapper[5120]: I0316 16:15:40.350599 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e3a1a48-35af-43bb-ba48-263697db6cc5" containerName="sg-core" Mar 16 16:15:40 crc kubenswrapper[5120]: I0316 16:15:40.350613 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e3a1a48-35af-43bb-ba48-263697db6cc5" containerName="proxy-httpd" Mar 16 16:15:40 crc kubenswrapper[5120]: I0316 16:15:40.350619 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e3a1a48-35af-43bb-ba48-263697db6cc5" containerName="proxy-httpd" Mar 16 16:15:40 crc kubenswrapper[5120]: I0316 16:15:40.350823 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="3e3a1a48-35af-43bb-ba48-263697db6cc5" containerName="sg-core" Mar 16 16:15:40 crc kubenswrapper[5120]: I0316 16:15:40.350835 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="3e3a1a48-35af-43bb-ba48-263697db6cc5" containerName="ceilometer-central-agent" Mar 16 16:15:40 crc kubenswrapper[5120]: I0316 16:15:40.350851 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="3e3a1a48-35af-43bb-ba48-263697db6cc5" containerName="ceilometer-notification-agent" Mar 16 16:15:40 crc kubenswrapper[5120]: I0316 16:15:40.350858 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="3e3a1a48-35af-43bb-ba48-263697db6cc5" containerName="proxy-httpd" Mar 16 16:15:40 crc kubenswrapper[5120]: I0316 16:15:40.357862 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:15:40 crc kubenswrapper[5120]: I0316 16:15:40.360310 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 16:15:40 crc kubenswrapper[5120]: I0316 16:15:40.361367 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 16:15:40 crc kubenswrapper[5120]: I0316 16:15:40.363046 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:15:40 crc kubenswrapper[5120]: I0316 16:15:40.381148 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c140cf00-8a50-47a8-9eaf-0e692be36d16-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"c140cf00-8a50-47a8-9eaf-0e692be36d16\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:15:40 crc kubenswrapper[5120]: I0316 16:15:40.381199 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fw6ng\" (UniqueName: \"kubernetes.io/projected/c140cf00-8a50-47a8-9eaf-0e692be36d16-kube-api-access-fw6ng\") pod \"ceilometer-0\" (UID: \"c140cf00-8a50-47a8-9eaf-0e692be36d16\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:15:40 crc kubenswrapper[5120]: I0316 16:15:40.381248 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c140cf00-8a50-47a8-9eaf-0e692be36d16-run-httpd\") pod \"ceilometer-0\" (UID: \"c140cf00-8a50-47a8-9eaf-0e692be36d16\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:15:40 crc kubenswrapper[5120]: I0316 16:15:40.381303 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c140cf00-8a50-47a8-9eaf-0e692be36d16-scripts\") pod \"ceilometer-0\" (UID: \"c140cf00-8a50-47a8-9eaf-0e692be36d16\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:15:40 crc kubenswrapper[5120]: I0316 16:15:40.381350 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c140cf00-8a50-47a8-9eaf-0e692be36d16-config-data\") pod \"ceilometer-0\" (UID: \"c140cf00-8a50-47a8-9eaf-0e692be36d16\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:15:40 crc kubenswrapper[5120]: I0316 16:15:40.381399 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c140cf00-8a50-47a8-9eaf-0e692be36d16-log-httpd\") pod \"ceilometer-0\" (UID: \"c140cf00-8a50-47a8-9eaf-0e692be36d16\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:15:40 crc kubenswrapper[5120]: I0316 16:15:40.381426 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/c140cf00-8a50-47a8-9eaf-0e692be36d16-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"c140cf00-8a50-47a8-9eaf-0e692be36d16\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:15:40 crc kubenswrapper[5120]: I0316 16:15:40.389074 5120 scope.go:117] "RemoveContainer" containerID="42380b678f524d53ecd974600bf119a16ddc20199e6b1fd5587b12b49b33cc61" Mar 16 16:15:40 crc kubenswrapper[5120]: I0316 16:15:40.437933 5120 scope.go:117] "RemoveContainer" containerID="5e1f746bc2717412dc835d042a25537512dc44835951b00fa8cd18d024891b29" Mar 16 16:15:40 crc kubenswrapper[5120]: E0316 16:15:40.440197 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5e1f746bc2717412dc835d042a25537512dc44835951b00fa8cd18d024891b29\": container with ID starting with 5e1f746bc2717412dc835d042a25537512dc44835951b00fa8cd18d024891b29 not found: ID does not exist" containerID="5e1f746bc2717412dc835d042a25537512dc44835951b00fa8cd18d024891b29" Mar 16 16:15:40 crc kubenswrapper[5120]: I0316 16:15:40.440233 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e1f746bc2717412dc835d042a25537512dc44835951b00fa8cd18d024891b29"} err="failed to get container status \"5e1f746bc2717412dc835d042a25537512dc44835951b00fa8cd18d024891b29\": rpc error: code = NotFound desc = could not find container \"5e1f746bc2717412dc835d042a25537512dc44835951b00fa8cd18d024891b29\": container with ID starting with 5e1f746bc2717412dc835d042a25537512dc44835951b00fa8cd18d024891b29 not found: ID does not exist" Mar 16 16:15:40 crc kubenswrapper[5120]: I0316 16:15:40.440257 5120 scope.go:117] "RemoveContainer" containerID="797802849eec37703c2ba470d7ca9f4e8eeb562707348b014730a24013477f0f" Mar 16 16:15:40 crc kubenswrapper[5120]: E0316 16:15:40.440831 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"797802849eec37703c2ba470d7ca9f4e8eeb562707348b014730a24013477f0f\": container with ID starting with 797802849eec37703c2ba470d7ca9f4e8eeb562707348b014730a24013477f0f not found: ID does not exist" containerID="797802849eec37703c2ba470d7ca9f4e8eeb562707348b014730a24013477f0f" Mar 16 16:15:40 crc kubenswrapper[5120]: I0316 16:15:40.440857 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"797802849eec37703c2ba470d7ca9f4e8eeb562707348b014730a24013477f0f"} err="failed to get container status \"797802849eec37703c2ba470d7ca9f4e8eeb562707348b014730a24013477f0f\": rpc error: code = NotFound desc = could not find container \"797802849eec37703c2ba470d7ca9f4e8eeb562707348b014730a24013477f0f\": container with ID starting with 797802849eec37703c2ba470d7ca9f4e8eeb562707348b014730a24013477f0f not found: ID does not exist" Mar 16 16:15:40 crc kubenswrapper[5120]: I0316 16:15:40.440874 5120 scope.go:117] "RemoveContainer" containerID="9408531d55cb6a1ac74d2d5c8d3f11abfbbe2c44fb1c81ce4e3b6edcb48af836" Mar 16 16:15:40 crc kubenswrapper[5120]: E0316 16:15:40.441367 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9408531d55cb6a1ac74d2d5c8d3f11abfbbe2c44fb1c81ce4e3b6edcb48af836\": container with ID starting with 9408531d55cb6a1ac74d2d5c8d3f11abfbbe2c44fb1c81ce4e3b6edcb48af836 not found: ID does not exist" containerID="9408531d55cb6a1ac74d2d5c8d3f11abfbbe2c44fb1c81ce4e3b6edcb48af836" Mar 16 16:15:40 crc kubenswrapper[5120]: I0316 16:15:40.441389 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9408531d55cb6a1ac74d2d5c8d3f11abfbbe2c44fb1c81ce4e3b6edcb48af836"} err="failed to get container status \"9408531d55cb6a1ac74d2d5c8d3f11abfbbe2c44fb1c81ce4e3b6edcb48af836\": rpc error: code = NotFound desc = could not find container \"9408531d55cb6a1ac74d2d5c8d3f11abfbbe2c44fb1c81ce4e3b6edcb48af836\": container with ID starting with 9408531d55cb6a1ac74d2d5c8d3f11abfbbe2c44fb1c81ce4e3b6edcb48af836 not found: ID does not exist" Mar 16 16:15:40 crc kubenswrapper[5120]: I0316 16:15:40.441402 5120 scope.go:117] "RemoveContainer" containerID="42380b678f524d53ecd974600bf119a16ddc20199e6b1fd5587b12b49b33cc61" Mar 16 16:15:40 crc kubenswrapper[5120]: E0316 16:15:40.441896 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"42380b678f524d53ecd974600bf119a16ddc20199e6b1fd5587b12b49b33cc61\": container with ID starting with 42380b678f524d53ecd974600bf119a16ddc20199e6b1fd5587b12b49b33cc61 not found: ID does not exist" containerID="42380b678f524d53ecd974600bf119a16ddc20199e6b1fd5587b12b49b33cc61" Mar 16 16:15:40 crc kubenswrapper[5120]: I0316 16:15:40.441920 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42380b678f524d53ecd974600bf119a16ddc20199e6b1fd5587b12b49b33cc61"} err="failed to get container status \"42380b678f524d53ecd974600bf119a16ddc20199e6b1fd5587b12b49b33cc61\": rpc error: code = NotFound desc = could not find container \"42380b678f524d53ecd974600bf119a16ddc20199e6b1fd5587b12b49b33cc61\": container with ID starting with 42380b678f524d53ecd974600bf119a16ddc20199e6b1fd5587b12b49b33cc61 not found: ID does not exist" Mar 16 16:15:40 crc kubenswrapper[5120]: I0316 16:15:40.459549 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:15:40 crc kubenswrapper[5120]: E0316 16:15:40.460220 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[combined-ca-bundle config-data kube-api-access-fw6ng log-httpd run-httpd scripts sg-core-conf-yaml], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openstack-kuttl-tests/ceilometer-0" podUID="c140cf00-8a50-47a8-9eaf-0e692be36d16" Mar 16 16:15:40 crc kubenswrapper[5120]: I0316 16:15:40.482647 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c140cf00-8a50-47a8-9eaf-0e692be36d16-config-data\") pod \"ceilometer-0\" (UID: \"c140cf00-8a50-47a8-9eaf-0e692be36d16\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:15:40 crc kubenswrapper[5120]: I0316 16:15:40.482718 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c140cf00-8a50-47a8-9eaf-0e692be36d16-log-httpd\") pod \"ceilometer-0\" (UID: \"c140cf00-8a50-47a8-9eaf-0e692be36d16\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:15:40 crc kubenswrapper[5120]: I0316 16:15:40.482748 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/c140cf00-8a50-47a8-9eaf-0e692be36d16-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"c140cf00-8a50-47a8-9eaf-0e692be36d16\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:15:40 crc kubenswrapper[5120]: I0316 16:15:40.482916 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c140cf00-8a50-47a8-9eaf-0e692be36d16-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"c140cf00-8a50-47a8-9eaf-0e692be36d16\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:15:40 crc kubenswrapper[5120]: I0316 16:15:40.482938 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fw6ng\" (UniqueName: \"kubernetes.io/projected/c140cf00-8a50-47a8-9eaf-0e692be36d16-kube-api-access-fw6ng\") pod \"ceilometer-0\" (UID: \"c140cf00-8a50-47a8-9eaf-0e692be36d16\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:15:40 crc kubenswrapper[5120]: I0316 16:15:40.482982 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c140cf00-8a50-47a8-9eaf-0e692be36d16-run-httpd\") pod \"ceilometer-0\" (UID: \"c140cf00-8a50-47a8-9eaf-0e692be36d16\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:15:40 crc kubenswrapper[5120]: I0316 16:15:40.483037 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c140cf00-8a50-47a8-9eaf-0e692be36d16-scripts\") pod \"ceilometer-0\" (UID: \"c140cf00-8a50-47a8-9eaf-0e692be36d16\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:15:40 crc kubenswrapper[5120]: I0316 16:15:40.483501 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c140cf00-8a50-47a8-9eaf-0e692be36d16-log-httpd\") pod \"ceilometer-0\" (UID: \"c140cf00-8a50-47a8-9eaf-0e692be36d16\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:15:40 crc kubenswrapper[5120]: I0316 16:15:40.483878 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c140cf00-8a50-47a8-9eaf-0e692be36d16-run-httpd\") pod \"ceilometer-0\" (UID: \"c140cf00-8a50-47a8-9eaf-0e692be36d16\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:15:40 crc kubenswrapper[5120]: I0316 16:15:40.493795 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c140cf00-8a50-47a8-9eaf-0e692be36d16-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"c140cf00-8a50-47a8-9eaf-0e692be36d16\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:15:40 crc kubenswrapper[5120]: I0316 16:15:40.497481 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c140cf00-8a50-47a8-9eaf-0e692be36d16-config-data\") pod \"ceilometer-0\" (UID: \"c140cf00-8a50-47a8-9eaf-0e692be36d16\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:15:40 crc kubenswrapper[5120]: I0316 16:15:40.498852 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/c140cf00-8a50-47a8-9eaf-0e692be36d16-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"c140cf00-8a50-47a8-9eaf-0e692be36d16\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:15:40 crc kubenswrapper[5120]: I0316 16:15:40.499565 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c140cf00-8a50-47a8-9eaf-0e692be36d16-scripts\") pod \"ceilometer-0\" (UID: \"c140cf00-8a50-47a8-9eaf-0e692be36d16\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:15:40 crc kubenswrapper[5120]: I0316 16:15:40.500388 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fw6ng\" (UniqueName: \"kubernetes.io/projected/c140cf00-8a50-47a8-9eaf-0e692be36d16-kube-api-access-fw6ng\") pod \"ceilometer-0\" (UID: \"c140cf00-8a50-47a8-9eaf-0e692be36d16\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:15:40 crc kubenswrapper[5120]: I0316 16:15:40.675551 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3e3a1a48-35af-43bb-ba48-263697db6cc5" path="/var/lib/kubelet/pods/3e3a1a48-35af-43bb-ba48-263697db6cc5/volumes" Mar 16 16:15:40 crc kubenswrapper[5120]: I0316 16:15:40.676401 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f332d01c-8618-4bf0-adda-5d5e90a43f7a" path="/var/lib/kubelet/pods/f332d01c-8618-4bf0-adda-5d5e90a43f7a/volumes" Mar 16 16:15:41 crc kubenswrapper[5120]: I0316 16:15:41.219542 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"044996b4-e444-4486-9503-61d776ec849f","Type":"ContainerStarted","Data":"a7009166ee17bc972006fca5fae2160d1fd948f482b659e9b784be0cafb5a261"} Mar 16 16:15:41 crc kubenswrapper[5120]: I0316 16:15:41.225858 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"ff974854-15db-4188-b6dc-e330110c2427","Type":"ContainerStarted","Data":"1047a775a4d6d73834e956332daf4031b254e261c008046c75b64d3eca888ffd"} Mar 16 16:15:41 crc kubenswrapper[5120]: I0316 16:15:41.230184 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:15:41 crc kubenswrapper[5120]: I0316 16:15:41.245045 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:15:41 crc kubenswrapper[5120]: I0316 16:15:41.245500 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-external-api-0" podStartSLOduration=3.245483934 podStartE2EDuration="3.245483934s" podCreationTimestamp="2026-03-16 16:15:38 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:15:41.240106089 +0000 UTC m=+2643.394037736" watchObservedRunningTime="2026-03-16 16:15:41.245483934 +0000 UTC m=+2643.399415591" Mar 16 16:15:41 crc kubenswrapper[5120]: I0316 16:15:41.298677 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/c140cf00-8a50-47a8-9eaf-0e692be36d16-sg-core-conf-yaml\") pod \"c140cf00-8a50-47a8-9eaf-0e692be36d16\" (UID: \"c140cf00-8a50-47a8-9eaf-0e692be36d16\") " Mar 16 16:15:41 crc kubenswrapper[5120]: I0316 16:15:41.299294 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c140cf00-8a50-47a8-9eaf-0e692be36d16-combined-ca-bundle\") pod \"c140cf00-8a50-47a8-9eaf-0e692be36d16\" (UID: \"c140cf00-8a50-47a8-9eaf-0e692be36d16\") " Mar 16 16:15:41 crc kubenswrapper[5120]: I0316 16:15:41.299342 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c140cf00-8a50-47a8-9eaf-0e692be36d16-log-httpd\") pod \"c140cf00-8a50-47a8-9eaf-0e692be36d16\" (UID: \"c140cf00-8a50-47a8-9eaf-0e692be36d16\") " Mar 16 16:15:41 crc kubenswrapper[5120]: I0316 16:15:41.299368 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c140cf00-8a50-47a8-9eaf-0e692be36d16-config-data\") pod \"c140cf00-8a50-47a8-9eaf-0e692be36d16\" (UID: \"c140cf00-8a50-47a8-9eaf-0e692be36d16\") " Mar 16 16:15:41 crc kubenswrapper[5120]: I0316 16:15:41.299797 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c140cf00-8a50-47a8-9eaf-0e692be36d16-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "c140cf00-8a50-47a8-9eaf-0e692be36d16" (UID: "c140cf00-8a50-47a8-9eaf-0e692be36d16"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:15:41 crc kubenswrapper[5120]: I0316 16:15:41.299907 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c140cf00-8a50-47a8-9eaf-0e692be36d16-scripts\") pod \"c140cf00-8a50-47a8-9eaf-0e692be36d16\" (UID: \"c140cf00-8a50-47a8-9eaf-0e692be36d16\") " Mar 16 16:15:41 crc kubenswrapper[5120]: I0316 16:15:41.300045 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c140cf00-8a50-47a8-9eaf-0e692be36d16-run-httpd\") pod \"c140cf00-8a50-47a8-9eaf-0e692be36d16\" (UID: \"c140cf00-8a50-47a8-9eaf-0e692be36d16\") " Mar 16 16:15:41 crc kubenswrapper[5120]: I0316 16:15:41.300170 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fw6ng\" (UniqueName: \"kubernetes.io/projected/c140cf00-8a50-47a8-9eaf-0e692be36d16-kube-api-access-fw6ng\") pod \"c140cf00-8a50-47a8-9eaf-0e692be36d16\" (UID: \"c140cf00-8a50-47a8-9eaf-0e692be36d16\") " Mar 16 16:15:41 crc kubenswrapper[5120]: I0316 16:15:41.300279 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c140cf00-8a50-47a8-9eaf-0e692be36d16-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "c140cf00-8a50-47a8-9eaf-0e692be36d16" (UID: "c140cf00-8a50-47a8-9eaf-0e692be36d16"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:15:41 crc kubenswrapper[5120]: I0316 16:15:41.301521 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c140cf00-8a50-47a8-9eaf-0e692be36d16-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:15:41 crc kubenswrapper[5120]: I0316 16:15:41.301613 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c140cf00-8a50-47a8-9eaf-0e692be36d16-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:15:41 crc kubenswrapper[5120]: I0316 16:15:41.304273 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c140cf00-8a50-47a8-9eaf-0e692be36d16-config-data" (OuterVolumeSpecName: "config-data") pod "c140cf00-8a50-47a8-9eaf-0e692be36d16" (UID: "c140cf00-8a50-47a8-9eaf-0e692be36d16"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:15:41 crc kubenswrapper[5120]: I0316 16:15:41.304480 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c140cf00-8a50-47a8-9eaf-0e692be36d16-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "c140cf00-8a50-47a8-9eaf-0e692be36d16" (UID: "c140cf00-8a50-47a8-9eaf-0e692be36d16"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:15:41 crc kubenswrapper[5120]: I0316 16:15:41.305051 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c140cf00-8a50-47a8-9eaf-0e692be36d16-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "c140cf00-8a50-47a8-9eaf-0e692be36d16" (UID: "c140cf00-8a50-47a8-9eaf-0e692be36d16"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:15:41 crc kubenswrapper[5120]: I0316 16:15:41.305520 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c140cf00-8a50-47a8-9eaf-0e692be36d16-kube-api-access-fw6ng" (OuterVolumeSpecName: "kube-api-access-fw6ng") pod "c140cf00-8a50-47a8-9eaf-0e692be36d16" (UID: "c140cf00-8a50-47a8-9eaf-0e692be36d16"). InnerVolumeSpecName "kube-api-access-fw6ng". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:15:41 crc kubenswrapper[5120]: I0316 16:15:41.307080 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c140cf00-8a50-47a8-9eaf-0e692be36d16-scripts" (OuterVolumeSpecName: "scripts") pod "c140cf00-8a50-47a8-9eaf-0e692be36d16" (UID: "c140cf00-8a50-47a8-9eaf-0e692be36d16"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:15:41 crc kubenswrapper[5120]: I0316 16:15:41.403932 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c140cf00-8a50-47a8-9eaf-0e692be36d16-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:15:41 crc kubenswrapper[5120]: I0316 16:15:41.404181 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c140cf00-8a50-47a8-9eaf-0e692be36d16-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:15:41 crc kubenswrapper[5120]: I0316 16:15:41.404250 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c140cf00-8a50-47a8-9eaf-0e692be36d16-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:15:41 crc kubenswrapper[5120]: I0316 16:15:41.404319 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fw6ng\" (UniqueName: \"kubernetes.io/projected/c140cf00-8a50-47a8-9eaf-0e692be36d16-kube-api-access-fw6ng\") on node \"crc\" DevicePath \"\"" Mar 16 16:15:41 crc kubenswrapper[5120]: I0316 16:15:41.404389 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/c140cf00-8a50-47a8-9eaf-0e692be36d16-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 16:15:42 crc kubenswrapper[5120]: I0316 16:15:42.244357 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"044996b4-e444-4486-9503-61d776ec849f","Type":"ContainerStarted","Data":"8e88512fc32d8a4ecf18ca4d49876068a8159a6a0e0b4a45be98703daa80d90d"} Mar 16 16:15:42 crc kubenswrapper[5120]: I0316 16:15:42.247040 5120 generic.go:358] "Generic (PLEG): container finished" podID="059e3299-784b-46be-9e1b-f0b81118a979" containerID="3d380b12787b3d95c1c6f7e8c7fcef06816af75aa0b3979c5d9b7dd602be12ac" exitCode=0 Mar 16 16:15:42 crc kubenswrapper[5120]: I0316 16:15:42.247219 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-54f764f5f6-t2dpg" event={"ID":"059e3299-784b-46be-9e1b-f0b81118a979","Type":"ContainerDied","Data":"3d380b12787b3d95c1c6f7e8c7fcef06816af75aa0b3979c5d9b7dd602be12ac"} Mar 16 16:15:42 crc kubenswrapper[5120]: I0316 16:15:42.247545 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:15:42 crc kubenswrapper[5120]: I0316 16:15:42.279072 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-internal-api-0" podStartSLOduration=3.279052113 podStartE2EDuration="3.279052113s" podCreationTimestamp="2026-03-16 16:15:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:15:42.262500469 +0000 UTC m=+2644.416432136" watchObservedRunningTime="2026-03-16 16:15:42.279052113 +0000 UTC m=+2644.432983780" Mar 16 16:15:42 crc kubenswrapper[5120]: I0316 16:15:42.344072 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:15:42 crc kubenswrapper[5120]: I0316 16:15:42.364158 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:15:42 crc kubenswrapper[5120]: I0316 16:15:42.372512 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:15:42 crc kubenswrapper[5120]: I0316 16:15:42.380306 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:15:42 crc kubenswrapper[5120]: I0316 16:15:42.383885 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 16:15:42 crc kubenswrapper[5120]: I0316 16:15:42.385235 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 16:15:42 crc kubenswrapper[5120]: I0316 16:15:42.385348 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:15:42 crc kubenswrapper[5120]: I0316 16:15:42.428000 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e75e15b9-8524-4d60-8f0e-fbc62c53017d-scripts\") pod \"ceilometer-0\" (UID: \"e75e15b9-8524-4d60-8f0e-fbc62c53017d\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:15:42 crc kubenswrapper[5120]: I0316 16:15:42.428122 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e75e15b9-8524-4d60-8f0e-fbc62c53017d-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"e75e15b9-8524-4d60-8f0e-fbc62c53017d\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:15:42 crc kubenswrapper[5120]: I0316 16:15:42.428224 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e75e15b9-8524-4d60-8f0e-fbc62c53017d-log-httpd\") pod \"ceilometer-0\" (UID: \"e75e15b9-8524-4d60-8f0e-fbc62c53017d\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:15:42 crc kubenswrapper[5120]: I0316 16:15:42.428281 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e75e15b9-8524-4d60-8f0e-fbc62c53017d-run-httpd\") pod \"ceilometer-0\" (UID: \"e75e15b9-8524-4d60-8f0e-fbc62c53017d\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:15:42 crc kubenswrapper[5120]: I0316 16:15:42.428413 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5924l\" (UniqueName: \"kubernetes.io/projected/e75e15b9-8524-4d60-8f0e-fbc62c53017d-kube-api-access-5924l\") pod \"ceilometer-0\" (UID: \"e75e15b9-8524-4d60-8f0e-fbc62c53017d\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:15:42 crc kubenswrapper[5120]: I0316 16:15:42.428510 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/e75e15b9-8524-4d60-8f0e-fbc62c53017d-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"e75e15b9-8524-4d60-8f0e-fbc62c53017d\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:15:42 crc kubenswrapper[5120]: I0316 16:15:42.428643 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e75e15b9-8524-4d60-8f0e-fbc62c53017d-config-data\") pod \"ceilometer-0\" (UID: \"e75e15b9-8524-4d60-8f0e-fbc62c53017d\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:15:42 crc kubenswrapper[5120]: I0316 16:15:42.516380 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-54f764f5f6-t2dpg" Mar 16 16:15:42 crc kubenswrapper[5120]: I0316 16:15:42.529508 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/059e3299-784b-46be-9e1b-f0b81118a979-logs\") pod \"059e3299-784b-46be-9e1b-f0b81118a979\" (UID: \"059e3299-784b-46be-9e1b-f0b81118a979\") " Mar 16 16:15:42 crc kubenswrapper[5120]: I0316 16:15:42.529553 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/059e3299-784b-46be-9e1b-f0b81118a979-combined-ca-bundle\") pod \"059e3299-784b-46be-9e1b-f0b81118a979\" (UID: \"059e3299-784b-46be-9e1b-f0b81118a979\") " Mar 16 16:15:42 crc kubenswrapper[5120]: I0316 16:15:42.529647 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/059e3299-784b-46be-9e1b-f0b81118a979-internal-tls-certs\") pod \"059e3299-784b-46be-9e1b-f0b81118a979\" (UID: \"059e3299-784b-46be-9e1b-f0b81118a979\") " Mar 16 16:15:42 crc kubenswrapper[5120]: I0316 16:15:42.529848 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/059e3299-784b-46be-9e1b-f0b81118a979-public-tls-certs\") pod \"059e3299-784b-46be-9e1b-f0b81118a979\" (UID: \"059e3299-784b-46be-9e1b-f0b81118a979\") " Mar 16 16:15:42 crc kubenswrapper[5120]: I0316 16:15:42.529902 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/059e3299-784b-46be-9e1b-f0b81118a979-logs" (OuterVolumeSpecName: "logs") pod "059e3299-784b-46be-9e1b-f0b81118a979" (UID: "059e3299-784b-46be-9e1b-f0b81118a979"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:15:42 crc kubenswrapper[5120]: I0316 16:15:42.529967 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/059e3299-784b-46be-9e1b-f0b81118a979-scripts\") pod \"059e3299-784b-46be-9e1b-f0b81118a979\" (UID: \"059e3299-784b-46be-9e1b-f0b81118a979\") " Mar 16 16:15:42 crc kubenswrapper[5120]: I0316 16:15:42.530042 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-brvpb\" (UniqueName: \"kubernetes.io/projected/059e3299-784b-46be-9e1b-f0b81118a979-kube-api-access-brvpb\") pod \"059e3299-784b-46be-9e1b-f0b81118a979\" (UID: \"059e3299-784b-46be-9e1b-f0b81118a979\") " Mar 16 16:15:42 crc kubenswrapper[5120]: I0316 16:15:42.530182 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/059e3299-784b-46be-9e1b-f0b81118a979-config-data\") pod \"059e3299-784b-46be-9e1b-f0b81118a979\" (UID: \"059e3299-784b-46be-9e1b-f0b81118a979\") " Mar 16 16:15:42 crc kubenswrapper[5120]: I0316 16:15:42.530407 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e75e15b9-8524-4d60-8f0e-fbc62c53017d-config-data\") pod \"ceilometer-0\" (UID: \"e75e15b9-8524-4d60-8f0e-fbc62c53017d\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:15:42 crc kubenswrapper[5120]: I0316 16:15:42.530541 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e75e15b9-8524-4d60-8f0e-fbc62c53017d-scripts\") pod \"ceilometer-0\" (UID: \"e75e15b9-8524-4d60-8f0e-fbc62c53017d\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:15:42 crc kubenswrapper[5120]: I0316 16:15:42.530613 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e75e15b9-8524-4d60-8f0e-fbc62c53017d-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"e75e15b9-8524-4d60-8f0e-fbc62c53017d\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:15:42 crc kubenswrapper[5120]: I0316 16:15:42.530654 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e75e15b9-8524-4d60-8f0e-fbc62c53017d-log-httpd\") pod \"ceilometer-0\" (UID: \"e75e15b9-8524-4d60-8f0e-fbc62c53017d\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:15:42 crc kubenswrapper[5120]: I0316 16:15:42.530721 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e75e15b9-8524-4d60-8f0e-fbc62c53017d-run-httpd\") pod \"ceilometer-0\" (UID: \"e75e15b9-8524-4d60-8f0e-fbc62c53017d\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:15:42 crc kubenswrapper[5120]: I0316 16:15:42.530910 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5924l\" (UniqueName: \"kubernetes.io/projected/e75e15b9-8524-4d60-8f0e-fbc62c53017d-kube-api-access-5924l\") pod \"ceilometer-0\" (UID: \"e75e15b9-8524-4d60-8f0e-fbc62c53017d\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:15:42 crc kubenswrapper[5120]: I0316 16:15:42.530998 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/e75e15b9-8524-4d60-8f0e-fbc62c53017d-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"e75e15b9-8524-4d60-8f0e-fbc62c53017d\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:15:42 crc kubenswrapper[5120]: I0316 16:15:42.531081 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/059e3299-784b-46be-9e1b-f0b81118a979-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:15:42 crc kubenswrapper[5120]: I0316 16:15:42.533023 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e75e15b9-8524-4d60-8f0e-fbc62c53017d-run-httpd\") pod \"ceilometer-0\" (UID: \"e75e15b9-8524-4d60-8f0e-fbc62c53017d\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:15:42 crc kubenswrapper[5120]: I0316 16:15:42.533181 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e75e15b9-8524-4d60-8f0e-fbc62c53017d-log-httpd\") pod \"ceilometer-0\" (UID: \"e75e15b9-8524-4d60-8f0e-fbc62c53017d\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:15:42 crc kubenswrapper[5120]: I0316 16:15:42.540503 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/059e3299-784b-46be-9e1b-f0b81118a979-kube-api-access-brvpb" (OuterVolumeSpecName: "kube-api-access-brvpb") pod "059e3299-784b-46be-9e1b-f0b81118a979" (UID: "059e3299-784b-46be-9e1b-f0b81118a979"). InnerVolumeSpecName "kube-api-access-brvpb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:15:42 crc kubenswrapper[5120]: I0316 16:15:42.541746 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/059e3299-784b-46be-9e1b-f0b81118a979-scripts" (OuterVolumeSpecName: "scripts") pod "059e3299-784b-46be-9e1b-f0b81118a979" (UID: "059e3299-784b-46be-9e1b-f0b81118a979"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:15:42 crc kubenswrapper[5120]: I0316 16:15:42.546576 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/e75e15b9-8524-4d60-8f0e-fbc62c53017d-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"e75e15b9-8524-4d60-8f0e-fbc62c53017d\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:15:42 crc kubenswrapper[5120]: I0316 16:15:42.556809 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5924l\" (UniqueName: \"kubernetes.io/projected/e75e15b9-8524-4d60-8f0e-fbc62c53017d-kube-api-access-5924l\") pod \"ceilometer-0\" (UID: \"e75e15b9-8524-4d60-8f0e-fbc62c53017d\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:15:42 crc kubenswrapper[5120]: I0316 16:15:42.569567 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e75e15b9-8524-4d60-8f0e-fbc62c53017d-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"e75e15b9-8524-4d60-8f0e-fbc62c53017d\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:15:42 crc kubenswrapper[5120]: I0316 16:15:42.574556 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e75e15b9-8524-4d60-8f0e-fbc62c53017d-config-data\") pod \"ceilometer-0\" (UID: \"e75e15b9-8524-4d60-8f0e-fbc62c53017d\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:15:42 crc kubenswrapper[5120]: I0316 16:15:42.581735 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e75e15b9-8524-4d60-8f0e-fbc62c53017d-scripts\") pod \"ceilometer-0\" (UID: \"e75e15b9-8524-4d60-8f0e-fbc62c53017d\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:15:42 crc kubenswrapper[5120]: I0316 16:15:42.600940 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/059e3299-784b-46be-9e1b-f0b81118a979-config-data" (OuterVolumeSpecName: "config-data") pod "059e3299-784b-46be-9e1b-f0b81118a979" (UID: "059e3299-784b-46be-9e1b-f0b81118a979"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:15:42 crc kubenswrapper[5120]: I0316 16:15:42.604554 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/059e3299-784b-46be-9e1b-f0b81118a979-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "059e3299-784b-46be-9e1b-f0b81118a979" (UID: "059e3299-784b-46be-9e1b-f0b81118a979"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:15:42 crc kubenswrapper[5120]: I0316 16:15:42.632858 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/059e3299-784b-46be-9e1b-f0b81118a979-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:15:42 crc kubenswrapper[5120]: I0316 16:15:42.632886 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-brvpb\" (UniqueName: \"kubernetes.io/projected/059e3299-784b-46be-9e1b-f0b81118a979-kube-api-access-brvpb\") on node \"crc\" DevicePath \"\"" Mar 16 16:15:42 crc kubenswrapper[5120]: I0316 16:15:42.632899 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/059e3299-784b-46be-9e1b-f0b81118a979-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:15:42 crc kubenswrapper[5120]: I0316 16:15:42.632910 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/059e3299-784b-46be-9e1b-f0b81118a979-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:15:42 crc kubenswrapper[5120]: I0316 16:15:42.652229 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/059e3299-784b-46be-9e1b-f0b81118a979-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "059e3299-784b-46be-9e1b-f0b81118a979" (UID: "059e3299-784b-46be-9e1b-f0b81118a979"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:15:42 crc kubenswrapper[5120]: I0316 16:15:42.661491 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/059e3299-784b-46be-9e1b-f0b81118a979-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "059e3299-784b-46be-9e1b-f0b81118a979" (UID: "059e3299-784b-46be-9e1b-f0b81118a979"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:15:42 crc kubenswrapper[5120]: I0316 16:15:42.676060 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c140cf00-8a50-47a8-9eaf-0e692be36d16" path="/var/lib/kubelet/pods/c140cf00-8a50-47a8-9eaf-0e692be36d16/volumes" Mar 16 16:15:42 crc kubenswrapper[5120]: I0316 16:15:42.706358 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:15:42 crc kubenswrapper[5120]: I0316 16:15:42.736353 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/059e3299-784b-46be-9e1b-f0b81118a979-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:15:42 crc kubenswrapper[5120]: I0316 16:15:42.736815 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/059e3299-784b-46be-9e1b-f0b81118a979-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:15:43 crc kubenswrapper[5120]: I0316 16:15:43.164827 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:15:43 crc kubenswrapper[5120]: W0316 16:15:43.165453 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode75e15b9_8524_4d60_8f0e_fbc62c53017d.slice/crio-383a72622dd5893f2a4e36d040846eaa79bbf1aafda8d15e55c72ec8bee594ca WatchSource:0}: Error finding container 383a72622dd5893f2a4e36d040846eaa79bbf1aafda8d15e55c72ec8bee594ca: Status 404 returned error can't find the container with id 383a72622dd5893f2a4e36d040846eaa79bbf1aafda8d15e55c72ec8bee594ca Mar 16 16:15:43 crc kubenswrapper[5120]: I0316 16:15:43.259525 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-54f764f5f6-t2dpg" Mar 16 16:15:43 crc kubenswrapper[5120]: I0316 16:15:43.259548 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-54f764f5f6-t2dpg" event={"ID":"059e3299-784b-46be-9e1b-f0b81118a979","Type":"ContainerDied","Data":"fd9ed33f26264de8b2cd2d34cb5494f6e8f04abb8a30263606d5bf8544d686df"} Mar 16 16:15:43 crc kubenswrapper[5120]: I0316 16:15:43.260264 5120 scope.go:117] "RemoveContainer" containerID="3d380b12787b3d95c1c6f7e8c7fcef06816af75aa0b3979c5d9b7dd602be12ac" Mar 16 16:15:43 crc kubenswrapper[5120]: I0316 16:15:43.261932 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"e75e15b9-8524-4d60-8f0e-fbc62c53017d","Type":"ContainerStarted","Data":"383a72622dd5893f2a4e36d040846eaa79bbf1aafda8d15e55c72ec8bee594ca"} Mar 16 16:15:43 crc kubenswrapper[5120]: I0316 16:15:43.310456 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-54f764f5f6-t2dpg"] Mar 16 16:15:43 crc kubenswrapper[5120]: I0316 16:15:43.311026 5120 scope.go:117] "RemoveContainer" containerID="1f995c8e48ba658ba33982a0b6c2e16251b61464a914fdf7b421a8da28a25e23" Mar 16 16:15:43 crc kubenswrapper[5120]: I0316 16:15:43.334585 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-54f764f5f6-t2dpg"] Mar 16 16:15:43 crc kubenswrapper[5120]: I0316 16:15:43.793379 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-z6f5v"] Mar 16 16:15:43 crc kubenswrapper[5120]: I0316 16:15:43.800892 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="059e3299-784b-46be-9e1b-f0b81118a979" containerName="placement-log" Mar 16 16:15:43 crc kubenswrapper[5120]: I0316 16:15:43.800923 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="059e3299-784b-46be-9e1b-f0b81118a979" containerName="placement-log" Mar 16 16:15:43 crc kubenswrapper[5120]: I0316 16:15:43.800951 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="059e3299-784b-46be-9e1b-f0b81118a979" containerName="placement-api" Mar 16 16:15:43 crc kubenswrapper[5120]: I0316 16:15:43.800957 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="059e3299-784b-46be-9e1b-f0b81118a979" containerName="placement-api" Mar 16 16:15:43 crc kubenswrapper[5120]: I0316 16:15:43.801224 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="059e3299-784b-46be-9e1b-f0b81118a979" containerName="placement-api" Mar 16 16:15:43 crc kubenswrapper[5120]: I0316 16:15:43.801245 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="059e3299-784b-46be-9e1b-f0b81118a979" containerName="placement-log" Mar 16 16:15:43 crc kubenswrapper[5120]: I0316 16:15:43.805665 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-z6f5v"] Mar 16 16:15:43 crc kubenswrapper[5120]: I0316 16:15:43.805775 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-z6f5v" Mar 16 16:15:43 crc kubenswrapper[5120]: I0316 16:15:43.808285 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-conductor-config-data\"" Mar 16 16:15:43 crc kubenswrapper[5120]: I0316 16:15:43.812362 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-nova-dockercfg-jccgj\"" Mar 16 16:15:43 crc kubenswrapper[5120]: I0316 16:15:43.833214 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-conductor-scripts\"" Mar 16 16:15:43 crc kubenswrapper[5120]: I0316 16:15:43.882092 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b56a81fa-4773-41b2-b585-c72ebe415ea1-combined-ca-bundle\") pod \"nova-cell0-conductor-db-sync-z6f5v\" (UID: \"b56a81fa-4773-41b2-b585-c72ebe415ea1\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-z6f5v" Mar 16 16:15:43 crc kubenswrapper[5120]: I0316 16:15:43.882175 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b56a81fa-4773-41b2-b585-c72ebe415ea1-config-data\") pod \"nova-cell0-conductor-db-sync-z6f5v\" (UID: \"b56a81fa-4773-41b2-b585-c72ebe415ea1\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-z6f5v" Mar 16 16:15:43 crc kubenswrapper[5120]: I0316 16:15:43.882246 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhbcj\" (UniqueName: \"kubernetes.io/projected/b56a81fa-4773-41b2-b585-c72ebe415ea1-kube-api-access-rhbcj\") pod \"nova-cell0-conductor-db-sync-z6f5v\" (UID: \"b56a81fa-4773-41b2-b585-c72ebe415ea1\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-z6f5v" Mar 16 16:15:43 crc kubenswrapper[5120]: I0316 16:15:43.882301 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b56a81fa-4773-41b2-b585-c72ebe415ea1-scripts\") pod \"nova-cell0-conductor-db-sync-z6f5v\" (UID: \"b56a81fa-4773-41b2-b585-c72ebe415ea1\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-z6f5v" Mar 16 16:15:43 crc kubenswrapper[5120]: I0316 16:15:43.983567 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b56a81fa-4773-41b2-b585-c72ebe415ea1-combined-ca-bundle\") pod \"nova-cell0-conductor-db-sync-z6f5v\" (UID: \"b56a81fa-4773-41b2-b585-c72ebe415ea1\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-z6f5v" Mar 16 16:15:43 crc kubenswrapper[5120]: I0316 16:15:43.983633 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b56a81fa-4773-41b2-b585-c72ebe415ea1-config-data\") pod \"nova-cell0-conductor-db-sync-z6f5v\" (UID: \"b56a81fa-4773-41b2-b585-c72ebe415ea1\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-z6f5v" Mar 16 16:15:43 crc kubenswrapper[5120]: I0316 16:15:43.983704 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rhbcj\" (UniqueName: \"kubernetes.io/projected/b56a81fa-4773-41b2-b585-c72ebe415ea1-kube-api-access-rhbcj\") pod \"nova-cell0-conductor-db-sync-z6f5v\" (UID: \"b56a81fa-4773-41b2-b585-c72ebe415ea1\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-z6f5v" Mar 16 16:15:43 crc kubenswrapper[5120]: I0316 16:15:43.983772 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b56a81fa-4773-41b2-b585-c72ebe415ea1-scripts\") pod \"nova-cell0-conductor-db-sync-z6f5v\" (UID: \"b56a81fa-4773-41b2-b585-c72ebe415ea1\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-z6f5v" Mar 16 16:15:44 crc kubenswrapper[5120]: I0316 16:15:44.003647 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b56a81fa-4773-41b2-b585-c72ebe415ea1-combined-ca-bundle\") pod \"nova-cell0-conductor-db-sync-z6f5v\" (UID: \"b56a81fa-4773-41b2-b585-c72ebe415ea1\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-z6f5v" Mar 16 16:15:44 crc kubenswrapper[5120]: I0316 16:15:44.008686 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b56a81fa-4773-41b2-b585-c72ebe415ea1-scripts\") pod \"nova-cell0-conductor-db-sync-z6f5v\" (UID: \"b56a81fa-4773-41b2-b585-c72ebe415ea1\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-z6f5v" Mar 16 16:15:44 crc kubenswrapper[5120]: I0316 16:15:44.013240 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b56a81fa-4773-41b2-b585-c72ebe415ea1-config-data\") pod \"nova-cell0-conductor-db-sync-z6f5v\" (UID: \"b56a81fa-4773-41b2-b585-c72ebe415ea1\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-z6f5v" Mar 16 16:15:44 crc kubenswrapper[5120]: I0316 16:15:44.019534 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhbcj\" (UniqueName: \"kubernetes.io/projected/b56a81fa-4773-41b2-b585-c72ebe415ea1-kube-api-access-rhbcj\") pod \"nova-cell0-conductor-db-sync-z6f5v\" (UID: \"b56a81fa-4773-41b2-b585-c72ebe415ea1\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-z6f5v" Mar 16 16:15:44 crc kubenswrapper[5120]: I0316 16:15:44.169448 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-z6f5v" Mar 16 16:15:44 crc kubenswrapper[5120]: I0316 16:15:44.280390 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"e75e15b9-8524-4d60-8f0e-fbc62c53017d","Type":"ContainerStarted","Data":"17cc20f230aaacbf09567a8e3c1fd76557368efa2c5cc8ef2ef609b247a960ea"} Mar 16 16:15:44 crc kubenswrapper[5120]: I0316 16:15:44.725593 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="059e3299-784b-46be-9e1b-f0b81118a979" path="/var/lib/kubelet/pods/059e3299-784b-46be-9e1b-f0b81118a979/volumes" Mar 16 16:15:44 crc kubenswrapper[5120]: I0316 16:15:44.733796 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-z6f5v"] Mar 16 16:15:45 crc kubenswrapper[5120]: I0316 16:15:45.294070 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"e75e15b9-8524-4d60-8f0e-fbc62c53017d","Type":"ContainerStarted","Data":"ac58d6522b00bf15e9f2beae73c11d1bef154858476c238e0a1dc17e974e5986"} Mar 16 16:15:45 crc kubenswrapper[5120]: I0316 16:15:45.296835 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-z6f5v" event={"ID":"b56a81fa-4773-41b2-b585-c72ebe415ea1","Type":"ContainerStarted","Data":"a2b5bb293c850d9efc551f9bb6c4bb698396da51ecac0ac9a7494438c023a581"} Mar 16 16:15:45 crc kubenswrapper[5120]: I0316 16:15:45.296881 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-z6f5v" event={"ID":"b56a81fa-4773-41b2-b585-c72ebe415ea1","Type":"ContainerStarted","Data":"86f5aed2947864aebbda2f8abc1fbce4e240723e9d60bf9230d0977bd92fec87"} Mar 16 16:15:45 crc kubenswrapper[5120]: I0316 16:15:45.325282 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-z6f5v" podStartSLOduration=2.325257772 podStartE2EDuration="2.325257772s" podCreationTimestamp="2026-03-16 16:15:43 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:15:45.312650964 +0000 UTC m=+2647.466582621" watchObservedRunningTime="2026-03-16 16:15:45.325257772 +0000 UTC m=+2647.479189439" Mar 16 16:15:46 crc kubenswrapper[5120]: I0316 16:15:46.307933 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"e75e15b9-8524-4d60-8f0e-fbc62c53017d","Type":"ContainerStarted","Data":"f7120deb045ac2697483dc56cd7f2466a0e674ce0900dcc0f12585477b6fb21b"} Mar 16 16:15:48 crc kubenswrapper[5120]: I0316 16:15:48.340010 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"e75e15b9-8524-4d60-8f0e-fbc62c53017d","Type":"ContainerStarted","Data":"eef1a25a0cf1e37b068a91b7c0912810dba06eb70e31791fb6786f0323a8cf91"} Mar 16 16:15:48 crc kubenswrapper[5120]: I0316 16:15:48.342171 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:15:48 crc kubenswrapper[5120]: I0316 16:15:48.370143 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.292845723 podStartE2EDuration="6.370123695s" podCreationTimestamp="2026-03-16 16:15:42 +0000 UTC" firstStartedPulling="2026-03-16 16:15:43.167995897 +0000 UTC m=+2645.321927564" lastFinishedPulling="2026-03-16 16:15:47.245273849 +0000 UTC m=+2649.399205536" observedRunningTime="2026-03-16 16:15:48.362746477 +0000 UTC m=+2650.516678154" watchObservedRunningTime="2026-03-16 16:15:48.370123695 +0000 UTC m=+2650.524055352" Mar 16 16:15:48 crc kubenswrapper[5120]: I0316 16:15:48.880025 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:15:48 crc kubenswrapper[5120]: I0316 16:15:48.880365 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:15:48 crc kubenswrapper[5120]: I0316 16:15:48.913877 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:15:48 crc kubenswrapper[5120]: I0316 16:15:48.931156 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:15:49 crc kubenswrapper[5120]: I0316 16:15:49.349966 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:15:49 crc kubenswrapper[5120]: I0316 16:15:49.349995 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:15:49 crc kubenswrapper[5120]: I0316 16:15:49.567744 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:15:49 crc kubenswrapper[5120]: I0316 16:15:49.569152 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:15:49 crc kubenswrapper[5120]: I0316 16:15:49.608859 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:15:49 crc kubenswrapper[5120]: I0316 16:15:49.635364 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:15:50 crc kubenswrapper[5120]: I0316 16:15:50.358499 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:15:50 crc kubenswrapper[5120]: I0316 16:15:50.358539 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:15:51 crc kubenswrapper[5120]: I0316 16:15:51.105481 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:15:51 crc kubenswrapper[5120]: I0316 16:15:51.233301 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:15:52 crc kubenswrapper[5120]: I0316 16:15:52.219830 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:15:52 crc kubenswrapper[5120]: I0316 16:15:52.221046 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:15:54 crc kubenswrapper[5120]: I0316 16:15:54.396045 5120 generic.go:358] "Generic (PLEG): container finished" podID="b56a81fa-4773-41b2-b585-c72ebe415ea1" containerID="a2b5bb293c850d9efc551f9bb6c4bb698396da51ecac0ac9a7494438c023a581" exitCode=0 Mar 16 16:15:54 crc kubenswrapper[5120]: I0316 16:15:54.396104 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-z6f5v" event={"ID":"b56a81fa-4773-41b2-b585-c72ebe415ea1","Type":"ContainerDied","Data":"a2b5bb293c850d9efc551f9bb6c4bb698396da51ecac0ac9a7494438c023a581"} Mar 16 16:15:55 crc kubenswrapper[5120]: I0316 16:15:55.765802 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-z6f5v" Mar 16 16:15:55 crc kubenswrapper[5120]: I0316 16:15:55.876186 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b56a81fa-4773-41b2-b585-c72ebe415ea1-combined-ca-bundle\") pod \"b56a81fa-4773-41b2-b585-c72ebe415ea1\" (UID: \"b56a81fa-4773-41b2-b585-c72ebe415ea1\") " Mar 16 16:15:55 crc kubenswrapper[5120]: I0316 16:15:55.876359 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b56a81fa-4773-41b2-b585-c72ebe415ea1-scripts\") pod \"b56a81fa-4773-41b2-b585-c72ebe415ea1\" (UID: \"b56a81fa-4773-41b2-b585-c72ebe415ea1\") " Mar 16 16:15:55 crc kubenswrapper[5120]: I0316 16:15:55.876479 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b56a81fa-4773-41b2-b585-c72ebe415ea1-config-data\") pod \"b56a81fa-4773-41b2-b585-c72ebe415ea1\" (UID: \"b56a81fa-4773-41b2-b585-c72ebe415ea1\") " Mar 16 16:15:55 crc kubenswrapper[5120]: I0316 16:15:55.876625 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rhbcj\" (UniqueName: \"kubernetes.io/projected/b56a81fa-4773-41b2-b585-c72ebe415ea1-kube-api-access-rhbcj\") pod \"b56a81fa-4773-41b2-b585-c72ebe415ea1\" (UID: \"b56a81fa-4773-41b2-b585-c72ebe415ea1\") " Mar 16 16:15:55 crc kubenswrapper[5120]: I0316 16:15:55.882036 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b56a81fa-4773-41b2-b585-c72ebe415ea1-kube-api-access-rhbcj" (OuterVolumeSpecName: "kube-api-access-rhbcj") pod "b56a81fa-4773-41b2-b585-c72ebe415ea1" (UID: "b56a81fa-4773-41b2-b585-c72ebe415ea1"). InnerVolumeSpecName "kube-api-access-rhbcj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:15:55 crc kubenswrapper[5120]: I0316 16:15:55.897556 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b56a81fa-4773-41b2-b585-c72ebe415ea1-scripts" (OuterVolumeSpecName: "scripts") pod "b56a81fa-4773-41b2-b585-c72ebe415ea1" (UID: "b56a81fa-4773-41b2-b585-c72ebe415ea1"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:15:55 crc kubenswrapper[5120]: I0316 16:15:55.901993 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b56a81fa-4773-41b2-b585-c72ebe415ea1-config-data" (OuterVolumeSpecName: "config-data") pod "b56a81fa-4773-41b2-b585-c72ebe415ea1" (UID: "b56a81fa-4773-41b2-b585-c72ebe415ea1"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:15:55 crc kubenswrapper[5120]: I0316 16:15:55.908612 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b56a81fa-4773-41b2-b585-c72ebe415ea1-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "b56a81fa-4773-41b2-b585-c72ebe415ea1" (UID: "b56a81fa-4773-41b2-b585-c72ebe415ea1"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:15:55 crc kubenswrapper[5120]: I0316 16:15:55.980120 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b56a81fa-4773-41b2-b585-c72ebe415ea1-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:15:55 crc kubenswrapper[5120]: I0316 16:15:55.980161 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b56a81fa-4773-41b2-b585-c72ebe415ea1-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:15:55 crc kubenswrapper[5120]: I0316 16:15:55.980171 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b56a81fa-4773-41b2-b585-c72ebe415ea1-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:15:55 crc kubenswrapper[5120]: I0316 16:15:55.980182 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rhbcj\" (UniqueName: \"kubernetes.io/projected/b56a81fa-4773-41b2-b585-c72ebe415ea1-kube-api-access-rhbcj\") on node \"crc\" DevicePath \"\"" Mar 16 16:15:56 crc kubenswrapper[5120]: I0316 16:15:56.423901 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-z6f5v" Mar 16 16:15:56 crc kubenswrapper[5120]: I0316 16:15:56.423988 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-z6f5v" event={"ID":"b56a81fa-4773-41b2-b585-c72ebe415ea1","Type":"ContainerDied","Data":"86f5aed2947864aebbda2f8abc1fbce4e240723e9d60bf9230d0977bd92fec87"} Mar 16 16:15:56 crc kubenswrapper[5120]: I0316 16:15:56.424041 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="86f5aed2947864aebbda2f8abc1fbce4e240723e9d60bf9230d0977bd92fec87" Mar 16 16:15:56 crc kubenswrapper[5120]: I0316 16:15:56.526794 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:15:56 crc kubenswrapper[5120]: I0316 16:15:56.528044 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b56a81fa-4773-41b2-b585-c72ebe415ea1" containerName="nova-cell0-conductor-db-sync" Mar 16 16:15:56 crc kubenswrapper[5120]: I0316 16:15:56.528074 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="b56a81fa-4773-41b2-b585-c72ebe415ea1" containerName="nova-cell0-conductor-db-sync" Mar 16 16:15:56 crc kubenswrapper[5120]: I0316 16:15:56.528319 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="b56a81fa-4773-41b2-b585-c72ebe415ea1" containerName="nova-cell0-conductor-db-sync" Mar 16 16:15:56 crc kubenswrapper[5120]: I0316 16:15:56.534185 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:15:56 crc kubenswrapper[5120]: I0316 16:15:56.536960 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-nova-dockercfg-jccgj\"" Mar 16 16:15:56 crc kubenswrapper[5120]: I0316 16:15:56.538235 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-conductor-config-data\"" Mar 16 16:15:56 crc kubenswrapper[5120]: I0316 16:15:56.541346 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:15:56 crc kubenswrapper[5120]: I0316 16:15:56.601030 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/711e7cd2-a028-4c76-969e-e08558a5d732-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"711e7cd2-a028-4c76-969e-e08558a5d732\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:15:56 crc kubenswrapper[5120]: I0316 16:15:56.601231 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znd29\" (UniqueName: \"kubernetes.io/projected/711e7cd2-a028-4c76-969e-e08558a5d732-kube-api-access-znd29\") pod \"nova-cell0-conductor-0\" (UID: \"711e7cd2-a028-4c76-969e-e08558a5d732\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:15:56 crc kubenswrapper[5120]: I0316 16:15:56.601360 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/711e7cd2-a028-4c76-969e-e08558a5d732-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"711e7cd2-a028-4c76-969e-e08558a5d732\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:15:56 crc kubenswrapper[5120]: I0316 16:15:56.703227 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/711e7cd2-a028-4c76-969e-e08558a5d732-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"711e7cd2-a028-4c76-969e-e08558a5d732\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:15:56 crc kubenswrapper[5120]: I0316 16:15:56.703460 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-znd29\" (UniqueName: \"kubernetes.io/projected/711e7cd2-a028-4c76-969e-e08558a5d732-kube-api-access-znd29\") pod \"nova-cell0-conductor-0\" (UID: \"711e7cd2-a028-4c76-969e-e08558a5d732\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:15:56 crc kubenswrapper[5120]: I0316 16:15:56.704224 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/711e7cd2-a028-4c76-969e-e08558a5d732-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"711e7cd2-a028-4c76-969e-e08558a5d732\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:15:56 crc kubenswrapper[5120]: I0316 16:15:56.709530 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/711e7cd2-a028-4c76-969e-e08558a5d732-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"711e7cd2-a028-4c76-969e-e08558a5d732\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:15:56 crc kubenswrapper[5120]: I0316 16:15:56.710267 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/711e7cd2-a028-4c76-969e-e08558a5d732-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"711e7cd2-a028-4c76-969e-e08558a5d732\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:15:56 crc kubenswrapper[5120]: I0316 16:15:56.721454 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-znd29\" (UniqueName: \"kubernetes.io/projected/711e7cd2-a028-4c76-969e-e08558a5d732-kube-api-access-znd29\") pod \"nova-cell0-conductor-0\" (UID: \"711e7cd2-a028-4c76-969e-e08558a5d732\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:15:56 crc kubenswrapper[5120]: I0316 16:15:56.901267 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:15:57 crc kubenswrapper[5120]: W0316 16:15:57.378232 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod711e7cd2_a028_4c76_969e_e08558a5d732.slice/crio-6c2d6ed8f340a4e3c048b0de0cc28a7730dd5b0d5151829210190716447f7150 WatchSource:0}: Error finding container 6c2d6ed8f340a4e3c048b0de0cc28a7730dd5b0d5151829210190716447f7150: Status 404 returned error can't find the container with id 6c2d6ed8f340a4e3c048b0de0cc28a7730dd5b0d5151829210190716447f7150 Mar 16 16:15:57 crc kubenswrapper[5120]: I0316 16:15:57.379592 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:15:57 crc kubenswrapper[5120]: I0316 16:15:57.438683 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"711e7cd2-a028-4c76-969e-e08558a5d732","Type":"ContainerStarted","Data":"6c2d6ed8f340a4e3c048b0de0cc28a7730dd5b0d5151829210190716447f7150"} Mar 16 16:15:58 crc kubenswrapper[5120]: I0316 16:15:58.454660 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"711e7cd2-a028-4c76-969e-e08558a5d732","Type":"ContainerStarted","Data":"6c6a76b2480d11bbcbe9da4f0bbb77ee9e7dcffe33abc117e4fd2108ee958a64"} Mar 16 16:15:58 crc kubenswrapper[5120]: I0316 16:15:58.454855 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:15:58 crc kubenswrapper[5120]: I0316 16:15:58.486663 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podStartSLOduration=2.486629468 podStartE2EDuration="2.486629468s" podCreationTimestamp="2026-03-16 16:15:56 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:15:58.476252759 +0000 UTC m=+2660.630184526" watchObservedRunningTime="2026-03-16 16:15:58.486629468 +0000 UTC m=+2660.640561165" Mar 16 16:16:00 crc kubenswrapper[5120]: I0316 16:16:00.146468 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-infra/auto-csr-approver-29561296-84z27"] Mar 16 16:16:00 crc kubenswrapper[5120]: I0316 16:16:00.158970 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561296-84z27"] Mar 16 16:16:00 crc kubenswrapper[5120]: I0316 16:16:00.159087 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561296-84z27" Mar 16 16:16:00 crc kubenswrapper[5120]: I0316 16:16:00.162007 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-infra\"/\"csr-approver-sa-dockercfg-x2nsz\"" Mar 16 16:16:00 crc kubenswrapper[5120]: I0316 16:16:00.162473 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"openshift-service-ca.crt\"" Mar 16 16:16:00 crc kubenswrapper[5120]: I0316 16:16:00.162706 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"kube-root-ca.crt\"" Mar 16 16:16:00 crc kubenswrapper[5120]: I0316 16:16:00.300123 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9lg4c\" (UniqueName: \"kubernetes.io/projected/18f9bc9d-6434-4b9f-a8f2-0135edd298d4-kube-api-access-9lg4c\") pod \"auto-csr-approver-29561296-84z27\" (UID: \"18f9bc9d-6434-4b9f-a8f2-0135edd298d4\") " pod="openshift-infra/auto-csr-approver-29561296-84z27" Mar 16 16:16:00 crc kubenswrapper[5120]: I0316 16:16:00.402731 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9lg4c\" (UniqueName: \"kubernetes.io/projected/18f9bc9d-6434-4b9f-a8f2-0135edd298d4-kube-api-access-9lg4c\") pod \"auto-csr-approver-29561296-84z27\" (UID: \"18f9bc9d-6434-4b9f-a8f2-0135edd298d4\") " pod="openshift-infra/auto-csr-approver-29561296-84z27" Mar 16 16:16:00 crc kubenswrapper[5120]: I0316 16:16:00.430457 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9lg4c\" (UniqueName: \"kubernetes.io/projected/18f9bc9d-6434-4b9f-a8f2-0135edd298d4-kube-api-access-9lg4c\") pod \"auto-csr-approver-29561296-84z27\" (UID: \"18f9bc9d-6434-4b9f-a8f2-0135edd298d4\") " pod="openshift-infra/auto-csr-approver-29561296-84z27" Mar 16 16:16:00 crc kubenswrapper[5120]: I0316 16:16:00.492097 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561296-84z27" Mar 16 16:16:01 crc kubenswrapper[5120]: I0316 16:16:01.060041 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561296-84z27"] Mar 16 16:16:01 crc kubenswrapper[5120]: W0316 16:16:01.067988 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod18f9bc9d_6434_4b9f_a8f2_0135edd298d4.slice/crio-9c2c569b14a33e62a8b7560d1f664eef3c1a356f696742b19bfe73833ce54c41 WatchSource:0}: Error finding container 9c2c569b14a33e62a8b7560d1f664eef3c1a356f696742b19bfe73833ce54c41: Status 404 returned error can't find the container with id 9c2c569b14a33e62a8b7560d1f664eef3c1a356f696742b19bfe73833ce54c41 Mar 16 16:16:01 crc kubenswrapper[5120]: I0316 16:16:01.500729 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561296-84z27" event={"ID":"18f9bc9d-6434-4b9f-a8f2-0135edd298d4","Type":"ContainerStarted","Data":"9c2c569b14a33e62a8b7560d1f664eef3c1a356f696742b19bfe73833ce54c41"} Mar 16 16:16:03 crc kubenswrapper[5120]: I0316 16:16:03.529985 5120 generic.go:358] "Generic (PLEG): container finished" podID="18f9bc9d-6434-4b9f-a8f2-0135edd298d4" containerID="90c715905e529ad14178abbf6e655f50ba4c8c1f19dec4d3c9f6de79844d5fff" exitCode=0 Mar 16 16:16:03 crc kubenswrapper[5120]: I0316 16:16:03.530097 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561296-84z27" event={"ID":"18f9bc9d-6434-4b9f-a8f2-0135edd298d4","Type":"ContainerDied","Data":"90c715905e529ad14178abbf6e655f50ba4c8c1f19dec4d3c9f6de79844d5fff"} Mar 16 16:16:04 crc kubenswrapper[5120]: I0316 16:16:04.499438 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:16:05 crc kubenswrapper[5120]: I0316 16:16:05.271027 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-5dw24"] Mar 16 16:16:05 crc kubenswrapper[5120]: I0316 16:16:05.277234 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-5dw24" Mar 16 16:16:05 crc kubenswrapper[5120]: I0316 16:16:05.279567 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-manage-scripts\"" Mar 16 16:16:05 crc kubenswrapper[5120]: I0316 16:16:05.279609 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-manage-config-data\"" Mar 16 16:16:05 crc kubenswrapper[5120]: I0316 16:16:05.287610 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-5dw24"] Mar 16 16:16:05 crc kubenswrapper[5120]: I0316 16:16:05.326607 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561296-84z27" Mar 16 16:16:05 crc kubenswrapper[5120]: I0316 16:16:05.331638 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b6faf05a-dc59-49cb-9b76-dd13901f77d3-config-data\") pod \"nova-cell0-cell-mapping-5dw24\" (UID: \"b6faf05a-dc59-49cb-9b76-dd13901f77d3\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-5dw24" Mar 16 16:16:05 crc kubenswrapper[5120]: I0316 16:16:05.331684 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b6faf05a-dc59-49cb-9b76-dd13901f77d3-combined-ca-bundle\") pod \"nova-cell0-cell-mapping-5dw24\" (UID: \"b6faf05a-dc59-49cb-9b76-dd13901f77d3\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-5dw24" Mar 16 16:16:05 crc kubenswrapper[5120]: I0316 16:16:05.331823 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xrl8\" (UniqueName: \"kubernetes.io/projected/b6faf05a-dc59-49cb-9b76-dd13901f77d3-kube-api-access-6xrl8\") pod \"nova-cell0-cell-mapping-5dw24\" (UID: \"b6faf05a-dc59-49cb-9b76-dd13901f77d3\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-5dw24" Mar 16 16:16:05 crc kubenswrapper[5120]: I0316 16:16:05.331928 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b6faf05a-dc59-49cb-9b76-dd13901f77d3-scripts\") pod \"nova-cell0-cell-mapping-5dw24\" (UID: \"b6faf05a-dc59-49cb-9b76-dd13901f77d3\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-5dw24" Mar 16 16:16:05 crc kubenswrapper[5120]: I0316 16:16:05.386673 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-cmr6k"] Mar 16 16:16:05 crc kubenswrapper[5120]: I0316 16:16:05.388037 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18f9bc9d-6434-4b9f-a8f2-0135edd298d4" containerName="oc" Mar 16 16:16:05 crc kubenswrapper[5120]: I0316 16:16:05.389144 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="18f9bc9d-6434-4b9f-a8f2-0135edd298d4" containerName="oc" Mar 16 16:16:05 crc kubenswrapper[5120]: I0316 16:16:05.389479 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="18f9bc9d-6434-4b9f-a8f2-0135edd298d4" containerName="oc" Mar 16 16:16:05 crc kubenswrapper[5120]: I0316 16:16:05.394111 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-cmr6k" Mar 16 16:16:05 crc kubenswrapper[5120]: I0316 16:16:05.399077 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-conductor-config-data\"" Mar 16 16:16:05 crc kubenswrapper[5120]: I0316 16:16:05.399282 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-conductor-scripts\"" Mar 16 16:16:05 crc kubenswrapper[5120]: I0316 16:16:05.404728 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-cmr6k"] Mar 16 16:16:05 crc kubenswrapper[5120]: I0316 16:16:05.434123 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9lg4c\" (UniqueName: \"kubernetes.io/projected/18f9bc9d-6434-4b9f-a8f2-0135edd298d4-kube-api-access-9lg4c\") pod \"18f9bc9d-6434-4b9f-a8f2-0135edd298d4\" (UID: \"18f9bc9d-6434-4b9f-a8f2-0135edd298d4\") " Mar 16 16:16:05 crc kubenswrapper[5120]: I0316 16:16:05.434653 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b6faf05a-dc59-49cb-9b76-dd13901f77d3-config-data\") pod \"nova-cell0-cell-mapping-5dw24\" (UID: \"b6faf05a-dc59-49cb-9b76-dd13901f77d3\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-5dw24" Mar 16 16:16:05 crc kubenswrapper[5120]: I0316 16:16:05.434686 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b6faf05a-dc59-49cb-9b76-dd13901f77d3-combined-ca-bundle\") pod \"nova-cell0-cell-mapping-5dw24\" (UID: \"b6faf05a-dc59-49cb-9b76-dd13901f77d3\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-5dw24" Mar 16 16:16:05 crc kubenswrapper[5120]: I0316 16:16:05.435132 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6xrl8\" (UniqueName: \"kubernetes.io/projected/b6faf05a-dc59-49cb-9b76-dd13901f77d3-kube-api-access-6xrl8\") pod \"nova-cell0-cell-mapping-5dw24\" (UID: \"b6faf05a-dc59-49cb-9b76-dd13901f77d3\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-5dw24" Mar 16 16:16:05 crc kubenswrapper[5120]: I0316 16:16:05.435391 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b6faf05a-dc59-49cb-9b76-dd13901f77d3-scripts\") pod \"nova-cell0-cell-mapping-5dw24\" (UID: \"b6faf05a-dc59-49cb-9b76-dd13901f77d3\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-5dw24" Mar 16 16:16:05 crc kubenswrapper[5120]: I0316 16:16:05.440523 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b6faf05a-dc59-49cb-9b76-dd13901f77d3-scripts\") pod \"nova-cell0-cell-mapping-5dw24\" (UID: \"b6faf05a-dc59-49cb-9b76-dd13901f77d3\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-5dw24" Mar 16 16:16:05 crc kubenswrapper[5120]: I0316 16:16:05.445185 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b6faf05a-dc59-49cb-9b76-dd13901f77d3-config-data\") pod \"nova-cell0-cell-mapping-5dw24\" (UID: \"b6faf05a-dc59-49cb-9b76-dd13901f77d3\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-5dw24" Mar 16 16:16:05 crc kubenswrapper[5120]: I0316 16:16:05.445735 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b6faf05a-dc59-49cb-9b76-dd13901f77d3-combined-ca-bundle\") pod \"nova-cell0-cell-mapping-5dw24\" (UID: \"b6faf05a-dc59-49cb-9b76-dd13901f77d3\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-5dw24" Mar 16 16:16:05 crc kubenswrapper[5120]: I0316 16:16:05.449706 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18f9bc9d-6434-4b9f-a8f2-0135edd298d4-kube-api-access-9lg4c" (OuterVolumeSpecName: "kube-api-access-9lg4c") pod "18f9bc9d-6434-4b9f-a8f2-0135edd298d4" (UID: "18f9bc9d-6434-4b9f-a8f2-0135edd298d4"). InnerVolumeSpecName "kube-api-access-9lg4c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:16:05 crc kubenswrapper[5120]: I0316 16:16:05.458874 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:16:05 crc kubenswrapper[5120]: I0316 16:16:05.469076 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xrl8\" (UniqueName: \"kubernetes.io/projected/b6faf05a-dc59-49cb-9b76-dd13901f77d3-kube-api-access-6xrl8\") pod \"nova-cell0-cell-mapping-5dw24\" (UID: \"b6faf05a-dc59-49cb-9b76-dd13901f77d3\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-5dw24" Mar 16 16:16:05 crc kubenswrapper[5120]: I0316 16:16:05.470103 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:16:05 crc kubenswrapper[5120]: I0316 16:16:05.471376 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:16:05 crc kubenswrapper[5120]: I0316 16:16:05.476199 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:16:05 crc kubenswrapper[5120]: I0316 16:16:05.477127 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-config-data\"" Mar 16 16:16:05 crc kubenswrapper[5120]: I0316 16:16:05.483139 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-scheduler-config-data\"" Mar 16 16:16:05 crc kubenswrapper[5120]: I0316 16:16:05.491656 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:16:05 crc kubenswrapper[5120]: I0316 16:16:05.507262 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:16:05 crc kubenswrapper[5120]: I0316 16:16:05.538415 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3d99b69f-0e55-4c21-a44a-f9d489528859-scripts\") pod \"nova-cell1-conductor-db-sync-cmr6k\" (UID: \"3d99b69f-0e55-4c21-a44a-f9d489528859\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-cmr6k" Mar 16 16:16:05 crc kubenswrapper[5120]: I0316 16:16:05.538477 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/991185cb-9198-485d-9c8a-c47ed6909585-config-data\") pod \"nova-api-0\" (UID: \"991185cb-9198-485d-9c8a-c47ed6909585\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:16:05 crc kubenswrapper[5120]: I0316 16:16:05.538508 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3d99b69f-0e55-4c21-a44a-f9d489528859-combined-ca-bundle\") pod \"nova-cell1-conductor-db-sync-cmr6k\" (UID: \"3d99b69f-0e55-4c21-a44a-f9d489528859\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-cmr6k" Mar 16 16:16:05 crc kubenswrapper[5120]: I0316 16:16:05.538537 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/991185cb-9198-485d-9c8a-c47ed6909585-logs\") pod \"nova-api-0\" (UID: \"991185cb-9198-485d-9c8a-c47ed6909585\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:16:05 crc kubenswrapper[5120]: I0316 16:16:05.538597 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mw2m\" (UniqueName: \"kubernetes.io/projected/b02a0c6f-3a63-400d-9e44-cb09c8e2669a-kube-api-access-7mw2m\") pod \"nova-scheduler-0\" (UID: \"b02a0c6f-3a63-400d-9e44-cb09c8e2669a\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:16:05 crc kubenswrapper[5120]: I0316 16:16:05.538623 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b02a0c6f-3a63-400d-9e44-cb09c8e2669a-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"b02a0c6f-3a63-400d-9e44-cb09c8e2669a\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:16:05 crc kubenswrapper[5120]: I0316 16:16:05.538641 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b02a0c6f-3a63-400d-9e44-cb09c8e2669a-config-data\") pod \"nova-scheduler-0\" (UID: \"b02a0c6f-3a63-400d-9e44-cb09c8e2669a\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:16:05 crc kubenswrapper[5120]: I0316 16:16:05.538689 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3d99b69f-0e55-4c21-a44a-f9d489528859-config-data\") pod \"nova-cell1-conductor-db-sync-cmr6k\" (UID: \"3d99b69f-0e55-4c21-a44a-f9d489528859\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-cmr6k" Mar 16 16:16:05 crc kubenswrapper[5120]: I0316 16:16:05.538747 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jb7sh\" (UniqueName: \"kubernetes.io/projected/991185cb-9198-485d-9c8a-c47ed6909585-kube-api-access-jb7sh\") pod \"nova-api-0\" (UID: \"991185cb-9198-485d-9c8a-c47ed6909585\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:16:05 crc kubenswrapper[5120]: I0316 16:16:05.538817 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6r9gl\" (UniqueName: \"kubernetes.io/projected/3d99b69f-0e55-4c21-a44a-f9d489528859-kube-api-access-6r9gl\") pod \"nova-cell1-conductor-db-sync-cmr6k\" (UID: \"3d99b69f-0e55-4c21-a44a-f9d489528859\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-cmr6k" Mar 16 16:16:05 crc kubenswrapper[5120]: I0316 16:16:05.538840 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/991185cb-9198-485d-9c8a-c47ed6909585-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"991185cb-9198-485d-9c8a-c47ed6909585\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:16:05 crc kubenswrapper[5120]: I0316 16:16:05.538961 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9lg4c\" (UniqueName: \"kubernetes.io/projected/18f9bc9d-6434-4b9f-a8f2-0135edd298d4-kube-api-access-9lg4c\") on node \"crc\" DevicePath \"\"" Mar 16 16:16:05 crc kubenswrapper[5120]: I0316 16:16:05.563554 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561296-84z27" event={"ID":"18f9bc9d-6434-4b9f-a8f2-0135edd298d4","Type":"ContainerDied","Data":"9c2c569b14a33e62a8b7560d1f664eef3c1a356f696742b19bfe73833ce54c41"} Mar 16 16:16:05 crc kubenswrapper[5120]: I0316 16:16:05.563594 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9c2c569b14a33e62a8b7560d1f664eef3c1a356f696742b19bfe73833ce54c41" Mar 16 16:16:05 crc kubenswrapper[5120]: I0316 16:16:05.563657 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561296-84z27" Mar 16 16:16:05 crc kubenswrapper[5120]: I0316 16:16:05.579292 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:16:05 crc kubenswrapper[5120]: I0316 16:16:05.590594 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:16:05 crc kubenswrapper[5120]: I0316 16:16:05.592636 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-novncproxy-config-data\"" Mar 16 16:16:05 crc kubenswrapper[5120]: I0316 16:16:05.598510 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:16:05 crc kubenswrapper[5120]: I0316 16:16:05.609809 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:16:05 crc kubenswrapper[5120]: I0316 16:16:05.628669 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:16:05 crc kubenswrapper[5120]: I0316 16:16:05.628919 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:16:05 crc kubenswrapper[5120]: I0316 16:16:05.636242 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-metadata-config-data\"" Mar 16 16:16:05 crc kubenswrapper[5120]: I0316 16:16:05.641472 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/991185cb-9198-485d-9c8a-c47ed6909585-config-data\") pod \"nova-api-0\" (UID: \"991185cb-9198-485d-9c8a-c47ed6909585\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:16:05 crc kubenswrapper[5120]: I0316 16:16:05.641523 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3d99b69f-0e55-4c21-a44a-f9d489528859-combined-ca-bundle\") pod \"nova-cell1-conductor-db-sync-cmr6k\" (UID: \"3d99b69f-0e55-4c21-a44a-f9d489528859\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-cmr6k" Mar 16 16:16:05 crc kubenswrapper[5120]: I0316 16:16:05.641556 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/991185cb-9198-485d-9c8a-c47ed6909585-logs\") pod \"nova-api-0\" (UID: \"991185cb-9198-485d-9c8a-c47ed6909585\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:16:05 crc kubenswrapper[5120]: I0316 16:16:05.641614 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7mw2m\" (UniqueName: \"kubernetes.io/projected/b02a0c6f-3a63-400d-9e44-cb09c8e2669a-kube-api-access-7mw2m\") pod \"nova-scheduler-0\" (UID: \"b02a0c6f-3a63-400d-9e44-cb09c8e2669a\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:16:05 crc kubenswrapper[5120]: I0316 16:16:05.641639 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b02a0c6f-3a63-400d-9e44-cb09c8e2669a-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"b02a0c6f-3a63-400d-9e44-cb09c8e2669a\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:16:05 crc kubenswrapper[5120]: I0316 16:16:05.641657 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b02a0c6f-3a63-400d-9e44-cb09c8e2669a-config-data\") pod \"nova-scheduler-0\" (UID: \"b02a0c6f-3a63-400d-9e44-cb09c8e2669a\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:16:05 crc kubenswrapper[5120]: I0316 16:16:05.641705 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3d99b69f-0e55-4c21-a44a-f9d489528859-config-data\") pod \"nova-cell1-conductor-db-sync-cmr6k\" (UID: \"3d99b69f-0e55-4c21-a44a-f9d489528859\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-cmr6k" Mar 16 16:16:05 crc kubenswrapper[5120]: I0316 16:16:05.641772 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jb7sh\" (UniqueName: \"kubernetes.io/projected/991185cb-9198-485d-9c8a-c47ed6909585-kube-api-access-jb7sh\") pod \"nova-api-0\" (UID: \"991185cb-9198-485d-9c8a-c47ed6909585\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:16:05 crc kubenswrapper[5120]: I0316 16:16:05.641798 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6r9gl\" (UniqueName: \"kubernetes.io/projected/3d99b69f-0e55-4c21-a44a-f9d489528859-kube-api-access-6r9gl\") pod \"nova-cell1-conductor-db-sync-cmr6k\" (UID: \"3d99b69f-0e55-4c21-a44a-f9d489528859\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-cmr6k" Mar 16 16:16:05 crc kubenswrapper[5120]: I0316 16:16:05.641822 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/991185cb-9198-485d-9c8a-c47ed6909585-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"991185cb-9198-485d-9c8a-c47ed6909585\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:16:05 crc kubenswrapper[5120]: I0316 16:16:05.641953 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3d99b69f-0e55-4c21-a44a-f9d489528859-scripts\") pod \"nova-cell1-conductor-db-sync-cmr6k\" (UID: \"3d99b69f-0e55-4c21-a44a-f9d489528859\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-cmr6k" Mar 16 16:16:05 crc kubenswrapper[5120]: I0316 16:16:05.642078 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/991185cb-9198-485d-9c8a-c47ed6909585-logs\") pod \"nova-api-0\" (UID: \"991185cb-9198-485d-9c8a-c47ed6909585\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:16:05 crc kubenswrapper[5120]: I0316 16:16:05.645522 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b02a0c6f-3a63-400d-9e44-cb09c8e2669a-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"b02a0c6f-3a63-400d-9e44-cb09c8e2669a\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:16:05 crc kubenswrapper[5120]: I0316 16:16:05.645926 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/991185cb-9198-485d-9c8a-c47ed6909585-config-data\") pod \"nova-api-0\" (UID: \"991185cb-9198-485d-9c8a-c47ed6909585\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:16:05 crc kubenswrapper[5120]: I0316 16:16:05.650215 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-5dw24" Mar 16 16:16:05 crc kubenswrapper[5120]: I0316 16:16:05.652268 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/991185cb-9198-485d-9c8a-c47ed6909585-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"991185cb-9198-485d-9c8a-c47ed6909585\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:16:05 crc kubenswrapper[5120]: I0316 16:16:05.655176 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3d99b69f-0e55-4c21-a44a-f9d489528859-scripts\") pod \"nova-cell1-conductor-db-sync-cmr6k\" (UID: \"3d99b69f-0e55-4c21-a44a-f9d489528859\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-cmr6k" Mar 16 16:16:05 crc kubenswrapper[5120]: I0316 16:16:05.655469 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3d99b69f-0e55-4c21-a44a-f9d489528859-config-data\") pod \"nova-cell1-conductor-db-sync-cmr6k\" (UID: \"3d99b69f-0e55-4c21-a44a-f9d489528859\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-cmr6k" Mar 16 16:16:05 crc kubenswrapper[5120]: I0316 16:16:05.669959 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3d99b69f-0e55-4c21-a44a-f9d489528859-combined-ca-bundle\") pod \"nova-cell1-conductor-db-sync-cmr6k\" (UID: \"3d99b69f-0e55-4c21-a44a-f9d489528859\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-cmr6k" Mar 16 16:16:05 crc kubenswrapper[5120]: I0316 16:16:05.672207 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b02a0c6f-3a63-400d-9e44-cb09c8e2669a-config-data\") pod \"nova-scheduler-0\" (UID: \"b02a0c6f-3a63-400d-9e44-cb09c8e2669a\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:16:05 crc kubenswrapper[5120]: I0316 16:16:05.673962 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mw2m\" (UniqueName: \"kubernetes.io/projected/b02a0c6f-3a63-400d-9e44-cb09c8e2669a-kube-api-access-7mw2m\") pod \"nova-scheduler-0\" (UID: \"b02a0c6f-3a63-400d-9e44-cb09c8e2669a\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:16:05 crc kubenswrapper[5120]: I0316 16:16:05.674676 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6r9gl\" (UniqueName: \"kubernetes.io/projected/3d99b69f-0e55-4c21-a44a-f9d489528859-kube-api-access-6r9gl\") pod \"nova-cell1-conductor-db-sync-cmr6k\" (UID: \"3d99b69f-0e55-4c21-a44a-f9d489528859\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-cmr6k" Mar 16 16:16:05 crc kubenswrapper[5120]: I0316 16:16:05.678598 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jb7sh\" (UniqueName: \"kubernetes.io/projected/991185cb-9198-485d-9c8a-c47ed6909585-kube-api-access-jb7sh\") pod \"nova-api-0\" (UID: \"991185cb-9198-485d-9c8a-c47ed6909585\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:16:05 crc kubenswrapper[5120]: I0316 16:16:05.718980 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-cmr6k" Mar 16 16:16:05 crc kubenswrapper[5120]: I0316 16:16:05.743889 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f77ea92b-f466-4e3d-9e77-663322a99dc0-logs\") pod \"nova-metadata-0\" (UID: \"f77ea92b-f466-4e3d-9e77-663322a99dc0\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:16:05 crc kubenswrapper[5120]: I0316 16:16:05.744024 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mhvp\" (UniqueName: \"kubernetes.io/projected/f77ea92b-f466-4e3d-9e77-663322a99dc0-kube-api-access-5mhvp\") pod \"nova-metadata-0\" (UID: \"f77ea92b-f466-4e3d-9e77-663322a99dc0\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:16:05 crc kubenswrapper[5120]: I0316 16:16:05.744055 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/47d61c29-479c-4ba1-b903-cc33aaf92c75-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"47d61c29-479c-4ba1-b903-cc33aaf92c75\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:16:05 crc kubenswrapper[5120]: I0316 16:16:05.744198 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/47d61c29-479c-4ba1-b903-cc33aaf92c75-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"47d61c29-479c-4ba1-b903-cc33aaf92c75\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:16:05 crc kubenswrapper[5120]: I0316 16:16:05.744368 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f77ea92b-f466-4e3d-9e77-663322a99dc0-config-data\") pod \"nova-metadata-0\" (UID: \"f77ea92b-f466-4e3d-9e77-663322a99dc0\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:16:05 crc kubenswrapper[5120]: I0316 16:16:05.744408 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjtdt\" (UniqueName: \"kubernetes.io/projected/47d61c29-479c-4ba1-b903-cc33aaf92c75-kube-api-access-fjtdt\") pod \"nova-cell1-novncproxy-0\" (UID: \"47d61c29-479c-4ba1-b903-cc33aaf92c75\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:16:05 crc kubenswrapper[5120]: I0316 16:16:05.744476 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f77ea92b-f466-4e3d-9e77-663322a99dc0-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"f77ea92b-f466-4e3d-9e77-663322a99dc0\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:16:05 crc kubenswrapper[5120]: I0316 16:16:05.844161 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:16:05 crc kubenswrapper[5120]: I0316 16:16:05.846887 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/47d61c29-479c-4ba1-b903-cc33aaf92c75-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"47d61c29-479c-4ba1-b903-cc33aaf92c75\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:16:05 crc kubenswrapper[5120]: I0316 16:16:05.847020 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f77ea92b-f466-4e3d-9e77-663322a99dc0-config-data\") pod \"nova-metadata-0\" (UID: \"f77ea92b-f466-4e3d-9e77-663322a99dc0\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:16:05 crc kubenswrapper[5120]: I0316 16:16:05.847130 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fjtdt\" (UniqueName: \"kubernetes.io/projected/47d61c29-479c-4ba1-b903-cc33aaf92c75-kube-api-access-fjtdt\") pod \"nova-cell1-novncproxy-0\" (UID: \"47d61c29-479c-4ba1-b903-cc33aaf92c75\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:16:05 crc kubenswrapper[5120]: I0316 16:16:05.847183 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f77ea92b-f466-4e3d-9e77-663322a99dc0-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"f77ea92b-f466-4e3d-9e77-663322a99dc0\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:16:05 crc kubenswrapper[5120]: I0316 16:16:05.847206 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f77ea92b-f466-4e3d-9e77-663322a99dc0-logs\") pod \"nova-metadata-0\" (UID: \"f77ea92b-f466-4e3d-9e77-663322a99dc0\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:16:05 crc kubenswrapper[5120]: I0316 16:16:05.847280 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5mhvp\" (UniqueName: \"kubernetes.io/projected/f77ea92b-f466-4e3d-9e77-663322a99dc0-kube-api-access-5mhvp\") pod \"nova-metadata-0\" (UID: \"f77ea92b-f466-4e3d-9e77-663322a99dc0\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:16:05 crc kubenswrapper[5120]: I0316 16:16:05.847303 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/47d61c29-479c-4ba1-b903-cc33aaf92c75-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"47d61c29-479c-4ba1-b903-cc33aaf92c75\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:16:05 crc kubenswrapper[5120]: I0316 16:16:05.851582 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:16:05 crc kubenswrapper[5120]: I0316 16:16:05.851674 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f77ea92b-f466-4e3d-9e77-663322a99dc0-logs\") pod \"nova-metadata-0\" (UID: \"f77ea92b-f466-4e3d-9e77-663322a99dc0\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:16:05 crc kubenswrapper[5120]: I0316 16:16:05.851936 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f77ea92b-f466-4e3d-9e77-663322a99dc0-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"f77ea92b-f466-4e3d-9e77-663322a99dc0\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:16:05 crc kubenswrapper[5120]: I0316 16:16:05.855187 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/47d61c29-479c-4ba1-b903-cc33aaf92c75-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"47d61c29-479c-4ba1-b903-cc33aaf92c75\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:16:05 crc kubenswrapper[5120]: I0316 16:16:05.855838 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/47d61c29-479c-4ba1-b903-cc33aaf92c75-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"47d61c29-479c-4ba1-b903-cc33aaf92c75\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:16:05 crc kubenswrapper[5120]: I0316 16:16:05.858802 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f77ea92b-f466-4e3d-9e77-663322a99dc0-config-data\") pod \"nova-metadata-0\" (UID: \"f77ea92b-f466-4e3d-9e77-663322a99dc0\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:16:05 crc kubenswrapper[5120]: I0316 16:16:05.875663 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjtdt\" (UniqueName: \"kubernetes.io/projected/47d61c29-479c-4ba1-b903-cc33aaf92c75-kube-api-access-fjtdt\") pod \"nova-cell1-novncproxy-0\" (UID: \"47d61c29-479c-4ba1-b903-cc33aaf92c75\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:16:05 crc kubenswrapper[5120]: I0316 16:16:05.878518 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mhvp\" (UniqueName: \"kubernetes.io/projected/f77ea92b-f466-4e3d-9e77-663322a99dc0-kube-api-access-5mhvp\") pod \"nova-metadata-0\" (UID: \"f77ea92b-f466-4e3d-9e77-663322a99dc0\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:16:05 crc kubenswrapper[5120]: I0316 16:16:05.923005 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:16:06 crc kubenswrapper[5120]: I0316 16:16:06.023322 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:16:06 crc kubenswrapper[5120]: I0316 16:16:06.253124 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-5dw24"] Mar 16 16:16:06 crc kubenswrapper[5120]: I0316 16:16:06.291143 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-cmr6k"] Mar 16 16:16:06 crc kubenswrapper[5120]: I0316 16:16:06.422274 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-infra/auto-csr-approver-29561290-dff9h"] Mar 16 16:16:06 crc kubenswrapper[5120]: I0316 16:16:06.442202 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-infra/auto-csr-approver-29561290-dff9h"] Mar 16 16:16:06 crc kubenswrapper[5120]: I0316 16:16:06.517379 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:16:06 crc kubenswrapper[5120]: I0316 16:16:06.586644 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-cmr6k" event={"ID":"3d99b69f-0e55-4c21-a44a-f9d489528859","Type":"ContainerStarted","Data":"766982a964317e9619f7d31e7013d695b8a9f52e78e42fc7480d9bac69603893"} Mar 16 16:16:06 crc kubenswrapper[5120]: I0316 16:16:06.586707 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-cmr6k" event={"ID":"3d99b69f-0e55-4c21-a44a-f9d489528859","Type":"ContainerStarted","Data":"e23268c09d68f18f7ccf72ddf91e638456a7ff50ab88bde4f391a5e56524d0a0"} Mar 16 16:16:06 crc kubenswrapper[5120]: I0316 16:16:06.590277 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"991185cb-9198-485d-9c8a-c47ed6909585","Type":"ContainerStarted","Data":"9492011c2e7bdf561d4a82d4bb4ca9c243d0068b8619be51b0a405dfa3993480"} Mar 16 16:16:06 crc kubenswrapper[5120]: I0316 16:16:06.595883 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-5dw24" event={"ID":"b6faf05a-dc59-49cb-9b76-dd13901f77d3","Type":"ContainerStarted","Data":"dac34075aeb6bc6e192a9a3ad848558733e226ae86f00d5dd46aa7f0bc9852fe"} Mar 16 16:16:06 crc kubenswrapper[5120]: I0316 16:16:06.595936 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-5dw24" event={"ID":"b6faf05a-dc59-49cb-9b76-dd13901f77d3","Type":"ContainerStarted","Data":"af8e7894e85d95f6065705a77dc36600f094a0fdc4da45c1b0cf967269c52264"} Mar 16 16:16:06 crc kubenswrapper[5120]: I0316 16:16:06.615922 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-cmr6k" podStartSLOduration=1.615871082 podStartE2EDuration="1.615871082s" podCreationTimestamp="2026-03-16 16:16:05 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:16:06.606359227 +0000 UTC m=+2668.760290904" watchObservedRunningTime="2026-03-16 16:16:06.615871082 +0000 UTC m=+2668.769802739" Mar 16 16:16:06 crc kubenswrapper[5120]: I0316 16:16:06.635105 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-5dw24" podStartSLOduration=1.6350865159999999 podStartE2EDuration="1.635086516s" podCreationTimestamp="2026-03-16 16:16:05 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:16:06.619304264 +0000 UTC m=+2668.773235911" watchObservedRunningTime="2026-03-16 16:16:06.635086516 +0000 UTC m=+2668.789018173" Mar 16 16:16:06 crc kubenswrapper[5120]: I0316 16:16:06.693031 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8b0556b7-9ad7-41d6-afd7-f1853c53d0aa" path="/var/lib/kubelet/pods/8b0556b7-9ad7-41d6-afd7-f1853c53d0aa/volumes" Mar 16 16:16:06 crc kubenswrapper[5120]: I0316 16:16:06.702788 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:16:06 crc kubenswrapper[5120]: I0316 16:16:06.733568 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:16:06 crc kubenswrapper[5120]: I0316 16:16:06.747102 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:16:07 crc kubenswrapper[5120]: I0316 16:16:07.644342 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"f77ea92b-f466-4e3d-9e77-663322a99dc0","Type":"ContainerStarted","Data":"74b7611ecc9f36d8684695fa3154c58ab783aec6c811da0fb2d1a6652da16d1e"} Mar 16 16:16:07 crc kubenswrapper[5120]: I0316 16:16:07.644698 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"f77ea92b-f466-4e3d-9e77-663322a99dc0","Type":"ContainerStarted","Data":"25306dcf5b5b624053731008a4b015d7e5b210fed51f2c6497e2c458ed6945db"} Mar 16 16:16:07 crc kubenswrapper[5120]: I0316 16:16:07.644719 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"f77ea92b-f466-4e3d-9e77-663322a99dc0","Type":"ContainerStarted","Data":"6c03457ba49df16b46c0c9c387193248898fe4f4d715c847bdba83420978a4b2"} Mar 16 16:16:07 crc kubenswrapper[5120]: I0316 16:16:07.656925 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"b02a0c6f-3a63-400d-9e44-cb09c8e2669a","Type":"ContainerStarted","Data":"61d6553a6b8005f56275fcb5de5e5514d87c4b5c4f667b0ac1e45bd2cd79cdef"} Mar 16 16:16:07 crc kubenswrapper[5120]: I0316 16:16:07.657348 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"b02a0c6f-3a63-400d-9e44-cb09c8e2669a","Type":"ContainerStarted","Data":"834f0aea0a6f2c2977997b03044b386d1a7fd2a3776556058da0f455464ffd62"} Mar 16 16:16:07 crc kubenswrapper[5120]: I0316 16:16:07.667300 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"47d61c29-479c-4ba1-b903-cc33aaf92c75","Type":"ContainerStarted","Data":"be7b92f2502d6ef29900ab4e4835ad186353e47fdd34ba1ca4d4521ab39a3923"} Mar 16 16:16:07 crc kubenswrapper[5120]: I0316 16:16:07.667353 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"47d61c29-479c-4ba1-b903-cc33aaf92c75","Type":"ContainerStarted","Data":"5dd2f4afe124205a310a6184b7f9df1c664d0d2e7bc3df313e14fc85a370b6a8"} Mar 16 16:16:07 crc kubenswrapper[5120]: I0316 16:16:07.681385 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"991185cb-9198-485d-9c8a-c47ed6909585","Type":"ContainerStarted","Data":"1260a16c02d2ce7784013185114f426ca7e5b94a2afd2cd5bee051f58ac76247"} Mar 16 16:16:07 crc kubenswrapper[5120]: I0316 16:16:07.681784 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"991185cb-9198-485d-9c8a-c47ed6909585","Type":"ContainerStarted","Data":"ddef8c7aa4f1f97f6c45164394f85586533769e767e9ff8d14f8eace0297e296"} Mar 16 16:16:07 crc kubenswrapper[5120]: I0316 16:16:07.696353 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podStartSLOduration=2.696332108 podStartE2EDuration="2.696332108s" podCreationTimestamp="2026-03-16 16:16:05 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:16:07.684969984 +0000 UTC m=+2669.838901641" watchObservedRunningTime="2026-03-16 16:16:07.696332108 +0000 UTC m=+2669.850263755" Mar 16 16:16:07 crc kubenswrapper[5120]: I0316 16:16:07.700560 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=2.700551951 podStartE2EDuration="2.700551951s" podCreationTimestamp="2026-03-16 16:16:05 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:16:07.672982803 +0000 UTC m=+2669.826914530" watchObservedRunningTime="2026-03-16 16:16:07.700551951 +0000 UTC m=+2669.854483608" Mar 16 16:16:07 crc kubenswrapper[5120]: I0316 16:16:07.711344 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-scheduler-0" podStartSLOduration=2.71132762 podStartE2EDuration="2.71132762s" podCreationTimestamp="2026-03-16 16:16:05 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:16:07.70423356 +0000 UTC m=+2669.858165247" watchObservedRunningTime="2026-03-16 16:16:07.71132762 +0000 UTC m=+2669.865259277" Mar 16 16:16:07 crc kubenswrapper[5120]: I0316 16:16:07.728168 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=2.728151261 podStartE2EDuration="2.728151261s" podCreationTimestamp="2026-03-16 16:16:05 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:16:07.722455869 +0000 UTC m=+2669.876387526" watchObservedRunningTime="2026-03-16 16:16:07.728151261 +0000 UTC m=+2669.882082918" Mar 16 16:16:08 crc kubenswrapper[5120]: I0316 16:16:08.103864 5120 scope.go:117] "RemoveContainer" containerID="78382554d9c208bba61834a431de97fc207b284ff5c8f388eb91ae7ea5bbbe8d" Mar 16 16:16:08 crc kubenswrapper[5120]: I0316 16:16:08.125159 5120 scope.go:117] "RemoveContainer" containerID="2964d6eb95f5debfdfb4ed8f1a05caf29f7abb417eef506fc6a7729a0163939d" Mar 16 16:16:08 crc kubenswrapper[5120]: I0316 16:16:08.212428 5120 scope.go:117] "RemoveContainer" containerID="3045f1ee7ec0dab437ed2fef6fb5bc64b10f78943640e4007f7e41fe05c275cc" Mar 16 16:16:08 crc kubenswrapper[5120]: I0316 16:16:08.238242 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:16:08 crc kubenswrapper[5120]: I0316 16:16:08.276550 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:16:08 crc kubenswrapper[5120]: E0316 16:16:08.910982 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1769919 actualBytes=10240 Mar 16 16:16:09 crc kubenswrapper[5120]: I0316 16:16:09.720054 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podUID="47d61c29-479c-4ba1-b903-cc33aaf92c75" containerName="nova-cell1-novncproxy-novncproxy" containerID="cri-o://be7b92f2502d6ef29900ab4e4835ad186353e47fdd34ba1ca4d4521ab39a3923" gracePeriod=30 Mar 16 16:16:09 crc kubenswrapper[5120]: I0316 16:16:09.720174 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="f77ea92b-f466-4e3d-9e77-663322a99dc0" containerName="nova-metadata-log" containerID="cri-o://25306dcf5b5b624053731008a4b015d7e5b210fed51f2c6497e2c458ed6945db" gracePeriod=30 Mar 16 16:16:09 crc kubenswrapper[5120]: I0316 16:16:09.720227 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="f77ea92b-f466-4e3d-9e77-663322a99dc0" containerName="nova-metadata-metadata" containerID="cri-o://74b7611ecc9f36d8684695fa3154c58ab783aec6c811da0fb2d1a6652da16d1e" gracePeriod=30 Mar 16 16:16:10 crc kubenswrapper[5120]: I0316 16:16:10.332670 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:16:10 crc kubenswrapper[5120]: I0316 16:16:10.382298 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:16:10 crc kubenswrapper[5120]: I0316 16:16:10.443393 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f77ea92b-f466-4e3d-9e77-663322a99dc0-logs\") pod \"f77ea92b-f466-4e3d-9e77-663322a99dc0\" (UID: \"f77ea92b-f466-4e3d-9e77-663322a99dc0\") " Mar 16 16:16:10 crc kubenswrapper[5120]: I0316 16:16:10.443685 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f77ea92b-f466-4e3d-9e77-663322a99dc0-config-data\") pod \"f77ea92b-f466-4e3d-9e77-663322a99dc0\" (UID: \"f77ea92b-f466-4e3d-9e77-663322a99dc0\") " Mar 16 16:16:10 crc kubenswrapper[5120]: I0316 16:16:10.443855 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5mhvp\" (UniqueName: \"kubernetes.io/projected/f77ea92b-f466-4e3d-9e77-663322a99dc0-kube-api-access-5mhvp\") pod \"f77ea92b-f466-4e3d-9e77-663322a99dc0\" (UID: \"f77ea92b-f466-4e3d-9e77-663322a99dc0\") " Mar 16 16:16:10 crc kubenswrapper[5120]: I0316 16:16:10.443920 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f77ea92b-f466-4e3d-9e77-663322a99dc0-combined-ca-bundle\") pod \"f77ea92b-f466-4e3d-9e77-663322a99dc0\" (UID: \"f77ea92b-f466-4e3d-9e77-663322a99dc0\") " Mar 16 16:16:10 crc kubenswrapper[5120]: I0316 16:16:10.444009 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f77ea92b-f466-4e3d-9e77-663322a99dc0-logs" (OuterVolumeSpecName: "logs") pod "f77ea92b-f466-4e3d-9e77-663322a99dc0" (UID: "f77ea92b-f466-4e3d-9e77-663322a99dc0"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:16:10 crc kubenswrapper[5120]: I0316 16:16:10.444451 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f77ea92b-f466-4e3d-9e77-663322a99dc0-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:16:10 crc kubenswrapper[5120]: I0316 16:16:10.449527 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f77ea92b-f466-4e3d-9e77-663322a99dc0-kube-api-access-5mhvp" (OuterVolumeSpecName: "kube-api-access-5mhvp") pod "f77ea92b-f466-4e3d-9e77-663322a99dc0" (UID: "f77ea92b-f466-4e3d-9e77-663322a99dc0"). InnerVolumeSpecName "kube-api-access-5mhvp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:16:10 crc kubenswrapper[5120]: I0316 16:16:10.468517 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f77ea92b-f466-4e3d-9e77-663322a99dc0-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f77ea92b-f466-4e3d-9e77-663322a99dc0" (UID: "f77ea92b-f466-4e3d-9e77-663322a99dc0"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:16:10 crc kubenswrapper[5120]: I0316 16:16:10.472197 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f77ea92b-f466-4e3d-9e77-663322a99dc0-config-data" (OuterVolumeSpecName: "config-data") pod "f77ea92b-f466-4e3d-9e77-663322a99dc0" (UID: "f77ea92b-f466-4e3d-9e77-663322a99dc0"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:16:10 crc kubenswrapper[5120]: I0316 16:16:10.545873 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fjtdt\" (UniqueName: \"kubernetes.io/projected/47d61c29-479c-4ba1-b903-cc33aaf92c75-kube-api-access-fjtdt\") pod \"47d61c29-479c-4ba1-b903-cc33aaf92c75\" (UID: \"47d61c29-479c-4ba1-b903-cc33aaf92c75\") " Mar 16 16:16:10 crc kubenswrapper[5120]: I0316 16:16:10.546718 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/47d61c29-479c-4ba1-b903-cc33aaf92c75-combined-ca-bundle\") pod \"47d61c29-479c-4ba1-b903-cc33aaf92c75\" (UID: \"47d61c29-479c-4ba1-b903-cc33aaf92c75\") " Mar 16 16:16:10 crc kubenswrapper[5120]: I0316 16:16:10.546816 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/47d61c29-479c-4ba1-b903-cc33aaf92c75-config-data\") pod \"47d61c29-479c-4ba1-b903-cc33aaf92c75\" (UID: \"47d61c29-479c-4ba1-b903-cc33aaf92c75\") " Mar 16 16:16:10 crc kubenswrapper[5120]: I0316 16:16:10.547995 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f77ea92b-f466-4e3d-9e77-663322a99dc0-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:16:10 crc kubenswrapper[5120]: I0316 16:16:10.548030 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5mhvp\" (UniqueName: \"kubernetes.io/projected/f77ea92b-f466-4e3d-9e77-663322a99dc0-kube-api-access-5mhvp\") on node \"crc\" DevicePath \"\"" Mar 16 16:16:10 crc kubenswrapper[5120]: I0316 16:16:10.548049 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f77ea92b-f466-4e3d-9e77-663322a99dc0-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:16:10 crc kubenswrapper[5120]: I0316 16:16:10.550261 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47d61c29-479c-4ba1-b903-cc33aaf92c75-kube-api-access-fjtdt" (OuterVolumeSpecName: "kube-api-access-fjtdt") pod "47d61c29-479c-4ba1-b903-cc33aaf92c75" (UID: "47d61c29-479c-4ba1-b903-cc33aaf92c75"). InnerVolumeSpecName "kube-api-access-fjtdt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:16:10 crc kubenswrapper[5120]: I0316 16:16:10.570904 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/47d61c29-479c-4ba1-b903-cc33aaf92c75-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "47d61c29-479c-4ba1-b903-cc33aaf92c75" (UID: "47d61c29-479c-4ba1-b903-cc33aaf92c75"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:16:10 crc kubenswrapper[5120]: I0316 16:16:10.571748 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/47d61c29-479c-4ba1-b903-cc33aaf92c75-config-data" (OuterVolumeSpecName: "config-data") pod "47d61c29-479c-4ba1-b903-cc33aaf92c75" (UID: "47d61c29-479c-4ba1-b903-cc33aaf92c75"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:16:10 crc kubenswrapper[5120]: I0316 16:16:10.650570 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fjtdt\" (UniqueName: \"kubernetes.io/projected/47d61c29-479c-4ba1-b903-cc33aaf92c75-kube-api-access-fjtdt\") on node \"crc\" DevicePath \"\"" Mar 16 16:16:10 crc kubenswrapper[5120]: I0316 16:16:10.650605 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/47d61c29-479c-4ba1-b903-cc33aaf92c75-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:16:10 crc kubenswrapper[5120]: I0316 16:16:10.650621 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/47d61c29-479c-4ba1-b903-cc33aaf92c75-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:16:10 crc kubenswrapper[5120]: I0316 16:16:10.734712 5120 generic.go:358] "Generic (PLEG): container finished" podID="f77ea92b-f466-4e3d-9e77-663322a99dc0" containerID="74b7611ecc9f36d8684695fa3154c58ab783aec6c811da0fb2d1a6652da16d1e" exitCode=0 Mar 16 16:16:10 crc kubenswrapper[5120]: I0316 16:16:10.734755 5120 generic.go:358] "Generic (PLEG): container finished" podID="f77ea92b-f466-4e3d-9e77-663322a99dc0" containerID="25306dcf5b5b624053731008a4b015d7e5b210fed51f2c6497e2c458ed6945db" exitCode=143 Mar 16 16:16:10 crc kubenswrapper[5120]: I0316 16:16:10.735179 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"f77ea92b-f466-4e3d-9e77-663322a99dc0","Type":"ContainerDied","Data":"74b7611ecc9f36d8684695fa3154c58ab783aec6c811da0fb2d1a6652da16d1e"} Mar 16 16:16:10 crc kubenswrapper[5120]: I0316 16:16:10.735232 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"f77ea92b-f466-4e3d-9e77-663322a99dc0","Type":"ContainerDied","Data":"25306dcf5b5b624053731008a4b015d7e5b210fed51f2c6497e2c458ed6945db"} Mar 16 16:16:10 crc kubenswrapper[5120]: I0316 16:16:10.735254 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"f77ea92b-f466-4e3d-9e77-663322a99dc0","Type":"ContainerDied","Data":"6c03457ba49df16b46c0c9c387193248898fe4f4d715c847bdba83420978a4b2"} Mar 16 16:16:10 crc kubenswrapper[5120]: I0316 16:16:10.735280 5120 scope.go:117] "RemoveContainer" containerID="74b7611ecc9f36d8684695fa3154c58ab783aec6c811da0fb2d1a6652da16d1e" Mar 16 16:16:10 crc kubenswrapper[5120]: I0316 16:16:10.735470 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:16:10 crc kubenswrapper[5120]: I0316 16:16:10.741468 5120 generic.go:358] "Generic (PLEG): container finished" podID="47d61c29-479c-4ba1-b903-cc33aaf92c75" containerID="be7b92f2502d6ef29900ab4e4835ad186353e47fdd34ba1ca4d4521ab39a3923" exitCode=0 Mar 16 16:16:10 crc kubenswrapper[5120]: I0316 16:16:10.741819 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"47d61c29-479c-4ba1-b903-cc33aaf92c75","Type":"ContainerDied","Data":"be7b92f2502d6ef29900ab4e4835ad186353e47fdd34ba1ca4d4521ab39a3923"} Mar 16 16:16:10 crc kubenswrapper[5120]: I0316 16:16:10.741869 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"47d61c29-479c-4ba1-b903-cc33aaf92c75","Type":"ContainerDied","Data":"5dd2f4afe124205a310a6184b7f9df1c664d0d2e7bc3df313e14fc85a370b6a8"} Mar 16 16:16:10 crc kubenswrapper[5120]: I0316 16:16:10.741995 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:16:10 crc kubenswrapper[5120]: I0316 16:16:10.775118 5120 scope.go:117] "RemoveContainer" containerID="25306dcf5b5b624053731008a4b015d7e5b210fed51f2c6497e2c458ed6945db" Mar 16 16:16:10 crc kubenswrapper[5120]: I0316 16:16:10.791953 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:16:10 crc kubenswrapper[5120]: I0316 16:16:10.801304 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:16:10 crc kubenswrapper[5120]: I0316 16:16:10.814701 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:16:10 crc kubenswrapper[5120]: I0316 16:16:10.827054 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:16:10 crc kubenswrapper[5120]: I0316 16:16:10.830100 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:16:10 crc kubenswrapper[5120]: I0316 16:16:10.839505 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f77ea92b-f466-4e3d-9e77-663322a99dc0" containerName="nova-metadata-log" Mar 16 16:16:10 crc kubenswrapper[5120]: I0316 16:16:10.839541 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f77ea92b-f466-4e3d-9e77-663322a99dc0" containerName="nova-metadata-log" Mar 16 16:16:10 crc kubenswrapper[5120]: I0316 16:16:10.839592 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47d61c29-479c-4ba1-b903-cc33aaf92c75" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 16:16:10 crc kubenswrapper[5120]: I0316 16:16:10.839599 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="47d61c29-479c-4ba1-b903-cc33aaf92c75" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 16:16:10 crc kubenswrapper[5120]: I0316 16:16:10.839628 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f77ea92b-f466-4e3d-9e77-663322a99dc0" containerName="nova-metadata-metadata" Mar 16 16:16:10 crc kubenswrapper[5120]: I0316 16:16:10.839637 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f77ea92b-f466-4e3d-9e77-663322a99dc0" containerName="nova-metadata-metadata" Mar 16 16:16:10 crc kubenswrapper[5120]: I0316 16:16:10.839827 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="47d61c29-479c-4ba1-b903-cc33aaf92c75" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 16:16:10 crc kubenswrapper[5120]: I0316 16:16:10.839847 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f77ea92b-f466-4e3d-9e77-663322a99dc0" containerName="nova-metadata-log" Mar 16 16:16:10 crc kubenswrapper[5120]: I0316 16:16:10.839856 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f77ea92b-f466-4e3d-9e77-663322a99dc0" containerName="nova-metadata-metadata" Mar 16 16:16:10 crc kubenswrapper[5120]: I0316 16:16:10.844144 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:16:10 crc kubenswrapper[5120]: I0316 16:16:10.848567 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:16:10 crc kubenswrapper[5120]: I0316 16:16:10.848663 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:16:10 crc kubenswrapper[5120]: I0316 16:16:10.849123 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:16:10 crc kubenswrapper[5120]: I0316 16:16:10.849636 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:16:10 crc kubenswrapper[5120]: I0316 16:16:10.853610 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-novncproxy-config-data\"" Mar 16 16:16:10 crc kubenswrapper[5120]: I0316 16:16:10.853901 5120 scope.go:117] "RemoveContainer" containerID="74b7611ecc9f36d8684695fa3154c58ab783aec6c811da0fb2d1a6652da16d1e" Mar 16 16:16:10 crc kubenswrapper[5120]: I0316 16:16:10.854124 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-novncproxy-cell1-vencrypt\"" Mar 16 16:16:10 crc kubenswrapper[5120]: I0316 16:16:10.854268 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-metadata-config-data\"" Mar 16 16:16:10 crc kubenswrapper[5120]: E0316 16:16:10.854384 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"74b7611ecc9f36d8684695fa3154c58ab783aec6c811da0fb2d1a6652da16d1e\": container with ID starting with 74b7611ecc9f36d8684695fa3154c58ab783aec6c811da0fb2d1a6652da16d1e not found: ID does not exist" containerID="74b7611ecc9f36d8684695fa3154c58ab783aec6c811da0fb2d1a6652da16d1e" Mar 16 16:16:10 crc kubenswrapper[5120]: I0316 16:16:10.854405 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74b7611ecc9f36d8684695fa3154c58ab783aec6c811da0fb2d1a6652da16d1e"} err="failed to get container status \"74b7611ecc9f36d8684695fa3154c58ab783aec6c811da0fb2d1a6652da16d1e\": rpc error: code = NotFound desc = could not find container \"74b7611ecc9f36d8684695fa3154c58ab783aec6c811da0fb2d1a6652da16d1e\": container with ID starting with 74b7611ecc9f36d8684695fa3154c58ab783aec6c811da0fb2d1a6652da16d1e not found: ID does not exist" Mar 16 16:16:10 crc kubenswrapper[5120]: I0316 16:16:10.854424 5120 scope.go:117] "RemoveContainer" containerID="25306dcf5b5b624053731008a4b015d7e5b210fed51f2c6497e2c458ed6945db" Mar 16 16:16:10 crc kubenswrapper[5120]: I0316 16:16:10.854530 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-metadata-internal-svc\"" Mar 16 16:16:10 crc kubenswrapper[5120]: I0316 16:16:10.854546 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-novncproxy-cell1-public-svc\"" Mar 16 16:16:10 crc kubenswrapper[5120]: E0316 16:16:10.854701 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"25306dcf5b5b624053731008a4b015d7e5b210fed51f2c6497e2c458ed6945db\": container with ID starting with 25306dcf5b5b624053731008a4b015d7e5b210fed51f2c6497e2c458ed6945db not found: ID does not exist" containerID="25306dcf5b5b624053731008a4b015d7e5b210fed51f2c6497e2c458ed6945db" Mar 16 16:16:10 crc kubenswrapper[5120]: I0316 16:16:10.854724 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25306dcf5b5b624053731008a4b015d7e5b210fed51f2c6497e2c458ed6945db"} err="failed to get container status \"25306dcf5b5b624053731008a4b015d7e5b210fed51f2c6497e2c458ed6945db\": rpc error: code = NotFound desc = could not find container \"25306dcf5b5b624053731008a4b015d7e5b210fed51f2c6497e2c458ed6945db\": container with ID starting with 25306dcf5b5b624053731008a4b015d7e5b210fed51f2c6497e2c458ed6945db not found: ID does not exist" Mar 16 16:16:10 crc kubenswrapper[5120]: I0316 16:16:10.854744 5120 scope.go:117] "RemoveContainer" containerID="74b7611ecc9f36d8684695fa3154c58ab783aec6c811da0fb2d1a6652da16d1e" Mar 16 16:16:10 crc kubenswrapper[5120]: I0316 16:16:10.854547 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:16:10 crc kubenswrapper[5120]: I0316 16:16:10.858653 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74b7611ecc9f36d8684695fa3154c58ab783aec6c811da0fb2d1a6652da16d1e"} err="failed to get container status \"74b7611ecc9f36d8684695fa3154c58ab783aec6c811da0fb2d1a6652da16d1e\": rpc error: code = NotFound desc = could not find container \"74b7611ecc9f36d8684695fa3154c58ab783aec6c811da0fb2d1a6652da16d1e\": container with ID starting with 74b7611ecc9f36d8684695fa3154c58ab783aec6c811da0fb2d1a6652da16d1e not found: ID does not exist" Mar 16 16:16:10 crc kubenswrapper[5120]: I0316 16:16:10.858672 5120 scope.go:117] "RemoveContainer" containerID="25306dcf5b5b624053731008a4b015d7e5b210fed51f2c6497e2c458ed6945db" Mar 16 16:16:10 crc kubenswrapper[5120]: I0316 16:16:10.861076 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25306dcf5b5b624053731008a4b015d7e5b210fed51f2c6497e2c458ed6945db"} err="failed to get container status \"25306dcf5b5b624053731008a4b015d7e5b210fed51f2c6497e2c458ed6945db\": rpc error: code = NotFound desc = could not find container \"25306dcf5b5b624053731008a4b015d7e5b210fed51f2c6497e2c458ed6945db\": container with ID starting with 25306dcf5b5b624053731008a4b015d7e5b210fed51f2c6497e2c458ed6945db not found: ID does not exist" Mar 16 16:16:10 crc kubenswrapper[5120]: I0316 16:16:10.861200 5120 scope.go:117] "RemoveContainer" containerID="be7b92f2502d6ef29900ab4e4835ad186353e47fdd34ba1ca4d4521ab39a3923" Mar 16 16:16:10 crc kubenswrapper[5120]: I0316 16:16:10.919698 5120 scope.go:117] "RemoveContainer" containerID="be7b92f2502d6ef29900ab4e4835ad186353e47fdd34ba1ca4d4521ab39a3923" Mar 16 16:16:10 crc kubenswrapper[5120]: E0316 16:16:10.920013 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"be7b92f2502d6ef29900ab4e4835ad186353e47fdd34ba1ca4d4521ab39a3923\": container with ID starting with be7b92f2502d6ef29900ab4e4835ad186353e47fdd34ba1ca4d4521ab39a3923 not found: ID does not exist" containerID="be7b92f2502d6ef29900ab4e4835ad186353e47fdd34ba1ca4d4521ab39a3923" Mar 16 16:16:10 crc kubenswrapper[5120]: I0316 16:16:10.920038 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be7b92f2502d6ef29900ab4e4835ad186353e47fdd34ba1ca4d4521ab39a3923"} err="failed to get container status \"be7b92f2502d6ef29900ab4e4835ad186353e47fdd34ba1ca4d4521ab39a3923\": rpc error: code = NotFound desc = could not find container \"be7b92f2502d6ef29900ab4e4835ad186353e47fdd34ba1ca4d4521ab39a3923\": container with ID starting with be7b92f2502d6ef29900ab4e4835ad186353e47fdd34ba1ca4d4521ab39a3923 not found: ID does not exist" Mar 16 16:16:10 crc kubenswrapper[5120]: I0316 16:16:10.956250 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8vh8\" (UniqueName: \"kubernetes.io/projected/fb13a989-3fee-4cd9-97d4-e68371891b6b-kube-api-access-k8vh8\") pod \"nova-cell1-novncproxy-0\" (UID: \"fb13a989-3fee-4cd9-97d4-e68371891b6b\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:16:10 crc kubenswrapper[5120]: I0316 16:16:10.956292 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fb13a989-3fee-4cd9-97d4-e68371891b6b-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"fb13a989-3fee-4cd9-97d4-e68371891b6b\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:16:10 crc kubenswrapper[5120]: I0316 16:16:10.956319 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7bw4\" (UniqueName: \"kubernetes.io/projected/df40e9ac-8a94-4d19-9bd7-50c958c79e42-kube-api-access-l7bw4\") pod \"nova-metadata-0\" (UID: \"df40e9ac-8a94-4d19-9bd7-50c958c79e42\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:16:10 crc kubenswrapper[5120]: I0316 16:16:10.956374 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/fb13a989-3fee-4cd9-97d4-e68371891b6b-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"fb13a989-3fee-4cd9-97d4-e68371891b6b\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:16:10 crc kubenswrapper[5120]: I0316 16:16:10.956515 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fb13a989-3fee-4cd9-97d4-e68371891b6b-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"fb13a989-3fee-4cd9-97d4-e68371891b6b\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:16:10 crc kubenswrapper[5120]: I0316 16:16:10.956607 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/df40e9ac-8a94-4d19-9bd7-50c958c79e42-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"df40e9ac-8a94-4d19-9bd7-50c958c79e42\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:16:10 crc kubenswrapper[5120]: I0316 16:16:10.956699 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/fb13a989-3fee-4cd9-97d4-e68371891b6b-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"fb13a989-3fee-4cd9-97d4-e68371891b6b\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:16:10 crc kubenswrapper[5120]: I0316 16:16:10.956750 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/df40e9ac-8a94-4d19-9bd7-50c958c79e42-logs\") pod \"nova-metadata-0\" (UID: \"df40e9ac-8a94-4d19-9bd7-50c958c79e42\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:16:10 crc kubenswrapper[5120]: I0316 16:16:10.956844 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/df40e9ac-8a94-4d19-9bd7-50c958c79e42-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"df40e9ac-8a94-4d19-9bd7-50c958c79e42\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:16:10 crc kubenswrapper[5120]: I0316 16:16:10.956980 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/df40e9ac-8a94-4d19-9bd7-50c958c79e42-config-data\") pod \"nova-metadata-0\" (UID: \"df40e9ac-8a94-4d19-9bd7-50c958c79e42\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:16:11 crc kubenswrapper[5120]: I0316 16:16:11.059064 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/df40e9ac-8a94-4d19-9bd7-50c958c79e42-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"df40e9ac-8a94-4d19-9bd7-50c958c79e42\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:16:11 crc kubenswrapper[5120]: I0316 16:16:11.059170 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/df40e9ac-8a94-4d19-9bd7-50c958c79e42-config-data\") pod \"nova-metadata-0\" (UID: \"df40e9ac-8a94-4d19-9bd7-50c958c79e42\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:16:11 crc kubenswrapper[5120]: I0316 16:16:11.059300 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k8vh8\" (UniqueName: \"kubernetes.io/projected/fb13a989-3fee-4cd9-97d4-e68371891b6b-kube-api-access-k8vh8\") pod \"nova-cell1-novncproxy-0\" (UID: \"fb13a989-3fee-4cd9-97d4-e68371891b6b\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:16:11 crc kubenswrapper[5120]: I0316 16:16:11.059332 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fb13a989-3fee-4cd9-97d4-e68371891b6b-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"fb13a989-3fee-4cd9-97d4-e68371891b6b\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:16:11 crc kubenswrapper[5120]: I0316 16:16:11.059359 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l7bw4\" (UniqueName: \"kubernetes.io/projected/df40e9ac-8a94-4d19-9bd7-50c958c79e42-kube-api-access-l7bw4\") pod \"nova-metadata-0\" (UID: \"df40e9ac-8a94-4d19-9bd7-50c958c79e42\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:16:11 crc kubenswrapper[5120]: I0316 16:16:11.059431 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/fb13a989-3fee-4cd9-97d4-e68371891b6b-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"fb13a989-3fee-4cd9-97d4-e68371891b6b\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:16:11 crc kubenswrapper[5120]: I0316 16:16:11.059483 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fb13a989-3fee-4cd9-97d4-e68371891b6b-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"fb13a989-3fee-4cd9-97d4-e68371891b6b\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:16:11 crc kubenswrapper[5120]: I0316 16:16:11.059535 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/df40e9ac-8a94-4d19-9bd7-50c958c79e42-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"df40e9ac-8a94-4d19-9bd7-50c958c79e42\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:16:11 crc kubenswrapper[5120]: I0316 16:16:11.059615 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/fb13a989-3fee-4cd9-97d4-e68371891b6b-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"fb13a989-3fee-4cd9-97d4-e68371891b6b\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:16:11 crc kubenswrapper[5120]: I0316 16:16:11.059655 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/df40e9ac-8a94-4d19-9bd7-50c958c79e42-logs\") pod \"nova-metadata-0\" (UID: \"df40e9ac-8a94-4d19-9bd7-50c958c79e42\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:16:11 crc kubenswrapper[5120]: I0316 16:16:11.060129 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/df40e9ac-8a94-4d19-9bd7-50c958c79e42-logs\") pod \"nova-metadata-0\" (UID: \"df40e9ac-8a94-4d19-9bd7-50c958c79e42\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:16:11 crc kubenswrapper[5120]: I0316 16:16:11.066982 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/fb13a989-3fee-4cd9-97d4-e68371891b6b-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"fb13a989-3fee-4cd9-97d4-e68371891b6b\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:16:11 crc kubenswrapper[5120]: I0316 16:16:11.071277 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/fb13a989-3fee-4cd9-97d4-e68371891b6b-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"fb13a989-3fee-4cd9-97d4-e68371891b6b\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:16:11 crc kubenswrapper[5120]: I0316 16:16:11.071365 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/df40e9ac-8a94-4d19-9bd7-50c958c79e42-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"df40e9ac-8a94-4d19-9bd7-50c958c79e42\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:16:11 crc kubenswrapper[5120]: I0316 16:16:11.072554 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fb13a989-3fee-4cd9-97d4-e68371891b6b-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"fb13a989-3fee-4cd9-97d4-e68371891b6b\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:16:11 crc kubenswrapper[5120]: I0316 16:16:11.072897 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/df40e9ac-8a94-4d19-9bd7-50c958c79e42-config-data\") pod \"nova-metadata-0\" (UID: \"df40e9ac-8a94-4d19-9bd7-50c958c79e42\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:16:11 crc kubenswrapper[5120]: I0316 16:16:11.073423 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/df40e9ac-8a94-4d19-9bd7-50c958c79e42-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"df40e9ac-8a94-4d19-9bd7-50c958c79e42\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:16:11 crc kubenswrapper[5120]: I0316 16:16:11.080743 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fb13a989-3fee-4cd9-97d4-e68371891b6b-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"fb13a989-3fee-4cd9-97d4-e68371891b6b\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:16:11 crc kubenswrapper[5120]: I0316 16:16:11.085385 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8vh8\" (UniqueName: \"kubernetes.io/projected/fb13a989-3fee-4cd9-97d4-e68371891b6b-kube-api-access-k8vh8\") pod \"nova-cell1-novncproxy-0\" (UID: \"fb13a989-3fee-4cd9-97d4-e68371891b6b\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:16:11 crc kubenswrapper[5120]: I0316 16:16:11.101652 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7bw4\" (UniqueName: \"kubernetes.io/projected/df40e9ac-8a94-4d19-9bd7-50c958c79e42-kube-api-access-l7bw4\") pod \"nova-metadata-0\" (UID: \"df40e9ac-8a94-4d19-9bd7-50c958c79e42\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:16:11 crc kubenswrapper[5120]: I0316 16:16:11.220006 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:16:11 crc kubenswrapper[5120]: I0316 16:16:11.229774 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:16:11 crc kubenswrapper[5120]: I0316 16:16:11.746700 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:16:11 crc kubenswrapper[5120]: I0316 16:16:11.756941 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"fb13a989-3fee-4cd9-97d4-e68371891b6b","Type":"ContainerStarted","Data":"c5a33ec73250ca09d3b111e20956d6d079261017144eb3dd578cab4c4b533e36"} Mar 16 16:16:11 crc kubenswrapper[5120]: I0316 16:16:11.794291 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:16:11 crc kubenswrapper[5120]: W0316 16:16:11.799265 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddf40e9ac_8a94_4d19_9bd7_50c958c79e42.slice/crio-0be3d4364fdaafcd9e7d483174bf93be1b1b6b07d786eeffe580aa8e1f9d44bb WatchSource:0}: Error finding container 0be3d4364fdaafcd9e7d483174bf93be1b1b6b07d786eeffe580aa8e1f9d44bb: Status 404 returned error can't find the container with id 0be3d4364fdaafcd9e7d483174bf93be1b1b6b07d786eeffe580aa8e1f9d44bb Mar 16 16:16:12 crc kubenswrapper[5120]: I0316 16:16:12.680353 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="47d61c29-479c-4ba1-b903-cc33aaf92c75" path="/var/lib/kubelet/pods/47d61c29-479c-4ba1-b903-cc33aaf92c75/volumes" Mar 16 16:16:12 crc kubenswrapper[5120]: I0316 16:16:12.681790 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f77ea92b-f466-4e3d-9e77-663322a99dc0" path="/var/lib/kubelet/pods/f77ea92b-f466-4e3d-9e77-663322a99dc0/volumes" Mar 16 16:16:12 crc kubenswrapper[5120]: I0316 16:16:12.778396 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"df40e9ac-8a94-4d19-9bd7-50c958c79e42","Type":"ContainerStarted","Data":"250c9a3b1e441ae056a925f00402a0b6794d918dbd7dba667c73ef7c0afea814"} Mar 16 16:16:12 crc kubenswrapper[5120]: I0316 16:16:12.778463 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"df40e9ac-8a94-4d19-9bd7-50c958c79e42","Type":"ContainerStarted","Data":"fcb9390c2b0cbf715900652262c42debff521687a59e4b0fa014586b161628ad"} Mar 16 16:16:12 crc kubenswrapper[5120]: I0316 16:16:12.778487 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"df40e9ac-8a94-4d19-9bd7-50c958c79e42","Type":"ContainerStarted","Data":"0be3d4364fdaafcd9e7d483174bf93be1b1b6b07d786eeffe580aa8e1f9d44bb"} Mar 16 16:16:12 crc kubenswrapper[5120]: I0316 16:16:12.781938 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"fb13a989-3fee-4cd9-97d4-e68371891b6b","Type":"ContainerStarted","Data":"02d26c01c0add7af45d27551c127315970f580e97920c2b887ce397fd67a99cf"} Mar 16 16:16:12 crc kubenswrapper[5120]: I0316 16:16:12.804119 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=2.804093557 podStartE2EDuration="2.804093557s" podCreationTimestamp="2026-03-16 16:16:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:16:12.802843023 +0000 UTC m=+2674.956774690" watchObservedRunningTime="2026-03-16 16:16:12.804093557 +0000 UTC m=+2674.958025254" Mar 16 16:16:12 crc kubenswrapper[5120]: I0316 16:16:12.830992 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podStartSLOduration=2.830964517 podStartE2EDuration="2.830964517s" podCreationTimestamp="2026-03-16 16:16:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:16:12.824198346 +0000 UTC m=+2674.978130043" watchObservedRunningTime="2026-03-16 16:16:12.830964517 +0000 UTC m=+2674.984896224" Mar 16 16:16:13 crc kubenswrapper[5120]: I0316 16:16:13.796100 5120 generic.go:358] "Generic (PLEG): container finished" podID="3d99b69f-0e55-4c21-a44a-f9d489528859" containerID="766982a964317e9619f7d31e7013d695b8a9f52e78e42fc7480d9bac69603893" exitCode=0 Mar 16 16:16:13 crc kubenswrapper[5120]: I0316 16:16:13.796227 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-cmr6k" event={"ID":"3d99b69f-0e55-4c21-a44a-f9d489528859","Type":"ContainerDied","Data":"766982a964317e9619f7d31e7013d695b8a9f52e78e42fc7480d9bac69603893"} Mar 16 16:16:14 crc kubenswrapper[5120]: I0316 16:16:14.808902 5120 generic.go:358] "Generic (PLEG): container finished" podID="b6faf05a-dc59-49cb-9b76-dd13901f77d3" containerID="dac34075aeb6bc6e192a9a3ad848558733e226ae86f00d5dd46aa7f0bc9852fe" exitCode=0 Mar 16 16:16:14 crc kubenswrapper[5120]: I0316 16:16:14.809627 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-5dw24" event={"ID":"b6faf05a-dc59-49cb-9b76-dd13901f77d3","Type":"ContainerDied","Data":"dac34075aeb6bc6e192a9a3ad848558733e226ae86f00d5dd46aa7f0bc9852fe"} Mar 16 16:16:15 crc kubenswrapper[5120]: I0316 16:16:15.234838 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-cmr6k" Mar 16 16:16:15 crc kubenswrapper[5120]: I0316 16:16:15.270515 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3d99b69f-0e55-4c21-a44a-f9d489528859-scripts\") pod \"3d99b69f-0e55-4c21-a44a-f9d489528859\" (UID: \"3d99b69f-0e55-4c21-a44a-f9d489528859\") " Mar 16 16:16:15 crc kubenswrapper[5120]: I0316 16:16:15.270665 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3d99b69f-0e55-4c21-a44a-f9d489528859-config-data\") pod \"3d99b69f-0e55-4c21-a44a-f9d489528859\" (UID: \"3d99b69f-0e55-4c21-a44a-f9d489528859\") " Mar 16 16:16:15 crc kubenswrapper[5120]: I0316 16:16:15.270745 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3d99b69f-0e55-4c21-a44a-f9d489528859-combined-ca-bundle\") pod \"3d99b69f-0e55-4c21-a44a-f9d489528859\" (UID: \"3d99b69f-0e55-4c21-a44a-f9d489528859\") " Mar 16 16:16:15 crc kubenswrapper[5120]: I0316 16:16:15.270784 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6r9gl\" (UniqueName: \"kubernetes.io/projected/3d99b69f-0e55-4c21-a44a-f9d489528859-kube-api-access-6r9gl\") pod \"3d99b69f-0e55-4c21-a44a-f9d489528859\" (UID: \"3d99b69f-0e55-4c21-a44a-f9d489528859\") " Mar 16 16:16:15 crc kubenswrapper[5120]: I0316 16:16:15.276817 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d99b69f-0e55-4c21-a44a-f9d489528859-kube-api-access-6r9gl" (OuterVolumeSpecName: "kube-api-access-6r9gl") pod "3d99b69f-0e55-4c21-a44a-f9d489528859" (UID: "3d99b69f-0e55-4c21-a44a-f9d489528859"). InnerVolumeSpecName "kube-api-access-6r9gl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:16:15 crc kubenswrapper[5120]: I0316 16:16:15.277531 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d99b69f-0e55-4c21-a44a-f9d489528859-scripts" (OuterVolumeSpecName: "scripts") pod "3d99b69f-0e55-4c21-a44a-f9d489528859" (UID: "3d99b69f-0e55-4c21-a44a-f9d489528859"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:16:15 crc kubenswrapper[5120]: E0316 16:16:15.296091 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d99b69f-0e55-4c21-a44a-f9d489528859-combined-ca-bundle podName:3d99b69f-0e55-4c21-a44a-f9d489528859 nodeName:}" failed. No retries permitted until 2026-03-16 16:16:15.796054412 +0000 UTC m=+2677.949986069 (durationBeforeRetry 500ms). Error: error cleaning subPath mounts for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/3d99b69f-0e55-4c21-a44a-f9d489528859-combined-ca-bundle") pod "3d99b69f-0e55-4c21-a44a-f9d489528859" (UID: "3d99b69f-0e55-4c21-a44a-f9d489528859") : error deleting /var/lib/kubelet/pods/3d99b69f-0e55-4c21-a44a-f9d489528859/volume-subpaths: remove /var/lib/kubelet/pods/3d99b69f-0e55-4c21-a44a-f9d489528859/volume-subpaths: no such file or directory Mar 16 16:16:15 crc kubenswrapper[5120]: I0316 16:16:15.298815 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d99b69f-0e55-4c21-a44a-f9d489528859-config-data" (OuterVolumeSpecName: "config-data") pod "3d99b69f-0e55-4c21-a44a-f9d489528859" (UID: "3d99b69f-0e55-4c21-a44a-f9d489528859"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:16:15 crc kubenswrapper[5120]: I0316 16:16:15.373609 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3d99b69f-0e55-4c21-a44a-f9d489528859-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:16:15 crc kubenswrapper[5120]: I0316 16:16:15.373648 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3d99b69f-0e55-4c21-a44a-f9d489528859-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:16:15 crc kubenswrapper[5120]: I0316 16:16:15.373659 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6r9gl\" (UniqueName: \"kubernetes.io/projected/3d99b69f-0e55-4c21-a44a-f9d489528859-kube-api-access-6r9gl\") on node \"crc\" DevicePath \"\"" Mar 16 16:16:15 crc kubenswrapper[5120]: I0316 16:16:15.825481 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-cmr6k" Mar 16 16:16:15 crc kubenswrapper[5120]: I0316 16:16:15.825671 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-cmr6k" event={"ID":"3d99b69f-0e55-4c21-a44a-f9d489528859","Type":"ContainerDied","Data":"e23268c09d68f18f7ccf72ddf91e638456a7ff50ab88bde4f391a5e56524d0a0"} Mar 16 16:16:15 crc kubenswrapper[5120]: I0316 16:16:15.826647 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e23268c09d68f18f7ccf72ddf91e638456a7ff50ab88bde4f391a5e56524d0a0" Mar 16 16:16:15 crc kubenswrapper[5120]: I0316 16:16:15.845587 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:16:15 crc kubenswrapper[5120]: I0316 16:16:15.845661 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:16:15 crc kubenswrapper[5120]: I0316 16:16:15.851952 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:16:15 crc kubenswrapper[5120]: I0316 16:16:15.890070 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3d99b69f-0e55-4c21-a44a-f9d489528859-combined-ca-bundle\") pod \"3d99b69f-0e55-4c21-a44a-f9d489528859\" (UID: \"3d99b69f-0e55-4c21-a44a-f9d489528859\") " Mar 16 16:16:15 crc kubenswrapper[5120]: I0316 16:16:15.910008 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d99b69f-0e55-4c21-a44a-f9d489528859-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "3d99b69f-0e55-4c21-a44a-f9d489528859" (UID: "3d99b69f-0e55-4c21-a44a-f9d489528859"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:16:15 crc kubenswrapper[5120]: I0316 16:16:15.921276 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:16:15 crc kubenswrapper[5120]: I0316 16:16:15.923151 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 16:16:15 crc kubenswrapper[5120]: I0316 16:16:15.924903 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d99b69f-0e55-4c21-a44a-f9d489528859" containerName="nova-cell1-conductor-db-sync" Mar 16 16:16:15 crc kubenswrapper[5120]: I0316 16:16:15.924938 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d99b69f-0e55-4c21-a44a-f9d489528859" containerName="nova-cell1-conductor-db-sync" Mar 16 16:16:15 crc kubenswrapper[5120]: I0316 16:16:15.925298 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="3d99b69f-0e55-4c21-a44a-f9d489528859" containerName="nova-cell1-conductor-db-sync" Mar 16 16:16:15 crc kubenswrapper[5120]: I0316 16:16:15.932921 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:16:15 crc kubenswrapper[5120]: I0316 16:16:15.933310 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 16:16:15 crc kubenswrapper[5120]: I0316 16:16:15.994030 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e73bdb2c-01bf-4eca-93df-22b051fee769-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"e73bdb2c-01bf-4eca-93df-22b051fee769\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:16:15 crc kubenswrapper[5120]: I0316 16:16:15.994184 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvzzn\" (UniqueName: \"kubernetes.io/projected/e73bdb2c-01bf-4eca-93df-22b051fee769-kube-api-access-lvzzn\") pod \"nova-cell1-conductor-0\" (UID: \"e73bdb2c-01bf-4eca-93df-22b051fee769\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:16:15 crc kubenswrapper[5120]: I0316 16:16:15.994250 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e73bdb2c-01bf-4eca-93df-22b051fee769-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"e73bdb2c-01bf-4eca-93df-22b051fee769\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:16:15 crc kubenswrapper[5120]: I0316 16:16:15.994329 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3d99b69f-0e55-4c21-a44a-f9d489528859-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:16:16 crc kubenswrapper[5120]: I0316 16:16:16.099768 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e73bdb2c-01bf-4eca-93df-22b051fee769-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"e73bdb2c-01bf-4eca-93df-22b051fee769\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:16:16 crc kubenswrapper[5120]: I0316 16:16:16.100098 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lvzzn\" (UniqueName: \"kubernetes.io/projected/e73bdb2c-01bf-4eca-93df-22b051fee769-kube-api-access-lvzzn\") pod \"nova-cell1-conductor-0\" (UID: \"e73bdb2c-01bf-4eca-93df-22b051fee769\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:16:16 crc kubenswrapper[5120]: I0316 16:16:16.100220 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e73bdb2c-01bf-4eca-93df-22b051fee769-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"e73bdb2c-01bf-4eca-93df-22b051fee769\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:16:16 crc kubenswrapper[5120]: I0316 16:16:16.103864 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e73bdb2c-01bf-4eca-93df-22b051fee769-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"e73bdb2c-01bf-4eca-93df-22b051fee769\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:16:16 crc kubenswrapper[5120]: I0316 16:16:16.105042 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e73bdb2c-01bf-4eca-93df-22b051fee769-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"e73bdb2c-01bf-4eca-93df-22b051fee769\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:16:16 crc kubenswrapper[5120]: I0316 16:16:16.114573 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvzzn\" (UniqueName: \"kubernetes.io/projected/e73bdb2c-01bf-4eca-93df-22b051fee769-kube-api-access-lvzzn\") pod \"nova-cell1-conductor-0\" (UID: \"e73bdb2c-01bf-4eca-93df-22b051fee769\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:16:16 crc kubenswrapper[5120]: I0316 16:16:16.220971 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:16:16 crc kubenswrapper[5120]: I0316 16:16:16.263424 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:16:16 crc kubenswrapper[5120]: I0316 16:16:16.281704 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-5dw24" Mar 16 16:16:16 crc kubenswrapper[5120]: I0316 16:16:16.406877 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b6faf05a-dc59-49cb-9b76-dd13901f77d3-scripts\") pod \"b6faf05a-dc59-49cb-9b76-dd13901f77d3\" (UID: \"b6faf05a-dc59-49cb-9b76-dd13901f77d3\") " Mar 16 16:16:16 crc kubenswrapper[5120]: I0316 16:16:16.409550 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6xrl8\" (UniqueName: \"kubernetes.io/projected/b6faf05a-dc59-49cb-9b76-dd13901f77d3-kube-api-access-6xrl8\") pod \"b6faf05a-dc59-49cb-9b76-dd13901f77d3\" (UID: \"b6faf05a-dc59-49cb-9b76-dd13901f77d3\") " Mar 16 16:16:16 crc kubenswrapper[5120]: I0316 16:16:16.409751 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b6faf05a-dc59-49cb-9b76-dd13901f77d3-config-data\") pod \"b6faf05a-dc59-49cb-9b76-dd13901f77d3\" (UID: \"b6faf05a-dc59-49cb-9b76-dd13901f77d3\") " Mar 16 16:16:16 crc kubenswrapper[5120]: I0316 16:16:16.411202 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b6faf05a-dc59-49cb-9b76-dd13901f77d3-combined-ca-bundle\") pod \"b6faf05a-dc59-49cb-9b76-dd13901f77d3\" (UID: \"b6faf05a-dc59-49cb-9b76-dd13901f77d3\") " Mar 16 16:16:16 crc kubenswrapper[5120]: I0316 16:16:16.416293 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6faf05a-dc59-49cb-9b76-dd13901f77d3-kube-api-access-6xrl8" (OuterVolumeSpecName: "kube-api-access-6xrl8") pod "b6faf05a-dc59-49cb-9b76-dd13901f77d3" (UID: "b6faf05a-dc59-49cb-9b76-dd13901f77d3"). InnerVolumeSpecName "kube-api-access-6xrl8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:16:16 crc kubenswrapper[5120]: I0316 16:16:16.419890 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b6faf05a-dc59-49cb-9b76-dd13901f77d3-scripts" (OuterVolumeSpecName: "scripts") pod "b6faf05a-dc59-49cb-9b76-dd13901f77d3" (UID: "b6faf05a-dc59-49cb-9b76-dd13901f77d3"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:16:16 crc kubenswrapper[5120]: I0316 16:16:16.437951 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b6faf05a-dc59-49cb-9b76-dd13901f77d3-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "b6faf05a-dc59-49cb-9b76-dd13901f77d3" (UID: "b6faf05a-dc59-49cb-9b76-dd13901f77d3"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:16:16 crc kubenswrapper[5120]: I0316 16:16:16.442072 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b6faf05a-dc59-49cb-9b76-dd13901f77d3-config-data" (OuterVolumeSpecName: "config-data") pod "b6faf05a-dc59-49cb-9b76-dd13901f77d3" (UID: "b6faf05a-dc59-49cb-9b76-dd13901f77d3"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:16:16 crc kubenswrapper[5120]: I0316 16:16:16.515096 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b6faf05a-dc59-49cb-9b76-dd13901f77d3-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:16:16 crc kubenswrapper[5120]: I0316 16:16:16.515128 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b6faf05a-dc59-49cb-9b76-dd13901f77d3-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:16:16 crc kubenswrapper[5120]: I0316 16:16:16.515139 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b6faf05a-dc59-49cb-9b76-dd13901f77d3-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:16:16 crc kubenswrapper[5120]: I0316 16:16:16.515148 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6xrl8\" (UniqueName: \"kubernetes.io/projected/b6faf05a-dc59-49cb-9b76-dd13901f77d3-kube-api-access-6xrl8\") on node \"crc\" DevicePath \"\"" Mar 16 16:16:16 crc kubenswrapper[5120]: I0316 16:16:16.736106 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 16:16:16 crc kubenswrapper[5120]: W0316 16:16:16.744306 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode73bdb2c_01bf_4eca_93df_22b051fee769.slice/crio-66ac18240efe86f829036e029419a154036d8d6828a2309a747afc4acbe8ab78 WatchSource:0}: Error finding container 66ac18240efe86f829036e029419a154036d8d6828a2309a747afc4acbe8ab78: Status 404 returned error can't find the container with id 66ac18240efe86f829036e029419a154036d8d6828a2309a747afc4acbe8ab78 Mar 16 16:16:16 crc kubenswrapper[5120]: I0316 16:16:16.835206 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-5dw24" event={"ID":"b6faf05a-dc59-49cb-9b76-dd13901f77d3","Type":"ContainerDied","Data":"af8e7894e85d95f6065705a77dc36600f094a0fdc4da45c1b0cf967269c52264"} Mar 16 16:16:16 crc kubenswrapper[5120]: I0316 16:16:16.835247 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="af8e7894e85d95f6065705a77dc36600f094a0fdc4da45c1b0cf967269c52264" Mar 16 16:16:16 crc kubenswrapper[5120]: I0316 16:16:16.835316 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-5dw24" Mar 16 16:16:16 crc kubenswrapper[5120]: I0316 16:16:16.843102 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"e73bdb2c-01bf-4eca-93df-22b051fee769","Type":"ContainerStarted","Data":"66ac18240efe86f829036e029419a154036d8d6828a2309a747afc4acbe8ab78"} Mar 16 16:16:16 crc kubenswrapper[5120]: I0316 16:16:16.888133 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="991185cb-9198-485d-9c8a-c47ed6909585" containerName="nova-api-api" probeResult="failure" output="Get \"http://10.217.1.0:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 16:16:16 crc kubenswrapper[5120]: I0316 16:16:16.888138 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="991185cb-9198-485d-9c8a-c47ed6909585" containerName="nova-api-log" probeResult="failure" output="Get \"http://10.217.1.0:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 16:16:16 crc kubenswrapper[5120]: I0316 16:16:16.901463 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:16:17 crc kubenswrapper[5120]: I0316 16:16:17.107389 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:16:17 crc kubenswrapper[5120]: I0316 16:16:17.107853 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="991185cb-9198-485d-9c8a-c47ed6909585" containerName="nova-api-api" containerID="cri-o://1260a16c02d2ce7784013185114f426ca7e5b94a2afd2cd5bee051f58ac76247" gracePeriod=30 Mar 16 16:16:17 crc kubenswrapper[5120]: I0316 16:16:17.107673 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="991185cb-9198-485d-9c8a-c47ed6909585" containerName="nova-api-log" containerID="cri-o://ddef8c7aa4f1f97f6c45164394f85586533769e767e9ff8d14f8eace0297e296" gracePeriod=30 Mar 16 16:16:17 crc kubenswrapper[5120]: I0316 16:16:17.136776 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:16:17 crc kubenswrapper[5120]: I0316 16:16:17.137529 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="df40e9ac-8a94-4d19-9bd7-50c958c79e42" containerName="nova-metadata-log" containerID="cri-o://fcb9390c2b0cbf715900652262c42debff521687a59e4b0fa014586b161628ad" gracePeriod=30 Mar 16 16:16:17 crc kubenswrapper[5120]: I0316 16:16:17.138156 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="df40e9ac-8a94-4d19-9bd7-50c958c79e42" containerName="nova-metadata-metadata" containerID="cri-o://250c9a3b1e441ae056a925f00402a0b6794d918dbd7dba667c73ef7c0afea814" gracePeriod=30 Mar 16 16:16:17 crc kubenswrapper[5120]: I0316 16:16:17.331388 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:16:17 crc kubenswrapper[5120]: I0316 16:16:17.649576 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:16:17 crc kubenswrapper[5120]: I0316 16:16:17.740473 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/df40e9ac-8a94-4d19-9bd7-50c958c79e42-combined-ca-bundle\") pod \"df40e9ac-8a94-4d19-9bd7-50c958c79e42\" (UID: \"df40e9ac-8a94-4d19-9bd7-50c958c79e42\") " Mar 16 16:16:17 crc kubenswrapper[5120]: I0316 16:16:17.740530 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/df40e9ac-8a94-4d19-9bd7-50c958c79e42-config-data\") pod \"df40e9ac-8a94-4d19-9bd7-50c958c79e42\" (UID: \"df40e9ac-8a94-4d19-9bd7-50c958c79e42\") " Mar 16 16:16:17 crc kubenswrapper[5120]: I0316 16:16:17.740832 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/df40e9ac-8a94-4d19-9bd7-50c958c79e42-logs\") pod \"df40e9ac-8a94-4d19-9bd7-50c958c79e42\" (UID: \"df40e9ac-8a94-4d19-9bd7-50c958c79e42\") " Mar 16 16:16:17 crc kubenswrapper[5120]: I0316 16:16:17.740945 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l7bw4\" (UniqueName: \"kubernetes.io/projected/df40e9ac-8a94-4d19-9bd7-50c958c79e42-kube-api-access-l7bw4\") pod \"df40e9ac-8a94-4d19-9bd7-50c958c79e42\" (UID: \"df40e9ac-8a94-4d19-9bd7-50c958c79e42\") " Mar 16 16:16:17 crc kubenswrapper[5120]: I0316 16:16:17.741037 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/df40e9ac-8a94-4d19-9bd7-50c958c79e42-nova-metadata-tls-certs\") pod \"df40e9ac-8a94-4d19-9bd7-50c958c79e42\" (UID: \"df40e9ac-8a94-4d19-9bd7-50c958c79e42\") " Mar 16 16:16:17 crc kubenswrapper[5120]: I0316 16:16:17.741280 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df40e9ac-8a94-4d19-9bd7-50c958c79e42-logs" (OuterVolumeSpecName: "logs") pod "df40e9ac-8a94-4d19-9bd7-50c958c79e42" (UID: "df40e9ac-8a94-4d19-9bd7-50c958c79e42"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:16:17 crc kubenswrapper[5120]: I0316 16:16:17.741973 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/df40e9ac-8a94-4d19-9bd7-50c958c79e42-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:16:17 crc kubenswrapper[5120]: I0316 16:16:17.746455 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df40e9ac-8a94-4d19-9bd7-50c958c79e42-kube-api-access-l7bw4" (OuterVolumeSpecName: "kube-api-access-l7bw4") pod "df40e9ac-8a94-4d19-9bd7-50c958c79e42" (UID: "df40e9ac-8a94-4d19-9bd7-50c958c79e42"). InnerVolumeSpecName "kube-api-access-l7bw4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:16:17 crc kubenswrapper[5120]: I0316 16:16:17.771274 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/df40e9ac-8a94-4d19-9bd7-50c958c79e42-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "df40e9ac-8a94-4d19-9bd7-50c958c79e42" (UID: "df40e9ac-8a94-4d19-9bd7-50c958c79e42"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:16:17 crc kubenswrapper[5120]: I0316 16:16:17.775854 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/df40e9ac-8a94-4d19-9bd7-50c958c79e42-config-data" (OuterVolumeSpecName: "config-data") pod "df40e9ac-8a94-4d19-9bd7-50c958c79e42" (UID: "df40e9ac-8a94-4d19-9bd7-50c958c79e42"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:16:17 crc kubenswrapper[5120]: I0316 16:16:17.794826 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/df40e9ac-8a94-4d19-9bd7-50c958c79e42-nova-metadata-tls-certs" (OuterVolumeSpecName: "nova-metadata-tls-certs") pod "df40e9ac-8a94-4d19-9bd7-50c958c79e42" (UID: "df40e9ac-8a94-4d19-9bd7-50c958c79e42"). InnerVolumeSpecName "nova-metadata-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:16:17 crc kubenswrapper[5120]: I0316 16:16:17.844674 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l7bw4\" (UniqueName: \"kubernetes.io/projected/df40e9ac-8a94-4d19-9bd7-50c958c79e42-kube-api-access-l7bw4\") on node \"crc\" DevicePath \"\"" Mar 16 16:16:17 crc kubenswrapper[5120]: I0316 16:16:17.844708 5120 reconciler_common.go:299] "Volume detached for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/df40e9ac-8a94-4d19-9bd7-50c958c79e42-nova-metadata-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:16:17 crc kubenswrapper[5120]: I0316 16:16:17.844721 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/df40e9ac-8a94-4d19-9bd7-50c958c79e42-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:16:17 crc kubenswrapper[5120]: I0316 16:16:17.844732 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/df40e9ac-8a94-4d19-9bd7-50c958c79e42-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:16:17 crc kubenswrapper[5120]: I0316 16:16:17.852422 5120 generic.go:358] "Generic (PLEG): container finished" podID="df40e9ac-8a94-4d19-9bd7-50c958c79e42" containerID="250c9a3b1e441ae056a925f00402a0b6794d918dbd7dba667c73ef7c0afea814" exitCode=0 Mar 16 16:16:17 crc kubenswrapper[5120]: I0316 16:16:17.852717 5120 generic.go:358] "Generic (PLEG): container finished" podID="df40e9ac-8a94-4d19-9bd7-50c958c79e42" containerID="fcb9390c2b0cbf715900652262c42debff521687a59e4b0fa014586b161628ad" exitCode=143 Mar 16 16:16:17 crc kubenswrapper[5120]: I0316 16:16:17.852544 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"df40e9ac-8a94-4d19-9bd7-50c958c79e42","Type":"ContainerDied","Data":"250c9a3b1e441ae056a925f00402a0b6794d918dbd7dba667c73ef7c0afea814"} Mar 16 16:16:17 crc kubenswrapper[5120]: I0316 16:16:17.853066 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"df40e9ac-8a94-4d19-9bd7-50c958c79e42","Type":"ContainerDied","Data":"fcb9390c2b0cbf715900652262c42debff521687a59e4b0fa014586b161628ad"} Mar 16 16:16:17 crc kubenswrapper[5120]: I0316 16:16:17.853215 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"df40e9ac-8a94-4d19-9bd7-50c958c79e42","Type":"ContainerDied","Data":"0be3d4364fdaafcd9e7d483174bf93be1b1b6b07d786eeffe580aa8e1f9d44bb"} Mar 16 16:16:17 crc kubenswrapper[5120]: I0316 16:16:17.853196 5120 scope.go:117] "RemoveContainer" containerID="250c9a3b1e441ae056a925f00402a0b6794d918dbd7dba667c73ef7c0afea814" Mar 16 16:16:17 crc kubenswrapper[5120]: I0316 16:16:17.852522 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:16:17 crc kubenswrapper[5120]: I0316 16:16:17.861902 5120 generic.go:358] "Generic (PLEG): container finished" podID="991185cb-9198-485d-9c8a-c47ed6909585" containerID="ddef8c7aa4f1f97f6c45164394f85586533769e767e9ff8d14f8eace0297e296" exitCode=143 Mar 16 16:16:17 crc kubenswrapper[5120]: I0316 16:16:17.863598 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"991185cb-9198-485d-9c8a-c47ed6909585","Type":"ContainerDied","Data":"ddef8c7aa4f1f97f6c45164394f85586533769e767e9ff8d14f8eace0297e296"} Mar 16 16:16:17 crc kubenswrapper[5120]: I0316 16:16:17.866959 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"e73bdb2c-01bf-4eca-93df-22b051fee769","Type":"ContainerStarted","Data":"e97ac48130213536a9b9b0d15722b762acfe6f81aabde1c8b9c64553d53ec8c7"} Mar 16 16:16:17 crc kubenswrapper[5120]: I0316 16:16:17.867125 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:16:17 crc kubenswrapper[5120]: I0316 16:16:17.889014 5120 scope.go:117] "RemoveContainer" containerID="fcb9390c2b0cbf715900652262c42debff521687a59e4b0fa014586b161628ad" Mar 16 16:16:17 crc kubenswrapper[5120]: I0316 16:16:17.889934 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podStartSLOduration=2.889913618 podStartE2EDuration="2.889913618s" podCreationTimestamp="2026-03-16 16:16:15 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:16:17.887445372 +0000 UTC m=+2680.041377029" watchObservedRunningTime="2026-03-16 16:16:17.889913618 +0000 UTC m=+2680.043845275" Mar 16 16:16:17 crc kubenswrapper[5120]: I0316 16:16:17.917837 5120 scope.go:117] "RemoveContainer" containerID="250c9a3b1e441ae056a925f00402a0b6794d918dbd7dba667c73ef7c0afea814" Mar 16 16:16:17 crc kubenswrapper[5120]: E0316 16:16:17.918502 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"250c9a3b1e441ae056a925f00402a0b6794d918dbd7dba667c73ef7c0afea814\": container with ID starting with 250c9a3b1e441ae056a925f00402a0b6794d918dbd7dba667c73ef7c0afea814 not found: ID does not exist" containerID="250c9a3b1e441ae056a925f00402a0b6794d918dbd7dba667c73ef7c0afea814" Mar 16 16:16:17 crc kubenswrapper[5120]: I0316 16:16:17.918571 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"250c9a3b1e441ae056a925f00402a0b6794d918dbd7dba667c73ef7c0afea814"} err="failed to get container status \"250c9a3b1e441ae056a925f00402a0b6794d918dbd7dba667c73ef7c0afea814\": rpc error: code = NotFound desc = could not find container \"250c9a3b1e441ae056a925f00402a0b6794d918dbd7dba667c73ef7c0afea814\": container with ID starting with 250c9a3b1e441ae056a925f00402a0b6794d918dbd7dba667c73ef7c0afea814 not found: ID does not exist" Mar 16 16:16:17 crc kubenswrapper[5120]: I0316 16:16:17.918599 5120 scope.go:117] "RemoveContainer" containerID="fcb9390c2b0cbf715900652262c42debff521687a59e4b0fa014586b161628ad" Mar 16 16:16:17 crc kubenswrapper[5120]: E0316 16:16:17.919001 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fcb9390c2b0cbf715900652262c42debff521687a59e4b0fa014586b161628ad\": container with ID starting with fcb9390c2b0cbf715900652262c42debff521687a59e4b0fa014586b161628ad not found: ID does not exist" containerID="fcb9390c2b0cbf715900652262c42debff521687a59e4b0fa014586b161628ad" Mar 16 16:16:17 crc kubenswrapper[5120]: I0316 16:16:17.919033 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fcb9390c2b0cbf715900652262c42debff521687a59e4b0fa014586b161628ad"} err="failed to get container status \"fcb9390c2b0cbf715900652262c42debff521687a59e4b0fa014586b161628ad\": rpc error: code = NotFound desc = could not find container \"fcb9390c2b0cbf715900652262c42debff521687a59e4b0fa014586b161628ad\": container with ID starting with fcb9390c2b0cbf715900652262c42debff521687a59e4b0fa014586b161628ad not found: ID does not exist" Mar 16 16:16:17 crc kubenswrapper[5120]: I0316 16:16:17.919056 5120 scope.go:117] "RemoveContainer" containerID="250c9a3b1e441ae056a925f00402a0b6794d918dbd7dba667c73ef7c0afea814" Mar 16 16:16:17 crc kubenswrapper[5120]: I0316 16:16:17.919268 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:16:17 crc kubenswrapper[5120]: I0316 16:16:17.919430 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"250c9a3b1e441ae056a925f00402a0b6794d918dbd7dba667c73ef7c0afea814"} err="failed to get container status \"250c9a3b1e441ae056a925f00402a0b6794d918dbd7dba667c73ef7c0afea814\": rpc error: code = NotFound desc = could not find container \"250c9a3b1e441ae056a925f00402a0b6794d918dbd7dba667c73ef7c0afea814\": container with ID starting with 250c9a3b1e441ae056a925f00402a0b6794d918dbd7dba667c73ef7c0afea814 not found: ID does not exist" Mar 16 16:16:17 crc kubenswrapper[5120]: I0316 16:16:17.919453 5120 scope.go:117] "RemoveContainer" containerID="fcb9390c2b0cbf715900652262c42debff521687a59e4b0fa014586b161628ad" Mar 16 16:16:17 crc kubenswrapper[5120]: I0316 16:16:17.919840 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fcb9390c2b0cbf715900652262c42debff521687a59e4b0fa014586b161628ad"} err="failed to get container status \"fcb9390c2b0cbf715900652262c42debff521687a59e4b0fa014586b161628ad\": rpc error: code = NotFound desc = could not find container \"fcb9390c2b0cbf715900652262c42debff521687a59e4b0fa014586b161628ad\": container with ID starting with fcb9390c2b0cbf715900652262c42debff521687a59e4b0fa014586b161628ad not found: ID does not exist" Mar 16 16:16:17 crc kubenswrapper[5120]: I0316 16:16:17.942654 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:16:17 crc kubenswrapper[5120]: I0316 16:16:17.949299 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:16:17 crc kubenswrapper[5120]: I0316 16:16:17.950288 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df40e9ac-8a94-4d19-9bd7-50c958c79e42" containerName="nova-metadata-metadata" Mar 16 16:16:17 crc kubenswrapper[5120]: I0316 16:16:17.950307 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="df40e9ac-8a94-4d19-9bd7-50c958c79e42" containerName="nova-metadata-metadata" Mar 16 16:16:17 crc kubenswrapper[5120]: I0316 16:16:17.950343 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df40e9ac-8a94-4d19-9bd7-50c958c79e42" containerName="nova-metadata-log" Mar 16 16:16:17 crc kubenswrapper[5120]: I0316 16:16:17.950349 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="df40e9ac-8a94-4d19-9bd7-50c958c79e42" containerName="nova-metadata-log" Mar 16 16:16:17 crc kubenswrapper[5120]: I0316 16:16:17.950374 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6faf05a-dc59-49cb-9b76-dd13901f77d3" containerName="nova-manage" Mar 16 16:16:17 crc kubenswrapper[5120]: I0316 16:16:17.950379 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6faf05a-dc59-49cb-9b76-dd13901f77d3" containerName="nova-manage" Mar 16 16:16:17 crc kubenswrapper[5120]: I0316 16:16:17.950524 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="df40e9ac-8a94-4d19-9bd7-50c958c79e42" containerName="nova-metadata-log" Mar 16 16:16:17 crc kubenswrapper[5120]: I0316 16:16:17.950540 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="df40e9ac-8a94-4d19-9bd7-50c958c79e42" containerName="nova-metadata-metadata" Mar 16 16:16:17 crc kubenswrapper[5120]: I0316 16:16:17.950552 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="b6faf05a-dc59-49cb-9b76-dd13901f77d3" containerName="nova-manage" Mar 16 16:16:17 crc kubenswrapper[5120]: I0316 16:16:17.965798 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:16:17 crc kubenswrapper[5120]: I0316 16:16:17.966214 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:16:17 crc kubenswrapper[5120]: I0316 16:16:17.970078 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-metadata-internal-svc\"" Mar 16 16:16:17 crc kubenswrapper[5120]: I0316 16:16:17.970714 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-metadata-config-data\"" Mar 16 16:16:18 crc kubenswrapper[5120]: I0316 16:16:18.048082 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3555721d-1bee-4d75-9cc0-91d87be1fb23-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"3555721d-1bee-4d75-9cc0-91d87be1fb23\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:16:18 crc kubenswrapper[5120]: I0316 16:16:18.048166 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jsb5\" (UniqueName: \"kubernetes.io/projected/3555721d-1bee-4d75-9cc0-91d87be1fb23-kube-api-access-7jsb5\") pod \"nova-metadata-0\" (UID: \"3555721d-1bee-4d75-9cc0-91d87be1fb23\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:16:18 crc kubenswrapper[5120]: I0316 16:16:18.048304 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3555721d-1bee-4d75-9cc0-91d87be1fb23-logs\") pod \"nova-metadata-0\" (UID: \"3555721d-1bee-4d75-9cc0-91d87be1fb23\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:16:18 crc kubenswrapper[5120]: I0316 16:16:18.048363 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/3555721d-1bee-4d75-9cc0-91d87be1fb23-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"3555721d-1bee-4d75-9cc0-91d87be1fb23\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:16:18 crc kubenswrapper[5120]: I0316 16:16:18.048401 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3555721d-1bee-4d75-9cc0-91d87be1fb23-config-data\") pod \"nova-metadata-0\" (UID: \"3555721d-1bee-4d75-9cc0-91d87be1fb23\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:16:18 crc kubenswrapper[5120]: I0316 16:16:18.150051 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3555721d-1bee-4d75-9cc0-91d87be1fb23-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"3555721d-1bee-4d75-9cc0-91d87be1fb23\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:16:18 crc kubenswrapper[5120]: I0316 16:16:18.150394 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7jsb5\" (UniqueName: \"kubernetes.io/projected/3555721d-1bee-4d75-9cc0-91d87be1fb23-kube-api-access-7jsb5\") pod \"nova-metadata-0\" (UID: \"3555721d-1bee-4d75-9cc0-91d87be1fb23\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:16:18 crc kubenswrapper[5120]: I0316 16:16:18.150910 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3555721d-1bee-4d75-9cc0-91d87be1fb23-logs\") pod \"nova-metadata-0\" (UID: \"3555721d-1bee-4d75-9cc0-91d87be1fb23\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:16:18 crc kubenswrapper[5120]: I0316 16:16:18.151112 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/3555721d-1bee-4d75-9cc0-91d87be1fb23-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"3555721d-1bee-4d75-9cc0-91d87be1fb23\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:16:18 crc kubenswrapper[5120]: I0316 16:16:18.151274 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3555721d-1bee-4d75-9cc0-91d87be1fb23-config-data\") pod \"nova-metadata-0\" (UID: \"3555721d-1bee-4d75-9cc0-91d87be1fb23\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:16:18 crc kubenswrapper[5120]: I0316 16:16:18.152027 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3555721d-1bee-4d75-9cc0-91d87be1fb23-logs\") pod \"nova-metadata-0\" (UID: \"3555721d-1bee-4d75-9cc0-91d87be1fb23\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:16:18 crc kubenswrapper[5120]: I0316 16:16:18.155238 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3555721d-1bee-4d75-9cc0-91d87be1fb23-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"3555721d-1bee-4d75-9cc0-91d87be1fb23\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:16:18 crc kubenswrapper[5120]: I0316 16:16:18.155525 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/3555721d-1bee-4d75-9cc0-91d87be1fb23-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"3555721d-1bee-4d75-9cc0-91d87be1fb23\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:16:18 crc kubenswrapper[5120]: I0316 16:16:18.155728 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3555721d-1bee-4d75-9cc0-91d87be1fb23-config-data\") pod \"nova-metadata-0\" (UID: \"3555721d-1bee-4d75-9cc0-91d87be1fb23\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:16:18 crc kubenswrapper[5120]: I0316 16:16:18.177381 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jsb5\" (UniqueName: \"kubernetes.io/projected/3555721d-1bee-4d75-9cc0-91d87be1fb23-kube-api-access-7jsb5\") pod \"nova-metadata-0\" (UID: \"3555721d-1bee-4d75-9cc0-91d87be1fb23\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:16:18 crc kubenswrapper[5120]: I0316 16:16:18.283601 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:16:18 crc kubenswrapper[5120]: I0316 16:16:18.683396 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="df40e9ac-8a94-4d19-9bd7-50c958c79e42" path="/var/lib/kubelet/pods/df40e9ac-8a94-4d19-9bd7-50c958c79e42/volumes" Mar 16 16:16:18 crc kubenswrapper[5120]: I0316 16:16:18.805128 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:16:18 crc kubenswrapper[5120]: I0316 16:16:18.875968 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"3555721d-1bee-4d75-9cc0-91d87be1fb23","Type":"ContainerStarted","Data":"cb3e0bd56db08699d5e8e2e61ac2deb7fa86c31c75fa30cdb296e4f001775415"} Mar 16 16:16:18 crc kubenswrapper[5120]: I0316 16:16:18.879096 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="b02a0c6f-3a63-400d-9e44-cb09c8e2669a" containerName="nova-scheduler-scheduler" containerID="cri-o://61d6553a6b8005f56275fcb5de5e5514d87c4b5c4f667b0ac1e45bd2cd79cdef" gracePeriod=30 Mar 16 16:16:19 crc kubenswrapper[5120]: I0316 16:16:19.356579 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:16:19 crc kubenswrapper[5120]: I0316 16:16:19.913593 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"3555721d-1bee-4d75-9cc0-91d87be1fb23","Type":"ContainerStarted","Data":"714d752a003dc482162279ded9ade8ecaf909c2597f2de062e9aa760bc59f588"} Mar 16 16:16:19 crc kubenswrapper[5120]: I0316 16:16:19.914146 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"3555721d-1bee-4d75-9cc0-91d87be1fb23","Type":"ContainerStarted","Data":"91f7dd868888c206b12f206956b254cab2eb873c8c44272df32e83eea22a5ba8"} Mar 16 16:16:19 crc kubenswrapper[5120]: I0316 16:16:19.946405 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=2.946380311 podStartE2EDuration="2.946380311s" podCreationTimestamp="2026-03-16 16:16:17 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:16:19.945050385 +0000 UTC m=+2682.098982132" watchObservedRunningTime="2026-03-16 16:16:19.946380311 +0000 UTC m=+2682.100311998" Mar 16 16:16:21 crc kubenswrapper[5120]: I0316 16:16:21.221306 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:16:21 crc kubenswrapper[5120]: I0316 16:16:21.243546 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:16:21 crc kubenswrapper[5120]: E0316 16:16:21.845751 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="61d6553a6b8005f56275fcb5de5e5514d87c4b5c4f667b0ac1e45bd2cd79cdef" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:16:21 crc kubenswrapper[5120]: E0316 16:16:21.848121 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="61d6553a6b8005f56275fcb5de5e5514d87c4b5c4f667b0ac1e45bd2cd79cdef" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:16:21 crc kubenswrapper[5120]: E0316 16:16:21.850905 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="61d6553a6b8005f56275fcb5de5e5514d87c4b5c4f667b0ac1e45bd2cd79cdef" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:16:21 crc kubenswrapper[5120]: E0316 16:16:21.850991 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="b02a0c6f-3a63-400d-9e44-cb09c8e2669a" containerName="nova-scheduler-scheduler" probeResult="unknown" Mar 16 16:16:22 crc kubenswrapper[5120]: I0316 16:16:22.001655 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:16:22 crc kubenswrapper[5120]: I0316 16:16:22.007695 5120 patch_prober.go:28] interesting pod/machine-config-daemon-7bf76 container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 16:16:22 crc kubenswrapper[5120]: I0316 16:16:22.007829 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 16:16:22 crc kubenswrapper[5120]: I0316 16:16:22.981529 5120 generic.go:358] "Generic (PLEG): container finished" podID="991185cb-9198-485d-9c8a-c47ed6909585" containerID="1260a16c02d2ce7784013185114f426ca7e5b94a2afd2cd5bee051f58ac76247" exitCode=0 Mar 16 16:16:22 crc kubenswrapper[5120]: I0316 16:16:22.981574 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"991185cb-9198-485d-9c8a-c47ed6909585","Type":"ContainerDied","Data":"1260a16c02d2ce7784013185114f426ca7e5b94a2afd2cd5bee051f58ac76247"} Mar 16 16:16:23 crc kubenswrapper[5120]: I0316 16:16:23.103969 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:16:23 crc kubenswrapper[5120]: I0316 16:16:23.192677 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/991185cb-9198-485d-9c8a-c47ed6909585-combined-ca-bundle\") pod \"991185cb-9198-485d-9c8a-c47ed6909585\" (UID: \"991185cb-9198-485d-9c8a-c47ed6909585\") " Mar 16 16:16:23 crc kubenswrapper[5120]: I0316 16:16:23.192803 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/991185cb-9198-485d-9c8a-c47ed6909585-logs\") pod \"991185cb-9198-485d-9c8a-c47ed6909585\" (UID: \"991185cb-9198-485d-9c8a-c47ed6909585\") " Mar 16 16:16:23 crc kubenswrapper[5120]: I0316 16:16:23.192838 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/991185cb-9198-485d-9c8a-c47ed6909585-config-data\") pod \"991185cb-9198-485d-9c8a-c47ed6909585\" (UID: \"991185cb-9198-485d-9c8a-c47ed6909585\") " Mar 16 16:16:23 crc kubenswrapper[5120]: I0316 16:16:23.192980 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jb7sh\" (UniqueName: \"kubernetes.io/projected/991185cb-9198-485d-9c8a-c47ed6909585-kube-api-access-jb7sh\") pod \"991185cb-9198-485d-9c8a-c47ed6909585\" (UID: \"991185cb-9198-485d-9c8a-c47ed6909585\") " Mar 16 16:16:23 crc kubenswrapper[5120]: I0316 16:16:23.194813 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/991185cb-9198-485d-9c8a-c47ed6909585-logs" (OuterVolumeSpecName: "logs") pod "991185cb-9198-485d-9c8a-c47ed6909585" (UID: "991185cb-9198-485d-9c8a-c47ed6909585"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:16:23 crc kubenswrapper[5120]: I0316 16:16:23.200673 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/991185cb-9198-485d-9c8a-c47ed6909585-kube-api-access-jb7sh" (OuterVolumeSpecName: "kube-api-access-jb7sh") pod "991185cb-9198-485d-9c8a-c47ed6909585" (UID: "991185cb-9198-485d-9c8a-c47ed6909585"). InnerVolumeSpecName "kube-api-access-jb7sh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:16:23 crc kubenswrapper[5120]: I0316 16:16:23.235720 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/991185cb-9198-485d-9c8a-c47ed6909585-config-data" (OuterVolumeSpecName: "config-data") pod "991185cb-9198-485d-9c8a-c47ed6909585" (UID: "991185cb-9198-485d-9c8a-c47ed6909585"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:16:23 crc kubenswrapper[5120]: I0316 16:16:23.240079 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/991185cb-9198-485d-9c8a-c47ed6909585-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "991185cb-9198-485d-9c8a-c47ed6909585" (UID: "991185cb-9198-485d-9c8a-c47ed6909585"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:16:23 crc kubenswrapper[5120]: I0316 16:16:23.296145 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jb7sh\" (UniqueName: \"kubernetes.io/projected/991185cb-9198-485d-9c8a-c47ed6909585-kube-api-access-jb7sh\") on node \"crc\" DevicePath \"\"" Mar 16 16:16:23 crc kubenswrapper[5120]: I0316 16:16:23.296194 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/991185cb-9198-485d-9c8a-c47ed6909585-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:16:23 crc kubenswrapper[5120]: I0316 16:16:23.296204 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/991185cb-9198-485d-9c8a-c47ed6909585-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:16:23 crc kubenswrapper[5120]: I0316 16:16:23.296214 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/991185cb-9198-485d-9c8a-c47ed6909585-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:16:23 crc kubenswrapper[5120]: I0316 16:16:23.472908 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 16:16:23 crc kubenswrapper[5120]: I0316 16:16:23.473146 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/kube-state-metrics-0" podUID="da20effd-08fa-46be-81a1-d9a5074e72a2" containerName="kube-state-metrics" containerID="cri-o://8cc8e36d000e2d0c2c42d12d21dbefc8ec0787382032ec5f9d372e053ee9da21" gracePeriod=30 Mar 16 16:16:23 crc kubenswrapper[5120]: I0316 16:16:23.895741 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:16:23 crc kubenswrapper[5120]: I0316 16:16:23.926710 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:16:23 crc kubenswrapper[5120]: I0316 16:16:23.998037 5120 generic.go:358] "Generic (PLEG): container finished" podID="b02a0c6f-3a63-400d-9e44-cb09c8e2669a" containerID="61d6553a6b8005f56275fcb5de5e5514d87c4b5c4f667b0ac1e45bd2cd79cdef" exitCode=0 Mar 16 16:16:23 crc kubenswrapper[5120]: I0316 16:16:23.998136 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"b02a0c6f-3a63-400d-9e44-cb09c8e2669a","Type":"ContainerDied","Data":"61d6553a6b8005f56275fcb5de5e5514d87c4b5c4f667b0ac1e45bd2cd79cdef"} Mar 16 16:16:23 crc kubenswrapper[5120]: I0316 16:16:23.998163 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"b02a0c6f-3a63-400d-9e44-cb09c8e2669a","Type":"ContainerDied","Data":"834f0aea0a6f2c2977997b03044b386d1a7fd2a3776556058da0f455464ffd62"} Mar 16 16:16:23 crc kubenswrapper[5120]: I0316 16:16:23.998178 5120 scope.go:117] "RemoveContainer" containerID="61d6553a6b8005f56275fcb5de5e5514d87c4b5c4f667b0ac1e45bd2cd79cdef" Mar 16 16:16:23 crc kubenswrapper[5120]: I0316 16:16:23.998272 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:16:24 crc kubenswrapper[5120]: I0316 16:16:24.004585 5120 generic.go:358] "Generic (PLEG): container finished" podID="da20effd-08fa-46be-81a1-d9a5074e72a2" containerID="8cc8e36d000e2d0c2c42d12d21dbefc8ec0787382032ec5f9d372e053ee9da21" exitCode=2 Mar 16 16:16:24 crc kubenswrapper[5120]: I0316 16:16:24.004810 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"da20effd-08fa-46be-81a1-d9a5074e72a2","Type":"ContainerDied","Data":"8cc8e36d000e2d0c2c42d12d21dbefc8ec0787382032ec5f9d372e053ee9da21"} Mar 16 16:16:24 crc kubenswrapper[5120]: I0316 16:16:24.004837 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"da20effd-08fa-46be-81a1-d9a5074e72a2","Type":"ContainerDied","Data":"58446e866fa7d08d3c619baba7b4eb6247cab583cae5b19a2bc2b0f59c1da64e"} Mar 16 16:16:24 crc kubenswrapper[5120]: I0316 16:16:24.004851 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="58446e866fa7d08d3c619baba7b4eb6247cab583cae5b19a2bc2b0f59c1da64e" Mar 16 16:16:24 crc kubenswrapper[5120]: I0316 16:16:24.008226 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"991185cb-9198-485d-9c8a-c47ed6909585","Type":"ContainerDied","Data":"9492011c2e7bdf561d4a82d4bb4ca9c243d0068b8619be51b0a405dfa3993480"} Mar 16 16:16:24 crc kubenswrapper[5120]: I0316 16:16:24.008303 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:16:24 crc kubenswrapper[5120]: I0316 16:16:24.011195 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b02a0c6f-3a63-400d-9e44-cb09c8e2669a-combined-ca-bundle\") pod \"b02a0c6f-3a63-400d-9e44-cb09c8e2669a\" (UID: \"b02a0c6f-3a63-400d-9e44-cb09c8e2669a\") " Mar 16 16:16:24 crc kubenswrapper[5120]: I0316 16:16:24.011537 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b02a0c6f-3a63-400d-9e44-cb09c8e2669a-config-data\") pod \"b02a0c6f-3a63-400d-9e44-cb09c8e2669a\" (UID: \"b02a0c6f-3a63-400d-9e44-cb09c8e2669a\") " Mar 16 16:16:24 crc kubenswrapper[5120]: I0316 16:16:24.011641 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7mw2m\" (UniqueName: \"kubernetes.io/projected/b02a0c6f-3a63-400d-9e44-cb09c8e2669a-kube-api-access-7mw2m\") pod \"b02a0c6f-3a63-400d-9e44-cb09c8e2669a\" (UID: \"b02a0c6f-3a63-400d-9e44-cb09c8e2669a\") " Mar 16 16:16:24 crc kubenswrapper[5120]: I0316 16:16:24.019740 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b02a0c6f-3a63-400d-9e44-cb09c8e2669a-kube-api-access-7mw2m" (OuterVolumeSpecName: "kube-api-access-7mw2m") pod "b02a0c6f-3a63-400d-9e44-cb09c8e2669a" (UID: "b02a0c6f-3a63-400d-9e44-cb09c8e2669a"). InnerVolumeSpecName "kube-api-access-7mw2m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:16:24 crc kubenswrapper[5120]: I0316 16:16:24.029586 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:16:24 crc kubenswrapper[5120]: I0316 16:16:24.040920 5120 scope.go:117] "RemoveContainer" containerID="61d6553a6b8005f56275fcb5de5e5514d87c4b5c4f667b0ac1e45bd2cd79cdef" Mar 16 16:16:24 crc kubenswrapper[5120]: E0316 16:16:24.041272 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"61d6553a6b8005f56275fcb5de5e5514d87c4b5c4f667b0ac1e45bd2cd79cdef\": container with ID starting with 61d6553a6b8005f56275fcb5de5e5514d87c4b5c4f667b0ac1e45bd2cd79cdef not found: ID does not exist" containerID="61d6553a6b8005f56275fcb5de5e5514d87c4b5c4f667b0ac1e45bd2cd79cdef" Mar 16 16:16:24 crc kubenswrapper[5120]: I0316 16:16:24.041332 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61d6553a6b8005f56275fcb5de5e5514d87c4b5c4f667b0ac1e45bd2cd79cdef"} err="failed to get container status \"61d6553a6b8005f56275fcb5de5e5514d87c4b5c4f667b0ac1e45bd2cd79cdef\": rpc error: code = NotFound desc = could not find container \"61d6553a6b8005f56275fcb5de5e5514d87c4b5c4f667b0ac1e45bd2cd79cdef\": container with ID starting with 61d6553a6b8005f56275fcb5de5e5514d87c4b5c4f667b0ac1e45bd2cd79cdef not found: ID does not exist" Mar 16 16:16:24 crc kubenswrapper[5120]: I0316 16:16:24.041361 5120 scope.go:117] "RemoveContainer" containerID="1260a16c02d2ce7784013185114f426ca7e5b94a2afd2cd5bee051f58ac76247" Mar 16 16:16:24 crc kubenswrapper[5120]: I0316 16:16:24.063503 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:16:24 crc kubenswrapper[5120]: I0316 16:16:24.064090 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b02a0c6f-3a63-400d-9e44-cb09c8e2669a-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "b02a0c6f-3a63-400d-9e44-cb09c8e2669a" (UID: "b02a0c6f-3a63-400d-9e44-cb09c8e2669a"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:16:24 crc kubenswrapper[5120]: I0316 16:16:24.079548 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b02a0c6f-3a63-400d-9e44-cb09c8e2669a-config-data" (OuterVolumeSpecName: "config-data") pod "b02a0c6f-3a63-400d-9e44-cb09c8e2669a" (UID: "b02a0c6f-3a63-400d-9e44-cb09c8e2669a"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:16:24 crc kubenswrapper[5120]: I0316 16:16:24.086199 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:16:24 crc kubenswrapper[5120]: I0316 16:16:24.088300 5120 scope.go:117] "RemoveContainer" containerID="ddef8c7aa4f1f97f6c45164394f85586533769e767e9ff8d14f8eace0297e296" Mar 16 16:16:24 crc kubenswrapper[5120]: I0316 16:16:24.111876 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:16:24 crc kubenswrapper[5120]: I0316 16:16:24.112884 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="991185cb-9198-485d-9c8a-c47ed6909585" containerName="nova-api-api" Mar 16 16:16:24 crc kubenswrapper[5120]: I0316 16:16:24.112903 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="991185cb-9198-485d-9c8a-c47ed6909585" containerName="nova-api-api" Mar 16 16:16:24 crc kubenswrapper[5120]: I0316 16:16:24.112925 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="991185cb-9198-485d-9c8a-c47ed6909585" containerName="nova-api-log" Mar 16 16:16:24 crc kubenswrapper[5120]: I0316 16:16:24.112931 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="991185cb-9198-485d-9c8a-c47ed6909585" containerName="nova-api-log" Mar 16 16:16:24 crc kubenswrapper[5120]: I0316 16:16:24.112943 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b02a0c6f-3a63-400d-9e44-cb09c8e2669a" containerName="nova-scheduler-scheduler" Mar 16 16:16:24 crc kubenswrapper[5120]: I0316 16:16:24.112949 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="b02a0c6f-3a63-400d-9e44-cb09c8e2669a" containerName="nova-scheduler-scheduler" Mar 16 16:16:24 crc kubenswrapper[5120]: I0316 16:16:24.112962 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da20effd-08fa-46be-81a1-d9a5074e72a2" containerName="kube-state-metrics" Mar 16 16:16:24 crc kubenswrapper[5120]: I0316 16:16:24.112968 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="da20effd-08fa-46be-81a1-d9a5074e72a2" containerName="kube-state-metrics" Mar 16 16:16:24 crc kubenswrapper[5120]: I0316 16:16:24.113106 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="da20effd-08fa-46be-81a1-d9a5074e72a2" containerName="kube-state-metrics" Mar 16 16:16:24 crc kubenswrapper[5120]: I0316 16:16:24.113127 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="b02a0c6f-3a63-400d-9e44-cb09c8e2669a" containerName="nova-scheduler-scheduler" Mar 16 16:16:24 crc kubenswrapper[5120]: I0316 16:16:24.113138 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="991185cb-9198-485d-9c8a-c47ed6909585" containerName="nova-api-log" Mar 16 16:16:24 crc kubenswrapper[5120]: I0316 16:16:24.113151 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="991185cb-9198-485d-9c8a-c47ed6909585" containerName="nova-api-api" Mar 16 16:16:24 crc kubenswrapper[5120]: I0316 16:16:24.113551 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-86tc7\" (UniqueName: \"kubernetes.io/projected/da20effd-08fa-46be-81a1-d9a5074e72a2-kube-api-access-86tc7\") pod \"da20effd-08fa-46be-81a1-d9a5074e72a2\" (UID: \"da20effd-08fa-46be-81a1-d9a5074e72a2\") " Mar 16 16:16:24 crc kubenswrapper[5120]: I0316 16:16:24.114153 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b02a0c6f-3a63-400d-9e44-cb09c8e2669a-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:16:24 crc kubenswrapper[5120]: I0316 16:16:24.114177 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b02a0c6f-3a63-400d-9e44-cb09c8e2669a-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:16:24 crc kubenswrapper[5120]: I0316 16:16:24.114190 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7mw2m\" (UniqueName: \"kubernetes.io/projected/b02a0c6f-3a63-400d-9e44-cb09c8e2669a-kube-api-access-7mw2m\") on node \"crc\" DevicePath \"\"" Mar 16 16:16:24 crc kubenswrapper[5120]: I0316 16:16:24.116731 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da20effd-08fa-46be-81a1-d9a5074e72a2-kube-api-access-86tc7" (OuterVolumeSpecName: "kube-api-access-86tc7") pod "da20effd-08fa-46be-81a1-d9a5074e72a2" (UID: "da20effd-08fa-46be-81a1-d9a5074e72a2"). InnerVolumeSpecName "kube-api-access-86tc7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:16:24 crc kubenswrapper[5120]: I0316 16:16:24.121477 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:16:24 crc kubenswrapper[5120]: I0316 16:16:24.121581 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:16:24 crc kubenswrapper[5120]: I0316 16:16:24.124066 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-config-data\"" Mar 16 16:16:24 crc kubenswrapper[5120]: I0316 16:16:24.216367 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwjqd\" (UniqueName: \"kubernetes.io/projected/16a01d7c-c746-4436-bd54-f00c0af8abfe-kube-api-access-hwjqd\") pod \"nova-api-0\" (UID: \"16a01d7c-c746-4436-bd54-f00c0af8abfe\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:16:24 crc kubenswrapper[5120]: I0316 16:16:24.216444 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/16a01d7c-c746-4436-bd54-f00c0af8abfe-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"16a01d7c-c746-4436-bd54-f00c0af8abfe\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:16:24 crc kubenswrapper[5120]: I0316 16:16:24.216471 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/16a01d7c-c746-4436-bd54-f00c0af8abfe-logs\") pod \"nova-api-0\" (UID: \"16a01d7c-c746-4436-bd54-f00c0af8abfe\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:16:24 crc kubenswrapper[5120]: I0316 16:16:24.216794 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/16a01d7c-c746-4436-bd54-f00c0af8abfe-config-data\") pod \"nova-api-0\" (UID: \"16a01d7c-c746-4436-bd54-f00c0af8abfe\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:16:24 crc kubenswrapper[5120]: I0316 16:16:24.217022 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-86tc7\" (UniqueName: \"kubernetes.io/projected/da20effd-08fa-46be-81a1-d9a5074e72a2-kube-api-access-86tc7\") on node \"crc\" DevicePath \"\"" Mar 16 16:16:24 crc kubenswrapper[5120]: I0316 16:16:24.319317 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/16a01d7c-c746-4436-bd54-f00c0af8abfe-config-data\") pod \"nova-api-0\" (UID: \"16a01d7c-c746-4436-bd54-f00c0af8abfe\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:16:24 crc kubenswrapper[5120]: I0316 16:16:24.319484 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hwjqd\" (UniqueName: \"kubernetes.io/projected/16a01d7c-c746-4436-bd54-f00c0af8abfe-kube-api-access-hwjqd\") pod \"nova-api-0\" (UID: \"16a01d7c-c746-4436-bd54-f00c0af8abfe\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:16:24 crc kubenswrapper[5120]: I0316 16:16:24.319528 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/16a01d7c-c746-4436-bd54-f00c0af8abfe-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"16a01d7c-c746-4436-bd54-f00c0af8abfe\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:16:24 crc kubenswrapper[5120]: I0316 16:16:24.319554 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/16a01d7c-c746-4436-bd54-f00c0af8abfe-logs\") pod \"nova-api-0\" (UID: \"16a01d7c-c746-4436-bd54-f00c0af8abfe\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:16:24 crc kubenswrapper[5120]: I0316 16:16:24.320106 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/16a01d7c-c746-4436-bd54-f00c0af8abfe-logs\") pod \"nova-api-0\" (UID: \"16a01d7c-c746-4436-bd54-f00c0af8abfe\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:16:24 crc kubenswrapper[5120]: I0316 16:16:24.325875 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/16a01d7c-c746-4436-bd54-f00c0af8abfe-config-data\") pod \"nova-api-0\" (UID: \"16a01d7c-c746-4436-bd54-f00c0af8abfe\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:16:24 crc kubenswrapper[5120]: I0316 16:16:24.326119 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/16a01d7c-c746-4436-bd54-f00c0af8abfe-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"16a01d7c-c746-4436-bd54-f00c0af8abfe\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:16:24 crc kubenswrapper[5120]: I0316 16:16:24.333491 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:16:24 crc kubenswrapper[5120]: I0316 16:16:24.338395 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwjqd\" (UniqueName: \"kubernetes.io/projected/16a01d7c-c746-4436-bd54-f00c0af8abfe-kube-api-access-hwjqd\") pod \"nova-api-0\" (UID: \"16a01d7c-c746-4436-bd54-f00c0af8abfe\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:16:24 crc kubenswrapper[5120]: I0316 16:16:24.344910 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:16:24 crc kubenswrapper[5120]: I0316 16:16:24.358134 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:16:24 crc kubenswrapper[5120]: I0316 16:16:24.364288 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:16:24 crc kubenswrapper[5120]: I0316 16:16:24.368161 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-scheduler-config-data\"" Mar 16 16:16:24 crc kubenswrapper[5120]: I0316 16:16:24.371729 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:16:24 crc kubenswrapper[5120]: I0316 16:16:24.420705 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c0716e29-22dd-442d-b52e-b21f627de899-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"c0716e29-22dd-442d-b52e-b21f627de899\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:16:24 crc kubenswrapper[5120]: I0316 16:16:24.421124 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mccdj\" (UniqueName: \"kubernetes.io/projected/c0716e29-22dd-442d-b52e-b21f627de899-kube-api-access-mccdj\") pod \"nova-scheduler-0\" (UID: \"c0716e29-22dd-442d-b52e-b21f627de899\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:16:24 crc kubenswrapper[5120]: I0316 16:16:24.421280 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c0716e29-22dd-442d-b52e-b21f627de899-config-data\") pod \"nova-scheduler-0\" (UID: \"c0716e29-22dd-442d-b52e-b21f627de899\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:16:24 crc kubenswrapper[5120]: I0316 16:16:24.437945 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:16:24 crc kubenswrapper[5120]: I0316 16:16:24.487809 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-ghlgl"] Mar 16 16:16:24 crc kubenswrapper[5120]: I0316 16:16:24.494193 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-ghlgl" Mar 16 16:16:24 crc kubenswrapper[5120]: I0316 16:16:24.496848 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-manage-config-data\"" Mar 16 16:16:24 crc kubenswrapper[5120]: I0316 16:16:24.497047 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-manage-scripts\"" Mar 16 16:16:24 crc kubenswrapper[5120]: I0316 16:16:24.501062 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-ghlgl"] Mar 16 16:16:24 crc kubenswrapper[5120]: I0316 16:16:24.523574 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g82p5\" (UniqueName: \"kubernetes.io/projected/08bb98cb-efd9-409e-b1bf-760159c5460c-kube-api-access-g82p5\") pod \"nova-cell1-cell-mapping-ghlgl\" (UID: \"08bb98cb-efd9-409e-b1bf-760159c5460c\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-ghlgl" Mar 16 16:16:24 crc kubenswrapper[5120]: I0316 16:16:24.523703 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c0716e29-22dd-442d-b52e-b21f627de899-config-data\") pod \"nova-scheduler-0\" (UID: \"c0716e29-22dd-442d-b52e-b21f627de899\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:16:24 crc kubenswrapper[5120]: I0316 16:16:24.523794 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/08bb98cb-efd9-409e-b1bf-760159c5460c-combined-ca-bundle\") pod \"nova-cell1-cell-mapping-ghlgl\" (UID: \"08bb98cb-efd9-409e-b1bf-760159c5460c\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-ghlgl" Mar 16 16:16:24 crc kubenswrapper[5120]: I0316 16:16:24.523840 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c0716e29-22dd-442d-b52e-b21f627de899-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"c0716e29-22dd-442d-b52e-b21f627de899\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:16:24 crc kubenswrapper[5120]: I0316 16:16:24.523891 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/08bb98cb-efd9-409e-b1bf-760159c5460c-config-data\") pod \"nova-cell1-cell-mapping-ghlgl\" (UID: \"08bb98cb-efd9-409e-b1bf-760159c5460c\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-ghlgl" Mar 16 16:16:24 crc kubenswrapper[5120]: I0316 16:16:24.523921 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mccdj\" (UniqueName: \"kubernetes.io/projected/c0716e29-22dd-442d-b52e-b21f627de899-kube-api-access-mccdj\") pod \"nova-scheduler-0\" (UID: \"c0716e29-22dd-442d-b52e-b21f627de899\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:16:24 crc kubenswrapper[5120]: I0316 16:16:24.523954 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/08bb98cb-efd9-409e-b1bf-760159c5460c-scripts\") pod \"nova-cell1-cell-mapping-ghlgl\" (UID: \"08bb98cb-efd9-409e-b1bf-760159c5460c\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-ghlgl" Mar 16 16:16:24 crc kubenswrapper[5120]: I0316 16:16:24.528433 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c0716e29-22dd-442d-b52e-b21f627de899-config-data\") pod \"nova-scheduler-0\" (UID: \"c0716e29-22dd-442d-b52e-b21f627de899\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:16:24 crc kubenswrapper[5120]: I0316 16:16:24.529236 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c0716e29-22dd-442d-b52e-b21f627de899-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"c0716e29-22dd-442d-b52e-b21f627de899\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:16:24 crc kubenswrapper[5120]: I0316 16:16:24.539366 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mccdj\" (UniqueName: \"kubernetes.io/projected/c0716e29-22dd-442d-b52e-b21f627de899-kube-api-access-mccdj\") pod \"nova-scheduler-0\" (UID: \"c0716e29-22dd-442d-b52e-b21f627de899\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:16:24 crc kubenswrapper[5120]: I0316 16:16:24.625548 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/08bb98cb-efd9-409e-b1bf-760159c5460c-scripts\") pod \"nova-cell1-cell-mapping-ghlgl\" (UID: \"08bb98cb-efd9-409e-b1bf-760159c5460c\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-ghlgl" Mar 16 16:16:24 crc kubenswrapper[5120]: I0316 16:16:24.625646 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g82p5\" (UniqueName: \"kubernetes.io/projected/08bb98cb-efd9-409e-b1bf-760159c5460c-kube-api-access-g82p5\") pod \"nova-cell1-cell-mapping-ghlgl\" (UID: \"08bb98cb-efd9-409e-b1bf-760159c5460c\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-ghlgl" Mar 16 16:16:24 crc kubenswrapper[5120]: I0316 16:16:24.625841 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/08bb98cb-efd9-409e-b1bf-760159c5460c-combined-ca-bundle\") pod \"nova-cell1-cell-mapping-ghlgl\" (UID: \"08bb98cb-efd9-409e-b1bf-760159c5460c\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-ghlgl" Mar 16 16:16:24 crc kubenswrapper[5120]: I0316 16:16:24.625922 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/08bb98cb-efd9-409e-b1bf-760159c5460c-config-data\") pod \"nova-cell1-cell-mapping-ghlgl\" (UID: \"08bb98cb-efd9-409e-b1bf-760159c5460c\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-ghlgl" Mar 16 16:16:24 crc kubenswrapper[5120]: I0316 16:16:24.630820 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/08bb98cb-efd9-409e-b1bf-760159c5460c-combined-ca-bundle\") pod \"nova-cell1-cell-mapping-ghlgl\" (UID: \"08bb98cb-efd9-409e-b1bf-760159c5460c\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-ghlgl" Mar 16 16:16:24 crc kubenswrapper[5120]: I0316 16:16:24.630962 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/08bb98cb-efd9-409e-b1bf-760159c5460c-scripts\") pod \"nova-cell1-cell-mapping-ghlgl\" (UID: \"08bb98cb-efd9-409e-b1bf-760159c5460c\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-ghlgl" Mar 16 16:16:24 crc kubenswrapper[5120]: I0316 16:16:24.631131 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/08bb98cb-efd9-409e-b1bf-760159c5460c-config-data\") pod \"nova-cell1-cell-mapping-ghlgl\" (UID: \"08bb98cb-efd9-409e-b1bf-760159c5460c\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-ghlgl" Mar 16 16:16:24 crc kubenswrapper[5120]: I0316 16:16:24.652659 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g82p5\" (UniqueName: \"kubernetes.io/projected/08bb98cb-efd9-409e-b1bf-760159c5460c-kube-api-access-g82p5\") pod \"nova-cell1-cell-mapping-ghlgl\" (UID: \"08bb98cb-efd9-409e-b1bf-760159c5460c\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-ghlgl" Mar 16 16:16:24 crc kubenswrapper[5120]: I0316 16:16:24.679414 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="991185cb-9198-485d-9c8a-c47ed6909585" path="/var/lib/kubelet/pods/991185cb-9198-485d-9c8a-c47ed6909585/volumes" Mar 16 16:16:24 crc kubenswrapper[5120]: I0316 16:16:24.680204 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b02a0c6f-3a63-400d-9e44-cb09c8e2669a" path="/var/lib/kubelet/pods/b02a0c6f-3a63-400d-9e44-cb09c8e2669a/volumes" Mar 16 16:16:24 crc kubenswrapper[5120]: I0316 16:16:24.693339 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:16:24 crc kubenswrapper[5120]: I0316 16:16:24.820316 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-ghlgl" Mar 16 16:16:24 crc kubenswrapper[5120]: I0316 16:16:24.911075 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:16:25 crc kubenswrapper[5120]: I0316 16:16:25.025732 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"16a01d7c-c746-4436-bd54-f00c0af8abfe","Type":"ContainerStarted","Data":"e376b5adc4614e280ad5c37031edf5d7b97cdf0e5e50f342de321f74cd0b1bff"} Mar 16 16:16:25 crc kubenswrapper[5120]: I0316 16:16:25.028233 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:16:25 crc kubenswrapper[5120]: I0316 16:16:25.061760 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 16:16:25 crc kubenswrapper[5120]: I0316 16:16:25.074924 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 16:16:25 crc kubenswrapper[5120]: I0316 16:16:25.081628 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 16:16:25 crc kubenswrapper[5120]: I0316 16:16:25.088128 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:16:25 crc kubenswrapper[5120]: I0316 16:16:25.088372 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 16:16:25 crc kubenswrapper[5120]: I0316 16:16:25.090291 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"kube-state-metrics-tls-config\"" Mar 16 16:16:25 crc kubenswrapper[5120]: I0316 16:16:25.090500 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-kube-state-metrics-svc\"" Mar 16 16:16:25 crc kubenswrapper[5120]: I0316 16:16:25.138121 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6dv2\" (UniqueName: \"kubernetes.io/projected/d73ebf72-269e-4ebf-86b6-2d517ce8881a-kube-api-access-z6dv2\") pod \"kube-state-metrics-0\" (UID: \"d73ebf72-269e-4ebf-86b6-2d517ce8881a\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:16:25 crc kubenswrapper[5120]: I0316 16:16:25.138235 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/d73ebf72-269e-4ebf-86b6-2d517ce8881a-kube-state-metrics-tls-certs\") pod \"kube-state-metrics-0\" (UID: \"d73ebf72-269e-4ebf-86b6-2d517ce8881a\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:16:25 crc kubenswrapper[5120]: I0316 16:16:25.138264 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d73ebf72-269e-4ebf-86b6-2d517ce8881a-combined-ca-bundle\") pod \"kube-state-metrics-0\" (UID: \"d73ebf72-269e-4ebf-86b6-2d517ce8881a\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:16:25 crc kubenswrapper[5120]: I0316 16:16:25.138415 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/d73ebf72-269e-4ebf-86b6-2d517ce8881a-kube-state-metrics-tls-config\") pod \"kube-state-metrics-0\" (UID: \"d73ebf72-269e-4ebf-86b6-2d517ce8881a\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:16:25 crc kubenswrapper[5120]: I0316 16:16:25.139653 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:16:25 crc kubenswrapper[5120]: I0316 16:16:25.240570 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/d73ebf72-269e-4ebf-86b6-2d517ce8881a-kube-state-metrics-tls-config\") pod \"kube-state-metrics-0\" (UID: \"d73ebf72-269e-4ebf-86b6-2d517ce8881a\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:16:25 crc kubenswrapper[5120]: I0316 16:16:25.240705 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z6dv2\" (UniqueName: \"kubernetes.io/projected/d73ebf72-269e-4ebf-86b6-2d517ce8881a-kube-api-access-z6dv2\") pod \"kube-state-metrics-0\" (UID: \"d73ebf72-269e-4ebf-86b6-2d517ce8881a\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:16:25 crc kubenswrapper[5120]: I0316 16:16:25.240802 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/d73ebf72-269e-4ebf-86b6-2d517ce8881a-kube-state-metrics-tls-certs\") pod \"kube-state-metrics-0\" (UID: \"d73ebf72-269e-4ebf-86b6-2d517ce8881a\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:16:25 crc kubenswrapper[5120]: I0316 16:16:25.240822 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d73ebf72-269e-4ebf-86b6-2d517ce8881a-combined-ca-bundle\") pod \"kube-state-metrics-0\" (UID: \"d73ebf72-269e-4ebf-86b6-2d517ce8881a\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:16:25 crc kubenswrapper[5120]: I0316 16:16:25.253435 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/d73ebf72-269e-4ebf-86b6-2d517ce8881a-kube-state-metrics-tls-config\") pod \"kube-state-metrics-0\" (UID: \"d73ebf72-269e-4ebf-86b6-2d517ce8881a\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:16:25 crc kubenswrapper[5120]: I0316 16:16:25.254414 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d73ebf72-269e-4ebf-86b6-2d517ce8881a-combined-ca-bundle\") pod \"kube-state-metrics-0\" (UID: \"d73ebf72-269e-4ebf-86b6-2d517ce8881a\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:16:25 crc kubenswrapper[5120]: I0316 16:16:25.255159 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/d73ebf72-269e-4ebf-86b6-2d517ce8881a-kube-state-metrics-tls-certs\") pod \"kube-state-metrics-0\" (UID: \"d73ebf72-269e-4ebf-86b6-2d517ce8881a\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:16:25 crc kubenswrapper[5120]: I0316 16:16:25.257833 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6dv2\" (UniqueName: \"kubernetes.io/projected/d73ebf72-269e-4ebf-86b6-2d517ce8881a-kube-api-access-z6dv2\") pod \"kube-state-metrics-0\" (UID: \"d73ebf72-269e-4ebf-86b6-2d517ce8881a\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:16:25 crc kubenswrapper[5120]: I0316 16:16:25.261883 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-ghlgl"] Mar 16 16:16:25 crc kubenswrapper[5120]: I0316 16:16:25.406802 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:16:25 crc kubenswrapper[5120]: I0316 16:16:25.626575 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:16:25 crc kubenswrapper[5120]: I0316 16:16:25.627093 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="e75e15b9-8524-4d60-8f0e-fbc62c53017d" containerName="ceilometer-central-agent" containerID="cri-o://17cc20f230aaacbf09567a8e3c1fd76557368efa2c5cc8ef2ef609b247a960ea" gracePeriod=30 Mar 16 16:16:25 crc kubenswrapper[5120]: I0316 16:16:25.630527 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="e75e15b9-8524-4d60-8f0e-fbc62c53017d" containerName="proxy-httpd" containerID="cri-o://eef1a25a0cf1e37b068a91b7c0912810dba06eb70e31791fb6786f0323a8cf91" gracePeriod=30 Mar 16 16:16:25 crc kubenswrapper[5120]: I0316 16:16:25.630724 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="e75e15b9-8524-4d60-8f0e-fbc62c53017d" containerName="ceilometer-notification-agent" containerID="cri-o://ac58d6522b00bf15e9f2beae73c11d1bef154858476c238e0a1dc17e974e5986" gracePeriod=30 Mar 16 16:16:25 crc kubenswrapper[5120]: I0316 16:16:25.630948 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="e75e15b9-8524-4d60-8f0e-fbc62c53017d" containerName="sg-core" containerID="cri-o://f7120deb045ac2697483dc56cd7f2466a0e674ce0900dcc0f12585477b6fb21b" gracePeriod=30 Mar 16 16:16:25 crc kubenswrapper[5120]: I0316 16:16:25.892573 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 16:16:25 crc kubenswrapper[5120]: W0316 16:16:25.906845 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd73ebf72_269e_4ebf_86b6_2d517ce8881a.slice/crio-515662ef71e91e532e24d0c8d65028fe03b5519ac49d1a8cc8af9840ea05b280 WatchSource:0}: Error finding container 515662ef71e91e532e24d0c8d65028fe03b5519ac49d1a8cc8af9840ea05b280: Status 404 returned error can't find the container with id 515662ef71e91e532e24d0c8d65028fe03b5519ac49d1a8cc8af9840ea05b280 Mar 16 16:16:26 crc kubenswrapper[5120]: I0316 16:16:26.042386 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-ghlgl" event={"ID":"08bb98cb-efd9-409e-b1bf-760159c5460c","Type":"ContainerStarted","Data":"5850cdaacaa2728289ea6d253949dda18d2b7ab63a5336423e60e4a606603ca7"} Mar 16 16:16:26 crc kubenswrapper[5120]: I0316 16:16:26.042433 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-ghlgl" event={"ID":"08bb98cb-efd9-409e-b1bf-760159c5460c","Type":"ContainerStarted","Data":"aa03a838927a1994e043d91e0d92c7c3218a8f911897f703c53044b2b6a809f9"} Mar 16 16:16:26 crc kubenswrapper[5120]: I0316 16:16:26.049522 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"16a01d7c-c746-4436-bd54-f00c0af8abfe","Type":"ContainerStarted","Data":"e112ee7c79ecb17707fc95314ac70b6869e37bd08c64037e7be00e2a695c8429"} Mar 16 16:16:26 crc kubenswrapper[5120]: I0316 16:16:26.049564 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"16a01d7c-c746-4436-bd54-f00c0af8abfe","Type":"ContainerStarted","Data":"b6a80c590728c274157887c814a57a7db404433e10f7f7835675160252124708"} Mar 16 16:16:26 crc kubenswrapper[5120]: I0316 16:16:26.061291 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"d73ebf72-269e-4ebf-86b6-2d517ce8881a","Type":"ContainerStarted","Data":"515662ef71e91e532e24d0c8d65028fe03b5519ac49d1a8cc8af9840ea05b280"} Mar 16 16:16:26 crc kubenswrapper[5120]: I0316 16:16:26.063411 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-ghlgl" podStartSLOduration=2.063397628 podStartE2EDuration="2.063397628s" podCreationTimestamp="2026-03-16 16:16:24 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:16:26.061641782 +0000 UTC m=+2688.215573439" watchObservedRunningTime="2026-03-16 16:16:26.063397628 +0000 UTC m=+2688.217329285" Mar 16 16:16:26 crc kubenswrapper[5120]: I0316 16:16:26.065971 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"c0716e29-22dd-442d-b52e-b21f627de899","Type":"ContainerStarted","Data":"b740409ac34c52375a2495ededfe8c61b61436c3881a613fe774f4903cfe3a06"} Mar 16 16:16:26 crc kubenswrapper[5120]: I0316 16:16:26.066082 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"c0716e29-22dd-442d-b52e-b21f627de899","Type":"ContainerStarted","Data":"01b43998ff169bbd8da411390902ef41d15ee0690d423c3bdbb6fd713ff61d50"} Mar 16 16:16:26 crc kubenswrapper[5120]: I0316 16:16:26.069268 5120 generic.go:358] "Generic (PLEG): container finished" podID="e75e15b9-8524-4d60-8f0e-fbc62c53017d" containerID="eef1a25a0cf1e37b068a91b7c0912810dba06eb70e31791fb6786f0323a8cf91" exitCode=0 Mar 16 16:16:26 crc kubenswrapper[5120]: I0316 16:16:26.069293 5120 generic.go:358] "Generic (PLEG): container finished" podID="e75e15b9-8524-4d60-8f0e-fbc62c53017d" containerID="f7120deb045ac2697483dc56cd7f2466a0e674ce0900dcc0f12585477b6fb21b" exitCode=2 Mar 16 16:16:26 crc kubenswrapper[5120]: I0316 16:16:26.069364 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"e75e15b9-8524-4d60-8f0e-fbc62c53017d","Type":"ContainerDied","Data":"eef1a25a0cf1e37b068a91b7c0912810dba06eb70e31791fb6786f0323a8cf91"} Mar 16 16:16:26 crc kubenswrapper[5120]: I0316 16:16:26.069384 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"e75e15b9-8524-4d60-8f0e-fbc62c53017d","Type":"ContainerDied","Data":"f7120deb045ac2697483dc56cd7f2466a0e674ce0900dcc0f12585477b6fb21b"} Mar 16 16:16:26 crc kubenswrapper[5120]: I0316 16:16:26.085565 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=2.085546502 podStartE2EDuration="2.085546502s" podCreationTimestamp="2026-03-16 16:16:24 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:16:26.0809965 +0000 UTC m=+2688.234928157" watchObservedRunningTime="2026-03-16 16:16:26.085546502 +0000 UTC m=+2688.239478159" Mar 16 16:16:26 crc kubenswrapper[5120]: I0316 16:16:26.103683 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-scheduler-0" podStartSLOduration=2.103663848 podStartE2EDuration="2.103663848s" podCreationTimestamp="2026-03-16 16:16:24 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:16:26.100127252 +0000 UTC m=+2688.254058949" watchObservedRunningTime="2026-03-16 16:16:26.103663848 +0000 UTC m=+2688.257595505" Mar 16 16:16:26 crc kubenswrapper[5120]: I0316 16:16:26.679504 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="da20effd-08fa-46be-81a1-d9a5074e72a2" path="/var/lib/kubelet/pods/da20effd-08fa-46be-81a1-d9a5074e72a2/volumes" Mar 16 16:16:27 crc kubenswrapper[5120]: I0316 16:16:27.078698 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"d73ebf72-269e-4ebf-86b6-2d517ce8881a","Type":"ContainerStarted","Data":"55aacccfe83493c2807259e063c3f528093cf68eb2ea222aec83b143462b6a75"} Mar 16 16:16:27 crc kubenswrapper[5120]: I0316 16:16:27.079994 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:16:27 crc kubenswrapper[5120]: I0316 16:16:27.085364 5120 generic.go:358] "Generic (PLEG): container finished" podID="e75e15b9-8524-4d60-8f0e-fbc62c53017d" containerID="17cc20f230aaacbf09567a8e3c1fd76557368efa2c5cc8ef2ef609b247a960ea" exitCode=0 Mar 16 16:16:27 crc kubenswrapper[5120]: I0316 16:16:27.086473 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"e75e15b9-8524-4d60-8f0e-fbc62c53017d","Type":"ContainerDied","Data":"17cc20f230aaacbf09567a8e3c1fd76557368efa2c5cc8ef2ef609b247a960ea"} Mar 16 16:16:27 crc kubenswrapper[5120]: I0316 16:16:27.103691 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/kube-state-metrics-0" podStartSLOduration=1.459648608 podStartE2EDuration="2.103670978s" podCreationTimestamp="2026-03-16 16:16:25 +0000 UTC" firstStartedPulling="2026-03-16 16:16:25.912091253 +0000 UTC m=+2688.066022910" lastFinishedPulling="2026-03-16 16:16:26.556113623 +0000 UTC m=+2688.710045280" observedRunningTime="2026-03-16 16:16:27.09737336 +0000 UTC m=+2689.251305027" watchObservedRunningTime="2026-03-16 16:16:27.103670978 +0000 UTC m=+2689.257602635" Mar 16 16:16:27 crc kubenswrapper[5120]: I0316 16:16:27.620972 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:16:27 crc kubenswrapper[5120]: I0316 16:16:27.693723 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e75e15b9-8524-4d60-8f0e-fbc62c53017d-scripts\") pod \"e75e15b9-8524-4d60-8f0e-fbc62c53017d\" (UID: \"e75e15b9-8524-4d60-8f0e-fbc62c53017d\") " Mar 16 16:16:27 crc kubenswrapper[5120]: I0316 16:16:27.693809 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e75e15b9-8524-4d60-8f0e-fbc62c53017d-config-data\") pod \"e75e15b9-8524-4d60-8f0e-fbc62c53017d\" (UID: \"e75e15b9-8524-4d60-8f0e-fbc62c53017d\") " Mar 16 16:16:27 crc kubenswrapper[5120]: I0316 16:16:27.693974 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e75e15b9-8524-4d60-8f0e-fbc62c53017d-log-httpd\") pod \"e75e15b9-8524-4d60-8f0e-fbc62c53017d\" (UID: \"e75e15b9-8524-4d60-8f0e-fbc62c53017d\") " Mar 16 16:16:27 crc kubenswrapper[5120]: I0316 16:16:27.694079 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e75e15b9-8524-4d60-8f0e-fbc62c53017d-run-httpd\") pod \"e75e15b9-8524-4d60-8f0e-fbc62c53017d\" (UID: \"e75e15b9-8524-4d60-8f0e-fbc62c53017d\") " Mar 16 16:16:27 crc kubenswrapper[5120]: I0316 16:16:27.694324 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/e75e15b9-8524-4d60-8f0e-fbc62c53017d-sg-core-conf-yaml\") pod \"e75e15b9-8524-4d60-8f0e-fbc62c53017d\" (UID: \"e75e15b9-8524-4d60-8f0e-fbc62c53017d\") " Mar 16 16:16:27 crc kubenswrapper[5120]: I0316 16:16:27.694370 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5924l\" (UniqueName: \"kubernetes.io/projected/e75e15b9-8524-4d60-8f0e-fbc62c53017d-kube-api-access-5924l\") pod \"e75e15b9-8524-4d60-8f0e-fbc62c53017d\" (UID: \"e75e15b9-8524-4d60-8f0e-fbc62c53017d\") " Mar 16 16:16:27 crc kubenswrapper[5120]: I0316 16:16:27.694367 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e75e15b9-8524-4d60-8f0e-fbc62c53017d-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "e75e15b9-8524-4d60-8f0e-fbc62c53017d" (UID: "e75e15b9-8524-4d60-8f0e-fbc62c53017d"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:16:27 crc kubenswrapper[5120]: I0316 16:16:27.694528 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e75e15b9-8524-4d60-8f0e-fbc62c53017d-combined-ca-bundle\") pod \"e75e15b9-8524-4d60-8f0e-fbc62c53017d\" (UID: \"e75e15b9-8524-4d60-8f0e-fbc62c53017d\") " Mar 16 16:16:27 crc kubenswrapper[5120]: I0316 16:16:27.695178 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e75e15b9-8524-4d60-8f0e-fbc62c53017d-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "e75e15b9-8524-4d60-8f0e-fbc62c53017d" (UID: "e75e15b9-8524-4d60-8f0e-fbc62c53017d"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:16:27 crc kubenswrapper[5120]: I0316 16:16:27.695905 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e75e15b9-8524-4d60-8f0e-fbc62c53017d-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:16:27 crc kubenswrapper[5120]: I0316 16:16:27.695926 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e75e15b9-8524-4d60-8f0e-fbc62c53017d-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:16:27 crc kubenswrapper[5120]: I0316 16:16:27.703339 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e75e15b9-8524-4d60-8f0e-fbc62c53017d-kube-api-access-5924l" (OuterVolumeSpecName: "kube-api-access-5924l") pod "e75e15b9-8524-4d60-8f0e-fbc62c53017d" (UID: "e75e15b9-8524-4d60-8f0e-fbc62c53017d"). InnerVolumeSpecName "kube-api-access-5924l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:16:27 crc kubenswrapper[5120]: I0316 16:16:27.708065 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e75e15b9-8524-4d60-8f0e-fbc62c53017d-scripts" (OuterVolumeSpecName: "scripts") pod "e75e15b9-8524-4d60-8f0e-fbc62c53017d" (UID: "e75e15b9-8524-4d60-8f0e-fbc62c53017d"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:16:27 crc kubenswrapper[5120]: I0316 16:16:27.734584 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e75e15b9-8524-4d60-8f0e-fbc62c53017d-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "e75e15b9-8524-4d60-8f0e-fbc62c53017d" (UID: "e75e15b9-8524-4d60-8f0e-fbc62c53017d"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:16:27 crc kubenswrapper[5120]: I0316 16:16:27.788890 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e75e15b9-8524-4d60-8f0e-fbc62c53017d-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e75e15b9-8524-4d60-8f0e-fbc62c53017d" (UID: "e75e15b9-8524-4d60-8f0e-fbc62c53017d"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:16:27 crc kubenswrapper[5120]: I0316 16:16:27.799879 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/e75e15b9-8524-4d60-8f0e-fbc62c53017d-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 16:16:27 crc kubenswrapper[5120]: I0316 16:16:27.799911 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5924l\" (UniqueName: \"kubernetes.io/projected/e75e15b9-8524-4d60-8f0e-fbc62c53017d-kube-api-access-5924l\") on node \"crc\" DevicePath \"\"" Mar 16 16:16:27 crc kubenswrapper[5120]: I0316 16:16:27.799925 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e75e15b9-8524-4d60-8f0e-fbc62c53017d-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:16:27 crc kubenswrapper[5120]: I0316 16:16:27.799937 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e75e15b9-8524-4d60-8f0e-fbc62c53017d-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:16:27 crc kubenswrapper[5120]: I0316 16:16:27.806708 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e75e15b9-8524-4d60-8f0e-fbc62c53017d-config-data" (OuterVolumeSpecName: "config-data") pod "e75e15b9-8524-4d60-8f0e-fbc62c53017d" (UID: "e75e15b9-8524-4d60-8f0e-fbc62c53017d"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:16:27 crc kubenswrapper[5120]: I0316 16:16:27.903476 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e75e15b9-8524-4d60-8f0e-fbc62c53017d-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:16:28 crc kubenswrapper[5120]: I0316 16:16:28.101711 5120 generic.go:358] "Generic (PLEG): container finished" podID="e75e15b9-8524-4d60-8f0e-fbc62c53017d" containerID="ac58d6522b00bf15e9f2beae73c11d1bef154858476c238e0a1dc17e974e5986" exitCode=0 Mar 16 16:16:28 crc kubenswrapper[5120]: I0316 16:16:28.104152 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:16:28 crc kubenswrapper[5120]: I0316 16:16:28.104634 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"e75e15b9-8524-4d60-8f0e-fbc62c53017d","Type":"ContainerDied","Data":"ac58d6522b00bf15e9f2beae73c11d1bef154858476c238e0a1dc17e974e5986"} Mar 16 16:16:28 crc kubenswrapper[5120]: I0316 16:16:28.104691 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"e75e15b9-8524-4d60-8f0e-fbc62c53017d","Type":"ContainerDied","Data":"383a72622dd5893f2a4e36d040846eaa79bbf1aafda8d15e55c72ec8bee594ca"} Mar 16 16:16:28 crc kubenswrapper[5120]: I0316 16:16:28.104714 5120 scope.go:117] "RemoveContainer" containerID="eef1a25a0cf1e37b068a91b7c0912810dba06eb70e31791fb6786f0323a8cf91" Mar 16 16:16:28 crc kubenswrapper[5120]: I0316 16:16:28.126962 5120 scope.go:117] "RemoveContainer" containerID="f7120deb045ac2697483dc56cd7f2466a0e674ce0900dcc0f12585477b6fb21b" Mar 16 16:16:28 crc kubenswrapper[5120]: I0316 16:16:28.154961 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:16:28 crc kubenswrapper[5120]: I0316 16:16:28.155251 5120 scope.go:117] "RemoveContainer" containerID="ac58d6522b00bf15e9f2beae73c11d1bef154858476c238e0a1dc17e974e5986" Mar 16 16:16:28 crc kubenswrapper[5120]: I0316 16:16:28.164666 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:16:28 crc kubenswrapper[5120]: I0316 16:16:28.190681 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:16:28 crc kubenswrapper[5120]: I0316 16:16:28.195552 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e75e15b9-8524-4d60-8f0e-fbc62c53017d" containerName="proxy-httpd" Mar 16 16:16:28 crc kubenswrapper[5120]: I0316 16:16:28.195581 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e75e15b9-8524-4d60-8f0e-fbc62c53017d" containerName="proxy-httpd" Mar 16 16:16:28 crc kubenswrapper[5120]: I0316 16:16:28.195619 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e75e15b9-8524-4d60-8f0e-fbc62c53017d" containerName="sg-core" Mar 16 16:16:28 crc kubenswrapper[5120]: I0316 16:16:28.195625 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e75e15b9-8524-4d60-8f0e-fbc62c53017d" containerName="sg-core" Mar 16 16:16:28 crc kubenswrapper[5120]: I0316 16:16:28.195645 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e75e15b9-8524-4d60-8f0e-fbc62c53017d" containerName="ceilometer-notification-agent" Mar 16 16:16:28 crc kubenswrapper[5120]: I0316 16:16:28.195652 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e75e15b9-8524-4d60-8f0e-fbc62c53017d" containerName="ceilometer-notification-agent" Mar 16 16:16:28 crc kubenswrapper[5120]: I0316 16:16:28.195665 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e75e15b9-8524-4d60-8f0e-fbc62c53017d" containerName="ceilometer-central-agent" Mar 16 16:16:28 crc kubenswrapper[5120]: I0316 16:16:28.195670 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e75e15b9-8524-4d60-8f0e-fbc62c53017d" containerName="ceilometer-central-agent" Mar 16 16:16:28 crc kubenswrapper[5120]: I0316 16:16:28.195887 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e75e15b9-8524-4d60-8f0e-fbc62c53017d" containerName="proxy-httpd" Mar 16 16:16:28 crc kubenswrapper[5120]: I0316 16:16:28.195906 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e75e15b9-8524-4d60-8f0e-fbc62c53017d" containerName="ceilometer-central-agent" Mar 16 16:16:28 crc kubenswrapper[5120]: I0316 16:16:28.195917 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e75e15b9-8524-4d60-8f0e-fbc62c53017d" containerName="sg-core" Mar 16 16:16:28 crc kubenswrapper[5120]: I0316 16:16:28.195929 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e75e15b9-8524-4d60-8f0e-fbc62c53017d" containerName="ceilometer-notification-agent" Mar 16 16:16:28 crc kubenswrapper[5120]: I0316 16:16:28.204475 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:16:28 crc kubenswrapper[5120]: I0316 16:16:28.206649 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 16:16:28 crc kubenswrapper[5120]: I0316 16:16:28.206853 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 16:16:28 crc kubenswrapper[5120]: I0316 16:16:28.206896 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ceilometer-internal-svc\"" Mar 16 16:16:28 crc kubenswrapper[5120]: I0316 16:16:28.228694 5120 scope.go:117] "RemoveContainer" containerID="17cc20f230aaacbf09567a8e3c1fd76557368efa2c5cc8ef2ef609b247a960ea" Mar 16 16:16:28 crc kubenswrapper[5120]: I0316 16:16:28.230207 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:16:28 crc kubenswrapper[5120]: I0316 16:16:28.263207 5120 scope.go:117] "RemoveContainer" containerID="eef1a25a0cf1e37b068a91b7c0912810dba06eb70e31791fb6786f0323a8cf91" Mar 16 16:16:28 crc kubenswrapper[5120]: E0316 16:16:28.264072 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eef1a25a0cf1e37b068a91b7c0912810dba06eb70e31791fb6786f0323a8cf91\": container with ID starting with eef1a25a0cf1e37b068a91b7c0912810dba06eb70e31791fb6786f0323a8cf91 not found: ID does not exist" containerID="eef1a25a0cf1e37b068a91b7c0912810dba06eb70e31791fb6786f0323a8cf91" Mar 16 16:16:28 crc kubenswrapper[5120]: I0316 16:16:28.264116 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eef1a25a0cf1e37b068a91b7c0912810dba06eb70e31791fb6786f0323a8cf91"} err="failed to get container status \"eef1a25a0cf1e37b068a91b7c0912810dba06eb70e31791fb6786f0323a8cf91\": rpc error: code = NotFound desc = could not find container \"eef1a25a0cf1e37b068a91b7c0912810dba06eb70e31791fb6786f0323a8cf91\": container with ID starting with eef1a25a0cf1e37b068a91b7c0912810dba06eb70e31791fb6786f0323a8cf91 not found: ID does not exist" Mar 16 16:16:28 crc kubenswrapper[5120]: I0316 16:16:28.264332 5120 scope.go:117] "RemoveContainer" containerID="f7120deb045ac2697483dc56cd7f2466a0e674ce0900dcc0f12585477b6fb21b" Mar 16 16:16:28 crc kubenswrapper[5120]: E0316 16:16:28.266239 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f7120deb045ac2697483dc56cd7f2466a0e674ce0900dcc0f12585477b6fb21b\": container with ID starting with f7120deb045ac2697483dc56cd7f2466a0e674ce0900dcc0f12585477b6fb21b not found: ID does not exist" containerID="f7120deb045ac2697483dc56cd7f2466a0e674ce0900dcc0f12585477b6fb21b" Mar 16 16:16:28 crc kubenswrapper[5120]: I0316 16:16:28.266300 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7120deb045ac2697483dc56cd7f2466a0e674ce0900dcc0f12585477b6fb21b"} err="failed to get container status \"f7120deb045ac2697483dc56cd7f2466a0e674ce0900dcc0f12585477b6fb21b\": rpc error: code = NotFound desc = could not find container \"f7120deb045ac2697483dc56cd7f2466a0e674ce0900dcc0f12585477b6fb21b\": container with ID starting with f7120deb045ac2697483dc56cd7f2466a0e674ce0900dcc0f12585477b6fb21b not found: ID does not exist" Mar 16 16:16:28 crc kubenswrapper[5120]: I0316 16:16:28.266316 5120 scope.go:117] "RemoveContainer" containerID="ac58d6522b00bf15e9f2beae73c11d1bef154858476c238e0a1dc17e974e5986" Mar 16 16:16:28 crc kubenswrapper[5120]: E0316 16:16:28.266943 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac58d6522b00bf15e9f2beae73c11d1bef154858476c238e0a1dc17e974e5986\": container with ID starting with ac58d6522b00bf15e9f2beae73c11d1bef154858476c238e0a1dc17e974e5986 not found: ID does not exist" containerID="ac58d6522b00bf15e9f2beae73c11d1bef154858476c238e0a1dc17e974e5986" Mar 16 16:16:28 crc kubenswrapper[5120]: I0316 16:16:28.266966 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac58d6522b00bf15e9f2beae73c11d1bef154858476c238e0a1dc17e974e5986"} err="failed to get container status \"ac58d6522b00bf15e9f2beae73c11d1bef154858476c238e0a1dc17e974e5986\": rpc error: code = NotFound desc = could not find container \"ac58d6522b00bf15e9f2beae73c11d1bef154858476c238e0a1dc17e974e5986\": container with ID starting with ac58d6522b00bf15e9f2beae73c11d1bef154858476c238e0a1dc17e974e5986 not found: ID does not exist" Mar 16 16:16:28 crc kubenswrapper[5120]: I0316 16:16:28.266979 5120 scope.go:117] "RemoveContainer" containerID="17cc20f230aaacbf09567a8e3c1fd76557368efa2c5cc8ef2ef609b247a960ea" Mar 16 16:16:28 crc kubenswrapper[5120]: E0316 16:16:28.268817 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"17cc20f230aaacbf09567a8e3c1fd76557368efa2c5cc8ef2ef609b247a960ea\": container with ID starting with 17cc20f230aaacbf09567a8e3c1fd76557368efa2c5cc8ef2ef609b247a960ea not found: ID does not exist" containerID="17cc20f230aaacbf09567a8e3c1fd76557368efa2c5cc8ef2ef609b247a960ea" Mar 16 16:16:28 crc kubenswrapper[5120]: I0316 16:16:28.268843 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17cc20f230aaacbf09567a8e3c1fd76557368efa2c5cc8ef2ef609b247a960ea"} err="failed to get container status \"17cc20f230aaacbf09567a8e3c1fd76557368efa2c5cc8ef2ef609b247a960ea\": rpc error: code = NotFound desc = could not find container \"17cc20f230aaacbf09567a8e3c1fd76557368efa2c5cc8ef2ef609b247a960ea\": container with ID starting with 17cc20f230aaacbf09567a8e3c1fd76557368efa2c5cc8ef2ef609b247a960ea not found: ID does not exist" Mar 16 16:16:28 crc kubenswrapper[5120]: I0316 16:16:28.285822 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:16:28 crc kubenswrapper[5120]: I0316 16:16:28.286045 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:16:28 crc kubenswrapper[5120]: I0316 16:16:28.329562 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/46db769c-ef7b-4e05-b69c-1483b71e7bad-run-httpd\") pod \"ceilometer-0\" (UID: \"46db769c-ef7b-4e05-b69c-1483b71e7bad\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:16:28 crc kubenswrapper[5120]: I0316 16:16:28.329726 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/46db769c-ef7b-4e05-b69c-1483b71e7bad-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"46db769c-ef7b-4e05-b69c-1483b71e7bad\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:16:28 crc kubenswrapper[5120]: I0316 16:16:28.329862 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xrlb\" (UniqueName: \"kubernetes.io/projected/46db769c-ef7b-4e05-b69c-1483b71e7bad-kube-api-access-6xrlb\") pod \"ceilometer-0\" (UID: \"46db769c-ef7b-4e05-b69c-1483b71e7bad\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:16:28 crc kubenswrapper[5120]: I0316 16:16:28.329904 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/46db769c-ef7b-4e05-b69c-1483b71e7bad-log-httpd\") pod \"ceilometer-0\" (UID: \"46db769c-ef7b-4e05-b69c-1483b71e7bad\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:16:28 crc kubenswrapper[5120]: I0316 16:16:28.329973 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/46db769c-ef7b-4e05-b69c-1483b71e7bad-scripts\") pod \"ceilometer-0\" (UID: \"46db769c-ef7b-4e05-b69c-1483b71e7bad\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:16:28 crc kubenswrapper[5120]: I0316 16:16:28.330056 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/46db769c-ef7b-4e05-b69c-1483b71e7bad-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"46db769c-ef7b-4e05-b69c-1483b71e7bad\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:16:28 crc kubenswrapper[5120]: I0316 16:16:28.330148 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/46db769c-ef7b-4e05-b69c-1483b71e7bad-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"46db769c-ef7b-4e05-b69c-1483b71e7bad\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:16:28 crc kubenswrapper[5120]: I0316 16:16:28.330201 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/46db769c-ef7b-4e05-b69c-1483b71e7bad-config-data\") pod \"ceilometer-0\" (UID: \"46db769c-ef7b-4e05-b69c-1483b71e7bad\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:16:28 crc kubenswrapper[5120]: I0316 16:16:28.432721 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/46db769c-ef7b-4e05-b69c-1483b71e7bad-config-data\") pod \"ceilometer-0\" (UID: \"46db769c-ef7b-4e05-b69c-1483b71e7bad\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:16:28 crc kubenswrapper[5120]: I0316 16:16:28.432813 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/46db769c-ef7b-4e05-b69c-1483b71e7bad-run-httpd\") pod \"ceilometer-0\" (UID: \"46db769c-ef7b-4e05-b69c-1483b71e7bad\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:16:28 crc kubenswrapper[5120]: I0316 16:16:28.432934 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/46db769c-ef7b-4e05-b69c-1483b71e7bad-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"46db769c-ef7b-4e05-b69c-1483b71e7bad\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:16:28 crc kubenswrapper[5120]: I0316 16:16:28.433031 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6xrlb\" (UniqueName: \"kubernetes.io/projected/46db769c-ef7b-4e05-b69c-1483b71e7bad-kube-api-access-6xrlb\") pod \"ceilometer-0\" (UID: \"46db769c-ef7b-4e05-b69c-1483b71e7bad\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:16:28 crc kubenswrapper[5120]: I0316 16:16:28.433073 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/46db769c-ef7b-4e05-b69c-1483b71e7bad-log-httpd\") pod \"ceilometer-0\" (UID: \"46db769c-ef7b-4e05-b69c-1483b71e7bad\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:16:28 crc kubenswrapper[5120]: I0316 16:16:28.433152 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/46db769c-ef7b-4e05-b69c-1483b71e7bad-scripts\") pod \"ceilometer-0\" (UID: \"46db769c-ef7b-4e05-b69c-1483b71e7bad\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:16:28 crc kubenswrapper[5120]: I0316 16:16:28.433247 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/46db769c-ef7b-4e05-b69c-1483b71e7bad-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"46db769c-ef7b-4e05-b69c-1483b71e7bad\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:16:28 crc kubenswrapper[5120]: I0316 16:16:28.433341 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/46db769c-ef7b-4e05-b69c-1483b71e7bad-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"46db769c-ef7b-4e05-b69c-1483b71e7bad\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:16:28 crc kubenswrapper[5120]: I0316 16:16:28.434569 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/46db769c-ef7b-4e05-b69c-1483b71e7bad-log-httpd\") pod \"ceilometer-0\" (UID: \"46db769c-ef7b-4e05-b69c-1483b71e7bad\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:16:28 crc kubenswrapper[5120]: I0316 16:16:28.434880 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/46db769c-ef7b-4e05-b69c-1483b71e7bad-run-httpd\") pod \"ceilometer-0\" (UID: \"46db769c-ef7b-4e05-b69c-1483b71e7bad\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:16:28 crc kubenswrapper[5120]: I0316 16:16:28.438470 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/46db769c-ef7b-4e05-b69c-1483b71e7bad-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"46db769c-ef7b-4e05-b69c-1483b71e7bad\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:16:28 crc kubenswrapper[5120]: I0316 16:16:28.439102 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/46db769c-ef7b-4e05-b69c-1483b71e7bad-config-data\") pod \"ceilometer-0\" (UID: \"46db769c-ef7b-4e05-b69c-1483b71e7bad\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:16:28 crc kubenswrapper[5120]: I0316 16:16:28.440429 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/46db769c-ef7b-4e05-b69c-1483b71e7bad-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"46db769c-ef7b-4e05-b69c-1483b71e7bad\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:16:28 crc kubenswrapper[5120]: I0316 16:16:28.443904 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/46db769c-ef7b-4e05-b69c-1483b71e7bad-scripts\") pod \"ceilometer-0\" (UID: \"46db769c-ef7b-4e05-b69c-1483b71e7bad\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:16:28 crc kubenswrapper[5120]: I0316 16:16:28.449898 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/46db769c-ef7b-4e05-b69c-1483b71e7bad-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"46db769c-ef7b-4e05-b69c-1483b71e7bad\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:16:28 crc kubenswrapper[5120]: I0316 16:16:28.453890 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xrlb\" (UniqueName: \"kubernetes.io/projected/46db769c-ef7b-4e05-b69c-1483b71e7bad-kube-api-access-6xrlb\") pod \"ceilometer-0\" (UID: \"46db769c-ef7b-4e05-b69c-1483b71e7bad\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:16:28 crc kubenswrapper[5120]: I0316 16:16:28.559435 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:16:28 crc kubenswrapper[5120]: I0316 16:16:28.673897 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e75e15b9-8524-4d60-8f0e-fbc62c53017d" path="/var/lib/kubelet/pods/e75e15b9-8524-4d60-8f0e-fbc62c53017d/volumes" Mar 16 16:16:29 crc kubenswrapper[5120]: I0316 16:16:29.004176 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:16:29 crc kubenswrapper[5120]: W0316 16:16:29.009052 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod46db769c_ef7b_4e05_b69c_1483b71e7bad.slice/crio-9e6d697130f6188f6d5de9e3453d43d342db68dc1316b6174f526e6df1652d51 WatchSource:0}: Error finding container 9e6d697130f6188f6d5de9e3453d43d342db68dc1316b6174f526e6df1652d51: Status 404 returned error can't find the container with id 9e6d697130f6188f6d5de9e3453d43d342db68dc1316b6174f526e6df1652d51 Mar 16 16:16:29 crc kubenswrapper[5120]: I0316 16:16:29.113443 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"46db769c-ef7b-4e05-b69c-1483b71e7bad","Type":"ContainerStarted","Data":"9e6d697130f6188f6d5de9e3453d43d342db68dc1316b6174f526e6df1652d51"} Mar 16 16:16:29 crc kubenswrapper[5120]: I0316 16:16:29.290931 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="3555721d-1bee-4d75-9cc0-91d87be1fb23" containerName="nova-metadata-log" probeResult="failure" output="Get \"https://10.217.1.7:8775/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Mar 16 16:16:29 crc kubenswrapper[5120]: I0316 16:16:29.294037 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="3555721d-1bee-4d75-9cc0-91d87be1fb23" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"https://10.217.1.7:8775/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Mar 16 16:16:29 crc kubenswrapper[5120]: I0316 16:16:29.694547 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:16:30 crc kubenswrapper[5120]: I0316 16:16:30.127121 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"46db769c-ef7b-4e05-b69c-1483b71e7bad","Type":"ContainerStarted","Data":"d779bd16d2467008fd0f078e50a0d3e4a6d8293f3a7bcc3ab5d43f1085a0a6b1"} Mar 16 16:16:31 crc kubenswrapper[5120]: I0316 16:16:31.140388 5120 generic.go:358] "Generic (PLEG): container finished" podID="08bb98cb-efd9-409e-b1bf-760159c5460c" containerID="5850cdaacaa2728289ea6d253949dda18d2b7ab63a5336423e60e4a606603ca7" exitCode=0 Mar 16 16:16:31 crc kubenswrapper[5120]: I0316 16:16:31.140441 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-ghlgl" event={"ID":"08bb98cb-efd9-409e-b1bf-760159c5460c","Type":"ContainerDied","Data":"5850cdaacaa2728289ea6d253949dda18d2b7ab63a5336423e60e4a606603ca7"} Mar 16 16:16:31 crc kubenswrapper[5120]: I0316 16:16:31.146335 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"46db769c-ef7b-4e05-b69c-1483b71e7bad","Type":"ContainerStarted","Data":"b4901eaab9aa6b825c271f8a83ab766c1d744bc325f732147aa91286293f1608"} Mar 16 16:16:32 crc kubenswrapper[5120]: I0316 16:16:32.159751 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"46db769c-ef7b-4e05-b69c-1483b71e7bad","Type":"ContainerStarted","Data":"38e9a6e9a8f81b104e6b4d2b574eb5f16d8cef988bd368bfe27c72ceb77d5683"} Mar 16 16:16:32 crc kubenswrapper[5120]: I0316 16:16:32.582487 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-ghlgl" Mar 16 16:16:32 crc kubenswrapper[5120]: I0316 16:16:32.641247 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/08bb98cb-efd9-409e-b1bf-760159c5460c-scripts\") pod \"08bb98cb-efd9-409e-b1bf-760159c5460c\" (UID: \"08bb98cb-efd9-409e-b1bf-760159c5460c\") " Mar 16 16:16:32 crc kubenswrapper[5120]: I0316 16:16:32.641414 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/08bb98cb-efd9-409e-b1bf-760159c5460c-combined-ca-bundle\") pod \"08bb98cb-efd9-409e-b1bf-760159c5460c\" (UID: \"08bb98cb-efd9-409e-b1bf-760159c5460c\") " Mar 16 16:16:32 crc kubenswrapper[5120]: I0316 16:16:32.641563 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/08bb98cb-efd9-409e-b1bf-760159c5460c-config-data\") pod \"08bb98cb-efd9-409e-b1bf-760159c5460c\" (UID: \"08bb98cb-efd9-409e-b1bf-760159c5460c\") " Mar 16 16:16:32 crc kubenswrapper[5120]: I0316 16:16:32.641690 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g82p5\" (UniqueName: \"kubernetes.io/projected/08bb98cb-efd9-409e-b1bf-760159c5460c-kube-api-access-g82p5\") pod \"08bb98cb-efd9-409e-b1bf-760159c5460c\" (UID: \"08bb98cb-efd9-409e-b1bf-760159c5460c\") " Mar 16 16:16:32 crc kubenswrapper[5120]: I0316 16:16:32.652603 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/08bb98cb-efd9-409e-b1bf-760159c5460c-scripts" (OuterVolumeSpecName: "scripts") pod "08bb98cb-efd9-409e-b1bf-760159c5460c" (UID: "08bb98cb-efd9-409e-b1bf-760159c5460c"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:16:32 crc kubenswrapper[5120]: I0316 16:16:32.654466 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08bb98cb-efd9-409e-b1bf-760159c5460c-kube-api-access-g82p5" (OuterVolumeSpecName: "kube-api-access-g82p5") pod "08bb98cb-efd9-409e-b1bf-760159c5460c" (UID: "08bb98cb-efd9-409e-b1bf-760159c5460c"). InnerVolumeSpecName "kube-api-access-g82p5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:16:32 crc kubenswrapper[5120]: I0316 16:16:32.676185 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/08bb98cb-efd9-409e-b1bf-760159c5460c-config-data" (OuterVolumeSpecName: "config-data") pod "08bb98cb-efd9-409e-b1bf-760159c5460c" (UID: "08bb98cb-efd9-409e-b1bf-760159c5460c"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:16:32 crc kubenswrapper[5120]: I0316 16:16:32.692876 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/08bb98cb-efd9-409e-b1bf-760159c5460c-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "08bb98cb-efd9-409e-b1bf-760159c5460c" (UID: "08bb98cb-efd9-409e-b1bf-760159c5460c"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:16:32 crc kubenswrapper[5120]: I0316 16:16:32.744841 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/08bb98cb-efd9-409e-b1bf-760159c5460c-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:16:32 crc kubenswrapper[5120]: I0316 16:16:32.744880 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g82p5\" (UniqueName: \"kubernetes.io/projected/08bb98cb-efd9-409e-b1bf-760159c5460c-kube-api-access-g82p5\") on node \"crc\" DevicePath \"\"" Mar 16 16:16:32 crc kubenswrapper[5120]: I0316 16:16:32.744893 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/08bb98cb-efd9-409e-b1bf-760159c5460c-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:16:32 crc kubenswrapper[5120]: I0316 16:16:32.744906 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/08bb98cb-efd9-409e-b1bf-760159c5460c-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:16:33 crc kubenswrapper[5120]: I0316 16:16:33.173376 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-ghlgl" Mar 16 16:16:33 crc kubenswrapper[5120]: I0316 16:16:33.173372 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-ghlgl" event={"ID":"08bb98cb-efd9-409e-b1bf-760159c5460c","Type":"ContainerDied","Data":"aa03a838927a1994e043d91e0d92c7c3218a8f911897f703c53044b2b6a809f9"} Mar 16 16:16:33 crc kubenswrapper[5120]: I0316 16:16:33.173545 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="aa03a838927a1994e043d91e0d92c7c3218a8f911897f703c53044b2b6a809f9" Mar 16 16:16:33 crc kubenswrapper[5120]: I0316 16:16:33.470839 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:16:33 crc kubenswrapper[5120]: I0316 16:16:33.471676 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="16a01d7c-c746-4436-bd54-f00c0af8abfe" containerName="nova-api-log" containerID="cri-o://b6a80c590728c274157887c814a57a7db404433e10f7f7835675160252124708" gracePeriod=30 Mar 16 16:16:33 crc kubenswrapper[5120]: I0316 16:16:33.472026 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="16a01d7c-c746-4436-bd54-f00c0af8abfe" containerName="nova-api-api" containerID="cri-o://e112ee7c79ecb17707fc95314ac70b6869e37bd08c64037e7be00e2a695c8429" gracePeriod=30 Mar 16 16:16:33 crc kubenswrapper[5120]: I0316 16:16:33.518751 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:16:33 crc kubenswrapper[5120]: I0316 16:16:33.519073 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="c0716e29-22dd-442d-b52e-b21f627de899" containerName="nova-scheduler-scheduler" containerID="cri-o://b740409ac34c52375a2495ededfe8c61b61436c3881a613fe774f4903cfe3a06" gracePeriod=30 Mar 16 16:16:33 crc kubenswrapper[5120]: I0316 16:16:33.543294 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:16:33 crc kubenswrapper[5120]: I0316 16:16:33.543533 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="3555721d-1bee-4d75-9cc0-91d87be1fb23" containerName="nova-metadata-log" containerID="cri-o://91f7dd868888c206b12f206956b254cab2eb873c8c44272df32e83eea22a5ba8" gracePeriod=30 Mar 16 16:16:33 crc kubenswrapper[5120]: I0316 16:16:33.544095 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="3555721d-1bee-4d75-9cc0-91d87be1fb23" containerName="nova-metadata-metadata" containerID="cri-o://714d752a003dc482162279ded9ade8ecaf909c2597f2de062e9aa760bc59f588" gracePeriod=30 Mar 16 16:16:34 crc kubenswrapper[5120]: I0316 16:16:34.024746 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:16:34 crc kubenswrapper[5120]: I0316 16:16:34.088921 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hwjqd\" (UniqueName: \"kubernetes.io/projected/16a01d7c-c746-4436-bd54-f00c0af8abfe-kube-api-access-hwjqd\") pod \"16a01d7c-c746-4436-bd54-f00c0af8abfe\" (UID: \"16a01d7c-c746-4436-bd54-f00c0af8abfe\") " Mar 16 16:16:34 crc kubenswrapper[5120]: I0316 16:16:34.088961 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/16a01d7c-c746-4436-bd54-f00c0af8abfe-combined-ca-bundle\") pod \"16a01d7c-c746-4436-bd54-f00c0af8abfe\" (UID: \"16a01d7c-c746-4436-bd54-f00c0af8abfe\") " Mar 16 16:16:34 crc kubenswrapper[5120]: I0316 16:16:34.089008 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/16a01d7c-c746-4436-bd54-f00c0af8abfe-config-data\") pod \"16a01d7c-c746-4436-bd54-f00c0af8abfe\" (UID: \"16a01d7c-c746-4436-bd54-f00c0af8abfe\") " Mar 16 16:16:34 crc kubenswrapper[5120]: I0316 16:16:34.089036 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/16a01d7c-c746-4436-bd54-f00c0af8abfe-logs\") pod \"16a01d7c-c746-4436-bd54-f00c0af8abfe\" (UID: \"16a01d7c-c746-4436-bd54-f00c0af8abfe\") " Mar 16 16:16:34 crc kubenswrapper[5120]: I0316 16:16:34.089613 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16a01d7c-c746-4436-bd54-f00c0af8abfe-logs" (OuterVolumeSpecName: "logs") pod "16a01d7c-c746-4436-bd54-f00c0af8abfe" (UID: "16a01d7c-c746-4436-bd54-f00c0af8abfe"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:16:34 crc kubenswrapper[5120]: I0316 16:16:34.095181 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16a01d7c-c746-4436-bd54-f00c0af8abfe-kube-api-access-hwjqd" (OuterVolumeSpecName: "kube-api-access-hwjqd") pod "16a01d7c-c746-4436-bd54-f00c0af8abfe" (UID: "16a01d7c-c746-4436-bd54-f00c0af8abfe"). InnerVolumeSpecName "kube-api-access-hwjqd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:16:34 crc kubenswrapper[5120]: I0316 16:16:34.122861 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/16a01d7c-c746-4436-bd54-f00c0af8abfe-config-data" (OuterVolumeSpecName: "config-data") pod "16a01d7c-c746-4436-bd54-f00c0af8abfe" (UID: "16a01d7c-c746-4436-bd54-f00c0af8abfe"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:16:34 crc kubenswrapper[5120]: I0316 16:16:34.126034 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/16a01d7c-c746-4436-bd54-f00c0af8abfe-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "16a01d7c-c746-4436-bd54-f00c0af8abfe" (UID: "16a01d7c-c746-4436-bd54-f00c0af8abfe"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:16:34 crc kubenswrapper[5120]: I0316 16:16:34.183975 5120 generic.go:358] "Generic (PLEG): container finished" podID="16a01d7c-c746-4436-bd54-f00c0af8abfe" containerID="e112ee7c79ecb17707fc95314ac70b6869e37bd08c64037e7be00e2a695c8429" exitCode=0 Mar 16 16:16:34 crc kubenswrapper[5120]: I0316 16:16:34.184006 5120 generic.go:358] "Generic (PLEG): container finished" podID="16a01d7c-c746-4436-bd54-f00c0af8abfe" containerID="b6a80c590728c274157887c814a57a7db404433e10f7f7835675160252124708" exitCode=143 Mar 16 16:16:34 crc kubenswrapper[5120]: I0316 16:16:34.184089 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"16a01d7c-c746-4436-bd54-f00c0af8abfe","Type":"ContainerDied","Data":"e112ee7c79ecb17707fc95314ac70b6869e37bd08c64037e7be00e2a695c8429"} Mar 16 16:16:34 crc kubenswrapper[5120]: I0316 16:16:34.184116 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"16a01d7c-c746-4436-bd54-f00c0af8abfe","Type":"ContainerDied","Data":"b6a80c590728c274157887c814a57a7db404433e10f7f7835675160252124708"} Mar 16 16:16:34 crc kubenswrapper[5120]: I0316 16:16:34.184126 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"16a01d7c-c746-4436-bd54-f00c0af8abfe","Type":"ContainerDied","Data":"e376b5adc4614e280ad5c37031edf5d7b97cdf0e5e50f342de321f74cd0b1bff"} Mar 16 16:16:34 crc kubenswrapper[5120]: I0316 16:16:34.184141 5120 scope.go:117] "RemoveContainer" containerID="e112ee7c79ecb17707fc95314ac70b6869e37bd08c64037e7be00e2a695c8429" Mar 16 16:16:34 crc kubenswrapper[5120]: I0316 16:16:34.184286 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:16:34 crc kubenswrapper[5120]: I0316 16:16:34.188639 5120 generic.go:358] "Generic (PLEG): container finished" podID="3555721d-1bee-4d75-9cc0-91d87be1fb23" containerID="91f7dd868888c206b12f206956b254cab2eb873c8c44272df32e83eea22a5ba8" exitCode=143 Mar 16 16:16:34 crc kubenswrapper[5120]: I0316 16:16:34.188825 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"3555721d-1bee-4d75-9cc0-91d87be1fb23","Type":"ContainerDied","Data":"91f7dd868888c206b12f206956b254cab2eb873c8c44272df32e83eea22a5ba8"} Mar 16 16:16:34 crc kubenswrapper[5120]: I0316 16:16:34.191617 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/16a01d7c-c746-4436-bd54-f00c0af8abfe-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:16:34 crc kubenswrapper[5120]: I0316 16:16:34.191638 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/16a01d7c-c746-4436-bd54-f00c0af8abfe-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:16:34 crc kubenswrapper[5120]: I0316 16:16:34.191650 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/16a01d7c-c746-4436-bd54-f00c0af8abfe-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:16:34 crc kubenswrapper[5120]: I0316 16:16:34.191661 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hwjqd\" (UniqueName: \"kubernetes.io/projected/16a01d7c-c746-4436-bd54-f00c0af8abfe-kube-api-access-hwjqd\") on node \"crc\" DevicePath \"\"" Mar 16 16:16:34 crc kubenswrapper[5120]: I0316 16:16:34.199339 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"46db769c-ef7b-4e05-b69c-1483b71e7bad","Type":"ContainerStarted","Data":"93cd1ebf0ea416dc9c015eb668e91ab0baeb461fe15396fa4d1b9d76f5fe2eb4"} Mar 16 16:16:34 crc kubenswrapper[5120]: I0316 16:16:34.200599 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:16:34 crc kubenswrapper[5120]: I0316 16:16:34.215222 5120 scope.go:117] "RemoveContainer" containerID="b6a80c590728c274157887c814a57a7db404433e10f7f7835675160252124708" Mar 16 16:16:34 crc kubenswrapper[5120]: I0316 16:16:34.222779 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.110544613 podStartE2EDuration="6.22274529s" podCreationTimestamp="2026-03-16 16:16:28 +0000 UTC" firstStartedPulling="2026-03-16 16:16:29.010986844 +0000 UTC m=+2691.164918491" lastFinishedPulling="2026-03-16 16:16:33.123187521 +0000 UTC m=+2695.277119168" observedRunningTime="2026-03-16 16:16:34.221467986 +0000 UTC m=+2696.375399643" watchObservedRunningTime="2026-03-16 16:16:34.22274529 +0000 UTC m=+2696.376676947" Mar 16 16:16:34 crc kubenswrapper[5120]: I0316 16:16:34.240480 5120 scope.go:117] "RemoveContainer" containerID="e112ee7c79ecb17707fc95314ac70b6869e37bd08c64037e7be00e2a695c8429" Mar 16 16:16:34 crc kubenswrapper[5120]: E0316 16:16:34.240896 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e112ee7c79ecb17707fc95314ac70b6869e37bd08c64037e7be00e2a695c8429\": container with ID starting with e112ee7c79ecb17707fc95314ac70b6869e37bd08c64037e7be00e2a695c8429 not found: ID does not exist" containerID="e112ee7c79ecb17707fc95314ac70b6869e37bd08c64037e7be00e2a695c8429" Mar 16 16:16:34 crc kubenswrapper[5120]: I0316 16:16:34.241049 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e112ee7c79ecb17707fc95314ac70b6869e37bd08c64037e7be00e2a695c8429"} err="failed to get container status \"e112ee7c79ecb17707fc95314ac70b6869e37bd08c64037e7be00e2a695c8429\": rpc error: code = NotFound desc = could not find container \"e112ee7c79ecb17707fc95314ac70b6869e37bd08c64037e7be00e2a695c8429\": container with ID starting with e112ee7c79ecb17707fc95314ac70b6869e37bd08c64037e7be00e2a695c8429 not found: ID does not exist" Mar 16 16:16:34 crc kubenswrapper[5120]: I0316 16:16:34.241072 5120 scope.go:117] "RemoveContainer" containerID="b6a80c590728c274157887c814a57a7db404433e10f7f7835675160252124708" Mar 16 16:16:34 crc kubenswrapper[5120]: E0316 16:16:34.241370 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b6a80c590728c274157887c814a57a7db404433e10f7f7835675160252124708\": container with ID starting with b6a80c590728c274157887c814a57a7db404433e10f7f7835675160252124708 not found: ID does not exist" containerID="b6a80c590728c274157887c814a57a7db404433e10f7f7835675160252124708" Mar 16 16:16:34 crc kubenswrapper[5120]: I0316 16:16:34.241421 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6a80c590728c274157887c814a57a7db404433e10f7f7835675160252124708"} err="failed to get container status \"b6a80c590728c274157887c814a57a7db404433e10f7f7835675160252124708\": rpc error: code = NotFound desc = could not find container \"b6a80c590728c274157887c814a57a7db404433e10f7f7835675160252124708\": container with ID starting with b6a80c590728c274157887c814a57a7db404433e10f7f7835675160252124708 not found: ID does not exist" Mar 16 16:16:34 crc kubenswrapper[5120]: I0316 16:16:34.241449 5120 scope.go:117] "RemoveContainer" containerID="e112ee7c79ecb17707fc95314ac70b6869e37bd08c64037e7be00e2a695c8429" Mar 16 16:16:34 crc kubenswrapper[5120]: I0316 16:16:34.241711 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e112ee7c79ecb17707fc95314ac70b6869e37bd08c64037e7be00e2a695c8429"} err="failed to get container status \"e112ee7c79ecb17707fc95314ac70b6869e37bd08c64037e7be00e2a695c8429\": rpc error: code = NotFound desc = could not find container \"e112ee7c79ecb17707fc95314ac70b6869e37bd08c64037e7be00e2a695c8429\": container with ID starting with e112ee7c79ecb17707fc95314ac70b6869e37bd08c64037e7be00e2a695c8429 not found: ID does not exist" Mar 16 16:16:34 crc kubenswrapper[5120]: I0316 16:16:34.241839 5120 scope.go:117] "RemoveContainer" containerID="b6a80c590728c274157887c814a57a7db404433e10f7f7835675160252124708" Mar 16 16:16:34 crc kubenswrapper[5120]: I0316 16:16:34.242241 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6a80c590728c274157887c814a57a7db404433e10f7f7835675160252124708"} err="failed to get container status \"b6a80c590728c274157887c814a57a7db404433e10f7f7835675160252124708\": rpc error: code = NotFound desc = could not find container \"b6a80c590728c274157887c814a57a7db404433e10f7f7835675160252124708\": container with ID starting with b6a80c590728c274157887c814a57a7db404433e10f7f7835675160252124708 not found: ID does not exist" Mar 16 16:16:34 crc kubenswrapper[5120]: I0316 16:16:34.256284 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:16:34 crc kubenswrapper[5120]: I0316 16:16:34.271118 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:16:34 crc kubenswrapper[5120]: I0316 16:16:34.285396 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:16:34 crc kubenswrapper[5120]: I0316 16:16:34.286777 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08bb98cb-efd9-409e-b1bf-760159c5460c" containerName="nova-manage" Mar 16 16:16:34 crc kubenswrapper[5120]: I0316 16:16:34.286801 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="08bb98cb-efd9-409e-b1bf-760159c5460c" containerName="nova-manage" Mar 16 16:16:34 crc kubenswrapper[5120]: I0316 16:16:34.286877 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16a01d7c-c746-4436-bd54-f00c0af8abfe" containerName="nova-api-log" Mar 16 16:16:34 crc kubenswrapper[5120]: I0316 16:16:34.286887 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="16a01d7c-c746-4436-bd54-f00c0af8abfe" containerName="nova-api-log" Mar 16 16:16:34 crc kubenswrapper[5120]: I0316 16:16:34.286903 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16a01d7c-c746-4436-bd54-f00c0af8abfe" containerName="nova-api-api" Mar 16 16:16:34 crc kubenswrapper[5120]: I0316 16:16:34.286914 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="16a01d7c-c746-4436-bd54-f00c0af8abfe" containerName="nova-api-api" Mar 16 16:16:34 crc kubenswrapper[5120]: I0316 16:16:34.287142 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="16a01d7c-c746-4436-bd54-f00c0af8abfe" containerName="nova-api-log" Mar 16 16:16:34 crc kubenswrapper[5120]: I0316 16:16:34.287175 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="16a01d7c-c746-4436-bd54-f00c0af8abfe" containerName="nova-api-api" Mar 16 16:16:34 crc kubenswrapper[5120]: I0316 16:16:34.287190 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="08bb98cb-efd9-409e-b1bf-760159c5460c" containerName="nova-manage" Mar 16 16:16:34 crc kubenswrapper[5120]: I0316 16:16:34.297425 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:16:34 crc kubenswrapper[5120]: I0316 16:16:34.297539 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:16:34 crc kubenswrapper[5120]: I0316 16:16:34.300781 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-config-data\"" Mar 16 16:16:34 crc kubenswrapper[5120]: I0316 16:16:34.395538 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfrlb\" (UniqueName: \"kubernetes.io/projected/be20213e-52c5-4771-82b6-56878e525cc5-kube-api-access-lfrlb\") pod \"nova-api-0\" (UID: \"be20213e-52c5-4771-82b6-56878e525cc5\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:16:34 crc kubenswrapper[5120]: I0316 16:16:34.395737 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/be20213e-52c5-4771-82b6-56878e525cc5-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"be20213e-52c5-4771-82b6-56878e525cc5\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:16:34 crc kubenswrapper[5120]: I0316 16:16:34.396029 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/be20213e-52c5-4771-82b6-56878e525cc5-config-data\") pod \"nova-api-0\" (UID: \"be20213e-52c5-4771-82b6-56878e525cc5\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:16:34 crc kubenswrapper[5120]: I0316 16:16:34.396166 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/be20213e-52c5-4771-82b6-56878e525cc5-logs\") pod \"nova-api-0\" (UID: \"be20213e-52c5-4771-82b6-56878e525cc5\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:16:34 crc kubenswrapper[5120]: I0316 16:16:34.497986 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/be20213e-52c5-4771-82b6-56878e525cc5-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"be20213e-52c5-4771-82b6-56878e525cc5\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:16:34 crc kubenswrapper[5120]: I0316 16:16:34.498087 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/be20213e-52c5-4771-82b6-56878e525cc5-config-data\") pod \"nova-api-0\" (UID: \"be20213e-52c5-4771-82b6-56878e525cc5\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:16:34 crc kubenswrapper[5120]: I0316 16:16:34.498138 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/be20213e-52c5-4771-82b6-56878e525cc5-logs\") pod \"nova-api-0\" (UID: \"be20213e-52c5-4771-82b6-56878e525cc5\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:16:34 crc kubenswrapper[5120]: I0316 16:16:34.498401 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lfrlb\" (UniqueName: \"kubernetes.io/projected/be20213e-52c5-4771-82b6-56878e525cc5-kube-api-access-lfrlb\") pod \"nova-api-0\" (UID: \"be20213e-52c5-4771-82b6-56878e525cc5\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:16:34 crc kubenswrapper[5120]: I0316 16:16:34.498917 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/be20213e-52c5-4771-82b6-56878e525cc5-logs\") pod \"nova-api-0\" (UID: \"be20213e-52c5-4771-82b6-56878e525cc5\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:16:34 crc kubenswrapper[5120]: I0316 16:16:34.503449 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/be20213e-52c5-4771-82b6-56878e525cc5-config-data\") pod \"nova-api-0\" (UID: \"be20213e-52c5-4771-82b6-56878e525cc5\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:16:34 crc kubenswrapper[5120]: I0316 16:16:34.504486 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/be20213e-52c5-4771-82b6-56878e525cc5-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"be20213e-52c5-4771-82b6-56878e525cc5\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:16:34 crc kubenswrapper[5120]: I0316 16:16:34.514613 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfrlb\" (UniqueName: \"kubernetes.io/projected/be20213e-52c5-4771-82b6-56878e525cc5-kube-api-access-lfrlb\") pod \"nova-api-0\" (UID: \"be20213e-52c5-4771-82b6-56878e525cc5\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:16:34 crc kubenswrapper[5120]: I0316 16:16:34.618128 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:16:34 crc kubenswrapper[5120]: I0316 16:16:34.681678 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="16a01d7c-c746-4436-bd54-f00c0af8abfe" path="/var/lib/kubelet/pods/16a01d7c-c746-4436-bd54-f00c0af8abfe/volumes" Mar 16 16:16:35 crc kubenswrapper[5120]: W0316 16:16:35.094725 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbe20213e_52c5_4771_82b6_56878e525cc5.slice/crio-2d0696ca48f6eb8581c3fc910da1c764eeee5f922d71139e60bfc73fbfe2f083 WatchSource:0}: Error finding container 2d0696ca48f6eb8581c3fc910da1c764eeee5f922d71139e60bfc73fbfe2f083: Status 404 returned error can't find the container with id 2d0696ca48f6eb8581c3fc910da1c764eeee5f922d71139e60bfc73fbfe2f083 Mar 16 16:16:35 crc kubenswrapper[5120]: I0316 16:16:35.096797 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:16:35 crc kubenswrapper[5120]: I0316 16:16:35.212519 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"be20213e-52c5-4771-82b6-56878e525cc5","Type":"ContainerStarted","Data":"2d0696ca48f6eb8581c3fc910da1c764eeee5f922d71139e60bfc73fbfe2f083"} Mar 16 16:16:36 crc kubenswrapper[5120]: I0316 16:16:36.235258 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"be20213e-52c5-4771-82b6-56878e525cc5","Type":"ContainerStarted","Data":"c7733de8b9f8de19f9755e04ae675c4a5edd99da05bf7430e130caab616667a3"} Mar 16 16:16:36 crc kubenswrapper[5120]: I0316 16:16:36.235322 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"be20213e-52c5-4771-82b6-56878e525cc5","Type":"ContainerStarted","Data":"5057377e4901bf855cfe9e8e8561e877e6549591a414a40b76cc5c25839e76e9"} Mar 16 16:16:36 crc kubenswrapper[5120]: I0316 16:16:36.253886 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=2.2538667439999998 podStartE2EDuration="2.253866744s" podCreationTimestamp="2026-03-16 16:16:34 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:16:36.253227647 +0000 UTC m=+2698.407159344" watchObservedRunningTime="2026-03-16 16:16:36.253866744 +0000 UTC m=+2698.407798421" Mar 16 16:16:36 crc kubenswrapper[5120]: I0316 16:16:36.286395 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:16:36 crc kubenswrapper[5120]: I0316 16:16:36.286471 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:16:37 crc kubenswrapper[5120]: I0316 16:16:37.012016 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:16:37 crc kubenswrapper[5120]: I0316 16:16:37.125642 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:16:37 crc kubenswrapper[5120]: I0316 16:16:37.192342 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c0716e29-22dd-442d-b52e-b21f627de899-config-data\") pod \"c0716e29-22dd-442d-b52e-b21f627de899\" (UID: \"c0716e29-22dd-442d-b52e-b21f627de899\") " Mar 16 16:16:37 crc kubenswrapper[5120]: I0316 16:16:37.192424 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c0716e29-22dd-442d-b52e-b21f627de899-combined-ca-bundle\") pod \"c0716e29-22dd-442d-b52e-b21f627de899\" (UID: \"c0716e29-22dd-442d-b52e-b21f627de899\") " Mar 16 16:16:37 crc kubenswrapper[5120]: I0316 16:16:37.192483 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mccdj\" (UniqueName: \"kubernetes.io/projected/c0716e29-22dd-442d-b52e-b21f627de899-kube-api-access-mccdj\") pod \"c0716e29-22dd-442d-b52e-b21f627de899\" (UID: \"c0716e29-22dd-442d-b52e-b21f627de899\") " Mar 16 16:16:37 crc kubenswrapper[5120]: I0316 16:16:37.199959 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0716e29-22dd-442d-b52e-b21f627de899-kube-api-access-mccdj" (OuterVolumeSpecName: "kube-api-access-mccdj") pod "c0716e29-22dd-442d-b52e-b21f627de899" (UID: "c0716e29-22dd-442d-b52e-b21f627de899"). InnerVolumeSpecName "kube-api-access-mccdj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:16:37 crc kubenswrapper[5120]: I0316 16:16:37.219649 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c0716e29-22dd-442d-b52e-b21f627de899-config-data" (OuterVolumeSpecName: "config-data") pod "c0716e29-22dd-442d-b52e-b21f627de899" (UID: "c0716e29-22dd-442d-b52e-b21f627de899"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:16:37 crc kubenswrapper[5120]: I0316 16:16:37.222237 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c0716e29-22dd-442d-b52e-b21f627de899-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "c0716e29-22dd-442d-b52e-b21f627de899" (UID: "c0716e29-22dd-442d-b52e-b21f627de899"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:16:37 crc kubenswrapper[5120]: I0316 16:16:37.245010 5120 generic.go:358] "Generic (PLEG): container finished" podID="3555721d-1bee-4d75-9cc0-91d87be1fb23" containerID="714d752a003dc482162279ded9ade8ecaf909c2597f2de062e9aa760bc59f588" exitCode=0 Mar 16 16:16:37 crc kubenswrapper[5120]: I0316 16:16:37.245043 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"3555721d-1bee-4d75-9cc0-91d87be1fb23","Type":"ContainerDied","Data":"714d752a003dc482162279ded9ade8ecaf909c2597f2de062e9aa760bc59f588"} Mar 16 16:16:37 crc kubenswrapper[5120]: I0316 16:16:37.245093 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"3555721d-1bee-4d75-9cc0-91d87be1fb23","Type":"ContainerDied","Data":"cb3e0bd56db08699d5e8e2e61ac2deb7fa86c31c75fa30cdb296e4f001775415"} Mar 16 16:16:37 crc kubenswrapper[5120]: I0316 16:16:37.245097 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:16:37 crc kubenswrapper[5120]: I0316 16:16:37.245110 5120 scope.go:117] "RemoveContainer" containerID="714d752a003dc482162279ded9ade8ecaf909c2597f2de062e9aa760bc59f588" Mar 16 16:16:37 crc kubenswrapper[5120]: I0316 16:16:37.248057 5120 generic.go:358] "Generic (PLEG): container finished" podID="c0716e29-22dd-442d-b52e-b21f627de899" containerID="b740409ac34c52375a2495ededfe8c61b61436c3881a613fe774f4903cfe3a06" exitCode=0 Mar 16 16:16:37 crc kubenswrapper[5120]: I0316 16:16:37.248344 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:16:37 crc kubenswrapper[5120]: I0316 16:16:37.248387 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"c0716e29-22dd-442d-b52e-b21f627de899","Type":"ContainerDied","Data":"b740409ac34c52375a2495ededfe8c61b61436c3881a613fe774f4903cfe3a06"} Mar 16 16:16:37 crc kubenswrapper[5120]: I0316 16:16:37.248410 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"c0716e29-22dd-442d-b52e-b21f627de899","Type":"ContainerDied","Data":"01b43998ff169bbd8da411390902ef41d15ee0690d423c3bdbb6fd713ff61d50"} Mar 16 16:16:37 crc kubenswrapper[5120]: I0316 16:16:37.284157 5120 scope.go:117] "RemoveContainer" containerID="91f7dd868888c206b12f206956b254cab2eb873c8c44272df32e83eea22a5ba8" Mar 16 16:16:37 crc kubenswrapper[5120]: I0316 16:16:37.285145 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:16:37 crc kubenswrapper[5120]: I0316 16:16:37.296913 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/3555721d-1bee-4d75-9cc0-91d87be1fb23-nova-metadata-tls-certs\") pod \"3555721d-1bee-4d75-9cc0-91d87be1fb23\" (UID: \"3555721d-1bee-4d75-9cc0-91d87be1fb23\") " Mar 16 16:16:37 crc kubenswrapper[5120]: I0316 16:16:37.297603 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3555721d-1bee-4d75-9cc0-91d87be1fb23-logs\") pod \"3555721d-1bee-4d75-9cc0-91d87be1fb23\" (UID: \"3555721d-1bee-4d75-9cc0-91d87be1fb23\") " Mar 16 16:16:37 crc kubenswrapper[5120]: I0316 16:16:37.297702 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3555721d-1bee-4d75-9cc0-91d87be1fb23-config-data\") pod \"3555721d-1bee-4d75-9cc0-91d87be1fb23\" (UID: \"3555721d-1bee-4d75-9cc0-91d87be1fb23\") " Mar 16 16:16:37 crc kubenswrapper[5120]: I0316 16:16:37.298305 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3555721d-1bee-4d75-9cc0-91d87be1fb23-combined-ca-bundle\") pod \"3555721d-1bee-4d75-9cc0-91d87be1fb23\" (UID: \"3555721d-1bee-4d75-9cc0-91d87be1fb23\") " Mar 16 16:16:37 crc kubenswrapper[5120]: I0316 16:16:37.298441 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7jsb5\" (UniqueName: \"kubernetes.io/projected/3555721d-1bee-4d75-9cc0-91d87be1fb23-kube-api-access-7jsb5\") pod \"3555721d-1bee-4d75-9cc0-91d87be1fb23\" (UID: \"3555721d-1bee-4d75-9cc0-91d87be1fb23\") " Mar 16 16:16:37 crc kubenswrapper[5120]: I0316 16:16:37.299640 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c0716e29-22dd-442d-b52e-b21f627de899-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:16:37 crc kubenswrapper[5120]: I0316 16:16:37.299679 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c0716e29-22dd-442d-b52e-b21f627de899-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:16:37 crc kubenswrapper[5120]: I0316 16:16:37.299700 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mccdj\" (UniqueName: \"kubernetes.io/projected/c0716e29-22dd-442d-b52e-b21f627de899-kube-api-access-mccdj\") on node \"crc\" DevicePath \"\"" Mar 16 16:16:37 crc kubenswrapper[5120]: I0316 16:16:37.300239 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3555721d-1bee-4d75-9cc0-91d87be1fb23-logs" (OuterVolumeSpecName: "logs") pod "3555721d-1bee-4d75-9cc0-91d87be1fb23" (UID: "3555721d-1bee-4d75-9cc0-91d87be1fb23"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:16:37 crc kubenswrapper[5120]: I0316 16:16:37.300450 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:16:37 crc kubenswrapper[5120]: I0316 16:16:37.316967 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:16:37 crc kubenswrapper[5120]: I0316 16:16:37.317847 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3555721d-1bee-4d75-9cc0-91d87be1fb23-kube-api-access-7jsb5" (OuterVolumeSpecName: "kube-api-access-7jsb5") pod "3555721d-1bee-4d75-9cc0-91d87be1fb23" (UID: "3555721d-1bee-4d75-9cc0-91d87be1fb23"). InnerVolumeSpecName "kube-api-access-7jsb5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:16:37 crc kubenswrapper[5120]: I0316 16:16:37.318901 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3555721d-1bee-4d75-9cc0-91d87be1fb23" containerName="nova-metadata-metadata" Mar 16 16:16:37 crc kubenswrapper[5120]: I0316 16:16:37.318933 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="3555721d-1bee-4d75-9cc0-91d87be1fb23" containerName="nova-metadata-metadata" Mar 16 16:16:37 crc kubenswrapper[5120]: I0316 16:16:37.318961 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3555721d-1bee-4d75-9cc0-91d87be1fb23" containerName="nova-metadata-log" Mar 16 16:16:37 crc kubenswrapper[5120]: I0316 16:16:37.318971 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="3555721d-1bee-4d75-9cc0-91d87be1fb23" containerName="nova-metadata-log" Mar 16 16:16:37 crc kubenswrapper[5120]: I0316 16:16:37.319041 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0716e29-22dd-442d-b52e-b21f627de899" containerName="nova-scheduler-scheduler" Mar 16 16:16:37 crc kubenswrapper[5120]: I0316 16:16:37.319050 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0716e29-22dd-442d-b52e-b21f627de899" containerName="nova-scheduler-scheduler" Mar 16 16:16:37 crc kubenswrapper[5120]: I0316 16:16:37.319277 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="3555721d-1bee-4d75-9cc0-91d87be1fb23" containerName="nova-metadata-metadata" Mar 16 16:16:37 crc kubenswrapper[5120]: I0316 16:16:37.319299 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c0716e29-22dd-442d-b52e-b21f627de899" containerName="nova-scheduler-scheduler" Mar 16 16:16:37 crc kubenswrapper[5120]: I0316 16:16:37.319324 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="3555721d-1bee-4d75-9cc0-91d87be1fb23" containerName="nova-metadata-log" Mar 16 16:16:37 crc kubenswrapper[5120]: I0316 16:16:37.333446 5120 scope.go:117] "RemoveContainer" containerID="714d752a003dc482162279ded9ade8ecaf909c2597f2de062e9aa760bc59f588" Mar 16 16:16:37 crc kubenswrapper[5120]: I0316 16:16:37.333736 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:16:37 crc kubenswrapper[5120]: E0316 16:16:37.334119 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"714d752a003dc482162279ded9ade8ecaf909c2597f2de062e9aa760bc59f588\": container with ID starting with 714d752a003dc482162279ded9ade8ecaf909c2597f2de062e9aa760bc59f588 not found: ID does not exist" containerID="714d752a003dc482162279ded9ade8ecaf909c2597f2de062e9aa760bc59f588" Mar 16 16:16:37 crc kubenswrapper[5120]: I0316 16:16:37.334152 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"714d752a003dc482162279ded9ade8ecaf909c2597f2de062e9aa760bc59f588"} err="failed to get container status \"714d752a003dc482162279ded9ade8ecaf909c2597f2de062e9aa760bc59f588\": rpc error: code = NotFound desc = could not find container \"714d752a003dc482162279ded9ade8ecaf909c2597f2de062e9aa760bc59f588\": container with ID starting with 714d752a003dc482162279ded9ade8ecaf909c2597f2de062e9aa760bc59f588 not found: ID does not exist" Mar 16 16:16:37 crc kubenswrapper[5120]: I0316 16:16:37.334174 5120 scope.go:117] "RemoveContainer" containerID="91f7dd868888c206b12f206956b254cab2eb873c8c44272df32e83eea22a5ba8" Mar 16 16:16:37 crc kubenswrapper[5120]: E0316 16:16:37.334493 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"91f7dd868888c206b12f206956b254cab2eb873c8c44272df32e83eea22a5ba8\": container with ID starting with 91f7dd868888c206b12f206956b254cab2eb873c8c44272df32e83eea22a5ba8 not found: ID does not exist" containerID="91f7dd868888c206b12f206956b254cab2eb873c8c44272df32e83eea22a5ba8" Mar 16 16:16:37 crc kubenswrapper[5120]: I0316 16:16:37.334531 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91f7dd868888c206b12f206956b254cab2eb873c8c44272df32e83eea22a5ba8"} err="failed to get container status \"91f7dd868888c206b12f206956b254cab2eb873c8c44272df32e83eea22a5ba8\": rpc error: code = NotFound desc = could not find container \"91f7dd868888c206b12f206956b254cab2eb873c8c44272df32e83eea22a5ba8\": container with ID starting with 91f7dd868888c206b12f206956b254cab2eb873c8c44272df32e83eea22a5ba8 not found: ID does not exist" Mar 16 16:16:37 crc kubenswrapper[5120]: I0316 16:16:37.334554 5120 scope.go:117] "RemoveContainer" containerID="b740409ac34c52375a2495ededfe8c61b61436c3881a613fe774f4903cfe3a06" Mar 16 16:16:37 crc kubenswrapper[5120]: I0316 16:16:37.336396 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-scheduler-config-data\"" Mar 16 16:16:37 crc kubenswrapper[5120]: I0316 16:16:37.336945 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3555721d-1bee-4d75-9cc0-91d87be1fb23-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "3555721d-1bee-4d75-9cc0-91d87be1fb23" (UID: "3555721d-1bee-4d75-9cc0-91d87be1fb23"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:16:37 crc kubenswrapper[5120]: I0316 16:16:37.354824 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:16:37 crc kubenswrapper[5120]: I0316 16:16:37.357030 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3555721d-1bee-4d75-9cc0-91d87be1fb23-config-data" (OuterVolumeSpecName: "config-data") pod "3555721d-1bee-4d75-9cc0-91d87be1fb23" (UID: "3555721d-1bee-4d75-9cc0-91d87be1fb23"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:16:37 crc kubenswrapper[5120]: I0316 16:16:37.358892 5120 scope.go:117] "RemoveContainer" containerID="b740409ac34c52375a2495ededfe8c61b61436c3881a613fe774f4903cfe3a06" Mar 16 16:16:37 crc kubenswrapper[5120]: E0316 16:16:37.359290 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b740409ac34c52375a2495ededfe8c61b61436c3881a613fe774f4903cfe3a06\": container with ID starting with b740409ac34c52375a2495ededfe8c61b61436c3881a613fe774f4903cfe3a06 not found: ID does not exist" containerID="b740409ac34c52375a2495ededfe8c61b61436c3881a613fe774f4903cfe3a06" Mar 16 16:16:37 crc kubenswrapper[5120]: I0316 16:16:37.359328 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b740409ac34c52375a2495ededfe8c61b61436c3881a613fe774f4903cfe3a06"} err="failed to get container status \"b740409ac34c52375a2495ededfe8c61b61436c3881a613fe774f4903cfe3a06\": rpc error: code = NotFound desc = could not find container \"b740409ac34c52375a2495ededfe8c61b61436c3881a613fe774f4903cfe3a06\": container with ID starting with b740409ac34c52375a2495ededfe8c61b61436c3881a613fe774f4903cfe3a06 not found: ID does not exist" Mar 16 16:16:37 crc kubenswrapper[5120]: I0316 16:16:37.389249 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3555721d-1bee-4d75-9cc0-91d87be1fb23-nova-metadata-tls-certs" (OuterVolumeSpecName: "nova-metadata-tls-certs") pod "3555721d-1bee-4d75-9cc0-91d87be1fb23" (UID: "3555721d-1bee-4d75-9cc0-91d87be1fb23"). InnerVolumeSpecName "nova-metadata-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:16:37 crc kubenswrapper[5120]: I0316 16:16:37.401681 5120 reconciler_common.go:299] "Volume detached for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/3555721d-1bee-4d75-9cc0-91d87be1fb23-nova-metadata-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:16:37 crc kubenswrapper[5120]: I0316 16:16:37.401709 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3555721d-1bee-4d75-9cc0-91d87be1fb23-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:16:37 crc kubenswrapper[5120]: I0316 16:16:37.401717 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3555721d-1bee-4d75-9cc0-91d87be1fb23-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:16:37 crc kubenswrapper[5120]: I0316 16:16:37.401727 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3555721d-1bee-4d75-9cc0-91d87be1fb23-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:16:37 crc kubenswrapper[5120]: I0316 16:16:37.401735 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7jsb5\" (UniqueName: \"kubernetes.io/projected/3555721d-1bee-4d75-9cc0-91d87be1fb23-kube-api-access-7jsb5\") on node \"crc\" DevicePath \"\"" Mar 16 16:16:37 crc kubenswrapper[5120]: I0316 16:16:37.503123 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3f5ad605-f6ee-47e9-a2b6-43e60f01c4c9-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"3f5ad605-f6ee-47e9-a2b6-43e60f01c4c9\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:16:37 crc kubenswrapper[5120]: I0316 16:16:37.503256 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3f5ad605-f6ee-47e9-a2b6-43e60f01c4c9-config-data\") pod \"nova-scheduler-0\" (UID: \"3f5ad605-f6ee-47e9-a2b6-43e60f01c4c9\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:16:37 crc kubenswrapper[5120]: I0316 16:16:37.503681 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7fm9p\" (UniqueName: \"kubernetes.io/projected/3f5ad605-f6ee-47e9-a2b6-43e60f01c4c9-kube-api-access-7fm9p\") pod \"nova-scheduler-0\" (UID: \"3f5ad605-f6ee-47e9-a2b6-43e60f01c4c9\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:16:37 crc kubenswrapper[5120]: I0316 16:16:37.606240 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7fm9p\" (UniqueName: \"kubernetes.io/projected/3f5ad605-f6ee-47e9-a2b6-43e60f01c4c9-kube-api-access-7fm9p\") pod \"nova-scheduler-0\" (UID: \"3f5ad605-f6ee-47e9-a2b6-43e60f01c4c9\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:16:37 crc kubenswrapper[5120]: I0316 16:16:37.606575 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3f5ad605-f6ee-47e9-a2b6-43e60f01c4c9-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"3f5ad605-f6ee-47e9-a2b6-43e60f01c4c9\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:16:37 crc kubenswrapper[5120]: I0316 16:16:37.606622 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3f5ad605-f6ee-47e9-a2b6-43e60f01c4c9-config-data\") pod \"nova-scheduler-0\" (UID: \"3f5ad605-f6ee-47e9-a2b6-43e60f01c4c9\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:16:37 crc kubenswrapper[5120]: I0316 16:16:37.608324 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:16:37 crc kubenswrapper[5120]: I0316 16:16:37.611992 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3f5ad605-f6ee-47e9-a2b6-43e60f01c4c9-config-data\") pod \"nova-scheduler-0\" (UID: \"3f5ad605-f6ee-47e9-a2b6-43e60f01c4c9\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:16:37 crc kubenswrapper[5120]: I0316 16:16:37.613643 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3f5ad605-f6ee-47e9-a2b6-43e60f01c4c9-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"3f5ad605-f6ee-47e9-a2b6-43e60f01c4c9\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:16:37 crc kubenswrapper[5120]: I0316 16:16:37.616895 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:16:37 crc kubenswrapper[5120]: I0316 16:16:37.625995 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:16:37 crc kubenswrapper[5120]: I0316 16:16:37.634352 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:16:37 crc kubenswrapper[5120]: I0316 16:16:37.637625 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:16:37 crc kubenswrapper[5120]: I0316 16:16:37.638379 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-metadata-config-data\"" Mar 16 16:16:37 crc kubenswrapper[5120]: I0316 16:16:37.639594 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-metadata-internal-svc\"" Mar 16 16:16:37 crc kubenswrapper[5120]: I0316 16:16:37.641403 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7fm9p\" (UniqueName: \"kubernetes.io/projected/3f5ad605-f6ee-47e9-a2b6-43e60f01c4c9-kube-api-access-7fm9p\") pod \"nova-scheduler-0\" (UID: \"3f5ad605-f6ee-47e9-a2b6-43e60f01c4c9\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:16:37 crc kubenswrapper[5120]: I0316 16:16:37.654282 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:16:37 crc kubenswrapper[5120]: I0316 16:16:37.811544 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzdnb\" (UniqueName: \"kubernetes.io/projected/9292b258-885b-40a8-8b7d-9ed28a747bc7-kube-api-access-jzdnb\") pod \"nova-metadata-0\" (UID: \"9292b258-885b-40a8-8b7d-9ed28a747bc7\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:16:37 crc kubenswrapper[5120]: I0316 16:16:37.811918 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9292b258-885b-40a8-8b7d-9ed28a747bc7-config-data\") pod \"nova-metadata-0\" (UID: \"9292b258-885b-40a8-8b7d-9ed28a747bc7\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:16:37 crc kubenswrapper[5120]: I0316 16:16:37.812097 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9292b258-885b-40a8-8b7d-9ed28a747bc7-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"9292b258-885b-40a8-8b7d-9ed28a747bc7\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:16:37 crc kubenswrapper[5120]: I0316 16:16:37.812263 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9292b258-885b-40a8-8b7d-9ed28a747bc7-logs\") pod \"nova-metadata-0\" (UID: \"9292b258-885b-40a8-8b7d-9ed28a747bc7\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:16:37 crc kubenswrapper[5120]: I0316 16:16:37.812285 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/9292b258-885b-40a8-8b7d-9ed28a747bc7-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"9292b258-885b-40a8-8b7d-9ed28a747bc7\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:16:37 crc kubenswrapper[5120]: I0316 16:16:37.914184 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jzdnb\" (UniqueName: \"kubernetes.io/projected/9292b258-885b-40a8-8b7d-9ed28a747bc7-kube-api-access-jzdnb\") pod \"nova-metadata-0\" (UID: \"9292b258-885b-40a8-8b7d-9ed28a747bc7\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:16:37 crc kubenswrapper[5120]: I0316 16:16:37.914329 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9292b258-885b-40a8-8b7d-9ed28a747bc7-config-data\") pod \"nova-metadata-0\" (UID: \"9292b258-885b-40a8-8b7d-9ed28a747bc7\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:16:37 crc kubenswrapper[5120]: I0316 16:16:37.914401 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9292b258-885b-40a8-8b7d-9ed28a747bc7-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"9292b258-885b-40a8-8b7d-9ed28a747bc7\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:16:37 crc kubenswrapper[5120]: I0316 16:16:37.914462 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9292b258-885b-40a8-8b7d-9ed28a747bc7-logs\") pod \"nova-metadata-0\" (UID: \"9292b258-885b-40a8-8b7d-9ed28a747bc7\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:16:37 crc kubenswrapper[5120]: I0316 16:16:37.914480 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/9292b258-885b-40a8-8b7d-9ed28a747bc7-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"9292b258-885b-40a8-8b7d-9ed28a747bc7\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:16:37 crc kubenswrapper[5120]: I0316 16:16:37.915318 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9292b258-885b-40a8-8b7d-9ed28a747bc7-logs\") pod \"nova-metadata-0\" (UID: \"9292b258-885b-40a8-8b7d-9ed28a747bc7\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:16:37 crc kubenswrapper[5120]: I0316 16:16:37.919584 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9292b258-885b-40a8-8b7d-9ed28a747bc7-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"9292b258-885b-40a8-8b7d-9ed28a747bc7\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:16:37 crc kubenswrapper[5120]: I0316 16:16:37.923938 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9292b258-885b-40a8-8b7d-9ed28a747bc7-config-data\") pod \"nova-metadata-0\" (UID: \"9292b258-885b-40a8-8b7d-9ed28a747bc7\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:16:37 crc kubenswrapper[5120]: I0316 16:16:37.930275 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/9292b258-885b-40a8-8b7d-9ed28a747bc7-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"9292b258-885b-40a8-8b7d-9ed28a747bc7\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:16:37 crc kubenswrapper[5120]: I0316 16:16:37.935670 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzdnb\" (UniqueName: \"kubernetes.io/projected/9292b258-885b-40a8-8b7d-9ed28a747bc7-kube-api-access-jzdnb\") pod \"nova-metadata-0\" (UID: \"9292b258-885b-40a8-8b7d-9ed28a747bc7\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:16:38 crc kubenswrapper[5120]: I0316 16:16:38.105077 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:16:38 crc kubenswrapper[5120]: I0316 16:16:38.132830 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:16:38 crc kubenswrapper[5120]: I0316 16:16:38.274409 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"3f5ad605-f6ee-47e9-a2b6-43e60f01c4c9","Type":"ContainerStarted","Data":"bf4bd6e360e94442837b5a30e427d7e2ec3b6ee57583492341a02bc65361a415"} Mar 16 16:16:38 crc kubenswrapper[5120]: I0316 16:16:38.594478 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:16:38 crc kubenswrapper[5120]: I0316 16:16:38.686488 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3555721d-1bee-4d75-9cc0-91d87be1fb23" path="/var/lib/kubelet/pods/3555721d-1bee-4d75-9cc0-91d87be1fb23/volumes" Mar 16 16:16:38 crc kubenswrapper[5120]: I0316 16:16:38.687974 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c0716e29-22dd-442d-b52e-b21f627de899" path="/var/lib/kubelet/pods/c0716e29-22dd-442d-b52e-b21f627de899/volumes" Mar 16 16:16:39 crc kubenswrapper[5120]: I0316 16:16:39.118837 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:16:39 crc kubenswrapper[5120]: I0316 16:16:39.286732 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"3f5ad605-f6ee-47e9-a2b6-43e60f01c4c9","Type":"ContainerStarted","Data":"a1f5e797b52c263768103f57dc958a68929e1eaed737a81298570c479cbfd478"} Mar 16 16:16:39 crc kubenswrapper[5120]: I0316 16:16:39.290754 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"9292b258-885b-40a8-8b7d-9ed28a747bc7","Type":"ContainerStarted","Data":"f19f6e35585d519c6c4887128e22a173629daff0e73ecce16798b83d694eb56d"} Mar 16 16:16:39 crc kubenswrapper[5120]: I0316 16:16:39.290846 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"9292b258-885b-40a8-8b7d-9ed28a747bc7","Type":"ContainerStarted","Data":"67504ceae616481d35ca3f878a42ab809e32f965b94f09a9c14bb47581bf94e4"} Mar 16 16:16:39 crc kubenswrapper[5120]: I0316 16:16:39.290861 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"9292b258-885b-40a8-8b7d-9ed28a747bc7","Type":"ContainerStarted","Data":"c4e317d02c501ce91e27c064b8faccd19f268254274db10077250e86eb4fb358"} Mar 16 16:16:39 crc kubenswrapper[5120]: I0316 16:16:39.307565 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-scheduler-0" podStartSLOduration=2.307545373 podStartE2EDuration="2.307545373s" podCreationTimestamp="2026-03-16 16:16:37 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:16:39.303361341 +0000 UTC m=+2701.457292998" watchObservedRunningTime="2026-03-16 16:16:39.307545373 +0000 UTC m=+2701.461477040" Mar 16 16:16:39 crc kubenswrapper[5120]: I0316 16:16:39.320716 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=2.320693346 podStartE2EDuration="2.320693346s" podCreationTimestamp="2026-03-16 16:16:37 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:16:39.319059502 +0000 UTC m=+2701.472991199" watchObservedRunningTime="2026-03-16 16:16:39.320693346 +0000 UTC m=+2701.474625043" Mar 16 16:16:42 crc kubenswrapper[5120]: I0316 16:16:42.655178 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:16:43 crc kubenswrapper[5120]: I0316 16:16:43.505333 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-v822j_ac55471d-4e42-475f-a082-50f611571482/kube-multus/0.log" Mar 16 16:16:43 crc kubenswrapper[5120]: I0316 16:16:43.513830 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-crc_9f0bc7fcb0822a2c13eb2d22cd8c0641/kube-controller-manager/0.log" Mar 16 16:16:43 crc kubenswrapper[5120]: I0316 16:16:43.514367 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-v822j_ac55471d-4e42-475f-a082-50f611571482/kube-multus/0.log" Mar 16 16:16:43 crc kubenswrapper[5120]: I0316 16:16:43.519129 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-crc_9f0bc7fcb0822a2c13eb2d22cd8c0641/kube-controller-manager/0.log" Mar 16 16:16:44 crc kubenswrapper[5120]: I0316 16:16:44.618710 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:16:44 crc kubenswrapper[5120]: I0316 16:16:44.619121 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:16:45 crc kubenswrapper[5120]: I0316 16:16:45.660979 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="be20213e-52c5-4771-82b6-56878e525cc5" containerName="nova-api-api" probeResult="failure" output="Get \"http://10.217.1.13:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 16:16:45 crc kubenswrapper[5120]: I0316 16:16:45.661029 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="be20213e-52c5-4771-82b6-56878e525cc5" containerName="nova-api-log" probeResult="failure" output="Get \"http://10.217.1.13:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 16:16:47 crc kubenswrapper[5120]: I0316 16:16:47.654632 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:16:47 crc kubenswrapper[5120]: I0316 16:16:47.705416 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:16:48 crc kubenswrapper[5120]: I0316 16:16:48.106315 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:16:48 crc kubenswrapper[5120]: I0316 16:16:48.106710 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:16:48 crc kubenswrapper[5120]: I0316 16:16:48.421466 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:16:49 crc kubenswrapper[5120]: I0316 16:16:49.115014 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="9292b258-885b-40a8-8b7d-9ed28a747bc7" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"https://10.217.1.15:8775/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Mar 16 16:16:49 crc kubenswrapper[5120]: I0316 16:16:49.115883 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="9292b258-885b-40a8-8b7d-9ed28a747bc7" containerName="nova-metadata-log" probeResult="failure" output="Get \"https://10.217.1.15:8775/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Mar 16 16:16:52 crc kubenswrapper[5120]: I0316 16:16:52.008544 5120 patch_prober.go:28] interesting pod/machine-config-daemon-7bf76 container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 16:16:52 crc kubenswrapper[5120]: I0316 16:16:52.009067 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 16:16:52 crc kubenswrapper[5120]: I0316 16:16:52.618587 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:16:52 crc kubenswrapper[5120]: I0316 16:16:52.618949 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:16:54 crc kubenswrapper[5120]: I0316 16:16:54.623109 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:16:54 crc kubenswrapper[5120]: I0316 16:16:54.624999 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:16:54 crc kubenswrapper[5120]: I0316 16:16:54.626001 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:16:55 crc kubenswrapper[5120]: I0316 16:16:55.490451 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:16:56 crc kubenswrapper[5120]: I0316 16:16:56.105623 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:16:56 crc kubenswrapper[5120]: I0316 16:16:56.106891 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:16:57 crc kubenswrapper[5120]: I0316 16:16:57.405788 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:16:57 crc kubenswrapper[5120]: I0316 16:16:57.406349 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="46db769c-ef7b-4e05-b69c-1483b71e7bad" containerName="ceilometer-central-agent" containerID="cri-o://d779bd16d2467008fd0f078e50a0d3e4a6d8293f3a7bcc3ab5d43f1085a0a6b1" gracePeriod=30 Mar 16 16:16:57 crc kubenswrapper[5120]: I0316 16:16:57.406475 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="46db769c-ef7b-4e05-b69c-1483b71e7bad" containerName="proxy-httpd" containerID="cri-o://93cd1ebf0ea416dc9c015eb668e91ab0baeb461fe15396fa4d1b9d76f5fe2eb4" gracePeriod=30 Mar 16 16:16:57 crc kubenswrapper[5120]: I0316 16:16:57.406524 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="46db769c-ef7b-4e05-b69c-1483b71e7bad" containerName="sg-core" containerID="cri-o://38e9a6e9a8f81b104e6b4d2b574eb5f16d8cef988bd368bfe27c72ceb77d5683" gracePeriod=30 Mar 16 16:16:57 crc kubenswrapper[5120]: I0316 16:16:57.406556 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="46db769c-ef7b-4e05-b69c-1483b71e7bad" containerName="ceilometer-notification-agent" containerID="cri-o://b4901eaab9aa6b825c271f8a83ab766c1d744bc325f732147aa91286293f1608" gracePeriod=30 Mar 16 16:16:57 crc kubenswrapper[5120]: I0316 16:16:57.418260 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/ceilometer-0" podUID="46db769c-ef7b-4e05-b69c-1483b71e7bad" containerName="proxy-httpd" probeResult="failure" output="Get \"https://10.217.1.12:3000/\": EOF" Mar 16 16:16:57 crc kubenswrapper[5120]: E0316 16:16:57.514352 5120 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod46db769c_ef7b_4e05_b69c_1483b71e7bad.slice/crio-38e9a6e9a8f81b104e6b4d2b574eb5f16d8cef988bd368bfe27c72ceb77d5683.scope\": RecentStats: unable to find data in memory cache]" Mar 16 16:16:57 crc kubenswrapper[5120]: I0316 16:16:57.542724 5120 generic.go:358] "Generic (PLEG): container finished" podID="46db769c-ef7b-4e05-b69c-1483b71e7bad" containerID="38e9a6e9a8f81b104e6b4d2b574eb5f16d8cef988bd368bfe27c72ceb77d5683" exitCode=2 Mar 16 16:16:57 crc kubenswrapper[5120]: I0316 16:16:57.542813 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"46db769c-ef7b-4e05-b69c-1483b71e7bad","Type":"ContainerDied","Data":"38e9a6e9a8f81b104e6b4d2b574eb5f16d8cef988bd368bfe27c72ceb77d5683"} Mar 16 16:16:57 crc kubenswrapper[5120]: I0316 16:16:57.777937 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:16:58 crc kubenswrapper[5120]: I0316 16:16:58.111670 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:16:58 crc kubenswrapper[5120]: I0316 16:16:58.113723 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:16:58 crc kubenswrapper[5120]: I0316 16:16:58.115837 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:16:58 crc kubenswrapper[5120]: I0316 16:16:58.424081 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:16:58 crc kubenswrapper[5120]: I0316 16:16:58.546341 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/46db769c-ef7b-4e05-b69c-1483b71e7bad-scripts\") pod \"46db769c-ef7b-4e05-b69c-1483b71e7bad\" (UID: \"46db769c-ef7b-4e05-b69c-1483b71e7bad\") " Mar 16 16:16:58 crc kubenswrapper[5120]: I0316 16:16:58.546610 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/46db769c-ef7b-4e05-b69c-1483b71e7bad-ceilometer-tls-certs\") pod \"46db769c-ef7b-4e05-b69c-1483b71e7bad\" (UID: \"46db769c-ef7b-4e05-b69c-1483b71e7bad\") " Mar 16 16:16:58 crc kubenswrapper[5120]: I0316 16:16:58.546794 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/46db769c-ef7b-4e05-b69c-1483b71e7bad-sg-core-conf-yaml\") pod \"46db769c-ef7b-4e05-b69c-1483b71e7bad\" (UID: \"46db769c-ef7b-4e05-b69c-1483b71e7bad\") " Mar 16 16:16:58 crc kubenswrapper[5120]: I0316 16:16:58.546849 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/46db769c-ef7b-4e05-b69c-1483b71e7bad-config-data\") pod \"46db769c-ef7b-4e05-b69c-1483b71e7bad\" (UID: \"46db769c-ef7b-4e05-b69c-1483b71e7bad\") " Mar 16 16:16:58 crc kubenswrapper[5120]: I0316 16:16:58.546919 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/46db769c-ef7b-4e05-b69c-1483b71e7bad-combined-ca-bundle\") pod \"46db769c-ef7b-4e05-b69c-1483b71e7bad\" (UID: \"46db769c-ef7b-4e05-b69c-1483b71e7bad\") " Mar 16 16:16:58 crc kubenswrapper[5120]: I0316 16:16:58.547033 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/46db769c-ef7b-4e05-b69c-1483b71e7bad-run-httpd\") pod \"46db769c-ef7b-4e05-b69c-1483b71e7bad\" (UID: \"46db769c-ef7b-4e05-b69c-1483b71e7bad\") " Mar 16 16:16:58 crc kubenswrapper[5120]: I0316 16:16:58.547075 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/46db769c-ef7b-4e05-b69c-1483b71e7bad-log-httpd\") pod \"46db769c-ef7b-4e05-b69c-1483b71e7bad\" (UID: \"46db769c-ef7b-4e05-b69c-1483b71e7bad\") " Mar 16 16:16:58 crc kubenswrapper[5120]: I0316 16:16:58.547185 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6xrlb\" (UniqueName: \"kubernetes.io/projected/46db769c-ef7b-4e05-b69c-1483b71e7bad-kube-api-access-6xrlb\") pod \"46db769c-ef7b-4e05-b69c-1483b71e7bad\" (UID: \"46db769c-ef7b-4e05-b69c-1483b71e7bad\") " Mar 16 16:16:58 crc kubenswrapper[5120]: I0316 16:16:58.547421 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46db769c-ef7b-4e05-b69c-1483b71e7bad-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "46db769c-ef7b-4e05-b69c-1483b71e7bad" (UID: "46db769c-ef7b-4e05-b69c-1483b71e7bad"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:16:58 crc kubenswrapper[5120]: I0316 16:16:58.547799 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/46db769c-ef7b-4e05-b69c-1483b71e7bad-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:16:58 crc kubenswrapper[5120]: I0316 16:16:58.550074 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46db769c-ef7b-4e05-b69c-1483b71e7bad-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "46db769c-ef7b-4e05-b69c-1483b71e7bad" (UID: "46db769c-ef7b-4e05-b69c-1483b71e7bad"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:16:58 crc kubenswrapper[5120]: I0316 16:16:58.552377 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46db769c-ef7b-4e05-b69c-1483b71e7bad-kube-api-access-6xrlb" (OuterVolumeSpecName: "kube-api-access-6xrlb") pod "46db769c-ef7b-4e05-b69c-1483b71e7bad" (UID: "46db769c-ef7b-4e05-b69c-1483b71e7bad"). InnerVolumeSpecName "kube-api-access-6xrlb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:16:58 crc kubenswrapper[5120]: I0316 16:16:58.553187 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/46db769c-ef7b-4e05-b69c-1483b71e7bad-scripts" (OuterVolumeSpecName: "scripts") pod "46db769c-ef7b-4e05-b69c-1483b71e7bad" (UID: "46db769c-ef7b-4e05-b69c-1483b71e7bad"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:16:58 crc kubenswrapper[5120]: I0316 16:16:58.555553 5120 generic.go:358] "Generic (PLEG): container finished" podID="46db769c-ef7b-4e05-b69c-1483b71e7bad" containerID="93cd1ebf0ea416dc9c015eb668e91ab0baeb461fe15396fa4d1b9d76f5fe2eb4" exitCode=0 Mar 16 16:16:58 crc kubenswrapper[5120]: I0316 16:16:58.555578 5120 generic.go:358] "Generic (PLEG): container finished" podID="46db769c-ef7b-4e05-b69c-1483b71e7bad" containerID="b4901eaab9aa6b825c271f8a83ab766c1d744bc325f732147aa91286293f1608" exitCode=0 Mar 16 16:16:58 crc kubenswrapper[5120]: I0316 16:16:58.555587 5120 generic.go:358] "Generic (PLEG): container finished" podID="46db769c-ef7b-4e05-b69c-1483b71e7bad" containerID="d779bd16d2467008fd0f078e50a0d3e4a6d8293f3a7bcc3ab5d43f1085a0a6b1" exitCode=0 Mar 16 16:16:58 crc kubenswrapper[5120]: I0316 16:16:58.555947 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"46db769c-ef7b-4e05-b69c-1483b71e7bad","Type":"ContainerDied","Data":"93cd1ebf0ea416dc9c015eb668e91ab0baeb461fe15396fa4d1b9d76f5fe2eb4"} Mar 16 16:16:58 crc kubenswrapper[5120]: I0316 16:16:58.555978 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"46db769c-ef7b-4e05-b69c-1483b71e7bad","Type":"ContainerDied","Data":"b4901eaab9aa6b825c271f8a83ab766c1d744bc325f732147aa91286293f1608"} Mar 16 16:16:58 crc kubenswrapper[5120]: I0316 16:16:58.555988 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"46db769c-ef7b-4e05-b69c-1483b71e7bad","Type":"ContainerDied","Data":"d779bd16d2467008fd0f078e50a0d3e4a6d8293f3a7bcc3ab5d43f1085a0a6b1"} Mar 16 16:16:58 crc kubenswrapper[5120]: I0316 16:16:58.555996 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"46db769c-ef7b-4e05-b69c-1483b71e7bad","Type":"ContainerDied","Data":"9e6d697130f6188f6d5de9e3453d43d342db68dc1316b6174f526e6df1652d51"} Mar 16 16:16:58 crc kubenswrapper[5120]: I0316 16:16:58.556011 5120 scope.go:117] "RemoveContainer" containerID="93cd1ebf0ea416dc9c015eb668e91ab0baeb461fe15396fa4d1b9d76f5fe2eb4" Mar 16 16:16:58 crc kubenswrapper[5120]: I0316 16:16:58.556517 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:16:58 crc kubenswrapper[5120]: I0316 16:16:58.556691 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="be20213e-52c5-4771-82b6-56878e525cc5" containerName="nova-api-log" containerID="cri-o://5057377e4901bf855cfe9e8e8561e877e6549591a414a40b76cc5c25839e76e9" gracePeriod=30 Mar 16 16:16:58 crc kubenswrapper[5120]: I0316 16:16:58.556859 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="be20213e-52c5-4771-82b6-56878e525cc5" containerName="nova-api-api" containerID="cri-o://c7733de8b9f8de19f9755e04ae675c4a5edd99da05bf7430e130caab616667a3" gracePeriod=30 Mar 16 16:16:58 crc kubenswrapper[5120]: I0316 16:16:58.568732 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:16:58 crc kubenswrapper[5120]: I0316 16:16:58.608309 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/46db769c-ef7b-4e05-b69c-1483b71e7bad-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "46db769c-ef7b-4e05-b69c-1483b71e7bad" (UID: "46db769c-ef7b-4e05-b69c-1483b71e7bad"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:16:58 crc kubenswrapper[5120]: I0316 16:16:58.652961 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/46db769c-ef7b-4e05-b69c-1483b71e7bad-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 16:16:58 crc kubenswrapper[5120]: I0316 16:16:58.653002 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/46db769c-ef7b-4e05-b69c-1483b71e7bad-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:16:58 crc kubenswrapper[5120]: I0316 16:16:58.653017 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6xrlb\" (UniqueName: \"kubernetes.io/projected/46db769c-ef7b-4e05-b69c-1483b71e7bad-kube-api-access-6xrlb\") on node \"crc\" DevicePath \"\"" Mar 16 16:16:58 crc kubenswrapper[5120]: I0316 16:16:58.653056 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/46db769c-ef7b-4e05-b69c-1483b71e7bad-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:16:58 crc kubenswrapper[5120]: I0316 16:16:58.672225 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/46db769c-ef7b-4e05-b69c-1483b71e7bad-ceilometer-tls-certs" (OuterVolumeSpecName: "ceilometer-tls-certs") pod "46db769c-ef7b-4e05-b69c-1483b71e7bad" (UID: "46db769c-ef7b-4e05-b69c-1483b71e7bad"). InnerVolumeSpecName "ceilometer-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:16:58 crc kubenswrapper[5120]: I0316 16:16:58.691035 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/46db769c-ef7b-4e05-b69c-1483b71e7bad-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "46db769c-ef7b-4e05-b69c-1483b71e7bad" (UID: "46db769c-ef7b-4e05-b69c-1483b71e7bad"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:16:58 crc kubenswrapper[5120]: I0316 16:16:58.723878 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/46db769c-ef7b-4e05-b69c-1483b71e7bad-config-data" (OuterVolumeSpecName: "config-data") pod "46db769c-ef7b-4e05-b69c-1483b71e7bad" (UID: "46db769c-ef7b-4e05-b69c-1483b71e7bad"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:16:58 crc kubenswrapper[5120]: I0316 16:16:58.756066 5120 reconciler_common.go:299] "Volume detached for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/46db769c-ef7b-4e05-b69c-1483b71e7bad-ceilometer-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:16:58 crc kubenswrapper[5120]: I0316 16:16:58.756136 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/46db769c-ef7b-4e05-b69c-1483b71e7bad-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:16:58 crc kubenswrapper[5120]: I0316 16:16:58.756149 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/46db769c-ef7b-4e05-b69c-1483b71e7bad-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:16:58 crc kubenswrapper[5120]: I0316 16:16:58.784737 5120 scope.go:117] "RemoveContainer" containerID="38e9a6e9a8f81b104e6b4d2b574eb5f16d8cef988bd368bfe27c72ceb77d5683" Mar 16 16:16:58 crc kubenswrapper[5120]: I0316 16:16:58.808652 5120 scope.go:117] "RemoveContainer" containerID="b4901eaab9aa6b825c271f8a83ab766c1d744bc325f732147aa91286293f1608" Mar 16 16:16:58 crc kubenswrapper[5120]: I0316 16:16:58.829935 5120 scope.go:117] "RemoveContainer" containerID="d779bd16d2467008fd0f078e50a0d3e4a6d8293f3a7bcc3ab5d43f1085a0a6b1" Mar 16 16:16:58 crc kubenswrapper[5120]: I0316 16:16:58.870184 5120 scope.go:117] "RemoveContainer" containerID="93cd1ebf0ea416dc9c015eb668e91ab0baeb461fe15396fa4d1b9d76f5fe2eb4" Mar 16 16:16:58 crc kubenswrapper[5120]: E0316 16:16:58.871342 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93cd1ebf0ea416dc9c015eb668e91ab0baeb461fe15396fa4d1b9d76f5fe2eb4\": container with ID starting with 93cd1ebf0ea416dc9c015eb668e91ab0baeb461fe15396fa4d1b9d76f5fe2eb4 not found: ID does not exist" containerID="93cd1ebf0ea416dc9c015eb668e91ab0baeb461fe15396fa4d1b9d76f5fe2eb4" Mar 16 16:16:58 crc kubenswrapper[5120]: I0316 16:16:58.871418 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93cd1ebf0ea416dc9c015eb668e91ab0baeb461fe15396fa4d1b9d76f5fe2eb4"} err="failed to get container status \"93cd1ebf0ea416dc9c015eb668e91ab0baeb461fe15396fa4d1b9d76f5fe2eb4\": rpc error: code = NotFound desc = could not find container \"93cd1ebf0ea416dc9c015eb668e91ab0baeb461fe15396fa4d1b9d76f5fe2eb4\": container with ID starting with 93cd1ebf0ea416dc9c015eb668e91ab0baeb461fe15396fa4d1b9d76f5fe2eb4 not found: ID does not exist" Mar 16 16:16:58 crc kubenswrapper[5120]: I0316 16:16:58.871472 5120 scope.go:117] "RemoveContainer" containerID="38e9a6e9a8f81b104e6b4d2b574eb5f16d8cef988bd368bfe27c72ceb77d5683" Mar 16 16:16:58 crc kubenswrapper[5120]: E0316 16:16:58.871889 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"38e9a6e9a8f81b104e6b4d2b574eb5f16d8cef988bd368bfe27c72ceb77d5683\": container with ID starting with 38e9a6e9a8f81b104e6b4d2b574eb5f16d8cef988bd368bfe27c72ceb77d5683 not found: ID does not exist" containerID="38e9a6e9a8f81b104e6b4d2b574eb5f16d8cef988bd368bfe27c72ceb77d5683" Mar 16 16:16:58 crc kubenswrapper[5120]: I0316 16:16:58.871958 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38e9a6e9a8f81b104e6b4d2b574eb5f16d8cef988bd368bfe27c72ceb77d5683"} err="failed to get container status \"38e9a6e9a8f81b104e6b4d2b574eb5f16d8cef988bd368bfe27c72ceb77d5683\": rpc error: code = NotFound desc = could not find container \"38e9a6e9a8f81b104e6b4d2b574eb5f16d8cef988bd368bfe27c72ceb77d5683\": container with ID starting with 38e9a6e9a8f81b104e6b4d2b574eb5f16d8cef988bd368bfe27c72ceb77d5683 not found: ID does not exist" Mar 16 16:16:58 crc kubenswrapper[5120]: I0316 16:16:58.872002 5120 scope.go:117] "RemoveContainer" containerID="b4901eaab9aa6b825c271f8a83ab766c1d744bc325f732147aa91286293f1608" Mar 16 16:16:58 crc kubenswrapper[5120]: E0316 16:16:58.872382 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b4901eaab9aa6b825c271f8a83ab766c1d744bc325f732147aa91286293f1608\": container with ID starting with b4901eaab9aa6b825c271f8a83ab766c1d744bc325f732147aa91286293f1608 not found: ID does not exist" containerID="b4901eaab9aa6b825c271f8a83ab766c1d744bc325f732147aa91286293f1608" Mar 16 16:16:58 crc kubenswrapper[5120]: I0316 16:16:58.872415 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4901eaab9aa6b825c271f8a83ab766c1d744bc325f732147aa91286293f1608"} err="failed to get container status \"b4901eaab9aa6b825c271f8a83ab766c1d744bc325f732147aa91286293f1608\": rpc error: code = NotFound desc = could not find container \"b4901eaab9aa6b825c271f8a83ab766c1d744bc325f732147aa91286293f1608\": container with ID starting with b4901eaab9aa6b825c271f8a83ab766c1d744bc325f732147aa91286293f1608 not found: ID does not exist" Mar 16 16:16:58 crc kubenswrapper[5120]: I0316 16:16:58.872439 5120 scope.go:117] "RemoveContainer" containerID="d779bd16d2467008fd0f078e50a0d3e4a6d8293f3a7bcc3ab5d43f1085a0a6b1" Mar 16 16:16:58 crc kubenswrapper[5120]: E0316 16:16:58.872787 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d779bd16d2467008fd0f078e50a0d3e4a6d8293f3a7bcc3ab5d43f1085a0a6b1\": container with ID starting with d779bd16d2467008fd0f078e50a0d3e4a6d8293f3a7bcc3ab5d43f1085a0a6b1 not found: ID does not exist" containerID="d779bd16d2467008fd0f078e50a0d3e4a6d8293f3a7bcc3ab5d43f1085a0a6b1" Mar 16 16:16:58 crc kubenswrapper[5120]: I0316 16:16:58.872823 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d779bd16d2467008fd0f078e50a0d3e4a6d8293f3a7bcc3ab5d43f1085a0a6b1"} err="failed to get container status \"d779bd16d2467008fd0f078e50a0d3e4a6d8293f3a7bcc3ab5d43f1085a0a6b1\": rpc error: code = NotFound desc = could not find container \"d779bd16d2467008fd0f078e50a0d3e4a6d8293f3a7bcc3ab5d43f1085a0a6b1\": container with ID starting with d779bd16d2467008fd0f078e50a0d3e4a6d8293f3a7bcc3ab5d43f1085a0a6b1 not found: ID does not exist" Mar 16 16:16:58 crc kubenswrapper[5120]: I0316 16:16:58.872843 5120 scope.go:117] "RemoveContainer" containerID="93cd1ebf0ea416dc9c015eb668e91ab0baeb461fe15396fa4d1b9d76f5fe2eb4" Mar 16 16:16:58 crc kubenswrapper[5120]: I0316 16:16:58.873108 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93cd1ebf0ea416dc9c015eb668e91ab0baeb461fe15396fa4d1b9d76f5fe2eb4"} err="failed to get container status \"93cd1ebf0ea416dc9c015eb668e91ab0baeb461fe15396fa4d1b9d76f5fe2eb4\": rpc error: code = NotFound desc = could not find container \"93cd1ebf0ea416dc9c015eb668e91ab0baeb461fe15396fa4d1b9d76f5fe2eb4\": container with ID starting with 93cd1ebf0ea416dc9c015eb668e91ab0baeb461fe15396fa4d1b9d76f5fe2eb4 not found: ID does not exist" Mar 16 16:16:58 crc kubenswrapper[5120]: I0316 16:16:58.873129 5120 scope.go:117] "RemoveContainer" containerID="38e9a6e9a8f81b104e6b4d2b574eb5f16d8cef988bd368bfe27c72ceb77d5683" Mar 16 16:16:58 crc kubenswrapper[5120]: I0316 16:16:58.873401 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38e9a6e9a8f81b104e6b4d2b574eb5f16d8cef988bd368bfe27c72ceb77d5683"} err="failed to get container status \"38e9a6e9a8f81b104e6b4d2b574eb5f16d8cef988bd368bfe27c72ceb77d5683\": rpc error: code = NotFound desc = could not find container \"38e9a6e9a8f81b104e6b4d2b574eb5f16d8cef988bd368bfe27c72ceb77d5683\": container with ID starting with 38e9a6e9a8f81b104e6b4d2b574eb5f16d8cef988bd368bfe27c72ceb77d5683 not found: ID does not exist" Mar 16 16:16:58 crc kubenswrapper[5120]: I0316 16:16:58.873428 5120 scope.go:117] "RemoveContainer" containerID="b4901eaab9aa6b825c271f8a83ab766c1d744bc325f732147aa91286293f1608" Mar 16 16:16:58 crc kubenswrapper[5120]: I0316 16:16:58.873677 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4901eaab9aa6b825c271f8a83ab766c1d744bc325f732147aa91286293f1608"} err="failed to get container status \"b4901eaab9aa6b825c271f8a83ab766c1d744bc325f732147aa91286293f1608\": rpc error: code = NotFound desc = could not find container \"b4901eaab9aa6b825c271f8a83ab766c1d744bc325f732147aa91286293f1608\": container with ID starting with b4901eaab9aa6b825c271f8a83ab766c1d744bc325f732147aa91286293f1608 not found: ID does not exist" Mar 16 16:16:58 crc kubenswrapper[5120]: I0316 16:16:58.873695 5120 scope.go:117] "RemoveContainer" containerID="d779bd16d2467008fd0f078e50a0d3e4a6d8293f3a7bcc3ab5d43f1085a0a6b1" Mar 16 16:16:58 crc kubenswrapper[5120]: I0316 16:16:58.873955 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d779bd16d2467008fd0f078e50a0d3e4a6d8293f3a7bcc3ab5d43f1085a0a6b1"} err="failed to get container status \"d779bd16d2467008fd0f078e50a0d3e4a6d8293f3a7bcc3ab5d43f1085a0a6b1\": rpc error: code = NotFound desc = could not find container \"d779bd16d2467008fd0f078e50a0d3e4a6d8293f3a7bcc3ab5d43f1085a0a6b1\": container with ID starting with d779bd16d2467008fd0f078e50a0d3e4a6d8293f3a7bcc3ab5d43f1085a0a6b1 not found: ID does not exist" Mar 16 16:16:58 crc kubenswrapper[5120]: I0316 16:16:58.873970 5120 scope.go:117] "RemoveContainer" containerID="93cd1ebf0ea416dc9c015eb668e91ab0baeb461fe15396fa4d1b9d76f5fe2eb4" Mar 16 16:16:58 crc kubenswrapper[5120]: I0316 16:16:58.874296 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93cd1ebf0ea416dc9c015eb668e91ab0baeb461fe15396fa4d1b9d76f5fe2eb4"} err="failed to get container status \"93cd1ebf0ea416dc9c015eb668e91ab0baeb461fe15396fa4d1b9d76f5fe2eb4\": rpc error: code = NotFound desc = could not find container \"93cd1ebf0ea416dc9c015eb668e91ab0baeb461fe15396fa4d1b9d76f5fe2eb4\": container with ID starting with 93cd1ebf0ea416dc9c015eb668e91ab0baeb461fe15396fa4d1b9d76f5fe2eb4 not found: ID does not exist" Mar 16 16:16:58 crc kubenswrapper[5120]: I0316 16:16:58.874324 5120 scope.go:117] "RemoveContainer" containerID="38e9a6e9a8f81b104e6b4d2b574eb5f16d8cef988bd368bfe27c72ceb77d5683" Mar 16 16:16:58 crc kubenswrapper[5120]: I0316 16:16:58.876013 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38e9a6e9a8f81b104e6b4d2b574eb5f16d8cef988bd368bfe27c72ceb77d5683"} err="failed to get container status \"38e9a6e9a8f81b104e6b4d2b574eb5f16d8cef988bd368bfe27c72ceb77d5683\": rpc error: code = NotFound desc = could not find container \"38e9a6e9a8f81b104e6b4d2b574eb5f16d8cef988bd368bfe27c72ceb77d5683\": container with ID starting with 38e9a6e9a8f81b104e6b4d2b574eb5f16d8cef988bd368bfe27c72ceb77d5683 not found: ID does not exist" Mar 16 16:16:58 crc kubenswrapper[5120]: I0316 16:16:58.876035 5120 scope.go:117] "RemoveContainer" containerID="b4901eaab9aa6b825c271f8a83ab766c1d744bc325f732147aa91286293f1608" Mar 16 16:16:58 crc kubenswrapper[5120]: I0316 16:16:58.877439 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4901eaab9aa6b825c271f8a83ab766c1d744bc325f732147aa91286293f1608"} err="failed to get container status \"b4901eaab9aa6b825c271f8a83ab766c1d744bc325f732147aa91286293f1608\": rpc error: code = NotFound desc = could not find container \"b4901eaab9aa6b825c271f8a83ab766c1d744bc325f732147aa91286293f1608\": container with ID starting with b4901eaab9aa6b825c271f8a83ab766c1d744bc325f732147aa91286293f1608 not found: ID does not exist" Mar 16 16:16:58 crc kubenswrapper[5120]: I0316 16:16:58.877482 5120 scope.go:117] "RemoveContainer" containerID="d779bd16d2467008fd0f078e50a0d3e4a6d8293f3a7bcc3ab5d43f1085a0a6b1" Mar 16 16:16:58 crc kubenswrapper[5120]: I0316 16:16:58.877831 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d779bd16d2467008fd0f078e50a0d3e4a6d8293f3a7bcc3ab5d43f1085a0a6b1"} err="failed to get container status \"d779bd16d2467008fd0f078e50a0d3e4a6d8293f3a7bcc3ab5d43f1085a0a6b1\": rpc error: code = NotFound desc = could not find container \"d779bd16d2467008fd0f078e50a0d3e4a6d8293f3a7bcc3ab5d43f1085a0a6b1\": container with ID starting with d779bd16d2467008fd0f078e50a0d3e4a6d8293f3a7bcc3ab5d43f1085a0a6b1 not found: ID does not exist" Mar 16 16:16:58 crc kubenswrapper[5120]: I0316 16:16:58.912380 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:16:58 crc kubenswrapper[5120]: I0316 16:16:58.920890 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:16:58 crc kubenswrapper[5120]: I0316 16:16:58.930062 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:16:58 crc kubenswrapper[5120]: I0316 16:16:58.931367 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46db769c-ef7b-4e05-b69c-1483b71e7bad" containerName="ceilometer-central-agent" Mar 16 16:16:58 crc kubenswrapper[5120]: I0316 16:16:58.931388 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="46db769c-ef7b-4e05-b69c-1483b71e7bad" containerName="ceilometer-central-agent" Mar 16 16:16:58 crc kubenswrapper[5120]: I0316 16:16:58.931403 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46db769c-ef7b-4e05-b69c-1483b71e7bad" containerName="proxy-httpd" Mar 16 16:16:58 crc kubenswrapper[5120]: I0316 16:16:58.931409 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="46db769c-ef7b-4e05-b69c-1483b71e7bad" containerName="proxy-httpd" Mar 16 16:16:58 crc kubenswrapper[5120]: I0316 16:16:58.931422 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46db769c-ef7b-4e05-b69c-1483b71e7bad" containerName="sg-core" Mar 16 16:16:58 crc kubenswrapper[5120]: I0316 16:16:58.931428 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="46db769c-ef7b-4e05-b69c-1483b71e7bad" containerName="sg-core" Mar 16 16:16:58 crc kubenswrapper[5120]: I0316 16:16:58.931464 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46db769c-ef7b-4e05-b69c-1483b71e7bad" containerName="ceilometer-notification-agent" Mar 16 16:16:58 crc kubenswrapper[5120]: I0316 16:16:58.931477 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="46db769c-ef7b-4e05-b69c-1483b71e7bad" containerName="ceilometer-notification-agent" Mar 16 16:16:58 crc kubenswrapper[5120]: I0316 16:16:58.931643 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="46db769c-ef7b-4e05-b69c-1483b71e7bad" containerName="proxy-httpd" Mar 16 16:16:58 crc kubenswrapper[5120]: I0316 16:16:58.931659 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="46db769c-ef7b-4e05-b69c-1483b71e7bad" containerName="ceilometer-notification-agent" Mar 16 16:16:58 crc kubenswrapper[5120]: I0316 16:16:58.931668 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="46db769c-ef7b-4e05-b69c-1483b71e7bad" containerName="sg-core" Mar 16 16:16:58 crc kubenswrapper[5120]: I0316 16:16:58.931677 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="46db769c-ef7b-4e05-b69c-1483b71e7bad" containerName="ceilometer-central-agent" Mar 16 16:16:58 crc kubenswrapper[5120]: I0316 16:16:58.937609 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:16:58 crc kubenswrapper[5120]: I0316 16:16:58.938044 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:16:58 crc kubenswrapper[5120]: I0316 16:16:58.940470 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 16:16:58 crc kubenswrapper[5120]: I0316 16:16:58.940685 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ceilometer-internal-svc\"" Mar 16 16:16:58 crc kubenswrapper[5120]: I0316 16:16:58.941045 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 16:16:59 crc kubenswrapper[5120]: I0316 16:16:59.062684 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t56cx\" (UniqueName: \"kubernetes.io/projected/820eb766-0332-4c32-b7b0-0beea8bcd28c-kube-api-access-t56cx\") pod \"ceilometer-0\" (UID: \"820eb766-0332-4c32-b7b0-0beea8bcd28c\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:16:59 crc kubenswrapper[5120]: I0316 16:16:59.063100 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/820eb766-0332-4c32-b7b0-0beea8bcd28c-run-httpd\") pod \"ceilometer-0\" (UID: \"820eb766-0332-4c32-b7b0-0beea8bcd28c\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:16:59 crc kubenswrapper[5120]: I0316 16:16:59.063184 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/820eb766-0332-4c32-b7b0-0beea8bcd28c-scripts\") pod \"ceilometer-0\" (UID: \"820eb766-0332-4c32-b7b0-0beea8bcd28c\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:16:59 crc kubenswrapper[5120]: I0316 16:16:59.063224 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/820eb766-0332-4c32-b7b0-0beea8bcd28c-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"820eb766-0332-4c32-b7b0-0beea8bcd28c\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:16:59 crc kubenswrapper[5120]: I0316 16:16:59.063261 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/820eb766-0332-4c32-b7b0-0beea8bcd28c-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"820eb766-0332-4c32-b7b0-0beea8bcd28c\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:16:59 crc kubenswrapper[5120]: I0316 16:16:59.063340 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/820eb766-0332-4c32-b7b0-0beea8bcd28c-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"820eb766-0332-4c32-b7b0-0beea8bcd28c\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:16:59 crc kubenswrapper[5120]: I0316 16:16:59.063367 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/820eb766-0332-4c32-b7b0-0beea8bcd28c-log-httpd\") pod \"ceilometer-0\" (UID: \"820eb766-0332-4c32-b7b0-0beea8bcd28c\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:16:59 crc kubenswrapper[5120]: I0316 16:16:59.063420 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/820eb766-0332-4c32-b7b0-0beea8bcd28c-config-data\") pod \"ceilometer-0\" (UID: \"820eb766-0332-4c32-b7b0-0beea8bcd28c\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:16:59 crc kubenswrapper[5120]: I0316 16:16:59.165337 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/820eb766-0332-4c32-b7b0-0beea8bcd28c-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"820eb766-0332-4c32-b7b0-0beea8bcd28c\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:16:59 crc kubenswrapper[5120]: I0316 16:16:59.165482 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/820eb766-0332-4c32-b7b0-0beea8bcd28c-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"820eb766-0332-4c32-b7b0-0beea8bcd28c\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:16:59 crc kubenswrapper[5120]: I0316 16:16:59.165520 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/820eb766-0332-4c32-b7b0-0beea8bcd28c-log-httpd\") pod \"ceilometer-0\" (UID: \"820eb766-0332-4c32-b7b0-0beea8bcd28c\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:16:59 crc kubenswrapper[5120]: I0316 16:16:59.165573 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/820eb766-0332-4c32-b7b0-0beea8bcd28c-config-data\") pod \"ceilometer-0\" (UID: \"820eb766-0332-4c32-b7b0-0beea8bcd28c\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:16:59 crc kubenswrapper[5120]: I0316 16:16:59.165668 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t56cx\" (UniqueName: \"kubernetes.io/projected/820eb766-0332-4c32-b7b0-0beea8bcd28c-kube-api-access-t56cx\") pod \"ceilometer-0\" (UID: \"820eb766-0332-4c32-b7b0-0beea8bcd28c\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:16:59 crc kubenswrapper[5120]: I0316 16:16:59.165694 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/820eb766-0332-4c32-b7b0-0beea8bcd28c-run-httpd\") pod \"ceilometer-0\" (UID: \"820eb766-0332-4c32-b7b0-0beea8bcd28c\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:16:59 crc kubenswrapper[5120]: I0316 16:16:59.165735 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/820eb766-0332-4c32-b7b0-0beea8bcd28c-scripts\") pod \"ceilometer-0\" (UID: \"820eb766-0332-4c32-b7b0-0beea8bcd28c\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:16:59 crc kubenswrapper[5120]: I0316 16:16:59.165792 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/820eb766-0332-4c32-b7b0-0beea8bcd28c-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"820eb766-0332-4c32-b7b0-0beea8bcd28c\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:16:59 crc kubenswrapper[5120]: I0316 16:16:59.166493 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/820eb766-0332-4c32-b7b0-0beea8bcd28c-run-httpd\") pod \"ceilometer-0\" (UID: \"820eb766-0332-4c32-b7b0-0beea8bcd28c\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:16:59 crc kubenswrapper[5120]: I0316 16:16:59.166572 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/820eb766-0332-4c32-b7b0-0beea8bcd28c-log-httpd\") pod \"ceilometer-0\" (UID: \"820eb766-0332-4c32-b7b0-0beea8bcd28c\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:16:59 crc kubenswrapper[5120]: I0316 16:16:59.170214 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/820eb766-0332-4c32-b7b0-0beea8bcd28c-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"820eb766-0332-4c32-b7b0-0beea8bcd28c\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:16:59 crc kubenswrapper[5120]: I0316 16:16:59.171238 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/820eb766-0332-4c32-b7b0-0beea8bcd28c-scripts\") pod \"ceilometer-0\" (UID: \"820eb766-0332-4c32-b7b0-0beea8bcd28c\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:16:59 crc kubenswrapper[5120]: I0316 16:16:59.173066 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/820eb766-0332-4c32-b7b0-0beea8bcd28c-config-data\") pod \"ceilometer-0\" (UID: \"820eb766-0332-4c32-b7b0-0beea8bcd28c\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:16:59 crc kubenswrapper[5120]: I0316 16:16:59.173157 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/820eb766-0332-4c32-b7b0-0beea8bcd28c-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"820eb766-0332-4c32-b7b0-0beea8bcd28c\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:16:59 crc kubenswrapper[5120]: I0316 16:16:59.173640 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/820eb766-0332-4c32-b7b0-0beea8bcd28c-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"820eb766-0332-4c32-b7b0-0beea8bcd28c\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:16:59 crc kubenswrapper[5120]: I0316 16:16:59.189410 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t56cx\" (UniqueName: \"kubernetes.io/projected/820eb766-0332-4c32-b7b0-0beea8bcd28c-kube-api-access-t56cx\") pod \"ceilometer-0\" (UID: \"820eb766-0332-4c32-b7b0-0beea8bcd28c\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:16:59 crc kubenswrapper[5120]: I0316 16:16:59.260646 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:16:59 crc kubenswrapper[5120]: I0316 16:16:59.308549 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:16:59 crc kubenswrapper[5120]: I0316 16:16:59.567793 5120 generic.go:358] "Generic (PLEG): container finished" podID="be20213e-52c5-4771-82b6-56878e525cc5" containerID="5057377e4901bf855cfe9e8e8561e877e6549591a414a40b76cc5c25839e76e9" exitCode=143 Mar 16 16:16:59 crc kubenswrapper[5120]: I0316 16:16:59.567862 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"be20213e-52c5-4771-82b6-56878e525cc5","Type":"ContainerDied","Data":"5057377e4901bf855cfe9e8e8561e877e6549591a414a40b76cc5c25839e76e9"} Mar 16 16:16:59 crc kubenswrapper[5120]: I0316 16:16:59.706788 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:17:00 crc kubenswrapper[5120]: I0316 16:17:00.582084 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"820eb766-0332-4c32-b7b0-0beea8bcd28c","Type":"ContainerStarted","Data":"9427d5d428883aaa8a34fc6d26e6842ff6ba9eb64042859223828b798e3bcf7e"} Mar 16 16:17:00 crc kubenswrapper[5120]: I0316 16:17:00.582492 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"820eb766-0332-4c32-b7b0-0beea8bcd28c","Type":"ContainerStarted","Data":"ee425a8ab3fa1046b7fff8e57bbe9866971f713412e869d6a0fcad1b6605584a"} Mar 16 16:17:00 crc kubenswrapper[5120]: I0316 16:17:00.677643 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="46db769c-ef7b-4e05-b69c-1483b71e7bad" path="/var/lib/kubelet/pods/46db769c-ef7b-4e05-b69c-1483b71e7bad/volumes" Mar 16 16:17:01 crc kubenswrapper[5120]: I0316 16:17:01.593171 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"820eb766-0332-4c32-b7b0-0beea8bcd28c","Type":"ContainerStarted","Data":"d9ffa4a5b0b95c20d5c35e56fd4a8e36015a02119463d075a7fd8c0939106403"} Mar 16 16:17:02 crc kubenswrapper[5120]: I0316 16:17:02.221974 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:17:02 crc kubenswrapper[5120]: I0316 16:17:02.343617 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lfrlb\" (UniqueName: \"kubernetes.io/projected/be20213e-52c5-4771-82b6-56878e525cc5-kube-api-access-lfrlb\") pod \"be20213e-52c5-4771-82b6-56878e525cc5\" (UID: \"be20213e-52c5-4771-82b6-56878e525cc5\") " Mar 16 16:17:02 crc kubenswrapper[5120]: I0316 16:17:02.343724 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/be20213e-52c5-4771-82b6-56878e525cc5-config-data\") pod \"be20213e-52c5-4771-82b6-56878e525cc5\" (UID: \"be20213e-52c5-4771-82b6-56878e525cc5\") " Mar 16 16:17:02 crc kubenswrapper[5120]: I0316 16:17:02.343748 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/be20213e-52c5-4771-82b6-56878e525cc5-logs\") pod \"be20213e-52c5-4771-82b6-56878e525cc5\" (UID: \"be20213e-52c5-4771-82b6-56878e525cc5\") " Mar 16 16:17:02 crc kubenswrapper[5120]: I0316 16:17:02.343795 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/be20213e-52c5-4771-82b6-56878e525cc5-combined-ca-bundle\") pod \"be20213e-52c5-4771-82b6-56878e525cc5\" (UID: \"be20213e-52c5-4771-82b6-56878e525cc5\") " Mar 16 16:17:02 crc kubenswrapper[5120]: I0316 16:17:02.345158 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be20213e-52c5-4771-82b6-56878e525cc5-logs" (OuterVolumeSpecName: "logs") pod "be20213e-52c5-4771-82b6-56878e525cc5" (UID: "be20213e-52c5-4771-82b6-56878e525cc5"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:17:02 crc kubenswrapper[5120]: I0316 16:17:02.345801 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/be20213e-52c5-4771-82b6-56878e525cc5-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:17:02 crc kubenswrapper[5120]: I0316 16:17:02.354032 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be20213e-52c5-4771-82b6-56878e525cc5-kube-api-access-lfrlb" (OuterVolumeSpecName: "kube-api-access-lfrlb") pod "be20213e-52c5-4771-82b6-56878e525cc5" (UID: "be20213e-52c5-4771-82b6-56878e525cc5"). InnerVolumeSpecName "kube-api-access-lfrlb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:17:02 crc kubenswrapper[5120]: I0316 16:17:02.373990 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/be20213e-52c5-4771-82b6-56878e525cc5-config-data" (OuterVolumeSpecName: "config-data") pod "be20213e-52c5-4771-82b6-56878e525cc5" (UID: "be20213e-52c5-4771-82b6-56878e525cc5"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:17:02 crc kubenswrapper[5120]: I0316 16:17:02.376885 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/be20213e-52c5-4771-82b6-56878e525cc5-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "be20213e-52c5-4771-82b6-56878e525cc5" (UID: "be20213e-52c5-4771-82b6-56878e525cc5"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:17:02 crc kubenswrapper[5120]: I0316 16:17:02.448078 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lfrlb\" (UniqueName: \"kubernetes.io/projected/be20213e-52c5-4771-82b6-56878e525cc5-kube-api-access-lfrlb\") on node \"crc\" DevicePath \"\"" Mar 16 16:17:02 crc kubenswrapper[5120]: I0316 16:17:02.448254 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/be20213e-52c5-4771-82b6-56878e525cc5-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:17:02 crc kubenswrapper[5120]: I0316 16:17:02.448340 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/be20213e-52c5-4771-82b6-56878e525cc5-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:17:03 crc kubenswrapper[5120]: I0316 16:17:02.608580 5120 generic.go:358] "Generic (PLEG): container finished" podID="be20213e-52c5-4771-82b6-56878e525cc5" containerID="c7733de8b9f8de19f9755e04ae675c4a5edd99da05bf7430e130caab616667a3" exitCode=0 Mar 16 16:17:03 crc kubenswrapper[5120]: I0316 16:17:02.608786 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"be20213e-52c5-4771-82b6-56878e525cc5","Type":"ContainerDied","Data":"c7733de8b9f8de19f9755e04ae675c4a5edd99da05bf7430e130caab616667a3"} Mar 16 16:17:03 crc kubenswrapper[5120]: I0316 16:17:02.608818 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:17:03 crc kubenswrapper[5120]: I0316 16:17:02.608855 5120 scope.go:117] "RemoveContainer" containerID="c7733de8b9f8de19f9755e04ae675c4a5edd99da05bf7430e130caab616667a3" Mar 16 16:17:03 crc kubenswrapper[5120]: I0316 16:17:02.608840 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"be20213e-52c5-4771-82b6-56878e525cc5","Type":"ContainerDied","Data":"2d0696ca48f6eb8581c3fc910da1c764eeee5f922d71139e60bfc73fbfe2f083"} Mar 16 16:17:03 crc kubenswrapper[5120]: I0316 16:17:02.612509 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"820eb766-0332-4c32-b7b0-0beea8bcd28c","Type":"ContainerStarted","Data":"8b474ae3301c7f42444560e2671ed039715c59ae7dcb7d3aa20f389095bc45f4"} Mar 16 16:17:03 crc kubenswrapper[5120]: I0316 16:17:02.639915 5120 scope.go:117] "RemoveContainer" containerID="5057377e4901bf855cfe9e8e8561e877e6549591a414a40b76cc5c25839e76e9" Mar 16 16:17:03 crc kubenswrapper[5120]: I0316 16:17:02.674009 5120 scope.go:117] "RemoveContainer" containerID="c7733de8b9f8de19f9755e04ae675c4a5edd99da05bf7430e130caab616667a3" Mar 16 16:17:03 crc kubenswrapper[5120]: E0316 16:17:02.676153 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c7733de8b9f8de19f9755e04ae675c4a5edd99da05bf7430e130caab616667a3\": container with ID starting with c7733de8b9f8de19f9755e04ae675c4a5edd99da05bf7430e130caab616667a3 not found: ID does not exist" containerID="c7733de8b9f8de19f9755e04ae675c4a5edd99da05bf7430e130caab616667a3" Mar 16 16:17:03 crc kubenswrapper[5120]: I0316 16:17:02.676240 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7733de8b9f8de19f9755e04ae675c4a5edd99da05bf7430e130caab616667a3"} err="failed to get container status \"c7733de8b9f8de19f9755e04ae675c4a5edd99da05bf7430e130caab616667a3\": rpc error: code = NotFound desc = could not find container \"c7733de8b9f8de19f9755e04ae675c4a5edd99da05bf7430e130caab616667a3\": container with ID starting with c7733de8b9f8de19f9755e04ae675c4a5edd99da05bf7430e130caab616667a3 not found: ID does not exist" Mar 16 16:17:03 crc kubenswrapper[5120]: I0316 16:17:02.676302 5120 scope.go:117] "RemoveContainer" containerID="5057377e4901bf855cfe9e8e8561e877e6549591a414a40b76cc5c25839e76e9" Mar 16 16:17:03 crc kubenswrapper[5120]: E0316 16:17:02.677071 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5057377e4901bf855cfe9e8e8561e877e6549591a414a40b76cc5c25839e76e9\": container with ID starting with 5057377e4901bf855cfe9e8e8561e877e6549591a414a40b76cc5c25839e76e9 not found: ID does not exist" containerID="5057377e4901bf855cfe9e8e8561e877e6549591a414a40b76cc5c25839e76e9" Mar 16 16:17:03 crc kubenswrapper[5120]: I0316 16:17:02.677108 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5057377e4901bf855cfe9e8e8561e877e6549591a414a40b76cc5c25839e76e9"} err="failed to get container status \"5057377e4901bf855cfe9e8e8561e877e6549591a414a40b76cc5c25839e76e9\": rpc error: code = NotFound desc = could not find container \"5057377e4901bf855cfe9e8e8561e877e6549591a414a40b76cc5c25839e76e9\": container with ID starting with 5057377e4901bf855cfe9e8e8561e877e6549591a414a40b76cc5c25839e76e9 not found: ID does not exist" Mar 16 16:17:03 crc kubenswrapper[5120]: I0316 16:17:02.695612 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:17:03 crc kubenswrapper[5120]: I0316 16:17:02.711691 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:17:03 crc kubenswrapper[5120]: I0316 16:17:02.722658 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:17:03 crc kubenswrapper[5120]: I0316 16:17:02.723770 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be20213e-52c5-4771-82b6-56878e525cc5" containerName="nova-api-log" Mar 16 16:17:03 crc kubenswrapper[5120]: I0316 16:17:02.723784 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="be20213e-52c5-4771-82b6-56878e525cc5" containerName="nova-api-log" Mar 16 16:17:03 crc kubenswrapper[5120]: I0316 16:17:02.723817 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be20213e-52c5-4771-82b6-56878e525cc5" containerName="nova-api-api" Mar 16 16:17:03 crc kubenswrapper[5120]: I0316 16:17:02.723822 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="be20213e-52c5-4771-82b6-56878e525cc5" containerName="nova-api-api" Mar 16 16:17:03 crc kubenswrapper[5120]: I0316 16:17:02.723990 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="be20213e-52c5-4771-82b6-56878e525cc5" containerName="nova-api-log" Mar 16 16:17:03 crc kubenswrapper[5120]: I0316 16:17:02.724012 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="be20213e-52c5-4771-82b6-56878e525cc5" containerName="nova-api-api" Mar 16 16:17:03 crc kubenswrapper[5120]: I0316 16:17:02.735859 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:17:03 crc kubenswrapper[5120]: I0316 16:17:02.736003 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:17:03 crc kubenswrapper[5120]: I0316 16:17:02.737832 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-internal-svc\"" Mar 16 16:17:03 crc kubenswrapper[5120]: I0316 16:17:02.738110 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-config-data\"" Mar 16 16:17:03 crc kubenswrapper[5120]: I0316 16:17:02.738701 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-public-svc\"" Mar 16 16:17:03 crc kubenswrapper[5120]: I0316 16:17:02.859719 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6b2b\" (UniqueName: \"kubernetes.io/projected/9e7f8135-737c-4639-bdd8-46d68e1a617d-kube-api-access-c6b2b\") pod \"nova-api-0\" (UID: \"9e7f8135-737c-4639-bdd8-46d68e1a617d\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:17:03 crc kubenswrapper[5120]: I0316 16:17:02.859834 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/9e7f8135-737c-4639-bdd8-46d68e1a617d-internal-tls-certs\") pod \"nova-api-0\" (UID: \"9e7f8135-737c-4639-bdd8-46d68e1a617d\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:17:03 crc kubenswrapper[5120]: I0316 16:17:02.859867 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9e7f8135-737c-4639-bdd8-46d68e1a617d-config-data\") pod \"nova-api-0\" (UID: \"9e7f8135-737c-4639-bdd8-46d68e1a617d\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:17:03 crc kubenswrapper[5120]: I0316 16:17:02.859931 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9e7f8135-737c-4639-bdd8-46d68e1a617d-logs\") pod \"nova-api-0\" (UID: \"9e7f8135-737c-4639-bdd8-46d68e1a617d\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:17:03 crc kubenswrapper[5120]: I0316 16:17:02.860143 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9e7f8135-737c-4639-bdd8-46d68e1a617d-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"9e7f8135-737c-4639-bdd8-46d68e1a617d\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:17:03 crc kubenswrapper[5120]: I0316 16:17:02.860265 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/9e7f8135-737c-4639-bdd8-46d68e1a617d-public-tls-certs\") pod \"nova-api-0\" (UID: \"9e7f8135-737c-4639-bdd8-46d68e1a617d\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:17:03 crc kubenswrapper[5120]: I0316 16:17:02.965027 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c6b2b\" (UniqueName: \"kubernetes.io/projected/9e7f8135-737c-4639-bdd8-46d68e1a617d-kube-api-access-c6b2b\") pod \"nova-api-0\" (UID: \"9e7f8135-737c-4639-bdd8-46d68e1a617d\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:17:03 crc kubenswrapper[5120]: I0316 16:17:02.965093 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/9e7f8135-737c-4639-bdd8-46d68e1a617d-internal-tls-certs\") pod \"nova-api-0\" (UID: \"9e7f8135-737c-4639-bdd8-46d68e1a617d\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:17:03 crc kubenswrapper[5120]: I0316 16:17:02.965116 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9e7f8135-737c-4639-bdd8-46d68e1a617d-config-data\") pod \"nova-api-0\" (UID: \"9e7f8135-737c-4639-bdd8-46d68e1a617d\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:17:03 crc kubenswrapper[5120]: I0316 16:17:02.965159 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9e7f8135-737c-4639-bdd8-46d68e1a617d-logs\") pod \"nova-api-0\" (UID: \"9e7f8135-737c-4639-bdd8-46d68e1a617d\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:17:03 crc kubenswrapper[5120]: I0316 16:17:02.965238 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9e7f8135-737c-4639-bdd8-46d68e1a617d-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"9e7f8135-737c-4639-bdd8-46d68e1a617d\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:17:03 crc kubenswrapper[5120]: I0316 16:17:02.965284 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/9e7f8135-737c-4639-bdd8-46d68e1a617d-public-tls-certs\") pod \"nova-api-0\" (UID: \"9e7f8135-737c-4639-bdd8-46d68e1a617d\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:17:03 crc kubenswrapper[5120]: I0316 16:17:02.971639 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/9e7f8135-737c-4639-bdd8-46d68e1a617d-public-tls-certs\") pod \"nova-api-0\" (UID: \"9e7f8135-737c-4639-bdd8-46d68e1a617d\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:17:03 crc kubenswrapper[5120]: I0316 16:17:02.971895 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9e7f8135-737c-4639-bdd8-46d68e1a617d-logs\") pod \"nova-api-0\" (UID: \"9e7f8135-737c-4639-bdd8-46d68e1a617d\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:17:03 crc kubenswrapper[5120]: I0316 16:17:02.972820 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9e7f8135-737c-4639-bdd8-46d68e1a617d-config-data\") pod \"nova-api-0\" (UID: \"9e7f8135-737c-4639-bdd8-46d68e1a617d\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:17:03 crc kubenswrapper[5120]: I0316 16:17:02.975844 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/9e7f8135-737c-4639-bdd8-46d68e1a617d-internal-tls-certs\") pod \"nova-api-0\" (UID: \"9e7f8135-737c-4639-bdd8-46d68e1a617d\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:17:03 crc kubenswrapper[5120]: I0316 16:17:02.986105 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9e7f8135-737c-4639-bdd8-46d68e1a617d-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"9e7f8135-737c-4639-bdd8-46d68e1a617d\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:17:03 crc kubenswrapper[5120]: I0316 16:17:02.988186 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6b2b\" (UniqueName: \"kubernetes.io/projected/9e7f8135-737c-4639-bdd8-46d68e1a617d-kube-api-access-c6b2b\") pod \"nova-api-0\" (UID: \"9e7f8135-737c-4639-bdd8-46d68e1a617d\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:17:03 crc kubenswrapper[5120]: I0316 16:17:03.062680 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:17:03 crc kubenswrapper[5120]: I0316 16:17:03.492104 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:17:03 crc kubenswrapper[5120]: I0316 16:17:03.623594 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"9e7f8135-737c-4639-bdd8-46d68e1a617d","Type":"ContainerStarted","Data":"e46ecf7ac5c2398dc3163b9caec10fd908db95f3669447d3eed5809af484a2f9"} Mar 16 16:17:04 crc kubenswrapper[5120]: I0316 16:17:04.642082 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"9e7f8135-737c-4639-bdd8-46d68e1a617d","Type":"ContainerStarted","Data":"4423760983d234cf89f326a9ce253676e3e6b0c280a356f96097c3c830d8ad07"} Mar 16 16:17:04 crc kubenswrapper[5120]: I0316 16:17:04.643097 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"9e7f8135-737c-4639-bdd8-46d68e1a617d","Type":"ContainerStarted","Data":"12572d4dbfa6da89a684a45d45fbbef79f79d94a4c9264be847c926efe2a306c"} Mar 16 16:17:04 crc kubenswrapper[5120]: I0316 16:17:04.648880 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"820eb766-0332-4c32-b7b0-0beea8bcd28c","Type":"ContainerStarted","Data":"423614a513fe08aebaee4c3e76dab7593250907fb7595b138dc90a58c30ca4a3"} Mar 16 16:17:04 crc kubenswrapper[5120]: I0316 16:17:04.649284 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:17:04 crc kubenswrapper[5120]: I0316 16:17:04.649310 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="820eb766-0332-4c32-b7b0-0beea8bcd28c" containerName="sg-core" containerID="cri-o://8b474ae3301c7f42444560e2671ed039715c59ae7dcb7d3aa20f389095bc45f4" gracePeriod=30 Mar 16 16:17:04 crc kubenswrapper[5120]: I0316 16:17:04.649354 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="820eb766-0332-4c32-b7b0-0beea8bcd28c" containerName="ceilometer-notification-agent" containerID="cri-o://d9ffa4a5b0b95c20d5c35e56fd4a8e36015a02119463d075a7fd8c0939106403" gracePeriod=30 Mar 16 16:17:04 crc kubenswrapper[5120]: I0316 16:17:04.649358 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="820eb766-0332-4c32-b7b0-0beea8bcd28c" containerName="proxy-httpd" containerID="cri-o://423614a513fe08aebaee4c3e76dab7593250907fb7595b138dc90a58c30ca4a3" gracePeriod=30 Mar 16 16:17:04 crc kubenswrapper[5120]: I0316 16:17:04.649663 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="820eb766-0332-4c32-b7b0-0beea8bcd28c" containerName="ceilometer-central-agent" containerID="cri-o://9427d5d428883aaa8a34fc6d26e6842ff6ba9eb64042859223828b798e3bcf7e" gracePeriod=30 Mar 16 16:17:04 crc kubenswrapper[5120]: I0316 16:17:04.688082 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=2.688051874 podStartE2EDuration="2.688051874s" podCreationTimestamp="2026-03-16 16:17:02 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:17:04.679711741 +0000 UTC m=+2726.833643438" watchObservedRunningTime="2026-03-16 16:17:04.688051874 +0000 UTC m=+2726.841983541" Mar 16 16:17:04 crc kubenswrapper[5120]: I0316 16:17:04.689619 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="be20213e-52c5-4771-82b6-56878e525cc5" path="/var/lib/kubelet/pods/be20213e-52c5-4771-82b6-56878e525cc5/volumes" Mar 16 16:17:04 crc kubenswrapper[5120]: I0316 16:17:04.718537 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.80544783 podStartE2EDuration="6.718505421s" podCreationTimestamp="2026-03-16 16:16:58 +0000 UTC" firstStartedPulling="2026-03-16 16:16:59.716212978 +0000 UTC m=+2721.870144635" lastFinishedPulling="2026-03-16 16:17:03.629270569 +0000 UTC m=+2725.783202226" observedRunningTime="2026-03-16 16:17:04.70801632 +0000 UTC m=+2726.861947987" watchObservedRunningTime="2026-03-16 16:17:04.718505421 +0000 UTC m=+2726.872437118" Mar 16 16:17:05 crc kubenswrapper[5120]: I0316 16:17:05.744570 5120 generic.go:358] "Generic (PLEG): container finished" podID="820eb766-0332-4c32-b7b0-0beea8bcd28c" containerID="423614a513fe08aebaee4c3e76dab7593250907fb7595b138dc90a58c30ca4a3" exitCode=0 Mar 16 16:17:05 crc kubenswrapper[5120]: I0316 16:17:05.745859 5120 generic.go:358] "Generic (PLEG): container finished" podID="820eb766-0332-4c32-b7b0-0beea8bcd28c" containerID="8b474ae3301c7f42444560e2671ed039715c59ae7dcb7d3aa20f389095bc45f4" exitCode=2 Mar 16 16:17:05 crc kubenswrapper[5120]: I0316 16:17:05.745887 5120 generic.go:358] "Generic (PLEG): container finished" podID="820eb766-0332-4c32-b7b0-0beea8bcd28c" containerID="d9ffa4a5b0b95c20d5c35e56fd4a8e36015a02119463d075a7fd8c0939106403" exitCode=0 Mar 16 16:17:05 crc kubenswrapper[5120]: I0316 16:17:05.744975 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"820eb766-0332-4c32-b7b0-0beea8bcd28c","Type":"ContainerDied","Data":"423614a513fe08aebaee4c3e76dab7593250907fb7595b138dc90a58c30ca4a3"} Mar 16 16:17:05 crc kubenswrapper[5120]: I0316 16:17:05.747406 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"820eb766-0332-4c32-b7b0-0beea8bcd28c","Type":"ContainerDied","Data":"8b474ae3301c7f42444560e2671ed039715c59ae7dcb7d3aa20f389095bc45f4"} Mar 16 16:17:05 crc kubenswrapper[5120]: I0316 16:17:05.747433 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"820eb766-0332-4c32-b7b0-0beea8bcd28c","Type":"ContainerDied","Data":"d9ffa4a5b0b95c20d5c35e56fd4a8e36015a02119463d075a7fd8c0939106403"} Mar 16 16:17:08 crc kubenswrapper[5120]: I0316 16:17:08.305439 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:17:08 crc kubenswrapper[5120]: I0316 16:17:08.382421 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/820eb766-0332-4c32-b7b0-0beea8bcd28c-combined-ca-bundle\") pod \"820eb766-0332-4c32-b7b0-0beea8bcd28c\" (UID: \"820eb766-0332-4c32-b7b0-0beea8bcd28c\") " Mar 16 16:17:08 crc kubenswrapper[5120]: I0316 16:17:08.382706 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/820eb766-0332-4c32-b7b0-0beea8bcd28c-log-httpd\") pod \"820eb766-0332-4c32-b7b0-0beea8bcd28c\" (UID: \"820eb766-0332-4c32-b7b0-0beea8bcd28c\") " Mar 16 16:17:08 crc kubenswrapper[5120]: I0316 16:17:08.382955 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t56cx\" (UniqueName: \"kubernetes.io/projected/820eb766-0332-4c32-b7b0-0beea8bcd28c-kube-api-access-t56cx\") pod \"820eb766-0332-4c32-b7b0-0beea8bcd28c\" (UID: \"820eb766-0332-4c32-b7b0-0beea8bcd28c\") " Mar 16 16:17:08 crc kubenswrapper[5120]: I0316 16:17:08.383035 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/820eb766-0332-4c32-b7b0-0beea8bcd28c-run-httpd\") pod \"820eb766-0332-4c32-b7b0-0beea8bcd28c\" (UID: \"820eb766-0332-4c32-b7b0-0beea8bcd28c\") " Mar 16 16:17:08 crc kubenswrapper[5120]: I0316 16:17:08.383291 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/820eb766-0332-4c32-b7b0-0beea8bcd28c-sg-core-conf-yaml\") pod \"820eb766-0332-4c32-b7b0-0beea8bcd28c\" (UID: \"820eb766-0332-4c32-b7b0-0beea8bcd28c\") " Mar 16 16:17:08 crc kubenswrapper[5120]: I0316 16:17:08.383444 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/820eb766-0332-4c32-b7b0-0beea8bcd28c-scripts\") pod \"820eb766-0332-4c32-b7b0-0beea8bcd28c\" (UID: \"820eb766-0332-4c32-b7b0-0beea8bcd28c\") " Mar 16 16:17:08 crc kubenswrapper[5120]: I0316 16:17:08.383530 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/820eb766-0332-4c32-b7b0-0beea8bcd28c-ceilometer-tls-certs\") pod \"820eb766-0332-4c32-b7b0-0beea8bcd28c\" (UID: \"820eb766-0332-4c32-b7b0-0beea8bcd28c\") " Mar 16 16:17:08 crc kubenswrapper[5120]: I0316 16:17:08.383628 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/820eb766-0332-4c32-b7b0-0beea8bcd28c-config-data\") pod \"820eb766-0332-4c32-b7b0-0beea8bcd28c\" (UID: \"820eb766-0332-4c32-b7b0-0beea8bcd28c\") " Mar 16 16:17:08 crc kubenswrapper[5120]: I0316 16:17:08.383938 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/820eb766-0332-4c32-b7b0-0beea8bcd28c-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "820eb766-0332-4c32-b7b0-0beea8bcd28c" (UID: "820eb766-0332-4c32-b7b0-0beea8bcd28c"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:17:08 crc kubenswrapper[5120]: I0316 16:17:08.384659 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/820eb766-0332-4c32-b7b0-0beea8bcd28c-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "820eb766-0332-4c32-b7b0-0beea8bcd28c" (UID: "820eb766-0332-4c32-b7b0-0beea8bcd28c"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:17:08 crc kubenswrapper[5120]: I0316 16:17:08.385272 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/820eb766-0332-4c32-b7b0-0beea8bcd28c-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:17:08 crc kubenswrapper[5120]: I0316 16:17:08.385300 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/820eb766-0332-4c32-b7b0-0beea8bcd28c-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:17:08 crc kubenswrapper[5120]: I0316 16:17:08.392694 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/820eb766-0332-4c32-b7b0-0beea8bcd28c-scripts" (OuterVolumeSpecName: "scripts") pod "820eb766-0332-4c32-b7b0-0beea8bcd28c" (UID: "820eb766-0332-4c32-b7b0-0beea8bcd28c"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:17:08 crc kubenswrapper[5120]: I0316 16:17:08.392712 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/820eb766-0332-4c32-b7b0-0beea8bcd28c-kube-api-access-t56cx" (OuterVolumeSpecName: "kube-api-access-t56cx") pod "820eb766-0332-4c32-b7b0-0beea8bcd28c" (UID: "820eb766-0332-4c32-b7b0-0beea8bcd28c"). InnerVolumeSpecName "kube-api-access-t56cx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:17:08 crc kubenswrapper[5120]: E0316 16:17:08.403573 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1762669 actualBytes=10240 Mar 16 16:17:08 crc kubenswrapper[5120]: I0316 16:17:08.412446 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/820eb766-0332-4c32-b7b0-0beea8bcd28c-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "820eb766-0332-4c32-b7b0-0beea8bcd28c" (UID: "820eb766-0332-4c32-b7b0-0beea8bcd28c"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:17:08 crc kubenswrapper[5120]: I0316 16:17:08.451967 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/820eb766-0332-4c32-b7b0-0beea8bcd28c-ceilometer-tls-certs" (OuterVolumeSpecName: "ceilometer-tls-certs") pod "820eb766-0332-4c32-b7b0-0beea8bcd28c" (UID: "820eb766-0332-4c32-b7b0-0beea8bcd28c"). InnerVolumeSpecName "ceilometer-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:17:08 crc kubenswrapper[5120]: I0316 16:17:08.454284 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/820eb766-0332-4c32-b7b0-0beea8bcd28c-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "820eb766-0332-4c32-b7b0-0beea8bcd28c" (UID: "820eb766-0332-4c32-b7b0-0beea8bcd28c"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:17:08 crc kubenswrapper[5120]: I0316 16:17:08.480894 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/820eb766-0332-4c32-b7b0-0beea8bcd28c-config-data" (OuterVolumeSpecName: "config-data") pod "820eb766-0332-4c32-b7b0-0beea8bcd28c" (UID: "820eb766-0332-4c32-b7b0-0beea8bcd28c"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:17:08 crc kubenswrapper[5120]: I0316 16:17:08.488185 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/820eb766-0332-4c32-b7b0-0beea8bcd28c-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 16:17:08 crc kubenswrapper[5120]: I0316 16:17:08.488209 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/820eb766-0332-4c32-b7b0-0beea8bcd28c-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:17:08 crc kubenswrapper[5120]: I0316 16:17:08.488218 5120 reconciler_common.go:299] "Volume detached for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/820eb766-0332-4c32-b7b0-0beea8bcd28c-ceilometer-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:17:08 crc kubenswrapper[5120]: I0316 16:17:08.488227 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/820eb766-0332-4c32-b7b0-0beea8bcd28c-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:17:08 crc kubenswrapper[5120]: I0316 16:17:08.488234 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/820eb766-0332-4c32-b7b0-0beea8bcd28c-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:17:08 crc kubenswrapper[5120]: I0316 16:17:08.488243 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t56cx\" (UniqueName: \"kubernetes.io/projected/820eb766-0332-4c32-b7b0-0beea8bcd28c-kube-api-access-t56cx\") on node \"crc\" DevicePath \"\"" Mar 16 16:17:08 crc kubenswrapper[5120]: I0316 16:17:08.512862 5120 scope.go:117] "RemoveContainer" containerID="d63aa185f89b094e212f4b9c1e6a47eba5f4c1879b7497a04e1756dd958d9e0b" Mar 16 16:17:08 crc kubenswrapper[5120]: I0316 16:17:08.540900 5120 scope.go:117] "RemoveContainer" containerID="599f011088e503f3e11d98f29b50e5be3ac4f59b95d2bee1aad84fffd8081a06" Mar 16 16:17:08 crc kubenswrapper[5120]: I0316 16:17:08.575365 5120 scope.go:117] "RemoveContainer" containerID="ea8deddd73fde4c5ea23f81fa45539ab89c9921aa9ad9bb0430924396bb773e6" Mar 16 16:17:08 crc kubenswrapper[5120]: I0316 16:17:08.775517 5120 generic.go:358] "Generic (PLEG): container finished" podID="820eb766-0332-4c32-b7b0-0beea8bcd28c" containerID="9427d5d428883aaa8a34fc6d26e6842ff6ba9eb64042859223828b798e3bcf7e" exitCode=0 Mar 16 16:17:08 crc kubenswrapper[5120]: I0316 16:17:08.776042 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"820eb766-0332-4c32-b7b0-0beea8bcd28c","Type":"ContainerDied","Data":"9427d5d428883aaa8a34fc6d26e6842ff6ba9eb64042859223828b798e3bcf7e"} Mar 16 16:17:08 crc kubenswrapper[5120]: I0316 16:17:08.776095 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"820eb766-0332-4c32-b7b0-0beea8bcd28c","Type":"ContainerDied","Data":"ee425a8ab3fa1046b7fff8e57bbe9866971f713412e869d6a0fcad1b6605584a"} Mar 16 16:17:08 crc kubenswrapper[5120]: I0316 16:17:08.776129 5120 scope.go:117] "RemoveContainer" containerID="423614a513fe08aebaee4c3e76dab7593250907fb7595b138dc90a58c30ca4a3" Mar 16 16:17:08 crc kubenswrapper[5120]: I0316 16:17:08.777301 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:17:08 crc kubenswrapper[5120]: I0316 16:17:08.817123 5120 scope.go:117] "RemoveContainer" containerID="8b474ae3301c7f42444560e2671ed039715c59ae7dcb7d3aa20f389095bc45f4" Mar 16 16:17:08 crc kubenswrapper[5120]: I0316 16:17:08.821472 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:17:08 crc kubenswrapper[5120]: I0316 16:17:08.834031 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:17:08 crc kubenswrapper[5120]: I0316 16:17:08.856615 5120 scope.go:117] "RemoveContainer" containerID="d9ffa4a5b0b95c20d5c35e56fd4a8e36015a02119463d075a7fd8c0939106403" Mar 16 16:17:08 crc kubenswrapper[5120]: I0316 16:17:08.858195 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:17:08 crc kubenswrapper[5120]: I0316 16:17:08.859121 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="820eb766-0332-4c32-b7b0-0beea8bcd28c" containerName="proxy-httpd" Mar 16 16:17:08 crc kubenswrapper[5120]: I0316 16:17:08.859139 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="820eb766-0332-4c32-b7b0-0beea8bcd28c" containerName="proxy-httpd" Mar 16 16:17:08 crc kubenswrapper[5120]: I0316 16:17:08.859155 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="820eb766-0332-4c32-b7b0-0beea8bcd28c" containerName="sg-core" Mar 16 16:17:08 crc kubenswrapper[5120]: I0316 16:17:08.859161 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="820eb766-0332-4c32-b7b0-0beea8bcd28c" containerName="sg-core" Mar 16 16:17:08 crc kubenswrapper[5120]: I0316 16:17:08.859205 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="820eb766-0332-4c32-b7b0-0beea8bcd28c" containerName="ceilometer-notification-agent" Mar 16 16:17:08 crc kubenswrapper[5120]: I0316 16:17:08.859212 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="820eb766-0332-4c32-b7b0-0beea8bcd28c" containerName="ceilometer-notification-agent" Mar 16 16:17:08 crc kubenswrapper[5120]: I0316 16:17:08.859228 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="820eb766-0332-4c32-b7b0-0beea8bcd28c" containerName="ceilometer-central-agent" Mar 16 16:17:08 crc kubenswrapper[5120]: I0316 16:17:08.859234 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="820eb766-0332-4c32-b7b0-0beea8bcd28c" containerName="ceilometer-central-agent" Mar 16 16:17:08 crc kubenswrapper[5120]: I0316 16:17:08.859399 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="820eb766-0332-4c32-b7b0-0beea8bcd28c" containerName="ceilometer-notification-agent" Mar 16 16:17:08 crc kubenswrapper[5120]: I0316 16:17:08.859418 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="820eb766-0332-4c32-b7b0-0beea8bcd28c" containerName="proxy-httpd" Mar 16 16:17:08 crc kubenswrapper[5120]: I0316 16:17:08.859427 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="820eb766-0332-4c32-b7b0-0beea8bcd28c" containerName="sg-core" Mar 16 16:17:08 crc kubenswrapper[5120]: I0316 16:17:08.859435 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="820eb766-0332-4c32-b7b0-0beea8bcd28c" containerName="ceilometer-central-agent" Mar 16 16:17:08 crc kubenswrapper[5120]: I0316 16:17:08.868938 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:17:08 crc kubenswrapper[5120]: I0316 16:17:08.875457 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:17:08 crc kubenswrapper[5120]: I0316 16:17:08.877169 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ceilometer-internal-svc\"" Mar 16 16:17:08 crc kubenswrapper[5120]: I0316 16:17:08.877515 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 16:17:08 crc kubenswrapper[5120]: I0316 16:17:08.877790 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 16:17:08 crc kubenswrapper[5120]: I0316 16:17:08.949148 5120 scope.go:117] "RemoveContainer" containerID="9427d5d428883aaa8a34fc6d26e6842ff6ba9eb64042859223828b798e3bcf7e" Mar 16 16:17:08 crc kubenswrapper[5120]: I0316 16:17:08.969546 5120 scope.go:117] "RemoveContainer" containerID="423614a513fe08aebaee4c3e76dab7593250907fb7595b138dc90a58c30ca4a3" Mar 16 16:17:08 crc kubenswrapper[5120]: E0316 16:17:08.969917 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"423614a513fe08aebaee4c3e76dab7593250907fb7595b138dc90a58c30ca4a3\": container with ID starting with 423614a513fe08aebaee4c3e76dab7593250907fb7595b138dc90a58c30ca4a3 not found: ID does not exist" containerID="423614a513fe08aebaee4c3e76dab7593250907fb7595b138dc90a58c30ca4a3" Mar 16 16:17:08 crc kubenswrapper[5120]: I0316 16:17:08.969961 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"423614a513fe08aebaee4c3e76dab7593250907fb7595b138dc90a58c30ca4a3"} err="failed to get container status \"423614a513fe08aebaee4c3e76dab7593250907fb7595b138dc90a58c30ca4a3\": rpc error: code = NotFound desc = could not find container \"423614a513fe08aebaee4c3e76dab7593250907fb7595b138dc90a58c30ca4a3\": container with ID starting with 423614a513fe08aebaee4c3e76dab7593250907fb7595b138dc90a58c30ca4a3 not found: ID does not exist" Mar 16 16:17:08 crc kubenswrapper[5120]: I0316 16:17:08.969987 5120 scope.go:117] "RemoveContainer" containerID="8b474ae3301c7f42444560e2671ed039715c59ae7dcb7d3aa20f389095bc45f4" Mar 16 16:17:08 crc kubenswrapper[5120]: E0316 16:17:08.970258 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b474ae3301c7f42444560e2671ed039715c59ae7dcb7d3aa20f389095bc45f4\": container with ID starting with 8b474ae3301c7f42444560e2671ed039715c59ae7dcb7d3aa20f389095bc45f4 not found: ID does not exist" containerID="8b474ae3301c7f42444560e2671ed039715c59ae7dcb7d3aa20f389095bc45f4" Mar 16 16:17:08 crc kubenswrapper[5120]: I0316 16:17:08.970312 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b474ae3301c7f42444560e2671ed039715c59ae7dcb7d3aa20f389095bc45f4"} err="failed to get container status \"8b474ae3301c7f42444560e2671ed039715c59ae7dcb7d3aa20f389095bc45f4\": rpc error: code = NotFound desc = could not find container \"8b474ae3301c7f42444560e2671ed039715c59ae7dcb7d3aa20f389095bc45f4\": container with ID starting with 8b474ae3301c7f42444560e2671ed039715c59ae7dcb7d3aa20f389095bc45f4 not found: ID does not exist" Mar 16 16:17:08 crc kubenswrapper[5120]: I0316 16:17:08.970346 5120 scope.go:117] "RemoveContainer" containerID="d9ffa4a5b0b95c20d5c35e56fd4a8e36015a02119463d075a7fd8c0939106403" Mar 16 16:17:08 crc kubenswrapper[5120]: E0316 16:17:08.970596 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d9ffa4a5b0b95c20d5c35e56fd4a8e36015a02119463d075a7fd8c0939106403\": container with ID starting with d9ffa4a5b0b95c20d5c35e56fd4a8e36015a02119463d075a7fd8c0939106403 not found: ID does not exist" containerID="d9ffa4a5b0b95c20d5c35e56fd4a8e36015a02119463d075a7fd8c0939106403" Mar 16 16:17:08 crc kubenswrapper[5120]: I0316 16:17:08.970616 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9ffa4a5b0b95c20d5c35e56fd4a8e36015a02119463d075a7fd8c0939106403"} err="failed to get container status \"d9ffa4a5b0b95c20d5c35e56fd4a8e36015a02119463d075a7fd8c0939106403\": rpc error: code = NotFound desc = could not find container \"d9ffa4a5b0b95c20d5c35e56fd4a8e36015a02119463d075a7fd8c0939106403\": container with ID starting with d9ffa4a5b0b95c20d5c35e56fd4a8e36015a02119463d075a7fd8c0939106403 not found: ID does not exist" Mar 16 16:17:08 crc kubenswrapper[5120]: I0316 16:17:08.970629 5120 scope.go:117] "RemoveContainer" containerID="9427d5d428883aaa8a34fc6d26e6842ff6ba9eb64042859223828b798e3bcf7e" Mar 16 16:17:08 crc kubenswrapper[5120]: E0316 16:17:08.970825 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9427d5d428883aaa8a34fc6d26e6842ff6ba9eb64042859223828b798e3bcf7e\": container with ID starting with 9427d5d428883aaa8a34fc6d26e6842ff6ba9eb64042859223828b798e3bcf7e not found: ID does not exist" containerID="9427d5d428883aaa8a34fc6d26e6842ff6ba9eb64042859223828b798e3bcf7e" Mar 16 16:17:08 crc kubenswrapper[5120]: I0316 16:17:08.970847 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9427d5d428883aaa8a34fc6d26e6842ff6ba9eb64042859223828b798e3bcf7e"} err="failed to get container status \"9427d5d428883aaa8a34fc6d26e6842ff6ba9eb64042859223828b798e3bcf7e\": rpc error: code = NotFound desc = could not find container \"9427d5d428883aaa8a34fc6d26e6842ff6ba9eb64042859223828b798e3bcf7e\": container with ID starting with 9427d5d428883aaa8a34fc6d26e6842ff6ba9eb64042859223828b798e3bcf7e not found: ID does not exist" Mar 16 16:17:08 crc kubenswrapper[5120]: I0316 16:17:08.996831 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/76c6cd23-f4cd-4b95-95b1-252ec9c5cafa-scripts\") pod \"ceilometer-0\" (UID: \"76c6cd23-f4cd-4b95-95b1-252ec9c5cafa\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:17:08 crc kubenswrapper[5120]: I0316 16:17:08.996965 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/76c6cd23-f4cd-4b95-95b1-252ec9c5cafa-config-data\") pod \"ceilometer-0\" (UID: \"76c6cd23-f4cd-4b95-95b1-252ec9c5cafa\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:17:08 crc kubenswrapper[5120]: I0316 16:17:08.997156 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/76c6cd23-f4cd-4b95-95b1-252ec9c5cafa-run-httpd\") pod \"ceilometer-0\" (UID: \"76c6cd23-f4cd-4b95-95b1-252ec9c5cafa\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:17:08 crc kubenswrapper[5120]: I0316 16:17:08.997299 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/76c6cd23-f4cd-4b95-95b1-252ec9c5cafa-log-httpd\") pod \"ceilometer-0\" (UID: \"76c6cd23-f4cd-4b95-95b1-252ec9c5cafa\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:17:08 crc kubenswrapper[5120]: I0316 16:17:08.997439 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xsdzm\" (UniqueName: \"kubernetes.io/projected/76c6cd23-f4cd-4b95-95b1-252ec9c5cafa-kube-api-access-xsdzm\") pod \"ceilometer-0\" (UID: \"76c6cd23-f4cd-4b95-95b1-252ec9c5cafa\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:17:08 crc kubenswrapper[5120]: I0316 16:17:08.997499 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/76c6cd23-f4cd-4b95-95b1-252ec9c5cafa-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"76c6cd23-f4cd-4b95-95b1-252ec9c5cafa\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:17:08 crc kubenswrapper[5120]: I0316 16:17:08.997659 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/76c6cd23-f4cd-4b95-95b1-252ec9c5cafa-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"76c6cd23-f4cd-4b95-95b1-252ec9c5cafa\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:17:08 crc kubenswrapper[5120]: I0316 16:17:08.997850 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/76c6cd23-f4cd-4b95-95b1-252ec9c5cafa-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"76c6cd23-f4cd-4b95-95b1-252ec9c5cafa\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:17:09 crc kubenswrapper[5120]: I0316 16:17:09.099559 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/76c6cd23-f4cd-4b95-95b1-252ec9c5cafa-log-httpd\") pod \"ceilometer-0\" (UID: \"76c6cd23-f4cd-4b95-95b1-252ec9c5cafa\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:17:09 crc kubenswrapper[5120]: I0316 16:17:09.099641 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xsdzm\" (UniqueName: \"kubernetes.io/projected/76c6cd23-f4cd-4b95-95b1-252ec9c5cafa-kube-api-access-xsdzm\") pod \"ceilometer-0\" (UID: \"76c6cd23-f4cd-4b95-95b1-252ec9c5cafa\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:17:09 crc kubenswrapper[5120]: I0316 16:17:09.099673 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/76c6cd23-f4cd-4b95-95b1-252ec9c5cafa-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"76c6cd23-f4cd-4b95-95b1-252ec9c5cafa\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:17:09 crc kubenswrapper[5120]: I0316 16:17:09.099729 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/76c6cd23-f4cd-4b95-95b1-252ec9c5cafa-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"76c6cd23-f4cd-4b95-95b1-252ec9c5cafa\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:17:09 crc kubenswrapper[5120]: I0316 16:17:09.099773 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/76c6cd23-f4cd-4b95-95b1-252ec9c5cafa-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"76c6cd23-f4cd-4b95-95b1-252ec9c5cafa\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:17:09 crc kubenswrapper[5120]: I0316 16:17:09.099842 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/76c6cd23-f4cd-4b95-95b1-252ec9c5cafa-scripts\") pod \"ceilometer-0\" (UID: \"76c6cd23-f4cd-4b95-95b1-252ec9c5cafa\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:17:09 crc kubenswrapper[5120]: I0316 16:17:09.099911 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/76c6cd23-f4cd-4b95-95b1-252ec9c5cafa-config-data\") pod \"ceilometer-0\" (UID: \"76c6cd23-f4cd-4b95-95b1-252ec9c5cafa\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:17:09 crc kubenswrapper[5120]: I0316 16:17:09.099950 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/76c6cd23-f4cd-4b95-95b1-252ec9c5cafa-run-httpd\") pod \"ceilometer-0\" (UID: \"76c6cd23-f4cd-4b95-95b1-252ec9c5cafa\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:17:09 crc kubenswrapper[5120]: I0316 16:17:09.100462 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/76c6cd23-f4cd-4b95-95b1-252ec9c5cafa-run-httpd\") pod \"ceilometer-0\" (UID: \"76c6cd23-f4cd-4b95-95b1-252ec9c5cafa\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:17:09 crc kubenswrapper[5120]: I0316 16:17:09.100691 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/76c6cd23-f4cd-4b95-95b1-252ec9c5cafa-log-httpd\") pod \"ceilometer-0\" (UID: \"76c6cd23-f4cd-4b95-95b1-252ec9c5cafa\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:17:09 crc kubenswrapper[5120]: I0316 16:17:09.105518 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/76c6cd23-f4cd-4b95-95b1-252ec9c5cafa-scripts\") pod \"ceilometer-0\" (UID: \"76c6cd23-f4cd-4b95-95b1-252ec9c5cafa\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:17:09 crc kubenswrapper[5120]: I0316 16:17:09.106159 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/76c6cd23-f4cd-4b95-95b1-252ec9c5cafa-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"76c6cd23-f4cd-4b95-95b1-252ec9c5cafa\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:17:09 crc kubenswrapper[5120]: I0316 16:17:09.106359 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/76c6cd23-f4cd-4b95-95b1-252ec9c5cafa-config-data\") pod \"ceilometer-0\" (UID: \"76c6cd23-f4cd-4b95-95b1-252ec9c5cafa\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:17:09 crc kubenswrapper[5120]: I0316 16:17:09.107707 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/76c6cd23-f4cd-4b95-95b1-252ec9c5cafa-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"76c6cd23-f4cd-4b95-95b1-252ec9c5cafa\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:17:09 crc kubenswrapper[5120]: I0316 16:17:09.127326 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xsdzm\" (UniqueName: \"kubernetes.io/projected/76c6cd23-f4cd-4b95-95b1-252ec9c5cafa-kube-api-access-xsdzm\") pod \"ceilometer-0\" (UID: \"76c6cd23-f4cd-4b95-95b1-252ec9c5cafa\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:17:09 crc kubenswrapper[5120]: I0316 16:17:09.128089 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/76c6cd23-f4cd-4b95-95b1-252ec9c5cafa-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"76c6cd23-f4cd-4b95-95b1-252ec9c5cafa\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:17:09 crc kubenswrapper[5120]: I0316 16:17:09.250211 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:17:09 crc kubenswrapper[5120]: W0316 16:17:09.753116 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod76c6cd23_f4cd_4b95_95b1_252ec9c5cafa.slice/crio-8c8cce4feccff9c9131a8d68f2a8097cd4c069acb839f2f62445ca2dd739cc68 WatchSource:0}: Error finding container 8c8cce4feccff9c9131a8d68f2a8097cd4c069acb839f2f62445ca2dd739cc68: Status 404 returned error can't find the container with id 8c8cce4feccff9c9131a8d68f2a8097cd4c069acb839f2f62445ca2dd739cc68 Mar 16 16:17:09 crc kubenswrapper[5120]: I0316 16:17:09.754289 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:17:09 crc kubenswrapper[5120]: I0316 16:17:09.791059 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"76c6cd23-f4cd-4b95-95b1-252ec9c5cafa","Type":"ContainerStarted","Data":"8c8cce4feccff9c9131a8d68f2a8097cd4c069acb839f2f62445ca2dd739cc68"} Mar 16 16:17:10 crc kubenswrapper[5120]: I0316 16:17:10.681295 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="820eb766-0332-4c32-b7b0-0beea8bcd28c" path="/var/lib/kubelet/pods/820eb766-0332-4c32-b7b0-0beea8bcd28c/volumes" Mar 16 16:17:10 crc kubenswrapper[5120]: I0316 16:17:10.803873 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"76c6cd23-f4cd-4b95-95b1-252ec9c5cafa","Type":"ContainerStarted","Data":"af5fb6c449290fd20f488014a20a2e812dbe3b44b9e9e143413c9ee4a9424499"} Mar 16 16:17:11 crc kubenswrapper[5120]: I0316 16:17:11.817848 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"76c6cd23-f4cd-4b95-95b1-252ec9c5cafa","Type":"ContainerStarted","Data":"cf198603b58bf7b45d7c9f7f1ce555f5fcb8f5b47b0707c2960e22415f81c96e"} Mar 16 16:17:11 crc kubenswrapper[5120]: I0316 16:17:11.818509 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"76c6cd23-f4cd-4b95-95b1-252ec9c5cafa","Type":"ContainerStarted","Data":"35e4423fcf67ea82bfe0fc8b41693767ef5d5424b86c9ca38dce930212eed434"} Mar 16 16:17:13 crc kubenswrapper[5120]: I0316 16:17:13.063814 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:17:13 crc kubenswrapper[5120]: I0316 16:17:13.064413 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:17:13 crc kubenswrapper[5120]: I0316 16:17:13.841948 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"76c6cd23-f4cd-4b95-95b1-252ec9c5cafa","Type":"ContainerStarted","Data":"40002f2be6fa424b030589769c3c029dfacfcdae45b3980ed054abb3abc3c1d9"} Mar 16 16:17:13 crc kubenswrapper[5120]: I0316 16:17:13.842427 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:17:13 crc kubenswrapper[5120]: I0316 16:17:13.908717 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.184038037 podStartE2EDuration="5.908694848s" podCreationTimestamp="2026-03-16 16:17:08 +0000 UTC" firstStartedPulling="2026-03-16 16:17:09.755892313 +0000 UTC m=+2731.909823970" lastFinishedPulling="2026-03-16 16:17:13.480549124 +0000 UTC m=+2735.634480781" observedRunningTime="2026-03-16 16:17:13.861131054 +0000 UTC m=+2736.015062731" watchObservedRunningTime="2026-03-16 16:17:13.908694848 +0000 UTC m=+2736.062626515" Mar 16 16:17:14 crc kubenswrapper[5120]: I0316 16:17:14.073946 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="9e7f8135-737c-4639-bdd8-46d68e1a617d" containerName="nova-api-api" probeResult="failure" output="Get \"https://10.217.1.17:8774/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Mar 16 16:17:14 crc kubenswrapper[5120]: I0316 16:17:14.073940 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="9e7f8135-737c-4639-bdd8-46d68e1a617d" containerName="nova-api-log" probeResult="failure" output="Get \"https://10.217.1.17:8774/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Mar 16 16:17:21 crc kubenswrapper[5120]: I0316 16:17:21.062941 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:17:21 crc kubenswrapper[5120]: I0316 16:17:21.063638 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:17:22 crc kubenswrapper[5120]: I0316 16:17:22.007549 5120 patch_prober.go:28] interesting pod/machine-config-daemon-7bf76 container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 16:17:22 crc kubenswrapper[5120]: I0316 16:17:22.007651 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 16:17:22 crc kubenswrapper[5120]: I0316 16:17:22.007721 5120 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" Mar 16 16:17:22 crc kubenswrapper[5120]: I0316 16:17:22.008739 5120 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="machine-config-daemon" containerStatusID={"Type":"cri-o","ID":"c6f2e7729551b434e995735fce26cb8624554f70ca6b56bae845f839f1f3f2df"} pod="openshift-machine-config-operator/machine-config-daemon-7bf76" containerMessage="Container machine-config-daemon failed liveness probe, will be restarted" Mar 16 16:17:22 crc kubenswrapper[5120]: I0316 16:17:22.008890 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" containerID="cri-o://c6f2e7729551b434e995735fce26cb8624554f70ca6b56bae845f839f1f3f2df" gracePeriod=600 Mar 16 16:17:22 crc kubenswrapper[5120]: I0316 16:17:22.953371 5120 generic.go:358] "Generic (PLEG): container finished" podID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerID="c6f2e7729551b434e995735fce26cb8624554f70ca6b56bae845f839f1f3f2df" exitCode=0 Mar 16 16:17:22 crc kubenswrapper[5120]: I0316 16:17:22.953566 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" event={"ID":"e2275cb4-4905-4d66-a87e-8010120db2bd","Type":"ContainerDied","Data":"c6f2e7729551b434e995735fce26cb8624554f70ca6b56bae845f839f1f3f2df"} Mar 16 16:17:22 crc kubenswrapper[5120]: I0316 16:17:22.954166 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" event={"ID":"e2275cb4-4905-4d66-a87e-8010120db2bd","Type":"ContainerStarted","Data":"f40e444f89abd558ac90555bfd58e04a1c4379a653ba8035c228d2b7a5443eb5"} Mar 16 16:17:22 crc kubenswrapper[5120]: I0316 16:17:22.954199 5120 scope.go:117] "RemoveContainer" containerID="bc2df124cc6ad146d7c7dd2115ac815986fb62978d38895f6d345a4a9b14dbd8" Mar 16 16:17:23 crc kubenswrapper[5120]: I0316 16:17:23.071723 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:17:23 crc kubenswrapper[5120]: I0316 16:17:23.072558 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:17:23 crc kubenswrapper[5120]: I0316 16:17:23.079405 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:17:23 crc kubenswrapper[5120]: I0316 16:17:23.981281 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:17:43 crc kubenswrapper[5120]: I0316 16:17:43.826218 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-operators-9nt5d"] Mar 16 16:17:43 crc kubenswrapper[5120]: I0316 16:17:43.833893 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-9nt5d" Mar 16 16:17:43 crc kubenswrapper[5120]: I0316 16:17:43.853588 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-9nt5d"] Mar 16 16:17:43 crc kubenswrapper[5120]: I0316 16:17:43.917178 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/a9aa8c5d-78c1-43ce-9503-6e2ef87c6520-catalog-content\") pod \"redhat-operators-9nt5d\" (UID: \"a9aa8c5d-78c1-43ce-9503-6e2ef87c6520\") " pod="openshift-marketplace/redhat-operators-9nt5d" Mar 16 16:17:43 crc kubenswrapper[5120]: I0316 16:17:43.917354 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/a9aa8c5d-78c1-43ce-9503-6e2ef87c6520-utilities\") pod \"redhat-operators-9nt5d\" (UID: \"a9aa8c5d-78c1-43ce-9503-6e2ef87c6520\") " pod="openshift-marketplace/redhat-operators-9nt5d" Mar 16 16:17:43 crc kubenswrapper[5120]: I0316 16:17:43.917381 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nlwd4\" (UniqueName: \"kubernetes.io/projected/a9aa8c5d-78c1-43ce-9503-6e2ef87c6520-kube-api-access-nlwd4\") pod \"redhat-operators-9nt5d\" (UID: \"a9aa8c5d-78c1-43ce-9503-6e2ef87c6520\") " pod="openshift-marketplace/redhat-operators-9nt5d" Mar 16 16:17:44 crc kubenswrapper[5120]: I0316 16:17:44.019900 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/a9aa8c5d-78c1-43ce-9503-6e2ef87c6520-catalog-content\") pod \"redhat-operators-9nt5d\" (UID: \"a9aa8c5d-78c1-43ce-9503-6e2ef87c6520\") " pod="openshift-marketplace/redhat-operators-9nt5d" Mar 16 16:17:44 crc kubenswrapper[5120]: I0316 16:17:44.020014 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/a9aa8c5d-78c1-43ce-9503-6e2ef87c6520-utilities\") pod \"redhat-operators-9nt5d\" (UID: \"a9aa8c5d-78c1-43ce-9503-6e2ef87c6520\") " pod="openshift-marketplace/redhat-operators-9nt5d" Mar 16 16:17:44 crc kubenswrapper[5120]: I0316 16:17:44.020040 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nlwd4\" (UniqueName: \"kubernetes.io/projected/a9aa8c5d-78c1-43ce-9503-6e2ef87c6520-kube-api-access-nlwd4\") pod \"redhat-operators-9nt5d\" (UID: \"a9aa8c5d-78c1-43ce-9503-6e2ef87c6520\") " pod="openshift-marketplace/redhat-operators-9nt5d" Mar 16 16:17:44 crc kubenswrapper[5120]: I0316 16:17:44.020536 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/a9aa8c5d-78c1-43ce-9503-6e2ef87c6520-catalog-content\") pod \"redhat-operators-9nt5d\" (UID: \"a9aa8c5d-78c1-43ce-9503-6e2ef87c6520\") " pod="openshift-marketplace/redhat-operators-9nt5d" Mar 16 16:17:44 crc kubenswrapper[5120]: I0316 16:17:44.020899 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/a9aa8c5d-78c1-43ce-9503-6e2ef87c6520-utilities\") pod \"redhat-operators-9nt5d\" (UID: \"a9aa8c5d-78c1-43ce-9503-6e2ef87c6520\") " pod="openshift-marketplace/redhat-operators-9nt5d" Mar 16 16:17:44 crc kubenswrapper[5120]: I0316 16:17:44.047197 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nlwd4\" (UniqueName: \"kubernetes.io/projected/a9aa8c5d-78c1-43ce-9503-6e2ef87c6520-kube-api-access-nlwd4\") pod \"redhat-operators-9nt5d\" (UID: \"a9aa8c5d-78c1-43ce-9503-6e2ef87c6520\") " pod="openshift-marketplace/redhat-operators-9nt5d" Mar 16 16:17:44 crc kubenswrapper[5120]: I0316 16:17:44.158499 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-9nt5d" Mar 16 16:17:44 crc kubenswrapper[5120]: I0316 16:17:44.597282 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-9nt5d"] Mar 16 16:17:44 crc kubenswrapper[5120]: I0316 16:17:44.867161 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:17:45 crc kubenswrapper[5120]: I0316 16:17:45.235747 5120 generic.go:358] "Generic (PLEG): container finished" podID="a9aa8c5d-78c1-43ce-9503-6e2ef87c6520" containerID="d2fbb2b1ad82b81d9b5998b40417bd6c705ce5ddfe7dad9be381ef1c4a4df360" exitCode=0 Mar 16 16:17:45 crc kubenswrapper[5120]: I0316 16:17:45.235812 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-9nt5d" event={"ID":"a9aa8c5d-78c1-43ce-9503-6e2ef87c6520","Type":"ContainerDied","Data":"d2fbb2b1ad82b81d9b5998b40417bd6c705ce5ddfe7dad9be381ef1c4a4df360"} Mar 16 16:17:45 crc kubenswrapper[5120]: I0316 16:17:45.235875 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-9nt5d" event={"ID":"a9aa8c5d-78c1-43ce-9503-6e2ef87c6520","Type":"ContainerStarted","Data":"587faa8e2b87852c846f87b5c31a8141ca2d4e73275e493690ec19b81fe9fe47"} Mar 16 16:17:47 crc kubenswrapper[5120]: I0316 16:17:47.256328 5120 generic.go:358] "Generic (PLEG): container finished" podID="a9aa8c5d-78c1-43ce-9503-6e2ef87c6520" containerID="507cd307b37fb9b60be37e70fbfdce4bc19d3a1a482500e51e802c02ddc04726" exitCode=0 Mar 16 16:17:47 crc kubenswrapper[5120]: I0316 16:17:47.256385 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-9nt5d" event={"ID":"a9aa8c5d-78c1-43ce-9503-6e2ef87c6520","Type":"ContainerDied","Data":"507cd307b37fb9b60be37e70fbfdce4bc19d3a1a482500e51e802c02ddc04726"} Mar 16 16:17:48 crc kubenswrapper[5120]: I0316 16:17:48.274984 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-9nt5d" event={"ID":"a9aa8c5d-78c1-43ce-9503-6e2ef87c6520","Type":"ContainerStarted","Data":"288367643eabb0ee1295994ece8e8c48b647029ba1585d135ce563eabe31aebd"} Mar 16 16:17:48 crc kubenswrapper[5120]: I0316 16:17:48.304130 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/redhat-operators-9nt5d" podStartSLOduration=4.366121802 podStartE2EDuration="5.30410494s" podCreationTimestamp="2026-03-16 16:17:43 +0000 UTC" firstStartedPulling="2026-03-16 16:17:45.23693322 +0000 UTC m=+2767.390864877" lastFinishedPulling="2026-03-16 16:17:46.174916328 +0000 UTC m=+2768.328848015" observedRunningTime="2026-03-16 16:17:48.290072694 +0000 UTC m=+2770.444004351" watchObservedRunningTime="2026-03-16 16:17:48.30410494 +0000 UTC m=+2770.458036627" Mar 16 16:17:49 crc kubenswrapper[5120]: I0316 16:17:49.493999 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovn-controller-5sznk"] Mar 16 16:17:49 crc kubenswrapper[5120]: I0316 16:17:49.502819 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-controller-5sznk" Mar 16 16:17:49 crc kubenswrapper[5120]: I0316 16:17:49.511357 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovncontroller-scripts\"" Mar 16 16:17:49 crc kubenswrapper[5120]: I0316 16:17:49.511531 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ovncontroller-ovndbs\"" Mar 16 16:17:49 crc kubenswrapper[5120]: I0316 16:17:49.511593 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ovncontroller-ovncontroller-dockercfg-8c4q7\"" Mar 16 16:17:49 crc kubenswrapper[5120]: I0316 16:17:49.532405 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovn-controller-ovs-4qzrp"] Mar 16 16:17:49 crc kubenswrapper[5120]: I0316 16:17:49.547214 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8lsg\" (UniqueName: \"kubernetes.io/projected/8305890a-6a7f-4a42-a6af-33ab4f36a9fd-kube-api-access-v8lsg\") pod \"ovn-controller-5sznk\" (UID: \"8305890a-6a7f-4a42-a6af-33ab4f36a9fd\") " pod="openstack-kuttl-tests/ovn-controller-5sznk" Mar 16 16:17:49 crc kubenswrapper[5120]: I0316 16:17:49.547259 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-controller-tls-certs\" (UniqueName: \"kubernetes.io/secret/8305890a-6a7f-4a42-a6af-33ab4f36a9fd-ovn-controller-tls-certs\") pod \"ovn-controller-5sznk\" (UID: \"8305890a-6a7f-4a42-a6af-33ab4f36a9fd\") " pod="openstack-kuttl-tests/ovn-controller-5sznk" Mar 16 16:17:49 crc kubenswrapper[5120]: I0316 16:17:49.547333 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/8305890a-6a7f-4a42-a6af-33ab4f36a9fd-scripts\") pod \"ovn-controller-5sznk\" (UID: \"8305890a-6a7f-4a42-a6af-33ab4f36a9fd\") " pod="openstack-kuttl-tests/ovn-controller-5sznk" Mar 16 16:17:49 crc kubenswrapper[5120]: I0316 16:17:49.547379 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8305890a-6a7f-4a42-a6af-33ab4f36a9fd-combined-ca-bundle\") pod \"ovn-controller-5sznk\" (UID: \"8305890a-6a7f-4a42-a6af-33ab4f36a9fd\") " pod="openstack-kuttl-tests/ovn-controller-5sznk" Mar 16 16:17:49 crc kubenswrapper[5120]: I0316 16:17:49.547517 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-run-ovn\" (UniqueName: \"kubernetes.io/host-path/8305890a-6a7f-4a42-a6af-33ab4f36a9fd-var-run-ovn\") pod \"ovn-controller-5sznk\" (UID: \"8305890a-6a7f-4a42-a6af-33ab4f36a9fd\") " pod="openstack-kuttl-tests/ovn-controller-5sznk" Mar 16 16:17:49 crc kubenswrapper[5120]: I0316 16:17:49.547569 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-log-ovn\" (UniqueName: \"kubernetes.io/host-path/8305890a-6a7f-4a42-a6af-33ab4f36a9fd-var-log-ovn\") pod \"ovn-controller-5sznk\" (UID: \"8305890a-6a7f-4a42-a6af-33ab4f36a9fd\") " pod="openstack-kuttl-tests/ovn-controller-5sznk" Mar 16 16:17:49 crc kubenswrapper[5120]: I0316 16:17:49.547631 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-run\" (UniqueName: \"kubernetes.io/host-path/8305890a-6a7f-4a42-a6af-33ab4f36a9fd-var-run\") pod \"ovn-controller-5sznk\" (UID: \"8305890a-6a7f-4a42-a6af-33ab4f36a9fd\") " pod="openstack-kuttl-tests/ovn-controller-5sznk" Mar 16 16:17:49 crc kubenswrapper[5120]: I0316 16:17:49.548842 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-controller-ovs-4qzrp" Mar 16 16:17:49 crc kubenswrapper[5120]: I0316 16:17:49.637381 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-controller-ovs-4qzrp"] Mar 16 16:17:49 crc kubenswrapper[5120]: I0316 16:17:49.648168 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovn-controller-metrics-f7zgv"] Mar 16 16:17:49 crc kubenswrapper[5120]: I0316 16:17:49.652888 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-run\" (UniqueName: \"kubernetes.io/host-path/8305890a-6a7f-4a42-a6af-33ab4f36a9fd-var-run\") pod \"ovn-controller-5sznk\" (UID: \"8305890a-6a7f-4a42-a6af-33ab4f36a9fd\") " pod="openstack-kuttl-tests/ovn-controller-5sznk" Mar 16 16:17:49 crc kubenswrapper[5120]: I0316 16:17:49.652934 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v8lsg\" (UniqueName: \"kubernetes.io/projected/8305890a-6a7f-4a42-a6af-33ab4f36a9fd-kube-api-access-v8lsg\") pod \"ovn-controller-5sznk\" (UID: \"8305890a-6a7f-4a42-a6af-33ab4f36a9fd\") " pod="openstack-kuttl-tests/ovn-controller-5sznk" Mar 16 16:17:49 crc kubenswrapper[5120]: I0316 16:17:49.652959 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-ovs\" (UniqueName: \"kubernetes.io/host-path/b734d30f-bb89-4e8e-88cd-e6a0f051c64b-etc-ovs\") pod \"ovn-controller-ovs-4qzrp\" (UID: \"b734d30f-bb89-4e8e-88cd-e6a0f051c64b\") " pod="openstack-kuttl-tests/ovn-controller-ovs-4qzrp" Mar 16 16:17:49 crc kubenswrapper[5120]: I0316 16:17:49.652984 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-controller-tls-certs\" (UniqueName: \"kubernetes.io/secret/8305890a-6a7f-4a42-a6af-33ab4f36a9fd-ovn-controller-tls-certs\") pod \"ovn-controller-5sznk\" (UID: \"8305890a-6a7f-4a42-a6af-33ab4f36a9fd\") " pod="openstack-kuttl-tests/ovn-controller-5sznk" Mar 16 16:17:49 crc kubenswrapper[5120]: I0316 16:17:49.653017 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4bn9\" (UniqueName: \"kubernetes.io/projected/b734d30f-bb89-4e8e-88cd-e6a0f051c64b-kube-api-access-w4bn9\") pod \"ovn-controller-ovs-4qzrp\" (UID: \"b734d30f-bb89-4e8e-88cd-e6a0f051c64b\") " pod="openstack-kuttl-tests/ovn-controller-ovs-4qzrp" Mar 16 16:17:49 crc kubenswrapper[5120]: I0316 16:17:49.653038 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib\" (UniqueName: \"kubernetes.io/host-path/b734d30f-bb89-4e8e-88cd-e6a0f051c64b-var-lib\") pod \"ovn-controller-ovs-4qzrp\" (UID: \"b734d30f-bb89-4e8e-88cd-e6a0f051c64b\") " pod="openstack-kuttl-tests/ovn-controller-ovs-4qzrp" Mar 16 16:17:49 crc kubenswrapper[5120]: I0316 16:17:49.653094 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/8305890a-6a7f-4a42-a6af-33ab4f36a9fd-scripts\") pod \"ovn-controller-5sznk\" (UID: \"8305890a-6a7f-4a42-a6af-33ab4f36a9fd\") " pod="openstack-kuttl-tests/ovn-controller-5sznk" Mar 16 16:17:49 crc kubenswrapper[5120]: I0316 16:17:49.653142 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8305890a-6a7f-4a42-a6af-33ab4f36a9fd-combined-ca-bundle\") pod \"ovn-controller-5sznk\" (UID: \"8305890a-6a7f-4a42-a6af-33ab4f36a9fd\") " pod="openstack-kuttl-tests/ovn-controller-5sznk" Mar 16 16:17:49 crc kubenswrapper[5120]: I0316 16:17:49.653188 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/b734d30f-bb89-4e8e-88cd-e6a0f051c64b-scripts\") pod \"ovn-controller-ovs-4qzrp\" (UID: \"b734d30f-bb89-4e8e-88cd-e6a0f051c64b\") " pod="openstack-kuttl-tests/ovn-controller-ovs-4qzrp" Mar 16 16:17:49 crc kubenswrapper[5120]: I0316 16:17:49.653211 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-log\" (UniqueName: \"kubernetes.io/host-path/b734d30f-bb89-4e8e-88cd-e6a0f051c64b-var-log\") pod \"ovn-controller-ovs-4qzrp\" (UID: \"b734d30f-bb89-4e8e-88cd-e6a0f051c64b\") " pod="openstack-kuttl-tests/ovn-controller-ovs-4qzrp" Mar 16 16:17:49 crc kubenswrapper[5120]: I0316 16:17:49.653338 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-run\" (UniqueName: \"kubernetes.io/host-path/b734d30f-bb89-4e8e-88cd-e6a0f051c64b-var-run\") pod \"ovn-controller-ovs-4qzrp\" (UID: \"b734d30f-bb89-4e8e-88cd-e6a0f051c64b\") " pod="openstack-kuttl-tests/ovn-controller-ovs-4qzrp" Mar 16 16:17:49 crc kubenswrapper[5120]: I0316 16:17:49.653375 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-run-ovn\" (UniqueName: \"kubernetes.io/host-path/8305890a-6a7f-4a42-a6af-33ab4f36a9fd-var-run-ovn\") pod \"ovn-controller-5sznk\" (UID: \"8305890a-6a7f-4a42-a6af-33ab4f36a9fd\") " pod="openstack-kuttl-tests/ovn-controller-5sznk" Mar 16 16:17:49 crc kubenswrapper[5120]: I0316 16:17:49.653419 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-log-ovn\" (UniqueName: \"kubernetes.io/host-path/8305890a-6a7f-4a42-a6af-33ab4f36a9fd-var-log-ovn\") pod \"ovn-controller-5sznk\" (UID: \"8305890a-6a7f-4a42-a6af-33ab4f36a9fd\") " pod="openstack-kuttl-tests/ovn-controller-5sznk" Mar 16 16:17:49 crc kubenswrapper[5120]: I0316 16:17:49.653797 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-log-ovn\" (UniqueName: \"kubernetes.io/host-path/8305890a-6a7f-4a42-a6af-33ab4f36a9fd-var-log-ovn\") pod \"ovn-controller-5sznk\" (UID: \"8305890a-6a7f-4a42-a6af-33ab4f36a9fd\") " pod="openstack-kuttl-tests/ovn-controller-5sznk" Mar 16 16:17:49 crc kubenswrapper[5120]: I0316 16:17:49.653854 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-run\" (UniqueName: \"kubernetes.io/host-path/8305890a-6a7f-4a42-a6af-33ab4f36a9fd-var-run\") pod \"ovn-controller-5sznk\" (UID: \"8305890a-6a7f-4a42-a6af-33ab4f36a9fd\") " pod="openstack-kuttl-tests/ovn-controller-5sznk" Mar 16 16:17:49 crc kubenswrapper[5120]: I0316 16:17:49.654832 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-controller-metrics-f7zgv" Mar 16 16:17:49 crc kubenswrapper[5120]: I0316 16:17:49.655587 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/8305890a-6a7f-4a42-a6af-33ab4f36a9fd-scripts\") pod \"ovn-controller-5sznk\" (UID: \"8305890a-6a7f-4a42-a6af-33ab4f36a9fd\") " pod="openstack-kuttl-tests/ovn-controller-5sznk" Mar 16 16:17:49 crc kubenswrapper[5120]: I0316 16:17:49.655800 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-run-ovn\" (UniqueName: \"kubernetes.io/host-path/8305890a-6a7f-4a42-a6af-33ab4f36a9fd-var-run-ovn\") pod \"ovn-controller-5sznk\" (UID: \"8305890a-6a7f-4a42-a6af-33ab4f36a9fd\") " pod="openstack-kuttl-tests/ovn-controller-5sznk" Mar 16 16:17:49 crc kubenswrapper[5120]: I0316 16:17:49.657217 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovncontroller-metrics-config\"" Mar 16 16:17:49 crc kubenswrapper[5120]: I0316 16:17:49.661380 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8305890a-6a7f-4a42-a6af-33ab4f36a9fd-combined-ca-bundle\") pod \"ovn-controller-5sznk\" (UID: \"8305890a-6a7f-4a42-a6af-33ab4f36a9fd\") " pod="openstack-kuttl-tests/ovn-controller-5sznk" Mar 16 16:17:49 crc kubenswrapper[5120]: I0316 16:17:49.664031 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-controller-5sznk"] Mar 16 16:17:49 crc kubenswrapper[5120]: I0316 16:17:49.680062 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-controller-metrics-f7zgv"] Mar 16 16:17:49 crc kubenswrapper[5120]: I0316 16:17:49.697522 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-controller-tls-certs\" (UniqueName: \"kubernetes.io/secret/8305890a-6a7f-4a42-a6af-33ab4f36a9fd-ovn-controller-tls-certs\") pod \"ovn-controller-5sznk\" (UID: \"8305890a-6a7f-4a42-a6af-33ab4f36a9fd\") " pod="openstack-kuttl-tests/ovn-controller-5sznk" Mar 16 16:17:49 crc kubenswrapper[5120]: I0316 16:17:49.707337 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8lsg\" (UniqueName: \"kubernetes.io/projected/8305890a-6a7f-4a42-a6af-33ab4f36a9fd-kube-api-access-v8lsg\") pod \"ovn-controller-5sznk\" (UID: \"8305890a-6a7f-4a42-a6af-33ab4f36a9fd\") " pod="openstack-kuttl-tests/ovn-controller-5sznk" Mar 16 16:17:49 crc kubenswrapper[5120]: I0316 16:17:49.755389 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/b734d30f-bb89-4e8e-88cd-e6a0f051c64b-scripts\") pod \"ovn-controller-ovs-4qzrp\" (UID: \"b734d30f-bb89-4e8e-88cd-e6a0f051c64b\") " pod="openstack-kuttl-tests/ovn-controller-ovs-4qzrp" Mar 16 16:17:49 crc kubenswrapper[5120]: I0316 16:17:49.755436 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-log\" (UniqueName: \"kubernetes.io/host-path/b734d30f-bb89-4e8e-88cd-e6a0f051c64b-var-log\") pod \"ovn-controller-ovs-4qzrp\" (UID: \"b734d30f-bb89-4e8e-88cd-e6a0f051c64b\") " pod="openstack-kuttl-tests/ovn-controller-ovs-4qzrp" Mar 16 16:17:49 crc kubenswrapper[5120]: I0316 16:17:49.755478 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8b5dd88c-6425-4d5a-b2d4-f2ed35fa8a1c-combined-ca-bundle\") pod \"ovn-controller-metrics-f7zgv\" (UID: \"8b5dd88c-6425-4d5a-b2d4-f2ed35fa8a1c\") " pod="openstack-kuttl-tests/ovn-controller-metrics-f7zgv" Mar 16 16:17:49 crc kubenswrapper[5120]: I0316 16:17:49.755535 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-run\" (UniqueName: \"kubernetes.io/host-path/b734d30f-bb89-4e8e-88cd-e6a0f051c64b-var-run\") pod \"ovn-controller-ovs-4qzrp\" (UID: \"b734d30f-bb89-4e8e-88cd-e6a0f051c64b\") " pod="openstack-kuttl-tests/ovn-controller-ovs-4qzrp" Mar 16 16:17:49 crc kubenswrapper[5120]: I0316 16:17:49.755579 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/host-path/8b5dd88c-6425-4d5a-b2d4-f2ed35fa8a1c-ovn-rundir\") pod \"ovn-controller-metrics-f7zgv\" (UID: \"8b5dd88c-6425-4d5a-b2d4-f2ed35fa8a1c\") " pod="openstack-kuttl-tests/ovn-controller-metrics-f7zgv" Mar 16 16:17:49 crc kubenswrapper[5120]: I0316 16:17:49.755627 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/8b5dd88c-6425-4d5a-b2d4-f2ed35fa8a1c-metrics-certs-tls-certs\") pod \"ovn-controller-metrics-f7zgv\" (UID: \"8b5dd88c-6425-4d5a-b2d4-f2ed35fa8a1c\") " pod="openstack-kuttl-tests/ovn-controller-metrics-f7zgv" Mar 16 16:17:49 crc kubenswrapper[5120]: I0316 16:17:49.755700 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-ovs\" (UniqueName: \"kubernetes.io/host-path/b734d30f-bb89-4e8e-88cd-e6a0f051c64b-etc-ovs\") pod \"ovn-controller-ovs-4qzrp\" (UID: \"b734d30f-bb89-4e8e-88cd-e6a0f051c64b\") " pod="openstack-kuttl-tests/ovn-controller-ovs-4qzrp" Mar 16 16:17:49 crc kubenswrapper[5120]: I0316 16:17:49.755739 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fz4ld\" (UniqueName: \"kubernetes.io/projected/8b5dd88c-6425-4d5a-b2d4-f2ed35fa8a1c-kube-api-access-fz4ld\") pod \"ovn-controller-metrics-f7zgv\" (UID: \"8b5dd88c-6425-4d5a-b2d4-f2ed35fa8a1c\") " pod="openstack-kuttl-tests/ovn-controller-metrics-f7zgv" Mar 16 16:17:49 crc kubenswrapper[5120]: I0316 16:17:49.756657 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-run\" (UniqueName: \"kubernetes.io/host-path/b734d30f-bb89-4e8e-88cd-e6a0f051c64b-var-run\") pod \"ovn-controller-ovs-4qzrp\" (UID: \"b734d30f-bb89-4e8e-88cd-e6a0f051c64b\") " pod="openstack-kuttl-tests/ovn-controller-ovs-4qzrp" Mar 16 16:17:49 crc kubenswrapper[5120]: I0316 16:17:49.757239 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-log\" (UniqueName: \"kubernetes.io/host-path/b734d30f-bb89-4e8e-88cd-e6a0f051c64b-var-log\") pod \"ovn-controller-ovs-4qzrp\" (UID: \"b734d30f-bb89-4e8e-88cd-e6a0f051c64b\") " pod="openstack-kuttl-tests/ovn-controller-ovs-4qzrp" Mar 16 16:17:49 crc kubenswrapper[5120]: I0316 16:17:49.757701 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-ovs\" (UniqueName: \"kubernetes.io/host-path/b734d30f-bb89-4e8e-88cd-e6a0f051c64b-etc-ovs\") pod \"ovn-controller-ovs-4qzrp\" (UID: \"b734d30f-bb89-4e8e-88cd-e6a0f051c64b\") " pod="openstack-kuttl-tests/ovn-controller-ovs-4qzrp" Mar 16 16:17:49 crc kubenswrapper[5120]: I0316 16:17:49.760046 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/b734d30f-bb89-4e8e-88cd-e6a0f051c64b-scripts\") pod \"ovn-controller-ovs-4qzrp\" (UID: \"b734d30f-bb89-4e8e-88cd-e6a0f051c64b\") " pod="openstack-kuttl-tests/ovn-controller-ovs-4qzrp" Mar 16 16:17:49 crc kubenswrapper[5120]: I0316 16:17:49.761011 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w4bn9\" (UniqueName: \"kubernetes.io/projected/b734d30f-bb89-4e8e-88cd-e6a0f051c64b-kube-api-access-w4bn9\") pod \"ovn-controller-ovs-4qzrp\" (UID: \"b734d30f-bb89-4e8e-88cd-e6a0f051c64b\") " pod="openstack-kuttl-tests/ovn-controller-ovs-4qzrp" Mar 16 16:17:49 crc kubenswrapper[5120]: I0316 16:17:49.761047 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib\" (UniqueName: \"kubernetes.io/host-path/b734d30f-bb89-4e8e-88cd-e6a0f051c64b-var-lib\") pod \"ovn-controller-ovs-4qzrp\" (UID: \"b734d30f-bb89-4e8e-88cd-e6a0f051c64b\") " pod="openstack-kuttl-tests/ovn-controller-ovs-4qzrp" Mar 16 16:17:49 crc kubenswrapper[5120]: I0316 16:17:49.761099 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovs-rundir\" (UniqueName: \"kubernetes.io/host-path/8b5dd88c-6425-4d5a-b2d4-f2ed35fa8a1c-ovs-rundir\") pod \"ovn-controller-metrics-f7zgv\" (UID: \"8b5dd88c-6425-4d5a-b2d4-f2ed35fa8a1c\") " pod="openstack-kuttl-tests/ovn-controller-metrics-f7zgv" Mar 16 16:17:49 crc kubenswrapper[5120]: I0316 16:17:49.761219 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8b5dd88c-6425-4d5a-b2d4-f2ed35fa8a1c-config\") pod \"ovn-controller-metrics-f7zgv\" (UID: \"8b5dd88c-6425-4d5a-b2d4-f2ed35fa8a1c\") " pod="openstack-kuttl-tests/ovn-controller-metrics-f7zgv" Mar 16 16:17:49 crc kubenswrapper[5120]: I0316 16:17:49.761807 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib\" (UniqueName: \"kubernetes.io/host-path/b734d30f-bb89-4e8e-88cd-e6a0f051c64b-var-lib\") pod \"ovn-controller-ovs-4qzrp\" (UID: \"b734d30f-bb89-4e8e-88cd-e6a0f051c64b\") " pod="openstack-kuttl-tests/ovn-controller-ovs-4qzrp" Mar 16 16:17:49 crc kubenswrapper[5120]: I0316 16:17:49.795172 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4bn9\" (UniqueName: \"kubernetes.io/projected/b734d30f-bb89-4e8e-88cd-e6a0f051c64b-kube-api-access-w4bn9\") pod \"ovn-controller-ovs-4qzrp\" (UID: \"b734d30f-bb89-4e8e-88cd-e6a0f051c64b\") " pod="openstack-kuttl-tests/ovn-controller-ovs-4qzrp" Mar 16 16:17:49 crc kubenswrapper[5120]: I0316 16:17:49.824900 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-controller-5sznk" Mar 16 16:17:49 crc kubenswrapper[5120]: I0316 16:17:49.864068 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fz4ld\" (UniqueName: \"kubernetes.io/projected/8b5dd88c-6425-4d5a-b2d4-f2ed35fa8a1c-kube-api-access-fz4ld\") pod \"ovn-controller-metrics-f7zgv\" (UID: \"8b5dd88c-6425-4d5a-b2d4-f2ed35fa8a1c\") " pod="openstack-kuttl-tests/ovn-controller-metrics-f7zgv" Mar 16 16:17:49 crc kubenswrapper[5120]: I0316 16:17:49.864146 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovs-rundir\" (UniqueName: \"kubernetes.io/host-path/8b5dd88c-6425-4d5a-b2d4-f2ed35fa8a1c-ovs-rundir\") pod \"ovn-controller-metrics-f7zgv\" (UID: \"8b5dd88c-6425-4d5a-b2d4-f2ed35fa8a1c\") " pod="openstack-kuttl-tests/ovn-controller-metrics-f7zgv" Mar 16 16:17:49 crc kubenswrapper[5120]: I0316 16:17:49.864985 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovs-rundir\" (UniqueName: \"kubernetes.io/host-path/8b5dd88c-6425-4d5a-b2d4-f2ed35fa8a1c-ovs-rundir\") pod \"ovn-controller-metrics-f7zgv\" (UID: \"8b5dd88c-6425-4d5a-b2d4-f2ed35fa8a1c\") " pod="openstack-kuttl-tests/ovn-controller-metrics-f7zgv" Mar 16 16:17:49 crc kubenswrapper[5120]: I0316 16:17:49.865741 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8b5dd88c-6425-4d5a-b2d4-f2ed35fa8a1c-config\") pod \"ovn-controller-metrics-f7zgv\" (UID: \"8b5dd88c-6425-4d5a-b2d4-f2ed35fa8a1c\") " pod="openstack-kuttl-tests/ovn-controller-metrics-f7zgv" Mar 16 16:17:49 crc kubenswrapper[5120]: I0316 16:17:49.865066 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8b5dd88c-6425-4d5a-b2d4-f2ed35fa8a1c-config\") pod \"ovn-controller-metrics-f7zgv\" (UID: \"8b5dd88c-6425-4d5a-b2d4-f2ed35fa8a1c\") " pod="openstack-kuttl-tests/ovn-controller-metrics-f7zgv" Mar 16 16:17:49 crc kubenswrapper[5120]: I0316 16:17:49.865939 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8b5dd88c-6425-4d5a-b2d4-f2ed35fa8a1c-combined-ca-bundle\") pod \"ovn-controller-metrics-f7zgv\" (UID: \"8b5dd88c-6425-4d5a-b2d4-f2ed35fa8a1c\") " pod="openstack-kuttl-tests/ovn-controller-metrics-f7zgv" Mar 16 16:17:49 crc kubenswrapper[5120]: I0316 16:17:49.866700 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/host-path/8b5dd88c-6425-4d5a-b2d4-f2ed35fa8a1c-ovn-rundir\") pod \"ovn-controller-metrics-f7zgv\" (UID: \"8b5dd88c-6425-4d5a-b2d4-f2ed35fa8a1c\") " pod="openstack-kuttl-tests/ovn-controller-metrics-f7zgv" Mar 16 16:17:49 crc kubenswrapper[5120]: I0316 16:17:49.866841 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/8b5dd88c-6425-4d5a-b2d4-f2ed35fa8a1c-metrics-certs-tls-certs\") pod \"ovn-controller-metrics-f7zgv\" (UID: \"8b5dd88c-6425-4d5a-b2d4-f2ed35fa8a1c\") " pod="openstack-kuttl-tests/ovn-controller-metrics-f7zgv" Mar 16 16:17:49 crc kubenswrapper[5120]: I0316 16:17:49.866895 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/host-path/8b5dd88c-6425-4d5a-b2d4-f2ed35fa8a1c-ovn-rundir\") pod \"ovn-controller-metrics-f7zgv\" (UID: \"8b5dd88c-6425-4d5a-b2d4-f2ed35fa8a1c\") " pod="openstack-kuttl-tests/ovn-controller-metrics-f7zgv" Mar 16 16:17:49 crc kubenswrapper[5120]: I0316 16:17:49.871374 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8b5dd88c-6425-4d5a-b2d4-f2ed35fa8a1c-combined-ca-bundle\") pod \"ovn-controller-metrics-f7zgv\" (UID: \"8b5dd88c-6425-4d5a-b2d4-f2ed35fa8a1c\") " pod="openstack-kuttl-tests/ovn-controller-metrics-f7zgv" Mar 16 16:17:49 crc kubenswrapper[5120]: I0316 16:17:49.871460 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/8b5dd88c-6425-4d5a-b2d4-f2ed35fa8a1c-metrics-certs-tls-certs\") pod \"ovn-controller-metrics-f7zgv\" (UID: \"8b5dd88c-6425-4d5a-b2d4-f2ed35fa8a1c\") " pod="openstack-kuttl-tests/ovn-controller-metrics-f7zgv" Mar 16 16:17:49 crc kubenswrapper[5120]: I0316 16:17:49.879477 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fz4ld\" (UniqueName: \"kubernetes.io/projected/8b5dd88c-6425-4d5a-b2d4-f2ed35fa8a1c-kube-api-access-fz4ld\") pod \"ovn-controller-metrics-f7zgv\" (UID: \"8b5dd88c-6425-4d5a-b2d4-f2ed35fa8a1c\") " pod="openstack-kuttl-tests/ovn-controller-metrics-f7zgv" Mar 16 16:17:49 crc kubenswrapper[5120]: I0316 16:17:49.926519 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-controller-ovs-4qzrp" Mar 16 16:17:50 crc kubenswrapper[5120]: I0316 16:17:50.069403 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-controller-metrics-f7zgv" Mar 16 16:17:50 crc kubenswrapper[5120]: I0316 16:17:50.310031 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-controller-5sznk"] Mar 16 16:17:50 crc kubenswrapper[5120]: I0316 16:17:50.530924 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-controller-ovs-4qzrp"] Mar 16 16:17:50 crc kubenswrapper[5120]: W0316 16:17:50.541684 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb734d30f_bb89_4e8e_88cd_e6a0f051c64b.slice/crio-1ed81c7d3cf0eee360f755d73da4aa4bd25f260e4689ccb5dc588a833e8a0114 WatchSource:0}: Error finding container 1ed81c7d3cf0eee360f755d73da4aa4bd25f260e4689ccb5dc588a833e8a0114: Status 404 returned error can't find the container with id 1ed81c7d3cf0eee360f755d73da4aa4bd25f260e4689ccb5dc588a833e8a0114 Mar 16 16:17:50 crc kubenswrapper[5120]: I0316 16:17:50.633767 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-controller-metrics-f7zgv"] Mar 16 16:17:51 crc kubenswrapper[5120]: I0316 16:17:51.305191 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-controller-metrics-f7zgv" event={"ID":"8b5dd88c-6425-4d5a-b2d4-f2ed35fa8a1c","Type":"ContainerStarted","Data":"f2f6fc6bbc971ff74b7f77b818ffb55651bc4f80cf17ada608e016787d48db64"} Mar 16 16:17:51 crc kubenswrapper[5120]: I0316 16:17:51.305581 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-controller-metrics-f7zgv" event={"ID":"8b5dd88c-6425-4d5a-b2d4-f2ed35fa8a1c","Type":"ContainerStarted","Data":"591f12bf32b5829ad55108cc2138013e982b21a3b7675c2171fc65d7c23effc1"} Mar 16 16:17:51 crc kubenswrapper[5120]: I0316 16:17:51.307126 5120 generic.go:358] "Generic (PLEG): container finished" podID="b734d30f-bb89-4e8e-88cd-e6a0f051c64b" containerID="0e1210f42fc82b8ff11d58113944f05b6f0bd52dcf345eadad7a2780ba72a429" exitCode=0 Mar 16 16:17:51 crc kubenswrapper[5120]: I0316 16:17:51.307221 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-controller-ovs-4qzrp" event={"ID":"b734d30f-bb89-4e8e-88cd-e6a0f051c64b","Type":"ContainerDied","Data":"0e1210f42fc82b8ff11d58113944f05b6f0bd52dcf345eadad7a2780ba72a429"} Mar 16 16:17:51 crc kubenswrapper[5120]: I0316 16:17:51.307254 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-controller-ovs-4qzrp" event={"ID":"b734d30f-bb89-4e8e-88cd-e6a0f051c64b","Type":"ContainerStarted","Data":"1ed81c7d3cf0eee360f755d73da4aa4bd25f260e4689ccb5dc588a833e8a0114"} Mar 16 16:17:51 crc kubenswrapper[5120]: I0316 16:17:51.310286 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-controller-5sznk" event={"ID":"8305890a-6a7f-4a42-a6af-33ab4f36a9fd","Type":"ContainerStarted","Data":"c3ba1ed8eb10460a93be03783efe6bcaa9ba71fd9db113c6c8336ec51849bf98"} Mar 16 16:17:51 crc kubenswrapper[5120]: I0316 16:17:51.310311 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-controller-5sznk" event={"ID":"8305890a-6a7f-4a42-a6af-33ab4f36a9fd","Type":"ContainerStarted","Data":"43d328c5adbd8412c911ec739bcf2a7e098695a81409e29650e1f04f07e54686"} Mar 16 16:17:51 crc kubenswrapper[5120]: I0316 16:17:51.310366 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ovn-controller-5sznk" Mar 16 16:17:51 crc kubenswrapper[5120]: I0316 16:17:51.331283 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovn-controller-metrics-f7zgv" podStartSLOduration=2.331263209 podStartE2EDuration="2.331263209s" podCreationTimestamp="2026-03-16 16:17:49 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:17:51.320914531 +0000 UTC m=+2773.474846178" watchObservedRunningTime="2026-03-16 16:17:51.331263209 +0000 UTC m=+2773.485194866" Mar 16 16:17:51 crc kubenswrapper[5120]: I0316 16:17:51.368038 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovn-controller-5sznk" podStartSLOduration=2.368015054 podStartE2EDuration="2.368015054s" podCreationTimestamp="2026-03-16 16:17:49 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:17:51.365800204 +0000 UTC m=+2773.519731871" watchObservedRunningTime="2026-03-16 16:17:51.368015054 +0000 UTC m=+2773.521946721" Mar 16 16:17:52 crc kubenswrapper[5120]: I0316 16:17:52.330585 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-controller-ovs-4qzrp" event={"ID":"b734d30f-bb89-4e8e-88cd-e6a0f051c64b","Type":"ContainerStarted","Data":"c27b52f4291138b8ac6c9ecb5133e11d4e129f0f8b4432aadea7661f7b2368d0"} Mar 16 16:17:52 crc kubenswrapper[5120]: I0316 16:17:52.331196 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ovn-controller-ovs-4qzrp" Mar 16 16:17:52 crc kubenswrapper[5120]: I0316 16:17:52.331214 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ovn-controller-ovs-4qzrp" Mar 16 16:17:52 crc kubenswrapper[5120]: I0316 16:17:52.331225 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-controller-ovs-4qzrp" event={"ID":"b734d30f-bb89-4e8e-88cd-e6a0f051c64b","Type":"ContainerStarted","Data":"de08a06c73642c2a52be29d79b2ff5646efcf3737041ebcd688aa295572d020a"} Mar 16 16:17:52 crc kubenswrapper[5120]: I0316 16:17:52.373720 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovn-controller-ovs-4qzrp" podStartSLOduration=3.373692376 podStartE2EDuration="3.373692376s" podCreationTimestamp="2026-03-16 16:17:49 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:17:52.360501213 +0000 UTC m=+2774.514432900" watchObservedRunningTime="2026-03-16 16:17:52.373692376 +0000 UTC m=+2774.527624043" Mar 16 16:17:53 crc kubenswrapper[5120]: I0316 16:17:53.759969 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-controller-5sznk"] Mar 16 16:17:53 crc kubenswrapper[5120]: I0316 16:17:53.793419 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-controller-metrics-f7zgv"] Mar 16 16:17:53 crc kubenswrapper[5120]: I0316 16:17:53.793714 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovn-controller-metrics-f7zgv" podUID="8b5dd88c-6425-4d5a-b2d4-f2ed35fa8a1c" containerName="openstack-network-exporter" containerID="cri-o://f2f6fc6bbc971ff74b7f77b818ffb55651bc4f80cf17ada608e016787d48db64" gracePeriod=30 Mar 16 16:17:53 crc kubenswrapper[5120]: I0316 16:17:53.806778 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-controller-ovs-4qzrp"] Mar 16 16:17:53 crc kubenswrapper[5120]: E0316 16:17:53.884626 5120 handlers.go:80] "Exec lifecycle hook for Container in Pod failed" err="command '/usr/share/ovn/scripts/ovn-ctl stop_controller' exited with 137: " execCommand=["/usr/share/ovn/scripts/ovn-ctl","stop_controller"] containerName="ovn-controller" pod="openstack-kuttl-tests/ovn-controller-5sznk" message="Exiting ovn-controller (1) " Mar 16 16:17:53 crc kubenswrapper[5120]: E0316 16:17:53.884675 5120 kuberuntime_container.go:741] "PreStop hook failed" err="command '/usr/share/ovn/scripts/ovn-ctl stop_controller' exited with 137: " pod="openstack-kuttl-tests/ovn-controller-5sznk" podUID="8305890a-6a7f-4a42-a6af-33ab4f36a9fd" containerName="ovn-controller" containerID="cri-o://c3ba1ed8eb10460a93be03783efe6bcaa9ba71fd9db113c6c8336ec51849bf98" Mar 16 16:17:53 crc kubenswrapper[5120]: I0316 16:17:53.884730 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovn-controller-5sznk" podUID="8305890a-6a7f-4a42-a6af-33ab4f36a9fd" containerName="ovn-controller" containerID="cri-o://c3ba1ed8eb10460a93be03783efe6bcaa9ba71fd9db113c6c8336ec51849bf98" gracePeriod=30 Mar 16 16:17:54 crc kubenswrapper[5120]: I0316 16:17:54.159267 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-operators-9nt5d" Mar 16 16:17:54 crc kubenswrapper[5120]: I0316 16:17:54.159632 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-marketplace/redhat-operators-9nt5d" Mar 16 16:17:54 crc kubenswrapper[5120]: I0316 16:17:54.216971 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-operators-9nt5d" Mar 16 16:17:54 crc kubenswrapper[5120]: I0316 16:17:54.349136 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-controller-metrics-f7zgv_8b5dd88c-6425-4d5a-b2d4-f2ed35fa8a1c/openstack-network-exporter/0.log" Mar 16 16:17:54 crc kubenswrapper[5120]: I0316 16:17:54.349188 5120 generic.go:358] "Generic (PLEG): container finished" podID="8b5dd88c-6425-4d5a-b2d4-f2ed35fa8a1c" containerID="f2f6fc6bbc971ff74b7f77b818ffb55651bc4f80cf17ada608e016787d48db64" exitCode=2 Mar 16 16:17:54 crc kubenswrapper[5120]: I0316 16:17:54.349302 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-controller-metrics-f7zgv" event={"ID":"8b5dd88c-6425-4d5a-b2d4-f2ed35fa8a1c","Type":"ContainerDied","Data":"f2f6fc6bbc971ff74b7f77b818ffb55651bc4f80cf17ada608e016787d48db64"} Mar 16 16:17:54 crc kubenswrapper[5120]: I0316 16:17:54.349357 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-controller-metrics-f7zgv" event={"ID":"8b5dd88c-6425-4d5a-b2d4-f2ed35fa8a1c","Type":"ContainerDied","Data":"591f12bf32b5829ad55108cc2138013e982b21a3b7675c2171fc65d7c23effc1"} Mar 16 16:17:54 crc kubenswrapper[5120]: I0316 16:17:54.349372 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="591f12bf32b5829ad55108cc2138013e982b21a3b7675c2171fc65d7c23effc1" Mar 16 16:17:54 crc kubenswrapper[5120]: I0316 16:17:54.351625 5120 generic.go:358] "Generic (PLEG): container finished" podID="8305890a-6a7f-4a42-a6af-33ab4f36a9fd" containerID="c3ba1ed8eb10460a93be03783efe6bcaa9ba71fd9db113c6c8336ec51849bf98" exitCode=0 Mar 16 16:17:54 crc kubenswrapper[5120]: I0316 16:17:54.351945 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-controller-5sznk" event={"ID":"8305890a-6a7f-4a42-a6af-33ab4f36a9fd","Type":"ContainerDied","Data":"c3ba1ed8eb10460a93be03783efe6bcaa9ba71fd9db113c6c8336ec51849bf98"} Mar 16 16:17:54 crc kubenswrapper[5120]: I0316 16:17:54.351983 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-controller-5sznk" event={"ID":"8305890a-6a7f-4a42-a6af-33ab4f36a9fd","Type":"ContainerDied","Data":"43d328c5adbd8412c911ec739bcf2a7e098695a81409e29650e1f04f07e54686"} Mar 16 16:17:54 crc kubenswrapper[5120]: I0316 16:17:54.351994 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="43d328c5adbd8412c911ec739bcf2a7e098695a81409e29650e1f04f07e54686" Mar 16 16:17:54 crc kubenswrapper[5120]: I0316 16:17:54.406605 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-operators-9nt5d" Mar 16 16:17:54 crc kubenswrapper[5120]: I0316 16:17:54.425960 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-controller-5sznk" Mar 16 16:17:54 crc kubenswrapper[5120]: I0316 16:17:54.434157 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-controller-metrics-f7zgv_8b5dd88c-6425-4d5a-b2d4-f2ed35fa8a1c/openstack-network-exporter/0.log" Mar 16 16:17:54 crc kubenswrapper[5120]: I0316 16:17:54.434239 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-controller-metrics-f7zgv" Mar 16 16:17:54 crc kubenswrapper[5120]: I0316 16:17:54.481692 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-operators-9nt5d"] Mar 16 16:17:54 crc kubenswrapper[5120]: I0316 16:17:54.593585 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fz4ld\" (UniqueName: \"kubernetes.io/projected/8b5dd88c-6425-4d5a-b2d4-f2ed35fa8a1c-kube-api-access-fz4ld\") pod \"8b5dd88c-6425-4d5a-b2d4-f2ed35fa8a1c\" (UID: \"8b5dd88c-6425-4d5a-b2d4-f2ed35fa8a1c\") " Mar 16 16:17:54 crc kubenswrapper[5120]: I0316 16:17:54.593660 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovs-rundir\" (UniqueName: \"kubernetes.io/host-path/8b5dd88c-6425-4d5a-b2d4-f2ed35fa8a1c-ovs-rundir\") pod \"8b5dd88c-6425-4d5a-b2d4-f2ed35fa8a1c\" (UID: \"8b5dd88c-6425-4d5a-b2d4-f2ed35fa8a1c\") " Mar 16 16:17:54 crc kubenswrapper[5120]: I0316 16:17:54.593717 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/host-path/8b5dd88c-6425-4d5a-b2d4-f2ed35fa8a1c-ovn-rundir\") pod \"8b5dd88c-6425-4d5a-b2d4-f2ed35fa8a1c\" (UID: \"8b5dd88c-6425-4d5a-b2d4-f2ed35fa8a1c\") " Mar 16 16:17:54 crc kubenswrapper[5120]: I0316 16:17:54.593741 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/8b5dd88c-6425-4d5a-b2d4-f2ed35fa8a1c-ovs-rundir" (OuterVolumeSpecName: "ovs-rundir") pod "8b5dd88c-6425-4d5a-b2d4-f2ed35fa8a1c" (UID: "8b5dd88c-6425-4d5a-b2d4-f2ed35fa8a1c"). InnerVolumeSpecName "ovs-rundir". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 16:17:54 crc kubenswrapper[5120]: I0316 16:17:54.593809 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"var-run-ovn\" (UniqueName: \"kubernetes.io/host-path/8305890a-6a7f-4a42-a6af-33ab4f36a9fd-var-run-ovn\") pod \"8305890a-6a7f-4a42-a6af-33ab4f36a9fd\" (UID: \"8305890a-6a7f-4a42-a6af-33ab4f36a9fd\") " Mar 16 16:17:54 crc kubenswrapper[5120]: I0316 16:17:54.593848 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/8305890a-6a7f-4a42-a6af-33ab4f36a9fd-var-run-ovn" (OuterVolumeSpecName: "var-run-ovn") pod "8305890a-6a7f-4a42-a6af-33ab4f36a9fd" (UID: "8305890a-6a7f-4a42-a6af-33ab4f36a9fd"). InnerVolumeSpecName "var-run-ovn". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 16:17:54 crc kubenswrapper[5120]: I0316 16:17:54.593870 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/8b5dd88c-6425-4d5a-b2d4-f2ed35fa8a1c-ovn-rundir" (OuterVolumeSpecName: "ovn-rundir") pod "8b5dd88c-6425-4d5a-b2d4-f2ed35fa8a1c" (UID: "8b5dd88c-6425-4d5a-b2d4-f2ed35fa8a1c"). InnerVolumeSpecName "ovn-rundir". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 16:17:54 crc kubenswrapper[5120]: I0316 16:17:54.593905 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/8305890a-6a7f-4a42-a6af-33ab4f36a9fd-scripts\") pod \"8305890a-6a7f-4a42-a6af-33ab4f36a9fd\" (UID: \"8305890a-6a7f-4a42-a6af-33ab4f36a9fd\") " Mar 16 16:17:54 crc kubenswrapper[5120]: I0316 16:17:54.593973 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/8b5dd88c-6425-4d5a-b2d4-f2ed35fa8a1c-metrics-certs-tls-certs\") pod \"8b5dd88c-6425-4d5a-b2d4-f2ed35fa8a1c\" (UID: \"8b5dd88c-6425-4d5a-b2d4-f2ed35fa8a1c\") " Mar 16 16:17:54 crc kubenswrapper[5120]: I0316 16:17:54.594051 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"var-log-ovn\" (UniqueName: \"kubernetes.io/host-path/8305890a-6a7f-4a42-a6af-33ab4f36a9fd-var-log-ovn\") pod \"8305890a-6a7f-4a42-a6af-33ab4f36a9fd\" (UID: \"8305890a-6a7f-4a42-a6af-33ab4f36a9fd\") " Mar 16 16:17:54 crc kubenswrapper[5120]: I0316 16:17:54.594084 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovn-controller-tls-certs\" (UniqueName: \"kubernetes.io/secret/8305890a-6a7f-4a42-a6af-33ab4f36a9fd-ovn-controller-tls-certs\") pod \"8305890a-6a7f-4a42-a6af-33ab4f36a9fd\" (UID: \"8305890a-6a7f-4a42-a6af-33ab4f36a9fd\") " Mar 16 16:17:54 crc kubenswrapper[5120]: I0316 16:17:54.594161 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/8305890a-6a7f-4a42-a6af-33ab4f36a9fd-var-log-ovn" (OuterVolumeSpecName: "var-log-ovn") pod "8305890a-6a7f-4a42-a6af-33ab4f36a9fd" (UID: "8305890a-6a7f-4a42-a6af-33ab4f36a9fd"). InnerVolumeSpecName "var-log-ovn". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 16:17:54 crc kubenswrapper[5120]: I0316 16:17:54.594240 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8b5dd88c-6425-4d5a-b2d4-f2ed35fa8a1c-config\") pod \"8b5dd88c-6425-4d5a-b2d4-f2ed35fa8a1c\" (UID: \"8b5dd88c-6425-4d5a-b2d4-f2ed35fa8a1c\") " Mar 16 16:17:54 crc kubenswrapper[5120]: I0316 16:17:54.594290 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8b5dd88c-6425-4d5a-b2d4-f2ed35fa8a1c-combined-ca-bundle\") pod \"8b5dd88c-6425-4d5a-b2d4-f2ed35fa8a1c\" (UID: \"8b5dd88c-6425-4d5a-b2d4-f2ed35fa8a1c\") " Mar 16 16:17:54 crc kubenswrapper[5120]: I0316 16:17:54.594330 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"var-run\" (UniqueName: \"kubernetes.io/host-path/8305890a-6a7f-4a42-a6af-33ab4f36a9fd-var-run\") pod \"8305890a-6a7f-4a42-a6af-33ab4f36a9fd\" (UID: \"8305890a-6a7f-4a42-a6af-33ab4f36a9fd\") " Mar 16 16:17:54 crc kubenswrapper[5120]: I0316 16:17:54.594458 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v8lsg\" (UniqueName: \"kubernetes.io/projected/8305890a-6a7f-4a42-a6af-33ab4f36a9fd-kube-api-access-v8lsg\") pod \"8305890a-6a7f-4a42-a6af-33ab4f36a9fd\" (UID: \"8305890a-6a7f-4a42-a6af-33ab4f36a9fd\") " Mar 16 16:17:54 crc kubenswrapper[5120]: I0316 16:17:54.594515 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8305890a-6a7f-4a42-a6af-33ab4f36a9fd-combined-ca-bundle\") pod \"8305890a-6a7f-4a42-a6af-33ab4f36a9fd\" (UID: \"8305890a-6a7f-4a42-a6af-33ab4f36a9fd\") " Mar 16 16:17:54 crc kubenswrapper[5120]: I0316 16:17:54.594535 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/8305890a-6a7f-4a42-a6af-33ab4f36a9fd-var-run" (OuterVolumeSpecName: "var-run") pod "8305890a-6a7f-4a42-a6af-33ab4f36a9fd" (UID: "8305890a-6a7f-4a42-a6af-33ab4f36a9fd"). InnerVolumeSpecName "var-run". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 16:17:54 crc kubenswrapper[5120]: I0316 16:17:54.594852 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8b5dd88c-6425-4d5a-b2d4-f2ed35fa8a1c-config" (OuterVolumeSpecName: "config") pod "8b5dd88c-6425-4d5a-b2d4-f2ed35fa8a1c" (UID: "8b5dd88c-6425-4d5a-b2d4-f2ed35fa8a1c"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:17:54 crc kubenswrapper[5120]: I0316 16:17:54.595187 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8305890a-6a7f-4a42-a6af-33ab4f36a9fd-scripts" (OuterVolumeSpecName: "scripts") pod "8305890a-6a7f-4a42-a6af-33ab4f36a9fd" (UID: "8305890a-6a7f-4a42-a6af-33ab4f36a9fd"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:17:54 crc kubenswrapper[5120]: I0316 16:17:54.595456 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/8305890a-6a7f-4a42-a6af-33ab4f36a9fd-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:17:54 crc kubenswrapper[5120]: I0316 16:17:54.595474 5120 reconciler_common.go:299] "Volume detached for volume \"var-log-ovn\" (UniqueName: \"kubernetes.io/host-path/8305890a-6a7f-4a42-a6af-33ab4f36a9fd-var-log-ovn\") on node \"crc\" DevicePath \"\"" Mar 16 16:17:54 crc kubenswrapper[5120]: I0316 16:17:54.595484 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8b5dd88c-6425-4d5a-b2d4-f2ed35fa8a1c-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:17:54 crc kubenswrapper[5120]: I0316 16:17:54.595493 5120 reconciler_common.go:299] "Volume detached for volume \"var-run\" (UniqueName: \"kubernetes.io/host-path/8305890a-6a7f-4a42-a6af-33ab4f36a9fd-var-run\") on node \"crc\" DevicePath \"\"" Mar 16 16:17:54 crc kubenswrapper[5120]: I0316 16:17:54.595502 5120 reconciler_common.go:299] "Volume detached for volume \"ovs-rundir\" (UniqueName: \"kubernetes.io/host-path/8b5dd88c-6425-4d5a-b2d4-f2ed35fa8a1c-ovs-rundir\") on node \"crc\" DevicePath \"\"" Mar 16 16:17:54 crc kubenswrapper[5120]: I0316 16:17:54.595510 5120 reconciler_common.go:299] "Volume detached for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/host-path/8b5dd88c-6425-4d5a-b2d4-f2ed35fa8a1c-ovn-rundir\") on node \"crc\" DevicePath \"\"" Mar 16 16:17:54 crc kubenswrapper[5120]: I0316 16:17:54.595520 5120 reconciler_common.go:299] "Volume detached for volume \"var-run-ovn\" (UniqueName: \"kubernetes.io/host-path/8305890a-6a7f-4a42-a6af-33ab4f36a9fd-var-run-ovn\") on node \"crc\" DevicePath \"\"" Mar 16 16:17:54 crc kubenswrapper[5120]: I0316 16:17:54.600236 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8305890a-6a7f-4a42-a6af-33ab4f36a9fd-kube-api-access-v8lsg" (OuterVolumeSpecName: "kube-api-access-v8lsg") pod "8305890a-6a7f-4a42-a6af-33ab4f36a9fd" (UID: "8305890a-6a7f-4a42-a6af-33ab4f36a9fd"). InnerVolumeSpecName "kube-api-access-v8lsg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:17:54 crc kubenswrapper[5120]: I0316 16:17:54.600476 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b5dd88c-6425-4d5a-b2d4-f2ed35fa8a1c-kube-api-access-fz4ld" (OuterVolumeSpecName: "kube-api-access-fz4ld") pod "8b5dd88c-6425-4d5a-b2d4-f2ed35fa8a1c" (UID: "8b5dd88c-6425-4d5a-b2d4-f2ed35fa8a1c"). InnerVolumeSpecName "kube-api-access-fz4ld". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:17:54 crc kubenswrapper[5120]: I0316 16:17:54.623891 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8305890a-6a7f-4a42-a6af-33ab4f36a9fd-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "8305890a-6a7f-4a42-a6af-33ab4f36a9fd" (UID: "8305890a-6a7f-4a42-a6af-33ab4f36a9fd"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:17:54 crc kubenswrapper[5120]: I0316 16:17:54.636421 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8b5dd88c-6425-4d5a-b2d4-f2ed35fa8a1c-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "8b5dd88c-6425-4d5a-b2d4-f2ed35fa8a1c" (UID: "8b5dd88c-6425-4d5a-b2d4-f2ed35fa8a1c"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:17:54 crc kubenswrapper[5120]: I0316 16:17:54.671902 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8b5dd88c-6425-4d5a-b2d4-f2ed35fa8a1c-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "8b5dd88c-6425-4d5a-b2d4-f2ed35fa8a1c" (UID: "8b5dd88c-6425-4d5a-b2d4-f2ed35fa8a1c"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:17:54 crc kubenswrapper[5120]: I0316 16:17:54.673003 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8305890a-6a7f-4a42-a6af-33ab4f36a9fd-ovn-controller-tls-certs" (OuterVolumeSpecName: "ovn-controller-tls-certs") pod "8305890a-6a7f-4a42-a6af-33ab4f36a9fd" (UID: "8305890a-6a7f-4a42-a6af-33ab4f36a9fd"). InnerVolumeSpecName "ovn-controller-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:17:54 crc kubenswrapper[5120]: I0316 16:17:54.698294 5120 reconciler_common.go:299] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/8b5dd88c-6425-4d5a-b2d4-f2ed35fa8a1c-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:17:54 crc kubenswrapper[5120]: I0316 16:17:54.698368 5120 reconciler_common.go:299] "Volume detached for volume \"ovn-controller-tls-certs\" (UniqueName: \"kubernetes.io/secret/8305890a-6a7f-4a42-a6af-33ab4f36a9fd-ovn-controller-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:17:54 crc kubenswrapper[5120]: I0316 16:17:54.698386 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8b5dd88c-6425-4d5a-b2d4-f2ed35fa8a1c-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:17:54 crc kubenswrapper[5120]: I0316 16:17:54.698399 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v8lsg\" (UniqueName: \"kubernetes.io/projected/8305890a-6a7f-4a42-a6af-33ab4f36a9fd-kube-api-access-v8lsg\") on node \"crc\" DevicePath \"\"" Mar 16 16:17:54 crc kubenswrapper[5120]: I0316 16:17:54.698414 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8305890a-6a7f-4a42-a6af-33ab4f36a9fd-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:17:54 crc kubenswrapper[5120]: I0316 16:17:54.698429 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fz4ld\" (UniqueName: \"kubernetes.io/projected/8b5dd88c-6425-4d5a-b2d4-f2ed35fa8a1c-kube-api-access-fz4ld\") on node \"crc\" DevicePath \"\"" Mar 16 16:17:54 crc kubenswrapper[5120]: I0316 16:17:54.776853 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovn-controller-ovs-4qzrp" podUID="b734d30f-bb89-4e8e-88cd-e6a0f051c64b" containerName="ovs-vswitchd" containerID="cri-o://c27b52f4291138b8ac6c9ecb5133e11d4e129f0f8b4432aadea7661f7b2368d0" gracePeriod=30 Mar 16 16:17:54 crc kubenswrapper[5120]: E0316 16:17:54.974695 5120 handlers.go:80] "Exec lifecycle hook for Container in Pod failed" err=< Mar 16 16:17:54 crc kubenswrapper[5120]: command '/usr/local/bin/container-scripts/stop-ovsdb-server.sh' exited with 137: ++ dirname /usr/local/bin/container-scripts/stop-ovsdb-server.sh Mar 16 16:17:54 crc kubenswrapper[5120]: + source /usr/local/bin/container-scripts/functions Mar 16 16:17:54 crc kubenswrapper[5120]: ++ OVNBridge=br-int Mar 16 16:17:54 crc kubenswrapper[5120]: ++ OVNRemote=tcp:localhost:6642 Mar 16 16:17:54 crc kubenswrapper[5120]: ++ OVNEncapType=geneve Mar 16 16:17:54 crc kubenswrapper[5120]: ++ OVNAvailabilityZones= Mar 16 16:17:54 crc kubenswrapper[5120]: ++ EnableChassisAsGateway=true Mar 16 16:17:54 crc kubenswrapper[5120]: ++ PhysicalNetworks= Mar 16 16:17:54 crc kubenswrapper[5120]: ++ OVNHostName= Mar 16 16:17:54 crc kubenswrapper[5120]: ++ DB_FILE=/etc/openvswitch/conf.db Mar 16 16:17:54 crc kubenswrapper[5120]: ++ ovs_dir=/var/lib/openvswitch Mar 16 16:17:54 crc kubenswrapper[5120]: ++ FLOWS_RESTORE_SCRIPT=/var/lib/openvswitch/flows-script Mar 16 16:17:54 crc kubenswrapper[5120]: ++ FLOWS_RESTORE_DIR=/var/lib/openvswitch/saved-flows Mar 16 16:17:54 crc kubenswrapper[5120]: ++ SAFE_TO_STOP_OVSDB_SERVER_SEMAPHORE=/var/lib/openvswitch/is_safe_to_stop_ovsdb_server Mar 16 16:17:54 crc kubenswrapper[5120]: + '[' '!' -f /var/lib/openvswitch/is_safe_to_stop_ovsdb_server ']' Mar 16 16:17:54 crc kubenswrapper[5120]: + sleep 0.5 Mar 16 16:17:54 crc kubenswrapper[5120]: + '[' '!' -f /var/lib/openvswitch/is_safe_to_stop_ovsdb_server ']' Mar 16 16:17:54 crc kubenswrapper[5120]: + cleanup_ovsdb_server_semaphore Mar 16 16:17:54 crc kubenswrapper[5120]: + rm -f /var/lib/openvswitch/is_safe_to_stop_ovsdb_server Mar 16 16:17:54 crc kubenswrapper[5120]: + /usr/share/openvswitch/scripts/ovs-ctl stop --no-ovs-vswitchd Mar 16 16:17:54 crc kubenswrapper[5120]: > execCommand=["/usr/local/bin/container-scripts/stop-ovsdb-server.sh"] containerName="ovsdb-server" pod="openstack-kuttl-tests/ovn-controller-ovs-4qzrp" message=< Mar 16 16:17:54 crc kubenswrapper[5120]: Exiting ovsdb-server (5) [ OK ] Mar 16 16:17:54 crc kubenswrapper[5120]: ++ dirname /usr/local/bin/container-scripts/stop-ovsdb-server.sh Mar 16 16:17:54 crc kubenswrapper[5120]: + source /usr/local/bin/container-scripts/functions Mar 16 16:17:54 crc kubenswrapper[5120]: ++ OVNBridge=br-int Mar 16 16:17:54 crc kubenswrapper[5120]: ++ OVNRemote=tcp:localhost:6642 Mar 16 16:17:54 crc kubenswrapper[5120]: ++ OVNEncapType=geneve Mar 16 16:17:54 crc kubenswrapper[5120]: ++ OVNAvailabilityZones= Mar 16 16:17:54 crc kubenswrapper[5120]: ++ EnableChassisAsGateway=true Mar 16 16:17:54 crc kubenswrapper[5120]: ++ PhysicalNetworks= Mar 16 16:17:54 crc kubenswrapper[5120]: ++ OVNHostName= Mar 16 16:17:54 crc kubenswrapper[5120]: ++ DB_FILE=/etc/openvswitch/conf.db Mar 16 16:17:54 crc kubenswrapper[5120]: ++ ovs_dir=/var/lib/openvswitch Mar 16 16:17:54 crc kubenswrapper[5120]: ++ FLOWS_RESTORE_SCRIPT=/var/lib/openvswitch/flows-script Mar 16 16:17:54 crc kubenswrapper[5120]: ++ FLOWS_RESTORE_DIR=/var/lib/openvswitch/saved-flows Mar 16 16:17:54 crc kubenswrapper[5120]: ++ SAFE_TO_STOP_OVSDB_SERVER_SEMAPHORE=/var/lib/openvswitch/is_safe_to_stop_ovsdb_server Mar 16 16:17:54 crc kubenswrapper[5120]: + '[' '!' -f /var/lib/openvswitch/is_safe_to_stop_ovsdb_server ']' Mar 16 16:17:54 crc kubenswrapper[5120]: + sleep 0.5 Mar 16 16:17:54 crc kubenswrapper[5120]: + '[' '!' -f /var/lib/openvswitch/is_safe_to_stop_ovsdb_server ']' Mar 16 16:17:54 crc kubenswrapper[5120]: + cleanup_ovsdb_server_semaphore Mar 16 16:17:54 crc kubenswrapper[5120]: + rm -f /var/lib/openvswitch/is_safe_to_stop_ovsdb_server Mar 16 16:17:54 crc kubenswrapper[5120]: + /usr/share/openvswitch/scripts/ovs-ctl stop --no-ovs-vswitchd Mar 16 16:17:54 crc kubenswrapper[5120]: > Mar 16 16:17:54 crc kubenswrapper[5120]: E0316 16:17:54.974778 5120 kuberuntime_container.go:741] "PreStop hook failed" err=< Mar 16 16:17:54 crc kubenswrapper[5120]: command '/usr/local/bin/container-scripts/stop-ovsdb-server.sh' exited with 137: ++ dirname /usr/local/bin/container-scripts/stop-ovsdb-server.sh Mar 16 16:17:54 crc kubenswrapper[5120]: + source /usr/local/bin/container-scripts/functions Mar 16 16:17:54 crc kubenswrapper[5120]: ++ OVNBridge=br-int Mar 16 16:17:54 crc kubenswrapper[5120]: ++ OVNRemote=tcp:localhost:6642 Mar 16 16:17:54 crc kubenswrapper[5120]: ++ OVNEncapType=geneve Mar 16 16:17:54 crc kubenswrapper[5120]: ++ OVNAvailabilityZones= Mar 16 16:17:54 crc kubenswrapper[5120]: ++ EnableChassisAsGateway=true Mar 16 16:17:54 crc kubenswrapper[5120]: ++ PhysicalNetworks= Mar 16 16:17:54 crc kubenswrapper[5120]: ++ OVNHostName= Mar 16 16:17:54 crc kubenswrapper[5120]: ++ DB_FILE=/etc/openvswitch/conf.db Mar 16 16:17:54 crc kubenswrapper[5120]: ++ ovs_dir=/var/lib/openvswitch Mar 16 16:17:54 crc kubenswrapper[5120]: ++ FLOWS_RESTORE_SCRIPT=/var/lib/openvswitch/flows-script Mar 16 16:17:54 crc kubenswrapper[5120]: ++ FLOWS_RESTORE_DIR=/var/lib/openvswitch/saved-flows Mar 16 16:17:54 crc kubenswrapper[5120]: ++ SAFE_TO_STOP_OVSDB_SERVER_SEMAPHORE=/var/lib/openvswitch/is_safe_to_stop_ovsdb_server Mar 16 16:17:54 crc kubenswrapper[5120]: + '[' '!' -f /var/lib/openvswitch/is_safe_to_stop_ovsdb_server ']' Mar 16 16:17:54 crc kubenswrapper[5120]: + sleep 0.5 Mar 16 16:17:54 crc kubenswrapper[5120]: + '[' '!' -f /var/lib/openvswitch/is_safe_to_stop_ovsdb_server ']' Mar 16 16:17:54 crc kubenswrapper[5120]: + cleanup_ovsdb_server_semaphore Mar 16 16:17:54 crc kubenswrapper[5120]: + rm -f /var/lib/openvswitch/is_safe_to_stop_ovsdb_server Mar 16 16:17:54 crc kubenswrapper[5120]: + /usr/share/openvswitch/scripts/ovs-ctl stop --no-ovs-vswitchd Mar 16 16:17:54 crc kubenswrapper[5120]: > pod="openstack-kuttl-tests/ovn-controller-ovs-4qzrp" podUID="b734d30f-bb89-4e8e-88cd-e6a0f051c64b" containerName="ovsdb-server" containerID="cri-o://de08a06c73642c2a52be29d79b2ff5646efcf3737041ebcd688aa295572d020a" Mar 16 16:17:54 crc kubenswrapper[5120]: I0316 16:17:54.974868 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovn-controller-ovs-4qzrp" podUID="b734d30f-bb89-4e8e-88cd-e6a0f051c64b" containerName="ovsdb-server" containerID="cri-o://de08a06c73642c2a52be29d79b2ff5646efcf3737041ebcd688aa295572d020a" gracePeriod=30 Mar 16 16:17:55 crc kubenswrapper[5120]: I0316 16:17:55.365877 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-controller-ovs-4qzrp_b734d30f-bb89-4e8e-88cd-e6a0f051c64b/ovs-vswitchd/0.log" Mar 16 16:17:55 crc kubenswrapper[5120]: I0316 16:17:55.366543 5120 generic.go:358] "Generic (PLEG): container finished" podID="b734d30f-bb89-4e8e-88cd-e6a0f051c64b" containerID="c27b52f4291138b8ac6c9ecb5133e11d4e129f0f8b4432aadea7661f7b2368d0" exitCode=143 Mar 16 16:17:55 crc kubenswrapper[5120]: I0316 16:17:55.366563 5120 generic.go:358] "Generic (PLEG): container finished" podID="b734d30f-bb89-4e8e-88cd-e6a0f051c64b" containerID="de08a06c73642c2a52be29d79b2ff5646efcf3737041ebcd688aa295572d020a" exitCode=0 Mar 16 16:17:55 crc kubenswrapper[5120]: I0316 16:17:55.366640 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-controller-ovs-4qzrp" event={"ID":"b734d30f-bb89-4e8e-88cd-e6a0f051c64b","Type":"ContainerDied","Data":"c27b52f4291138b8ac6c9ecb5133e11d4e129f0f8b4432aadea7661f7b2368d0"} Mar 16 16:17:55 crc kubenswrapper[5120]: I0316 16:17:55.366704 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-controller-ovs-4qzrp" event={"ID":"b734d30f-bb89-4e8e-88cd-e6a0f051c64b","Type":"ContainerDied","Data":"de08a06c73642c2a52be29d79b2ff5646efcf3737041ebcd688aa295572d020a"} Mar 16 16:17:55 crc kubenswrapper[5120]: I0316 16:17:55.366727 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-controller-5sznk" Mar 16 16:17:55 crc kubenswrapper[5120]: I0316 16:17:55.367366 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-controller-metrics-f7zgv" Mar 16 16:17:55 crc kubenswrapper[5120]: I0316 16:17:55.447256 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-controller-ovs-4qzrp_b734d30f-bb89-4e8e-88cd-e6a0f051c64b/ovs-vswitchd/0.log" Mar 16 16:17:55 crc kubenswrapper[5120]: I0316 16:17:55.448352 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-controller-ovs-4qzrp" Mar 16 16:17:55 crc kubenswrapper[5120]: I0316 16:17:55.462907 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-controller-5sznk"] Mar 16 16:17:55 crc kubenswrapper[5120]: I0316 16:17:55.471659 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovn-controller-5sznk"] Mar 16 16:17:55 crc kubenswrapper[5120]: I0316 16:17:55.479708 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-controller-metrics-f7zgv"] Mar 16 16:17:55 crc kubenswrapper[5120]: I0316 16:17:55.487077 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovn-controller-metrics-f7zgv"] Mar 16 16:17:55 crc kubenswrapper[5120]: I0316 16:17:55.619811 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"var-run\" (UniqueName: \"kubernetes.io/host-path/b734d30f-bb89-4e8e-88cd-e6a0f051c64b-var-run\") pod \"b734d30f-bb89-4e8e-88cd-e6a0f051c64b\" (UID: \"b734d30f-bb89-4e8e-88cd-e6a0f051c64b\") " Mar 16 16:17:55 crc kubenswrapper[5120]: I0316 16:17:55.619899 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/b734d30f-bb89-4e8e-88cd-e6a0f051c64b-var-run" (OuterVolumeSpecName: "var-run") pod "b734d30f-bb89-4e8e-88cd-e6a0f051c64b" (UID: "b734d30f-bb89-4e8e-88cd-e6a0f051c64b"). InnerVolumeSpecName "var-run". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 16:17:55 crc kubenswrapper[5120]: I0316 16:17:55.619949 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"var-lib\" (UniqueName: \"kubernetes.io/host-path/b734d30f-bb89-4e8e-88cd-e6a0f051c64b-var-lib\") pod \"b734d30f-bb89-4e8e-88cd-e6a0f051c64b\" (UID: \"b734d30f-bb89-4e8e-88cd-e6a0f051c64b\") " Mar 16 16:17:55 crc kubenswrapper[5120]: I0316 16:17:55.620018 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/b734d30f-bb89-4e8e-88cd-e6a0f051c64b-var-lib" (OuterVolumeSpecName: "var-lib") pod "b734d30f-bb89-4e8e-88cd-e6a0f051c64b" (UID: "b734d30f-bb89-4e8e-88cd-e6a0f051c64b"). InnerVolumeSpecName "var-lib". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 16:17:55 crc kubenswrapper[5120]: I0316 16:17:55.620226 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w4bn9\" (UniqueName: \"kubernetes.io/projected/b734d30f-bb89-4e8e-88cd-e6a0f051c64b-kube-api-access-w4bn9\") pod \"b734d30f-bb89-4e8e-88cd-e6a0f051c64b\" (UID: \"b734d30f-bb89-4e8e-88cd-e6a0f051c64b\") " Mar 16 16:17:55 crc kubenswrapper[5120]: I0316 16:17:55.620336 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-ovs\" (UniqueName: \"kubernetes.io/host-path/b734d30f-bb89-4e8e-88cd-e6a0f051c64b-etc-ovs\") pod \"b734d30f-bb89-4e8e-88cd-e6a0f051c64b\" (UID: \"b734d30f-bb89-4e8e-88cd-e6a0f051c64b\") " Mar 16 16:17:55 crc kubenswrapper[5120]: I0316 16:17:55.620462 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"var-log\" (UniqueName: \"kubernetes.io/host-path/b734d30f-bb89-4e8e-88cd-e6a0f051c64b-var-log\") pod \"b734d30f-bb89-4e8e-88cd-e6a0f051c64b\" (UID: \"b734d30f-bb89-4e8e-88cd-e6a0f051c64b\") " Mar 16 16:17:55 crc kubenswrapper[5120]: I0316 16:17:55.620466 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/b734d30f-bb89-4e8e-88cd-e6a0f051c64b-etc-ovs" (OuterVolumeSpecName: "etc-ovs") pod "b734d30f-bb89-4e8e-88cd-e6a0f051c64b" (UID: "b734d30f-bb89-4e8e-88cd-e6a0f051c64b"). InnerVolumeSpecName "etc-ovs". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 16:17:55 crc kubenswrapper[5120]: I0316 16:17:55.620496 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/b734d30f-bb89-4e8e-88cd-e6a0f051c64b-scripts\") pod \"b734d30f-bb89-4e8e-88cd-e6a0f051c64b\" (UID: \"b734d30f-bb89-4e8e-88cd-e6a0f051c64b\") " Mar 16 16:17:55 crc kubenswrapper[5120]: I0316 16:17:55.620559 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/b734d30f-bb89-4e8e-88cd-e6a0f051c64b-var-log" (OuterVolumeSpecName: "var-log") pod "b734d30f-bb89-4e8e-88cd-e6a0f051c64b" (UID: "b734d30f-bb89-4e8e-88cd-e6a0f051c64b"). InnerVolumeSpecName "var-log". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 16:17:55 crc kubenswrapper[5120]: I0316 16:17:55.621623 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b734d30f-bb89-4e8e-88cd-e6a0f051c64b-scripts" (OuterVolumeSpecName: "scripts") pod "b734d30f-bb89-4e8e-88cd-e6a0f051c64b" (UID: "b734d30f-bb89-4e8e-88cd-e6a0f051c64b"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:17:55 crc kubenswrapper[5120]: I0316 16:17:55.622165 5120 reconciler_common.go:299] "Volume detached for volume \"var-log\" (UniqueName: \"kubernetes.io/host-path/b734d30f-bb89-4e8e-88cd-e6a0f051c64b-var-log\") on node \"crc\" DevicePath \"\"" Mar 16 16:17:55 crc kubenswrapper[5120]: I0316 16:17:55.622205 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/b734d30f-bb89-4e8e-88cd-e6a0f051c64b-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:17:55 crc kubenswrapper[5120]: I0316 16:17:55.622226 5120 reconciler_common.go:299] "Volume detached for volume \"var-run\" (UniqueName: \"kubernetes.io/host-path/b734d30f-bb89-4e8e-88cd-e6a0f051c64b-var-run\") on node \"crc\" DevicePath \"\"" Mar 16 16:17:55 crc kubenswrapper[5120]: I0316 16:17:55.622244 5120 reconciler_common.go:299] "Volume detached for volume \"var-lib\" (UniqueName: \"kubernetes.io/host-path/b734d30f-bb89-4e8e-88cd-e6a0f051c64b-var-lib\") on node \"crc\" DevicePath \"\"" Mar 16 16:17:55 crc kubenswrapper[5120]: I0316 16:17:55.622262 5120 reconciler_common.go:299] "Volume detached for volume \"etc-ovs\" (UniqueName: \"kubernetes.io/host-path/b734d30f-bb89-4e8e-88cd-e6a0f051c64b-etc-ovs\") on node \"crc\" DevicePath \"\"" Mar 16 16:17:55 crc kubenswrapper[5120]: I0316 16:17:55.629695 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b734d30f-bb89-4e8e-88cd-e6a0f051c64b-kube-api-access-w4bn9" (OuterVolumeSpecName: "kube-api-access-w4bn9") pod "b734d30f-bb89-4e8e-88cd-e6a0f051c64b" (UID: "b734d30f-bb89-4e8e-88cd-e6a0f051c64b"). InnerVolumeSpecName "kube-api-access-w4bn9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:17:55 crc kubenswrapper[5120]: I0316 16:17:55.724208 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w4bn9\" (UniqueName: \"kubernetes.io/projected/b734d30f-bb89-4e8e-88cd-e6a0f051c64b-kube-api-access-w4bn9\") on node \"crc\" DevicePath \"\"" Mar 16 16:17:56 crc kubenswrapper[5120]: I0316 16:17:56.378864 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-controller-ovs-4qzrp_b734d30f-bb89-4e8e-88cd-e6a0f051c64b/ovs-vswitchd/0.log" Mar 16 16:17:56 crc kubenswrapper[5120]: I0316 16:17:56.379887 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-controller-ovs-4qzrp" Mar 16 16:17:56 crc kubenswrapper[5120]: I0316 16:17:56.379910 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-controller-ovs-4qzrp" event={"ID":"b734d30f-bb89-4e8e-88cd-e6a0f051c64b","Type":"ContainerDied","Data":"1ed81c7d3cf0eee360f755d73da4aa4bd25f260e4689ccb5dc588a833e8a0114"} Mar 16 16:17:56 crc kubenswrapper[5120]: I0316 16:17:56.379976 5120 scope.go:117] "RemoveContainer" containerID="c27b52f4291138b8ac6c9ecb5133e11d4e129f0f8b4432aadea7661f7b2368d0" Mar 16 16:17:56 crc kubenswrapper[5120]: I0316 16:17:56.380487 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-marketplace/redhat-operators-9nt5d" podUID="a9aa8c5d-78c1-43ce-9503-6e2ef87c6520" containerName="registry-server" containerID="cri-o://288367643eabb0ee1295994ece8e8c48b647029ba1585d135ce563eabe31aebd" gracePeriod=2 Mar 16 16:17:56 crc kubenswrapper[5120]: I0316 16:17:56.418373 5120 scope.go:117] "RemoveContainer" containerID="de08a06c73642c2a52be29d79b2ff5646efcf3737041ebcd688aa295572d020a" Mar 16 16:17:56 crc kubenswrapper[5120]: I0316 16:17:56.423178 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-controller-ovs-4qzrp"] Mar 16 16:17:56 crc kubenswrapper[5120]: I0316 16:17:56.434503 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovn-controller-ovs-4qzrp"] Mar 16 16:17:56 crc kubenswrapper[5120]: I0316 16:17:56.450655 5120 scope.go:117] "RemoveContainer" containerID="0e1210f42fc82b8ff11d58113944f05b6f0bd52dcf345eadad7a2780ba72a429" Mar 16 16:17:56 crc kubenswrapper[5120]: I0316 16:17:56.701824 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8305890a-6a7f-4a42-a6af-33ab4f36a9fd" path="/var/lib/kubelet/pods/8305890a-6a7f-4a42-a6af-33ab4f36a9fd/volumes" Mar 16 16:17:56 crc kubenswrapper[5120]: I0316 16:17:56.702592 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8b5dd88c-6425-4d5a-b2d4-f2ed35fa8a1c" path="/var/lib/kubelet/pods/8b5dd88c-6425-4d5a-b2d4-f2ed35fa8a1c/volumes" Mar 16 16:17:56 crc kubenswrapper[5120]: I0316 16:17:56.703222 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b734d30f-bb89-4e8e-88cd-e6a0f051c64b" path="/var/lib/kubelet/pods/b734d30f-bb89-4e8e-88cd-e6a0f051c64b/volumes" Mar 16 16:17:56 crc kubenswrapper[5120]: I0316 16:17:56.938293 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-9nt5d" Mar 16 16:17:56 crc kubenswrapper[5120]: I0316 16:17:56.957594 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/a9aa8c5d-78c1-43ce-9503-6e2ef87c6520-utilities\") pod \"a9aa8c5d-78c1-43ce-9503-6e2ef87c6520\" (UID: \"a9aa8c5d-78c1-43ce-9503-6e2ef87c6520\") " Mar 16 16:17:56 crc kubenswrapper[5120]: I0316 16:17:56.957947 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nlwd4\" (UniqueName: \"kubernetes.io/projected/a9aa8c5d-78c1-43ce-9503-6e2ef87c6520-kube-api-access-nlwd4\") pod \"a9aa8c5d-78c1-43ce-9503-6e2ef87c6520\" (UID: \"a9aa8c5d-78c1-43ce-9503-6e2ef87c6520\") " Mar 16 16:17:56 crc kubenswrapper[5120]: I0316 16:17:56.958205 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/a9aa8c5d-78c1-43ce-9503-6e2ef87c6520-catalog-content\") pod \"a9aa8c5d-78c1-43ce-9503-6e2ef87c6520\" (UID: \"a9aa8c5d-78c1-43ce-9503-6e2ef87c6520\") " Mar 16 16:17:56 crc kubenswrapper[5120]: I0316 16:17:56.958865 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a9aa8c5d-78c1-43ce-9503-6e2ef87c6520-utilities" (OuterVolumeSpecName: "utilities") pod "a9aa8c5d-78c1-43ce-9503-6e2ef87c6520" (UID: "a9aa8c5d-78c1-43ce-9503-6e2ef87c6520"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:17:56 crc kubenswrapper[5120]: I0316 16:17:56.959391 5120 reconciler_common.go:299] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/a9aa8c5d-78c1-43ce-9503-6e2ef87c6520-utilities\") on node \"crc\" DevicePath \"\"" Mar 16 16:17:56 crc kubenswrapper[5120]: I0316 16:17:56.977079 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a9aa8c5d-78c1-43ce-9503-6e2ef87c6520-kube-api-access-nlwd4" (OuterVolumeSpecName: "kube-api-access-nlwd4") pod "a9aa8c5d-78c1-43ce-9503-6e2ef87c6520" (UID: "a9aa8c5d-78c1-43ce-9503-6e2ef87c6520"). InnerVolumeSpecName "kube-api-access-nlwd4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:17:57 crc kubenswrapper[5120]: I0316 16:17:57.061325 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nlwd4\" (UniqueName: \"kubernetes.io/projected/a9aa8c5d-78c1-43ce-9503-6e2ef87c6520-kube-api-access-nlwd4\") on node \"crc\" DevicePath \"\"" Mar 16 16:17:57 crc kubenswrapper[5120]: I0316 16:17:57.390508 5120 generic.go:358] "Generic (PLEG): container finished" podID="a9aa8c5d-78c1-43ce-9503-6e2ef87c6520" containerID="288367643eabb0ee1295994ece8e8c48b647029ba1585d135ce563eabe31aebd" exitCode=0 Mar 16 16:17:57 crc kubenswrapper[5120]: I0316 16:17:57.390616 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-9nt5d" Mar 16 16:17:57 crc kubenswrapper[5120]: I0316 16:17:57.390657 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-9nt5d" event={"ID":"a9aa8c5d-78c1-43ce-9503-6e2ef87c6520","Type":"ContainerDied","Data":"288367643eabb0ee1295994ece8e8c48b647029ba1585d135ce563eabe31aebd"} Mar 16 16:17:57 crc kubenswrapper[5120]: I0316 16:17:57.390725 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-9nt5d" event={"ID":"a9aa8c5d-78c1-43ce-9503-6e2ef87c6520","Type":"ContainerDied","Data":"587faa8e2b87852c846f87b5c31a8141ca2d4e73275e493690ec19b81fe9fe47"} Mar 16 16:17:57 crc kubenswrapper[5120]: I0316 16:17:57.390772 5120 scope.go:117] "RemoveContainer" containerID="288367643eabb0ee1295994ece8e8c48b647029ba1585d135ce563eabe31aebd" Mar 16 16:17:57 crc kubenswrapper[5120]: I0316 16:17:57.423220 5120 scope.go:117] "RemoveContainer" containerID="507cd307b37fb9b60be37e70fbfdce4bc19d3a1a482500e51e802c02ddc04726" Mar 16 16:17:57 crc kubenswrapper[5120]: I0316 16:17:57.459625 5120 scope.go:117] "RemoveContainer" containerID="d2fbb2b1ad82b81d9b5998b40417bd6c705ce5ddfe7dad9be381ef1c4a4df360" Mar 16 16:17:57 crc kubenswrapper[5120]: I0316 16:17:57.480838 5120 scope.go:117] "RemoveContainer" containerID="288367643eabb0ee1295994ece8e8c48b647029ba1585d135ce563eabe31aebd" Mar 16 16:17:57 crc kubenswrapper[5120]: E0316 16:17:57.481260 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"288367643eabb0ee1295994ece8e8c48b647029ba1585d135ce563eabe31aebd\": container with ID starting with 288367643eabb0ee1295994ece8e8c48b647029ba1585d135ce563eabe31aebd not found: ID does not exist" containerID="288367643eabb0ee1295994ece8e8c48b647029ba1585d135ce563eabe31aebd" Mar 16 16:17:57 crc kubenswrapper[5120]: I0316 16:17:57.481306 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"288367643eabb0ee1295994ece8e8c48b647029ba1585d135ce563eabe31aebd"} err="failed to get container status \"288367643eabb0ee1295994ece8e8c48b647029ba1585d135ce563eabe31aebd\": rpc error: code = NotFound desc = could not find container \"288367643eabb0ee1295994ece8e8c48b647029ba1585d135ce563eabe31aebd\": container with ID starting with 288367643eabb0ee1295994ece8e8c48b647029ba1585d135ce563eabe31aebd not found: ID does not exist" Mar 16 16:17:57 crc kubenswrapper[5120]: I0316 16:17:57.481333 5120 scope.go:117] "RemoveContainer" containerID="507cd307b37fb9b60be37e70fbfdce4bc19d3a1a482500e51e802c02ddc04726" Mar 16 16:17:57 crc kubenswrapper[5120]: E0316 16:17:57.481737 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"507cd307b37fb9b60be37e70fbfdce4bc19d3a1a482500e51e802c02ddc04726\": container with ID starting with 507cd307b37fb9b60be37e70fbfdce4bc19d3a1a482500e51e802c02ddc04726 not found: ID does not exist" containerID="507cd307b37fb9b60be37e70fbfdce4bc19d3a1a482500e51e802c02ddc04726" Mar 16 16:17:57 crc kubenswrapper[5120]: I0316 16:17:57.481922 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"507cd307b37fb9b60be37e70fbfdce4bc19d3a1a482500e51e802c02ddc04726"} err="failed to get container status \"507cd307b37fb9b60be37e70fbfdce4bc19d3a1a482500e51e802c02ddc04726\": rpc error: code = NotFound desc = could not find container \"507cd307b37fb9b60be37e70fbfdce4bc19d3a1a482500e51e802c02ddc04726\": container with ID starting with 507cd307b37fb9b60be37e70fbfdce4bc19d3a1a482500e51e802c02ddc04726 not found: ID does not exist" Mar 16 16:17:57 crc kubenswrapper[5120]: I0316 16:17:57.481954 5120 scope.go:117] "RemoveContainer" containerID="d2fbb2b1ad82b81d9b5998b40417bd6c705ce5ddfe7dad9be381ef1c4a4df360" Mar 16 16:17:57 crc kubenswrapper[5120]: E0316 16:17:57.482391 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d2fbb2b1ad82b81d9b5998b40417bd6c705ce5ddfe7dad9be381ef1c4a4df360\": container with ID starting with d2fbb2b1ad82b81d9b5998b40417bd6c705ce5ddfe7dad9be381ef1c4a4df360 not found: ID does not exist" containerID="d2fbb2b1ad82b81d9b5998b40417bd6c705ce5ddfe7dad9be381ef1c4a4df360" Mar 16 16:17:57 crc kubenswrapper[5120]: I0316 16:17:57.482422 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2fbb2b1ad82b81d9b5998b40417bd6c705ce5ddfe7dad9be381ef1c4a4df360"} err="failed to get container status \"d2fbb2b1ad82b81d9b5998b40417bd6c705ce5ddfe7dad9be381ef1c4a4df360\": rpc error: code = NotFound desc = could not find container \"d2fbb2b1ad82b81d9b5998b40417bd6c705ce5ddfe7dad9be381ef1c4a4df360\": container with ID starting with d2fbb2b1ad82b81d9b5998b40417bd6c705ce5ddfe7dad9be381ef1c4a4df360 not found: ID does not exist" Mar 16 16:17:57 crc kubenswrapper[5120]: I0316 16:17:57.801928 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/root-account-create-update-bh8f4"] Mar 16 16:17:57 crc kubenswrapper[5120]: I0316 16:17:57.802884 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9aa8c5d-78c1-43ce-9503-6e2ef87c6520" containerName="extract-content" Mar 16 16:17:57 crc kubenswrapper[5120]: I0316 16:17:57.802901 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9aa8c5d-78c1-43ce-9503-6e2ef87c6520" containerName="extract-content" Mar 16 16:17:57 crc kubenswrapper[5120]: I0316 16:17:57.802913 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b734d30f-bb89-4e8e-88cd-e6a0f051c64b" containerName="ovsdb-server" Mar 16 16:17:57 crc kubenswrapper[5120]: I0316 16:17:57.802919 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="b734d30f-bb89-4e8e-88cd-e6a0f051c64b" containerName="ovsdb-server" Mar 16 16:17:57 crc kubenswrapper[5120]: I0316 16:17:57.802931 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8305890a-6a7f-4a42-a6af-33ab4f36a9fd" containerName="ovn-controller" Mar 16 16:17:57 crc kubenswrapper[5120]: I0316 16:17:57.802937 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8305890a-6a7f-4a42-a6af-33ab4f36a9fd" containerName="ovn-controller" Mar 16 16:17:57 crc kubenswrapper[5120]: I0316 16:17:57.802952 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9aa8c5d-78c1-43ce-9503-6e2ef87c6520" containerName="extract-utilities" Mar 16 16:17:57 crc kubenswrapper[5120]: I0316 16:17:57.802958 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9aa8c5d-78c1-43ce-9503-6e2ef87c6520" containerName="extract-utilities" Mar 16 16:17:57 crc kubenswrapper[5120]: I0316 16:17:57.802976 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b734d30f-bb89-4e8e-88cd-e6a0f051c64b" containerName="ovs-vswitchd" Mar 16 16:17:57 crc kubenswrapper[5120]: I0316 16:17:57.802982 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="b734d30f-bb89-4e8e-88cd-e6a0f051c64b" containerName="ovs-vswitchd" Mar 16 16:17:57 crc kubenswrapper[5120]: I0316 16:17:57.802996 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9aa8c5d-78c1-43ce-9503-6e2ef87c6520" containerName="registry-server" Mar 16 16:17:57 crc kubenswrapper[5120]: I0316 16:17:57.803002 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9aa8c5d-78c1-43ce-9503-6e2ef87c6520" containerName="registry-server" Mar 16 16:17:57 crc kubenswrapper[5120]: I0316 16:17:57.803022 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b734d30f-bb89-4e8e-88cd-e6a0f051c64b" containerName="ovsdb-server-init" Mar 16 16:17:57 crc kubenswrapper[5120]: I0316 16:17:57.803028 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="b734d30f-bb89-4e8e-88cd-e6a0f051c64b" containerName="ovsdb-server-init" Mar 16 16:17:57 crc kubenswrapper[5120]: I0316 16:17:57.803052 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b5dd88c-6425-4d5a-b2d4-f2ed35fa8a1c" containerName="openstack-network-exporter" Mar 16 16:17:57 crc kubenswrapper[5120]: I0316 16:17:57.803059 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b5dd88c-6425-4d5a-b2d4-f2ed35fa8a1c" containerName="openstack-network-exporter" Mar 16 16:17:57 crc kubenswrapper[5120]: I0316 16:17:57.803210 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="8305890a-6a7f-4a42-a6af-33ab4f36a9fd" containerName="ovn-controller" Mar 16 16:17:57 crc kubenswrapper[5120]: I0316 16:17:57.803222 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="8b5dd88c-6425-4d5a-b2d4-f2ed35fa8a1c" containerName="openstack-network-exporter" Mar 16 16:17:57 crc kubenswrapper[5120]: I0316 16:17:57.803231 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="b734d30f-bb89-4e8e-88cd-e6a0f051c64b" containerName="ovs-vswitchd" Mar 16 16:17:57 crc kubenswrapper[5120]: I0316 16:17:57.803243 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="a9aa8c5d-78c1-43ce-9503-6e2ef87c6520" containerName="registry-server" Mar 16 16:17:57 crc kubenswrapper[5120]: I0316 16:17:57.803254 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="b734d30f-bb89-4e8e-88cd-e6a0f051c64b" containerName="ovsdb-server" Mar 16 16:17:57 crc kubenswrapper[5120]: I0316 16:17:57.828288 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-bh8f4" Mar 16 16:17:57 crc kubenswrapper[5120]: I0316 16:17:57.831083 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"openstack-mariadb-root-db-secret\"" Mar 16 16:17:57 crc kubenswrapper[5120]: I0316 16:17:57.871278 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-bh8f4"] Mar 16 16:17:57 crc kubenswrapper[5120]: I0316 16:17:57.877811 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvjx8\" (UniqueName: \"kubernetes.io/projected/90982d87-fc0f-49d0-a400-4155e4f3b000-kube-api-access-tvjx8\") pod \"root-account-create-update-bh8f4\" (UID: \"90982d87-fc0f-49d0-a400-4155e4f3b000\") " pod="openstack-kuttl-tests/root-account-create-update-bh8f4" Mar 16 16:17:57 crc kubenswrapper[5120]: I0316 16:17:57.877872 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/90982d87-fc0f-49d0-a400-4155e4f3b000-operator-scripts\") pod \"root-account-create-update-bh8f4\" (UID: \"90982d87-fc0f-49d0-a400-4155e4f3b000\") " pod="openstack-kuttl-tests/root-account-create-update-bh8f4" Mar 16 16:17:57 crc kubenswrapper[5120]: I0316 16:17:57.963864 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-xczfx"] Mar 16 16:17:57 crc kubenswrapper[5120]: I0316 16:17:57.979971 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tvjx8\" (UniqueName: \"kubernetes.io/projected/90982d87-fc0f-49d0-a400-4155e4f3b000-kube-api-access-tvjx8\") pod \"root-account-create-update-bh8f4\" (UID: \"90982d87-fc0f-49d0-a400-4155e4f3b000\") " pod="openstack-kuttl-tests/root-account-create-update-bh8f4" Mar 16 16:17:57 crc kubenswrapper[5120]: I0316 16:17:57.980028 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/90982d87-fc0f-49d0-a400-4155e4f3b000-operator-scripts\") pod \"root-account-create-update-bh8f4\" (UID: \"90982d87-fc0f-49d0-a400-4155e4f3b000\") " pod="openstack-kuttl-tests/root-account-create-update-bh8f4" Mar 16 16:17:57 crc kubenswrapper[5120]: I0316 16:17:57.980967 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/90982d87-fc0f-49d0-a400-4155e4f3b000-operator-scripts\") pod \"root-account-create-update-bh8f4\" (UID: \"90982d87-fc0f-49d0-a400-4155e4f3b000\") " pod="openstack-kuttl-tests/root-account-create-update-bh8f4" Mar 16 16:17:57 crc kubenswrapper[5120]: I0316 16:17:57.983649 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-xczfx"] Mar 16 16:17:58 crc kubenswrapper[5120]: I0316 16:17:58.004458 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 16:17:58 crc kubenswrapper[5120]: I0316 16:17:58.022402 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvjx8\" (UniqueName: \"kubernetes.io/projected/90982d87-fc0f-49d0-a400-4155e4f3b000-kube-api-access-tvjx8\") pod \"root-account-create-update-bh8f4\" (UID: \"90982d87-fc0f-49d0-a400-4155e4f3b000\") " pod="openstack-kuttl-tests/root-account-create-update-bh8f4" Mar 16 16:17:58 crc kubenswrapper[5120]: I0316 16:17:58.053053 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-347f-account-create-update-kvc8k"] Mar 16 16:17:58 crc kubenswrapper[5120]: I0316 16:17:58.101602 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-347f-account-create-update-5mt2p"] Mar 16 16:17:58 crc kubenswrapper[5120]: I0316 16:17:58.101782 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-347f-account-create-update-kvc8k" Mar 16 16:17:58 crc kubenswrapper[5120]: I0316 16:17:58.114053 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-db-secret\"" Mar 16 16:17:58 crc kubenswrapper[5120]: I0316 16:17:58.117155 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-347f-account-create-update-kvc8k"] Mar 16 16:17:58 crc kubenswrapper[5120]: I0316 16:17:58.143595 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-bh8f4" Mar 16 16:17:58 crc kubenswrapper[5120]: I0316 16:17:58.178265 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-347f-account-create-update-5mt2p"] Mar 16 16:17:58 crc kubenswrapper[5120]: I0316 16:17:58.184684 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/6cf8b665-920c-4d82-92eb-508d6ca3e9a1-operator-scripts\") pod \"placement-347f-account-create-update-kvc8k\" (UID: \"6cf8b665-920c-4d82-92eb-508d6ca3e9a1\") " pod="openstack-kuttl-tests/placement-347f-account-create-update-kvc8k" Mar 16 16:17:58 crc kubenswrapper[5120]: I0316 16:17:58.184803 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9s8bd\" (UniqueName: \"kubernetes.io/projected/6cf8b665-920c-4d82-92eb-508d6ca3e9a1-kube-api-access-9s8bd\") pod \"placement-347f-account-create-update-kvc8k\" (UID: \"6cf8b665-920c-4d82-92eb-508d6ca3e9a1\") " pod="openstack-kuttl-tests/placement-347f-account-create-update-kvc8k" Mar 16 16:17:58 crc kubenswrapper[5120]: I0316 16:17:58.220916 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 16:17:58 crc kubenswrapper[5120]: I0316 16:17:58.221143 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/openstackclient" podUID="6064cc64-d619-4992-a1f6-b174b05d8ebf" containerName="openstackclient" containerID="cri-o://ad0375bf4af105fa6a34f99135b8947f56c2ad8a62f3ea28296881a4467a492c" gracePeriod=2 Mar 16 16:17:58 crc kubenswrapper[5120]: I0316 16:17:58.260653 5120 status_manager.go:895] "Failed to get status for pod" podUID="6064cc64-d619-4992-a1f6-b174b05d8ebf" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 16:17:58 crc kubenswrapper[5120]: I0316 16:17:58.266344 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 16:17:58 crc kubenswrapper[5120]: I0316 16:17:58.289393 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9s8bd\" (UniqueName: \"kubernetes.io/projected/6cf8b665-920c-4d82-92eb-508d6ca3e9a1-kube-api-access-9s8bd\") pod \"placement-347f-account-create-update-kvc8k\" (UID: \"6cf8b665-920c-4d82-92eb-508d6ca3e9a1\") " pod="openstack-kuttl-tests/placement-347f-account-create-update-kvc8k" Mar 16 16:17:58 crc kubenswrapper[5120]: I0316 16:17:58.289630 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/6cf8b665-920c-4d82-92eb-508d6ca3e9a1-operator-scripts\") pod \"placement-347f-account-create-update-kvc8k\" (UID: \"6cf8b665-920c-4d82-92eb-508d6ca3e9a1\") " pod="openstack-kuttl-tests/placement-347f-account-create-update-kvc8k" Mar 16 16:17:58 crc kubenswrapper[5120]: I0316 16:17:58.303393 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/6cf8b665-920c-4d82-92eb-508d6ca3e9a1-operator-scripts\") pod \"placement-347f-account-create-update-kvc8k\" (UID: \"6cf8b665-920c-4d82-92eb-508d6ca3e9a1\") " pod="openstack-kuttl-tests/placement-347f-account-create-update-kvc8k" Mar 16 16:17:58 crc kubenswrapper[5120]: I0316 16:17:58.366450 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9s8bd\" (UniqueName: \"kubernetes.io/projected/6cf8b665-920c-4d82-92eb-508d6ca3e9a1-kube-api-access-9s8bd\") pod \"placement-347f-account-create-update-kvc8k\" (UID: \"6cf8b665-920c-4d82-92eb-508d6ca3e9a1\") " pod="openstack-kuttl-tests/placement-347f-account-create-update-kvc8k" Mar 16 16:17:58 crc kubenswrapper[5120]: I0316 16:17:58.382845 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 16:17:58 crc kubenswrapper[5120]: I0316 16:17:58.383121 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovn-northd-0" podUID="43c58ec7-474a-49bc-921f-89cf47b67811" containerName="ovn-northd" containerID="cri-o://91983d4216ebe44a593c5fc4a07bcf3d059ad912a84a5035330dd9bd796a595d" gracePeriod=30 Mar 16 16:17:58 crc kubenswrapper[5120]: I0316 16:17:58.383569 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovn-northd-0" podUID="43c58ec7-474a-49bc-921f-89cf47b67811" containerName="openstack-network-exporter" containerID="cri-o://c129c8987a210dccaf5b5f1284053994d439c82b3f7a189597964833bd162b00" gracePeriod=30 Mar 16 16:17:58 crc kubenswrapper[5120]: I0316 16:17:58.397512 5120 status_manager.go:895] "Failed to get status for pod" podUID="6064cc64-d619-4992-a1f6-b174b05d8ebf" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 16:17:58 crc kubenswrapper[5120]: I0316 16:17:58.422058 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a9aa8c5d-78c1-43ce-9503-6e2ef87c6520-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "a9aa8c5d-78c1-43ce-9503-6e2ef87c6520" (UID: "a9aa8c5d-78c1-43ce-9503-6e2ef87c6520"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:17:58 crc kubenswrapper[5120]: I0316 16:17:58.441389 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-347f-account-create-update-kvc8k" Mar 16 16:17:58 crc kubenswrapper[5120]: I0316 16:17:58.446595 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-c034-account-create-update-vtkb4"] Mar 16 16:17:58 crc kubenswrapper[5120]: I0316 16:17:58.486414 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-c034-account-create-update-vtkb4"] Mar 16 16:17:58 crc kubenswrapper[5120]: I0316 16:17:58.512044 5120 reconciler_common.go:299] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/a9aa8c5d-78c1-43ce-9503-6e2ef87c6520-catalog-content\") on node \"crc\" DevicePath \"\"" Mar 16 16:17:58 crc kubenswrapper[5120]: I0316 16:17:58.524594 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-39eb-account-create-update-tnz8p"] Mar 16 16:17:58 crc kubenswrapper[5120]: I0316 16:17:58.526042 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6064cc64-d619-4992-a1f6-b174b05d8ebf" containerName="openstackclient" Mar 16 16:17:58 crc kubenswrapper[5120]: I0316 16:17:58.526065 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="6064cc64-d619-4992-a1f6-b174b05d8ebf" containerName="openstackclient" Mar 16 16:17:58 crc kubenswrapper[5120]: I0316 16:17:58.526353 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="6064cc64-d619-4992-a1f6-b174b05d8ebf" containerName="openstackclient" Mar 16 16:17:58 crc kubenswrapper[5120]: I0316 16:17:58.546802 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-39eb-account-create-update-tnz8p" Mar 16 16:17:58 crc kubenswrapper[5120]: I0316 16:17:58.596351 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-e3fe-account-create-update-dgd59"] Mar 16 16:17:58 crc kubenswrapper[5120]: I0316 16:17:58.608249 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-e3fe-account-create-update-dgd59" Mar 16 16:17:58 crc kubenswrapper[5120]: I0316 16:17:58.623606 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-db-secret\"" Mar 16 16:17:58 crc kubenswrapper[5120]: I0316 16:17:58.624247 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-db-secret\"" Mar 16 16:17:58 crc kubenswrapper[5120]: I0316 16:17:58.656260 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-39eb-account-create-update-tnz8p"] Mar 16 16:17:58 crc kubenswrapper[5120]: I0316 16:17:58.715388 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b4c1be7-4f3b-490b-bf6d-89281ddf8c5b" path="/var/lib/kubelet/pods/4b4c1be7-4f3b-490b-bf6d-89281ddf8c5b/volumes" Mar 16 16:17:58 crc kubenswrapper[5120]: I0316 16:17:58.725124 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/979c2589-0aa0-4e9c-8a97-9fd5a1676e64-operator-scripts\") pod \"glance-e3fe-account-create-update-dgd59\" (UID: \"979c2589-0aa0-4e9c-8a97-9fd5a1676e64\") " pod="openstack-kuttl-tests/glance-e3fe-account-create-update-dgd59" Mar 16 16:17:58 crc kubenswrapper[5120]: I0316 16:17:58.725193 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hsp5v\" (UniqueName: \"kubernetes.io/projected/979c2589-0aa0-4e9c-8a97-9fd5a1676e64-kube-api-access-hsp5v\") pod \"glance-e3fe-account-create-update-dgd59\" (UID: \"979c2589-0aa0-4e9c-8a97-9fd5a1676e64\") " pod="openstack-kuttl-tests/glance-e3fe-account-create-update-dgd59" Mar 16 16:17:58 crc kubenswrapper[5120]: I0316 16:17:58.725225 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0d72ed4f-2b58-4e71-ada5-a06739dac8b2-operator-scripts\") pod \"barbican-39eb-account-create-update-tnz8p\" (UID: \"0d72ed4f-2b58-4e71-ada5-a06739dac8b2\") " pod="openstack-kuttl-tests/barbican-39eb-account-create-update-tnz8p" Mar 16 16:17:58 crc kubenswrapper[5120]: I0316 16:17:58.725356 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8g9tn\" (UniqueName: \"kubernetes.io/projected/0d72ed4f-2b58-4e71-ada5-a06739dac8b2-kube-api-access-8g9tn\") pod \"barbican-39eb-account-create-update-tnz8p\" (UID: \"0d72ed4f-2b58-4e71-ada5-a06739dac8b2\") " pod="openstack-kuttl-tests/barbican-39eb-account-create-update-tnz8p" Mar 16 16:17:58 crc kubenswrapper[5120]: I0316 16:17:58.727437 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="62b9615a-6258-4e79-a0dc-e77955db96f8" path="/var/lib/kubelet/pods/62b9615a-6258-4e79-a0dc-e77955db96f8/volumes" Mar 16 16:17:58 crc kubenswrapper[5120]: I0316 16:17:58.731078 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a3c82ca6-cc5d-4f5d-ab18-ff0cf8187c85" path="/var/lib/kubelet/pods/a3c82ca6-cc5d-4f5d-ab18-ff0cf8187c85/volumes" Mar 16 16:17:58 crc kubenswrapper[5120]: I0316 16:17:58.731908 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-e3fe-account-create-update-dgd59"] Mar 16 16:17:58 crc kubenswrapper[5120]: I0316 16:17:58.734927 5120 kubelet_pods.go:1019] "Unable to retrieve pull secret, the image pull may not succeed." pod="openstack-kuttl-tests/swift-proxy-7c79cc45b-sp9b7" secret="" err="secret \"swift-swift-dockercfg-qxcsg\" not found" Mar 16 16:17:58 crc kubenswrapper[5120]: I0316 16:17:58.774231 5120 status_manager.go:895] "Failed to get status for pod" podUID="6064cc64-d619-4992-a1f6-b174b05d8ebf" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 16:17:58 crc kubenswrapper[5120]: I0316 16:17:58.827283 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8g9tn\" (UniqueName: \"kubernetes.io/projected/0d72ed4f-2b58-4e71-ada5-a06739dac8b2-kube-api-access-8g9tn\") pod \"barbican-39eb-account-create-update-tnz8p\" (UID: \"0d72ed4f-2b58-4e71-ada5-a06739dac8b2\") " pod="openstack-kuttl-tests/barbican-39eb-account-create-update-tnz8p" Mar 16 16:17:58 crc kubenswrapper[5120]: I0316 16:17:58.827655 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/979c2589-0aa0-4e9c-8a97-9fd5a1676e64-operator-scripts\") pod \"glance-e3fe-account-create-update-dgd59\" (UID: \"979c2589-0aa0-4e9c-8a97-9fd5a1676e64\") " pod="openstack-kuttl-tests/glance-e3fe-account-create-update-dgd59" Mar 16 16:17:58 crc kubenswrapper[5120]: I0316 16:17:58.827705 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hsp5v\" (UniqueName: \"kubernetes.io/projected/979c2589-0aa0-4e9c-8a97-9fd5a1676e64-kube-api-access-hsp5v\") pod \"glance-e3fe-account-create-update-dgd59\" (UID: \"979c2589-0aa0-4e9c-8a97-9fd5a1676e64\") " pod="openstack-kuttl-tests/glance-e3fe-account-create-update-dgd59" Mar 16 16:17:58 crc kubenswrapper[5120]: I0316 16:17:58.827746 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0d72ed4f-2b58-4e71-ada5-a06739dac8b2-operator-scripts\") pod \"barbican-39eb-account-create-update-tnz8p\" (UID: \"0d72ed4f-2b58-4e71-ada5-a06739dac8b2\") " pod="openstack-kuttl-tests/barbican-39eb-account-create-update-tnz8p" Mar 16 16:17:58 crc kubenswrapper[5120]: E0316 16:17:58.828270 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 16:17:58 crc kubenswrapper[5120]: E0316 16:17:58.828319 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c06828a4-039e-4080-a682-0bf5a7aaf9c2-combined-ca-bundle podName:c06828a4-039e-4080-a682-0bf5a7aaf9c2 nodeName:}" failed. No retries permitted until 2026-03-16 16:17:59.32830295 +0000 UTC m=+2781.482234607 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/c06828a4-039e-4080-a682-0bf5a7aaf9c2-combined-ca-bundle") pod "swift-proxy-7c79cc45b-sp9b7" (UID: "c06828a4-039e-4080-a682-0bf5a7aaf9c2") : secret "combined-ca-bundle" not found Mar 16 16:17:58 crc kubenswrapper[5120]: E0316 16:17:58.828745 5120 projected.go:264] Couldn't get secret openstack-kuttl-tests/swift-conf: secret "swift-conf" not found Mar 16 16:17:58 crc kubenswrapper[5120]: E0316 16:17:58.828779 5120 projected.go:289] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Mar 16 16:17:58 crc kubenswrapper[5120]: E0316 16:17:58.828799 5120 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-proxy-7c79cc45b-sp9b7: [secret "swift-conf" not found, configmap "swift-ring-files" not found] Mar 16 16:17:58 crc kubenswrapper[5120]: E0316 16:17:58.828850 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c06828a4-039e-4080-a682-0bf5a7aaf9c2-etc-swift podName:c06828a4-039e-4080-a682-0bf5a7aaf9c2 nodeName:}" failed. No retries permitted until 2026-03-16 16:17:59.328840994 +0000 UTC m=+2781.482772651 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/c06828a4-039e-4080-a682-0bf5a7aaf9c2-etc-swift") pod "swift-proxy-7c79cc45b-sp9b7" (UID: "c06828a4-039e-4080-a682-0bf5a7aaf9c2") : [secret "swift-conf" not found, configmap "swift-ring-files" not found] Mar 16 16:17:58 crc kubenswrapper[5120]: I0316 16:17:58.829356 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/979c2589-0aa0-4e9c-8a97-9fd5a1676e64-operator-scripts\") pod \"glance-e3fe-account-create-update-dgd59\" (UID: \"979c2589-0aa0-4e9c-8a97-9fd5a1676e64\") " pod="openstack-kuttl-tests/glance-e3fe-account-create-update-dgd59" Mar 16 16:17:58 crc kubenswrapper[5120]: I0316 16:17:58.830135 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0d72ed4f-2b58-4e71-ada5-a06739dac8b2-operator-scripts\") pod \"barbican-39eb-account-create-update-tnz8p\" (UID: \"0d72ed4f-2b58-4e71-ada5-a06739dac8b2\") " pod="openstack-kuttl-tests/barbican-39eb-account-create-update-tnz8p" Mar 16 16:17:58 crc kubenswrapper[5120]: I0316 16:17:58.834349 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-39eb-account-create-update-qbcgq"] Mar 16 16:17:58 crc kubenswrapper[5120]: I0316 16:17:58.900924 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8g9tn\" (UniqueName: \"kubernetes.io/projected/0d72ed4f-2b58-4e71-ada5-a06739dac8b2-kube-api-access-8g9tn\") pod \"barbican-39eb-account-create-update-tnz8p\" (UID: \"0d72ed4f-2b58-4e71-ada5-a06739dac8b2\") " pod="openstack-kuttl-tests/barbican-39eb-account-create-update-tnz8p" Mar 16 16:17:58 crc kubenswrapper[5120]: I0316 16:17:58.950527 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-39eb-account-create-update-qbcgq"] Mar 16 16:17:59 crc kubenswrapper[5120]: I0316 16:17:59.014679 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hsp5v\" (UniqueName: \"kubernetes.io/projected/979c2589-0aa0-4e9c-8a97-9fd5a1676e64-kube-api-access-hsp5v\") pod \"glance-e3fe-account-create-update-dgd59\" (UID: \"979c2589-0aa0-4e9c-8a97-9fd5a1676e64\") " pod="openstack-kuttl-tests/glance-e3fe-account-create-update-dgd59" Mar 16 16:17:59 crc kubenswrapper[5120]: I0316 16:17:59.030126 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-9c08-account-create-update-w7m2p"] Mar 16 16:17:59 crc kubenswrapper[5120]: I0316 16:17:59.109050 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 16:17:59 crc kubenswrapper[5120]: I0316 16:17:59.109515 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-9c08-account-create-update-w7m2p" Mar 16 16:17:59 crc kubenswrapper[5120]: I0316 16:17:59.110140 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podUID="39b1a992-7cfc-4382-9263-18d430251511" containerName="openstack-network-exporter" containerID="cri-o://f24bdb846594a48104f84ee1555c401e3cab825116931065b9f832d3b9ecbacd" gracePeriod=300 Mar 16 16:17:59 crc kubenswrapper[5120]: I0316 16:17:59.147512 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-db-secret\"" Mar 16 16:17:59 crc kubenswrapper[5120]: I0316 16:17:59.156179 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-9c08-account-create-update-w7m2p"] Mar 16 16:17:59 crc kubenswrapper[5120]: I0316 16:17:59.190560 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-e3fe-account-create-update-6gdjr"] Mar 16 16:17:59 crc kubenswrapper[5120]: I0316 16:17:59.205979 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-e3fe-account-create-update-6gdjr"] Mar 16 16:17:59 crc kubenswrapper[5120]: I0316 16:17:59.252977 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-9c08-account-create-update-ld8t5"] Mar 16 16:17:59 crc kubenswrapper[5120]: I0316 16:17:59.275243 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/70f64346-8cba-4ea9-b229-c1ba5012ca42-operator-scripts\") pod \"neutron-9c08-account-create-update-w7m2p\" (UID: \"70f64346-8cba-4ea9-b229-c1ba5012ca42\") " pod="openstack-kuttl-tests/neutron-9c08-account-create-update-w7m2p" Mar 16 16:17:59 crc kubenswrapper[5120]: I0316 16:17:59.276256 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwd7h\" (UniqueName: \"kubernetes.io/projected/70f64346-8cba-4ea9-b229-c1ba5012ca42-kube-api-access-fwd7h\") pod \"neutron-9c08-account-create-update-w7m2p\" (UID: \"70f64346-8cba-4ea9-b229-c1ba5012ca42\") " pod="openstack-kuttl-tests/neutron-9c08-account-create-update-w7m2p" Mar 16 16:17:59 crc kubenswrapper[5120]: I0316 16:17:59.329889 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-9c08-account-create-update-ld8t5"] Mar 16 16:17:59 crc kubenswrapper[5120]: I0316 16:17:59.375070 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-dfhwx"] Mar 16 16:17:59 crc kubenswrapper[5120]: I0316 16:17:59.378602 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/70f64346-8cba-4ea9-b229-c1ba5012ca42-operator-scripts\") pod \"neutron-9c08-account-create-update-w7m2p\" (UID: \"70f64346-8cba-4ea9-b229-c1ba5012ca42\") " pod="openstack-kuttl-tests/neutron-9c08-account-create-update-w7m2p" Mar 16 16:17:59 crc kubenswrapper[5120]: I0316 16:17:59.378650 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fwd7h\" (UniqueName: \"kubernetes.io/projected/70f64346-8cba-4ea9-b229-c1ba5012ca42-kube-api-access-fwd7h\") pod \"neutron-9c08-account-create-update-w7m2p\" (UID: \"70f64346-8cba-4ea9-b229-c1ba5012ca42\") " pod="openstack-kuttl-tests/neutron-9c08-account-create-update-w7m2p" Mar 16 16:17:59 crc kubenswrapper[5120]: E0316 16:17:59.379026 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 16:17:59 crc kubenswrapper[5120]: E0316 16:17:59.379084 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c06828a4-039e-4080-a682-0bf5a7aaf9c2-combined-ca-bundle podName:c06828a4-039e-4080-a682-0bf5a7aaf9c2 nodeName:}" failed. No retries permitted until 2026-03-16 16:18:00.379067761 +0000 UTC m=+2782.532999408 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/c06828a4-039e-4080-a682-0bf5a7aaf9c2-combined-ca-bundle") pod "swift-proxy-7c79cc45b-sp9b7" (UID: "c06828a4-039e-4080-a682-0bf5a7aaf9c2") : secret "combined-ca-bundle" not found Mar 16 16:17:59 crc kubenswrapper[5120]: E0316 16:17:59.386305 5120 projected.go:264] Couldn't get secret openstack-kuttl-tests/swift-conf: secret "swift-conf" not found Mar 16 16:17:59 crc kubenswrapper[5120]: E0316 16:17:59.389331 5120 projected.go:289] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Mar 16 16:17:59 crc kubenswrapper[5120]: E0316 16:17:59.389652 5120 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-proxy-7c79cc45b-sp9b7: [secret "swift-conf" not found, configmap "swift-ring-files" not found] Mar 16 16:17:59 crc kubenswrapper[5120]: E0316 16:17:59.390296 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c06828a4-039e-4080-a682-0bf5a7aaf9c2-etc-swift podName:c06828a4-039e-4080-a682-0bf5a7aaf9c2 nodeName:}" failed. No retries permitted until 2026-03-16 16:18:00.389921182 +0000 UTC m=+2782.543852839 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/c06828a4-039e-4080-a682-0bf5a7aaf9c2-etc-swift") pod "swift-proxy-7c79cc45b-sp9b7" (UID: "c06828a4-039e-4080-a682-0bf5a7aaf9c2") : [secret "swift-conf" not found, configmap "swift-ring-files" not found] Mar 16 16:17:59 crc kubenswrapper[5120]: I0316 16:17:59.389103 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/70f64346-8cba-4ea9-b229-c1ba5012ca42-operator-scripts\") pod \"neutron-9c08-account-create-update-w7m2p\" (UID: \"70f64346-8cba-4ea9-b229-c1ba5012ca42\") " pod="openstack-kuttl-tests/neutron-9c08-account-create-update-w7m2p" Mar 16 16:17:59 crc kubenswrapper[5120]: I0316 16:17:59.398305 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-dfhwx"] Mar 16 16:17:59 crc kubenswrapper[5120]: I0316 16:17:59.428429 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwd7h\" (UniqueName: \"kubernetes.io/projected/70f64346-8cba-4ea9-b229-c1ba5012ca42-kube-api-access-fwd7h\") pod \"neutron-9c08-account-create-update-w7m2p\" (UID: \"70f64346-8cba-4ea9-b229-c1ba5012ca42\") " pod="openstack-kuttl-tests/neutron-9c08-account-create-update-w7m2p" Mar 16 16:17:59 crc kubenswrapper[5120]: I0316 16:17:59.449142 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 16:17:59 crc kubenswrapper[5120]: I0316 16:17:59.449742 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podUID="b82f3ed0-7b4a-4ac7-800a-40f5c2cb7242" containerName="openstack-network-exporter" containerID="cri-o://63b5afa737f6f7747352275491173c16cae3412926aa04a8ec50d294ba0d5c7e" gracePeriod=300 Mar 16 16:17:59 crc kubenswrapper[5120]: I0316 16:17:59.481955 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-zx6s6"] Mar 16 16:17:59 crc kubenswrapper[5120]: I0316 16:17:59.527983 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-zx6s6"] Mar 16 16:17:59 crc kubenswrapper[5120]: I0316 16:17:59.528045 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-wwjzc"] Mar 16 16:17:59 crc kubenswrapper[5120]: I0316 16:17:59.548098 5120 generic.go:358] "Generic (PLEG): container finished" podID="43c58ec7-474a-49bc-921f-89cf47b67811" containerID="c129c8987a210dccaf5b5f1284053994d439c82b3f7a189597964833bd162b00" exitCode=2 Mar 16 16:17:59 crc kubenswrapper[5120]: I0316 16:17:59.548454 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"43c58ec7-474a-49bc-921f-89cf47b67811","Type":"ContainerDied","Data":"c129c8987a210dccaf5b5f1284053994d439c82b3f7a189597964833bd162b00"} Mar 16 16:17:59 crc kubenswrapper[5120]: I0316 16:17:59.556861 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-wwjzc"] Mar 16 16:17:59 crc kubenswrapper[5120]: I0316 16:17:59.560243 5120 generic.go:358] "Generic (PLEG): container finished" podID="39b1a992-7cfc-4382-9263-18d430251511" containerID="f24bdb846594a48104f84ee1555c401e3cab825116931065b9f832d3b9ecbacd" exitCode=2 Mar 16 16:17:59 crc kubenswrapper[5120]: I0316 16:17:59.560376 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"39b1a992-7cfc-4382-9263-18d430251511","Type":"ContainerDied","Data":"f24bdb846594a48104f84ee1555c401e3cab825116931065b9f832d3b9ecbacd"} Mar 16 16:17:59 crc kubenswrapper[5120]: I0316 16:17:59.570252 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-9zjx8"] Mar 16 16:17:59 crc kubenswrapper[5120]: I0316 16:17:59.587205 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-2d21-account-create-update-vmvmw"] Mar 16 16:17:59 crc kubenswrapper[5120]: I0316 16:17:59.608841 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-9zjx8"] Mar 16 16:17:59 crc kubenswrapper[5120]: I0316 16:17:59.674404 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-2d21-account-create-update-vmvmw"] Mar 16 16:17:59 crc kubenswrapper[5120]: I0316 16:17:59.698661 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 16:17:59 crc kubenswrapper[5120]: I0316 16:17:59.774297 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podUID="b82f3ed0-7b4a-4ac7-800a-40f5c2cb7242" containerName="ovsdbserver-nb" containerID="cri-o://80c9afe3261c93a6525f7ff404170b08abdba9d0e0d9e39fe4469ee485fc35fe" gracePeriod=300 Mar 16 16:17:59 crc kubenswrapper[5120]: I0316 16:17:59.785648 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podUID="39b1a992-7cfc-4382-9263-18d430251511" containerName="ovsdbserver-sb" containerID="cri-o://b864e5a30bdd1ec09c5e8b740495f3b877525c6eb80190831e21454bd493272f" gracePeriod=300 Mar 16 16:17:59 crc kubenswrapper[5120]: I0316 16:17:59.787516 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-6758-account-create-update-mb8v8"] Mar 16 16:17:59 crc kubenswrapper[5120]: E0316 16:17:59.800902 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-config-data: configmap "rabbitmq-config-data" not found Mar 16 16:17:59 crc kubenswrapper[5120]: E0316 16:17:59.800972 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/51d5f0da-bcbc-492e-ab39-6189dc22fa22-config-data podName:51d5f0da-bcbc-492e-ab39-6189dc22fa22 nodeName:}" failed. No retries permitted until 2026-03-16 16:18:00.300956398 +0000 UTC m=+2782.454888055 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/51d5f0da-bcbc-492e-ab39-6189dc22fa22-config-data") pod "rabbitmq-server-0" (UID: "51d5f0da-bcbc-492e-ab39-6189dc22fa22") : configmap "rabbitmq-config-data" not found Mar 16 16:17:59 crc kubenswrapper[5120]: E0316 16:17:59.804566 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-galera-openstack-svc: secret "cert-galera-openstack-svc" not found Mar 16 16:17:59 crc kubenswrapper[5120]: E0316 16:17:59.804612 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4885bea5-bdc7-472b-8f70-e110dd9b8c06-galera-tls-certs podName:4885bea5-bdc7-472b-8f70-e110dd9b8c06 nodeName:}" failed. No retries permitted until 2026-03-16 16:18:00.304601865 +0000 UTC m=+2782.458533522 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "galera-tls-certs" (UniqueName: "kubernetes.io/secret/4885bea5-bdc7-472b-8f70-e110dd9b8c06-galera-tls-certs") pod "openstack-galera-0" (UID: "4885bea5-bdc7-472b-8f70-e110dd9b8c06") : secret "cert-galera-openstack-svc" not found Mar 16 16:17:59 crc kubenswrapper[5120]: E0316 16:17:59.804941 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 16:17:59 crc kubenswrapper[5120]: E0316 16:17:59.805008 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4885bea5-bdc7-472b-8f70-e110dd9b8c06-combined-ca-bundle podName:4885bea5-bdc7-472b-8f70-e110dd9b8c06 nodeName:}" failed. No retries permitted until 2026-03-16 16:18:00.304989516 +0000 UTC m=+2782.458921173 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/4885bea5-bdc7-472b-8f70-e110dd9b8c06-combined-ca-bundle") pod "openstack-galera-0" (UID: "4885bea5-bdc7-472b-8f70-e110dd9b8c06") : secret "combined-ca-bundle" not found Mar 16 16:17:59 crc kubenswrapper[5120]: I0316 16:17:59.820563 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-xlnnr"] Mar 16 16:17:59 crc kubenswrapper[5120]: E0316 16:17:59.832868 5120 kuberuntime_manager.go:1358] "Unhandled Error" err=< Mar 16 16:17:59 crc kubenswrapper[5120]: container &Container{Name:mariadb-account-create-update,Image:quay.io/podified-antelope-centos9/openstack-mariadb@sha256:4caef2b55e01b9a7ee88a22bc69db1893521a91d95c7ad4c8e593f14f17a5f95,Command:[/bin/sh -c #!/bin/bash Mar 16 16:17:59 crc kubenswrapper[5120]: Mar 16 16:17:59 crc kubenswrapper[5120]: MYSQL_REMOTE_HOST="" source /var/lib/operator-scripts/mysql_root_auth.sh Mar 16 16:17:59 crc kubenswrapper[5120]: Mar 16 16:17:59 crc kubenswrapper[5120]: export DatabasePassword=${DatabasePassword:?"Please specify a DatabasePassword variable."} Mar 16 16:17:59 crc kubenswrapper[5120]: Mar 16 16:17:59 crc kubenswrapper[5120]: MYSQL_CMD="mysql -h -u root -P 3306" Mar 16 16:17:59 crc kubenswrapper[5120]: Mar 16 16:17:59 crc kubenswrapper[5120]: if [ -n "placement" ]; then Mar 16 16:17:59 crc kubenswrapper[5120]: GRANT_DATABASE="placement" Mar 16 16:17:59 crc kubenswrapper[5120]: else Mar 16 16:17:59 crc kubenswrapper[5120]: GRANT_DATABASE="*" Mar 16 16:17:59 crc kubenswrapper[5120]: fi Mar 16 16:17:59 crc kubenswrapper[5120]: Mar 16 16:17:59 crc kubenswrapper[5120]: # going for maximum compatibility here: Mar 16 16:17:59 crc kubenswrapper[5120]: # 1. MySQL 8 no longer allows implicit create user when GRANT is used Mar 16 16:17:59 crc kubenswrapper[5120]: # 2. MariaDB has "CREATE OR REPLACE", but MySQL does not Mar 16 16:17:59 crc kubenswrapper[5120]: # 3. create user with CREATE but then do all password and TLS with ALTER to Mar 16 16:17:59 crc kubenswrapper[5120]: # support updates Mar 16 16:17:59 crc kubenswrapper[5120]: Mar 16 16:17:59 crc kubenswrapper[5120]: $MYSQL_CMD < logger="UnhandledError" Mar 16 16:17:59 crc kubenswrapper[5120]: E0316 16:17:59.834027 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"mariadb-account-create-update\" with CreateContainerConfigError: \"secret \\\"placement-db-secret\\\" not found\"" pod="openstack-kuttl-tests/placement-347f-account-create-update-kvc8k" podUID="6cf8b665-920c-4d82-92eb-508d6ca3e9a1" Mar 16 16:17:59 crc kubenswrapper[5120]: I0316 16:17:59.837513 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-6758-account-create-update-mb8v8"] Mar 16 16:17:59 crc kubenswrapper[5120]: I0316 16:17:59.841800 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-39eb-account-create-update-tnz8p" Mar 16 16:17:59 crc kubenswrapper[5120]: I0316 16:17:59.878731 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-xlnnr"] Mar 16 16:17:59 crc kubenswrapper[5120]: I0316 16:17:59.910498 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-j7b48"] Mar 16 16:17:59 crc kubenswrapper[5120]: I0316 16:17:59.921633 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-j7b48"] Mar 16 16:17:59 crc kubenswrapper[5120]: I0316 16:17:59.933687 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 16:17:59 crc kubenswrapper[5120]: I0316 16:17:59.938246 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="101749dc-c834-4d18-9d65-704af8b368a4" containerName="account-server" containerID="cri-o://724e698bc2647d226f34e5e375df069d0a2d87cec35127fb8ca1aa87a3e302dc" gracePeriod=30 Mar 16 16:17:59 crc kubenswrapper[5120]: I0316 16:17:59.938276 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="101749dc-c834-4d18-9d65-704af8b368a4" containerName="object-replicator" containerID="cri-o://e3aa4f856a04b1edd734f731b0ff764b58f2b038b82ca0b0d4359c2b9bf86469" gracePeriod=30 Mar 16 16:17:59 crc kubenswrapper[5120]: I0316 16:17:59.938385 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="101749dc-c834-4d18-9d65-704af8b368a4" containerName="object-server" containerID="cri-o://65875e7567b5b9a91bd06c5e05daccd574160efc902dcf5923e2b79b0c8d2244" gracePeriod=30 Mar 16 16:17:59 crc kubenswrapper[5120]: I0316 16:17:59.938433 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="101749dc-c834-4d18-9d65-704af8b368a4" containerName="container-updater" containerID="cri-o://1c5916dc01f8f4a3e1534605c444a2119e71a700b54a69e10c8bb9e635de25e8" gracePeriod=30 Mar 16 16:17:59 crc kubenswrapper[5120]: I0316 16:17:59.938481 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="101749dc-c834-4d18-9d65-704af8b368a4" containerName="container-auditor" containerID="cri-o://51cf967532606c9ced06ad6de8648b12654ee7582414482d898f98946c9fa5fc" gracePeriod=30 Mar 16 16:17:59 crc kubenswrapper[5120]: I0316 16:17:59.938512 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="101749dc-c834-4d18-9d65-704af8b368a4" containerName="container-replicator" containerID="cri-o://4cb9bb128aaf44f72b20395fcb3cc05e72d1adffacb345c94004414396b1d28a" gracePeriod=30 Mar 16 16:17:59 crc kubenswrapper[5120]: I0316 16:17:59.938547 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="101749dc-c834-4d18-9d65-704af8b368a4" containerName="container-server" containerID="cri-o://01823eea0af03bb3372ba342990110a4b6c8c7fa9118b0d7d29650e99d2cd108" gracePeriod=30 Mar 16 16:17:59 crc kubenswrapper[5120]: I0316 16:17:59.938588 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="101749dc-c834-4d18-9d65-704af8b368a4" containerName="account-reaper" containerID="cri-o://4a42fa4b365d37c495ee5ee82170ce1b235d8d672fd02b0158bdcc126237e473" gracePeriod=30 Mar 16 16:17:59 crc kubenswrapper[5120]: I0316 16:17:59.938631 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="101749dc-c834-4d18-9d65-704af8b368a4" containerName="account-auditor" containerID="cri-o://bef2d8e8e654dd9a105c210bd37ced0c71c3d573629cb12e5d3cbd97b64421d7" gracePeriod=30 Mar 16 16:17:59 crc kubenswrapper[5120]: I0316 16:17:59.938659 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="101749dc-c834-4d18-9d65-704af8b368a4" containerName="account-replicator" containerID="cri-o://4a42f47b6d82f13c7158ef114a3d72c3c33bdc7a2c6031a71bfddca2f3b3ca3a" gracePeriod=30 Mar 16 16:17:59 crc kubenswrapper[5120]: I0316 16:17:59.938803 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="101749dc-c834-4d18-9d65-704af8b368a4" containerName="object-expirer" containerID="cri-o://d3498f4c52aa0e90e0fc4d0abe76a9d9dfdd5f4ff506a2e63ee7f72189220719" gracePeriod=30 Mar 16 16:17:59 crc kubenswrapper[5120]: I0316 16:17:59.938841 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="101749dc-c834-4d18-9d65-704af8b368a4" containerName="swift-recon-cron" containerID="cri-o://ece1a88abc1997dbb13342308b7cefe3d5da6a00ca03108092562f3d6a4f1d16" gracePeriod=30 Mar 16 16:17:59 crc kubenswrapper[5120]: I0316 16:17:59.938873 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="101749dc-c834-4d18-9d65-704af8b368a4" containerName="rsync" containerID="cri-o://088d32f480158b50b622b79c86870fbb30bf7d4089dd0d34fcf8a46590f9352d" gracePeriod=30 Mar 16 16:17:59 crc kubenswrapper[5120]: I0316 16:17:59.938918 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="101749dc-c834-4d18-9d65-704af8b368a4" containerName="object-updater" containerID="cri-o://b4ac5deaffac392f3bb392fc03b0084b602ddec296f8870f1652da6f222d4e54" gracePeriod=30 Mar 16 16:17:59 crc kubenswrapper[5120]: I0316 16:17:59.938999 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="101749dc-c834-4d18-9d65-704af8b368a4" containerName="object-auditor" containerID="cri-o://10dfe1e92abc7a6f8ab5af868cf187ab014f8189c9aa859d23d8de692d693309" gracePeriod=30 Mar 16 16:17:59 crc kubenswrapper[5120]: I0316 16:17:59.940833 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:17:59 crc kubenswrapper[5120]: I0316 16:17:59.941327 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="1c354659-a22a-4fa3-8747-75b7241aea49" containerName="cinder-scheduler" containerID="cri-o://6b9790a44239640d9456c0bcdc9e4c40280465570805a0b2131ed727167a1767" gracePeriod=30 Mar 16 16:17:59 crc kubenswrapper[5120]: I0316 16:17:59.941514 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="1c354659-a22a-4fa3-8747-75b7241aea49" containerName="probe" containerID="cri-o://e7d4e3842ff2074c385862c7f0cb2ed29aa14bda35f907a94808d0d9edb150e9" gracePeriod=30 Mar 16 16:17:59 crc kubenswrapper[5120]: I0316 16:17:59.948461 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-db-create-h8hbg"] Mar 16 16:17:59 crc kubenswrapper[5120]: I0316 16:17:59.977440 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-db-create-h8hbg"] Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.067998 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-77f5d87454-bxpdp"] Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.068315 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-77f5d87454-bxpdp" podUID="3fe73309-f917-40c4-a606-511f1547daf4" containerName="placement-log" containerID="cri-o://a636602cf9c0f74b67bfffb9ee956a50e5d2bd7168bfc08b70cd6207ef08e4c0" gracePeriod=30 Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.071805 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-77f5d87454-bxpdp" podUID="3fe73309-f917-40c4-a606-511f1547daf4" containerName="placement-api" containerID="cri-o://3c1dc0476ec152189cd9cccaa8817bd8c79eb785cc5a85c7a89fc21e075d9c23" gracePeriod=30 Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.132860 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-d8b74df76-z7648"] Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.133152 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-d8b74df76-z7648" podUID="9698823e-0af0-4477-b47a-a388c6264dda" containerName="neutron-api" containerID="cri-o://51ef4c7e3e0dc3d7b67115fda2c5e6d516da517af01fe5c37d48fabfd8112d2b" gracePeriod=30 Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.133601 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-d8b74df76-z7648" podUID="9698823e-0af0-4477-b47a-a388c6264dda" containerName="neutron-httpd" containerID="cri-o://5346c7728f32b0dc09b52da8b4cb5097e3f94eb1c9956ddf64dfa7f4fe5c9f0b" gracePeriod=30 Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.171141 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.172911 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="60fe13eb-066c-4985-bb16-1a201e5c339c" containerName="cinder-api-log" containerID="cri-o://0fb5e3d8d5edd7398c14a6ea88b6ab188a65bacb06e33f6b4414f043c40c548e" gracePeriod=30 Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.173382 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="60fe13eb-066c-4985-bb16-1a201e5c339c" containerName="cinder-api" containerID="cri-o://c3d6d0476f8615371dfec590da87aa17915191fd8befb1ec3bcb8fe489ed8d5c" gracePeriod=30 Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.184342 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-e3fe-account-create-update-dgd59" Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.185145 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-9c08-account-create-update-w7m2p" Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.194351 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-4w76w"] Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.231591 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-4w76w" Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.234699 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-4w76w"] Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.257733 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-ghlgl"] Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.304379 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-ghlgl"] Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.332452 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1b59d8b3-3000-4e61-8e3c-50df40fc5181-config\") pod \"dnsmasq-dnsmasq-79dcd846c5-4w76w\" (UID: \"1b59d8b3-3000-4e61-8e3c-50df40fc5181\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-4w76w" Mar 16 16:18:00 crc kubenswrapper[5120]: E0316 16:18:00.332962 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 16:18:00 crc kubenswrapper[5120]: E0316 16:18:00.333043 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4885bea5-bdc7-472b-8f70-e110dd9b8c06-combined-ca-bundle podName:4885bea5-bdc7-472b-8f70-e110dd9b8c06 nodeName:}" failed. No retries permitted until 2026-03-16 16:18:01.333016667 +0000 UTC m=+2783.486948324 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/4885bea5-bdc7-472b-8f70-e110dd9b8c06-combined-ca-bundle") pod "openstack-galera-0" (UID: "4885bea5-bdc7-472b-8f70-e110dd9b8c06") : secret "combined-ca-bundle" not found Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.334314 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/1b59d8b3-3000-4e61-8e3c-50df40fc5181-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-79dcd846c5-4w76w\" (UID: \"1b59d8b3-3000-4e61-8e3c-50df40fc5181\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-4w76w" Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.334437 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9ghw\" (UniqueName: \"kubernetes.io/projected/1b59d8b3-3000-4e61-8e3c-50df40fc5181-kube-api-access-j9ghw\") pod \"dnsmasq-dnsmasq-79dcd846c5-4w76w\" (UID: \"1b59d8b3-3000-4e61-8e3c-50df40fc5181\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-4w76w" Mar 16 16:18:00 crc kubenswrapper[5120]: E0316 16:18:00.335960 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-config-data: configmap "rabbitmq-config-data" not found Mar 16 16:18:00 crc kubenswrapper[5120]: E0316 16:18:00.336386 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-galera-openstack-svc: secret "cert-galera-openstack-svc" not found Mar 16 16:18:00 crc kubenswrapper[5120]: E0316 16:18:00.337368 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/51d5f0da-bcbc-492e-ab39-6189dc22fa22-config-data podName:51d5f0da-bcbc-492e-ab39-6189dc22fa22 nodeName:}" failed. No retries permitted until 2026-03-16 16:18:01.337351823 +0000 UTC m=+2783.491283480 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/51d5f0da-bcbc-492e-ab39-6189dc22fa22-config-data") pod "rabbitmq-server-0" (UID: "51d5f0da-bcbc-492e-ab39-6189dc22fa22") : configmap "rabbitmq-config-data" not found Mar 16 16:18:00 crc kubenswrapper[5120]: E0316 16:18:00.337440 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4885bea5-bdc7-472b-8f70-e110dd9b8c06-galera-tls-certs podName:4885bea5-bdc7-472b-8f70-e110dd9b8c06 nodeName:}" failed. No retries permitted until 2026-03-16 16:18:01.337431265 +0000 UTC m=+2783.491362922 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "galera-tls-certs" (UniqueName: "kubernetes.io/secret/4885bea5-bdc7-472b-8f70-e110dd9b8c06-galera-tls-certs") pod "openstack-galera-0" (UID: "4885bea5-bdc7-472b-8f70-e110dd9b8c06") : secret "cert-galera-openstack-svc" not found Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.339351 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-5dw24"] Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.363979 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-5dw24"] Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.385632 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-bh8f4"] Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.401213 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.401524 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="ff974854-15db-4188-b6dc-e330110c2427" containerName="glance-log" containerID="cri-o://a2e438fc9999e069782ed119547c3c2d018c963e082bf48fcbbd7cc8e78719ff" gracePeriod=30 Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.402186 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="ff974854-15db-4188-b6dc-e330110c2427" containerName="glance-httpd" containerID="cri-o://1047a775a4d6d73834e956332daf4031b254e261c008046c75b64d3eca888ffd" gracePeriod=30 Mar 16 16:18:00 crc kubenswrapper[5120]: E0316 16:18:00.407949 5120 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9aa8c5d_78c1_43ce_9503_6e2ef87c6520.slice/crio-587faa8e2b87852c846f87b5c31a8141ca2d4e73275e493690ec19b81fe9fe47\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb82f3ed0_7b4a_4ac7_800a_40f5c2cb7242.slice/crio-80c9afe3261c93a6525f7ff404170b08abdba9d0e0d9e39fe4469ee485fc35fe.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod39b1a992_7cfc_4382_9263_18d430251511.slice/crio-f24bdb846594a48104f84ee1555c401e3cab825116931065b9f832d3b9ecbacd.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb82f3ed0_7b4a_4ac7_800a_40f5c2cb7242.slice/crio-conmon-80c9afe3261c93a6525f7ff404170b08abdba9d0e0d9e39fe4469ee485fc35fe.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb82f3ed0_7b4a_4ac7_800a_40f5c2cb7242.slice/crio-63b5afa737f6f7747352275491173c16cae3412926aa04a8ec50d294ba0d5c7e.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod101749dc_c834_4d18_9d65_704af8b368a4.slice/crio-conmon-4cb9bb128aaf44f72b20395fcb3cc05e72d1adffacb345c94004414396b1d28a.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod101749dc_c834_4d18_9d65_704af8b368a4.slice/crio-4a42f47b6d82f13c7158ef114a3d72c3c33bdc7a2c6031a71bfddca2f3b3ca3a.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod101749dc_c834_4d18_9d65_704af8b368a4.slice/crio-conmon-bef2d8e8e654dd9a105c210bd37ced0c71c3d573629cb12e5d3cbd97b64421d7.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod43c58ec7_474a_49bc_921f_89cf47b67811.slice/crio-conmon-c129c8987a210dccaf5b5f1284053994d439c82b3f7a189597964833bd162b00.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb82f3ed0_7b4a_4ac7_800a_40f5c2cb7242.slice/crio-conmon-63b5afa737f6f7747352275491173c16cae3412926aa04a8ec50d294ba0d5c7e.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod101749dc_c834_4d18_9d65_704af8b368a4.slice/crio-conmon-51cf967532606c9ced06ad6de8648b12654ee7582414482d898f98946c9fa5fc.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9aa8c5d_78c1_43ce_9503_6e2ef87c6520.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod101749dc_c834_4d18_9d65_704af8b368a4.slice/crio-4cb9bb128aaf44f72b20395fcb3cc05e72d1adffacb345c94004414396b1d28a.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod101749dc_c834_4d18_9d65_704af8b368a4.slice/crio-conmon-4a42f47b6d82f13c7158ef114a3d72c3c33bdc7a2c6031a71bfddca2f3b3ca3a.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod43c58ec7_474a_49bc_921f_89cf47b67811.slice/crio-c129c8987a210dccaf5b5f1284053994d439c82b3f7a189597964833bd162b00.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod101749dc_c834_4d18_9d65_704af8b368a4.slice/crio-bef2d8e8e654dd9a105c210bd37ced0c71c3d573629cb12e5d3cbd97b64421d7.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod39b1a992_7cfc_4382_9263_18d430251511.slice/crio-conmon-f24bdb846594a48104f84ee1555c401e3cab825116931065b9f832d3b9ecbacd.scope\": RecentStats: unable to find data in memory cache]" Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.436172 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-5dfe-account-create-update-wf5pw"] Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.440208 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1b59d8b3-3000-4e61-8e3c-50df40fc5181-config\") pod \"dnsmasq-dnsmasq-79dcd846c5-4w76w\" (UID: \"1b59d8b3-3000-4e61-8e3c-50df40fc5181\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-4w76w" Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.440346 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/1b59d8b3-3000-4e61-8e3c-50df40fc5181-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-79dcd846c5-4w76w\" (UID: \"1b59d8b3-3000-4e61-8e3c-50df40fc5181\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-4w76w" Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.440392 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j9ghw\" (UniqueName: \"kubernetes.io/projected/1b59d8b3-3000-4e61-8e3c-50df40fc5181-kube-api-access-j9ghw\") pod \"dnsmasq-dnsmasq-79dcd846c5-4w76w\" (UID: \"1b59d8b3-3000-4e61-8e3c-50df40fc5181\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-4w76w" Mar 16 16:18:00 crc kubenswrapper[5120]: E0316 16:18:00.440599 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 16:18:00 crc kubenswrapper[5120]: E0316 16:18:00.440656 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c06828a4-039e-4080-a682-0bf5a7aaf9c2-combined-ca-bundle podName:c06828a4-039e-4080-a682-0bf5a7aaf9c2 nodeName:}" failed. No retries permitted until 2026-03-16 16:18:02.440639682 +0000 UTC m=+2784.594571339 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/c06828a4-039e-4080-a682-0bf5a7aaf9c2-combined-ca-bundle") pod "swift-proxy-7c79cc45b-sp9b7" (UID: "c06828a4-039e-4080-a682-0bf5a7aaf9c2") : secret "combined-ca-bundle" not found Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.441860 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1b59d8b3-3000-4e61-8e3c-50df40fc5181-config\") pod \"dnsmasq-dnsmasq-79dcd846c5-4w76w\" (UID: \"1b59d8b3-3000-4e61-8e3c-50df40fc5181\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-4w76w" Mar 16 16:18:00 crc kubenswrapper[5120]: E0316 16:18:00.441985 5120 projected.go:264] Couldn't get secret openstack-kuttl-tests/swift-conf: secret "swift-conf" not found Mar 16 16:18:00 crc kubenswrapper[5120]: E0316 16:18:00.442000 5120 projected.go:289] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Mar 16 16:18:00 crc kubenswrapper[5120]: E0316 16:18:00.442010 5120 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-proxy-7c79cc45b-sp9b7: [secret "swift-conf" not found, configmap "swift-ring-files" not found] Mar 16 16:18:00 crc kubenswrapper[5120]: E0316 16:18:00.442054 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c06828a4-039e-4080-a682-0bf5a7aaf9c2-etc-swift podName:c06828a4-039e-4080-a682-0bf5a7aaf9c2 nodeName:}" failed. No retries permitted until 2026-03-16 16:18:02.442039449 +0000 UTC m=+2784.595971106 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/c06828a4-039e-4080-a682-0bf5a7aaf9c2-etc-swift") pod "swift-proxy-7c79cc45b-sp9b7" (UID: "c06828a4-039e-4080-a682-0bf5a7aaf9c2") : [secret "swift-conf" not found, configmap "swift-ring-files" not found] Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.442093 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/1b59d8b3-3000-4e61-8e3c-50df40fc5181-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-79dcd846c5-4w76w\" (UID: \"1b59d8b3-3000-4e61-8e3c-50df40fc5181\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-4w76w" Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.453272 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-5dfe-account-create-update-wf5pw"] Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.475496 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.480261 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-db-create-hjbrr"] Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.481392 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="044996b4-e444-4486-9503-61d776ec849f" containerName="glance-httpd" containerID="cri-o://8e88512fc32d8a4ecf18ca4d49876068a8159a6a0e0b4a45be98703daa80d90d" gracePeriod=30 Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.481520 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="044996b4-e444-4486-9503-61d776ec849f" containerName="glance-log" containerID="cri-o://a7009166ee17bc972006fca5fae2160d1fd948f482b659e9b784be0cafb5a261" gracePeriod=30 Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.492052 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-db-create-hjbrr"] Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.501444 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-347f-account-create-update-kvc8k"] Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.511390 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9ghw\" (UniqueName: \"kubernetes.io/projected/1b59d8b3-3000-4e61-8e3c-50df40fc5181-kube-api-access-j9ghw\") pod \"dnsmasq-dnsmasq-79dcd846c5-4w76w\" (UID: \"1b59d8b3-3000-4e61-8e3c-50df40fc5181\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-4w76w" Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.517643 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-347f-account-create-update-kvc8k"] Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.530232 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.582464 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-4w76w" Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.588081 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" podUID="551715bc-101a-4745-955b-027ac2be9c0b" containerName="rabbitmq" containerID="cri-o://1c358da4a94182ad980d04746126744b917f3eefac12cf1b996c541e1be24f80" gracePeriod=604800 Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.598625 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-bh8f4" event={"ID":"90982d87-fc0f-49d0-a400-4155e4f3b000","Type":"ContainerStarted","Data":"26e8b9f9697804206263041dfac96ee0ec7752f779185773bc942ee9e6460745"} Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.608943 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-cbf797d74-8frg4"] Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.609209 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-cbf797d74-8frg4" podUID="b2e8d0e9-fa13-49fc-b149-af0d8d1d5ef0" containerName="barbican-keystone-listener-log" containerID="cri-o://9f4ca810d0333490f7f8804535988941a3f37adb5983d0982fedf9261a9e97e6" gracePeriod=30 Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.609580 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-cbf797d74-8frg4" podUID="b2e8d0e9-fa13-49fc-b149-af0d8d1d5ef0" containerName="barbican-keystone-listener" containerID="cri-o://39998592854bf56ef9997d1b6241d034080c653045712cd7dd3cecb1c338b3b5" gracePeriod=30 Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.663120 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.663442 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="3f5ad605-f6ee-47e9-a2b6-43e60f01c4c9" containerName="nova-scheduler-scheduler" containerID="cri-o://a1f5e797b52c263768103f57dc958a68929e1eaed737a81298570c479cbfd478" gracePeriod=30 Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.676053 5120 generic.go:358] "Generic (PLEG): container finished" podID="101749dc-c834-4d18-9d65-704af8b368a4" containerID="088d32f480158b50b622b79c86870fbb30bf7d4089dd0d34fcf8a46590f9352d" exitCode=0 Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.676084 5120 generic.go:358] "Generic (PLEG): container finished" podID="101749dc-c834-4d18-9d65-704af8b368a4" containerID="d3498f4c52aa0e90e0fc4d0abe76a9d9dfdd5f4ff506a2e63ee7f72189220719" exitCode=0 Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.676095 5120 generic.go:358] "Generic (PLEG): container finished" podID="101749dc-c834-4d18-9d65-704af8b368a4" containerID="b4ac5deaffac392f3bb392fc03b0084b602ddec296f8870f1652da6f222d4e54" exitCode=0 Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.676105 5120 generic.go:358] "Generic (PLEG): container finished" podID="101749dc-c834-4d18-9d65-704af8b368a4" containerID="10dfe1e92abc7a6f8ab5af868cf187ab014f8189c9aa859d23d8de692d693309" exitCode=0 Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.676115 5120 generic.go:358] "Generic (PLEG): container finished" podID="101749dc-c834-4d18-9d65-704af8b368a4" containerID="e3aa4f856a04b1edd734f731b0ff764b58f2b038b82ca0b0d4359c2b9bf86469" exitCode=0 Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.676123 5120 generic.go:358] "Generic (PLEG): container finished" podID="101749dc-c834-4d18-9d65-704af8b368a4" containerID="1c5916dc01f8f4a3e1534605c444a2119e71a700b54a69e10c8bb9e635de25e8" exitCode=0 Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.676131 5120 generic.go:358] "Generic (PLEG): container finished" podID="101749dc-c834-4d18-9d65-704af8b368a4" containerID="51cf967532606c9ced06ad6de8648b12654ee7582414482d898f98946c9fa5fc" exitCode=0 Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.676138 5120 generic.go:358] "Generic (PLEG): container finished" podID="101749dc-c834-4d18-9d65-704af8b368a4" containerID="4cb9bb128aaf44f72b20395fcb3cc05e72d1adffacb345c94004414396b1d28a" exitCode=0 Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.676145 5120 generic.go:358] "Generic (PLEG): container finished" podID="101749dc-c834-4d18-9d65-704af8b368a4" containerID="01823eea0af03bb3372ba342990110a4b6c8c7fa9118b0d7d29650e99d2cd108" exitCode=0 Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.676153 5120 generic.go:358] "Generic (PLEG): container finished" podID="101749dc-c834-4d18-9d65-704af8b368a4" containerID="4a42fa4b365d37c495ee5ee82170ce1b235d8d672fd02b0158bdcc126237e473" exitCode=0 Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.676160 5120 generic.go:358] "Generic (PLEG): container finished" podID="101749dc-c834-4d18-9d65-704af8b368a4" containerID="bef2d8e8e654dd9a105c210bd37ced0c71c3d573629cb12e5d3cbd97b64421d7" exitCode=0 Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.676166 5120 generic.go:358] "Generic (PLEG): container finished" podID="101749dc-c834-4d18-9d65-704af8b368a4" containerID="4a42f47b6d82f13c7158ef114a3d72c3c33bdc7a2c6031a71bfddca2f3b3ca3a" exitCode=0 Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.676173 5120 generic.go:358] "Generic (PLEG): container finished" podID="101749dc-c834-4d18-9d65-704af8b368a4" containerID="724e698bc2647d226f34e5e375df069d0a2d87cec35127fb8ca1aa87a3e302dc" exitCode=0 Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.689293 5120 generic.go:358] "Generic (PLEG): container finished" podID="ff974854-15db-4188-b6dc-e330110c2427" containerID="a2e438fc9999e069782ed119547c3c2d018c963e082bf48fcbbd7cc8e78719ff" exitCode=143 Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.719406 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="08bb98cb-efd9-409e-b1bf-760159c5460c" path="/var/lib/kubelet/pods/08bb98cb-efd9-409e-b1bf-760159c5460c/volumes" Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.720334 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="177329dd-879c-4289-a817-04bd6b0d78bb" path="/var/lib/kubelet/pods/177329dd-879c-4289-a817-04bd6b0d78bb/volumes" Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.720949 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="229b83a2-da65-44f4-933d-0b43976c171d" path="/var/lib/kubelet/pods/229b83a2-da65-44f4-933d-0b43976c171d/volumes" Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.722577 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="23283298-2c56-4b32-b74b-4b84c81a14ba" path="/var/lib/kubelet/pods/23283298-2c56-4b32-b74b-4b84c81a14ba/volumes" Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.738577 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="30317636-b1f4-4ee1-950b-6d80a890ef09" path="/var/lib/kubelet/pods/30317636-b1f4-4ee1-950b-6d80a890ef09/volumes" Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.747574 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="43748bda-8aea-4bf9-a3db-178c7e9da885" path="/var/lib/kubelet/pods/43748bda-8aea-4bf9-a3db-178c7e9da885/volumes" Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.748218 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="44189db5-7f84-4e8f-9bca-59a28faf203f" path="/var/lib/kubelet/pods/44189db5-7f84-4e8f-9bca-59a28faf203f/volumes" Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.748925 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="50ebddc2-9233-4354-b102-0c05fb7512df" path="/var/lib/kubelet/pods/50ebddc2-9233-4354-b102-0c05fb7512df/volumes" Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.757946 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="acdd6b61-6a50-47b4-b7fd-8c308277843d" path="/var/lib/kubelet/pods/acdd6b61-6a50-47b4-b7fd-8c308277843d/volumes" Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.758508 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aed6211e-7fe1-4037-909a-18ac2e1e2783" path="/var/lib/kubelet/pods/aed6211e-7fe1-4037-909a-18ac2e1e2783/volumes" Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.759202 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b6faf05a-dc59-49cb-9b76-dd13901f77d3" path="/var/lib/kubelet/pods/b6faf05a-dc59-49cb-9b76-dd13901f77d3/volumes" Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.760901 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b82a4dce-40fb-4e1c-85a0-5e29b900ad33" path="/var/lib/kubelet/pods/b82a4dce-40fb-4e1c-85a0-5e29b900ad33/volumes" Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.761951 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b9228df3-a073-46d0-9eb2-345a0bef33a7" path="/var/lib/kubelet/pods/b9228df3-a073-46d0-9eb2-345a0bef33a7/volumes" Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.762460 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dd7a06d8-8dcb-4564-98a3-71818f740edf" path="/var/lib/kubelet/pods/dd7a06d8-8dcb-4564-98a3-71818f740edf/volumes" Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.764354 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e318f613-a626-41fc-a05d-d2b0595dafca" path="/var/lib/kubelet/pods/e318f613-a626-41fc-a05d-d2b0595dafca/volumes" Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.765508 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e3b5dae5-ebf8-404d-8514-a0bf55440fbb" path="/var/lib/kubelet/pods/e3b5dae5-ebf8-404d-8514-a0bf55440fbb/volumes" Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.766323 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"101749dc-c834-4d18-9d65-704af8b368a4","Type":"ContainerDied","Data":"088d32f480158b50b622b79c86870fbb30bf7d4089dd0d34fcf8a46590f9352d"} Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.766359 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-5bfb7678f9-6dzmx"] Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.766378 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.766390 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"101749dc-c834-4d18-9d65-704af8b368a4","Type":"ContainerDied","Data":"d3498f4c52aa0e90e0fc4d0abe76a9d9dfdd5f4ff506a2e63ee7f72189220719"} Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.766399 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"101749dc-c834-4d18-9d65-704af8b368a4","Type":"ContainerDied","Data":"b4ac5deaffac392f3bb392fc03b0084b602ddec296f8870f1652da6f222d4e54"} Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.766408 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-796f4f9644-59hlg"] Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.766418 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-db-create-p4ngm"] Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.766426 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"101749dc-c834-4d18-9d65-704af8b368a4","Type":"ContainerDied","Data":"10dfe1e92abc7a6f8ab5af868cf187ab014f8189c9aa859d23d8de692d693309"} Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.766434 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"101749dc-c834-4d18-9d65-704af8b368a4","Type":"ContainerDied","Data":"e3aa4f856a04b1edd734f731b0ff764b58f2b038b82ca0b0d4359c2b9bf86469"} Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.766445 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"101749dc-c834-4d18-9d65-704af8b368a4","Type":"ContainerDied","Data":"1c5916dc01f8f4a3e1534605c444a2119e71a700b54a69e10c8bb9e635de25e8"} Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.766455 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"101749dc-c834-4d18-9d65-704af8b368a4","Type":"ContainerDied","Data":"51cf967532606c9ced06ad6de8648b12654ee7582414482d898f98946c9fa5fc"} Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.766465 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"101749dc-c834-4d18-9d65-704af8b368a4","Type":"ContainerDied","Data":"4cb9bb128aaf44f72b20395fcb3cc05e72d1adffacb345c94004414396b1d28a"} Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.766475 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"101749dc-c834-4d18-9d65-704af8b368a4","Type":"ContainerDied","Data":"01823eea0af03bb3372ba342990110a4b6c8c7fa9118b0d7d29650e99d2cd108"} Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.766482 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"101749dc-c834-4d18-9d65-704af8b368a4","Type":"ContainerDied","Data":"4a42fa4b365d37c495ee5ee82170ce1b235d8d672fd02b0158bdcc126237e473"} Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.766490 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"101749dc-c834-4d18-9d65-704af8b368a4","Type":"ContainerDied","Data":"bef2d8e8e654dd9a105c210bd37ced0c71c3d573629cb12e5d3cbd97b64421d7"} Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.766499 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"101749dc-c834-4d18-9d65-704af8b368a4","Type":"ContainerDied","Data":"4a42f47b6d82f13c7158ef114a3d72c3c33bdc7a2c6031a71bfddca2f3b3ca3a"} Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.766507 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"101749dc-c834-4d18-9d65-704af8b368a4","Type":"ContainerDied","Data":"724e698bc2647d226f34e5e375df069d0a2d87cec35127fb8ca1aa87a3e302dc"} Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.766519 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"ff974854-15db-4188-b6dc-e330110c2427","Type":"ContainerDied","Data":"a2e438fc9999e069782ed119547c3c2d018c963e082bf48fcbbd7cc8e78719ff"} Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.766961 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-796f4f9644-59hlg" podUID="9f16b3a2-bc26-4a63-8f8c-836611f0d320" containerName="barbican-api-log" containerID="cri-o://3d3613157c725663b3645ab202fb54ad95ebbe067187047f60bb2b1749e436ce" gracePeriod=30 Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.767139 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-5bfb7678f9-6dzmx" podUID="7e059927-938d-4449-a260-90053be70ec9" containerName="barbican-worker-log" containerID="cri-o://d430d21560c12eca992abdde06e718c2e3d71e50d61e91ef2285be76ee5901bd" gracePeriod=30 Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.767231 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-5bfb7678f9-6dzmx" podUID="7e059927-938d-4449-a260-90053be70ec9" containerName="barbican-worker" containerID="cri-o://e38ea22442a3e5da16488296d5a4582eb3a1ae936d22b1e4246f21d7c1a26d34" gracePeriod=30 Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.767305 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-796f4f9644-59hlg" podUID="9f16b3a2-bc26-4a63-8f8c-836611f0d320" containerName="barbican-api" containerID="cri-o://cebcd6329c9e1b957b3f4bffa93b5a65003bd9fd06134f8e8d62306f23ec1220" gracePeriod=30 Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.769684 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-db-create-p4ngm"] Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.783013 5120 generic.go:358] "Generic (PLEG): container finished" podID="6064cc64-d619-4992-a1f6-b174b05d8ebf" containerID="ad0375bf4af105fa6a34f99135b8947f56c2ad8a62f3ea28296881a4467a492c" exitCode=137 Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.803420 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.803687 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="9292b258-885b-40a8-8b7d-9ed28a747bc7" containerName="nova-metadata-log" containerID="cri-o://67504ceae616481d35ca3f878a42ab809e32f965b94f09a9c14bb47581bf94e4" gracePeriod=30 Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.803877 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="9292b258-885b-40a8-8b7d-9ed28a747bc7" containerName="nova-metadata-metadata" containerID="cri-o://f19f6e35585d519c6c4887128e22a173629daff0e73ecce16798b83d694eb56d" gracePeriod=30 Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.819132 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-e3fe-account-create-update-dgd59"] Mar 16 16:18:00 crc kubenswrapper[5120]: E0316 16:18:00.839549 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 80c9afe3261c93a6525f7ff404170b08abdba9d0e0d9e39fe4469ee485fc35fe is running failed: container process not found" containerID="80c9afe3261c93a6525f7ff404170b08abdba9d0e0d9e39fe4469ee485fc35fe" cmd=["/usr/bin/pidof","ovsdb-server"] Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.840007 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.840132 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-db-create-cdlpn"] Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.840427 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="9e7f8135-737c-4639-bdd8-46d68e1a617d" containerName="nova-api-log" containerID="cri-o://12572d4dbfa6da89a684a45d45fbbef79f79d94a4c9264be847c926efe2a306c" gracePeriod=30 Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.840953 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="9e7f8135-737c-4639-bdd8-46d68e1a617d" containerName="nova-api-api" containerID="cri-o://4423760983d234cf89f326a9ce253676e3e6b0c280a356f96097c3c830d8ad07" gracePeriod=30 Mar 16 16:18:00 crc kubenswrapper[5120]: E0316 16:18:00.849294 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 80c9afe3261c93a6525f7ff404170b08abdba9d0e0d9e39fe4469ee485fc35fe is running failed: container process not found" containerID="80c9afe3261c93a6525f7ff404170b08abdba9d0e0d9e39fe4469ee485fc35fe" cmd=["/usr/bin/pidof","ovsdb-server"] Mar 16 16:18:00 crc kubenswrapper[5120]: E0316 16:18:00.850029 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 80c9afe3261c93a6525f7ff404170b08abdba9d0e0d9e39fe4469ee485fc35fe is running failed: container process not found" containerID="80c9afe3261c93a6525f7ff404170b08abdba9d0e0d9e39fe4469ee485fc35fe" cmd=["/usr/bin/pidof","ovsdb-server"] Mar 16 16:18:00 crc kubenswrapper[5120]: E0316 16:18:00.850061 5120 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 80c9afe3261c93a6525f7ff404170b08abdba9d0e0d9e39fe4469ee485fc35fe is running failed: container process not found" probeType="Readiness" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podUID="b82f3ed0-7b4a-4ac7-800a-40f5c2cb7242" containerName="ovsdbserver-nb" probeResult="unknown" Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.853739 5120 generic.go:358] "Generic (PLEG): container finished" podID="3fe73309-f917-40c4-a606-511f1547daf4" containerID="a636602cf9c0f74b67bfffb9ee956a50e5d2bd7168bfc08b70cd6207ef08e4c0" exitCode=143 Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.853830 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-77f5d87454-bxpdp" event={"ID":"3fe73309-f917-40c4-a606-511f1547daf4","Type":"ContainerDied","Data":"a636602cf9c0f74b67bfffb9ee956a50e5d2bd7168bfc08b70cd6207ef08e4c0"} Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.868316 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-9c08-account-create-update-w7m2p"] Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.888100 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_39b1a992-7cfc-4382-9263-18d430251511/ovsdbserver-sb/0.log" Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.888176 5120 generic.go:358] "Generic (PLEG): container finished" podID="39b1a992-7cfc-4382-9263-18d430251511" containerID="b864e5a30bdd1ec09c5e8b740495f3b877525c6eb80190831e21454bd493272f" exitCode=143 Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.888328 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"39b1a992-7cfc-4382-9263-18d430251511","Type":"ContainerDied","Data":"b864e5a30bdd1ec09c5e8b740495f3b877525c6eb80190831e21454bd493272f"} Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.893433 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-347f-account-create-update-kvc8k" event={"ID":"6cf8b665-920c-4d82-92eb-508d6ca3e9a1","Type":"ContainerStarted","Data":"8a3b6d8507370d8e2f4199111b5d4a03d12a303a718a8221b024aed580f9eb02"} Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.910112 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-db-create-cdlpn"] Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.926389 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-hk5sb"] Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.927235 5120 generic.go:358] "Generic (PLEG): container finished" podID="60fe13eb-066c-4985-bb16-1a201e5c339c" containerID="0fb5e3d8d5edd7398c14a6ea88b6ab188a65bacb06e33f6b4414f043c40c548e" exitCode=143 Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.927320 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"60fe13eb-066c-4985-bb16-1a201e5c339c","Type":"ContainerDied","Data":"0fb5e3d8d5edd7398c14a6ea88b6ab188a65bacb06e33f6b4414f043c40c548e"} Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.931179 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_b82f3ed0-7b4a-4ac7-800a-40f5c2cb7242/ovsdbserver-nb/0.log" Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.931211 5120 generic.go:358] "Generic (PLEG): container finished" podID="b82f3ed0-7b4a-4ac7-800a-40f5c2cb7242" containerID="63b5afa737f6f7747352275491173c16cae3412926aa04a8ec50d294ba0d5c7e" exitCode=2 Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.931222 5120 generic.go:358] "Generic (PLEG): container finished" podID="b82f3ed0-7b4a-4ac7-800a-40f5c2cb7242" containerID="80c9afe3261c93a6525f7ff404170b08abdba9d0e0d9e39fe4469ee485fc35fe" exitCode=143 Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.931290 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"b82f3ed0-7b4a-4ac7-800a-40f5c2cb7242","Type":"ContainerDied","Data":"63b5afa737f6f7747352275491173c16cae3412926aa04a8ec50d294ba0d5c7e"} Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.931308 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"b82f3ed0-7b4a-4ac7-800a-40f5c2cb7242","Type":"ContainerDied","Data":"80c9afe3261c93a6525f7ff404170b08abdba9d0e0d9e39fe4469ee485fc35fe"} Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.945338 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-hk5sb"] Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.962537 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-cmr6k"] Mar 16 16:18:00 crc kubenswrapper[5120]: I0316 16:18:00.971601 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-cmr6k"] Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.009141 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-db-create-khl7k"] Mar 16 16:18:01 crc kubenswrapper[5120]: E0316 16:18:01.015153 5120 kuberuntime_manager.go:1358] "Unhandled Error" err=< Mar 16 16:18:01 crc kubenswrapper[5120]: container &Container{Name:mariadb-account-create-update,Image:quay.io/podified-antelope-centos9/openstack-mariadb@sha256:4caef2b55e01b9a7ee88a22bc69db1893521a91d95c7ad4c8e593f14f17a5f95,Command:[/bin/sh -c #!/bin/bash Mar 16 16:18:01 crc kubenswrapper[5120]: Mar 16 16:18:01 crc kubenswrapper[5120]: MYSQL_REMOTE_HOST="" source /var/lib/operator-scripts/mysql_root_auth.sh Mar 16 16:18:01 crc kubenswrapper[5120]: Mar 16 16:18:01 crc kubenswrapper[5120]: export DatabasePassword=${DatabasePassword:?"Please specify a DatabasePassword variable."} Mar 16 16:18:01 crc kubenswrapper[5120]: Mar 16 16:18:01 crc kubenswrapper[5120]: MYSQL_CMD="mysql -h -u root -P 3306" Mar 16 16:18:01 crc kubenswrapper[5120]: Mar 16 16:18:01 crc kubenswrapper[5120]: if [ -n "placement" ]; then Mar 16 16:18:01 crc kubenswrapper[5120]: GRANT_DATABASE="placement" Mar 16 16:18:01 crc kubenswrapper[5120]: else Mar 16 16:18:01 crc kubenswrapper[5120]: GRANT_DATABASE="*" Mar 16 16:18:01 crc kubenswrapper[5120]: fi Mar 16 16:18:01 crc kubenswrapper[5120]: Mar 16 16:18:01 crc kubenswrapper[5120]: # going for maximum compatibility here: Mar 16 16:18:01 crc kubenswrapper[5120]: # 1. MySQL 8 no longer allows implicit create user when GRANT is used Mar 16 16:18:01 crc kubenswrapper[5120]: # 2. MariaDB has "CREATE OR REPLACE", but MySQL does not Mar 16 16:18:01 crc kubenswrapper[5120]: # 3. create user with CREATE but then do all password and TLS with ALTER to Mar 16 16:18:01 crc kubenswrapper[5120]: # support updates Mar 16 16:18:01 crc kubenswrapper[5120]: Mar 16 16:18:01 crc kubenswrapper[5120]: $MYSQL_CMD < logger="UnhandledError" Mar 16 16:18:01 crc kubenswrapper[5120]: E0316 16:18:01.016341 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"mariadb-account-create-update\" with CreateContainerConfigError: \"secret \\\"placement-db-secret\\\" not found\"" pod="openstack-kuttl-tests/placement-347f-account-create-update-kvc8k" podUID="6cf8b665-920c-4d82-92eb-508d6ca3e9a1" Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.026766 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-db-create-khl7k"] Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.038583 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-z6f5v"] Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.046190 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.046394 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="e73bdb2c-01bf-4eca-93df-22b051fee769" containerName="nova-cell1-conductor-conductor" containerID="cri-o://e97ac48130213536a9b9b0d15722b762acfe6f81aabde1c8b9c64553d53ec8c7" gracePeriod=30 Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.053182 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-z6f5v"] Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.061907 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-39eb-account-create-update-tnz8p"] Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.069053 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.069304 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="711e7cd2-a028-4c76-969e-e08558a5d732" containerName="nova-cell0-conductor-conductor" containerID="cri-o://6c6a76b2480d11bbcbe9da4f0bbb77ee9e7dcffe33abc117e4fd2108ee958a64" gracePeriod=30 Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.074855 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.075110 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podUID="fb13a989-3fee-4cd9-97d4-e68371891b6b" containerName="nova-cell1-novncproxy-novncproxy" containerID="cri-o://02d26c01c0add7af45d27551c127315970f580e97920c2b887ce397fd67a99cf" gracePeriod=30 Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.099990 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-kcmsv"] Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.106278 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/openstack-cell1-galera-0" podUID="848fca26-246f-48f5-8f00-a41ecb239952" containerName="galera" containerID="cri-o://c758fe75eb30010d3898ba0e46464704f4eaccdb5721a29379189ee1664975df" gracePeriod=30 Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.135921 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-lcrbw"] Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.144814 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-kcmsv"] Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.151920 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-lcrbw"] Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.159904 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-infra/auto-csr-approver-29561298-6qsf7"] Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.173253 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561298-6qsf7"] Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.173386 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561298-6qsf7" Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.176624 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"openshift-service-ca.crt\"" Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.177084 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"kube-root-ca.crt\"" Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.177498 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-infra\"/\"csr-approver-sa-dockercfg-x2nsz\"" Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.179157 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.179397 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/kube-state-metrics-0" podUID="d73ebf72-269e-4ebf-86b6-2d517ce8881a" containerName="kube-state-metrics" containerID="cri-o://55aacccfe83493c2807259e063c3f528093cf68eb2ea222aec83b143462b6a75" gracePeriod=30 Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.205237 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_39b1a992-7cfc-4382-9263-18d430251511/ovsdbserver-sb/0.log" Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.205352 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.208974 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.209205 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="76c6cd23-f4cd-4b95-95b1-252ec9c5cafa" containerName="ceilometer-central-agent" containerID="cri-o://af5fb6c449290fd20f488014a20a2e812dbe3b44b9e9e143413c9ee4a9424499" gracePeriod=30 Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.209305 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="76c6cd23-f4cd-4b95-95b1-252ec9c5cafa" containerName="proxy-httpd" containerID="cri-o://40002f2be6fa424b030589769c3c029dfacfcdae45b3980ed054abb3abc3c1d9" gracePeriod=30 Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.209341 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="76c6cd23-f4cd-4b95-95b1-252ec9c5cafa" containerName="sg-core" containerID="cri-o://cf198603b58bf7b45d7c9f7f1ce555f5fcb8f5b47b0707c2960e22415f81c96e" gracePeriod=30 Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.209370 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="76c6cd23-f4cd-4b95-95b1-252ec9c5cafa" containerName="ceilometer-notification-agent" containerID="cri-o://35e4423fcf67ea82bfe0fc8b41693767ef5d5424b86c9ca38dce930212eed434" gracePeriod=30 Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.215562 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-proxy-7c79cc45b-sp9b7"] Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.215777 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-proxy-7c79cc45b-sp9b7" podUID="c06828a4-039e-4080-a682-0bf5a7aaf9c2" containerName="proxy-httpd" containerID="cri-o://d7fad27bd78b15e804b67e664c292c55fa7faee0c6fb07e878bcb9e536052264" gracePeriod=30 Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.215882 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-proxy-7c79cc45b-sp9b7" podUID="c06828a4-039e-4080-a682-0bf5a7aaf9c2" containerName="proxy-server" containerID="cri-o://b95fea81e244713a6300e6ead4faf992fc23c53c8f23c0486269773f1cf284c5" gracePeriod=30 Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.218240 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hn9x\" (UniqueName: \"kubernetes.io/projected/e4cb4b19-5e1d-4cb5-8cc1-e51c0b445e06-kube-api-access-7hn9x\") pod \"auto-csr-approver-29561298-6qsf7\" (UID: \"e4cb4b19-5e1d-4cb5-8cc1-e51c0b445e06\") " pod="openshift-infra/auto-csr-approver-29561298-6qsf7" Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.236037 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-39eb-account-create-update-tnz8p"] Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.273292 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_b82f3ed0-7b4a-4ac7-800a-40f5c2cb7242/ovsdbserver-nb/0.log" Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.273360 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.323596 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9pslm\" (UniqueName: \"kubernetes.io/projected/b82f3ed0-7b4a-4ac7-800a-40f5c2cb7242-kube-api-access-9pslm\") pod \"b82f3ed0-7b4a-4ac7-800a-40f5c2cb7242\" (UID: \"b82f3ed0-7b4a-4ac7-800a-40f5c2cb7242\") " Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.323713 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/39b1a992-7cfc-4382-9263-18d430251511-metrics-certs-tls-certs\") pod \"39b1a992-7cfc-4382-9263-18d430251511\" (UID: \"39b1a992-7cfc-4382-9263-18d430251511\") " Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.323749 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f7qtg\" (UniqueName: \"kubernetes.io/projected/39b1a992-7cfc-4382-9263-18d430251511-kube-api-access-f7qtg\") pod \"39b1a992-7cfc-4382-9263-18d430251511\" (UID: \"39b1a992-7cfc-4382-9263-18d430251511\") " Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.323810 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/39b1a992-7cfc-4382-9263-18d430251511-ovsdbserver-sb-tls-certs\") pod \"39b1a992-7cfc-4382-9263-18d430251511\" (UID: \"39b1a992-7cfc-4382-9263-18d430251511\") " Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.323861 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b82f3ed0-7b4a-4ac7-800a-40f5c2cb7242-config\") pod \"b82f3ed0-7b4a-4ac7-800a-40f5c2cb7242\" (UID: \"b82f3ed0-7b4a-4ac7-800a-40f5c2cb7242\") " Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.323933 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/b82f3ed0-7b4a-4ac7-800a-40f5c2cb7242-ovsdbserver-nb-tls-certs\") pod \"b82f3ed0-7b4a-4ac7-800a-40f5c2cb7242\" (UID: \"b82f3ed0-7b4a-4ac7-800a-40f5c2cb7242\") " Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.323965 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/39b1a992-7cfc-4382-9263-18d430251511-ovsdb-rundir\") pod \"39b1a992-7cfc-4382-9263-18d430251511\" (UID: \"39b1a992-7cfc-4382-9263-18d430251511\") " Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.324041 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/39b1a992-7cfc-4382-9263-18d430251511-config\") pod \"39b1a992-7cfc-4382-9263-18d430251511\" (UID: \"39b1a992-7cfc-4382-9263-18d430251511\") " Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.324068 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/b82f3ed0-7b4a-4ac7-800a-40f5c2cb7242-ovsdb-rundir\") pod \"b82f3ed0-7b4a-4ac7-800a-40f5c2cb7242\" (UID: \"b82f3ed0-7b4a-4ac7-800a-40f5c2cb7242\") " Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.324215 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/39b1a992-7cfc-4382-9263-18d430251511-combined-ca-bundle\") pod \"39b1a992-7cfc-4382-9263-18d430251511\" (UID: \"39b1a992-7cfc-4382-9263-18d430251511\") " Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.324431 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/b82f3ed0-7b4a-4ac7-800a-40f5c2cb7242-scripts\") pod \"b82f3ed0-7b4a-4ac7-800a-40f5c2cb7242\" (UID: \"b82f3ed0-7b4a-4ac7-800a-40f5c2cb7242\") " Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.324470 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/b82f3ed0-7b4a-4ac7-800a-40f5c2cb7242-metrics-certs-tls-certs\") pod \"b82f3ed0-7b4a-4ac7-800a-40f5c2cb7242\" (UID: \"b82f3ed0-7b4a-4ac7-800a-40f5c2cb7242\") " Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.324501 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/39b1a992-7cfc-4382-9263-18d430251511-scripts\") pod \"39b1a992-7cfc-4382-9263-18d430251511\" (UID: \"39b1a992-7cfc-4382-9263-18d430251511\") " Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.324580 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovndbcluster-sb-etc-ovn\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") pod \"39b1a992-7cfc-4382-9263-18d430251511\" (UID: \"39b1a992-7cfc-4382-9263-18d430251511\") " Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.324627 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovndbcluster-nb-etc-ovn\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"b82f3ed0-7b4a-4ac7-800a-40f5c2cb7242\" (UID: \"b82f3ed0-7b4a-4ac7-800a-40f5c2cb7242\") " Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.324704 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b82f3ed0-7b4a-4ac7-800a-40f5c2cb7242-combined-ca-bundle\") pod \"b82f3ed0-7b4a-4ac7-800a-40f5c2cb7242\" (UID: \"b82f3ed0-7b4a-4ac7-800a-40f5c2cb7242\") " Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.325053 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7hn9x\" (UniqueName: \"kubernetes.io/projected/e4cb4b19-5e1d-4cb5-8cc1-e51c0b445e06-kube-api-access-7hn9x\") pod \"auto-csr-approver-29561298-6qsf7\" (UID: \"e4cb4b19-5e1d-4cb5-8cc1-e51c0b445e06\") " pod="openshift-infra/auto-csr-approver-29561298-6qsf7" Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.325791 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b82f3ed0-7b4a-4ac7-800a-40f5c2cb7242-ovsdb-rundir" (OuterVolumeSpecName: "ovsdb-rundir") pod "b82f3ed0-7b4a-4ac7-800a-40f5c2cb7242" (UID: "b82f3ed0-7b4a-4ac7-800a-40f5c2cb7242"). InnerVolumeSpecName "ovsdb-rundir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.326314 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b82f3ed0-7b4a-4ac7-800a-40f5c2cb7242-config" (OuterVolumeSpecName: "config") pod "b82f3ed0-7b4a-4ac7-800a-40f5c2cb7242" (UID: "b82f3ed0-7b4a-4ac7-800a-40f5c2cb7242"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.326376 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39b1a992-7cfc-4382-9263-18d430251511-scripts" (OuterVolumeSpecName: "scripts") pod "39b1a992-7cfc-4382-9263-18d430251511" (UID: "39b1a992-7cfc-4382-9263-18d430251511"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.327913 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b82f3ed0-7b4a-4ac7-800a-40f5c2cb7242-scripts" (OuterVolumeSpecName: "scripts") pod "b82f3ed0-7b4a-4ac7-800a-40f5c2cb7242" (UID: "b82f3ed0-7b4a-4ac7-800a-40f5c2cb7242"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.328478 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39b1a992-7cfc-4382-9263-18d430251511-config" (OuterVolumeSpecName: "config") pod "39b1a992-7cfc-4382-9263-18d430251511" (UID: "39b1a992-7cfc-4382-9263-18d430251511"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.338021 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39b1a992-7cfc-4382-9263-18d430251511-ovsdb-rundir" (OuterVolumeSpecName: "ovsdb-rundir") pod "39b1a992-7cfc-4382-9263-18d430251511" (UID: "39b1a992-7cfc-4382-9263-18d430251511"). InnerVolumeSpecName "ovsdb-rundir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.344213 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage19-crc" (OuterVolumeSpecName: "ovndbcluster-sb-etc-ovn") pod "39b1a992-7cfc-4382-9263-18d430251511" (UID: "39b1a992-7cfc-4382-9263-18d430251511"). InnerVolumeSpecName "local-storage19-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.344348 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39b1a992-7cfc-4382-9263-18d430251511-kube-api-access-f7qtg" (OuterVolumeSpecName: "kube-api-access-f7qtg") pod "39b1a992-7cfc-4382-9263-18d430251511" (UID: "39b1a992-7cfc-4382-9263-18d430251511"). InnerVolumeSpecName "kube-api-access-f7qtg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.343295 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage03-crc" (OuterVolumeSpecName: "ovndbcluster-nb-etc-ovn") pod "b82f3ed0-7b4a-4ac7-800a-40f5c2cb7242" (UID: "b82f3ed0-7b4a-4ac7-800a-40f5c2cb7242"). InnerVolumeSpecName "local-storage03-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.344488 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b82f3ed0-7b4a-4ac7-800a-40f5c2cb7242-kube-api-access-9pslm" (OuterVolumeSpecName: "kube-api-access-9pslm") pod "b82f3ed0-7b4a-4ac7-800a-40f5c2cb7242" (UID: "b82f3ed0-7b4a-4ac7-800a-40f5c2cb7242"). InnerVolumeSpecName "kube-api-access-9pslm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.349161 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hn9x\" (UniqueName: \"kubernetes.io/projected/e4cb4b19-5e1d-4cb5-8cc1-e51c0b445e06-kube-api-access-7hn9x\") pod \"auto-csr-approver-29561298-6qsf7\" (UID: \"e4cb4b19-5e1d-4cb5-8cc1-e51c0b445e06\") " pod="openshift-infra/auto-csr-approver-29561298-6qsf7" Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.390788 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/39b1a992-7cfc-4382-9263-18d430251511-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "39b1a992-7cfc-4382-9263-18d430251511" (UID: "39b1a992-7cfc-4382-9263-18d430251511"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.418014 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b82f3ed0-7b4a-4ac7-800a-40f5c2cb7242-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "b82f3ed0-7b4a-4ac7-800a-40f5c2cb7242" (UID: "b82f3ed0-7b4a-4ac7-800a-40f5c2cb7242"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.428438 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b82f3ed0-7b4a-4ac7-800a-40f5c2cb7242-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.433218 5120 reconciler_common.go:299] "Volume detached for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/39b1a992-7cfc-4382-9263-18d430251511-ovsdb-rundir\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.433321 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/39b1a992-7cfc-4382-9263-18d430251511-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.433373 5120 reconciler_common.go:299] "Volume detached for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/b82f3ed0-7b4a-4ac7-800a-40f5c2cb7242-ovsdb-rundir\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.433428 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/39b1a992-7cfc-4382-9263-18d430251511-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.433479 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/b82f3ed0-7b4a-4ac7-800a-40f5c2cb7242-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.433535 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/39b1a992-7cfc-4382-9263-18d430251511-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.433596 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage19-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") on node \"crc\" " Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.433649 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") on node \"crc\" " Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.433704 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b82f3ed0-7b4a-4ac7-800a-40f5c2cb7242-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.433754 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9pslm\" (UniqueName: \"kubernetes.io/projected/b82f3ed0-7b4a-4ac7-800a-40f5c2cb7242-kube-api-access-9pslm\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.433840 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f7qtg\" (UniqueName: \"kubernetes.io/projected/39b1a992-7cfc-4382-9263-18d430251511-kube-api-access-f7qtg\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:01 crc kubenswrapper[5120]: E0316 16:18:01.433108 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 16:18:01 crc kubenswrapper[5120]: E0316 16:18:01.434214 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4885bea5-bdc7-472b-8f70-e110dd9b8c06-combined-ca-bundle podName:4885bea5-bdc7-472b-8f70-e110dd9b8c06 nodeName:}" failed. No retries permitted until 2026-03-16 16:18:03.434183728 +0000 UTC m=+2785.588115385 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/4885bea5-bdc7-472b-8f70-e110dd9b8c06-combined-ca-bundle") pod "openstack-galera-0" (UID: "4885bea5-bdc7-472b-8f70-e110dd9b8c06") : secret "combined-ca-bundle" not found Mar 16 16:18:01 crc kubenswrapper[5120]: E0316 16:18:01.433141 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-config-data: configmap "rabbitmq-config-data" not found Mar 16 16:18:01 crc kubenswrapper[5120]: E0316 16:18:01.434617 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/51d5f0da-bcbc-492e-ab39-6189dc22fa22-config-data podName:51d5f0da-bcbc-492e-ab39-6189dc22fa22 nodeName:}" failed. No retries permitted until 2026-03-16 16:18:03.434582959 +0000 UTC m=+2785.588514696 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/51d5f0da-bcbc-492e-ab39-6189dc22fa22-config-data") pod "rabbitmq-server-0" (UID: "51d5f0da-bcbc-492e-ab39-6189dc22fa22") : configmap "rabbitmq-config-data" not found Mar 16 16:18:01 crc kubenswrapper[5120]: E0316 16:18:01.433177 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-galera-openstack-svc: secret "cert-galera-openstack-svc" not found Mar 16 16:18:01 crc kubenswrapper[5120]: E0316 16:18:01.434668 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4885bea5-bdc7-472b-8f70-e110dd9b8c06-galera-tls-certs podName:4885bea5-bdc7-472b-8f70-e110dd9b8c06 nodeName:}" failed. No retries permitted until 2026-03-16 16:18:03.434662242 +0000 UTC m=+2785.588593899 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "galera-tls-certs" (UniqueName: "kubernetes.io/secret/4885bea5-bdc7-472b-8f70-e110dd9b8c06-galera-tls-certs") pod "openstack-galera-0" (UID: "4885bea5-bdc7-472b-8f70-e110dd9b8c06") : secret "cert-galera-openstack-svc" not found Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.443231 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/39b1a992-7cfc-4382-9263-18d430251511-ovsdbserver-sb-tls-certs" (OuterVolumeSpecName: "ovsdbserver-sb-tls-certs") pod "39b1a992-7cfc-4382-9263-18d430251511" (UID: "39b1a992-7cfc-4382-9263-18d430251511"). InnerVolumeSpecName "ovsdbserver-sb-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:18:01 crc kubenswrapper[5120]: W0316 16:18:01.473245 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0d72ed4f_2b58_4e71_ada5_a06739dac8b2.slice/crio-68258a1f77c1ed7b37e32470c33913b9b4625c7c547b769b102cad784a0d8a73 WatchSource:0}: Error finding container 68258a1f77c1ed7b37e32470c33913b9b4625c7c547b769b102cad784a0d8a73: Status 404 returned error can't find the container with id 68258a1f77c1ed7b37e32470c33913b9b4625c7c547b769b102cad784a0d8a73 Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.474906 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage19-crc" (UniqueName: "kubernetes.io/local-volume/local-storage19-crc") on node "crc" Mar 16 16:18:01 crc kubenswrapper[5120]: E0316 16:18:01.479791 5120 kuberuntime_manager.go:1358] "Unhandled Error" err=< Mar 16 16:18:01 crc kubenswrapper[5120]: container &Container{Name:mariadb-account-create-update,Image:quay.io/podified-antelope-centos9/openstack-mariadb@sha256:4caef2b55e01b9a7ee88a22bc69db1893521a91d95c7ad4c8e593f14f17a5f95,Command:[/bin/sh -c #!/bin/bash Mar 16 16:18:01 crc kubenswrapper[5120]: Mar 16 16:18:01 crc kubenswrapper[5120]: MYSQL_REMOTE_HOST="" source /var/lib/operator-scripts/mysql_root_auth.sh Mar 16 16:18:01 crc kubenswrapper[5120]: Mar 16 16:18:01 crc kubenswrapper[5120]: export DatabasePassword=${DatabasePassword:?"Please specify a DatabasePassword variable."} Mar 16 16:18:01 crc kubenswrapper[5120]: Mar 16 16:18:01 crc kubenswrapper[5120]: MYSQL_CMD="mysql -h -u root -P 3306" Mar 16 16:18:01 crc kubenswrapper[5120]: Mar 16 16:18:01 crc kubenswrapper[5120]: if [ -n "barbican" ]; then Mar 16 16:18:01 crc kubenswrapper[5120]: GRANT_DATABASE="barbican" Mar 16 16:18:01 crc kubenswrapper[5120]: else Mar 16 16:18:01 crc kubenswrapper[5120]: GRANT_DATABASE="*" Mar 16 16:18:01 crc kubenswrapper[5120]: fi Mar 16 16:18:01 crc kubenswrapper[5120]: Mar 16 16:18:01 crc kubenswrapper[5120]: # going for maximum compatibility here: Mar 16 16:18:01 crc kubenswrapper[5120]: # 1. MySQL 8 no longer allows implicit create user when GRANT is used Mar 16 16:18:01 crc kubenswrapper[5120]: # 2. MariaDB has "CREATE OR REPLACE", but MySQL does not Mar 16 16:18:01 crc kubenswrapper[5120]: # 3. create user with CREATE but then do all password and TLS with ALTER to Mar 16 16:18:01 crc kubenswrapper[5120]: # support updates Mar 16 16:18:01 crc kubenswrapper[5120]: Mar 16 16:18:01 crc kubenswrapper[5120]: $MYSQL_CMD < logger="UnhandledError" Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.480006 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage03-crc" (UniqueName: "kubernetes.io/local-volume/local-storage03-crc") on node "crc" Mar 16 16:18:01 crc kubenswrapper[5120]: E0316 16:18:01.480870 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"mariadb-account-create-update\" with CreateContainerConfigError: \"secret \\\"barbican-db-secret\\\" not found\"" pod="openstack-kuttl-tests/barbican-39eb-account-create-update-tnz8p" podUID="0d72ed4f-2b58-4e71-ada5-a06739dac8b2" Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.491397 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.492564 5120 status_manager.go:895] "Failed to get status for pod" podUID="6064cc64-d619-4992-a1f6-b174b05d8ebf" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.498672 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/39b1a992-7cfc-4382-9263-18d430251511-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "39b1a992-7cfc-4382-9263-18d430251511" (UID: "39b1a992-7cfc-4382-9263-18d430251511"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.512865 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b82f3ed0-7b4a-4ac7-800a-40f5c2cb7242-ovsdbserver-nb-tls-certs" (OuterVolumeSpecName: "ovsdbserver-nb-tls-certs") pod "b82f3ed0-7b4a-4ac7-800a-40f5c2cb7242" (UID: "b82f3ed0-7b4a-4ac7-800a-40f5c2cb7242"). InnerVolumeSpecName "ovsdbserver-nb-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.528975 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561298-6qsf7" Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.538259 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/6064cc64-d619-4992-a1f6-b174b05d8ebf-openstack-config-secret\") pod \"6064cc64-d619-4992-a1f6-b174b05d8ebf\" (UID: \"6064cc64-d619-4992-a1f6-b174b05d8ebf\") " Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.538522 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6064cc64-d619-4992-a1f6-b174b05d8ebf-combined-ca-bundle\") pod \"6064cc64-d619-4992-a1f6-b174b05d8ebf\" (UID: \"6064cc64-d619-4992-a1f6-b174b05d8ebf\") " Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.538558 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/6064cc64-d619-4992-a1f6-b174b05d8ebf-openstack-config\") pod \"6064cc64-d619-4992-a1f6-b174b05d8ebf\" (UID: \"6064cc64-d619-4992-a1f6-b174b05d8ebf\") " Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.538696 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d2prx\" (UniqueName: \"kubernetes.io/projected/6064cc64-d619-4992-a1f6-b174b05d8ebf-kube-api-access-d2prx\") pod \"6064cc64-d619-4992-a1f6-b174b05d8ebf\" (UID: \"6064cc64-d619-4992-a1f6-b174b05d8ebf\") " Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.539342 5120 reconciler_common.go:299] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/39b1a992-7cfc-4382-9263-18d430251511-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.539359 5120 reconciler_common.go:299] "Volume detached for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/39b1a992-7cfc-4382-9263-18d430251511-ovsdbserver-sb-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.539373 5120 reconciler_common.go:299] "Volume detached for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/b82f3ed0-7b4a-4ac7-800a-40f5c2cb7242-ovsdbserver-nb-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.539386 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage19-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.539399 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.572851 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b82f3ed0-7b4a-4ac7-800a-40f5c2cb7242-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "b82f3ed0-7b4a-4ac7-800a-40f5c2cb7242" (UID: "b82f3ed0-7b4a-4ac7-800a-40f5c2cb7242"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.603301 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6064cc64-d619-4992-a1f6-b174b05d8ebf-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "6064cc64-d619-4992-a1f6-b174b05d8ebf" (UID: "6064cc64-d619-4992-a1f6-b174b05d8ebf"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.606394 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6064cc64-d619-4992-a1f6-b174b05d8ebf-openstack-config" (OuterVolumeSpecName: "openstack-config") pod "6064cc64-d619-4992-a1f6-b174b05d8ebf" (UID: "6064cc64-d619-4992-a1f6-b174b05d8ebf"). InnerVolumeSpecName "openstack-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.612358 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6064cc64-d619-4992-a1f6-b174b05d8ebf-kube-api-access-d2prx" (OuterVolumeSpecName: "kube-api-access-d2prx") pod "6064cc64-d619-4992-a1f6-b174b05d8ebf" (UID: "6064cc64-d619-4992-a1f6-b174b05d8ebf"). InnerVolumeSpecName "kube-api-access-d2prx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.643735 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6064cc64-d619-4992-a1f6-b174b05d8ebf-openstack-config-secret" (OuterVolumeSpecName: "openstack-config-secret") pod "6064cc64-d619-4992-a1f6-b174b05d8ebf" (UID: "6064cc64-d619-4992-a1f6-b174b05d8ebf"). InnerVolumeSpecName "openstack-config-secret". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.649947 5120 reconciler_common.go:299] "Volume detached for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/6064cc64-d619-4992-a1f6-b174b05d8ebf-openstack-config-secret\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.649979 5120 reconciler_common.go:299] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/b82f3ed0-7b4a-4ac7-800a-40f5c2cb7242-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.649990 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6064cc64-d619-4992-a1f6-b174b05d8ebf-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.649998 5120 reconciler_common.go:299] "Volume detached for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/6064cc64-d619-4992-a1f6-b174b05d8ebf-openstack-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.650007 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d2prx\" (UniqueName: \"kubernetes.io/projected/6064cc64-d619-4992-a1f6-b174b05d8ebf-kube-api-access-d2prx\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.655651 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-e3fe-account-create-update-dgd59"] Mar 16 16:18:01 crc kubenswrapper[5120]: E0316 16:18:01.671788 5120 kuberuntime_manager.go:1358] "Unhandled Error" err=< Mar 16 16:18:01 crc kubenswrapper[5120]: container &Container{Name:mariadb-account-create-update,Image:quay.io/podified-antelope-centos9/openstack-mariadb@sha256:4caef2b55e01b9a7ee88a22bc69db1893521a91d95c7ad4c8e593f14f17a5f95,Command:[/bin/sh -c #!/bin/bash Mar 16 16:18:01 crc kubenswrapper[5120]: Mar 16 16:18:01 crc kubenswrapper[5120]: MYSQL_REMOTE_HOST="" source /var/lib/operator-scripts/mysql_root_auth.sh Mar 16 16:18:01 crc kubenswrapper[5120]: Mar 16 16:18:01 crc kubenswrapper[5120]: export DatabasePassword=${DatabasePassword:?"Please specify a DatabasePassword variable."} Mar 16 16:18:01 crc kubenswrapper[5120]: Mar 16 16:18:01 crc kubenswrapper[5120]: MYSQL_CMD="mysql -h -u root -P 3306" Mar 16 16:18:01 crc kubenswrapper[5120]: Mar 16 16:18:01 crc kubenswrapper[5120]: if [ -n "glance" ]; then Mar 16 16:18:01 crc kubenswrapper[5120]: GRANT_DATABASE="glance" Mar 16 16:18:01 crc kubenswrapper[5120]: else Mar 16 16:18:01 crc kubenswrapper[5120]: GRANT_DATABASE="*" Mar 16 16:18:01 crc kubenswrapper[5120]: fi Mar 16 16:18:01 crc kubenswrapper[5120]: Mar 16 16:18:01 crc kubenswrapper[5120]: # going for maximum compatibility here: Mar 16 16:18:01 crc kubenswrapper[5120]: # 1. MySQL 8 no longer allows implicit create user when GRANT is used Mar 16 16:18:01 crc kubenswrapper[5120]: # 2. MariaDB has "CREATE OR REPLACE", but MySQL does not Mar 16 16:18:01 crc kubenswrapper[5120]: # 3. create user with CREATE but then do all password and TLS with ALTER to Mar 16 16:18:01 crc kubenswrapper[5120]: # support updates Mar 16 16:18:01 crc kubenswrapper[5120]: Mar 16 16:18:01 crc kubenswrapper[5120]: $MYSQL_CMD < logger="UnhandledError" Mar 16 16:18:01 crc kubenswrapper[5120]: E0316 16:18:01.673224 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"mariadb-account-create-update\" with CreateContainerConfigError: \"secret \\\"glance-db-secret\\\" not found\"" pod="openstack-kuttl-tests/glance-e3fe-account-create-update-dgd59" podUID="979c2589-0aa0-4e9c-8a97-9fd5a1676e64" Mar 16 16:18:01 crc kubenswrapper[5120]: E0316 16:18:01.937810 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of c758fe75eb30010d3898ba0e46464704f4eaccdb5721a29379189ee1664975df is running failed: container process not found" containerID="c758fe75eb30010d3898ba0e46464704f4eaccdb5721a29379189ee1664975df" cmd=["/bin/bash","/var/lib/operator-scripts/mysql_probe.sh","readiness"] Mar 16 16:18:01 crc kubenswrapper[5120]: E0316 16:18:01.938337 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of c758fe75eb30010d3898ba0e46464704f4eaccdb5721a29379189ee1664975df is running failed: container process not found" containerID="c758fe75eb30010d3898ba0e46464704f4eaccdb5721a29379189ee1664975df" cmd=["/bin/bash","/var/lib/operator-scripts/mysql_probe.sh","readiness"] Mar 16 16:18:01 crc kubenswrapper[5120]: E0316 16:18:01.939541 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of c758fe75eb30010d3898ba0e46464704f4eaccdb5721a29379189ee1664975df is running failed: container process not found" containerID="c758fe75eb30010d3898ba0e46464704f4eaccdb5721a29379189ee1664975df" cmd=["/bin/bash","/var/lib/operator-scripts/mysql_probe.sh","readiness"] Mar 16 16:18:01 crc kubenswrapper[5120]: E0316 16:18:01.939577 5120 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of c758fe75eb30010d3898ba0e46464704f4eaccdb5721a29379189ee1664975df is running failed: container process not found" probeType="Readiness" pod="openstack-kuttl-tests/openstack-cell1-galera-0" podUID="848fca26-246f-48f5-8f00-a41ecb239952" containerName="galera" probeResult="unknown" Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.961712 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podUID="fb13a989-3fee-4cd9-97d4-e68371891b6b" containerName="nova-cell1-novncproxy-novncproxy" probeResult="failure" output="Get \"https://10.217.1.5:6080/vnc_lite.html\": dial tcp 10.217.1.5:6080: connect: connection refused" Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.976904 5120 generic.go:358] "Generic (PLEG): container finished" podID="c06828a4-039e-4080-a682-0bf5a7aaf9c2" containerID="b95fea81e244713a6300e6ead4faf992fc23c53c8f23c0486269773f1cf284c5" exitCode=0 Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.976931 5120 generic.go:358] "Generic (PLEG): container finished" podID="c06828a4-039e-4080-a682-0bf5a7aaf9c2" containerID="d7fad27bd78b15e804b67e664c292c55fa7faee0c6fb07e878bcb9e536052264" exitCode=0 Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.977077 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-7c79cc45b-sp9b7" event={"ID":"c06828a4-039e-4080-a682-0bf5a7aaf9c2","Type":"ContainerDied","Data":"b95fea81e244713a6300e6ead4faf992fc23c53c8f23c0486269773f1cf284c5"} Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.977121 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-7c79cc45b-sp9b7" event={"ID":"c06828a4-039e-4080-a682-0bf5a7aaf9c2","Type":"ContainerDied","Data":"d7fad27bd78b15e804b67e664c292c55fa7faee0c6fb07e878bcb9e536052264"} Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.983283 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_b82f3ed0-7b4a-4ac7-800a-40f5c2cb7242/ovsdbserver-nb/0.log" Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.983359 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"b82f3ed0-7b4a-4ac7-800a-40f5c2cb7242","Type":"ContainerDied","Data":"7c5bf82afa95d3206dada3c4848737e3057cea3d907251f318b9fc4d732f69e3"} Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.983387 5120 scope.go:117] "RemoveContainer" containerID="63b5afa737f6f7747352275491173c16cae3412926aa04a8ec50d294ba0d5c7e" Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.983532 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.987281 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-9c08-account-create-update-w7m2p"] Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.989488 5120 generic.go:358] "Generic (PLEG): container finished" podID="1c354659-a22a-4fa3-8747-75b7241aea49" containerID="e7d4e3842ff2074c385862c7f0cb2ed29aa14bda35f907a94808d0d9edb150e9" exitCode=0 Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.989581 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"1c354659-a22a-4fa3-8747-75b7241aea49","Type":"ContainerDied","Data":"e7d4e3842ff2074c385862c7f0cb2ed29aa14bda35f907a94808d0d9edb150e9"} Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.990509 5120 status_manager.go:895] "Failed to get status for pod" podUID="6064cc64-d619-4992-a1f6-b174b05d8ebf" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.993772 5120 generic.go:358] "Generic (PLEG): container finished" podID="9f16b3a2-bc26-4a63-8f8c-836611f0d320" containerID="3d3613157c725663b3645ab202fb54ad95ebbe067187047f60bb2b1749e436ce" exitCode=143 Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.993844 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-796f4f9644-59hlg" event={"ID":"9f16b3a2-bc26-4a63-8f8c-836611f0d320","Type":"ContainerDied","Data":"3d3613157c725663b3645ab202fb54ad95ebbe067187047f60bb2b1749e436ce"} Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.998151 5120 generic.go:358] "Generic (PLEG): container finished" podID="76c6cd23-f4cd-4b95-95b1-252ec9c5cafa" containerID="40002f2be6fa424b030589769c3c029dfacfcdae45b3980ed054abb3abc3c1d9" exitCode=0 Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.998174 5120 generic.go:358] "Generic (PLEG): container finished" podID="76c6cd23-f4cd-4b95-95b1-252ec9c5cafa" containerID="cf198603b58bf7b45d7c9f7f1ce555f5fcb8f5b47b0707c2960e22415f81c96e" exitCode=2 Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.998180 5120 generic.go:358] "Generic (PLEG): container finished" podID="76c6cd23-f4cd-4b95-95b1-252ec9c5cafa" containerID="af5fb6c449290fd20f488014a20a2e812dbe3b44b9e9e143413c9ee4a9424499" exitCode=0 Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.998316 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"76c6cd23-f4cd-4b95-95b1-252ec9c5cafa","Type":"ContainerDied","Data":"40002f2be6fa424b030589769c3c029dfacfcdae45b3980ed054abb3abc3c1d9"} Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.998341 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"76c6cd23-f4cd-4b95-95b1-252ec9c5cafa","Type":"ContainerDied","Data":"cf198603b58bf7b45d7c9f7f1ce555f5fcb8f5b47b0707c2960e22415f81c96e"} Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.998350 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"76c6cd23-f4cd-4b95-95b1-252ec9c5cafa","Type":"ContainerDied","Data":"af5fb6c449290fd20f488014a20a2e812dbe3b44b9e9e143413c9ee4a9424499"} Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.999854 5120 generic.go:358] "Generic (PLEG): container finished" podID="7e059927-938d-4449-a260-90053be70ec9" containerID="d430d21560c12eca992abdde06e718c2e3d71e50d61e91ef2285be76ee5901bd" exitCode=143 Mar 16 16:18:01 crc kubenswrapper[5120]: I0316 16:18:01.999897 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-5bfb7678f9-6dzmx" event={"ID":"7e059927-938d-4449-a260-90053be70ec9","Type":"ContainerDied","Data":"d430d21560c12eca992abdde06e718c2e3d71e50d61e91ef2285be76ee5901bd"} Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.015494 5120 generic.go:358] "Generic (PLEG): container finished" podID="90982d87-fc0f-49d0-a400-4155e4f3b000" containerID="46f6c0f40f4dd4a16ffce3878f6cf6ade2206957a9e4f6824def88db1fdb2279" exitCode=1 Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.016504 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-bh8f4" event={"ID":"90982d87-fc0f-49d0-a400-4155e4f3b000","Type":"ContainerDied","Data":"46f6c0f40f4dd4a16ffce3878f6cf6ade2206957a9e4f6824def88db1fdb2279"} Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.017158 5120 scope.go:117] "RemoveContainer" containerID="46f6c0f40f4dd4a16ffce3878f6cf6ade2206957a9e4f6824def88db1fdb2279" Mar 16 16:18:02 crc kubenswrapper[5120]: E0316 16:18:02.021556 5120 kuberuntime_manager.go:1358] "Unhandled Error" err=< Mar 16 16:18:02 crc kubenswrapper[5120]: container &Container{Name:mariadb-account-create-update,Image:quay.io/podified-antelope-centos9/openstack-mariadb@sha256:4caef2b55e01b9a7ee88a22bc69db1893521a91d95c7ad4c8e593f14f17a5f95,Command:[/bin/sh -c #!/bin/bash Mar 16 16:18:02 crc kubenswrapper[5120]: Mar 16 16:18:02 crc kubenswrapper[5120]: MYSQL_REMOTE_HOST="" source /var/lib/operator-scripts/mysql_root_auth.sh Mar 16 16:18:02 crc kubenswrapper[5120]: Mar 16 16:18:02 crc kubenswrapper[5120]: export DatabasePassword=${DatabasePassword:?"Please specify a DatabasePassword variable."} Mar 16 16:18:02 crc kubenswrapper[5120]: Mar 16 16:18:02 crc kubenswrapper[5120]: MYSQL_CMD="mysql -h -u root -P 3306" Mar 16 16:18:02 crc kubenswrapper[5120]: Mar 16 16:18:02 crc kubenswrapper[5120]: if [ -n "neutron" ]; then Mar 16 16:18:02 crc kubenswrapper[5120]: GRANT_DATABASE="neutron" Mar 16 16:18:02 crc kubenswrapper[5120]: else Mar 16 16:18:02 crc kubenswrapper[5120]: GRANT_DATABASE="*" Mar 16 16:18:02 crc kubenswrapper[5120]: fi Mar 16 16:18:02 crc kubenswrapper[5120]: Mar 16 16:18:02 crc kubenswrapper[5120]: # going for maximum compatibility here: Mar 16 16:18:02 crc kubenswrapper[5120]: # 1. MySQL 8 no longer allows implicit create user when GRANT is used Mar 16 16:18:02 crc kubenswrapper[5120]: # 2. MariaDB has "CREATE OR REPLACE", but MySQL does not Mar 16 16:18:02 crc kubenswrapper[5120]: # 3. create user with CREATE but then do all password and TLS with ALTER to Mar 16 16:18:02 crc kubenswrapper[5120]: # support updates Mar 16 16:18:02 crc kubenswrapper[5120]: Mar 16 16:18:02 crc kubenswrapper[5120]: $MYSQL_CMD < logger="UnhandledError" Mar 16 16:18:02 crc kubenswrapper[5120]: E0316 16:18:02.023098 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"mariadb-account-create-update\" with CreateContainerConfigError: \"secret \\\"neutron-db-secret\\\" not found\"" pod="openstack-kuttl-tests/neutron-9c08-account-create-update-w7m2p" podUID="70f64346-8cba-4ea9-b229-c1ba5012ca42" Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.044204 5120 status_manager.go:895] "Failed to get status for pod" podUID="6064cc64-d619-4992-a1f6-b174b05d8ebf" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.064936 5120 generic.go:358] "Generic (PLEG): container finished" podID="101749dc-c834-4d18-9d65-704af8b368a4" containerID="65875e7567b5b9a91bd06c5e05daccd574160efc902dcf5923e2b79b0c8d2244" exitCode=0 Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.065107 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"101749dc-c834-4d18-9d65-704af8b368a4","Type":"ContainerDied","Data":"65875e7567b5b9a91bd06c5e05daccd574160efc902dcf5923e2b79b0c8d2244"} Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.066286 5120 status_manager.go:895] "Failed to get status for pod" podUID="6064cc64-d619-4992-a1f6-b174b05d8ebf" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.071337 5120 scope.go:117] "RemoveContainer" containerID="80c9afe3261c93a6525f7ff404170b08abdba9d0e0d9e39fe4469ee485fc35fe" Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.086102 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.087060 5120 generic.go:358] "Generic (PLEG): container finished" podID="044996b4-e444-4486-9503-61d776ec849f" containerID="a7009166ee17bc972006fca5fae2160d1fd948f482b659e9b784be0cafb5a261" exitCode=143 Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.087213 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"044996b4-e444-4486-9503-61d776ec849f","Type":"ContainerDied","Data":"a7009166ee17bc972006fca5fae2160d1fd948f482b659e9b784be0cafb5a261"} Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.095994 5120 generic.go:358] "Generic (PLEG): container finished" podID="b2e8d0e9-fa13-49fc-b149-af0d8d1d5ef0" containerID="9f4ca810d0333490f7f8804535988941a3f37adb5983d0982fedf9261a9e97e6" exitCode=143 Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.096112 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-cbf797d74-8frg4" event={"ID":"b2e8d0e9-fa13-49fc-b149-af0d8d1d5ef0","Type":"ContainerDied","Data":"9f4ca810d0333490f7f8804535988941a3f37adb5983d0982fedf9261a9e97e6"} Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.126669 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.145214 5120 generic.go:358] "Generic (PLEG): container finished" podID="9698823e-0af0-4477-b47a-a388c6264dda" containerID="5346c7728f32b0dc09b52da8b4cb5097e3f94eb1c9956ddf64dfa7f4fe5c9f0b" exitCode=0 Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.145347 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-d8b74df76-z7648" event={"ID":"9698823e-0af0-4477-b47a-a388c6264dda","Type":"ContainerDied","Data":"5346c7728f32b0dc09b52da8b4cb5097e3f94eb1c9956ddf64dfa7f4fe5c9f0b"} Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.150925 5120 generic.go:358] "Generic (PLEG): container finished" podID="9e7f8135-737c-4639-bdd8-46d68e1a617d" containerID="12572d4dbfa6da89a684a45d45fbbef79f79d94a4c9264be847c926efe2a306c" exitCode=143 Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.151000 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"9e7f8135-737c-4639-bdd8-46d68e1a617d","Type":"ContainerDied","Data":"12572d4dbfa6da89a684a45d45fbbef79f79d94a4c9264be847c926efe2a306c"} Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.155126 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.159773 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-4w76w"] Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.161247 5120 status_manager.go:895] "Failed to get status for pod" podUID="6064cc64-d619-4992-a1f6-b174b05d8ebf" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.170492 5120 generic.go:358] "Generic (PLEG): container finished" podID="fb13a989-3fee-4cd9-97d4-e68371891b6b" containerID="02d26c01c0add7af45d27551c127315970f580e97920c2b887ce397fd67a99cf" exitCode=0 Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.170549 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"fb13a989-3fee-4cd9-97d4-e68371891b6b","Type":"ContainerDied","Data":"02d26c01c0add7af45d27551c127315970f580e97920c2b887ce397fd67a99cf"} Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.193860 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.196951 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_39b1a992-7cfc-4382-9263-18d430251511/ovsdbserver-sb/0.log" Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.197890 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"39b1a992-7cfc-4382-9263-18d430251511","Type":"ContainerDied","Data":"741adc23c987b9e7b49b829acf8ee06d2c68c97ae7f7de14051ad29d223ae155"} Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.197973 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.204168 5120 status_manager.go:895] "Failed to get status for pod" podUID="6064cc64-d619-4992-a1f6-b174b05d8ebf" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.228935 5120 status_manager.go:895] "Failed to get status for pod" podUID="6064cc64-d619-4992-a1f6-b174b05d8ebf" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.233399 5120 generic.go:358] "Generic (PLEG): container finished" podID="9292b258-885b-40a8-8b7d-9ed28a747bc7" containerID="67504ceae616481d35ca3f878a42ab809e32f965b94f09a9c14bb47581bf94e4" exitCode=143 Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.233490 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"9292b258-885b-40a8-8b7d-9ed28a747bc7","Type":"ContainerDied","Data":"67504ceae616481d35ca3f878a42ab809e32f965b94f09a9c14bb47581bf94e4"} Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.247728 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-39eb-account-create-update-tnz8p" event={"ID":"0d72ed4f-2b58-4e71-ada5-a06739dac8b2","Type":"ContainerStarted","Data":"68258a1f77c1ed7b37e32470c33913b9b4625c7c547b769b102cad784a0d8a73"} Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.252221 5120 status_manager.go:895] "Failed to get status for pod" podUID="6064cc64-d619-4992-a1f6-b174b05d8ebf" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.258878 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561298-6qsf7"] Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.263421 5120 generic.go:358] "Generic (PLEG): container finished" podID="d73ebf72-269e-4ebf-86b6-2d517ce8881a" containerID="55aacccfe83493c2807259e063c3f528093cf68eb2ea222aec83b143462b6a75" exitCode=2 Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.263523 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"d73ebf72-269e-4ebf-86b6-2d517ce8881a","Type":"ContainerDied","Data":"55aacccfe83493c2807259e063c3f528093cf68eb2ea222aec83b143462b6a75"} Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.283909 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-e3fe-account-create-update-dgd59" event={"ID":"979c2589-0aa0-4e9c-8a97-9fd5a1676e64","Type":"ContainerStarted","Data":"3dcef1e52f5a3fe01fbbce40f12e3460f264aa432d60e7fe46d8cb526104b359"} Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.325862 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.326103 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/memcached-0" podUID="ead61fcf-891a-44f3-8867-a2adcf744d69" containerName="memcached" containerID="cri-o://d251b0429da624062362d8f63ad78aba4ba2e5f930e45f5add820cdf106863fd" gracePeriod=30 Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.334056 5120 status_manager.go:895] "Failed to get status for pod" podUID="6064cc64-d619-4992-a1f6-b174b05d8ebf" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.340920 5120 status_manager.go:895] "Failed to get status for pod" podUID="6064cc64-d619-4992-a1f6-b174b05d8ebf" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.341245 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.374848 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-5fac-account-create-update-m6ghj"] Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.389697 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-5fac-account-create-update-m6ghj"] Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.442325 5120 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.445694 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-5fac-account-create-update-clvt8"] Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.456139 5120 status_manager.go:895] "Failed to get status for pod" podUID="6064cc64-d619-4992-a1f6-b174b05d8ebf" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.461716 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b82f3ed0-7b4a-4ac7-800a-40f5c2cb7242" containerName="openstack-network-exporter" Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.461765 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="b82f3ed0-7b4a-4ac7-800a-40f5c2cb7242" containerName="openstack-network-exporter" Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.461799 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d73ebf72-269e-4ebf-86b6-2d517ce8881a" containerName="kube-state-metrics" Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.461804 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="d73ebf72-269e-4ebf-86b6-2d517ce8881a" containerName="kube-state-metrics" Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.461843 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b82f3ed0-7b4a-4ac7-800a-40f5c2cb7242" containerName="ovsdbserver-nb" Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.461849 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="b82f3ed0-7b4a-4ac7-800a-40f5c2cb7242" containerName="ovsdbserver-nb" Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.461855 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39b1a992-7cfc-4382-9263-18d430251511" containerName="ovsdbserver-sb" Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.461860 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="39b1a992-7cfc-4382-9263-18d430251511" containerName="ovsdbserver-sb" Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.461875 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39b1a992-7cfc-4382-9263-18d430251511" containerName="openstack-network-exporter" Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.461882 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="39b1a992-7cfc-4382-9263-18d430251511" containerName="openstack-network-exporter" Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.462040 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="b82f3ed0-7b4a-4ac7-800a-40f5c2cb7242" containerName="openstack-network-exporter" Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.462053 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="39b1a992-7cfc-4382-9263-18d430251511" containerName="openstack-network-exporter" Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.462066 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="b82f3ed0-7b4a-4ac7-800a-40f5c2cb7242" containerName="ovsdbserver-nb" Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.462081 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="39b1a992-7cfc-4382-9263-18d430251511" containerName="ovsdbserver-sb" Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.462091 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="d73ebf72-269e-4ebf-86b6-2d517ce8881a" containerName="kube-state-metrics" Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.470230 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-5fac-account-create-update-clvt8" Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.474205 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-db-secret\"" Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.479369 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-5fac-account-create-update-clvt8"] Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.485500 5120 status_manager.go:895] "Failed to get status for pod" podUID="6064cc64-d619-4992-a1f6-b174b05d8ebf" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.492806 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/d73ebf72-269e-4ebf-86b6-2d517ce8881a-kube-state-metrics-tls-certs\") pod \"d73ebf72-269e-4ebf-86b6-2d517ce8881a\" (UID: \"d73ebf72-269e-4ebf-86b6-2d517ce8881a\") " Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.492960 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d73ebf72-269e-4ebf-86b6-2d517ce8881a-combined-ca-bundle\") pod \"d73ebf72-269e-4ebf-86b6-2d517ce8881a\" (UID: \"d73ebf72-269e-4ebf-86b6-2d517ce8881a\") " Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.493142 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/d73ebf72-269e-4ebf-86b6-2d517ce8881a-kube-state-metrics-tls-config\") pod \"d73ebf72-269e-4ebf-86b6-2d517ce8881a\" (UID: \"d73ebf72-269e-4ebf-86b6-2d517ce8881a\") " Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.493493 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z6dv2\" (UniqueName: \"kubernetes.io/projected/d73ebf72-269e-4ebf-86b6-2d517ce8881a-kube-api-access-z6dv2\") pod \"d73ebf72-269e-4ebf-86b6-2d517ce8881a\" (UID: \"d73ebf72-269e-4ebf-86b6-2d517ce8881a\") " Mar 16 16:18:02 crc kubenswrapper[5120]: E0316 16:18:02.494056 5120 projected.go:264] Couldn't get secret openstack-kuttl-tests/swift-proxy-config-data: secret "swift-proxy-config-data" not found Mar 16 16:18:02 crc kubenswrapper[5120]: E0316 16:18:02.494069 5120 projected.go:264] Couldn't get secret openstack-kuttl-tests/swift-conf: secret "swift-conf" not found Mar 16 16:18:02 crc kubenswrapper[5120]: E0316 16:18:02.494078 5120 projected.go:289] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Mar 16 16:18:02 crc kubenswrapper[5120]: E0316 16:18:02.494087 5120 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-proxy-7c79cc45b-sp9b7: [secret "swift-proxy-config-data" not found, secret "swift-conf" not found, configmap "swift-ring-files" not found] Mar 16 16:18:02 crc kubenswrapper[5120]: E0316 16:18:02.495628 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c06828a4-039e-4080-a682-0bf5a7aaf9c2-etc-swift podName:c06828a4-039e-4080-a682-0bf5a7aaf9c2 nodeName:}" failed. No retries permitted until 2026-03-16 16:18:06.495610005 +0000 UTC m=+2788.649541662 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/c06828a4-039e-4080-a682-0bf5a7aaf9c2-etc-swift") pod "swift-proxy-7c79cc45b-sp9b7" (UID: "c06828a4-039e-4080-a682-0bf5a7aaf9c2") : [secret "swift-proxy-config-data" not found, secret "swift-conf" not found, configmap "swift-ring-files" not found] Mar 16 16:18:02 crc kubenswrapper[5120]: E0316 16:18:02.497552 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 16:18:02 crc kubenswrapper[5120]: E0316 16:18:02.497821 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c06828a4-039e-4080-a682-0bf5a7aaf9c2-combined-ca-bundle podName:c06828a4-039e-4080-a682-0bf5a7aaf9c2 nodeName:}" failed. No retries permitted until 2026-03-16 16:18:06.497741252 +0000 UTC m=+2788.651672909 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/c06828a4-039e-4080-a682-0bf5a7aaf9c2-combined-ca-bundle") pod "swift-proxy-7c79cc45b-sp9b7" (UID: "c06828a4-039e-4080-a682-0bf5a7aaf9c2") : secret "combined-ca-bundle" not found Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.503224 5120 scope.go:117] "RemoveContainer" containerID="ad0375bf4af105fa6a34f99135b8947f56c2ad8a62f3ea28296881a4467a492c" Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.507827 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-cl2jb"] Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.520282 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-cl2jb"] Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.520541 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d73ebf72-269e-4ebf-86b6-2d517ce8881a-kube-api-access-z6dv2" (OuterVolumeSpecName: "kube-api-access-z6dv2") pod "d73ebf72-269e-4ebf-86b6-2d517ce8881a" (UID: "d73ebf72-269e-4ebf-86b6-2d517ce8881a"). InnerVolumeSpecName "kube-api-access-z6dv2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.542938 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-9s4rw"] Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.569141 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-9s4rw"] Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.581515 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-6f9485b564-dlsjq"] Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.581868 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/keystone-6f9485b564-dlsjq" podUID="d762c585-b44b-475d-a371-507fa2f9439a" containerName="keystone-api" containerID="cri-o://2dae34322c3b177952bf14227b112419b3dd714c550886bb4270633cbccfcb9d" gracePeriod=30 Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.595573 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.595878 5120 status_manager.go:895] "Failed to get status for pod" podUID="6064cc64-d619-4992-a1f6-b174b05d8ebf" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.596021 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nj6t9\" (UniqueName: \"kubernetes.io/projected/23634501-dcbf-4b5f-a734-820f1959b54e-kube-api-access-nj6t9\") pod \"keystone-5fac-account-create-update-clvt8\" (UID: \"23634501-dcbf-4b5f-a734-820f1959b54e\") " pod="openstack-kuttl-tests/keystone-5fac-account-create-update-clvt8" Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.596103 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/23634501-dcbf-4b5f-a734-820f1959b54e-operator-scripts\") pod \"keystone-5fac-account-create-update-clvt8\" (UID: \"23634501-dcbf-4b5f-a734-820f1959b54e\") " pod="openstack-kuttl-tests/keystone-5fac-account-create-update-clvt8" Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.596406 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z6dv2\" (UniqueName: \"kubernetes.io/projected/d73ebf72-269e-4ebf-86b6-2d517ce8881a-kube-api-access-z6dv2\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.605734 5120 status_manager.go:895] "Failed to get status for pod" podUID="6064cc64-d619-4992-a1f6-b174b05d8ebf" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.620248 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" podUID="551715bc-101a-4745-955b-027ac2be9c0b" containerName="rabbitmq" probeResult="failure" output="dial tcp 10.217.0.177:5671: connect: connection refused" Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.620740 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-db-create-jvj4v"] Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.633396 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-db-create-jvj4v"] Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.638836 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.649846 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.652324 5120 scope.go:117] "RemoveContainer" containerID="f24bdb846594a48104f84ee1555c401e3cab825116931065b9f832d3b9ecbacd" Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.688903 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d73ebf72-269e-4ebf-86b6-2d517ce8881a-kube-state-metrics-tls-config" (OuterVolumeSpecName: "kube-state-metrics-tls-config") pod "d73ebf72-269e-4ebf-86b6-2d517ce8881a" (UID: "d73ebf72-269e-4ebf-86b6-2d517ce8881a"). InnerVolumeSpecName "kube-state-metrics-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.689917 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d73ebf72-269e-4ebf-86b6-2d517ce8881a-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "d73ebf72-269e-4ebf-86b6-2d517ce8881a" (UID: "d73ebf72-269e-4ebf-86b6-2d517ce8881a"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.706219 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nj6t9\" (UniqueName: \"kubernetes.io/projected/23634501-dcbf-4b5f-a734-820f1959b54e-kube-api-access-nj6t9\") pod \"keystone-5fac-account-create-update-clvt8\" (UID: \"23634501-dcbf-4b5f-a734-820f1959b54e\") " pod="openstack-kuttl-tests/keystone-5fac-account-create-update-clvt8" Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.706334 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/23634501-dcbf-4b5f-a734-820f1959b54e-operator-scripts\") pod \"keystone-5fac-account-create-update-clvt8\" (UID: \"23634501-dcbf-4b5f-a734-820f1959b54e\") " pod="openstack-kuttl-tests/keystone-5fac-account-create-update-clvt8" Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.706801 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d73ebf72-269e-4ebf-86b6-2d517ce8881a-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.706814 5120 reconciler_common.go:299] "Volume detached for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/d73ebf72-269e-4ebf-86b6-2d517ce8881a-kube-state-metrics-tls-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:02 crc kubenswrapper[5120]: E0316 16:18:02.706886 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Mar 16 16:18:02 crc kubenswrapper[5120]: E0316 16:18:02.706940 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/23634501-dcbf-4b5f-a734-820f1959b54e-operator-scripts podName:23634501-dcbf-4b5f-a734-820f1959b54e nodeName:}" failed. No retries permitted until 2026-03-16 16:18:03.206924998 +0000 UTC m=+2785.360856655 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/23634501-dcbf-4b5f-a734-820f1959b54e-operator-scripts") pod "keystone-5fac-account-create-update-clvt8" (UID: "23634501-dcbf-4b5f-a734-820f1959b54e") : configmap "openstack-scripts" not found Mar 16 16:18:02 crc kubenswrapper[5120]: E0316 16:18:02.710949 5120 projected.go:194] Error preparing data for projected volume kube-api-access-nj6t9 for pod openstack-kuttl-tests/keystone-5fac-account-create-update-clvt8: failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 16:18:02 crc kubenswrapper[5120]: E0316 16:18:02.711037 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/23634501-dcbf-4b5f-a734-820f1959b54e-kube-api-access-nj6t9 podName:23634501-dcbf-4b5f-a734-820f1959b54e nodeName:}" failed. No retries permitted until 2026-03-16 16:18:03.211016948 +0000 UTC m=+2785.364948605 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-nj6t9" (UniqueName: "kubernetes.io/projected/23634501-dcbf-4b5f-a734-820f1959b54e-kube-api-access-nj6t9") pod "keystone-5fac-account-create-update-clvt8" (UID: "23634501-dcbf-4b5f-a734-820f1959b54e") : failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.734010 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.737138 5120 status_manager.go:895] "Failed to get status for pod" podUID="6064cc64-d619-4992-a1f6-b174b05d8ebf" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.768494 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="05833667-2f2c-4785-89d7-1cfaaf139ebb" path="/var/lib/kubelet/pods/05833667-2f2c-4785-89d7-1cfaaf139ebb/volumes" Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.769562 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="21396f29-338c-4c63-8a5d-1a664e24899b" path="/var/lib/kubelet/pods/21396f29-338c-4c63-8a5d-1a664e24899b/volumes" Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.770131 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="23b70bd1-22f7-49c7-a28e-8972f2e8341d" path="/var/lib/kubelet/pods/23b70bd1-22f7-49c7-a28e-8972f2e8341d/volumes" Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.781952 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="39b1a992-7cfc-4382-9263-18d430251511" path="/var/lib/kubelet/pods/39b1a992-7cfc-4382-9263-18d430251511/volumes" Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.783109 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3b1e62ee-71b0-4dc1-acdb-c879ca6dc4f2" path="/var/lib/kubelet/pods/3b1e62ee-71b0-4dc1-acdb-c879ca6dc4f2/volumes" Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.783684 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d99b69f-0e55-4c21-a44a-f9d489528859" path="/var/lib/kubelet/pods/3d99b69f-0e55-4c21-a44a-f9d489528859/volumes" Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.787374 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4cabd00d-52cd-410b-a721-7e6089462d6a" path="/var/lib/kubelet/pods/4cabd00d-52cd-410b-a721-7e6089462d6a/volumes" Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.788020 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4f1dba2e-ff26-4e74-9322-65f013a2f969" path="/var/lib/kubelet/pods/4f1dba2e-ff26-4e74-9322-65f013a2f969/volumes" Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.788586 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6064cc64-d619-4992-a1f6-b174b05d8ebf" path="/var/lib/kubelet/pods/6064cc64-d619-4992-a1f6-b174b05d8ebf/volumes" Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.789130 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="afe6db0b-404e-4339-a3c6-94ae2fc4adc1" path="/var/lib/kubelet/pods/afe6db0b-404e-4339-a3c6-94ae2fc4adc1/volumes" Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.796553 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b0e5c34b-8582-407e-a0ce-7fe6748cf84f" path="/var/lib/kubelet/pods/b0e5c34b-8582-407e-a0ce-7fe6748cf84f/volumes" Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.797106 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b3408f9f-4603-417a-b56b-63780924bc68" path="/var/lib/kubelet/pods/b3408f9f-4603-417a-b56b-63780924bc68/volumes" Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.797702 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b56a81fa-4773-41b2-b585-c72ebe415ea1" path="/var/lib/kubelet/pods/b56a81fa-4773-41b2-b585-c72ebe415ea1/volumes" Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.806271 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b82f3ed0-7b4a-4ac7-800a-40f5c2cb7242" path="/var/lib/kubelet/pods/b82f3ed0-7b4a-4ac7-800a-40f5c2cb7242/volumes" Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.806935 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f9aaa51a-8e46-4554-b9eb-3b0ff4ee602b" path="/var/lib/kubelet/pods/f9aaa51a-8e46-4554-b9eb-3b0ff4ee602b/volumes" Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.808443 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k8vh8\" (UniqueName: \"kubernetes.io/projected/fb13a989-3fee-4cd9-97d4-e68371891b6b-kube-api-access-k8vh8\") pod \"fb13a989-3fee-4cd9-97d4-e68371891b6b\" (UID: \"fb13a989-3fee-4cd9-97d4-e68371891b6b\") " Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.808483 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fb13a989-3fee-4cd9-97d4-e68371891b6b-combined-ca-bundle\") pod \"fb13a989-3fee-4cd9-97d4-e68371891b6b\" (UID: \"fb13a989-3fee-4cd9-97d4-e68371891b6b\") " Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.808599 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/fb13a989-3fee-4cd9-97d4-e68371891b6b-vencrypt-tls-certs\") pod \"fb13a989-3fee-4cd9-97d4-e68371891b6b\" (UID: \"fb13a989-3fee-4cd9-97d4-e68371891b6b\") " Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.808635 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fb13a989-3fee-4cd9-97d4-e68371891b6b-config-data\") pod \"fb13a989-3fee-4cd9-97d4-e68371891b6b\" (UID: \"fb13a989-3fee-4cd9-97d4-e68371891b6b\") " Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.809133 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/fb13a989-3fee-4cd9-97d4-e68371891b6b-nova-novncproxy-tls-certs\") pod \"fb13a989-3fee-4cd9-97d4-e68371891b6b\" (UID: \"fb13a989-3fee-4cd9-97d4-e68371891b6b\") " Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.828772 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb13a989-3fee-4cd9-97d4-e68371891b6b-kube-api-access-k8vh8" (OuterVolumeSpecName: "kube-api-access-k8vh8") pod "fb13a989-3fee-4cd9-97d4-e68371891b6b" (UID: "fb13a989-3fee-4cd9-97d4-e68371891b6b"). InnerVolumeSpecName "kube-api-access-k8vh8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.873455 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb13a989-3fee-4cd9-97d4-e68371891b6b-config-data" (OuterVolumeSpecName: "config-data") pod "fb13a989-3fee-4cd9-97d4-e68371891b6b" (UID: "fb13a989-3fee-4cd9-97d4-e68371891b6b"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.878967 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb13a989-3fee-4cd9-97d4-e68371891b6b-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "fb13a989-3fee-4cd9-97d4-e68371891b6b" (UID: "fb13a989-3fee-4cd9-97d4-e68371891b6b"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.880451 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d73ebf72-269e-4ebf-86b6-2d517ce8881a-kube-state-metrics-tls-certs" (OuterVolumeSpecName: "kube-state-metrics-tls-certs") pod "d73ebf72-269e-4ebf-86b6-2d517ce8881a" (UID: "d73ebf72-269e-4ebf-86b6-2d517ce8881a"). InnerVolumeSpecName "kube-state-metrics-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.937562 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k8vh8\" (UniqueName: \"kubernetes.io/projected/fb13a989-3fee-4cd9-97d4-e68371891b6b-kube-api-access-k8vh8\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.937598 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fb13a989-3fee-4cd9-97d4-e68371891b6b-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.937608 5120 reconciler_common.go:299] "Volume detached for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/d73ebf72-269e-4ebf-86b6-2d517ce8881a-kube-state-metrics-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.937617 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fb13a989-3fee-4cd9-97d4-e68371891b6b-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.984780 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/openstack-galera-0" podUID="4885bea5-bdc7-472b-8f70-e110dd9b8c06" containerName="galera" containerID="cri-o://c833fe04b4a70d900cce526171b73ba0d1127695de57d343cd58245cc8c7ce58" gracePeriod=30 Mar 16 16:18:02 crc kubenswrapper[5120]: I0316 16:18:02.989783 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb13a989-3fee-4cd9-97d4-e68371891b6b-nova-novncproxy-tls-certs" (OuterVolumeSpecName: "nova-novncproxy-tls-certs") pod "fb13a989-3fee-4cd9-97d4-e68371891b6b" (UID: "fb13a989-3fee-4cd9-97d4-e68371891b6b"). InnerVolumeSpecName "nova-novncproxy-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.033631 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb13a989-3fee-4cd9-97d4-e68371891b6b-vencrypt-tls-certs" (OuterVolumeSpecName: "vencrypt-tls-certs") pod "fb13a989-3fee-4cd9-97d4-e68371891b6b" (UID: "fb13a989-3fee-4cd9-97d4-e68371891b6b"). InnerVolumeSpecName "vencrypt-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.044335 5120 reconciler_common.go:299] "Volume detached for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/fb13a989-3fee-4cd9-97d4-e68371891b6b-vencrypt-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.044369 5120 reconciler_common.go:299] "Volume detached for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/fb13a989-3fee-4cd9-97d4-e68371891b6b-nova-novncproxy-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.138450 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-bh8f4"] Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.138492 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-5fac-account-create-update-clvt8"] Mar 16 16:18:03 crc kubenswrapper[5120]: E0316 16:18:03.139161 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-nj6t9 operator-scripts], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openstack-kuttl-tests/keystone-5fac-account-create-update-clvt8" podUID="23634501-dcbf-4b5f-a734-820f1959b54e" Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.149626 5120 scope.go:117] "RemoveContainer" containerID="b864e5a30bdd1ec09c5e8b740495f3b877525c6eb80190831e21454bd493272f" Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.152004 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-7c79cc45b-sp9b7" Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.160565 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.166677 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-d8b74df76-z7648" Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.172086 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-e3fe-account-create-update-dgd59" Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.177247 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-347f-account-create-update-kvc8k" Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.181322 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-39eb-account-create-update-tnz8p" Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.247545 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/848fca26-246f-48f5-8f00-a41ecb239952-config-data-default\") pod \"848fca26-246f-48f5-8f00-a41ecb239952\" (UID: \"848fca26-246f-48f5-8f00-a41ecb239952\") " Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.247595 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/9698823e-0af0-4477-b47a-a388c6264dda-config\") pod \"9698823e-0af0-4477-b47a-a388c6264dda\" (UID: \"9698823e-0af0-4477-b47a-a388c6264dda\") " Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.247713 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c06828a4-039e-4080-a682-0bf5a7aaf9c2-config-data\") pod \"c06828a4-039e-4080-a682-0bf5a7aaf9c2\" (UID: \"c06828a4-039e-4080-a682-0bf5a7aaf9c2\") " Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.247803 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5pzdk\" (UniqueName: \"kubernetes.io/projected/9698823e-0af0-4477-b47a-a388c6264dda-kube-api-access-5pzdk\") pod \"9698823e-0af0-4477-b47a-a388c6264dda\" (UID: \"9698823e-0af0-4477-b47a-a388c6264dda\") " Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.247866 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c06828a4-039e-4080-a682-0bf5a7aaf9c2-run-httpd\") pod \"c06828a4-039e-4080-a682-0bf5a7aaf9c2\" (UID: \"c06828a4-039e-4080-a682-0bf5a7aaf9c2\") " Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.247901 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9s8bd\" (UniqueName: \"kubernetes.io/projected/6cf8b665-920c-4d82-92eb-508d6ca3e9a1-kube-api-access-9s8bd\") pod \"6cf8b665-920c-4d82-92eb-508d6ca3e9a1\" (UID: \"6cf8b665-920c-4d82-92eb-508d6ca3e9a1\") " Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.247931 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/9698823e-0af0-4477-b47a-a388c6264dda-public-tls-certs\") pod \"9698823e-0af0-4477-b47a-a388c6264dda\" (UID: \"9698823e-0af0-4477-b47a-a388c6264dda\") " Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.247955 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/6cf8b665-920c-4d82-92eb-508d6ca3e9a1-operator-scripts\") pod \"6cf8b665-920c-4d82-92eb-508d6ca3e9a1\" (UID: \"6cf8b665-920c-4d82-92eb-508d6ca3e9a1\") " Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.247973 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/848fca26-246f-48f5-8f00-a41ecb239952-galera-tls-certs\") pod \"848fca26-246f-48f5-8f00-a41ecb239952\" (UID: \"848fca26-246f-48f5-8f00-a41ecb239952\") " Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.248017 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/c06828a4-039e-4080-a682-0bf5a7aaf9c2-public-tls-certs\") pod \"c06828a4-039e-4080-a682-0bf5a7aaf9c2\" (UID: \"c06828a4-039e-4080-a682-0bf5a7aaf9c2\") " Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.248059 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c06828a4-039e-4080-a682-0bf5a7aaf9c2-log-httpd\") pod \"c06828a4-039e-4080-a682-0bf5a7aaf9c2\" (UID: \"c06828a4-039e-4080-a682-0bf5a7aaf9c2\") " Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.248116 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/848fca26-246f-48f5-8f00-a41ecb239952-combined-ca-bundle\") pod \"848fca26-246f-48f5-8f00-a41ecb239952\" (UID: \"848fca26-246f-48f5-8f00-a41ecb239952\") " Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.248139 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/c06828a4-039e-4080-a682-0bf5a7aaf9c2-etc-swift\") pod \"c06828a4-039e-4080-a682-0bf5a7aaf9c2\" (UID: \"c06828a4-039e-4080-a682-0bf5a7aaf9c2\") " Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.248334 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/848fca26-246f-48f5-8f00-a41ecb239952-kolla-config\") pod \"848fca26-246f-48f5-8f00-a41ecb239952\" (UID: \"848fca26-246f-48f5-8f00-a41ecb239952\") " Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.248378 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/c06828a4-039e-4080-a682-0bf5a7aaf9c2-internal-tls-certs\") pod \"c06828a4-039e-4080-a682-0bf5a7aaf9c2\" (UID: \"c06828a4-039e-4080-a682-0bf5a7aaf9c2\") " Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.248449 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c06828a4-039e-4080-a682-0bf5a7aaf9c2-combined-ca-bundle\") pod \"c06828a4-039e-4080-a682-0bf5a7aaf9c2\" (UID: \"c06828a4-039e-4080-a682-0bf5a7aaf9c2\") " Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.248451 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/848fca26-246f-48f5-8f00-a41ecb239952-config-data-default" (OuterVolumeSpecName: "config-data-default") pod "848fca26-246f-48f5-8f00-a41ecb239952" (UID: "848fca26-246f-48f5-8f00-a41ecb239952"). InnerVolumeSpecName "config-data-default". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.248496 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/9698823e-0af0-4477-b47a-a388c6264dda-ovndb-tls-certs\") pod \"9698823e-0af0-4477-b47a-a388c6264dda\" (UID: \"9698823e-0af0-4477-b47a-a388c6264dda\") " Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.248518 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0d72ed4f-2b58-4e71-ada5-a06739dac8b2-operator-scripts\") pod \"0d72ed4f-2b58-4e71-ada5-a06739dac8b2\" (UID: \"0d72ed4f-2b58-4e71-ada5-a06739dac8b2\") " Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.248594 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/9698823e-0af0-4477-b47a-a388c6264dda-httpd-config\") pod \"9698823e-0af0-4477-b47a-a388c6264dda\" (UID: \"9698823e-0af0-4477-b47a-a388c6264dda\") " Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.248619 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"mysql-db\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"848fca26-246f-48f5-8f00-a41ecb239952\" (UID: \"848fca26-246f-48f5-8f00-a41ecb239952\") " Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.248642 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fx6t6\" (UniqueName: \"kubernetes.io/projected/c06828a4-039e-4080-a682-0bf5a7aaf9c2-kube-api-access-fx6t6\") pod \"c06828a4-039e-4080-a682-0bf5a7aaf9c2\" (UID: \"c06828a4-039e-4080-a682-0bf5a7aaf9c2\") " Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.248662 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hsp5v\" (UniqueName: \"kubernetes.io/projected/979c2589-0aa0-4e9c-8a97-9fd5a1676e64-kube-api-access-hsp5v\") pod \"979c2589-0aa0-4e9c-8a97-9fd5a1676e64\" (UID: \"979c2589-0aa0-4e9c-8a97-9fd5a1676e64\") " Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.248682 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8g9tn\" (UniqueName: \"kubernetes.io/projected/0d72ed4f-2b58-4e71-ada5-a06739dac8b2-kube-api-access-8g9tn\") pod \"0d72ed4f-2b58-4e71-ada5-a06739dac8b2\" (UID: \"0d72ed4f-2b58-4e71-ada5-a06739dac8b2\") " Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.248712 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/9698823e-0af0-4477-b47a-a388c6264dda-internal-tls-certs\") pod \"9698823e-0af0-4477-b47a-a388c6264dda\" (UID: \"9698823e-0af0-4477-b47a-a388c6264dda\") " Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.248793 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/979c2589-0aa0-4e9c-8a97-9fd5a1676e64-operator-scripts\") pod \"979c2589-0aa0-4e9c-8a97-9fd5a1676e64\" (UID: \"979c2589-0aa0-4e9c-8a97-9fd5a1676e64\") " Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.248814 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/848fca26-246f-48f5-8f00-a41ecb239952-operator-scripts\") pod \"848fca26-246f-48f5-8f00-a41ecb239952\" (UID: \"848fca26-246f-48f5-8f00-a41ecb239952\") " Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.248830 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wplp2\" (UniqueName: \"kubernetes.io/projected/848fca26-246f-48f5-8f00-a41ecb239952-kube-api-access-wplp2\") pod \"848fca26-246f-48f5-8f00-a41ecb239952\" (UID: \"848fca26-246f-48f5-8f00-a41ecb239952\") " Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.248876 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/848fca26-246f-48f5-8f00-a41ecb239952-config-data-generated\") pod \"848fca26-246f-48f5-8f00-a41ecb239952\" (UID: \"848fca26-246f-48f5-8f00-a41ecb239952\") " Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.248917 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9698823e-0af0-4477-b47a-a388c6264dda-combined-ca-bundle\") pod \"9698823e-0af0-4477-b47a-a388c6264dda\" (UID: \"9698823e-0af0-4477-b47a-a388c6264dda\") " Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.249035 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nj6t9\" (UniqueName: \"kubernetes.io/projected/23634501-dcbf-4b5f-a734-820f1959b54e-kube-api-access-nj6t9\") pod \"keystone-5fac-account-create-update-clvt8\" (UID: \"23634501-dcbf-4b5f-a734-820f1959b54e\") " pod="openstack-kuttl-tests/keystone-5fac-account-create-update-clvt8" Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.249043 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6cf8b665-920c-4d82-92eb-508d6ca3e9a1-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "6cf8b665-920c-4d82-92eb-508d6ca3e9a1" (UID: "6cf8b665-920c-4d82-92eb-508d6ca3e9a1"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.249183 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/23634501-dcbf-4b5f-a734-820f1959b54e-operator-scripts\") pod \"keystone-5fac-account-create-update-clvt8\" (UID: \"23634501-dcbf-4b5f-a734-820f1959b54e\") " pod="openstack-kuttl-tests/keystone-5fac-account-create-update-clvt8" Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.251615 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/848fca26-246f-48f5-8f00-a41ecb239952-config-data-default\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.251637 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/6cf8b665-920c-4d82-92eb-508d6ca3e9a1-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:03 crc kubenswrapper[5120]: E0316 16:18:03.251687 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Mar 16 16:18:03 crc kubenswrapper[5120]: E0316 16:18:03.251730 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/23634501-dcbf-4b5f-a734-820f1959b54e-operator-scripts podName:23634501-dcbf-4b5f-a734-820f1959b54e nodeName:}" failed. No retries permitted until 2026-03-16 16:18:04.251715738 +0000 UTC m=+2786.405647395 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/23634501-dcbf-4b5f-a734-820f1959b54e-operator-scripts") pod "keystone-5fac-account-create-update-clvt8" (UID: "23634501-dcbf-4b5f-a734-820f1959b54e") : configmap "openstack-scripts" not found Mar 16 16:18:03 crc kubenswrapper[5120]: E0316 16:18:03.252086 5120 projected.go:194] Error preparing data for projected volume kube-api-access-nj6t9 for pod openstack-kuttl-tests/keystone-5fac-account-create-update-clvt8: failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.252107 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c06828a4-039e-4080-a682-0bf5a7aaf9c2-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "c06828a4-039e-4080-a682-0bf5a7aaf9c2" (UID: "c06828a4-039e-4080-a682-0bf5a7aaf9c2"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:18:03 crc kubenswrapper[5120]: E0316 16:18:03.252901 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/23634501-dcbf-4b5f-a734-820f1959b54e-kube-api-access-nj6t9 podName:23634501-dcbf-4b5f-a734-820f1959b54e nodeName:}" failed. No retries permitted until 2026-03-16 16:18:04.25288125 +0000 UTC m=+2786.406812907 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-nj6t9" (UniqueName: "kubernetes.io/projected/23634501-dcbf-4b5f-a734-820f1959b54e-kube-api-access-nj6t9") pod "keystone-5fac-account-create-update-clvt8" (UID: "23634501-dcbf-4b5f-a734-820f1959b54e") : failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.253600 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/848fca26-246f-48f5-8f00-a41ecb239952-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "848fca26-246f-48f5-8f00-a41ecb239952" (UID: "848fca26-246f-48f5-8f00-a41ecb239952"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.255313 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/848fca26-246f-48f5-8f00-a41ecb239952-config-data-generated" (OuterVolumeSpecName: "config-data-generated") pod "848fca26-246f-48f5-8f00-a41ecb239952" (UID: "848fca26-246f-48f5-8f00-a41ecb239952"). InnerVolumeSpecName "config-data-generated". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.255325 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/979c2589-0aa0-4e9c-8a97-9fd5a1676e64-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "979c2589-0aa0-4e9c-8a97-9fd5a1676e64" (UID: "979c2589-0aa0-4e9c-8a97-9fd5a1676e64"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.259232 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/848fca26-246f-48f5-8f00-a41ecb239952-kube-api-access-wplp2" (OuterVolumeSpecName: "kube-api-access-wplp2") pod "848fca26-246f-48f5-8f00-a41ecb239952" (UID: "848fca26-246f-48f5-8f00-a41ecb239952"). InnerVolumeSpecName "kube-api-access-wplp2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.262082 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d72ed4f-2b58-4e71-ada5-a06739dac8b2-kube-api-access-8g9tn" (OuterVolumeSpecName: "kube-api-access-8g9tn") pod "0d72ed4f-2b58-4e71-ada5-a06739dac8b2" (UID: "0d72ed4f-2b58-4e71-ada5-a06739dac8b2"). InnerVolumeSpecName "kube-api-access-8g9tn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.263590 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9698823e-0af0-4477-b47a-a388c6264dda-httpd-config" (OuterVolumeSpecName: "httpd-config") pod "9698823e-0af0-4477-b47a-a388c6264dda" (UID: "9698823e-0af0-4477-b47a-a388c6264dda"). InnerVolumeSpecName "httpd-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.263924 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d72ed4f-2b58-4e71-ada5-a06739dac8b2-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "0d72ed4f-2b58-4e71-ada5-a06739dac8b2" (UID: "0d72ed4f-2b58-4e71-ada5-a06739dac8b2"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.265324 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9698823e-0af0-4477-b47a-a388c6264dda-kube-api-access-5pzdk" (OuterVolumeSpecName: "kube-api-access-5pzdk") pod "9698823e-0af0-4477-b47a-a388c6264dda" (UID: "9698823e-0af0-4477-b47a-a388c6264dda"). InnerVolumeSpecName "kube-api-access-5pzdk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.265906 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c06828a4-039e-4080-a682-0bf5a7aaf9c2-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "c06828a4-039e-4080-a682-0bf5a7aaf9c2" (UID: "c06828a4-039e-4080-a682-0bf5a7aaf9c2"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.268507 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6cf8b665-920c-4d82-92eb-508d6ca3e9a1-kube-api-access-9s8bd" (OuterVolumeSpecName: "kube-api-access-9s8bd") pod "6cf8b665-920c-4d82-92eb-508d6ca3e9a1" (UID: "6cf8b665-920c-4d82-92eb-508d6ca3e9a1"). InnerVolumeSpecName "kube-api-access-9s8bd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.270615 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/979c2589-0aa0-4e9c-8a97-9fd5a1676e64-kube-api-access-hsp5v" (OuterVolumeSpecName: "kube-api-access-hsp5v") pod "979c2589-0aa0-4e9c-8a97-9fd5a1676e64" (UID: "979c2589-0aa0-4e9c-8a97-9fd5a1676e64"). InnerVolumeSpecName "kube-api-access-hsp5v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.273157 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/848fca26-246f-48f5-8f00-a41ecb239952-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "848fca26-246f-48f5-8f00-a41ecb239952" (UID: "848fca26-246f-48f5-8f00-a41ecb239952"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.273353 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c06828a4-039e-4080-a682-0bf5a7aaf9c2-kube-api-access-fx6t6" (OuterVolumeSpecName: "kube-api-access-fx6t6") pod "c06828a4-039e-4080-a682-0bf5a7aaf9c2" (UID: "c06828a4-039e-4080-a682-0bf5a7aaf9c2"). InnerVolumeSpecName "kube-api-access-fx6t6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.279239 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c06828a4-039e-4080-a682-0bf5a7aaf9c2-etc-swift" (OuterVolumeSpecName: "etc-swift") pod "c06828a4-039e-4080-a682-0bf5a7aaf9c2" (UID: "c06828a4-039e-4080-a682-0bf5a7aaf9c2"). InnerVolumeSpecName "etc-swift". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.294023 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561298-6qsf7" event={"ID":"e4cb4b19-5e1d-4cb5-8cc1-e51c0b445e06","Type":"ContainerStarted","Data":"9012264b8936dd5c90296e7aa7d5735e9f8e13d137b9feea90b8c5fc7d8da049"} Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.296216 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"fb13a989-3fee-4cd9-97d4-e68371891b6b","Type":"ContainerDied","Data":"c5a33ec73250ca09d3b111e20956d6d079261017144eb3dd578cab4c4b533e36"} Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.296264 5120 scope.go:117] "RemoveContainer" containerID="02d26c01c0add7af45d27551c127315970f580e97920c2b887ce397fd67a99cf" Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.296286 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.301973 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage02-crc" (OuterVolumeSpecName: "mysql-db") pod "848fca26-246f-48f5-8f00-a41ecb239952" (UID: "848fca26-246f-48f5-8f00-a41ecb239952"). InnerVolumeSpecName "local-storage02-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.302208 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-39eb-account-create-update-tnz8p" event={"ID":"0d72ed4f-2b58-4e71-ada5-a06739dac8b2","Type":"ContainerDied","Data":"68258a1f77c1ed7b37e32470c33913b9b4625c7c547b769b102cad784a0d8a73"} Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.302219 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-39eb-account-create-update-tnz8p" Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.303936 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"d73ebf72-269e-4ebf-86b6-2d517ce8881a","Type":"ContainerDied","Data":"515662ef71e91e532e24d0c8d65028fe03b5519ac49d1a8cc8af9840ea05b280"} Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.305552 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.308094 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-e3fe-account-create-update-dgd59" event={"ID":"979c2589-0aa0-4e9c-8a97-9fd5a1676e64","Type":"ContainerDied","Data":"3dcef1e52f5a3fe01fbbce40f12e3460f264aa432d60e7fe46d8cb526104b359"} Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.308198 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-e3fe-account-create-update-dgd59" Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.310803 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-347f-account-create-update-kvc8k" event={"ID":"6cf8b665-920c-4d82-92eb-508d6ca3e9a1","Type":"ContainerDied","Data":"8a3b6d8507370d8e2f4199111b5d4a03d12a303a718a8221b024aed580f9eb02"} Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.310900 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-347f-account-create-update-kvc8k" Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.314635 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-7c79cc45b-sp9b7" event={"ID":"c06828a4-039e-4080-a682-0bf5a7aaf9c2","Type":"ContainerDied","Data":"4761f3928e0d8a4d4f57996ffc9e16e0fdf830eaf56e2dd64b0459206bc31b71"} Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.314721 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-7c79cc45b-sp9b7" Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.319778 5120 generic.go:358] "Generic (PLEG): container finished" podID="1b59d8b3-3000-4e61-8e3c-50df40fc5181" containerID="f8f27d1c83638d0fcabbe5c220bd622f1bb404a1a0701d2905d1bb94f79658f5" exitCode=0 Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.319882 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-4w76w" event={"ID":"1b59d8b3-3000-4e61-8e3c-50df40fc5181","Type":"ContainerDied","Data":"f8f27d1c83638d0fcabbe5c220bd622f1bb404a1a0701d2905d1bb94f79658f5"} Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.319905 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-4w76w" event={"ID":"1b59d8b3-3000-4e61-8e3c-50df40fc5181","Type":"ContainerStarted","Data":"22775bb5a4450f5b32c1502faed7b8606af805e3a0a4c3143d5f25a68739346d"} Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.323421 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-9c08-account-create-update-w7m2p" event={"ID":"70f64346-8cba-4ea9-b229-c1ba5012ca42","Type":"ContainerStarted","Data":"09fdc01ca0949c390f4075dced7cf3575be78f9059bd474ba716019d43e4c5c6"} Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.326732 5120 scope.go:117] "RemoveContainer" containerID="55aacccfe83493c2807259e063c3f528093cf68eb2ea222aec83b143462b6a75" Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.335519 5120 generic.go:358] "Generic (PLEG): container finished" podID="90982d87-fc0f-49d0-a400-4155e4f3b000" containerID="6bd6e439036f2cf71848ab77929e2541ab683472c7163b47058922e907b978d2" exitCode=1 Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.336110 5120 kubelet_pods.go:1019] "Unable to retrieve pull secret, the image pull may not succeed." pod="openstack-kuttl-tests/root-account-create-update-bh8f4" secret="" err="secret \"galera-openstack-dockercfg-5lqvh\" not found" Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.336146 5120 scope.go:117] "RemoveContainer" containerID="6bd6e439036f2cf71848ab77929e2541ab683472c7163b47058922e907b978d2" Mar 16 16:18:03 crc kubenswrapper[5120]: E0316 16:18:03.336454 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"mariadb-account-create-update\" with CrashLoopBackOff: \"back-off 10s restarting failed container=mariadb-account-create-update pod=root-account-create-update-bh8f4_openstack-kuttl-tests(90982d87-fc0f-49d0-a400-4155e4f3b000)\"" pod="openstack-kuttl-tests/root-account-create-update-bh8f4" podUID="90982d87-fc0f-49d0-a400-4155e4f3b000" Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.336712 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-bh8f4" event={"ID":"90982d87-fc0f-49d0-a400-4155e4f3b000","Type":"ContainerDied","Data":"6bd6e439036f2cf71848ab77929e2541ab683472c7163b47058922e907b978d2"} Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.338066 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9698823e-0af0-4477-b47a-a388c6264dda-config" (OuterVolumeSpecName: "config") pod "9698823e-0af0-4477-b47a-a388c6264dda" (UID: "9698823e-0af0-4477-b47a-a388c6264dda"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.346676 5120 generic.go:358] "Generic (PLEG): container finished" podID="848fca26-246f-48f5-8f00-a41ecb239952" containerID="c758fe75eb30010d3898ba0e46464704f4eaccdb5721a29379189ee1664975df" exitCode=0 Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.346901 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.346824 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"848fca26-246f-48f5-8f00-a41ecb239952","Type":"ContainerDied","Data":"c758fe75eb30010d3898ba0e46464704f4eaccdb5721a29379189ee1664975df"} Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.347216 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"848fca26-246f-48f5-8f00-a41ecb239952","Type":"ContainerDied","Data":"8154531de0917e89dad3ddad5cf829da3b6011299e7c5d3e48ee19fbdf3df7eb"} Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.355626 5120 reconciler_common.go:299] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/848fca26-246f-48f5-8f00-a41ecb239952-kolla-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.355655 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0d72ed4f-2b58-4e71-ada5-a06739dac8b2-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.355664 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/9698823e-0af0-4477-b47a-a388c6264dda-httpd-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.355686 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") on node \"crc\" " Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.355696 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fx6t6\" (UniqueName: \"kubernetes.io/projected/c06828a4-039e-4080-a682-0bf5a7aaf9c2-kube-api-access-fx6t6\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.355706 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hsp5v\" (UniqueName: \"kubernetes.io/projected/979c2589-0aa0-4e9c-8a97-9fd5a1676e64-kube-api-access-hsp5v\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.355715 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8g9tn\" (UniqueName: \"kubernetes.io/projected/0d72ed4f-2b58-4e71-ada5-a06739dac8b2-kube-api-access-8g9tn\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.355723 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/979c2589-0aa0-4e9c-8a97-9fd5a1676e64-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.355733 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/848fca26-246f-48f5-8f00-a41ecb239952-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.355741 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wplp2\" (UniqueName: \"kubernetes.io/projected/848fca26-246f-48f5-8f00-a41ecb239952-kube-api-access-wplp2\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.355750 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/848fca26-246f-48f5-8f00-a41ecb239952-config-data-generated\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.355774 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/9698823e-0af0-4477-b47a-a388c6264dda-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.355782 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5pzdk\" (UniqueName: \"kubernetes.io/projected/9698823e-0af0-4477-b47a-a388c6264dda-kube-api-access-5pzdk\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.355791 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c06828a4-039e-4080-a682-0bf5a7aaf9c2-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.355800 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9s8bd\" (UniqueName: \"kubernetes.io/projected/6cf8b665-920c-4d82-92eb-508d6ca3e9a1-kube-api-access-9s8bd\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.355808 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c06828a4-039e-4080-a682-0bf5a7aaf9c2-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.355816 5120 reconciler_common.go:299] "Volume detached for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/c06828a4-039e-4080-a682-0bf5a7aaf9c2-etc-swift\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.356789 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c06828a4-039e-4080-a682-0bf5a7aaf9c2-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "c06828a4-039e-4080-a682-0bf5a7aaf9c2" (UID: "c06828a4-039e-4080-a682-0bf5a7aaf9c2"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.365912 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"ead61fcf-891a-44f3-8867-a2adcf744d69","Type":"ContainerDied","Data":"d251b0429da624062362d8f63ad78aba4ba2e5f930e45f5add820cdf106863fd"} Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.368972 5120 generic.go:358] "Generic (PLEG): container finished" podID="ead61fcf-891a-44f3-8867-a2adcf744d69" containerID="d251b0429da624062362d8f63ad78aba4ba2e5f930e45f5add820cdf106863fd" exitCode=0 Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.373430 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9698823e-0af0-4477-b47a-a388c6264dda-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "9698823e-0af0-4477-b47a-a388c6264dda" (UID: "9698823e-0af0-4477-b47a-a388c6264dda"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.373679 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.388873 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.392933 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9698823e-0af0-4477-b47a-a388c6264dda-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "9698823e-0af0-4477-b47a-a388c6264dda" (UID: "9698823e-0af0-4477-b47a-a388c6264dda"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.393661 5120 scope.go:117] "RemoveContainer" containerID="b95fea81e244713a6300e6ead4faf992fc23c53c8f23c0486269773f1cf284c5" Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.396816 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/848fca26-246f-48f5-8f00-a41ecb239952-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "848fca26-246f-48f5-8f00-a41ecb239952" (UID: "848fca26-246f-48f5-8f00-a41ecb239952"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.404173 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-d8b74df76-z7648" Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.404490 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-d8b74df76-z7648" event={"ID":"9698823e-0af0-4477-b47a-a388c6264dda","Type":"ContainerDied","Data":"51ef4c7e3e0dc3d7b67115fda2c5e6d516da517af01fe5c37d48fabfd8112d2b"} Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.404094 5120 generic.go:358] "Generic (PLEG): container finished" podID="9698823e-0af0-4477-b47a-a388c6264dda" containerID="51ef4c7e3e0dc3d7b67115fda2c5e6d516da517af01fe5c37d48fabfd8112d2b" exitCode=0 Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.409295 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-d8b74df76-z7648" event={"ID":"9698823e-0af0-4477-b47a-a388c6264dda","Type":"ContainerDied","Data":"6f87c95dbbec0e10f1c7f28e7fb03bb68c90ac680d5abe9466ffa371a17a0c5c"} Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.409409 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-5fac-account-create-update-clvt8" Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.411753 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-39eb-account-create-update-tnz8p"] Mar 16 16:18:03 crc kubenswrapper[5120]: E0316 16:18:03.412434 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a1f5e797b52c263768103f57dc958a68929e1eaed737a81298570c479cbfd478" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:18:03 crc kubenswrapper[5120]: E0316 16:18:03.416565 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a1f5e797b52c263768103f57dc958a68929e1eaed737a81298570c479cbfd478" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.419165 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-39eb-account-create-update-tnz8p"] Mar 16 16:18:03 crc kubenswrapper[5120]: E0316 16:18:03.423357 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a1f5e797b52c263768103f57dc958a68929e1eaed737a81298570c479cbfd478" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:18:03 crc kubenswrapper[5120]: E0316 16:18:03.423405 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="3f5ad605-f6ee-47e9-a2b6-43e60f01c4c9" containerName="nova-scheduler-scheduler" probeResult="unknown" Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.425995 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-5fac-account-create-update-clvt8" Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.442174 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c06828a4-039e-4080-a682-0bf5a7aaf9c2-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "c06828a4-039e-4080-a682-0bf5a7aaf9c2" (UID: "c06828a4-039e-4080-a682-0bf5a7aaf9c2"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.446595 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage02-crc" (UniqueName: "kubernetes.io/local-volume/local-storage02-crc") on node "crc" Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.451591 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c06828a4-039e-4080-a682-0bf5a7aaf9c2-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "c06828a4-039e-4080-a682-0bf5a7aaf9c2" (UID: "c06828a4-039e-4080-a682-0bf5a7aaf9c2"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:18:03 crc kubenswrapper[5120]: E0316 16:18:03.461619 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 16:18:03 crc kubenswrapper[5120]: E0316 16:18:03.461702 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4885bea5-bdc7-472b-8f70-e110dd9b8c06-combined-ca-bundle podName:4885bea5-bdc7-472b-8f70-e110dd9b8c06 nodeName:}" failed. No retries permitted until 2026-03-16 16:18:07.461682536 +0000 UTC m=+2789.615614193 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/4885bea5-bdc7-472b-8f70-e110dd9b8c06-combined-ca-bundle") pod "openstack-galera-0" (UID: "4885bea5-bdc7-472b-8f70-e110dd9b8c06") : secret "combined-ca-bundle" not found Mar 16 16:18:03 crc kubenswrapper[5120]: E0316 16:18:03.461916 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Mar 16 16:18:03 crc kubenswrapper[5120]: E0316 16:18:03.461992 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/90982d87-fc0f-49d0-a400-4155e4f3b000-operator-scripts podName:90982d87-fc0f-49d0-a400-4155e4f3b000 nodeName:}" failed. No retries permitted until 2026-03-16 16:18:03.961970823 +0000 UTC m=+2786.115902560 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/90982d87-fc0f-49d0-a400-4155e4f3b000-operator-scripts") pod "root-account-create-update-bh8f4" (UID: "90982d87-fc0f-49d0-a400-4155e4f3b000") : configmap "openstack-scripts" not found Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.465970 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.466201 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9698823e-0af0-4477-b47a-a388c6264dda-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "9698823e-0af0-4477-b47a-a388c6264dda" (UID: "9698823e-0af0-4477-b47a-a388c6264dda"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:18:03 crc kubenswrapper[5120]: E0316 16:18:03.467061 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-galera-openstack-svc: secret "cert-galera-openstack-svc" not found Mar 16 16:18:03 crc kubenswrapper[5120]: E0316 16:18:03.467708 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4885bea5-bdc7-472b-8f70-e110dd9b8c06-galera-tls-certs podName:4885bea5-bdc7-472b-8f70-e110dd9b8c06 nodeName:}" failed. No retries permitted until 2026-03-16 16:18:07.467689887 +0000 UTC m=+2789.621621544 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "galera-tls-certs" (UniqueName: "kubernetes.io/secret/4885bea5-bdc7-472b-8f70-e110dd9b8c06-galera-tls-certs") pod "openstack-galera-0" (UID: "4885bea5-bdc7-472b-8f70-e110dd9b8c06") : secret "cert-galera-openstack-svc" not found Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.468120 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9698823e-0af0-4477-b47a-a388c6264dda-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.468135 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/9698823e-0af0-4477-b47a-a388c6264dda-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.468146 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/c06828a4-039e-4080-a682-0bf5a7aaf9c2-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.468155 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/848fca26-246f-48f5-8f00-a41ecb239952-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.468164 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/c06828a4-039e-4080-a682-0bf5a7aaf9c2-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.468174 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c06828a4-039e-4080-a682-0bf5a7aaf9c2-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.468182 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.468198 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/9698823e-0af0-4477-b47a-a388c6264dda-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:03 crc kubenswrapper[5120]: E0316 16:18:03.468241 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-config-data: configmap "rabbitmq-config-data" not found Mar 16 16:18:03 crc kubenswrapper[5120]: E0316 16:18:03.468265 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/51d5f0da-bcbc-492e-ab39-6189dc22fa22-config-data podName:51d5f0da-bcbc-492e-ab39-6189dc22fa22 nodeName:}" failed. No retries permitted until 2026-03-16 16:18:07.468257972 +0000 UTC m=+2789.622189629 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/51d5f0da-bcbc-492e-ab39-6189dc22fa22-config-data") pod "rabbitmq-server-0" (UID: "51d5f0da-bcbc-492e-ab39-6189dc22fa22") : configmap "rabbitmq-config-data" not found Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.476955 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.522213 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.523273 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/848fca26-246f-48f5-8f00-a41ecb239952-galera-tls-certs" (OuterVolumeSpecName: "galera-tls-certs") pod "848fca26-246f-48f5-8f00-a41ecb239952" (UID: "848fca26-246f-48f5-8f00-a41ecb239952"). InnerVolumeSpecName "galera-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.552656 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c06828a4-039e-4080-a682-0bf5a7aaf9c2-config-data" (OuterVolumeSpecName: "config-data") pod "c06828a4-039e-4080-a682-0bf5a7aaf9c2" (UID: "c06828a4-039e-4080-a682-0bf5a7aaf9c2"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.552727 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-347f-account-create-update-kvc8k"] Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.554385 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9698823e-0af0-4477-b47a-a388c6264dda-ovndb-tls-certs" (OuterVolumeSpecName: "ovndb-tls-certs") pod "9698823e-0af0-4477-b47a-a388c6264dda" (UID: "9698823e-0af0-4477-b47a-a388c6264dda"). InnerVolumeSpecName "ovndb-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.558555 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-347f-account-create-update-kvc8k"] Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.564389 5120 scope.go:117] "RemoveContainer" containerID="d7fad27bd78b15e804b67e664c292c55fa7faee0c6fb07e878bcb9e536052264" Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.569028 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/ead61fcf-891a-44f3-8867-a2adcf744d69-kolla-config\") pod \"ead61fcf-891a-44f3-8867-a2adcf744d69\" (UID: \"ead61fcf-891a-44f3-8867-a2adcf744d69\") " Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.569182 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mbdcx\" (UniqueName: \"kubernetes.io/projected/ead61fcf-891a-44f3-8867-a2adcf744d69-kube-api-access-mbdcx\") pod \"ead61fcf-891a-44f3-8867-a2adcf744d69\" (UID: \"ead61fcf-891a-44f3-8867-a2adcf744d69\") " Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.569229 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/ead61fcf-891a-44f3-8867-a2adcf744d69-memcached-tls-certs\") pod \"ead61fcf-891a-44f3-8867-a2adcf744d69\" (UID: \"ead61fcf-891a-44f3-8867-a2adcf744d69\") " Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.569352 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/ead61fcf-891a-44f3-8867-a2adcf744d69-config-data\") pod \"ead61fcf-891a-44f3-8867-a2adcf744d69\" (UID: \"ead61fcf-891a-44f3-8867-a2adcf744d69\") " Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.569642 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ead61fcf-891a-44f3-8867-a2adcf744d69-combined-ca-bundle\") pod \"ead61fcf-891a-44f3-8867-a2adcf744d69\" (UID: \"ead61fcf-891a-44f3-8867-a2adcf744d69\") " Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.570258 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-e3fe-account-create-update-dgd59"] Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.570958 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ead61fcf-891a-44f3-8867-a2adcf744d69-config-data" (OuterVolumeSpecName: "config-data") pod "ead61fcf-891a-44f3-8867-a2adcf744d69" (UID: "ead61fcf-891a-44f3-8867-a2adcf744d69"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.571014 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ead61fcf-891a-44f3-8867-a2adcf744d69-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "ead61fcf-891a-44f3-8867-a2adcf744d69" (UID: "ead61fcf-891a-44f3-8867-a2adcf744d69"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.571456 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c06828a4-039e-4080-a682-0bf5a7aaf9c2-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.571471 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/ead61fcf-891a-44f3-8867-a2adcf744d69-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.571480 5120 reconciler_common.go:299] "Volume detached for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/848fca26-246f-48f5-8f00-a41ecb239952-galera-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.571492 5120 reconciler_common.go:299] "Volume detached for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/9698823e-0af0-4477-b47a-a388c6264dda-ovndb-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.571501 5120 reconciler_common.go:299] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/ead61fcf-891a-44f3-8867-a2adcf744d69-kolla-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.574292 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ead61fcf-891a-44f3-8867-a2adcf744d69-kube-api-access-mbdcx" (OuterVolumeSpecName: "kube-api-access-mbdcx") pod "ead61fcf-891a-44f3-8867-a2adcf744d69" (UID: "ead61fcf-891a-44f3-8867-a2adcf744d69"). InnerVolumeSpecName "kube-api-access-mbdcx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.575878 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-e3fe-account-create-update-dgd59"] Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.616738 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ead61fcf-891a-44f3-8867-a2adcf744d69-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ead61fcf-891a-44f3-8867-a2adcf744d69" (UID: "ead61fcf-891a-44f3-8867-a2adcf744d69"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.638665 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/cinder-api-0" podUID="60fe13eb-066c-4985-bb16-1a201e5c339c" containerName="cinder-api" probeResult="failure" output="Get \"https://10.217.0.230:8776/healthcheck\": read tcp 10.217.0.2:38070->10.217.0.230:8776: read: connection reset by peer" Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.665811 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ead61fcf-891a-44f3-8867-a2adcf744d69-memcached-tls-certs" (OuterVolumeSpecName: "memcached-tls-certs") pod "ead61fcf-891a-44f3-8867-a2adcf744d69" (UID: "ead61fcf-891a-44f3-8867-a2adcf744d69"). InnerVolumeSpecName "memcached-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.673120 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ead61fcf-891a-44f3-8867-a2adcf744d69-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.673229 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mbdcx\" (UniqueName: \"kubernetes.io/projected/ead61fcf-891a-44f3-8867-a2adcf744d69-kube-api-access-mbdcx\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:03 crc kubenswrapper[5120]: I0316 16:18:03.673286 5120 reconciler_common.go:299] "Volume detached for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/ead61fcf-891a-44f3-8867-a2adcf744d69-memcached-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:03 crc kubenswrapper[5120]: E0316 16:18:03.886118 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="e97ac48130213536a9b9b0d15722b762acfe6f81aabde1c8b9c64553d53ec8c7" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:18:03 crc kubenswrapper[5120]: E0316 16:18:03.889219 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="e97ac48130213536a9b9b0d15722b762acfe6f81aabde1c8b9c64553d53ec8c7" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:18:03 crc kubenswrapper[5120]: E0316 16:18:03.891432 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="e97ac48130213536a9b9b0d15722b762acfe6f81aabde1c8b9c64553d53ec8c7" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:18:03 crc kubenswrapper[5120]: E0316 16:18:03.891473 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="e73bdb2c-01bf-4eca-93df-22b051fee769" containerName="nova-cell1-conductor-conductor" probeResult="unknown" Mar 16 16:18:03 crc kubenswrapper[5120]: E0316 16:18:03.982477 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Mar 16 16:18:03 crc kubenswrapper[5120]: E0316 16:18:03.982880 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/90982d87-fc0f-49d0-a400-4155e4f3b000-operator-scripts podName:90982d87-fc0f-49d0-a400-4155e4f3b000 nodeName:}" failed. No retries permitted until 2026-03-16 16:18:04.982857583 +0000 UTC m=+2787.136789330 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/90982d87-fc0f-49d0-a400-4155e4f3b000-operator-scripts") pod "root-account-create-update-bh8f4" (UID: "90982d87-fc0f-49d0-a400-4155e4f3b000") : configmap "openstack-scripts" not found Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.253356 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-796f4f9644-59hlg" podUID="9f16b3a2-bc26-4a63-8f8c-836611f0d320" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.0.229:9311/healthcheck\": read tcp 10.217.0.2:48318->10.217.0.229:9311: read: connection reset by peer" Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.291359 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nj6t9\" (UniqueName: \"kubernetes.io/projected/23634501-dcbf-4b5f-a734-820f1959b54e-kube-api-access-nj6t9\") pod \"keystone-5fac-account-create-update-clvt8\" (UID: \"23634501-dcbf-4b5f-a734-820f1959b54e\") " pod="openstack-kuttl-tests/keystone-5fac-account-create-update-clvt8" Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.291445 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/23634501-dcbf-4b5f-a734-820f1959b54e-operator-scripts\") pod \"keystone-5fac-account-create-update-clvt8\" (UID: \"23634501-dcbf-4b5f-a734-820f1959b54e\") " pod="openstack-kuttl-tests/keystone-5fac-account-create-update-clvt8" Mar 16 16:18:04 crc kubenswrapper[5120]: E0316 16:18:04.291676 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Mar 16 16:18:04 crc kubenswrapper[5120]: E0316 16:18:04.291726 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/23634501-dcbf-4b5f-a734-820f1959b54e-operator-scripts podName:23634501-dcbf-4b5f-a734-820f1959b54e nodeName:}" failed. No retries permitted until 2026-03-16 16:18:06.291712221 +0000 UTC m=+2788.445643878 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/23634501-dcbf-4b5f-a734-820f1959b54e-operator-scripts") pod "keystone-5fac-account-create-update-clvt8" (UID: "23634501-dcbf-4b5f-a734-820f1959b54e") : configmap "openstack-scripts" not found Mar 16 16:18:04 crc kubenswrapper[5120]: E0316 16:18:04.294512 5120 projected.go:194] Error preparing data for projected volume kube-api-access-nj6t9 for pod openstack-kuttl-tests/keystone-5fac-account-create-update-clvt8: failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 16:18:04 crc kubenswrapper[5120]: E0316 16:18:04.294550 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/23634501-dcbf-4b5f-a734-820f1959b54e-kube-api-access-nj6t9 podName:23634501-dcbf-4b5f-a734-820f1959b54e nodeName:}" failed. No retries permitted until 2026-03-16 16:18:06.294538756 +0000 UTC m=+2788.448470413 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-nj6t9" (UniqueName: "kubernetes.io/projected/23634501-dcbf-4b5f-a734-820f1959b54e-kube-api-access-nj6t9") pod "keystone-5fac-account-create-update-clvt8" (UID: "23634501-dcbf-4b5f-a734-820f1959b54e") : failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.424040 5120 scope.go:117] "RemoveContainer" containerID="46f6c0f40f4dd4a16ffce3878f6cf6ade2206957a9e4f6824def88db1fdb2279" Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.427647 5120 generic.go:358] "Generic (PLEG): container finished" podID="9e7f8135-737c-4639-bdd8-46d68e1a617d" containerID="4423760983d234cf89f326a9ce253676e3e6b0c280a356f96097c3c830d8ad07" exitCode=0 Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.427738 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"9e7f8135-737c-4639-bdd8-46d68e1a617d","Type":"ContainerDied","Data":"4423760983d234cf89f326a9ce253676e3e6b0c280a356f96097c3c830d8ad07"} Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.429022 5120 generic.go:358] "Generic (PLEG): container finished" podID="3fe73309-f917-40c4-a606-511f1547daf4" containerID="3c1dc0476ec152189cd9cccaa8817bd8c79eb785cc5a85c7a89fc21e075d9c23" exitCode=0 Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.429070 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-77f5d87454-bxpdp" event={"ID":"3fe73309-f917-40c4-a606-511f1547daf4","Type":"ContainerDied","Data":"3c1dc0476ec152189cd9cccaa8817bd8c79eb785cc5a85c7a89fc21e075d9c23"} Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.435849 5120 generic.go:358] "Generic (PLEG): container finished" podID="9292b258-885b-40a8-8b7d-9ed28a747bc7" containerID="f19f6e35585d519c6c4887128e22a173629daff0e73ecce16798b83d694eb56d" exitCode=0 Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.435980 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"9292b258-885b-40a8-8b7d-9ed28a747bc7","Type":"ContainerDied","Data":"f19f6e35585d519c6c4887128e22a173629daff0e73ecce16798b83d694eb56d"} Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.449314 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-northd-0_43c58ec7-474a-49bc-921f-89cf47b67811/ovn-northd/0.log" Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.449339 5120 generic.go:358] "Generic (PLEG): container finished" podID="43c58ec7-474a-49bc-921f-89cf47b67811" containerID="91983d4216ebe44a593c5fc4a07bcf3d059ad912a84a5035330dd9bd796a595d" exitCode=139 Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.449379 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"43c58ec7-474a-49bc-921f-89cf47b67811","Type":"ContainerDied","Data":"91983d4216ebe44a593c5fc4a07bcf3d059ad912a84a5035330dd9bd796a595d"} Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.451155 5120 generic.go:358] "Generic (PLEG): container finished" podID="60fe13eb-066c-4985-bb16-1a201e5c339c" containerID="c3d6d0476f8615371dfec590da87aa17915191fd8befb1ec3bcb8fe489ed8d5c" exitCode=0 Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.451210 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"60fe13eb-066c-4985-bb16-1a201e5c339c","Type":"ContainerDied","Data":"c3d6d0476f8615371dfec590da87aa17915191fd8befb1ec3bcb8fe489ed8d5c"} Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.452720 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-9c08-account-create-update-w7m2p" event={"ID":"70f64346-8cba-4ea9-b229-c1ba5012ca42","Type":"ContainerDied","Data":"09fdc01ca0949c390f4075dced7cf3575be78f9059bd474ba716019d43e4c5c6"} Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.452743 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="09fdc01ca0949c390f4075dced7cf3575be78f9059bd474ba716019d43e4c5c6" Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.457816 5120 generic.go:358] "Generic (PLEG): container finished" podID="9f16b3a2-bc26-4a63-8f8c-836611f0d320" containerID="cebcd6329c9e1b957b3f4bffa93b5a65003bd9fd06134f8e8d62306f23ec1220" exitCode=0 Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.457978 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-796f4f9644-59hlg" event={"ID":"9f16b3a2-bc26-4a63-8f8c-836611f0d320","Type":"ContainerDied","Data":"cebcd6329c9e1b957b3f4bffa93b5a65003bd9fd06134f8e8d62306f23ec1220"} Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.460512 5120 generic.go:358] "Generic (PLEG): container finished" podID="7e059927-938d-4449-a260-90053be70ec9" containerID="e38ea22442a3e5da16488296d5a4582eb3a1ae936d22b1e4246f21d7c1a26d34" exitCode=0 Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.460710 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-5bfb7678f9-6dzmx" event={"ID":"7e059927-938d-4449-a260-90053be70ec9","Type":"ContainerDied","Data":"e38ea22442a3e5da16488296d5a4582eb3a1ae936d22b1e4246f21d7c1a26d34"} Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.463313 5120 generic.go:358] "Generic (PLEG): container finished" podID="044996b4-e444-4486-9503-61d776ec849f" containerID="8e88512fc32d8a4ecf18ca4d49876068a8159a6a0e0b4a45be98703daa80d90d" exitCode=0 Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.463409 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"044996b4-e444-4486-9503-61d776ec849f","Type":"ContainerDied","Data":"8e88512fc32d8a4ecf18ca4d49876068a8159a6a0e0b4a45be98703daa80d90d"} Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.465214 5120 generic.go:358] "Generic (PLEG): container finished" podID="b2e8d0e9-fa13-49fc-b149-af0d8d1d5ef0" containerID="39998592854bf56ef9997d1b6241d034080c653045712cd7dd3cecb1c338b3b5" exitCode=0 Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.465284 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-cbf797d74-8frg4" event={"ID":"b2e8d0e9-fa13-49fc-b149-af0d8d1d5ef0","Type":"ContainerDied","Data":"39998592854bf56ef9997d1b6241d034080c653045712cd7dd3cecb1c338b3b5"} Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.465314 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-cbf797d74-8frg4" event={"ID":"b2e8d0e9-fa13-49fc-b149-af0d8d1d5ef0","Type":"ContainerDied","Data":"2d5a95850013c417952bd349e0e34ec10a5acd281a53c3aef855d2eb411dc9ed"} Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.465323 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2d5a95850013c417952bd349e0e34ec10a5acd281a53c3aef855d2eb411dc9ed" Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.467305 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"ead61fcf-891a-44f3-8867-a2adcf744d69","Type":"ContainerDied","Data":"99ce2b2ca9b50cf26c7be433dd5e683dd52dc02bbd8b038fbe0eefbbfaf13907"} Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.467362 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.470674 5120 generic.go:358] "Generic (PLEG): container finished" podID="ff974854-15db-4188-b6dc-e330110c2427" containerID="1047a775a4d6d73834e956332daf4031b254e261c008046c75b64d3eca888ffd" exitCode=0 Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.470750 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"ff974854-15db-4188-b6dc-e330110c2427","Type":"ContainerDied","Data":"1047a775a4d6d73834e956332daf4031b254e261c008046c75b64d3eca888ffd"} Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.470796 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"ff974854-15db-4188-b6dc-e330110c2427","Type":"ContainerDied","Data":"d81e77ba112e6269f39cc7ddbf703f1cdeaa54b0a25fe4f67b8da7f8a2f6b2a7"} Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.470810 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d81e77ba112e6269f39cc7ddbf703f1cdeaa54b0a25fe4f67b8da7f8a2f6b2a7" Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.470927 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-5fac-account-create-update-clvt8" Mar 16 16:18:04 crc kubenswrapper[5120]: E0316 16:18:04.473672 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="6c6a76b2480d11bbcbe9da4f0bbb77ee9e7dcffe33abc117e4fd2108ee958a64" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:18:04 crc kubenswrapper[5120]: E0316 16:18:04.477327 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="6c6a76b2480d11bbcbe9da4f0bbb77ee9e7dcffe33abc117e4fd2108ee958a64" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:18:04 crc kubenswrapper[5120]: E0316 16:18:04.481780 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="6c6a76b2480d11bbcbe9da4f0bbb77ee9e7dcffe33abc117e4fd2108ee958a64" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:18:04 crc kubenswrapper[5120]: E0316 16:18:04.481815 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="711e7cd2-a028-4c76-969e-e08558a5d732" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.486567 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-9c08-account-create-update-w7m2p" Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.539425 5120 scope.go:117] "RemoveContainer" containerID="c758fe75eb30010d3898ba0e46464704f4eaccdb5721a29379189ee1664975df" Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.546996 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-cbf797d74-8frg4" Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.581646 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.586471 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.586888 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.604617 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.611619 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.621703 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.626004 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ff974854-15db-4188-b6dc-e330110c2427-logs\") pod \"ff974854-15db-4188-b6dc-e330110c2427\" (UID: \"ff974854-15db-4188-b6dc-e330110c2427\") " Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.626049 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b2e8d0e9-fa13-49fc-b149-af0d8d1d5ef0-combined-ca-bundle\") pod \"b2e8d0e9-fa13-49fc-b149-af0d8d1d5ef0\" (UID: \"b2e8d0e9-fa13-49fc-b149-af0d8d1d5ef0\") " Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.626086 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/60fe13eb-066c-4985-bb16-1a201e5c339c-public-tls-certs\") pod \"60fe13eb-066c-4985-bb16-1a201e5c339c\" (UID: \"60fe13eb-066c-4985-bb16-1a201e5c339c\") " Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.626186 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-djgjs\" (UniqueName: \"kubernetes.io/projected/b2e8d0e9-fa13-49fc-b149-af0d8d1d5ef0-kube-api-access-djgjs\") pod \"b2e8d0e9-fa13-49fc-b149-af0d8d1d5ef0\" (UID: \"b2e8d0e9-fa13-49fc-b149-af0d8d1d5ef0\") " Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.626217 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/70f64346-8cba-4ea9-b229-c1ba5012ca42-operator-scripts\") pod \"70f64346-8cba-4ea9-b229-c1ba5012ca42\" (UID: \"70f64346-8cba-4ea9-b229-c1ba5012ca42\") " Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.626265 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/b2e8d0e9-fa13-49fc-b149-af0d8d1d5ef0-config-data-custom\") pod \"b2e8d0e9-fa13-49fc-b149-af0d8d1d5ef0\" (UID: \"b2e8d0e9-fa13-49fc-b149-af0d8d1d5ef0\") " Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.626298 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b2e8d0e9-fa13-49fc-b149-af0d8d1d5ef0-config-data\") pod \"b2e8d0e9-fa13-49fc-b149-af0d8d1d5ef0\" (UID: \"b2e8d0e9-fa13-49fc-b149-af0d8d1d5ef0\") " Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.626335 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/60fe13eb-066c-4985-bb16-1a201e5c339c-internal-tls-certs\") pod \"60fe13eb-066c-4985-bb16-1a201e5c339c\" (UID: \"60fe13eb-066c-4985-bb16-1a201e5c339c\") " Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.626359 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/60fe13eb-066c-4985-bb16-1a201e5c339c-config-data-custom\") pod \"60fe13eb-066c-4985-bb16-1a201e5c339c\" (UID: \"60fe13eb-066c-4985-bb16-1a201e5c339c\") " Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.626397 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/ff974854-15db-4188-b6dc-e330110c2427-httpd-run\") pod \"ff974854-15db-4188-b6dc-e330110c2427\" (UID: \"ff974854-15db-4188-b6dc-e330110c2427\") " Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.626420 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zsfkq\" (UniqueName: \"kubernetes.io/projected/60fe13eb-066c-4985-bb16-1a201e5c339c-kube-api-access-zsfkq\") pod \"60fe13eb-066c-4985-bb16-1a201e5c339c\" (UID: \"60fe13eb-066c-4985-bb16-1a201e5c339c\") " Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.626443 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/60fe13eb-066c-4985-bb16-1a201e5c339c-config-data\") pod \"60fe13eb-066c-4985-bb16-1a201e5c339c\" (UID: \"60fe13eb-066c-4985-bb16-1a201e5c339c\") " Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.626473 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"ff974854-15db-4188-b6dc-e330110c2427\" (UID: \"ff974854-15db-4188-b6dc-e330110c2427\") " Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.626504 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ff974854-15db-4188-b6dc-e330110c2427-scripts\") pod \"ff974854-15db-4188-b6dc-e330110c2427\" (UID: \"ff974854-15db-4188-b6dc-e330110c2427\") " Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.626519 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ff974854-15db-4188-b6dc-e330110c2427-combined-ca-bundle\") pod \"ff974854-15db-4188-b6dc-e330110c2427\" (UID: \"ff974854-15db-4188-b6dc-e330110c2427\") " Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.626548 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/60fe13eb-066c-4985-bb16-1a201e5c339c-combined-ca-bundle\") pod \"60fe13eb-066c-4985-bb16-1a201e5c339c\" (UID: \"60fe13eb-066c-4985-bb16-1a201e5c339c\") " Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.626629 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/60fe13eb-066c-4985-bb16-1a201e5c339c-scripts\") pod \"60fe13eb-066c-4985-bb16-1a201e5c339c\" (UID: \"60fe13eb-066c-4985-bb16-1a201e5c339c\") " Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.626655 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b2e8d0e9-fa13-49fc-b149-af0d8d1d5ef0-logs\") pod \"b2e8d0e9-fa13-49fc-b149-af0d8d1d5ef0\" (UID: \"b2e8d0e9-fa13-49fc-b149-af0d8d1d5ef0\") " Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.626846 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ff974854-15db-4188-b6dc-e330110c2427-config-data\") pod \"ff974854-15db-4188-b6dc-e330110c2427\" (UID: \"ff974854-15db-4188-b6dc-e330110c2427\") " Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.626887 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/60fe13eb-066c-4985-bb16-1a201e5c339c-etc-machine-id\") pod \"60fe13eb-066c-4985-bb16-1a201e5c339c\" (UID: \"60fe13eb-066c-4985-bb16-1a201e5c339c\") " Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.626956 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/60fe13eb-066c-4985-bb16-1a201e5c339c-logs\") pod \"60fe13eb-066c-4985-bb16-1a201e5c339c\" (UID: \"60fe13eb-066c-4985-bb16-1a201e5c339c\") " Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.626977 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7xxnv\" (UniqueName: \"kubernetes.io/projected/ff974854-15db-4188-b6dc-e330110c2427-kube-api-access-7xxnv\") pod \"ff974854-15db-4188-b6dc-e330110c2427\" (UID: \"ff974854-15db-4188-b6dc-e330110c2427\") " Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.627009 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fwd7h\" (UniqueName: \"kubernetes.io/projected/70f64346-8cba-4ea9-b229-c1ba5012ca42-kube-api-access-fwd7h\") pod \"70f64346-8cba-4ea9-b229-c1ba5012ca42\" (UID: \"70f64346-8cba-4ea9-b229-c1ba5012ca42\") " Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.627038 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ff974854-15db-4188-b6dc-e330110c2427-public-tls-certs\") pod \"ff974854-15db-4188-b6dc-e330110c2427\" (UID: \"ff974854-15db-4188-b6dc-e330110c2427\") " Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.634309 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-proxy-7c79cc45b-sp9b7"] Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.642924 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/swift-proxy-7c79cc45b-sp9b7"] Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.644129 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-d8b74df76-z7648"] Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.626623 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff974854-15db-4188-b6dc-e330110c2427-logs" (OuterVolumeSpecName: "logs") pod "ff974854-15db-4188-b6dc-e330110c2427" (UID: "ff974854-15db-4188-b6dc-e330110c2427"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.627485 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/70f64346-8cba-4ea9-b229-c1ba5012ca42-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "70f64346-8cba-4ea9-b229-c1ba5012ca42" (UID: "70f64346-8cba-4ea9-b229-c1ba5012ca42"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.640084 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/60fe13eb-066c-4985-bb16-1a201e5c339c-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "60fe13eb-066c-4985-bb16-1a201e5c339c" (UID: "60fe13eb-066c-4985-bb16-1a201e5c339c"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.646361 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2e8d0e9-fa13-49fc-b149-af0d8d1d5ef0-kube-api-access-djgjs" (OuterVolumeSpecName: "kube-api-access-djgjs") pod "b2e8d0e9-fa13-49fc-b149-af0d8d1d5ef0" (UID: "b2e8d0e9-fa13-49fc-b149-af0d8d1d5ef0"). InnerVolumeSpecName "kube-api-access-djgjs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.646577 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2e8d0e9-fa13-49fc-b149-af0d8d1d5ef0-logs" (OuterVolumeSpecName: "logs") pod "b2e8d0e9-fa13-49fc-b149-af0d8d1d5ef0" (UID: "b2e8d0e9-fa13-49fc-b149-af0d8d1d5ef0"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.649768 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-d8b74df76-z7648"] Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.658931 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-77f5d87454-bxpdp" Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.659015 5120 scope.go:117] "RemoveContainer" containerID="c7f3ff7114c8325a4013354eac7abcb97615578a9e9578a4e22a4de17afb1ebc" Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.660082 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-5fac-account-create-update-clvt8"] Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.665148 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b2e8d0e9-fa13-49fc-b149-af0d8d1d5ef0-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "b2e8d0e9-fa13-49fc-b149-af0d8d1d5ef0" (UID: "b2e8d0e9-fa13-49fc-b149-af0d8d1d5ef0"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.665649 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-5fac-account-create-update-clvt8"] Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.667507 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/60fe13eb-066c-4985-bb16-1a201e5c339c-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "60fe13eb-066c-4985-bb16-1a201e5c339c" (UID: "60fe13eb-066c-4985-bb16-1a201e5c339c"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.668029 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-5bfb7678f9-6dzmx" Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.670223 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff974854-15db-4188-b6dc-e330110c2427-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "ff974854-15db-4188-b6dc-e330110c2427" (UID: "ff974854-15db-4188-b6dc-e330110c2427"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.675010 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff974854-15db-4188-b6dc-e330110c2427-scripts" (OuterVolumeSpecName: "scripts") pod "ff974854-15db-4188-b6dc-e330110c2427" (UID: "ff974854-15db-4188-b6dc-e330110c2427"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.675050 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60fe13eb-066c-4985-bb16-1a201e5c339c-logs" (OuterVolumeSpecName: "logs") pod "60fe13eb-066c-4985-bb16-1a201e5c339c" (UID: "60fe13eb-066c-4985-bb16-1a201e5c339c"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.680935 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage04-crc" (OuterVolumeSpecName: "glance") pod "ff974854-15db-4188-b6dc-e330110c2427" (UID: "ff974854-15db-4188-b6dc-e330110c2427"). InnerVolumeSpecName "local-storage04-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.682964 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60fe13eb-066c-4985-bb16-1a201e5c339c-kube-api-access-zsfkq" (OuterVolumeSpecName: "kube-api-access-zsfkq") pod "60fe13eb-066c-4985-bb16-1a201e5c339c" (UID: "60fe13eb-066c-4985-bb16-1a201e5c339c"). InnerVolumeSpecName "kube-api-access-zsfkq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.684518 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff974854-15db-4188-b6dc-e330110c2427-kube-api-access-7xxnv" (OuterVolumeSpecName: "kube-api-access-7xxnv") pod "ff974854-15db-4188-b6dc-e330110c2427" (UID: "ff974854-15db-4188-b6dc-e330110c2427"). InnerVolumeSpecName "kube-api-access-7xxnv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.686970 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/60fe13eb-066c-4985-bb16-1a201e5c339c-scripts" (OuterVolumeSpecName: "scripts") pod "60fe13eb-066c-4985-bb16-1a201e5c339c" (UID: "60fe13eb-066c-4985-bb16-1a201e5c339c"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.695786 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d72ed4f-2b58-4e71-ada5-a06739dac8b2" path="/var/lib/kubelet/pods/0d72ed4f-2b58-4e71-ada5-a06739dac8b2/volumes" Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.696099 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="23634501-dcbf-4b5f-a734-820f1959b54e" path="/var/lib/kubelet/pods/23634501-dcbf-4b5f-a734-820f1959b54e/volumes" Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.696372 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6cf8b665-920c-4d82-92eb-508d6ca3e9a1" path="/var/lib/kubelet/pods/6cf8b665-920c-4d82-92eb-508d6ca3e9a1/volumes" Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.696955 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="848fca26-246f-48f5-8f00-a41ecb239952" path="/var/lib/kubelet/pods/848fca26-246f-48f5-8f00-a41ecb239952/volumes" Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.697579 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9698823e-0af0-4477-b47a-a388c6264dda" path="/var/lib/kubelet/pods/9698823e-0af0-4477-b47a-a388c6264dda/volumes" Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.698701 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="979c2589-0aa0-4e9c-8a97-9fd5a1676e64" path="/var/lib/kubelet/pods/979c2589-0aa0-4e9c-8a97-9fd5a1676e64/volumes" Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.699312 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c06828a4-039e-4080-a682-0bf5a7aaf9c2" path="/var/lib/kubelet/pods/c06828a4-039e-4080-a682-0bf5a7aaf9c2/volumes" Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.700096 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d73ebf72-269e-4ebf-86b6-2d517ce8881a" path="/var/lib/kubelet/pods/d73ebf72-269e-4ebf-86b6-2d517ce8881a/volumes" Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.701455 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ead61fcf-891a-44f3-8867-a2adcf744d69" path="/var/lib/kubelet/pods/ead61fcf-891a-44f3-8867-a2adcf744d69/volumes" Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.708239 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fb13a989-3fee-4cd9-97d4-e68371891b6b" path="/var/lib/kubelet/pods/fb13a989-3fee-4cd9-97d4-e68371891b6b/volumes" Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.717536 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70f64346-8cba-4ea9-b229-c1ba5012ca42-kube-api-access-fwd7h" (OuterVolumeSpecName: "kube-api-access-fwd7h") pod "70f64346-8cba-4ea9-b229-c1ba5012ca42" (UID: "70f64346-8cba-4ea9-b229-c1ba5012ca42"). InnerVolumeSpecName "kube-api-access-fwd7h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.724694 5120 scope.go:117] "RemoveContainer" containerID="c758fe75eb30010d3898ba0e46464704f4eaccdb5721a29379189ee1664975df" Mar 16 16:18:04 crc kubenswrapper[5120]: E0316 16:18:04.725652 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c758fe75eb30010d3898ba0e46464704f4eaccdb5721a29379189ee1664975df\": container with ID starting with c758fe75eb30010d3898ba0e46464704f4eaccdb5721a29379189ee1664975df not found: ID does not exist" containerID="c758fe75eb30010d3898ba0e46464704f4eaccdb5721a29379189ee1664975df" Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.725682 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c758fe75eb30010d3898ba0e46464704f4eaccdb5721a29379189ee1664975df"} err="failed to get container status \"c758fe75eb30010d3898ba0e46464704f4eaccdb5721a29379189ee1664975df\": rpc error: code = NotFound desc = could not find container \"c758fe75eb30010d3898ba0e46464704f4eaccdb5721a29379189ee1664975df\": container with ID starting with c758fe75eb30010d3898ba0e46464704f4eaccdb5721a29379189ee1664975df not found: ID does not exist" Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.725701 5120 scope.go:117] "RemoveContainer" containerID="c7f3ff7114c8325a4013354eac7abcb97615578a9e9578a4e22a4de17afb1ebc" Mar 16 16:18:04 crc kubenswrapper[5120]: E0316 16:18:04.725898 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c7f3ff7114c8325a4013354eac7abcb97615578a9e9578a4e22a4de17afb1ebc\": container with ID starting with c7f3ff7114c8325a4013354eac7abcb97615578a9e9578a4e22a4de17afb1ebc not found: ID does not exist" containerID="c7f3ff7114c8325a4013354eac7abcb97615578a9e9578a4e22a4de17afb1ebc" Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.725911 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7f3ff7114c8325a4013354eac7abcb97615578a9e9578a4e22a4de17afb1ebc"} err="failed to get container status \"c7f3ff7114c8325a4013354eac7abcb97615578a9e9578a4e22a4de17afb1ebc\": rpc error: code = NotFound desc = could not find container \"c7f3ff7114c8325a4013354eac7abcb97615578a9e9578a4e22a4de17afb1ebc\": container with ID starting with c7f3ff7114c8325a4013354eac7abcb97615578a9e9578a4e22a4de17afb1ebc not found: ID does not exist" Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.725922 5120 scope.go:117] "RemoveContainer" containerID="5346c7728f32b0dc09b52da8b4cb5097e3f94eb1c9956ddf64dfa7f4fe5c9f0b" Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.728702 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3fe73309-f917-40c4-a606-511f1547daf4-scripts\") pod \"3fe73309-f917-40c4-a606-511f1547daf4\" (UID: \"3fe73309-f917-40c4-a606-511f1547daf4\") " Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.729977 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b2e8d0e9-fa13-49fc-b149-af0d8d1d5ef0-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "b2e8d0e9-fa13-49fc-b149-af0d8d1d5ef0" (UID: "b2e8d0e9-fa13-49fc-b149-af0d8d1d5ef0"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.730239 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b2e8d0e9-fa13-49fc-b149-af0d8d1d5ef0-combined-ca-bundle\") pod \"b2e8d0e9-fa13-49fc-b149-af0d8d1d5ef0\" (UID: \"b2e8d0e9-fa13-49fc-b149-af0d8d1d5ef0\") " Mar 16 16:18:04 crc kubenswrapper[5120]: W0316 16:18:04.730332 5120 empty_dir.go:511] Warning: Unmount skipped because path does not exist: /var/lib/kubelet/pods/b2e8d0e9-fa13-49fc-b149-af0d8d1d5ef0/volumes/kubernetes.io~secret/combined-ca-bundle Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.730343 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b2e8d0e9-fa13-49fc-b149-af0d8d1d5ef0-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "b2e8d0e9-fa13-49fc-b149-af0d8d1d5ef0" (UID: "b2e8d0e9-fa13-49fc-b149-af0d8d1d5ef0"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.730367 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3fe73309-f917-40c4-a606-511f1547daf4-combined-ca-bundle\") pod \"3fe73309-f917-40c4-a606-511f1547daf4\" (UID: \"3fe73309-f917-40c4-a606-511f1547daf4\") " Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.730415 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7e059927-938d-4449-a260-90053be70ec9-logs\") pod \"7e059927-938d-4449-a260-90053be70ec9\" (UID: \"7e059927-938d-4449-a260-90053be70ec9\") " Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.730476 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3fe73309-f917-40c4-a606-511f1547daf4-logs\") pod \"3fe73309-f917-40c4-a606-511f1547daf4\" (UID: \"3fe73309-f917-40c4-a606-511f1547daf4\") " Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.730515 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7e059927-938d-4449-a260-90053be70ec9-config-data\") pod \"7e059927-938d-4449-a260-90053be70ec9\" (UID: \"7e059927-938d-4449-a260-90053be70ec9\") " Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.730564 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9k7q7\" (UniqueName: \"kubernetes.io/projected/3fe73309-f917-40c4-a606-511f1547daf4-kube-api-access-9k7q7\") pod \"3fe73309-f917-40c4-a606-511f1547daf4\" (UID: \"3fe73309-f917-40c4-a606-511f1547daf4\") " Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.730624 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3fe73309-f917-40c4-a606-511f1547daf4-config-data\") pod \"3fe73309-f917-40c4-a606-511f1547daf4\" (UID: \"3fe73309-f917-40c4-a606-511f1547daf4\") " Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.730729 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/3fe73309-f917-40c4-a606-511f1547daf4-internal-tls-certs\") pod \"3fe73309-f917-40c4-a606-511f1547daf4\" (UID: \"3fe73309-f917-40c4-a606-511f1547daf4\") " Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.730786 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rzw8k\" (UniqueName: \"kubernetes.io/projected/7e059927-938d-4449-a260-90053be70ec9-kube-api-access-rzw8k\") pod \"7e059927-938d-4449-a260-90053be70ec9\" (UID: \"7e059927-938d-4449-a260-90053be70ec9\") " Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.730892 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/7e059927-938d-4449-a260-90053be70ec9-config-data-custom\") pod \"7e059927-938d-4449-a260-90053be70ec9\" (UID: \"7e059927-938d-4449-a260-90053be70ec9\") " Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.730940 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/3fe73309-f917-40c4-a606-511f1547daf4-public-tls-certs\") pod \"3fe73309-f917-40c4-a606-511f1547daf4\" (UID: \"3fe73309-f917-40c4-a606-511f1547daf4\") " Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.731010 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7e059927-938d-4449-a260-90053be70ec9-combined-ca-bundle\") pod \"7e059927-938d-4449-a260-90053be70ec9\" (UID: \"7e059927-938d-4449-a260-90053be70ec9\") " Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.731635 5120 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/60fe13eb-066c-4985-bb16-1a201e5c339c-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.731653 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/60fe13eb-066c-4985-bb16-1a201e5c339c-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.731663 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7xxnv\" (UniqueName: \"kubernetes.io/projected/ff974854-15db-4188-b6dc-e330110c2427-kube-api-access-7xxnv\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.731675 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fwd7h\" (UniqueName: \"kubernetes.io/projected/70f64346-8cba-4ea9-b229-c1ba5012ca42-kube-api-access-fwd7h\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.731683 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ff974854-15db-4188-b6dc-e330110c2427-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.731691 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b2e8d0e9-fa13-49fc-b149-af0d8d1d5ef0-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.731700 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nj6t9\" (UniqueName: \"kubernetes.io/projected/23634501-dcbf-4b5f-a734-820f1959b54e-kube-api-access-nj6t9\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.731708 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-djgjs\" (UniqueName: \"kubernetes.io/projected/b2e8d0e9-fa13-49fc-b149-af0d8d1d5ef0-kube-api-access-djgjs\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.731718 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/70f64346-8cba-4ea9-b229-c1ba5012ca42-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.731727 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/b2e8d0e9-fa13-49fc-b149-af0d8d1d5ef0-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.731736 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/60fe13eb-066c-4985-bb16-1a201e5c339c-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.731745 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/ff974854-15db-4188-b6dc-e330110c2427-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.731768 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zsfkq\" (UniqueName: \"kubernetes.io/projected/60fe13eb-066c-4985-bb16-1a201e5c339c-kube-api-access-zsfkq\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.731787 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") on node \"crc\" " Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.731796 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ff974854-15db-4188-b6dc-e330110c2427-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.731804 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/23634501-dcbf-4b5f-a734-820f1959b54e-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.731813 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/60fe13eb-066c-4985-bb16-1a201e5c339c-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.731821 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b2e8d0e9-fa13-49fc-b149-af0d8d1d5ef0-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.748003 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e059927-938d-4449-a260-90053be70ec9-logs" (OuterVolumeSpecName: "logs") pod "7e059927-938d-4449-a260-90053be70ec9" (UID: "7e059927-938d-4449-a260-90053be70ec9"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.749676 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fe73309-f917-40c4-a606-511f1547daf4-logs" (OuterVolumeSpecName: "logs") pod "3fe73309-f917-40c4-a606-511f1547daf4" (UID: "3fe73309-f917-40c4-a606-511f1547daf4"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.770865 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/60fe13eb-066c-4985-bb16-1a201e5c339c-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "60fe13eb-066c-4985-bb16-1a201e5c339c" (UID: "60fe13eb-066c-4985-bb16-1a201e5c339c"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.775474 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e059927-938d-4449-a260-90053be70ec9-kube-api-access-rzw8k" (OuterVolumeSpecName: "kube-api-access-rzw8k") pod "7e059927-938d-4449-a260-90053be70ec9" (UID: "7e059927-938d-4449-a260-90053be70ec9"). InnerVolumeSpecName "kube-api-access-rzw8k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.779591 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e059927-938d-4449-a260-90053be70ec9-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "7e059927-938d-4449-a260-90053be70ec9" (UID: "7e059927-938d-4449-a260-90053be70ec9"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.783773 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3fe73309-f917-40c4-a606-511f1547daf4-kube-api-access-9k7q7" (OuterVolumeSpecName: "kube-api-access-9k7q7") pod "3fe73309-f917-40c4-a606-511f1547daf4" (UID: "3fe73309-f917-40c4-a606-511f1547daf4"). InnerVolumeSpecName "kube-api-access-9k7q7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.789288 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3fe73309-f917-40c4-a606-511f1547daf4-scripts" (OuterVolumeSpecName: "scripts") pod "3fe73309-f917-40c4-a606-511f1547daf4" (UID: "3fe73309-f917-40c4-a606-511f1547daf4"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.790821 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage04-crc" (UniqueName: "kubernetes.io/local-volume/local-storage04-crc") on node "crc" Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.833785 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7e059927-938d-4449-a260-90053be70ec9-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.833818 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3fe73309-f917-40c4-a606-511f1547daf4-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.833827 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.833836 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9k7q7\" (UniqueName: \"kubernetes.io/projected/3fe73309-f917-40c4-a606-511f1547daf4-kube-api-access-9k7q7\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.833845 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/60fe13eb-066c-4985-bb16-1a201e5c339c-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.833853 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rzw8k\" (UniqueName: \"kubernetes.io/projected/7e059927-938d-4449-a260-90053be70ec9-kube-api-access-rzw8k\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.833861 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/7e059927-938d-4449-a260-90053be70ec9-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.833871 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3fe73309-f917-40c4-a606-511f1547daf4-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.870998 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff974854-15db-4188-b6dc-e330110c2427-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "ff974854-15db-4188-b6dc-e330110c2427" (UID: "ff974854-15db-4188-b6dc-e330110c2427"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.871164 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff974854-15db-4188-b6dc-e330110c2427-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ff974854-15db-4188-b6dc-e330110c2427" (UID: "ff974854-15db-4188-b6dc-e330110c2427"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.879462 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/60fe13eb-066c-4985-bb16-1a201e5c339c-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "60fe13eb-066c-4985-bb16-1a201e5c339c" (UID: "60fe13eb-066c-4985-bb16-1a201e5c339c"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.936929 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ff974854-15db-4188-b6dc-e330110c2427-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.936983 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ff974854-15db-4188-b6dc-e330110c2427-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.936994 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/60fe13eb-066c-4985-bb16-1a201e5c339c-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.938629 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e059927-938d-4449-a260-90053be70ec9-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "7e059927-938d-4449-a260-90053be70ec9" (UID: "7e059927-938d-4449-a260-90053be70ec9"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.966508 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/60fe13eb-066c-4985-bb16-1a201e5c339c-config-data" (OuterVolumeSpecName: "config-data") pod "60fe13eb-066c-4985-bb16-1a201e5c339c" (UID: "60fe13eb-066c-4985-bb16-1a201e5c339c"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.987911 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b2e8d0e9-fa13-49fc-b149-af0d8d1d5ef0-config-data" (OuterVolumeSpecName: "config-data") pod "b2e8d0e9-fa13-49fc-b149-af0d8d1d5ef0" (UID: "b2e8d0e9-fa13-49fc-b149-af0d8d1d5ef0"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:18:04 crc kubenswrapper[5120]: I0316 16:18:04.996905 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/60fe13eb-066c-4985-bb16-1a201e5c339c-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "60fe13eb-066c-4985-bb16-1a201e5c339c" (UID: "60fe13eb-066c-4985-bb16-1a201e5c339c"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.000855 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3fe73309-f917-40c4-a606-511f1547daf4-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "3fe73309-f917-40c4-a606-511f1547daf4" (UID: "3fe73309-f917-40c4-a606-511f1547daf4"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.000990 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e059927-938d-4449-a260-90053be70ec9-config-data" (OuterVolumeSpecName: "config-data") pod "7e059927-938d-4449-a260-90053be70ec9" (UID: "7e059927-938d-4449-a260-90053be70ec9"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.002535 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff974854-15db-4188-b6dc-e330110c2427-config-data" (OuterVolumeSpecName: "config-data") pod "ff974854-15db-4188-b6dc-e330110c2427" (UID: "ff974854-15db-4188-b6dc-e330110c2427"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.039990 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ff974854-15db-4188-b6dc-e330110c2427-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.040026 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7e059927-938d-4449-a260-90053be70ec9-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.040044 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3fe73309-f917-40c4-a606-511f1547daf4-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.040054 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b2e8d0e9-fa13-49fc-b149-af0d8d1d5ef0-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.040065 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/60fe13eb-066c-4985-bb16-1a201e5c339c-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.040075 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7e059927-938d-4449-a260-90053be70ec9-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.040107 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/60fe13eb-066c-4985-bb16-1a201e5c339c-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:05 crc kubenswrapper[5120]: E0316 16:18:05.040204 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Mar 16 16:18:05 crc kubenswrapper[5120]: E0316 16:18:05.040318 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/90982d87-fc0f-49d0-a400-4155e4f3b000-operator-scripts podName:90982d87-fc0f-49d0-a400-4155e4f3b000 nodeName:}" failed. No retries permitted until 2026-03-16 16:18:07.040292663 +0000 UTC m=+2789.194224320 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/90982d87-fc0f-49d0-a400-4155e4f3b000-operator-scripts") pod "root-account-create-update-bh8f4" (UID: "90982d87-fc0f-49d0-a400-4155e4f3b000") : configmap "openstack-scripts" not found Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.052466 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3fe73309-f917-40c4-a606-511f1547daf4-config-data" (OuterVolumeSpecName: "config-data") pod "3fe73309-f917-40c4-a606-511f1547daf4" (UID: "3fe73309-f917-40c4-a606-511f1547daf4"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.080468 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3fe73309-f917-40c4-a606-511f1547daf4-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "3fe73309-f917-40c4-a606-511f1547daf4" (UID: "3fe73309-f917-40c4-a606-511f1547daf4"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.093229 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3fe73309-f917-40c4-a606-511f1547daf4-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "3fe73309-f917-40c4-a606-511f1547daf4" (UID: "3fe73309-f917-40c4-a606-511f1547daf4"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.143837 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3fe73309-f917-40c4-a606-511f1547daf4-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.143867 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/3fe73309-f917-40c4-a606-511f1547daf4-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.143877 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/3fe73309-f917-40c4-a606-511f1547daf4-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.250555 5120 scope.go:117] "RemoveContainer" containerID="51ef4c7e3e0dc3d7b67115fda2c5e6d516da517af01fe5c37d48fabfd8112d2b" Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.255139 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.275540 5120 scope.go:117] "RemoveContainer" containerID="5346c7728f32b0dc09b52da8b4cb5097e3f94eb1c9956ddf64dfa7f4fe5c9f0b" Mar 16 16:18:05 crc kubenswrapper[5120]: E0316 16:18:05.279296 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5346c7728f32b0dc09b52da8b4cb5097e3f94eb1c9956ddf64dfa7f4fe5c9f0b\": container with ID starting with 5346c7728f32b0dc09b52da8b4cb5097e3f94eb1c9956ddf64dfa7f4fe5c9f0b not found: ID does not exist" containerID="5346c7728f32b0dc09b52da8b4cb5097e3f94eb1c9956ddf64dfa7f4fe5c9f0b" Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.279360 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5346c7728f32b0dc09b52da8b4cb5097e3f94eb1c9956ddf64dfa7f4fe5c9f0b"} err="failed to get container status \"5346c7728f32b0dc09b52da8b4cb5097e3f94eb1c9956ddf64dfa7f4fe5c9f0b\": rpc error: code = NotFound desc = could not find container \"5346c7728f32b0dc09b52da8b4cb5097e3f94eb1c9956ddf64dfa7f4fe5c9f0b\": container with ID starting with 5346c7728f32b0dc09b52da8b4cb5097e3f94eb1c9956ddf64dfa7f4fe5c9f0b not found: ID does not exist" Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.279401 5120 scope.go:117] "RemoveContainer" containerID="51ef4c7e3e0dc3d7b67115fda2c5e6d516da517af01fe5c37d48fabfd8112d2b" Mar 16 16:18:05 crc kubenswrapper[5120]: E0316 16:18:05.279846 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"51ef4c7e3e0dc3d7b67115fda2c5e6d516da517af01fe5c37d48fabfd8112d2b\": container with ID starting with 51ef4c7e3e0dc3d7b67115fda2c5e6d516da517af01fe5c37d48fabfd8112d2b not found: ID does not exist" containerID="51ef4c7e3e0dc3d7b67115fda2c5e6d516da517af01fe5c37d48fabfd8112d2b" Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.279897 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51ef4c7e3e0dc3d7b67115fda2c5e6d516da517af01fe5c37d48fabfd8112d2b"} err="failed to get container status \"51ef4c7e3e0dc3d7b67115fda2c5e6d516da517af01fe5c37d48fabfd8112d2b\": rpc error: code = NotFound desc = could not find container \"51ef4c7e3e0dc3d7b67115fda2c5e6d516da517af01fe5c37d48fabfd8112d2b\": container with ID starting with 51ef4c7e3e0dc3d7b67115fda2c5e6d516da517af01fe5c37d48fabfd8112d2b not found: ID does not exist" Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.279925 5120 scope.go:117] "RemoveContainer" containerID="d251b0429da624062362d8f63ad78aba4ba2e5f930e45f5add820cdf106863fd" Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.282279 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-northd-0_43c58ec7-474a-49bc-921f-89cf47b67811/ovn-northd/0.log" Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.282357 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.295375 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.314042 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.318377 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-796f4f9644-59hlg" Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.329780 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-bh8f4" Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.347922 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"044996b4-e444-4486-9503-61d776ec849f\" (UID: \"044996b4-e444-4486-9503-61d776ec849f\") " Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.347976 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/044996b4-e444-4486-9503-61d776ec849f-scripts\") pod \"044996b4-e444-4486-9503-61d776ec849f\" (UID: \"044996b4-e444-4486-9503-61d776ec849f\") " Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.348003 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/9e7f8135-737c-4639-bdd8-46d68e1a617d-public-tls-certs\") pod \"9e7f8135-737c-4639-bdd8-46d68e1a617d\" (UID: \"9e7f8135-737c-4639-bdd8-46d68e1a617d\") " Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.348026 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/43c58ec7-474a-49bc-921f-89cf47b67811-scripts\") pod \"43c58ec7-474a-49bc-921f-89cf47b67811\" (UID: \"43c58ec7-474a-49bc-921f-89cf47b67811\") " Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.348054 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/9292b258-885b-40a8-8b7d-9ed28a747bc7-nova-metadata-tls-certs\") pod \"9292b258-885b-40a8-8b7d-9ed28a747bc7\" (UID: \"9292b258-885b-40a8-8b7d-9ed28a747bc7\") " Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.348102 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jzdnb\" (UniqueName: \"kubernetes.io/projected/9292b258-885b-40a8-8b7d-9ed28a747bc7-kube-api-access-jzdnb\") pod \"9292b258-885b-40a8-8b7d-9ed28a747bc7\" (UID: \"9292b258-885b-40a8-8b7d-9ed28a747bc7\") " Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.348135 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/43c58ec7-474a-49bc-921f-89cf47b67811-config\") pod \"43c58ec7-474a-49bc-921f-89cf47b67811\" (UID: \"43c58ec7-474a-49bc-921f-89cf47b67811\") " Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.348150 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9e7f8135-737c-4639-bdd8-46d68e1a617d-config-data\") pod \"9e7f8135-737c-4639-bdd8-46d68e1a617d\" (UID: \"9e7f8135-737c-4639-bdd8-46d68e1a617d\") " Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.348170 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-492g4\" (UniqueName: \"kubernetes.io/projected/43c58ec7-474a-49bc-921f-89cf47b67811-kube-api-access-492g4\") pod \"43c58ec7-474a-49bc-921f-89cf47b67811\" (UID: \"43c58ec7-474a-49bc-921f-89cf47b67811\") " Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.348206 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9292b258-885b-40a8-8b7d-9ed28a747bc7-combined-ca-bundle\") pod \"9292b258-885b-40a8-8b7d-9ed28a747bc7\" (UID: \"9292b258-885b-40a8-8b7d-9ed28a747bc7\") " Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.348228 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/9f16b3a2-bc26-4a63-8f8c-836611f0d320-public-tls-certs\") pod \"9f16b3a2-bc26-4a63-8f8c-836611f0d320\" (UID: \"9f16b3a2-bc26-4a63-8f8c-836611f0d320\") " Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.348270 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8dpdp\" (UniqueName: \"kubernetes.io/projected/9f16b3a2-bc26-4a63-8f8c-836611f0d320-kube-api-access-8dpdp\") pod \"9f16b3a2-bc26-4a63-8f8c-836611f0d320\" (UID: \"9f16b3a2-bc26-4a63-8f8c-836611f0d320\") " Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.348312 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hhvrb\" (UniqueName: \"kubernetes.io/projected/044996b4-e444-4486-9503-61d776ec849f-kube-api-access-hhvrb\") pod \"044996b4-e444-4486-9503-61d776ec849f\" (UID: \"044996b4-e444-4486-9503-61d776ec849f\") " Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.348331 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/43c58ec7-474a-49bc-921f-89cf47b67811-combined-ca-bundle\") pod \"43c58ec7-474a-49bc-921f-89cf47b67811\" (UID: \"43c58ec7-474a-49bc-921f-89cf47b67811\") " Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.348355 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/43c58ec7-474a-49bc-921f-89cf47b67811-ovn-rundir\") pod \"43c58ec7-474a-49bc-921f-89cf47b67811\" (UID: \"43c58ec7-474a-49bc-921f-89cf47b67811\") " Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.348381 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9f16b3a2-bc26-4a63-8f8c-836611f0d320-combined-ca-bundle\") pod \"9f16b3a2-bc26-4a63-8f8c-836611f0d320\" (UID: \"9f16b3a2-bc26-4a63-8f8c-836611f0d320\") " Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.348409 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9292b258-885b-40a8-8b7d-9ed28a747bc7-config-data\") pod \"9292b258-885b-40a8-8b7d-9ed28a747bc7\" (UID: \"9292b258-885b-40a8-8b7d-9ed28a747bc7\") " Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.348424 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/044996b4-e444-4486-9503-61d776ec849f-internal-tls-certs\") pod \"044996b4-e444-4486-9503-61d776ec849f\" (UID: \"044996b4-e444-4486-9503-61d776ec849f\") " Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.348466 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/044996b4-e444-4486-9503-61d776ec849f-httpd-run\") pod \"044996b4-e444-4486-9503-61d776ec849f\" (UID: \"044996b4-e444-4486-9503-61d776ec849f\") " Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.348491 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9292b258-885b-40a8-8b7d-9ed28a747bc7-logs\") pod \"9292b258-885b-40a8-8b7d-9ed28a747bc7\" (UID: \"9292b258-885b-40a8-8b7d-9ed28a747bc7\") " Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.348542 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9e7f8135-737c-4639-bdd8-46d68e1a617d-logs\") pod \"9e7f8135-737c-4639-bdd8-46d68e1a617d\" (UID: \"9e7f8135-737c-4639-bdd8-46d68e1a617d\") " Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.348620 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/43c58ec7-474a-49bc-921f-89cf47b67811-metrics-certs-tls-certs\") pod \"43c58ec7-474a-49bc-921f-89cf47b67811\" (UID: \"43c58ec7-474a-49bc-921f-89cf47b67811\") " Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.348646 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/9f16b3a2-bc26-4a63-8f8c-836611f0d320-internal-tls-certs\") pod \"9f16b3a2-bc26-4a63-8f8c-836611f0d320\" (UID: \"9f16b3a2-bc26-4a63-8f8c-836611f0d320\") " Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.348720 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/43c58ec7-474a-49bc-921f-89cf47b67811-ovn-northd-tls-certs\") pod \"43c58ec7-474a-49bc-921f-89cf47b67811\" (UID: \"43c58ec7-474a-49bc-921f-89cf47b67811\") " Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.348741 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/044996b4-e444-4486-9503-61d776ec849f-combined-ca-bundle\") pod \"044996b4-e444-4486-9503-61d776ec849f\" (UID: \"044996b4-e444-4486-9503-61d776ec849f\") " Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.348792 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9f16b3a2-bc26-4a63-8f8c-836611f0d320-config-data\") pod \"9f16b3a2-bc26-4a63-8f8c-836611f0d320\" (UID: \"9f16b3a2-bc26-4a63-8f8c-836611f0d320\") " Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.348844 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c6b2b\" (UniqueName: \"kubernetes.io/projected/9e7f8135-737c-4639-bdd8-46d68e1a617d-kube-api-access-c6b2b\") pod \"9e7f8135-737c-4639-bdd8-46d68e1a617d\" (UID: \"9e7f8135-737c-4639-bdd8-46d68e1a617d\") " Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.348912 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9f16b3a2-bc26-4a63-8f8c-836611f0d320-logs\") pod \"9f16b3a2-bc26-4a63-8f8c-836611f0d320\" (UID: \"9f16b3a2-bc26-4a63-8f8c-836611f0d320\") " Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.348931 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/9e7f8135-737c-4639-bdd8-46d68e1a617d-internal-tls-certs\") pod \"9e7f8135-737c-4639-bdd8-46d68e1a617d\" (UID: \"9e7f8135-737c-4639-bdd8-46d68e1a617d\") " Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.348950 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9e7f8135-737c-4639-bdd8-46d68e1a617d-combined-ca-bundle\") pod \"9e7f8135-737c-4639-bdd8-46d68e1a617d\" (UID: \"9e7f8135-737c-4639-bdd8-46d68e1a617d\") " Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.348986 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/9f16b3a2-bc26-4a63-8f8c-836611f0d320-config-data-custom\") pod \"9f16b3a2-bc26-4a63-8f8c-836611f0d320\" (UID: \"9f16b3a2-bc26-4a63-8f8c-836611f0d320\") " Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.349029 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/044996b4-e444-4486-9503-61d776ec849f-logs\") pod \"044996b4-e444-4486-9503-61d776ec849f\" (UID: \"044996b4-e444-4486-9503-61d776ec849f\") " Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.349054 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/044996b4-e444-4486-9503-61d776ec849f-config-data\") pod \"044996b4-e444-4486-9503-61d776ec849f\" (UID: \"044996b4-e444-4486-9503-61d776ec849f\") " Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.367957 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.368643 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/43c58ec7-474a-49bc-921f-89cf47b67811-config" (OuterVolumeSpecName: "config") pod "43c58ec7-474a-49bc-921f-89cf47b67811" (UID: "43c58ec7-474a-49bc-921f-89cf47b67811"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.368992 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/43c58ec7-474a-49bc-921f-89cf47b67811-kube-api-access-492g4" (OuterVolumeSpecName: "kube-api-access-492g4") pod "43c58ec7-474a-49bc-921f-89cf47b67811" (UID: "43c58ec7-474a-49bc-921f-89cf47b67811"). InnerVolumeSpecName "kube-api-access-492g4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.370096 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/43c58ec7-474a-49bc-921f-89cf47b67811-scripts" (OuterVolumeSpecName: "scripts") pod "43c58ec7-474a-49bc-921f-89cf47b67811" (UID: "43c58ec7-474a-49bc-921f-89cf47b67811"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.372074 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9292b258-885b-40a8-8b7d-9ed28a747bc7-logs" (OuterVolumeSpecName: "logs") pod "9292b258-885b-40a8-8b7d-9ed28a747bc7" (UID: "9292b258-885b-40a8-8b7d-9ed28a747bc7"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.372505 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/044996b4-e444-4486-9503-61d776ec849f-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "044996b4-e444-4486-9503-61d776ec849f" (UID: "044996b4-e444-4486-9503-61d776ec849f"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.373015 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e7f8135-737c-4639-bdd8-46d68e1a617d-logs" (OuterVolumeSpecName: "logs") pod "9e7f8135-737c-4639-bdd8-46d68e1a617d" (UID: "9e7f8135-737c-4639-bdd8-46d68e1a617d"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.373349 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43c58ec7-474a-49bc-921f-89cf47b67811-ovn-rundir" (OuterVolumeSpecName: "ovn-rundir") pod "43c58ec7-474a-49bc-921f-89cf47b67811" (UID: "43c58ec7-474a-49bc-921f-89cf47b67811"). InnerVolumeSpecName "ovn-rundir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.373637 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f16b3a2-bc26-4a63-8f8c-836611f0d320-logs" (OuterVolumeSpecName: "logs") pod "9f16b3a2-bc26-4a63-8f8c-836611f0d320" (UID: "9f16b3a2-bc26-4a63-8f8c-836611f0d320"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.374602 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/044996b4-e444-4486-9503-61d776ec849f-logs" (OuterVolumeSpecName: "logs") pod "044996b4-e444-4486-9503-61d776ec849f" (UID: "044996b4-e444-4486-9503-61d776ec849f"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.382723 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/044996b4-e444-4486-9503-61d776ec849f-scripts" (OuterVolumeSpecName: "scripts") pod "044996b4-e444-4486-9503-61d776ec849f" (UID: "044996b4-e444-4486-9503-61d776ec849f"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.393638 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage01-crc" (OuterVolumeSpecName: "glance") pod "044996b4-e444-4486-9503-61d776ec849f" (UID: "044996b4-e444-4486-9503-61d776ec849f"). InnerVolumeSpecName "local-storage01-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.393669 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e7f8135-737c-4639-bdd8-46d68e1a617d-kube-api-access-c6b2b" (OuterVolumeSpecName: "kube-api-access-c6b2b") pod "9e7f8135-737c-4639-bdd8-46d68e1a617d" (UID: "9e7f8135-737c-4639-bdd8-46d68e1a617d"). InnerVolumeSpecName "kube-api-access-c6b2b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.393735 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9292b258-885b-40a8-8b7d-9ed28a747bc7-kube-api-access-jzdnb" (OuterVolumeSpecName: "kube-api-access-jzdnb") pod "9292b258-885b-40a8-8b7d-9ed28a747bc7" (UID: "9292b258-885b-40a8-8b7d-9ed28a747bc7"). InnerVolumeSpecName "kube-api-access-jzdnb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.393860 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f16b3a2-bc26-4a63-8f8c-836611f0d320-kube-api-access-8dpdp" (OuterVolumeSpecName: "kube-api-access-8dpdp") pod "9f16b3a2-bc26-4a63-8f8c-836611f0d320" (UID: "9f16b3a2-bc26-4a63-8f8c-836611f0d320"). InnerVolumeSpecName "kube-api-access-8dpdp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.396210 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f16b3a2-bc26-4a63-8f8c-836611f0d320-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "9f16b3a2-bc26-4a63-8f8c-836611f0d320" (UID: "9f16b3a2-bc26-4a63-8f8c-836611f0d320"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.422974 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/044996b4-e444-4486-9503-61d776ec849f-kube-api-access-hhvrb" (OuterVolumeSpecName: "kube-api-access-hhvrb") pod "044996b4-e444-4486-9503-61d776ec849f" (UID: "044996b4-e444-4486-9503-61d776ec849f"). InnerVolumeSpecName "kube-api-access-hhvrb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.441236 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9292b258-885b-40a8-8b7d-9ed28a747bc7-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "9292b258-885b-40a8-8b7d-9ed28a747bc7" (UID: "9292b258-885b-40a8-8b7d-9ed28a747bc7"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.451451 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e7f8135-737c-4639-bdd8-46d68e1a617d-config-data" (OuterVolumeSpecName: "config-data") pod "9e7f8135-737c-4639-bdd8-46d68e1a617d" (UID: "9e7f8135-737c-4639-bdd8-46d68e1a617d"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.452406 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/4885bea5-bdc7-472b-8f70-e110dd9b8c06-config-data-generated\") pod \"4885bea5-bdc7-472b-8f70-e110dd9b8c06\" (UID: \"4885bea5-bdc7-472b-8f70-e110dd9b8c06\") " Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.452455 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4885bea5-bdc7-472b-8f70-e110dd9b8c06-combined-ca-bundle\") pod \"4885bea5-bdc7-472b-8f70-e110dd9b8c06\" (UID: \"4885bea5-bdc7-472b-8f70-e110dd9b8c06\") " Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.452515 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2f29c\" (UniqueName: \"kubernetes.io/projected/4885bea5-bdc7-472b-8f70-e110dd9b8c06-kube-api-access-2f29c\") pod \"4885bea5-bdc7-472b-8f70-e110dd9b8c06\" (UID: \"4885bea5-bdc7-472b-8f70-e110dd9b8c06\") " Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.452579 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tvjx8\" (UniqueName: \"kubernetes.io/projected/90982d87-fc0f-49d0-a400-4155e4f3b000-kube-api-access-tvjx8\") pod \"90982d87-fc0f-49d0-a400-4155e4f3b000\" (UID: \"90982d87-fc0f-49d0-a400-4155e4f3b000\") " Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.452612 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/4885bea5-bdc7-472b-8f70-e110dd9b8c06-kolla-config\") pod \"4885bea5-bdc7-472b-8f70-e110dd9b8c06\" (UID: \"4885bea5-bdc7-472b-8f70-e110dd9b8c06\") " Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.453428 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/4885bea5-bdc7-472b-8f70-e110dd9b8c06-config-data-default\") pod \"4885bea5-bdc7-472b-8f70-e110dd9b8c06\" (UID: \"4885bea5-bdc7-472b-8f70-e110dd9b8c06\") " Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.453469 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/4885bea5-bdc7-472b-8f70-e110dd9b8c06-galera-tls-certs\") pod \"4885bea5-bdc7-472b-8f70-e110dd9b8c06\" (UID: \"4885bea5-bdc7-472b-8f70-e110dd9b8c06\") " Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.453558 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/4885bea5-bdc7-472b-8f70-e110dd9b8c06-operator-scripts\") pod \"4885bea5-bdc7-472b-8f70-e110dd9b8c06\" (UID: \"4885bea5-bdc7-472b-8f70-e110dd9b8c06\") " Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.453591 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/90982d87-fc0f-49d0-a400-4155e4f3b000-operator-scripts\") pod \"90982d87-fc0f-49d0-a400-4155e4f3b000\" (UID: \"90982d87-fc0f-49d0-a400-4155e4f3b000\") " Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.453612 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"mysql-db\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") pod \"4885bea5-bdc7-472b-8f70-e110dd9b8c06\" (UID: \"4885bea5-bdc7-472b-8f70-e110dd9b8c06\") " Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.454368 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4885bea5-bdc7-472b-8f70-e110dd9b8c06-config-data-generated" (OuterVolumeSpecName: "config-data-generated") pod "4885bea5-bdc7-472b-8f70-e110dd9b8c06" (UID: "4885bea5-bdc7-472b-8f70-e110dd9b8c06"). InnerVolumeSpecName "config-data-generated". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.455257 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c6b2b\" (UniqueName: \"kubernetes.io/projected/9e7f8135-737c-4639-bdd8-46d68e1a617d-kube-api-access-c6b2b\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.455276 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9f16b3a2-bc26-4a63-8f8c-836611f0d320-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.455287 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/9f16b3a2-bc26-4a63-8f8c-836611f0d320-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.455298 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/044996b4-e444-4486-9503-61d776ec849f-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.455306 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/4885bea5-bdc7-472b-8f70-e110dd9b8c06-config-data-generated\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.455324 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") on node \"crc\" " Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.455335 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/044996b4-e444-4486-9503-61d776ec849f-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.455344 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/43c58ec7-474a-49bc-921f-89cf47b67811-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.455353 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jzdnb\" (UniqueName: \"kubernetes.io/projected/9292b258-885b-40a8-8b7d-9ed28a747bc7-kube-api-access-jzdnb\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.455362 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/43c58ec7-474a-49bc-921f-89cf47b67811-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.455371 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9e7f8135-737c-4639-bdd8-46d68e1a617d-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.455379 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-492g4\" (UniqueName: \"kubernetes.io/projected/43c58ec7-474a-49bc-921f-89cf47b67811-kube-api-access-492g4\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.455388 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9292b258-885b-40a8-8b7d-9ed28a747bc7-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.455396 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8dpdp\" (UniqueName: \"kubernetes.io/projected/9f16b3a2-bc26-4a63-8f8c-836611f0d320-kube-api-access-8dpdp\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.455405 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hhvrb\" (UniqueName: \"kubernetes.io/projected/044996b4-e444-4486-9503-61d776ec849f-kube-api-access-hhvrb\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.455416 5120 reconciler_common.go:299] "Volume detached for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/43c58ec7-474a-49bc-921f-89cf47b67811-ovn-rundir\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.455424 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/044996b4-e444-4486-9503-61d776ec849f-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.455432 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9292b258-885b-40a8-8b7d-9ed28a747bc7-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.455440 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9e7f8135-737c-4639-bdd8-46d68e1a617d-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.458968 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4885bea5-bdc7-472b-8f70-e110dd9b8c06-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "4885bea5-bdc7-472b-8f70-e110dd9b8c06" (UID: "4885bea5-bdc7-472b-8f70-e110dd9b8c06"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.460212 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4885bea5-bdc7-472b-8f70-e110dd9b8c06-config-data-default" (OuterVolumeSpecName: "config-data-default") pod "4885bea5-bdc7-472b-8f70-e110dd9b8c06" (UID: "4885bea5-bdc7-472b-8f70-e110dd9b8c06"). InnerVolumeSpecName "config-data-default". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.460701 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/90982d87-fc0f-49d0-a400-4155e4f3b000-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "90982d87-fc0f-49d0-a400-4155e4f3b000" (UID: "90982d87-fc0f-49d0-a400-4155e4f3b000"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.461790 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4885bea5-bdc7-472b-8f70-e110dd9b8c06-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "4885bea5-bdc7-472b-8f70-e110dd9b8c06" (UID: "4885bea5-bdc7-472b-8f70-e110dd9b8c06"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.464391 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90982d87-fc0f-49d0-a400-4155e4f3b000-kube-api-access-tvjx8" (OuterVolumeSpecName: "kube-api-access-tvjx8") pod "90982d87-fc0f-49d0-a400-4155e4f3b000" (UID: "90982d87-fc0f-49d0-a400-4155e4f3b000"). InnerVolumeSpecName "kube-api-access-tvjx8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.465165 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4885bea5-bdc7-472b-8f70-e110dd9b8c06-kube-api-access-2f29c" (OuterVolumeSpecName: "kube-api-access-2f29c") pod "4885bea5-bdc7-472b-8f70-e110dd9b8c06" (UID: "4885bea5-bdc7-472b-8f70-e110dd9b8c06"). InnerVolumeSpecName "kube-api-access-2f29c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.478677 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage18-crc" (OuterVolumeSpecName: "mysql-db") pod "4885bea5-bdc7-472b-8f70-e110dd9b8c06" (UID: "4885bea5-bdc7-472b-8f70-e110dd9b8c06"). InnerVolumeSpecName "local-storage18-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.483423 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.483482 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"9292b258-885b-40a8-8b7d-9ed28a747bc7","Type":"ContainerDied","Data":"c4e317d02c501ce91e27c064b8faccd19f268254274db10077250e86eb4fb358"} Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.483530 5120 scope.go:117] "RemoveContainer" containerID="f19f6e35585d519c6c4887128e22a173629daff0e73ecce16798b83d694eb56d" Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.489796 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-4w76w" event={"ID":"1b59d8b3-3000-4e61-8e3c-50df40fc5181","Type":"ContainerStarted","Data":"85bbc914bacb73f33e0c57c0ebd483d60bcd0040127d7a501adf7eda67ad9d18"} Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.490230 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-4w76w" Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.492911 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-northd-0_43c58ec7-474a-49bc-921f-89cf47b67811/ovn-northd/0.log" Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.493025 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"43c58ec7-474a-49bc-921f-89cf47b67811","Type":"ContainerDied","Data":"fdfda74e8dea1743568bff9193171e47ef9404e97f22d3c41f3b371490216c0c"} Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.493049 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.495305 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"60fe13eb-066c-4985-bb16-1a201e5c339c","Type":"ContainerDied","Data":"d3fc3812292aa6ea211b7d08855a1b4384ef8f553c75145fad60438d88db61e1"} Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.495386 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.498503 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-796f4f9644-59hlg" Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.498600 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-796f4f9644-59hlg" event={"ID":"9f16b3a2-bc26-4a63-8f8c-836611f0d320","Type":"ContainerDied","Data":"bb48372b68c9bc4066fb62520c9aabc044968dabf2c988b20d2d88ef013d62bc"} Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.500294 5120 generic.go:358] "Generic (PLEG): container finished" podID="4885bea5-bdc7-472b-8f70-e110dd9b8c06" containerID="c833fe04b4a70d900cce526171b73ba0d1127695de57d343cd58245cc8c7ce58" exitCode=0 Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.500379 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"4885bea5-bdc7-472b-8f70-e110dd9b8c06","Type":"ContainerDied","Data":"c833fe04b4a70d900cce526171b73ba0d1127695de57d343cd58245cc8c7ce58"} Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.500394 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"4885bea5-bdc7-472b-8f70-e110dd9b8c06","Type":"ContainerDied","Data":"e5880733cde3ad118ba2636713bd344419a5c01552ec4ae5f849085e22205c3f"} Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.500451 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.505419 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-5bfb7678f9-6dzmx" event={"ID":"7e059927-938d-4449-a260-90053be70ec9","Type":"ContainerDied","Data":"837165edc5cc416d379b2f8ff2be5601feb8c1103fe0aeda4578d419db1abb93"} Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.505528 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-5bfb7678f9-6dzmx" Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.508197 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-4w76w" podStartSLOduration=6.508184813 podStartE2EDuration="6.508184813s" podCreationTimestamp="2026-03-16 16:17:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:18:05.503904978 +0000 UTC m=+2787.657836635" watchObservedRunningTime="2026-03-16 16:18:05.508184813 +0000 UTC m=+2787.662116470" Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.508806 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-bh8f4" event={"ID":"90982d87-fc0f-49d0-a400-4155e4f3b000","Type":"ContainerDied","Data":"26e8b9f9697804206263041dfac96ee0ec7752f779185773bc942ee9e6460745"} Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.508826 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-bh8f4" Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.510840 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage01-crc" (UniqueName: "kubernetes.io/local-volume/local-storage01-crc") on node "crc" Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.512903 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"044996b4-e444-4486-9503-61d776ec849f","Type":"ContainerDied","Data":"f257a011cef25035f6eb0ee29b2821db5b5395afa9c4ce5becc5e1bd7f99089e"} Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.512986 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.528585 5120 scope.go:117] "RemoveContainer" containerID="67504ceae616481d35ca3f878a42ab809e32f965b94f09a9c14bb47581bf94e4" Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.528750 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/044996b4-e444-4486-9503-61d776ec849f-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "044996b4-e444-4486-9503-61d776ec849f" (UID: "044996b4-e444-4486-9503-61d776ec849f"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.529146 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f16b3a2-bc26-4a63-8f8c-836611f0d320-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "9f16b3a2-bc26-4a63-8f8c-836611f0d320" (UID: "9f16b3a2-bc26-4a63-8f8c-836611f0d320"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.533701 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"9e7f8135-737c-4639-bdd8-46d68e1a617d","Type":"ContainerDied","Data":"e46ecf7ac5c2398dc3163b9caec10fd908db95f3669447d3eed5809af484a2f9"} Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.533815 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.540646 5120 generic.go:358] "Generic (PLEG): container finished" podID="e4cb4b19-5e1d-4cb5-8cc1-e51c0b445e06" containerID="96bf948107e35afd61b46aed0827c2cfb513aa41ab259f6ad44d2f616e83f0d0" exitCode=0 Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.540707 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561298-6qsf7" event={"ID":"e4cb4b19-5e1d-4cb5-8cc1-e51c0b445e06","Type":"ContainerDied","Data":"96bf948107e35afd61b46aed0827c2cfb513aa41ab259f6ad44d2f616e83f0d0"} Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.543343 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-9c08-account-create-update-w7m2p" Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.553291 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-77f5d87454-bxpdp" Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.553561 5120 scope.go:117] "RemoveContainer" containerID="c129c8987a210dccaf5b5f1284053994d439c82b3f7a189597964833bd162b00" Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.553664 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-77f5d87454-bxpdp" event={"ID":"3fe73309-f917-40c4-a606-511f1547daf4","Type":"ContainerDied","Data":"7a9f0951e2ab89eff983b7a8851442bc26d500ea04503047c86877fa3eae66eb"} Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.553805 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-cbf797d74-8frg4" Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.554198 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.556989 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/4885bea5-bdc7-472b-8f70-e110dd9b8c06-config-data-default\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.557020 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/4885bea5-bdc7-472b-8f70-e110dd9b8c06-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.557030 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/90982d87-fc0f-49d0-a400-4155e4f3b000-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.557049 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage18-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") on node \"crc\" " Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.557059 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/044996b4-e444-4486-9503-61d776ec849f-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.557070 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.557081 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2f29c\" (UniqueName: \"kubernetes.io/projected/4885bea5-bdc7-472b-8f70-e110dd9b8c06-kube-api-access-2f29c\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.557092 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tvjx8\" (UniqueName: \"kubernetes.io/projected/90982d87-fc0f-49d0-a400-4155e4f3b000-kube-api-access-tvjx8\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.557104 5120 reconciler_common.go:299] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/4885bea5-bdc7-472b-8f70-e110dd9b8c06-kolla-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.557115 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/9f16b3a2-bc26-4a63-8f8c-836611f0d320-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.571978 5120 scope.go:117] "RemoveContainer" containerID="91983d4216ebe44a593c5fc4a07bcf3d059ad912a84a5035330dd9bd796a595d" Mar 16 16:18:05 crc kubenswrapper[5120]: I0316 16:18:05.590366 5120 scope.go:117] "RemoveContainer" containerID="c3d6d0476f8615371dfec590da87aa17915191fd8befb1ec3bcb8fe489ed8d5c" Mar 16 16:18:06 crc kubenswrapper[5120]: I0316 16:18:06.384566 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9292b258-885b-40a8-8b7d-9ed28a747bc7-nova-metadata-tls-certs" (OuterVolumeSpecName: "nova-metadata-tls-certs") pod "9292b258-885b-40a8-8b7d-9ed28a747bc7" (UID: "9292b258-885b-40a8-8b7d-9ed28a747bc7"). InnerVolumeSpecName "nova-metadata-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:18:06 crc kubenswrapper[5120]: I0316 16:18:06.408508 5120 scope.go:117] "RemoveContainer" containerID="0fb5e3d8d5edd7398c14a6ea88b6ab188a65bacb06e33f6b4414f043c40c548e" Mar 16 16:18:06 crc kubenswrapper[5120]: I0316 16:18:06.409801 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f16b3a2-bc26-4a63-8f8c-836611f0d320-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "9f16b3a2-bc26-4a63-8f8c-836611f0d320" (UID: "9f16b3a2-bc26-4a63-8f8c-836611f0d320"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:18:06 crc kubenswrapper[5120]: I0316 16:18:06.457376 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-5bfb7678f9-6dzmx"] Mar 16 16:18:06 crc kubenswrapper[5120]: I0316 16:18:06.472270 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/044996b4-e444-4486-9503-61d776ec849f-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "044996b4-e444-4486-9503-61d776ec849f" (UID: "044996b4-e444-4486-9503-61d776ec849f"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:18:06 crc kubenswrapper[5120]: I0316 16:18:06.475716 5120 reconciler_common.go:299] "Volume detached for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/9292b258-885b-40a8-8b7d-9ed28a747bc7-nova-metadata-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:06 crc kubenswrapper[5120]: I0316 16:18:06.475753 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9f16b3a2-bc26-4a63-8f8c-836611f0d320-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:06 crc kubenswrapper[5120]: I0316 16:18:06.475781 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/044996b4-e444-4486-9503-61d776ec849f-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:06 crc kubenswrapper[5120]: I0316 16:18:06.481334 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/43c58ec7-474a-49bc-921f-89cf47b67811-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "43c58ec7-474a-49bc-921f-89cf47b67811" (UID: "43c58ec7-474a-49bc-921f-89cf47b67811"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:18:06 crc kubenswrapper[5120]: I0316 16:18:06.491126 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e7f8135-737c-4639-bdd8-46d68e1a617d-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "9e7f8135-737c-4639-bdd8-46d68e1a617d" (UID: "9e7f8135-737c-4639-bdd8-46d68e1a617d"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:18:06 crc kubenswrapper[5120]: I0316 16:18:06.501720 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-worker-5bfb7678f9-6dzmx"] Mar 16 16:18:06 crc kubenswrapper[5120]: I0316 16:18:06.511572 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:18:06 crc kubenswrapper[5120]: I0316 16:18:06.513335 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/044996b4-e444-4486-9503-61d776ec849f-config-data" (OuterVolumeSpecName: "config-data") pod "044996b4-e444-4486-9503-61d776ec849f" (UID: "044996b4-e444-4486-9503-61d776ec849f"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:18:06 crc kubenswrapper[5120]: I0316 16:18:06.513372 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e7f8135-737c-4639-bdd8-46d68e1a617d-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "9e7f8135-737c-4639-bdd8-46d68e1a617d" (UID: "9e7f8135-737c-4639-bdd8-46d68e1a617d"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:18:06 crc kubenswrapper[5120]: I0316 16:18:06.527543 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9292b258-885b-40a8-8b7d-9ed28a747bc7-config-data" (OuterVolumeSpecName: "config-data") pod "9292b258-885b-40a8-8b7d-9ed28a747bc7" (UID: "9292b258-885b-40a8-8b7d-9ed28a747bc7"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:18:06 crc kubenswrapper[5120]: I0316 16:18:06.530201 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:18:06 crc kubenswrapper[5120]: I0316 16:18:06.541327 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-77f5d87454-bxpdp"] Mar 16 16:18:06 crc kubenswrapper[5120]: I0316 16:18:06.555703 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4885bea5-bdc7-472b-8f70-e110dd9b8c06-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "4885bea5-bdc7-472b-8f70-e110dd9b8c06" (UID: "4885bea5-bdc7-472b-8f70-e110dd9b8c06"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:18:06 crc kubenswrapper[5120]: I0316 16:18:06.557970 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4885bea5-bdc7-472b-8f70-e110dd9b8c06-galera-tls-certs" (OuterVolumeSpecName: "galera-tls-certs") pod "4885bea5-bdc7-472b-8f70-e110dd9b8c06" (UID: "4885bea5-bdc7-472b-8f70-e110dd9b8c06"). InnerVolumeSpecName "galera-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:18:06 crc kubenswrapper[5120]: I0316 16:18:06.558071 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f16b3a2-bc26-4a63-8f8c-836611f0d320-config-data" (OuterVolumeSpecName: "config-data") pod "9f16b3a2-bc26-4a63-8f8c-836611f0d320" (UID: "9f16b3a2-bc26-4a63-8f8c-836611f0d320"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:18:06 crc kubenswrapper[5120]: I0316 16:18:06.559288 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-77f5d87454-bxpdp"] Mar 16 16:18:06 crc kubenswrapper[5120]: I0316 16:18:06.581064 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/43c58ec7-474a-49bc-921f-89cf47b67811-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:06 crc kubenswrapper[5120]: I0316 16:18:06.581091 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9292b258-885b-40a8-8b7d-9ed28a747bc7-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:06 crc kubenswrapper[5120]: I0316 16:18:06.581100 5120 reconciler_common.go:299] "Volume detached for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/4885bea5-bdc7-472b-8f70-e110dd9b8c06-galera-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:06 crc kubenswrapper[5120]: I0316 16:18:06.581108 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9f16b3a2-bc26-4a63-8f8c-836611f0d320-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:06 crc kubenswrapper[5120]: I0316 16:18:06.581117 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9e7f8135-737c-4639-bdd8-46d68e1a617d-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:06 crc kubenswrapper[5120]: I0316 16:18:06.581125 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/044996b4-e444-4486-9503-61d776ec849f-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:06 crc kubenswrapper[5120]: I0316 16:18:06.581133 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4885bea5-bdc7-472b-8f70-e110dd9b8c06-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:06 crc kubenswrapper[5120]: I0316 16:18:06.581142 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/9e7f8135-737c-4639-bdd8-46d68e1a617d-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:06 crc kubenswrapper[5120]: I0316 16:18:06.582394 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/43c58ec7-474a-49bc-921f-89cf47b67811-ovn-northd-tls-certs" (OuterVolumeSpecName: "ovn-northd-tls-certs") pod "43c58ec7-474a-49bc-921f-89cf47b67811" (UID: "43c58ec7-474a-49bc-921f-89cf47b67811"). InnerVolumeSpecName "ovn-northd-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:18:06 crc kubenswrapper[5120]: I0316 16:18:06.583875 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:18:06 crc kubenswrapper[5120]: I0316 16:18:06.589554 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:18:06 crc kubenswrapper[5120]: I0316 16:18:06.599059 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e7f8135-737c-4639-bdd8-46d68e1a617d-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "9e7f8135-737c-4639-bdd8-46d68e1a617d" (UID: "9e7f8135-737c-4639-bdd8-46d68e1a617d"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:18:06 crc kubenswrapper[5120]: I0316 16:18:06.600676 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage18-crc" (UniqueName: "kubernetes.io/local-volume/local-storage18-crc") on node "crc" Mar 16 16:18:06 crc kubenswrapper[5120]: I0316 16:18:06.612600 5120 generic.go:358] "Generic (PLEG): container finished" podID="d762c585-b44b-475d-a371-507fa2f9439a" containerID="2dae34322c3b177952bf14227b112419b3dd714c550886bb4270633cbccfcb9d" exitCode=0 Mar 16 16:18:06 crc kubenswrapper[5120]: I0316 16:18:06.613462 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-6f9485b564-dlsjq" event={"ID":"d762c585-b44b-475d-a371-507fa2f9439a","Type":"ContainerDied","Data":"2dae34322c3b177952bf14227b112419b3dd714c550886bb4270633cbccfcb9d"} Mar 16 16:18:06 crc kubenswrapper[5120]: I0316 16:18:06.620117 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-bh8f4"] Mar 16 16:18:06 crc kubenswrapper[5120]: I0316 16:18:06.634505 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/43c58ec7-474a-49bc-921f-89cf47b67811-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "43c58ec7-474a-49bc-921f-89cf47b67811" (UID: "43c58ec7-474a-49bc-921f-89cf47b67811"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:18:06 crc kubenswrapper[5120]: I0316 16:18:06.643959 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-bh8f4"] Mar 16 16:18:06 crc kubenswrapper[5120]: I0316 16:18:06.657965 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f16b3a2-bc26-4a63-8f8c-836611f0d320-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "9f16b3a2-bc26-4a63-8f8c-836611f0d320" (UID: "9f16b3a2-bc26-4a63-8f8c-836611f0d320"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:18:06 crc kubenswrapper[5120]: I0316 16:18:06.658697 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-9c08-account-create-update-w7m2p"] Mar 16 16:18:06 crc kubenswrapper[5120]: I0316 16:18:06.663895 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-9c08-account-create-update-w7m2p"] Mar 16 16:18:06 crc kubenswrapper[5120]: I0316 16:18:06.686530 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3fe73309-f917-40c4-a606-511f1547daf4" path="/var/lib/kubelet/pods/3fe73309-f917-40c4-a606-511f1547daf4/volumes" Mar 16 16:18:06 crc kubenswrapper[5120]: I0316 16:18:06.687167 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="60fe13eb-066c-4985-bb16-1a201e5c339c" path="/var/lib/kubelet/pods/60fe13eb-066c-4985-bb16-1a201e5c339c/volumes" Mar 16 16:18:06 crc kubenswrapper[5120]: I0316 16:18:06.687700 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="70f64346-8cba-4ea9-b229-c1ba5012ca42" path="/var/lib/kubelet/pods/70f64346-8cba-4ea9-b229-c1ba5012ca42/volumes" Mar 16 16:18:06 crc kubenswrapper[5120]: I0316 16:18:06.688573 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7e059927-938d-4449-a260-90053be70ec9" path="/var/lib/kubelet/pods/7e059927-938d-4449-a260-90053be70ec9/volumes" Mar 16 16:18:06 crc kubenswrapper[5120]: I0316 16:18:06.689211 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="90982d87-fc0f-49d0-a400-4155e4f3b000" path="/var/lib/kubelet/pods/90982d87-fc0f-49d0-a400-4155e4f3b000/volumes" Mar 16 16:18:06 crc kubenswrapper[5120]: I0316 16:18:06.690017 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ff974854-15db-4188-b6dc-e330110c2427" path="/var/lib/kubelet/pods/ff974854-15db-4188-b6dc-e330110c2427/volumes" Mar 16 16:18:06 crc kubenswrapper[5120]: I0316 16:18:06.690181 5120 reconciler_common.go:299] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/43c58ec7-474a-49bc-921f-89cf47b67811-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:06 crc kubenswrapper[5120]: I0316 16:18:06.692462 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/9f16b3a2-bc26-4a63-8f8c-836611f0d320-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:06 crc kubenswrapper[5120]: I0316 16:18:06.692565 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage18-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:06 crc kubenswrapper[5120]: I0316 16:18:06.692620 5120 reconciler_common.go:299] "Volume detached for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/43c58ec7-474a-49bc-921f-89cf47b67811-ovn-northd-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:06 crc kubenswrapper[5120]: I0316 16:18:06.692686 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/9e7f8135-737c-4639-bdd8-46d68e1a617d-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:06 crc kubenswrapper[5120]: I0316 16:18:06.692046 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-cbf797d74-8frg4"] Mar 16 16:18:06 crc kubenswrapper[5120]: I0316 16:18:06.692823 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-cbf797d74-8frg4"] Mar 16 16:18:06 crc kubenswrapper[5120]: I0316 16:18:06.878326 5120 scope.go:117] "RemoveContainer" containerID="cebcd6329c9e1b957b3f4bffa93b5a65003bd9fd06134f8e8d62306f23ec1220" Mar 16 16:18:06 crc kubenswrapper[5120]: I0316 16:18:06.897594 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 16:18:06 crc kubenswrapper[5120]: I0316 16:18:06.914555 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 16:18:06 crc kubenswrapper[5120]: I0316 16:18:06.921699 5120 scope.go:117] "RemoveContainer" containerID="3d3613157c725663b3645ab202fb54ad95ebbe067187047f60bb2b1749e436ce" Mar 16 16:18:06 crc kubenswrapper[5120]: I0316 16:18:06.935770 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 16:18:06 crc kubenswrapper[5120]: I0316 16:18:06.947651 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 16:18:06 crc kubenswrapper[5120]: I0316 16:18:06.957362 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-796f4f9644-59hlg"] Mar 16 16:18:06 crc kubenswrapper[5120]: I0316 16:18:06.962855 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-api-796f4f9644-59hlg"] Mar 16 16:18:06 crc kubenswrapper[5120]: I0316 16:18:06.968194 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:18:06 crc kubenswrapper[5120]: I0316 16:18:06.973993 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:18:06 crc kubenswrapper[5120]: I0316 16:18:06.979368 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:18:06 crc kubenswrapper[5120]: I0316 16:18:06.984821 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:18:07 crc kubenswrapper[5120]: I0316 16:18:07.000120 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:18:07 crc kubenswrapper[5120]: I0316 16:18:07.007443 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:18:07 crc kubenswrapper[5120]: I0316 16:18:07.021794 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-6f9485b564-dlsjq" Mar 16 16:18:07 crc kubenswrapper[5120]: I0316 16:18:07.024840 5120 scope.go:117] "RemoveContainer" containerID="c833fe04b4a70d900cce526171b73ba0d1127695de57d343cd58245cc8c7ce58" Mar 16 16:18:07 crc kubenswrapper[5120]: I0316 16:18:07.028227 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561298-6qsf7" Mar 16 16:18:07 crc kubenswrapper[5120]: I0316 16:18:07.061095 5120 scope.go:117] "RemoveContainer" containerID="331f5131feda92dcfd2ae478bd7fceddc5894d75c7dcb0e5bbc21e423c1443f2" Mar 16 16:18:07 crc kubenswrapper[5120]: I0316 16:18:07.083061 5120 scope.go:117] "RemoveContainer" containerID="c833fe04b4a70d900cce526171b73ba0d1127695de57d343cd58245cc8c7ce58" Mar 16 16:18:07 crc kubenswrapper[5120]: E0316 16:18:07.083558 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c833fe04b4a70d900cce526171b73ba0d1127695de57d343cd58245cc8c7ce58\": container with ID starting with c833fe04b4a70d900cce526171b73ba0d1127695de57d343cd58245cc8c7ce58 not found: ID does not exist" containerID="c833fe04b4a70d900cce526171b73ba0d1127695de57d343cd58245cc8c7ce58" Mar 16 16:18:07 crc kubenswrapper[5120]: I0316 16:18:07.083586 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c833fe04b4a70d900cce526171b73ba0d1127695de57d343cd58245cc8c7ce58"} err="failed to get container status \"c833fe04b4a70d900cce526171b73ba0d1127695de57d343cd58245cc8c7ce58\": rpc error: code = NotFound desc = could not find container \"c833fe04b4a70d900cce526171b73ba0d1127695de57d343cd58245cc8c7ce58\": container with ID starting with c833fe04b4a70d900cce526171b73ba0d1127695de57d343cd58245cc8c7ce58 not found: ID does not exist" Mar 16 16:18:07 crc kubenswrapper[5120]: I0316 16:18:07.083606 5120 scope.go:117] "RemoveContainer" containerID="331f5131feda92dcfd2ae478bd7fceddc5894d75c7dcb0e5bbc21e423c1443f2" Mar 16 16:18:07 crc kubenswrapper[5120]: E0316 16:18:07.084084 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"331f5131feda92dcfd2ae478bd7fceddc5894d75c7dcb0e5bbc21e423c1443f2\": container with ID starting with 331f5131feda92dcfd2ae478bd7fceddc5894d75c7dcb0e5bbc21e423c1443f2 not found: ID does not exist" containerID="331f5131feda92dcfd2ae478bd7fceddc5894d75c7dcb0e5bbc21e423c1443f2" Mar 16 16:18:07 crc kubenswrapper[5120]: I0316 16:18:07.084103 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"331f5131feda92dcfd2ae478bd7fceddc5894d75c7dcb0e5bbc21e423c1443f2"} err="failed to get container status \"331f5131feda92dcfd2ae478bd7fceddc5894d75c7dcb0e5bbc21e423c1443f2\": rpc error: code = NotFound desc = could not find container \"331f5131feda92dcfd2ae478bd7fceddc5894d75c7dcb0e5bbc21e423c1443f2\": container with ID starting with 331f5131feda92dcfd2ae478bd7fceddc5894d75c7dcb0e5bbc21e423c1443f2 not found: ID does not exist" Mar 16 16:18:07 crc kubenswrapper[5120]: I0316 16:18:07.084117 5120 scope.go:117] "RemoveContainer" containerID="e38ea22442a3e5da16488296d5a4582eb3a1ae936d22b1e4246f21d7c1a26d34" Mar 16 16:18:07 crc kubenswrapper[5120]: I0316 16:18:07.105027 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7hn9x\" (UniqueName: \"kubernetes.io/projected/e4cb4b19-5e1d-4cb5-8cc1-e51c0b445e06-kube-api-access-7hn9x\") pod \"e4cb4b19-5e1d-4cb5-8cc1-e51c0b445e06\" (UID: \"e4cb4b19-5e1d-4cb5-8cc1-e51c0b445e06\") " Mar 16 16:18:07 crc kubenswrapper[5120]: I0316 16:18:07.105280 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d762c585-b44b-475d-a371-507fa2f9439a-combined-ca-bundle\") pod \"d762c585-b44b-475d-a371-507fa2f9439a\" (UID: \"d762c585-b44b-475d-a371-507fa2f9439a\") " Mar 16 16:18:07 crc kubenswrapper[5120]: I0316 16:18:07.105376 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/d762c585-b44b-475d-a371-507fa2f9439a-public-tls-certs\") pod \"d762c585-b44b-475d-a371-507fa2f9439a\" (UID: \"d762c585-b44b-475d-a371-507fa2f9439a\") " Mar 16 16:18:07 crc kubenswrapper[5120]: I0316 16:18:07.105445 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d762c585-b44b-475d-a371-507fa2f9439a-scripts\") pod \"d762c585-b44b-475d-a371-507fa2f9439a\" (UID: \"d762c585-b44b-475d-a371-507fa2f9439a\") " Mar 16 16:18:07 crc kubenswrapper[5120]: I0316 16:18:07.105562 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/d762c585-b44b-475d-a371-507fa2f9439a-fernet-keys\") pod \"d762c585-b44b-475d-a371-507fa2f9439a\" (UID: \"d762c585-b44b-475d-a371-507fa2f9439a\") " Mar 16 16:18:07 crc kubenswrapper[5120]: I0316 16:18:07.105682 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/d762c585-b44b-475d-a371-507fa2f9439a-internal-tls-certs\") pod \"d762c585-b44b-475d-a371-507fa2f9439a\" (UID: \"d762c585-b44b-475d-a371-507fa2f9439a\") " Mar 16 16:18:07 crc kubenswrapper[5120]: I0316 16:18:07.105771 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d762c585-b44b-475d-a371-507fa2f9439a-config-data\") pod \"d762c585-b44b-475d-a371-507fa2f9439a\" (UID: \"d762c585-b44b-475d-a371-507fa2f9439a\") " Mar 16 16:18:07 crc kubenswrapper[5120]: I0316 16:18:07.105904 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/d762c585-b44b-475d-a371-507fa2f9439a-credential-keys\") pod \"d762c585-b44b-475d-a371-507fa2f9439a\" (UID: \"d762c585-b44b-475d-a371-507fa2f9439a\") " Mar 16 16:18:07 crc kubenswrapper[5120]: I0316 16:18:07.105977 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kj978\" (UniqueName: \"kubernetes.io/projected/d762c585-b44b-475d-a371-507fa2f9439a-kube-api-access-kj978\") pod \"d762c585-b44b-475d-a371-507fa2f9439a\" (UID: \"d762c585-b44b-475d-a371-507fa2f9439a\") " Mar 16 16:18:07 crc kubenswrapper[5120]: I0316 16:18:07.110047 5120 scope.go:117] "RemoveContainer" containerID="d430d21560c12eca992abdde06e718c2e3d71e50d61e91ef2285be76ee5901bd" Mar 16 16:18:07 crc kubenswrapper[5120]: I0316 16:18:07.110327 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d762c585-b44b-475d-a371-507fa2f9439a-kube-api-access-kj978" (OuterVolumeSpecName: "kube-api-access-kj978") pod "d762c585-b44b-475d-a371-507fa2f9439a" (UID: "d762c585-b44b-475d-a371-507fa2f9439a"). InnerVolumeSpecName "kube-api-access-kj978". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:18:07 crc kubenswrapper[5120]: I0316 16:18:07.111662 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d762c585-b44b-475d-a371-507fa2f9439a-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "d762c585-b44b-475d-a371-507fa2f9439a" (UID: "d762c585-b44b-475d-a371-507fa2f9439a"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:18:07 crc kubenswrapper[5120]: I0316 16:18:07.113904 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d762c585-b44b-475d-a371-507fa2f9439a-scripts" (OuterVolumeSpecName: "scripts") pod "d762c585-b44b-475d-a371-507fa2f9439a" (UID: "d762c585-b44b-475d-a371-507fa2f9439a"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:18:07 crc kubenswrapper[5120]: I0316 16:18:07.114789 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d762c585-b44b-475d-a371-507fa2f9439a-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "d762c585-b44b-475d-a371-507fa2f9439a" (UID: "d762c585-b44b-475d-a371-507fa2f9439a"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:18:07 crc kubenswrapper[5120]: I0316 16:18:07.116958 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e4cb4b19-5e1d-4cb5-8cc1-e51c0b445e06-kube-api-access-7hn9x" (OuterVolumeSpecName: "kube-api-access-7hn9x") pod "e4cb4b19-5e1d-4cb5-8cc1-e51c0b445e06" (UID: "e4cb4b19-5e1d-4cb5-8cc1-e51c0b445e06"). InnerVolumeSpecName "kube-api-access-7hn9x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:18:07 crc kubenswrapper[5120]: I0316 16:18:07.127792 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d762c585-b44b-475d-a371-507fa2f9439a-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "d762c585-b44b-475d-a371-507fa2f9439a" (UID: "d762c585-b44b-475d-a371-507fa2f9439a"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:18:07 crc kubenswrapper[5120]: I0316 16:18:07.150063 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d762c585-b44b-475d-a371-507fa2f9439a-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "d762c585-b44b-475d-a371-507fa2f9439a" (UID: "d762c585-b44b-475d-a371-507fa2f9439a"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:18:07 crc kubenswrapper[5120]: I0316 16:18:07.150224 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d762c585-b44b-475d-a371-507fa2f9439a-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "d762c585-b44b-475d-a371-507fa2f9439a" (UID: "d762c585-b44b-475d-a371-507fa2f9439a"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:18:07 crc kubenswrapper[5120]: I0316 16:18:07.150711 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d762c585-b44b-475d-a371-507fa2f9439a-config-data" (OuterVolumeSpecName: "config-data") pod "d762c585-b44b-475d-a371-507fa2f9439a" (UID: "d762c585-b44b-475d-a371-507fa2f9439a"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:18:07 crc kubenswrapper[5120]: I0316 16:18:07.152210 5120 scope.go:117] "RemoveContainer" containerID="6bd6e439036f2cf71848ab77929e2541ab683472c7163b47058922e907b978d2" Mar 16 16:18:07 crc kubenswrapper[5120]: I0316 16:18:07.175866 5120 scope.go:117] "RemoveContainer" containerID="8e88512fc32d8a4ecf18ca4d49876068a8159a6a0e0b4a45be98703daa80d90d" Mar 16 16:18:07 crc kubenswrapper[5120]: I0316 16:18:07.196398 5120 scope.go:117] "RemoveContainer" containerID="a7009166ee17bc972006fca5fae2160d1fd948f482b659e9b784be0cafb5a261" Mar 16 16:18:07 crc kubenswrapper[5120]: I0316 16:18:07.208231 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d762c585-b44b-475d-a371-507fa2f9439a-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:07 crc kubenswrapper[5120]: I0316 16:18:07.208270 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/d762c585-b44b-475d-a371-507fa2f9439a-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:07 crc kubenswrapper[5120]: I0316 16:18:07.208283 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d762c585-b44b-475d-a371-507fa2f9439a-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:07 crc kubenswrapper[5120]: I0316 16:18:07.208295 5120 reconciler_common.go:299] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/d762c585-b44b-475d-a371-507fa2f9439a-fernet-keys\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:07 crc kubenswrapper[5120]: I0316 16:18:07.208306 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/d762c585-b44b-475d-a371-507fa2f9439a-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:07 crc kubenswrapper[5120]: I0316 16:18:07.208316 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d762c585-b44b-475d-a371-507fa2f9439a-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:07 crc kubenswrapper[5120]: I0316 16:18:07.208328 5120 reconciler_common.go:299] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/d762c585-b44b-475d-a371-507fa2f9439a-credential-keys\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:07 crc kubenswrapper[5120]: I0316 16:18:07.208339 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kj978\" (UniqueName: \"kubernetes.io/projected/d762c585-b44b-475d-a371-507fa2f9439a-kube-api-access-kj978\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:07 crc kubenswrapper[5120]: I0316 16:18:07.208351 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7hn9x\" (UniqueName: \"kubernetes.io/projected/e4cb4b19-5e1d-4cb5-8cc1-e51c0b445e06-kube-api-access-7hn9x\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:07 crc kubenswrapper[5120]: I0316 16:18:07.213085 5120 scope.go:117] "RemoveContainer" containerID="4423760983d234cf89f326a9ce253676e3e6b0c280a356f96097c3c830d8ad07" Mar 16 16:18:07 crc kubenswrapper[5120]: I0316 16:18:07.233715 5120 scope.go:117] "RemoveContainer" containerID="12572d4dbfa6da89a684a45d45fbbef79f79d94a4c9264be847c926efe2a306c" Mar 16 16:18:07 crc kubenswrapper[5120]: I0316 16:18:07.250545 5120 scope.go:117] "RemoveContainer" containerID="3c1dc0476ec152189cd9cccaa8817bd8c79eb785cc5a85c7a89fc21e075d9c23" Mar 16 16:18:07 crc kubenswrapper[5120]: I0316 16:18:07.268115 5120 scope.go:117] "RemoveContainer" containerID="a636602cf9c0f74b67bfffb9ee956a50e5d2bd7168bfc08b70cd6207ef08e4c0" Mar 16 16:18:07 crc kubenswrapper[5120]: E0316 16:18:07.516079 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-config-data: configmap "rabbitmq-config-data" not found Mar 16 16:18:07 crc kubenswrapper[5120]: E0316 16:18:07.516179 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/51d5f0da-bcbc-492e-ab39-6189dc22fa22-config-data podName:51d5f0da-bcbc-492e-ab39-6189dc22fa22 nodeName:}" failed. No retries permitted until 2026-03-16 16:18:15.516160447 +0000 UTC m=+2797.670092114 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/51d5f0da-bcbc-492e-ab39-6189dc22fa22-config-data") pod "rabbitmq-server-0" (UID: "51d5f0da-bcbc-492e-ab39-6189dc22fa22") : configmap "rabbitmq-config-data" not found Mar 16 16:18:07 crc kubenswrapper[5120]: I0316 16:18:07.523159 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-infra/auto-csr-approver-29561292-z2wqq"] Mar 16 16:18:07 crc kubenswrapper[5120]: I0316 16:18:07.537655 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-infra/auto-csr-approver-29561292-z2wqq"] Mar 16 16:18:07 crc kubenswrapper[5120]: I0316 16:18:07.632662 5120 generic.go:358] "Generic (PLEG): container finished" podID="551715bc-101a-4745-955b-027ac2be9c0b" containerID="1c358da4a94182ad980d04746126744b917f3eefac12cf1b996c541e1be24f80" exitCode=0 Mar 16 16:18:07 crc kubenswrapper[5120]: I0316 16:18:07.632742 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"551715bc-101a-4745-955b-027ac2be9c0b","Type":"ContainerDied","Data":"1c358da4a94182ad980d04746126744b917f3eefac12cf1b996c541e1be24f80"} Mar 16 16:18:07 crc kubenswrapper[5120]: I0316 16:18:07.635905 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561298-6qsf7" Mar 16 16:18:07 crc kubenswrapper[5120]: I0316 16:18:07.636051 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561298-6qsf7" event={"ID":"e4cb4b19-5e1d-4cb5-8cc1-e51c0b445e06","Type":"ContainerDied","Data":"9012264b8936dd5c90296e7aa7d5735e9f8e13d137b9feea90b8c5fc7d8da049"} Mar 16 16:18:07 crc kubenswrapper[5120]: I0316 16:18:07.636095 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9012264b8936dd5c90296e7aa7d5735e9f8e13d137b9feea90b8c5fc7d8da049" Mar 16 16:18:07 crc kubenswrapper[5120]: I0316 16:18:07.638048 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-6f9485b564-dlsjq" event={"ID":"d762c585-b44b-475d-a371-507fa2f9439a","Type":"ContainerDied","Data":"fda84fe9262bf524f54d7d849d96c19ecea9490aeea8c1a6b9d174aea9c6389b"} Mar 16 16:18:07 crc kubenswrapper[5120]: I0316 16:18:07.638094 5120 scope.go:117] "RemoveContainer" containerID="2dae34322c3b177952bf14227b112419b3dd714c550886bb4270633cbccfcb9d" Mar 16 16:18:07 crc kubenswrapper[5120]: I0316 16:18:07.638101 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-6f9485b564-dlsjq" Mar 16 16:18:07 crc kubenswrapper[5120]: I0316 16:18:07.689480 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-6f9485b564-dlsjq"] Mar 16 16:18:07 crc kubenswrapper[5120]: I0316 16:18:07.695329 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-6f9485b564-dlsjq"] Mar 16 16:18:08 crc kubenswrapper[5120]: I0316 16:18:08.002882 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:18:08 crc kubenswrapper[5120]: I0316 16:18:08.027136 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"persistence\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") pod \"551715bc-101a-4745-955b-027ac2be9c0b\" (UID: \"551715bc-101a-4745-955b-027ac2be9c0b\") " Mar 16 16:18:08 crc kubenswrapper[5120]: I0316 16:18:08.027274 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/551715bc-101a-4745-955b-027ac2be9c0b-rabbitmq-erlang-cookie\") pod \"551715bc-101a-4745-955b-027ac2be9c0b\" (UID: \"551715bc-101a-4745-955b-027ac2be9c0b\") " Mar 16 16:18:08 crc kubenswrapper[5120]: I0316 16:18:08.027310 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n6vgr\" (UniqueName: \"kubernetes.io/projected/551715bc-101a-4745-955b-027ac2be9c0b-kube-api-access-n6vgr\") pod \"551715bc-101a-4745-955b-027ac2be9c0b\" (UID: \"551715bc-101a-4745-955b-027ac2be9c0b\") " Mar 16 16:18:08 crc kubenswrapper[5120]: I0316 16:18:08.027354 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/551715bc-101a-4745-955b-027ac2be9c0b-server-conf\") pod \"551715bc-101a-4745-955b-027ac2be9c0b\" (UID: \"551715bc-101a-4745-955b-027ac2be9c0b\") " Mar 16 16:18:08 crc kubenswrapper[5120]: I0316 16:18:08.027446 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/551715bc-101a-4745-955b-027ac2be9c0b-erlang-cookie-secret\") pod \"551715bc-101a-4745-955b-027ac2be9c0b\" (UID: \"551715bc-101a-4745-955b-027ac2be9c0b\") " Mar 16 16:18:08 crc kubenswrapper[5120]: I0316 16:18:08.027480 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/551715bc-101a-4745-955b-027ac2be9c0b-rabbitmq-plugins\") pod \"551715bc-101a-4745-955b-027ac2be9c0b\" (UID: \"551715bc-101a-4745-955b-027ac2be9c0b\") " Mar 16 16:18:08 crc kubenswrapper[5120]: I0316 16:18:08.027721 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/551715bc-101a-4745-955b-027ac2be9c0b-config-data\") pod \"551715bc-101a-4745-955b-027ac2be9c0b\" (UID: \"551715bc-101a-4745-955b-027ac2be9c0b\") " Mar 16 16:18:08 crc kubenswrapper[5120]: I0316 16:18:08.027808 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/551715bc-101a-4745-955b-027ac2be9c0b-rabbitmq-confd\") pod \"551715bc-101a-4745-955b-027ac2be9c0b\" (UID: \"551715bc-101a-4745-955b-027ac2be9c0b\") " Mar 16 16:18:08 crc kubenswrapper[5120]: I0316 16:18:08.027840 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/551715bc-101a-4745-955b-027ac2be9c0b-plugins-conf\") pod \"551715bc-101a-4745-955b-027ac2be9c0b\" (UID: \"551715bc-101a-4745-955b-027ac2be9c0b\") " Mar 16 16:18:08 crc kubenswrapper[5120]: I0316 16:18:08.027939 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/551715bc-101a-4745-955b-027ac2be9c0b-rabbitmq-tls\") pod \"551715bc-101a-4745-955b-027ac2be9c0b\" (UID: \"551715bc-101a-4745-955b-027ac2be9c0b\") " Mar 16 16:18:08 crc kubenswrapper[5120]: I0316 16:18:08.028020 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/551715bc-101a-4745-955b-027ac2be9c0b-pod-info\") pod \"551715bc-101a-4745-955b-027ac2be9c0b\" (UID: \"551715bc-101a-4745-955b-027ac2be9c0b\") " Mar 16 16:18:08 crc kubenswrapper[5120]: I0316 16:18:08.028746 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/551715bc-101a-4745-955b-027ac2be9c0b-rabbitmq-plugins" (OuterVolumeSpecName: "rabbitmq-plugins") pod "551715bc-101a-4745-955b-027ac2be9c0b" (UID: "551715bc-101a-4745-955b-027ac2be9c0b"). InnerVolumeSpecName "rabbitmq-plugins". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:18:08 crc kubenswrapper[5120]: I0316 16:18:08.029083 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/551715bc-101a-4745-955b-027ac2be9c0b-rabbitmq-plugins\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:08 crc kubenswrapper[5120]: I0316 16:18:08.029814 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/551715bc-101a-4745-955b-027ac2be9c0b-rabbitmq-erlang-cookie" (OuterVolumeSpecName: "rabbitmq-erlang-cookie") pod "551715bc-101a-4745-955b-027ac2be9c0b" (UID: "551715bc-101a-4745-955b-027ac2be9c0b"). InnerVolumeSpecName "rabbitmq-erlang-cookie". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:18:08 crc kubenswrapper[5120]: I0316 16:18:08.033643 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/551715bc-101a-4745-955b-027ac2be9c0b-pod-info" (OuterVolumeSpecName: "pod-info") pod "551715bc-101a-4745-955b-027ac2be9c0b" (UID: "551715bc-101a-4745-955b-027ac2be9c0b"). InnerVolumeSpecName "pod-info". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Mar 16 16:18:08 crc kubenswrapper[5120]: I0316 16:18:08.034285 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/551715bc-101a-4745-955b-027ac2be9c0b-kube-api-access-n6vgr" (OuterVolumeSpecName: "kube-api-access-n6vgr") pod "551715bc-101a-4745-955b-027ac2be9c0b" (UID: "551715bc-101a-4745-955b-027ac2be9c0b"). InnerVolumeSpecName "kube-api-access-n6vgr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:18:08 crc kubenswrapper[5120]: I0316 16:18:08.035211 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage17-crc" (OuterVolumeSpecName: "persistence") pod "551715bc-101a-4745-955b-027ac2be9c0b" (UID: "551715bc-101a-4745-955b-027ac2be9c0b"). InnerVolumeSpecName "local-storage17-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:18:08 crc kubenswrapper[5120]: I0316 16:18:08.036071 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/551715bc-101a-4745-955b-027ac2be9c0b-plugins-conf" (OuterVolumeSpecName: "plugins-conf") pod "551715bc-101a-4745-955b-027ac2be9c0b" (UID: "551715bc-101a-4745-955b-027ac2be9c0b"). InnerVolumeSpecName "plugins-conf". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:18:08 crc kubenswrapper[5120]: I0316 16:18:08.047267 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/551715bc-101a-4745-955b-027ac2be9c0b-rabbitmq-tls" (OuterVolumeSpecName: "rabbitmq-tls") pod "551715bc-101a-4745-955b-027ac2be9c0b" (UID: "551715bc-101a-4745-955b-027ac2be9c0b"). InnerVolumeSpecName "rabbitmq-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:18:08 crc kubenswrapper[5120]: I0316 16:18:08.059046 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/551715bc-101a-4745-955b-027ac2be9c0b-erlang-cookie-secret" (OuterVolumeSpecName: "erlang-cookie-secret") pod "551715bc-101a-4745-955b-027ac2be9c0b" (UID: "551715bc-101a-4745-955b-027ac2be9c0b"). InnerVolumeSpecName "erlang-cookie-secret". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:18:08 crc kubenswrapper[5120]: I0316 16:18:08.088529 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/551715bc-101a-4745-955b-027ac2be9c0b-config-data" (OuterVolumeSpecName: "config-data") pod "551715bc-101a-4745-955b-027ac2be9c0b" (UID: "551715bc-101a-4745-955b-027ac2be9c0b"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:18:08 crc kubenswrapper[5120]: I0316 16:18:08.096346 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/551715bc-101a-4745-955b-027ac2be9c0b-server-conf" (OuterVolumeSpecName: "server-conf") pod "551715bc-101a-4745-955b-027ac2be9c0b" (UID: "551715bc-101a-4745-955b-027ac2be9c0b"). InnerVolumeSpecName "server-conf". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:18:08 crc kubenswrapper[5120]: I0316 16:18:08.122967 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/551715bc-101a-4745-955b-027ac2be9c0b-rabbitmq-confd" (OuterVolumeSpecName: "rabbitmq-confd") pod "551715bc-101a-4745-955b-027ac2be9c0b" (UID: "551715bc-101a-4745-955b-027ac2be9c0b"). InnerVolumeSpecName "rabbitmq-confd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:18:08 crc kubenswrapper[5120]: I0316 16:18:08.130345 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/551715bc-101a-4745-955b-027ac2be9c0b-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:08 crc kubenswrapper[5120]: I0316 16:18:08.130375 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/551715bc-101a-4745-955b-027ac2be9c0b-rabbitmq-confd\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:08 crc kubenswrapper[5120]: I0316 16:18:08.130386 5120 reconciler_common.go:299] "Volume detached for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/551715bc-101a-4745-955b-027ac2be9c0b-plugins-conf\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:08 crc kubenswrapper[5120]: I0316 16:18:08.130395 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/551715bc-101a-4745-955b-027ac2be9c0b-rabbitmq-tls\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:08 crc kubenswrapper[5120]: I0316 16:18:08.130404 5120 reconciler_common.go:299] "Volume detached for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/551715bc-101a-4745-955b-027ac2be9c0b-pod-info\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:08 crc kubenswrapper[5120]: I0316 16:18:08.130429 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") on node \"crc\" " Mar 16 16:18:08 crc kubenswrapper[5120]: I0316 16:18:08.130440 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/551715bc-101a-4745-955b-027ac2be9c0b-rabbitmq-erlang-cookie\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:08 crc kubenswrapper[5120]: I0316 16:18:08.130449 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n6vgr\" (UniqueName: \"kubernetes.io/projected/551715bc-101a-4745-955b-027ac2be9c0b-kube-api-access-n6vgr\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:08 crc kubenswrapper[5120]: I0316 16:18:08.130457 5120 reconciler_common.go:299] "Volume detached for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/551715bc-101a-4745-955b-027ac2be9c0b-server-conf\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:08 crc kubenswrapper[5120]: I0316 16:18:08.130466 5120 reconciler_common.go:299] "Volume detached for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/551715bc-101a-4745-955b-027ac2be9c0b-erlang-cookie-secret\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:08 crc kubenswrapper[5120]: I0316 16:18:08.144538 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage17-crc" (UniqueName: "kubernetes.io/local-volume/local-storage17-crc") on node "crc" Mar 16 16:18:08 crc kubenswrapper[5120]: I0316 16:18:08.232351 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:08 crc kubenswrapper[5120]: E0316 16:18:08.399449 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a1f5e797b52c263768103f57dc958a68929e1eaed737a81298570c479cbfd478" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:18:08 crc kubenswrapper[5120]: E0316 16:18:08.401323 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a1f5e797b52c263768103f57dc958a68929e1eaed737a81298570c479cbfd478" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:18:08 crc kubenswrapper[5120]: E0316 16:18:08.403406 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a1f5e797b52c263768103f57dc958a68929e1eaed737a81298570c479cbfd478" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:18:08 crc kubenswrapper[5120]: E0316 16:18:08.403500 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="3f5ad605-f6ee-47e9-a2b6-43e60f01c4c9" containerName="nova-scheduler-scheduler" probeResult="unknown" Mar 16 16:18:08 crc kubenswrapper[5120]: I0316 16:18:08.655854 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"551715bc-101a-4745-955b-027ac2be9c0b","Type":"ContainerDied","Data":"55fb9de35613d1592a20a79970889fb22a27e7a62635b9d08d1363e782b1425e"} Mar 16 16:18:08 crc kubenswrapper[5120]: I0316 16:18:08.655917 5120 scope.go:117] "RemoveContainer" containerID="1c358da4a94182ad980d04746126744b917f3eefac12cf1b996c541e1be24f80" Mar 16 16:18:08 crc kubenswrapper[5120]: I0316 16:18:08.656140 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:18:08 crc kubenswrapper[5120]: I0316 16:18:08.674745 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="044996b4-e444-4486-9503-61d776ec849f" path="/var/lib/kubelet/pods/044996b4-e444-4486-9503-61d776ec849f/volumes" Mar 16 16:18:08 crc kubenswrapper[5120]: I0316 16:18:08.679041 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="43c58ec7-474a-49bc-921f-89cf47b67811" path="/var/lib/kubelet/pods/43c58ec7-474a-49bc-921f-89cf47b67811/volumes" Mar 16 16:18:08 crc kubenswrapper[5120]: I0316 16:18:08.681035 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4885bea5-bdc7-472b-8f70-e110dd9b8c06" path="/var/lib/kubelet/pods/4885bea5-bdc7-472b-8f70-e110dd9b8c06/volumes" Mar 16 16:18:08 crc kubenswrapper[5120]: I0316 16:18:08.682485 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9292b258-885b-40a8-8b7d-9ed28a747bc7" path="/var/lib/kubelet/pods/9292b258-885b-40a8-8b7d-9ed28a747bc7/volumes" Mar 16 16:18:08 crc kubenswrapper[5120]: I0316 16:18:08.683933 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9e7f8135-737c-4639-bdd8-46d68e1a617d" path="/var/lib/kubelet/pods/9e7f8135-737c-4639-bdd8-46d68e1a617d/volumes" Mar 16 16:18:08 crc kubenswrapper[5120]: I0316 16:18:08.684713 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f16b3a2-bc26-4a63-8f8c-836611f0d320" path="/var/lib/kubelet/pods/9f16b3a2-bc26-4a63-8f8c-836611f0d320/volumes" Mar 16 16:18:08 crc kubenswrapper[5120]: I0316 16:18:08.685980 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ad803ce8-2d88-44d8-a717-aaec85ce871c" path="/var/lib/kubelet/pods/ad803ce8-2d88-44d8-a717-aaec85ce871c/volumes" Mar 16 16:18:08 crc kubenswrapper[5120]: I0316 16:18:08.686856 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b2e8d0e9-fa13-49fc-b149-af0d8d1d5ef0" path="/var/lib/kubelet/pods/b2e8d0e9-fa13-49fc-b149-af0d8d1d5ef0/volumes" Mar 16 16:18:08 crc kubenswrapper[5120]: I0316 16:18:08.687827 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d762c585-b44b-475d-a371-507fa2f9439a" path="/var/lib/kubelet/pods/d762c585-b44b-475d-a371-507fa2f9439a/volumes" Mar 16 16:18:08 crc kubenswrapper[5120]: I0316 16:18:08.710488 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 16:18:08 crc kubenswrapper[5120]: I0316 16:18:08.713375 5120 scope.go:117] "RemoveContainer" containerID="851c1660f50a90ff9d46cc70cf1f804834a4e916e5c034ce95bd2ac287850333" Mar 16 16:18:08 crc kubenswrapper[5120]: E0316 16:18:08.717419 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1394229 actualBytes=10240 Mar 16 16:18:08 crc kubenswrapper[5120]: I0316 16:18:08.718332 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 16:18:08 crc kubenswrapper[5120]: E0316 16:18:08.882324 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="e97ac48130213536a9b9b0d15722b762acfe6f81aabde1c8b9c64553d53ec8c7" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:18:08 crc kubenswrapper[5120]: E0316 16:18:08.884962 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="e97ac48130213536a9b9b0d15722b762acfe6f81aabde1c8b9c64553d53ec8c7" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:18:08 crc kubenswrapper[5120]: E0316 16:18:08.887780 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="e97ac48130213536a9b9b0d15722b762acfe6f81aabde1c8b9c64553d53ec8c7" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:18:08 crc kubenswrapper[5120]: E0316 16:18:08.887837 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="e73bdb2c-01bf-4eca-93df-22b051fee769" containerName="nova-cell1-conductor-conductor" probeResult="unknown" Mar 16 16:18:08 crc kubenswrapper[5120]: I0316 16:18:08.949378 5120 scope.go:117] "RemoveContainer" containerID="e09ca476407ec729cd1111e5cc4d786a923c7f7a46f6062fd777ae7956a01722" Mar 16 16:18:09 crc kubenswrapper[5120]: E0316 16:18:09.472605 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="6c6a76b2480d11bbcbe9da4f0bbb77ee9e7dcffe33abc117e4fd2108ee958a64" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:18:09 crc kubenswrapper[5120]: E0316 16:18:09.474516 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="6c6a76b2480d11bbcbe9da4f0bbb77ee9e7dcffe33abc117e4fd2108ee958a64" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:18:09 crc kubenswrapper[5120]: E0316 16:18:09.477696 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="6c6a76b2480d11bbcbe9da4f0bbb77ee9e7dcffe33abc117e4fd2108ee958a64" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:18:09 crc kubenswrapper[5120]: E0316 16:18:09.477801 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="711e7cd2-a028-4c76-969e-e08558a5d732" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 16:18:10 crc kubenswrapper[5120]: I0316 16:18:10.678652 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="551715bc-101a-4745-955b-027ac2be9c0b" path="/var/lib/kubelet/pods/551715bc-101a-4745-955b-027ac2be9c0b/volumes" Mar 16 16:18:11 crc kubenswrapper[5120]: I0316 16:18:11.616057 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-4w76w" Mar 16 16:18:11 crc kubenswrapper[5120]: I0316 16:18:11.682402 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-654d469f7f-jcvx4"] Mar 16 16:18:11 crc kubenswrapper[5120]: I0316 16:18:11.682647 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-654d469f7f-jcvx4" podUID="251f0648-5ccd-4e12-acbb-ced50b9ce41b" containerName="dnsmasq-dns" containerID="cri-o://c2508f73cb4eff7625d77f71d14b9731e2712af5e9df7a2c21e1820e48d9287c" gracePeriod=10 Mar 16 16:18:12 crc kubenswrapper[5120]: I0316 16:18:12.189340 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-654d469f7f-jcvx4" Mar 16 16:18:12 crc kubenswrapper[5120]: I0316 16:18:12.317137 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/251f0648-5ccd-4e12-acbb-ced50b9ce41b-dnsmasq-svc\") pod \"251f0648-5ccd-4e12-acbb-ced50b9ce41b\" (UID: \"251f0648-5ccd-4e12-acbb-ced50b9ce41b\") " Mar 16 16:18:12 crc kubenswrapper[5120]: I0316 16:18:12.317386 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cvvmn\" (UniqueName: \"kubernetes.io/projected/251f0648-5ccd-4e12-acbb-ced50b9ce41b-kube-api-access-cvvmn\") pod \"251f0648-5ccd-4e12-acbb-ced50b9ce41b\" (UID: \"251f0648-5ccd-4e12-acbb-ced50b9ce41b\") " Mar 16 16:18:12 crc kubenswrapper[5120]: I0316 16:18:12.317695 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/251f0648-5ccd-4e12-acbb-ced50b9ce41b-config\") pod \"251f0648-5ccd-4e12-acbb-ced50b9ce41b\" (UID: \"251f0648-5ccd-4e12-acbb-ced50b9ce41b\") " Mar 16 16:18:12 crc kubenswrapper[5120]: I0316 16:18:12.317816 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/251f0648-5ccd-4e12-acbb-ced50b9ce41b-dns-swift-storage-0\") pod \"251f0648-5ccd-4e12-acbb-ced50b9ce41b\" (UID: \"251f0648-5ccd-4e12-acbb-ced50b9ce41b\") " Mar 16 16:18:12 crc kubenswrapper[5120]: I0316 16:18:12.331974 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/251f0648-5ccd-4e12-acbb-ced50b9ce41b-kube-api-access-cvvmn" (OuterVolumeSpecName: "kube-api-access-cvvmn") pod "251f0648-5ccd-4e12-acbb-ced50b9ce41b" (UID: "251f0648-5ccd-4e12-acbb-ced50b9ce41b"). InnerVolumeSpecName "kube-api-access-cvvmn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:18:12 crc kubenswrapper[5120]: I0316 16:18:12.359312 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/251f0648-5ccd-4e12-acbb-ced50b9ce41b-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "251f0648-5ccd-4e12-acbb-ced50b9ce41b" (UID: "251f0648-5ccd-4e12-acbb-ced50b9ce41b"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:18:12 crc kubenswrapper[5120]: I0316 16:18:12.364547 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/251f0648-5ccd-4e12-acbb-ced50b9ce41b-dns-swift-storage-0" (OuterVolumeSpecName: "dns-swift-storage-0") pod "251f0648-5ccd-4e12-acbb-ced50b9ce41b" (UID: "251f0648-5ccd-4e12-acbb-ced50b9ce41b"). InnerVolumeSpecName "dns-swift-storage-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:18:12 crc kubenswrapper[5120]: I0316 16:18:12.376864 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/251f0648-5ccd-4e12-acbb-ced50b9ce41b-config" (OuterVolumeSpecName: "config") pod "251f0648-5ccd-4e12-acbb-ced50b9ce41b" (UID: "251f0648-5ccd-4e12-acbb-ced50b9ce41b"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:18:12 crc kubenswrapper[5120]: I0316 16:18:12.420426 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/251f0648-5ccd-4e12-acbb-ced50b9ce41b-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:12 crc kubenswrapper[5120]: I0316 16:18:12.420464 5120 reconciler_common.go:299] "Volume detached for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/251f0648-5ccd-4e12-acbb-ced50b9ce41b-dns-swift-storage-0\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:12 crc kubenswrapper[5120]: I0316 16:18:12.420478 5120 reconciler_common.go:299] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/251f0648-5ccd-4e12-acbb-ced50b9ce41b-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:12 crc kubenswrapper[5120]: I0316 16:18:12.420490 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cvvmn\" (UniqueName: \"kubernetes.io/projected/251f0648-5ccd-4e12-acbb-ced50b9ce41b-kube-api-access-cvvmn\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:12 crc kubenswrapper[5120]: I0316 16:18:12.731424 5120 generic.go:358] "Generic (PLEG): container finished" podID="251f0648-5ccd-4e12-acbb-ced50b9ce41b" containerID="c2508f73cb4eff7625d77f71d14b9731e2712af5e9df7a2c21e1820e48d9287c" exitCode=0 Mar 16 16:18:12 crc kubenswrapper[5120]: I0316 16:18:12.731546 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-654d469f7f-jcvx4" Mar 16 16:18:12 crc kubenswrapper[5120]: I0316 16:18:12.731593 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-654d469f7f-jcvx4" event={"ID":"251f0648-5ccd-4e12-acbb-ced50b9ce41b","Type":"ContainerDied","Data":"c2508f73cb4eff7625d77f71d14b9731e2712af5e9df7a2c21e1820e48d9287c"} Mar 16 16:18:12 crc kubenswrapper[5120]: I0316 16:18:12.731681 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-654d469f7f-jcvx4" event={"ID":"251f0648-5ccd-4e12-acbb-ced50b9ce41b","Type":"ContainerDied","Data":"8698455c6cb902305d6d9205edc4b495ac12fc1bbe35763c23a523f2962e685e"} Mar 16 16:18:12 crc kubenswrapper[5120]: I0316 16:18:12.731712 5120 scope.go:117] "RemoveContainer" containerID="c2508f73cb4eff7625d77f71d14b9731e2712af5e9df7a2c21e1820e48d9287c" Mar 16 16:18:12 crc kubenswrapper[5120]: I0316 16:18:12.756878 5120 scope.go:117] "RemoveContainer" containerID="7dbaadf663fdcc74917ddaddd7287c528dc87729b5063e138d4e863a06aa4e38" Mar 16 16:18:12 crc kubenswrapper[5120]: I0316 16:18:12.761227 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-654d469f7f-jcvx4"] Mar 16 16:18:12 crc kubenswrapper[5120]: I0316 16:18:12.767699 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-654d469f7f-jcvx4"] Mar 16 16:18:12 crc kubenswrapper[5120]: I0316 16:18:12.787599 5120 scope.go:117] "RemoveContainer" containerID="c2508f73cb4eff7625d77f71d14b9731e2712af5e9df7a2c21e1820e48d9287c" Mar 16 16:18:12 crc kubenswrapper[5120]: E0316 16:18:12.788371 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c2508f73cb4eff7625d77f71d14b9731e2712af5e9df7a2c21e1820e48d9287c\": container with ID starting with c2508f73cb4eff7625d77f71d14b9731e2712af5e9df7a2c21e1820e48d9287c not found: ID does not exist" containerID="c2508f73cb4eff7625d77f71d14b9731e2712af5e9df7a2c21e1820e48d9287c" Mar 16 16:18:12 crc kubenswrapper[5120]: I0316 16:18:12.788422 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2508f73cb4eff7625d77f71d14b9731e2712af5e9df7a2c21e1820e48d9287c"} err="failed to get container status \"c2508f73cb4eff7625d77f71d14b9731e2712af5e9df7a2c21e1820e48d9287c\": rpc error: code = NotFound desc = could not find container \"c2508f73cb4eff7625d77f71d14b9731e2712af5e9df7a2c21e1820e48d9287c\": container with ID starting with c2508f73cb4eff7625d77f71d14b9731e2712af5e9df7a2c21e1820e48d9287c not found: ID does not exist" Mar 16 16:18:12 crc kubenswrapper[5120]: I0316 16:18:12.788454 5120 scope.go:117] "RemoveContainer" containerID="7dbaadf663fdcc74917ddaddd7287c528dc87729b5063e138d4e863a06aa4e38" Mar 16 16:18:12 crc kubenswrapper[5120]: E0316 16:18:12.789030 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7dbaadf663fdcc74917ddaddd7287c528dc87729b5063e138d4e863a06aa4e38\": container with ID starting with 7dbaadf663fdcc74917ddaddd7287c528dc87729b5063e138d4e863a06aa4e38 not found: ID does not exist" containerID="7dbaadf663fdcc74917ddaddd7287c528dc87729b5063e138d4e863a06aa4e38" Mar 16 16:18:12 crc kubenswrapper[5120]: I0316 16:18:12.789085 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7dbaadf663fdcc74917ddaddd7287c528dc87729b5063e138d4e863a06aa4e38"} err="failed to get container status \"7dbaadf663fdcc74917ddaddd7287c528dc87729b5063e138d4e863a06aa4e38\": rpc error: code = NotFound desc = could not find container \"7dbaadf663fdcc74917ddaddd7287c528dc87729b5063e138d4e863a06aa4e38\": container with ID starting with 7dbaadf663fdcc74917ddaddd7287c528dc87729b5063e138d4e863a06aa4e38 not found: ID does not exist" Mar 16 16:18:13 crc kubenswrapper[5120]: E0316 16:18:13.400164 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a1f5e797b52c263768103f57dc958a68929e1eaed737a81298570c479cbfd478" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:18:13 crc kubenswrapper[5120]: E0316 16:18:13.402710 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a1f5e797b52c263768103f57dc958a68929e1eaed737a81298570c479cbfd478" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:18:13 crc kubenswrapper[5120]: E0316 16:18:13.405012 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a1f5e797b52c263768103f57dc958a68929e1eaed737a81298570c479cbfd478" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:18:13 crc kubenswrapper[5120]: E0316 16:18:13.405105 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="3f5ad605-f6ee-47e9-a2b6-43e60f01c4c9" containerName="nova-scheduler-scheduler" probeResult="unknown" Mar 16 16:18:13 crc kubenswrapper[5120]: E0316 16:18:13.881821 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="e97ac48130213536a9b9b0d15722b762acfe6f81aabde1c8b9c64553d53ec8c7" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:18:13 crc kubenswrapper[5120]: E0316 16:18:13.883515 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="e97ac48130213536a9b9b0d15722b762acfe6f81aabde1c8b9c64553d53ec8c7" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:18:13 crc kubenswrapper[5120]: E0316 16:18:13.884924 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="e97ac48130213536a9b9b0d15722b762acfe6f81aabde1c8b9c64553d53ec8c7" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:18:13 crc kubenswrapper[5120]: E0316 16:18:13.884998 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="e73bdb2c-01bf-4eca-93df-22b051fee769" containerName="nova-cell1-conductor-conductor" probeResult="unknown" Mar 16 16:18:14 crc kubenswrapper[5120]: E0316 16:18:14.474050 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="6c6a76b2480d11bbcbe9da4f0bbb77ee9e7dcffe33abc117e4fd2108ee958a64" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:18:14 crc kubenswrapper[5120]: E0316 16:18:14.476262 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="6c6a76b2480d11bbcbe9da4f0bbb77ee9e7dcffe33abc117e4fd2108ee958a64" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:18:14 crc kubenswrapper[5120]: E0316 16:18:14.478573 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="6c6a76b2480d11bbcbe9da4f0bbb77ee9e7dcffe33abc117e4fd2108ee958a64" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:18:14 crc kubenswrapper[5120]: E0316 16:18:14.478670 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="711e7cd2-a028-4c76-969e-e08558a5d732" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 16:18:14 crc kubenswrapper[5120]: I0316 16:18:14.676821 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="251f0648-5ccd-4e12-acbb-ced50b9ce41b" path="/var/lib/kubelet/pods/251f0648-5ccd-4e12-acbb-ced50b9ce41b/volumes" Mar 16 16:18:14 crc kubenswrapper[5120]: I0316 16:18:14.860744 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/ceilometer-0" podUID="76c6cd23-f4cd-4b95-95b1-252ec9c5cafa" containerName="proxy-httpd" probeResult="failure" output="Get \"https://10.217.1.18:3000/\": dial tcp 10.217.1.18:3000: connect: connection refused" Mar 16 16:18:15 crc kubenswrapper[5120]: E0316 16:18:15.589732 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-config-data: configmap "rabbitmq-config-data" not found Mar 16 16:18:15 crc kubenswrapper[5120]: E0316 16:18:15.589946 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/51d5f0da-bcbc-492e-ab39-6189dc22fa22-config-data podName:51d5f0da-bcbc-492e-ab39-6189dc22fa22 nodeName:}" failed. No retries permitted until 2026-03-16 16:18:31.589914567 +0000 UTC m=+2813.743846274 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/51d5f0da-bcbc-492e-ab39-6189dc22fa22-config-data") pod "rabbitmq-server-0" (UID: "51d5f0da-bcbc-492e-ab39-6189dc22fa22") : configmap "rabbitmq-config-data" not found Mar 16 16:18:18 crc kubenswrapper[5120]: E0316 16:18:18.398664 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a1f5e797b52c263768103f57dc958a68929e1eaed737a81298570c479cbfd478" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:18:18 crc kubenswrapper[5120]: E0316 16:18:18.402509 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a1f5e797b52c263768103f57dc958a68929e1eaed737a81298570c479cbfd478" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:18:18 crc kubenswrapper[5120]: E0316 16:18:18.405144 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a1f5e797b52c263768103f57dc958a68929e1eaed737a81298570c479cbfd478" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:18:18 crc kubenswrapper[5120]: E0316 16:18:18.405247 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="3f5ad605-f6ee-47e9-a2b6-43e60f01c4c9" containerName="nova-scheduler-scheduler" probeResult="unknown" Mar 16 16:18:18 crc kubenswrapper[5120]: E0316 16:18:18.882741 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="e97ac48130213536a9b9b0d15722b762acfe6f81aabde1c8b9c64553d53ec8c7" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:18:18 crc kubenswrapper[5120]: E0316 16:18:18.885904 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="e97ac48130213536a9b9b0d15722b762acfe6f81aabde1c8b9c64553d53ec8c7" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:18:18 crc kubenswrapper[5120]: E0316 16:18:18.888234 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="e97ac48130213536a9b9b0d15722b762acfe6f81aabde1c8b9c64553d53ec8c7" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:18:18 crc kubenswrapper[5120]: E0316 16:18:18.888295 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="e73bdb2c-01bf-4eca-93df-22b051fee769" containerName="nova-cell1-conductor-conductor" probeResult="unknown" Mar 16 16:18:19 crc kubenswrapper[5120]: E0316 16:18:19.473054 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="6c6a76b2480d11bbcbe9da4f0bbb77ee9e7dcffe33abc117e4fd2108ee958a64" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:18:19 crc kubenswrapper[5120]: E0316 16:18:19.475112 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="6c6a76b2480d11bbcbe9da4f0bbb77ee9e7dcffe33abc117e4fd2108ee958a64" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:18:19 crc kubenswrapper[5120]: E0316 16:18:19.477699 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="6c6a76b2480d11bbcbe9da4f0bbb77ee9e7dcffe33abc117e4fd2108ee958a64" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:18:19 crc kubenswrapper[5120]: E0316 16:18:19.477855 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="711e7cd2-a028-4c76-969e-e08558a5d732" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 16:18:23 crc kubenswrapper[5120]: E0316 16:18:23.398835 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a1f5e797b52c263768103f57dc958a68929e1eaed737a81298570c479cbfd478" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:18:23 crc kubenswrapper[5120]: E0316 16:18:23.402322 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a1f5e797b52c263768103f57dc958a68929e1eaed737a81298570c479cbfd478" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:18:23 crc kubenswrapper[5120]: E0316 16:18:23.404250 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a1f5e797b52c263768103f57dc958a68929e1eaed737a81298570c479cbfd478" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:18:23 crc kubenswrapper[5120]: E0316 16:18:23.404316 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="3f5ad605-f6ee-47e9-a2b6-43e60f01c4c9" containerName="nova-scheduler-scheduler" probeResult="unknown" Mar 16 16:18:23 crc kubenswrapper[5120]: E0316 16:18:23.881842 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="e97ac48130213536a9b9b0d15722b762acfe6f81aabde1c8b9c64553d53ec8c7" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:18:23 crc kubenswrapper[5120]: E0316 16:18:23.884374 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="e97ac48130213536a9b9b0d15722b762acfe6f81aabde1c8b9c64553d53ec8c7" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:18:23 crc kubenswrapper[5120]: E0316 16:18:23.886827 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="e97ac48130213536a9b9b0d15722b762acfe6f81aabde1c8b9c64553d53ec8c7" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:18:23 crc kubenswrapper[5120]: E0316 16:18:23.886895 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="e73bdb2c-01bf-4eca-93df-22b051fee769" containerName="nova-cell1-conductor-conductor" probeResult="unknown" Mar 16 16:18:24 crc kubenswrapper[5120]: E0316 16:18:24.473009 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="6c6a76b2480d11bbcbe9da4f0bbb77ee9e7dcffe33abc117e4fd2108ee958a64" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:18:24 crc kubenswrapper[5120]: E0316 16:18:24.475222 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="6c6a76b2480d11bbcbe9da4f0bbb77ee9e7dcffe33abc117e4fd2108ee958a64" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:18:24 crc kubenswrapper[5120]: E0316 16:18:24.477583 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="6c6a76b2480d11bbcbe9da4f0bbb77ee9e7dcffe33abc117e4fd2108ee958a64" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:18:24 crc kubenswrapper[5120]: E0316 16:18:24.477655 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="711e7cd2-a028-4c76-969e-e08558a5d732" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 16:18:28 crc kubenswrapper[5120]: E0316 16:18:28.400261 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a1f5e797b52c263768103f57dc958a68929e1eaed737a81298570c479cbfd478" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:18:28 crc kubenswrapper[5120]: E0316 16:18:28.408051 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a1f5e797b52c263768103f57dc958a68929e1eaed737a81298570c479cbfd478" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:18:28 crc kubenswrapper[5120]: E0316 16:18:28.410597 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a1f5e797b52c263768103f57dc958a68929e1eaed737a81298570c479cbfd478" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:18:28 crc kubenswrapper[5120]: E0316 16:18:28.410702 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="3f5ad605-f6ee-47e9-a2b6-43e60f01c4c9" containerName="nova-scheduler-scheduler" probeResult="unknown" Mar 16 16:18:28 crc kubenswrapper[5120]: E0316 16:18:28.883462 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="e97ac48130213536a9b9b0d15722b762acfe6f81aabde1c8b9c64553d53ec8c7" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:18:28 crc kubenswrapper[5120]: E0316 16:18:28.886112 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="e97ac48130213536a9b9b0d15722b762acfe6f81aabde1c8b9c64553d53ec8c7" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:18:28 crc kubenswrapper[5120]: E0316 16:18:28.889666 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="e97ac48130213536a9b9b0d15722b762acfe6f81aabde1c8b9c64553d53ec8c7" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:18:28 crc kubenswrapper[5120]: E0316 16:18:28.889971 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="e73bdb2c-01bf-4eca-93df-22b051fee769" containerName="nova-cell1-conductor-conductor" probeResult="unknown" Mar 16 16:18:29 crc kubenswrapper[5120]: E0316 16:18:29.473805 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="6c6a76b2480d11bbcbe9da4f0bbb77ee9e7dcffe33abc117e4fd2108ee958a64" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:18:29 crc kubenswrapper[5120]: E0316 16:18:29.475863 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="6c6a76b2480d11bbcbe9da4f0bbb77ee9e7dcffe33abc117e4fd2108ee958a64" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:18:29 crc kubenswrapper[5120]: E0316 16:18:29.477664 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="6c6a76b2480d11bbcbe9da4f0bbb77ee9e7dcffe33abc117e4fd2108ee958a64" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:18:29 crc kubenswrapper[5120]: E0316 16:18:29.477829 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="711e7cd2-a028-4c76-969e-e08558a5d732" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 16:18:29 crc kubenswrapper[5120]: I0316 16:18:29.836316 5120 pod_container_manager_linux.go:217] "Failed to delete cgroup paths" cgroupName=["kubepods","burstable","poda9aa8c5d-78c1-43ce-9503-6e2ef87c6520"] err="unable to destroy cgroup paths for cgroup [kubepods burstable poda9aa8c5d-78c1-43ce-9503-6e2ef87c6520] : Timed out while waiting for systemd to remove kubepods-burstable-poda9aa8c5d_78c1_43ce_9503_6e2ef87c6520.slice" Mar 16 16:18:29 crc kubenswrapper[5120]: E0316 16:18:29.836380 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to delete cgroup paths for [kubepods burstable poda9aa8c5d-78c1-43ce-9503-6e2ef87c6520] : unable to destroy cgroup paths for cgroup [kubepods burstable poda9aa8c5d-78c1-43ce-9503-6e2ef87c6520] : Timed out while waiting for systemd to remove kubepods-burstable-poda9aa8c5d_78c1_43ce_9503_6e2ef87c6520.slice" pod="openshift-marketplace/redhat-operators-9nt5d" podUID="a9aa8c5d-78c1-43ce-9503-6e2ef87c6520" Mar 16 16:18:29 crc kubenswrapper[5120]: I0316 16:18:29.938157 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-9nt5d" Mar 16 16:18:29 crc kubenswrapper[5120]: I0316 16:18:29.996718 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-operators-9nt5d"] Mar 16 16:18:30 crc kubenswrapper[5120]: I0316 16:18:30.005561 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/redhat-operators-9nt5d"] Mar 16 16:18:30 crc kubenswrapper[5120]: I0316 16:18:30.415413 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:18:30 crc kubenswrapper[5120]: I0316 16:18:30.491708 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:18:30 crc kubenswrapper[5120]: I0316 16:18:30.553328 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/101749dc-c834-4d18-9d65-704af8b368a4-combined-ca-bundle\") pod \"101749dc-c834-4d18-9d65-704af8b368a4\" (UID: \"101749dc-c834-4d18-9d65-704af8b368a4\") " Mar 16 16:18:30 crc kubenswrapper[5120]: I0316 16:18:30.553490 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"swift\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"101749dc-c834-4d18-9d65-704af8b368a4\" (UID: \"101749dc-c834-4d18-9d65-704af8b368a4\") " Mar 16 16:18:30 crc kubenswrapper[5120]: I0316 16:18:30.553572 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/101749dc-c834-4d18-9d65-704af8b368a4-etc-swift\") pod \"101749dc-c834-4d18-9d65-704af8b368a4\" (UID: \"101749dc-c834-4d18-9d65-704af8b368a4\") " Mar 16 16:18:30 crc kubenswrapper[5120]: I0316 16:18:30.553606 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/101749dc-c834-4d18-9d65-704af8b368a4-lock\") pod \"101749dc-c834-4d18-9d65-704af8b368a4\" (UID: \"101749dc-c834-4d18-9d65-704af8b368a4\") " Mar 16 16:18:30 crc kubenswrapper[5120]: I0316 16:18:30.553665 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/101749dc-c834-4d18-9d65-704af8b368a4-cache\") pod \"101749dc-c834-4d18-9d65-704af8b368a4\" (UID: \"101749dc-c834-4d18-9d65-704af8b368a4\") " Mar 16 16:18:30 crc kubenswrapper[5120]: I0316 16:18:30.553791 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gddfd\" (UniqueName: \"kubernetes.io/projected/101749dc-c834-4d18-9d65-704af8b368a4-kube-api-access-gddfd\") pod \"101749dc-c834-4d18-9d65-704af8b368a4\" (UID: \"101749dc-c834-4d18-9d65-704af8b368a4\") " Mar 16 16:18:30 crc kubenswrapper[5120]: I0316 16:18:30.555439 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/101749dc-c834-4d18-9d65-704af8b368a4-cache" (OuterVolumeSpecName: "cache") pod "101749dc-c834-4d18-9d65-704af8b368a4" (UID: "101749dc-c834-4d18-9d65-704af8b368a4"). InnerVolumeSpecName "cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:18:30 crc kubenswrapper[5120]: I0316 16:18:30.555573 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/101749dc-c834-4d18-9d65-704af8b368a4-lock" (OuterVolumeSpecName: "lock") pod "101749dc-c834-4d18-9d65-704af8b368a4" (UID: "101749dc-c834-4d18-9d65-704af8b368a4"). InnerVolumeSpecName "lock". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:18:30 crc kubenswrapper[5120]: I0316 16:18:30.560876 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/101749dc-c834-4d18-9d65-704af8b368a4-etc-swift" (OuterVolumeSpecName: "etc-swift") pod "101749dc-c834-4d18-9d65-704af8b368a4" (UID: "101749dc-c834-4d18-9d65-704af8b368a4"). InnerVolumeSpecName "etc-swift". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:18:30 crc kubenswrapper[5120]: I0316 16:18:30.561100 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage06-crc" (OuterVolumeSpecName: "swift") pod "101749dc-c834-4d18-9d65-704af8b368a4" (UID: "101749dc-c834-4d18-9d65-704af8b368a4"). InnerVolumeSpecName "local-storage06-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:18:30 crc kubenswrapper[5120]: I0316 16:18:30.561948 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/101749dc-c834-4d18-9d65-704af8b368a4-kube-api-access-gddfd" (OuterVolumeSpecName: "kube-api-access-gddfd") pod "101749dc-c834-4d18-9d65-704af8b368a4" (UID: "101749dc-c834-4d18-9d65-704af8b368a4"). InnerVolumeSpecName "kube-api-access-gddfd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:18:30 crc kubenswrapper[5120]: I0316 16:18:30.654548 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1c354659-a22a-4fa3-8747-75b7241aea49-config-data\") pod \"1c354659-a22a-4fa3-8747-75b7241aea49\" (UID: \"1c354659-a22a-4fa3-8747-75b7241aea49\") " Mar 16 16:18:30 crc kubenswrapper[5120]: I0316 16:18:30.655003 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/1c354659-a22a-4fa3-8747-75b7241aea49-etc-machine-id\") pod \"1c354659-a22a-4fa3-8747-75b7241aea49\" (UID: \"1c354659-a22a-4fa3-8747-75b7241aea49\") " Mar 16 16:18:30 crc kubenswrapper[5120]: I0316 16:18:30.655075 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1c354659-a22a-4fa3-8747-75b7241aea49-combined-ca-bundle\") pod \"1c354659-a22a-4fa3-8747-75b7241aea49\" (UID: \"1c354659-a22a-4fa3-8747-75b7241aea49\") " Mar 16 16:18:30 crc kubenswrapper[5120]: I0316 16:18:30.655111 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/1c354659-a22a-4fa3-8747-75b7241aea49-config-data-custom\") pod \"1c354659-a22a-4fa3-8747-75b7241aea49\" (UID: \"1c354659-a22a-4fa3-8747-75b7241aea49\") " Mar 16 16:18:30 crc kubenswrapper[5120]: I0316 16:18:30.655133 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1c354659-a22a-4fa3-8747-75b7241aea49-scripts\") pod \"1c354659-a22a-4fa3-8747-75b7241aea49\" (UID: \"1c354659-a22a-4fa3-8747-75b7241aea49\") " Mar 16 16:18:30 crc kubenswrapper[5120]: I0316 16:18:30.655134 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/1c354659-a22a-4fa3-8747-75b7241aea49-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "1c354659-a22a-4fa3-8747-75b7241aea49" (UID: "1c354659-a22a-4fa3-8747-75b7241aea49"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 16:18:30 crc kubenswrapper[5120]: I0316 16:18:30.655170 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r5fl8\" (UniqueName: \"kubernetes.io/projected/1c354659-a22a-4fa3-8747-75b7241aea49-kube-api-access-r5fl8\") pod \"1c354659-a22a-4fa3-8747-75b7241aea49\" (UID: \"1c354659-a22a-4fa3-8747-75b7241aea49\") " Mar 16 16:18:30 crc kubenswrapper[5120]: I0316 16:18:30.655737 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gddfd\" (UniqueName: \"kubernetes.io/projected/101749dc-c834-4d18-9d65-704af8b368a4-kube-api-access-gddfd\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:30 crc kubenswrapper[5120]: I0316 16:18:30.655771 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") on node \"crc\" " Mar 16 16:18:30 crc kubenswrapper[5120]: I0316 16:18:30.655796 5120 reconciler_common.go:299] "Volume detached for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/101749dc-c834-4d18-9d65-704af8b368a4-etc-swift\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:30 crc kubenswrapper[5120]: I0316 16:18:30.655805 5120 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/1c354659-a22a-4fa3-8747-75b7241aea49-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:30 crc kubenswrapper[5120]: I0316 16:18:30.655815 5120 reconciler_common.go:299] "Volume detached for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/101749dc-c834-4d18-9d65-704af8b368a4-lock\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:30 crc kubenswrapper[5120]: I0316 16:18:30.655823 5120 reconciler_common.go:299] "Volume detached for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/101749dc-c834-4d18-9d65-704af8b368a4-cache\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:30 crc kubenswrapper[5120]: I0316 16:18:30.658582 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c354659-a22a-4fa3-8747-75b7241aea49-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "1c354659-a22a-4fa3-8747-75b7241aea49" (UID: "1c354659-a22a-4fa3-8747-75b7241aea49"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:18:30 crc kubenswrapper[5120]: I0316 16:18:30.659113 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c354659-a22a-4fa3-8747-75b7241aea49-kube-api-access-r5fl8" (OuterVolumeSpecName: "kube-api-access-r5fl8") pod "1c354659-a22a-4fa3-8747-75b7241aea49" (UID: "1c354659-a22a-4fa3-8747-75b7241aea49"). InnerVolumeSpecName "kube-api-access-r5fl8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:18:30 crc kubenswrapper[5120]: I0316 16:18:30.659725 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c354659-a22a-4fa3-8747-75b7241aea49-scripts" (OuterVolumeSpecName: "scripts") pod "1c354659-a22a-4fa3-8747-75b7241aea49" (UID: "1c354659-a22a-4fa3-8747-75b7241aea49"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:18:30 crc kubenswrapper[5120]: I0316 16:18:30.671998 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage06-crc" (UniqueName: "kubernetes.io/local-volume/local-storage06-crc") on node "crc" Mar 16 16:18:30 crc kubenswrapper[5120]: I0316 16:18:30.672773 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a9aa8c5d-78c1-43ce-9503-6e2ef87c6520" path="/var/lib/kubelet/pods/a9aa8c5d-78c1-43ce-9503-6e2ef87c6520/volumes" Mar 16 16:18:30 crc kubenswrapper[5120]: I0316 16:18:30.697037 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c354659-a22a-4fa3-8747-75b7241aea49-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "1c354659-a22a-4fa3-8747-75b7241aea49" (UID: "1c354659-a22a-4fa3-8747-75b7241aea49"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:18:30 crc kubenswrapper[5120]: I0316 16:18:30.731752 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c354659-a22a-4fa3-8747-75b7241aea49-config-data" (OuterVolumeSpecName: "config-data") pod "1c354659-a22a-4fa3-8747-75b7241aea49" (UID: "1c354659-a22a-4fa3-8747-75b7241aea49"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:18:30 crc kubenswrapper[5120]: I0316 16:18:30.758078 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:30 crc kubenswrapper[5120]: I0316 16:18:30.758124 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1c354659-a22a-4fa3-8747-75b7241aea49-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:30 crc kubenswrapper[5120]: I0316 16:18:30.758135 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1c354659-a22a-4fa3-8747-75b7241aea49-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:30 crc kubenswrapper[5120]: I0316 16:18:30.758147 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/1c354659-a22a-4fa3-8747-75b7241aea49-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:30 crc kubenswrapper[5120]: I0316 16:18:30.758156 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1c354659-a22a-4fa3-8747-75b7241aea49-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:30 crc kubenswrapper[5120]: I0316 16:18:30.758167 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r5fl8\" (UniqueName: \"kubernetes.io/projected/1c354659-a22a-4fa3-8747-75b7241aea49-kube-api-access-r5fl8\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:30 crc kubenswrapper[5120]: I0316 16:18:30.859433 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/101749dc-c834-4d18-9d65-704af8b368a4-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "101749dc-c834-4d18-9d65-704af8b368a4" (UID: "101749dc-c834-4d18-9d65-704af8b368a4"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:18:30 crc kubenswrapper[5120]: I0316 16:18:30.859885 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/101749dc-c834-4d18-9d65-704af8b368a4-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:30 crc kubenswrapper[5120]: I0316 16:18:30.950185 5120 generic.go:358] "Generic (PLEG): container finished" podID="1c354659-a22a-4fa3-8747-75b7241aea49" containerID="6b9790a44239640d9456c0bcdc9e4c40280465570805a0b2131ed727167a1767" exitCode=137 Mar 16 16:18:30 crc kubenswrapper[5120]: I0316 16:18:30.950329 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"1c354659-a22a-4fa3-8747-75b7241aea49","Type":"ContainerDied","Data":"6b9790a44239640d9456c0bcdc9e4c40280465570805a0b2131ed727167a1767"} Mar 16 16:18:30 crc kubenswrapper[5120]: I0316 16:18:30.950408 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"1c354659-a22a-4fa3-8747-75b7241aea49","Type":"ContainerDied","Data":"56aadc758dbb1dde99eddcfe80f07a7ca65fd002a6446660bb91ec6f341094b4"} Mar 16 16:18:30 crc kubenswrapper[5120]: I0316 16:18:30.950432 5120 scope.go:117] "RemoveContainer" containerID="e7d4e3842ff2074c385862c7f0cb2ed29aa14bda35f907a94808d0d9edb150e9" Mar 16 16:18:30 crc kubenswrapper[5120]: I0316 16:18:30.950853 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:18:30 crc kubenswrapper[5120]: I0316 16:18:30.957842 5120 generic.go:358] "Generic (PLEG): container finished" podID="3f5ad605-f6ee-47e9-a2b6-43e60f01c4c9" containerID="a1f5e797b52c263768103f57dc958a68929e1eaed737a81298570c479cbfd478" exitCode=137 Mar 16 16:18:30 crc kubenswrapper[5120]: I0316 16:18:30.957924 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"3f5ad605-f6ee-47e9-a2b6-43e60f01c4c9","Type":"ContainerDied","Data":"a1f5e797b52c263768103f57dc958a68929e1eaed737a81298570c479cbfd478"} Mar 16 16:18:30 crc kubenswrapper[5120]: I0316 16:18:30.972475 5120 generic.go:358] "Generic (PLEG): container finished" podID="101749dc-c834-4d18-9d65-704af8b368a4" containerID="ece1a88abc1997dbb13342308b7cefe3d5da6a00ca03108092562f3d6a4f1d16" exitCode=137 Mar 16 16:18:30 crc kubenswrapper[5120]: I0316 16:18:30.972570 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"101749dc-c834-4d18-9d65-704af8b368a4","Type":"ContainerDied","Data":"ece1a88abc1997dbb13342308b7cefe3d5da6a00ca03108092562f3d6a4f1d16"} Mar 16 16:18:30 crc kubenswrapper[5120]: I0316 16:18:30.972682 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"101749dc-c834-4d18-9d65-704af8b368a4","Type":"ContainerDied","Data":"197f27f892721488b0848c325b307ad49c1fce4664f9c8cb573b750610849bb6"} Mar 16 16:18:30 crc kubenswrapper[5120]: I0316 16:18:30.973100 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:18:30 crc kubenswrapper[5120]: I0316 16:18:30.994808 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:18:31 crc kubenswrapper[5120]: I0316 16:18:31.005515 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:18:31 crc kubenswrapper[5120]: I0316 16:18:31.046684 5120 scope.go:117] "RemoveContainer" containerID="6b9790a44239640d9456c0bcdc9e4c40280465570805a0b2131ed727167a1767" Mar 16 16:18:31 crc kubenswrapper[5120]: I0316 16:18:31.356000 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:18:31 crc kubenswrapper[5120]: I0316 16:18:31.358534 5120 scope.go:117] "RemoveContainer" containerID="e7d4e3842ff2074c385862c7f0cb2ed29aa14bda35f907a94808d0d9edb150e9" Mar 16 16:18:31 crc kubenswrapper[5120]: E0316 16:18:31.358997 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e7d4e3842ff2074c385862c7f0cb2ed29aa14bda35f907a94808d0d9edb150e9\": container with ID starting with e7d4e3842ff2074c385862c7f0cb2ed29aa14bda35f907a94808d0d9edb150e9 not found: ID does not exist" containerID="e7d4e3842ff2074c385862c7f0cb2ed29aa14bda35f907a94808d0d9edb150e9" Mar 16 16:18:31 crc kubenswrapper[5120]: I0316 16:18:31.359042 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7d4e3842ff2074c385862c7f0cb2ed29aa14bda35f907a94808d0d9edb150e9"} err="failed to get container status \"e7d4e3842ff2074c385862c7f0cb2ed29aa14bda35f907a94808d0d9edb150e9\": rpc error: code = NotFound desc = could not find container \"e7d4e3842ff2074c385862c7f0cb2ed29aa14bda35f907a94808d0d9edb150e9\": container with ID starting with e7d4e3842ff2074c385862c7f0cb2ed29aa14bda35f907a94808d0d9edb150e9 not found: ID does not exist" Mar 16 16:18:31 crc kubenswrapper[5120]: I0316 16:18:31.359071 5120 scope.go:117] "RemoveContainer" containerID="6b9790a44239640d9456c0bcdc9e4c40280465570805a0b2131ed727167a1767" Mar 16 16:18:31 crc kubenswrapper[5120]: E0316 16:18:31.360129 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b9790a44239640d9456c0bcdc9e4c40280465570805a0b2131ed727167a1767\": container with ID starting with 6b9790a44239640d9456c0bcdc9e4c40280465570805a0b2131ed727167a1767 not found: ID does not exist" containerID="6b9790a44239640d9456c0bcdc9e4c40280465570805a0b2131ed727167a1767" Mar 16 16:18:31 crc kubenswrapper[5120]: I0316 16:18:31.360175 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b9790a44239640d9456c0bcdc9e4c40280465570805a0b2131ed727167a1767"} err="failed to get container status \"6b9790a44239640d9456c0bcdc9e4c40280465570805a0b2131ed727167a1767\": rpc error: code = NotFound desc = could not find container \"6b9790a44239640d9456c0bcdc9e4c40280465570805a0b2131ed727167a1767\": container with ID starting with 6b9790a44239640d9456c0bcdc9e4c40280465570805a0b2131ed727167a1767 not found: ID does not exist" Mar 16 16:18:31 crc kubenswrapper[5120]: I0316 16:18:31.360200 5120 scope.go:117] "RemoveContainer" containerID="ece1a88abc1997dbb13342308b7cefe3d5da6a00ca03108092562f3d6a4f1d16" Mar 16 16:18:31 crc kubenswrapper[5120]: I0316 16:18:31.404502 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 16:18:31 crc kubenswrapper[5120]: I0316 16:18:31.426181 5120 scope.go:117] "RemoveContainer" containerID="088d32f480158b50b622b79c86870fbb30bf7d4089dd0d34fcf8a46590f9352d" Mar 16 16:18:31 crc kubenswrapper[5120]: I0316 16:18:31.426383 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 16:18:31 crc kubenswrapper[5120]: I0316 16:18:31.456677 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:18:31 crc kubenswrapper[5120]: I0316 16:18:31.469278 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3f5ad605-f6ee-47e9-a2b6-43e60f01c4c9-combined-ca-bundle\") pod \"3f5ad605-f6ee-47e9-a2b6-43e60f01c4c9\" (UID: \"3f5ad605-f6ee-47e9-a2b6-43e60f01c4c9\") " Mar 16 16:18:31 crc kubenswrapper[5120]: I0316 16:18:31.469404 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3f5ad605-f6ee-47e9-a2b6-43e60f01c4c9-config-data\") pod \"3f5ad605-f6ee-47e9-a2b6-43e60f01c4c9\" (UID: \"3f5ad605-f6ee-47e9-a2b6-43e60f01c4c9\") " Mar 16 16:18:31 crc kubenswrapper[5120]: I0316 16:18:31.469453 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7fm9p\" (UniqueName: \"kubernetes.io/projected/3f5ad605-f6ee-47e9-a2b6-43e60f01c4c9-kube-api-access-7fm9p\") pod \"3f5ad605-f6ee-47e9-a2b6-43e60f01c4c9\" (UID: \"3f5ad605-f6ee-47e9-a2b6-43e60f01c4c9\") " Mar 16 16:18:31 crc kubenswrapper[5120]: I0316 16:18:31.478201 5120 scope.go:117] "RemoveContainer" containerID="d3498f4c52aa0e90e0fc4d0abe76a9d9dfdd5f4ff506a2e63ee7f72189220719" Mar 16 16:18:31 crc kubenswrapper[5120]: I0316 16:18:31.479531 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f5ad605-f6ee-47e9-a2b6-43e60f01c4c9-kube-api-access-7fm9p" (OuterVolumeSpecName: "kube-api-access-7fm9p") pod "3f5ad605-f6ee-47e9-a2b6-43e60f01c4c9" (UID: "3f5ad605-f6ee-47e9-a2b6-43e60f01c4c9"). InnerVolumeSpecName "kube-api-access-7fm9p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:18:31 crc kubenswrapper[5120]: I0316 16:18:31.502016 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f5ad605-f6ee-47e9-a2b6-43e60f01c4c9-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "3f5ad605-f6ee-47e9-a2b6-43e60f01c4c9" (UID: "3f5ad605-f6ee-47e9-a2b6-43e60f01c4c9"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:18:31 crc kubenswrapper[5120]: I0316 16:18:31.503547 5120 scope.go:117] "RemoveContainer" containerID="b4ac5deaffac392f3bb392fc03b0084b602ddec296f8870f1652da6f222d4e54" Mar 16 16:18:31 crc kubenswrapper[5120]: I0316 16:18:31.505829 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:18:31 crc kubenswrapper[5120]: I0316 16:18:31.526047 5120 scope.go:117] "RemoveContainer" containerID="10dfe1e92abc7a6f8ab5af868cf187ab014f8189c9aa859d23d8de692d693309" Mar 16 16:18:31 crc kubenswrapper[5120]: I0316 16:18:31.526566 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f5ad605-f6ee-47e9-a2b6-43e60f01c4c9-config-data" (OuterVolumeSpecName: "config-data") pod "3f5ad605-f6ee-47e9-a2b6-43e60f01c4c9" (UID: "3f5ad605-f6ee-47e9-a2b6-43e60f01c4c9"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:18:31 crc kubenswrapper[5120]: I0316 16:18:31.547490 5120 scope.go:117] "RemoveContainer" containerID="e3aa4f856a04b1edd734f731b0ff764b58f2b038b82ca0b0d4359c2b9bf86469" Mar 16 16:18:31 crc kubenswrapper[5120]: I0316 16:18:31.566814 5120 scope.go:117] "RemoveContainer" containerID="65875e7567b5b9a91bd06c5e05daccd574160efc902dcf5923e2b79b0c8d2244" Mar 16 16:18:31 crc kubenswrapper[5120]: I0316 16:18:31.570641 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/711e7cd2-a028-4c76-969e-e08558a5d732-combined-ca-bundle\") pod \"711e7cd2-a028-4c76-969e-e08558a5d732\" (UID: \"711e7cd2-a028-4c76-969e-e08558a5d732\") " Mar 16 16:18:31 crc kubenswrapper[5120]: I0316 16:18:31.570920 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e73bdb2c-01bf-4eca-93df-22b051fee769-combined-ca-bundle\") pod \"e73bdb2c-01bf-4eca-93df-22b051fee769\" (UID: \"e73bdb2c-01bf-4eca-93df-22b051fee769\") " Mar 16 16:18:31 crc kubenswrapper[5120]: I0316 16:18:31.570983 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e73bdb2c-01bf-4eca-93df-22b051fee769-config-data\") pod \"e73bdb2c-01bf-4eca-93df-22b051fee769\" (UID: \"e73bdb2c-01bf-4eca-93df-22b051fee769\") " Mar 16 16:18:31 crc kubenswrapper[5120]: I0316 16:18:31.571016 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lvzzn\" (UniqueName: \"kubernetes.io/projected/e73bdb2c-01bf-4eca-93df-22b051fee769-kube-api-access-lvzzn\") pod \"e73bdb2c-01bf-4eca-93df-22b051fee769\" (UID: \"e73bdb2c-01bf-4eca-93df-22b051fee769\") " Mar 16 16:18:31 crc kubenswrapper[5120]: I0316 16:18:31.571070 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-znd29\" (UniqueName: \"kubernetes.io/projected/711e7cd2-a028-4c76-969e-e08558a5d732-kube-api-access-znd29\") pod \"711e7cd2-a028-4c76-969e-e08558a5d732\" (UID: \"711e7cd2-a028-4c76-969e-e08558a5d732\") " Mar 16 16:18:31 crc kubenswrapper[5120]: I0316 16:18:31.571151 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/711e7cd2-a028-4c76-969e-e08558a5d732-config-data\") pod \"711e7cd2-a028-4c76-969e-e08558a5d732\" (UID: \"711e7cd2-a028-4c76-969e-e08558a5d732\") " Mar 16 16:18:31 crc kubenswrapper[5120]: I0316 16:18:31.571476 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3f5ad605-f6ee-47e9-a2b6-43e60f01c4c9-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:31 crc kubenswrapper[5120]: I0316 16:18:31.571491 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7fm9p\" (UniqueName: \"kubernetes.io/projected/3f5ad605-f6ee-47e9-a2b6-43e60f01c4c9-kube-api-access-7fm9p\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:31 crc kubenswrapper[5120]: I0316 16:18:31.571500 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3f5ad605-f6ee-47e9-a2b6-43e60f01c4c9-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:31 crc kubenswrapper[5120]: I0316 16:18:31.574867 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e73bdb2c-01bf-4eca-93df-22b051fee769-kube-api-access-lvzzn" (OuterVolumeSpecName: "kube-api-access-lvzzn") pod "e73bdb2c-01bf-4eca-93df-22b051fee769" (UID: "e73bdb2c-01bf-4eca-93df-22b051fee769"). InnerVolumeSpecName "kube-api-access-lvzzn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:18:31 crc kubenswrapper[5120]: I0316 16:18:31.575294 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/711e7cd2-a028-4c76-969e-e08558a5d732-kube-api-access-znd29" (OuterVolumeSpecName: "kube-api-access-znd29") pod "711e7cd2-a028-4c76-969e-e08558a5d732" (UID: "711e7cd2-a028-4c76-969e-e08558a5d732"). InnerVolumeSpecName "kube-api-access-znd29". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:18:31 crc kubenswrapper[5120]: I0316 16:18:31.589998 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/711e7cd2-a028-4c76-969e-e08558a5d732-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "711e7cd2-a028-4c76-969e-e08558a5d732" (UID: "711e7cd2-a028-4c76-969e-e08558a5d732"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:18:31 crc kubenswrapper[5120]: I0316 16:18:31.592919 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/711e7cd2-a028-4c76-969e-e08558a5d732-config-data" (OuterVolumeSpecName: "config-data") pod "711e7cd2-a028-4c76-969e-e08558a5d732" (UID: "711e7cd2-a028-4c76-969e-e08558a5d732"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:18:31 crc kubenswrapper[5120]: I0316 16:18:31.593484 5120 scope.go:117] "RemoveContainer" containerID="1c5916dc01f8f4a3e1534605c444a2119e71a700b54a69e10c8bb9e635de25e8" Mar 16 16:18:31 crc kubenswrapper[5120]: I0316 16:18:31.595599 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e73bdb2c-01bf-4eca-93df-22b051fee769-config-data" (OuterVolumeSpecName: "config-data") pod "e73bdb2c-01bf-4eca-93df-22b051fee769" (UID: "e73bdb2c-01bf-4eca-93df-22b051fee769"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:18:31 crc kubenswrapper[5120]: I0316 16:18:31.597325 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e73bdb2c-01bf-4eca-93df-22b051fee769-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e73bdb2c-01bf-4eca-93df-22b051fee769" (UID: "e73bdb2c-01bf-4eca-93df-22b051fee769"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:18:31 crc kubenswrapper[5120]: I0316 16:18:31.610073 5120 scope.go:117] "RemoveContainer" containerID="51cf967532606c9ced06ad6de8648b12654ee7582414482d898f98946c9fa5fc" Mar 16 16:18:31 crc kubenswrapper[5120]: I0316 16:18:31.637318 5120 scope.go:117] "RemoveContainer" containerID="4cb9bb128aaf44f72b20395fcb3cc05e72d1adffacb345c94004414396b1d28a" Mar 16 16:18:31 crc kubenswrapper[5120]: I0316 16:18:31.657428 5120 scope.go:117] "RemoveContainer" containerID="01823eea0af03bb3372ba342990110a4b6c8c7fa9118b0d7d29650e99d2cd108" Mar 16 16:18:31 crc kubenswrapper[5120]: I0316 16:18:31.672568 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e73bdb2c-01bf-4eca-93df-22b051fee769-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:31 crc kubenswrapper[5120]: I0316 16:18:31.672592 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e73bdb2c-01bf-4eca-93df-22b051fee769-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:31 crc kubenswrapper[5120]: I0316 16:18:31.672601 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lvzzn\" (UniqueName: \"kubernetes.io/projected/e73bdb2c-01bf-4eca-93df-22b051fee769-kube-api-access-lvzzn\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:31 crc kubenswrapper[5120]: I0316 16:18:31.672610 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-znd29\" (UniqueName: \"kubernetes.io/projected/711e7cd2-a028-4c76-969e-e08558a5d732-kube-api-access-znd29\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:31 crc kubenswrapper[5120]: I0316 16:18:31.672620 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/711e7cd2-a028-4c76-969e-e08558a5d732-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:31 crc kubenswrapper[5120]: I0316 16:18:31.672630 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/711e7cd2-a028-4c76-969e-e08558a5d732-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:31 crc kubenswrapper[5120]: E0316 16:18:31.672647 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-config-data: configmap "rabbitmq-config-data" not found Mar 16 16:18:31 crc kubenswrapper[5120]: E0316 16:18:31.672714 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/51d5f0da-bcbc-492e-ab39-6189dc22fa22-config-data podName:51d5f0da-bcbc-492e-ab39-6189dc22fa22 nodeName:}" failed. No retries permitted until 2026-03-16 16:19:03.672697106 +0000 UTC m=+2845.826628763 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/51d5f0da-bcbc-492e-ab39-6189dc22fa22-config-data") pod "rabbitmq-server-0" (UID: "51d5f0da-bcbc-492e-ab39-6189dc22fa22") : configmap "rabbitmq-config-data" not found Mar 16 16:18:31 crc kubenswrapper[5120]: I0316 16:18:31.675037 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:18:31 crc kubenswrapper[5120]: I0316 16:18:31.689609 5120 scope.go:117] "RemoveContainer" containerID="4a42fa4b365d37c495ee5ee82170ce1b235d8d672fd02b0158bdcc126237e473" Mar 16 16:18:31 crc kubenswrapper[5120]: I0316 16:18:31.712812 5120 scope.go:117] "RemoveContainer" containerID="bef2d8e8e654dd9a105c210bd37ced0c71c3d573629cb12e5d3cbd97b64421d7" Mar 16 16:18:31 crc kubenswrapper[5120]: I0316 16:18:31.730598 5120 scope.go:117] "RemoveContainer" containerID="4a42f47b6d82f13c7158ef114a3d72c3c33bdc7a2c6031a71bfddca2f3b3ca3a" Mar 16 16:18:31 crc kubenswrapper[5120]: I0316 16:18:31.748264 5120 scope.go:117] "RemoveContainer" containerID="724e698bc2647d226f34e5e375df069d0a2d87cec35127fb8ca1aa87a3e302dc" Mar 16 16:18:31 crc kubenswrapper[5120]: I0316 16:18:31.764890 5120 scope.go:117] "RemoveContainer" containerID="ece1a88abc1997dbb13342308b7cefe3d5da6a00ca03108092562f3d6a4f1d16" Mar 16 16:18:31 crc kubenswrapper[5120]: E0316 16:18:31.765230 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ece1a88abc1997dbb13342308b7cefe3d5da6a00ca03108092562f3d6a4f1d16\": container with ID starting with ece1a88abc1997dbb13342308b7cefe3d5da6a00ca03108092562f3d6a4f1d16 not found: ID does not exist" containerID="ece1a88abc1997dbb13342308b7cefe3d5da6a00ca03108092562f3d6a4f1d16" Mar 16 16:18:31 crc kubenswrapper[5120]: I0316 16:18:31.765257 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ece1a88abc1997dbb13342308b7cefe3d5da6a00ca03108092562f3d6a4f1d16"} err="failed to get container status \"ece1a88abc1997dbb13342308b7cefe3d5da6a00ca03108092562f3d6a4f1d16\": rpc error: code = NotFound desc = could not find container \"ece1a88abc1997dbb13342308b7cefe3d5da6a00ca03108092562f3d6a4f1d16\": container with ID starting with ece1a88abc1997dbb13342308b7cefe3d5da6a00ca03108092562f3d6a4f1d16 not found: ID does not exist" Mar 16 16:18:31 crc kubenswrapper[5120]: I0316 16:18:31.765277 5120 scope.go:117] "RemoveContainer" containerID="088d32f480158b50b622b79c86870fbb30bf7d4089dd0d34fcf8a46590f9352d" Mar 16 16:18:31 crc kubenswrapper[5120]: E0316 16:18:31.765487 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"088d32f480158b50b622b79c86870fbb30bf7d4089dd0d34fcf8a46590f9352d\": container with ID starting with 088d32f480158b50b622b79c86870fbb30bf7d4089dd0d34fcf8a46590f9352d not found: ID does not exist" containerID="088d32f480158b50b622b79c86870fbb30bf7d4089dd0d34fcf8a46590f9352d" Mar 16 16:18:31 crc kubenswrapper[5120]: I0316 16:18:31.765507 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"088d32f480158b50b622b79c86870fbb30bf7d4089dd0d34fcf8a46590f9352d"} err="failed to get container status \"088d32f480158b50b622b79c86870fbb30bf7d4089dd0d34fcf8a46590f9352d\": rpc error: code = NotFound desc = could not find container \"088d32f480158b50b622b79c86870fbb30bf7d4089dd0d34fcf8a46590f9352d\": container with ID starting with 088d32f480158b50b622b79c86870fbb30bf7d4089dd0d34fcf8a46590f9352d not found: ID does not exist" Mar 16 16:18:31 crc kubenswrapper[5120]: I0316 16:18:31.765522 5120 scope.go:117] "RemoveContainer" containerID="d3498f4c52aa0e90e0fc4d0abe76a9d9dfdd5f4ff506a2e63ee7f72189220719" Mar 16 16:18:31 crc kubenswrapper[5120]: E0316 16:18:31.765918 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d3498f4c52aa0e90e0fc4d0abe76a9d9dfdd5f4ff506a2e63ee7f72189220719\": container with ID starting with d3498f4c52aa0e90e0fc4d0abe76a9d9dfdd5f4ff506a2e63ee7f72189220719 not found: ID does not exist" containerID="d3498f4c52aa0e90e0fc4d0abe76a9d9dfdd5f4ff506a2e63ee7f72189220719" Mar 16 16:18:31 crc kubenswrapper[5120]: I0316 16:18:31.765943 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3498f4c52aa0e90e0fc4d0abe76a9d9dfdd5f4ff506a2e63ee7f72189220719"} err="failed to get container status \"d3498f4c52aa0e90e0fc4d0abe76a9d9dfdd5f4ff506a2e63ee7f72189220719\": rpc error: code = NotFound desc = could not find container \"d3498f4c52aa0e90e0fc4d0abe76a9d9dfdd5f4ff506a2e63ee7f72189220719\": container with ID starting with d3498f4c52aa0e90e0fc4d0abe76a9d9dfdd5f4ff506a2e63ee7f72189220719 not found: ID does not exist" Mar 16 16:18:31 crc kubenswrapper[5120]: I0316 16:18:31.765959 5120 scope.go:117] "RemoveContainer" containerID="b4ac5deaffac392f3bb392fc03b0084b602ddec296f8870f1652da6f222d4e54" Mar 16 16:18:31 crc kubenswrapper[5120]: E0316 16:18:31.766193 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b4ac5deaffac392f3bb392fc03b0084b602ddec296f8870f1652da6f222d4e54\": container with ID starting with b4ac5deaffac392f3bb392fc03b0084b602ddec296f8870f1652da6f222d4e54 not found: ID does not exist" containerID="b4ac5deaffac392f3bb392fc03b0084b602ddec296f8870f1652da6f222d4e54" Mar 16 16:18:31 crc kubenswrapper[5120]: I0316 16:18:31.766219 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4ac5deaffac392f3bb392fc03b0084b602ddec296f8870f1652da6f222d4e54"} err="failed to get container status \"b4ac5deaffac392f3bb392fc03b0084b602ddec296f8870f1652da6f222d4e54\": rpc error: code = NotFound desc = could not find container \"b4ac5deaffac392f3bb392fc03b0084b602ddec296f8870f1652da6f222d4e54\": container with ID starting with b4ac5deaffac392f3bb392fc03b0084b602ddec296f8870f1652da6f222d4e54 not found: ID does not exist" Mar 16 16:18:31 crc kubenswrapper[5120]: I0316 16:18:31.766243 5120 scope.go:117] "RemoveContainer" containerID="10dfe1e92abc7a6f8ab5af868cf187ab014f8189c9aa859d23d8de692d693309" Mar 16 16:18:31 crc kubenswrapper[5120]: E0316 16:18:31.766535 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"10dfe1e92abc7a6f8ab5af868cf187ab014f8189c9aa859d23d8de692d693309\": container with ID starting with 10dfe1e92abc7a6f8ab5af868cf187ab014f8189c9aa859d23d8de692d693309 not found: ID does not exist" containerID="10dfe1e92abc7a6f8ab5af868cf187ab014f8189c9aa859d23d8de692d693309" Mar 16 16:18:31 crc kubenswrapper[5120]: I0316 16:18:31.766554 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10dfe1e92abc7a6f8ab5af868cf187ab014f8189c9aa859d23d8de692d693309"} err="failed to get container status \"10dfe1e92abc7a6f8ab5af868cf187ab014f8189c9aa859d23d8de692d693309\": rpc error: code = NotFound desc = could not find container \"10dfe1e92abc7a6f8ab5af868cf187ab014f8189c9aa859d23d8de692d693309\": container with ID starting with 10dfe1e92abc7a6f8ab5af868cf187ab014f8189c9aa859d23d8de692d693309 not found: ID does not exist" Mar 16 16:18:31 crc kubenswrapper[5120]: I0316 16:18:31.766566 5120 scope.go:117] "RemoveContainer" containerID="e3aa4f856a04b1edd734f731b0ff764b58f2b038b82ca0b0d4359c2b9bf86469" Mar 16 16:18:31 crc kubenswrapper[5120]: E0316 16:18:31.766744 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e3aa4f856a04b1edd734f731b0ff764b58f2b038b82ca0b0d4359c2b9bf86469\": container with ID starting with e3aa4f856a04b1edd734f731b0ff764b58f2b038b82ca0b0d4359c2b9bf86469 not found: ID does not exist" containerID="e3aa4f856a04b1edd734f731b0ff764b58f2b038b82ca0b0d4359c2b9bf86469" Mar 16 16:18:31 crc kubenswrapper[5120]: I0316 16:18:31.766855 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3aa4f856a04b1edd734f731b0ff764b58f2b038b82ca0b0d4359c2b9bf86469"} err="failed to get container status \"e3aa4f856a04b1edd734f731b0ff764b58f2b038b82ca0b0d4359c2b9bf86469\": rpc error: code = NotFound desc = could not find container \"e3aa4f856a04b1edd734f731b0ff764b58f2b038b82ca0b0d4359c2b9bf86469\": container with ID starting with e3aa4f856a04b1edd734f731b0ff764b58f2b038b82ca0b0d4359c2b9bf86469 not found: ID does not exist" Mar 16 16:18:31 crc kubenswrapper[5120]: I0316 16:18:31.766868 5120 scope.go:117] "RemoveContainer" containerID="65875e7567b5b9a91bd06c5e05daccd574160efc902dcf5923e2b79b0c8d2244" Mar 16 16:18:31 crc kubenswrapper[5120]: E0316 16:18:31.767149 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"65875e7567b5b9a91bd06c5e05daccd574160efc902dcf5923e2b79b0c8d2244\": container with ID starting with 65875e7567b5b9a91bd06c5e05daccd574160efc902dcf5923e2b79b0c8d2244 not found: ID does not exist" containerID="65875e7567b5b9a91bd06c5e05daccd574160efc902dcf5923e2b79b0c8d2244" Mar 16 16:18:31 crc kubenswrapper[5120]: I0316 16:18:31.767179 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65875e7567b5b9a91bd06c5e05daccd574160efc902dcf5923e2b79b0c8d2244"} err="failed to get container status \"65875e7567b5b9a91bd06c5e05daccd574160efc902dcf5923e2b79b0c8d2244\": rpc error: code = NotFound desc = could not find container \"65875e7567b5b9a91bd06c5e05daccd574160efc902dcf5923e2b79b0c8d2244\": container with ID starting with 65875e7567b5b9a91bd06c5e05daccd574160efc902dcf5923e2b79b0c8d2244 not found: ID does not exist" Mar 16 16:18:31 crc kubenswrapper[5120]: I0316 16:18:31.767192 5120 scope.go:117] "RemoveContainer" containerID="1c5916dc01f8f4a3e1534605c444a2119e71a700b54a69e10c8bb9e635de25e8" Mar 16 16:18:31 crc kubenswrapper[5120]: E0316 16:18:31.767533 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c5916dc01f8f4a3e1534605c444a2119e71a700b54a69e10c8bb9e635de25e8\": container with ID starting with 1c5916dc01f8f4a3e1534605c444a2119e71a700b54a69e10c8bb9e635de25e8 not found: ID does not exist" containerID="1c5916dc01f8f4a3e1534605c444a2119e71a700b54a69e10c8bb9e635de25e8" Mar 16 16:18:31 crc kubenswrapper[5120]: I0316 16:18:31.767553 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c5916dc01f8f4a3e1534605c444a2119e71a700b54a69e10c8bb9e635de25e8"} err="failed to get container status \"1c5916dc01f8f4a3e1534605c444a2119e71a700b54a69e10c8bb9e635de25e8\": rpc error: code = NotFound desc = could not find container \"1c5916dc01f8f4a3e1534605c444a2119e71a700b54a69e10c8bb9e635de25e8\": container with ID starting with 1c5916dc01f8f4a3e1534605c444a2119e71a700b54a69e10c8bb9e635de25e8 not found: ID does not exist" Mar 16 16:18:31 crc kubenswrapper[5120]: I0316 16:18:31.767565 5120 scope.go:117] "RemoveContainer" containerID="51cf967532606c9ced06ad6de8648b12654ee7582414482d898f98946c9fa5fc" Mar 16 16:18:31 crc kubenswrapper[5120]: E0316 16:18:31.767749 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"51cf967532606c9ced06ad6de8648b12654ee7582414482d898f98946c9fa5fc\": container with ID starting with 51cf967532606c9ced06ad6de8648b12654ee7582414482d898f98946c9fa5fc not found: ID does not exist" containerID="51cf967532606c9ced06ad6de8648b12654ee7582414482d898f98946c9fa5fc" Mar 16 16:18:31 crc kubenswrapper[5120]: I0316 16:18:31.767771 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51cf967532606c9ced06ad6de8648b12654ee7582414482d898f98946c9fa5fc"} err="failed to get container status \"51cf967532606c9ced06ad6de8648b12654ee7582414482d898f98946c9fa5fc\": rpc error: code = NotFound desc = could not find container \"51cf967532606c9ced06ad6de8648b12654ee7582414482d898f98946c9fa5fc\": container with ID starting with 51cf967532606c9ced06ad6de8648b12654ee7582414482d898f98946c9fa5fc not found: ID does not exist" Mar 16 16:18:31 crc kubenswrapper[5120]: I0316 16:18:31.767823 5120 scope.go:117] "RemoveContainer" containerID="4cb9bb128aaf44f72b20395fcb3cc05e72d1adffacb345c94004414396b1d28a" Mar 16 16:18:31 crc kubenswrapper[5120]: E0316 16:18:31.768119 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4cb9bb128aaf44f72b20395fcb3cc05e72d1adffacb345c94004414396b1d28a\": container with ID starting with 4cb9bb128aaf44f72b20395fcb3cc05e72d1adffacb345c94004414396b1d28a not found: ID does not exist" containerID="4cb9bb128aaf44f72b20395fcb3cc05e72d1adffacb345c94004414396b1d28a" Mar 16 16:18:31 crc kubenswrapper[5120]: I0316 16:18:31.768145 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4cb9bb128aaf44f72b20395fcb3cc05e72d1adffacb345c94004414396b1d28a"} err="failed to get container status \"4cb9bb128aaf44f72b20395fcb3cc05e72d1adffacb345c94004414396b1d28a\": rpc error: code = NotFound desc = could not find container \"4cb9bb128aaf44f72b20395fcb3cc05e72d1adffacb345c94004414396b1d28a\": container with ID starting with 4cb9bb128aaf44f72b20395fcb3cc05e72d1adffacb345c94004414396b1d28a not found: ID does not exist" Mar 16 16:18:31 crc kubenswrapper[5120]: I0316 16:18:31.768157 5120 scope.go:117] "RemoveContainer" containerID="01823eea0af03bb3372ba342990110a4b6c8c7fa9118b0d7d29650e99d2cd108" Mar 16 16:18:31 crc kubenswrapper[5120]: E0316 16:18:31.768415 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"01823eea0af03bb3372ba342990110a4b6c8c7fa9118b0d7d29650e99d2cd108\": container with ID starting with 01823eea0af03bb3372ba342990110a4b6c8c7fa9118b0d7d29650e99d2cd108 not found: ID does not exist" containerID="01823eea0af03bb3372ba342990110a4b6c8c7fa9118b0d7d29650e99d2cd108" Mar 16 16:18:31 crc kubenswrapper[5120]: I0316 16:18:31.768461 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01823eea0af03bb3372ba342990110a4b6c8c7fa9118b0d7d29650e99d2cd108"} err="failed to get container status \"01823eea0af03bb3372ba342990110a4b6c8c7fa9118b0d7d29650e99d2cd108\": rpc error: code = NotFound desc = could not find container \"01823eea0af03bb3372ba342990110a4b6c8c7fa9118b0d7d29650e99d2cd108\": container with ID starting with 01823eea0af03bb3372ba342990110a4b6c8c7fa9118b0d7d29650e99d2cd108 not found: ID does not exist" Mar 16 16:18:31 crc kubenswrapper[5120]: I0316 16:18:31.768474 5120 scope.go:117] "RemoveContainer" containerID="4a42fa4b365d37c495ee5ee82170ce1b235d8d672fd02b0158bdcc126237e473" Mar 16 16:18:31 crc kubenswrapper[5120]: E0316 16:18:31.768660 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4a42fa4b365d37c495ee5ee82170ce1b235d8d672fd02b0158bdcc126237e473\": container with ID starting with 4a42fa4b365d37c495ee5ee82170ce1b235d8d672fd02b0158bdcc126237e473 not found: ID does not exist" containerID="4a42fa4b365d37c495ee5ee82170ce1b235d8d672fd02b0158bdcc126237e473" Mar 16 16:18:31 crc kubenswrapper[5120]: I0316 16:18:31.768680 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a42fa4b365d37c495ee5ee82170ce1b235d8d672fd02b0158bdcc126237e473"} err="failed to get container status \"4a42fa4b365d37c495ee5ee82170ce1b235d8d672fd02b0158bdcc126237e473\": rpc error: code = NotFound desc = could not find container \"4a42fa4b365d37c495ee5ee82170ce1b235d8d672fd02b0158bdcc126237e473\": container with ID starting with 4a42fa4b365d37c495ee5ee82170ce1b235d8d672fd02b0158bdcc126237e473 not found: ID does not exist" Mar 16 16:18:31 crc kubenswrapper[5120]: I0316 16:18:31.768691 5120 scope.go:117] "RemoveContainer" containerID="bef2d8e8e654dd9a105c210bd37ced0c71c3d573629cb12e5d3cbd97b64421d7" Mar 16 16:18:31 crc kubenswrapper[5120]: E0316 16:18:31.768897 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bef2d8e8e654dd9a105c210bd37ced0c71c3d573629cb12e5d3cbd97b64421d7\": container with ID starting with bef2d8e8e654dd9a105c210bd37ced0c71c3d573629cb12e5d3cbd97b64421d7 not found: ID does not exist" containerID="bef2d8e8e654dd9a105c210bd37ced0c71c3d573629cb12e5d3cbd97b64421d7" Mar 16 16:18:31 crc kubenswrapper[5120]: I0316 16:18:31.768936 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bef2d8e8e654dd9a105c210bd37ced0c71c3d573629cb12e5d3cbd97b64421d7"} err="failed to get container status \"bef2d8e8e654dd9a105c210bd37ced0c71c3d573629cb12e5d3cbd97b64421d7\": rpc error: code = NotFound desc = could not find container \"bef2d8e8e654dd9a105c210bd37ced0c71c3d573629cb12e5d3cbd97b64421d7\": container with ID starting with bef2d8e8e654dd9a105c210bd37ced0c71c3d573629cb12e5d3cbd97b64421d7 not found: ID does not exist" Mar 16 16:18:31 crc kubenswrapper[5120]: I0316 16:18:31.768965 5120 scope.go:117] "RemoveContainer" containerID="4a42f47b6d82f13c7158ef114a3d72c3c33bdc7a2c6031a71bfddca2f3b3ca3a" Mar 16 16:18:31 crc kubenswrapper[5120]: E0316 16:18:31.769213 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4a42f47b6d82f13c7158ef114a3d72c3c33bdc7a2c6031a71bfddca2f3b3ca3a\": container with ID starting with 4a42f47b6d82f13c7158ef114a3d72c3c33bdc7a2c6031a71bfddca2f3b3ca3a not found: ID does not exist" containerID="4a42f47b6d82f13c7158ef114a3d72c3c33bdc7a2c6031a71bfddca2f3b3ca3a" Mar 16 16:18:31 crc kubenswrapper[5120]: I0316 16:18:31.769234 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a42f47b6d82f13c7158ef114a3d72c3c33bdc7a2c6031a71bfddca2f3b3ca3a"} err="failed to get container status \"4a42f47b6d82f13c7158ef114a3d72c3c33bdc7a2c6031a71bfddca2f3b3ca3a\": rpc error: code = NotFound desc = could not find container \"4a42f47b6d82f13c7158ef114a3d72c3c33bdc7a2c6031a71bfddca2f3b3ca3a\": container with ID starting with 4a42f47b6d82f13c7158ef114a3d72c3c33bdc7a2c6031a71bfddca2f3b3ca3a not found: ID does not exist" Mar 16 16:18:31 crc kubenswrapper[5120]: I0316 16:18:31.769248 5120 scope.go:117] "RemoveContainer" containerID="724e698bc2647d226f34e5e375df069d0a2d87cec35127fb8ca1aa87a3e302dc" Mar 16 16:18:31 crc kubenswrapper[5120]: E0316 16:18:31.769414 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"724e698bc2647d226f34e5e375df069d0a2d87cec35127fb8ca1aa87a3e302dc\": container with ID starting with 724e698bc2647d226f34e5e375df069d0a2d87cec35127fb8ca1aa87a3e302dc not found: ID does not exist" containerID="724e698bc2647d226f34e5e375df069d0a2d87cec35127fb8ca1aa87a3e302dc" Mar 16 16:18:31 crc kubenswrapper[5120]: I0316 16:18:31.769434 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"724e698bc2647d226f34e5e375df069d0a2d87cec35127fb8ca1aa87a3e302dc"} err="failed to get container status \"724e698bc2647d226f34e5e375df069d0a2d87cec35127fb8ca1aa87a3e302dc\": rpc error: code = NotFound desc = could not find container \"724e698bc2647d226f34e5e375df069d0a2d87cec35127fb8ca1aa87a3e302dc\": container with ID starting with 724e698bc2647d226f34e5e375df069d0a2d87cec35127fb8ca1aa87a3e302dc not found: ID does not exist" Mar 16 16:18:31 crc kubenswrapper[5120]: I0316 16:18:31.774000 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/76c6cd23-f4cd-4b95-95b1-252ec9c5cafa-sg-core-conf-yaml\") pod \"76c6cd23-f4cd-4b95-95b1-252ec9c5cafa\" (UID: \"76c6cd23-f4cd-4b95-95b1-252ec9c5cafa\") " Mar 16 16:18:31 crc kubenswrapper[5120]: I0316 16:18:31.774122 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xsdzm\" (UniqueName: \"kubernetes.io/projected/76c6cd23-f4cd-4b95-95b1-252ec9c5cafa-kube-api-access-xsdzm\") pod \"76c6cd23-f4cd-4b95-95b1-252ec9c5cafa\" (UID: \"76c6cd23-f4cd-4b95-95b1-252ec9c5cafa\") " Mar 16 16:18:31 crc kubenswrapper[5120]: I0316 16:18:31.774227 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/76c6cd23-f4cd-4b95-95b1-252ec9c5cafa-log-httpd\") pod \"76c6cd23-f4cd-4b95-95b1-252ec9c5cafa\" (UID: \"76c6cd23-f4cd-4b95-95b1-252ec9c5cafa\") " Mar 16 16:18:31 crc kubenswrapper[5120]: I0316 16:18:31.774268 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/76c6cd23-f4cd-4b95-95b1-252ec9c5cafa-ceilometer-tls-certs\") pod \"76c6cd23-f4cd-4b95-95b1-252ec9c5cafa\" (UID: \"76c6cd23-f4cd-4b95-95b1-252ec9c5cafa\") " Mar 16 16:18:31 crc kubenswrapper[5120]: I0316 16:18:31.774297 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/76c6cd23-f4cd-4b95-95b1-252ec9c5cafa-run-httpd\") pod \"76c6cd23-f4cd-4b95-95b1-252ec9c5cafa\" (UID: \"76c6cd23-f4cd-4b95-95b1-252ec9c5cafa\") " Mar 16 16:18:31 crc kubenswrapper[5120]: I0316 16:18:31.774359 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/76c6cd23-f4cd-4b95-95b1-252ec9c5cafa-combined-ca-bundle\") pod \"76c6cd23-f4cd-4b95-95b1-252ec9c5cafa\" (UID: \"76c6cd23-f4cd-4b95-95b1-252ec9c5cafa\") " Mar 16 16:18:31 crc kubenswrapper[5120]: I0316 16:18:31.774406 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/76c6cd23-f4cd-4b95-95b1-252ec9c5cafa-scripts\") pod \"76c6cd23-f4cd-4b95-95b1-252ec9c5cafa\" (UID: \"76c6cd23-f4cd-4b95-95b1-252ec9c5cafa\") " Mar 16 16:18:31 crc kubenswrapper[5120]: I0316 16:18:31.774470 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/76c6cd23-f4cd-4b95-95b1-252ec9c5cafa-config-data\") pod \"76c6cd23-f4cd-4b95-95b1-252ec9c5cafa\" (UID: \"76c6cd23-f4cd-4b95-95b1-252ec9c5cafa\") " Mar 16 16:18:31 crc kubenswrapper[5120]: I0316 16:18:31.774823 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76c6cd23-f4cd-4b95-95b1-252ec9c5cafa-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "76c6cd23-f4cd-4b95-95b1-252ec9c5cafa" (UID: "76c6cd23-f4cd-4b95-95b1-252ec9c5cafa"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:18:31 crc kubenswrapper[5120]: I0316 16:18:31.775307 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/76c6cd23-f4cd-4b95-95b1-252ec9c5cafa-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:31 crc kubenswrapper[5120]: I0316 16:18:31.776280 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76c6cd23-f4cd-4b95-95b1-252ec9c5cafa-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "76c6cd23-f4cd-4b95-95b1-252ec9c5cafa" (UID: "76c6cd23-f4cd-4b95-95b1-252ec9c5cafa"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:18:31 crc kubenswrapper[5120]: I0316 16:18:31.778067 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76c6cd23-f4cd-4b95-95b1-252ec9c5cafa-kube-api-access-xsdzm" (OuterVolumeSpecName: "kube-api-access-xsdzm") pod "76c6cd23-f4cd-4b95-95b1-252ec9c5cafa" (UID: "76c6cd23-f4cd-4b95-95b1-252ec9c5cafa"). InnerVolumeSpecName "kube-api-access-xsdzm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:18:31 crc kubenswrapper[5120]: I0316 16:18:31.778258 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/76c6cd23-f4cd-4b95-95b1-252ec9c5cafa-scripts" (OuterVolumeSpecName: "scripts") pod "76c6cd23-f4cd-4b95-95b1-252ec9c5cafa" (UID: "76c6cd23-f4cd-4b95-95b1-252ec9c5cafa"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:18:31 crc kubenswrapper[5120]: I0316 16:18:31.792499 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/76c6cd23-f4cd-4b95-95b1-252ec9c5cafa-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "76c6cd23-f4cd-4b95-95b1-252ec9c5cafa" (UID: "76c6cd23-f4cd-4b95-95b1-252ec9c5cafa"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:18:31 crc kubenswrapper[5120]: I0316 16:18:31.805676 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/76c6cd23-f4cd-4b95-95b1-252ec9c5cafa-ceilometer-tls-certs" (OuterVolumeSpecName: "ceilometer-tls-certs") pod "76c6cd23-f4cd-4b95-95b1-252ec9c5cafa" (UID: "76c6cd23-f4cd-4b95-95b1-252ec9c5cafa"). InnerVolumeSpecName "ceilometer-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:18:31 crc kubenswrapper[5120]: I0316 16:18:31.836824 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/76c6cd23-f4cd-4b95-95b1-252ec9c5cafa-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "76c6cd23-f4cd-4b95-95b1-252ec9c5cafa" (UID: "76c6cd23-f4cd-4b95-95b1-252ec9c5cafa"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:18:31 crc kubenswrapper[5120]: I0316 16:18:31.845096 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/76c6cd23-f4cd-4b95-95b1-252ec9c5cafa-config-data" (OuterVolumeSpecName: "config-data") pod "76c6cd23-f4cd-4b95-95b1-252ec9c5cafa" (UID: "76c6cd23-f4cd-4b95-95b1-252ec9c5cafa"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:18:31 crc kubenswrapper[5120]: I0316 16:18:31.876346 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/76c6cd23-f4cd-4b95-95b1-252ec9c5cafa-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:31 crc kubenswrapper[5120]: I0316 16:18:31.876381 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xsdzm\" (UniqueName: \"kubernetes.io/projected/76c6cd23-f4cd-4b95-95b1-252ec9c5cafa-kube-api-access-xsdzm\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:31 crc kubenswrapper[5120]: I0316 16:18:31.876392 5120 reconciler_common.go:299] "Volume detached for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/76c6cd23-f4cd-4b95-95b1-252ec9c5cafa-ceilometer-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:31 crc kubenswrapper[5120]: I0316 16:18:31.876400 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/76c6cd23-f4cd-4b95-95b1-252ec9c5cafa-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:31 crc kubenswrapper[5120]: I0316 16:18:31.876409 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/76c6cd23-f4cd-4b95-95b1-252ec9c5cafa-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:31 crc kubenswrapper[5120]: I0316 16:18:31.876417 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/76c6cd23-f4cd-4b95-95b1-252ec9c5cafa-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:31 crc kubenswrapper[5120]: I0316 16:18:31.876427 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/76c6cd23-f4cd-4b95-95b1-252ec9c5cafa-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:18:31 crc kubenswrapper[5120]: I0316 16:18:31.986115 5120 generic.go:358] "Generic (PLEG): container finished" podID="711e7cd2-a028-4c76-969e-e08558a5d732" containerID="6c6a76b2480d11bbcbe9da4f0bbb77ee9e7dcffe33abc117e4fd2108ee958a64" exitCode=137 Mar 16 16:18:31 crc kubenswrapper[5120]: I0316 16:18:31.986175 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"711e7cd2-a028-4c76-969e-e08558a5d732","Type":"ContainerDied","Data":"6c6a76b2480d11bbcbe9da4f0bbb77ee9e7dcffe33abc117e4fd2108ee958a64"} Mar 16 16:18:31 crc kubenswrapper[5120]: I0316 16:18:31.986252 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"711e7cd2-a028-4c76-969e-e08558a5d732","Type":"ContainerDied","Data":"6c2d6ed8f340a4e3c048b0de0cc28a7730dd5b0d5151829210190716447f7150"} Mar 16 16:18:31 crc kubenswrapper[5120]: I0316 16:18:31.986281 5120 scope.go:117] "RemoveContainer" containerID="6c6a76b2480d11bbcbe9da4f0bbb77ee9e7dcffe33abc117e4fd2108ee958a64" Mar 16 16:18:31 crc kubenswrapper[5120]: I0316 16:18:31.986579 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:18:31 crc kubenswrapper[5120]: I0316 16:18:31.989614 5120 generic.go:358] "Generic (PLEG): container finished" podID="e73bdb2c-01bf-4eca-93df-22b051fee769" containerID="e97ac48130213536a9b9b0d15722b762acfe6f81aabde1c8b9c64553d53ec8c7" exitCode=137 Mar 16 16:18:31 crc kubenswrapper[5120]: I0316 16:18:31.989700 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"e73bdb2c-01bf-4eca-93df-22b051fee769","Type":"ContainerDied","Data":"e97ac48130213536a9b9b0d15722b762acfe6f81aabde1c8b9c64553d53ec8c7"} Mar 16 16:18:31 crc kubenswrapper[5120]: I0316 16:18:31.989732 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"e73bdb2c-01bf-4eca-93df-22b051fee769","Type":"ContainerDied","Data":"66ac18240efe86f829036e029419a154036d8d6828a2309a747afc4acbe8ab78"} Mar 16 16:18:31 crc kubenswrapper[5120]: I0316 16:18:31.989931 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:18:31 crc kubenswrapper[5120]: I0316 16:18:31.993093 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:18:31 crc kubenswrapper[5120]: I0316 16:18:31.993120 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"3f5ad605-f6ee-47e9-a2b6-43e60f01c4c9","Type":"ContainerDied","Data":"bf4bd6e360e94442837b5a30e427d7e2ec3b6ee57583492341a02bc65361a415"} Mar 16 16:18:32 crc kubenswrapper[5120]: I0316 16:18:32.003118 5120 generic.go:358] "Generic (PLEG): container finished" podID="76c6cd23-f4cd-4b95-95b1-252ec9c5cafa" containerID="35e4423fcf67ea82bfe0fc8b41693767ef5d5424b86c9ca38dce930212eed434" exitCode=137 Mar 16 16:18:32 crc kubenswrapper[5120]: I0316 16:18:32.003201 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"76c6cd23-f4cd-4b95-95b1-252ec9c5cafa","Type":"ContainerDied","Data":"35e4423fcf67ea82bfe0fc8b41693767ef5d5424b86c9ca38dce930212eed434"} Mar 16 16:18:32 crc kubenswrapper[5120]: I0316 16:18:32.003234 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"76c6cd23-f4cd-4b95-95b1-252ec9c5cafa","Type":"ContainerDied","Data":"8c8cce4feccff9c9131a8d68f2a8097cd4c069acb839f2f62445ca2dd739cc68"} Mar 16 16:18:32 crc kubenswrapper[5120]: I0316 16:18:32.003341 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:18:32 crc kubenswrapper[5120]: I0316 16:18:32.016251 5120 scope.go:117] "RemoveContainer" containerID="6c6a76b2480d11bbcbe9da4f0bbb77ee9e7dcffe33abc117e4fd2108ee958a64" Mar 16 16:18:32 crc kubenswrapper[5120]: E0316 16:18:32.019147 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c6a76b2480d11bbcbe9da4f0bbb77ee9e7dcffe33abc117e4fd2108ee958a64\": container with ID starting with 6c6a76b2480d11bbcbe9da4f0bbb77ee9e7dcffe33abc117e4fd2108ee958a64 not found: ID does not exist" containerID="6c6a76b2480d11bbcbe9da4f0bbb77ee9e7dcffe33abc117e4fd2108ee958a64" Mar 16 16:18:32 crc kubenswrapper[5120]: I0316 16:18:32.019190 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c6a76b2480d11bbcbe9da4f0bbb77ee9e7dcffe33abc117e4fd2108ee958a64"} err="failed to get container status \"6c6a76b2480d11bbcbe9da4f0bbb77ee9e7dcffe33abc117e4fd2108ee958a64\": rpc error: code = NotFound desc = could not find container \"6c6a76b2480d11bbcbe9da4f0bbb77ee9e7dcffe33abc117e4fd2108ee958a64\": container with ID starting with 6c6a76b2480d11bbcbe9da4f0bbb77ee9e7dcffe33abc117e4fd2108ee958a64 not found: ID does not exist" Mar 16 16:18:32 crc kubenswrapper[5120]: I0316 16:18:32.019216 5120 scope.go:117] "RemoveContainer" containerID="e97ac48130213536a9b9b0d15722b762acfe6f81aabde1c8b9c64553d53ec8c7" Mar 16 16:18:32 crc kubenswrapper[5120]: I0316 16:18:32.045061 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 16:18:32 crc kubenswrapper[5120]: I0316 16:18:32.052815 5120 scope.go:117] "RemoveContainer" containerID="e97ac48130213536a9b9b0d15722b762acfe6f81aabde1c8b9c64553d53ec8c7" Mar 16 16:18:32 crc kubenswrapper[5120]: E0316 16:18:32.053222 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e97ac48130213536a9b9b0d15722b762acfe6f81aabde1c8b9c64553d53ec8c7\": container with ID starting with e97ac48130213536a9b9b0d15722b762acfe6f81aabde1c8b9c64553d53ec8c7 not found: ID does not exist" containerID="e97ac48130213536a9b9b0d15722b762acfe6f81aabde1c8b9c64553d53ec8c7" Mar 16 16:18:32 crc kubenswrapper[5120]: I0316 16:18:32.053274 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e97ac48130213536a9b9b0d15722b762acfe6f81aabde1c8b9c64553d53ec8c7"} err="failed to get container status \"e97ac48130213536a9b9b0d15722b762acfe6f81aabde1c8b9c64553d53ec8c7\": rpc error: code = NotFound desc = could not find container \"e97ac48130213536a9b9b0d15722b762acfe6f81aabde1c8b9c64553d53ec8c7\": container with ID starting with e97ac48130213536a9b9b0d15722b762acfe6f81aabde1c8b9c64553d53ec8c7 not found: ID does not exist" Mar 16 16:18:32 crc kubenswrapper[5120]: I0316 16:18:32.053305 5120 scope.go:117] "RemoveContainer" containerID="a1f5e797b52c263768103f57dc958a68929e1eaed737a81298570c479cbfd478" Mar 16 16:18:32 crc kubenswrapper[5120]: I0316 16:18:32.054749 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 16:18:32 crc kubenswrapper[5120]: I0316 16:18:32.060523 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:18:32 crc kubenswrapper[5120]: I0316 16:18:32.076751 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:18:32 crc kubenswrapper[5120]: I0316 16:18:32.082486 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:18:32 crc kubenswrapper[5120]: I0316 16:18:32.087942 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:18:32 crc kubenswrapper[5120]: I0316 16:18:32.092902 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:18:32 crc kubenswrapper[5120]: I0316 16:18:32.097708 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:18:32 crc kubenswrapper[5120]: I0316 16:18:32.165902 5120 scope.go:117] "RemoveContainer" containerID="40002f2be6fa424b030589769c3c029dfacfcdae45b3980ed054abb3abc3c1d9" Mar 16 16:18:32 crc kubenswrapper[5120]: I0316 16:18:32.189342 5120 scope.go:117] "RemoveContainer" containerID="cf198603b58bf7b45d7c9f7f1ce555f5fcb8f5b47b0707c2960e22415f81c96e" Mar 16 16:18:32 crc kubenswrapper[5120]: I0316 16:18:32.208562 5120 scope.go:117] "RemoveContainer" containerID="35e4423fcf67ea82bfe0fc8b41693767ef5d5424b86c9ca38dce930212eed434" Mar 16 16:18:32 crc kubenswrapper[5120]: I0316 16:18:32.235813 5120 scope.go:117] "RemoveContainer" containerID="af5fb6c449290fd20f488014a20a2e812dbe3b44b9e9e143413c9ee4a9424499" Mar 16 16:18:32 crc kubenswrapper[5120]: I0316 16:18:32.274074 5120 scope.go:117] "RemoveContainer" containerID="40002f2be6fa424b030589769c3c029dfacfcdae45b3980ed054abb3abc3c1d9" Mar 16 16:18:32 crc kubenswrapper[5120]: E0316 16:18:32.274493 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"40002f2be6fa424b030589769c3c029dfacfcdae45b3980ed054abb3abc3c1d9\": container with ID starting with 40002f2be6fa424b030589769c3c029dfacfcdae45b3980ed054abb3abc3c1d9 not found: ID does not exist" containerID="40002f2be6fa424b030589769c3c029dfacfcdae45b3980ed054abb3abc3c1d9" Mar 16 16:18:32 crc kubenswrapper[5120]: I0316 16:18:32.274525 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40002f2be6fa424b030589769c3c029dfacfcdae45b3980ed054abb3abc3c1d9"} err="failed to get container status \"40002f2be6fa424b030589769c3c029dfacfcdae45b3980ed054abb3abc3c1d9\": rpc error: code = NotFound desc = could not find container \"40002f2be6fa424b030589769c3c029dfacfcdae45b3980ed054abb3abc3c1d9\": container with ID starting with 40002f2be6fa424b030589769c3c029dfacfcdae45b3980ed054abb3abc3c1d9 not found: ID does not exist" Mar 16 16:18:32 crc kubenswrapper[5120]: I0316 16:18:32.274546 5120 scope.go:117] "RemoveContainer" containerID="cf198603b58bf7b45d7c9f7f1ce555f5fcb8f5b47b0707c2960e22415f81c96e" Mar 16 16:18:32 crc kubenswrapper[5120]: E0316 16:18:32.275063 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cf198603b58bf7b45d7c9f7f1ce555f5fcb8f5b47b0707c2960e22415f81c96e\": container with ID starting with cf198603b58bf7b45d7c9f7f1ce555f5fcb8f5b47b0707c2960e22415f81c96e not found: ID does not exist" containerID="cf198603b58bf7b45d7c9f7f1ce555f5fcb8f5b47b0707c2960e22415f81c96e" Mar 16 16:18:32 crc kubenswrapper[5120]: I0316 16:18:32.275085 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf198603b58bf7b45d7c9f7f1ce555f5fcb8f5b47b0707c2960e22415f81c96e"} err="failed to get container status \"cf198603b58bf7b45d7c9f7f1ce555f5fcb8f5b47b0707c2960e22415f81c96e\": rpc error: code = NotFound desc = could not find container \"cf198603b58bf7b45d7c9f7f1ce555f5fcb8f5b47b0707c2960e22415f81c96e\": container with ID starting with cf198603b58bf7b45d7c9f7f1ce555f5fcb8f5b47b0707c2960e22415f81c96e not found: ID does not exist" Mar 16 16:18:32 crc kubenswrapper[5120]: I0316 16:18:32.275097 5120 scope.go:117] "RemoveContainer" containerID="35e4423fcf67ea82bfe0fc8b41693767ef5d5424b86c9ca38dce930212eed434" Mar 16 16:18:32 crc kubenswrapper[5120]: E0316 16:18:32.275572 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"35e4423fcf67ea82bfe0fc8b41693767ef5d5424b86c9ca38dce930212eed434\": container with ID starting with 35e4423fcf67ea82bfe0fc8b41693767ef5d5424b86c9ca38dce930212eed434 not found: ID does not exist" containerID="35e4423fcf67ea82bfe0fc8b41693767ef5d5424b86c9ca38dce930212eed434" Mar 16 16:18:32 crc kubenswrapper[5120]: I0316 16:18:32.275634 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35e4423fcf67ea82bfe0fc8b41693767ef5d5424b86c9ca38dce930212eed434"} err="failed to get container status \"35e4423fcf67ea82bfe0fc8b41693767ef5d5424b86c9ca38dce930212eed434\": rpc error: code = NotFound desc = could not find container \"35e4423fcf67ea82bfe0fc8b41693767ef5d5424b86c9ca38dce930212eed434\": container with ID starting with 35e4423fcf67ea82bfe0fc8b41693767ef5d5424b86c9ca38dce930212eed434 not found: ID does not exist" Mar 16 16:18:32 crc kubenswrapper[5120]: I0316 16:18:32.275672 5120 scope.go:117] "RemoveContainer" containerID="af5fb6c449290fd20f488014a20a2e812dbe3b44b9e9e143413c9ee4a9424499" Mar 16 16:18:32 crc kubenswrapper[5120]: E0316 16:18:32.276466 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af5fb6c449290fd20f488014a20a2e812dbe3b44b9e9e143413c9ee4a9424499\": container with ID starting with af5fb6c449290fd20f488014a20a2e812dbe3b44b9e9e143413c9ee4a9424499 not found: ID does not exist" containerID="af5fb6c449290fd20f488014a20a2e812dbe3b44b9e9e143413c9ee4a9424499" Mar 16 16:18:32 crc kubenswrapper[5120]: I0316 16:18:32.276508 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af5fb6c449290fd20f488014a20a2e812dbe3b44b9e9e143413c9ee4a9424499"} err="failed to get container status \"af5fb6c449290fd20f488014a20a2e812dbe3b44b9e9e143413c9ee4a9424499\": rpc error: code = NotFound desc = could not find container \"af5fb6c449290fd20f488014a20a2e812dbe3b44b9e9e143413c9ee4a9424499\": container with ID starting with af5fb6c449290fd20f488014a20a2e812dbe3b44b9e9e143413c9ee4a9424499 not found: ID does not exist" Mar 16 16:18:32 crc kubenswrapper[5120]: I0316 16:18:32.674509 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="101749dc-c834-4d18-9d65-704af8b368a4" path="/var/lib/kubelet/pods/101749dc-c834-4d18-9d65-704af8b368a4/volumes" Mar 16 16:18:32 crc kubenswrapper[5120]: I0316 16:18:32.678742 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1c354659-a22a-4fa3-8747-75b7241aea49" path="/var/lib/kubelet/pods/1c354659-a22a-4fa3-8747-75b7241aea49/volumes" Mar 16 16:18:32 crc kubenswrapper[5120]: I0316 16:18:32.680094 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3f5ad605-f6ee-47e9-a2b6-43e60f01c4c9" path="/var/lib/kubelet/pods/3f5ad605-f6ee-47e9-a2b6-43e60f01c4c9/volumes" Mar 16 16:18:32 crc kubenswrapper[5120]: I0316 16:18:32.681076 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="711e7cd2-a028-4c76-969e-e08558a5d732" path="/var/lib/kubelet/pods/711e7cd2-a028-4c76-969e-e08558a5d732/volumes" Mar 16 16:18:32 crc kubenswrapper[5120]: I0316 16:18:32.683148 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="76c6cd23-f4cd-4b95-95b1-252ec9c5cafa" path="/var/lib/kubelet/pods/76c6cd23-f4cd-4b95-95b1-252ec9c5cafa/volumes" Mar 16 16:18:32 crc kubenswrapper[5120]: I0316 16:18:32.684522 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e73bdb2c-01bf-4eca-93df-22b051fee769" path="/var/lib/kubelet/pods/e73bdb2c-01bf-4eca-93df-22b051fee769/volumes" Mar 16 16:19:03 crc kubenswrapper[5120]: E0316 16:19:03.768558 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-config-data: configmap "rabbitmq-config-data" not found Mar 16 16:19:03 crc kubenswrapper[5120]: E0316 16:19:03.770074 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/51d5f0da-bcbc-492e-ab39-6189dc22fa22-config-data podName:51d5f0da-bcbc-492e-ab39-6189dc22fa22 nodeName:}" failed. No retries permitted until 2026-03-16 16:20:07.770026912 +0000 UTC m=+2909.923958609 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/51d5f0da-bcbc-492e-ab39-6189dc22fa22-config-data") pod "rabbitmq-server-0" (UID: "51d5f0da-bcbc-492e-ab39-6189dc22fa22") : configmap "rabbitmq-config-data" not found Mar 16 16:19:04 crc kubenswrapper[5120]: E0316 16:19:04.422675 5120 handlers.go:80] "Exec lifecycle hook for Container in Pod failed" err=< Mar 16 16:19:04 crc kubenswrapper[5120]: command '/bin/bash -c if [ ! -z "$(cat /etc/pod-info/skipPreStopChecks)" ]; then exit 0; fi; rabbitmq-upgrade await_online_quorum_plus_one -t 604800 && rabbitmq-upgrade await_online_synchronized_mirror -t 604800 || true && rabbitmq-upgrade drain -t 604800' exited with 69: Error: unable to perform an operation on node 'rabbit@rabbitmq-server-0.rabbitmq-nodes.openstack-kuttl-tests'. Please see diagnostics information and suggestions below. Mar 16 16:19:04 crc kubenswrapper[5120]: Mar 16 16:19:04 crc kubenswrapper[5120]: Most common reasons for this are: Mar 16 16:19:04 crc kubenswrapper[5120]: Mar 16 16:19:04 crc kubenswrapper[5120]: * Target node is unreachable (e.g. due to hostname resolution, TCP connection or firewall issues) Mar 16 16:19:04 crc kubenswrapper[5120]: * CLI tool fails to authenticate with the server (e.g. due to CLI tool's Erlang cookie not matching that of the server) Mar 16 16:19:04 crc kubenswrapper[5120]: * Target node is not running Mar 16 16:19:04 crc kubenswrapper[5120]: Mar 16 16:19:04 crc kubenswrapper[5120]: In addition to the diagnostics info below: Mar 16 16:19:04 crc kubenswrapper[5120]: Mar 16 16:19:04 crc kubenswrapper[5120]: * See the CLI, clustering and networking guides on https://rabbitmq.com/documentation.html to learn more Mar 16 16:19:04 crc kubenswrapper[5120]: * Consult server logs on node rabbit@rabbitmq-server-0.rabbitmq-nodes.openstack-kuttl-tests Mar 16 16:19:04 crc kubenswrapper[5120]: * If target node is configured to use long node names, don't forget to use --longnames with CLI tools Mar 16 16:19:04 crc kubenswrapper[5120]: Mar 16 16:19:04 crc kubenswrapper[5120]: DIAGNOSTICS Mar 16 16:19:04 crc kubenswrapper[5120]: =========== Mar 16 16:19:04 crc kubenswrapper[5120]: Mar 16 16:19:04 crc kubenswrapper[5120]: attempted to contact: ['rabbit@rabbitmq-server-0.rabbitmq-nodes.openstack-kuttl-tests'] Mar 16 16:19:04 crc kubenswrapper[5120]: Mar 16 16:19:04 crc kubenswrapper[5120]: rabbit@rabbitmq-server-0.rabbitmq-nodes.openstack-kuttl-tests: Mar 16 16:19:04 crc kubenswrapper[5120]: * unable to connect to epmd (port 4369) on rabbitmq-server-0.rabbitmq-nodes.openstack-kuttl-tests: nxdomain (non-existing domain) Mar 16 16:19:04 crc kubenswrapper[5120]: Mar 16 16:19:04 crc kubenswrapper[5120]: Mar 16 16:19:04 crc kubenswrapper[5120]: Current node details: Mar 16 16:19:04 crc kubenswrapper[5120]: * node name: 'rabbitmqcli-866-rabbit@rabbitmq-server-0.rabbitmq-nodes.openstack-kuttl-tests' Mar 16 16:19:04 crc kubenswrapper[5120]: * effective user's home directory: /var/lib/rabbitmq Mar 16 16:19:04 crc kubenswrapper[5120]: * Erlang cookie hash: BpNYU0BL9KGH+D4ug4RGjw== Mar 16 16:19:04 crc kubenswrapper[5120]: Mar 16 16:19:04 crc kubenswrapper[5120]: Error: unable to perform an operation on node 'rabbit@rabbitmq-server-0.rabbitmq-nodes.openstack-kuttl-tests'. Please see diagnostics information and suggestions below. Mar 16 16:19:04 crc kubenswrapper[5120]: Mar 16 16:19:04 crc kubenswrapper[5120]: Most common reasons for this are: Mar 16 16:19:04 crc kubenswrapper[5120]: Mar 16 16:19:04 crc kubenswrapper[5120]: * Target node is unreachable (e.g. due to hostname resolution, TCP connection or firewall issues) Mar 16 16:19:04 crc kubenswrapper[5120]: * CLI tool fails to authenticate with the server (e.g. due to CLI tool's Erlang cookie not matching that of the server) Mar 16 16:19:04 crc kubenswrapper[5120]: * Target node is not running Mar 16 16:19:04 crc kubenswrapper[5120]: Mar 16 16:19:04 crc kubenswrapper[5120]: In addition to the diagnostics info below: Mar 16 16:19:04 crc kubenswrapper[5120]: Mar 16 16:19:04 crc kubenswrapper[5120]: * See the CLI, clustering and networking guides on https://rabbitmq.com/documentation.html to learn more Mar 16 16:19:04 crc kubenswrapper[5120]: * Consult server logs on node rabbit@rabbitmq-server-0.rabbitmq-nodes.openstack-kuttl-tests Mar 16 16:19:04 crc kubenswrapper[5120]: * If target node is configured to use long node names, don't forget to use --longnames with CLI tools Mar 16 16:19:04 crc kubenswrapper[5120]: Mar 16 16:19:04 crc kubenswrapper[5120]: DIAGNOSTICS Mar 16 16:19:04 crc kubenswrapper[5120]: =========== Mar 16 16:19:04 crc kubenswrapper[5120]: Mar 16 16:19:04 crc kubenswrapper[5120]: attempted to contact: ['rabbit@rabbitmq-server-0.rabbitmq-nodes.openstack-kuttl-tests'] Mar 16 16:19:04 crc kubenswrapper[5120]: Mar 16 16:19:04 crc kubenswrapper[5120]: rabbit@rabbitmq-server-0.rabbitmq-nodes.openstack-kuttl-tests: Mar 16 16:19:04 crc kubenswrapper[5120]: * unable to connect to epmd (port 4369) on rabbitmq-server-0.rabbitmq-nodes.openstack-kuttl-tests: nxdomain (non-existing domain) Mar 16 16:19:04 crc kubenswrapper[5120]: Mar 16 16:19:04 crc kubenswrapper[5120]: Mar 16 16:19:04 crc kubenswrapper[5120]: Current node details: Mar 16 16:19:04 crc kubenswrapper[5120]: * node name: 'rabbitmqcli-536-rabbit@rabbitmq-server-0.rabbitmq-nodes.openstack-kuttl-tests' Mar 16 16:19:04 crc kubenswrapper[5120]: * effective user's home directory: /var/lib/rabbitmq Mar 16 16:19:04 crc kubenswrapper[5120]: * Erlang cookie hash: BpNYU0BL9KGH+D4ug4RGjw== Mar 16 16:19:04 crc kubenswrapper[5120]: Mar 16 16:19:04 crc kubenswrapper[5120]: > execCommand=["/bin/bash","-c","if [ ! -z \"$(cat /etc/pod-info/skipPreStopChecks)\" ]; then exit 0; fi; rabbitmq-upgrade await_online_quorum_plus_one -t 604800 \u0026\u0026 rabbitmq-upgrade await_online_synchronized_mirror -t 604800 || true \u0026\u0026 rabbitmq-upgrade drain -t 604800"] containerName="rabbitmq" pod="openstack-kuttl-tests/rabbitmq-server-0" message=< Mar 16 16:19:04 crc kubenswrapper[5120]: Will put node rabbit@rabbitmq-server-0.rabbitmq-nodes.openstack-kuttl-tests into maintenance mode. The node will no longer serve any client traffic! Mar 16 16:19:04 crc kubenswrapper[5120]: Error: unable to perform an operation on node 'rabbit@rabbitmq-server-0.rabbitmq-nodes.openstack-kuttl-tests'. Please see diagnostics information and suggestions below. Mar 16 16:19:04 crc kubenswrapper[5120]: Mar 16 16:19:04 crc kubenswrapper[5120]: Most common reasons for this are: Mar 16 16:19:04 crc kubenswrapper[5120]: Mar 16 16:19:04 crc kubenswrapper[5120]: * Target node is unreachable (e.g. due to hostname resolution, TCP connection or firewall issues) Mar 16 16:19:04 crc kubenswrapper[5120]: * CLI tool fails to authenticate with the server (e.g. due to CLI tool's Erlang cookie not matching that of the server) Mar 16 16:19:04 crc kubenswrapper[5120]: * Target node is not running Mar 16 16:19:04 crc kubenswrapper[5120]: Mar 16 16:19:04 crc kubenswrapper[5120]: In addition to the diagnostics info below: Mar 16 16:19:04 crc kubenswrapper[5120]: Mar 16 16:19:04 crc kubenswrapper[5120]: * See the CLI, clustering and networking guides on https://rabbitmq.com/documentation.html to learn more Mar 16 16:19:04 crc kubenswrapper[5120]: * Consult server logs on node rabbit@rabbitmq-server-0.rabbitmq-nodes.openstack-kuttl-tests Mar 16 16:19:04 crc kubenswrapper[5120]: * If target node is configured to use long node names, don't forget to use --longnames with CLI tools Mar 16 16:19:04 crc kubenswrapper[5120]: Mar 16 16:19:04 crc kubenswrapper[5120]: DIAGNOSTICS Mar 16 16:19:04 crc kubenswrapper[5120]: =========== Mar 16 16:19:04 crc kubenswrapper[5120]: Mar 16 16:19:04 crc kubenswrapper[5120]: attempted to contact: ['rabbit@rabbitmq-server-0.rabbitmq-nodes.openstack-kuttl-tests'] Mar 16 16:19:04 crc kubenswrapper[5120]: Mar 16 16:19:04 crc kubenswrapper[5120]: rabbit@rabbitmq-server-0.rabbitmq-nodes.openstack-kuttl-tests: Mar 16 16:19:04 crc kubenswrapper[5120]: * unable to connect to epmd (port 4369) on rabbitmq-server-0.rabbitmq-nodes.openstack-kuttl-tests: nxdomain (non-existing domain) Mar 16 16:19:04 crc kubenswrapper[5120]: Mar 16 16:19:04 crc kubenswrapper[5120]: Mar 16 16:19:04 crc kubenswrapper[5120]: Current node details: Mar 16 16:19:04 crc kubenswrapper[5120]: * node name: 'rabbitmqcli-866-rabbit@rabbitmq-server-0.rabbitmq-nodes.openstack-kuttl-tests' Mar 16 16:19:04 crc kubenswrapper[5120]: * effective user's home directory: /var/lib/rabbitmq Mar 16 16:19:04 crc kubenswrapper[5120]: * Erlang cookie hash: BpNYU0BL9KGH+D4ug4RGjw== Mar 16 16:19:04 crc kubenswrapper[5120]: Mar 16 16:19:04 crc kubenswrapper[5120]: Error: unable to perform an operation on node 'rabbit@rabbitmq-server-0.rabbitmq-nodes.openstack-kuttl-tests'. Please see diagnostics information and suggestions below. Mar 16 16:19:04 crc kubenswrapper[5120]: Mar 16 16:19:04 crc kubenswrapper[5120]: Most common reasons for this are: Mar 16 16:19:04 crc kubenswrapper[5120]: Mar 16 16:19:04 crc kubenswrapper[5120]: * Target node is unreachable (e.g. due to hostname resolution, TCP connection or firewall issues) Mar 16 16:19:04 crc kubenswrapper[5120]: * CLI tool fails to authenticate with the server (e.g. due to CLI tool's Erlang cookie not matching that of the server) Mar 16 16:19:04 crc kubenswrapper[5120]: * Target node is not running Mar 16 16:19:04 crc kubenswrapper[5120]: Mar 16 16:19:04 crc kubenswrapper[5120]: In addition to the diagnostics info below: Mar 16 16:19:04 crc kubenswrapper[5120]: Mar 16 16:19:04 crc kubenswrapper[5120]: * See the CLI, clustering and networking guides on https://rabbitmq.com/documentation.html to learn more Mar 16 16:19:04 crc kubenswrapper[5120]: * Consult server logs on node rabbit@rabbitmq-server-0.rabbitmq-nodes.openstack-kuttl-tests Mar 16 16:19:04 crc kubenswrapper[5120]: * If target node is configured to use long node names, don't forget to use --longnames with CLI tools Mar 16 16:19:04 crc kubenswrapper[5120]: Mar 16 16:19:04 crc kubenswrapper[5120]: DIAGNOSTICS Mar 16 16:19:04 crc kubenswrapper[5120]: =========== Mar 16 16:19:04 crc kubenswrapper[5120]: Mar 16 16:19:04 crc kubenswrapper[5120]: attempted to contact: ['rabbit@rabbitmq-server-0.rabbitmq-nodes.openstack-kuttl-tests'] Mar 16 16:19:04 crc kubenswrapper[5120]: Mar 16 16:19:04 crc kubenswrapper[5120]: rabbit@rabbitmq-server-0.rabbitmq-nodes.openstack-kuttl-tests: Mar 16 16:19:04 crc kubenswrapper[5120]: * unable to connect to epmd (port 4369) on rabbitmq-server-0.rabbitmq-nodes.openstack-kuttl-tests: nxdomain (non-existing domain) Mar 16 16:19:04 crc kubenswrapper[5120]: Mar 16 16:19:04 crc kubenswrapper[5120]: Mar 16 16:19:04 crc kubenswrapper[5120]: Current node details: Mar 16 16:19:04 crc kubenswrapper[5120]: * node name: 'rabbitmqcli-536-rabbit@rabbitmq-server-0.rabbitmq-nodes.openstack-kuttl-tests' Mar 16 16:19:04 crc kubenswrapper[5120]: * effective user's home directory: /var/lib/rabbitmq Mar 16 16:19:04 crc kubenswrapper[5120]: * Erlang cookie hash: BpNYU0BL9KGH+D4ug4RGjw== Mar 16 16:19:04 crc kubenswrapper[5120]: Mar 16 16:19:04 crc kubenswrapper[5120]: > Mar 16 16:19:04 crc kubenswrapper[5120]: E0316 16:19:04.422814 5120 kuberuntime_container.go:741] "PreStop hook failed" err=< Mar 16 16:19:04 crc kubenswrapper[5120]: command '/bin/bash -c if [ ! -z "$(cat /etc/pod-info/skipPreStopChecks)" ]; then exit 0; fi; rabbitmq-upgrade await_online_quorum_plus_one -t 604800 && rabbitmq-upgrade await_online_synchronized_mirror -t 604800 || true && rabbitmq-upgrade drain -t 604800' exited with 69: Error: unable to perform an operation on node 'rabbit@rabbitmq-server-0.rabbitmq-nodes.openstack-kuttl-tests'. Please see diagnostics information and suggestions below. Mar 16 16:19:04 crc kubenswrapper[5120]: Mar 16 16:19:04 crc kubenswrapper[5120]: Most common reasons for this are: Mar 16 16:19:04 crc kubenswrapper[5120]: Mar 16 16:19:04 crc kubenswrapper[5120]: * Target node is unreachable (e.g. due to hostname resolution, TCP connection or firewall issues) Mar 16 16:19:04 crc kubenswrapper[5120]: * CLI tool fails to authenticate with the server (e.g. due to CLI tool's Erlang cookie not matching that of the server) Mar 16 16:19:04 crc kubenswrapper[5120]: * Target node is not running Mar 16 16:19:04 crc kubenswrapper[5120]: Mar 16 16:19:04 crc kubenswrapper[5120]: In addition to the diagnostics info below: Mar 16 16:19:04 crc kubenswrapper[5120]: Mar 16 16:19:04 crc kubenswrapper[5120]: * See the CLI, clustering and networking guides on https://rabbitmq.com/documentation.html to learn more Mar 16 16:19:04 crc kubenswrapper[5120]: * Consult server logs on node rabbit@rabbitmq-server-0.rabbitmq-nodes.openstack-kuttl-tests Mar 16 16:19:04 crc kubenswrapper[5120]: * If target node is configured to use long node names, don't forget to use --longnames with CLI tools Mar 16 16:19:04 crc kubenswrapper[5120]: Mar 16 16:19:04 crc kubenswrapper[5120]: DIAGNOSTICS Mar 16 16:19:04 crc kubenswrapper[5120]: =========== Mar 16 16:19:04 crc kubenswrapper[5120]: Mar 16 16:19:04 crc kubenswrapper[5120]: attempted to contact: ['rabbit@rabbitmq-server-0.rabbitmq-nodes.openstack-kuttl-tests'] Mar 16 16:19:04 crc kubenswrapper[5120]: Mar 16 16:19:04 crc kubenswrapper[5120]: rabbit@rabbitmq-server-0.rabbitmq-nodes.openstack-kuttl-tests: Mar 16 16:19:04 crc kubenswrapper[5120]: * unable to connect to epmd (port 4369) on rabbitmq-server-0.rabbitmq-nodes.openstack-kuttl-tests: nxdomain (non-existing domain) Mar 16 16:19:04 crc kubenswrapper[5120]: Mar 16 16:19:04 crc kubenswrapper[5120]: Mar 16 16:19:04 crc kubenswrapper[5120]: Current node details: Mar 16 16:19:04 crc kubenswrapper[5120]: * node name: 'rabbitmqcli-866-rabbit@rabbitmq-server-0.rabbitmq-nodes.openstack-kuttl-tests' Mar 16 16:19:04 crc kubenswrapper[5120]: * effective user's home directory: /var/lib/rabbitmq Mar 16 16:19:04 crc kubenswrapper[5120]: * Erlang cookie hash: BpNYU0BL9KGH+D4ug4RGjw== Mar 16 16:19:04 crc kubenswrapper[5120]: Mar 16 16:19:04 crc kubenswrapper[5120]: Error: unable to perform an operation on node 'rabbit@rabbitmq-server-0.rabbitmq-nodes.openstack-kuttl-tests'. Please see diagnostics information and suggestions below. Mar 16 16:19:04 crc kubenswrapper[5120]: Mar 16 16:19:04 crc kubenswrapper[5120]: Most common reasons for this are: Mar 16 16:19:04 crc kubenswrapper[5120]: Mar 16 16:19:04 crc kubenswrapper[5120]: * Target node is unreachable (e.g. due to hostname resolution, TCP connection or firewall issues) Mar 16 16:19:04 crc kubenswrapper[5120]: * CLI tool fails to authenticate with the server (e.g. due to CLI tool's Erlang cookie not matching that of the server) Mar 16 16:19:04 crc kubenswrapper[5120]: * Target node is not running Mar 16 16:19:04 crc kubenswrapper[5120]: Mar 16 16:19:04 crc kubenswrapper[5120]: In addition to the diagnostics info below: Mar 16 16:19:04 crc kubenswrapper[5120]: Mar 16 16:19:04 crc kubenswrapper[5120]: * See the CLI, clustering and networking guides on https://rabbitmq.com/documentation.html to learn more Mar 16 16:19:04 crc kubenswrapper[5120]: * Consult server logs on node rabbit@rabbitmq-server-0.rabbitmq-nodes.openstack-kuttl-tests Mar 16 16:19:04 crc kubenswrapper[5120]: * If target node is configured to use long node names, don't forget to use --longnames with CLI tools Mar 16 16:19:04 crc kubenswrapper[5120]: Mar 16 16:19:04 crc kubenswrapper[5120]: DIAGNOSTICS Mar 16 16:19:04 crc kubenswrapper[5120]: =========== Mar 16 16:19:04 crc kubenswrapper[5120]: Mar 16 16:19:04 crc kubenswrapper[5120]: attempted to contact: ['rabbit@rabbitmq-server-0.rabbitmq-nodes.openstack-kuttl-tests'] Mar 16 16:19:04 crc kubenswrapper[5120]: Mar 16 16:19:04 crc kubenswrapper[5120]: rabbit@rabbitmq-server-0.rabbitmq-nodes.openstack-kuttl-tests: Mar 16 16:19:04 crc kubenswrapper[5120]: * unable to connect to epmd (port 4369) on rabbitmq-server-0.rabbitmq-nodes.openstack-kuttl-tests: nxdomain (non-existing domain) Mar 16 16:19:04 crc kubenswrapper[5120]: Mar 16 16:19:04 crc kubenswrapper[5120]: Mar 16 16:19:04 crc kubenswrapper[5120]: Current node details: Mar 16 16:19:04 crc kubenswrapper[5120]: * node name: 'rabbitmqcli-536-rabbit@rabbitmq-server-0.rabbitmq-nodes.openstack-kuttl-tests' Mar 16 16:19:04 crc kubenswrapper[5120]: * effective user's home directory: /var/lib/rabbitmq Mar 16 16:19:04 crc kubenswrapper[5120]: * Erlang cookie hash: BpNYU0BL9KGH+D4ug4RGjw== Mar 16 16:19:04 crc kubenswrapper[5120]: Mar 16 16:19:04 crc kubenswrapper[5120]: > pod="openstack-kuttl-tests/rabbitmq-server-0" podUID="51d5f0da-bcbc-492e-ab39-6189dc22fa22" containerName="rabbitmq" containerID="cri-o://612da3352edae9eff1f05f74b385ccf462bdc41a37210c6f1f1b0581e0b27fe9" Mar 16 16:19:04 crc kubenswrapper[5120]: I0316 16:19:04.422925 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/rabbitmq-server-0" podUID="51d5f0da-bcbc-492e-ab39-6189dc22fa22" containerName="rabbitmq" containerID="cri-o://612da3352edae9eff1f05f74b385ccf462bdc41a37210c6f1f1b0581e0b27fe9" gracePeriod=604738 Mar 16 16:19:07 crc kubenswrapper[5120]: E0316 16:19:07.790062 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1235313 actualBytes=10240 Mar 16 16:19:09 crc kubenswrapper[5120]: I0316 16:19:09.607749 5120 scope.go:117] "RemoveContainer" containerID="3dbb8b6b77f417ec85385c65e554cb7523158b245e4a90353843df1bfba0af65" Mar 16 16:19:10 crc kubenswrapper[5120]: I0316 16:19:10.968510 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:19:11 crc kubenswrapper[5120]: I0316 16:19:11.078281 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/51d5f0da-bcbc-492e-ab39-6189dc22fa22-config-data\") pod \"51d5f0da-bcbc-492e-ab39-6189dc22fa22\" (UID: \"51d5f0da-bcbc-492e-ab39-6189dc22fa22\") " Mar 16 16:19:11 crc kubenswrapper[5120]: I0316 16:19:11.078369 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/51d5f0da-bcbc-492e-ab39-6189dc22fa22-rabbitmq-confd\") pod \"51d5f0da-bcbc-492e-ab39-6189dc22fa22\" (UID: \"51d5f0da-bcbc-492e-ab39-6189dc22fa22\") " Mar 16 16:19:11 crc kubenswrapper[5120]: I0316 16:19:11.078410 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/51d5f0da-bcbc-492e-ab39-6189dc22fa22-pod-info\") pod \"51d5f0da-bcbc-492e-ab39-6189dc22fa22\" (UID: \"51d5f0da-bcbc-492e-ab39-6189dc22fa22\") " Mar 16 16:19:11 crc kubenswrapper[5120]: I0316 16:19:11.078459 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/51d5f0da-bcbc-492e-ab39-6189dc22fa22-rabbitmq-tls\") pod \"51d5f0da-bcbc-492e-ab39-6189dc22fa22\" (UID: \"51d5f0da-bcbc-492e-ab39-6189dc22fa22\") " Mar 16 16:19:11 crc kubenswrapper[5120]: I0316 16:19:11.078485 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/51d5f0da-bcbc-492e-ab39-6189dc22fa22-rabbitmq-plugins\") pod \"51d5f0da-bcbc-492e-ab39-6189dc22fa22\" (UID: \"51d5f0da-bcbc-492e-ab39-6189dc22fa22\") " Mar 16 16:19:11 crc kubenswrapper[5120]: I0316 16:19:11.078628 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nprdj\" (UniqueName: \"kubernetes.io/projected/51d5f0da-bcbc-492e-ab39-6189dc22fa22-kube-api-access-nprdj\") pod \"51d5f0da-bcbc-492e-ab39-6189dc22fa22\" (UID: \"51d5f0da-bcbc-492e-ab39-6189dc22fa22\") " Mar 16 16:19:11 crc kubenswrapper[5120]: I0316 16:19:11.079163 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51d5f0da-bcbc-492e-ab39-6189dc22fa22-rabbitmq-plugins" (OuterVolumeSpecName: "rabbitmq-plugins") pod "51d5f0da-bcbc-492e-ab39-6189dc22fa22" (UID: "51d5f0da-bcbc-492e-ab39-6189dc22fa22"). InnerVolumeSpecName "rabbitmq-plugins". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:19:11 crc kubenswrapper[5120]: I0316 16:19:11.079218 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"persistence\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"51d5f0da-bcbc-492e-ab39-6189dc22fa22\" (UID: \"51d5f0da-bcbc-492e-ab39-6189dc22fa22\") " Mar 16 16:19:11 crc kubenswrapper[5120]: I0316 16:19:11.079598 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/51d5f0da-bcbc-492e-ab39-6189dc22fa22-plugins-conf\") pod \"51d5f0da-bcbc-492e-ab39-6189dc22fa22\" (UID: \"51d5f0da-bcbc-492e-ab39-6189dc22fa22\") " Mar 16 16:19:11 crc kubenswrapper[5120]: I0316 16:19:11.079645 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/51d5f0da-bcbc-492e-ab39-6189dc22fa22-server-conf\") pod \"51d5f0da-bcbc-492e-ab39-6189dc22fa22\" (UID: \"51d5f0da-bcbc-492e-ab39-6189dc22fa22\") " Mar 16 16:19:11 crc kubenswrapper[5120]: I0316 16:19:11.079685 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/51d5f0da-bcbc-492e-ab39-6189dc22fa22-rabbitmq-erlang-cookie\") pod \"51d5f0da-bcbc-492e-ab39-6189dc22fa22\" (UID: \"51d5f0da-bcbc-492e-ab39-6189dc22fa22\") " Mar 16 16:19:11 crc kubenswrapper[5120]: I0316 16:19:11.079997 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/51d5f0da-bcbc-492e-ab39-6189dc22fa22-erlang-cookie-secret\") pod \"51d5f0da-bcbc-492e-ab39-6189dc22fa22\" (UID: \"51d5f0da-bcbc-492e-ab39-6189dc22fa22\") " Mar 16 16:19:11 crc kubenswrapper[5120]: I0316 16:19:11.080292 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/51d5f0da-bcbc-492e-ab39-6189dc22fa22-rabbitmq-plugins\") on node \"crc\" DevicePath \"\"" Mar 16 16:19:11 crc kubenswrapper[5120]: I0316 16:19:11.080283 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51d5f0da-bcbc-492e-ab39-6189dc22fa22-rabbitmq-erlang-cookie" (OuterVolumeSpecName: "rabbitmq-erlang-cookie") pod "51d5f0da-bcbc-492e-ab39-6189dc22fa22" (UID: "51d5f0da-bcbc-492e-ab39-6189dc22fa22"). InnerVolumeSpecName "rabbitmq-erlang-cookie". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:19:11 crc kubenswrapper[5120]: I0316 16:19:11.080470 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/51d5f0da-bcbc-492e-ab39-6189dc22fa22-plugins-conf" (OuterVolumeSpecName: "plugins-conf") pod "51d5f0da-bcbc-492e-ab39-6189dc22fa22" (UID: "51d5f0da-bcbc-492e-ab39-6189dc22fa22"). InnerVolumeSpecName "plugins-conf". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:19:11 crc kubenswrapper[5120]: I0316 16:19:11.084262 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/51d5f0da-bcbc-492e-ab39-6189dc22fa22-erlang-cookie-secret" (OuterVolumeSpecName: "erlang-cookie-secret") pod "51d5f0da-bcbc-492e-ab39-6189dc22fa22" (UID: "51d5f0da-bcbc-492e-ab39-6189dc22fa22"). InnerVolumeSpecName "erlang-cookie-secret". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:19:11 crc kubenswrapper[5120]: I0316 16:19:11.084595 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51d5f0da-bcbc-492e-ab39-6189dc22fa22-kube-api-access-nprdj" (OuterVolumeSpecName: "kube-api-access-nprdj") pod "51d5f0da-bcbc-492e-ab39-6189dc22fa22" (UID: "51d5f0da-bcbc-492e-ab39-6189dc22fa22"). InnerVolumeSpecName "kube-api-access-nprdj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:19:11 crc kubenswrapper[5120]: I0316 16:19:11.085478 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/51d5f0da-bcbc-492e-ab39-6189dc22fa22-pod-info" (OuterVolumeSpecName: "pod-info") pod "51d5f0da-bcbc-492e-ab39-6189dc22fa22" (UID: "51d5f0da-bcbc-492e-ab39-6189dc22fa22"). InnerVolumeSpecName "pod-info". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Mar 16 16:19:11 crc kubenswrapper[5120]: I0316 16:19:11.085737 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage12-crc" (OuterVolumeSpecName: "persistence") pod "51d5f0da-bcbc-492e-ab39-6189dc22fa22" (UID: "51d5f0da-bcbc-492e-ab39-6189dc22fa22"). InnerVolumeSpecName "local-storage12-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:19:11 crc kubenswrapper[5120]: I0316 16:19:11.088553 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51d5f0da-bcbc-492e-ab39-6189dc22fa22-rabbitmq-tls" (OuterVolumeSpecName: "rabbitmq-tls") pod "51d5f0da-bcbc-492e-ab39-6189dc22fa22" (UID: "51d5f0da-bcbc-492e-ab39-6189dc22fa22"). InnerVolumeSpecName "rabbitmq-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:19:11 crc kubenswrapper[5120]: I0316 16:19:11.100574 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/51d5f0da-bcbc-492e-ab39-6189dc22fa22-config-data" (OuterVolumeSpecName: "config-data") pod "51d5f0da-bcbc-492e-ab39-6189dc22fa22" (UID: "51d5f0da-bcbc-492e-ab39-6189dc22fa22"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:19:11 crc kubenswrapper[5120]: I0316 16:19:11.113741 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/51d5f0da-bcbc-492e-ab39-6189dc22fa22-server-conf" (OuterVolumeSpecName: "server-conf") pod "51d5f0da-bcbc-492e-ab39-6189dc22fa22" (UID: "51d5f0da-bcbc-492e-ab39-6189dc22fa22"). InnerVolumeSpecName "server-conf". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:19:11 crc kubenswrapper[5120]: I0316 16:19:11.152514 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51d5f0da-bcbc-492e-ab39-6189dc22fa22-rabbitmq-confd" (OuterVolumeSpecName: "rabbitmq-confd") pod "51d5f0da-bcbc-492e-ab39-6189dc22fa22" (UID: "51d5f0da-bcbc-492e-ab39-6189dc22fa22"). InnerVolumeSpecName "rabbitmq-confd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:19:11 crc kubenswrapper[5120]: I0316 16:19:11.181498 5120 reconciler_common.go:299] "Volume detached for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/51d5f0da-bcbc-492e-ab39-6189dc22fa22-pod-info\") on node \"crc\" DevicePath \"\"" Mar 16 16:19:11 crc kubenswrapper[5120]: I0316 16:19:11.181536 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/51d5f0da-bcbc-492e-ab39-6189dc22fa22-rabbitmq-tls\") on node \"crc\" DevicePath \"\"" Mar 16 16:19:11 crc kubenswrapper[5120]: I0316 16:19:11.181550 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nprdj\" (UniqueName: \"kubernetes.io/projected/51d5f0da-bcbc-492e-ab39-6189dc22fa22-kube-api-access-nprdj\") on node \"crc\" DevicePath \"\"" Mar 16 16:19:11 crc kubenswrapper[5120]: I0316 16:19:11.181587 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") on node \"crc\" " Mar 16 16:19:11 crc kubenswrapper[5120]: I0316 16:19:11.181601 5120 reconciler_common.go:299] "Volume detached for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/51d5f0da-bcbc-492e-ab39-6189dc22fa22-plugins-conf\") on node \"crc\" DevicePath \"\"" Mar 16 16:19:11 crc kubenswrapper[5120]: I0316 16:19:11.181611 5120 reconciler_common.go:299] "Volume detached for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/51d5f0da-bcbc-492e-ab39-6189dc22fa22-server-conf\") on node \"crc\" DevicePath \"\"" Mar 16 16:19:11 crc kubenswrapper[5120]: I0316 16:19:11.181624 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/51d5f0da-bcbc-492e-ab39-6189dc22fa22-rabbitmq-erlang-cookie\") on node \"crc\" DevicePath \"\"" Mar 16 16:19:11 crc kubenswrapper[5120]: I0316 16:19:11.181634 5120 reconciler_common.go:299] "Volume detached for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/51d5f0da-bcbc-492e-ab39-6189dc22fa22-erlang-cookie-secret\") on node \"crc\" DevicePath \"\"" Mar 16 16:19:11 crc kubenswrapper[5120]: I0316 16:19:11.181644 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/51d5f0da-bcbc-492e-ab39-6189dc22fa22-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:19:11 crc kubenswrapper[5120]: I0316 16:19:11.181653 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/51d5f0da-bcbc-492e-ab39-6189dc22fa22-rabbitmq-confd\") on node \"crc\" DevicePath \"\"" Mar 16 16:19:11 crc kubenswrapper[5120]: I0316 16:19:11.195212 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage12-crc" (UniqueName: "kubernetes.io/local-volume/local-storage12-crc") on node "crc" Mar 16 16:19:11 crc kubenswrapper[5120]: I0316 16:19:11.283410 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:19:11 crc kubenswrapper[5120]: I0316 16:19:11.447411 5120 generic.go:358] "Generic (PLEG): container finished" podID="51d5f0da-bcbc-492e-ab39-6189dc22fa22" containerID="612da3352edae9eff1f05f74b385ccf462bdc41a37210c6f1f1b0581e0b27fe9" exitCode=0 Mar 16 16:19:11 crc kubenswrapper[5120]: I0316 16:19:11.447575 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:19:11 crc kubenswrapper[5120]: I0316 16:19:11.447938 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"51d5f0da-bcbc-492e-ab39-6189dc22fa22","Type":"ContainerDied","Data":"612da3352edae9eff1f05f74b385ccf462bdc41a37210c6f1f1b0581e0b27fe9"} Mar 16 16:19:11 crc kubenswrapper[5120]: I0316 16:19:11.448049 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"51d5f0da-bcbc-492e-ab39-6189dc22fa22","Type":"ContainerDied","Data":"a4290f99426e82e7e1bb576ee2d094e599d45c679282a7447ab119fbaf9f7682"} Mar 16 16:19:11 crc kubenswrapper[5120]: I0316 16:19:11.448116 5120 scope.go:117] "RemoveContainer" containerID="612da3352edae9eff1f05f74b385ccf462bdc41a37210c6f1f1b0581e0b27fe9" Mar 16 16:19:11 crc kubenswrapper[5120]: I0316 16:19:11.479376 5120 scope.go:117] "RemoveContainer" containerID="e6b2822e5d645128d56a9bd865e65d852149622fc008ded1e1d1554dda52b32a" Mar 16 16:19:11 crc kubenswrapper[5120]: I0316 16:19:11.508308 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 16:19:11 crc kubenswrapper[5120]: I0316 16:19:11.515392 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 16:19:11 crc kubenswrapper[5120]: I0316 16:19:11.533954 5120 scope.go:117] "RemoveContainer" containerID="612da3352edae9eff1f05f74b385ccf462bdc41a37210c6f1f1b0581e0b27fe9" Mar 16 16:19:11 crc kubenswrapper[5120]: E0316 16:19:11.534599 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"612da3352edae9eff1f05f74b385ccf462bdc41a37210c6f1f1b0581e0b27fe9\": container with ID starting with 612da3352edae9eff1f05f74b385ccf462bdc41a37210c6f1f1b0581e0b27fe9 not found: ID does not exist" containerID="612da3352edae9eff1f05f74b385ccf462bdc41a37210c6f1f1b0581e0b27fe9" Mar 16 16:19:11 crc kubenswrapper[5120]: I0316 16:19:11.534696 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"612da3352edae9eff1f05f74b385ccf462bdc41a37210c6f1f1b0581e0b27fe9"} err="failed to get container status \"612da3352edae9eff1f05f74b385ccf462bdc41a37210c6f1f1b0581e0b27fe9\": rpc error: code = NotFound desc = could not find container \"612da3352edae9eff1f05f74b385ccf462bdc41a37210c6f1f1b0581e0b27fe9\": container with ID starting with 612da3352edae9eff1f05f74b385ccf462bdc41a37210c6f1f1b0581e0b27fe9 not found: ID does not exist" Mar 16 16:19:11 crc kubenswrapper[5120]: I0316 16:19:11.534784 5120 scope.go:117] "RemoveContainer" containerID="e6b2822e5d645128d56a9bd865e65d852149622fc008ded1e1d1554dda52b32a" Mar 16 16:19:11 crc kubenswrapper[5120]: E0316 16:19:11.535299 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e6b2822e5d645128d56a9bd865e65d852149622fc008ded1e1d1554dda52b32a\": container with ID starting with e6b2822e5d645128d56a9bd865e65d852149622fc008ded1e1d1554dda52b32a not found: ID does not exist" containerID="e6b2822e5d645128d56a9bd865e65d852149622fc008ded1e1d1554dda52b32a" Mar 16 16:19:11 crc kubenswrapper[5120]: I0316 16:19:11.535381 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6b2822e5d645128d56a9bd865e65d852149622fc008ded1e1d1554dda52b32a"} err="failed to get container status \"e6b2822e5d645128d56a9bd865e65d852149622fc008ded1e1d1554dda52b32a\": rpc error: code = NotFound desc = could not find container \"e6b2822e5d645128d56a9bd865e65d852149622fc008ded1e1d1554dda52b32a\": container with ID starting with e6b2822e5d645128d56a9bd865e65d852149622fc008ded1e1d1554dda52b32a not found: ID does not exist" Mar 16 16:19:12 crc kubenswrapper[5120]: I0316 16:19:12.692479 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="51d5f0da-bcbc-492e-ab39-6189dc22fa22" path="/var/lib/kubelet/pods/51d5f0da-bcbc-492e-ab39-6189dc22fa22/volumes" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.553906 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/certified-operators-6szgv"] Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.555706 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90982d87-fc0f-49d0-a400-4155e4f3b000" containerName="mariadb-account-create-update" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.555740 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="90982d87-fc0f-49d0-a400-4155e4f3b000" containerName="mariadb-account-create-update" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.555789 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="101749dc-c834-4d18-9d65-704af8b368a4" containerName="rsync" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.555802 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="101749dc-c834-4d18-9d65-704af8b368a4" containerName="rsync" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.555822 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c06828a4-039e-4080-a682-0bf5a7aaf9c2" containerName="proxy-httpd" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.555833 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c06828a4-039e-4080-a682-0bf5a7aaf9c2" containerName="proxy-httpd" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.555850 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d762c585-b44b-475d-a371-507fa2f9439a" containerName="keystone-api" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.555861 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="d762c585-b44b-475d-a371-507fa2f9439a" containerName="keystone-api" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.555876 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2e8d0e9-fa13-49fc-b149-af0d8d1d5ef0" containerName="barbican-keystone-listener-log" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.555887 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2e8d0e9-fa13-49fc-b149-af0d8d1d5ef0" containerName="barbican-keystone-listener-log" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.555908 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9292b258-885b-40a8-8b7d-9ed28a747bc7" containerName="nova-metadata-log" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.555919 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9292b258-885b-40a8-8b7d-9ed28a747bc7" containerName="nova-metadata-log" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.555934 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76c6cd23-f4cd-4b95-95b1-252ec9c5cafa" containerName="ceilometer-central-agent" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.555944 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="76c6cd23-f4cd-4b95-95b1-252ec9c5cafa" containerName="ceilometer-central-agent" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.555959 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76c6cd23-f4cd-4b95-95b1-252ec9c5cafa" containerName="sg-core" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.555971 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="76c6cd23-f4cd-4b95-95b1-252ec9c5cafa" containerName="sg-core" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.555983 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60fe13eb-066c-4985-bb16-1a201e5c339c" containerName="cinder-api" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.555993 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="60fe13eb-066c-4985-bb16-1a201e5c339c" containerName="cinder-api" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.556013 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e7f8135-737c-4639-bdd8-46d68e1a617d" containerName="nova-api-log" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.556022 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e7f8135-737c-4639-bdd8-46d68e1a617d" containerName="nova-api-log" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.556035 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="101749dc-c834-4d18-9d65-704af8b368a4" containerName="container-auditor" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.556044 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="101749dc-c834-4d18-9d65-704af8b368a4" containerName="container-auditor" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.556062 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="101749dc-c834-4d18-9d65-704af8b368a4" containerName="object-auditor" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.556074 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="101749dc-c834-4d18-9d65-704af8b368a4" containerName="object-auditor" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.556089 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e73bdb2c-01bf-4eca-93df-22b051fee769" containerName="nova-cell1-conductor-conductor" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.556100 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e73bdb2c-01bf-4eca-93df-22b051fee769" containerName="nova-cell1-conductor-conductor" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.556120 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f16b3a2-bc26-4a63-8f8c-836611f0d320" containerName="barbican-api" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.556130 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f16b3a2-bc26-4a63-8f8c-836611f0d320" containerName="barbican-api" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.556143 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="101749dc-c834-4d18-9d65-704af8b368a4" containerName="account-reaper" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.556152 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="101749dc-c834-4d18-9d65-704af8b368a4" containerName="account-reaper" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.556167 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="101749dc-c834-4d18-9d65-704af8b368a4" containerName="object-replicator" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.556176 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="101749dc-c834-4d18-9d65-704af8b368a4" containerName="object-replicator" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.556188 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fe73309-f917-40c4-a606-511f1547daf4" containerName="placement-api" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.556198 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fe73309-f917-40c4-a606-511f1547daf4" containerName="placement-api" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.556216 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="711e7cd2-a028-4c76-969e-e08558a5d732" containerName="nova-cell0-conductor-conductor" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.556226 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="711e7cd2-a028-4c76-969e-e08558a5d732" containerName="nova-cell0-conductor-conductor" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.556237 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76c6cd23-f4cd-4b95-95b1-252ec9c5cafa" containerName="ceilometer-notification-agent" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.556247 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="76c6cd23-f4cd-4b95-95b1-252ec9c5cafa" containerName="ceilometer-notification-agent" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.556265 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="101749dc-c834-4d18-9d65-704af8b368a4" containerName="container-server" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.556275 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="101749dc-c834-4d18-9d65-704af8b368a4" containerName="container-server" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.556286 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51d5f0da-bcbc-492e-ab39-6189dc22fa22" containerName="rabbitmq" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.556295 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="51d5f0da-bcbc-492e-ab39-6189dc22fa22" containerName="rabbitmq" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.556307 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76c6cd23-f4cd-4b95-95b1-252ec9c5cafa" containerName="proxy-httpd" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.556316 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="76c6cd23-f4cd-4b95-95b1-252ec9c5cafa" containerName="proxy-httpd" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.556337 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fe73309-f917-40c4-a606-511f1547daf4" containerName="placement-log" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.556347 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fe73309-f917-40c4-a606-511f1547daf4" containerName="placement-log" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.556366 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="551715bc-101a-4745-955b-027ac2be9c0b" containerName="setup-container" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.556375 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="551715bc-101a-4745-955b-027ac2be9c0b" containerName="setup-container" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.556385 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4885bea5-bdc7-472b-8f70-e110dd9b8c06" containerName="galera" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.556395 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="4885bea5-bdc7-472b-8f70-e110dd9b8c06" containerName="galera" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.556404 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="044996b4-e444-4486-9503-61d776ec849f" containerName="glance-httpd" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.556414 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="044996b4-e444-4486-9503-61d776ec849f" containerName="glance-httpd" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.556428 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e7f8135-737c-4639-bdd8-46d68e1a617d" containerName="nova-api-api" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.556438 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e7f8135-737c-4639-bdd8-46d68e1a617d" containerName="nova-api-api" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.556454 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff974854-15db-4188-b6dc-e330110c2427" containerName="glance-log" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.556465 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff974854-15db-4188-b6dc-e330110c2427" containerName="glance-log" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.556479 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51d5f0da-bcbc-492e-ab39-6189dc22fa22" containerName="setup-container" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.556490 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="51d5f0da-bcbc-492e-ab39-6189dc22fa22" containerName="setup-container" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.556505 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="251f0648-5ccd-4e12-acbb-ced50b9ce41b" containerName="init" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.556514 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="251f0648-5ccd-4e12-acbb-ced50b9ce41b" containerName="init" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.556531 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="101749dc-c834-4d18-9d65-704af8b368a4" containerName="container-updater" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.556540 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="101749dc-c834-4d18-9d65-704af8b368a4" containerName="container-updater" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.556554 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="551715bc-101a-4745-955b-027ac2be9c0b" containerName="rabbitmq" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.556563 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="551715bc-101a-4745-955b-027ac2be9c0b" containerName="rabbitmq" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.556576 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="101749dc-c834-4d18-9d65-704af8b368a4" containerName="object-server" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.556585 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="101749dc-c834-4d18-9d65-704af8b368a4" containerName="object-server" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.556602 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c354659-a22a-4fa3-8747-75b7241aea49" containerName="probe" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.556611 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c354659-a22a-4fa3-8747-75b7241aea49" containerName="probe" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.556632 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60fe13eb-066c-4985-bb16-1a201e5c339c" containerName="cinder-api-log" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.556643 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="60fe13eb-066c-4985-bb16-1a201e5c339c" containerName="cinder-api-log" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.556656 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="101749dc-c834-4d18-9d65-704af8b368a4" containerName="account-auditor" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.556668 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="101749dc-c834-4d18-9d65-704af8b368a4" containerName="account-auditor" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.556687 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2e8d0e9-fa13-49fc-b149-af0d8d1d5ef0" containerName="barbican-keystone-listener" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.556696 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2e8d0e9-fa13-49fc-b149-af0d8d1d5ef0" containerName="barbican-keystone-listener" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.556713 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="848fca26-246f-48f5-8f00-a41ecb239952" containerName="galera" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.556722 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="848fca26-246f-48f5-8f00-a41ecb239952" containerName="galera" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.556736 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="101749dc-c834-4d18-9d65-704af8b368a4" containerName="account-server" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.556746 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="101749dc-c834-4d18-9d65-704af8b368a4" containerName="account-server" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.556797 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="044996b4-e444-4486-9503-61d776ec849f" containerName="glance-log" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.556809 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="044996b4-e444-4486-9503-61d776ec849f" containerName="glance-log" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.556820 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4885bea5-bdc7-472b-8f70-e110dd9b8c06" containerName="mysql-bootstrap" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.556831 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="4885bea5-bdc7-472b-8f70-e110dd9b8c06" containerName="mysql-bootstrap" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.556841 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ead61fcf-891a-44f3-8867-a2adcf744d69" containerName="memcached" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.556850 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ead61fcf-891a-44f3-8867-a2adcf744d69" containerName="memcached" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.556869 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9698823e-0af0-4477-b47a-a388c6264dda" containerName="neutron-httpd" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.556880 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9698823e-0af0-4477-b47a-a388c6264dda" containerName="neutron-httpd" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.556901 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9292b258-885b-40a8-8b7d-9ed28a747bc7" containerName="nova-metadata-metadata" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.556910 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9292b258-885b-40a8-8b7d-9ed28a747bc7" containerName="nova-metadata-metadata" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.556924 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb13a989-3fee-4cd9-97d4-e68371891b6b" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.556935 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb13a989-3fee-4cd9-97d4-e68371891b6b" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.556950 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="251f0648-5ccd-4e12-acbb-ced50b9ce41b" containerName="dnsmasq-dns" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.556960 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="251f0648-5ccd-4e12-acbb-ced50b9ce41b" containerName="dnsmasq-dns" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.556975 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="101749dc-c834-4d18-9d65-704af8b368a4" containerName="object-updater" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.556984 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="101749dc-c834-4d18-9d65-704af8b368a4" containerName="object-updater" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.556997 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c06828a4-039e-4080-a682-0bf5a7aaf9c2" containerName="proxy-server" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.557007 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c06828a4-039e-4080-a682-0bf5a7aaf9c2" containerName="proxy-server" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.557018 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="101749dc-c834-4d18-9d65-704af8b368a4" containerName="object-expirer" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.557028 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="101749dc-c834-4d18-9d65-704af8b368a4" containerName="object-expirer" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.557043 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="101749dc-c834-4d18-9d65-704af8b368a4" containerName="swift-recon-cron" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.557052 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="101749dc-c834-4d18-9d65-704af8b368a4" containerName="swift-recon-cron" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.557065 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="101749dc-c834-4d18-9d65-704af8b368a4" containerName="account-replicator" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.557076 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="101749dc-c834-4d18-9d65-704af8b368a4" containerName="account-replicator" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.557092 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e059927-938d-4449-a260-90053be70ec9" containerName="barbican-worker-log" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.557102 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e059927-938d-4449-a260-90053be70ec9" containerName="barbican-worker-log" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.557113 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43c58ec7-474a-49bc-921f-89cf47b67811" containerName="openstack-network-exporter" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.557123 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="43c58ec7-474a-49bc-921f-89cf47b67811" containerName="openstack-network-exporter" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.557138 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f16b3a2-bc26-4a63-8f8c-836611f0d320" containerName="barbican-api-log" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.557148 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f16b3a2-bc26-4a63-8f8c-836611f0d320" containerName="barbican-api-log" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.557161 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9698823e-0af0-4477-b47a-a388c6264dda" containerName="neutron-api" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.557171 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9698823e-0af0-4477-b47a-a388c6264dda" containerName="neutron-api" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.557181 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f5ad605-f6ee-47e9-a2b6-43e60f01c4c9" containerName="nova-scheduler-scheduler" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.557190 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f5ad605-f6ee-47e9-a2b6-43e60f01c4c9" containerName="nova-scheduler-scheduler" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.557200 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c354659-a22a-4fa3-8747-75b7241aea49" containerName="cinder-scheduler" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.557209 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c354659-a22a-4fa3-8747-75b7241aea49" containerName="cinder-scheduler" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.557226 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="848fca26-246f-48f5-8f00-a41ecb239952" containerName="mysql-bootstrap" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.557235 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="848fca26-246f-48f5-8f00-a41ecb239952" containerName="mysql-bootstrap" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.557252 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43c58ec7-474a-49bc-921f-89cf47b67811" containerName="ovn-northd" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.557262 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="43c58ec7-474a-49bc-921f-89cf47b67811" containerName="ovn-northd" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.557279 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff974854-15db-4188-b6dc-e330110c2427" containerName="glance-httpd" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.557289 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff974854-15db-4188-b6dc-e330110c2427" containerName="glance-httpd" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.557304 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="101749dc-c834-4d18-9d65-704af8b368a4" containerName="container-replicator" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.557315 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="101749dc-c834-4d18-9d65-704af8b368a4" containerName="container-replicator" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.557333 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4cb4b19-5e1d-4cb5-8cc1-e51c0b445e06" containerName="oc" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.557344 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4cb4b19-5e1d-4cb5-8cc1-e51c0b445e06" containerName="oc" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.557360 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e059927-938d-4449-a260-90053be70ec9" containerName="barbican-worker" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.557369 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e059927-938d-4449-a260-90053be70ec9" containerName="barbican-worker" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.557585 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="044996b4-e444-4486-9503-61d776ec849f" containerName="glance-httpd" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.557612 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="76c6cd23-f4cd-4b95-95b1-252ec9c5cafa" containerName="sg-core" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.557631 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ead61fcf-891a-44f3-8867-a2adcf744d69" containerName="memcached" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.557642 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="9e7f8135-737c-4639-bdd8-46d68e1a617d" containerName="nova-api-log" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.557652 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="d762c585-b44b-475d-a371-507fa2f9439a" containerName="keystone-api" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.557662 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="251f0648-5ccd-4e12-acbb-ced50b9ce41b" containerName="dnsmasq-dns" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.557676 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="90982d87-fc0f-49d0-a400-4155e4f3b000" containerName="mariadb-account-create-update" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.557690 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="43c58ec7-474a-49bc-921f-89cf47b67811" containerName="openstack-network-exporter" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.557704 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="3fe73309-f917-40c4-a606-511f1547daf4" containerName="placement-api" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.557719 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="76c6cd23-f4cd-4b95-95b1-252ec9c5cafa" containerName="proxy-httpd" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.557737 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="101749dc-c834-4d18-9d65-704af8b368a4" containerName="object-replicator" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.557750 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="60fe13eb-066c-4985-bb16-1a201e5c339c" containerName="cinder-api" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.557786 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="101749dc-c834-4d18-9d65-704af8b368a4" containerName="object-updater" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.557804 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="3f5ad605-f6ee-47e9-a2b6-43e60f01c4c9" containerName="nova-scheduler-scheduler" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.557821 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="101749dc-c834-4d18-9d65-704af8b368a4" containerName="container-replicator" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.557840 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="711e7cd2-a028-4c76-969e-e08558a5d732" containerName="nova-cell0-conductor-conductor" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.557856 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1c354659-a22a-4fa3-8747-75b7241aea49" containerName="probe" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.557870 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="101749dc-c834-4d18-9d65-704af8b368a4" containerName="object-auditor" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.557888 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="9292b258-885b-40a8-8b7d-9ed28a747bc7" containerName="nova-metadata-metadata" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.557906 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="b2e8d0e9-fa13-49fc-b149-af0d8d1d5ef0" containerName="barbican-keystone-listener-log" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.557923 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="60fe13eb-066c-4985-bb16-1a201e5c339c" containerName="cinder-api-log" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.557939 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="76c6cd23-f4cd-4b95-95b1-252ec9c5cafa" containerName="ceilometer-central-agent" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.557958 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="9e7f8135-737c-4639-bdd8-46d68e1a617d" containerName="nova-api-api" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.557969 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e4cb4b19-5e1d-4cb5-8cc1-e51c0b445e06" containerName="oc" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.557984 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="101749dc-c834-4d18-9d65-704af8b368a4" containerName="rsync" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.557994 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="101749dc-c834-4d18-9d65-704af8b368a4" containerName="account-server" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.558006 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7e059927-938d-4449-a260-90053be70ec9" containerName="barbican-worker-log" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.558022 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="9698823e-0af0-4477-b47a-a388c6264dda" containerName="neutron-httpd" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.558040 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="9f16b3a2-bc26-4a63-8f8c-836611f0d320" containerName="barbican-api" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.558053 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="9292b258-885b-40a8-8b7d-9ed28a747bc7" containerName="nova-metadata-log" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.558068 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ff974854-15db-4188-b6dc-e330110c2427" containerName="glance-log" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.558080 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="044996b4-e444-4486-9503-61d776ec849f" containerName="glance-log" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.558090 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7e059927-938d-4449-a260-90053be70ec9" containerName="barbican-worker" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.558105 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="101749dc-c834-4d18-9d65-704af8b368a4" containerName="container-updater" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.558119 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="101749dc-c834-4d18-9d65-704af8b368a4" containerName="account-reaper" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.558131 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="101749dc-c834-4d18-9d65-704af8b368a4" containerName="object-expirer" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.558145 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="3fe73309-f917-40c4-a606-511f1547daf4" containerName="placement-log" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.558163 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="101749dc-c834-4d18-9d65-704af8b368a4" containerName="container-server" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.558180 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c06828a4-039e-4080-a682-0bf5a7aaf9c2" containerName="proxy-httpd" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.558193 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="101749dc-c834-4d18-9d65-704af8b368a4" containerName="account-auditor" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.558207 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="43c58ec7-474a-49bc-921f-89cf47b67811" containerName="ovn-northd" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.558218 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="51d5f0da-bcbc-492e-ab39-6189dc22fa22" containerName="rabbitmq" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.558232 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="4885bea5-bdc7-472b-8f70-e110dd9b8c06" containerName="galera" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.558243 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="b2e8d0e9-fa13-49fc-b149-af0d8d1d5ef0" containerName="barbican-keystone-listener" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.558257 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="9f16b3a2-bc26-4a63-8f8c-836611f0d320" containerName="barbican-api-log" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.558272 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="9698823e-0af0-4477-b47a-a388c6264dda" containerName="neutron-api" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.558285 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="101749dc-c834-4d18-9d65-704af8b368a4" containerName="account-replicator" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.558297 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1c354659-a22a-4fa3-8747-75b7241aea49" containerName="cinder-scheduler" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.558308 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ff974854-15db-4188-b6dc-e330110c2427" containerName="glance-httpd" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.558320 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="101749dc-c834-4d18-9d65-704af8b368a4" containerName="container-auditor" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.558337 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="101749dc-c834-4d18-9d65-704af8b368a4" containerName="object-server" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.558350 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="101749dc-c834-4d18-9d65-704af8b368a4" containerName="swift-recon-cron" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.558360 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="848fca26-246f-48f5-8f00-a41ecb239952" containerName="galera" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.558371 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="551715bc-101a-4745-955b-027ac2be9c0b" containerName="rabbitmq" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.558383 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e73bdb2c-01bf-4eca-93df-22b051fee769" containerName="nova-cell1-conductor-conductor" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.558397 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="76c6cd23-f4cd-4b95-95b1-252ec9c5cafa" containerName="ceilometer-notification-agent" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.558411 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c06828a4-039e-4080-a682-0bf5a7aaf9c2" containerName="proxy-server" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.558421 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="fb13a989-3fee-4cd9-97d4-e68371891b6b" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.558680 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90982d87-fc0f-49d0-a400-4155e4f3b000" containerName="mariadb-account-create-update" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.558694 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="90982d87-fc0f-49d0-a400-4155e4f3b000" containerName="mariadb-account-create-update" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.558955 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="90982d87-fc0f-49d0-a400-4155e4f3b000" containerName="mariadb-account-create-update" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.571967 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/certified-operators-6szgv"] Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.572132 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-6szgv" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.620496 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/ca886aad-948e-4ab5-839e-7a09f19d7713-utilities\") pod \"certified-operators-6szgv\" (UID: \"ca886aad-948e-4ab5-839e-7a09f19d7713\") " pod="openshift-marketplace/certified-operators-6szgv" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.620846 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wj4dn\" (UniqueName: \"kubernetes.io/projected/ca886aad-948e-4ab5-839e-7a09f19d7713-kube-api-access-wj4dn\") pod \"certified-operators-6szgv\" (UID: \"ca886aad-948e-4ab5-839e-7a09f19d7713\") " pod="openshift-marketplace/certified-operators-6szgv" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.621203 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/ca886aad-948e-4ab5-839e-7a09f19d7713-catalog-content\") pod \"certified-operators-6szgv\" (UID: \"ca886aad-948e-4ab5-839e-7a09f19d7713\") " pod="openshift-marketplace/certified-operators-6szgv" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.723064 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/ca886aad-948e-4ab5-839e-7a09f19d7713-catalog-content\") pod \"certified-operators-6szgv\" (UID: \"ca886aad-948e-4ab5-839e-7a09f19d7713\") " pod="openshift-marketplace/certified-operators-6szgv" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.723247 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/ca886aad-948e-4ab5-839e-7a09f19d7713-utilities\") pod \"certified-operators-6szgv\" (UID: \"ca886aad-948e-4ab5-839e-7a09f19d7713\") " pod="openshift-marketplace/certified-operators-6szgv" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.723303 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wj4dn\" (UniqueName: \"kubernetes.io/projected/ca886aad-948e-4ab5-839e-7a09f19d7713-kube-api-access-wj4dn\") pod \"certified-operators-6szgv\" (UID: \"ca886aad-948e-4ab5-839e-7a09f19d7713\") " pod="openshift-marketplace/certified-operators-6szgv" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.723529 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/ca886aad-948e-4ab5-839e-7a09f19d7713-catalog-content\") pod \"certified-operators-6szgv\" (UID: \"ca886aad-948e-4ab5-839e-7a09f19d7713\") " pod="openshift-marketplace/certified-operators-6szgv" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.723881 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/ca886aad-948e-4ab5-839e-7a09f19d7713-utilities\") pod \"certified-operators-6szgv\" (UID: \"ca886aad-948e-4ab5-839e-7a09f19d7713\") " pod="openshift-marketplace/certified-operators-6szgv" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.749070 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-marketplace-8zjm9"] Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.752882 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wj4dn\" (UniqueName: \"kubernetes.io/projected/ca886aad-948e-4ab5-839e-7a09f19d7713-kube-api-access-wj4dn\") pod \"certified-operators-6szgv\" (UID: \"ca886aad-948e-4ab5-839e-7a09f19d7713\") " pod="openshift-marketplace/certified-operators-6szgv" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.771070 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-8zjm9"] Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.771202 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-8zjm9" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.824319 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5f6st\" (UniqueName: \"kubernetes.io/projected/4b1f9465-a9b2-4cca-81c5-cf7fec00619a-kube-api-access-5f6st\") pod \"redhat-marketplace-8zjm9\" (UID: \"4b1f9465-a9b2-4cca-81c5-cf7fec00619a\") " pod="openshift-marketplace/redhat-marketplace-8zjm9" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.824398 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/4b1f9465-a9b2-4cca-81c5-cf7fec00619a-catalog-content\") pod \"redhat-marketplace-8zjm9\" (UID: \"4b1f9465-a9b2-4cca-81c5-cf7fec00619a\") " pod="openshift-marketplace/redhat-marketplace-8zjm9" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.824547 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/4b1f9465-a9b2-4cca-81c5-cf7fec00619a-utilities\") pod \"redhat-marketplace-8zjm9\" (UID: \"4b1f9465-a9b2-4cca-81c5-cf7fec00619a\") " pod="openshift-marketplace/redhat-marketplace-8zjm9" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.911455 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-6szgv" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.926312 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5f6st\" (UniqueName: \"kubernetes.io/projected/4b1f9465-a9b2-4cca-81c5-cf7fec00619a-kube-api-access-5f6st\") pod \"redhat-marketplace-8zjm9\" (UID: \"4b1f9465-a9b2-4cca-81c5-cf7fec00619a\") " pod="openshift-marketplace/redhat-marketplace-8zjm9" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.926403 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/4b1f9465-a9b2-4cca-81c5-cf7fec00619a-catalog-content\") pod \"redhat-marketplace-8zjm9\" (UID: \"4b1f9465-a9b2-4cca-81c5-cf7fec00619a\") " pod="openshift-marketplace/redhat-marketplace-8zjm9" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.926752 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/4b1f9465-a9b2-4cca-81c5-cf7fec00619a-utilities\") pod \"redhat-marketplace-8zjm9\" (UID: \"4b1f9465-a9b2-4cca-81c5-cf7fec00619a\") " pod="openshift-marketplace/redhat-marketplace-8zjm9" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.926856 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/4b1f9465-a9b2-4cca-81c5-cf7fec00619a-catalog-content\") pod \"redhat-marketplace-8zjm9\" (UID: \"4b1f9465-a9b2-4cca-81c5-cf7fec00619a\") " pod="openshift-marketplace/redhat-marketplace-8zjm9" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.927083 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/4b1f9465-a9b2-4cca-81c5-cf7fec00619a-utilities\") pod \"redhat-marketplace-8zjm9\" (UID: \"4b1f9465-a9b2-4cca-81c5-cf7fec00619a\") " pod="openshift-marketplace/redhat-marketplace-8zjm9" Mar 16 16:19:17 crc kubenswrapper[5120]: I0316 16:19:17.944876 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5f6st\" (UniqueName: \"kubernetes.io/projected/4b1f9465-a9b2-4cca-81c5-cf7fec00619a-kube-api-access-5f6st\") pod \"redhat-marketplace-8zjm9\" (UID: \"4b1f9465-a9b2-4cca-81c5-cf7fec00619a\") " pod="openshift-marketplace/redhat-marketplace-8zjm9" Mar 16 16:19:18 crc kubenswrapper[5120]: I0316 16:19:18.105449 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-8zjm9" Mar 16 16:19:18 crc kubenswrapper[5120]: I0316 16:19:18.161752 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/certified-operators-6szgv"] Mar 16 16:19:18 crc kubenswrapper[5120]: W0316 16:19:18.171176 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca886aad_948e_4ab5_839e_7a09f19d7713.slice/crio-ae92ed049b89f99e0e4c2fe8203439e59c3f62afa4312c4f49656cb11808700d WatchSource:0}: Error finding container ae92ed049b89f99e0e4c2fe8203439e59c3f62afa4312c4f49656cb11808700d: Status 404 returned error can't find the container with id ae92ed049b89f99e0e4c2fe8203439e59c3f62afa4312c4f49656cb11808700d Mar 16 16:19:18 crc kubenswrapper[5120]: I0316 16:19:18.219766 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["crc-storage/crc-storage-crc-vqdc9"] Mar 16 16:19:18 crc kubenswrapper[5120]: I0316 16:19:18.228099 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["crc-storage/crc-storage-crc-vqdc9"] Mar 16 16:19:18 crc kubenswrapper[5120]: I0316 16:19:18.341737 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["crc-storage/crc-storage-crc-kwpmh"] Mar 16 16:19:18 crc kubenswrapper[5120]: I0316 16:19:18.354976 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-kwpmh" Mar 16 16:19:18 crc kubenswrapper[5120]: I0316 16:19:18.365079 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"crc-storage\"" Mar 16 16:19:18 crc kubenswrapper[5120]: I0316 16:19:18.365483 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"openshift-service-ca.crt\"" Mar 16 16:19:18 crc kubenswrapper[5120]: I0316 16:19:18.365750 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"kube-root-ca.crt\"" Mar 16 16:19:18 crc kubenswrapper[5120]: I0316 16:19:18.366432 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"crc-storage\"/\"crc-storage-dockercfg-s2tht\"" Mar 16 16:19:18 crc kubenswrapper[5120]: I0316 16:19:18.376396 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-kwpmh"] Mar 16 16:19:18 crc kubenswrapper[5120]: I0316 16:19:18.437066 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rv6qn\" (UniqueName: \"kubernetes.io/projected/b4bd3f33-8a10-42ad-8d8a-7463d215021f-kube-api-access-rv6qn\") pod \"crc-storage-crc-kwpmh\" (UID: \"b4bd3f33-8a10-42ad-8d8a-7463d215021f\") " pod="crc-storage/crc-storage-crc-kwpmh" Mar 16 16:19:18 crc kubenswrapper[5120]: I0316 16:19:18.437130 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/b4bd3f33-8a10-42ad-8d8a-7463d215021f-crc-storage\") pod \"crc-storage-crc-kwpmh\" (UID: \"b4bd3f33-8a10-42ad-8d8a-7463d215021f\") " pod="crc-storage/crc-storage-crc-kwpmh" Mar 16 16:19:18 crc kubenswrapper[5120]: I0316 16:19:18.437393 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/b4bd3f33-8a10-42ad-8d8a-7463d215021f-node-mnt\") pod \"crc-storage-crc-kwpmh\" (UID: \"b4bd3f33-8a10-42ad-8d8a-7463d215021f\") " pod="crc-storage/crc-storage-crc-kwpmh" Mar 16 16:19:18 crc kubenswrapper[5120]: I0316 16:19:18.528933 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-8zjm9"] Mar 16 16:19:18 crc kubenswrapper[5120]: W0316 16:19:18.531513 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b1f9465_a9b2_4cca_81c5_cf7fec00619a.slice/crio-280206c420a62e1430d25bfd795b51005cba090492822f59aea35da1235aa100 WatchSource:0}: Error finding container 280206c420a62e1430d25bfd795b51005cba090492822f59aea35da1235aa100: Status 404 returned error can't find the container with id 280206c420a62e1430d25bfd795b51005cba090492822f59aea35da1235aa100 Mar 16 16:19:18 crc kubenswrapper[5120]: I0316 16:19:18.537783 5120 generic.go:358] "Generic (PLEG): container finished" podID="ca886aad-948e-4ab5-839e-7a09f19d7713" containerID="c1a6a7cd8dea15783cc462db6ee69614c21761750cf6c401e06d8d64ffbaafcc" exitCode=0 Mar 16 16:19:18 crc kubenswrapper[5120]: I0316 16:19:18.537874 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-6szgv" event={"ID":"ca886aad-948e-4ab5-839e-7a09f19d7713","Type":"ContainerDied","Data":"c1a6a7cd8dea15783cc462db6ee69614c21761750cf6c401e06d8d64ffbaafcc"} Mar 16 16:19:18 crc kubenswrapper[5120]: I0316 16:19:18.537930 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-6szgv" event={"ID":"ca886aad-948e-4ab5-839e-7a09f19d7713","Type":"ContainerStarted","Data":"ae92ed049b89f99e0e4c2fe8203439e59c3f62afa4312c4f49656cb11808700d"} Mar 16 16:19:18 crc kubenswrapper[5120]: I0316 16:19:18.539303 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/b4bd3f33-8a10-42ad-8d8a-7463d215021f-node-mnt\") pod \"crc-storage-crc-kwpmh\" (UID: \"b4bd3f33-8a10-42ad-8d8a-7463d215021f\") " pod="crc-storage/crc-storage-crc-kwpmh" Mar 16 16:19:18 crc kubenswrapper[5120]: I0316 16:19:18.539504 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rv6qn\" (UniqueName: \"kubernetes.io/projected/b4bd3f33-8a10-42ad-8d8a-7463d215021f-kube-api-access-rv6qn\") pod \"crc-storage-crc-kwpmh\" (UID: \"b4bd3f33-8a10-42ad-8d8a-7463d215021f\") " pod="crc-storage/crc-storage-crc-kwpmh" Mar 16 16:19:18 crc kubenswrapper[5120]: I0316 16:19:18.539607 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/b4bd3f33-8a10-42ad-8d8a-7463d215021f-crc-storage\") pod \"crc-storage-crc-kwpmh\" (UID: \"b4bd3f33-8a10-42ad-8d8a-7463d215021f\") " pod="crc-storage/crc-storage-crc-kwpmh" Mar 16 16:19:18 crc kubenswrapper[5120]: I0316 16:19:18.539897 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/b4bd3f33-8a10-42ad-8d8a-7463d215021f-node-mnt\") pod \"crc-storage-crc-kwpmh\" (UID: \"b4bd3f33-8a10-42ad-8d8a-7463d215021f\") " pod="crc-storage/crc-storage-crc-kwpmh" Mar 16 16:19:18 crc kubenswrapper[5120]: I0316 16:19:18.540945 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/b4bd3f33-8a10-42ad-8d8a-7463d215021f-crc-storage\") pod \"crc-storage-crc-kwpmh\" (UID: \"b4bd3f33-8a10-42ad-8d8a-7463d215021f\") " pod="crc-storage/crc-storage-crc-kwpmh" Mar 16 16:19:18 crc kubenswrapper[5120]: I0316 16:19:18.561944 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rv6qn\" (UniqueName: \"kubernetes.io/projected/b4bd3f33-8a10-42ad-8d8a-7463d215021f-kube-api-access-rv6qn\") pod \"crc-storage-crc-kwpmh\" (UID: \"b4bd3f33-8a10-42ad-8d8a-7463d215021f\") " pod="crc-storage/crc-storage-crc-kwpmh" Mar 16 16:19:18 crc kubenswrapper[5120]: I0316 16:19:18.675683 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8c1eb67e-902c-4fa5-84b5-3199caea970a" path="/var/lib/kubelet/pods/8c1eb67e-902c-4fa5-84b5-3199caea970a/volumes" Mar 16 16:19:18 crc kubenswrapper[5120]: I0316 16:19:18.730131 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-kwpmh" Mar 16 16:19:19 crc kubenswrapper[5120]: I0316 16:19:19.201442 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-kwpmh"] Mar 16 16:19:19 crc kubenswrapper[5120]: I0316 16:19:19.547989 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-kwpmh" event={"ID":"b4bd3f33-8a10-42ad-8d8a-7463d215021f","Type":"ContainerStarted","Data":"d10628e601fcc10a1b574b380506fcd52fe72f1e1e443ae37e1b8e2eb07c9c2b"} Mar 16 16:19:19 crc kubenswrapper[5120]: I0316 16:19:19.550926 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-6szgv" event={"ID":"ca886aad-948e-4ab5-839e-7a09f19d7713","Type":"ContainerStarted","Data":"9df53a9b594f2b5389f4caec395683abc55565aa3d186ed568e9aaa6aaca0a29"} Mar 16 16:19:19 crc kubenswrapper[5120]: I0316 16:19:19.556816 5120 generic.go:358] "Generic (PLEG): container finished" podID="4b1f9465-a9b2-4cca-81c5-cf7fec00619a" containerID="befa310c2047884e8301ef4976457257ea3c17343bada853d87b0a352e843c20" exitCode=0 Mar 16 16:19:19 crc kubenswrapper[5120]: I0316 16:19:19.556934 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-8zjm9" event={"ID":"4b1f9465-a9b2-4cca-81c5-cf7fec00619a","Type":"ContainerDied","Data":"befa310c2047884e8301ef4976457257ea3c17343bada853d87b0a352e843c20"} Mar 16 16:19:19 crc kubenswrapper[5120]: I0316 16:19:19.556974 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-8zjm9" event={"ID":"4b1f9465-a9b2-4cca-81c5-cf7fec00619a","Type":"ContainerStarted","Data":"280206c420a62e1430d25bfd795b51005cba090492822f59aea35da1235aa100"} Mar 16 16:19:20 crc kubenswrapper[5120]: I0316 16:19:20.574450 5120 generic.go:358] "Generic (PLEG): container finished" podID="b4bd3f33-8a10-42ad-8d8a-7463d215021f" containerID="7585df4078615dabd64c031b0029e70c9446a686bdfd224743c3c5cbe2469b6e" exitCode=0 Mar 16 16:19:20 crc kubenswrapper[5120]: I0316 16:19:20.574580 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-kwpmh" event={"ID":"b4bd3f33-8a10-42ad-8d8a-7463d215021f","Type":"ContainerDied","Data":"7585df4078615dabd64c031b0029e70c9446a686bdfd224743c3c5cbe2469b6e"} Mar 16 16:19:20 crc kubenswrapper[5120]: I0316 16:19:20.578299 5120 generic.go:358] "Generic (PLEG): container finished" podID="ca886aad-948e-4ab5-839e-7a09f19d7713" containerID="9df53a9b594f2b5389f4caec395683abc55565aa3d186ed568e9aaa6aaca0a29" exitCode=0 Mar 16 16:19:20 crc kubenswrapper[5120]: I0316 16:19:20.578507 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-6szgv" event={"ID":"ca886aad-948e-4ab5-839e-7a09f19d7713","Type":"ContainerDied","Data":"9df53a9b594f2b5389f4caec395683abc55565aa3d186ed568e9aaa6aaca0a29"} Mar 16 16:19:21 crc kubenswrapper[5120]: I0316 16:19:21.593307 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-6szgv" event={"ID":"ca886aad-948e-4ab5-839e-7a09f19d7713","Type":"ContainerStarted","Data":"a71f9fad289bf88bd132eeef7021c729909d224026a882fc978ee9df119b2a7e"} Mar 16 16:19:21 crc kubenswrapper[5120]: I0316 16:19:21.597080 5120 generic.go:358] "Generic (PLEG): container finished" podID="4b1f9465-a9b2-4cca-81c5-cf7fec00619a" containerID="b002f8b79d45c11eca7957aff993c39ca141f2fd3ef226a99111d31e924f6179" exitCode=0 Mar 16 16:19:21 crc kubenswrapper[5120]: I0316 16:19:21.597499 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-8zjm9" event={"ID":"4b1f9465-a9b2-4cca-81c5-cf7fec00619a","Type":"ContainerDied","Data":"b002f8b79d45c11eca7957aff993c39ca141f2fd3ef226a99111d31e924f6179"} Mar 16 16:19:21 crc kubenswrapper[5120]: I0316 16:19:21.638970 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/certified-operators-6szgv" podStartSLOduration=3.990559055 podStartE2EDuration="4.638947427s" podCreationTimestamp="2026-03-16 16:19:17 +0000 UTC" firstStartedPulling="2026-03-16 16:19:18.538865509 +0000 UTC m=+2860.692797186" lastFinishedPulling="2026-03-16 16:19:19.187253891 +0000 UTC m=+2861.341185558" observedRunningTime="2026-03-16 16:19:21.623388301 +0000 UTC m=+2863.777319998" watchObservedRunningTime="2026-03-16 16:19:21.638947427 +0000 UTC m=+2863.792879094" Mar 16 16:19:21 crc kubenswrapper[5120]: I0316 16:19:21.950136 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-kwpmh" Mar 16 16:19:22 crc kubenswrapper[5120]: I0316 16:19:22.007806 5120 patch_prober.go:28] interesting pod/machine-config-daemon-7bf76 container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 16:19:22 crc kubenswrapper[5120]: I0316 16:19:22.007884 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 16:19:22 crc kubenswrapper[5120]: I0316 16:19:22.017432 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/b4bd3f33-8a10-42ad-8d8a-7463d215021f-crc-storage\") pod \"b4bd3f33-8a10-42ad-8d8a-7463d215021f\" (UID: \"b4bd3f33-8a10-42ad-8d8a-7463d215021f\") " Mar 16 16:19:22 crc kubenswrapper[5120]: I0316 16:19:22.017471 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/b4bd3f33-8a10-42ad-8d8a-7463d215021f-node-mnt\") pod \"b4bd3f33-8a10-42ad-8d8a-7463d215021f\" (UID: \"b4bd3f33-8a10-42ad-8d8a-7463d215021f\") " Mar 16 16:19:22 crc kubenswrapper[5120]: I0316 16:19:22.017537 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rv6qn\" (UniqueName: \"kubernetes.io/projected/b4bd3f33-8a10-42ad-8d8a-7463d215021f-kube-api-access-rv6qn\") pod \"b4bd3f33-8a10-42ad-8d8a-7463d215021f\" (UID: \"b4bd3f33-8a10-42ad-8d8a-7463d215021f\") " Mar 16 16:19:22 crc kubenswrapper[5120]: I0316 16:19:22.018568 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/b4bd3f33-8a10-42ad-8d8a-7463d215021f-node-mnt" (OuterVolumeSpecName: "node-mnt") pod "b4bd3f33-8a10-42ad-8d8a-7463d215021f" (UID: "b4bd3f33-8a10-42ad-8d8a-7463d215021f"). InnerVolumeSpecName "node-mnt". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 16:19:22 crc kubenswrapper[5120]: I0316 16:19:22.028915 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4bd3f33-8a10-42ad-8d8a-7463d215021f-kube-api-access-rv6qn" (OuterVolumeSpecName: "kube-api-access-rv6qn") pod "b4bd3f33-8a10-42ad-8d8a-7463d215021f" (UID: "b4bd3f33-8a10-42ad-8d8a-7463d215021f"). InnerVolumeSpecName "kube-api-access-rv6qn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:19:22 crc kubenswrapper[5120]: I0316 16:19:22.035581 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b4bd3f33-8a10-42ad-8d8a-7463d215021f-crc-storage" (OuterVolumeSpecName: "crc-storage") pod "b4bd3f33-8a10-42ad-8d8a-7463d215021f" (UID: "b4bd3f33-8a10-42ad-8d8a-7463d215021f"). InnerVolumeSpecName "crc-storage". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:19:22 crc kubenswrapper[5120]: I0316 16:19:22.120387 5120 reconciler_common.go:299] "Volume detached for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/b4bd3f33-8a10-42ad-8d8a-7463d215021f-crc-storage\") on node \"crc\" DevicePath \"\"" Mar 16 16:19:22 crc kubenswrapper[5120]: I0316 16:19:22.120608 5120 reconciler_common.go:299] "Volume detached for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/b4bd3f33-8a10-42ad-8d8a-7463d215021f-node-mnt\") on node \"crc\" DevicePath \"\"" Mar 16 16:19:22 crc kubenswrapper[5120]: I0316 16:19:22.120725 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rv6qn\" (UniqueName: \"kubernetes.io/projected/b4bd3f33-8a10-42ad-8d8a-7463d215021f-kube-api-access-rv6qn\") on node \"crc\" DevicePath \"\"" Mar 16 16:19:22 crc kubenswrapper[5120]: I0316 16:19:22.609922 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-kwpmh" event={"ID":"b4bd3f33-8a10-42ad-8d8a-7463d215021f","Type":"ContainerDied","Data":"d10628e601fcc10a1b574b380506fcd52fe72f1e1e443ae37e1b8e2eb07c9c2b"} Mar 16 16:19:22 crc kubenswrapper[5120]: I0316 16:19:22.610981 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d10628e601fcc10a1b574b380506fcd52fe72f1e1e443ae37e1b8e2eb07c9c2b" Mar 16 16:19:22 crc kubenswrapper[5120]: I0316 16:19:22.609952 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-kwpmh" Mar 16 16:19:22 crc kubenswrapper[5120]: I0316 16:19:22.615953 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-8zjm9" event={"ID":"4b1f9465-a9b2-4cca-81c5-cf7fec00619a","Type":"ContainerStarted","Data":"c6c855b5a020dbbe4f8e739870bd0e3a62429785722fa4fab53be53b74829ad4"} Mar 16 16:19:22 crc kubenswrapper[5120]: I0316 16:19:22.650835 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/redhat-marketplace-8zjm9" podStartSLOduration=4.7353848670000005 podStartE2EDuration="5.650807842s" podCreationTimestamp="2026-03-16 16:19:17 +0000 UTC" firstStartedPulling="2026-03-16 16:19:19.557794393 +0000 UTC m=+2861.711726090" lastFinishedPulling="2026-03-16 16:19:20.473217408 +0000 UTC m=+2862.627149065" observedRunningTime="2026-03-16 16:19:22.642943891 +0000 UTC m=+2864.796875608" watchObservedRunningTime="2026-03-16 16:19:22.650807842 +0000 UTC m=+2864.804739529" Mar 16 16:19:25 crc kubenswrapper[5120]: I0316 16:19:25.297049 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["crc-storage/crc-storage-crc-kwpmh"] Mar 16 16:19:25 crc kubenswrapper[5120]: I0316 16:19:25.307144 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["crc-storage/crc-storage-crc-kwpmh"] Mar 16 16:19:25 crc kubenswrapper[5120]: I0316 16:19:25.416127 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["crc-storage/crc-storage-crc-dbtb9"] Mar 16 16:19:25 crc kubenswrapper[5120]: I0316 16:19:25.417781 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4bd3f33-8a10-42ad-8d8a-7463d215021f" containerName="storage" Mar 16 16:19:25 crc kubenswrapper[5120]: I0316 16:19:25.417816 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4bd3f33-8a10-42ad-8d8a-7463d215021f" containerName="storage" Mar 16 16:19:25 crc kubenswrapper[5120]: I0316 16:19:25.418136 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="b4bd3f33-8a10-42ad-8d8a-7463d215021f" containerName="storage" Mar 16 16:19:25 crc kubenswrapper[5120]: I0316 16:19:25.430169 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-dbtb9" Mar 16 16:19:25 crc kubenswrapper[5120]: I0316 16:19:25.430446 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-dbtb9"] Mar 16 16:19:25 crc kubenswrapper[5120]: I0316 16:19:25.438061 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"crc-storage\"" Mar 16 16:19:25 crc kubenswrapper[5120]: I0316 16:19:25.438139 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"openshift-service-ca.crt\"" Mar 16 16:19:25 crc kubenswrapper[5120]: I0316 16:19:25.439054 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"kube-root-ca.crt\"" Mar 16 16:19:25 crc kubenswrapper[5120]: I0316 16:19:25.439057 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"crc-storage\"/\"crc-storage-dockercfg-s2tht\"" Mar 16 16:19:25 crc kubenswrapper[5120]: I0316 16:19:25.587127 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/9a988117-7627-4f34-9b78-50a8e13adfa6-crc-storage\") pod \"crc-storage-crc-dbtb9\" (UID: \"9a988117-7627-4f34-9b78-50a8e13adfa6\") " pod="crc-storage/crc-storage-crc-dbtb9" Mar 16 16:19:25 crc kubenswrapper[5120]: I0316 16:19:25.587189 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/9a988117-7627-4f34-9b78-50a8e13adfa6-node-mnt\") pod \"crc-storage-crc-dbtb9\" (UID: \"9a988117-7627-4f34-9b78-50a8e13adfa6\") " pod="crc-storage/crc-storage-crc-dbtb9" Mar 16 16:19:25 crc kubenswrapper[5120]: I0316 16:19:25.587404 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zdc7\" (UniqueName: \"kubernetes.io/projected/9a988117-7627-4f34-9b78-50a8e13adfa6-kube-api-access-9zdc7\") pod \"crc-storage-crc-dbtb9\" (UID: \"9a988117-7627-4f34-9b78-50a8e13adfa6\") " pod="crc-storage/crc-storage-crc-dbtb9" Mar 16 16:19:25 crc kubenswrapper[5120]: I0316 16:19:25.689320 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9zdc7\" (UniqueName: \"kubernetes.io/projected/9a988117-7627-4f34-9b78-50a8e13adfa6-kube-api-access-9zdc7\") pod \"crc-storage-crc-dbtb9\" (UID: \"9a988117-7627-4f34-9b78-50a8e13adfa6\") " pod="crc-storage/crc-storage-crc-dbtb9" Mar 16 16:19:25 crc kubenswrapper[5120]: I0316 16:19:25.689473 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/9a988117-7627-4f34-9b78-50a8e13adfa6-crc-storage\") pod \"crc-storage-crc-dbtb9\" (UID: \"9a988117-7627-4f34-9b78-50a8e13adfa6\") " pod="crc-storage/crc-storage-crc-dbtb9" Mar 16 16:19:25 crc kubenswrapper[5120]: I0316 16:19:25.689519 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/9a988117-7627-4f34-9b78-50a8e13adfa6-node-mnt\") pod \"crc-storage-crc-dbtb9\" (UID: \"9a988117-7627-4f34-9b78-50a8e13adfa6\") " pod="crc-storage/crc-storage-crc-dbtb9" Mar 16 16:19:25 crc kubenswrapper[5120]: I0316 16:19:25.689924 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/9a988117-7627-4f34-9b78-50a8e13adfa6-node-mnt\") pod \"crc-storage-crc-dbtb9\" (UID: \"9a988117-7627-4f34-9b78-50a8e13adfa6\") " pod="crc-storage/crc-storage-crc-dbtb9" Mar 16 16:19:25 crc kubenswrapper[5120]: I0316 16:19:25.690889 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/9a988117-7627-4f34-9b78-50a8e13adfa6-crc-storage\") pod \"crc-storage-crc-dbtb9\" (UID: \"9a988117-7627-4f34-9b78-50a8e13adfa6\") " pod="crc-storage/crc-storage-crc-dbtb9" Mar 16 16:19:25 crc kubenswrapper[5120]: I0316 16:19:25.718421 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zdc7\" (UniqueName: \"kubernetes.io/projected/9a988117-7627-4f34-9b78-50a8e13adfa6-kube-api-access-9zdc7\") pod \"crc-storage-crc-dbtb9\" (UID: \"9a988117-7627-4f34-9b78-50a8e13adfa6\") " pod="crc-storage/crc-storage-crc-dbtb9" Mar 16 16:19:25 crc kubenswrapper[5120]: I0316 16:19:25.753895 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-dbtb9" Mar 16 16:19:26 crc kubenswrapper[5120]: I0316 16:19:26.182156 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-dbtb9"] Mar 16 16:19:26 crc kubenswrapper[5120]: I0316 16:19:26.661118 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-dbtb9" event={"ID":"9a988117-7627-4f34-9b78-50a8e13adfa6","Type":"ContainerStarted","Data":"d1068688111b9480c9347036937b7eb0ed6498168d908f452aaaae98d2e71457"} Mar 16 16:19:26 crc kubenswrapper[5120]: I0316 16:19:26.682545 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b4bd3f33-8a10-42ad-8d8a-7463d215021f" path="/var/lib/kubelet/pods/b4bd3f33-8a10-42ad-8d8a-7463d215021f/volumes" Mar 16 16:19:27 crc kubenswrapper[5120]: I0316 16:19:27.676851 5120 generic.go:358] "Generic (PLEG): container finished" podID="9a988117-7627-4f34-9b78-50a8e13adfa6" containerID="ef555b565781b0ed51d1e10c66b7f4ccdd9c617065f94ffb19a56c298e670055" exitCode=0 Mar 16 16:19:27 crc kubenswrapper[5120]: I0316 16:19:27.677035 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-dbtb9" event={"ID":"9a988117-7627-4f34-9b78-50a8e13adfa6","Type":"ContainerDied","Data":"ef555b565781b0ed51d1e10c66b7f4ccdd9c617065f94ffb19a56c298e670055"} Mar 16 16:19:27 crc kubenswrapper[5120]: I0316 16:19:27.911918 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/certified-operators-6szgv" Mar 16 16:19:27 crc kubenswrapper[5120]: I0316 16:19:27.911981 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-marketplace/certified-operators-6szgv" Mar 16 16:19:27 crc kubenswrapper[5120]: I0316 16:19:27.970610 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/certified-operators-6szgv" Mar 16 16:19:28 crc kubenswrapper[5120]: I0316 16:19:28.107006 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-marketplace/redhat-marketplace-8zjm9" Mar 16 16:19:28 crc kubenswrapper[5120]: I0316 16:19:28.107407 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-marketplace-8zjm9" Mar 16 16:19:28 crc kubenswrapper[5120]: I0316 16:19:28.178287 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-marketplace-8zjm9" Mar 16 16:19:28 crc kubenswrapper[5120]: I0316 16:19:28.769913 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-marketplace-8zjm9" Mar 16 16:19:28 crc kubenswrapper[5120]: I0316 16:19:28.770014 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/certified-operators-6szgv" Mar 16 16:19:29 crc kubenswrapper[5120]: I0316 16:19:29.135636 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-dbtb9" Mar 16 16:19:29 crc kubenswrapper[5120]: I0316 16:19:29.167433 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9zdc7\" (UniqueName: \"kubernetes.io/projected/9a988117-7627-4f34-9b78-50a8e13adfa6-kube-api-access-9zdc7\") pod \"9a988117-7627-4f34-9b78-50a8e13adfa6\" (UID: \"9a988117-7627-4f34-9b78-50a8e13adfa6\") " Mar 16 16:19:29 crc kubenswrapper[5120]: I0316 16:19:29.168003 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/9a988117-7627-4f34-9b78-50a8e13adfa6-crc-storage\") pod \"9a988117-7627-4f34-9b78-50a8e13adfa6\" (UID: \"9a988117-7627-4f34-9b78-50a8e13adfa6\") " Mar 16 16:19:29 crc kubenswrapper[5120]: I0316 16:19:29.168086 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/9a988117-7627-4f34-9b78-50a8e13adfa6-node-mnt\") pod \"9a988117-7627-4f34-9b78-50a8e13adfa6\" (UID: \"9a988117-7627-4f34-9b78-50a8e13adfa6\") " Mar 16 16:19:29 crc kubenswrapper[5120]: I0316 16:19:29.168324 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/9a988117-7627-4f34-9b78-50a8e13adfa6-node-mnt" (OuterVolumeSpecName: "node-mnt") pod "9a988117-7627-4f34-9b78-50a8e13adfa6" (UID: "9a988117-7627-4f34-9b78-50a8e13adfa6"). InnerVolumeSpecName "node-mnt". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 16:19:29 crc kubenswrapper[5120]: I0316 16:19:29.169077 5120 reconciler_common.go:299] "Volume detached for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/9a988117-7627-4f34-9b78-50a8e13adfa6-node-mnt\") on node \"crc\" DevicePath \"\"" Mar 16 16:19:29 crc kubenswrapper[5120]: I0316 16:19:29.181025 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a988117-7627-4f34-9b78-50a8e13adfa6-kube-api-access-9zdc7" (OuterVolumeSpecName: "kube-api-access-9zdc7") pod "9a988117-7627-4f34-9b78-50a8e13adfa6" (UID: "9a988117-7627-4f34-9b78-50a8e13adfa6"). InnerVolumeSpecName "kube-api-access-9zdc7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:19:29 crc kubenswrapper[5120]: I0316 16:19:29.190514 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a988117-7627-4f34-9b78-50a8e13adfa6-crc-storage" (OuterVolumeSpecName: "crc-storage") pod "9a988117-7627-4f34-9b78-50a8e13adfa6" (UID: "9a988117-7627-4f34-9b78-50a8e13adfa6"). InnerVolumeSpecName "crc-storage". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:19:29 crc kubenswrapper[5120]: I0316 16:19:29.270558 5120 reconciler_common.go:299] "Volume detached for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/9a988117-7627-4f34-9b78-50a8e13adfa6-crc-storage\") on node \"crc\" DevicePath \"\"" Mar 16 16:19:29 crc kubenswrapper[5120]: I0316 16:19:29.270598 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9zdc7\" (UniqueName: \"kubernetes.io/projected/9a988117-7627-4f34-9b78-50a8e13adfa6-kube-api-access-9zdc7\") on node \"crc\" DevicePath \"\"" Mar 16 16:19:29 crc kubenswrapper[5120]: I0316 16:19:29.704960 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-dbtb9" Mar 16 16:19:29 crc kubenswrapper[5120]: I0316 16:19:29.704961 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-dbtb9" event={"ID":"9a988117-7627-4f34-9b78-50a8e13adfa6","Type":"ContainerDied","Data":"d1068688111b9480c9347036937b7eb0ed6498168d908f452aaaae98d2e71457"} Mar 16 16:19:29 crc kubenswrapper[5120]: I0316 16:19:29.705151 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d1068688111b9480c9347036937b7eb0ed6498168d908f452aaaae98d2e71457" Mar 16 16:19:30 crc kubenswrapper[5120]: I0316 16:19:30.549644 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-marketplace-8zjm9"] Mar 16 16:19:30 crc kubenswrapper[5120]: I0316 16:19:30.716945 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-marketplace/redhat-marketplace-8zjm9" podUID="4b1f9465-a9b2-4cca-81c5-cf7fec00619a" containerName="registry-server" containerID="cri-o://c6c855b5a020dbbe4f8e739870bd0e3a62429785722fa4fab53be53b74829ad4" gracePeriod=2 Mar 16 16:19:31 crc kubenswrapper[5120]: I0316 16:19:31.141460 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/certified-operators-6szgv"] Mar 16 16:19:31 crc kubenswrapper[5120]: I0316 16:19:31.142056 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-marketplace/certified-operators-6szgv" podUID="ca886aad-948e-4ab5-839e-7a09f19d7713" containerName="registry-server" containerID="cri-o://a71f9fad289bf88bd132eeef7021c729909d224026a882fc978ee9df119b2a7e" gracePeriod=2 Mar 16 16:19:31 crc kubenswrapper[5120]: I0316 16:19:31.356023 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-8zjm9" Mar 16 16:19:31 crc kubenswrapper[5120]: I0316 16:19:31.419272 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/4b1f9465-a9b2-4cca-81c5-cf7fec00619a-utilities\") pod \"4b1f9465-a9b2-4cca-81c5-cf7fec00619a\" (UID: \"4b1f9465-a9b2-4cca-81c5-cf7fec00619a\") " Mar 16 16:19:31 crc kubenswrapper[5120]: I0316 16:19:31.419351 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/4b1f9465-a9b2-4cca-81c5-cf7fec00619a-catalog-content\") pod \"4b1f9465-a9b2-4cca-81c5-cf7fec00619a\" (UID: \"4b1f9465-a9b2-4cca-81c5-cf7fec00619a\") " Mar 16 16:19:31 crc kubenswrapper[5120]: I0316 16:19:31.419414 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5f6st\" (UniqueName: \"kubernetes.io/projected/4b1f9465-a9b2-4cca-81c5-cf7fec00619a-kube-api-access-5f6st\") pod \"4b1f9465-a9b2-4cca-81c5-cf7fec00619a\" (UID: \"4b1f9465-a9b2-4cca-81c5-cf7fec00619a\") " Mar 16 16:19:31 crc kubenswrapper[5120]: I0316 16:19:31.421060 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b1f9465-a9b2-4cca-81c5-cf7fec00619a-utilities" (OuterVolumeSpecName: "utilities") pod "4b1f9465-a9b2-4cca-81c5-cf7fec00619a" (UID: "4b1f9465-a9b2-4cca-81c5-cf7fec00619a"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:19:31 crc kubenswrapper[5120]: I0316 16:19:31.431350 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b1f9465-a9b2-4cca-81c5-cf7fec00619a-kube-api-access-5f6st" (OuterVolumeSpecName: "kube-api-access-5f6st") pod "4b1f9465-a9b2-4cca-81c5-cf7fec00619a" (UID: "4b1f9465-a9b2-4cca-81c5-cf7fec00619a"). InnerVolumeSpecName "kube-api-access-5f6st". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:19:31 crc kubenswrapper[5120]: I0316 16:19:31.455881 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b1f9465-a9b2-4cca-81c5-cf7fec00619a-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "4b1f9465-a9b2-4cca-81c5-cf7fec00619a" (UID: "4b1f9465-a9b2-4cca-81c5-cf7fec00619a"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:19:31 crc kubenswrapper[5120]: I0316 16:19:31.497240 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-6szgv" Mar 16 16:19:31 crc kubenswrapper[5120]: I0316 16:19:31.521729 5120 reconciler_common.go:299] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/4b1f9465-a9b2-4cca-81c5-cf7fec00619a-utilities\") on node \"crc\" DevicePath \"\"" Mar 16 16:19:31 crc kubenswrapper[5120]: I0316 16:19:31.521804 5120 reconciler_common.go:299] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/4b1f9465-a9b2-4cca-81c5-cf7fec00619a-catalog-content\") on node \"crc\" DevicePath \"\"" Mar 16 16:19:31 crc kubenswrapper[5120]: I0316 16:19:31.521828 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5f6st\" (UniqueName: \"kubernetes.io/projected/4b1f9465-a9b2-4cca-81c5-cf7fec00619a-kube-api-access-5f6st\") on node \"crc\" DevicePath \"\"" Mar 16 16:19:31 crc kubenswrapper[5120]: I0316 16:19:31.623130 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/ca886aad-948e-4ab5-839e-7a09f19d7713-utilities\") pod \"ca886aad-948e-4ab5-839e-7a09f19d7713\" (UID: \"ca886aad-948e-4ab5-839e-7a09f19d7713\") " Mar 16 16:19:31 crc kubenswrapper[5120]: I0316 16:19:31.623283 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wj4dn\" (UniqueName: \"kubernetes.io/projected/ca886aad-948e-4ab5-839e-7a09f19d7713-kube-api-access-wj4dn\") pod \"ca886aad-948e-4ab5-839e-7a09f19d7713\" (UID: \"ca886aad-948e-4ab5-839e-7a09f19d7713\") " Mar 16 16:19:31 crc kubenswrapper[5120]: I0316 16:19:31.623487 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/ca886aad-948e-4ab5-839e-7a09f19d7713-catalog-content\") pod \"ca886aad-948e-4ab5-839e-7a09f19d7713\" (UID: \"ca886aad-948e-4ab5-839e-7a09f19d7713\") " Mar 16 16:19:31 crc kubenswrapper[5120]: I0316 16:19:31.624278 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca886aad-948e-4ab5-839e-7a09f19d7713-utilities" (OuterVolumeSpecName: "utilities") pod "ca886aad-948e-4ab5-839e-7a09f19d7713" (UID: "ca886aad-948e-4ab5-839e-7a09f19d7713"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:19:31 crc kubenswrapper[5120]: I0316 16:19:31.628228 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca886aad-948e-4ab5-839e-7a09f19d7713-kube-api-access-wj4dn" (OuterVolumeSpecName: "kube-api-access-wj4dn") pod "ca886aad-948e-4ab5-839e-7a09f19d7713" (UID: "ca886aad-948e-4ab5-839e-7a09f19d7713"). InnerVolumeSpecName "kube-api-access-wj4dn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:19:31 crc kubenswrapper[5120]: I0316 16:19:31.671034 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca886aad-948e-4ab5-839e-7a09f19d7713-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "ca886aad-948e-4ab5-839e-7a09f19d7713" (UID: "ca886aad-948e-4ab5-839e-7a09f19d7713"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:19:31 crc kubenswrapper[5120]: I0316 16:19:31.726777 5120 reconciler_common.go:299] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/ca886aad-948e-4ab5-839e-7a09f19d7713-utilities\") on node \"crc\" DevicePath \"\"" Mar 16 16:19:31 crc kubenswrapper[5120]: I0316 16:19:31.726845 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wj4dn\" (UniqueName: \"kubernetes.io/projected/ca886aad-948e-4ab5-839e-7a09f19d7713-kube-api-access-wj4dn\") on node \"crc\" DevicePath \"\"" Mar 16 16:19:31 crc kubenswrapper[5120]: I0316 16:19:31.726862 5120 reconciler_common.go:299] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/ca886aad-948e-4ab5-839e-7a09f19d7713-catalog-content\") on node \"crc\" DevicePath \"\"" Mar 16 16:19:31 crc kubenswrapper[5120]: I0316 16:19:31.732722 5120 generic.go:358] "Generic (PLEG): container finished" podID="ca886aad-948e-4ab5-839e-7a09f19d7713" containerID="a71f9fad289bf88bd132eeef7021c729909d224026a882fc978ee9df119b2a7e" exitCode=0 Mar 16 16:19:31 crc kubenswrapper[5120]: I0316 16:19:31.732820 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-6szgv" event={"ID":"ca886aad-948e-4ab5-839e-7a09f19d7713","Type":"ContainerDied","Data":"a71f9fad289bf88bd132eeef7021c729909d224026a882fc978ee9df119b2a7e"} Mar 16 16:19:31 crc kubenswrapper[5120]: I0316 16:19:31.732889 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-6szgv" Mar 16 16:19:31 crc kubenswrapper[5120]: I0316 16:19:31.732904 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-6szgv" event={"ID":"ca886aad-948e-4ab5-839e-7a09f19d7713","Type":"ContainerDied","Data":"ae92ed049b89f99e0e4c2fe8203439e59c3f62afa4312c4f49656cb11808700d"} Mar 16 16:19:31 crc kubenswrapper[5120]: I0316 16:19:31.732926 5120 scope.go:117] "RemoveContainer" containerID="a71f9fad289bf88bd132eeef7021c729909d224026a882fc978ee9df119b2a7e" Mar 16 16:19:31 crc kubenswrapper[5120]: I0316 16:19:31.738147 5120 generic.go:358] "Generic (PLEG): container finished" podID="4b1f9465-a9b2-4cca-81c5-cf7fec00619a" containerID="c6c855b5a020dbbe4f8e739870bd0e3a62429785722fa4fab53be53b74829ad4" exitCode=0 Mar 16 16:19:31 crc kubenswrapper[5120]: I0316 16:19:31.738261 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-8zjm9" event={"ID":"4b1f9465-a9b2-4cca-81c5-cf7fec00619a","Type":"ContainerDied","Data":"c6c855b5a020dbbe4f8e739870bd0e3a62429785722fa4fab53be53b74829ad4"} Mar 16 16:19:31 crc kubenswrapper[5120]: I0316 16:19:31.738331 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-8zjm9" Mar 16 16:19:31 crc kubenswrapper[5120]: I0316 16:19:31.738345 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-8zjm9" event={"ID":"4b1f9465-a9b2-4cca-81c5-cf7fec00619a","Type":"ContainerDied","Data":"280206c420a62e1430d25bfd795b51005cba090492822f59aea35da1235aa100"} Mar 16 16:19:31 crc kubenswrapper[5120]: I0316 16:19:31.764003 5120 scope.go:117] "RemoveContainer" containerID="9df53a9b594f2b5389f4caec395683abc55565aa3d186ed568e9aaa6aaca0a29" Mar 16 16:19:31 crc kubenswrapper[5120]: I0316 16:19:31.791612 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/certified-operators-6szgv"] Mar 16 16:19:31 crc kubenswrapper[5120]: I0316 16:19:31.809258 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/certified-operators-6szgv"] Mar 16 16:19:31 crc kubenswrapper[5120]: I0316 16:19:31.816263 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-marketplace-8zjm9"] Mar 16 16:19:31 crc kubenswrapper[5120]: I0316 16:19:31.816590 5120 scope.go:117] "RemoveContainer" containerID="c1a6a7cd8dea15783cc462db6ee69614c21761750cf6c401e06d8d64ffbaafcc" Mar 16 16:19:31 crc kubenswrapper[5120]: I0316 16:19:31.822699 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/redhat-marketplace-8zjm9"] Mar 16 16:19:31 crc kubenswrapper[5120]: I0316 16:19:31.882945 5120 scope.go:117] "RemoveContainer" containerID="a71f9fad289bf88bd132eeef7021c729909d224026a882fc978ee9df119b2a7e" Mar 16 16:19:31 crc kubenswrapper[5120]: E0316 16:19:31.883470 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a71f9fad289bf88bd132eeef7021c729909d224026a882fc978ee9df119b2a7e\": container with ID starting with a71f9fad289bf88bd132eeef7021c729909d224026a882fc978ee9df119b2a7e not found: ID does not exist" containerID="a71f9fad289bf88bd132eeef7021c729909d224026a882fc978ee9df119b2a7e" Mar 16 16:19:31 crc kubenswrapper[5120]: I0316 16:19:31.883519 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a71f9fad289bf88bd132eeef7021c729909d224026a882fc978ee9df119b2a7e"} err="failed to get container status \"a71f9fad289bf88bd132eeef7021c729909d224026a882fc978ee9df119b2a7e\": rpc error: code = NotFound desc = could not find container \"a71f9fad289bf88bd132eeef7021c729909d224026a882fc978ee9df119b2a7e\": container with ID starting with a71f9fad289bf88bd132eeef7021c729909d224026a882fc978ee9df119b2a7e not found: ID does not exist" Mar 16 16:19:31 crc kubenswrapper[5120]: I0316 16:19:31.883548 5120 scope.go:117] "RemoveContainer" containerID="9df53a9b594f2b5389f4caec395683abc55565aa3d186ed568e9aaa6aaca0a29" Mar 16 16:19:31 crc kubenswrapper[5120]: E0316 16:19:31.884018 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9df53a9b594f2b5389f4caec395683abc55565aa3d186ed568e9aaa6aaca0a29\": container with ID starting with 9df53a9b594f2b5389f4caec395683abc55565aa3d186ed568e9aaa6aaca0a29 not found: ID does not exist" containerID="9df53a9b594f2b5389f4caec395683abc55565aa3d186ed568e9aaa6aaca0a29" Mar 16 16:19:31 crc kubenswrapper[5120]: I0316 16:19:31.884063 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9df53a9b594f2b5389f4caec395683abc55565aa3d186ed568e9aaa6aaca0a29"} err="failed to get container status \"9df53a9b594f2b5389f4caec395683abc55565aa3d186ed568e9aaa6aaca0a29\": rpc error: code = NotFound desc = could not find container \"9df53a9b594f2b5389f4caec395683abc55565aa3d186ed568e9aaa6aaca0a29\": container with ID starting with 9df53a9b594f2b5389f4caec395683abc55565aa3d186ed568e9aaa6aaca0a29 not found: ID does not exist" Mar 16 16:19:31 crc kubenswrapper[5120]: I0316 16:19:31.884092 5120 scope.go:117] "RemoveContainer" containerID="c1a6a7cd8dea15783cc462db6ee69614c21761750cf6c401e06d8d64ffbaafcc" Mar 16 16:19:31 crc kubenswrapper[5120]: E0316 16:19:31.884647 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c1a6a7cd8dea15783cc462db6ee69614c21761750cf6c401e06d8d64ffbaafcc\": container with ID starting with c1a6a7cd8dea15783cc462db6ee69614c21761750cf6c401e06d8d64ffbaafcc not found: ID does not exist" containerID="c1a6a7cd8dea15783cc462db6ee69614c21761750cf6c401e06d8d64ffbaafcc" Mar 16 16:19:31 crc kubenswrapper[5120]: I0316 16:19:31.884678 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1a6a7cd8dea15783cc462db6ee69614c21761750cf6c401e06d8d64ffbaafcc"} err="failed to get container status \"c1a6a7cd8dea15783cc462db6ee69614c21761750cf6c401e06d8d64ffbaafcc\": rpc error: code = NotFound desc = could not find container \"c1a6a7cd8dea15783cc462db6ee69614c21761750cf6c401e06d8d64ffbaafcc\": container with ID starting with c1a6a7cd8dea15783cc462db6ee69614c21761750cf6c401e06d8d64ffbaafcc not found: ID does not exist" Mar 16 16:19:31 crc kubenswrapper[5120]: I0316 16:19:31.884713 5120 scope.go:117] "RemoveContainer" containerID="c6c855b5a020dbbe4f8e739870bd0e3a62429785722fa4fab53be53b74829ad4" Mar 16 16:19:31 crc kubenswrapper[5120]: I0316 16:19:31.920297 5120 scope.go:117] "RemoveContainer" containerID="b002f8b79d45c11eca7957aff993c39ca141f2fd3ef226a99111d31e924f6179" Mar 16 16:19:31 crc kubenswrapper[5120]: I0316 16:19:31.960140 5120 scope.go:117] "RemoveContainer" containerID="befa310c2047884e8301ef4976457257ea3c17343bada853d87b0a352e843c20" Mar 16 16:19:31 crc kubenswrapper[5120]: I0316 16:19:31.983947 5120 scope.go:117] "RemoveContainer" containerID="c6c855b5a020dbbe4f8e739870bd0e3a62429785722fa4fab53be53b74829ad4" Mar 16 16:19:31 crc kubenswrapper[5120]: E0316 16:19:31.984464 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c6c855b5a020dbbe4f8e739870bd0e3a62429785722fa4fab53be53b74829ad4\": container with ID starting with c6c855b5a020dbbe4f8e739870bd0e3a62429785722fa4fab53be53b74829ad4 not found: ID does not exist" containerID="c6c855b5a020dbbe4f8e739870bd0e3a62429785722fa4fab53be53b74829ad4" Mar 16 16:19:31 crc kubenswrapper[5120]: I0316 16:19:31.984555 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6c855b5a020dbbe4f8e739870bd0e3a62429785722fa4fab53be53b74829ad4"} err="failed to get container status \"c6c855b5a020dbbe4f8e739870bd0e3a62429785722fa4fab53be53b74829ad4\": rpc error: code = NotFound desc = could not find container \"c6c855b5a020dbbe4f8e739870bd0e3a62429785722fa4fab53be53b74829ad4\": container with ID starting with c6c855b5a020dbbe4f8e739870bd0e3a62429785722fa4fab53be53b74829ad4 not found: ID does not exist" Mar 16 16:19:31 crc kubenswrapper[5120]: I0316 16:19:31.984606 5120 scope.go:117] "RemoveContainer" containerID="b002f8b79d45c11eca7957aff993c39ca141f2fd3ef226a99111d31e924f6179" Mar 16 16:19:31 crc kubenswrapper[5120]: E0316 16:19:31.985163 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b002f8b79d45c11eca7957aff993c39ca141f2fd3ef226a99111d31e924f6179\": container with ID starting with b002f8b79d45c11eca7957aff993c39ca141f2fd3ef226a99111d31e924f6179 not found: ID does not exist" containerID="b002f8b79d45c11eca7957aff993c39ca141f2fd3ef226a99111d31e924f6179" Mar 16 16:19:31 crc kubenswrapper[5120]: I0316 16:19:31.985305 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b002f8b79d45c11eca7957aff993c39ca141f2fd3ef226a99111d31e924f6179"} err="failed to get container status \"b002f8b79d45c11eca7957aff993c39ca141f2fd3ef226a99111d31e924f6179\": rpc error: code = NotFound desc = could not find container \"b002f8b79d45c11eca7957aff993c39ca141f2fd3ef226a99111d31e924f6179\": container with ID starting with b002f8b79d45c11eca7957aff993c39ca141f2fd3ef226a99111d31e924f6179 not found: ID does not exist" Mar 16 16:19:31 crc kubenswrapper[5120]: I0316 16:19:31.985360 5120 scope.go:117] "RemoveContainer" containerID="befa310c2047884e8301ef4976457257ea3c17343bada853d87b0a352e843c20" Mar 16 16:19:31 crc kubenswrapper[5120]: E0316 16:19:31.985862 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"befa310c2047884e8301ef4976457257ea3c17343bada853d87b0a352e843c20\": container with ID starting with befa310c2047884e8301ef4976457257ea3c17343bada853d87b0a352e843c20 not found: ID does not exist" containerID="befa310c2047884e8301ef4976457257ea3c17343bada853d87b0a352e843c20" Mar 16 16:19:31 crc kubenswrapper[5120]: I0316 16:19:31.985904 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"befa310c2047884e8301ef4976457257ea3c17343bada853d87b0a352e843c20"} err="failed to get container status \"befa310c2047884e8301ef4976457257ea3c17343bada853d87b0a352e843c20\": rpc error: code = NotFound desc = could not find container \"befa310c2047884e8301ef4976457257ea3c17343bada853d87b0a352e843c20\": container with ID starting with befa310c2047884e8301ef4976457257ea3c17343bada853d87b0a352e843c20 not found: ID does not exist" Mar 16 16:19:32 crc kubenswrapper[5120]: I0316 16:19:32.675184 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b1f9465-a9b2-4cca-81c5-cf7fec00619a" path="/var/lib/kubelet/pods/4b1f9465-a9b2-4cca-81c5-cf7fec00619a/volumes" Mar 16 16:19:32 crc kubenswrapper[5120]: I0316 16:19:32.675845 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca886aad-948e-4ab5-839e-7a09f19d7713" path="/var/lib/kubelet/pods/ca886aad-948e-4ab5-839e-7a09f19d7713/volumes" Mar 16 16:19:38 crc kubenswrapper[5120]: I0316 16:19:38.596709 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/98629960b44b381d1a86cff1d1439a8df43509c9ad24579158c59d0f08lwstg"] Mar 16 16:19:38 crc kubenswrapper[5120]: I0316 16:19:38.598362 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca886aad-948e-4ab5-839e-7a09f19d7713" containerName="extract-content" Mar 16 16:19:38 crc kubenswrapper[5120]: I0316 16:19:38.598388 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca886aad-948e-4ab5-839e-7a09f19d7713" containerName="extract-content" Mar 16 16:19:38 crc kubenswrapper[5120]: I0316 16:19:38.598407 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca886aad-948e-4ab5-839e-7a09f19d7713" containerName="registry-server" Mar 16 16:19:38 crc kubenswrapper[5120]: I0316 16:19:38.598413 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca886aad-948e-4ab5-839e-7a09f19d7713" containerName="registry-server" Mar 16 16:19:38 crc kubenswrapper[5120]: I0316 16:19:38.598443 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b1f9465-a9b2-4cca-81c5-cf7fec00619a" containerName="registry-server" Mar 16 16:19:38 crc kubenswrapper[5120]: I0316 16:19:38.598450 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b1f9465-a9b2-4cca-81c5-cf7fec00619a" containerName="registry-server" Mar 16 16:19:38 crc kubenswrapper[5120]: I0316 16:19:38.598472 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a988117-7627-4f34-9b78-50a8e13adfa6" containerName="storage" Mar 16 16:19:38 crc kubenswrapper[5120]: I0316 16:19:38.598479 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a988117-7627-4f34-9b78-50a8e13adfa6" containerName="storage" Mar 16 16:19:38 crc kubenswrapper[5120]: I0316 16:19:38.598500 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b1f9465-a9b2-4cca-81c5-cf7fec00619a" containerName="extract-content" Mar 16 16:19:38 crc kubenswrapper[5120]: I0316 16:19:38.598507 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b1f9465-a9b2-4cca-81c5-cf7fec00619a" containerName="extract-content" Mar 16 16:19:38 crc kubenswrapper[5120]: I0316 16:19:38.598516 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b1f9465-a9b2-4cca-81c5-cf7fec00619a" containerName="extract-utilities" Mar 16 16:19:38 crc kubenswrapper[5120]: I0316 16:19:38.598523 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b1f9465-a9b2-4cca-81c5-cf7fec00619a" containerName="extract-utilities" Mar 16 16:19:38 crc kubenswrapper[5120]: I0316 16:19:38.598541 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca886aad-948e-4ab5-839e-7a09f19d7713" containerName="extract-utilities" Mar 16 16:19:38 crc kubenswrapper[5120]: I0316 16:19:38.598548 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca886aad-948e-4ab5-839e-7a09f19d7713" containerName="extract-utilities" Mar 16 16:19:38 crc kubenswrapper[5120]: I0316 16:19:38.598695 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="9a988117-7627-4f34-9b78-50a8e13adfa6" containerName="storage" Mar 16 16:19:38 crc kubenswrapper[5120]: I0316 16:19:38.598713 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="4b1f9465-a9b2-4cca-81c5-cf7fec00619a" containerName="registry-server" Mar 16 16:19:38 crc kubenswrapper[5120]: I0316 16:19:38.598726 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ca886aad-948e-4ab5-839e-7a09f19d7713" containerName="registry-server" Mar 16 16:19:38 crc kubenswrapper[5120]: I0316 16:19:38.608431 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/98629960b44b381d1a86cff1d1439a8df43509c9ad24579158c59d0f08lwstg" Mar 16 16:19:38 crc kubenswrapper[5120]: I0316 16:19:38.613818 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-b2ccr\"" Mar 16 16:19:38 crc kubenswrapper[5120]: I0316 16:19:38.616319 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/98629960b44b381d1a86cff1d1439a8df43509c9ad24579158c59d0f08lwstg"] Mar 16 16:19:38 crc kubenswrapper[5120]: I0316 16:19:38.676957 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjzzh\" (UniqueName: \"kubernetes.io/projected/04363a62-e592-457c-ac4a-48bb6c942c9a-kube-api-access-kjzzh\") pod \"98629960b44b381d1a86cff1d1439a8df43509c9ad24579158c59d0f08lwstg\" (UID: \"04363a62-e592-457c-ac4a-48bb6c942c9a\") " pod="openshift-marketplace/98629960b44b381d1a86cff1d1439a8df43509c9ad24579158c59d0f08lwstg" Mar 16 16:19:38 crc kubenswrapper[5120]: I0316 16:19:38.677152 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/04363a62-e592-457c-ac4a-48bb6c942c9a-util\") pod \"98629960b44b381d1a86cff1d1439a8df43509c9ad24579158c59d0f08lwstg\" (UID: \"04363a62-e592-457c-ac4a-48bb6c942c9a\") " pod="openshift-marketplace/98629960b44b381d1a86cff1d1439a8df43509c9ad24579158c59d0f08lwstg" Mar 16 16:19:38 crc kubenswrapper[5120]: I0316 16:19:38.677249 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/04363a62-e592-457c-ac4a-48bb6c942c9a-bundle\") pod \"98629960b44b381d1a86cff1d1439a8df43509c9ad24579158c59d0f08lwstg\" (UID: \"04363a62-e592-457c-ac4a-48bb6c942c9a\") " pod="openshift-marketplace/98629960b44b381d1a86cff1d1439a8df43509c9ad24579158c59d0f08lwstg" Mar 16 16:19:38 crc kubenswrapper[5120]: I0316 16:19:38.779016 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kjzzh\" (UniqueName: \"kubernetes.io/projected/04363a62-e592-457c-ac4a-48bb6c942c9a-kube-api-access-kjzzh\") pod \"98629960b44b381d1a86cff1d1439a8df43509c9ad24579158c59d0f08lwstg\" (UID: \"04363a62-e592-457c-ac4a-48bb6c942c9a\") " pod="openshift-marketplace/98629960b44b381d1a86cff1d1439a8df43509c9ad24579158c59d0f08lwstg" Mar 16 16:19:38 crc kubenswrapper[5120]: I0316 16:19:38.779141 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/04363a62-e592-457c-ac4a-48bb6c942c9a-util\") pod \"98629960b44b381d1a86cff1d1439a8df43509c9ad24579158c59d0f08lwstg\" (UID: \"04363a62-e592-457c-ac4a-48bb6c942c9a\") " pod="openshift-marketplace/98629960b44b381d1a86cff1d1439a8df43509c9ad24579158c59d0f08lwstg" Mar 16 16:19:38 crc kubenswrapper[5120]: I0316 16:19:38.779218 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/04363a62-e592-457c-ac4a-48bb6c942c9a-bundle\") pod \"98629960b44b381d1a86cff1d1439a8df43509c9ad24579158c59d0f08lwstg\" (UID: \"04363a62-e592-457c-ac4a-48bb6c942c9a\") " pod="openshift-marketplace/98629960b44b381d1a86cff1d1439a8df43509c9ad24579158c59d0f08lwstg" Mar 16 16:19:38 crc kubenswrapper[5120]: I0316 16:19:38.779590 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/04363a62-e592-457c-ac4a-48bb6c942c9a-util\") pod \"98629960b44b381d1a86cff1d1439a8df43509c9ad24579158c59d0f08lwstg\" (UID: \"04363a62-e592-457c-ac4a-48bb6c942c9a\") " pod="openshift-marketplace/98629960b44b381d1a86cff1d1439a8df43509c9ad24579158c59d0f08lwstg" Mar 16 16:19:38 crc kubenswrapper[5120]: I0316 16:19:38.780020 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/04363a62-e592-457c-ac4a-48bb6c942c9a-bundle\") pod \"98629960b44b381d1a86cff1d1439a8df43509c9ad24579158c59d0f08lwstg\" (UID: \"04363a62-e592-457c-ac4a-48bb6c942c9a\") " pod="openshift-marketplace/98629960b44b381d1a86cff1d1439a8df43509c9ad24579158c59d0f08lwstg" Mar 16 16:19:38 crc kubenswrapper[5120]: I0316 16:19:38.798571 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjzzh\" (UniqueName: \"kubernetes.io/projected/04363a62-e592-457c-ac4a-48bb6c942c9a-kube-api-access-kjzzh\") pod \"98629960b44b381d1a86cff1d1439a8df43509c9ad24579158c59d0f08lwstg\" (UID: \"04363a62-e592-457c-ac4a-48bb6c942c9a\") " pod="openshift-marketplace/98629960b44b381d1a86cff1d1439a8df43509c9ad24579158c59d0f08lwstg" Mar 16 16:19:38 crc kubenswrapper[5120]: I0316 16:19:38.941235 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/98629960b44b381d1a86cff1d1439a8df43509c9ad24579158c59d0f08lwstg" Mar 16 16:19:39 crc kubenswrapper[5120]: I0316 16:19:39.398737 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/98629960b44b381d1a86cff1d1439a8df43509c9ad24579158c59d0f08lwstg"] Mar 16 16:19:39 crc kubenswrapper[5120]: I0316 16:19:39.844004 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/98629960b44b381d1a86cff1d1439a8df43509c9ad24579158c59d0f08lwstg" event={"ID":"04363a62-e592-457c-ac4a-48bb6c942c9a","Type":"ContainerStarted","Data":"c700d3063688035bf6bbcd2473da711c70b54e42c393b7a8b6a0557f229e7af9"} Mar 16 16:19:39 crc kubenswrapper[5120]: I0316 16:19:39.844079 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/98629960b44b381d1a86cff1d1439a8df43509c9ad24579158c59d0f08lwstg" event={"ID":"04363a62-e592-457c-ac4a-48bb6c942c9a","Type":"ContainerStarted","Data":"c08eb6219a25bf91a04acc437874f1519dd44ea18628f1a3222697fb661d2d1f"} Mar 16 16:19:40 crc kubenswrapper[5120]: I0316 16:19:40.854554 5120 generic.go:358] "Generic (PLEG): container finished" podID="04363a62-e592-457c-ac4a-48bb6c942c9a" containerID="c700d3063688035bf6bbcd2473da711c70b54e42c393b7a8b6a0557f229e7af9" exitCode=0 Mar 16 16:19:40 crc kubenswrapper[5120]: I0316 16:19:40.854673 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/98629960b44b381d1a86cff1d1439a8df43509c9ad24579158c59d0f08lwstg" event={"ID":"04363a62-e592-457c-ac4a-48bb6c942c9a","Type":"ContainerDied","Data":"c700d3063688035bf6bbcd2473da711c70b54e42c393b7a8b6a0557f229e7af9"} Mar 16 16:19:42 crc kubenswrapper[5120]: I0316 16:19:42.884883 5120 generic.go:358] "Generic (PLEG): container finished" podID="04363a62-e592-457c-ac4a-48bb6c942c9a" containerID="99fa5373d059be2dc26b4e4fcd8b0bf8f38de7a7cd9ef87f002d5bada8ecb775" exitCode=0 Mar 16 16:19:42 crc kubenswrapper[5120]: I0316 16:19:42.885021 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/98629960b44b381d1a86cff1d1439a8df43509c9ad24579158c59d0f08lwstg" event={"ID":"04363a62-e592-457c-ac4a-48bb6c942c9a","Type":"ContainerDied","Data":"99fa5373d059be2dc26b4e4fcd8b0bf8f38de7a7cd9ef87f002d5bada8ecb775"} Mar 16 16:19:43 crc kubenswrapper[5120]: I0316 16:19:43.907790 5120 generic.go:358] "Generic (PLEG): container finished" podID="04363a62-e592-457c-ac4a-48bb6c942c9a" containerID="ca0b2cba08b3cc3b33e973ae29f85d004bf945b22a0f5efa67d7d1d08318fe9e" exitCode=0 Mar 16 16:19:43 crc kubenswrapper[5120]: I0316 16:19:43.907891 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/98629960b44b381d1a86cff1d1439a8df43509c9ad24579158c59d0f08lwstg" event={"ID":"04363a62-e592-457c-ac4a-48bb6c942c9a","Type":"ContainerDied","Data":"ca0b2cba08b3cc3b33e973ae29f85d004bf945b22a0f5efa67d7d1d08318fe9e"} Mar 16 16:19:45 crc kubenswrapper[5120]: I0316 16:19:45.241723 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/98629960b44b381d1a86cff1d1439a8df43509c9ad24579158c59d0f08lwstg" Mar 16 16:19:45 crc kubenswrapper[5120]: I0316 16:19:45.320386 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/04363a62-e592-457c-ac4a-48bb6c942c9a-util\") pod \"04363a62-e592-457c-ac4a-48bb6c942c9a\" (UID: \"04363a62-e592-457c-ac4a-48bb6c942c9a\") " Mar 16 16:19:45 crc kubenswrapper[5120]: I0316 16:19:45.320580 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kjzzh\" (UniqueName: \"kubernetes.io/projected/04363a62-e592-457c-ac4a-48bb6c942c9a-kube-api-access-kjzzh\") pod \"04363a62-e592-457c-ac4a-48bb6c942c9a\" (UID: \"04363a62-e592-457c-ac4a-48bb6c942c9a\") " Mar 16 16:19:45 crc kubenswrapper[5120]: I0316 16:19:45.320692 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/04363a62-e592-457c-ac4a-48bb6c942c9a-bundle\") pod \"04363a62-e592-457c-ac4a-48bb6c942c9a\" (UID: \"04363a62-e592-457c-ac4a-48bb6c942c9a\") " Mar 16 16:19:45 crc kubenswrapper[5120]: I0316 16:19:45.326744 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04363a62-e592-457c-ac4a-48bb6c942c9a-bundle" (OuterVolumeSpecName: "bundle") pod "04363a62-e592-457c-ac4a-48bb6c942c9a" (UID: "04363a62-e592-457c-ac4a-48bb6c942c9a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:19:45 crc kubenswrapper[5120]: I0316 16:19:45.327117 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04363a62-e592-457c-ac4a-48bb6c942c9a-kube-api-access-kjzzh" (OuterVolumeSpecName: "kube-api-access-kjzzh") pod "04363a62-e592-457c-ac4a-48bb6c942c9a" (UID: "04363a62-e592-457c-ac4a-48bb6c942c9a"). InnerVolumeSpecName "kube-api-access-kjzzh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:19:45 crc kubenswrapper[5120]: I0316 16:19:45.341337 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04363a62-e592-457c-ac4a-48bb6c942c9a-util" (OuterVolumeSpecName: "util") pod "04363a62-e592-457c-ac4a-48bb6c942c9a" (UID: "04363a62-e592-457c-ac4a-48bb6c942c9a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:19:45 crc kubenswrapper[5120]: I0316 16:19:45.423677 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kjzzh\" (UniqueName: \"kubernetes.io/projected/04363a62-e592-457c-ac4a-48bb6c942c9a-kube-api-access-kjzzh\") on node \"crc\" DevicePath \"\"" Mar 16 16:19:45 crc kubenswrapper[5120]: I0316 16:19:45.424155 5120 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/04363a62-e592-457c-ac4a-48bb6c942c9a-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:19:45 crc kubenswrapper[5120]: I0316 16:19:45.424185 5120 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/04363a62-e592-457c-ac4a-48bb6c942c9a-util\") on node \"crc\" DevicePath \"\"" Mar 16 16:19:45 crc kubenswrapper[5120]: I0316 16:19:45.936390 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/98629960b44b381d1a86cff1d1439a8df43509c9ad24579158c59d0f08lwstg" event={"ID":"04363a62-e592-457c-ac4a-48bb6c942c9a","Type":"ContainerDied","Data":"c08eb6219a25bf91a04acc437874f1519dd44ea18628f1a3222697fb661d2d1f"} Mar 16 16:19:45 crc kubenswrapper[5120]: I0316 16:19:45.936449 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c08eb6219a25bf91a04acc437874f1519dd44ea18628f1a3222697fb661d2d1f" Mar 16 16:19:45 crc kubenswrapper[5120]: I0316 16:19:45.936592 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/98629960b44b381d1a86cff1d1439a8df43509c9ad24579158c59d0f08lwstg" Mar 16 16:19:52 crc kubenswrapper[5120]: I0316 16:19:52.008292 5120 patch_prober.go:28] interesting pod/machine-config-daemon-7bf76 container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 16:19:52 crc kubenswrapper[5120]: I0316 16:19:52.008720 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 16:19:56 crc kubenswrapper[5120]: I0316 16:19:56.554701 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-operators/obo-prometheus-operator-9bc85b4bf-7p4jt"] Mar 16 16:19:56 crc kubenswrapper[5120]: I0316 16:19:56.556000 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04363a62-e592-457c-ac4a-48bb6c942c9a" containerName="util" Mar 16 16:19:56 crc kubenswrapper[5120]: I0316 16:19:56.556014 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="04363a62-e592-457c-ac4a-48bb6c942c9a" containerName="util" Mar 16 16:19:56 crc kubenswrapper[5120]: I0316 16:19:56.556024 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04363a62-e592-457c-ac4a-48bb6c942c9a" containerName="extract" Mar 16 16:19:56 crc kubenswrapper[5120]: I0316 16:19:56.556031 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="04363a62-e592-457c-ac4a-48bb6c942c9a" containerName="extract" Mar 16 16:19:56 crc kubenswrapper[5120]: I0316 16:19:56.556052 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04363a62-e592-457c-ac4a-48bb6c942c9a" containerName="pull" Mar 16 16:19:56 crc kubenswrapper[5120]: I0316 16:19:56.556057 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="04363a62-e592-457c-ac4a-48bb6c942c9a" containerName="pull" Mar 16 16:19:56 crc kubenswrapper[5120]: I0316 16:19:56.556183 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="04363a62-e592-457c-ac4a-48bb6c942c9a" containerName="extract" Mar 16 16:19:56 crc kubenswrapper[5120]: I0316 16:19:56.565300 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/obo-prometheus-operator-9bc85b4bf-7p4jt" Mar 16 16:19:56 crc kubenswrapper[5120]: I0316 16:19:56.571464 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Mar 16 16:19:56 crc kubenswrapper[5120]: I0316 16:19:56.574717 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"obo-prometheus-operator-dockercfg-vn8ws\"" Mar 16 16:19:56 crc kubenswrapper[5120]: I0316 16:19:56.576703 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/obo-prometheus-operator-9bc85b4bf-7p4jt"] Mar 16 16:19:56 crc kubenswrapper[5120]: I0316 16:19:56.577077 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Mar 16 16:19:56 crc kubenswrapper[5120]: I0316 16:19:56.622346 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d68zk\" (UniqueName: \"kubernetes.io/projected/18c84489-f690-4ef3-b74c-90c206024afd-kube-api-access-d68zk\") pod \"obo-prometheus-operator-9bc85b4bf-7p4jt\" (UID: \"18c84489-f690-4ef3-b74c-90c206024afd\") " pod="openshift-operators/obo-prometheus-operator-9bc85b4bf-7p4jt" Mar 16 16:19:56 crc kubenswrapper[5120]: I0316 16:19:56.692643 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-operators/obo-prometheus-operator-admission-webhook-669bcd8dd-pzkpw"] Mar 16 16:19:56 crc kubenswrapper[5120]: I0316 16:19:56.701497 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/obo-prometheus-operator-admission-webhook-669bcd8dd-pzkpw" Mar 16 16:19:56 crc kubenswrapper[5120]: I0316 16:19:56.703910 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"obo-prometheus-operator-admission-webhook-dockercfg-vqk8c\"" Mar 16 16:19:56 crc kubenswrapper[5120]: I0316 16:19:56.704526 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"obo-prometheus-operator-admission-webhook-service-cert\"" Mar 16 16:19:56 crc kubenswrapper[5120]: I0316 16:19:56.708536 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/obo-prometheus-operator-admission-webhook-669bcd8dd-pzkpw"] Mar 16 16:19:56 crc kubenswrapper[5120]: I0316 16:19:56.716096 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-operators/obo-prometheus-operator-admission-webhook-669bcd8dd-zfrnj"] Mar 16 16:19:56 crc kubenswrapper[5120]: I0316 16:19:56.723796 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d68zk\" (UniqueName: \"kubernetes.io/projected/18c84489-f690-4ef3-b74c-90c206024afd-kube-api-access-d68zk\") pod \"obo-prometheus-operator-9bc85b4bf-7p4jt\" (UID: \"18c84489-f690-4ef3-b74c-90c206024afd\") " pod="openshift-operators/obo-prometheus-operator-9bc85b4bf-7p4jt" Mar 16 16:19:56 crc kubenswrapper[5120]: I0316 16:19:56.727616 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/obo-prometheus-operator-admission-webhook-669bcd8dd-zfrnj" Mar 16 16:19:56 crc kubenswrapper[5120]: I0316 16:19:56.738491 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/obo-prometheus-operator-admission-webhook-669bcd8dd-zfrnj"] Mar 16 16:19:56 crc kubenswrapper[5120]: I0316 16:19:56.756016 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d68zk\" (UniqueName: \"kubernetes.io/projected/18c84489-f690-4ef3-b74c-90c206024afd-kube-api-access-d68zk\") pod \"obo-prometheus-operator-9bc85b4bf-7p4jt\" (UID: \"18c84489-f690-4ef3-b74c-90c206024afd\") " pod="openshift-operators/obo-prometheus-operator-9bc85b4bf-7p4jt" Mar 16 16:19:56 crc kubenswrapper[5120]: I0316 16:19:56.825324 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/71f02692-3bf5-4e19-97a5-e7f79f2c52af-apiservice-cert\") pod \"obo-prometheus-operator-admission-webhook-669bcd8dd-zfrnj\" (UID: \"71f02692-3bf5-4e19-97a5-e7f79f2c52af\") " pod="openshift-operators/obo-prometheus-operator-admission-webhook-669bcd8dd-zfrnj" Mar 16 16:19:56 crc kubenswrapper[5120]: I0316 16:19:56.825394 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/13869ea5-bd74-407b-a6ce-c20c6214d66a-apiservice-cert\") pod \"obo-prometheus-operator-admission-webhook-669bcd8dd-pzkpw\" (UID: \"13869ea5-bd74-407b-a6ce-c20c6214d66a\") " pod="openshift-operators/obo-prometheus-operator-admission-webhook-669bcd8dd-pzkpw" Mar 16 16:19:56 crc kubenswrapper[5120]: I0316 16:19:56.825657 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/71f02692-3bf5-4e19-97a5-e7f79f2c52af-webhook-cert\") pod \"obo-prometheus-operator-admission-webhook-669bcd8dd-zfrnj\" (UID: \"71f02692-3bf5-4e19-97a5-e7f79f2c52af\") " pod="openshift-operators/obo-prometheus-operator-admission-webhook-669bcd8dd-zfrnj" Mar 16 16:19:56 crc kubenswrapper[5120]: I0316 16:19:56.825869 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/13869ea5-bd74-407b-a6ce-c20c6214d66a-webhook-cert\") pod \"obo-prometheus-operator-admission-webhook-669bcd8dd-pzkpw\" (UID: \"13869ea5-bd74-407b-a6ce-c20c6214d66a\") " pod="openshift-operators/obo-prometheus-operator-admission-webhook-669bcd8dd-pzkpw" Mar 16 16:19:56 crc kubenswrapper[5120]: I0316 16:19:56.881028 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/obo-prometheus-operator-9bc85b4bf-7p4jt" Mar 16 16:19:56 crc kubenswrapper[5120]: I0316 16:19:56.901702 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-operators/observability-operator-85c68dddb-zj2rl"] Mar 16 16:19:56 crc kubenswrapper[5120]: I0316 16:19:56.913548 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/observability-operator-85c68dddb-zj2rl" Mar 16 16:19:56 crc kubenswrapper[5120]: I0316 16:19:56.915870 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"observability-operator-sa-dockercfg-7xjjf\"" Mar 16 16:19:56 crc kubenswrapper[5120]: I0316 16:19:56.916112 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"observability-operator-tls\"" Mar 16 16:19:56 crc kubenswrapper[5120]: I0316 16:19:56.927534 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/13869ea5-bd74-407b-a6ce-c20c6214d66a-webhook-cert\") pod \"obo-prometheus-operator-admission-webhook-669bcd8dd-pzkpw\" (UID: \"13869ea5-bd74-407b-a6ce-c20c6214d66a\") " pod="openshift-operators/obo-prometheus-operator-admission-webhook-669bcd8dd-pzkpw" Mar 16 16:19:56 crc kubenswrapper[5120]: I0316 16:19:56.927807 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/71f02692-3bf5-4e19-97a5-e7f79f2c52af-apiservice-cert\") pod \"obo-prometheus-operator-admission-webhook-669bcd8dd-zfrnj\" (UID: \"71f02692-3bf5-4e19-97a5-e7f79f2c52af\") " pod="openshift-operators/obo-prometheus-operator-admission-webhook-669bcd8dd-zfrnj" Mar 16 16:19:56 crc kubenswrapper[5120]: I0316 16:19:56.927913 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/13869ea5-bd74-407b-a6ce-c20c6214d66a-apiservice-cert\") pod \"obo-prometheus-operator-admission-webhook-669bcd8dd-pzkpw\" (UID: \"13869ea5-bd74-407b-a6ce-c20c6214d66a\") " pod="openshift-operators/obo-prometheus-operator-admission-webhook-669bcd8dd-pzkpw" Mar 16 16:19:56 crc kubenswrapper[5120]: I0316 16:19:56.928066 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/71f02692-3bf5-4e19-97a5-e7f79f2c52af-webhook-cert\") pod \"obo-prometheus-operator-admission-webhook-669bcd8dd-zfrnj\" (UID: \"71f02692-3bf5-4e19-97a5-e7f79f2c52af\") " pod="openshift-operators/obo-prometheus-operator-admission-webhook-669bcd8dd-zfrnj" Mar 16 16:19:56 crc kubenswrapper[5120]: I0316 16:19:56.934506 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/71f02692-3bf5-4e19-97a5-e7f79f2c52af-apiservice-cert\") pod \"obo-prometheus-operator-admission-webhook-669bcd8dd-zfrnj\" (UID: \"71f02692-3bf5-4e19-97a5-e7f79f2c52af\") " pod="openshift-operators/obo-prometheus-operator-admission-webhook-669bcd8dd-zfrnj" Mar 16 16:19:56 crc kubenswrapper[5120]: I0316 16:19:56.946051 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/71f02692-3bf5-4e19-97a5-e7f79f2c52af-webhook-cert\") pod \"obo-prometheus-operator-admission-webhook-669bcd8dd-zfrnj\" (UID: \"71f02692-3bf5-4e19-97a5-e7f79f2c52af\") " pod="openshift-operators/obo-prometheus-operator-admission-webhook-669bcd8dd-zfrnj" Mar 16 16:19:56 crc kubenswrapper[5120]: I0316 16:19:56.947306 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/13869ea5-bd74-407b-a6ce-c20c6214d66a-webhook-cert\") pod \"obo-prometheus-operator-admission-webhook-669bcd8dd-pzkpw\" (UID: \"13869ea5-bd74-407b-a6ce-c20c6214d66a\") " pod="openshift-operators/obo-prometheus-operator-admission-webhook-669bcd8dd-pzkpw" Mar 16 16:19:56 crc kubenswrapper[5120]: I0316 16:19:56.951683 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/13869ea5-bd74-407b-a6ce-c20c6214d66a-apiservice-cert\") pod \"obo-prometheus-operator-admission-webhook-669bcd8dd-pzkpw\" (UID: \"13869ea5-bd74-407b-a6ce-c20c6214d66a\") " pod="openshift-operators/obo-prometheus-operator-admission-webhook-669bcd8dd-pzkpw" Mar 16 16:19:56 crc kubenswrapper[5120]: I0316 16:19:56.955533 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/observability-operator-85c68dddb-zj2rl"] Mar 16 16:19:57 crc kubenswrapper[5120]: I0316 16:19:57.015828 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/obo-prometheus-operator-admission-webhook-669bcd8dd-pzkpw" Mar 16 16:19:57 crc kubenswrapper[5120]: I0316 16:19:57.029709 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"observability-operator-tls\" (UniqueName: \"kubernetes.io/secret/4df87e18-229a-409c-8e61-36fc094b6de9-observability-operator-tls\") pod \"observability-operator-85c68dddb-zj2rl\" (UID: \"4df87e18-229a-409c-8e61-36fc094b6de9\") " pod="openshift-operators/observability-operator-85c68dddb-zj2rl" Mar 16 16:19:57 crc kubenswrapper[5120]: I0316 16:19:57.030144 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qb7t\" (UniqueName: \"kubernetes.io/projected/4df87e18-229a-409c-8e61-36fc094b6de9-kube-api-access-4qb7t\") pod \"observability-operator-85c68dddb-zj2rl\" (UID: \"4df87e18-229a-409c-8e61-36fc094b6de9\") " pod="openshift-operators/observability-operator-85c68dddb-zj2rl" Mar 16 16:19:57 crc kubenswrapper[5120]: I0316 16:19:57.046680 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/obo-prometheus-operator-admission-webhook-669bcd8dd-zfrnj" Mar 16 16:19:57 crc kubenswrapper[5120]: I0316 16:19:57.110825 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-operators/perses-operator-669c9f96b5-m4vlq"] Mar 16 16:19:57 crc kubenswrapper[5120]: I0316 16:19:57.141986 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"observability-operator-tls\" (UniqueName: \"kubernetes.io/secret/4df87e18-229a-409c-8e61-36fc094b6de9-observability-operator-tls\") pod \"observability-operator-85c68dddb-zj2rl\" (UID: \"4df87e18-229a-409c-8e61-36fc094b6de9\") " pod="openshift-operators/observability-operator-85c68dddb-zj2rl" Mar 16 16:19:57 crc kubenswrapper[5120]: I0316 16:19:57.142240 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4qb7t\" (UniqueName: \"kubernetes.io/projected/4df87e18-229a-409c-8e61-36fc094b6de9-kube-api-access-4qb7t\") pod \"observability-operator-85c68dddb-zj2rl\" (UID: \"4df87e18-229a-409c-8e61-36fc094b6de9\") " pod="openshift-operators/observability-operator-85c68dddb-zj2rl" Mar 16 16:19:57 crc kubenswrapper[5120]: I0316 16:19:57.146103 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/perses-operator-669c9f96b5-m4vlq" Mar 16 16:19:57 crc kubenswrapper[5120]: I0316 16:19:57.155018 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"perses-operator-dockercfg-x2g85\"" Mar 16 16:19:57 crc kubenswrapper[5120]: I0316 16:19:57.156339 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/perses-operator-669c9f96b5-m4vlq"] Mar 16 16:19:57 crc kubenswrapper[5120]: I0316 16:19:57.161804 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"observability-operator-tls\" (UniqueName: \"kubernetes.io/secret/4df87e18-229a-409c-8e61-36fc094b6de9-observability-operator-tls\") pod \"observability-operator-85c68dddb-zj2rl\" (UID: \"4df87e18-229a-409c-8e61-36fc094b6de9\") " pod="openshift-operators/observability-operator-85c68dddb-zj2rl" Mar 16 16:19:57 crc kubenswrapper[5120]: I0316 16:19:57.161531 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qb7t\" (UniqueName: \"kubernetes.io/projected/4df87e18-229a-409c-8e61-36fc094b6de9-kube-api-access-4qb7t\") pod \"observability-operator-85c68dddb-zj2rl\" (UID: \"4df87e18-229a-409c-8e61-36fc094b6de9\") " pod="openshift-operators/observability-operator-85c68dddb-zj2rl" Mar 16 16:19:57 crc kubenswrapper[5120]: I0316 16:19:57.245546 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/395765ab-8a57-4a9d-a0b5-f113e4914594-openshift-service-ca\") pod \"perses-operator-669c9f96b5-m4vlq\" (UID: \"395765ab-8a57-4a9d-a0b5-f113e4914594\") " pod="openshift-operators/perses-operator-669c9f96b5-m4vlq" Mar 16 16:19:57 crc kubenswrapper[5120]: I0316 16:19:57.245993 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txsgt\" (UniqueName: \"kubernetes.io/projected/395765ab-8a57-4a9d-a0b5-f113e4914594-kube-api-access-txsgt\") pod \"perses-operator-669c9f96b5-m4vlq\" (UID: \"395765ab-8a57-4a9d-a0b5-f113e4914594\") " pod="openshift-operators/perses-operator-669c9f96b5-m4vlq" Mar 16 16:19:57 crc kubenswrapper[5120]: I0316 16:19:57.306526 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/observability-operator-85c68dddb-zj2rl" Mar 16 16:19:57 crc kubenswrapper[5120]: I0316 16:19:57.347823 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/395765ab-8a57-4a9d-a0b5-f113e4914594-openshift-service-ca\") pod \"perses-operator-669c9f96b5-m4vlq\" (UID: \"395765ab-8a57-4a9d-a0b5-f113e4914594\") " pod="openshift-operators/perses-operator-669c9f96b5-m4vlq" Mar 16 16:19:57 crc kubenswrapper[5120]: I0316 16:19:57.347984 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-txsgt\" (UniqueName: \"kubernetes.io/projected/395765ab-8a57-4a9d-a0b5-f113e4914594-kube-api-access-txsgt\") pod \"perses-operator-669c9f96b5-m4vlq\" (UID: \"395765ab-8a57-4a9d-a0b5-f113e4914594\") " pod="openshift-operators/perses-operator-669c9f96b5-m4vlq" Mar 16 16:19:57 crc kubenswrapper[5120]: I0316 16:19:57.349184 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/395765ab-8a57-4a9d-a0b5-f113e4914594-openshift-service-ca\") pod \"perses-operator-669c9f96b5-m4vlq\" (UID: \"395765ab-8a57-4a9d-a0b5-f113e4914594\") " pod="openshift-operators/perses-operator-669c9f96b5-m4vlq" Mar 16 16:19:57 crc kubenswrapper[5120]: I0316 16:19:57.382776 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-txsgt\" (UniqueName: \"kubernetes.io/projected/395765ab-8a57-4a9d-a0b5-f113e4914594-kube-api-access-txsgt\") pod \"perses-operator-669c9f96b5-m4vlq\" (UID: \"395765ab-8a57-4a9d-a0b5-f113e4914594\") " pod="openshift-operators/perses-operator-669c9f96b5-m4vlq" Mar 16 16:19:57 crc kubenswrapper[5120]: I0316 16:19:57.491426 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/obo-prometheus-operator-9bc85b4bf-7p4jt"] Mar 16 16:19:57 crc kubenswrapper[5120]: I0316 16:19:57.532612 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/perses-operator-669c9f96b5-m4vlq" Mar 16 16:19:57 crc kubenswrapper[5120]: I0316 16:19:57.691989 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/obo-prometheus-operator-admission-webhook-669bcd8dd-pzkpw"] Mar 16 16:19:57 crc kubenswrapper[5120]: I0316 16:19:57.816306 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/obo-prometheus-operator-admission-webhook-669bcd8dd-zfrnj"] Mar 16 16:19:57 crc kubenswrapper[5120]: I0316 16:19:57.953366 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/observability-operator-85c68dddb-zj2rl"] Mar 16 16:19:57 crc kubenswrapper[5120]: W0316 16:19:57.964903 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4df87e18_229a_409c_8e61_36fc094b6de9.slice/crio-c5de74cdda4486a2a46e6ce37285b1abc9acd7cd8ffcd8f42e97fc6f73fc4e3d WatchSource:0}: Error finding container c5de74cdda4486a2a46e6ce37285b1abc9acd7cd8ffcd8f42e97fc6f73fc4e3d: Status 404 returned error can't find the container with id c5de74cdda4486a2a46e6ce37285b1abc9acd7cd8ffcd8f42e97fc6f73fc4e3d Mar 16 16:19:58 crc kubenswrapper[5120]: I0316 16:19:58.027079 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/perses-operator-669c9f96b5-m4vlq"] Mar 16 16:19:58 crc kubenswrapper[5120]: W0316 16:19:58.038528 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod395765ab_8a57_4a9d_a0b5_f113e4914594.slice/crio-03b37868c964910bcf357dc806e4036a42385566226b5695d19f2e3067e94347 WatchSource:0}: Error finding container 03b37868c964910bcf357dc806e4036a42385566226b5695d19f2e3067e94347: Status 404 returned error can't find the container with id 03b37868c964910bcf357dc806e4036a42385566226b5695d19f2e3067e94347 Mar 16 16:19:58 crc kubenswrapper[5120]: I0316 16:19:58.057884 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/obo-prometheus-operator-admission-webhook-669bcd8dd-zfrnj" event={"ID":"71f02692-3bf5-4e19-97a5-e7f79f2c52af","Type":"ContainerStarted","Data":"c9b8bf249e383baa4ab4c0348cc4f96f1e58cc1b6fa2b8313119189e822fe6f2"} Mar 16 16:19:58 crc kubenswrapper[5120]: I0316 16:19:58.059446 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/obo-prometheus-operator-admission-webhook-669bcd8dd-pzkpw" event={"ID":"13869ea5-bd74-407b-a6ce-c20c6214d66a","Type":"ContainerStarted","Data":"2e0010184006e8323de82d18561074265a38549f190829f2713138f6027beef4"} Mar 16 16:19:58 crc kubenswrapper[5120]: I0316 16:19:58.060545 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/observability-operator-85c68dddb-zj2rl" event={"ID":"4df87e18-229a-409c-8e61-36fc094b6de9","Type":"ContainerStarted","Data":"c5de74cdda4486a2a46e6ce37285b1abc9acd7cd8ffcd8f42e97fc6f73fc4e3d"} Mar 16 16:19:58 crc kubenswrapper[5120]: I0316 16:19:58.061481 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/obo-prometheus-operator-9bc85b4bf-7p4jt" event={"ID":"18c84489-f690-4ef3-b74c-90c206024afd","Type":"ContainerStarted","Data":"371ad6c33df3b3982098f4bef722bd4b2044a717cd78ce039a9c451e97cc4797"} Mar 16 16:19:59 crc kubenswrapper[5120]: I0316 16:19:59.073719 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/perses-operator-669c9f96b5-m4vlq" event={"ID":"395765ab-8a57-4a9d-a0b5-f113e4914594","Type":"ContainerStarted","Data":"03b37868c964910bcf357dc806e4036a42385566226b5695d19f2e3067e94347"} Mar 16 16:20:00 crc kubenswrapper[5120]: I0316 16:20:00.132800 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-infra/auto-csr-approver-29561300-vrl66"] Mar 16 16:20:00 crc kubenswrapper[5120]: I0316 16:20:00.159975 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561300-vrl66"] Mar 16 16:20:00 crc kubenswrapper[5120]: I0316 16:20:00.160091 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561300-vrl66" Mar 16 16:20:00 crc kubenswrapper[5120]: I0316 16:20:00.166719 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-infra\"/\"csr-approver-sa-dockercfg-x2nsz\"" Mar 16 16:20:00 crc kubenswrapper[5120]: I0316 16:20:00.166820 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"openshift-service-ca.crt\"" Mar 16 16:20:00 crc kubenswrapper[5120]: I0316 16:20:00.167049 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"kube-root-ca.crt\"" Mar 16 16:20:00 crc kubenswrapper[5120]: I0316 16:20:00.200715 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jc4b7\" (UniqueName: \"kubernetes.io/projected/8b8f1cab-ef2b-4dda-9cd5-0c7841b17c66-kube-api-access-jc4b7\") pod \"auto-csr-approver-29561300-vrl66\" (UID: \"8b8f1cab-ef2b-4dda-9cd5-0c7841b17c66\") " pod="openshift-infra/auto-csr-approver-29561300-vrl66" Mar 16 16:20:00 crc kubenswrapper[5120]: I0316 16:20:00.306621 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jc4b7\" (UniqueName: \"kubernetes.io/projected/8b8f1cab-ef2b-4dda-9cd5-0c7841b17c66-kube-api-access-jc4b7\") pod \"auto-csr-approver-29561300-vrl66\" (UID: \"8b8f1cab-ef2b-4dda-9cd5-0c7841b17c66\") " pod="openshift-infra/auto-csr-approver-29561300-vrl66" Mar 16 16:20:00 crc kubenswrapper[5120]: I0316 16:20:00.339668 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jc4b7\" (UniqueName: \"kubernetes.io/projected/8b8f1cab-ef2b-4dda-9cd5-0c7841b17c66-kube-api-access-jc4b7\") pod \"auto-csr-approver-29561300-vrl66\" (UID: \"8b8f1cab-ef2b-4dda-9cd5-0c7841b17c66\") " pod="openshift-infra/auto-csr-approver-29561300-vrl66" Mar 16 16:20:00 crc kubenswrapper[5120]: I0316 16:20:00.480228 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561300-vrl66" Mar 16 16:20:01 crc kubenswrapper[5120]: I0316 16:20:01.008210 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561300-vrl66"] Mar 16 16:20:01 crc kubenswrapper[5120]: I0316 16:20:01.106403 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561300-vrl66" event={"ID":"8b8f1cab-ef2b-4dda-9cd5-0c7841b17c66","Type":"ContainerStarted","Data":"737bb72e6c5c42f26816475c9e09ae04287ee166557dd2006f42ada9bf493fc3"} Mar 16 16:20:02 crc kubenswrapper[5120]: I0316 16:20:02.532362 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 16:20:02 crc kubenswrapper[5120]: I0316 16:20:02.556507 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 16:20:02 crc kubenswrapper[5120]: I0316 16:20:02.556691 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:20:02 crc kubenswrapper[5120]: I0316 16:20:02.562572 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-config-data\"" Mar 16 16:20:02 crc kubenswrapper[5120]: I0316 16:20:02.562760 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-default-user\"" Mar 16 16:20:02 crc kubenswrapper[5120]: I0316 16:20:02.562919 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-rabbitmq-svc\"" Mar 16 16:20:02 crc kubenswrapper[5120]: I0316 16:20:02.562931 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-server-conf\"" Mar 16 16:20:02 crc kubenswrapper[5120]: I0316 16:20:02.563001 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-server-dockercfg-55rn4\"" Mar 16 16:20:02 crc kubenswrapper[5120]: I0316 16:20:02.563037 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-erlang-cookie\"" Mar 16 16:20:02 crc kubenswrapper[5120]: I0316 16:20:02.563049 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-plugins-conf\"" Mar 16 16:20:02 crc kubenswrapper[5120]: I0316 16:20:02.661705 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93-rabbitmq-tls\") pod \"rabbitmq-server-0\" (UID: \"dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:20:02 crc kubenswrapper[5120]: I0316 16:20:02.661791 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93-config-data\") pod \"rabbitmq-server-0\" (UID: \"dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:20:02 crc kubenswrapper[5120]: I0316 16:20:02.661944 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"rabbitmq-server-0\" (UID: \"dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:20:02 crc kubenswrapper[5120]: I0316 16:20:02.661980 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m452p\" (UniqueName: \"kubernetes.io/projected/dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93-kube-api-access-m452p\") pod \"rabbitmq-server-0\" (UID: \"dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:20:02 crc kubenswrapper[5120]: I0316 16:20:02.662067 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93-pod-info\") pod \"rabbitmq-server-0\" (UID: \"dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:20:02 crc kubenswrapper[5120]: I0316 16:20:02.662133 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:20:02 crc kubenswrapper[5120]: I0316 16:20:02.662181 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93-server-conf\") pod \"rabbitmq-server-0\" (UID: \"dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:20:02 crc kubenswrapper[5120]: I0316 16:20:02.662259 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:20:02 crc kubenswrapper[5120]: I0316 16:20:02.662351 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:20:02 crc kubenswrapper[5120]: I0316 16:20:02.662381 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:20:02 crc kubenswrapper[5120]: I0316 16:20:02.662448 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:20:02 crc kubenswrapper[5120]: I0316 16:20:02.763867 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"rabbitmq-server-0\" (UID: \"dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:20:02 crc kubenswrapper[5120]: I0316 16:20:02.763921 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m452p\" (UniqueName: \"kubernetes.io/projected/dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93-kube-api-access-m452p\") pod \"rabbitmq-server-0\" (UID: \"dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:20:02 crc kubenswrapper[5120]: I0316 16:20:02.763970 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93-pod-info\") pod \"rabbitmq-server-0\" (UID: \"dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:20:02 crc kubenswrapper[5120]: I0316 16:20:02.763992 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:20:02 crc kubenswrapper[5120]: I0316 16:20:02.764011 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93-server-conf\") pod \"rabbitmq-server-0\" (UID: \"dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:20:02 crc kubenswrapper[5120]: I0316 16:20:02.764059 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:20:02 crc kubenswrapper[5120]: I0316 16:20:02.764105 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:20:02 crc kubenswrapper[5120]: I0316 16:20:02.764120 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:20:02 crc kubenswrapper[5120]: I0316 16:20:02.764153 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:20:02 crc kubenswrapper[5120]: I0316 16:20:02.764184 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93-rabbitmq-tls\") pod \"rabbitmq-server-0\" (UID: \"dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:20:02 crc kubenswrapper[5120]: I0316 16:20:02.764213 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93-config-data\") pod \"rabbitmq-server-0\" (UID: \"dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:20:02 crc kubenswrapper[5120]: I0316 16:20:02.765126 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93-config-data\") pod \"rabbitmq-server-0\" (UID: \"dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:20:02 crc kubenswrapper[5120]: I0316 16:20:02.765662 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:20:02 crc kubenswrapper[5120]: I0316 16:20:02.766096 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93-server-conf\") pod \"rabbitmq-server-0\" (UID: \"dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:20:02 crc kubenswrapper[5120]: I0316 16:20:02.766455 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"rabbitmq-server-0\" (UID: \"dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93\") device mount path \"/mnt/openstack/pv08\"" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:20:02 crc kubenswrapper[5120]: I0316 16:20:02.767994 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:20:02 crc kubenswrapper[5120]: I0316 16:20:02.769519 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:20:02 crc kubenswrapper[5120]: I0316 16:20:02.774074 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93-rabbitmq-tls\") pod \"rabbitmq-server-0\" (UID: \"dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:20:02 crc kubenswrapper[5120]: I0316 16:20:02.784550 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m452p\" (UniqueName: \"kubernetes.io/projected/dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93-kube-api-access-m452p\") pod \"rabbitmq-server-0\" (UID: \"dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:20:02 crc kubenswrapper[5120]: I0316 16:20:02.789408 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:20:02 crc kubenswrapper[5120]: I0316 16:20:02.799674 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:20:02 crc kubenswrapper[5120]: I0316 16:20:02.803058 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"rabbitmq-server-0\" (UID: \"dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:20:02 crc kubenswrapper[5120]: I0316 16:20:02.804074 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93-pod-info\") pod \"rabbitmq-server-0\" (UID: \"dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:20:02 crc kubenswrapper[5120]: I0316 16:20:02.882122 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:20:03 crc kubenswrapper[5120]: I0316 16:20:03.049208 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 16:20:03 crc kubenswrapper[5120]: I0316 16:20:03.063026 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 16:20:03 crc kubenswrapper[5120]: I0316 16:20:03.063142 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:20:03 crc kubenswrapper[5120]: I0316 16:20:03.066050 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-galera-openstack-svc\"" Mar 16 16:20:03 crc kubenswrapper[5120]: I0316 16:20:03.067416 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-config-data\"" Mar 16 16:20:03 crc kubenswrapper[5120]: I0316 16:20:03.067578 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"galera-openstack-dockercfg-78xm6\"" Mar 16 16:20:03 crc kubenswrapper[5120]: I0316 16:20:03.070566 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-scripts\"" Mar 16 16:20:03 crc kubenswrapper[5120]: I0316 16:20:03.082364 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"combined-ca-bundle\"" Mar 16 16:20:03 crc kubenswrapper[5120]: I0316 16:20:03.125494 5120 generic.go:358] "Generic (PLEG): container finished" podID="8b8f1cab-ef2b-4dda-9cd5-0c7841b17c66" containerID="5fa34cfe92c499e9a866c066d9a129f18e0e5590f75287260fd13ac5a7d3c743" exitCode=0 Mar 16 16:20:03 crc kubenswrapper[5120]: I0316 16:20:03.125592 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561300-vrl66" event={"ID":"8b8f1cab-ef2b-4dda-9cd5-0c7841b17c66","Type":"ContainerDied","Data":"5fa34cfe92c499e9a866c066d9a129f18e0e5590f75287260fd13ac5a7d3c743"} Mar 16 16:20:03 crc kubenswrapper[5120]: I0316 16:20:03.170236 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9185c9ac-7b26-4bbc-be42-545c166ba2c8-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"9185c9ac-7b26-4bbc-be42-545c166ba2c8\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:20:03 crc kubenswrapper[5120]: I0316 16:20:03.170332 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"openstack-galera-0\" (UID: \"9185c9ac-7b26-4bbc-be42-545c166ba2c8\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:20:03 crc kubenswrapper[5120]: I0316 16:20:03.170361 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9185c9ac-7b26-4bbc-be42-545c166ba2c8-operator-scripts\") pod \"openstack-galera-0\" (UID: \"9185c9ac-7b26-4bbc-be42-545c166ba2c8\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:20:03 crc kubenswrapper[5120]: I0316 16:20:03.170460 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/9185c9ac-7b26-4bbc-be42-545c166ba2c8-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"9185c9ac-7b26-4bbc-be42-545c166ba2c8\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:20:03 crc kubenswrapper[5120]: I0316 16:20:03.170511 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfjhp\" (UniqueName: \"kubernetes.io/projected/9185c9ac-7b26-4bbc-be42-545c166ba2c8-kube-api-access-gfjhp\") pod \"openstack-galera-0\" (UID: \"9185c9ac-7b26-4bbc-be42-545c166ba2c8\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:20:03 crc kubenswrapper[5120]: I0316 16:20:03.170588 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/9185c9ac-7b26-4bbc-be42-545c166ba2c8-config-data-default\") pod \"openstack-galera-0\" (UID: \"9185c9ac-7b26-4bbc-be42-545c166ba2c8\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:20:03 crc kubenswrapper[5120]: I0316 16:20:03.170609 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/9185c9ac-7b26-4bbc-be42-545c166ba2c8-config-data-generated\") pod \"openstack-galera-0\" (UID: \"9185c9ac-7b26-4bbc-be42-545c166ba2c8\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:20:03 crc kubenswrapper[5120]: I0316 16:20:03.170649 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/9185c9ac-7b26-4bbc-be42-545c166ba2c8-kolla-config\") pod \"openstack-galera-0\" (UID: \"9185c9ac-7b26-4bbc-be42-545c166ba2c8\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:20:03 crc kubenswrapper[5120]: I0316 16:20:03.272502 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"openstack-galera-0\" (UID: \"9185c9ac-7b26-4bbc-be42-545c166ba2c8\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:20:03 crc kubenswrapper[5120]: I0316 16:20:03.272945 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9185c9ac-7b26-4bbc-be42-545c166ba2c8-operator-scripts\") pod \"openstack-galera-0\" (UID: \"9185c9ac-7b26-4bbc-be42-545c166ba2c8\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:20:03 crc kubenswrapper[5120]: I0316 16:20:03.273177 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/9185c9ac-7b26-4bbc-be42-545c166ba2c8-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"9185c9ac-7b26-4bbc-be42-545c166ba2c8\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:20:03 crc kubenswrapper[5120]: I0316 16:20:03.273268 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gfjhp\" (UniqueName: \"kubernetes.io/projected/9185c9ac-7b26-4bbc-be42-545c166ba2c8-kube-api-access-gfjhp\") pod \"openstack-galera-0\" (UID: \"9185c9ac-7b26-4bbc-be42-545c166ba2c8\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:20:03 crc kubenswrapper[5120]: I0316 16:20:03.273428 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/9185c9ac-7b26-4bbc-be42-545c166ba2c8-config-data-default\") pod \"openstack-galera-0\" (UID: \"9185c9ac-7b26-4bbc-be42-545c166ba2c8\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:20:03 crc kubenswrapper[5120]: I0316 16:20:03.273508 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/9185c9ac-7b26-4bbc-be42-545c166ba2c8-config-data-generated\") pod \"openstack-galera-0\" (UID: \"9185c9ac-7b26-4bbc-be42-545c166ba2c8\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:20:03 crc kubenswrapper[5120]: I0316 16:20:03.273578 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/9185c9ac-7b26-4bbc-be42-545c166ba2c8-kolla-config\") pod \"openstack-galera-0\" (UID: \"9185c9ac-7b26-4bbc-be42-545c166ba2c8\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:20:03 crc kubenswrapper[5120]: I0316 16:20:03.273620 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9185c9ac-7b26-4bbc-be42-545c166ba2c8-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"9185c9ac-7b26-4bbc-be42-545c166ba2c8\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:20:03 crc kubenswrapper[5120]: I0316 16:20:03.272663 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"openstack-galera-0\" (UID: \"9185c9ac-7b26-4bbc-be42-545c166ba2c8\") device mount path \"/mnt/openstack/pv13\"" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:20:03 crc kubenswrapper[5120]: I0316 16:20:03.275229 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/9185c9ac-7b26-4bbc-be42-545c166ba2c8-config-data-generated\") pod \"openstack-galera-0\" (UID: \"9185c9ac-7b26-4bbc-be42-545c166ba2c8\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:20:03 crc kubenswrapper[5120]: I0316 16:20:03.275410 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/9185c9ac-7b26-4bbc-be42-545c166ba2c8-kolla-config\") pod \"openstack-galera-0\" (UID: \"9185c9ac-7b26-4bbc-be42-545c166ba2c8\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:20:03 crc kubenswrapper[5120]: I0316 16:20:03.275804 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/9185c9ac-7b26-4bbc-be42-545c166ba2c8-config-data-default\") pod \"openstack-galera-0\" (UID: \"9185c9ac-7b26-4bbc-be42-545c166ba2c8\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:20:03 crc kubenswrapper[5120]: I0316 16:20:03.276424 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9185c9ac-7b26-4bbc-be42-545c166ba2c8-operator-scripts\") pod \"openstack-galera-0\" (UID: \"9185c9ac-7b26-4bbc-be42-545c166ba2c8\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:20:03 crc kubenswrapper[5120]: I0316 16:20:03.281915 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/9185c9ac-7b26-4bbc-be42-545c166ba2c8-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"9185c9ac-7b26-4bbc-be42-545c166ba2c8\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:20:03 crc kubenswrapper[5120]: I0316 16:20:03.299511 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9185c9ac-7b26-4bbc-be42-545c166ba2c8-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"9185c9ac-7b26-4bbc-be42-545c166ba2c8\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:20:03 crc kubenswrapper[5120]: I0316 16:20:03.308674 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"openstack-galera-0\" (UID: \"9185c9ac-7b26-4bbc-be42-545c166ba2c8\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:20:03 crc kubenswrapper[5120]: I0316 16:20:03.311339 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfjhp\" (UniqueName: \"kubernetes.io/projected/9185c9ac-7b26-4bbc-be42-545c166ba2c8-kube-api-access-gfjhp\") pod \"openstack-galera-0\" (UID: \"9185c9ac-7b26-4bbc-be42-545c166ba2c8\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:20:03 crc kubenswrapper[5120]: I0316 16:20:03.382145 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:20:03 crc kubenswrapper[5120]: I0316 16:20:03.423190 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 16:20:03 crc kubenswrapper[5120]: I0316 16:20:03.436861 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Mar 16 16:20:03 crc kubenswrapper[5120]: I0316 16:20:03.439902 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"memcached-config-data\"" Mar 16 16:20:03 crc kubenswrapper[5120]: I0316 16:20:03.439984 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-memcached-svc\"" Mar 16 16:20:03 crc kubenswrapper[5120]: I0316 16:20:03.440205 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"memcached-memcached-dockercfg-9n8l4\"" Mar 16 16:20:03 crc kubenswrapper[5120]: I0316 16:20:03.445130 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 16:20:03 crc kubenswrapper[5120]: I0316 16:20:03.577983 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/ba0d3286-038b-4735-b0b4-1ce9b3faeed1-kolla-config\") pod \"memcached-0\" (UID: \"ba0d3286-038b-4735-b0b4-1ce9b3faeed1\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:20:03 crc kubenswrapper[5120]: I0316 16:20:03.578044 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ba0d3286-038b-4735-b0b4-1ce9b3faeed1-combined-ca-bundle\") pod \"memcached-0\" (UID: \"ba0d3286-038b-4735-b0b4-1ce9b3faeed1\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:20:03 crc kubenswrapper[5120]: I0316 16:20:03.578115 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/ba0d3286-038b-4735-b0b4-1ce9b3faeed1-config-data\") pod \"memcached-0\" (UID: \"ba0d3286-038b-4735-b0b4-1ce9b3faeed1\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:20:03 crc kubenswrapper[5120]: I0316 16:20:03.578317 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4bw4\" (UniqueName: \"kubernetes.io/projected/ba0d3286-038b-4735-b0b4-1ce9b3faeed1-kube-api-access-j4bw4\") pod \"memcached-0\" (UID: \"ba0d3286-038b-4735-b0b4-1ce9b3faeed1\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:20:03 crc kubenswrapper[5120]: I0316 16:20:03.578392 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/ba0d3286-038b-4735-b0b4-1ce9b3faeed1-memcached-tls-certs\") pod \"memcached-0\" (UID: \"ba0d3286-038b-4735-b0b4-1ce9b3faeed1\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:20:03 crc kubenswrapper[5120]: I0316 16:20:03.680614 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/ba0d3286-038b-4735-b0b4-1ce9b3faeed1-kolla-config\") pod \"memcached-0\" (UID: \"ba0d3286-038b-4735-b0b4-1ce9b3faeed1\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:20:03 crc kubenswrapper[5120]: I0316 16:20:03.680658 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ba0d3286-038b-4735-b0b4-1ce9b3faeed1-combined-ca-bundle\") pod \"memcached-0\" (UID: \"ba0d3286-038b-4735-b0b4-1ce9b3faeed1\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:20:03 crc kubenswrapper[5120]: I0316 16:20:03.680703 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/ba0d3286-038b-4735-b0b4-1ce9b3faeed1-config-data\") pod \"memcached-0\" (UID: \"ba0d3286-038b-4735-b0b4-1ce9b3faeed1\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:20:03 crc kubenswrapper[5120]: I0316 16:20:03.680752 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j4bw4\" (UniqueName: \"kubernetes.io/projected/ba0d3286-038b-4735-b0b4-1ce9b3faeed1-kube-api-access-j4bw4\") pod \"memcached-0\" (UID: \"ba0d3286-038b-4735-b0b4-1ce9b3faeed1\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:20:03 crc kubenswrapper[5120]: I0316 16:20:03.680817 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/ba0d3286-038b-4735-b0b4-1ce9b3faeed1-memcached-tls-certs\") pod \"memcached-0\" (UID: \"ba0d3286-038b-4735-b0b4-1ce9b3faeed1\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:20:03 crc kubenswrapper[5120]: I0316 16:20:03.682261 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/ba0d3286-038b-4735-b0b4-1ce9b3faeed1-kolla-config\") pod \"memcached-0\" (UID: \"ba0d3286-038b-4735-b0b4-1ce9b3faeed1\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:20:03 crc kubenswrapper[5120]: I0316 16:20:03.682845 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/ba0d3286-038b-4735-b0b4-1ce9b3faeed1-config-data\") pod \"memcached-0\" (UID: \"ba0d3286-038b-4735-b0b4-1ce9b3faeed1\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:20:03 crc kubenswrapper[5120]: I0316 16:20:03.684624 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/ba0d3286-038b-4735-b0b4-1ce9b3faeed1-memcached-tls-certs\") pod \"memcached-0\" (UID: \"ba0d3286-038b-4735-b0b4-1ce9b3faeed1\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:20:03 crc kubenswrapper[5120]: I0316 16:20:03.690503 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ba0d3286-038b-4735-b0b4-1ce9b3faeed1-combined-ca-bundle\") pod \"memcached-0\" (UID: \"ba0d3286-038b-4735-b0b4-1ce9b3faeed1\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:20:03 crc kubenswrapper[5120]: I0316 16:20:03.695568 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4bw4\" (UniqueName: \"kubernetes.io/projected/ba0d3286-038b-4735-b0b4-1ce9b3faeed1-kube-api-access-j4bw4\") pod \"memcached-0\" (UID: \"ba0d3286-038b-4735-b0b4-1ce9b3faeed1\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:20:03 crc kubenswrapper[5120]: I0316 16:20:03.764951 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Mar 16 16:20:05 crc kubenswrapper[5120]: I0316 16:20:05.146892 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561300-vrl66" event={"ID":"8b8f1cab-ef2b-4dda-9cd5-0c7841b17c66","Type":"ContainerDied","Data":"737bb72e6c5c42f26816475c9e09ae04287ee166557dd2006f42ada9bf493fc3"} Mar 16 16:20:05 crc kubenswrapper[5120]: I0316 16:20:05.147116 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="737bb72e6c5c42f26816475c9e09ae04287ee166557dd2006f42ada9bf493fc3" Mar 16 16:20:05 crc kubenswrapper[5120]: I0316 16:20:05.221302 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561300-vrl66" Mar 16 16:20:05 crc kubenswrapper[5120]: I0316 16:20:05.323191 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jc4b7\" (UniqueName: \"kubernetes.io/projected/8b8f1cab-ef2b-4dda-9cd5-0c7841b17c66-kube-api-access-jc4b7\") pod \"8b8f1cab-ef2b-4dda-9cd5-0c7841b17c66\" (UID: \"8b8f1cab-ef2b-4dda-9cd5-0c7841b17c66\") " Mar 16 16:20:05 crc kubenswrapper[5120]: I0316 16:20:05.345079 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b8f1cab-ef2b-4dda-9cd5-0c7841b17c66-kube-api-access-jc4b7" (OuterVolumeSpecName: "kube-api-access-jc4b7") pod "8b8f1cab-ef2b-4dda-9cd5-0c7841b17c66" (UID: "8b8f1cab-ef2b-4dda-9cd5-0c7841b17c66"). InnerVolumeSpecName "kube-api-access-jc4b7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:20:05 crc kubenswrapper[5120]: I0316 16:20:05.427408 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jc4b7\" (UniqueName: \"kubernetes.io/projected/8b8f1cab-ef2b-4dda-9cd5-0c7841b17c66-kube-api-access-jc4b7\") on node \"crc\" DevicePath \"\"" Mar 16 16:20:05 crc kubenswrapper[5120]: I0316 16:20:05.757291 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 16:20:05 crc kubenswrapper[5120]: I0316 16:20:05.758170 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b8f1cab-ef2b-4dda-9cd5-0c7841b17c66" containerName="oc" Mar 16 16:20:05 crc kubenswrapper[5120]: I0316 16:20:05.758188 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b8f1cab-ef2b-4dda-9cd5-0c7841b17c66" containerName="oc" Mar 16 16:20:05 crc kubenswrapper[5120]: I0316 16:20:05.758346 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="8b8f1cab-ef2b-4dda-9cd5-0c7841b17c66" containerName="oc" Mar 16 16:20:05 crc kubenswrapper[5120]: I0316 16:20:05.766330 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:20:05 crc kubenswrapper[5120]: I0316 16:20:05.768001 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 16:20:05 crc kubenswrapper[5120]: I0316 16:20:05.769691 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"telemetry-ceilometer-dockercfg-5zg68\"" Mar 16 16:20:05 crc kubenswrapper[5120]: I0316 16:20:05.933576 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gzb9\" (UniqueName: \"kubernetes.io/projected/7df75da5-8410-4171-b485-8eebd87a15b0-kube-api-access-8gzb9\") pod \"kube-state-metrics-0\" (UID: \"7df75da5-8410-4171-b485-8eebd87a15b0\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:20:06 crc kubenswrapper[5120]: I0316 16:20:06.035153 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8gzb9\" (UniqueName: \"kubernetes.io/projected/7df75da5-8410-4171-b485-8eebd87a15b0-kube-api-access-8gzb9\") pod \"kube-state-metrics-0\" (UID: \"7df75da5-8410-4171-b485-8eebd87a15b0\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:20:06 crc kubenswrapper[5120]: I0316 16:20:06.050842 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gzb9\" (UniqueName: \"kubernetes.io/projected/7df75da5-8410-4171-b485-8eebd87a15b0-kube-api-access-8gzb9\") pod \"kube-state-metrics-0\" (UID: \"7df75da5-8410-4171-b485-8eebd87a15b0\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:20:06 crc kubenswrapper[5120]: I0316 16:20:06.101650 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:20:06 crc kubenswrapper[5120]: I0316 16:20:06.153634 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561300-vrl66" Mar 16 16:20:06 crc kubenswrapper[5120]: I0316 16:20:06.279972 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-infra/auto-csr-approver-29561294-74vpp"] Mar 16 16:20:06 crc kubenswrapper[5120]: I0316 16:20:06.295281 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-infra/auto-csr-approver-29561294-74vpp"] Mar 16 16:20:06 crc kubenswrapper[5120]: I0316 16:20:06.671237 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="896c0a85-dde5-457c-8253-683e2002bea4" path="/var/lib/kubelet/pods/896c0a85-dde5-457c-8253-683e2002bea4/volumes" Mar 16 16:20:08 crc kubenswrapper[5120]: E0316 16:20:08.310357 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1306177 actualBytes=10240 Mar 16 16:20:08 crc kubenswrapper[5120]: I0316 16:20:08.611548 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 16:20:08 crc kubenswrapper[5120]: I0316 16:20:08.708501 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 16:20:08 crc kubenswrapper[5120]: I0316 16:20:08.708694 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:20:08 crc kubenswrapper[5120]: I0316 16:20:08.710285 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ovndbcluster-nb-ovndbs\"" Mar 16 16:20:08 crc kubenswrapper[5120]: I0316 16:20:08.713415 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovndbcluster-nb-config\"" Mar 16 16:20:08 crc kubenswrapper[5120]: I0316 16:20:08.713424 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovndbcluster-nb-scripts\"" Mar 16 16:20:08 crc kubenswrapper[5120]: I0316 16:20:08.713455 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ovn-metrics\"" Mar 16 16:20:08 crc kubenswrapper[5120]: I0316 16:20:08.713516 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ovncluster-ovndbcluster-nb-dockercfg-f7wn4\"" Mar 16 16:20:08 crc kubenswrapper[5120]: I0316 16:20:08.784812 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/47f6dea8-ee86-4de1-8bf7-3bbb7b5b4be1-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"47f6dea8-ee86-4de1-8bf7-3bbb7b5b4be1\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:20:08 crc kubenswrapper[5120]: I0316 16:20:08.784853 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/47f6dea8-ee86-4de1-8bf7-3bbb7b5b4be1-config\") pod \"ovsdbserver-nb-0\" (UID: \"47f6dea8-ee86-4de1-8bf7-3bbb7b5b4be1\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:20:08 crc kubenswrapper[5120]: I0316 16:20:08.784995 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qb22n\" (UniqueName: \"kubernetes.io/projected/47f6dea8-ee86-4de1-8bf7-3bbb7b5b4be1-kube-api-access-qb22n\") pod \"ovsdbserver-nb-0\" (UID: \"47f6dea8-ee86-4de1-8bf7-3bbb7b5b4be1\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:20:08 crc kubenswrapper[5120]: I0316 16:20:08.785054 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") pod \"ovsdbserver-nb-0\" (UID: \"47f6dea8-ee86-4de1-8bf7-3bbb7b5b4be1\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:20:08 crc kubenswrapper[5120]: I0316 16:20:08.785209 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/47f6dea8-ee86-4de1-8bf7-3bbb7b5b4be1-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"47f6dea8-ee86-4de1-8bf7-3bbb7b5b4be1\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:20:08 crc kubenswrapper[5120]: I0316 16:20:08.785250 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/47f6dea8-ee86-4de1-8bf7-3bbb7b5b4be1-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"47f6dea8-ee86-4de1-8bf7-3bbb7b5b4be1\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:20:08 crc kubenswrapper[5120]: I0316 16:20:08.785445 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/47f6dea8-ee86-4de1-8bf7-3bbb7b5b4be1-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"47f6dea8-ee86-4de1-8bf7-3bbb7b5b4be1\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:20:08 crc kubenswrapper[5120]: I0316 16:20:08.785575 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/47f6dea8-ee86-4de1-8bf7-3bbb7b5b4be1-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"47f6dea8-ee86-4de1-8bf7-3bbb7b5b4be1\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:20:08 crc kubenswrapper[5120]: I0316 16:20:08.887939 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/47f6dea8-ee86-4de1-8bf7-3bbb7b5b4be1-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"47f6dea8-ee86-4de1-8bf7-3bbb7b5b4be1\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:20:08 crc kubenswrapper[5120]: I0316 16:20:08.888137 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/47f6dea8-ee86-4de1-8bf7-3bbb7b5b4be1-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"47f6dea8-ee86-4de1-8bf7-3bbb7b5b4be1\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:20:08 crc kubenswrapper[5120]: I0316 16:20:08.888240 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/47f6dea8-ee86-4de1-8bf7-3bbb7b5b4be1-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"47f6dea8-ee86-4de1-8bf7-3bbb7b5b4be1\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:20:08 crc kubenswrapper[5120]: I0316 16:20:08.888278 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/47f6dea8-ee86-4de1-8bf7-3bbb7b5b4be1-config\") pod \"ovsdbserver-nb-0\" (UID: \"47f6dea8-ee86-4de1-8bf7-3bbb7b5b4be1\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:20:08 crc kubenswrapper[5120]: I0316 16:20:08.888368 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qb22n\" (UniqueName: \"kubernetes.io/projected/47f6dea8-ee86-4de1-8bf7-3bbb7b5b4be1-kube-api-access-qb22n\") pod \"ovsdbserver-nb-0\" (UID: \"47f6dea8-ee86-4de1-8bf7-3bbb7b5b4be1\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:20:08 crc kubenswrapper[5120]: I0316 16:20:08.888424 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") pod \"ovsdbserver-nb-0\" (UID: \"47f6dea8-ee86-4de1-8bf7-3bbb7b5b4be1\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:20:08 crc kubenswrapper[5120]: I0316 16:20:08.888560 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/47f6dea8-ee86-4de1-8bf7-3bbb7b5b4be1-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"47f6dea8-ee86-4de1-8bf7-3bbb7b5b4be1\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:20:08 crc kubenswrapper[5120]: I0316 16:20:08.888633 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/47f6dea8-ee86-4de1-8bf7-3bbb7b5b4be1-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"47f6dea8-ee86-4de1-8bf7-3bbb7b5b4be1\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:20:08 crc kubenswrapper[5120]: I0316 16:20:08.889461 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/47f6dea8-ee86-4de1-8bf7-3bbb7b5b4be1-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"47f6dea8-ee86-4de1-8bf7-3bbb7b5b4be1\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:20:08 crc kubenswrapper[5120]: I0316 16:20:08.889617 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") pod \"ovsdbserver-nb-0\" (UID: \"47f6dea8-ee86-4de1-8bf7-3bbb7b5b4be1\") device mount path \"/mnt/openstack/pv11\"" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:20:08 crc kubenswrapper[5120]: I0316 16:20:08.890168 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/47f6dea8-ee86-4de1-8bf7-3bbb7b5b4be1-config\") pod \"ovsdbserver-nb-0\" (UID: \"47f6dea8-ee86-4de1-8bf7-3bbb7b5b4be1\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:20:08 crc kubenswrapper[5120]: I0316 16:20:08.891420 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/47f6dea8-ee86-4de1-8bf7-3bbb7b5b4be1-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"47f6dea8-ee86-4de1-8bf7-3bbb7b5b4be1\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:20:08 crc kubenswrapper[5120]: I0316 16:20:08.895091 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/47f6dea8-ee86-4de1-8bf7-3bbb7b5b4be1-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"47f6dea8-ee86-4de1-8bf7-3bbb7b5b4be1\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:20:08 crc kubenswrapper[5120]: I0316 16:20:08.896041 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/47f6dea8-ee86-4de1-8bf7-3bbb7b5b4be1-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"47f6dea8-ee86-4de1-8bf7-3bbb7b5b4be1\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:20:08 crc kubenswrapper[5120]: I0316 16:20:08.899190 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/47f6dea8-ee86-4de1-8bf7-3bbb7b5b4be1-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"47f6dea8-ee86-4de1-8bf7-3bbb7b5b4be1\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:20:08 crc kubenswrapper[5120]: I0316 16:20:08.915365 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qb22n\" (UniqueName: \"kubernetes.io/projected/47f6dea8-ee86-4de1-8bf7-3bbb7b5b4be1-kube-api-access-qb22n\") pod \"ovsdbserver-nb-0\" (UID: \"47f6dea8-ee86-4de1-8bf7-3bbb7b5b4be1\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:20:08 crc kubenswrapper[5120]: I0316 16:20:08.933019 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") pod \"ovsdbserver-nb-0\" (UID: \"47f6dea8-ee86-4de1-8bf7-3bbb7b5b4be1\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:20:09 crc kubenswrapper[5120]: I0316 16:20:09.032727 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:20:09 crc kubenswrapper[5120]: I0316 16:20:09.769452 5120 scope.go:117] "RemoveContainer" containerID="5b379a830ff9d3c0159f76782a30148b2923a1653897bee0e8b29c16d72595be" Mar 16 16:20:10 crc kubenswrapper[5120]: I0316 16:20:10.359026 5120 scope.go:117] "RemoveContainer" containerID="ede1108ab087ef4dcb2ebf9dc2991b85c96cd8d26d42c8467e114b88ac302f0b" Mar 16 16:20:10 crc kubenswrapper[5120]: I0316 16:20:10.464252 5120 scope.go:117] "RemoveContainer" containerID="7cddf6f9772bb6d3fb4cedcc8d62e67f7c196cf34e754082cabc8e98596326c9" Mar 16 16:20:10 crc kubenswrapper[5120]: I0316 16:20:10.517033 5120 scope.go:117] "RemoveContainer" containerID="cef163ac5d8903c027451833dff610868bc8ad0469d059ca1d86ddf780dfab64" Mar 16 16:20:10 crc kubenswrapper[5120]: I0316 16:20:10.619970 5120 scope.go:117] "RemoveContainer" containerID="898e7e24e24ad47f5e4d28774c017ff107e537198ddac3c945dfbfd1a7ba3af8" Mar 16 16:20:10 crc kubenswrapper[5120]: I0316 16:20:10.742408 5120 scope.go:117] "RemoveContainer" containerID="b319fa4b2240e163b4790fe578a169ead1aec8b3e3597e2c33e865b692ec652d" Mar 16 16:20:10 crc kubenswrapper[5120]: I0316 16:20:10.775806 5120 scope.go:117] "RemoveContainer" containerID="937e2a7efef1e2a35873822eb3a6449330bdf62ec5cf4314b81be61a4c89538c" Mar 16 16:20:10 crc kubenswrapper[5120]: I0316 16:20:10.856514 5120 scope.go:117] "RemoveContainer" containerID="8cc8e36d000e2d0c2c42d12d21dbefc8ec0787382032ec5f9d372e053ee9da21" Mar 16 16:20:10 crc kubenswrapper[5120]: I0316 16:20:10.882960 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 16:20:10 crc kubenswrapper[5120]: I0316 16:20:10.884287 5120 scope.go:117] "RemoveContainer" containerID="336175f6e4a413fbdc7f5d1defbe23cb6b1d219efc18fc5eac887c1f8fa43cdc" Mar 16 16:20:10 crc kubenswrapper[5120]: W0316 16:20:10.894872 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podba0d3286_038b_4735_b0b4_1ce9b3faeed1.slice/crio-b9f3c464989a1affa3a4f085c00961d5c30aedbd39d59ff691ab4f489b7b0402 WatchSource:0}: Error finding container b9f3c464989a1affa3a4f085c00961d5c30aedbd39d59ff691ab4f489b7b0402: Status 404 returned error can't find the container with id b9f3c464989a1affa3a4f085c00961d5c30aedbd39d59ff691ab4f489b7b0402 Mar 16 16:20:10 crc kubenswrapper[5120]: I0316 16:20:10.935648 5120 scope.go:117] "RemoveContainer" containerID="c4272cd2258dc61984015e82abc7077ec95f9adb1a627de39afe019a3a50d9d2" Mar 16 16:20:10 crc kubenswrapper[5120]: I0316 16:20:10.987919 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 16:20:10 crc kubenswrapper[5120]: I0316 16:20:10.989664 5120 scope.go:117] "RemoveContainer" containerID="055f79a6905c351bf0d70cb2881d199a03a0362607503778267a2038d7383741" Mar 16 16:20:10 crc kubenswrapper[5120]: I0316 16:20:10.992900 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 16:20:10 crc kubenswrapper[5120]: I0316 16:20:10.999337 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 16:20:11 crc kubenswrapper[5120]: W0316 16:20:11.031406 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddacf3ba5_1ecd_46e4_bed9_e33f9b9ffd93.slice/crio-44a2cccc864973454484f69be739562b1909ac1559b25c7b301cb292e1794ade WatchSource:0}: Error finding container 44a2cccc864973454484f69be739562b1909ac1559b25c7b301cb292e1794ade: Status 404 returned error can't find the container with id 44a2cccc864973454484f69be739562b1909ac1559b25c7b301cb292e1794ade Mar 16 16:20:11 crc kubenswrapper[5120]: I0316 16:20:11.049314 5120 scope.go:117] "RemoveContainer" containerID="4e8dc1d069cbac7b06e5c6e3687fcf8e8f118bb132d322174aac0b0c84a0b2a9" Mar 16 16:20:11 crc kubenswrapper[5120]: I0316 16:20:11.161643 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 16:20:11 crc kubenswrapper[5120]: W0316 16:20:11.190853 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod47f6dea8_ee86_4de1_8bf7_3bbb7b5b4be1.slice/crio-c396eab7cfd04a68e003754d0f4dbce9e0d796206e592cb2e89291a1722bd249 WatchSource:0}: Error finding container c396eab7cfd04a68e003754d0f4dbce9e0d796206e592cb2e89291a1722bd249: Status 404 returned error can't find the container with id c396eab7cfd04a68e003754d0f4dbce9e0d796206e592cb2e89291a1722bd249 Mar 16 16:20:11 crc kubenswrapper[5120]: I0316 16:20:11.215186 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93","Type":"ContainerStarted","Data":"44a2cccc864973454484f69be739562b1909ac1559b25c7b301cb292e1794ade"} Mar 16 16:20:11 crc kubenswrapper[5120]: I0316 16:20:11.223791 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/perses-operator-669c9f96b5-m4vlq" event={"ID":"395765ab-8a57-4a9d-a0b5-f113e4914594","Type":"ContainerStarted","Data":"2684311c5c23d2a512dcac6912d0294d26838fc5ce68940ebe8b331b224252f6"} Mar 16 16:20:11 crc kubenswrapper[5120]: I0316 16:20:11.224322 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/perses-operator-669c9f96b5-m4vlq" Mar 16 16:20:11 crc kubenswrapper[5120]: I0316 16:20:11.226532 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/obo-prometheus-operator-9bc85b4bf-7p4jt" event={"ID":"18c84489-f690-4ef3-b74c-90c206024afd","Type":"ContainerStarted","Data":"95b97072531170c0d863de6c016c7c7ebc3b7204cc23f091e39347cea0a2379c"} Mar 16 16:20:11 crc kubenswrapper[5120]: I0316 16:20:11.228090 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"ba0d3286-038b-4735-b0b4-1ce9b3faeed1","Type":"ContainerStarted","Data":"b9f3c464989a1affa3a4f085c00961d5c30aedbd39d59ff691ab4f489b7b0402"} Mar 16 16:20:11 crc kubenswrapper[5120]: I0316 16:20:11.231817 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/obo-prometheus-operator-admission-webhook-669bcd8dd-zfrnj" event={"ID":"71f02692-3bf5-4e19-97a5-e7f79f2c52af","Type":"ContainerStarted","Data":"0b123baf7c1b95995f263cdef42cc0166bd97551b88505acd2df4a0292440eb7"} Mar 16 16:20:11 crc kubenswrapper[5120]: I0316 16:20:11.234980 5120 scope.go:117] "RemoveContainer" containerID="8f9466afed1f7a0ef7a6f3cac7487cf1ed203ee726c32fb4e6a13a8ca68d71a1" Mar 16 16:20:11 crc kubenswrapper[5120]: I0316 16:20:11.246382 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operators/perses-operator-669c9f96b5-m4vlq" podStartSLOduration=1.9342956550000001 podStartE2EDuration="14.246363418s" podCreationTimestamp="2026-03-16 16:19:57 +0000 UTC" firstStartedPulling="2026-03-16 16:19:58.052812997 +0000 UTC m=+2900.206744654" lastFinishedPulling="2026-03-16 16:20:10.36488076 +0000 UTC m=+2912.518812417" observedRunningTime="2026-03-16 16:20:11.242978577 +0000 UTC m=+2913.396910234" watchObservedRunningTime="2026-03-16 16:20:11.246363418 +0000 UTC m=+2913.400295075" Mar 16 16:20:11 crc kubenswrapper[5120]: I0316 16:20:11.261373 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operators/obo-prometheus-operator-admission-webhook-669bcd8dd-zfrnj" podStartSLOduration=2.722366215 podStartE2EDuration="15.261356328s" podCreationTimestamp="2026-03-16 16:19:56 +0000 UTC" firstStartedPulling="2026-03-16 16:19:57.825941789 +0000 UTC m=+2899.979873446" lastFinishedPulling="2026-03-16 16:20:10.364931902 +0000 UTC m=+2912.518863559" observedRunningTime="2026-03-16 16:20:11.25955943 +0000 UTC m=+2913.413491097" watchObservedRunningTime="2026-03-16 16:20:11.261356328 +0000 UTC m=+2913.415287985" Mar 16 16:20:11 crc kubenswrapper[5120]: I0316 16:20:11.266325 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"47f6dea8-ee86-4de1-8bf7-3bbb7b5b4be1","Type":"ContainerStarted","Data":"c396eab7cfd04a68e003754d0f4dbce9e0d796206e592cb2e89291a1722bd249"} Mar 16 16:20:11 crc kubenswrapper[5120]: I0316 16:20:11.270513 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"7df75da5-8410-4171-b485-8eebd87a15b0","Type":"ContainerStarted","Data":"8a9320db1190c17c21e36fb275d7c170a9a9b75d89e32651e1bccbd679c4cd39"} Mar 16 16:20:11 crc kubenswrapper[5120]: I0316 16:20:11.293680 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/observability-operator-85c68dddb-zj2rl" event={"ID":"4df87e18-229a-409c-8e61-36fc094b6de9","Type":"ContainerStarted","Data":"ff5bd44ca8a5a578dcd9dc88161e771393c2d2094a518c149e4f39cef2cb902e"} Mar 16 16:20:11 crc kubenswrapper[5120]: I0316 16:20:11.295199 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/observability-operator-85c68dddb-zj2rl" Mar 16 16:20:11 crc kubenswrapper[5120]: I0316 16:20:11.295249 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"9185c9ac-7b26-4bbc-be42-545c166ba2c8","Type":"ContainerStarted","Data":"966cbed3f89d1e6f4528814c78dcd7a2422097bfaeec397b30d5976e8f5edfbb"} Mar 16 16:20:11 crc kubenswrapper[5120]: I0316 16:20:11.304354 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operators/obo-prometheus-operator-9bc85b4bf-7p4jt" podStartSLOduration=2.410388121 podStartE2EDuration="15.304328968s" podCreationTimestamp="2026-03-16 16:19:56 +0000 UTC" firstStartedPulling="2026-03-16 16:19:57.504781078 +0000 UTC m=+2899.658712735" lastFinishedPulling="2026-03-16 16:20:10.398721925 +0000 UTC m=+2912.552653582" observedRunningTime="2026-03-16 16:20:11.289266605 +0000 UTC m=+2913.443198262" watchObservedRunningTime="2026-03-16 16:20:11.304328968 +0000 UTC m=+2913.458260625" Mar 16 16:20:11 crc kubenswrapper[5120]: I0316 16:20:11.309047 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/observability-operator-85c68dddb-zj2rl" Mar 16 16:20:11 crc kubenswrapper[5120]: I0316 16:20:11.329864 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operators/observability-operator-85c68dddb-zj2rl" podStartSLOduration=2.925547079 podStartE2EDuration="15.32984603s" podCreationTimestamp="2026-03-16 16:19:56 +0000 UTC" firstStartedPulling="2026-03-16 16:19:57.967212977 +0000 UTC m=+2900.121144634" lastFinishedPulling="2026-03-16 16:20:10.371511928 +0000 UTC m=+2912.525443585" observedRunningTime="2026-03-16 16:20:11.322859283 +0000 UTC m=+2913.476790940" watchObservedRunningTime="2026-03-16 16:20:11.32984603 +0000 UTC m=+2913.483777687" Mar 16 16:20:11 crc kubenswrapper[5120]: I0316 16:20:11.926234 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 16:20:11 crc kubenswrapper[5120]: I0316 16:20:11.939324 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:20:11 crc kubenswrapper[5120]: I0316 16:20:11.943377 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovndbcluster-sb-scripts\"" Mar 16 16:20:11 crc kubenswrapper[5120]: I0316 16:20:11.943621 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ovndbcluster-sb-ovndbs\"" Mar 16 16:20:11 crc kubenswrapper[5120]: I0316 16:20:11.944842 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovndbcluster-sb-config\"" Mar 16 16:20:11 crc kubenswrapper[5120]: I0316 16:20:11.952307 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ovncluster-ovndbcluster-sb-dockercfg-5c6n6\"" Mar 16 16:20:11 crc kubenswrapper[5120]: I0316 16:20:11.972748 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 16:20:12 crc kubenswrapper[5120]: I0316 16:20:12.051622 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/7ae11e5d-88eb-4be1-8936-985a2daadef0-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"7ae11e5d-88eb-4be1-8936-985a2daadef0\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:20:12 crc kubenswrapper[5120]: I0316 16:20:12.051933 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/7ae11e5d-88eb-4be1-8936-985a2daadef0-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"7ae11e5d-88eb-4be1-8936-985a2daadef0\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:20:12 crc kubenswrapper[5120]: I0316 16:20:12.052055 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/7ae11e5d-88eb-4be1-8936-985a2daadef0-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"7ae11e5d-88eb-4be1-8936-985a2daadef0\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:20:12 crc kubenswrapper[5120]: I0316 16:20:12.052130 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7ae11e5d-88eb-4be1-8936-985a2daadef0-config\") pod \"ovsdbserver-sb-0\" (UID: \"7ae11e5d-88eb-4be1-8936-985a2daadef0\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:20:12 crc kubenswrapper[5120]: I0316 16:20:12.052293 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/7ae11e5d-88eb-4be1-8936-985a2daadef0-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"7ae11e5d-88eb-4be1-8936-985a2daadef0\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:20:12 crc kubenswrapper[5120]: I0316 16:20:12.052460 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") pod \"ovsdbserver-sb-0\" (UID: \"7ae11e5d-88eb-4be1-8936-985a2daadef0\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:20:12 crc kubenswrapper[5120]: I0316 16:20:12.052529 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpkm2\" (UniqueName: \"kubernetes.io/projected/7ae11e5d-88eb-4be1-8936-985a2daadef0-kube-api-access-xpkm2\") pod \"ovsdbserver-sb-0\" (UID: \"7ae11e5d-88eb-4be1-8936-985a2daadef0\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:20:12 crc kubenswrapper[5120]: I0316 16:20:12.052568 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7ae11e5d-88eb-4be1-8936-985a2daadef0-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"7ae11e5d-88eb-4be1-8936-985a2daadef0\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:20:12 crc kubenswrapper[5120]: I0316 16:20:12.154008 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/7ae11e5d-88eb-4be1-8936-985a2daadef0-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"7ae11e5d-88eb-4be1-8936-985a2daadef0\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:20:12 crc kubenswrapper[5120]: I0316 16:20:12.154068 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") pod \"ovsdbserver-sb-0\" (UID: \"7ae11e5d-88eb-4be1-8936-985a2daadef0\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:20:12 crc kubenswrapper[5120]: I0316 16:20:12.154114 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xpkm2\" (UniqueName: \"kubernetes.io/projected/7ae11e5d-88eb-4be1-8936-985a2daadef0-kube-api-access-xpkm2\") pod \"ovsdbserver-sb-0\" (UID: \"7ae11e5d-88eb-4be1-8936-985a2daadef0\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:20:12 crc kubenswrapper[5120]: I0316 16:20:12.154145 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7ae11e5d-88eb-4be1-8936-985a2daadef0-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"7ae11e5d-88eb-4be1-8936-985a2daadef0\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:20:12 crc kubenswrapper[5120]: I0316 16:20:12.154209 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/7ae11e5d-88eb-4be1-8936-985a2daadef0-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"7ae11e5d-88eb-4be1-8936-985a2daadef0\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:20:12 crc kubenswrapper[5120]: I0316 16:20:12.154404 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") pod \"ovsdbserver-sb-0\" (UID: \"7ae11e5d-88eb-4be1-8936-985a2daadef0\") device mount path \"/mnt/openstack/pv14\"" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:20:12 crc kubenswrapper[5120]: I0316 16:20:12.154577 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/7ae11e5d-88eb-4be1-8936-985a2daadef0-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"7ae11e5d-88eb-4be1-8936-985a2daadef0\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:20:12 crc kubenswrapper[5120]: I0316 16:20:12.154642 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/7ae11e5d-88eb-4be1-8936-985a2daadef0-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"7ae11e5d-88eb-4be1-8936-985a2daadef0\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:20:12 crc kubenswrapper[5120]: I0316 16:20:12.154679 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7ae11e5d-88eb-4be1-8936-985a2daadef0-config\") pod \"ovsdbserver-sb-0\" (UID: \"7ae11e5d-88eb-4be1-8936-985a2daadef0\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:20:12 crc kubenswrapper[5120]: I0316 16:20:12.155700 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7ae11e5d-88eb-4be1-8936-985a2daadef0-config\") pod \"ovsdbserver-sb-0\" (UID: \"7ae11e5d-88eb-4be1-8936-985a2daadef0\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:20:12 crc kubenswrapper[5120]: I0316 16:20:12.156476 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/7ae11e5d-88eb-4be1-8936-985a2daadef0-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"7ae11e5d-88eb-4be1-8936-985a2daadef0\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:20:12 crc kubenswrapper[5120]: I0316 16:20:12.158960 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/7ae11e5d-88eb-4be1-8936-985a2daadef0-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"7ae11e5d-88eb-4be1-8936-985a2daadef0\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:20:12 crc kubenswrapper[5120]: I0316 16:20:12.159565 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/7ae11e5d-88eb-4be1-8936-985a2daadef0-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"7ae11e5d-88eb-4be1-8936-985a2daadef0\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:20:12 crc kubenswrapper[5120]: I0316 16:20:12.162248 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7ae11e5d-88eb-4be1-8936-985a2daadef0-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"7ae11e5d-88eb-4be1-8936-985a2daadef0\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:20:12 crc kubenswrapper[5120]: I0316 16:20:12.168332 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/7ae11e5d-88eb-4be1-8936-985a2daadef0-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"7ae11e5d-88eb-4be1-8936-985a2daadef0\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:20:12 crc kubenswrapper[5120]: I0316 16:20:12.173539 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpkm2\" (UniqueName: \"kubernetes.io/projected/7ae11e5d-88eb-4be1-8936-985a2daadef0-kube-api-access-xpkm2\") pod \"ovsdbserver-sb-0\" (UID: \"7ae11e5d-88eb-4be1-8936-985a2daadef0\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:20:12 crc kubenswrapper[5120]: I0316 16:20:12.182538 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") pod \"ovsdbserver-sb-0\" (UID: \"7ae11e5d-88eb-4be1-8936-985a2daadef0\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:20:12 crc kubenswrapper[5120]: I0316 16:20:12.271942 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:20:12 crc kubenswrapper[5120]: I0316 16:20:12.311355 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/obo-prometheus-operator-admission-webhook-669bcd8dd-pzkpw" event={"ID":"13869ea5-bd74-407b-a6ce-c20c6214d66a","Type":"ContainerStarted","Data":"481c7022b5284d3db7cfdec4718a08744799f2c2c88410c2a0726763c4db6454"} Mar 16 16:20:12 crc kubenswrapper[5120]: I0316 16:20:12.325503 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"47f6dea8-ee86-4de1-8bf7-3bbb7b5b4be1","Type":"ContainerStarted","Data":"f9993e08b1a1c6e83a003533f2dc36cc32a4e662efefb4ae622f4ee6f0fd404e"} Mar 16 16:20:12 crc kubenswrapper[5120]: I0316 16:20:12.325545 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"47f6dea8-ee86-4de1-8bf7-3bbb7b5b4be1","Type":"ContainerStarted","Data":"c4e58989b0e4c03f55cfdda8d9b7d8a1793435113a8b45dcd1505218a190c874"} Mar 16 16:20:12 crc kubenswrapper[5120]: I0316 16:20:12.345352 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operators/obo-prometheus-operator-admission-webhook-669bcd8dd-pzkpw" podStartSLOduration=3.5918768229999998 podStartE2EDuration="16.345339453s" podCreationTimestamp="2026-03-16 16:19:56 +0000 UTC" firstStartedPulling="2026-03-16 16:19:57.710768978 +0000 UTC m=+2899.864700635" lastFinishedPulling="2026-03-16 16:20:10.464231608 +0000 UTC m=+2912.618163265" observedRunningTime="2026-03-16 16:20:12.342974579 +0000 UTC m=+2914.496906236" watchObservedRunningTime="2026-03-16 16:20:12.345339453 +0000 UTC m=+2914.499271110" Mar 16 16:20:12 crc kubenswrapper[5120]: I0316 16:20:12.362430 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"7df75da5-8410-4171-b485-8eebd87a15b0","Type":"ContainerStarted","Data":"af562d53215e7974c3793aaba0dab638102c240038426e19f4953c83a80dde64"} Mar 16 16:20:12 crc kubenswrapper[5120]: I0316 16:20:12.363166 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:20:12 crc kubenswrapper[5120]: I0316 16:20:12.375707 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"9185c9ac-7b26-4bbc-be42-545c166ba2c8","Type":"ContainerStarted","Data":"c28bfe665bcd0544d43e21f6e2de3d861c2f37eb4482203437939e7ccb122494"} Mar 16 16:20:12 crc kubenswrapper[5120]: I0316 16:20:12.406978 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93","Type":"ContainerStarted","Data":"6a2fb343ca510feb5a32f2ce7721ac643d1503dbfd5a0b3e76d3ce922f56d65e"} Mar 16 16:20:12 crc kubenswrapper[5120]: I0316 16:20:12.410720 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"ba0d3286-038b-4735-b0b4-1ce9b3faeed1","Type":"ContainerStarted","Data":"3a4b5e65bf5e800c769f7c15e8f403de6b226620ed492165a5326a15bf9c76d3"} Mar 16 16:20:12 crc kubenswrapper[5120]: I0316 16:20:12.410870 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/memcached-0" Mar 16 16:20:12 crc kubenswrapper[5120]: I0316 16:20:12.415862 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podStartSLOduration=5.415848758 podStartE2EDuration="5.415848758s" podCreationTimestamp="2026-03-16 16:20:07 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:20:12.385126566 +0000 UTC m=+2914.539058243" watchObservedRunningTime="2026-03-16 16:20:12.415848758 +0000 UTC m=+2914.569780415" Mar 16 16:20:12 crc kubenswrapper[5120]: I0316 16:20:12.439462 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/kube-state-metrics-0" podStartSLOduration=6.814853483 podStartE2EDuration="7.439449019s" podCreationTimestamp="2026-03-16 16:20:05 +0000 UTC" firstStartedPulling="2026-03-16 16:20:10.996571996 +0000 UTC m=+2913.150503653" lastFinishedPulling="2026-03-16 16:20:11.621167532 +0000 UTC m=+2913.775099189" observedRunningTime="2026-03-16 16:20:12.436991323 +0000 UTC m=+2914.590922980" watchObservedRunningTime="2026-03-16 16:20:12.439449019 +0000 UTC m=+2914.593380666" Mar 16 16:20:12 crc kubenswrapper[5120]: I0316 16:20:12.464605 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/memcached-0" podStartSLOduration=9.464592202 podStartE2EDuration="9.464592202s" podCreationTimestamp="2026-03-16 16:20:03 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:20:12.458628342 +0000 UTC m=+2914.612559989" watchObservedRunningTime="2026-03-16 16:20:12.464592202 +0000 UTC m=+2914.618523849" Mar 16 16:20:12 crc kubenswrapper[5120]: I0316 16:20:12.847153 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 16:20:12 crc kubenswrapper[5120]: W0316 16:20:12.859419 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7ae11e5d_88eb_4be1_8936_985a2daadef0.slice/crio-fc168f961684ca96e5b21e3c362739e1c46878e4622c2675cfb0f8f2293fae79 WatchSource:0}: Error finding container fc168f961684ca96e5b21e3c362739e1c46878e4622c2675cfb0f8f2293fae79: Status 404 returned error can't find the container with id fc168f961684ca96e5b21e3c362739e1c46878e4622c2675cfb0f8f2293fae79 Mar 16 16:20:13 crc kubenswrapper[5120]: I0316 16:20:13.424823 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"7ae11e5d-88eb-4be1-8936-985a2daadef0","Type":"ContainerStarted","Data":"43b1e480c270d5982eb7544840036b7b1e664f5b3eda16d1c57593f55fd4e913"} Mar 16 16:20:13 crc kubenswrapper[5120]: I0316 16:20:13.425153 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"7ae11e5d-88eb-4be1-8936-985a2daadef0","Type":"ContainerStarted","Data":"30fb3aa88577d49531b8a5e3ae2d20fd54120a0e99aa07ccc38055fa65373f91"} Mar 16 16:20:13 crc kubenswrapper[5120]: I0316 16:20:13.425167 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"7ae11e5d-88eb-4be1-8936-985a2daadef0","Type":"ContainerStarted","Data":"fc168f961684ca96e5b21e3c362739e1c46878e4622c2675cfb0f8f2293fae79"} Mar 16 16:20:13 crc kubenswrapper[5120]: I0316 16:20:13.465699 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podStartSLOduration=3.465682438 podStartE2EDuration="3.465682438s" podCreationTimestamp="2026-03-16 16:20:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:20:13.462657678 +0000 UTC m=+2915.616589325" watchObservedRunningTime="2026-03-16 16:20:13.465682438 +0000 UTC m=+2915.619614085" Mar 16 16:20:14 crc kubenswrapper[5120]: I0316 16:20:14.033666 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:20:14 crc kubenswrapper[5120]: I0316 16:20:14.245252 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/alertmanager-metric-storage-0"] Mar 16 16:20:14 crc kubenswrapper[5120]: I0316 16:20:14.252045 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/alertmanager-metric-storage-0" Mar 16 16:20:14 crc kubenswrapper[5120]: I0316 16:20:14.255075 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"alertmanager-metric-storage-generated\"" Mar 16 16:20:14 crc kubenswrapper[5120]: I0316 16:20:14.255260 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"alertmanager-metric-storage-web-config\"" Mar 16 16:20:14 crc kubenswrapper[5120]: I0316 16:20:14.256034 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"alertmanager-metric-storage-cluster-tls-config\"" Mar 16 16:20:14 crc kubenswrapper[5120]: I0316 16:20:14.256089 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"metric-storage-alertmanager-dockercfg-v5mtq\"" Mar 16 16:20:14 crc kubenswrapper[5120]: I0316 16:20:14.256883 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"alertmanager-metric-storage-tls-assets-0\"" Mar 16 16:20:14 crc kubenswrapper[5120]: I0316 16:20:14.273035 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/alertmanager-metric-storage-0"] Mar 16 16:20:14 crc kubenswrapper[5120]: I0316 16:20:14.404204 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9b43ebee-5f04-44e0-a8bf-56f70871894e-web-config\") pod \"alertmanager-metric-storage-0\" (UID: \"9b43ebee-5f04-44e0-a8bf-56f70871894e\") " pod="openstack-kuttl-tests/alertmanager-metric-storage-0" Mar 16 16:20:14 crc kubenswrapper[5120]: I0316 16:20:14.404293 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9b43ebee-5f04-44e0-a8bf-56f70871894e-tls-assets\") pod \"alertmanager-metric-storage-0\" (UID: \"9b43ebee-5f04-44e0-a8bf-56f70871894e\") " pod="openstack-kuttl-tests/alertmanager-metric-storage-0" Mar 16 16:20:14 crc kubenswrapper[5120]: I0316 16:20:14.404339 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9b43ebee-5f04-44e0-a8bf-56f70871894e-cluster-tls-config\") pod \"alertmanager-metric-storage-0\" (UID: \"9b43ebee-5f04-44e0-a8bf-56f70871894e\") " pod="openstack-kuttl-tests/alertmanager-metric-storage-0" Mar 16 16:20:14 crc kubenswrapper[5120]: I0316 16:20:14.404391 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-glqjf\" (UniqueName: \"kubernetes.io/projected/9b43ebee-5f04-44e0-a8bf-56f70871894e-kube-api-access-glqjf\") pod \"alertmanager-metric-storage-0\" (UID: \"9b43ebee-5f04-44e0-a8bf-56f70871894e\") " pod="openstack-kuttl-tests/alertmanager-metric-storage-0" Mar 16 16:20:14 crc kubenswrapper[5120]: I0316 16:20:14.404412 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9b43ebee-5f04-44e0-a8bf-56f70871894e-config-volume\") pod \"alertmanager-metric-storage-0\" (UID: \"9b43ebee-5f04-44e0-a8bf-56f70871894e\") " pod="openstack-kuttl-tests/alertmanager-metric-storage-0" Mar 16 16:20:14 crc kubenswrapper[5120]: I0316 16:20:14.404427 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9b43ebee-5f04-44e0-a8bf-56f70871894e-config-out\") pod \"alertmanager-metric-storage-0\" (UID: \"9b43ebee-5f04-44e0-a8bf-56f70871894e\") " pod="openstack-kuttl-tests/alertmanager-metric-storage-0" Mar 16 16:20:14 crc kubenswrapper[5120]: I0316 16:20:14.404636 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-metric-storage-db\" (UniqueName: \"kubernetes.io/empty-dir/9b43ebee-5f04-44e0-a8bf-56f70871894e-alertmanager-metric-storage-db\") pod \"alertmanager-metric-storage-0\" (UID: \"9b43ebee-5f04-44e0-a8bf-56f70871894e\") " pod="openstack-kuttl-tests/alertmanager-metric-storage-0" Mar 16 16:20:14 crc kubenswrapper[5120]: I0316 16:20:14.506828 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9b43ebee-5f04-44e0-a8bf-56f70871894e-tls-assets\") pod \"alertmanager-metric-storage-0\" (UID: \"9b43ebee-5f04-44e0-a8bf-56f70871894e\") " pod="openstack-kuttl-tests/alertmanager-metric-storage-0" Mar 16 16:20:14 crc kubenswrapper[5120]: I0316 16:20:14.506922 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9b43ebee-5f04-44e0-a8bf-56f70871894e-cluster-tls-config\") pod \"alertmanager-metric-storage-0\" (UID: \"9b43ebee-5f04-44e0-a8bf-56f70871894e\") " pod="openstack-kuttl-tests/alertmanager-metric-storage-0" Mar 16 16:20:14 crc kubenswrapper[5120]: I0316 16:20:14.507793 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-glqjf\" (UniqueName: \"kubernetes.io/projected/9b43ebee-5f04-44e0-a8bf-56f70871894e-kube-api-access-glqjf\") pod \"alertmanager-metric-storage-0\" (UID: \"9b43ebee-5f04-44e0-a8bf-56f70871894e\") " pod="openstack-kuttl-tests/alertmanager-metric-storage-0" Mar 16 16:20:14 crc kubenswrapper[5120]: I0316 16:20:14.507904 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9b43ebee-5f04-44e0-a8bf-56f70871894e-config-volume\") pod \"alertmanager-metric-storage-0\" (UID: \"9b43ebee-5f04-44e0-a8bf-56f70871894e\") " pod="openstack-kuttl-tests/alertmanager-metric-storage-0" Mar 16 16:20:14 crc kubenswrapper[5120]: I0316 16:20:14.507966 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9b43ebee-5f04-44e0-a8bf-56f70871894e-config-out\") pod \"alertmanager-metric-storage-0\" (UID: \"9b43ebee-5f04-44e0-a8bf-56f70871894e\") " pod="openstack-kuttl-tests/alertmanager-metric-storage-0" Mar 16 16:20:14 crc kubenswrapper[5120]: I0316 16:20:14.508070 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-metric-storage-db\" (UniqueName: \"kubernetes.io/empty-dir/9b43ebee-5f04-44e0-a8bf-56f70871894e-alertmanager-metric-storage-db\") pod \"alertmanager-metric-storage-0\" (UID: \"9b43ebee-5f04-44e0-a8bf-56f70871894e\") " pod="openstack-kuttl-tests/alertmanager-metric-storage-0" Mar 16 16:20:14 crc kubenswrapper[5120]: I0316 16:20:14.508369 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9b43ebee-5f04-44e0-a8bf-56f70871894e-web-config\") pod \"alertmanager-metric-storage-0\" (UID: \"9b43ebee-5f04-44e0-a8bf-56f70871894e\") " pod="openstack-kuttl-tests/alertmanager-metric-storage-0" Mar 16 16:20:14 crc kubenswrapper[5120]: I0316 16:20:14.508752 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-metric-storage-db\" (UniqueName: \"kubernetes.io/empty-dir/9b43ebee-5f04-44e0-a8bf-56f70871894e-alertmanager-metric-storage-db\") pod \"alertmanager-metric-storage-0\" (UID: \"9b43ebee-5f04-44e0-a8bf-56f70871894e\") " pod="openstack-kuttl-tests/alertmanager-metric-storage-0" Mar 16 16:20:14 crc kubenswrapper[5120]: I0316 16:20:14.517625 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9b43ebee-5f04-44e0-a8bf-56f70871894e-config-volume\") pod \"alertmanager-metric-storage-0\" (UID: \"9b43ebee-5f04-44e0-a8bf-56f70871894e\") " pod="openstack-kuttl-tests/alertmanager-metric-storage-0" Mar 16 16:20:14 crc kubenswrapper[5120]: I0316 16:20:14.522227 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9b43ebee-5f04-44e0-a8bf-56f70871894e-config-out\") pod \"alertmanager-metric-storage-0\" (UID: \"9b43ebee-5f04-44e0-a8bf-56f70871894e\") " pod="openstack-kuttl-tests/alertmanager-metric-storage-0" Mar 16 16:20:14 crc kubenswrapper[5120]: I0316 16:20:14.522864 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9b43ebee-5f04-44e0-a8bf-56f70871894e-tls-assets\") pod \"alertmanager-metric-storage-0\" (UID: \"9b43ebee-5f04-44e0-a8bf-56f70871894e\") " pod="openstack-kuttl-tests/alertmanager-metric-storage-0" Mar 16 16:20:14 crc kubenswrapper[5120]: I0316 16:20:14.527355 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9b43ebee-5f04-44e0-a8bf-56f70871894e-web-config\") pod \"alertmanager-metric-storage-0\" (UID: \"9b43ebee-5f04-44e0-a8bf-56f70871894e\") " pod="openstack-kuttl-tests/alertmanager-metric-storage-0" Mar 16 16:20:14 crc kubenswrapper[5120]: I0316 16:20:14.531634 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9b43ebee-5f04-44e0-a8bf-56f70871894e-cluster-tls-config\") pod \"alertmanager-metric-storage-0\" (UID: \"9b43ebee-5f04-44e0-a8bf-56f70871894e\") " pod="openstack-kuttl-tests/alertmanager-metric-storage-0" Mar 16 16:20:14 crc kubenswrapper[5120]: I0316 16:20:14.536371 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-glqjf\" (UniqueName: \"kubernetes.io/projected/9b43ebee-5f04-44e0-a8bf-56f70871894e-kube-api-access-glqjf\") pod \"alertmanager-metric-storage-0\" (UID: \"9b43ebee-5f04-44e0-a8bf-56f70871894e\") " pod="openstack-kuttl-tests/alertmanager-metric-storage-0" Mar 16 16:20:14 crc kubenswrapper[5120]: I0316 16:20:14.568994 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/alertmanager-metric-storage-0" Mar 16 16:20:15 crc kubenswrapper[5120]: I0316 16:20:15.033277 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:20:15 crc kubenswrapper[5120]: I0316 16:20:15.081597 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/alertmanager-metric-storage-0"] Mar 16 16:20:15 crc kubenswrapper[5120]: W0316 16:20:15.089981 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b43ebee_5f04_44e0_a8bf_56f70871894e.slice/crio-2c71e99e580c97c17b132527f62bcfd7cbaa417dad592c33bc45556834c34181 WatchSource:0}: Error finding container 2c71e99e580c97c17b132527f62bcfd7cbaa417dad592c33bc45556834c34181: Status 404 returned error can't find the container with id 2c71e99e580c97c17b132527f62bcfd7cbaa417dad592c33bc45556834c34181 Mar 16 16:20:15 crc kubenswrapper[5120]: I0316 16:20:15.132119 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:20:15 crc kubenswrapper[5120]: I0316 16:20:15.273228 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:20:15 crc kubenswrapper[5120]: I0316 16:20:15.365435 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/prometheus-metric-storage-0"] Mar 16 16:20:15 crc kubenswrapper[5120]: I0316 16:20:15.374132 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/prometheus-metric-storage-0" Mar 16 16:20:15 crc kubenswrapper[5120]: I0316 16:20:15.375973 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"prometheus-metric-storage-rulefiles-1\"" Mar 16 16:20:15 crc kubenswrapper[5120]: I0316 16:20:15.376050 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"prometheus-metric-storage-web-config\"" Mar 16 16:20:15 crc kubenswrapper[5120]: I0316 16:20:15.377021 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"prometheus-metric-storage-thanos-prometheus-http-client-file\"" Mar 16 16:20:15 crc kubenswrapper[5120]: I0316 16:20:15.377376 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"prometheus-metric-storage-rulefiles-2\"" Mar 16 16:20:15 crc kubenswrapper[5120]: I0316 16:20:15.377379 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"prometheus-metric-storage-rulefiles-0\"" Mar 16 16:20:15 crc kubenswrapper[5120]: I0316 16:20:15.377921 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"prometheus-metric-storage\"" Mar 16 16:20:15 crc kubenswrapper[5120]: I0316 16:20:15.379827 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/prometheus-metric-storage-0"] Mar 16 16:20:15 crc kubenswrapper[5120]: I0316 16:20:15.383947 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"metric-storage-prometheus-dockercfg-mvdng\"" Mar 16 16:20:15 crc kubenswrapper[5120]: I0316 16:20:15.385416 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"prometheus-metric-storage-tls-assets-0\"" Mar 16 16:20:15 crc kubenswrapper[5120]: I0316 16:20:15.421193 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e007aee0-65df-4ec7-bd52-23bf7f4b704f-tls-assets\") pod \"prometheus-metric-storage-0\" (UID: \"e007aee0-65df-4ec7-bd52-23bf7f4b704f\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Mar 16 16:20:15 crc kubenswrapper[5120]: I0316 16:20:15.421249 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e007aee0-65df-4ec7-bd52-23bf7f4b704f-config-out\") pod \"prometheus-metric-storage-0\" (UID: \"e007aee0-65df-4ec7-bd52-23bf7f4b704f\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Mar 16 16:20:15 crc kubenswrapper[5120]: I0316 16:20:15.421297 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e007aee0-65df-4ec7-bd52-23bf7f4b704f-web-config\") pod \"prometheus-metric-storage-0\" (UID: \"e007aee0-65df-4ec7-bd52-23bf7f4b704f\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Mar 16 16:20:15 crc kubenswrapper[5120]: I0316 16:20:15.421317 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-metric-storage-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e007aee0-65df-4ec7-bd52-23bf7f4b704f-prometheus-metric-storage-rulefiles-2\") pod \"prometheus-metric-storage-0\" (UID: \"e007aee0-65df-4ec7-bd52-23bf7f4b704f\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Mar 16 16:20:15 crc kubenswrapper[5120]: I0316 16:20:15.421357 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"prometheus-metric-storage-0\" (UID: \"e007aee0-65df-4ec7-bd52-23bf7f4b704f\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Mar 16 16:20:15 crc kubenswrapper[5120]: I0316 16:20:15.421410 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86mwh\" (UniqueName: \"kubernetes.io/projected/e007aee0-65df-4ec7-bd52-23bf7f4b704f-kube-api-access-86mwh\") pod \"prometheus-metric-storage-0\" (UID: \"e007aee0-65df-4ec7-bd52-23bf7f4b704f\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Mar 16 16:20:15 crc kubenswrapper[5120]: I0316 16:20:15.421447 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-metric-storage-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e007aee0-65df-4ec7-bd52-23bf7f4b704f-prometheus-metric-storage-rulefiles-0\") pod \"prometheus-metric-storage-0\" (UID: \"e007aee0-65df-4ec7-bd52-23bf7f4b704f\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Mar 16 16:20:15 crc kubenswrapper[5120]: I0316 16:20:15.421462 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-metric-storage-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e007aee0-65df-4ec7-bd52-23bf7f4b704f-prometheus-metric-storage-rulefiles-1\") pod \"prometheus-metric-storage-0\" (UID: \"e007aee0-65df-4ec7-bd52-23bf7f4b704f\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Mar 16 16:20:15 crc kubenswrapper[5120]: I0316 16:20:15.421490 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e007aee0-65df-4ec7-bd52-23bf7f4b704f-thanos-prometheus-http-client-file\") pod \"prometheus-metric-storage-0\" (UID: \"e007aee0-65df-4ec7-bd52-23bf7f4b704f\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Mar 16 16:20:15 crc kubenswrapper[5120]: I0316 16:20:15.421528 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e007aee0-65df-4ec7-bd52-23bf7f4b704f-config\") pod \"prometheus-metric-storage-0\" (UID: \"e007aee0-65df-4ec7-bd52-23bf7f4b704f\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Mar 16 16:20:15 crc kubenswrapper[5120]: I0316 16:20:15.445251 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/alertmanager-metric-storage-0" event={"ID":"9b43ebee-5f04-44e0-a8bf-56f70871894e","Type":"ContainerStarted","Data":"2c71e99e580c97c17b132527f62bcfd7cbaa417dad592c33bc45556834c34181"} Mar 16 16:20:15 crc kubenswrapper[5120]: I0316 16:20:15.524026 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e007aee0-65df-4ec7-bd52-23bf7f4b704f-web-config\") pod \"prometheus-metric-storage-0\" (UID: \"e007aee0-65df-4ec7-bd52-23bf7f4b704f\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Mar 16 16:20:15 crc kubenswrapper[5120]: I0316 16:20:15.524072 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-metric-storage-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e007aee0-65df-4ec7-bd52-23bf7f4b704f-prometheus-metric-storage-rulefiles-2\") pod \"prometheus-metric-storage-0\" (UID: \"e007aee0-65df-4ec7-bd52-23bf7f4b704f\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Mar 16 16:20:15 crc kubenswrapper[5120]: I0316 16:20:15.524133 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"prometheus-metric-storage-0\" (UID: \"e007aee0-65df-4ec7-bd52-23bf7f4b704f\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Mar 16 16:20:15 crc kubenswrapper[5120]: I0316 16:20:15.524224 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-86mwh\" (UniqueName: \"kubernetes.io/projected/e007aee0-65df-4ec7-bd52-23bf7f4b704f-kube-api-access-86mwh\") pod \"prometheus-metric-storage-0\" (UID: \"e007aee0-65df-4ec7-bd52-23bf7f4b704f\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Mar 16 16:20:15 crc kubenswrapper[5120]: I0316 16:20:15.524652 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-metric-storage-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e007aee0-65df-4ec7-bd52-23bf7f4b704f-prometheus-metric-storage-rulefiles-0\") pod \"prometheus-metric-storage-0\" (UID: \"e007aee0-65df-4ec7-bd52-23bf7f4b704f\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Mar 16 16:20:15 crc kubenswrapper[5120]: I0316 16:20:15.524673 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-metric-storage-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e007aee0-65df-4ec7-bd52-23bf7f4b704f-prometheus-metric-storage-rulefiles-1\") pod \"prometheus-metric-storage-0\" (UID: \"e007aee0-65df-4ec7-bd52-23bf7f4b704f\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Mar 16 16:20:15 crc kubenswrapper[5120]: I0316 16:20:15.524699 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e007aee0-65df-4ec7-bd52-23bf7f4b704f-thanos-prometheus-http-client-file\") pod \"prometheus-metric-storage-0\" (UID: \"e007aee0-65df-4ec7-bd52-23bf7f4b704f\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Mar 16 16:20:15 crc kubenswrapper[5120]: I0316 16:20:15.524750 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e007aee0-65df-4ec7-bd52-23bf7f4b704f-config\") pod \"prometheus-metric-storage-0\" (UID: \"e007aee0-65df-4ec7-bd52-23bf7f4b704f\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Mar 16 16:20:15 crc kubenswrapper[5120]: I0316 16:20:15.524860 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e007aee0-65df-4ec7-bd52-23bf7f4b704f-tls-assets\") pod \"prometheus-metric-storage-0\" (UID: \"e007aee0-65df-4ec7-bd52-23bf7f4b704f\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Mar 16 16:20:15 crc kubenswrapper[5120]: I0316 16:20:15.525720 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"prometheus-metric-storage-0\" (UID: \"e007aee0-65df-4ec7-bd52-23bf7f4b704f\") device mount path \"/mnt/openstack/pv10\"" pod="openstack-kuttl-tests/prometheus-metric-storage-0" Mar 16 16:20:15 crc kubenswrapper[5120]: I0316 16:20:15.525948 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-metric-storage-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e007aee0-65df-4ec7-bd52-23bf7f4b704f-prometheus-metric-storage-rulefiles-0\") pod \"prometheus-metric-storage-0\" (UID: \"e007aee0-65df-4ec7-bd52-23bf7f4b704f\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Mar 16 16:20:15 crc kubenswrapper[5120]: I0316 16:20:15.525982 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-metric-storage-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e007aee0-65df-4ec7-bd52-23bf7f4b704f-prometheus-metric-storage-rulefiles-2\") pod \"prometheus-metric-storage-0\" (UID: \"e007aee0-65df-4ec7-bd52-23bf7f4b704f\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Mar 16 16:20:15 crc kubenswrapper[5120]: I0316 16:20:15.526306 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e007aee0-65df-4ec7-bd52-23bf7f4b704f-config-out\") pod \"prometheus-metric-storage-0\" (UID: \"e007aee0-65df-4ec7-bd52-23bf7f4b704f\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Mar 16 16:20:15 crc kubenswrapper[5120]: I0316 16:20:15.526440 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-metric-storage-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e007aee0-65df-4ec7-bd52-23bf7f4b704f-prometheus-metric-storage-rulefiles-1\") pod \"prometheus-metric-storage-0\" (UID: \"e007aee0-65df-4ec7-bd52-23bf7f4b704f\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Mar 16 16:20:15 crc kubenswrapper[5120]: I0316 16:20:15.530316 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e007aee0-65df-4ec7-bd52-23bf7f4b704f-thanos-prometheus-http-client-file\") pod \"prometheus-metric-storage-0\" (UID: \"e007aee0-65df-4ec7-bd52-23bf7f4b704f\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Mar 16 16:20:15 crc kubenswrapper[5120]: I0316 16:20:15.530496 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/e007aee0-65df-4ec7-bd52-23bf7f4b704f-config\") pod \"prometheus-metric-storage-0\" (UID: \"e007aee0-65df-4ec7-bd52-23bf7f4b704f\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Mar 16 16:20:15 crc kubenswrapper[5120]: I0316 16:20:15.531371 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e007aee0-65df-4ec7-bd52-23bf7f4b704f-tls-assets\") pod \"prometheus-metric-storage-0\" (UID: \"e007aee0-65df-4ec7-bd52-23bf7f4b704f\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Mar 16 16:20:15 crc kubenswrapper[5120]: I0316 16:20:15.531567 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e007aee0-65df-4ec7-bd52-23bf7f4b704f-config-out\") pod \"prometheus-metric-storage-0\" (UID: \"e007aee0-65df-4ec7-bd52-23bf7f4b704f\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Mar 16 16:20:15 crc kubenswrapper[5120]: I0316 16:20:15.536340 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e007aee0-65df-4ec7-bd52-23bf7f4b704f-web-config\") pod \"prometheus-metric-storage-0\" (UID: \"e007aee0-65df-4ec7-bd52-23bf7f4b704f\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Mar 16 16:20:15 crc kubenswrapper[5120]: I0316 16:20:15.553852 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-86mwh\" (UniqueName: \"kubernetes.io/projected/e007aee0-65df-4ec7-bd52-23bf7f4b704f-kube-api-access-86mwh\") pod \"prometheus-metric-storage-0\" (UID: \"e007aee0-65df-4ec7-bd52-23bf7f4b704f\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Mar 16 16:20:15 crc kubenswrapper[5120]: I0316 16:20:15.555953 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"prometheus-metric-storage-0\" (UID: \"e007aee0-65df-4ec7-bd52-23bf7f4b704f\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Mar 16 16:20:15 crc kubenswrapper[5120]: I0316 16:20:15.694276 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/prometheus-metric-storage-0" Mar 16 16:20:16 crc kubenswrapper[5120]: I0316 16:20:16.159482 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/prometheus-metric-storage-0"] Mar 16 16:20:16 crc kubenswrapper[5120]: I0316 16:20:16.457273 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/prometheus-metric-storage-0" event={"ID":"e007aee0-65df-4ec7-bd52-23bf7f4b704f","Type":"ContainerStarted","Data":"692934be2005dc0de86279f0e85a81cd76859725e50367da82b7ad55406585d5"} Mar 16 16:20:16 crc kubenswrapper[5120]: I0316 16:20:16.459215 5120 generic.go:358] "Generic (PLEG): container finished" podID="9185c9ac-7b26-4bbc-be42-545c166ba2c8" containerID="c28bfe665bcd0544d43e21f6e2de3d861c2f37eb4482203437939e7ccb122494" exitCode=0 Mar 16 16:20:16 crc kubenswrapper[5120]: I0316 16:20:16.460230 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"9185c9ac-7b26-4bbc-be42-545c166ba2c8","Type":"ContainerDied","Data":"c28bfe665bcd0544d43e21f6e2de3d861c2f37eb4482203437939e7ccb122494"} Mar 16 16:20:16 crc kubenswrapper[5120]: I0316 16:20:16.512602 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:20:17 crc kubenswrapper[5120]: I0316 16:20:17.273133 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:20:17 crc kubenswrapper[5120]: I0316 16:20:17.472750 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"9185c9ac-7b26-4bbc-be42-545c166ba2c8","Type":"ContainerStarted","Data":"adf00bc598caf7fd100ad6d9a04dd18b37b6a59bdd16122c1c463bf65b466e55"} Mar 16 16:20:18 crc kubenswrapper[5120]: I0316 16:20:18.313201 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:20:18 crc kubenswrapper[5120]: I0316 16:20:18.335814 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstack-galera-0" podStartSLOduration=16.33578957 podStartE2EDuration="16.33578957s" podCreationTimestamp="2026-03-16 16:20:02 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:20:17.511539013 +0000 UTC m=+2919.665470670" watchObservedRunningTime="2026-03-16 16:20:18.33578957 +0000 UTC m=+2920.489721237" Mar 16 16:20:18 crc kubenswrapper[5120]: I0316 16:20:18.384406 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:20:18 crc kubenswrapper[5120]: I0316 16:20:18.432927 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/memcached-0" Mar 16 16:20:18 crc kubenswrapper[5120]: I0316 16:20:18.694400 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 16:20:18 crc kubenswrapper[5120]: I0316 16:20:18.700672 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:20:18 crc kubenswrapper[5120]: I0316 16:20:18.703324 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovnnorthd-scripts\"" Mar 16 16:20:18 crc kubenswrapper[5120]: I0316 16:20:18.703394 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovnnorthd-config\"" Mar 16 16:20:18 crc kubenswrapper[5120]: I0316 16:20:18.703832 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ovnnorthd-ovnnorthd-dockercfg-fdf8p\"" Mar 16 16:20:18 crc kubenswrapper[5120]: I0316 16:20:18.703879 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ovnnorthd-ovndbs\"" Mar 16 16:20:18 crc kubenswrapper[5120]: I0316 16:20:18.710558 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 16:20:18 crc kubenswrapper[5120]: I0316 16:20:18.790134 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/794d950a-8664-4970-963a-2773749103e0-scripts\") pod \"ovn-northd-0\" (UID: \"794d950a-8664-4970-963a-2773749103e0\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:20:18 crc kubenswrapper[5120]: I0316 16:20:18.790368 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/794d950a-8664-4970-963a-2773749103e0-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"794d950a-8664-4970-963a-2773749103e0\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:20:18 crc kubenswrapper[5120]: I0316 16:20:18.790496 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4xhk\" (UniqueName: \"kubernetes.io/projected/794d950a-8664-4970-963a-2773749103e0-kube-api-access-s4xhk\") pod \"ovn-northd-0\" (UID: \"794d950a-8664-4970-963a-2773749103e0\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:20:18 crc kubenswrapper[5120]: I0316 16:20:18.790567 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/794d950a-8664-4970-963a-2773749103e0-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"794d950a-8664-4970-963a-2773749103e0\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:20:18 crc kubenswrapper[5120]: I0316 16:20:18.790626 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/794d950a-8664-4970-963a-2773749103e0-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"794d950a-8664-4970-963a-2773749103e0\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:20:18 crc kubenswrapper[5120]: I0316 16:20:18.790751 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/794d950a-8664-4970-963a-2773749103e0-config\") pod \"ovn-northd-0\" (UID: \"794d950a-8664-4970-963a-2773749103e0\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:20:18 crc kubenswrapper[5120]: I0316 16:20:18.791083 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/794d950a-8664-4970-963a-2773749103e0-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"794d950a-8664-4970-963a-2773749103e0\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:20:18 crc kubenswrapper[5120]: I0316 16:20:18.892625 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/794d950a-8664-4970-963a-2773749103e0-scripts\") pod \"ovn-northd-0\" (UID: \"794d950a-8664-4970-963a-2773749103e0\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:20:18 crc kubenswrapper[5120]: I0316 16:20:18.892698 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/794d950a-8664-4970-963a-2773749103e0-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"794d950a-8664-4970-963a-2773749103e0\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:20:18 crc kubenswrapper[5120]: I0316 16:20:18.892770 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s4xhk\" (UniqueName: \"kubernetes.io/projected/794d950a-8664-4970-963a-2773749103e0-kube-api-access-s4xhk\") pod \"ovn-northd-0\" (UID: \"794d950a-8664-4970-963a-2773749103e0\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:20:18 crc kubenswrapper[5120]: I0316 16:20:18.893747 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/794d950a-8664-4970-963a-2773749103e0-scripts\") pod \"ovn-northd-0\" (UID: \"794d950a-8664-4970-963a-2773749103e0\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:20:18 crc kubenswrapper[5120]: I0316 16:20:18.893844 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/794d950a-8664-4970-963a-2773749103e0-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"794d950a-8664-4970-963a-2773749103e0\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:20:18 crc kubenswrapper[5120]: I0316 16:20:18.893891 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/794d950a-8664-4970-963a-2773749103e0-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"794d950a-8664-4970-963a-2773749103e0\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:20:18 crc kubenswrapper[5120]: I0316 16:20:18.893938 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/794d950a-8664-4970-963a-2773749103e0-config\") pod \"ovn-northd-0\" (UID: \"794d950a-8664-4970-963a-2773749103e0\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:20:18 crc kubenswrapper[5120]: I0316 16:20:18.893999 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/794d950a-8664-4970-963a-2773749103e0-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"794d950a-8664-4970-963a-2773749103e0\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:20:18 crc kubenswrapper[5120]: I0316 16:20:18.894352 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/794d950a-8664-4970-963a-2773749103e0-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"794d950a-8664-4970-963a-2773749103e0\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:20:18 crc kubenswrapper[5120]: I0316 16:20:18.895416 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/794d950a-8664-4970-963a-2773749103e0-config\") pod \"ovn-northd-0\" (UID: \"794d950a-8664-4970-963a-2773749103e0\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:20:18 crc kubenswrapper[5120]: I0316 16:20:18.909615 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/794d950a-8664-4970-963a-2773749103e0-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"794d950a-8664-4970-963a-2773749103e0\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:20:18 crc kubenswrapper[5120]: I0316 16:20:18.909666 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/794d950a-8664-4970-963a-2773749103e0-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"794d950a-8664-4970-963a-2773749103e0\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:20:18 crc kubenswrapper[5120]: I0316 16:20:18.909671 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/794d950a-8664-4970-963a-2773749103e0-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"794d950a-8664-4970-963a-2773749103e0\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:20:18 crc kubenswrapper[5120]: I0316 16:20:18.997469 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4xhk\" (UniqueName: \"kubernetes.io/projected/794d950a-8664-4970-963a-2773749103e0-kube-api-access-s4xhk\") pod \"ovn-northd-0\" (UID: \"794d950a-8664-4970-963a-2773749103e0\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:20:19 crc kubenswrapper[5120]: I0316 16:20:19.018439 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:20:19 crc kubenswrapper[5120]: W0316 16:20:19.497146 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod794d950a_8664_4970_963a_2773749103e0.slice/crio-5f48480c944c7603cbd6f64783745e4a564303f08c21cb0422baddefbeed2a24 WatchSource:0}: Error finding container 5f48480c944c7603cbd6f64783745e4a564303f08c21cb0422baddefbeed2a24: Status 404 returned error can't find the container with id 5f48480c944c7603cbd6f64783745e4a564303f08c21cb0422baddefbeed2a24 Mar 16 16:20:19 crc kubenswrapper[5120]: I0316 16:20:19.500210 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 16:20:20 crc kubenswrapper[5120]: I0316 16:20:20.507944 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/alertmanager-metric-storage-0" event={"ID":"9b43ebee-5f04-44e0-a8bf-56f70871894e","Type":"ContainerStarted","Data":"83b1a0951aacf8c335110caf5c001078ee4b461c91a37a5ee3ff5fbf1294518b"} Mar 16 16:20:20 crc kubenswrapper[5120]: I0316 16:20:20.510494 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"794d950a-8664-4970-963a-2773749103e0","Type":"ContainerStarted","Data":"0419588781daf97a47d3362db1f9a8d1a88d231d99c1a6cb08730e97206c4fed"} Mar 16 16:20:20 crc kubenswrapper[5120]: I0316 16:20:20.510523 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"794d950a-8664-4970-963a-2773749103e0","Type":"ContainerStarted","Data":"5f48480c944c7603cbd6f64783745e4a564303f08c21cb0422baddefbeed2a24"} Mar 16 16:20:20 crc kubenswrapper[5120]: I0316 16:20:20.513079 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/prometheus-metric-storage-0" event={"ID":"e007aee0-65df-4ec7-bd52-23bf7f4b704f","Type":"ContainerStarted","Data":"53d03858cadc5105eba35075d2d8179684dcb66d28a132eb4b7fa7a08dd123dd"} Mar 16 16:20:21 crc kubenswrapper[5120]: I0316 16:20:21.524267 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"794d950a-8664-4970-963a-2773749103e0","Type":"ContainerStarted","Data":"28a01c5edf4ff6aef66071041d049bd9bd12e77fbd906ddfb625be33100a15b5"} Mar 16 16:20:21 crc kubenswrapper[5120]: I0316 16:20:21.525241 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:20:21 crc kubenswrapper[5120]: I0316 16:20:21.548191 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovn-northd-0" podStartSLOduration=3.548170641 podStartE2EDuration="3.548170641s" podCreationTimestamp="2026-03-16 16:20:18 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:20:21.544408211 +0000 UTC m=+2923.698339878" watchObservedRunningTime="2026-03-16 16:20:21.548170641 +0000 UTC m=+2923.702102298" Mar 16 16:20:22 crc kubenswrapper[5120]: I0316 16:20:22.008047 5120 patch_prober.go:28] interesting pod/machine-config-daemon-7bf76 container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 16:20:22 crc kubenswrapper[5120]: I0316 16:20:22.008125 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 16:20:22 crc kubenswrapper[5120]: I0316 16:20:22.008172 5120 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" Mar 16 16:20:22 crc kubenswrapper[5120]: I0316 16:20:22.009203 5120 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="machine-config-daemon" containerStatusID={"Type":"cri-o","ID":"f40e444f89abd558ac90555bfd58e04a1c4379a653ba8035c228d2b7a5443eb5"} pod="openshift-machine-config-operator/machine-config-daemon-7bf76" containerMessage="Container machine-config-daemon failed liveness probe, will be restarted" Mar 16 16:20:22 crc kubenswrapper[5120]: I0316 16:20:22.009275 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" containerID="cri-o://f40e444f89abd558ac90555bfd58e04a1c4379a653ba8035c228d2b7a5443eb5" gracePeriod=600 Mar 16 16:20:22 crc kubenswrapper[5120]: E0316 16:20:22.151164 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:20:22 crc kubenswrapper[5120]: I0316 16:20:22.416354 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/perses-operator-669c9f96b5-m4vlq" Mar 16 16:20:22 crc kubenswrapper[5120]: I0316 16:20:22.536907 5120 generic.go:358] "Generic (PLEG): container finished" podID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerID="f40e444f89abd558ac90555bfd58e04a1c4379a653ba8035c228d2b7a5443eb5" exitCode=0 Mar 16 16:20:22 crc kubenswrapper[5120]: I0316 16:20:22.536965 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" event={"ID":"e2275cb4-4905-4d66-a87e-8010120db2bd","Type":"ContainerDied","Data":"f40e444f89abd558ac90555bfd58e04a1c4379a653ba8035c228d2b7a5443eb5"} Mar 16 16:20:22 crc kubenswrapper[5120]: I0316 16:20:22.537134 5120 scope.go:117] "RemoveContainer" containerID="c6f2e7729551b434e995735fce26cb8624554f70ca6b56bae845f839f1f3f2df" Mar 16 16:20:22 crc kubenswrapper[5120]: I0316 16:20:22.538118 5120 scope.go:117] "RemoveContainer" containerID="f40e444f89abd558ac90555bfd58e04a1c4379a653ba8035c228d2b7a5443eb5" Mar 16 16:20:22 crc kubenswrapper[5120]: E0316 16:20:22.538485 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:20:23 crc kubenswrapper[5120]: I0316 16:20:23.383108 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:20:23 crc kubenswrapper[5120]: I0316 16:20:23.383426 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:20:23 crc kubenswrapper[5120]: I0316 16:20:23.518059 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:20:23 crc kubenswrapper[5120]: I0316 16:20:23.711966 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:20:24 crc kubenswrapper[5120]: I0316 16:20:24.433720 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:20:24 crc kubenswrapper[5120]: I0316 16:20:24.791937 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-db-create-5jzgn"] Mar 16 16:20:24 crc kubenswrapper[5120]: I0316 16:20:24.803259 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-create-5jzgn" Mar 16 16:20:24 crc kubenswrapper[5120]: I0316 16:20:24.809052 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-db-create-5jzgn"] Mar 16 16:20:24 crc kubenswrapper[5120]: I0316 16:20:24.897730 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-b6ca-account-create-update-zpt89"] Mar 16 16:20:24 crc kubenswrapper[5120]: I0316 16:20:24.907058 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pcrbk\" (UniqueName: \"kubernetes.io/projected/c6d25137-770c-4094-9c3a-85b1ac79873c-kube-api-access-pcrbk\") pod \"keystone-db-create-5jzgn\" (UID: \"c6d25137-770c-4094-9c3a-85b1ac79873c\") " pod="openstack-kuttl-tests/keystone-db-create-5jzgn" Mar 16 16:20:24 crc kubenswrapper[5120]: I0316 16:20:24.907204 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c6d25137-770c-4094-9c3a-85b1ac79873c-operator-scripts\") pod \"keystone-db-create-5jzgn\" (UID: \"c6d25137-770c-4094-9c3a-85b1ac79873c\") " pod="openstack-kuttl-tests/keystone-db-create-5jzgn" Mar 16 16:20:24 crc kubenswrapper[5120]: I0316 16:20:24.915570 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-b6ca-account-create-update-zpt89" Mar 16 16:20:24 crc kubenswrapper[5120]: I0316 16:20:24.918654 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-db-secret\"" Mar 16 16:20:24 crc kubenswrapper[5120]: I0316 16:20:24.937593 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-b6ca-account-create-update-zpt89"] Mar 16 16:20:25 crc kubenswrapper[5120]: I0316 16:20:25.008397 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pcrbk\" (UniqueName: \"kubernetes.io/projected/c6d25137-770c-4094-9c3a-85b1ac79873c-kube-api-access-pcrbk\") pod \"keystone-db-create-5jzgn\" (UID: \"c6d25137-770c-4094-9c3a-85b1ac79873c\") " pod="openstack-kuttl-tests/keystone-db-create-5jzgn" Mar 16 16:20:25 crc kubenswrapper[5120]: I0316 16:20:25.008538 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c6d25137-770c-4094-9c3a-85b1ac79873c-operator-scripts\") pod \"keystone-db-create-5jzgn\" (UID: \"c6d25137-770c-4094-9c3a-85b1ac79873c\") " pod="openstack-kuttl-tests/keystone-db-create-5jzgn" Mar 16 16:20:25 crc kubenswrapper[5120]: I0316 16:20:25.009319 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c6d25137-770c-4094-9c3a-85b1ac79873c-operator-scripts\") pod \"keystone-db-create-5jzgn\" (UID: \"c6d25137-770c-4094-9c3a-85b1ac79873c\") " pod="openstack-kuttl-tests/keystone-db-create-5jzgn" Mar 16 16:20:25 crc kubenswrapper[5120]: I0316 16:20:25.032472 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pcrbk\" (UniqueName: \"kubernetes.io/projected/c6d25137-770c-4094-9c3a-85b1ac79873c-kube-api-access-pcrbk\") pod \"keystone-db-create-5jzgn\" (UID: \"c6d25137-770c-4094-9c3a-85b1ac79873c\") " pod="openstack-kuttl-tests/keystone-db-create-5jzgn" Mar 16 16:20:25 crc kubenswrapper[5120]: I0316 16:20:25.099969 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-db-create-jltxh"] Mar 16 16:20:25 crc kubenswrapper[5120]: I0316 16:20:25.105074 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-create-jltxh" Mar 16 16:20:25 crc kubenswrapper[5120]: I0316 16:20:25.106625 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-1b1e-account-create-update-xsrqk"] Mar 16 16:20:25 crc kubenswrapper[5120]: I0316 16:20:25.111908 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-1b1e-account-create-update-xsrqk" Mar 16 16:20:25 crc kubenswrapper[5120]: I0316 16:20:25.113258 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5da55de8-8d9d-4e87-a022-c3c0b95403bf-operator-scripts\") pod \"placement-db-create-jltxh\" (UID: \"5da55de8-8d9d-4e87-a022-c3c0b95403bf\") " pod="openstack-kuttl-tests/placement-db-create-jltxh" Mar 16 16:20:25 crc kubenswrapper[5120]: I0316 16:20:25.113502 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hspzg\" (UniqueName: \"kubernetes.io/projected/4710f915-4683-4e68-b1e1-ec9143e2331c-kube-api-access-hspzg\") pod \"keystone-b6ca-account-create-update-zpt89\" (UID: \"4710f915-4683-4e68-b1e1-ec9143e2331c\") " pod="openstack-kuttl-tests/keystone-b6ca-account-create-update-zpt89" Mar 16 16:20:25 crc kubenswrapper[5120]: I0316 16:20:25.113619 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/4710f915-4683-4e68-b1e1-ec9143e2331c-operator-scripts\") pod \"keystone-b6ca-account-create-update-zpt89\" (UID: \"4710f915-4683-4e68-b1e1-ec9143e2331c\") " pod="openstack-kuttl-tests/keystone-b6ca-account-create-update-zpt89" Mar 16 16:20:25 crc kubenswrapper[5120]: I0316 16:20:25.113684 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mh99v\" (UniqueName: \"kubernetes.io/projected/5da55de8-8d9d-4e87-a022-c3c0b95403bf-kube-api-access-mh99v\") pod \"placement-db-create-jltxh\" (UID: \"5da55de8-8d9d-4e87-a022-c3c0b95403bf\") " pod="openstack-kuttl-tests/placement-db-create-jltxh" Mar 16 16:20:25 crc kubenswrapper[5120]: I0316 16:20:25.113796 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/442c41b4-b70b-4714-933f-3470a22e2422-operator-scripts\") pod \"placement-1b1e-account-create-update-xsrqk\" (UID: \"442c41b4-b70b-4714-933f-3470a22e2422\") " pod="openstack-kuttl-tests/placement-1b1e-account-create-update-xsrqk" Mar 16 16:20:25 crc kubenswrapper[5120]: I0316 16:20:25.113832 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rbmz\" (UniqueName: \"kubernetes.io/projected/442c41b4-b70b-4714-933f-3470a22e2422-kube-api-access-6rbmz\") pod \"placement-1b1e-account-create-update-xsrqk\" (UID: \"442c41b4-b70b-4714-933f-3470a22e2422\") " pod="openstack-kuttl-tests/placement-1b1e-account-create-update-xsrqk" Mar 16 16:20:25 crc kubenswrapper[5120]: I0316 16:20:25.114257 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-db-create-jltxh"] Mar 16 16:20:25 crc kubenswrapper[5120]: I0316 16:20:25.129352 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-create-5jzgn" Mar 16 16:20:25 crc kubenswrapper[5120]: I0316 16:20:25.129710 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-db-secret\"" Mar 16 16:20:25 crc kubenswrapper[5120]: I0316 16:20:25.137364 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-1b1e-account-create-update-xsrqk"] Mar 16 16:20:25 crc kubenswrapper[5120]: I0316 16:20:25.216280 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hspzg\" (UniqueName: \"kubernetes.io/projected/4710f915-4683-4e68-b1e1-ec9143e2331c-kube-api-access-hspzg\") pod \"keystone-b6ca-account-create-update-zpt89\" (UID: \"4710f915-4683-4e68-b1e1-ec9143e2331c\") " pod="openstack-kuttl-tests/keystone-b6ca-account-create-update-zpt89" Mar 16 16:20:25 crc kubenswrapper[5120]: I0316 16:20:25.216337 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/4710f915-4683-4e68-b1e1-ec9143e2331c-operator-scripts\") pod \"keystone-b6ca-account-create-update-zpt89\" (UID: \"4710f915-4683-4e68-b1e1-ec9143e2331c\") " pod="openstack-kuttl-tests/keystone-b6ca-account-create-update-zpt89" Mar 16 16:20:25 crc kubenswrapper[5120]: I0316 16:20:25.216376 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mh99v\" (UniqueName: \"kubernetes.io/projected/5da55de8-8d9d-4e87-a022-c3c0b95403bf-kube-api-access-mh99v\") pod \"placement-db-create-jltxh\" (UID: \"5da55de8-8d9d-4e87-a022-c3c0b95403bf\") " pod="openstack-kuttl-tests/placement-db-create-jltxh" Mar 16 16:20:25 crc kubenswrapper[5120]: I0316 16:20:25.216485 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/442c41b4-b70b-4714-933f-3470a22e2422-operator-scripts\") pod \"placement-1b1e-account-create-update-xsrqk\" (UID: \"442c41b4-b70b-4714-933f-3470a22e2422\") " pod="openstack-kuttl-tests/placement-1b1e-account-create-update-xsrqk" Mar 16 16:20:25 crc kubenswrapper[5120]: I0316 16:20:25.216519 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6rbmz\" (UniqueName: \"kubernetes.io/projected/442c41b4-b70b-4714-933f-3470a22e2422-kube-api-access-6rbmz\") pod \"placement-1b1e-account-create-update-xsrqk\" (UID: \"442c41b4-b70b-4714-933f-3470a22e2422\") " pod="openstack-kuttl-tests/placement-1b1e-account-create-update-xsrqk" Mar 16 16:20:25 crc kubenswrapper[5120]: I0316 16:20:25.216545 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5da55de8-8d9d-4e87-a022-c3c0b95403bf-operator-scripts\") pod \"placement-db-create-jltxh\" (UID: \"5da55de8-8d9d-4e87-a022-c3c0b95403bf\") " pod="openstack-kuttl-tests/placement-db-create-jltxh" Mar 16 16:20:25 crc kubenswrapper[5120]: I0316 16:20:25.217271 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5da55de8-8d9d-4e87-a022-c3c0b95403bf-operator-scripts\") pod \"placement-db-create-jltxh\" (UID: \"5da55de8-8d9d-4e87-a022-c3c0b95403bf\") " pod="openstack-kuttl-tests/placement-db-create-jltxh" Mar 16 16:20:25 crc kubenswrapper[5120]: I0316 16:20:25.218037 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/4710f915-4683-4e68-b1e1-ec9143e2331c-operator-scripts\") pod \"keystone-b6ca-account-create-update-zpt89\" (UID: \"4710f915-4683-4e68-b1e1-ec9143e2331c\") " pod="openstack-kuttl-tests/keystone-b6ca-account-create-update-zpt89" Mar 16 16:20:25 crc kubenswrapper[5120]: I0316 16:20:25.218709 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/442c41b4-b70b-4714-933f-3470a22e2422-operator-scripts\") pod \"placement-1b1e-account-create-update-xsrqk\" (UID: \"442c41b4-b70b-4714-933f-3470a22e2422\") " pod="openstack-kuttl-tests/placement-1b1e-account-create-update-xsrqk" Mar 16 16:20:25 crc kubenswrapper[5120]: I0316 16:20:25.239428 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hspzg\" (UniqueName: \"kubernetes.io/projected/4710f915-4683-4e68-b1e1-ec9143e2331c-kube-api-access-hspzg\") pod \"keystone-b6ca-account-create-update-zpt89\" (UID: \"4710f915-4683-4e68-b1e1-ec9143e2331c\") " pod="openstack-kuttl-tests/keystone-b6ca-account-create-update-zpt89" Mar 16 16:20:25 crc kubenswrapper[5120]: I0316 16:20:25.239479 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rbmz\" (UniqueName: \"kubernetes.io/projected/442c41b4-b70b-4714-933f-3470a22e2422-kube-api-access-6rbmz\") pod \"placement-1b1e-account-create-update-xsrqk\" (UID: \"442c41b4-b70b-4714-933f-3470a22e2422\") " pod="openstack-kuttl-tests/placement-1b1e-account-create-update-xsrqk" Mar 16 16:20:25 crc kubenswrapper[5120]: I0316 16:20:25.239601 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mh99v\" (UniqueName: \"kubernetes.io/projected/5da55de8-8d9d-4e87-a022-c3c0b95403bf-kube-api-access-mh99v\") pod \"placement-db-create-jltxh\" (UID: \"5da55de8-8d9d-4e87-a022-c3c0b95403bf\") " pod="openstack-kuttl-tests/placement-db-create-jltxh" Mar 16 16:20:25 crc kubenswrapper[5120]: I0316 16:20:25.257959 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-b6ca-account-create-update-zpt89" Mar 16 16:20:25 crc kubenswrapper[5120]: I0316 16:20:25.309055 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-1b1e-account-create-update-xsrqk" Mar 16 16:20:25 crc kubenswrapper[5120]: I0316 16:20:25.503851 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-create-jltxh" Mar 16 16:20:25 crc kubenswrapper[5120]: I0316 16:20:25.656162 5120 generic.go:358] "Generic (PLEG): container finished" podID="e007aee0-65df-4ec7-bd52-23bf7f4b704f" containerID="53d03858cadc5105eba35075d2d8179684dcb66d28a132eb4b7fa7a08dd123dd" exitCode=0 Mar 16 16:20:25 crc kubenswrapper[5120]: I0316 16:20:25.657177 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/prometheus-metric-storage-0" event={"ID":"e007aee0-65df-4ec7-bd52-23bf7f4b704f","Type":"ContainerDied","Data":"53d03858cadc5105eba35075d2d8179684dcb66d28a132eb4b7fa7a08dd123dd"} Mar 16 16:20:25 crc kubenswrapper[5120]: I0316 16:20:25.776777 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-db-create-5jzgn"] Mar 16 16:20:25 crc kubenswrapper[5120]: I0316 16:20:25.867805 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-b6ca-account-create-update-zpt89"] Mar 16 16:20:25 crc kubenswrapper[5120]: W0316 16:20:25.874940 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4710f915_4683_4e68_b1e1_ec9143e2331c.slice/crio-14d0960f4c939b4aba7dda07c0480f5a475b08d0a71d7348f04dfb4e034e79a8 WatchSource:0}: Error finding container 14d0960f4c939b4aba7dda07c0480f5a475b08d0a71d7348f04dfb4e034e79a8: Status 404 returned error can't find the container with id 14d0960f4c939b4aba7dda07c0480f5a475b08d0a71d7348f04dfb4e034e79a8 Mar 16 16:20:26 crc kubenswrapper[5120]: I0316 16:20:26.082082 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-1b1e-account-create-update-xsrqk"] Mar 16 16:20:26 crc kubenswrapper[5120]: I0316 16:20:26.149668 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/watcher-db-create-zwrqr"] Mar 16 16:20:26 crc kubenswrapper[5120]: I0316 16:20:26.155168 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/watcher-db-create-zwrqr" Mar 16 16:20:26 crc kubenswrapper[5120]: I0316 16:20:26.175102 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/watcher-db-create-zwrqr"] Mar 16 16:20:26 crc kubenswrapper[5120]: I0316 16:20:26.228585 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-db-create-jltxh"] Mar 16 16:20:26 crc kubenswrapper[5120]: I0316 16:20:26.243813 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ecd9da24-f35b-48a1-80a4-47e1557b4e0d-operator-scripts\") pod \"watcher-db-create-zwrqr\" (UID: \"ecd9da24-f35b-48a1-80a4-47e1557b4e0d\") " pod="openstack-kuttl-tests/watcher-db-create-zwrqr" Mar 16 16:20:26 crc kubenswrapper[5120]: I0316 16:20:26.243909 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htlg7\" (UniqueName: \"kubernetes.io/projected/ecd9da24-f35b-48a1-80a4-47e1557b4e0d-kube-api-access-htlg7\") pod \"watcher-db-create-zwrqr\" (UID: \"ecd9da24-f35b-48a1-80a4-47e1557b4e0d\") " pod="openstack-kuttl-tests/watcher-db-create-zwrqr" Mar 16 16:20:26 crc kubenswrapper[5120]: I0316 16:20:26.345118 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ecd9da24-f35b-48a1-80a4-47e1557b4e0d-operator-scripts\") pod \"watcher-db-create-zwrqr\" (UID: \"ecd9da24-f35b-48a1-80a4-47e1557b4e0d\") " pod="openstack-kuttl-tests/watcher-db-create-zwrqr" Mar 16 16:20:26 crc kubenswrapper[5120]: I0316 16:20:26.345204 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-htlg7\" (UniqueName: \"kubernetes.io/projected/ecd9da24-f35b-48a1-80a4-47e1557b4e0d-kube-api-access-htlg7\") pod \"watcher-db-create-zwrqr\" (UID: \"ecd9da24-f35b-48a1-80a4-47e1557b4e0d\") " pod="openstack-kuttl-tests/watcher-db-create-zwrqr" Mar 16 16:20:26 crc kubenswrapper[5120]: I0316 16:20:26.346517 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ecd9da24-f35b-48a1-80a4-47e1557b4e0d-operator-scripts\") pod \"watcher-db-create-zwrqr\" (UID: \"ecd9da24-f35b-48a1-80a4-47e1557b4e0d\") " pod="openstack-kuttl-tests/watcher-db-create-zwrqr" Mar 16 16:20:26 crc kubenswrapper[5120]: I0316 16:20:26.379399 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-htlg7\" (UniqueName: \"kubernetes.io/projected/ecd9da24-f35b-48a1-80a4-47e1557b4e0d-kube-api-access-htlg7\") pod \"watcher-db-create-zwrqr\" (UID: \"ecd9da24-f35b-48a1-80a4-47e1557b4e0d\") " pod="openstack-kuttl-tests/watcher-db-create-zwrqr" Mar 16 16:20:26 crc kubenswrapper[5120]: I0316 16:20:26.489293 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/watcher-db-create-zwrqr" Mar 16 16:20:26 crc kubenswrapper[5120]: I0316 16:20:26.678858 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-create-jltxh" event={"ID":"5da55de8-8d9d-4e87-a022-c3c0b95403bf","Type":"ContainerStarted","Data":"deabbef007390ab9aa3e373eade0eb0373e61a45e8ad9c027e1d1a3c0bc7821a"} Mar 16 16:20:26 crc kubenswrapper[5120]: I0316 16:20:26.679359 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-create-jltxh" event={"ID":"5da55de8-8d9d-4e87-a022-c3c0b95403bf","Type":"ContainerStarted","Data":"33eb6a38d9a94c6aa6eec7087d18f1d3260e2175a3186f9d841f06c3b13a4250"} Mar 16 16:20:26 crc kubenswrapper[5120]: I0316 16:20:26.682097 5120 generic.go:358] "Generic (PLEG): container finished" podID="9b43ebee-5f04-44e0-a8bf-56f70871894e" containerID="83b1a0951aacf8c335110caf5c001078ee4b461c91a37a5ee3ff5fbf1294518b" exitCode=0 Mar 16 16:20:26 crc kubenswrapper[5120]: I0316 16:20:26.682174 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/alertmanager-metric-storage-0" event={"ID":"9b43ebee-5f04-44e0-a8bf-56f70871894e","Type":"ContainerDied","Data":"83b1a0951aacf8c335110caf5c001078ee4b461c91a37a5ee3ff5fbf1294518b"} Mar 16 16:20:26 crc kubenswrapper[5120]: I0316 16:20:26.692912 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-1b1e-account-create-update-xsrqk" event={"ID":"442c41b4-b70b-4714-933f-3470a22e2422","Type":"ContainerStarted","Data":"85dff6b00aec22ec6ca84fdaff453933b939693c5667ecec87c406987d669331"} Mar 16 16:20:26 crc kubenswrapper[5120]: I0316 16:20:26.692960 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-1b1e-account-create-update-xsrqk" event={"ID":"442c41b4-b70b-4714-933f-3470a22e2422","Type":"ContainerStarted","Data":"0b27338b594edaeba88e741c2eb7e2e1d4399466d68c26946b66fb09042618c9"} Mar 16 16:20:26 crc kubenswrapper[5120]: I0316 16:20:26.699309 5120 generic.go:358] "Generic (PLEG): container finished" podID="4710f915-4683-4e68-b1e1-ec9143e2331c" containerID="8983190d13953a9f0e86dac603b2cf09d61cf95c6239355ff01d5977e8249984" exitCode=0 Mar 16 16:20:26 crc kubenswrapper[5120]: I0316 16:20:26.699390 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-b6ca-account-create-update-zpt89" event={"ID":"4710f915-4683-4e68-b1e1-ec9143e2331c","Type":"ContainerDied","Data":"8983190d13953a9f0e86dac603b2cf09d61cf95c6239355ff01d5977e8249984"} Mar 16 16:20:26 crc kubenswrapper[5120]: I0316 16:20:26.699416 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-b6ca-account-create-update-zpt89" event={"ID":"4710f915-4683-4e68-b1e1-ec9143e2331c","Type":"ContainerStarted","Data":"14d0960f4c939b4aba7dda07c0480f5a475b08d0a71d7348f04dfb4e034e79a8"} Mar 16 16:20:26 crc kubenswrapper[5120]: I0316 16:20:26.702386 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-create-5jzgn" event={"ID":"c6d25137-770c-4094-9c3a-85b1ac79873c","Type":"ContainerStarted","Data":"f33534b2314eb2fa1de0e0e1418fe05eb2edd62ee516b96d73bbc31c44a5430a"} Mar 16 16:20:26 crc kubenswrapper[5120]: I0316 16:20:26.702409 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-create-5jzgn" event={"ID":"c6d25137-770c-4094-9c3a-85b1ac79873c","Type":"ContainerStarted","Data":"ffd872f625d13d69a6e0ec9e84531aa5af33de598e205c98a3bf1477bdb7b90e"} Mar 16 16:20:26 crc kubenswrapper[5120]: I0316 16:20:26.704495 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-db-create-jltxh" podStartSLOduration=1.7044793679999999 podStartE2EDuration="1.704479368s" podCreationTimestamp="2026-03-16 16:20:25 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:20:26.693509244 +0000 UTC m=+2928.847440901" watchObservedRunningTime="2026-03-16 16:20:26.704479368 +0000 UTC m=+2928.858411025" Mar 16 16:20:26 crc kubenswrapper[5120]: I0316 16:20:26.756004 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-1b1e-account-create-update-xsrqk" podStartSLOduration=1.755988246 podStartE2EDuration="1.755988246s" podCreationTimestamp="2026-03-16 16:20:25 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:20:26.741640783 +0000 UTC m=+2928.895572440" watchObservedRunningTime="2026-03-16 16:20:26.755988246 +0000 UTC m=+2928.909919903" Mar 16 16:20:26 crc kubenswrapper[5120]: I0316 16:20:26.962938 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/watcher-db-create-zwrqr"] Mar 16 16:20:27 crc kubenswrapper[5120]: I0316 16:20:27.054807 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/watcher-7aff-account-create-update-qzj6x"] Mar 16 16:20:27 crc kubenswrapper[5120]: I0316 16:20:27.069512 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/watcher-7aff-account-create-update-qzj6x" Mar 16 16:20:27 crc kubenswrapper[5120]: I0316 16:20:27.071980 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"watcher-db-secret\"" Mar 16 16:20:27 crc kubenswrapper[5120]: I0316 16:20:27.077736 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/watcher-7aff-account-create-update-qzj6x"] Mar 16 16:20:27 crc kubenswrapper[5120]: I0316 16:20:27.159714 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmbjt\" (UniqueName: \"kubernetes.io/projected/88923e4b-c216-48dd-9b51-988c209c7df9-kube-api-access-nmbjt\") pod \"watcher-7aff-account-create-update-qzj6x\" (UID: \"88923e4b-c216-48dd-9b51-988c209c7df9\") " pod="openstack-kuttl-tests/watcher-7aff-account-create-update-qzj6x" Mar 16 16:20:27 crc kubenswrapper[5120]: I0316 16:20:27.160061 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/88923e4b-c216-48dd-9b51-988c209c7df9-operator-scripts\") pod \"watcher-7aff-account-create-update-qzj6x\" (UID: \"88923e4b-c216-48dd-9b51-988c209c7df9\") " pod="openstack-kuttl-tests/watcher-7aff-account-create-update-qzj6x" Mar 16 16:20:27 crc kubenswrapper[5120]: I0316 16:20:27.221321 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 16:20:27 crc kubenswrapper[5120]: I0316 16:20:27.235290 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:20:27 crc kubenswrapper[5120]: I0316 16:20:27.242798 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"swift-ring-files\"" Mar 16 16:20:27 crc kubenswrapper[5120]: I0316 16:20:27.243480 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"swift-conf\"" Mar 16 16:20:27 crc kubenswrapper[5120]: I0316 16:20:27.243585 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"swift-storage-config-data\"" Mar 16 16:20:27 crc kubenswrapper[5120]: I0316 16:20:27.245802 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"swift-swift-dockercfg-zfxvs\"" Mar 16 16:20:27 crc kubenswrapper[5120]: I0316 16:20:27.254262 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 16:20:27 crc kubenswrapper[5120]: I0316 16:20:27.266714 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/88923e4b-c216-48dd-9b51-988c209c7df9-operator-scripts\") pod \"watcher-7aff-account-create-update-qzj6x\" (UID: \"88923e4b-c216-48dd-9b51-988c209c7df9\") " pod="openstack-kuttl-tests/watcher-7aff-account-create-update-qzj6x" Mar 16 16:20:27 crc kubenswrapper[5120]: I0316 16:20:27.267114 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nmbjt\" (UniqueName: \"kubernetes.io/projected/88923e4b-c216-48dd-9b51-988c209c7df9-kube-api-access-nmbjt\") pod \"watcher-7aff-account-create-update-qzj6x\" (UID: \"88923e4b-c216-48dd-9b51-988c209c7df9\") " pod="openstack-kuttl-tests/watcher-7aff-account-create-update-qzj6x" Mar 16 16:20:27 crc kubenswrapper[5120]: I0316 16:20:27.276194 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/88923e4b-c216-48dd-9b51-988c209c7df9-operator-scripts\") pod \"watcher-7aff-account-create-update-qzj6x\" (UID: \"88923e4b-c216-48dd-9b51-988c209c7df9\") " pod="openstack-kuttl-tests/watcher-7aff-account-create-update-qzj6x" Mar 16 16:20:27 crc kubenswrapper[5120]: I0316 16:20:27.344155 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmbjt\" (UniqueName: \"kubernetes.io/projected/88923e4b-c216-48dd-9b51-988c209c7df9-kube-api-access-nmbjt\") pod \"watcher-7aff-account-create-update-qzj6x\" (UID: \"88923e4b-c216-48dd-9b51-988c209c7df9\") " pod="openstack-kuttl-tests/watcher-7aff-account-create-update-qzj6x" Mar 16 16:20:27 crc kubenswrapper[5120]: I0316 16:20:27.369249 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/7f5bff08-fc88-42fc-ab9b-6d8db171ee6a-cache\") pod \"swift-storage-0\" (UID: \"7f5bff08-fc88-42fc-ab9b-6d8db171ee6a\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:20:27 crc kubenswrapper[5120]: I0316 16:20:27.369295 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gc45z\" (UniqueName: \"kubernetes.io/projected/7f5bff08-fc88-42fc-ab9b-6d8db171ee6a-kube-api-access-gc45z\") pod \"swift-storage-0\" (UID: \"7f5bff08-fc88-42fc-ab9b-6d8db171ee6a\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:20:27 crc kubenswrapper[5120]: I0316 16:20:27.369341 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7f5bff08-fc88-42fc-ab9b-6d8db171ee6a-combined-ca-bundle\") pod \"swift-storage-0\" (UID: \"7f5bff08-fc88-42fc-ab9b-6d8db171ee6a\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:20:27 crc kubenswrapper[5120]: I0316 16:20:27.369368 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"swift-storage-0\" (UID: \"7f5bff08-fc88-42fc-ab9b-6d8db171ee6a\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:20:27 crc kubenswrapper[5120]: I0316 16:20:27.369446 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/7f5bff08-fc88-42fc-ab9b-6d8db171ee6a-etc-swift\") pod \"swift-storage-0\" (UID: \"7f5bff08-fc88-42fc-ab9b-6d8db171ee6a\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:20:27 crc kubenswrapper[5120]: I0316 16:20:27.369530 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/7f5bff08-fc88-42fc-ab9b-6d8db171ee6a-lock\") pod \"swift-storage-0\" (UID: \"7f5bff08-fc88-42fc-ab9b-6d8db171ee6a\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:20:27 crc kubenswrapper[5120]: I0316 16:20:27.431512 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/watcher-7aff-account-create-update-qzj6x" Mar 16 16:20:27 crc kubenswrapper[5120]: I0316 16:20:27.473185 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/7f5bff08-fc88-42fc-ab9b-6d8db171ee6a-cache\") pod \"swift-storage-0\" (UID: \"7f5bff08-fc88-42fc-ab9b-6d8db171ee6a\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:20:27 crc kubenswrapper[5120]: I0316 16:20:27.473621 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gc45z\" (UniqueName: \"kubernetes.io/projected/7f5bff08-fc88-42fc-ab9b-6d8db171ee6a-kube-api-access-gc45z\") pod \"swift-storage-0\" (UID: \"7f5bff08-fc88-42fc-ab9b-6d8db171ee6a\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:20:27 crc kubenswrapper[5120]: I0316 16:20:27.473660 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7f5bff08-fc88-42fc-ab9b-6d8db171ee6a-combined-ca-bundle\") pod \"swift-storage-0\" (UID: \"7f5bff08-fc88-42fc-ab9b-6d8db171ee6a\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:20:27 crc kubenswrapper[5120]: I0316 16:20:27.473696 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"swift-storage-0\" (UID: \"7f5bff08-fc88-42fc-ab9b-6d8db171ee6a\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:20:27 crc kubenswrapper[5120]: I0316 16:20:27.473798 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/7f5bff08-fc88-42fc-ab9b-6d8db171ee6a-etc-swift\") pod \"swift-storage-0\" (UID: \"7f5bff08-fc88-42fc-ab9b-6d8db171ee6a\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:20:27 crc kubenswrapper[5120]: I0316 16:20:27.473894 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/7f5bff08-fc88-42fc-ab9b-6d8db171ee6a-lock\") pod \"swift-storage-0\" (UID: \"7f5bff08-fc88-42fc-ab9b-6d8db171ee6a\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:20:27 crc kubenswrapper[5120]: I0316 16:20:27.473961 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/7f5bff08-fc88-42fc-ab9b-6d8db171ee6a-cache\") pod \"swift-storage-0\" (UID: \"7f5bff08-fc88-42fc-ab9b-6d8db171ee6a\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:20:27 crc kubenswrapper[5120]: E0316 16:20:27.474052 5120 projected.go:289] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Mar 16 16:20:27 crc kubenswrapper[5120]: E0316 16:20:27.474076 5120 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Mar 16 16:20:27 crc kubenswrapper[5120]: E0316 16:20:27.474161 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7f5bff08-fc88-42fc-ab9b-6d8db171ee6a-etc-swift podName:7f5bff08-fc88-42fc-ab9b-6d8db171ee6a nodeName:}" failed. No retries permitted until 2026-03-16 16:20:27.974136825 +0000 UTC m=+2930.128068482 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/7f5bff08-fc88-42fc-ab9b-6d8db171ee6a-etc-swift") pod "swift-storage-0" (UID: "7f5bff08-fc88-42fc-ab9b-6d8db171ee6a") : configmap "swift-ring-files" not found Mar 16 16:20:27 crc kubenswrapper[5120]: I0316 16:20:27.474298 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"swift-storage-0\" (UID: \"7f5bff08-fc88-42fc-ab9b-6d8db171ee6a\") device mount path \"/mnt/openstack/pv12\"" pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:20:27 crc kubenswrapper[5120]: I0316 16:20:27.474403 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/7f5bff08-fc88-42fc-ab9b-6d8db171ee6a-lock\") pod \"swift-storage-0\" (UID: \"7f5bff08-fc88-42fc-ab9b-6d8db171ee6a\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:20:27 crc kubenswrapper[5120]: I0316 16:20:27.483831 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7f5bff08-fc88-42fc-ab9b-6d8db171ee6a-combined-ca-bundle\") pod \"swift-storage-0\" (UID: \"7f5bff08-fc88-42fc-ab9b-6d8db171ee6a\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:20:27 crc kubenswrapper[5120]: I0316 16:20:27.495884 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gc45z\" (UniqueName: \"kubernetes.io/projected/7f5bff08-fc88-42fc-ab9b-6d8db171ee6a-kube-api-access-gc45z\") pod \"swift-storage-0\" (UID: \"7f5bff08-fc88-42fc-ab9b-6d8db171ee6a\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:20:27 crc kubenswrapper[5120]: I0316 16:20:27.513066 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"swift-storage-0\" (UID: \"7f5bff08-fc88-42fc-ab9b-6d8db171ee6a\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:20:27 crc kubenswrapper[5120]: I0316 16:20:27.643821 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-7kzs9"] Mar 16 16:20:27 crc kubenswrapper[5120]: I0316 16:20:27.650071 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-7kzs9" Mar 16 16:20:27 crc kubenswrapper[5120]: I0316 16:20:27.656417 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"swift-ring-config-data\"" Mar 16 16:20:27 crc kubenswrapper[5120]: I0316 16:20:27.656462 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"swift-ring-scripts\"" Mar 16 16:20:27 crc kubenswrapper[5120]: I0316 16:20:27.656669 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"swift-proxy-config-data\"" Mar 16 16:20:27 crc kubenswrapper[5120]: I0316 16:20:27.663107 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-7kzs9"] Mar 16 16:20:27 crc kubenswrapper[5120]: E0316 16:20:27.672719 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[combined-ca-bundle dispersionconf etc-swift kube-api-access-jk8gq ring-data-devices scripts swiftconf], unattached volumes=[], failed to process volumes=[combined-ca-bundle dispersionconf etc-swift kube-api-access-jk8gq ring-data-devices scripts swiftconf]: context canceled" pod="openstack-kuttl-tests/swift-ring-rebalance-7kzs9" podUID="138c726c-0509-4b55-b050-a5b846f7b69d" Mar 16 16:20:27 crc kubenswrapper[5120]: I0316 16:20:27.689992 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-7kzs9"] Mar 16 16:20:27 crc kubenswrapper[5120]: I0316 16:20:27.699813 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-sr2cl"] Mar 16 16:20:27 crc kubenswrapper[5120]: I0316 16:20:27.705224 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-sr2cl" Mar 16 16:20:27 crc kubenswrapper[5120]: I0316 16:20:27.712590 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-sr2cl"] Mar 16 16:20:27 crc kubenswrapper[5120]: I0316 16:20:27.720613 5120 generic.go:358] "Generic (PLEG): container finished" podID="ecd9da24-f35b-48a1-80a4-47e1557b4e0d" containerID="be8b393dfcd7777cccd2fa4b13cfab1c7e081ec46f8ab42dbc4a6ce81b6cc6c9" exitCode=0 Mar 16 16:20:27 crc kubenswrapper[5120]: I0316 16:20:27.720798 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/watcher-db-create-zwrqr" event={"ID":"ecd9da24-f35b-48a1-80a4-47e1557b4e0d","Type":"ContainerDied","Data":"be8b393dfcd7777cccd2fa4b13cfab1c7e081ec46f8ab42dbc4a6ce81b6cc6c9"} Mar 16 16:20:27 crc kubenswrapper[5120]: I0316 16:20:27.720820 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/watcher-db-create-zwrqr" event={"ID":"ecd9da24-f35b-48a1-80a4-47e1557b4e0d","Type":"ContainerStarted","Data":"fa92f3537d8327fe5e425ba5a6d10e2499abc339cebba5b0b3a43f15da10bb77"} Mar 16 16:20:27 crc kubenswrapper[5120]: I0316 16:20:27.723159 5120 generic.go:358] "Generic (PLEG): container finished" podID="5da55de8-8d9d-4e87-a022-c3c0b95403bf" containerID="deabbef007390ab9aa3e373eade0eb0373e61a45e8ad9c027e1d1a3c0bc7821a" exitCode=0 Mar 16 16:20:27 crc kubenswrapper[5120]: I0316 16:20:27.723485 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-create-jltxh" event={"ID":"5da55de8-8d9d-4e87-a022-c3c0b95403bf","Type":"ContainerDied","Data":"deabbef007390ab9aa3e373eade0eb0373e61a45e8ad9c027e1d1a3c0bc7821a"} Mar 16 16:20:27 crc kubenswrapper[5120]: I0316 16:20:27.732178 5120 generic.go:358] "Generic (PLEG): container finished" podID="442c41b4-b70b-4714-933f-3470a22e2422" containerID="85dff6b00aec22ec6ca84fdaff453933b939693c5667ecec87c406987d669331" exitCode=0 Mar 16 16:20:27 crc kubenswrapper[5120]: I0316 16:20:27.732555 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-1b1e-account-create-update-xsrqk" event={"ID":"442c41b4-b70b-4714-933f-3470a22e2422","Type":"ContainerDied","Data":"85dff6b00aec22ec6ca84fdaff453933b939693c5667ecec87c406987d669331"} Mar 16 16:20:27 crc kubenswrapper[5120]: I0316 16:20:27.736463 5120 generic.go:358] "Generic (PLEG): container finished" podID="c6d25137-770c-4094-9c3a-85b1ac79873c" containerID="f33534b2314eb2fa1de0e0e1418fe05eb2edd62ee516b96d73bbc31c44a5430a" exitCode=0 Mar 16 16:20:27 crc kubenswrapper[5120]: I0316 16:20:27.736641 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-create-5jzgn" event={"ID":"c6d25137-770c-4094-9c3a-85b1ac79873c","Type":"ContainerDied","Data":"f33534b2314eb2fa1de0e0e1418fe05eb2edd62ee516b96d73bbc31c44a5430a"} Mar 16 16:20:27 crc kubenswrapper[5120]: I0316 16:20:27.737291 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-7kzs9" Mar 16 16:20:27 crc kubenswrapper[5120]: I0316 16:20:27.759989 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-7kzs9" Mar 16 16:20:27 crc kubenswrapper[5120]: I0316 16:20:27.781333 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jk8gq\" (UniqueName: \"kubernetes.io/projected/138c726c-0509-4b55-b050-a5b846f7b69d-kube-api-access-jk8gq\") pod \"swift-ring-rebalance-7kzs9\" (UID: \"138c726c-0509-4b55-b050-a5b846f7b69d\") " pod="openstack-kuttl-tests/swift-ring-rebalance-7kzs9" Mar 16 16:20:27 crc kubenswrapper[5120]: I0316 16:20:27.781375 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/e0d63296-b495-418b-937b-3de15045b5c2-dispersionconf\") pod \"swift-ring-rebalance-sr2cl\" (UID: \"e0d63296-b495-418b-937b-3de15045b5c2\") " pod="openstack-kuttl-tests/swift-ring-rebalance-sr2cl" Mar 16 16:20:27 crc kubenswrapper[5120]: I0316 16:20:27.781426 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/138c726c-0509-4b55-b050-a5b846f7b69d-scripts\") pod \"swift-ring-rebalance-7kzs9\" (UID: \"138c726c-0509-4b55-b050-a5b846f7b69d\") " pod="openstack-kuttl-tests/swift-ring-rebalance-7kzs9" Mar 16 16:20:27 crc kubenswrapper[5120]: I0316 16:20:27.781497 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e0d63296-b495-418b-937b-3de15045b5c2-combined-ca-bundle\") pod \"swift-ring-rebalance-sr2cl\" (UID: \"e0d63296-b495-418b-937b-3de15045b5c2\") " pod="openstack-kuttl-tests/swift-ring-rebalance-sr2cl" Mar 16 16:20:27 crc kubenswrapper[5120]: I0316 16:20:27.781522 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jsk2l\" (UniqueName: \"kubernetes.io/projected/e0d63296-b495-418b-937b-3de15045b5c2-kube-api-access-jsk2l\") pod \"swift-ring-rebalance-sr2cl\" (UID: \"e0d63296-b495-418b-937b-3de15045b5c2\") " pod="openstack-kuttl-tests/swift-ring-rebalance-sr2cl" Mar 16 16:20:27 crc kubenswrapper[5120]: I0316 16:20:27.781538 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/138c726c-0509-4b55-b050-a5b846f7b69d-dispersionconf\") pod \"swift-ring-rebalance-7kzs9\" (UID: \"138c726c-0509-4b55-b050-a5b846f7b69d\") " pod="openstack-kuttl-tests/swift-ring-rebalance-7kzs9" Mar 16 16:20:27 crc kubenswrapper[5120]: I0316 16:20:27.781563 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/e0d63296-b495-418b-937b-3de15045b5c2-etc-swift\") pod \"swift-ring-rebalance-sr2cl\" (UID: \"e0d63296-b495-418b-937b-3de15045b5c2\") " pod="openstack-kuttl-tests/swift-ring-rebalance-sr2cl" Mar 16 16:20:27 crc kubenswrapper[5120]: I0316 16:20:27.781594 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/138c726c-0509-4b55-b050-a5b846f7b69d-swiftconf\") pod \"swift-ring-rebalance-7kzs9\" (UID: \"138c726c-0509-4b55-b050-a5b846f7b69d\") " pod="openstack-kuttl-tests/swift-ring-rebalance-7kzs9" Mar 16 16:20:27 crc kubenswrapper[5120]: I0316 16:20:27.781618 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/e0d63296-b495-418b-937b-3de15045b5c2-swiftconf\") pod \"swift-ring-rebalance-sr2cl\" (UID: \"e0d63296-b495-418b-937b-3de15045b5c2\") " pod="openstack-kuttl-tests/swift-ring-rebalance-sr2cl" Mar 16 16:20:27 crc kubenswrapper[5120]: I0316 16:20:27.781699 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/138c726c-0509-4b55-b050-a5b846f7b69d-combined-ca-bundle\") pod \"swift-ring-rebalance-7kzs9\" (UID: \"138c726c-0509-4b55-b050-a5b846f7b69d\") " pod="openstack-kuttl-tests/swift-ring-rebalance-7kzs9" Mar 16 16:20:27 crc kubenswrapper[5120]: I0316 16:20:27.781717 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/138c726c-0509-4b55-b050-a5b846f7b69d-etc-swift\") pod \"swift-ring-rebalance-7kzs9\" (UID: \"138c726c-0509-4b55-b050-a5b846f7b69d\") " pod="openstack-kuttl-tests/swift-ring-rebalance-7kzs9" Mar 16 16:20:27 crc kubenswrapper[5120]: I0316 16:20:27.794504 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/138c726c-0509-4b55-b050-a5b846f7b69d-ring-data-devices\") pod \"swift-ring-rebalance-7kzs9\" (UID: \"138c726c-0509-4b55-b050-a5b846f7b69d\") " pod="openstack-kuttl-tests/swift-ring-rebalance-7kzs9" Mar 16 16:20:27 crc kubenswrapper[5120]: I0316 16:20:27.794635 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/e0d63296-b495-418b-937b-3de15045b5c2-scripts\") pod \"swift-ring-rebalance-sr2cl\" (UID: \"e0d63296-b495-418b-937b-3de15045b5c2\") " pod="openstack-kuttl-tests/swift-ring-rebalance-sr2cl" Mar 16 16:20:27 crc kubenswrapper[5120]: I0316 16:20:27.794669 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/e0d63296-b495-418b-937b-3de15045b5c2-ring-data-devices\") pod \"swift-ring-rebalance-sr2cl\" (UID: \"e0d63296-b495-418b-937b-3de15045b5c2\") " pod="openstack-kuttl-tests/swift-ring-rebalance-sr2cl" Mar 16 16:20:27 crc kubenswrapper[5120]: I0316 16:20:27.896869 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/e0d63296-b495-418b-937b-3de15045b5c2-scripts\") pod \"swift-ring-rebalance-sr2cl\" (UID: \"e0d63296-b495-418b-937b-3de15045b5c2\") " pod="openstack-kuttl-tests/swift-ring-rebalance-sr2cl" Mar 16 16:20:27 crc kubenswrapper[5120]: I0316 16:20:27.896922 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/e0d63296-b495-418b-937b-3de15045b5c2-ring-data-devices\") pod \"swift-ring-rebalance-sr2cl\" (UID: \"e0d63296-b495-418b-937b-3de15045b5c2\") " pod="openstack-kuttl-tests/swift-ring-rebalance-sr2cl" Mar 16 16:20:27 crc kubenswrapper[5120]: I0316 16:20:27.896970 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jk8gq\" (UniqueName: \"kubernetes.io/projected/138c726c-0509-4b55-b050-a5b846f7b69d-kube-api-access-jk8gq\") pod \"swift-ring-rebalance-7kzs9\" (UID: \"138c726c-0509-4b55-b050-a5b846f7b69d\") " pod="openstack-kuttl-tests/swift-ring-rebalance-7kzs9" Mar 16 16:20:27 crc kubenswrapper[5120]: I0316 16:20:27.896988 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/e0d63296-b495-418b-937b-3de15045b5c2-dispersionconf\") pod \"swift-ring-rebalance-sr2cl\" (UID: \"e0d63296-b495-418b-937b-3de15045b5c2\") " pod="openstack-kuttl-tests/swift-ring-rebalance-sr2cl" Mar 16 16:20:27 crc kubenswrapper[5120]: I0316 16:20:27.897038 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/138c726c-0509-4b55-b050-a5b846f7b69d-scripts\") pod \"swift-ring-rebalance-7kzs9\" (UID: \"138c726c-0509-4b55-b050-a5b846f7b69d\") " pod="openstack-kuttl-tests/swift-ring-rebalance-7kzs9" Mar 16 16:20:27 crc kubenswrapper[5120]: I0316 16:20:27.897112 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e0d63296-b495-418b-937b-3de15045b5c2-combined-ca-bundle\") pod \"swift-ring-rebalance-sr2cl\" (UID: \"e0d63296-b495-418b-937b-3de15045b5c2\") " pod="openstack-kuttl-tests/swift-ring-rebalance-sr2cl" Mar 16 16:20:27 crc kubenswrapper[5120]: I0316 16:20:27.897137 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jsk2l\" (UniqueName: \"kubernetes.io/projected/e0d63296-b495-418b-937b-3de15045b5c2-kube-api-access-jsk2l\") pod \"swift-ring-rebalance-sr2cl\" (UID: \"e0d63296-b495-418b-937b-3de15045b5c2\") " pod="openstack-kuttl-tests/swift-ring-rebalance-sr2cl" Mar 16 16:20:27 crc kubenswrapper[5120]: I0316 16:20:27.897154 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/138c726c-0509-4b55-b050-a5b846f7b69d-dispersionconf\") pod \"swift-ring-rebalance-7kzs9\" (UID: \"138c726c-0509-4b55-b050-a5b846f7b69d\") " pod="openstack-kuttl-tests/swift-ring-rebalance-7kzs9" Mar 16 16:20:27 crc kubenswrapper[5120]: I0316 16:20:27.897180 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/e0d63296-b495-418b-937b-3de15045b5c2-etc-swift\") pod \"swift-ring-rebalance-sr2cl\" (UID: \"e0d63296-b495-418b-937b-3de15045b5c2\") " pod="openstack-kuttl-tests/swift-ring-rebalance-sr2cl" Mar 16 16:20:27 crc kubenswrapper[5120]: I0316 16:20:27.897200 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/138c726c-0509-4b55-b050-a5b846f7b69d-swiftconf\") pod \"swift-ring-rebalance-7kzs9\" (UID: \"138c726c-0509-4b55-b050-a5b846f7b69d\") " pod="openstack-kuttl-tests/swift-ring-rebalance-7kzs9" Mar 16 16:20:27 crc kubenswrapper[5120]: I0316 16:20:27.897218 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/e0d63296-b495-418b-937b-3de15045b5c2-swiftconf\") pod \"swift-ring-rebalance-sr2cl\" (UID: \"e0d63296-b495-418b-937b-3de15045b5c2\") " pod="openstack-kuttl-tests/swift-ring-rebalance-sr2cl" Mar 16 16:20:27 crc kubenswrapper[5120]: I0316 16:20:27.897283 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/138c726c-0509-4b55-b050-a5b846f7b69d-combined-ca-bundle\") pod \"swift-ring-rebalance-7kzs9\" (UID: \"138c726c-0509-4b55-b050-a5b846f7b69d\") " pod="openstack-kuttl-tests/swift-ring-rebalance-7kzs9" Mar 16 16:20:27 crc kubenswrapper[5120]: I0316 16:20:27.897303 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/138c726c-0509-4b55-b050-a5b846f7b69d-etc-swift\") pod \"swift-ring-rebalance-7kzs9\" (UID: \"138c726c-0509-4b55-b050-a5b846f7b69d\") " pod="openstack-kuttl-tests/swift-ring-rebalance-7kzs9" Mar 16 16:20:27 crc kubenswrapper[5120]: I0316 16:20:27.897326 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/138c726c-0509-4b55-b050-a5b846f7b69d-ring-data-devices\") pod \"swift-ring-rebalance-7kzs9\" (UID: \"138c726c-0509-4b55-b050-a5b846f7b69d\") " pod="openstack-kuttl-tests/swift-ring-rebalance-7kzs9" Mar 16 16:20:27 crc kubenswrapper[5120]: I0316 16:20:27.897580 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/e0d63296-b495-418b-937b-3de15045b5c2-scripts\") pod \"swift-ring-rebalance-sr2cl\" (UID: \"e0d63296-b495-418b-937b-3de15045b5c2\") " pod="openstack-kuttl-tests/swift-ring-rebalance-sr2cl" Mar 16 16:20:27 crc kubenswrapper[5120]: I0316 16:20:27.897989 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/138c726c-0509-4b55-b050-a5b846f7b69d-ring-data-devices\") pod \"swift-ring-rebalance-7kzs9\" (UID: \"138c726c-0509-4b55-b050-a5b846f7b69d\") " pod="openstack-kuttl-tests/swift-ring-rebalance-7kzs9" Mar 16 16:20:27 crc kubenswrapper[5120]: I0316 16:20:27.898383 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/e0d63296-b495-418b-937b-3de15045b5c2-ring-data-devices\") pod \"swift-ring-rebalance-sr2cl\" (UID: \"e0d63296-b495-418b-937b-3de15045b5c2\") " pod="openstack-kuttl-tests/swift-ring-rebalance-sr2cl" Mar 16 16:20:27 crc kubenswrapper[5120]: I0316 16:20:27.899768 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/e0d63296-b495-418b-937b-3de15045b5c2-etc-swift\") pod \"swift-ring-rebalance-sr2cl\" (UID: \"e0d63296-b495-418b-937b-3de15045b5c2\") " pod="openstack-kuttl-tests/swift-ring-rebalance-sr2cl" Mar 16 16:20:27 crc kubenswrapper[5120]: I0316 16:20:27.904264 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/138c726c-0509-4b55-b050-a5b846f7b69d-swiftconf\") pod \"swift-ring-rebalance-7kzs9\" (UID: \"138c726c-0509-4b55-b050-a5b846f7b69d\") " pod="openstack-kuttl-tests/swift-ring-rebalance-7kzs9" Mar 16 16:20:27 crc kubenswrapper[5120]: I0316 16:20:27.904447 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/138c726c-0509-4b55-b050-a5b846f7b69d-combined-ca-bundle\") pod \"swift-ring-rebalance-7kzs9\" (UID: \"138c726c-0509-4b55-b050-a5b846f7b69d\") " pod="openstack-kuttl-tests/swift-ring-rebalance-7kzs9" Mar 16 16:20:27 crc kubenswrapper[5120]: I0316 16:20:27.904792 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/138c726c-0509-4b55-b050-a5b846f7b69d-scripts\") pod \"swift-ring-rebalance-7kzs9\" (UID: \"138c726c-0509-4b55-b050-a5b846f7b69d\") " pod="openstack-kuttl-tests/swift-ring-rebalance-7kzs9" Mar 16 16:20:27 crc kubenswrapper[5120]: I0316 16:20:27.905052 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/138c726c-0509-4b55-b050-a5b846f7b69d-etc-swift\") pod \"swift-ring-rebalance-7kzs9\" (UID: \"138c726c-0509-4b55-b050-a5b846f7b69d\") " pod="openstack-kuttl-tests/swift-ring-rebalance-7kzs9" Mar 16 16:20:27 crc kubenswrapper[5120]: I0316 16:20:27.908248 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/e0d63296-b495-418b-937b-3de15045b5c2-dispersionconf\") pod \"swift-ring-rebalance-sr2cl\" (UID: \"e0d63296-b495-418b-937b-3de15045b5c2\") " pod="openstack-kuttl-tests/swift-ring-rebalance-sr2cl" Mar 16 16:20:27 crc kubenswrapper[5120]: I0316 16:20:27.908942 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/138c726c-0509-4b55-b050-a5b846f7b69d-dispersionconf\") pod \"swift-ring-rebalance-7kzs9\" (UID: \"138c726c-0509-4b55-b050-a5b846f7b69d\") " pod="openstack-kuttl-tests/swift-ring-rebalance-7kzs9" Mar 16 16:20:27 crc kubenswrapper[5120]: I0316 16:20:27.911232 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/e0d63296-b495-418b-937b-3de15045b5c2-swiftconf\") pod \"swift-ring-rebalance-sr2cl\" (UID: \"e0d63296-b495-418b-937b-3de15045b5c2\") " pod="openstack-kuttl-tests/swift-ring-rebalance-sr2cl" Mar 16 16:20:27 crc kubenswrapper[5120]: I0316 16:20:27.913091 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e0d63296-b495-418b-937b-3de15045b5c2-combined-ca-bundle\") pod \"swift-ring-rebalance-sr2cl\" (UID: \"e0d63296-b495-418b-937b-3de15045b5c2\") " pod="openstack-kuttl-tests/swift-ring-rebalance-sr2cl" Mar 16 16:20:27 crc kubenswrapper[5120]: I0316 16:20:27.928416 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jsk2l\" (UniqueName: \"kubernetes.io/projected/e0d63296-b495-418b-937b-3de15045b5c2-kube-api-access-jsk2l\") pod \"swift-ring-rebalance-sr2cl\" (UID: \"e0d63296-b495-418b-937b-3de15045b5c2\") " pod="openstack-kuttl-tests/swift-ring-rebalance-sr2cl" Mar 16 16:20:27 crc kubenswrapper[5120]: I0316 16:20:27.935430 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jk8gq\" (UniqueName: \"kubernetes.io/projected/138c726c-0509-4b55-b050-a5b846f7b69d-kube-api-access-jk8gq\") pod \"swift-ring-rebalance-7kzs9\" (UID: \"138c726c-0509-4b55-b050-a5b846f7b69d\") " pod="openstack-kuttl-tests/swift-ring-rebalance-7kzs9" Mar 16 16:20:27 crc kubenswrapper[5120]: I0316 16:20:27.971957 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/watcher-7aff-account-create-update-qzj6x"] Mar 16 16:20:28 crc kubenswrapper[5120]: I0316 16:20:27.998194 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/138c726c-0509-4b55-b050-a5b846f7b69d-combined-ca-bundle\") pod \"138c726c-0509-4b55-b050-a5b846f7b69d\" (UID: \"138c726c-0509-4b55-b050-a5b846f7b69d\") " Mar 16 16:20:28 crc kubenswrapper[5120]: I0316 16:20:27.998307 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/138c726c-0509-4b55-b050-a5b846f7b69d-scripts\") pod \"138c726c-0509-4b55-b050-a5b846f7b69d\" (UID: \"138c726c-0509-4b55-b050-a5b846f7b69d\") " Mar 16 16:20:28 crc kubenswrapper[5120]: I0316 16:20:27.998433 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/138c726c-0509-4b55-b050-a5b846f7b69d-etc-swift\") pod \"138c726c-0509-4b55-b050-a5b846f7b69d\" (UID: \"138c726c-0509-4b55-b050-a5b846f7b69d\") " Mar 16 16:20:28 crc kubenswrapper[5120]: I0316 16:20:27.998503 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/138c726c-0509-4b55-b050-a5b846f7b69d-dispersionconf\") pod \"138c726c-0509-4b55-b050-a5b846f7b69d\" (UID: \"138c726c-0509-4b55-b050-a5b846f7b69d\") " Mar 16 16:20:28 crc kubenswrapper[5120]: I0316 16:20:27.998526 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/138c726c-0509-4b55-b050-a5b846f7b69d-swiftconf\") pod \"138c726c-0509-4b55-b050-a5b846f7b69d\" (UID: \"138c726c-0509-4b55-b050-a5b846f7b69d\") " Mar 16 16:20:28 crc kubenswrapper[5120]: I0316 16:20:27.998576 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/138c726c-0509-4b55-b050-a5b846f7b69d-ring-data-devices\") pod \"138c726c-0509-4b55-b050-a5b846f7b69d\" (UID: \"138c726c-0509-4b55-b050-a5b846f7b69d\") " Mar 16 16:20:28 crc kubenswrapper[5120]: I0316 16:20:27.998931 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/7f5bff08-fc88-42fc-ab9b-6d8db171ee6a-etc-swift\") pod \"swift-storage-0\" (UID: \"7f5bff08-fc88-42fc-ab9b-6d8db171ee6a\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:20:28 crc kubenswrapper[5120]: E0316 16:20:27.999164 5120 projected.go:289] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Mar 16 16:20:28 crc kubenswrapper[5120]: E0316 16:20:27.999177 5120 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Mar 16 16:20:28 crc kubenswrapper[5120]: E0316 16:20:27.999225 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7f5bff08-fc88-42fc-ab9b-6d8db171ee6a-etc-swift podName:7f5bff08-fc88-42fc-ab9b-6d8db171ee6a nodeName:}" failed. No retries permitted until 2026-03-16 16:20:28.999211199 +0000 UTC m=+2931.153142856 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/7f5bff08-fc88-42fc-ab9b-6d8db171ee6a-etc-swift") pod "swift-storage-0" (UID: "7f5bff08-fc88-42fc-ab9b-6d8db171ee6a") : configmap "swift-ring-files" not found Mar 16 16:20:28 crc kubenswrapper[5120]: I0316 16:20:28.012063 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/138c726c-0509-4b55-b050-a5b846f7b69d-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "138c726c-0509-4b55-b050-a5b846f7b69d" (UID: "138c726c-0509-4b55-b050-a5b846f7b69d"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:20:28 crc kubenswrapper[5120]: I0316 16:20:28.016326 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/138c726c-0509-4b55-b050-a5b846f7b69d-scripts" (OuterVolumeSpecName: "scripts") pod "138c726c-0509-4b55-b050-a5b846f7b69d" (UID: "138c726c-0509-4b55-b050-a5b846f7b69d"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:20:28 crc kubenswrapper[5120]: I0316 16:20:28.016591 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/138c726c-0509-4b55-b050-a5b846f7b69d-etc-swift" (OuterVolumeSpecName: "etc-swift") pod "138c726c-0509-4b55-b050-a5b846f7b69d" (UID: "138c726c-0509-4b55-b050-a5b846f7b69d"). InnerVolumeSpecName "etc-swift". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:20:28 crc kubenswrapper[5120]: I0316 16:20:28.016547 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/138c726c-0509-4b55-b050-a5b846f7b69d-ring-data-devices" (OuterVolumeSpecName: "ring-data-devices") pod "138c726c-0509-4b55-b050-a5b846f7b69d" (UID: "138c726c-0509-4b55-b050-a5b846f7b69d"). InnerVolumeSpecName "ring-data-devices". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:20:28 crc kubenswrapper[5120]: I0316 16:20:28.018952 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/138c726c-0509-4b55-b050-a5b846f7b69d-dispersionconf" (OuterVolumeSpecName: "dispersionconf") pod "138c726c-0509-4b55-b050-a5b846f7b69d" (UID: "138c726c-0509-4b55-b050-a5b846f7b69d"). InnerVolumeSpecName "dispersionconf". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:20:28 crc kubenswrapper[5120]: I0316 16:20:28.020014 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/138c726c-0509-4b55-b050-a5b846f7b69d-swiftconf" (OuterVolumeSpecName: "swiftconf") pod "138c726c-0509-4b55-b050-a5b846f7b69d" (UID: "138c726c-0509-4b55-b050-a5b846f7b69d"). InnerVolumeSpecName "swiftconf". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:20:28 crc kubenswrapper[5120]: W0316 16:20:28.035200 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod88923e4b_c216_48dd_9b51_988c209c7df9.slice/crio-f60479eca6618eee913d78c85036fdae53baadbabf7baf260c6c7b7d5c3852d8 WatchSource:0}: Error finding container f60479eca6618eee913d78c85036fdae53baadbabf7baf260c6c7b7d5c3852d8: Status 404 returned error can't find the container with id f60479eca6618eee913d78c85036fdae53baadbabf7baf260c6c7b7d5c3852d8 Mar 16 16:20:28 crc kubenswrapper[5120]: I0316 16:20:28.035202 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-sr2cl" Mar 16 16:20:28 crc kubenswrapper[5120]: I0316 16:20:28.100197 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jk8gq\" (UniqueName: \"kubernetes.io/projected/138c726c-0509-4b55-b050-a5b846f7b69d-kube-api-access-jk8gq\") pod \"138c726c-0509-4b55-b050-a5b846f7b69d\" (UID: \"138c726c-0509-4b55-b050-a5b846f7b69d\") " Mar 16 16:20:28 crc kubenswrapper[5120]: I0316 16:20:28.100875 5120 reconciler_common.go:299] "Volume detached for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/138c726c-0509-4b55-b050-a5b846f7b69d-ring-data-devices\") on node \"crc\" DevicePath \"\"" Mar 16 16:20:28 crc kubenswrapper[5120]: I0316 16:20:28.100893 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/138c726c-0509-4b55-b050-a5b846f7b69d-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:20:28 crc kubenswrapper[5120]: I0316 16:20:28.100901 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/138c726c-0509-4b55-b050-a5b846f7b69d-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:20:28 crc kubenswrapper[5120]: I0316 16:20:28.100910 5120 reconciler_common.go:299] "Volume detached for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/138c726c-0509-4b55-b050-a5b846f7b69d-etc-swift\") on node \"crc\" DevicePath \"\"" Mar 16 16:20:28 crc kubenswrapper[5120]: I0316 16:20:28.100918 5120 reconciler_common.go:299] "Volume detached for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/138c726c-0509-4b55-b050-a5b846f7b69d-dispersionconf\") on node \"crc\" DevicePath \"\"" Mar 16 16:20:28 crc kubenswrapper[5120]: I0316 16:20:28.100926 5120 reconciler_common.go:299] "Volume detached for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/138c726c-0509-4b55-b050-a5b846f7b69d-swiftconf\") on node \"crc\" DevicePath \"\"" Mar 16 16:20:28 crc kubenswrapper[5120]: I0316 16:20:28.112952 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/138c726c-0509-4b55-b050-a5b846f7b69d-kube-api-access-jk8gq" (OuterVolumeSpecName: "kube-api-access-jk8gq") pod "138c726c-0509-4b55-b050-a5b846f7b69d" (UID: "138c726c-0509-4b55-b050-a5b846f7b69d"). InnerVolumeSpecName "kube-api-access-jk8gq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:20:28 crc kubenswrapper[5120]: I0316 16:20:28.202271 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jk8gq\" (UniqueName: \"kubernetes.io/projected/138c726c-0509-4b55-b050-a5b846f7b69d-kube-api-access-jk8gq\") on node \"crc\" DevicePath \"\"" Mar 16 16:20:28 crc kubenswrapper[5120]: I0316 16:20:28.333019 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-create-5jzgn" Mar 16 16:20:28 crc kubenswrapper[5120]: I0316 16:20:28.372180 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-b6ca-account-create-update-zpt89" Mar 16 16:20:28 crc kubenswrapper[5120]: I0316 16:20:28.513539 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hspzg\" (UniqueName: \"kubernetes.io/projected/4710f915-4683-4e68-b1e1-ec9143e2331c-kube-api-access-hspzg\") pod \"4710f915-4683-4e68-b1e1-ec9143e2331c\" (UID: \"4710f915-4683-4e68-b1e1-ec9143e2331c\") " Mar 16 16:20:28 crc kubenswrapper[5120]: I0316 16:20:28.514381 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/4710f915-4683-4e68-b1e1-ec9143e2331c-operator-scripts\") pod \"4710f915-4683-4e68-b1e1-ec9143e2331c\" (UID: \"4710f915-4683-4e68-b1e1-ec9143e2331c\") " Mar 16 16:20:28 crc kubenswrapper[5120]: I0316 16:20:28.514457 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c6d25137-770c-4094-9c3a-85b1ac79873c-operator-scripts\") pod \"c6d25137-770c-4094-9c3a-85b1ac79873c\" (UID: \"c6d25137-770c-4094-9c3a-85b1ac79873c\") " Mar 16 16:20:28 crc kubenswrapper[5120]: I0316 16:20:28.514558 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pcrbk\" (UniqueName: \"kubernetes.io/projected/c6d25137-770c-4094-9c3a-85b1ac79873c-kube-api-access-pcrbk\") pod \"c6d25137-770c-4094-9c3a-85b1ac79873c\" (UID: \"c6d25137-770c-4094-9c3a-85b1ac79873c\") " Mar 16 16:20:28 crc kubenswrapper[5120]: I0316 16:20:28.515414 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4710f915-4683-4e68-b1e1-ec9143e2331c-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "4710f915-4683-4e68-b1e1-ec9143e2331c" (UID: "4710f915-4683-4e68-b1e1-ec9143e2331c"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:20:28 crc kubenswrapper[5120]: I0316 16:20:28.515560 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c6d25137-770c-4094-9c3a-85b1ac79873c-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "c6d25137-770c-4094-9c3a-85b1ac79873c" (UID: "c6d25137-770c-4094-9c3a-85b1ac79873c"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:20:28 crc kubenswrapper[5120]: I0316 16:20:28.519343 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4710f915-4683-4e68-b1e1-ec9143e2331c-kube-api-access-hspzg" (OuterVolumeSpecName: "kube-api-access-hspzg") pod "4710f915-4683-4e68-b1e1-ec9143e2331c" (UID: "4710f915-4683-4e68-b1e1-ec9143e2331c"). InnerVolumeSpecName "kube-api-access-hspzg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:20:28 crc kubenswrapper[5120]: I0316 16:20:28.521890 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6d25137-770c-4094-9c3a-85b1ac79873c-kube-api-access-pcrbk" (OuterVolumeSpecName: "kube-api-access-pcrbk") pod "c6d25137-770c-4094-9c3a-85b1ac79873c" (UID: "c6d25137-770c-4094-9c3a-85b1ac79873c"). InnerVolumeSpecName "kube-api-access-pcrbk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:20:28 crc kubenswrapper[5120]: I0316 16:20:28.572408 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-db-create-2ggfv"] Mar 16 16:20:28 crc kubenswrapper[5120]: I0316 16:20:28.573673 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4710f915-4683-4e68-b1e1-ec9143e2331c" containerName="mariadb-account-create-update" Mar 16 16:20:28 crc kubenswrapper[5120]: I0316 16:20:28.573702 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="4710f915-4683-4e68-b1e1-ec9143e2331c" containerName="mariadb-account-create-update" Mar 16 16:20:28 crc kubenswrapper[5120]: I0316 16:20:28.573734 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6d25137-770c-4094-9c3a-85b1ac79873c" containerName="mariadb-database-create" Mar 16 16:20:28 crc kubenswrapper[5120]: I0316 16:20:28.573745 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6d25137-770c-4094-9c3a-85b1ac79873c" containerName="mariadb-database-create" Mar 16 16:20:28 crc kubenswrapper[5120]: I0316 16:20:28.573977 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="4710f915-4683-4e68-b1e1-ec9143e2331c" containerName="mariadb-account-create-update" Mar 16 16:20:28 crc kubenswrapper[5120]: I0316 16:20:28.574013 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c6d25137-770c-4094-9c3a-85b1ac79873c" containerName="mariadb-database-create" Mar 16 16:20:28 crc kubenswrapper[5120]: I0316 16:20:28.580351 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-create-2ggfv" Mar 16 16:20:28 crc kubenswrapper[5120]: I0316 16:20:28.581028 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-db-create-2ggfv"] Mar 16 16:20:28 crc kubenswrapper[5120]: I0316 16:20:28.617693 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/4710f915-4683-4e68-b1e1-ec9143e2331c-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:20:28 crc kubenswrapper[5120]: I0316 16:20:28.617740 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c6d25137-770c-4094-9c3a-85b1ac79873c-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:20:28 crc kubenswrapper[5120]: I0316 16:20:28.617754 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pcrbk\" (UniqueName: \"kubernetes.io/projected/c6d25137-770c-4094-9c3a-85b1ac79873c-kube-api-access-pcrbk\") on node \"crc\" DevicePath \"\"" Mar 16 16:20:28 crc kubenswrapper[5120]: I0316 16:20:28.617783 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hspzg\" (UniqueName: \"kubernetes.io/projected/4710f915-4683-4e68-b1e1-ec9143e2331c-kube-api-access-hspzg\") on node \"crc\" DevicePath \"\"" Mar 16 16:20:28 crc kubenswrapper[5120]: I0316 16:20:28.627653 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-sr2cl"] Mar 16 16:20:28 crc kubenswrapper[5120]: I0316 16:20:28.645102 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-2841-account-create-update-j4bbs"] Mar 16 16:20:28 crc kubenswrapper[5120]: W0316 16:20:28.648408 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode0d63296_b495_418b_937b_3de15045b5c2.slice/crio-e085863b817449eb1335981c865bb6ee996cd39d9f13683a3f494299691020bd WatchSource:0}: Error finding container e085863b817449eb1335981c865bb6ee996cd39d9f13683a3f494299691020bd: Status 404 returned error can't find the container with id e085863b817449eb1335981c865bb6ee996cd39d9f13683a3f494299691020bd Mar 16 16:20:28 crc kubenswrapper[5120]: I0316 16:20:28.652199 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-2841-account-create-update-j4bbs" Mar 16 16:20:28 crc kubenswrapper[5120]: I0316 16:20:28.655235 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-db-secret\"" Mar 16 16:20:28 crc kubenswrapper[5120]: I0316 16:20:28.660869 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-2841-account-create-update-j4bbs"] Mar 16 16:20:28 crc kubenswrapper[5120]: I0316 16:20:28.720011 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b55kg\" (UniqueName: \"kubernetes.io/projected/f157f8fd-51e4-4948-9a15-8c5da242ae97-kube-api-access-b55kg\") pod \"glance-db-create-2ggfv\" (UID: \"f157f8fd-51e4-4948-9a15-8c5da242ae97\") " pod="openstack-kuttl-tests/glance-db-create-2ggfv" Mar 16 16:20:28 crc kubenswrapper[5120]: I0316 16:20:28.720533 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f157f8fd-51e4-4948-9a15-8c5da242ae97-operator-scripts\") pod \"glance-db-create-2ggfv\" (UID: \"f157f8fd-51e4-4948-9a15-8c5da242ae97\") " pod="openstack-kuttl-tests/glance-db-create-2ggfv" Mar 16 16:20:28 crc kubenswrapper[5120]: I0316 16:20:28.755300 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-create-5jzgn" event={"ID":"c6d25137-770c-4094-9c3a-85b1ac79873c","Type":"ContainerDied","Data":"ffd872f625d13d69a6e0ec9e84531aa5af33de598e205c98a3bf1477bdb7b90e"} Mar 16 16:20:28 crc kubenswrapper[5120]: I0316 16:20:28.755355 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ffd872f625d13d69a6e0ec9e84531aa5af33de598e205c98a3bf1477bdb7b90e" Mar 16 16:20:28 crc kubenswrapper[5120]: I0316 16:20:28.755624 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-create-5jzgn" Mar 16 16:20:28 crc kubenswrapper[5120]: I0316 16:20:28.757293 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-sr2cl" event={"ID":"e0d63296-b495-418b-937b-3de15045b5c2","Type":"ContainerStarted","Data":"e085863b817449eb1335981c865bb6ee996cd39d9f13683a3f494299691020bd"} Mar 16 16:20:28 crc kubenswrapper[5120]: I0316 16:20:28.759372 5120 generic.go:358] "Generic (PLEG): container finished" podID="88923e4b-c216-48dd-9b51-988c209c7df9" containerID="e337b753227a44f99187b6b2ea0dee2cb3bbf9714106544ca9af9264a314b250" exitCode=0 Mar 16 16:20:28 crc kubenswrapper[5120]: I0316 16:20:28.759506 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/watcher-7aff-account-create-update-qzj6x" event={"ID":"88923e4b-c216-48dd-9b51-988c209c7df9","Type":"ContainerDied","Data":"e337b753227a44f99187b6b2ea0dee2cb3bbf9714106544ca9af9264a314b250"} Mar 16 16:20:28 crc kubenswrapper[5120]: I0316 16:20:28.759533 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/watcher-7aff-account-create-update-qzj6x" event={"ID":"88923e4b-c216-48dd-9b51-988c209c7df9","Type":"ContainerStarted","Data":"f60479eca6618eee913d78c85036fdae53baadbabf7baf260c6c7b7d5c3852d8"} Mar 16 16:20:28 crc kubenswrapper[5120]: I0316 16:20:28.761648 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-7kzs9" Mar 16 16:20:28 crc kubenswrapper[5120]: I0316 16:20:28.761842 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-b6ca-account-create-update-zpt89" event={"ID":"4710f915-4683-4e68-b1e1-ec9143e2331c","Type":"ContainerDied","Data":"14d0960f4c939b4aba7dda07c0480f5a475b08d0a71d7348f04dfb4e034e79a8"} Mar 16 16:20:28 crc kubenswrapper[5120]: I0316 16:20:28.761883 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="14d0960f4c939b4aba7dda07c0480f5a475b08d0a71d7348f04dfb4e034e79a8" Mar 16 16:20:28 crc kubenswrapper[5120]: I0316 16:20:28.761996 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-b6ca-account-create-update-zpt89" Mar 16 16:20:28 crc kubenswrapper[5120]: I0316 16:20:28.831504 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b55kg\" (UniqueName: \"kubernetes.io/projected/f157f8fd-51e4-4948-9a15-8c5da242ae97-kube-api-access-b55kg\") pod \"glance-db-create-2ggfv\" (UID: \"f157f8fd-51e4-4948-9a15-8c5da242ae97\") " pod="openstack-kuttl-tests/glance-db-create-2ggfv" Mar 16 16:20:28 crc kubenswrapper[5120]: I0316 16:20:28.831747 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f157f8fd-51e4-4948-9a15-8c5da242ae97-operator-scripts\") pod \"glance-db-create-2ggfv\" (UID: \"f157f8fd-51e4-4948-9a15-8c5da242ae97\") " pod="openstack-kuttl-tests/glance-db-create-2ggfv" Mar 16 16:20:28 crc kubenswrapper[5120]: I0316 16:20:28.831847 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/1e9c9fdb-20c1-4c7b-b5d1-91088ed981a5-operator-scripts\") pod \"glance-2841-account-create-update-j4bbs\" (UID: \"1e9c9fdb-20c1-4c7b-b5d1-91088ed981a5\") " pod="openstack-kuttl-tests/glance-2841-account-create-update-j4bbs" Mar 16 16:20:28 crc kubenswrapper[5120]: I0316 16:20:28.832119 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vs7f\" (UniqueName: \"kubernetes.io/projected/1e9c9fdb-20c1-4c7b-b5d1-91088ed981a5-kube-api-access-9vs7f\") pod \"glance-2841-account-create-update-j4bbs\" (UID: \"1e9c9fdb-20c1-4c7b-b5d1-91088ed981a5\") " pod="openstack-kuttl-tests/glance-2841-account-create-update-j4bbs" Mar 16 16:20:28 crc kubenswrapper[5120]: I0316 16:20:28.865852 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f157f8fd-51e4-4948-9a15-8c5da242ae97-operator-scripts\") pod \"glance-db-create-2ggfv\" (UID: \"f157f8fd-51e4-4948-9a15-8c5da242ae97\") " pod="openstack-kuttl-tests/glance-db-create-2ggfv" Mar 16 16:20:28 crc kubenswrapper[5120]: I0316 16:20:28.882771 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-7kzs9"] Mar 16 16:20:28 crc kubenswrapper[5120]: I0316 16:20:28.885372 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b55kg\" (UniqueName: \"kubernetes.io/projected/f157f8fd-51e4-4948-9a15-8c5da242ae97-kube-api-access-b55kg\") pod \"glance-db-create-2ggfv\" (UID: \"f157f8fd-51e4-4948-9a15-8c5da242ae97\") " pod="openstack-kuttl-tests/glance-db-create-2ggfv" Mar 16 16:20:28 crc kubenswrapper[5120]: I0316 16:20:28.903281 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-create-2ggfv" Mar 16 16:20:28 crc kubenswrapper[5120]: I0316 16:20:28.909800 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-7kzs9"] Mar 16 16:20:28 crc kubenswrapper[5120]: I0316 16:20:28.937801 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/1e9c9fdb-20c1-4c7b-b5d1-91088ed981a5-operator-scripts\") pod \"glance-2841-account-create-update-j4bbs\" (UID: \"1e9c9fdb-20c1-4c7b-b5d1-91088ed981a5\") " pod="openstack-kuttl-tests/glance-2841-account-create-update-j4bbs" Mar 16 16:20:28 crc kubenswrapper[5120]: I0316 16:20:28.937957 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9vs7f\" (UniqueName: \"kubernetes.io/projected/1e9c9fdb-20c1-4c7b-b5d1-91088ed981a5-kube-api-access-9vs7f\") pod \"glance-2841-account-create-update-j4bbs\" (UID: \"1e9c9fdb-20c1-4c7b-b5d1-91088ed981a5\") " pod="openstack-kuttl-tests/glance-2841-account-create-update-j4bbs" Mar 16 16:20:28 crc kubenswrapper[5120]: I0316 16:20:28.938720 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/1e9c9fdb-20c1-4c7b-b5d1-91088ed981a5-operator-scripts\") pod \"glance-2841-account-create-update-j4bbs\" (UID: \"1e9c9fdb-20c1-4c7b-b5d1-91088ed981a5\") " pod="openstack-kuttl-tests/glance-2841-account-create-update-j4bbs" Mar 16 16:20:28 crc kubenswrapper[5120]: I0316 16:20:28.958023 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vs7f\" (UniqueName: \"kubernetes.io/projected/1e9c9fdb-20c1-4c7b-b5d1-91088ed981a5-kube-api-access-9vs7f\") pod \"glance-2841-account-create-update-j4bbs\" (UID: \"1e9c9fdb-20c1-4c7b-b5d1-91088ed981a5\") " pod="openstack-kuttl-tests/glance-2841-account-create-update-j4bbs" Mar 16 16:20:29 crc kubenswrapper[5120]: I0316 16:20:29.036973 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-2841-account-create-update-j4bbs" Mar 16 16:20:29 crc kubenswrapper[5120]: I0316 16:20:29.039443 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/7f5bff08-fc88-42fc-ab9b-6d8db171ee6a-etc-swift\") pod \"swift-storage-0\" (UID: \"7f5bff08-fc88-42fc-ab9b-6d8db171ee6a\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:20:29 crc kubenswrapper[5120]: E0316 16:20:29.039937 5120 projected.go:289] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Mar 16 16:20:29 crc kubenswrapper[5120]: E0316 16:20:29.039965 5120 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Mar 16 16:20:29 crc kubenswrapper[5120]: E0316 16:20:29.040038 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7f5bff08-fc88-42fc-ab9b-6d8db171ee6a-etc-swift podName:7f5bff08-fc88-42fc-ab9b-6d8db171ee6a nodeName:}" failed. No retries permitted until 2026-03-16 16:20:31.040016127 +0000 UTC m=+2933.193947784 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/7f5bff08-fc88-42fc-ab9b-6d8db171ee6a-etc-swift") pod "swift-storage-0" (UID: "7f5bff08-fc88-42fc-ab9b-6d8db171ee6a") : configmap "swift-ring-files" not found Mar 16 16:20:29 crc kubenswrapper[5120]: I0316 16:20:29.282826 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/watcher-db-create-zwrqr" Mar 16 16:20:29 crc kubenswrapper[5120]: I0316 16:20:29.447159 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-htlg7\" (UniqueName: \"kubernetes.io/projected/ecd9da24-f35b-48a1-80a4-47e1557b4e0d-kube-api-access-htlg7\") pod \"ecd9da24-f35b-48a1-80a4-47e1557b4e0d\" (UID: \"ecd9da24-f35b-48a1-80a4-47e1557b4e0d\") " Mar 16 16:20:29 crc kubenswrapper[5120]: I0316 16:20:29.447572 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ecd9da24-f35b-48a1-80a4-47e1557b4e0d-operator-scripts\") pod \"ecd9da24-f35b-48a1-80a4-47e1557b4e0d\" (UID: \"ecd9da24-f35b-48a1-80a4-47e1557b4e0d\") " Mar 16 16:20:29 crc kubenswrapper[5120]: I0316 16:20:29.448990 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ecd9da24-f35b-48a1-80a4-47e1557b4e0d-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "ecd9da24-f35b-48a1-80a4-47e1557b4e0d" (UID: "ecd9da24-f35b-48a1-80a4-47e1557b4e0d"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:20:29 crc kubenswrapper[5120]: I0316 16:20:29.454843 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ecd9da24-f35b-48a1-80a4-47e1557b4e0d-kube-api-access-htlg7" (OuterVolumeSpecName: "kube-api-access-htlg7") pod "ecd9da24-f35b-48a1-80a4-47e1557b4e0d" (UID: "ecd9da24-f35b-48a1-80a4-47e1557b4e0d"). InnerVolumeSpecName "kube-api-access-htlg7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:20:29 crc kubenswrapper[5120]: I0316 16:20:29.474532 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-1b1e-account-create-update-xsrqk" Mar 16 16:20:29 crc kubenswrapper[5120]: I0316 16:20:29.502727 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-create-jltxh" Mar 16 16:20:29 crc kubenswrapper[5120]: I0316 16:20:29.550131 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-htlg7\" (UniqueName: \"kubernetes.io/projected/ecd9da24-f35b-48a1-80a4-47e1557b4e0d-kube-api-access-htlg7\") on node \"crc\" DevicePath \"\"" Mar 16 16:20:29 crc kubenswrapper[5120]: I0316 16:20:29.550169 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ecd9da24-f35b-48a1-80a4-47e1557b4e0d-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:20:29 crc kubenswrapper[5120]: I0316 16:20:29.633032 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-db-create-2ggfv"] Mar 16 16:20:29 crc kubenswrapper[5120]: I0316 16:20:29.651405 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mh99v\" (UniqueName: \"kubernetes.io/projected/5da55de8-8d9d-4e87-a022-c3c0b95403bf-kube-api-access-mh99v\") pod \"5da55de8-8d9d-4e87-a022-c3c0b95403bf\" (UID: \"5da55de8-8d9d-4e87-a022-c3c0b95403bf\") " Mar 16 16:20:29 crc kubenswrapper[5120]: I0316 16:20:29.651511 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-2841-account-create-update-j4bbs"] Mar 16 16:20:29 crc kubenswrapper[5120]: I0316 16:20:29.651630 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5da55de8-8d9d-4e87-a022-c3c0b95403bf-operator-scripts\") pod \"5da55de8-8d9d-4e87-a022-c3c0b95403bf\" (UID: \"5da55de8-8d9d-4e87-a022-c3c0b95403bf\") " Mar 16 16:20:29 crc kubenswrapper[5120]: I0316 16:20:29.651683 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/442c41b4-b70b-4714-933f-3470a22e2422-operator-scripts\") pod \"442c41b4-b70b-4714-933f-3470a22e2422\" (UID: \"442c41b4-b70b-4714-933f-3470a22e2422\") " Mar 16 16:20:29 crc kubenswrapper[5120]: I0316 16:20:29.651916 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6rbmz\" (UniqueName: \"kubernetes.io/projected/442c41b4-b70b-4714-933f-3470a22e2422-kube-api-access-6rbmz\") pod \"442c41b4-b70b-4714-933f-3470a22e2422\" (UID: \"442c41b4-b70b-4714-933f-3470a22e2422\") " Mar 16 16:20:29 crc kubenswrapper[5120]: I0316 16:20:29.655816 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5da55de8-8d9d-4e87-a022-c3c0b95403bf-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "5da55de8-8d9d-4e87-a022-c3c0b95403bf" (UID: "5da55de8-8d9d-4e87-a022-c3c0b95403bf"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:20:29 crc kubenswrapper[5120]: I0316 16:20:29.656061 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/442c41b4-b70b-4714-933f-3470a22e2422-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "442c41b4-b70b-4714-933f-3470a22e2422" (UID: "442c41b4-b70b-4714-933f-3470a22e2422"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:20:29 crc kubenswrapper[5120]: I0316 16:20:29.658848 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/442c41b4-b70b-4714-933f-3470a22e2422-kube-api-access-6rbmz" (OuterVolumeSpecName: "kube-api-access-6rbmz") pod "442c41b4-b70b-4714-933f-3470a22e2422" (UID: "442c41b4-b70b-4714-933f-3470a22e2422"). InnerVolumeSpecName "kube-api-access-6rbmz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:20:29 crc kubenswrapper[5120]: I0316 16:20:29.658923 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5da55de8-8d9d-4e87-a022-c3c0b95403bf-kube-api-access-mh99v" (OuterVolumeSpecName: "kube-api-access-mh99v") pod "5da55de8-8d9d-4e87-a022-c3c0b95403bf" (UID: "5da55de8-8d9d-4e87-a022-c3c0b95403bf"). InnerVolumeSpecName "kube-api-access-mh99v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:20:29 crc kubenswrapper[5120]: I0316 16:20:29.755634 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/442c41b4-b70b-4714-933f-3470a22e2422-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:20:29 crc kubenswrapper[5120]: I0316 16:20:29.755677 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6rbmz\" (UniqueName: \"kubernetes.io/projected/442c41b4-b70b-4714-933f-3470a22e2422-kube-api-access-6rbmz\") on node \"crc\" DevicePath \"\"" Mar 16 16:20:29 crc kubenswrapper[5120]: I0316 16:20:29.755697 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mh99v\" (UniqueName: \"kubernetes.io/projected/5da55de8-8d9d-4e87-a022-c3c0b95403bf-kube-api-access-mh99v\") on node \"crc\" DevicePath \"\"" Mar 16 16:20:29 crc kubenswrapper[5120]: I0316 16:20:29.755712 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5da55de8-8d9d-4e87-a022-c3c0b95403bf-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:20:29 crc kubenswrapper[5120]: I0316 16:20:29.778794 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-create-2ggfv" event={"ID":"f157f8fd-51e4-4948-9a15-8c5da242ae97","Type":"ContainerStarted","Data":"e05a762b72a0ac31fab527bf298a3a6139d2ee897616fd0312a6636a71134a37"} Mar 16 16:20:29 crc kubenswrapper[5120]: I0316 16:20:29.781322 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/watcher-db-create-zwrqr" event={"ID":"ecd9da24-f35b-48a1-80a4-47e1557b4e0d","Type":"ContainerDied","Data":"fa92f3537d8327fe5e425ba5a6d10e2499abc339cebba5b0b3a43f15da10bb77"} Mar 16 16:20:29 crc kubenswrapper[5120]: I0316 16:20:29.781367 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fa92f3537d8327fe5e425ba5a6d10e2499abc339cebba5b0b3a43f15da10bb77" Mar 16 16:20:29 crc kubenswrapper[5120]: I0316 16:20:29.781393 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/watcher-db-create-zwrqr" Mar 16 16:20:29 crc kubenswrapper[5120]: I0316 16:20:29.790687 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-create-jltxh" event={"ID":"5da55de8-8d9d-4e87-a022-c3c0b95403bf","Type":"ContainerDied","Data":"33eb6a38d9a94c6aa6eec7087d18f1d3260e2175a3186f9d841f06c3b13a4250"} Mar 16 16:20:29 crc kubenswrapper[5120]: I0316 16:20:29.790739 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="33eb6a38d9a94c6aa6eec7087d18f1d3260e2175a3186f9d841f06c3b13a4250" Mar 16 16:20:29 crc kubenswrapper[5120]: I0316 16:20:29.790705 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-create-jltxh" Mar 16 16:20:29 crc kubenswrapper[5120]: I0316 16:20:29.794314 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-sr2cl" event={"ID":"e0d63296-b495-418b-937b-3de15045b5c2","Type":"ContainerStarted","Data":"1ddcfd5d034aa6deaf40884273678979b2fe808078bc9c218243bb3aac2ec261"} Mar 16 16:20:29 crc kubenswrapper[5120]: I0316 16:20:29.796737 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-1b1e-account-create-update-xsrqk" Mar 16 16:20:29 crc kubenswrapper[5120]: I0316 16:20:29.796783 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-1b1e-account-create-update-xsrqk" event={"ID":"442c41b4-b70b-4714-933f-3470a22e2422","Type":"ContainerDied","Data":"0b27338b594edaeba88e741c2eb7e2e1d4399466d68c26946b66fb09042618c9"} Mar 16 16:20:29 crc kubenswrapper[5120]: I0316 16:20:29.796813 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0b27338b594edaeba88e741c2eb7e2e1d4399466d68c26946b66fb09042618c9" Mar 16 16:20:29 crc kubenswrapper[5120]: I0316 16:20:29.803006 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-2841-account-create-update-j4bbs" event={"ID":"1e9c9fdb-20c1-4c7b-b5d1-91088ed981a5","Type":"ContainerStarted","Data":"38d0ae59b6cbfbbc8f824e33964010f1147c0145b87186883b02b0c98842ad2e"} Mar 16 16:20:29 crc kubenswrapper[5120]: I0316 16:20:29.814217 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/swift-ring-rebalance-sr2cl" podStartSLOduration=2.814205104 podStartE2EDuration="2.814205104s" podCreationTimestamp="2026-03-16 16:20:27 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:20:29.811706357 +0000 UTC m=+2931.965638014" watchObservedRunningTime="2026-03-16 16:20:29.814205104 +0000 UTC m=+2931.968136751" Mar 16 16:20:30 crc kubenswrapper[5120]: I0316 16:20:30.676487 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="138c726c-0509-4b55-b050-a5b846f7b69d" path="/var/lib/kubelet/pods/138c726c-0509-4b55-b050-a5b846f7b69d/volumes" Mar 16 16:20:30 crc kubenswrapper[5120]: I0316 16:20:30.813999 5120 generic.go:358] "Generic (PLEG): container finished" podID="f157f8fd-51e4-4948-9a15-8c5da242ae97" containerID="ee2dbd92d8c632c7f11ac63c279c2d0955265a5153094b60dbfed327c9046a88" exitCode=0 Mar 16 16:20:30 crc kubenswrapper[5120]: I0316 16:20:30.814508 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-create-2ggfv" event={"ID":"f157f8fd-51e4-4948-9a15-8c5da242ae97","Type":"ContainerDied","Data":"ee2dbd92d8c632c7f11ac63c279c2d0955265a5153094b60dbfed327c9046a88"} Mar 16 16:20:30 crc kubenswrapper[5120]: I0316 16:20:30.818330 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/watcher-7aff-account-create-update-qzj6x" event={"ID":"88923e4b-c216-48dd-9b51-988c209c7df9","Type":"ContainerDied","Data":"f60479eca6618eee913d78c85036fdae53baadbabf7baf260c6c7b7d5c3852d8"} Mar 16 16:20:30 crc kubenswrapper[5120]: I0316 16:20:30.818352 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f60479eca6618eee913d78c85036fdae53baadbabf7baf260c6c7b7d5c3852d8" Mar 16 16:20:30 crc kubenswrapper[5120]: I0316 16:20:30.822551 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/watcher-7aff-account-create-update-qzj6x" Mar 16 16:20:30 crc kubenswrapper[5120]: I0316 16:20:30.822725 5120 generic.go:358] "Generic (PLEG): container finished" podID="1e9c9fdb-20c1-4c7b-b5d1-91088ed981a5" containerID="a70070a0cdf8b938ca28a83896d0eaadeb26a79b3f907ff7a81de44229468628" exitCode=0 Mar 16 16:20:30 crc kubenswrapper[5120]: I0316 16:20:30.823986 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-2841-account-create-update-j4bbs" event={"ID":"1e9c9fdb-20c1-4c7b-b5d1-91088ed981a5","Type":"ContainerDied","Data":"a70070a0cdf8b938ca28a83896d0eaadeb26a79b3f907ff7a81de44229468628"} Mar 16 16:20:30 crc kubenswrapper[5120]: I0316 16:20:30.878473 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/88923e4b-c216-48dd-9b51-988c209c7df9-operator-scripts\") pod \"88923e4b-c216-48dd-9b51-988c209c7df9\" (UID: \"88923e4b-c216-48dd-9b51-988c209c7df9\") " Mar 16 16:20:30 crc kubenswrapper[5120]: I0316 16:20:30.878677 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nmbjt\" (UniqueName: \"kubernetes.io/projected/88923e4b-c216-48dd-9b51-988c209c7df9-kube-api-access-nmbjt\") pod \"88923e4b-c216-48dd-9b51-988c209c7df9\" (UID: \"88923e4b-c216-48dd-9b51-988c209c7df9\") " Mar 16 16:20:30 crc kubenswrapper[5120]: I0316 16:20:30.879349 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/88923e4b-c216-48dd-9b51-988c209c7df9-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "88923e4b-c216-48dd-9b51-988c209c7df9" (UID: "88923e4b-c216-48dd-9b51-988c209c7df9"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:20:30 crc kubenswrapper[5120]: I0316 16:20:30.879470 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/88923e4b-c216-48dd-9b51-988c209c7df9-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:20:30 crc kubenswrapper[5120]: I0316 16:20:30.904472 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88923e4b-c216-48dd-9b51-988c209c7df9-kube-api-access-nmbjt" (OuterVolumeSpecName: "kube-api-access-nmbjt") pod "88923e4b-c216-48dd-9b51-988c209c7df9" (UID: "88923e4b-c216-48dd-9b51-988c209c7df9"). InnerVolumeSpecName "kube-api-access-nmbjt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:20:30 crc kubenswrapper[5120]: I0316 16:20:30.982313 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nmbjt\" (UniqueName: \"kubernetes.io/projected/88923e4b-c216-48dd-9b51-988c209c7df9-kube-api-access-nmbjt\") on node \"crc\" DevicePath \"\"" Mar 16 16:20:31 crc kubenswrapper[5120]: I0316 16:20:31.084487 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/7f5bff08-fc88-42fc-ab9b-6d8db171ee6a-etc-swift\") pod \"swift-storage-0\" (UID: \"7f5bff08-fc88-42fc-ab9b-6d8db171ee6a\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:20:31 crc kubenswrapper[5120]: E0316 16:20:31.084690 5120 projected.go:289] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Mar 16 16:20:31 crc kubenswrapper[5120]: E0316 16:20:31.084729 5120 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Mar 16 16:20:31 crc kubenswrapper[5120]: E0316 16:20:31.084915 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7f5bff08-fc88-42fc-ab9b-6d8db171ee6a-etc-swift podName:7f5bff08-fc88-42fc-ab9b-6d8db171ee6a nodeName:}" failed. No retries permitted until 2026-03-16 16:20:35.084895202 +0000 UTC m=+2937.238826859 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/7f5bff08-fc88-42fc-ab9b-6d8db171ee6a-etc-swift") pod "swift-storage-0" (UID: "7f5bff08-fc88-42fc-ab9b-6d8db171ee6a") : configmap "swift-ring-files" not found Mar 16 16:20:31 crc kubenswrapper[5120]: I0316 16:20:31.841028 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/alertmanager-metric-storage-0" event={"ID":"9b43ebee-5f04-44e0-a8bf-56f70871894e","Type":"ContainerStarted","Data":"d174f547bf24ef444cb7eb8748c654dbe1df34b53324eb8a10d06c56c02dec63"} Mar 16 16:20:31 crc kubenswrapper[5120]: I0316 16:20:31.841472 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/watcher-7aff-account-create-update-qzj6x" Mar 16 16:20:31 crc kubenswrapper[5120]: I0316 16:20:31.971096 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/root-account-create-update-qkk4c"] Mar 16 16:20:31 crc kubenswrapper[5120]: I0316 16:20:31.972472 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88923e4b-c216-48dd-9b51-988c209c7df9" containerName="mariadb-account-create-update" Mar 16 16:20:31 crc kubenswrapper[5120]: I0316 16:20:31.972498 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="88923e4b-c216-48dd-9b51-988c209c7df9" containerName="mariadb-account-create-update" Mar 16 16:20:31 crc kubenswrapper[5120]: I0316 16:20:31.972543 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5da55de8-8d9d-4e87-a022-c3c0b95403bf" containerName="mariadb-database-create" Mar 16 16:20:31 crc kubenswrapper[5120]: I0316 16:20:31.972551 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="5da55de8-8d9d-4e87-a022-c3c0b95403bf" containerName="mariadb-database-create" Mar 16 16:20:31 crc kubenswrapper[5120]: I0316 16:20:31.972569 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="442c41b4-b70b-4714-933f-3470a22e2422" containerName="mariadb-account-create-update" Mar 16 16:20:31 crc kubenswrapper[5120]: I0316 16:20:31.972579 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="442c41b4-b70b-4714-933f-3470a22e2422" containerName="mariadb-account-create-update" Mar 16 16:20:31 crc kubenswrapper[5120]: I0316 16:20:31.972603 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ecd9da24-f35b-48a1-80a4-47e1557b4e0d" containerName="mariadb-database-create" Mar 16 16:20:31 crc kubenswrapper[5120]: I0316 16:20:31.972611 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ecd9da24-f35b-48a1-80a4-47e1557b4e0d" containerName="mariadb-database-create" Mar 16 16:20:31 crc kubenswrapper[5120]: I0316 16:20:31.972877 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="88923e4b-c216-48dd-9b51-988c209c7df9" containerName="mariadb-account-create-update" Mar 16 16:20:31 crc kubenswrapper[5120]: I0316 16:20:31.972916 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ecd9da24-f35b-48a1-80a4-47e1557b4e0d" containerName="mariadb-database-create" Mar 16 16:20:31 crc kubenswrapper[5120]: I0316 16:20:31.972932 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="5da55de8-8d9d-4e87-a022-c3c0b95403bf" containerName="mariadb-database-create" Mar 16 16:20:31 crc kubenswrapper[5120]: I0316 16:20:31.972947 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="442c41b4-b70b-4714-933f-3470a22e2422" containerName="mariadb-account-create-update" Mar 16 16:20:31 crc kubenswrapper[5120]: I0316 16:20:31.980582 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-qkk4c"] Mar 16 16:20:31 crc kubenswrapper[5120]: I0316 16:20:31.980796 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-qkk4c" Mar 16 16:20:31 crc kubenswrapper[5120]: I0316 16:20:31.984132 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"openstack-mariadb-root-db-secret\"" Mar 16 16:20:32 crc kubenswrapper[5120]: I0316 16:20:32.003245 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c2cd901d-2bb0-43a4-affa-534bbbf63f11-operator-scripts\") pod \"root-account-create-update-qkk4c\" (UID: \"c2cd901d-2bb0-43a4-affa-534bbbf63f11\") " pod="openstack-kuttl-tests/root-account-create-update-qkk4c" Mar 16 16:20:32 crc kubenswrapper[5120]: I0316 16:20:32.003739 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qcqn6\" (UniqueName: \"kubernetes.io/projected/c2cd901d-2bb0-43a4-affa-534bbbf63f11-kube-api-access-qcqn6\") pod \"root-account-create-update-qkk4c\" (UID: \"c2cd901d-2bb0-43a4-affa-534bbbf63f11\") " pod="openstack-kuttl-tests/root-account-create-update-qkk4c" Mar 16 16:20:32 crc kubenswrapper[5120]: I0316 16:20:32.105876 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c2cd901d-2bb0-43a4-affa-534bbbf63f11-operator-scripts\") pod \"root-account-create-update-qkk4c\" (UID: \"c2cd901d-2bb0-43a4-affa-534bbbf63f11\") " pod="openstack-kuttl-tests/root-account-create-update-qkk4c" Mar 16 16:20:32 crc kubenswrapper[5120]: I0316 16:20:32.106983 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qcqn6\" (UniqueName: \"kubernetes.io/projected/c2cd901d-2bb0-43a4-affa-534bbbf63f11-kube-api-access-qcqn6\") pod \"root-account-create-update-qkk4c\" (UID: \"c2cd901d-2bb0-43a4-affa-534bbbf63f11\") " pod="openstack-kuttl-tests/root-account-create-update-qkk4c" Mar 16 16:20:32 crc kubenswrapper[5120]: I0316 16:20:32.107660 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c2cd901d-2bb0-43a4-affa-534bbbf63f11-operator-scripts\") pod \"root-account-create-update-qkk4c\" (UID: \"c2cd901d-2bb0-43a4-affa-534bbbf63f11\") " pod="openstack-kuttl-tests/root-account-create-update-qkk4c" Mar 16 16:20:32 crc kubenswrapper[5120]: I0316 16:20:32.134184 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qcqn6\" (UniqueName: \"kubernetes.io/projected/c2cd901d-2bb0-43a4-affa-534bbbf63f11-kube-api-access-qcqn6\") pod \"root-account-create-update-qkk4c\" (UID: \"c2cd901d-2bb0-43a4-affa-534bbbf63f11\") " pod="openstack-kuttl-tests/root-account-create-update-qkk4c" Mar 16 16:20:32 crc kubenswrapper[5120]: I0316 16:20:32.299054 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-qkk4c" Mar 16 16:20:32 crc kubenswrapper[5120]: I0316 16:20:32.657679 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:20:33 crc kubenswrapper[5120]: I0316 16:20:33.869390 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/alertmanager-metric-storage-0" event={"ID":"9b43ebee-5f04-44e0-a8bf-56f70871894e","Type":"ContainerStarted","Data":"b1a722f653ecb9a8de687b89024aff31dbebdf8af7ee495b08f3d6c4416ffed9"} Mar 16 16:20:33 crc kubenswrapper[5120]: I0316 16:20:33.870052 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/alertmanager-metric-storage-0" Mar 16 16:20:33 crc kubenswrapper[5120]: I0316 16:20:33.897035 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/alertmanager-metric-storage-0" podStartSLOduration=4.169553023 podStartE2EDuration="19.897017588s" podCreationTimestamp="2026-03-16 16:20:14 +0000 UTC" firstStartedPulling="2026-03-16 16:20:15.098719527 +0000 UTC m=+2917.252651174" lastFinishedPulling="2026-03-16 16:20:30.826184082 +0000 UTC m=+2932.980115739" observedRunningTime="2026-03-16 16:20:33.891319296 +0000 UTC m=+2936.045250973" watchObservedRunningTime="2026-03-16 16:20:33.897017588 +0000 UTC m=+2936.050949245" Mar 16 16:20:34 crc kubenswrapper[5120]: I0316 16:20:34.589121 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-2841-account-create-update-j4bbs" Mar 16 16:20:34 crc kubenswrapper[5120]: I0316 16:20:34.650479 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-create-2ggfv" Mar 16 16:20:34 crc kubenswrapper[5120]: I0316 16:20:34.665113 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9vs7f\" (UniqueName: \"kubernetes.io/projected/1e9c9fdb-20c1-4c7b-b5d1-91088ed981a5-kube-api-access-9vs7f\") pod \"1e9c9fdb-20c1-4c7b-b5d1-91088ed981a5\" (UID: \"1e9c9fdb-20c1-4c7b-b5d1-91088ed981a5\") " Mar 16 16:20:34 crc kubenswrapper[5120]: I0316 16:20:34.665604 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/1e9c9fdb-20c1-4c7b-b5d1-91088ed981a5-operator-scripts\") pod \"1e9c9fdb-20c1-4c7b-b5d1-91088ed981a5\" (UID: \"1e9c9fdb-20c1-4c7b-b5d1-91088ed981a5\") " Mar 16 16:20:34 crc kubenswrapper[5120]: I0316 16:20:34.666728 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e9c9fdb-20c1-4c7b-b5d1-91088ed981a5-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "1e9c9fdb-20c1-4c7b-b5d1-91088ed981a5" (UID: "1e9c9fdb-20c1-4c7b-b5d1-91088ed981a5"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:20:34 crc kubenswrapper[5120]: I0316 16:20:34.671520 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e9c9fdb-20c1-4c7b-b5d1-91088ed981a5-kube-api-access-9vs7f" (OuterVolumeSpecName: "kube-api-access-9vs7f") pod "1e9c9fdb-20c1-4c7b-b5d1-91088ed981a5" (UID: "1e9c9fdb-20c1-4c7b-b5d1-91088ed981a5"). InnerVolumeSpecName "kube-api-access-9vs7f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:20:34 crc kubenswrapper[5120]: I0316 16:20:34.767454 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f157f8fd-51e4-4948-9a15-8c5da242ae97-operator-scripts\") pod \"f157f8fd-51e4-4948-9a15-8c5da242ae97\" (UID: \"f157f8fd-51e4-4948-9a15-8c5da242ae97\") " Mar 16 16:20:34 crc kubenswrapper[5120]: I0316 16:20:34.767668 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b55kg\" (UniqueName: \"kubernetes.io/projected/f157f8fd-51e4-4948-9a15-8c5da242ae97-kube-api-access-b55kg\") pod \"f157f8fd-51e4-4948-9a15-8c5da242ae97\" (UID: \"f157f8fd-51e4-4948-9a15-8c5da242ae97\") " Mar 16 16:20:34 crc kubenswrapper[5120]: I0316 16:20:34.768253 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/1e9c9fdb-20c1-4c7b-b5d1-91088ed981a5-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:20:34 crc kubenswrapper[5120]: I0316 16:20:34.768266 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9vs7f\" (UniqueName: \"kubernetes.io/projected/1e9c9fdb-20c1-4c7b-b5d1-91088ed981a5-kube-api-access-9vs7f\") on node \"crc\" DevicePath \"\"" Mar 16 16:20:34 crc kubenswrapper[5120]: I0316 16:20:34.768711 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f157f8fd-51e4-4948-9a15-8c5da242ae97-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "f157f8fd-51e4-4948-9a15-8c5da242ae97" (UID: "f157f8fd-51e4-4948-9a15-8c5da242ae97"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:20:34 crc kubenswrapper[5120]: I0316 16:20:34.770725 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f157f8fd-51e4-4948-9a15-8c5da242ae97-kube-api-access-b55kg" (OuterVolumeSpecName: "kube-api-access-b55kg") pod "f157f8fd-51e4-4948-9a15-8c5da242ae97" (UID: "f157f8fd-51e4-4948-9a15-8c5da242ae97"). InnerVolumeSpecName "kube-api-access-b55kg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:20:34 crc kubenswrapper[5120]: I0316 16:20:34.870156 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f157f8fd-51e4-4948-9a15-8c5da242ae97-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:20:34 crc kubenswrapper[5120]: I0316 16:20:34.870199 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b55kg\" (UniqueName: \"kubernetes.io/projected/f157f8fd-51e4-4948-9a15-8c5da242ae97-kube-api-access-b55kg\") on node \"crc\" DevicePath \"\"" Mar 16 16:20:34 crc kubenswrapper[5120]: I0316 16:20:34.879626 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-2841-account-create-update-j4bbs" Mar 16 16:20:34 crc kubenswrapper[5120]: I0316 16:20:34.879719 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-2841-account-create-update-j4bbs" event={"ID":"1e9c9fdb-20c1-4c7b-b5d1-91088ed981a5","Type":"ContainerDied","Data":"38d0ae59b6cbfbbc8f824e33964010f1147c0145b87186883b02b0c98842ad2e"} Mar 16 16:20:34 crc kubenswrapper[5120]: I0316 16:20:34.879779 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="38d0ae59b6cbfbbc8f824e33964010f1147c0145b87186883b02b0c98842ad2e" Mar 16 16:20:34 crc kubenswrapper[5120]: I0316 16:20:34.885043 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/prometheus-metric-storage-0" event={"ID":"e007aee0-65df-4ec7-bd52-23bf7f4b704f","Type":"ContainerStarted","Data":"f287e2a89b8a786d204d6870f4cd0a46a6ed86d615917bcfadfd137614b32e66"} Mar 16 16:20:34 crc kubenswrapper[5120]: I0316 16:20:34.886654 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-create-2ggfv" event={"ID":"f157f8fd-51e4-4948-9a15-8c5da242ae97","Type":"ContainerDied","Data":"e05a762b72a0ac31fab527bf298a3a6139d2ee897616fd0312a6636a71134a37"} Mar 16 16:20:34 crc kubenswrapper[5120]: I0316 16:20:34.886691 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e05a762b72a0ac31fab527bf298a3a6139d2ee897616fd0312a6636a71134a37" Mar 16 16:20:34 crc kubenswrapper[5120]: I0316 16:20:34.886721 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-create-2ggfv" Mar 16 16:20:34 crc kubenswrapper[5120]: I0316 16:20:34.888529 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/alertmanager-metric-storage-0" Mar 16 16:20:34 crc kubenswrapper[5120]: I0316 16:20:34.959021 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-qkk4c"] Mar 16 16:20:35 crc kubenswrapper[5120]: I0316 16:20:35.175640 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/7f5bff08-fc88-42fc-ab9b-6d8db171ee6a-etc-swift\") pod \"swift-storage-0\" (UID: \"7f5bff08-fc88-42fc-ab9b-6d8db171ee6a\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:20:35 crc kubenswrapper[5120]: E0316 16:20:35.176186 5120 projected.go:289] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Mar 16 16:20:35 crc kubenswrapper[5120]: E0316 16:20:35.176213 5120 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Mar 16 16:20:35 crc kubenswrapper[5120]: E0316 16:20:35.176273 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7f5bff08-fc88-42fc-ab9b-6d8db171ee6a-etc-swift podName:7f5bff08-fc88-42fc-ab9b-6d8db171ee6a nodeName:}" failed. No retries permitted until 2026-03-16 16:20:43.176254705 +0000 UTC m=+2945.330186372 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/7f5bff08-fc88-42fc-ab9b-6d8db171ee6a-etc-swift") pod "swift-storage-0" (UID: "7f5bff08-fc88-42fc-ab9b-6d8db171ee6a") : configmap "swift-ring-files" not found Mar 16 16:20:35 crc kubenswrapper[5120]: I0316 16:20:35.907018 5120 generic.go:358] "Generic (PLEG): container finished" podID="e0d63296-b495-418b-937b-3de15045b5c2" containerID="1ddcfd5d034aa6deaf40884273678979b2fe808078bc9c218243bb3aac2ec261" exitCode=0 Mar 16 16:20:35 crc kubenswrapper[5120]: I0316 16:20:35.907151 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-sr2cl" event={"ID":"e0d63296-b495-418b-937b-3de15045b5c2","Type":"ContainerDied","Data":"1ddcfd5d034aa6deaf40884273678979b2fe808078bc9c218243bb3aac2ec261"} Mar 16 16:20:35 crc kubenswrapper[5120]: I0316 16:20:35.909610 5120 generic.go:358] "Generic (PLEG): container finished" podID="c2cd901d-2bb0-43a4-affa-534bbbf63f11" containerID="73a77c25908f3c5b0c6feb0c617fcb3f143e685cb50cb5854d59879998d1894d" exitCode=0 Mar 16 16:20:35 crc kubenswrapper[5120]: I0316 16:20:35.909659 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-qkk4c" event={"ID":"c2cd901d-2bb0-43a4-affa-534bbbf63f11","Type":"ContainerDied","Data":"73a77c25908f3c5b0c6feb0c617fcb3f143e685cb50cb5854d59879998d1894d"} Mar 16 16:20:35 crc kubenswrapper[5120]: I0316 16:20:35.909719 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-qkk4c" event={"ID":"c2cd901d-2bb0-43a4-affa-534bbbf63f11","Type":"ContainerStarted","Data":"000b0c0e8cc587661628ba6ec025cf8e58af5868e1178706ab3febee37bb9d8a"} Mar 16 16:20:37 crc kubenswrapper[5120]: I0316 16:20:37.509768 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-sr2cl" Mar 16 16:20:37 crc kubenswrapper[5120]: I0316 16:20:37.517360 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-qkk4c" Mar 16 16:20:37 crc kubenswrapper[5120]: I0316 16:20:37.635034 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/e0d63296-b495-418b-937b-3de15045b5c2-dispersionconf\") pod \"e0d63296-b495-418b-937b-3de15045b5c2\" (UID: \"e0d63296-b495-418b-937b-3de15045b5c2\") " Mar 16 16:20:37 crc kubenswrapper[5120]: I0316 16:20:37.635104 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/e0d63296-b495-418b-937b-3de15045b5c2-swiftconf\") pod \"e0d63296-b495-418b-937b-3de15045b5c2\" (UID: \"e0d63296-b495-418b-937b-3de15045b5c2\") " Mar 16 16:20:37 crc kubenswrapper[5120]: I0316 16:20:37.635157 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jsk2l\" (UniqueName: \"kubernetes.io/projected/e0d63296-b495-418b-937b-3de15045b5c2-kube-api-access-jsk2l\") pod \"e0d63296-b495-418b-937b-3de15045b5c2\" (UID: \"e0d63296-b495-418b-937b-3de15045b5c2\") " Mar 16 16:20:37 crc kubenswrapper[5120]: I0316 16:20:37.635175 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/e0d63296-b495-418b-937b-3de15045b5c2-scripts\") pod \"e0d63296-b495-418b-937b-3de15045b5c2\" (UID: \"e0d63296-b495-418b-937b-3de15045b5c2\") " Mar 16 16:20:37 crc kubenswrapper[5120]: I0316 16:20:37.635228 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c2cd901d-2bb0-43a4-affa-534bbbf63f11-operator-scripts\") pod \"c2cd901d-2bb0-43a4-affa-534bbbf63f11\" (UID: \"c2cd901d-2bb0-43a4-affa-534bbbf63f11\") " Mar 16 16:20:37 crc kubenswrapper[5120]: I0316 16:20:37.635310 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/e0d63296-b495-418b-937b-3de15045b5c2-etc-swift\") pod \"e0d63296-b495-418b-937b-3de15045b5c2\" (UID: \"e0d63296-b495-418b-937b-3de15045b5c2\") " Mar 16 16:20:37 crc kubenswrapper[5120]: I0316 16:20:37.635368 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qcqn6\" (UniqueName: \"kubernetes.io/projected/c2cd901d-2bb0-43a4-affa-534bbbf63f11-kube-api-access-qcqn6\") pod \"c2cd901d-2bb0-43a4-affa-534bbbf63f11\" (UID: \"c2cd901d-2bb0-43a4-affa-534bbbf63f11\") " Mar 16 16:20:37 crc kubenswrapper[5120]: I0316 16:20:37.635401 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/e0d63296-b495-418b-937b-3de15045b5c2-ring-data-devices\") pod \"e0d63296-b495-418b-937b-3de15045b5c2\" (UID: \"e0d63296-b495-418b-937b-3de15045b5c2\") " Mar 16 16:20:37 crc kubenswrapper[5120]: I0316 16:20:37.635471 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e0d63296-b495-418b-937b-3de15045b5c2-combined-ca-bundle\") pod \"e0d63296-b495-418b-937b-3de15045b5c2\" (UID: \"e0d63296-b495-418b-937b-3de15045b5c2\") " Mar 16 16:20:37 crc kubenswrapper[5120]: I0316 16:20:37.636935 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c2cd901d-2bb0-43a4-affa-534bbbf63f11-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "c2cd901d-2bb0-43a4-affa-534bbbf63f11" (UID: "c2cd901d-2bb0-43a4-affa-534bbbf63f11"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:20:37 crc kubenswrapper[5120]: I0316 16:20:37.637069 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0d63296-b495-418b-937b-3de15045b5c2-ring-data-devices" (OuterVolumeSpecName: "ring-data-devices") pod "e0d63296-b495-418b-937b-3de15045b5c2" (UID: "e0d63296-b495-418b-937b-3de15045b5c2"). InnerVolumeSpecName "ring-data-devices". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:20:37 crc kubenswrapper[5120]: I0316 16:20:37.637737 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0d63296-b495-418b-937b-3de15045b5c2-etc-swift" (OuterVolumeSpecName: "etc-swift") pod "e0d63296-b495-418b-937b-3de15045b5c2" (UID: "e0d63296-b495-418b-937b-3de15045b5c2"). InnerVolumeSpecName "etc-swift". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:20:37 crc kubenswrapper[5120]: I0316 16:20:37.641531 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2cd901d-2bb0-43a4-affa-534bbbf63f11-kube-api-access-qcqn6" (OuterVolumeSpecName: "kube-api-access-qcqn6") pod "c2cd901d-2bb0-43a4-affa-534bbbf63f11" (UID: "c2cd901d-2bb0-43a4-affa-534bbbf63f11"). InnerVolumeSpecName "kube-api-access-qcqn6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:20:37 crc kubenswrapper[5120]: I0316 16:20:37.644920 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0d63296-b495-418b-937b-3de15045b5c2-kube-api-access-jsk2l" (OuterVolumeSpecName: "kube-api-access-jsk2l") pod "e0d63296-b495-418b-937b-3de15045b5c2" (UID: "e0d63296-b495-418b-937b-3de15045b5c2"). InnerVolumeSpecName "kube-api-access-jsk2l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:20:37 crc kubenswrapper[5120]: I0316 16:20:37.645804 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0d63296-b495-418b-937b-3de15045b5c2-dispersionconf" (OuterVolumeSpecName: "dispersionconf") pod "e0d63296-b495-418b-937b-3de15045b5c2" (UID: "e0d63296-b495-418b-937b-3de15045b5c2"). InnerVolumeSpecName "dispersionconf". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:20:37 crc kubenswrapper[5120]: I0316 16:20:37.656314 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0d63296-b495-418b-937b-3de15045b5c2-scripts" (OuterVolumeSpecName: "scripts") pod "e0d63296-b495-418b-937b-3de15045b5c2" (UID: "e0d63296-b495-418b-937b-3de15045b5c2"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:20:37 crc kubenswrapper[5120]: I0316 16:20:37.662712 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0d63296-b495-418b-937b-3de15045b5c2-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e0d63296-b495-418b-937b-3de15045b5c2" (UID: "e0d63296-b495-418b-937b-3de15045b5c2"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:20:37 crc kubenswrapper[5120]: I0316 16:20:37.663325 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0d63296-b495-418b-937b-3de15045b5c2-swiftconf" (OuterVolumeSpecName: "swiftconf") pod "e0d63296-b495-418b-937b-3de15045b5c2" (UID: "e0d63296-b495-418b-937b-3de15045b5c2"). InnerVolumeSpecName "swiftconf". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:20:37 crc kubenswrapper[5120]: I0316 16:20:37.663555 5120 scope.go:117] "RemoveContainer" containerID="f40e444f89abd558ac90555bfd58e04a1c4379a653ba8035c228d2b7a5443eb5" Mar 16 16:20:37 crc kubenswrapper[5120]: E0316 16:20:37.663991 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:20:37 crc kubenswrapper[5120]: I0316 16:20:37.738147 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c2cd901d-2bb0-43a4-affa-534bbbf63f11-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:20:37 crc kubenswrapper[5120]: I0316 16:20:37.738188 5120 reconciler_common.go:299] "Volume detached for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/e0d63296-b495-418b-937b-3de15045b5c2-etc-swift\") on node \"crc\" DevicePath \"\"" Mar 16 16:20:37 crc kubenswrapper[5120]: I0316 16:20:37.738200 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qcqn6\" (UniqueName: \"kubernetes.io/projected/c2cd901d-2bb0-43a4-affa-534bbbf63f11-kube-api-access-qcqn6\") on node \"crc\" DevicePath \"\"" Mar 16 16:20:37 crc kubenswrapper[5120]: I0316 16:20:37.738214 5120 reconciler_common.go:299] "Volume detached for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/e0d63296-b495-418b-937b-3de15045b5c2-ring-data-devices\") on node \"crc\" DevicePath \"\"" Mar 16 16:20:37 crc kubenswrapper[5120]: I0316 16:20:37.738226 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e0d63296-b495-418b-937b-3de15045b5c2-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:20:37 crc kubenswrapper[5120]: I0316 16:20:37.738238 5120 reconciler_common.go:299] "Volume detached for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/e0d63296-b495-418b-937b-3de15045b5c2-dispersionconf\") on node \"crc\" DevicePath \"\"" Mar 16 16:20:37 crc kubenswrapper[5120]: I0316 16:20:37.738247 5120 reconciler_common.go:299] "Volume detached for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/e0d63296-b495-418b-937b-3de15045b5c2-swiftconf\") on node \"crc\" DevicePath \"\"" Mar 16 16:20:37 crc kubenswrapper[5120]: I0316 16:20:37.738257 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jsk2l\" (UniqueName: \"kubernetes.io/projected/e0d63296-b495-418b-937b-3de15045b5c2-kube-api-access-jsk2l\") on node \"crc\" DevicePath \"\"" Mar 16 16:20:37 crc kubenswrapper[5120]: I0316 16:20:37.738265 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/e0d63296-b495-418b-937b-3de15045b5c2-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:20:37 crc kubenswrapper[5120]: I0316 16:20:37.949939 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/prometheus-metric-storage-0" event={"ID":"e007aee0-65df-4ec7-bd52-23bf7f4b704f","Type":"ContainerStarted","Data":"bb501404b43a3ab4a852f60b9f15711dbdc9534e7927d346e281dc835402bbe7"} Mar 16 16:20:37 crc kubenswrapper[5120]: I0316 16:20:37.956366 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-sr2cl" event={"ID":"e0d63296-b495-418b-937b-3de15045b5c2","Type":"ContainerDied","Data":"e085863b817449eb1335981c865bb6ee996cd39d9f13683a3f494299691020bd"} Mar 16 16:20:37 crc kubenswrapper[5120]: I0316 16:20:37.956431 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e085863b817449eb1335981c865bb6ee996cd39d9f13683a3f494299691020bd" Mar 16 16:20:37 crc kubenswrapper[5120]: I0316 16:20:37.956536 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-sr2cl" Mar 16 16:20:37 crc kubenswrapper[5120]: I0316 16:20:37.959297 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-qkk4c" event={"ID":"c2cd901d-2bb0-43a4-affa-534bbbf63f11","Type":"ContainerDied","Data":"000b0c0e8cc587661628ba6ec025cf8e58af5868e1178706ab3febee37bb9d8a"} Mar 16 16:20:37 crc kubenswrapper[5120]: I0316 16:20:37.959348 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="000b0c0e8cc587661628ba6ec025cf8e58af5868e1178706ab3febee37bb9d8a" Mar 16 16:20:37 crc kubenswrapper[5120]: I0316 16:20:37.959441 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-qkk4c" Mar 16 16:20:38 crc kubenswrapper[5120]: I0316 16:20:38.853115 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-db-sync-dpqrl"] Mar 16 16:20:38 crc kubenswrapper[5120]: I0316 16:20:38.854464 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e9c9fdb-20c1-4c7b-b5d1-91088ed981a5" containerName="mariadb-account-create-update" Mar 16 16:20:38 crc kubenswrapper[5120]: I0316 16:20:38.854481 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e9c9fdb-20c1-4c7b-b5d1-91088ed981a5" containerName="mariadb-account-create-update" Mar 16 16:20:38 crc kubenswrapper[5120]: I0316 16:20:38.854501 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0d63296-b495-418b-937b-3de15045b5c2" containerName="swift-ring-rebalance" Mar 16 16:20:38 crc kubenswrapper[5120]: I0316 16:20:38.854509 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0d63296-b495-418b-937b-3de15045b5c2" containerName="swift-ring-rebalance" Mar 16 16:20:38 crc kubenswrapper[5120]: I0316 16:20:38.854527 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f157f8fd-51e4-4948-9a15-8c5da242ae97" containerName="mariadb-database-create" Mar 16 16:20:38 crc kubenswrapper[5120]: I0316 16:20:38.854534 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f157f8fd-51e4-4948-9a15-8c5da242ae97" containerName="mariadb-database-create" Mar 16 16:20:38 crc kubenswrapper[5120]: I0316 16:20:38.854550 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2cd901d-2bb0-43a4-affa-534bbbf63f11" containerName="mariadb-account-create-update" Mar 16 16:20:38 crc kubenswrapper[5120]: I0316 16:20:38.854558 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2cd901d-2bb0-43a4-affa-534bbbf63f11" containerName="mariadb-account-create-update" Mar 16 16:20:38 crc kubenswrapper[5120]: I0316 16:20:38.855410 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f157f8fd-51e4-4948-9a15-8c5da242ae97" containerName="mariadb-database-create" Mar 16 16:20:38 crc kubenswrapper[5120]: I0316 16:20:38.855443 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e0d63296-b495-418b-937b-3de15045b5c2" containerName="swift-ring-rebalance" Mar 16 16:20:38 crc kubenswrapper[5120]: I0316 16:20:38.855459 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1e9c9fdb-20c1-4c7b-b5d1-91088ed981a5" containerName="mariadb-account-create-update" Mar 16 16:20:38 crc kubenswrapper[5120]: I0316 16:20:38.855471 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c2cd901d-2bb0-43a4-affa-534bbbf63f11" containerName="mariadb-account-create-update" Mar 16 16:20:38 crc kubenswrapper[5120]: I0316 16:20:38.936749 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-dpqrl"] Mar 16 16:20:38 crc kubenswrapper[5120]: I0316 16:20:38.936908 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-dpqrl" Mar 16 16:20:38 crc kubenswrapper[5120]: I0316 16:20:38.939317 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-config-data\"" Mar 16 16:20:38 crc kubenswrapper[5120]: I0316 16:20:38.939500 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-glance-dockercfg-46sjz\"" Mar 16 16:20:39 crc kubenswrapper[5120]: I0316 16:20:39.066608 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/930884a5-5cda-4141-8d98-deee3cd13dc3-config-data\") pod \"glance-db-sync-dpqrl\" (UID: \"930884a5-5cda-4141-8d98-deee3cd13dc3\") " pod="openstack-kuttl-tests/glance-db-sync-dpqrl" Mar 16 16:20:39 crc kubenswrapper[5120]: I0316 16:20:39.066900 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6p7b9\" (UniqueName: \"kubernetes.io/projected/930884a5-5cda-4141-8d98-deee3cd13dc3-kube-api-access-6p7b9\") pod \"glance-db-sync-dpqrl\" (UID: \"930884a5-5cda-4141-8d98-deee3cd13dc3\") " pod="openstack-kuttl-tests/glance-db-sync-dpqrl" Mar 16 16:20:39 crc kubenswrapper[5120]: I0316 16:20:39.067061 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/930884a5-5cda-4141-8d98-deee3cd13dc3-combined-ca-bundle\") pod \"glance-db-sync-dpqrl\" (UID: \"930884a5-5cda-4141-8d98-deee3cd13dc3\") " pod="openstack-kuttl-tests/glance-db-sync-dpqrl" Mar 16 16:20:39 crc kubenswrapper[5120]: I0316 16:20:39.068997 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/930884a5-5cda-4141-8d98-deee3cd13dc3-db-sync-config-data\") pod \"glance-db-sync-dpqrl\" (UID: \"930884a5-5cda-4141-8d98-deee3cd13dc3\") " pod="openstack-kuttl-tests/glance-db-sync-dpqrl" Mar 16 16:20:39 crc kubenswrapper[5120]: I0316 16:20:39.170143 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6p7b9\" (UniqueName: \"kubernetes.io/projected/930884a5-5cda-4141-8d98-deee3cd13dc3-kube-api-access-6p7b9\") pod \"glance-db-sync-dpqrl\" (UID: \"930884a5-5cda-4141-8d98-deee3cd13dc3\") " pod="openstack-kuttl-tests/glance-db-sync-dpqrl" Mar 16 16:20:39 crc kubenswrapper[5120]: I0316 16:20:39.170627 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/930884a5-5cda-4141-8d98-deee3cd13dc3-combined-ca-bundle\") pod \"glance-db-sync-dpqrl\" (UID: \"930884a5-5cda-4141-8d98-deee3cd13dc3\") " pod="openstack-kuttl-tests/glance-db-sync-dpqrl" Mar 16 16:20:39 crc kubenswrapper[5120]: I0316 16:20:39.170922 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/930884a5-5cda-4141-8d98-deee3cd13dc3-db-sync-config-data\") pod \"glance-db-sync-dpqrl\" (UID: \"930884a5-5cda-4141-8d98-deee3cd13dc3\") " pod="openstack-kuttl-tests/glance-db-sync-dpqrl" Mar 16 16:20:39 crc kubenswrapper[5120]: I0316 16:20:39.171073 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/930884a5-5cda-4141-8d98-deee3cd13dc3-config-data\") pod \"glance-db-sync-dpqrl\" (UID: \"930884a5-5cda-4141-8d98-deee3cd13dc3\") " pod="openstack-kuttl-tests/glance-db-sync-dpqrl" Mar 16 16:20:39 crc kubenswrapper[5120]: I0316 16:20:39.178792 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/930884a5-5cda-4141-8d98-deee3cd13dc3-config-data\") pod \"glance-db-sync-dpqrl\" (UID: \"930884a5-5cda-4141-8d98-deee3cd13dc3\") " pod="openstack-kuttl-tests/glance-db-sync-dpqrl" Mar 16 16:20:39 crc kubenswrapper[5120]: I0316 16:20:39.180641 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/930884a5-5cda-4141-8d98-deee3cd13dc3-db-sync-config-data\") pod \"glance-db-sync-dpqrl\" (UID: \"930884a5-5cda-4141-8d98-deee3cd13dc3\") " pod="openstack-kuttl-tests/glance-db-sync-dpqrl" Mar 16 16:20:39 crc kubenswrapper[5120]: I0316 16:20:39.186000 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/930884a5-5cda-4141-8d98-deee3cd13dc3-combined-ca-bundle\") pod \"glance-db-sync-dpqrl\" (UID: \"930884a5-5cda-4141-8d98-deee3cd13dc3\") " pod="openstack-kuttl-tests/glance-db-sync-dpqrl" Mar 16 16:20:39 crc kubenswrapper[5120]: I0316 16:20:39.192147 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6p7b9\" (UniqueName: \"kubernetes.io/projected/930884a5-5cda-4141-8d98-deee3cd13dc3-kube-api-access-6p7b9\") pod \"glance-db-sync-dpqrl\" (UID: \"930884a5-5cda-4141-8d98-deee3cd13dc3\") " pod="openstack-kuttl-tests/glance-db-sync-dpqrl" Mar 16 16:20:39 crc kubenswrapper[5120]: I0316 16:20:39.259877 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-dpqrl" Mar 16 16:20:39 crc kubenswrapper[5120]: I0316 16:20:39.944994 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-dpqrl"] Mar 16 16:20:39 crc kubenswrapper[5120]: I0316 16:20:39.980177 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-dpqrl" event={"ID":"930884a5-5cda-4141-8d98-deee3cd13dc3","Type":"ContainerStarted","Data":"0a9dd54a04feba152548b1de934b359f95275b1cc74c41289805947aa850eab4"} Mar 16 16:20:41 crc kubenswrapper[5120]: I0316 16:20:41.004576 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-dpqrl" event={"ID":"930884a5-5cda-4141-8d98-deee3cd13dc3","Type":"ContainerStarted","Data":"feb3be09389db6bd790a30edc6a7f93fb5b8ca057afada47deb12fbf7a3eb22e"} Mar 16 16:20:41 crc kubenswrapper[5120]: I0316 16:20:41.027959 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-db-sync-dpqrl" podStartSLOduration=3.02793245 podStartE2EDuration="3.02793245s" podCreationTimestamp="2026-03-16 16:20:38 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:20:41.024898579 +0000 UTC m=+2943.178830266" watchObservedRunningTime="2026-03-16 16:20:41.02793245 +0000 UTC m=+2943.181864147" Mar 16 16:20:43 crc kubenswrapper[5120]: I0316 16:20:43.040615 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/prometheus-metric-storage-0" event={"ID":"e007aee0-65df-4ec7-bd52-23bf7f4b704f","Type":"ContainerStarted","Data":"48ee6e5f7295fa0717a2cc5a6f976acf1f88ff011920a621a42120de366b1dbc"} Mar 16 16:20:43 crc kubenswrapper[5120]: I0316 16:20:43.177276 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/7f5bff08-fc88-42fc-ab9b-6d8db171ee6a-etc-swift\") pod \"swift-storage-0\" (UID: \"7f5bff08-fc88-42fc-ab9b-6d8db171ee6a\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:20:43 crc kubenswrapper[5120]: I0316 16:20:43.187186 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/7f5bff08-fc88-42fc-ab9b-6d8db171ee6a-etc-swift\") pod \"swift-storage-0\" (UID: \"7f5bff08-fc88-42fc-ab9b-6d8db171ee6a\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:20:43 crc kubenswrapper[5120]: I0316 16:20:43.208896 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:20:43 crc kubenswrapper[5120]: I0316 16:20:43.732519 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/prometheus-metric-storage-0" podStartSLOduration=3.539137912 podStartE2EDuration="29.7324993s" podCreationTimestamp="2026-03-16 16:20:14 +0000 UTC" firstStartedPulling="2026-03-16 16:20:16.169623921 +0000 UTC m=+2918.323555588" lastFinishedPulling="2026-03-16 16:20:42.362985329 +0000 UTC m=+2944.516916976" observedRunningTime="2026-03-16 16:20:43.079969057 +0000 UTC m=+2945.233900764" watchObservedRunningTime="2026-03-16 16:20:43.7324993 +0000 UTC m=+2945.886430967" Mar 16 16:20:43 crc kubenswrapper[5120]: I0316 16:20:43.741909 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 16:20:43 crc kubenswrapper[5120]: W0316 16:20:43.779790 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7f5bff08_fc88_42fc_ab9b_6d8db171ee6a.slice/crio-a90fd4eb6c42dcd7ec0fdb5e47bf16b9f832482d628f1c82240c796bc1350c00 WatchSource:0}: Error finding container a90fd4eb6c42dcd7ec0fdb5e47bf16b9f832482d628f1c82240c796bc1350c00: Status 404 returned error can't find the container with id a90fd4eb6c42dcd7ec0fdb5e47bf16b9f832482d628f1c82240c796bc1350c00 Mar 16 16:20:44 crc kubenswrapper[5120]: I0316 16:20:44.052350 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7f5bff08-fc88-42fc-ab9b-6d8db171ee6a","Type":"ContainerStarted","Data":"293e4eeed9c463f36b54974ddbda55237ad67246ce53a79f496892505134a481"} Mar 16 16:20:44 crc kubenswrapper[5120]: I0316 16:20:44.052393 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7f5bff08-fc88-42fc-ab9b-6d8db171ee6a","Type":"ContainerStarted","Data":"a90fd4eb6c42dcd7ec0fdb5e47bf16b9f832482d628f1c82240c796bc1350c00"} Mar 16 16:20:44 crc kubenswrapper[5120]: I0316 16:20:44.054998 5120 generic.go:358] "Generic (PLEG): container finished" podID="dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93" containerID="6a2fb343ca510feb5a32f2ce7721ac643d1503dbfd5a0b3e76d3ce922f56d65e" exitCode=0 Mar 16 16:20:44 crc kubenswrapper[5120]: I0316 16:20:44.055067 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93","Type":"ContainerDied","Data":"6a2fb343ca510feb5a32f2ce7721ac643d1503dbfd5a0b3e76d3ce922f56d65e"} Mar 16 16:20:45 crc kubenswrapper[5120]: I0316 16:20:45.068822 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7f5bff08-fc88-42fc-ab9b-6d8db171ee6a","Type":"ContainerStarted","Data":"02a2ffa3d3a2d7c1552f7589bbf4799a5575b36a6ab8851cfeface45442ecf4c"} Mar 16 16:20:45 crc kubenswrapper[5120]: I0316 16:20:45.069662 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7f5bff08-fc88-42fc-ab9b-6d8db171ee6a","Type":"ContainerStarted","Data":"2add8d73118c8e33eeb2d9664e5dfd77ce96c461c1767cd0fd0328b33f5c36fb"} Mar 16 16:20:45 crc kubenswrapper[5120]: I0316 16:20:45.069676 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7f5bff08-fc88-42fc-ab9b-6d8db171ee6a","Type":"ContainerStarted","Data":"999c0ea5f7b0027f0c11788a39e8314b09f917d6f6c4ab035c13db24d7b71c5f"} Mar 16 16:20:45 crc kubenswrapper[5120]: I0316 16:20:45.069692 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7f5bff08-fc88-42fc-ab9b-6d8db171ee6a","Type":"ContainerStarted","Data":"f92f67038f74d06e99a30d2effb51dbd1ebba2432520a2fba300840396f0f972"} Mar 16 16:20:45 crc kubenswrapper[5120]: I0316 16:20:45.074187 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93","Type":"ContainerStarted","Data":"b8e19f90a888ff13c234758eff3ff394d92c8e571dbc711727543bdb57e3ecc7"} Mar 16 16:20:45 crc kubenswrapper[5120]: I0316 16:20:45.074418 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:20:45 crc kubenswrapper[5120]: I0316 16:20:45.136182 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/rabbitmq-server-0" podStartSLOduration=44.136141873 podStartE2EDuration="44.136141873s" podCreationTimestamp="2026-03-16 16:20:01 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:20:45.099333479 +0000 UTC m=+2947.253265156" watchObservedRunningTime="2026-03-16 16:20:45.136141873 +0000 UTC m=+2947.290073530" Mar 16 16:20:45 crc kubenswrapper[5120]: I0316 16:20:45.694688 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/prometheus-metric-storage-0" Mar 16 16:20:45 crc kubenswrapper[5120]: I0316 16:20:45.695131 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/prometheus-metric-storage-0" Mar 16 16:20:45 crc kubenswrapper[5120]: I0316 16:20:45.703363 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/prometheus-metric-storage-0" Mar 16 16:20:46 crc kubenswrapper[5120]: I0316 16:20:46.089588 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7f5bff08-fc88-42fc-ab9b-6d8db171ee6a","Type":"ContainerStarted","Data":"4399abb79b72fcaae5898a8f46943a6ab6f42d0bb8e6d9531ec308f970c87f67"} Mar 16 16:20:46 crc kubenswrapper[5120]: I0316 16:20:46.090064 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7f5bff08-fc88-42fc-ab9b-6d8db171ee6a","Type":"ContainerStarted","Data":"914a1accee31ec9d58f31d18ce16ebc71b52c798b7569e8ba2718c12eb0b6727"} Mar 16 16:20:46 crc kubenswrapper[5120]: I0316 16:20:46.090076 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7f5bff08-fc88-42fc-ab9b-6d8db171ee6a","Type":"ContainerStarted","Data":"00a717d1a33a62975a302ddd0726c4e1b1c0c5fd8cc1fc610e198519673ec7b5"} Mar 16 16:20:46 crc kubenswrapper[5120]: I0316 16:20:46.090086 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7f5bff08-fc88-42fc-ab9b-6d8db171ee6a","Type":"ContainerStarted","Data":"338c2b64732eb5311f04bd9a566b4c3c11a3210d4d3421b6e4a7d84edcd4d18f"} Mar 16 16:20:46 crc kubenswrapper[5120]: I0316 16:20:46.090096 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7f5bff08-fc88-42fc-ab9b-6d8db171ee6a","Type":"ContainerStarted","Data":"da0cebe0fefea2659ee1956f1a037ab95538f3b38f4c90c9544da64c8f4c5a1c"} Mar 16 16:20:46 crc kubenswrapper[5120]: I0316 16:20:46.093520 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/prometheus-metric-storage-0" Mar 16 16:20:47 crc kubenswrapper[5120]: I0316 16:20:47.105216 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7f5bff08-fc88-42fc-ab9b-6d8db171ee6a","Type":"ContainerStarted","Data":"88d0838f0e55c2ee07fde8bbf71e8df1ae6de7871d90a1d121e8c8c31cc0d30c"} Mar 16 16:20:47 crc kubenswrapper[5120]: I0316 16:20:47.105499 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7f5bff08-fc88-42fc-ab9b-6d8db171ee6a","Type":"ContainerStarted","Data":"6c3e70ac2fbe4fa7acb01497861b03a7149c1e383ad9c493b5591ae3ea540c5c"} Mar 16 16:20:47 crc kubenswrapper[5120]: I0316 16:20:47.105512 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7f5bff08-fc88-42fc-ab9b-6d8db171ee6a","Type":"ContainerStarted","Data":"6696b7f7b697efa4feabf0a01622540fdb189bc4a1df6611b1c30c76619d0945"} Mar 16 16:20:47 crc kubenswrapper[5120]: I0316 16:20:47.105521 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7f5bff08-fc88-42fc-ab9b-6d8db171ee6a","Type":"ContainerStarted","Data":"43e5191629bf082b0e01836ca76be96391e20c5de3b139199777067a04192339"} Mar 16 16:20:47 crc kubenswrapper[5120]: I0316 16:20:47.105532 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7f5bff08-fc88-42fc-ab9b-6d8db171ee6a","Type":"ContainerStarted","Data":"2c2449075b7cb36e869c5f5b1d0cbbf73a489350dbfc1054e715c259e79792ad"} Mar 16 16:20:47 crc kubenswrapper[5120]: I0316 16:20:47.107852 5120 generic.go:358] "Generic (PLEG): container finished" podID="930884a5-5cda-4141-8d98-deee3cd13dc3" containerID="feb3be09389db6bd790a30edc6a7f93fb5b8ca057afada47deb12fbf7a3eb22e" exitCode=0 Mar 16 16:20:47 crc kubenswrapper[5120]: I0316 16:20:47.107944 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-dpqrl" event={"ID":"930884a5-5cda-4141-8d98-deee3cd13dc3","Type":"ContainerDied","Data":"feb3be09389db6bd790a30edc6a7f93fb5b8ca057afada47deb12fbf7a3eb22e"} Mar 16 16:20:47 crc kubenswrapper[5120]: I0316 16:20:47.164065 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/swift-storage-0" podStartSLOduration=21.164046394 podStartE2EDuration="21.164046394s" podCreationTimestamp="2026-03-16 16:20:26 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:20:47.157735145 +0000 UTC m=+2949.311666832" watchObservedRunningTime="2026-03-16 16:20:47.164046394 +0000 UTC m=+2949.317978051" Mar 16 16:20:47 crc kubenswrapper[5120]: I0316 16:20:47.320923 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-6c9947cfc-tjlwq"] Mar 16 16:20:47 crc kubenswrapper[5120]: I0316 16:20:47.326416 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6c9947cfc-tjlwq" Mar 16 16:20:47 crc kubenswrapper[5120]: I0316 16:20:47.328534 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"dns-swift-storage-0\"" Mar 16 16:20:47 crc kubenswrapper[5120]: I0316 16:20:47.332140 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-6c9947cfc-tjlwq"] Mar 16 16:20:47 crc kubenswrapper[5120]: I0316 16:20:47.370972 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1195ba16-9c86-4aeb-b62f-a93570eb8b02-config\") pod \"dnsmasq-dnsmasq-6c9947cfc-tjlwq\" (UID: \"1195ba16-9c86-4aeb-b62f-a93570eb8b02\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6c9947cfc-tjlwq" Mar 16 16:20:47 crc kubenswrapper[5120]: I0316 16:20:47.371023 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/1195ba16-9c86-4aeb-b62f-a93570eb8b02-dns-swift-storage-0\") pod \"dnsmasq-dnsmasq-6c9947cfc-tjlwq\" (UID: \"1195ba16-9c86-4aeb-b62f-a93570eb8b02\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6c9947cfc-tjlwq" Mar 16 16:20:47 crc kubenswrapper[5120]: I0316 16:20:47.371122 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxkw6\" (UniqueName: \"kubernetes.io/projected/1195ba16-9c86-4aeb-b62f-a93570eb8b02-kube-api-access-kxkw6\") pod \"dnsmasq-dnsmasq-6c9947cfc-tjlwq\" (UID: \"1195ba16-9c86-4aeb-b62f-a93570eb8b02\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6c9947cfc-tjlwq" Mar 16 16:20:47 crc kubenswrapper[5120]: I0316 16:20:47.371217 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/1195ba16-9c86-4aeb-b62f-a93570eb8b02-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-6c9947cfc-tjlwq\" (UID: \"1195ba16-9c86-4aeb-b62f-a93570eb8b02\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6c9947cfc-tjlwq" Mar 16 16:20:47 crc kubenswrapper[5120]: I0316 16:20:47.472262 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/1195ba16-9c86-4aeb-b62f-a93570eb8b02-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-6c9947cfc-tjlwq\" (UID: \"1195ba16-9c86-4aeb-b62f-a93570eb8b02\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6c9947cfc-tjlwq" Mar 16 16:20:47 crc kubenswrapper[5120]: I0316 16:20:47.472363 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1195ba16-9c86-4aeb-b62f-a93570eb8b02-config\") pod \"dnsmasq-dnsmasq-6c9947cfc-tjlwq\" (UID: \"1195ba16-9c86-4aeb-b62f-a93570eb8b02\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6c9947cfc-tjlwq" Mar 16 16:20:47 crc kubenswrapper[5120]: I0316 16:20:47.472397 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/1195ba16-9c86-4aeb-b62f-a93570eb8b02-dns-swift-storage-0\") pod \"dnsmasq-dnsmasq-6c9947cfc-tjlwq\" (UID: \"1195ba16-9c86-4aeb-b62f-a93570eb8b02\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6c9947cfc-tjlwq" Mar 16 16:20:47 crc kubenswrapper[5120]: I0316 16:20:47.472487 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kxkw6\" (UniqueName: \"kubernetes.io/projected/1195ba16-9c86-4aeb-b62f-a93570eb8b02-kube-api-access-kxkw6\") pod \"dnsmasq-dnsmasq-6c9947cfc-tjlwq\" (UID: \"1195ba16-9c86-4aeb-b62f-a93570eb8b02\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6c9947cfc-tjlwq" Mar 16 16:20:47 crc kubenswrapper[5120]: I0316 16:20:47.473640 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/1195ba16-9c86-4aeb-b62f-a93570eb8b02-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-6c9947cfc-tjlwq\" (UID: \"1195ba16-9c86-4aeb-b62f-a93570eb8b02\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6c9947cfc-tjlwq" Mar 16 16:20:47 crc kubenswrapper[5120]: I0316 16:20:47.474249 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1195ba16-9c86-4aeb-b62f-a93570eb8b02-config\") pod \"dnsmasq-dnsmasq-6c9947cfc-tjlwq\" (UID: \"1195ba16-9c86-4aeb-b62f-a93570eb8b02\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6c9947cfc-tjlwq" Mar 16 16:20:47 crc kubenswrapper[5120]: I0316 16:20:47.474856 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/1195ba16-9c86-4aeb-b62f-a93570eb8b02-dns-swift-storage-0\") pod \"dnsmasq-dnsmasq-6c9947cfc-tjlwq\" (UID: \"1195ba16-9c86-4aeb-b62f-a93570eb8b02\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6c9947cfc-tjlwq" Mar 16 16:20:47 crc kubenswrapper[5120]: I0316 16:20:47.489932 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxkw6\" (UniqueName: \"kubernetes.io/projected/1195ba16-9c86-4aeb-b62f-a93570eb8b02-kube-api-access-kxkw6\") pod \"dnsmasq-dnsmasq-6c9947cfc-tjlwq\" (UID: \"1195ba16-9c86-4aeb-b62f-a93570eb8b02\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6c9947cfc-tjlwq" Mar 16 16:20:47 crc kubenswrapper[5120]: I0316 16:20:47.640445 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6c9947cfc-tjlwq" Mar 16 16:20:48 crc kubenswrapper[5120]: I0316 16:20:48.082422 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-6c9947cfc-tjlwq"] Mar 16 16:20:48 crc kubenswrapper[5120]: I0316 16:20:48.127656 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6c9947cfc-tjlwq" event={"ID":"1195ba16-9c86-4aeb-b62f-a93570eb8b02","Type":"ContainerStarted","Data":"d52e407e5ce6d18418b6c5e6c53b6dfc5c15b9fed0c932a46205d56c13d5eac2"} Mar 16 16:20:48 crc kubenswrapper[5120]: I0316 16:20:48.454635 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/prometheus-metric-storage-0"] Mar 16 16:20:48 crc kubenswrapper[5120]: I0316 16:20:48.455168 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/prometheus-metric-storage-0" podUID="e007aee0-65df-4ec7-bd52-23bf7f4b704f" containerName="prometheus" containerID="cri-o://f287e2a89b8a786d204d6870f4cd0a46a6ed86d615917bcfadfd137614b32e66" gracePeriod=600 Mar 16 16:20:48 crc kubenswrapper[5120]: I0316 16:20:48.455268 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/prometheus-metric-storage-0" podUID="e007aee0-65df-4ec7-bd52-23bf7f4b704f" containerName="thanos-sidecar" containerID="cri-o://48ee6e5f7295fa0717a2cc5a6f976acf1f88ff011920a621a42120de366b1dbc" gracePeriod=600 Mar 16 16:20:48 crc kubenswrapper[5120]: I0316 16:20:48.455257 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/prometheus-metric-storage-0" podUID="e007aee0-65df-4ec7-bd52-23bf7f4b704f" containerName="config-reloader" containerID="cri-o://bb501404b43a3ab4a852f60b9f15711dbdc9534e7927d346e281dc835402bbe7" gracePeriod=600 Mar 16 16:20:48 crc kubenswrapper[5120]: I0316 16:20:48.483240 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-dpqrl" Mar 16 16:20:48 crc kubenswrapper[5120]: I0316 16:20:48.591716 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6p7b9\" (UniqueName: \"kubernetes.io/projected/930884a5-5cda-4141-8d98-deee3cd13dc3-kube-api-access-6p7b9\") pod \"930884a5-5cda-4141-8d98-deee3cd13dc3\" (UID: \"930884a5-5cda-4141-8d98-deee3cd13dc3\") " Mar 16 16:20:48 crc kubenswrapper[5120]: I0316 16:20:48.592227 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/930884a5-5cda-4141-8d98-deee3cd13dc3-config-data\") pod \"930884a5-5cda-4141-8d98-deee3cd13dc3\" (UID: \"930884a5-5cda-4141-8d98-deee3cd13dc3\") " Mar 16 16:20:48 crc kubenswrapper[5120]: I0316 16:20:48.592356 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/930884a5-5cda-4141-8d98-deee3cd13dc3-db-sync-config-data\") pod \"930884a5-5cda-4141-8d98-deee3cd13dc3\" (UID: \"930884a5-5cda-4141-8d98-deee3cd13dc3\") " Mar 16 16:20:48 crc kubenswrapper[5120]: I0316 16:20:48.592479 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/930884a5-5cda-4141-8d98-deee3cd13dc3-combined-ca-bundle\") pod \"930884a5-5cda-4141-8d98-deee3cd13dc3\" (UID: \"930884a5-5cda-4141-8d98-deee3cd13dc3\") " Mar 16 16:20:48 crc kubenswrapper[5120]: I0316 16:20:48.597953 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/930884a5-5cda-4141-8d98-deee3cd13dc3-kube-api-access-6p7b9" (OuterVolumeSpecName: "kube-api-access-6p7b9") pod "930884a5-5cda-4141-8d98-deee3cd13dc3" (UID: "930884a5-5cda-4141-8d98-deee3cd13dc3"). InnerVolumeSpecName "kube-api-access-6p7b9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:20:48 crc kubenswrapper[5120]: I0316 16:20:48.598627 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/930884a5-5cda-4141-8d98-deee3cd13dc3-db-sync-config-data" (OuterVolumeSpecName: "db-sync-config-data") pod "930884a5-5cda-4141-8d98-deee3cd13dc3" (UID: "930884a5-5cda-4141-8d98-deee3cd13dc3"). InnerVolumeSpecName "db-sync-config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:20:48 crc kubenswrapper[5120]: I0316 16:20:48.631613 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/930884a5-5cda-4141-8d98-deee3cd13dc3-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "930884a5-5cda-4141-8d98-deee3cd13dc3" (UID: "930884a5-5cda-4141-8d98-deee3cd13dc3"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:20:48 crc kubenswrapper[5120]: I0316 16:20:48.633321 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/930884a5-5cda-4141-8d98-deee3cd13dc3-config-data" (OuterVolumeSpecName: "config-data") pod "930884a5-5cda-4141-8d98-deee3cd13dc3" (UID: "930884a5-5cda-4141-8d98-deee3cd13dc3"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:20:48 crc kubenswrapper[5120]: I0316 16:20:48.695928 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6p7b9\" (UniqueName: \"kubernetes.io/projected/930884a5-5cda-4141-8d98-deee3cd13dc3-kube-api-access-6p7b9\") on node \"crc\" DevicePath \"\"" Mar 16 16:20:48 crc kubenswrapper[5120]: I0316 16:20:48.695974 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/930884a5-5cda-4141-8d98-deee3cd13dc3-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:20:48 crc kubenswrapper[5120]: I0316 16:20:48.695995 5120 reconciler_common.go:299] "Volume detached for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/930884a5-5cda-4141-8d98-deee3cd13dc3-db-sync-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:20:48 crc kubenswrapper[5120]: I0316 16:20:48.696008 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/930884a5-5cda-4141-8d98-deee3cd13dc3-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:20:49 crc kubenswrapper[5120]: I0316 16:20:49.157529 5120 generic.go:358] "Generic (PLEG): container finished" podID="1195ba16-9c86-4aeb-b62f-a93570eb8b02" containerID="58894cc87b2d78e35392e8f10235f6f16cc3bc32f31c6e78ab6be9a3edc0cc33" exitCode=0 Mar 16 16:20:49 crc kubenswrapper[5120]: I0316 16:20:49.157661 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6c9947cfc-tjlwq" event={"ID":"1195ba16-9c86-4aeb-b62f-a93570eb8b02","Type":"ContainerDied","Data":"58894cc87b2d78e35392e8f10235f6f16cc3bc32f31c6e78ab6be9a3edc0cc33"} Mar 16 16:20:49 crc kubenswrapper[5120]: I0316 16:20:49.166071 5120 generic.go:358] "Generic (PLEG): container finished" podID="e007aee0-65df-4ec7-bd52-23bf7f4b704f" containerID="48ee6e5f7295fa0717a2cc5a6f976acf1f88ff011920a621a42120de366b1dbc" exitCode=0 Mar 16 16:20:49 crc kubenswrapper[5120]: I0316 16:20:49.166123 5120 generic.go:358] "Generic (PLEG): container finished" podID="e007aee0-65df-4ec7-bd52-23bf7f4b704f" containerID="bb501404b43a3ab4a852f60b9f15711dbdc9534e7927d346e281dc835402bbe7" exitCode=0 Mar 16 16:20:49 crc kubenswrapper[5120]: I0316 16:20:49.166138 5120 generic.go:358] "Generic (PLEG): container finished" podID="e007aee0-65df-4ec7-bd52-23bf7f4b704f" containerID="f287e2a89b8a786d204d6870f4cd0a46a6ed86d615917bcfadfd137614b32e66" exitCode=0 Mar 16 16:20:49 crc kubenswrapper[5120]: I0316 16:20:49.166441 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/prometheus-metric-storage-0" event={"ID":"e007aee0-65df-4ec7-bd52-23bf7f4b704f","Type":"ContainerDied","Data":"48ee6e5f7295fa0717a2cc5a6f976acf1f88ff011920a621a42120de366b1dbc"} Mar 16 16:20:49 crc kubenswrapper[5120]: I0316 16:20:49.166482 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/prometheus-metric-storage-0" event={"ID":"e007aee0-65df-4ec7-bd52-23bf7f4b704f","Type":"ContainerDied","Data":"bb501404b43a3ab4a852f60b9f15711dbdc9534e7927d346e281dc835402bbe7"} Mar 16 16:20:49 crc kubenswrapper[5120]: I0316 16:20:49.166502 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/prometheus-metric-storage-0" event={"ID":"e007aee0-65df-4ec7-bd52-23bf7f4b704f","Type":"ContainerDied","Data":"f287e2a89b8a786d204d6870f4cd0a46a6ed86d615917bcfadfd137614b32e66"} Mar 16 16:20:49 crc kubenswrapper[5120]: I0316 16:20:49.169391 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-dpqrl" event={"ID":"930884a5-5cda-4141-8d98-deee3cd13dc3","Type":"ContainerDied","Data":"0a9dd54a04feba152548b1de934b359f95275b1cc74c41289805947aa850eab4"} Mar 16 16:20:49 crc kubenswrapper[5120]: I0316 16:20:49.169443 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0a9dd54a04feba152548b1de934b359f95275b1cc74c41289805947aa850eab4" Mar 16 16:20:49 crc kubenswrapper[5120]: I0316 16:20:49.169590 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-dpqrl" Mar 16 16:20:49 crc kubenswrapper[5120]: I0316 16:20:49.500801 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/prometheus-metric-storage-0" Mar 16 16:20:49 crc kubenswrapper[5120]: I0316 16:20:49.618967 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e007aee0-65df-4ec7-bd52-23bf7f4b704f-thanos-prometheus-http-client-file\") pod \"e007aee0-65df-4ec7-bd52-23bf7f4b704f\" (UID: \"e007aee0-65df-4ec7-bd52-23bf7f4b704f\") " Mar 16 16:20:49 crc kubenswrapper[5120]: I0316 16:20:49.619074 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e007aee0-65df-4ec7-bd52-23bf7f4b704f-tls-assets\") pod \"e007aee0-65df-4ec7-bd52-23bf7f4b704f\" (UID: \"e007aee0-65df-4ec7-bd52-23bf7f4b704f\") " Mar 16 16:20:49 crc kubenswrapper[5120]: I0316 16:20:49.619219 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-metric-storage-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e007aee0-65df-4ec7-bd52-23bf7f4b704f-prometheus-metric-storage-rulefiles-0\") pod \"e007aee0-65df-4ec7-bd52-23bf7f4b704f\" (UID: \"e007aee0-65df-4ec7-bd52-23bf7f4b704f\") " Mar 16 16:20:49 crc kubenswrapper[5120]: I0316 16:20:49.619285 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e007aee0-65df-4ec7-bd52-23bf7f4b704f-config\") pod \"e007aee0-65df-4ec7-bd52-23bf7f4b704f\" (UID: \"e007aee0-65df-4ec7-bd52-23bf7f4b704f\") " Mar 16 16:20:49 crc kubenswrapper[5120]: I0316 16:20:49.619351 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-86mwh\" (UniqueName: \"kubernetes.io/projected/e007aee0-65df-4ec7-bd52-23bf7f4b704f-kube-api-access-86mwh\") pod \"e007aee0-65df-4ec7-bd52-23bf7f4b704f\" (UID: \"e007aee0-65df-4ec7-bd52-23bf7f4b704f\") " Mar 16 16:20:49 crc kubenswrapper[5120]: I0316 16:20:49.619372 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e007aee0-65df-4ec7-bd52-23bf7f4b704f-web-config\") pod \"e007aee0-65df-4ec7-bd52-23bf7f4b704f\" (UID: \"e007aee0-65df-4ec7-bd52-23bf7f4b704f\") " Mar 16 16:20:49 crc kubenswrapper[5120]: I0316 16:20:49.619393 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e007aee0-65df-4ec7-bd52-23bf7f4b704f-config-out\") pod \"e007aee0-65df-4ec7-bd52-23bf7f4b704f\" (UID: \"e007aee0-65df-4ec7-bd52-23bf7f4b704f\") " Mar 16 16:20:49 crc kubenswrapper[5120]: I0316 16:20:49.619408 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-metric-storage-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e007aee0-65df-4ec7-bd52-23bf7f4b704f-prometheus-metric-storage-rulefiles-2\") pod \"e007aee0-65df-4ec7-bd52-23bf7f4b704f\" (UID: \"e007aee0-65df-4ec7-bd52-23bf7f4b704f\") " Mar 16 16:20:49 crc kubenswrapper[5120]: I0316 16:20:49.619483 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-metric-storage-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e007aee0-65df-4ec7-bd52-23bf7f4b704f-prometheus-metric-storage-rulefiles-1\") pod \"e007aee0-65df-4ec7-bd52-23bf7f4b704f\" (UID: \"e007aee0-65df-4ec7-bd52-23bf7f4b704f\") " Mar 16 16:20:49 crc kubenswrapper[5120]: I0316 16:20:49.619527 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-metric-storage-db\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"e007aee0-65df-4ec7-bd52-23bf7f4b704f\" (UID: \"e007aee0-65df-4ec7-bd52-23bf7f4b704f\") " Mar 16 16:20:49 crc kubenswrapper[5120]: I0316 16:20:49.620312 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e007aee0-65df-4ec7-bd52-23bf7f4b704f-prometheus-metric-storage-rulefiles-0" (OuterVolumeSpecName: "prometheus-metric-storage-rulefiles-0") pod "e007aee0-65df-4ec7-bd52-23bf7f4b704f" (UID: "e007aee0-65df-4ec7-bd52-23bf7f4b704f"). InnerVolumeSpecName "prometheus-metric-storage-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:20:49 crc kubenswrapper[5120]: I0316 16:20:49.620395 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e007aee0-65df-4ec7-bd52-23bf7f4b704f-prometheus-metric-storage-rulefiles-2" (OuterVolumeSpecName: "prometheus-metric-storage-rulefiles-2") pod "e007aee0-65df-4ec7-bd52-23bf7f4b704f" (UID: "e007aee0-65df-4ec7-bd52-23bf7f4b704f"). InnerVolumeSpecName "prometheus-metric-storage-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:20:49 crc kubenswrapper[5120]: I0316 16:20:49.620549 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e007aee0-65df-4ec7-bd52-23bf7f4b704f-prometheus-metric-storage-rulefiles-1" (OuterVolumeSpecName: "prometheus-metric-storage-rulefiles-1") pod "e007aee0-65df-4ec7-bd52-23bf7f4b704f" (UID: "e007aee0-65df-4ec7-bd52-23bf7f4b704f"). InnerVolumeSpecName "prometheus-metric-storage-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:20:49 crc kubenswrapper[5120]: I0316 16:20:49.620917 5120 reconciler_common.go:299] "Volume detached for volume \"prometheus-metric-storage-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e007aee0-65df-4ec7-bd52-23bf7f4b704f-prometheus-metric-storage-rulefiles-0\") on node \"crc\" DevicePath \"\"" Mar 16 16:20:49 crc kubenswrapper[5120]: I0316 16:20:49.620938 5120 reconciler_common.go:299] "Volume detached for volume \"prometheus-metric-storage-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e007aee0-65df-4ec7-bd52-23bf7f4b704f-prometheus-metric-storage-rulefiles-2\") on node \"crc\" DevicePath \"\"" Mar 16 16:20:49 crc kubenswrapper[5120]: I0316 16:20:49.620948 5120 reconciler_common.go:299] "Volume detached for volume \"prometheus-metric-storage-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e007aee0-65df-4ec7-bd52-23bf7f4b704f-prometheus-metric-storage-rulefiles-1\") on node \"crc\" DevicePath \"\"" Mar 16 16:20:49 crc kubenswrapper[5120]: I0316 16:20:49.625717 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e007aee0-65df-4ec7-bd52-23bf7f4b704f-config-out" (OuterVolumeSpecName: "config-out") pod "e007aee0-65df-4ec7-bd52-23bf7f4b704f" (UID: "e007aee0-65df-4ec7-bd52-23bf7f4b704f"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:20:49 crc kubenswrapper[5120]: I0316 16:20:49.626085 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e007aee0-65df-4ec7-bd52-23bf7f4b704f-kube-api-access-86mwh" (OuterVolumeSpecName: "kube-api-access-86mwh") pod "e007aee0-65df-4ec7-bd52-23bf7f4b704f" (UID: "e007aee0-65df-4ec7-bd52-23bf7f4b704f"). InnerVolumeSpecName "kube-api-access-86mwh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:20:49 crc kubenswrapper[5120]: I0316 16:20:49.626130 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e007aee0-65df-4ec7-bd52-23bf7f4b704f-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "e007aee0-65df-4ec7-bd52-23bf7f4b704f" (UID: "e007aee0-65df-4ec7-bd52-23bf7f4b704f"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:20:49 crc kubenswrapper[5120]: I0316 16:20:49.626917 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e007aee0-65df-4ec7-bd52-23bf7f4b704f-config" (OuterVolumeSpecName: "config") pod "e007aee0-65df-4ec7-bd52-23bf7f4b704f" (UID: "e007aee0-65df-4ec7-bd52-23bf7f4b704f"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:20:49 crc kubenswrapper[5120]: I0316 16:20:49.639107 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e007aee0-65df-4ec7-bd52-23bf7f4b704f-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "e007aee0-65df-4ec7-bd52-23bf7f4b704f" (UID: "e007aee0-65df-4ec7-bd52-23bf7f4b704f"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:20:49 crc kubenswrapper[5120]: I0316 16:20:49.639630 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage10-crc" (OuterVolumeSpecName: "prometheus-metric-storage-db") pod "e007aee0-65df-4ec7-bd52-23bf7f4b704f" (UID: "e007aee0-65df-4ec7-bd52-23bf7f4b704f"). InnerVolumeSpecName "local-storage10-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:20:49 crc kubenswrapper[5120]: I0316 16:20:49.657596 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e007aee0-65df-4ec7-bd52-23bf7f4b704f-web-config" (OuterVolumeSpecName: "web-config") pod "e007aee0-65df-4ec7-bd52-23bf7f4b704f" (UID: "e007aee0-65df-4ec7-bd52-23bf7f4b704f"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:20:49 crc kubenswrapper[5120]: I0316 16:20:49.663542 5120 scope.go:117] "RemoveContainer" containerID="f40e444f89abd558ac90555bfd58e04a1c4379a653ba8035c228d2b7a5443eb5" Mar 16 16:20:49 crc kubenswrapper[5120]: E0316 16:20:49.663852 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:20:49 crc kubenswrapper[5120]: I0316 16:20:49.722272 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/e007aee0-65df-4ec7-bd52-23bf7f4b704f-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:20:49 crc kubenswrapper[5120]: I0316 16:20:49.722302 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-86mwh\" (UniqueName: \"kubernetes.io/projected/e007aee0-65df-4ec7-bd52-23bf7f4b704f-kube-api-access-86mwh\") on node \"crc\" DevicePath \"\"" Mar 16 16:20:49 crc kubenswrapper[5120]: I0316 16:20:49.722313 5120 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e007aee0-65df-4ec7-bd52-23bf7f4b704f-web-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:20:49 crc kubenswrapper[5120]: I0316 16:20:49.722322 5120 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e007aee0-65df-4ec7-bd52-23bf7f4b704f-config-out\") on node \"crc\" DevicePath \"\"" Mar 16 16:20:49 crc kubenswrapper[5120]: I0316 16:20:49.722341 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") on node \"crc\" " Mar 16 16:20:49 crc kubenswrapper[5120]: I0316 16:20:49.722351 5120 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e007aee0-65df-4ec7-bd52-23bf7f4b704f-thanos-prometheus-http-client-file\") on node \"crc\" DevicePath \"\"" Mar 16 16:20:49 crc kubenswrapper[5120]: I0316 16:20:49.722362 5120 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e007aee0-65df-4ec7-bd52-23bf7f4b704f-tls-assets\") on node \"crc\" DevicePath \"\"" Mar 16 16:20:49 crc kubenswrapper[5120]: I0316 16:20:49.738058 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage10-crc" (UniqueName: "kubernetes.io/local-volume/local-storage10-crc") on node "crc" Mar 16 16:20:49 crc kubenswrapper[5120]: I0316 16:20:49.825212 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:20:50 crc kubenswrapper[5120]: I0316 16:20:50.179077 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6c9947cfc-tjlwq" event={"ID":"1195ba16-9c86-4aeb-b62f-a93570eb8b02","Type":"ContainerStarted","Data":"f0b65a6a153b621263f90d92c1fc08c1e81948794cb1a5a296e5138ea7560e07"} Mar 16 16:20:50 crc kubenswrapper[5120]: I0316 16:20:50.179178 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6c9947cfc-tjlwq" Mar 16 16:20:50 crc kubenswrapper[5120]: I0316 16:20:50.182579 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/prometheus-metric-storage-0" event={"ID":"e007aee0-65df-4ec7-bd52-23bf7f4b704f","Type":"ContainerDied","Data":"692934be2005dc0de86279f0e85a81cd76859725e50367da82b7ad55406585d5"} Mar 16 16:20:50 crc kubenswrapper[5120]: I0316 16:20:50.182739 5120 scope.go:117] "RemoveContainer" containerID="48ee6e5f7295fa0717a2cc5a6f976acf1f88ff011920a621a42120de366b1dbc" Mar 16 16:20:50 crc kubenswrapper[5120]: I0316 16:20:50.182595 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/prometheus-metric-storage-0" Mar 16 16:20:50 crc kubenswrapper[5120]: I0316 16:20:50.206821 5120 scope.go:117] "RemoveContainer" containerID="bb501404b43a3ab4a852f60b9f15711dbdc9534e7927d346e281dc835402bbe7" Mar 16 16:20:50 crc kubenswrapper[5120]: I0316 16:20:50.208948 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6c9947cfc-tjlwq" podStartSLOduration=3.208937116 podStartE2EDuration="3.208937116s" podCreationTimestamp="2026-03-16 16:20:47 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:20:50.206982394 +0000 UTC m=+2952.360914051" watchObservedRunningTime="2026-03-16 16:20:50.208937116 +0000 UTC m=+2952.362868773" Mar 16 16:20:50 crc kubenswrapper[5120]: I0316 16:20:50.230400 5120 scope.go:117] "RemoveContainer" containerID="f287e2a89b8a786d204d6870f4cd0a46a6ed86d615917bcfadfd137614b32e66" Mar 16 16:20:50 crc kubenswrapper[5120]: I0316 16:20:50.238618 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/prometheus-metric-storage-0"] Mar 16 16:20:50 crc kubenswrapper[5120]: I0316 16:20:50.241730 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/prometheus-metric-storage-0"] Mar 16 16:20:50 crc kubenswrapper[5120]: I0316 16:20:50.257734 5120 scope.go:117] "RemoveContainer" containerID="53d03858cadc5105eba35075d2d8179684dcb66d28a132eb4b7fa7a08dd123dd" Mar 16 16:20:50 crc kubenswrapper[5120]: I0316 16:20:50.278295 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/prometheus-metric-storage-0"] Mar 16 16:20:50 crc kubenswrapper[5120]: I0316 16:20:50.279121 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="930884a5-5cda-4141-8d98-deee3cd13dc3" containerName="glance-db-sync" Mar 16 16:20:50 crc kubenswrapper[5120]: I0316 16:20:50.279136 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="930884a5-5cda-4141-8d98-deee3cd13dc3" containerName="glance-db-sync" Mar 16 16:20:50 crc kubenswrapper[5120]: I0316 16:20:50.279149 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e007aee0-65df-4ec7-bd52-23bf7f4b704f" containerName="init-config-reloader" Mar 16 16:20:50 crc kubenswrapper[5120]: I0316 16:20:50.279154 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e007aee0-65df-4ec7-bd52-23bf7f4b704f" containerName="init-config-reloader" Mar 16 16:20:50 crc kubenswrapper[5120]: I0316 16:20:50.279171 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e007aee0-65df-4ec7-bd52-23bf7f4b704f" containerName="config-reloader" Mar 16 16:20:50 crc kubenswrapper[5120]: I0316 16:20:50.279178 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e007aee0-65df-4ec7-bd52-23bf7f4b704f" containerName="config-reloader" Mar 16 16:20:50 crc kubenswrapper[5120]: I0316 16:20:50.279187 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e007aee0-65df-4ec7-bd52-23bf7f4b704f" containerName="thanos-sidecar" Mar 16 16:20:50 crc kubenswrapper[5120]: I0316 16:20:50.279193 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e007aee0-65df-4ec7-bd52-23bf7f4b704f" containerName="thanos-sidecar" Mar 16 16:20:50 crc kubenswrapper[5120]: I0316 16:20:50.279216 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e007aee0-65df-4ec7-bd52-23bf7f4b704f" containerName="prometheus" Mar 16 16:20:50 crc kubenswrapper[5120]: I0316 16:20:50.279222 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e007aee0-65df-4ec7-bd52-23bf7f4b704f" containerName="prometheus" Mar 16 16:20:50 crc kubenswrapper[5120]: I0316 16:20:50.279383 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="930884a5-5cda-4141-8d98-deee3cd13dc3" containerName="glance-db-sync" Mar 16 16:20:50 crc kubenswrapper[5120]: I0316 16:20:50.279402 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e007aee0-65df-4ec7-bd52-23bf7f4b704f" containerName="config-reloader" Mar 16 16:20:50 crc kubenswrapper[5120]: I0316 16:20:50.279413 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e007aee0-65df-4ec7-bd52-23bf7f4b704f" containerName="thanos-sidecar" Mar 16 16:20:50 crc kubenswrapper[5120]: I0316 16:20:50.279421 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e007aee0-65df-4ec7-bd52-23bf7f4b704f" containerName="prometheus" Mar 16 16:20:50 crc kubenswrapper[5120]: I0316 16:20:50.295745 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/prometheus-metric-storage-0"] Mar 16 16:20:50 crc kubenswrapper[5120]: I0316 16:20:50.295879 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/prometheus-metric-storage-0" Mar 16 16:20:50 crc kubenswrapper[5120]: I0316 16:20:50.329341 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"prometheus-metric-storage\"" Mar 16 16:20:50 crc kubenswrapper[5120]: I0316 16:20:50.329523 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"prometheus-metric-storage-thanos-prometheus-http-client-file\"" Mar 16 16:20:50 crc kubenswrapper[5120]: I0316 16:20:50.329641 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"prometheus-metric-storage-rulefiles-2\"" Mar 16 16:20:50 crc kubenswrapper[5120]: I0316 16:20:50.329814 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"prometheus-metric-storage-rulefiles-1\"" Mar 16 16:20:50 crc kubenswrapper[5120]: I0316 16:20:50.329893 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-metric-storage-prometheus-svc\"" Mar 16 16:20:50 crc kubenswrapper[5120]: I0316 16:20:50.329646 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"prometheus-metric-storage-web-config\"" Mar 16 16:20:50 crc kubenswrapper[5120]: I0316 16:20:50.329352 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"metric-storage-prometheus-dockercfg-mvdng\"" Mar 16 16:20:50 crc kubenswrapper[5120]: I0316 16:20:50.329671 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"prometheus-metric-storage-rulefiles-0\"" Mar 16 16:20:50 crc kubenswrapper[5120]: I0316 16:20:50.337092 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"prometheus-metric-storage-tls-assets-0\"" Mar 16 16:20:50 crc kubenswrapper[5120]: I0316 16:20:50.435093 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/436edb75-475a-4096-a9c9-bf235fc92d9c-thanos-prometheus-http-client-file\") pod \"prometheus-metric-storage-0\" (UID: \"436edb75-475a-4096-a9c9-bf235fc92d9c\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Mar 16 16:20:50 crc kubenswrapper[5120]: I0316 16:20:50.435351 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/436edb75-475a-4096-a9c9-bf235fc92d9c-tls-assets\") pod \"prometheus-metric-storage-0\" (UID: \"436edb75-475a-4096-a9c9-bf235fc92d9c\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Mar 16 16:20:50 crc kubenswrapper[5120]: I0316 16:20:50.435441 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z62jk\" (UniqueName: \"kubernetes.io/projected/436edb75-475a-4096-a9c9-bf235fc92d9c-kube-api-access-z62jk\") pod \"prometheus-metric-storage-0\" (UID: \"436edb75-475a-4096-a9c9-bf235fc92d9c\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Mar 16 16:20:50 crc kubenswrapper[5120]: I0316 16:20:50.435551 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/436edb75-475a-4096-a9c9-bf235fc92d9c-secret-combined-ca-bundle\") pod \"prometheus-metric-storage-0\" (UID: \"436edb75-475a-4096-a9c9-bf235fc92d9c\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Mar 16 16:20:50 crc kubenswrapper[5120]: I0316 16:20:50.435690 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config-tls-secret-key-cert-metric-storage-promethe-dc638c2d\" (UniqueName: \"kubernetes.io/secret/436edb75-475a-4096-a9c9-bf235fc92d9c-web-config-tls-secret-key-cert-metric-storage-promethe-dc638c2d\") pod \"prometheus-metric-storage-0\" (UID: \"436edb75-475a-4096-a9c9-bf235fc92d9c\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Mar 16 16:20:50 crc kubenswrapper[5120]: I0316 16:20:50.435820 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-metric-storage-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/436edb75-475a-4096-a9c9-bf235fc92d9c-prometheus-metric-storage-rulefiles-1\") pod \"prometheus-metric-storage-0\" (UID: \"436edb75-475a-4096-a9c9-bf235fc92d9c\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Mar 16 16:20:50 crc kubenswrapper[5120]: I0316 16:20:50.436062 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-metric-storage-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/436edb75-475a-4096-a9c9-bf235fc92d9c-prometheus-metric-storage-rulefiles-0\") pod \"prometheus-metric-storage-0\" (UID: \"436edb75-475a-4096-a9c9-bf235fc92d9c\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Mar 16 16:20:50 crc kubenswrapper[5120]: I0316 16:20:50.436312 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/436edb75-475a-4096-a9c9-bf235fc92d9c-web-config\") pod \"prometheus-metric-storage-0\" (UID: \"436edb75-475a-4096-a9c9-bf235fc92d9c\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Mar 16 16:20:50 crc kubenswrapper[5120]: I0316 16:20:50.436521 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/436edb75-475a-4096-a9c9-bf235fc92d9c-config\") pod \"prometheus-metric-storage-0\" (UID: \"436edb75-475a-4096-a9c9-bf235fc92d9c\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Mar 16 16:20:50 crc kubenswrapper[5120]: I0316 16:20:50.436723 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/436edb75-475a-4096-a9c9-bf235fc92d9c-config-out\") pod \"prometheus-metric-storage-0\" (UID: \"436edb75-475a-4096-a9c9-bf235fc92d9c\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Mar 16 16:20:50 crc kubenswrapper[5120]: I0316 16:20:50.437094 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-metric-storage-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/436edb75-475a-4096-a9c9-bf235fc92d9c-prometheus-metric-storage-rulefiles-2\") pod \"prometheus-metric-storage-0\" (UID: \"436edb75-475a-4096-a9c9-bf235fc92d9c\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Mar 16 16:20:50 crc kubenswrapper[5120]: I0316 16:20:50.437819 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"prometheus-metric-storage-0\" (UID: \"436edb75-475a-4096-a9c9-bf235fc92d9c\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Mar 16 16:20:50 crc kubenswrapper[5120]: I0316 16:20:50.437879 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config-tls-secret-cert-cert-metric-storage-prometh-dc638c2d\" (UniqueName: \"kubernetes.io/secret/436edb75-475a-4096-a9c9-bf235fc92d9c-web-config-tls-secret-cert-cert-metric-storage-prometh-dc638c2d\") pod \"prometheus-metric-storage-0\" (UID: \"436edb75-475a-4096-a9c9-bf235fc92d9c\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Mar 16 16:20:50 crc kubenswrapper[5120]: I0316 16:20:50.539673 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/436edb75-475a-4096-a9c9-bf235fc92d9c-thanos-prometheus-http-client-file\") pod \"prometheus-metric-storage-0\" (UID: \"436edb75-475a-4096-a9c9-bf235fc92d9c\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Mar 16 16:20:50 crc kubenswrapper[5120]: I0316 16:20:50.539801 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/436edb75-475a-4096-a9c9-bf235fc92d9c-tls-assets\") pod \"prometheus-metric-storage-0\" (UID: \"436edb75-475a-4096-a9c9-bf235fc92d9c\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Mar 16 16:20:50 crc kubenswrapper[5120]: I0316 16:20:50.539838 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z62jk\" (UniqueName: \"kubernetes.io/projected/436edb75-475a-4096-a9c9-bf235fc92d9c-kube-api-access-z62jk\") pod \"prometheus-metric-storage-0\" (UID: \"436edb75-475a-4096-a9c9-bf235fc92d9c\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Mar 16 16:20:50 crc kubenswrapper[5120]: I0316 16:20:50.539892 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/436edb75-475a-4096-a9c9-bf235fc92d9c-secret-combined-ca-bundle\") pod \"prometheus-metric-storage-0\" (UID: \"436edb75-475a-4096-a9c9-bf235fc92d9c\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Mar 16 16:20:50 crc kubenswrapper[5120]: I0316 16:20:50.539937 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config-tls-secret-key-cert-metric-storage-promethe-dc638c2d\" (UniqueName: \"kubernetes.io/secret/436edb75-475a-4096-a9c9-bf235fc92d9c-web-config-tls-secret-key-cert-metric-storage-promethe-dc638c2d\") pod \"prometheus-metric-storage-0\" (UID: \"436edb75-475a-4096-a9c9-bf235fc92d9c\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Mar 16 16:20:50 crc kubenswrapper[5120]: I0316 16:20:50.539957 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-metric-storage-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/436edb75-475a-4096-a9c9-bf235fc92d9c-prometheus-metric-storage-rulefiles-1\") pod \"prometheus-metric-storage-0\" (UID: \"436edb75-475a-4096-a9c9-bf235fc92d9c\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Mar 16 16:20:50 crc kubenswrapper[5120]: I0316 16:20:50.539975 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-metric-storage-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/436edb75-475a-4096-a9c9-bf235fc92d9c-prometheus-metric-storage-rulefiles-0\") pod \"prometheus-metric-storage-0\" (UID: \"436edb75-475a-4096-a9c9-bf235fc92d9c\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Mar 16 16:20:50 crc kubenswrapper[5120]: I0316 16:20:50.539992 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/436edb75-475a-4096-a9c9-bf235fc92d9c-web-config\") pod \"prometheus-metric-storage-0\" (UID: \"436edb75-475a-4096-a9c9-bf235fc92d9c\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Mar 16 16:20:50 crc kubenswrapper[5120]: I0316 16:20:50.540013 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/436edb75-475a-4096-a9c9-bf235fc92d9c-config\") pod \"prometheus-metric-storage-0\" (UID: \"436edb75-475a-4096-a9c9-bf235fc92d9c\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Mar 16 16:20:50 crc kubenswrapper[5120]: I0316 16:20:50.540036 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/436edb75-475a-4096-a9c9-bf235fc92d9c-config-out\") pod \"prometheus-metric-storage-0\" (UID: \"436edb75-475a-4096-a9c9-bf235fc92d9c\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Mar 16 16:20:50 crc kubenswrapper[5120]: I0316 16:20:50.540128 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-metric-storage-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/436edb75-475a-4096-a9c9-bf235fc92d9c-prometheus-metric-storage-rulefiles-2\") pod \"prometheus-metric-storage-0\" (UID: \"436edb75-475a-4096-a9c9-bf235fc92d9c\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Mar 16 16:20:50 crc kubenswrapper[5120]: I0316 16:20:50.540172 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"prometheus-metric-storage-0\" (UID: \"436edb75-475a-4096-a9c9-bf235fc92d9c\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Mar 16 16:20:50 crc kubenswrapper[5120]: I0316 16:20:50.540202 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config-tls-secret-cert-cert-metric-storage-prometh-dc638c2d\" (UniqueName: \"kubernetes.io/secret/436edb75-475a-4096-a9c9-bf235fc92d9c-web-config-tls-secret-cert-cert-metric-storage-prometh-dc638c2d\") pod \"prometheus-metric-storage-0\" (UID: \"436edb75-475a-4096-a9c9-bf235fc92d9c\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Mar 16 16:20:50 crc kubenswrapper[5120]: I0316 16:20:50.541508 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-metric-storage-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/436edb75-475a-4096-a9c9-bf235fc92d9c-prometheus-metric-storage-rulefiles-1\") pod \"prometheus-metric-storage-0\" (UID: \"436edb75-475a-4096-a9c9-bf235fc92d9c\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Mar 16 16:20:50 crc kubenswrapper[5120]: I0316 16:20:50.543456 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-metric-storage-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/436edb75-475a-4096-a9c9-bf235fc92d9c-prometheus-metric-storage-rulefiles-0\") pod \"prometheus-metric-storage-0\" (UID: \"436edb75-475a-4096-a9c9-bf235fc92d9c\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Mar 16 16:20:50 crc kubenswrapper[5120]: I0316 16:20:50.544702 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"prometheus-metric-storage-0\" (UID: \"436edb75-475a-4096-a9c9-bf235fc92d9c\") device mount path \"/mnt/openstack/pv10\"" pod="openstack-kuttl-tests/prometheus-metric-storage-0" Mar 16 16:20:50 crc kubenswrapper[5120]: I0316 16:20:50.544750 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-metric-storage-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/436edb75-475a-4096-a9c9-bf235fc92d9c-prometheus-metric-storage-rulefiles-2\") pod \"prometheus-metric-storage-0\" (UID: \"436edb75-475a-4096-a9c9-bf235fc92d9c\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Mar 16 16:20:50 crc kubenswrapper[5120]: I0316 16:20:50.545508 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/436edb75-475a-4096-a9c9-bf235fc92d9c-config-out\") pod \"prometheus-metric-storage-0\" (UID: \"436edb75-475a-4096-a9c9-bf235fc92d9c\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Mar 16 16:20:50 crc kubenswrapper[5120]: I0316 16:20:50.546946 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/436edb75-475a-4096-a9c9-bf235fc92d9c-secret-combined-ca-bundle\") pod \"prometheus-metric-storage-0\" (UID: \"436edb75-475a-4096-a9c9-bf235fc92d9c\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Mar 16 16:20:50 crc kubenswrapper[5120]: I0316 16:20:50.547458 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/436edb75-475a-4096-a9c9-bf235fc92d9c-thanos-prometheus-http-client-file\") pod \"prometheus-metric-storage-0\" (UID: \"436edb75-475a-4096-a9c9-bf235fc92d9c\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Mar 16 16:20:50 crc kubenswrapper[5120]: I0316 16:20:50.547530 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/436edb75-475a-4096-a9c9-bf235fc92d9c-web-config\") pod \"prometheus-metric-storage-0\" (UID: \"436edb75-475a-4096-a9c9-bf235fc92d9c\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Mar 16 16:20:50 crc kubenswrapper[5120]: I0316 16:20:50.548085 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/436edb75-475a-4096-a9c9-bf235fc92d9c-config\") pod \"prometheus-metric-storage-0\" (UID: \"436edb75-475a-4096-a9c9-bf235fc92d9c\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Mar 16 16:20:50 crc kubenswrapper[5120]: I0316 16:20:50.548438 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/436edb75-475a-4096-a9c9-bf235fc92d9c-tls-assets\") pod \"prometheus-metric-storage-0\" (UID: \"436edb75-475a-4096-a9c9-bf235fc92d9c\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Mar 16 16:20:50 crc kubenswrapper[5120]: I0316 16:20:50.550196 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config-tls-secret-cert-cert-metric-storage-prometh-dc638c2d\" (UniqueName: \"kubernetes.io/secret/436edb75-475a-4096-a9c9-bf235fc92d9c-web-config-tls-secret-cert-cert-metric-storage-prometh-dc638c2d\") pod \"prometheus-metric-storage-0\" (UID: \"436edb75-475a-4096-a9c9-bf235fc92d9c\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Mar 16 16:20:50 crc kubenswrapper[5120]: I0316 16:20:50.562460 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z62jk\" (UniqueName: \"kubernetes.io/projected/436edb75-475a-4096-a9c9-bf235fc92d9c-kube-api-access-z62jk\") pod \"prometheus-metric-storage-0\" (UID: \"436edb75-475a-4096-a9c9-bf235fc92d9c\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Mar 16 16:20:50 crc kubenswrapper[5120]: I0316 16:20:50.568858 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config-tls-secret-key-cert-metric-storage-promethe-dc638c2d\" (UniqueName: \"kubernetes.io/secret/436edb75-475a-4096-a9c9-bf235fc92d9c-web-config-tls-secret-key-cert-metric-storage-promethe-dc638c2d\") pod \"prometheus-metric-storage-0\" (UID: \"436edb75-475a-4096-a9c9-bf235fc92d9c\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Mar 16 16:20:50 crc kubenswrapper[5120]: I0316 16:20:50.578724 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"prometheus-metric-storage-0\" (UID: \"436edb75-475a-4096-a9c9-bf235fc92d9c\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Mar 16 16:20:50 crc kubenswrapper[5120]: I0316 16:20:50.637194 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/prometheus-metric-storage-0" Mar 16 16:20:50 crc kubenswrapper[5120]: I0316 16:20:50.686501 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e007aee0-65df-4ec7-bd52-23bf7f4b704f" path="/var/lib/kubelet/pods/e007aee0-65df-4ec7-bd52-23bf7f4b704f/volumes" Mar 16 16:20:51 crc kubenswrapper[5120]: I0316 16:20:51.101019 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/prometheus-metric-storage-0"] Mar 16 16:20:51 crc kubenswrapper[5120]: W0316 16:20:51.106522 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod436edb75_475a_4096_a9c9_bf235fc92d9c.slice/crio-f103913d8232cf82f1ed1a7fc559f65bf626b71dff26bcb1e82ccfe014a32d15 WatchSource:0}: Error finding container f103913d8232cf82f1ed1a7fc559f65bf626b71dff26bcb1e82ccfe014a32d15: Status 404 returned error can't find the container with id f103913d8232cf82f1ed1a7fc559f65bf626b71dff26bcb1e82ccfe014a32d15 Mar 16 16:20:51 crc kubenswrapper[5120]: I0316 16:20:51.205548 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/prometheus-metric-storage-0" event={"ID":"436edb75-475a-4096-a9c9-bf235fc92d9c","Type":"ContainerStarted","Data":"f103913d8232cf82f1ed1a7fc559f65bf626b71dff26bcb1e82ccfe014a32d15"} Mar 16 16:20:54 crc kubenswrapper[5120]: I0316 16:20:54.238047 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/prometheus-metric-storage-0" event={"ID":"436edb75-475a-4096-a9c9-bf235fc92d9c","Type":"ContainerStarted","Data":"9502739a7d25d2137566dcf525619e40c2aee690dead067c34fdb4a1fc4f0c13"} Mar 16 16:20:56 crc kubenswrapper[5120]: I0316 16:20:56.096056 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:20:56 crc kubenswrapper[5120]: I0316 16:20:56.209124 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6c9947cfc-tjlwq" Mar 16 16:20:56 crc kubenswrapper[5120]: I0316 16:20:56.298351 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-4w76w"] Mar 16 16:20:56 crc kubenswrapper[5120]: I0316 16:20:56.298631 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-4w76w" podUID="1b59d8b3-3000-4e61-8e3c-50df40fc5181" containerName="dnsmasq-dns" containerID="cri-o://85bbc914bacb73f33e0c57c0ebd483d60bcd0040127d7a501adf7eda67ad9d18" gracePeriod=10 Mar 16 16:20:56 crc kubenswrapper[5120]: I0316 16:20:56.464634 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-db-create-hblb6"] Mar 16 16:20:56 crc kubenswrapper[5120]: I0316 16:20:56.477122 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-create-hblb6" Mar 16 16:20:56 crc kubenswrapper[5120]: I0316 16:20:56.479147 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-db-create-hblb6"] Mar 16 16:20:56 crc kubenswrapper[5120]: I0316 16:20:56.571946 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rmvm\" (UniqueName: \"kubernetes.io/projected/098bebf2-f1d9-4af9-a09c-10f7d6be8761-kube-api-access-5rmvm\") pod \"cinder-db-create-hblb6\" (UID: \"098bebf2-f1d9-4af9-a09c-10f7d6be8761\") " pod="openstack-kuttl-tests/cinder-db-create-hblb6" Mar 16 16:20:56 crc kubenswrapper[5120]: I0316 16:20:56.572176 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/098bebf2-f1d9-4af9-a09c-10f7d6be8761-operator-scripts\") pod \"cinder-db-create-hblb6\" (UID: \"098bebf2-f1d9-4af9-a09c-10f7d6be8761\") " pod="openstack-kuttl-tests/cinder-db-create-hblb6" Mar 16 16:20:56 crc kubenswrapper[5120]: I0316 16:20:56.595626 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-51fc-account-create-update-8thf9"] Mar 16 16:20:56 crc kubenswrapper[5120]: I0316 16:20:56.601159 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-51fc-account-create-update-8thf9" Mar 16 16:20:56 crc kubenswrapper[5120]: I0316 16:20:56.602471 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-51fc-account-create-update-8thf9"] Mar 16 16:20:56 crc kubenswrapper[5120]: I0316 16:20:56.607244 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-db-secret\"" Mar 16 16:20:56 crc kubenswrapper[5120]: I0316 16:20:56.615951 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-4w76w" podUID="1b59d8b3-3000-4e61-8e3c-50df40fc5181" containerName="dnsmasq-dns" probeResult="failure" output="dial tcp 10.217.1.28:5353: connect: connection refused" Mar 16 16:20:56 crc kubenswrapper[5120]: I0316 16:20:56.683502 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/098bebf2-f1d9-4af9-a09c-10f7d6be8761-operator-scripts\") pod \"cinder-db-create-hblb6\" (UID: \"098bebf2-f1d9-4af9-a09c-10f7d6be8761\") " pod="openstack-kuttl-tests/cinder-db-create-hblb6" Mar 16 16:20:56 crc kubenswrapper[5120]: I0316 16:20:56.683875 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5rmvm\" (UniqueName: \"kubernetes.io/projected/098bebf2-f1d9-4af9-a09c-10f7d6be8761-kube-api-access-5rmvm\") pod \"cinder-db-create-hblb6\" (UID: \"098bebf2-f1d9-4af9-a09c-10f7d6be8761\") " pod="openstack-kuttl-tests/cinder-db-create-hblb6" Mar 16 16:20:56 crc kubenswrapper[5120]: I0316 16:20:56.688160 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/098bebf2-f1d9-4af9-a09c-10f7d6be8761-operator-scripts\") pod \"cinder-db-create-hblb6\" (UID: \"098bebf2-f1d9-4af9-a09c-10f7d6be8761\") " pod="openstack-kuttl-tests/cinder-db-create-hblb6" Mar 16 16:20:56 crc kubenswrapper[5120]: I0316 16:20:56.714364 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rmvm\" (UniqueName: \"kubernetes.io/projected/098bebf2-f1d9-4af9-a09c-10f7d6be8761-kube-api-access-5rmvm\") pod \"cinder-db-create-hblb6\" (UID: \"098bebf2-f1d9-4af9-a09c-10f7d6be8761\") " pod="openstack-kuttl-tests/cinder-db-create-hblb6" Mar 16 16:20:56 crc kubenswrapper[5120]: I0316 16:20:56.714741 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/watcher-db-sync-tlbgk"] Mar 16 16:20:56 crc kubenswrapper[5120]: I0316 16:20:56.721726 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/watcher-db-sync-tlbgk"] Mar 16 16:20:56 crc kubenswrapper[5120]: I0316 16:20:56.721863 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-db-create-nvn6z"] Mar 16 16:20:56 crc kubenswrapper[5120]: I0316 16:20:56.722156 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/watcher-db-sync-tlbgk" Mar 16 16:20:56 crc kubenswrapper[5120]: I0316 16:20:56.727684 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"watcher-config-data\"" Mar 16 16:20:56 crc kubenswrapper[5120]: I0316 16:20:56.728001 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"watcher-watcher-dockercfg-sctn4\"" Mar 16 16:20:56 crc kubenswrapper[5120]: I0316 16:20:56.741189 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-create-nvn6z" Mar 16 16:20:56 crc kubenswrapper[5120]: I0316 16:20:56.753949 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-db-create-nvn6z"] Mar 16 16:20:56 crc kubenswrapper[5120]: I0316 16:20:56.785541 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6z99g\" (UniqueName: \"kubernetes.io/projected/0deba017-f115-4b42-8695-63cbe951fb08-kube-api-access-6z99g\") pod \"cinder-51fc-account-create-update-8thf9\" (UID: \"0deba017-f115-4b42-8695-63cbe951fb08\") " pod="openstack-kuttl-tests/cinder-51fc-account-create-update-8thf9" Mar 16 16:20:56 crc kubenswrapper[5120]: I0316 16:20:56.785902 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0deba017-f115-4b42-8695-63cbe951fb08-operator-scripts\") pod \"cinder-51fc-account-create-update-8thf9\" (UID: \"0deba017-f115-4b42-8695-63cbe951fb08\") " pod="openstack-kuttl-tests/cinder-51fc-account-create-update-8thf9" Mar 16 16:20:56 crc kubenswrapper[5120]: I0316 16:20:56.834888 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-create-hblb6" Mar 16 16:20:56 crc kubenswrapper[5120]: I0316 16:20:56.852350 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-db-create-6wrmh"] Mar 16 16:20:56 crc kubenswrapper[5120]: I0316 16:20:56.865026 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-create-6wrmh" Mar 16 16:20:56 crc kubenswrapper[5120]: I0316 16:20:56.878400 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-db-create-6wrmh"] Mar 16 16:20:56 crc kubenswrapper[5120]: I0316 16:20:56.889503 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/75f1b7f4-9fac-4135-819b-8eab79df5cf9-config-data\") pod \"watcher-db-sync-tlbgk\" (UID: \"75f1b7f4-9fac-4135-819b-8eab79df5cf9\") " pod="openstack-kuttl-tests/watcher-db-sync-tlbgk" Mar 16 16:20:56 crc kubenswrapper[5120]: I0316 16:20:56.889566 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/75f1b7f4-9fac-4135-819b-8eab79df5cf9-db-sync-config-data\") pod \"watcher-db-sync-tlbgk\" (UID: \"75f1b7f4-9fac-4135-819b-8eab79df5cf9\") " pod="openstack-kuttl-tests/watcher-db-sync-tlbgk" Mar 16 16:20:56 crc kubenswrapper[5120]: I0316 16:20:56.889620 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0deba017-f115-4b42-8695-63cbe951fb08-operator-scripts\") pod \"cinder-51fc-account-create-update-8thf9\" (UID: \"0deba017-f115-4b42-8695-63cbe951fb08\") " pod="openstack-kuttl-tests/cinder-51fc-account-create-update-8thf9" Mar 16 16:20:56 crc kubenswrapper[5120]: I0316 16:20:56.889687 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2th8\" (UniqueName: \"kubernetes.io/projected/75f1b7f4-9fac-4135-819b-8eab79df5cf9-kube-api-access-w2th8\") pod \"watcher-db-sync-tlbgk\" (UID: \"75f1b7f4-9fac-4135-819b-8eab79df5cf9\") " pod="openstack-kuttl-tests/watcher-db-sync-tlbgk" Mar 16 16:20:56 crc kubenswrapper[5120]: I0316 16:20:56.889790 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6z99g\" (UniqueName: \"kubernetes.io/projected/0deba017-f115-4b42-8695-63cbe951fb08-kube-api-access-6z99g\") pod \"cinder-51fc-account-create-update-8thf9\" (UID: \"0deba017-f115-4b42-8695-63cbe951fb08\") " pod="openstack-kuttl-tests/cinder-51fc-account-create-update-8thf9" Mar 16 16:20:56 crc kubenswrapper[5120]: I0316 16:20:56.889852 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/75f1b7f4-9fac-4135-819b-8eab79df5cf9-combined-ca-bundle\") pod \"watcher-db-sync-tlbgk\" (UID: \"75f1b7f4-9fac-4135-819b-8eab79df5cf9\") " pod="openstack-kuttl-tests/watcher-db-sync-tlbgk" Mar 16 16:20:56 crc kubenswrapper[5120]: I0316 16:20:56.889880 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e9495774-461a-413a-97a3-d348c402a717-operator-scripts\") pod \"neutron-db-create-nvn6z\" (UID: \"e9495774-461a-413a-97a3-d348c402a717\") " pod="openstack-kuttl-tests/neutron-db-create-nvn6z" Mar 16 16:20:56 crc kubenswrapper[5120]: I0316 16:20:56.889933 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvfjw\" (UniqueName: \"kubernetes.io/projected/e9495774-461a-413a-97a3-d348c402a717-kube-api-access-qvfjw\") pod \"neutron-db-create-nvn6z\" (UID: \"e9495774-461a-413a-97a3-d348c402a717\") " pod="openstack-kuttl-tests/neutron-db-create-nvn6z" Mar 16 16:20:56 crc kubenswrapper[5120]: I0316 16:20:56.891610 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0deba017-f115-4b42-8695-63cbe951fb08-operator-scripts\") pod \"cinder-51fc-account-create-update-8thf9\" (UID: \"0deba017-f115-4b42-8695-63cbe951fb08\") " pod="openstack-kuttl-tests/cinder-51fc-account-create-update-8thf9" Mar 16 16:20:56 crc kubenswrapper[5120]: I0316 16:20:56.904630 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-a8ac-account-create-update-98gk4"] Mar 16 16:20:56 crc kubenswrapper[5120]: I0316 16:20:56.926520 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6z99g\" (UniqueName: \"kubernetes.io/projected/0deba017-f115-4b42-8695-63cbe951fb08-kube-api-access-6z99g\") pod \"cinder-51fc-account-create-update-8thf9\" (UID: \"0deba017-f115-4b42-8695-63cbe951fb08\") " pod="openstack-kuttl-tests/cinder-51fc-account-create-update-8thf9" Mar 16 16:20:56 crc kubenswrapper[5120]: I0316 16:20:56.929304 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-a8ac-account-create-update-98gk4" Mar 16 16:20:56 crc kubenswrapper[5120]: I0316 16:20:56.937298 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-db-secret\"" Mar 16 16:20:56 crc kubenswrapper[5120]: I0316 16:20:56.952314 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-a8ac-account-create-update-98gk4"] Mar 16 16:20:56 crc kubenswrapper[5120]: I0316 16:20:56.989824 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-pq7q8"] Mar 16 16:20:56 crc kubenswrapper[5120]: I0316 16:20:56.993954 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/75f1b7f4-9fac-4135-819b-8eab79df5cf9-combined-ca-bundle\") pod \"watcher-db-sync-tlbgk\" (UID: \"75f1b7f4-9fac-4135-819b-8eab79df5cf9\") " pod="openstack-kuttl-tests/watcher-db-sync-tlbgk" Mar 16 16:20:56 crc kubenswrapper[5120]: I0316 16:20:56.994007 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e9495774-461a-413a-97a3-d348c402a717-operator-scripts\") pod \"neutron-db-create-nvn6z\" (UID: \"e9495774-461a-413a-97a3-d348c402a717\") " pod="openstack-kuttl-tests/neutron-db-create-nvn6z" Mar 16 16:20:56 crc kubenswrapper[5120]: I0316 16:20:56.994075 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qvfjw\" (UniqueName: \"kubernetes.io/projected/e9495774-461a-413a-97a3-d348c402a717-kube-api-access-qvfjw\") pod \"neutron-db-create-nvn6z\" (UID: \"e9495774-461a-413a-97a3-d348c402a717\") " pod="openstack-kuttl-tests/neutron-db-create-nvn6z" Mar 16 16:20:56 crc kubenswrapper[5120]: I0316 16:20:56.994149 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqmrf\" (UniqueName: \"kubernetes.io/projected/8539dbb8-688e-4007-a0ed-268b58f3b39a-kube-api-access-tqmrf\") pod \"barbican-db-create-6wrmh\" (UID: \"8539dbb8-688e-4007-a0ed-268b58f3b39a\") " pod="openstack-kuttl-tests/barbican-db-create-6wrmh" Mar 16 16:20:56 crc kubenswrapper[5120]: I0316 16:20:56.994210 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/75f1b7f4-9fac-4135-819b-8eab79df5cf9-config-data\") pod \"watcher-db-sync-tlbgk\" (UID: \"75f1b7f4-9fac-4135-819b-8eab79df5cf9\") " pod="openstack-kuttl-tests/watcher-db-sync-tlbgk" Mar 16 16:20:56 crc kubenswrapper[5120]: I0316 16:20:56.994285 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/75f1b7f4-9fac-4135-819b-8eab79df5cf9-db-sync-config-data\") pod \"watcher-db-sync-tlbgk\" (UID: \"75f1b7f4-9fac-4135-819b-8eab79df5cf9\") " pod="openstack-kuttl-tests/watcher-db-sync-tlbgk" Mar 16 16:20:56 crc kubenswrapper[5120]: I0316 16:20:56.994411 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w2th8\" (UniqueName: \"kubernetes.io/projected/75f1b7f4-9fac-4135-819b-8eab79df5cf9-kube-api-access-w2th8\") pod \"watcher-db-sync-tlbgk\" (UID: \"75f1b7f4-9fac-4135-819b-8eab79df5cf9\") " pod="openstack-kuttl-tests/watcher-db-sync-tlbgk" Mar 16 16:20:56 crc kubenswrapper[5120]: I0316 16:20:56.994438 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8539dbb8-688e-4007-a0ed-268b58f3b39a-operator-scripts\") pod \"barbican-db-create-6wrmh\" (UID: \"8539dbb8-688e-4007-a0ed-268b58f3b39a\") " pod="openstack-kuttl-tests/barbican-db-create-6wrmh" Mar 16 16:20:57 crc kubenswrapper[5120]: I0316 16:20:56.995603 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e9495774-461a-413a-97a3-d348c402a717-operator-scripts\") pod \"neutron-db-create-nvn6z\" (UID: \"e9495774-461a-413a-97a3-d348c402a717\") " pod="openstack-kuttl-tests/neutron-db-create-nvn6z" Mar 16 16:20:57 crc kubenswrapper[5120]: I0316 16:20:57.009257 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-pq7q8" Mar 16 16:20:57 crc kubenswrapper[5120]: I0316 16:20:57.011222 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/75f1b7f4-9fac-4135-819b-8eab79df5cf9-config-data\") pod \"watcher-db-sync-tlbgk\" (UID: \"75f1b7f4-9fac-4135-819b-8eab79df5cf9\") " pod="openstack-kuttl-tests/watcher-db-sync-tlbgk" Mar 16 16:20:57 crc kubenswrapper[5120]: I0316 16:20:57.011294 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-pq7q8"] Mar 16 16:20:57 crc kubenswrapper[5120]: I0316 16:20:57.012648 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-scripts\"" Mar 16 16:20:57 crc kubenswrapper[5120]: I0316 16:20:57.014839 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/75f1b7f4-9fac-4135-819b-8eab79df5cf9-combined-ca-bundle\") pod \"watcher-db-sync-tlbgk\" (UID: \"75f1b7f4-9fac-4135-819b-8eab79df5cf9\") " pod="openstack-kuttl-tests/watcher-db-sync-tlbgk" Mar 16 16:20:57 crc kubenswrapper[5120]: I0316 16:20:57.015046 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/75f1b7f4-9fac-4135-819b-8eab79df5cf9-db-sync-config-data\") pod \"watcher-db-sync-tlbgk\" (UID: \"75f1b7f4-9fac-4135-819b-8eab79df5cf9\") " pod="openstack-kuttl-tests/watcher-db-sync-tlbgk" Mar 16 16:20:57 crc kubenswrapper[5120]: I0316 16:20:57.016185 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-config-data\"" Mar 16 16:20:57 crc kubenswrapper[5120]: I0316 16:20:57.016435 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone\"" Mar 16 16:20:57 crc kubenswrapper[5120]: I0316 16:20:57.017477 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-keystone-dockercfg-xwsqf\"" Mar 16 16:20:57 crc kubenswrapper[5120]: I0316 16:20:57.027658 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-da68-account-create-update-58v6p"] Mar 16 16:20:57 crc kubenswrapper[5120]: I0316 16:20:57.030906 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2th8\" (UniqueName: \"kubernetes.io/projected/75f1b7f4-9fac-4135-819b-8eab79df5cf9-kube-api-access-w2th8\") pod \"watcher-db-sync-tlbgk\" (UID: \"75f1b7f4-9fac-4135-819b-8eab79df5cf9\") " pod="openstack-kuttl-tests/watcher-db-sync-tlbgk" Mar 16 16:20:57 crc kubenswrapper[5120]: I0316 16:20:57.042534 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-da68-account-create-update-58v6p"] Mar 16 16:20:57 crc kubenswrapper[5120]: I0316 16:20:57.042649 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-da68-account-create-update-58v6p" Mar 16 16:20:57 crc kubenswrapper[5120]: I0316 16:20:57.052179 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-db-secret\"" Mar 16 16:20:57 crc kubenswrapper[5120]: I0316 16:20:57.061203 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvfjw\" (UniqueName: \"kubernetes.io/projected/e9495774-461a-413a-97a3-d348c402a717-kube-api-access-qvfjw\") pod \"neutron-db-create-nvn6z\" (UID: \"e9495774-461a-413a-97a3-d348c402a717\") " pod="openstack-kuttl-tests/neutron-db-create-nvn6z" Mar 16 16:20:57 crc kubenswrapper[5120]: I0316 16:20:57.074655 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/watcher-db-sync-tlbgk" Mar 16 16:20:57 crc kubenswrapper[5120]: I0316 16:20:57.077632 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-4w76w" Mar 16 16:20:57 crc kubenswrapper[5120]: I0316 16:20:57.083507 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-create-nvn6z" Mar 16 16:20:57 crc kubenswrapper[5120]: I0316 16:20:57.105990 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tqmrf\" (UniqueName: \"kubernetes.io/projected/8539dbb8-688e-4007-a0ed-268b58f3b39a-kube-api-access-tqmrf\") pod \"barbican-db-create-6wrmh\" (UID: \"8539dbb8-688e-4007-a0ed-268b58f3b39a\") " pod="openstack-kuttl-tests/barbican-db-create-6wrmh" Mar 16 16:20:57 crc kubenswrapper[5120]: I0316 16:20:57.106115 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d63757a1-dcb4-4951-a68e-6517bf529a8e-operator-scripts\") pod \"barbican-a8ac-account-create-update-98gk4\" (UID: \"d63757a1-dcb4-4951-a68e-6517bf529a8e\") " pod="openstack-kuttl-tests/barbican-a8ac-account-create-update-98gk4" Mar 16 16:20:57 crc kubenswrapper[5120]: I0316 16:20:57.106145 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3da68321-bcd7-4099-9782-fc28ba9a5a90-combined-ca-bundle\") pod \"keystone-db-sync-pq7q8\" (UID: \"3da68321-bcd7-4099-9782-fc28ba9a5a90\") " pod="openstack-kuttl-tests/keystone-db-sync-pq7q8" Mar 16 16:20:57 crc kubenswrapper[5120]: I0316 16:20:57.106161 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ml8h\" (UniqueName: \"kubernetes.io/projected/3da68321-bcd7-4099-9782-fc28ba9a5a90-kube-api-access-2ml8h\") pod \"keystone-db-sync-pq7q8\" (UID: \"3da68321-bcd7-4099-9782-fc28ba9a5a90\") " pod="openstack-kuttl-tests/keystone-db-sync-pq7q8" Mar 16 16:20:57 crc kubenswrapper[5120]: I0316 16:20:57.106225 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8539dbb8-688e-4007-a0ed-268b58f3b39a-operator-scripts\") pod \"barbican-db-create-6wrmh\" (UID: \"8539dbb8-688e-4007-a0ed-268b58f3b39a\") " pod="openstack-kuttl-tests/barbican-db-create-6wrmh" Mar 16 16:20:57 crc kubenswrapper[5120]: I0316 16:20:57.106258 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3da68321-bcd7-4099-9782-fc28ba9a5a90-config-data\") pod \"keystone-db-sync-pq7q8\" (UID: \"3da68321-bcd7-4099-9782-fc28ba9a5a90\") " pod="openstack-kuttl-tests/keystone-db-sync-pq7q8" Mar 16 16:20:57 crc kubenswrapper[5120]: I0316 16:20:57.106297 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c315e251-3560-4322-9350-b163fd772f38-operator-scripts\") pod \"neutron-da68-account-create-update-58v6p\" (UID: \"c315e251-3560-4322-9350-b163fd772f38\") " pod="openstack-kuttl-tests/neutron-da68-account-create-update-58v6p" Mar 16 16:20:57 crc kubenswrapper[5120]: I0316 16:20:57.106351 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xs4xw\" (UniqueName: \"kubernetes.io/projected/d63757a1-dcb4-4951-a68e-6517bf529a8e-kube-api-access-xs4xw\") pod \"barbican-a8ac-account-create-update-98gk4\" (UID: \"d63757a1-dcb4-4951-a68e-6517bf529a8e\") " pod="openstack-kuttl-tests/barbican-a8ac-account-create-update-98gk4" Mar 16 16:20:57 crc kubenswrapper[5120]: I0316 16:20:57.106412 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwzv5\" (UniqueName: \"kubernetes.io/projected/c315e251-3560-4322-9350-b163fd772f38-kube-api-access-xwzv5\") pod \"neutron-da68-account-create-update-58v6p\" (UID: \"c315e251-3560-4322-9350-b163fd772f38\") " pod="openstack-kuttl-tests/neutron-da68-account-create-update-58v6p" Mar 16 16:20:57 crc kubenswrapper[5120]: I0316 16:20:57.107095 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8539dbb8-688e-4007-a0ed-268b58f3b39a-operator-scripts\") pod \"barbican-db-create-6wrmh\" (UID: \"8539dbb8-688e-4007-a0ed-268b58f3b39a\") " pod="openstack-kuttl-tests/barbican-db-create-6wrmh" Mar 16 16:20:57 crc kubenswrapper[5120]: I0316 16:20:57.137179 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqmrf\" (UniqueName: \"kubernetes.io/projected/8539dbb8-688e-4007-a0ed-268b58f3b39a-kube-api-access-tqmrf\") pod \"barbican-db-create-6wrmh\" (UID: \"8539dbb8-688e-4007-a0ed-268b58f3b39a\") " pod="openstack-kuttl-tests/barbican-db-create-6wrmh" Mar 16 16:20:57 crc kubenswrapper[5120]: I0316 16:20:57.207139 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1b59d8b3-3000-4e61-8e3c-50df40fc5181-config\") pod \"1b59d8b3-3000-4e61-8e3c-50df40fc5181\" (UID: \"1b59d8b3-3000-4e61-8e3c-50df40fc5181\") " Mar 16 16:20:57 crc kubenswrapper[5120]: I0316 16:20:57.207279 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/1b59d8b3-3000-4e61-8e3c-50df40fc5181-dnsmasq-svc\") pod \"1b59d8b3-3000-4e61-8e3c-50df40fc5181\" (UID: \"1b59d8b3-3000-4e61-8e3c-50df40fc5181\") " Mar 16 16:20:57 crc kubenswrapper[5120]: I0316 16:20:57.207504 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j9ghw\" (UniqueName: \"kubernetes.io/projected/1b59d8b3-3000-4e61-8e3c-50df40fc5181-kube-api-access-j9ghw\") pod \"1b59d8b3-3000-4e61-8e3c-50df40fc5181\" (UID: \"1b59d8b3-3000-4e61-8e3c-50df40fc5181\") " Mar 16 16:20:57 crc kubenswrapper[5120]: I0316 16:20:57.207743 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xwzv5\" (UniqueName: \"kubernetes.io/projected/c315e251-3560-4322-9350-b163fd772f38-kube-api-access-xwzv5\") pod \"neutron-da68-account-create-update-58v6p\" (UID: \"c315e251-3560-4322-9350-b163fd772f38\") " pod="openstack-kuttl-tests/neutron-da68-account-create-update-58v6p" Mar 16 16:20:57 crc kubenswrapper[5120]: I0316 16:20:57.207885 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d63757a1-dcb4-4951-a68e-6517bf529a8e-operator-scripts\") pod \"barbican-a8ac-account-create-update-98gk4\" (UID: \"d63757a1-dcb4-4951-a68e-6517bf529a8e\") " pod="openstack-kuttl-tests/barbican-a8ac-account-create-update-98gk4" Mar 16 16:20:57 crc kubenswrapper[5120]: I0316 16:20:57.207910 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3da68321-bcd7-4099-9782-fc28ba9a5a90-combined-ca-bundle\") pod \"keystone-db-sync-pq7q8\" (UID: \"3da68321-bcd7-4099-9782-fc28ba9a5a90\") " pod="openstack-kuttl-tests/keystone-db-sync-pq7q8" Mar 16 16:20:57 crc kubenswrapper[5120]: I0316 16:20:57.207925 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2ml8h\" (UniqueName: \"kubernetes.io/projected/3da68321-bcd7-4099-9782-fc28ba9a5a90-kube-api-access-2ml8h\") pod \"keystone-db-sync-pq7q8\" (UID: \"3da68321-bcd7-4099-9782-fc28ba9a5a90\") " pod="openstack-kuttl-tests/keystone-db-sync-pq7q8" Mar 16 16:20:57 crc kubenswrapper[5120]: I0316 16:20:57.207984 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3da68321-bcd7-4099-9782-fc28ba9a5a90-config-data\") pod \"keystone-db-sync-pq7q8\" (UID: \"3da68321-bcd7-4099-9782-fc28ba9a5a90\") " pod="openstack-kuttl-tests/keystone-db-sync-pq7q8" Mar 16 16:20:57 crc kubenswrapper[5120]: I0316 16:20:57.208018 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c315e251-3560-4322-9350-b163fd772f38-operator-scripts\") pod \"neutron-da68-account-create-update-58v6p\" (UID: \"c315e251-3560-4322-9350-b163fd772f38\") " pod="openstack-kuttl-tests/neutron-da68-account-create-update-58v6p" Mar 16 16:20:57 crc kubenswrapper[5120]: I0316 16:20:57.208058 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xs4xw\" (UniqueName: \"kubernetes.io/projected/d63757a1-dcb4-4951-a68e-6517bf529a8e-kube-api-access-xs4xw\") pod \"barbican-a8ac-account-create-update-98gk4\" (UID: \"d63757a1-dcb4-4951-a68e-6517bf529a8e\") " pod="openstack-kuttl-tests/barbican-a8ac-account-create-update-98gk4" Mar 16 16:20:57 crc kubenswrapper[5120]: I0316 16:20:57.211468 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d63757a1-dcb4-4951-a68e-6517bf529a8e-operator-scripts\") pod \"barbican-a8ac-account-create-update-98gk4\" (UID: \"d63757a1-dcb4-4951-a68e-6517bf529a8e\") " pod="openstack-kuttl-tests/barbican-a8ac-account-create-update-98gk4" Mar 16 16:20:57 crc kubenswrapper[5120]: I0316 16:20:57.212574 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c315e251-3560-4322-9350-b163fd772f38-operator-scripts\") pod \"neutron-da68-account-create-update-58v6p\" (UID: \"c315e251-3560-4322-9350-b163fd772f38\") " pod="openstack-kuttl-tests/neutron-da68-account-create-update-58v6p" Mar 16 16:20:57 crc kubenswrapper[5120]: I0316 16:20:57.220309 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-51fc-account-create-update-8thf9" Mar 16 16:20:57 crc kubenswrapper[5120]: I0316 16:20:57.228373 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b59d8b3-3000-4e61-8e3c-50df40fc5181-kube-api-access-j9ghw" (OuterVolumeSpecName: "kube-api-access-j9ghw") pod "1b59d8b3-3000-4e61-8e3c-50df40fc5181" (UID: "1b59d8b3-3000-4e61-8e3c-50df40fc5181"). InnerVolumeSpecName "kube-api-access-j9ghw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:20:57 crc kubenswrapper[5120]: I0316 16:20:57.231541 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3da68321-bcd7-4099-9782-fc28ba9a5a90-combined-ca-bundle\") pod \"keystone-db-sync-pq7q8\" (UID: \"3da68321-bcd7-4099-9782-fc28ba9a5a90\") " pod="openstack-kuttl-tests/keystone-db-sync-pq7q8" Mar 16 16:20:57 crc kubenswrapper[5120]: I0316 16:20:57.245107 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwzv5\" (UniqueName: \"kubernetes.io/projected/c315e251-3560-4322-9350-b163fd772f38-kube-api-access-xwzv5\") pod \"neutron-da68-account-create-update-58v6p\" (UID: \"c315e251-3560-4322-9350-b163fd772f38\") " pod="openstack-kuttl-tests/neutron-da68-account-create-update-58v6p" Mar 16 16:20:57 crc kubenswrapper[5120]: I0316 16:20:57.245126 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ml8h\" (UniqueName: \"kubernetes.io/projected/3da68321-bcd7-4099-9782-fc28ba9a5a90-kube-api-access-2ml8h\") pod \"keystone-db-sync-pq7q8\" (UID: \"3da68321-bcd7-4099-9782-fc28ba9a5a90\") " pod="openstack-kuttl-tests/keystone-db-sync-pq7q8" Mar 16 16:20:57 crc kubenswrapper[5120]: I0316 16:20:57.245156 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xs4xw\" (UniqueName: \"kubernetes.io/projected/d63757a1-dcb4-4951-a68e-6517bf529a8e-kube-api-access-xs4xw\") pod \"barbican-a8ac-account-create-update-98gk4\" (UID: \"d63757a1-dcb4-4951-a68e-6517bf529a8e\") " pod="openstack-kuttl-tests/barbican-a8ac-account-create-update-98gk4" Mar 16 16:20:57 crc kubenswrapper[5120]: I0316 16:20:57.246143 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3da68321-bcd7-4099-9782-fc28ba9a5a90-config-data\") pod \"keystone-db-sync-pq7q8\" (UID: \"3da68321-bcd7-4099-9782-fc28ba9a5a90\") " pod="openstack-kuttl-tests/keystone-db-sync-pq7q8" Mar 16 16:20:57 crc kubenswrapper[5120]: I0316 16:20:57.276726 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1b59d8b3-3000-4e61-8e3c-50df40fc5181-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "1b59d8b3-3000-4e61-8e3c-50df40fc5181" (UID: "1b59d8b3-3000-4e61-8e3c-50df40fc5181"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:20:57 crc kubenswrapper[5120]: I0316 16:20:57.282236 5120 generic.go:358] "Generic (PLEG): container finished" podID="1b59d8b3-3000-4e61-8e3c-50df40fc5181" containerID="85bbc914bacb73f33e0c57c0ebd483d60bcd0040127d7a501adf7eda67ad9d18" exitCode=0 Mar 16 16:20:57 crc kubenswrapper[5120]: I0316 16:20:57.282328 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-4w76w" Mar 16 16:20:57 crc kubenswrapper[5120]: I0316 16:20:57.282373 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-4w76w" event={"ID":"1b59d8b3-3000-4e61-8e3c-50df40fc5181","Type":"ContainerDied","Data":"85bbc914bacb73f33e0c57c0ebd483d60bcd0040127d7a501adf7eda67ad9d18"} Mar 16 16:20:57 crc kubenswrapper[5120]: I0316 16:20:57.282401 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-4w76w" event={"ID":"1b59d8b3-3000-4e61-8e3c-50df40fc5181","Type":"ContainerDied","Data":"22775bb5a4450f5b32c1502faed7b8606af805e3a0a4c3143d5f25a68739346d"} Mar 16 16:20:57 crc kubenswrapper[5120]: I0316 16:20:57.282418 5120 scope.go:117] "RemoveContainer" containerID="85bbc914bacb73f33e0c57c0ebd483d60bcd0040127d7a501adf7eda67ad9d18" Mar 16 16:20:57 crc kubenswrapper[5120]: I0316 16:20:57.286066 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1b59d8b3-3000-4e61-8e3c-50df40fc5181-config" (OuterVolumeSpecName: "config") pod "1b59d8b3-3000-4e61-8e3c-50df40fc5181" (UID: "1b59d8b3-3000-4e61-8e3c-50df40fc5181"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:20:57 crc kubenswrapper[5120]: I0316 16:20:57.294996 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-create-6wrmh" Mar 16 16:20:57 crc kubenswrapper[5120]: I0316 16:20:57.311775 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-a8ac-account-create-update-98gk4" Mar 16 16:20:57 crc kubenswrapper[5120]: I0316 16:20:57.312855 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1b59d8b3-3000-4e61-8e3c-50df40fc5181-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:20:57 crc kubenswrapper[5120]: I0316 16:20:57.312885 5120 reconciler_common.go:299] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/1b59d8b3-3000-4e61-8e3c-50df40fc5181-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Mar 16 16:20:57 crc kubenswrapper[5120]: I0316 16:20:57.312896 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j9ghw\" (UniqueName: \"kubernetes.io/projected/1b59d8b3-3000-4e61-8e3c-50df40fc5181-kube-api-access-j9ghw\") on node \"crc\" DevicePath \"\"" Mar 16 16:20:57 crc kubenswrapper[5120]: I0316 16:20:57.313965 5120 scope.go:117] "RemoveContainer" containerID="f8f27d1c83638d0fcabbe5c220bd622f1bb404a1a0701d2905d1bb94f79658f5" Mar 16 16:20:57 crc kubenswrapper[5120]: I0316 16:20:57.387721 5120 scope.go:117] "RemoveContainer" containerID="85bbc914bacb73f33e0c57c0ebd483d60bcd0040127d7a501adf7eda67ad9d18" Mar 16 16:20:57 crc kubenswrapper[5120]: E0316 16:20:57.388172 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"85bbc914bacb73f33e0c57c0ebd483d60bcd0040127d7a501adf7eda67ad9d18\": container with ID starting with 85bbc914bacb73f33e0c57c0ebd483d60bcd0040127d7a501adf7eda67ad9d18 not found: ID does not exist" containerID="85bbc914bacb73f33e0c57c0ebd483d60bcd0040127d7a501adf7eda67ad9d18" Mar 16 16:20:57 crc kubenswrapper[5120]: I0316 16:20:57.388212 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85bbc914bacb73f33e0c57c0ebd483d60bcd0040127d7a501adf7eda67ad9d18"} err="failed to get container status \"85bbc914bacb73f33e0c57c0ebd483d60bcd0040127d7a501adf7eda67ad9d18\": rpc error: code = NotFound desc = could not find container \"85bbc914bacb73f33e0c57c0ebd483d60bcd0040127d7a501adf7eda67ad9d18\": container with ID starting with 85bbc914bacb73f33e0c57c0ebd483d60bcd0040127d7a501adf7eda67ad9d18 not found: ID does not exist" Mar 16 16:20:57 crc kubenswrapper[5120]: I0316 16:20:57.388239 5120 scope.go:117] "RemoveContainer" containerID="f8f27d1c83638d0fcabbe5c220bd622f1bb404a1a0701d2905d1bb94f79658f5" Mar 16 16:20:57 crc kubenswrapper[5120]: E0316 16:20:57.388715 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f8f27d1c83638d0fcabbe5c220bd622f1bb404a1a0701d2905d1bb94f79658f5\": container with ID starting with f8f27d1c83638d0fcabbe5c220bd622f1bb404a1a0701d2905d1bb94f79658f5 not found: ID does not exist" containerID="f8f27d1c83638d0fcabbe5c220bd622f1bb404a1a0701d2905d1bb94f79658f5" Mar 16 16:20:57 crc kubenswrapper[5120]: I0316 16:20:57.388738 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8f27d1c83638d0fcabbe5c220bd622f1bb404a1a0701d2905d1bb94f79658f5"} err="failed to get container status \"f8f27d1c83638d0fcabbe5c220bd622f1bb404a1a0701d2905d1bb94f79658f5\": rpc error: code = NotFound desc = could not find container \"f8f27d1c83638d0fcabbe5c220bd622f1bb404a1a0701d2905d1bb94f79658f5\": container with ID starting with f8f27d1c83638d0fcabbe5c220bd622f1bb404a1a0701d2905d1bb94f79658f5 not found: ID does not exist" Mar 16 16:20:57 crc kubenswrapper[5120]: I0316 16:20:57.412085 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-pq7q8" Mar 16 16:20:57 crc kubenswrapper[5120]: I0316 16:20:57.425900 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-da68-account-create-update-58v6p" Mar 16 16:20:57 crc kubenswrapper[5120]: I0316 16:20:57.443858 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-db-create-hblb6"] Mar 16 16:20:57 crc kubenswrapper[5120]: I0316 16:20:57.628663 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-4w76w"] Mar 16 16:20:57 crc kubenswrapper[5120]: I0316 16:20:57.636661 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-4w76w"] Mar 16 16:20:57 crc kubenswrapper[5120]: I0316 16:20:57.643154 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-db-create-nvn6z"] Mar 16 16:20:57 crc kubenswrapper[5120]: W0316 16:20:57.657417 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode9495774_461a_413a_97a3_d348c402a717.slice/crio-2e64e330d956a42445c16bfc4af41a1c0f9c984eda718ec5a3ea133b7b3c9bd0 WatchSource:0}: Error finding container 2e64e330d956a42445c16bfc4af41a1c0f9c984eda718ec5a3ea133b7b3c9bd0: Status 404 returned error can't find the container with id 2e64e330d956a42445c16bfc4af41a1c0f9c984eda718ec5a3ea133b7b3c9bd0 Mar 16 16:20:57 crc kubenswrapper[5120]: I0316 16:20:57.715978 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/watcher-db-sync-tlbgk"] Mar 16 16:20:57 crc kubenswrapper[5120]: I0316 16:20:57.844550 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-51fc-account-create-update-8thf9"] Mar 16 16:20:57 crc kubenswrapper[5120]: W0316 16:20:57.856507 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0deba017_f115_4b42_8695_63cbe951fb08.slice/crio-2808790676d04607c58fffb091b839440cd094bdd4b77ea9705ce641d46308d6 WatchSource:0}: Error finding container 2808790676d04607c58fffb091b839440cd094bdd4b77ea9705ce641d46308d6: Status 404 returned error can't find the container with id 2808790676d04607c58fffb091b839440cd094bdd4b77ea9705ce641d46308d6 Mar 16 16:20:57 crc kubenswrapper[5120]: I0316 16:20:57.939619 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-db-create-6wrmh"] Mar 16 16:20:57 crc kubenswrapper[5120]: W0316 16:20:57.947969 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8539dbb8_688e_4007_a0ed_268b58f3b39a.slice/crio-ed31f2a9ec0e4d80b85780744163aed6eb82d89fdc9dbe2d27fd547652aa2429 WatchSource:0}: Error finding container ed31f2a9ec0e4d80b85780744163aed6eb82d89fdc9dbe2d27fd547652aa2429: Status 404 returned error can't find the container with id ed31f2a9ec0e4d80b85780744163aed6eb82d89fdc9dbe2d27fd547652aa2429 Mar 16 16:20:58 crc kubenswrapper[5120]: I0316 16:20:58.049275 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-pq7q8"] Mar 16 16:20:58 crc kubenswrapper[5120]: I0316 16:20:58.056821 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-a8ac-account-create-update-98gk4"] Mar 16 16:20:58 crc kubenswrapper[5120]: I0316 16:20:58.177173 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-da68-account-create-update-58v6p"] Mar 16 16:20:58 crc kubenswrapper[5120]: I0316 16:20:58.297294 5120 generic.go:358] "Generic (PLEG): container finished" podID="e9495774-461a-413a-97a3-d348c402a717" containerID="101e7bf7aead3babee5e3fc458c097c94e1a0ac7926cd598c2f9ff7a49cc767f" exitCode=0 Mar 16 16:20:58 crc kubenswrapper[5120]: I0316 16:20:58.297533 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-create-nvn6z" event={"ID":"e9495774-461a-413a-97a3-d348c402a717","Type":"ContainerDied","Data":"101e7bf7aead3babee5e3fc458c097c94e1a0ac7926cd598c2f9ff7a49cc767f"} Mar 16 16:20:58 crc kubenswrapper[5120]: I0316 16:20:58.297575 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-create-nvn6z" event={"ID":"e9495774-461a-413a-97a3-d348c402a717","Type":"ContainerStarted","Data":"2e64e330d956a42445c16bfc4af41a1c0f9c984eda718ec5a3ea133b7b3c9bd0"} Mar 16 16:20:58 crc kubenswrapper[5120]: I0316 16:20:58.300259 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-da68-account-create-update-58v6p" event={"ID":"c315e251-3560-4322-9350-b163fd772f38","Type":"ContainerStarted","Data":"a4b1765cc4c3faf479d74f2f14602d6fb5b88276ce973fe38c77e2d89bde1e51"} Mar 16 16:20:58 crc kubenswrapper[5120]: I0316 16:20:58.302041 5120 generic.go:358] "Generic (PLEG): container finished" podID="0deba017-f115-4b42-8695-63cbe951fb08" containerID="5c0364e41c63bf0d8ed7a64ae86436707c5e76e490baa4f0457965e28504705c" exitCode=0 Mar 16 16:20:58 crc kubenswrapper[5120]: I0316 16:20:58.302213 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-51fc-account-create-update-8thf9" event={"ID":"0deba017-f115-4b42-8695-63cbe951fb08","Type":"ContainerDied","Data":"5c0364e41c63bf0d8ed7a64ae86436707c5e76e490baa4f0457965e28504705c"} Mar 16 16:20:58 crc kubenswrapper[5120]: I0316 16:20:58.302282 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-51fc-account-create-update-8thf9" event={"ID":"0deba017-f115-4b42-8695-63cbe951fb08","Type":"ContainerStarted","Data":"2808790676d04607c58fffb091b839440cd094bdd4b77ea9705ce641d46308d6"} Mar 16 16:20:58 crc kubenswrapper[5120]: I0316 16:20:58.303171 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/watcher-db-sync-tlbgk" event={"ID":"75f1b7f4-9fac-4135-819b-8eab79df5cf9","Type":"ContainerStarted","Data":"1945f3ecb15c8c8d42295da4b252af1f066fd07b5c2cea9778e5e414f531f180"} Mar 16 16:20:58 crc kubenswrapper[5120]: I0316 16:20:58.307265 5120 generic.go:358] "Generic (PLEG): container finished" podID="098bebf2-f1d9-4af9-a09c-10f7d6be8761" containerID="8a6ee3ca882a9586a3d9f41084e7384ef2ab1123a935e1e45a3d2c45a7e2b9fd" exitCode=0 Mar 16 16:20:58 crc kubenswrapper[5120]: I0316 16:20:58.307403 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-create-hblb6" event={"ID":"098bebf2-f1d9-4af9-a09c-10f7d6be8761","Type":"ContainerDied","Data":"8a6ee3ca882a9586a3d9f41084e7384ef2ab1123a935e1e45a3d2c45a7e2b9fd"} Mar 16 16:20:58 crc kubenswrapper[5120]: I0316 16:20:58.307438 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-create-hblb6" event={"ID":"098bebf2-f1d9-4af9-a09c-10f7d6be8761","Type":"ContainerStarted","Data":"dc183229c7d03903c579503551c5e2014aaef4c00da56d2e1a1e4075463ee975"} Mar 16 16:20:58 crc kubenswrapper[5120]: I0316 16:20:58.309578 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-pq7q8" event={"ID":"3da68321-bcd7-4099-9782-fc28ba9a5a90","Type":"ContainerStarted","Data":"de1a865384702a742cc4d20ef443ea06dad8d943f54ed62db47f01638c1f4aa5"} Mar 16 16:20:58 crc kubenswrapper[5120]: I0316 16:20:58.309617 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-pq7q8" event={"ID":"3da68321-bcd7-4099-9782-fc28ba9a5a90","Type":"ContainerStarted","Data":"1c275cb07e4f587154b6e18fc69ef86775bd927561ac5ff5dc8bac348ef42be0"} Mar 16 16:20:58 crc kubenswrapper[5120]: I0316 16:20:58.311854 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-create-6wrmh" event={"ID":"8539dbb8-688e-4007-a0ed-268b58f3b39a","Type":"ContainerStarted","Data":"be811c09ef39e9727c4c3efe23b19799fc17a15a1331470553b4fe9b5bd24323"} Mar 16 16:20:58 crc kubenswrapper[5120]: I0316 16:20:58.311889 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-create-6wrmh" event={"ID":"8539dbb8-688e-4007-a0ed-268b58f3b39a","Type":"ContainerStarted","Data":"ed31f2a9ec0e4d80b85780744163aed6eb82d89fdc9dbe2d27fd547652aa2429"} Mar 16 16:20:58 crc kubenswrapper[5120]: I0316 16:20:58.315987 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-a8ac-account-create-update-98gk4" event={"ID":"d63757a1-dcb4-4951-a68e-6517bf529a8e","Type":"ContainerStarted","Data":"349445cbd3dfee7c8b81b92374996f75bc712e1ba0143a36c567c6c5f97c3a1f"} Mar 16 16:20:58 crc kubenswrapper[5120]: I0316 16:20:58.316041 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-a8ac-account-create-update-98gk4" event={"ID":"d63757a1-dcb4-4951-a68e-6517bf529a8e","Type":"ContainerStarted","Data":"5ecc7e01be1c3e4532ae6191cadad53e470476054cd86421833fb5fc162f0f6d"} Mar 16 16:20:58 crc kubenswrapper[5120]: I0316 16:20:58.360118 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-db-sync-pq7q8" podStartSLOduration=2.360090758 podStartE2EDuration="2.360090758s" podCreationTimestamp="2026-03-16 16:20:56 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:20:58.350483341 +0000 UTC m=+2960.504414998" watchObservedRunningTime="2026-03-16 16:20:58.360090758 +0000 UTC m=+2960.514022435" Mar 16 16:20:58 crc kubenswrapper[5120]: I0316 16:20:58.383087 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-db-create-6wrmh" podStartSLOduration=2.383071833 podStartE2EDuration="2.383071833s" podCreationTimestamp="2026-03-16 16:20:56 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:20:58.379180138 +0000 UTC m=+2960.533111805" watchObservedRunningTime="2026-03-16 16:20:58.383071833 +0000 UTC m=+2960.537003490" Mar 16 16:20:58 crc kubenswrapper[5120]: I0316 16:20:58.402905 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-a8ac-account-create-update-98gk4" podStartSLOduration=2.402881962 podStartE2EDuration="2.402881962s" podCreationTimestamp="2026-03-16 16:20:56 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:20:58.393298827 +0000 UTC m=+2960.547230484" watchObservedRunningTime="2026-03-16 16:20:58.402881962 +0000 UTC m=+2960.556813619" Mar 16 16:20:58 crc kubenswrapper[5120]: I0316 16:20:58.678389 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1b59d8b3-3000-4e61-8e3c-50df40fc5181" path="/var/lib/kubelet/pods/1b59d8b3-3000-4e61-8e3c-50df40fc5181/volumes" Mar 16 16:20:59 crc kubenswrapper[5120]: I0316 16:20:59.333833 5120 generic.go:358] "Generic (PLEG): container finished" podID="8539dbb8-688e-4007-a0ed-268b58f3b39a" containerID="be811c09ef39e9727c4c3efe23b19799fc17a15a1331470553b4fe9b5bd24323" exitCode=0 Mar 16 16:20:59 crc kubenswrapper[5120]: I0316 16:20:59.333879 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-create-6wrmh" event={"ID":"8539dbb8-688e-4007-a0ed-268b58f3b39a","Type":"ContainerDied","Data":"be811c09ef39e9727c4c3efe23b19799fc17a15a1331470553b4fe9b5bd24323"} Mar 16 16:20:59 crc kubenswrapper[5120]: I0316 16:20:59.336650 5120 generic.go:358] "Generic (PLEG): container finished" podID="d63757a1-dcb4-4951-a68e-6517bf529a8e" containerID="349445cbd3dfee7c8b81b92374996f75bc712e1ba0143a36c567c6c5f97c3a1f" exitCode=0 Mar 16 16:20:59 crc kubenswrapper[5120]: I0316 16:20:59.336690 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-a8ac-account-create-update-98gk4" event={"ID":"d63757a1-dcb4-4951-a68e-6517bf529a8e","Type":"ContainerDied","Data":"349445cbd3dfee7c8b81b92374996f75bc712e1ba0143a36c567c6c5f97c3a1f"} Mar 16 16:20:59 crc kubenswrapper[5120]: I0316 16:20:59.340139 5120 generic.go:358] "Generic (PLEG): container finished" podID="c315e251-3560-4322-9350-b163fd772f38" containerID="c4cc64c99784d9578e1d73662999f12daacb9b8031f42c96f56295c15bcd7fb1" exitCode=0 Mar 16 16:20:59 crc kubenswrapper[5120]: I0316 16:20:59.340453 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-da68-account-create-update-58v6p" event={"ID":"c315e251-3560-4322-9350-b163fd772f38","Type":"ContainerDied","Data":"c4cc64c99784d9578e1d73662999f12daacb9b8031f42c96f56295c15bcd7fb1"} Mar 16 16:20:59 crc kubenswrapper[5120]: I0316 16:20:59.712797 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-create-hblb6" Mar 16 16:20:59 crc kubenswrapper[5120]: I0316 16:20:59.779670 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/098bebf2-f1d9-4af9-a09c-10f7d6be8761-operator-scripts\") pod \"098bebf2-f1d9-4af9-a09c-10f7d6be8761\" (UID: \"098bebf2-f1d9-4af9-a09c-10f7d6be8761\") " Mar 16 16:20:59 crc kubenswrapper[5120]: I0316 16:20:59.779820 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5rmvm\" (UniqueName: \"kubernetes.io/projected/098bebf2-f1d9-4af9-a09c-10f7d6be8761-kube-api-access-5rmvm\") pod \"098bebf2-f1d9-4af9-a09c-10f7d6be8761\" (UID: \"098bebf2-f1d9-4af9-a09c-10f7d6be8761\") " Mar 16 16:20:59 crc kubenswrapper[5120]: I0316 16:20:59.780183 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/098bebf2-f1d9-4af9-a09c-10f7d6be8761-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "098bebf2-f1d9-4af9-a09c-10f7d6be8761" (UID: "098bebf2-f1d9-4af9-a09c-10f7d6be8761"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:20:59 crc kubenswrapper[5120]: I0316 16:20:59.780625 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/098bebf2-f1d9-4af9-a09c-10f7d6be8761-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:20:59 crc kubenswrapper[5120]: I0316 16:20:59.786279 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/098bebf2-f1d9-4af9-a09c-10f7d6be8761-kube-api-access-5rmvm" (OuterVolumeSpecName: "kube-api-access-5rmvm") pod "098bebf2-f1d9-4af9-a09c-10f7d6be8761" (UID: "098bebf2-f1d9-4af9-a09c-10f7d6be8761"). InnerVolumeSpecName "kube-api-access-5rmvm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:20:59 crc kubenswrapper[5120]: I0316 16:20:59.840234 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-51fc-account-create-update-8thf9" Mar 16 16:20:59 crc kubenswrapper[5120]: I0316 16:20:59.845915 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-create-nvn6z" Mar 16 16:20:59 crc kubenswrapper[5120]: I0316 16:20:59.881557 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0deba017-f115-4b42-8695-63cbe951fb08-operator-scripts\") pod \"0deba017-f115-4b42-8695-63cbe951fb08\" (UID: \"0deba017-f115-4b42-8695-63cbe951fb08\") " Mar 16 16:20:59 crc kubenswrapper[5120]: I0316 16:20:59.882022 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e9495774-461a-413a-97a3-d348c402a717-operator-scripts\") pod \"e9495774-461a-413a-97a3-d348c402a717\" (UID: \"e9495774-461a-413a-97a3-d348c402a717\") " Mar 16 16:20:59 crc kubenswrapper[5120]: I0316 16:20:59.882104 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6z99g\" (UniqueName: \"kubernetes.io/projected/0deba017-f115-4b42-8695-63cbe951fb08-kube-api-access-6z99g\") pod \"0deba017-f115-4b42-8695-63cbe951fb08\" (UID: \"0deba017-f115-4b42-8695-63cbe951fb08\") " Mar 16 16:20:59 crc kubenswrapper[5120]: I0316 16:20:59.882175 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qvfjw\" (UniqueName: \"kubernetes.io/projected/e9495774-461a-413a-97a3-d348c402a717-kube-api-access-qvfjw\") pod \"e9495774-461a-413a-97a3-d348c402a717\" (UID: \"e9495774-461a-413a-97a3-d348c402a717\") " Mar 16 16:20:59 crc kubenswrapper[5120]: I0316 16:20:59.882543 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e9495774-461a-413a-97a3-d348c402a717-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "e9495774-461a-413a-97a3-d348c402a717" (UID: "e9495774-461a-413a-97a3-d348c402a717"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:20:59 crc kubenswrapper[5120]: I0316 16:20:59.882596 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5rmvm\" (UniqueName: \"kubernetes.io/projected/098bebf2-f1d9-4af9-a09c-10f7d6be8761-kube-api-access-5rmvm\") on node \"crc\" DevicePath \"\"" Mar 16 16:20:59 crc kubenswrapper[5120]: I0316 16:20:59.882629 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0deba017-f115-4b42-8695-63cbe951fb08-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "0deba017-f115-4b42-8695-63cbe951fb08" (UID: "0deba017-f115-4b42-8695-63cbe951fb08"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:20:59 crc kubenswrapper[5120]: I0316 16:20:59.894311 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0deba017-f115-4b42-8695-63cbe951fb08-kube-api-access-6z99g" (OuterVolumeSpecName: "kube-api-access-6z99g") pod "0deba017-f115-4b42-8695-63cbe951fb08" (UID: "0deba017-f115-4b42-8695-63cbe951fb08"). InnerVolumeSpecName "kube-api-access-6z99g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:20:59 crc kubenswrapper[5120]: I0316 16:20:59.895924 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9495774-461a-413a-97a3-d348c402a717-kube-api-access-qvfjw" (OuterVolumeSpecName: "kube-api-access-qvfjw") pod "e9495774-461a-413a-97a3-d348c402a717" (UID: "e9495774-461a-413a-97a3-d348c402a717"). InnerVolumeSpecName "kube-api-access-qvfjw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:20:59 crc kubenswrapper[5120]: I0316 16:20:59.985350 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e9495774-461a-413a-97a3-d348c402a717-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:20:59 crc kubenswrapper[5120]: I0316 16:20:59.985388 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6z99g\" (UniqueName: \"kubernetes.io/projected/0deba017-f115-4b42-8695-63cbe951fb08-kube-api-access-6z99g\") on node \"crc\" DevicePath \"\"" Mar 16 16:20:59 crc kubenswrapper[5120]: I0316 16:20:59.985400 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qvfjw\" (UniqueName: \"kubernetes.io/projected/e9495774-461a-413a-97a3-d348c402a717-kube-api-access-qvfjw\") on node \"crc\" DevicePath \"\"" Mar 16 16:20:59 crc kubenswrapper[5120]: I0316 16:20:59.985409 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0deba017-f115-4b42-8695-63cbe951fb08-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:21:00 crc kubenswrapper[5120]: I0316 16:21:00.351860 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-51fc-account-create-update-8thf9" event={"ID":"0deba017-f115-4b42-8695-63cbe951fb08","Type":"ContainerDied","Data":"2808790676d04607c58fffb091b839440cd094bdd4b77ea9705ce641d46308d6"} Mar 16 16:21:00 crc kubenswrapper[5120]: I0316 16:21:00.351890 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-51fc-account-create-update-8thf9" Mar 16 16:21:00 crc kubenswrapper[5120]: I0316 16:21:00.351898 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2808790676d04607c58fffb091b839440cd094bdd4b77ea9705ce641d46308d6" Mar 16 16:21:00 crc kubenswrapper[5120]: I0316 16:21:00.356415 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-create-hblb6" event={"ID":"098bebf2-f1d9-4af9-a09c-10f7d6be8761","Type":"ContainerDied","Data":"dc183229c7d03903c579503551c5e2014aaef4c00da56d2e1a1e4075463ee975"} Mar 16 16:21:00 crc kubenswrapper[5120]: I0316 16:21:00.356450 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dc183229c7d03903c579503551c5e2014aaef4c00da56d2e1a1e4075463ee975" Mar 16 16:21:00 crc kubenswrapper[5120]: I0316 16:21:00.356525 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-create-hblb6" Mar 16 16:21:00 crc kubenswrapper[5120]: I0316 16:21:00.360443 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-create-nvn6z" Mar 16 16:21:00 crc kubenswrapper[5120]: I0316 16:21:00.360648 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-create-nvn6z" event={"ID":"e9495774-461a-413a-97a3-d348c402a717","Type":"ContainerDied","Data":"2e64e330d956a42445c16bfc4af41a1c0f9c984eda718ec5a3ea133b7b3c9bd0"} Mar 16 16:21:00 crc kubenswrapper[5120]: I0316 16:21:00.360726 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2e64e330d956a42445c16bfc4af41a1c0f9c984eda718ec5a3ea133b7b3c9bd0" Mar 16 16:21:00 crc kubenswrapper[5120]: I0316 16:21:00.593175 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-da68-account-create-update-58v6p" Mar 16 16:21:00 crc kubenswrapper[5120]: I0316 16:21:00.698123 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c315e251-3560-4322-9350-b163fd772f38-operator-scripts\") pod \"c315e251-3560-4322-9350-b163fd772f38\" (UID: \"c315e251-3560-4322-9350-b163fd772f38\") " Mar 16 16:21:00 crc kubenswrapper[5120]: I0316 16:21:00.698445 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xwzv5\" (UniqueName: \"kubernetes.io/projected/c315e251-3560-4322-9350-b163fd772f38-kube-api-access-xwzv5\") pod \"c315e251-3560-4322-9350-b163fd772f38\" (UID: \"c315e251-3560-4322-9350-b163fd772f38\") " Mar 16 16:21:00 crc kubenswrapper[5120]: I0316 16:21:00.699702 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c315e251-3560-4322-9350-b163fd772f38-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "c315e251-3560-4322-9350-b163fd772f38" (UID: "c315e251-3560-4322-9350-b163fd772f38"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:21:00 crc kubenswrapper[5120]: I0316 16:21:00.706910 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c315e251-3560-4322-9350-b163fd772f38-kube-api-access-xwzv5" (OuterVolumeSpecName: "kube-api-access-xwzv5") pod "c315e251-3560-4322-9350-b163fd772f38" (UID: "c315e251-3560-4322-9350-b163fd772f38"). InnerVolumeSpecName "kube-api-access-xwzv5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:21:00 crc kubenswrapper[5120]: I0316 16:21:00.801729 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c315e251-3560-4322-9350-b163fd772f38-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:21:00 crc kubenswrapper[5120]: I0316 16:21:00.801784 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xwzv5\" (UniqueName: \"kubernetes.io/projected/c315e251-3560-4322-9350-b163fd772f38-kube-api-access-xwzv5\") on node \"crc\" DevicePath \"\"" Mar 16 16:21:01 crc kubenswrapper[5120]: I0316 16:21:01.371839 5120 generic.go:358] "Generic (PLEG): container finished" podID="3da68321-bcd7-4099-9782-fc28ba9a5a90" containerID="de1a865384702a742cc4d20ef443ea06dad8d943f54ed62db47f01638c1f4aa5" exitCode=0 Mar 16 16:21:01 crc kubenswrapper[5120]: I0316 16:21:01.372013 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-pq7q8" event={"ID":"3da68321-bcd7-4099-9782-fc28ba9a5a90","Type":"ContainerDied","Data":"de1a865384702a742cc4d20ef443ea06dad8d943f54ed62db47f01638c1f4aa5"} Mar 16 16:21:01 crc kubenswrapper[5120]: I0316 16:21:01.374602 5120 generic.go:358] "Generic (PLEG): container finished" podID="436edb75-475a-4096-a9c9-bf235fc92d9c" containerID="9502739a7d25d2137566dcf525619e40c2aee690dead067c34fdb4a1fc4f0c13" exitCode=0 Mar 16 16:21:01 crc kubenswrapper[5120]: I0316 16:21:01.374644 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/prometheus-metric-storage-0" event={"ID":"436edb75-475a-4096-a9c9-bf235fc92d9c","Type":"ContainerDied","Data":"9502739a7d25d2137566dcf525619e40c2aee690dead067c34fdb4a1fc4f0c13"} Mar 16 16:21:01 crc kubenswrapper[5120]: I0316 16:21:01.377980 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-da68-account-create-update-58v6p" event={"ID":"c315e251-3560-4322-9350-b163fd772f38","Type":"ContainerDied","Data":"a4b1765cc4c3faf479d74f2f14602d6fb5b88276ce973fe38c77e2d89bde1e51"} Mar 16 16:21:01 crc kubenswrapper[5120]: I0316 16:21:01.378022 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a4b1765cc4c3faf479d74f2f14602d6fb5b88276ce973fe38c77e2d89bde1e51" Mar 16 16:21:01 crc kubenswrapper[5120]: I0316 16:21:01.378077 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-da68-account-create-update-58v6p" Mar 16 16:21:02 crc kubenswrapper[5120]: I0316 16:21:02.873925 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-a8ac-account-create-update-98gk4" Mar 16 16:21:02 crc kubenswrapper[5120]: I0316 16:21:02.881059 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-pq7q8" Mar 16 16:21:02 crc kubenswrapper[5120]: I0316 16:21:02.942300 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3da68321-bcd7-4099-9782-fc28ba9a5a90-combined-ca-bundle\") pod \"3da68321-bcd7-4099-9782-fc28ba9a5a90\" (UID: \"3da68321-bcd7-4099-9782-fc28ba9a5a90\") " Mar 16 16:21:02 crc kubenswrapper[5120]: I0316 16:21:02.942381 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2ml8h\" (UniqueName: \"kubernetes.io/projected/3da68321-bcd7-4099-9782-fc28ba9a5a90-kube-api-access-2ml8h\") pod \"3da68321-bcd7-4099-9782-fc28ba9a5a90\" (UID: \"3da68321-bcd7-4099-9782-fc28ba9a5a90\") " Mar 16 16:21:02 crc kubenswrapper[5120]: I0316 16:21:02.943122 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3da68321-bcd7-4099-9782-fc28ba9a5a90-config-data\") pod \"3da68321-bcd7-4099-9782-fc28ba9a5a90\" (UID: \"3da68321-bcd7-4099-9782-fc28ba9a5a90\") " Mar 16 16:21:02 crc kubenswrapper[5120]: I0316 16:21:02.943306 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d63757a1-dcb4-4951-a68e-6517bf529a8e-operator-scripts\") pod \"d63757a1-dcb4-4951-a68e-6517bf529a8e\" (UID: \"d63757a1-dcb4-4951-a68e-6517bf529a8e\") " Mar 16 16:21:02 crc kubenswrapper[5120]: I0316 16:21:02.943344 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xs4xw\" (UniqueName: \"kubernetes.io/projected/d63757a1-dcb4-4951-a68e-6517bf529a8e-kube-api-access-xs4xw\") pod \"d63757a1-dcb4-4951-a68e-6517bf529a8e\" (UID: \"d63757a1-dcb4-4951-a68e-6517bf529a8e\") " Mar 16 16:21:02 crc kubenswrapper[5120]: I0316 16:21:02.944406 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d63757a1-dcb4-4951-a68e-6517bf529a8e-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "d63757a1-dcb4-4951-a68e-6517bf529a8e" (UID: "d63757a1-dcb4-4951-a68e-6517bf529a8e"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:21:02 crc kubenswrapper[5120]: I0316 16:21:02.954233 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d63757a1-dcb4-4951-a68e-6517bf529a8e-kube-api-access-xs4xw" (OuterVolumeSpecName: "kube-api-access-xs4xw") pod "d63757a1-dcb4-4951-a68e-6517bf529a8e" (UID: "d63757a1-dcb4-4951-a68e-6517bf529a8e"). InnerVolumeSpecName "kube-api-access-xs4xw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:21:02 crc kubenswrapper[5120]: I0316 16:21:02.963631 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3da68321-bcd7-4099-9782-fc28ba9a5a90-kube-api-access-2ml8h" (OuterVolumeSpecName: "kube-api-access-2ml8h") pod "3da68321-bcd7-4099-9782-fc28ba9a5a90" (UID: "3da68321-bcd7-4099-9782-fc28ba9a5a90"). InnerVolumeSpecName "kube-api-access-2ml8h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:21:03 crc kubenswrapper[5120]: I0316 16:21:03.002088 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3da68321-bcd7-4099-9782-fc28ba9a5a90-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "3da68321-bcd7-4099-9782-fc28ba9a5a90" (UID: "3da68321-bcd7-4099-9782-fc28ba9a5a90"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:21:03 crc kubenswrapper[5120]: I0316 16:21:03.024984 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3da68321-bcd7-4099-9782-fc28ba9a5a90-config-data" (OuterVolumeSpecName: "config-data") pod "3da68321-bcd7-4099-9782-fc28ba9a5a90" (UID: "3da68321-bcd7-4099-9782-fc28ba9a5a90"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:21:03 crc kubenswrapper[5120]: I0316 16:21:03.046361 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3da68321-bcd7-4099-9782-fc28ba9a5a90-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:21:03 crc kubenswrapper[5120]: I0316 16:21:03.046396 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d63757a1-dcb4-4951-a68e-6517bf529a8e-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:21:03 crc kubenswrapper[5120]: I0316 16:21:03.046413 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xs4xw\" (UniqueName: \"kubernetes.io/projected/d63757a1-dcb4-4951-a68e-6517bf529a8e-kube-api-access-xs4xw\") on node \"crc\" DevicePath \"\"" Mar 16 16:21:03 crc kubenswrapper[5120]: I0316 16:21:03.046427 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3da68321-bcd7-4099-9782-fc28ba9a5a90-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:21:03 crc kubenswrapper[5120]: I0316 16:21:03.046439 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2ml8h\" (UniqueName: \"kubernetes.io/projected/3da68321-bcd7-4099-9782-fc28ba9a5a90-kube-api-access-2ml8h\") on node \"crc\" DevicePath \"\"" Mar 16 16:21:03 crc kubenswrapper[5120]: I0316 16:21:03.400700 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-pq7q8" event={"ID":"3da68321-bcd7-4099-9782-fc28ba9a5a90","Type":"ContainerDied","Data":"1c275cb07e4f587154b6e18fc69ef86775bd927561ac5ff5dc8bac348ef42be0"} Mar 16 16:21:03 crc kubenswrapper[5120]: I0316 16:21:03.400751 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1c275cb07e4f587154b6e18fc69ef86775bd927561ac5ff5dc8bac348ef42be0" Mar 16 16:21:03 crc kubenswrapper[5120]: I0316 16:21:03.400817 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-pq7q8" Mar 16 16:21:03 crc kubenswrapper[5120]: I0316 16:21:03.411323 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-a8ac-account-create-update-98gk4" event={"ID":"d63757a1-dcb4-4951-a68e-6517bf529a8e","Type":"ContainerDied","Data":"5ecc7e01be1c3e4532ae6191cadad53e470476054cd86421833fb5fc162f0f6d"} Mar 16 16:21:03 crc kubenswrapper[5120]: I0316 16:21:03.413870 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5ecc7e01be1c3e4532ae6191cadad53e470476054cd86421833fb5fc162f0f6d" Mar 16 16:21:03 crc kubenswrapper[5120]: I0316 16:21:03.414199 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-a8ac-account-create-update-98gk4" Mar 16 16:21:03 crc kubenswrapper[5120]: I0316 16:21:03.622734 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-k6l62"] Mar 16 16:21:03 crc kubenswrapper[5120]: I0316 16:21:03.624363 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d63757a1-dcb4-4951-a68e-6517bf529a8e" containerName="mariadb-account-create-update" Mar 16 16:21:03 crc kubenswrapper[5120]: I0316 16:21:03.624382 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="d63757a1-dcb4-4951-a68e-6517bf529a8e" containerName="mariadb-account-create-update" Mar 16 16:21:03 crc kubenswrapper[5120]: I0316 16:21:03.624397 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3da68321-bcd7-4099-9782-fc28ba9a5a90" containerName="keystone-db-sync" Mar 16 16:21:03 crc kubenswrapper[5120]: I0316 16:21:03.624403 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="3da68321-bcd7-4099-9782-fc28ba9a5a90" containerName="keystone-db-sync" Mar 16 16:21:03 crc kubenswrapper[5120]: I0316 16:21:03.624416 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b59d8b3-3000-4e61-8e3c-50df40fc5181" containerName="dnsmasq-dns" Mar 16 16:21:03 crc kubenswrapper[5120]: I0316 16:21:03.624422 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b59d8b3-3000-4e61-8e3c-50df40fc5181" containerName="dnsmasq-dns" Mar 16 16:21:03 crc kubenswrapper[5120]: I0316 16:21:03.624434 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="098bebf2-f1d9-4af9-a09c-10f7d6be8761" containerName="mariadb-database-create" Mar 16 16:21:03 crc kubenswrapper[5120]: I0316 16:21:03.624440 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="098bebf2-f1d9-4af9-a09c-10f7d6be8761" containerName="mariadb-database-create" Mar 16 16:21:03 crc kubenswrapper[5120]: I0316 16:21:03.624462 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9495774-461a-413a-97a3-d348c402a717" containerName="mariadb-database-create" Mar 16 16:21:03 crc kubenswrapper[5120]: I0316 16:21:03.624467 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9495774-461a-413a-97a3-d348c402a717" containerName="mariadb-database-create" Mar 16 16:21:03 crc kubenswrapper[5120]: I0316 16:21:03.624484 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0deba017-f115-4b42-8695-63cbe951fb08" containerName="mariadb-account-create-update" Mar 16 16:21:03 crc kubenswrapper[5120]: I0316 16:21:03.624489 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="0deba017-f115-4b42-8695-63cbe951fb08" containerName="mariadb-account-create-update" Mar 16 16:21:03 crc kubenswrapper[5120]: I0316 16:21:03.624497 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b59d8b3-3000-4e61-8e3c-50df40fc5181" containerName="init" Mar 16 16:21:03 crc kubenswrapper[5120]: I0316 16:21:03.624504 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b59d8b3-3000-4e61-8e3c-50df40fc5181" containerName="init" Mar 16 16:21:03 crc kubenswrapper[5120]: I0316 16:21:03.624528 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c315e251-3560-4322-9350-b163fd772f38" containerName="mariadb-account-create-update" Mar 16 16:21:03 crc kubenswrapper[5120]: I0316 16:21:03.624535 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c315e251-3560-4322-9350-b163fd772f38" containerName="mariadb-account-create-update" Mar 16 16:21:03 crc kubenswrapper[5120]: I0316 16:21:03.624670 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c315e251-3560-4322-9350-b163fd772f38" containerName="mariadb-account-create-update" Mar 16 16:21:03 crc kubenswrapper[5120]: I0316 16:21:03.624682 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="d63757a1-dcb4-4951-a68e-6517bf529a8e" containerName="mariadb-account-create-update" Mar 16 16:21:03 crc kubenswrapper[5120]: I0316 16:21:03.624693 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="3da68321-bcd7-4099-9782-fc28ba9a5a90" containerName="keystone-db-sync" Mar 16 16:21:03 crc kubenswrapper[5120]: I0316 16:21:03.624705 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e9495774-461a-413a-97a3-d348c402a717" containerName="mariadb-database-create" Mar 16 16:21:03 crc kubenswrapper[5120]: I0316 16:21:03.624714 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="098bebf2-f1d9-4af9-a09c-10f7d6be8761" containerName="mariadb-database-create" Mar 16 16:21:03 crc kubenswrapper[5120]: I0316 16:21:03.624722 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="0deba017-f115-4b42-8695-63cbe951fb08" containerName="mariadb-account-create-update" Mar 16 16:21:03 crc kubenswrapper[5120]: I0316 16:21:03.624732 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1b59d8b3-3000-4e61-8e3c-50df40fc5181" containerName="dnsmasq-dns" Mar 16 16:21:03 crc kubenswrapper[5120]: I0316 16:21:03.630526 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-k6l62" Mar 16 16:21:03 crc kubenswrapper[5120]: I0316 16:21:03.635331 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-scripts\"" Mar 16 16:21:03 crc kubenswrapper[5120]: I0316 16:21:03.635437 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-keystone-dockercfg-xwsqf\"" Mar 16 16:21:03 crc kubenswrapper[5120]: I0316 16:21:03.635588 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone\"" Mar 16 16:21:03 crc kubenswrapper[5120]: I0316 16:21:03.635752 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"osp-secret\"" Mar 16 16:21:03 crc kubenswrapper[5120]: I0316 16:21:03.643534 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-config-data\"" Mar 16 16:21:03 crc kubenswrapper[5120]: I0316 16:21:03.653729 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-k6l62"] Mar 16 16:21:03 crc kubenswrapper[5120]: I0316 16:21:03.744772 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-d2k76"] Mar 16 16:21:03 crc kubenswrapper[5120]: I0316 16:21:03.754666 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-d2k76" Mar 16 16:21:03 crc kubenswrapper[5120]: I0316 16:21:03.765839 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/356bec90-b61f-42ca-85ea-9b25a263f3e5-config-data\") pod \"keystone-bootstrap-k6l62\" (UID: \"356bec90-b61f-42ca-85ea-9b25a263f3e5\") " pod="openstack-kuttl-tests/keystone-bootstrap-k6l62" Mar 16 16:21:03 crc kubenswrapper[5120]: I0316 16:21:03.765926 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/356bec90-b61f-42ca-85ea-9b25a263f3e5-combined-ca-bundle\") pod \"keystone-bootstrap-k6l62\" (UID: \"356bec90-b61f-42ca-85ea-9b25a263f3e5\") " pod="openstack-kuttl-tests/keystone-bootstrap-k6l62" Mar 16 16:21:03 crc kubenswrapper[5120]: I0316 16:21:03.765952 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/356bec90-b61f-42ca-85ea-9b25a263f3e5-credential-keys\") pod \"keystone-bootstrap-k6l62\" (UID: \"356bec90-b61f-42ca-85ea-9b25a263f3e5\") " pod="openstack-kuttl-tests/keystone-bootstrap-k6l62" Mar 16 16:21:03 crc kubenswrapper[5120]: I0316 16:21:03.765982 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/356bec90-b61f-42ca-85ea-9b25a263f3e5-fernet-keys\") pod \"keystone-bootstrap-k6l62\" (UID: \"356bec90-b61f-42ca-85ea-9b25a263f3e5\") " pod="openstack-kuttl-tests/keystone-bootstrap-k6l62" Mar 16 16:21:03 crc kubenswrapper[5120]: I0316 16:21:03.766016 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jppdf\" (UniqueName: \"kubernetes.io/projected/356bec90-b61f-42ca-85ea-9b25a263f3e5-kube-api-access-jppdf\") pod \"keystone-bootstrap-k6l62\" (UID: \"356bec90-b61f-42ca-85ea-9b25a263f3e5\") " pod="openstack-kuttl-tests/keystone-bootstrap-k6l62" Mar 16 16:21:03 crc kubenswrapper[5120]: I0316 16:21:03.766097 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/356bec90-b61f-42ca-85ea-9b25a263f3e5-scripts\") pod \"keystone-bootstrap-k6l62\" (UID: \"356bec90-b61f-42ca-85ea-9b25a263f3e5\") " pod="openstack-kuttl-tests/keystone-bootstrap-k6l62" Mar 16 16:21:03 crc kubenswrapper[5120]: I0316 16:21:03.768556 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-d2k76"] Mar 16 16:21:03 crc kubenswrapper[5120]: I0316 16:21:03.773767 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-config-data\"" Mar 16 16:21:03 crc kubenswrapper[5120]: I0316 16:21:03.773997 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-cinder-dockercfg-szxx6\"" Mar 16 16:21:03 crc kubenswrapper[5120]: I0316 16:21:03.774152 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-scripts\"" Mar 16 16:21:03 crc kubenswrapper[5120]: I0316 16:21:03.852334 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-db-sync-nwmkm"] Mar 16 16:21:03 crc kubenswrapper[5120]: I0316 16:21:03.871475 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c2b81fed-a0a9-44aa-9d9e-ba21b827dc43-scripts\") pod \"cinder-db-sync-d2k76\" (UID: \"c2b81fed-a0a9-44aa-9d9e-ba21b827dc43\") " pod="openstack-kuttl-tests/cinder-db-sync-d2k76" Mar 16 16:21:03 crc kubenswrapper[5120]: I0316 16:21:03.871596 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/c2b81fed-a0a9-44aa-9d9e-ba21b827dc43-db-sync-config-data\") pod \"cinder-db-sync-d2k76\" (UID: \"c2b81fed-a0a9-44aa-9d9e-ba21b827dc43\") " pod="openstack-kuttl-tests/cinder-db-sync-d2k76" Mar 16 16:21:03 crc kubenswrapper[5120]: I0316 16:21:03.871660 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/356bec90-b61f-42ca-85ea-9b25a263f3e5-config-data\") pod \"keystone-bootstrap-k6l62\" (UID: \"356bec90-b61f-42ca-85ea-9b25a263f3e5\") " pod="openstack-kuttl-tests/keystone-bootstrap-k6l62" Mar 16 16:21:03 crc kubenswrapper[5120]: I0316 16:21:03.871721 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c2b81fed-a0a9-44aa-9d9e-ba21b827dc43-config-data\") pod \"cinder-db-sync-d2k76\" (UID: \"c2b81fed-a0a9-44aa-9d9e-ba21b827dc43\") " pod="openstack-kuttl-tests/cinder-db-sync-d2k76" Mar 16 16:21:03 crc kubenswrapper[5120]: I0316 16:21:03.871771 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/356bec90-b61f-42ca-85ea-9b25a263f3e5-combined-ca-bundle\") pod \"keystone-bootstrap-k6l62\" (UID: \"356bec90-b61f-42ca-85ea-9b25a263f3e5\") " pod="openstack-kuttl-tests/keystone-bootstrap-k6l62" Mar 16 16:21:03 crc kubenswrapper[5120]: I0316 16:21:03.871795 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/356bec90-b61f-42ca-85ea-9b25a263f3e5-credential-keys\") pod \"keystone-bootstrap-k6l62\" (UID: \"356bec90-b61f-42ca-85ea-9b25a263f3e5\") " pod="openstack-kuttl-tests/keystone-bootstrap-k6l62" Mar 16 16:21:03 crc kubenswrapper[5120]: I0316 16:21:03.871830 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zp7n\" (UniqueName: \"kubernetes.io/projected/c2b81fed-a0a9-44aa-9d9e-ba21b827dc43-kube-api-access-8zp7n\") pod \"cinder-db-sync-d2k76\" (UID: \"c2b81fed-a0a9-44aa-9d9e-ba21b827dc43\") " pod="openstack-kuttl-tests/cinder-db-sync-d2k76" Mar 16 16:21:03 crc kubenswrapper[5120]: I0316 16:21:03.871858 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/356bec90-b61f-42ca-85ea-9b25a263f3e5-fernet-keys\") pod \"keystone-bootstrap-k6l62\" (UID: \"356bec90-b61f-42ca-85ea-9b25a263f3e5\") " pod="openstack-kuttl-tests/keystone-bootstrap-k6l62" Mar 16 16:21:03 crc kubenswrapper[5120]: I0316 16:21:03.872084 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jppdf\" (UniqueName: \"kubernetes.io/projected/356bec90-b61f-42ca-85ea-9b25a263f3e5-kube-api-access-jppdf\") pod \"keystone-bootstrap-k6l62\" (UID: \"356bec90-b61f-42ca-85ea-9b25a263f3e5\") " pod="openstack-kuttl-tests/keystone-bootstrap-k6l62" Mar 16 16:21:03 crc kubenswrapper[5120]: I0316 16:21:03.878204 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c2b81fed-a0a9-44aa-9d9e-ba21b827dc43-combined-ca-bundle\") pod \"cinder-db-sync-d2k76\" (UID: \"c2b81fed-a0a9-44aa-9d9e-ba21b827dc43\") " pod="openstack-kuttl-tests/cinder-db-sync-d2k76" Mar 16 16:21:03 crc kubenswrapper[5120]: I0316 16:21:03.879137 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/356bec90-b61f-42ca-85ea-9b25a263f3e5-scripts\") pod \"keystone-bootstrap-k6l62\" (UID: \"356bec90-b61f-42ca-85ea-9b25a263f3e5\") " pod="openstack-kuttl-tests/keystone-bootstrap-k6l62" Mar 16 16:21:03 crc kubenswrapper[5120]: I0316 16:21:03.880025 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/c2b81fed-a0a9-44aa-9d9e-ba21b827dc43-etc-machine-id\") pod \"cinder-db-sync-d2k76\" (UID: \"c2b81fed-a0a9-44aa-9d9e-ba21b827dc43\") " pod="openstack-kuttl-tests/cinder-db-sync-d2k76" Mar 16 16:21:03 crc kubenswrapper[5120]: I0316 16:21:03.880446 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/356bec90-b61f-42ca-85ea-9b25a263f3e5-combined-ca-bundle\") pod \"keystone-bootstrap-k6l62\" (UID: \"356bec90-b61f-42ca-85ea-9b25a263f3e5\") " pod="openstack-kuttl-tests/keystone-bootstrap-k6l62" Mar 16 16:21:03 crc kubenswrapper[5120]: I0316 16:21:03.884377 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/356bec90-b61f-42ca-85ea-9b25a263f3e5-fernet-keys\") pod \"keystone-bootstrap-k6l62\" (UID: \"356bec90-b61f-42ca-85ea-9b25a263f3e5\") " pod="openstack-kuttl-tests/keystone-bootstrap-k6l62" Mar 16 16:21:03 crc kubenswrapper[5120]: I0316 16:21:03.887482 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-vt87c"] Mar 16 16:21:03 crc kubenswrapper[5120]: I0316 16:21:03.888041 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-nwmkm" Mar 16 16:21:03 crc kubenswrapper[5120]: I0316 16:21:03.893332 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/356bec90-b61f-42ca-85ea-9b25a263f3e5-scripts\") pod \"keystone-bootstrap-k6l62\" (UID: \"356bec90-b61f-42ca-85ea-9b25a263f3e5\") " pod="openstack-kuttl-tests/keystone-bootstrap-k6l62" Mar 16 16:21:03 crc kubenswrapper[5120]: I0316 16:21:03.902703 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-nwmkm"] Mar 16 16:21:03 crc kubenswrapper[5120]: I0316 16:21:03.902871 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-vt87c" Mar 16 16:21:03 crc kubenswrapper[5120]: I0316 16:21:03.908083 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-scripts\"" Mar 16 16:21:03 crc kubenswrapper[5120]: I0316 16:21:03.908267 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-placement-dockercfg-ntdjh\"" Mar 16 16:21:03 crc kubenswrapper[5120]: I0316 16:21:03.908401 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-config-data\"" Mar 16 16:21:03 crc kubenswrapper[5120]: I0316 16:21:03.914842 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-httpd-config\"" Mar 16 16:21:03 crc kubenswrapper[5120]: I0316 16:21:03.915007 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-neutron-dockercfg-tsjtv\"" Mar 16 16:21:03 crc kubenswrapper[5120]: I0316 16:21:03.915191 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-config\"" Mar 16 16:21:03 crc kubenswrapper[5120]: I0316 16:21:03.915668 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/356bec90-b61f-42ca-85ea-9b25a263f3e5-credential-keys\") pod \"keystone-bootstrap-k6l62\" (UID: \"356bec90-b61f-42ca-85ea-9b25a263f3e5\") " pod="openstack-kuttl-tests/keystone-bootstrap-k6l62" Mar 16 16:21:03 crc kubenswrapper[5120]: I0316 16:21:03.915953 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/356bec90-b61f-42ca-85ea-9b25a263f3e5-config-data\") pod \"keystone-bootstrap-k6l62\" (UID: \"356bec90-b61f-42ca-85ea-9b25a263f3e5\") " pod="openstack-kuttl-tests/keystone-bootstrap-k6l62" Mar 16 16:21:03 crc kubenswrapper[5120]: I0316 16:21:03.929839 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-vt87c"] Mar 16 16:21:03 crc kubenswrapper[5120]: I0316 16:21:03.930069 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jppdf\" (UniqueName: \"kubernetes.io/projected/356bec90-b61f-42ca-85ea-9b25a263f3e5-kube-api-access-jppdf\") pod \"keystone-bootstrap-k6l62\" (UID: \"356bec90-b61f-42ca-85ea-9b25a263f3e5\") " pod="openstack-kuttl-tests/keystone-bootstrap-k6l62" Mar 16 16:21:03 crc kubenswrapper[5120]: I0316 16:21:03.955591 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:21:03 crc kubenswrapper[5120]: I0316 16:21:03.966635 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:21:03 crc kubenswrapper[5120]: I0316 16:21:03.966975 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:21:03 crc kubenswrapper[5120]: I0316 16:21:03.971799 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 16:21:03 crc kubenswrapper[5120]: I0316 16:21:03.972358 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-k6l62" Mar 16 16:21:03 crc kubenswrapper[5120]: I0316 16:21:03.972989 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 16:21:03 crc kubenswrapper[5120]: I0316 16:21:03.985162 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c2b81fed-a0a9-44aa-9d9e-ba21b827dc43-combined-ca-bundle\") pod \"cinder-db-sync-d2k76\" (UID: \"c2b81fed-a0a9-44aa-9d9e-ba21b827dc43\") " pod="openstack-kuttl-tests/cinder-db-sync-d2k76" Mar 16 16:21:03 crc kubenswrapper[5120]: I0316 16:21:03.987092 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4b4fb783-c7b1-4688-b793-d3ae04edc806-config\") pod \"neutron-db-sync-vt87c\" (UID: \"4b4fb783-c7b1-4688-b793-d3ae04edc806\") " pod="openstack-kuttl-tests/neutron-db-sync-vt87c" Mar 16 16:21:03 crc kubenswrapper[5120]: I0316 16:21:03.987316 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/395499e0-a2dc-4775-9dde-f66517d1d827-scripts\") pod \"placement-db-sync-nwmkm\" (UID: \"395499e0-a2dc-4775-9dde-f66517d1d827\") " pod="openstack-kuttl-tests/placement-db-sync-nwmkm" Mar 16 16:21:03 crc kubenswrapper[5120]: I0316 16:21:03.988634 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2b6st\" (UniqueName: \"kubernetes.io/projected/395499e0-a2dc-4775-9dde-f66517d1d827-kube-api-access-2b6st\") pod \"placement-db-sync-nwmkm\" (UID: \"395499e0-a2dc-4775-9dde-f66517d1d827\") " pod="openstack-kuttl-tests/placement-db-sync-nwmkm" Mar 16 16:21:03 crc kubenswrapper[5120]: I0316 16:21:03.989034 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c2b81fed-a0a9-44aa-9d9e-ba21b827dc43-combined-ca-bundle\") pod \"cinder-db-sync-d2k76\" (UID: \"c2b81fed-a0a9-44aa-9d9e-ba21b827dc43\") " pod="openstack-kuttl-tests/cinder-db-sync-d2k76" Mar 16 16:21:03 crc kubenswrapper[5120]: I0316 16:21:03.989305 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxjwv\" (UniqueName: \"kubernetes.io/projected/4b4fb783-c7b1-4688-b793-d3ae04edc806-kube-api-access-qxjwv\") pod \"neutron-db-sync-vt87c\" (UID: \"4b4fb783-c7b1-4688-b793-d3ae04edc806\") " pod="openstack-kuttl-tests/neutron-db-sync-vt87c" Mar 16 16:21:03 crc kubenswrapper[5120]: I0316 16:21:03.990029 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/395499e0-a2dc-4775-9dde-f66517d1d827-config-data\") pod \"placement-db-sync-nwmkm\" (UID: \"395499e0-a2dc-4775-9dde-f66517d1d827\") " pod="openstack-kuttl-tests/placement-db-sync-nwmkm" Mar 16 16:21:03 crc kubenswrapper[5120]: I0316 16:21:03.990888 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/c2b81fed-a0a9-44aa-9d9e-ba21b827dc43-etc-machine-id\") pod \"cinder-db-sync-d2k76\" (UID: \"c2b81fed-a0a9-44aa-9d9e-ba21b827dc43\") " pod="openstack-kuttl-tests/cinder-db-sync-d2k76" Mar 16 16:21:03 crc kubenswrapper[5120]: I0316 16:21:03.991069 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/c2b81fed-a0a9-44aa-9d9e-ba21b827dc43-etc-machine-id\") pod \"cinder-db-sync-d2k76\" (UID: \"c2b81fed-a0a9-44aa-9d9e-ba21b827dc43\") " pod="openstack-kuttl-tests/cinder-db-sync-d2k76" Mar 16 16:21:03 crc kubenswrapper[5120]: I0316 16:21:03.991575 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c2b81fed-a0a9-44aa-9d9e-ba21b827dc43-scripts\") pod \"cinder-db-sync-d2k76\" (UID: \"c2b81fed-a0a9-44aa-9d9e-ba21b827dc43\") " pod="openstack-kuttl-tests/cinder-db-sync-d2k76" Mar 16 16:21:03 crc kubenswrapper[5120]: I0316 16:21:03.991607 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/c2b81fed-a0a9-44aa-9d9e-ba21b827dc43-db-sync-config-data\") pod \"cinder-db-sync-d2k76\" (UID: \"c2b81fed-a0a9-44aa-9d9e-ba21b827dc43\") " pod="openstack-kuttl-tests/cinder-db-sync-d2k76" Mar 16 16:21:03 crc kubenswrapper[5120]: I0316 16:21:03.991660 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/395499e0-a2dc-4775-9dde-f66517d1d827-logs\") pod \"placement-db-sync-nwmkm\" (UID: \"395499e0-a2dc-4775-9dde-f66517d1d827\") " pod="openstack-kuttl-tests/placement-db-sync-nwmkm" Mar 16 16:21:03 crc kubenswrapper[5120]: I0316 16:21:03.991851 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c2b81fed-a0a9-44aa-9d9e-ba21b827dc43-config-data\") pod \"cinder-db-sync-d2k76\" (UID: \"c2b81fed-a0a9-44aa-9d9e-ba21b827dc43\") " pod="openstack-kuttl-tests/cinder-db-sync-d2k76" Mar 16 16:21:03 crc kubenswrapper[5120]: I0316 16:21:03.991996 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4b4fb783-c7b1-4688-b793-d3ae04edc806-combined-ca-bundle\") pod \"neutron-db-sync-vt87c\" (UID: \"4b4fb783-c7b1-4688-b793-d3ae04edc806\") " pod="openstack-kuttl-tests/neutron-db-sync-vt87c" Mar 16 16:21:03 crc kubenswrapper[5120]: I0316 16:21:03.992056 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8zp7n\" (UniqueName: \"kubernetes.io/projected/c2b81fed-a0a9-44aa-9d9e-ba21b827dc43-kube-api-access-8zp7n\") pod \"cinder-db-sync-d2k76\" (UID: \"c2b81fed-a0a9-44aa-9d9e-ba21b827dc43\") " pod="openstack-kuttl-tests/cinder-db-sync-d2k76" Mar 16 16:21:03 crc kubenswrapper[5120]: I0316 16:21:03.992083 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/395499e0-a2dc-4775-9dde-f66517d1d827-combined-ca-bundle\") pod \"placement-db-sync-nwmkm\" (UID: \"395499e0-a2dc-4775-9dde-f66517d1d827\") " pod="openstack-kuttl-tests/placement-db-sync-nwmkm" Mar 16 16:21:03 crc kubenswrapper[5120]: I0316 16:21:03.998664 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c2b81fed-a0a9-44aa-9d9e-ba21b827dc43-scripts\") pod \"cinder-db-sync-d2k76\" (UID: \"c2b81fed-a0a9-44aa-9d9e-ba21b827dc43\") " pod="openstack-kuttl-tests/cinder-db-sync-d2k76" Mar 16 16:21:04 crc kubenswrapper[5120]: I0316 16:21:04.014561 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/c2b81fed-a0a9-44aa-9d9e-ba21b827dc43-db-sync-config-data\") pod \"cinder-db-sync-d2k76\" (UID: \"c2b81fed-a0a9-44aa-9d9e-ba21b827dc43\") " pod="openstack-kuttl-tests/cinder-db-sync-d2k76" Mar 16 16:21:04 crc kubenswrapper[5120]: I0316 16:21:04.015291 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c2b81fed-a0a9-44aa-9d9e-ba21b827dc43-config-data\") pod \"cinder-db-sync-d2k76\" (UID: \"c2b81fed-a0a9-44aa-9d9e-ba21b827dc43\") " pod="openstack-kuttl-tests/cinder-db-sync-d2k76" Mar 16 16:21:04 crc kubenswrapper[5120]: I0316 16:21:04.018217 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zp7n\" (UniqueName: \"kubernetes.io/projected/c2b81fed-a0a9-44aa-9d9e-ba21b827dc43-kube-api-access-8zp7n\") pod \"cinder-db-sync-d2k76\" (UID: \"c2b81fed-a0a9-44aa-9d9e-ba21b827dc43\") " pod="openstack-kuttl-tests/cinder-db-sync-d2k76" Mar 16 16:21:04 crc kubenswrapper[5120]: I0316 16:21:04.094261 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4b4fb783-c7b1-4688-b793-d3ae04edc806-combined-ca-bundle\") pod \"neutron-db-sync-vt87c\" (UID: \"4b4fb783-c7b1-4688-b793-d3ae04edc806\") " pod="openstack-kuttl-tests/neutron-db-sync-vt87c" Mar 16 16:21:04 crc kubenswrapper[5120]: I0316 16:21:04.094357 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/395499e0-a2dc-4775-9dde-f66517d1d827-combined-ca-bundle\") pod \"placement-db-sync-nwmkm\" (UID: \"395499e0-a2dc-4775-9dde-f66517d1d827\") " pod="openstack-kuttl-tests/placement-db-sync-nwmkm" Mar 16 16:21:04 crc kubenswrapper[5120]: I0316 16:21:04.094404 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1e1d9ac4-3b31-4a4e-8930-42f2670838be-log-httpd\") pod \"ceilometer-0\" (UID: \"1e1d9ac4-3b31-4a4e-8930-42f2670838be\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:21:04 crc kubenswrapper[5120]: I0316 16:21:04.094456 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1e1d9ac4-3b31-4a4e-8930-42f2670838be-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"1e1d9ac4-3b31-4a4e-8930-42f2670838be\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:21:04 crc kubenswrapper[5120]: I0316 16:21:04.094538 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4b4fb783-c7b1-4688-b793-d3ae04edc806-config\") pod \"neutron-db-sync-vt87c\" (UID: \"4b4fb783-c7b1-4688-b793-d3ae04edc806\") " pod="openstack-kuttl-tests/neutron-db-sync-vt87c" Mar 16 16:21:04 crc kubenswrapper[5120]: I0316 16:21:04.094573 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/395499e0-a2dc-4775-9dde-f66517d1d827-scripts\") pod \"placement-db-sync-nwmkm\" (UID: \"395499e0-a2dc-4775-9dde-f66517d1d827\") " pod="openstack-kuttl-tests/placement-db-sync-nwmkm" Mar 16 16:21:04 crc kubenswrapper[5120]: I0316 16:21:04.094643 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1e1d9ac4-3b31-4a4e-8930-42f2670838be-scripts\") pod \"ceilometer-0\" (UID: \"1e1d9ac4-3b31-4a4e-8930-42f2670838be\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:21:04 crc kubenswrapper[5120]: I0316 16:21:04.094679 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2b6st\" (UniqueName: \"kubernetes.io/projected/395499e0-a2dc-4775-9dde-f66517d1d827-kube-api-access-2b6st\") pod \"placement-db-sync-nwmkm\" (UID: \"395499e0-a2dc-4775-9dde-f66517d1d827\") " pod="openstack-kuttl-tests/placement-db-sync-nwmkm" Mar 16 16:21:04 crc kubenswrapper[5120]: I0316 16:21:04.094747 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qxjwv\" (UniqueName: \"kubernetes.io/projected/4b4fb783-c7b1-4688-b793-d3ae04edc806-kube-api-access-qxjwv\") pod \"neutron-db-sync-vt87c\" (UID: \"4b4fb783-c7b1-4688-b793-d3ae04edc806\") " pod="openstack-kuttl-tests/neutron-db-sync-vt87c" Mar 16 16:21:04 crc kubenswrapper[5120]: I0316 16:21:04.094820 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1e1d9ac4-3b31-4a4e-8930-42f2670838be-run-httpd\") pod \"ceilometer-0\" (UID: \"1e1d9ac4-3b31-4a4e-8930-42f2670838be\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:21:04 crc kubenswrapper[5120]: I0316 16:21:04.094870 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1e1d9ac4-3b31-4a4e-8930-42f2670838be-config-data\") pod \"ceilometer-0\" (UID: \"1e1d9ac4-3b31-4a4e-8930-42f2670838be\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:21:04 crc kubenswrapper[5120]: I0316 16:21:04.094938 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8xmv\" (UniqueName: \"kubernetes.io/projected/1e1d9ac4-3b31-4a4e-8930-42f2670838be-kube-api-access-j8xmv\") pod \"ceilometer-0\" (UID: \"1e1d9ac4-3b31-4a4e-8930-42f2670838be\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:21:04 crc kubenswrapper[5120]: I0316 16:21:04.095037 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/395499e0-a2dc-4775-9dde-f66517d1d827-config-data\") pod \"placement-db-sync-nwmkm\" (UID: \"395499e0-a2dc-4775-9dde-f66517d1d827\") " pod="openstack-kuttl-tests/placement-db-sync-nwmkm" Mar 16 16:21:04 crc kubenswrapper[5120]: I0316 16:21:04.095138 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/1e1d9ac4-3b31-4a4e-8930-42f2670838be-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"1e1d9ac4-3b31-4a4e-8930-42f2670838be\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:21:04 crc kubenswrapper[5120]: I0316 16:21:04.095255 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/395499e0-a2dc-4775-9dde-f66517d1d827-logs\") pod \"placement-db-sync-nwmkm\" (UID: \"395499e0-a2dc-4775-9dde-f66517d1d827\") " pod="openstack-kuttl-tests/placement-db-sync-nwmkm" Mar 16 16:21:04 crc kubenswrapper[5120]: I0316 16:21:04.095974 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/395499e0-a2dc-4775-9dde-f66517d1d827-logs\") pod \"placement-db-sync-nwmkm\" (UID: \"395499e0-a2dc-4775-9dde-f66517d1d827\") " pod="openstack-kuttl-tests/placement-db-sync-nwmkm" Mar 16 16:21:04 crc kubenswrapper[5120]: I0316 16:21:04.099973 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4b4fb783-c7b1-4688-b793-d3ae04edc806-combined-ca-bundle\") pod \"neutron-db-sync-vt87c\" (UID: \"4b4fb783-c7b1-4688-b793-d3ae04edc806\") " pod="openstack-kuttl-tests/neutron-db-sync-vt87c" Mar 16 16:21:04 crc kubenswrapper[5120]: I0316 16:21:04.101305 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/4b4fb783-c7b1-4688-b793-d3ae04edc806-config\") pod \"neutron-db-sync-vt87c\" (UID: \"4b4fb783-c7b1-4688-b793-d3ae04edc806\") " pod="openstack-kuttl-tests/neutron-db-sync-vt87c" Mar 16 16:21:04 crc kubenswrapper[5120]: I0316 16:21:04.102915 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/395499e0-a2dc-4775-9dde-f66517d1d827-combined-ca-bundle\") pod \"placement-db-sync-nwmkm\" (UID: \"395499e0-a2dc-4775-9dde-f66517d1d827\") " pod="openstack-kuttl-tests/placement-db-sync-nwmkm" Mar 16 16:21:04 crc kubenswrapper[5120]: I0316 16:21:04.106263 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/395499e0-a2dc-4775-9dde-f66517d1d827-scripts\") pod \"placement-db-sync-nwmkm\" (UID: \"395499e0-a2dc-4775-9dde-f66517d1d827\") " pod="openstack-kuttl-tests/placement-db-sync-nwmkm" Mar 16 16:21:04 crc kubenswrapper[5120]: I0316 16:21:04.107518 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/395499e0-a2dc-4775-9dde-f66517d1d827-config-data\") pod \"placement-db-sync-nwmkm\" (UID: \"395499e0-a2dc-4775-9dde-f66517d1d827\") " pod="openstack-kuttl-tests/placement-db-sync-nwmkm" Mar 16 16:21:04 crc kubenswrapper[5120]: I0316 16:21:04.115080 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-d2k76" Mar 16 16:21:04 crc kubenswrapper[5120]: I0316 16:21:04.118684 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2b6st\" (UniqueName: \"kubernetes.io/projected/395499e0-a2dc-4775-9dde-f66517d1d827-kube-api-access-2b6st\") pod \"placement-db-sync-nwmkm\" (UID: \"395499e0-a2dc-4775-9dde-f66517d1d827\") " pod="openstack-kuttl-tests/placement-db-sync-nwmkm" Mar 16 16:21:04 crc kubenswrapper[5120]: I0316 16:21:04.121064 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxjwv\" (UniqueName: \"kubernetes.io/projected/4b4fb783-c7b1-4688-b793-d3ae04edc806-kube-api-access-qxjwv\") pod \"neutron-db-sync-vt87c\" (UID: \"4b4fb783-c7b1-4688-b793-d3ae04edc806\") " pod="openstack-kuttl-tests/neutron-db-sync-vt87c" Mar 16 16:21:04 crc kubenswrapper[5120]: I0316 16:21:04.198481 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1e1d9ac4-3b31-4a4e-8930-42f2670838be-config-data\") pod \"ceilometer-0\" (UID: \"1e1d9ac4-3b31-4a4e-8930-42f2670838be\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:21:04 crc kubenswrapper[5120]: I0316 16:21:04.198550 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j8xmv\" (UniqueName: \"kubernetes.io/projected/1e1d9ac4-3b31-4a4e-8930-42f2670838be-kube-api-access-j8xmv\") pod \"ceilometer-0\" (UID: \"1e1d9ac4-3b31-4a4e-8930-42f2670838be\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:21:04 crc kubenswrapper[5120]: I0316 16:21:04.198619 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/1e1d9ac4-3b31-4a4e-8930-42f2670838be-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"1e1d9ac4-3b31-4a4e-8930-42f2670838be\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:21:04 crc kubenswrapper[5120]: I0316 16:21:04.198739 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1e1d9ac4-3b31-4a4e-8930-42f2670838be-log-httpd\") pod \"ceilometer-0\" (UID: \"1e1d9ac4-3b31-4a4e-8930-42f2670838be\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:21:04 crc kubenswrapper[5120]: I0316 16:21:04.198778 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1e1d9ac4-3b31-4a4e-8930-42f2670838be-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"1e1d9ac4-3b31-4a4e-8930-42f2670838be\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:21:04 crc kubenswrapper[5120]: I0316 16:21:04.198860 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1e1d9ac4-3b31-4a4e-8930-42f2670838be-scripts\") pod \"ceilometer-0\" (UID: \"1e1d9ac4-3b31-4a4e-8930-42f2670838be\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:21:04 crc kubenswrapper[5120]: I0316 16:21:04.198943 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1e1d9ac4-3b31-4a4e-8930-42f2670838be-run-httpd\") pod \"ceilometer-0\" (UID: \"1e1d9ac4-3b31-4a4e-8930-42f2670838be\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:21:04 crc kubenswrapper[5120]: I0316 16:21:04.199425 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1e1d9ac4-3b31-4a4e-8930-42f2670838be-run-httpd\") pod \"ceilometer-0\" (UID: \"1e1d9ac4-3b31-4a4e-8930-42f2670838be\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:21:04 crc kubenswrapper[5120]: I0316 16:21:04.200647 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1e1d9ac4-3b31-4a4e-8930-42f2670838be-log-httpd\") pod \"ceilometer-0\" (UID: \"1e1d9ac4-3b31-4a4e-8930-42f2670838be\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:21:04 crc kubenswrapper[5120]: I0316 16:21:04.205241 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/1e1d9ac4-3b31-4a4e-8930-42f2670838be-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"1e1d9ac4-3b31-4a4e-8930-42f2670838be\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:21:04 crc kubenswrapper[5120]: I0316 16:21:04.205974 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1e1d9ac4-3b31-4a4e-8930-42f2670838be-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"1e1d9ac4-3b31-4a4e-8930-42f2670838be\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:21:04 crc kubenswrapper[5120]: I0316 16:21:04.206456 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1e1d9ac4-3b31-4a4e-8930-42f2670838be-scripts\") pod \"ceilometer-0\" (UID: \"1e1d9ac4-3b31-4a4e-8930-42f2670838be\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:21:04 crc kubenswrapper[5120]: I0316 16:21:04.213621 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1e1d9ac4-3b31-4a4e-8930-42f2670838be-config-data\") pod \"ceilometer-0\" (UID: \"1e1d9ac4-3b31-4a4e-8930-42f2670838be\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:21:04 crc kubenswrapper[5120]: I0316 16:21:04.218029 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8xmv\" (UniqueName: \"kubernetes.io/projected/1e1d9ac4-3b31-4a4e-8930-42f2670838be-kube-api-access-j8xmv\") pod \"ceilometer-0\" (UID: \"1e1d9ac4-3b31-4a4e-8930-42f2670838be\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:21:04 crc kubenswrapper[5120]: I0316 16:21:04.357586 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-nwmkm" Mar 16 16:21:04 crc kubenswrapper[5120]: I0316 16:21:04.369370 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-vt87c" Mar 16 16:21:04 crc kubenswrapper[5120]: I0316 16:21:04.379263 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:21:04 crc kubenswrapper[5120]: I0316 16:21:04.666931 5120 scope.go:117] "RemoveContainer" containerID="f40e444f89abd558ac90555bfd58e04a1c4379a653ba8035c228d2b7a5443eb5" Mar 16 16:21:04 crc kubenswrapper[5120]: E0316 16:21:04.667859 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:21:04 crc kubenswrapper[5120]: I0316 16:21:04.676865 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:21:04 crc kubenswrapper[5120]: I0316 16:21:04.760930 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:21:04 crc kubenswrapper[5120]: I0316 16:21:04.760966 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:21:04 crc kubenswrapper[5120]: I0316 16:21:04.763026 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:21:04 crc kubenswrapper[5120]: I0316 16:21:04.765920 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-glance-dockercfg-46sjz\"" Mar 16 16:21:04 crc kubenswrapper[5120]: I0316 16:21:04.766150 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-public-svc\"" Mar 16 16:21:04 crc kubenswrapper[5120]: I0316 16:21:04.766210 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-scripts\"" Mar 16 16:21:04 crc kubenswrapper[5120]: I0316 16:21:04.766280 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-external-config-data\"" Mar 16 16:21:04 crc kubenswrapper[5120]: I0316 16:21:04.768117 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:21:04 crc kubenswrapper[5120]: I0316 16:21:04.768215 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:21:04 crc kubenswrapper[5120]: I0316 16:21:04.770344 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-internal-svc\"" Mar 16 16:21:04 crc kubenswrapper[5120]: I0316 16:21:04.770879 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-internal-config-data\"" Mar 16 16:21:04 crc kubenswrapper[5120]: I0316 16:21:04.930525 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"glance-default-internal-api-0\" (UID: \"dc8cc9c3-03de-4f16-887b-ed689ac4eb99\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:21:04 crc kubenswrapper[5120]: I0316 16:21:04.930602 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/84d11cfa-2a20-48a3-ba0e-7e7d80bef376-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"84d11cfa-2a20-48a3-ba0e-7e7d80bef376\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:21:04 crc kubenswrapper[5120]: I0316 16:21:04.930651 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/dc8cc9c3-03de-4f16-887b-ed689ac4eb99-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"dc8cc9c3-03de-4f16-887b-ed689ac4eb99\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:21:04 crc kubenswrapper[5120]: I0316 16:21:04.930772 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/84d11cfa-2a20-48a3-ba0e-7e7d80bef376-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"84d11cfa-2a20-48a3-ba0e-7e7d80bef376\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:21:04 crc kubenswrapper[5120]: I0316 16:21:04.930882 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dc8cc9c3-03de-4f16-887b-ed689ac4eb99-config-data\") pod \"glance-default-internal-api-0\" (UID: \"dc8cc9c3-03de-4f16-887b-ed689ac4eb99\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:21:04 crc kubenswrapper[5120]: I0316 16:21:04.930970 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/84d11cfa-2a20-48a3-ba0e-7e7d80bef376-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"84d11cfa-2a20-48a3-ba0e-7e7d80bef376\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:21:04 crc kubenswrapper[5120]: I0316 16:21:04.931024 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dc8cc9c3-03de-4f16-887b-ed689ac4eb99-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"dc8cc9c3-03de-4f16-887b-ed689ac4eb99\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:21:04 crc kubenswrapper[5120]: I0316 16:21:04.931057 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage19-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") pod \"glance-default-external-api-0\" (UID: \"84d11cfa-2a20-48a3-ba0e-7e7d80bef376\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:21:04 crc kubenswrapper[5120]: I0316 16:21:04.931098 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pq74w\" (UniqueName: \"kubernetes.io/projected/dc8cc9c3-03de-4f16-887b-ed689ac4eb99-kube-api-access-pq74w\") pod \"glance-default-internal-api-0\" (UID: \"dc8cc9c3-03de-4f16-887b-ed689ac4eb99\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:21:04 crc kubenswrapper[5120]: I0316 16:21:04.931122 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/dc8cc9c3-03de-4f16-887b-ed689ac4eb99-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"dc8cc9c3-03de-4f16-887b-ed689ac4eb99\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:21:04 crc kubenswrapper[5120]: I0316 16:21:04.931155 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/dc8cc9c3-03de-4f16-887b-ed689ac4eb99-logs\") pod \"glance-default-internal-api-0\" (UID: \"dc8cc9c3-03de-4f16-887b-ed689ac4eb99\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:21:04 crc kubenswrapper[5120]: I0316 16:21:04.931174 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/84d11cfa-2a20-48a3-ba0e-7e7d80bef376-scripts\") pod \"glance-default-external-api-0\" (UID: \"84d11cfa-2a20-48a3-ba0e-7e7d80bef376\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:21:04 crc kubenswrapper[5120]: I0316 16:21:04.931233 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5kk8\" (UniqueName: \"kubernetes.io/projected/84d11cfa-2a20-48a3-ba0e-7e7d80bef376-kube-api-access-l5kk8\") pod \"glance-default-external-api-0\" (UID: \"84d11cfa-2a20-48a3-ba0e-7e7d80bef376\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:21:04 crc kubenswrapper[5120]: I0316 16:21:04.931471 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/84d11cfa-2a20-48a3-ba0e-7e7d80bef376-config-data\") pod \"glance-default-external-api-0\" (UID: \"84d11cfa-2a20-48a3-ba0e-7e7d80bef376\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:21:04 crc kubenswrapper[5120]: I0316 16:21:04.931505 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/84d11cfa-2a20-48a3-ba0e-7e7d80bef376-logs\") pod \"glance-default-external-api-0\" (UID: \"84d11cfa-2a20-48a3-ba0e-7e7d80bef376\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:21:04 crc kubenswrapper[5120]: I0316 16:21:04.931555 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/dc8cc9c3-03de-4f16-887b-ed689ac4eb99-scripts\") pod \"glance-default-internal-api-0\" (UID: \"dc8cc9c3-03de-4f16-887b-ed689ac4eb99\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:21:05 crc kubenswrapper[5120]: I0316 16:21:05.034257 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/dc8cc9c3-03de-4f16-887b-ed689ac4eb99-logs\") pod \"glance-default-internal-api-0\" (UID: \"dc8cc9c3-03de-4f16-887b-ed689ac4eb99\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:21:05 crc kubenswrapper[5120]: I0316 16:21:05.034330 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/84d11cfa-2a20-48a3-ba0e-7e7d80bef376-scripts\") pod \"glance-default-external-api-0\" (UID: \"84d11cfa-2a20-48a3-ba0e-7e7d80bef376\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:21:05 crc kubenswrapper[5120]: I0316 16:21:05.034362 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l5kk8\" (UniqueName: \"kubernetes.io/projected/84d11cfa-2a20-48a3-ba0e-7e7d80bef376-kube-api-access-l5kk8\") pod \"glance-default-external-api-0\" (UID: \"84d11cfa-2a20-48a3-ba0e-7e7d80bef376\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:21:05 crc kubenswrapper[5120]: I0316 16:21:05.034490 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/84d11cfa-2a20-48a3-ba0e-7e7d80bef376-config-data\") pod \"glance-default-external-api-0\" (UID: \"84d11cfa-2a20-48a3-ba0e-7e7d80bef376\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:21:05 crc kubenswrapper[5120]: I0316 16:21:05.034565 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/84d11cfa-2a20-48a3-ba0e-7e7d80bef376-logs\") pod \"glance-default-external-api-0\" (UID: \"84d11cfa-2a20-48a3-ba0e-7e7d80bef376\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:21:05 crc kubenswrapper[5120]: I0316 16:21:05.034771 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/dc8cc9c3-03de-4f16-887b-ed689ac4eb99-scripts\") pod \"glance-default-internal-api-0\" (UID: \"dc8cc9c3-03de-4f16-887b-ed689ac4eb99\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:21:05 crc kubenswrapper[5120]: I0316 16:21:05.034901 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"glance-default-internal-api-0\" (UID: \"dc8cc9c3-03de-4f16-887b-ed689ac4eb99\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:21:05 crc kubenswrapper[5120]: I0316 16:21:05.034943 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/84d11cfa-2a20-48a3-ba0e-7e7d80bef376-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"84d11cfa-2a20-48a3-ba0e-7e7d80bef376\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:21:05 crc kubenswrapper[5120]: I0316 16:21:05.035014 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/dc8cc9c3-03de-4f16-887b-ed689ac4eb99-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"dc8cc9c3-03de-4f16-887b-ed689ac4eb99\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:21:05 crc kubenswrapper[5120]: I0316 16:21:05.035061 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/84d11cfa-2a20-48a3-ba0e-7e7d80bef376-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"84d11cfa-2a20-48a3-ba0e-7e7d80bef376\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:21:05 crc kubenswrapper[5120]: I0316 16:21:05.035123 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dc8cc9c3-03de-4f16-887b-ed689ac4eb99-config-data\") pod \"glance-default-internal-api-0\" (UID: \"dc8cc9c3-03de-4f16-887b-ed689ac4eb99\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:21:05 crc kubenswrapper[5120]: I0316 16:21:05.035190 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/84d11cfa-2a20-48a3-ba0e-7e7d80bef376-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"84d11cfa-2a20-48a3-ba0e-7e7d80bef376\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:21:05 crc kubenswrapper[5120]: I0316 16:21:05.035244 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dc8cc9c3-03de-4f16-887b-ed689ac4eb99-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"dc8cc9c3-03de-4f16-887b-ed689ac4eb99\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:21:05 crc kubenswrapper[5120]: I0316 16:21:05.035255 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/84d11cfa-2a20-48a3-ba0e-7e7d80bef376-logs\") pod \"glance-default-external-api-0\" (UID: \"84d11cfa-2a20-48a3-ba0e-7e7d80bef376\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:21:05 crc kubenswrapper[5120]: I0316 16:21:05.035286 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage19-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") pod \"glance-default-external-api-0\" (UID: \"84d11cfa-2a20-48a3-ba0e-7e7d80bef376\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:21:05 crc kubenswrapper[5120]: I0316 16:21:05.035313 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/84d11cfa-2a20-48a3-ba0e-7e7d80bef376-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"84d11cfa-2a20-48a3-ba0e-7e7d80bef376\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:21:05 crc kubenswrapper[5120]: I0316 16:21:05.035313 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"glance-default-internal-api-0\" (UID: \"dc8cc9c3-03de-4f16-887b-ed689ac4eb99\") device mount path \"/mnt/openstack/pv20\"" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:21:05 crc kubenswrapper[5120]: I0316 16:21:05.035008 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/dc8cc9c3-03de-4f16-887b-ed689ac4eb99-logs\") pod \"glance-default-internal-api-0\" (UID: \"dc8cc9c3-03de-4f16-887b-ed689ac4eb99\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:21:05 crc kubenswrapper[5120]: I0316 16:21:05.035494 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage19-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") pod \"glance-default-external-api-0\" (UID: \"84d11cfa-2a20-48a3-ba0e-7e7d80bef376\") device mount path \"/mnt/openstack/pv19\"" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:21:05 crc kubenswrapper[5120]: I0316 16:21:05.035734 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/dc8cc9c3-03de-4f16-887b-ed689ac4eb99-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"dc8cc9c3-03de-4f16-887b-ed689ac4eb99\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:21:05 crc kubenswrapper[5120]: I0316 16:21:05.036864 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pq74w\" (UniqueName: \"kubernetes.io/projected/dc8cc9c3-03de-4f16-887b-ed689ac4eb99-kube-api-access-pq74w\") pod \"glance-default-internal-api-0\" (UID: \"dc8cc9c3-03de-4f16-887b-ed689ac4eb99\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:21:05 crc kubenswrapper[5120]: I0316 16:21:05.036917 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/dc8cc9c3-03de-4f16-887b-ed689ac4eb99-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"dc8cc9c3-03de-4f16-887b-ed689ac4eb99\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:21:05 crc kubenswrapper[5120]: I0316 16:21:05.039955 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/84d11cfa-2a20-48a3-ba0e-7e7d80bef376-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"84d11cfa-2a20-48a3-ba0e-7e7d80bef376\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:21:05 crc kubenswrapper[5120]: I0316 16:21:05.041247 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dc8cc9c3-03de-4f16-887b-ed689ac4eb99-config-data\") pod \"glance-default-internal-api-0\" (UID: \"dc8cc9c3-03de-4f16-887b-ed689ac4eb99\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:21:05 crc kubenswrapper[5120]: I0316 16:21:05.051049 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/84d11cfa-2a20-48a3-ba0e-7e7d80bef376-config-data\") pod \"glance-default-external-api-0\" (UID: \"84d11cfa-2a20-48a3-ba0e-7e7d80bef376\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:21:05 crc kubenswrapper[5120]: I0316 16:21:05.052243 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dc8cc9c3-03de-4f16-887b-ed689ac4eb99-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"dc8cc9c3-03de-4f16-887b-ed689ac4eb99\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:21:05 crc kubenswrapper[5120]: I0316 16:21:05.052946 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/dc8cc9c3-03de-4f16-887b-ed689ac4eb99-scripts\") pod \"glance-default-internal-api-0\" (UID: \"dc8cc9c3-03de-4f16-887b-ed689ac4eb99\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:21:05 crc kubenswrapper[5120]: I0316 16:21:05.053864 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pq74w\" (UniqueName: \"kubernetes.io/projected/dc8cc9c3-03de-4f16-887b-ed689ac4eb99-kube-api-access-pq74w\") pod \"glance-default-internal-api-0\" (UID: \"dc8cc9c3-03de-4f16-887b-ed689ac4eb99\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:21:05 crc kubenswrapper[5120]: I0316 16:21:05.055522 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/84d11cfa-2a20-48a3-ba0e-7e7d80bef376-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"84d11cfa-2a20-48a3-ba0e-7e7d80bef376\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:21:05 crc kubenswrapper[5120]: I0316 16:21:05.058801 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/dc8cc9c3-03de-4f16-887b-ed689ac4eb99-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"dc8cc9c3-03de-4f16-887b-ed689ac4eb99\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:21:05 crc kubenswrapper[5120]: I0316 16:21:05.059056 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5kk8\" (UniqueName: \"kubernetes.io/projected/84d11cfa-2a20-48a3-ba0e-7e7d80bef376-kube-api-access-l5kk8\") pod \"glance-default-external-api-0\" (UID: \"84d11cfa-2a20-48a3-ba0e-7e7d80bef376\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:21:05 crc kubenswrapper[5120]: I0316 16:21:05.065681 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/84d11cfa-2a20-48a3-ba0e-7e7d80bef376-scripts\") pod \"glance-default-external-api-0\" (UID: \"84d11cfa-2a20-48a3-ba0e-7e7d80bef376\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:21:05 crc kubenswrapper[5120]: I0316 16:21:05.083318 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"glance-default-internal-api-0\" (UID: \"dc8cc9c3-03de-4f16-887b-ed689ac4eb99\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:21:05 crc kubenswrapper[5120]: I0316 16:21:05.083568 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage19-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") pod \"glance-default-external-api-0\" (UID: \"84d11cfa-2a20-48a3-ba0e-7e7d80bef376\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:21:05 crc kubenswrapper[5120]: I0316 16:21:05.128322 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:21:05 crc kubenswrapper[5120]: I0316 16:21:05.136317 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:21:05 crc kubenswrapper[5120]: I0316 16:21:05.737284 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:21:05 crc kubenswrapper[5120]: I0316 16:21:05.785832 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:21:05 crc kubenswrapper[5120]: I0316 16:21:05.833570 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:21:07 crc kubenswrapper[5120]: I0316 16:21:07.181620 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-create-6wrmh" Mar 16 16:21:07 crc kubenswrapper[5120]: I0316 16:21:07.290250 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8539dbb8-688e-4007-a0ed-268b58f3b39a-operator-scripts\") pod \"8539dbb8-688e-4007-a0ed-268b58f3b39a\" (UID: \"8539dbb8-688e-4007-a0ed-268b58f3b39a\") " Mar 16 16:21:07 crc kubenswrapper[5120]: I0316 16:21:07.290464 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tqmrf\" (UniqueName: \"kubernetes.io/projected/8539dbb8-688e-4007-a0ed-268b58f3b39a-kube-api-access-tqmrf\") pod \"8539dbb8-688e-4007-a0ed-268b58f3b39a\" (UID: \"8539dbb8-688e-4007-a0ed-268b58f3b39a\") " Mar 16 16:21:07 crc kubenswrapper[5120]: I0316 16:21:07.292133 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8539dbb8-688e-4007-a0ed-268b58f3b39a-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "8539dbb8-688e-4007-a0ed-268b58f3b39a" (UID: "8539dbb8-688e-4007-a0ed-268b58f3b39a"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:21:07 crc kubenswrapper[5120]: I0316 16:21:07.316429 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8539dbb8-688e-4007-a0ed-268b58f3b39a-kube-api-access-tqmrf" (OuterVolumeSpecName: "kube-api-access-tqmrf") pod "8539dbb8-688e-4007-a0ed-268b58f3b39a" (UID: "8539dbb8-688e-4007-a0ed-268b58f3b39a"). InnerVolumeSpecName "kube-api-access-tqmrf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:21:07 crc kubenswrapper[5120]: I0316 16:21:07.392368 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tqmrf\" (UniqueName: \"kubernetes.io/projected/8539dbb8-688e-4007-a0ed-268b58f3b39a-kube-api-access-tqmrf\") on node \"crc\" DevicePath \"\"" Mar 16 16:21:07 crc kubenswrapper[5120]: I0316 16:21:07.392398 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8539dbb8-688e-4007-a0ed-268b58f3b39a-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:21:07 crc kubenswrapper[5120]: I0316 16:21:07.471555 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-create-6wrmh" Mar 16 16:21:07 crc kubenswrapper[5120]: I0316 16:21:07.471644 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-create-6wrmh" event={"ID":"8539dbb8-688e-4007-a0ed-268b58f3b39a","Type":"ContainerDied","Data":"ed31f2a9ec0e4d80b85780744163aed6eb82d89fdc9dbe2d27fd547652aa2429"} Mar 16 16:21:07 crc kubenswrapper[5120]: I0316 16:21:07.471691 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ed31f2a9ec0e4d80b85780744163aed6eb82d89fdc9dbe2d27fd547652aa2429" Mar 16 16:21:08 crc kubenswrapper[5120]: E0316 16:21:08.430721 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1490920 actualBytes=10240 Mar 16 16:21:11 crc kubenswrapper[5120]: I0316 16:21:11.744345 5120 scope.go:117] "RemoveContainer" containerID="9f4ca810d0333490f7f8804535988941a3f37adb5983d0982fedf9261a9e97e6" Mar 16 16:21:12 crc kubenswrapper[5120]: I0316 16:21:12.077924 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-xbzfv"] Mar 16 16:21:12 crc kubenswrapper[5120]: I0316 16:21:12.078949 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8539dbb8-688e-4007-a0ed-268b58f3b39a" containerName="mariadb-database-create" Mar 16 16:21:12 crc kubenswrapper[5120]: I0316 16:21:12.078970 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8539dbb8-688e-4007-a0ed-268b58f3b39a" containerName="mariadb-database-create" Mar 16 16:21:12 crc kubenswrapper[5120]: I0316 16:21:12.079132 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="8539dbb8-688e-4007-a0ed-268b58f3b39a" containerName="mariadb-database-create" Mar 16 16:21:12 crc kubenswrapper[5120]: I0316 16:21:12.087690 5120 scope.go:117] "RemoveContainer" containerID="fb7014d82f06bd9e0b52f0b04d5b5fff1111af219f9733a27808c78985138c36" Mar 16 16:21:12 crc kubenswrapper[5120]: I0316 16:21:12.088148 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-xbzfv" Mar 16 16:21:12 crc kubenswrapper[5120]: I0316 16:21:12.090897 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-config-data\"" Mar 16 16:21:12 crc kubenswrapper[5120]: I0316 16:21:12.091264 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-barbican-dockercfg-vs6hm\"" Mar 16 16:21:12 crc kubenswrapper[5120]: I0316 16:21:12.092288 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-xbzfv"] Mar 16 16:21:12 crc kubenswrapper[5120]: I0316 16:21:12.207207 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8d540ae4-9eb1-4540-bb5b-4035063b47ca-combined-ca-bundle\") pod \"barbican-db-sync-xbzfv\" (UID: \"8d540ae4-9eb1-4540-bb5b-4035063b47ca\") " pod="openstack-kuttl-tests/barbican-db-sync-xbzfv" Mar 16 16:21:12 crc kubenswrapper[5120]: I0316 16:21:12.207687 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2ddn\" (UniqueName: \"kubernetes.io/projected/8d540ae4-9eb1-4540-bb5b-4035063b47ca-kube-api-access-h2ddn\") pod \"barbican-db-sync-xbzfv\" (UID: \"8d540ae4-9eb1-4540-bb5b-4035063b47ca\") " pod="openstack-kuttl-tests/barbican-db-sync-xbzfv" Mar 16 16:21:12 crc kubenswrapper[5120]: I0316 16:21:12.208031 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/8d540ae4-9eb1-4540-bb5b-4035063b47ca-db-sync-config-data\") pod \"barbican-db-sync-xbzfv\" (UID: \"8d540ae4-9eb1-4540-bb5b-4035063b47ca\") " pod="openstack-kuttl-tests/barbican-db-sync-xbzfv" Mar 16 16:21:12 crc kubenswrapper[5120]: I0316 16:21:12.236658 5120 scope.go:117] "RemoveContainer" containerID="d9c76aa340d603643bb917bbd7c06fa96f405666621b213aa3daae966a23d7af" Mar 16 16:21:12 crc kubenswrapper[5120]: I0316 16:21:12.306961 5120 scope.go:117] "RemoveContainer" containerID="048ccc5a474f0a74102ffc356a269aaf83381c4a545e56c632aa7d6fab8611af" Mar 16 16:21:12 crc kubenswrapper[5120]: I0316 16:21:12.317713 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8d540ae4-9eb1-4540-bb5b-4035063b47ca-combined-ca-bundle\") pod \"barbican-db-sync-xbzfv\" (UID: \"8d540ae4-9eb1-4540-bb5b-4035063b47ca\") " pod="openstack-kuttl-tests/barbican-db-sync-xbzfv" Mar 16 16:21:12 crc kubenswrapper[5120]: I0316 16:21:12.319350 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h2ddn\" (UniqueName: \"kubernetes.io/projected/8d540ae4-9eb1-4540-bb5b-4035063b47ca-kube-api-access-h2ddn\") pod \"barbican-db-sync-xbzfv\" (UID: \"8d540ae4-9eb1-4540-bb5b-4035063b47ca\") " pod="openstack-kuttl-tests/barbican-db-sync-xbzfv" Mar 16 16:21:12 crc kubenswrapper[5120]: I0316 16:21:12.320346 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/8d540ae4-9eb1-4540-bb5b-4035063b47ca-db-sync-config-data\") pod \"barbican-db-sync-xbzfv\" (UID: \"8d540ae4-9eb1-4540-bb5b-4035063b47ca\") " pod="openstack-kuttl-tests/barbican-db-sync-xbzfv" Mar 16 16:21:12 crc kubenswrapper[5120]: I0316 16:21:12.325980 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/8d540ae4-9eb1-4540-bb5b-4035063b47ca-db-sync-config-data\") pod \"barbican-db-sync-xbzfv\" (UID: \"8d540ae4-9eb1-4540-bb5b-4035063b47ca\") " pod="openstack-kuttl-tests/barbican-db-sync-xbzfv" Mar 16 16:21:12 crc kubenswrapper[5120]: I0316 16:21:12.330037 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8d540ae4-9eb1-4540-bb5b-4035063b47ca-combined-ca-bundle\") pod \"barbican-db-sync-xbzfv\" (UID: \"8d540ae4-9eb1-4540-bb5b-4035063b47ca\") " pod="openstack-kuttl-tests/barbican-db-sync-xbzfv" Mar 16 16:21:12 crc kubenswrapper[5120]: I0316 16:21:12.348484 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2ddn\" (UniqueName: \"kubernetes.io/projected/8d540ae4-9eb1-4540-bb5b-4035063b47ca-kube-api-access-h2ddn\") pod \"barbican-db-sync-xbzfv\" (UID: \"8d540ae4-9eb1-4540-bb5b-4035063b47ca\") " pod="openstack-kuttl-tests/barbican-db-sync-xbzfv" Mar 16 16:21:12 crc kubenswrapper[5120]: I0316 16:21:12.352636 5120 scope.go:117] "RemoveContainer" containerID="39998592854bf56ef9997d1b6241d034080c653045712cd7dd3cecb1c338b3b5" Mar 16 16:21:12 crc kubenswrapper[5120]: I0316 16:21:12.395937 5120 scope.go:117] "RemoveContainer" containerID="5378ad34d9758a144ee943f34770e0b06832baf379ab5bffe3100e28939b0afd" Mar 16 16:21:12 crc kubenswrapper[5120]: I0316 16:21:12.531092 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/watcher-db-sync-tlbgk" event={"ID":"75f1b7f4-9fac-4135-819b-8eab79df5cf9","Type":"ContainerStarted","Data":"a5c83d8e90667f73122dcc3a225e1d4b07bb1b3172749937c72924c96311a483"} Mar 16 16:21:12 crc kubenswrapper[5120]: I0316 16:21:12.539733 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/prometheus-metric-storage-0" event={"ID":"436edb75-475a-4096-a9c9-bf235fc92d9c","Type":"ContainerStarted","Data":"533af2cb60162ddbab3651bb11e174e85e24fca07c3ffcfd31f3cbe35830d8bd"} Mar 16 16:21:12 crc kubenswrapper[5120]: I0316 16:21:12.550365 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/watcher-db-sync-tlbgk" podStartSLOduration=2.046536181 podStartE2EDuration="16.550347878s" podCreationTimestamp="2026-03-16 16:20:56 +0000 UTC" firstStartedPulling="2026-03-16 16:20:57.735210384 +0000 UTC m=+2959.889142031" lastFinishedPulling="2026-03-16 16:21:12.239022071 +0000 UTC m=+2974.392953728" observedRunningTime="2026-03-16 16:21:12.54331914 +0000 UTC m=+2974.697250797" watchObservedRunningTime="2026-03-16 16:21:12.550347878 +0000 UTC m=+2974.704279535" Mar 16 16:21:12 crc kubenswrapper[5120]: I0316 16:21:12.569772 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-xbzfv" Mar 16 16:21:12 crc kubenswrapper[5120]: I0316 16:21:12.605971 5120 scope.go:117] "RemoveContainer" containerID="320b88bddc9b6a83665dceba6bbbe7764ea121254e371a55cbaf212003fe9534" Mar 16 16:21:12 crc kubenswrapper[5120]: I0316 16:21:12.695742 5120 scope.go:117] "RemoveContainer" containerID="017373c958d49032144fbe318a10976807bbd78b24a245e7b5bbdf6db64b7476" Mar 16 16:21:12 crc kubenswrapper[5120]: I0316 16:21:12.749172 5120 scope.go:117] "RemoveContainer" containerID="39aeafa8666446d25a5b2e18ff2113d614f81487d6359922b45fb4d77879ff78" Mar 16 16:21:12 crc kubenswrapper[5120]: I0316 16:21:12.808079 5120 scope.go:117] "RemoveContainer" containerID="cb924e1b048e7104d449d9ed5a9c19c5fb9f4a662334a0dbf25edc3eea144bdc" Mar 16 16:21:12 crc kubenswrapper[5120]: I0316 16:21:12.847130 5120 scope.go:117] "RemoveContainer" containerID="f0a969484bc8b33413c7e75bd58fd4957a3d1e7b4f67181477315ecdf371d498" Mar 16 16:21:12 crc kubenswrapper[5120]: I0316 16:21:12.870728 5120 scope.go:117] "RemoveContainer" containerID="682b0a5848aef122872540d289a695e1f370fadbcc7c61bef2d31ebc83439a1c" Mar 16 16:21:12 crc kubenswrapper[5120]: I0316 16:21:12.897108 5120 scope.go:117] "RemoveContainer" containerID="5672b998b123b9f2d2e8b222c724b426b74bdc647537a83f3254f525174e930d" Mar 16 16:21:12 crc kubenswrapper[5120]: I0316 16:21:12.931465 5120 scope.go:117] "RemoveContainer" containerID="019cbe9266c3e626b838cf930352f422ad0940ce877d1a1360b500c0918fa709" Mar 16 16:21:12 crc kubenswrapper[5120]: I0316 16:21:12.940295 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-nwmkm"] Mar 16 16:21:12 crc kubenswrapper[5120]: I0316 16:21:12.963964 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-vt87c"] Mar 16 16:21:12 crc kubenswrapper[5120]: W0316 16:21:12.966361 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod395499e0_a2dc_4775_9dde_f66517d1d827.slice/crio-f2a05a68ef39b4a8dd2622bd460a3b28de19795d0634f09757e65b13f341d2b1 WatchSource:0}: Error finding container f2a05a68ef39b4a8dd2622bd460a3b28de19795d0634f09757e65b13f341d2b1: Status 404 returned error can't find the container with id f2a05a68ef39b4a8dd2622bd460a3b28de19795d0634f09757e65b13f341d2b1 Mar 16 16:21:12 crc kubenswrapper[5120]: I0316 16:21:12.974405 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-k6l62"] Mar 16 16:21:12 crc kubenswrapper[5120]: W0316 16:21:12.974724 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod356bec90_b61f_42ca_85ea_9b25a263f3e5.slice/crio-e980d64c46c953c65395311131c9f9e365304b8a66bd8e2219bf007f498d7d87 WatchSource:0}: Error finding container e980d64c46c953c65395311131c9f9e365304b8a66bd8e2219bf007f498d7d87: Status 404 returned error can't find the container with id e980d64c46c953c65395311131c9f9e365304b8a66bd8e2219bf007f498d7d87 Mar 16 16:21:12 crc kubenswrapper[5120]: I0316 16:21:12.982666 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:21:13 crc kubenswrapper[5120]: I0316 16:21:13.005985 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-d2k76"] Mar 16 16:21:13 crc kubenswrapper[5120]: I0316 16:21:13.017558 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:21:13 crc kubenswrapper[5120]: W0316 16:21:13.020751 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1e1d9ac4_3b31_4a4e_8930_42f2670838be.slice/crio-30e8ea54a1bc416b30183e2c502417161fe7f9032569c2d70532f6f329bdd057 WatchSource:0}: Error finding container 30e8ea54a1bc416b30183e2c502417161fe7f9032569c2d70532f6f329bdd057: Status 404 returned error can't find the container with id 30e8ea54a1bc416b30183e2c502417161fe7f9032569c2d70532f6f329bdd057 Mar 16 16:21:13 crc kubenswrapper[5120]: I0316 16:21:13.025885 5120 scope.go:117] "RemoveContainer" containerID="2b298e703ea76c468bcf7fbe09cc4b1d04236ee47d6af12a4a7e9a34e4e507e6" Mar 16 16:21:13 crc kubenswrapper[5120]: I0316 16:21:13.085280 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:21:13 crc kubenswrapper[5120]: I0316 16:21:13.257965 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-xbzfv"] Mar 16 16:21:13 crc kubenswrapper[5120]: W0316 16:21:13.272260 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8d540ae4_9eb1_4540_bb5b_4035063b47ca.slice/crio-b096716ff2686c9a9d3701d519fbfa4da51c9823ba658c67d621efe61f1eaf14 WatchSource:0}: Error finding container b096716ff2686c9a9d3701d519fbfa4da51c9823ba658c67d621efe61f1eaf14: Status 404 returned error can't find the container with id b096716ff2686c9a9d3701d519fbfa4da51c9823ba658c67d621efe61f1eaf14 Mar 16 16:21:13 crc kubenswrapper[5120]: I0316 16:21:13.564911 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-d2k76" event={"ID":"c2b81fed-a0a9-44aa-9d9e-ba21b827dc43","Type":"ContainerStarted","Data":"f819a2eadc5dc862f9fd438a71dba8e91a6ce4f661fb36bc97d1ec009262ab9c"} Mar 16 16:21:13 crc kubenswrapper[5120]: I0316 16:21:13.573997 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-k6l62" event={"ID":"356bec90-b61f-42ca-85ea-9b25a263f3e5","Type":"ContainerStarted","Data":"d63fb9b48fd6b1db0dec801b87cbcaa22743a49a59e9f7e340af855fa43fafc8"} Mar 16 16:21:13 crc kubenswrapper[5120]: I0316 16:21:13.574031 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-k6l62" event={"ID":"356bec90-b61f-42ca-85ea-9b25a263f3e5","Type":"ContainerStarted","Data":"e980d64c46c953c65395311131c9f9e365304b8a66bd8e2219bf007f498d7d87"} Mar 16 16:21:13 crc kubenswrapper[5120]: I0316 16:21:13.578403 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-vt87c" event={"ID":"4b4fb783-c7b1-4688-b793-d3ae04edc806","Type":"ContainerStarted","Data":"a0563243f791daf4df3d95b328fc12ff620a6cbda02c76fafaea3cd34b4b0a44"} Mar 16 16:21:13 crc kubenswrapper[5120]: I0316 16:21:13.578433 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-vt87c" event={"ID":"4b4fb783-c7b1-4688-b793-d3ae04edc806","Type":"ContainerStarted","Data":"32125af11fa877384afc87d6c964f7c867ff3cf2eb7797ff6bf0a047bea8b74e"} Mar 16 16:21:13 crc kubenswrapper[5120]: I0316 16:21:13.580787 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-xbzfv" event={"ID":"8d540ae4-9eb1-4540-bb5b-4035063b47ca","Type":"ContainerStarted","Data":"b096716ff2686c9a9d3701d519fbfa4da51c9823ba658c67d621efe61f1eaf14"} Mar 16 16:21:13 crc kubenswrapper[5120]: I0316 16:21:13.582477 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1e1d9ac4-3b31-4a4e-8930-42f2670838be","Type":"ContainerStarted","Data":"30e8ea54a1bc416b30183e2c502417161fe7f9032569c2d70532f6f329bdd057"} Mar 16 16:21:13 crc kubenswrapper[5120]: I0316 16:21:13.586362 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"84d11cfa-2a20-48a3-ba0e-7e7d80bef376","Type":"ContainerStarted","Data":"4f7471bc43e1790be4e30e261034fa3a2d5fdb2cd193a892cc90d15b5306dae4"} Mar 16 16:21:13 crc kubenswrapper[5120]: I0316 16:21:13.592215 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-nwmkm" event={"ID":"395499e0-a2dc-4775-9dde-f66517d1d827","Type":"ContainerStarted","Data":"5a7249f78b90d7cc4b86766255da1ae161449cc81a4de8c3ba3676aedd314db4"} Mar 16 16:21:13 crc kubenswrapper[5120]: I0316 16:21:13.592251 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-nwmkm" event={"ID":"395499e0-a2dc-4775-9dde-f66517d1d827","Type":"ContainerStarted","Data":"f2a05a68ef39b4a8dd2622bd460a3b28de19795d0634f09757e65b13f341d2b1"} Mar 16 16:21:13 crc kubenswrapper[5120]: I0316 16:21:13.593685 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-bootstrap-k6l62" podStartSLOduration=10.593667494 podStartE2EDuration="10.593667494s" podCreationTimestamp="2026-03-16 16:21:03 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:21:13.589885543 +0000 UTC m=+2975.743817200" watchObservedRunningTime="2026-03-16 16:21:13.593667494 +0000 UTC m=+2975.747599151" Mar 16 16:21:13 crc kubenswrapper[5120]: I0316 16:21:13.605820 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"dc8cc9c3-03de-4f16-887b-ed689ac4eb99","Type":"ContainerStarted","Data":"7f2086c80b8f95d0d58a4df94ecb6e5e87a94059a49b5eacce3b66b3c1f0053d"} Mar 16 16:21:13 crc kubenswrapper[5120]: I0316 16:21:13.645678 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-db-sync-nwmkm" podStartSLOduration=10.645659955 podStartE2EDuration="10.645659955s" podCreationTimestamp="2026-03-16 16:21:03 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:21:13.634211569 +0000 UTC m=+2975.788143226" watchObservedRunningTime="2026-03-16 16:21:13.645659955 +0000 UTC m=+2975.799591612" Mar 16 16:21:13 crc kubenswrapper[5120]: I0316 16:21:13.664974 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-db-sync-vt87c" podStartSLOduration=10.664954001 podStartE2EDuration="10.664954001s" podCreationTimestamp="2026-03-16 16:21:03 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:21:13.617974174 +0000 UTC m=+2975.771905831" watchObservedRunningTime="2026-03-16 16:21:13.664954001 +0000 UTC m=+2975.818885658" Mar 16 16:21:14 crc kubenswrapper[5120]: I0316 16:21:14.621328 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1e1d9ac4-3b31-4a4e-8930-42f2670838be","Type":"ContainerStarted","Data":"4557aac861cc42cf68288c1a9d7e9bb7ab3d0da395ee4b8a2a22276adbb9f50d"} Mar 16 16:21:14 crc kubenswrapper[5120]: I0316 16:21:14.623792 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"84d11cfa-2a20-48a3-ba0e-7e7d80bef376","Type":"ContainerStarted","Data":"9d1cc192494169d1b98ce6c285d93be953ab2e27d763d30e5e3e55d556beba2c"} Mar 16 16:21:14 crc kubenswrapper[5120]: I0316 16:21:14.631626 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"dc8cc9c3-03de-4f16-887b-ed689ac4eb99","Type":"ContainerStarted","Data":"c7415f2459acf4be6875a4aaa9a2d82e85a86bd82b444391788352b9e172cd06"} Mar 16 16:21:14 crc kubenswrapper[5120]: I0316 16:21:14.637031 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-xbzfv" event={"ID":"8d540ae4-9eb1-4540-bb5b-4035063b47ca","Type":"ContainerStarted","Data":"a9d5fa9921a3eb3e26ff72411dfd9d087b678c51ac514abab8dca1272664f813"} Mar 16 16:21:14 crc kubenswrapper[5120]: I0316 16:21:14.667872 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-db-sync-xbzfv" podStartSLOduration=2.667856245 podStartE2EDuration="2.667856245s" podCreationTimestamp="2026-03-16 16:21:12 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:21:14.657012595 +0000 UTC m=+2976.810944252" watchObservedRunningTime="2026-03-16 16:21:14.667856245 +0000 UTC m=+2976.821787902" Mar 16 16:21:15 crc kubenswrapper[5120]: I0316 16:21:15.646232 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-d2k76" event={"ID":"c2b81fed-a0a9-44aa-9d9e-ba21b827dc43","Type":"ContainerStarted","Data":"b3f67bac83ec3397d083d4295b6aae920370a632da07ca7a35f4d30b94b1d332"} Mar 16 16:21:15 crc kubenswrapper[5120]: I0316 16:21:15.649032 5120 generic.go:358] "Generic (PLEG): container finished" podID="75f1b7f4-9fac-4135-819b-8eab79df5cf9" containerID="a5c83d8e90667f73122dcc3a225e1d4b07bb1b3172749937c72924c96311a483" exitCode=0 Mar 16 16:21:15 crc kubenswrapper[5120]: I0316 16:21:15.649069 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/watcher-db-sync-tlbgk" event={"ID":"75f1b7f4-9fac-4135-819b-8eab79df5cf9","Type":"ContainerDied","Data":"a5c83d8e90667f73122dcc3a225e1d4b07bb1b3172749937c72924c96311a483"} Mar 16 16:21:15 crc kubenswrapper[5120]: I0316 16:21:15.651396 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1e1d9ac4-3b31-4a4e-8930-42f2670838be","Type":"ContainerStarted","Data":"e523bc2c517fcee5391a2c03f390c1d6962bf26aa6c40a167defd48939f3e291"} Mar 16 16:21:15 crc kubenswrapper[5120]: I0316 16:21:15.653522 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"84d11cfa-2a20-48a3-ba0e-7e7d80bef376","Type":"ContainerStarted","Data":"974bd308f1cb30877dd8d9a4ba646cbc0183492f30399b429d3491b947008c6d"} Mar 16 16:21:15 crc kubenswrapper[5120]: I0316 16:21:15.653617 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="84d11cfa-2a20-48a3-ba0e-7e7d80bef376" containerName="glance-log" containerID="cri-o://9d1cc192494169d1b98ce6c285d93be953ab2e27d763d30e5e3e55d556beba2c" gracePeriod=30 Mar 16 16:21:15 crc kubenswrapper[5120]: I0316 16:21:15.653627 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="84d11cfa-2a20-48a3-ba0e-7e7d80bef376" containerName="glance-httpd" containerID="cri-o://974bd308f1cb30877dd8d9a4ba646cbc0183492f30399b429d3491b947008c6d" gracePeriod=30 Mar 16 16:21:15 crc kubenswrapper[5120]: I0316 16:21:15.664196 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/prometheus-metric-storage-0" event={"ID":"436edb75-475a-4096-a9c9-bf235fc92d9c","Type":"ContainerStarted","Data":"2a896000e70dd7124ec92af5c96ae6d01ec902505892d014e791fed3fbdfa390"} Mar 16 16:21:15 crc kubenswrapper[5120]: I0316 16:21:15.664245 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/prometheus-metric-storage-0" event={"ID":"436edb75-475a-4096-a9c9-bf235fc92d9c","Type":"ContainerStarted","Data":"1bba6ac3aa0cc48a80a5395897ea292ab61046d1fda826d5eb20948de324115b"} Mar 16 16:21:15 crc kubenswrapper[5120]: I0316 16:21:15.672229 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"dc8cc9c3-03de-4f16-887b-ed689ac4eb99","Type":"ContainerStarted","Data":"f0696664c4dc5eed3d986c6feafe1efa35ec333d6dadec50457d294d5d7390ce"} Mar 16 16:21:15 crc kubenswrapper[5120]: I0316 16:21:15.672485 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="dc8cc9c3-03de-4f16-887b-ed689ac4eb99" containerName="glance-log" containerID="cri-o://c7415f2459acf4be6875a4aaa9a2d82e85a86bd82b444391788352b9e172cd06" gracePeriod=30 Mar 16 16:21:15 crc kubenswrapper[5120]: I0316 16:21:15.672534 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="dc8cc9c3-03de-4f16-887b-ed689ac4eb99" containerName="glance-httpd" containerID="cri-o://f0696664c4dc5eed3d986c6feafe1efa35ec333d6dadec50457d294d5d7390ce" gracePeriod=30 Mar 16 16:21:15 crc kubenswrapper[5120]: I0316 16:21:15.687809 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-db-sync-d2k76" podStartSLOduration=12.687791935 podStartE2EDuration="12.687791935s" podCreationTimestamp="2026-03-16 16:21:03 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:21:15.663612469 +0000 UTC m=+2977.817544126" watchObservedRunningTime="2026-03-16 16:21:15.687791935 +0000 UTC m=+2977.841723582" Mar 16 16:21:15 crc kubenswrapper[5120]: I0316 16:21:15.712806 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-external-api-0" podStartSLOduration=12.712786324 podStartE2EDuration="12.712786324s" podCreationTimestamp="2026-03-16 16:21:03 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:21:15.705826608 +0000 UTC m=+2977.859758275" watchObservedRunningTime="2026-03-16 16:21:15.712786324 +0000 UTC m=+2977.866717981" Mar 16 16:21:15 crc kubenswrapper[5120]: I0316 16:21:15.730696 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-internal-api-0" podStartSLOduration=12.730676773 podStartE2EDuration="12.730676773s" podCreationTimestamp="2026-03-16 16:21:03 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:21:15.72271755 +0000 UTC m=+2977.876649217" watchObservedRunningTime="2026-03-16 16:21:15.730676773 +0000 UTC m=+2977.884608430" Mar 16 16:21:15 crc kubenswrapper[5120]: I0316 16:21:15.751529 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/prometheus-metric-storage-0" podStartSLOduration=25.75151429 podStartE2EDuration="25.75151429s" podCreationTimestamp="2026-03-16 16:20:50 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:21:15.747116093 +0000 UTC m=+2977.901047750" watchObservedRunningTime="2026-03-16 16:21:15.75151429 +0000 UTC m=+2977.905445947" Mar 16 16:21:16 crc kubenswrapper[5120]: I0316 16:21:16.551782 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:21:16 crc kubenswrapper[5120]: I0316 16:21:16.628109 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/84d11cfa-2a20-48a3-ba0e-7e7d80bef376-combined-ca-bundle\") pod \"84d11cfa-2a20-48a3-ba0e-7e7d80bef376\" (UID: \"84d11cfa-2a20-48a3-ba0e-7e7d80bef376\") " Mar 16 16:21:16 crc kubenswrapper[5120]: I0316 16:21:16.628197 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") pod \"84d11cfa-2a20-48a3-ba0e-7e7d80bef376\" (UID: \"84d11cfa-2a20-48a3-ba0e-7e7d80bef376\") " Mar 16 16:21:16 crc kubenswrapper[5120]: I0316 16:21:16.634100 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage19-crc" (OuterVolumeSpecName: "glance") pod "84d11cfa-2a20-48a3-ba0e-7e7d80bef376" (UID: "84d11cfa-2a20-48a3-ba0e-7e7d80bef376"). InnerVolumeSpecName "local-storage19-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:21:16 crc kubenswrapper[5120]: I0316 16:21:16.657070 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/84d11cfa-2a20-48a3-ba0e-7e7d80bef376-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "84d11cfa-2a20-48a3-ba0e-7e7d80bef376" (UID: "84d11cfa-2a20-48a3-ba0e-7e7d80bef376"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:21:16 crc kubenswrapper[5120]: I0316 16:21:16.686199 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1e1d9ac4-3b31-4a4e-8930-42f2670838be","Type":"ContainerStarted","Data":"8924dd738fa63e4ed91c2b2cd400cb43fd037582ec47620602daaff519be9da8"} Mar 16 16:21:16 crc kubenswrapper[5120]: I0316 16:21:16.689845 5120 generic.go:358] "Generic (PLEG): container finished" podID="84d11cfa-2a20-48a3-ba0e-7e7d80bef376" containerID="974bd308f1cb30877dd8d9a4ba646cbc0183492f30399b429d3491b947008c6d" exitCode=0 Mar 16 16:21:16 crc kubenswrapper[5120]: I0316 16:21:16.689870 5120 generic.go:358] "Generic (PLEG): container finished" podID="84d11cfa-2a20-48a3-ba0e-7e7d80bef376" containerID="9d1cc192494169d1b98ce6c285d93be953ab2e27d763d30e5e3e55d556beba2c" exitCode=143 Mar 16 16:21:16 crc kubenswrapper[5120]: I0316 16:21:16.689941 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"84d11cfa-2a20-48a3-ba0e-7e7d80bef376","Type":"ContainerDied","Data":"974bd308f1cb30877dd8d9a4ba646cbc0183492f30399b429d3491b947008c6d"} Mar 16 16:21:16 crc kubenswrapper[5120]: I0316 16:21:16.689942 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:21:16 crc kubenswrapper[5120]: I0316 16:21:16.689977 5120 scope.go:117] "RemoveContainer" containerID="974bd308f1cb30877dd8d9a4ba646cbc0183492f30399b429d3491b947008c6d" Mar 16 16:21:16 crc kubenswrapper[5120]: I0316 16:21:16.689967 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"84d11cfa-2a20-48a3-ba0e-7e7d80bef376","Type":"ContainerDied","Data":"9d1cc192494169d1b98ce6c285d93be953ab2e27d763d30e5e3e55d556beba2c"} Mar 16 16:21:16 crc kubenswrapper[5120]: I0316 16:21:16.690144 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"84d11cfa-2a20-48a3-ba0e-7e7d80bef376","Type":"ContainerDied","Data":"4f7471bc43e1790be4e30e261034fa3a2d5fdb2cd193a892cc90d15b5306dae4"} Mar 16 16:21:16 crc kubenswrapper[5120]: I0316 16:21:16.694114 5120 generic.go:358] "Generic (PLEG): container finished" podID="395499e0-a2dc-4775-9dde-f66517d1d827" containerID="5a7249f78b90d7cc4b86766255da1ae161449cc81a4de8c3ba3676aedd314db4" exitCode=0 Mar 16 16:21:16 crc kubenswrapper[5120]: I0316 16:21:16.694199 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-nwmkm" event={"ID":"395499e0-a2dc-4775-9dde-f66517d1d827","Type":"ContainerDied","Data":"5a7249f78b90d7cc4b86766255da1ae161449cc81a4de8c3ba3676aedd314db4"} Mar 16 16:21:16 crc kubenswrapper[5120]: I0316 16:21:16.700191 5120 generic.go:358] "Generic (PLEG): container finished" podID="dc8cc9c3-03de-4f16-887b-ed689ac4eb99" containerID="f0696664c4dc5eed3d986c6feafe1efa35ec333d6dadec50457d294d5d7390ce" exitCode=0 Mar 16 16:21:16 crc kubenswrapper[5120]: I0316 16:21:16.700215 5120 generic.go:358] "Generic (PLEG): container finished" podID="dc8cc9c3-03de-4f16-887b-ed689ac4eb99" containerID="c7415f2459acf4be6875a4aaa9a2d82e85a86bd82b444391788352b9e172cd06" exitCode=143 Mar 16 16:21:16 crc kubenswrapper[5120]: I0316 16:21:16.700238 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"dc8cc9c3-03de-4f16-887b-ed689ac4eb99","Type":"ContainerDied","Data":"f0696664c4dc5eed3d986c6feafe1efa35ec333d6dadec50457d294d5d7390ce"} Mar 16 16:21:16 crc kubenswrapper[5120]: I0316 16:21:16.700307 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"dc8cc9c3-03de-4f16-887b-ed689ac4eb99","Type":"ContainerDied","Data":"c7415f2459acf4be6875a4aaa9a2d82e85a86bd82b444391788352b9e172cd06"} Mar 16 16:21:16 crc kubenswrapper[5120]: I0316 16:21:16.700325 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"dc8cc9c3-03de-4f16-887b-ed689ac4eb99","Type":"ContainerDied","Data":"7f2086c80b8f95d0d58a4df94ecb6e5e87a94059a49b5eacce3b66b3c1f0053d"} Mar 16 16:21:16 crc kubenswrapper[5120]: I0316 16:21:16.700337 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7f2086c80b8f95d0d58a4df94ecb6e5e87a94059a49b5eacce3b66b3c1f0053d" Mar 16 16:21:16 crc kubenswrapper[5120]: I0316 16:21:16.700438 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:21:16 crc kubenswrapper[5120]: I0316 16:21:16.732638 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/84d11cfa-2a20-48a3-ba0e-7e7d80bef376-scripts\") pod \"84d11cfa-2a20-48a3-ba0e-7e7d80bef376\" (UID: \"84d11cfa-2a20-48a3-ba0e-7e7d80bef376\") " Mar 16 16:21:16 crc kubenswrapper[5120]: I0316 16:21:16.732752 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/84d11cfa-2a20-48a3-ba0e-7e7d80bef376-logs\") pod \"84d11cfa-2a20-48a3-ba0e-7e7d80bef376\" (UID: \"84d11cfa-2a20-48a3-ba0e-7e7d80bef376\") " Mar 16 16:21:16 crc kubenswrapper[5120]: I0316 16:21:16.732809 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l5kk8\" (UniqueName: \"kubernetes.io/projected/84d11cfa-2a20-48a3-ba0e-7e7d80bef376-kube-api-access-l5kk8\") pod \"84d11cfa-2a20-48a3-ba0e-7e7d80bef376\" (UID: \"84d11cfa-2a20-48a3-ba0e-7e7d80bef376\") " Mar 16 16:21:16 crc kubenswrapper[5120]: I0316 16:21:16.733167 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/84d11cfa-2a20-48a3-ba0e-7e7d80bef376-httpd-run\") pod \"84d11cfa-2a20-48a3-ba0e-7e7d80bef376\" (UID: \"84d11cfa-2a20-48a3-ba0e-7e7d80bef376\") " Mar 16 16:21:16 crc kubenswrapper[5120]: I0316 16:21:16.733228 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/84d11cfa-2a20-48a3-ba0e-7e7d80bef376-public-tls-certs\") pod \"84d11cfa-2a20-48a3-ba0e-7e7d80bef376\" (UID: \"84d11cfa-2a20-48a3-ba0e-7e7d80bef376\") " Mar 16 16:21:16 crc kubenswrapper[5120]: I0316 16:21:16.733298 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/84d11cfa-2a20-48a3-ba0e-7e7d80bef376-config-data\") pod \"84d11cfa-2a20-48a3-ba0e-7e7d80bef376\" (UID: \"84d11cfa-2a20-48a3-ba0e-7e7d80bef376\") " Mar 16 16:21:16 crc kubenswrapper[5120]: I0316 16:21:16.733617 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84d11cfa-2a20-48a3-ba0e-7e7d80bef376-logs" (OuterVolumeSpecName: "logs") pod "84d11cfa-2a20-48a3-ba0e-7e7d80bef376" (UID: "84d11cfa-2a20-48a3-ba0e-7e7d80bef376"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:21:16 crc kubenswrapper[5120]: I0316 16:21:16.734102 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/84d11cfa-2a20-48a3-ba0e-7e7d80bef376-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:21:16 crc kubenswrapper[5120]: I0316 16:21:16.734146 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage19-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") on node \"crc\" " Mar 16 16:21:16 crc kubenswrapper[5120]: I0316 16:21:16.734168 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/84d11cfa-2a20-48a3-ba0e-7e7d80bef376-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:21:16 crc kubenswrapper[5120]: I0316 16:21:16.734660 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84d11cfa-2a20-48a3-ba0e-7e7d80bef376-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "84d11cfa-2a20-48a3-ba0e-7e7d80bef376" (UID: "84d11cfa-2a20-48a3-ba0e-7e7d80bef376"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:21:16 crc kubenswrapper[5120]: I0316 16:21:16.739645 5120 scope.go:117] "RemoveContainer" containerID="9d1cc192494169d1b98ce6c285d93be953ab2e27d763d30e5e3e55d556beba2c" Mar 16 16:21:16 crc kubenswrapper[5120]: I0316 16:21:16.741526 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84d11cfa-2a20-48a3-ba0e-7e7d80bef376-kube-api-access-l5kk8" (OuterVolumeSpecName: "kube-api-access-l5kk8") pod "84d11cfa-2a20-48a3-ba0e-7e7d80bef376" (UID: "84d11cfa-2a20-48a3-ba0e-7e7d80bef376"). InnerVolumeSpecName "kube-api-access-l5kk8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:21:16 crc kubenswrapper[5120]: I0316 16:21:16.742258 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/84d11cfa-2a20-48a3-ba0e-7e7d80bef376-scripts" (OuterVolumeSpecName: "scripts") pod "84d11cfa-2a20-48a3-ba0e-7e7d80bef376" (UID: "84d11cfa-2a20-48a3-ba0e-7e7d80bef376"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:21:16 crc kubenswrapper[5120]: I0316 16:21:16.757867 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage19-crc" (UniqueName: "kubernetes.io/local-volume/local-storage19-crc") on node "crc" Mar 16 16:21:16 crc kubenswrapper[5120]: I0316 16:21:16.779626 5120 scope.go:117] "RemoveContainer" containerID="974bd308f1cb30877dd8d9a4ba646cbc0183492f30399b429d3491b947008c6d" Mar 16 16:21:16 crc kubenswrapper[5120]: E0316 16:21:16.779966 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"974bd308f1cb30877dd8d9a4ba646cbc0183492f30399b429d3491b947008c6d\": container with ID starting with 974bd308f1cb30877dd8d9a4ba646cbc0183492f30399b429d3491b947008c6d not found: ID does not exist" containerID="974bd308f1cb30877dd8d9a4ba646cbc0183492f30399b429d3491b947008c6d" Mar 16 16:21:16 crc kubenswrapper[5120]: I0316 16:21:16.779996 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"974bd308f1cb30877dd8d9a4ba646cbc0183492f30399b429d3491b947008c6d"} err="failed to get container status \"974bd308f1cb30877dd8d9a4ba646cbc0183492f30399b429d3491b947008c6d\": rpc error: code = NotFound desc = could not find container \"974bd308f1cb30877dd8d9a4ba646cbc0183492f30399b429d3491b947008c6d\": container with ID starting with 974bd308f1cb30877dd8d9a4ba646cbc0183492f30399b429d3491b947008c6d not found: ID does not exist" Mar 16 16:21:16 crc kubenswrapper[5120]: I0316 16:21:16.780019 5120 scope.go:117] "RemoveContainer" containerID="9d1cc192494169d1b98ce6c285d93be953ab2e27d763d30e5e3e55d556beba2c" Mar 16 16:21:16 crc kubenswrapper[5120]: E0316 16:21:16.780168 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d1cc192494169d1b98ce6c285d93be953ab2e27d763d30e5e3e55d556beba2c\": container with ID starting with 9d1cc192494169d1b98ce6c285d93be953ab2e27d763d30e5e3e55d556beba2c not found: ID does not exist" containerID="9d1cc192494169d1b98ce6c285d93be953ab2e27d763d30e5e3e55d556beba2c" Mar 16 16:21:16 crc kubenswrapper[5120]: I0316 16:21:16.780186 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d1cc192494169d1b98ce6c285d93be953ab2e27d763d30e5e3e55d556beba2c"} err="failed to get container status \"9d1cc192494169d1b98ce6c285d93be953ab2e27d763d30e5e3e55d556beba2c\": rpc error: code = NotFound desc = could not find container \"9d1cc192494169d1b98ce6c285d93be953ab2e27d763d30e5e3e55d556beba2c\": container with ID starting with 9d1cc192494169d1b98ce6c285d93be953ab2e27d763d30e5e3e55d556beba2c not found: ID does not exist" Mar 16 16:21:16 crc kubenswrapper[5120]: I0316 16:21:16.780198 5120 scope.go:117] "RemoveContainer" containerID="974bd308f1cb30877dd8d9a4ba646cbc0183492f30399b429d3491b947008c6d" Mar 16 16:21:16 crc kubenswrapper[5120]: I0316 16:21:16.780330 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"974bd308f1cb30877dd8d9a4ba646cbc0183492f30399b429d3491b947008c6d"} err="failed to get container status \"974bd308f1cb30877dd8d9a4ba646cbc0183492f30399b429d3491b947008c6d\": rpc error: code = NotFound desc = could not find container \"974bd308f1cb30877dd8d9a4ba646cbc0183492f30399b429d3491b947008c6d\": container with ID starting with 974bd308f1cb30877dd8d9a4ba646cbc0183492f30399b429d3491b947008c6d not found: ID does not exist" Mar 16 16:21:16 crc kubenswrapper[5120]: I0316 16:21:16.780347 5120 scope.go:117] "RemoveContainer" containerID="9d1cc192494169d1b98ce6c285d93be953ab2e27d763d30e5e3e55d556beba2c" Mar 16 16:21:16 crc kubenswrapper[5120]: I0316 16:21:16.780455 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d1cc192494169d1b98ce6c285d93be953ab2e27d763d30e5e3e55d556beba2c"} err="failed to get container status \"9d1cc192494169d1b98ce6c285d93be953ab2e27d763d30e5e3e55d556beba2c\": rpc error: code = NotFound desc = could not find container \"9d1cc192494169d1b98ce6c285d93be953ab2e27d763d30e5e3e55d556beba2c\": container with ID starting with 9d1cc192494169d1b98ce6c285d93be953ab2e27d763d30e5e3e55d556beba2c not found: ID does not exist" Mar 16 16:21:16 crc kubenswrapper[5120]: I0316 16:21:16.792457 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/84d11cfa-2a20-48a3-ba0e-7e7d80bef376-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "84d11cfa-2a20-48a3-ba0e-7e7d80bef376" (UID: "84d11cfa-2a20-48a3-ba0e-7e7d80bef376"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:21:16 crc kubenswrapper[5120]: I0316 16:21:16.798080 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/84d11cfa-2a20-48a3-ba0e-7e7d80bef376-config-data" (OuterVolumeSpecName: "config-data") pod "84d11cfa-2a20-48a3-ba0e-7e7d80bef376" (UID: "84d11cfa-2a20-48a3-ba0e-7e7d80bef376"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:21:16 crc kubenswrapper[5120]: I0316 16:21:16.835110 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dc8cc9c3-03de-4f16-887b-ed689ac4eb99-config-data\") pod \"dc8cc9c3-03de-4f16-887b-ed689ac4eb99\" (UID: \"dc8cc9c3-03de-4f16-887b-ed689ac4eb99\") " Mar 16 16:21:16 crc kubenswrapper[5120]: I0316 16:21:16.835167 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pq74w\" (UniqueName: \"kubernetes.io/projected/dc8cc9c3-03de-4f16-887b-ed689ac4eb99-kube-api-access-pq74w\") pod \"dc8cc9c3-03de-4f16-887b-ed689ac4eb99\" (UID: \"dc8cc9c3-03de-4f16-887b-ed689ac4eb99\") " Mar 16 16:21:16 crc kubenswrapper[5120]: I0316 16:21:16.835195 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"dc8cc9c3-03de-4f16-887b-ed689ac4eb99\" (UID: \"dc8cc9c3-03de-4f16-887b-ed689ac4eb99\") " Mar 16 16:21:16 crc kubenswrapper[5120]: I0316 16:21:16.835214 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/dc8cc9c3-03de-4f16-887b-ed689ac4eb99-internal-tls-certs\") pod \"dc8cc9c3-03de-4f16-887b-ed689ac4eb99\" (UID: \"dc8cc9c3-03de-4f16-887b-ed689ac4eb99\") " Mar 16 16:21:16 crc kubenswrapper[5120]: I0316 16:21:16.835288 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/dc8cc9c3-03de-4f16-887b-ed689ac4eb99-scripts\") pod \"dc8cc9c3-03de-4f16-887b-ed689ac4eb99\" (UID: \"dc8cc9c3-03de-4f16-887b-ed689ac4eb99\") " Mar 16 16:21:16 crc kubenswrapper[5120]: I0316 16:21:16.835378 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/dc8cc9c3-03de-4f16-887b-ed689ac4eb99-logs\") pod \"dc8cc9c3-03de-4f16-887b-ed689ac4eb99\" (UID: \"dc8cc9c3-03de-4f16-887b-ed689ac4eb99\") " Mar 16 16:21:16 crc kubenswrapper[5120]: I0316 16:21:16.835492 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/dc8cc9c3-03de-4f16-887b-ed689ac4eb99-httpd-run\") pod \"dc8cc9c3-03de-4f16-887b-ed689ac4eb99\" (UID: \"dc8cc9c3-03de-4f16-887b-ed689ac4eb99\") " Mar 16 16:21:16 crc kubenswrapper[5120]: I0316 16:21:16.835579 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dc8cc9c3-03de-4f16-887b-ed689ac4eb99-combined-ca-bundle\") pod \"dc8cc9c3-03de-4f16-887b-ed689ac4eb99\" (UID: \"dc8cc9c3-03de-4f16-887b-ed689ac4eb99\") " Mar 16 16:21:16 crc kubenswrapper[5120]: I0316 16:21:16.835997 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc8cc9c3-03de-4f16-887b-ed689ac4eb99-logs" (OuterVolumeSpecName: "logs") pod "dc8cc9c3-03de-4f16-887b-ed689ac4eb99" (UID: "dc8cc9c3-03de-4f16-887b-ed689ac4eb99"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:21:16 crc kubenswrapper[5120]: I0316 16:21:16.836358 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc8cc9c3-03de-4f16-887b-ed689ac4eb99-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "dc8cc9c3-03de-4f16-887b-ed689ac4eb99" (UID: "dc8cc9c3-03de-4f16-887b-ed689ac4eb99"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:21:16 crc kubenswrapper[5120]: I0316 16:21:16.836669 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/dc8cc9c3-03de-4f16-887b-ed689ac4eb99-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:21:16 crc kubenswrapper[5120]: I0316 16:21:16.836699 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/dc8cc9c3-03de-4f16-887b-ed689ac4eb99-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 16:21:16 crc kubenswrapper[5120]: I0316 16:21:16.836713 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/84d11cfa-2a20-48a3-ba0e-7e7d80bef376-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 16:21:16 crc kubenswrapper[5120]: I0316 16:21:16.836725 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/84d11cfa-2a20-48a3-ba0e-7e7d80bef376-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:21:16 crc kubenswrapper[5120]: I0316 16:21:16.836739 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/84d11cfa-2a20-48a3-ba0e-7e7d80bef376-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:21:16 crc kubenswrapper[5120]: I0316 16:21:16.836799 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/84d11cfa-2a20-48a3-ba0e-7e7d80bef376-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:21:16 crc kubenswrapper[5120]: I0316 16:21:16.836814 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l5kk8\" (UniqueName: \"kubernetes.io/projected/84d11cfa-2a20-48a3-ba0e-7e7d80bef376-kube-api-access-l5kk8\") on node \"crc\" DevicePath \"\"" Mar 16 16:21:16 crc kubenswrapper[5120]: I0316 16:21:16.836827 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage19-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:21:16 crc kubenswrapper[5120]: I0316 16:21:16.839647 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc8cc9c3-03de-4f16-887b-ed689ac4eb99-kube-api-access-pq74w" (OuterVolumeSpecName: "kube-api-access-pq74w") pod "dc8cc9c3-03de-4f16-887b-ed689ac4eb99" (UID: "dc8cc9c3-03de-4f16-887b-ed689ac4eb99"). InnerVolumeSpecName "kube-api-access-pq74w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:21:16 crc kubenswrapper[5120]: I0316 16:21:16.840734 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage20-crc" (OuterVolumeSpecName: "glance") pod "dc8cc9c3-03de-4f16-887b-ed689ac4eb99" (UID: "dc8cc9c3-03de-4f16-887b-ed689ac4eb99"). InnerVolumeSpecName "local-storage20-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:21:16 crc kubenswrapper[5120]: I0316 16:21:16.859965 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc8cc9c3-03de-4f16-887b-ed689ac4eb99-scripts" (OuterVolumeSpecName: "scripts") pod "dc8cc9c3-03de-4f16-887b-ed689ac4eb99" (UID: "dc8cc9c3-03de-4f16-887b-ed689ac4eb99"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:21:16 crc kubenswrapper[5120]: I0316 16:21:16.871119 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc8cc9c3-03de-4f16-887b-ed689ac4eb99-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "dc8cc9c3-03de-4f16-887b-ed689ac4eb99" (UID: "dc8cc9c3-03de-4f16-887b-ed689ac4eb99"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:21:16 crc kubenswrapper[5120]: I0316 16:21:16.888974 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc8cc9c3-03de-4f16-887b-ed689ac4eb99-config-data" (OuterVolumeSpecName: "config-data") pod "dc8cc9c3-03de-4f16-887b-ed689ac4eb99" (UID: "dc8cc9c3-03de-4f16-887b-ed689ac4eb99"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:21:16 crc kubenswrapper[5120]: I0316 16:21:16.897906 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc8cc9c3-03de-4f16-887b-ed689ac4eb99-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "dc8cc9c3-03de-4f16-887b-ed689ac4eb99" (UID: "dc8cc9c3-03de-4f16-887b-ed689ac4eb99"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:21:16 crc kubenswrapper[5120]: I0316 16:21:16.939210 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dc8cc9c3-03de-4f16-887b-ed689ac4eb99-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:21:16 crc kubenswrapper[5120]: I0316 16:21:16.939253 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dc8cc9c3-03de-4f16-887b-ed689ac4eb99-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:21:16 crc kubenswrapper[5120]: I0316 16:21:16.939267 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pq74w\" (UniqueName: \"kubernetes.io/projected/dc8cc9c3-03de-4f16-887b-ed689ac4eb99-kube-api-access-pq74w\") on node \"crc\" DevicePath \"\"" Mar 16 16:21:16 crc kubenswrapper[5120]: I0316 16:21:16.939309 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") on node \"crc\" " Mar 16 16:21:16 crc kubenswrapper[5120]: I0316 16:21:16.939321 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/dc8cc9c3-03de-4f16-887b-ed689ac4eb99-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:21:16 crc kubenswrapper[5120]: I0316 16:21:16.939333 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/dc8cc9c3-03de-4f16-887b-ed689ac4eb99-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:21:16 crc kubenswrapper[5120]: I0316 16:21:16.956403 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage20-crc" (UniqueName: "kubernetes.io/local-volume/local-storage20-crc") on node "crc" Mar 16 16:21:17 crc kubenswrapper[5120]: I0316 16:21:17.002271 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/watcher-db-sync-tlbgk" Mar 16 16:21:17 crc kubenswrapper[5120]: I0316 16:21:17.044145 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:21:17 crc kubenswrapper[5120]: I0316 16:21:17.088148 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:21:17 crc kubenswrapper[5120]: I0316 16:21:17.106292 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:21:17 crc kubenswrapper[5120]: I0316 16:21:17.126173 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:21:17 crc kubenswrapper[5120]: I0316 16:21:17.127497 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84d11cfa-2a20-48a3-ba0e-7e7d80bef376" containerName="glance-httpd" Mar 16 16:21:17 crc kubenswrapper[5120]: I0316 16:21:17.127531 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="84d11cfa-2a20-48a3-ba0e-7e7d80bef376" containerName="glance-httpd" Mar 16 16:21:17 crc kubenswrapper[5120]: I0316 16:21:17.127574 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84d11cfa-2a20-48a3-ba0e-7e7d80bef376" containerName="glance-log" Mar 16 16:21:17 crc kubenswrapper[5120]: I0316 16:21:17.127583 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="84d11cfa-2a20-48a3-ba0e-7e7d80bef376" containerName="glance-log" Mar 16 16:21:17 crc kubenswrapper[5120]: I0316 16:21:17.127601 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc8cc9c3-03de-4f16-887b-ed689ac4eb99" containerName="glance-log" Mar 16 16:21:17 crc kubenswrapper[5120]: I0316 16:21:17.127610 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc8cc9c3-03de-4f16-887b-ed689ac4eb99" containerName="glance-log" Mar 16 16:21:17 crc kubenswrapper[5120]: I0316 16:21:17.127625 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc8cc9c3-03de-4f16-887b-ed689ac4eb99" containerName="glance-httpd" Mar 16 16:21:17 crc kubenswrapper[5120]: I0316 16:21:17.127632 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc8cc9c3-03de-4f16-887b-ed689ac4eb99" containerName="glance-httpd" Mar 16 16:21:17 crc kubenswrapper[5120]: I0316 16:21:17.127664 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75f1b7f4-9fac-4135-819b-8eab79df5cf9" containerName="watcher-db-sync" Mar 16 16:21:17 crc kubenswrapper[5120]: I0316 16:21:17.127671 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="75f1b7f4-9fac-4135-819b-8eab79df5cf9" containerName="watcher-db-sync" Mar 16 16:21:17 crc kubenswrapper[5120]: I0316 16:21:17.127892 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="84d11cfa-2a20-48a3-ba0e-7e7d80bef376" containerName="glance-log" Mar 16 16:21:17 crc kubenswrapper[5120]: I0316 16:21:17.127915 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="dc8cc9c3-03de-4f16-887b-ed689ac4eb99" containerName="glance-httpd" Mar 16 16:21:17 crc kubenswrapper[5120]: I0316 16:21:17.127925 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="84d11cfa-2a20-48a3-ba0e-7e7d80bef376" containerName="glance-httpd" Mar 16 16:21:17 crc kubenswrapper[5120]: I0316 16:21:17.127944 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="dc8cc9c3-03de-4f16-887b-ed689ac4eb99" containerName="glance-log" Mar 16 16:21:17 crc kubenswrapper[5120]: I0316 16:21:17.127958 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="75f1b7f4-9fac-4135-819b-8eab79df5cf9" containerName="watcher-db-sync" Mar 16 16:21:17 crc kubenswrapper[5120]: I0316 16:21:17.133268 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:21:17 crc kubenswrapper[5120]: I0316 16:21:17.135586 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-public-svc\"" Mar 16 16:21:17 crc kubenswrapper[5120]: I0316 16:21:17.137838 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-external-config-data\"" Mar 16 16:21:17 crc kubenswrapper[5120]: I0316 16:21:17.146374 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/75f1b7f4-9fac-4135-819b-8eab79df5cf9-db-sync-config-data\") pod \"75f1b7f4-9fac-4135-819b-8eab79df5cf9\" (UID: \"75f1b7f4-9fac-4135-819b-8eab79df5cf9\") " Mar 16 16:21:17 crc kubenswrapper[5120]: I0316 16:21:17.146416 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/75f1b7f4-9fac-4135-819b-8eab79df5cf9-config-data\") pod \"75f1b7f4-9fac-4135-819b-8eab79df5cf9\" (UID: \"75f1b7f4-9fac-4135-819b-8eab79df5cf9\") " Mar 16 16:21:17 crc kubenswrapper[5120]: I0316 16:21:17.146452 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w2th8\" (UniqueName: \"kubernetes.io/projected/75f1b7f4-9fac-4135-819b-8eab79df5cf9-kube-api-access-w2th8\") pod \"75f1b7f4-9fac-4135-819b-8eab79df5cf9\" (UID: \"75f1b7f4-9fac-4135-819b-8eab79df5cf9\") " Mar 16 16:21:17 crc kubenswrapper[5120]: I0316 16:21:17.146668 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/75f1b7f4-9fac-4135-819b-8eab79df5cf9-combined-ca-bundle\") pod \"75f1b7f4-9fac-4135-819b-8eab79df5cf9\" (UID: \"75f1b7f4-9fac-4135-819b-8eab79df5cf9\") " Mar 16 16:21:17 crc kubenswrapper[5120]: I0316 16:21:17.153704 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75f1b7f4-9fac-4135-819b-8eab79df5cf9-kube-api-access-w2th8" (OuterVolumeSpecName: "kube-api-access-w2th8") pod "75f1b7f4-9fac-4135-819b-8eab79df5cf9" (UID: "75f1b7f4-9fac-4135-819b-8eab79df5cf9"). InnerVolumeSpecName "kube-api-access-w2th8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:21:17 crc kubenswrapper[5120]: I0316 16:21:17.154785 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75f1b7f4-9fac-4135-819b-8eab79df5cf9-db-sync-config-data" (OuterVolumeSpecName: "db-sync-config-data") pod "75f1b7f4-9fac-4135-819b-8eab79df5cf9" (UID: "75f1b7f4-9fac-4135-819b-8eab79df5cf9"). InnerVolumeSpecName "db-sync-config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:21:17 crc kubenswrapper[5120]: I0316 16:21:17.165045 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:21:17 crc kubenswrapper[5120]: I0316 16:21:17.185111 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75f1b7f4-9fac-4135-819b-8eab79df5cf9-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "75f1b7f4-9fac-4135-819b-8eab79df5cf9" (UID: "75f1b7f4-9fac-4135-819b-8eab79df5cf9"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:21:17 crc kubenswrapper[5120]: I0316 16:21:17.193208 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75f1b7f4-9fac-4135-819b-8eab79df5cf9-config-data" (OuterVolumeSpecName: "config-data") pod "75f1b7f4-9fac-4135-819b-8eab79df5cf9" (UID: "75f1b7f4-9fac-4135-819b-8eab79df5cf9"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:21:17 crc kubenswrapper[5120]: I0316 16:21:17.250302 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3b45ef4a-c2e4-4ddb-b51f-aaaaac181aac-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"3b45ef4a-c2e4-4ddb-b51f-aaaaac181aac\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:21:17 crc kubenswrapper[5120]: I0316 16:21:17.250411 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/3b45ef4a-c2e4-4ddb-b51f-aaaaac181aac-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"3b45ef4a-c2e4-4ddb-b51f-aaaaac181aac\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:21:17 crc kubenswrapper[5120]: I0316 16:21:17.250676 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmqlk\" (UniqueName: \"kubernetes.io/projected/3b45ef4a-c2e4-4ddb-b51f-aaaaac181aac-kube-api-access-jmqlk\") pod \"glance-default-external-api-0\" (UID: \"3b45ef4a-c2e4-4ddb-b51f-aaaaac181aac\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:21:17 crc kubenswrapper[5120]: I0316 16:21:17.250864 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3b45ef4a-c2e4-4ddb-b51f-aaaaac181aac-config-data\") pod \"glance-default-external-api-0\" (UID: \"3b45ef4a-c2e4-4ddb-b51f-aaaaac181aac\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:21:17 crc kubenswrapper[5120]: I0316 16:21:17.250925 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/3b45ef4a-c2e4-4ddb-b51f-aaaaac181aac-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"3b45ef4a-c2e4-4ddb-b51f-aaaaac181aac\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:21:17 crc kubenswrapper[5120]: I0316 16:21:17.250980 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3b45ef4a-c2e4-4ddb-b51f-aaaaac181aac-logs\") pod \"glance-default-external-api-0\" (UID: \"3b45ef4a-c2e4-4ddb-b51f-aaaaac181aac\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:21:17 crc kubenswrapper[5120]: I0316 16:21:17.251006 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3b45ef4a-c2e4-4ddb-b51f-aaaaac181aac-scripts\") pod \"glance-default-external-api-0\" (UID: \"3b45ef4a-c2e4-4ddb-b51f-aaaaac181aac\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:21:17 crc kubenswrapper[5120]: I0316 16:21:17.251238 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage19-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") pod \"glance-default-external-api-0\" (UID: \"3b45ef4a-c2e4-4ddb-b51f-aaaaac181aac\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:21:17 crc kubenswrapper[5120]: I0316 16:21:17.251355 5120 reconciler_common.go:299] "Volume detached for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/75f1b7f4-9fac-4135-819b-8eab79df5cf9-db-sync-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:21:17 crc kubenswrapper[5120]: I0316 16:21:17.251372 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/75f1b7f4-9fac-4135-819b-8eab79df5cf9-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:21:17 crc kubenswrapper[5120]: I0316 16:21:17.251382 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w2th8\" (UniqueName: \"kubernetes.io/projected/75f1b7f4-9fac-4135-819b-8eab79df5cf9-kube-api-access-w2th8\") on node \"crc\" DevicePath \"\"" Mar 16 16:21:17 crc kubenswrapper[5120]: I0316 16:21:17.251394 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/75f1b7f4-9fac-4135-819b-8eab79df5cf9-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:21:17 crc kubenswrapper[5120]: I0316 16:21:17.362017 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/3b45ef4a-c2e4-4ddb-b51f-aaaaac181aac-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"3b45ef4a-c2e4-4ddb-b51f-aaaaac181aac\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:21:17 crc kubenswrapper[5120]: I0316 16:21:17.362063 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3b45ef4a-c2e4-4ddb-b51f-aaaaac181aac-logs\") pod \"glance-default-external-api-0\" (UID: \"3b45ef4a-c2e4-4ddb-b51f-aaaaac181aac\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:21:17 crc kubenswrapper[5120]: I0316 16:21:17.362087 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3b45ef4a-c2e4-4ddb-b51f-aaaaac181aac-scripts\") pod \"glance-default-external-api-0\" (UID: \"3b45ef4a-c2e4-4ddb-b51f-aaaaac181aac\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:21:17 crc kubenswrapper[5120]: I0316 16:21:17.362180 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage19-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") pod \"glance-default-external-api-0\" (UID: \"3b45ef4a-c2e4-4ddb-b51f-aaaaac181aac\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:21:17 crc kubenswrapper[5120]: I0316 16:21:17.362235 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3b45ef4a-c2e4-4ddb-b51f-aaaaac181aac-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"3b45ef4a-c2e4-4ddb-b51f-aaaaac181aac\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:21:17 crc kubenswrapper[5120]: I0316 16:21:17.362257 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/3b45ef4a-c2e4-4ddb-b51f-aaaaac181aac-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"3b45ef4a-c2e4-4ddb-b51f-aaaaac181aac\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:21:17 crc kubenswrapper[5120]: I0316 16:21:17.362340 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jmqlk\" (UniqueName: \"kubernetes.io/projected/3b45ef4a-c2e4-4ddb-b51f-aaaaac181aac-kube-api-access-jmqlk\") pod \"glance-default-external-api-0\" (UID: \"3b45ef4a-c2e4-4ddb-b51f-aaaaac181aac\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:21:17 crc kubenswrapper[5120]: I0316 16:21:17.362404 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3b45ef4a-c2e4-4ddb-b51f-aaaaac181aac-config-data\") pod \"glance-default-external-api-0\" (UID: \"3b45ef4a-c2e4-4ddb-b51f-aaaaac181aac\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:21:17 crc kubenswrapper[5120]: I0316 16:21:17.363392 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/3b45ef4a-c2e4-4ddb-b51f-aaaaac181aac-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"3b45ef4a-c2e4-4ddb-b51f-aaaaac181aac\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:21:17 crc kubenswrapper[5120]: I0316 16:21:17.366489 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3b45ef4a-c2e4-4ddb-b51f-aaaaac181aac-scripts\") pod \"glance-default-external-api-0\" (UID: \"3b45ef4a-c2e4-4ddb-b51f-aaaaac181aac\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:21:17 crc kubenswrapper[5120]: I0316 16:21:17.366864 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/3b45ef4a-c2e4-4ddb-b51f-aaaaac181aac-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"3b45ef4a-c2e4-4ddb-b51f-aaaaac181aac\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:21:17 crc kubenswrapper[5120]: I0316 16:21:17.367250 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3b45ef4a-c2e4-4ddb-b51f-aaaaac181aac-logs\") pod \"glance-default-external-api-0\" (UID: \"3b45ef4a-c2e4-4ddb-b51f-aaaaac181aac\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:21:17 crc kubenswrapper[5120]: I0316 16:21:17.368833 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3b45ef4a-c2e4-4ddb-b51f-aaaaac181aac-config-data\") pod \"glance-default-external-api-0\" (UID: \"3b45ef4a-c2e4-4ddb-b51f-aaaaac181aac\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:21:17 crc kubenswrapper[5120]: I0316 16:21:17.369025 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage19-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") pod \"glance-default-external-api-0\" (UID: \"3b45ef4a-c2e4-4ddb-b51f-aaaaac181aac\") device mount path \"/mnt/openstack/pv19\"" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:21:17 crc kubenswrapper[5120]: I0316 16:21:17.371082 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3b45ef4a-c2e4-4ddb-b51f-aaaaac181aac-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"3b45ef4a-c2e4-4ddb-b51f-aaaaac181aac\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:21:17 crc kubenswrapper[5120]: I0316 16:21:17.379376 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmqlk\" (UniqueName: \"kubernetes.io/projected/3b45ef4a-c2e4-4ddb-b51f-aaaaac181aac-kube-api-access-jmqlk\") pod \"glance-default-external-api-0\" (UID: \"3b45ef4a-c2e4-4ddb-b51f-aaaaac181aac\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:21:17 crc kubenswrapper[5120]: I0316 16:21:17.391810 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage19-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") pod \"glance-default-external-api-0\" (UID: \"3b45ef4a-c2e4-4ddb-b51f-aaaaac181aac\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:21:17 crc kubenswrapper[5120]: I0316 16:21:17.553795 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:21:17 crc kubenswrapper[5120]: I0316 16:21:17.664336 5120 scope.go:117] "RemoveContainer" containerID="f40e444f89abd558ac90555bfd58e04a1c4379a653ba8035c228d2b7a5443eb5" Mar 16 16:21:17 crc kubenswrapper[5120]: E0316 16:21:17.664888 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:21:17 crc kubenswrapper[5120]: I0316 16:21:17.727346 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/watcher-db-sync-tlbgk" event={"ID":"75f1b7f4-9fac-4135-819b-8eab79df5cf9","Type":"ContainerDied","Data":"1945f3ecb15c8c8d42295da4b252af1f066fd07b5c2cea9778e5e414f531f180"} Mar 16 16:21:17 crc kubenswrapper[5120]: I0316 16:21:17.727384 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1945f3ecb15c8c8d42295da4b252af1f066fd07b5c2cea9778e5e414f531f180" Mar 16 16:21:17 crc kubenswrapper[5120]: I0316 16:21:17.727446 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/watcher-db-sync-tlbgk" Mar 16 16:21:17 crc kubenswrapper[5120]: I0316 16:21:17.745685 5120 generic.go:358] "Generic (PLEG): container finished" podID="356bec90-b61f-42ca-85ea-9b25a263f3e5" containerID="d63fb9b48fd6b1db0dec801b87cbcaa22743a49a59e9f7e340af855fa43fafc8" exitCode=0 Mar 16 16:21:17 crc kubenswrapper[5120]: I0316 16:21:17.746018 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-k6l62" event={"ID":"356bec90-b61f-42ca-85ea-9b25a263f3e5","Type":"ContainerDied","Data":"d63fb9b48fd6b1db0dec801b87cbcaa22743a49a59e9f7e340af855fa43fafc8"} Mar 16 16:21:17 crc kubenswrapper[5120]: I0316 16:21:17.753398 5120 generic.go:358] "Generic (PLEG): container finished" podID="8d540ae4-9eb1-4540-bb5b-4035063b47ca" containerID="a9d5fa9921a3eb3e26ff72411dfd9d087b678c51ac514abab8dca1272664f813" exitCode=0 Mar 16 16:21:17 crc kubenswrapper[5120]: I0316 16:21:17.753603 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-xbzfv" event={"ID":"8d540ae4-9eb1-4540-bb5b-4035063b47ca","Type":"ContainerDied","Data":"a9d5fa9921a3eb3e26ff72411dfd9d087b678c51ac514abab8dca1272664f813"} Mar 16 16:21:17 crc kubenswrapper[5120]: I0316 16:21:17.755709 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:21:17 crc kubenswrapper[5120]: I0316 16:21:17.810938 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:21:17 crc kubenswrapper[5120]: I0316 16:21:17.826842 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:21:17 crc kubenswrapper[5120]: I0316 16:21:17.840797 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:21:17 crc kubenswrapper[5120]: I0316 16:21:17.856130 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:21:17 crc kubenswrapper[5120]: I0316 16:21:17.859544 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-internal-config-data\"" Mar 16 16:21:17 crc kubenswrapper[5120]: I0316 16:21:17.860440 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-internal-svc\"" Mar 16 16:21:17 crc kubenswrapper[5120]: I0316 16:21:17.919835 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:21:17 crc kubenswrapper[5120]: I0316 16:21:17.979784 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c99f889b-8cce-419b-bea2-16bbac703bca-scripts\") pod \"glance-default-internal-api-0\" (UID: \"c99f889b-8cce-419b-bea2-16bbac703bca\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:21:17 crc kubenswrapper[5120]: I0316 16:21:17.979850 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c99f889b-8cce-419b-bea2-16bbac703bca-config-data\") pod \"glance-default-internal-api-0\" (UID: \"c99f889b-8cce-419b-bea2-16bbac703bca\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:21:17 crc kubenswrapper[5120]: I0316 16:21:17.979882 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgkwj\" (UniqueName: \"kubernetes.io/projected/c99f889b-8cce-419b-bea2-16bbac703bca-kube-api-access-fgkwj\") pod \"glance-default-internal-api-0\" (UID: \"c99f889b-8cce-419b-bea2-16bbac703bca\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:21:17 crc kubenswrapper[5120]: I0316 16:21:17.979934 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c99f889b-8cce-419b-bea2-16bbac703bca-logs\") pod \"glance-default-internal-api-0\" (UID: \"c99f889b-8cce-419b-bea2-16bbac703bca\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:21:17 crc kubenswrapper[5120]: I0316 16:21:17.979948 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/c99f889b-8cce-419b-bea2-16bbac703bca-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"c99f889b-8cce-419b-bea2-16bbac703bca\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:21:17 crc kubenswrapper[5120]: I0316 16:21:17.980003 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c99f889b-8cce-419b-bea2-16bbac703bca-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"c99f889b-8cce-419b-bea2-16bbac703bca\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:21:17 crc kubenswrapper[5120]: I0316 16:21:17.980019 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/c99f889b-8cce-419b-bea2-16bbac703bca-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"c99f889b-8cce-419b-bea2-16bbac703bca\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:21:17 crc kubenswrapper[5120]: I0316 16:21:17.980064 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"glance-default-internal-api-0\" (UID: \"c99f889b-8cce-419b-bea2-16bbac703bca\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:21:18 crc kubenswrapper[5120]: I0316 16:21:18.014303 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/watcher-api-0"] Mar 16 16:21:18 crc kubenswrapper[5120]: I0316 16:21:18.027517 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/watcher-api-0"] Mar 16 16:21:18 crc kubenswrapper[5120]: I0316 16:21:18.027661 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/watcher-api-0" Mar 16 16:21:18 crc kubenswrapper[5120]: I0316 16:21:18.033395 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"watcher-watcher-dockercfg-sctn4\"" Mar 16 16:21:18 crc kubenswrapper[5120]: I0316 16:21:18.033643 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"watcher-api-config-data\"" Mar 16 16:21:18 crc kubenswrapper[5120]: I0316 16:21:18.050517 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/watcher-applier-0"] Mar 16 16:21:18 crc kubenswrapper[5120]: I0316 16:21:18.055820 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/watcher-applier-0" Mar 16 16:21:18 crc kubenswrapper[5120]: I0316 16:21:18.057775 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"watcher-applier-config-data\"" Mar 16 16:21:18 crc kubenswrapper[5120]: I0316 16:21:18.067165 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/watcher-applier-0"] Mar 16 16:21:18 crc kubenswrapper[5120]: I0316 16:21:18.080039 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:21:18 crc kubenswrapper[5120]: I0316 16:21:18.082770 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c99f889b-8cce-419b-bea2-16bbac703bca-scripts\") pod \"glance-default-internal-api-0\" (UID: \"c99f889b-8cce-419b-bea2-16bbac703bca\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:21:18 crc kubenswrapper[5120]: I0316 16:21:18.082818 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c99f889b-8cce-419b-bea2-16bbac703bca-config-data\") pod \"glance-default-internal-api-0\" (UID: \"c99f889b-8cce-419b-bea2-16bbac703bca\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:21:18 crc kubenswrapper[5120]: I0316 16:21:18.082860 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fgkwj\" (UniqueName: \"kubernetes.io/projected/c99f889b-8cce-419b-bea2-16bbac703bca-kube-api-access-fgkwj\") pod \"glance-default-internal-api-0\" (UID: \"c99f889b-8cce-419b-bea2-16bbac703bca\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:21:18 crc kubenswrapper[5120]: I0316 16:21:18.082930 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c99f889b-8cce-419b-bea2-16bbac703bca-logs\") pod \"glance-default-internal-api-0\" (UID: \"c99f889b-8cce-419b-bea2-16bbac703bca\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:21:18 crc kubenswrapper[5120]: I0316 16:21:18.082946 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/c99f889b-8cce-419b-bea2-16bbac703bca-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"c99f889b-8cce-419b-bea2-16bbac703bca\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:21:18 crc kubenswrapper[5120]: I0316 16:21:18.083022 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c99f889b-8cce-419b-bea2-16bbac703bca-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"c99f889b-8cce-419b-bea2-16bbac703bca\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:21:18 crc kubenswrapper[5120]: I0316 16:21:18.083040 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/c99f889b-8cce-419b-bea2-16bbac703bca-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"c99f889b-8cce-419b-bea2-16bbac703bca\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:21:18 crc kubenswrapper[5120]: I0316 16:21:18.083093 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"glance-default-internal-api-0\" (UID: \"c99f889b-8cce-419b-bea2-16bbac703bca\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:21:18 crc kubenswrapper[5120]: I0316 16:21:18.083429 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"glance-default-internal-api-0\" (UID: \"c99f889b-8cce-419b-bea2-16bbac703bca\") device mount path \"/mnt/openstack/pv20\"" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:21:18 crc kubenswrapper[5120]: I0316 16:21:18.085776 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c99f889b-8cce-419b-bea2-16bbac703bca-logs\") pod \"glance-default-internal-api-0\" (UID: \"c99f889b-8cce-419b-bea2-16bbac703bca\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:21:18 crc kubenswrapper[5120]: I0316 16:21:18.086934 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/c99f889b-8cce-419b-bea2-16bbac703bca-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"c99f889b-8cce-419b-bea2-16bbac703bca\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:21:18 crc kubenswrapper[5120]: I0316 16:21:18.091969 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c99f889b-8cce-419b-bea2-16bbac703bca-scripts\") pod \"glance-default-internal-api-0\" (UID: \"c99f889b-8cce-419b-bea2-16bbac703bca\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:21:18 crc kubenswrapper[5120]: I0316 16:21:18.097566 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c99f889b-8cce-419b-bea2-16bbac703bca-config-data\") pod \"glance-default-internal-api-0\" (UID: \"c99f889b-8cce-419b-bea2-16bbac703bca\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:21:18 crc kubenswrapper[5120]: I0316 16:21:18.106706 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgkwj\" (UniqueName: \"kubernetes.io/projected/c99f889b-8cce-419b-bea2-16bbac703bca-kube-api-access-fgkwj\") pod \"glance-default-internal-api-0\" (UID: \"c99f889b-8cce-419b-bea2-16bbac703bca\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:21:18 crc kubenswrapper[5120]: I0316 16:21:18.108989 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c99f889b-8cce-419b-bea2-16bbac703bca-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"c99f889b-8cce-419b-bea2-16bbac703bca\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:21:18 crc kubenswrapper[5120]: I0316 16:21:18.132348 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/c99f889b-8cce-419b-bea2-16bbac703bca-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"c99f889b-8cce-419b-bea2-16bbac703bca\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:21:18 crc kubenswrapper[5120]: I0316 16:21:18.185424 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"custom-prometheus-ca\" (UniqueName: \"kubernetes.io/secret/d8c78a81-c746-4232-9442-b648cd62f793-custom-prometheus-ca\") pod \"watcher-api-0\" (UID: \"d8c78a81-c746-4232-9442-b648cd62f793\") " pod="openstack-kuttl-tests/watcher-api-0" Mar 16 16:21:18 crc kubenswrapper[5120]: I0316 16:21:18.185522 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d5160b65-3a41-4645-9f47-bd4e891fef5f-combined-ca-bundle\") pod \"watcher-applier-0\" (UID: \"d5160b65-3a41-4645-9f47-bd4e891fef5f\") " pod="openstack-kuttl-tests/watcher-applier-0" Mar 16 16:21:18 crc kubenswrapper[5120]: I0316 16:21:18.185546 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d8c78a81-c746-4232-9442-b648cd62f793-config-data\") pod \"watcher-api-0\" (UID: \"d8c78a81-c746-4232-9442-b648cd62f793\") " pod="openstack-kuttl-tests/watcher-api-0" Mar 16 16:21:18 crc kubenswrapper[5120]: I0316 16:21:18.185562 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d5160b65-3a41-4645-9f47-bd4e891fef5f-logs\") pod \"watcher-applier-0\" (UID: \"d5160b65-3a41-4645-9f47-bd4e891fef5f\") " pod="openstack-kuttl-tests/watcher-applier-0" Mar 16 16:21:18 crc kubenswrapper[5120]: I0316 16:21:18.185622 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4bgkg\" (UniqueName: \"kubernetes.io/projected/d5160b65-3a41-4645-9f47-bd4e891fef5f-kube-api-access-4bgkg\") pod \"watcher-applier-0\" (UID: \"d5160b65-3a41-4645-9f47-bd4e891fef5f\") " pod="openstack-kuttl-tests/watcher-applier-0" Mar 16 16:21:18 crc kubenswrapper[5120]: I0316 16:21:18.185650 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d8c78a81-c746-4232-9442-b648cd62f793-combined-ca-bundle\") pod \"watcher-api-0\" (UID: \"d8c78a81-c746-4232-9442-b648cd62f793\") " pod="openstack-kuttl-tests/watcher-api-0" Mar 16 16:21:18 crc kubenswrapper[5120]: I0316 16:21:18.185744 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d5160b65-3a41-4645-9f47-bd4e891fef5f-config-data\") pod \"watcher-applier-0\" (UID: \"d5160b65-3a41-4645-9f47-bd4e891fef5f\") " pod="openstack-kuttl-tests/watcher-applier-0" Mar 16 16:21:18 crc kubenswrapper[5120]: I0316 16:21:18.185807 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42rg4\" (UniqueName: \"kubernetes.io/projected/d8c78a81-c746-4232-9442-b648cd62f793-kube-api-access-42rg4\") pod \"watcher-api-0\" (UID: \"d8c78a81-c746-4232-9442-b648cd62f793\") " pod="openstack-kuttl-tests/watcher-api-0" Mar 16 16:21:18 crc kubenswrapper[5120]: I0316 16:21:18.185847 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d8c78a81-c746-4232-9442-b648cd62f793-logs\") pod \"watcher-api-0\" (UID: \"d8c78a81-c746-4232-9442-b648cd62f793\") " pod="openstack-kuttl-tests/watcher-api-0" Mar 16 16:21:18 crc kubenswrapper[5120]: I0316 16:21:18.237697 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/watcher-decision-engine-0"] Mar 16 16:21:18 crc kubenswrapper[5120]: I0316 16:21:18.252040 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/watcher-decision-engine-0"] Mar 16 16:21:18 crc kubenswrapper[5120]: I0316 16:21:18.252517 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/watcher-decision-engine-0" Mar 16 16:21:18 crc kubenswrapper[5120]: I0316 16:21:18.257016 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"watcher-decision-engine-config-data\"" Mar 16 16:21:18 crc kubenswrapper[5120]: I0316 16:21:18.264789 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"glance-default-internal-api-0\" (UID: \"c99f889b-8cce-419b-bea2-16bbac703bca\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:21:18 crc kubenswrapper[5120]: I0316 16:21:18.287750 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d8c78a81-c746-4232-9442-b648cd62f793-config-data\") pod \"watcher-api-0\" (UID: \"d8c78a81-c746-4232-9442-b648cd62f793\") " pod="openstack-kuttl-tests/watcher-api-0" Mar 16 16:21:18 crc kubenswrapper[5120]: I0316 16:21:18.287804 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d5160b65-3a41-4645-9f47-bd4e891fef5f-logs\") pod \"watcher-applier-0\" (UID: \"d5160b65-3a41-4645-9f47-bd4e891fef5f\") " pod="openstack-kuttl-tests/watcher-applier-0" Mar 16 16:21:18 crc kubenswrapper[5120]: I0316 16:21:18.287864 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4bgkg\" (UniqueName: \"kubernetes.io/projected/d5160b65-3a41-4645-9f47-bd4e891fef5f-kube-api-access-4bgkg\") pod \"watcher-applier-0\" (UID: \"d5160b65-3a41-4645-9f47-bd4e891fef5f\") " pod="openstack-kuttl-tests/watcher-applier-0" Mar 16 16:21:18 crc kubenswrapper[5120]: I0316 16:21:18.287891 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d8c78a81-c746-4232-9442-b648cd62f793-combined-ca-bundle\") pod \"watcher-api-0\" (UID: \"d8c78a81-c746-4232-9442-b648cd62f793\") " pod="openstack-kuttl-tests/watcher-api-0" Mar 16 16:21:18 crc kubenswrapper[5120]: I0316 16:21:18.287963 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d5160b65-3a41-4645-9f47-bd4e891fef5f-config-data\") pod \"watcher-applier-0\" (UID: \"d5160b65-3a41-4645-9f47-bd4e891fef5f\") " pod="openstack-kuttl-tests/watcher-applier-0" Mar 16 16:21:18 crc kubenswrapper[5120]: I0316 16:21:18.288001 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-42rg4\" (UniqueName: \"kubernetes.io/projected/d8c78a81-c746-4232-9442-b648cd62f793-kube-api-access-42rg4\") pod \"watcher-api-0\" (UID: \"d8c78a81-c746-4232-9442-b648cd62f793\") " pod="openstack-kuttl-tests/watcher-api-0" Mar 16 16:21:18 crc kubenswrapper[5120]: I0316 16:21:18.288027 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d8c78a81-c746-4232-9442-b648cd62f793-logs\") pod \"watcher-api-0\" (UID: \"d8c78a81-c746-4232-9442-b648cd62f793\") " pod="openstack-kuttl-tests/watcher-api-0" Mar 16 16:21:18 crc kubenswrapper[5120]: I0316 16:21:18.288088 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"custom-prometheus-ca\" (UniqueName: \"kubernetes.io/secret/d8c78a81-c746-4232-9442-b648cd62f793-custom-prometheus-ca\") pod \"watcher-api-0\" (UID: \"d8c78a81-c746-4232-9442-b648cd62f793\") " pod="openstack-kuttl-tests/watcher-api-0" Mar 16 16:21:18 crc kubenswrapper[5120]: I0316 16:21:18.288151 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d5160b65-3a41-4645-9f47-bd4e891fef5f-combined-ca-bundle\") pod \"watcher-applier-0\" (UID: \"d5160b65-3a41-4645-9f47-bd4e891fef5f\") " pod="openstack-kuttl-tests/watcher-applier-0" Mar 16 16:21:18 crc kubenswrapper[5120]: I0316 16:21:18.288297 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d5160b65-3a41-4645-9f47-bd4e891fef5f-logs\") pod \"watcher-applier-0\" (UID: \"d5160b65-3a41-4645-9f47-bd4e891fef5f\") " pod="openstack-kuttl-tests/watcher-applier-0" Mar 16 16:21:18 crc kubenswrapper[5120]: I0316 16:21:18.288701 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d8c78a81-c746-4232-9442-b648cd62f793-logs\") pod \"watcher-api-0\" (UID: \"d8c78a81-c746-4232-9442-b648cd62f793\") " pod="openstack-kuttl-tests/watcher-api-0" Mar 16 16:21:18 crc kubenswrapper[5120]: I0316 16:21:18.292134 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d8c78a81-c746-4232-9442-b648cd62f793-combined-ca-bundle\") pod \"watcher-api-0\" (UID: \"d8c78a81-c746-4232-9442-b648cd62f793\") " pod="openstack-kuttl-tests/watcher-api-0" Mar 16 16:21:18 crc kubenswrapper[5120]: I0316 16:21:18.292131 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d5160b65-3a41-4645-9f47-bd4e891fef5f-config-data\") pod \"watcher-applier-0\" (UID: \"d5160b65-3a41-4645-9f47-bd4e891fef5f\") " pod="openstack-kuttl-tests/watcher-applier-0" Mar 16 16:21:18 crc kubenswrapper[5120]: I0316 16:21:18.292662 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d5160b65-3a41-4645-9f47-bd4e891fef5f-combined-ca-bundle\") pod \"watcher-applier-0\" (UID: \"d5160b65-3a41-4645-9f47-bd4e891fef5f\") " pod="openstack-kuttl-tests/watcher-applier-0" Mar 16 16:21:18 crc kubenswrapper[5120]: I0316 16:21:18.294281 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d8c78a81-c746-4232-9442-b648cd62f793-config-data\") pod \"watcher-api-0\" (UID: \"d8c78a81-c746-4232-9442-b648cd62f793\") " pod="openstack-kuttl-tests/watcher-api-0" Mar 16 16:21:18 crc kubenswrapper[5120]: I0316 16:21:18.314481 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"custom-prometheus-ca\" (UniqueName: \"kubernetes.io/secret/d8c78a81-c746-4232-9442-b648cd62f793-custom-prometheus-ca\") pod \"watcher-api-0\" (UID: \"d8c78a81-c746-4232-9442-b648cd62f793\") " pod="openstack-kuttl-tests/watcher-api-0" Mar 16 16:21:18 crc kubenswrapper[5120]: I0316 16:21:18.322064 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-42rg4\" (UniqueName: \"kubernetes.io/projected/d8c78a81-c746-4232-9442-b648cd62f793-kube-api-access-42rg4\") pod \"watcher-api-0\" (UID: \"d8c78a81-c746-4232-9442-b648cd62f793\") " pod="openstack-kuttl-tests/watcher-api-0" Mar 16 16:21:18 crc kubenswrapper[5120]: I0316 16:21:18.326095 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bgkg\" (UniqueName: \"kubernetes.io/projected/d5160b65-3a41-4645-9f47-bd4e891fef5f-kube-api-access-4bgkg\") pod \"watcher-applier-0\" (UID: \"d5160b65-3a41-4645-9f47-bd4e891fef5f\") " pod="openstack-kuttl-tests/watcher-applier-0" Mar 16 16:21:18 crc kubenswrapper[5120]: I0316 16:21:18.360377 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-nwmkm" Mar 16 16:21:18 crc kubenswrapper[5120]: I0316 16:21:18.390428 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/447d5bb0-18ef-4779-8b6a-a4a96bd0fe09-combined-ca-bundle\") pod \"watcher-decision-engine-0\" (UID: \"447d5bb0-18ef-4779-8b6a-a4a96bd0fe09\") " pod="openstack-kuttl-tests/watcher-decision-engine-0" Mar 16 16:21:18 crc kubenswrapper[5120]: I0316 16:21:18.390518 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/447d5bb0-18ef-4779-8b6a-a4a96bd0fe09-logs\") pod \"watcher-decision-engine-0\" (UID: \"447d5bb0-18ef-4779-8b6a-a4a96bd0fe09\") " pod="openstack-kuttl-tests/watcher-decision-engine-0" Mar 16 16:21:18 crc kubenswrapper[5120]: I0316 16:21:18.390559 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"custom-prometheus-ca\" (UniqueName: \"kubernetes.io/secret/447d5bb0-18ef-4779-8b6a-a4a96bd0fe09-custom-prometheus-ca\") pod \"watcher-decision-engine-0\" (UID: \"447d5bb0-18ef-4779-8b6a-a4a96bd0fe09\") " pod="openstack-kuttl-tests/watcher-decision-engine-0" Mar 16 16:21:18 crc kubenswrapper[5120]: I0316 16:21:18.390657 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27ppd\" (UniqueName: \"kubernetes.io/projected/447d5bb0-18ef-4779-8b6a-a4a96bd0fe09-kube-api-access-27ppd\") pod \"watcher-decision-engine-0\" (UID: \"447d5bb0-18ef-4779-8b6a-a4a96bd0fe09\") " pod="openstack-kuttl-tests/watcher-decision-engine-0" Mar 16 16:21:18 crc kubenswrapper[5120]: I0316 16:21:18.390680 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/447d5bb0-18ef-4779-8b6a-a4a96bd0fe09-config-data\") pod \"watcher-decision-engine-0\" (UID: \"447d5bb0-18ef-4779-8b6a-a4a96bd0fe09\") " pod="openstack-kuttl-tests/watcher-decision-engine-0" Mar 16 16:21:18 crc kubenswrapper[5120]: I0316 16:21:18.492428 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/395499e0-a2dc-4775-9dde-f66517d1d827-config-data\") pod \"395499e0-a2dc-4775-9dde-f66517d1d827\" (UID: \"395499e0-a2dc-4775-9dde-f66517d1d827\") " Mar 16 16:21:18 crc kubenswrapper[5120]: I0316 16:21:18.492483 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/395499e0-a2dc-4775-9dde-f66517d1d827-scripts\") pod \"395499e0-a2dc-4775-9dde-f66517d1d827\" (UID: \"395499e0-a2dc-4775-9dde-f66517d1d827\") " Mar 16 16:21:18 crc kubenswrapper[5120]: I0316 16:21:18.492709 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2b6st\" (UniqueName: \"kubernetes.io/projected/395499e0-a2dc-4775-9dde-f66517d1d827-kube-api-access-2b6st\") pod \"395499e0-a2dc-4775-9dde-f66517d1d827\" (UID: \"395499e0-a2dc-4775-9dde-f66517d1d827\") " Mar 16 16:21:18 crc kubenswrapper[5120]: I0316 16:21:18.492731 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/395499e0-a2dc-4775-9dde-f66517d1d827-combined-ca-bundle\") pod \"395499e0-a2dc-4775-9dde-f66517d1d827\" (UID: \"395499e0-a2dc-4775-9dde-f66517d1d827\") " Mar 16 16:21:18 crc kubenswrapper[5120]: I0316 16:21:18.493091 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/watcher-api-0" Mar 16 16:21:18 crc kubenswrapper[5120]: I0316 16:21:18.493694 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/395499e0-a2dc-4775-9dde-f66517d1d827-logs\") pod \"395499e0-a2dc-4775-9dde-f66517d1d827\" (UID: \"395499e0-a2dc-4775-9dde-f66517d1d827\") " Mar 16 16:21:18 crc kubenswrapper[5120]: I0316 16:21:18.494156 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/395499e0-a2dc-4775-9dde-f66517d1d827-logs" (OuterVolumeSpecName: "logs") pod "395499e0-a2dc-4775-9dde-f66517d1d827" (UID: "395499e0-a2dc-4775-9dde-f66517d1d827"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:21:18 crc kubenswrapper[5120]: I0316 16:21:18.494190 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-27ppd\" (UniqueName: \"kubernetes.io/projected/447d5bb0-18ef-4779-8b6a-a4a96bd0fe09-kube-api-access-27ppd\") pod \"watcher-decision-engine-0\" (UID: \"447d5bb0-18ef-4779-8b6a-a4a96bd0fe09\") " pod="openstack-kuttl-tests/watcher-decision-engine-0" Mar 16 16:21:18 crc kubenswrapper[5120]: I0316 16:21:18.494217 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/447d5bb0-18ef-4779-8b6a-a4a96bd0fe09-config-data\") pod \"watcher-decision-engine-0\" (UID: \"447d5bb0-18ef-4779-8b6a-a4a96bd0fe09\") " pod="openstack-kuttl-tests/watcher-decision-engine-0" Mar 16 16:21:18 crc kubenswrapper[5120]: I0316 16:21:18.494838 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/447d5bb0-18ef-4779-8b6a-a4a96bd0fe09-combined-ca-bundle\") pod \"watcher-decision-engine-0\" (UID: \"447d5bb0-18ef-4779-8b6a-a4a96bd0fe09\") " pod="openstack-kuttl-tests/watcher-decision-engine-0" Mar 16 16:21:18 crc kubenswrapper[5120]: I0316 16:21:18.494882 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/447d5bb0-18ef-4779-8b6a-a4a96bd0fe09-logs\") pod \"watcher-decision-engine-0\" (UID: \"447d5bb0-18ef-4779-8b6a-a4a96bd0fe09\") " pod="openstack-kuttl-tests/watcher-decision-engine-0" Mar 16 16:21:18 crc kubenswrapper[5120]: I0316 16:21:18.495106 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"custom-prometheus-ca\" (UniqueName: \"kubernetes.io/secret/447d5bb0-18ef-4779-8b6a-a4a96bd0fe09-custom-prometheus-ca\") pod \"watcher-decision-engine-0\" (UID: \"447d5bb0-18ef-4779-8b6a-a4a96bd0fe09\") " pod="openstack-kuttl-tests/watcher-decision-engine-0" Mar 16 16:21:18 crc kubenswrapper[5120]: I0316 16:21:18.495934 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/447d5bb0-18ef-4779-8b6a-a4a96bd0fe09-logs\") pod \"watcher-decision-engine-0\" (UID: \"447d5bb0-18ef-4779-8b6a-a4a96bd0fe09\") " pod="openstack-kuttl-tests/watcher-decision-engine-0" Mar 16 16:21:18 crc kubenswrapper[5120]: I0316 16:21:18.497459 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/395499e0-a2dc-4775-9dde-f66517d1d827-scripts" (OuterVolumeSpecName: "scripts") pod "395499e0-a2dc-4775-9dde-f66517d1d827" (UID: "395499e0-a2dc-4775-9dde-f66517d1d827"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:21:18 crc kubenswrapper[5120]: I0316 16:21:18.498195 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:21:18 crc kubenswrapper[5120]: I0316 16:21:18.498256 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/395499e0-a2dc-4775-9dde-f66517d1d827-kube-api-access-2b6st" (OuterVolumeSpecName: "kube-api-access-2b6st") pod "395499e0-a2dc-4775-9dde-f66517d1d827" (UID: "395499e0-a2dc-4775-9dde-f66517d1d827"). InnerVolumeSpecName "kube-api-access-2b6st". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:21:18 crc kubenswrapper[5120]: I0316 16:21:18.501700 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"custom-prometheus-ca\" (UniqueName: \"kubernetes.io/secret/447d5bb0-18ef-4779-8b6a-a4a96bd0fe09-custom-prometheus-ca\") pod \"watcher-decision-engine-0\" (UID: \"447d5bb0-18ef-4779-8b6a-a4a96bd0fe09\") " pod="openstack-kuttl-tests/watcher-decision-engine-0" Mar 16 16:21:18 crc kubenswrapper[5120]: I0316 16:21:18.506709 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/447d5bb0-18ef-4779-8b6a-a4a96bd0fe09-config-data\") pod \"watcher-decision-engine-0\" (UID: \"447d5bb0-18ef-4779-8b6a-a4a96bd0fe09\") " pod="openstack-kuttl-tests/watcher-decision-engine-0" Mar 16 16:21:18 crc kubenswrapper[5120]: I0316 16:21:18.508189 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2b6st\" (UniqueName: \"kubernetes.io/projected/395499e0-a2dc-4775-9dde-f66517d1d827-kube-api-access-2b6st\") on node \"crc\" DevicePath \"\"" Mar 16 16:21:18 crc kubenswrapper[5120]: I0316 16:21:18.508220 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/395499e0-a2dc-4775-9dde-f66517d1d827-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:21:18 crc kubenswrapper[5120]: I0316 16:21:18.508231 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/395499e0-a2dc-4775-9dde-f66517d1d827-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:21:18 crc kubenswrapper[5120]: I0316 16:21:18.510273 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-27ppd\" (UniqueName: \"kubernetes.io/projected/447d5bb0-18ef-4779-8b6a-a4a96bd0fe09-kube-api-access-27ppd\") pod \"watcher-decision-engine-0\" (UID: \"447d5bb0-18ef-4779-8b6a-a4a96bd0fe09\") " pod="openstack-kuttl-tests/watcher-decision-engine-0" Mar 16 16:21:18 crc kubenswrapper[5120]: I0316 16:21:18.510662 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/447d5bb0-18ef-4779-8b6a-a4a96bd0fe09-combined-ca-bundle\") pod \"watcher-decision-engine-0\" (UID: \"447d5bb0-18ef-4779-8b6a-a4a96bd0fe09\") " pod="openstack-kuttl-tests/watcher-decision-engine-0" Mar 16 16:21:18 crc kubenswrapper[5120]: I0316 16:21:18.513364 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/watcher-applier-0" Mar 16 16:21:18 crc kubenswrapper[5120]: I0316 16:21:18.517976 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/395499e0-a2dc-4775-9dde-f66517d1d827-config-data" (OuterVolumeSpecName: "config-data") pod "395499e0-a2dc-4775-9dde-f66517d1d827" (UID: "395499e0-a2dc-4775-9dde-f66517d1d827"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:21:18 crc kubenswrapper[5120]: I0316 16:21:18.531453 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/395499e0-a2dc-4775-9dde-f66517d1d827-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "395499e0-a2dc-4775-9dde-f66517d1d827" (UID: "395499e0-a2dc-4775-9dde-f66517d1d827"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:21:18 crc kubenswrapper[5120]: I0316 16:21:18.609856 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/395499e0-a2dc-4775-9dde-f66517d1d827-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:21:18 crc kubenswrapper[5120]: I0316 16:21:18.609889 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/395499e0-a2dc-4775-9dde-f66517d1d827-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:21:18 crc kubenswrapper[5120]: I0316 16:21:18.657695 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/watcher-decision-engine-0" Mar 16 16:21:18 crc kubenswrapper[5120]: I0316 16:21:18.695446 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="84d11cfa-2a20-48a3-ba0e-7e7d80bef376" path="/var/lib/kubelet/pods/84d11cfa-2a20-48a3-ba0e-7e7d80bef376/volumes" Mar 16 16:21:18 crc kubenswrapper[5120]: I0316 16:21:18.696332 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc8cc9c3-03de-4f16-887b-ed689ac4eb99" path="/var/lib/kubelet/pods/dc8cc9c3-03de-4f16-887b-ed689ac4eb99/volumes" Mar 16 16:21:18 crc kubenswrapper[5120]: I0316 16:21:18.795243 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1e1d9ac4-3b31-4a4e-8930-42f2670838be","Type":"ContainerStarted","Data":"8649361aa2365f61a2d5834e81fa8bfffd9456a7988de96450e89b1fb7d915c2"} Mar 16 16:21:18 crc kubenswrapper[5120]: I0316 16:21:18.795663 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="1e1d9ac4-3b31-4a4e-8930-42f2670838be" containerName="ceilometer-central-agent" containerID="cri-o://4557aac861cc42cf68288c1a9d7e9bb7ab3d0da395ee4b8a2a22276adbb9f50d" gracePeriod=30 Mar 16 16:21:18 crc kubenswrapper[5120]: I0316 16:21:18.795871 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:21:18 crc kubenswrapper[5120]: I0316 16:21:18.796336 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="1e1d9ac4-3b31-4a4e-8930-42f2670838be" containerName="proxy-httpd" containerID="cri-o://8649361aa2365f61a2d5834e81fa8bfffd9456a7988de96450e89b1fb7d915c2" gracePeriod=30 Mar 16 16:21:18 crc kubenswrapper[5120]: I0316 16:21:18.796506 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="1e1d9ac4-3b31-4a4e-8930-42f2670838be" containerName="sg-core" containerID="cri-o://8924dd738fa63e4ed91c2b2cd400cb43fd037582ec47620602daaff519be9da8" gracePeriod=30 Mar 16 16:21:18 crc kubenswrapper[5120]: I0316 16:21:18.796865 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="1e1d9ac4-3b31-4a4e-8930-42f2670838be" containerName="ceilometer-notification-agent" containerID="cri-o://e523bc2c517fcee5391a2c03f390c1d6962bf26aa6c40a167defd48939f3e291" gracePeriod=30 Mar 16 16:21:18 crc kubenswrapper[5120]: I0316 16:21:18.800624 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-nwmkm" event={"ID":"395499e0-a2dc-4775-9dde-f66517d1d827","Type":"ContainerDied","Data":"f2a05a68ef39b4a8dd2622bd460a3b28de19795d0634f09757e65b13f341d2b1"} Mar 16 16:21:18 crc kubenswrapper[5120]: I0316 16:21:18.800664 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f2a05a68ef39b4a8dd2622bd460a3b28de19795d0634f09757e65b13f341d2b1" Mar 16 16:21:18 crc kubenswrapper[5120]: I0316 16:21:18.800634 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-nwmkm" Mar 16 16:21:18 crc kubenswrapper[5120]: I0316 16:21:18.822934 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"3b45ef4a-c2e4-4ddb-b51f-aaaaac181aac","Type":"ContainerStarted","Data":"91d66675f300b3f43d34855167c7f92e5b01d8b24f89c827438b654fe3e78937"} Mar 16 16:21:18 crc kubenswrapper[5120]: I0316 16:21:18.833572 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=11.165101338 podStartE2EDuration="15.833548216s" podCreationTimestamp="2026-03-16 16:21:03 +0000 UTC" firstStartedPulling="2026-03-16 16:21:13.025702852 +0000 UTC m=+2975.179634509" lastFinishedPulling="2026-03-16 16:21:17.69414973 +0000 UTC m=+2979.848081387" observedRunningTime="2026-03-16 16:21:18.82099118 +0000 UTC m=+2980.974922847" watchObservedRunningTime="2026-03-16 16:21:18.833548216 +0000 UTC m=+2980.987479873" Mar 16 16:21:18 crc kubenswrapper[5120]: I0316 16:21:18.886188 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-749879f798-p2tp8"] Mar 16 16:21:18 crc kubenswrapper[5120]: I0316 16:21:18.887311 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="395499e0-a2dc-4775-9dde-f66517d1d827" containerName="placement-db-sync" Mar 16 16:21:18 crc kubenswrapper[5120]: I0316 16:21:18.887332 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="395499e0-a2dc-4775-9dde-f66517d1d827" containerName="placement-db-sync" Mar 16 16:21:18 crc kubenswrapper[5120]: I0316 16:21:18.887521 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="395499e0-a2dc-4775-9dde-f66517d1d827" containerName="placement-db-sync" Mar 16 16:21:18 crc kubenswrapper[5120]: I0316 16:21:18.904884 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-749879f798-p2tp8"] Mar 16 16:21:18 crc kubenswrapper[5120]: I0316 16:21:18.904952 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-749879f798-p2tp8" Mar 16 16:21:18 crc kubenswrapper[5120]: I0316 16:21:18.908051 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-placement-public-svc\"" Mar 16 16:21:18 crc kubenswrapper[5120]: I0316 16:21:18.908396 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-placement-internal-svc\"" Mar 16 16:21:18 crc kubenswrapper[5120]: I0316 16:21:18.908970 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-scripts\"" Mar 16 16:21:18 crc kubenswrapper[5120]: I0316 16:21:18.910174 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-placement-dockercfg-ntdjh\"" Mar 16 16:21:18 crc kubenswrapper[5120]: I0316 16:21:18.914115 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-config-data\"" Mar 16 16:21:19 crc kubenswrapper[5120]: I0316 16:21:19.027210 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/ca8ead84-6680-43da-b50b-703242333d2d-internal-tls-certs\") pod \"placement-749879f798-p2tp8\" (UID: \"ca8ead84-6680-43da-b50b-703242333d2d\") " pod="openstack-kuttl-tests/placement-749879f798-p2tp8" Mar 16 16:21:19 crc kubenswrapper[5120]: I0316 16:21:19.027643 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ca8ead84-6680-43da-b50b-703242333d2d-config-data\") pod \"placement-749879f798-p2tp8\" (UID: \"ca8ead84-6680-43da-b50b-703242333d2d\") " pod="openstack-kuttl-tests/placement-749879f798-p2tp8" Mar 16 16:21:19 crc kubenswrapper[5120]: I0316 16:21:19.027748 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ca8ead84-6680-43da-b50b-703242333d2d-combined-ca-bundle\") pod \"placement-749879f798-p2tp8\" (UID: \"ca8ead84-6680-43da-b50b-703242333d2d\") " pod="openstack-kuttl-tests/placement-749879f798-p2tp8" Mar 16 16:21:19 crc kubenswrapper[5120]: I0316 16:21:19.027803 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ca8ead84-6680-43da-b50b-703242333d2d-logs\") pod \"placement-749879f798-p2tp8\" (UID: \"ca8ead84-6680-43da-b50b-703242333d2d\") " pod="openstack-kuttl-tests/placement-749879f798-p2tp8" Mar 16 16:21:19 crc kubenswrapper[5120]: I0316 16:21:19.027829 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ca8ead84-6680-43da-b50b-703242333d2d-scripts\") pod \"placement-749879f798-p2tp8\" (UID: \"ca8ead84-6680-43da-b50b-703242333d2d\") " pod="openstack-kuttl-tests/placement-749879f798-p2tp8" Mar 16 16:21:19 crc kubenswrapper[5120]: I0316 16:21:19.027843 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ca8ead84-6680-43da-b50b-703242333d2d-public-tls-certs\") pod \"placement-749879f798-p2tp8\" (UID: \"ca8ead84-6680-43da-b50b-703242333d2d\") " pod="openstack-kuttl-tests/placement-749879f798-p2tp8" Mar 16 16:21:19 crc kubenswrapper[5120]: I0316 16:21:19.027920 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8tcq\" (UniqueName: \"kubernetes.io/projected/ca8ead84-6680-43da-b50b-703242333d2d-kube-api-access-x8tcq\") pod \"placement-749879f798-p2tp8\" (UID: \"ca8ead84-6680-43da-b50b-703242333d2d\") " pod="openstack-kuttl-tests/placement-749879f798-p2tp8" Mar 16 16:21:19 crc kubenswrapper[5120]: W0316 16:21:19.037566 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd8c78a81_c746_4232_9442_b648cd62f793.slice/crio-e0bde5007f86a7642e8e3befaab5f2a103863a01281cef12dc9b52fb8e5a08a1 WatchSource:0}: Error finding container e0bde5007f86a7642e8e3befaab5f2a103863a01281cef12dc9b52fb8e5a08a1: Status 404 returned error can't find the container with id e0bde5007f86a7642e8e3befaab5f2a103863a01281cef12dc9b52fb8e5a08a1 Mar 16 16:21:19 crc kubenswrapper[5120]: I0316 16:21:19.044200 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/watcher-api-0"] Mar 16 16:21:19 crc kubenswrapper[5120]: I0316 16:21:19.129147 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x8tcq\" (UniqueName: \"kubernetes.io/projected/ca8ead84-6680-43da-b50b-703242333d2d-kube-api-access-x8tcq\") pod \"placement-749879f798-p2tp8\" (UID: \"ca8ead84-6680-43da-b50b-703242333d2d\") " pod="openstack-kuttl-tests/placement-749879f798-p2tp8" Mar 16 16:21:19 crc kubenswrapper[5120]: I0316 16:21:19.129237 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/ca8ead84-6680-43da-b50b-703242333d2d-internal-tls-certs\") pod \"placement-749879f798-p2tp8\" (UID: \"ca8ead84-6680-43da-b50b-703242333d2d\") " pod="openstack-kuttl-tests/placement-749879f798-p2tp8" Mar 16 16:21:19 crc kubenswrapper[5120]: I0316 16:21:19.129272 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ca8ead84-6680-43da-b50b-703242333d2d-config-data\") pod \"placement-749879f798-p2tp8\" (UID: \"ca8ead84-6680-43da-b50b-703242333d2d\") " pod="openstack-kuttl-tests/placement-749879f798-p2tp8" Mar 16 16:21:19 crc kubenswrapper[5120]: I0316 16:21:19.129409 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ca8ead84-6680-43da-b50b-703242333d2d-combined-ca-bundle\") pod \"placement-749879f798-p2tp8\" (UID: \"ca8ead84-6680-43da-b50b-703242333d2d\") " pod="openstack-kuttl-tests/placement-749879f798-p2tp8" Mar 16 16:21:19 crc kubenswrapper[5120]: I0316 16:21:19.129451 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ca8ead84-6680-43da-b50b-703242333d2d-logs\") pod \"placement-749879f798-p2tp8\" (UID: \"ca8ead84-6680-43da-b50b-703242333d2d\") " pod="openstack-kuttl-tests/placement-749879f798-p2tp8" Mar 16 16:21:19 crc kubenswrapper[5120]: I0316 16:21:19.129475 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ca8ead84-6680-43da-b50b-703242333d2d-scripts\") pod \"placement-749879f798-p2tp8\" (UID: \"ca8ead84-6680-43da-b50b-703242333d2d\") " pod="openstack-kuttl-tests/placement-749879f798-p2tp8" Mar 16 16:21:19 crc kubenswrapper[5120]: I0316 16:21:19.129498 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ca8ead84-6680-43da-b50b-703242333d2d-public-tls-certs\") pod \"placement-749879f798-p2tp8\" (UID: \"ca8ead84-6680-43da-b50b-703242333d2d\") " pod="openstack-kuttl-tests/placement-749879f798-p2tp8" Mar 16 16:21:19 crc kubenswrapper[5120]: I0316 16:21:19.130373 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ca8ead84-6680-43da-b50b-703242333d2d-logs\") pod \"placement-749879f798-p2tp8\" (UID: \"ca8ead84-6680-43da-b50b-703242333d2d\") " pod="openstack-kuttl-tests/placement-749879f798-p2tp8" Mar 16 16:21:19 crc kubenswrapper[5120]: I0316 16:21:19.136353 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ca8ead84-6680-43da-b50b-703242333d2d-scripts\") pod \"placement-749879f798-p2tp8\" (UID: \"ca8ead84-6680-43da-b50b-703242333d2d\") " pod="openstack-kuttl-tests/placement-749879f798-p2tp8" Mar 16 16:21:19 crc kubenswrapper[5120]: I0316 16:21:19.136461 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ca8ead84-6680-43da-b50b-703242333d2d-config-data\") pod \"placement-749879f798-p2tp8\" (UID: \"ca8ead84-6680-43da-b50b-703242333d2d\") " pod="openstack-kuttl-tests/placement-749879f798-p2tp8" Mar 16 16:21:19 crc kubenswrapper[5120]: I0316 16:21:19.140219 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ca8ead84-6680-43da-b50b-703242333d2d-combined-ca-bundle\") pod \"placement-749879f798-p2tp8\" (UID: \"ca8ead84-6680-43da-b50b-703242333d2d\") " pod="openstack-kuttl-tests/placement-749879f798-p2tp8" Mar 16 16:21:19 crc kubenswrapper[5120]: I0316 16:21:19.140540 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ca8ead84-6680-43da-b50b-703242333d2d-public-tls-certs\") pod \"placement-749879f798-p2tp8\" (UID: \"ca8ead84-6680-43da-b50b-703242333d2d\") " pod="openstack-kuttl-tests/placement-749879f798-p2tp8" Mar 16 16:21:19 crc kubenswrapper[5120]: I0316 16:21:19.140921 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/ca8ead84-6680-43da-b50b-703242333d2d-internal-tls-certs\") pod \"placement-749879f798-p2tp8\" (UID: \"ca8ead84-6680-43da-b50b-703242333d2d\") " pod="openstack-kuttl-tests/placement-749879f798-p2tp8" Mar 16 16:21:19 crc kubenswrapper[5120]: I0316 16:21:19.149961 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8tcq\" (UniqueName: \"kubernetes.io/projected/ca8ead84-6680-43da-b50b-703242333d2d-kube-api-access-x8tcq\") pod \"placement-749879f798-p2tp8\" (UID: \"ca8ead84-6680-43da-b50b-703242333d2d\") " pod="openstack-kuttl-tests/placement-749879f798-p2tp8" Mar 16 16:21:19 crc kubenswrapper[5120]: I0316 16:21:19.183002 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:21:19 crc kubenswrapper[5120]: I0316 16:21:19.226201 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-749879f798-p2tp8" Mar 16 16:21:19 crc kubenswrapper[5120]: I0316 16:21:19.409819 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/watcher-applier-0"] Mar 16 16:21:19 crc kubenswrapper[5120]: I0316 16:21:19.454212 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/watcher-decision-engine-0"] Mar 16 16:21:19 crc kubenswrapper[5120]: I0316 16:21:19.625714 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-xbzfv" Mar 16 16:21:19 crc kubenswrapper[5120]: I0316 16:21:19.635379 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-k6l62" Mar 16 16:21:19 crc kubenswrapper[5120]: I0316 16:21:19.679368 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/356bec90-b61f-42ca-85ea-9b25a263f3e5-fernet-keys\") pod \"356bec90-b61f-42ca-85ea-9b25a263f3e5\" (UID: \"356bec90-b61f-42ca-85ea-9b25a263f3e5\") " Mar 16 16:21:19 crc kubenswrapper[5120]: I0316 16:21:19.679696 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/356bec90-b61f-42ca-85ea-9b25a263f3e5-scripts\") pod \"356bec90-b61f-42ca-85ea-9b25a263f3e5\" (UID: \"356bec90-b61f-42ca-85ea-9b25a263f3e5\") " Mar 16 16:21:19 crc kubenswrapper[5120]: I0316 16:21:19.679810 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jppdf\" (UniqueName: \"kubernetes.io/projected/356bec90-b61f-42ca-85ea-9b25a263f3e5-kube-api-access-jppdf\") pod \"356bec90-b61f-42ca-85ea-9b25a263f3e5\" (UID: \"356bec90-b61f-42ca-85ea-9b25a263f3e5\") " Mar 16 16:21:19 crc kubenswrapper[5120]: I0316 16:21:19.679945 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/356bec90-b61f-42ca-85ea-9b25a263f3e5-combined-ca-bundle\") pod \"356bec90-b61f-42ca-85ea-9b25a263f3e5\" (UID: \"356bec90-b61f-42ca-85ea-9b25a263f3e5\") " Mar 16 16:21:19 crc kubenswrapper[5120]: I0316 16:21:19.680067 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/356bec90-b61f-42ca-85ea-9b25a263f3e5-config-data\") pod \"356bec90-b61f-42ca-85ea-9b25a263f3e5\" (UID: \"356bec90-b61f-42ca-85ea-9b25a263f3e5\") " Mar 16 16:21:19 crc kubenswrapper[5120]: I0316 16:21:19.680196 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h2ddn\" (UniqueName: \"kubernetes.io/projected/8d540ae4-9eb1-4540-bb5b-4035063b47ca-kube-api-access-h2ddn\") pod \"8d540ae4-9eb1-4540-bb5b-4035063b47ca\" (UID: \"8d540ae4-9eb1-4540-bb5b-4035063b47ca\") " Mar 16 16:21:19 crc kubenswrapper[5120]: I0316 16:21:19.680214 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/8d540ae4-9eb1-4540-bb5b-4035063b47ca-db-sync-config-data\") pod \"8d540ae4-9eb1-4540-bb5b-4035063b47ca\" (UID: \"8d540ae4-9eb1-4540-bb5b-4035063b47ca\") " Mar 16 16:21:19 crc kubenswrapper[5120]: I0316 16:21:19.680246 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8d540ae4-9eb1-4540-bb5b-4035063b47ca-combined-ca-bundle\") pod \"8d540ae4-9eb1-4540-bb5b-4035063b47ca\" (UID: \"8d540ae4-9eb1-4540-bb5b-4035063b47ca\") " Mar 16 16:21:19 crc kubenswrapper[5120]: I0316 16:21:19.680277 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/356bec90-b61f-42ca-85ea-9b25a263f3e5-credential-keys\") pod \"356bec90-b61f-42ca-85ea-9b25a263f3e5\" (UID: \"356bec90-b61f-42ca-85ea-9b25a263f3e5\") " Mar 16 16:21:19 crc kubenswrapper[5120]: I0316 16:21:19.687944 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/356bec90-b61f-42ca-85ea-9b25a263f3e5-scripts" (OuterVolumeSpecName: "scripts") pod "356bec90-b61f-42ca-85ea-9b25a263f3e5" (UID: "356bec90-b61f-42ca-85ea-9b25a263f3e5"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:21:19 crc kubenswrapper[5120]: I0316 16:21:19.688691 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/356bec90-b61f-42ca-85ea-9b25a263f3e5-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "356bec90-b61f-42ca-85ea-9b25a263f3e5" (UID: "356bec90-b61f-42ca-85ea-9b25a263f3e5"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:21:19 crc kubenswrapper[5120]: I0316 16:21:19.689611 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/356bec90-b61f-42ca-85ea-9b25a263f3e5-kube-api-access-jppdf" (OuterVolumeSpecName: "kube-api-access-jppdf") pod "356bec90-b61f-42ca-85ea-9b25a263f3e5" (UID: "356bec90-b61f-42ca-85ea-9b25a263f3e5"). InnerVolumeSpecName "kube-api-access-jppdf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:21:19 crc kubenswrapper[5120]: I0316 16:21:19.698182 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d540ae4-9eb1-4540-bb5b-4035063b47ca-kube-api-access-h2ddn" (OuterVolumeSpecName: "kube-api-access-h2ddn") pod "8d540ae4-9eb1-4540-bb5b-4035063b47ca" (UID: "8d540ae4-9eb1-4540-bb5b-4035063b47ca"). InnerVolumeSpecName "kube-api-access-h2ddn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:21:19 crc kubenswrapper[5120]: I0316 16:21:19.699730 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/356bec90-b61f-42ca-85ea-9b25a263f3e5-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "356bec90-b61f-42ca-85ea-9b25a263f3e5" (UID: "356bec90-b61f-42ca-85ea-9b25a263f3e5"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:21:19 crc kubenswrapper[5120]: I0316 16:21:19.709317 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d540ae4-9eb1-4540-bb5b-4035063b47ca-db-sync-config-data" (OuterVolumeSpecName: "db-sync-config-data") pod "8d540ae4-9eb1-4540-bb5b-4035063b47ca" (UID: "8d540ae4-9eb1-4540-bb5b-4035063b47ca"). InnerVolumeSpecName "db-sync-config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:21:19 crc kubenswrapper[5120]: I0316 16:21:19.731200 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d540ae4-9eb1-4540-bb5b-4035063b47ca-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "8d540ae4-9eb1-4540-bb5b-4035063b47ca" (UID: "8d540ae4-9eb1-4540-bb5b-4035063b47ca"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:21:19 crc kubenswrapper[5120]: I0316 16:21:19.731285 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/356bec90-b61f-42ca-85ea-9b25a263f3e5-config-data" (OuterVolumeSpecName: "config-data") pod "356bec90-b61f-42ca-85ea-9b25a263f3e5" (UID: "356bec90-b61f-42ca-85ea-9b25a263f3e5"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:21:19 crc kubenswrapper[5120]: I0316 16:21:19.732517 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/356bec90-b61f-42ca-85ea-9b25a263f3e5-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "356bec90-b61f-42ca-85ea-9b25a263f3e5" (UID: "356bec90-b61f-42ca-85ea-9b25a263f3e5"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:21:19 crc kubenswrapper[5120]: I0316 16:21:19.784397 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h2ddn\" (UniqueName: \"kubernetes.io/projected/8d540ae4-9eb1-4540-bb5b-4035063b47ca-kube-api-access-h2ddn\") on node \"crc\" DevicePath \"\"" Mar 16 16:21:19 crc kubenswrapper[5120]: I0316 16:21:19.784966 5120 reconciler_common.go:299] "Volume detached for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/8d540ae4-9eb1-4540-bb5b-4035063b47ca-db-sync-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:21:19 crc kubenswrapper[5120]: I0316 16:21:19.785000 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8d540ae4-9eb1-4540-bb5b-4035063b47ca-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:21:19 crc kubenswrapper[5120]: I0316 16:21:19.785010 5120 reconciler_common.go:299] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/356bec90-b61f-42ca-85ea-9b25a263f3e5-credential-keys\") on node \"crc\" DevicePath \"\"" Mar 16 16:21:19 crc kubenswrapper[5120]: I0316 16:21:19.785019 5120 reconciler_common.go:299] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/356bec90-b61f-42ca-85ea-9b25a263f3e5-fernet-keys\") on node \"crc\" DevicePath \"\"" Mar 16 16:21:19 crc kubenswrapper[5120]: I0316 16:21:19.785032 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/356bec90-b61f-42ca-85ea-9b25a263f3e5-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:21:19 crc kubenswrapper[5120]: I0316 16:21:19.785043 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jppdf\" (UniqueName: \"kubernetes.io/projected/356bec90-b61f-42ca-85ea-9b25a263f3e5-kube-api-access-jppdf\") on node \"crc\" DevicePath \"\"" Mar 16 16:21:19 crc kubenswrapper[5120]: I0316 16:21:19.785052 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/356bec90-b61f-42ca-85ea-9b25a263f3e5-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:21:19 crc kubenswrapper[5120]: I0316 16:21:19.785095 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/356bec90-b61f-42ca-85ea-9b25a263f3e5-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:21:19 crc kubenswrapper[5120]: I0316 16:21:19.853495 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-k6l62"] Mar 16 16:21:19 crc kubenswrapper[5120]: I0316 16:21:19.861932 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"c99f889b-8cce-419b-bea2-16bbac703bca","Type":"ContainerStarted","Data":"c4c1036cc673340b11bc0a72b985616a46617a2229dd057956a0ddbd21255839"} Mar 16 16:21:19 crc kubenswrapper[5120]: I0316 16:21:19.865978 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"3b45ef4a-c2e4-4ddb-b51f-aaaaac181aac","Type":"ContainerStarted","Data":"7f5e65844564bb87a668ddf064d998658e40b3861b086ad783415350b42b86a3"} Mar 16 16:21:19 crc kubenswrapper[5120]: I0316 16:21:19.866306 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-k6l62"] Mar 16 16:21:19 crc kubenswrapper[5120]: I0316 16:21:19.871938 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e980d64c46c953c65395311131c9f9e365304b8a66bd8e2219bf007f498d7d87" Mar 16 16:21:19 crc kubenswrapper[5120]: I0316 16:21:19.872001 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-k6l62" Mar 16 16:21:19 crc kubenswrapper[5120]: I0316 16:21:19.875001 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/watcher-decision-engine-0" event={"ID":"447d5bb0-18ef-4779-8b6a-a4a96bd0fe09","Type":"ContainerStarted","Data":"2c0e694e9b269f5f21e9b956398e43d55943ca16e4bf8d532c9a69cd86e3d8fb"} Mar 16 16:21:19 crc kubenswrapper[5120]: I0316 16:21:19.876820 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-xbzfv" Mar 16 16:21:19 crc kubenswrapper[5120]: I0316 16:21:19.876850 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-xbzfv" event={"ID":"8d540ae4-9eb1-4540-bb5b-4035063b47ca","Type":"ContainerDied","Data":"b096716ff2686c9a9d3701d519fbfa4da51c9823ba658c67d621efe61f1eaf14"} Mar 16 16:21:19 crc kubenswrapper[5120]: I0316 16:21:19.876885 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b096716ff2686c9a9d3701d519fbfa4da51c9823ba658c67d621efe61f1eaf14" Mar 16 16:21:19 crc kubenswrapper[5120]: I0316 16:21:19.884537 5120 generic.go:358] "Generic (PLEG): container finished" podID="1e1d9ac4-3b31-4a4e-8930-42f2670838be" containerID="8649361aa2365f61a2d5834e81fa8bfffd9456a7988de96450e89b1fb7d915c2" exitCode=0 Mar 16 16:21:19 crc kubenswrapper[5120]: I0316 16:21:19.884563 5120 generic.go:358] "Generic (PLEG): container finished" podID="1e1d9ac4-3b31-4a4e-8930-42f2670838be" containerID="8924dd738fa63e4ed91c2b2cd400cb43fd037582ec47620602daaff519be9da8" exitCode=2 Mar 16 16:21:19 crc kubenswrapper[5120]: I0316 16:21:19.884569 5120 generic.go:358] "Generic (PLEG): container finished" podID="1e1d9ac4-3b31-4a4e-8930-42f2670838be" containerID="e523bc2c517fcee5391a2c03f390c1d6962bf26aa6c40a167defd48939f3e291" exitCode=0 Mar 16 16:21:19 crc kubenswrapper[5120]: I0316 16:21:19.884575 5120 generic.go:358] "Generic (PLEG): container finished" podID="1e1d9ac4-3b31-4a4e-8930-42f2670838be" containerID="4557aac861cc42cf68288c1a9d7e9bb7ab3d0da395ee4b8a2a22276adbb9f50d" exitCode=0 Mar 16 16:21:19 crc kubenswrapper[5120]: I0316 16:21:19.884799 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1e1d9ac4-3b31-4a4e-8930-42f2670838be","Type":"ContainerDied","Data":"8649361aa2365f61a2d5834e81fa8bfffd9456a7988de96450e89b1fb7d915c2"} Mar 16 16:21:19 crc kubenswrapper[5120]: I0316 16:21:19.884829 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1e1d9ac4-3b31-4a4e-8930-42f2670838be","Type":"ContainerDied","Data":"8924dd738fa63e4ed91c2b2cd400cb43fd037582ec47620602daaff519be9da8"} Mar 16 16:21:19 crc kubenswrapper[5120]: I0316 16:21:19.884841 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1e1d9ac4-3b31-4a4e-8930-42f2670838be","Type":"ContainerDied","Data":"e523bc2c517fcee5391a2c03f390c1d6962bf26aa6c40a167defd48939f3e291"} Mar 16 16:21:19 crc kubenswrapper[5120]: I0316 16:21:19.884851 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1e1d9ac4-3b31-4a4e-8930-42f2670838be","Type":"ContainerDied","Data":"4557aac861cc42cf68288c1a9d7e9bb7ab3d0da395ee4b8a2a22276adbb9f50d"} Mar 16 16:21:19 crc kubenswrapper[5120]: I0316 16:21:19.889671 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/watcher-applier-0" event={"ID":"d5160b65-3a41-4645-9f47-bd4e891fef5f","Type":"ContainerStarted","Data":"145fef35dc3dba8d720e8ad4f4ff4335ddf8e20173cf77514167e279ecbed03d"} Mar 16 16:21:19 crc kubenswrapper[5120]: I0316 16:21:19.897269 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/watcher-api-0" event={"ID":"d8c78a81-c746-4232-9442-b648cd62f793","Type":"ContainerStarted","Data":"0677d5b267cbda865c96b1c31d7cbe94dc0a9c10de34337ed831ef8b24b15834"} Mar 16 16:21:19 crc kubenswrapper[5120]: I0316 16:21:19.897316 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/watcher-api-0" event={"ID":"d8c78a81-c746-4232-9442-b648cd62f793","Type":"ContainerStarted","Data":"e0bde5007f86a7642e8e3befaab5f2a103863a01281cef12dc9b52fb8e5a08a1"} Mar 16 16:21:19 crc kubenswrapper[5120]: I0316 16:21:19.905956 5120 status_manager.go:895] "Failed to get status for pod" podUID="356bec90-b61f-42ca-85ea-9b25a263f3e5" pod="openstack-kuttl-tests/keystone-bootstrap-k6l62" err="pods \"keystone-bootstrap-k6l62\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 16:21:19 crc kubenswrapper[5120]: I0316 16:21:19.915082 5120 status_manager.go:895] "Failed to get status for pod" podUID="356bec90-b61f-42ca-85ea-9b25a263f3e5" pod="openstack-kuttl-tests/keystone-bootstrap-k6l62" err="pods \"keystone-bootstrap-k6l62\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 16:21:19 crc kubenswrapper[5120]: I0316 16:21:19.971862 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-pchr5"] Mar 16 16:21:19 crc kubenswrapper[5120]: I0316 16:21:19.972884 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d540ae4-9eb1-4540-bb5b-4035063b47ca" containerName="barbican-db-sync" Mar 16 16:21:19 crc kubenswrapper[5120]: I0316 16:21:19.972901 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d540ae4-9eb1-4540-bb5b-4035063b47ca" containerName="barbican-db-sync" Mar 16 16:21:19 crc kubenswrapper[5120]: I0316 16:21:19.972932 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="356bec90-b61f-42ca-85ea-9b25a263f3e5" containerName="keystone-bootstrap" Mar 16 16:21:19 crc kubenswrapper[5120]: I0316 16:21:19.972938 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="356bec90-b61f-42ca-85ea-9b25a263f3e5" containerName="keystone-bootstrap" Mar 16 16:21:19 crc kubenswrapper[5120]: I0316 16:21:19.973141 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="8d540ae4-9eb1-4540-bb5b-4035063b47ca" containerName="barbican-db-sync" Mar 16 16:21:19 crc kubenswrapper[5120]: I0316 16:21:19.973162 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="356bec90-b61f-42ca-85ea-9b25a263f3e5" containerName="keystone-bootstrap" Mar 16 16:21:19 crc kubenswrapper[5120]: I0316 16:21:19.995694 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-pchr5"] Mar 16 16:21:19 crc kubenswrapper[5120]: I0316 16:21:19.995958 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-pchr5" Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.006832 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone\"" Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.007041 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-scripts\"" Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.007354 5120 status_manager.go:895] "Failed to get status for pod" podUID="356bec90-b61f-42ca-85ea-9b25a263f3e5" pod="openstack-kuttl-tests/keystone-bootstrap-k6l62" err="pods \"keystone-bootstrap-k6l62\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.007500 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-keystone-dockercfg-xwsqf\"" Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.007647 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"osp-secret\"" Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.007790 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-config-data\"" Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.037243 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-worker-5ffd6f596c-m52jd"] Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.056681 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-5ffd6f596c-m52jd" Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.077386 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-config-data\"" Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.077698 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-worker-config-data\"" Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.077898 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-barbican-dockercfg-vs6hm\"" Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.078369 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-756f865fd6-cllz7"] Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.083527 5120 status_manager.go:895] "Failed to get status for pod" podUID="356bec90-b61f-42ca-85ea-9b25a263f3e5" pod="openstack-kuttl-tests/keystone-bootstrap-k6l62" err="pods \"keystone-bootstrap-k6l62\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.085974 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-756f865fd6-cllz7" Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.092636 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-keystone-listener-config-data\"" Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.100112 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bbcf321a-a331-4e3a-96f2-90af1aa2d619-combined-ca-bundle\") pod \"keystone-bootstrap-pchr5\" (UID: \"bbcf321a-a331-4e3a-96f2-90af1aa2d619\") " pod="openstack-kuttl-tests/keystone-bootstrap-pchr5" Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.100176 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/bbcf321a-a331-4e3a-96f2-90af1aa2d619-fernet-keys\") pod \"keystone-bootstrap-pchr5\" (UID: \"bbcf321a-a331-4e3a-96f2-90af1aa2d619\") " pod="openstack-kuttl-tests/keystone-bootstrap-pchr5" Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.100213 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/61e41544-dcc8-47cf-8a6e-45b053ae0f9e-config-data\") pod \"barbican-worker-5ffd6f596c-m52jd\" (UID: \"61e41544-dcc8-47cf-8a6e-45b053ae0f9e\") " pod="openstack-kuttl-tests/barbican-worker-5ffd6f596c-m52jd" Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.100239 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/61e41544-dcc8-47cf-8a6e-45b053ae0f9e-config-data-custom\") pod \"barbican-worker-5ffd6f596c-m52jd\" (UID: \"61e41544-dcc8-47cf-8a6e-45b053ae0f9e\") " pod="openstack-kuttl-tests/barbican-worker-5ffd6f596c-m52jd" Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.100276 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/bbcf321a-a331-4e3a-96f2-90af1aa2d619-credential-keys\") pod \"keystone-bootstrap-pchr5\" (UID: \"bbcf321a-a331-4e3a-96f2-90af1aa2d619\") " pod="openstack-kuttl-tests/keystone-bootstrap-pchr5" Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.100311 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfb9x\" (UniqueName: \"kubernetes.io/projected/bbcf321a-a331-4e3a-96f2-90af1aa2d619-kube-api-access-rfb9x\") pod \"keystone-bootstrap-pchr5\" (UID: \"bbcf321a-a331-4e3a-96f2-90af1aa2d619\") " pod="openstack-kuttl-tests/keystone-bootstrap-pchr5" Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.100331 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lhxr\" (UniqueName: \"kubernetes.io/projected/61e41544-dcc8-47cf-8a6e-45b053ae0f9e-kube-api-access-2lhxr\") pod \"barbican-worker-5ffd6f596c-m52jd\" (UID: \"61e41544-dcc8-47cf-8a6e-45b053ae0f9e\") " pod="openstack-kuttl-tests/barbican-worker-5ffd6f596c-m52jd" Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.100402 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/61e41544-dcc8-47cf-8a6e-45b053ae0f9e-logs\") pod \"barbican-worker-5ffd6f596c-m52jd\" (UID: \"61e41544-dcc8-47cf-8a6e-45b053ae0f9e\") " pod="openstack-kuttl-tests/barbican-worker-5ffd6f596c-m52jd" Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.100427 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/bbcf321a-a331-4e3a-96f2-90af1aa2d619-scripts\") pod \"keystone-bootstrap-pchr5\" (UID: \"bbcf321a-a331-4e3a-96f2-90af1aa2d619\") " pod="openstack-kuttl-tests/keystone-bootstrap-pchr5" Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.100479 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/61e41544-dcc8-47cf-8a6e-45b053ae0f9e-combined-ca-bundle\") pod \"barbican-worker-5ffd6f596c-m52jd\" (UID: \"61e41544-dcc8-47cf-8a6e-45b053ae0f9e\") " pod="openstack-kuttl-tests/barbican-worker-5ffd6f596c-m52jd" Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.100529 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bbcf321a-a331-4e3a-96f2-90af1aa2d619-config-data\") pod \"keystone-bootstrap-pchr5\" (UID: \"bbcf321a-a331-4e3a-96f2-90af1aa2d619\") " pod="openstack-kuttl-tests/keystone-bootstrap-pchr5" Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.107714 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-5ffd6f596c-m52jd"] Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.134749 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-756f865fd6-cllz7"] Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.142820 5120 status_manager.go:895] "Failed to get status for pod" podUID="356bec90-b61f-42ca-85ea-9b25a263f3e5" pod="openstack-kuttl-tests/keystone-bootstrap-k6l62" err="pods \"keystone-bootstrap-k6l62\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.181902 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-api-6b497d5884-fvxpp"] Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.198517 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.202547 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/61e41544-dcc8-47cf-8a6e-45b053ae0f9e-config-data\") pod \"barbican-worker-5ffd6f596c-m52jd\" (UID: \"61e41544-dcc8-47cf-8a6e-45b053ae0f9e\") " pod="openstack-kuttl-tests/barbican-worker-5ffd6f596c-m52jd" Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.202587 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/61e41544-dcc8-47cf-8a6e-45b053ae0f9e-config-data-custom\") pod \"barbican-worker-5ffd6f596c-m52jd\" (UID: \"61e41544-dcc8-47cf-8a6e-45b053ae0f9e\") " pod="openstack-kuttl-tests/barbican-worker-5ffd6f596c-m52jd" Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.202614 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3bb21f28-1bc0-402f-b18b-f29c0b834174-config-data\") pod \"barbican-keystone-listener-756f865fd6-cllz7\" (UID: \"3bb21f28-1bc0-402f-b18b-f29c0b834174\") " pod="openstack-kuttl-tests/barbican-keystone-listener-756f865fd6-cllz7" Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.202666 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/bbcf321a-a331-4e3a-96f2-90af1aa2d619-credential-keys\") pod \"keystone-bootstrap-pchr5\" (UID: \"bbcf321a-a331-4e3a-96f2-90af1aa2d619\") " pod="openstack-kuttl-tests/keystone-bootstrap-pchr5" Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.202698 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rfb9x\" (UniqueName: \"kubernetes.io/projected/bbcf321a-a331-4e3a-96f2-90af1aa2d619-kube-api-access-rfb9x\") pod \"keystone-bootstrap-pchr5\" (UID: \"bbcf321a-a331-4e3a-96f2-90af1aa2d619\") " pod="openstack-kuttl-tests/keystone-bootstrap-pchr5" Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.202722 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2lhxr\" (UniqueName: \"kubernetes.io/projected/61e41544-dcc8-47cf-8a6e-45b053ae0f9e-kube-api-access-2lhxr\") pod \"barbican-worker-5ffd6f596c-m52jd\" (UID: \"61e41544-dcc8-47cf-8a6e-45b053ae0f9e\") " pod="openstack-kuttl-tests/barbican-worker-5ffd6f596c-m52jd" Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.202745 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/3bb21f28-1bc0-402f-b18b-f29c0b834174-config-data-custom\") pod \"barbican-keystone-listener-756f865fd6-cllz7\" (UID: \"3bb21f28-1bc0-402f-b18b-f29c0b834174\") " pod="openstack-kuttl-tests/barbican-keystone-listener-756f865fd6-cllz7" Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.202795 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3bb21f28-1bc0-402f-b18b-f29c0b834174-logs\") pod \"barbican-keystone-listener-756f865fd6-cllz7\" (UID: \"3bb21f28-1bc0-402f-b18b-f29c0b834174\") " pod="openstack-kuttl-tests/barbican-keystone-listener-756f865fd6-cllz7" Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.202818 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3bb21f28-1bc0-402f-b18b-f29c0b834174-combined-ca-bundle\") pod \"barbican-keystone-listener-756f865fd6-cllz7\" (UID: \"3bb21f28-1bc0-402f-b18b-f29c0b834174\") " pod="openstack-kuttl-tests/barbican-keystone-listener-756f865fd6-cllz7" Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.202846 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4spd9\" (UniqueName: \"kubernetes.io/projected/3bb21f28-1bc0-402f-b18b-f29c0b834174-kube-api-access-4spd9\") pod \"barbican-keystone-listener-756f865fd6-cllz7\" (UID: \"3bb21f28-1bc0-402f-b18b-f29c0b834174\") " pod="openstack-kuttl-tests/barbican-keystone-listener-756f865fd6-cllz7" Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.202908 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/61e41544-dcc8-47cf-8a6e-45b053ae0f9e-logs\") pod \"barbican-worker-5ffd6f596c-m52jd\" (UID: \"61e41544-dcc8-47cf-8a6e-45b053ae0f9e\") " pod="openstack-kuttl-tests/barbican-worker-5ffd6f596c-m52jd" Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.202938 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/bbcf321a-a331-4e3a-96f2-90af1aa2d619-scripts\") pod \"keystone-bootstrap-pchr5\" (UID: \"bbcf321a-a331-4e3a-96f2-90af1aa2d619\") " pod="openstack-kuttl-tests/keystone-bootstrap-pchr5" Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.202993 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/61e41544-dcc8-47cf-8a6e-45b053ae0f9e-combined-ca-bundle\") pod \"barbican-worker-5ffd6f596c-m52jd\" (UID: \"61e41544-dcc8-47cf-8a6e-45b053ae0f9e\") " pod="openstack-kuttl-tests/barbican-worker-5ffd6f596c-m52jd" Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.203042 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bbcf321a-a331-4e3a-96f2-90af1aa2d619-config-data\") pod \"keystone-bootstrap-pchr5\" (UID: \"bbcf321a-a331-4e3a-96f2-90af1aa2d619\") " pod="openstack-kuttl-tests/keystone-bootstrap-pchr5" Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.203077 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bbcf321a-a331-4e3a-96f2-90af1aa2d619-combined-ca-bundle\") pod \"keystone-bootstrap-pchr5\" (UID: \"bbcf321a-a331-4e3a-96f2-90af1aa2d619\") " pod="openstack-kuttl-tests/keystone-bootstrap-pchr5" Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.203127 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/bbcf321a-a331-4e3a-96f2-90af1aa2d619-fernet-keys\") pod \"keystone-bootstrap-pchr5\" (UID: \"bbcf321a-a331-4e3a-96f2-90af1aa2d619\") " pod="openstack-kuttl-tests/keystone-bootstrap-pchr5" Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.204208 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-6b497d5884-fvxpp"] Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.204433 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-6b497d5884-fvxpp" Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.206998 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/61e41544-dcc8-47cf-8a6e-45b053ae0f9e-logs\") pod \"barbican-worker-5ffd6f596c-m52jd\" (UID: \"61e41544-dcc8-47cf-8a6e-45b053ae0f9e\") " pod="openstack-kuttl-tests/barbican-worker-5ffd6f596c-m52jd" Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.211003 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-api-config-data\"" Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.222915 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/bbcf321a-a331-4e3a-96f2-90af1aa2d619-credential-keys\") pod \"keystone-bootstrap-pchr5\" (UID: \"bbcf321a-a331-4e3a-96f2-90af1aa2d619\") " pod="openstack-kuttl-tests/keystone-bootstrap-pchr5" Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.227712 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/61e41544-dcc8-47cf-8a6e-45b053ae0f9e-combined-ca-bundle\") pod \"barbican-worker-5ffd6f596c-m52jd\" (UID: \"61e41544-dcc8-47cf-8a6e-45b053ae0f9e\") " pod="openstack-kuttl-tests/barbican-worker-5ffd6f596c-m52jd" Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.239113 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bbcf321a-a331-4e3a-96f2-90af1aa2d619-config-data\") pod \"keystone-bootstrap-pchr5\" (UID: \"bbcf321a-a331-4e3a-96f2-90af1aa2d619\") " pod="openstack-kuttl-tests/keystone-bootstrap-pchr5" Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.242228 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bbcf321a-a331-4e3a-96f2-90af1aa2d619-combined-ca-bundle\") pod \"keystone-bootstrap-pchr5\" (UID: \"bbcf321a-a331-4e3a-96f2-90af1aa2d619\") " pod="openstack-kuttl-tests/keystone-bootstrap-pchr5" Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.252458 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/61e41544-dcc8-47cf-8a6e-45b053ae0f9e-config-data-custom\") pod \"barbican-worker-5ffd6f596c-m52jd\" (UID: \"61e41544-dcc8-47cf-8a6e-45b053ae0f9e\") " pod="openstack-kuttl-tests/barbican-worker-5ffd6f596c-m52jd" Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.253505 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/61e41544-dcc8-47cf-8a6e-45b053ae0f9e-config-data\") pod \"barbican-worker-5ffd6f596c-m52jd\" (UID: \"61e41544-dcc8-47cf-8a6e-45b053ae0f9e\") " pod="openstack-kuttl-tests/barbican-worker-5ffd6f596c-m52jd" Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.254793 5120 status_manager.go:895] "Failed to get status for pod" podUID="356bec90-b61f-42ca-85ea-9b25a263f3e5" pod="openstack-kuttl-tests/keystone-bootstrap-k6l62" err="pods \"keystone-bootstrap-k6l62\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.255141 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/bbcf321a-a331-4e3a-96f2-90af1aa2d619-fernet-keys\") pod \"keystone-bootstrap-pchr5\" (UID: \"bbcf321a-a331-4e3a-96f2-90af1aa2d619\") " pod="openstack-kuttl-tests/keystone-bootstrap-pchr5" Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.255511 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/bbcf321a-a331-4e3a-96f2-90af1aa2d619-scripts\") pod \"keystone-bootstrap-pchr5\" (UID: \"bbcf321a-a331-4e3a-96f2-90af1aa2d619\") " pod="openstack-kuttl-tests/keystone-bootstrap-pchr5" Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.270885 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-749879f798-p2tp8"] Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.272041 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfb9x\" (UniqueName: \"kubernetes.io/projected/bbcf321a-a331-4e3a-96f2-90af1aa2d619-kube-api-access-rfb9x\") pod \"keystone-bootstrap-pchr5\" (UID: \"bbcf321a-a331-4e3a-96f2-90af1aa2d619\") " pod="openstack-kuttl-tests/keystone-bootstrap-pchr5" Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.281869 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lhxr\" (UniqueName: \"kubernetes.io/projected/61e41544-dcc8-47cf-8a6e-45b053ae0f9e-kube-api-access-2lhxr\") pod \"barbican-worker-5ffd6f596c-m52jd\" (UID: \"61e41544-dcc8-47cf-8a6e-45b053ae0f9e\") " pod="openstack-kuttl-tests/barbican-worker-5ffd6f596c-m52jd" Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.287984 5120 status_manager.go:895] "Failed to get status for pod" podUID="356bec90-b61f-42ca-85ea-9b25a263f3e5" pod="openstack-kuttl-tests/keystone-bootstrap-k6l62" err="pods \"keystone-bootstrap-k6l62\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.304542 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1e1d9ac4-3b31-4a4e-8930-42f2670838be-run-httpd\") pod \"1e1d9ac4-3b31-4a4e-8930-42f2670838be\" (UID: \"1e1d9ac4-3b31-4a4e-8930-42f2670838be\") " Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.304609 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1e1d9ac4-3b31-4a4e-8930-42f2670838be-combined-ca-bundle\") pod \"1e1d9ac4-3b31-4a4e-8930-42f2670838be\" (UID: \"1e1d9ac4-3b31-4a4e-8930-42f2670838be\") " Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.304690 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/1e1d9ac4-3b31-4a4e-8930-42f2670838be-sg-core-conf-yaml\") pod \"1e1d9ac4-3b31-4a4e-8930-42f2670838be\" (UID: \"1e1d9ac4-3b31-4a4e-8930-42f2670838be\") " Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.304745 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1e1d9ac4-3b31-4a4e-8930-42f2670838be-config-data\") pod \"1e1d9ac4-3b31-4a4e-8930-42f2670838be\" (UID: \"1e1d9ac4-3b31-4a4e-8930-42f2670838be\") " Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.310444 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1e1d9ac4-3b31-4a4e-8930-42f2670838be-scripts\") pod \"1e1d9ac4-3b31-4a4e-8930-42f2670838be\" (UID: \"1e1d9ac4-3b31-4a4e-8930-42f2670838be\") " Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.310509 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j8xmv\" (UniqueName: \"kubernetes.io/projected/1e1d9ac4-3b31-4a4e-8930-42f2670838be-kube-api-access-j8xmv\") pod \"1e1d9ac4-3b31-4a4e-8930-42f2670838be\" (UID: \"1e1d9ac4-3b31-4a4e-8930-42f2670838be\") " Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.310578 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1e1d9ac4-3b31-4a4e-8930-42f2670838be-log-httpd\") pod \"1e1d9ac4-3b31-4a4e-8930-42f2670838be\" (UID: \"1e1d9ac4-3b31-4a4e-8930-42f2670838be\") " Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.311295 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/57c22289-a4b5-4b54-a910-5fdec6ac0be7-config-data\") pod \"barbican-api-6b497d5884-fvxpp\" (UID: \"57c22289-a4b5-4b54-a910-5fdec6ac0be7\") " pod="openstack-kuttl-tests/barbican-api-6b497d5884-fvxpp" Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.311374 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/57c22289-a4b5-4b54-a910-5fdec6ac0be7-combined-ca-bundle\") pod \"barbican-api-6b497d5884-fvxpp\" (UID: \"57c22289-a4b5-4b54-a910-5fdec6ac0be7\") " pod="openstack-kuttl-tests/barbican-api-6b497d5884-fvxpp" Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.311468 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3bb21f28-1bc0-402f-b18b-f29c0b834174-config-data\") pod \"barbican-keystone-listener-756f865fd6-cllz7\" (UID: \"3bb21f28-1bc0-402f-b18b-f29c0b834174\") " pod="openstack-kuttl-tests/barbican-keystone-listener-756f865fd6-cllz7" Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.311540 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/57c22289-a4b5-4b54-a910-5fdec6ac0be7-config-data-custom\") pod \"barbican-api-6b497d5884-fvxpp\" (UID: \"57c22289-a4b5-4b54-a910-5fdec6ac0be7\") " pod="openstack-kuttl-tests/barbican-api-6b497d5884-fvxpp" Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.311578 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6tdpb\" (UniqueName: \"kubernetes.io/projected/57c22289-a4b5-4b54-a910-5fdec6ac0be7-kube-api-access-6tdpb\") pod \"barbican-api-6b497d5884-fvxpp\" (UID: \"57c22289-a4b5-4b54-a910-5fdec6ac0be7\") " pod="openstack-kuttl-tests/barbican-api-6b497d5884-fvxpp" Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.311600 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/3bb21f28-1bc0-402f-b18b-f29c0b834174-config-data-custom\") pod \"barbican-keystone-listener-756f865fd6-cllz7\" (UID: \"3bb21f28-1bc0-402f-b18b-f29c0b834174\") " pod="openstack-kuttl-tests/barbican-keystone-listener-756f865fd6-cllz7" Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.311634 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3bb21f28-1bc0-402f-b18b-f29c0b834174-logs\") pod \"barbican-keystone-listener-756f865fd6-cllz7\" (UID: \"3bb21f28-1bc0-402f-b18b-f29c0b834174\") " pod="openstack-kuttl-tests/barbican-keystone-listener-756f865fd6-cllz7" Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.311660 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3bb21f28-1bc0-402f-b18b-f29c0b834174-combined-ca-bundle\") pod \"barbican-keystone-listener-756f865fd6-cllz7\" (UID: \"3bb21f28-1bc0-402f-b18b-f29c0b834174\") " pod="openstack-kuttl-tests/barbican-keystone-listener-756f865fd6-cllz7" Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.311700 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4spd9\" (UniqueName: \"kubernetes.io/projected/3bb21f28-1bc0-402f-b18b-f29c0b834174-kube-api-access-4spd9\") pod \"barbican-keystone-listener-756f865fd6-cllz7\" (UID: \"3bb21f28-1bc0-402f-b18b-f29c0b834174\") " pod="openstack-kuttl-tests/barbican-keystone-listener-756f865fd6-cllz7" Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.311777 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/57c22289-a4b5-4b54-a910-5fdec6ac0be7-logs\") pod \"barbican-api-6b497d5884-fvxpp\" (UID: \"57c22289-a4b5-4b54-a910-5fdec6ac0be7\") " pod="openstack-kuttl-tests/barbican-api-6b497d5884-fvxpp" Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.316384 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3bb21f28-1bc0-402f-b18b-f29c0b834174-config-data\") pod \"barbican-keystone-listener-756f865fd6-cllz7\" (UID: \"3bb21f28-1bc0-402f-b18b-f29c0b834174\") " pod="openstack-kuttl-tests/barbican-keystone-listener-756f865fd6-cllz7" Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.317416 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e1d9ac4-3b31-4a4e-8930-42f2670838be-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "1e1d9ac4-3b31-4a4e-8930-42f2670838be" (UID: "1e1d9ac4-3b31-4a4e-8930-42f2670838be"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.318438 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3bb21f28-1bc0-402f-b18b-f29c0b834174-logs\") pod \"barbican-keystone-listener-756f865fd6-cllz7\" (UID: \"3bb21f28-1bc0-402f-b18b-f29c0b834174\") " pod="openstack-kuttl-tests/barbican-keystone-listener-756f865fd6-cllz7" Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.319193 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e1d9ac4-3b31-4a4e-8930-42f2670838be-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "1e1d9ac4-3b31-4a4e-8930-42f2670838be" (UID: "1e1d9ac4-3b31-4a4e-8930-42f2670838be"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.331479 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e1d9ac4-3b31-4a4e-8930-42f2670838be-kube-api-access-j8xmv" (OuterVolumeSpecName: "kube-api-access-j8xmv") pod "1e1d9ac4-3b31-4a4e-8930-42f2670838be" (UID: "1e1d9ac4-3b31-4a4e-8930-42f2670838be"). InnerVolumeSpecName "kube-api-access-j8xmv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.339169 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3bb21f28-1bc0-402f-b18b-f29c0b834174-combined-ca-bundle\") pod \"barbican-keystone-listener-756f865fd6-cllz7\" (UID: \"3bb21f28-1bc0-402f-b18b-f29c0b834174\") " pod="openstack-kuttl-tests/barbican-keystone-listener-756f865fd6-cllz7" Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.362337 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4spd9\" (UniqueName: \"kubernetes.io/projected/3bb21f28-1bc0-402f-b18b-f29c0b834174-kube-api-access-4spd9\") pod \"barbican-keystone-listener-756f865fd6-cllz7\" (UID: \"3bb21f28-1bc0-402f-b18b-f29c0b834174\") " pod="openstack-kuttl-tests/barbican-keystone-listener-756f865fd6-cllz7" Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.366069 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1e1d9ac4-3b31-4a4e-8930-42f2670838be-scripts" (OuterVolumeSpecName: "scripts") pod "1e1d9ac4-3b31-4a4e-8930-42f2670838be" (UID: "1e1d9ac4-3b31-4a4e-8930-42f2670838be"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.369530 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/3bb21f28-1bc0-402f-b18b-f29c0b834174-config-data-custom\") pod \"barbican-keystone-listener-756f865fd6-cllz7\" (UID: \"3bb21f28-1bc0-402f-b18b-f29c0b834174\") " pod="openstack-kuttl-tests/barbican-keystone-listener-756f865fd6-cllz7" Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.378473 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1e1d9ac4-3b31-4a4e-8930-42f2670838be-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "1e1d9ac4-3b31-4a4e-8930-42f2670838be" (UID: "1e1d9ac4-3b31-4a4e-8930-42f2670838be"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.384215 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-pchr5" Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.416874 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/57c22289-a4b5-4b54-a910-5fdec6ac0be7-logs\") pod \"barbican-api-6b497d5884-fvxpp\" (UID: \"57c22289-a4b5-4b54-a910-5fdec6ac0be7\") " pod="openstack-kuttl-tests/barbican-api-6b497d5884-fvxpp" Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.417057 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/57c22289-a4b5-4b54-a910-5fdec6ac0be7-config-data\") pod \"barbican-api-6b497d5884-fvxpp\" (UID: \"57c22289-a4b5-4b54-a910-5fdec6ac0be7\") " pod="openstack-kuttl-tests/barbican-api-6b497d5884-fvxpp" Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.417121 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/57c22289-a4b5-4b54-a910-5fdec6ac0be7-combined-ca-bundle\") pod \"barbican-api-6b497d5884-fvxpp\" (UID: \"57c22289-a4b5-4b54-a910-5fdec6ac0be7\") " pod="openstack-kuttl-tests/barbican-api-6b497d5884-fvxpp" Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.417222 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/57c22289-a4b5-4b54-a910-5fdec6ac0be7-config-data-custom\") pod \"barbican-api-6b497d5884-fvxpp\" (UID: \"57c22289-a4b5-4b54-a910-5fdec6ac0be7\") " pod="openstack-kuttl-tests/barbican-api-6b497d5884-fvxpp" Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.417256 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6tdpb\" (UniqueName: \"kubernetes.io/projected/57c22289-a4b5-4b54-a910-5fdec6ac0be7-kube-api-access-6tdpb\") pod \"barbican-api-6b497d5884-fvxpp\" (UID: \"57c22289-a4b5-4b54-a910-5fdec6ac0be7\") " pod="openstack-kuttl-tests/barbican-api-6b497d5884-fvxpp" Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.417332 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j8xmv\" (UniqueName: \"kubernetes.io/projected/1e1d9ac4-3b31-4a4e-8930-42f2670838be-kube-api-access-j8xmv\") on node \"crc\" DevicePath \"\"" Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.417349 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1e1d9ac4-3b31-4a4e-8930-42f2670838be-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.417358 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1e1d9ac4-3b31-4a4e-8930-42f2670838be-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.417368 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/1e1d9ac4-3b31-4a4e-8930-42f2670838be-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.417377 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1e1d9ac4-3b31-4a4e-8930-42f2670838be-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.418103 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/57c22289-a4b5-4b54-a910-5fdec6ac0be7-logs\") pod \"barbican-api-6b497d5884-fvxpp\" (UID: \"57c22289-a4b5-4b54-a910-5fdec6ac0be7\") " pod="openstack-kuttl-tests/barbican-api-6b497d5884-fvxpp" Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.419094 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1e1d9ac4-3b31-4a4e-8930-42f2670838be-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "1e1d9ac4-3b31-4a4e-8930-42f2670838be" (UID: "1e1d9ac4-3b31-4a4e-8930-42f2670838be"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.432310 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/57c22289-a4b5-4b54-a910-5fdec6ac0be7-config-data\") pod \"barbican-api-6b497d5884-fvxpp\" (UID: \"57c22289-a4b5-4b54-a910-5fdec6ac0be7\") " pod="openstack-kuttl-tests/barbican-api-6b497d5884-fvxpp" Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.438436 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/57c22289-a4b5-4b54-a910-5fdec6ac0be7-combined-ca-bundle\") pod \"barbican-api-6b497d5884-fvxpp\" (UID: \"57c22289-a4b5-4b54-a910-5fdec6ac0be7\") " pod="openstack-kuttl-tests/barbican-api-6b497d5884-fvxpp" Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.440654 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/57c22289-a4b5-4b54-a910-5fdec6ac0be7-config-data-custom\") pod \"barbican-api-6b497d5884-fvxpp\" (UID: \"57c22289-a4b5-4b54-a910-5fdec6ac0be7\") " pod="openstack-kuttl-tests/barbican-api-6b497d5884-fvxpp" Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.441097 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6tdpb\" (UniqueName: \"kubernetes.io/projected/57c22289-a4b5-4b54-a910-5fdec6ac0be7-kube-api-access-6tdpb\") pod \"barbican-api-6b497d5884-fvxpp\" (UID: \"57c22289-a4b5-4b54-a910-5fdec6ac0be7\") " pod="openstack-kuttl-tests/barbican-api-6b497d5884-fvxpp" Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.456645 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-756f865fd6-cllz7" Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.465308 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-6b497d5884-fvxpp" Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.502734 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-5ffd6f596c-m52jd" Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.513418 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1e1d9ac4-3b31-4a4e-8930-42f2670838be-config-data" (OuterVolumeSpecName: "config-data") pod "1e1d9ac4-3b31-4a4e-8930-42f2670838be" (UID: "1e1d9ac4-3b31-4a4e-8930-42f2670838be"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.519261 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1e1d9ac4-3b31-4a4e-8930-42f2670838be-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.519290 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1e1d9ac4-3b31-4a4e-8930-42f2670838be-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.638221 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/prometheus-metric-storage-0" Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.638587 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/prometheus-metric-storage-0" Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.655869 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/prometheus-metric-storage-0" Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.658207 5120 status_manager.go:895] "Failed to get status for pod" podUID="356bec90-b61f-42ca-85ea-9b25a263f3e5" pod="openstack-kuttl-tests/keystone-bootstrap-k6l62" err="pods \"keystone-bootstrap-k6l62\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.711933 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="356bec90-b61f-42ca-85ea-9b25a263f3e5" path="/var/lib/kubelet/pods/356bec90-b61f-42ca-85ea-9b25a263f3e5/volumes" Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.913820 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1e1d9ac4-3b31-4a4e-8930-42f2670838be","Type":"ContainerDied","Data":"30e8ea54a1bc416b30183e2c502417161fe7f9032569c2d70532f6f329bdd057"} Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.914315 5120 scope.go:117] "RemoveContainer" containerID="8649361aa2365f61a2d5834e81fa8bfffd9456a7988de96450e89b1fb7d915c2" Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.914447 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.933157 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-749879f798-p2tp8" event={"ID":"ca8ead84-6680-43da-b50b-703242333d2d","Type":"ContainerStarted","Data":"01ed7e6ee3f1b24489b148318e11636a850d2324364424cdbeaa5cac6802ae47"} Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.933207 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-749879f798-p2tp8" event={"ID":"ca8ead84-6680-43da-b50b-703242333d2d","Type":"ContainerStarted","Data":"8376c7670e39ec909979f3946611406179005b9a16d57c18dbc8a21e7502d8ce"} Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.954487 5120 scope.go:117] "RemoveContainer" containerID="8924dd738fa63e4ed91c2b2cd400cb43fd037582ec47620602daaff519be9da8" Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.994495 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.996886 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/watcher-api-0" event={"ID":"d8c78a81-c746-4232-9442-b648cd62f793","Type":"ContainerStarted","Data":"008f86bac563fd795b6d052b49f36b99f8c0a7f375500d7650f25046727052f9"} Mar 16 16:21:20 crc kubenswrapper[5120]: I0316 16:21:20.998014 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/watcher-api-0" Mar 16 16:21:21 crc kubenswrapper[5120]: I0316 16:21:21.031655 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"c99f889b-8cce-419b-bea2-16bbac703bca","Type":"ContainerStarted","Data":"5ab7d4db2915f9758b009d7c96025ef3c39006b82f4c7495cfaa192b41d89d6c"} Mar 16 16:21:21 crc kubenswrapper[5120]: I0316 16:21:21.034362 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:21:21 crc kubenswrapper[5120]: I0316 16:21:21.040489 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"3b45ef4a-c2e4-4ddb-b51f-aaaaac181aac","Type":"ContainerStarted","Data":"59e2208f07cce59a54ce43914a7ec56234e2cfd2367f283d1f1b4a096c2cd0ae"} Mar 16 16:21:21 crc kubenswrapper[5120]: I0316 16:21:21.047522 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:21:21 crc kubenswrapper[5120]: I0316 16:21:21.048847 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e1d9ac4-3b31-4a4e-8930-42f2670838be" containerName="ceilometer-central-agent" Mar 16 16:21:21 crc kubenswrapper[5120]: I0316 16:21:21.048889 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e1d9ac4-3b31-4a4e-8930-42f2670838be" containerName="ceilometer-central-agent" Mar 16 16:21:21 crc kubenswrapper[5120]: I0316 16:21:21.048927 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e1d9ac4-3b31-4a4e-8930-42f2670838be" containerName="sg-core" Mar 16 16:21:21 crc kubenswrapper[5120]: I0316 16:21:21.048933 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e1d9ac4-3b31-4a4e-8930-42f2670838be" containerName="sg-core" Mar 16 16:21:21 crc kubenswrapper[5120]: I0316 16:21:21.048948 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e1d9ac4-3b31-4a4e-8930-42f2670838be" containerName="proxy-httpd" Mar 16 16:21:21 crc kubenswrapper[5120]: I0316 16:21:21.050846 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e1d9ac4-3b31-4a4e-8930-42f2670838be" containerName="proxy-httpd" Mar 16 16:21:21 crc kubenswrapper[5120]: I0316 16:21:21.050881 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e1d9ac4-3b31-4a4e-8930-42f2670838be" containerName="ceilometer-notification-agent" Mar 16 16:21:21 crc kubenswrapper[5120]: I0316 16:21:21.050889 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e1d9ac4-3b31-4a4e-8930-42f2670838be" containerName="ceilometer-notification-agent" Mar 16 16:21:21 crc kubenswrapper[5120]: I0316 16:21:21.051157 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1e1d9ac4-3b31-4a4e-8930-42f2670838be" containerName="proxy-httpd" Mar 16 16:21:21 crc kubenswrapper[5120]: I0316 16:21:21.051173 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1e1d9ac4-3b31-4a4e-8930-42f2670838be" containerName="ceilometer-central-agent" Mar 16 16:21:21 crc kubenswrapper[5120]: I0316 16:21:21.051190 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1e1d9ac4-3b31-4a4e-8930-42f2670838be" containerName="sg-core" Mar 16 16:21:21 crc kubenswrapper[5120]: I0316 16:21:21.051224 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1e1d9ac4-3b31-4a4e-8930-42f2670838be" containerName="ceilometer-notification-agent" Mar 16 16:21:21 crc kubenswrapper[5120]: I0316 16:21:21.071177 5120 scope.go:117] "RemoveContainer" containerID="e523bc2c517fcee5391a2c03f390c1d6962bf26aa6c40a167defd48939f3e291" Mar 16 16:21:21 crc kubenswrapper[5120]: I0316 16:21:21.073007 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/prometheus-metric-storage-0" Mar 16 16:21:21 crc kubenswrapper[5120]: I0316 16:21:21.073454 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:21:21 crc kubenswrapper[5120]: I0316 16:21:21.077710 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 16:21:21 crc kubenswrapper[5120]: I0316 16:21:21.081188 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:21:21 crc kubenswrapper[5120]: I0316 16:21:21.081740 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 16:21:21 crc kubenswrapper[5120]: I0316 16:21:21.095239 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-pchr5"] Mar 16 16:21:21 crc kubenswrapper[5120]: I0316 16:21:21.103978 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/watcher-api-0" podStartSLOduration=4.103952353 podStartE2EDuration="4.103952353s" podCreationTimestamp="2026-03-16 16:21:17 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:21:21.02010321 +0000 UTC m=+2983.174034877" watchObservedRunningTime="2026-03-16 16:21:21.103952353 +0000 UTC m=+2983.257884030" Mar 16 16:21:21 crc kubenswrapper[5120]: I0316 16:21:21.112988 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-external-api-0" podStartSLOduration=4.112968494 podStartE2EDuration="4.112968494s" podCreationTimestamp="2026-03-16 16:21:17 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:21:21.062786242 +0000 UTC m=+2983.216717909" watchObservedRunningTime="2026-03-16 16:21:21.112968494 +0000 UTC m=+2983.266900151" Mar 16 16:21:21 crc kubenswrapper[5120]: I0316 16:21:21.163398 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/bd6718c5-d778-4991-bc8e-de0989c82299-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"bd6718c5-d778-4991-bc8e-de0989c82299\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:21:21 crc kubenswrapper[5120]: I0316 16:21:21.165939 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfvvt\" (UniqueName: \"kubernetes.io/projected/bd6718c5-d778-4991-bc8e-de0989c82299-kube-api-access-hfvvt\") pod \"ceilometer-0\" (UID: \"bd6718c5-d778-4991-bc8e-de0989c82299\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:21:21 crc kubenswrapper[5120]: I0316 16:21:21.166030 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/bd6718c5-d778-4991-bc8e-de0989c82299-scripts\") pod \"ceilometer-0\" (UID: \"bd6718c5-d778-4991-bc8e-de0989c82299\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:21:21 crc kubenswrapper[5120]: I0316 16:21:21.166061 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/bd6718c5-d778-4991-bc8e-de0989c82299-run-httpd\") pod \"ceilometer-0\" (UID: \"bd6718c5-d778-4991-bc8e-de0989c82299\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:21:21 crc kubenswrapper[5120]: I0316 16:21:21.166131 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bd6718c5-d778-4991-bc8e-de0989c82299-config-data\") pod \"ceilometer-0\" (UID: \"bd6718c5-d778-4991-bc8e-de0989c82299\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:21:21 crc kubenswrapper[5120]: I0316 16:21:21.166172 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/bd6718c5-d778-4991-bc8e-de0989c82299-log-httpd\") pod \"ceilometer-0\" (UID: \"bd6718c5-d778-4991-bc8e-de0989c82299\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:21:21 crc kubenswrapper[5120]: I0316 16:21:21.166345 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bd6718c5-d778-4991-bc8e-de0989c82299-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"bd6718c5-d778-4991-bc8e-de0989c82299\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:21:21 crc kubenswrapper[5120]: I0316 16:21:21.212300 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-756f865fd6-cllz7"] Mar 16 16:21:21 crc kubenswrapper[5120]: I0316 16:21:21.269677 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bd6718c5-d778-4991-bc8e-de0989c82299-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"bd6718c5-d778-4991-bc8e-de0989c82299\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:21:21 crc kubenswrapper[5120]: I0316 16:21:21.269798 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/bd6718c5-d778-4991-bc8e-de0989c82299-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"bd6718c5-d778-4991-bc8e-de0989c82299\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:21:21 crc kubenswrapper[5120]: I0316 16:21:21.272289 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hfvvt\" (UniqueName: \"kubernetes.io/projected/bd6718c5-d778-4991-bc8e-de0989c82299-kube-api-access-hfvvt\") pod \"ceilometer-0\" (UID: \"bd6718c5-d778-4991-bc8e-de0989c82299\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:21:21 crc kubenswrapper[5120]: I0316 16:21:21.272363 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/bd6718c5-d778-4991-bc8e-de0989c82299-scripts\") pod \"ceilometer-0\" (UID: \"bd6718c5-d778-4991-bc8e-de0989c82299\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:21:21 crc kubenswrapper[5120]: I0316 16:21:21.272392 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/bd6718c5-d778-4991-bc8e-de0989c82299-run-httpd\") pod \"ceilometer-0\" (UID: \"bd6718c5-d778-4991-bc8e-de0989c82299\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:21:21 crc kubenswrapper[5120]: I0316 16:21:21.272479 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bd6718c5-d778-4991-bc8e-de0989c82299-config-data\") pod \"ceilometer-0\" (UID: \"bd6718c5-d778-4991-bc8e-de0989c82299\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:21:21 crc kubenswrapper[5120]: I0316 16:21:21.272511 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/bd6718c5-d778-4991-bc8e-de0989c82299-log-httpd\") pod \"ceilometer-0\" (UID: \"bd6718c5-d778-4991-bc8e-de0989c82299\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:21:21 crc kubenswrapper[5120]: I0316 16:21:21.282978 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/bd6718c5-d778-4991-bc8e-de0989c82299-run-httpd\") pod \"ceilometer-0\" (UID: \"bd6718c5-d778-4991-bc8e-de0989c82299\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:21:21 crc kubenswrapper[5120]: I0316 16:21:21.283404 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/bd6718c5-d778-4991-bc8e-de0989c82299-log-httpd\") pod \"ceilometer-0\" (UID: \"bd6718c5-d778-4991-bc8e-de0989c82299\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:21:21 crc kubenswrapper[5120]: I0316 16:21:21.287600 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bd6718c5-d778-4991-bc8e-de0989c82299-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"bd6718c5-d778-4991-bc8e-de0989c82299\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:21:21 crc kubenswrapper[5120]: I0316 16:21:21.288443 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/bd6718c5-d778-4991-bc8e-de0989c82299-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"bd6718c5-d778-4991-bc8e-de0989c82299\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:21:21 crc kubenswrapper[5120]: I0316 16:21:21.292630 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/bd6718c5-d778-4991-bc8e-de0989c82299-scripts\") pod \"ceilometer-0\" (UID: \"bd6718c5-d778-4991-bc8e-de0989c82299\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:21:21 crc kubenswrapper[5120]: I0316 16:21:21.306854 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bd6718c5-d778-4991-bc8e-de0989c82299-config-data\") pod \"ceilometer-0\" (UID: \"bd6718c5-d778-4991-bc8e-de0989c82299\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:21:21 crc kubenswrapper[5120]: I0316 16:21:21.312425 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfvvt\" (UniqueName: \"kubernetes.io/projected/bd6718c5-d778-4991-bc8e-de0989c82299-kube-api-access-hfvvt\") pod \"ceilometer-0\" (UID: \"bd6718c5-d778-4991-bc8e-de0989c82299\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:21:21 crc kubenswrapper[5120]: I0316 16:21:21.321076 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-6b497d5884-fvxpp"] Mar 16 16:21:21 crc kubenswrapper[5120]: I0316 16:21:21.328356 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-5ffd6f596c-m52jd"] Mar 16 16:21:21 crc kubenswrapper[5120]: W0316 16:21:21.357493 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod57c22289_a4b5_4b54_a910_5fdec6ac0be7.slice/crio-76b5d0c22b39224c684c018a16072a7bd85500de7b58815706a2e8e5eaf35e9f WatchSource:0}: Error finding container 76b5d0c22b39224c684c018a16072a7bd85500de7b58815706a2e8e5eaf35e9f: Status 404 returned error can't find the container with id 76b5d0c22b39224c684c018a16072a7bd85500de7b58815706a2e8e5eaf35e9f Mar 16 16:21:21 crc kubenswrapper[5120]: I0316 16:21:21.368656 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:21:21 crc kubenswrapper[5120]: I0316 16:21:21.457895 5120 scope.go:117] "RemoveContainer" containerID="4557aac861cc42cf68288c1a9d7e9bb7ab3d0da395ee4b8a2a22276adbb9f50d" Mar 16 16:21:22 crc kubenswrapper[5120]: I0316 16:21:22.056502 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-pchr5" event={"ID":"bbcf321a-a331-4e3a-96f2-90af1aa2d619","Type":"ContainerStarted","Data":"419f3cb8227efffe4cc292792953134a291a4774e5e6894af2479686f7fa97c8"} Mar 16 16:21:22 crc kubenswrapper[5120]: I0316 16:21:22.057090 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-pchr5" event={"ID":"bbcf321a-a331-4e3a-96f2-90af1aa2d619","Type":"ContainerStarted","Data":"d30cd0c032b1378bbc1f9c98c1a3a902f05cbe4f0ec431bc7a8b15ba016a7797"} Mar 16 16:21:22 crc kubenswrapper[5120]: I0316 16:21:22.084565 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-bootstrap-pchr5" podStartSLOduration=3.084547921 podStartE2EDuration="3.084547921s" podCreationTimestamp="2026-03-16 16:21:19 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:21:22.080351119 +0000 UTC m=+2984.234282786" watchObservedRunningTime="2026-03-16 16:21:22.084547921 +0000 UTC m=+2984.238479578" Mar 16 16:21:22 crc kubenswrapper[5120]: I0316 16:21:22.131396 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-756f865fd6-cllz7" event={"ID":"3bb21f28-1bc0-402f-b18b-f29c0b834174","Type":"ContainerStarted","Data":"c1d44c9bc92ca9945715186ad30c605d1106f5afd0d5347a1f091e01c268412c"} Mar 16 16:21:22 crc kubenswrapper[5120]: I0316 16:21:22.131441 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-756f865fd6-cllz7" event={"ID":"3bb21f28-1bc0-402f-b18b-f29c0b834174","Type":"ContainerStarted","Data":"2bd625cf02e831d748d79a2a782e6ca939c530254b7265a4d6bdb18f7d957ea4"} Mar 16 16:21:22 crc kubenswrapper[5120]: I0316 16:21:22.131454 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-756f865fd6-cllz7" event={"ID":"3bb21f28-1bc0-402f-b18b-f29c0b834174","Type":"ContainerStarted","Data":"e05f4a229f7c67155623e6f591cc54b5b248b9a3ffd9b6983a6e2de25f6df9a0"} Mar 16 16:21:22 crc kubenswrapper[5120]: I0316 16:21:22.141164 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-749879f798-p2tp8" event={"ID":"ca8ead84-6680-43da-b50b-703242333d2d","Type":"ContainerStarted","Data":"11fee32b150db2114dc9928481fdaccdecbcc9b57599f32700330e73cd463dde"} Mar 16 16:21:22 crc kubenswrapper[5120]: I0316 16:21:22.141215 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-749879f798-p2tp8" Mar 16 16:21:22 crc kubenswrapper[5120]: I0316 16:21:22.141228 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-749879f798-p2tp8" Mar 16 16:21:22 crc kubenswrapper[5120]: I0316 16:21:22.147377 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-5ffd6f596c-m52jd" event={"ID":"61e41544-dcc8-47cf-8a6e-45b053ae0f9e","Type":"ContainerStarted","Data":"da371751a76a30f178eff06cf80fbc0812228b79e3637d23b403035295bb62ee"} Mar 16 16:21:22 crc kubenswrapper[5120]: I0316 16:21:22.147435 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-5ffd6f596c-m52jd" event={"ID":"61e41544-dcc8-47cf-8a6e-45b053ae0f9e","Type":"ContainerStarted","Data":"3a6462abd71c56a875a101ba5922e4616a44e213b945e6603580e677c4a7f753"} Mar 16 16:21:22 crc kubenswrapper[5120]: I0316 16:21:22.155351 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-keystone-listener-756f865fd6-cllz7" podStartSLOduration=3.155334575 podStartE2EDuration="3.155334575s" podCreationTimestamp="2026-03-16 16:21:19 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:21:22.154212185 +0000 UTC m=+2984.308143852" watchObservedRunningTime="2026-03-16 16:21:22.155334575 +0000 UTC m=+2984.309266232" Mar 16 16:21:22 crc kubenswrapper[5120]: I0316 16:21:22.165805 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-6b497d5884-fvxpp" event={"ID":"57c22289-a4b5-4b54-a910-5fdec6ac0be7","Type":"ContainerStarted","Data":"c1a0f2ad5025128012c9fedc079104ec08b3ce3c8df14ee46277cd1d057b82f0"} Mar 16 16:21:22 crc kubenswrapper[5120]: I0316 16:21:22.165851 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-6b497d5884-fvxpp" event={"ID":"57c22289-a4b5-4b54-a910-5fdec6ac0be7","Type":"ContainerStarted","Data":"76b5d0c22b39224c684c018a16072a7bd85500de7b58815706a2e8e5eaf35e9f"} Mar 16 16:21:22 crc kubenswrapper[5120]: I0316 16:21:22.172877 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:21:22 crc kubenswrapper[5120]: I0316 16:21:22.192832 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-749879f798-p2tp8" podStartSLOduration=4.192813856 podStartE2EDuration="4.192813856s" podCreationTimestamp="2026-03-16 16:21:18 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:21:22.183928189 +0000 UTC m=+2984.337859846" watchObservedRunningTime="2026-03-16 16:21:22.192813856 +0000 UTC m=+2984.346745503" Mar 16 16:21:22 crc kubenswrapper[5120]: W0316 16:21:22.556445 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbd6718c5_d778_4991_bc8e_de0989c82299.slice/crio-0d27ee7d3389dfea0720a1feae26dc9c46a3c1bc81a261125e3e7f5bd5b1a68a WatchSource:0}: Error finding container 0d27ee7d3389dfea0720a1feae26dc9c46a3c1bc81a261125e3e7f5bd5b1a68a: Status 404 returned error can't find the container with id 0d27ee7d3389dfea0720a1feae26dc9c46a3c1bc81a261125e3e7f5bd5b1a68a Mar 16 16:21:22 crc kubenswrapper[5120]: I0316 16:21:22.617390 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-api-6b946b9c94-hvvmv"] Mar 16 16:21:22 crc kubenswrapper[5120]: I0316 16:21:22.625629 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-6b946b9c94-hvvmv" Mar 16 16:21:22 crc kubenswrapper[5120]: I0316 16:21:22.630983 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-barbican-public-svc\"" Mar 16 16:21:22 crc kubenswrapper[5120]: I0316 16:21:22.631277 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-barbican-internal-svc\"" Mar 16 16:21:22 crc kubenswrapper[5120]: I0316 16:21:22.647854 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-6b946b9c94-hvvmv"] Mar 16 16:21:22 crc kubenswrapper[5120]: I0316 16:21:22.699025 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1e1d9ac4-3b31-4a4e-8930-42f2670838be" path="/var/lib/kubelet/pods/1e1d9ac4-3b31-4a4e-8930-42f2670838be/volumes" Mar 16 16:21:22 crc kubenswrapper[5120]: I0316 16:21:22.818419 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cc082deb-bc44-4949-95e5-f6a9ece6220c-combined-ca-bundle\") pod \"barbican-api-6b946b9c94-hvvmv\" (UID: \"cc082deb-bc44-4949-95e5-f6a9ece6220c\") " pod="openstack-kuttl-tests/barbican-api-6b946b9c94-hvvmv" Mar 16 16:21:22 crc kubenswrapper[5120]: I0316 16:21:22.818474 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/cc082deb-bc44-4949-95e5-f6a9ece6220c-logs\") pod \"barbican-api-6b946b9c94-hvvmv\" (UID: \"cc082deb-bc44-4949-95e5-f6a9ece6220c\") " pod="openstack-kuttl-tests/barbican-api-6b946b9c94-hvvmv" Mar 16 16:21:22 crc kubenswrapper[5120]: I0316 16:21:22.819270 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cc082deb-bc44-4949-95e5-f6a9ece6220c-config-data\") pod \"barbican-api-6b946b9c94-hvvmv\" (UID: \"cc082deb-bc44-4949-95e5-f6a9ece6220c\") " pod="openstack-kuttl-tests/barbican-api-6b946b9c94-hvvmv" Mar 16 16:21:22 crc kubenswrapper[5120]: I0316 16:21:22.819311 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9bpl\" (UniqueName: \"kubernetes.io/projected/cc082deb-bc44-4949-95e5-f6a9ece6220c-kube-api-access-l9bpl\") pod \"barbican-api-6b946b9c94-hvvmv\" (UID: \"cc082deb-bc44-4949-95e5-f6a9ece6220c\") " pod="openstack-kuttl-tests/barbican-api-6b946b9c94-hvvmv" Mar 16 16:21:22 crc kubenswrapper[5120]: I0316 16:21:22.819465 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/cc082deb-bc44-4949-95e5-f6a9ece6220c-public-tls-certs\") pod \"barbican-api-6b946b9c94-hvvmv\" (UID: \"cc082deb-bc44-4949-95e5-f6a9ece6220c\") " pod="openstack-kuttl-tests/barbican-api-6b946b9c94-hvvmv" Mar 16 16:21:22 crc kubenswrapper[5120]: I0316 16:21:22.819530 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/cc082deb-bc44-4949-95e5-f6a9ece6220c-config-data-custom\") pod \"barbican-api-6b946b9c94-hvvmv\" (UID: \"cc082deb-bc44-4949-95e5-f6a9ece6220c\") " pod="openstack-kuttl-tests/barbican-api-6b946b9c94-hvvmv" Mar 16 16:21:22 crc kubenswrapper[5120]: I0316 16:21:22.819586 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/cc082deb-bc44-4949-95e5-f6a9ece6220c-internal-tls-certs\") pod \"barbican-api-6b946b9c94-hvvmv\" (UID: \"cc082deb-bc44-4949-95e5-f6a9ece6220c\") " pod="openstack-kuttl-tests/barbican-api-6b946b9c94-hvvmv" Mar 16 16:21:22 crc kubenswrapper[5120]: I0316 16:21:22.922575 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cc082deb-bc44-4949-95e5-f6a9ece6220c-config-data\") pod \"barbican-api-6b946b9c94-hvvmv\" (UID: \"cc082deb-bc44-4949-95e5-f6a9ece6220c\") " pod="openstack-kuttl-tests/barbican-api-6b946b9c94-hvvmv" Mar 16 16:21:22 crc kubenswrapper[5120]: I0316 16:21:22.922616 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l9bpl\" (UniqueName: \"kubernetes.io/projected/cc082deb-bc44-4949-95e5-f6a9ece6220c-kube-api-access-l9bpl\") pod \"barbican-api-6b946b9c94-hvvmv\" (UID: \"cc082deb-bc44-4949-95e5-f6a9ece6220c\") " pod="openstack-kuttl-tests/barbican-api-6b946b9c94-hvvmv" Mar 16 16:21:22 crc kubenswrapper[5120]: I0316 16:21:22.922640 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/cc082deb-bc44-4949-95e5-f6a9ece6220c-public-tls-certs\") pod \"barbican-api-6b946b9c94-hvvmv\" (UID: \"cc082deb-bc44-4949-95e5-f6a9ece6220c\") " pod="openstack-kuttl-tests/barbican-api-6b946b9c94-hvvmv" Mar 16 16:21:22 crc kubenswrapper[5120]: I0316 16:21:22.922670 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/cc082deb-bc44-4949-95e5-f6a9ece6220c-config-data-custom\") pod \"barbican-api-6b946b9c94-hvvmv\" (UID: \"cc082deb-bc44-4949-95e5-f6a9ece6220c\") " pod="openstack-kuttl-tests/barbican-api-6b946b9c94-hvvmv" Mar 16 16:21:22 crc kubenswrapper[5120]: I0316 16:21:22.922701 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/cc082deb-bc44-4949-95e5-f6a9ece6220c-internal-tls-certs\") pod \"barbican-api-6b946b9c94-hvvmv\" (UID: \"cc082deb-bc44-4949-95e5-f6a9ece6220c\") " pod="openstack-kuttl-tests/barbican-api-6b946b9c94-hvvmv" Mar 16 16:21:22 crc kubenswrapper[5120]: I0316 16:21:22.922877 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cc082deb-bc44-4949-95e5-f6a9ece6220c-combined-ca-bundle\") pod \"barbican-api-6b946b9c94-hvvmv\" (UID: \"cc082deb-bc44-4949-95e5-f6a9ece6220c\") " pod="openstack-kuttl-tests/barbican-api-6b946b9c94-hvvmv" Mar 16 16:21:22 crc kubenswrapper[5120]: I0316 16:21:22.922905 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/cc082deb-bc44-4949-95e5-f6a9ece6220c-logs\") pod \"barbican-api-6b946b9c94-hvvmv\" (UID: \"cc082deb-bc44-4949-95e5-f6a9ece6220c\") " pod="openstack-kuttl-tests/barbican-api-6b946b9c94-hvvmv" Mar 16 16:21:22 crc kubenswrapper[5120]: I0316 16:21:22.923510 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/cc082deb-bc44-4949-95e5-f6a9ece6220c-logs\") pod \"barbican-api-6b946b9c94-hvvmv\" (UID: \"cc082deb-bc44-4949-95e5-f6a9ece6220c\") " pod="openstack-kuttl-tests/barbican-api-6b946b9c94-hvvmv" Mar 16 16:21:22 crc kubenswrapper[5120]: I0316 16:21:22.929912 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/cc082deb-bc44-4949-95e5-f6a9ece6220c-config-data-custom\") pod \"barbican-api-6b946b9c94-hvvmv\" (UID: \"cc082deb-bc44-4949-95e5-f6a9ece6220c\") " pod="openstack-kuttl-tests/barbican-api-6b946b9c94-hvvmv" Mar 16 16:21:22 crc kubenswrapper[5120]: I0316 16:21:22.930352 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cc082deb-bc44-4949-95e5-f6a9ece6220c-config-data\") pod \"barbican-api-6b946b9c94-hvvmv\" (UID: \"cc082deb-bc44-4949-95e5-f6a9ece6220c\") " pod="openstack-kuttl-tests/barbican-api-6b946b9c94-hvvmv" Mar 16 16:21:22 crc kubenswrapper[5120]: I0316 16:21:22.930534 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/cc082deb-bc44-4949-95e5-f6a9ece6220c-public-tls-certs\") pod \"barbican-api-6b946b9c94-hvvmv\" (UID: \"cc082deb-bc44-4949-95e5-f6a9ece6220c\") " pod="openstack-kuttl-tests/barbican-api-6b946b9c94-hvvmv" Mar 16 16:21:22 crc kubenswrapper[5120]: I0316 16:21:22.939915 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cc082deb-bc44-4949-95e5-f6a9ece6220c-combined-ca-bundle\") pod \"barbican-api-6b946b9c94-hvvmv\" (UID: \"cc082deb-bc44-4949-95e5-f6a9ece6220c\") " pod="openstack-kuttl-tests/barbican-api-6b946b9c94-hvvmv" Mar 16 16:21:22 crc kubenswrapper[5120]: I0316 16:21:22.942149 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/cc082deb-bc44-4949-95e5-f6a9ece6220c-internal-tls-certs\") pod \"barbican-api-6b946b9c94-hvvmv\" (UID: \"cc082deb-bc44-4949-95e5-f6a9ece6220c\") " pod="openstack-kuttl-tests/barbican-api-6b946b9c94-hvvmv" Mar 16 16:21:22 crc kubenswrapper[5120]: I0316 16:21:22.942189 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9bpl\" (UniqueName: \"kubernetes.io/projected/cc082deb-bc44-4949-95e5-f6a9ece6220c-kube-api-access-l9bpl\") pod \"barbican-api-6b946b9c94-hvvmv\" (UID: \"cc082deb-bc44-4949-95e5-f6a9ece6220c\") " pod="openstack-kuttl-tests/barbican-api-6b946b9c94-hvvmv" Mar 16 16:21:22 crc kubenswrapper[5120]: I0316 16:21:22.977990 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-6b946b9c94-hvvmv" Mar 16 16:21:23 crc kubenswrapper[5120]: I0316 16:21:23.182654 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"bd6718c5-d778-4991-bc8e-de0989c82299","Type":"ContainerStarted","Data":"0d27ee7d3389dfea0720a1feae26dc9c46a3c1bc81a261125e3e7f5bd5b1a68a"} Mar 16 16:21:23 crc kubenswrapper[5120]: I0316 16:21:23.184191 5120 generic.go:358] "Generic (PLEG): container finished" podID="c2b81fed-a0a9-44aa-9d9e-ba21b827dc43" containerID="b3f67bac83ec3397d083d4295b6aae920370a632da07ca7a35f4d30b94b1d332" exitCode=0 Mar 16 16:21:23 crc kubenswrapper[5120]: I0316 16:21:23.184262 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-d2k76" event={"ID":"c2b81fed-a0a9-44aa-9d9e-ba21b827dc43","Type":"ContainerDied","Data":"b3f67bac83ec3397d083d4295b6aae920370a632da07ca7a35f4d30b94b1d332"} Mar 16 16:21:23 crc kubenswrapper[5120]: I0316 16:21:23.189006 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"c99f889b-8cce-419b-bea2-16bbac703bca","Type":"ContainerStarted","Data":"fcdab08251b097dec25fdba98221132625088fbe856c4964b494d87f06509eca"} Mar 16 16:21:23 crc kubenswrapper[5120]: I0316 16:21:23.224491 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-internal-api-0" podStartSLOduration=6.22446118 podStartE2EDuration="6.22446118s" podCreationTimestamp="2026-03-16 16:21:17 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:21:23.222818987 +0000 UTC m=+2985.376750644" watchObservedRunningTime="2026-03-16 16:21:23.22446118 +0000 UTC m=+2985.378392837" Mar 16 16:21:23 crc kubenswrapper[5120]: I0316 16:21:23.495303 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/watcher-api-0" Mar 16 16:21:23 crc kubenswrapper[5120]: I0316 16:21:23.495987 5120 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Mar 16 16:21:23 crc kubenswrapper[5120]: I0316 16:21:23.753974 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-6b946b9c94-hvvmv"] Mar 16 16:21:23 crc kubenswrapper[5120]: I0316 16:21:23.932617 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/watcher-api-0" Mar 16 16:21:24 crc kubenswrapper[5120]: I0316 16:21:24.210863 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/watcher-applier-0" event={"ID":"d5160b65-3a41-4645-9f47-bd4e891fef5f","Type":"ContainerStarted","Data":"ce0a8bde470adeb57224c167d670364e256b6b1b5b4d78dd8410053f53d53467"} Mar 16 16:21:24 crc kubenswrapper[5120]: I0316 16:21:24.213271 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-6b946b9c94-hvvmv" event={"ID":"cc082deb-bc44-4949-95e5-f6a9ece6220c","Type":"ContainerStarted","Data":"7b9d72fd68bdaeb3ffdd80b1f42f221d7edcb3c58698eb912cef35b25cd35fcc"} Mar 16 16:21:24 crc kubenswrapper[5120]: I0316 16:21:24.213300 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-6b946b9c94-hvvmv" event={"ID":"cc082deb-bc44-4949-95e5-f6a9ece6220c","Type":"ContainerStarted","Data":"347ec183e1d04f152b9b6c320925ef988778142b98af6611b0826d95f0009108"} Mar 16 16:21:24 crc kubenswrapper[5120]: I0316 16:21:24.215859 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-6b497d5884-fvxpp" event={"ID":"57c22289-a4b5-4b54-a910-5fdec6ac0be7","Type":"ContainerStarted","Data":"35ff5b911cade3b41afb99088225189dca6df087065a3b1ebbfc3cc5be684296"} Mar 16 16:21:24 crc kubenswrapper[5120]: I0316 16:21:24.215974 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-6b497d5884-fvxpp" Mar 16 16:21:24 crc kubenswrapper[5120]: I0316 16:21:24.216087 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-6b497d5884-fvxpp" Mar 16 16:21:24 crc kubenswrapper[5120]: I0316 16:21:24.217265 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/watcher-decision-engine-0" event={"ID":"447d5bb0-18ef-4779-8b6a-a4a96bd0fe09","Type":"ContainerStarted","Data":"883cc8ebfe94a6c0156946f1e741a4f8fe89bc0d3fb7ccd962c340565eecff9a"} Mar 16 16:21:24 crc kubenswrapper[5120]: I0316 16:21:24.222005 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-5ffd6f596c-m52jd" event={"ID":"61e41544-dcc8-47cf-8a6e-45b053ae0f9e","Type":"ContainerStarted","Data":"eb0d8a6546028f00924b876961e7377e8be7061907902ffda27871c0c53fa378"} Mar 16 16:21:24 crc kubenswrapper[5120]: I0316 16:21:24.248274 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/watcher-applier-0" podStartSLOduration=2.557694662 podStartE2EDuration="6.248250984s" podCreationTimestamp="2026-03-16 16:21:18 +0000 UTC" firstStartedPulling="2026-03-16 16:21:19.564317292 +0000 UTC m=+2981.718248949" lastFinishedPulling="2026-03-16 16:21:23.254873614 +0000 UTC m=+2985.408805271" observedRunningTime="2026-03-16 16:21:24.233972432 +0000 UTC m=+2986.387904099" watchObservedRunningTime="2026-03-16 16:21:24.248250984 +0000 UTC m=+2986.402182641" Mar 16 16:21:24 crc kubenswrapper[5120]: I0316 16:21:24.287362 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/watcher-decision-engine-0" podStartSLOduration=2.637848836 podStartE2EDuration="6.287333669s" podCreationTimestamp="2026-03-16 16:21:18 +0000 UTC" firstStartedPulling="2026-03-16 16:21:19.603077839 +0000 UTC m=+2981.757009506" lastFinishedPulling="2026-03-16 16:21:23.252562692 +0000 UTC m=+2985.406494339" observedRunningTime="2026-03-16 16:21:24.284127294 +0000 UTC m=+2986.438058951" watchObservedRunningTime="2026-03-16 16:21:24.287333669 +0000 UTC m=+2986.441265326" Mar 16 16:21:24 crc kubenswrapper[5120]: I0316 16:21:24.290268 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-api-6b497d5884-fvxpp" podStartSLOduration=4.290257567 podStartE2EDuration="4.290257567s" podCreationTimestamp="2026-03-16 16:21:20 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:21:24.266824991 +0000 UTC m=+2986.420756648" watchObservedRunningTime="2026-03-16 16:21:24.290257567 +0000 UTC m=+2986.444189224" Mar 16 16:21:24 crc kubenswrapper[5120]: I0316 16:21:24.650587 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-d2k76" Mar 16 16:21:24 crc kubenswrapper[5120]: I0316 16:21:24.678877 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-worker-5ffd6f596c-m52jd" podStartSLOduration=5.678854692 podStartE2EDuration="5.678854692s" podCreationTimestamp="2026-03-16 16:21:19 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:21:24.309206915 +0000 UTC m=+2986.463138572" watchObservedRunningTime="2026-03-16 16:21:24.678854692 +0000 UTC m=+2986.832786359" Mar 16 16:21:24 crc kubenswrapper[5120]: I0316 16:21:24.780484 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c2b81fed-a0a9-44aa-9d9e-ba21b827dc43-combined-ca-bundle\") pod \"c2b81fed-a0a9-44aa-9d9e-ba21b827dc43\" (UID: \"c2b81fed-a0a9-44aa-9d9e-ba21b827dc43\") " Mar 16 16:21:24 crc kubenswrapper[5120]: I0316 16:21:24.780604 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8zp7n\" (UniqueName: \"kubernetes.io/projected/c2b81fed-a0a9-44aa-9d9e-ba21b827dc43-kube-api-access-8zp7n\") pod \"c2b81fed-a0a9-44aa-9d9e-ba21b827dc43\" (UID: \"c2b81fed-a0a9-44aa-9d9e-ba21b827dc43\") " Mar 16 16:21:24 crc kubenswrapper[5120]: I0316 16:21:24.780667 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c2b81fed-a0a9-44aa-9d9e-ba21b827dc43-config-data\") pod \"c2b81fed-a0a9-44aa-9d9e-ba21b827dc43\" (UID: \"c2b81fed-a0a9-44aa-9d9e-ba21b827dc43\") " Mar 16 16:21:24 crc kubenswrapper[5120]: I0316 16:21:24.780892 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/c2b81fed-a0a9-44aa-9d9e-ba21b827dc43-db-sync-config-data\") pod \"c2b81fed-a0a9-44aa-9d9e-ba21b827dc43\" (UID: \"c2b81fed-a0a9-44aa-9d9e-ba21b827dc43\") " Mar 16 16:21:24 crc kubenswrapper[5120]: I0316 16:21:24.781014 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/c2b81fed-a0a9-44aa-9d9e-ba21b827dc43-etc-machine-id\") pod \"c2b81fed-a0a9-44aa-9d9e-ba21b827dc43\" (UID: \"c2b81fed-a0a9-44aa-9d9e-ba21b827dc43\") " Mar 16 16:21:24 crc kubenswrapper[5120]: I0316 16:21:24.781107 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c2b81fed-a0a9-44aa-9d9e-ba21b827dc43-scripts\") pod \"c2b81fed-a0a9-44aa-9d9e-ba21b827dc43\" (UID: \"c2b81fed-a0a9-44aa-9d9e-ba21b827dc43\") " Mar 16 16:21:24 crc kubenswrapper[5120]: I0316 16:21:24.781165 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/c2b81fed-a0a9-44aa-9d9e-ba21b827dc43-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "c2b81fed-a0a9-44aa-9d9e-ba21b827dc43" (UID: "c2b81fed-a0a9-44aa-9d9e-ba21b827dc43"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 16:21:24 crc kubenswrapper[5120]: I0316 16:21:24.781822 5120 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/c2b81fed-a0a9-44aa-9d9e-ba21b827dc43-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 16:21:24 crc kubenswrapper[5120]: I0316 16:21:24.790936 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c2b81fed-a0a9-44aa-9d9e-ba21b827dc43-db-sync-config-data" (OuterVolumeSpecName: "db-sync-config-data") pod "c2b81fed-a0a9-44aa-9d9e-ba21b827dc43" (UID: "c2b81fed-a0a9-44aa-9d9e-ba21b827dc43"). InnerVolumeSpecName "db-sync-config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:21:24 crc kubenswrapper[5120]: I0316 16:21:24.790973 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2b81fed-a0a9-44aa-9d9e-ba21b827dc43-kube-api-access-8zp7n" (OuterVolumeSpecName: "kube-api-access-8zp7n") pod "c2b81fed-a0a9-44aa-9d9e-ba21b827dc43" (UID: "c2b81fed-a0a9-44aa-9d9e-ba21b827dc43"). InnerVolumeSpecName "kube-api-access-8zp7n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:21:24 crc kubenswrapper[5120]: I0316 16:21:24.792872 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c2b81fed-a0a9-44aa-9d9e-ba21b827dc43-scripts" (OuterVolumeSpecName: "scripts") pod "c2b81fed-a0a9-44aa-9d9e-ba21b827dc43" (UID: "c2b81fed-a0a9-44aa-9d9e-ba21b827dc43"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:21:24 crc kubenswrapper[5120]: I0316 16:21:24.830148 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c2b81fed-a0a9-44aa-9d9e-ba21b827dc43-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "c2b81fed-a0a9-44aa-9d9e-ba21b827dc43" (UID: "c2b81fed-a0a9-44aa-9d9e-ba21b827dc43"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:21:24 crc kubenswrapper[5120]: I0316 16:21:24.844862 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c2b81fed-a0a9-44aa-9d9e-ba21b827dc43-config-data" (OuterVolumeSpecName: "config-data") pod "c2b81fed-a0a9-44aa-9d9e-ba21b827dc43" (UID: "c2b81fed-a0a9-44aa-9d9e-ba21b827dc43"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:21:24 crc kubenswrapper[5120]: I0316 16:21:24.885543 5120 reconciler_common.go:299] "Volume detached for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/c2b81fed-a0a9-44aa-9d9e-ba21b827dc43-db-sync-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:21:24 crc kubenswrapper[5120]: I0316 16:21:24.885596 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c2b81fed-a0a9-44aa-9d9e-ba21b827dc43-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:21:24 crc kubenswrapper[5120]: I0316 16:21:24.885613 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c2b81fed-a0a9-44aa-9d9e-ba21b827dc43-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:21:24 crc kubenswrapper[5120]: I0316 16:21:24.885627 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8zp7n\" (UniqueName: \"kubernetes.io/projected/c2b81fed-a0a9-44aa-9d9e-ba21b827dc43-kube-api-access-8zp7n\") on node \"crc\" DevicePath \"\"" Mar 16 16:21:24 crc kubenswrapper[5120]: I0316 16:21:24.885643 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c2b81fed-a0a9-44aa-9d9e-ba21b827dc43-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:21:25 crc kubenswrapper[5120]: I0316 16:21:25.233861 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"bd6718c5-d778-4991-bc8e-de0989c82299","Type":"ContainerStarted","Data":"818b27a472d92374032010866daa0e995cc70e7f9539c02e4b5d4b8db55f15f9"} Mar 16 16:21:25 crc kubenswrapper[5120]: I0316 16:21:25.233905 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"bd6718c5-d778-4991-bc8e-de0989c82299","Type":"ContainerStarted","Data":"9e17fdd369ba7374abf0d212cd6d7f5d289a260a0de7cfccd3c61cc1b45d2cf4"} Mar 16 16:21:25 crc kubenswrapper[5120]: I0316 16:21:25.237071 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-6b946b9c94-hvvmv" event={"ID":"cc082deb-bc44-4949-95e5-f6a9ece6220c","Type":"ContainerStarted","Data":"d5aaa29de71f9506edf61c52ff902611842cbc3ad6e5f2ae70727afe76f85f25"} Mar 16 16:21:25 crc kubenswrapper[5120]: I0316 16:21:25.238590 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-6b946b9c94-hvvmv" Mar 16 16:21:25 crc kubenswrapper[5120]: I0316 16:21:25.238632 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-6b946b9c94-hvvmv" Mar 16 16:21:25 crc kubenswrapper[5120]: I0316 16:21:25.241983 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-d2k76" event={"ID":"c2b81fed-a0a9-44aa-9d9e-ba21b827dc43","Type":"ContainerDied","Data":"f819a2eadc5dc862f9fd438a71dba8e91a6ce4f661fb36bc97d1ec009262ab9c"} Mar 16 16:21:25 crc kubenswrapper[5120]: I0316 16:21:25.242032 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f819a2eadc5dc862f9fd438a71dba8e91a6ce4f661fb36bc97d1ec009262ab9c" Mar 16 16:21:25 crc kubenswrapper[5120]: I0316 16:21:25.242179 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-d2k76" Mar 16 16:21:25 crc kubenswrapper[5120]: I0316 16:21:25.272141 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-api-6b946b9c94-hvvmv" podStartSLOduration=3.27211782 podStartE2EDuration="3.27211782s" podCreationTimestamp="2026-03-16 16:21:22 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:21:25.258243689 +0000 UTC m=+2987.412175336" watchObservedRunningTime="2026-03-16 16:21:25.27211782 +0000 UTC m=+2987.426049477" Mar 16 16:21:25 crc kubenswrapper[5120]: I0316 16:21:25.445441 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:21:25 crc kubenswrapper[5120]: I0316 16:21:25.446438 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2b81fed-a0a9-44aa-9d9e-ba21b827dc43" containerName="cinder-db-sync" Mar 16 16:21:25 crc kubenswrapper[5120]: I0316 16:21:25.446455 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2b81fed-a0a9-44aa-9d9e-ba21b827dc43" containerName="cinder-db-sync" Mar 16 16:21:25 crc kubenswrapper[5120]: I0316 16:21:25.446629 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c2b81fed-a0a9-44aa-9d9e-ba21b827dc43" containerName="cinder-db-sync" Mar 16 16:21:25 crc kubenswrapper[5120]: I0316 16:21:25.460432 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:21:25 crc kubenswrapper[5120]: I0316 16:21:25.463695 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-cinder-dockercfg-szxx6\"" Mar 16 16:21:25 crc kubenswrapper[5120]: I0316 16:21:25.466031 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-scheduler-config-data\"" Mar 16 16:21:25 crc kubenswrapper[5120]: I0316 16:21:25.466097 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-scripts\"" Mar 16 16:21:25 crc kubenswrapper[5120]: I0316 16:21:25.466449 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-config-data\"" Mar 16 16:21:25 crc kubenswrapper[5120]: I0316 16:21:25.477981 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:21:25 crc kubenswrapper[5120]: I0316 16:21:25.499384 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ssllz\" (UniqueName: \"kubernetes.io/projected/88c05a13-c1ef-4aee-9a86-d91a80dc4af5-kube-api-access-ssllz\") pod \"cinder-scheduler-0\" (UID: \"88c05a13-c1ef-4aee-9a86-d91a80dc4af5\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:21:25 crc kubenswrapper[5120]: I0316 16:21:25.499860 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/88c05a13-c1ef-4aee-9a86-d91a80dc4af5-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"88c05a13-c1ef-4aee-9a86-d91a80dc4af5\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:21:25 crc kubenswrapper[5120]: I0316 16:21:25.500055 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/88c05a13-c1ef-4aee-9a86-d91a80dc4af5-config-data\") pod \"cinder-scheduler-0\" (UID: \"88c05a13-c1ef-4aee-9a86-d91a80dc4af5\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:21:25 crc kubenswrapper[5120]: I0316 16:21:25.500192 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/88c05a13-c1ef-4aee-9a86-d91a80dc4af5-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"88c05a13-c1ef-4aee-9a86-d91a80dc4af5\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:21:25 crc kubenswrapper[5120]: I0316 16:21:25.500404 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/88c05a13-c1ef-4aee-9a86-d91a80dc4af5-scripts\") pod \"cinder-scheduler-0\" (UID: \"88c05a13-c1ef-4aee-9a86-d91a80dc4af5\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:21:25 crc kubenswrapper[5120]: I0316 16:21:25.500531 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/88c05a13-c1ef-4aee-9a86-d91a80dc4af5-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"88c05a13-c1ef-4aee-9a86-d91a80dc4af5\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:21:25 crc kubenswrapper[5120]: I0316 16:21:25.586598 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:21:25 crc kubenswrapper[5120]: I0316 16:21:25.592054 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:21:25 crc kubenswrapper[5120]: I0316 16:21:25.597457 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-api-config-data\"" Mar 16 16:21:25 crc kubenswrapper[5120]: I0316 16:21:25.604720 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/88c05a13-c1ef-4aee-9a86-d91a80dc4af5-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"88c05a13-c1ef-4aee-9a86-d91a80dc4af5\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:21:25 crc kubenswrapper[5120]: I0316 16:21:25.605021 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/c64d0fce-5ae8-4f4a-9b5e-987fba23be30-etc-machine-id\") pod \"cinder-api-0\" (UID: \"c64d0fce-5ae8-4f4a-9b5e-987fba23be30\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:21:25 crc kubenswrapper[5120]: I0316 16:21:25.605151 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c64d0fce-5ae8-4f4a-9b5e-987fba23be30-logs\") pod \"cinder-api-0\" (UID: \"c64d0fce-5ae8-4f4a-9b5e-987fba23be30\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:21:25 crc kubenswrapper[5120]: I0316 16:21:25.605260 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c64d0fce-5ae8-4f4a-9b5e-987fba23be30-scripts\") pod \"cinder-api-0\" (UID: \"c64d0fce-5ae8-4f4a-9b5e-987fba23be30\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:21:25 crc kubenswrapper[5120]: I0316 16:21:25.605344 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jp4zq\" (UniqueName: \"kubernetes.io/projected/c64d0fce-5ae8-4f4a-9b5e-987fba23be30-kube-api-access-jp4zq\") pod \"cinder-api-0\" (UID: \"c64d0fce-5ae8-4f4a-9b5e-987fba23be30\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:21:25 crc kubenswrapper[5120]: I0316 16:21:25.605438 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ssllz\" (UniqueName: \"kubernetes.io/projected/88c05a13-c1ef-4aee-9a86-d91a80dc4af5-kube-api-access-ssllz\") pod \"cinder-scheduler-0\" (UID: \"88c05a13-c1ef-4aee-9a86-d91a80dc4af5\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:21:25 crc kubenswrapper[5120]: I0316 16:21:25.605525 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/88c05a13-c1ef-4aee-9a86-d91a80dc4af5-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"88c05a13-c1ef-4aee-9a86-d91a80dc4af5\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:21:25 crc kubenswrapper[5120]: I0316 16:21:25.605967 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/88c05a13-c1ef-4aee-9a86-d91a80dc4af5-config-data\") pod \"cinder-scheduler-0\" (UID: \"88c05a13-c1ef-4aee-9a86-d91a80dc4af5\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:21:25 crc kubenswrapper[5120]: I0316 16:21:25.606068 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/c64d0fce-5ae8-4f4a-9b5e-987fba23be30-config-data-custom\") pod \"cinder-api-0\" (UID: \"c64d0fce-5ae8-4f4a-9b5e-987fba23be30\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:21:25 crc kubenswrapper[5120]: I0316 16:21:25.606168 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/88c05a13-c1ef-4aee-9a86-d91a80dc4af5-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"88c05a13-c1ef-4aee-9a86-d91a80dc4af5\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:21:25 crc kubenswrapper[5120]: I0316 16:21:25.606340 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c64d0fce-5ae8-4f4a-9b5e-987fba23be30-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"c64d0fce-5ae8-4f4a-9b5e-987fba23be30\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:21:25 crc kubenswrapper[5120]: I0316 16:21:25.606434 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c64d0fce-5ae8-4f4a-9b5e-987fba23be30-config-data\") pod \"cinder-api-0\" (UID: \"c64d0fce-5ae8-4f4a-9b5e-987fba23be30\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:21:25 crc kubenswrapper[5120]: I0316 16:21:25.606543 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/88c05a13-c1ef-4aee-9a86-d91a80dc4af5-scripts\") pod \"cinder-scheduler-0\" (UID: \"88c05a13-c1ef-4aee-9a86-d91a80dc4af5\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:21:25 crc kubenswrapper[5120]: I0316 16:21:25.614926 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/88c05a13-c1ef-4aee-9a86-d91a80dc4af5-scripts\") pod \"cinder-scheduler-0\" (UID: \"88c05a13-c1ef-4aee-9a86-d91a80dc4af5\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:21:25 crc kubenswrapper[5120]: I0316 16:21:25.615293 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/88c05a13-c1ef-4aee-9a86-d91a80dc4af5-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"88c05a13-c1ef-4aee-9a86-d91a80dc4af5\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:21:25 crc kubenswrapper[5120]: I0316 16:21:25.631869 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:21:25 crc kubenswrapper[5120]: I0316 16:21:25.632588 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ssllz\" (UniqueName: \"kubernetes.io/projected/88c05a13-c1ef-4aee-9a86-d91a80dc4af5-kube-api-access-ssllz\") pod \"cinder-scheduler-0\" (UID: \"88c05a13-c1ef-4aee-9a86-d91a80dc4af5\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:21:25 crc kubenswrapper[5120]: I0316 16:21:25.634839 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/88c05a13-c1ef-4aee-9a86-d91a80dc4af5-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"88c05a13-c1ef-4aee-9a86-d91a80dc4af5\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:21:25 crc kubenswrapper[5120]: I0316 16:21:25.636443 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/88c05a13-c1ef-4aee-9a86-d91a80dc4af5-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"88c05a13-c1ef-4aee-9a86-d91a80dc4af5\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:21:25 crc kubenswrapper[5120]: I0316 16:21:25.665521 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/88c05a13-c1ef-4aee-9a86-d91a80dc4af5-config-data\") pod \"cinder-scheduler-0\" (UID: \"88c05a13-c1ef-4aee-9a86-d91a80dc4af5\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:21:25 crc kubenswrapper[5120]: I0316 16:21:25.709996 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c64d0fce-5ae8-4f4a-9b5e-987fba23be30-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"c64d0fce-5ae8-4f4a-9b5e-987fba23be30\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:21:25 crc kubenswrapper[5120]: I0316 16:21:25.710095 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c64d0fce-5ae8-4f4a-9b5e-987fba23be30-config-data\") pod \"cinder-api-0\" (UID: \"c64d0fce-5ae8-4f4a-9b5e-987fba23be30\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:21:25 crc kubenswrapper[5120]: I0316 16:21:25.710281 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/c64d0fce-5ae8-4f4a-9b5e-987fba23be30-etc-machine-id\") pod \"cinder-api-0\" (UID: \"c64d0fce-5ae8-4f4a-9b5e-987fba23be30\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:21:25 crc kubenswrapper[5120]: I0316 16:21:25.710337 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c64d0fce-5ae8-4f4a-9b5e-987fba23be30-logs\") pod \"cinder-api-0\" (UID: \"c64d0fce-5ae8-4f4a-9b5e-987fba23be30\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:21:25 crc kubenswrapper[5120]: I0316 16:21:25.710448 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c64d0fce-5ae8-4f4a-9b5e-987fba23be30-scripts\") pod \"cinder-api-0\" (UID: \"c64d0fce-5ae8-4f4a-9b5e-987fba23be30\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:21:25 crc kubenswrapper[5120]: I0316 16:21:25.710504 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jp4zq\" (UniqueName: \"kubernetes.io/projected/c64d0fce-5ae8-4f4a-9b5e-987fba23be30-kube-api-access-jp4zq\") pod \"cinder-api-0\" (UID: \"c64d0fce-5ae8-4f4a-9b5e-987fba23be30\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:21:25 crc kubenswrapper[5120]: I0316 16:21:25.710658 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/c64d0fce-5ae8-4f4a-9b5e-987fba23be30-config-data-custom\") pod \"cinder-api-0\" (UID: \"c64d0fce-5ae8-4f4a-9b5e-987fba23be30\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:21:25 crc kubenswrapper[5120]: I0316 16:21:25.710874 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/c64d0fce-5ae8-4f4a-9b5e-987fba23be30-etc-machine-id\") pod \"cinder-api-0\" (UID: \"c64d0fce-5ae8-4f4a-9b5e-987fba23be30\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:21:25 crc kubenswrapper[5120]: I0316 16:21:25.713246 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c64d0fce-5ae8-4f4a-9b5e-987fba23be30-logs\") pod \"cinder-api-0\" (UID: \"c64d0fce-5ae8-4f4a-9b5e-987fba23be30\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:21:25 crc kubenswrapper[5120]: I0316 16:21:25.721661 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c64d0fce-5ae8-4f4a-9b5e-987fba23be30-scripts\") pod \"cinder-api-0\" (UID: \"c64d0fce-5ae8-4f4a-9b5e-987fba23be30\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:21:25 crc kubenswrapper[5120]: I0316 16:21:25.734107 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c64d0fce-5ae8-4f4a-9b5e-987fba23be30-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"c64d0fce-5ae8-4f4a-9b5e-987fba23be30\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:21:25 crc kubenswrapper[5120]: I0316 16:21:25.734527 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/c64d0fce-5ae8-4f4a-9b5e-987fba23be30-config-data-custom\") pod \"cinder-api-0\" (UID: \"c64d0fce-5ae8-4f4a-9b5e-987fba23be30\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:21:25 crc kubenswrapper[5120]: I0316 16:21:25.738069 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c64d0fce-5ae8-4f4a-9b5e-987fba23be30-config-data\") pod \"cinder-api-0\" (UID: \"c64d0fce-5ae8-4f4a-9b5e-987fba23be30\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:21:25 crc kubenswrapper[5120]: I0316 16:21:25.746458 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jp4zq\" (UniqueName: \"kubernetes.io/projected/c64d0fce-5ae8-4f4a-9b5e-987fba23be30-kube-api-access-jp4zq\") pod \"cinder-api-0\" (UID: \"c64d0fce-5ae8-4f4a-9b5e-987fba23be30\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:21:25 crc kubenswrapper[5120]: I0316 16:21:25.780179 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:21:25 crc kubenswrapper[5120]: I0316 16:21:25.792619 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:21:26 crc kubenswrapper[5120]: I0316 16:21:26.252797 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"bd6718c5-d778-4991-bc8e-de0989c82299","Type":"ContainerStarted","Data":"125aa5ff5a1ef8c056ecbe837f3c6667f0418af79a250ecfbced930b968e2f1a"} Mar 16 16:21:26 crc kubenswrapper[5120]: I0316 16:21:26.255203 5120 generic.go:358] "Generic (PLEG): container finished" podID="bbcf321a-a331-4e3a-96f2-90af1aa2d619" containerID="419f3cb8227efffe4cc292792953134a291a4774e5e6894af2479686f7fa97c8" exitCode=0 Mar 16 16:21:26 crc kubenswrapper[5120]: I0316 16:21:26.255276 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-pchr5" event={"ID":"bbcf321a-a331-4e3a-96f2-90af1aa2d619","Type":"ContainerDied","Data":"419f3cb8227efffe4cc292792953134a291a4774e5e6894af2479686f7fa97c8"} Mar 16 16:21:26 crc kubenswrapper[5120]: I0316 16:21:26.334740 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:21:26 crc kubenswrapper[5120]: I0316 16:21:26.468989 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:21:26 crc kubenswrapper[5120]: W0316 16:21:26.496086 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc64d0fce_5ae8_4f4a_9b5e_987fba23be30.slice/crio-a20b0b37b8cf34894ac44e32809a5b9f66eddaea38637dc0f4520b6229590738 WatchSource:0}: Error finding container a20b0b37b8cf34894ac44e32809a5b9f66eddaea38637dc0f4520b6229590738: Status 404 returned error can't find the container with id a20b0b37b8cf34894ac44e32809a5b9f66eddaea38637dc0f4520b6229590738 Mar 16 16:21:27 crc kubenswrapper[5120]: I0316 16:21:27.293427 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"88c05a13-c1ef-4aee-9a86-d91a80dc4af5","Type":"ContainerStarted","Data":"414e348b57743afdaf5beba40c4475103cb2bdc3704e717970a712c80b675463"} Mar 16 16:21:27 crc kubenswrapper[5120]: I0316 16:21:27.297650 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"88c05a13-c1ef-4aee-9a86-d91a80dc4af5","Type":"ContainerStarted","Data":"f13d061f08b214d3272987f47aef21ce311f5528cf5e46155abd9e08b5675c88"} Mar 16 16:21:27 crc kubenswrapper[5120]: I0316 16:21:27.315328 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"c64d0fce-5ae8-4f4a-9b5e-987fba23be30","Type":"ContainerStarted","Data":"a20b0b37b8cf34894ac44e32809a5b9f66eddaea38637dc0f4520b6229590738"} Mar 16 16:21:27 crc kubenswrapper[5120]: I0316 16:21:27.556045 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:21:27 crc kubenswrapper[5120]: I0316 16:21:27.556344 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:21:27 crc kubenswrapper[5120]: I0316 16:21:27.644124 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:21:27 crc kubenswrapper[5120]: I0316 16:21:27.704718 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:21:27 crc kubenswrapper[5120]: I0316 16:21:27.922480 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-pchr5" Mar 16 16:21:27 crc kubenswrapper[5120]: I0316 16:21:27.960170 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:21:27 crc kubenswrapper[5120]: I0316 16:21:27.994697 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bbcf321a-a331-4e3a-96f2-90af1aa2d619-config-data\") pod \"bbcf321a-a331-4e3a-96f2-90af1aa2d619\" (UID: \"bbcf321a-a331-4e3a-96f2-90af1aa2d619\") " Mar 16 16:21:27 crc kubenswrapper[5120]: I0316 16:21:27.994740 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bbcf321a-a331-4e3a-96f2-90af1aa2d619-combined-ca-bundle\") pod \"bbcf321a-a331-4e3a-96f2-90af1aa2d619\" (UID: \"bbcf321a-a331-4e3a-96f2-90af1aa2d619\") " Mar 16 16:21:27 crc kubenswrapper[5120]: I0316 16:21:27.994795 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/bbcf321a-a331-4e3a-96f2-90af1aa2d619-scripts\") pod \"bbcf321a-a331-4e3a-96f2-90af1aa2d619\" (UID: \"bbcf321a-a331-4e3a-96f2-90af1aa2d619\") " Mar 16 16:21:27 crc kubenswrapper[5120]: I0316 16:21:27.994865 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rfb9x\" (UniqueName: \"kubernetes.io/projected/bbcf321a-a331-4e3a-96f2-90af1aa2d619-kube-api-access-rfb9x\") pod \"bbcf321a-a331-4e3a-96f2-90af1aa2d619\" (UID: \"bbcf321a-a331-4e3a-96f2-90af1aa2d619\") " Mar 16 16:21:27 crc kubenswrapper[5120]: I0316 16:21:27.995682 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/bbcf321a-a331-4e3a-96f2-90af1aa2d619-credential-keys\") pod \"bbcf321a-a331-4e3a-96f2-90af1aa2d619\" (UID: \"bbcf321a-a331-4e3a-96f2-90af1aa2d619\") " Mar 16 16:21:27 crc kubenswrapper[5120]: I0316 16:21:27.995936 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/bbcf321a-a331-4e3a-96f2-90af1aa2d619-fernet-keys\") pod \"bbcf321a-a331-4e3a-96f2-90af1aa2d619\" (UID: \"bbcf321a-a331-4e3a-96f2-90af1aa2d619\") " Mar 16 16:21:28 crc kubenswrapper[5120]: I0316 16:21:28.002695 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bbcf321a-a331-4e3a-96f2-90af1aa2d619-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "bbcf321a-a331-4e3a-96f2-90af1aa2d619" (UID: "bbcf321a-a331-4e3a-96f2-90af1aa2d619"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:21:28 crc kubenswrapper[5120]: I0316 16:21:28.006503 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bbcf321a-a331-4e3a-96f2-90af1aa2d619-kube-api-access-rfb9x" (OuterVolumeSpecName: "kube-api-access-rfb9x") pod "bbcf321a-a331-4e3a-96f2-90af1aa2d619" (UID: "bbcf321a-a331-4e3a-96f2-90af1aa2d619"). InnerVolumeSpecName "kube-api-access-rfb9x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:21:28 crc kubenswrapper[5120]: I0316 16:21:28.006740 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rfb9x\" (UniqueName: \"kubernetes.io/projected/bbcf321a-a331-4e3a-96f2-90af1aa2d619-kube-api-access-rfb9x\") on node \"crc\" DevicePath \"\"" Mar 16 16:21:28 crc kubenswrapper[5120]: I0316 16:21:28.006767 5120 reconciler_common.go:299] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/bbcf321a-a331-4e3a-96f2-90af1aa2d619-credential-keys\") on node \"crc\" DevicePath \"\"" Mar 16 16:21:28 crc kubenswrapper[5120]: I0316 16:21:28.008128 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bbcf321a-a331-4e3a-96f2-90af1aa2d619-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "bbcf321a-a331-4e3a-96f2-90af1aa2d619" (UID: "bbcf321a-a331-4e3a-96f2-90af1aa2d619"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:21:28 crc kubenswrapper[5120]: I0316 16:21:28.032915 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bbcf321a-a331-4e3a-96f2-90af1aa2d619-scripts" (OuterVolumeSpecName: "scripts") pod "bbcf321a-a331-4e3a-96f2-90af1aa2d619" (UID: "bbcf321a-a331-4e3a-96f2-90af1aa2d619"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:21:28 crc kubenswrapper[5120]: I0316 16:21:28.042001 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bbcf321a-a331-4e3a-96f2-90af1aa2d619-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "bbcf321a-a331-4e3a-96f2-90af1aa2d619" (UID: "bbcf321a-a331-4e3a-96f2-90af1aa2d619"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:21:28 crc kubenswrapper[5120]: I0316 16:21:28.057360 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bbcf321a-a331-4e3a-96f2-90af1aa2d619-config-data" (OuterVolumeSpecName: "config-data") pod "bbcf321a-a331-4e3a-96f2-90af1aa2d619" (UID: "bbcf321a-a331-4e3a-96f2-90af1aa2d619"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:21:28 crc kubenswrapper[5120]: I0316 16:21:28.108444 5120 reconciler_common.go:299] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/bbcf321a-a331-4e3a-96f2-90af1aa2d619-fernet-keys\") on node \"crc\" DevicePath \"\"" Mar 16 16:21:28 crc kubenswrapper[5120]: I0316 16:21:28.108475 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bbcf321a-a331-4e3a-96f2-90af1aa2d619-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:21:28 crc kubenswrapper[5120]: I0316 16:21:28.108483 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bbcf321a-a331-4e3a-96f2-90af1aa2d619-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:21:28 crc kubenswrapper[5120]: I0316 16:21:28.108494 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/bbcf321a-a331-4e3a-96f2-90af1aa2d619-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:21:28 crc kubenswrapper[5120]: I0316 16:21:28.359328 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-pchr5" event={"ID":"bbcf321a-a331-4e3a-96f2-90af1aa2d619","Type":"ContainerDied","Data":"d30cd0c032b1378bbc1f9c98c1a3a902f05cbe4f0ec431bc7a8b15ba016a7797"} Mar 16 16:21:28 crc kubenswrapper[5120]: I0316 16:21:28.359382 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d30cd0c032b1378bbc1f9c98c1a3a902f05cbe4f0ec431bc7a8b15ba016a7797" Mar 16 16:21:28 crc kubenswrapper[5120]: I0316 16:21:28.359443 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-pchr5" Mar 16 16:21:28 crc kubenswrapper[5120]: I0316 16:21:28.383335 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"c64d0fce-5ae8-4f4a-9b5e-987fba23be30","Type":"ContainerStarted","Data":"7dbb4c76fd47c6ef778b602b465cb11ea5f6da01510471c691a4a9f58e578102"} Mar 16 16:21:28 crc kubenswrapper[5120]: I0316 16:21:28.391120 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:21:28 crc kubenswrapper[5120]: I0316 16:21:28.391499 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:21:28 crc kubenswrapper[5120]: I0316 16:21:28.391636 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:21:28 crc kubenswrapper[5120]: I0316 16:21:28.415046 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-7bc85bbbf-4ttl9"] Mar 16 16:21:28 crc kubenswrapper[5120]: I0316 16:21:28.416119 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bbcf321a-a331-4e3a-96f2-90af1aa2d619" containerName="keystone-bootstrap" Mar 16 16:21:28 crc kubenswrapper[5120]: I0316 16:21:28.416135 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="bbcf321a-a331-4e3a-96f2-90af1aa2d619" containerName="keystone-bootstrap" Mar 16 16:21:28 crc kubenswrapper[5120]: I0316 16:21:28.416355 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="bbcf321a-a331-4e3a-96f2-90af1aa2d619" containerName="keystone-bootstrap" Mar 16 16:21:28 crc kubenswrapper[5120]: I0316 16:21:28.432013 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-7bc85bbbf-4ttl9" Mar 16 16:21:28 crc kubenswrapper[5120]: I0316 16:21:28.441460 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-7bc85bbbf-4ttl9"] Mar 16 16:21:28 crc kubenswrapper[5120]: I0316 16:21:28.444077 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-keystone-public-svc\"" Mar 16 16:21:28 crc kubenswrapper[5120]: I0316 16:21:28.444090 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-scripts\"" Mar 16 16:21:28 crc kubenswrapper[5120]: I0316 16:21:28.444324 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone\"" Mar 16 16:21:28 crc kubenswrapper[5120]: I0316 16:21:28.444410 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-keystone-dockercfg-xwsqf\"" Mar 16 16:21:28 crc kubenswrapper[5120]: I0316 16:21:28.446125 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-keystone-internal-svc\"" Mar 16 16:21:28 crc kubenswrapper[5120]: I0316 16:21:28.446209 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-config-data\"" Mar 16 16:21:28 crc kubenswrapper[5120]: I0316 16:21:28.465723 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=3.041855418 podStartE2EDuration="8.46570462s" podCreationTimestamp="2026-03-16 16:21:20 +0000 UTC" firstStartedPulling="2026-03-16 16:21:22.558505169 +0000 UTC m=+2984.712436826" lastFinishedPulling="2026-03-16 16:21:27.982354331 +0000 UTC m=+2990.136286028" observedRunningTime="2026-03-16 16:21:28.422094702 +0000 UTC m=+2990.576026369" watchObservedRunningTime="2026-03-16 16:21:28.46570462 +0000 UTC m=+2990.619636277" Mar 16 16:21:28 crc kubenswrapper[5120]: I0316 16:21:28.494544 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/watcher-api-0" Mar 16 16:21:28 crc kubenswrapper[5120]: I0316 16:21:28.499277 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:21:28 crc kubenswrapper[5120]: I0316 16:21:28.500191 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:21:28 crc kubenswrapper[5120]: I0316 16:21:28.513095 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/watcher-api-0" Mar 16 16:21:28 crc kubenswrapper[5120]: I0316 16:21:28.513504 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/watcher-applier-0" Mar 16 16:21:28 crc kubenswrapper[5120]: I0316 16:21:28.513548 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/watcher-applier-0" Mar 16 16:21:28 crc kubenswrapper[5120]: I0316 16:21:28.535164 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/7b05ec0c-8f80-4a86-8823-629c4e953395-credential-keys\") pod \"keystone-7bc85bbbf-4ttl9\" (UID: \"7b05ec0c-8f80-4a86-8823-629c4e953395\") " pod="openstack-kuttl-tests/keystone-7bc85bbbf-4ttl9" Mar 16 16:21:28 crc kubenswrapper[5120]: I0316 16:21:28.535270 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/7b05ec0c-8f80-4a86-8823-629c4e953395-public-tls-certs\") pod \"keystone-7bc85bbbf-4ttl9\" (UID: \"7b05ec0c-8f80-4a86-8823-629c4e953395\") " pod="openstack-kuttl-tests/keystone-7bc85bbbf-4ttl9" Mar 16 16:21:28 crc kubenswrapper[5120]: I0316 16:21:28.535323 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7b05ec0c-8f80-4a86-8823-629c4e953395-combined-ca-bundle\") pod \"keystone-7bc85bbbf-4ttl9\" (UID: \"7b05ec0c-8f80-4a86-8823-629c4e953395\") " pod="openstack-kuttl-tests/keystone-7bc85bbbf-4ttl9" Mar 16 16:21:28 crc kubenswrapper[5120]: I0316 16:21:28.535372 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/7b05ec0c-8f80-4a86-8823-629c4e953395-internal-tls-certs\") pod \"keystone-7bc85bbbf-4ttl9\" (UID: \"7b05ec0c-8f80-4a86-8823-629c4e953395\") " pod="openstack-kuttl-tests/keystone-7bc85bbbf-4ttl9" Mar 16 16:21:28 crc kubenswrapper[5120]: I0316 16:21:28.535421 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zps2p\" (UniqueName: \"kubernetes.io/projected/7b05ec0c-8f80-4a86-8823-629c4e953395-kube-api-access-zps2p\") pod \"keystone-7bc85bbbf-4ttl9\" (UID: \"7b05ec0c-8f80-4a86-8823-629c4e953395\") " pod="openstack-kuttl-tests/keystone-7bc85bbbf-4ttl9" Mar 16 16:21:28 crc kubenswrapper[5120]: I0316 16:21:28.535477 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7b05ec0c-8f80-4a86-8823-629c4e953395-scripts\") pod \"keystone-7bc85bbbf-4ttl9\" (UID: \"7b05ec0c-8f80-4a86-8823-629c4e953395\") " pod="openstack-kuttl-tests/keystone-7bc85bbbf-4ttl9" Mar 16 16:21:28 crc kubenswrapper[5120]: I0316 16:21:28.535512 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7b05ec0c-8f80-4a86-8823-629c4e953395-config-data\") pod \"keystone-7bc85bbbf-4ttl9\" (UID: \"7b05ec0c-8f80-4a86-8823-629c4e953395\") " pod="openstack-kuttl-tests/keystone-7bc85bbbf-4ttl9" Mar 16 16:21:28 crc kubenswrapper[5120]: I0316 16:21:28.535631 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/7b05ec0c-8f80-4a86-8823-629c4e953395-fernet-keys\") pod \"keystone-7bc85bbbf-4ttl9\" (UID: \"7b05ec0c-8f80-4a86-8823-629c4e953395\") " pod="openstack-kuttl-tests/keystone-7bc85bbbf-4ttl9" Mar 16 16:21:28 crc kubenswrapper[5120]: I0316 16:21:28.554131 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:21:28 crc kubenswrapper[5120]: I0316 16:21:28.557648 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:21:28 crc kubenswrapper[5120]: I0316 16:21:28.565266 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/watcher-applier-0" Mar 16 16:21:28 crc kubenswrapper[5120]: I0316 16:21:28.637054 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/7b05ec0c-8f80-4a86-8823-629c4e953395-fernet-keys\") pod \"keystone-7bc85bbbf-4ttl9\" (UID: \"7b05ec0c-8f80-4a86-8823-629c4e953395\") " pod="openstack-kuttl-tests/keystone-7bc85bbbf-4ttl9" Mar 16 16:21:28 crc kubenswrapper[5120]: I0316 16:21:28.637166 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/7b05ec0c-8f80-4a86-8823-629c4e953395-credential-keys\") pod \"keystone-7bc85bbbf-4ttl9\" (UID: \"7b05ec0c-8f80-4a86-8823-629c4e953395\") " pod="openstack-kuttl-tests/keystone-7bc85bbbf-4ttl9" Mar 16 16:21:28 crc kubenswrapper[5120]: I0316 16:21:28.637243 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/7b05ec0c-8f80-4a86-8823-629c4e953395-public-tls-certs\") pod \"keystone-7bc85bbbf-4ttl9\" (UID: \"7b05ec0c-8f80-4a86-8823-629c4e953395\") " pod="openstack-kuttl-tests/keystone-7bc85bbbf-4ttl9" Mar 16 16:21:28 crc kubenswrapper[5120]: I0316 16:21:28.637308 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7b05ec0c-8f80-4a86-8823-629c4e953395-combined-ca-bundle\") pod \"keystone-7bc85bbbf-4ttl9\" (UID: \"7b05ec0c-8f80-4a86-8823-629c4e953395\") " pod="openstack-kuttl-tests/keystone-7bc85bbbf-4ttl9" Mar 16 16:21:28 crc kubenswrapper[5120]: I0316 16:21:28.637355 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/7b05ec0c-8f80-4a86-8823-629c4e953395-internal-tls-certs\") pod \"keystone-7bc85bbbf-4ttl9\" (UID: \"7b05ec0c-8f80-4a86-8823-629c4e953395\") " pod="openstack-kuttl-tests/keystone-7bc85bbbf-4ttl9" Mar 16 16:21:28 crc kubenswrapper[5120]: I0316 16:21:28.637416 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zps2p\" (UniqueName: \"kubernetes.io/projected/7b05ec0c-8f80-4a86-8823-629c4e953395-kube-api-access-zps2p\") pod \"keystone-7bc85bbbf-4ttl9\" (UID: \"7b05ec0c-8f80-4a86-8823-629c4e953395\") " pod="openstack-kuttl-tests/keystone-7bc85bbbf-4ttl9" Mar 16 16:21:28 crc kubenswrapper[5120]: I0316 16:21:28.637481 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7b05ec0c-8f80-4a86-8823-629c4e953395-scripts\") pod \"keystone-7bc85bbbf-4ttl9\" (UID: \"7b05ec0c-8f80-4a86-8823-629c4e953395\") " pod="openstack-kuttl-tests/keystone-7bc85bbbf-4ttl9" Mar 16 16:21:28 crc kubenswrapper[5120]: I0316 16:21:28.637513 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7b05ec0c-8f80-4a86-8823-629c4e953395-config-data\") pod \"keystone-7bc85bbbf-4ttl9\" (UID: \"7b05ec0c-8f80-4a86-8823-629c4e953395\") " pod="openstack-kuttl-tests/keystone-7bc85bbbf-4ttl9" Mar 16 16:21:28 crc kubenswrapper[5120]: I0316 16:21:28.648051 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7b05ec0c-8f80-4a86-8823-629c4e953395-combined-ca-bundle\") pod \"keystone-7bc85bbbf-4ttl9\" (UID: \"7b05ec0c-8f80-4a86-8823-629c4e953395\") " pod="openstack-kuttl-tests/keystone-7bc85bbbf-4ttl9" Mar 16 16:21:28 crc kubenswrapper[5120]: I0316 16:21:28.648315 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7b05ec0c-8f80-4a86-8823-629c4e953395-config-data\") pod \"keystone-7bc85bbbf-4ttl9\" (UID: \"7b05ec0c-8f80-4a86-8823-629c4e953395\") " pod="openstack-kuttl-tests/keystone-7bc85bbbf-4ttl9" Mar 16 16:21:28 crc kubenswrapper[5120]: I0316 16:21:28.650270 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/7b05ec0c-8f80-4a86-8823-629c4e953395-credential-keys\") pod \"keystone-7bc85bbbf-4ttl9\" (UID: \"7b05ec0c-8f80-4a86-8823-629c4e953395\") " pod="openstack-kuttl-tests/keystone-7bc85bbbf-4ttl9" Mar 16 16:21:28 crc kubenswrapper[5120]: I0316 16:21:28.650716 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/7b05ec0c-8f80-4a86-8823-629c4e953395-internal-tls-certs\") pod \"keystone-7bc85bbbf-4ttl9\" (UID: \"7b05ec0c-8f80-4a86-8823-629c4e953395\") " pod="openstack-kuttl-tests/keystone-7bc85bbbf-4ttl9" Mar 16 16:21:28 crc kubenswrapper[5120]: I0316 16:21:28.651146 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/7b05ec0c-8f80-4a86-8823-629c4e953395-public-tls-certs\") pod \"keystone-7bc85bbbf-4ttl9\" (UID: \"7b05ec0c-8f80-4a86-8823-629c4e953395\") " pod="openstack-kuttl-tests/keystone-7bc85bbbf-4ttl9" Mar 16 16:21:28 crc kubenswrapper[5120]: I0316 16:21:28.654950 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/7b05ec0c-8f80-4a86-8823-629c4e953395-fernet-keys\") pod \"keystone-7bc85bbbf-4ttl9\" (UID: \"7b05ec0c-8f80-4a86-8823-629c4e953395\") " pod="openstack-kuttl-tests/keystone-7bc85bbbf-4ttl9" Mar 16 16:21:28 crc kubenswrapper[5120]: I0316 16:21:28.656508 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7b05ec0c-8f80-4a86-8823-629c4e953395-scripts\") pod \"keystone-7bc85bbbf-4ttl9\" (UID: \"7b05ec0c-8f80-4a86-8823-629c4e953395\") " pod="openstack-kuttl-tests/keystone-7bc85bbbf-4ttl9" Mar 16 16:21:28 crc kubenswrapper[5120]: I0316 16:21:28.659053 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/watcher-decision-engine-0" Mar 16 16:21:28 crc kubenswrapper[5120]: I0316 16:21:28.669638 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zps2p\" (UniqueName: \"kubernetes.io/projected/7b05ec0c-8f80-4a86-8823-629c4e953395-kube-api-access-zps2p\") pod \"keystone-7bc85bbbf-4ttl9\" (UID: \"7b05ec0c-8f80-4a86-8823-629c4e953395\") " pod="openstack-kuttl-tests/keystone-7bc85bbbf-4ttl9" Mar 16 16:21:28 crc kubenswrapper[5120]: I0316 16:21:28.696326 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/watcher-decision-engine-0" Mar 16 16:21:28 crc kubenswrapper[5120]: I0316 16:21:28.776168 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-7bc85bbbf-4ttl9" Mar 16 16:21:29 crc kubenswrapper[5120]: I0316 16:21:29.246475 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-7bc85bbbf-4ttl9"] Mar 16 16:21:29 crc kubenswrapper[5120]: I0316 16:21:29.399009 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-7bc85bbbf-4ttl9" event={"ID":"7b05ec0c-8f80-4a86-8823-629c4e953395","Type":"ContainerStarted","Data":"070613f82c1eaf53a952f80ff11171e778cd4de17626bfdf96740ef00f776e39"} Mar 16 16:21:29 crc kubenswrapper[5120]: I0316 16:21:29.400703 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"c64d0fce-5ae8-4f4a-9b5e-987fba23be30","Type":"ContainerStarted","Data":"3417c193984ba713d34def8ce1de683131800f1681b1d919c6fc463fb90a4ce1"} Mar 16 16:21:29 crc kubenswrapper[5120]: I0316 16:21:29.400863 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="c64d0fce-5ae8-4f4a-9b5e-987fba23be30" containerName="cinder-api-log" containerID="cri-o://7dbb4c76fd47c6ef778b602b465cb11ea5f6da01510471c691a4a9f58e578102" gracePeriod=30 Mar 16 16:21:29 crc kubenswrapper[5120]: I0316 16:21:29.401158 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:21:29 crc kubenswrapper[5120]: I0316 16:21:29.401379 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="c64d0fce-5ae8-4f4a-9b5e-987fba23be30" containerName="cinder-api" containerID="cri-o://3417c193984ba713d34def8ce1de683131800f1681b1d919c6fc463fb90a4ce1" gracePeriod=30 Mar 16 16:21:29 crc kubenswrapper[5120]: I0316 16:21:29.411430 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"bd6718c5-d778-4991-bc8e-de0989c82299","Type":"ContainerStarted","Data":"cb45f951b2479757a6c305a37f699644d4da21da50dda194ea5f942be0ed610d"} Mar 16 16:21:29 crc kubenswrapper[5120]: I0316 16:21:29.418572 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"88c05a13-c1ef-4aee-9a86-d91a80dc4af5","Type":"ContainerStarted","Data":"d75f51f85be5c791208584f47eac49d55ec6339fcfb949515777db7507334633"} Mar 16 16:21:29 crc kubenswrapper[5120]: I0316 16:21:29.418624 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/watcher-decision-engine-0" Mar 16 16:21:29 crc kubenswrapper[5120]: I0316 16:21:29.420369 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-api-0" podStartSLOduration=4.420360183 podStartE2EDuration="4.420360183s" podCreationTimestamp="2026-03-16 16:21:25 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:21:29.417187149 +0000 UTC m=+2991.571118806" watchObservedRunningTime="2026-03-16 16:21:29.420360183 +0000 UTC m=+2991.574291840" Mar 16 16:21:29 crc kubenswrapper[5120]: I0316 16:21:29.420748 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:21:29 crc kubenswrapper[5120]: I0316 16:21:29.420817 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:21:29 crc kubenswrapper[5120]: I0316 16:21:29.456061 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-scheduler-0" podStartSLOduration=4.456010587 podStartE2EDuration="4.456010587s" podCreationTimestamp="2026-03-16 16:21:25 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:21:29.44601071 +0000 UTC m=+2991.599942367" watchObservedRunningTime="2026-03-16 16:21:29.456010587 +0000 UTC m=+2991.609942264" Mar 16 16:21:29 crc kubenswrapper[5120]: I0316 16:21:29.458006 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/watcher-applier-0" Mar 16 16:21:29 crc kubenswrapper[5120]: I0316 16:21:29.464036 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/watcher-decision-engine-0" Mar 16 16:21:29 crc kubenswrapper[5120]: I0316 16:21:29.464095 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/watcher-api-0" Mar 16 16:21:29 crc kubenswrapper[5120]: I0316 16:21:29.781539 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:21:30 crc kubenswrapper[5120]: I0316 16:21:30.425873 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-7bc85bbbf-4ttl9" event={"ID":"7b05ec0c-8f80-4a86-8823-629c4e953395","Type":"ContainerStarted","Data":"48370642f51fb950140c497068c7d992955ae7d6047b48a68307501d1a50da67"} Mar 16 16:21:30 crc kubenswrapper[5120]: I0316 16:21:30.426243 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/keystone-7bc85bbbf-4ttl9" Mar 16 16:21:30 crc kubenswrapper[5120]: I0316 16:21:30.428031 5120 generic.go:358] "Generic (PLEG): container finished" podID="c64d0fce-5ae8-4f4a-9b5e-987fba23be30" containerID="3417c193984ba713d34def8ce1de683131800f1681b1d919c6fc463fb90a4ce1" exitCode=0 Mar 16 16:21:30 crc kubenswrapper[5120]: I0316 16:21:30.428061 5120 generic.go:358] "Generic (PLEG): container finished" podID="c64d0fce-5ae8-4f4a-9b5e-987fba23be30" containerID="7dbb4c76fd47c6ef778b602b465cb11ea5f6da01510471c691a4a9f58e578102" exitCode=143 Mar 16 16:21:30 crc kubenswrapper[5120]: I0316 16:21:30.429106 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"c64d0fce-5ae8-4f4a-9b5e-987fba23be30","Type":"ContainerDied","Data":"3417c193984ba713d34def8ce1de683131800f1681b1d919c6fc463fb90a4ce1"} Mar 16 16:21:30 crc kubenswrapper[5120]: I0316 16:21:30.429143 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"c64d0fce-5ae8-4f4a-9b5e-987fba23be30","Type":"ContainerDied","Data":"7dbb4c76fd47c6ef778b602b465cb11ea5f6da01510471c691a4a9f58e578102"} Mar 16 16:21:30 crc kubenswrapper[5120]: I0316 16:21:30.429155 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"c64d0fce-5ae8-4f4a-9b5e-987fba23be30","Type":"ContainerDied","Data":"a20b0b37b8cf34894ac44e32809a5b9f66eddaea38637dc0f4520b6229590738"} Mar 16 16:21:30 crc kubenswrapper[5120]: I0316 16:21:30.429164 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a20b0b37b8cf34894ac44e32809a5b9f66eddaea38637dc0f4520b6229590738" Mar 16 16:21:30 crc kubenswrapper[5120]: I0316 16:21:30.461238 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-7bc85bbbf-4ttl9" podStartSLOduration=2.461219824 podStartE2EDuration="2.461219824s" podCreationTimestamp="2026-03-16 16:21:28 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:21:30.452215703 +0000 UTC m=+2992.606147350" watchObservedRunningTime="2026-03-16 16:21:30.461219824 +0000 UTC m=+2992.615151481" Mar 16 16:21:30 crc kubenswrapper[5120]: I0316 16:21:30.469125 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:21:30 crc kubenswrapper[5120]: I0316 16:21:30.594479 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/c64d0fce-5ae8-4f4a-9b5e-987fba23be30-etc-machine-id\") pod \"c64d0fce-5ae8-4f4a-9b5e-987fba23be30\" (UID: \"c64d0fce-5ae8-4f4a-9b5e-987fba23be30\") " Mar 16 16:21:30 crc kubenswrapper[5120]: I0316 16:21:30.594595 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c64d0fce-5ae8-4f4a-9b5e-987fba23be30-scripts\") pod \"c64d0fce-5ae8-4f4a-9b5e-987fba23be30\" (UID: \"c64d0fce-5ae8-4f4a-9b5e-987fba23be30\") " Mar 16 16:21:30 crc kubenswrapper[5120]: I0316 16:21:30.594693 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/c64d0fce-5ae8-4f4a-9b5e-987fba23be30-config-data-custom\") pod \"c64d0fce-5ae8-4f4a-9b5e-987fba23be30\" (UID: \"c64d0fce-5ae8-4f4a-9b5e-987fba23be30\") " Mar 16 16:21:30 crc kubenswrapper[5120]: I0316 16:21:30.595000 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c64d0fce-5ae8-4f4a-9b5e-987fba23be30-combined-ca-bundle\") pod \"c64d0fce-5ae8-4f4a-9b5e-987fba23be30\" (UID: \"c64d0fce-5ae8-4f4a-9b5e-987fba23be30\") " Mar 16 16:21:30 crc kubenswrapper[5120]: I0316 16:21:30.595126 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c64d0fce-5ae8-4f4a-9b5e-987fba23be30-config-data\") pod \"c64d0fce-5ae8-4f4a-9b5e-987fba23be30\" (UID: \"c64d0fce-5ae8-4f4a-9b5e-987fba23be30\") " Mar 16 16:21:30 crc kubenswrapper[5120]: I0316 16:21:30.595208 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jp4zq\" (UniqueName: \"kubernetes.io/projected/c64d0fce-5ae8-4f4a-9b5e-987fba23be30-kube-api-access-jp4zq\") pod \"c64d0fce-5ae8-4f4a-9b5e-987fba23be30\" (UID: \"c64d0fce-5ae8-4f4a-9b5e-987fba23be30\") " Mar 16 16:21:30 crc kubenswrapper[5120]: I0316 16:21:30.595302 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c64d0fce-5ae8-4f4a-9b5e-987fba23be30-logs\") pod \"c64d0fce-5ae8-4f4a-9b5e-987fba23be30\" (UID: \"c64d0fce-5ae8-4f4a-9b5e-987fba23be30\") " Mar 16 16:21:30 crc kubenswrapper[5120]: I0316 16:21:30.596443 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/c64d0fce-5ae8-4f4a-9b5e-987fba23be30-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "c64d0fce-5ae8-4f4a-9b5e-987fba23be30" (UID: "c64d0fce-5ae8-4f4a-9b5e-987fba23be30"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 16:21:30 crc kubenswrapper[5120]: I0316 16:21:30.601916 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c64d0fce-5ae8-4f4a-9b5e-987fba23be30-logs" (OuterVolumeSpecName: "logs") pod "c64d0fce-5ae8-4f4a-9b5e-987fba23be30" (UID: "c64d0fce-5ae8-4f4a-9b5e-987fba23be30"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:21:30 crc kubenswrapper[5120]: I0316 16:21:30.616607 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c64d0fce-5ae8-4f4a-9b5e-987fba23be30-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:21:30 crc kubenswrapper[5120]: I0316 16:21:30.616806 5120 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/c64d0fce-5ae8-4f4a-9b5e-987fba23be30-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 16:21:30 crc kubenswrapper[5120]: I0316 16:21:30.626309 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c64d0fce-5ae8-4f4a-9b5e-987fba23be30-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "c64d0fce-5ae8-4f4a-9b5e-987fba23be30" (UID: "c64d0fce-5ae8-4f4a-9b5e-987fba23be30"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:21:30 crc kubenswrapper[5120]: I0316 16:21:30.628220 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c64d0fce-5ae8-4f4a-9b5e-987fba23be30-scripts" (OuterVolumeSpecName: "scripts") pod "c64d0fce-5ae8-4f4a-9b5e-987fba23be30" (UID: "c64d0fce-5ae8-4f4a-9b5e-987fba23be30"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:21:30 crc kubenswrapper[5120]: I0316 16:21:30.692844 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c64d0fce-5ae8-4f4a-9b5e-987fba23be30-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "c64d0fce-5ae8-4f4a-9b5e-987fba23be30" (UID: "c64d0fce-5ae8-4f4a-9b5e-987fba23be30"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:21:30 crc kubenswrapper[5120]: I0316 16:21:30.718526 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c64d0fce-5ae8-4f4a-9b5e-987fba23be30-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:21:30 crc kubenswrapper[5120]: I0316 16:21:30.718563 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/c64d0fce-5ae8-4f4a-9b5e-987fba23be30-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:21:30 crc kubenswrapper[5120]: I0316 16:21:30.718572 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c64d0fce-5ae8-4f4a-9b5e-987fba23be30-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:21:30 crc kubenswrapper[5120]: I0316 16:21:30.729006 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c64d0fce-5ae8-4f4a-9b5e-987fba23be30-kube-api-access-jp4zq" (OuterVolumeSpecName: "kube-api-access-jp4zq") pod "c64d0fce-5ae8-4f4a-9b5e-987fba23be30" (UID: "c64d0fce-5ae8-4f4a-9b5e-987fba23be30"). InnerVolumeSpecName "kube-api-access-jp4zq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:21:30 crc kubenswrapper[5120]: I0316 16:21:30.731718 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c64d0fce-5ae8-4f4a-9b5e-987fba23be30-config-data" (OuterVolumeSpecName: "config-data") pod "c64d0fce-5ae8-4f4a-9b5e-987fba23be30" (UID: "c64d0fce-5ae8-4f4a-9b5e-987fba23be30"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:21:30 crc kubenswrapper[5120]: I0316 16:21:30.780892 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:21:30 crc kubenswrapper[5120]: I0316 16:21:30.823385 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c64d0fce-5ae8-4f4a-9b5e-987fba23be30-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:21:30 crc kubenswrapper[5120]: I0316 16:21:30.823426 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jp4zq\" (UniqueName: \"kubernetes.io/projected/c64d0fce-5ae8-4f4a-9b5e-987fba23be30-kube-api-access-jp4zq\") on node \"crc\" DevicePath \"\"" Mar 16 16:21:31 crc kubenswrapper[5120]: I0316 16:21:31.021273 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:21:31 crc kubenswrapper[5120]: I0316 16:21:31.022323 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:21:31 crc kubenswrapper[5120]: I0316 16:21:31.437668 5120 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Mar 16 16:21:31 crc kubenswrapper[5120]: I0316 16:21:31.437698 5120 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Mar 16 16:21:31 crc kubenswrapper[5120]: I0316 16:21:31.437733 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:21:31 crc kubenswrapper[5120]: I0316 16:21:31.439515 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="bd6718c5-d778-4991-bc8e-de0989c82299" containerName="ceilometer-central-agent" containerID="cri-o://9e17fdd369ba7374abf0d212cd6d7f5d289a260a0de7cfccd3c61cc1b45d2cf4" gracePeriod=30 Mar 16 16:21:31 crc kubenswrapper[5120]: I0316 16:21:31.442857 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="bd6718c5-d778-4991-bc8e-de0989c82299" containerName="sg-core" containerID="cri-o://125aa5ff5a1ef8c056ecbe837f3c6667f0418af79a250ecfbced930b968e2f1a" gracePeriod=30 Mar 16 16:21:31 crc kubenswrapper[5120]: I0316 16:21:31.443061 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="bd6718c5-d778-4991-bc8e-de0989c82299" containerName="proxy-httpd" containerID="cri-o://cb45f951b2479757a6c305a37f699644d4da21da50dda194ea5f942be0ed610d" gracePeriod=30 Mar 16 16:21:31 crc kubenswrapper[5120]: I0316 16:21:31.443318 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="bd6718c5-d778-4991-bc8e-de0989c82299" containerName="ceilometer-notification-agent" containerID="cri-o://818b27a472d92374032010866daa0e995cc70e7f9539c02e4b5d4b8db55f15f9" gracePeriod=30 Mar 16 16:21:31 crc kubenswrapper[5120]: I0316 16:21:31.486232 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:21:31 crc kubenswrapper[5120]: I0316 16:21:31.510981 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:21:31 crc kubenswrapper[5120]: I0316 16:21:31.552732 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:21:31 crc kubenswrapper[5120]: I0316 16:21:31.553742 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c64d0fce-5ae8-4f4a-9b5e-987fba23be30" containerName="cinder-api-log" Mar 16 16:21:31 crc kubenswrapper[5120]: I0316 16:21:31.553771 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c64d0fce-5ae8-4f4a-9b5e-987fba23be30" containerName="cinder-api-log" Mar 16 16:21:31 crc kubenswrapper[5120]: I0316 16:21:31.553789 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c64d0fce-5ae8-4f4a-9b5e-987fba23be30" containerName="cinder-api" Mar 16 16:21:31 crc kubenswrapper[5120]: I0316 16:21:31.553796 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c64d0fce-5ae8-4f4a-9b5e-987fba23be30" containerName="cinder-api" Mar 16 16:21:31 crc kubenswrapper[5120]: I0316 16:21:31.555283 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c64d0fce-5ae8-4f4a-9b5e-987fba23be30" containerName="cinder-api-log" Mar 16 16:21:31 crc kubenswrapper[5120]: I0316 16:21:31.555322 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c64d0fce-5ae8-4f4a-9b5e-987fba23be30" containerName="cinder-api" Mar 16 16:21:31 crc kubenswrapper[5120]: I0316 16:21:31.724843 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:21:31 crc kubenswrapper[5120]: I0316 16:21:31.725033 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:21:31 crc kubenswrapper[5120]: I0316 16:21:31.727425 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-api-config-data\"" Mar 16 16:21:31 crc kubenswrapper[5120]: I0316 16:21:31.730819 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-cinder-public-svc\"" Mar 16 16:21:31 crc kubenswrapper[5120]: I0316 16:21:31.731060 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-cinder-internal-svc\"" Mar 16 16:21:31 crc kubenswrapper[5120]: I0316 16:21:31.844778 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9z9cv\" (UniqueName: \"kubernetes.io/projected/7ea8cd10-4026-4603-a76b-b26ebe185441-kube-api-access-9z9cv\") pod \"cinder-api-0\" (UID: \"7ea8cd10-4026-4603-a76b-b26ebe185441\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:21:31 crc kubenswrapper[5120]: I0316 16:21:31.844898 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7ea8cd10-4026-4603-a76b-b26ebe185441-config-data\") pod \"cinder-api-0\" (UID: \"7ea8cd10-4026-4603-a76b-b26ebe185441\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:21:31 crc kubenswrapper[5120]: I0316 16:21:31.844923 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7ea8cd10-4026-4603-a76b-b26ebe185441-logs\") pod \"cinder-api-0\" (UID: \"7ea8cd10-4026-4603-a76b-b26ebe185441\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:21:31 crc kubenswrapper[5120]: I0316 16:21:31.844948 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7ea8cd10-4026-4603-a76b-b26ebe185441-scripts\") pod \"cinder-api-0\" (UID: \"7ea8cd10-4026-4603-a76b-b26ebe185441\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:21:31 crc kubenswrapper[5120]: I0316 16:21:31.845035 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/7ea8cd10-4026-4603-a76b-b26ebe185441-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"7ea8cd10-4026-4603-a76b-b26ebe185441\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:21:31 crc kubenswrapper[5120]: I0316 16:21:31.845054 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/7ea8cd10-4026-4603-a76b-b26ebe185441-etc-machine-id\") pod \"cinder-api-0\" (UID: \"7ea8cd10-4026-4603-a76b-b26ebe185441\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:21:31 crc kubenswrapper[5120]: I0316 16:21:31.845070 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/7ea8cd10-4026-4603-a76b-b26ebe185441-public-tls-certs\") pod \"cinder-api-0\" (UID: \"7ea8cd10-4026-4603-a76b-b26ebe185441\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:21:31 crc kubenswrapper[5120]: I0316 16:21:31.845104 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7ea8cd10-4026-4603-a76b-b26ebe185441-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"7ea8cd10-4026-4603-a76b-b26ebe185441\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:21:31 crc kubenswrapper[5120]: I0316 16:21:31.845135 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/7ea8cd10-4026-4603-a76b-b26ebe185441-config-data-custom\") pod \"cinder-api-0\" (UID: \"7ea8cd10-4026-4603-a76b-b26ebe185441\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:21:31 crc kubenswrapper[5120]: I0316 16:21:31.946624 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/7ea8cd10-4026-4603-a76b-b26ebe185441-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"7ea8cd10-4026-4603-a76b-b26ebe185441\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:21:31 crc kubenswrapper[5120]: I0316 16:21:31.946673 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/7ea8cd10-4026-4603-a76b-b26ebe185441-etc-machine-id\") pod \"cinder-api-0\" (UID: \"7ea8cd10-4026-4603-a76b-b26ebe185441\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:21:31 crc kubenswrapper[5120]: I0316 16:21:31.946689 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/7ea8cd10-4026-4603-a76b-b26ebe185441-public-tls-certs\") pod \"cinder-api-0\" (UID: \"7ea8cd10-4026-4603-a76b-b26ebe185441\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:21:31 crc kubenswrapper[5120]: I0316 16:21:31.946714 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7ea8cd10-4026-4603-a76b-b26ebe185441-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"7ea8cd10-4026-4603-a76b-b26ebe185441\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:21:31 crc kubenswrapper[5120]: I0316 16:21:31.946745 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/7ea8cd10-4026-4603-a76b-b26ebe185441-config-data-custom\") pod \"cinder-api-0\" (UID: \"7ea8cd10-4026-4603-a76b-b26ebe185441\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:21:31 crc kubenswrapper[5120]: I0316 16:21:31.946869 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9z9cv\" (UniqueName: \"kubernetes.io/projected/7ea8cd10-4026-4603-a76b-b26ebe185441-kube-api-access-9z9cv\") pod \"cinder-api-0\" (UID: \"7ea8cd10-4026-4603-a76b-b26ebe185441\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:21:31 crc kubenswrapper[5120]: I0316 16:21:31.946960 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7ea8cd10-4026-4603-a76b-b26ebe185441-config-data\") pod \"cinder-api-0\" (UID: \"7ea8cd10-4026-4603-a76b-b26ebe185441\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:21:31 crc kubenswrapper[5120]: I0316 16:21:31.946982 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7ea8cd10-4026-4603-a76b-b26ebe185441-logs\") pod \"cinder-api-0\" (UID: \"7ea8cd10-4026-4603-a76b-b26ebe185441\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:21:31 crc kubenswrapper[5120]: I0316 16:21:31.947006 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7ea8cd10-4026-4603-a76b-b26ebe185441-scripts\") pod \"cinder-api-0\" (UID: \"7ea8cd10-4026-4603-a76b-b26ebe185441\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:21:31 crc kubenswrapper[5120]: I0316 16:21:31.948092 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/7ea8cd10-4026-4603-a76b-b26ebe185441-etc-machine-id\") pod \"cinder-api-0\" (UID: \"7ea8cd10-4026-4603-a76b-b26ebe185441\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:21:31 crc kubenswrapper[5120]: I0316 16:21:31.954605 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7ea8cd10-4026-4603-a76b-b26ebe185441-logs\") pod \"cinder-api-0\" (UID: \"7ea8cd10-4026-4603-a76b-b26ebe185441\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:21:31 crc kubenswrapper[5120]: I0316 16:21:31.957705 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7ea8cd10-4026-4603-a76b-b26ebe185441-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"7ea8cd10-4026-4603-a76b-b26ebe185441\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:21:31 crc kubenswrapper[5120]: I0316 16:21:31.958226 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/7ea8cd10-4026-4603-a76b-b26ebe185441-config-data-custom\") pod \"cinder-api-0\" (UID: \"7ea8cd10-4026-4603-a76b-b26ebe185441\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:21:31 crc kubenswrapper[5120]: I0316 16:21:31.958604 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7ea8cd10-4026-4603-a76b-b26ebe185441-scripts\") pod \"cinder-api-0\" (UID: \"7ea8cd10-4026-4603-a76b-b26ebe185441\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:21:31 crc kubenswrapper[5120]: I0316 16:21:31.959018 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7ea8cd10-4026-4603-a76b-b26ebe185441-config-data\") pod \"cinder-api-0\" (UID: \"7ea8cd10-4026-4603-a76b-b26ebe185441\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:21:31 crc kubenswrapper[5120]: I0316 16:21:31.962193 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/7ea8cd10-4026-4603-a76b-b26ebe185441-public-tls-certs\") pod \"cinder-api-0\" (UID: \"7ea8cd10-4026-4603-a76b-b26ebe185441\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:21:31 crc kubenswrapper[5120]: I0316 16:21:31.966253 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/7ea8cd10-4026-4603-a76b-b26ebe185441-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"7ea8cd10-4026-4603-a76b-b26ebe185441\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:21:31 crc kubenswrapper[5120]: I0316 16:21:31.978182 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9z9cv\" (UniqueName: \"kubernetes.io/projected/7ea8cd10-4026-4603-a76b-b26ebe185441-kube-api-access-9z9cv\") pod \"cinder-api-0\" (UID: \"7ea8cd10-4026-4603-a76b-b26ebe185441\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:21:32 crc kubenswrapper[5120]: I0316 16:21:32.042538 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:21:32 crc kubenswrapper[5120]: I0316 16:21:32.086748 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-6b497d5884-fvxpp" Mar 16 16:21:32 crc kubenswrapper[5120]: I0316 16:21:32.244498 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:21:32 crc kubenswrapper[5120]: I0316 16:21:32.314991 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:21:32 crc kubenswrapper[5120]: I0316 16:21:32.449201 5120 generic.go:358] "Generic (PLEG): container finished" podID="bd6718c5-d778-4991-bc8e-de0989c82299" containerID="cb45f951b2479757a6c305a37f699644d4da21da50dda194ea5f942be0ed610d" exitCode=0 Mar 16 16:21:32 crc kubenswrapper[5120]: I0316 16:21:32.449231 5120 generic.go:358] "Generic (PLEG): container finished" podID="bd6718c5-d778-4991-bc8e-de0989c82299" containerID="125aa5ff5a1ef8c056ecbe837f3c6667f0418af79a250ecfbced930b968e2f1a" exitCode=2 Mar 16 16:21:32 crc kubenswrapper[5120]: I0316 16:21:32.449241 5120 generic.go:358] "Generic (PLEG): container finished" podID="bd6718c5-d778-4991-bc8e-de0989c82299" containerID="818b27a472d92374032010866daa0e995cc70e7f9539c02e4b5d4b8db55f15f9" exitCode=0 Mar 16 16:21:32 crc kubenswrapper[5120]: I0316 16:21:32.449249 5120 generic.go:358] "Generic (PLEG): container finished" podID="bd6718c5-d778-4991-bc8e-de0989c82299" containerID="9e17fdd369ba7374abf0d212cd6d7f5d289a260a0de7cfccd3c61cc1b45d2cf4" exitCode=0 Mar 16 16:21:32 crc kubenswrapper[5120]: I0316 16:21:32.450692 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"bd6718c5-d778-4991-bc8e-de0989c82299","Type":"ContainerDied","Data":"cb45f951b2479757a6c305a37f699644d4da21da50dda194ea5f942be0ed610d"} Mar 16 16:21:32 crc kubenswrapper[5120]: I0316 16:21:32.450722 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"bd6718c5-d778-4991-bc8e-de0989c82299","Type":"ContainerDied","Data":"125aa5ff5a1ef8c056ecbe837f3c6667f0418af79a250ecfbced930b968e2f1a"} Mar 16 16:21:32 crc kubenswrapper[5120]: I0316 16:21:32.450737 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"bd6718c5-d778-4991-bc8e-de0989c82299","Type":"ContainerDied","Data":"818b27a472d92374032010866daa0e995cc70e7f9539c02e4b5d4b8db55f15f9"} Mar 16 16:21:32 crc kubenswrapper[5120]: I0316 16:21:32.450747 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"bd6718c5-d778-4991-bc8e-de0989c82299","Type":"ContainerDied","Data":"9e17fdd369ba7374abf0d212cd6d7f5d289a260a0de7cfccd3c61cc1b45d2cf4"} Mar 16 16:21:32 crc kubenswrapper[5120]: I0316 16:21:32.547492 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:21:32 crc kubenswrapper[5120]: I0316 16:21:32.663836 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-6b497d5884-fvxpp" Mar 16 16:21:32 crc kubenswrapper[5120]: I0316 16:21:32.666231 5120 scope.go:117] "RemoveContainer" containerID="f40e444f89abd558ac90555bfd58e04a1c4379a653ba8035c228d2b7a5443eb5" Mar 16 16:21:32 crc kubenswrapper[5120]: E0316 16:21:32.667004 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:21:32 crc kubenswrapper[5120]: I0316 16:21:32.689632 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c64d0fce-5ae8-4f4a-9b5e-987fba23be30" path="/var/lib/kubelet/pods/c64d0fce-5ae8-4f4a-9b5e-987fba23be30/volumes" Mar 16 16:21:32 crc kubenswrapper[5120]: I0316 16:21:32.897295 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-worker-6f68c75449-s4d7j"] Mar 16 16:21:32 crc kubenswrapper[5120]: I0316 16:21:32.978937 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-6f68c75449-s4d7j"] Mar 16 16:21:32 crc kubenswrapper[5120]: I0316 16:21:32.978977 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-6bf46d9f46-cv8dx"] Mar 16 16:21:33 crc kubenswrapper[5120]: I0316 16:21:33.061903 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-6bf46d9f46-cv8dx"] Mar 16 16:21:33 crc kubenswrapper[5120]: I0316 16:21:33.061935 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-6b946b9c94-hvvmv"] Mar 16 16:21:33 crc kubenswrapper[5120]: I0316 16:21:33.061951 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-api-85c89c7f6-6429v"] Mar 16 16:21:33 crc kubenswrapper[5120]: I0316 16:21:33.063250 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-6bf46d9f46-cv8dx" Mar 16 16:21:33 crc kubenswrapper[5120]: I0316 16:21:33.063273 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-6f68c75449-s4d7j" Mar 16 16:21:33 crc kubenswrapper[5120]: I0316 16:21:33.069364 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-6b946b9c94-hvvmv" podUID="cc082deb-bc44-4949-95e5-f6a9ece6220c" containerName="barbican-api-log" containerID="cri-o://7b9d72fd68bdaeb3ffdd80b1f42f221d7edcb3c58698eb912cef35b25cd35fcc" gracePeriod=30 Mar 16 16:21:33 crc kubenswrapper[5120]: I0316 16:21:33.069499 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-6b946b9c94-hvvmv" podUID="cc082deb-bc44-4949-95e5-f6a9ece6220c" containerName="barbican-api" containerID="cri-o://d5aaa29de71f9506edf61c52ff902611842cbc3ad6e5f2ae70727afe76f85f25" gracePeriod=30 Mar 16 16:21:33 crc kubenswrapper[5120]: I0316 16:21:33.077608 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openstack-kuttl-tests/barbican-api-6b946b9c94-hvvmv" podUID="cc082deb-bc44-4949-95e5-f6a9ece6220c" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.1.93:9311/healthcheck\": EOF" Mar 16 16:21:33 crc kubenswrapper[5120]: I0316 16:21:33.077965 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-6b946b9c94-hvvmv" podUID="cc082deb-bc44-4949-95e5-f6a9ece6220c" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.1.93:9311/healthcheck\": EOF" Mar 16 16:21:33 crc kubenswrapper[5120]: I0316 16:21:33.080688 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openstack-kuttl-tests/barbican-api-6b946b9c94-hvvmv" podUID="cc082deb-bc44-4949-95e5-f6a9ece6220c" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.1.93:9311/healthcheck\": EOF" Mar 16 16:21:33 crc kubenswrapper[5120]: I0316 16:21:33.081087 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-6b946b9c94-hvvmv" podUID="cc082deb-bc44-4949-95e5-f6a9ece6220c" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.1.93:9311/healthcheck\": EOF" Mar 16 16:21:33 crc kubenswrapper[5120]: I0316 16:21:33.085620 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8558eb14-801e-455b-8374-1c69e333901c-logs\") pod \"barbican-worker-6f68c75449-s4d7j\" (UID: \"8558eb14-801e-455b-8374-1c69e333901c\") " pod="openstack-kuttl-tests/barbican-worker-6f68c75449-s4d7j" Mar 16 16:21:33 crc kubenswrapper[5120]: I0316 16:21:33.085725 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8558eb14-801e-455b-8374-1c69e333901c-config-data\") pod \"barbican-worker-6f68c75449-s4d7j\" (UID: \"8558eb14-801e-455b-8374-1c69e333901c\") " pod="openstack-kuttl-tests/barbican-worker-6f68c75449-s4d7j" Mar 16 16:21:33 crc kubenswrapper[5120]: I0316 16:21:33.085771 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8558eb14-801e-455b-8374-1c69e333901c-combined-ca-bundle\") pod \"barbican-worker-6f68c75449-s4d7j\" (UID: \"8558eb14-801e-455b-8374-1c69e333901c\") " pod="openstack-kuttl-tests/barbican-worker-6f68c75449-s4d7j" Mar 16 16:21:33 crc kubenswrapper[5120]: I0316 16:21:33.085803 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/8558eb14-801e-455b-8374-1c69e333901c-config-data-custom\") pod \"barbican-worker-6f68c75449-s4d7j\" (UID: \"8558eb14-801e-455b-8374-1c69e333901c\") " pod="openstack-kuttl-tests/barbican-worker-6f68c75449-s4d7j" Mar 16 16:21:33 crc kubenswrapper[5120]: I0316 16:21:33.086170 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fg5ll\" (UniqueName: \"kubernetes.io/projected/8558eb14-801e-455b-8374-1c69e333901c-kube-api-access-fg5ll\") pod \"barbican-worker-6f68c75449-s4d7j\" (UID: \"8558eb14-801e-455b-8374-1c69e333901c\") " pod="openstack-kuttl-tests/barbican-worker-6f68c75449-s4d7j" Mar 16 16:21:33 crc kubenswrapper[5120]: I0316 16:21:33.132070 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-85c89c7f6-6429v"] Mar 16 16:21:33 crc kubenswrapper[5120]: I0316 16:21:33.132345 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-85c89c7f6-6429v" Mar 16 16:21:33 crc kubenswrapper[5120]: I0316 16:21:33.191958 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ecdbe440-4557-4298-b0b7-e2e89958bf07-logs\") pod \"barbican-keystone-listener-6bf46d9f46-cv8dx\" (UID: \"ecdbe440-4557-4298-b0b7-e2e89958bf07\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6bf46d9f46-cv8dx" Mar 16 16:21:33 crc kubenswrapper[5120]: I0316 16:21:33.193541 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ecdbe440-4557-4298-b0b7-e2e89958bf07-combined-ca-bundle\") pod \"barbican-keystone-listener-6bf46d9f46-cv8dx\" (UID: \"ecdbe440-4557-4298-b0b7-e2e89958bf07\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6bf46d9f46-cv8dx" Mar 16 16:21:33 crc kubenswrapper[5120]: I0316 16:21:33.193636 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/ecdbe440-4557-4298-b0b7-e2e89958bf07-config-data-custom\") pod \"barbican-keystone-listener-6bf46d9f46-cv8dx\" (UID: \"ecdbe440-4557-4298-b0b7-e2e89958bf07\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6bf46d9f46-cv8dx" Mar 16 16:21:33 crc kubenswrapper[5120]: I0316 16:21:33.193750 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ecdbe440-4557-4298-b0b7-e2e89958bf07-config-data\") pod \"barbican-keystone-listener-6bf46d9f46-cv8dx\" (UID: \"ecdbe440-4557-4298-b0b7-e2e89958bf07\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6bf46d9f46-cv8dx" Mar 16 16:21:33 crc kubenswrapper[5120]: I0316 16:21:33.193864 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rpgf9\" (UniqueName: \"kubernetes.io/projected/69c47154-7063-4a88-af54-c4dba11e7fd6-kube-api-access-rpgf9\") pod \"barbican-api-85c89c7f6-6429v\" (UID: \"69c47154-7063-4a88-af54-c4dba11e7fd6\") " pod="openstack-kuttl-tests/barbican-api-85c89c7f6-6429v" Mar 16 16:21:33 crc kubenswrapper[5120]: I0316 16:21:33.193966 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/69c47154-7063-4a88-af54-c4dba11e7fd6-logs\") pod \"barbican-api-85c89c7f6-6429v\" (UID: \"69c47154-7063-4a88-af54-c4dba11e7fd6\") " pod="openstack-kuttl-tests/barbican-api-85c89c7f6-6429v" Mar 16 16:21:33 crc kubenswrapper[5120]: I0316 16:21:33.194061 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/69c47154-7063-4a88-af54-c4dba11e7fd6-internal-tls-certs\") pod \"barbican-api-85c89c7f6-6429v\" (UID: \"69c47154-7063-4a88-af54-c4dba11e7fd6\") " pod="openstack-kuttl-tests/barbican-api-85c89c7f6-6429v" Mar 16 16:21:33 crc kubenswrapper[5120]: I0316 16:21:33.194173 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fg5ll\" (UniqueName: \"kubernetes.io/projected/8558eb14-801e-455b-8374-1c69e333901c-kube-api-access-fg5ll\") pod \"barbican-worker-6f68c75449-s4d7j\" (UID: \"8558eb14-801e-455b-8374-1c69e333901c\") " pod="openstack-kuttl-tests/barbican-worker-6f68c75449-s4d7j" Mar 16 16:21:33 crc kubenswrapper[5120]: I0316 16:21:33.194377 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/69c47154-7063-4a88-af54-c4dba11e7fd6-public-tls-certs\") pod \"barbican-api-85c89c7f6-6429v\" (UID: \"69c47154-7063-4a88-af54-c4dba11e7fd6\") " pod="openstack-kuttl-tests/barbican-api-85c89c7f6-6429v" Mar 16 16:21:33 crc kubenswrapper[5120]: I0316 16:21:33.194454 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8558eb14-801e-455b-8374-1c69e333901c-logs\") pod \"barbican-worker-6f68c75449-s4d7j\" (UID: \"8558eb14-801e-455b-8374-1c69e333901c\") " pod="openstack-kuttl-tests/barbican-worker-6f68c75449-s4d7j" Mar 16 16:21:33 crc kubenswrapper[5120]: I0316 16:21:33.194561 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqxmx\" (UniqueName: \"kubernetes.io/projected/ecdbe440-4557-4298-b0b7-e2e89958bf07-kube-api-access-sqxmx\") pod \"barbican-keystone-listener-6bf46d9f46-cv8dx\" (UID: \"ecdbe440-4557-4298-b0b7-e2e89958bf07\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6bf46d9f46-cv8dx" Mar 16 16:21:33 crc kubenswrapper[5120]: I0316 16:21:33.194653 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/69c47154-7063-4a88-af54-c4dba11e7fd6-config-data\") pod \"barbican-api-85c89c7f6-6429v\" (UID: \"69c47154-7063-4a88-af54-c4dba11e7fd6\") " pod="openstack-kuttl-tests/barbican-api-85c89c7f6-6429v" Mar 16 16:21:33 crc kubenswrapper[5120]: I0316 16:21:33.194727 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8558eb14-801e-455b-8374-1c69e333901c-config-data\") pod \"barbican-worker-6f68c75449-s4d7j\" (UID: \"8558eb14-801e-455b-8374-1c69e333901c\") " pod="openstack-kuttl-tests/barbican-worker-6f68c75449-s4d7j" Mar 16 16:21:33 crc kubenswrapper[5120]: I0316 16:21:33.194817 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/69c47154-7063-4a88-af54-c4dba11e7fd6-config-data-custom\") pod \"barbican-api-85c89c7f6-6429v\" (UID: \"69c47154-7063-4a88-af54-c4dba11e7fd6\") " pod="openstack-kuttl-tests/barbican-api-85c89c7f6-6429v" Mar 16 16:21:33 crc kubenswrapper[5120]: I0316 16:21:33.194900 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8558eb14-801e-455b-8374-1c69e333901c-combined-ca-bundle\") pod \"barbican-worker-6f68c75449-s4d7j\" (UID: \"8558eb14-801e-455b-8374-1c69e333901c\") " pod="openstack-kuttl-tests/barbican-worker-6f68c75449-s4d7j" Mar 16 16:21:33 crc kubenswrapper[5120]: I0316 16:21:33.194965 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/69c47154-7063-4a88-af54-c4dba11e7fd6-combined-ca-bundle\") pod \"barbican-api-85c89c7f6-6429v\" (UID: \"69c47154-7063-4a88-af54-c4dba11e7fd6\") " pod="openstack-kuttl-tests/barbican-api-85c89c7f6-6429v" Mar 16 16:21:33 crc kubenswrapper[5120]: I0316 16:21:33.195047 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/8558eb14-801e-455b-8374-1c69e333901c-config-data-custom\") pod \"barbican-worker-6f68c75449-s4d7j\" (UID: \"8558eb14-801e-455b-8374-1c69e333901c\") " pod="openstack-kuttl-tests/barbican-worker-6f68c75449-s4d7j" Mar 16 16:21:33 crc kubenswrapper[5120]: I0316 16:21:33.196293 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8558eb14-801e-455b-8374-1c69e333901c-logs\") pod \"barbican-worker-6f68c75449-s4d7j\" (UID: \"8558eb14-801e-455b-8374-1c69e333901c\") " pod="openstack-kuttl-tests/barbican-worker-6f68c75449-s4d7j" Mar 16 16:21:33 crc kubenswrapper[5120]: I0316 16:21:33.203740 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/8558eb14-801e-455b-8374-1c69e333901c-config-data-custom\") pod \"barbican-worker-6f68c75449-s4d7j\" (UID: \"8558eb14-801e-455b-8374-1c69e333901c\") " pod="openstack-kuttl-tests/barbican-worker-6f68c75449-s4d7j" Mar 16 16:21:33 crc kubenswrapper[5120]: I0316 16:21:33.218367 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8558eb14-801e-455b-8374-1c69e333901c-combined-ca-bundle\") pod \"barbican-worker-6f68c75449-s4d7j\" (UID: \"8558eb14-801e-455b-8374-1c69e333901c\") " pod="openstack-kuttl-tests/barbican-worker-6f68c75449-s4d7j" Mar 16 16:21:33 crc kubenswrapper[5120]: I0316 16:21:33.229427 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fg5ll\" (UniqueName: \"kubernetes.io/projected/8558eb14-801e-455b-8374-1c69e333901c-kube-api-access-fg5ll\") pod \"barbican-worker-6f68c75449-s4d7j\" (UID: \"8558eb14-801e-455b-8374-1c69e333901c\") " pod="openstack-kuttl-tests/barbican-worker-6f68c75449-s4d7j" Mar 16 16:21:33 crc kubenswrapper[5120]: I0316 16:21:33.249347 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8558eb14-801e-455b-8374-1c69e333901c-config-data\") pod \"barbican-worker-6f68c75449-s4d7j\" (UID: \"8558eb14-801e-455b-8374-1c69e333901c\") " pod="openstack-kuttl-tests/barbican-worker-6f68c75449-s4d7j" Mar 16 16:21:33 crc kubenswrapper[5120]: I0316 16:21:33.298306 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sqxmx\" (UniqueName: \"kubernetes.io/projected/ecdbe440-4557-4298-b0b7-e2e89958bf07-kube-api-access-sqxmx\") pod \"barbican-keystone-listener-6bf46d9f46-cv8dx\" (UID: \"ecdbe440-4557-4298-b0b7-e2e89958bf07\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6bf46d9f46-cv8dx" Mar 16 16:21:33 crc kubenswrapper[5120]: I0316 16:21:33.298366 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/69c47154-7063-4a88-af54-c4dba11e7fd6-config-data\") pod \"barbican-api-85c89c7f6-6429v\" (UID: \"69c47154-7063-4a88-af54-c4dba11e7fd6\") " pod="openstack-kuttl-tests/barbican-api-85c89c7f6-6429v" Mar 16 16:21:33 crc kubenswrapper[5120]: I0316 16:21:33.298401 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/69c47154-7063-4a88-af54-c4dba11e7fd6-config-data-custom\") pod \"barbican-api-85c89c7f6-6429v\" (UID: \"69c47154-7063-4a88-af54-c4dba11e7fd6\") " pod="openstack-kuttl-tests/barbican-api-85c89c7f6-6429v" Mar 16 16:21:33 crc kubenswrapper[5120]: I0316 16:21:33.298442 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/69c47154-7063-4a88-af54-c4dba11e7fd6-combined-ca-bundle\") pod \"barbican-api-85c89c7f6-6429v\" (UID: \"69c47154-7063-4a88-af54-c4dba11e7fd6\") " pod="openstack-kuttl-tests/barbican-api-85c89c7f6-6429v" Mar 16 16:21:33 crc kubenswrapper[5120]: I0316 16:21:33.298489 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ecdbe440-4557-4298-b0b7-e2e89958bf07-logs\") pod \"barbican-keystone-listener-6bf46d9f46-cv8dx\" (UID: \"ecdbe440-4557-4298-b0b7-e2e89958bf07\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6bf46d9f46-cv8dx" Mar 16 16:21:33 crc kubenswrapper[5120]: I0316 16:21:33.298514 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ecdbe440-4557-4298-b0b7-e2e89958bf07-combined-ca-bundle\") pod \"barbican-keystone-listener-6bf46d9f46-cv8dx\" (UID: \"ecdbe440-4557-4298-b0b7-e2e89958bf07\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6bf46d9f46-cv8dx" Mar 16 16:21:33 crc kubenswrapper[5120]: I0316 16:21:33.298542 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/ecdbe440-4557-4298-b0b7-e2e89958bf07-config-data-custom\") pod \"barbican-keystone-listener-6bf46d9f46-cv8dx\" (UID: \"ecdbe440-4557-4298-b0b7-e2e89958bf07\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6bf46d9f46-cv8dx" Mar 16 16:21:33 crc kubenswrapper[5120]: I0316 16:21:33.298571 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ecdbe440-4557-4298-b0b7-e2e89958bf07-config-data\") pod \"barbican-keystone-listener-6bf46d9f46-cv8dx\" (UID: \"ecdbe440-4557-4298-b0b7-e2e89958bf07\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6bf46d9f46-cv8dx" Mar 16 16:21:33 crc kubenswrapper[5120]: I0316 16:21:33.298609 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rpgf9\" (UniqueName: \"kubernetes.io/projected/69c47154-7063-4a88-af54-c4dba11e7fd6-kube-api-access-rpgf9\") pod \"barbican-api-85c89c7f6-6429v\" (UID: \"69c47154-7063-4a88-af54-c4dba11e7fd6\") " pod="openstack-kuttl-tests/barbican-api-85c89c7f6-6429v" Mar 16 16:21:33 crc kubenswrapper[5120]: I0316 16:21:33.298641 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/69c47154-7063-4a88-af54-c4dba11e7fd6-logs\") pod \"barbican-api-85c89c7f6-6429v\" (UID: \"69c47154-7063-4a88-af54-c4dba11e7fd6\") " pod="openstack-kuttl-tests/barbican-api-85c89c7f6-6429v" Mar 16 16:21:33 crc kubenswrapper[5120]: I0316 16:21:33.298690 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/69c47154-7063-4a88-af54-c4dba11e7fd6-internal-tls-certs\") pod \"barbican-api-85c89c7f6-6429v\" (UID: \"69c47154-7063-4a88-af54-c4dba11e7fd6\") " pod="openstack-kuttl-tests/barbican-api-85c89c7f6-6429v" Mar 16 16:21:33 crc kubenswrapper[5120]: I0316 16:21:33.298852 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/69c47154-7063-4a88-af54-c4dba11e7fd6-public-tls-certs\") pod \"barbican-api-85c89c7f6-6429v\" (UID: \"69c47154-7063-4a88-af54-c4dba11e7fd6\") " pod="openstack-kuttl-tests/barbican-api-85c89c7f6-6429v" Mar 16 16:21:33 crc kubenswrapper[5120]: I0316 16:21:33.307006 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ecdbe440-4557-4298-b0b7-e2e89958bf07-combined-ca-bundle\") pod \"barbican-keystone-listener-6bf46d9f46-cv8dx\" (UID: \"ecdbe440-4557-4298-b0b7-e2e89958bf07\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6bf46d9f46-cv8dx" Mar 16 16:21:33 crc kubenswrapper[5120]: I0316 16:21:33.307273 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ecdbe440-4557-4298-b0b7-e2e89958bf07-logs\") pod \"barbican-keystone-listener-6bf46d9f46-cv8dx\" (UID: \"ecdbe440-4557-4298-b0b7-e2e89958bf07\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6bf46d9f46-cv8dx" Mar 16 16:21:33 crc kubenswrapper[5120]: I0316 16:21:33.309039 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/69c47154-7063-4a88-af54-c4dba11e7fd6-logs\") pod \"barbican-api-85c89c7f6-6429v\" (UID: \"69c47154-7063-4a88-af54-c4dba11e7fd6\") " pod="openstack-kuttl-tests/barbican-api-85c89c7f6-6429v" Mar 16 16:21:33 crc kubenswrapper[5120]: I0316 16:21:33.315220 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/69c47154-7063-4a88-af54-c4dba11e7fd6-internal-tls-certs\") pod \"barbican-api-85c89c7f6-6429v\" (UID: \"69c47154-7063-4a88-af54-c4dba11e7fd6\") " pod="openstack-kuttl-tests/barbican-api-85c89c7f6-6429v" Mar 16 16:21:33 crc kubenswrapper[5120]: I0316 16:21:33.316494 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/69c47154-7063-4a88-af54-c4dba11e7fd6-config-data\") pod \"barbican-api-85c89c7f6-6429v\" (UID: \"69c47154-7063-4a88-af54-c4dba11e7fd6\") " pod="openstack-kuttl-tests/barbican-api-85c89c7f6-6429v" Mar 16 16:21:33 crc kubenswrapper[5120]: I0316 16:21:33.317293 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/ecdbe440-4557-4298-b0b7-e2e89958bf07-config-data-custom\") pod \"barbican-keystone-listener-6bf46d9f46-cv8dx\" (UID: \"ecdbe440-4557-4298-b0b7-e2e89958bf07\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6bf46d9f46-cv8dx" Mar 16 16:21:33 crc kubenswrapper[5120]: I0316 16:21:33.317602 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ecdbe440-4557-4298-b0b7-e2e89958bf07-config-data\") pod \"barbican-keystone-listener-6bf46d9f46-cv8dx\" (UID: \"ecdbe440-4557-4298-b0b7-e2e89958bf07\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6bf46d9f46-cv8dx" Mar 16 16:21:33 crc kubenswrapper[5120]: I0316 16:21:33.334492 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/69c47154-7063-4a88-af54-c4dba11e7fd6-combined-ca-bundle\") pod \"barbican-api-85c89c7f6-6429v\" (UID: \"69c47154-7063-4a88-af54-c4dba11e7fd6\") " pod="openstack-kuttl-tests/barbican-api-85c89c7f6-6429v" Mar 16 16:21:33 crc kubenswrapper[5120]: I0316 16:21:33.334816 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/watcher-api-0"] Mar 16 16:21:33 crc kubenswrapper[5120]: I0316 16:21:33.335144 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/watcher-api-0" podUID="d8c78a81-c746-4232-9442-b648cd62f793" containerName="watcher-api-log" containerID="cri-o://0677d5b267cbda865c96b1c31d7cbe94dc0a9c10de34337ed831ef8b24b15834" gracePeriod=30 Mar 16 16:21:33 crc kubenswrapper[5120]: I0316 16:21:33.335717 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/watcher-api-0" podUID="d8c78a81-c746-4232-9442-b648cd62f793" containerName="watcher-api" containerID="cri-o://008f86bac563fd795b6d052b49f36b99f8c0a7f375500d7650f25046727052f9" gracePeriod=30 Mar 16 16:21:33 crc kubenswrapper[5120]: I0316 16:21:33.347155 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/69c47154-7063-4a88-af54-c4dba11e7fd6-public-tls-certs\") pod \"barbican-api-85c89c7f6-6429v\" (UID: \"69c47154-7063-4a88-af54-c4dba11e7fd6\") " pod="openstack-kuttl-tests/barbican-api-85c89c7f6-6429v" Mar 16 16:21:33 crc kubenswrapper[5120]: I0316 16:21:33.347815 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rpgf9\" (UniqueName: \"kubernetes.io/projected/69c47154-7063-4a88-af54-c4dba11e7fd6-kube-api-access-rpgf9\") pod \"barbican-api-85c89c7f6-6429v\" (UID: \"69c47154-7063-4a88-af54-c4dba11e7fd6\") " pod="openstack-kuttl-tests/barbican-api-85c89c7f6-6429v" Mar 16 16:21:33 crc kubenswrapper[5120]: I0316 16:21:33.354157 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqxmx\" (UniqueName: \"kubernetes.io/projected/ecdbe440-4557-4298-b0b7-e2e89958bf07-kube-api-access-sqxmx\") pod \"barbican-keystone-listener-6bf46d9f46-cv8dx\" (UID: \"ecdbe440-4557-4298-b0b7-e2e89958bf07\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6bf46d9f46-cv8dx" Mar 16 16:21:33 crc kubenswrapper[5120]: I0316 16:21:33.364026 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/69c47154-7063-4a88-af54-c4dba11e7fd6-config-data-custom\") pod \"barbican-api-85c89c7f6-6429v\" (UID: \"69c47154-7063-4a88-af54-c4dba11e7fd6\") " pod="openstack-kuttl-tests/barbican-api-85c89c7f6-6429v" Mar 16 16:21:33 crc kubenswrapper[5120]: I0316 16:21:33.411596 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-85c89c7f6-6429v" Mar 16 16:21:33 crc kubenswrapper[5120]: I0316 16:21:33.462733 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-6bf46d9f46-cv8dx" Mar 16 16:21:33 crc kubenswrapper[5120]: I0316 16:21:33.507265 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-6f68c75449-s4d7j" Mar 16 16:21:33 crc kubenswrapper[5120]: I0316 16:21:33.529924 5120 generic.go:358] "Generic (PLEG): container finished" podID="cc082deb-bc44-4949-95e5-f6a9ece6220c" containerID="7b9d72fd68bdaeb3ffdd80b1f42f221d7edcb3c58698eb912cef35b25cd35fcc" exitCode=143 Mar 16 16:21:33 crc kubenswrapper[5120]: I0316 16:21:33.530205 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-6b946b9c94-hvvmv" event={"ID":"cc082deb-bc44-4949-95e5-f6a9ece6220c","Type":"ContainerDied","Data":"7b9d72fd68bdaeb3ffdd80b1f42f221d7edcb3c58698eb912cef35b25cd35fcc"} Mar 16 16:21:33 crc kubenswrapper[5120]: I0316 16:21:33.542879 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"7ea8cd10-4026-4603-a76b-b26ebe185441","Type":"ContainerStarted","Data":"5019dfad6719a1fa7a4319b1a9237d7eaaadf94171dd04c8d16917f3a4869715"} Mar 16 16:21:34 crc kubenswrapper[5120]: I0316 16:21:34.082899 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-85c89c7f6-6429v"] Mar 16 16:21:34 crc kubenswrapper[5120]: I0316 16:21:34.253261 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-6bf46d9f46-cv8dx"] Mar 16 16:21:34 crc kubenswrapper[5120]: I0316 16:21:34.320612 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-6f68c75449-s4d7j"] Mar 16 16:21:34 crc kubenswrapper[5120]: I0316 16:21:34.583322 5120 generic.go:358] "Generic (PLEG): container finished" podID="d8c78a81-c746-4232-9442-b648cd62f793" containerID="0677d5b267cbda865c96b1c31d7cbe94dc0a9c10de34337ed831ef8b24b15834" exitCode=143 Mar 16 16:21:34 crc kubenswrapper[5120]: I0316 16:21:34.583675 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/watcher-api-0" event={"ID":"d8c78a81-c746-4232-9442-b648cd62f793","Type":"ContainerDied","Data":"0677d5b267cbda865c96b1c31d7cbe94dc0a9c10de34337ed831ef8b24b15834"} Mar 16 16:21:34 crc kubenswrapper[5120]: I0316 16:21:34.603450 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"7ea8cd10-4026-4603-a76b-b26ebe185441","Type":"ContainerStarted","Data":"012a3855ae67a12b9164354428ce7c259e43b459de8113e16569a6cd9ad28f57"} Mar 16 16:21:34 crc kubenswrapper[5120]: I0316 16:21:34.609204 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-85c89c7f6-6429v" event={"ID":"69c47154-7063-4a88-af54-c4dba11e7fd6","Type":"ContainerStarted","Data":"07a3523e95e26a4ad1674aba9a3699719e7fc78f28f29651ed652b5d355fc208"} Mar 16 16:21:34 crc kubenswrapper[5120]: I0316 16:21:34.613890 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-6f68c75449-s4d7j" event={"ID":"8558eb14-801e-455b-8374-1c69e333901c","Type":"ContainerStarted","Data":"2a900e19e17e760158b56abc2de17566f4c4d3e37e3fd0b91bf26d4666959603"} Mar 16 16:21:34 crc kubenswrapper[5120]: I0316 16:21:34.620101 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-6bf46d9f46-cv8dx" event={"ID":"ecdbe440-4557-4298-b0b7-e2e89958bf07","Type":"ContainerStarted","Data":"2c94e2c8cdc0b8ee4d5553efb4a6697a26f56c1b6df3aced5fdb636183f83d78"} Mar 16 16:21:34 crc kubenswrapper[5120]: I0316 16:21:34.625280 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:21:34 crc kubenswrapper[5120]: I0316 16:21:34.767725 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/bd6718c5-d778-4991-bc8e-de0989c82299-log-httpd\") pod \"bd6718c5-d778-4991-bc8e-de0989c82299\" (UID: \"bd6718c5-d778-4991-bc8e-de0989c82299\") " Mar 16 16:21:34 crc kubenswrapper[5120]: I0316 16:21:34.767857 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/bd6718c5-d778-4991-bc8e-de0989c82299-scripts\") pod \"bd6718c5-d778-4991-bc8e-de0989c82299\" (UID: \"bd6718c5-d778-4991-bc8e-de0989c82299\") " Mar 16 16:21:34 crc kubenswrapper[5120]: I0316 16:21:34.767973 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bd6718c5-d778-4991-bc8e-de0989c82299-config-data\") pod \"bd6718c5-d778-4991-bc8e-de0989c82299\" (UID: \"bd6718c5-d778-4991-bc8e-de0989c82299\") " Mar 16 16:21:34 crc kubenswrapper[5120]: I0316 16:21:34.768013 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bd6718c5-d778-4991-bc8e-de0989c82299-combined-ca-bundle\") pod \"bd6718c5-d778-4991-bc8e-de0989c82299\" (UID: \"bd6718c5-d778-4991-bc8e-de0989c82299\") " Mar 16 16:21:34 crc kubenswrapper[5120]: I0316 16:21:34.768079 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/bd6718c5-d778-4991-bc8e-de0989c82299-run-httpd\") pod \"bd6718c5-d778-4991-bc8e-de0989c82299\" (UID: \"bd6718c5-d778-4991-bc8e-de0989c82299\") " Mar 16 16:21:34 crc kubenswrapper[5120]: I0316 16:21:34.768114 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hfvvt\" (UniqueName: \"kubernetes.io/projected/bd6718c5-d778-4991-bc8e-de0989c82299-kube-api-access-hfvvt\") pod \"bd6718c5-d778-4991-bc8e-de0989c82299\" (UID: \"bd6718c5-d778-4991-bc8e-de0989c82299\") " Mar 16 16:21:34 crc kubenswrapper[5120]: I0316 16:21:34.768221 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/bd6718c5-d778-4991-bc8e-de0989c82299-sg-core-conf-yaml\") pod \"bd6718c5-d778-4991-bc8e-de0989c82299\" (UID: \"bd6718c5-d778-4991-bc8e-de0989c82299\") " Mar 16 16:21:34 crc kubenswrapper[5120]: I0316 16:21:34.768658 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd6718c5-d778-4991-bc8e-de0989c82299-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "bd6718c5-d778-4991-bc8e-de0989c82299" (UID: "bd6718c5-d778-4991-bc8e-de0989c82299"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:21:34 crc kubenswrapper[5120]: I0316 16:21:34.769099 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd6718c5-d778-4991-bc8e-de0989c82299-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "bd6718c5-d778-4991-bc8e-de0989c82299" (UID: "bd6718c5-d778-4991-bc8e-de0989c82299"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:21:34 crc kubenswrapper[5120]: I0316 16:21:34.770229 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/bd6718c5-d778-4991-bc8e-de0989c82299-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:21:34 crc kubenswrapper[5120]: I0316 16:21:34.770261 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/bd6718c5-d778-4991-bc8e-de0989c82299-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:21:34 crc kubenswrapper[5120]: I0316 16:21:34.776103 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd6718c5-d778-4991-bc8e-de0989c82299-kube-api-access-hfvvt" (OuterVolumeSpecName: "kube-api-access-hfvvt") pod "bd6718c5-d778-4991-bc8e-de0989c82299" (UID: "bd6718c5-d778-4991-bc8e-de0989c82299"). InnerVolumeSpecName "kube-api-access-hfvvt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:21:34 crc kubenswrapper[5120]: I0316 16:21:34.776163 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd6718c5-d778-4991-bc8e-de0989c82299-scripts" (OuterVolumeSpecName: "scripts") pod "bd6718c5-d778-4991-bc8e-de0989c82299" (UID: "bd6718c5-d778-4991-bc8e-de0989c82299"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:21:34 crc kubenswrapper[5120]: I0316 16:21:34.821094 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd6718c5-d778-4991-bc8e-de0989c82299-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "bd6718c5-d778-4991-bc8e-de0989c82299" (UID: "bd6718c5-d778-4991-bc8e-de0989c82299"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:21:34 crc kubenswrapper[5120]: I0316 16:21:34.872446 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/bd6718c5-d778-4991-bc8e-de0989c82299-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:21:34 crc kubenswrapper[5120]: I0316 16:21:34.872482 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hfvvt\" (UniqueName: \"kubernetes.io/projected/bd6718c5-d778-4991-bc8e-de0989c82299-kube-api-access-hfvvt\") on node \"crc\" DevicePath \"\"" Mar 16 16:21:34 crc kubenswrapper[5120]: I0316 16:21:34.872494 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/bd6718c5-d778-4991-bc8e-de0989c82299-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 16:21:34 crc kubenswrapper[5120]: I0316 16:21:34.918611 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd6718c5-d778-4991-bc8e-de0989c82299-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "bd6718c5-d778-4991-bc8e-de0989c82299" (UID: "bd6718c5-d778-4991-bc8e-de0989c82299"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:21:34 crc kubenswrapper[5120]: I0316 16:21:34.934185 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd6718c5-d778-4991-bc8e-de0989c82299-config-data" (OuterVolumeSpecName: "config-data") pod "bd6718c5-d778-4991-bc8e-de0989c82299" (UID: "bd6718c5-d778-4991-bc8e-de0989c82299"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:21:34 crc kubenswrapper[5120]: I0316 16:21:34.976632 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bd6718c5-d778-4991-bc8e-de0989c82299-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:21:34 crc kubenswrapper[5120]: I0316 16:21:34.976664 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bd6718c5-d778-4991-bc8e-de0989c82299-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:21:35 crc kubenswrapper[5120]: I0316 16:21:35.631808 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-6f68c75449-s4d7j" event={"ID":"8558eb14-801e-455b-8374-1c69e333901c","Type":"ContainerStarted","Data":"790456066ec1c9d2fb08d49a67269b46aa9af70d5546f44faab71e69a301ccfb"} Mar 16 16:21:35 crc kubenswrapper[5120]: I0316 16:21:35.632319 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-6f68c75449-s4d7j" event={"ID":"8558eb14-801e-455b-8374-1c69e333901c","Type":"ContainerStarted","Data":"d7c153224a3bf3e6347984cb47aae3cd6b8bb54fa6f5bb003cfe5e0fc882319e"} Mar 16 16:21:35 crc kubenswrapper[5120]: I0316 16:21:35.634943 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-6bf46d9f46-cv8dx" event={"ID":"ecdbe440-4557-4298-b0b7-e2e89958bf07","Type":"ContainerStarted","Data":"ee098489a81ab6a4f9e4ca8e42dc2cbdb96791a0f059a8249a2d3bb49356b4d4"} Mar 16 16:21:35 crc kubenswrapper[5120]: I0316 16:21:35.634975 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-6bf46d9f46-cv8dx" event={"ID":"ecdbe440-4557-4298-b0b7-e2e89958bf07","Type":"ContainerStarted","Data":"2e47d1a1b6ef394c9e4f761ae69ebb45114b8cfb8609be386af11e1fb6adb4e3"} Mar 16 16:21:35 crc kubenswrapper[5120]: I0316 16:21:35.643552 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"bd6718c5-d778-4991-bc8e-de0989c82299","Type":"ContainerDied","Data":"0d27ee7d3389dfea0720a1feae26dc9c46a3c1bc81a261125e3e7f5bd5b1a68a"} Mar 16 16:21:35 crc kubenswrapper[5120]: I0316 16:21:35.643599 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:21:35 crc kubenswrapper[5120]: I0316 16:21:35.643638 5120 scope.go:117] "RemoveContainer" containerID="cb45f951b2479757a6c305a37f699644d4da21da50dda194ea5f942be0ed610d" Mar 16 16:21:35 crc kubenswrapper[5120]: I0316 16:21:35.648177 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-85c89c7f6-6429v" event={"ID":"69c47154-7063-4a88-af54-c4dba11e7fd6","Type":"ContainerStarted","Data":"8b568e74a3015e82c143b45e4ec9c9806b390389907f25fffb8093f0f982c0cd"} Mar 16 16:21:35 crc kubenswrapper[5120]: I0316 16:21:35.648218 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-85c89c7f6-6429v" event={"ID":"69c47154-7063-4a88-af54-c4dba11e7fd6","Type":"ContainerStarted","Data":"b28880e5a05a573108be1a0e941930a878933df93431db8ee6799513224cdd63"} Mar 16 16:21:35 crc kubenswrapper[5120]: I0316 16:21:35.649230 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-85c89c7f6-6429v" Mar 16 16:21:35 crc kubenswrapper[5120]: I0316 16:21:35.649330 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-85c89c7f6-6429v" Mar 16 16:21:35 crc kubenswrapper[5120]: I0316 16:21:35.673505 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-worker-6f68c75449-s4d7j" podStartSLOduration=3.6734884770000003 podStartE2EDuration="3.673488477s" podCreationTimestamp="2026-03-16 16:21:32 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:21:35.665194056 +0000 UTC m=+2997.819125723" watchObservedRunningTime="2026-03-16 16:21:35.673488477 +0000 UTC m=+2997.827420134" Mar 16 16:21:35 crc kubenswrapper[5120]: I0316 16:21:35.682412 5120 scope.go:117] "RemoveContainer" containerID="125aa5ff5a1ef8c056ecbe837f3c6667f0418af79a250ecfbced930b968e2f1a" Mar 16 16:21:35 crc kubenswrapper[5120]: I0316 16:21:35.695000 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-5ffd6f596c-m52jd"] Mar 16 16:21:35 crc kubenswrapper[5120]: I0316 16:21:35.695222 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-5ffd6f596c-m52jd" podUID="61e41544-dcc8-47cf-8a6e-45b053ae0f9e" containerName="barbican-worker-log" containerID="cri-o://da371751a76a30f178eff06cf80fbc0812228b79e3637d23b403035295bb62ee" gracePeriod=30 Mar 16 16:21:35 crc kubenswrapper[5120]: I0316 16:21:35.695327 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-5ffd6f596c-m52jd" podUID="61e41544-dcc8-47cf-8a6e-45b053ae0f9e" containerName="barbican-worker" containerID="cri-o://eb0d8a6546028f00924b876961e7377e8be7061907902ffda27871c0c53fa378" gracePeriod=30 Mar 16 16:21:35 crc kubenswrapper[5120]: I0316 16:21:35.710069 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-keystone-listener-6bf46d9f46-cv8dx" podStartSLOduration=3.710050516 podStartE2EDuration="3.710050516s" podCreationTimestamp="2026-03-16 16:21:32 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:21:35.693368989 +0000 UTC m=+2997.847300646" watchObservedRunningTime="2026-03-16 16:21:35.710050516 +0000 UTC m=+2997.863982413" Mar 16 16:21:35 crc kubenswrapper[5120]: I0316 16:21:35.728262 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-api-85c89c7f6-6429v" podStartSLOduration=2.7282463420000003 podStartE2EDuration="2.728246342s" podCreationTimestamp="2026-03-16 16:21:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:21:35.721966704 +0000 UTC m=+2997.875898361" watchObservedRunningTime="2026-03-16 16:21:35.728246342 +0000 UTC m=+2997.882177999" Mar 16 16:21:35 crc kubenswrapper[5120]: I0316 16:21:35.748812 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-756f865fd6-cllz7"] Mar 16 16:21:35 crc kubenswrapper[5120]: I0316 16:21:35.749052 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-756f865fd6-cllz7" podUID="3bb21f28-1bc0-402f-b18b-f29c0b834174" containerName="barbican-keystone-listener-log" containerID="cri-o://2bd625cf02e831d748d79a2a782e6ca939c530254b7265a4d6bdb18f7d957ea4" gracePeriod=30 Mar 16 16:21:35 crc kubenswrapper[5120]: I0316 16:21:35.749152 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-756f865fd6-cllz7" podUID="3bb21f28-1bc0-402f-b18b-f29c0b834174" containerName="barbican-keystone-listener" containerID="cri-o://c1d44c9bc92ca9945715186ad30c605d1106f5afd0d5347a1f091e01c268412c" gracePeriod=30 Mar 16 16:21:35 crc kubenswrapper[5120]: I0316 16:21:35.764292 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:21:35 crc kubenswrapper[5120]: I0316 16:21:35.777654 5120 scope.go:117] "RemoveContainer" containerID="818b27a472d92374032010866daa0e995cc70e7f9539c02e4b5d4b8db55f15f9" Mar 16 16:21:35 crc kubenswrapper[5120]: I0316 16:21:35.779230 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:21:35 crc kubenswrapper[5120]: I0316 16:21:35.788224 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:21:35 crc kubenswrapper[5120]: I0316 16:21:35.789445 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd6718c5-d778-4991-bc8e-de0989c82299" containerName="ceilometer-notification-agent" Mar 16 16:21:35 crc kubenswrapper[5120]: I0316 16:21:35.789471 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd6718c5-d778-4991-bc8e-de0989c82299" containerName="ceilometer-notification-agent" Mar 16 16:21:35 crc kubenswrapper[5120]: I0316 16:21:35.789484 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd6718c5-d778-4991-bc8e-de0989c82299" containerName="ceilometer-central-agent" Mar 16 16:21:35 crc kubenswrapper[5120]: I0316 16:21:35.789490 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd6718c5-d778-4991-bc8e-de0989c82299" containerName="ceilometer-central-agent" Mar 16 16:21:35 crc kubenswrapper[5120]: I0316 16:21:35.789505 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd6718c5-d778-4991-bc8e-de0989c82299" containerName="sg-core" Mar 16 16:21:35 crc kubenswrapper[5120]: I0316 16:21:35.789511 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd6718c5-d778-4991-bc8e-de0989c82299" containerName="sg-core" Mar 16 16:21:35 crc kubenswrapper[5120]: I0316 16:21:35.789529 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd6718c5-d778-4991-bc8e-de0989c82299" containerName="proxy-httpd" Mar 16 16:21:35 crc kubenswrapper[5120]: I0316 16:21:35.789534 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd6718c5-d778-4991-bc8e-de0989c82299" containerName="proxy-httpd" Mar 16 16:21:35 crc kubenswrapper[5120]: I0316 16:21:35.789725 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="bd6718c5-d778-4991-bc8e-de0989c82299" containerName="proxy-httpd" Mar 16 16:21:35 crc kubenswrapper[5120]: I0316 16:21:35.789746 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="bd6718c5-d778-4991-bc8e-de0989c82299" containerName="ceilometer-notification-agent" Mar 16 16:21:35 crc kubenswrapper[5120]: I0316 16:21:35.789797 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="bd6718c5-d778-4991-bc8e-de0989c82299" containerName="ceilometer-central-agent" Mar 16 16:21:35 crc kubenswrapper[5120]: I0316 16:21:35.789813 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="bd6718c5-d778-4991-bc8e-de0989c82299" containerName="sg-core" Mar 16 16:21:35 crc kubenswrapper[5120]: I0316 16:21:35.799823 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:21:35 crc kubenswrapper[5120]: I0316 16:21:35.800009 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:21:35 crc kubenswrapper[5120]: I0316 16:21:35.809822 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 16:21:35 crc kubenswrapper[5120]: I0316 16:21:35.810274 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 16:21:35 crc kubenswrapper[5120]: I0316 16:21:35.824267 5120 scope.go:117] "RemoveContainer" containerID="9e17fdd369ba7374abf0d212cd6d7f5d289a260a0de7cfccd3c61cc1b45d2cf4" Mar 16 16:21:35 crc kubenswrapper[5120]: I0316 16:21:35.921986 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pt6nf\" (UniqueName: \"kubernetes.io/projected/ee06fc7a-e571-4eec-b5fd-309e6dc0eab0-kube-api-access-pt6nf\") pod \"ceilometer-0\" (UID: \"ee06fc7a-e571-4eec-b5fd-309e6dc0eab0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:21:35 crc kubenswrapper[5120]: I0316 16:21:35.922069 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/ee06fc7a-e571-4eec-b5fd-309e6dc0eab0-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"ee06fc7a-e571-4eec-b5fd-309e6dc0eab0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:21:35 crc kubenswrapper[5120]: I0316 16:21:35.922094 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ee06fc7a-e571-4eec-b5fd-309e6dc0eab0-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"ee06fc7a-e571-4eec-b5fd-309e6dc0eab0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:21:35 crc kubenswrapper[5120]: I0316 16:21:35.922111 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ee06fc7a-e571-4eec-b5fd-309e6dc0eab0-run-httpd\") pod \"ceilometer-0\" (UID: \"ee06fc7a-e571-4eec-b5fd-309e6dc0eab0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:21:35 crc kubenswrapper[5120]: I0316 16:21:35.922176 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ee06fc7a-e571-4eec-b5fd-309e6dc0eab0-log-httpd\") pod \"ceilometer-0\" (UID: \"ee06fc7a-e571-4eec-b5fd-309e6dc0eab0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:21:35 crc kubenswrapper[5120]: I0316 16:21:35.922196 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ee06fc7a-e571-4eec-b5fd-309e6dc0eab0-config-data\") pod \"ceilometer-0\" (UID: \"ee06fc7a-e571-4eec-b5fd-309e6dc0eab0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:21:35 crc kubenswrapper[5120]: I0316 16:21:35.922227 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ee06fc7a-e571-4eec-b5fd-309e6dc0eab0-scripts\") pod \"ceilometer-0\" (UID: \"ee06fc7a-e571-4eec-b5fd-309e6dc0eab0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:21:36 crc kubenswrapper[5120]: I0316 16:21:36.024400 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pt6nf\" (UniqueName: \"kubernetes.io/projected/ee06fc7a-e571-4eec-b5fd-309e6dc0eab0-kube-api-access-pt6nf\") pod \"ceilometer-0\" (UID: \"ee06fc7a-e571-4eec-b5fd-309e6dc0eab0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:21:36 crc kubenswrapper[5120]: I0316 16:21:36.024574 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/ee06fc7a-e571-4eec-b5fd-309e6dc0eab0-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"ee06fc7a-e571-4eec-b5fd-309e6dc0eab0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:21:36 crc kubenswrapper[5120]: I0316 16:21:36.024613 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ee06fc7a-e571-4eec-b5fd-309e6dc0eab0-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"ee06fc7a-e571-4eec-b5fd-309e6dc0eab0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:21:36 crc kubenswrapper[5120]: I0316 16:21:36.024633 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ee06fc7a-e571-4eec-b5fd-309e6dc0eab0-run-httpd\") pod \"ceilometer-0\" (UID: \"ee06fc7a-e571-4eec-b5fd-309e6dc0eab0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:21:36 crc kubenswrapper[5120]: I0316 16:21:36.024835 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ee06fc7a-e571-4eec-b5fd-309e6dc0eab0-log-httpd\") pod \"ceilometer-0\" (UID: \"ee06fc7a-e571-4eec-b5fd-309e6dc0eab0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:21:36 crc kubenswrapper[5120]: I0316 16:21:36.024892 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ee06fc7a-e571-4eec-b5fd-309e6dc0eab0-config-data\") pod \"ceilometer-0\" (UID: \"ee06fc7a-e571-4eec-b5fd-309e6dc0eab0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:21:36 crc kubenswrapper[5120]: I0316 16:21:36.024948 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ee06fc7a-e571-4eec-b5fd-309e6dc0eab0-scripts\") pod \"ceilometer-0\" (UID: \"ee06fc7a-e571-4eec-b5fd-309e6dc0eab0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:21:36 crc kubenswrapper[5120]: I0316 16:21:36.025813 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ee06fc7a-e571-4eec-b5fd-309e6dc0eab0-log-httpd\") pod \"ceilometer-0\" (UID: \"ee06fc7a-e571-4eec-b5fd-309e6dc0eab0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:21:36 crc kubenswrapper[5120]: I0316 16:21:36.025847 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ee06fc7a-e571-4eec-b5fd-309e6dc0eab0-run-httpd\") pod \"ceilometer-0\" (UID: \"ee06fc7a-e571-4eec-b5fd-309e6dc0eab0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:21:36 crc kubenswrapper[5120]: I0316 16:21:36.030742 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ee06fc7a-e571-4eec-b5fd-309e6dc0eab0-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"ee06fc7a-e571-4eec-b5fd-309e6dc0eab0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:21:36 crc kubenswrapper[5120]: I0316 16:21:36.031078 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ee06fc7a-e571-4eec-b5fd-309e6dc0eab0-scripts\") pod \"ceilometer-0\" (UID: \"ee06fc7a-e571-4eec-b5fd-309e6dc0eab0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:21:36 crc kubenswrapper[5120]: I0316 16:21:36.031645 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ee06fc7a-e571-4eec-b5fd-309e6dc0eab0-config-data\") pod \"ceilometer-0\" (UID: \"ee06fc7a-e571-4eec-b5fd-309e6dc0eab0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:21:36 crc kubenswrapper[5120]: I0316 16:21:36.032383 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/ee06fc7a-e571-4eec-b5fd-309e6dc0eab0-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"ee06fc7a-e571-4eec-b5fd-309e6dc0eab0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:21:36 crc kubenswrapper[5120]: I0316 16:21:36.042683 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pt6nf\" (UniqueName: \"kubernetes.io/projected/ee06fc7a-e571-4eec-b5fd-309e6dc0eab0-kube-api-access-pt6nf\") pod \"ceilometer-0\" (UID: \"ee06fc7a-e571-4eec-b5fd-309e6dc0eab0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:21:36 crc kubenswrapper[5120]: I0316 16:21:36.130538 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:21:36 crc kubenswrapper[5120]: I0316 16:21:36.167307 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:21:36 crc kubenswrapper[5120]: I0316 16:21:36.244989 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:21:36 crc kubenswrapper[5120]: I0316 16:21:36.519625 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/watcher-api-0" podUID="d8c78a81-c746-4232-9442-b648cd62f793" containerName="watcher-api" probeResult="failure" output="Get \"http://10.217.1.84:9322/\": read tcp 10.217.0.2:41246->10.217.1.84:9322: read: connection reset by peer" Mar 16 16:21:36 crc kubenswrapper[5120]: I0316 16:21:36.519720 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/watcher-api-0" podUID="d8c78a81-c746-4232-9442-b648cd62f793" containerName="watcher-api-log" probeResult="failure" output="Get \"http://10.217.1.84:9322/\": read tcp 10.217.0.2:41262->10.217.1.84:9322: read: connection reset by peer" Mar 16 16:21:36 crc kubenswrapper[5120]: I0316 16:21:36.617460 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:21:36 crc kubenswrapper[5120]: I0316 16:21:36.666218 5120 generic.go:358] "Generic (PLEG): container finished" podID="d8c78a81-c746-4232-9442-b648cd62f793" containerID="008f86bac563fd795b6d052b49f36b99f8c0a7f375500d7650f25046727052f9" exitCode=0 Mar 16 16:21:36 crc kubenswrapper[5120]: I0316 16:21:36.675267 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bd6718c5-d778-4991-bc8e-de0989c82299" path="/var/lib/kubelet/pods/bd6718c5-d778-4991-bc8e-de0989c82299/volumes" Mar 16 16:21:36 crc kubenswrapper[5120]: I0316 16:21:36.676076 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/watcher-api-0" event={"ID":"d8c78a81-c746-4232-9442-b648cd62f793","Type":"ContainerDied","Data":"008f86bac563fd795b6d052b49f36b99f8c0a7f375500d7650f25046727052f9"} Mar 16 16:21:36 crc kubenswrapper[5120]: I0316 16:21:36.676386 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"7ea8cd10-4026-4603-a76b-b26ebe185441","Type":"ContainerStarted","Data":"2a90a1b43864b07de00f6e1d407ba798daf32a8248e46043a557119db32aff1d"} Mar 16 16:21:36 crc kubenswrapper[5120]: I0316 16:21:36.676519 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:21:36 crc kubenswrapper[5120]: I0316 16:21:36.678090 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ee06fc7a-e571-4eec-b5fd-309e6dc0eab0","Type":"ContainerStarted","Data":"f7111c41626c24aef2984abecb90e0921c7d924c99083388cc4f18e63f2f8e0c"} Mar 16 16:21:36 crc kubenswrapper[5120]: I0316 16:21:36.680233 5120 generic.go:358] "Generic (PLEG): container finished" podID="3bb21f28-1bc0-402f-b18b-f29c0b834174" containerID="2bd625cf02e831d748d79a2a782e6ca939c530254b7265a4d6bdb18f7d957ea4" exitCode=143 Mar 16 16:21:36 crc kubenswrapper[5120]: I0316 16:21:36.680323 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-756f865fd6-cllz7" event={"ID":"3bb21f28-1bc0-402f-b18b-f29c0b834174","Type":"ContainerDied","Data":"2bd625cf02e831d748d79a2a782e6ca939c530254b7265a4d6bdb18f7d957ea4"} Mar 16 16:21:36 crc kubenswrapper[5120]: I0316 16:21:36.682663 5120 generic.go:358] "Generic (PLEG): container finished" podID="61e41544-dcc8-47cf-8a6e-45b053ae0f9e" containerID="da371751a76a30f178eff06cf80fbc0812228b79e3637d23b403035295bb62ee" exitCode=143 Mar 16 16:21:36 crc kubenswrapper[5120]: I0316 16:21:36.683034 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="88c05a13-c1ef-4aee-9a86-d91a80dc4af5" containerName="cinder-scheduler" containerID="cri-o://414e348b57743afdaf5beba40c4475103cb2bdc3704e717970a712c80b675463" gracePeriod=30 Mar 16 16:21:36 crc kubenswrapper[5120]: I0316 16:21:36.683245 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-5ffd6f596c-m52jd" event={"ID":"61e41544-dcc8-47cf-8a6e-45b053ae0f9e","Type":"ContainerDied","Data":"da371751a76a30f178eff06cf80fbc0812228b79e3637d23b403035295bb62ee"} Mar 16 16:21:36 crc kubenswrapper[5120]: I0316 16:21:36.685165 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="88c05a13-c1ef-4aee-9a86-d91a80dc4af5" containerName="probe" containerID="cri-o://d75f51f85be5c791208584f47eac49d55ec6339fcfb949515777db7507334633" gracePeriod=30 Mar 16 16:21:36 crc kubenswrapper[5120]: I0316 16:21:36.736295 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-api-0" podStartSLOduration=5.736278096 podStartE2EDuration="5.736278096s" podCreationTimestamp="2026-03-16 16:21:31 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:21:36.72669234 +0000 UTC m=+2998.880623997" watchObservedRunningTime="2026-03-16 16:21:36.736278096 +0000 UTC m=+2998.890209753" Mar 16 16:21:37 crc kubenswrapper[5120]: I0316 16:21:37.014568 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/watcher-api-0" Mar 16 16:21:37 crc kubenswrapper[5120]: I0316 16:21:37.156705 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"custom-prometheus-ca\" (UniqueName: \"kubernetes.io/secret/d8c78a81-c746-4232-9442-b648cd62f793-custom-prometheus-ca\") pod \"d8c78a81-c746-4232-9442-b648cd62f793\" (UID: \"d8c78a81-c746-4232-9442-b648cd62f793\") " Mar 16 16:21:37 crc kubenswrapper[5120]: I0316 16:21:37.156805 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d8c78a81-c746-4232-9442-b648cd62f793-combined-ca-bundle\") pod \"d8c78a81-c746-4232-9442-b648cd62f793\" (UID: \"d8c78a81-c746-4232-9442-b648cd62f793\") " Mar 16 16:21:37 crc kubenswrapper[5120]: I0316 16:21:37.156924 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d8c78a81-c746-4232-9442-b648cd62f793-config-data\") pod \"d8c78a81-c746-4232-9442-b648cd62f793\" (UID: \"d8c78a81-c746-4232-9442-b648cd62f793\") " Mar 16 16:21:37 crc kubenswrapper[5120]: I0316 16:21:37.157097 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-42rg4\" (UniqueName: \"kubernetes.io/projected/d8c78a81-c746-4232-9442-b648cd62f793-kube-api-access-42rg4\") pod \"d8c78a81-c746-4232-9442-b648cd62f793\" (UID: \"d8c78a81-c746-4232-9442-b648cd62f793\") " Mar 16 16:21:37 crc kubenswrapper[5120]: I0316 16:21:37.157206 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d8c78a81-c746-4232-9442-b648cd62f793-logs\") pod \"d8c78a81-c746-4232-9442-b648cd62f793\" (UID: \"d8c78a81-c746-4232-9442-b648cd62f793\") " Mar 16 16:21:37 crc kubenswrapper[5120]: I0316 16:21:37.158005 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8c78a81-c746-4232-9442-b648cd62f793-logs" (OuterVolumeSpecName: "logs") pod "d8c78a81-c746-4232-9442-b648cd62f793" (UID: "d8c78a81-c746-4232-9442-b648cd62f793"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:21:37 crc kubenswrapper[5120]: I0316 16:21:37.161376 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8c78a81-c746-4232-9442-b648cd62f793-kube-api-access-42rg4" (OuterVolumeSpecName: "kube-api-access-42rg4") pod "d8c78a81-c746-4232-9442-b648cd62f793" (UID: "d8c78a81-c746-4232-9442-b648cd62f793"). InnerVolumeSpecName "kube-api-access-42rg4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:21:37 crc kubenswrapper[5120]: I0316 16:21:37.195549 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d8c78a81-c746-4232-9442-b648cd62f793-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "d8c78a81-c746-4232-9442-b648cd62f793" (UID: "d8c78a81-c746-4232-9442-b648cd62f793"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:21:37 crc kubenswrapper[5120]: I0316 16:21:37.196181 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d8c78a81-c746-4232-9442-b648cd62f793-custom-prometheus-ca" (OuterVolumeSpecName: "custom-prometheus-ca") pod "d8c78a81-c746-4232-9442-b648cd62f793" (UID: "d8c78a81-c746-4232-9442-b648cd62f793"). InnerVolumeSpecName "custom-prometheus-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:21:37 crc kubenswrapper[5120]: I0316 16:21:37.261587 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-42rg4\" (UniqueName: \"kubernetes.io/projected/d8c78a81-c746-4232-9442-b648cd62f793-kube-api-access-42rg4\") on node \"crc\" DevicePath \"\"" Mar 16 16:21:37 crc kubenswrapper[5120]: I0316 16:21:37.261619 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d8c78a81-c746-4232-9442-b648cd62f793-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:21:37 crc kubenswrapper[5120]: I0316 16:21:37.261630 5120 reconciler_common.go:299] "Volume detached for volume \"custom-prometheus-ca\" (UniqueName: \"kubernetes.io/secret/d8c78a81-c746-4232-9442-b648cd62f793-custom-prometheus-ca\") on node \"crc\" DevicePath \"\"" Mar 16 16:21:37 crc kubenswrapper[5120]: I0316 16:21:37.261640 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d8c78a81-c746-4232-9442-b648cd62f793-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:21:37 crc kubenswrapper[5120]: I0316 16:21:37.262776 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d8c78a81-c746-4232-9442-b648cd62f793-config-data" (OuterVolumeSpecName: "config-data") pod "d8c78a81-c746-4232-9442-b648cd62f793" (UID: "d8c78a81-c746-4232-9442-b648cd62f793"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:21:37 crc kubenswrapper[5120]: I0316 16:21:37.363991 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d8c78a81-c746-4232-9442-b648cd62f793-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:21:37 crc kubenswrapper[5120]: I0316 16:21:37.694803 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/watcher-api-0" event={"ID":"d8c78a81-c746-4232-9442-b648cd62f793","Type":"ContainerDied","Data":"e0bde5007f86a7642e8e3befaab5f2a103863a01281cef12dc9b52fb8e5a08a1"} Mar 16 16:21:37 crc kubenswrapper[5120]: I0316 16:21:37.694839 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/watcher-api-0" Mar 16 16:21:37 crc kubenswrapper[5120]: I0316 16:21:37.694881 5120 scope.go:117] "RemoveContainer" containerID="008f86bac563fd795b6d052b49f36b99f8c0a7f375500d7650f25046727052f9" Mar 16 16:21:37 crc kubenswrapper[5120]: I0316 16:21:37.698209 5120 generic.go:358] "Generic (PLEG): container finished" podID="88c05a13-c1ef-4aee-9a86-d91a80dc4af5" containerID="d75f51f85be5c791208584f47eac49d55ec6339fcfb949515777db7507334633" exitCode=0 Mar 16 16:21:37 crc kubenswrapper[5120]: I0316 16:21:37.698298 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"88c05a13-c1ef-4aee-9a86-d91a80dc4af5","Type":"ContainerDied","Data":"d75f51f85be5c791208584f47eac49d55ec6339fcfb949515777db7507334633"} Mar 16 16:21:37 crc kubenswrapper[5120]: I0316 16:21:37.700112 5120 generic.go:358] "Generic (PLEG): container finished" podID="4b4fb783-c7b1-4688-b793-d3ae04edc806" containerID="a0563243f791daf4df3d95b328fc12ff620a6cbda02c76fafaea3cd34b4b0a44" exitCode=0 Mar 16 16:21:37 crc kubenswrapper[5120]: I0316 16:21:37.700146 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-vt87c" event={"ID":"4b4fb783-c7b1-4688-b793-d3ae04edc806","Type":"ContainerDied","Data":"a0563243f791daf4df3d95b328fc12ff620a6cbda02c76fafaea3cd34b4b0a44"} Mar 16 16:21:37 crc kubenswrapper[5120]: I0316 16:21:37.703186 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ee06fc7a-e571-4eec-b5fd-309e6dc0eab0","Type":"ContainerStarted","Data":"817a9125e991fa96016aa25ce1eb23576e854327114f49e01facd964dafe5bf6"} Mar 16 16:21:37 crc kubenswrapper[5120]: I0316 16:21:37.726188 5120 scope.go:117] "RemoveContainer" containerID="0677d5b267cbda865c96b1c31d7cbe94dc0a9c10de34337ed831ef8b24b15834" Mar 16 16:21:37 crc kubenswrapper[5120]: I0316 16:21:37.755383 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/watcher-api-0"] Mar 16 16:21:37 crc kubenswrapper[5120]: I0316 16:21:37.770826 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/watcher-api-0"] Mar 16 16:21:37 crc kubenswrapper[5120]: I0316 16:21:37.833816 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/watcher-api-0"] Mar 16 16:21:37 crc kubenswrapper[5120]: I0316 16:21:37.836531 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8c78a81-c746-4232-9442-b648cd62f793" containerName="watcher-api" Mar 16 16:21:37 crc kubenswrapper[5120]: I0316 16:21:37.836557 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8c78a81-c746-4232-9442-b648cd62f793" containerName="watcher-api" Mar 16 16:21:37 crc kubenswrapper[5120]: I0316 16:21:37.836575 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8c78a81-c746-4232-9442-b648cd62f793" containerName="watcher-api-log" Mar 16 16:21:37 crc kubenswrapper[5120]: I0316 16:21:37.836583 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8c78a81-c746-4232-9442-b648cd62f793" containerName="watcher-api-log" Mar 16 16:21:37 crc kubenswrapper[5120]: I0316 16:21:37.836819 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="d8c78a81-c746-4232-9442-b648cd62f793" containerName="watcher-api" Mar 16 16:21:37 crc kubenswrapper[5120]: I0316 16:21:37.836844 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="d8c78a81-c746-4232-9442-b648cd62f793" containerName="watcher-api-log" Mar 16 16:21:37 crc kubenswrapper[5120]: I0316 16:21:37.843385 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/watcher-api-0" Mar 16 16:21:37 crc kubenswrapper[5120]: I0316 16:21:37.845732 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"watcher-api-config-data\"" Mar 16 16:21:37 crc kubenswrapper[5120]: I0316 16:21:37.847056 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-watcher-public-svc\"" Mar 16 16:21:37 crc kubenswrapper[5120]: I0316 16:21:37.848199 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-watcher-internal-svc\"" Mar 16 16:21:37 crc kubenswrapper[5120]: I0316 16:21:37.852726 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/watcher-api-0"] Mar 16 16:21:37 crc kubenswrapper[5120]: I0316 16:21:37.981419 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e15efd1b-6aa8-4a24-b576-4e03e19e19d0-logs\") pod \"watcher-api-0\" (UID: \"e15efd1b-6aa8-4a24-b576-4e03e19e19d0\") " pod="openstack-kuttl-tests/watcher-api-0" Mar 16 16:21:37 crc kubenswrapper[5120]: I0316 16:21:37.981574 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e15efd1b-6aa8-4a24-b576-4e03e19e19d0-public-tls-certs\") pod \"watcher-api-0\" (UID: \"e15efd1b-6aa8-4a24-b576-4e03e19e19d0\") " pod="openstack-kuttl-tests/watcher-api-0" Mar 16 16:21:37 crc kubenswrapper[5120]: I0316 16:21:37.981915 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"custom-prometheus-ca\" (UniqueName: \"kubernetes.io/secret/e15efd1b-6aa8-4a24-b576-4e03e19e19d0-custom-prometheus-ca\") pod \"watcher-api-0\" (UID: \"e15efd1b-6aa8-4a24-b576-4e03e19e19d0\") " pod="openstack-kuttl-tests/watcher-api-0" Mar 16 16:21:37 crc kubenswrapper[5120]: I0316 16:21:37.982407 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e15efd1b-6aa8-4a24-b576-4e03e19e19d0-internal-tls-certs\") pod \"watcher-api-0\" (UID: \"e15efd1b-6aa8-4a24-b576-4e03e19e19d0\") " pod="openstack-kuttl-tests/watcher-api-0" Mar 16 16:21:37 crc kubenswrapper[5120]: I0316 16:21:37.982612 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e15efd1b-6aa8-4a24-b576-4e03e19e19d0-config-data\") pod \"watcher-api-0\" (UID: \"e15efd1b-6aa8-4a24-b576-4e03e19e19d0\") " pod="openstack-kuttl-tests/watcher-api-0" Mar 16 16:21:37 crc kubenswrapper[5120]: I0316 16:21:37.982694 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8bb9\" (UniqueName: \"kubernetes.io/projected/e15efd1b-6aa8-4a24-b576-4e03e19e19d0-kube-api-access-t8bb9\") pod \"watcher-api-0\" (UID: \"e15efd1b-6aa8-4a24-b576-4e03e19e19d0\") " pod="openstack-kuttl-tests/watcher-api-0" Mar 16 16:21:37 crc kubenswrapper[5120]: I0316 16:21:37.982852 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e15efd1b-6aa8-4a24-b576-4e03e19e19d0-combined-ca-bundle\") pod \"watcher-api-0\" (UID: \"e15efd1b-6aa8-4a24-b576-4e03e19e19d0\") " pod="openstack-kuttl-tests/watcher-api-0" Mar 16 16:21:38 crc kubenswrapper[5120]: I0316 16:21:38.081815 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-6b946b9c94-hvvmv" podUID="cc082deb-bc44-4949-95e5-f6a9ece6220c" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.1.93:9311/healthcheck\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Mar 16 16:21:38 crc kubenswrapper[5120]: I0316 16:21:38.082064 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-6b946b9c94-hvvmv" podUID="cc082deb-bc44-4949-95e5-f6a9ece6220c" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.1.93:9311/healthcheck\": context deadline exceeded" Mar 16 16:21:38 crc kubenswrapper[5120]: I0316 16:21:38.086297 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"custom-prometheus-ca\" (UniqueName: \"kubernetes.io/secret/e15efd1b-6aa8-4a24-b576-4e03e19e19d0-custom-prometheus-ca\") pod \"watcher-api-0\" (UID: \"e15efd1b-6aa8-4a24-b576-4e03e19e19d0\") " pod="openstack-kuttl-tests/watcher-api-0" Mar 16 16:21:38 crc kubenswrapper[5120]: I0316 16:21:38.086472 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e15efd1b-6aa8-4a24-b576-4e03e19e19d0-internal-tls-certs\") pod \"watcher-api-0\" (UID: \"e15efd1b-6aa8-4a24-b576-4e03e19e19d0\") " pod="openstack-kuttl-tests/watcher-api-0" Mar 16 16:21:38 crc kubenswrapper[5120]: I0316 16:21:38.086517 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e15efd1b-6aa8-4a24-b576-4e03e19e19d0-config-data\") pod \"watcher-api-0\" (UID: \"e15efd1b-6aa8-4a24-b576-4e03e19e19d0\") " pod="openstack-kuttl-tests/watcher-api-0" Mar 16 16:21:38 crc kubenswrapper[5120]: I0316 16:21:38.086556 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t8bb9\" (UniqueName: \"kubernetes.io/projected/e15efd1b-6aa8-4a24-b576-4e03e19e19d0-kube-api-access-t8bb9\") pod \"watcher-api-0\" (UID: \"e15efd1b-6aa8-4a24-b576-4e03e19e19d0\") " pod="openstack-kuttl-tests/watcher-api-0" Mar 16 16:21:38 crc kubenswrapper[5120]: I0316 16:21:38.086590 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e15efd1b-6aa8-4a24-b576-4e03e19e19d0-combined-ca-bundle\") pod \"watcher-api-0\" (UID: \"e15efd1b-6aa8-4a24-b576-4e03e19e19d0\") " pod="openstack-kuttl-tests/watcher-api-0" Mar 16 16:21:38 crc kubenswrapper[5120]: I0316 16:21:38.086650 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e15efd1b-6aa8-4a24-b576-4e03e19e19d0-logs\") pod \"watcher-api-0\" (UID: \"e15efd1b-6aa8-4a24-b576-4e03e19e19d0\") " pod="openstack-kuttl-tests/watcher-api-0" Mar 16 16:21:38 crc kubenswrapper[5120]: I0316 16:21:38.086681 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e15efd1b-6aa8-4a24-b576-4e03e19e19d0-public-tls-certs\") pod \"watcher-api-0\" (UID: \"e15efd1b-6aa8-4a24-b576-4e03e19e19d0\") " pod="openstack-kuttl-tests/watcher-api-0" Mar 16 16:21:38 crc kubenswrapper[5120]: I0316 16:21:38.090792 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e15efd1b-6aa8-4a24-b576-4e03e19e19d0-logs\") pod \"watcher-api-0\" (UID: \"e15efd1b-6aa8-4a24-b576-4e03e19e19d0\") " pod="openstack-kuttl-tests/watcher-api-0" Mar 16 16:21:38 crc kubenswrapper[5120]: I0316 16:21:38.093359 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e15efd1b-6aa8-4a24-b576-4e03e19e19d0-public-tls-certs\") pod \"watcher-api-0\" (UID: \"e15efd1b-6aa8-4a24-b576-4e03e19e19d0\") " pod="openstack-kuttl-tests/watcher-api-0" Mar 16 16:21:38 crc kubenswrapper[5120]: I0316 16:21:38.093377 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"custom-prometheus-ca\" (UniqueName: \"kubernetes.io/secret/e15efd1b-6aa8-4a24-b576-4e03e19e19d0-custom-prometheus-ca\") pod \"watcher-api-0\" (UID: \"e15efd1b-6aa8-4a24-b576-4e03e19e19d0\") " pod="openstack-kuttl-tests/watcher-api-0" Mar 16 16:21:38 crc kubenswrapper[5120]: I0316 16:21:38.094309 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e15efd1b-6aa8-4a24-b576-4e03e19e19d0-combined-ca-bundle\") pod \"watcher-api-0\" (UID: \"e15efd1b-6aa8-4a24-b576-4e03e19e19d0\") " pod="openstack-kuttl-tests/watcher-api-0" Mar 16 16:21:38 crc kubenswrapper[5120]: I0316 16:21:38.095726 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e15efd1b-6aa8-4a24-b576-4e03e19e19d0-config-data\") pod \"watcher-api-0\" (UID: \"e15efd1b-6aa8-4a24-b576-4e03e19e19d0\") " pod="openstack-kuttl-tests/watcher-api-0" Mar 16 16:21:38 crc kubenswrapper[5120]: I0316 16:21:38.096483 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e15efd1b-6aa8-4a24-b576-4e03e19e19d0-internal-tls-certs\") pod \"watcher-api-0\" (UID: \"e15efd1b-6aa8-4a24-b576-4e03e19e19d0\") " pod="openstack-kuttl-tests/watcher-api-0" Mar 16 16:21:38 crc kubenswrapper[5120]: I0316 16:21:38.106512 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8bb9\" (UniqueName: \"kubernetes.io/projected/e15efd1b-6aa8-4a24-b576-4e03e19e19d0-kube-api-access-t8bb9\") pod \"watcher-api-0\" (UID: \"e15efd1b-6aa8-4a24-b576-4e03e19e19d0\") " pod="openstack-kuttl-tests/watcher-api-0" Mar 16 16:21:38 crc kubenswrapper[5120]: I0316 16:21:38.169270 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/watcher-api-0" Mar 16 16:21:38 crc kubenswrapper[5120]: I0316 16:21:38.515380 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-6b946b9c94-hvvmv" podUID="cc082deb-bc44-4949-95e5-f6a9ece6220c" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.1.93:9311/healthcheck\": read tcp 10.217.0.2:45524->10.217.1.93:9311: read: connection reset by peer" Mar 16 16:21:38 crc kubenswrapper[5120]: I0316 16:21:38.515389 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-6b946b9c94-hvvmv" podUID="cc082deb-bc44-4949-95e5-f6a9ece6220c" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.1.93:9311/healthcheck\": read tcp 10.217.0.2:45520->10.217.1.93:9311: read: connection reset by peer" Mar 16 16:21:38 crc kubenswrapper[5120]: I0316 16:21:38.658194 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/watcher-api-0"] Mar 16 16:21:38 crc kubenswrapper[5120]: I0316 16:21:38.695916 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d8c78a81-c746-4232-9442-b648cd62f793" path="/var/lib/kubelet/pods/d8c78a81-c746-4232-9442-b648cd62f793/volumes" Mar 16 16:21:38 crc kubenswrapper[5120]: I0316 16:21:38.742277 5120 generic.go:358] "Generic (PLEG): container finished" podID="cc082deb-bc44-4949-95e5-f6a9ece6220c" containerID="d5aaa29de71f9506edf61c52ff902611842cbc3ad6e5f2ae70727afe76f85f25" exitCode=0 Mar 16 16:21:38 crc kubenswrapper[5120]: I0316 16:21:38.742710 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-6b946b9c94-hvvmv" event={"ID":"cc082deb-bc44-4949-95e5-f6a9ece6220c","Type":"ContainerDied","Data":"d5aaa29de71f9506edf61c52ff902611842cbc3ad6e5f2ae70727afe76f85f25"} Mar 16 16:21:38 crc kubenswrapper[5120]: I0316 16:21:38.752075 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ee06fc7a-e571-4eec-b5fd-309e6dc0eab0","Type":"ContainerStarted","Data":"22611112d9fac7d25e08fe02853f61e8b92fd841dfbdd5030d5230aebc23c203"} Mar 16 16:21:38 crc kubenswrapper[5120]: I0316 16:21:38.753855 5120 generic.go:358] "Generic (PLEG): container finished" podID="3bb21f28-1bc0-402f-b18b-f29c0b834174" containerID="c1d44c9bc92ca9945715186ad30c605d1106f5afd0d5347a1f091e01c268412c" exitCode=0 Mar 16 16:21:38 crc kubenswrapper[5120]: I0316 16:21:38.753948 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-756f865fd6-cllz7" event={"ID":"3bb21f28-1bc0-402f-b18b-f29c0b834174","Type":"ContainerDied","Data":"c1d44c9bc92ca9945715186ad30c605d1106f5afd0d5347a1f091e01c268412c"} Mar 16 16:21:38 crc kubenswrapper[5120]: I0316 16:21:38.756465 5120 generic.go:358] "Generic (PLEG): container finished" podID="61e41544-dcc8-47cf-8a6e-45b053ae0f9e" containerID="eb0d8a6546028f00924b876961e7377e8be7061907902ffda27871c0c53fa378" exitCode=0 Mar 16 16:21:38 crc kubenswrapper[5120]: I0316 16:21:38.756656 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-5ffd6f596c-m52jd" event={"ID":"61e41544-dcc8-47cf-8a6e-45b053ae0f9e","Type":"ContainerDied","Data":"eb0d8a6546028f00924b876961e7377e8be7061907902ffda27871c0c53fa378"} Mar 16 16:21:38 crc kubenswrapper[5120]: I0316 16:21:38.972316 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-756f865fd6-cllz7" Mar 16 16:21:39 crc kubenswrapper[5120]: I0316 16:21:39.019363 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3bb21f28-1bc0-402f-b18b-f29c0b834174-logs\") pod \"3bb21f28-1bc0-402f-b18b-f29c0b834174\" (UID: \"3bb21f28-1bc0-402f-b18b-f29c0b834174\") " Mar 16 16:21:39 crc kubenswrapper[5120]: I0316 16:21:39.019436 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/3bb21f28-1bc0-402f-b18b-f29c0b834174-config-data-custom\") pod \"3bb21f28-1bc0-402f-b18b-f29c0b834174\" (UID: \"3bb21f28-1bc0-402f-b18b-f29c0b834174\") " Mar 16 16:21:39 crc kubenswrapper[5120]: I0316 16:21:39.019567 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4spd9\" (UniqueName: \"kubernetes.io/projected/3bb21f28-1bc0-402f-b18b-f29c0b834174-kube-api-access-4spd9\") pod \"3bb21f28-1bc0-402f-b18b-f29c0b834174\" (UID: \"3bb21f28-1bc0-402f-b18b-f29c0b834174\") " Mar 16 16:21:39 crc kubenswrapper[5120]: I0316 16:21:39.019604 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3bb21f28-1bc0-402f-b18b-f29c0b834174-config-data\") pod \"3bb21f28-1bc0-402f-b18b-f29c0b834174\" (UID: \"3bb21f28-1bc0-402f-b18b-f29c0b834174\") " Mar 16 16:21:39 crc kubenswrapper[5120]: I0316 16:21:39.019627 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3bb21f28-1bc0-402f-b18b-f29c0b834174-combined-ca-bundle\") pod \"3bb21f28-1bc0-402f-b18b-f29c0b834174\" (UID: \"3bb21f28-1bc0-402f-b18b-f29c0b834174\") " Mar 16 16:21:39 crc kubenswrapper[5120]: I0316 16:21:39.028813 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3bb21f28-1bc0-402f-b18b-f29c0b834174-logs" (OuterVolumeSpecName: "logs") pod "3bb21f28-1bc0-402f-b18b-f29c0b834174" (UID: "3bb21f28-1bc0-402f-b18b-f29c0b834174"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:21:39 crc kubenswrapper[5120]: I0316 16:21:39.031149 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3bb21f28-1bc0-402f-b18b-f29c0b834174-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "3bb21f28-1bc0-402f-b18b-f29c0b834174" (UID: "3bb21f28-1bc0-402f-b18b-f29c0b834174"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:21:39 crc kubenswrapper[5120]: I0316 16:21:39.031549 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3bb21f28-1bc0-402f-b18b-f29c0b834174-kube-api-access-4spd9" (OuterVolumeSpecName: "kube-api-access-4spd9") pod "3bb21f28-1bc0-402f-b18b-f29c0b834174" (UID: "3bb21f28-1bc0-402f-b18b-f29c0b834174"). InnerVolumeSpecName "kube-api-access-4spd9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:21:39 crc kubenswrapper[5120]: I0316 16:21:39.059453 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3bb21f28-1bc0-402f-b18b-f29c0b834174-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "3bb21f28-1bc0-402f-b18b-f29c0b834174" (UID: "3bb21f28-1bc0-402f-b18b-f29c0b834174"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:21:39 crc kubenswrapper[5120]: I0316 16:21:39.080058 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3bb21f28-1bc0-402f-b18b-f29c0b834174-config-data" (OuterVolumeSpecName: "config-data") pod "3bb21f28-1bc0-402f-b18b-f29c0b834174" (UID: "3bb21f28-1bc0-402f-b18b-f29c0b834174"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:21:39 crc kubenswrapper[5120]: I0316 16:21:39.082115 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-6b946b9c94-hvvmv" Mar 16 16:21:39 crc kubenswrapper[5120]: I0316 16:21:39.115467 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-5ffd6f596c-m52jd" Mar 16 16:21:39 crc kubenswrapper[5120]: I0316 16:21:39.121401 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cc082deb-bc44-4949-95e5-f6a9ece6220c-config-data\") pod \"cc082deb-bc44-4949-95e5-f6a9ece6220c\" (UID: \"cc082deb-bc44-4949-95e5-f6a9ece6220c\") " Mar 16 16:21:39 crc kubenswrapper[5120]: I0316 16:21:39.121901 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/cc082deb-bc44-4949-95e5-f6a9ece6220c-internal-tls-certs\") pod \"cc082deb-bc44-4949-95e5-f6a9ece6220c\" (UID: \"cc082deb-bc44-4949-95e5-f6a9ece6220c\") " Mar 16 16:21:39 crc kubenswrapper[5120]: I0316 16:21:39.121960 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l9bpl\" (UniqueName: \"kubernetes.io/projected/cc082deb-bc44-4949-95e5-f6a9ece6220c-kube-api-access-l9bpl\") pod \"cc082deb-bc44-4949-95e5-f6a9ece6220c\" (UID: \"cc082deb-bc44-4949-95e5-f6a9ece6220c\") " Mar 16 16:21:39 crc kubenswrapper[5120]: I0316 16:21:39.121986 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/cc082deb-bc44-4949-95e5-f6a9ece6220c-logs\") pod \"cc082deb-bc44-4949-95e5-f6a9ece6220c\" (UID: \"cc082deb-bc44-4949-95e5-f6a9ece6220c\") " Mar 16 16:21:39 crc kubenswrapper[5120]: I0316 16:21:39.122624 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/cc082deb-bc44-4949-95e5-f6a9ece6220c-config-data-custom\") pod \"cc082deb-bc44-4949-95e5-f6a9ece6220c\" (UID: \"cc082deb-bc44-4949-95e5-f6a9ece6220c\") " Mar 16 16:21:39 crc kubenswrapper[5120]: I0316 16:21:39.122831 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/cc082deb-bc44-4949-95e5-f6a9ece6220c-public-tls-certs\") pod \"cc082deb-bc44-4949-95e5-f6a9ece6220c\" (UID: \"cc082deb-bc44-4949-95e5-f6a9ece6220c\") " Mar 16 16:21:39 crc kubenswrapper[5120]: I0316 16:21:39.122900 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cc082deb-bc44-4949-95e5-f6a9ece6220c-combined-ca-bundle\") pod \"cc082deb-bc44-4949-95e5-f6a9ece6220c\" (UID: \"cc082deb-bc44-4949-95e5-f6a9ece6220c\") " Mar 16 16:21:39 crc kubenswrapper[5120]: I0316 16:21:39.122945 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc082deb-bc44-4949-95e5-f6a9ece6220c-logs" (OuterVolumeSpecName: "logs") pod "cc082deb-bc44-4949-95e5-f6a9ece6220c" (UID: "cc082deb-bc44-4949-95e5-f6a9ece6220c"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:21:39 crc kubenswrapper[5120]: I0316 16:21:39.123392 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3bb21f28-1bc0-402f-b18b-f29c0b834174-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:21:39 crc kubenswrapper[5120]: I0316 16:21:39.123404 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/3bb21f28-1bc0-402f-b18b-f29c0b834174-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:21:39 crc kubenswrapper[5120]: I0316 16:21:39.123413 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4spd9\" (UniqueName: \"kubernetes.io/projected/3bb21f28-1bc0-402f-b18b-f29c0b834174-kube-api-access-4spd9\") on node \"crc\" DevicePath \"\"" Mar 16 16:21:39 crc kubenswrapper[5120]: I0316 16:21:39.123423 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3bb21f28-1bc0-402f-b18b-f29c0b834174-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:21:39 crc kubenswrapper[5120]: I0316 16:21:39.123431 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3bb21f28-1bc0-402f-b18b-f29c0b834174-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:21:39 crc kubenswrapper[5120]: I0316 16:21:39.123439 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/cc082deb-bc44-4949-95e5-f6a9ece6220c-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:21:39 crc kubenswrapper[5120]: I0316 16:21:39.126298 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc082deb-bc44-4949-95e5-f6a9ece6220c-kube-api-access-l9bpl" (OuterVolumeSpecName: "kube-api-access-l9bpl") pod "cc082deb-bc44-4949-95e5-f6a9ece6220c" (UID: "cc082deb-bc44-4949-95e5-f6a9ece6220c"). InnerVolumeSpecName "kube-api-access-l9bpl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:21:39 crc kubenswrapper[5120]: I0316 16:21:39.126370 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc082deb-bc44-4949-95e5-f6a9ece6220c-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "cc082deb-bc44-4949-95e5-f6a9ece6220c" (UID: "cc082deb-bc44-4949-95e5-f6a9ece6220c"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:21:39 crc kubenswrapper[5120]: I0316 16:21:39.158460 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-vt87c" Mar 16 16:21:39 crc kubenswrapper[5120]: I0316 16:21:39.210287 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc082deb-bc44-4949-95e5-f6a9ece6220c-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "cc082deb-bc44-4949-95e5-f6a9ece6220c" (UID: "cc082deb-bc44-4949-95e5-f6a9ece6220c"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:21:39 crc kubenswrapper[5120]: I0316 16:21:39.224196 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4b4fb783-c7b1-4688-b793-d3ae04edc806-combined-ca-bundle\") pod \"4b4fb783-c7b1-4688-b793-d3ae04edc806\" (UID: \"4b4fb783-c7b1-4688-b793-d3ae04edc806\") " Mar 16 16:21:39 crc kubenswrapper[5120]: I0316 16:21:39.224284 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4b4fb783-c7b1-4688-b793-d3ae04edc806-config\") pod \"4b4fb783-c7b1-4688-b793-d3ae04edc806\" (UID: \"4b4fb783-c7b1-4688-b793-d3ae04edc806\") " Mar 16 16:21:39 crc kubenswrapper[5120]: I0316 16:21:39.224378 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/61e41544-dcc8-47cf-8a6e-45b053ae0f9e-logs\") pod \"61e41544-dcc8-47cf-8a6e-45b053ae0f9e\" (UID: \"61e41544-dcc8-47cf-8a6e-45b053ae0f9e\") " Mar 16 16:21:39 crc kubenswrapper[5120]: I0316 16:21:39.224489 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/61e41544-dcc8-47cf-8a6e-45b053ae0f9e-config-data\") pod \"61e41544-dcc8-47cf-8a6e-45b053ae0f9e\" (UID: \"61e41544-dcc8-47cf-8a6e-45b053ae0f9e\") " Mar 16 16:21:39 crc kubenswrapper[5120]: I0316 16:21:39.224568 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qxjwv\" (UniqueName: \"kubernetes.io/projected/4b4fb783-c7b1-4688-b793-d3ae04edc806-kube-api-access-qxjwv\") pod \"4b4fb783-c7b1-4688-b793-d3ae04edc806\" (UID: \"4b4fb783-c7b1-4688-b793-d3ae04edc806\") " Mar 16 16:21:39 crc kubenswrapper[5120]: I0316 16:21:39.224632 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2lhxr\" (UniqueName: \"kubernetes.io/projected/61e41544-dcc8-47cf-8a6e-45b053ae0f9e-kube-api-access-2lhxr\") pod \"61e41544-dcc8-47cf-8a6e-45b053ae0f9e\" (UID: \"61e41544-dcc8-47cf-8a6e-45b053ae0f9e\") " Mar 16 16:21:39 crc kubenswrapper[5120]: I0316 16:21:39.224694 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/61e41544-dcc8-47cf-8a6e-45b053ae0f9e-config-data-custom\") pod \"61e41544-dcc8-47cf-8a6e-45b053ae0f9e\" (UID: \"61e41544-dcc8-47cf-8a6e-45b053ae0f9e\") " Mar 16 16:21:39 crc kubenswrapper[5120]: I0316 16:21:39.224741 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/61e41544-dcc8-47cf-8a6e-45b053ae0f9e-combined-ca-bundle\") pod \"61e41544-dcc8-47cf-8a6e-45b053ae0f9e\" (UID: \"61e41544-dcc8-47cf-8a6e-45b053ae0f9e\") " Mar 16 16:21:39 crc kubenswrapper[5120]: I0316 16:21:39.225273 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l9bpl\" (UniqueName: \"kubernetes.io/projected/cc082deb-bc44-4949-95e5-f6a9ece6220c-kube-api-access-l9bpl\") on node \"crc\" DevicePath \"\"" Mar 16 16:21:39 crc kubenswrapper[5120]: I0316 16:21:39.225288 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/cc082deb-bc44-4949-95e5-f6a9ece6220c-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:21:39 crc kubenswrapper[5120]: I0316 16:21:39.225296 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cc082deb-bc44-4949-95e5-f6a9ece6220c-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:21:39 crc kubenswrapper[5120]: I0316 16:21:39.227884 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc082deb-bc44-4949-95e5-f6a9ece6220c-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "cc082deb-bc44-4949-95e5-f6a9ece6220c" (UID: "cc082deb-bc44-4949-95e5-f6a9ece6220c"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:21:39 crc kubenswrapper[5120]: I0316 16:21:39.228499 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61e41544-dcc8-47cf-8a6e-45b053ae0f9e-logs" (OuterVolumeSpecName: "logs") pod "61e41544-dcc8-47cf-8a6e-45b053ae0f9e" (UID: "61e41544-dcc8-47cf-8a6e-45b053ae0f9e"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:21:39 crc kubenswrapper[5120]: I0316 16:21:39.232135 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc082deb-bc44-4949-95e5-f6a9ece6220c-config-data" (OuterVolumeSpecName: "config-data") pod "cc082deb-bc44-4949-95e5-f6a9ece6220c" (UID: "cc082deb-bc44-4949-95e5-f6a9ece6220c"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:21:39 crc kubenswrapper[5120]: I0316 16:21:39.232237 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b4fb783-c7b1-4688-b793-d3ae04edc806-kube-api-access-qxjwv" (OuterVolumeSpecName: "kube-api-access-qxjwv") pod "4b4fb783-c7b1-4688-b793-d3ae04edc806" (UID: "4b4fb783-c7b1-4688-b793-d3ae04edc806"). InnerVolumeSpecName "kube-api-access-qxjwv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:21:39 crc kubenswrapper[5120]: I0316 16:21:39.232270 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61e41544-dcc8-47cf-8a6e-45b053ae0f9e-kube-api-access-2lhxr" (OuterVolumeSpecName: "kube-api-access-2lhxr") pod "61e41544-dcc8-47cf-8a6e-45b053ae0f9e" (UID: "61e41544-dcc8-47cf-8a6e-45b053ae0f9e"). InnerVolumeSpecName "kube-api-access-2lhxr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:21:39 crc kubenswrapper[5120]: I0316 16:21:39.232718 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61e41544-dcc8-47cf-8a6e-45b053ae0f9e-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "61e41544-dcc8-47cf-8a6e-45b053ae0f9e" (UID: "61e41544-dcc8-47cf-8a6e-45b053ae0f9e"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:21:39 crc kubenswrapper[5120]: I0316 16:21:39.237738 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc082deb-bc44-4949-95e5-f6a9ece6220c-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "cc082deb-bc44-4949-95e5-f6a9ece6220c" (UID: "cc082deb-bc44-4949-95e5-f6a9ece6220c"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:21:39 crc kubenswrapper[5120]: I0316 16:21:39.252644 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b4fb783-c7b1-4688-b793-d3ae04edc806-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "4b4fb783-c7b1-4688-b793-d3ae04edc806" (UID: "4b4fb783-c7b1-4688-b793-d3ae04edc806"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:21:39 crc kubenswrapper[5120]: I0316 16:21:39.253359 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b4fb783-c7b1-4688-b793-d3ae04edc806-config" (OuterVolumeSpecName: "config") pod "4b4fb783-c7b1-4688-b793-d3ae04edc806" (UID: "4b4fb783-c7b1-4688-b793-d3ae04edc806"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:21:39 crc kubenswrapper[5120]: I0316 16:21:39.254151 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61e41544-dcc8-47cf-8a6e-45b053ae0f9e-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "61e41544-dcc8-47cf-8a6e-45b053ae0f9e" (UID: "61e41544-dcc8-47cf-8a6e-45b053ae0f9e"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:21:39 crc kubenswrapper[5120]: I0316 16:21:39.289520 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61e41544-dcc8-47cf-8a6e-45b053ae0f9e-config-data" (OuterVolumeSpecName: "config-data") pod "61e41544-dcc8-47cf-8a6e-45b053ae0f9e" (UID: "61e41544-dcc8-47cf-8a6e-45b053ae0f9e"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:21:39 crc kubenswrapper[5120]: I0316 16:21:39.327026 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4b4fb783-c7b1-4688-b793-d3ae04edc806-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:21:39 crc kubenswrapper[5120]: I0316 16:21:39.327061 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/cc082deb-bc44-4949-95e5-f6a9ece6220c-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:21:39 crc kubenswrapper[5120]: I0316 16:21:39.327070 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/4b4fb783-c7b1-4688-b793-d3ae04edc806-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:21:39 crc kubenswrapper[5120]: I0316 16:21:39.327081 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/61e41544-dcc8-47cf-8a6e-45b053ae0f9e-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:21:39 crc kubenswrapper[5120]: I0316 16:21:39.327089 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/61e41544-dcc8-47cf-8a6e-45b053ae0f9e-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:21:39 crc kubenswrapper[5120]: I0316 16:21:39.327098 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qxjwv\" (UniqueName: \"kubernetes.io/projected/4b4fb783-c7b1-4688-b793-d3ae04edc806-kube-api-access-qxjwv\") on node \"crc\" DevicePath \"\"" Mar 16 16:21:39 crc kubenswrapper[5120]: I0316 16:21:39.327109 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2lhxr\" (UniqueName: \"kubernetes.io/projected/61e41544-dcc8-47cf-8a6e-45b053ae0f9e-kube-api-access-2lhxr\") on node \"crc\" DevicePath \"\"" Mar 16 16:21:39 crc kubenswrapper[5120]: I0316 16:21:39.327116 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/61e41544-dcc8-47cf-8a6e-45b053ae0f9e-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:21:39 crc kubenswrapper[5120]: I0316 16:21:39.327125 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/cc082deb-bc44-4949-95e5-f6a9ece6220c-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:21:39 crc kubenswrapper[5120]: I0316 16:21:39.327133 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/61e41544-dcc8-47cf-8a6e-45b053ae0f9e-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:21:39 crc kubenswrapper[5120]: I0316 16:21:39.327141 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cc082deb-bc44-4949-95e5-f6a9ece6220c-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:21:39 crc kubenswrapper[5120]: I0316 16:21:39.798441 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-vt87c" event={"ID":"4b4fb783-c7b1-4688-b793-d3ae04edc806","Type":"ContainerDied","Data":"32125af11fa877384afc87d6c964f7c867ff3cf2eb7797ff6bf0a047bea8b74e"} Mar 16 16:21:39 crc kubenswrapper[5120]: I0316 16:21:39.798504 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="32125af11fa877384afc87d6c964f7c867ff3cf2eb7797ff6bf0a047bea8b74e" Mar 16 16:21:39 crc kubenswrapper[5120]: I0316 16:21:39.798610 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-vt87c" Mar 16 16:21:39 crc kubenswrapper[5120]: I0316 16:21:39.809861 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ee06fc7a-e571-4eec-b5fd-309e6dc0eab0","Type":"ContainerStarted","Data":"cbbd0406183a1c1e2a2f808987d41f121130d40cd153739b03d29d850a32861d"} Mar 16 16:21:39 crc kubenswrapper[5120]: I0316 16:21:39.813289 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-756f865fd6-cllz7" event={"ID":"3bb21f28-1bc0-402f-b18b-f29c0b834174","Type":"ContainerDied","Data":"e05f4a229f7c67155623e6f591cc54b5b248b9a3ffd9b6983a6e2de25f6df9a0"} Mar 16 16:21:39 crc kubenswrapper[5120]: I0316 16:21:39.813687 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-756f865fd6-cllz7" Mar 16 16:21:39 crc kubenswrapper[5120]: I0316 16:21:39.813479 5120 scope.go:117] "RemoveContainer" containerID="c1d44c9bc92ca9945715186ad30c605d1106f5afd0d5347a1f091e01c268412c" Mar 16 16:21:39 crc kubenswrapper[5120]: I0316 16:21:39.819565 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-5ffd6f596c-m52jd" Mar 16 16:21:39 crc kubenswrapper[5120]: I0316 16:21:39.819660 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-5ffd6f596c-m52jd" event={"ID":"61e41544-dcc8-47cf-8a6e-45b053ae0f9e","Type":"ContainerDied","Data":"3a6462abd71c56a875a101ba5922e4616a44e213b945e6603580e677c4a7f753"} Mar 16 16:21:39 crc kubenswrapper[5120]: I0316 16:21:39.827650 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/watcher-api-0" event={"ID":"e15efd1b-6aa8-4a24-b576-4e03e19e19d0","Type":"ContainerStarted","Data":"1ef4b2599981ce7b8001b50ecfd4a007c4f23a0c049893394acf7b049e550690"} Mar 16 16:21:39 crc kubenswrapper[5120]: I0316 16:21:39.827918 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/watcher-api-0" Mar 16 16:21:39 crc kubenswrapper[5120]: I0316 16:21:39.828260 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/watcher-api-0" event={"ID":"e15efd1b-6aa8-4a24-b576-4e03e19e19d0","Type":"ContainerStarted","Data":"e0f92a07b7fa6f808f45a98109ff109cb20b21840d1d05128661b849870c2178"} Mar 16 16:21:39 crc kubenswrapper[5120]: I0316 16:21:39.828306 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/watcher-api-0" event={"ID":"e15efd1b-6aa8-4a24-b576-4e03e19e19d0","Type":"ContainerStarted","Data":"6fad77389d935c02c32755e665ca002b068ef37079df2ebd4e98b3d6de64a115"} Mar 16 16:21:39 crc kubenswrapper[5120]: I0316 16:21:39.837147 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-6b946b9c94-hvvmv" Mar 16 16:21:39 crc kubenswrapper[5120]: I0316 16:21:39.837146 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-6b946b9c94-hvvmv" event={"ID":"cc082deb-bc44-4949-95e5-f6a9ece6220c","Type":"ContainerDied","Data":"347ec183e1d04f152b9b6c320925ef988778142b98af6611b0826d95f0009108"} Mar 16 16:21:39 crc kubenswrapper[5120]: I0316 16:21:39.861893 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/watcher-api-0" podStartSLOduration=2.861858817 podStartE2EDuration="2.861858817s" podCreationTimestamp="2026-03-16 16:21:37 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:21:39.851859189 +0000 UTC m=+3002.005790906" watchObservedRunningTime="2026-03-16 16:21:39.861858817 +0000 UTC m=+3002.015790614" Mar 16 16:21:39 crc kubenswrapper[5120]: I0316 16:21:39.874630 5120 scope.go:117] "RemoveContainer" containerID="2bd625cf02e831d748d79a2a782e6ca939c530254b7265a4d6bdb18f7d957ea4" Mar 16 16:21:39 crc kubenswrapper[5120]: I0316 16:21:39.919246 5120 scope.go:117] "RemoveContainer" containerID="eb0d8a6546028f00924b876961e7377e8be7061907902ffda27871c0c53fa378" Mar 16 16:21:39 crc kubenswrapper[5120]: I0316 16:21:39.958124 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-5ffd6f596c-m52jd"] Mar 16 16:21:39 crc kubenswrapper[5120]: I0316 16:21:39.994921 5120 scope.go:117] "RemoveContainer" containerID="da371751a76a30f178eff06cf80fbc0812228b79e3637d23b403035295bb62ee" Mar 16 16:21:39 crc kubenswrapper[5120]: I0316 16:21:39.995067 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-worker-5ffd6f596c-m52jd"] Mar 16 16:21:40 crc kubenswrapper[5120]: I0316 16:21:40.007063 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-756f865fd6-cllz7"] Mar 16 16:21:40 crc kubenswrapper[5120]: I0316 16:21:40.021821 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-756f865fd6-cllz7"] Mar 16 16:21:40 crc kubenswrapper[5120]: I0316 16:21:40.024589 5120 scope.go:117] "RemoveContainer" containerID="d5aaa29de71f9506edf61c52ff902611842cbc3ad6e5f2ae70727afe76f85f25" Mar 16 16:21:40 crc kubenswrapper[5120]: I0316 16:21:40.029205 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-7bccf4cf49-4xg9g"] Mar 16 16:21:40 crc kubenswrapper[5120]: I0316 16:21:40.030394 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61e41544-dcc8-47cf-8a6e-45b053ae0f9e" containerName="barbican-worker-log" Mar 16 16:21:40 crc kubenswrapper[5120]: I0316 16:21:40.030408 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="61e41544-dcc8-47cf-8a6e-45b053ae0f9e" containerName="barbican-worker-log" Mar 16 16:21:40 crc kubenswrapper[5120]: I0316 16:21:40.030433 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61e41544-dcc8-47cf-8a6e-45b053ae0f9e" containerName="barbican-worker" Mar 16 16:21:40 crc kubenswrapper[5120]: I0316 16:21:40.030439 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="61e41544-dcc8-47cf-8a6e-45b053ae0f9e" containerName="barbican-worker" Mar 16 16:21:40 crc kubenswrapper[5120]: I0316 16:21:40.030447 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc082deb-bc44-4949-95e5-f6a9ece6220c" containerName="barbican-api-log" Mar 16 16:21:40 crc kubenswrapper[5120]: I0316 16:21:40.030453 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc082deb-bc44-4949-95e5-f6a9ece6220c" containerName="barbican-api-log" Mar 16 16:21:40 crc kubenswrapper[5120]: I0316 16:21:40.030493 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3bb21f28-1bc0-402f-b18b-f29c0b834174" containerName="barbican-keystone-listener-log" Mar 16 16:21:40 crc kubenswrapper[5120]: I0316 16:21:40.030502 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="3bb21f28-1bc0-402f-b18b-f29c0b834174" containerName="barbican-keystone-listener-log" Mar 16 16:21:40 crc kubenswrapper[5120]: I0316 16:21:40.030511 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3bb21f28-1bc0-402f-b18b-f29c0b834174" containerName="barbican-keystone-listener" Mar 16 16:21:40 crc kubenswrapper[5120]: I0316 16:21:40.030517 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="3bb21f28-1bc0-402f-b18b-f29c0b834174" containerName="barbican-keystone-listener" Mar 16 16:21:40 crc kubenswrapper[5120]: I0316 16:21:40.030538 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b4fb783-c7b1-4688-b793-d3ae04edc806" containerName="neutron-db-sync" Mar 16 16:21:40 crc kubenswrapper[5120]: I0316 16:21:40.030544 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b4fb783-c7b1-4688-b793-d3ae04edc806" containerName="neutron-db-sync" Mar 16 16:21:40 crc kubenswrapper[5120]: I0316 16:21:40.030559 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc082deb-bc44-4949-95e5-f6a9ece6220c" containerName="barbican-api" Mar 16 16:21:40 crc kubenswrapper[5120]: I0316 16:21:40.030565 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc082deb-bc44-4949-95e5-f6a9ece6220c" containerName="barbican-api" Mar 16 16:21:40 crc kubenswrapper[5120]: I0316 16:21:40.031610 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="3bb21f28-1bc0-402f-b18b-f29c0b834174" containerName="barbican-keystone-listener-log" Mar 16 16:21:40 crc kubenswrapper[5120]: I0316 16:21:40.031682 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="cc082deb-bc44-4949-95e5-f6a9ece6220c" containerName="barbican-api-log" Mar 16 16:21:40 crc kubenswrapper[5120]: I0316 16:21:40.031744 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="4b4fb783-c7b1-4688-b793-d3ae04edc806" containerName="neutron-db-sync" Mar 16 16:21:40 crc kubenswrapper[5120]: I0316 16:21:40.031874 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="61e41544-dcc8-47cf-8a6e-45b053ae0f9e" containerName="barbican-worker-log" Mar 16 16:21:40 crc kubenswrapper[5120]: I0316 16:21:40.031988 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="61e41544-dcc8-47cf-8a6e-45b053ae0f9e" containerName="barbican-worker" Mar 16 16:21:40 crc kubenswrapper[5120]: I0316 16:21:40.032080 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="3bb21f28-1bc0-402f-b18b-f29c0b834174" containerName="barbican-keystone-listener" Mar 16 16:21:40 crc kubenswrapper[5120]: I0316 16:21:40.032281 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="cc082deb-bc44-4949-95e5-f6a9ece6220c" containerName="barbican-api" Mar 16 16:21:40 crc kubenswrapper[5120]: I0316 16:21:40.046218 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-6b946b9c94-hvvmv"] Mar 16 16:21:40 crc kubenswrapper[5120]: I0316 16:21:40.046490 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-7bccf4cf49-4xg9g" Mar 16 16:21:40 crc kubenswrapper[5120]: I0316 16:21:40.048038 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-neutron-dockercfg-tsjtv\"" Mar 16 16:21:40 crc kubenswrapper[5120]: I0316 16:21:40.049277 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-neutron-ovndbs\"" Mar 16 16:21:40 crc kubenswrapper[5120]: I0316 16:21:40.049965 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-httpd-config\"" Mar 16 16:21:40 crc kubenswrapper[5120]: I0316 16:21:40.050167 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-config\"" Mar 16 16:21:40 crc kubenswrapper[5120]: I0316 16:21:40.065705 5120 scope.go:117] "RemoveContainer" containerID="7b9d72fd68bdaeb3ffdd80b1f42f221d7edcb3c58698eb912cef35b25cd35fcc" Mar 16 16:21:40 crc kubenswrapper[5120]: I0316 16:21:40.067785 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-api-6b946b9c94-hvvmv"] Mar 16 16:21:40 crc kubenswrapper[5120]: I0316 16:21:40.076895 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-7bccf4cf49-4xg9g"] Mar 16 16:21:40 crc kubenswrapper[5120]: I0316 16:21:40.148477 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/81b5f864-0fd2-4f60-a59d-f37ea787f938-ovndb-tls-certs\") pod \"neutron-7bccf4cf49-4xg9g\" (UID: \"81b5f864-0fd2-4f60-a59d-f37ea787f938\") " pod="openstack-kuttl-tests/neutron-7bccf4cf49-4xg9g" Mar 16 16:21:40 crc kubenswrapper[5120]: I0316 16:21:40.148854 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/81b5f864-0fd2-4f60-a59d-f37ea787f938-httpd-config\") pod \"neutron-7bccf4cf49-4xg9g\" (UID: \"81b5f864-0fd2-4f60-a59d-f37ea787f938\") " pod="openstack-kuttl-tests/neutron-7bccf4cf49-4xg9g" Mar 16 16:21:40 crc kubenswrapper[5120]: I0316 16:21:40.148983 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/81b5f864-0fd2-4f60-a59d-f37ea787f938-config\") pod \"neutron-7bccf4cf49-4xg9g\" (UID: \"81b5f864-0fd2-4f60-a59d-f37ea787f938\") " pod="openstack-kuttl-tests/neutron-7bccf4cf49-4xg9g" Mar 16 16:21:40 crc kubenswrapper[5120]: I0316 16:21:40.149048 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/81b5f864-0fd2-4f60-a59d-f37ea787f938-combined-ca-bundle\") pod \"neutron-7bccf4cf49-4xg9g\" (UID: \"81b5f864-0fd2-4f60-a59d-f37ea787f938\") " pod="openstack-kuttl-tests/neutron-7bccf4cf49-4xg9g" Mar 16 16:21:40 crc kubenswrapper[5120]: I0316 16:21:40.149221 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hlj8z\" (UniqueName: \"kubernetes.io/projected/81b5f864-0fd2-4f60-a59d-f37ea787f938-kube-api-access-hlj8z\") pod \"neutron-7bccf4cf49-4xg9g\" (UID: \"81b5f864-0fd2-4f60-a59d-f37ea787f938\") " pod="openstack-kuttl-tests/neutron-7bccf4cf49-4xg9g" Mar 16 16:21:40 crc kubenswrapper[5120]: I0316 16:21:40.251239 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/81b5f864-0fd2-4f60-a59d-f37ea787f938-ovndb-tls-certs\") pod \"neutron-7bccf4cf49-4xg9g\" (UID: \"81b5f864-0fd2-4f60-a59d-f37ea787f938\") " pod="openstack-kuttl-tests/neutron-7bccf4cf49-4xg9g" Mar 16 16:21:40 crc kubenswrapper[5120]: I0316 16:21:40.251336 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/81b5f864-0fd2-4f60-a59d-f37ea787f938-httpd-config\") pod \"neutron-7bccf4cf49-4xg9g\" (UID: \"81b5f864-0fd2-4f60-a59d-f37ea787f938\") " pod="openstack-kuttl-tests/neutron-7bccf4cf49-4xg9g" Mar 16 16:21:40 crc kubenswrapper[5120]: I0316 16:21:40.251383 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/81b5f864-0fd2-4f60-a59d-f37ea787f938-config\") pod \"neutron-7bccf4cf49-4xg9g\" (UID: \"81b5f864-0fd2-4f60-a59d-f37ea787f938\") " pod="openstack-kuttl-tests/neutron-7bccf4cf49-4xg9g" Mar 16 16:21:40 crc kubenswrapper[5120]: I0316 16:21:40.251413 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/81b5f864-0fd2-4f60-a59d-f37ea787f938-combined-ca-bundle\") pod \"neutron-7bccf4cf49-4xg9g\" (UID: \"81b5f864-0fd2-4f60-a59d-f37ea787f938\") " pod="openstack-kuttl-tests/neutron-7bccf4cf49-4xg9g" Mar 16 16:21:40 crc kubenswrapper[5120]: I0316 16:21:40.251456 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hlj8z\" (UniqueName: \"kubernetes.io/projected/81b5f864-0fd2-4f60-a59d-f37ea787f938-kube-api-access-hlj8z\") pod \"neutron-7bccf4cf49-4xg9g\" (UID: \"81b5f864-0fd2-4f60-a59d-f37ea787f938\") " pod="openstack-kuttl-tests/neutron-7bccf4cf49-4xg9g" Mar 16 16:21:40 crc kubenswrapper[5120]: I0316 16:21:40.262164 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/81b5f864-0fd2-4f60-a59d-f37ea787f938-httpd-config\") pod \"neutron-7bccf4cf49-4xg9g\" (UID: \"81b5f864-0fd2-4f60-a59d-f37ea787f938\") " pod="openstack-kuttl-tests/neutron-7bccf4cf49-4xg9g" Mar 16 16:21:40 crc kubenswrapper[5120]: I0316 16:21:40.264340 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/81b5f864-0fd2-4f60-a59d-f37ea787f938-config\") pod \"neutron-7bccf4cf49-4xg9g\" (UID: \"81b5f864-0fd2-4f60-a59d-f37ea787f938\") " pod="openstack-kuttl-tests/neutron-7bccf4cf49-4xg9g" Mar 16 16:21:40 crc kubenswrapper[5120]: I0316 16:21:40.264351 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/81b5f864-0fd2-4f60-a59d-f37ea787f938-ovndb-tls-certs\") pod \"neutron-7bccf4cf49-4xg9g\" (UID: \"81b5f864-0fd2-4f60-a59d-f37ea787f938\") " pod="openstack-kuttl-tests/neutron-7bccf4cf49-4xg9g" Mar 16 16:21:40 crc kubenswrapper[5120]: I0316 16:21:40.264494 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/81b5f864-0fd2-4f60-a59d-f37ea787f938-combined-ca-bundle\") pod \"neutron-7bccf4cf49-4xg9g\" (UID: \"81b5f864-0fd2-4f60-a59d-f37ea787f938\") " pod="openstack-kuttl-tests/neutron-7bccf4cf49-4xg9g" Mar 16 16:21:40 crc kubenswrapper[5120]: I0316 16:21:40.267679 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hlj8z\" (UniqueName: \"kubernetes.io/projected/81b5f864-0fd2-4f60-a59d-f37ea787f938-kube-api-access-hlj8z\") pod \"neutron-7bccf4cf49-4xg9g\" (UID: \"81b5f864-0fd2-4f60-a59d-f37ea787f938\") " pod="openstack-kuttl-tests/neutron-7bccf4cf49-4xg9g" Mar 16 16:21:40 crc kubenswrapper[5120]: I0316 16:21:40.367088 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-7bccf4cf49-4xg9g" Mar 16 16:21:40 crc kubenswrapper[5120]: I0316 16:21:40.686673 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3bb21f28-1bc0-402f-b18b-f29c0b834174" path="/var/lib/kubelet/pods/3bb21f28-1bc0-402f-b18b-f29c0b834174/volumes" Mar 16 16:21:40 crc kubenswrapper[5120]: I0316 16:21:40.688119 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="61e41544-dcc8-47cf-8a6e-45b053ae0f9e" path="/var/lib/kubelet/pods/61e41544-dcc8-47cf-8a6e-45b053ae0f9e/volumes" Mar 16 16:21:40 crc kubenswrapper[5120]: I0316 16:21:40.688741 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc082deb-bc44-4949-95e5-f6a9ece6220c" path="/var/lib/kubelet/pods/cc082deb-bc44-4949-95e5-f6a9ece6220c/volumes" Mar 16 16:21:40 crc kubenswrapper[5120]: I0316 16:21:40.861525 5120 generic.go:358] "Generic (PLEG): container finished" podID="88c05a13-c1ef-4aee-9a86-d91a80dc4af5" containerID="414e348b57743afdaf5beba40c4475103cb2bdc3704e717970a712c80b675463" exitCode=0 Mar 16 16:21:40 crc kubenswrapper[5120]: I0316 16:21:40.861935 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"88c05a13-c1ef-4aee-9a86-d91a80dc4af5","Type":"ContainerDied","Data":"414e348b57743afdaf5beba40c4475103cb2bdc3704e717970a712c80b675463"} Mar 16 16:21:40 crc kubenswrapper[5120]: I0316 16:21:40.863655 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ee06fc7a-e571-4eec-b5fd-309e6dc0eab0","Type":"ContainerStarted","Data":"f3a710091929bdde8bf34e0dc3921d0325a9e12ace444521041aa583c6b00c4e"} Mar 16 16:21:40 crc kubenswrapper[5120]: I0316 16:21:40.865266 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-7bccf4cf49-4xg9g"] Mar 16 16:21:40 crc kubenswrapper[5120]: I0316 16:21:40.868048 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:21:40 crc kubenswrapper[5120]: W0316 16:21:40.874212 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod81b5f864_0fd2_4f60_a59d_f37ea787f938.slice/crio-61590c6d4efef7daca6c32ff7e5d7f44cde7eeb6368af9423af46b099523cecf WatchSource:0}: Error finding container 61590c6d4efef7daca6c32ff7e5d7f44cde7eeb6368af9423af46b099523cecf: Status 404 returned error can't find the container with id 61590c6d4efef7daca6c32ff7e5d7f44cde7eeb6368af9423af46b099523cecf Mar 16 16:21:40 crc kubenswrapper[5120]: I0316 16:21:40.910188 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.064479674 podStartE2EDuration="5.910162516s" podCreationTimestamp="2026-03-16 16:21:35 +0000 UTC" firstStartedPulling="2026-03-16 16:21:36.622150513 +0000 UTC m=+2998.776082170" lastFinishedPulling="2026-03-16 16:21:40.467833355 +0000 UTC m=+3002.621765012" observedRunningTime="2026-03-16 16:21:40.888869376 +0000 UTC m=+3003.042801043" watchObservedRunningTime="2026-03-16 16:21:40.910162516 +0000 UTC m=+3003.064094183" Mar 16 16:21:41 crc kubenswrapper[5120]: I0316 16:21:41.132205 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:21:41 crc kubenswrapper[5120]: I0316 16:21:41.170560 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/88c05a13-c1ef-4aee-9a86-d91a80dc4af5-config-data\") pod \"88c05a13-c1ef-4aee-9a86-d91a80dc4af5\" (UID: \"88c05a13-c1ef-4aee-9a86-d91a80dc4af5\") " Mar 16 16:21:41 crc kubenswrapper[5120]: I0316 16:21:41.170647 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/88c05a13-c1ef-4aee-9a86-d91a80dc4af5-config-data-custom\") pod \"88c05a13-c1ef-4aee-9a86-d91a80dc4af5\" (UID: \"88c05a13-c1ef-4aee-9a86-d91a80dc4af5\") " Mar 16 16:21:41 crc kubenswrapper[5120]: I0316 16:21:41.170716 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/88c05a13-c1ef-4aee-9a86-d91a80dc4af5-combined-ca-bundle\") pod \"88c05a13-c1ef-4aee-9a86-d91a80dc4af5\" (UID: \"88c05a13-c1ef-4aee-9a86-d91a80dc4af5\") " Mar 16 16:21:41 crc kubenswrapper[5120]: I0316 16:21:41.170794 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ssllz\" (UniqueName: \"kubernetes.io/projected/88c05a13-c1ef-4aee-9a86-d91a80dc4af5-kube-api-access-ssllz\") pod \"88c05a13-c1ef-4aee-9a86-d91a80dc4af5\" (UID: \"88c05a13-c1ef-4aee-9a86-d91a80dc4af5\") " Mar 16 16:21:41 crc kubenswrapper[5120]: I0316 16:21:41.170993 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/88c05a13-c1ef-4aee-9a86-d91a80dc4af5-scripts\") pod \"88c05a13-c1ef-4aee-9a86-d91a80dc4af5\" (UID: \"88c05a13-c1ef-4aee-9a86-d91a80dc4af5\") " Mar 16 16:21:41 crc kubenswrapper[5120]: I0316 16:21:41.171044 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/88c05a13-c1ef-4aee-9a86-d91a80dc4af5-etc-machine-id\") pod \"88c05a13-c1ef-4aee-9a86-d91a80dc4af5\" (UID: \"88c05a13-c1ef-4aee-9a86-d91a80dc4af5\") " Mar 16 16:21:41 crc kubenswrapper[5120]: I0316 16:21:41.171671 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/88c05a13-c1ef-4aee-9a86-d91a80dc4af5-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "88c05a13-c1ef-4aee-9a86-d91a80dc4af5" (UID: "88c05a13-c1ef-4aee-9a86-d91a80dc4af5"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 16:21:41 crc kubenswrapper[5120]: I0316 16:21:41.176519 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/88c05a13-c1ef-4aee-9a86-d91a80dc4af5-scripts" (OuterVolumeSpecName: "scripts") pod "88c05a13-c1ef-4aee-9a86-d91a80dc4af5" (UID: "88c05a13-c1ef-4aee-9a86-d91a80dc4af5"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:21:41 crc kubenswrapper[5120]: I0316 16:21:41.182379 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88c05a13-c1ef-4aee-9a86-d91a80dc4af5-kube-api-access-ssllz" (OuterVolumeSpecName: "kube-api-access-ssllz") pod "88c05a13-c1ef-4aee-9a86-d91a80dc4af5" (UID: "88c05a13-c1ef-4aee-9a86-d91a80dc4af5"). InnerVolumeSpecName "kube-api-access-ssllz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:21:41 crc kubenswrapper[5120]: I0316 16:21:41.207265 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/88c05a13-c1ef-4aee-9a86-d91a80dc4af5-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "88c05a13-c1ef-4aee-9a86-d91a80dc4af5" (UID: "88c05a13-c1ef-4aee-9a86-d91a80dc4af5"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:21:41 crc kubenswrapper[5120]: I0316 16:21:41.225812 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/88c05a13-c1ef-4aee-9a86-d91a80dc4af5-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "88c05a13-c1ef-4aee-9a86-d91a80dc4af5" (UID: "88c05a13-c1ef-4aee-9a86-d91a80dc4af5"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:21:41 crc kubenswrapper[5120]: I0316 16:21:41.273869 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/88c05a13-c1ef-4aee-9a86-d91a80dc4af5-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:21:41 crc kubenswrapper[5120]: I0316 16:21:41.273894 5120 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/88c05a13-c1ef-4aee-9a86-d91a80dc4af5-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 16:21:41 crc kubenswrapper[5120]: I0316 16:21:41.273905 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/88c05a13-c1ef-4aee-9a86-d91a80dc4af5-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:21:41 crc kubenswrapper[5120]: I0316 16:21:41.273913 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/88c05a13-c1ef-4aee-9a86-d91a80dc4af5-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:21:41 crc kubenswrapper[5120]: I0316 16:21:41.273921 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ssllz\" (UniqueName: \"kubernetes.io/projected/88c05a13-c1ef-4aee-9a86-d91a80dc4af5-kube-api-access-ssllz\") on node \"crc\" DevicePath \"\"" Mar 16 16:21:41 crc kubenswrapper[5120]: I0316 16:21:41.282517 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/88c05a13-c1ef-4aee-9a86-d91a80dc4af5-config-data" (OuterVolumeSpecName: "config-data") pod "88c05a13-c1ef-4aee-9a86-d91a80dc4af5" (UID: "88c05a13-c1ef-4aee-9a86-d91a80dc4af5"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:21:41 crc kubenswrapper[5120]: I0316 16:21:41.375991 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/88c05a13-c1ef-4aee-9a86-d91a80dc4af5-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:21:41 crc kubenswrapper[5120]: I0316 16:21:41.877963 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:21:41 crc kubenswrapper[5120]: I0316 16:21:41.878185 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"88c05a13-c1ef-4aee-9a86-d91a80dc4af5","Type":"ContainerDied","Data":"f13d061f08b214d3272987f47aef21ce311f5528cf5e46155abd9e08b5675c88"} Mar 16 16:21:41 crc kubenswrapper[5120]: I0316 16:21:41.878344 5120 scope.go:117] "RemoveContainer" containerID="d75f51f85be5c791208584f47eac49d55ec6339fcfb949515777db7507334633" Mar 16 16:21:41 crc kubenswrapper[5120]: I0316 16:21:41.882504 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-7bccf4cf49-4xg9g" event={"ID":"81b5f864-0fd2-4f60-a59d-f37ea787f938","Type":"ContainerStarted","Data":"0ec532e38e77a8c2fb10baeb9e3f00655491b28243540d510c37807942ce6cb9"} Mar 16 16:21:41 crc kubenswrapper[5120]: I0316 16:21:41.882556 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-7bccf4cf49-4xg9g" event={"ID":"81b5f864-0fd2-4f60-a59d-f37ea787f938","Type":"ContainerStarted","Data":"e7d2c352088e95d9a105b34f2c007137b4dd6063eb236929c342f8930e702e8b"} Mar 16 16:21:41 crc kubenswrapper[5120]: I0316 16:21:41.882568 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-7bccf4cf49-4xg9g" event={"ID":"81b5f864-0fd2-4f60-a59d-f37ea787f938","Type":"ContainerStarted","Data":"61590c6d4efef7daca6c32ff7e5d7f44cde7eeb6368af9423af46b099523cecf"} Mar 16 16:21:41 crc kubenswrapper[5120]: I0316 16:21:41.882710 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/neutron-7bccf4cf49-4xg9g" Mar 16 16:21:41 crc kubenswrapper[5120]: I0316 16:21:41.910054 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-7bccf4cf49-4xg9g" podStartSLOduration=2.91003512 podStartE2EDuration="2.91003512s" podCreationTimestamp="2026-03-16 16:21:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:21:41.902507278 +0000 UTC m=+3004.056438945" watchObservedRunningTime="2026-03-16 16:21:41.91003512 +0000 UTC m=+3004.063966777" Mar 16 16:21:41 crc kubenswrapper[5120]: I0316 16:21:41.917966 5120 scope.go:117] "RemoveContainer" containerID="414e348b57743afdaf5beba40c4475103cb2bdc3704e717970a712c80b675463" Mar 16 16:21:41 crc kubenswrapper[5120]: I0316 16:21:41.940107 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/watcher-api-0" Mar 16 16:21:41 crc kubenswrapper[5120]: I0316 16:21:41.945455 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:21:42 crc kubenswrapper[5120]: I0316 16:21:42.002011 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:21:42 crc kubenswrapper[5120]: I0316 16:21:42.022885 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:21:42 crc kubenswrapper[5120]: I0316 16:21:42.024017 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88c05a13-c1ef-4aee-9a86-d91a80dc4af5" containerName="cinder-scheduler" Mar 16 16:21:42 crc kubenswrapper[5120]: I0316 16:21:42.024038 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="88c05a13-c1ef-4aee-9a86-d91a80dc4af5" containerName="cinder-scheduler" Mar 16 16:21:42 crc kubenswrapper[5120]: I0316 16:21:42.024094 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88c05a13-c1ef-4aee-9a86-d91a80dc4af5" containerName="probe" Mar 16 16:21:42 crc kubenswrapper[5120]: I0316 16:21:42.024101 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="88c05a13-c1ef-4aee-9a86-d91a80dc4af5" containerName="probe" Mar 16 16:21:42 crc kubenswrapper[5120]: I0316 16:21:42.024277 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="88c05a13-c1ef-4aee-9a86-d91a80dc4af5" containerName="cinder-scheduler" Mar 16 16:21:42 crc kubenswrapper[5120]: I0316 16:21:42.024300 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="88c05a13-c1ef-4aee-9a86-d91a80dc4af5" containerName="probe" Mar 16 16:21:42 crc kubenswrapper[5120]: I0316 16:21:42.028379 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:21:42 crc kubenswrapper[5120]: I0316 16:21:42.031414 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-scheduler-config-data\"" Mar 16 16:21:42 crc kubenswrapper[5120]: I0316 16:21:42.032526 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:21:42 crc kubenswrapper[5120]: I0316 16:21:42.105347 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/73c9b7cf-53e7-4e3b-81c4-f674f8bfd894-config-data\") pod \"cinder-scheduler-0\" (UID: \"73c9b7cf-53e7-4e3b-81c4-f674f8bfd894\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:21:42 crc kubenswrapper[5120]: I0316 16:21:42.105400 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/73c9b7cf-53e7-4e3b-81c4-f674f8bfd894-scripts\") pod \"cinder-scheduler-0\" (UID: \"73c9b7cf-53e7-4e3b-81c4-f674f8bfd894\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:21:42 crc kubenswrapper[5120]: I0316 16:21:42.105425 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/73c9b7cf-53e7-4e3b-81c4-f674f8bfd894-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"73c9b7cf-53e7-4e3b-81c4-f674f8bfd894\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:21:42 crc kubenswrapper[5120]: I0316 16:21:42.105451 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/73c9b7cf-53e7-4e3b-81c4-f674f8bfd894-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"73c9b7cf-53e7-4e3b-81c4-f674f8bfd894\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:21:42 crc kubenswrapper[5120]: I0316 16:21:42.105470 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/73c9b7cf-53e7-4e3b-81c4-f674f8bfd894-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"73c9b7cf-53e7-4e3b-81c4-f674f8bfd894\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:21:42 crc kubenswrapper[5120]: I0316 16:21:42.105541 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzmqk\" (UniqueName: \"kubernetes.io/projected/73c9b7cf-53e7-4e3b-81c4-f674f8bfd894-kube-api-access-zzmqk\") pod \"cinder-scheduler-0\" (UID: \"73c9b7cf-53e7-4e3b-81c4-f674f8bfd894\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:21:42 crc kubenswrapper[5120]: I0316 16:21:42.208448 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zzmqk\" (UniqueName: \"kubernetes.io/projected/73c9b7cf-53e7-4e3b-81c4-f674f8bfd894-kube-api-access-zzmqk\") pod \"cinder-scheduler-0\" (UID: \"73c9b7cf-53e7-4e3b-81c4-f674f8bfd894\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:21:42 crc kubenswrapper[5120]: I0316 16:21:42.208687 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/73c9b7cf-53e7-4e3b-81c4-f674f8bfd894-config-data\") pod \"cinder-scheduler-0\" (UID: \"73c9b7cf-53e7-4e3b-81c4-f674f8bfd894\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:21:42 crc kubenswrapper[5120]: I0316 16:21:42.208712 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/73c9b7cf-53e7-4e3b-81c4-f674f8bfd894-scripts\") pod \"cinder-scheduler-0\" (UID: \"73c9b7cf-53e7-4e3b-81c4-f674f8bfd894\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:21:42 crc kubenswrapper[5120]: I0316 16:21:42.208737 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/73c9b7cf-53e7-4e3b-81c4-f674f8bfd894-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"73c9b7cf-53e7-4e3b-81c4-f674f8bfd894\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:21:42 crc kubenswrapper[5120]: I0316 16:21:42.208774 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/73c9b7cf-53e7-4e3b-81c4-f674f8bfd894-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"73c9b7cf-53e7-4e3b-81c4-f674f8bfd894\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:21:42 crc kubenswrapper[5120]: I0316 16:21:42.208797 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/73c9b7cf-53e7-4e3b-81c4-f674f8bfd894-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"73c9b7cf-53e7-4e3b-81c4-f674f8bfd894\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:21:42 crc kubenswrapper[5120]: I0316 16:21:42.212485 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/73c9b7cf-53e7-4e3b-81c4-f674f8bfd894-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"73c9b7cf-53e7-4e3b-81c4-f674f8bfd894\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:21:42 crc kubenswrapper[5120]: I0316 16:21:42.225447 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/73c9b7cf-53e7-4e3b-81c4-f674f8bfd894-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"73c9b7cf-53e7-4e3b-81c4-f674f8bfd894\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:21:42 crc kubenswrapper[5120]: I0316 16:21:42.225493 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/73c9b7cf-53e7-4e3b-81c4-f674f8bfd894-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"73c9b7cf-53e7-4e3b-81c4-f674f8bfd894\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:21:42 crc kubenswrapper[5120]: I0316 16:21:42.225755 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/73c9b7cf-53e7-4e3b-81c4-f674f8bfd894-config-data\") pod \"cinder-scheduler-0\" (UID: \"73c9b7cf-53e7-4e3b-81c4-f674f8bfd894\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:21:42 crc kubenswrapper[5120]: I0316 16:21:42.227048 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/73c9b7cf-53e7-4e3b-81c4-f674f8bfd894-scripts\") pod \"cinder-scheduler-0\" (UID: \"73c9b7cf-53e7-4e3b-81c4-f674f8bfd894\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:21:42 crc kubenswrapper[5120]: I0316 16:21:42.231429 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzmqk\" (UniqueName: \"kubernetes.io/projected/73c9b7cf-53e7-4e3b-81c4-f674f8bfd894-kube-api-access-zzmqk\") pod \"cinder-scheduler-0\" (UID: \"73c9b7cf-53e7-4e3b-81c4-f674f8bfd894\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:21:42 crc kubenswrapper[5120]: I0316 16:21:42.350900 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:21:42 crc kubenswrapper[5120]: I0316 16:21:42.458130 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-6d4b69cb4d-gjpzv"] Mar 16 16:21:42 crc kubenswrapper[5120]: I0316 16:21:42.482682 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-6d4b69cb4d-gjpzv"] Mar 16 16:21:42 crc kubenswrapper[5120]: I0316 16:21:42.483057 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-6d4b69cb4d-gjpzv" Mar 16 16:21:42 crc kubenswrapper[5120]: I0316 16:21:42.491170 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-neutron-public-svc\"" Mar 16 16:21:42 crc kubenswrapper[5120]: I0316 16:21:42.491416 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-neutron-internal-svc\"" Mar 16 16:21:42 crc kubenswrapper[5120]: I0316 16:21:42.616307 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rpxlr\" (UniqueName: \"kubernetes.io/projected/1d4fa436-d4ae-48e8-b4db-5e9096c6f51d-kube-api-access-rpxlr\") pod \"neutron-6d4b69cb4d-gjpzv\" (UID: \"1d4fa436-d4ae-48e8-b4db-5e9096c6f51d\") " pod="openstack-kuttl-tests/neutron-6d4b69cb4d-gjpzv" Mar 16 16:21:42 crc kubenswrapper[5120]: I0316 16:21:42.616461 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/1d4fa436-d4ae-48e8-b4db-5e9096c6f51d-ovndb-tls-certs\") pod \"neutron-6d4b69cb4d-gjpzv\" (UID: \"1d4fa436-d4ae-48e8-b4db-5e9096c6f51d\") " pod="openstack-kuttl-tests/neutron-6d4b69cb4d-gjpzv" Mar 16 16:21:42 crc kubenswrapper[5120]: I0316 16:21:42.616489 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1d4fa436-d4ae-48e8-b4db-5e9096c6f51d-combined-ca-bundle\") pod \"neutron-6d4b69cb4d-gjpzv\" (UID: \"1d4fa436-d4ae-48e8-b4db-5e9096c6f51d\") " pod="openstack-kuttl-tests/neutron-6d4b69cb4d-gjpzv" Mar 16 16:21:42 crc kubenswrapper[5120]: I0316 16:21:42.616516 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/1d4fa436-d4ae-48e8-b4db-5e9096c6f51d-internal-tls-certs\") pod \"neutron-6d4b69cb4d-gjpzv\" (UID: \"1d4fa436-d4ae-48e8-b4db-5e9096c6f51d\") " pod="openstack-kuttl-tests/neutron-6d4b69cb4d-gjpzv" Mar 16 16:21:42 crc kubenswrapper[5120]: I0316 16:21:42.616540 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/1d4fa436-d4ae-48e8-b4db-5e9096c6f51d-httpd-config\") pod \"neutron-6d4b69cb4d-gjpzv\" (UID: \"1d4fa436-d4ae-48e8-b4db-5e9096c6f51d\") " pod="openstack-kuttl-tests/neutron-6d4b69cb4d-gjpzv" Mar 16 16:21:42 crc kubenswrapper[5120]: I0316 16:21:42.616589 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/1d4fa436-d4ae-48e8-b4db-5e9096c6f51d-public-tls-certs\") pod \"neutron-6d4b69cb4d-gjpzv\" (UID: \"1d4fa436-d4ae-48e8-b4db-5e9096c6f51d\") " pod="openstack-kuttl-tests/neutron-6d4b69cb4d-gjpzv" Mar 16 16:21:42 crc kubenswrapper[5120]: I0316 16:21:42.616604 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1d4fa436-d4ae-48e8-b4db-5e9096c6f51d-config\") pod \"neutron-6d4b69cb4d-gjpzv\" (UID: \"1d4fa436-d4ae-48e8-b4db-5e9096c6f51d\") " pod="openstack-kuttl-tests/neutron-6d4b69cb4d-gjpzv" Mar 16 16:21:42 crc kubenswrapper[5120]: I0316 16:21:42.679620 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="88c05a13-c1ef-4aee-9a86-d91a80dc4af5" path="/var/lib/kubelet/pods/88c05a13-c1ef-4aee-9a86-d91a80dc4af5/volumes" Mar 16 16:21:42 crc kubenswrapper[5120]: I0316 16:21:42.718187 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rpxlr\" (UniqueName: \"kubernetes.io/projected/1d4fa436-d4ae-48e8-b4db-5e9096c6f51d-kube-api-access-rpxlr\") pod \"neutron-6d4b69cb4d-gjpzv\" (UID: \"1d4fa436-d4ae-48e8-b4db-5e9096c6f51d\") " pod="openstack-kuttl-tests/neutron-6d4b69cb4d-gjpzv" Mar 16 16:21:42 crc kubenswrapper[5120]: I0316 16:21:42.718309 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/1d4fa436-d4ae-48e8-b4db-5e9096c6f51d-ovndb-tls-certs\") pod \"neutron-6d4b69cb4d-gjpzv\" (UID: \"1d4fa436-d4ae-48e8-b4db-5e9096c6f51d\") " pod="openstack-kuttl-tests/neutron-6d4b69cb4d-gjpzv" Mar 16 16:21:42 crc kubenswrapper[5120]: I0316 16:21:42.718342 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1d4fa436-d4ae-48e8-b4db-5e9096c6f51d-combined-ca-bundle\") pod \"neutron-6d4b69cb4d-gjpzv\" (UID: \"1d4fa436-d4ae-48e8-b4db-5e9096c6f51d\") " pod="openstack-kuttl-tests/neutron-6d4b69cb4d-gjpzv" Mar 16 16:21:42 crc kubenswrapper[5120]: I0316 16:21:42.718372 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/1d4fa436-d4ae-48e8-b4db-5e9096c6f51d-internal-tls-certs\") pod \"neutron-6d4b69cb4d-gjpzv\" (UID: \"1d4fa436-d4ae-48e8-b4db-5e9096c6f51d\") " pod="openstack-kuttl-tests/neutron-6d4b69cb4d-gjpzv" Mar 16 16:21:42 crc kubenswrapper[5120]: I0316 16:21:42.718397 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/1d4fa436-d4ae-48e8-b4db-5e9096c6f51d-httpd-config\") pod \"neutron-6d4b69cb4d-gjpzv\" (UID: \"1d4fa436-d4ae-48e8-b4db-5e9096c6f51d\") " pod="openstack-kuttl-tests/neutron-6d4b69cb4d-gjpzv" Mar 16 16:21:42 crc kubenswrapper[5120]: I0316 16:21:42.718447 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/1d4fa436-d4ae-48e8-b4db-5e9096c6f51d-public-tls-certs\") pod \"neutron-6d4b69cb4d-gjpzv\" (UID: \"1d4fa436-d4ae-48e8-b4db-5e9096c6f51d\") " pod="openstack-kuttl-tests/neutron-6d4b69cb4d-gjpzv" Mar 16 16:21:42 crc kubenswrapper[5120]: I0316 16:21:42.718465 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1d4fa436-d4ae-48e8-b4db-5e9096c6f51d-config\") pod \"neutron-6d4b69cb4d-gjpzv\" (UID: \"1d4fa436-d4ae-48e8-b4db-5e9096c6f51d\") " pod="openstack-kuttl-tests/neutron-6d4b69cb4d-gjpzv" Mar 16 16:21:42 crc kubenswrapper[5120]: I0316 16:21:42.726199 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/1d4fa436-d4ae-48e8-b4db-5e9096c6f51d-public-tls-certs\") pod \"neutron-6d4b69cb4d-gjpzv\" (UID: \"1d4fa436-d4ae-48e8-b4db-5e9096c6f51d\") " pod="openstack-kuttl-tests/neutron-6d4b69cb4d-gjpzv" Mar 16 16:21:42 crc kubenswrapper[5120]: I0316 16:21:42.730488 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1d4fa436-d4ae-48e8-b4db-5e9096c6f51d-combined-ca-bundle\") pod \"neutron-6d4b69cb4d-gjpzv\" (UID: \"1d4fa436-d4ae-48e8-b4db-5e9096c6f51d\") " pod="openstack-kuttl-tests/neutron-6d4b69cb4d-gjpzv" Mar 16 16:21:42 crc kubenswrapper[5120]: I0316 16:21:42.734562 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/1d4fa436-d4ae-48e8-b4db-5e9096c6f51d-config\") pod \"neutron-6d4b69cb4d-gjpzv\" (UID: \"1d4fa436-d4ae-48e8-b4db-5e9096c6f51d\") " pod="openstack-kuttl-tests/neutron-6d4b69cb4d-gjpzv" Mar 16 16:21:42 crc kubenswrapper[5120]: I0316 16:21:42.735000 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/1d4fa436-d4ae-48e8-b4db-5e9096c6f51d-internal-tls-certs\") pod \"neutron-6d4b69cb4d-gjpzv\" (UID: \"1d4fa436-d4ae-48e8-b4db-5e9096c6f51d\") " pod="openstack-kuttl-tests/neutron-6d4b69cb4d-gjpzv" Mar 16 16:21:42 crc kubenswrapper[5120]: I0316 16:21:42.735109 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/1d4fa436-d4ae-48e8-b4db-5e9096c6f51d-httpd-config\") pod \"neutron-6d4b69cb4d-gjpzv\" (UID: \"1d4fa436-d4ae-48e8-b4db-5e9096c6f51d\") " pod="openstack-kuttl-tests/neutron-6d4b69cb4d-gjpzv" Mar 16 16:21:42 crc kubenswrapper[5120]: I0316 16:21:42.747208 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/1d4fa436-d4ae-48e8-b4db-5e9096c6f51d-ovndb-tls-certs\") pod \"neutron-6d4b69cb4d-gjpzv\" (UID: \"1d4fa436-d4ae-48e8-b4db-5e9096c6f51d\") " pod="openstack-kuttl-tests/neutron-6d4b69cb4d-gjpzv" Mar 16 16:21:42 crc kubenswrapper[5120]: I0316 16:21:42.750682 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rpxlr\" (UniqueName: \"kubernetes.io/projected/1d4fa436-d4ae-48e8-b4db-5e9096c6f51d-kube-api-access-rpxlr\") pod \"neutron-6d4b69cb4d-gjpzv\" (UID: \"1d4fa436-d4ae-48e8-b4db-5e9096c6f51d\") " pod="openstack-kuttl-tests/neutron-6d4b69cb4d-gjpzv" Mar 16 16:21:42 crc kubenswrapper[5120]: I0316 16:21:42.824566 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-6d4b69cb4d-gjpzv" Mar 16 16:21:42 crc kubenswrapper[5120]: I0316 16:21:42.865436 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:21:42 crc kubenswrapper[5120]: I0316 16:21:42.912498 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"73c9b7cf-53e7-4e3b-81c4-f674f8bfd894","Type":"ContainerStarted","Data":"23878926aa146c7ecaada59e28fe104d88160298b354a974fc41f65e98b026a1"} Mar 16 16:21:43 crc kubenswrapper[5120]: I0316 16:21:43.169359 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/watcher-api-0" Mar 16 16:21:43 crc kubenswrapper[5120]: I0316 16:21:43.328701 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-6d4b69cb4d-gjpzv"] Mar 16 16:21:43 crc kubenswrapper[5120]: W0316 16:21:43.369528 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1d4fa436_d4ae_48e8_b4db_5e9096c6f51d.slice/crio-24c0e6126828b2c9236a97cc04656d2b5b5bb7c609fb8e258917582512a4ff57 WatchSource:0}: Error finding container 24c0e6126828b2c9236a97cc04656d2b5b5bb7c609fb8e258917582512a4ff57: Status 404 returned error can't find the container with id 24c0e6126828b2c9236a97cc04656d2b5b5bb7c609fb8e258917582512a4ff57 Mar 16 16:21:43 crc kubenswrapper[5120]: I0316 16:21:43.937514 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"73c9b7cf-53e7-4e3b-81c4-f674f8bfd894","Type":"ContainerStarted","Data":"6d0c744e21abc67d4d22f2172b5ffdd0c1c8058e7ea0636d21a2bf8a35b91b0e"} Mar 16 16:21:43 crc kubenswrapper[5120]: I0316 16:21:43.949427 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-6d4b69cb4d-gjpzv" event={"ID":"1d4fa436-d4ae-48e8-b4db-5e9096c6f51d","Type":"ContainerStarted","Data":"769346ed2040f04a707d25f586265995e85d8fc1000ad07bd25db94424574293"} Mar 16 16:21:43 crc kubenswrapper[5120]: I0316 16:21:43.949458 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-6d4b69cb4d-gjpzv" event={"ID":"1d4fa436-d4ae-48e8-b4db-5e9096c6f51d","Type":"ContainerStarted","Data":"24c0e6126828b2c9236a97cc04656d2b5b5bb7c609fb8e258917582512a4ff57"} Mar 16 16:21:44 crc kubenswrapper[5120]: I0316 16:21:44.123139 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-v822j_ac55471d-4e42-475f-a082-50f611571482/kube-multus/0.log" Mar 16 16:21:44 crc kubenswrapper[5120]: I0316 16:21:44.155811 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-crc_9f0bc7fcb0822a2c13eb2d22cd8c0641/kube-controller-manager/0.log" Mar 16 16:21:44 crc kubenswrapper[5120]: I0316 16:21:44.161968 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-v822j_ac55471d-4e42-475f-a082-50f611571482/kube-multus/0.log" Mar 16 16:21:44 crc kubenswrapper[5120]: I0316 16:21:44.169700 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-crc_9f0bc7fcb0822a2c13eb2d22cd8c0641/kube-controller-manager/0.log" Mar 16 16:21:44 crc kubenswrapper[5120]: I0316 16:21:44.811212 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-85c89c7f6-6429v" Mar 16 16:21:44 crc kubenswrapper[5120]: I0316 16:21:44.959773 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-6d4b69cb4d-gjpzv" event={"ID":"1d4fa436-d4ae-48e8-b4db-5e9096c6f51d","Type":"ContainerStarted","Data":"c006c912d0b81da9cf43cada9cc7e6f4a1e0fac1e38af8ab7eb79480910018da"} Mar 16 16:21:44 crc kubenswrapper[5120]: I0316 16:21:44.959950 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/neutron-6d4b69cb4d-gjpzv" Mar 16 16:21:44 crc kubenswrapper[5120]: I0316 16:21:44.962685 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-85c89c7f6-6429v" Mar 16 16:21:44 crc kubenswrapper[5120]: I0316 16:21:44.962734 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"73c9b7cf-53e7-4e3b-81c4-f674f8bfd894","Type":"ContainerStarted","Data":"0828e02870000200de6ce67c3eccd85fed823e244bc79a5b6a48e7620b7e3a7b"} Mar 16 16:21:44 crc kubenswrapper[5120]: I0316 16:21:44.982526 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-6d4b69cb4d-gjpzv" podStartSLOduration=2.982502309 podStartE2EDuration="2.982502309s" podCreationTimestamp="2026-03-16 16:21:42 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:21:44.975138603 +0000 UTC m=+3007.129070260" watchObservedRunningTime="2026-03-16 16:21:44.982502309 +0000 UTC m=+3007.136433966" Mar 16 16:21:45 crc kubenswrapper[5120]: I0316 16:21:45.004591 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-scheduler-0" podStartSLOduration=4.00457503 podStartE2EDuration="4.00457503s" podCreationTimestamp="2026-03-16 16:21:41 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:21:45.001490038 +0000 UTC m=+3007.155421705" watchObservedRunningTime="2026-03-16 16:21:45.00457503 +0000 UTC m=+3007.158506687" Mar 16 16:21:45 crc kubenswrapper[5120]: I0316 16:21:45.164877 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-6b497d5884-fvxpp"] Mar 16 16:21:45 crc kubenswrapper[5120]: I0316 16:21:45.165124 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-6b497d5884-fvxpp" podUID="57c22289-a4b5-4b54-a910-5fdec6ac0be7" containerName="barbican-api-log" containerID="cri-o://c1a0f2ad5025128012c9fedc079104ec08b3ce3c8df14ee46277cd1d057b82f0" gracePeriod=30 Mar 16 16:21:45 crc kubenswrapper[5120]: I0316 16:21:45.165581 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-6b497d5884-fvxpp" podUID="57c22289-a4b5-4b54-a910-5fdec6ac0be7" containerName="barbican-api" containerID="cri-o://35ff5b911cade3b41afb99088225189dca6df087065a3b1ebbfc3cc5be684296" gracePeriod=30 Mar 16 16:21:45 crc kubenswrapper[5120]: I0316 16:21:45.271739 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:21:45 crc kubenswrapper[5120]: I0316 16:21:45.973997 5120 generic.go:358] "Generic (PLEG): container finished" podID="57c22289-a4b5-4b54-a910-5fdec6ac0be7" containerID="c1a0f2ad5025128012c9fedc079104ec08b3ce3c8df14ee46277cd1d057b82f0" exitCode=143 Mar 16 16:21:45 crc kubenswrapper[5120]: I0316 16:21:45.974083 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-6b497d5884-fvxpp" event={"ID":"57c22289-a4b5-4b54-a910-5fdec6ac0be7","Type":"ContainerDied","Data":"c1a0f2ad5025128012c9fedc079104ec08b3ce3c8df14ee46277cd1d057b82f0"} Mar 16 16:21:47 crc kubenswrapper[5120]: I0316 16:21:47.351985 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:21:47 crc kubenswrapper[5120]: I0316 16:21:47.663853 5120 scope.go:117] "RemoveContainer" containerID="f40e444f89abd558ac90555bfd58e04a1c4379a653ba8035c228d2b7a5443eb5" Mar 16 16:21:47 crc kubenswrapper[5120]: E0316 16:21:47.664462 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:21:48 crc kubenswrapper[5120]: I0316 16:21:48.169568 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/watcher-api-0" Mar 16 16:21:48 crc kubenswrapper[5120]: I0316 16:21:48.184316 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/watcher-api-0" Mar 16 16:21:48 crc kubenswrapper[5120]: I0316 16:21:48.382463 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-6b497d5884-fvxpp" podUID="57c22289-a4b5-4b54-a910-5fdec6ac0be7" containerName="barbican-api" probeResult="failure" output="Get \"http://10.217.1.91:9311/healthcheck\": read tcp 10.217.0.2:39758->10.217.1.91:9311: read: connection reset by peer" Mar 16 16:21:48 crc kubenswrapper[5120]: I0316 16:21:48.382589 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-6b497d5884-fvxpp" podUID="57c22289-a4b5-4b54-a910-5fdec6ac0be7" containerName="barbican-api-log" probeResult="failure" output="Get \"http://10.217.1.91:9311/healthcheck\": read tcp 10.217.0.2:44928->10.217.1.91:9311: read: connection reset by peer" Mar 16 16:21:48 crc kubenswrapper[5120]: I0316 16:21:48.886393 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-6b497d5884-fvxpp" Mar 16 16:21:49 crc kubenswrapper[5120]: I0316 16:21:49.009263 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/57c22289-a4b5-4b54-a910-5fdec6ac0be7-logs\") pod \"57c22289-a4b5-4b54-a910-5fdec6ac0be7\" (UID: \"57c22289-a4b5-4b54-a910-5fdec6ac0be7\") " Mar 16 16:21:49 crc kubenswrapper[5120]: I0316 16:21:49.009351 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/57c22289-a4b5-4b54-a910-5fdec6ac0be7-combined-ca-bundle\") pod \"57c22289-a4b5-4b54-a910-5fdec6ac0be7\" (UID: \"57c22289-a4b5-4b54-a910-5fdec6ac0be7\") " Mar 16 16:21:49 crc kubenswrapper[5120]: I0316 16:21:49.009647 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6tdpb\" (UniqueName: \"kubernetes.io/projected/57c22289-a4b5-4b54-a910-5fdec6ac0be7-kube-api-access-6tdpb\") pod \"57c22289-a4b5-4b54-a910-5fdec6ac0be7\" (UID: \"57c22289-a4b5-4b54-a910-5fdec6ac0be7\") " Mar 16 16:21:49 crc kubenswrapper[5120]: I0316 16:21:49.010293 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57c22289-a4b5-4b54-a910-5fdec6ac0be7-logs" (OuterVolumeSpecName: "logs") pod "57c22289-a4b5-4b54-a910-5fdec6ac0be7" (UID: "57c22289-a4b5-4b54-a910-5fdec6ac0be7"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:21:49 crc kubenswrapper[5120]: I0316 16:21:49.010584 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/57c22289-a4b5-4b54-a910-5fdec6ac0be7-config-data-custom\") pod \"57c22289-a4b5-4b54-a910-5fdec6ac0be7\" (UID: \"57c22289-a4b5-4b54-a910-5fdec6ac0be7\") " Mar 16 16:21:49 crc kubenswrapper[5120]: I0316 16:21:49.010959 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/57c22289-a4b5-4b54-a910-5fdec6ac0be7-config-data\") pod \"57c22289-a4b5-4b54-a910-5fdec6ac0be7\" (UID: \"57c22289-a4b5-4b54-a910-5fdec6ac0be7\") " Mar 16 16:21:49 crc kubenswrapper[5120]: I0316 16:21:49.013483 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/57c22289-a4b5-4b54-a910-5fdec6ac0be7-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:21:49 crc kubenswrapper[5120]: I0316 16:21:49.017990 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57c22289-a4b5-4b54-a910-5fdec6ac0be7-kube-api-access-6tdpb" (OuterVolumeSpecName: "kube-api-access-6tdpb") pod "57c22289-a4b5-4b54-a910-5fdec6ac0be7" (UID: "57c22289-a4b5-4b54-a910-5fdec6ac0be7"). InnerVolumeSpecName "kube-api-access-6tdpb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:21:49 crc kubenswrapper[5120]: I0316 16:21:49.019238 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/57c22289-a4b5-4b54-a910-5fdec6ac0be7-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "57c22289-a4b5-4b54-a910-5fdec6ac0be7" (UID: "57c22289-a4b5-4b54-a910-5fdec6ac0be7"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:21:49 crc kubenswrapper[5120]: I0316 16:21:49.029241 5120 generic.go:358] "Generic (PLEG): container finished" podID="57c22289-a4b5-4b54-a910-5fdec6ac0be7" containerID="35ff5b911cade3b41afb99088225189dca6df087065a3b1ebbfc3cc5be684296" exitCode=0 Mar 16 16:21:49 crc kubenswrapper[5120]: I0316 16:21:49.031331 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-6b497d5884-fvxpp" Mar 16 16:21:49 crc kubenswrapper[5120]: I0316 16:21:49.031780 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-6b497d5884-fvxpp" event={"ID":"57c22289-a4b5-4b54-a910-5fdec6ac0be7","Type":"ContainerDied","Data":"35ff5b911cade3b41afb99088225189dca6df087065a3b1ebbfc3cc5be684296"} Mar 16 16:21:49 crc kubenswrapper[5120]: I0316 16:21:49.031812 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-6b497d5884-fvxpp" event={"ID":"57c22289-a4b5-4b54-a910-5fdec6ac0be7","Type":"ContainerDied","Data":"76b5d0c22b39224c684c018a16072a7bd85500de7b58815706a2e8e5eaf35e9f"} Mar 16 16:21:49 crc kubenswrapper[5120]: I0316 16:21:49.031841 5120 scope.go:117] "RemoveContainer" containerID="35ff5b911cade3b41afb99088225189dca6df087065a3b1ebbfc3cc5be684296" Mar 16 16:21:49 crc kubenswrapper[5120]: I0316 16:21:49.046202 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/watcher-api-0" Mar 16 16:21:49 crc kubenswrapper[5120]: I0316 16:21:49.107964 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/57c22289-a4b5-4b54-a910-5fdec6ac0be7-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "57c22289-a4b5-4b54-a910-5fdec6ac0be7" (UID: "57c22289-a4b5-4b54-a910-5fdec6ac0be7"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:21:49 crc kubenswrapper[5120]: I0316 16:21:49.111061 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/57c22289-a4b5-4b54-a910-5fdec6ac0be7-config-data" (OuterVolumeSpecName: "config-data") pod "57c22289-a4b5-4b54-a910-5fdec6ac0be7" (UID: "57c22289-a4b5-4b54-a910-5fdec6ac0be7"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:21:49 crc kubenswrapper[5120]: I0316 16:21:49.115935 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/57c22289-a4b5-4b54-a910-5fdec6ac0be7-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:21:49 crc kubenswrapper[5120]: I0316 16:21:49.115959 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6tdpb\" (UniqueName: \"kubernetes.io/projected/57c22289-a4b5-4b54-a910-5fdec6ac0be7-kube-api-access-6tdpb\") on node \"crc\" DevicePath \"\"" Mar 16 16:21:49 crc kubenswrapper[5120]: I0316 16:21:49.115970 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/57c22289-a4b5-4b54-a910-5fdec6ac0be7-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:21:49 crc kubenswrapper[5120]: I0316 16:21:49.115979 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/57c22289-a4b5-4b54-a910-5fdec6ac0be7-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:21:49 crc kubenswrapper[5120]: I0316 16:21:49.154003 5120 scope.go:117] "RemoveContainer" containerID="c1a0f2ad5025128012c9fedc079104ec08b3ce3c8df14ee46277cd1d057b82f0" Mar 16 16:21:49 crc kubenswrapper[5120]: I0316 16:21:49.185977 5120 scope.go:117] "RemoveContainer" containerID="35ff5b911cade3b41afb99088225189dca6df087065a3b1ebbfc3cc5be684296" Mar 16 16:21:49 crc kubenswrapper[5120]: E0316 16:21:49.186521 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"35ff5b911cade3b41afb99088225189dca6df087065a3b1ebbfc3cc5be684296\": container with ID starting with 35ff5b911cade3b41afb99088225189dca6df087065a3b1ebbfc3cc5be684296 not found: ID does not exist" containerID="35ff5b911cade3b41afb99088225189dca6df087065a3b1ebbfc3cc5be684296" Mar 16 16:21:49 crc kubenswrapper[5120]: I0316 16:21:49.186622 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35ff5b911cade3b41afb99088225189dca6df087065a3b1ebbfc3cc5be684296"} err="failed to get container status \"35ff5b911cade3b41afb99088225189dca6df087065a3b1ebbfc3cc5be684296\": rpc error: code = NotFound desc = could not find container \"35ff5b911cade3b41afb99088225189dca6df087065a3b1ebbfc3cc5be684296\": container with ID starting with 35ff5b911cade3b41afb99088225189dca6df087065a3b1ebbfc3cc5be684296 not found: ID does not exist" Mar 16 16:21:49 crc kubenswrapper[5120]: I0316 16:21:49.186695 5120 scope.go:117] "RemoveContainer" containerID="c1a0f2ad5025128012c9fedc079104ec08b3ce3c8df14ee46277cd1d057b82f0" Mar 16 16:21:49 crc kubenswrapper[5120]: E0316 16:21:49.187173 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c1a0f2ad5025128012c9fedc079104ec08b3ce3c8df14ee46277cd1d057b82f0\": container with ID starting with c1a0f2ad5025128012c9fedc079104ec08b3ce3c8df14ee46277cd1d057b82f0 not found: ID does not exist" containerID="c1a0f2ad5025128012c9fedc079104ec08b3ce3c8df14ee46277cd1d057b82f0" Mar 16 16:21:49 crc kubenswrapper[5120]: I0316 16:21:49.187267 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1a0f2ad5025128012c9fedc079104ec08b3ce3c8df14ee46277cd1d057b82f0"} err="failed to get container status \"c1a0f2ad5025128012c9fedc079104ec08b3ce3c8df14ee46277cd1d057b82f0\": rpc error: code = NotFound desc = could not find container \"c1a0f2ad5025128012c9fedc079104ec08b3ce3c8df14ee46277cd1d057b82f0\": container with ID starting with c1a0f2ad5025128012c9fedc079104ec08b3ce3c8df14ee46277cd1d057b82f0 not found: ID does not exist" Mar 16 16:21:49 crc kubenswrapper[5120]: I0316 16:21:49.363499 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-6b497d5884-fvxpp"] Mar 16 16:21:49 crc kubenswrapper[5120]: I0316 16:21:49.372057 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-api-6b497d5884-fvxpp"] Mar 16 16:21:50 crc kubenswrapper[5120]: I0316 16:21:50.675324 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="57c22289-a4b5-4b54-a910-5fdec6ac0be7" path="/var/lib/kubelet/pods/57c22289-a4b5-4b54-a910-5fdec6ac0be7/volumes" Mar 16 16:21:52 crc kubenswrapper[5120]: I0316 16:21:52.549595 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:21:53 crc kubenswrapper[5120]: I0316 16:21:53.195867 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/placement-749879f798-p2tp8" Mar 16 16:21:54 crc kubenswrapper[5120]: I0316 16:21:54.211693 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/placement-749879f798-p2tp8" Mar 16 16:21:54 crc kubenswrapper[5120]: I0316 16:21:54.427175 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-87c8bf854-gkthd"] Mar 16 16:21:54 crc kubenswrapper[5120]: I0316 16:21:54.429085 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57c22289-a4b5-4b54-a910-5fdec6ac0be7" containerName="barbican-api" Mar 16 16:21:54 crc kubenswrapper[5120]: I0316 16:21:54.429117 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="57c22289-a4b5-4b54-a910-5fdec6ac0be7" containerName="barbican-api" Mar 16 16:21:54 crc kubenswrapper[5120]: I0316 16:21:54.429458 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57c22289-a4b5-4b54-a910-5fdec6ac0be7" containerName="barbican-api-log" Mar 16 16:21:54 crc kubenswrapper[5120]: I0316 16:21:54.429522 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="57c22289-a4b5-4b54-a910-5fdec6ac0be7" containerName="barbican-api-log" Mar 16 16:21:54 crc kubenswrapper[5120]: I0316 16:21:54.483649 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="57c22289-a4b5-4b54-a910-5fdec6ac0be7" containerName="barbican-api" Mar 16 16:21:54 crc kubenswrapper[5120]: I0316 16:21:54.483690 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="57c22289-a4b5-4b54-a910-5fdec6ac0be7" containerName="barbican-api-log" Mar 16 16:21:54 crc kubenswrapper[5120]: I0316 16:21:54.500914 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-87c8bf854-gkthd"] Mar 16 16:21:54 crc kubenswrapper[5120]: I0316 16:21:54.501056 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-87c8bf854-gkthd" Mar 16 16:21:54 crc kubenswrapper[5120]: I0316 16:21:54.589741 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/771204f4-c55f-4a6e-be63-70f3d1c8a51e-logs\") pod \"placement-87c8bf854-gkthd\" (UID: \"771204f4-c55f-4a6e-be63-70f3d1c8a51e\") " pod="openstack-kuttl-tests/placement-87c8bf854-gkthd" Mar 16 16:21:54 crc kubenswrapper[5120]: I0316 16:21:54.589831 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/771204f4-c55f-4a6e-be63-70f3d1c8a51e-internal-tls-certs\") pod \"placement-87c8bf854-gkthd\" (UID: \"771204f4-c55f-4a6e-be63-70f3d1c8a51e\") " pod="openstack-kuttl-tests/placement-87c8bf854-gkthd" Mar 16 16:21:54 crc kubenswrapper[5120]: I0316 16:21:54.589864 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/771204f4-c55f-4a6e-be63-70f3d1c8a51e-combined-ca-bundle\") pod \"placement-87c8bf854-gkthd\" (UID: \"771204f4-c55f-4a6e-be63-70f3d1c8a51e\") " pod="openstack-kuttl-tests/placement-87c8bf854-gkthd" Mar 16 16:21:54 crc kubenswrapper[5120]: I0316 16:21:54.589912 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/771204f4-c55f-4a6e-be63-70f3d1c8a51e-config-data\") pod \"placement-87c8bf854-gkthd\" (UID: \"771204f4-c55f-4a6e-be63-70f3d1c8a51e\") " pod="openstack-kuttl-tests/placement-87c8bf854-gkthd" Mar 16 16:21:54 crc kubenswrapper[5120]: I0316 16:21:54.589925 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/771204f4-c55f-4a6e-be63-70f3d1c8a51e-public-tls-certs\") pod \"placement-87c8bf854-gkthd\" (UID: \"771204f4-c55f-4a6e-be63-70f3d1c8a51e\") " pod="openstack-kuttl-tests/placement-87c8bf854-gkthd" Mar 16 16:21:54 crc kubenswrapper[5120]: I0316 16:21:54.589956 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/771204f4-c55f-4a6e-be63-70f3d1c8a51e-scripts\") pod \"placement-87c8bf854-gkthd\" (UID: \"771204f4-c55f-4a6e-be63-70f3d1c8a51e\") " pod="openstack-kuttl-tests/placement-87c8bf854-gkthd" Mar 16 16:21:54 crc kubenswrapper[5120]: I0316 16:21:54.590004 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pssnq\" (UniqueName: \"kubernetes.io/projected/771204f4-c55f-4a6e-be63-70f3d1c8a51e-kube-api-access-pssnq\") pod \"placement-87c8bf854-gkthd\" (UID: \"771204f4-c55f-4a6e-be63-70f3d1c8a51e\") " pod="openstack-kuttl-tests/placement-87c8bf854-gkthd" Mar 16 16:21:54 crc kubenswrapper[5120]: I0316 16:21:54.691703 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/771204f4-c55f-4a6e-be63-70f3d1c8a51e-combined-ca-bundle\") pod \"placement-87c8bf854-gkthd\" (UID: \"771204f4-c55f-4a6e-be63-70f3d1c8a51e\") " pod="openstack-kuttl-tests/placement-87c8bf854-gkthd" Mar 16 16:21:54 crc kubenswrapper[5120]: I0316 16:21:54.691803 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/771204f4-c55f-4a6e-be63-70f3d1c8a51e-config-data\") pod \"placement-87c8bf854-gkthd\" (UID: \"771204f4-c55f-4a6e-be63-70f3d1c8a51e\") " pod="openstack-kuttl-tests/placement-87c8bf854-gkthd" Mar 16 16:21:54 crc kubenswrapper[5120]: I0316 16:21:54.691824 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/771204f4-c55f-4a6e-be63-70f3d1c8a51e-public-tls-certs\") pod \"placement-87c8bf854-gkthd\" (UID: \"771204f4-c55f-4a6e-be63-70f3d1c8a51e\") " pod="openstack-kuttl-tests/placement-87c8bf854-gkthd" Mar 16 16:21:54 crc kubenswrapper[5120]: I0316 16:21:54.691875 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/771204f4-c55f-4a6e-be63-70f3d1c8a51e-scripts\") pod \"placement-87c8bf854-gkthd\" (UID: \"771204f4-c55f-4a6e-be63-70f3d1c8a51e\") " pod="openstack-kuttl-tests/placement-87c8bf854-gkthd" Mar 16 16:21:54 crc kubenswrapper[5120]: I0316 16:21:54.691945 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pssnq\" (UniqueName: \"kubernetes.io/projected/771204f4-c55f-4a6e-be63-70f3d1c8a51e-kube-api-access-pssnq\") pod \"placement-87c8bf854-gkthd\" (UID: \"771204f4-c55f-4a6e-be63-70f3d1c8a51e\") " pod="openstack-kuttl-tests/placement-87c8bf854-gkthd" Mar 16 16:21:54 crc kubenswrapper[5120]: I0316 16:21:54.692269 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/771204f4-c55f-4a6e-be63-70f3d1c8a51e-logs\") pod \"placement-87c8bf854-gkthd\" (UID: \"771204f4-c55f-4a6e-be63-70f3d1c8a51e\") " pod="openstack-kuttl-tests/placement-87c8bf854-gkthd" Mar 16 16:21:54 crc kubenswrapper[5120]: I0316 16:21:54.692420 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/771204f4-c55f-4a6e-be63-70f3d1c8a51e-internal-tls-certs\") pod \"placement-87c8bf854-gkthd\" (UID: \"771204f4-c55f-4a6e-be63-70f3d1c8a51e\") " pod="openstack-kuttl-tests/placement-87c8bf854-gkthd" Mar 16 16:21:54 crc kubenswrapper[5120]: I0316 16:21:54.692811 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/771204f4-c55f-4a6e-be63-70f3d1c8a51e-logs\") pod \"placement-87c8bf854-gkthd\" (UID: \"771204f4-c55f-4a6e-be63-70f3d1c8a51e\") " pod="openstack-kuttl-tests/placement-87c8bf854-gkthd" Mar 16 16:21:54 crc kubenswrapper[5120]: I0316 16:21:54.698987 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/771204f4-c55f-4a6e-be63-70f3d1c8a51e-combined-ca-bundle\") pod \"placement-87c8bf854-gkthd\" (UID: \"771204f4-c55f-4a6e-be63-70f3d1c8a51e\") " pod="openstack-kuttl-tests/placement-87c8bf854-gkthd" Mar 16 16:21:54 crc kubenswrapper[5120]: I0316 16:21:54.699253 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/771204f4-c55f-4a6e-be63-70f3d1c8a51e-scripts\") pod \"placement-87c8bf854-gkthd\" (UID: \"771204f4-c55f-4a6e-be63-70f3d1c8a51e\") " pod="openstack-kuttl-tests/placement-87c8bf854-gkthd" Mar 16 16:21:54 crc kubenswrapper[5120]: I0316 16:21:54.706372 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/771204f4-c55f-4a6e-be63-70f3d1c8a51e-config-data\") pod \"placement-87c8bf854-gkthd\" (UID: \"771204f4-c55f-4a6e-be63-70f3d1c8a51e\") " pod="openstack-kuttl-tests/placement-87c8bf854-gkthd" Mar 16 16:21:54 crc kubenswrapper[5120]: I0316 16:21:54.707456 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/771204f4-c55f-4a6e-be63-70f3d1c8a51e-public-tls-certs\") pod \"placement-87c8bf854-gkthd\" (UID: \"771204f4-c55f-4a6e-be63-70f3d1c8a51e\") " pod="openstack-kuttl-tests/placement-87c8bf854-gkthd" Mar 16 16:21:54 crc kubenswrapper[5120]: I0316 16:21:54.709899 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/771204f4-c55f-4a6e-be63-70f3d1c8a51e-internal-tls-certs\") pod \"placement-87c8bf854-gkthd\" (UID: \"771204f4-c55f-4a6e-be63-70f3d1c8a51e\") " pod="openstack-kuttl-tests/placement-87c8bf854-gkthd" Mar 16 16:21:54 crc kubenswrapper[5120]: I0316 16:21:54.712259 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pssnq\" (UniqueName: \"kubernetes.io/projected/771204f4-c55f-4a6e-be63-70f3d1c8a51e-kube-api-access-pssnq\") pod \"placement-87c8bf854-gkthd\" (UID: \"771204f4-c55f-4a6e-be63-70f3d1c8a51e\") " pod="openstack-kuttl-tests/placement-87c8bf854-gkthd" Mar 16 16:21:54 crc kubenswrapper[5120]: I0316 16:21:54.821312 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-87c8bf854-gkthd" Mar 16 16:21:55 crc kubenswrapper[5120]: I0316 16:21:55.305034 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-87c8bf854-gkthd"] Mar 16 16:21:56 crc kubenswrapper[5120]: I0316 16:21:56.110993 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-87c8bf854-gkthd" event={"ID":"771204f4-c55f-4a6e-be63-70f3d1c8a51e","Type":"ContainerStarted","Data":"7c4f8549d75fe7169915e7f6cda9d1b1a6faa1e896903408eeb16bd5e1ec8969"} Mar 16 16:21:56 crc kubenswrapper[5120]: I0316 16:21:56.111393 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-87c8bf854-gkthd" Mar 16 16:21:56 crc kubenswrapper[5120]: I0316 16:21:56.111409 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-87c8bf854-gkthd" event={"ID":"771204f4-c55f-4a6e-be63-70f3d1c8a51e","Type":"ContainerStarted","Data":"3a19d570305168b53a02c3d68205387f2601dd914bd1d418b04fabacd375394c"} Mar 16 16:21:56 crc kubenswrapper[5120]: I0316 16:21:56.111423 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-87c8bf854-gkthd" event={"ID":"771204f4-c55f-4a6e-be63-70f3d1c8a51e","Type":"ContainerStarted","Data":"be03b69fe55b2f23810330a8ea422eea7dc474c4dbfe4a78a1f517279c23f519"} Mar 16 16:21:56 crc kubenswrapper[5120]: I0316 16:21:56.111441 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-87c8bf854-gkthd" Mar 16 16:21:56 crc kubenswrapper[5120]: I0316 16:21:56.148875 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-87c8bf854-gkthd" podStartSLOduration=2.148841007 podStartE2EDuration="2.148841007s" podCreationTimestamp="2026-03-16 16:21:54 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:21:56.135866781 +0000 UTC m=+3018.289798468" watchObservedRunningTime="2026-03-16 16:21:56.148841007 +0000 UTC m=+3018.302772704" Mar 16 16:21:58 crc kubenswrapper[5120]: I0316 16:21:58.684992 5120 scope.go:117] "RemoveContainer" containerID="f40e444f89abd558ac90555bfd58e04a1c4379a653ba8035c228d2b7a5443eb5" Mar 16 16:21:58 crc kubenswrapper[5120]: E0316 16:21:58.686363 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:22:00 crc kubenswrapper[5120]: I0316 16:22:00.148013 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-infra/auto-csr-approver-29561302-8vlww"] Mar 16 16:22:00 crc kubenswrapper[5120]: I0316 16:22:00.156458 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561302-8vlww" Mar 16 16:22:00 crc kubenswrapper[5120]: I0316 16:22:00.159355 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"kube-root-ca.crt\"" Mar 16 16:22:00 crc kubenswrapper[5120]: I0316 16:22:00.159591 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"openshift-service-ca.crt\"" Mar 16 16:22:00 crc kubenswrapper[5120]: I0316 16:22:00.160650 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-infra\"/\"csr-approver-sa-dockercfg-x2nsz\"" Mar 16 16:22:00 crc kubenswrapper[5120]: I0316 16:22:00.166364 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561302-8vlww"] Mar 16 16:22:00 crc kubenswrapper[5120]: I0316 16:22:00.264214 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzr9d\" (UniqueName: \"kubernetes.io/projected/f82ef7e7-0afb-4c91-975f-29517a090cb7-kube-api-access-jzr9d\") pod \"auto-csr-approver-29561302-8vlww\" (UID: \"f82ef7e7-0afb-4c91-975f-29517a090cb7\") " pod="openshift-infra/auto-csr-approver-29561302-8vlww" Mar 16 16:22:00 crc kubenswrapper[5120]: I0316 16:22:00.367014 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jzr9d\" (UniqueName: \"kubernetes.io/projected/f82ef7e7-0afb-4c91-975f-29517a090cb7-kube-api-access-jzr9d\") pod \"auto-csr-approver-29561302-8vlww\" (UID: \"f82ef7e7-0afb-4c91-975f-29517a090cb7\") " pod="openshift-infra/auto-csr-approver-29561302-8vlww" Mar 16 16:22:00 crc kubenswrapper[5120]: I0316 16:22:00.386129 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzr9d\" (UniqueName: \"kubernetes.io/projected/f82ef7e7-0afb-4c91-975f-29517a090cb7-kube-api-access-jzr9d\") pod \"auto-csr-approver-29561302-8vlww\" (UID: \"f82ef7e7-0afb-4c91-975f-29517a090cb7\") " pod="openshift-infra/auto-csr-approver-29561302-8vlww" Mar 16 16:22:00 crc kubenswrapper[5120]: I0316 16:22:00.479674 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561302-8vlww" Mar 16 16:22:01 crc kubenswrapper[5120]: W0316 16:22:01.001268 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf82ef7e7_0afb_4c91_975f_29517a090cb7.slice/crio-2f99861953d5c1f86c223e8a413397f0e559155f6b4927f924d433a5c6a8949f WatchSource:0}: Error finding container 2f99861953d5c1f86c223e8a413397f0e559155f6b4927f924d433a5c6a8949f: Status 404 returned error can't find the container with id 2f99861953d5c1f86c223e8a413397f0e559155f6b4927f924d433a5c6a8949f Mar 16 16:22:01 crc kubenswrapper[5120]: I0316 16:22:01.008789 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561302-8vlww"] Mar 16 16:22:01 crc kubenswrapper[5120]: I0316 16:22:01.169370 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561302-8vlww" event={"ID":"f82ef7e7-0afb-4c91-975f-29517a090cb7","Type":"ContainerStarted","Data":"2f99861953d5c1f86c223e8a413397f0e559155f6b4927f924d433a5c6a8949f"} Mar 16 16:22:02 crc kubenswrapper[5120]: I0316 16:22:02.953310 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/keystone-7bc85bbbf-4ttl9" Mar 16 16:22:03 crc kubenswrapper[5120]: I0316 16:22:03.190571 5120 generic.go:358] "Generic (PLEG): container finished" podID="f82ef7e7-0afb-4c91-975f-29517a090cb7" containerID="581650431b98ec2c16d7a6badc54a9a72e12d063f9f18749b4c73247e67cb6bf" exitCode=0 Mar 16 16:22:03 crc kubenswrapper[5120]: I0316 16:22:03.190724 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561302-8vlww" event={"ID":"f82ef7e7-0afb-4c91-975f-29517a090cb7","Type":"ContainerDied","Data":"581650431b98ec2c16d7a6badc54a9a72e12d063f9f18749b4c73247e67cb6bf"} Mar 16 16:22:04 crc kubenswrapper[5120]: I0316 16:22:04.632281 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561302-8vlww" Mar 16 16:22:04 crc kubenswrapper[5120]: I0316 16:22:04.680125 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jzr9d\" (UniqueName: \"kubernetes.io/projected/f82ef7e7-0afb-4c91-975f-29517a090cb7-kube-api-access-jzr9d\") pod \"f82ef7e7-0afb-4c91-975f-29517a090cb7\" (UID: \"f82ef7e7-0afb-4c91-975f-29517a090cb7\") " Mar 16 16:22:04 crc kubenswrapper[5120]: I0316 16:22:04.692241 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f82ef7e7-0afb-4c91-975f-29517a090cb7-kube-api-access-jzr9d" (OuterVolumeSpecName: "kube-api-access-jzr9d") pod "f82ef7e7-0afb-4c91-975f-29517a090cb7" (UID: "f82ef7e7-0afb-4c91-975f-29517a090cb7"). InnerVolumeSpecName "kube-api-access-jzr9d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:22:04 crc kubenswrapper[5120]: I0316 16:22:04.784154 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jzr9d\" (UniqueName: \"kubernetes.io/projected/f82ef7e7-0afb-4c91-975f-29517a090cb7-kube-api-access-jzr9d\") on node \"crc\" DevicePath \"\"" Mar 16 16:22:05 crc kubenswrapper[5120]: I0316 16:22:05.230521 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561302-8vlww" event={"ID":"f82ef7e7-0afb-4c91-975f-29517a090cb7","Type":"ContainerDied","Data":"2f99861953d5c1f86c223e8a413397f0e559155f6b4927f924d433a5c6a8949f"} Mar 16 16:22:05 crc kubenswrapper[5120]: I0316 16:22:05.230940 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2f99861953d5c1f86c223e8a413397f0e559155f6b4927f924d433a5c6a8949f" Mar 16 16:22:05 crc kubenswrapper[5120]: I0316 16:22:05.231095 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561302-8vlww" Mar 16 16:22:05 crc kubenswrapper[5120]: I0316 16:22:05.443221 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 16:22:05 crc kubenswrapper[5120]: I0316 16:22:05.451434 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f82ef7e7-0afb-4c91-975f-29517a090cb7" containerName="oc" Mar 16 16:22:05 crc kubenswrapper[5120]: I0316 16:22:05.451472 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f82ef7e7-0afb-4c91-975f-29517a090cb7" containerName="oc" Mar 16 16:22:05 crc kubenswrapper[5120]: I0316 16:22:05.451791 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f82ef7e7-0afb-4c91-975f-29517a090cb7" containerName="oc" Mar 16 16:22:05 crc kubenswrapper[5120]: I0316 16:22:05.464215 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 16:22:05 crc kubenswrapper[5120]: I0316 16:22:05.464542 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Mar 16 16:22:05 crc kubenswrapper[5120]: I0316 16:22:05.467437 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"openstack-config-secret\"" Mar 16 16:22:05 crc kubenswrapper[5120]: I0316 16:22:05.468954 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-config\"" Mar 16 16:22:05 crc kubenswrapper[5120]: I0316 16:22:05.472087 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"openstackclient-openstackclient-dockercfg-r9bpb\"" Mar 16 16:22:05 crc kubenswrapper[5120]: I0316 16:22:05.527295 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4c4d0f9a-4660-44c7-aa3c-4653612142bb-combined-ca-bundle\") pod \"openstackclient\" (UID: \"4c4d0f9a-4660-44c7-aa3c-4653612142bb\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:22:05 crc kubenswrapper[5120]: I0316 16:22:05.527909 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctbnz\" (UniqueName: \"kubernetes.io/projected/4c4d0f9a-4660-44c7-aa3c-4653612142bb-kube-api-access-ctbnz\") pod \"openstackclient\" (UID: \"4c4d0f9a-4660-44c7-aa3c-4653612142bb\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:22:05 crc kubenswrapper[5120]: I0316 16:22:05.528068 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/4c4d0f9a-4660-44c7-aa3c-4653612142bb-openstack-config-secret\") pod \"openstackclient\" (UID: \"4c4d0f9a-4660-44c7-aa3c-4653612142bb\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:22:05 crc kubenswrapper[5120]: I0316 16:22:05.528481 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/4c4d0f9a-4660-44c7-aa3c-4653612142bb-openstack-config\") pod \"openstackclient\" (UID: \"4c4d0f9a-4660-44c7-aa3c-4653612142bb\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:22:05 crc kubenswrapper[5120]: I0316 16:22:05.630993 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4c4d0f9a-4660-44c7-aa3c-4653612142bb-combined-ca-bundle\") pod \"openstackclient\" (UID: \"4c4d0f9a-4660-44c7-aa3c-4653612142bb\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:22:05 crc kubenswrapper[5120]: I0316 16:22:05.631078 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ctbnz\" (UniqueName: \"kubernetes.io/projected/4c4d0f9a-4660-44c7-aa3c-4653612142bb-kube-api-access-ctbnz\") pod \"openstackclient\" (UID: \"4c4d0f9a-4660-44c7-aa3c-4653612142bb\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:22:05 crc kubenswrapper[5120]: I0316 16:22:05.631102 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/4c4d0f9a-4660-44c7-aa3c-4653612142bb-openstack-config-secret\") pod \"openstackclient\" (UID: \"4c4d0f9a-4660-44c7-aa3c-4653612142bb\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:22:05 crc kubenswrapper[5120]: I0316 16:22:05.631203 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/4c4d0f9a-4660-44c7-aa3c-4653612142bb-openstack-config\") pod \"openstackclient\" (UID: \"4c4d0f9a-4660-44c7-aa3c-4653612142bb\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:22:05 crc kubenswrapper[5120]: I0316 16:22:05.632115 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/4c4d0f9a-4660-44c7-aa3c-4653612142bb-openstack-config\") pod \"openstackclient\" (UID: \"4c4d0f9a-4660-44c7-aa3c-4653612142bb\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:22:05 crc kubenswrapper[5120]: I0316 16:22:05.642472 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/4c4d0f9a-4660-44c7-aa3c-4653612142bb-openstack-config-secret\") pod \"openstackclient\" (UID: \"4c4d0f9a-4660-44c7-aa3c-4653612142bb\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:22:05 crc kubenswrapper[5120]: I0316 16:22:05.645260 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4c4d0f9a-4660-44c7-aa3c-4653612142bb-combined-ca-bundle\") pod \"openstackclient\" (UID: \"4c4d0f9a-4660-44c7-aa3c-4653612142bb\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:22:05 crc kubenswrapper[5120]: I0316 16:22:05.661697 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctbnz\" (UniqueName: \"kubernetes.io/projected/4c4d0f9a-4660-44c7-aa3c-4653612142bb-kube-api-access-ctbnz\") pod \"openstackclient\" (UID: \"4c4d0f9a-4660-44c7-aa3c-4653612142bb\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:22:05 crc kubenswrapper[5120]: I0316 16:22:05.702989 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-infra/auto-csr-approver-29561296-84z27"] Mar 16 16:22:05 crc kubenswrapper[5120]: I0316 16:22:05.713092 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-infra/auto-csr-approver-29561296-84z27"] Mar 16 16:22:05 crc kubenswrapper[5120]: I0316 16:22:05.800698 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Mar 16 16:22:06 crc kubenswrapper[5120]: I0316 16:22:06.302573 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 16:22:06 crc kubenswrapper[5120]: W0316 16:22:06.304595 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4c4d0f9a_4660_44c7_aa3c_4653612142bb.slice/crio-fa2d35e12665742b1e5b23931bfbdd5a8f50cd18d6a6dcbadc1945cd4113aeb7 WatchSource:0}: Error finding container fa2d35e12665742b1e5b23931bfbdd5a8f50cd18d6a6dcbadc1945cd4113aeb7: Status 404 returned error can't find the container with id fa2d35e12665742b1e5b23931bfbdd5a8f50cd18d6a6dcbadc1945cd4113aeb7 Mar 16 16:22:06 crc kubenswrapper[5120]: I0316 16:22:06.676141 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="18f9bc9d-6434-4b9f-a8f2-0135edd298d4" path="/var/lib/kubelet/pods/18f9bc9d-6434-4b9f-a8f2-0135edd298d4/volumes" Mar 16 16:22:07 crc kubenswrapper[5120]: I0316 16:22:07.250862 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstackclient" event={"ID":"4c4d0f9a-4660-44c7-aa3c-4653612142bb","Type":"ContainerStarted","Data":"96164b8ea75d052b461cddb068f1640ceb2bc89fadd9423f78383162a3347b9f"} Mar 16 16:22:07 crc kubenswrapper[5120]: I0316 16:22:07.251135 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstackclient" event={"ID":"4c4d0f9a-4660-44c7-aa3c-4653612142bb","Type":"ContainerStarted","Data":"fa2d35e12665742b1e5b23931bfbdd5a8f50cd18d6a6dcbadc1945cd4113aeb7"} Mar 16 16:22:07 crc kubenswrapper[5120]: I0316 16:22:07.280203 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstackclient" podStartSLOduration=2.28018373 podStartE2EDuration="2.28018373s" podCreationTimestamp="2026-03-16 16:22:05 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:22:07.26521532 +0000 UTC m=+3029.419146977" watchObservedRunningTime="2026-03-16 16:22:07.28018373 +0000 UTC m=+3029.434115397" Mar 16 16:22:07 crc kubenswrapper[5120]: E0316 16:22:07.946868 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1788209 actualBytes=10240 Mar 16 16:22:08 crc kubenswrapper[5120]: I0316 16:22:08.841410 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/swift-proxy-8698d79fbb-6czlj"] Mar 16 16:22:08 crc kubenswrapper[5120]: I0316 16:22:08.855175 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-8698d79fbb-6czlj" Mar 16 16:22:08 crc kubenswrapper[5120]: I0316 16:22:08.857750 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"swift-proxy-config-data\"" Mar 16 16:22:08 crc kubenswrapper[5120]: I0316 16:22:08.860742 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-swift-public-svc\"" Mar 16 16:22:08 crc kubenswrapper[5120]: I0316 16:22:08.861721 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-swift-internal-svc\"" Mar 16 16:22:08 crc kubenswrapper[5120]: I0316 16:22:08.866970 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-proxy-8698d79fbb-6czlj"] Mar 16 16:22:08 crc kubenswrapper[5120]: I0316 16:22:08.915304 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/90dbf97e-452f-4fce-8ceb-07fda29e83b8-combined-ca-bundle\") pod \"swift-proxy-8698d79fbb-6czlj\" (UID: \"90dbf97e-452f-4fce-8ceb-07fda29e83b8\") " pod="openstack-kuttl-tests/swift-proxy-8698d79fbb-6czlj" Mar 16 16:22:08 crc kubenswrapper[5120]: I0316 16:22:08.915361 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/90dbf97e-452f-4fce-8ceb-07fda29e83b8-public-tls-certs\") pod \"swift-proxy-8698d79fbb-6czlj\" (UID: \"90dbf97e-452f-4fce-8ceb-07fda29e83b8\") " pod="openstack-kuttl-tests/swift-proxy-8698d79fbb-6czlj" Mar 16 16:22:08 crc kubenswrapper[5120]: I0316 16:22:08.915393 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/90dbf97e-452f-4fce-8ceb-07fda29e83b8-config-data\") pod \"swift-proxy-8698d79fbb-6czlj\" (UID: \"90dbf97e-452f-4fce-8ceb-07fda29e83b8\") " pod="openstack-kuttl-tests/swift-proxy-8698d79fbb-6czlj" Mar 16 16:22:08 crc kubenswrapper[5120]: I0316 16:22:08.915731 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/90dbf97e-452f-4fce-8ceb-07fda29e83b8-run-httpd\") pod \"swift-proxy-8698d79fbb-6czlj\" (UID: \"90dbf97e-452f-4fce-8ceb-07fda29e83b8\") " pod="openstack-kuttl-tests/swift-proxy-8698d79fbb-6czlj" Mar 16 16:22:08 crc kubenswrapper[5120]: I0316 16:22:08.915874 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/90dbf97e-452f-4fce-8ceb-07fda29e83b8-internal-tls-certs\") pod \"swift-proxy-8698d79fbb-6czlj\" (UID: \"90dbf97e-452f-4fce-8ceb-07fda29e83b8\") " pod="openstack-kuttl-tests/swift-proxy-8698d79fbb-6czlj" Mar 16 16:22:08 crc kubenswrapper[5120]: I0316 16:22:08.915899 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpc8b\" (UniqueName: \"kubernetes.io/projected/90dbf97e-452f-4fce-8ceb-07fda29e83b8-kube-api-access-wpc8b\") pod \"swift-proxy-8698d79fbb-6czlj\" (UID: \"90dbf97e-452f-4fce-8ceb-07fda29e83b8\") " pod="openstack-kuttl-tests/swift-proxy-8698d79fbb-6czlj" Mar 16 16:22:08 crc kubenswrapper[5120]: I0316 16:22:08.915981 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/90dbf97e-452f-4fce-8ceb-07fda29e83b8-etc-swift\") pod \"swift-proxy-8698d79fbb-6czlj\" (UID: \"90dbf97e-452f-4fce-8ceb-07fda29e83b8\") " pod="openstack-kuttl-tests/swift-proxy-8698d79fbb-6czlj" Mar 16 16:22:08 crc kubenswrapper[5120]: I0316 16:22:08.916963 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/90dbf97e-452f-4fce-8ceb-07fda29e83b8-log-httpd\") pod \"swift-proxy-8698d79fbb-6czlj\" (UID: \"90dbf97e-452f-4fce-8ceb-07fda29e83b8\") " pod="openstack-kuttl-tests/swift-proxy-8698d79fbb-6czlj" Mar 16 16:22:09 crc kubenswrapper[5120]: I0316 16:22:09.018772 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/90dbf97e-452f-4fce-8ceb-07fda29e83b8-combined-ca-bundle\") pod \"swift-proxy-8698d79fbb-6czlj\" (UID: \"90dbf97e-452f-4fce-8ceb-07fda29e83b8\") " pod="openstack-kuttl-tests/swift-proxy-8698d79fbb-6czlj" Mar 16 16:22:09 crc kubenswrapper[5120]: I0316 16:22:09.018835 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/90dbf97e-452f-4fce-8ceb-07fda29e83b8-public-tls-certs\") pod \"swift-proxy-8698d79fbb-6czlj\" (UID: \"90dbf97e-452f-4fce-8ceb-07fda29e83b8\") " pod="openstack-kuttl-tests/swift-proxy-8698d79fbb-6czlj" Mar 16 16:22:09 crc kubenswrapper[5120]: I0316 16:22:09.018866 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/90dbf97e-452f-4fce-8ceb-07fda29e83b8-config-data\") pod \"swift-proxy-8698d79fbb-6czlj\" (UID: \"90dbf97e-452f-4fce-8ceb-07fda29e83b8\") " pod="openstack-kuttl-tests/swift-proxy-8698d79fbb-6czlj" Mar 16 16:22:09 crc kubenswrapper[5120]: I0316 16:22:09.018956 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/90dbf97e-452f-4fce-8ceb-07fda29e83b8-run-httpd\") pod \"swift-proxy-8698d79fbb-6czlj\" (UID: \"90dbf97e-452f-4fce-8ceb-07fda29e83b8\") " pod="openstack-kuttl-tests/swift-proxy-8698d79fbb-6czlj" Mar 16 16:22:09 crc kubenswrapper[5120]: I0316 16:22:09.018997 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/90dbf97e-452f-4fce-8ceb-07fda29e83b8-internal-tls-certs\") pod \"swift-proxy-8698d79fbb-6czlj\" (UID: \"90dbf97e-452f-4fce-8ceb-07fda29e83b8\") " pod="openstack-kuttl-tests/swift-proxy-8698d79fbb-6czlj" Mar 16 16:22:09 crc kubenswrapper[5120]: I0316 16:22:09.019015 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wpc8b\" (UniqueName: \"kubernetes.io/projected/90dbf97e-452f-4fce-8ceb-07fda29e83b8-kube-api-access-wpc8b\") pod \"swift-proxy-8698d79fbb-6czlj\" (UID: \"90dbf97e-452f-4fce-8ceb-07fda29e83b8\") " pod="openstack-kuttl-tests/swift-proxy-8698d79fbb-6czlj" Mar 16 16:22:09 crc kubenswrapper[5120]: I0316 16:22:09.019044 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/90dbf97e-452f-4fce-8ceb-07fda29e83b8-etc-swift\") pod \"swift-proxy-8698d79fbb-6czlj\" (UID: \"90dbf97e-452f-4fce-8ceb-07fda29e83b8\") " pod="openstack-kuttl-tests/swift-proxy-8698d79fbb-6czlj" Mar 16 16:22:09 crc kubenswrapper[5120]: I0316 16:22:09.019149 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/90dbf97e-452f-4fce-8ceb-07fda29e83b8-log-httpd\") pod \"swift-proxy-8698d79fbb-6czlj\" (UID: \"90dbf97e-452f-4fce-8ceb-07fda29e83b8\") " pod="openstack-kuttl-tests/swift-proxy-8698d79fbb-6czlj" Mar 16 16:22:09 crc kubenswrapper[5120]: I0316 16:22:09.019773 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/90dbf97e-452f-4fce-8ceb-07fda29e83b8-log-httpd\") pod \"swift-proxy-8698d79fbb-6czlj\" (UID: \"90dbf97e-452f-4fce-8ceb-07fda29e83b8\") " pod="openstack-kuttl-tests/swift-proxy-8698d79fbb-6czlj" Mar 16 16:22:09 crc kubenswrapper[5120]: I0316 16:22:09.020025 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/90dbf97e-452f-4fce-8ceb-07fda29e83b8-run-httpd\") pod \"swift-proxy-8698d79fbb-6czlj\" (UID: \"90dbf97e-452f-4fce-8ceb-07fda29e83b8\") " pod="openstack-kuttl-tests/swift-proxy-8698d79fbb-6czlj" Mar 16 16:22:09 crc kubenswrapper[5120]: I0316 16:22:09.025429 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/90dbf97e-452f-4fce-8ceb-07fda29e83b8-config-data\") pod \"swift-proxy-8698d79fbb-6czlj\" (UID: \"90dbf97e-452f-4fce-8ceb-07fda29e83b8\") " pod="openstack-kuttl-tests/swift-proxy-8698d79fbb-6czlj" Mar 16 16:22:09 crc kubenswrapper[5120]: I0316 16:22:09.026736 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/90dbf97e-452f-4fce-8ceb-07fda29e83b8-etc-swift\") pod \"swift-proxy-8698d79fbb-6czlj\" (UID: \"90dbf97e-452f-4fce-8ceb-07fda29e83b8\") " pod="openstack-kuttl-tests/swift-proxy-8698d79fbb-6czlj" Mar 16 16:22:09 crc kubenswrapper[5120]: I0316 16:22:09.027295 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/90dbf97e-452f-4fce-8ceb-07fda29e83b8-internal-tls-certs\") pod \"swift-proxy-8698d79fbb-6czlj\" (UID: \"90dbf97e-452f-4fce-8ceb-07fda29e83b8\") " pod="openstack-kuttl-tests/swift-proxy-8698d79fbb-6czlj" Mar 16 16:22:09 crc kubenswrapper[5120]: I0316 16:22:09.027790 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/90dbf97e-452f-4fce-8ceb-07fda29e83b8-public-tls-certs\") pod \"swift-proxy-8698d79fbb-6czlj\" (UID: \"90dbf97e-452f-4fce-8ceb-07fda29e83b8\") " pod="openstack-kuttl-tests/swift-proxy-8698d79fbb-6czlj" Mar 16 16:22:09 crc kubenswrapper[5120]: I0316 16:22:09.040243 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/90dbf97e-452f-4fce-8ceb-07fda29e83b8-combined-ca-bundle\") pod \"swift-proxy-8698d79fbb-6czlj\" (UID: \"90dbf97e-452f-4fce-8ceb-07fda29e83b8\") " pod="openstack-kuttl-tests/swift-proxy-8698d79fbb-6czlj" Mar 16 16:22:09 crc kubenswrapper[5120]: I0316 16:22:09.066247 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpc8b\" (UniqueName: \"kubernetes.io/projected/90dbf97e-452f-4fce-8ceb-07fda29e83b8-kube-api-access-wpc8b\") pod \"swift-proxy-8698d79fbb-6czlj\" (UID: \"90dbf97e-452f-4fce-8ceb-07fda29e83b8\") " pod="openstack-kuttl-tests/swift-proxy-8698d79fbb-6czlj" Mar 16 16:22:09 crc kubenswrapper[5120]: I0316 16:22:09.180560 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-8698d79fbb-6czlj" Mar 16 16:22:09 crc kubenswrapper[5120]: I0316 16:22:09.695800 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-proxy-8698d79fbb-6czlj"] Mar 16 16:22:10 crc kubenswrapper[5120]: I0316 16:22:10.130687 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:22:10 crc kubenswrapper[5120]: I0316 16:22:10.131000 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="ee06fc7a-e571-4eec-b5fd-309e6dc0eab0" containerName="ceilometer-central-agent" containerID="cri-o://817a9125e991fa96016aa25ce1eb23576e854327114f49e01facd964dafe5bf6" gracePeriod=30 Mar 16 16:22:10 crc kubenswrapper[5120]: I0316 16:22:10.131136 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="ee06fc7a-e571-4eec-b5fd-309e6dc0eab0" containerName="sg-core" containerID="cri-o://cbbd0406183a1c1e2a2f808987d41f121130d40cd153739b03d29d850a32861d" gracePeriod=30 Mar 16 16:22:10 crc kubenswrapper[5120]: I0316 16:22:10.131147 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="ee06fc7a-e571-4eec-b5fd-309e6dc0eab0" containerName="proxy-httpd" containerID="cri-o://f3a710091929bdde8bf34e0dc3921d0325a9e12ace444521041aa583c6b00c4e" gracePeriod=30 Mar 16 16:22:10 crc kubenswrapper[5120]: I0316 16:22:10.131554 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="ee06fc7a-e571-4eec-b5fd-309e6dc0eab0" containerName="ceilometer-notification-agent" containerID="cri-o://22611112d9fac7d25e08fe02853f61e8b92fd841dfbdd5030d5230aebc23c203" gracePeriod=30 Mar 16 16:22:10 crc kubenswrapper[5120]: I0316 16:22:10.145706 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/ceilometer-0" podUID="ee06fc7a-e571-4eec-b5fd-309e6dc0eab0" containerName="proxy-httpd" probeResult="failure" output="Get \"http://10.217.1.101:3000/\": EOF" Mar 16 16:22:10 crc kubenswrapper[5120]: I0316 16:22:10.285858 5120 generic.go:358] "Generic (PLEG): container finished" podID="ee06fc7a-e571-4eec-b5fd-309e6dc0eab0" containerID="cbbd0406183a1c1e2a2f808987d41f121130d40cd153739b03d29d850a32861d" exitCode=2 Mar 16 16:22:10 crc kubenswrapper[5120]: I0316 16:22:10.285936 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ee06fc7a-e571-4eec-b5fd-309e6dc0eab0","Type":"ContainerDied","Data":"cbbd0406183a1c1e2a2f808987d41f121130d40cd153739b03d29d850a32861d"} Mar 16 16:22:10 crc kubenswrapper[5120]: I0316 16:22:10.288404 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-8698d79fbb-6czlj" event={"ID":"90dbf97e-452f-4fce-8ceb-07fda29e83b8","Type":"ContainerStarted","Data":"67cf881a6a854436edea224c7b420d193ade58ddc2a769579fe0b891879e4d9f"} Mar 16 16:22:10 crc kubenswrapper[5120]: I0316 16:22:10.288515 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/swift-proxy-8698d79fbb-6czlj" Mar 16 16:22:10 crc kubenswrapper[5120]: I0316 16:22:10.288542 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-8698d79fbb-6czlj" event={"ID":"90dbf97e-452f-4fce-8ceb-07fda29e83b8","Type":"ContainerStarted","Data":"69de27d7b1816f359b19d7db8ad34481405845a2709dc4483b84ffc8307ede29"} Mar 16 16:22:10 crc kubenswrapper[5120]: I0316 16:22:10.288561 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-8698d79fbb-6czlj" event={"ID":"90dbf97e-452f-4fce-8ceb-07fda29e83b8","Type":"ContainerStarted","Data":"61d1f002c6ea3229e8bc270c50328df1bc0af955af1a3199d132930a243c97cd"} Mar 16 16:22:10 crc kubenswrapper[5120]: I0316 16:22:10.288870 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/swift-proxy-8698d79fbb-6czlj" Mar 16 16:22:10 crc kubenswrapper[5120]: I0316 16:22:10.312128 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/swift-proxy-8698d79fbb-6czlj" podStartSLOduration=2.312102226 podStartE2EDuration="2.312102226s" podCreationTimestamp="2026-03-16 16:22:08 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:22:10.305722905 +0000 UTC m=+3032.459654552" watchObservedRunningTime="2026-03-16 16:22:10.312102226 +0000 UTC m=+3032.466033903" Mar 16 16:22:10 crc kubenswrapper[5120]: I0316 16:22:10.664151 5120 scope.go:117] "RemoveContainer" containerID="f40e444f89abd558ac90555bfd58e04a1c4379a653ba8035c228d2b7a5443eb5" Mar 16 16:22:10 crc kubenswrapper[5120]: E0316 16:22:10.664465 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:22:11 crc kubenswrapper[5120]: I0316 16:22:11.231198 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:22:11 crc kubenswrapper[5120]: I0316 16:22:11.282442 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ee06fc7a-e571-4eec-b5fd-309e6dc0eab0-combined-ca-bundle\") pod \"ee06fc7a-e571-4eec-b5fd-309e6dc0eab0\" (UID: \"ee06fc7a-e571-4eec-b5fd-309e6dc0eab0\") " Mar 16 16:22:11 crc kubenswrapper[5120]: I0316 16:22:11.282490 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ee06fc7a-e571-4eec-b5fd-309e6dc0eab0-config-data\") pod \"ee06fc7a-e571-4eec-b5fd-309e6dc0eab0\" (UID: \"ee06fc7a-e571-4eec-b5fd-309e6dc0eab0\") " Mar 16 16:22:11 crc kubenswrapper[5120]: I0316 16:22:11.282645 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ee06fc7a-e571-4eec-b5fd-309e6dc0eab0-scripts\") pod \"ee06fc7a-e571-4eec-b5fd-309e6dc0eab0\" (UID: \"ee06fc7a-e571-4eec-b5fd-309e6dc0eab0\") " Mar 16 16:22:11 crc kubenswrapper[5120]: I0316 16:22:11.282783 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ee06fc7a-e571-4eec-b5fd-309e6dc0eab0-log-httpd\") pod \"ee06fc7a-e571-4eec-b5fd-309e6dc0eab0\" (UID: \"ee06fc7a-e571-4eec-b5fd-309e6dc0eab0\") " Mar 16 16:22:11 crc kubenswrapper[5120]: I0316 16:22:11.282804 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pt6nf\" (UniqueName: \"kubernetes.io/projected/ee06fc7a-e571-4eec-b5fd-309e6dc0eab0-kube-api-access-pt6nf\") pod \"ee06fc7a-e571-4eec-b5fd-309e6dc0eab0\" (UID: \"ee06fc7a-e571-4eec-b5fd-309e6dc0eab0\") " Mar 16 16:22:11 crc kubenswrapper[5120]: I0316 16:22:11.282905 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/ee06fc7a-e571-4eec-b5fd-309e6dc0eab0-sg-core-conf-yaml\") pod \"ee06fc7a-e571-4eec-b5fd-309e6dc0eab0\" (UID: \"ee06fc7a-e571-4eec-b5fd-309e6dc0eab0\") " Mar 16 16:22:11 crc kubenswrapper[5120]: I0316 16:22:11.282998 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ee06fc7a-e571-4eec-b5fd-309e6dc0eab0-run-httpd\") pod \"ee06fc7a-e571-4eec-b5fd-309e6dc0eab0\" (UID: \"ee06fc7a-e571-4eec-b5fd-309e6dc0eab0\") " Mar 16 16:22:11 crc kubenswrapper[5120]: I0316 16:22:11.284208 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee06fc7a-e571-4eec-b5fd-309e6dc0eab0-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "ee06fc7a-e571-4eec-b5fd-309e6dc0eab0" (UID: "ee06fc7a-e571-4eec-b5fd-309e6dc0eab0"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:22:11 crc kubenswrapper[5120]: I0316 16:22:11.284364 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee06fc7a-e571-4eec-b5fd-309e6dc0eab0-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "ee06fc7a-e571-4eec-b5fd-309e6dc0eab0" (UID: "ee06fc7a-e571-4eec-b5fd-309e6dc0eab0"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:22:11 crc kubenswrapper[5120]: I0316 16:22:11.290000 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ee06fc7a-e571-4eec-b5fd-309e6dc0eab0-scripts" (OuterVolumeSpecName: "scripts") pod "ee06fc7a-e571-4eec-b5fd-309e6dc0eab0" (UID: "ee06fc7a-e571-4eec-b5fd-309e6dc0eab0"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:22:11 crc kubenswrapper[5120]: I0316 16:22:11.291504 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee06fc7a-e571-4eec-b5fd-309e6dc0eab0-kube-api-access-pt6nf" (OuterVolumeSpecName: "kube-api-access-pt6nf") pod "ee06fc7a-e571-4eec-b5fd-309e6dc0eab0" (UID: "ee06fc7a-e571-4eec-b5fd-309e6dc0eab0"). InnerVolumeSpecName "kube-api-access-pt6nf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:22:11 crc kubenswrapper[5120]: I0316 16:22:11.317535 5120 generic.go:358] "Generic (PLEG): container finished" podID="ee06fc7a-e571-4eec-b5fd-309e6dc0eab0" containerID="f3a710091929bdde8bf34e0dc3921d0325a9e12ace444521041aa583c6b00c4e" exitCode=0 Mar 16 16:22:11 crc kubenswrapper[5120]: I0316 16:22:11.317565 5120 generic.go:358] "Generic (PLEG): container finished" podID="ee06fc7a-e571-4eec-b5fd-309e6dc0eab0" containerID="22611112d9fac7d25e08fe02853f61e8b92fd841dfbdd5030d5230aebc23c203" exitCode=0 Mar 16 16:22:11 crc kubenswrapper[5120]: I0316 16:22:11.317589 5120 generic.go:358] "Generic (PLEG): container finished" podID="ee06fc7a-e571-4eec-b5fd-309e6dc0eab0" containerID="817a9125e991fa96016aa25ce1eb23576e854327114f49e01facd964dafe5bf6" exitCode=0 Mar 16 16:22:11 crc kubenswrapper[5120]: I0316 16:22:11.319083 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ee06fc7a-e571-4eec-b5fd-309e6dc0eab0","Type":"ContainerDied","Data":"f3a710091929bdde8bf34e0dc3921d0325a9e12ace444521041aa583c6b00c4e"} Mar 16 16:22:11 crc kubenswrapper[5120]: I0316 16:22:11.319126 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:22:11 crc kubenswrapper[5120]: I0316 16:22:11.319161 5120 scope.go:117] "RemoveContainer" containerID="f3a710091929bdde8bf34e0dc3921d0325a9e12ace444521041aa583c6b00c4e" Mar 16 16:22:11 crc kubenswrapper[5120]: I0316 16:22:11.319149 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ee06fc7a-e571-4eec-b5fd-309e6dc0eab0","Type":"ContainerDied","Data":"22611112d9fac7d25e08fe02853f61e8b92fd841dfbdd5030d5230aebc23c203"} Mar 16 16:22:11 crc kubenswrapper[5120]: I0316 16:22:11.319329 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ee06fc7a-e571-4eec-b5fd-309e6dc0eab0","Type":"ContainerDied","Data":"817a9125e991fa96016aa25ce1eb23576e854327114f49e01facd964dafe5bf6"} Mar 16 16:22:11 crc kubenswrapper[5120]: I0316 16:22:11.319346 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ee06fc7a-e571-4eec-b5fd-309e6dc0eab0","Type":"ContainerDied","Data":"f7111c41626c24aef2984abecb90e0921c7d924c99083388cc4f18e63f2f8e0c"} Mar 16 16:22:11 crc kubenswrapper[5120]: I0316 16:22:11.349866 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ee06fc7a-e571-4eec-b5fd-309e6dc0eab0-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "ee06fc7a-e571-4eec-b5fd-309e6dc0eab0" (UID: "ee06fc7a-e571-4eec-b5fd-309e6dc0eab0"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:22:11 crc kubenswrapper[5120]: I0316 16:22:11.387183 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ee06fc7a-e571-4eec-b5fd-309e6dc0eab0-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:22:11 crc kubenswrapper[5120]: I0316 16:22:11.387224 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ee06fc7a-e571-4eec-b5fd-309e6dc0eab0-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:22:11 crc kubenswrapper[5120]: I0316 16:22:11.387240 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pt6nf\" (UniqueName: \"kubernetes.io/projected/ee06fc7a-e571-4eec-b5fd-309e6dc0eab0-kube-api-access-pt6nf\") on node \"crc\" DevicePath \"\"" Mar 16 16:22:11 crc kubenswrapper[5120]: I0316 16:22:11.387249 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/ee06fc7a-e571-4eec-b5fd-309e6dc0eab0-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 16:22:11 crc kubenswrapper[5120]: I0316 16:22:11.387258 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ee06fc7a-e571-4eec-b5fd-309e6dc0eab0-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:22:11 crc kubenswrapper[5120]: I0316 16:22:11.424938 5120 scope.go:117] "RemoveContainer" containerID="cbbd0406183a1c1e2a2f808987d41f121130d40cd153739b03d29d850a32861d" Mar 16 16:22:11 crc kubenswrapper[5120]: I0316 16:22:11.466905 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ee06fc7a-e571-4eec-b5fd-309e6dc0eab0-config-data" (OuterVolumeSpecName: "config-data") pod "ee06fc7a-e571-4eec-b5fd-309e6dc0eab0" (UID: "ee06fc7a-e571-4eec-b5fd-309e6dc0eab0"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:22:11 crc kubenswrapper[5120]: I0316 16:22:11.471893 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ee06fc7a-e571-4eec-b5fd-309e6dc0eab0-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ee06fc7a-e571-4eec-b5fd-309e6dc0eab0" (UID: "ee06fc7a-e571-4eec-b5fd-309e6dc0eab0"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:22:11 crc kubenswrapper[5120]: I0316 16:22:11.481815 5120 scope.go:117] "RemoveContainer" containerID="22611112d9fac7d25e08fe02853f61e8b92fd841dfbdd5030d5230aebc23c203" Mar 16 16:22:11 crc kubenswrapper[5120]: I0316 16:22:11.489515 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ee06fc7a-e571-4eec-b5fd-309e6dc0eab0-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:22:11 crc kubenswrapper[5120]: I0316 16:22:11.489554 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ee06fc7a-e571-4eec-b5fd-309e6dc0eab0-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:22:11 crc kubenswrapper[5120]: I0316 16:22:11.524836 5120 scope.go:117] "RemoveContainer" containerID="817a9125e991fa96016aa25ce1eb23576e854327114f49e01facd964dafe5bf6" Mar 16 16:22:11 crc kubenswrapper[5120]: I0316 16:22:11.548125 5120 scope.go:117] "RemoveContainer" containerID="f3a710091929bdde8bf34e0dc3921d0325a9e12ace444521041aa583c6b00c4e" Mar 16 16:22:11 crc kubenswrapper[5120]: E0316 16:22:11.553124 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f3a710091929bdde8bf34e0dc3921d0325a9e12ace444521041aa583c6b00c4e\": container with ID starting with f3a710091929bdde8bf34e0dc3921d0325a9e12ace444521041aa583c6b00c4e not found: ID does not exist" containerID="f3a710091929bdde8bf34e0dc3921d0325a9e12ace444521041aa583c6b00c4e" Mar 16 16:22:11 crc kubenswrapper[5120]: I0316 16:22:11.553165 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3a710091929bdde8bf34e0dc3921d0325a9e12ace444521041aa583c6b00c4e"} err="failed to get container status \"f3a710091929bdde8bf34e0dc3921d0325a9e12ace444521041aa583c6b00c4e\": rpc error: code = NotFound desc = could not find container \"f3a710091929bdde8bf34e0dc3921d0325a9e12ace444521041aa583c6b00c4e\": container with ID starting with f3a710091929bdde8bf34e0dc3921d0325a9e12ace444521041aa583c6b00c4e not found: ID does not exist" Mar 16 16:22:11 crc kubenswrapper[5120]: I0316 16:22:11.553189 5120 scope.go:117] "RemoveContainer" containerID="cbbd0406183a1c1e2a2f808987d41f121130d40cd153739b03d29d850a32861d" Mar 16 16:22:11 crc kubenswrapper[5120]: E0316 16:22:11.553525 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cbbd0406183a1c1e2a2f808987d41f121130d40cd153739b03d29d850a32861d\": container with ID starting with cbbd0406183a1c1e2a2f808987d41f121130d40cd153739b03d29d850a32861d not found: ID does not exist" containerID="cbbd0406183a1c1e2a2f808987d41f121130d40cd153739b03d29d850a32861d" Mar 16 16:22:11 crc kubenswrapper[5120]: I0316 16:22:11.553546 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cbbd0406183a1c1e2a2f808987d41f121130d40cd153739b03d29d850a32861d"} err="failed to get container status \"cbbd0406183a1c1e2a2f808987d41f121130d40cd153739b03d29d850a32861d\": rpc error: code = NotFound desc = could not find container \"cbbd0406183a1c1e2a2f808987d41f121130d40cd153739b03d29d850a32861d\": container with ID starting with cbbd0406183a1c1e2a2f808987d41f121130d40cd153739b03d29d850a32861d not found: ID does not exist" Mar 16 16:22:11 crc kubenswrapper[5120]: I0316 16:22:11.553557 5120 scope.go:117] "RemoveContainer" containerID="22611112d9fac7d25e08fe02853f61e8b92fd841dfbdd5030d5230aebc23c203" Mar 16 16:22:11 crc kubenswrapper[5120]: E0316 16:22:11.553812 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"22611112d9fac7d25e08fe02853f61e8b92fd841dfbdd5030d5230aebc23c203\": container with ID starting with 22611112d9fac7d25e08fe02853f61e8b92fd841dfbdd5030d5230aebc23c203 not found: ID does not exist" containerID="22611112d9fac7d25e08fe02853f61e8b92fd841dfbdd5030d5230aebc23c203" Mar 16 16:22:11 crc kubenswrapper[5120]: I0316 16:22:11.553829 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22611112d9fac7d25e08fe02853f61e8b92fd841dfbdd5030d5230aebc23c203"} err="failed to get container status \"22611112d9fac7d25e08fe02853f61e8b92fd841dfbdd5030d5230aebc23c203\": rpc error: code = NotFound desc = could not find container \"22611112d9fac7d25e08fe02853f61e8b92fd841dfbdd5030d5230aebc23c203\": container with ID starting with 22611112d9fac7d25e08fe02853f61e8b92fd841dfbdd5030d5230aebc23c203 not found: ID does not exist" Mar 16 16:22:11 crc kubenswrapper[5120]: I0316 16:22:11.553840 5120 scope.go:117] "RemoveContainer" containerID="817a9125e991fa96016aa25ce1eb23576e854327114f49e01facd964dafe5bf6" Mar 16 16:22:11 crc kubenswrapper[5120]: E0316 16:22:11.554041 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"817a9125e991fa96016aa25ce1eb23576e854327114f49e01facd964dafe5bf6\": container with ID starting with 817a9125e991fa96016aa25ce1eb23576e854327114f49e01facd964dafe5bf6 not found: ID does not exist" containerID="817a9125e991fa96016aa25ce1eb23576e854327114f49e01facd964dafe5bf6" Mar 16 16:22:11 crc kubenswrapper[5120]: I0316 16:22:11.554058 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"817a9125e991fa96016aa25ce1eb23576e854327114f49e01facd964dafe5bf6"} err="failed to get container status \"817a9125e991fa96016aa25ce1eb23576e854327114f49e01facd964dafe5bf6\": rpc error: code = NotFound desc = could not find container \"817a9125e991fa96016aa25ce1eb23576e854327114f49e01facd964dafe5bf6\": container with ID starting with 817a9125e991fa96016aa25ce1eb23576e854327114f49e01facd964dafe5bf6 not found: ID does not exist" Mar 16 16:22:11 crc kubenswrapper[5120]: I0316 16:22:11.554070 5120 scope.go:117] "RemoveContainer" containerID="f3a710091929bdde8bf34e0dc3921d0325a9e12ace444521041aa583c6b00c4e" Mar 16 16:22:11 crc kubenswrapper[5120]: I0316 16:22:11.554266 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3a710091929bdde8bf34e0dc3921d0325a9e12ace444521041aa583c6b00c4e"} err="failed to get container status \"f3a710091929bdde8bf34e0dc3921d0325a9e12ace444521041aa583c6b00c4e\": rpc error: code = NotFound desc = could not find container \"f3a710091929bdde8bf34e0dc3921d0325a9e12ace444521041aa583c6b00c4e\": container with ID starting with f3a710091929bdde8bf34e0dc3921d0325a9e12ace444521041aa583c6b00c4e not found: ID does not exist" Mar 16 16:22:11 crc kubenswrapper[5120]: I0316 16:22:11.554282 5120 scope.go:117] "RemoveContainer" containerID="cbbd0406183a1c1e2a2f808987d41f121130d40cd153739b03d29d850a32861d" Mar 16 16:22:11 crc kubenswrapper[5120]: I0316 16:22:11.554447 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cbbd0406183a1c1e2a2f808987d41f121130d40cd153739b03d29d850a32861d"} err="failed to get container status \"cbbd0406183a1c1e2a2f808987d41f121130d40cd153739b03d29d850a32861d\": rpc error: code = NotFound desc = could not find container \"cbbd0406183a1c1e2a2f808987d41f121130d40cd153739b03d29d850a32861d\": container with ID starting with cbbd0406183a1c1e2a2f808987d41f121130d40cd153739b03d29d850a32861d not found: ID does not exist" Mar 16 16:22:11 crc kubenswrapper[5120]: I0316 16:22:11.554463 5120 scope.go:117] "RemoveContainer" containerID="22611112d9fac7d25e08fe02853f61e8b92fd841dfbdd5030d5230aebc23c203" Mar 16 16:22:11 crc kubenswrapper[5120]: I0316 16:22:11.554624 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22611112d9fac7d25e08fe02853f61e8b92fd841dfbdd5030d5230aebc23c203"} err="failed to get container status \"22611112d9fac7d25e08fe02853f61e8b92fd841dfbdd5030d5230aebc23c203\": rpc error: code = NotFound desc = could not find container \"22611112d9fac7d25e08fe02853f61e8b92fd841dfbdd5030d5230aebc23c203\": container with ID starting with 22611112d9fac7d25e08fe02853f61e8b92fd841dfbdd5030d5230aebc23c203 not found: ID does not exist" Mar 16 16:22:11 crc kubenswrapper[5120]: I0316 16:22:11.554640 5120 scope.go:117] "RemoveContainer" containerID="817a9125e991fa96016aa25ce1eb23576e854327114f49e01facd964dafe5bf6" Mar 16 16:22:11 crc kubenswrapper[5120]: I0316 16:22:11.554874 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"817a9125e991fa96016aa25ce1eb23576e854327114f49e01facd964dafe5bf6"} err="failed to get container status \"817a9125e991fa96016aa25ce1eb23576e854327114f49e01facd964dafe5bf6\": rpc error: code = NotFound desc = could not find container \"817a9125e991fa96016aa25ce1eb23576e854327114f49e01facd964dafe5bf6\": container with ID starting with 817a9125e991fa96016aa25ce1eb23576e854327114f49e01facd964dafe5bf6 not found: ID does not exist" Mar 16 16:22:11 crc kubenswrapper[5120]: I0316 16:22:11.554889 5120 scope.go:117] "RemoveContainer" containerID="f3a710091929bdde8bf34e0dc3921d0325a9e12ace444521041aa583c6b00c4e" Mar 16 16:22:11 crc kubenswrapper[5120]: I0316 16:22:11.555056 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3a710091929bdde8bf34e0dc3921d0325a9e12ace444521041aa583c6b00c4e"} err="failed to get container status \"f3a710091929bdde8bf34e0dc3921d0325a9e12ace444521041aa583c6b00c4e\": rpc error: code = NotFound desc = could not find container \"f3a710091929bdde8bf34e0dc3921d0325a9e12ace444521041aa583c6b00c4e\": container with ID starting with f3a710091929bdde8bf34e0dc3921d0325a9e12ace444521041aa583c6b00c4e not found: ID does not exist" Mar 16 16:22:11 crc kubenswrapper[5120]: I0316 16:22:11.555072 5120 scope.go:117] "RemoveContainer" containerID="cbbd0406183a1c1e2a2f808987d41f121130d40cd153739b03d29d850a32861d" Mar 16 16:22:11 crc kubenswrapper[5120]: I0316 16:22:11.555236 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cbbd0406183a1c1e2a2f808987d41f121130d40cd153739b03d29d850a32861d"} err="failed to get container status \"cbbd0406183a1c1e2a2f808987d41f121130d40cd153739b03d29d850a32861d\": rpc error: code = NotFound desc = could not find container \"cbbd0406183a1c1e2a2f808987d41f121130d40cd153739b03d29d850a32861d\": container with ID starting with cbbd0406183a1c1e2a2f808987d41f121130d40cd153739b03d29d850a32861d not found: ID does not exist" Mar 16 16:22:11 crc kubenswrapper[5120]: I0316 16:22:11.555251 5120 scope.go:117] "RemoveContainer" containerID="22611112d9fac7d25e08fe02853f61e8b92fd841dfbdd5030d5230aebc23c203" Mar 16 16:22:11 crc kubenswrapper[5120]: I0316 16:22:11.555418 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22611112d9fac7d25e08fe02853f61e8b92fd841dfbdd5030d5230aebc23c203"} err="failed to get container status \"22611112d9fac7d25e08fe02853f61e8b92fd841dfbdd5030d5230aebc23c203\": rpc error: code = NotFound desc = could not find container \"22611112d9fac7d25e08fe02853f61e8b92fd841dfbdd5030d5230aebc23c203\": container with ID starting with 22611112d9fac7d25e08fe02853f61e8b92fd841dfbdd5030d5230aebc23c203 not found: ID does not exist" Mar 16 16:22:11 crc kubenswrapper[5120]: I0316 16:22:11.555432 5120 scope.go:117] "RemoveContainer" containerID="817a9125e991fa96016aa25ce1eb23576e854327114f49e01facd964dafe5bf6" Mar 16 16:22:11 crc kubenswrapper[5120]: I0316 16:22:11.555595 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"817a9125e991fa96016aa25ce1eb23576e854327114f49e01facd964dafe5bf6"} err="failed to get container status \"817a9125e991fa96016aa25ce1eb23576e854327114f49e01facd964dafe5bf6\": rpc error: code = NotFound desc = could not find container \"817a9125e991fa96016aa25ce1eb23576e854327114f49e01facd964dafe5bf6\": container with ID starting with 817a9125e991fa96016aa25ce1eb23576e854327114f49e01facd964dafe5bf6 not found: ID does not exist" Mar 16 16:22:11 crc kubenswrapper[5120]: I0316 16:22:11.649852 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:22:11 crc kubenswrapper[5120]: I0316 16:22:11.663919 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:22:11 crc kubenswrapper[5120]: I0316 16:22:11.673962 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:22:11 crc kubenswrapper[5120]: I0316 16:22:11.674986 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee06fc7a-e571-4eec-b5fd-309e6dc0eab0" containerName="sg-core" Mar 16 16:22:11 crc kubenswrapper[5120]: I0316 16:22:11.675003 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee06fc7a-e571-4eec-b5fd-309e6dc0eab0" containerName="sg-core" Mar 16 16:22:11 crc kubenswrapper[5120]: I0316 16:22:11.675033 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee06fc7a-e571-4eec-b5fd-309e6dc0eab0" containerName="ceilometer-notification-agent" Mar 16 16:22:11 crc kubenswrapper[5120]: I0316 16:22:11.675039 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee06fc7a-e571-4eec-b5fd-309e6dc0eab0" containerName="ceilometer-notification-agent" Mar 16 16:22:11 crc kubenswrapper[5120]: I0316 16:22:11.675071 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee06fc7a-e571-4eec-b5fd-309e6dc0eab0" containerName="proxy-httpd" Mar 16 16:22:11 crc kubenswrapper[5120]: I0316 16:22:11.675076 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee06fc7a-e571-4eec-b5fd-309e6dc0eab0" containerName="proxy-httpd" Mar 16 16:22:11 crc kubenswrapper[5120]: I0316 16:22:11.675087 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee06fc7a-e571-4eec-b5fd-309e6dc0eab0" containerName="ceilometer-central-agent" Mar 16 16:22:11 crc kubenswrapper[5120]: I0316 16:22:11.675092 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee06fc7a-e571-4eec-b5fd-309e6dc0eab0" containerName="ceilometer-central-agent" Mar 16 16:22:11 crc kubenswrapper[5120]: I0316 16:22:11.675268 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ee06fc7a-e571-4eec-b5fd-309e6dc0eab0" containerName="sg-core" Mar 16 16:22:11 crc kubenswrapper[5120]: I0316 16:22:11.675282 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ee06fc7a-e571-4eec-b5fd-309e6dc0eab0" containerName="ceilometer-central-agent" Mar 16 16:22:11 crc kubenswrapper[5120]: I0316 16:22:11.675292 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ee06fc7a-e571-4eec-b5fd-309e6dc0eab0" containerName="proxy-httpd" Mar 16 16:22:11 crc kubenswrapper[5120]: I0316 16:22:11.675303 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ee06fc7a-e571-4eec-b5fd-309e6dc0eab0" containerName="ceilometer-notification-agent" Mar 16 16:22:11 crc kubenswrapper[5120]: I0316 16:22:11.684997 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:22:11 crc kubenswrapper[5120]: I0316 16:22:11.689798 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:22:11 crc kubenswrapper[5120]: I0316 16:22:11.697188 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 16:22:11 crc kubenswrapper[5120]: I0316 16:22:11.697596 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 16:22:11 crc kubenswrapper[5120]: I0316 16:22:11.796881 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/954b8df0-5a5c-4057-a887-fc920c995ce0-scripts\") pod \"ceilometer-0\" (UID: \"954b8df0-5a5c-4057-a887-fc920c995ce0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:22:11 crc kubenswrapper[5120]: I0316 16:22:11.797028 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/954b8df0-5a5c-4057-a887-fc920c995ce0-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"954b8df0-5a5c-4057-a887-fc920c995ce0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:22:11 crc kubenswrapper[5120]: I0316 16:22:11.797177 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/954b8df0-5a5c-4057-a887-fc920c995ce0-run-httpd\") pod \"ceilometer-0\" (UID: \"954b8df0-5a5c-4057-a887-fc920c995ce0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:22:11 crc kubenswrapper[5120]: I0316 16:22:11.797222 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/954b8df0-5a5c-4057-a887-fc920c995ce0-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"954b8df0-5a5c-4057-a887-fc920c995ce0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:22:11 crc kubenswrapper[5120]: I0316 16:22:11.797462 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/954b8df0-5a5c-4057-a887-fc920c995ce0-config-data\") pod \"ceilometer-0\" (UID: \"954b8df0-5a5c-4057-a887-fc920c995ce0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:22:11 crc kubenswrapper[5120]: I0316 16:22:11.797549 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/954b8df0-5a5c-4057-a887-fc920c995ce0-log-httpd\") pod \"ceilometer-0\" (UID: \"954b8df0-5a5c-4057-a887-fc920c995ce0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:22:11 crc kubenswrapper[5120]: I0316 16:22:11.797720 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p55k6\" (UniqueName: \"kubernetes.io/projected/954b8df0-5a5c-4057-a887-fc920c995ce0-kube-api-access-p55k6\") pod \"ceilometer-0\" (UID: \"954b8df0-5a5c-4057-a887-fc920c995ce0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:22:11 crc kubenswrapper[5120]: I0316 16:22:11.899888 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/954b8df0-5a5c-4057-a887-fc920c995ce0-scripts\") pod \"ceilometer-0\" (UID: \"954b8df0-5a5c-4057-a887-fc920c995ce0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:22:11 crc kubenswrapper[5120]: I0316 16:22:11.899974 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/954b8df0-5a5c-4057-a887-fc920c995ce0-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"954b8df0-5a5c-4057-a887-fc920c995ce0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:22:11 crc kubenswrapper[5120]: I0316 16:22:11.900072 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/954b8df0-5a5c-4057-a887-fc920c995ce0-run-httpd\") pod \"ceilometer-0\" (UID: \"954b8df0-5a5c-4057-a887-fc920c995ce0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:22:11 crc kubenswrapper[5120]: I0316 16:22:11.900113 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/954b8df0-5a5c-4057-a887-fc920c995ce0-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"954b8df0-5a5c-4057-a887-fc920c995ce0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:22:11 crc kubenswrapper[5120]: I0316 16:22:11.900223 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/954b8df0-5a5c-4057-a887-fc920c995ce0-config-data\") pod \"ceilometer-0\" (UID: \"954b8df0-5a5c-4057-a887-fc920c995ce0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:22:11 crc kubenswrapper[5120]: I0316 16:22:11.900256 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/954b8df0-5a5c-4057-a887-fc920c995ce0-log-httpd\") pod \"ceilometer-0\" (UID: \"954b8df0-5a5c-4057-a887-fc920c995ce0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:22:11 crc kubenswrapper[5120]: I0316 16:22:11.900355 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p55k6\" (UniqueName: \"kubernetes.io/projected/954b8df0-5a5c-4057-a887-fc920c995ce0-kube-api-access-p55k6\") pod \"ceilometer-0\" (UID: \"954b8df0-5a5c-4057-a887-fc920c995ce0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:22:11 crc kubenswrapper[5120]: I0316 16:22:11.902231 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/954b8df0-5a5c-4057-a887-fc920c995ce0-run-httpd\") pod \"ceilometer-0\" (UID: \"954b8df0-5a5c-4057-a887-fc920c995ce0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:22:11 crc kubenswrapper[5120]: I0316 16:22:11.902291 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/954b8df0-5a5c-4057-a887-fc920c995ce0-log-httpd\") pod \"ceilometer-0\" (UID: \"954b8df0-5a5c-4057-a887-fc920c995ce0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:22:11 crc kubenswrapper[5120]: I0316 16:22:11.906605 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/954b8df0-5a5c-4057-a887-fc920c995ce0-scripts\") pod \"ceilometer-0\" (UID: \"954b8df0-5a5c-4057-a887-fc920c995ce0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:22:11 crc kubenswrapper[5120]: I0316 16:22:11.907363 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/954b8df0-5a5c-4057-a887-fc920c995ce0-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"954b8df0-5a5c-4057-a887-fc920c995ce0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:22:11 crc kubenswrapper[5120]: I0316 16:22:11.908083 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/954b8df0-5a5c-4057-a887-fc920c995ce0-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"954b8df0-5a5c-4057-a887-fc920c995ce0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:22:11 crc kubenswrapper[5120]: I0316 16:22:11.908231 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/954b8df0-5a5c-4057-a887-fc920c995ce0-config-data\") pod \"ceilometer-0\" (UID: \"954b8df0-5a5c-4057-a887-fc920c995ce0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:22:11 crc kubenswrapper[5120]: I0316 16:22:11.921429 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p55k6\" (UniqueName: \"kubernetes.io/projected/954b8df0-5a5c-4057-a887-fc920c995ce0-kube-api-access-p55k6\") pod \"ceilometer-0\" (UID: \"954b8df0-5a5c-4057-a887-fc920c995ce0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:22:12 crc kubenswrapper[5120]: I0316 16:22:12.013011 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:22:12 crc kubenswrapper[5120]: I0316 16:22:12.532674 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:22:12 crc kubenswrapper[5120]: W0316 16:22:12.538021 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod954b8df0_5a5c_4057_a887_fc920c995ce0.slice/crio-55369c4493de0b39bb2224c2ca281360f88260e78197d74c6bd018e1add320b6 WatchSource:0}: Error finding container 55369c4493de0b39bb2224c2ca281360f88260e78197d74c6bd018e1add320b6: Status 404 returned error can't find the container with id 55369c4493de0b39bb2224c2ca281360f88260e78197d74c6bd018e1add320b6 Mar 16 16:22:12 crc kubenswrapper[5120]: I0316 16:22:12.676002 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ee06fc7a-e571-4eec-b5fd-309e6dc0eab0" path="/var/lib/kubelet/pods/ee06fc7a-e571-4eec-b5fd-309e6dc0eab0/volumes" Mar 16 16:22:12 crc kubenswrapper[5120]: I0316 16:22:12.917623 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/neutron-7bccf4cf49-4xg9g" Mar 16 16:22:13 crc kubenswrapper[5120]: I0316 16:22:13.342302 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"954b8df0-5a5c-4057-a887-fc920c995ce0","Type":"ContainerStarted","Data":"899cdc537eabf72f56e57dfed12366c810c0469aa975dd59cc4c8ba413f86dd3"} Mar 16 16:22:13 crc kubenswrapper[5120]: I0316 16:22:13.342911 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"954b8df0-5a5c-4057-a887-fc920c995ce0","Type":"ContainerStarted","Data":"55369c4493de0b39bb2224c2ca281360f88260e78197d74c6bd018e1add320b6"} Mar 16 16:22:13 crc kubenswrapper[5120]: I0316 16:22:13.891109 5120 scope.go:117] "RemoveContainer" containerID="79f086e72f0b3dcc57867b036c16615a4da1d7f137461f590af97b4617e73cc4" Mar 16 16:22:13 crc kubenswrapper[5120]: I0316 16:22:13.918224 5120 scope.go:117] "RemoveContainer" containerID="90c715905e529ad14178abbf6e655f50ba4c8c1f19dec4d3c9f6de79844d5fff" Mar 16 16:22:14 crc kubenswrapper[5120]: I0316 16:22:14.087225 5120 scope.go:117] "RemoveContainer" containerID="1047a775a4d6d73834e956332daf4031b254e261c008046c75b64d3eca888ffd" Mar 16 16:22:14 crc kubenswrapper[5120]: I0316 16:22:14.110147 5120 scope.go:117] "RemoveContainer" containerID="a10ed440c92b700107c14d3e35ad0a0112cd5f7bac5d0f25b91e51b3e11d40ff" Mar 16 16:22:14 crc kubenswrapper[5120]: I0316 16:22:14.137595 5120 scope.go:117] "RemoveContainer" containerID="dac34075aeb6bc6e192a9a3ad848558733e226ae86f00d5dd46aa7f0bc9852fe" Mar 16 16:22:14 crc kubenswrapper[5120]: I0316 16:22:14.207581 5120 scope.go:117] "RemoveContainer" containerID="766982a964317e9619f7d31e7013d695b8a9f52e78e42fc7480d9bac69603893" Mar 16 16:22:14 crc kubenswrapper[5120]: I0316 16:22:14.247640 5120 scope.go:117] "RemoveContainer" containerID="ad8f6c4dcb3659e2c4cbe189da7a816ad948ca69a309d3a2140b84893c720ed6" Mar 16 16:22:14 crc kubenswrapper[5120]: I0316 16:22:14.280543 5120 scope.go:117] "RemoveContainer" containerID="a2b5bb293c850d9efc551f9bb6c4bb698396da51ecac0ac9a7494438c023a581" Mar 16 16:22:14 crc kubenswrapper[5120]: I0316 16:22:14.327487 5120 scope.go:117] "RemoveContainer" containerID="725f4e686ce47597a3e0b8dd9e7330d349e62a035ac96bd7354c4a2e53d2ac39" Mar 16 16:22:14 crc kubenswrapper[5120]: I0316 16:22:14.351556 5120 scope.go:117] "RemoveContainer" containerID="a3311cf05ee4f0b66524c04257f99504b0af3167a74573741bd8a50f6873690c" Mar 16 16:22:14 crc kubenswrapper[5120]: I0316 16:22:14.357648 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"954b8df0-5a5c-4057-a887-fc920c995ce0","Type":"ContainerStarted","Data":"9eb0d9d024a82549c280fe4c7e1ed4e65dc61eacd1ba3ddfc3b8c06aac3fba28"} Mar 16 16:22:14 crc kubenswrapper[5120]: I0316 16:22:14.376600 5120 scope.go:117] "RemoveContainer" containerID="a2e438fc9999e069782ed119547c3c2d018c963e082bf48fcbbd7cc8e78719ff" Mar 16 16:22:14 crc kubenswrapper[5120]: I0316 16:22:14.397116 5120 scope.go:117] "RemoveContainer" containerID="3d30ff5d5b126cc2a3c4857604ac839e740aeb06884d340ea105459e0cfc131b" Mar 16 16:22:15 crc kubenswrapper[5120]: I0316 16:22:15.377536 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"954b8df0-5a5c-4057-a887-fc920c995ce0","Type":"ContainerStarted","Data":"c60a3dbd4b93459618559c9157315430acd5193440d24ad271e7fe903009f32c"} Mar 16 16:22:15 crc kubenswrapper[5120]: I0316 16:22:15.983806 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/neutron-6d4b69cb4d-gjpzv" Mar 16 16:22:16 crc kubenswrapper[5120]: I0316 16:22:16.060198 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-7bccf4cf49-4xg9g"] Mar 16 16:22:16 crc kubenswrapper[5120]: I0316 16:22:16.060436 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-7bccf4cf49-4xg9g" podUID="81b5f864-0fd2-4f60-a59d-f37ea787f938" containerName="neutron-api" containerID="cri-o://e7d2c352088e95d9a105b34f2c007137b4dd6063eb236929c342f8930e702e8b" gracePeriod=30 Mar 16 16:22:16 crc kubenswrapper[5120]: I0316 16:22:16.060890 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-7bccf4cf49-4xg9g" podUID="81b5f864-0fd2-4f60-a59d-f37ea787f938" containerName="neutron-httpd" containerID="cri-o://0ec532e38e77a8c2fb10baeb9e3f00655491b28243540d510c37807942ce6cb9" gracePeriod=30 Mar 16 16:22:16 crc kubenswrapper[5120]: I0316 16:22:16.266187 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:22:16 crc kubenswrapper[5120]: I0316 16:22:16.266459 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="3b45ef4a-c2e4-4ddb-b51f-aaaaac181aac" containerName="glance-log" containerID="cri-o://7f5e65844564bb87a668ddf064d998658e40b3861b086ad783415350b42b86a3" gracePeriod=30 Mar 16 16:22:16 crc kubenswrapper[5120]: I0316 16:22:16.266607 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="3b45ef4a-c2e4-4ddb-b51f-aaaaac181aac" containerName="glance-httpd" containerID="cri-o://59e2208f07cce59a54ce43914a7ec56234e2cfd2367f283d1f1b4a096c2cd0ae" gracePeriod=30 Mar 16 16:22:16 crc kubenswrapper[5120]: I0316 16:22:16.328730 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/swift-proxy-8698d79fbb-6czlj" Mar 16 16:22:16 crc kubenswrapper[5120]: I0316 16:22:16.331405 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/swift-proxy-8698d79fbb-6czlj" Mar 16 16:22:16 crc kubenswrapper[5120]: E0316 16:22:16.347283 5120 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod81b5f864_0fd2_4f60_a59d_f37ea787f938.slice/crio-conmon-0ec532e38e77a8c2fb10baeb9e3f00655491b28243540d510c37807942ce6cb9.scope\": RecentStats: unable to find data in memory cache]" Mar 16 16:22:16 crc kubenswrapper[5120]: I0316 16:22:16.421530 5120 generic.go:358] "Generic (PLEG): container finished" podID="81b5f864-0fd2-4f60-a59d-f37ea787f938" containerID="0ec532e38e77a8c2fb10baeb9e3f00655491b28243540d510c37807942ce6cb9" exitCode=0 Mar 16 16:22:16 crc kubenswrapper[5120]: I0316 16:22:16.421622 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-7bccf4cf49-4xg9g" event={"ID":"81b5f864-0fd2-4f60-a59d-f37ea787f938","Type":"ContainerDied","Data":"0ec532e38e77a8c2fb10baeb9e3f00655491b28243540d510c37807942ce6cb9"} Mar 16 16:22:17 crc kubenswrapper[5120]: I0316 16:22:17.433553 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"954b8df0-5a5c-4057-a887-fc920c995ce0","Type":"ContainerStarted","Data":"65356c1dfdebe9004a8391665e2f7bdd617317a2b5e16ef74b358b42449c8430"} Mar 16 16:22:17 crc kubenswrapper[5120]: I0316 16:22:17.435054 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:22:17 crc kubenswrapper[5120]: I0316 16:22:17.439129 5120 generic.go:358] "Generic (PLEG): container finished" podID="3b45ef4a-c2e4-4ddb-b51f-aaaaac181aac" containerID="7f5e65844564bb87a668ddf064d998658e40b3861b086ad783415350b42b86a3" exitCode=143 Mar 16 16:22:17 crc kubenswrapper[5120]: I0316 16:22:17.439240 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"3b45ef4a-c2e4-4ddb-b51f-aaaaac181aac","Type":"ContainerDied","Data":"7f5e65844564bb87a668ddf064d998658e40b3861b086ad783415350b42b86a3"} Mar 16 16:22:17 crc kubenswrapper[5120]: I0316 16:22:17.460847 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.140368594 podStartE2EDuration="6.460830965s" podCreationTimestamp="2026-03-16 16:22:11 +0000 UTC" firstStartedPulling="2026-03-16 16:22:12.543018436 +0000 UTC m=+3034.696950083" lastFinishedPulling="2026-03-16 16:22:16.863480797 +0000 UTC m=+3039.017412454" observedRunningTime="2026-03-16 16:22:17.456067957 +0000 UTC m=+3039.609999624" watchObservedRunningTime="2026-03-16 16:22:17.460830965 +0000 UTC m=+3039.614762622" Mar 16 16:22:18 crc kubenswrapper[5120]: I0316 16:22:18.962752 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-fcjdd"] Mar 16 16:22:18 crc kubenswrapper[5120]: I0316 16:22:18.969466 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-db-create-fcjdd" Mar 16 16:22:18 crc kubenswrapper[5120]: I0316 16:22:18.975788 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:22:18 crc kubenswrapper[5120]: I0316 16:22:18.976277 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="c99f889b-8cce-419b-bea2-16bbac703bca" containerName="glance-httpd" containerID="cri-o://fcdab08251b097dec25fdba98221132625088fbe856c4964b494d87f06509eca" gracePeriod=30 Mar 16 16:22:18 crc kubenswrapper[5120]: I0316 16:22:18.976222 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="c99f889b-8cce-419b-bea2-16bbac703bca" containerName="glance-log" containerID="cri-o://5ab7d4db2915f9758b009d7c96025ef3c39006b82f4c7495cfaa192b41d89d6c" gracePeriod=30 Mar 16 16:22:18 crc kubenswrapper[5120]: I0316 16:22:18.989034 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-fcjdd"] Mar 16 16:22:19 crc kubenswrapper[5120]: I0316 16:22:19.060511 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94x29\" (UniqueName: \"kubernetes.io/projected/803bf3cd-94da-4de9-a2c1-c92bb5453589-kube-api-access-94x29\") pod \"nova-api-db-create-fcjdd\" (UID: \"803bf3cd-94da-4de9-a2c1-c92bb5453589\") " pod="openstack-kuttl-tests/nova-api-db-create-fcjdd" Mar 16 16:22:19 crc kubenswrapper[5120]: I0316 16:22:19.061184 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/803bf3cd-94da-4de9-a2c1-c92bb5453589-operator-scripts\") pod \"nova-api-db-create-fcjdd\" (UID: \"803bf3cd-94da-4de9-a2c1-c92bb5453589\") " pod="openstack-kuttl-tests/nova-api-db-create-fcjdd" Mar 16 16:22:19 crc kubenswrapper[5120]: I0316 16:22:19.077116 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-xb2nh"] Mar 16 16:22:19 crc kubenswrapper[5120]: I0316 16:22:19.112719 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-xb2nh"] Mar 16 16:22:19 crc kubenswrapper[5120]: I0316 16:22:19.113895 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-9428-account-create-update-hzch2"] Mar 16 16:22:19 crc kubenswrapper[5120]: I0316 16:22:19.113718 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-db-create-xb2nh" Mar 16 16:22:19 crc kubenswrapper[5120]: I0316 16:22:19.141264 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-9428-account-create-update-hzch2"] Mar 16 16:22:19 crc kubenswrapper[5120]: I0316 16:22:19.141329 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:22:19 crc kubenswrapper[5120]: I0316 16:22:19.141494 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-9428-account-create-update-hzch2" Mar 16 16:22:19 crc kubenswrapper[5120]: I0316 16:22:19.150121 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-db-secret\"" Mar 16 16:22:19 crc kubenswrapper[5120]: I0316 16:22:19.162695 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/803bf3cd-94da-4de9-a2c1-c92bb5453589-operator-scripts\") pod \"nova-api-db-create-fcjdd\" (UID: \"803bf3cd-94da-4de9-a2c1-c92bb5453589\") " pod="openstack-kuttl-tests/nova-api-db-create-fcjdd" Mar 16 16:22:19 crc kubenswrapper[5120]: I0316 16:22:19.162929 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-94x29\" (UniqueName: \"kubernetes.io/projected/803bf3cd-94da-4de9-a2c1-c92bb5453589-kube-api-access-94x29\") pod \"nova-api-db-create-fcjdd\" (UID: \"803bf3cd-94da-4de9-a2c1-c92bb5453589\") " pod="openstack-kuttl-tests/nova-api-db-create-fcjdd" Mar 16 16:22:19 crc kubenswrapper[5120]: I0316 16:22:19.164307 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/803bf3cd-94da-4de9-a2c1-c92bb5453589-operator-scripts\") pod \"nova-api-db-create-fcjdd\" (UID: \"803bf3cd-94da-4de9-a2c1-c92bb5453589\") " pod="openstack-kuttl-tests/nova-api-db-create-fcjdd" Mar 16 16:22:19 crc kubenswrapper[5120]: I0316 16:22:19.213036 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-94x29\" (UniqueName: \"kubernetes.io/projected/803bf3cd-94da-4de9-a2c1-c92bb5453589-kube-api-access-94x29\") pod \"nova-api-db-create-fcjdd\" (UID: \"803bf3cd-94da-4de9-a2c1-c92bb5453589\") " pod="openstack-kuttl-tests/nova-api-db-create-fcjdd" Mar 16 16:22:19 crc kubenswrapper[5120]: I0316 16:22:19.263241 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-n2wfm"] Mar 16 16:22:19 crc kubenswrapper[5120]: I0316 16:22:19.264539 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/832b7d40-7b24-49a1-9247-e10c8747b7ff-operator-scripts\") pod \"nova-api-9428-account-create-update-hzch2\" (UID: \"832b7d40-7b24-49a1-9247-e10c8747b7ff\") " pod="openstack-kuttl-tests/nova-api-9428-account-create-update-hzch2" Mar 16 16:22:19 crc kubenswrapper[5120]: I0316 16:22:19.264798 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9efd76f8-2676-4522-900e-ade9c74942aa-operator-scripts\") pod \"nova-cell0-db-create-xb2nh\" (UID: \"9efd76f8-2676-4522-900e-ade9c74942aa\") " pod="openstack-kuttl-tests/nova-cell0-db-create-xb2nh" Mar 16 16:22:19 crc kubenswrapper[5120]: I0316 16:22:19.264854 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfb27\" (UniqueName: \"kubernetes.io/projected/832b7d40-7b24-49a1-9247-e10c8747b7ff-kube-api-access-qfb27\") pod \"nova-api-9428-account-create-update-hzch2\" (UID: \"832b7d40-7b24-49a1-9247-e10c8747b7ff\") " pod="openstack-kuttl-tests/nova-api-9428-account-create-update-hzch2" Mar 16 16:22:19 crc kubenswrapper[5120]: I0316 16:22:19.265214 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znjws\" (UniqueName: \"kubernetes.io/projected/9efd76f8-2676-4522-900e-ade9c74942aa-kube-api-access-znjws\") pod \"nova-cell0-db-create-xb2nh\" (UID: \"9efd76f8-2676-4522-900e-ade9c74942aa\") " pod="openstack-kuttl-tests/nova-cell0-db-create-xb2nh" Mar 16 16:22:19 crc kubenswrapper[5120]: I0316 16:22:19.270000 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-db-create-n2wfm" Mar 16 16:22:19 crc kubenswrapper[5120]: I0316 16:22:19.275077 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-n2wfm"] Mar 16 16:22:19 crc kubenswrapper[5120]: I0316 16:22:19.293798 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-c949-account-create-update-8vkk4"] Mar 16 16:22:19 crc kubenswrapper[5120]: I0316 16:22:19.296106 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-db-create-fcjdd" Mar 16 16:22:19 crc kubenswrapper[5120]: I0316 16:22:19.300632 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-c949-account-create-update-8vkk4" Mar 16 16:22:19 crc kubenswrapper[5120]: I0316 16:22:19.307298 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-db-secret\"" Mar 16 16:22:19 crc kubenswrapper[5120]: I0316 16:22:19.320233 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-c949-account-create-update-8vkk4"] Mar 16 16:22:19 crc kubenswrapper[5120]: I0316 16:22:19.367608 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2da9f738-8983-4a21-ae37-5917076739f4-operator-scripts\") pod \"nova-cell0-c949-account-create-update-8vkk4\" (UID: \"2da9f738-8983-4a21-ae37-5917076739f4\") " pod="openstack-kuttl-tests/nova-cell0-c949-account-create-update-8vkk4" Mar 16 16:22:19 crc kubenswrapper[5120]: I0316 16:22:19.367803 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9efd76f8-2676-4522-900e-ade9c74942aa-operator-scripts\") pod \"nova-cell0-db-create-xb2nh\" (UID: \"9efd76f8-2676-4522-900e-ade9c74942aa\") " pod="openstack-kuttl-tests/nova-cell0-db-create-xb2nh" Mar 16 16:22:19 crc kubenswrapper[5120]: I0316 16:22:19.367845 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qfb27\" (UniqueName: \"kubernetes.io/projected/832b7d40-7b24-49a1-9247-e10c8747b7ff-kube-api-access-qfb27\") pod \"nova-api-9428-account-create-update-hzch2\" (UID: \"832b7d40-7b24-49a1-9247-e10c8747b7ff\") " pod="openstack-kuttl-tests/nova-api-9428-account-create-update-hzch2" Mar 16 16:22:19 crc kubenswrapper[5120]: I0316 16:22:19.367871 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vlmql\" (UniqueName: \"kubernetes.io/projected/bea1d61f-54be-4e9e-ae9f-9cd209757cd5-kube-api-access-vlmql\") pod \"nova-cell1-db-create-n2wfm\" (UID: \"bea1d61f-54be-4e9e-ae9f-9cd209757cd5\") " pod="openstack-kuttl-tests/nova-cell1-db-create-n2wfm" Mar 16 16:22:19 crc kubenswrapper[5120]: I0316 16:22:19.367930 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/bea1d61f-54be-4e9e-ae9f-9cd209757cd5-operator-scripts\") pod \"nova-cell1-db-create-n2wfm\" (UID: \"bea1d61f-54be-4e9e-ae9f-9cd209757cd5\") " pod="openstack-kuttl-tests/nova-cell1-db-create-n2wfm" Mar 16 16:22:19 crc kubenswrapper[5120]: I0316 16:22:19.367951 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xdv9\" (UniqueName: \"kubernetes.io/projected/2da9f738-8983-4a21-ae37-5917076739f4-kube-api-access-9xdv9\") pod \"nova-cell0-c949-account-create-update-8vkk4\" (UID: \"2da9f738-8983-4a21-ae37-5917076739f4\") " pod="openstack-kuttl-tests/nova-cell0-c949-account-create-update-8vkk4" Mar 16 16:22:19 crc kubenswrapper[5120]: I0316 16:22:19.368000 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-znjws\" (UniqueName: \"kubernetes.io/projected/9efd76f8-2676-4522-900e-ade9c74942aa-kube-api-access-znjws\") pod \"nova-cell0-db-create-xb2nh\" (UID: \"9efd76f8-2676-4522-900e-ade9c74942aa\") " pod="openstack-kuttl-tests/nova-cell0-db-create-xb2nh" Mar 16 16:22:19 crc kubenswrapper[5120]: I0316 16:22:19.368045 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/832b7d40-7b24-49a1-9247-e10c8747b7ff-operator-scripts\") pod \"nova-api-9428-account-create-update-hzch2\" (UID: \"832b7d40-7b24-49a1-9247-e10c8747b7ff\") " pod="openstack-kuttl-tests/nova-api-9428-account-create-update-hzch2" Mar 16 16:22:19 crc kubenswrapper[5120]: I0316 16:22:19.369219 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/832b7d40-7b24-49a1-9247-e10c8747b7ff-operator-scripts\") pod \"nova-api-9428-account-create-update-hzch2\" (UID: \"832b7d40-7b24-49a1-9247-e10c8747b7ff\") " pod="openstack-kuttl-tests/nova-api-9428-account-create-update-hzch2" Mar 16 16:22:19 crc kubenswrapper[5120]: I0316 16:22:19.369655 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9efd76f8-2676-4522-900e-ade9c74942aa-operator-scripts\") pod \"nova-cell0-db-create-xb2nh\" (UID: \"9efd76f8-2676-4522-900e-ade9c74942aa\") " pod="openstack-kuttl-tests/nova-cell0-db-create-xb2nh" Mar 16 16:22:19 crc kubenswrapper[5120]: I0316 16:22:19.385149 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfb27\" (UniqueName: \"kubernetes.io/projected/832b7d40-7b24-49a1-9247-e10c8747b7ff-kube-api-access-qfb27\") pod \"nova-api-9428-account-create-update-hzch2\" (UID: \"832b7d40-7b24-49a1-9247-e10c8747b7ff\") " pod="openstack-kuttl-tests/nova-api-9428-account-create-update-hzch2" Mar 16 16:22:19 crc kubenswrapper[5120]: I0316 16:22:19.385598 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-znjws\" (UniqueName: \"kubernetes.io/projected/9efd76f8-2676-4522-900e-ade9c74942aa-kube-api-access-znjws\") pod \"nova-cell0-db-create-xb2nh\" (UID: \"9efd76f8-2676-4522-900e-ade9c74942aa\") " pod="openstack-kuttl-tests/nova-cell0-db-create-xb2nh" Mar 16 16:22:19 crc kubenswrapper[5120]: I0316 16:22:19.461940 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-db-create-xb2nh" Mar 16 16:22:19 crc kubenswrapper[5120]: I0316 16:22:19.469848 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2da9f738-8983-4a21-ae37-5917076739f4-operator-scripts\") pod \"nova-cell0-c949-account-create-update-8vkk4\" (UID: \"2da9f738-8983-4a21-ae37-5917076739f4\") " pod="openstack-kuttl-tests/nova-cell0-c949-account-create-update-8vkk4" Mar 16 16:22:19 crc kubenswrapper[5120]: I0316 16:22:19.470122 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vlmql\" (UniqueName: \"kubernetes.io/projected/bea1d61f-54be-4e9e-ae9f-9cd209757cd5-kube-api-access-vlmql\") pod \"nova-cell1-db-create-n2wfm\" (UID: \"bea1d61f-54be-4e9e-ae9f-9cd209757cd5\") " pod="openstack-kuttl-tests/nova-cell1-db-create-n2wfm" Mar 16 16:22:19 crc kubenswrapper[5120]: I0316 16:22:19.470190 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/bea1d61f-54be-4e9e-ae9f-9cd209757cd5-operator-scripts\") pod \"nova-cell1-db-create-n2wfm\" (UID: \"bea1d61f-54be-4e9e-ae9f-9cd209757cd5\") " pod="openstack-kuttl-tests/nova-cell1-db-create-n2wfm" Mar 16 16:22:19 crc kubenswrapper[5120]: I0316 16:22:19.470208 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9xdv9\" (UniqueName: \"kubernetes.io/projected/2da9f738-8983-4a21-ae37-5917076739f4-kube-api-access-9xdv9\") pod \"nova-cell0-c949-account-create-update-8vkk4\" (UID: \"2da9f738-8983-4a21-ae37-5917076739f4\") " pod="openstack-kuttl-tests/nova-cell0-c949-account-create-update-8vkk4" Mar 16 16:22:19 crc kubenswrapper[5120]: I0316 16:22:19.471571 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2da9f738-8983-4a21-ae37-5917076739f4-operator-scripts\") pod \"nova-cell0-c949-account-create-update-8vkk4\" (UID: \"2da9f738-8983-4a21-ae37-5917076739f4\") " pod="openstack-kuttl-tests/nova-cell0-c949-account-create-update-8vkk4" Mar 16 16:22:19 crc kubenswrapper[5120]: I0316 16:22:19.472313 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/bea1d61f-54be-4e9e-ae9f-9cd209757cd5-operator-scripts\") pod \"nova-cell1-db-create-n2wfm\" (UID: \"bea1d61f-54be-4e9e-ae9f-9cd209757cd5\") " pod="openstack-kuttl-tests/nova-cell1-db-create-n2wfm" Mar 16 16:22:19 crc kubenswrapper[5120]: I0316 16:22:19.472345 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-3f68-account-create-update-6x45z"] Mar 16 16:22:19 crc kubenswrapper[5120]: I0316 16:22:19.475053 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-9428-account-create-update-hzch2" Mar 16 16:22:19 crc kubenswrapper[5120]: I0316 16:22:19.492368 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vlmql\" (UniqueName: \"kubernetes.io/projected/bea1d61f-54be-4e9e-ae9f-9cd209757cd5-kube-api-access-vlmql\") pod \"nova-cell1-db-create-n2wfm\" (UID: \"bea1d61f-54be-4e9e-ae9f-9cd209757cd5\") " pod="openstack-kuttl-tests/nova-cell1-db-create-n2wfm" Mar 16 16:22:19 crc kubenswrapper[5120]: I0316 16:22:19.498299 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xdv9\" (UniqueName: \"kubernetes.io/projected/2da9f738-8983-4a21-ae37-5917076739f4-kube-api-access-9xdv9\") pod \"nova-cell0-c949-account-create-update-8vkk4\" (UID: \"2da9f738-8983-4a21-ae37-5917076739f4\") " pod="openstack-kuttl-tests/nova-cell0-c949-account-create-update-8vkk4" Mar 16 16:22:19 crc kubenswrapper[5120]: I0316 16:22:19.507601 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-3f68-account-create-update-6x45z"] Mar 16 16:22:19 crc kubenswrapper[5120]: I0316 16:22:19.507805 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-3f68-account-create-update-6x45z" Mar 16 16:22:19 crc kubenswrapper[5120]: I0316 16:22:19.513115 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-db-secret\"" Mar 16 16:22:19 crc kubenswrapper[5120]: I0316 16:22:19.517527 5120 generic.go:358] "Generic (PLEG): container finished" podID="c99f889b-8cce-419b-bea2-16bbac703bca" containerID="5ab7d4db2915f9758b009d7c96025ef3c39006b82f4c7495cfaa192b41d89d6c" exitCode=143 Mar 16 16:22:19 crc kubenswrapper[5120]: I0316 16:22:19.519180 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"c99f889b-8cce-419b-bea2-16bbac703bca","Type":"ContainerDied","Data":"5ab7d4db2915f9758b009d7c96025ef3c39006b82f4c7495cfaa192b41d89d6c"} Mar 16 16:22:19 crc kubenswrapper[5120]: I0316 16:22:19.522393 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="954b8df0-5a5c-4057-a887-fc920c995ce0" containerName="ceilometer-central-agent" containerID="cri-o://899cdc537eabf72f56e57dfed12366c810c0469aa975dd59cc4c8ba413f86dd3" gracePeriod=30 Mar 16 16:22:19 crc kubenswrapper[5120]: I0316 16:22:19.522561 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="954b8df0-5a5c-4057-a887-fc920c995ce0" containerName="proxy-httpd" containerID="cri-o://65356c1dfdebe9004a8391665e2f7bdd617317a2b5e16ef74b358b42449c8430" gracePeriod=30 Mar 16 16:22:19 crc kubenswrapper[5120]: I0316 16:22:19.522604 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="954b8df0-5a5c-4057-a887-fc920c995ce0" containerName="sg-core" containerID="cri-o://c60a3dbd4b93459618559c9157315430acd5193440d24ad271e7fe903009f32c" gracePeriod=30 Mar 16 16:22:19 crc kubenswrapper[5120]: I0316 16:22:19.522638 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="954b8df0-5a5c-4057-a887-fc920c995ce0" containerName="ceilometer-notification-agent" containerID="cri-o://9eb0d9d024a82549c280fe4c7e1ed4e65dc61eacd1ba3ddfc3b8c06aac3fba28" gracePeriod=30 Mar 16 16:22:19 crc kubenswrapper[5120]: I0316 16:22:19.572550 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/35ce1e81-fe7f-42f9-b95d-3730a347e275-operator-scripts\") pod \"nova-cell1-3f68-account-create-update-6x45z\" (UID: \"35ce1e81-fe7f-42f9-b95d-3730a347e275\") " pod="openstack-kuttl-tests/nova-cell1-3f68-account-create-update-6x45z" Mar 16 16:22:19 crc kubenswrapper[5120]: I0316 16:22:19.572886 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdfxd\" (UniqueName: \"kubernetes.io/projected/35ce1e81-fe7f-42f9-b95d-3730a347e275-kube-api-access-tdfxd\") pod \"nova-cell1-3f68-account-create-update-6x45z\" (UID: \"35ce1e81-fe7f-42f9-b95d-3730a347e275\") " pod="openstack-kuttl-tests/nova-cell1-3f68-account-create-update-6x45z" Mar 16 16:22:19 crc kubenswrapper[5120]: I0316 16:22:19.615926 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-db-create-n2wfm" Mar 16 16:22:19 crc kubenswrapper[5120]: I0316 16:22:19.677924 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tdfxd\" (UniqueName: \"kubernetes.io/projected/35ce1e81-fe7f-42f9-b95d-3730a347e275-kube-api-access-tdfxd\") pod \"nova-cell1-3f68-account-create-update-6x45z\" (UID: \"35ce1e81-fe7f-42f9-b95d-3730a347e275\") " pod="openstack-kuttl-tests/nova-cell1-3f68-account-create-update-6x45z" Mar 16 16:22:19 crc kubenswrapper[5120]: I0316 16:22:19.678195 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/35ce1e81-fe7f-42f9-b95d-3730a347e275-operator-scripts\") pod \"nova-cell1-3f68-account-create-update-6x45z\" (UID: \"35ce1e81-fe7f-42f9-b95d-3730a347e275\") " pod="openstack-kuttl-tests/nova-cell1-3f68-account-create-update-6x45z" Mar 16 16:22:19 crc kubenswrapper[5120]: I0316 16:22:19.678932 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/35ce1e81-fe7f-42f9-b95d-3730a347e275-operator-scripts\") pod \"nova-cell1-3f68-account-create-update-6x45z\" (UID: \"35ce1e81-fe7f-42f9-b95d-3730a347e275\") " pod="openstack-kuttl-tests/nova-cell1-3f68-account-create-update-6x45z" Mar 16 16:22:19 crc kubenswrapper[5120]: I0316 16:22:19.698196 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdfxd\" (UniqueName: \"kubernetes.io/projected/35ce1e81-fe7f-42f9-b95d-3730a347e275-kube-api-access-tdfxd\") pod \"nova-cell1-3f68-account-create-update-6x45z\" (UID: \"35ce1e81-fe7f-42f9-b95d-3730a347e275\") " pod="openstack-kuttl-tests/nova-cell1-3f68-account-create-update-6x45z" Mar 16 16:22:19 crc kubenswrapper[5120]: I0316 16:22:19.774561 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-c949-account-create-update-8vkk4" Mar 16 16:22:19 crc kubenswrapper[5120]: I0316 16:22:19.848810 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-fcjdd"] Mar 16 16:22:19 crc kubenswrapper[5120]: I0316 16:22:19.888990 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-3f68-account-create-update-6x45z" Mar 16 16:22:20 crc kubenswrapper[5120]: I0316 16:22:20.048612 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-9428-account-create-update-hzch2"] Mar 16 16:22:20 crc kubenswrapper[5120]: I0316 16:22:20.202988 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-xb2nh"] Mar 16 16:22:20 crc kubenswrapper[5120]: I0316 16:22:20.347466 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:22:20 crc kubenswrapper[5120]: I0316 16:22:20.424218 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-n2wfm"] Mar 16 16:22:20 crc kubenswrapper[5120]: I0316 16:22:20.443404 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-c949-account-create-update-8vkk4"] Mar 16 16:22:20 crc kubenswrapper[5120]: I0316 16:22:20.503469 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/3b45ef4a-c2e4-4ddb-b51f-aaaaac181aac-httpd-run\") pod \"3b45ef4a-c2e4-4ddb-b51f-aaaaac181aac\" (UID: \"3b45ef4a-c2e4-4ddb-b51f-aaaaac181aac\") " Mar 16 16:22:20 crc kubenswrapper[5120]: I0316 16:22:20.503555 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") pod \"3b45ef4a-c2e4-4ddb-b51f-aaaaac181aac\" (UID: \"3b45ef4a-c2e4-4ddb-b51f-aaaaac181aac\") " Mar 16 16:22:20 crc kubenswrapper[5120]: I0316 16:22:20.503601 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/3b45ef4a-c2e4-4ddb-b51f-aaaaac181aac-public-tls-certs\") pod \"3b45ef4a-c2e4-4ddb-b51f-aaaaac181aac\" (UID: \"3b45ef4a-c2e4-4ddb-b51f-aaaaac181aac\") " Mar 16 16:22:20 crc kubenswrapper[5120]: I0316 16:22:20.503671 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3b45ef4a-c2e4-4ddb-b51f-aaaaac181aac-config-data\") pod \"3b45ef4a-c2e4-4ddb-b51f-aaaaac181aac\" (UID: \"3b45ef4a-c2e4-4ddb-b51f-aaaaac181aac\") " Mar 16 16:22:20 crc kubenswrapper[5120]: I0316 16:22:20.503722 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3b45ef4a-c2e4-4ddb-b51f-aaaaac181aac-scripts\") pod \"3b45ef4a-c2e4-4ddb-b51f-aaaaac181aac\" (UID: \"3b45ef4a-c2e4-4ddb-b51f-aaaaac181aac\") " Mar 16 16:22:20 crc kubenswrapper[5120]: I0316 16:22:20.503939 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jmqlk\" (UniqueName: \"kubernetes.io/projected/3b45ef4a-c2e4-4ddb-b51f-aaaaac181aac-kube-api-access-jmqlk\") pod \"3b45ef4a-c2e4-4ddb-b51f-aaaaac181aac\" (UID: \"3b45ef4a-c2e4-4ddb-b51f-aaaaac181aac\") " Mar 16 16:22:20 crc kubenswrapper[5120]: I0316 16:22:20.504119 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3b45ef4a-c2e4-4ddb-b51f-aaaaac181aac-logs\") pod \"3b45ef4a-c2e4-4ddb-b51f-aaaaac181aac\" (UID: \"3b45ef4a-c2e4-4ddb-b51f-aaaaac181aac\") " Mar 16 16:22:20 crc kubenswrapper[5120]: I0316 16:22:20.504272 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3b45ef4a-c2e4-4ddb-b51f-aaaaac181aac-combined-ca-bundle\") pod \"3b45ef4a-c2e4-4ddb-b51f-aaaaac181aac\" (UID: \"3b45ef4a-c2e4-4ddb-b51f-aaaaac181aac\") " Mar 16 16:22:20 crc kubenswrapper[5120]: I0316 16:22:20.504632 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b45ef4a-c2e4-4ddb-b51f-aaaaac181aac-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "3b45ef4a-c2e4-4ddb-b51f-aaaaac181aac" (UID: "3b45ef4a-c2e4-4ddb-b51f-aaaaac181aac"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:22:20 crc kubenswrapper[5120]: I0316 16:22:20.504980 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/3b45ef4a-c2e4-4ddb-b51f-aaaaac181aac-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 16:22:20 crc kubenswrapper[5120]: I0316 16:22:20.505258 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b45ef4a-c2e4-4ddb-b51f-aaaaac181aac-logs" (OuterVolumeSpecName: "logs") pod "3b45ef4a-c2e4-4ddb-b51f-aaaaac181aac" (UID: "3b45ef4a-c2e4-4ddb-b51f-aaaaac181aac"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:22:20 crc kubenswrapper[5120]: I0316 16:22:20.516908 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b45ef4a-c2e4-4ddb-b51f-aaaaac181aac-scripts" (OuterVolumeSpecName: "scripts") pod "3b45ef4a-c2e4-4ddb-b51f-aaaaac181aac" (UID: "3b45ef4a-c2e4-4ddb-b51f-aaaaac181aac"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:22:20 crc kubenswrapper[5120]: I0316 16:22:20.535056 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b45ef4a-c2e4-4ddb-b51f-aaaaac181aac-kube-api-access-jmqlk" (OuterVolumeSpecName: "kube-api-access-jmqlk") pod "3b45ef4a-c2e4-4ddb-b51f-aaaaac181aac" (UID: "3b45ef4a-c2e4-4ddb-b51f-aaaaac181aac"). InnerVolumeSpecName "kube-api-access-jmqlk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:22:20 crc kubenswrapper[5120]: I0316 16:22:20.535488 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage19-crc" (OuterVolumeSpecName: "glance") pod "3b45ef4a-c2e4-4ddb-b51f-aaaaac181aac" (UID: "3b45ef4a-c2e4-4ddb-b51f-aaaaac181aac"). InnerVolumeSpecName "local-storage19-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:22:20 crc kubenswrapper[5120]: I0316 16:22:20.556747 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-9428-account-create-update-hzch2" event={"ID":"832b7d40-7b24-49a1-9247-e10c8747b7ff","Type":"ContainerStarted","Data":"21bce66a707103c0c4494b4b34b9d5756cf82eb2fefafd919a0dae858d454b38"} Mar 16 16:22:20 crc kubenswrapper[5120]: I0316 16:22:20.556835 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-9428-account-create-update-hzch2" event={"ID":"832b7d40-7b24-49a1-9247-e10c8747b7ff","Type":"ContainerStarted","Data":"39034781f91e4bda681b3b57196eb5c074899b8a3419c6ba64f7d16f551a29d4"} Mar 16 16:22:20 crc kubenswrapper[5120]: I0316 16:22:20.562195 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-c949-account-create-update-8vkk4" event={"ID":"2da9f738-8983-4a21-ae37-5917076739f4","Type":"ContainerStarted","Data":"f490bba022936392cd4e4b0b917c0b66ac262308bcbc672b5448a2dd1e58c7a7"} Mar 16 16:22:20 crc kubenswrapper[5120]: I0316 16:22:20.574675 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-db-create-n2wfm" event={"ID":"bea1d61f-54be-4e9e-ae9f-9cd209757cd5","Type":"ContainerStarted","Data":"ec237389d0c4e4d487708b132687f4295699555704d129ea5ef696419b6edf21"} Mar 16 16:22:20 crc kubenswrapper[5120]: I0316 16:22:20.597948 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b45ef4a-c2e4-4ddb-b51f-aaaaac181aac-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "3b45ef4a-c2e4-4ddb-b51f-aaaaac181aac" (UID: "3b45ef4a-c2e4-4ddb-b51f-aaaaac181aac"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:22:20 crc kubenswrapper[5120]: I0316 16:22:20.606464 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-db-create-xb2nh" event={"ID":"9efd76f8-2676-4522-900e-ade9c74942aa","Type":"ContainerStarted","Data":"33a4ab6d0801be84ab8ea365dc946cfc333d8e434cce9217ace7dcd436bdd3ae"} Mar 16 16:22:20 crc kubenswrapper[5120]: I0316 16:22:20.608628 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-db-create-xb2nh" event={"ID":"9efd76f8-2676-4522-900e-ade9c74942aa","Type":"ContainerStarted","Data":"22083f89e608c5ba62abbc998b068b021e6fb6d5c053050b6e92c7f75e2dbb68"} Mar 16 16:22:20 crc kubenswrapper[5120]: I0316 16:22:20.612827 5120 generic.go:358] "Generic (PLEG): container finished" podID="803bf3cd-94da-4de9-a2c1-c92bb5453589" containerID="4598e66dbeea0ce54f3f7c7e600bc881bc3248b3052564bab4c10a1d54fe28fd" exitCode=0 Mar 16 16:22:20 crc kubenswrapper[5120]: I0316 16:22:20.612960 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-db-create-fcjdd" event={"ID":"803bf3cd-94da-4de9-a2c1-c92bb5453589","Type":"ContainerDied","Data":"4598e66dbeea0ce54f3f7c7e600bc881bc3248b3052564bab4c10a1d54fe28fd"} Mar 16 16:22:20 crc kubenswrapper[5120]: I0316 16:22:20.612992 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-db-create-fcjdd" event={"ID":"803bf3cd-94da-4de9-a2c1-c92bb5453589","Type":"ContainerStarted","Data":"a9c0d5f375bf04777618c5345f275587b5ab6e244c1ec65451fa67d2dc4b073e"} Mar 16 16:22:20 crc kubenswrapper[5120]: I0316 16:22:20.617086 5120 generic.go:358] "Generic (PLEG): container finished" podID="954b8df0-5a5c-4057-a887-fc920c995ce0" containerID="65356c1dfdebe9004a8391665e2f7bdd617317a2b5e16ef74b358b42449c8430" exitCode=0 Mar 16 16:22:20 crc kubenswrapper[5120]: I0316 16:22:20.617119 5120 generic.go:358] "Generic (PLEG): container finished" podID="954b8df0-5a5c-4057-a887-fc920c995ce0" containerID="c60a3dbd4b93459618559c9157315430acd5193440d24ad271e7fe903009f32c" exitCode=2 Mar 16 16:22:20 crc kubenswrapper[5120]: I0316 16:22:20.617219 5120 generic.go:358] "Generic (PLEG): container finished" podID="954b8df0-5a5c-4057-a887-fc920c995ce0" containerID="9eb0d9d024a82549c280fe4c7e1ed4e65dc61eacd1ba3ddfc3b8c06aac3fba28" exitCode=0 Mar 16 16:22:20 crc kubenswrapper[5120]: I0316 16:22:20.617278 5120 generic.go:358] "Generic (PLEG): container finished" podID="954b8df0-5a5c-4057-a887-fc920c995ce0" containerID="899cdc537eabf72f56e57dfed12366c810c0469aa975dd59cc4c8ba413f86dd3" exitCode=0 Mar 16 16:22:20 crc kubenswrapper[5120]: I0316 16:22:20.617378 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"954b8df0-5a5c-4057-a887-fc920c995ce0","Type":"ContainerDied","Data":"65356c1dfdebe9004a8391665e2f7bdd617317a2b5e16ef74b358b42449c8430"} Mar 16 16:22:20 crc kubenswrapper[5120]: I0316 16:22:20.617495 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"954b8df0-5a5c-4057-a887-fc920c995ce0","Type":"ContainerDied","Data":"c60a3dbd4b93459618559c9157315430acd5193440d24ad271e7fe903009f32c"} Mar 16 16:22:20 crc kubenswrapper[5120]: I0316 16:22:20.617509 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"954b8df0-5a5c-4057-a887-fc920c995ce0","Type":"ContainerDied","Data":"9eb0d9d024a82549c280fe4c7e1ed4e65dc61eacd1ba3ddfc3b8c06aac3fba28"} Mar 16 16:22:20 crc kubenswrapper[5120]: I0316 16:22:20.617520 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"954b8df0-5a5c-4057-a887-fc920c995ce0","Type":"ContainerDied","Data":"899cdc537eabf72f56e57dfed12366c810c0469aa975dd59cc4c8ba413f86dd3"} Mar 16 16:22:20 crc kubenswrapper[5120]: I0316 16:22:20.621487 5120 generic.go:358] "Generic (PLEG): container finished" podID="3b45ef4a-c2e4-4ddb-b51f-aaaaac181aac" containerID="59e2208f07cce59a54ce43914a7ec56234e2cfd2367f283d1f1b4a096c2cd0ae" exitCode=0 Mar 16 16:22:20 crc kubenswrapper[5120]: I0316 16:22:20.621631 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"3b45ef4a-c2e4-4ddb-b51f-aaaaac181aac","Type":"ContainerDied","Data":"59e2208f07cce59a54ce43914a7ec56234e2cfd2367f283d1f1b4a096c2cd0ae"} Mar 16 16:22:20 crc kubenswrapper[5120]: I0316 16:22:20.621674 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"3b45ef4a-c2e4-4ddb-b51f-aaaaac181aac","Type":"ContainerDied","Data":"91d66675f300b3f43d34855167c7f92e5b01d8b24f89c827438b654fe3e78937"} Mar 16 16:22:20 crc kubenswrapper[5120]: I0316 16:22:20.621785 5120 scope.go:117] "RemoveContainer" containerID="59e2208f07cce59a54ce43914a7ec56234e2cfd2367f283d1f1b4a096c2cd0ae" Mar 16 16:22:20 crc kubenswrapper[5120]: I0316 16:22:20.621929 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:22:20 crc kubenswrapper[5120]: I0316 16:22:20.622241 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:22:20 crc kubenswrapper[5120]: I0316 16:22:20.627473 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-9428-account-create-update-hzch2" podStartSLOduration=1.627451143 podStartE2EDuration="1.627451143s" podCreationTimestamp="2026-03-16 16:22:19 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:22:20.574973769 +0000 UTC m=+3042.728905426" watchObservedRunningTime="2026-03-16 16:22:20.627451143 +0000 UTC m=+3042.781382800" Mar 16 16:22:20 crc kubenswrapper[5120]: I0316 16:22:20.679426 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage19-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") on node \"crc\" " Mar 16 16:22:20 crc kubenswrapper[5120]: I0316 16:22:20.679458 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/3b45ef4a-c2e4-4ddb-b51f-aaaaac181aac-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:22:20 crc kubenswrapper[5120]: I0316 16:22:20.679471 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3b45ef4a-c2e4-4ddb-b51f-aaaaac181aac-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:22:20 crc kubenswrapper[5120]: I0316 16:22:20.679483 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jmqlk\" (UniqueName: \"kubernetes.io/projected/3b45ef4a-c2e4-4ddb-b51f-aaaaac181aac-kube-api-access-jmqlk\") on node \"crc\" DevicePath \"\"" Mar 16 16:22:20 crc kubenswrapper[5120]: I0316 16:22:20.679499 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3b45ef4a-c2e4-4ddb-b51f-aaaaac181aac-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:22:20 crc kubenswrapper[5120]: I0316 16:22:20.699509 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b45ef4a-c2e4-4ddb-b51f-aaaaac181aac-config-data" (OuterVolumeSpecName: "config-data") pod "3b45ef4a-c2e4-4ddb-b51f-aaaaac181aac" (UID: "3b45ef4a-c2e4-4ddb-b51f-aaaaac181aac"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:22:20 crc kubenswrapper[5120]: I0316 16:22:20.700241 5120 scope.go:117] "RemoveContainer" containerID="7f5e65844564bb87a668ddf064d998658e40b3861b086ad783415350b42b86a3" Mar 16 16:22:20 crc kubenswrapper[5120]: I0316 16:22:20.704413 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b45ef4a-c2e4-4ddb-b51f-aaaaac181aac-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "3b45ef4a-c2e4-4ddb-b51f-aaaaac181aac" (UID: "3b45ef4a-c2e4-4ddb-b51f-aaaaac181aac"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:22:20 crc kubenswrapper[5120]: I0316 16:22:20.716112 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-db-create-xb2nh" podStartSLOduration=1.716095213 podStartE2EDuration="1.716095213s" podCreationTimestamp="2026-03-16 16:22:19 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:22:20.640125642 +0000 UTC m=+3042.794057299" watchObservedRunningTime="2026-03-16 16:22:20.716095213 +0000 UTC m=+3042.870026870" Mar 16 16:22:20 crc kubenswrapper[5120]: I0316 16:22:20.744489 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage19-crc" (UniqueName: "kubernetes.io/local-volume/local-storage19-crc") on node "crc" Mar 16 16:22:20 crc kubenswrapper[5120]: I0316 16:22:20.751082 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-3f68-account-create-update-6x45z"] Mar 16 16:22:20 crc kubenswrapper[5120]: I0316 16:22:20.780553 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/954b8df0-5a5c-4057-a887-fc920c995ce0-config-data\") pod \"954b8df0-5a5c-4057-a887-fc920c995ce0\" (UID: \"954b8df0-5a5c-4057-a887-fc920c995ce0\") " Mar 16 16:22:20 crc kubenswrapper[5120]: I0316 16:22:20.780689 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/954b8df0-5a5c-4057-a887-fc920c995ce0-sg-core-conf-yaml\") pod \"954b8df0-5a5c-4057-a887-fc920c995ce0\" (UID: \"954b8df0-5a5c-4057-a887-fc920c995ce0\") " Mar 16 16:22:20 crc kubenswrapper[5120]: I0316 16:22:20.780714 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/954b8df0-5a5c-4057-a887-fc920c995ce0-log-httpd\") pod \"954b8df0-5a5c-4057-a887-fc920c995ce0\" (UID: \"954b8df0-5a5c-4057-a887-fc920c995ce0\") " Mar 16 16:22:20 crc kubenswrapper[5120]: I0316 16:22:20.780853 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/954b8df0-5a5c-4057-a887-fc920c995ce0-scripts\") pod \"954b8df0-5a5c-4057-a887-fc920c995ce0\" (UID: \"954b8df0-5a5c-4057-a887-fc920c995ce0\") " Mar 16 16:22:20 crc kubenswrapper[5120]: I0316 16:22:20.781023 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/954b8df0-5a5c-4057-a887-fc920c995ce0-run-httpd\") pod \"954b8df0-5a5c-4057-a887-fc920c995ce0\" (UID: \"954b8df0-5a5c-4057-a887-fc920c995ce0\") " Mar 16 16:22:20 crc kubenswrapper[5120]: I0316 16:22:20.781095 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/954b8df0-5a5c-4057-a887-fc920c995ce0-combined-ca-bundle\") pod \"954b8df0-5a5c-4057-a887-fc920c995ce0\" (UID: \"954b8df0-5a5c-4057-a887-fc920c995ce0\") " Mar 16 16:22:20 crc kubenswrapper[5120]: I0316 16:22:20.781158 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p55k6\" (UniqueName: \"kubernetes.io/projected/954b8df0-5a5c-4057-a887-fc920c995ce0-kube-api-access-p55k6\") pod \"954b8df0-5a5c-4057-a887-fc920c995ce0\" (UID: \"954b8df0-5a5c-4057-a887-fc920c995ce0\") " Mar 16 16:22:20 crc kubenswrapper[5120]: I0316 16:22:20.781891 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3b45ef4a-c2e4-4ddb-b51f-aaaaac181aac-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:22:20 crc kubenswrapper[5120]: I0316 16:22:20.781904 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3b45ef4a-c2e4-4ddb-b51f-aaaaac181aac-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:22:20 crc kubenswrapper[5120]: I0316 16:22:20.781917 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage19-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:22:20 crc kubenswrapper[5120]: I0316 16:22:20.782295 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/954b8df0-5a5c-4057-a887-fc920c995ce0-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "954b8df0-5a5c-4057-a887-fc920c995ce0" (UID: "954b8df0-5a5c-4057-a887-fc920c995ce0"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:22:20 crc kubenswrapper[5120]: I0316 16:22:20.783177 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/954b8df0-5a5c-4057-a887-fc920c995ce0-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "954b8df0-5a5c-4057-a887-fc920c995ce0" (UID: "954b8df0-5a5c-4057-a887-fc920c995ce0"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:22:20 crc kubenswrapper[5120]: I0316 16:22:20.792402 5120 scope.go:117] "RemoveContainer" containerID="59e2208f07cce59a54ce43914a7ec56234e2cfd2367f283d1f1b4a096c2cd0ae" Mar 16 16:22:20 crc kubenswrapper[5120]: E0316 16:22:20.804240 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"59e2208f07cce59a54ce43914a7ec56234e2cfd2367f283d1f1b4a096c2cd0ae\": container with ID starting with 59e2208f07cce59a54ce43914a7ec56234e2cfd2367f283d1f1b4a096c2cd0ae not found: ID does not exist" containerID="59e2208f07cce59a54ce43914a7ec56234e2cfd2367f283d1f1b4a096c2cd0ae" Mar 16 16:22:20 crc kubenswrapper[5120]: I0316 16:22:20.804292 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59e2208f07cce59a54ce43914a7ec56234e2cfd2367f283d1f1b4a096c2cd0ae"} err="failed to get container status \"59e2208f07cce59a54ce43914a7ec56234e2cfd2367f283d1f1b4a096c2cd0ae\": rpc error: code = NotFound desc = could not find container \"59e2208f07cce59a54ce43914a7ec56234e2cfd2367f283d1f1b4a096c2cd0ae\": container with ID starting with 59e2208f07cce59a54ce43914a7ec56234e2cfd2367f283d1f1b4a096c2cd0ae not found: ID does not exist" Mar 16 16:22:20 crc kubenswrapper[5120]: I0316 16:22:20.804318 5120 scope.go:117] "RemoveContainer" containerID="7f5e65844564bb87a668ddf064d998658e40b3861b086ad783415350b42b86a3" Mar 16 16:22:20 crc kubenswrapper[5120]: E0316 16:22:20.805176 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f5e65844564bb87a668ddf064d998658e40b3861b086ad783415350b42b86a3\": container with ID starting with 7f5e65844564bb87a668ddf064d998658e40b3861b086ad783415350b42b86a3 not found: ID does not exist" containerID="7f5e65844564bb87a668ddf064d998658e40b3861b086ad783415350b42b86a3" Mar 16 16:22:20 crc kubenswrapper[5120]: I0316 16:22:20.805204 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f5e65844564bb87a668ddf064d998658e40b3861b086ad783415350b42b86a3"} err="failed to get container status \"7f5e65844564bb87a668ddf064d998658e40b3861b086ad783415350b42b86a3\": rpc error: code = NotFound desc = could not find container \"7f5e65844564bb87a668ddf064d998658e40b3861b086ad783415350b42b86a3\": container with ID starting with 7f5e65844564bb87a668ddf064d998658e40b3861b086ad783415350b42b86a3 not found: ID does not exist" Mar 16 16:22:20 crc kubenswrapper[5120]: I0316 16:22:20.812270 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/954b8df0-5a5c-4057-a887-fc920c995ce0-kube-api-access-p55k6" (OuterVolumeSpecName: "kube-api-access-p55k6") pod "954b8df0-5a5c-4057-a887-fc920c995ce0" (UID: "954b8df0-5a5c-4057-a887-fc920c995ce0"). InnerVolumeSpecName "kube-api-access-p55k6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:22:20 crc kubenswrapper[5120]: I0316 16:22:20.833744 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/954b8df0-5a5c-4057-a887-fc920c995ce0-scripts" (OuterVolumeSpecName: "scripts") pod "954b8df0-5a5c-4057-a887-fc920c995ce0" (UID: "954b8df0-5a5c-4057-a887-fc920c995ce0"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:22:20 crc kubenswrapper[5120]: I0316 16:22:20.885673 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p55k6\" (UniqueName: \"kubernetes.io/projected/954b8df0-5a5c-4057-a887-fc920c995ce0-kube-api-access-p55k6\") on node \"crc\" DevicePath \"\"" Mar 16 16:22:20 crc kubenswrapper[5120]: I0316 16:22:20.885822 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/954b8df0-5a5c-4057-a887-fc920c995ce0-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:22:20 crc kubenswrapper[5120]: I0316 16:22:20.885845 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/954b8df0-5a5c-4057-a887-fc920c995ce0-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:22:20 crc kubenswrapper[5120]: I0316 16:22:20.885856 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/954b8df0-5a5c-4057-a887-fc920c995ce0-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:22:20 crc kubenswrapper[5120]: I0316 16:22:20.896002 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/954b8df0-5a5c-4057-a887-fc920c995ce0-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "954b8df0-5a5c-4057-a887-fc920c995ce0" (UID: "954b8df0-5a5c-4057-a887-fc920c995ce0"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:22:20 crc kubenswrapper[5120]: I0316 16:22:20.953821 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/954b8df0-5a5c-4057-a887-fc920c995ce0-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "954b8df0-5a5c-4057-a887-fc920c995ce0" (UID: "954b8df0-5a5c-4057-a887-fc920c995ce0"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:22:20 crc kubenswrapper[5120]: I0316 16:22:20.975824 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:22:20 crc kubenswrapper[5120]: I0316 16:22:20.975919 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:22:21 crc kubenswrapper[5120]: I0316 16:22:21.002485 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/954b8df0-5a5c-4057-a887-fc920c995ce0-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:22:21 crc kubenswrapper[5120]: I0316 16:22:21.002514 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/954b8df0-5a5c-4057-a887-fc920c995ce0-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 16:22:21 crc kubenswrapper[5120]: I0316 16:22:21.023886 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/954b8df0-5a5c-4057-a887-fc920c995ce0-config-data" (OuterVolumeSpecName: "config-data") pod "954b8df0-5a5c-4057-a887-fc920c995ce0" (UID: "954b8df0-5a5c-4057-a887-fc920c995ce0"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:22:21 crc kubenswrapper[5120]: I0316 16:22:21.050318 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:22:21 crc kubenswrapper[5120]: I0316 16:22:21.051356 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="954b8df0-5a5c-4057-a887-fc920c995ce0" containerName="ceilometer-notification-agent" Mar 16 16:22:21 crc kubenswrapper[5120]: I0316 16:22:21.051370 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="954b8df0-5a5c-4057-a887-fc920c995ce0" containerName="ceilometer-notification-agent" Mar 16 16:22:21 crc kubenswrapper[5120]: I0316 16:22:21.051382 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="954b8df0-5a5c-4057-a887-fc920c995ce0" containerName="sg-core" Mar 16 16:22:21 crc kubenswrapper[5120]: I0316 16:22:21.051387 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="954b8df0-5a5c-4057-a887-fc920c995ce0" containerName="sg-core" Mar 16 16:22:21 crc kubenswrapper[5120]: I0316 16:22:21.051422 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="954b8df0-5a5c-4057-a887-fc920c995ce0" containerName="proxy-httpd" Mar 16 16:22:21 crc kubenswrapper[5120]: I0316 16:22:21.051428 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="954b8df0-5a5c-4057-a887-fc920c995ce0" containerName="proxy-httpd" Mar 16 16:22:21 crc kubenswrapper[5120]: I0316 16:22:21.051441 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="954b8df0-5a5c-4057-a887-fc920c995ce0" containerName="ceilometer-central-agent" Mar 16 16:22:21 crc kubenswrapper[5120]: I0316 16:22:21.051446 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="954b8df0-5a5c-4057-a887-fc920c995ce0" containerName="ceilometer-central-agent" Mar 16 16:22:21 crc kubenswrapper[5120]: I0316 16:22:21.051472 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b45ef4a-c2e4-4ddb-b51f-aaaaac181aac" containerName="glance-log" Mar 16 16:22:21 crc kubenswrapper[5120]: I0316 16:22:21.051478 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b45ef4a-c2e4-4ddb-b51f-aaaaac181aac" containerName="glance-log" Mar 16 16:22:21 crc kubenswrapper[5120]: I0316 16:22:21.051500 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b45ef4a-c2e4-4ddb-b51f-aaaaac181aac" containerName="glance-httpd" Mar 16 16:22:21 crc kubenswrapper[5120]: I0316 16:22:21.051507 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b45ef4a-c2e4-4ddb-b51f-aaaaac181aac" containerName="glance-httpd" Mar 16 16:22:21 crc kubenswrapper[5120]: I0316 16:22:21.051661 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="3b45ef4a-c2e4-4ddb-b51f-aaaaac181aac" containerName="glance-log" Mar 16 16:22:21 crc kubenswrapper[5120]: I0316 16:22:21.051679 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="954b8df0-5a5c-4057-a887-fc920c995ce0" containerName="sg-core" Mar 16 16:22:21 crc kubenswrapper[5120]: I0316 16:22:21.051688 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="954b8df0-5a5c-4057-a887-fc920c995ce0" containerName="proxy-httpd" Mar 16 16:22:21 crc kubenswrapper[5120]: I0316 16:22:21.051697 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="954b8df0-5a5c-4057-a887-fc920c995ce0" containerName="ceilometer-central-agent" Mar 16 16:22:21 crc kubenswrapper[5120]: I0316 16:22:21.051707 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="3b45ef4a-c2e4-4ddb-b51f-aaaaac181aac" containerName="glance-httpd" Mar 16 16:22:21 crc kubenswrapper[5120]: I0316 16:22:21.051714 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="954b8df0-5a5c-4057-a887-fc920c995ce0" containerName="ceilometer-notification-agent" Mar 16 16:22:21 crc kubenswrapper[5120]: I0316 16:22:21.058314 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:22:21 crc kubenswrapper[5120]: I0316 16:22:21.062576 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-external-config-data\"" Mar 16 16:22:21 crc kubenswrapper[5120]: I0316 16:22:21.062877 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-public-svc\"" Mar 16 16:22:21 crc kubenswrapper[5120]: I0316 16:22:21.079062 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:22:21 crc kubenswrapper[5120]: I0316 16:22:21.105060 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/954b8df0-5a5c-4057-a887-fc920c995ce0-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:22:21 crc kubenswrapper[5120]: I0316 16:22:21.206579 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d4b88a4e-143e-46bd-ada8-56dece11d6cc-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"d4b88a4e-143e-46bd-ada8-56dece11d6cc\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:22:21 crc kubenswrapper[5120]: I0316 16:22:21.207016 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d4b88a4e-143e-46bd-ada8-56dece11d6cc-logs\") pod \"glance-default-external-api-0\" (UID: \"d4b88a4e-143e-46bd-ada8-56dece11d6cc\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:22:21 crc kubenswrapper[5120]: I0316 16:22:21.207042 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d4b88a4e-143e-46bd-ada8-56dece11d6cc-scripts\") pod \"glance-default-external-api-0\" (UID: \"d4b88a4e-143e-46bd-ada8-56dece11d6cc\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:22:21 crc kubenswrapper[5120]: I0316 16:22:21.207144 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/d4b88a4e-143e-46bd-ada8-56dece11d6cc-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"d4b88a4e-143e-46bd-ada8-56dece11d6cc\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:22:21 crc kubenswrapper[5120]: I0316 16:22:21.207169 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d4b88a4e-143e-46bd-ada8-56dece11d6cc-config-data\") pod \"glance-default-external-api-0\" (UID: \"d4b88a4e-143e-46bd-ada8-56dece11d6cc\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:22:21 crc kubenswrapper[5120]: I0316 16:22:21.207225 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/d4b88a4e-143e-46bd-ada8-56dece11d6cc-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"d4b88a4e-143e-46bd-ada8-56dece11d6cc\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:22:21 crc kubenswrapper[5120]: I0316 16:22:21.207247 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage19-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") pod \"glance-default-external-api-0\" (UID: \"d4b88a4e-143e-46bd-ada8-56dece11d6cc\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:22:21 crc kubenswrapper[5120]: I0316 16:22:21.207424 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fp2xj\" (UniqueName: \"kubernetes.io/projected/d4b88a4e-143e-46bd-ada8-56dece11d6cc-kube-api-access-fp2xj\") pod \"glance-default-external-api-0\" (UID: \"d4b88a4e-143e-46bd-ada8-56dece11d6cc\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:22:21 crc kubenswrapper[5120]: I0316 16:22:21.309334 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/d4b88a4e-143e-46bd-ada8-56dece11d6cc-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"d4b88a4e-143e-46bd-ada8-56dece11d6cc\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:22:21 crc kubenswrapper[5120]: I0316 16:22:21.309394 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d4b88a4e-143e-46bd-ada8-56dece11d6cc-config-data\") pod \"glance-default-external-api-0\" (UID: \"d4b88a4e-143e-46bd-ada8-56dece11d6cc\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:22:21 crc kubenswrapper[5120]: I0316 16:22:21.309472 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/d4b88a4e-143e-46bd-ada8-56dece11d6cc-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"d4b88a4e-143e-46bd-ada8-56dece11d6cc\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:22:21 crc kubenswrapper[5120]: I0316 16:22:21.309497 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage19-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") pod \"glance-default-external-api-0\" (UID: \"d4b88a4e-143e-46bd-ada8-56dece11d6cc\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:22:21 crc kubenswrapper[5120]: I0316 16:22:21.309579 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fp2xj\" (UniqueName: \"kubernetes.io/projected/d4b88a4e-143e-46bd-ada8-56dece11d6cc-kube-api-access-fp2xj\") pod \"glance-default-external-api-0\" (UID: \"d4b88a4e-143e-46bd-ada8-56dece11d6cc\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:22:21 crc kubenswrapper[5120]: I0316 16:22:21.309611 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d4b88a4e-143e-46bd-ada8-56dece11d6cc-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"d4b88a4e-143e-46bd-ada8-56dece11d6cc\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:22:21 crc kubenswrapper[5120]: I0316 16:22:21.311024 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d4b88a4e-143e-46bd-ada8-56dece11d6cc-logs\") pod \"glance-default-external-api-0\" (UID: \"d4b88a4e-143e-46bd-ada8-56dece11d6cc\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:22:21 crc kubenswrapper[5120]: I0316 16:22:21.311070 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d4b88a4e-143e-46bd-ada8-56dece11d6cc-scripts\") pod \"glance-default-external-api-0\" (UID: \"d4b88a4e-143e-46bd-ada8-56dece11d6cc\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:22:21 crc kubenswrapper[5120]: I0316 16:22:21.312244 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d4b88a4e-143e-46bd-ada8-56dece11d6cc-logs\") pod \"glance-default-external-api-0\" (UID: \"d4b88a4e-143e-46bd-ada8-56dece11d6cc\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:22:21 crc kubenswrapper[5120]: I0316 16:22:21.312615 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/d4b88a4e-143e-46bd-ada8-56dece11d6cc-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"d4b88a4e-143e-46bd-ada8-56dece11d6cc\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:22:21 crc kubenswrapper[5120]: I0316 16:22:21.315105 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d4b88a4e-143e-46bd-ada8-56dece11d6cc-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"d4b88a4e-143e-46bd-ada8-56dece11d6cc\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:22:21 crc kubenswrapper[5120]: I0316 16:22:21.317317 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d4b88a4e-143e-46bd-ada8-56dece11d6cc-scripts\") pod \"glance-default-external-api-0\" (UID: \"d4b88a4e-143e-46bd-ada8-56dece11d6cc\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:22:21 crc kubenswrapper[5120]: I0316 16:22:21.319826 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d4b88a4e-143e-46bd-ada8-56dece11d6cc-config-data\") pod \"glance-default-external-api-0\" (UID: \"d4b88a4e-143e-46bd-ada8-56dece11d6cc\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:22:21 crc kubenswrapper[5120]: I0316 16:22:21.320110 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage19-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") pod \"glance-default-external-api-0\" (UID: \"d4b88a4e-143e-46bd-ada8-56dece11d6cc\") device mount path \"/mnt/openstack/pv19\"" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:22:21 crc kubenswrapper[5120]: I0316 16:22:21.326749 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/d4b88a4e-143e-46bd-ada8-56dece11d6cc-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"d4b88a4e-143e-46bd-ada8-56dece11d6cc\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:22:21 crc kubenswrapper[5120]: I0316 16:22:21.328526 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fp2xj\" (UniqueName: \"kubernetes.io/projected/d4b88a4e-143e-46bd-ada8-56dece11d6cc-kube-api-access-fp2xj\") pod \"glance-default-external-api-0\" (UID: \"d4b88a4e-143e-46bd-ada8-56dece11d6cc\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:22:21 crc kubenswrapper[5120]: I0316 16:22:21.362347 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage19-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") pod \"glance-default-external-api-0\" (UID: \"d4b88a4e-143e-46bd-ada8-56dece11d6cc\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:22:21 crc kubenswrapper[5120]: I0316 16:22:21.380076 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:22:21 crc kubenswrapper[5120]: I0316 16:22:21.635906 5120 generic.go:358] "Generic (PLEG): container finished" podID="2da9f738-8983-4a21-ae37-5917076739f4" containerID="fd11cfec77020da4c9520f2df943d972df61f40850afe3158e1db4ed683e3ab0" exitCode=0 Mar 16 16:22:21 crc kubenswrapper[5120]: I0316 16:22:21.636348 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-c949-account-create-update-8vkk4" event={"ID":"2da9f738-8983-4a21-ae37-5917076739f4","Type":"ContainerDied","Data":"fd11cfec77020da4c9520f2df943d972df61f40850afe3158e1db4ed683e3ab0"} Mar 16 16:22:21 crc kubenswrapper[5120]: I0316 16:22:21.647624 5120 generic.go:358] "Generic (PLEG): container finished" podID="bea1d61f-54be-4e9e-ae9f-9cd209757cd5" containerID="4ccbfad91f89bfb8d7b4609f7c76733ab028c5e8e9735fe9d8a28a9886c6e451" exitCode=0 Mar 16 16:22:21 crc kubenswrapper[5120]: I0316 16:22:21.647720 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-db-create-n2wfm" event={"ID":"bea1d61f-54be-4e9e-ae9f-9cd209757cd5","Type":"ContainerDied","Data":"4ccbfad91f89bfb8d7b4609f7c76733ab028c5e8e9735fe9d8a28a9886c6e451"} Mar 16 16:22:21 crc kubenswrapper[5120]: I0316 16:22:21.654575 5120 generic.go:358] "Generic (PLEG): container finished" podID="9efd76f8-2676-4522-900e-ade9c74942aa" containerID="33a4ab6d0801be84ab8ea365dc946cfc333d8e434cce9217ace7dcd436bdd3ae" exitCode=0 Mar 16 16:22:21 crc kubenswrapper[5120]: I0316 16:22:21.654657 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-db-create-xb2nh" event={"ID":"9efd76f8-2676-4522-900e-ade9c74942aa","Type":"ContainerDied","Data":"33a4ab6d0801be84ab8ea365dc946cfc333d8e434cce9217ace7dcd436bdd3ae"} Mar 16 16:22:21 crc kubenswrapper[5120]: I0316 16:22:21.657185 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"954b8df0-5a5c-4057-a887-fc920c995ce0","Type":"ContainerDied","Data":"55369c4493de0b39bb2224c2ca281360f88260e78197d74c6bd018e1add320b6"} Mar 16 16:22:21 crc kubenswrapper[5120]: I0316 16:22:21.657232 5120 scope.go:117] "RemoveContainer" containerID="65356c1dfdebe9004a8391665e2f7bdd617317a2b5e16ef74b358b42449c8430" Mar 16 16:22:21 crc kubenswrapper[5120]: I0316 16:22:21.657347 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:22:21 crc kubenswrapper[5120]: I0316 16:22:21.677726 5120 generic.go:358] "Generic (PLEG): container finished" podID="35ce1e81-fe7f-42f9-b95d-3730a347e275" containerID="faec934fdf618da87c90e1efafcb15b6b468ceda4e45e61f8abad7b9415796db" exitCode=0 Mar 16 16:22:21 crc kubenswrapper[5120]: I0316 16:22:21.677863 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-3f68-account-create-update-6x45z" event={"ID":"35ce1e81-fe7f-42f9-b95d-3730a347e275","Type":"ContainerDied","Data":"faec934fdf618da87c90e1efafcb15b6b468ceda4e45e61f8abad7b9415796db"} Mar 16 16:22:21 crc kubenswrapper[5120]: I0316 16:22:21.677942 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-3f68-account-create-update-6x45z" event={"ID":"35ce1e81-fe7f-42f9-b95d-3730a347e275","Type":"ContainerStarted","Data":"3cb3b2520ea6443045c2e7ba462be65642649cdffa1156689039460668446603"} Mar 16 16:22:21 crc kubenswrapper[5120]: I0316 16:22:21.679939 5120 generic.go:358] "Generic (PLEG): container finished" podID="832b7d40-7b24-49a1-9247-e10c8747b7ff" containerID="21bce66a707103c0c4494b4b34b9d5756cf82eb2fefafd919a0dae858d454b38" exitCode=0 Mar 16 16:22:21 crc kubenswrapper[5120]: I0316 16:22:21.680208 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-9428-account-create-update-hzch2" event={"ID":"832b7d40-7b24-49a1-9247-e10c8747b7ff","Type":"ContainerDied","Data":"21bce66a707103c0c4494b4b34b9d5756cf82eb2fefafd919a0dae858d454b38"} Mar 16 16:22:21 crc kubenswrapper[5120]: I0316 16:22:21.694283 5120 scope.go:117] "RemoveContainer" containerID="c60a3dbd4b93459618559c9157315430acd5193440d24ad271e7fe903009f32c" Mar 16 16:22:21 crc kubenswrapper[5120]: I0316 16:22:21.743236 5120 scope.go:117] "RemoveContainer" containerID="9eb0d9d024a82549c280fe4c7e1ed4e65dc61eacd1ba3ddfc3b8c06aac3fba28" Mar 16 16:22:21 crc kubenswrapper[5120]: I0316 16:22:21.752096 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:22:21 crc kubenswrapper[5120]: I0316 16:22:21.773016 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:22:21 crc kubenswrapper[5120]: I0316 16:22:21.813835 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:22:21 crc kubenswrapper[5120]: I0316 16:22:21.832664 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:22:21 crc kubenswrapper[5120]: I0316 16:22:21.832818 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:22:21 crc kubenswrapper[5120]: I0316 16:22:21.838211 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 16:22:21 crc kubenswrapper[5120]: I0316 16:22:21.842146 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/watcher-decision-engine-0"] Mar 16 16:22:21 crc kubenswrapper[5120]: I0316 16:22:21.842350 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/watcher-decision-engine-0" podUID="447d5bb0-18ef-4779-8b6a-a4a96bd0fe09" containerName="watcher-decision-engine" containerID="cri-o://883cc8ebfe94a6c0156946f1e741a4f8fe89bc0d3fb7ccd962c340565eecff9a" gracePeriod=30 Mar 16 16:22:21 crc kubenswrapper[5120]: I0316 16:22:21.844159 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 16:22:21 crc kubenswrapper[5120]: I0316 16:22:21.866059 5120 scope.go:117] "RemoveContainer" containerID="899cdc537eabf72f56e57dfed12366c810c0469aa975dd59cc4c8ba413f86dd3" Mar 16 16:22:21 crc kubenswrapper[5120]: I0316 16:22:21.927050 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqwfh\" (UniqueName: \"kubernetes.io/projected/74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f-kube-api-access-tqwfh\") pod \"ceilometer-0\" (UID: \"74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:22:21 crc kubenswrapper[5120]: I0316 16:22:21.927097 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f-log-httpd\") pod \"ceilometer-0\" (UID: \"74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:22:21 crc kubenswrapper[5120]: I0316 16:22:21.927141 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f-config-data\") pod \"ceilometer-0\" (UID: \"74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:22:21 crc kubenswrapper[5120]: I0316 16:22:21.927197 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:22:21 crc kubenswrapper[5120]: I0316 16:22:21.927263 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f-run-httpd\") pod \"ceilometer-0\" (UID: \"74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:22:21 crc kubenswrapper[5120]: I0316 16:22:21.927305 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f-scripts\") pod \"ceilometer-0\" (UID: \"74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:22:21 crc kubenswrapper[5120]: I0316 16:22:21.927322 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:22:22 crc kubenswrapper[5120]: I0316 16:22:21.998854 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:22:22 crc kubenswrapper[5120]: I0316 16:22:22.040821 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:22:22 crc kubenswrapper[5120]: I0316 16:22:22.040980 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tqwfh\" (UniqueName: \"kubernetes.io/projected/74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f-kube-api-access-tqwfh\") pod \"ceilometer-0\" (UID: \"74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:22:22 crc kubenswrapper[5120]: I0316 16:22:22.040999 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f-log-httpd\") pod \"ceilometer-0\" (UID: \"74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:22:22 crc kubenswrapper[5120]: I0316 16:22:22.041038 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f-config-data\") pod \"ceilometer-0\" (UID: \"74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:22:22 crc kubenswrapper[5120]: I0316 16:22:22.041325 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:22:22 crc kubenswrapper[5120]: I0316 16:22:22.041398 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f-run-httpd\") pod \"ceilometer-0\" (UID: \"74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:22:22 crc kubenswrapper[5120]: I0316 16:22:22.041447 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f-scripts\") pod \"ceilometer-0\" (UID: \"74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:22:22 crc kubenswrapper[5120]: I0316 16:22:22.043331 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f-run-httpd\") pod \"ceilometer-0\" (UID: \"74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:22:22 crc kubenswrapper[5120]: I0316 16:22:22.045111 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f-log-httpd\") pod \"ceilometer-0\" (UID: \"74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:22:22 crc kubenswrapper[5120]: I0316 16:22:22.053532 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:22:22 crc kubenswrapper[5120]: I0316 16:22:22.054099 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f-config-data\") pod \"ceilometer-0\" (UID: \"74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:22:22 crc kubenswrapper[5120]: I0316 16:22:22.054654 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f-scripts\") pod \"ceilometer-0\" (UID: \"74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:22:22 crc kubenswrapper[5120]: I0316 16:22:22.060782 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:22:22 crc kubenswrapper[5120]: I0316 16:22:22.084564 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqwfh\" (UniqueName: \"kubernetes.io/projected/74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f-kube-api-access-tqwfh\") pod \"ceilometer-0\" (UID: \"74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:22:22 crc kubenswrapper[5120]: I0316 16:22:22.183988 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:22:22 crc kubenswrapper[5120]: I0316 16:22:22.426558 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-db-create-fcjdd" Mar 16 16:22:22 crc kubenswrapper[5120]: I0316 16:22:22.430977 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:22:22 crc kubenswrapper[5120]: I0316 16:22:22.558228 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/803bf3cd-94da-4de9-a2c1-c92bb5453589-operator-scripts\") pod \"803bf3cd-94da-4de9-a2c1-c92bb5453589\" (UID: \"803bf3cd-94da-4de9-a2c1-c92bb5453589\") " Mar 16 16:22:22 crc kubenswrapper[5120]: I0316 16:22:22.558597 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-94x29\" (UniqueName: \"kubernetes.io/projected/803bf3cd-94da-4de9-a2c1-c92bb5453589-kube-api-access-94x29\") pod \"803bf3cd-94da-4de9-a2c1-c92bb5453589\" (UID: \"803bf3cd-94da-4de9-a2c1-c92bb5453589\") " Mar 16 16:22:22 crc kubenswrapper[5120]: I0316 16:22:22.567770 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/803bf3cd-94da-4de9-a2c1-c92bb5453589-kube-api-access-94x29" (OuterVolumeSpecName: "kube-api-access-94x29") pod "803bf3cd-94da-4de9-a2c1-c92bb5453589" (UID: "803bf3cd-94da-4de9-a2c1-c92bb5453589"). InnerVolumeSpecName "kube-api-access-94x29". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:22:22 crc kubenswrapper[5120]: I0316 16:22:22.571609 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/803bf3cd-94da-4de9-a2c1-c92bb5453589-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "803bf3cd-94da-4de9-a2c1-c92bb5453589" (UID: "803bf3cd-94da-4de9-a2c1-c92bb5453589"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:22:22 crc kubenswrapper[5120]: I0316 16:22:22.664713 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/803bf3cd-94da-4de9-a2c1-c92bb5453589-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:22:22 crc kubenswrapper[5120]: I0316 16:22:22.664934 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-94x29\" (UniqueName: \"kubernetes.io/projected/803bf3cd-94da-4de9-a2c1-c92bb5453589-kube-api-access-94x29\") on node \"crc\" DevicePath \"\"" Mar 16 16:22:22 crc kubenswrapper[5120]: I0316 16:22:22.691361 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3b45ef4a-c2e4-4ddb-b51f-aaaaac181aac" path="/var/lib/kubelet/pods/3b45ef4a-c2e4-4ddb-b51f-aaaaac181aac/volumes" Mar 16 16:22:22 crc kubenswrapper[5120]: I0316 16:22:22.692423 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="954b8df0-5a5c-4057-a887-fc920c995ce0" path="/var/lib/kubelet/pods/954b8df0-5a5c-4057-a887-fc920c995ce0/volumes" Mar 16 16:22:22 crc kubenswrapper[5120]: I0316 16:22:22.719413 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:22:22 crc kubenswrapper[5120]: I0316 16:22:22.737050 5120 generic.go:358] "Generic (PLEG): container finished" podID="81b5f864-0fd2-4f60-a59d-f37ea787f938" containerID="e7d2c352088e95d9a105b34f2c007137b4dd6063eb236929c342f8930e702e8b" exitCode=0 Mar 16 16:22:22 crc kubenswrapper[5120]: I0316 16:22:22.737215 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-7bccf4cf49-4xg9g" event={"ID":"81b5f864-0fd2-4f60-a59d-f37ea787f938","Type":"ContainerDied","Data":"e7d2c352088e95d9a105b34f2c007137b4dd6063eb236929c342f8930e702e8b"} Mar 16 16:22:22 crc kubenswrapper[5120]: I0316 16:22:22.795751 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"d4b88a4e-143e-46bd-ada8-56dece11d6cc","Type":"ContainerStarted","Data":"462d355c14e2d482b71406f9553bdca0f3407a51cb5358071e72e3ce92791da9"} Mar 16 16:22:22 crc kubenswrapper[5120]: I0316 16:22:22.799150 5120 generic.go:358] "Generic (PLEG): container finished" podID="c99f889b-8cce-419b-bea2-16bbac703bca" containerID="fcdab08251b097dec25fdba98221132625088fbe856c4964b494d87f06509eca" exitCode=0 Mar 16 16:22:22 crc kubenswrapper[5120]: I0316 16:22:22.799250 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"c99f889b-8cce-419b-bea2-16bbac703bca","Type":"ContainerDied","Data":"fcdab08251b097dec25fdba98221132625088fbe856c4964b494d87f06509eca"} Mar 16 16:22:22 crc kubenswrapper[5120]: I0316 16:22:22.801263 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-db-create-fcjdd" Mar 16 16:22:22 crc kubenswrapper[5120]: I0316 16:22:22.801582 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-db-create-fcjdd" event={"ID":"803bf3cd-94da-4de9-a2c1-c92bb5453589","Type":"ContainerDied","Data":"a9c0d5f375bf04777618c5345f275587b5ab6e244c1ec65451fa67d2dc4b073e"} Mar 16 16:22:22 crc kubenswrapper[5120]: I0316 16:22:22.801693 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a9c0d5f375bf04777618c5345f275587b5ab6e244c1ec65451fa67d2dc4b073e" Mar 16 16:22:22 crc kubenswrapper[5120]: I0316 16:22:22.849080 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:22:22 crc kubenswrapper[5120]: I0316 16:22:22.976053 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-7bccf4cf49-4xg9g" Mar 16 16:22:22 crc kubenswrapper[5120]: I0316 16:22:22.987990 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c99f889b-8cce-419b-bea2-16bbac703bca-config-data\") pod \"c99f889b-8cce-419b-bea2-16bbac703bca\" (UID: \"c99f889b-8cce-419b-bea2-16bbac703bca\") " Mar 16 16:22:22 crc kubenswrapper[5120]: I0316 16:22:22.988045 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c99f889b-8cce-419b-bea2-16bbac703bca-combined-ca-bundle\") pod \"c99f889b-8cce-419b-bea2-16bbac703bca\" (UID: \"c99f889b-8cce-419b-bea2-16bbac703bca\") " Mar 16 16:22:22 crc kubenswrapper[5120]: I0316 16:22:22.988109 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fgkwj\" (UniqueName: \"kubernetes.io/projected/c99f889b-8cce-419b-bea2-16bbac703bca-kube-api-access-fgkwj\") pod \"c99f889b-8cce-419b-bea2-16bbac703bca\" (UID: \"c99f889b-8cce-419b-bea2-16bbac703bca\") " Mar 16 16:22:22 crc kubenswrapper[5120]: I0316 16:22:22.988157 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c99f889b-8cce-419b-bea2-16bbac703bca-logs\") pod \"c99f889b-8cce-419b-bea2-16bbac703bca\" (UID: \"c99f889b-8cce-419b-bea2-16bbac703bca\") " Mar 16 16:22:22 crc kubenswrapper[5120]: I0316 16:22:22.988255 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/81b5f864-0fd2-4f60-a59d-f37ea787f938-ovndb-tls-certs\") pod \"81b5f864-0fd2-4f60-a59d-f37ea787f938\" (UID: \"81b5f864-0fd2-4f60-a59d-f37ea787f938\") " Mar 16 16:22:22 crc kubenswrapper[5120]: I0316 16:22:22.988334 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/81b5f864-0fd2-4f60-a59d-f37ea787f938-combined-ca-bundle\") pod \"81b5f864-0fd2-4f60-a59d-f37ea787f938\" (UID: \"81b5f864-0fd2-4f60-a59d-f37ea787f938\") " Mar 16 16:22:22 crc kubenswrapper[5120]: I0316 16:22:22.988350 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/c99f889b-8cce-419b-bea2-16bbac703bca-internal-tls-certs\") pod \"c99f889b-8cce-419b-bea2-16bbac703bca\" (UID: \"c99f889b-8cce-419b-bea2-16bbac703bca\") " Mar 16 16:22:22 crc kubenswrapper[5120]: I0316 16:22:22.988369 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hlj8z\" (UniqueName: \"kubernetes.io/projected/81b5f864-0fd2-4f60-a59d-f37ea787f938-kube-api-access-hlj8z\") pod \"81b5f864-0fd2-4f60-a59d-f37ea787f938\" (UID: \"81b5f864-0fd2-4f60-a59d-f37ea787f938\") " Mar 16 16:22:22 crc kubenswrapper[5120]: I0316 16:22:22.988437 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c99f889b-8cce-419b-bea2-16bbac703bca-scripts\") pod \"c99f889b-8cce-419b-bea2-16bbac703bca\" (UID: \"c99f889b-8cce-419b-bea2-16bbac703bca\") " Mar 16 16:22:22 crc kubenswrapper[5120]: I0316 16:22:22.988461 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"c99f889b-8cce-419b-bea2-16bbac703bca\" (UID: \"c99f889b-8cce-419b-bea2-16bbac703bca\") " Mar 16 16:22:22 crc kubenswrapper[5120]: I0316 16:22:22.988492 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/c99f889b-8cce-419b-bea2-16bbac703bca-httpd-run\") pod \"c99f889b-8cce-419b-bea2-16bbac703bca\" (UID: \"c99f889b-8cce-419b-bea2-16bbac703bca\") " Mar 16 16:22:22 crc kubenswrapper[5120]: I0316 16:22:22.988535 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/81b5f864-0fd2-4f60-a59d-f37ea787f938-config\") pod \"81b5f864-0fd2-4f60-a59d-f37ea787f938\" (UID: \"81b5f864-0fd2-4f60-a59d-f37ea787f938\") " Mar 16 16:22:22 crc kubenswrapper[5120]: I0316 16:22:22.988561 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/81b5f864-0fd2-4f60-a59d-f37ea787f938-httpd-config\") pod \"81b5f864-0fd2-4f60-a59d-f37ea787f938\" (UID: \"81b5f864-0fd2-4f60-a59d-f37ea787f938\") " Mar 16 16:22:22 crc kubenswrapper[5120]: I0316 16:22:22.996797 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/81b5f864-0fd2-4f60-a59d-f37ea787f938-httpd-config" (OuterVolumeSpecName: "httpd-config") pod "81b5f864-0fd2-4f60-a59d-f37ea787f938" (UID: "81b5f864-0fd2-4f60-a59d-f37ea787f938"). InnerVolumeSpecName "httpd-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:22:22 crc kubenswrapper[5120]: I0316 16:22:22.997505 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c99f889b-8cce-419b-bea2-16bbac703bca-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "c99f889b-8cce-419b-bea2-16bbac703bca" (UID: "c99f889b-8cce-419b-bea2-16bbac703bca"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:22:22 crc kubenswrapper[5120]: I0316 16:22:22.998057 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c99f889b-8cce-419b-bea2-16bbac703bca-logs" (OuterVolumeSpecName: "logs") pod "c99f889b-8cce-419b-bea2-16bbac703bca" (UID: "c99f889b-8cce-419b-bea2-16bbac703bca"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:22:23 crc kubenswrapper[5120]: I0316 16:22:23.021177 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c99f889b-8cce-419b-bea2-16bbac703bca-scripts" (OuterVolumeSpecName: "scripts") pod "c99f889b-8cce-419b-bea2-16bbac703bca" (UID: "c99f889b-8cce-419b-bea2-16bbac703bca"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:22:23 crc kubenswrapper[5120]: I0316 16:22:23.021082 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81b5f864-0fd2-4f60-a59d-f37ea787f938-kube-api-access-hlj8z" (OuterVolumeSpecName: "kube-api-access-hlj8z") pod "81b5f864-0fd2-4f60-a59d-f37ea787f938" (UID: "81b5f864-0fd2-4f60-a59d-f37ea787f938"). InnerVolumeSpecName "kube-api-access-hlj8z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:22:23 crc kubenswrapper[5120]: I0316 16:22:23.021535 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage20-crc" (OuterVolumeSpecName: "glance") pod "c99f889b-8cce-419b-bea2-16bbac703bca" (UID: "c99f889b-8cce-419b-bea2-16bbac703bca"). InnerVolumeSpecName "local-storage20-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:22:23 crc kubenswrapper[5120]: I0316 16:22:23.022681 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c99f889b-8cce-419b-bea2-16bbac703bca-kube-api-access-fgkwj" (OuterVolumeSpecName: "kube-api-access-fgkwj") pod "c99f889b-8cce-419b-bea2-16bbac703bca" (UID: "c99f889b-8cce-419b-bea2-16bbac703bca"). InnerVolumeSpecName "kube-api-access-fgkwj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:22:23 crc kubenswrapper[5120]: I0316 16:22:23.053236 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c99f889b-8cce-419b-bea2-16bbac703bca-config-data" (OuterVolumeSpecName: "config-data") pod "c99f889b-8cce-419b-bea2-16bbac703bca" (UID: "c99f889b-8cce-419b-bea2-16bbac703bca"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:22:23 crc kubenswrapper[5120]: I0316 16:22:23.053393 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c99f889b-8cce-419b-bea2-16bbac703bca-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "c99f889b-8cce-419b-bea2-16bbac703bca" (UID: "c99f889b-8cce-419b-bea2-16bbac703bca"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:22:23 crc kubenswrapper[5120]: I0316 16:22:23.063963 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/81b5f864-0fd2-4f60-a59d-f37ea787f938-config" (OuterVolumeSpecName: "config") pod "81b5f864-0fd2-4f60-a59d-f37ea787f938" (UID: "81b5f864-0fd2-4f60-a59d-f37ea787f938"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:22:23 crc kubenswrapper[5120]: I0316 16:22:23.099187 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hlj8z\" (UniqueName: \"kubernetes.io/projected/81b5f864-0fd2-4f60-a59d-f37ea787f938-kube-api-access-hlj8z\") on node \"crc\" DevicePath \"\"" Mar 16 16:22:23 crc kubenswrapper[5120]: I0316 16:22:23.099224 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c99f889b-8cce-419b-bea2-16bbac703bca-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:22:23 crc kubenswrapper[5120]: I0316 16:22:23.099257 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") on node \"crc\" " Mar 16 16:22:23 crc kubenswrapper[5120]: I0316 16:22:23.099270 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/c99f889b-8cce-419b-bea2-16bbac703bca-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 16:22:23 crc kubenswrapper[5120]: I0316 16:22:23.099283 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/81b5f864-0fd2-4f60-a59d-f37ea787f938-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:22:23 crc kubenswrapper[5120]: I0316 16:22:23.099294 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/81b5f864-0fd2-4f60-a59d-f37ea787f938-httpd-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:22:23 crc kubenswrapper[5120]: I0316 16:22:23.099305 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c99f889b-8cce-419b-bea2-16bbac703bca-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:22:23 crc kubenswrapper[5120]: I0316 16:22:23.099322 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c99f889b-8cce-419b-bea2-16bbac703bca-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:22:23 crc kubenswrapper[5120]: I0316 16:22:23.099334 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fgkwj\" (UniqueName: \"kubernetes.io/projected/c99f889b-8cce-419b-bea2-16bbac703bca-kube-api-access-fgkwj\") on node \"crc\" DevicePath \"\"" Mar 16 16:22:23 crc kubenswrapper[5120]: I0316 16:22:23.099347 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c99f889b-8cce-419b-bea2-16bbac703bca-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:22:23 crc kubenswrapper[5120]: I0316 16:22:23.136243 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/81b5f864-0fd2-4f60-a59d-f37ea787f938-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "81b5f864-0fd2-4f60-a59d-f37ea787f938" (UID: "81b5f864-0fd2-4f60-a59d-f37ea787f938"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:22:23 crc kubenswrapper[5120]: I0316 16:22:23.137199 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/81b5f864-0fd2-4f60-a59d-f37ea787f938-ovndb-tls-certs" (OuterVolumeSpecName: "ovndb-tls-certs") pod "81b5f864-0fd2-4f60-a59d-f37ea787f938" (UID: "81b5f864-0fd2-4f60-a59d-f37ea787f938"). InnerVolumeSpecName "ovndb-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:22:23 crc kubenswrapper[5120]: I0316 16:22:23.140208 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage20-crc" (UniqueName: "kubernetes.io/local-volume/local-storage20-crc") on node "crc" Mar 16 16:22:23 crc kubenswrapper[5120]: I0316 16:22:23.153453 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c99f889b-8cce-419b-bea2-16bbac703bca-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "c99f889b-8cce-419b-bea2-16bbac703bca" (UID: "c99f889b-8cce-419b-bea2-16bbac703bca"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:22:23 crc kubenswrapper[5120]: I0316 16:22:23.201815 5120 reconciler_common.go:299] "Volume detached for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/81b5f864-0fd2-4f60-a59d-f37ea787f938-ovndb-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:22:23 crc kubenswrapper[5120]: I0316 16:22:23.201841 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/81b5f864-0fd2-4f60-a59d-f37ea787f938-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:22:23 crc kubenswrapper[5120]: I0316 16:22:23.201869 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/c99f889b-8cce-419b-bea2-16bbac703bca-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:22:23 crc kubenswrapper[5120]: I0316 16:22:23.201879 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:22:23 crc kubenswrapper[5120]: I0316 16:22:23.410576 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-db-create-xb2nh" Mar 16 16:22:23 crc kubenswrapper[5120]: I0316 16:22:23.464571 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/watcher-decision-engine-0" Mar 16 16:22:23 crc kubenswrapper[5120]: I0316 16:22:23.490903 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-db-create-n2wfm" Mar 16 16:22:23 crc kubenswrapper[5120]: I0316 16:22:23.496891 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-9428-account-create-update-hzch2" Mar 16 16:22:23 crc kubenswrapper[5120]: I0316 16:22:23.514137 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/447d5bb0-18ef-4779-8b6a-a4a96bd0fe09-combined-ca-bundle\") pod \"447d5bb0-18ef-4779-8b6a-a4a96bd0fe09\" (UID: \"447d5bb0-18ef-4779-8b6a-a4a96bd0fe09\") " Mar 16 16:22:23 crc kubenswrapper[5120]: I0316 16:22:23.514184 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/832b7d40-7b24-49a1-9247-e10c8747b7ff-operator-scripts\") pod \"832b7d40-7b24-49a1-9247-e10c8747b7ff\" (UID: \"832b7d40-7b24-49a1-9247-e10c8747b7ff\") " Mar 16 16:22:23 crc kubenswrapper[5120]: I0316 16:22:23.514248 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/447d5bb0-18ef-4779-8b6a-a4a96bd0fe09-config-data\") pod \"447d5bb0-18ef-4779-8b6a-a4a96bd0fe09\" (UID: \"447d5bb0-18ef-4779-8b6a-a4a96bd0fe09\") " Mar 16 16:22:23 crc kubenswrapper[5120]: I0316 16:22:23.514269 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/447d5bb0-18ef-4779-8b6a-a4a96bd0fe09-logs\") pod \"447d5bb0-18ef-4779-8b6a-a4a96bd0fe09\" (UID: \"447d5bb0-18ef-4779-8b6a-a4a96bd0fe09\") " Mar 16 16:22:23 crc kubenswrapper[5120]: I0316 16:22:23.514323 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vlmql\" (UniqueName: \"kubernetes.io/projected/bea1d61f-54be-4e9e-ae9f-9cd209757cd5-kube-api-access-vlmql\") pod \"bea1d61f-54be-4e9e-ae9f-9cd209757cd5\" (UID: \"bea1d61f-54be-4e9e-ae9f-9cd209757cd5\") " Mar 16 16:22:23 crc kubenswrapper[5120]: I0316 16:22:23.514339 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-27ppd\" (UniqueName: \"kubernetes.io/projected/447d5bb0-18ef-4779-8b6a-a4a96bd0fe09-kube-api-access-27ppd\") pod \"447d5bb0-18ef-4779-8b6a-a4a96bd0fe09\" (UID: \"447d5bb0-18ef-4779-8b6a-a4a96bd0fe09\") " Mar 16 16:22:23 crc kubenswrapper[5120]: I0316 16:22:23.514376 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-znjws\" (UniqueName: \"kubernetes.io/projected/9efd76f8-2676-4522-900e-ade9c74942aa-kube-api-access-znjws\") pod \"9efd76f8-2676-4522-900e-ade9c74942aa\" (UID: \"9efd76f8-2676-4522-900e-ade9c74942aa\") " Mar 16 16:22:23 crc kubenswrapper[5120]: I0316 16:22:23.514699 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"custom-prometheus-ca\" (UniqueName: \"kubernetes.io/secret/447d5bb0-18ef-4779-8b6a-a4a96bd0fe09-custom-prometheus-ca\") pod \"447d5bb0-18ef-4779-8b6a-a4a96bd0fe09\" (UID: \"447d5bb0-18ef-4779-8b6a-a4a96bd0fe09\") " Mar 16 16:22:23 crc kubenswrapper[5120]: I0316 16:22:23.514732 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qfb27\" (UniqueName: \"kubernetes.io/projected/832b7d40-7b24-49a1-9247-e10c8747b7ff-kube-api-access-qfb27\") pod \"832b7d40-7b24-49a1-9247-e10c8747b7ff\" (UID: \"832b7d40-7b24-49a1-9247-e10c8747b7ff\") " Mar 16 16:22:23 crc kubenswrapper[5120]: I0316 16:22:23.514802 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/bea1d61f-54be-4e9e-ae9f-9cd209757cd5-operator-scripts\") pod \"bea1d61f-54be-4e9e-ae9f-9cd209757cd5\" (UID: \"bea1d61f-54be-4e9e-ae9f-9cd209757cd5\") " Mar 16 16:22:23 crc kubenswrapper[5120]: I0316 16:22:23.514826 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9efd76f8-2676-4522-900e-ade9c74942aa-operator-scripts\") pod \"9efd76f8-2676-4522-900e-ade9c74942aa\" (UID: \"9efd76f8-2676-4522-900e-ade9c74942aa\") " Mar 16 16:22:23 crc kubenswrapper[5120]: I0316 16:22:23.517498 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9efd76f8-2676-4522-900e-ade9c74942aa-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "9efd76f8-2676-4522-900e-ade9c74942aa" (UID: "9efd76f8-2676-4522-900e-ade9c74942aa"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:22:23 crc kubenswrapper[5120]: I0316 16:22:23.518627 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bea1d61f-54be-4e9e-ae9f-9cd209757cd5-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "bea1d61f-54be-4e9e-ae9f-9cd209757cd5" (UID: "bea1d61f-54be-4e9e-ae9f-9cd209757cd5"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:22:23 crc kubenswrapper[5120]: I0316 16:22:23.520563 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/447d5bb0-18ef-4779-8b6a-a4a96bd0fe09-logs" (OuterVolumeSpecName: "logs") pod "447d5bb0-18ef-4779-8b6a-a4a96bd0fe09" (UID: "447d5bb0-18ef-4779-8b6a-a4a96bd0fe09"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:22:23 crc kubenswrapper[5120]: I0316 16:22:23.521577 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/447d5bb0-18ef-4779-8b6a-a4a96bd0fe09-kube-api-access-27ppd" (OuterVolumeSpecName: "kube-api-access-27ppd") pod "447d5bb0-18ef-4779-8b6a-a4a96bd0fe09" (UID: "447d5bb0-18ef-4779-8b6a-a4a96bd0fe09"). InnerVolumeSpecName "kube-api-access-27ppd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:22:23 crc kubenswrapper[5120]: I0316 16:22:23.522536 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/832b7d40-7b24-49a1-9247-e10c8747b7ff-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "832b7d40-7b24-49a1-9247-e10c8747b7ff" (UID: "832b7d40-7b24-49a1-9247-e10c8747b7ff"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:22:23 crc kubenswrapper[5120]: I0316 16:22:23.523449 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-3f68-account-create-update-6x45z" Mar 16 16:22:23 crc kubenswrapper[5120]: I0316 16:22:23.537962 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bea1d61f-54be-4e9e-ae9f-9cd209757cd5-kube-api-access-vlmql" (OuterVolumeSpecName: "kube-api-access-vlmql") pod "bea1d61f-54be-4e9e-ae9f-9cd209757cd5" (UID: "bea1d61f-54be-4e9e-ae9f-9cd209757cd5"). InnerVolumeSpecName "kube-api-access-vlmql". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:22:23 crc kubenswrapper[5120]: I0316 16:22:23.544058 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9efd76f8-2676-4522-900e-ade9c74942aa-kube-api-access-znjws" (OuterVolumeSpecName: "kube-api-access-znjws") pod "9efd76f8-2676-4522-900e-ade9c74942aa" (UID: "9efd76f8-2676-4522-900e-ade9c74942aa"). InnerVolumeSpecName "kube-api-access-znjws". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:22:23 crc kubenswrapper[5120]: I0316 16:22:23.544119 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/832b7d40-7b24-49a1-9247-e10c8747b7ff-kube-api-access-qfb27" (OuterVolumeSpecName: "kube-api-access-qfb27") pod "832b7d40-7b24-49a1-9247-e10c8747b7ff" (UID: "832b7d40-7b24-49a1-9247-e10c8747b7ff"). InnerVolumeSpecName "kube-api-access-qfb27". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:22:23 crc kubenswrapper[5120]: I0316 16:22:23.552928 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-c949-account-create-update-8vkk4" Mar 16 16:22:23 crc kubenswrapper[5120]: I0316 16:22:23.580941 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/447d5bb0-18ef-4779-8b6a-a4a96bd0fe09-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "447d5bb0-18ef-4779-8b6a-a4a96bd0fe09" (UID: "447d5bb0-18ef-4779-8b6a-a4a96bd0fe09"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:22:23 crc kubenswrapper[5120]: I0316 16:22:23.598933 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/447d5bb0-18ef-4779-8b6a-a4a96bd0fe09-custom-prometheus-ca" (OuterVolumeSpecName: "custom-prometheus-ca") pod "447d5bb0-18ef-4779-8b6a-a4a96bd0fe09" (UID: "447d5bb0-18ef-4779-8b6a-a4a96bd0fe09"). InnerVolumeSpecName "custom-prometheus-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:22:23 crc kubenswrapper[5120]: I0316 16:22:23.621223 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2da9f738-8983-4a21-ae37-5917076739f4-operator-scripts\") pod \"2da9f738-8983-4a21-ae37-5917076739f4\" (UID: \"2da9f738-8983-4a21-ae37-5917076739f4\") " Mar 16 16:22:23 crc kubenswrapper[5120]: I0316 16:22:23.621312 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tdfxd\" (UniqueName: \"kubernetes.io/projected/35ce1e81-fe7f-42f9-b95d-3730a347e275-kube-api-access-tdfxd\") pod \"35ce1e81-fe7f-42f9-b95d-3730a347e275\" (UID: \"35ce1e81-fe7f-42f9-b95d-3730a347e275\") " Mar 16 16:22:23 crc kubenswrapper[5120]: I0316 16:22:23.621463 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/35ce1e81-fe7f-42f9-b95d-3730a347e275-operator-scripts\") pod \"35ce1e81-fe7f-42f9-b95d-3730a347e275\" (UID: \"35ce1e81-fe7f-42f9-b95d-3730a347e275\") " Mar 16 16:22:23 crc kubenswrapper[5120]: I0316 16:22:23.621711 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9xdv9\" (UniqueName: \"kubernetes.io/projected/2da9f738-8983-4a21-ae37-5917076739f4-kube-api-access-9xdv9\") pod \"2da9f738-8983-4a21-ae37-5917076739f4\" (UID: \"2da9f738-8983-4a21-ae37-5917076739f4\") " Mar 16 16:22:23 crc kubenswrapper[5120]: I0316 16:22:23.622274 5120 reconciler_common.go:299] "Volume detached for volume \"custom-prometheus-ca\" (UniqueName: \"kubernetes.io/secret/447d5bb0-18ef-4779-8b6a-a4a96bd0fe09-custom-prometheus-ca\") on node \"crc\" DevicePath \"\"" Mar 16 16:22:23 crc kubenswrapper[5120]: I0316 16:22:23.622293 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qfb27\" (UniqueName: \"kubernetes.io/projected/832b7d40-7b24-49a1-9247-e10c8747b7ff-kube-api-access-qfb27\") on node \"crc\" DevicePath \"\"" Mar 16 16:22:23 crc kubenswrapper[5120]: I0316 16:22:23.622303 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/bea1d61f-54be-4e9e-ae9f-9cd209757cd5-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:22:23 crc kubenswrapper[5120]: I0316 16:22:23.622313 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9efd76f8-2676-4522-900e-ade9c74942aa-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:22:23 crc kubenswrapper[5120]: I0316 16:22:23.622321 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/447d5bb0-18ef-4779-8b6a-a4a96bd0fe09-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:22:23 crc kubenswrapper[5120]: I0316 16:22:23.622330 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/832b7d40-7b24-49a1-9247-e10c8747b7ff-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:22:23 crc kubenswrapper[5120]: I0316 16:22:23.622339 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/447d5bb0-18ef-4779-8b6a-a4a96bd0fe09-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:22:23 crc kubenswrapper[5120]: I0316 16:22:23.622348 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vlmql\" (UniqueName: \"kubernetes.io/projected/bea1d61f-54be-4e9e-ae9f-9cd209757cd5-kube-api-access-vlmql\") on node \"crc\" DevicePath \"\"" Mar 16 16:22:23 crc kubenswrapper[5120]: I0316 16:22:23.622356 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-27ppd\" (UniqueName: \"kubernetes.io/projected/447d5bb0-18ef-4779-8b6a-a4a96bd0fe09-kube-api-access-27ppd\") on node \"crc\" DevicePath \"\"" Mar 16 16:22:23 crc kubenswrapper[5120]: I0316 16:22:23.622366 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-znjws\" (UniqueName: \"kubernetes.io/projected/9efd76f8-2676-4522-900e-ade9c74942aa-kube-api-access-znjws\") on node \"crc\" DevicePath \"\"" Mar 16 16:22:23 crc kubenswrapper[5120]: I0316 16:22:23.624250 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/447d5bb0-18ef-4779-8b6a-a4a96bd0fe09-config-data" (OuterVolumeSpecName: "config-data") pod "447d5bb0-18ef-4779-8b6a-a4a96bd0fe09" (UID: "447d5bb0-18ef-4779-8b6a-a4a96bd0fe09"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:22:23 crc kubenswrapper[5120]: I0316 16:22:23.625696 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2da9f738-8983-4a21-ae37-5917076739f4-kube-api-access-9xdv9" (OuterVolumeSpecName: "kube-api-access-9xdv9") pod "2da9f738-8983-4a21-ae37-5917076739f4" (UID: "2da9f738-8983-4a21-ae37-5917076739f4"). InnerVolumeSpecName "kube-api-access-9xdv9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:22:23 crc kubenswrapper[5120]: I0316 16:22:23.626028 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/35ce1e81-fe7f-42f9-b95d-3730a347e275-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "35ce1e81-fe7f-42f9-b95d-3730a347e275" (UID: "35ce1e81-fe7f-42f9-b95d-3730a347e275"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:22:23 crc kubenswrapper[5120]: I0316 16:22:23.626339 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2da9f738-8983-4a21-ae37-5917076739f4-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "2da9f738-8983-4a21-ae37-5917076739f4" (UID: "2da9f738-8983-4a21-ae37-5917076739f4"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:22:23 crc kubenswrapper[5120]: I0316 16:22:23.632933 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35ce1e81-fe7f-42f9-b95d-3730a347e275-kube-api-access-tdfxd" (OuterVolumeSpecName: "kube-api-access-tdfxd") pod "35ce1e81-fe7f-42f9-b95d-3730a347e275" (UID: "35ce1e81-fe7f-42f9-b95d-3730a347e275"). InnerVolumeSpecName "kube-api-access-tdfxd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:22:23 crc kubenswrapper[5120]: I0316 16:22:23.723911 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9xdv9\" (UniqueName: \"kubernetes.io/projected/2da9f738-8983-4a21-ae37-5917076739f4-kube-api-access-9xdv9\") on node \"crc\" DevicePath \"\"" Mar 16 16:22:23 crc kubenswrapper[5120]: I0316 16:22:23.723938 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2da9f738-8983-4a21-ae37-5917076739f4-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:22:23 crc kubenswrapper[5120]: I0316 16:22:23.723948 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tdfxd\" (UniqueName: \"kubernetes.io/projected/35ce1e81-fe7f-42f9-b95d-3730a347e275-kube-api-access-tdfxd\") on node \"crc\" DevicePath \"\"" Mar 16 16:22:23 crc kubenswrapper[5120]: I0316 16:22:23.723957 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/35ce1e81-fe7f-42f9-b95d-3730a347e275-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:22:23 crc kubenswrapper[5120]: I0316 16:22:23.723965 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/447d5bb0-18ef-4779-8b6a-a4a96bd0fe09-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:22:23 crc kubenswrapper[5120]: I0316 16:22:23.819657 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f","Type":"ContainerStarted","Data":"64bd08a41f9dbb1b2a6a7b48f700c0ea4339c71d3f021c3d5ddf6702d069a21f"} Mar 16 16:22:23 crc kubenswrapper[5120]: I0316 16:22:23.819711 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f","Type":"ContainerStarted","Data":"3266a26f3cbab067f839d1f301589a54110977bc22c33a97c38159649ee98498"} Mar 16 16:22:23 crc kubenswrapper[5120]: I0316 16:22:23.823855 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-c949-account-create-update-8vkk4" event={"ID":"2da9f738-8983-4a21-ae37-5917076739f4","Type":"ContainerDied","Data":"f490bba022936392cd4e4b0b917c0b66ac262308bcbc672b5448a2dd1e58c7a7"} Mar 16 16:22:23 crc kubenswrapper[5120]: I0316 16:22:23.823880 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f490bba022936392cd4e4b0b917c0b66ac262308bcbc672b5448a2dd1e58c7a7" Mar 16 16:22:23 crc kubenswrapper[5120]: I0316 16:22:23.823862 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-c949-account-create-update-8vkk4" Mar 16 16:22:23 crc kubenswrapper[5120]: I0316 16:22:23.826860 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"d4b88a4e-143e-46bd-ada8-56dece11d6cc","Type":"ContainerStarted","Data":"d3796ecbe42b3beab0d0040cb2692ce8f22bdf760113ef0e8c3cfaa0ff2276f7"} Mar 16 16:22:23 crc kubenswrapper[5120]: I0316 16:22:23.829445 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-db-create-n2wfm" Mar 16 16:22:23 crc kubenswrapper[5120]: I0316 16:22:23.829464 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-db-create-n2wfm" event={"ID":"bea1d61f-54be-4e9e-ae9f-9cd209757cd5","Type":"ContainerDied","Data":"ec237389d0c4e4d487708b132687f4295699555704d129ea5ef696419b6edf21"} Mar 16 16:22:23 crc kubenswrapper[5120]: I0316 16:22:23.829505 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ec237389d0c4e4d487708b132687f4295699555704d129ea5ef696419b6edf21" Mar 16 16:22:23 crc kubenswrapper[5120]: I0316 16:22:23.845985 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:22:23 crc kubenswrapper[5120]: I0316 16:22:23.845987 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"c99f889b-8cce-419b-bea2-16bbac703bca","Type":"ContainerDied","Data":"c4c1036cc673340b11bc0a72b985616a46617a2229dd057956a0ddbd21255839"} Mar 16 16:22:23 crc kubenswrapper[5120]: I0316 16:22:23.846119 5120 scope.go:117] "RemoveContainer" containerID="fcdab08251b097dec25fdba98221132625088fbe856c4964b494d87f06509eca" Mar 16 16:22:23 crc kubenswrapper[5120]: I0316 16:22:23.851192 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-db-create-xb2nh" Mar 16 16:22:23 crc kubenswrapper[5120]: I0316 16:22:23.851275 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-db-create-xb2nh" event={"ID":"9efd76f8-2676-4522-900e-ade9c74942aa","Type":"ContainerDied","Data":"22083f89e608c5ba62abbc998b068b021e6fb6d5c053050b6e92c7f75e2dbb68"} Mar 16 16:22:23 crc kubenswrapper[5120]: I0316 16:22:23.851300 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="22083f89e608c5ba62abbc998b068b021e6fb6d5c053050b6e92c7f75e2dbb68" Mar 16 16:22:23 crc kubenswrapper[5120]: I0316 16:22:23.875095 5120 generic.go:358] "Generic (PLEG): container finished" podID="447d5bb0-18ef-4779-8b6a-a4a96bd0fe09" containerID="883cc8ebfe94a6c0156946f1e741a4f8fe89bc0d3fb7ccd962c340565eecff9a" exitCode=0 Mar 16 16:22:23 crc kubenswrapper[5120]: I0316 16:22:23.875195 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/watcher-decision-engine-0" Mar 16 16:22:23 crc kubenswrapper[5120]: I0316 16:22:23.875242 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/watcher-decision-engine-0" event={"ID":"447d5bb0-18ef-4779-8b6a-a4a96bd0fe09","Type":"ContainerDied","Data":"883cc8ebfe94a6c0156946f1e741a4f8fe89bc0d3fb7ccd962c340565eecff9a"} Mar 16 16:22:23 crc kubenswrapper[5120]: I0316 16:22:23.875270 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/watcher-decision-engine-0" event={"ID":"447d5bb0-18ef-4779-8b6a-a4a96bd0fe09","Type":"ContainerDied","Data":"2c0e694e9b269f5f21e9b956398e43d55943ca16e4bf8d532c9a69cd86e3d8fb"} Mar 16 16:22:23 crc kubenswrapper[5120]: I0316 16:22:23.881454 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-3f68-account-create-update-6x45z" event={"ID":"35ce1e81-fe7f-42f9-b95d-3730a347e275","Type":"ContainerDied","Data":"3cb3b2520ea6443045c2e7ba462be65642649cdffa1156689039460668446603"} Mar 16 16:22:23 crc kubenswrapper[5120]: I0316 16:22:23.881490 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3cb3b2520ea6443045c2e7ba462be65642649cdffa1156689039460668446603" Mar 16 16:22:23 crc kubenswrapper[5120]: I0316 16:22:23.881553 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-3f68-account-create-update-6x45z" Mar 16 16:22:23 crc kubenswrapper[5120]: I0316 16:22:23.891784 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-9428-account-create-update-hzch2" Mar 16 16:22:23 crc kubenswrapper[5120]: I0316 16:22:23.891835 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-9428-account-create-update-hzch2" event={"ID":"832b7d40-7b24-49a1-9247-e10c8747b7ff","Type":"ContainerDied","Data":"39034781f91e4bda681b3b57196eb5c074899b8a3419c6ba64f7d16f551a29d4"} Mar 16 16:22:23 crc kubenswrapper[5120]: I0316 16:22:23.891898 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="39034781f91e4bda681b3b57196eb5c074899b8a3419c6ba64f7d16f551a29d4" Mar 16 16:22:23 crc kubenswrapper[5120]: I0316 16:22:23.898966 5120 scope.go:117] "RemoveContainer" containerID="5ab7d4db2915f9758b009d7c96025ef3c39006b82f4c7495cfaa192b41d89d6c" Mar 16 16:22:23 crc kubenswrapper[5120]: I0316 16:22:23.916885 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:22:23 crc kubenswrapper[5120]: I0316 16:22:23.919144 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-7bccf4cf49-4xg9g" event={"ID":"81b5f864-0fd2-4f60-a59d-f37ea787f938","Type":"ContainerDied","Data":"61590c6d4efef7daca6c32ff7e5d7f44cde7eeb6368af9423af46b099523cecf"} Mar 16 16:22:23 crc kubenswrapper[5120]: I0316 16:22:23.919204 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-7bccf4cf49-4xg9g" Mar 16 16:22:23 crc kubenswrapper[5120]: I0316 16:22:23.941910 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:22:23 crc kubenswrapper[5120]: I0316 16:22:23.957148 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/watcher-decision-engine-0"] Mar 16 16:22:23 crc kubenswrapper[5120]: I0316 16:22:23.975895 5120 scope.go:117] "RemoveContainer" containerID="883cc8ebfe94a6c0156946f1e741a4f8fe89bc0d3fb7ccd962c340565eecff9a" Mar 16 16:22:23 crc kubenswrapper[5120]: I0316 16:22:23.991826 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/watcher-decision-engine-0"] Mar 16 16:22:24 crc kubenswrapper[5120]: I0316 16:22:24.023430 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:22:24 crc kubenswrapper[5120]: I0316 16:22:24.024858 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9efd76f8-2676-4522-900e-ade9c74942aa" containerName="mariadb-database-create" Mar 16 16:22:24 crc kubenswrapper[5120]: I0316 16:22:24.024883 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9efd76f8-2676-4522-900e-ade9c74942aa" containerName="mariadb-database-create" Mar 16 16:22:24 crc kubenswrapper[5120]: I0316 16:22:24.024901 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="803bf3cd-94da-4de9-a2c1-c92bb5453589" containerName="mariadb-database-create" Mar 16 16:22:24 crc kubenswrapper[5120]: I0316 16:22:24.024909 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="803bf3cd-94da-4de9-a2c1-c92bb5453589" containerName="mariadb-database-create" Mar 16 16:22:24 crc kubenswrapper[5120]: I0316 16:22:24.024925 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2da9f738-8983-4a21-ae37-5917076739f4" containerName="mariadb-account-create-update" Mar 16 16:22:24 crc kubenswrapper[5120]: I0316 16:22:24.024933 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="2da9f738-8983-4a21-ae37-5917076739f4" containerName="mariadb-account-create-update" Mar 16 16:22:24 crc kubenswrapper[5120]: I0316 16:22:24.024949 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35ce1e81-fe7f-42f9-b95d-3730a347e275" containerName="mariadb-account-create-update" Mar 16 16:22:24 crc kubenswrapper[5120]: I0316 16:22:24.024956 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="35ce1e81-fe7f-42f9-b95d-3730a347e275" containerName="mariadb-account-create-update" Mar 16 16:22:24 crc kubenswrapper[5120]: I0316 16:22:24.025019 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81b5f864-0fd2-4f60-a59d-f37ea787f938" containerName="neutron-api" Mar 16 16:22:24 crc kubenswrapper[5120]: I0316 16:22:24.025029 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="81b5f864-0fd2-4f60-a59d-f37ea787f938" containerName="neutron-api" Mar 16 16:22:24 crc kubenswrapper[5120]: I0316 16:22:24.025043 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bea1d61f-54be-4e9e-ae9f-9cd209757cd5" containerName="mariadb-database-create" Mar 16 16:22:24 crc kubenswrapper[5120]: I0316 16:22:24.025050 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="bea1d61f-54be-4e9e-ae9f-9cd209757cd5" containerName="mariadb-database-create" Mar 16 16:22:24 crc kubenswrapper[5120]: I0316 16:22:24.025060 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81b5f864-0fd2-4f60-a59d-f37ea787f938" containerName="neutron-httpd" Mar 16 16:22:24 crc kubenswrapper[5120]: I0316 16:22:24.025067 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="81b5f864-0fd2-4f60-a59d-f37ea787f938" containerName="neutron-httpd" Mar 16 16:22:24 crc kubenswrapper[5120]: I0316 16:22:24.025108 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c99f889b-8cce-419b-bea2-16bbac703bca" containerName="glance-log" Mar 16 16:22:24 crc kubenswrapper[5120]: I0316 16:22:24.025116 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c99f889b-8cce-419b-bea2-16bbac703bca" containerName="glance-log" Mar 16 16:22:24 crc kubenswrapper[5120]: I0316 16:22:24.025130 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c99f889b-8cce-419b-bea2-16bbac703bca" containerName="glance-httpd" Mar 16 16:22:24 crc kubenswrapper[5120]: I0316 16:22:24.025137 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c99f889b-8cce-419b-bea2-16bbac703bca" containerName="glance-httpd" Mar 16 16:22:24 crc kubenswrapper[5120]: I0316 16:22:24.025149 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="447d5bb0-18ef-4779-8b6a-a4a96bd0fe09" containerName="watcher-decision-engine" Mar 16 16:22:24 crc kubenswrapper[5120]: I0316 16:22:24.025156 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="447d5bb0-18ef-4779-8b6a-a4a96bd0fe09" containerName="watcher-decision-engine" Mar 16 16:22:24 crc kubenswrapper[5120]: I0316 16:22:24.025186 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="832b7d40-7b24-49a1-9247-e10c8747b7ff" containerName="mariadb-account-create-update" Mar 16 16:22:24 crc kubenswrapper[5120]: I0316 16:22:24.025195 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="832b7d40-7b24-49a1-9247-e10c8747b7ff" containerName="mariadb-account-create-update" Mar 16 16:22:24 crc kubenswrapper[5120]: I0316 16:22:24.025409 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="81b5f864-0fd2-4f60-a59d-f37ea787f938" containerName="neutron-api" Mar 16 16:22:24 crc kubenswrapper[5120]: I0316 16:22:24.025432 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="35ce1e81-fe7f-42f9-b95d-3730a347e275" containerName="mariadb-account-create-update" Mar 16 16:22:24 crc kubenswrapper[5120]: I0316 16:22:24.025447 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="9efd76f8-2676-4522-900e-ade9c74942aa" containerName="mariadb-database-create" Mar 16 16:22:24 crc kubenswrapper[5120]: I0316 16:22:24.025460 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="803bf3cd-94da-4de9-a2c1-c92bb5453589" containerName="mariadb-database-create" Mar 16 16:22:24 crc kubenswrapper[5120]: I0316 16:22:24.025470 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c99f889b-8cce-419b-bea2-16bbac703bca" containerName="glance-log" Mar 16 16:22:24 crc kubenswrapper[5120]: I0316 16:22:24.025479 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="832b7d40-7b24-49a1-9247-e10c8747b7ff" containerName="mariadb-account-create-update" Mar 16 16:22:24 crc kubenswrapper[5120]: I0316 16:22:24.025489 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="447d5bb0-18ef-4779-8b6a-a4a96bd0fe09" containerName="watcher-decision-engine" Mar 16 16:22:24 crc kubenswrapper[5120]: I0316 16:22:24.025502 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="2da9f738-8983-4a21-ae37-5917076739f4" containerName="mariadb-account-create-update" Mar 16 16:22:24 crc kubenswrapper[5120]: I0316 16:22:24.025514 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="bea1d61f-54be-4e9e-ae9f-9cd209757cd5" containerName="mariadb-database-create" Mar 16 16:22:24 crc kubenswrapper[5120]: I0316 16:22:24.025528 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c99f889b-8cce-419b-bea2-16bbac703bca" containerName="glance-httpd" Mar 16 16:22:24 crc kubenswrapper[5120]: I0316 16:22:24.025538 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="81b5f864-0fd2-4f60-a59d-f37ea787f938" containerName="neutron-httpd" Mar 16 16:22:24 crc kubenswrapper[5120]: I0316 16:22:24.033543 5120 scope.go:117] "RemoveContainer" containerID="883cc8ebfe94a6c0156946f1e741a4f8fe89bc0d3fb7ccd962c340565eecff9a" Mar 16 16:22:24 crc kubenswrapper[5120]: E0316 16:22:24.034665 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"883cc8ebfe94a6c0156946f1e741a4f8fe89bc0d3fb7ccd962c340565eecff9a\": container with ID starting with 883cc8ebfe94a6c0156946f1e741a4f8fe89bc0d3fb7ccd962c340565eecff9a not found: ID does not exist" containerID="883cc8ebfe94a6c0156946f1e741a4f8fe89bc0d3fb7ccd962c340565eecff9a" Mar 16 16:22:24 crc kubenswrapper[5120]: I0316 16:22:24.034826 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"883cc8ebfe94a6c0156946f1e741a4f8fe89bc0d3fb7ccd962c340565eecff9a"} err="failed to get container status \"883cc8ebfe94a6c0156946f1e741a4f8fe89bc0d3fb7ccd962c340565eecff9a\": rpc error: code = NotFound desc = could not find container \"883cc8ebfe94a6c0156946f1e741a4f8fe89bc0d3fb7ccd962c340565eecff9a\": container with ID starting with 883cc8ebfe94a6c0156946f1e741a4f8fe89bc0d3fb7ccd962c340565eecff9a not found: ID does not exist" Mar 16 16:22:24 crc kubenswrapper[5120]: I0316 16:22:24.034920 5120 scope.go:117] "RemoveContainer" containerID="0ec532e38e77a8c2fb10baeb9e3f00655491b28243540d510c37807942ce6cb9" Mar 16 16:22:24 crc kubenswrapper[5120]: I0316 16:22:24.035936 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:22:24 crc kubenswrapper[5120]: I0316 16:22:24.040383 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-internal-config-data\"" Mar 16 16:22:24 crc kubenswrapper[5120]: I0316 16:22:24.040655 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-internal-svc\"" Mar 16 16:22:24 crc kubenswrapper[5120]: I0316 16:22:24.066462 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:22:24 crc kubenswrapper[5120]: I0316 16:22:24.075880 5120 scope.go:117] "RemoveContainer" containerID="e7d2c352088e95d9a105b34f2c007137b4dd6063eb236929c342f8930e702e8b" Mar 16 16:22:24 crc kubenswrapper[5120]: I0316 16:22:24.084378 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/watcher-decision-engine-0"] Mar 16 16:22:24 crc kubenswrapper[5120]: I0316 16:22:24.111066 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/watcher-decision-engine-0" Mar 16 16:22:24 crc kubenswrapper[5120]: I0316 16:22:24.114861 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"watcher-decision-engine-config-data\"" Mar 16 16:22:24 crc kubenswrapper[5120]: I0316 16:22:24.136144 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/watcher-decision-engine-0"] Mar 16 16:22:24 crc kubenswrapper[5120]: I0316 16:22:24.149031 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-7bccf4cf49-4xg9g"] Mar 16 16:22:24 crc kubenswrapper[5120]: I0316 16:22:24.162389 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-7bccf4cf49-4xg9g"] Mar 16 16:22:24 crc kubenswrapper[5120]: I0316 16:22:24.234875 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3b04c3f7-3328-4aef-92bc-42f328744879-combined-ca-bundle\") pod \"watcher-decision-engine-0\" (UID: \"3b04c3f7-3328-4aef-92bc-42f328744879\") " pod="openstack-kuttl-tests/watcher-decision-engine-0" Mar 16 16:22:24 crc kubenswrapper[5120]: I0316 16:22:24.234928 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/79383c2c-77ce-4694-acfd-f65a93d14d36-config-data\") pod \"glance-default-internal-api-0\" (UID: \"79383c2c-77ce-4694-acfd-f65a93d14d36\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:22:24 crc kubenswrapper[5120]: I0316 16:22:24.235180 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7vrd\" (UniqueName: \"kubernetes.io/projected/3b04c3f7-3328-4aef-92bc-42f328744879-kube-api-access-k7vrd\") pod \"watcher-decision-engine-0\" (UID: \"3b04c3f7-3328-4aef-92bc-42f328744879\") " pod="openstack-kuttl-tests/watcher-decision-engine-0" Mar 16 16:22:24 crc kubenswrapper[5120]: I0316 16:22:24.235247 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"glance-default-internal-api-0\" (UID: \"79383c2c-77ce-4694-acfd-f65a93d14d36\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:22:24 crc kubenswrapper[5120]: I0316 16:22:24.235293 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/79383c2c-77ce-4694-acfd-f65a93d14d36-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"79383c2c-77ce-4694-acfd-f65a93d14d36\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:22:24 crc kubenswrapper[5120]: I0316 16:22:24.235336 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"custom-prometheus-ca\" (UniqueName: \"kubernetes.io/secret/3b04c3f7-3328-4aef-92bc-42f328744879-custom-prometheus-ca\") pod \"watcher-decision-engine-0\" (UID: \"3b04c3f7-3328-4aef-92bc-42f328744879\") " pod="openstack-kuttl-tests/watcher-decision-engine-0" Mar 16 16:22:24 crc kubenswrapper[5120]: I0316 16:22:24.235435 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bsl8f\" (UniqueName: \"kubernetes.io/projected/79383c2c-77ce-4694-acfd-f65a93d14d36-kube-api-access-bsl8f\") pod \"glance-default-internal-api-0\" (UID: \"79383c2c-77ce-4694-acfd-f65a93d14d36\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:22:24 crc kubenswrapper[5120]: I0316 16:22:24.235540 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3b04c3f7-3328-4aef-92bc-42f328744879-logs\") pod \"watcher-decision-engine-0\" (UID: \"3b04c3f7-3328-4aef-92bc-42f328744879\") " pod="openstack-kuttl-tests/watcher-decision-engine-0" Mar 16 16:22:24 crc kubenswrapper[5120]: I0316 16:22:24.235659 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/79383c2c-77ce-4694-acfd-f65a93d14d36-logs\") pod \"glance-default-internal-api-0\" (UID: \"79383c2c-77ce-4694-acfd-f65a93d14d36\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:22:24 crc kubenswrapper[5120]: I0316 16:22:24.236043 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3b04c3f7-3328-4aef-92bc-42f328744879-config-data\") pod \"watcher-decision-engine-0\" (UID: \"3b04c3f7-3328-4aef-92bc-42f328744879\") " pod="openstack-kuttl-tests/watcher-decision-engine-0" Mar 16 16:22:24 crc kubenswrapper[5120]: I0316 16:22:24.236121 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/79383c2c-77ce-4694-acfd-f65a93d14d36-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"79383c2c-77ce-4694-acfd-f65a93d14d36\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:22:24 crc kubenswrapper[5120]: I0316 16:22:24.236282 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/79383c2c-77ce-4694-acfd-f65a93d14d36-scripts\") pod \"glance-default-internal-api-0\" (UID: \"79383c2c-77ce-4694-acfd-f65a93d14d36\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:22:24 crc kubenswrapper[5120]: I0316 16:22:24.236328 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/79383c2c-77ce-4694-acfd-f65a93d14d36-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"79383c2c-77ce-4694-acfd-f65a93d14d36\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:22:24 crc kubenswrapper[5120]: I0316 16:22:24.338518 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3b04c3f7-3328-4aef-92bc-42f328744879-config-data\") pod \"watcher-decision-engine-0\" (UID: \"3b04c3f7-3328-4aef-92bc-42f328744879\") " pod="openstack-kuttl-tests/watcher-decision-engine-0" Mar 16 16:22:24 crc kubenswrapper[5120]: I0316 16:22:24.338899 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/79383c2c-77ce-4694-acfd-f65a93d14d36-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"79383c2c-77ce-4694-acfd-f65a93d14d36\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:22:24 crc kubenswrapper[5120]: I0316 16:22:24.338962 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/79383c2c-77ce-4694-acfd-f65a93d14d36-scripts\") pod \"glance-default-internal-api-0\" (UID: \"79383c2c-77ce-4694-acfd-f65a93d14d36\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:22:24 crc kubenswrapper[5120]: I0316 16:22:24.339020 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/79383c2c-77ce-4694-acfd-f65a93d14d36-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"79383c2c-77ce-4694-acfd-f65a93d14d36\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:22:24 crc kubenswrapper[5120]: I0316 16:22:24.339053 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3b04c3f7-3328-4aef-92bc-42f328744879-combined-ca-bundle\") pod \"watcher-decision-engine-0\" (UID: \"3b04c3f7-3328-4aef-92bc-42f328744879\") " pod="openstack-kuttl-tests/watcher-decision-engine-0" Mar 16 16:22:24 crc kubenswrapper[5120]: I0316 16:22:24.339114 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/79383c2c-77ce-4694-acfd-f65a93d14d36-config-data\") pod \"glance-default-internal-api-0\" (UID: \"79383c2c-77ce-4694-acfd-f65a93d14d36\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:22:24 crc kubenswrapper[5120]: I0316 16:22:24.339217 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k7vrd\" (UniqueName: \"kubernetes.io/projected/3b04c3f7-3328-4aef-92bc-42f328744879-kube-api-access-k7vrd\") pod \"watcher-decision-engine-0\" (UID: \"3b04c3f7-3328-4aef-92bc-42f328744879\") " pod="openstack-kuttl-tests/watcher-decision-engine-0" Mar 16 16:22:24 crc kubenswrapper[5120]: I0316 16:22:24.339274 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"glance-default-internal-api-0\" (UID: \"79383c2c-77ce-4694-acfd-f65a93d14d36\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:22:24 crc kubenswrapper[5120]: I0316 16:22:24.339290 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/79383c2c-77ce-4694-acfd-f65a93d14d36-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"79383c2c-77ce-4694-acfd-f65a93d14d36\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:22:24 crc kubenswrapper[5120]: I0316 16:22:24.339314 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"custom-prometheus-ca\" (UniqueName: \"kubernetes.io/secret/3b04c3f7-3328-4aef-92bc-42f328744879-custom-prometheus-ca\") pod \"watcher-decision-engine-0\" (UID: \"3b04c3f7-3328-4aef-92bc-42f328744879\") " pod="openstack-kuttl-tests/watcher-decision-engine-0" Mar 16 16:22:24 crc kubenswrapper[5120]: I0316 16:22:24.339369 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bsl8f\" (UniqueName: \"kubernetes.io/projected/79383c2c-77ce-4694-acfd-f65a93d14d36-kube-api-access-bsl8f\") pod \"glance-default-internal-api-0\" (UID: \"79383c2c-77ce-4694-acfd-f65a93d14d36\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:22:24 crc kubenswrapper[5120]: I0316 16:22:24.339437 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3b04c3f7-3328-4aef-92bc-42f328744879-logs\") pod \"watcher-decision-engine-0\" (UID: \"3b04c3f7-3328-4aef-92bc-42f328744879\") " pod="openstack-kuttl-tests/watcher-decision-engine-0" Mar 16 16:22:24 crc kubenswrapper[5120]: I0316 16:22:24.339500 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/79383c2c-77ce-4694-acfd-f65a93d14d36-logs\") pod \"glance-default-internal-api-0\" (UID: \"79383c2c-77ce-4694-acfd-f65a93d14d36\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:22:24 crc kubenswrapper[5120]: I0316 16:22:24.340093 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/79383c2c-77ce-4694-acfd-f65a93d14d36-logs\") pod \"glance-default-internal-api-0\" (UID: \"79383c2c-77ce-4694-acfd-f65a93d14d36\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:22:24 crc kubenswrapper[5120]: I0316 16:22:24.340746 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/79383c2c-77ce-4694-acfd-f65a93d14d36-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"79383c2c-77ce-4694-acfd-f65a93d14d36\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:22:24 crc kubenswrapper[5120]: I0316 16:22:24.344346 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3b04c3f7-3328-4aef-92bc-42f328744879-logs\") pod \"watcher-decision-engine-0\" (UID: \"3b04c3f7-3328-4aef-92bc-42f328744879\") " pod="openstack-kuttl-tests/watcher-decision-engine-0" Mar 16 16:22:24 crc kubenswrapper[5120]: I0316 16:22:24.344705 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"glance-default-internal-api-0\" (UID: \"79383c2c-77ce-4694-acfd-f65a93d14d36\") device mount path \"/mnt/openstack/pv20\"" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:22:24 crc kubenswrapper[5120]: I0316 16:22:24.346360 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3b04c3f7-3328-4aef-92bc-42f328744879-config-data\") pod \"watcher-decision-engine-0\" (UID: \"3b04c3f7-3328-4aef-92bc-42f328744879\") " pod="openstack-kuttl-tests/watcher-decision-engine-0" Mar 16 16:22:24 crc kubenswrapper[5120]: I0316 16:22:24.348700 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3b04c3f7-3328-4aef-92bc-42f328744879-combined-ca-bundle\") pod \"watcher-decision-engine-0\" (UID: \"3b04c3f7-3328-4aef-92bc-42f328744879\") " pod="openstack-kuttl-tests/watcher-decision-engine-0" Mar 16 16:22:24 crc kubenswrapper[5120]: I0316 16:22:24.355140 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/79383c2c-77ce-4694-acfd-f65a93d14d36-config-data\") pod \"glance-default-internal-api-0\" (UID: \"79383c2c-77ce-4694-acfd-f65a93d14d36\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:22:24 crc kubenswrapper[5120]: I0316 16:22:24.365581 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/79383c2c-77ce-4694-acfd-f65a93d14d36-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"79383c2c-77ce-4694-acfd-f65a93d14d36\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:22:24 crc kubenswrapper[5120]: I0316 16:22:24.366148 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/79383c2c-77ce-4694-acfd-f65a93d14d36-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"79383c2c-77ce-4694-acfd-f65a93d14d36\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:22:24 crc kubenswrapper[5120]: I0316 16:22:24.370011 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"custom-prometheus-ca\" (UniqueName: \"kubernetes.io/secret/3b04c3f7-3328-4aef-92bc-42f328744879-custom-prometheus-ca\") pod \"watcher-decision-engine-0\" (UID: \"3b04c3f7-3328-4aef-92bc-42f328744879\") " pod="openstack-kuttl-tests/watcher-decision-engine-0" Mar 16 16:22:24 crc kubenswrapper[5120]: I0316 16:22:24.371342 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7vrd\" (UniqueName: \"kubernetes.io/projected/3b04c3f7-3328-4aef-92bc-42f328744879-kube-api-access-k7vrd\") pod \"watcher-decision-engine-0\" (UID: \"3b04c3f7-3328-4aef-92bc-42f328744879\") " pod="openstack-kuttl-tests/watcher-decision-engine-0" Mar 16 16:22:24 crc kubenswrapper[5120]: I0316 16:22:24.371615 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bsl8f\" (UniqueName: \"kubernetes.io/projected/79383c2c-77ce-4694-acfd-f65a93d14d36-kube-api-access-bsl8f\") pod \"glance-default-internal-api-0\" (UID: \"79383c2c-77ce-4694-acfd-f65a93d14d36\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:22:24 crc kubenswrapper[5120]: I0316 16:22:24.376356 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/79383c2c-77ce-4694-acfd-f65a93d14d36-scripts\") pod \"glance-default-internal-api-0\" (UID: \"79383c2c-77ce-4694-acfd-f65a93d14d36\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:22:24 crc kubenswrapper[5120]: I0316 16:22:24.388975 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"glance-default-internal-api-0\" (UID: \"79383c2c-77ce-4694-acfd-f65a93d14d36\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:22:24 crc kubenswrapper[5120]: I0316 16:22:24.587588 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/watcher-decision-engine-0" Mar 16 16:22:24 crc kubenswrapper[5120]: I0316 16:22:24.663326 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:22:24 crc kubenswrapper[5120]: I0316 16:22:24.693618 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="447d5bb0-18ef-4779-8b6a-a4a96bd0fe09" path="/var/lib/kubelet/pods/447d5bb0-18ef-4779-8b6a-a4a96bd0fe09/volumes" Mar 16 16:22:24 crc kubenswrapper[5120]: I0316 16:22:24.694566 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="81b5f864-0fd2-4f60-a59d-f37ea787f938" path="/var/lib/kubelet/pods/81b5f864-0fd2-4f60-a59d-f37ea787f938/volumes" Mar 16 16:22:24 crc kubenswrapper[5120]: I0316 16:22:24.695486 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c99f889b-8cce-419b-bea2-16bbac703bca" path="/var/lib/kubelet/pods/c99f889b-8cce-419b-bea2-16bbac703bca/volumes" Mar 16 16:22:24 crc kubenswrapper[5120]: I0316 16:22:24.937642 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f","Type":"ContainerStarted","Data":"61d6f7882bda9507c7944fceae77f9d722a89e07238d733a55399c772ec624f1"} Mar 16 16:22:24 crc kubenswrapper[5120]: I0316 16:22:24.942327 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"d4b88a4e-143e-46bd-ada8-56dece11d6cc","Type":"ContainerStarted","Data":"bcf29711a914125565b105b455e66a7b23dfececab72dcb037b0a8c45113f6ab"} Mar 16 16:22:25 crc kubenswrapper[5120]: I0316 16:22:25.128009 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-external-api-0" podStartSLOduration=5.127992939 podStartE2EDuration="5.127992939s" podCreationTimestamp="2026-03-16 16:22:20 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:22:24.976238631 +0000 UTC m=+3047.130170298" watchObservedRunningTime="2026-03-16 16:22:25.127992939 +0000 UTC m=+3047.281924596" Mar 16 16:22:25 crc kubenswrapper[5120]: I0316 16:22:25.132027 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/watcher-decision-engine-0"] Mar 16 16:22:25 crc kubenswrapper[5120]: W0316 16:22:25.137251 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3b04c3f7_3328_4aef_92bc_42f328744879.slice/crio-b7fea4f6486e966b5cff9ae9e25d84e4d1d13f26497bab681ff2d690cb435116 WatchSource:0}: Error finding container b7fea4f6486e966b5cff9ae9e25d84e4d1d13f26497bab681ff2d690cb435116: Status 404 returned error can't find the container with id b7fea4f6486e966b5cff9ae9e25d84e4d1d13f26497bab681ff2d690cb435116 Mar 16 16:22:25 crc kubenswrapper[5120]: I0316 16:22:25.300528 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:22:25 crc kubenswrapper[5120]: I0316 16:22:25.664156 5120 scope.go:117] "RemoveContainer" containerID="f40e444f89abd558ac90555bfd58e04a1c4379a653ba8035c228d2b7a5443eb5" Mar 16 16:22:25 crc kubenswrapper[5120]: E0316 16:22:25.664662 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:22:25 crc kubenswrapper[5120]: I0316 16:22:25.959260 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/watcher-decision-engine-0" event={"ID":"3b04c3f7-3328-4aef-92bc-42f328744879","Type":"ContainerStarted","Data":"9eb860bf6d2648fb5b6a19e67714ff9df156e4d633ea711717e4dd7ef09593c3"} Mar 16 16:22:25 crc kubenswrapper[5120]: I0316 16:22:25.959302 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/watcher-decision-engine-0" event={"ID":"3b04c3f7-3328-4aef-92bc-42f328744879","Type":"ContainerStarted","Data":"b7fea4f6486e966b5cff9ae9e25d84e4d1d13f26497bab681ff2d690cb435116"} Mar 16 16:22:25 crc kubenswrapper[5120]: I0316 16:22:25.965284 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"79383c2c-77ce-4694-acfd-f65a93d14d36","Type":"ContainerStarted","Data":"7aaba374563b7fe33dbe346a55235637987db5b53c31ff3f0647c9cff5a3128d"} Mar 16 16:22:25 crc kubenswrapper[5120]: I0316 16:22:25.976865 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/watcher-decision-engine-0" podStartSLOduration=2.976847814 podStartE2EDuration="2.976847814s" podCreationTimestamp="2026-03-16 16:22:23 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:22:25.973662568 +0000 UTC m=+3048.127594285" watchObservedRunningTime="2026-03-16 16:22:25.976847814 +0000 UTC m=+3048.130779461" Mar 16 16:22:26 crc kubenswrapper[5120]: I0316 16:22:26.977006 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f","Type":"ContainerStarted","Data":"203d4bedf199291f2614eb71000f8a1445200c0439448e76b9ba1f38e9e47a5b"} Mar 16 16:22:26 crc kubenswrapper[5120]: I0316 16:22:26.980829 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"79383c2c-77ce-4694-acfd-f65a93d14d36","Type":"ContainerStarted","Data":"f553eca0fd2ecf045ea723c74a9de9bad3d2b0275e01c2e51bf1cd235ad00eb5"} Mar 16 16:22:26 crc kubenswrapper[5120]: I0316 16:22:26.980878 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"79383c2c-77ce-4694-acfd-f65a93d14d36","Type":"ContainerStarted","Data":"23319fc57aa64fe609c628ba0cd9c070d7c509b1db6779e65be1e844ed0d962a"} Mar 16 16:22:27 crc kubenswrapper[5120]: I0316 16:22:27.000500 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-internal-api-0" podStartSLOduration=4.000481664 podStartE2EDuration="4.000481664s" podCreationTimestamp="2026-03-16 16:22:23 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:22:26.996015734 +0000 UTC m=+3049.149947391" watchObservedRunningTime="2026-03-16 16:22:27.000481664 +0000 UTC m=+3049.154413321" Mar 16 16:22:27 crc kubenswrapper[5120]: I0316 16:22:27.129801 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/placement-87c8bf854-gkthd" Mar 16 16:22:27 crc kubenswrapper[5120]: I0316 16:22:27.991005 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f" containerName="ceilometer-central-agent" containerID="cri-o://64bd08a41f9dbb1b2a6a7b48f700c0ea4339c71d3f021c3d5ddf6702d069a21f" gracePeriod=30 Mar 16 16:22:27 crc kubenswrapper[5120]: I0316 16:22:27.991325 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f","Type":"ContainerStarted","Data":"017b72641a853824e2c00279610bf22e07197f7e20842ebc66753ba019aa6f00"} Mar 16 16:22:27 crc kubenswrapper[5120]: I0316 16:22:27.991381 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f" containerName="proxy-httpd" containerID="cri-o://017b72641a853824e2c00279610bf22e07197f7e20842ebc66753ba019aa6f00" gracePeriod=30 Mar 16 16:22:27 crc kubenswrapper[5120]: I0316 16:22:27.991471 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f" containerName="sg-core" containerID="cri-o://203d4bedf199291f2614eb71000f8a1445200c0439448e76b9ba1f38e9e47a5b" gracePeriod=30 Mar 16 16:22:27 crc kubenswrapper[5120]: I0316 16:22:27.991506 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f" containerName="ceilometer-notification-agent" containerID="cri-o://61d6f7882bda9507c7944fceae77f9d722a89e07238d733a55399c772ec624f1" gracePeriod=30 Mar 16 16:22:27 crc kubenswrapper[5120]: I0316 16:22:27.991702 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:22:28 crc kubenswrapper[5120]: I0316 16:22:28.016176 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.073682793 podStartE2EDuration="7.0161633s" podCreationTimestamp="2026-03-16 16:22:21 +0000 UTC" firstStartedPulling="2026-03-16 16:22:22.73258273 +0000 UTC m=+3044.886514387" lastFinishedPulling="2026-03-16 16:22:27.675063247 +0000 UTC m=+3049.828994894" observedRunningTime="2026-03-16 16:22:28.014477445 +0000 UTC m=+3050.168409102" watchObservedRunningTime="2026-03-16 16:22:28.0161633 +0000 UTC m=+3050.170094957" Mar 16 16:22:28 crc kubenswrapper[5120]: I0316 16:22:28.204177 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/placement-87c8bf854-gkthd" Mar 16 16:22:28 crc kubenswrapper[5120]: I0316 16:22:28.321557 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-749879f798-p2tp8"] Mar 16 16:22:28 crc kubenswrapper[5120]: I0316 16:22:28.322021 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-749879f798-p2tp8" podUID="ca8ead84-6680-43da-b50b-703242333d2d" containerName="placement-log" containerID="cri-o://01ed7e6ee3f1b24489b148318e11636a850d2324364424cdbeaa5cac6802ae47" gracePeriod=30 Mar 16 16:22:28 crc kubenswrapper[5120]: I0316 16:22:28.322155 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-749879f798-p2tp8" podUID="ca8ead84-6680-43da-b50b-703242333d2d" containerName="placement-api" containerID="cri-o://11fee32b150db2114dc9928481fdaccdecbcc9b57599f32700330e73cd463dde" gracePeriod=30 Mar 16 16:22:29 crc kubenswrapper[5120]: I0316 16:22:29.001486 5120 generic.go:358] "Generic (PLEG): container finished" podID="ca8ead84-6680-43da-b50b-703242333d2d" containerID="01ed7e6ee3f1b24489b148318e11636a850d2324364424cdbeaa5cac6802ae47" exitCode=143 Mar 16 16:22:29 crc kubenswrapper[5120]: I0316 16:22:29.001626 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-749879f798-p2tp8" event={"ID":"ca8ead84-6680-43da-b50b-703242333d2d","Type":"ContainerDied","Data":"01ed7e6ee3f1b24489b148318e11636a850d2324364424cdbeaa5cac6802ae47"} Mar 16 16:22:29 crc kubenswrapper[5120]: I0316 16:22:29.004567 5120 generic.go:358] "Generic (PLEG): container finished" podID="74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f" containerID="203d4bedf199291f2614eb71000f8a1445200c0439448e76b9ba1f38e9e47a5b" exitCode=2 Mar 16 16:22:29 crc kubenswrapper[5120]: I0316 16:22:29.004598 5120 generic.go:358] "Generic (PLEG): container finished" podID="74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f" containerID="61d6f7882bda9507c7944fceae77f9d722a89e07238d733a55399c772ec624f1" exitCode=0 Mar 16 16:22:29 crc kubenswrapper[5120]: I0316 16:22:29.004604 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f","Type":"ContainerDied","Data":"203d4bedf199291f2614eb71000f8a1445200c0439448e76b9ba1f38e9e47a5b"} Mar 16 16:22:29 crc kubenswrapper[5120]: I0316 16:22:29.004636 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f","Type":"ContainerDied","Data":"61d6f7882bda9507c7944fceae77f9d722a89e07238d733a55399c772ec624f1"} Mar 16 16:22:29 crc kubenswrapper[5120]: I0316 16:22:29.564474 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-x6zpt"] Mar 16 16:22:29 crc kubenswrapper[5120]: I0316 16:22:29.569911 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-x6zpt" Mar 16 16:22:29 crc kubenswrapper[5120]: I0316 16:22:29.571909 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-conductor-scripts\"" Mar 16 16:22:29 crc kubenswrapper[5120]: I0316 16:22:29.572352 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-nova-dockercfg-nwvvr\"" Mar 16 16:22:29 crc kubenswrapper[5120]: I0316 16:22:29.573554 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-conductor-config-data\"" Mar 16 16:22:29 crc kubenswrapper[5120]: I0316 16:22:29.574605 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-x6zpt"] Mar 16 16:22:29 crc kubenswrapper[5120]: I0316 16:22:29.615623 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/596799c6-6d4c-4bac-b499-ce3eee4c68ea-config-data\") pod \"nova-cell0-conductor-db-sync-x6zpt\" (UID: \"596799c6-6d4c-4bac-b499-ce3eee4c68ea\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-x6zpt" Mar 16 16:22:29 crc kubenswrapper[5120]: I0316 16:22:29.615702 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/596799c6-6d4c-4bac-b499-ce3eee4c68ea-scripts\") pod \"nova-cell0-conductor-db-sync-x6zpt\" (UID: \"596799c6-6d4c-4bac-b499-ce3eee4c68ea\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-x6zpt" Mar 16 16:22:29 crc kubenswrapper[5120]: I0316 16:22:29.615784 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4tvld\" (UniqueName: \"kubernetes.io/projected/596799c6-6d4c-4bac-b499-ce3eee4c68ea-kube-api-access-4tvld\") pod \"nova-cell0-conductor-db-sync-x6zpt\" (UID: \"596799c6-6d4c-4bac-b499-ce3eee4c68ea\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-x6zpt" Mar 16 16:22:29 crc kubenswrapper[5120]: I0316 16:22:29.616074 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/596799c6-6d4c-4bac-b499-ce3eee4c68ea-combined-ca-bundle\") pod \"nova-cell0-conductor-db-sync-x6zpt\" (UID: \"596799c6-6d4c-4bac-b499-ce3eee4c68ea\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-x6zpt" Mar 16 16:22:29 crc kubenswrapper[5120]: I0316 16:22:29.717469 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/596799c6-6d4c-4bac-b499-ce3eee4c68ea-combined-ca-bundle\") pod \"nova-cell0-conductor-db-sync-x6zpt\" (UID: \"596799c6-6d4c-4bac-b499-ce3eee4c68ea\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-x6zpt" Mar 16 16:22:29 crc kubenswrapper[5120]: I0316 16:22:29.717828 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/596799c6-6d4c-4bac-b499-ce3eee4c68ea-config-data\") pod \"nova-cell0-conductor-db-sync-x6zpt\" (UID: \"596799c6-6d4c-4bac-b499-ce3eee4c68ea\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-x6zpt" Mar 16 16:22:29 crc kubenswrapper[5120]: I0316 16:22:29.717861 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/596799c6-6d4c-4bac-b499-ce3eee4c68ea-scripts\") pod \"nova-cell0-conductor-db-sync-x6zpt\" (UID: \"596799c6-6d4c-4bac-b499-ce3eee4c68ea\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-x6zpt" Mar 16 16:22:29 crc kubenswrapper[5120]: I0316 16:22:29.717924 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4tvld\" (UniqueName: \"kubernetes.io/projected/596799c6-6d4c-4bac-b499-ce3eee4c68ea-kube-api-access-4tvld\") pod \"nova-cell0-conductor-db-sync-x6zpt\" (UID: \"596799c6-6d4c-4bac-b499-ce3eee4c68ea\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-x6zpt" Mar 16 16:22:29 crc kubenswrapper[5120]: I0316 16:22:29.725224 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/596799c6-6d4c-4bac-b499-ce3eee4c68ea-config-data\") pod \"nova-cell0-conductor-db-sync-x6zpt\" (UID: \"596799c6-6d4c-4bac-b499-ce3eee4c68ea\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-x6zpt" Mar 16 16:22:29 crc kubenswrapper[5120]: I0316 16:22:29.726537 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/596799c6-6d4c-4bac-b499-ce3eee4c68ea-combined-ca-bundle\") pod \"nova-cell0-conductor-db-sync-x6zpt\" (UID: \"596799c6-6d4c-4bac-b499-ce3eee4c68ea\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-x6zpt" Mar 16 16:22:29 crc kubenswrapper[5120]: I0316 16:22:29.726857 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/596799c6-6d4c-4bac-b499-ce3eee4c68ea-scripts\") pod \"nova-cell0-conductor-db-sync-x6zpt\" (UID: \"596799c6-6d4c-4bac-b499-ce3eee4c68ea\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-x6zpt" Mar 16 16:22:29 crc kubenswrapper[5120]: I0316 16:22:29.735406 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4tvld\" (UniqueName: \"kubernetes.io/projected/596799c6-6d4c-4bac-b499-ce3eee4c68ea-kube-api-access-4tvld\") pod \"nova-cell0-conductor-db-sync-x6zpt\" (UID: \"596799c6-6d4c-4bac-b499-ce3eee4c68ea\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-x6zpt" Mar 16 16:22:29 crc kubenswrapper[5120]: I0316 16:22:29.887835 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-x6zpt" Mar 16 16:22:30 crc kubenswrapper[5120]: W0316 16:22:30.342380 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod596799c6_6d4c_4bac_b499_ce3eee4c68ea.slice/crio-677bc973908be224338b9ba1c499b1456f7d359265841024da264d6b628fc7d7 WatchSource:0}: Error finding container 677bc973908be224338b9ba1c499b1456f7d359265841024da264d6b628fc7d7: Status 404 returned error can't find the container with id 677bc973908be224338b9ba1c499b1456f7d359265841024da264d6b628fc7d7 Mar 16 16:22:30 crc kubenswrapper[5120]: I0316 16:22:30.343452 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-x6zpt"] Mar 16 16:22:31 crc kubenswrapper[5120]: I0316 16:22:31.027963 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-x6zpt" event={"ID":"596799c6-6d4c-4bac-b499-ce3eee4c68ea","Type":"ContainerStarted","Data":"b94ec93f56ee6617fe167a4ba516b4eb9fed04f363256f1da3ee498ccfbaba60"} Mar 16 16:22:31 crc kubenswrapper[5120]: I0316 16:22:31.028235 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-x6zpt" event={"ID":"596799c6-6d4c-4bac-b499-ce3eee4c68ea","Type":"ContainerStarted","Data":"677bc973908be224338b9ba1c499b1456f7d359265841024da264d6b628fc7d7"} Mar 16 16:22:31 crc kubenswrapper[5120]: I0316 16:22:31.046534 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-x6zpt" podStartSLOduration=2.046519204 podStartE2EDuration="2.046519204s" podCreationTimestamp="2026-03-16 16:22:29 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:22:31.043707809 +0000 UTC m=+3053.197639476" watchObservedRunningTime="2026-03-16 16:22:31.046519204 +0000 UTC m=+3053.200450861" Mar 16 16:22:31 crc kubenswrapper[5120]: I0316 16:22:31.380563 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:22:31 crc kubenswrapper[5120]: I0316 16:22:31.380625 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:22:31 crc kubenswrapper[5120]: I0316 16:22:31.416120 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:22:31 crc kubenswrapper[5120]: I0316 16:22:31.430049 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:22:31 crc kubenswrapper[5120]: I0316 16:22:31.881981 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-749879f798-p2tp8" Mar 16 16:22:31 crc kubenswrapper[5120]: I0316 16:22:31.981528 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ca8ead84-6680-43da-b50b-703242333d2d-combined-ca-bundle\") pod \"ca8ead84-6680-43da-b50b-703242333d2d\" (UID: \"ca8ead84-6680-43da-b50b-703242333d2d\") " Mar 16 16:22:31 crc kubenswrapper[5120]: I0316 16:22:31.981572 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ca8ead84-6680-43da-b50b-703242333d2d-scripts\") pod \"ca8ead84-6680-43da-b50b-703242333d2d\" (UID: \"ca8ead84-6680-43da-b50b-703242333d2d\") " Mar 16 16:22:31 crc kubenswrapper[5120]: I0316 16:22:31.981741 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/ca8ead84-6680-43da-b50b-703242333d2d-internal-tls-certs\") pod \"ca8ead84-6680-43da-b50b-703242333d2d\" (UID: \"ca8ead84-6680-43da-b50b-703242333d2d\") " Mar 16 16:22:31 crc kubenswrapper[5120]: I0316 16:22:31.981807 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x8tcq\" (UniqueName: \"kubernetes.io/projected/ca8ead84-6680-43da-b50b-703242333d2d-kube-api-access-x8tcq\") pod \"ca8ead84-6680-43da-b50b-703242333d2d\" (UID: \"ca8ead84-6680-43da-b50b-703242333d2d\") " Mar 16 16:22:31 crc kubenswrapper[5120]: I0316 16:22:31.981902 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ca8ead84-6680-43da-b50b-703242333d2d-public-tls-certs\") pod \"ca8ead84-6680-43da-b50b-703242333d2d\" (UID: \"ca8ead84-6680-43da-b50b-703242333d2d\") " Mar 16 16:22:31 crc kubenswrapper[5120]: I0316 16:22:31.982019 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ca8ead84-6680-43da-b50b-703242333d2d-config-data\") pod \"ca8ead84-6680-43da-b50b-703242333d2d\" (UID: \"ca8ead84-6680-43da-b50b-703242333d2d\") " Mar 16 16:22:31 crc kubenswrapper[5120]: I0316 16:22:31.982296 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ca8ead84-6680-43da-b50b-703242333d2d-logs\") pod \"ca8ead84-6680-43da-b50b-703242333d2d\" (UID: \"ca8ead84-6680-43da-b50b-703242333d2d\") " Mar 16 16:22:31 crc kubenswrapper[5120]: I0316 16:22:31.982977 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca8ead84-6680-43da-b50b-703242333d2d-logs" (OuterVolumeSpecName: "logs") pod "ca8ead84-6680-43da-b50b-703242333d2d" (UID: "ca8ead84-6680-43da-b50b-703242333d2d"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:22:31 crc kubenswrapper[5120]: I0316 16:22:31.988592 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca8ead84-6680-43da-b50b-703242333d2d-kube-api-access-x8tcq" (OuterVolumeSpecName: "kube-api-access-x8tcq") pod "ca8ead84-6680-43da-b50b-703242333d2d" (UID: "ca8ead84-6680-43da-b50b-703242333d2d"). InnerVolumeSpecName "kube-api-access-x8tcq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:22:31 crc kubenswrapper[5120]: I0316 16:22:31.991597 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca8ead84-6680-43da-b50b-703242333d2d-scripts" (OuterVolumeSpecName: "scripts") pod "ca8ead84-6680-43da-b50b-703242333d2d" (UID: "ca8ead84-6680-43da-b50b-703242333d2d"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:22:32 crc kubenswrapper[5120]: I0316 16:22:32.040430 5120 generic.go:358] "Generic (PLEG): container finished" podID="ca8ead84-6680-43da-b50b-703242333d2d" containerID="11fee32b150db2114dc9928481fdaccdecbcc9b57599f32700330e73cd463dde" exitCode=0 Mar 16 16:22:32 crc kubenswrapper[5120]: I0316 16:22:32.042355 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-749879f798-p2tp8" Mar 16 16:22:32 crc kubenswrapper[5120]: I0316 16:22:32.042998 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-749879f798-p2tp8" event={"ID":"ca8ead84-6680-43da-b50b-703242333d2d","Type":"ContainerDied","Data":"11fee32b150db2114dc9928481fdaccdecbcc9b57599f32700330e73cd463dde"} Mar 16 16:22:32 crc kubenswrapper[5120]: I0316 16:22:32.043051 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:22:32 crc kubenswrapper[5120]: I0316 16:22:32.043069 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-749879f798-p2tp8" event={"ID":"ca8ead84-6680-43da-b50b-703242333d2d","Type":"ContainerDied","Data":"8376c7670e39ec909979f3946611406179005b9a16d57c18dbc8a21e7502d8ce"} Mar 16 16:22:32 crc kubenswrapper[5120]: I0316 16:22:32.043090 5120 scope.go:117] "RemoveContainer" containerID="11fee32b150db2114dc9928481fdaccdecbcc9b57599f32700330e73cd463dde" Mar 16 16:22:32 crc kubenswrapper[5120]: I0316 16:22:32.043623 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:22:32 crc kubenswrapper[5120]: I0316 16:22:32.063710 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca8ead84-6680-43da-b50b-703242333d2d-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ca8ead84-6680-43da-b50b-703242333d2d" (UID: "ca8ead84-6680-43da-b50b-703242333d2d"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:22:32 crc kubenswrapper[5120]: I0316 16:22:32.085543 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ca8ead84-6680-43da-b50b-703242333d2d-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:22:32 crc kubenswrapper[5120]: I0316 16:22:32.085570 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ca8ead84-6680-43da-b50b-703242333d2d-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:22:32 crc kubenswrapper[5120]: I0316 16:22:32.085580 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ca8ead84-6680-43da-b50b-703242333d2d-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:22:32 crc kubenswrapper[5120]: I0316 16:22:32.085588 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x8tcq\" (UniqueName: \"kubernetes.io/projected/ca8ead84-6680-43da-b50b-703242333d2d-kube-api-access-x8tcq\") on node \"crc\" DevicePath \"\"" Mar 16 16:22:32 crc kubenswrapper[5120]: I0316 16:22:32.094912 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca8ead84-6680-43da-b50b-703242333d2d-config-data" (OuterVolumeSpecName: "config-data") pod "ca8ead84-6680-43da-b50b-703242333d2d" (UID: "ca8ead84-6680-43da-b50b-703242333d2d"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:22:32 crc kubenswrapper[5120]: I0316 16:22:32.114922 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca8ead84-6680-43da-b50b-703242333d2d-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "ca8ead84-6680-43da-b50b-703242333d2d" (UID: "ca8ead84-6680-43da-b50b-703242333d2d"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:22:32 crc kubenswrapper[5120]: I0316 16:22:32.128863 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca8ead84-6680-43da-b50b-703242333d2d-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "ca8ead84-6680-43da-b50b-703242333d2d" (UID: "ca8ead84-6680-43da-b50b-703242333d2d"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:22:32 crc kubenswrapper[5120]: I0316 16:22:32.130857 5120 scope.go:117] "RemoveContainer" containerID="01ed7e6ee3f1b24489b148318e11636a850d2324364424cdbeaa5cac6802ae47" Mar 16 16:22:32 crc kubenswrapper[5120]: I0316 16:22:32.154363 5120 scope.go:117] "RemoveContainer" containerID="11fee32b150db2114dc9928481fdaccdecbcc9b57599f32700330e73cd463dde" Mar 16 16:22:32 crc kubenswrapper[5120]: E0316 16:22:32.154813 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"11fee32b150db2114dc9928481fdaccdecbcc9b57599f32700330e73cd463dde\": container with ID starting with 11fee32b150db2114dc9928481fdaccdecbcc9b57599f32700330e73cd463dde not found: ID does not exist" containerID="11fee32b150db2114dc9928481fdaccdecbcc9b57599f32700330e73cd463dde" Mar 16 16:22:32 crc kubenswrapper[5120]: I0316 16:22:32.154842 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11fee32b150db2114dc9928481fdaccdecbcc9b57599f32700330e73cd463dde"} err="failed to get container status \"11fee32b150db2114dc9928481fdaccdecbcc9b57599f32700330e73cd463dde\": rpc error: code = NotFound desc = could not find container \"11fee32b150db2114dc9928481fdaccdecbcc9b57599f32700330e73cd463dde\": container with ID starting with 11fee32b150db2114dc9928481fdaccdecbcc9b57599f32700330e73cd463dde not found: ID does not exist" Mar 16 16:22:32 crc kubenswrapper[5120]: I0316 16:22:32.154862 5120 scope.go:117] "RemoveContainer" containerID="01ed7e6ee3f1b24489b148318e11636a850d2324364424cdbeaa5cac6802ae47" Mar 16 16:22:32 crc kubenswrapper[5120]: E0316 16:22:32.155161 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"01ed7e6ee3f1b24489b148318e11636a850d2324364424cdbeaa5cac6802ae47\": container with ID starting with 01ed7e6ee3f1b24489b148318e11636a850d2324364424cdbeaa5cac6802ae47 not found: ID does not exist" containerID="01ed7e6ee3f1b24489b148318e11636a850d2324364424cdbeaa5cac6802ae47" Mar 16 16:22:32 crc kubenswrapper[5120]: I0316 16:22:32.155180 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01ed7e6ee3f1b24489b148318e11636a850d2324364424cdbeaa5cac6802ae47"} err="failed to get container status \"01ed7e6ee3f1b24489b148318e11636a850d2324364424cdbeaa5cac6802ae47\": rpc error: code = NotFound desc = could not find container \"01ed7e6ee3f1b24489b148318e11636a850d2324364424cdbeaa5cac6802ae47\": container with ID starting with 01ed7e6ee3f1b24489b148318e11636a850d2324364424cdbeaa5cac6802ae47 not found: ID does not exist" Mar 16 16:22:32 crc kubenswrapper[5120]: I0316 16:22:32.186881 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ca8ead84-6680-43da-b50b-703242333d2d-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:22:32 crc kubenswrapper[5120]: I0316 16:22:32.186912 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/ca8ead84-6680-43da-b50b-703242333d2d-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:22:32 crc kubenswrapper[5120]: I0316 16:22:32.186922 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ca8ead84-6680-43da-b50b-703242333d2d-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:22:32 crc kubenswrapper[5120]: I0316 16:22:32.378920 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-749879f798-p2tp8"] Mar 16 16:22:32 crc kubenswrapper[5120]: I0316 16:22:32.387329 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-749879f798-p2tp8"] Mar 16 16:22:32 crc kubenswrapper[5120]: I0316 16:22:32.682568 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca8ead84-6680-43da-b50b-703242333d2d" path="/var/lib/kubelet/pods/ca8ead84-6680-43da-b50b-703242333d2d/volumes" Mar 16 16:22:33 crc kubenswrapper[5120]: I0316 16:22:33.916177 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:22:33 crc kubenswrapper[5120]: I0316 16:22:33.998262 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:22:34 crc kubenswrapper[5120]: I0316 16:22:34.588107 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/watcher-decision-engine-0" Mar 16 16:22:34 crc kubenswrapper[5120]: I0316 16:22:34.614852 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/watcher-decision-engine-0" Mar 16 16:22:34 crc kubenswrapper[5120]: I0316 16:22:34.680366 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:22:34 crc kubenswrapper[5120]: I0316 16:22:34.680426 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:22:34 crc kubenswrapper[5120]: I0316 16:22:34.705679 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:22:34 crc kubenswrapper[5120]: I0316 16:22:34.708678 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:22:35 crc kubenswrapper[5120]: I0316 16:22:35.077052 5120 generic.go:358] "Generic (PLEG): container finished" podID="74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f" containerID="64bd08a41f9dbb1b2a6a7b48f700c0ea4339c71d3f021c3d5ddf6702d069a21f" exitCode=0 Mar 16 16:22:35 crc kubenswrapper[5120]: I0316 16:22:35.078460 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f","Type":"ContainerDied","Data":"64bd08a41f9dbb1b2a6a7b48f700c0ea4339c71d3f021c3d5ddf6702d069a21f"} Mar 16 16:22:35 crc kubenswrapper[5120]: I0316 16:22:35.078538 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:22:35 crc kubenswrapper[5120]: I0316 16:22:35.079832 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/watcher-decision-engine-0" Mar 16 16:22:35 crc kubenswrapper[5120]: I0316 16:22:35.079871 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:22:35 crc kubenswrapper[5120]: I0316 16:22:35.125243 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/watcher-decision-engine-0" Mar 16 16:22:36 crc kubenswrapper[5120]: I0316 16:22:36.846653 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:22:36 crc kubenswrapper[5120]: I0316 16:22:36.923298 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:22:40 crc kubenswrapper[5120]: I0316 16:22:40.664133 5120 scope.go:117] "RemoveContainer" containerID="f40e444f89abd558ac90555bfd58e04a1c4379a653ba8035c228d2b7a5443eb5" Mar 16 16:22:40 crc kubenswrapper[5120]: E0316 16:22:40.665212 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:22:41 crc kubenswrapper[5120]: I0316 16:22:41.139464 5120 generic.go:358] "Generic (PLEG): container finished" podID="596799c6-6d4c-4bac-b499-ce3eee4c68ea" containerID="b94ec93f56ee6617fe167a4ba516b4eb9fed04f363256f1da3ee498ccfbaba60" exitCode=0 Mar 16 16:22:41 crc kubenswrapper[5120]: I0316 16:22:41.139533 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-x6zpt" event={"ID":"596799c6-6d4c-4bac-b499-ce3eee4c68ea","Type":"ContainerDied","Data":"b94ec93f56ee6617fe167a4ba516b4eb9fed04f363256f1da3ee498ccfbaba60"} Mar 16 16:22:42 crc kubenswrapper[5120]: I0316 16:22:42.569018 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-x6zpt" Mar 16 16:22:42 crc kubenswrapper[5120]: I0316 16:22:42.634824 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/596799c6-6d4c-4bac-b499-ce3eee4c68ea-scripts\") pod \"596799c6-6d4c-4bac-b499-ce3eee4c68ea\" (UID: \"596799c6-6d4c-4bac-b499-ce3eee4c68ea\") " Mar 16 16:22:42 crc kubenswrapper[5120]: I0316 16:22:42.635018 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/596799c6-6d4c-4bac-b499-ce3eee4c68ea-combined-ca-bundle\") pod \"596799c6-6d4c-4bac-b499-ce3eee4c68ea\" (UID: \"596799c6-6d4c-4bac-b499-ce3eee4c68ea\") " Mar 16 16:22:42 crc kubenswrapper[5120]: I0316 16:22:42.635045 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/596799c6-6d4c-4bac-b499-ce3eee4c68ea-config-data\") pod \"596799c6-6d4c-4bac-b499-ce3eee4c68ea\" (UID: \"596799c6-6d4c-4bac-b499-ce3eee4c68ea\") " Mar 16 16:22:42 crc kubenswrapper[5120]: I0316 16:22:42.635097 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4tvld\" (UniqueName: \"kubernetes.io/projected/596799c6-6d4c-4bac-b499-ce3eee4c68ea-kube-api-access-4tvld\") pod \"596799c6-6d4c-4bac-b499-ce3eee4c68ea\" (UID: \"596799c6-6d4c-4bac-b499-ce3eee4c68ea\") " Mar 16 16:22:42 crc kubenswrapper[5120]: I0316 16:22:42.642871 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/596799c6-6d4c-4bac-b499-ce3eee4c68ea-scripts" (OuterVolumeSpecName: "scripts") pod "596799c6-6d4c-4bac-b499-ce3eee4c68ea" (UID: "596799c6-6d4c-4bac-b499-ce3eee4c68ea"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:22:42 crc kubenswrapper[5120]: I0316 16:22:42.645263 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/596799c6-6d4c-4bac-b499-ce3eee4c68ea-kube-api-access-4tvld" (OuterVolumeSpecName: "kube-api-access-4tvld") pod "596799c6-6d4c-4bac-b499-ce3eee4c68ea" (UID: "596799c6-6d4c-4bac-b499-ce3eee4c68ea"). InnerVolumeSpecName "kube-api-access-4tvld". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:22:42 crc kubenswrapper[5120]: I0316 16:22:42.667198 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/596799c6-6d4c-4bac-b499-ce3eee4c68ea-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "596799c6-6d4c-4bac-b499-ce3eee4c68ea" (UID: "596799c6-6d4c-4bac-b499-ce3eee4c68ea"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:22:42 crc kubenswrapper[5120]: I0316 16:22:42.675077 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/596799c6-6d4c-4bac-b499-ce3eee4c68ea-config-data" (OuterVolumeSpecName: "config-data") pod "596799c6-6d4c-4bac-b499-ce3eee4c68ea" (UID: "596799c6-6d4c-4bac-b499-ce3eee4c68ea"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:22:42 crc kubenswrapper[5120]: I0316 16:22:42.737117 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/596799c6-6d4c-4bac-b499-ce3eee4c68ea-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:22:42 crc kubenswrapper[5120]: I0316 16:22:42.737316 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/596799c6-6d4c-4bac-b499-ce3eee4c68ea-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:22:42 crc kubenswrapper[5120]: I0316 16:22:42.737383 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/596799c6-6d4c-4bac-b499-ce3eee4c68ea-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:22:42 crc kubenswrapper[5120]: I0316 16:22:42.737527 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4tvld\" (UniqueName: \"kubernetes.io/projected/596799c6-6d4c-4bac-b499-ce3eee4c68ea-kube-api-access-4tvld\") on node \"crc\" DevicePath \"\"" Mar 16 16:22:43 crc kubenswrapper[5120]: I0316 16:22:43.167065 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-x6zpt" Mar 16 16:22:43 crc kubenswrapper[5120]: I0316 16:22:43.167141 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-x6zpt" event={"ID":"596799c6-6d4c-4bac-b499-ce3eee4c68ea","Type":"ContainerDied","Data":"677bc973908be224338b9ba1c499b1456f7d359265841024da264d6b628fc7d7"} Mar 16 16:22:43 crc kubenswrapper[5120]: I0316 16:22:43.167179 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="677bc973908be224338b9ba1c499b1456f7d359265841024da264d6b628fc7d7" Mar 16 16:22:43 crc kubenswrapper[5120]: I0316 16:22:43.788510 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-j9pqb"] Mar 16 16:22:43 crc kubenswrapper[5120]: I0316 16:22:43.789748 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca8ead84-6680-43da-b50b-703242333d2d" containerName="placement-api" Mar 16 16:22:43 crc kubenswrapper[5120]: I0316 16:22:43.789776 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca8ead84-6680-43da-b50b-703242333d2d" containerName="placement-api" Mar 16 16:22:43 crc kubenswrapper[5120]: I0316 16:22:43.789817 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca8ead84-6680-43da-b50b-703242333d2d" containerName="placement-log" Mar 16 16:22:43 crc kubenswrapper[5120]: I0316 16:22:43.789823 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca8ead84-6680-43da-b50b-703242333d2d" containerName="placement-log" Mar 16 16:22:43 crc kubenswrapper[5120]: I0316 16:22:43.789850 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="596799c6-6d4c-4bac-b499-ce3eee4c68ea" containerName="nova-cell0-conductor-db-sync" Mar 16 16:22:43 crc kubenswrapper[5120]: I0316 16:22:43.789858 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="596799c6-6d4c-4bac-b499-ce3eee4c68ea" containerName="nova-cell0-conductor-db-sync" Mar 16 16:22:43 crc kubenswrapper[5120]: I0316 16:22:43.790020 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ca8ead84-6680-43da-b50b-703242333d2d" containerName="placement-api" Mar 16 16:22:43 crc kubenswrapper[5120]: I0316 16:22:43.790034 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="596799c6-6d4c-4bac-b499-ce3eee4c68ea" containerName="nova-cell0-conductor-db-sync" Mar 16 16:22:43 crc kubenswrapper[5120]: I0316 16:22:43.790057 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ca8ead84-6680-43da-b50b-703242333d2d" containerName="placement-log" Mar 16 16:22:43 crc kubenswrapper[5120]: I0316 16:22:43.795123 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-j9pqb" Mar 16 16:22:43 crc kubenswrapper[5120]: I0316 16:22:43.814261 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-j9pqb"] Mar 16 16:22:43 crc kubenswrapper[5120]: I0316 16:22:43.814572 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-nova-dockercfg-nwvvr\"" Mar 16 16:22:43 crc kubenswrapper[5120]: I0316 16:22:43.814981 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-manage-config-data\"" Mar 16 16:22:43 crc kubenswrapper[5120]: I0316 16:22:43.815197 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-manage-scripts\"" Mar 16 16:22:43 crc kubenswrapper[5120]: I0316 16:22:43.957285 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:22:43 crc kubenswrapper[5120]: I0316 16:22:43.964076 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdt4f\" (UniqueName: \"kubernetes.io/projected/a1770402-bcb6-4c25-8079-130a3aaafcbb-kube-api-access-kdt4f\") pod \"nova-cell0-cell-mapping-j9pqb\" (UID: \"a1770402-bcb6-4c25-8079-130a3aaafcbb\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-j9pqb" Mar 16 16:22:43 crc kubenswrapper[5120]: I0316 16:22:43.964195 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a1770402-bcb6-4c25-8079-130a3aaafcbb-combined-ca-bundle\") pod \"nova-cell0-cell-mapping-j9pqb\" (UID: \"a1770402-bcb6-4c25-8079-130a3aaafcbb\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-j9pqb" Mar 16 16:22:43 crc kubenswrapper[5120]: I0316 16:22:43.964358 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a1770402-bcb6-4c25-8079-130a3aaafcbb-scripts\") pod \"nova-cell0-cell-mapping-j9pqb\" (UID: \"a1770402-bcb6-4c25-8079-130a3aaafcbb\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-j9pqb" Mar 16 16:22:43 crc kubenswrapper[5120]: I0316 16:22:43.964449 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a1770402-bcb6-4c25-8079-130a3aaafcbb-config-data\") pod \"nova-cell0-cell-mapping-j9pqb\" (UID: \"a1770402-bcb6-4c25-8079-130a3aaafcbb\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-j9pqb" Mar 16 16:22:43 crc kubenswrapper[5120]: I0316 16:22:43.965053 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:22:43 crc kubenswrapper[5120]: I0316 16:22:43.971401 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-config-data\"" Mar 16 16:22:43 crc kubenswrapper[5120]: I0316 16:22:43.987360 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:22:44 crc kubenswrapper[5120]: I0316 16:22:44.032207 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:22:44 crc kubenswrapper[5120]: I0316 16:22:44.037969 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:22:44 crc kubenswrapper[5120]: I0316 16:22:44.043837 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-scheduler-config-data\"" Mar 16 16:22:44 crc kubenswrapper[5120]: I0316 16:22:44.054649 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:22:44 crc kubenswrapper[5120]: I0316 16:22:44.065976 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ea1fedf1-104c-49e0-88dd-1259b976439e-logs\") pod \"nova-api-0\" (UID: \"ea1fedf1-104c-49e0-88dd-1259b976439e\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:22:44 crc kubenswrapper[5120]: I0316 16:22:44.066104 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kdt4f\" (UniqueName: \"kubernetes.io/projected/a1770402-bcb6-4c25-8079-130a3aaafcbb-kube-api-access-kdt4f\") pod \"nova-cell0-cell-mapping-j9pqb\" (UID: \"a1770402-bcb6-4c25-8079-130a3aaafcbb\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-j9pqb" Mar 16 16:22:44 crc kubenswrapper[5120]: I0316 16:22:44.066186 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a1770402-bcb6-4c25-8079-130a3aaafcbb-combined-ca-bundle\") pod \"nova-cell0-cell-mapping-j9pqb\" (UID: \"a1770402-bcb6-4c25-8079-130a3aaafcbb\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-j9pqb" Mar 16 16:22:44 crc kubenswrapper[5120]: I0316 16:22:44.066284 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a1770402-bcb6-4c25-8079-130a3aaafcbb-scripts\") pod \"nova-cell0-cell-mapping-j9pqb\" (UID: \"a1770402-bcb6-4c25-8079-130a3aaafcbb\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-j9pqb" Mar 16 16:22:44 crc kubenswrapper[5120]: I0316 16:22:44.066369 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a1770402-bcb6-4c25-8079-130a3aaafcbb-config-data\") pod \"nova-cell0-cell-mapping-j9pqb\" (UID: \"a1770402-bcb6-4c25-8079-130a3aaafcbb\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-j9pqb" Mar 16 16:22:44 crc kubenswrapper[5120]: I0316 16:22:44.066440 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ea1fedf1-104c-49e0-88dd-1259b976439e-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"ea1fedf1-104c-49e0-88dd-1259b976439e\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:22:44 crc kubenswrapper[5120]: I0316 16:22:44.066468 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ea1fedf1-104c-49e0-88dd-1259b976439e-config-data\") pod \"nova-api-0\" (UID: \"ea1fedf1-104c-49e0-88dd-1259b976439e\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:22:44 crc kubenswrapper[5120]: I0316 16:22:44.066540 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qtfs\" (UniqueName: \"kubernetes.io/projected/ea1fedf1-104c-49e0-88dd-1259b976439e-kube-api-access-6qtfs\") pod \"nova-api-0\" (UID: \"ea1fedf1-104c-49e0-88dd-1259b976439e\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:22:44 crc kubenswrapper[5120]: I0316 16:22:44.077914 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:22:44 crc kubenswrapper[5120]: I0316 16:22:44.082039 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a1770402-bcb6-4c25-8079-130a3aaafcbb-scripts\") pod \"nova-cell0-cell-mapping-j9pqb\" (UID: \"a1770402-bcb6-4c25-8079-130a3aaafcbb\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-j9pqb" Mar 16 16:22:44 crc kubenswrapper[5120]: I0316 16:22:44.083901 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a1770402-bcb6-4c25-8079-130a3aaafcbb-combined-ca-bundle\") pod \"nova-cell0-cell-mapping-j9pqb\" (UID: \"a1770402-bcb6-4c25-8079-130a3aaafcbb\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-j9pqb" Mar 16 16:22:44 crc kubenswrapper[5120]: I0316 16:22:44.083981 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a1770402-bcb6-4c25-8079-130a3aaafcbb-config-data\") pod \"nova-cell0-cell-mapping-j9pqb\" (UID: \"a1770402-bcb6-4c25-8079-130a3aaafcbb\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-j9pqb" Mar 16 16:22:44 crc kubenswrapper[5120]: I0316 16:22:44.089654 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdt4f\" (UniqueName: \"kubernetes.io/projected/a1770402-bcb6-4c25-8079-130a3aaafcbb-kube-api-access-kdt4f\") pod \"nova-cell0-cell-mapping-j9pqb\" (UID: \"a1770402-bcb6-4c25-8079-130a3aaafcbb\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-j9pqb" Mar 16 16:22:44 crc kubenswrapper[5120]: I0316 16:22:44.123698 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-j9pqb" Mar 16 16:22:44 crc kubenswrapper[5120]: I0316 16:22:44.158579 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:22:44 crc kubenswrapper[5120]: I0316 16:22:44.158630 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:22:44 crc kubenswrapper[5120]: I0316 16:22:44.165060 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:22:44 crc kubenswrapper[5120]: I0316 16:22:44.166005 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:22:44 crc kubenswrapper[5120]: I0316 16:22:44.169126 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d99dd334-98f5-49f4-b6e5-3f644f6310d3-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"d99dd334-98f5-49f4-b6e5-3f644f6310d3\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:22:44 crc kubenswrapper[5120]: I0316 16:22:44.169282 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9kjx\" (UniqueName: \"kubernetes.io/projected/d99dd334-98f5-49f4-b6e5-3f644f6310d3-kube-api-access-c9kjx\") pod \"nova-scheduler-0\" (UID: \"d99dd334-98f5-49f4-b6e5-3f644f6310d3\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:22:44 crc kubenswrapper[5120]: I0316 16:22:44.169351 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d99dd334-98f5-49f4-b6e5-3f644f6310d3-config-data\") pod \"nova-scheduler-0\" (UID: \"d99dd334-98f5-49f4-b6e5-3f644f6310d3\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:22:44 crc kubenswrapper[5120]: I0316 16:22:44.170555 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-metadata-config-data\"" Mar 16 16:22:44 crc kubenswrapper[5120]: I0316 16:22:44.170835 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-novncproxy-config-data\"" Mar 16 16:22:44 crc kubenswrapper[5120]: I0316 16:22:44.172957 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ea1fedf1-104c-49e0-88dd-1259b976439e-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"ea1fedf1-104c-49e0-88dd-1259b976439e\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:22:44 crc kubenswrapper[5120]: I0316 16:22:44.173052 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ea1fedf1-104c-49e0-88dd-1259b976439e-config-data\") pod \"nova-api-0\" (UID: \"ea1fedf1-104c-49e0-88dd-1259b976439e\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:22:44 crc kubenswrapper[5120]: I0316 16:22:44.173174 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6qtfs\" (UniqueName: \"kubernetes.io/projected/ea1fedf1-104c-49e0-88dd-1259b976439e-kube-api-access-6qtfs\") pod \"nova-api-0\" (UID: \"ea1fedf1-104c-49e0-88dd-1259b976439e\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:22:44 crc kubenswrapper[5120]: I0316 16:22:44.173372 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ea1fedf1-104c-49e0-88dd-1259b976439e-logs\") pod \"nova-api-0\" (UID: \"ea1fedf1-104c-49e0-88dd-1259b976439e\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:22:44 crc kubenswrapper[5120]: I0316 16:22:44.175827 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ea1fedf1-104c-49e0-88dd-1259b976439e-logs\") pod \"nova-api-0\" (UID: \"ea1fedf1-104c-49e0-88dd-1259b976439e\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:22:44 crc kubenswrapper[5120]: I0316 16:22:44.187931 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ea1fedf1-104c-49e0-88dd-1259b976439e-config-data\") pod \"nova-api-0\" (UID: \"ea1fedf1-104c-49e0-88dd-1259b976439e\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:22:44 crc kubenswrapper[5120]: I0316 16:22:44.197012 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:22:44 crc kubenswrapper[5120]: I0316 16:22:44.210240 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ea1fedf1-104c-49e0-88dd-1259b976439e-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"ea1fedf1-104c-49e0-88dd-1259b976439e\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:22:44 crc kubenswrapper[5120]: I0316 16:22:44.214642 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qtfs\" (UniqueName: \"kubernetes.io/projected/ea1fedf1-104c-49e0-88dd-1259b976439e-kube-api-access-6qtfs\") pod \"nova-api-0\" (UID: \"ea1fedf1-104c-49e0-88dd-1259b976439e\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:22:44 crc kubenswrapper[5120]: I0316 16:22:44.276375 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d99dd334-98f5-49f4-b6e5-3f644f6310d3-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"d99dd334-98f5-49f4-b6e5-3f644f6310d3\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:22:44 crc kubenswrapper[5120]: I0316 16:22:44.276705 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9ed4ded3-d35c-4bdb-8098-70ca7d7c2d55-logs\") pod \"nova-metadata-0\" (UID: \"9ed4ded3-d35c-4bdb-8098-70ca7d7c2d55\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:22:44 crc kubenswrapper[5120]: I0316 16:22:44.276932 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c9kjx\" (UniqueName: \"kubernetes.io/projected/d99dd334-98f5-49f4-b6e5-3f644f6310d3-kube-api-access-c9kjx\") pod \"nova-scheduler-0\" (UID: \"d99dd334-98f5-49f4-b6e5-3f644f6310d3\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:22:44 crc kubenswrapper[5120]: I0316 16:22:44.277040 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9ed4ded3-d35c-4bdb-8098-70ca7d7c2d55-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"9ed4ded3-d35c-4bdb-8098-70ca7d7c2d55\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:22:44 crc kubenswrapper[5120]: I0316 16:22:44.277164 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d99dd334-98f5-49f4-b6e5-3f644f6310d3-config-data\") pod \"nova-scheduler-0\" (UID: \"d99dd334-98f5-49f4-b6e5-3f644f6310d3\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:22:44 crc kubenswrapper[5120]: I0316 16:22:44.277325 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/baf07044-4781-4cc5-bcf4-44e71dbe9e5b-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"baf07044-4781-4cc5-bcf4-44e71dbe9e5b\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:22:44 crc kubenswrapper[5120]: I0316 16:22:44.277417 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9ed4ded3-d35c-4bdb-8098-70ca7d7c2d55-config-data\") pod \"nova-metadata-0\" (UID: \"9ed4ded3-d35c-4bdb-8098-70ca7d7c2d55\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:22:44 crc kubenswrapper[5120]: I0316 16:22:44.277735 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b58kh\" (UniqueName: \"kubernetes.io/projected/baf07044-4781-4cc5-bcf4-44e71dbe9e5b-kube-api-access-b58kh\") pod \"nova-cell1-novncproxy-0\" (UID: \"baf07044-4781-4cc5-bcf4-44e71dbe9e5b\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:22:44 crc kubenswrapper[5120]: I0316 16:22:44.278118 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/baf07044-4781-4cc5-bcf4-44e71dbe9e5b-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"baf07044-4781-4cc5-bcf4-44e71dbe9e5b\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:22:44 crc kubenswrapper[5120]: I0316 16:22:44.278220 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6s6b\" (UniqueName: \"kubernetes.io/projected/9ed4ded3-d35c-4bdb-8098-70ca7d7c2d55-kube-api-access-d6s6b\") pod \"nova-metadata-0\" (UID: \"9ed4ded3-d35c-4bdb-8098-70ca7d7c2d55\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:22:44 crc kubenswrapper[5120]: I0316 16:22:44.283136 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d99dd334-98f5-49f4-b6e5-3f644f6310d3-config-data\") pod \"nova-scheduler-0\" (UID: \"d99dd334-98f5-49f4-b6e5-3f644f6310d3\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:22:44 crc kubenswrapper[5120]: I0316 16:22:44.290121 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:22:44 crc kubenswrapper[5120]: I0316 16:22:44.311553 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d99dd334-98f5-49f4-b6e5-3f644f6310d3-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"d99dd334-98f5-49f4-b6e5-3f644f6310d3\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:22:44 crc kubenswrapper[5120]: I0316 16:22:44.312794 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9kjx\" (UniqueName: \"kubernetes.io/projected/d99dd334-98f5-49f4-b6e5-3f644f6310d3-kube-api-access-c9kjx\") pod \"nova-scheduler-0\" (UID: \"d99dd334-98f5-49f4-b6e5-3f644f6310d3\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:22:44 crc kubenswrapper[5120]: I0316 16:22:44.365405 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:22:44 crc kubenswrapper[5120]: I0316 16:22:44.380237 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/baf07044-4781-4cc5-bcf4-44e71dbe9e5b-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"baf07044-4781-4cc5-bcf4-44e71dbe9e5b\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:22:44 crc kubenswrapper[5120]: I0316 16:22:44.380287 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d6s6b\" (UniqueName: \"kubernetes.io/projected/9ed4ded3-d35c-4bdb-8098-70ca7d7c2d55-kube-api-access-d6s6b\") pod \"nova-metadata-0\" (UID: \"9ed4ded3-d35c-4bdb-8098-70ca7d7c2d55\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:22:44 crc kubenswrapper[5120]: I0316 16:22:44.380336 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9ed4ded3-d35c-4bdb-8098-70ca7d7c2d55-logs\") pod \"nova-metadata-0\" (UID: \"9ed4ded3-d35c-4bdb-8098-70ca7d7c2d55\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:22:44 crc kubenswrapper[5120]: I0316 16:22:44.380400 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9ed4ded3-d35c-4bdb-8098-70ca7d7c2d55-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"9ed4ded3-d35c-4bdb-8098-70ca7d7c2d55\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:22:44 crc kubenswrapper[5120]: I0316 16:22:44.380462 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/baf07044-4781-4cc5-bcf4-44e71dbe9e5b-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"baf07044-4781-4cc5-bcf4-44e71dbe9e5b\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:22:44 crc kubenswrapper[5120]: I0316 16:22:44.380512 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9ed4ded3-d35c-4bdb-8098-70ca7d7c2d55-config-data\") pod \"nova-metadata-0\" (UID: \"9ed4ded3-d35c-4bdb-8098-70ca7d7c2d55\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:22:44 crc kubenswrapper[5120]: I0316 16:22:44.380583 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b58kh\" (UniqueName: \"kubernetes.io/projected/baf07044-4781-4cc5-bcf4-44e71dbe9e5b-kube-api-access-b58kh\") pod \"nova-cell1-novncproxy-0\" (UID: \"baf07044-4781-4cc5-bcf4-44e71dbe9e5b\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:22:44 crc kubenswrapper[5120]: I0316 16:22:44.383945 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9ed4ded3-d35c-4bdb-8098-70ca7d7c2d55-logs\") pod \"nova-metadata-0\" (UID: \"9ed4ded3-d35c-4bdb-8098-70ca7d7c2d55\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:22:44 crc kubenswrapper[5120]: I0316 16:22:44.387552 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9ed4ded3-d35c-4bdb-8098-70ca7d7c2d55-config-data\") pod \"nova-metadata-0\" (UID: \"9ed4ded3-d35c-4bdb-8098-70ca7d7c2d55\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:22:44 crc kubenswrapper[5120]: I0316 16:22:44.387591 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9ed4ded3-d35c-4bdb-8098-70ca7d7c2d55-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"9ed4ded3-d35c-4bdb-8098-70ca7d7c2d55\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:22:44 crc kubenswrapper[5120]: I0316 16:22:44.393455 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/baf07044-4781-4cc5-bcf4-44e71dbe9e5b-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"baf07044-4781-4cc5-bcf4-44e71dbe9e5b\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:22:44 crc kubenswrapper[5120]: I0316 16:22:44.395924 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/baf07044-4781-4cc5-bcf4-44e71dbe9e5b-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"baf07044-4781-4cc5-bcf4-44e71dbe9e5b\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:22:44 crc kubenswrapper[5120]: I0316 16:22:44.396092 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b58kh\" (UniqueName: \"kubernetes.io/projected/baf07044-4781-4cc5-bcf4-44e71dbe9e5b-kube-api-access-b58kh\") pod \"nova-cell1-novncproxy-0\" (UID: \"baf07044-4781-4cc5-bcf4-44e71dbe9e5b\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:22:44 crc kubenswrapper[5120]: I0316 16:22:44.399291 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6s6b\" (UniqueName: \"kubernetes.io/projected/9ed4ded3-d35c-4bdb-8098-70ca7d7c2d55-kube-api-access-d6s6b\") pod \"nova-metadata-0\" (UID: \"9ed4ded3-d35c-4bdb-8098-70ca7d7c2d55\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:22:44 crc kubenswrapper[5120]: I0316 16:22:44.591999 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:22:44 crc kubenswrapper[5120]: I0316 16:22:44.613183 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:22:44 crc kubenswrapper[5120]: I0316 16:22:44.685108 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-j9pqb"] Mar 16 16:22:44 crc kubenswrapper[5120]: I0316 16:22:44.864648 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:22:44 crc kubenswrapper[5120]: I0316 16:22:44.932559 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:22:45 crc kubenswrapper[5120]: I0316 16:22:45.083666 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:22:45 crc kubenswrapper[5120]: I0316 16:22:45.219401 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"d99dd334-98f5-49f4-b6e5-3f644f6310d3","Type":"ContainerStarted","Data":"348b53d4b718ed9227021c35ff9c9218fc33d8d41b62e6f6ae46a16a1a9a29a5"} Mar 16 16:22:45 crc kubenswrapper[5120]: I0316 16:22:45.221553 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"baf07044-4781-4cc5-bcf4-44e71dbe9e5b","Type":"ContainerStarted","Data":"aeef91777f21d69abb09292a16d3bb196c0905970c345579d2420815e3a7b4fd"} Mar 16 16:22:45 crc kubenswrapper[5120]: I0316 16:22:45.222866 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-2bwpk"] Mar 16 16:22:45 crc kubenswrapper[5120]: I0316 16:22:45.244918 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-j9pqb" event={"ID":"a1770402-bcb6-4c25-8079-130a3aaafcbb","Type":"ContainerStarted","Data":"397a027fbf9b87ea03164b3c61b5392abddd4a13b6c50ece8dee26ab0e081444"} Mar 16 16:22:45 crc kubenswrapper[5120]: I0316 16:22:45.244958 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"ea1fedf1-104c-49e0-88dd-1259b976439e","Type":"ContainerStarted","Data":"eabf4972bec0230e5b0d47539d093c66cfefa3555a0fa46eea812488e138c730"} Mar 16 16:22:45 crc kubenswrapper[5120]: I0316 16:22:45.245049 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-2bwpk" Mar 16 16:22:45 crc kubenswrapper[5120]: I0316 16:22:45.246614 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-2bwpk"] Mar 16 16:22:45 crc kubenswrapper[5120]: I0316 16:22:45.248590 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-conductor-config-data\"" Mar 16 16:22:45 crc kubenswrapper[5120]: I0316 16:22:45.249179 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-conductor-scripts\"" Mar 16 16:22:45 crc kubenswrapper[5120]: I0316 16:22:45.341128 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:22:45 crc kubenswrapper[5120]: W0316 16:22:45.406845 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9ed4ded3_d35c_4bdb_8098_70ca7d7c2d55.slice/crio-28f687a1c649f930f58d8c3f9a5ac16260468739dc37cdbab20c2f9a0b565058 WatchSource:0}: Error finding container 28f687a1c649f930f58d8c3f9a5ac16260468739dc37cdbab20c2f9a0b565058: Status 404 returned error can't find the container with id 28f687a1c649f930f58d8c3f9a5ac16260468739dc37cdbab20c2f9a0b565058 Mar 16 16:22:45 crc kubenswrapper[5120]: I0316 16:22:45.411348 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5db65e99-b0fe-4cf7-975c-6452ca8dfa62-combined-ca-bundle\") pod \"nova-cell1-conductor-db-sync-2bwpk\" (UID: \"5db65e99-b0fe-4cf7-975c-6452ca8dfa62\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-2bwpk" Mar 16 16:22:45 crc kubenswrapper[5120]: I0316 16:22:45.411386 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfvqx\" (UniqueName: \"kubernetes.io/projected/5db65e99-b0fe-4cf7-975c-6452ca8dfa62-kube-api-access-xfvqx\") pod \"nova-cell1-conductor-db-sync-2bwpk\" (UID: \"5db65e99-b0fe-4cf7-975c-6452ca8dfa62\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-2bwpk" Mar 16 16:22:45 crc kubenswrapper[5120]: I0316 16:22:45.411430 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5db65e99-b0fe-4cf7-975c-6452ca8dfa62-scripts\") pod \"nova-cell1-conductor-db-sync-2bwpk\" (UID: \"5db65e99-b0fe-4cf7-975c-6452ca8dfa62\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-2bwpk" Mar 16 16:22:45 crc kubenswrapper[5120]: I0316 16:22:45.411511 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5db65e99-b0fe-4cf7-975c-6452ca8dfa62-config-data\") pod \"nova-cell1-conductor-db-sync-2bwpk\" (UID: \"5db65e99-b0fe-4cf7-975c-6452ca8dfa62\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-2bwpk" Mar 16 16:22:45 crc kubenswrapper[5120]: I0316 16:22:45.513974 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5db65e99-b0fe-4cf7-975c-6452ca8dfa62-combined-ca-bundle\") pod \"nova-cell1-conductor-db-sync-2bwpk\" (UID: \"5db65e99-b0fe-4cf7-975c-6452ca8dfa62\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-2bwpk" Mar 16 16:22:45 crc kubenswrapper[5120]: I0316 16:22:45.514035 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xfvqx\" (UniqueName: \"kubernetes.io/projected/5db65e99-b0fe-4cf7-975c-6452ca8dfa62-kube-api-access-xfvqx\") pod \"nova-cell1-conductor-db-sync-2bwpk\" (UID: \"5db65e99-b0fe-4cf7-975c-6452ca8dfa62\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-2bwpk" Mar 16 16:22:45 crc kubenswrapper[5120]: I0316 16:22:45.514270 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5db65e99-b0fe-4cf7-975c-6452ca8dfa62-scripts\") pod \"nova-cell1-conductor-db-sync-2bwpk\" (UID: \"5db65e99-b0fe-4cf7-975c-6452ca8dfa62\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-2bwpk" Mar 16 16:22:45 crc kubenswrapper[5120]: I0316 16:22:45.514498 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5db65e99-b0fe-4cf7-975c-6452ca8dfa62-config-data\") pod \"nova-cell1-conductor-db-sync-2bwpk\" (UID: \"5db65e99-b0fe-4cf7-975c-6452ca8dfa62\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-2bwpk" Mar 16 16:22:45 crc kubenswrapper[5120]: I0316 16:22:45.521473 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5db65e99-b0fe-4cf7-975c-6452ca8dfa62-combined-ca-bundle\") pod \"nova-cell1-conductor-db-sync-2bwpk\" (UID: \"5db65e99-b0fe-4cf7-975c-6452ca8dfa62\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-2bwpk" Mar 16 16:22:45 crc kubenswrapper[5120]: I0316 16:22:45.521559 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5db65e99-b0fe-4cf7-975c-6452ca8dfa62-config-data\") pod \"nova-cell1-conductor-db-sync-2bwpk\" (UID: \"5db65e99-b0fe-4cf7-975c-6452ca8dfa62\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-2bwpk" Mar 16 16:22:45 crc kubenswrapper[5120]: I0316 16:22:45.521749 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5db65e99-b0fe-4cf7-975c-6452ca8dfa62-scripts\") pod \"nova-cell1-conductor-db-sync-2bwpk\" (UID: \"5db65e99-b0fe-4cf7-975c-6452ca8dfa62\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-2bwpk" Mar 16 16:22:45 crc kubenswrapper[5120]: I0316 16:22:45.563838 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfvqx\" (UniqueName: \"kubernetes.io/projected/5db65e99-b0fe-4cf7-975c-6452ca8dfa62-kube-api-access-xfvqx\") pod \"nova-cell1-conductor-db-sync-2bwpk\" (UID: \"5db65e99-b0fe-4cf7-975c-6452ca8dfa62\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-2bwpk" Mar 16 16:22:45 crc kubenswrapper[5120]: I0316 16:22:45.601139 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-2bwpk" Mar 16 16:22:46 crc kubenswrapper[5120]: I0316 16:22:46.154711 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-2bwpk"] Mar 16 16:22:46 crc kubenswrapper[5120]: I0316 16:22:46.260453 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"d99dd334-98f5-49f4-b6e5-3f644f6310d3","Type":"ContainerStarted","Data":"aeec2c01ababdc42ae5e8d3db9fb22d2689fe9202ed76eab7413e53be7b5372a"} Mar 16 16:22:46 crc kubenswrapper[5120]: I0316 16:22:46.276648 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"baf07044-4781-4cc5-bcf4-44e71dbe9e5b","Type":"ContainerStarted","Data":"1a6927123da56878d6d08977b6cbd86a81a241a13ea4690a48bd982b0926073d"} Mar 16 16:22:46 crc kubenswrapper[5120]: I0316 16:22:46.286722 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-scheduler-0" podStartSLOduration=3.286707346 podStartE2EDuration="3.286707346s" podCreationTimestamp="2026-03-16 16:22:43 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:22:46.2812612 +0000 UTC m=+3068.435192857" watchObservedRunningTime="2026-03-16 16:22:46.286707346 +0000 UTC m=+3068.440639003" Mar 16 16:22:46 crc kubenswrapper[5120]: I0316 16:22:46.292192 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-j9pqb" event={"ID":"a1770402-bcb6-4c25-8079-130a3aaafcbb","Type":"ContainerStarted","Data":"aea0fb409f850179130b773a9414fd4e56470e278e2c89d536d55881df43ec8b"} Mar 16 16:22:46 crc kubenswrapper[5120]: I0316 16:22:46.301045 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-2bwpk" event={"ID":"5db65e99-b0fe-4cf7-975c-6452ca8dfa62","Type":"ContainerStarted","Data":"6fbb34d455c32659f8d6d851237f86cc8aeb1155b519b0be0365904696f6c4fc"} Mar 16 16:22:46 crc kubenswrapper[5120]: I0316 16:22:46.303415 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"9ed4ded3-d35c-4bdb-8098-70ca7d7c2d55","Type":"ContainerStarted","Data":"34fe2affcfc81580e39c888580c377af4aed59e2f116fc25d71268ed302db6ad"} Mar 16 16:22:46 crc kubenswrapper[5120]: I0316 16:22:46.303453 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"9ed4ded3-d35c-4bdb-8098-70ca7d7c2d55","Type":"ContainerStarted","Data":"004de7e774163e2976e055d7d2010705f26814f5333e9fe63ed434e5d134f41b"} Mar 16 16:22:46 crc kubenswrapper[5120]: I0316 16:22:46.303462 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"9ed4ded3-d35c-4bdb-8098-70ca7d7c2d55","Type":"ContainerStarted","Data":"28f687a1c649f930f58d8c3f9a5ac16260468739dc37cdbab20c2f9a0b565058"} Mar 16 16:22:46 crc kubenswrapper[5120]: I0316 16:22:46.315112 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"ea1fedf1-104c-49e0-88dd-1259b976439e","Type":"ContainerStarted","Data":"984f88b739b18155a72b1ba981d48b7bb9c1dafa30b19e9a0f4cd73077e8d702"} Mar 16 16:22:46 crc kubenswrapper[5120]: I0316 16:22:46.315161 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"ea1fedf1-104c-49e0-88dd-1259b976439e","Type":"ContainerStarted","Data":"f6b2bc436b440b75ed3d86b1cba9dc61b53eac42d607f570ab7fbd213de02ae7"} Mar 16 16:22:46 crc kubenswrapper[5120]: I0316 16:22:46.337524 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podStartSLOduration=2.337492235 podStartE2EDuration="2.337492235s" podCreationTimestamp="2026-03-16 16:22:44 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:22:46.297222428 +0000 UTC m=+3068.451154085" watchObservedRunningTime="2026-03-16 16:22:46.337492235 +0000 UTC m=+3068.491423892" Mar 16 16:22:46 crc kubenswrapper[5120]: I0316 16:22:46.354977 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-j9pqb" podStartSLOduration=3.354953631 podStartE2EDuration="3.354953631s" podCreationTimestamp="2026-03-16 16:22:43 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:22:46.319597436 +0000 UTC m=+3068.473529093" watchObservedRunningTime="2026-03-16 16:22:46.354953631 +0000 UTC m=+3068.508885288" Mar 16 16:22:46 crc kubenswrapper[5120]: I0316 16:22:46.364062 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=2.364045435 podStartE2EDuration="2.364045435s" podCreationTimestamp="2026-03-16 16:22:44 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:22:46.343358062 +0000 UTC m=+3068.497289719" watchObservedRunningTime="2026-03-16 16:22:46.364045435 +0000 UTC m=+3068.517977092" Mar 16 16:22:46 crc kubenswrapper[5120]: I0316 16:22:46.373668 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=3.373653221 podStartE2EDuration="3.373653221s" podCreationTimestamp="2026-03-16 16:22:43 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:22:46.361698102 +0000 UTC m=+3068.515629759" watchObservedRunningTime="2026-03-16 16:22:46.373653221 +0000 UTC m=+3068.527584878" Mar 16 16:22:47 crc kubenswrapper[5120]: I0316 16:22:47.327037 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-2bwpk" event={"ID":"5db65e99-b0fe-4cf7-975c-6452ca8dfa62","Type":"ContainerStarted","Data":"5b8987748353c1d2e69d60fc0c21b864956f03ab076a25c45a0a35fabf53babd"} Mar 16 16:22:47 crc kubenswrapper[5120]: I0316 16:22:47.346648 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-2bwpk" podStartSLOduration=2.346626936 podStartE2EDuration="2.346626936s" podCreationTimestamp="2026-03-16 16:22:45 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:22:47.34231832 +0000 UTC m=+3069.496249977" watchObservedRunningTime="2026-03-16 16:22:47.346626936 +0000 UTC m=+3069.500558593" Mar 16 16:22:47 crc kubenswrapper[5120]: I0316 16:22:47.460575 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:22:47 crc kubenswrapper[5120]: I0316 16:22:47.477021 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:22:48 crc kubenswrapper[5120]: I0316 16:22:48.337227 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podUID="baf07044-4781-4cc5-bcf4-44e71dbe9e5b" containerName="nova-cell1-novncproxy-novncproxy" containerID="cri-o://1a6927123da56878d6d08977b6cbd86a81a241a13ea4690a48bd982b0926073d" gracePeriod=30 Mar 16 16:22:48 crc kubenswrapper[5120]: I0316 16:22:48.337332 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="9ed4ded3-d35c-4bdb-8098-70ca7d7c2d55" containerName="nova-metadata-log" containerID="cri-o://004de7e774163e2976e055d7d2010705f26814f5333e9fe63ed434e5d134f41b" gracePeriod=30 Mar 16 16:22:48 crc kubenswrapper[5120]: I0316 16:22:48.337402 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="9ed4ded3-d35c-4bdb-8098-70ca7d7c2d55" containerName="nova-metadata-metadata" containerID="cri-o://34fe2affcfc81580e39c888580c377af4aed59e2f116fc25d71268ed302db6ad" gracePeriod=30 Mar 16 16:22:48 crc kubenswrapper[5120]: I0316 16:22:48.968574 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:22:49 crc kubenswrapper[5120]: I0316 16:22:49.007842 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d6s6b\" (UniqueName: \"kubernetes.io/projected/9ed4ded3-d35c-4bdb-8098-70ca7d7c2d55-kube-api-access-d6s6b\") pod \"9ed4ded3-d35c-4bdb-8098-70ca7d7c2d55\" (UID: \"9ed4ded3-d35c-4bdb-8098-70ca7d7c2d55\") " Mar 16 16:22:49 crc kubenswrapper[5120]: I0316 16:22:49.007948 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9ed4ded3-d35c-4bdb-8098-70ca7d7c2d55-combined-ca-bundle\") pod \"9ed4ded3-d35c-4bdb-8098-70ca7d7c2d55\" (UID: \"9ed4ded3-d35c-4bdb-8098-70ca7d7c2d55\") " Mar 16 16:22:49 crc kubenswrapper[5120]: I0316 16:22:49.008061 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9ed4ded3-d35c-4bdb-8098-70ca7d7c2d55-logs\") pod \"9ed4ded3-d35c-4bdb-8098-70ca7d7c2d55\" (UID: \"9ed4ded3-d35c-4bdb-8098-70ca7d7c2d55\") " Mar 16 16:22:49 crc kubenswrapper[5120]: I0316 16:22:49.008275 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9ed4ded3-d35c-4bdb-8098-70ca7d7c2d55-config-data\") pod \"9ed4ded3-d35c-4bdb-8098-70ca7d7c2d55\" (UID: \"9ed4ded3-d35c-4bdb-8098-70ca7d7c2d55\") " Mar 16 16:22:49 crc kubenswrapper[5120]: I0316 16:22:49.009146 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ed4ded3-d35c-4bdb-8098-70ca7d7c2d55-logs" (OuterVolumeSpecName: "logs") pod "9ed4ded3-d35c-4bdb-8098-70ca7d7c2d55" (UID: "9ed4ded3-d35c-4bdb-8098-70ca7d7c2d55"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:22:49 crc kubenswrapper[5120]: I0316 16:22:49.034629 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ed4ded3-d35c-4bdb-8098-70ca7d7c2d55-kube-api-access-d6s6b" (OuterVolumeSpecName: "kube-api-access-d6s6b") pod "9ed4ded3-d35c-4bdb-8098-70ca7d7c2d55" (UID: "9ed4ded3-d35c-4bdb-8098-70ca7d7c2d55"). InnerVolumeSpecName "kube-api-access-d6s6b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:22:49 crc kubenswrapper[5120]: I0316 16:22:49.041390 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ed4ded3-d35c-4bdb-8098-70ca7d7c2d55-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "9ed4ded3-d35c-4bdb-8098-70ca7d7c2d55" (UID: "9ed4ded3-d35c-4bdb-8098-70ca7d7c2d55"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:22:49 crc kubenswrapper[5120]: I0316 16:22:49.041991 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ed4ded3-d35c-4bdb-8098-70ca7d7c2d55-config-data" (OuterVolumeSpecName: "config-data") pod "9ed4ded3-d35c-4bdb-8098-70ca7d7c2d55" (UID: "9ed4ded3-d35c-4bdb-8098-70ca7d7c2d55"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:22:49 crc kubenswrapper[5120]: I0316 16:22:49.054192 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:22:49 crc kubenswrapper[5120]: I0316 16:22:49.109862 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/baf07044-4781-4cc5-bcf4-44e71dbe9e5b-combined-ca-bundle\") pod \"baf07044-4781-4cc5-bcf4-44e71dbe9e5b\" (UID: \"baf07044-4781-4cc5-bcf4-44e71dbe9e5b\") " Mar 16 16:22:49 crc kubenswrapper[5120]: I0316 16:22:49.110060 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b58kh\" (UniqueName: \"kubernetes.io/projected/baf07044-4781-4cc5-bcf4-44e71dbe9e5b-kube-api-access-b58kh\") pod \"baf07044-4781-4cc5-bcf4-44e71dbe9e5b\" (UID: \"baf07044-4781-4cc5-bcf4-44e71dbe9e5b\") " Mar 16 16:22:49 crc kubenswrapper[5120]: I0316 16:22:49.110228 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/baf07044-4781-4cc5-bcf4-44e71dbe9e5b-config-data\") pod \"baf07044-4781-4cc5-bcf4-44e71dbe9e5b\" (UID: \"baf07044-4781-4cc5-bcf4-44e71dbe9e5b\") " Mar 16 16:22:49 crc kubenswrapper[5120]: I0316 16:22:49.110734 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d6s6b\" (UniqueName: \"kubernetes.io/projected/9ed4ded3-d35c-4bdb-8098-70ca7d7c2d55-kube-api-access-d6s6b\") on node \"crc\" DevicePath \"\"" Mar 16 16:22:49 crc kubenswrapper[5120]: I0316 16:22:49.110750 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9ed4ded3-d35c-4bdb-8098-70ca7d7c2d55-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:22:49 crc kubenswrapper[5120]: I0316 16:22:49.110770 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9ed4ded3-d35c-4bdb-8098-70ca7d7c2d55-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:22:49 crc kubenswrapper[5120]: I0316 16:22:49.110780 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9ed4ded3-d35c-4bdb-8098-70ca7d7c2d55-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:22:49 crc kubenswrapper[5120]: I0316 16:22:49.113916 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/baf07044-4781-4cc5-bcf4-44e71dbe9e5b-kube-api-access-b58kh" (OuterVolumeSpecName: "kube-api-access-b58kh") pod "baf07044-4781-4cc5-bcf4-44e71dbe9e5b" (UID: "baf07044-4781-4cc5-bcf4-44e71dbe9e5b"). InnerVolumeSpecName "kube-api-access-b58kh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:22:49 crc kubenswrapper[5120]: I0316 16:22:49.142672 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/baf07044-4781-4cc5-bcf4-44e71dbe9e5b-config-data" (OuterVolumeSpecName: "config-data") pod "baf07044-4781-4cc5-bcf4-44e71dbe9e5b" (UID: "baf07044-4781-4cc5-bcf4-44e71dbe9e5b"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:22:49 crc kubenswrapper[5120]: I0316 16:22:49.143292 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/baf07044-4781-4cc5-bcf4-44e71dbe9e5b-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "baf07044-4781-4cc5-bcf4-44e71dbe9e5b" (UID: "baf07044-4781-4cc5-bcf4-44e71dbe9e5b"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:22:49 crc kubenswrapper[5120]: I0316 16:22:49.213425 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/baf07044-4781-4cc5-bcf4-44e71dbe9e5b-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:22:49 crc kubenswrapper[5120]: I0316 16:22:49.213456 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/baf07044-4781-4cc5-bcf4-44e71dbe9e5b-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:22:49 crc kubenswrapper[5120]: I0316 16:22:49.213470 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b58kh\" (UniqueName: \"kubernetes.io/projected/baf07044-4781-4cc5-bcf4-44e71dbe9e5b-kube-api-access-b58kh\") on node \"crc\" DevicePath \"\"" Mar 16 16:22:49 crc kubenswrapper[5120]: I0316 16:22:49.347706 5120 generic.go:358] "Generic (PLEG): container finished" podID="d99dd334-98f5-49f4-b6e5-3f644f6310d3" containerID="aeec2c01ababdc42ae5e8d3db9fb22d2689fe9202ed76eab7413e53be7b5372a" exitCode=1 Mar 16 16:22:49 crc kubenswrapper[5120]: I0316 16:22:49.347810 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"d99dd334-98f5-49f4-b6e5-3f644f6310d3","Type":"ContainerDied","Data":"aeec2c01ababdc42ae5e8d3db9fb22d2689fe9202ed76eab7413e53be7b5372a"} Mar 16 16:22:49 crc kubenswrapper[5120]: I0316 16:22:49.348696 5120 scope.go:117] "RemoveContainer" containerID="aeec2c01ababdc42ae5e8d3db9fb22d2689fe9202ed76eab7413e53be7b5372a" Mar 16 16:22:49 crc kubenswrapper[5120]: I0316 16:22:49.349102 5120 generic.go:358] "Generic (PLEG): container finished" podID="baf07044-4781-4cc5-bcf4-44e71dbe9e5b" containerID="1a6927123da56878d6d08977b6cbd86a81a241a13ea4690a48bd982b0926073d" exitCode=0 Mar 16 16:22:49 crc kubenswrapper[5120]: I0316 16:22:49.349290 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"baf07044-4781-4cc5-bcf4-44e71dbe9e5b","Type":"ContainerDied","Data":"1a6927123da56878d6d08977b6cbd86a81a241a13ea4690a48bd982b0926073d"} Mar 16 16:22:49 crc kubenswrapper[5120]: I0316 16:22:49.349316 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"baf07044-4781-4cc5-bcf4-44e71dbe9e5b","Type":"ContainerDied","Data":"aeef91777f21d69abb09292a16d3bb196c0905970c345579d2420815e3a7b4fd"} Mar 16 16:22:49 crc kubenswrapper[5120]: I0316 16:22:49.349332 5120 scope.go:117] "RemoveContainer" containerID="1a6927123da56878d6d08977b6cbd86a81a241a13ea4690a48bd982b0926073d" Mar 16 16:22:49 crc kubenswrapper[5120]: I0316 16:22:49.350313 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:22:49 crc kubenswrapper[5120]: I0316 16:22:49.353660 5120 generic.go:358] "Generic (PLEG): container finished" podID="9ed4ded3-d35c-4bdb-8098-70ca7d7c2d55" containerID="34fe2affcfc81580e39c888580c377af4aed59e2f116fc25d71268ed302db6ad" exitCode=0 Mar 16 16:22:49 crc kubenswrapper[5120]: I0316 16:22:49.353699 5120 generic.go:358] "Generic (PLEG): container finished" podID="9ed4ded3-d35c-4bdb-8098-70ca7d7c2d55" containerID="004de7e774163e2976e055d7d2010705f26814f5333e9fe63ed434e5d134f41b" exitCode=143 Mar 16 16:22:49 crc kubenswrapper[5120]: I0316 16:22:49.353922 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"9ed4ded3-d35c-4bdb-8098-70ca7d7c2d55","Type":"ContainerDied","Data":"34fe2affcfc81580e39c888580c377af4aed59e2f116fc25d71268ed302db6ad"} Mar 16 16:22:49 crc kubenswrapper[5120]: I0316 16:22:49.353960 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"9ed4ded3-d35c-4bdb-8098-70ca7d7c2d55","Type":"ContainerDied","Data":"004de7e774163e2976e055d7d2010705f26814f5333e9fe63ed434e5d134f41b"} Mar 16 16:22:49 crc kubenswrapper[5120]: I0316 16:22:49.353977 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:22:49 crc kubenswrapper[5120]: I0316 16:22:49.353980 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"9ed4ded3-d35c-4bdb-8098-70ca7d7c2d55","Type":"ContainerDied","Data":"28f687a1c649f930f58d8c3f9a5ac16260468739dc37cdbab20c2f9a0b565058"} Mar 16 16:22:49 crc kubenswrapper[5120]: I0316 16:22:49.365924 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:22:49 crc kubenswrapper[5120]: I0316 16:22:49.406513 5120 scope.go:117] "RemoveContainer" containerID="1a6927123da56878d6d08977b6cbd86a81a241a13ea4690a48bd982b0926073d" Mar 16 16:22:49 crc kubenswrapper[5120]: E0316 16:22:49.407579 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a6927123da56878d6d08977b6cbd86a81a241a13ea4690a48bd982b0926073d\": container with ID starting with 1a6927123da56878d6d08977b6cbd86a81a241a13ea4690a48bd982b0926073d not found: ID does not exist" containerID="1a6927123da56878d6d08977b6cbd86a81a241a13ea4690a48bd982b0926073d" Mar 16 16:22:49 crc kubenswrapper[5120]: I0316 16:22:49.407611 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a6927123da56878d6d08977b6cbd86a81a241a13ea4690a48bd982b0926073d"} err="failed to get container status \"1a6927123da56878d6d08977b6cbd86a81a241a13ea4690a48bd982b0926073d\": rpc error: code = NotFound desc = could not find container \"1a6927123da56878d6d08977b6cbd86a81a241a13ea4690a48bd982b0926073d\": container with ID starting with 1a6927123da56878d6d08977b6cbd86a81a241a13ea4690a48bd982b0926073d not found: ID does not exist" Mar 16 16:22:49 crc kubenswrapper[5120]: I0316 16:22:49.407629 5120 scope.go:117] "RemoveContainer" containerID="34fe2affcfc81580e39c888580c377af4aed59e2f116fc25d71268ed302db6ad" Mar 16 16:22:49 crc kubenswrapper[5120]: I0316 16:22:49.412962 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:22:49 crc kubenswrapper[5120]: I0316 16:22:49.429034 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:22:49 crc kubenswrapper[5120]: I0316 16:22:49.453529 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:22:49 crc kubenswrapper[5120]: I0316 16:22:49.470420 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:22:49 crc kubenswrapper[5120]: I0316 16:22:49.472827 5120 scope.go:117] "RemoveContainer" containerID="004de7e774163e2976e055d7d2010705f26814f5333e9fe63ed434e5d134f41b" Mar 16 16:22:49 crc kubenswrapper[5120]: I0316 16:22:49.479957 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:22:49 crc kubenswrapper[5120]: I0316 16:22:49.481362 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ed4ded3-d35c-4bdb-8098-70ca7d7c2d55" containerName="nova-metadata-metadata" Mar 16 16:22:49 crc kubenswrapper[5120]: I0316 16:22:49.481379 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ed4ded3-d35c-4bdb-8098-70ca7d7c2d55" containerName="nova-metadata-metadata" Mar 16 16:22:49 crc kubenswrapper[5120]: I0316 16:22:49.481405 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="baf07044-4781-4cc5-bcf4-44e71dbe9e5b" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 16:22:49 crc kubenswrapper[5120]: I0316 16:22:49.481412 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="baf07044-4781-4cc5-bcf4-44e71dbe9e5b" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 16:22:49 crc kubenswrapper[5120]: I0316 16:22:49.481449 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ed4ded3-d35c-4bdb-8098-70ca7d7c2d55" containerName="nova-metadata-log" Mar 16 16:22:49 crc kubenswrapper[5120]: I0316 16:22:49.481455 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ed4ded3-d35c-4bdb-8098-70ca7d7c2d55" containerName="nova-metadata-log" Mar 16 16:22:49 crc kubenswrapper[5120]: I0316 16:22:49.481608 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="9ed4ded3-d35c-4bdb-8098-70ca7d7c2d55" containerName="nova-metadata-log" Mar 16 16:22:49 crc kubenswrapper[5120]: I0316 16:22:49.481630 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="9ed4ded3-d35c-4bdb-8098-70ca7d7c2d55" containerName="nova-metadata-metadata" Mar 16 16:22:49 crc kubenswrapper[5120]: I0316 16:22:49.481641 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="baf07044-4781-4cc5-bcf4-44e71dbe9e5b" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 16:22:49 crc kubenswrapper[5120]: I0316 16:22:49.487162 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:22:49 crc kubenswrapper[5120]: I0316 16:22:49.488523 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:22:49 crc kubenswrapper[5120]: I0316 16:22:49.490157 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-metadata-config-data\"" Mar 16 16:22:49 crc kubenswrapper[5120]: I0316 16:22:49.490382 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-metadata-internal-svc\"" Mar 16 16:22:49 crc kubenswrapper[5120]: I0316 16:22:49.497872 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:22:49 crc kubenswrapper[5120]: I0316 16:22:49.503260 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:22:49 crc kubenswrapper[5120]: I0316 16:22:49.505967 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-novncproxy-config-data\"" Mar 16 16:22:49 crc kubenswrapper[5120]: I0316 16:22:49.506310 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-novncproxy-cell1-public-svc\"" Mar 16 16:22:49 crc kubenswrapper[5120]: I0316 16:22:49.506458 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-novncproxy-cell1-vencrypt\"" Mar 16 16:22:49 crc kubenswrapper[5120]: I0316 16:22:49.510983 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:22:49 crc kubenswrapper[5120]: I0316 16:22:49.519896 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/209176a4-f078-44ac-9975-ff5ea6c6bc03-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"209176a4-f078-44ac-9975-ff5ea6c6bc03\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:22:49 crc kubenswrapper[5120]: I0316 16:22:49.519942 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/52f78b0c-8c71-4e47-978b-840e0ca12c1c-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"52f78b0c-8c71-4e47-978b-840e0ca12c1c\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:22:49 crc kubenswrapper[5120]: I0316 16:22:49.520111 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ncp8f\" (UniqueName: \"kubernetes.io/projected/209176a4-f078-44ac-9975-ff5ea6c6bc03-kube-api-access-ncp8f\") pod \"nova-metadata-0\" (UID: \"209176a4-f078-44ac-9975-ff5ea6c6bc03\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:22:49 crc kubenswrapper[5120]: I0316 16:22:49.520171 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/52f78b0c-8c71-4e47-978b-840e0ca12c1c-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"52f78b0c-8c71-4e47-978b-840e0ca12c1c\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:22:49 crc kubenswrapper[5120]: I0316 16:22:49.520343 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/209176a4-f078-44ac-9975-ff5ea6c6bc03-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"209176a4-f078-44ac-9975-ff5ea6c6bc03\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:22:49 crc kubenswrapper[5120]: I0316 16:22:49.520383 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/209176a4-f078-44ac-9975-ff5ea6c6bc03-config-data\") pod \"nova-metadata-0\" (UID: \"209176a4-f078-44ac-9975-ff5ea6c6bc03\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:22:49 crc kubenswrapper[5120]: I0316 16:22:49.520400 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/52f78b0c-8c71-4e47-978b-840e0ca12c1c-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"52f78b0c-8c71-4e47-978b-840e0ca12c1c\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:22:49 crc kubenswrapper[5120]: I0316 16:22:49.520585 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/209176a4-f078-44ac-9975-ff5ea6c6bc03-logs\") pod \"nova-metadata-0\" (UID: \"209176a4-f078-44ac-9975-ff5ea6c6bc03\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:22:49 crc kubenswrapper[5120]: I0316 16:22:49.520629 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/52f78b0c-8c71-4e47-978b-840e0ca12c1c-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"52f78b0c-8c71-4e47-978b-840e0ca12c1c\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:22:49 crc kubenswrapper[5120]: I0316 16:22:49.520675 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2rmh\" (UniqueName: \"kubernetes.io/projected/52f78b0c-8c71-4e47-978b-840e0ca12c1c-kube-api-access-j2rmh\") pod \"nova-cell1-novncproxy-0\" (UID: \"52f78b0c-8c71-4e47-978b-840e0ca12c1c\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:22:49 crc kubenswrapper[5120]: I0316 16:22:49.551876 5120 scope.go:117] "RemoveContainer" containerID="34fe2affcfc81580e39c888580c377af4aed59e2f116fc25d71268ed302db6ad" Mar 16 16:22:49 crc kubenswrapper[5120]: E0316 16:22:49.552294 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"34fe2affcfc81580e39c888580c377af4aed59e2f116fc25d71268ed302db6ad\": container with ID starting with 34fe2affcfc81580e39c888580c377af4aed59e2f116fc25d71268ed302db6ad not found: ID does not exist" containerID="34fe2affcfc81580e39c888580c377af4aed59e2f116fc25d71268ed302db6ad" Mar 16 16:22:49 crc kubenswrapper[5120]: I0316 16:22:49.552329 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34fe2affcfc81580e39c888580c377af4aed59e2f116fc25d71268ed302db6ad"} err="failed to get container status \"34fe2affcfc81580e39c888580c377af4aed59e2f116fc25d71268ed302db6ad\": rpc error: code = NotFound desc = could not find container \"34fe2affcfc81580e39c888580c377af4aed59e2f116fc25d71268ed302db6ad\": container with ID starting with 34fe2affcfc81580e39c888580c377af4aed59e2f116fc25d71268ed302db6ad not found: ID does not exist" Mar 16 16:22:49 crc kubenswrapper[5120]: I0316 16:22:49.552354 5120 scope.go:117] "RemoveContainer" containerID="004de7e774163e2976e055d7d2010705f26814f5333e9fe63ed434e5d134f41b" Mar 16 16:22:49 crc kubenswrapper[5120]: E0316 16:22:49.552786 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"004de7e774163e2976e055d7d2010705f26814f5333e9fe63ed434e5d134f41b\": container with ID starting with 004de7e774163e2976e055d7d2010705f26814f5333e9fe63ed434e5d134f41b not found: ID does not exist" containerID="004de7e774163e2976e055d7d2010705f26814f5333e9fe63ed434e5d134f41b" Mar 16 16:22:49 crc kubenswrapper[5120]: I0316 16:22:49.552812 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"004de7e774163e2976e055d7d2010705f26814f5333e9fe63ed434e5d134f41b"} err="failed to get container status \"004de7e774163e2976e055d7d2010705f26814f5333e9fe63ed434e5d134f41b\": rpc error: code = NotFound desc = could not find container \"004de7e774163e2976e055d7d2010705f26814f5333e9fe63ed434e5d134f41b\": container with ID starting with 004de7e774163e2976e055d7d2010705f26814f5333e9fe63ed434e5d134f41b not found: ID does not exist" Mar 16 16:22:49 crc kubenswrapper[5120]: I0316 16:22:49.552827 5120 scope.go:117] "RemoveContainer" containerID="34fe2affcfc81580e39c888580c377af4aed59e2f116fc25d71268ed302db6ad" Mar 16 16:22:49 crc kubenswrapper[5120]: I0316 16:22:49.553061 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34fe2affcfc81580e39c888580c377af4aed59e2f116fc25d71268ed302db6ad"} err="failed to get container status \"34fe2affcfc81580e39c888580c377af4aed59e2f116fc25d71268ed302db6ad\": rpc error: code = NotFound desc = could not find container \"34fe2affcfc81580e39c888580c377af4aed59e2f116fc25d71268ed302db6ad\": container with ID starting with 34fe2affcfc81580e39c888580c377af4aed59e2f116fc25d71268ed302db6ad not found: ID does not exist" Mar 16 16:22:49 crc kubenswrapper[5120]: I0316 16:22:49.553081 5120 scope.go:117] "RemoveContainer" containerID="004de7e774163e2976e055d7d2010705f26814f5333e9fe63ed434e5d134f41b" Mar 16 16:22:49 crc kubenswrapper[5120]: I0316 16:22:49.553268 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"004de7e774163e2976e055d7d2010705f26814f5333e9fe63ed434e5d134f41b"} err="failed to get container status \"004de7e774163e2976e055d7d2010705f26814f5333e9fe63ed434e5d134f41b\": rpc error: code = NotFound desc = could not find container \"004de7e774163e2976e055d7d2010705f26814f5333e9fe63ed434e5d134f41b\": container with ID starting with 004de7e774163e2976e055d7d2010705f26814f5333e9fe63ed434e5d134f41b not found: ID does not exist" Mar 16 16:22:49 crc kubenswrapper[5120]: I0316 16:22:49.622355 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/52f78b0c-8c71-4e47-978b-840e0ca12c1c-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"52f78b0c-8c71-4e47-978b-840e0ca12c1c\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:22:49 crc kubenswrapper[5120]: I0316 16:22:49.622712 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ncp8f\" (UniqueName: \"kubernetes.io/projected/209176a4-f078-44ac-9975-ff5ea6c6bc03-kube-api-access-ncp8f\") pod \"nova-metadata-0\" (UID: \"209176a4-f078-44ac-9975-ff5ea6c6bc03\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:22:49 crc kubenswrapper[5120]: I0316 16:22:49.622784 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/52f78b0c-8c71-4e47-978b-840e0ca12c1c-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"52f78b0c-8c71-4e47-978b-840e0ca12c1c\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:22:49 crc kubenswrapper[5120]: I0316 16:22:49.622898 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/209176a4-f078-44ac-9975-ff5ea6c6bc03-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"209176a4-f078-44ac-9975-ff5ea6c6bc03\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:22:49 crc kubenswrapper[5120]: I0316 16:22:49.622936 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/209176a4-f078-44ac-9975-ff5ea6c6bc03-config-data\") pod \"nova-metadata-0\" (UID: \"209176a4-f078-44ac-9975-ff5ea6c6bc03\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:22:49 crc kubenswrapper[5120]: I0316 16:22:49.623143 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/52f78b0c-8c71-4e47-978b-840e0ca12c1c-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"52f78b0c-8c71-4e47-978b-840e0ca12c1c\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:22:49 crc kubenswrapper[5120]: I0316 16:22:49.623559 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/209176a4-f078-44ac-9975-ff5ea6c6bc03-logs\") pod \"nova-metadata-0\" (UID: \"209176a4-f078-44ac-9975-ff5ea6c6bc03\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:22:49 crc kubenswrapper[5120]: I0316 16:22:49.623691 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/52f78b0c-8c71-4e47-978b-840e0ca12c1c-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"52f78b0c-8c71-4e47-978b-840e0ca12c1c\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:22:49 crc kubenswrapper[5120]: I0316 16:22:49.623809 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j2rmh\" (UniqueName: \"kubernetes.io/projected/52f78b0c-8c71-4e47-978b-840e0ca12c1c-kube-api-access-j2rmh\") pod \"nova-cell1-novncproxy-0\" (UID: \"52f78b0c-8c71-4e47-978b-840e0ca12c1c\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:22:49 crc kubenswrapper[5120]: I0316 16:22:49.623994 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/209176a4-f078-44ac-9975-ff5ea6c6bc03-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"209176a4-f078-44ac-9975-ff5ea6c6bc03\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:22:49 crc kubenswrapper[5120]: I0316 16:22:49.624048 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/209176a4-f078-44ac-9975-ff5ea6c6bc03-logs\") pod \"nova-metadata-0\" (UID: \"209176a4-f078-44ac-9975-ff5ea6c6bc03\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:22:49 crc kubenswrapper[5120]: I0316 16:22:49.626827 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/52f78b0c-8c71-4e47-978b-840e0ca12c1c-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"52f78b0c-8c71-4e47-978b-840e0ca12c1c\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:22:49 crc kubenswrapper[5120]: I0316 16:22:49.627166 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/209176a4-f078-44ac-9975-ff5ea6c6bc03-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"209176a4-f078-44ac-9975-ff5ea6c6bc03\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:22:49 crc kubenswrapper[5120]: I0316 16:22:49.630332 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/52f78b0c-8c71-4e47-978b-840e0ca12c1c-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"52f78b0c-8c71-4e47-978b-840e0ca12c1c\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:22:49 crc kubenswrapper[5120]: I0316 16:22:49.630334 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/52f78b0c-8c71-4e47-978b-840e0ca12c1c-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"52f78b0c-8c71-4e47-978b-840e0ca12c1c\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:22:49 crc kubenswrapper[5120]: I0316 16:22:49.630470 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/209176a4-f078-44ac-9975-ff5ea6c6bc03-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"209176a4-f078-44ac-9975-ff5ea6c6bc03\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:22:49 crc kubenswrapper[5120]: I0316 16:22:49.632546 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/52f78b0c-8c71-4e47-978b-840e0ca12c1c-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"52f78b0c-8c71-4e47-978b-840e0ca12c1c\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:22:49 crc kubenswrapper[5120]: I0316 16:22:49.638690 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/209176a4-f078-44ac-9975-ff5ea6c6bc03-config-data\") pod \"nova-metadata-0\" (UID: \"209176a4-f078-44ac-9975-ff5ea6c6bc03\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:22:49 crc kubenswrapper[5120]: I0316 16:22:49.640138 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2rmh\" (UniqueName: \"kubernetes.io/projected/52f78b0c-8c71-4e47-978b-840e0ca12c1c-kube-api-access-j2rmh\") pod \"nova-cell1-novncproxy-0\" (UID: \"52f78b0c-8c71-4e47-978b-840e0ca12c1c\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:22:49 crc kubenswrapper[5120]: I0316 16:22:49.657312 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ncp8f\" (UniqueName: \"kubernetes.io/projected/209176a4-f078-44ac-9975-ff5ea6c6bc03-kube-api-access-ncp8f\") pod \"nova-metadata-0\" (UID: \"209176a4-f078-44ac-9975-ff5ea6c6bc03\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:22:49 crc kubenswrapper[5120]: I0316 16:22:49.862540 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:22:49 crc kubenswrapper[5120]: I0316 16:22:49.888292 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:22:50 crc kubenswrapper[5120]: I0316 16:22:50.370191 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"d99dd334-98f5-49f4-b6e5-3f644f6310d3","Type":"ContainerStarted","Data":"f73c573142484be1d03f3cdceb7bde1b025f09605d398ed5b4577e9d6377509a"} Mar 16 16:22:50 crc kubenswrapper[5120]: I0316 16:22:50.396908 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:22:50 crc kubenswrapper[5120]: I0316 16:22:50.444194 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:22:50 crc kubenswrapper[5120]: I0316 16:22:50.676153 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ed4ded3-d35c-4bdb-8098-70ca7d7c2d55" path="/var/lib/kubelet/pods/9ed4ded3-d35c-4bdb-8098-70ca7d7c2d55/volumes" Mar 16 16:22:50 crc kubenswrapper[5120]: I0316 16:22:50.677332 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="baf07044-4781-4cc5-bcf4-44e71dbe9e5b" path="/var/lib/kubelet/pods/baf07044-4781-4cc5-bcf4-44e71dbe9e5b/volumes" Mar 16 16:22:51 crc kubenswrapper[5120]: I0316 16:22:51.388323 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"52f78b0c-8c71-4e47-978b-840e0ca12c1c","Type":"ContainerStarted","Data":"44d0dacb34ea15c6e811251f71ff5ac8bd11c4cd7ed1ed20abb4d704503c48c2"} Mar 16 16:22:51 crc kubenswrapper[5120]: I0316 16:22:51.388612 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"52f78b0c-8c71-4e47-978b-840e0ca12c1c","Type":"ContainerStarted","Data":"7ee4c212fb05f23f3de8f4157cd469b4a721b5fd3570d08d09ac210211e73485"} Mar 16 16:22:51 crc kubenswrapper[5120]: I0316 16:22:51.391289 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"209176a4-f078-44ac-9975-ff5ea6c6bc03","Type":"ContainerStarted","Data":"6d3b6f112c006ecba99109c2949a38d06f07e9ad36eb88f6b4b4938aa775a5cd"} Mar 16 16:22:51 crc kubenswrapper[5120]: I0316 16:22:51.391312 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"209176a4-f078-44ac-9975-ff5ea6c6bc03","Type":"ContainerStarted","Data":"a4851b68a0355ad02802780f04fe1de2b7c6c2607c522d488dc5c54f0175e556"} Mar 16 16:22:51 crc kubenswrapper[5120]: I0316 16:22:51.391324 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"209176a4-f078-44ac-9975-ff5ea6c6bc03","Type":"ContainerStarted","Data":"8cc8546fadc231c444cbeb5a9d5b8e1129b32f28d9bc9de392693d2114c2f2cf"} Mar 16 16:22:51 crc kubenswrapper[5120]: I0316 16:22:51.406349 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podStartSLOduration=2.406334592 podStartE2EDuration="2.406334592s" podCreationTimestamp="2026-03-16 16:22:49 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:22:51.401716419 +0000 UTC m=+3073.555648076" watchObservedRunningTime="2026-03-16 16:22:51.406334592 +0000 UTC m=+3073.560266249" Mar 16 16:22:51 crc kubenswrapper[5120]: I0316 16:22:51.449056 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=2.449038634 podStartE2EDuration="2.449038634s" podCreationTimestamp="2026-03-16 16:22:49 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:22:51.428931806 +0000 UTC m=+3073.582863463" watchObservedRunningTime="2026-03-16 16:22:51.449038634 +0000 UTC m=+3073.602970291" Mar 16 16:22:52 crc kubenswrapper[5120]: I0316 16:22:52.340317 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:22:52 crc kubenswrapper[5120]: I0316 16:22:52.360726 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:22:52 crc kubenswrapper[5120]: I0316 16:22:52.375583 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:22:52 crc kubenswrapper[5120]: I0316 16:22:52.375893 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="ea1fedf1-104c-49e0-88dd-1259b976439e" containerName="nova-api-log" containerID="cri-o://f6b2bc436b440b75ed3d86b1cba9dc61b53eac42d607f570ab7fbd213de02ae7" gracePeriod=30 Mar 16 16:22:52 crc kubenswrapper[5120]: I0316 16:22:52.375967 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="ea1fedf1-104c-49e0-88dd-1259b976439e" containerName="nova-api-api" containerID="cri-o://984f88b739b18155a72b1ba981d48b7bb9c1dafa30b19e9a0f4cd73077e8d702" gracePeriod=30 Mar 16 16:22:52 crc kubenswrapper[5120]: I0316 16:22:52.400480 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:22:52 crc kubenswrapper[5120]: I0316 16:22:52.403755 5120 generic.go:358] "Generic (PLEG): container finished" podID="d99dd334-98f5-49f4-b6e5-3f644f6310d3" containerID="f73c573142484be1d03f3cdceb7bde1b025f09605d398ed5b4577e9d6377509a" exitCode=1 Mar 16 16:22:52 crc kubenswrapper[5120]: I0316 16:22:52.404226 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"d99dd334-98f5-49f4-b6e5-3f644f6310d3","Type":"ContainerDied","Data":"f73c573142484be1d03f3cdceb7bde1b025f09605d398ed5b4577e9d6377509a"} Mar 16 16:22:52 crc kubenswrapper[5120]: I0316 16:22:52.404261 5120 scope.go:117] "RemoveContainer" containerID="aeec2c01ababdc42ae5e8d3db9fb22d2689fe9202ed76eab7413e53be7b5372a" Mar 16 16:22:52 crc kubenswrapper[5120]: I0316 16:22:52.894824 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:22:52 crc kubenswrapper[5120]: I0316 16:22:52.998408 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d99dd334-98f5-49f4-b6e5-3f644f6310d3-combined-ca-bundle\") pod \"d99dd334-98f5-49f4-b6e5-3f644f6310d3\" (UID: \"d99dd334-98f5-49f4-b6e5-3f644f6310d3\") " Mar 16 16:22:52 crc kubenswrapper[5120]: I0316 16:22:52.998561 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c9kjx\" (UniqueName: \"kubernetes.io/projected/d99dd334-98f5-49f4-b6e5-3f644f6310d3-kube-api-access-c9kjx\") pod \"d99dd334-98f5-49f4-b6e5-3f644f6310d3\" (UID: \"d99dd334-98f5-49f4-b6e5-3f644f6310d3\") " Mar 16 16:22:52 crc kubenswrapper[5120]: I0316 16:22:52.998928 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d99dd334-98f5-49f4-b6e5-3f644f6310d3-config-data\") pod \"d99dd334-98f5-49f4-b6e5-3f644f6310d3\" (UID: \"d99dd334-98f5-49f4-b6e5-3f644f6310d3\") " Mar 16 16:22:53 crc kubenswrapper[5120]: I0316 16:22:53.005253 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d99dd334-98f5-49f4-b6e5-3f644f6310d3-kube-api-access-c9kjx" (OuterVolumeSpecName: "kube-api-access-c9kjx") pod "d99dd334-98f5-49f4-b6e5-3f644f6310d3" (UID: "d99dd334-98f5-49f4-b6e5-3f644f6310d3"). InnerVolumeSpecName "kube-api-access-c9kjx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:22:53 crc kubenswrapper[5120]: I0316 16:22:53.027381 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d99dd334-98f5-49f4-b6e5-3f644f6310d3-config-data" (OuterVolumeSpecName: "config-data") pod "d99dd334-98f5-49f4-b6e5-3f644f6310d3" (UID: "d99dd334-98f5-49f4-b6e5-3f644f6310d3"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:22:53 crc kubenswrapper[5120]: I0316 16:22:53.031969 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d99dd334-98f5-49f4-b6e5-3f644f6310d3-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "d99dd334-98f5-49f4-b6e5-3f644f6310d3" (UID: "d99dd334-98f5-49f4-b6e5-3f644f6310d3"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:22:53 crc kubenswrapper[5120]: I0316 16:22:53.056440 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:22:53 crc kubenswrapper[5120]: I0316 16:22:53.100251 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ea1fedf1-104c-49e0-88dd-1259b976439e-config-data\") pod \"ea1fedf1-104c-49e0-88dd-1259b976439e\" (UID: \"ea1fedf1-104c-49e0-88dd-1259b976439e\") " Mar 16 16:22:53 crc kubenswrapper[5120]: I0316 16:22:53.100748 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ea1fedf1-104c-49e0-88dd-1259b976439e-combined-ca-bundle\") pod \"ea1fedf1-104c-49e0-88dd-1259b976439e\" (UID: \"ea1fedf1-104c-49e0-88dd-1259b976439e\") " Mar 16 16:22:53 crc kubenswrapper[5120]: I0316 16:22:53.100829 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ea1fedf1-104c-49e0-88dd-1259b976439e-logs\") pod \"ea1fedf1-104c-49e0-88dd-1259b976439e\" (UID: \"ea1fedf1-104c-49e0-88dd-1259b976439e\") " Mar 16 16:22:53 crc kubenswrapper[5120]: I0316 16:22:53.100959 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6qtfs\" (UniqueName: \"kubernetes.io/projected/ea1fedf1-104c-49e0-88dd-1259b976439e-kube-api-access-6qtfs\") pod \"ea1fedf1-104c-49e0-88dd-1259b976439e\" (UID: \"ea1fedf1-104c-49e0-88dd-1259b976439e\") " Mar 16 16:22:53 crc kubenswrapper[5120]: I0316 16:22:53.101602 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d99dd334-98f5-49f4-b6e5-3f644f6310d3-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:22:53 crc kubenswrapper[5120]: I0316 16:22:53.101625 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d99dd334-98f5-49f4-b6e5-3f644f6310d3-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:22:53 crc kubenswrapper[5120]: I0316 16:22:53.101639 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c9kjx\" (UniqueName: \"kubernetes.io/projected/d99dd334-98f5-49f4-b6e5-3f644f6310d3-kube-api-access-c9kjx\") on node \"crc\" DevicePath \"\"" Mar 16 16:22:53 crc kubenswrapper[5120]: I0316 16:22:53.102144 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea1fedf1-104c-49e0-88dd-1259b976439e-logs" (OuterVolumeSpecName: "logs") pod "ea1fedf1-104c-49e0-88dd-1259b976439e" (UID: "ea1fedf1-104c-49e0-88dd-1259b976439e"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:22:53 crc kubenswrapper[5120]: I0316 16:22:53.106914 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea1fedf1-104c-49e0-88dd-1259b976439e-kube-api-access-6qtfs" (OuterVolumeSpecName: "kube-api-access-6qtfs") pod "ea1fedf1-104c-49e0-88dd-1259b976439e" (UID: "ea1fedf1-104c-49e0-88dd-1259b976439e"). InnerVolumeSpecName "kube-api-access-6qtfs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:22:53 crc kubenswrapper[5120]: I0316 16:22:53.127467 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea1fedf1-104c-49e0-88dd-1259b976439e-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ea1fedf1-104c-49e0-88dd-1259b976439e" (UID: "ea1fedf1-104c-49e0-88dd-1259b976439e"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:22:53 crc kubenswrapper[5120]: I0316 16:22:53.127871 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea1fedf1-104c-49e0-88dd-1259b976439e-config-data" (OuterVolumeSpecName: "config-data") pod "ea1fedf1-104c-49e0-88dd-1259b976439e" (UID: "ea1fedf1-104c-49e0-88dd-1259b976439e"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:22:53 crc kubenswrapper[5120]: I0316 16:22:53.203610 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ea1fedf1-104c-49e0-88dd-1259b976439e-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:22:53 crc kubenswrapper[5120]: I0316 16:22:53.203649 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ea1fedf1-104c-49e0-88dd-1259b976439e-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:22:53 crc kubenswrapper[5120]: I0316 16:22:53.203662 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ea1fedf1-104c-49e0-88dd-1259b976439e-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:22:53 crc kubenswrapper[5120]: I0316 16:22:53.203673 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6qtfs\" (UniqueName: \"kubernetes.io/projected/ea1fedf1-104c-49e0-88dd-1259b976439e-kube-api-access-6qtfs\") on node \"crc\" DevicePath \"\"" Mar 16 16:22:53 crc kubenswrapper[5120]: I0316 16:22:53.423636 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:22:53 crc kubenswrapper[5120]: I0316 16:22:53.423711 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"d99dd334-98f5-49f4-b6e5-3f644f6310d3","Type":"ContainerDied","Data":"348b53d4b718ed9227021c35ff9c9218fc33d8d41b62e6f6ae46a16a1a9a29a5"} Mar 16 16:22:53 crc kubenswrapper[5120]: I0316 16:22:53.425098 5120 scope.go:117] "RemoveContainer" containerID="f73c573142484be1d03f3cdceb7bde1b025f09605d398ed5b4577e9d6377509a" Mar 16 16:22:53 crc kubenswrapper[5120]: I0316 16:22:53.433316 5120 generic.go:358] "Generic (PLEG): container finished" podID="a1770402-bcb6-4c25-8079-130a3aaafcbb" containerID="aea0fb409f850179130b773a9414fd4e56470e278e2c89d536d55881df43ec8b" exitCode=0 Mar 16 16:22:53 crc kubenswrapper[5120]: I0316 16:22:53.433370 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-j9pqb" event={"ID":"a1770402-bcb6-4c25-8079-130a3aaafcbb","Type":"ContainerDied","Data":"aea0fb409f850179130b773a9414fd4e56470e278e2c89d536d55881df43ec8b"} Mar 16 16:22:53 crc kubenswrapper[5120]: I0316 16:22:53.439810 5120 generic.go:358] "Generic (PLEG): container finished" podID="5db65e99-b0fe-4cf7-975c-6452ca8dfa62" containerID="5b8987748353c1d2e69d60fc0c21b864956f03ab076a25c45a0a35fabf53babd" exitCode=0 Mar 16 16:22:53 crc kubenswrapper[5120]: I0316 16:22:53.440001 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-2bwpk" event={"ID":"5db65e99-b0fe-4cf7-975c-6452ca8dfa62","Type":"ContainerDied","Data":"5b8987748353c1d2e69d60fc0c21b864956f03ab076a25c45a0a35fabf53babd"} Mar 16 16:22:53 crc kubenswrapper[5120]: I0316 16:22:53.442985 5120 generic.go:358] "Generic (PLEG): container finished" podID="ea1fedf1-104c-49e0-88dd-1259b976439e" containerID="984f88b739b18155a72b1ba981d48b7bb9c1dafa30b19e9a0f4cd73077e8d702" exitCode=0 Mar 16 16:22:53 crc kubenswrapper[5120]: I0316 16:22:53.443004 5120 generic.go:358] "Generic (PLEG): container finished" podID="ea1fedf1-104c-49e0-88dd-1259b976439e" containerID="f6b2bc436b440b75ed3d86b1cba9dc61b53eac42d607f570ab7fbd213de02ae7" exitCode=143 Mar 16 16:22:53 crc kubenswrapper[5120]: I0316 16:22:53.443252 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:22:53 crc kubenswrapper[5120]: I0316 16:22:53.443412 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"ea1fedf1-104c-49e0-88dd-1259b976439e","Type":"ContainerDied","Data":"984f88b739b18155a72b1ba981d48b7bb9c1dafa30b19e9a0f4cd73077e8d702"} Mar 16 16:22:53 crc kubenswrapper[5120]: I0316 16:22:53.443640 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"ea1fedf1-104c-49e0-88dd-1259b976439e","Type":"ContainerDied","Data":"f6b2bc436b440b75ed3d86b1cba9dc61b53eac42d607f570ab7fbd213de02ae7"} Mar 16 16:22:53 crc kubenswrapper[5120]: I0316 16:22:53.443729 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"ea1fedf1-104c-49e0-88dd-1259b976439e","Type":"ContainerDied","Data":"eabf4972bec0230e5b0d47539d093c66cfefa3555a0fa46eea812488e138c730"} Mar 16 16:22:53 crc kubenswrapper[5120]: I0316 16:22:53.444278 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podUID="52f78b0c-8c71-4e47-978b-840e0ca12c1c" containerName="nova-cell1-novncproxy-novncproxy" containerID="cri-o://44d0dacb34ea15c6e811251f71ff5ac8bd11c4cd7ed1ed20abb4d704503c48c2" gracePeriod=30 Mar 16 16:22:53 crc kubenswrapper[5120]: I0316 16:22:53.444526 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="209176a4-f078-44ac-9975-ff5ea6c6bc03" containerName="nova-metadata-log" containerID="cri-o://a4851b68a0355ad02802780f04fe1de2b7c6c2607c522d488dc5c54f0175e556" gracePeriod=30 Mar 16 16:22:53 crc kubenswrapper[5120]: I0316 16:22:53.444802 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="209176a4-f078-44ac-9975-ff5ea6c6bc03" containerName="nova-metadata-metadata" containerID="cri-o://6d3b6f112c006ecba99109c2949a38d06f07e9ad36eb88f6b4b4938aa775a5cd" gracePeriod=30 Mar 16 16:22:53 crc kubenswrapper[5120]: I0316 16:22:53.512266 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:22:53 crc kubenswrapper[5120]: I0316 16:22:53.522709 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:22:53 crc kubenswrapper[5120]: I0316 16:22:53.533405 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:22:53 crc kubenswrapper[5120]: I0316 16:22:53.544208 5120 scope.go:117] "RemoveContainer" containerID="984f88b739b18155a72b1ba981d48b7bb9c1dafa30b19e9a0f4cd73077e8d702" Mar 16 16:22:53 crc kubenswrapper[5120]: I0316 16:22:53.547511 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:22:53 crc kubenswrapper[5120]: I0316 16:22:53.557908 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:22:53 crc kubenswrapper[5120]: I0316 16:22:53.559329 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea1fedf1-104c-49e0-88dd-1259b976439e" containerName="nova-api-log" Mar 16 16:22:53 crc kubenswrapper[5120]: I0316 16:22:53.559357 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea1fedf1-104c-49e0-88dd-1259b976439e" containerName="nova-api-log" Mar 16 16:22:53 crc kubenswrapper[5120]: I0316 16:22:53.559385 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d99dd334-98f5-49f4-b6e5-3f644f6310d3" containerName="nova-scheduler-scheduler" Mar 16 16:22:53 crc kubenswrapper[5120]: I0316 16:22:53.559393 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="d99dd334-98f5-49f4-b6e5-3f644f6310d3" containerName="nova-scheduler-scheduler" Mar 16 16:22:53 crc kubenswrapper[5120]: I0316 16:22:53.559448 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d99dd334-98f5-49f4-b6e5-3f644f6310d3" containerName="nova-scheduler-scheduler" Mar 16 16:22:53 crc kubenswrapper[5120]: I0316 16:22:53.559456 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="d99dd334-98f5-49f4-b6e5-3f644f6310d3" containerName="nova-scheduler-scheduler" Mar 16 16:22:53 crc kubenswrapper[5120]: I0316 16:22:53.559475 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea1fedf1-104c-49e0-88dd-1259b976439e" containerName="nova-api-api" Mar 16 16:22:53 crc kubenswrapper[5120]: I0316 16:22:53.559482 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea1fedf1-104c-49e0-88dd-1259b976439e" containerName="nova-api-api" Mar 16 16:22:53 crc kubenswrapper[5120]: I0316 16:22:53.559690 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="d99dd334-98f5-49f4-b6e5-3f644f6310d3" containerName="nova-scheduler-scheduler" Mar 16 16:22:53 crc kubenswrapper[5120]: I0316 16:22:53.559706 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ea1fedf1-104c-49e0-88dd-1259b976439e" containerName="nova-api-api" Mar 16 16:22:53 crc kubenswrapper[5120]: I0316 16:22:53.559747 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ea1fedf1-104c-49e0-88dd-1259b976439e" containerName="nova-api-log" Mar 16 16:22:53 crc kubenswrapper[5120]: I0316 16:22:53.559829 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="d99dd334-98f5-49f4-b6e5-3f644f6310d3" containerName="nova-scheduler-scheduler" Mar 16 16:22:53 crc kubenswrapper[5120]: I0316 16:22:53.591267 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:22:53 crc kubenswrapper[5120]: I0316 16:22:53.591437 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:22:53 crc kubenswrapper[5120]: I0316 16:22:53.596541 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:22:53 crc kubenswrapper[5120]: I0316 16:22:53.608211 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-config-data\"" Mar 16 16:22:53 crc kubenswrapper[5120]: I0316 16:22:53.632213 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:22:53 crc kubenswrapper[5120]: I0316 16:22:53.635259 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-scheduler-config-data\"" Mar 16 16:22:53 crc kubenswrapper[5120]: I0316 16:22:53.644963 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:22:53 crc kubenswrapper[5120]: I0316 16:22:53.657395 5120 scope.go:117] "RemoveContainer" containerID="f6b2bc436b440b75ed3d86b1cba9dc61b53eac42d607f570ab7fbd213de02ae7" Mar 16 16:22:53 crc kubenswrapper[5120]: I0316 16:22:53.718917 5120 scope.go:117] "RemoveContainer" containerID="984f88b739b18155a72b1ba981d48b7bb9c1dafa30b19e9a0f4cd73077e8d702" Mar 16 16:22:53 crc kubenswrapper[5120]: E0316 16:22:53.719545 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"984f88b739b18155a72b1ba981d48b7bb9c1dafa30b19e9a0f4cd73077e8d702\": container with ID starting with 984f88b739b18155a72b1ba981d48b7bb9c1dafa30b19e9a0f4cd73077e8d702 not found: ID does not exist" containerID="984f88b739b18155a72b1ba981d48b7bb9c1dafa30b19e9a0f4cd73077e8d702" Mar 16 16:22:53 crc kubenswrapper[5120]: I0316 16:22:53.719603 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"984f88b739b18155a72b1ba981d48b7bb9c1dafa30b19e9a0f4cd73077e8d702"} err="failed to get container status \"984f88b739b18155a72b1ba981d48b7bb9c1dafa30b19e9a0f4cd73077e8d702\": rpc error: code = NotFound desc = could not find container \"984f88b739b18155a72b1ba981d48b7bb9c1dafa30b19e9a0f4cd73077e8d702\": container with ID starting with 984f88b739b18155a72b1ba981d48b7bb9c1dafa30b19e9a0f4cd73077e8d702 not found: ID does not exist" Mar 16 16:22:53 crc kubenswrapper[5120]: I0316 16:22:53.719622 5120 scope.go:117] "RemoveContainer" containerID="f6b2bc436b440b75ed3d86b1cba9dc61b53eac42d607f570ab7fbd213de02ae7" Mar 16 16:22:53 crc kubenswrapper[5120]: E0316 16:22:53.719917 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f6b2bc436b440b75ed3d86b1cba9dc61b53eac42d607f570ab7fbd213de02ae7\": container with ID starting with f6b2bc436b440b75ed3d86b1cba9dc61b53eac42d607f570ab7fbd213de02ae7 not found: ID does not exist" containerID="f6b2bc436b440b75ed3d86b1cba9dc61b53eac42d607f570ab7fbd213de02ae7" Mar 16 16:22:53 crc kubenswrapper[5120]: I0316 16:22:53.719954 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6b2bc436b440b75ed3d86b1cba9dc61b53eac42d607f570ab7fbd213de02ae7"} err="failed to get container status \"f6b2bc436b440b75ed3d86b1cba9dc61b53eac42d607f570ab7fbd213de02ae7\": rpc error: code = NotFound desc = could not find container \"f6b2bc436b440b75ed3d86b1cba9dc61b53eac42d607f570ab7fbd213de02ae7\": container with ID starting with f6b2bc436b440b75ed3d86b1cba9dc61b53eac42d607f570ab7fbd213de02ae7 not found: ID does not exist" Mar 16 16:22:53 crc kubenswrapper[5120]: I0316 16:22:53.719976 5120 scope.go:117] "RemoveContainer" containerID="984f88b739b18155a72b1ba981d48b7bb9c1dafa30b19e9a0f4cd73077e8d702" Mar 16 16:22:53 crc kubenswrapper[5120]: I0316 16:22:53.720223 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtpdb\" (UniqueName: \"kubernetes.io/projected/0e8671c6-1540-4375-8eb9-222bbcab34d8-kube-api-access-dtpdb\") pod \"nova-api-0\" (UID: \"0e8671c6-1540-4375-8eb9-222bbcab34d8\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:22:53 crc kubenswrapper[5120]: I0316 16:22:53.720291 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkd5d\" (UniqueName: \"kubernetes.io/projected/e6f79b5a-7ec0-4175-be98-73239396dd90-kube-api-access-pkd5d\") pod \"nova-scheduler-0\" (UID: \"e6f79b5a-7ec0-4175-be98-73239396dd90\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:22:53 crc kubenswrapper[5120]: I0316 16:22:53.720346 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0e8671c6-1540-4375-8eb9-222bbcab34d8-config-data\") pod \"nova-api-0\" (UID: \"0e8671c6-1540-4375-8eb9-222bbcab34d8\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:22:53 crc kubenswrapper[5120]: I0316 16:22:53.720369 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e6f79b5a-7ec0-4175-be98-73239396dd90-config-data\") pod \"nova-scheduler-0\" (UID: \"e6f79b5a-7ec0-4175-be98-73239396dd90\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:22:53 crc kubenswrapper[5120]: I0316 16:22:53.720471 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0e8671c6-1540-4375-8eb9-222bbcab34d8-logs\") pod \"nova-api-0\" (UID: \"0e8671c6-1540-4375-8eb9-222bbcab34d8\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:22:53 crc kubenswrapper[5120]: I0316 16:22:53.720509 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e6f79b5a-7ec0-4175-be98-73239396dd90-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"e6f79b5a-7ec0-4175-be98-73239396dd90\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:22:53 crc kubenswrapper[5120]: I0316 16:22:53.720546 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0e8671c6-1540-4375-8eb9-222bbcab34d8-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"0e8671c6-1540-4375-8eb9-222bbcab34d8\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:22:53 crc kubenswrapper[5120]: I0316 16:22:53.721064 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"984f88b739b18155a72b1ba981d48b7bb9c1dafa30b19e9a0f4cd73077e8d702"} err="failed to get container status \"984f88b739b18155a72b1ba981d48b7bb9c1dafa30b19e9a0f4cd73077e8d702\": rpc error: code = NotFound desc = could not find container \"984f88b739b18155a72b1ba981d48b7bb9c1dafa30b19e9a0f4cd73077e8d702\": container with ID starting with 984f88b739b18155a72b1ba981d48b7bb9c1dafa30b19e9a0f4cd73077e8d702 not found: ID does not exist" Mar 16 16:22:53 crc kubenswrapper[5120]: I0316 16:22:53.721089 5120 scope.go:117] "RemoveContainer" containerID="f6b2bc436b440b75ed3d86b1cba9dc61b53eac42d607f570ab7fbd213de02ae7" Mar 16 16:22:53 crc kubenswrapper[5120]: I0316 16:22:53.721301 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6b2bc436b440b75ed3d86b1cba9dc61b53eac42d607f570ab7fbd213de02ae7"} err="failed to get container status \"f6b2bc436b440b75ed3d86b1cba9dc61b53eac42d607f570ab7fbd213de02ae7\": rpc error: code = NotFound desc = could not find container \"f6b2bc436b440b75ed3d86b1cba9dc61b53eac42d607f570ab7fbd213de02ae7\": container with ID starting with f6b2bc436b440b75ed3d86b1cba9dc61b53eac42d607f570ab7fbd213de02ae7 not found: ID does not exist" Mar 16 16:22:53 crc kubenswrapper[5120]: I0316 16:22:53.823648 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0e8671c6-1540-4375-8eb9-222bbcab34d8-logs\") pod \"nova-api-0\" (UID: \"0e8671c6-1540-4375-8eb9-222bbcab34d8\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:22:53 crc kubenswrapper[5120]: I0316 16:22:53.823754 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e6f79b5a-7ec0-4175-be98-73239396dd90-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"e6f79b5a-7ec0-4175-be98-73239396dd90\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:22:53 crc kubenswrapper[5120]: I0316 16:22:53.823832 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0e8671c6-1540-4375-8eb9-222bbcab34d8-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"0e8671c6-1540-4375-8eb9-222bbcab34d8\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:22:53 crc kubenswrapper[5120]: I0316 16:22:53.824001 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dtpdb\" (UniqueName: \"kubernetes.io/projected/0e8671c6-1540-4375-8eb9-222bbcab34d8-kube-api-access-dtpdb\") pod \"nova-api-0\" (UID: \"0e8671c6-1540-4375-8eb9-222bbcab34d8\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:22:53 crc kubenswrapper[5120]: I0316 16:22:53.824090 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pkd5d\" (UniqueName: \"kubernetes.io/projected/e6f79b5a-7ec0-4175-be98-73239396dd90-kube-api-access-pkd5d\") pod \"nova-scheduler-0\" (UID: \"e6f79b5a-7ec0-4175-be98-73239396dd90\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:22:53 crc kubenswrapper[5120]: I0316 16:22:53.824182 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0e8671c6-1540-4375-8eb9-222bbcab34d8-config-data\") pod \"nova-api-0\" (UID: \"0e8671c6-1540-4375-8eb9-222bbcab34d8\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:22:53 crc kubenswrapper[5120]: I0316 16:22:53.824225 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e6f79b5a-7ec0-4175-be98-73239396dd90-config-data\") pod \"nova-scheduler-0\" (UID: \"e6f79b5a-7ec0-4175-be98-73239396dd90\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:22:53 crc kubenswrapper[5120]: I0316 16:22:53.826016 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0e8671c6-1540-4375-8eb9-222bbcab34d8-logs\") pod \"nova-api-0\" (UID: \"0e8671c6-1540-4375-8eb9-222bbcab34d8\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:22:53 crc kubenswrapper[5120]: I0316 16:22:53.830591 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e6f79b5a-7ec0-4175-be98-73239396dd90-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"e6f79b5a-7ec0-4175-be98-73239396dd90\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:22:53 crc kubenswrapper[5120]: I0316 16:22:53.834272 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0e8671c6-1540-4375-8eb9-222bbcab34d8-config-data\") pod \"nova-api-0\" (UID: \"0e8671c6-1540-4375-8eb9-222bbcab34d8\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:22:53 crc kubenswrapper[5120]: I0316 16:22:53.834808 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0e8671c6-1540-4375-8eb9-222bbcab34d8-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"0e8671c6-1540-4375-8eb9-222bbcab34d8\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:22:53 crc kubenswrapper[5120]: I0316 16:22:53.844389 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e6f79b5a-7ec0-4175-be98-73239396dd90-config-data\") pod \"nova-scheduler-0\" (UID: \"e6f79b5a-7ec0-4175-be98-73239396dd90\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:22:53 crc kubenswrapper[5120]: I0316 16:22:53.847205 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtpdb\" (UniqueName: \"kubernetes.io/projected/0e8671c6-1540-4375-8eb9-222bbcab34d8-kube-api-access-dtpdb\") pod \"nova-api-0\" (UID: \"0e8671c6-1540-4375-8eb9-222bbcab34d8\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:22:53 crc kubenswrapper[5120]: I0316 16:22:53.851573 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkd5d\" (UniqueName: \"kubernetes.io/projected/e6f79b5a-7ec0-4175-be98-73239396dd90-kube-api-access-pkd5d\") pod \"nova-scheduler-0\" (UID: \"e6f79b5a-7ec0-4175-be98-73239396dd90\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:22:53 crc kubenswrapper[5120]: I0316 16:22:53.959917 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:22:53 crc kubenswrapper[5120]: I0316 16:22:53.998922 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:22:54 crc kubenswrapper[5120]: I0316 16:22:54.028271 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ncp8f\" (UniqueName: \"kubernetes.io/projected/209176a4-f078-44ac-9975-ff5ea6c6bc03-kube-api-access-ncp8f\") pod \"209176a4-f078-44ac-9975-ff5ea6c6bc03\" (UID: \"209176a4-f078-44ac-9975-ff5ea6c6bc03\") " Mar 16 16:22:54 crc kubenswrapper[5120]: I0316 16:22:54.028441 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/209176a4-f078-44ac-9975-ff5ea6c6bc03-nova-metadata-tls-certs\") pod \"209176a4-f078-44ac-9975-ff5ea6c6bc03\" (UID: \"209176a4-f078-44ac-9975-ff5ea6c6bc03\") " Mar 16 16:22:54 crc kubenswrapper[5120]: I0316 16:22:54.028526 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/209176a4-f078-44ac-9975-ff5ea6c6bc03-logs\") pod \"209176a4-f078-44ac-9975-ff5ea6c6bc03\" (UID: \"209176a4-f078-44ac-9975-ff5ea6c6bc03\") " Mar 16 16:22:54 crc kubenswrapper[5120]: I0316 16:22:54.028890 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/209176a4-f078-44ac-9975-ff5ea6c6bc03-logs" (OuterVolumeSpecName: "logs") pod "209176a4-f078-44ac-9975-ff5ea6c6bc03" (UID: "209176a4-f078-44ac-9975-ff5ea6c6bc03"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:22:54 crc kubenswrapper[5120]: I0316 16:22:54.030192 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/209176a4-f078-44ac-9975-ff5ea6c6bc03-combined-ca-bundle\") pod \"209176a4-f078-44ac-9975-ff5ea6c6bc03\" (UID: \"209176a4-f078-44ac-9975-ff5ea6c6bc03\") " Mar 16 16:22:54 crc kubenswrapper[5120]: I0316 16:22:54.030516 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:22:54 crc kubenswrapper[5120]: I0316 16:22:54.030691 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/209176a4-f078-44ac-9975-ff5ea6c6bc03-config-data\") pod \"209176a4-f078-44ac-9975-ff5ea6c6bc03\" (UID: \"209176a4-f078-44ac-9975-ff5ea6c6bc03\") " Mar 16 16:22:54 crc kubenswrapper[5120]: I0316 16:22:54.031375 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/209176a4-f078-44ac-9975-ff5ea6c6bc03-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:22:54 crc kubenswrapper[5120]: I0316 16:22:54.036256 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/209176a4-f078-44ac-9975-ff5ea6c6bc03-kube-api-access-ncp8f" (OuterVolumeSpecName: "kube-api-access-ncp8f") pod "209176a4-f078-44ac-9975-ff5ea6c6bc03" (UID: "209176a4-f078-44ac-9975-ff5ea6c6bc03"). InnerVolumeSpecName "kube-api-access-ncp8f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:22:54 crc kubenswrapper[5120]: I0316 16:22:54.054886 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/209176a4-f078-44ac-9975-ff5ea6c6bc03-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "209176a4-f078-44ac-9975-ff5ea6c6bc03" (UID: "209176a4-f078-44ac-9975-ff5ea6c6bc03"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:22:54 crc kubenswrapper[5120]: I0316 16:22:54.084674 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/209176a4-f078-44ac-9975-ff5ea6c6bc03-nova-metadata-tls-certs" (OuterVolumeSpecName: "nova-metadata-tls-certs") pod "209176a4-f078-44ac-9975-ff5ea6c6bc03" (UID: "209176a4-f078-44ac-9975-ff5ea6c6bc03"). InnerVolumeSpecName "nova-metadata-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:22:54 crc kubenswrapper[5120]: I0316 16:22:54.089956 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/209176a4-f078-44ac-9975-ff5ea6c6bc03-config-data" (OuterVolumeSpecName: "config-data") pod "209176a4-f078-44ac-9975-ff5ea6c6bc03" (UID: "209176a4-f078-44ac-9975-ff5ea6c6bc03"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:22:54 crc kubenswrapper[5120]: I0316 16:22:54.136582 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/209176a4-f078-44ac-9975-ff5ea6c6bc03-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:22:54 crc kubenswrapper[5120]: I0316 16:22:54.136621 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/209176a4-f078-44ac-9975-ff5ea6c6bc03-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:22:54 crc kubenswrapper[5120]: I0316 16:22:54.136635 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ncp8f\" (UniqueName: \"kubernetes.io/projected/209176a4-f078-44ac-9975-ff5ea6c6bc03-kube-api-access-ncp8f\") on node \"crc\" DevicePath \"\"" Mar 16 16:22:54 crc kubenswrapper[5120]: I0316 16:22:54.136651 5120 reconciler_common.go:299] "Volume detached for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/209176a4-f078-44ac-9975-ff5ea6c6bc03-nova-metadata-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:22:54 crc kubenswrapper[5120]: I0316 16:22:54.399198 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:22:54 crc kubenswrapper[5120]: I0316 16:22:54.454507 5120 generic.go:358] "Generic (PLEG): container finished" podID="209176a4-f078-44ac-9975-ff5ea6c6bc03" containerID="6d3b6f112c006ecba99109c2949a38d06f07e9ad36eb88f6b4b4938aa775a5cd" exitCode=0 Mar 16 16:22:54 crc kubenswrapper[5120]: I0316 16:22:54.455918 5120 generic.go:358] "Generic (PLEG): container finished" podID="209176a4-f078-44ac-9975-ff5ea6c6bc03" containerID="a4851b68a0355ad02802780f04fe1de2b7c6c2607c522d488dc5c54f0175e556" exitCode=143 Mar 16 16:22:54 crc kubenswrapper[5120]: I0316 16:22:54.454597 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"209176a4-f078-44ac-9975-ff5ea6c6bc03","Type":"ContainerDied","Data":"6d3b6f112c006ecba99109c2949a38d06f07e9ad36eb88f6b4b4938aa775a5cd"} Mar 16 16:22:54 crc kubenswrapper[5120]: I0316 16:22:54.454562 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:22:54 crc kubenswrapper[5120]: I0316 16:22:54.456407 5120 scope.go:117] "RemoveContainer" containerID="6d3b6f112c006ecba99109c2949a38d06f07e9ad36eb88f6b4b4938aa775a5cd" Mar 16 16:22:54 crc kubenswrapper[5120]: I0316 16:22:54.464704 5120 generic.go:358] "Generic (PLEG): container finished" podID="52f78b0c-8c71-4e47-978b-840e0ca12c1c" containerID="44d0dacb34ea15c6e811251f71ff5ac8bd11c4cd7ed1ed20abb4d704503c48c2" exitCode=0 Mar 16 16:22:54 crc kubenswrapper[5120]: I0316 16:22:54.464851 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:22:54 crc kubenswrapper[5120]: I0316 16:22:54.456285 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"209176a4-f078-44ac-9975-ff5ea6c6bc03","Type":"ContainerDied","Data":"a4851b68a0355ad02802780f04fe1de2b7c6c2607c522d488dc5c54f0175e556"} Mar 16 16:22:54 crc kubenswrapper[5120]: I0316 16:22:54.468157 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"209176a4-f078-44ac-9975-ff5ea6c6bc03","Type":"ContainerDied","Data":"8cc8546fadc231c444cbeb5a9d5b8e1129b32f28d9bc9de392693d2114c2f2cf"} Mar 16 16:22:54 crc kubenswrapper[5120]: I0316 16:22:54.468179 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"52f78b0c-8c71-4e47-978b-840e0ca12c1c","Type":"ContainerDied","Data":"44d0dacb34ea15c6e811251f71ff5ac8bd11c4cd7ed1ed20abb4d704503c48c2"} Mar 16 16:22:54 crc kubenswrapper[5120]: I0316 16:22:54.468194 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"52f78b0c-8c71-4e47-978b-840e0ca12c1c","Type":"ContainerDied","Data":"7ee4c212fb05f23f3de8f4157cd469b4a721b5fd3570d08d09ac210211e73485"} Mar 16 16:22:54 crc kubenswrapper[5120]: I0316 16:22:54.506737 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:22:54 crc kubenswrapper[5120]: I0316 16:22:54.514471 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:22:54 crc kubenswrapper[5120]: I0316 16:22:54.528319 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:22:54 crc kubenswrapper[5120]: I0316 16:22:54.529377 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="209176a4-f078-44ac-9975-ff5ea6c6bc03" containerName="nova-metadata-log" Mar 16 16:22:54 crc kubenswrapper[5120]: I0316 16:22:54.529396 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="209176a4-f078-44ac-9975-ff5ea6c6bc03" containerName="nova-metadata-log" Mar 16 16:22:54 crc kubenswrapper[5120]: I0316 16:22:54.529406 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="209176a4-f078-44ac-9975-ff5ea6c6bc03" containerName="nova-metadata-metadata" Mar 16 16:22:54 crc kubenswrapper[5120]: I0316 16:22:54.529412 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="209176a4-f078-44ac-9975-ff5ea6c6bc03" containerName="nova-metadata-metadata" Mar 16 16:22:54 crc kubenswrapper[5120]: I0316 16:22:54.529448 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52f78b0c-8c71-4e47-978b-840e0ca12c1c" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 16:22:54 crc kubenswrapper[5120]: I0316 16:22:54.529454 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="52f78b0c-8c71-4e47-978b-840e0ca12c1c" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 16:22:54 crc kubenswrapper[5120]: I0316 16:22:54.529700 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="209176a4-f078-44ac-9975-ff5ea6c6bc03" containerName="nova-metadata-metadata" Mar 16 16:22:54 crc kubenswrapper[5120]: I0316 16:22:54.529723 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="52f78b0c-8c71-4e47-978b-840e0ca12c1c" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 16:22:54 crc kubenswrapper[5120]: I0316 16:22:54.529733 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="209176a4-f078-44ac-9975-ff5ea6c6bc03" containerName="nova-metadata-log" Mar 16 16:22:54 crc kubenswrapper[5120]: I0316 16:22:54.532910 5120 scope.go:117] "RemoveContainer" containerID="a4851b68a0355ad02802780f04fe1de2b7c6c2607c522d488dc5c54f0175e556" Mar 16 16:22:54 crc kubenswrapper[5120]: I0316 16:22:54.535376 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:22:54 crc kubenswrapper[5120]: I0316 16:22:54.537745 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-metadata-internal-svc\"" Mar 16 16:22:54 crc kubenswrapper[5120]: I0316 16:22:54.538330 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-metadata-config-data\"" Mar 16 16:22:54 crc kubenswrapper[5120]: I0316 16:22:54.543821 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/52f78b0c-8c71-4e47-978b-840e0ca12c1c-combined-ca-bundle\") pod \"52f78b0c-8c71-4e47-978b-840e0ca12c1c\" (UID: \"52f78b0c-8c71-4e47-978b-840e0ca12c1c\") " Mar 16 16:22:54 crc kubenswrapper[5120]: I0316 16:22:54.543944 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/52f78b0c-8c71-4e47-978b-840e0ca12c1c-nova-novncproxy-tls-certs\") pod \"52f78b0c-8c71-4e47-978b-840e0ca12c1c\" (UID: \"52f78b0c-8c71-4e47-978b-840e0ca12c1c\") " Mar 16 16:22:54 crc kubenswrapper[5120]: I0316 16:22:54.544125 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/52f78b0c-8c71-4e47-978b-840e0ca12c1c-vencrypt-tls-certs\") pod \"52f78b0c-8c71-4e47-978b-840e0ca12c1c\" (UID: \"52f78b0c-8c71-4e47-978b-840e0ca12c1c\") " Mar 16 16:22:54 crc kubenswrapper[5120]: I0316 16:22:54.544154 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j2rmh\" (UniqueName: \"kubernetes.io/projected/52f78b0c-8c71-4e47-978b-840e0ca12c1c-kube-api-access-j2rmh\") pod \"52f78b0c-8c71-4e47-978b-840e0ca12c1c\" (UID: \"52f78b0c-8c71-4e47-978b-840e0ca12c1c\") " Mar 16 16:22:54 crc kubenswrapper[5120]: I0316 16:22:54.544172 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/52f78b0c-8c71-4e47-978b-840e0ca12c1c-config-data\") pod \"52f78b0c-8c71-4e47-978b-840e0ca12c1c\" (UID: \"52f78b0c-8c71-4e47-978b-840e0ca12c1c\") " Mar 16 16:22:54 crc kubenswrapper[5120]: I0316 16:22:54.551434 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:22:54 crc kubenswrapper[5120]: I0316 16:22:54.557344 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/52f78b0c-8c71-4e47-978b-840e0ca12c1c-kube-api-access-j2rmh" (OuterVolumeSpecName: "kube-api-access-j2rmh") pod "52f78b0c-8c71-4e47-978b-840e0ca12c1c" (UID: "52f78b0c-8c71-4e47-978b-840e0ca12c1c"). InnerVolumeSpecName "kube-api-access-j2rmh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:22:54 crc kubenswrapper[5120]: I0316 16:22:54.601269 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/52f78b0c-8c71-4e47-978b-840e0ca12c1c-config-data" (OuterVolumeSpecName: "config-data") pod "52f78b0c-8c71-4e47-978b-840e0ca12c1c" (UID: "52f78b0c-8c71-4e47-978b-840e0ca12c1c"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:22:54 crc kubenswrapper[5120]: I0316 16:22:54.610054 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:22:54 crc kubenswrapper[5120]: I0316 16:22:54.617918 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:22:54 crc kubenswrapper[5120]: I0316 16:22:54.620178 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/52f78b0c-8c71-4e47-978b-840e0ca12c1c-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "52f78b0c-8c71-4e47-978b-840e0ca12c1c" (UID: "52f78b0c-8c71-4e47-978b-840e0ca12c1c"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:22:54 crc kubenswrapper[5120]: I0316 16:22:54.632838 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/52f78b0c-8c71-4e47-978b-840e0ca12c1c-vencrypt-tls-certs" (OuterVolumeSpecName: "vencrypt-tls-certs") pod "52f78b0c-8c71-4e47-978b-840e0ca12c1c" (UID: "52f78b0c-8c71-4e47-978b-840e0ca12c1c"). InnerVolumeSpecName "vencrypt-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:22:54 crc kubenswrapper[5120]: I0316 16:22:54.639000 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/52f78b0c-8c71-4e47-978b-840e0ca12c1c-nova-novncproxy-tls-certs" (OuterVolumeSpecName: "nova-novncproxy-tls-certs") pod "52f78b0c-8c71-4e47-978b-840e0ca12c1c" (UID: "52f78b0c-8c71-4e47-978b-840e0ca12c1c"). InnerVolumeSpecName "nova-novncproxy-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:22:54 crc kubenswrapper[5120]: I0316 16:22:54.652569 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/01b7a18f-9ea0-4145-bf98-1950d5913c20-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"01b7a18f-9ea0-4145-bf98-1950d5913c20\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:22:54 crc kubenswrapper[5120]: I0316 16:22:54.652682 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/01b7a18f-9ea0-4145-bf98-1950d5913c20-config-data\") pod \"nova-metadata-0\" (UID: \"01b7a18f-9ea0-4145-bf98-1950d5913c20\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:22:54 crc kubenswrapper[5120]: I0316 16:22:54.652715 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/01b7a18f-9ea0-4145-bf98-1950d5913c20-logs\") pod \"nova-metadata-0\" (UID: \"01b7a18f-9ea0-4145-bf98-1950d5913c20\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:22:54 crc kubenswrapper[5120]: I0316 16:22:54.652800 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/01b7a18f-9ea0-4145-bf98-1950d5913c20-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"01b7a18f-9ea0-4145-bf98-1950d5913c20\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:22:54 crc kubenswrapper[5120]: I0316 16:22:54.652910 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sms2b\" (UniqueName: \"kubernetes.io/projected/01b7a18f-9ea0-4145-bf98-1950d5913c20-kube-api-access-sms2b\") pod \"nova-metadata-0\" (UID: \"01b7a18f-9ea0-4145-bf98-1950d5913c20\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:22:54 crc kubenswrapper[5120]: I0316 16:22:54.653095 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/52f78b0c-8c71-4e47-978b-840e0ca12c1c-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:22:54 crc kubenswrapper[5120]: I0316 16:22:54.653115 5120 reconciler_common.go:299] "Volume detached for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/52f78b0c-8c71-4e47-978b-840e0ca12c1c-nova-novncproxy-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:22:54 crc kubenswrapper[5120]: I0316 16:22:54.653130 5120 reconciler_common.go:299] "Volume detached for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/52f78b0c-8c71-4e47-978b-840e0ca12c1c-vencrypt-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:22:54 crc kubenswrapper[5120]: I0316 16:22:54.653143 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j2rmh\" (UniqueName: \"kubernetes.io/projected/52f78b0c-8c71-4e47-978b-840e0ca12c1c-kube-api-access-j2rmh\") on node \"crc\" DevicePath \"\"" Mar 16 16:22:54 crc kubenswrapper[5120]: I0316 16:22:54.653156 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/52f78b0c-8c71-4e47-978b-840e0ca12c1c-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:22:54 crc kubenswrapper[5120]: I0316 16:22:54.680005 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="209176a4-f078-44ac-9975-ff5ea6c6bc03" path="/var/lib/kubelet/pods/209176a4-f078-44ac-9975-ff5ea6c6bc03/volumes" Mar 16 16:22:54 crc kubenswrapper[5120]: I0316 16:22:54.680556 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d99dd334-98f5-49f4-b6e5-3f644f6310d3" path="/var/lib/kubelet/pods/d99dd334-98f5-49f4-b6e5-3f644f6310d3/volumes" Mar 16 16:22:54 crc kubenswrapper[5120]: I0316 16:22:54.681083 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ea1fedf1-104c-49e0-88dd-1259b976439e" path="/var/lib/kubelet/pods/ea1fedf1-104c-49e0-88dd-1259b976439e/volumes" Mar 16 16:22:54 crc kubenswrapper[5120]: I0316 16:22:54.755468 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sms2b\" (UniqueName: \"kubernetes.io/projected/01b7a18f-9ea0-4145-bf98-1950d5913c20-kube-api-access-sms2b\") pod \"nova-metadata-0\" (UID: \"01b7a18f-9ea0-4145-bf98-1950d5913c20\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:22:54 crc kubenswrapper[5120]: I0316 16:22:54.755869 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/01b7a18f-9ea0-4145-bf98-1950d5913c20-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"01b7a18f-9ea0-4145-bf98-1950d5913c20\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:22:54 crc kubenswrapper[5120]: I0316 16:22:54.756026 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/01b7a18f-9ea0-4145-bf98-1950d5913c20-config-data\") pod \"nova-metadata-0\" (UID: \"01b7a18f-9ea0-4145-bf98-1950d5913c20\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:22:54 crc kubenswrapper[5120]: I0316 16:22:54.756590 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/01b7a18f-9ea0-4145-bf98-1950d5913c20-logs\") pod \"nova-metadata-0\" (UID: \"01b7a18f-9ea0-4145-bf98-1950d5913c20\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:22:54 crc kubenswrapper[5120]: I0316 16:22:54.756910 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/01b7a18f-9ea0-4145-bf98-1950d5913c20-logs\") pod \"nova-metadata-0\" (UID: \"01b7a18f-9ea0-4145-bf98-1950d5913c20\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:22:54 crc kubenswrapper[5120]: I0316 16:22:54.757188 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/01b7a18f-9ea0-4145-bf98-1950d5913c20-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"01b7a18f-9ea0-4145-bf98-1950d5913c20\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:22:54 crc kubenswrapper[5120]: I0316 16:22:54.760440 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/01b7a18f-9ea0-4145-bf98-1950d5913c20-config-data\") pod \"nova-metadata-0\" (UID: \"01b7a18f-9ea0-4145-bf98-1950d5913c20\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:22:54 crc kubenswrapper[5120]: I0316 16:22:54.760678 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/01b7a18f-9ea0-4145-bf98-1950d5913c20-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"01b7a18f-9ea0-4145-bf98-1950d5913c20\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:22:54 crc kubenswrapper[5120]: I0316 16:22:54.761551 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/01b7a18f-9ea0-4145-bf98-1950d5913c20-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"01b7a18f-9ea0-4145-bf98-1950d5913c20\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:22:54 crc kubenswrapper[5120]: I0316 16:22:54.767956 5120 scope.go:117] "RemoveContainer" containerID="6d3b6f112c006ecba99109c2949a38d06f07e9ad36eb88f6b4b4938aa775a5cd" Mar 16 16:22:54 crc kubenswrapper[5120]: E0316 16:22:54.768586 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d3b6f112c006ecba99109c2949a38d06f07e9ad36eb88f6b4b4938aa775a5cd\": container with ID starting with 6d3b6f112c006ecba99109c2949a38d06f07e9ad36eb88f6b4b4938aa775a5cd not found: ID does not exist" containerID="6d3b6f112c006ecba99109c2949a38d06f07e9ad36eb88f6b4b4938aa775a5cd" Mar 16 16:22:54 crc kubenswrapper[5120]: I0316 16:22:54.768642 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d3b6f112c006ecba99109c2949a38d06f07e9ad36eb88f6b4b4938aa775a5cd"} err="failed to get container status \"6d3b6f112c006ecba99109c2949a38d06f07e9ad36eb88f6b4b4938aa775a5cd\": rpc error: code = NotFound desc = could not find container \"6d3b6f112c006ecba99109c2949a38d06f07e9ad36eb88f6b4b4938aa775a5cd\": container with ID starting with 6d3b6f112c006ecba99109c2949a38d06f07e9ad36eb88f6b4b4938aa775a5cd not found: ID does not exist" Mar 16 16:22:54 crc kubenswrapper[5120]: I0316 16:22:54.768662 5120 scope.go:117] "RemoveContainer" containerID="a4851b68a0355ad02802780f04fe1de2b7c6c2607c522d488dc5c54f0175e556" Mar 16 16:22:54 crc kubenswrapper[5120]: E0316 16:22:54.769347 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a4851b68a0355ad02802780f04fe1de2b7c6c2607c522d488dc5c54f0175e556\": container with ID starting with a4851b68a0355ad02802780f04fe1de2b7c6c2607c522d488dc5c54f0175e556 not found: ID does not exist" containerID="a4851b68a0355ad02802780f04fe1de2b7c6c2607c522d488dc5c54f0175e556" Mar 16 16:22:54 crc kubenswrapper[5120]: I0316 16:22:54.769389 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4851b68a0355ad02802780f04fe1de2b7c6c2607c522d488dc5c54f0175e556"} err="failed to get container status \"a4851b68a0355ad02802780f04fe1de2b7c6c2607c522d488dc5c54f0175e556\": rpc error: code = NotFound desc = could not find container \"a4851b68a0355ad02802780f04fe1de2b7c6c2607c522d488dc5c54f0175e556\": container with ID starting with a4851b68a0355ad02802780f04fe1de2b7c6c2607c522d488dc5c54f0175e556 not found: ID does not exist" Mar 16 16:22:54 crc kubenswrapper[5120]: I0316 16:22:54.769404 5120 scope.go:117] "RemoveContainer" containerID="6d3b6f112c006ecba99109c2949a38d06f07e9ad36eb88f6b4b4938aa775a5cd" Mar 16 16:22:54 crc kubenswrapper[5120]: I0316 16:22:54.769692 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d3b6f112c006ecba99109c2949a38d06f07e9ad36eb88f6b4b4938aa775a5cd"} err="failed to get container status \"6d3b6f112c006ecba99109c2949a38d06f07e9ad36eb88f6b4b4938aa775a5cd\": rpc error: code = NotFound desc = could not find container \"6d3b6f112c006ecba99109c2949a38d06f07e9ad36eb88f6b4b4938aa775a5cd\": container with ID starting with 6d3b6f112c006ecba99109c2949a38d06f07e9ad36eb88f6b4b4938aa775a5cd not found: ID does not exist" Mar 16 16:22:54 crc kubenswrapper[5120]: I0316 16:22:54.769713 5120 scope.go:117] "RemoveContainer" containerID="a4851b68a0355ad02802780f04fe1de2b7c6c2607c522d488dc5c54f0175e556" Mar 16 16:22:54 crc kubenswrapper[5120]: I0316 16:22:54.769987 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4851b68a0355ad02802780f04fe1de2b7c6c2607c522d488dc5c54f0175e556"} err="failed to get container status \"a4851b68a0355ad02802780f04fe1de2b7c6c2607c522d488dc5c54f0175e556\": rpc error: code = NotFound desc = could not find container \"a4851b68a0355ad02802780f04fe1de2b7c6c2607c522d488dc5c54f0175e556\": container with ID starting with a4851b68a0355ad02802780f04fe1de2b7c6c2607c522d488dc5c54f0175e556 not found: ID does not exist" Mar 16 16:22:54 crc kubenswrapper[5120]: I0316 16:22:54.770005 5120 scope.go:117] "RemoveContainer" containerID="44d0dacb34ea15c6e811251f71ff5ac8bd11c4cd7ed1ed20abb4d704503c48c2" Mar 16 16:22:54 crc kubenswrapper[5120]: I0316 16:22:54.772131 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sms2b\" (UniqueName: \"kubernetes.io/projected/01b7a18f-9ea0-4145-bf98-1950d5913c20-kube-api-access-sms2b\") pod \"nova-metadata-0\" (UID: \"01b7a18f-9ea0-4145-bf98-1950d5913c20\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:22:54 crc kubenswrapper[5120]: I0316 16:22:54.892196 5120 scope.go:117] "RemoveContainer" containerID="44d0dacb34ea15c6e811251f71ff5ac8bd11c4cd7ed1ed20abb4d704503c48c2" Mar 16 16:22:54 crc kubenswrapper[5120]: E0316 16:22:54.892647 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"44d0dacb34ea15c6e811251f71ff5ac8bd11c4cd7ed1ed20abb4d704503c48c2\": container with ID starting with 44d0dacb34ea15c6e811251f71ff5ac8bd11c4cd7ed1ed20abb4d704503c48c2 not found: ID does not exist" containerID="44d0dacb34ea15c6e811251f71ff5ac8bd11c4cd7ed1ed20abb4d704503c48c2" Mar 16 16:22:54 crc kubenswrapper[5120]: I0316 16:22:54.892676 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44d0dacb34ea15c6e811251f71ff5ac8bd11c4cd7ed1ed20abb4d704503c48c2"} err="failed to get container status \"44d0dacb34ea15c6e811251f71ff5ac8bd11c4cd7ed1ed20abb4d704503c48c2\": rpc error: code = NotFound desc = could not find container \"44d0dacb34ea15c6e811251f71ff5ac8bd11c4cd7ed1ed20abb4d704503c48c2\": container with ID starting with 44d0dacb34ea15c6e811251f71ff5ac8bd11c4cd7ed1ed20abb4d704503c48c2 not found: ID does not exist" Mar 16 16:22:54 crc kubenswrapper[5120]: I0316 16:22:54.908322 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-2bwpk" Mar 16 16:22:54 crc kubenswrapper[5120]: I0316 16:22:54.909628 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:22:54 crc kubenswrapper[5120]: I0316 16:22:54.930228 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:22:54 crc kubenswrapper[5120]: I0316 16:22:54.946035 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-j9pqb" Mar 16 16:22:54 crc kubenswrapper[5120]: I0316 16:22:54.955910 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:22:54 crc kubenswrapper[5120]: I0316 16:22:54.986805 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:22:54 crc kubenswrapper[5120]: I0316 16:22:54.987921 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1770402-bcb6-4c25-8079-130a3aaafcbb" containerName="nova-manage" Mar 16 16:22:54 crc kubenswrapper[5120]: I0316 16:22:54.987939 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1770402-bcb6-4c25-8079-130a3aaafcbb" containerName="nova-manage" Mar 16 16:22:54 crc kubenswrapper[5120]: I0316 16:22:54.987970 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5db65e99-b0fe-4cf7-975c-6452ca8dfa62" containerName="nova-cell1-conductor-db-sync" Mar 16 16:22:54 crc kubenswrapper[5120]: I0316 16:22:54.987977 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="5db65e99-b0fe-4cf7-975c-6452ca8dfa62" containerName="nova-cell1-conductor-db-sync" Mar 16 16:22:54 crc kubenswrapper[5120]: I0316 16:22:54.988156 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="5db65e99-b0fe-4cf7-975c-6452ca8dfa62" containerName="nova-cell1-conductor-db-sync" Mar 16 16:22:54 crc kubenswrapper[5120]: I0316 16:22:54.988184 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="a1770402-bcb6-4c25-8079-130a3aaafcbb" containerName="nova-manage" Mar 16 16:22:54 crc kubenswrapper[5120]: I0316 16:22:54.996339 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:22:54 crc kubenswrapper[5120]: I0316 16:22:54.998614 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-novncproxy-cell1-vencrypt\"" Mar 16 16:22:54 crc kubenswrapper[5120]: I0316 16:22:54.999003 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-novncproxy-cell1-public-svc\"" Mar 16 16:22:55 crc kubenswrapper[5120]: I0316 16:22:55.000248 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-novncproxy-config-data\"" Mar 16 16:22:55 crc kubenswrapper[5120]: I0316 16:22:55.015434 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:22:55 crc kubenswrapper[5120]: I0316 16:22:55.081419 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5db65e99-b0fe-4cf7-975c-6452ca8dfa62-combined-ca-bundle\") pod \"5db65e99-b0fe-4cf7-975c-6452ca8dfa62\" (UID: \"5db65e99-b0fe-4cf7-975c-6452ca8dfa62\") " Mar 16 16:22:55 crc kubenswrapper[5120]: I0316 16:22:55.081554 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kdt4f\" (UniqueName: \"kubernetes.io/projected/a1770402-bcb6-4c25-8079-130a3aaafcbb-kube-api-access-kdt4f\") pod \"a1770402-bcb6-4c25-8079-130a3aaafcbb\" (UID: \"a1770402-bcb6-4c25-8079-130a3aaafcbb\") " Mar 16 16:22:55 crc kubenswrapper[5120]: I0316 16:22:55.081577 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a1770402-bcb6-4c25-8079-130a3aaafcbb-config-data\") pod \"a1770402-bcb6-4c25-8079-130a3aaafcbb\" (UID: \"a1770402-bcb6-4c25-8079-130a3aaafcbb\") " Mar 16 16:22:55 crc kubenswrapper[5120]: I0316 16:22:55.081737 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a1770402-bcb6-4c25-8079-130a3aaafcbb-combined-ca-bundle\") pod \"a1770402-bcb6-4c25-8079-130a3aaafcbb\" (UID: \"a1770402-bcb6-4c25-8079-130a3aaafcbb\") " Mar 16 16:22:55 crc kubenswrapper[5120]: I0316 16:22:55.081874 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5db65e99-b0fe-4cf7-975c-6452ca8dfa62-scripts\") pod \"5db65e99-b0fe-4cf7-975c-6452ca8dfa62\" (UID: \"5db65e99-b0fe-4cf7-975c-6452ca8dfa62\") " Mar 16 16:22:55 crc kubenswrapper[5120]: I0316 16:22:55.081942 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a1770402-bcb6-4c25-8079-130a3aaafcbb-scripts\") pod \"a1770402-bcb6-4c25-8079-130a3aaafcbb\" (UID: \"a1770402-bcb6-4c25-8079-130a3aaafcbb\") " Mar 16 16:22:55 crc kubenswrapper[5120]: I0316 16:22:55.081961 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xfvqx\" (UniqueName: \"kubernetes.io/projected/5db65e99-b0fe-4cf7-975c-6452ca8dfa62-kube-api-access-xfvqx\") pod \"5db65e99-b0fe-4cf7-975c-6452ca8dfa62\" (UID: \"5db65e99-b0fe-4cf7-975c-6452ca8dfa62\") " Mar 16 16:22:55 crc kubenswrapper[5120]: I0316 16:22:55.082082 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5db65e99-b0fe-4cf7-975c-6452ca8dfa62-config-data\") pod \"5db65e99-b0fe-4cf7-975c-6452ca8dfa62\" (UID: \"5db65e99-b0fe-4cf7-975c-6452ca8dfa62\") " Mar 16 16:22:55 crc kubenswrapper[5120]: I0316 16:22:55.082216 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f90be6a3-f863-476d-b78b-95b9d069037e-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"f90be6a3-f863-476d-b78b-95b9d069037e\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:22:55 crc kubenswrapper[5120]: I0316 16:22:55.082472 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/f90be6a3-f863-476d-b78b-95b9d069037e-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"f90be6a3-f863-476d-b78b-95b9d069037e\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:22:55 crc kubenswrapper[5120]: I0316 16:22:55.082557 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qs4cs\" (UniqueName: \"kubernetes.io/projected/f90be6a3-f863-476d-b78b-95b9d069037e-kube-api-access-qs4cs\") pod \"nova-cell1-novncproxy-0\" (UID: \"f90be6a3-f863-476d-b78b-95b9d069037e\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:22:55 crc kubenswrapper[5120]: I0316 16:22:55.084521 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f90be6a3-f863-476d-b78b-95b9d069037e-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"f90be6a3-f863-476d-b78b-95b9d069037e\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:22:55 crc kubenswrapper[5120]: I0316 16:22:55.084548 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/f90be6a3-f863-476d-b78b-95b9d069037e-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"f90be6a3-f863-476d-b78b-95b9d069037e\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:22:55 crc kubenswrapper[5120]: I0316 16:22:55.087188 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1770402-bcb6-4c25-8079-130a3aaafcbb-kube-api-access-kdt4f" (OuterVolumeSpecName: "kube-api-access-kdt4f") pod "a1770402-bcb6-4c25-8079-130a3aaafcbb" (UID: "a1770402-bcb6-4c25-8079-130a3aaafcbb"). InnerVolumeSpecName "kube-api-access-kdt4f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:22:55 crc kubenswrapper[5120]: I0316 16:22:55.093047 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a1770402-bcb6-4c25-8079-130a3aaafcbb-scripts" (OuterVolumeSpecName: "scripts") pod "a1770402-bcb6-4c25-8079-130a3aaafcbb" (UID: "a1770402-bcb6-4c25-8079-130a3aaafcbb"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:22:55 crc kubenswrapper[5120]: I0316 16:22:55.100106 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5db65e99-b0fe-4cf7-975c-6452ca8dfa62-kube-api-access-xfvqx" (OuterVolumeSpecName: "kube-api-access-xfvqx") pod "5db65e99-b0fe-4cf7-975c-6452ca8dfa62" (UID: "5db65e99-b0fe-4cf7-975c-6452ca8dfa62"). InnerVolumeSpecName "kube-api-access-xfvqx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:22:55 crc kubenswrapper[5120]: I0316 16:22:55.100098 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5db65e99-b0fe-4cf7-975c-6452ca8dfa62-scripts" (OuterVolumeSpecName: "scripts") pod "5db65e99-b0fe-4cf7-975c-6452ca8dfa62" (UID: "5db65e99-b0fe-4cf7-975c-6452ca8dfa62"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:22:55 crc kubenswrapper[5120]: I0316 16:22:55.120100 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5db65e99-b0fe-4cf7-975c-6452ca8dfa62-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "5db65e99-b0fe-4cf7-975c-6452ca8dfa62" (UID: "5db65e99-b0fe-4cf7-975c-6452ca8dfa62"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:22:55 crc kubenswrapper[5120]: I0316 16:22:55.122435 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a1770402-bcb6-4c25-8079-130a3aaafcbb-config-data" (OuterVolumeSpecName: "config-data") pod "a1770402-bcb6-4c25-8079-130a3aaafcbb" (UID: "a1770402-bcb6-4c25-8079-130a3aaafcbb"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:22:55 crc kubenswrapper[5120]: I0316 16:22:55.125810 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5db65e99-b0fe-4cf7-975c-6452ca8dfa62-config-data" (OuterVolumeSpecName: "config-data") pod "5db65e99-b0fe-4cf7-975c-6452ca8dfa62" (UID: "5db65e99-b0fe-4cf7-975c-6452ca8dfa62"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:22:55 crc kubenswrapper[5120]: I0316 16:22:55.128973 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a1770402-bcb6-4c25-8079-130a3aaafcbb-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "a1770402-bcb6-4c25-8079-130a3aaafcbb" (UID: "a1770402-bcb6-4c25-8079-130a3aaafcbb"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:22:55 crc kubenswrapper[5120]: I0316 16:22:55.186038 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qs4cs\" (UniqueName: \"kubernetes.io/projected/f90be6a3-f863-476d-b78b-95b9d069037e-kube-api-access-qs4cs\") pod \"nova-cell1-novncproxy-0\" (UID: \"f90be6a3-f863-476d-b78b-95b9d069037e\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:22:55 crc kubenswrapper[5120]: I0316 16:22:55.186382 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f90be6a3-f863-476d-b78b-95b9d069037e-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"f90be6a3-f863-476d-b78b-95b9d069037e\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:22:55 crc kubenswrapper[5120]: I0316 16:22:55.186403 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/f90be6a3-f863-476d-b78b-95b9d069037e-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"f90be6a3-f863-476d-b78b-95b9d069037e\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:22:55 crc kubenswrapper[5120]: I0316 16:22:55.187110 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f90be6a3-f863-476d-b78b-95b9d069037e-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"f90be6a3-f863-476d-b78b-95b9d069037e\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:22:55 crc kubenswrapper[5120]: I0316 16:22:55.187350 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/f90be6a3-f863-476d-b78b-95b9d069037e-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"f90be6a3-f863-476d-b78b-95b9d069037e\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:22:55 crc kubenswrapper[5120]: I0316 16:22:55.187431 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a1770402-bcb6-4c25-8079-130a3aaafcbb-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:22:55 crc kubenswrapper[5120]: I0316 16:22:55.187625 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5db65e99-b0fe-4cf7-975c-6452ca8dfa62-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:22:55 crc kubenswrapper[5120]: I0316 16:22:55.187681 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a1770402-bcb6-4c25-8079-130a3aaafcbb-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:22:55 crc kubenswrapper[5120]: I0316 16:22:55.187736 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xfvqx\" (UniqueName: \"kubernetes.io/projected/5db65e99-b0fe-4cf7-975c-6452ca8dfa62-kube-api-access-xfvqx\") on node \"crc\" DevicePath \"\"" Mar 16 16:22:55 crc kubenswrapper[5120]: I0316 16:22:55.187824 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5db65e99-b0fe-4cf7-975c-6452ca8dfa62-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:22:55 crc kubenswrapper[5120]: I0316 16:22:55.187888 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5db65e99-b0fe-4cf7-975c-6452ca8dfa62-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:22:55 crc kubenswrapper[5120]: I0316 16:22:55.187943 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kdt4f\" (UniqueName: \"kubernetes.io/projected/a1770402-bcb6-4c25-8079-130a3aaafcbb-kube-api-access-kdt4f\") on node \"crc\" DevicePath \"\"" Mar 16 16:22:55 crc kubenswrapper[5120]: I0316 16:22:55.188002 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a1770402-bcb6-4c25-8079-130a3aaafcbb-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:22:55 crc kubenswrapper[5120]: I0316 16:22:55.191373 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/f90be6a3-f863-476d-b78b-95b9d069037e-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"f90be6a3-f863-476d-b78b-95b9d069037e\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:22:55 crc kubenswrapper[5120]: I0316 16:22:55.191399 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f90be6a3-f863-476d-b78b-95b9d069037e-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"f90be6a3-f863-476d-b78b-95b9d069037e\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:22:55 crc kubenswrapper[5120]: I0316 16:22:55.191416 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/f90be6a3-f863-476d-b78b-95b9d069037e-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"f90be6a3-f863-476d-b78b-95b9d069037e\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:22:55 crc kubenswrapper[5120]: I0316 16:22:55.192470 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f90be6a3-f863-476d-b78b-95b9d069037e-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"f90be6a3-f863-476d-b78b-95b9d069037e\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:22:55 crc kubenswrapper[5120]: I0316 16:22:55.203273 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qs4cs\" (UniqueName: \"kubernetes.io/projected/f90be6a3-f863-476d-b78b-95b9d069037e-kube-api-access-qs4cs\") pod \"nova-cell1-novncproxy-0\" (UID: \"f90be6a3-f863-476d-b78b-95b9d069037e\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:22:55 crc kubenswrapper[5120]: I0316 16:22:55.356854 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:22:55 crc kubenswrapper[5120]: I0316 16:22:55.368487 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:22:55 crc kubenswrapper[5120]: I0316 16:22:55.491869 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"01b7a18f-9ea0-4145-bf98-1950d5913c20","Type":"ContainerStarted","Data":"9a5f577d293d3d468bc40ce6d0020de3b3318ddd6265880d0cfc86e7ae259e4c"} Mar 16 16:22:55 crc kubenswrapper[5120]: I0316 16:22:55.515865 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-j9pqb" event={"ID":"a1770402-bcb6-4c25-8079-130a3aaafcbb","Type":"ContainerDied","Data":"397a027fbf9b87ea03164b3c61b5392abddd4a13b6c50ece8dee26ab0e081444"} Mar 16 16:22:55 crc kubenswrapper[5120]: I0316 16:22:55.515914 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="397a027fbf9b87ea03164b3c61b5392abddd4a13b6c50ece8dee26ab0e081444" Mar 16 16:22:55 crc kubenswrapper[5120]: I0316 16:22:55.515995 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-j9pqb" Mar 16 16:22:55 crc kubenswrapper[5120]: I0316 16:22:55.520350 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"0e8671c6-1540-4375-8eb9-222bbcab34d8","Type":"ContainerStarted","Data":"27ab5a2145cda5bf2a9c6c996111e4f37b4011dd09d39d5485fb0358de6d2079"} Mar 16 16:22:55 crc kubenswrapper[5120]: I0316 16:22:55.520396 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"0e8671c6-1540-4375-8eb9-222bbcab34d8","Type":"ContainerStarted","Data":"15910d3f3bd767b34b15ad48f3cc8e4f19dd7a7634767acdf71362e43e7eee78"} Mar 16 16:22:55 crc kubenswrapper[5120]: I0316 16:22:55.520405 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"0e8671c6-1540-4375-8eb9-222bbcab34d8","Type":"ContainerStarted","Data":"1578db49fecec8722638c4236b88fc077e8080c28d339a75939200748bbe7795"} Mar 16 16:22:55 crc kubenswrapper[5120]: I0316 16:22:55.528998 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-2bwpk" event={"ID":"5db65e99-b0fe-4cf7-975c-6452ca8dfa62","Type":"ContainerDied","Data":"6fbb34d455c32659f8d6d851237f86cc8aeb1155b519b0be0365904696f6c4fc"} Mar 16 16:22:55 crc kubenswrapper[5120]: I0316 16:22:55.529036 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6fbb34d455c32659f8d6d851237f86cc8aeb1155b519b0be0365904696f6c4fc" Mar 16 16:22:55 crc kubenswrapper[5120]: I0316 16:22:55.529278 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-2bwpk" Mar 16 16:22:55 crc kubenswrapper[5120]: I0316 16:22:55.539263 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"e6f79b5a-7ec0-4175-be98-73239396dd90","Type":"ContainerStarted","Data":"d63b63f896e16ee6ca0499eadf5f4897e18e93018d3e86e30c2fa276b3f8df7d"} Mar 16 16:22:55 crc kubenswrapper[5120]: I0316 16:22:55.539300 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"e6f79b5a-7ec0-4175-be98-73239396dd90","Type":"ContainerStarted","Data":"6101301c6507c34728e7dcea169d587031f770aa87b5439179b2b3b73bbf2ce7"} Mar 16 16:22:55 crc kubenswrapper[5120]: I0316 16:22:55.550245 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=2.550229991 podStartE2EDuration="2.550229991s" podCreationTimestamp="2026-03-16 16:22:53 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:22:55.546852841 +0000 UTC m=+3077.700784518" watchObservedRunningTime="2026-03-16 16:22:55.550229991 +0000 UTC m=+3077.704161648" Mar 16 16:22:55 crc kubenswrapper[5120]: I0316 16:22:55.583576 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-scheduler-0" podStartSLOduration=2.583555832 podStartE2EDuration="2.583555832s" podCreationTimestamp="2026-03-16 16:22:53 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:22:55.560930467 +0000 UTC m=+3077.714862124" watchObservedRunningTime="2026-03-16 16:22:55.583555832 +0000 UTC m=+3077.737487489" Mar 16 16:22:55 crc kubenswrapper[5120]: I0316 16:22:55.615171 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 16:22:55 crc kubenswrapper[5120]: I0316 16:22:55.632810 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 16:22:55 crc kubenswrapper[5120]: I0316 16:22:55.632937 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:22:55 crc kubenswrapper[5120]: I0316 16:22:55.636450 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-conductor-config-data\"" Mar 16 16:22:55 crc kubenswrapper[5120]: I0316 16:22:55.666402 5120 scope.go:117] "RemoveContainer" containerID="f40e444f89abd558ac90555bfd58e04a1c4379a653ba8035c228d2b7a5443eb5" Mar 16 16:22:55 crc kubenswrapper[5120]: E0316 16:22:55.666620 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:22:55 crc kubenswrapper[5120]: I0316 16:22:55.718817 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/00712a43-f38b-478f-bd42-a8cb0c2c14b3-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"00712a43-f38b-478f-bd42-a8cb0c2c14b3\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:22:55 crc kubenswrapper[5120]: I0316 16:22:55.718878 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gm4dx\" (UniqueName: \"kubernetes.io/projected/00712a43-f38b-478f-bd42-a8cb0c2c14b3-kube-api-access-gm4dx\") pod \"nova-cell1-conductor-0\" (UID: \"00712a43-f38b-478f-bd42-a8cb0c2c14b3\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:22:55 crc kubenswrapper[5120]: I0316 16:22:55.718939 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/00712a43-f38b-478f-bd42-a8cb0c2c14b3-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"00712a43-f38b-478f-bd42-a8cb0c2c14b3\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:22:55 crc kubenswrapper[5120]: I0316 16:22:55.759028 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:22:55 crc kubenswrapper[5120]: I0316 16:22:55.767475 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:22:55 crc kubenswrapper[5120]: I0316 16:22:55.777068 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:22:55 crc kubenswrapper[5120]: I0316 16:22:55.820694 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/00712a43-f38b-478f-bd42-a8cb0c2c14b3-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"00712a43-f38b-478f-bd42-a8cb0c2c14b3\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:22:55 crc kubenswrapper[5120]: I0316 16:22:55.820775 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gm4dx\" (UniqueName: \"kubernetes.io/projected/00712a43-f38b-478f-bd42-a8cb0c2c14b3-kube-api-access-gm4dx\") pod \"nova-cell1-conductor-0\" (UID: \"00712a43-f38b-478f-bd42-a8cb0c2c14b3\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:22:55 crc kubenswrapper[5120]: I0316 16:22:55.820832 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/00712a43-f38b-478f-bd42-a8cb0c2c14b3-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"00712a43-f38b-478f-bd42-a8cb0c2c14b3\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:22:55 crc kubenswrapper[5120]: I0316 16:22:55.825075 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/00712a43-f38b-478f-bd42-a8cb0c2c14b3-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"00712a43-f38b-478f-bd42-a8cb0c2c14b3\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:22:55 crc kubenswrapper[5120]: I0316 16:22:55.829119 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/00712a43-f38b-478f-bd42-a8cb0c2c14b3-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"00712a43-f38b-478f-bd42-a8cb0c2c14b3\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:22:55 crc kubenswrapper[5120]: I0316 16:22:55.839833 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gm4dx\" (UniqueName: \"kubernetes.io/projected/00712a43-f38b-478f-bd42-a8cb0c2c14b3-kube-api-access-gm4dx\") pod \"nova-cell1-conductor-0\" (UID: \"00712a43-f38b-478f-bd42-a8cb0c2c14b3\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:22:55 crc kubenswrapper[5120]: I0316 16:22:55.893485 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:22:56 crc kubenswrapper[5120]: I0316 16:22:56.105968 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:22:56 crc kubenswrapper[5120]: W0316 16:22:56.531002 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod00712a43_f38b_478f_bd42_a8cb0c2c14b3.slice/crio-3b29a96c14c835876f6b81f6a6b9d6933b75560c30eb2d97914132860ca24756 WatchSource:0}: Error finding container 3b29a96c14c835876f6b81f6a6b9d6933b75560c30eb2d97914132860ca24756: Status 404 returned error can't find the container with id 3b29a96c14c835876f6b81f6a6b9d6933b75560c30eb2d97914132860ca24756 Mar 16 16:22:56 crc kubenswrapper[5120]: I0316 16:22:56.547209 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 16:22:56 crc kubenswrapper[5120]: I0316 16:22:56.550288 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"00712a43-f38b-478f-bd42-a8cb0c2c14b3","Type":"ContainerStarted","Data":"3b29a96c14c835876f6b81f6a6b9d6933b75560c30eb2d97914132860ca24756"} Mar 16 16:22:56 crc kubenswrapper[5120]: I0316 16:22:56.552479 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"f90be6a3-f863-476d-b78b-95b9d069037e","Type":"ContainerStarted","Data":"0332ef9a2b607b7a01644fa26cd31f338123d18f32f186ba2acdff4ad391e66e"} Mar 16 16:22:56 crc kubenswrapper[5120]: I0316 16:22:56.552529 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"f90be6a3-f863-476d-b78b-95b9d069037e","Type":"ContainerStarted","Data":"dff103b2ba9b082c4e632c9ecd3d6aec83f0012d947e248a449bf2319f228be7"} Mar 16 16:22:56 crc kubenswrapper[5120]: I0316 16:22:56.566308 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"01b7a18f-9ea0-4145-bf98-1950d5913c20","Type":"ContainerStarted","Data":"35fba0a360b1b5283025226706be1eaf84aa4c29df21b410f284f713811d61c6"} Mar 16 16:22:56 crc kubenswrapper[5120]: I0316 16:22:56.566423 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"01b7a18f-9ea0-4145-bf98-1950d5913c20","Type":"ContainerStarted","Data":"67285e9d1ce2968cc11db3348d9cf4ff195746de12703f65eb16b1bc97da21e0"} Mar 16 16:22:56 crc kubenswrapper[5120]: I0316 16:22:56.566308 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="01b7a18f-9ea0-4145-bf98-1950d5913c20" containerName="nova-metadata-log" containerID="cri-o://67285e9d1ce2968cc11db3348d9cf4ff195746de12703f65eb16b1bc97da21e0" gracePeriod=30 Mar 16 16:22:56 crc kubenswrapper[5120]: I0316 16:22:56.566661 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="01b7a18f-9ea0-4145-bf98-1950d5913c20" containerName="nova-metadata-metadata" containerID="cri-o://35fba0a360b1b5283025226706be1eaf84aa4c29df21b410f284f713811d61c6" gracePeriod=30 Mar 16 16:22:56 crc kubenswrapper[5120]: I0316 16:22:56.587544 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podStartSLOduration=2.5875280959999998 podStartE2EDuration="2.587528096s" podCreationTimestamp="2026-03-16 16:22:54 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:22:56.586285973 +0000 UTC m=+3078.740217640" watchObservedRunningTime="2026-03-16 16:22:56.587528096 +0000 UTC m=+3078.741459743" Mar 16 16:22:56 crc kubenswrapper[5120]: I0316 16:22:56.615568 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=2.615547816 podStartE2EDuration="2.615547816s" podCreationTimestamp="2026-03-16 16:22:54 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:22:56.607487691 +0000 UTC m=+3078.761419358" watchObservedRunningTime="2026-03-16 16:22:56.615547816 +0000 UTC m=+3078.769479473" Mar 16 16:22:56 crc kubenswrapper[5120]: I0316 16:22:56.673477 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="52f78b0c-8c71-4e47-978b-840e0ca12c1c" path="/var/lib/kubelet/pods/52f78b0c-8c71-4e47-978b-840e0ca12c1c/volumes" Mar 16 16:22:57 crc kubenswrapper[5120]: I0316 16:22:57.142814 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:22:57 crc kubenswrapper[5120]: I0316 16:22:57.253293 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/01b7a18f-9ea0-4145-bf98-1950d5913c20-nova-metadata-tls-certs\") pod \"01b7a18f-9ea0-4145-bf98-1950d5913c20\" (UID: \"01b7a18f-9ea0-4145-bf98-1950d5913c20\") " Mar 16 16:22:57 crc kubenswrapper[5120]: I0316 16:22:57.253353 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sms2b\" (UniqueName: \"kubernetes.io/projected/01b7a18f-9ea0-4145-bf98-1950d5913c20-kube-api-access-sms2b\") pod \"01b7a18f-9ea0-4145-bf98-1950d5913c20\" (UID: \"01b7a18f-9ea0-4145-bf98-1950d5913c20\") " Mar 16 16:22:57 crc kubenswrapper[5120]: I0316 16:22:57.253483 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/01b7a18f-9ea0-4145-bf98-1950d5913c20-config-data\") pod \"01b7a18f-9ea0-4145-bf98-1950d5913c20\" (UID: \"01b7a18f-9ea0-4145-bf98-1950d5913c20\") " Mar 16 16:22:57 crc kubenswrapper[5120]: I0316 16:22:57.253567 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/01b7a18f-9ea0-4145-bf98-1950d5913c20-combined-ca-bundle\") pod \"01b7a18f-9ea0-4145-bf98-1950d5913c20\" (UID: \"01b7a18f-9ea0-4145-bf98-1950d5913c20\") " Mar 16 16:22:57 crc kubenswrapper[5120]: I0316 16:22:57.253682 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/01b7a18f-9ea0-4145-bf98-1950d5913c20-logs\") pod \"01b7a18f-9ea0-4145-bf98-1950d5913c20\" (UID: \"01b7a18f-9ea0-4145-bf98-1950d5913c20\") " Mar 16 16:22:57 crc kubenswrapper[5120]: I0316 16:22:57.255002 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01b7a18f-9ea0-4145-bf98-1950d5913c20-logs" (OuterVolumeSpecName: "logs") pod "01b7a18f-9ea0-4145-bf98-1950d5913c20" (UID: "01b7a18f-9ea0-4145-bf98-1950d5913c20"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:22:57 crc kubenswrapper[5120]: I0316 16:22:57.268004 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01b7a18f-9ea0-4145-bf98-1950d5913c20-kube-api-access-sms2b" (OuterVolumeSpecName: "kube-api-access-sms2b") pod "01b7a18f-9ea0-4145-bf98-1950d5913c20" (UID: "01b7a18f-9ea0-4145-bf98-1950d5913c20"). InnerVolumeSpecName "kube-api-access-sms2b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:22:57 crc kubenswrapper[5120]: I0316 16:22:57.289883 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/01b7a18f-9ea0-4145-bf98-1950d5913c20-config-data" (OuterVolumeSpecName: "config-data") pod "01b7a18f-9ea0-4145-bf98-1950d5913c20" (UID: "01b7a18f-9ea0-4145-bf98-1950d5913c20"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:22:57 crc kubenswrapper[5120]: I0316 16:22:57.347141 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/01b7a18f-9ea0-4145-bf98-1950d5913c20-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "01b7a18f-9ea0-4145-bf98-1950d5913c20" (UID: "01b7a18f-9ea0-4145-bf98-1950d5913c20"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:22:57 crc kubenswrapper[5120]: I0316 16:22:57.356413 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/01b7a18f-9ea0-4145-bf98-1950d5913c20-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:22:57 crc kubenswrapper[5120]: I0316 16:22:57.356451 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/01b7a18f-9ea0-4145-bf98-1950d5913c20-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:22:57 crc kubenswrapper[5120]: I0316 16:22:57.356466 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/01b7a18f-9ea0-4145-bf98-1950d5913c20-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:22:57 crc kubenswrapper[5120]: I0316 16:22:57.356475 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sms2b\" (UniqueName: \"kubernetes.io/projected/01b7a18f-9ea0-4145-bf98-1950d5913c20-kube-api-access-sms2b\") on node \"crc\" DevicePath \"\"" Mar 16 16:22:57 crc kubenswrapper[5120]: I0316 16:22:57.379872 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/01b7a18f-9ea0-4145-bf98-1950d5913c20-nova-metadata-tls-certs" (OuterVolumeSpecName: "nova-metadata-tls-certs") pod "01b7a18f-9ea0-4145-bf98-1950d5913c20" (UID: "01b7a18f-9ea0-4145-bf98-1950d5913c20"). InnerVolumeSpecName "nova-metadata-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:22:57 crc kubenswrapper[5120]: I0316 16:22:57.458681 5120 reconciler_common.go:299] "Volume detached for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/01b7a18f-9ea0-4145-bf98-1950d5913c20-nova-metadata-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:22:57 crc kubenswrapper[5120]: I0316 16:22:57.578935 5120 generic.go:358] "Generic (PLEG): container finished" podID="01b7a18f-9ea0-4145-bf98-1950d5913c20" containerID="35fba0a360b1b5283025226706be1eaf84aa4c29df21b410f284f713811d61c6" exitCode=0 Mar 16 16:22:57 crc kubenswrapper[5120]: I0316 16:22:57.578963 5120 generic.go:358] "Generic (PLEG): container finished" podID="01b7a18f-9ea0-4145-bf98-1950d5913c20" containerID="67285e9d1ce2968cc11db3348d9cf4ff195746de12703f65eb16b1bc97da21e0" exitCode=143 Mar 16 16:22:57 crc kubenswrapper[5120]: I0316 16:22:57.579113 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"01b7a18f-9ea0-4145-bf98-1950d5913c20","Type":"ContainerDied","Data":"35fba0a360b1b5283025226706be1eaf84aa4c29df21b410f284f713811d61c6"} Mar 16 16:22:57 crc kubenswrapper[5120]: I0316 16:22:57.579138 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"01b7a18f-9ea0-4145-bf98-1950d5913c20","Type":"ContainerDied","Data":"67285e9d1ce2968cc11db3348d9cf4ff195746de12703f65eb16b1bc97da21e0"} Mar 16 16:22:57 crc kubenswrapper[5120]: I0316 16:22:57.579149 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"01b7a18f-9ea0-4145-bf98-1950d5913c20","Type":"ContainerDied","Data":"9a5f577d293d3d468bc40ce6d0020de3b3318ddd6265880d0cfc86e7ae259e4c"} Mar 16 16:22:57 crc kubenswrapper[5120]: I0316 16:22:57.579164 5120 scope.go:117] "RemoveContainer" containerID="35fba0a360b1b5283025226706be1eaf84aa4c29df21b410f284f713811d61c6" Mar 16 16:22:57 crc kubenswrapper[5120]: I0316 16:22:57.579275 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:22:57 crc kubenswrapper[5120]: I0316 16:22:57.583107 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"00712a43-f38b-478f-bd42-a8cb0c2c14b3","Type":"ContainerStarted","Data":"e20d7270f4fe9453876580e96b11e1123f8f3ee72618f8412137ebf03e720b64"} Mar 16 16:22:57 crc kubenswrapper[5120]: I0316 16:22:57.584117 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="0e8671c6-1540-4375-8eb9-222bbcab34d8" containerName="nova-api-log" containerID="cri-o://15910d3f3bd767b34b15ad48f3cc8e4f19dd7a7634767acdf71362e43e7eee78" gracePeriod=30 Mar 16 16:22:57 crc kubenswrapper[5120]: I0316 16:22:57.584321 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="0e8671c6-1540-4375-8eb9-222bbcab34d8" containerName="nova-api-api" containerID="cri-o://27ab5a2145cda5bf2a9c6c996111e4f37b4011dd09d39d5485fb0358de6d2079" gracePeriod=30 Mar 16 16:22:57 crc kubenswrapper[5120]: I0316 16:22:57.584191 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:22:57 crc kubenswrapper[5120]: I0316 16:22:57.584337 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="e6f79b5a-7ec0-4175-be98-73239396dd90" containerName="nova-scheduler-scheduler" containerID="cri-o://d63b63f896e16ee6ca0499eadf5f4897e18e93018d3e86e30c2fa276b3f8df7d" gracePeriod=30 Mar 16 16:22:57 crc kubenswrapper[5120]: I0316 16:22:57.618179 5120 scope.go:117] "RemoveContainer" containerID="67285e9d1ce2968cc11db3348d9cf4ff195746de12703f65eb16b1bc97da21e0" Mar 16 16:22:57 crc kubenswrapper[5120]: I0316 16:22:57.622334 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podStartSLOduration=2.622314694 podStartE2EDuration="2.622314694s" podCreationTimestamp="2026-03-16 16:22:55 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:22:57.613992841 +0000 UTC m=+3079.767924498" watchObservedRunningTime="2026-03-16 16:22:57.622314694 +0000 UTC m=+3079.776246341" Mar 16 16:22:57 crc kubenswrapper[5120]: I0316 16:22:57.638823 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:22:57 crc kubenswrapper[5120]: I0316 16:22:57.642555 5120 scope.go:117] "RemoveContainer" containerID="35fba0a360b1b5283025226706be1eaf84aa4c29df21b410f284f713811d61c6" Mar 16 16:22:57 crc kubenswrapper[5120]: E0316 16:22:57.643046 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"35fba0a360b1b5283025226706be1eaf84aa4c29df21b410f284f713811d61c6\": container with ID starting with 35fba0a360b1b5283025226706be1eaf84aa4c29df21b410f284f713811d61c6 not found: ID does not exist" containerID="35fba0a360b1b5283025226706be1eaf84aa4c29df21b410f284f713811d61c6" Mar 16 16:22:57 crc kubenswrapper[5120]: I0316 16:22:57.643160 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35fba0a360b1b5283025226706be1eaf84aa4c29df21b410f284f713811d61c6"} err="failed to get container status \"35fba0a360b1b5283025226706be1eaf84aa4c29df21b410f284f713811d61c6\": rpc error: code = NotFound desc = could not find container \"35fba0a360b1b5283025226706be1eaf84aa4c29df21b410f284f713811d61c6\": container with ID starting with 35fba0a360b1b5283025226706be1eaf84aa4c29df21b410f284f713811d61c6 not found: ID does not exist" Mar 16 16:22:57 crc kubenswrapper[5120]: I0316 16:22:57.643242 5120 scope.go:117] "RemoveContainer" containerID="67285e9d1ce2968cc11db3348d9cf4ff195746de12703f65eb16b1bc97da21e0" Mar 16 16:22:57 crc kubenswrapper[5120]: E0316 16:22:57.643592 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"67285e9d1ce2968cc11db3348d9cf4ff195746de12703f65eb16b1bc97da21e0\": container with ID starting with 67285e9d1ce2968cc11db3348d9cf4ff195746de12703f65eb16b1bc97da21e0 not found: ID does not exist" containerID="67285e9d1ce2968cc11db3348d9cf4ff195746de12703f65eb16b1bc97da21e0" Mar 16 16:22:57 crc kubenswrapper[5120]: I0316 16:22:57.643634 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67285e9d1ce2968cc11db3348d9cf4ff195746de12703f65eb16b1bc97da21e0"} err="failed to get container status \"67285e9d1ce2968cc11db3348d9cf4ff195746de12703f65eb16b1bc97da21e0\": rpc error: code = NotFound desc = could not find container \"67285e9d1ce2968cc11db3348d9cf4ff195746de12703f65eb16b1bc97da21e0\": container with ID starting with 67285e9d1ce2968cc11db3348d9cf4ff195746de12703f65eb16b1bc97da21e0 not found: ID does not exist" Mar 16 16:22:57 crc kubenswrapper[5120]: I0316 16:22:57.643683 5120 scope.go:117] "RemoveContainer" containerID="35fba0a360b1b5283025226706be1eaf84aa4c29df21b410f284f713811d61c6" Mar 16 16:22:57 crc kubenswrapper[5120]: I0316 16:22:57.646071 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35fba0a360b1b5283025226706be1eaf84aa4c29df21b410f284f713811d61c6"} err="failed to get container status \"35fba0a360b1b5283025226706be1eaf84aa4c29df21b410f284f713811d61c6\": rpc error: code = NotFound desc = could not find container \"35fba0a360b1b5283025226706be1eaf84aa4c29df21b410f284f713811d61c6\": container with ID starting with 35fba0a360b1b5283025226706be1eaf84aa4c29df21b410f284f713811d61c6 not found: ID does not exist" Mar 16 16:22:57 crc kubenswrapper[5120]: I0316 16:22:57.646112 5120 scope.go:117] "RemoveContainer" containerID="67285e9d1ce2968cc11db3348d9cf4ff195746de12703f65eb16b1bc97da21e0" Mar 16 16:22:57 crc kubenswrapper[5120]: I0316 16:22:57.646543 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67285e9d1ce2968cc11db3348d9cf4ff195746de12703f65eb16b1bc97da21e0"} err="failed to get container status \"67285e9d1ce2968cc11db3348d9cf4ff195746de12703f65eb16b1bc97da21e0\": rpc error: code = NotFound desc = could not find container \"67285e9d1ce2968cc11db3348d9cf4ff195746de12703f65eb16b1bc97da21e0\": container with ID starting with 67285e9d1ce2968cc11db3348d9cf4ff195746de12703f65eb16b1bc97da21e0 not found: ID does not exist" Mar 16 16:22:57 crc kubenswrapper[5120]: I0316 16:22:57.659893 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:22:57 crc kubenswrapper[5120]: I0316 16:22:57.671344 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:22:57 crc kubenswrapper[5120]: I0316 16:22:57.672503 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01b7a18f-9ea0-4145-bf98-1950d5913c20" containerName="nova-metadata-metadata" Mar 16 16:22:57 crc kubenswrapper[5120]: I0316 16:22:57.672521 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="01b7a18f-9ea0-4145-bf98-1950d5913c20" containerName="nova-metadata-metadata" Mar 16 16:22:57 crc kubenswrapper[5120]: I0316 16:22:57.672581 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01b7a18f-9ea0-4145-bf98-1950d5913c20" containerName="nova-metadata-log" Mar 16 16:22:57 crc kubenswrapper[5120]: I0316 16:22:57.672588 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="01b7a18f-9ea0-4145-bf98-1950d5913c20" containerName="nova-metadata-log" Mar 16 16:22:57 crc kubenswrapper[5120]: I0316 16:22:57.672752 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="01b7a18f-9ea0-4145-bf98-1950d5913c20" containerName="nova-metadata-metadata" Mar 16 16:22:57 crc kubenswrapper[5120]: I0316 16:22:57.672797 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="01b7a18f-9ea0-4145-bf98-1950d5913c20" containerName="nova-metadata-log" Mar 16 16:22:57 crc kubenswrapper[5120]: I0316 16:22:57.690072 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:22:57 crc kubenswrapper[5120]: I0316 16:22:57.690206 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:22:57 crc kubenswrapper[5120]: I0316 16:22:57.692712 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-metadata-config-data\"" Mar 16 16:22:57 crc kubenswrapper[5120]: I0316 16:22:57.693149 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-metadata-internal-svc\"" Mar 16 16:22:57 crc kubenswrapper[5120]: I0316 16:22:57.865750 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/eedcb5c7-fe1f-48f2-bf88-bd0b575ec7b8-logs\") pod \"nova-metadata-0\" (UID: \"eedcb5c7-fe1f-48f2-bf88-bd0b575ec7b8\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:22:57 crc kubenswrapper[5120]: I0316 16:22:57.866510 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/eedcb5c7-fe1f-48f2-bf88-bd0b575ec7b8-config-data\") pod \"nova-metadata-0\" (UID: \"eedcb5c7-fe1f-48f2-bf88-bd0b575ec7b8\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:22:57 crc kubenswrapper[5120]: I0316 16:22:57.866667 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eedcb5c7-fe1f-48f2-bf88-bd0b575ec7b8-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"eedcb5c7-fe1f-48f2-bf88-bd0b575ec7b8\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:22:57 crc kubenswrapper[5120]: I0316 16:22:57.867151 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzg9t\" (UniqueName: \"kubernetes.io/projected/eedcb5c7-fe1f-48f2-bf88-bd0b575ec7b8-kube-api-access-hzg9t\") pod \"nova-metadata-0\" (UID: \"eedcb5c7-fe1f-48f2-bf88-bd0b575ec7b8\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:22:57 crc kubenswrapper[5120]: I0316 16:22:57.867277 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/eedcb5c7-fe1f-48f2-bf88-bd0b575ec7b8-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"eedcb5c7-fe1f-48f2-bf88-bd0b575ec7b8\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:22:57 crc kubenswrapper[5120]: I0316 16:22:57.969902 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eedcb5c7-fe1f-48f2-bf88-bd0b575ec7b8-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"eedcb5c7-fe1f-48f2-bf88-bd0b575ec7b8\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:22:57 crc kubenswrapper[5120]: I0316 16:22:57.970090 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hzg9t\" (UniqueName: \"kubernetes.io/projected/eedcb5c7-fe1f-48f2-bf88-bd0b575ec7b8-kube-api-access-hzg9t\") pod \"nova-metadata-0\" (UID: \"eedcb5c7-fe1f-48f2-bf88-bd0b575ec7b8\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:22:57 crc kubenswrapper[5120]: I0316 16:22:57.970147 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/eedcb5c7-fe1f-48f2-bf88-bd0b575ec7b8-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"eedcb5c7-fe1f-48f2-bf88-bd0b575ec7b8\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:22:57 crc kubenswrapper[5120]: I0316 16:22:57.970225 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/eedcb5c7-fe1f-48f2-bf88-bd0b575ec7b8-logs\") pod \"nova-metadata-0\" (UID: \"eedcb5c7-fe1f-48f2-bf88-bd0b575ec7b8\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:22:57 crc kubenswrapper[5120]: I0316 16:22:57.970330 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/eedcb5c7-fe1f-48f2-bf88-bd0b575ec7b8-config-data\") pod \"nova-metadata-0\" (UID: \"eedcb5c7-fe1f-48f2-bf88-bd0b575ec7b8\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:22:57 crc kubenswrapper[5120]: I0316 16:22:57.970894 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/eedcb5c7-fe1f-48f2-bf88-bd0b575ec7b8-logs\") pod \"nova-metadata-0\" (UID: \"eedcb5c7-fe1f-48f2-bf88-bd0b575ec7b8\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:22:57 crc kubenswrapper[5120]: I0316 16:22:57.974972 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/eedcb5c7-fe1f-48f2-bf88-bd0b575ec7b8-config-data\") pod \"nova-metadata-0\" (UID: \"eedcb5c7-fe1f-48f2-bf88-bd0b575ec7b8\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:22:57 crc kubenswrapper[5120]: I0316 16:22:57.980629 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/eedcb5c7-fe1f-48f2-bf88-bd0b575ec7b8-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"eedcb5c7-fe1f-48f2-bf88-bd0b575ec7b8\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:22:57 crc kubenswrapper[5120]: I0316 16:22:57.982336 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eedcb5c7-fe1f-48f2-bf88-bd0b575ec7b8-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"eedcb5c7-fe1f-48f2-bf88-bd0b575ec7b8\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:22:57 crc kubenswrapper[5120]: I0316 16:22:57.995087 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/ceilometer-0" podUID="74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f" containerName="proxy-httpd" probeResult="failure" output="HTTP probe failed with statuscode: 503" Mar 16 16:22:58 crc kubenswrapper[5120]: I0316 16:22:58.015878 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzg9t\" (UniqueName: \"kubernetes.io/projected/eedcb5c7-fe1f-48f2-bf88-bd0b575ec7b8-kube-api-access-hzg9t\") pod \"nova-metadata-0\" (UID: \"eedcb5c7-fe1f-48f2-bf88-bd0b575ec7b8\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:22:58 crc kubenswrapper[5120]: I0316 16:22:58.116470 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:22:58 crc kubenswrapper[5120]: I0316 16:22:58.154346 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:22:58 crc kubenswrapper[5120]: I0316 16:22:58.294243 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0e8671c6-1540-4375-8eb9-222bbcab34d8-combined-ca-bundle\") pod \"0e8671c6-1540-4375-8eb9-222bbcab34d8\" (UID: \"0e8671c6-1540-4375-8eb9-222bbcab34d8\") " Mar 16 16:22:58 crc kubenswrapper[5120]: I0316 16:22:58.294589 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0e8671c6-1540-4375-8eb9-222bbcab34d8-logs\") pod \"0e8671c6-1540-4375-8eb9-222bbcab34d8\" (UID: \"0e8671c6-1540-4375-8eb9-222bbcab34d8\") " Mar 16 16:22:58 crc kubenswrapper[5120]: I0316 16:22:58.294713 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dtpdb\" (UniqueName: \"kubernetes.io/projected/0e8671c6-1540-4375-8eb9-222bbcab34d8-kube-api-access-dtpdb\") pod \"0e8671c6-1540-4375-8eb9-222bbcab34d8\" (UID: \"0e8671c6-1540-4375-8eb9-222bbcab34d8\") " Mar 16 16:22:58 crc kubenswrapper[5120]: I0316 16:22:58.294839 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0e8671c6-1540-4375-8eb9-222bbcab34d8-config-data\") pod \"0e8671c6-1540-4375-8eb9-222bbcab34d8\" (UID: \"0e8671c6-1540-4375-8eb9-222bbcab34d8\") " Mar 16 16:22:58 crc kubenswrapper[5120]: I0316 16:22:58.295094 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e8671c6-1540-4375-8eb9-222bbcab34d8-logs" (OuterVolumeSpecName: "logs") pod "0e8671c6-1540-4375-8eb9-222bbcab34d8" (UID: "0e8671c6-1540-4375-8eb9-222bbcab34d8"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:22:58 crc kubenswrapper[5120]: I0316 16:22:58.295592 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0e8671c6-1540-4375-8eb9-222bbcab34d8-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:22:58 crc kubenswrapper[5120]: I0316 16:22:58.301114 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e8671c6-1540-4375-8eb9-222bbcab34d8-kube-api-access-dtpdb" (OuterVolumeSpecName: "kube-api-access-dtpdb") pod "0e8671c6-1540-4375-8eb9-222bbcab34d8" (UID: "0e8671c6-1540-4375-8eb9-222bbcab34d8"). InnerVolumeSpecName "kube-api-access-dtpdb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:22:58 crc kubenswrapper[5120]: I0316 16:22:58.328918 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e8671c6-1540-4375-8eb9-222bbcab34d8-config-data" (OuterVolumeSpecName: "config-data") pod "0e8671c6-1540-4375-8eb9-222bbcab34d8" (UID: "0e8671c6-1540-4375-8eb9-222bbcab34d8"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:22:58 crc kubenswrapper[5120]: I0316 16:22:58.338927 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e8671c6-1540-4375-8eb9-222bbcab34d8-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "0e8671c6-1540-4375-8eb9-222bbcab34d8" (UID: "0e8671c6-1540-4375-8eb9-222bbcab34d8"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:22:58 crc kubenswrapper[5120]: I0316 16:22:58.374743 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:22:58 crc kubenswrapper[5120]: I0316 16:22:58.406911 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tqwfh\" (UniqueName: \"kubernetes.io/projected/74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f-kube-api-access-tqwfh\") pod \"74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f\" (UID: \"74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f\") " Mar 16 16:22:58 crc kubenswrapper[5120]: I0316 16:22:58.407023 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f-sg-core-conf-yaml\") pod \"74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f\" (UID: \"74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f\") " Mar 16 16:22:58 crc kubenswrapper[5120]: I0316 16:22:58.407162 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f-log-httpd\") pod \"74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f\" (UID: \"74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f\") " Mar 16 16:22:58 crc kubenswrapper[5120]: I0316 16:22:58.407367 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f-run-httpd\") pod \"74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f\" (UID: \"74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f\") " Mar 16 16:22:58 crc kubenswrapper[5120]: I0316 16:22:58.407409 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f-scripts\") pod \"74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f\" (UID: \"74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f\") " Mar 16 16:22:58 crc kubenswrapper[5120]: I0316 16:22:58.407520 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f-config-data\") pod \"74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f\" (UID: \"74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f\") " Mar 16 16:22:58 crc kubenswrapper[5120]: I0316 16:22:58.407603 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f-combined-ca-bundle\") pod \"74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f\" (UID: \"74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f\") " Mar 16 16:22:58 crc kubenswrapper[5120]: I0316 16:22:58.408094 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dtpdb\" (UniqueName: \"kubernetes.io/projected/0e8671c6-1540-4375-8eb9-222bbcab34d8-kube-api-access-dtpdb\") on node \"crc\" DevicePath \"\"" Mar 16 16:22:58 crc kubenswrapper[5120]: I0316 16:22:58.408112 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0e8671c6-1540-4375-8eb9-222bbcab34d8-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:22:58 crc kubenswrapper[5120]: I0316 16:22:58.408123 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0e8671c6-1540-4375-8eb9-222bbcab34d8-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:22:58 crc kubenswrapper[5120]: I0316 16:22:58.408623 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f" (UID: "74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:22:58 crc kubenswrapper[5120]: I0316 16:22:58.408858 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f" (UID: "74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:22:58 crc kubenswrapper[5120]: I0316 16:22:58.413318 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f-kube-api-access-tqwfh" (OuterVolumeSpecName: "kube-api-access-tqwfh") pod "74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f" (UID: "74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f"). InnerVolumeSpecName "kube-api-access-tqwfh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:22:58 crc kubenswrapper[5120]: I0316 16:22:58.414489 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f-scripts" (OuterVolumeSpecName: "scripts") pod "74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f" (UID: "74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:22:58 crc kubenswrapper[5120]: I0316 16:22:58.455034 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f" (UID: "74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:22:58 crc kubenswrapper[5120]: I0316 16:22:58.477679 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f" (UID: "74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:22:58 crc kubenswrapper[5120]: I0316 16:22:58.506487 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f-config-data" (OuterVolumeSpecName: "config-data") pod "74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f" (UID: "74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:22:58 crc kubenswrapper[5120]: I0316 16:22:58.510226 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:22:58 crc kubenswrapper[5120]: I0316 16:22:58.510251 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:22:58 crc kubenswrapper[5120]: I0316 16:22:58.510260 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:22:58 crc kubenswrapper[5120]: I0316 16:22:58.510268 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:22:58 crc kubenswrapper[5120]: I0316 16:22:58.510280 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tqwfh\" (UniqueName: \"kubernetes.io/projected/74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f-kube-api-access-tqwfh\") on node \"crc\" DevicePath \"\"" Mar 16 16:22:58 crc kubenswrapper[5120]: I0316 16:22:58.510290 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 16:22:58 crc kubenswrapper[5120]: I0316 16:22:58.510298 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:22:58 crc kubenswrapper[5120]: I0316 16:22:58.598574 5120 generic.go:358] "Generic (PLEG): container finished" podID="74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f" containerID="017b72641a853824e2c00279610bf22e07197f7e20842ebc66753ba019aa6f00" exitCode=137 Mar 16 16:22:58 crc kubenswrapper[5120]: I0316 16:22:58.598903 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f","Type":"ContainerDied","Data":"017b72641a853824e2c00279610bf22e07197f7e20842ebc66753ba019aa6f00"} Mar 16 16:22:58 crc kubenswrapper[5120]: I0316 16:22:58.598936 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f","Type":"ContainerDied","Data":"3266a26f3cbab067f839d1f301589a54110977bc22c33a97c38159649ee98498"} Mar 16 16:22:58 crc kubenswrapper[5120]: I0316 16:22:58.598959 5120 scope.go:117] "RemoveContainer" containerID="017b72641a853824e2c00279610bf22e07197f7e20842ebc66753ba019aa6f00" Mar 16 16:22:58 crc kubenswrapper[5120]: I0316 16:22:58.599129 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:22:58 crc kubenswrapper[5120]: I0316 16:22:58.629889 5120 generic.go:358] "Generic (PLEG): container finished" podID="0e8671c6-1540-4375-8eb9-222bbcab34d8" containerID="27ab5a2145cda5bf2a9c6c996111e4f37b4011dd09d39d5485fb0358de6d2079" exitCode=0 Mar 16 16:22:58 crc kubenswrapper[5120]: I0316 16:22:58.630126 5120 generic.go:358] "Generic (PLEG): container finished" podID="0e8671c6-1540-4375-8eb9-222bbcab34d8" containerID="15910d3f3bd767b34b15ad48f3cc8e4f19dd7a7634767acdf71362e43e7eee78" exitCode=143 Mar 16 16:22:58 crc kubenswrapper[5120]: I0316 16:22:58.630711 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:22:58 crc kubenswrapper[5120]: I0316 16:22:58.632327 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"0e8671c6-1540-4375-8eb9-222bbcab34d8","Type":"ContainerDied","Data":"27ab5a2145cda5bf2a9c6c996111e4f37b4011dd09d39d5485fb0358de6d2079"} Mar 16 16:22:58 crc kubenswrapper[5120]: I0316 16:22:58.632372 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"0e8671c6-1540-4375-8eb9-222bbcab34d8","Type":"ContainerDied","Data":"15910d3f3bd767b34b15ad48f3cc8e4f19dd7a7634767acdf71362e43e7eee78"} Mar 16 16:22:58 crc kubenswrapper[5120]: I0316 16:22:58.632383 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"0e8671c6-1540-4375-8eb9-222bbcab34d8","Type":"ContainerDied","Data":"1578db49fecec8722638c4236b88fc077e8080c28d339a75939200748bbe7795"} Mar 16 16:22:58 crc kubenswrapper[5120]: I0316 16:22:58.634851 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:22:58 crc kubenswrapper[5120]: I0316 16:22:58.684845 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="01b7a18f-9ea0-4145-bf98-1950d5913c20" path="/var/lib/kubelet/pods/01b7a18f-9ea0-4145-bf98-1950d5913c20/volumes" Mar 16 16:22:58 crc kubenswrapper[5120]: I0316 16:22:58.690088 5120 scope.go:117] "RemoveContainer" containerID="203d4bedf199291f2614eb71000f8a1445200c0439448e76b9ba1f38e9e47a5b" Mar 16 16:22:58 crc kubenswrapper[5120]: I0316 16:22:58.739919 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:22:58 crc kubenswrapper[5120]: I0316 16:22:58.761080 5120 scope.go:117] "RemoveContainer" containerID="61d6f7882bda9507c7944fceae77f9d722a89e07238d733a55399c772ec624f1" Mar 16 16:22:58 crc kubenswrapper[5120]: I0316 16:22:58.769391 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:22:58 crc kubenswrapper[5120]: I0316 16:22:58.800944 5120 scope.go:117] "RemoveContainer" containerID="64bd08a41f9dbb1b2a6a7b48f700c0ea4339c71d3f021c3d5ddf6702d069a21f" Mar 16 16:22:58 crc kubenswrapper[5120]: I0316 16:22:58.802469 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:22:58 crc kubenswrapper[5120]: I0316 16:22:58.813456 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:22:58 crc kubenswrapper[5120]: I0316 16:22:58.837883 5120 scope.go:117] "RemoveContainer" containerID="017b72641a853824e2c00279610bf22e07197f7e20842ebc66753ba019aa6f00" Mar 16 16:22:58 crc kubenswrapper[5120]: E0316 16:22:58.839504 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"017b72641a853824e2c00279610bf22e07197f7e20842ebc66753ba019aa6f00\": container with ID starting with 017b72641a853824e2c00279610bf22e07197f7e20842ebc66753ba019aa6f00 not found: ID does not exist" containerID="017b72641a853824e2c00279610bf22e07197f7e20842ebc66753ba019aa6f00" Mar 16 16:22:58 crc kubenswrapper[5120]: I0316 16:22:58.839601 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"017b72641a853824e2c00279610bf22e07197f7e20842ebc66753ba019aa6f00"} err="failed to get container status \"017b72641a853824e2c00279610bf22e07197f7e20842ebc66753ba019aa6f00\": rpc error: code = NotFound desc = could not find container \"017b72641a853824e2c00279610bf22e07197f7e20842ebc66753ba019aa6f00\": container with ID starting with 017b72641a853824e2c00279610bf22e07197f7e20842ebc66753ba019aa6f00 not found: ID does not exist" Mar 16 16:22:58 crc kubenswrapper[5120]: I0316 16:22:58.839627 5120 scope.go:117] "RemoveContainer" containerID="203d4bedf199291f2614eb71000f8a1445200c0439448e76b9ba1f38e9e47a5b" Mar 16 16:22:58 crc kubenswrapper[5120]: I0316 16:22:58.842807 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:22:58 crc kubenswrapper[5120]: E0316 16:22:58.843582 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"203d4bedf199291f2614eb71000f8a1445200c0439448e76b9ba1f38e9e47a5b\": container with ID starting with 203d4bedf199291f2614eb71000f8a1445200c0439448e76b9ba1f38e9e47a5b not found: ID does not exist" containerID="203d4bedf199291f2614eb71000f8a1445200c0439448e76b9ba1f38e9e47a5b" Mar 16 16:22:58 crc kubenswrapper[5120]: I0316 16:22:58.843641 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"203d4bedf199291f2614eb71000f8a1445200c0439448e76b9ba1f38e9e47a5b"} err="failed to get container status \"203d4bedf199291f2614eb71000f8a1445200c0439448e76b9ba1f38e9e47a5b\": rpc error: code = NotFound desc = could not find container \"203d4bedf199291f2614eb71000f8a1445200c0439448e76b9ba1f38e9e47a5b\": container with ID starting with 203d4bedf199291f2614eb71000f8a1445200c0439448e76b9ba1f38e9e47a5b not found: ID does not exist" Mar 16 16:22:58 crc kubenswrapper[5120]: I0316 16:22:58.843666 5120 scope.go:117] "RemoveContainer" containerID="61d6f7882bda9507c7944fceae77f9d722a89e07238d733a55399c772ec624f1" Mar 16 16:22:58 crc kubenswrapper[5120]: E0316 16:22:58.844136 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"61d6f7882bda9507c7944fceae77f9d722a89e07238d733a55399c772ec624f1\": container with ID starting with 61d6f7882bda9507c7944fceae77f9d722a89e07238d733a55399c772ec624f1 not found: ID does not exist" containerID="61d6f7882bda9507c7944fceae77f9d722a89e07238d733a55399c772ec624f1" Mar 16 16:22:58 crc kubenswrapper[5120]: I0316 16:22:58.844157 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61d6f7882bda9507c7944fceae77f9d722a89e07238d733a55399c772ec624f1"} err="failed to get container status \"61d6f7882bda9507c7944fceae77f9d722a89e07238d733a55399c772ec624f1\": rpc error: code = NotFound desc = could not find container \"61d6f7882bda9507c7944fceae77f9d722a89e07238d733a55399c772ec624f1\": container with ID starting with 61d6f7882bda9507c7944fceae77f9d722a89e07238d733a55399c772ec624f1 not found: ID does not exist" Mar 16 16:22:58 crc kubenswrapper[5120]: I0316 16:22:58.844171 5120 scope.go:117] "RemoveContainer" containerID="64bd08a41f9dbb1b2a6a7b48f700c0ea4339c71d3f021c3d5ddf6702d069a21f" Mar 16 16:22:58 crc kubenswrapper[5120]: E0316 16:22:58.844642 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"64bd08a41f9dbb1b2a6a7b48f700c0ea4339c71d3f021c3d5ddf6702d069a21f\": container with ID starting with 64bd08a41f9dbb1b2a6a7b48f700c0ea4339c71d3f021c3d5ddf6702d069a21f not found: ID does not exist" containerID="64bd08a41f9dbb1b2a6a7b48f700c0ea4339c71d3f021c3d5ddf6702d069a21f" Mar 16 16:22:58 crc kubenswrapper[5120]: I0316 16:22:58.844659 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64bd08a41f9dbb1b2a6a7b48f700c0ea4339c71d3f021c3d5ddf6702d069a21f"} err="failed to get container status \"64bd08a41f9dbb1b2a6a7b48f700c0ea4339c71d3f021c3d5ddf6702d069a21f\": rpc error: code = NotFound desc = could not find container \"64bd08a41f9dbb1b2a6a7b48f700c0ea4339c71d3f021c3d5ddf6702d069a21f\": container with ID starting with 64bd08a41f9dbb1b2a6a7b48f700c0ea4339c71d3f021c3d5ddf6702d069a21f not found: ID does not exist" Mar 16 16:22:58 crc kubenswrapper[5120]: I0316 16:22:58.844671 5120 scope.go:117] "RemoveContainer" containerID="27ab5a2145cda5bf2a9c6c996111e4f37b4011dd09d39d5485fb0358de6d2079" Mar 16 16:22:58 crc kubenswrapper[5120]: I0316 16:22:58.845047 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f" containerName="ceilometer-central-agent" Mar 16 16:22:58 crc kubenswrapper[5120]: I0316 16:22:58.845084 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f" containerName="ceilometer-central-agent" Mar 16 16:22:58 crc kubenswrapper[5120]: I0316 16:22:58.845110 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f" containerName="proxy-httpd" Mar 16 16:22:58 crc kubenswrapper[5120]: I0316 16:22:58.845122 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f" containerName="proxy-httpd" Mar 16 16:22:58 crc kubenswrapper[5120]: I0316 16:22:58.845157 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e8671c6-1540-4375-8eb9-222bbcab34d8" containerName="nova-api-log" Mar 16 16:22:58 crc kubenswrapper[5120]: I0316 16:22:58.845171 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e8671c6-1540-4375-8eb9-222bbcab34d8" containerName="nova-api-log" Mar 16 16:22:58 crc kubenswrapper[5120]: I0316 16:22:58.845219 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e8671c6-1540-4375-8eb9-222bbcab34d8" containerName="nova-api-api" Mar 16 16:22:58 crc kubenswrapper[5120]: I0316 16:22:58.845233 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e8671c6-1540-4375-8eb9-222bbcab34d8" containerName="nova-api-api" Mar 16 16:22:58 crc kubenswrapper[5120]: I0316 16:22:58.845281 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f" containerName="ceilometer-notification-agent" Mar 16 16:22:58 crc kubenswrapper[5120]: I0316 16:22:58.845293 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f" containerName="ceilometer-notification-agent" Mar 16 16:22:58 crc kubenswrapper[5120]: I0316 16:22:58.845343 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f" containerName="sg-core" Mar 16 16:22:58 crc kubenswrapper[5120]: I0316 16:22:58.845355 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f" containerName="sg-core" Mar 16 16:22:58 crc kubenswrapper[5120]: I0316 16:22:58.845668 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f" containerName="ceilometer-notification-agent" Mar 16 16:22:58 crc kubenswrapper[5120]: I0316 16:22:58.845707 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="0e8671c6-1540-4375-8eb9-222bbcab34d8" containerName="nova-api-log" Mar 16 16:22:58 crc kubenswrapper[5120]: I0316 16:22:58.845723 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f" containerName="sg-core" Mar 16 16:22:58 crc kubenswrapper[5120]: I0316 16:22:58.845751 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f" containerName="ceilometer-central-agent" Mar 16 16:22:58 crc kubenswrapper[5120]: I0316 16:22:58.845798 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="0e8671c6-1540-4375-8eb9-222bbcab34d8" containerName="nova-api-api" Mar 16 16:22:58 crc kubenswrapper[5120]: I0316 16:22:58.845823 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f" containerName="proxy-httpd" Mar 16 16:22:58 crc kubenswrapper[5120]: I0316 16:22:58.855630 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:22:58 crc kubenswrapper[5120]: I0316 16:22:58.858899 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:22:58 crc kubenswrapper[5120]: I0316 16:22:58.859864 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-config-data\"" Mar 16 16:22:58 crc kubenswrapper[5120]: I0316 16:22:58.865284 5120 scope.go:117] "RemoveContainer" containerID="15910d3f3bd767b34b15ad48f3cc8e4f19dd7a7634767acdf71362e43e7eee78" Mar 16 16:22:58 crc kubenswrapper[5120]: I0316 16:22:58.869069 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:22:58 crc kubenswrapper[5120]: I0316 16:22:58.869239 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:22:58 crc kubenswrapper[5120]: I0316 16:22:58.874072 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 16:22:58 crc kubenswrapper[5120]: I0316 16:22:58.874236 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 16:22:58 crc kubenswrapper[5120]: I0316 16:22:58.876046 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:22:58 crc kubenswrapper[5120]: I0316 16:22:58.944499 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8h82\" (UniqueName: \"kubernetes.io/projected/4b003c0d-225d-4657-959a-bcb352fda8b0-kube-api-access-p8h82\") pod \"nova-api-0\" (UID: \"4b003c0d-225d-4657-959a-bcb352fda8b0\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:22:58 crc kubenswrapper[5120]: I0316 16:22:58.944545 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/dcb3276e-6f5a-4fea-8428-6c16ca81a07a-scripts\") pod \"ceilometer-0\" (UID: \"dcb3276e-6f5a-4fea-8428-6c16ca81a07a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:22:58 crc kubenswrapper[5120]: I0316 16:22:58.944571 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4b003c0d-225d-4657-959a-bcb352fda8b0-config-data\") pod \"nova-api-0\" (UID: \"4b003c0d-225d-4657-959a-bcb352fda8b0\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:22:58 crc kubenswrapper[5120]: I0316 16:22:58.944671 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dcb3276e-6f5a-4fea-8428-6c16ca81a07a-config-data\") pod \"ceilometer-0\" (UID: \"dcb3276e-6f5a-4fea-8428-6c16ca81a07a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:22:58 crc kubenswrapper[5120]: I0316 16:22:58.944938 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/dcb3276e-6f5a-4fea-8428-6c16ca81a07a-run-httpd\") pod \"ceilometer-0\" (UID: \"dcb3276e-6f5a-4fea-8428-6c16ca81a07a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:22:58 crc kubenswrapper[5120]: I0316 16:22:58.945067 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gzwq\" (UniqueName: \"kubernetes.io/projected/dcb3276e-6f5a-4fea-8428-6c16ca81a07a-kube-api-access-8gzwq\") pod \"ceilometer-0\" (UID: \"dcb3276e-6f5a-4fea-8428-6c16ca81a07a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:22:58 crc kubenswrapper[5120]: I0316 16:22:58.945156 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4b003c0d-225d-4657-959a-bcb352fda8b0-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"4b003c0d-225d-4657-959a-bcb352fda8b0\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:22:58 crc kubenswrapper[5120]: I0316 16:22:58.945192 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/dcb3276e-6f5a-4fea-8428-6c16ca81a07a-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"dcb3276e-6f5a-4fea-8428-6c16ca81a07a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:22:58 crc kubenswrapper[5120]: I0316 16:22:58.945208 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dcb3276e-6f5a-4fea-8428-6c16ca81a07a-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"dcb3276e-6f5a-4fea-8428-6c16ca81a07a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:22:58 crc kubenswrapper[5120]: I0316 16:22:58.945301 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/dcb3276e-6f5a-4fea-8428-6c16ca81a07a-log-httpd\") pod \"ceilometer-0\" (UID: \"dcb3276e-6f5a-4fea-8428-6c16ca81a07a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:22:58 crc kubenswrapper[5120]: I0316 16:22:58.945381 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4b003c0d-225d-4657-959a-bcb352fda8b0-logs\") pod \"nova-api-0\" (UID: \"4b003c0d-225d-4657-959a-bcb352fda8b0\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:22:58 crc kubenswrapper[5120]: I0316 16:22:58.962165 5120 scope.go:117] "RemoveContainer" containerID="27ab5a2145cda5bf2a9c6c996111e4f37b4011dd09d39d5485fb0358de6d2079" Mar 16 16:22:58 crc kubenswrapper[5120]: E0316 16:22:58.962730 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"27ab5a2145cda5bf2a9c6c996111e4f37b4011dd09d39d5485fb0358de6d2079\": container with ID starting with 27ab5a2145cda5bf2a9c6c996111e4f37b4011dd09d39d5485fb0358de6d2079 not found: ID does not exist" containerID="27ab5a2145cda5bf2a9c6c996111e4f37b4011dd09d39d5485fb0358de6d2079" Mar 16 16:22:58 crc kubenswrapper[5120]: I0316 16:22:58.962862 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27ab5a2145cda5bf2a9c6c996111e4f37b4011dd09d39d5485fb0358de6d2079"} err="failed to get container status \"27ab5a2145cda5bf2a9c6c996111e4f37b4011dd09d39d5485fb0358de6d2079\": rpc error: code = NotFound desc = could not find container \"27ab5a2145cda5bf2a9c6c996111e4f37b4011dd09d39d5485fb0358de6d2079\": container with ID starting with 27ab5a2145cda5bf2a9c6c996111e4f37b4011dd09d39d5485fb0358de6d2079 not found: ID does not exist" Mar 16 16:22:58 crc kubenswrapper[5120]: I0316 16:22:58.962897 5120 scope.go:117] "RemoveContainer" containerID="15910d3f3bd767b34b15ad48f3cc8e4f19dd7a7634767acdf71362e43e7eee78" Mar 16 16:22:58 crc kubenswrapper[5120]: E0316 16:22:58.963179 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"15910d3f3bd767b34b15ad48f3cc8e4f19dd7a7634767acdf71362e43e7eee78\": container with ID starting with 15910d3f3bd767b34b15ad48f3cc8e4f19dd7a7634767acdf71362e43e7eee78 not found: ID does not exist" containerID="15910d3f3bd767b34b15ad48f3cc8e4f19dd7a7634767acdf71362e43e7eee78" Mar 16 16:22:58 crc kubenswrapper[5120]: I0316 16:22:58.963209 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15910d3f3bd767b34b15ad48f3cc8e4f19dd7a7634767acdf71362e43e7eee78"} err="failed to get container status \"15910d3f3bd767b34b15ad48f3cc8e4f19dd7a7634767acdf71362e43e7eee78\": rpc error: code = NotFound desc = could not find container \"15910d3f3bd767b34b15ad48f3cc8e4f19dd7a7634767acdf71362e43e7eee78\": container with ID starting with 15910d3f3bd767b34b15ad48f3cc8e4f19dd7a7634767acdf71362e43e7eee78 not found: ID does not exist" Mar 16 16:22:58 crc kubenswrapper[5120]: I0316 16:22:58.963230 5120 scope.go:117] "RemoveContainer" containerID="27ab5a2145cda5bf2a9c6c996111e4f37b4011dd09d39d5485fb0358de6d2079" Mar 16 16:22:58 crc kubenswrapper[5120]: I0316 16:22:58.963438 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27ab5a2145cda5bf2a9c6c996111e4f37b4011dd09d39d5485fb0358de6d2079"} err="failed to get container status \"27ab5a2145cda5bf2a9c6c996111e4f37b4011dd09d39d5485fb0358de6d2079\": rpc error: code = NotFound desc = could not find container \"27ab5a2145cda5bf2a9c6c996111e4f37b4011dd09d39d5485fb0358de6d2079\": container with ID starting with 27ab5a2145cda5bf2a9c6c996111e4f37b4011dd09d39d5485fb0358de6d2079 not found: ID does not exist" Mar 16 16:22:58 crc kubenswrapper[5120]: I0316 16:22:58.963474 5120 scope.go:117] "RemoveContainer" containerID="15910d3f3bd767b34b15ad48f3cc8e4f19dd7a7634767acdf71362e43e7eee78" Mar 16 16:22:58 crc kubenswrapper[5120]: I0316 16:22:58.963675 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15910d3f3bd767b34b15ad48f3cc8e4f19dd7a7634767acdf71362e43e7eee78"} err="failed to get container status \"15910d3f3bd767b34b15ad48f3cc8e4f19dd7a7634767acdf71362e43e7eee78\": rpc error: code = NotFound desc = could not find container \"15910d3f3bd767b34b15ad48f3cc8e4f19dd7a7634767acdf71362e43e7eee78\": container with ID starting with 15910d3f3bd767b34b15ad48f3cc8e4f19dd7a7634767acdf71362e43e7eee78 not found: ID does not exist" Mar 16 16:22:59 crc kubenswrapper[5120]: I0316 16:22:59.031385 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:22:59 crc kubenswrapper[5120]: I0316 16:22:59.047500 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dcb3276e-6f5a-4fea-8428-6c16ca81a07a-config-data\") pod \"ceilometer-0\" (UID: \"dcb3276e-6f5a-4fea-8428-6c16ca81a07a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:22:59 crc kubenswrapper[5120]: I0316 16:22:59.047713 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/dcb3276e-6f5a-4fea-8428-6c16ca81a07a-run-httpd\") pod \"ceilometer-0\" (UID: \"dcb3276e-6f5a-4fea-8428-6c16ca81a07a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:22:59 crc kubenswrapper[5120]: I0316 16:22:59.048033 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8gzwq\" (UniqueName: \"kubernetes.io/projected/dcb3276e-6f5a-4fea-8428-6c16ca81a07a-kube-api-access-8gzwq\") pod \"ceilometer-0\" (UID: \"dcb3276e-6f5a-4fea-8428-6c16ca81a07a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:22:59 crc kubenswrapper[5120]: I0316 16:22:59.048142 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4b003c0d-225d-4657-959a-bcb352fda8b0-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"4b003c0d-225d-4657-959a-bcb352fda8b0\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:22:59 crc kubenswrapper[5120]: I0316 16:22:59.048195 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/dcb3276e-6f5a-4fea-8428-6c16ca81a07a-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"dcb3276e-6f5a-4fea-8428-6c16ca81a07a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:22:59 crc kubenswrapper[5120]: I0316 16:22:59.048233 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dcb3276e-6f5a-4fea-8428-6c16ca81a07a-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"dcb3276e-6f5a-4fea-8428-6c16ca81a07a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:22:59 crc kubenswrapper[5120]: I0316 16:22:59.048331 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/dcb3276e-6f5a-4fea-8428-6c16ca81a07a-log-httpd\") pod \"ceilometer-0\" (UID: \"dcb3276e-6f5a-4fea-8428-6c16ca81a07a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:22:59 crc kubenswrapper[5120]: I0316 16:22:59.048416 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4b003c0d-225d-4657-959a-bcb352fda8b0-logs\") pod \"nova-api-0\" (UID: \"4b003c0d-225d-4657-959a-bcb352fda8b0\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:22:59 crc kubenswrapper[5120]: I0316 16:22:59.048563 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p8h82\" (UniqueName: \"kubernetes.io/projected/4b003c0d-225d-4657-959a-bcb352fda8b0-kube-api-access-p8h82\") pod \"nova-api-0\" (UID: \"4b003c0d-225d-4657-959a-bcb352fda8b0\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:22:59 crc kubenswrapper[5120]: I0316 16:22:59.048630 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/dcb3276e-6f5a-4fea-8428-6c16ca81a07a-scripts\") pod \"ceilometer-0\" (UID: \"dcb3276e-6f5a-4fea-8428-6c16ca81a07a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:22:59 crc kubenswrapper[5120]: I0316 16:22:59.048687 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4b003c0d-225d-4657-959a-bcb352fda8b0-config-data\") pod \"nova-api-0\" (UID: \"4b003c0d-225d-4657-959a-bcb352fda8b0\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:22:59 crc kubenswrapper[5120]: I0316 16:22:59.049531 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/dcb3276e-6f5a-4fea-8428-6c16ca81a07a-log-httpd\") pod \"ceilometer-0\" (UID: \"dcb3276e-6f5a-4fea-8428-6c16ca81a07a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:22:59 crc kubenswrapper[5120]: I0316 16:22:59.049714 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/dcb3276e-6f5a-4fea-8428-6c16ca81a07a-run-httpd\") pod \"ceilometer-0\" (UID: \"dcb3276e-6f5a-4fea-8428-6c16ca81a07a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:22:59 crc kubenswrapper[5120]: I0316 16:22:59.050336 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4b003c0d-225d-4657-959a-bcb352fda8b0-logs\") pod \"nova-api-0\" (UID: \"4b003c0d-225d-4657-959a-bcb352fda8b0\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:22:59 crc kubenswrapper[5120]: I0316 16:22:59.053045 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dcb3276e-6f5a-4fea-8428-6c16ca81a07a-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"dcb3276e-6f5a-4fea-8428-6c16ca81a07a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:22:59 crc kubenswrapper[5120]: I0316 16:22:59.053308 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dcb3276e-6f5a-4fea-8428-6c16ca81a07a-config-data\") pod \"ceilometer-0\" (UID: \"dcb3276e-6f5a-4fea-8428-6c16ca81a07a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:22:59 crc kubenswrapper[5120]: I0316 16:22:59.056068 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4b003c0d-225d-4657-959a-bcb352fda8b0-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"4b003c0d-225d-4657-959a-bcb352fda8b0\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:22:59 crc kubenswrapper[5120]: I0316 16:22:59.062347 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4b003c0d-225d-4657-959a-bcb352fda8b0-config-data\") pod \"nova-api-0\" (UID: \"4b003c0d-225d-4657-959a-bcb352fda8b0\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:22:59 crc kubenswrapper[5120]: I0316 16:22:59.062841 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/dcb3276e-6f5a-4fea-8428-6c16ca81a07a-scripts\") pod \"ceilometer-0\" (UID: \"dcb3276e-6f5a-4fea-8428-6c16ca81a07a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:22:59 crc kubenswrapper[5120]: I0316 16:22:59.063238 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/dcb3276e-6f5a-4fea-8428-6c16ca81a07a-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"dcb3276e-6f5a-4fea-8428-6c16ca81a07a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:22:59 crc kubenswrapper[5120]: I0316 16:22:59.064685 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gzwq\" (UniqueName: \"kubernetes.io/projected/dcb3276e-6f5a-4fea-8428-6c16ca81a07a-kube-api-access-8gzwq\") pod \"ceilometer-0\" (UID: \"dcb3276e-6f5a-4fea-8428-6c16ca81a07a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:22:59 crc kubenswrapper[5120]: I0316 16:22:59.067344 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8h82\" (UniqueName: \"kubernetes.io/projected/4b003c0d-225d-4657-959a-bcb352fda8b0-kube-api-access-p8h82\") pod \"nova-api-0\" (UID: \"4b003c0d-225d-4657-959a-bcb352fda8b0\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:22:59 crc kubenswrapper[5120]: I0316 16:22:59.181133 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:22:59 crc kubenswrapper[5120]: I0316 16:22:59.259086 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:22:59 crc kubenswrapper[5120]: W0316 16:22:59.616935 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4b003c0d_225d_4657_959a_bcb352fda8b0.slice/crio-912f7329bebd5d33c35f50343f5486fa967387140db68e62485576234cebf59c WatchSource:0}: Error finding container 912f7329bebd5d33c35f50343f5486fa967387140db68e62485576234cebf59c: Status 404 returned error can't find the container with id 912f7329bebd5d33c35f50343f5486fa967387140db68e62485576234cebf59c Mar 16 16:22:59 crc kubenswrapper[5120]: I0316 16:22:59.624926 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:22:59 crc kubenswrapper[5120]: I0316 16:22:59.648574 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"eedcb5c7-fe1f-48f2-bf88-bd0b575ec7b8","Type":"ContainerStarted","Data":"b979b959b9e2f2a85db0ec5f02671dff3b1a1c16d93dbd2e801d78ac41eda407"} Mar 16 16:22:59 crc kubenswrapper[5120]: I0316 16:22:59.648615 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"eedcb5c7-fe1f-48f2-bf88-bd0b575ec7b8","Type":"ContainerStarted","Data":"7d7bf8507bc45f796a191a74fdf34c80357ce8dce004416d099b4969624163bb"} Mar 16 16:22:59 crc kubenswrapper[5120]: I0316 16:22:59.648627 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"eedcb5c7-fe1f-48f2-bf88-bd0b575ec7b8","Type":"ContainerStarted","Data":"b619986d1ba689ff7ed868cbfda2461b18d1f3ee8858cd15b9cf4a7ffcdf42ba"} Mar 16 16:22:59 crc kubenswrapper[5120]: I0316 16:22:59.654199 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"4b003c0d-225d-4657-959a-bcb352fda8b0","Type":"ContainerStarted","Data":"912f7329bebd5d33c35f50343f5486fa967387140db68e62485576234cebf59c"} Mar 16 16:22:59 crc kubenswrapper[5120]: I0316 16:22:59.670647 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=2.670628211 podStartE2EDuration="2.670628211s" podCreationTimestamp="2026-03-16 16:22:57 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:22:59.668341251 +0000 UTC m=+3081.822272908" watchObservedRunningTime="2026-03-16 16:22:59.670628211 +0000 UTC m=+3081.824559868" Mar 16 16:22:59 crc kubenswrapper[5120]: W0316 16:22:59.741755 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddcb3276e_6f5a_4fea_8428_6c16ca81a07a.slice/crio-180c7fc2d2ca2ed1e90054c6360b1f4a6caace087cd2f2b13da98db51fa4a31b WatchSource:0}: Error finding container 180c7fc2d2ca2ed1e90054c6360b1f4a6caace087cd2f2b13da98db51fa4a31b: Status 404 returned error can't find the container with id 180c7fc2d2ca2ed1e90054c6360b1f4a6caace087cd2f2b13da98db51fa4a31b Mar 16 16:22:59 crc kubenswrapper[5120]: I0316 16:22:59.746519 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:23:00 crc kubenswrapper[5120]: I0316 16:23:00.358329 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:23:00 crc kubenswrapper[5120]: I0316 16:23:00.662632 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"dcb3276e-6f5a-4fea-8428-6c16ca81a07a","Type":"ContainerStarted","Data":"c3c5a0b6f157f90744850c14f4a79b95328a38cc804e65089108fdea76983af0"} Mar 16 16:23:00 crc kubenswrapper[5120]: I0316 16:23:00.662685 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"dcb3276e-6f5a-4fea-8428-6c16ca81a07a","Type":"ContainerStarted","Data":"180c7fc2d2ca2ed1e90054c6360b1f4a6caace087cd2f2b13da98db51fa4a31b"} Mar 16 16:23:00 crc kubenswrapper[5120]: I0316 16:23:00.673208 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0e8671c6-1540-4375-8eb9-222bbcab34d8" path="/var/lib/kubelet/pods/0e8671c6-1540-4375-8eb9-222bbcab34d8/volumes" Mar 16 16:23:00 crc kubenswrapper[5120]: I0316 16:23:00.673849 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f" path="/var/lib/kubelet/pods/74e6d08e-1d82-4a78-9fb6-d1a4e19e2f6f/volumes" Mar 16 16:23:00 crc kubenswrapper[5120]: I0316 16:23:00.674585 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"4b003c0d-225d-4657-959a-bcb352fda8b0","Type":"ContainerStarted","Data":"7a82cf48a06efa34bb69573643a1a3f1f4da758a7ecbd8c37ee11192bdd5b73e"} Mar 16 16:23:00 crc kubenswrapper[5120]: I0316 16:23:00.674622 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"4b003c0d-225d-4657-959a-bcb352fda8b0","Type":"ContainerStarted","Data":"abecdba26b6bff68777a897c6b9fc5029b3fe4c248555a514a0f020e41a8ff25"} Mar 16 16:23:00 crc kubenswrapper[5120]: I0316 16:23:00.680903 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=2.680882983 podStartE2EDuration="2.680882983s" podCreationTimestamp="2026-03-16 16:22:58 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:23:00.679360853 +0000 UTC m=+3082.833292510" watchObservedRunningTime="2026-03-16 16:23:00.680882983 +0000 UTC m=+3082.834814640" Mar 16 16:23:01 crc kubenswrapper[5120]: I0316 16:23:01.685062 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"dcb3276e-6f5a-4fea-8428-6c16ca81a07a","Type":"ContainerStarted","Data":"bfc7ca57a071c668257867f7d127c752f82d675faaea323a62e42a21f179772f"} Mar 16 16:23:02 crc kubenswrapper[5120]: I0316 16:23:02.701541 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"dcb3276e-6f5a-4fea-8428-6c16ca81a07a","Type":"ContainerStarted","Data":"6034e92d58dd5d1606c4810dafd10d1bbe734690458d5af960764b5c89664ccc"} Mar 16 16:23:04 crc kubenswrapper[5120]: I0316 16:23:04.688105 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:23:04 crc kubenswrapper[5120]: I0316 16:23:04.734571 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"dcb3276e-6f5a-4fea-8428-6c16ca81a07a","Type":"ContainerStarted","Data":"e0c45f416370a2663e2005580cbac7f56864a27b77c00cdac6e73309470099cc"} Mar 16 16:23:04 crc kubenswrapper[5120]: I0316 16:23:04.734774 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:23:04 crc kubenswrapper[5120]: I0316 16:23:04.764487 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.912720233 podStartE2EDuration="6.764463757s" podCreationTimestamp="2026-03-16 16:22:58 +0000 UTC" firstStartedPulling="2026-03-16 16:22:59.743344586 +0000 UTC m=+3081.897276243" lastFinishedPulling="2026-03-16 16:23:03.59508811 +0000 UTC m=+3085.749019767" observedRunningTime="2026-03-16 16:23:04.760706227 +0000 UTC m=+3086.914637914" watchObservedRunningTime="2026-03-16 16:23:04.764463757 +0000 UTC m=+3086.918395444" Mar 16 16:23:05 crc kubenswrapper[5120]: I0316 16:23:05.358358 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:23:05 crc kubenswrapper[5120]: I0316 16:23:05.380391 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:23:05 crc kubenswrapper[5120]: I0316 16:23:05.771155 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:23:05 crc kubenswrapper[5120]: I0316 16:23:05.965934 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-j6td6"] Mar 16 16:23:05 crc kubenswrapper[5120]: I0316 16:23:05.972033 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-j6td6" Mar 16 16:23:05 crc kubenswrapper[5120]: I0316 16:23:05.974099 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-j6td6"] Mar 16 16:23:05 crc kubenswrapper[5120]: I0316 16:23:05.976193 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-manage-config-data\"" Mar 16 16:23:05 crc kubenswrapper[5120]: I0316 16:23:05.976349 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-manage-scripts\"" Mar 16 16:23:06 crc kubenswrapper[5120]: I0316 16:23:06.041179 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2w8h5\" (UniqueName: \"kubernetes.io/projected/ebe87fc0-a7b8-4344-bb8d-3bd243ef0bbf-kube-api-access-2w8h5\") pod \"nova-cell1-cell-mapping-j6td6\" (UID: \"ebe87fc0-a7b8-4344-bb8d-3bd243ef0bbf\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-j6td6" Mar 16 16:23:06 crc kubenswrapper[5120]: I0316 16:23:06.041293 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ebe87fc0-a7b8-4344-bb8d-3bd243ef0bbf-config-data\") pod \"nova-cell1-cell-mapping-j6td6\" (UID: \"ebe87fc0-a7b8-4344-bb8d-3bd243ef0bbf\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-j6td6" Mar 16 16:23:06 crc kubenswrapper[5120]: I0316 16:23:06.041381 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ebe87fc0-a7b8-4344-bb8d-3bd243ef0bbf-scripts\") pod \"nova-cell1-cell-mapping-j6td6\" (UID: \"ebe87fc0-a7b8-4344-bb8d-3bd243ef0bbf\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-j6td6" Mar 16 16:23:06 crc kubenswrapper[5120]: I0316 16:23:06.041503 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ebe87fc0-a7b8-4344-bb8d-3bd243ef0bbf-combined-ca-bundle\") pod \"nova-cell1-cell-mapping-j6td6\" (UID: \"ebe87fc0-a7b8-4344-bb8d-3bd243ef0bbf\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-j6td6" Mar 16 16:23:06 crc kubenswrapper[5120]: I0316 16:23:06.144501 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ebe87fc0-a7b8-4344-bb8d-3bd243ef0bbf-combined-ca-bundle\") pod \"nova-cell1-cell-mapping-j6td6\" (UID: \"ebe87fc0-a7b8-4344-bb8d-3bd243ef0bbf\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-j6td6" Mar 16 16:23:06 crc kubenswrapper[5120]: I0316 16:23:06.145100 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2w8h5\" (UniqueName: \"kubernetes.io/projected/ebe87fc0-a7b8-4344-bb8d-3bd243ef0bbf-kube-api-access-2w8h5\") pod \"nova-cell1-cell-mapping-j6td6\" (UID: \"ebe87fc0-a7b8-4344-bb8d-3bd243ef0bbf\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-j6td6" Mar 16 16:23:06 crc kubenswrapper[5120]: I0316 16:23:06.145341 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ebe87fc0-a7b8-4344-bb8d-3bd243ef0bbf-config-data\") pod \"nova-cell1-cell-mapping-j6td6\" (UID: \"ebe87fc0-a7b8-4344-bb8d-3bd243ef0bbf\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-j6td6" Mar 16 16:23:06 crc kubenswrapper[5120]: I0316 16:23:06.145427 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ebe87fc0-a7b8-4344-bb8d-3bd243ef0bbf-scripts\") pod \"nova-cell1-cell-mapping-j6td6\" (UID: \"ebe87fc0-a7b8-4344-bb8d-3bd243ef0bbf\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-j6td6" Mar 16 16:23:06 crc kubenswrapper[5120]: I0316 16:23:06.151589 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ebe87fc0-a7b8-4344-bb8d-3bd243ef0bbf-scripts\") pod \"nova-cell1-cell-mapping-j6td6\" (UID: \"ebe87fc0-a7b8-4344-bb8d-3bd243ef0bbf\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-j6td6" Mar 16 16:23:06 crc kubenswrapper[5120]: I0316 16:23:06.158510 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ebe87fc0-a7b8-4344-bb8d-3bd243ef0bbf-config-data\") pod \"nova-cell1-cell-mapping-j6td6\" (UID: \"ebe87fc0-a7b8-4344-bb8d-3bd243ef0bbf\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-j6td6" Mar 16 16:23:06 crc kubenswrapper[5120]: I0316 16:23:06.162181 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ebe87fc0-a7b8-4344-bb8d-3bd243ef0bbf-combined-ca-bundle\") pod \"nova-cell1-cell-mapping-j6td6\" (UID: \"ebe87fc0-a7b8-4344-bb8d-3bd243ef0bbf\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-j6td6" Mar 16 16:23:06 crc kubenswrapper[5120]: I0316 16:23:06.171634 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2w8h5\" (UniqueName: \"kubernetes.io/projected/ebe87fc0-a7b8-4344-bb8d-3bd243ef0bbf-kube-api-access-2w8h5\") pod \"nova-cell1-cell-mapping-j6td6\" (UID: \"ebe87fc0-a7b8-4344-bb8d-3bd243ef0bbf\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-j6td6" Mar 16 16:23:06 crc kubenswrapper[5120]: I0316 16:23:06.329228 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-j6td6" Mar 16 16:23:06 crc kubenswrapper[5120]: I0316 16:23:06.797707 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-j6td6"] Mar 16 16:23:06 crc kubenswrapper[5120]: I0316 16:23:06.801991 5120 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Mar 16 16:23:07 crc kubenswrapper[5120]: I0316 16:23:07.769855 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-j6td6" event={"ID":"ebe87fc0-a7b8-4344-bb8d-3bd243ef0bbf","Type":"ContainerStarted","Data":"ec2b7b351db4491f5eb3973d4802ee60b890c0212d81d8e0093d1acfc93c3718"} Mar 16 16:23:07 crc kubenswrapper[5120]: I0316 16:23:07.770127 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-j6td6" event={"ID":"ebe87fc0-a7b8-4344-bb8d-3bd243ef0bbf","Type":"ContainerStarted","Data":"92fa4c5a2583c040f5c8e59e3173b53628935b4bbf58b63f0a64d8cb08d6e8fa"} Mar 16 16:23:07 crc kubenswrapper[5120]: I0316 16:23:07.797539 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-j6td6" podStartSLOduration=2.797521674 podStartE2EDuration="2.797521674s" podCreationTimestamp="2026-03-16 16:23:05 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:23:07.791555303 +0000 UTC m=+3089.945486980" watchObservedRunningTime="2026-03-16 16:23:07.797521674 +0000 UTC m=+3089.951453341" Mar 16 16:23:08 crc kubenswrapper[5120]: I0316 16:23:08.156460 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:23:08 crc kubenswrapper[5120]: I0316 16:23:08.156686 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:23:08 crc kubenswrapper[5120]: E0316 16:23:08.247988 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1912810 actualBytes=10240 Mar 16 16:23:09 crc kubenswrapper[5120]: I0316 16:23:09.162111 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="eedcb5c7-fe1f-48f2-bf88-bd0b575ec7b8" containerName="nova-metadata-log" probeResult="failure" output="Get \"https://10.217.1.135:8775/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 16:23:09 crc kubenswrapper[5120]: I0316 16:23:09.165325 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="eedcb5c7-fe1f-48f2-bf88-bd0b575ec7b8" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"https://10.217.1.135:8775/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Mar 16 16:23:09 crc kubenswrapper[5120]: I0316 16:23:09.181751 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:23:09 crc kubenswrapper[5120]: I0316 16:23:09.182190 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:23:10 crc kubenswrapper[5120]: I0316 16:23:10.222910 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="4b003c0d-225d-4657-959a-bcb352fda8b0" containerName="nova-api-api" probeResult="failure" output="Get \"http://10.217.1.136:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 16:23:10 crc kubenswrapper[5120]: I0316 16:23:10.223009 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="4b003c0d-225d-4657-959a-bcb352fda8b0" containerName="nova-api-log" probeResult="failure" output="Get \"http://10.217.1.136:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 16:23:10 crc kubenswrapper[5120]: I0316 16:23:10.663785 5120 scope.go:117] "RemoveContainer" containerID="f40e444f89abd558ac90555bfd58e04a1c4379a653ba8035c228d2b7a5443eb5" Mar 16 16:23:10 crc kubenswrapper[5120]: E0316 16:23:10.664132 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:23:11 crc kubenswrapper[5120]: I0316 16:23:11.815368 5120 generic.go:358] "Generic (PLEG): container finished" podID="ebe87fc0-a7b8-4344-bb8d-3bd243ef0bbf" containerID="ec2b7b351db4491f5eb3973d4802ee60b890c0212d81d8e0093d1acfc93c3718" exitCode=0 Mar 16 16:23:11 crc kubenswrapper[5120]: I0316 16:23:11.815472 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-j6td6" event={"ID":"ebe87fc0-a7b8-4344-bb8d-3bd243ef0bbf","Type":"ContainerDied","Data":"ec2b7b351db4491f5eb3973d4802ee60b890c0212d81d8e0093d1acfc93c3718"} Mar 16 16:23:13 crc kubenswrapper[5120]: I0316 16:23:13.257750 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-j6td6" Mar 16 16:23:13 crc kubenswrapper[5120]: I0316 16:23:13.340093 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ebe87fc0-a7b8-4344-bb8d-3bd243ef0bbf-scripts\") pod \"ebe87fc0-a7b8-4344-bb8d-3bd243ef0bbf\" (UID: \"ebe87fc0-a7b8-4344-bb8d-3bd243ef0bbf\") " Mar 16 16:23:13 crc kubenswrapper[5120]: I0316 16:23:13.340183 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2w8h5\" (UniqueName: \"kubernetes.io/projected/ebe87fc0-a7b8-4344-bb8d-3bd243ef0bbf-kube-api-access-2w8h5\") pod \"ebe87fc0-a7b8-4344-bb8d-3bd243ef0bbf\" (UID: \"ebe87fc0-a7b8-4344-bb8d-3bd243ef0bbf\") " Mar 16 16:23:13 crc kubenswrapper[5120]: I0316 16:23:13.340479 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ebe87fc0-a7b8-4344-bb8d-3bd243ef0bbf-combined-ca-bundle\") pod \"ebe87fc0-a7b8-4344-bb8d-3bd243ef0bbf\" (UID: \"ebe87fc0-a7b8-4344-bb8d-3bd243ef0bbf\") " Mar 16 16:23:13 crc kubenswrapper[5120]: I0316 16:23:13.340563 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ebe87fc0-a7b8-4344-bb8d-3bd243ef0bbf-config-data\") pod \"ebe87fc0-a7b8-4344-bb8d-3bd243ef0bbf\" (UID: \"ebe87fc0-a7b8-4344-bb8d-3bd243ef0bbf\") " Mar 16 16:23:13 crc kubenswrapper[5120]: I0316 16:23:13.349295 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ebe87fc0-a7b8-4344-bb8d-3bd243ef0bbf-scripts" (OuterVolumeSpecName: "scripts") pod "ebe87fc0-a7b8-4344-bb8d-3bd243ef0bbf" (UID: "ebe87fc0-a7b8-4344-bb8d-3bd243ef0bbf"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:23:13 crc kubenswrapper[5120]: I0316 16:23:13.352748 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ebe87fc0-a7b8-4344-bb8d-3bd243ef0bbf-kube-api-access-2w8h5" (OuterVolumeSpecName: "kube-api-access-2w8h5") pod "ebe87fc0-a7b8-4344-bb8d-3bd243ef0bbf" (UID: "ebe87fc0-a7b8-4344-bb8d-3bd243ef0bbf"). InnerVolumeSpecName "kube-api-access-2w8h5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:23:13 crc kubenswrapper[5120]: I0316 16:23:13.383150 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ebe87fc0-a7b8-4344-bb8d-3bd243ef0bbf-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ebe87fc0-a7b8-4344-bb8d-3bd243ef0bbf" (UID: "ebe87fc0-a7b8-4344-bb8d-3bd243ef0bbf"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:23:13 crc kubenswrapper[5120]: I0316 16:23:13.390119 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ebe87fc0-a7b8-4344-bb8d-3bd243ef0bbf-config-data" (OuterVolumeSpecName: "config-data") pod "ebe87fc0-a7b8-4344-bb8d-3bd243ef0bbf" (UID: "ebe87fc0-a7b8-4344-bb8d-3bd243ef0bbf"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:23:13 crc kubenswrapper[5120]: I0316 16:23:13.443989 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ebe87fc0-a7b8-4344-bb8d-3bd243ef0bbf-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:23:13 crc kubenswrapper[5120]: I0316 16:23:13.444021 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ebe87fc0-a7b8-4344-bb8d-3bd243ef0bbf-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:23:13 crc kubenswrapper[5120]: I0316 16:23:13.444031 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2w8h5\" (UniqueName: \"kubernetes.io/projected/ebe87fc0-a7b8-4344-bb8d-3bd243ef0bbf-kube-api-access-2w8h5\") on node \"crc\" DevicePath \"\"" Mar 16 16:23:13 crc kubenswrapper[5120]: I0316 16:23:13.444042 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ebe87fc0-a7b8-4344-bb8d-3bd243ef0bbf-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:23:13 crc kubenswrapper[5120]: I0316 16:23:13.841804 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-j6td6" event={"ID":"ebe87fc0-a7b8-4344-bb8d-3bd243ef0bbf","Type":"ContainerDied","Data":"92fa4c5a2583c040f5c8e59e3173b53628935b4bbf58b63f0a64d8cb08d6e8fa"} Mar 16 16:23:13 crc kubenswrapper[5120]: I0316 16:23:13.841841 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-j6td6" Mar 16 16:23:13 crc kubenswrapper[5120]: I0316 16:23:13.841859 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="92fa4c5a2583c040f5c8e59e3173b53628935b4bbf58b63f0a64d8cb08d6e8fa" Mar 16 16:23:14 crc kubenswrapper[5120]: I0316 16:23:14.027477 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:23:14 crc kubenswrapper[5120]: I0316 16:23:14.027784 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="4b003c0d-225d-4657-959a-bcb352fda8b0" containerName="nova-api-log" containerID="cri-o://abecdba26b6bff68777a897c6b9fc5029b3fe4c248555a514a0f020e41a8ff25" gracePeriod=30 Mar 16 16:23:14 crc kubenswrapper[5120]: I0316 16:23:14.027867 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="4b003c0d-225d-4657-959a-bcb352fda8b0" containerName="nova-api-api" containerID="cri-o://7a82cf48a06efa34bb69573643a1a3f1f4da758a7ecbd8c37ee11192bdd5b73e" gracePeriod=30 Mar 16 16:23:14 crc kubenswrapper[5120]: I0316 16:23:14.068041 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:23:14 crc kubenswrapper[5120]: I0316 16:23:14.068608 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="eedcb5c7-fe1f-48f2-bf88-bd0b575ec7b8" containerName="nova-metadata-log" containerID="cri-o://7d7bf8507bc45f796a191a74fdf34c80357ce8dce004416d099b4969624163bb" gracePeriod=30 Mar 16 16:23:14 crc kubenswrapper[5120]: I0316 16:23:14.069110 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="eedcb5c7-fe1f-48f2-bf88-bd0b575ec7b8" containerName="nova-metadata-metadata" containerID="cri-o://b979b959b9e2f2a85db0ec5f02671dff3b1a1c16d93dbd2e801d78ac41eda407" gracePeriod=30 Mar 16 16:23:14 crc kubenswrapper[5120]: I0316 16:23:14.855284 5120 generic.go:358] "Generic (PLEG): container finished" podID="eedcb5c7-fe1f-48f2-bf88-bd0b575ec7b8" containerID="7d7bf8507bc45f796a191a74fdf34c80357ce8dce004416d099b4969624163bb" exitCode=143 Mar 16 16:23:14 crc kubenswrapper[5120]: I0316 16:23:14.855394 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"eedcb5c7-fe1f-48f2-bf88-bd0b575ec7b8","Type":"ContainerDied","Data":"7d7bf8507bc45f796a191a74fdf34c80357ce8dce004416d099b4969624163bb"} Mar 16 16:23:14 crc kubenswrapper[5120]: I0316 16:23:14.858810 5120 generic.go:358] "Generic (PLEG): container finished" podID="4b003c0d-225d-4657-959a-bcb352fda8b0" containerID="abecdba26b6bff68777a897c6b9fc5029b3fe4c248555a514a0f020e41a8ff25" exitCode=143 Mar 16 16:23:14 crc kubenswrapper[5120]: I0316 16:23:14.859209 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"4b003c0d-225d-4657-959a-bcb352fda8b0","Type":"ContainerDied","Data":"abecdba26b6bff68777a897c6b9fc5029b3fe4c248555a514a0f020e41a8ff25"} Mar 16 16:23:14 crc kubenswrapper[5120]: I0316 16:23:14.875227 5120 scope.go:117] "RemoveContainer" containerID="5850cdaacaa2728289ea6d253949dda18d2b7ab63a5336423e60e4a606603ca7" Mar 16 16:23:16 crc kubenswrapper[5120]: I0316 16:23:16.156041 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:23:16 crc kubenswrapper[5120]: I0316 16:23:16.156527 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:23:17 crc kubenswrapper[5120]: I0316 16:23:17.186023 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:23:17 crc kubenswrapper[5120]: I0316 16:23:17.186067 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:23:17 crc kubenswrapper[5120]: I0316 16:23:17.742069 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:23:17 crc kubenswrapper[5120]: I0316 16:23:17.746304 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:23:17 crc kubenswrapper[5120]: I0316 16:23:17.876580 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4b003c0d-225d-4657-959a-bcb352fda8b0-config-data\") pod \"4b003c0d-225d-4657-959a-bcb352fda8b0\" (UID: \"4b003c0d-225d-4657-959a-bcb352fda8b0\") " Mar 16 16:23:17 crc kubenswrapper[5120]: I0316 16:23:17.876950 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/eedcb5c7-fe1f-48f2-bf88-bd0b575ec7b8-config-data\") pod \"eedcb5c7-fe1f-48f2-bf88-bd0b575ec7b8\" (UID: \"eedcb5c7-fe1f-48f2-bf88-bd0b575ec7b8\") " Mar 16 16:23:17 crc kubenswrapper[5120]: I0316 16:23:17.877013 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eedcb5c7-fe1f-48f2-bf88-bd0b575ec7b8-combined-ca-bundle\") pod \"eedcb5c7-fe1f-48f2-bf88-bd0b575ec7b8\" (UID: \"eedcb5c7-fe1f-48f2-bf88-bd0b575ec7b8\") " Mar 16 16:23:17 crc kubenswrapper[5120]: I0316 16:23:17.877080 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p8h82\" (UniqueName: \"kubernetes.io/projected/4b003c0d-225d-4657-959a-bcb352fda8b0-kube-api-access-p8h82\") pod \"4b003c0d-225d-4657-959a-bcb352fda8b0\" (UID: \"4b003c0d-225d-4657-959a-bcb352fda8b0\") " Mar 16 16:23:17 crc kubenswrapper[5120]: I0316 16:23:17.877200 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4b003c0d-225d-4657-959a-bcb352fda8b0-combined-ca-bundle\") pod \"4b003c0d-225d-4657-959a-bcb352fda8b0\" (UID: \"4b003c0d-225d-4657-959a-bcb352fda8b0\") " Mar 16 16:23:17 crc kubenswrapper[5120]: I0316 16:23:17.877261 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/eedcb5c7-fe1f-48f2-bf88-bd0b575ec7b8-logs\") pod \"eedcb5c7-fe1f-48f2-bf88-bd0b575ec7b8\" (UID: \"eedcb5c7-fe1f-48f2-bf88-bd0b575ec7b8\") " Mar 16 16:23:17 crc kubenswrapper[5120]: I0316 16:23:17.877482 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4b003c0d-225d-4657-959a-bcb352fda8b0-logs\") pod \"4b003c0d-225d-4657-959a-bcb352fda8b0\" (UID: \"4b003c0d-225d-4657-959a-bcb352fda8b0\") " Mar 16 16:23:17 crc kubenswrapper[5120]: I0316 16:23:17.877674 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eedcb5c7-fe1f-48f2-bf88-bd0b575ec7b8-logs" (OuterVolumeSpecName: "logs") pod "eedcb5c7-fe1f-48f2-bf88-bd0b575ec7b8" (UID: "eedcb5c7-fe1f-48f2-bf88-bd0b575ec7b8"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:23:17 crc kubenswrapper[5120]: I0316 16:23:17.877857 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/eedcb5c7-fe1f-48f2-bf88-bd0b575ec7b8-nova-metadata-tls-certs\") pod \"eedcb5c7-fe1f-48f2-bf88-bd0b575ec7b8\" (UID: \"eedcb5c7-fe1f-48f2-bf88-bd0b575ec7b8\") " Mar 16 16:23:17 crc kubenswrapper[5120]: I0316 16:23:17.878059 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b003c0d-225d-4657-959a-bcb352fda8b0-logs" (OuterVolumeSpecName: "logs") pod "4b003c0d-225d-4657-959a-bcb352fda8b0" (UID: "4b003c0d-225d-4657-959a-bcb352fda8b0"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:23:17 crc kubenswrapper[5120]: I0316 16:23:17.878070 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hzg9t\" (UniqueName: \"kubernetes.io/projected/eedcb5c7-fe1f-48f2-bf88-bd0b575ec7b8-kube-api-access-hzg9t\") pod \"eedcb5c7-fe1f-48f2-bf88-bd0b575ec7b8\" (UID: \"eedcb5c7-fe1f-48f2-bf88-bd0b575ec7b8\") " Mar 16 16:23:17 crc kubenswrapper[5120]: I0316 16:23:17.879584 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/eedcb5c7-fe1f-48f2-bf88-bd0b575ec7b8-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:23:17 crc kubenswrapper[5120]: I0316 16:23:17.879619 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4b003c0d-225d-4657-959a-bcb352fda8b0-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:23:17 crc kubenswrapper[5120]: I0316 16:23:17.882255 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b003c0d-225d-4657-959a-bcb352fda8b0-kube-api-access-p8h82" (OuterVolumeSpecName: "kube-api-access-p8h82") pod "4b003c0d-225d-4657-959a-bcb352fda8b0" (UID: "4b003c0d-225d-4657-959a-bcb352fda8b0"). InnerVolumeSpecName "kube-api-access-p8h82". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:23:17 crc kubenswrapper[5120]: I0316 16:23:17.882404 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eedcb5c7-fe1f-48f2-bf88-bd0b575ec7b8-kube-api-access-hzg9t" (OuterVolumeSpecName: "kube-api-access-hzg9t") pod "eedcb5c7-fe1f-48f2-bf88-bd0b575ec7b8" (UID: "eedcb5c7-fe1f-48f2-bf88-bd0b575ec7b8"). InnerVolumeSpecName "kube-api-access-hzg9t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:23:17 crc kubenswrapper[5120]: I0316 16:23:17.899247 5120 generic.go:358] "Generic (PLEG): container finished" podID="eedcb5c7-fe1f-48f2-bf88-bd0b575ec7b8" containerID="b979b959b9e2f2a85db0ec5f02671dff3b1a1c16d93dbd2e801d78ac41eda407" exitCode=0 Mar 16 16:23:17 crc kubenswrapper[5120]: I0316 16:23:17.899333 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:23:17 crc kubenswrapper[5120]: I0316 16:23:17.899381 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"eedcb5c7-fe1f-48f2-bf88-bd0b575ec7b8","Type":"ContainerDied","Data":"b979b959b9e2f2a85db0ec5f02671dff3b1a1c16d93dbd2e801d78ac41eda407"} Mar 16 16:23:17 crc kubenswrapper[5120]: I0316 16:23:17.899430 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"eedcb5c7-fe1f-48f2-bf88-bd0b575ec7b8","Type":"ContainerDied","Data":"b619986d1ba689ff7ed868cbfda2461b18d1f3ee8858cd15b9cf4a7ffcdf42ba"} Mar 16 16:23:17 crc kubenswrapper[5120]: I0316 16:23:17.899446 5120 scope.go:117] "RemoveContainer" containerID="b979b959b9e2f2a85db0ec5f02671dff3b1a1c16d93dbd2e801d78ac41eda407" Mar 16 16:23:17 crc kubenswrapper[5120]: I0316 16:23:17.903035 5120 generic.go:358] "Generic (PLEG): container finished" podID="4b003c0d-225d-4657-959a-bcb352fda8b0" containerID="7a82cf48a06efa34bb69573643a1a3f1f4da758a7ecbd8c37ee11192bdd5b73e" exitCode=0 Mar 16 16:23:17 crc kubenswrapper[5120]: I0316 16:23:17.903089 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"4b003c0d-225d-4657-959a-bcb352fda8b0","Type":"ContainerDied","Data":"7a82cf48a06efa34bb69573643a1a3f1f4da758a7ecbd8c37ee11192bdd5b73e"} Mar 16 16:23:17 crc kubenswrapper[5120]: I0316 16:23:17.903107 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"4b003c0d-225d-4657-959a-bcb352fda8b0","Type":"ContainerDied","Data":"912f7329bebd5d33c35f50343f5486fa967387140db68e62485576234cebf59c"} Mar 16 16:23:17 crc kubenswrapper[5120]: I0316 16:23:17.903175 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:23:17 crc kubenswrapper[5120]: I0316 16:23:17.906635 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b003c0d-225d-4657-959a-bcb352fda8b0-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "4b003c0d-225d-4657-959a-bcb352fda8b0" (UID: "4b003c0d-225d-4657-959a-bcb352fda8b0"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:23:17 crc kubenswrapper[5120]: I0316 16:23:17.910554 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eedcb5c7-fe1f-48f2-bf88-bd0b575ec7b8-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "eedcb5c7-fe1f-48f2-bf88-bd0b575ec7b8" (UID: "eedcb5c7-fe1f-48f2-bf88-bd0b575ec7b8"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:23:17 crc kubenswrapper[5120]: I0316 16:23:17.912282 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b003c0d-225d-4657-959a-bcb352fda8b0-config-data" (OuterVolumeSpecName: "config-data") pod "4b003c0d-225d-4657-959a-bcb352fda8b0" (UID: "4b003c0d-225d-4657-959a-bcb352fda8b0"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:23:17 crc kubenswrapper[5120]: I0316 16:23:17.916707 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eedcb5c7-fe1f-48f2-bf88-bd0b575ec7b8-config-data" (OuterVolumeSpecName: "config-data") pod "eedcb5c7-fe1f-48f2-bf88-bd0b575ec7b8" (UID: "eedcb5c7-fe1f-48f2-bf88-bd0b575ec7b8"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:23:17 crc kubenswrapper[5120]: I0316 16:23:17.937838 5120 scope.go:117] "RemoveContainer" containerID="7d7bf8507bc45f796a191a74fdf34c80357ce8dce004416d099b4969624163bb" Mar 16 16:23:17 crc kubenswrapper[5120]: I0316 16:23:17.939337 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eedcb5c7-fe1f-48f2-bf88-bd0b575ec7b8-nova-metadata-tls-certs" (OuterVolumeSpecName: "nova-metadata-tls-certs") pod "eedcb5c7-fe1f-48f2-bf88-bd0b575ec7b8" (UID: "eedcb5c7-fe1f-48f2-bf88-bd0b575ec7b8"). InnerVolumeSpecName "nova-metadata-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:23:17 crc kubenswrapper[5120]: I0316 16:23:17.960670 5120 scope.go:117] "RemoveContainer" containerID="b979b959b9e2f2a85db0ec5f02671dff3b1a1c16d93dbd2e801d78ac41eda407" Mar 16 16:23:17 crc kubenswrapper[5120]: E0316 16:23:17.960966 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b979b959b9e2f2a85db0ec5f02671dff3b1a1c16d93dbd2e801d78ac41eda407\": container with ID starting with b979b959b9e2f2a85db0ec5f02671dff3b1a1c16d93dbd2e801d78ac41eda407 not found: ID does not exist" containerID="b979b959b9e2f2a85db0ec5f02671dff3b1a1c16d93dbd2e801d78ac41eda407" Mar 16 16:23:17 crc kubenswrapper[5120]: I0316 16:23:17.960998 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b979b959b9e2f2a85db0ec5f02671dff3b1a1c16d93dbd2e801d78ac41eda407"} err="failed to get container status \"b979b959b9e2f2a85db0ec5f02671dff3b1a1c16d93dbd2e801d78ac41eda407\": rpc error: code = NotFound desc = could not find container \"b979b959b9e2f2a85db0ec5f02671dff3b1a1c16d93dbd2e801d78ac41eda407\": container with ID starting with b979b959b9e2f2a85db0ec5f02671dff3b1a1c16d93dbd2e801d78ac41eda407 not found: ID does not exist" Mar 16 16:23:17 crc kubenswrapper[5120]: I0316 16:23:17.961019 5120 scope.go:117] "RemoveContainer" containerID="7d7bf8507bc45f796a191a74fdf34c80357ce8dce004416d099b4969624163bb" Mar 16 16:23:17 crc kubenswrapper[5120]: E0316 16:23:17.961222 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d7bf8507bc45f796a191a74fdf34c80357ce8dce004416d099b4969624163bb\": container with ID starting with 7d7bf8507bc45f796a191a74fdf34c80357ce8dce004416d099b4969624163bb not found: ID does not exist" containerID="7d7bf8507bc45f796a191a74fdf34c80357ce8dce004416d099b4969624163bb" Mar 16 16:23:17 crc kubenswrapper[5120]: I0316 16:23:17.961248 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d7bf8507bc45f796a191a74fdf34c80357ce8dce004416d099b4969624163bb"} err="failed to get container status \"7d7bf8507bc45f796a191a74fdf34c80357ce8dce004416d099b4969624163bb\": rpc error: code = NotFound desc = could not find container \"7d7bf8507bc45f796a191a74fdf34c80357ce8dce004416d099b4969624163bb\": container with ID starting with 7d7bf8507bc45f796a191a74fdf34c80357ce8dce004416d099b4969624163bb not found: ID does not exist" Mar 16 16:23:17 crc kubenswrapper[5120]: I0316 16:23:17.961261 5120 scope.go:117] "RemoveContainer" containerID="7a82cf48a06efa34bb69573643a1a3f1f4da758a7ecbd8c37ee11192bdd5b73e" Mar 16 16:23:17 crc kubenswrapper[5120]: I0316 16:23:17.980670 5120 scope.go:117] "RemoveContainer" containerID="abecdba26b6bff68777a897c6b9fc5029b3fe4c248555a514a0f020e41a8ff25" Mar 16 16:23:17 crc kubenswrapper[5120]: I0316 16:23:17.981980 5120 reconciler_common.go:299] "Volume detached for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/eedcb5c7-fe1f-48f2-bf88-bd0b575ec7b8-nova-metadata-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:23:17 crc kubenswrapper[5120]: I0316 16:23:17.982014 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hzg9t\" (UniqueName: \"kubernetes.io/projected/eedcb5c7-fe1f-48f2-bf88-bd0b575ec7b8-kube-api-access-hzg9t\") on node \"crc\" DevicePath \"\"" Mar 16 16:23:17 crc kubenswrapper[5120]: I0316 16:23:17.982029 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4b003c0d-225d-4657-959a-bcb352fda8b0-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:23:17 crc kubenswrapper[5120]: I0316 16:23:17.982042 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/eedcb5c7-fe1f-48f2-bf88-bd0b575ec7b8-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:23:17 crc kubenswrapper[5120]: I0316 16:23:17.982054 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eedcb5c7-fe1f-48f2-bf88-bd0b575ec7b8-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:23:17 crc kubenswrapper[5120]: I0316 16:23:17.982068 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p8h82\" (UniqueName: \"kubernetes.io/projected/4b003c0d-225d-4657-959a-bcb352fda8b0-kube-api-access-p8h82\") on node \"crc\" DevicePath \"\"" Mar 16 16:23:17 crc kubenswrapper[5120]: I0316 16:23:17.982079 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4b003c0d-225d-4657-959a-bcb352fda8b0-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:23:17 crc kubenswrapper[5120]: I0316 16:23:17.998954 5120 scope.go:117] "RemoveContainer" containerID="7a82cf48a06efa34bb69573643a1a3f1f4da758a7ecbd8c37ee11192bdd5b73e" Mar 16 16:23:17 crc kubenswrapper[5120]: E0316 16:23:17.999297 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7a82cf48a06efa34bb69573643a1a3f1f4da758a7ecbd8c37ee11192bdd5b73e\": container with ID starting with 7a82cf48a06efa34bb69573643a1a3f1f4da758a7ecbd8c37ee11192bdd5b73e not found: ID does not exist" containerID="7a82cf48a06efa34bb69573643a1a3f1f4da758a7ecbd8c37ee11192bdd5b73e" Mar 16 16:23:17 crc kubenswrapper[5120]: I0316 16:23:17.999332 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a82cf48a06efa34bb69573643a1a3f1f4da758a7ecbd8c37ee11192bdd5b73e"} err="failed to get container status \"7a82cf48a06efa34bb69573643a1a3f1f4da758a7ecbd8c37ee11192bdd5b73e\": rpc error: code = NotFound desc = could not find container \"7a82cf48a06efa34bb69573643a1a3f1f4da758a7ecbd8c37ee11192bdd5b73e\": container with ID starting with 7a82cf48a06efa34bb69573643a1a3f1f4da758a7ecbd8c37ee11192bdd5b73e not found: ID does not exist" Mar 16 16:23:17 crc kubenswrapper[5120]: I0316 16:23:17.999350 5120 scope.go:117] "RemoveContainer" containerID="abecdba26b6bff68777a897c6b9fc5029b3fe4c248555a514a0f020e41a8ff25" Mar 16 16:23:17 crc kubenswrapper[5120]: E0316 16:23:17.999696 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"abecdba26b6bff68777a897c6b9fc5029b3fe4c248555a514a0f020e41a8ff25\": container with ID starting with abecdba26b6bff68777a897c6b9fc5029b3fe4c248555a514a0f020e41a8ff25 not found: ID does not exist" containerID="abecdba26b6bff68777a897c6b9fc5029b3fe4c248555a514a0f020e41a8ff25" Mar 16 16:23:17 crc kubenswrapper[5120]: I0316 16:23:17.999718 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"abecdba26b6bff68777a897c6b9fc5029b3fe4c248555a514a0f020e41a8ff25"} err="failed to get container status \"abecdba26b6bff68777a897c6b9fc5029b3fe4c248555a514a0f020e41a8ff25\": rpc error: code = NotFound desc = could not find container \"abecdba26b6bff68777a897c6b9fc5029b3fe4c248555a514a0f020e41a8ff25\": container with ID starting with abecdba26b6bff68777a897c6b9fc5029b3fe4c248555a514a0f020e41a8ff25 not found: ID does not exist" Mar 16 16:23:18 crc kubenswrapper[5120]: I0316 16:23:18.242900 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:23:18 crc kubenswrapper[5120]: I0316 16:23:18.263517 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:23:18 crc kubenswrapper[5120]: I0316 16:23:18.279610 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:23:18 crc kubenswrapper[5120]: I0316 16:23:18.302357 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:23:18 crc kubenswrapper[5120]: I0316 16:23:18.322289 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:23:18 crc kubenswrapper[5120]: I0316 16:23:18.323675 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b003c0d-225d-4657-959a-bcb352fda8b0" containerName="nova-api-api" Mar 16 16:23:18 crc kubenswrapper[5120]: I0316 16:23:18.323693 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b003c0d-225d-4657-959a-bcb352fda8b0" containerName="nova-api-api" Mar 16 16:23:18 crc kubenswrapper[5120]: I0316 16:23:18.323705 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b003c0d-225d-4657-959a-bcb352fda8b0" containerName="nova-api-log" Mar 16 16:23:18 crc kubenswrapper[5120]: I0316 16:23:18.323711 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b003c0d-225d-4657-959a-bcb352fda8b0" containerName="nova-api-log" Mar 16 16:23:18 crc kubenswrapper[5120]: I0316 16:23:18.323739 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eedcb5c7-fe1f-48f2-bf88-bd0b575ec7b8" containerName="nova-metadata-metadata" Mar 16 16:23:18 crc kubenswrapper[5120]: I0316 16:23:18.323744 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="eedcb5c7-fe1f-48f2-bf88-bd0b575ec7b8" containerName="nova-metadata-metadata" Mar 16 16:23:18 crc kubenswrapper[5120]: I0316 16:23:18.323780 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ebe87fc0-a7b8-4344-bb8d-3bd243ef0bbf" containerName="nova-manage" Mar 16 16:23:18 crc kubenswrapper[5120]: I0316 16:23:18.323785 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ebe87fc0-a7b8-4344-bb8d-3bd243ef0bbf" containerName="nova-manage" Mar 16 16:23:18 crc kubenswrapper[5120]: I0316 16:23:18.323806 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eedcb5c7-fe1f-48f2-bf88-bd0b575ec7b8" containerName="nova-metadata-log" Mar 16 16:23:18 crc kubenswrapper[5120]: I0316 16:23:18.323812 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="eedcb5c7-fe1f-48f2-bf88-bd0b575ec7b8" containerName="nova-metadata-log" Mar 16 16:23:18 crc kubenswrapper[5120]: I0316 16:23:18.324147 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="4b003c0d-225d-4657-959a-bcb352fda8b0" containerName="nova-api-api" Mar 16 16:23:18 crc kubenswrapper[5120]: I0316 16:23:18.324171 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ebe87fc0-a7b8-4344-bb8d-3bd243ef0bbf" containerName="nova-manage" Mar 16 16:23:18 crc kubenswrapper[5120]: I0316 16:23:18.324184 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="4b003c0d-225d-4657-959a-bcb352fda8b0" containerName="nova-api-log" Mar 16 16:23:18 crc kubenswrapper[5120]: I0316 16:23:18.324193 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="eedcb5c7-fe1f-48f2-bf88-bd0b575ec7b8" containerName="nova-metadata-log" Mar 16 16:23:18 crc kubenswrapper[5120]: I0316 16:23:18.324203 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="eedcb5c7-fe1f-48f2-bf88-bd0b575ec7b8" containerName="nova-metadata-metadata" Mar 16 16:23:18 crc kubenswrapper[5120]: I0316 16:23:18.338645 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:23:18 crc kubenswrapper[5120]: I0316 16:23:18.338795 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:23:18 crc kubenswrapper[5120]: I0316 16:23:18.341446 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-metadata-internal-svc\"" Mar 16 16:23:18 crc kubenswrapper[5120]: I0316 16:23:18.341739 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-metadata-config-data\"" Mar 16 16:23:18 crc kubenswrapper[5120]: I0316 16:23:18.354841 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:23:18 crc kubenswrapper[5120]: I0316 16:23:18.363521 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:23:18 crc kubenswrapper[5120]: I0316 16:23:18.363665 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:23:18 crc kubenswrapper[5120]: I0316 16:23:18.366519 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-config-data\"" Mar 16 16:23:18 crc kubenswrapper[5120]: I0316 16:23:18.403925 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b34821cb-b796-4656-9eb3-536286a2c00d-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"b34821cb-b796-4656-9eb3-536286a2c00d\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:23:18 crc kubenswrapper[5120]: I0316 16:23:18.404300 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b34821cb-b796-4656-9eb3-536286a2c00d-logs\") pod \"nova-api-0\" (UID: \"b34821cb-b796-4656-9eb3-536286a2c00d\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:23:18 crc kubenswrapper[5120]: I0316 16:23:18.404641 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rv6wd\" (UniqueName: \"kubernetes.io/projected/b34821cb-b796-4656-9eb3-536286a2c00d-kube-api-access-rv6wd\") pod \"nova-api-0\" (UID: \"b34821cb-b796-4656-9eb3-536286a2c00d\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:23:18 crc kubenswrapper[5120]: I0316 16:23:18.404930 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b34821cb-b796-4656-9eb3-536286a2c00d-config-data\") pod \"nova-api-0\" (UID: \"b34821cb-b796-4656-9eb3-536286a2c00d\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:23:18 crc kubenswrapper[5120]: I0316 16:23:18.506536 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3ea3fd85-7822-44e8-a112-9aec7d6f9a7c-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"3ea3fd85-7822-44e8-a112-9aec7d6f9a7c\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:23:18 crc kubenswrapper[5120]: I0316 16:23:18.506614 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b34821cb-b796-4656-9eb3-536286a2c00d-config-data\") pod \"nova-api-0\" (UID: \"b34821cb-b796-4656-9eb3-536286a2c00d\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:23:18 crc kubenswrapper[5120]: I0316 16:23:18.506749 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b34821cb-b796-4656-9eb3-536286a2c00d-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"b34821cb-b796-4656-9eb3-536286a2c00d\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:23:18 crc kubenswrapper[5120]: I0316 16:23:18.506948 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3ea3fd85-7822-44e8-a112-9aec7d6f9a7c-config-data\") pod \"nova-metadata-0\" (UID: \"3ea3fd85-7822-44e8-a112-9aec7d6f9a7c\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:23:18 crc kubenswrapper[5120]: I0316 16:23:18.507106 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b34821cb-b796-4656-9eb3-536286a2c00d-logs\") pod \"nova-api-0\" (UID: \"b34821cb-b796-4656-9eb3-536286a2c00d\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:23:18 crc kubenswrapper[5120]: I0316 16:23:18.507235 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3ea3fd85-7822-44e8-a112-9aec7d6f9a7c-logs\") pod \"nova-metadata-0\" (UID: \"3ea3fd85-7822-44e8-a112-9aec7d6f9a7c\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:23:18 crc kubenswrapper[5120]: I0316 16:23:18.507293 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2crb\" (UniqueName: \"kubernetes.io/projected/3ea3fd85-7822-44e8-a112-9aec7d6f9a7c-kube-api-access-v2crb\") pod \"nova-metadata-0\" (UID: \"3ea3fd85-7822-44e8-a112-9aec7d6f9a7c\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:23:18 crc kubenswrapper[5120]: I0316 16:23:18.507481 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/3ea3fd85-7822-44e8-a112-9aec7d6f9a7c-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"3ea3fd85-7822-44e8-a112-9aec7d6f9a7c\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:23:18 crc kubenswrapper[5120]: I0316 16:23:18.507500 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b34821cb-b796-4656-9eb3-536286a2c00d-logs\") pod \"nova-api-0\" (UID: \"b34821cb-b796-4656-9eb3-536286a2c00d\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:23:18 crc kubenswrapper[5120]: I0316 16:23:18.507752 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rv6wd\" (UniqueName: \"kubernetes.io/projected/b34821cb-b796-4656-9eb3-536286a2c00d-kube-api-access-rv6wd\") pod \"nova-api-0\" (UID: \"b34821cb-b796-4656-9eb3-536286a2c00d\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:23:18 crc kubenswrapper[5120]: I0316 16:23:18.511784 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b34821cb-b796-4656-9eb3-536286a2c00d-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"b34821cb-b796-4656-9eb3-536286a2c00d\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:23:18 crc kubenswrapper[5120]: I0316 16:23:18.516444 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b34821cb-b796-4656-9eb3-536286a2c00d-config-data\") pod \"nova-api-0\" (UID: \"b34821cb-b796-4656-9eb3-536286a2c00d\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:23:18 crc kubenswrapper[5120]: I0316 16:23:18.523559 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rv6wd\" (UniqueName: \"kubernetes.io/projected/b34821cb-b796-4656-9eb3-536286a2c00d-kube-api-access-rv6wd\") pod \"nova-api-0\" (UID: \"b34821cb-b796-4656-9eb3-536286a2c00d\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:23:18 crc kubenswrapper[5120]: I0316 16:23:18.610149 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3ea3fd85-7822-44e8-a112-9aec7d6f9a7c-config-data\") pod \"nova-metadata-0\" (UID: \"3ea3fd85-7822-44e8-a112-9aec7d6f9a7c\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:23:18 crc kubenswrapper[5120]: I0316 16:23:18.610354 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3ea3fd85-7822-44e8-a112-9aec7d6f9a7c-logs\") pod \"nova-metadata-0\" (UID: \"3ea3fd85-7822-44e8-a112-9aec7d6f9a7c\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:23:18 crc kubenswrapper[5120]: I0316 16:23:18.610393 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v2crb\" (UniqueName: \"kubernetes.io/projected/3ea3fd85-7822-44e8-a112-9aec7d6f9a7c-kube-api-access-v2crb\") pod \"nova-metadata-0\" (UID: \"3ea3fd85-7822-44e8-a112-9aec7d6f9a7c\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:23:18 crc kubenswrapper[5120]: I0316 16:23:18.610497 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/3ea3fd85-7822-44e8-a112-9aec7d6f9a7c-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"3ea3fd85-7822-44e8-a112-9aec7d6f9a7c\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:23:18 crc kubenswrapper[5120]: I0316 16:23:18.610949 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3ea3fd85-7822-44e8-a112-9aec7d6f9a7c-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"3ea3fd85-7822-44e8-a112-9aec7d6f9a7c\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:23:18 crc kubenswrapper[5120]: I0316 16:23:18.611030 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3ea3fd85-7822-44e8-a112-9aec7d6f9a7c-logs\") pod \"nova-metadata-0\" (UID: \"3ea3fd85-7822-44e8-a112-9aec7d6f9a7c\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:23:18 crc kubenswrapper[5120]: I0316 16:23:18.616397 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/3ea3fd85-7822-44e8-a112-9aec7d6f9a7c-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"3ea3fd85-7822-44e8-a112-9aec7d6f9a7c\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:23:18 crc kubenswrapper[5120]: I0316 16:23:18.617534 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3ea3fd85-7822-44e8-a112-9aec7d6f9a7c-config-data\") pod \"nova-metadata-0\" (UID: \"3ea3fd85-7822-44e8-a112-9aec7d6f9a7c\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:23:18 crc kubenswrapper[5120]: I0316 16:23:18.620322 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3ea3fd85-7822-44e8-a112-9aec7d6f9a7c-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"3ea3fd85-7822-44e8-a112-9aec7d6f9a7c\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:23:18 crc kubenswrapper[5120]: I0316 16:23:18.625656 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2crb\" (UniqueName: \"kubernetes.io/projected/3ea3fd85-7822-44e8-a112-9aec7d6f9a7c-kube-api-access-v2crb\") pod \"nova-metadata-0\" (UID: \"3ea3fd85-7822-44e8-a112-9aec7d6f9a7c\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:23:18 crc kubenswrapper[5120]: I0316 16:23:18.672961 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:23:18 crc kubenswrapper[5120]: I0316 16:23:18.678109 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b003c0d-225d-4657-959a-bcb352fda8b0" path="/var/lib/kubelet/pods/4b003c0d-225d-4657-959a-bcb352fda8b0/volumes" Mar 16 16:23:18 crc kubenswrapper[5120]: I0316 16:23:18.679364 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eedcb5c7-fe1f-48f2-bf88-bd0b575ec7b8" path="/var/lib/kubelet/pods/eedcb5c7-fe1f-48f2-bf88-bd0b575ec7b8/volumes" Mar 16 16:23:18 crc kubenswrapper[5120]: I0316 16:23:18.687007 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:23:19 crc kubenswrapper[5120]: W0316 16:23:19.181491 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb34821cb_b796_4656_9eb3_536286a2c00d.slice/crio-c41746b9873158fc982c66cde4294bbc97ada19a136c73216ada8aba50bdae86 WatchSource:0}: Error finding container c41746b9873158fc982c66cde4294bbc97ada19a136c73216ada8aba50bdae86: Status 404 returned error can't find the container with id c41746b9873158fc982c66cde4294bbc97ada19a136c73216ada8aba50bdae86 Mar 16 16:23:19 crc kubenswrapper[5120]: I0316 16:23:19.185890 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:23:19 crc kubenswrapper[5120]: I0316 16:23:19.249091 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:23:19 crc kubenswrapper[5120]: W0316 16:23:19.260473 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3ea3fd85_7822_44e8_a112_9aec7d6f9a7c.slice/crio-ecd246ec16fff8ecf2c8fe3b3972b32fa328a286bc8de100f83d7a17a7db47b6 WatchSource:0}: Error finding container ecd246ec16fff8ecf2c8fe3b3972b32fa328a286bc8de100f83d7a17a7db47b6: Status 404 returned error can't find the container with id ecd246ec16fff8ecf2c8fe3b3972b32fa328a286bc8de100f83d7a17a7db47b6 Mar 16 16:23:19 crc kubenswrapper[5120]: I0316 16:23:19.927149 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"b34821cb-b796-4656-9eb3-536286a2c00d","Type":"ContainerStarted","Data":"d576c1e4fc13885a95f26fa17ff27a2deb20a610a42cbc82a3e77342bbbe9ade"} Mar 16 16:23:19 crc kubenswrapper[5120]: I0316 16:23:19.927478 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"b34821cb-b796-4656-9eb3-536286a2c00d","Type":"ContainerStarted","Data":"3c56d0f8b0a3e0bc3fb824285e1f866b7c0fe4b2c167f01748d77ce09fe9939e"} Mar 16 16:23:19 crc kubenswrapper[5120]: I0316 16:23:19.927491 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"b34821cb-b796-4656-9eb3-536286a2c00d","Type":"ContainerStarted","Data":"c41746b9873158fc982c66cde4294bbc97ada19a136c73216ada8aba50bdae86"} Mar 16 16:23:19 crc kubenswrapper[5120]: I0316 16:23:19.929018 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"3ea3fd85-7822-44e8-a112-9aec7d6f9a7c","Type":"ContainerStarted","Data":"4ea09e08e85b261a659b39580e998425395c7ffa64c9d1c9ae71d3e57222b903"} Mar 16 16:23:19 crc kubenswrapper[5120]: I0316 16:23:19.929068 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"3ea3fd85-7822-44e8-a112-9aec7d6f9a7c","Type":"ContainerStarted","Data":"dddf01fb2a62a299ce661c264a716a073896f253775f73284ef6259d80e680a7"} Mar 16 16:23:19 crc kubenswrapper[5120]: I0316 16:23:19.929082 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"3ea3fd85-7822-44e8-a112-9aec7d6f9a7c","Type":"ContainerStarted","Data":"ecd246ec16fff8ecf2c8fe3b3972b32fa328a286bc8de100f83d7a17a7db47b6"} Mar 16 16:23:19 crc kubenswrapper[5120]: I0316 16:23:19.949273 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=1.9492552189999999 podStartE2EDuration="1.949255219s" podCreationTimestamp="2026-03-16 16:23:18 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:23:19.944446979 +0000 UTC m=+3102.098378646" watchObservedRunningTime="2026-03-16 16:23:19.949255219 +0000 UTC m=+3102.103186896" Mar 16 16:23:24 crc kubenswrapper[5120]: I0316 16:23:24.744198 5120 pod_container_manager_linux.go:217] "Failed to delete cgroup paths" cgroupName=["kubepods","besteffort","pod52f78b0c-8c71-4e47-978b-840e0ca12c1c"] err="unable to destroy cgroup paths for cgroup [kubepods besteffort pod52f78b0c-8c71-4e47-978b-840e0ca12c1c] : Timed out while waiting for systemd to remove kubepods-besteffort-pod52f78b0c_8c71_4e47_978b_840e0ca12c1c.slice" Mar 16 16:23:25 crc kubenswrapper[5120]: I0316 16:23:25.664332 5120 scope.go:117] "RemoveContainer" containerID="f40e444f89abd558ac90555bfd58e04a1c4379a653ba8035c228d2b7a5443eb5" Mar 16 16:23:25 crc kubenswrapper[5120]: E0316 16:23:25.664844 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:23:28 crc kubenswrapper[5120]: I0316 16:23:28.042366 5120 generic.go:358] "Generic (PLEG): container finished" podID="e6f79b5a-7ec0-4175-be98-73239396dd90" containerID="d63b63f896e16ee6ca0499eadf5f4897e18e93018d3e86e30c2fa276b3f8df7d" exitCode=137 Mar 16 16:23:28 crc kubenswrapper[5120]: I0316 16:23:28.042992 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"e6f79b5a-7ec0-4175-be98-73239396dd90","Type":"ContainerDied","Data":"d63b63f896e16ee6ca0499eadf5f4897e18e93018d3e86e30c2fa276b3f8df7d"} Mar 16 16:23:28 crc kubenswrapper[5120]: I0316 16:23:28.043018 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"e6f79b5a-7ec0-4175-be98-73239396dd90","Type":"ContainerDied","Data":"6101301c6507c34728e7dcea169d587031f770aa87b5439179b2b3b73bbf2ce7"} Mar 16 16:23:28 crc kubenswrapper[5120]: I0316 16:23:28.043028 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6101301c6507c34728e7dcea169d587031f770aa87b5439179b2b3b73bbf2ce7" Mar 16 16:23:28 crc kubenswrapper[5120]: I0316 16:23:28.128180 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:23:28 crc kubenswrapper[5120]: I0316 16:23:28.146981 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=10.146936293 podStartE2EDuration="10.146936293s" podCreationTimestamp="2026-03-16 16:23:18 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:23:19.960239042 +0000 UTC m=+3102.114170699" watchObservedRunningTime="2026-03-16 16:23:28.146936293 +0000 UTC m=+3110.300867960" Mar 16 16:23:28 crc kubenswrapper[5120]: I0316 16:23:28.181704 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e6f79b5a-7ec0-4175-be98-73239396dd90-config-data\") pod \"e6f79b5a-7ec0-4175-be98-73239396dd90\" (UID: \"e6f79b5a-7ec0-4175-be98-73239396dd90\") " Mar 16 16:23:28 crc kubenswrapper[5120]: I0316 16:23:28.181973 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pkd5d\" (UniqueName: \"kubernetes.io/projected/e6f79b5a-7ec0-4175-be98-73239396dd90-kube-api-access-pkd5d\") pod \"e6f79b5a-7ec0-4175-be98-73239396dd90\" (UID: \"e6f79b5a-7ec0-4175-be98-73239396dd90\") " Mar 16 16:23:28 crc kubenswrapper[5120]: I0316 16:23:28.182313 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e6f79b5a-7ec0-4175-be98-73239396dd90-combined-ca-bundle\") pod \"e6f79b5a-7ec0-4175-be98-73239396dd90\" (UID: \"e6f79b5a-7ec0-4175-be98-73239396dd90\") " Mar 16 16:23:28 crc kubenswrapper[5120]: I0316 16:23:28.188066 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6f79b5a-7ec0-4175-be98-73239396dd90-kube-api-access-pkd5d" (OuterVolumeSpecName: "kube-api-access-pkd5d") pod "e6f79b5a-7ec0-4175-be98-73239396dd90" (UID: "e6f79b5a-7ec0-4175-be98-73239396dd90"). InnerVolumeSpecName "kube-api-access-pkd5d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:23:28 crc kubenswrapper[5120]: I0316 16:23:28.218136 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e6f79b5a-7ec0-4175-be98-73239396dd90-config-data" (OuterVolumeSpecName: "config-data") pod "e6f79b5a-7ec0-4175-be98-73239396dd90" (UID: "e6f79b5a-7ec0-4175-be98-73239396dd90"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:23:28 crc kubenswrapper[5120]: I0316 16:23:28.224016 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e6f79b5a-7ec0-4175-be98-73239396dd90-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e6f79b5a-7ec0-4175-be98-73239396dd90" (UID: "e6f79b5a-7ec0-4175-be98-73239396dd90"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:23:28 crc kubenswrapper[5120]: I0316 16:23:28.285079 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e6f79b5a-7ec0-4175-be98-73239396dd90-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:23:28 crc kubenswrapper[5120]: I0316 16:23:28.285393 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pkd5d\" (UniqueName: \"kubernetes.io/projected/e6f79b5a-7ec0-4175-be98-73239396dd90-kube-api-access-pkd5d\") on node \"crc\" DevicePath \"\"" Mar 16 16:23:28 crc kubenswrapper[5120]: I0316 16:23:28.285405 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e6f79b5a-7ec0-4175-be98-73239396dd90-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:23:28 crc kubenswrapper[5120]: I0316 16:23:28.695752 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:23:28 crc kubenswrapper[5120]: I0316 16:23:28.695959 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:23:28 crc kubenswrapper[5120]: I0316 16:23:28.696070 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:23:28 crc kubenswrapper[5120]: I0316 16:23:28.696084 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:23:29 crc kubenswrapper[5120]: I0316 16:23:29.053102 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:23:29 crc kubenswrapper[5120]: I0316 16:23:29.074833 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:23:29 crc kubenswrapper[5120]: I0316 16:23:29.081907 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:23:29 crc kubenswrapper[5120]: I0316 16:23:29.088965 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:23:29 crc kubenswrapper[5120]: I0316 16:23:29.089984 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6f79b5a-7ec0-4175-be98-73239396dd90" containerName="nova-scheduler-scheduler" Mar 16 16:23:29 crc kubenswrapper[5120]: I0316 16:23:29.090005 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6f79b5a-7ec0-4175-be98-73239396dd90" containerName="nova-scheduler-scheduler" Mar 16 16:23:29 crc kubenswrapper[5120]: I0316 16:23:29.090196 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e6f79b5a-7ec0-4175-be98-73239396dd90" containerName="nova-scheduler-scheduler" Mar 16 16:23:29 crc kubenswrapper[5120]: I0316 16:23:29.100577 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:23:29 crc kubenswrapper[5120]: I0316 16:23:29.109845 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:23:29 crc kubenswrapper[5120]: I0316 16:23:29.109962 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-scheduler-config-data\"" Mar 16 16:23:29 crc kubenswrapper[5120]: I0316 16:23:29.218719 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/243c208b-8b2f-4041-9adc-aa2fee8f07f9-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"243c208b-8b2f-4041-9adc-aa2fee8f07f9\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:23:29 crc kubenswrapper[5120]: I0316 16:23:29.219450 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5476\" (UniqueName: \"kubernetes.io/projected/243c208b-8b2f-4041-9adc-aa2fee8f07f9-kube-api-access-r5476\") pod \"nova-scheduler-0\" (UID: \"243c208b-8b2f-4041-9adc-aa2fee8f07f9\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:23:29 crc kubenswrapper[5120]: I0316 16:23:29.219856 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/243c208b-8b2f-4041-9adc-aa2fee8f07f9-config-data\") pod \"nova-scheduler-0\" (UID: \"243c208b-8b2f-4041-9adc-aa2fee8f07f9\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:23:29 crc kubenswrapper[5120]: I0316 16:23:29.322464 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/243c208b-8b2f-4041-9adc-aa2fee8f07f9-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"243c208b-8b2f-4041-9adc-aa2fee8f07f9\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:23:29 crc kubenswrapper[5120]: I0316 16:23:29.322693 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r5476\" (UniqueName: \"kubernetes.io/projected/243c208b-8b2f-4041-9adc-aa2fee8f07f9-kube-api-access-r5476\") pod \"nova-scheduler-0\" (UID: \"243c208b-8b2f-4041-9adc-aa2fee8f07f9\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:23:29 crc kubenswrapper[5120]: I0316 16:23:29.322893 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/243c208b-8b2f-4041-9adc-aa2fee8f07f9-config-data\") pod \"nova-scheduler-0\" (UID: \"243c208b-8b2f-4041-9adc-aa2fee8f07f9\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:23:29 crc kubenswrapper[5120]: I0316 16:23:29.328187 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/243c208b-8b2f-4041-9adc-aa2fee8f07f9-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"243c208b-8b2f-4041-9adc-aa2fee8f07f9\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:23:29 crc kubenswrapper[5120]: I0316 16:23:29.328806 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/243c208b-8b2f-4041-9adc-aa2fee8f07f9-config-data\") pod \"nova-scheduler-0\" (UID: \"243c208b-8b2f-4041-9adc-aa2fee8f07f9\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:23:29 crc kubenswrapper[5120]: I0316 16:23:29.342786 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5476\" (UniqueName: \"kubernetes.io/projected/243c208b-8b2f-4041-9adc-aa2fee8f07f9-kube-api-access-r5476\") pod \"nova-scheduler-0\" (UID: \"243c208b-8b2f-4041-9adc-aa2fee8f07f9\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:23:29 crc kubenswrapper[5120]: I0316 16:23:29.430883 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:23:29 crc kubenswrapper[5120]: I0316 16:23:29.684920 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="3ea3fd85-7822-44e8-a112-9aec7d6f9a7c" containerName="nova-metadata-log" probeResult="failure" output="Get \"https://10.217.1.139:8775/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Mar 16 16:23:29 crc kubenswrapper[5120]: I0316 16:23:29.685447 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="3ea3fd85-7822-44e8-a112-9aec7d6f9a7c" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"https://10.217.1.139:8775/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Mar 16 16:23:29 crc kubenswrapper[5120]: I0316 16:23:29.737093 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="b34821cb-b796-4656-9eb3-536286a2c00d" containerName="nova-api-api" probeResult="failure" output="Get \"http://10.217.1.140:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 16:23:29 crc kubenswrapper[5120]: I0316 16:23:29.737134 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="b34821cb-b796-4656-9eb3-536286a2c00d" containerName="nova-api-log" probeResult="failure" output="Get \"http://10.217.1.140:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 16:23:29 crc kubenswrapper[5120]: I0316 16:23:29.919618 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:23:29 crc kubenswrapper[5120]: W0316 16:23:29.920956 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod243c208b_8b2f_4041_9adc_aa2fee8f07f9.slice/crio-56e7b7b9098475afdcf6841dee89df06512bdf988810e238467d4a3457db2d0b WatchSource:0}: Error finding container 56e7b7b9098475afdcf6841dee89df06512bdf988810e238467d4a3457db2d0b: Status 404 returned error can't find the container with id 56e7b7b9098475afdcf6841dee89df06512bdf988810e238467d4a3457db2d0b Mar 16 16:23:30 crc kubenswrapper[5120]: I0316 16:23:30.067966 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"243c208b-8b2f-4041-9adc-aa2fee8f07f9","Type":"ContainerStarted","Data":"56e7b7b9098475afdcf6841dee89df06512bdf988810e238467d4a3457db2d0b"} Mar 16 16:23:30 crc kubenswrapper[5120]: I0316 16:23:30.677646 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e6f79b5a-7ec0-4175-be98-73239396dd90" path="/var/lib/kubelet/pods/e6f79b5a-7ec0-4175-be98-73239396dd90/volumes" Mar 16 16:23:31 crc kubenswrapper[5120]: I0316 16:23:31.087700 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"243c208b-8b2f-4041-9adc-aa2fee8f07f9","Type":"ContainerStarted","Data":"5e6baa9f78619e40ffd6a36cfbb9720f6f4f84ce1842a854e4e515f3444ed405"} Mar 16 16:23:31 crc kubenswrapper[5120]: I0316 16:23:31.108587 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-scheduler-0" podStartSLOduration=2.108566569 podStartE2EDuration="2.108566569s" podCreationTimestamp="2026-03-16 16:23:29 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:23:31.108234479 +0000 UTC m=+3113.262166146" watchObservedRunningTime="2026-03-16 16:23:31.108566569 +0000 UTC m=+3113.262498236" Mar 16 16:23:34 crc kubenswrapper[5120]: I0316 16:23:34.432658 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:23:35 crc kubenswrapper[5120]: I0316 16:23:35.761731 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:23:36 crc kubenswrapper[5120]: I0316 16:23:36.684222 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:23:36 crc kubenswrapper[5120]: I0316 16:23:36.684599 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:23:36 crc kubenswrapper[5120]: I0316 16:23:36.688162 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:23:36 crc kubenswrapper[5120]: I0316 16:23:36.688234 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:23:38 crc kubenswrapper[5120]: I0316 16:23:38.695651 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:23:38 crc kubenswrapper[5120]: I0316 16:23:38.696750 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:23:38 crc kubenswrapper[5120]: I0316 16:23:38.701676 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:23:38 crc kubenswrapper[5120]: I0316 16:23:38.704943 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:23:38 crc kubenswrapper[5120]: I0316 16:23:38.705496 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:23:38 crc kubenswrapper[5120]: I0316 16:23:38.708467 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:23:38 crc kubenswrapper[5120]: I0316 16:23:38.715119 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:23:39 crc kubenswrapper[5120]: I0316 16:23:39.178462 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:23:39 crc kubenswrapper[5120]: I0316 16:23:39.432557 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:23:39 crc kubenswrapper[5120]: I0316 16:23:39.468074 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 16:23:39 crc kubenswrapper[5120]: I0316 16:23:39.468313 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/kube-state-metrics-0" podUID="7df75da5-8410-4171-b485-8eebd87a15b0" containerName="kube-state-metrics" containerID="cri-o://af562d53215e7974c3793aaba0dab638102c240038426e19f4953c83a80dde64" gracePeriod=30 Mar 16 16:23:39 crc kubenswrapper[5120]: I0316 16:23:39.471240 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:23:39 crc kubenswrapper[5120]: I0316 16:23:39.962016 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:23:40 crc kubenswrapper[5120]: I0316 16:23:40.122537 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8gzb9\" (UniqueName: \"kubernetes.io/projected/7df75da5-8410-4171-b485-8eebd87a15b0-kube-api-access-8gzb9\") pod \"7df75da5-8410-4171-b485-8eebd87a15b0\" (UID: \"7df75da5-8410-4171-b485-8eebd87a15b0\") " Mar 16 16:23:40 crc kubenswrapper[5120]: I0316 16:23:40.139073 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7df75da5-8410-4171-b485-8eebd87a15b0-kube-api-access-8gzb9" (OuterVolumeSpecName: "kube-api-access-8gzb9") pod "7df75da5-8410-4171-b485-8eebd87a15b0" (UID: "7df75da5-8410-4171-b485-8eebd87a15b0"). InnerVolumeSpecName "kube-api-access-8gzb9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:23:40 crc kubenswrapper[5120]: I0316 16:23:40.206975 5120 generic.go:358] "Generic (PLEG): container finished" podID="7df75da5-8410-4171-b485-8eebd87a15b0" containerID="af562d53215e7974c3793aaba0dab638102c240038426e19f4953c83a80dde64" exitCode=2 Mar 16 16:23:40 crc kubenswrapper[5120]: I0316 16:23:40.207340 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:23:40 crc kubenswrapper[5120]: I0316 16:23:40.207492 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"7df75da5-8410-4171-b485-8eebd87a15b0","Type":"ContainerDied","Data":"af562d53215e7974c3793aaba0dab638102c240038426e19f4953c83a80dde64"} Mar 16 16:23:40 crc kubenswrapper[5120]: I0316 16:23:40.207525 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"7df75da5-8410-4171-b485-8eebd87a15b0","Type":"ContainerDied","Data":"8a9320db1190c17c21e36fb275d7c170a9a9b75d89e32651e1bccbd679c4cd39"} Mar 16 16:23:40 crc kubenswrapper[5120]: I0316 16:23:40.207559 5120 scope.go:117] "RemoveContainer" containerID="af562d53215e7974c3793aaba0dab638102c240038426e19f4953c83a80dde64" Mar 16 16:23:40 crc kubenswrapper[5120]: I0316 16:23:40.228657 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8gzb9\" (UniqueName: \"kubernetes.io/projected/7df75da5-8410-4171-b485-8eebd87a15b0-kube-api-access-8gzb9\") on node \"crc\" DevicePath \"\"" Mar 16 16:23:40 crc kubenswrapper[5120]: I0316 16:23:40.248445 5120 scope.go:117] "RemoveContainer" containerID="af562d53215e7974c3793aaba0dab638102c240038426e19f4953c83a80dde64" Mar 16 16:23:40 crc kubenswrapper[5120]: E0316 16:23:40.249542 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af562d53215e7974c3793aaba0dab638102c240038426e19f4953c83a80dde64\": container with ID starting with af562d53215e7974c3793aaba0dab638102c240038426e19f4953c83a80dde64 not found: ID does not exist" containerID="af562d53215e7974c3793aaba0dab638102c240038426e19f4953c83a80dde64" Mar 16 16:23:40 crc kubenswrapper[5120]: I0316 16:23:40.249590 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af562d53215e7974c3793aaba0dab638102c240038426e19f4953c83a80dde64"} err="failed to get container status \"af562d53215e7974c3793aaba0dab638102c240038426e19f4953c83a80dde64\": rpc error: code = NotFound desc = could not find container \"af562d53215e7974c3793aaba0dab638102c240038426e19f4953c83a80dde64\": container with ID starting with af562d53215e7974c3793aaba0dab638102c240038426e19f4953c83a80dde64 not found: ID does not exist" Mar 16 16:23:40 crc kubenswrapper[5120]: I0316 16:23:40.250957 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:23:40 crc kubenswrapper[5120]: I0316 16:23:40.268126 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 16:23:40 crc kubenswrapper[5120]: I0316 16:23:40.284144 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 16:23:40 crc kubenswrapper[5120]: I0316 16:23:40.303244 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 16:23:40 crc kubenswrapper[5120]: I0316 16:23:40.304465 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7df75da5-8410-4171-b485-8eebd87a15b0" containerName="kube-state-metrics" Mar 16 16:23:40 crc kubenswrapper[5120]: I0316 16:23:40.304485 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7df75da5-8410-4171-b485-8eebd87a15b0" containerName="kube-state-metrics" Mar 16 16:23:40 crc kubenswrapper[5120]: I0316 16:23:40.304679 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7df75da5-8410-4171-b485-8eebd87a15b0" containerName="kube-state-metrics" Mar 16 16:23:40 crc kubenswrapper[5120]: I0316 16:23:40.312917 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 16:23:40 crc kubenswrapper[5120]: I0316 16:23:40.313014 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:23:40 crc kubenswrapper[5120]: I0316 16:23:40.336196 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"kube-state-metrics-tls-config\"" Mar 16 16:23:40 crc kubenswrapper[5120]: I0316 16:23:40.337096 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-kube-state-metrics-svc\"" Mar 16 16:23:40 crc kubenswrapper[5120]: I0316 16:23:40.435878 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2hht\" (UniqueName: \"kubernetes.io/projected/93d56b12-9c96-48fa-9343-4a12d639b8a3-kube-api-access-q2hht\") pod \"kube-state-metrics-0\" (UID: \"93d56b12-9c96-48fa-9343-4a12d639b8a3\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:23:40 crc kubenswrapper[5120]: I0316 16:23:40.435928 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/93d56b12-9c96-48fa-9343-4a12d639b8a3-combined-ca-bundle\") pod \"kube-state-metrics-0\" (UID: \"93d56b12-9c96-48fa-9343-4a12d639b8a3\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:23:40 crc kubenswrapper[5120]: I0316 16:23:40.435960 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/93d56b12-9c96-48fa-9343-4a12d639b8a3-kube-state-metrics-tls-certs\") pod \"kube-state-metrics-0\" (UID: \"93d56b12-9c96-48fa-9343-4a12d639b8a3\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:23:40 crc kubenswrapper[5120]: I0316 16:23:40.436459 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/93d56b12-9c96-48fa-9343-4a12d639b8a3-kube-state-metrics-tls-config\") pod \"kube-state-metrics-0\" (UID: \"93d56b12-9c96-48fa-9343-4a12d639b8a3\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:23:40 crc kubenswrapper[5120]: I0316 16:23:40.538190 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q2hht\" (UniqueName: \"kubernetes.io/projected/93d56b12-9c96-48fa-9343-4a12d639b8a3-kube-api-access-q2hht\") pod \"kube-state-metrics-0\" (UID: \"93d56b12-9c96-48fa-9343-4a12d639b8a3\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:23:40 crc kubenswrapper[5120]: I0316 16:23:40.538233 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/93d56b12-9c96-48fa-9343-4a12d639b8a3-combined-ca-bundle\") pod \"kube-state-metrics-0\" (UID: \"93d56b12-9c96-48fa-9343-4a12d639b8a3\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:23:40 crc kubenswrapper[5120]: I0316 16:23:40.538986 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/93d56b12-9c96-48fa-9343-4a12d639b8a3-kube-state-metrics-tls-certs\") pod \"kube-state-metrics-0\" (UID: \"93d56b12-9c96-48fa-9343-4a12d639b8a3\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:23:40 crc kubenswrapper[5120]: I0316 16:23:40.539450 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/93d56b12-9c96-48fa-9343-4a12d639b8a3-kube-state-metrics-tls-config\") pod \"kube-state-metrics-0\" (UID: \"93d56b12-9c96-48fa-9343-4a12d639b8a3\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:23:40 crc kubenswrapper[5120]: I0316 16:23:40.543554 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/93d56b12-9c96-48fa-9343-4a12d639b8a3-combined-ca-bundle\") pod \"kube-state-metrics-0\" (UID: \"93d56b12-9c96-48fa-9343-4a12d639b8a3\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:23:40 crc kubenswrapper[5120]: I0316 16:23:40.545185 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/93d56b12-9c96-48fa-9343-4a12d639b8a3-kube-state-metrics-tls-config\") pod \"kube-state-metrics-0\" (UID: \"93d56b12-9c96-48fa-9343-4a12d639b8a3\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:23:40 crc kubenswrapper[5120]: I0316 16:23:40.546995 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/93d56b12-9c96-48fa-9343-4a12d639b8a3-kube-state-metrics-tls-certs\") pod \"kube-state-metrics-0\" (UID: \"93d56b12-9c96-48fa-9343-4a12d639b8a3\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:23:40 crc kubenswrapper[5120]: I0316 16:23:40.554320 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2hht\" (UniqueName: \"kubernetes.io/projected/93d56b12-9c96-48fa-9343-4a12d639b8a3-kube-api-access-q2hht\") pod \"kube-state-metrics-0\" (UID: \"93d56b12-9c96-48fa-9343-4a12d639b8a3\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:23:40 crc kubenswrapper[5120]: I0316 16:23:40.649902 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:23:40 crc kubenswrapper[5120]: I0316 16:23:40.665115 5120 scope.go:117] "RemoveContainer" containerID="f40e444f89abd558ac90555bfd58e04a1c4379a653ba8035c228d2b7a5443eb5" Mar 16 16:23:40 crc kubenswrapper[5120]: E0316 16:23:40.665325 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:23:40 crc kubenswrapper[5120]: I0316 16:23:40.679776 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7df75da5-8410-4171-b485-8eebd87a15b0" path="/var/lib/kubelet/pods/7df75da5-8410-4171-b485-8eebd87a15b0/volumes" Mar 16 16:23:41 crc kubenswrapper[5120]: I0316 16:23:41.158409 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 16:23:41 crc kubenswrapper[5120]: W0316 16:23:41.159453 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod93d56b12_9c96_48fa_9343_4a12d639b8a3.slice/crio-f40a7be673c3adaf8cbf65b368450993353921214da360f566ffdf28d9868ca7 WatchSource:0}: Error finding container f40a7be673c3adaf8cbf65b368450993353921214da360f566ffdf28d9868ca7: Status 404 returned error can't find the container with id f40a7be673c3adaf8cbf65b368450993353921214da360f566ffdf28d9868ca7 Mar 16 16:23:41 crc kubenswrapper[5120]: I0316 16:23:41.218482 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"93d56b12-9c96-48fa-9343-4a12d639b8a3","Type":"ContainerStarted","Data":"f40a7be673c3adaf8cbf65b368450993353921214da360f566ffdf28d9868ca7"} Mar 16 16:23:42 crc kubenswrapper[5120]: I0316 16:23:42.004985 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:23:42 crc kubenswrapper[5120]: I0316 16:23:42.005284 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="dcb3276e-6f5a-4fea-8428-6c16ca81a07a" containerName="ceilometer-central-agent" containerID="cri-o://c3c5a0b6f157f90744850c14f4a79b95328a38cc804e65089108fdea76983af0" gracePeriod=30 Mar 16 16:23:42 crc kubenswrapper[5120]: I0316 16:23:42.005344 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="dcb3276e-6f5a-4fea-8428-6c16ca81a07a" containerName="proxy-httpd" containerID="cri-o://e0c45f416370a2663e2005580cbac7f56864a27b77c00cdac6e73309470099cc" gracePeriod=30 Mar 16 16:23:42 crc kubenswrapper[5120]: I0316 16:23:42.005405 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="dcb3276e-6f5a-4fea-8428-6c16ca81a07a" containerName="sg-core" containerID="cri-o://6034e92d58dd5d1606c4810dafd10d1bbe734690458d5af960764b5c89664ccc" gracePeriod=30 Mar 16 16:23:42 crc kubenswrapper[5120]: I0316 16:23:42.005439 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="dcb3276e-6f5a-4fea-8428-6c16ca81a07a" containerName="ceilometer-notification-agent" containerID="cri-o://bfc7ca57a071c668257867f7d127c752f82d675faaea323a62e42a21f179772f" gracePeriod=30 Mar 16 16:23:42 crc kubenswrapper[5120]: I0316 16:23:42.229087 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"93d56b12-9c96-48fa-9343-4a12d639b8a3","Type":"ContainerStarted","Data":"e155ab44ab0e81f14000fc0d43ea6be46487802295ab78a807b123db0cfeb8df"} Mar 16 16:23:42 crc kubenswrapper[5120]: I0316 16:23:42.229561 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:23:42 crc kubenswrapper[5120]: I0316 16:23:42.233151 5120 generic.go:358] "Generic (PLEG): container finished" podID="dcb3276e-6f5a-4fea-8428-6c16ca81a07a" containerID="e0c45f416370a2663e2005580cbac7f56864a27b77c00cdac6e73309470099cc" exitCode=0 Mar 16 16:23:42 crc kubenswrapper[5120]: I0316 16:23:42.233177 5120 generic.go:358] "Generic (PLEG): container finished" podID="dcb3276e-6f5a-4fea-8428-6c16ca81a07a" containerID="6034e92d58dd5d1606c4810dafd10d1bbe734690458d5af960764b5c89664ccc" exitCode=2 Mar 16 16:23:42 crc kubenswrapper[5120]: I0316 16:23:42.233235 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"dcb3276e-6f5a-4fea-8428-6c16ca81a07a","Type":"ContainerDied","Data":"e0c45f416370a2663e2005580cbac7f56864a27b77c00cdac6e73309470099cc"} Mar 16 16:23:42 crc kubenswrapper[5120]: I0316 16:23:42.233282 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"dcb3276e-6f5a-4fea-8428-6c16ca81a07a","Type":"ContainerDied","Data":"6034e92d58dd5d1606c4810dafd10d1bbe734690458d5af960764b5c89664ccc"} Mar 16 16:23:42 crc kubenswrapper[5120]: I0316 16:23:42.254065 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/kube-state-metrics-0" podStartSLOduration=1.889968171 podStartE2EDuration="2.254045759s" podCreationTimestamp="2026-03-16 16:23:40 +0000 UTC" firstStartedPulling="2026-03-16 16:23:41.161367982 +0000 UTC m=+3123.315299639" lastFinishedPulling="2026-03-16 16:23:41.52544557 +0000 UTC m=+3123.679377227" observedRunningTime="2026-03-16 16:23:42.244905024 +0000 UTC m=+3124.398836681" watchObservedRunningTime="2026-03-16 16:23:42.254045759 +0000 UTC m=+3124.407977416" Mar 16 16:23:42 crc kubenswrapper[5120]: I0316 16:23:42.681300 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:23:42 crc kubenswrapper[5120]: I0316 16:23:42.681637 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="b34821cb-b796-4656-9eb3-536286a2c00d" containerName="nova-api-log" containerID="cri-o://3c56d0f8b0a3e0bc3fb824285e1f866b7c0fe4b2c167f01748d77ce09fe9939e" gracePeriod=30 Mar 16 16:23:42 crc kubenswrapper[5120]: I0316 16:23:42.681731 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="b34821cb-b796-4656-9eb3-536286a2c00d" containerName="nova-api-api" containerID="cri-o://d576c1e4fc13885a95f26fa17ff27a2deb20a610a42cbc82a3e77342bbbe9ade" gracePeriod=30 Mar 16 16:23:43 crc kubenswrapper[5120]: I0316 16:23:43.244658 5120 generic.go:358] "Generic (PLEG): container finished" podID="b34821cb-b796-4656-9eb3-536286a2c00d" containerID="3c56d0f8b0a3e0bc3fb824285e1f866b7c0fe4b2c167f01748d77ce09fe9939e" exitCode=143 Mar 16 16:23:43 crc kubenswrapper[5120]: I0316 16:23:43.244778 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"b34821cb-b796-4656-9eb3-536286a2c00d","Type":"ContainerDied","Data":"3c56d0f8b0a3e0bc3fb824285e1f866b7c0fe4b2c167f01748d77ce09fe9939e"} Mar 16 16:23:43 crc kubenswrapper[5120]: I0316 16:23:43.247416 5120 generic.go:358] "Generic (PLEG): container finished" podID="dcb3276e-6f5a-4fea-8428-6c16ca81a07a" containerID="c3c5a0b6f157f90744850c14f4a79b95328a38cc804e65089108fdea76983af0" exitCode=0 Mar 16 16:23:43 crc kubenswrapper[5120]: I0316 16:23:43.247503 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"dcb3276e-6f5a-4fea-8428-6c16ca81a07a","Type":"ContainerDied","Data":"c3c5a0b6f157f90744850c14f4a79b95328a38cc804e65089108fdea76983af0"} Mar 16 16:23:43 crc kubenswrapper[5120]: I0316 16:23:43.681437 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:23:43 crc kubenswrapper[5120]: I0316 16:23:43.818424 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/dcb3276e-6f5a-4fea-8428-6c16ca81a07a-scripts\") pod \"dcb3276e-6f5a-4fea-8428-6c16ca81a07a\" (UID: \"dcb3276e-6f5a-4fea-8428-6c16ca81a07a\") " Mar 16 16:23:43 crc kubenswrapper[5120]: I0316 16:23:43.818661 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dcb3276e-6f5a-4fea-8428-6c16ca81a07a-config-data\") pod \"dcb3276e-6f5a-4fea-8428-6c16ca81a07a\" (UID: \"dcb3276e-6f5a-4fea-8428-6c16ca81a07a\") " Mar 16 16:23:43 crc kubenswrapper[5120]: I0316 16:23:43.818752 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/dcb3276e-6f5a-4fea-8428-6c16ca81a07a-run-httpd\") pod \"dcb3276e-6f5a-4fea-8428-6c16ca81a07a\" (UID: \"dcb3276e-6f5a-4fea-8428-6c16ca81a07a\") " Mar 16 16:23:43 crc kubenswrapper[5120]: I0316 16:23:43.818835 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/dcb3276e-6f5a-4fea-8428-6c16ca81a07a-log-httpd\") pod \"dcb3276e-6f5a-4fea-8428-6c16ca81a07a\" (UID: \"dcb3276e-6f5a-4fea-8428-6c16ca81a07a\") " Mar 16 16:23:43 crc kubenswrapper[5120]: I0316 16:23:43.818929 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/dcb3276e-6f5a-4fea-8428-6c16ca81a07a-sg-core-conf-yaml\") pod \"dcb3276e-6f5a-4fea-8428-6c16ca81a07a\" (UID: \"dcb3276e-6f5a-4fea-8428-6c16ca81a07a\") " Mar 16 16:23:43 crc kubenswrapper[5120]: I0316 16:23:43.819263 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8gzwq\" (UniqueName: \"kubernetes.io/projected/dcb3276e-6f5a-4fea-8428-6c16ca81a07a-kube-api-access-8gzwq\") pod \"dcb3276e-6f5a-4fea-8428-6c16ca81a07a\" (UID: \"dcb3276e-6f5a-4fea-8428-6c16ca81a07a\") " Mar 16 16:23:43 crc kubenswrapper[5120]: I0316 16:23:43.819394 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dcb3276e-6f5a-4fea-8428-6c16ca81a07a-combined-ca-bundle\") pod \"dcb3276e-6f5a-4fea-8428-6c16ca81a07a\" (UID: \"dcb3276e-6f5a-4fea-8428-6c16ca81a07a\") " Mar 16 16:23:43 crc kubenswrapper[5120]: I0316 16:23:43.819792 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dcb3276e-6f5a-4fea-8428-6c16ca81a07a-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "dcb3276e-6f5a-4fea-8428-6c16ca81a07a" (UID: "dcb3276e-6f5a-4fea-8428-6c16ca81a07a"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:23:43 crc kubenswrapper[5120]: I0316 16:23:43.819971 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dcb3276e-6f5a-4fea-8428-6c16ca81a07a-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "dcb3276e-6f5a-4fea-8428-6c16ca81a07a" (UID: "dcb3276e-6f5a-4fea-8428-6c16ca81a07a"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:23:43 crc kubenswrapper[5120]: I0316 16:23:43.820461 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/dcb3276e-6f5a-4fea-8428-6c16ca81a07a-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:23:43 crc kubenswrapper[5120]: I0316 16:23:43.820487 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/dcb3276e-6f5a-4fea-8428-6c16ca81a07a-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:23:43 crc kubenswrapper[5120]: I0316 16:23:43.824620 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dcb3276e-6f5a-4fea-8428-6c16ca81a07a-kube-api-access-8gzwq" (OuterVolumeSpecName: "kube-api-access-8gzwq") pod "dcb3276e-6f5a-4fea-8428-6c16ca81a07a" (UID: "dcb3276e-6f5a-4fea-8428-6c16ca81a07a"). InnerVolumeSpecName "kube-api-access-8gzwq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:23:43 crc kubenswrapper[5120]: I0316 16:23:43.824843 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dcb3276e-6f5a-4fea-8428-6c16ca81a07a-scripts" (OuterVolumeSpecName: "scripts") pod "dcb3276e-6f5a-4fea-8428-6c16ca81a07a" (UID: "dcb3276e-6f5a-4fea-8428-6c16ca81a07a"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:23:43 crc kubenswrapper[5120]: I0316 16:23:43.860480 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dcb3276e-6f5a-4fea-8428-6c16ca81a07a-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "dcb3276e-6f5a-4fea-8428-6c16ca81a07a" (UID: "dcb3276e-6f5a-4fea-8428-6c16ca81a07a"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:23:43 crc kubenswrapper[5120]: I0316 16:23:43.912928 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dcb3276e-6f5a-4fea-8428-6c16ca81a07a-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "dcb3276e-6f5a-4fea-8428-6c16ca81a07a" (UID: "dcb3276e-6f5a-4fea-8428-6c16ca81a07a"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:23:43 crc kubenswrapper[5120]: I0316 16:23:43.922503 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8gzwq\" (UniqueName: \"kubernetes.io/projected/dcb3276e-6f5a-4fea-8428-6c16ca81a07a-kube-api-access-8gzwq\") on node \"crc\" DevicePath \"\"" Mar 16 16:23:43 crc kubenswrapper[5120]: I0316 16:23:43.922535 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dcb3276e-6f5a-4fea-8428-6c16ca81a07a-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:23:43 crc kubenswrapper[5120]: I0316 16:23:43.922545 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/dcb3276e-6f5a-4fea-8428-6c16ca81a07a-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:23:43 crc kubenswrapper[5120]: I0316 16:23:43.922556 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/dcb3276e-6f5a-4fea-8428-6c16ca81a07a-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 16:23:43 crc kubenswrapper[5120]: I0316 16:23:43.947383 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dcb3276e-6f5a-4fea-8428-6c16ca81a07a-config-data" (OuterVolumeSpecName: "config-data") pod "dcb3276e-6f5a-4fea-8428-6c16ca81a07a" (UID: "dcb3276e-6f5a-4fea-8428-6c16ca81a07a"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:23:44 crc kubenswrapper[5120]: I0316 16:23:44.024321 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dcb3276e-6f5a-4fea-8428-6c16ca81a07a-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:23:44 crc kubenswrapper[5120]: I0316 16:23:44.261205 5120 generic.go:358] "Generic (PLEG): container finished" podID="dcb3276e-6f5a-4fea-8428-6c16ca81a07a" containerID="bfc7ca57a071c668257867f7d127c752f82d675faaea323a62e42a21f179772f" exitCode=0 Mar 16 16:23:44 crc kubenswrapper[5120]: I0316 16:23:44.261265 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"dcb3276e-6f5a-4fea-8428-6c16ca81a07a","Type":"ContainerDied","Data":"bfc7ca57a071c668257867f7d127c752f82d675faaea323a62e42a21f179772f"} Mar 16 16:23:44 crc kubenswrapper[5120]: I0316 16:23:44.261642 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"dcb3276e-6f5a-4fea-8428-6c16ca81a07a","Type":"ContainerDied","Data":"180c7fc2d2ca2ed1e90054c6360b1f4a6caace087cd2f2b13da98db51fa4a31b"} Mar 16 16:23:44 crc kubenswrapper[5120]: I0316 16:23:44.261666 5120 scope.go:117] "RemoveContainer" containerID="e0c45f416370a2663e2005580cbac7f56864a27b77c00cdac6e73309470099cc" Mar 16 16:23:44 crc kubenswrapper[5120]: I0316 16:23:44.261288 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:23:44 crc kubenswrapper[5120]: I0316 16:23:44.302699 5120 scope.go:117] "RemoveContainer" containerID="6034e92d58dd5d1606c4810dafd10d1bbe734690458d5af960764b5c89664ccc" Mar 16 16:23:44 crc kubenswrapper[5120]: I0316 16:23:44.307507 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:23:44 crc kubenswrapper[5120]: I0316 16:23:44.324746 5120 scope.go:117] "RemoveContainer" containerID="bfc7ca57a071c668257867f7d127c752f82d675faaea323a62e42a21f179772f" Mar 16 16:23:44 crc kubenswrapper[5120]: I0316 16:23:44.333206 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:23:44 crc kubenswrapper[5120]: I0316 16:23:44.345426 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:23:44 crc kubenswrapper[5120]: I0316 16:23:44.346625 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dcb3276e-6f5a-4fea-8428-6c16ca81a07a" containerName="ceilometer-central-agent" Mar 16 16:23:44 crc kubenswrapper[5120]: I0316 16:23:44.346643 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="dcb3276e-6f5a-4fea-8428-6c16ca81a07a" containerName="ceilometer-central-agent" Mar 16 16:23:44 crc kubenswrapper[5120]: I0316 16:23:44.346675 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dcb3276e-6f5a-4fea-8428-6c16ca81a07a" containerName="sg-core" Mar 16 16:23:44 crc kubenswrapper[5120]: I0316 16:23:44.346681 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="dcb3276e-6f5a-4fea-8428-6c16ca81a07a" containerName="sg-core" Mar 16 16:23:44 crc kubenswrapper[5120]: I0316 16:23:44.346722 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dcb3276e-6f5a-4fea-8428-6c16ca81a07a" containerName="ceilometer-notification-agent" Mar 16 16:23:44 crc kubenswrapper[5120]: I0316 16:23:44.346728 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="dcb3276e-6f5a-4fea-8428-6c16ca81a07a" containerName="ceilometer-notification-agent" Mar 16 16:23:44 crc kubenswrapper[5120]: I0316 16:23:44.346741 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dcb3276e-6f5a-4fea-8428-6c16ca81a07a" containerName="proxy-httpd" Mar 16 16:23:44 crc kubenswrapper[5120]: I0316 16:23:44.346747 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="dcb3276e-6f5a-4fea-8428-6c16ca81a07a" containerName="proxy-httpd" Mar 16 16:23:44 crc kubenswrapper[5120]: I0316 16:23:44.346929 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="dcb3276e-6f5a-4fea-8428-6c16ca81a07a" containerName="ceilometer-central-agent" Mar 16 16:23:44 crc kubenswrapper[5120]: I0316 16:23:44.346956 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="dcb3276e-6f5a-4fea-8428-6c16ca81a07a" containerName="sg-core" Mar 16 16:23:44 crc kubenswrapper[5120]: I0316 16:23:44.346970 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="dcb3276e-6f5a-4fea-8428-6c16ca81a07a" containerName="ceilometer-notification-agent" Mar 16 16:23:44 crc kubenswrapper[5120]: I0316 16:23:44.346979 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="dcb3276e-6f5a-4fea-8428-6c16ca81a07a" containerName="proxy-httpd" Mar 16 16:23:44 crc kubenswrapper[5120]: I0316 16:23:44.355434 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:23:44 crc kubenswrapper[5120]: I0316 16:23:44.362385 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 16:23:44 crc kubenswrapper[5120]: I0316 16:23:44.362752 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ceilometer-internal-svc\"" Mar 16 16:23:44 crc kubenswrapper[5120]: I0316 16:23:44.363037 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 16:23:44 crc kubenswrapper[5120]: I0316 16:23:44.371251 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:23:44 crc kubenswrapper[5120]: I0316 16:23:44.379503 5120 scope.go:117] "RemoveContainer" containerID="c3c5a0b6f157f90744850c14f4a79b95328a38cc804e65089108fdea76983af0" Mar 16 16:23:44 crc kubenswrapper[5120]: I0316 16:23:44.424920 5120 scope.go:117] "RemoveContainer" containerID="e0c45f416370a2663e2005580cbac7f56864a27b77c00cdac6e73309470099cc" Mar 16 16:23:44 crc kubenswrapper[5120]: E0316 16:23:44.425409 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e0c45f416370a2663e2005580cbac7f56864a27b77c00cdac6e73309470099cc\": container with ID starting with e0c45f416370a2663e2005580cbac7f56864a27b77c00cdac6e73309470099cc not found: ID does not exist" containerID="e0c45f416370a2663e2005580cbac7f56864a27b77c00cdac6e73309470099cc" Mar 16 16:23:44 crc kubenswrapper[5120]: I0316 16:23:44.425470 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0c45f416370a2663e2005580cbac7f56864a27b77c00cdac6e73309470099cc"} err="failed to get container status \"e0c45f416370a2663e2005580cbac7f56864a27b77c00cdac6e73309470099cc\": rpc error: code = NotFound desc = could not find container \"e0c45f416370a2663e2005580cbac7f56864a27b77c00cdac6e73309470099cc\": container with ID starting with e0c45f416370a2663e2005580cbac7f56864a27b77c00cdac6e73309470099cc not found: ID does not exist" Mar 16 16:23:44 crc kubenswrapper[5120]: I0316 16:23:44.425504 5120 scope.go:117] "RemoveContainer" containerID="6034e92d58dd5d1606c4810dafd10d1bbe734690458d5af960764b5c89664ccc" Mar 16 16:23:44 crc kubenswrapper[5120]: E0316 16:23:44.426989 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6034e92d58dd5d1606c4810dafd10d1bbe734690458d5af960764b5c89664ccc\": container with ID starting with 6034e92d58dd5d1606c4810dafd10d1bbe734690458d5af960764b5c89664ccc not found: ID does not exist" containerID="6034e92d58dd5d1606c4810dafd10d1bbe734690458d5af960764b5c89664ccc" Mar 16 16:23:44 crc kubenswrapper[5120]: I0316 16:23:44.427018 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6034e92d58dd5d1606c4810dafd10d1bbe734690458d5af960764b5c89664ccc"} err="failed to get container status \"6034e92d58dd5d1606c4810dafd10d1bbe734690458d5af960764b5c89664ccc\": rpc error: code = NotFound desc = could not find container \"6034e92d58dd5d1606c4810dafd10d1bbe734690458d5af960764b5c89664ccc\": container with ID starting with 6034e92d58dd5d1606c4810dafd10d1bbe734690458d5af960764b5c89664ccc not found: ID does not exist" Mar 16 16:23:44 crc kubenswrapper[5120]: I0316 16:23:44.427038 5120 scope.go:117] "RemoveContainer" containerID="bfc7ca57a071c668257867f7d127c752f82d675faaea323a62e42a21f179772f" Mar 16 16:23:44 crc kubenswrapper[5120]: E0316 16:23:44.427291 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bfc7ca57a071c668257867f7d127c752f82d675faaea323a62e42a21f179772f\": container with ID starting with bfc7ca57a071c668257867f7d127c752f82d675faaea323a62e42a21f179772f not found: ID does not exist" containerID="bfc7ca57a071c668257867f7d127c752f82d675faaea323a62e42a21f179772f" Mar 16 16:23:44 crc kubenswrapper[5120]: I0316 16:23:44.427322 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bfc7ca57a071c668257867f7d127c752f82d675faaea323a62e42a21f179772f"} err="failed to get container status \"bfc7ca57a071c668257867f7d127c752f82d675faaea323a62e42a21f179772f\": rpc error: code = NotFound desc = could not find container \"bfc7ca57a071c668257867f7d127c752f82d675faaea323a62e42a21f179772f\": container with ID starting with bfc7ca57a071c668257867f7d127c752f82d675faaea323a62e42a21f179772f not found: ID does not exist" Mar 16 16:23:44 crc kubenswrapper[5120]: I0316 16:23:44.427339 5120 scope.go:117] "RemoveContainer" containerID="c3c5a0b6f157f90744850c14f4a79b95328a38cc804e65089108fdea76983af0" Mar 16 16:23:44 crc kubenswrapper[5120]: E0316 16:23:44.428715 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c3c5a0b6f157f90744850c14f4a79b95328a38cc804e65089108fdea76983af0\": container with ID starting with c3c5a0b6f157f90744850c14f4a79b95328a38cc804e65089108fdea76983af0 not found: ID does not exist" containerID="c3c5a0b6f157f90744850c14f4a79b95328a38cc804e65089108fdea76983af0" Mar 16 16:23:44 crc kubenswrapper[5120]: I0316 16:23:44.428768 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3c5a0b6f157f90744850c14f4a79b95328a38cc804e65089108fdea76983af0"} err="failed to get container status \"c3c5a0b6f157f90744850c14f4a79b95328a38cc804e65089108fdea76983af0\": rpc error: code = NotFound desc = could not find container \"c3c5a0b6f157f90744850c14f4a79b95328a38cc804e65089108fdea76983af0\": container with ID starting with c3c5a0b6f157f90744850c14f4a79b95328a38cc804e65089108fdea76983af0 not found: ID does not exist" Mar 16 16:23:44 crc kubenswrapper[5120]: I0316 16:23:44.441908 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bd019f3d-1483-40e4-9534-b8bd551ed652-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"bd019f3d-1483-40e4-9534-b8bd551ed652\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:23:44 crc kubenswrapper[5120]: I0316 16:23:44.442019 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/bd019f3d-1483-40e4-9534-b8bd551ed652-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"bd019f3d-1483-40e4-9534-b8bd551ed652\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:23:44 crc kubenswrapper[5120]: I0316 16:23:44.442092 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/bd019f3d-1483-40e4-9534-b8bd551ed652-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"bd019f3d-1483-40e4-9534-b8bd551ed652\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:23:44 crc kubenswrapper[5120]: I0316 16:23:44.442172 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/bd019f3d-1483-40e4-9534-b8bd551ed652-run-httpd\") pod \"ceilometer-0\" (UID: \"bd019f3d-1483-40e4-9534-b8bd551ed652\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:23:44 crc kubenswrapper[5120]: I0316 16:23:44.442231 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/bd019f3d-1483-40e4-9534-b8bd551ed652-scripts\") pod \"ceilometer-0\" (UID: \"bd019f3d-1483-40e4-9534-b8bd551ed652\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:23:44 crc kubenswrapper[5120]: I0316 16:23:44.442316 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrz7w\" (UniqueName: \"kubernetes.io/projected/bd019f3d-1483-40e4-9534-b8bd551ed652-kube-api-access-zrz7w\") pod \"ceilometer-0\" (UID: \"bd019f3d-1483-40e4-9534-b8bd551ed652\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:23:44 crc kubenswrapper[5120]: I0316 16:23:44.442466 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/bd019f3d-1483-40e4-9534-b8bd551ed652-log-httpd\") pod \"ceilometer-0\" (UID: \"bd019f3d-1483-40e4-9534-b8bd551ed652\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:23:44 crc kubenswrapper[5120]: I0316 16:23:44.442669 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bd019f3d-1483-40e4-9534-b8bd551ed652-config-data\") pod \"ceilometer-0\" (UID: \"bd019f3d-1483-40e4-9534-b8bd551ed652\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:23:44 crc kubenswrapper[5120]: I0316 16:23:44.545089 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bd019f3d-1483-40e4-9534-b8bd551ed652-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"bd019f3d-1483-40e4-9534-b8bd551ed652\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:23:44 crc kubenswrapper[5120]: I0316 16:23:44.545197 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/bd019f3d-1483-40e4-9534-b8bd551ed652-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"bd019f3d-1483-40e4-9534-b8bd551ed652\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:23:44 crc kubenswrapper[5120]: I0316 16:23:44.545305 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/bd019f3d-1483-40e4-9534-b8bd551ed652-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"bd019f3d-1483-40e4-9534-b8bd551ed652\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:23:44 crc kubenswrapper[5120]: I0316 16:23:44.545380 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/bd019f3d-1483-40e4-9534-b8bd551ed652-run-httpd\") pod \"ceilometer-0\" (UID: \"bd019f3d-1483-40e4-9534-b8bd551ed652\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:23:44 crc kubenswrapper[5120]: I0316 16:23:44.545426 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/bd019f3d-1483-40e4-9534-b8bd551ed652-scripts\") pod \"ceilometer-0\" (UID: \"bd019f3d-1483-40e4-9534-b8bd551ed652\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:23:44 crc kubenswrapper[5120]: I0316 16:23:44.545460 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zrz7w\" (UniqueName: \"kubernetes.io/projected/bd019f3d-1483-40e4-9534-b8bd551ed652-kube-api-access-zrz7w\") pod \"ceilometer-0\" (UID: \"bd019f3d-1483-40e4-9534-b8bd551ed652\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:23:44 crc kubenswrapper[5120]: I0316 16:23:44.545510 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/bd019f3d-1483-40e4-9534-b8bd551ed652-log-httpd\") pod \"ceilometer-0\" (UID: \"bd019f3d-1483-40e4-9534-b8bd551ed652\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:23:44 crc kubenswrapper[5120]: I0316 16:23:44.545641 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bd019f3d-1483-40e4-9534-b8bd551ed652-config-data\") pod \"ceilometer-0\" (UID: \"bd019f3d-1483-40e4-9534-b8bd551ed652\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:23:44 crc kubenswrapper[5120]: I0316 16:23:44.547495 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/bd019f3d-1483-40e4-9534-b8bd551ed652-run-httpd\") pod \"ceilometer-0\" (UID: \"bd019f3d-1483-40e4-9534-b8bd551ed652\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:23:44 crc kubenswrapper[5120]: I0316 16:23:44.547586 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/bd019f3d-1483-40e4-9534-b8bd551ed652-log-httpd\") pod \"ceilometer-0\" (UID: \"bd019f3d-1483-40e4-9534-b8bd551ed652\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:23:44 crc kubenswrapper[5120]: I0316 16:23:44.551560 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/bd019f3d-1483-40e4-9534-b8bd551ed652-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"bd019f3d-1483-40e4-9534-b8bd551ed652\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:23:44 crc kubenswrapper[5120]: I0316 16:23:44.552048 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/bd019f3d-1483-40e4-9534-b8bd551ed652-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"bd019f3d-1483-40e4-9534-b8bd551ed652\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:23:44 crc kubenswrapper[5120]: I0316 16:23:44.553285 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bd019f3d-1483-40e4-9534-b8bd551ed652-config-data\") pod \"ceilometer-0\" (UID: \"bd019f3d-1483-40e4-9534-b8bd551ed652\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:23:44 crc kubenswrapper[5120]: I0316 16:23:44.560556 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bd019f3d-1483-40e4-9534-b8bd551ed652-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"bd019f3d-1483-40e4-9534-b8bd551ed652\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:23:44 crc kubenswrapper[5120]: I0316 16:23:44.563491 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/bd019f3d-1483-40e4-9534-b8bd551ed652-scripts\") pod \"ceilometer-0\" (UID: \"bd019f3d-1483-40e4-9534-b8bd551ed652\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:23:44 crc kubenswrapper[5120]: I0316 16:23:44.565303 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrz7w\" (UniqueName: \"kubernetes.io/projected/bd019f3d-1483-40e4-9534-b8bd551ed652-kube-api-access-zrz7w\") pod \"ceilometer-0\" (UID: \"bd019f3d-1483-40e4-9534-b8bd551ed652\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:23:44 crc kubenswrapper[5120]: I0316 16:23:44.681562 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dcb3276e-6f5a-4fea-8428-6c16ca81a07a" path="/var/lib/kubelet/pods/dcb3276e-6f5a-4fea-8428-6c16ca81a07a/volumes" Mar 16 16:23:44 crc kubenswrapper[5120]: I0316 16:23:44.696243 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:23:45 crc kubenswrapper[5120]: I0316 16:23:45.220800 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:23:45 crc kubenswrapper[5120]: I0316 16:23:45.284169 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"bd019f3d-1483-40e4-9534-b8bd551ed652","Type":"ContainerStarted","Data":"ed71670a7653765c9db84f5701474f386d7ef801cca6e92ffd96b09b675d8a7a"} Mar 16 16:23:46 crc kubenswrapper[5120]: I0316 16:23:46.301655 5120 generic.go:358] "Generic (PLEG): container finished" podID="b34821cb-b796-4656-9eb3-536286a2c00d" containerID="d576c1e4fc13885a95f26fa17ff27a2deb20a610a42cbc82a3e77342bbbe9ade" exitCode=0 Mar 16 16:23:46 crc kubenswrapper[5120]: I0316 16:23:46.301880 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"b34821cb-b796-4656-9eb3-536286a2c00d","Type":"ContainerDied","Data":"d576c1e4fc13885a95f26fa17ff27a2deb20a610a42cbc82a3e77342bbbe9ade"} Mar 16 16:23:46 crc kubenswrapper[5120]: I0316 16:23:46.308068 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"bd019f3d-1483-40e4-9534-b8bd551ed652","Type":"ContainerStarted","Data":"482e3be4b8e8664bade0b2a681aa7e0b736487e8b6c01fc03edf8ad396dc6ad3"} Mar 16 16:23:46 crc kubenswrapper[5120]: I0316 16:23:46.554091 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:23:46 crc kubenswrapper[5120]: I0316 16:23:46.713108 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b34821cb-b796-4656-9eb3-536286a2c00d-config-data\") pod \"b34821cb-b796-4656-9eb3-536286a2c00d\" (UID: \"b34821cb-b796-4656-9eb3-536286a2c00d\") " Mar 16 16:23:46 crc kubenswrapper[5120]: I0316 16:23:46.713150 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b34821cb-b796-4656-9eb3-536286a2c00d-combined-ca-bundle\") pod \"b34821cb-b796-4656-9eb3-536286a2c00d\" (UID: \"b34821cb-b796-4656-9eb3-536286a2c00d\") " Mar 16 16:23:46 crc kubenswrapper[5120]: I0316 16:23:46.713221 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b34821cb-b796-4656-9eb3-536286a2c00d-logs\") pod \"b34821cb-b796-4656-9eb3-536286a2c00d\" (UID: \"b34821cb-b796-4656-9eb3-536286a2c00d\") " Mar 16 16:23:46 crc kubenswrapper[5120]: I0316 16:23:46.713312 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rv6wd\" (UniqueName: \"kubernetes.io/projected/b34821cb-b796-4656-9eb3-536286a2c00d-kube-api-access-rv6wd\") pod \"b34821cb-b796-4656-9eb3-536286a2c00d\" (UID: \"b34821cb-b796-4656-9eb3-536286a2c00d\") " Mar 16 16:23:46 crc kubenswrapper[5120]: I0316 16:23:46.714321 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b34821cb-b796-4656-9eb3-536286a2c00d-logs" (OuterVolumeSpecName: "logs") pod "b34821cb-b796-4656-9eb3-536286a2c00d" (UID: "b34821cb-b796-4656-9eb3-536286a2c00d"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:23:46 crc kubenswrapper[5120]: I0316 16:23:46.715188 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b34821cb-b796-4656-9eb3-536286a2c00d-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:23:46 crc kubenswrapper[5120]: I0316 16:23:46.718361 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b34821cb-b796-4656-9eb3-536286a2c00d-kube-api-access-rv6wd" (OuterVolumeSpecName: "kube-api-access-rv6wd") pod "b34821cb-b796-4656-9eb3-536286a2c00d" (UID: "b34821cb-b796-4656-9eb3-536286a2c00d"). InnerVolumeSpecName "kube-api-access-rv6wd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:23:46 crc kubenswrapper[5120]: I0316 16:23:46.746178 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b34821cb-b796-4656-9eb3-536286a2c00d-config-data" (OuterVolumeSpecName: "config-data") pod "b34821cb-b796-4656-9eb3-536286a2c00d" (UID: "b34821cb-b796-4656-9eb3-536286a2c00d"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:23:46 crc kubenswrapper[5120]: I0316 16:23:46.749003 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b34821cb-b796-4656-9eb3-536286a2c00d-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "b34821cb-b796-4656-9eb3-536286a2c00d" (UID: "b34821cb-b796-4656-9eb3-536286a2c00d"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:23:46 crc kubenswrapper[5120]: I0316 16:23:46.817558 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b34821cb-b796-4656-9eb3-536286a2c00d-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:23:46 crc kubenswrapper[5120]: I0316 16:23:46.817590 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b34821cb-b796-4656-9eb3-536286a2c00d-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:23:46 crc kubenswrapper[5120]: I0316 16:23:46.817603 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rv6wd\" (UniqueName: \"kubernetes.io/projected/b34821cb-b796-4656-9eb3-536286a2c00d-kube-api-access-rv6wd\") on node \"crc\" DevicePath \"\"" Mar 16 16:23:47 crc kubenswrapper[5120]: I0316 16:23:47.322818 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:23:47 crc kubenswrapper[5120]: I0316 16:23:47.322892 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"b34821cb-b796-4656-9eb3-536286a2c00d","Type":"ContainerDied","Data":"c41746b9873158fc982c66cde4294bbc97ada19a136c73216ada8aba50bdae86"} Mar 16 16:23:47 crc kubenswrapper[5120]: I0316 16:23:47.323936 5120 scope.go:117] "RemoveContainer" containerID="d576c1e4fc13885a95f26fa17ff27a2deb20a610a42cbc82a3e77342bbbe9ade" Mar 16 16:23:47 crc kubenswrapper[5120]: I0316 16:23:47.341134 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"bd019f3d-1483-40e4-9534-b8bd551ed652","Type":"ContainerStarted","Data":"c976d3b3db94b93e1732bdd7cd1eb5e253e9c1f29aa03aaefc515f7729724645"} Mar 16 16:23:47 crc kubenswrapper[5120]: I0316 16:23:47.355610 5120 scope.go:117] "RemoveContainer" containerID="3c56d0f8b0a3e0bc3fb824285e1f866b7c0fe4b2c167f01748d77ce09fe9939e" Mar 16 16:23:47 crc kubenswrapper[5120]: I0316 16:23:47.375087 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:23:47 crc kubenswrapper[5120]: I0316 16:23:47.389404 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:23:47 crc kubenswrapper[5120]: I0316 16:23:47.411148 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:23:47 crc kubenswrapper[5120]: I0316 16:23:47.413244 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b34821cb-b796-4656-9eb3-536286a2c00d" containerName="nova-api-log" Mar 16 16:23:47 crc kubenswrapper[5120]: I0316 16:23:47.413280 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="b34821cb-b796-4656-9eb3-536286a2c00d" containerName="nova-api-log" Mar 16 16:23:47 crc kubenswrapper[5120]: I0316 16:23:47.413423 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b34821cb-b796-4656-9eb3-536286a2c00d" containerName="nova-api-api" Mar 16 16:23:47 crc kubenswrapper[5120]: I0316 16:23:47.413440 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="b34821cb-b796-4656-9eb3-536286a2c00d" containerName="nova-api-api" Mar 16 16:23:47 crc kubenswrapper[5120]: I0316 16:23:47.413714 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="b34821cb-b796-4656-9eb3-536286a2c00d" containerName="nova-api-api" Mar 16 16:23:47 crc kubenswrapper[5120]: I0316 16:23:47.413751 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="b34821cb-b796-4656-9eb3-536286a2c00d" containerName="nova-api-log" Mar 16 16:23:47 crc kubenswrapper[5120]: I0316 16:23:47.426347 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:23:47 crc kubenswrapper[5120]: I0316 16:23:47.428744 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-config-data\"" Mar 16 16:23:47 crc kubenswrapper[5120]: I0316 16:23:47.429190 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-internal-svc\"" Mar 16 16:23:47 crc kubenswrapper[5120]: I0316 16:23:47.430393 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-public-svc\"" Mar 16 16:23:47 crc kubenswrapper[5120]: I0316 16:23:47.437317 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:23:47 crc kubenswrapper[5120]: I0316 16:23:47.536135 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/11468616-1e2d-4cfd-b172-299b0cc33f6e-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"11468616-1e2d-4cfd-b172-299b0cc33f6e\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:23:47 crc kubenswrapper[5120]: I0316 16:23:47.536380 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/11468616-1e2d-4cfd-b172-299b0cc33f6e-public-tls-certs\") pod \"nova-api-0\" (UID: \"11468616-1e2d-4cfd-b172-299b0cc33f6e\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:23:47 crc kubenswrapper[5120]: I0316 16:23:47.536509 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/11468616-1e2d-4cfd-b172-299b0cc33f6e-config-data\") pod \"nova-api-0\" (UID: \"11468616-1e2d-4cfd-b172-299b0cc33f6e\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:23:47 crc kubenswrapper[5120]: I0316 16:23:47.536668 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/11468616-1e2d-4cfd-b172-299b0cc33f6e-logs\") pod \"nova-api-0\" (UID: \"11468616-1e2d-4cfd-b172-299b0cc33f6e\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:23:47 crc kubenswrapper[5120]: I0316 16:23:47.536991 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvbvb\" (UniqueName: \"kubernetes.io/projected/11468616-1e2d-4cfd-b172-299b0cc33f6e-kube-api-access-nvbvb\") pod \"nova-api-0\" (UID: \"11468616-1e2d-4cfd-b172-299b0cc33f6e\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:23:47 crc kubenswrapper[5120]: I0316 16:23:47.537076 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/11468616-1e2d-4cfd-b172-299b0cc33f6e-internal-tls-certs\") pod \"nova-api-0\" (UID: \"11468616-1e2d-4cfd-b172-299b0cc33f6e\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:23:47 crc kubenswrapper[5120]: I0316 16:23:47.638973 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/11468616-1e2d-4cfd-b172-299b0cc33f6e-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"11468616-1e2d-4cfd-b172-299b0cc33f6e\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:23:47 crc kubenswrapper[5120]: I0316 16:23:47.639234 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/11468616-1e2d-4cfd-b172-299b0cc33f6e-public-tls-certs\") pod \"nova-api-0\" (UID: \"11468616-1e2d-4cfd-b172-299b0cc33f6e\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:23:47 crc kubenswrapper[5120]: I0316 16:23:47.639308 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/11468616-1e2d-4cfd-b172-299b0cc33f6e-config-data\") pod \"nova-api-0\" (UID: \"11468616-1e2d-4cfd-b172-299b0cc33f6e\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:23:47 crc kubenswrapper[5120]: I0316 16:23:47.639350 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/11468616-1e2d-4cfd-b172-299b0cc33f6e-logs\") pod \"nova-api-0\" (UID: \"11468616-1e2d-4cfd-b172-299b0cc33f6e\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:23:47 crc kubenswrapper[5120]: I0316 16:23:47.639452 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nvbvb\" (UniqueName: \"kubernetes.io/projected/11468616-1e2d-4cfd-b172-299b0cc33f6e-kube-api-access-nvbvb\") pod \"nova-api-0\" (UID: \"11468616-1e2d-4cfd-b172-299b0cc33f6e\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:23:47 crc kubenswrapper[5120]: I0316 16:23:47.639490 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/11468616-1e2d-4cfd-b172-299b0cc33f6e-internal-tls-certs\") pod \"nova-api-0\" (UID: \"11468616-1e2d-4cfd-b172-299b0cc33f6e\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:23:47 crc kubenswrapper[5120]: I0316 16:23:47.640180 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/11468616-1e2d-4cfd-b172-299b0cc33f6e-logs\") pod \"nova-api-0\" (UID: \"11468616-1e2d-4cfd-b172-299b0cc33f6e\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:23:47 crc kubenswrapper[5120]: I0316 16:23:47.653479 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/11468616-1e2d-4cfd-b172-299b0cc33f6e-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"11468616-1e2d-4cfd-b172-299b0cc33f6e\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:23:47 crc kubenswrapper[5120]: I0316 16:23:47.653481 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/11468616-1e2d-4cfd-b172-299b0cc33f6e-config-data\") pod \"nova-api-0\" (UID: \"11468616-1e2d-4cfd-b172-299b0cc33f6e\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:23:47 crc kubenswrapper[5120]: I0316 16:23:47.653876 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/11468616-1e2d-4cfd-b172-299b0cc33f6e-internal-tls-certs\") pod \"nova-api-0\" (UID: \"11468616-1e2d-4cfd-b172-299b0cc33f6e\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:23:47 crc kubenswrapper[5120]: I0316 16:23:47.654126 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/11468616-1e2d-4cfd-b172-299b0cc33f6e-public-tls-certs\") pod \"nova-api-0\" (UID: \"11468616-1e2d-4cfd-b172-299b0cc33f6e\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:23:47 crc kubenswrapper[5120]: I0316 16:23:47.661847 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvbvb\" (UniqueName: \"kubernetes.io/projected/11468616-1e2d-4cfd-b172-299b0cc33f6e-kube-api-access-nvbvb\") pod \"nova-api-0\" (UID: \"11468616-1e2d-4cfd-b172-299b0cc33f6e\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:23:47 crc kubenswrapper[5120]: I0316 16:23:47.748649 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:23:48 crc kubenswrapper[5120]: I0316 16:23:48.286798 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:23:48 crc kubenswrapper[5120]: I0316 16:23:48.357643 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"bd019f3d-1483-40e4-9534-b8bd551ed652","Type":"ContainerStarted","Data":"6b5a370e0ffa16e0b998b02a52647c91125ab7a84492ad3a7f1d5d5a529919e7"} Mar 16 16:23:48 crc kubenswrapper[5120]: I0316 16:23:48.360656 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"11468616-1e2d-4cfd-b172-299b0cc33f6e","Type":"ContainerStarted","Data":"62db47366a25d78bee24cb4cce0feccd4e491f4bc1825e432a3a84cf7edc0270"} Mar 16 16:23:48 crc kubenswrapper[5120]: I0316 16:23:48.679594 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b34821cb-b796-4656-9eb3-536286a2c00d" path="/var/lib/kubelet/pods/b34821cb-b796-4656-9eb3-536286a2c00d/volumes" Mar 16 16:23:49 crc kubenswrapper[5120]: I0316 16:23:49.373991 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"11468616-1e2d-4cfd-b172-299b0cc33f6e","Type":"ContainerStarted","Data":"80b5ea2dfc65de88c23635009864244ff0b93f75a6ce71ea114be7eaf3207cec"} Mar 16 16:23:49 crc kubenswrapper[5120]: I0316 16:23:49.374556 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"11468616-1e2d-4cfd-b172-299b0cc33f6e","Type":"ContainerStarted","Data":"11ddd2a3e0b9e6341372082fc57fa83a45f334a4f158c1daef9d97c45b20424b"} Mar 16 16:23:49 crc kubenswrapper[5120]: I0316 16:23:49.395218 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=2.395198124 podStartE2EDuration="2.395198124s" podCreationTimestamp="2026-03-16 16:23:47 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:23:49.394702091 +0000 UTC m=+3131.548633748" watchObservedRunningTime="2026-03-16 16:23:49.395198124 +0000 UTC m=+3131.549129791" Mar 16 16:23:50 crc kubenswrapper[5120]: I0316 16:23:50.391646 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"bd019f3d-1483-40e4-9534-b8bd551ed652","Type":"ContainerStarted","Data":"7f7b09d62f8584e17ded7110727a79828e5c99e561c9bf5cd643aa5cc1c74758"} Mar 16 16:23:50 crc kubenswrapper[5120]: I0316 16:23:50.392298 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:23:50 crc kubenswrapper[5120]: I0316 16:23:50.434669 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.536651927 podStartE2EDuration="6.434639667s" podCreationTimestamp="2026-03-16 16:23:44 +0000 UTC" firstStartedPulling="2026-03-16 16:23:45.237727174 +0000 UTC m=+3127.391658831" lastFinishedPulling="2026-03-16 16:23:49.135714914 +0000 UTC m=+3131.289646571" observedRunningTime="2026-03-16 16:23:50.423520189 +0000 UTC m=+3132.577451846" watchObservedRunningTime="2026-03-16 16:23:50.434639667 +0000 UTC m=+3132.588571334" Mar 16 16:23:53 crc kubenswrapper[5120]: I0316 16:23:53.256054 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:23:53 crc kubenswrapper[5120]: I0316 16:23:53.967635 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/community-operators-pxmrv"] Mar 16 16:23:53 crc kubenswrapper[5120]: I0316 16:23:53.975854 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-pxmrv" Mar 16 16:23:53 crc kubenswrapper[5120]: I0316 16:23:53.987057 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/community-operators-pxmrv"] Mar 16 16:23:54 crc kubenswrapper[5120]: I0316 16:23:54.112968 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/f4359ac7-e3c2-48b7-8c4b-6eb5c3dd86fb-utilities\") pod \"community-operators-pxmrv\" (UID: \"f4359ac7-e3c2-48b7-8c4b-6eb5c3dd86fb\") " pod="openshift-marketplace/community-operators-pxmrv" Mar 16 16:23:54 crc kubenswrapper[5120]: I0316 16:23:54.113249 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8v7j\" (UniqueName: \"kubernetes.io/projected/f4359ac7-e3c2-48b7-8c4b-6eb5c3dd86fb-kube-api-access-s8v7j\") pod \"community-operators-pxmrv\" (UID: \"f4359ac7-e3c2-48b7-8c4b-6eb5c3dd86fb\") " pod="openshift-marketplace/community-operators-pxmrv" Mar 16 16:23:54 crc kubenswrapper[5120]: I0316 16:23:54.113325 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/f4359ac7-e3c2-48b7-8c4b-6eb5c3dd86fb-catalog-content\") pod \"community-operators-pxmrv\" (UID: \"f4359ac7-e3c2-48b7-8c4b-6eb5c3dd86fb\") " pod="openshift-marketplace/community-operators-pxmrv" Mar 16 16:23:54 crc kubenswrapper[5120]: I0316 16:23:54.216396 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/f4359ac7-e3c2-48b7-8c4b-6eb5c3dd86fb-utilities\") pod \"community-operators-pxmrv\" (UID: \"f4359ac7-e3c2-48b7-8c4b-6eb5c3dd86fb\") " pod="openshift-marketplace/community-operators-pxmrv" Mar 16 16:23:54 crc kubenswrapper[5120]: I0316 16:23:54.216563 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s8v7j\" (UniqueName: \"kubernetes.io/projected/f4359ac7-e3c2-48b7-8c4b-6eb5c3dd86fb-kube-api-access-s8v7j\") pod \"community-operators-pxmrv\" (UID: \"f4359ac7-e3c2-48b7-8c4b-6eb5c3dd86fb\") " pod="openshift-marketplace/community-operators-pxmrv" Mar 16 16:23:54 crc kubenswrapper[5120]: I0316 16:23:54.216604 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/f4359ac7-e3c2-48b7-8c4b-6eb5c3dd86fb-catalog-content\") pod \"community-operators-pxmrv\" (UID: \"f4359ac7-e3c2-48b7-8c4b-6eb5c3dd86fb\") " pod="openshift-marketplace/community-operators-pxmrv" Mar 16 16:23:54 crc kubenswrapper[5120]: I0316 16:23:54.217117 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/f4359ac7-e3c2-48b7-8c4b-6eb5c3dd86fb-utilities\") pod \"community-operators-pxmrv\" (UID: \"f4359ac7-e3c2-48b7-8c4b-6eb5c3dd86fb\") " pod="openshift-marketplace/community-operators-pxmrv" Mar 16 16:23:54 crc kubenswrapper[5120]: I0316 16:23:54.217225 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/f4359ac7-e3c2-48b7-8c4b-6eb5c3dd86fb-catalog-content\") pod \"community-operators-pxmrv\" (UID: \"f4359ac7-e3c2-48b7-8c4b-6eb5c3dd86fb\") " pod="openshift-marketplace/community-operators-pxmrv" Mar 16 16:23:54 crc kubenswrapper[5120]: I0316 16:23:54.237651 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8v7j\" (UniqueName: \"kubernetes.io/projected/f4359ac7-e3c2-48b7-8c4b-6eb5c3dd86fb-kube-api-access-s8v7j\") pod \"community-operators-pxmrv\" (UID: \"f4359ac7-e3c2-48b7-8c4b-6eb5c3dd86fb\") " pod="openshift-marketplace/community-operators-pxmrv" Mar 16 16:23:54 crc kubenswrapper[5120]: I0316 16:23:54.298083 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-pxmrv" Mar 16 16:23:54 crc kubenswrapper[5120]: I0316 16:23:54.666858 5120 scope.go:117] "RemoveContainer" containerID="f40e444f89abd558ac90555bfd58e04a1c4379a653ba8035c228d2b7a5443eb5" Mar 16 16:23:54 crc kubenswrapper[5120]: E0316 16:23:54.667440 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:23:54 crc kubenswrapper[5120]: I0316 16:23:54.835573 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/community-operators-pxmrv"] Mar 16 16:23:54 crc kubenswrapper[5120]: W0316 16:23:54.846117 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4359ac7_e3c2_48b7_8c4b_6eb5c3dd86fb.slice/crio-46c03848dbe59b01930426c4735ebd6ffd12894f0578404c65d6e0b41ad850ee WatchSource:0}: Error finding container 46c03848dbe59b01930426c4735ebd6ffd12894f0578404c65d6e0b41ad850ee: Status 404 returned error can't find the container with id 46c03848dbe59b01930426c4735ebd6ffd12894f0578404c65d6e0b41ad850ee Mar 16 16:23:55 crc kubenswrapper[5120]: I0316 16:23:55.459096 5120 generic.go:358] "Generic (PLEG): container finished" podID="f4359ac7-e3c2-48b7-8c4b-6eb5c3dd86fb" containerID="717f468f4ac72f91e07845ee1a1b0d6bdf6b44a49f25690122e66fee56b88e9c" exitCode=0 Mar 16 16:23:55 crc kubenswrapper[5120]: I0316 16:23:55.459259 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-pxmrv" event={"ID":"f4359ac7-e3c2-48b7-8c4b-6eb5c3dd86fb","Type":"ContainerDied","Data":"717f468f4ac72f91e07845ee1a1b0d6bdf6b44a49f25690122e66fee56b88e9c"} Mar 16 16:23:55 crc kubenswrapper[5120]: I0316 16:23:55.459332 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-pxmrv" event={"ID":"f4359ac7-e3c2-48b7-8c4b-6eb5c3dd86fb","Type":"ContainerStarted","Data":"46c03848dbe59b01930426c4735ebd6ffd12894f0578404c65d6e0b41ad850ee"} Mar 16 16:23:56 crc kubenswrapper[5120]: I0316 16:23:56.472504 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-pxmrv" event={"ID":"f4359ac7-e3c2-48b7-8c4b-6eb5c3dd86fb","Type":"ContainerStarted","Data":"4ff3a9a447f88b86af77a47f3cc109d3c8a13369821fe327dcb9b8415b41f21f"} Mar 16 16:23:57 crc kubenswrapper[5120]: I0316 16:23:57.749908 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:23:57 crc kubenswrapper[5120]: I0316 16:23:57.750316 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:23:58 crc kubenswrapper[5120]: I0316 16:23:58.504883 5120 generic.go:358] "Generic (PLEG): container finished" podID="f4359ac7-e3c2-48b7-8c4b-6eb5c3dd86fb" containerID="4ff3a9a447f88b86af77a47f3cc109d3c8a13369821fe327dcb9b8415b41f21f" exitCode=0 Mar 16 16:23:58 crc kubenswrapper[5120]: I0316 16:23:58.504965 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-pxmrv" event={"ID":"f4359ac7-e3c2-48b7-8c4b-6eb5c3dd86fb","Type":"ContainerDied","Data":"4ff3a9a447f88b86af77a47f3cc109d3c8a13369821fe327dcb9b8415b41f21f"} Mar 16 16:23:58 crc kubenswrapper[5120]: I0316 16:23:58.758938 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="11468616-1e2d-4cfd-b172-299b0cc33f6e" containerName="nova-api-api" probeResult="failure" output="Get \"https://10.217.1.144:8774/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Mar 16 16:23:58 crc kubenswrapper[5120]: I0316 16:23:58.765907 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="11468616-1e2d-4cfd-b172-299b0cc33f6e" containerName="nova-api-log" probeResult="failure" output="Get \"https://10.217.1.144:8774/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Mar 16 16:23:59 crc kubenswrapper[5120]: I0316 16:23:59.520645 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-pxmrv" event={"ID":"f4359ac7-e3c2-48b7-8c4b-6eb5c3dd86fb","Type":"ContainerStarted","Data":"1733d0949b299497bf816ace4fed06570c8004c66340df04f6e015881810fb9c"} Mar 16 16:23:59 crc kubenswrapper[5120]: I0316 16:23:59.551707 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/community-operators-pxmrv" podStartSLOduration=5.84797584 podStartE2EDuration="6.551690902s" podCreationTimestamp="2026-03-16 16:23:53 +0000 UTC" firstStartedPulling="2026-03-16 16:23:55.461164032 +0000 UTC m=+3137.615095729" lastFinishedPulling="2026-03-16 16:23:56.164879134 +0000 UTC m=+3138.318810791" observedRunningTime="2026-03-16 16:23:59.544922101 +0000 UTC m=+3141.698853758" watchObservedRunningTime="2026-03-16 16:23:59.551690902 +0000 UTC m=+3141.705622549" Mar 16 16:24:00 crc kubenswrapper[5120]: I0316 16:24:00.222044 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-infra/auto-csr-approver-29561304-tlv7d"] Mar 16 16:24:00 crc kubenswrapper[5120]: I0316 16:24:00.234884 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561304-tlv7d"] Mar 16 16:24:00 crc kubenswrapper[5120]: I0316 16:24:00.235020 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561304-tlv7d" Mar 16 16:24:00 crc kubenswrapper[5120]: I0316 16:24:00.240186 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"kube-root-ca.crt\"" Mar 16 16:24:00 crc kubenswrapper[5120]: I0316 16:24:00.240208 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"openshift-service-ca.crt\"" Mar 16 16:24:00 crc kubenswrapper[5120]: I0316 16:24:00.240641 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-infra\"/\"csr-approver-sa-dockercfg-x2nsz\"" Mar 16 16:24:00 crc kubenswrapper[5120]: I0316 16:24:00.281723 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9kqr\" (UniqueName: \"kubernetes.io/projected/9d5e5a11-7dc9-4ba8-ab1e-c63c16c54aac-kube-api-access-j9kqr\") pod \"auto-csr-approver-29561304-tlv7d\" (UID: \"9d5e5a11-7dc9-4ba8-ab1e-c63c16c54aac\") " pod="openshift-infra/auto-csr-approver-29561304-tlv7d" Mar 16 16:24:00 crc kubenswrapper[5120]: I0316 16:24:00.384611 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j9kqr\" (UniqueName: \"kubernetes.io/projected/9d5e5a11-7dc9-4ba8-ab1e-c63c16c54aac-kube-api-access-j9kqr\") pod \"auto-csr-approver-29561304-tlv7d\" (UID: \"9d5e5a11-7dc9-4ba8-ab1e-c63c16c54aac\") " pod="openshift-infra/auto-csr-approver-29561304-tlv7d" Mar 16 16:24:00 crc kubenswrapper[5120]: I0316 16:24:00.403717 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9kqr\" (UniqueName: \"kubernetes.io/projected/9d5e5a11-7dc9-4ba8-ab1e-c63c16c54aac-kube-api-access-j9kqr\") pod \"auto-csr-approver-29561304-tlv7d\" (UID: \"9d5e5a11-7dc9-4ba8-ab1e-c63c16c54aac\") " pod="openshift-infra/auto-csr-approver-29561304-tlv7d" Mar 16 16:24:00 crc kubenswrapper[5120]: I0316 16:24:00.566873 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561304-tlv7d" Mar 16 16:24:01 crc kubenswrapper[5120]: I0316 16:24:01.087166 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561304-tlv7d"] Mar 16 16:24:01 crc kubenswrapper[5120]: I0316 16:24:01.550561 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561304-tlv7d" event={"ID":"9d5e5a11-7dc9-4ba8-ab1e-c63c16c54aac","Type":"ContainerStarted","Data":"654fa8fd0116752adadaae48b5bc59fd981cda5edcfa33d0b9d3497894b24691"} Mar 16 16:24:02 crc kubenswrapper[5120]: I0316 16:24:02.563709 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561304-tlv7d" event={"ID":"9d5e5a11-7dc9-4ba8-ab1e-c63c16c54aac","Type":"ContainerStarted","Data":"04e36d71c6a6c65c6cf574a4e03bc47b26eeab3e3b231a1f90003eff30b30590"} Mar 16 16:24:02 crc kubenswrapper[5120]: I0316 16:24:02.583643 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-infra/auto-csr-approver-29561304-tlv7d" podStartSLOduration=1.6637106419999999 podStartE2EDuration="2.583620007s" podCreationTimestamp="2026-03-16 16:24:00 +0000 UTC" firstStartedPulling="2026-03-16 16:24:01.093725377 +0000 UTC m=+3143.247657034" lastFinishedPulling="2026-03-16 16:24:02.013634742 +0000 UTC m=+3144.167566399" observedRunningTime="2026-03-16 16:24:02.57586938 +0000 UTC m=+3144.729801037" watchObservedRunningTime="2026-03-16 16:24:02.583620007 +0000 UTC m=+3144.737551654" Mar 16 16:24:03 crc kubenswrapper[5120]: I0316 16:24:03.576258 5120 generic.go:358] "Generic (PLEG): container finished" podID="9d5e5a11-7dc9-4ba8-ab1e-c63c16c54aac" containerID="04e36d71c6a6c65c6cf574a4e03bc47b26eeab3e3b231a1f90003eff30b30590" exitCode=0 Mar 16 16:24:03 crc kubenswrapper[5120]: I0316 16:24:03.576441 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561304-tlv7d" event={"ID":"9d5e5a11-7dc9-4ba8-ab1e-c63c16c54aac","Type":"ContainerDied","Data":"04e36d71c6a6c65c6cf574a4e03bc47b26eeab3e3b231a1f90003eff30b30590"} Mar 16 16:24:04 crc kubenswrapper[5120]: I0316 16:24:04.298805 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/community-operators-pxmrv" Mar 16 16:24:04 crc kubenswrapper[5120]: I0316 16:24:04.299156 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-marketplace/community-operators-pxmrv" Mar 16 16:24:04 crc kubenswrapper[5120]: I0316 16:24:04.991339 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561304-tlv7d" Mar 16 16:24:05 crc kubenswrapper[5120]: I0316 16:24:05.095892 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j9kqr\" (UniqueName: \"kubernetes.io/projected/9d5e5a11-7dc9-4ba8-ab1e-c63c16c54aac-kube-api-access-j9kqr\") pod \"9d5e5a11-7dc9-4ba8-ab1e-c63c16c54aac\" (UID: \"9d5e5a11-7dc9-4ba8-ab1e-c63c16c54aac\") " Mar 16 16:24:05 crc kubenswrapper[5120]: I0316 16:24:05.104297 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d5e5a11-7dc9-4ba8-ab1e-c63c16c54aac-kube-api-access-j9kqr" (OuterVolumeSpecName: "kube-api-access-j9kqr") pod "9d5e5a11-7dc9-4ba8-ab1e-c63c16c54aac" (UID: "9d5e5a11-7dc9-4ba8-ab1e-c63c16c54aac"). InnerVolumeSpecName "kube-api-access-j9kqr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:24:05 crc kubenswrapper[5120]: I0316 16:24:05.199524 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j9kqr\" (UniqueName: \"kubernetes.io/projected/9d5e5a11-7dc9-4ba8-ab1e-c63c16c54aac-kube-api-access-j9kqr\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:05 crc kubenswrapper[5120]: I0316 16:24:05.340580 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-marketplace/community-operators-pxmrv" podUID="f4359ac7-e3c2-48b7-8c4b-6eb5c3dd86fb" containerName="registry-server" probeResult="failure" output=< Mar 16 16:24:05 crc kubenswrapper[5120]: timeout: failed to connect service ":50051" within 1s Mar 16 16:24:05 crc kubenswrapper[5120]: > Mar 16 16:24:05 crc kubenswrapper[5120]: I0316 16:24:05.604165 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561304-tlv7d" Mar 16 16:24:05 crc kubenswrapper[5120]: I0316 16:24:05.604156 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561304-tlv7d" event={"ID":"9d5e5a11-7dc9-4ba8-ab1e-c63c16c54aac","Type":"ContainerDied","Data":"654fa8fd0116752adadaae48b5bc59fd981cda5edcfa33d0b9d3497894b24691"} Mar 16 16:24:05 crc kubenswrapper[5120]: I0316 16:24:05.604313 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="654fa8fd0116752adadaae48b5bc59fd981cda5edcfa33d0b9d3497894b24691" Mar 16 16:24:05 crc kubenswrapper[5120]: I0316 16:24:05.663621 5120 scope.go:117] "RemoveContainer" containerID="f40e444f89abd558ac90555bfd58e04a1c4379a653ba8035c228d2b7a5443eb5" Mar 16 16:24:05 crc kubenswrapper[5120]: E0316 16:24:05.664048 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:24:05 crc kubenswrapper[5120]: I0316 16:24:05.667409 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-infra/auto-csr-approver-29561298-6qsf7"] Mar 16 16:24:05 crc kubenswrapper[5120]: I0316 16:24:05.679217 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-infra/auto-csr-approver-29561298-6qsf7"] Mar 16 16:24:05 crc kubenswrapper[5120]: I0316 16:24:05.749412 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:24:05 crc kubenswrapper[5120]: I0316 16:24:05.749601 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:24:06 crc kubenswrapper[5120]: I0316 16:24:06.683173 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e4cb4b19-5e1d-4cb5-8cc1-e51c0b445e06" path="/var/lib/kubelet/pods/e4cb4b19-5e1d-4cb5-8cc1-e51c0b445e06/volumes" Mar 16 16:24:07 crc kubenswrapper[5120]: I0316 16:24:07.759157 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:24:07 crc kubenswrapper[5120]: I0316 16:24:07.761028 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:24:07 crc kubenswrapper[5120]: I0316 16:24:07.767516 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:24:08 crc kubenswrapper[5120]: E0316 16:24:08.136849 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1914069 actualBytes=10240 Mar 16 16:24:08 crc kubenswrapper[5120]: I0316 16:24:08.653860 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:24:14 crc kubenswrapper[5120]: I0316 16:24:14.348555 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/community-operators-pxmrv" Mar 16 16:24:14 crc kubenswrapper[5120]: I0316 16:24:14.417490 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/community-operators-pxmrv" Mar 16 16:24:14 crc kubenswrapper[5120]: I0316 16:24:14.593129 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/community-operators-pxmrv"] Mar 16 16:24:15 crc kubenswrapper[5120]: I0316 16:24:15.331545 5120 scope.go:117] "RemoveContainer" containerID="c3ba1ed8eb10460a93be03783efe6bcaa9ba71fd9db113c6c8336ec51849bf98" Mar 16 16:24:15 crc kubenswrapper[5120]: I0316 16:24:15.369547 5120 scope.go:117] "RemoveContainer" containerID="96bf948107e35afd61b46aed0827c2cfb513aa41ab259f6ad44d2f616e83f0d0" Mar 16 16:24:15 crc kubenswrapper[5120]: I0316 16:24:15.479652 5120 scope.go:117] "RemoveContainer" containerID="f2f6fc6bbc971ff74b7f77b818ffb55651bc4f80cf17ada608e016787d48db64" Mar 16 16:24:15 crc kubenswrapper[5120]: I0316 16:24:15.732425 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-marketplace/community-operators-pxmrv" podUID="f4359ac7-e3c2-48b7-8c4b-6eb5c3dd86fb" containerName="registry-server" containerID="cri-o://1733d0949b299497bf816ace4fed06570c8004c66340df04f6e015881810fb9c" gracePeriod=2 Mar 16 16:24:16 crc kubenswrapper[5120]: I0316 16:24:16.238978 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-pxmrv" Mar 16 16:24:16 crc kubenswrapper[5120]: I0316 16:24:16.314900 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/f4359ac7-e3c2-48b7-8c4b-6eb5c3dd86fb-utilities\") pod \"f4359ac7-e3c2-48b7-8c4b-6eb5c3dd86fb\" (UID: \"f4359ac7-e3c2-48b7-8c4b-6eb5c3dd86fb\") " Mar 16 16:24:16 crc kubenswrapper[5120]: I0316 16:24:16.315480 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/f4359ac7-e3c2-48b7-8c4b-6eb5c3dd86fb-catalog-content\") pod \"f4359ac7-e3c2-48b7-8c4b-6eb5c3dd86fb\" (UID: \"f4359ac7-e3c2-48b7-8c4b-6eb5c3dd86fb\") " Mar 16 16:24:16 crc kubenswrapper[5120]: I0316 16:24:16.315613 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s8v7j\" (UniqueName: \"kubernetes.io/projected/f4359ac7-e3c2-48b7-8c4b-6eb5c3dd86fb-kube-api-access-s8v7j\") pod \"f4359ac7-e3c2-48b7-8c4b-6eb5c3dd86fb\" (UID: \"f4359ac7-e3c2-48b7-8c4b-6eb5c3dd86fb\") " Mar 16 16:24:16 crc kubenswrapper[5120]: I0316 16:24:16.315806 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4359ac7-e3c2-48b7-8c4b-6eb5c3dd86fb-utilities" (OuterVolumeSpecName: "utilities") pod "f4359ac7-e3c2-48b7-8c4b-6eb5c3dd86fb" (UID: "f4359ac7-e3c2-48b7-8c4b-6eb5c3dd86fb"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:24:16 crc kubenswrapper[5120]: I0316 16:24:16.316257 5120 reconciler_common.go:299] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/f4359ac7-e3c2-48b7-8c4b-6eb5c3dd86fb-utilities\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:16 crc kubenswrapper[5120]: I0316 16:24:16.321677 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4359ac7-e3c2-48b7-8c4b-6eb5c3dd86fb-kube-api-access-s8v7j" (OuterVolumeSpecName: "kube-api-access-s8v7j") pod "f4359ac7-e3c2-48b7-8c4b-6eb5c3dd86fb" (UID: "f4359ac7-e3c2-48b7-8c4b-6eb5c3dd86fb"). InnerVolumeSpecName "kube-api-access-s8v7j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:24:16 crc kubenswrapper[5120]: I0316 16:24:16.370426 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4359ac7-e3c2-48b7-8c4b-6eb5c3dd86fb-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "f4359ac7-e3c2-48b7-8c4b-6eb5c3dd86fb" (UID: "f4359ac7-e3c2-48b7-8c4b-6eb5c3dd86fb"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:24:16 crc kubenswrapper[5120]: I0316 16:24:16.418463 5120 reconciler_common.go:299] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/f4359ac7-e3c2-48b7-8c4b-6eb5c3dd86fb-catalog-content\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:16 crc kubenswrapper[5120]: I0316 16:24:16.418733 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s8v7j\" (UniqueName: \"kubernetes.io/projected/f4359ac7-e3c2-48b7-8c4b-6eb5c3dd86fb-kube-api-access-s8v7j\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:16 crc kubenswrapper[5120]: I0316 16:24:16.746171 5120 generic.go:358] "Generic (PLEG): container finished" podID="f4359ac7-e3c2-48b7-8c4b-6eb5c3dd86fb" containerID="1733d0949b299497bf816ace4fed06570c8004c66340df04f6e015881810fb9c" exitCode=0 Mar 16 16:24:16 crc kubenswrapper[5120]: I0316 16:24:16.746467 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-pxmrv" Mar 16 16:24:16 crc kubenswrapper[5120]: I0316 16:24:16.746343 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-pxmrv" event={"ID":"f4359ac7-e3c2-48b7-8c4b-6eb5c3dd86fb","Type":"ContainerDied","Data":"1733d0949b299497bf816ace4fed06570c8004c66340df04f6e015881810fb9c"} Mar 16 16:24:16 crc kubenswrapper[5120]: I0316 16:24:16.746661 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-pxmrv" event={"ID":"f4359ac7-e3c2-48b7-8c4b-6eb5c3dd86fb","Type":"ContainerDied","Data":"46c03848dbe59b01930426c4735ebd6ffd12894f0578404c65d6e0b41ad850ee"} Mar 16 16:24:16 crc kubenswrapper[5120]: I0316 16:24:16.746722 5120 scope.go:117] "RemoveContainer" containerID="1733d0949b299497bf816ace4fed06570c8004c66340df04f6e015881810fb9c" Mar 16 16:24:16 crc kubenswrapper[5120]: I0316 16:24:16.783581 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/community-operators-pxmrv"] Mar 16 16:24:16 crc kubenswrapper[5120]: I0316 16:24:16.792939 5120 scope.go:117] "RemoveContainer" containerID="4ff3a9a447f88b86af77a47f3cc109d3c8a13369821fe327dcb9b8415b41f21f" Mar 16 16:24:16 crc kubenswrapper[5120]: I0316 16:24:16.796087 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/community-operators-pxmrv"] Mar 16 16:24:16 crc kubenswrapper[5120]: I0316 16:24:16.823414 5120 scope.go:117] "RemoveContainer" containerID="717f468f4ac72f91e07845ee1a1b0d6bdf6b44a49f25690122e66fee56b88e9c" Mar 16 16:24:16 crc kubenswrapper[5120]: I0316 16:24:16.880707 5120 scope.go:117] "RemoveContainer" containerID="1733d0949b299497bf816ace4fed06570c8004c66340df04f6e015881810fb9c" Mar 16 16:24:16 crc kubenswrapper[5120]: E0316 16:24:16.881304 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1733d0949b299497bf816ace4fed06570c8004c66340df04f6e015881810fb9c\": container with ID starting with 1733d0949b299497bf816ace4fed06570c8004c66340df04f6e015881810fb9c not found: ID does not exist" containerID="1733d0949b299497bf816ace4fed06570c8004c66340df04f6e015881810fb9c" Mar 16 16:24:16 crc kubenswrapper[5120]: I0316 16:24:16.881345 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1733d0949b299497bf816ace4fed06570c8004c66340df04f6e015881810fb9c"} err="failed to get container status \"1733d0949b299497bf816ace4fed06570c8004c66340df04f6e015881810fb9c\": rpc error: code = NotFound desc = could not find container \"1733d0949b299497bf816ace4fed06570c8004c66340df04f6e015881810fb9c\": container with ID starting with 1733d0949b299497bf816ace4fed06570c8004c66340df04f6e015881810fb9c not found: ID does not exist" Mar 16 16:24:16 crc kubenswrapper[5120]: I0316 16:24:16.881370 5120 scope.go:117] "RemoveContainer" containerID="4ff3a9a447f88b86af77a47f3cc109d3c8a13369821fe327dcb9b8415b41f21f" Mar 16 16:24:16 crc kubenswrapper[5120]: E0316 16:24:16.881738 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ff3a9a447f88b86af77a47f3cc109d3c8a13369821fe327dcb9b8415b41f21f\": container with ID starting with 4ff3a9a447f88b86af77a47f3cc109d3c8a13369821fe327dcb9b8415b41f21f not found: ID does not exist" containerID="4ff3a9a447f88b86af77a47f3cc109d3c8a13369821fe327dcb9b8415b41f21f" Mar 16 16:24:16 crc kubenswrapper[5120]: I0316 16:24:16.881809 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ff3a9a447f88b86af77a47f3cc109d3c8a13369821fe327dcb9b8415b41f21f"} err="failed to get container status \"4ff3a9a447f88b86af77a47f3cc109d3c8a13369821fe327dcb9b8415b41f21f\": rpc error: code = NotFound desc = could not find container \"4ff3a9a447f88b86af77a47f3cc109d3c8a13369821fe327dcb9b8415b41f21f\": container with ID starting with 4ff3a9a447f88b86af77a47f3cc109d3c8a13369821fe327dcb9b8415b41f21f not found: ID does not exist" Mar 16 16:24:16 crc kubenswrapper[5120]: I0316 16:24:16.881912 5120 scope.go:117] "RemoveContainer" containerID="717f468f4ac72f91e07845ee1a1b0d6bdf6b44a49f25690122e66fee56b88e9c" Mar 16 16:24:16 crc kubenswrapper[5120]: E0316 16:24:16.882331 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"717f468f4ac72f91e07845ee1a1b0d6bdf6b44a49f25690122e66fee56b88e9c\": container with ID starting with 717f468f4ac72f91e07845ee1a1b0d6bdf6b44a49f25690122e66fee56b88e9c not found: ID does not exist" containerID="717f468f4ac72f91e07845ee1a1b0d6bdf6b44a49f25690122e66fee56b88e9c" Mar 16 16:24:16 crc kubenswrapper[5120]: I0316 16:24:16.882358 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"717f468f4ac72f91e07845ee1a1b0d6bdf6b44a49f25690122e66fee56b88e9c"} err="failed to get container status \"717f468f4ac72f91e07845ee1a1b0d6bdf6b44a49f25690122e66fee56b88e9c\": rpc error: code = NotFound desc = could not find container \"717f468f4ac72f91e07845ee1a1b0d6bdf6b44a49f25690122e66fee56b88e9c\": container with ID starting with 717f468f4ac72f91e07845ee1a1b0d6bdf6b44a49f25690122e66fee56b88e9c not found: ID does not exist" Mar 16 16:24:18 crc kubenswrapper[5120]: I0316 16:24:18.677863 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f4359ac7-e3c2-48b7-8c4b-6eb5c3dd86fb" path="/var/lib/kubelet/pods/f4359ac7-e3c2-48b7-8c4b-6eb5c3dd86fb/volumes" Mar 16 16:24:20 crc kubenswrapper[5120]: I0316 16:24:20.665602 5120 scope.go:117] "RemoveContainer" containerID="f40e444f89abd558ac90555bfd58e04a1c4379a653ba8035c228d2b7a5443eb5" Mar 16 16:24:20 crc kubenswrapper[5120]: E0316 16:24:20.666837 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:24:21 crc kubenswrapper[5120]: I0316 16:24:21.416447 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:24:25 crc kubenswrapper[5120]: I0316 16:24:25.012520 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 16:24:25 crc kubenswrapper[5120]: I0316 16:24:25.013298 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/openstackclient" podUID="4c4d0f9a-4660-44c7-aa3c-4653612142bb" containerName="openstackclient" containerID="cri-o://96164b8ea75d052b461cddb068f1640ceb2bc89fadd9423f78383162a3347b9f" gracePeriod=2 Mar 16 16:24:25 crc kubenswrapper[5120]: I0316 16:24:25.033942 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 16:24:25 crc kubenswrapper[5120]: I0316 16:24:25.055310 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-3f68-account-create-update-6x45z"] Mar 16 16:24:25 crc kubenswrapper[5120]: I0316 16:24:25.073709 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-3f68-account-create-update-6x45z"] Mar 16 16:24:25 crc kubenswrapper[5120]: I0316 16:24:25.105517 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-a8ac-account-create-update-98gk4"] Mar 16 16:24:25 crc kubenswrapper[5120]: I0316 16:24:25.143467 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-a8ac-account-create-update-98gk4"] Mar 16 16:24:25 crc kubenswrapper[5120]: I0316 16:24:25.159557 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 16:24:25 crc kubenswrapper[5120]: I0316 16:24:25.386599 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-a8ac-account-create-update-lqmbd"] Mar 16 16:24:25 crc kubenswrapper[5120]: I0316 16:24:25.387924 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4359ac7-e3c2-48b7-8c4b-6eb5c3dd86fb" containerName="extract-utilities" Mar 16 16:24:25 crc kubenswrapper[5120]: I0316 16:24:25.388091 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4359ac7-e3c2-48b7-8c4b-6eb5c3dd86fb" containerName="extract-utilities" Mar 16 16:24:25 crc kubenswrapper[5120]: I0316 16:24:25.388125 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4359ac7-e3c2-48b7-8c4b-6eb5c3dd86fb" containerName="extract-content" Mar 16 16:24:25 crc kubenswrapper[5120]: I0316 16:24:25.388133 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4359ac7-e3c2-48b7-8c4b-6eb5c3dd86fb" containerName="extract-content" Mar 16 16:24:25 crc kubenswrapper[5120]: I0316 16:24:25.388162 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c4d0f9a-4660-44c7-aa3c-4653612142bb" containerName="openstackclient" Mar 16 16:24:25 crc kubenswrapper[5120]: I0316 16:24:25.388168 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c4d0f9a-4660-44c7-aa3c-4653612142bb" containerName="openstackclient" Mar 16 16:24:25 crc kubenswrapper[5120]: I0316 16:24:25.388192 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d5e5a11-7dc9-4ba8-ab1e-c63c16c54aac" containerName="oc" Mar 16 16:24:25 crc kubenswrapper[5120]: I0316 16:24:25.388197 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d5e5a11-7dc9-4ba8-ab1e-c63c16c54aac" containerName="oc" Mar 16 16:24:25 crc kubenswrapper[5120]: I0316 16:24:25.388209 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4359ac7-e3c2-48b7-8c4b-6eb5c3dd86fb" containerName="registry-server" Mar 16 16:24:25 crc kubenswrapper[5120]: I0316 16:24:25.388214 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4359ac7-e3c2-48b7-8c4b-6eb5c3dd86fb" containerName="registry-server" Mar 16 16:24:25 crc kubenswrapper[5120]: I0316 16:24:25.388410 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="9d5e5a11-7dc9-4ba8-ab1e-c63c16c54aac" containerName="oc" Mar 16 16:24:25 crc kubenswrapper[5120]: I0316 16:24:25.388424 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f4359ac7-e3c2-48b7-8c4b-6eb5c3dd86fb" containerName="registry-server" Mar 16 16:24:25 crc kubenswrapper[5120]: I0316 16:24:25.388439 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="4c4d0f9a-4660-44c7-aa3c-4653612142bb" containerName="openstackclient" Mar 16 16:24:25 crc kubenswrapper[5120]: I0316 16:24:25.415903 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-d2k76"] Mar 16 16:24:25 crc kubenswrapper[5120]: I0316 16:24:25.416055 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-a8ac-account-create-update-lqmbd" Mar 16 16:24:25 crc kubenswrapper[5120]: I0316 16:24:25.423589 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-db-secret\"" Mar 16 16:24:25 crc kubenswrapper[5120]: I0316 16:24:25.424815 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-d2k76"] Mar 16 16:24:25 crc kubenswrapper[5120]: I0316 16:24:25.446220 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-a8ac-account-create-update-lqmbd"] Mar 16 16:24:25 crc kubenswrapper[5120]: I0316 16:24:25.463346 5120 status_manager.go:895] "Failed to get status for pod" podUID="4c4d0f9a-4660-44c7-aa3c-4653612142bb" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 16:24:25 crc kubenswrapper[5120]: I0316 16:24:25.558904 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-da68-account-create-update-58v6p"] Mar 16 16:24:25 crc kubenswrapper[5120]: I0316 16:24:25.567558 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-da68-account-create-update-58v6p"] Mar 16 16:24:25 crc kubenswrapper[5120]: I0316 16:24:25.574221 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7cnw\" (UniqueName: \"kubernetes.io/projected/cf8c7b4f-8110-4b63-9022-2f9dcf3c1270-kube-api-access-r7cnw\") pod \"barbican-a8ac-account-create-update-lqmbd\" (UID: \"cf8c7b4f-8110-4b63-9022-2f9dcf3c1270\") " pod="openstack-kuttl-tests/barbican-a8ac-account-create-update-lqmbd" Mar 16 16:24:25 crc kubenswrapper[5120]: I0316 16:24:25.574372 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/cf8c7b4f-8110-4b63-9022-2f9dcf3c1270-operator-scripts\") pod \"barbican-a8ac-account-create-update-lqmbd\" (UID: \"cf8c7b4f-8110-4b63-9022-2f9dcf3c1270\") " pod="openstack-kuttl-tests/barbican-a8ac-account-create-update-lqmbd" Mar 16 16:24:25 crc kubenswrapper[5120]: I0316 16:24:25.575852 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 16:24:25 crc kubenswrapper[5120]: I0316 16:24:25.576556 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podUID="7ae11e5d-88eb-4be1-8936-985a2daadef0" containerName="openstack-network-exporter" containerID="cri-o://43b1e480c270d5982eb7544840036b7b1e664f5b3eda16d1c57593f55fd4e913" gracePeriod=300 Mar 16 16:24:25 crc kubenswrapper[5120]: I0316 16:24:25.586045 5120 status_manager.go:895] "Failed to get status for pod" podUID="4c4d0f9a-4660-44c7-aa3c-4653612142bb" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 16:24:25 crc kubenswrapper[5120]: I0316 16:24:25.604525 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-qkk4c"] Mar 16 16:24:25 crc kubenswrapper[5120]: I0316 16:24:25.626848 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-c949-account-create-update-8vkk4"] Mar 16 16:24:25 crc kubenswrapper[5120]: I0316 16:24:25.642030 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-qkk4c"] Mar 16 16:24:25 crc kubenswrapper[5120]: I0316 16:24:25.675641 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-c949-account-create-update-8vkk4"] Mar 16 16:24:25 crc kubenswrapper[5120]: I0316 16:24:25.676358 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r7cnw\" (UniqueName: \"kubernetes.io/projected/cf8c7b4f-8110-4b63-9022-2f9dcf3c1270-kube-api-access-r7cnw\") pod \"barbican-a8ac-account-create-update-lqmbd\" (UID: \"cf8c7b4f-8110-4b63-9022-2f9dcf3c1270\") " pod="openstack-kuttl-tests/barbican-a8ac-account-create-update-lqmbd" Mar 16 16:24:25 crc kubenswrapper[5120]: I0316 16:24:25.676573 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/cf8c7b4f-8110-4b63-9022-2f9dcf3c1270-operator-scripts\") pod \"barbican-a8ac-account-create-update-lqmbd\" (UID: \"cf8c7b4f-8110-4b63-9022-2f9dcf3c1270\") " pod="openstack-kuttl-tests/barbican-a8ac-account-create-update-lqmbd" Mar 16 16:24:25 crc kubenswrapper[5120]: I0316 16:24:25.677335 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/cf8c7b4f-8110-4b63-9022-2f9dcf3c1270-operator-scripts\") pod \"barbican-a8ac-account-create-update-lqmbd\" (UID: \"cf8c7b4f-8110-4b63-9022-2f9dcf3c1270\") " pod="openstack-kuttl-tests/barbican-a8ac-account-create-update-lqmbd" Mar 16 16:24:25 crc kubenswrapper[5120]: I0316 16:24:25.691866 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/root-account-create-update-rvrb7"] Mar 16 16:24:25 crc kubenswrapper[5120]: I0316 16:24:25.719917 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7cnw\" (UniqueName: \"kubernetes.io/projected/cf8c7b4f-8110-4b63-9022-2f9dcf3c1270-kube-api-access-r7cnw\") pod \"barbican-a8ac-account-create-update-lqmbd\" (UID: \"cf8c7b4f-8110-4b63-9022-2f9dcf3c1270\") " pod="openstack-kuttl-tests/barbican-a8ac-account-create-update-lqmbd" Mar 16 16:24:25 crc kubenswrapper[5120]: I0316 16:24:25.719976 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podUID="7ae11e5d-88eb-4be1-8936-985a2daadef0" containerName="ovsdbserver-sb" containerID="cri-o://30fb3aa88577d49531b8a5e3ae2d20fd54120a0e99aa07ccc38055fa65373f91" gracePeriod=300 Mar 16 16:24:25 crc kubenswrapper[5120]: I0316 16:24:25.731108 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-rvrb7"] Mar 16 16:24:25 crc kubenswrapper[5120]: I0316 16:24:25.731250 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-rvrb7" Mar 16 16:24:25 crc kubenswrapper[5120]: I0316 16:24:25.738290 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-a8ac-account-create-update-lqmbd" Mar 16 16:24:25 crc kubenswrapper[5120]: I0316 16:24:25.743711 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 16:24:25 crc kubenswrapper[5120]: I0316 16:24:25.743956 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovn-northd-0" podUID="794d950a-8664-4970-963a-2773749103e0" containerName="ovn-northd" containerID="cri-o://0419588781daf97a47d3362db1f9a8d1a88d231d99c1a6cb08730e97206c4fed" gracePeriod=30 Mar 16 16:24:25 crc kubenswrapper[5120]: I0316 16:24:25.744112 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovn-northd-0" podUID="794d950a-8664-4970-963a-2773749103e0" containerName="openstack-network-exporter" containerID="cri-o://28a01c5edf4ff6aef66071041d049bd9bd12e77fbd906ddfb625be33100a15b5" gracePeriod=30 Mar 16 16:24:25 crc kubenswrapper[5120]: I0316 16:24:25.749415 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"openstack-mariadb-root-db-secret\"" Mar 16 16:24:25 crc kubenswrapper[5120]: I0316 16:24:25.776121 5120 status_manager.go:895] "Failed to get status for pod" podUID="4c4d0f9a-4660-44c7-aa3c-4653612142bb" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 16:24:25 crc kubenswrapper[5120]: E0316 16:24:25.780121 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/barbican-config-data: secret "barbican-config-data" not found Mar 16 16:24:25 crc kubenswrapper[5120]: E0316 16:24:25.780361 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-barbican-internal-svc: secret "cert-barbican-internal-svc" not found Mar 16 16:24:25 crc kubenswrapper[5120]: E0316 16:24:25.780372 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69c47154-7063-4a88-af54-c4dba11e7fd6-config-data podName:69c47154-7063-4a88-af54-c4dba11e7fd6 nodeName:}" failed. No retries permitted until 2026-03-16 16:24:26.280345498 +0000 UTC m=+3168.434277155 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/secret/69c47154-7063-4a88-af54-c4dba11e7fd6-config-data") pod "barbican-api-85c89c7f6-6429v" (UID: "69c47154-7063-4a88-af54-c4dba11e7fd6") : secret "barbican-config-data" not found Mar 16 16:24:25 crc kubenswrapper[5120]: E0316 16:24:25.780419 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 16:24:25 crc kubenswrapper[5120]: E0316 16:24:25.780438 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69c47154-7063-4a88-af54-c4dba11e7fd6-internal-tls-certs podName:69c47154-7063-4a88-af54-c4dba11e7fd6 nodeName:}" failed. No retries permitted until 2026-03-16 16:24:26.28041446 +0000 UTC m=+3168.434346117 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/69c47154-7063-4a88-af54-c4dba11e7fd6-internal-tls-certs") pod "barbican-api-85c89c7f6-6429v" (UID: "69c47154-7063-4a88-af54-c4dba11e7fd6") : secret "cert-barbican-internal-svc" not found Mar 16 16:24:25 crc kubenswrapper[5120]: E0316 16:24:25.780463 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69c47154-7063-4a88-af54-c4dba11e7fd6-combined-ca-bundle podName:69c47154-7063-4a88-af54-c4dba11e7fd6 nodeName:}" failed. No retries permitted until 2026-03-16 16:24:26.280456641 +0000 UTC m=+3168.434388298 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/69c47154-7063-4a88-af54-c4dba11e7fd6-combined-ca-bundle") pod "barbican-api-85c89c7f6-6429v" (UID: "69c47154-7063-4a88-af54-c4dba11e7fd6") : secret "combined-ca-bundle" not found Mar 16 16:24:25 crc kubenswrapper[5120]: E0316 16:24:25.781044 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-barbican-public-svc: secret "cert-barbican-public-svc" not found Mar 16 16:24:25 crc kubenswrapper[5120]: E0316 16:24:25.781083 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69c47154-7063-4a88-af54-c4dba11e7fd6-public-tls-certs podName:69c47154-7063-4a88-af54-c4dba11e7fd6 nodeName:}" failed. No retries permitted until 2026-03-16 16:24:26.281075677 +0000 UTC m=+3168.435007324 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/69c47154-7063-4a88-af54-c4dba11e7fd6-public-tls-certs") pod "barbican-api-85c89c7f6-6429v" (UID: "69c47154-7063-4a88-af54-c4dba11e7fd6") : secret "cert-barbican-public-svc" not found Mar 16 16:24:25 crc kubenswrapper[5120]: I0316 16:24:25.785179 5120 status_manager.go:895] "Failed to get status for pod" podUID="4c4d0f9a-4660-44c7-aa3c-4653612142bb" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 16:24:25 crc kubenswrapper[5120]: I0316 16:24:25.882289 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bt84v\" (UniqueName: \"kubernetes.io/projected/86686d29-4c19-43e3-97a8-d8373883dc6a-kube-api-access-bt84v\") pod \"root-account-create-update-rvrb7\" (UID: \"86686d29-4c19-43e3-97a8-d8373883dc6a\") " pod="openstack-kuttl-tests/root-account-create-update-rvrb7" Mar 16 16:24:25 crc kubenswrapper[5120]: I0316 16:24:25.883558 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/86686d29-4c19-43e3-97a8-d8373883dc6a-operator-scripts\") pod \"root-account-create-update-rvrb7\" (UID: \"86686d29-4c19-43e3-97a8-d8373883dc6a\") " pod="openstack-kuttl-tests/root-account-create-update-rvrb7" Mar 16 16:24:25 crc kubenswrapper[5120]: I0316 16:24:25.884469 5120 generic.go:358] "Generic (PLEG): container finished" podID="7ae11e5d-88eb-4be1-8936-985a2daadef0" containerID="43b1e480c270d5982eb7544840036b7b1e664f5b3eda16d1c57593f55fd4e913" exitCode=2 Mar 16 16:24:25 crc kubenswrapper[5120]: I0316 16:24:25.884539 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"7ae11e5d-88eb-4be1-8936-985a2daadef0","Type":"ContainerDied","Data":"43b1e480c270d5982eb7544840036b7b1e664f5b3eda16d1c57593f55fd4e913"} Mar 16 16:24:26 crc kubenswrapper[5120]: I0316 16:24:25.995190 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/86686d29-4c19-43e3-97a8-d8373883dc6a-operator-scripts\") pod \"root-account-create-update-rvrb7\" (UID: \"86686d29-4c19-43e3-97a8-d8373883dc6a\") " pod="openstack-kuttl-tests/root-account-create-update-rvrb7" Mar 16 16:24:26 crc kubenswrapper[5120]: I0316 16:24:25.995399 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bt84v\" (UniqueName: \"kubernetes.io/projected/86686d29-4c19-43e3-97a8-d8373883dc6a-kube-api-access-bt84v\") pod \"root-account-create-update-rvrb7\" (UID: \"86686d29-4c19-43e3-97a8-d8373883dc6a\") " pod="openstack-kuttl-tests/root-account-create-update-rvrb7" Mar 16 16:24:26 crc kubenswrapper[5120]: I0316 16:24:25.996439 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/86686d29-4c19-43e3-97a8-d8373883dc6a-operator-scripts\") pod \"root-account-create-update-rvrb7\" (UID: \"86686d29-4c19-43e3-97a8-d8373883dc6a\") " pod="openstack-kuttl-tests/root-account-create-update-rvrb7" Mar 16 16:24:26 crc kubenswrapper[5120]: I0316 16:24:26.029881 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/watcher-7aff-account-create-update-qzj6x"] Mar 16 16:24:26 crc kubenswrapper[5120]: I0316 16:24:26.048214 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-1b1e-account-create-update-xsrqk"] Mar 16 16:24:26 crc kubenswrapper[5120]: I0316 16:24:26.068883 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bt84v\" (UniqueName: \"kubernetes.io/projected/86686d29-4c19-43e3-97a8-d8373883dc6a-kube-api-access-bt84v\") pod \"root-account-create-update-rvrb7\" (UID: \"86686d29-4c19-43e3-97a8-d8373883dc6a\") " pod="openstack-kuttl-tests/root-account-create-update-rvrb7" Mar 16 16:24:26 crc kubenswrapper[5120]: I0316 16:24:26.087687 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/watcher-7aff-account-create-update-qzj6x"] Mar 16 16:24:26 crc kubenswrapper[5120]: I0316 16:24:26.125190 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-rvrb7" Mar 16 16:24:26 crc kubenswrapper[5120]: I0316 16:24:26.133424 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 16:24:26 crc kubenswrapper[5120]: I0316 16:24:26.134139 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podUID="47f6dea8-ee86-4de1-8bf7-3bbb7b5b4be1" containerName="openstack-network-exporter" containerID="cri-o://f9993e08b1a1c6e83a003533f2dc36cc32a4e662efefb4ae622f4ee6f0fd404e" gracePeriod=300 Mar 16 16:24:26 crc kubenswrapper[5120]: I0316 16:24:26.152083 5120 status_manager.go:895] "Failed to get status for pod" podUID="4c4d0f9a-4660-44c7-aa3c-4653612142bb" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 16:24:26 crc kubenswrapper[5120]: I0316 16:24:26.176277 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-1b1e-account-create-update-xsrqk"] Mar 16 16:24:26 crc kubenswrapper[5120]: I0316 16:24:26.184051 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-nwmkm"] Mar 16 16:24:26 crc kubenswrapper[5120]: I0316 16:24:26.214739 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-nwmkm"] Mar 16 16:24:26 crc kubenswrapper[5120]: I0316 16:24:26.229932 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podUID="47f6dea8-ee86-4de1-8bf7-3bbb7b5b4be1" containerName="ovsdbserver-nb" containerID="cri-o://c4e58989b0e4c03f55cfdda8d9b7d8a1793435113a8b45dcd1505218a190c874" gracePeriod=300 Mar 16 16:24:26 crc kubenswrapper[5120]: I0316 16:24:26.267254 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-2841-account-create-update-j4bbs"] Mar 16 16:24:26 crc kubenswrapper[5120]: E0316 16:24:26.310920 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-barbican-public-svc: secret "cert-barbican-public-svc" not found Mar 16 16:24:26 crc kubenswrapper[5120]: E0316 16:24:26.311001 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69c47154-7063-4a88-af54-c4dba11e7fd6-public-tls-certs podName:69c47154-7063-4a88-af54-c4dba11e7fd6 nodeName:}" failed. No retries permitted until 2026-03-16 16:24:27.310980801 +0000 UTC m=+3169.464912458 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/69c47154-7063-4a88-af54-c4dba11e7fd6-public-tls-certs") pod "barbican-api-85c89c7f6-6429v" (UID: "69c47154-7063-4a88-af54-c4dba11e7fd6") : secret "cert-barbican-public-svc" not found Mar 16 16:24:26 crc kubenswrapper[5120]: E0316 16:24:26.311073 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 16:24:26 crc kubenswrapper[5120]: E0316 16:24:26.311157 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69c47154-7063-4a88-af54-c4dba11e7fd6-combined-ca-bundle podName:69c47154-7063-4a88-af54-c4dba11e7fd6 nodeName:}" failed. No retries permitted until 2026-03-16 16:24:27.311140485 +0000 UTC m=+3169.465072142 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/69c47154-7063-4a88-af54-c4dba11e7fd6-combined-ca-bundle") pod "barbican-api-85c89c7f6-6429v" (UID: "69c47154-7063-4a88-af54-c4dba11e7fd6") : secret "combined-ca-bundle" not found Mar 16 16:24:26 crc kubenswrapper[5120]: E0316 16:24:26.311413 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-barbican-internal-svc: secret "cert-barbican-internal-svc" not found Mar 16 16:24:26 crc kubenswrapper[5120]: E0316 16:24:26.311441 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69c47154-7063-4a88-af54-c4dba11e7fd6-internal-tls-certs podName:69c47154-7063-4a88-af54-c4dba11e7fd6 nodeName:}" failed. No retries permitted until 2026-03-16 16:24:27.311435183 +0000 UTC m=+3169.465366840 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/69c47154-7063-4a88-af54-c4dba11e7fd6-internal-tls-certs") pod "barbican-api-85c89c7f6-6429v" (UID: "69c47154-7063-4a88-af54-c4dba11e7fd6") : secret "cert-barbican-internal-svc" not found Mar 16 16:24:26 crc kubenswrapper[5120]: E0316 16:24:26.311462 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/barbican-config-data: secret "barbican-config-data" not found Mar 16 16:24:26 crc kubenswrapper[5120]: E0316 16:24:26.311490 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69c47154-7063-4a88-af54-c4dba11e7fd6-config-data podName:69c47154-7063-4a88-af54-c4dba11e7fd6 nodeName:}" failed. No retries permitted until 2026-03-16 16:24:27.311483064 +0000 UTC m=+3169.465414721 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/secret/69c47154-7063-4a88-af54-c4dba11e7fd6-config-data") pod "barbican-api-85c89c7f6-6429v" (UID: "69c47154-7063-4a88-af54-c4dba11e7fd6") : secret "barbican-config-data" not found Mar 16 16:24:26 crc kubenswrapper[5120]: I0316 16:24:26.325522 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-j6td6"] Mar 16 16:24:26 crc kubenswrapper[5120]: I0316 16:24:26.381693 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-2841-account-create-update-j4bbs"] Mar 16 16:24:26 crc kubenswrapper[5120]: I0316 16:24:26.424296 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-j6td6"] Mar 16 16:24:26 crc kubenswrapper[5120]: I0316 16:24:26.474706 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-dpqrl"] Mar 16 16:24:26 crc kubenswrapper[5120]: E0316 16:24:26.500884 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of c4e58989b0e4c03f55cfdda8d9b7d8a1793435113a8b45dcd1505218a190c874 is running failed: container process not found" containerID="c4e58989b0e4c03f55cfdda8d9b7d8a1793435113a8b45dcd1505218a190c874" cmd=["/usr/bin/pidof","ovsdb-server"] Mar 16 16:24:26 crc kubenswrapper[5120]: E0316 16:24:26.501117 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of c4e58989b0e4c03f55cfdda8d9b7d8a1793435113a8b45dcd1505218a190c874 is running failed: container process not found" containerID="c4e58989b0e4c03f55cfdda8d9b7d8a1793435113a8b45dcd1505218a190c874" cmd=["/usr/bin/pidof","ovsdb-server"] Mar 16 16:24:26 crc kubenswrapper[5120]: E0316 16:24:26.501265 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of c4e58989b0e4c03f55cfdda8d9b7d8a1793435113a8b45dcd1505218a190c874 is running failed: container process not found" containerID="c4e58989b0e4c03f55cfdda8d9b7d8a1793435113a8b45dcd1505218a190c874" cmd=["/usr/bin/pidof","ovsdb-server"] Mar 16 16:24:26 crc kubenswrapper[5120]: E0316 16:24:26.501291 5120 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of c4e58989b0e4c03f55cfdda8d9b7d8a1793435113a8b45dcd1505218a190c874 is running failed: container process not found" probeType="Readiness" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podUID="47f6dea8-ee86-4de1-8bf7-3bbb7b5b4be1" containerName="ovsdbserver-nb" probeResult="unknown" Mar 16 16:24:26 crc kubenswrapper[5120]: I0316 16:24:26.514936 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-j9pqb"] Mar 16 16:24:26 crc kubenswrapper[5120]: I0316 16:24:26.571563 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-dpqrl"] Mar 16 16:24:26 crc kubenswrapper[5120]: I0316 16:24:26.615503 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_7ae11e5d-88eb-4be1-8936-985a2daadef0/ovsdbserver-sb/0.log" Mar 16 16:24:26 crc kubenswrapper[5120]: I0316 16:24:26.615581 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:24:26 crc kubenswrapper[5120]: I0316 16:24:26.617545 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-j9pqb"] Mar 16 16:24:26 crc kubenswrapper[5120]: I0316 16:24:26.634068 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-vt87c"] Mar 16 16:24:26 crc kubenswrapper[5120]: I0316 16:24:26.646157 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-vt87c"] Mar 16 16:24:26 crc kubenswrapper[5120]: I0316 16:24:26.649944 5120 status_manager.go:895] "Failed to get status for pod" podUID="4c4d0f9a-4660-44c7-aa3c-4653612142bb" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 16:24:26 crc kubenswrapper[5120]: I0316 16:24:26.660205 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/watcher-db-sync-tlbgk"] Mar 16 16:24:26 crc kubenswrapper[5120]: I0316 16:24:26.694576 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1e9c9fdb-20c1-4c7b-b5d1-91088ed981a5" path="/var/lib/kubelet/pods/1e9c9fdb-20c1-4c7b-b5d1-91088ed981a5/volumes" Mar 16 16:24:26 crc kubenswrapper[5120]: I0316 16:24:26.695286 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2da9f738-8983-4a21-ae37-5917076739f4" path="/var/lib/kubelet/pods/2da9f738-8983-4a21-ae37-5917076739f4/volumes" Mar 16 16:24:26 crc kubenswrapper[5120]: I0316 16:24:26.703278 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="35ce1e81-fe7f-42f9-b95d-3730a347e275" path="/var/lib/kubelet/pods/35ce1e81-fe7f-42f9-b95d-3730a347e275/volumes" Mar 16 16:24:26 crc kubenswrapper[5120]: I0316 16:24:26.703862 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="395499e0-a2dc-4775-9dde-f66517d1d827" path="/var/lib/kubelet/pods/395499e0-a2dc-4775-9dde-f66517d1d827/volumes" Mar 16 16:24:26 crc kubenswrapper[5120]: I0316 16:24:26.704333 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="442c41b4-b70b-4714-933f-3470a22e2422" path="/var/lib/kubelet/pods/442c41b4-b70b-4714-933f-3470a22e2422/volumes" Mar 16 16:24:26 crc kubenswrapper[5120]: I0316 16:24:26.713231 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b4fb783-c7b1-4688-b793-d3ae04edc806" path="/var/lib/kubelet/pods/4b4fb783-c7b1-4688-b793-d3ae04edc806/volumes" Mar 16 16:24:26 crc kubenswrapper[5120]: I0316 16:24:26.713856 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="88923e4b-c216-48dd-9b51-988c209c7df9" path="/var/lib/kubelet/pods/88923e4b-c216-48dd-9b51-988c209c7df9/volumes" Mar 16 16:24:26 crc kubenswrapper[5120]: I0316 16:24:26.714465 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="930884a5-5cda-4141-8d98-deee3cd13dc3" path="/var/lib/kubelet/pods/930884a5-5cda-4141-8d98-deee3cd13dc3/volumes" Mar 16 16:24:26 crc kubenswrapper[5120]: I0316 16:24:26.715593 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a1770402-bcb6-4c25-8079-130a3aaafcbb" path="/var/lib/kubelet/pods/a1770402-bcb6-4c25-8079-130a3aaafcbb/volumes" Mar 16 16:24:26 crc kubenswrapper[5120]: I0316 16:24:26.721297 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c2b81fed-a0a9-44aa-9d9e-ba21b827dc43" path="/var/lib/kubelet/pods/c2b81fed-a0a9-44aa-9d9e-ba21b827dc43/volumes" Mar 16 16:24:26 crc kubenswrapper[5120]: I0316 16:24:26.722349 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c2cd901d-2bb0-43a4-affa-534bbbf63f11" path="/var/lib/kubelet/pods/c2cd901d-2bb0-43a4-affa-534bbbf63f11/volumes" Mar 16 16:24:26 crc kubenswrapper[5120]: I0316 16:24:26.724341 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c315e251-3560-4322-9350-b163fd772f38" path="/var/lib/kubelet/pods/c315e251-3560-4322-9350-b163fd772f38/volumes" Mar 16 16:24:26 crc kubenswrapper[5120]: I0316 16:24:26.725423 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d63757a1-dcb4-4951-a68e-6517bf529a8e" path="/var/lib/kubelet/pods/d63757a1-dcb4-4951-a68e-6517bf529a8e/volumes" Mar 16 16:24:26 crc kubenswrapper[5120]: I0316 16:24:26.726995 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ebe87fc0-a7b8-4344-bb8d-3bd243ef0bbf" path="/var/lib/kubelet/pods/ebe87fc0-a7b8-4344-bb8d-3bd243ef0bbf/volumes" Mar 16 16:24:26 crc kubenswrapper[5120]: I0316 16:24:26.737268 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/watcher-db-sync-tlbgk"] Mar 16 16:24:26 crc kubenswrapper[5120]: I0316 16:24:26.737462 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:24:26 crc kubenswrapper[5120]: I0316 16:24:26.737505 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:24:26 crc kubenswrapper[5120]: I0316 16:24:26.737522 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-xbzfv"] Mar 16 16:24:26 crc kubenswrapper[5120]: I0316 16:24:26.737537 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-xbzfv"] Mar 16 16:24:26 crc kubenswrapper[5120]: I0316 16:24:26.737900 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="7ea8cd10-4026-4603-a76b-b26ebe185441" containerName="cinder-api-log" containerID="cri-o://012a3855ae67a12b9164354428ce7c259e43b459de8113e16569a6cd9ad28f57" gracePeriod=30 Mar 16 16:24:26 crc kubenswrapper[5120]: I0316 16:24:26.738215 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="73c9b7cf-53e7-4e3b-81c4-f674f8bfd894" containerName="cinder-scheduler" containerID="cri-o://6d0c744e21abc67d4d22f2172b5ffdd0c1c8058e7ea0636d21a2bf8a35b91b0e" gracePeriod=30 Mar 16 16:24:26 crc kubenswrapper[5120]: I0316 16:24:26.738725 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="7ea8cd10-4026-4603-a76b-b26ebe185441" containerName="cinder-api" containerID="cri-o://2a90a1b43864b07de00f6e1d407ba798daf32a8248e46043a557119db32aff1d" gracePeriod=30 Mar 16 16:24:26 crc kubenswrapper[5120]: I0316 16:24:26.739035 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="73c9b7cf-53e7-4e3b-81c4-f674f8bfd894" containerName="probe" containerID="cri-o://0828e02870000200de6ce67c3eccd85fed823e244bc79a5b6a48e7620b7e3a7b" gracePeriod=30 Mar 16 16:24:26 crc kubenswrapper[5120]: I0316 16:24:26.742751 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xpkm2\" (UniqueName: \"kubernetes.io/projected/7ae11e5d-88eb-4be1-8936-985a2daadef0-kube-api-access-xpkm2\") pod \"7ae11e5d-88eb-4be1-8936-985a2daadef0\" (UID: \"7ae11e5d-88eb-4be1-8936-985a2daadef0\") " Mar 16 16:24:26 crc kubenswrapper[5120]: I0316 16:24:26.743078 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7ae11e5d-88eb-4be1-8936-985a2daadef0-config\") pod \"7ae11e5d-88eb-4be1-8936-985a2daadef0\" (UID: \"7ae11e5d-88eb-4be1-8936-985a2daadef0\") " Mar 16 16:24:26 crc kubenswrapper[5120]: I0316 16:24:26.743324 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/7ae11e5d-88eb-4be1-8936-985a2daadef0-scripts\") pod \"7ae11e5d-88eb-4be1-8936-985a2daadef0\" (UID: \"7ae11e5d-88eb-4be1-8936-985a2daadef0\") " Mar 16 16:24:26 crc kubenswrapper[5120]: I0316 16:24:26.743441 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/7ae11e5d-88eb-4be1-8936-985a2daadef0-ovsdb-rundir\") pod \"7ae11e5d-88eb-4be1-8936-985a2daadef0\" (UID: \"7ae11e5d-88eb-4be1-8936-985a2daadef0\") " Mar 16 16:24:26 crc kubenswrapper[5120]: I0316 16:24:26.743809 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/7ae11e5d-88eb-4be1-8936-985a2daadef0-ovsdbserver-sb-tls-certs\") pod \"7ae11e5d-88eb-4be1-8936-985a2daadef0\" (UID: \"7ae11e5d-88eb-4be1-8936-985a2daadef0\") " Mar 16 16:24:26 crc kubenswrapper[5120]: I0316 16:24:26.743913 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7ae11e5d-88eb-4be1-8936-985a2daadef0-combined-ca-bundle\") pod \"7ae11e5d-88eb-4be1-8936-985a2daadef0\" (UID: \"7ae11e5d-88eb-4be1-8936-985a2daadef0\") " Mar 16 16:24:26 crc kubenswrapper[5120]: I0316 16:24:26.744104 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovndbcluster-sb-etc-ovn\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") pod \"7ae11e5d-88eb-4be1-8936-985a2daadef0\" (UID: \"7ae11e5d-88eb-4be1-8936-985a2daadef0\") " Mar 16 16:24:26 crc kubenswrapper[5120]: I0316 16:24:26.744281 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/7ae11e5d-88eb-4be1-8936-985a2daadef0-metrics-certs-tls-certs\") pod \"7ae11e5d-88eb-4be1-8936-985a2daadef0\" (UID: \"7ae11e5d-88eb-4be1-8936-985a2daadef0\") " Mar 16 16:24:26 crc kubenswrapper[5120]: I0316 16:24:26.752258 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7ae11e5d-88eb-4be1-8936-985a2daadef0-config" (OuterVolumeSpecName: "config") pod "7ae11e5d-88eb-4be1-8936-985a2daadef0" (UID: "7ae11e5d-88eb-4be1-8936-985a2daadef0"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:24:26 crc kubenswrapper[5120]: I0316 16:24:26.753096 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7ae11e5d-88eb-4be1-8936-985a2daadef0-scripts" (OuterVolumeSpecName: "scripts") pod "7ae11e5d-88eb-4be1-8936-985a2daadef0" (UID: "7ae11e5d-88eb-4be1-8936-985a2daadef0"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:24:26 crc kubenswrapper[5120]: I0316 16:24:26.755076 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ae11e5d-88eb-4be1-8936-985a2daadef0-ovsdb-rundir" (OuterVolumeSpecName: "ovsdb-rundir") pod "7ae11e5d-88eb-4be1-8936-985a2daadef0" (UID: "7ae11e5d-88eb-4be1-8936-985a2daadef0"). InnerVolumeSpecName "ovsdb-rundir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:24:26 crc kubenswrapper[5120]: I0316 16:24:26.758303 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ae11e5d-88eb-4be1-8936-985a2daadef0-kube-api-access-xpkm2" (OuterVolumeSpecName: "kube-api-access-xpkm2") pod "7ae11e5d-88eb-4be1-8936-985a2daadef0" (UID: "7ae11e5d-88eb-4be1-8936-985a2daadef0"). InnerVolumeSpecName "kube-api-access-xpkm2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:24:26 crc kubenswrapper[5120]: I0316 16:24:26.783199 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage14-crc" (OuterVolumeSpecName: "ovndbcluster-sb-etc-ovn") pod "7ae11e5d-88eb-4be1-8936-985a2daadef0" (UID: "7ae11e5d-88eb-4be1-8936-985a2daadef0"). InnerVolumeSpecName "local-storage14-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:24:26 crc kubenswrapper[5120]: I0316 16:24:26.823539 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 16:24:26 crc kubenswrapper[5120]: I0316 16:24:26.824033 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="7f5bff08-fc88-42fc-ab9b-6d8db171ee6a" containerName="account-server" containerID="cri-o://293e4eeed9c463f36b54974ddbda55237ad67246ce53a79f496892505134a481" gracePeriod=30 Mar 16 16:24:26 crc kubenswrapper[5120]: I0316 16:24:26.824415 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="7f5bff08-fc88-42fc-ab9b-6d8db171ee6a" containerName="container-updater" containerID="cri-o://00a717d1a33a62975a302ddd0726c4e1b1c0c5fd8cc1fc610e198519673ec7b5" gracePeriod=30 Mar 16 16:24:26 crc kubenswrapper[5120]: I0316 16:24:26.824455 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="7f5bff08-fc88-42fc-ab9b-6d8db171ee6a" containerName="account-reaper" containerID="cri-o://2add8d73118c8e33eeb2d9664e5dfd77ce96c461c1767cd0fd0328b33f5c36fb" gracePeriod=30 Mar 16 16:24:26 crc kubenswrapper[5120]: I0316 16:24:26.824562 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="7f5bff08-fc88-42fc-ab9b-6d8db171ee6a" containerName="container-auditor" containerID="cri-o://338c2b64732eb5311f04bd9a566b4c3c11a3210d4d3421b6e4a7d84edcd4d18f" gracePeriod=30 Mar 16 16:24:26 crc kubenswrapper[5120]: I0316 16:24:26.824609 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="7f5bff08-fc88-42fc-ab9b-6d8db171ee6a" containerName="swift-recon-cron" containerID="cri-o://88d0838f0e55c2ee07fde8bbf71e8df1ae6de7871d90a1d121e8c8c31cc0d30c" gracePeriod=30 Mar 16 16:24:26 crc kubenswrapper[5120]: I0316 16:24:26.824638 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="7f5bff08-fc88-42fc-ab9b-6d8db171ee6a" containerName="container-server" containerID="cri-o://02a2ffa3d3a2d7c1552f7589bbf4799a5575b36a6ab8851cfeface45442ecf4c" gracePeriod=30 Mar 16 16:24:26 crc kubenswrapper[5120]: I0316 16:24:26.824665 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="7f5bff08-fc88-42fc-ab9b-6d8db171ee6a" containerName="rsync" containerID="cri-o://6c3e70ac2fbe4fa7acb01497861b03a7149c1e383ad9c493b5591ae3ea540c5c" gracePeriod=30 Mar 16 16:24:26 crc kubenswrapper[5120]: I0316 16:24:26.824699 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="7f5bff08-fc88-42fc-ab9b-6d8db171ee6a" containerName="object-auditor" containerID="cri-o://2c2449075b7cb36e869c5f5b1d0cbbf73a489350dbfc1054e715c259e79792ad" gracePeriod=30 Mar 16 16:24:26 crc kubenswrapper[5120]: I0316 16:24:26.824726 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="7f5bff08-fc88-42fc-ab9b-6d8db171ee6a" containerName="object-replicator" containerID="cri-o://4399abb79b72fcaae5898a8f46943a6ab6f42d0bb8e6d9531ec308f970c87f67" gracePeriod=30 Mar 16 16:24:26 crc kubenswrapper[5120]: I0316 16:24:26.824737 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="7f5bff08-fc88-42fc-ab9b-6d8db171ee6a" containerName="object-expirer" containerID="cri-o://6696b7f7b697efa4feabf0a01622540fdb189bc4a1df6611b1c30c76619d0945" gracePeriod=30 Mar 16 16:24:26 crc kubenswrapper[5120]: I0316 16:24:26.824791 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="7f5bff08-fc88-42fc-ab9b-6d8db171ee6a" containerName="object-server" containerID="cri-o://914a1accee31ec9d58f31d18ce16ebc71b52c798b7569e8ba2718c12eb0b6727" gracePeriod=30 Mar 16 16:24:26 crc kubenswrapper[5120]: I0316 16:24:26.824807 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="7f5bff08-fc88-42fc-ab9b-6d8db171ee6a" containerName="object-updater" containerID="cri-o://43e5191629bf082b0e01836ca76be96391e20c5de3b139199777067a04192339" gracePeriod=30 Mar 16 16:24:26 crc kubenswrapper[5120]: I0316 16:24:26.824752 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="7f5bff08-fc88-42fc-ab9b-6d8db171ee6a" containerName="container-replicator" containerID="cri-o://da0cebe0fefea2659ee1956f1a037ab95538f3b38f4c90c9544da64c8f4c5a1c" gracePeriod=30 Mar 16 16:24:26 crc kubenswrapper[5120]: I0316 16:24:26.824871 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="7f5bff08-fc88-42fc-ab9b-6d8db171ee6a" containerName="account-replicator" containerID="cri-o://f92f67038f74d06e99a30d2effb51dbd1ebba2432520a2fba300840396f0f972" gracePeriod=30 Mar 16 16:24:26 crc kubenswrapper[5120]: I0316 16:24:26.824901 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="7f5bff08-fc88-42fc-ab9b-6d8db171ee6a" containerName="account-auditor" containerID="cri-o://999c0ea5f7b0027f0c11788a39e8314b09f917d6f6c4ab035c13db24d7b71c5f" gracePeriod=30 Mar 16 16:24:26 crc kubenswrapper[5120]: I0316 16:24:26.864941 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/7ae11e5d-88eb-4be1-8936-985a2daadef0-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:26 crc kubenswrapper[5120]: I0316 16:24:26.864968 5120 reconciler_common.go:299] "Volume detached for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/7ae11e5d-88eb-4be1-8936-985a2daadef0-ovsdb-rundir\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:26 crc kubenswrapper[5120]: I0316 16:24:26.864996 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") on node \"crc\" " Mar 16 16:24:26 crc kubenswrapper[5120]: I0316 16:24:26.865008 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xpkm2\" (UniqueName: \"kubernetes.io/projected/7ae11e5d-88eb-4be1-8936-985a2daadef0-kube-api-access-xpkm2\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:26 crc kubenswrapper[5120]: I0316 16:24:26.865018 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7ae11e5d-88eb-4be1-8936-985a2daadef0-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:26 crc kubenswrapper[5120]: I0316 16:24:26.896675 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-87c8bf854-gkthd"] Mar 16 16:24:26 crc kubenswrapper[5120]: I0316 16:24:26.896989 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-87c8bf854-gkthd" podUID="771204f4-c55f-4a6e-be63-70f3d1c8a51e" containerName="placement-log" containerID="cri-o://3a19d570305168b53a02c3d68205387f2601dd914bd1d418b04fabacd375394c" gracePeriod=30 Mar 16 16:24:26 crc kubenswrapper[5120]: I0316 16:24:26.897376 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-87c8bf854-gkthd" podUID="771204f4-c55f-4a6e-be63-70f3d1c8a51e" containerName="placement-api" containerID="cri-o://7c4f8549d75fe7169915e7f6cda9d1b1a6faa1e896903408eeb16bd5e1ec8969" gracePeriod=30 Mar 16 16:24:26 crc kubenswrapper[5120]: I0316 16:24:26.936996 5120 generic.go:358] "Generic (PLEG): container finished" podID="794d950a-8664-4970-963a-2773749103e0" containerID="28a01c5edf4ff6aef66071041d049bd9bd12e77fbd906ddfb625be33100a15b5" exitCode=2 Mar 16 16:24:26 crc kubenswrapper[5120]: I0316 16:24:26.937193 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"794d950a-8664-4970-963a-2773749103e0","Type":"ContainerDied","Data":"28a01c5edf4ff6aef66071041d049bd9bd12e77fbd906ddfb625be33100a15b5"} Mar 16 16:24:26 crc kubenswrapper[5120]: I0316 16:24:26.939483 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_47f6dea8-ee86-4de1-8bf7-3bbb7b5b4be1/ovsdbserver-nb/0.log" Mar 16 16:24:26 crc kubenswrapper[5120]: I0316 16:24:26.939508 5120 generic.go:358] "Generic (PLEG): container finished" podID="47f6dea8-ee86-4de1-8bf7-3bbb7b5b4be1" containerID="f9993e08b1a1c6e83a003533f2dc36cc32a4e662efefb4ae622f4ee6f0fd404e" exitCode=2 Mar 16 16:24:26 crc kubenswrapper[5120]: I0316 16:24:26.939519 5120 generic.go:358] "Generic (PLEG): container finished" podID="47f6dea8-ee86-4de1-8bf7-3bbb7b5b4be1" containerID="c4e58989b0e4c03f55cfdda8d9b7d8a1793435113a8b45dcd1505218a190c874" exitCode=143 Mar 16 16:24:26 crc kubenswrapper[5120]: I0316 16:24:26.939949 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"47f6dea8-ee86-4de1-8bf7-3bbb7b5b4be1","Type":"ContainerDied","Data":"f9993e08b1a1c6e83a003533f2dc36cc32a4e662efefb4ae622f4ee6f0fd404e"} Mar 16 16:24:26 crc kubenswrapper[5120]: I0316 16:24:26.939981 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"47f6dea8-ee86-4de1-8bf7-3bbb7b5b4be1","Type":"ContainerDied","Data":"c4e58989b0e4c03f55cfdda8d9b7d8a1793435113a8b45dcd1505218a190c874"} Mar 16 16:24:26 crc kubenswrapper[5120]: I0316 16:24:26.948513 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_7ae11e5d-88eb-4be1-8936-985a2daadef0/ovsdbserver-sb/0.log" Mar 16 16:24:26 crc kubenswrapper[5120]: I0316 16:24:26.948556 5120 generic.go:358] "Generic (PLEG): container finished" podID="7ae11e5d-88eb-4be1-8936-985a2daadef0" containerID="30fb3aa88577d49531b8a5e3ae2d20fd54120a0e99aa07ccc38055fa65373f91" exitCode=143 Mar 16 16:24:26 crc kubenswrapper[5120]: I0316 16:24:26.948679 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"7ae11e5d-88eb-4be1-8936-985a2daadef0","Type":"ContainerDied","Data":"30fb3aa88577d49531b8a5e3ae2d20fd54120a0e99aa07ccc38055fa65373f91"} Mar 16 16:24:26 crc kubenswrapper[5120]: I0316 16:24:26.948708 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"7ae11e5d-88eb-4be1-8936-985a2daadef0","Type":"ContainerDied","Data":"fc168f961684ca96e5b21e3c362739e1c46878e4622c2675cfb0f8f2293fae79"} Mar 16 16:24:26 crc kubenswrapper[5120]: I0316 16:24:26.948728 5120 scope.go:117] "RemoveContainer" containerID="43b1e480c270d5982eb7544840036b7b1e664f5b3eda16d1c57593f55fd4e913" Mar 16 16:24:26 crc kubenswrapper[5120]: I0316 16:24:26.948986 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:24:26 crc kubenswrapper[5120]: I0316 16:24:26.954412 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-sr2cl"] Mar 16 16:24:26 crc kubenswrapper[5120]: I0316 16:24:26.966393 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-sr2cl"] Mar 16 16:24:26 crc kubenswrapper[5120]: I0316 16:24:26.983961 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:24:26 crc kubenswrapper[5120]: I0316 16:24:26.984253 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="3ea3fd85-7822-44e8-a112-9aec7d6f9a7c" containerName="nova-metadata-log" containerID="cri-o://dddf01fb2a62a299ce661c264a716a073896f253775f73284ef6259d80e680a7" gracePeriod=30 Mar 16 16:24:26 crc kubenswrapper[5120]: I0316 16:24:26.984786 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="3ea3fd85-7822-44e8-a112-9aec7d6f9a7c" containerName="nova-metadata-metadata" containerID="cri-o://4ea09e08e85b261a659b39580e998425395c7ffa64c9d1c9ae71d3e57222b903" gracePeriod=30 Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.036134 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-q5hqq"] Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.038148 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ae11e5d-88eb-4be1-8936-985a2daadef0" containerName="ovsdbserver-sb" Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.038170 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ae11e5d-88eb-4be1-8936-985a2daadef0" containerName="ovsdbserver-sb" Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.038285 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ae11e5d-88eb-4be1-8936-985a2daadef0" containerName="openstack-network-exporter" Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.038302 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ae11e5d-88eb-4be1-8936-985a2daadef0" containerName="openstack-network-exporter" Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.038667 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7ae11e5d-88eb-4be1-8936-985a2daadef0" containerName="ovsdbserver-sb" Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.038692 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7ae11e5d-88eb-4be1-8936-985a2daadef0" containerName="openstack-network-exporter" Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.048353 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage14-crc" (UniqueName: "kubernetes.io/local-volume/local-storage14-crc") on node "crc" Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.077585 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.115217 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-q5hqq" Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.179654 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-6d4b69cb4d-gjpzv"] Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.179986 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-6d4b69cb4d-gjpzv" podUID="1d4fa436-d4ae-48e8-b4db-5e9096c6f51d" containerName="neutron-api" containerID="cri-o://769346ed2040f04a707d25f586265995e85d8fc1000ad07bd25db94424574293" gracePeriod=30 Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.180507 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-6d4b69cb4d-gjpzv" podUID="1d4fa436-d4ae-48e8-b4db-5e9096c6f51d" containerName="neutron-httpd" containerID="cri-o://c006c912d0b81da9cf43cada9cc7e6f4a1e0fac1e38af8ab7eb79480910018da" gracePeriod=30 Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.201594 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-q5hqq"] Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.220004 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.220403 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="79383c2c-77ce-4694-acfd-f65a93d14d36" containerName="glance-log" containerID="cri-o://23319fc57aa64fe609c628ba0cd9c070d7c509b1db6779e65be1e844ed0d962a" gracePeriod=30 Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.221203 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="79383c2c-77ce-4694-acfd-f65a93d14d36" containerName="glance-httpd" containerID="cri-o://f553eca0fd2ecf045ea723c74a9de9bad3d2b0275e01c2e51bf1cd235ad00eb5" gracePeriod=30 Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.235891 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-a8ac-account-create-update-lqmbd"] Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.245921 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7ae11e5d-88eb-4be1-8936-985a2daadef0-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "7ae11e5d-88eb-4be1-8936-985a2daadef0" (UID: "7ae11e5d-88eb-4be1-8936-985a2daadef0"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.264159 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-db-create-hblb6"] Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.285109 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-db-create-hblb6"] Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.295407 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5132805e-c90f-44bf-a405-0a3fae248b25-config\") pod \"dnsmasq-dnsmasq-79dcd846c5-q5hqq\" (UID: \"5132805e-c90f-44bf-a405-0a3fae248b25\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-q5hqq" Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.295609 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/5132805e-c90f-44bf-a405-0a3fae248b25-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-79dcd846c5-q5hqq\" (UID: \"5132805e-c90f-44bf-a405-0a3fae248b25\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-q5hqq" Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.295640 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4k4dw\" (UniqueName: \"kubernetes.io/projected/5132805e-c90f-44bf-a405-0a3fae248b25-kube-api-access-4k4dw\") pod \"dnsmasq-dnsmasq-79dcd846c5-q5hqq\" (UID: \"5132805e-c90f-44bf-a405-0a3fae248b25\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-q5hqq" Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.295709 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7ae11e5d-88eb-4be1-8936-985a2daadef0-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.309656 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7ae11e5d-88eb-4be1-8936-985a2daadef0-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "7ae11e5d-88eb-4be1-8936-985a2daadef0" (UID: "7ae11e5d-88eb-4be1-8936-985a2daadef0"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.316962 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.317559 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="d4b88a4e-143e-46bd-ada8-56dece11d6cc" containerName="glance-log" containerID="cri-o://d3796ecbe42b3beab0d0040cb2692ce8f22bdf760113ef0e8c3cfaa0ff2276f7" gracePeriod=30 Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.318130 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="d4b88a4e-143e-46bd-ada8-56dece11d6cc" containerName="glance-httpd" containerID="cri-o://bcf29711a914125565b105b455e66a7b23dfececab72dcb037b0a8c45113f6ab" gracePeriod=30 Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.336063 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.336632 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="11468616-1e2d-4cfd-b172-299b0cc33f6e" containerName="nova-api-log" containerID="cri-o://11ddd2a3e0b9e6341372082fc57fa83a45f334a4f158c1daef9d97c45b20424b" gracePeriod=30 Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.336989 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="11468616-1e2d-4cfd-b172-299b0cc33f6e" containerName="nova-api-api" containerID="cri-o://80b5ea2dfc65de88c23635009864244ff0b93f75a6ce71ea114be7eaf3207cec" gracePeriod=30 Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.393744 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-51fc-account-create-update-8thf9"] Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.400185 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/5132805e-c90f-44bf-a405-0a3fae248b25-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-79dcd846c5-q5hqq\" (UID: \"5132805e-c90f-44bf-a405-0a3fae248b25\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-q5hqq" Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.400249 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4k4dw\" (UniqueName: \"kubernetes.io/projected/5132805e-c90f-44bf-a405-0a3fae248b25-kube-api-access-4k4dw\") pod \"dnsmasq-dnsmasq-79dcd846c5-q5hqq\" (UID: \"5132805e-c90f-44bf-a405-0a3fae248b25\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-q5hqq" Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.400410 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5132805e-c90f-44bf-a405-0a3fae248b25-config\") pod \"dnsmasq-dnsmasq-79dcd846c5-q5hqq\" (UID: \"5132805e-c90f-44bf-a405-0a3fae248b25\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-q5hqq" Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.400534 5120 reconciler_common.go:299] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/7ae11e5d-88eb-4be1-8936-985a2daadef0-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:27 crc kubenswrapper[5120]: E0316 16:24:27.400611 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-barbican-internal-svc: secret "cert-barbican-internal-svc" not found Mar 16 16:24:27 crc kubenswrapper[5120]: E0316 16:24:27.400697 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69c47154-7063-4a88-af54-c4dba11e7fd6-internal-tls-certs podName:69c47154-7063-4a88-af54-c4dba11e7fd6 nodeName:}" failed. No retries permitted until 2026-03-16 16:24:29.400679257 +0000 UTC m=+3171.554610914 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/69c47154-7063-4a88-af54-c4dba11e7fd6-internal-tls-certs") pod "barbican-api-85c89c7f6-6429v" (UID: "69c47154-7063-4a88-af54-c4dba11e7fd6") : secret "cert-barbican-internal-svc" not found Mar 16 16:24:27 crc kubenswrapper[5120]: E0316 16:24:27.403092 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/barbican-config-data: secret "barbican-config-data" not found Mar 16 16:24:27 crc kubenswrapper[5120]: E0316 16:24:27.403167 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69c47154-7063-4a88-af54-c4dba11e7fd6-config-data podName:69c47154-7063-4a88-af54-c4dba11e7fd6 nodeName:}" failed. No retries permitted until 2026-03-16 16:24:29.403145433 +0000 UTC m=+3171.557077090 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/secret/69c47154-7063-4a88-af54-c4dba11e7fd6-config-data") pod "barbican-api-85c89c7f6-6429v" (UID: "69c47154-7063-4a88-af54-c4dba11e7fd6") : secret "barbican-config-data" not found Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.404019 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/5132805e-c90f-44bf-a405-0a3fae248b25-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-79dcd846c5-q5hqq\" (UID: \"5132805e-c90f-44bf-a405-0a3fae248b25\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-q5hqq" Mar 16 16:24:27 crc kubenswrapper[5120]: E0316 16:24:27.404078 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-barbican-public-svc: secret "cert-barbican-public-svc" not found Mar 16 16:24:27 crc kubenswrapper[5120]: E0316 16:24:27.404103 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69c47154-7063-4a88-af54-c4dba11e7fd6-public-tls-certs podName:69c47154-7063-4a88-af54-c4dba11e7fd6 nodeName:}" failed. No retries permitted until 2026-03-16 16:24:29.404094839 +0000 UTC m=+3171.558026496 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/69c47154-7063-4a88-af54-c4dba11e7fd6-public-tls-certs") pod "barbican-api-85c89c7f6-6429v" (UID: "69c47154-7063-4a88-af54-c4dba11e7fd6") : secret "cert-barbican-public-svc" not found Mar 16 16:24:27 crc kubenswrapper[5120]: E0316 16:24:27.404622 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 16:24:27 crc kubenswrapper[5120]: E0316 16:24:27.404688 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69c47154-7063-4a88-af54-c4dba11e7fd6-combined-ca-bundle podName:69c47154-7063-4a88-af54-c4dba11e7fd6 nodeName:}" failed. No retries permitted until 2026-03-16 16:24:29.404671594 +0000 UTC m=+3171.558603251 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/69c47154-7063-4a88-af54-c4dba11e7fd6-combined-ca-bundle") pod "barbican-api-85c89c7f6-6429v" (UID: "69c47154-7063-4a88-af54-c4dba11e7fd6") : secret "combined-ca-bundle" not found Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.405265 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5132805e-c90f-44bf-a405-0a3fae248b25-config\") pod \"dnsmasq-dnsmasq-79dcd846c5-q5hqq\" (UID: \"5132805e-c90f-44bf-a405-0a3fae248b25\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-q5hqq" Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.409100 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-51fc-account-create-update-8thf9"] Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.461337 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/watcher-applier-0"] Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.461618 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/watcher-applier-0" podUID="d5160b65-3a41-4645-9f47-bd4e891fef5f" containerName="watcher-applier" containerID="cri-o://ce0a8bde470adeb57224c167d670364e256b6b1b5b4d78dd8410053f53d53467" gracePeriod=30 Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.464593 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4k4dw\" (UniqueName: \"kubernetes.io/projected/5132805e-c90f-44bf-a405-0a3fae248b25-kube-api-access-4k4dw\") pod \"dnsmasq-dnsmasq-79dcd846c5-q5hqq\" (UID: \"5132805e-c90f-44bf-a405-0a3fae248b25\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-q5hqq" Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.468855 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7ae11e5d-88eb-4be1-8936-985a2daadef0-ovsdbserver-sb-tls-certs" (OuterVolumeSpecName: "ovsdbserver-sb-tls-certs") pod "7ae11e5d-88eb-4be1-8936-985a2daadef0" (UID: "7ae11e5d-88eb-4be1-8936-985a2daadef0"). InnerVolumeSpecName "ovsdbserver-sb-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.481828 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-n2wfm"] Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.485804 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-n2wfm"] Mar 16 16:24:27 crc kubenswrapper[5120]: E0316 16:24:27.492238 5120 kuberuntime_manager.go:1358] "Unhandled Error" err=< Mar 16 16:24:27 crc kubenswrapper[5120]: container &Container{Name:mariadb-account-create-update,Image:quay.io/podified-antelope-centos9/openstack-mariadb@sha256:4caef2b55e01b9a7ee88a22bc69db1893521a91d95c7ad4c8e593f14f17a5f95,Command:[/bin/sh -c #!/bin/bash Mar 16 16:24:27 crc kubenswrapper[5120]: Mar 16 16:24:27 crc kubenswrapper[5120]: MYSQL_REMOTE_HOST="" source /var/lib/operator-scripts/mysql_root_auth.sh Mar 16 16:24:27 crc kubenswrapper[5120]: Mar 16 16:24:27 crc kubenswrapper[5120]: export DatabasePassword=${DatabasePassword:?"Please specify a DatabasePassword variable."} Mar 16 16:24:27 crc kubenswrapper[5120]: Mar 16 16:24:27 crc kubenswrapper[5120]: MYSQL_CMD="mysql -h -u root -P 3306" Mar 16 16:24:27 crc kubenswrapper[5120]: Mar 16 16:24:27 crc kubenswrapper[5120]: if [ -n "barbican" ]; then Mar 16 16:24:27 crc kubenswrapper[5120]: GRANT_DATABASE="barbican" Mar 16 16:24:27 crc kubenswrapper[5120]: else Mar 16 16:24:27 crc kubenswrapper[5120]: GRANT_DATABASE="*" Mar 16 16:24:27 crc kubenswrapper[5120]: fi Mar 16 16:24:27 crc kubenswrapper[5120]: Mar 16 16:24:27 crc kubenswrapper[5120]: # going for maximum compatibility here: Mar 16 16:24:27 crc kubenswrapper[5120]: # 1. MySQL 8 no longer allows implicit create user when GRANT is used Mar 16 16:24:27 crc kubenswrapper[5120]: # 2. MariaDB has "CREATE OR REPLACE", but MySQL does not Mar 16 16:24:27 crc kubenswrapper[5120]: # 3. create user with CREATE but then do all password and TLS with ALTER to Mar 16 16:24:27 crc kubenswrapper[5120]: # support updates Mar 16 16:24:27 crc kubenswrapper[5120]: Mar 16 16:24:27 crc kubenswrapper[5120]: $MYSQL_CMD < logger="UnhandledError" Mar 16 16:24:27 crc kubenswrapper[5120]: E0316 16:24:27.493536 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"mariadb-account-create-update\" with CreateContainerConfigError: \"secret \\\"barbican-db-secret\\\" not found\"" pod="openstack-kuttl-tests/barbican-a8ac-account-create-update-lqmbd" podUID="cf8c7b4f-8110-4b63-9022-2f9dcf3c1270" Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.496071 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-xb2nh"] Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.502427 5120 reconciler_common.go:299] "Volume detached for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/7ae11e5d-88eb-4be1-8936-985a2daadef0-ovsdbserver-sb-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.523599 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-xb2nh"] Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.533804 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_47f6dea8-ee86-4de1-8bf7-3bbb7b5b4be1/ovsdbserver-nb/0.log" Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.533896 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.593717 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/watcher-decision-engine-0"] Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.594126 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/watcher-decision-engine-0" podUID="3b04c3f7-3328-4aef-92bc-42f328744879" containerName="watcher-decision-engine" containerID="cri-o://9eb860bf6d2648fb5b6a19e67714ff9df156e4d633ea711717e4dd7ef09593c3" gracePeriod=30 Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.599868 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/watcher-api-0"] Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.600117 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/watcher-api-0" podUID="e15efd1b-6aa8-4a24-b576-4e03e19e19d0" containerName="watcher-api-log" containerID="cri-o://e0f92a07b7fa6f808f45a98109ff109cb20b21840d1d05128661b849870c2178" gracePeriod=30 Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.602115 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/watcher-api-0" podUID="e15efd1b-6aa8-4a24-b576-4e03e19e19d0" containerName="watcher-api" containerID="cri-o://1ef4b2599981ce7b8001b50ecfd4a007c4f23a0c049893394acf7b049e550690" gracePeriod=30 Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.602790 5120 scope.go:117] "RemoveContainer" containerID="30fb3aa88577d49531b8a5e3ae2d20fd54120a0e99aa07ccc38055fa65373f91" Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.604182 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/47f6dea8-ee86-4de1-8bf7-3bbb7b5b4be1-scripts\") pod \"47f6dea8-ee86-4de1-8bf7-3bbb7b5b4be1\" (UID: \"47f6dea8-ee86-4de1-8bf7-3bbb7b5b4be1\") " Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.604597 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/47f6dea8-ee86-4de1-8bf7-3bbb7b5b4be1-ovsdbserver-nb-tls-certs\") pod \"47f6dea8-ee86-4de1-8bf7-3bbb7b5b4be1\" (UID: \"47f6dea8-ee86-4de1-8bf7-3bbb7b5b4be1\") " Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.605244 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/47f6dea8-ee86-4de1-8bf7-3bbb7b5b4be1-scripts" (OuterVolumeSpecName: "scripts") pod "47f6dea8-ee86-4de1-8bf7-3bbb7b5b4be1" (UID: "47f6dea8-ee86-4de1-8bf7-3bbb7b5b4be1"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.640111 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-q5hqq" Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.663625 5120 kubelet_pods.go:1019] "Unable to retrieve pull secret, the image pull may not succeed." pod="openstack-kuttl-tests/nova-cell1-conductor-0" secret="" err="secret \"nova-nova-dockercfg-nwvvr\" not found" Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.691871 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.704060 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-db-create-jltxh"] Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.712326 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/47f6dea8-ee86-4de1-8bf7-3bbb7b5b4be1-ovsdb-rundir\") pod \"47f6dea8-ee86-4de1-8bf7-3bbb7b5b4be1\" (UID: \"47f6dea8-ee86-4de1-8bf7-3bbb7b5b4be1\") " Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.712435 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/47f6dea8-ee86-4de1-8bf7-3bbb7b5b4be1-config\") pod \"47f6dea8-ee86-4de1-8bf7-3bbb7b5b4be1\" (UID: \"47f6dea8-ee86-4de1-8bf7-3bbb7b5b4be1\") " Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.712494 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qb22n\" (UniqueName: \"kubernetes.io/projected/47f6dea8-ee86-4de1-8bf7-3bbb7b5b4be1-kube-api-access-qb22n\") pod \"47f6dea8-ee86-4de1-8bf7-3bbb7b5b4be1\" (UID: \"47f6dea8-ee86-4de1-8bf7-3bbb7b5b4be1\") " Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.712576 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/47f6dea8-ee86-4de1-8bf7-3bbb7b5b4be1-metrics-certs-tls-certs\") pod \"47f6dea8-ee86-4de1-8bf7-3bbb7b5b4be1\" (UID: \"47f6dea8-ee86-4de1-8bf7-3bbb7b5b4be1\") " Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.712900 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/47f6dea8-ee86-4de1-8bf7-3bbb7b5b4be1-combined-ca-bundle\") pod \"47f6dea8-ee86-4de1-8bf7-3bbb7b5b4be1\" (UID: \"47f6dea8-ee86-4de1-8bf7-3bbb7b5b4be1\") " Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.712970 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovndbcluster-nb-etc-ovn\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") pod \"47f6dea8-ee86-4de1-8bf7-3bbb7b5b4be1\" (UID: \"47f6dea8-ee86-4de1-8bf7-3bbb7b5b4be1\") " Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.713665 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/47f6dea8-ee86-4de1-8bf7-3bbb7b5b4be1-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.714506 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/47f6dea8-ee86-4de1-8bf7-3bbb7b5b4be1-config" (OuterVolumeSpecName: "config") pod "47f6dea8-ee86-4de1-8bf7-3bbb7b5b4be1" (UID: "47f6dea8-ee86-4de1-8bf7-3bbb7b5b4be1"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.714837 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47f6dea8-ee86-4de1-8bf7-3bbb7b5b4be1-ovsdb-rundir" (OuterVolumeSpecName: "ovsdb-rundir") pod "47f6dea8-ee86-4de1-8bf7-3bbb7b5b4be1" (UID: "47f6dea8-ee86-4de1-8bf7-3bbb7b5b4be1"). InnerVolumeSpecName "ovsdb-rundir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.714916 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-db-create-nvn6z"] Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.729867 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/watcher-db-create-zwrqr"] Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.740173 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47f6dea8-ee86-4de1-8bf7-3bbb7b5b4be1-kube-api-access-qb22n" (OuterVolumeSpecName: "kube-api-access-qb22n") pod "47f6dea8-ee86-4de1-8bf7-3bbb7b5b4be1" (UID: "47f6dea8-ee86-4de1-8bf7-3bbb7b5b4be1"). InnerVolumeSpecName "kube-api-access-qb22n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.741011 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage11-crc" (OuterVolumeSpecName: "ovndbcluster-nb-etc-ovn") pod "47f6dea8-ee86-4de1-8bf7-3bbb7b5b4be1" (UID: "47f6dea8-ee86-4de1-8bf7-3bbb7b5b4be1"). InnerVolumeSpecName "local-storage11-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.746934 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/47f6dea8-ee86-4de1-8bf7-3bbb7b5b4be1-ovsdbserver-nb-tls-certs" (OuterVolumeSpecName: "ovsdbserver-nb-tls-certs") pod "47f6dea8-ee86-4de1-8bf7-3bbb7b5b4be1" (UID: "47f6dea8-ee86-4de1-8bf7-3bbb7b5b4be1"). InnerVolumeSpecName "ovsdbserver-nb-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.749206 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/rabbitmq-server-0" podUID="dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93" containerName="rabbitmq" containerID="cri-o://b8e19f90a888ff13c234758eff3ff394d92c8e571dbc711727543bdb57e3ecc7" gracePeriod=604800 Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.750818 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-db-create-jltxh"] Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.787878 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/47f6dea8-ee86-4de1-8bf7-3bbb7b5b4be1-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "47f6dea8-ee86-4de1-8bf7-3bbb7b5b4be1" (UID: "47f6dea8-ee86-4de1-8bf7-3bbb7b5b4be1"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.789521 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-db-create-nvn6z"] Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.819159 5120 reconciler_common.go:299] "Volume detached for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/47f6dea8-ee86-4de1-8bf7-3bbb7b5b4be1-ovsdb-rundir\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.819184 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/47f6dea8-ee86-4de1-8bf7-3bbb7b5b4be1-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.819194 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qb22n\" (UniqueName: \"kubernetes.io/projected/47f6dea8-ee86-4de1-8bf7-3bbb7b5b4be1-kube-api-access-qb22n\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.819205 5120 reconciler_common.go:299] "Volume detached for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/47f6dea8-ee86-4de1-8bf7-3bbb7b5b4be1-ovsdbserver-nb-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.819214 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/47f6dea8-ee86-4de1-8bf7-3bbb7b5b4be1-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.819234 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") on node \"crc\" " Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.830293 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/watcher-db-create-zwrqr"] Mar 16 16:24:27 crc kubenswrapper[5120]: E0316 16:24:27.832134 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 16:24:27 crc kubenswrapper[5120]: E0316 16:24:27.832186 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00712a43-f38b-478f-bd42-a8cb0c2c14b3-combined-ca-bundle podName:00712a43-f38b-478f-bd42-a8cb0c2c14b3 nodeName:}" failed. No retries permitted until 2026-03-16 16:24:28.332169178 +0000 UTC m=+3170.486100835 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/00712a43-f38b-478f-bd42-a8cb0c2c14b3-combined-ca-bundle") pod "nova-cell1-conductor-0" (UID: "00712a43-f38b-478f-bd42-a8cb0c2c14b3") : secret "combined-ca-bundle" not found Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.843519 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/47f6dea8-ee86-4de1-8bf7-3bbb7b5b4be1-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "47f6dea8-ee86-4de1-8bf7-3bbb7b5b4be1" (UID: "47f6dea8-ee86-4de1-8bf7-3bbb7b5b4be1"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.885668 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage11-crc" (UniqueName: "kubernetes.io/local-volume/local-storage11-crc") on node "crc" Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.890422 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-db-create-2ggfv"] Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.899557 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-db-create-2ggfv"] Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.909636 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-9428-account-create-update-hzch2"] Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.917835 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-fcjdd"] Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.921743 5120 reconciler_common.go:299] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/47f6dea8-ee86-4de1-8bf7-3bbb7b5b4be1-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.921786 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.926924 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-rvrb7"] Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.931947 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-9428-account-create-update-hzch2"] Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.937687 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-fcjdd"] Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.943485 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-db-create-6wrmh"] Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.950216 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-a8ac-account-create-update-lqmbd"] Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.955870 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-db-create-6wrmh"] Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.961211 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.961901 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="bd019f3d-1483-40e4-9534-b8bd551ed652" containerName="ceilometer-central-agent" containerID="cri-o://482e3be4b8e8664bade0b2a681aa7e0b736487e8b6c01fc03edf8ad396dc6ad3" gracePeriod=30 Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.962071 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="bd019f3d-1483-40e4-9534-b8bd551ed652" containerName="sg-core" containerID="cri-o://6b5a370e0ffa16e0b998b02a52647c91125ab7a84492ad3a7f1d5d5a529919e7" gracePeriod=30 Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.962105 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="bd019f3d-1483-40e4-9534-b8bd551ed652" containerName="proxy-httpd" containerID="cri-o://7f7b09d62f8584e17ded7110727a79828e5c99e561c9bf5cd643aa5cc1c74758" gracePeriod=30 Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.962396 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="bd019f3d-1483-40e4-9534-b8bd551ed652" containerName="ceilometer-notification-agent" containerID="cri-o://c976d3b3db94b93e1732bdd7cd1eb5e253e9c1f29aa03aaefc515f7729724645" gracePeriod=30 Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.967834 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.968055 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podUID="f90be6a3-f863-476d-b78b-95b9d069037e" containerName="nova-cell1-novncproxy-novncproxy" containerID="cri-o://0332ef9a2b607b7a01644fa26cd31f338123d18f32f186ba2acdff4ad391e66e" gracePeriod=30 Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.974684 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-6f68c75449-s4d7j"] Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.974987 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-6f68c75449-s4d7j" podUID="8558eb14-801e-455b-8374-1c69e333901c" containerName="barbican-worker-log" containerID="cri-o://d7c153224a3bf3e6347984cb47aae3cd6b8bb54fa6f5bb003cfe5e0fc882319e" gracePeriod=30 Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.975445 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-6f68c75449-s4d7j" podUID="8558eb14-801e-455b-8374-1c69e333901c" containerName="barbican-worker" containerID="cri-o://790456066ec1c9d2fb08d49a67269b46aa9af70d5546f44faab71e69a301ccfb" gracePeriod=30 Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.982699 5120 generic.go:358] "Generic (PLEG): container finished" podID="1d4fa436-d4ae-48e8-b4db-5e9096c6f51d" containerID="c006c912d0b81da9cf43cada9cc7e6f4a1e0fac1e38af8ab7eb79480910018da" exitCode=0 Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.982820 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-6bf46d9f46-cv8dx"] Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.982849 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-6d4b69cb4d-gjpzv" event={"ID":"1d4fa436-d4ae-48e8-b4db-5e9096c6f51d","Type":"ContainerDied","Data":"c006c912d0b81da9cf43cada9cc7e6f4a1e0fac1e38af8ab7eb79480910018da"} Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.983054 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-6bf46d9f46-cv8dx" podUID="ecdbe440-4557-4298-b0b7-e2e89958bf07" containerName="barbican-keystone-listener-log" containerID="cri-o://2e47d1a1b6ef394c9e4f761ae69ebb45114b8cfb8609be386af11e1fb6adb4e3" gracePeriod=30 Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.983117 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-6bf46d9f46-cv8dx" podUID="ecdbe440-4557-4298-b0b7-e2e89958bf07" containerName="barbican-keystone-listener" containerID="cri-o://ee098489a81ab6a4f9e4ca8e42dc2cbdb96791a0f059a8249a2d3bb49356b4d4" gracePeriod=30 Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.992003 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-85c89c7f6-6429v"] Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.992238 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-85c89c7f6-6429v" podUID="69c47154-7063-4a88-af54-c4dba11e7fd6" containerName="barbican-api-log" containerID="cri-o://b28880e5a05a573108be1a0e941930a878933df93431db8ee6799513224cdd63" gracePeriod=30 Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.992336 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-85c89c7f6-6429v" podUID="69c47154-7063-4a88-af54-c4dba11e7fd6" containerName="barbican-api" containerID="cri-o://8b568e74a3015e82c143b45e4ec9c9806b390389907f25fffb8093f0f982c0cd" gracePeriod=30 Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.996859 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/prometheus-metric-storage-0"] Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.997555 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/prometheus-metric-storage-0" podUID="436edb75-475a-4096-a9c9-bf235fc92d9c" containerName="prometheus" containerID="cri-o://533af2cb60162ddbab3651bb11e174e85e24fca07c3ffcfd31f3cbe35830d8bd" gracePeriod=600 Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.997877 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/prometheus-metric-storage-0" podUID="436edb75-475a-4096-a9c9-bf235fc92d9c" containerName="thanos-sidecar" containerID="cri-o://2a896000e70dd7124ec92af5c96ae6d01ec902505892d014e791fed3fbdfa390" gracePeriod=600 Mar 16 16:24:27 crc kubenswrapper[5120]: I0316 16:24:27.998118 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/prometheus-metric-storage-0" podUID="436edb75-475a-4096-a9c9-bf235fc92d9c" containerName="config-reloader" containerID="cri-o://1bba6ac3aa0cc48a80a5395897ea292ab61046d1fda826d5eb20948de324115b" gracePeriod=600 Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.000991 5120 generic.go:358] "Generic (PLEG): container finished" podID="4c4d0f9a-4660-44c7-aa3c-4653612142bb" containerID="96164b8ea75d052b461cddb068f1640ceb2bc89fadd9423f78383162a3347b9f" exitCode=137 Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.003632 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/alertmanager-metric-storage-0"] Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.004022 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/alertmanager-metric-storage-0" podUID="9b43ebee-5f04-44e0-a8bf-56f70871894e" containerName="alertmanager" containerID="cri-o://d174f547bf24ef444cb7eb8748c654dbe1df34b53324eb8a10d06c56c02dec63" gracePeriod=120 Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.004100 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/alertmanager-metric-storage-0" podUID="9b43ebee-5f04-44e0-a8bf-56f70871894e" containerName="config-reloader" containerID="cri-o://b1a722f653ecb9a8de687b89024aff31dbebdf8af7ee495b08f3d6c4416ffed9" gracePeriod=120 Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.010722 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-rvrb7" event={"ID":"86686d29-4c19-43e3-97a8-d8373883dc6a","Type":"ContainerStarted","Data":"56cf441eab6ffa06432f4cc0a85ea88a0672eaa5657fa69a5a3533853a39fd4d"} Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.014190 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.014564 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/kube-state-metrics-0" podUID="93d56b12-9c96-48fa-9343-4a12d639b8a3" containerName="kube-state-metrics" containerID="cri-o://e155ab44ab0e81f14000fc0d43ea6be46487802295ab78a807b123db0cfeb8df" gracePeriod=30 Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.043405 5120 generic.go:358] "Generic (PLEG): container finished" podID="79383c2c-77ce-4694-acfd-f65a93d14d36" containerID="23319fc57aa64fe609c628ba0cd9c070d7c509b1db6779e65be1e844ed0d962a" exitCode=143 Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.043621 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"79383c2c-77ce-4694-acfd-f65a93d14d36","Type":"ContainerDied","Data":"23319fc57aa64fe609c628ba0cd9c070d7c509b1db6779e65be1e844ed0d962a"} Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.048224 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.058931 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.083550 5120 generic.go:358] "Generic (PLEG): container finished" podID="7ea8cd10-4026-4603-a76b-b26ebe185441" containerID="012a3855ae67a12b9164354428ce7c259e43b459de8113e16569a6cd9ad28f57" exitCode=143 Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.083636 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"7ea8cd10-4026-4603-a76b-b26ebe185441","Type":"ContainerDied","Data":"012a3855ae67a12b9164354428ce7c259e43b459de8113e16569a6cd9ad28f57"} Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.121483 5120 scope.go:117] "RemoveContainer" containerID="43b1e480c270d5982eb7544840036b7b1e664f5b3eda16d1c57593f55fd4e913" Mar 16 16:24:28 crc kubenswrapper[5120]: E0316 16:24:28.123655 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"43b1e480c270d5982eb7544840036b7b1e664f5b3eda16d1c57593f55fd4e913\": container with ID starting with 43b1e480c270d5982eb7544840036b7b1e664f5b3eda16d1c57593f55fd4e913 not found: ID does not exist" containerID="43b1e480c270d5982eb7544840036b7b1e664f5b3eda16d1c57593f55fd4e913" Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.123691 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43b1e480c270d5982eb7544840036b7b1e664f5b3eda16d1c57593f55fd4e913"} err="failed to get container status \"43b1e480c270d5982eb7544840036b7b1e664f5b3eda16d1c57593f55fd4e913\": rpc error: code = NotFound desc = could not find container \"43b1e480c270d5982eb7544840036b7b1e664f5b3eda16d1c57593f55fd4e913\": container with ID starting with 43b1e480c270d5982eb7544840036b7b1e664f5b3eda16d1c57593f55fd4e913 not found: ID does not exist" Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.123712 5120 scope.go:117] "RemoveContainer" containerID="30fb3aa88577d49531b8a5e3ae2d20fd54120a0e99aa07ccc38055fa65373f91" Mar 16 16:24:28 crc kubenswrapper[5120]: E0316 16:24:28.125197 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"30fb3aa88577d49531b8a5e3ae2d20fd54120a0e99aa07ccc38055fa65373f91\": container with ID starting with 30fb3aa88577d49531b8a5e3ae2d20fd54120a0e99aa07ccc38055fa65373f91 not found: ID does not exist" containerID="30fb3aa88577d49531b8a5e3ae2d20fd54120a0e99aa07ccc38055fa65373f91" Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.125220 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30fb3aa88577d49531b8a5e3ae2d20fd54120a0e99aa07ccc38055fa65373f91"} err="failed to get container status \"30fb3aa88577d49531b8a5e3ae2d20fd54120a0e99aa07ccc38055fa65373f91\": rpc error: code = NotFound desc = could not find container \"30fb3aa88577d49531b8a5e3ae2d20fd54120a0e99aa07ccc38055fa65373f91\": container with ID starting with 30fb3aa88577d49531b8a5e3ae2d20fd54120a0e99aa07ccc38055fa65373f91 not found: ID does not exist" Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.125615 5120 generic.go:358] "Generic (PLEG): container finished" podID="7f5bff08-fc88-42fc-ab9b-6d8db171ee6a" containerID="6c3e70ac2fbe4fa7acb01497861b03a7149c1e383ad9c493b5591ae3ea540c5c" exitCode=0 Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.125633 5120 generic.go:358] "Generic (PLEG): container finished" podID="7f5bff08-fc88-42fc-ab9b-6d8db171ee6a" containerID="6696b7f7b697efa4feabf0a01622540fdb189bc4a1df6611b1c30c76619d0945" exitCode=0 Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.125641 5120 generic.go:358] "Generic (PLEG): container finished" podID="7f5bff08-fc88-42fc-ab9b-6d8db171ee6a" containerID="43e5191629bf082b0e01836ca76be96391e20c5de3b139199777067a04192339" exitCode=0 Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.125647 5120 generic.go:358] "Generic (PLEG): container finished" podID="7f5bff08-fc88-42fc-ab9b-6d8db171ee6a" containerID="2c2449075b7cb36e869c5f5b1d0cbbf73a489350dbfc1054e715c259e79792ad" exitCode=0 Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.125654 5120 generic.go:358] "Generic (PLEG): container finished" podID="7f5bff08-fc88-42fc-ab9b-6d8db171ee6a" containerID="4399abb79b72fcaae5898a8f46943a6ab6f42d0bb8e6d9531ec308f970c87f67" exitCode=0 Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.125659 5120 generic.go:358] "Generic (PLEG): container finished" podID="7f5bff08-fc88-42fc-ab9b-6d8db171ee6a" containerID="914a1accee31ec9d58f31d18ce16ebc71b52c798b7569e8ba2718c12eb0b6727" exitCode=0 Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.125664 5120 generic.go:358] "Generic (PLEG): container finished" podID="7f5bff08-fc88-42fc-ab9b-6d8db171ee6a" containerID="00a717d1a33a62975a302ddd0726c4e1b1c0c5fd8cc1fc610e198519673ec7b5" exitCode=0 Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.125671 5120 generic.go:358] "Generic (PLEG): container finished" podID="7f5bff08-fc88-42fc-ab9b-6d8db171ee6a" containerID="338c2b64732eb5311f04bd9a566b4c3c11a3210d4d3421b6e4a7d84edcd4d18f" exitCode=0 Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.125676 5120 generic.go:358] "Generic (PLEG): container finished" podID="7f5bff08-fc88-42fc-ab9b-6d8db171ee6a" containerID="da0cebe0fefea2659ee1956f1a037ab95538f3b38f4c90c9544da64c8f4c5a1c" exitCode=0 Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.125681 5120 generic.go:358] "Generic (PLEG): container finished" podID="7f5bff08-fc88-42fc-ab9b-6d8db171ee6a" containerID="02a2ffa3d3a2d7c1552f7589bbf4799a5575b36a6ab8851cfeface45442ecf4c" exitCode=0 Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.125688 5120 generic.go:358] "Generic (PLEG): container finished" podID="7f5bff08-fc88-42fc-ab9b-6d8db171ee6a" containerID="2add8d73118c8e33eeb2d9664e5dfd77ce96c461c1767cd0fd0328b33f5c36fb" exitCode=0 Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.125693 5120 generic.go:358] "Generic (PLEG): container finished" podID="7f5bff08-fc88-42fc-ab9b-6d8db171ee6a" containerID="999c0ea5f7b0027f0c11788a39e8314b09f917d6f6c4ab035c13db24d7b71c5f" exitCode=0 Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.125698 5120 generic.go:358] "Generic (PLEG): container finished" podID="7f5bff08-fc88-42fc-ab9b-6d8db171ee6a" containerID="f92f67038f74d06e99a30d2effb51dbd1ebba2432520a2fba300840396f0f972" exitCode=0 Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.125704 5120 generic.go:358] "Generic (PLEG): container finished" podID="7f5bff08-fc88-42fc-ab9b-6d8db171ee6a" containerID="293e4eeed9c463f36b54974ddbda55237ad67246ce53a79f496892505134a481" exitCode=0 Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.125768 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7f5bff08-fc88-42fc-ab9b-6d8db171ee6a","Type":"ContainerDied","Data":"6c3e70ac2fbe4fa7acb01497861b03a7149c1e383ad9c493b5591ae3ea540c5c"} Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.125812 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7f5bff08-fc88-42fc-ab9b-6d8db171ee6a","Type":"ContainerDied","Data":"6696b7f7b697efa4feabf0a01622540fdb189bc4a1df6611b1c30c76619d0945"} Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.125824 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7f5bff08-fc88-42fc-ab9b-6d8db171ee6a","Type":"ContainerDied","Data":"43e5191629bf082b0e01836ca76be96391e20c5de3b139199777067a04192339"} Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.125833 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7f5bff08-fc88-42fc-ab9b-6d8db171ee6a","Type":"ContainerDied","Data":"2c2449075b7cb36e869c5f5b1d0cbbf73a489350dbfc1054e715c259e79792ad"} Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.125842 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7f5bff08-fc88-42fc-ab9b-6d8db171ee6a","Type":"ContainerDied","Data":"4399abb79b72fcaae5898a8f46943a6ab6f42d0bb8e6d9531ec308f970c87f67"} Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.125851 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7f5bff08-fc88-42fc-ab9b-6d8db171ee6a","Type":"ContainerDied","Data":"914a1accee31ec9d58f31d18ce16ebc71b52c798b7569e8ba2718c12eb0b6727"} Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.125860 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7f5bff08-fc88-42fc-ab9b-6d8db171ee6a","Type":"ContainerDied","Data":"00a717d1a33a62975a302ddd0726c4e1b1c0c5fd8cc1fc610e198519673ec7b5"} Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.125868 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7f5bff08-fc88-42fc-ab9b-6d8db171ee6a","Type":"ContainerDied","Data":"338c2b64732eb5311f04bd9a566b4c3c11a3210d4d3421b6e4a7d84edcd4d18f"} Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.125877 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7f5bff08-fc88-42fc-ab9b-6d8db171ee6a","Type":"ContainerDied","Data":"da0cebe0fefea2659ee1956f1a037ab95538f3b38f4c90c9544da64c8f4c5a1c"} Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.125885 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7f5bff08-fc88-42fc-ab9b-6d8db171ee6a","Type":"ContainerDied","Data":"02a2ffa3d3a2d7c1552f7589bbf4799a5575b36a6ab8851cfeface45442ecf4c"} Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.125894 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7f5bff08-fc88-42fc-ab9b-6d8db171ee6a","Type":"ContainerDied","Data":"2add8d73118c8e33eeb2d9664e5dfd77ce96c461c1767cd0fd0328b33f5c36fb"} Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.125902 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7f5bff08-fc88-42fc-ab9b-6d8db171ee6a","Type":"ContainerDied","Data":"999c0ea5f7b0027f0c11788a39e8314b09f917d6f6c4ab035c13db24d7b71c5f"} Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.125910 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7f5bff08-fc88-42fc-ab9b-6d8db171ee6a","Type":"ContainerDied","Data":"f92f67038f74d06e99a30d2effb51dbd1ebba2432520a2fba300840396f0f972"} Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.125919 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7f5bff08-fc88-42fc-ab9b-6d8db171ee6a","Type":"ContainerDied","Data":"293e4eeed9c463f36b54974ddbda55237ad67246ce53a79f496892505134a481"} Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.140120 5120 generic.go:358] "Generic (PLEG): container finished" podID="73c9b7cf-53e7-4e3b-81c4-f674f8bfd894" containerID="0828e02870000200de6ce67c3eccd85fed823e244bc79a5b6a48e7620b7e3a7b" exitCode=0 Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.140251 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"73c9b7cf-53e7-4e3b-81c4-f674f8bfd894","Type":"ContainerDied","Data":"0828e02870000200de6ce67c3eccd85fed823e244bc79a5b6a48e7620b7e3a7b"} Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.147976 5120 generic.go:358] "Generic (PLEG): container finished" podID="771204f4-c55f-4a6e-be63-70f3d1c8a51e" containerID="3a19d570305168b53a02c3d68205387f2601dd914bd1d418b04fabacd375394c" exitCode=143 Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.148067 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-87c8bf854-gkthd" event={"ID":"771204f4-c55f-4a6e-be63-70f3d1c8a51e","Type":"ContainerDied","Data":"3a19d570305168b53a02c3d68205387f2601dd914bd1d418b04fabacd375394c"} Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.149174 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.152400 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_47f6dea8-ee86-4de1-8bf7-3bbb7b5b4be1/ovsdbserver-nb/0.log" Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.152525 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.152558 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"47f6dea8-ee86-4de1-8bf7-3bbb7b5b4be1","Type":"ContainerDied","Data":"c396eab7cfd04a68e003754d0f4dbce9e0d796206e592cb2e89291a1722bd249"} Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.152611 5120 scope.go:117] "RemoveContainer" containerID="f9993e08b1a1c6e83a003533f2dc36cc32a4e662efefb4ae622f4ee6f0fd404e" Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.158753 5120 generic.go:358] "Generic (PLEG): container finished" podID="e15efd1b-6aa8-4a24-b576-4e03e19e19d0" containerID="e0f92a07b7fa6f808f45a98109ff109cb20b21840d1d05128661b849870c2178" exitCode=143 Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.158859 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/watcher-api-0" event={"ID":"e15efd1b-6aa8-4a24-b576-4e03e19e19d0","Type":"ContainerDied","Data":"e0f92a07b7fa6f808f45a98109ff109cb20b21840d1d05128661b849870c2178"} Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.160966 5120 generic.go:358] "Generic (PLEG): container finished" podID="d4b88a4e-143e-46bd-ada8-56dece11d6cc" containerID="d3796ecbe42b3beab0d0040cb2692ce8f22bdf760113ef0e8c3cfaa0ff2276f7" exitCode=143 Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.161044 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"d4b88a4e-143e-46bd-ada8-56dece11d6cc","Type":"ContainerDied","Data":"d3796ecbe42b3beab0d0040cb2692ce8f22bdf760113ef0e8c3cfaa0ff2276f7"} Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.164353 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-a8ac-account-create-update-lqmbd" event={"ID":"cf8c7b4f-8110-4b63-9022-2f9dcf3c1270","Type":"ContainerStarted","Data":"3b83fe95376c0a09b94288d189d42bd250d7e116f87a98905b778f9cf99bc523"} Mar 16 16:24:28 crc kubenswrapper[5120]: E0316 16:24:28.167993 5120 kuberuntime_manager.go:1358] "Unhandled Error" err=< Mar 16 16:24:28 crc kubenswrapper[5120]: container &Container{Name:mariadb-account-create-update,Image:quay.io/podified-antelope-centos9/openstack-mariadb@sha256:4caef2b55e01b9a7ee88a22bc69db1893521a91d95c7ad4c8e593f14f17a5f95,Command:[/bin/sh -c #!/bin/bash Mar 16 16:24:28 crc kubenswrapper[5120]: Mar 16 16:24:28 crc kubenswrapper[5120]: MYSQL_REMOTE_HOST="" source /var/lib/operator-scripts/mysql_root_auth.sh Mar 16 16:24:28 crc kubenswrapper[5120]: Mar 16 16:24:28 crc kubenswrapper[5120]: export DatabasePassword=${DatabasePassword:?"Please specify a DatabasePassword variable."} Mar 16 16:24:28 crc kubenswrapper[5120]: Mar 16 16:24:28 crc kubenswrapper[5120]: MYSQL_CMD="mysql -h -u root -P 3306" Mar 16 16:24:28 crc kubenswrapper[5120]: Mar 16 16:24:28 crc kubenswrapper[5120]: if [ -n "barbican" ]; then Mar 16 16:24:28 crc kubenswrapper[5120]: GRANT_DATABASE="barbican" Mar 16 16:24:28 crc kubenswrapper[5120]: else Mar 16 16:24:28 crc kubenswrapper[5120]: GRANT_DATABASE="*" Mar 16 16:24:28 crc kubenswrapper[5120]: fi Mar 16 16:24:28 crc kubenswrapper[5120]: Mar 16 16:24:28 crc kubenswrapper[5120]: # going for maximum compatibility here: Mar 16 16:24:28 crc kubenswrapper[5120]: # 1. MySQL 8 no longer allows implicit create user when GRANT is used Mar 16 16:24:28 crc kubenswrapper[5120]: # 2. MariaDB has "CREATE OR REPLACE", but MySQL does not Mar 16 16:24:28 crc kubenswrapper[5120]: # 3. create user with CREATE but then do all password and TLS with ALTER to Mar 16 16:24:28 crc kubenswrapper[5120]: # support updates Mar 16 16:24:28 crc kubenswrapper[5120]: Mar 16 16:24:28 crc kubenswrapper[5120]: $MYSQL_CMD < logger="UnhandledError" Mar 16 16:24:28 crc kubenswrapper[5120]: E0316 16:24:28.169065 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"mariadb-account-create-update\" with CreateContainerConfigError: \"secret \\\"barbican-db-secret\\\" not found\"" pod="openstack-kuttl-tests/barbican-a8ac-account-create-update-lqmbd" podUID="cf8c7b4f-8110-4b63-9022-2f9dcf3c1270" Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.173457 5120 generic.go:358] "Generic (PLEG): container finished" podID="3ea3fd85-7822-44e8-a112-9aec7d6f9a7c" containerID="dddf01fb2a62a299ce661c264a716a073896f253775f73284ef6259d80e680a7" exitCode=143 Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.173759 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"3ea3fd85-7822-44e8-a112-9aec7d6f9a7c","Type":"ContainerDied","Data":"dddf01fb2a62a299ce661c264a716a073896f253775f73284ef6259d80e680a7"} Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.177872 5120 generic.go:358] "Generic (PLEG): container finished" podID="11468616-1e2d-4cfd-b172-299b0cc33f6e" containerID="11ddd2a3e0b9e6341372082fc57fa83a45f334a4f158c1daef9d97c45b20424b" exitCode=143 Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.177977 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"11468616-1e2d-4cfd-b172-299b0cc33f6e","Type":"ContainerDied","Data":"11ddd2a3e0b9e6341372082fc57fa83a45f334a4f158c1daef9d97c45b20424b"} Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.186772 5120 scope.go:117] "RemoveContainer" containerID="c4e58989b0e4c03f55cfdda8d9b7d8a1793435113a8b45dcd1505218a190c874" Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.207895 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.220054 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.246589 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4c4d0f9a-4660-44c7-aa3c-4653612142bb-combined-ca-bundle\") pod \"4c4d0f9a-4660-44c7-aa3c-4653612142bb\" (UID: \"4c4d0f9a-4660-44c7-aa3c-4653612142bb\") " Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.253847 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/4c4d0f9a-4660-44c7-aa3c-4653612142bb-openstack-config\") pod \"4c4d0f9a-4660-44c7-aa3c-4653612142bb\" (UID: \"4c4d0f9a-4660-44c7-aa3c-4653612142bb\") " Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.253940 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ctbnz\" (UniqueName: \"kubernetes.io/projected/4c4d0f9a-4660-44c7-aa3c-4653612142bb-kube-api-access-ctbnz\") pod \"4c4d0f9a-4660-44c7-aa3c-4653612142bb\" (UID: \"4c4d0f9a-4660-44c7-aa3c-4653612142bb\") " Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.254262 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/4c4d0f9a-4660-44c7-aa3c-4653612142bb-openstack-config-secret\") pod \"4c4d0f9a-4660-44c7-aa3c-4653612142bb\" (UID: \"4c4d0f9a-4660-44c7-aa3c-4653612142bb\") " Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.288345 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-proxy-8698d79fbb-6czlj"] Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.289654 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-proxy-8698d79fbb-6czlj" podUID="90dbf97e-452f-4fce-8ceb-07fda29e83b8" containerName="proxy-server" containerID="cri-o://67cf881a6a854436edea224c7b420d193ade58ddc2a769579fe0b891879e4d9f" gracePeriod=30 Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.290154 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-proxy-8698d79fbb-6czlj" podUID="90dbf97e-452f-4fce-8ceb-07fda29e83b8" containerName="proxy-httpd" containerID="cri-o://69de27d7b1816f359b19d7db8ad34481405845a2709dc4483b84ffc8307ede29" gracePeriod=30 Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.306115 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c4d0f9a-4660-44c7-aa3c-4653612142bb-kube-api-access-ctbnz" (OuterVolumeSpecName: "kube-api-access-ctbnz") pod "4c4d0f9a-4660-44c7-aa3c-4653612142bb" (UID: "4c4d0f9a-4660-44c7-aa3c-4653612142bb"). InnerVolumeSpecName "kube-api-access-ctbnz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.338541 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c4d0f9a-4660-44c7-aa3c-4653612142bb-openstack-config" (OuterVolumeSpecName: "openstack-config") pod "4c4d0f9a-4660-44c7-aa3c-4653612142bb" (UID: "4c4d0f9a-4660-44c7-aa3c-4653612142bb"). InnerVolumeSpecName "openstack-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:24:28 crc kubenswrapper[5120]: E0316 16:24:28.359599 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 16:24:28 crc kubenswrapper[5120]: E0316 16:24:28.359665 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00712a43-f38b-478f-bd42-a8cb0c2c14b3-combined-ca-bundle podName:00712a43-f38b-478f-bd42-a8cb0c2c14b3 nodeName:}" failed. No retries permitted until 2026-03-16 16:24:29.359651677 +0000 UTC m=+3171.513583334 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/00712a43-f38b-478f-bd42-a8cb0c2c14b3-combined-ca-bundle") pod "nova-cell1-conductor-0" (UID: "00712a43-f38b-478f-bd42-a8cb0c2c14b3") : secret "combined-ca-bundle" not found Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.360018 5120 reconciler_common.go:299] "Volume detached for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/4c4d0f9a-4660-44c7-aa3c-4653612142bb-openstack-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.360037 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ctbnz\" (UniqueName: \"kubernetes.io/projected/4c4d0f9a-4660-44c7-aa3c-4653612142bb-kube-api-access-ctbnz\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.439850 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-b6ca-account-create-update-zpt89"] Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.473569 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-b6ca-account-create-update-zpt89"] Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.537118 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-b6ca-account-create-update-t6nc4"] Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.538211 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47f6dea8-ee86-4de1-8bf7-3bbb7b5b4be1" containerName="ovsdbserver-nb" Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.538225 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="47f6dea8-ee86-4de1-8bf7-3bbb7b5b4be1" containerName="ovsdbserver-nb" Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.538290 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47f6dea8-ee86-4de1-8bf7-3bbb7b5b4be1" containerName="openstack-network-exporter" Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.538297 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="47f6dea8-ee86-4de1-8bf7-3bbb7b5b4be1" containerName="openstack-network-exporter" Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.538507 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="47f6dea8-ee86-4de1-8bf7-3bbb7b5b4be1" containerName="ovsdbserver-nb" Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.538522 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="47f6dea8-ee86-4de1-8bf7-3bbb7b5b4be1" containerName="openstack-network-exporter" Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.554597 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-b6ca-account-create-update-t6nc4" Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.560034 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-db-secret\"" Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.564461 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c4d0f9a-4660-44c7-aa3c-4653612142bb-openstack-config-secret" (OuterVolumeSpecName: "openstack-config-secret") pod "4c4d0f9a-4660-44c7-aa3c-4653612142bb" (UID: "4c4d0f9a-4660-44c7-aa3c-4653612142bb"). InnerVolumeSpecName "openstack-config-secret". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.565860 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-b6ca-account-create-update-t6nc4"] Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.593224 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rlkqb\" (UniqueName: \"kubernetes.io/projected/93507a7d-d4a9-4f98-aca5-30020461118a-kube-api-access-rlkqb\") pod \"keystone-b6ca-account-create-update-t6nc4\" (UID: \"93507a7d-d4a9-4f98-aca5-30020461118a\") " pod="openstack-kuttl-tests/keystone-b6ca-account-create-update-t6nc4" Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.593304 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/93507a7d-d4a9-4f98-aca5-30020461118a-operator-scripts\") pod \"keystone-b6ca-account-create-update-t6nc4\" (UID: \"93507a7d-d4a9-4f98-aca5-30020461118a\") " pod="openstack-kuttl-tests/keystone-b6ca-account-create-update-t6nc4" Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.593459 5120 reconciler_common.go:299] "Volume detached for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/4c4d0f9a-4660-44c7-aa3c-4653612142bb-openstack-config-secret\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.628284 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c4d0f9a-4660-44c7-aa3c-4653612142bb-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "4c4d0f9a-4660-44c7-aa3c-4653612142bb" (UID: "4c4d0f9a-4660-44c7-aa3c-4653612142bb"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.632527 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-pchr5"] Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.695783 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rlkqb\" (UniqueName: \"kubernetes.io/projected/93507a7d-d4a9-4f98-aca5-30020461118a-kube-api-access-rlkqb\") pod \"keystone-b6ca-account-create-update-t6nc4\" (UID: \"93507a7d-d4a9-4f98-aca5-30020461118a\") " pod="openstack-kuttl-tests/keystone-b6ca-account-create-update-t6nc4" Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.696506 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/93507a7d-d4a9-4f98-aca5-30020461118a-operator-scripts\") pod \"keystone-b6ca-account-create-update-t6nc4\" (UID: \"93507a7d-d4a9-4f98-aca5-30020461118a\") " pod="openstack-kuttl-tests/keystone-b6ca-account-create-update-t6nc4" Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.697257 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4c4d0f9a-4660-44c7-aa3c-4653612142bb-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:28 crc kubenswrapper[5120]: E0316 16:24:28.699899 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Mar 16 16:24:28 crc kubenswrapper[5120]: E0316 16:24:28.700078 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/93507a7d-d4a9-4f98-aca5-30020461118a-operator-scripts podName:93507a7d-d4a9-4f98-aca5-30020461118a nodeName:}" failed. No retries permitted until 2026-03-16 16:24:29.200062782 +0000 UTC m=+3171.353994439 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/93507a7d-d4a9-4f98-aca5-30020461118a-operator-scripts") pod "keystone-b6ca-account-create-update-t6nc4" (UID: "93507a7d-d4a9-4f98-aca5-30020461118a") : configmap "openstack-scripts" not found Mar 16 16:24:28 crc kubenswrapper[5120]: E0316 16:24:28.704478 5120 projected.go:194] Error preparing data for projected volume kube-api-access-rlkqb for pod openstack-kuttl-tests/keystone-b6ca-account-create-update-t6nc4: failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 16:24:28 crc kubenswrapper[5120]: E0316 16:24:28.704611 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/93507a7d-d4a9-4f98-aca5-30020461118a-kube-api-access-rlkqb podName:93507a7d-d4a9-4f98-aca5-30020461118a nodeName:}" failed. No retries permitted until 2026-03-16 16:24:29.204599503 +0000 UTC m=+3171.358531160 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-rlkqb" (UniqueName: "kubernetes.io/projected/93507a7d-d4a9-4f98-aca5-30020461118a-kube-api-access-rlkqb") pod "keystone-b6ca-account-create-update-t6nc4" (UID: "93507a7d-d4a9-4f98-aca5-30020461118a") : failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.715318 5120 status_manager.go:895] "Failed to get status for pod" podUID="bbcf321a-a331-4e3a-96f2-90af1aa2d619" pod="openstack-kuttl-tests/keystone-bootstrap-pchr5" err="pods \"keystone-bootstrap-pchr5\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.772843 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="098bebf2-f1d9-4af9-a09c-10f7d6be8761" path="/var/lib/kubelet/pods/098bebf2-f1d9-4af9-a09c-10f7d6be8761/volumes" Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.773965 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0deba017-f115-4b42-8695-63cbe951fb08" path="/var/lib/kubelet/pods/0deba017-f115-4b42-8695-63cbe951fb08/volumes" Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.774642 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4710f915-4683-4e68-b1e1-ec9143e2331c" path="/var/lib/kubelet/pods/4710f915-4683-4e68-b1e1-ec9143e2331c/volumes" Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.776949 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="47f6dea8-ee86-4de1-8bf7-3bbb7b5b4be1" path="/var/lib/kubelet/pods/47f6dea8-ee86-4de1-8bf7-3bbb7b5b4be1/volumes" Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.778262 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c4d0f9a-4660-44c7-aa3c-4653612142bb" path="/var/lib/kubelet/pods/4c4d0f9a-4660-44c7-aa3c-4653612142bb/volumes" Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.782587 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5da55de8-8d9d-4e87-a022-c3c0b95403bf" path="/var/lib/kubelet/pods/5da55de8-8d9d-4e87-a022-c3c0b95403bf/volumes" Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.783208 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="75f1b7f4-9fac-4135-819b-8eab79df5cf9" path="/var/lib/kubelet/pods/75f1b7f4-9fac-4135-819b-8eab79df5cf9/volumes" Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.790415 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7ae11e5d-88eb-4be1-8936-985a2daadef0" path="/var/lib/kubelet/pods/7ae11e5d-88eb-4be1-8936-985a2daadef0/volumes" Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.791347 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="803bf3cd-94da-4de9-a2c1-c92bb5453589" path="/var/lib/kubelet/pods/803bf3cd-94da-4de9-a2c1-c92bb5453589/volumes" Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.791914 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="832b7d40-7b24-49a1-9247-e10c8747b7ff" path="/var/lib/kubelet/pods/832b7d40-7b24-49a1-9247-e10c8747b7ff/volumes" Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.793311 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8539dbb8-688e-4007-a0ed-268b58f3b39a" path="/var/lib/kubelet/pods/8539dbb8-688e-4007-a0ed-268b58f3b39a/volumes" Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.793920 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8d540ae4-9eb1-4540-bb5b-4035063b47ca" path="/var/lib/kubelet/pods/8d540ae4-9eb1-4540-bb5b-4035063b47ca/volumes" Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.794469 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9efd76f8-2676-4522-900e-ade9c74942aa" path="/var/lib/kubelet/pods/9efd76f8-2676-4522-900e-ade9c74942aa/volumes" Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.795659 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bea1d61f-54be-4e9e-ae9f-9cd209757cd5" path="/var/lib/kubelet/pods/bea1d61f-54be-4e9e-ae9f-9cd209757cd5/volumes" Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.796348 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e0d63296-b495-418b-937b-3de15045b5c2" path="/var/lib/kubelet/pods/e0d63296-b495-418b-937b-3de15045b5c2/volumes" Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.799072 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e9495774-461a-413a-97a3-d348c402a717" path="/var/lib/kubelet/pods/e9495774-461a-413a-97a3-d348c402a717/volumes" Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.799621 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ecd9da24-f35b-48a1-80a4-47e1557b4e0d" path="/var/lib/kubelet/pods/ecd9da24-f35b-48a1-80a4-47e1557b4e0d/volumes" Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.800973 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f157f8fd-51e4-4948-9a15-8c5da242ae97" path="/var/lib/kubelet/pods/f157f8fd-51e4-4948-9a15-8c5da242ae97/volumes" Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.802711 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-pchr5"] Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.802841 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-pq7q8"] Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.848157 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-pq7q8"] Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.873849 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-7bc85bbbf-4ttl9"] Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.874136 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/keystone-7bc85bbbf-4ttl9" podUID="7b05ec0c-8f80-4a86-8823-629c4e953395" containerName="keystone-api" containerID="cri-o://48370642f51fb950140c497068c7d992955ae7d6047b48a68307501d1a50da67" gracePeriod=30 Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.917493 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.927941 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.944373 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-db-create-5jzgn"] Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.963820 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-db-create-5jzgn"] Mar 16 16:24:28 crc kubenswrapper[5120]: I0316 16:24:28.993952 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-b6ca-account-create-update-t6nc4"] Mar 16 16:24:28 crc kubenswrapper[5120]: E0316 16:24:28.994805 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-rlkqb operator-scripts], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openstack-kuttl-tests/keystone-b6ca-account-create-update-t6nc4" podUID="93507a7d-d4a9-4f98-aca5-30020461118a" Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.006578 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q2hht\" (UniqueName: \"kubernetes.io/projected/93d56b12-9c96-48fa-9343-4a12d639b8a3-kube-api-access-q2hht\") pod \"93d56b12-9c96-48fa-9343-4a12d639b8a3\" (UID: \"93d56b12-9c96-48fa-9343-4a12d639b8a3\") " Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.007594 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/93d56b12-9c96-48fa-9343-4a12d639b8a3-kube-state-metrics-tls-certs\") pod \"93d56b12-9c96-48fa-9343-4a12d639b8a3\" (UID: \"93d56b12-9c96-48fa-9343-4a12d639b8a3\") " Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.007622 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/93d56b12-9c96-48fa-9343-4a12d639b8a3-combined-ca-bundle\") pod \"93d56b12-9c96-48fa-9343-4a12d639b8a3\" (UID: \"93d56b12-9c96-48fa-9343-4a12d639b8a3\") " Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.008138 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/93d56b12-9c96-48fa-9343-4a12d639b8a3-kube-state-metrics-tls-config\") pod \"93d56b12-9c96-48fa-9343-4a12d639b8a3\" (UID: \"93d56b12-9c96-48fa-9343-4a12d639b8a3\") " Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.017892 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-rvrb7"] Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.052132 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93d56b12-9c96-48fa-9343-4a12d639b8a3-kube-api-access-q2hht" (OuterVolumeSpecName: "kube-api-access-q2hht") pod "93d56b12-9c96-48fa-9343-4a12d639b8a3" (UID: "93d56b12-9c96-48fa-9343-4a12d639b8a3"). InnerVolumeSpecName "kube-api-access-q2hht". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.052223 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93d56b12-9c96-48fa-9343-4a12d639b8a3-kube-state-metrics-tls-config" (OuterVolumeSpecName: "kube-state-metrics-tls-config") pod "93d56b12-9c96-48fa-9343-4a12d639b8a3" (UID: "93d56b12-9c96-48fa-9343-4a12d639b8a3"). InnerVolumeSpecName "kube-state-metrics-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.061198 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93d56b12-9c96-48fa-9343-4a12d639b8a3-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "93d56b12-9c96-48fa-9343-4a12d639b8a3" (UID: "93d56b12-9c96-48fa-9343-4a12d639b8a3"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.080884 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93d56b12-9c96-48fa-9343-4a12d639b8a3-kube-state-metrics-tls-certs" (OuterVolumeSpecName: "kube-state-metrics-tls-certs") pod "93d56b12-9c96-48fa-9343-4a12d639b8a3" (UID: "93d56b12-9c96-48fa-9343-4a12d639b8a3"). InnerVolumeSpecName "kube-state-metrics-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.114275 5120 reconciler_common.go:299] "Volume detached for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/93d56b12-9c96-48fa-9343-4a12d639b8a3-kube-state-metrics-tls-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.114308 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q2hht\" (UniqueName: \"kubernetes.io/projected/93d56b12-9c96-48fa-9343-4a12d639b8a3-kube-api-access-q2hht\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.114318 5120 reconciler_common.go:299] "Volume detached for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/93d56b12-9c96-48fa-9343-4a12d639b8a3-kube-state-metrics-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.114329 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/93d56b12-9c96-48fa-9343-4a12d639b8a3-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.204455 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/openstack-galera-0" podUID="9185c9ac-7b26-4bbc-be42-545c166ba2c8" containerName="galera" containerID="cri-o://adf00bc598caf7fd100ad6d9a04dd18b37b6a59bdd16122c1c463bf65b466e55" gracePeriod=30 Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.216241 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rlkqb\" (UniqueName: \"kubernetes.io/projected/93507a7d-d4a9-4f98-aca5-30020461118a-kube-api-access-rlkqb\") pod \"keystone-b6ca-account-create-update-t6nc4\" (UID: \"93507a7d-d4a9-4f98-aca5-30020461118a\") " pod="openstack-kuttl-tests/keystone-b6ca-account-create-update-t6nc4" Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.216315 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/93507a7d-d4a9-4f98-aca5-30020461118a-operator-scripts\") pod \"keystone-b6ca-account-create-update-t6nc4\" (UID: \"93507a7d-d4a9-4f98-aca5-30020461118a\") " pod="openstack-kuttl-tests/keystone-b6ca-account-create-update-t6nc4" Mar 16 16:24:29 crc kubenswrapper[5120]: E0316 16:24:29.216565 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Mar 16 16:24:29 crc kubenswrapper[5120]: E0316 16:24:29.216646 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/93507a7d-d4a9-4f98-aca5-30020461118a-operator-scripts podName:93507a7d-d4a9-4f98-aca5-30020461118a nodeName:}" failed. No retries permitted until 2026-03-16 16:24:30.216623199 +0000 UTC m=+3172.370554856 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/93507a7d-d4a9-4f98-aca5-30020461118a-operator-scripts") pod "keystone-b6ca-account-create-update-t6nc4" (UID: "93507a7d-d4a9-4f98-aca5-30020461118a") : configmap "openstack-scripts" not found Mar 16 16:24:29 crc kubenswrapper[5120]: E0316 16:24:29.226130 5120 projected.go:194] Error preparing data for projected volume kube-api-access-rlkqb for pod openstack-kuttl-tests/keystone-b6ca-account-create-update-t6nc4: failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 16:24:29 crc kubenswrapper[5120]: E0316 16:24:29.226202 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/93507a7d-d4a9-4f98-aca5-30020461118a-kube-api-access-rlkqb podName:93507a7d-d4a9-4f98-aca5-30020461118a nodeName:}" failed. No retries permitted until 2026-03-16 16:24:30.226184794 +0000 UTC m=+3172.380116451 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-rlkqb" (UniqueName: "kubernetes.io/projected/93507a7d-d4a9-4f98-aca5-30020461118a-kube-api-access-rlkqb") pod "keystone-b6ca-account-create-update-t6nc4" (UID: "93507a7d-d4a9-4f98-aca5-30020461118a") : failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.244641 5120 generic.go:358] "Generic (PLEG): container finished" podID="69c47154-7063-4a88-af54-c4dba11e7fd6" containerID="b28880e5a05a573108be1a0e941930a878933df93431db8ee6799513224cdd63" exitCode=143 Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.244747 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-85c89c7f6-6429v" event={"ID":"69c47154-7063-4a88-af54-c4dba11e7fd6","Type":"ContainerDied","Data":"b28880e5a05a573108be1a0e941930a878933df93431db8ee6799513224cdd63"} Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.246454 5120 generic.go:358] "Generic (PLEG): container finished" podID="93d56b12-9c96-48fa-9343-4a12d639b8a3" containerID="e155ab44ab0e81f14000fc0d43ea6be46487802295ab78a807b123db0cfeb8df" exitCode=2 Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.246590 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"93d56b12-9c96-48fa-9343-4a12d639b8a3","Type":"ContainerDied","Data":"e155ab44ab0e81f14000fc0d43ea6be46487802295ab78a807b123db0cfeb8df"} Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.246611 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"93d56b12-9c96-48fa-9343-4a12d639b8a3","Type":"ContainerDied","Data":"f40a7be673c3adaf8cbf65b368450993353921214da360f566ffdf28d9868ca7"} Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.246630 5120 scope.go:117] "RemoveContainer" containerID="e155ab44ab0e81f14000fc0d43ea6be46487802295ab78a807b123db0cfeb8df" Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.246744 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.277964 5120 generic.go:358] "Generic (PLEG): container finished" podID="8558eb14-801e-455b-8374-1c69e333901c" containerID="d7c153224a3bf3e6347984cb47aae3cd6b8bb54fa6f5bb003cfe5e0fc882319e" exitCode=143 Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.278223 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-6f68c75449-s4d7j" event={"ID":"8558eb14-801e-455b-8374-1c69e333901c","Type":"ContainerDied","Data":"d7c153224a3bf3e6347984cb47aae3cd6b8bb54fa6f5bb003cfe5e0fc882319e"} Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.286933 5120 generic.go:358] "Generic (PLEG): container finished" podID="90dbf97e-452f-4fce-8ceb-07fda29e83b8" containerID="67cf881a6a854436edea224c7b420d193ade58ddc2a769579fe0b891879e4d9f" exitCode=0 Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.286959 5120 generic.go:358] "Generic (PLEG): container finished" podID="90dbf97e-452f-4fce-8ceb-07fda29e83b8" containerID="69de27d7b1816f359b19d7db8ad34481405845a2709dc4483b84ffc8307ede29" exitCode=0 Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.287043 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-8698d79fbb-6czlj" event={"ID":"90dbf97e-452f-4fce-8ceb-07fda29e83b8","Type":"ContainerDied","Data":"67cf881a6a854436edea224c7b420d193ade58ddc2a769579fe0b891879e4d9f"} Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.287068 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-8698d79fbb-6czlj" event={"ID":"90dbf97e-452f-4fce-8ceb-07fda29e83b8","Type":"ContainerDied","Data":"69de27d7b1816f359b19d7db8ad34481405845a2709dc4483b84ffc8307ede29"} Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.293949 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.296205 5120 generic.go:358] "Generic (PLEG): container finished" podID="ecdbe440-4557-4298-b0b7-e2e89958bf07" containerID="2e47d1a1b6ef394c9e4f761ae69ebb45114b8cfb8609be386af11e1fb6adb4e3" exitCode=143 Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.296320 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-6bf46d9f46-cv8dx" event={"ID":"ecdbe440-4557-4298-b0b7-e2e89958bf07","Type":"ContainerDied","Data":"2e47d1a1b6ef394c9e4f761ae69ebb45114b8cfb8609be386af11e1fb6adb4e3"} Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.301165 5120 generic.go:358] "Generic (PLEG): container finished" podID="436edb75-475a-4096-a9c9-bf235fc92d9c" containerID="2a896000e70dd7124ec92af5c96ae6d01ec902505892d014e791fed3fbdfa390" exitCode=0 Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.301279 5120 generic.go:358] "Generic (PLEG): container finished" podID="436edb75-475a-4096-a9c9-bf235fc92d9c" containerID="1bba6ac3aa0cc48a80a5395897ea292ab61046d1fda826d5eb20948de324115b" exitCode=0 Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.301359 5120 generic.go:358] "Generic (PLEG): container finished" podID="436edb75-475a-4096-a9c9-bf235fc92d9c" containerID="533af2cb60162ddbab3651bb11e174e85e24fca07c3ffcfd31f3cbe35830d8bd" exitCode=0 Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.301564 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/prometheus-metric-storage-0" event={"ID":"436edb75-475a-4096-a9c9-bf235fc92d9c","Type":"ContainerDied","Data":"2a896000e70dd7124ec92af5c96ae6d01ec902505892d014e791fed3fbdfa390"} Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.301678 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/prometheus-metric-storage-0" event={"ID":"436edb75-475a-4096-a9c9-bf235fc92d9c","Type":"ContainerDied","Data":"1bba6ac3aa0cc48a80a5395897ea292ab61046d1fda826d5eb20948de324115b"} Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.301762 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/prometheus-metric-storage-0" event={"ID":"436edb75-475a-4096-a9c9-bf235fc92d9c","Type":"ContainerDied","Data":"533af2cb60162ddbab3651bb11e174e85e24fca07c3ffcfd31f3cbe35830d8bd"} Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.305348 5120 generic.go:358] "Generic (PLEG): container finished" podID="bd019f3d-1483-40e4-9534-b8bd551ed652" containerID="7f7b09d62f8584e17ded7110727a79828e5c99e561c9bf5cd643aa5cc1c74758" exitCode=0 Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.305430 5120 generic.go:358] "Generic (PLEG): container finished" podID="bd019f3d-1483-40e4-9534-b8bd551ed652" containerID="6b5a370e0ffa16e0b998b02a52647c91125ab7a84492ad3a7f1d5d5a529919e7" exitCode=2 Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.305502 5120 generic.go:358] "Generic (PLEG): container finished" podID="bd019f3d-1483-40e4-9534-b8bd551ed652" containerID="482e3be4b8e8664bade0b2a681aa7e0b736487e8b6c01fc03edf8ad396dc6ad3" exitCode=0 Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.305761 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"bd019f3d-1483-40e4-9534-b8bd551ed652","Type":"ContainerDied","Data":"7f7b09d62f8584e17ded7110727a79828e5c99e561c9bf5cd643aa5cc1c74758"} Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.305929 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"bd019f3d-1483-40e4-9534-b8bd551ed652","Type":"ContainerDied","Data":"6b5a370e0ffa16e0b998b02a52647c91125ab7a84492ad3a7f1d5d5a529919e7"} Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.305995 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"bd019f3d-1483-40e4-9534-b8bd551ed652","Type":"ContainerDied","Data":"482e3be4b8e8664bade0b2a681aa7e0b736487e8b6c01fc03edf8ad396dc6ad3"} Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.311187 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.316508 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/prometheus-metric-storage-0" Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.322247 5120 generic.go:358] "Generic (PLEG): container finished" podID="9b43ebee-5f04-44e0-a8bf-56f70871894e" containerID="b1a722f653ecb9a8de687b89024aff31dbebdf8af7ee495b08f3d6c4416ffed9" exitCode=0 Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.322677 5120 generic.go:358] "Generic (PLEG): container finished" podID="9b43ebee-5f04-44e0-a8bf-56f70871894e" containerID="d174f547bf24ef444cb7eb8748c654dbe1df34b53324eb8a10d06c56c02dec63" exitCode=0 Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.322728 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/alertmanager-metric-storage-0" event={"ID":"9b43ebee-5f04-44e0-a8bf-56f70871894e","Type":"ContainerDied","Data":"b1a722f653ecb9a8de687b89024aff31dbebdf8af7ee495b08f3d6c4416ffed9"} Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.322826 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/alertmanager-metric-storage-0" event={"ID":"9b43ebee-5f04-44e0-a8bf-56f70871894e","Type":"ContainerDied","Data":"d174f547bf24ef444cb7eb8748c654dbe1df34b53324eb8a10d06c56c02dec63"} Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.324179 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.326302 5120 generic.go:358] "Generic (PLEG): container finished" podID="86686d29-4c19-43e3-97a8-d8373883dc6a" containerID="f9a9d791d1443678d4a2c23479b8e11b6f560a185ffc34e35391ec6238b9ab79" exitCode=1 Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.326410 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-b6ca-account-create-update-t6nc4" Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.327208 5120 kubelet_pods.go:1019] "Unable to retrieve pull secret, the image pull may not succeed." pod="openstack-kuttl-tests/root-account-create-update-rvrb7" secret="" err="secret \"galera-openstack-dockercfg-78xm6\" not found" Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.327247 5120 scope.go:117] "RemoveContainer" containerID="f9a9d791d1443678d4a2c23479b8e11b6f560a185ffc34e35391ec6238b9ab79" Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.327809 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-rvrb7" event={"ID":"86686d29-4c19-43e3-97a8-d8373883dc6a","Type":"ContainerDied","Data":"f9a9d791d1443678d4a2c23479b8e11b6f560a185ffc34e35391ec6238b9ab79"} Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.333223 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-q5hqq"] Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.339958 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-b6ca-account-create-update-t6nc4" Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.342249 5120 scope.go:117] "RemoveContainer" containerID="e155ab44ab0e81f14000fc0d43ea6be46487802295ab78a807b123db0cfeb8df" Mar 16 16:24:29 crc kubenswrapper[5120]: E0316 16:24:29.342553 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e155ab44ab0e81f14000fc0d43ea6be46487802295ab78a807b123db0cfeb8df\": container with ID starting with e155ab44ab0e81f14000fc0d43ea6be46487802295ab78a807b123db0cfeb8df not found: ID does not exist" containerID="e155ab44ab0e81f14000fc0d43ea6be46487802295ab78a807b123db0cfeb8df" Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.342580 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e155ab44ab0e81f14000fc0d43ea6be46487802295ab78a807b123db0cfeb8df"} err="failed to get container status \"e155ab44ab0e81f14000fc0d43ea6be46487802295ab78a807b123db0cfeb8df\": rpc error: code = NotFound desc = could not find container \"e155ab44ab0e81f14000fc0d43ea6be46487802295ab78a807b123db0cfeb8df\": container with ID starting with e155ab44ab0e81f14000fc0d43ea6be46487802295ab78a807b123db0cfeb8df not found: ID does not exist" Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.342600 5120 scope.go:117] "RemoveContainer" containerID="96164b8ea75d052b461cddb068f1640ceb2bc89fadd9423f78383162a3347b9f" Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.372211 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/alertmanager-metric-storage-0" Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.419191 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9b43ebee-5f04-44e0-a8bf-56f70871894e-tls-assets\") pod \"9b43ebee-5f04-44e0-a8bf-56f70871894e\" (UID: \"9b43ebee-5f04-44e0-a8bf-56f70871894e\") " Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.419338 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9b43ebee-5f04-44e0-a8bf-56f70871894e-web-config\") pod \"9b43ebee-5f04-44e0-a8bf-56f70871894e\" (UID: \"9b43ebee-5f04-44e0-a8bf-56f70871894e\") " Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.419450 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-metric-storage-db\" (UniqueName: \"kubernetes.io/empty-dir/9b43ebee-5f04-44e0-a8bf-56f70871894e-alertmanager-metric-storage-db\") pod \"9b43ebee-5f04-44e0-a8bf-56f70871894e\" (UID: \"9b43ebee-5f04-44e0-a8bf-56f70871894e\") " Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.419522 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-metric-storage-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/436edb75-475a-4096-a9c9-bf235fc92d9c-prometheus-metric-storage-rulefiles-2\") pod \"436edb75-475a-4096-a9c9-bf235fc92d9c\" (UID: \"436edb75-475a-4096-a9c9-bf235fc92d9c\") " Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.419633 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-metric-storage-db\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"436edb75-475a-4096-a9c9-bf235fc92d9c\" (UID: \"436edb75-475a-4096-a9c9-bf235fc92d9c\") " Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.419765 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9b43ebee-5f04-44e0-a8bf-56f70871894e-cluster-tls-config\") pod \"9b43ebee-5f04-44e0-a8bf-56f70871894e\" (UID: \"9b43ebee-5f04-44e0-a8bf-56f70871894e\") " Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.419995 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/436edb75-475a-4096-a9c9-bf235fc92d9c-config-out\") pod \"436edb75-475a-4096-a9c9-bf235fc92d9c\" (UID: \"436edb75-475a-4096-a9c9-bf235fc92d9c\") " Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.420140 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/436edb75-475a-4096-a9c9-bf235fc92d9c-thanos-prometheus-http-client-file\") pod \"436edb75-475a-4096-a9c9-bf235fc92d9c\" (UID: \"436edb75-475a-4096-a9c9-bf235fc92d9c\") " Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.420248 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9b43ebee-5f04-44e0-a8bf-56f70871894e-config-out\") pod \"9b43ebee-5f04-44e0-a8bf-56f70871894e\" (UID: \"9b43ebee-5f04-44e0-a8bf-56f70871894e\") " Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.420460 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/436edb75-475a-4096-a9c9-bf235fc92d9c-tls-assets\") pod \"436edb75-475a-4096-a9c9-bf235fc92d9c\" (UID: \"436edb75-475a-4096-a9c9-bf235fc92d9c\") " Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.420560 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-metric-storage-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/436edb75-475a-4096-a9c9-bf235fc92d9c-prometheus-metric-storage-rulefiles-0\") pod \"436edb75-475a-4096-a9c9-bf235fc92d9c\" (UID: \"436edb75-475a-4096-a9c9-bf235fc92d9c\") " Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.420695 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z62jk\" (UniqueName: \"kubernetes.io/projected/436edb75-475a-4096-a9c9-bf235fc92d9c-kube-api-access-z62jk\") pod \"436edb75-475a-4096-a9c9-bf235fc92d9c\" (UID: \"436edb75-475a-4096-a9c9-bf235fc92d9c\") " Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.420832 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9b43ebee-5f04-44e0-a8bf-56f70871894e-config-volume\") pod \"9b43ebee-5f04-44e0-a8bf-56f70871894e\" (UID: \"9b43ebee-5f04-44e0-a8bf-56f70871894e\") " Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.421007 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/436edb75-475a-4096-a9c9-bf235fc92d9c-config\") pod \"436edb75-475a-4096-a9c9-bf235fc92d9c\" (UID: \"436edb75-475a-4096-a9c9-bf235fc92d9c\") " Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.421242 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-glqjf\" (UniqueName: \"kubernetes.io/projected/9b43ebee-5f04-44e0-a8bf-56f70871894e-kube-api-access-glqjf\") pod \"9b43ebee-5f04-44e0-a8bf-56f70871894e\" (UID: \"9b43ebee-5f04-44e0-a8bf-56f70871894e\") " Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.421454 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/436edb75-475a-4096-a9c9-bf235fc92d9c-web-config\") pod \"436edb75-475a-4096-a9c9-bf235fc92d9c\" (UID: \"436edb75-475a-4096-a9c9-bf235fc92d9c\") " Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.421560 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/436edb75-475a-4096-a9c9-bf235fc92d9c-secret-combined-ca-bundle\") pod \"436edb75-475a-4096-a9c9-bf235fc92d9c\" (UID: \"436edb75-475a-4096-a9c9-bf235fc92d9c\") " Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.421697 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config-tls-secret-key-cert-metric-storage-promethe-dc638c2d\" (UniqueName: \"kubernetes.io/secret/436edb75-475a-4096-a9c9-bf235fc92d9c-web-config-tls-secret-key-cert-metric-storage-promethe-dc638c2d\") pod \"436edb75-475a-4096-a9c9-bf235fc92d9c\" (UID: \"436edb75-475a-4096-a9c9-bf235fc92d9c\") " Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.421800 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config-tls-secret-cert-cert-metric-storage-prometh-dc638c2d\" (UniqueName: \"kubernetes.io/secret/436edb75-475a-4096-a9c9-bf235fc92d9c-web-config-tls-secret-cert-cert-metric-storage-prometh-dc638c2d\") pod \"436edb75-475a-4096-a9c9-bf235fc92d9c\" (UID: \"436edb75-475a-4096-a9c9-bf235fc92d9c\") " Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.422126 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-metric-storage-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/436edb75-475a-4096-a9c9-bf235fc92d9c-prometheus-metric-storage-rulefiles-1\") pod \"436edb75-475a-4096-a9c9-bf235fc92d9c\" (UID: \"436edb75-475a-4096-a9c9-bf235fc92d9c\") " Mar 16 16:24:29 crc kubenswrapper[5120]: E0316 16:24:29.422946 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/barbican-config-data: secret "barbican-config-data" not found Mar 16 16:24:29 crc kubenswrapper[5120]: E0316 16:24:29.423112 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69c47154-7063-4a88-af54-c4dba11e7fd6-config-data podName:69c47154-7063-4a88-af54-c4dba11e7fd6 nodeName:}" failed. No retries permitted until 2026-03-16 16:24:33.423096582 +0000 UTC m=+3175.577028239 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/secret/69c47154-7063-4a88-af54-c4dba11e7fd6-config-data") pod "barbican-api-85c89c7f6-6429v" (UID: "69c47154-7063-4a88-af54-c4dba11e7fd6") : secret "barbican-config-data" not found Mar 16 16:24:29 crc kubenswrapper[5120]: E0316 16:24:29.424501 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="ce0a8bde470adeb57224c167d670364e256b6b1b5b4d78dd8410053f53d53467" cmd=["/usr/bin/pgrep","-r","DRST","watcher-applier"] Mar 16 16:24:29 crc kubenswrapper[5120]: E0316 16:24:29.425049 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 16:24:29 crc kubenswrapper[5120]: E0316 16:24:29.426568 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69c47154-7063-4a88-af54-c4dba11e7fd6-combined-ca-bundle podName:69c47154-7063-4a88-af54-c4dba11e7fd6 nodeName:}" failed. No retries permitted until 2026-03-16 16:24:33.426551924 +0000 UTC m=+3175.580483581 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/69c47154-7063-4a88-af54-c4dba11e7fd6-combined-ca-bundle") pod "barbican-api-85c89c7f6-6429v" (UID: "69c47154-7063-4a88-af54-c4dba11e7fd6") : secret "combined-ca-bundle" not found Mar 16 16:24:29 crc kubenswrapper[5120]: E0316 16:24:29.426982 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 16:24:29 crc kubenswrapper[5120]: E0316 16:24:29.427090 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00712a43-f38b-478f-bd42-a8cb0c2c14b3-combined-ca-bundle podName:00712a43-f38b-478f-bd42-a8cb0c2c14b3 nodeName:}" failed. No retries permitted until 2026-03-16 16:24:31.427080427 +0000 UTC m=+3173.581012084 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/00712a43-f38b-478f-bd42-a8cb0c2c14b3-combined-ca-bundle") pod "nova-cell1-conductor-0" (UID: "00712a43-f38b-478f-bd42-a8cb0c2c14b3") : secret "combined-ca-bundle" not found Mar 16 16:24:29 crc kubenswrapper[5120]: E0316 16:24:29.427182 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Mar 16 16:24:29 crc kubenswrapper[5120]: E0316 16:24:29.427257 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/86686d29-4c19-43e3-97a8-d8373883dc6a-operator-scripts podName:86686d29-4c19-43e3-97a8-d8373883dc6a nodeName:}" failed. No retries permitted until 2026-03-16 16:24:29.927249073 +0000 UTC m=+3172.081180730 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/86686d29-4c19-43e3-97a8-d8373883dc6a-operator-scripts") pod "root-account-create-update-rvrb7" (UID: "86686d29-4c19-43e3-97a8-d8373883dc6a") : configmap "openstack-scripts" not found Mar 16 16:24:29 crc kubenswrapper[5120]: E0316 16:24:29.427430 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-barbican-internal-svc: secret "cert-barbican-internal-svc" not found Mar 16 16:24:29 crc kubenswrapper[5120]: E0316 16:24:29.427515 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69c47154-7063-4a88-af54-c4dba11e7fd6-internal-tls-certs podName:69c47154-7063-4a88-af54-c4dba11e7fd6 nodeName:}" failed. No retries permitted until 2026-03-16 16:24:33.427492389 +0000 UTC m=+3175.581424046 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/69c47154-7063-4a88-af54-c4dba11e7fd6-internal-tls-certs") pod "barbican-api-85c89c7f6-6429v" (UID: "69c47154-7063-4a88-af54-c4dba11e7fd6") : secret "cert-barbican-internal-svc" not found Mar 16 16:24:29 crc kubenswrapper[5120]: E0316 16:24:29.428327 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-barbican-public-svc: secret "cert-barbican-public-svc" not found Mar 16 16:24:29 crc kubenswrapper[5120]: E0316 16:24:29.428416 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69c47154-7063-4a88-af54-c4dba11e7fd6-public-tls-certs podName:69c47154-7063-4a88-af54-c4dba11e7fd6 nodeName:}" failed. No retries permitted until 2026-03-16 16:24:33.428389242 +0000 UTC m=+3175.582320899 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/69c47154-7063-4a88-af54-c4dba11e7fd6-public-tls-certs") pod "barbican-api-85c89c7f6-6429v" (UID: "69c47154-7063-4a88-af54-c4dba11e7fd6") : secret "cert-barbican-public-svc" not found Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.428633 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/436edb75-475a-4096-a9c9-bf235fc92d9c-prometheus-metric-storage-rulefiles-2" (OuterVolumeSpecName: "prometheus-metric-storage-rulefiles-2") pod "436edb75-475a-4096-a9c9-bf235fc92d9c" (UID: "436edb75-475a-4096-a9c9-bf235fc92d9c"). InnerVolumeSpecName "prometheus-metric-storage-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.429018 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/436edb75-475a-4096-a9c9-bf235fc92d9c-config" (OuterVolumeSpecName: "config") pod "436edb75-475a-4096-a9c9-bf235fc92d9c" (UID: "436edb75-475a-4096-a9c9-bf235fc92d9c"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.429497 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/436edb75-475a-4096-a9c9-bf235fc92d9c-prometheus-metric-storage-rulefiles-0" (OuterVolumeSpecName: "prometheus-metric-storage-rulefiles-0") pod "436edb75-475a-4096-a9c9-bf235fc92d9c" (UID: "436edb75-475a-4096-a9c9-bf235fc92d9c"). InnerVolumeSpecName "prometheus-metric-storage-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.433504 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/436edb75-475a-4096-a9c9-bf235fc92d9c-web-config-tls-secret-key-cert-metric-storage-promethe-dc638c2d" (OuterVolumeSpecName: "web-config-tls-secret-key-cert-metric-storage-promethe-dc638c2d") pod "436edb75-475a-4096-a9c9-bf235fc92d9c" (UID: "436edb75-475a-4096-a9c9-bf235fc92d9c"). InnerVolumeSpecName "web-config-tls-secret-key-cert-metric-storage-promethe-dc638c2d". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.436408 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/436edb75-475a-4096-a9c9-bf235fc92d9c-config-out" (OuterVolumeSpecName: "config-out") pod "436edb75-475a-4096-a9c9-bf235fc92d9c" (UID: "436edb75-475a-4096-a9c9-bf235fc92d9c"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.437578 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/436edb75-475a-4096-a9c9-bf235fc92d9c-prometheus-metric-storage-rulefiles-1" (OuterVolumeSpecName: "prometheus-metric-storage-rulefiles-1") pod "436edb75-475a-4096-a9c9-bf235fc92d9c" (UID: "436edb75-475a-4096-a9c9-bf235fc92d9c"). InnerVolumeSpecName "prometheus-metric-storage-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:24:29 crc kubenswrapper[5120]: E0316 16:24:29.439563 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="ce0a8bde470adeb57224c167d670364e256b6b1b5b4d78dd8410053f53d53467" cmd=["/usr/bin/pgrep","-r","DRST","watcher-applier"] Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.440097 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b43ebee-5f04-44e0-a8bf-56f70871894e-alertmanager-metric-storage-db" (OuterVolumeSpecName: "alertmanager-metric-storage-db") pod "9b43ebee-5f04-44e0-a8bf-56f70871894e" (UID: "9b43ebee-5f04-44e0-a8bf-56f70871894e"). InnerVolumeSpecName "alertmanager-metric-storage-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.441753 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/436edb75-475a-4096-a9c9-bf235fc92d9c-web-config-tls-secret-cert-cert-metric-storage-prometh-dc638c2d" (OuterVolumeSpecName: "web-config-tls-secret-cert-cert-metric-storage-prometh-dc638c2d") pod "436edb75-475a-4096-a9c9-bf235fc92d9c" (UID: "436edb75-475a-4096-a9c9-bf235fc92d9c"). InnerVolumeSpecName "web-config-tls-secret-cert-cert-metric-storage-prometh-dc638c2d". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:24:29 crc kubenswrapper[5120]: E0316 16:24:29.450213 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="ce0a8bde470adeb57224c167d670364e256b6b1b5b4d78dd8410053f53d53467" cmd=["/usr/bin/pgrep","-r","DRST","watcher-applier"] Mar 16 16:24:29 crc kubenswrapper[5120]: E0316 16:24:29.450289 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/watcher-applier-0" podUID="d5160b65-3a41-4645-9f47-bd4e891fef5f" containerName="watcher-applier" probeResult="unknown" Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.450759 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/436edb75-475a-4096-a9c9-bf235fc92d9c-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "436edb75-475a-4096-a9c9-bf235fc92d9c" (UID: "436edb75-475a-4096-a9c9-bf235fc92d9c"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.453128 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b43ebee-5f04-44e0-a8bf-56f70871894e-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "9b43ebee-5f04-44e0-a8bf-56f70871894e" (UID: "9b43ebee-5f04-44e0-a8bf-56f70871894e"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.459973 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b43ebee-5f04-44e0-a8bf-56f70871894e-config-out" (OuterVolumeSpecName: "config-out") pod "9b43ebee-5f04-44e0-a8bf-56f70871894e" (UID: "9b43ebee-5f04-44e0-a8bf-56f70871894e"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.470005 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9b43ebee-5f04-44e0-a8bf-56f70871894e-config-volume" (OuterVolumeSpecName: "config-volume") pod "9b43ebee-5f04-44e0-a8bf-56f70871894e" (UID: "9b43ebee-5f04-44e0-a8bf-56f70871894e"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.503131 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/436edb75-475a-4096-a9c9-bf235fc92d9c-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "436edb75-475a-4096-a9c9-bf235fc92d9c" (UID: "436edb75-475a-4096-a9c9-bf235fc92d9c"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.503230 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/436edb75-475a-4096-a9c9-bf235fc92d9c-secret-combined-ca-bundle" (OuterVolumeSpecName: "secret-combined-ca-bundle") pod "436edb75-475a-4096-a9c9-bf235fc92d9c" (UID: "436edb75-475a-4096-a9c9-bf235fc92d9c"). InnerVolumeSpecName "secret-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.504081 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/436edb75-475a-4096-a9c9-bf235fc92d9c-kube-api-access-z62jk" (OuterVolumeSpecName: "kube-api-access-z62jk") pod "436edb75-475a-4096-a9c9-bf235fc92d9c" (UID: "436edb75-475a-4096-a9c9-bf235fc92d9c"). InnerVolumeSpecName "kube-api-access-z62jk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.504125 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b43ebee-5f04-44e0-a8bf-56f70871894e-kube-api-access-glqjf" (OuterVolumeSpecName: "kube-api-access-glqjf") pod "9b43ebee-5f04-44e0-a8bf-56f70871894e" (UID: "9b43ebee-5f04-44e0-a8bf-56f70871894e"). InnerVolumeSpecName "kube-api-access-glqjf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.508575 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage10-crc" (OuterVolumeSpecName: "prometheus-metric-storage-db") pod "436edb75-475a-4096-a9c9-bf235fc92d9c" (UID: "436edb75-475a-4096-a9c9-bf235fc92d9c"). InnerVolumeSpecName "local-storage10-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.524523 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-glqjf\" (UniqueName: \"kubernetes.io/projected/9b43ebee-5f04-44e0-a8bf-56f70871894e-kube-api-access-glqjf\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.524558 5120 reconciler_common.go:299] "Volume detached for volume \"secret-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/436edb75-475a-4096-a9c9-bf235fc92d9c-secret-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.524569 5120 reconciler_common.go:299] "Volume detached for volume \"web-config-tls-secret-key-cert-metric-storage-promethe-dc638c2d\" (UniqueName: \"kubernetes.io/secret/436edb75-475a-4096-a9c9-bf235fc92d9c-web-config-tls-secret-key-cert-metric-storage-promethe-dc638c2d\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.524580 5120 reconciler_common.go:299] "Volume detached for volume \"web-config-tls-secret-cert-cert-metric-storage-prometh-dc638c2d\" (UniqueName: \"kubernetes.io/secret/436edb75-475a-4096-a9c9-bf235fc92d9c-web-config-tls-secret-cert-cert-metric-storage-prometh-dc638c2d\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.524608 5120 reconciler_common.go:299] "Volume detached for volume \"prometheus-metric-storage-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/436edb75-475a-4096-a9c9-bf235fc92d9c-prometheus-metric-storage-rulefiles-1\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.524618 5120 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9b43ebee-5f04-44e0-a8bf-56f70871894e-tls-assets\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.524628 5120 reconciler_common.go:299] "Volume detached for volume \"alertmanager-metric-storage-db\" (UniqueName: \"kubernetes.io/empty-dir/9b43ebee-5f04-44e0-a8bf-56f70871894e-alertmanager-metric-storage-db\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.524639 5120 reconciler_common.go:299] "Volume detached for volume \"prometheus-metric-storage-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/436edb75-475a-4096-a9c9-bf235fc92d9c-prometheus-metric-storage-rulefiles-2\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.524661 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") on node \"crc\" " Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.524670 5120 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/436edb75-475a-4096-a9c9-bf235fc92d9c-config-out\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.524678 5120 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/436edb75-475a-4096-a9c9-bf235fc92d9c-thanos-prometheus-http-client-file\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.524686 5120 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9b43ebee-5f04-44e0-a8bf-56f70871894e-config-out\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.524696 5120 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/436edb75-475a-4096-a9c9-bf235fc92d9c-tls-assets\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.524705 5120 reconciler_common.go:299] "Volume detached for volume \"prometheus-metric-storage-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/436edb75-475a-4096-a9c9-bf235fc92d9c-prometheus-metric-storage-rulefiles-0\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.524713 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z62jk\" (UniqueName: \"kubernetes.io/projected/436edb75-475a-4096-a9c9-bf235fc92d9c-kube-api-access-z62jk\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.524721 5120 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9b43ebee-5f04-44e0-a8bf-56f70871894e-config-volume\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.524730 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/436edb75-475a-4096-a9c9-bf235fc92d9c-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.541716 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-8698d79fbb-6czlj" Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.553852 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9b43ebee-5f04-44e0-a8bf-56f70871894e-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "9b43ebee-5f04-44e0-a8bf-56f70871894e" (UID: "9b43ebee-5f04-44e0-a8bf-56f70871894e"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.629732 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wpc8b\" (UniqueName: \"kubernetes.io/projected/90dbf97e-452f-4fce-8ceb-07fda29e83b8-kube-api-access-wpc8b\") pod \"90dbf97e-452f-4fce-8ceb-07fda29e83b8\" (UID: \"90dbf97e-452f-4fce-8ceb-07fda29e83b8\") " Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.630398 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/90dbf97e-452f-4fce-8ceb-07fda29e83b8-combined-ca-bundle\") pod \"90dbf97e-452f-4fce-8ceb-07fda29e83b8\" (UID: \"90dbf97e-452f-4fce-8ceb-07fda29e83b8\") " Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.630449 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/90dbf97e-452f-4fce-8ceb-07fda29e83b8-config-data\") pod \"90dbf97e-452f-4fce-8ceb-07fda29e83b8\" (UID: \"90dbf97e-452f-4fce-8ceb-07fda29e83b8\") " Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.630565 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/90dbf97e-452f-4fce-8ceb-07fda29e83b8-log-httpd\") pod \"90dbf97e-452f-4fce-8ceb-07fda29e83b8\" (UID: \"90dbf97e-452f-4fce-8ceb-07fda29e83b8\") " Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.630898 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/90dbf97e-452f-4fce-8ceb-07fda29e83b8-internal-tls-certs\") pod \"90dbf97e-452f-4fce-8ceb-07fda29e83b8\" (UID: \"90dbf97e-452f-4fce-8ceb-07fda29e83b8\") " Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.631018 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/90dbf97e-452f-4fce-8ceb-07fda29e83b8-run-httpd\") pod \"90dbf97e-452f-4fce-8ceb-07fda29e83b8\" (UID: \"90dbf97e-452f-4fce-8ceb-07fda29e83b8\") " Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.631092 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/90dbf97e-452f-4fce-8ceb-07fda29e83b8-public-tls-certs\") pod \"90dbf97e-452f-4fce-8ceb-07fda29e83b8\" (UID: \"90dbf97e-452f-4fce-8ceb-07fda29e83b8\") " Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.631469 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/90dbf97e-452f-4fce-8ceb-07fda29e83b8-etc-swift\") pod \"90dbf97e-452f-4fce-8ceb-07fda29e83b8\" (UID: \"90dbf97e-452f-4fce-8ceb-07fda29e83b8\") " Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.634614 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90dbf97e-452f-4fce-8ceb-07fda29e83b8-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "90dbf97e-452f-4fce-8ceb-07fda29e83b8" (UID: "90dbf97e-452f-4fce-8ceb-07fda29e83b8"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.642633 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90dbf97e-452f-4fce-8ceb-07fda29e83b8-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "90dbf97e-452f-4fce-8ceb-07fda29e83b8" (UID: "90dbf97e-452f-4fce-8ceb-07fda29e83b8"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.647241 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/90dbf97e-452f-4fce-8ceb-07fda29e83b8-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.647278 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/90dbf97e-452f-4fce-8ceb-07fda29e83b8-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.647290 5120 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9b43ebee-5f04-44e0-a8bf-56f70871894e-cluster-tls-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.651734 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage10-crc" (UniqueName: "kubernetes.io/local-volume/local-storage10-crc") on node "crc" Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.703645 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90dbf97e-452f-4fce-8ceb-07fda29e83b8-etc-swift" (OuterVolumeSpecName: "etc-swift") pod "90dbf97e-452f-4fce-8ceb-07fda29e83b8" (UID: "90dbf97e-452f-4fce-8ceb-07fda29e83b8"). InnerVolumeSpecName "etc-swift". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.707015 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90dbf97e-452f-4fce-8ceb-07fda29e83b8-kube-api-access-wpc8b" (OuterVolumeSpecName: "kube-api-access-wpc8b") pod "90dbf97e-452f-4fce-8ceb-07fda29e83b8" (UID: "90dbf97e-452f-4fce-8ceb-07fda29e83b8"). InnerVolumeSpecName "kube-api-access-wpc8b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.751204 5120 reconciler_common.go:299] "Volume detached for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/90dbf97e-452f-4fce-8ceb-07fda29e83b8-etc-swift\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.751250 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.751265 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wpc8b\" (UniqueName: \"kubernetes.io/projected/90dbf97e-452f-4fce-8ceb-07fda29e83b8-kube-api-access-wpc8b\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.767970 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/90dbf97e-452f-4fce-8ceb-07fda29e83b8-config-data" (OuterVolumeSpecName: "config-data") pod "90dbf97e-452f-4fce-8ceb-07fda29e83b8" (UID: "90dbf97e-452f-4fce-8ceb-07fda29e83b8"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.781556 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/436edb75-475a-4096-a9c9-bf235fc92d9c-web-config" (OuterVolumeSpecName: "web-config") pod "436edb75-475a-4096-a9c9-bf235fc92d9c" (UID: "436edb75-475a-4096-a9c9-bf235fc92d9c"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.840821 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/90dbf97e-452f-4fce-8ceb-07fda29e83b8-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "90dbf97e-452f-4fce-8ceb-07fda29e83b8" (UID: "90dbf97e-452f-4fce-8ceb-07fda29e83b8"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.853683 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/90dbf97e-452f-4fce-8ceb-07fda29e83b8-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.853713 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/90dbf97e-452f-4fce-8ceb-07fda29e83b8-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.853725 5120 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/436edb75-475a-4096-a9c9-bf235fc92d9c-web-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.862434 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/90dbf97e-452f-4fce-8ceb-07fda29e83b8-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "90dbf97e-452f-4fce-8ceb-07fda29e83b8" (UID: "90dbf97e-452f-4fce-8ceb-07fda29e83b8"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.863377 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/90dbf97e-452f-4fce-8ceb-07fda29e83b8-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "90dbf97e-452f-4fce-8ceb-07fda29e83b8" (UID: "90dbf97e-452f-4fce-8ceb-07fda29e83b8"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.865849 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9b43ebee-5f04-44e0-a8bf-56f70871894e-web-config" (OuterVolumeSpecName: "web-config") pod "9b43ebee-5f04-44e0-a8bf-56f70871894e" (UID: "9b43ebee-5f04-44e0-a8bf-56f70871894e"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.958017 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/90dbf97e-452f-4fce-8ceb-07fda29e83b8-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.958282 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/90dbf97e-452f-4fce-8ceb-07fda29e83b8-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:29 crc kubenswrapper[5120]: I0316 16:24:29.958292 5120 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9b43ebee-5f04-44e0-a8bf-56f70871894e-web-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:29 crc kubenswrapper[5120]: E0316 16:24:29.958102 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Mar 16 16:24:29 crc kubenswrapper[5120]: E0316 16:24:29.958434 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/86686d29-4c19-43e3-97a8-d8373883dc6a-operator-scripts podName:86686d29-4c19-43e3-97a8-d8373883dc6a nodeName:}" failed. No retries permitted until 2026-03-16 16:24:30.95841103 +0000 UTC m=+3173.112342697 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/86686d29-4c19-43e3-97a8-d8373883dc6a-operator-scripts") pod "root-account-create-update-rvrb7" (UID: "86686d29-4c19-43e3-97a8-d8373883dc6a") : configmap "openstack-scripts" not found Mar 16 16:24:30 crc kubenswrapper[5120]: I0316 16:24:30.068860 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-a8ac-account-create-update-lqmbd" Mar 16 16:24:30 crc kubenswrapper[5120]: I0316 16:24:30.095315 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:24:30 crc kubenswrapper[5120]: I0316 16:24:30.161857 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/cf8c7b4f-8110-4b63-9022-2f9dcf3c1270-operator-scripts\") pod \"cf8c7b4f-8110-4b63-9022-2f9dcf3c1270\" (UID: \"cf8c7b4f-8110-4b63-9022-2f9dcf3c1270\") " Mar 16 16:24:30 crc kubenswrapper[5120]: I0316 16:24:30.161906 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f90be6a3-f863-476d-b78b-95b9d069037e-config-data\") pod \"f90be6a3-f863-476d-b78b-95b9d069037e\" (UID: \"f90be6a3-f863-476d-b78b-95b9d069037e\") " Mar 16 16:24:30 crc kubenswrapper[5120]: I0316 16:24:30.162011 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r7cnw\" (UniqueName: \"kubernetes.io/projected/cf8c7b4f-8110-4b63-9022-2f9dcf3c1270-kube-api-access-r7cnw\") pod \"cf8c7b4f-8110-4b63-9022-2f9dcf3c1270\" (UID: \"cf8c7b4f-8110-4b63-9022-2f9dcf3c1270\") " Mar 16 16:24:30 crc kubenswrapper[5120]: I0316 16:24:30.162048 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f90be6a3-f863-476d-b78b-95b9d069037e-combined-ca-bundle\") pod \"f90be6a3-f863-476d-b78b-95b9d069037e\" (UID: \"f90be6a3-f863-476d-b78b-95b9d069037e\") " Mar 16 16:24:30 crc kubenswrapper[5120]: I0316 16:24:30.162092 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/f90be6a3-f863-476d-b78b-95b9d069037e-nova-novncproxy-tls-certs\") pod \"f90be6a3-f863-476d-b78b-95b9d069037e\" (UID: \"f90be6a3-f863-476d-b78b-95b9d069037e\") " Mar 16 16:24:30 crc kubenswrapper[5120]: I0316 16:24:30.162116 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/f90be6a3-f863-476d-b78b-95b9d069037e-vencrypt-tls-certs\") pod \"f90be6a3-f863-476d-b78b-95b9d069037e\" (UID: \"f90be6a3-f863-476d-b78b-95b9d069037e\") " Mar 16 16:24:30 crc kubenswrapper[5120]: I0316 16:24:30.162138 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qs4cs\" (UniqueName: \"kubernetes.io/projected/f90be6a3-f863-476d-b78b-95b9d069037e-kube-api-access-qs4cs\") pod \"f90be6a3-f863-476d-b78b-95b9d069037e\" (UID: \"f90be6a3-f863-476d-b78b-95b9d069037e\") " Mar 16 16:24:30 crc kubenswrapper[5120]: I0316 16:24:30.163467 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf8c7b4f-8110-4b63-9022-2f9dcf3c1270-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "cf8c7b4f-8110-4b63-9022-2f9dcf3c1270" (UID: "cf8c7b4f-8110-4b63-9022-2f9dcf3c1270"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:24:30 crc kubenswrapper[5120]: I0316 16:24:30.168289 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf8c7b4f-8110-4b63-9022-2f9dcf3c1270-kube-api-access-r7cnw" (OuterVolumeSpecName: "kube-api-access-r7cnw") pod "cf8c7b4f-8110-4b63-9022-2f9dcf3c1270" (UID: "cf8c7b4f-8110-4b63-9022-2f9dcf3c1270"). InnerVolumeSpecName "kube-api-access-r7cnw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:24:30 crc kubenswrapper[5120]: I0316 16:24:30.169982 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f90be6a3-f863-476d-b78b-95b9d069037e-kube-api-access-qs4cs" (OuterVolumeSpecName: "kube-api-access-qs4cs") pod "f90be6a3-f863-476d-b78b-95b9d069037e" (UID: "f90be6a3-f863-476d-b78b-95b9d069037e"). InnerVolumeSpecName "kube-api-access-qs4cs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:24:30 crc kubenswrapper[5120]: I0316 16:24:30.193949 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f90be6a3-f863-476d-b78b-95b9d069037e-config-data" (OuterVolumeSpecName: "config-data") pod "f90be6a3-f863-476d-b78b-95b9d069037e" (UID: "f90be6a3-f863-476d-b78b-95b9d069037e"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:24:30 crc kubenswrapper[5120]: I0316 16:24:30.222240 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f90be6a3-f863-476d-b78b-95b9d069037e-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f90be6a3-f863-476d-b78b-95b9d069037e" (UID: "f90be6a3-f863-476d-b78b-95b9d069037e"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:24:30 crc kubenswrapper[5120]: I0316 16:24:30.240927 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f90be6a3-f863-476d-b78b-95b9d069037e-vencrypt-tls-certs" (OuterVolumeSpecName: "vencrypt-tls-certs") pod "f90be6a3-f863-476d-b78b-95b9d069037e" (UID: "f90be6a3-f863-476d-b78b-95b9d069037e"). InnerVolumeSpecName "vencrypt-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:24:30 crc kubenswrapper[5120]: I0316 16:24:30.258721 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f90be6a3-f863-476d-b78b-95b9d069037e-nova-novncproxy-tls-certs" (OuterVolumeSpecName: "nova-novncproxy-tls-certs") pod "f90be6a3-f863-476d-b78b-95b9d069037e" (UID: "f90be6a3-f863-476d-b78b-95b9d069037e"). InnerVolumeSpecName "nova-novncproxy-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:24:30 crc kubenswrapper[5120]: I0316 16:24:30.265318 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rlkqb\" (UniqueName: \"kubernetes.io/projected/93507a7d-d4a9-4f98-aca5-30020461118a-kube-api-access-rlkqb\") pod \"keystone-b6ca-account-create-update-t6nc4\" (UID: \"93507a7d-d4a9-4f98-aca5-30020461118a\") " pod="openstack-kuttl-tests/keystone-b6ca-account-create-update-t6nc4" Mar 16 16:24:30 crc kubenswrapper[5120]: I0316 16:24:30.265426 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/93507a7d-d4a9-4f98-aca5-30020461118a-operator-scripts\") pod \"keystone-b6ca-account-create-update-t6nc4\" (UID: \"93507a7d-d4a9-4f98-aca5-30020461118a\") " pod="openstack-kuttl-tests/keystone-b6ca-account-create-update-t6nc4" Mar 16 16:24:30 crc kubenswrapper[5120]: I0316 16:24:30.265951 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/cf8c7b4f-8110-4b63-9022-2f9dcf3c1270-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:30 crc kubenswrapper[5120]: I0316 16:24:30.265978 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f90be6a3-f863-476d-b78b-95b9d069037e-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:30 crc kubenswrapper[5120]: I0316 16:24:30.265991 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r7cnw\" (UniqueName: \"kubernetes.io/projected/cf8c7b4f-8110-4b63-9022-2f9dcf3c1270-kube-api-access-r7cnw\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:30 crc kubenswrapper[5120]: I0316 16:24:30.266027 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f90be6a3-f863-476d-b78b-95b9d069037e-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:30 crc kubenswrapper[5120]: I0316 16:24:30.266041 5120 reconciler_common.go:299] "Volume detached for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/f90be6a3-f863-476d-b78b-95b9d069037e-nova-novncproxy-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:30 crc kubenswrapper[5120]: I0316 16:24:30.266054 5120 reconciler_common.go:299] "Volume detached for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/f90be6a3-f863-476d-b78b-95b9d069037e-vencrypt-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:30 crc kubenswrapper[5120]: I0316 16:24:30.266066 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qs4cs\" (UniqueName: \"kubernetes.io/projected/f90be6a3-f863-476d-b78b-95b9d069037e-kube-api-access-qs4cs\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:30 crc kubenswrapper[5120]: E0316 16:24:30.266147 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Mar 16 16:24:30 crc kubenswrapper[5120]: E0316 16:24:30.266224 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/93507a7d-d4a9-4f98-aca5-30020461118a-operator-scripts podName:93507a7d-d4a9-4f98-aca5-30020461118a nodeName:}" failed. No retries permitted until 2026-03-16 16:24:32.266204232 +0000 UTC m=+3174.420135889 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/93507a7d-d4a9-4f98-aca5-30020461118a-operator-scripts") pod "keystone-b6ca-account-create-update-t6nc4" (UID: "93507a7d-d4a9-4f98-aca5-30020461118a") : configmap "openstack-scripts" not found Mar 16 16:24:30 crc kubenswrapper[5120]: E0316 16:24:30.270938 5120 projected.go:194] Error preparing data for projected volume kube-api-access-rlkqb for pod openstack-kuttl-tests/keystone-b6ca-account-create-update-t6nc4: failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 16:24:30 crc kubenswrapper[5120]: E0316 16:24:30.271123 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/93507a7d-d4a9-4f98-aca5-30020461118a-kube-api-access-rlkqb podName:93507a7d-d4a9-4f98-aca5-30020461118a nodeName:}" failed. No retries permitted until 2026-03-16 16:24:32.271082452 +0000 UTC m=+3174.425014149 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-rlkqb" (UniqueName: "kubernetes.io/projected/93507a7d-d4a9-4f98-aca5-30020461118a-kube-api-access-rlkqb") pod "keystone-b6ca-account-create-update-t6nc4" (UID: "93507a7d-d4a9-4f98-aca5-30020461118a") : failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 16:24:30 crc kubenswrapper[5120]: I0316 16:24:30.298919 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/placement-87c8bf854-gkthd" podUID="771204f4-c55f-4a6e-be63-70f3d1c8a51e" containerName="placement-log" probeResult="failure" output="Get \"https://10.217.1.106:8778/\": read tcp 10.217.0.2:44722->10.217.1.106:8778: read: connection reset by peer" Mar 16 16:24:30 crc kubenswrapper[5120]: I0316 16:24:30.299293 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/placement-87c8bf854-gkthd" podUID="771204f4-c55f-4a6e-be63-70f3d1c8a51e" containerName="placement-api" probeResult="failure" output="Get \"https://10.217.1.106:8778/\": read tcp 10.217.0.2:35888->10.217.1.106:8778: read: connection reset by peer" Mar 16 16:24:30 crc kubenswrapper[5120]: I0316 16:24:30.346274 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/alertmanager-metric-storage-0" event={"ID":"9b43ebee-5f04-44e0-a8bf-56f70871894e","Type":"ContainerDied","Data":"2c71e99e580c97c17b132527f62bcfd7cbaa417dad592c33bc45556834c34181"} Mar 16 16:24:30 crc kubenswrapper[5120]: I0316 16:24:30.346460 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/alertmanager-metric-storage-0" Mar 16 16:24:30 crc kubenswrapper[5120]: I0316 16:24:30.346532 5120 scope.go:117] "RemoveContainer" containerID="b1a722f653ecb9a8de687b89024aff31dbebdf8af7ee495b08f3d6c4416ffed9" Mar 16 16:24:30 crc kubenswrapper[5120]: I0316 16:24:30.351405 5120 generic.go:358] "Generic (PLEG): container finished" podID="86686d29-4c19-43e3-97a8-d8373883dc6a" containerID="c156c86d2309060a909297c5becf2362c59502c26dff06e06c9dfdcf68581ad2" exitCode=1 Mar 16 16:24:30 crc kubenswrapper[5120]: I0316 16:24:30.351707 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-rvrb7" event={"ID":"86686d29-4c19-43e3-97a8-d8373883dc6a","Type":"ContainerDied","Data":"c156c86d2309060a909297c5becf2362c59502c26dff06e06c9dfdcf68581ad2"} Mar 16 16:24:30 crc kubenswrapper[5120]: I0316 16:24:30.354504 5120 generic.go:358] "Generic (PLEG): container finished" podID="5132805e-c90f-44bf-a405-0a3fae248b25" containerID="fd4e45f2c4670f47db023353f3e953f96c86ceae7f66ae655b1a622dff175c7f" exitCode=0 Mar 16 16:24:30 crc kubenswrapper[5120]: I0316 16:24:30.354985 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-q5hqq" event={"ID":"5132805e-c90f-44bf-a405-0a3fae248b25","Type":"ContainerDied","Data":"fd4e45f2c4670f47db023353f3e953f96c86ceae7f66ae655b1a622dff175c7f"} Mar 16 16:24:30 crc kubenswrapper[5120]: I0316 16:24:30.355119 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-q5hqq" event={"ID":"5132805e-c90f-44bf-a405-0a3fae248b25","Type":"ContainerStarted","Data":"47c13110662b8fc18494f64f566f22fbeff82c46fb785c90fc9ef2e968a7ac0d"} Mar 16 16:24:30 crc kubenswrapper[5120]: I0316 16:24:30.362030 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-8698d79fbb-6czlj" event={"ID":"90dbf97e-452f-4fce-8ceb-07fda29e83b8","Type":"ContainerDied","Data":"61d1f002c6ea3229e8bc270c50328df1bc0af955af1a3199d132930a243c97cd"} Mar 16 16:24:30 crc kubenswrapper[5120]: I0316 16:24:30.362064 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-8698d79fbb-6czlj" Mar 16 16:24:30 crc kubenswrapper[5120]: I0316 16:24:30.382367 5120 generic.go:358] "Generic (PLEG): container finished" podID="771204f4-c55f-4a6e-be63-70f3d1c8a51e" containerID="7c4f8549d75fe7169915e7f6cda9d1b1a6faa1e896903408eeb16bd5e1ec8969" exitCode=0 Mar 16 16:24:30 crc kubenswrapper[5120]: I0316 16:24:30.382719 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-87c8bf854-gkthd" event={"ID":"771204f4-c55f-4a6e-be63-70f3d1c8a51e","Type":"ContainerDied","Data":"7c4f8549d75fe7169915e7f6cda9d1b1a6faa1e896903408eeb16bd5e1ec8969"} Mar 16 16:24:30 crc kubenswrapper[5120]: I0316 16:24:30.389732 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/prometheus-metric-storage-0" Mar 16 16:24:30 crc kubenswrapper[5120]: I0316 16:24:30.390869 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/prometheus-metric-storage-0" event={"ID":"436edb75-475a-4096-a9c9-bf235fc92d9c","Type":"ContainerDied","Data":"f103913d8232cf82f1ed1a7fc559f65bf626b71dff26bcb1e82ccfe014a32d15"} Mar 16 16:24:30 crc kubenswrapper[5120]: I0316 16:24:30.401404 5120 generic.go:358] "Generic (PLEG): container finished" podID="f90be6a3-f863-476d-b78b-95b9d069037e" containerID="0332ef9a2b607b7a01644fa26cd31f338123d18f32f186ba2acdff4ad391e66e" exitCode=0 Mar 16 16:24:30 crc kubenswrapper[5120]: I0316 16:24:30.402046 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:24:30 crc kubenswrapper[5120]: I0316 16:24:30.402067 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"f90be6a3-f863-476d-b78b-95b9d069037e","Type":"ContainerDied","Data":"0332ef9a2b607b7a01644fa26cd31f338123d18f32f186ba2acdff4ad391e66e"} Mar 16 16:24:30 crc kubenswrapper[5120]: I0316 16:24:30.406095 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"f90be6a3-f863-476d-b78b-95b9d069037e","Type":"ContainerDied","Data":"dff103b2ba9b082c4e632c9ecd3d6aec83f0012d947e248a449bf2319f228be7"} Mar 16 16:24:30 crc kubenswrapper[5120]: I0316 16:24:30.413188 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-a8ac-account-create-update-lqmbd" Mar 16 16:24:30 crc kubenswrapper[5120]: I0316 16:24:30.413215 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-a8ac-account-create-update-lqmbd" event={"ID":"cf8c7b4f-8110-4b63-9022-2f9dcf3c1270","Type":"ContainerDied","Data":"3b83fe95376c0a09b94288d189d42bd250d7e116f87a98905b778f9cf99bc523"} Mar 16 16:24:30 crc kubenswrapper[5120]: I0316 16:24:30.413195 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-b6ca-account-create-update-t6nc4" Mar 16 16:24:30 crc kubenswrapper[5120]: I0316 16:24:30.419964 5120 scope.go:117] "RemoveContainer" containerID="d174f547bf24ef444cb7eb8748c654dbe1df34b53324eb8a10d06c56c02dec63" Mar 16 16:24:30 crc kubenswrapper[5120]: I0316 16:24:30.420793 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/alertmanager-metric-storage-0"] Mar 16 16:24:30 crc kubenswrapper[5120]: I0316 16:24:30.473843 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/cinder-api-0" podUID="7ea8cd10-4026-4603-a76b-b26ebe185441" containerName="cinder-api" probeResult="failure" output="Get \"https://10.217.1.97:8776/healthcheck\": read tcp 10.217.0.2:40042->10.217.1.97:8776: read: connection reset by peer" Mar 16 16:24:30 crc kubenswrapper[5120]: I0316 16:24:30.476386 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/alertmanager-metric-storage-0"] Mar 16 16:24:30 crc kubenswrapper[5120]: I0316 16:24:30.500979 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-proxy-8698d79fbb-6czlj"] Mar 16 16:24:30 crc kubenswrapper[5120]: I0316 16:24:30.508546 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/swift-proxy-8698d79fbb-6czlj"] Mar 16 16:24:30 crc kubenswrapper[5120]: I0316 16:24:30.720084 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3da68321-bcd7-4099-9782-fc28ba9a5a90" path="/var/lib/kubelet/pods/3da68321-bcd7-4099-9782-fc28ba9a5a90/volumes" Mar 16 16:24:30 crc kubenswrapper[5120]: I0316 16:24:30.720620 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="90dbf97e-452f-4fce-8ceb-07fda29e83b8" path="/var/lib/kubelet/pods/90dbf97e-452f-4fce-8ceb-07fda29e83b8/volumes" Mar 16 16:24:30 crc kubenswrapper[5120]: I0316 16:24:30.721180 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93d56b12-9c96-48fa-9343-4a12d639b8a3" path="/var/lib/kubelet/pods/93d56b12-9c96-48fa-9343-4a12d639b8a3/volumes" Mar 16 16:24:30 crc kubenswrapper[5120]: I0316 16:24:30.727197 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b43ebee-5f04-44e0-a8bf-56f70871894e" path="/var/lib/kubelet/pods/9b43ebee-5f04-44e0-a8bf-56f70871894e/volumes" Mar 16 16:24:30 crc kubenswrapper[5120]: I0316 16:24:30.732564 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bbcf321a-a331-4e3a-96f2-90af1aa2d619" path="/var/lib/kubelet/pods/bbcf321a-a331-4e3a-96f2-90af1aa2d619/volumes" Mar 16 16:24:30 crc kubenswrapper[5120]: I0316 16:24:30.733167 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c6d25137-770c-4094-9c3a-85b1ac79873c" path="/var/lib/kubelet/pods/c6d25137-770c-4094-9c3a-85b1ac79873c/volumes" Mar 16 16:24:30 crc kubenswrapper[5120]: I0316 16:24:30.733712 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-b6ca-account-create-update-t6nc4"] Mar 16 16:24:30 crc kubenswrapper[5120]: I0316 16:24:30.733734 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-b6ca-account-create-update-t6nc4"] Mar 16 16:24:30 crc kubenswrapper[5120]: I0316 16:24:30.733759 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-a8ac-account-create-update-lqmbd"] Mar 16 16:24:30 crc kubenswrapper[5120]: I0316 16:24:30.733782 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-a8ac-account-create-update-lqmbd"] Mar 16 16:24:30 crc kubenswrapper[5120]: I0316 16:24:30.737902 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/prometheus-metric-storage-0"] Mar 16 16:24:30 crc kubenswrapper[5120]: I0316 16:24:30.742176 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/prometheus-metric-storage-0"] Mar 16 16:24:30 crc kubenswrapper[5120]: I0316 16:24:30.746470 5120 scope.go:117] "RemoveContainer" containerID="83b1a0951aacf8c335110caf5c001078ee4b461c91a37a5ee3ff5fbf1294518b" Mar 16 16:24:30 crc kubenswrapper[5120]: I0316 16:24:30.748294 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:24:30 crc kubenswrapper[5120]: I0316 16:24:30.754749 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:24:30 crc kubenswrapper[5120]: I0316 16:24:30.806172 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rlkqb\" (UniqueName: \"kubernetes.io/projected/93507a7d-d4a9-4f98-aca5-30020461118a-kube-api-access-rlkqb\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:30 crc kubenswrapper[5120]: I0316 16:24:30.806197 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/93507a7d-d4a9-4f98-aca5-30020461118a-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:30 crc kubenswrapper[5120]: I0316 16:24:30.846145 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/watcher-api-0" podUID="e15efd1b-6aa8-4a24-b576-4e03e19e19d0" containerName="watcher-api-log" probeResult="failure" output="Get \"https://10.217.1.102:9322/\": read tcp 10.217.0.2:37898->10.217.1.102:9322: read: connection reset by peer" Mar 16 16:24:30 crc kubenswrapper[5120]: I0316 16:24:30.860928 5120 scope.go:117] "RemoveContainer" containerID="f9a9d791d1443678d4a2c23479b8e11b6f560a185ffc34e35391ec6238b9ab79" Mar 16 16:24:31 crc kubenswrapper[5120]: E0316 16:24:31.010526 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Mar 16 16:24:31 crc kubenswrapper[5120]: E0316 16:24:31.011989 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/86686d29-4c19-43e3-97a8-d8373883dc6a-operator-scripts podName:86686d29-4c19-43e3-97a8-d8373883dc6a nodeName:}" failed. No retries permitted until 2026-03-16 16:24:33.011960599 +0000 UTC m=+3175.165892256 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/86686d29-4c19-43e3-97a8-d8373883dc6a-operator-scripts") pod "root-account-create-update-rvrb7" (UID: "86686d29-4c19-43e3-97a8-d8373883dc6a") : configmap "openstack-scripts" not found Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.186644 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-87c8bf854-gkthd" Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.193637 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-rvrb7" Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.253952 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.281591 5120 scope.go:117] "RemoveContainer" containerID="67cf881a6a854436edea224c7b420d193ade58ddc2a769579fe0b891879e4d9f" Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.288323 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.314557 5120 scope.go:117] "RemoveContainer" containerID="69de27d7b1816f359b19d7db8ad34481405845a2709dc4483b84ffc8307ede29" Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.321588 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/771204f4-c55f-4a6e-be63-70f3d1c8a51e-internal-tls-certs\") pod \"771204f4-c55f-4a6e-be63-70f3d1c8a51e\" (UID: \"771204f4-c55f-4a6e-be63-70f3d1c8a51e\") " Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.321639 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/7ea8cd10-4026-4603-a76b-b26ebe185441-internal-tls-certs\") pod \"7ea8cd10-4026-4603-a76b-b26ebe185441\" (UID: \"7ea8cd10-4026-4603-a76b-b26ebe185441\") " Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.321678 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/7ea8cd10-4026-4603-a76b-b26ebe185441-etc-machine-id\") pod \"7ea8cd10-4026-4603-a76b-b26ebe185441\" (UID: \"7ea8cd10-4026-4603-a76b-b26ebe185441\") " Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.321922 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/7ea8cd10-4026-4603-a76b-b26ebe185441-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "7ea8cd10-4026-4603-a76b-b26ebe185441" (UID: "7ea8cd10-4026-4603-a76b-b26ebe185441"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.322351 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7ea8cd10-4026-4603-a76b-b26ebe185441-config-data\") pod \"7ea8cd10-4026-4603-a76b-b26ebe185441\" (UID: \"7ea8cd10-4026-4603-a76b-b26ebe185441\") " Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.322396 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9z9cv\" (UniqueName: \"kubernetes.io/projected/7ea8cd10-4026-4603-a76b-b26ebe185441-kube-api-access-9z9cv\") pod \"7ea8cd10-4026-4603-a76b-b26ebe185441\" (UID: \"7ea8cd10-4026-4603-a76b-b26ebe185441\") " Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.322414 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/771204f4-c55f-4a6e-be63-70f3d1c8a51e-config-data\") pod \"771204f4-c55f-4a6e-be63-70f3d1c8a51e\" (UID: \"771204f4-c55f-4a6e-be63-70f3d1c8a51e\") " Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.322438 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bt84v\" (UniqueName: \"kubernetes.io/projected/86686d29-4c19-43e3-97a8-d8373883dc6a-kube-api-access-bt84v\") pod \"86686d29-4c19-43e3-97a8-d8373883dc6a\" (UID: \"86686d29-4c19-43e3-97a8-d8373883dc6a\") " Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.322476 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/771204f4-c55f-4a6e-be63-70f3d1c8a51e-combined-ca-bundle\") pod \"771204f4-c55f-4a6e-be63-70f3d1c8a51e\" (UID: \"771204f4-c55f-4a6e-be63-70f3d1c8a51e\") " Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.322498 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7ea8cd10-4026-4603-a76b-b26ebe185441-combined-ca-bundle\") pod \"7ea8cd10-4026-4603-a76b-b26ebe185441\" (UID: \"7ea8cd10-4026-4603-a76b-b26ebe185441\") " Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.322901 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/86686d29-4c19-43e3-97a8-d8373883dc6a-operator-scripts\") pod \"86686d29-4c19-43e3-97a8-d8373883dc6a\" (UID: \"86686d29-4c19-43e3-97a8-d8373883dc6a\") " Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.323708 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/7ea8cd10-4026-4603-a76b-b26ebe185441-public-tls-certs\") pod \"7ea8cd10-4026-4603-a76b-b26ebe185441\" (UID: \"7ea8cd10-4026-4603-a76b-b26ebe185441\") " Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.323808 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7ea8cd10-4026-4603-a76b-b26ebe185441-logs\") pod \"7ea8cd10-4026-4603-a76b-b26ebe185441\" (UID: \"7ea8cd10-4026-4603-a76b-b26ebe185441\") " Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.323863 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/7ea8cd10-4026-4603-a76b-b26ebe185441-config-data-custom\") pod \"7ea8cd10-4026-4603-a76b-b26ebe185441\" (UID: \"7ea8cd10-4026-4603-a76b-b26ebe185441\") " Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.323909 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pssnq\" (UniqueName: \"kubernetes.io/projected/771204f4-c55f-4a6e-be63-70f3d1c8a51e-kube-api-access-pssnq\") pod \"771204f4-c55f-4a6e-be63-70f3d1c8a51e\" (UID: \"771204f4-c55f-4a6e-be63-70f3d1c8a51e\") " Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.323939 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7ea8cd10-4026-4603-a76b-b26ebe185441-scripts\") pod \"7ea8cd10-4026-4603-a76b-b26ebe185441\" (UID: \"7ea8cd10-4026-4603-a76b-b26ebe185441\") " Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.323958 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/771204f4-c55f-4a6e-be63-70f3d1c8a51e-logs\") pod \"771204f4-c55f-4a6e-be63-70f3d1c8a51e\" (UID: \"771204f4-c55f-4a6e-be63-70f3d1c8a51e\") " Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.323985 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/771204f4-c55f-4a6e-be63-70f3d1c8a51e-public-tls-certs\") pod \"771204f4-c55f-4a6e-be63-70f3d1c8a51e\" (UID: \"771204f4-c55f-4a6e-be63-70f3d1c8a51e\") " Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.324026 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/771204f4-c55f-4a6e-be63-70f3d1c8a51e-scripts\") pod \"771204f4-c55f-4a6e-be63-70f3d1c8a51e\" (UID: \"771204f4-c55f-4a6e-be63-70f3d1c8a51e\") " Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.324836 5120 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/7ea8cd10-4026-4603-a76b-b26ebe185441-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.332675 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/86686d29-4c19-43e3-97a8-d8373883dc6a-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "86686d29-4c19-43e3-97a8-d8373883dc6a" (UID: "86686d29-4c19-43e3-97a8-d8373883dc6a"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.334694 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ea8cd10-4026-4603-a76b-b26ebe185441-logs" (OuterVolumeSpecName: "logs") pod "7ea8cd10-4026-4603-a76b-b26ebe185441" (UID: "7ea8cd10-4026-4603-a76b-b26ebe185441"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.335115 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/771204f4-c55f-4a6e-be63-70f3d1c8a51e-logs" (OuterVolumeSpecName: "logs") pod "771204f4-c55f-4a6e-be63-70f3d1c8a51e" (UID: "771204f4-c55f-4a6e-be63-70f3d1c8a51e"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.343928 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86686d29-4c19-43e3-97a8-d8373883dc6a-kube-api-access-bt84v" (OuterVolumeSpecName: "kube-api-access-bt84v") pod "86686d29-4c19-43e3-97a8-d8373883dc6a" (UID: "86686d29-4c19-43e3-97a8-d8373883dc6a"). InnerVolumeSpecName "kube-api-access-bt84v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.344061 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/771204f4-c55f-4a6e-be63-70f3d1c8a51e-kube-api-access-pssnq" (OuterVolumeSpecName: "kube-api-access-pssnq") pod "771204f4-c55f-4a6e-be63-70f3d1c8a51e" (UID: "771204f4-c55f-4a6e-be63-70f3d1c8a51e"). InnerVolumeSpecName "kube-api-access-pssnq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.344801 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/771204f4-c55f-4a6e-be63-70f3d1c8a51e-scripts" (OuterVolumeSpecName: "scripts") pod "771204f4-c55f-4a6e-be63-70f3d1c8a51e" (UID: "771204f4-c55f-4a6e-be63-70f3d1c8a51e"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.345983 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ea8cd10-4026-4603-a76b-b26ebe185441-kube-api-access-9z9cv" (OuterVolumeSpecName: "kube-api-access-9z9cv") pod "7ea8cd10-4026-4603-a76b-b26ebe185441" (UID: "7ea8cd10-4026-4603-a76b-b26ebe185441"). InnerVolumeSpecName "kube-api-access-9z9cv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.352136 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7ea8cd10-4026-4603-a76b-b26ebe185441-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "7ea8cd10-4026-4603-a76b-b26ebe185441" (UID: "7ea8cd10-4026-4603-a76b-b26ebe185441"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.362510 5120 scope.go:117] "RemoveContainer" containerID="2a896000e70dd7124ec92af5c96ae6d01ec902505892d014e791fed3fbdfa390" Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.363890 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7ea8cd10-4026-4603-a76b-b26ebe185441-scripts" (OuterVolumeSpecName: "scripts") pod "7ea8cd10-4026-4603-a76b-b26ebe185441" (UID: "7ea8cd10-4026-4603-a76b-b26ebe185441"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.387067 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.399908 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7ea8cd10-4026-4603-a76b-b26ebe185441-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "7ea8cd10-4026-4603-a76b-b26ebe185441" (UID: "7ea8cd10-4026-4603-a76b-b26ebe185441"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.411432 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7ea8cd10-4026-4603-a76b-b26ebe185441-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "7ea8cd10-4026-4603-a76b-b26ebe185441" (UID: "7ea8cd10-4026-4603-a76b-b26ebe185441"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.432220 5120 scope.go:117] "RemoveContainer" containerID="1bba6ac3aa0cc48a80a5395897ea292ab61046d1fda826d5eb20948de324115b" Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.434154 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/3ea3fd85-7822-44e8-a112-9aec7d6f9a7c-nova-metadata-tls-certs\") pod \"3ea3fd85-7822-44e8-a112-9aec7d6f9a7c\" (UID: \"3ea3fd85-7822-44e8-a112-9aec7d6f9a7c\") " Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.434231 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v2crb\" (UniqueName: \"kubernetes.io/projected/3ea3fd85-7822-44e8-a112-9aec7d6f9a7c-kube-api-access-v2crb\") pod \"3ea3fd85-7822-44e8-a112-9aec7d6f9a7c\" (UID: \"3ea3fd85-7822-44e8-a112-9aec7d6f9a7c\") " Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.434387 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3ea3fd85-7822-44e8-a112-9aec7d6f9a7c-logs\") pod \"3ea3fd85-7822-44e8-a112-9aec7d6f9a7c\" (UID: \"3ea3fd85-7822-44e8-a112-9aec7d6f9a7c\") " Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.434445 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3ea3fd85-7822-44e8-a112-9aec7d6f9a7c-combined-ca-bundle\") pod \"3ea3fd85-7822-44e8-a112-9aec7d6f9a7c\" (UID: \"3ea3fd85-7822-44e8-a112-9aec7d6f9a7c\") " Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.434484 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3ea3fd85-7822-44e8-a112-9aec7d6f9a7c-config-data\") pod \"3ea3fd85-7822-44e8-a112-9aec7d6f9a7c\" (UID: \"3ea3fd85-7822-44e8-a112-9aec7d6f9a7c\") " Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.435591 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/86686d29-4c19-43e3-97a8-d8373883dc6a-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.435614 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7ea8cd10-4026-4603-a76b-b26ebe185441-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.435625 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/7ea8cd10-4026-4603-a76b-b26ebe185441-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.435637 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pssnq\" (UniqueName: \"kubernetes.io/projected/771204f4-c55f-4a6e-be63-70f3d1c8a51e-kube-api-access-pssnq\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.435651 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7ea8cd10-4026-4603-a76b-b26ebe185441-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.435660 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/771204f4-c55f-4a6e-be63-70f3d1c8a51e-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.435669 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/771204f4-c55f-4a6e-be63-70f3d1c8a51e-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.435679 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/7ea8cd10-4026-4603-a76b-b26ebe185441-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.435691 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9z9cv\" (UniqueName: \"kubernetes.io/projected/7ea8cd10-4026-4603-a76b-b26ebe185441-kube-api-access-9z9cv\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.435702 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bt84v\" (UniqueName: \"kubernetes.io/projected/86686d29-4c19-43e3-97a8-d8373883dc6a-kube-api-access-bt84v\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.435712 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7ea8cd10-4026-4603-a76b-b26ebe185441-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.436274 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ea3fd85-7822-44e8-a112-9aec7d6f9a7c-logs" (OuterVolumeSpecName: "logs") pod "3ea3fd85-7822-44e8-a112-9aec7d6f9a7c" (UID: "3ea3fd85-7822-44e8-a112-9aec7d6f9a7c"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:24:31 crc kubenswrapper[5120]: E0316 16:24:31.436688 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 16:24:31 crc kubenswrapper[5120]: E0316 16:24:31.436758 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00712a43-f38b-478f-bd42-a8cb0c2c14b3-combined-ca-bundle podName:00712a43-f38b-478f-bd42-a8cb0c2c14b3 nodeName:}" failed. No retries permitted until 2026-03-16 16:24:35.436730711 +0000 UTC m=+3177.590662368 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/00712a43-f38b-478f-bd42-a8cb0c2c14b3-combined-ca-bundle") pod "nova-cell1-conductor-0" (UID: "00712a43-f38b-478f-bd42-a8cb0c2c14b3") : secret "combined-ca-bundle" not found Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.439949 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ea3fd85-7822-44e8-a112-9aec7d6f9a7c-kube-api-access-v2crb" (OuterVolumeSpecName: "kube-api-access-v2crb") pod "3ea3fd85-7822-44e8-a112-9aec7d6f9a7c" (UID: "3ea3fd85-7822-44e8-a112-9aec7d6f9a7c"). InnerVolumeSpecName "kube-api-access-v2crb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.453021 5120 generic.go:358] "Generic (PLEG): container finished" podID="9185c9ac-7b26-4bbc-be42-545c166ba2c8" containerID="adf00bc598caf7fd100ad6d9a04dd18b37b6a59bdd16122c1c463bf65b466e55" exitCode=0 Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.453204 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"9185c9ac-7b26-4bbc-be42-545c166ba2c8","Type":"ContainerDied","Data":"adf00bc598caf7fd100ad6d9a04dd18b37b6a59bdd16122c1c463bf65b466e55"} Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.455099 5120 generic.go:358] "Generic (PLEG): container finished" podID="e15efd1b-6aa8-4a24-b576-4e03e19e19d0" containerID="1ef4b2599981ce7b8001b50ecfd4a007c4f23a0c049893394acf7b049e550690" exitCode=0 Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.455204 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/watcher-api-0" event={"ID":"e15efd1b-6aa8-4a24-b576-4e03e19e19d0","Type":"ContainerDied","Data":"1ef4b2599981ce7b8001b50ecfd4a007c4f23a0c049893394acf7b049e550690"} Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.462571 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/771204f4-c55f-4a6e-be63-70f3d1c8a51e-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "771204f4-c55f-4a6e-be63-70f3d1c8a51e" (UID: "771204f4-c55f-4a6e-be63-70f3d1c8a51e"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.464046 5120 generic.go:358] "Generic (PLEG): container finished" podID="d4b88a4e-143e-46bd-ada8-56dece11d6cc" containerID="bcf29711a914125565b105b455e66a7b23dfececab72dcb037b0a8c45113f6ab" exitCode=0 Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.464650 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"d4b88a4e-143e-46bd-ada8-56dece11d6cc","Type":"ContainerDied","Data":"bcf29711a914125565b105b455e66a7b23dfececab72dcb037b0a8c45113f6ab"} Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.470209 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7ea8cd10-4026-4603-a76b-b26ebe185441-config-data" (OuterVolumeSpecName: "config-data") pod "7ea8cd10-4026-4603-a76b-b26ebe185441" (UID: "7ea8cd10-4026-4603-a76b-b26ebe185441"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.472727 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.472734 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"3ea3fd85-7822-44e8-a112-9aec7d6f9a7c","Type":"ContainerDied","Data":"4ea09e08e85b261a659b39580e998425395c7ffa64c9d1c9ae71d3e57222b903"} Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.472824 5120 generic.go:358] "Generic (PLEG): container finished" podID="3ea3fd85-7822-44e8-a112-9aec7d6f9a7c" containerID="4ea09e08e85b261a659b39580e998425395c7ffa64c9d1c9ae71d3e57222b903" exitCode=0 Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.473033 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"3ea3fd85-7822-44e8-a112-9aec7d6f9a7c","Type":"ContainerDied","Data":"ecd246ec16fff8ecf2c8fe3b3972b32fa328a286bc8de100f83d7a17a7db47b6"} Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.474999 5120 scope.go:117] "RemoveContainer" containerID="533af2cb60162ddbab3651bb11e174e85e24fca07c3ffcfd31f3cbe35830d8bd" Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.477831 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-rvrb7" event={"ID":"86686d29-4c19-43e3-97a8-d8373883dc6a","Type":"ContainerDied","Data":"56cf441eab6ffa06432f4cc0a85ea88a0672eaa5657fa69a5a3533853a39fd4d"} Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.477920 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-rvrb7" Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.484916 5120 generic.go:358] "Generic (PLEG): container finished" podID="79383c2c-77ce-4694-acfd-f65a93d14d36" containerID="f553eca0fd2ecf045ea723c74a9de9bad3d2b0275e01c2e51bf1cd235ad00eb5" exitCode=0 Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.485083 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"79383c2c-77ce-4694-acfd-f65a93d14d36","Type":"ContainerDied","Data":"f553eca0fd2ecf045ea723c74a9de9bad3d2b0275e01c2e51bf1cd235ad00eb5"} Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.485124 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"79383c2c-77ce-4694-acfd-f65a93d14d36","Type":"ContainerDied","Data":"7aaba374563b7fe33dbe346a55235637987db5b53c31ff3f0647c9cff5a3128d"} Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.485231 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.497866 5120 scope.go:117] "RemoveContainer" containerID="9502739a7d25d2137566dcf525619e40c2aee690dead067c34fdb4a1fc4f0c13" Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.509347 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-q5hqq" event={"ID":"5132805e-c90f-44bf-a405-0a3fae248b25","Type":"ContainerStarted","Data":"566d78b0f8070276e13b3342ee30e370f030412b271305de46b708db6c533d94"} Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.509946 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-q5hqq" Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.519322 5120 generic.go:358] "Generic (PLEG): container finished" podID="7ea8cd10-4026-4603-a76b-b26ebe185441" containerID="2a90a1b43864b07de00f6e1d407ba798daf32a8248e46043a557119db32aff1d" exitCode=0 Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.519685 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"7ea8cd10-4026-4603-a76b-b26ebe185441","Type":"ContainerDied","Data":"2a90a1b43864b07de00f6e1d407ba798daf32a8248e46043a557119db32aff1d"} Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.519728 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"7ea8cd10-4026-4603-a76b-b26ebe185441","Type":"ContainerDied","Data":"5019dfad6719a1fa7a4319b1a9237d7eaaadf94171dd04c8d16917f3a4869715"} Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.519929 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.536798 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bsl8f\" (UniqueName: \"kubernetes.io/projected/79383c2c-77ce-4694-acfd-f65a93d14d36-kube-api-access-bsl8f\") pod \"79383c2c-77ce-4694-acfd-f65a93d14d36\" (UID: \"79383c2c-77ce-4694-acfd-f65a93d14d36\") " Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.536945 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/79383c2c-77ce-4694-acfd-f65a93d14d36-config-data\") pod \"79383c2c-77ce-4694-acfd-f65a93d14d36\" (UID: \"79383c2c-77ce-4694-acfd-f65a93d14d36\") " Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.537011 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/79383c2c-77ce-4694-acfd-f65a93d14d36-httpd-run\") pod \"79383c2c-77ce-4694-acfd-f65a93d14d36\" (UID: \"79383c2c-77ce-4694-acfd-f65a93d14d36\") " Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.537038 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/79383c2c-77ce-4694-acfd-f65a93d14d36-scripts\") pod \"79383c2c-77ce-4694-acfd-f65a93d14d36\" (UID: \"79383c2c-77ce-4694-acfd-f65a93d14d36\") " Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.537171 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/79383c2c-77ce-4694-acfd-f65a93d14d36-logs\") pod \"79383c2c-77ce-4694-acfd-f65a93d14d36\" (UID: \"79383c2c-77ce-4694-acfd-f65a93d14d36\") " Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.537256 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/79383c2c-77ce-4694-acfd-f65a93d14d36-internal-tls-certs\") pod \"79383c2c-77ce-4694-acfd-f65a93d14d36\" (UID: \"79383c2c-77ce-4694-acfd-f65a93d14d36\") " Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.537284 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"79383c2c-77ce-4694-acfd-f65a93d14d36\" (UID: \"79383c2c-77ce-4694-acfd-f65a93d14d36\") " Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.537467 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/79383c2c-77ce-4694-acfd-f65a93d14d36-combined-ca-bundle\") pod \"79383c2c-77ce-4694-acfd-f65a93d14d36\" (UID: \"79383c2c-77ce-4694-acfd-f65a93d14d36\") " Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.538106 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v2crb\" (UniqueName: \"kubernetes.io/projected/3ea3fd85-7822-44e8-a112-9aec7d6f9a7c-kube-api-access-v2crb\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.538125 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7ea8cd10-4026-4603-a76b-b26ebe185441-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.538133 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3ea3fd85-7822-44e8-a112-9aec7d6f9a7c-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.538142 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/771204f4-c55f-4a6e-be63-70f3d1c8a51e-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.548744 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79383c2c-77ce-4694-acfd-f65a93d14d36-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "79383c2c-77ce-4694-acfd-f65a93d14d36" (UID: "79383c2c-77ce-4694-acfd-f65a93d14d36"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.553259 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-q5hqq" podStartSLOduration=5.553237817 podStartE2EDuration="5.553237817s" podCreationTimestamp="2026-03-16 16:24:26 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:24:31.528046913 +0000 UTC m=+3173.681978580" watchObservedRunningTime="2026-03-16 16:24:31.553237817 +0000 UTC m=+3173.707169474" Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.553750 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-87c8bf854-gkthd" event={"ID":"771204f4-c55f-4a6e-be63-70f3d1c8a51e","Type":"ContainerDied","Data":"be03b69fe55b2f23810330a8ea422eea7dc474c4dbfe4a78a1f517279c23f519"} Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.554013 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-87c8bf854-gkthd" Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.556908 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79383c2c-77ce-4694-acfd-f65a93d14d36-logs" (OuterVolumeSpecName: "logs") pod "79383c2c-77ce-4694-acfd-f65a93d14d36" (UID: "79383c2c-77ce-4694-acfd-f65a93d14d36"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.560188 5120 scope.go:117] "RemoveContainer" containerID="0332ef9a2b607b7a01644fa26cd31f338123d18f32f186ba2acdff4ad391e66e" Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.577539 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79383c2c-77ce-4694-acfd-f65a93d14d36-kube-api-access-bsl8f" (OuterVolumeSpecName: "kube-api-access-bsl8f") pod "79383c2c-77ce-4694-acfd-f65a93d14d36" (UID: "79383c2c-77ce-4694-acfd-f65a93d14d36"). InnerVolumeSpecName "kube-api-access-bsl8f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.577641 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage20-crc" (OuterVolumeSpecName: "glance") pod "79383c2c-77ce-4694-acfd-f65a93d14d36" (UID: "79383c2c-77ce-4694-acfd-f65a93d14d36"). InnerVolumeSpecName "local-storage20-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.590965 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3ea3fd85-7822-44e8-a112-9aec7d6f9a7c-config-data" (OuterVolumeSpecName: "config-data") pod "3ea3fd85-7822-44e8-a112-9aec7d6f9a7c" (UID: "3ea3fd85-7822-44e8-a112-9aec7d6f9a7c"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.602715 5120 scope.go:117] "RemoveContainer" containerID="0332ef9a2b607b7a01644fa26cd31f338123d18f32f186ba2acdff4ad391e66e" Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.608899 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/79383c2c-77ce-4694-acfd-f65a93d14d36-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "79383c2c-77ce-4694-acfd-f65a93d14d36" (UID: "79383c2c-77ce-4694-acfd-f65a93d14d36"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:24:31 crc kubenswrapper[5120]: E0316 16:24:31.610957 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0332ef9a2b607b7a01644fa26cd31f338123d18f32f186ba2acdff4ad391e66e\": container with ID starting with 0332ef9a2b607b7a01644fa26cd31f338123d18f32f186ba2acdff4ad391e66e not found: ID does not exist" containerID="0332ef9a2b607b7a01644fa26cd31f338123d18f32f186ba2acdff4ad391e66e" Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.611005 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0332ef9a2b607b7a01644fa26cd31f338123d18f32f186ba2acdff4ad391e66e"} err="failed to get container status \"0332ef9a2b607b7a01644fa26cd31f338123d18f32f186ba2acdff4ad391e66e\": rpc error: code = NotFound desc = could not find container \"0332ef9a2b607b7a01644fa26cd31f338123d18f32f186ba2acdff4ad391e66e\": container with ID starting with 0332ef9a2b607b7a01644fa26cd31f338123d18f32f186ba2acdff4ad391e66e not found: ID does not exist" Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.611036 5120 scope.go:117] "RemoveContainer" containerID="4ea09e08e85b261a659b39580e998425395c7ffa64c9d1c9ae71d3e57222b903" Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.626940 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-rvrb7"] Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.628094 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/771204f4-c55f-4a6e-be63-70f3d1c8a51e-config-data" (OuterVolumeSpecName: "config-data") pod "771204f4-c55f-4a6e-be63-70f3d1c8a51e" (UID: "771204f4-c55f-4a6e-be63-70f3d1c8a51e"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.630343 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/watcher-api-0" Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.639904 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/79383c2c-77ce-4694-acfd-f65a93d14d36-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.640028 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/79383c2c-77ce-4694-acfd-f65a93d14d36-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.640097 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") on node \"crc\" " Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.640151 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/771204f4-c55f-4a6e-be63-70f3d1c8a51e-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.640215 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/79383c2c-77ce-4694-acfd-f65a93d14d36-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.640273 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3ea3fd85-7822-44e8-a112-9aec7d6f9a7c-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.640409 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bsl8f\" (UniqueName: \"kubernetes.io/projected/79383c2c-77ce-4694-acfd-f65a93d14d36-kube-api-access-bsl8f\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.651081 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-rvrb7"] Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.662284 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3ea3fd85-7822-44e8-a112-9aec7d6f9a7c-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "3ea3fd85-7822-44e8-a112-9aec7d6f9a7c" (UID: "3ea3fd85-7822-44e8-a112-9aec7d6f9a7c"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.662380 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/79383c2c-77ce-4694-acfd-f65a93d14d36-scripts" (OuterVolumeSpecName: "scripts") pod "79383c2c-77ce-4694-acfd-f65a93d14d36" (UID: "79383c2c-77ce-4694-acfd-f65a93d14d36"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.666102 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3ea3fd85-7822-44e8-a112-9aec7d6f9a7c-nova-metadata-tls-certs" (OuterVolumeSpecName: "nova-metadata-tls-certs") pod "3ea3fd85-7822-44e8-a112-9aec7d6f9a7c" (UID: "3ea3fd85-7822-44e8-a112-9aec7d6f9a7c"). InnerVolumeSpecName "nova-metadata-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.667190 5120 scope.go:117] "RemoveContainer" containerID="dddf01fb2a62a299ce661c264a716a073896f253775f73284ef6259d80e680a7" Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.673282 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/79383c2c-77ce-4694-acfd-f65a93d14d36-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "79383c2c-77ce-4694-acfd-f65a93d14d36" (UID: "79383c2c-77ce-4694-acfd-f65a93d14d36"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.680583 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/771204f4-c55f-4a6e-be63-70f3d1c8a51e-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "771204f4-c55f-4a6e-be63-70f3d1c8a51e" (UID: "771204f4-c55f-4a6e-be63-70f3d1c8a51e"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.680991 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/771204f4-c55f-4a6e-be63-70f3d1c8a51e-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "771204f4-c55f-4a6e-be63-70f3d1c8a51e" (UID: "771204f4-c55f-4a6e-be63-70f3d1c8a51e"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.683537 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage20-crc" (UniqueName: "kubernetes.io/local-volume/local-storage20-crc") on node "crc" Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.684428 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7ea8cd10-4026-4603-a76b-b26ebe185441-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "7ea8cd10-4026-4603-a76b-b26ebe185441" (UID: "7ea8cd10-4026-4603-a76b-b26ebe185441"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.687561 5120 scope.go:117] "RemoveContainer" containerID="4ea09e08e85b261a659b39580e998425395c7ffa64c9d1c9ae71d3e57222b903" Mar 16 16:24:31 crc kubenswrapper[5120]: E0316 16:24:31.688061 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ea09e08e85b261a659b39580e998425395c7ffa64c9d1c9ae71d3e57222b903\": container with ID starting with 4ea09e08e85b261a659b39580e998425395c7ffa64c9d1c9ae71d3e57222b903 not found: ID does not exist" containerID="4ea09e08e85b261a659b39580e998425395c7ffa64c9d1c9ae71d3e57222b903" Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.688132 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ea09e08e85b261a659b39580e998425395c7ffa64c9d1c9ae71d3e57222b903"} err="failed to get container status \"4ea09e08e85b261a659b39580e998425395c7ffa64c9d1c9ae71d3e57222b903\": rpc error: code = NotFound desc = could not find container \"4ea09e08e85b261a659b39580e998425395c7ffa64c9d1c9ae71d3e57222b903\": container with ID starting with 4ea09e08e85b261a659b39580e998425395c7ffa64c9d1c9ae71d3e57222b903 not found: ID does not exist" Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.688171 5120 scope.go:117] "RemoveContainer" containerID="dddf01fb2a62a299ce661c264a716a073896f253775f73284ef6259d80e680a7" Mar 16 16:24:31 crc kubenswrapper[5120]: E0316 16:24:31.688676 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dddf01fb2a62a299ce661c264a716a073896f253775f73284ef6259d80e680a7\": container with ID starting with dddf01fb2a62a299ce661c264a716a073896f253775f73284ef6259d80e680a7 not found: ID does not exist" containerID="dddf01fb2a62a299ce661c264a716a073896f253775f73284ef6259d80e680a7" Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.688713 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dddf01fb2a62a299ce661c264a716a073896f253775f73284ef6259d80e680a7"} err="failed to get container status \"dddf01fb2a62a299ce661c264a716a073896f253775f73284ef6259d80e680a7\": rpc error: code = NotFound desc = could not find container \"dddf01fb2a62a299ce661c264a716a073896f253775f73284ef6259d80e680a7\": container with ID starting with dddf01fb2a62a299ce661c264a716a073896f253775f73284ef6259d80e680a7 not found: ID does not exist" Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.688737 5120 scope.go:117] "RemoveContainer" containerID="c156c86d2309060a909297c5becf2362c59502c26dff06e06c9dfdcf68581ad2" Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.693735 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-85c89c7f6-6429v" podUID="69c47154-7063-4a88-af54-c4dba11e7fd6" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.1.100:9311/healthcheck\": read tcp 10.217.0.2:56698->10.217.1.100:9311: read: connection reset by peer" Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.716596 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/79383c2c-77ce-4694-acfd-f65a93d14d36-config-data" (OuterVolumeSpecName: "config-data") pod "79383c2c-77ce-4694-acfd-f65a93d14d36" (UID: "79383c2c-77ce-4694-acfd-f65a93d14d36"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.741416 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"custom-prometheus-ca\" (UniqueName: \"kubernetes.io/secret/e15efd1b-6aa8-4a24-b576-4e03e19e19d0-custom-prometheus-ca\") pod \"e15efd1b-6aa8-4a24-b576-4e03e19e19d0\" (UID: \"e15efd1b-6aa8-4a24-b576-4e03e19e19d0\") " Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.741454 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e15efd1b-6aa8-4a24-b576-4e03e19e19d0-internal-tls-certs\") pod \"e15efd1b-6aa8-4a24-b576-4e03e19e19d0\" (UID: \"e15efd1b-6aa8-4a24-b576-4e03e19e19d0\") " Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.741525 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e15efd1b-6aa8-4a24-b576-4e03e19e19d0-logs\") pod \"e15efd1b-6aa8-4a24-b576-4e03e19e19d0\" (UID: \"e15efd1b-6aa8-4a24-b576-4e03e19e19d0\") " Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.741543 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e15efd1b-6aa8-4a24-b576-4e03e19e19d0-public-tls-certs\") pod \"e15efd1b-6aa8-4a24-b576-4e03e19e19d0\" (UID: \"e15efd1b-6aa8-4a24-b576-4e03e19e19d0\") " Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.741606 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e15efd1b-6aa8-4a24-b576-4e03e19e19d0-config-data\") pod \"e15efd1b-6aa8-4a24-b576-4e03e19e19d0\" (UID: \"e15efd1b-6aa8-4a24-b576-4e03e19e19d0\") " Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.741674 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e15efd1b-6aa8-4a24-b576-4e03e19e19d0-combined-ca-bundle\") pod \"e15efd1b-6aa8-4a24-b576-4e03e19e19d0\" (UID: \"e15efd1b-6aa8-4a24-b576-4e03e19e19d0\") " Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.741854 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t8bb9\" (UniqueName: \"kubernetes.io/projected/e15efd1b-6aa8-4a24-b576-4e03e19e19d0-kube-api-access-t8bb9\") pod \"e15efd1b-6aa8-4a24-b576-4e03e19e19d0\" (UID: \"e15efd1b-6aa8-4a24-b576-4e03e19e19d0\") " Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.743358 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/771204f4-c55f-4a6e-be63-70f3d1c8a51e-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.743374 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/79383c2c-77ce-4694-acfd-f65a93d14d36-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.743382 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/79383c2c-77ce-4694-acfd-f65a93d14d36-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.743391 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.743402 5120 reconciler_common.go:299] "Volume detached for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/3ea3fd85-7822-44e8-a112-9aec7d6f9a7c-nova-metadata-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.743412 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/771204f4-c55f-4a6e-be63-70f3d1c8a51e-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.743440 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3ea3fd85-7822-44e8-a112-9aec7d6f9a7c-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.743449 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/7ea8cd10-4026-4603-a76b-b26ebe185441-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.743457 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/79383c2c-77ce-4694-acfd-f65a93d14d36-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.744214 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e15efd1b-6aa8-4a24-b576-4e03e19e19d0-logs" (OuterVolumeSpecName: "logs") pod "e15efd1b-6aa8-4a24-b576-4e03e19e19d0" (UID: "e15efd1b-6aa8-4a24-b576-4e03e19e19d0"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.746380 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e15efd1b-6aa8-4a24-b576-4e03e19e19d0-kube-api-access-t8bb9" (OuterVolumeSpecName: "kube-api-access-t8bb9") pod "e15efd1b-6aa8-4a24-b576-4e03e19e19d0" (UID: "e15efd1b-6aa8-4a24-b576-4e03e19e19d0"). InnerVolumeSpecName "kube-api-access-t8bb9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.765457 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e15efd1b-6aa8-4a24-b576-4e03e19e19d0-custom-prometheus-ca" (OuterVolumeSpecName: "custom-prometheus-ca") pod "e15efd1b-6aa8-4a24-b576-4e03e19e19d0" (UID: "e15efd1b-6aa8-4a24-b576-4e03e19e19d0"). InnerVolumeSpecName "custom-prometheus-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.796222 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e15efd1b-6aa8-4a24-b576-4e03e19e19d0-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e15efd1b-6aa8-4a24-b576-4e03e19e19d0" (UID: "e15efd1b-6aa8-4a24-b576-4e03e19e19d0"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.811638 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e15efd1b-6aa8-4a24-b576-4e03e19e19d0-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "e15efd1b-6aa8-4a24-b576-4e03e19e19d0" (UID: "e15efd1b-6aa8-4a24-b576-4e03e19e19d0"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.817178 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e15efd1b-6aa8-4a24-b576-4e03e19e19d0-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "e15efd1b-6aa8-4a24-b576-4e03e19e19d0" (UID: "e15efd1b-6aa8-4a24-b576-4e03e19e19d0"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.838430 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e15efd1b-6aa8-4a24-b576-4e03e19e19d0-config-data" (OuterVolumeSpecName: "config-data") pod "e15efd1b-6aa8-4a24-b576-4e03e19e19d0" (UID: "e15efd1b-6aa8-4a24-b576-4e03e19e19d0"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.845302 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t8bb9\" (UniqueName: \"kubernetes.io/projected/e15efd1b-6aa8-4a24-b576-4e03e19e19d0-kube-api-access-t8bb9\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.845338 5120 reconciler_common.go:299] "Volume detached for volume \"custom-prometheus-ca\" (UniqueName: \"kubernetes.io/secret/e15efd1b-6aa8-4a24-b576-4e03e19e19d0-custom-prometheus-ca\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.845347 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e15efd1b-6aa8-4a24-b576-4e03e19e19d0-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.845358 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e15efd1b-6aa8-4a24-b576-4e03e19e19d0-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.845369 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e15efd1b-6aa8-4a24-b576-4e03e19e19d0-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.845377 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e15efd1b-6aa8-4a24-b576-4e03e19e19d0-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:31 crc kubenswrapper[5120]: I0316 16:24:31.845386 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e15efd1b-6aa8-4a24-b576-4e03e19e19d0-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.317180 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.317227 5120 scope.go:117] "RemoveContainer" containerID="f553eca0fd2ecf045ea723c74a9de9bad3d2b0275e01c2e51bf1cd235ad00eb5" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.331534 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.334044 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-85c89c7f6-6429v" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.346398 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/watcher-applier-0" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.365663 5120 scope.go:117] "RemoveContainer" containerID="23319fc57aa64fe609c628ba0cd9c070d7c509b1db6779e65be1e844ed0d962a" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.366866 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-6f68c75449-s4d7j" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.395532 5120 scope.go:117] "RemoveContainer" containerID="f553eca0fd2ecf045ea723c74a9de9bad3d2b0275e01c2e51bf1cd235ad00eb5" Mar 16 16:24:32 crc kubenswrapper[5120]: E0316 16:24:32.396659 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f553eca0fd2ecf045ea723c74a9de9bad3d2b0275e01c2e51bf1cd235ad00eb5\": container with ID starting with f553eca0fd2ecf045ea723c74a9de9bad3d2b0275e01c2e51bf1cd235ad00eb5 not found: ID does not exist" containerID="f553eca0fd2ecf045ea723c74a9de9bad3d2b0275e01c2e51bf1cd235ad00eb5" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.396714 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f553eca0fd2ecf045ea723c74a9de9bad3d2b0275e01c2e51bf1cd235ad00eb5"} err="failed to get container status \"f553eca0fd2ecf045ea723c74a9de9bad3d2b0275e01c2e51bf1cd235ad00eb5\": rpc error: code = NotFound desc = could not find container \"f553eca0fd2ecf045ea723c74a9de9bad3d2b0275e01c2e51bf1cd235ad00eb5\": container with ID starting with f553eca0fd2ecf045ea723c74a9de9bad3d2b0275e01c2e51bf1cd235ad00eb5 not found: ID does not exist" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.396745 5120 scope.go:117] "RemoveContainer" containerID="23319fc57aa64fe609c628ba0cd9c070d7c509b1db6779e65be1e844ed0d962a" Mar 16 16:24:32 crc kubenswrapper[5120]: E0316 16:24:32.397333 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"23319fc57aa64fe609c628ba0cd9c070d7c509b1db6779e65be1e844ed0d962a\": container with ID starting with 23319fc57aa64fe609c628ba0cd9c070d7c509b1db6779e65be1e844ed0d962a not found: ID does not exist" containerID="23319fc57aa64fe609c628ba0cd9c070d7c509b1db6779e65be1e844ed0d962a" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.397434 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23319fc57aa64fe609c628ba0cd9c070d7c509b1db6779e65be1e844ed0d962a"} err="failed to get container status \"23319fc57aa64fe609c628ba0cd9c070d7c509b1db6779e65be1e844ed0d962a\": rpc error: code = NotFound desc = could not find container \"23319fc57aa64fe609c628ba0cd9c070d7c509b1db6779e65be1e844ed0d962a\": container with ID starting with 23319fc57aa64fe609c628ba0cd9c070d7c509b1db6779e65be1e844ed0d962a not found: ID does not exist" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.397462 5120 scope.go:117] "RemoveContainer" containerID="2a90a1b43864b07de00f6e1d407ba798daf32a8248e46043a557119db32aff1d" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.403344 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.403710 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/keystone-7bc85bbbf-4ttl9" podUID="7b05ec0c-8f80-4a86-8823-629c4e953395" containerName="keystone-api" probeResult="failure" output="Get \"https://10.217.1.96:5000/v3\": read tcp 10.217.0.2:39152->10.217.1.96:5000: read: connection reset by peer" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.420577 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.423197 5120 scope.go:117] "RemoveContainer" containerID="012a3855ae67a12b9164354428ce7c259e43b459de8113e16569a6cd9ad28f57" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.424834 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.436911 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.445064 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.453896 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-87c8bf854-gkthd"] Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.458246 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d4b88a4e-143e-46bd-ada8-56dece11d6cc-config-data\") pod \"d4b88a4e-143e-46bd-ada8-56dece11d6cc\" (UID: \"d4b88a4e-143e-46bd-ada8-56dece11d6cc\") " Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.458291 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d4b88a4e-143e-46bd-ada8-56dece11d6cc-logs\") pod \"d4b88a4e-143e-46bd-ada8-56dece11d6cc\" (UID: \"d4b88a4e-143e-46bd-ada8-56dece11d6cc\") " Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.458329 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9185c9ac-7b26-4bbc-be42-545c166ba2c8-operator-scripts\") pod \"9185c9ac-7b26-4bbc-be42-545c166ba2c8\" (UID: \"9185c9ac-7b26-4bbc-be42-545c166ba2c8\") " Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.458376 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/69c47154-7063-4a88-af54-c4dba11e7fd6-combined-ca-bundle\") pod \"69c47154-7063-4a88-af54-c4dba11e7fd6\" (UID: \"69c47154-7063-4a88-af54-c4dba11e7fd6\") " Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.458429 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d4b88a4e-143e-46bd-ada8-56dece11d6cc-combined-ca-bundle\") pod \"d4b88a4e-143e-46bd-ada8-56dece11d6cc\" (UID: \"d4b88a4e-143e-46bd-ada8-56dece11d6cc\") " Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.458453 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8558eb14-801e-455b-8374-1c69e333901c-combined-ca-bundle\") pod \"8558eb14-801e-455b-8374-1c69e333901c\" (UID: \"8558eb14-801e-455b-8374-1c69e333901c\") " Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.458495 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/d4b88a4e-143e-46bd-ada8-56dece11d6cc-httpd-run\") pod \"d4b88a4e-143e-46bd-ada8-56dece11d6cc\" (UID: \"d4b88a4e-143e-46bd-ada8-56dece11d6cc\") " Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.458524 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8558eb14-801e-455b-8374-1c69e333901c-logs\") pod \"8558eb14-801e-455b-8374-1c69e333901c\" (UID: \"8558eb14-801e-455b-8374-1c69e333901c\") " Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.458552 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/9185c9ac-7b26-4bbc-be42-545c166ba2c8-config-data-generated\") pod \"9185c9ac-7b26-4bbc-be42-545c166ba2c8\" (UID: \"9185c9ac-7b26-4bbc-be42-545c166ba2c8\") " Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.458574 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4bgkg\" (UniqueName: \"kubernetes.io/projected/d5160b65-3a41-4645-9f47-bd4e891fef5f-kube-api-access-4bgkg\") pod \"d5160b65-3a41-4645-9f47-bd4e891fef5f\" (UID: \"d5160b65-3a41-4645-9f47-bd4e891fef5f\") " Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.458604 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/9185c9ac-7b26-4bbc-be42-545c166ba2c8-kolla-config\") pod \"9185c9ac-7b26-4bbc-be42-545c166ba2c8\" (UID: \"9185c9ac-7b26-4bbc-be42-545c166ba2c8\") " Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.458620 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/d4b88a4e-143e-46bd-ada8-56dece11d6cc-public-tls-certs\") pod \"d4b88a4e-143e-46bd-ada8-56dece11d6cc\" (UID: \"d4b88a4e-143e-46bd-ada8-56dece11d6cc\") " Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.458652 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fp2xj\" (UniqueName: \"kubernetes.io/projected/d4b88a4e-143e-46bd-ada8-56dece11d6cc-kube-api-access-fp2xj\") pod \"d4b88a4e-143e-46bd-ada8-56dece11d6cc\" (UID: \"d4b88a4e-143e-46bd-ada8-56dece11d6cc\") " Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.458648 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-87c8bf854-gkthd"] Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.458698 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") pod \"d4b88a4e-143e-46bd-ada8-56dece11d6cc\" (UID: \"d4b88a4e-143e-46bd-ada8-56dece11d6cc\") " Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.458716 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d5160b65-3a41-4645-9f47-bd4e891fef5f-combined-ca-bundle\") pod \"d5160b65-3a41-4645-9f47-bd4e891fef5f\" (UID: \"d5160b65-3a41-4645-9f47-bd4e891fef5f\") " Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.458776 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/69c47154-7063-4a88-af54-c4dba11e7fd6-config-data-custom\") pod \"69c47154-7063-4a88-af54-c4dba11e7fd6\" (UID: \"69c47154-7063-4a88-af54-c4dba11e7fd6\") " Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.458815 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/69c47154-7063-4a88-af54-c4dba11e7fd6-internal-tls-certs\") pod \"69c47154-7063-4a88-af54-c4dba11e7fd6\" (UID: \"69c47154-7063-4a88-af54-c4dba11e7fd6\") " Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.458847 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d5160b65-3a41-4645-9f47-bd4e891fef5f-logs\") pod \"d5160b65-3a41-4645-9f47-bd4e891fef5f\" (UID: \"d5160b65-3a41-4645-9f47-bd4e891fef5f\") " Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.458863 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/8558eb14-801e-455b-8374-1c69e333901c-config-data-custom\") pod \"8558eb14-801e-455b-8374-1c69e333901c\" (UID: \"8558eb14-801e-455b-8374-1c69e333901c\") " Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.458899 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d5160b65-3a41-4645-9f47-bd4e891fef5f-config-data\") pod \"d5160b65-3a41-4645-9f47-bd4e891fef5f\" (UID: \"d5160b65-3a41-4645-9f47-bd4e891fef5f\") " Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.458975 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/9185c9ac-7b26-4bbc-be42-545c166ba2c8-galera-tls-certs\") pod \"9185c9ac-7b26-4bbc-be42-545c166ba2c8\" (UID: \"9185c9ac-7b26-4bbc-be42-545c166ba2c8\") " Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.459050 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8558eb14-801e-455b-8374-1c69e333901c-config-data\") pod \"8558eb14-801e-455b-8374-1c69e333901c\" (UID: \"8558eb14-801e-455b-8374-1c69e333901c\") " Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.459069 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/69c47154-7063-4a88-af54-c4dba11e7fd6-config-data\") pod \"69c47154-7063-4a88-af54-c4dba11e7fd6\" (UID: \"69c47154-7063-4a88-af54-c4dba11e7fd6\") " Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.459108 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fg5ll\" (UniqueName: \"kubernetes.io/projected/8558eb14-801e-455b-8374-1c69e333901c-kube-api-access-fg5ll\") pod \"8558eb14-801e-455b-8374-1c69e333901c\" (UID: \"8558eb14-801e-455b-8374-1c69e333901c\") " Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.459132 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"mysql-db\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"9185c9ac-7b26-4bbc-be42-545c166ba2c8\" (UID: \"9185c9ac-7b26-4bbc-be42-545c166ba2c8\") " Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.459189 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/9185c9ac-7b26-4bbc-be42-545c166ba2c8-config-data-default\") pod \"9185c9ac-7b26-4bbc-be42-545c166ba2c8\" (UID: \"9185c9ac-7b26-4bbc-be42-545c166ba2c8\") " Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.459209 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gfjhp\" (UniqueName: \"kubernetes.io/projected/9185c9ac-7b26-4bbc-be42-545c166ba2c8-kube-api-access-gfjhp\") pod \"9185c9ac-7b26-4bbc-be42-545c166ba2c8\" (UID: \"9185c9ac-7b26-4bbc-be42-545c166ba2c8\") " Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.459238 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rpgf9\" (UniqueName: \"kubernetes.io/projected/69c47154-7063-4a88-af54-c4dba11e7fd6-kube-api-access-rpgf9\") pod \"69c47154-7063-4a88-af54-c4dba11e7fd6\" (UID: \"69c47154-7063-4a88-af54-c4dba11e7fd6\") " Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.459246 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9185c9ac-7b26-4bbc-be42-545c166ba2c8-config-data-generated" (OuterVolumeSpecName: "config-data-generated") pod "9185c9ac-7b26-4bbc-be42-545c166ba2c8" (UID: "9185c9ac-7b26-4bbc-be42-545c166ba2c8"). InnerVolumeSpecName "config-data-generated". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.459256 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9185c9ac-7b26-4bbc-be42-545c166ba2c8-combined-ca-bundle\") pod \"9185c9ac-7b26-4bbc-be42-545c166ba2c8\" (UID: \"9185c9ac-7b26-4bbc-be42-545c166ba2c8\") " Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.459391 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4b88a4e-143e-46bd-ada8-56dece11d6cc-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "d4b88a4e-143e-46bd-ada8-56dece11d6cc" (UID: "d4b88a4e-143e-46bd-ada8-56dece11d6cc"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.459677 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4b88a4e-143e-46bd-ada8-56dece11d6cc-logs" (OuterVolumeSpecName: "logs") pod "d4b88a4e-143e-46bd-ada8-56dece11d6cc" (UID: "d4b88a4e-143e-46bd-ada8-56dece11d6cc"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.459726 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8558eb14-801e-455b-8374-1c69e333901c-logs" (OuterVolumeSpecName: "logs") pod "8558eb14-801e-455b-8374-1c69e333901c" (UID: "8558eb14-801e-455b-8374-1c69e333901c"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.459830 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69c47154-7063-4a88-af54-c4dba11e7fd6-logs" (OuterVolumeSpecName: "logs") pod "69c47154-7063-4a88-af54-c4dba11e7fd6" (UID: "69c47154-7063-4a88-af54-c4dba11e7fd6"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.459415 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/69c47154-7063-4a88-af54-c4dba11e7fd6-logs\") pod \"69c47154-7063-4a88-af54-c4dba11e7fd6\" (UID: \"69c47154-7063-4a88-af54-c4dba11e7fd6\") " Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.459895 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d4b88a4e-143e-46bd-ada8-56dece11d6cc-scripts\") pod \"d4b88a4e-143e-46bd-ada8-56dece11d6cc\" (UID: \"d4b88a4e-143e-46bd-ada8-56dece11d6cc\") " Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.459944 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/69c47154-7063-4a88-af54-c4dba11e7fd6-public-tls-certs\") pod \"69c47154-7063-4a88-af54-c4dba11e7fd6\" (UID: \"69c47154-7063-4a88-af54-c4dba11e7fd6\") " Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.460504 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/69c47154-7063-4a88-af54-c4dba11e7fd6-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.460519 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d4b88a4e-143e-46bd-ada8-56dece11d6cc-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.460528 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/d4b88a4e-143e-46bd-ada8-56dece11d6cc-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.460536 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8558eb14-801e-455b-8374-1c69e333901c-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.460544 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/9185c9ac-7b26-4bbc-be42-545c166ba2c8-config-data-generated\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.466306 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5160b65-3a41-4645-9f47-bd4e891fef5f-logs" (OuterVolumeSpecName: "logs") pod "d5160b65-3a41-4645-9f47-bd4e891fef5f" (UID: "d5160b65-3a41-4645-9f47-bd4e891fef5f"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.467303 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9185c9ac-7b26-4bbc-be42-545c166ba2c8-config-data-default" (OuterVolumeSpecName: "config-data-default") pod "9185c9ac-7b26-4bbc-be42-545c166ba2c8" (UID: "9185c9ac-7b26-4bbc-be42-545c166ba2c8"). InnerVolumeSpecName "config-data-default". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.469677 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9185c9ac-7b26-4bbc-be42-545c166ba2c8-kube-api-access-gfjhp" (OuterVolumeSpecName: "kube-api-access-gfjhp") pod "9185c9ac-7b26-4bbc-be42-545c166ba2c8" (UID: "9185c9ac-7b26-4bbc-be42-545c166ba2c8"). InnerVolumeSpecName "kube-api-access-gfjhp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.471624 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69c47154-7063-4a88-af54-c4dba11e7fd6-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "69c47154-7063-4a88-af54-c4dba11e7fd6" (UID: "69c47154-7063-4a88-af54-c4dba11e7fd6"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.478158 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9185c9ac-7b26-4bbc-be42-545c166ba2c8-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "9185c9ac-7b26-4bbc-be42-545c166ba2c8" (UID: "9185c9ac-7b26-4bbc-be42-545c166ba2c8"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.479133 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9185c9ac-7b26-4bbc-be42-545c166ba2c8-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "9185c9ac-7b26-4bbc-be42-545c166ba2c8" (UID: "9185c9ac-7b26-4bbc-be42-545c166ba2c8"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.495629 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4b88a4e-143e-46bd-ada8-56dece11d6cc-scripts" (OuterVolumeSpecName: "scripts") pod "d4b88a4e-143e-46bd-ada8-56dece11d6cc" (UID: "d4b88a4e-143e-46bd-ada8-56dece11d6cc"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.496046 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage19-crc" (OuterVolumeSpecName: "glance") pod "d4b88a4e-143e-46bd-ada8-56dece11d6cc" (UID: "d4b88a4e-143e-46bd-ada8-56dece11d6cc"). InnerVolumeSpecName "local-storage19-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.500857 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69c47154-7063-4a88-af54-c4dba11e7fd6-kube-api-access-rpgf9" (OuterVolumeSpecName: "kube-api-access-rpgf9") pod "69c47154-7063-4a88-af54-c4dba11e7fd6" (UID: "69c47154-7063-4a88-af54-c4dba11e7fd6"). InnerVolumeSpecName "kube-api-access-rpgf9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.501374 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8558eb14-801e-455b-8374-1c69e333901c-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "8558eb14-801e-455b-8374-1c69e333901c" (UID: "8558eb14-801e-455b-8374-1c69e333901c"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.505030 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4b88a4e-143e-46bd-ada8-56dece11d6cc-kube-api-access-fp2xj" (OuterVolumeSpecName: "kube-api-access-fp2xj") pod "d4b88a4e-143e-46bd-ada8-56dece11d6cc" (UID: "d4b88a4e-143e-46bd-ada8-56dece11d6cc"). InnerVolumeSpecName "kube-api-access-fp2xj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.507546 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5160b65-3a41-4645-9f47-bd4e891fef5f-kube-api-access-4bgkg" (OuterVolumeSpecName: "kube-api-access-4bgkg") pod "d5160b65-3a41-4645-9f47-bd4e891fef5f" (UID: "d5160b65-3a41-4645-9f47-bd4e891fef5f"). InnerVolumeSpecName "kube-api-access-4bgkg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.507606 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8558eb14-801e-455b-8374-1c69e333901c-kube-api-access-fg5ll" (OuterVolumeSpecName: "kube-api-access-fg5ll") pod "8558eb14-801e-455b-8374-1c69e333901c" (UID: "8558eb14-801e-455b-8374-1c69e333901c"). InnerVolumeSpecName "kube-api-access-fg5ll". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.517778 5120 scope.go:117] "RemoveContainer" containerID="2a90a1b43864b07de00f6e1d407ba798daf32a8248e46043a557119db32aff1d" Mar 16 16:24:32 crc kubenswrapper[5120]: E0316 16:24:32.518270 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2a90a1b43864b07de00f6e1d407ba798daf32a8248e46043a557119db32aff1d\": container with ID starting with 2a90a1b43864b07de00f6e1d407ba798daf32a8248e46043a557119db32aff1d not found: ID does not exist" containerID="2a90a1b43864b07de00f6e1d407ba798daf32a8248e46043a557119db32aff1d" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.518317 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a90a1b43864b07de00f6e1d407ba798daf32a8248e46043a557119db32aff1d"} err="failed to get container status \"2a90a1b43864b07de00f6e1d407ba798daf32a8248e46043a557119db32aff1d\": rpc error: code = NotFound desc = could not find container \"2a90a1b43864b07de00f6e1d407ba798daf32a8248e46043a557119db32aff1d\": container with ID starting with 2a90a1b43864b07de00f6e1d407ba798daf32a8248e46043a557119db32aff1d not found: ID does not exist" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.518343 5120 scope.go:117] "RemoveContainer" containerID="012a3855ae67a12b9164354428ce7c259e43b459de8113e16569a6cd9ad28f57" Mar 16 16:24:32 crc kubenswrapper[5120]: E0316 16:24:32.518993 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"012a3855ae67a12b9164354428ce7c259e43b459de8113e16569a6cd9ad28f57\": container with ID starting with 012a3855ae67a12b9164354428ce7c259e43b459de8113e16569a6cd9ad28f57 not found: ID does not exist" containerID="012a3855ae67a12b9164354428ce7c259e43b459de8113e16569a6cd9ad28f57" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.519031 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"012a3855ae67a12b9164354428ce7c259e43b459de8113e16569a6cd9ad28f57"} err="failed to get container status \"012a3855ae67a12b9164354428ce7c259e43b459de8113e16569a6cd9ad28f57\": rpc error: code = NotFound desc = could not find container \"012a3855ae67a12b9164354428ce7c259e43b459de8113e16569a6cd9ad28f57\": container with ID starting with 012a3855ae67a12b9164354428ce7c259e43b459de8113e16569a6cd9ad28f57 not found: ID does not exist" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.519061 5120 scope.go:117] "RemoveContainer" containerID="7c4f8549d75fe7169915e7f6cda9d1b1a6faa1e896903408eeb16bd5e1ec8969" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.524019 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.526408 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8558eb14-801e-455b-8374-1c69e333901c-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "8558eb14-801e-455b-8374-1c69e333901c" (UID: "8558eb14-801e-455b-8374-1c69e333901c"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:24:32 crc kubenswrapper[5120]: E0316 16:24:32.542812 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 0419588781daf97a47d3362db1f9a8d1a88d231d99c1a6cb08730e97206c4fed is running failed: container process not found" containerID="0419588781daf97a47d3362db1f9a8d1a88d231d99c1a6cb08730e97206c4fed" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Mar 16 16:24:32 crc kubenswrapper[5120]: E0316 16:24:32.543857 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 0419588781daf97a47d3362db1f9a8d1a88d231d99c1a6cb08730e97206c4fed is running failed: container process not found" containerID="0419588781daf97a47d3362db1f9a8d1a88d231d99c1a6cb08730e97206c4fed" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Mar 16 16:24:32 crc kubenswrapper[5120]: E0316 16:24:32.544241 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 0419588781daf97a47d3362db1f9a8d1a88d231d99c1a6cb08730e97206c4fed is running failed: container process not found" containerID="0419588781daf97a47d3362db1f9a8d1a88d231d99c1a6cb08730e97206c4fed" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Mar 16 16:24:32 crc kubenswrapper[5120]: E0316 16:24:32.544347 5120 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 0419588781daf97a47d3362db1f9a8d1a88d231d99c1a6cb08730e97206c4fed is running failed: container process not found" probeType="Readiness" pod="openstack-kuttl-tests/ovn-northd-0" podUID="794d950a-8664-4970-963a-2773749103e0" containerName="ovn-northd" probeResult="unknown" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.544654 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage13-crc" (OuterVolumeSpecName: "mysql-db") pod "9185c9ac-7b26-4bbc-be42-545c166ba2c8" (UID: "9185c9ac-7b26-4bbc-be42-545c166ba2c8"). InnerVolumeSpecName "local-storage13-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.552334 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5160b65-3a41-4645-9f47-bd4e891fef5f-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "d5160b65-3a41-4645-9f47-bd4e891fef5f" (UID: "d5160b65-3a41-4645-9f47-bd4e891fef5f"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.562035 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/11468616-1e2d-4cfd-b172-299b0cc33f6e-config-data\") pod \"11468616-1e2d-4cfd-b172-299b0cc33f6e\" (UID: \"11468616-1e2d-4cfd-b172-299b0cc33f6e\") " Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.562149 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/11468616-1e2d-4cfd-b172-299b0cc33f6e-logs\") pod \"11468616-1e2d-4cfd-b172-299b0cc33f6e\" (UID: \"11468616-1e2d-4cfd-b172-299b0cc33f6e\") " Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.562188 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nvbvb\" (UniqueName: \"kubernetes.io/projected/11468616-1e2d-4cfd-b172-299b0cc33f6e-kube-api-access-nvbvb\") pod \"11468616-1e2d-4cfd-b172-299b0cc33f6e\" (UID: \"11468616-1e2d-4cfd-b172-299b0cc33f6e\") " Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.562214 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/11468616-1e2d-4cfd-b172-299b0cc33f6e-public-tls-certs\") pod \"11468616-1e2d-4cfd-b172-299b0cc33f6e\" (UID: \"11468616-1e2d-4cfd-b172-299b0cc33f6e\") " Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.562372 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/11468616-1e2d-4cfd-b172-299b0cc33f6e-combined-ca-bundle\") pod \"11468616-1e2d-4cfd-b172-299b0cc33f6e\" (UID: \"11468616-1e2d-4cfd-b172-299b0cc33f6e\") " Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.562398 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/11468616-1e2d-4cfd-b172-299b0cc33f6e-internal-tls-certs\") pod \"11468616-1e2d-4cfd-b172-299b0cc33f6e\" (UID: \"11468616-1e2d-4cfd-b172-299b0cc33f6e\") " Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.562682 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11468616-1e2d-4cfd-b172-299b0cc33f6e-logs" (OuterVolumeSpecName: "logs") pod "11468616-1e2d-4cfd-b172-299b0cc33f6e" (UID: "11468616-1e2d-4cfd-b172-299b0cc33f6e"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.563106 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4bgkg\" (UniqueName: \"kubernetes.io/projected/d5160b65-3a41-4645-9f47-bd4e891fef5f-kube-api-access-4bgkg\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.563128 5120 reconciler_common.go:299] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/9185c9ac-7b26-4bbc-be42-545c166ba2c8-kolla-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.563142 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fp2xj\" (UniqueName: \"kubernetes.io/projected/d4b88a4e-143e-46bd-ada8-56dece11d6cc-kube-api-access-fp2xj\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.563164 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage19-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") on node \"crc\" " Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.563175 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d5160b65-3a41-4645-9f47-bd4e891fef5f-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.563184 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/69c47154-7063-4a88-af54-c4dba11e7fd6-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.563193 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d5160b65-3a41-4645-9f47-bd4e891fef5f-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.563202 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/8558eb14-801e-455b-8374-1c69e333901c-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.563211 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/11468616-1e2d-4cfd-b172-299b0cc33f6e-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.563221 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fg5ll\" (UniqueName: \"kubernetes.io/projected/8558eb14-801e-455b-8374-1c69e333901c-kube-api-access-fg5ll\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.563234 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") on node \"crc\" " Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.563242 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/9185c9ac-7b26-4bbc-be42-545c166ba2c8-config-data-default\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.563252 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gfjhp\" (UniqueName: \"kubernetes.io/projected/9185c9ac-7b26-4bbc-be42-545c166ba2c8-kube-api-access-gfjhp\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.563263 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rpgf9\" (UniqueName: \"kubernetes.io/projected/69c47154-7063-4a88-af54-c4dba11e7fd6-kube-api-access-rpgf9\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.563594 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d4b88a4e-143e-46bd-ada8-56dece11d6cc-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.563613 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9185c9ac-7b26-4bbc-be42-545c166ba2c8-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.563623 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8558eb14-801e-455b-8374-1c69e333901c-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.568154 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-northd-0_794d950a-8664-4970-963a-2773749103e0/ovn-northd/0.log" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.568187 5120 generic.go:358] "Generic (PLEG): container finished" podID="794d950a-8664-4970-963a-2773749103e0" containerID="0419588781daf97a47d3362db1f9a8d1a88d231d99c1a6cb08730e97206c4fed" exitCode=139 Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.568244 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"794d950a-8664-4970-963a-2773749103e0","Type":"ContainerDied","Data":"0419588781daf97a47d3362db1f9a8d1a88d231d99c1a6cb08730e97206c4fed"} Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.570512 5120 generic.go:358] "Generic (PLEG): container finished" podID="8558eb14-801e-455b-8374-1c69e333901c" containerID="790456066ec1c9d2fb08d49a67269b46aa9af70d5546f44faab71e69a301ccfb" exitCode=0 Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.570590 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-6f68c75449-s4d7j" event={"ID":"8558eb14-801e-455b-8374-1c69e333901c","Type":"ContainerDied","Data":"790456066ec1c9d2fb08d49a67269b46aa9af70d5546f44faab71e69a301ccfb"} Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.570606 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-6f68c75449-s4d7j" event={"ID":"8558eb14-801e-455b-8374-1c69e333901c","Type":"ContainerDied","Data":"2a900e19e17e760158b56abc2de17566f4c4d3e37e3fd0b91bf26d4666959603"} Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.570681 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-6f68c75449-s4d7j" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.574949 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11468616-1e2d-4cfd-b172-299b0cc33f6e-kube-api-access-nvbvb" (OuterVolumeSpecName: "kube-api-access-nvbvb") pod "11468616-1e2d-4cfd-b172-299b0cc33f6e" (UID: "11468616-1e2d-4cfd-b172-299b0cc33f6e"). InnerVolumeSpecName "kube-api-access-nvbvb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.574960 5120 generic.go:358] "Generic (PLEG): container finished" podID="ecdbe440-4557-4298-b0b7-e2e89958bf07" containerID="ee098489a81ab6a4f9e4ca8e42dc2cbdb96791a0f059a8249a2d3bb49356b4d4" exitCode=0 Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.575109 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-6bf46d9f46-cv8dx" event={"ID":"ecdbe440-4557-4298-b0b7-e2e89958bf07","Type":"ContainerDied","Data":"ee098489a81ab6a4f9e4ca8e42dc2cbdb96791a0f059a8249a2d3bb49356b4d4"} Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.588482 5120 generic.go:358] "Generic (PLEG): container finished" podID="7b05ec0c-8f80-4a86-8823-629c4e953395" containerID="48370642f51fb950140c497068c7d992955ae7d6047b48a68307501d1a50da67" exitCode=0 Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.588634 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-7bc85bbbf-4ttl9" event={"ID":"7b05ec0c-8f80-4a86-8823-629c4e953395","Type":"ContainerDied","Data":"48370642f51fb950140c497068c7d992955ae7d6047b48a68307501d1a50da67"} Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.592267 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage13-crc" (UniqueName: "kubernetes.io/local-volume/local-storage13-crc") on node "crc" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.594154 5120 generic.go:358] "Generic (PLEG): container finished" podID="d5160b65-3a41-4645-9f47-bd4e891fef5f" containerID="ce0a8bde470adeb57224c167d670364e256b6b1b5b4d78dd8410053f53d53467" exitCode=0 Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.594319 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/watcher-applier-0" event={"ID":"d5160b65-3a41-4645-9f47-bd4e891fef5f","Type":"ContainerDied","Data":"ce0a8bde470adeb57224c167d670364e256b6b1b5b4d78dd8410053f53d53467"} Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.594404 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/watcher-applier-0" event={"ID":"d5160b65-3a41-4645-9f47-bd4e891fef5f","Type":"ContainerDied","Data":"145fef35dc3dba8d720e8ad4f4ff4335ddf8e20173cf77514167e279ecbed03d"} Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.594518 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/watcher-applier-0" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.598015 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4b88a4e-143e-46bd-ada8-56dece11d6cc-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "d4b88a4e-143e-46bd-ada8-56dece11d6cc" (UID: "d4b88a4e-143e-46bd-ada8-56dece11d6cc"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.601894 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"9185c9ac-7b26-4bbc-be42-545c166ba2c8","Type":"ContainerDied","Data":"966cbed3f89d1e6f4528814c78dcd7a2422097bfaeec397b30d5976e8f5edfbb"} Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.602025 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.606780 5120 scope.go:117] "RemoveContainer" containerID="3a19d570305168b53a02c3d68205387f2601dd914bd1d418b04fabacd375394c" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.607783 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/watcher-api-0" event={"ID":"e15efd1b-6aa8-4a24-b576-4e03e19e19d0","Type":"ContainerDied","Data":"6fad77389d935c02c32755e665ca002b068ef37079df2ebd4e98b3d6de64a115"} Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.607867 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/watcher-api-0" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.610301 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"d4b88a4e-143e-46bd-ada8-56dece11d6cc","Type":"ContainerDied","Data":"462d355c14e2d482b71406f9553bdca0f3407a51cb5358071e72e3ce92791da9"} Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.610369 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.619013 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.624065 5120 generic.go:358] "Generic (PLEG): container finished" podID="11468616-1e2d-4cfd-b172-299b0cc33f6e" containerID="80b5ea2dfc65de88c23635009864244ff0b93f75a6ce71ea114be7eaf3207cec" exitCode=0 Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.624232 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"11468616-1e2d-4cfd-b172-299b0cc33f6e","Type":"ContainerDied","Data":"80b5ea2dfc65de88c23635009864244ff0b93f75a6ce71ea114be7eaf3207cec"} Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.624263 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"11468616-1e2d-4cfd-b172-299b0cc33f6e","Type":"ContainerDied","Data":"62db47366a25d78bee24cb4cce0feccd4e491f4bc1825e432a3a84cf7edc0270"} Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.624346 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.625591 5120 scope.go:117] "RemoveContainer" containerID="790456066ec1c9d2fb08d49a67269b46aa9af70d5546f44faab71e69a301ccfb" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.635908 5120 generic.go:358] "Generic (PLEG): container finished" podID="69c47154-7063-4a88-af54-c4dba11e7fd6" containerID="8b568e74a3015e82c143b45e4ec9c9806b390389907f25fffb8093f0f982c0cd" exitCode=0 Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.636280 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-85c89c7f6-6429v" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.637059 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-85c89c7f6-6429v" event={"ID":"69c47154-7063-4a88-af54-c4dba11e7fd6","Type":"ContainerDied","Data":"8b568e74a3015e82c143b45e4ec9c9806b390389907f25fffb8093f0f982c0cd"} Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.637103 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-85c89c7f6-6429v" event={"ID":"69c47154-7063-4a88-af54-c4dba11e7fd6","Type":"ContainerDied","Data":"07a3523e95e26a4ad1674aba9a3699719e7fc78f28f29651ed652b5d355fc208"} Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.646738 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11468616-1e2d-4cfd-b172-299b0cc33f6e-config-data" (OuterVolumeSpecName: "config-data") pod "11468616-1e2d-4cfd-b172-299b0cc33f6e" (UID: "11468616-1e2d-4cfd-b172-299b0cc33f6e"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.649888 5120 scope.go:117] "RemoveContainer" containerID="d7c153224a3bf3e6347984cb47aae3cd6b8bb54fa6f5bb003cfe5e0fc882319e" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.655067 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9185c9ac-7b26-4bbc-be42-545c166ba2c8-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "9185c9ac-7b26-4bbc-be42-545c166ba2c8" (UID: "9185c9ac-7b26-4bbc-be42-545c166ba2c8"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.661938 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-northd-0_794d950a-8664-4970-963a-2773749103e0/ovn-northd/0.log" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.662009 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.665543 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nvbvb\" (UniqueName: \"kubernetes.io/projected/11468616-1e2d-4cfd-b172-299b0cc33f6e-kube-api-access-nvbvb\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.665565 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.665575 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9185c9ac-7b26-4bbc-be42-545c166ba2c8-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.665585 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d4b88a4e-143e-46bd-ada8-56dece11d6cc-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.665597 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/11468616-1e2d-4cfd-b172-299b0cc33f6e-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.672555 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69c47154-7063-4a88-af54-c4dba11e7fd6-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "69c47154-7063-4a88-af54-c4dba11e7fd6" (UID: "69c47154-7063-4a88-af54-c4dba11e7fd6"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.676472 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3ea3fd85-7822-44e8-a112-9aec7d6f9a7c" path="/var/lib/kubelet/pods/3ea3fd85-7822-44e8-a112-9aec7d6f9a7c/volumes" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.680051 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="436edb75-475a-4096-a9c9-bf235fc92d9c" path="/var/lib/kubelet/pods/436edb75-475a-4096-a9c9-bf235fc92d9c/volumes" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.680884 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="771204f4-c55f-4a6e-be63-70f3d1c8a51e" path="/var/lib/kubelet/pods/771204f4-c55f-4a6e-be63-70f3d1c8a51e/volumes" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.681965 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="79383c2c-77ce-4694-acfd-f65a93d14d36" path="/var/lib/kubelet/pods/79383c2c-77ce-4694-acfd-f65a93d14d36/volumes" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.683106 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7ea8cd10-4026-4603-a76b-b26ebe185441" path="/var/lib/kubelet/pods/7ea8cd10-4026-4603-a76b-b26ebe185441/volumes" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.684372 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="86686d29-4c19-43e3-97a8-d8373883dc6a" path="/var/lib/kubelet/pods/86686d29-4c19-43e3-97a8-d8373883dc6a/volumes" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.685062 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93507a7d-d4a9-4f98-aca5-30020461118a" path="/var/lib/kubelet/pods/93507a7d-d4a9-4f98-aca5-30020461118a/volumes" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.685482 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf8c7b4f-8110-4b63-9022-2f9dcf3c1270" path="/var/lib/kubelet/pods/cf8c7b4f-8110-4b63-9022-2f9dcf3c1270/volumes" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.685990 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f90be6a3-f863-476d-b78b-95b9d069037e" path="/var/lib/kubelet/pods/f90be6a3-f863-476d-b78b-95b9d069037e/volumes" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.687638 5120 scope.go:117] "RemoveContainer" containerID="790456066ec1c9d2fb08d49a67269b46aa9af70d5546f44faab71e69a301ccfb" Mar 16 16:24:32 crc kubenswrapper[5120]: E0316 16:24:32.690147 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"790456066ec1c9d2fb08d49a67269b46aa9af70d5546f44faab71e69a301ccfb\": container with ID starting with 790456066ec1c9d2fb08d49a67269b46aa9af70d5546f44faab71e69a301ccfb not found: ID does not exist" containerID="790456066ec1c9d2fb08d49a67269b46aa9af70d5546f44faab71e69a301ccfb" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.690243 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"790456066ec1c9d2fb08d49a67269b46aa9af70d5546f44faab71e69a301ccfb"} err="failed to get container status \"790456066ec1c9d2fb08d49a67269b46aa9af70d5546f44faab71e69a301ccfb\": rpc error: code = NotFound desc = could not find container \"790456066ec1c9d2fb08d49a67269b46aa9af70d5546f44faab71e69a301ccfb\": container with ID starting with 790456066ec1c9d2fb08d49a67269b46aa9af70d5546f44faab71e69a301ccfb not found: ID does not exist" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.690337 5120 scope.go:117] "RemoveContainer" containerID="d7c153224a3bf3e6347984cb47aae3cd6b8bb54fa6f5bb003cfe5e0fc882319e" Mar 16 16:24:32 crc kubenswrapper[5120]: E0316 16:24:32.690859 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d7c153224a3bf3e6347984cb47aae3cd6b8bb54fa6f5bb003cfe5e0fc882319e\": container with ID starting with d7c153224a3bf3e6347984cb47aae3cd6b8bb54fa6f5bb003cfe5e0fc882319e not found: ID does not exist" containerID="d7c153224a3bf3e6347984cb47aae3cd6b8bb54fa6f5bb003cfe5e0fc882319e" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.690951 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7c153224a3bf3e6347984cb47aae3cd6b8bb54fa6f5bb003cfe5e0fc882319e"} err="failed to get container status \"d7c153224a3bf3e6347984cb47aae3cd6b8bb54fa6f5bb003cfe5e0fc882319e\": rpc error: code = NotFound desc = could not find container \"d7c153224a3bf3e6347984cb47aae3cd6b8bb54fa6f5bb003cfe5e0fc882319e\": container with ID starting with d7c153224a3bf3e6347984cb47aae3cd6b8bb54fa6f5bb003cfe5e0fc882319e not found: ID does not exist" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.691035 5120 scope.go:117] "RemoveContainer" containerID="ce0a8bde470adeb57224c167d670364e256b6b1b5b4d78dd8410053f53d53467" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.691348 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5160b65-3a41-4645-9f47-bd4e891fef5f-config-data" (OuterVolumeSpecName: "config-data") pod "d5160b65-3a41-4645-9f47-bd4e891fef5f" (UID: "d5160b65-3a41-4645-9f47-bd4e891fef5f"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.706716 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-6bf46d9f46-cv8dx" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.713962 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69c47154-7063-4a88-af54-c4dba11e7fd6-config-data" (OuterVolumeSpecName: "config-data") pod "69c47154-7063-4a88-af54-c4dba11e7fd6" (UID: "69c47154-7063-4a88-af54-c4dba11e7fd6"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.729468 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4b88a4e-143e-46bd-ada8-56dece11d6cc-config-data" (OuterVolumeSpecName: "config-data") pod "d4b88a4e-143e-46bd-ada8-56dece11d6cc" (UID: "d4b88a4e-143e-46bd-ada8-56dece11d6cc"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.731847 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11468616-1e2d-4cfd-b172-299b0cc33f6e-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "11468616-1e2d-4cfd-b172-299b0cc33f6e" (UID: "11468616-1e2d-4cfd-b172-299b0cc33f6e"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.745011 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9185c9ac-7b26-4bbc-be42-545c166ba2c8-galera-tls-certs" (OuterVolumeSpecName: "galera-tls-certs") pod "9185c9ac-7b26-4bbc-be42-545c166ba2c8" (UID: "9185c9ac-7b26-4bbc-be42-545c166ba2c8"). InnerVolumeSpecName "galera-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.763344 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage19-crc" (UniqueName: "kubernetes.io/local-volume/local-storage19-crc") on node "crc" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.766930 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/794d950a-8664-4970-963a-2773749103e0-ovn-rundir\") pod \"794d950a-8664-4970-963a-2773749103e0\" (UID: \"794d950a-8664-4970-963a-2773749103e0\") " Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.767112 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/794d950a-8664-4970-963a-2773749103e0-combined-ca-bundle\") pod \"794d950a-8664-4970-963a-2773749103e0\" (UID: \"794d950a-8664-4970-963a-2773749103e0\") " Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.767220 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/794d950a-8664-4970-963a-2773749103e0-metrics-certs-tls-certs\") pod \"794d950a-8664-4970-963a-2773749103e0\" (UID: \"794d950a-8664-4970-963a-2773749103e0\") " Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.767301 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/794d950a-8664-4970-963a-2773749103e0-ovn-northd-tls-certs\") pod \"794d950a-8664-4970-963a-2773749103e0\" (UID: \"794d950a-8664-4970-963a-2773749103e0\") " Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.767429 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s4xhk\" (UniqueName: \"kubernetes.io/projected/794d950a-8664-4970-963a-2773749103e0-kube-api-access-s4xhk\") pod \"794d950a-8664-4970-963a-2773749103e0\" (UID: \"794d950a-8664-4970-963a-2773749103e0\") " Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.767506 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/794d950a-8664-4970-963a-2773749103e0-config\") pod \"794d950a-8664-4970-963a-2773749103e0\" (UID: \"794d950a-8664-4970-963a-2773749103e0\") " Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.767693 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/794d950a-8664-4970-963a-2773749103e0-scripts\") pod \"794d950a-8664-4970-963a-2773749103e0\" (UID: \"794d950a-8664-4970-963a-2773749103e0\") " Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.768470 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/69c47154-7063-4a88-af54-c4dba11e7fd6-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.769802 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/11468616-1e2d-4cfd-b172-299b0cc33f6e-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.769887 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d4b88a4e-143e-46bd-ada8-56dece11d6cc-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.769953 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/69c47154-7063-4a88-af54-c4dba11e7fd6-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.770011 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage19-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.770072 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d5160b65-3a41-4645-9f47-bd4e891fef5f-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.770126 5120 reconciler_common.go:299] "Volume detached for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/9185c9ac-7b26-4bbc-be42-545c166ba2c8-galera-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.769853 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69c47154-7063-4a88-af54-c4dba11e7fd6-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "69c47154-7063-4a88-af54-c4dba11e7fd6" (UID: "69c47154-7063-4a88-af54-c4dba11e7fd6"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.771074 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8558eb14-801e-455b-8374-1c69e333901c-config-data" (OuterVolumeSpecName: "config-data") pod "8558eb14-801e-455b-8374-1c69e333901c" (UID: "8558eb14-801e-455b-8374-1c69e333901c"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.772876 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4b88a4e-143e-46bd-ada8-56dece11d6cc-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "d4b88a4e-143e-46bd-ada8-56dece11d6cc" (UID: "d4b88a4e-143e-46bd-ada8-56dece11d6cc"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.773645 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/794d950a-8664-4970-963a-2773749103e0-config" (OuterVolumeSpecName: "config") pod "794d950a-8664-4970-963a-2773749103e0" (UID: "794d950a-8664-4970-963a-2773749103e0"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.775715 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/794d950a-8664-4970-963a-2773749103e0-scripts" (OuterVolumeSpecName: "scripts") pod "794d950a-8664-4970-963a-2773749103e0" (UID: "794d950a-8664-4970-963a-2773749103e0"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.776610 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/794d950a-8664-4970-963a-2773749103e0-ovn-rundir" (OuterVolumeSpecName: "ovn-rundir") pod "794d950a-8664-4970-963a-2773749103e0" (UID: "794d950a-8664-4970-963a-2773749103e0"). InnerVolumeSpecName "ovn-rundir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.777129 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/794d950a-8664-4970-963a-2773749103e0-kube-api-access-s4xhk" (OuterVolumeSpecName: "kube-api-access-s4xhk") pod "794d950a-8664-4970-963a-2773749103e0" (UID: "794d950a-8664-4970-963a-2773749103e0"). InnerVolumeSpecName "kube-api-access-s4xhk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.782685 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69c47154-7063-4a88-af54-c4dba11e7fd6-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "69c47154-7063-4a88-af54-c4dba11e7fd6" (UID: "69c47154-7063-4a88-af54-c4dba11e7fd6"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.805408 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/794d950a-8664-4970-963a-2773749103e0-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "794d950a-8664-4970-963a-2773749103e0" (UID: "794d950a-8664-4970-963a-2773749103e0"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.839124 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11468616-1e2d-4cfd-b172-299b0cc33f6e-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "11468616-1e2d-4cfd-b172-299b0cc33f6e" (UID: "11468616-1e2d-4cfd-b172-299b0cc33f6e"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.843058 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11468616-1e2d-4cfd-b172-299b0cc33f6e-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "11468616-1e2d-4cfd-b172-299b0cc33f6e" (UID: "11468616-1e2d-4cfd-b172-299b0cc33f6e"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.855648 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/794d950a-8664-4970-963a-2773749103e0-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "794d950a-8664-4970-963a-2773749103e0" (UID: "794d950a-8664-4970-963a-2773749103e0"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.861301 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/794d950a-8664-4970-963a-2773749103e0-ovn-northd-tls-certs" (OuterVolumeSpecName: "ovn-northd-tls-certs") pod "794d950a-8664-4970-963a-2773749103e0" (UID: "794d950a-8664-4970-963a-2773749103e0"). InnerVolumeSpecName "ovn-northd-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.872749 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ecdbe440-4557-4298-b0b7-e2e89958bf07-logs\") pod \"ecdbe440-4557-4298-b0b7-e2e89958bf07\" (UID: \"ecdbe440-4557-4298-b0b7-e2e89958bf07\") " Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.873951 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ecdbe440-4557-4298-b0b7-e2e89958bf07-config-data\") pod \"ecdbe440-4557-4298-b0b7-e2e89958bf07\" (UID: \"ecdbe440-4557-4298-b0b7-e2e89958bf07\") " Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.873103 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ecdbe440-4557-4298-b0b7-e2e89958bf07-logs" (OuterVolumeSpecName: "logs") pod "ecdbe440-4557-4298-b0b7-e2e89958bf07" (UID: "ecdbe440-4557-4298-b0b7-e2e89958bf07"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.874508 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/ecdbe440-4557-4298-b0b7-e2e89958bf07-config-data-custom\") pod \"ecdbe440-4557-4298-b0b7-e2e89958bf07\" (UID: \"ecdbe440-4557-4298-b0b7-e2e89958bf07\") " Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.874544 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sqxmx\" (UniqueName: \"kubernetes.io/projected/ecdbe440-4557-4298-b0b7-e2e89958bf07-kube-api-access-sqxmx\") pod \"ecdbe440-4557-4298-b0b7-e2e89958bf07\" (UID: \"ecdbe440-4557-4298-b0b7-e2e89958bf07\") " Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.874606 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ecdbe440-4557-4298-b0b7-e2e89958bf07-combined-ca-bundle\") pod \"ecdbe440-4557-4298-b0b7-e2e89958bf07\" (UID: \"ecdbe440-4557-4298-b0b7-e2e89958bf07\") " Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.875963 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/d4b88a4e-143e-46bd-ada8-56dece11d6cc-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.876079 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/794d950a-8664-4970-963a-2773749103e0-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.876149 5120 reconciler_common.go:299] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/794d950a-8664-4970-963a-2773749103e0-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.876207 5120 reconciler_common.go:299] "Volume detached for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/794d950a-8664-4970-963a-2773749103e0-ovn-northd-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.876259 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/69c47154-7063-4a88-af54-c4dba11e7fd6-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.876318 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s4xhk\" (UniqueName: \"kubernetes.io/projected/794d950a-8664-4970-963a-2773749103e0-kube-api-access-s4xhk\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.876395 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/794d950a-8664-4970-963a-2773749103e0-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.876463 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/794d950a-8664-4970-963a-2773749103e0-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.876516 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8558eb14-801e-455b-8374-1c69e333901c-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.876605 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/11468616-1e2d-4cfd-b172-299b0cc33f6e-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.876666 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/11468616-1e2d-4cfd-b172-299b0cc33f6e-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.876725 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/69c47154-7063-4a88-af54-c4dba11e7fd6-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.876796 5120 reconciler_common.go:299] "Volume detached for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/794d950a-8664-4970-963a-2773749103e0-ovn-rundir\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.876863 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ecdbe440-4557-4298-b0b7-e2e89958bf07-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.881328 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ecdbe440-4557-4298-b0b7-e2e89958bf07-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "ecdbe440-4557-4298-b0b7-e2e89958bf07" (UID: "ecdbe440-4557-4298-b0b7-e2e89958bf07"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.881795 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ecdbe440-4557-4298-b0b7-e2e89958bf07-kube-api-access-sqxmx" (OuterVolumeSpecName: "kube-api-access-sqxmx") pod "ecdbe440-4557-4298-b0b7-e2e89958bf07" (UID: "ecdbe440-4557-4298-b0b7-e2e89958bf07"). InnerVolumeSpecName "kube-api-access-sqxmx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.905583 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ecdbe440-4557-4298-b0b7-e2e89958bf07-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ecdbe440-4557-4298-b0b7-e2e89958bf07" (UID: "ecdbe440-4557-4298-b0b7-e2e89958bf07"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.928007 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ecdbe440-4557-4298-b0b7-e2e89958bf07-config-data" (OuterVolumeSpecName: "config-data") pod "ecdbe440-4557-4298-b0b7-e2e89958bf07" (UID: "ecdbe440-4557-4298-b0b7-e2e89958bf07"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.978399 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ecdbe440-4557-4298-b0b7-e2e89958bf07-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.979019 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ecdbe440-4557-4298-b0b7-e2e89958bf07-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.979080 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/ecdbe440-4557-4298-b0b7-e2e89958bf07-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:32 crc kubenswrapper[5120]: I0316 16:24:32.979143 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sqxmx\" (UniqueName: \"kubernetes.io/projected/ecdbe440-4557-4298-b0b7-e2e89958bf07-kube-api-access-sqxmx\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:33 crc kubenswrapper[5120]: I0316 16:24:33.081792 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/watcher-api-0"] Mar 16 16:24:33 crc kubenswrapper[5120]: I0316 16:24:33.081823 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/watcher-api-0"] Mar 16 16:24:33 crc kubenswrapper[5120]: I0316 16:24:33.099833 5120 scope.go:117] "RemoveContainer" containerID="ce0a8bde470adeb57224c167d670364e256b6b1b5b4d78dd8410053f53d53467" Mar 16 16:24:33 crc kubenswrapper[5120]: E0316 16:24:33.100287 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce0a8bde470adeb57224c167d670364e256b6b1b5b4d78dd8410053f53d53467\": container with ID starting with ce0a8bde470adeb57224c167d670364e256b6b1b5b4d78dd8410053f53d53467 not found: ID does not exist" containerID="ce0a8bde470adeb57224c167d670364e256b6b1b5b4d78dd8410053f53d53467" Mar 16 16:24:33 crc kubenswrapper[5120]: I0316 16:24:33.100325 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce0a8bde470adeb57224c167d670364e256b6b1b5b4d78dd8410053f53d53467"} err="failed to get container status \"ce0a8bde470adeb57224c167d670364e256b6b1b5b4d78dd8410053f53d53467\": rpc error: code = NotFound desc = could not find container \"ce0a8bde470adeb57224c167d670364e256b6b1b5b4d78dd8410053f53d53467\": container with ID starting with ce0a8bde470adeb57224c167d670364e256b6b1b5b4d78dd8410053f53d53467 not found: ID does not exist" Mar 16 16:24:33 crc kubenswrapper[5120]: I0316 16:24:33.100348 5120 scope.go:117] "RemoveContainer" containerID="adf00bc598caf7fd100ad6d9a04dd18b37b6a59bdd16122c1c463bf65b466e55" Mar 16 16:24:33 crc kubenswrapper[5120]: I0316 16:24:33.103579 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-7bc85bbbf-4ttl9" Mar 16 16:24:33 crc kubenswrapper[5120]: I0316 16:24:33.144850 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-85c89c7f6-6429v"] Mar 16 16:24:33 crc kubenswrapper[5120]: I0316 16:24:33.145013 5120 scope.go:117] "RemoveContainer" containerID="c28bfe665bcd0544d43e21f6e2de3d861c2f37eb4482203437939e7ccb122494" Mar 16 16:24:33 crc kubenswrapper[5120]: I0316 16:24:33.152849 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-api-85c89c7f6-6429v"] Mar 16 16:24:33 crc kubenswrapper[5120]: I0316 16:24:33.161103 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 16:24:33 crc kubenswrapper[5120]: I0316 16:24:33.167846 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 16:24:33 crc kubenswrapper[5120]: I0316 16:24:33.187063 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/watcher-applier-0"] Mar 16 16:24:33 crc kubenswrapper[5120]: I0316 16:24:33.194288 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/watcher-applier-0"] Mar 16 16:24:33 crc kubenswrapper[5120]: I0316 16:24:33.209030 5120 scope.go:117] "RemoveContainer" containerID="1ef4b2599981ce7b8001b50ecfd4a007c4f23a0c049893394acf7b049e550690" Mar 16 16:24:33 crc kubenswrapper[5120]: I0316 16:24:33.220652 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:24:33 crc kubenswrapper[5120]: I0316 16:24:33.231249 5120 scope.go:117] "RemoveContainer" containerID="e0f92a07b7fa6f808f45a98109ff109cb20b21840d1d05128661b849870c2178" Mar 16 16:24:33 crc kubenswrapper[5120]: I0316 16:24:33.231428 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:24:33 crc kubenswrapper[5120]: I0316 16:24:33.240567 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-6f68c75449-s4d7j"] Mar 16 16:24:33 crc kubenswrapper[5120]: I0316 16:24:33.245083 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-worker-6f68c75449-s4d7j"] Mar 16 16:24:33 crc kubenswrapper[5120]: I0316 16:24:33.250006 5120 scope.go:117] "RemoveContainer" containerID="bcf29711a914125565b105b455e66a7b23dfececab72dcb037b0a8c45113f6ab" Mar 16 16:24:33 crc kubenswrapper[5120]: I0316 16:24:33.251187 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:24:33 crc kubenswrapper[5120]: I0316 16:24:33.260268 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:24:33 crc kubenswrapper[5120]: I0316 16:24:33.260382 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/watcher-decision-engine-0" Mar 16 16:24:33 crc kubenswrapper[5120]: I0316 16:24:33.270527 5120 scope.go:117] "RemoveContainer" containerID="d3796ecbe42b3beab0d0040cb2692ce8f22bdf760113ef0e8c3cfaa0ff2276f7" Mar 16 16:24:33 crc kubenswrapper[5120]: I0316 16:24:33.289233 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7b05ec0c-8f80-4a86-8823-629c4e953395-combined-ca-bundle\") pod \"7b05ec0c-8f80-4a86-8823-629c4e953395\" (UID: \"7b05ec0c-8f80-4a86-8823-629c4e953395\") " Mar 16 16:24:33 crc kubenswrapper[5120]: I0316 16:24:33.289308 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/7b05ec0c-8f80-4a86-8823-629c4e953395-fernet-keys\") pod \"7b05ec0c-8f80-4a86-8823-629c4e953395\" (UID: \"7b05ec0c-8f80-4a86-8823-629c4e953395\") " Mar 16 16:24:33 crc kubenswrapper[5120]: I0316 16:24:33.289364 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/7b05ec0c-8f80-4a86-8823-629c4e953395-credential-keys\") pod \"7b05ec0c-8f80-4a86-8823-629c4e953395\" (UID: \"7b05ec0c-8f80-4a86-8823-629c4e953395\") " Mar 16 16:24:33 crc kubenswrapper[5120]: I0316 16:24:33.289478 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/7b05ec0c-8f80-4a86-8823-629c4e953395-internal-tls-certs\") pod \"7b05ec0c-8f80-4a86-8823-629c4e953395\" (UID: \"7b05ec0c-8f80-4a86-8823-629c4e953395\") " Mar 16 16:24:33 crc kubenswrapper[5120]: I0316 16:24:33.289565 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zps2p\" (UniqueName: \"kubernetes.io/projected/7b05ec0c-8f80-4a86-8823-629c4e953395-kube-api-access-zps2p\") pod \"7b05ec0c-8f80-4a86-8823-629c4e953395\" (UID: \"7b05ec0c-8f80-4a86-8823-629c4e953395\") " Mar 16 16:24:33 crc kubenswrapper[5120]: I0316 16:24:33.289585 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7b05ec0c-8f80-4a86-8823-629c4e953395-scripts\") pod \"7b05ec0c-8f80-4a86-8823-629c4e953395\" (UID: \"7b05ec0c-8f80-4a86-8823-629c4e953395\") " Mar 16 16:24:33 crc kubenswrapper[5120]: I0316 16:24:33.289852 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7b05ec0c-8f80-4a86-8823-629c4e953395-config-data\") pod \"7b05ec0c-8f80-4a86-8823-629c4e953395\" (UID: \"7b05ec0c-8f80-4a86-8823-629c4e953395\") " Mar 16 16:24:33 crc kubenswrapper[5120]: I0316 16:24:33.289897 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/7b05ec0c-8f80-4a86-8823-629c4e953395-public-tls-certs\") pod \"7b05ec0c-8f80-4a86-8823-629c4e953395\" (UID: \"7b05ec0c-8f80-4a86-8823-629c4e953395\") " Mar 16 16:24:33 crc kubenswrapper[5120]: I0316 16:24:33.295482 5120 scope.go:117] "RemoveContainer" containerID="80b5ea2dfc65de88c23635009864244ff0b93f75a6ce71ea114be7eaf3207cec" Mar 16 16:24:33 crc kubenswrapper[5120]: I0316 16:24:33.299835 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b05ec0c-8f80-4a86-8823-629c4e953395-kube-api-access-zps2p" (OuterVolumeSpecName: "kube-api-access-zps2p") pod "7b05ec0c-8f80-4a86-8823-629c4e953395" (UID: "7b05ec0c-8f80-4a86-8823-629c4e953395"). InnerVolumeSpecName "kube-api-access-zps2p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:24:33 crc kubenswrapper[5120]: I0316 16:24:33.301591 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b05ec0c-8f80-4a86-8823-629c4e953395-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "7b05ec0c-8f80-4a86-8823-629c4e953395" (UID: "7b05ec0c-8f80-4a86-8823-629c4e953395"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:24:33 crc kubenswrapper[5120]: I0316 16:24:33.302677 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b05ec0c-8f80-4a86-8823-629c4e953395-scripts" (OuterVolumeSpecName: "scripts") pod "7b05ec0c-8f80-4a86-8823-629c4e953395" (UID: "7b05ec0c-8f80-4a86-8823-629c4e953395"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:24:33 crc kubenswrapper[5120]: I0316 16:24:33.305251 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b05ec0c-8f80-4a86-8823-629c4e953395-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "7b05ec0c-8f80-4a86-8823-629c4e953395" (UID: "7b05ec0c-8f80-4a86-8823-629c4e953395"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:24:33 crc kubenswrapper[5120]: I0316 16:24:33.322605 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b05ec0c-8f80-4a86-8823-629c4e953395-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "7b05ec0c-8f80-4a86-8823-629c4e953395" (UID: "7b05ec0c-8f80-4a86-8823-629c4e953395"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:24:33 crc kubenswrapper[5120]: I0316 16:24:33.323912 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b05ec0c-8f80-4a86-8823-629c4e953395-config-data" (OuterVolumeSpecName: "config-data") pod "7b05ec0c-8f80-4a86-8823-629c4e953395" (UID: "7b05ec0c-8f80-4a86-8823-629c4e953395"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:24:33 crc kubenswrapper[5120]: I0316 16:24:33.331787 5120 scope.go:117] "RemoveContainer" containerID="11ddd2a3e0b9e6341372082fc57fa83a45f334a4f158c1daef9d97c45b20424b" Mar 16 16:24:33 crc kubenswrapper[5120]: I0316 16:24:33.336923 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b05ec0c-8f80-4a86-8823-629c4e953395-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "7b05ec0c-8f80-4a86-8823-629c4e953395" (UID: "7b05ec0c-8f80-4a86-8823-629c4e953395"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:24:33 crc kubenswrapper[5120]: I0316 16:24:33.346679 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b05ec0c-8f80-4a86-8823-629c4e953395-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "7b05ec0c-8f80-4a86-8823-629c4e953395" (UID: "7b05ec0c-8f80-4a86-8823-629c4e953395"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:24:33 crc kubenswrapper[5120]: I0316 16:24:33.356232 5120 scope.go:117] "RemoveContainer" containerID="80b5ea2dfc65de88c23635009864244ff0b93f75a6ce71ea114be7eaf3207cec" Mar 16 16:24:33 crc kubenswrapper[5120]: E0316 16:24:33.356542 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"80b5ea2dfc65de88c23635009864244ff0b93f75a6ce71ea114be7eaf3207cec\": container with ID starting with 80b5ea2dfc65de88c23635009864244ff0b93f75a6ce71ea114be7eaf3207cec not found: ID does not exist" containerID="80b5ea2dfc65de88c23635009864244ff0b93f75a6ce71ea114be7eaf3207cec" Mar 16 16:24:33 crc kubenswrapper[5120]: I0316 16:24:33.356584 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80b5ea2dfc65de88c23635009864244ff0b93f75a6ce71ea114be7eaf3207cec"} err="failed to get container status \"80b5ea2dfc65de88c23635009864244ff0b93f75a6ce71ea114be7eaf3207cec\": rpc error: code = NotFound desc = could not find container \"80b5ea2dfc65de88c23635009864244ff0b93f75a6ce71ea114be7eaf3207cec\": container with ID starting with 80b5ea2dfc65de88c23635009864244ff0b93f75a6ce71ea114be7eaf3207cec not found: ID does not exist" Mar 16 16:24:33 crc kubenswrapper[5120]: I0316 16:24:33.356605 5120 scope.go:117] "RemoveContainer" containerID="11ddd2a3e0b9e6341372082fc57fa83a45f334a4f158c1daef9d97c45b20424b" Mar 16 16:24:33 crc kubenswrapper[5120]: E0316 16:24:33.357012 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"11ddd2a3e0b9e6341372082fc57fa83a45f334a4f158c1daef9d97c45b20424b\": container with ID starting with 11ddd2a3e0b9e6341372082fc57fa83a45f334a4f158c1daef9d97c45b20424b not found: ID does not exist" containerID="11ddd2a3e0b9e6341372082fc57fa83a45f334a4f158c1daef9d97c45b20424b" Mar 16 16:24:33 crc kubenswrapper[5120]: I0316 16:24:33.357033 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11ddd2a3e0b9e6341372082fc57fa83a45f334a4f158c1daef9d97c45b20424b"} err="failed to get container status \"11ddd2a3e0b9e6341372082fc57fa83a45f334a4f158c1daef9d97c45b20424b\": rpc error: code = NotFound desc = could not find container \"11ddd2a3e0b9e6341372082fc57fa83a45f334a4f158c1daef9d97c45b20424b\": container with ID starting with 11ddd2a3e0b9e6341372082fc57fa83a45f334a4f158c1daef9d97c45b20424b not found: ID does not exist" Mar 16 16:24:33 crc kubenswrapper[5120]: I0316 16:24:33.357047 5120 scope.go:117] "RemoveContainer" containerID="8b568e74a3015e82c143b45e4ec9c9806b390389907f25fffb8093f0f982c0cd" Mar 16 16:24:33 crc kubenswrapper[5120]: I0316 16:24:33.380864 5120 scope.go:117] "RemoveContainer" containerID="b28880e5a05a573108be1a0e941930a878933df93431db8ee6799513224cdd63" Mar 16 16:24:33 crc kubenswrapper[5120]: I0316 16:24:33.391817 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3b04c3f7-3328-4aef-92bc-42f328744879-logs\") pod \"3b04c3f7-3328-4aef-92bc-42f328744879\" (UID: \"3b04c3f7-3328-4aef-92bc-42f328744879\") " Mar 16 16:24:33 crc kubenswrapper[5120]: I0316 16:24:33.391847 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3b04c3f7-3328-4aef-92bc-42f328744879-combined-ca-bundle\") pod \"3b04c3f7-3328-4aef-92bc-42f328744879\" (UID: \"3b04c3f7-3328-4aef-92bc-42f328744879\") " Mar 16 16:24:33 crc kubenswrapper[5120]: I0316 16:24:33.391986 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3b04c3f7-3328-4aef-92bc-42f328744879-config-data\") pod \"3b04c3f7-3328-4aef-92bc-42f328744879\" (UID: \"3b04c3f7-3328-4aef-92bc-42f328744879\") " Mar 16 16:24:33 crc kubenswrapper[5120]: I0316 16:24:33.392118 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k7vrd\" (UniqueName: \"kubernetes.io/projected/3b04c3f7-3328-4aef-92bc-42f328744879-kube-api-access-k7vrd\") pod \"3b04c3f7-3328-4aef-92bc-42f328744879\" (UID: \"3b04c3f7-3328-4aef-92bc-42f328744879\") " Mar 16 16:24:33 crc kubenswrapper[5120]: I0316 16:24:33.392175 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"custom-prometheus-ca\" (UniqueName: \"kubernetes.io/secret/3b04c3f7-3328-4aef-92bc-42f328744879-custom-prometheus-ca\") pod \"3b04c3f7-3328-4aef-92bc-42f328744879\" (UID: \"3b04c3f7-3328-4aef-92bc-42f328744879\") " Mar 16 16:24:33 crc kubenswrapper[5120]: I0316 16:24:33.392519 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b04c3f7-3328-4aef-92bc-42f328744879-logs" (OuterVolumeSpecName: "logs") pod "3b04c3f7-3328-4aef-92bc-42f328744879" (UID: "3b04c3f7-3328-4aef-92bc-42f328744879"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:24:33 crc kubenswrapper[5120]: I0316 16:24:33.393242 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7b05ec0c-8f80-4a86-8823-629c4e953395-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:33 crc kubenswrapper[5120]: I0316 16:24:33.393261 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/7b05ec0c-8f80-4a86-8823-629c4e953395-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:33 crc kubenswrapper[5120]: I0316 16:24:33.393272 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7b05ec0c-8f80-4a86-8823-629c4e953395-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:33 crc kubenswrapper[5120]: I0316 16:24:33.393281 5120 reconciler_common.go:299] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/7b05ec0c-8f80-4a86-8823-629c4e953395-fernet-keys\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:33 crc kubenswrapper[5120]: I0316 16:24:33.393291 5120 reconciler_common.go:299] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/7b05ec0c-8f80-4a86-8823-629c4e953395-credential-keys\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:33 crc kubenswrapper[5120]: I0316 16:24:33.393299 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/7b05ec0c-8f80-4a86-8823-629c4e953395-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:33 crc kubenswrapper[5120]: I0316 16:24:33.393307 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3b04c3f7-3328-4aef-92bc-42f328744879-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:33 crc kubenswrapper[5120]: I0316 16:24:33.393798 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zps2p\" (UniqueName: \"kubernetes.io/projected/7b05ec0c-8f80-4a86-8823-629c4e953395-kube-api-access-zps2p\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:33 crc kubenswrapper[5120]: I0316 16:24:33.393837 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7b05ec0c-8f80-4a86-8823-629c4e953395-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:33 crc kubenswrapper[5120]: I0316 16:24:33.395252 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b04c3f7-3328-4aef-92bc-42f328744879-kube-api-access-k7vrd" (OuterVolumeSpecName: "kube-api-access-k7vrd") pod "3b04c3f7-3328-4aef-92bc-42f328744879" (UID: "3b04c3f7-3328-4aef-92bc-42f328744879"). InnerVolumeSpecName "kube-api-access-k7vrd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:24:33 crc kubenswrapper[5120]: I0316 16:24:33.401054 5120 scope.go:117] "RemoveContainer" containerID="8b568e74a3015e82c143b45e4ec9c9806b390389907f25fffb8093f0f982c0cd" Mar 16 16:24:33 crc kubenswrapper[5120]: E0316 16:24:33.401399 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b568e74a3015e82c143b45e4ec9c9806b390389907f25fffb8093f0f982c0cd\": container with ID starting with 8b568e74a3015e82c143b45e4ec9c9806b390389907f25fffb8093f0f982c0cd not found: ID does not exist" containerID="8b568e74a3015e82c143b45e4ec9c9806b390389907f25fffb8093f0f982c0cd" Mar 16 16:24:33 crc kubenswrapper[5120]: I0316 16:24:33.401447 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b568e74a3015e82c143b45e4ec9c9806b390389907f25fffb8093f0f982c0cd"} err="failed to get container status \"8b568e74a3015e82c143b45e4ec9c9806b390389907f25fffb8093f0f982c0cd\": rpc error: code = NotFound desc = could not find container \"8b568e74a3015e82c143b45e4ec9c9806b390389907f25fffb8093f0f982c0cd\": container with ID starting with 8b568e74a3015e82c143b45e4ec9c9806b390389907f25fffb8093f0f982c0cd not found: ID does not exist" Mar 16 16:24:33 crc kubenswrapper[5120]: I0316 16:24:33.401492 5120 scope.go:117] "RemoveContainer" containerID="b28880e5a05a573108be1a0e941930a878933df93431db8ee6799513224cdd63" Mar 16 16:24:33 crc kubenswrapper[5120]: E0316 16:24:33.402347 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b28880e5a05a573108be1a0e941930a878933df93431db8ee6799513224cdd63\": container with ID starting with b28880e5a05a573108be1a0e941930a878933df93431db8ee6799513224cdd63 not found: ID does not exist" containerID="b28880e5a05a573108be1a0e941930a878933df93431db8ee6799513224cdd63" Mar 16 16:24:33 crc kubenswrapper[5120]: I0316 16:24:33.402374 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b28880e5a05a573108be1a0e941930a878933df93431db8ee6799513224cdd63"} err="failed to get container status \"b28880e5a05a573108be1a0e941930a878933df93431db8ee6799513224cdd63\": rpc error: code = NotFound desc = could not find container \"b28880e5a05a573108be1a0e941930a878933df93431db8ee6799513224cdd63\": container with ID starting with b28880e5a05a573108be1a0e941930a878933df93431db8ee6799513224cdd63 not found: ID does not exist" Mar 16 16:24:33 crc kubenswrapper[5120]: I0316 16:24:33.414045 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b04c3f7-3328-4aef-92bc-42f328744879-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "3b04c3f7-3328-4aef-92bc-42f328744879" (UID: "3b04c3f7-3328-4aef-92bc-42f328744879"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:24:33 crc kubenswrapper[5120]: I0316 16:24:33.414882 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b04c3f7-3328-4aef-92bc-42f328744879-custom-prometheus-ca" (OuterVolumeSpecName: "custom-prometheus-ca") pod "3b04c3f7-3328-4aef-92bc-42f328744879" (UID: "3b04c3f7-3328-4aef-92bc-42f328744879"). InnerVolumeSpecName "custom-prometheus-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:24:33 crc kubenswrapper[5120]: I0316 16:24:33.432248 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b04c3f7-3328-4aef-92bc-42f328744879-config-data" (OuterVolumeSpecName: "config-data") pod "3b04c3f7-3328-4aef-92bc-42f328744879" (UID: "3b04c3f7-3328-4aef-92bc-42f328744879"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:24:33 crc kubenswrapper[5120]: I0316 16:24:33.495665 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3b04c3f7-3328-4aef-92bc-42f328744879-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:33 crc kubenswrapper[5120]: I0316 16:24:33.495696 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3b04c3f7-3328-4aef-92bc-42f328744879-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:33 crc kubenswrapper[5120]: I0316 16:24:33.495707 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k7vrd\" (UniqueName: \"kubernetes.io/projected/3b04c3f7-3328-4aef-92bc-42f328744879-kube-api-access-k7vrd\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:33 crc kubenswrapper[5120]: I0316 16:24:33.495719 5120 reconciler_common.go:299] "Volume detached for volume \"custom-prometheus-ca\" (UniqueName: \"kubernetes.io/secret/3b04c3f7-3328-4aef-92bc-42f328744879-custom-prometheus-ca\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:33 crc kubenswrapper[5120]: I0316 16:24:33.655690 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-northd-0_794d950a-8664-4970-963a-2773749103e0/ovn-northd/0.log" Mar 16 16:24:33 crc kubenswrapper[5120]: I0316 16:24:33.655855 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"794d950a-8664-4970-963a-2773749103e0","Type":"ContainerDied","Data":"5f48480c944c7603cbd6f64783745e4a564303f08c21cb0422baddefbeed2a24"} Mar 16 16:24:33 crc kubenswrapper[5120]: I0316 16:24:33.655906 5120 scope.go:117] "RemoveContainer" containerID="28a01c5edf4ff6aef66071041d049bd9bd12e77fbd906ddfb625be33100a15b5" Mar 16 16:24:33 crc kubenswrapper[5120]: I0316 16:24:33.656068 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:24:33 crc kubenswrapper[5120]: I0316 16:24:33.673218 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-6bf46d9f46-cv8dx" event={"ID":"ecdbe440-4557-4298-b0b7-e2e89958bf07","Type":"ContainerDied","Data":"2c94e2c8cdc0b8ee4d5553efb4a6697a26f56c1b6df3aced5fdb636183f83d78"} Mar 16 16:24:33 crc kubenswrapper[5120]: I0316 16:24:33.675206 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-6bf46d9f46-cv8dx" Mar 16 16:24:33 crc kubenswrapper[5120]: I0316 16:24:33.688815 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-7bc85bbbf-4ttl9" Mar 16 16:24:33 crc kubenswrapper[5120]: I0316 16:24:33.689121 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-7bc85bbbf-4ttl9" event={"ID":"7b05ec0c-8f80-4a86-8823-629c4e953395","Type":"ContainerDied","Data":"070613f82c1eaf53a952f80ff11171e778cd4de17626bfdf96740ef00f776e39"} Mar 16 16:24:33 crc kubenswrapper[5120]: I0316 16:24:33.699447 5120 generic.go:358] "Generic (PLEG): container finished" podID="3b04c3f7-3328-4aef-92bc-42f328744879" containerID="9eb860bf6d2648fb5b6a19e67714ff9df156e4d633ea711717e4dd7ef09593c3" exitCode=0 Mar 16 16:24:33 crc kubenswrapper[5120]: I0316 16:24:33.699538 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/watcher-decision-engine-0" event={"ID":"3b04c3f7-3328-4aef-92bc-42f328744879","Type":"ContainerDied","Data":"9eb860bf6d2648fb5b6a19e67714ff9df156e4d633ea711717e4dd7ef09593c3"} Mar 16 16:24:33 crc kubenswrapper[5120]: I0316 16:24:33.699563 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/watcher-decision-engine-0" event={"ID":"3b04c3f7-3328-4aef-92bc-42f328744879","Type":"ContainerDied","Data":"b7fea4f6486e966b5cff9ae9e25d84e4d1d13f26497bab681ff2d690cb435116"} Mar 16 16:24:33 crc kubenswrapper[5120]: I0316 16:24:33.699558 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/watcher-decision-engine-0" Mar 16 16:24:33 crc kubenswrapper[5120]: I0316 16:24:33.733288 5120 scope.go:117] "RemoveContainer" containerID="0419588781daf97a47d3362db1f9a8d1a88d231d99c1a6cb08730e97206c4fed" Mar 16 16:24:33 crc kubenswrapper[5120]: I0316 16:24:33.733508 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 16:24:33 crc kubenswrapper[5120]: I0316 16:24:33.741919 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 16:24:33 crc kubenswrapper[5120]: I0316 16:24:33.799199 5120 scope.go:117] "RemoveContainer" containerID="ee098489a81ab6a4f9e4ca8e42dc2cbdb96791a0f059a8249a2d3bb49356b4d4" Mar 16 16:24:33 crc kubenswrapper[5120]: I0316 16:24:33.810251 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/watcher-decision-engine-0"] Mar 16 16:24:33 crc kubenswrapper[5120]: I0316 16:24:33.820060 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/watcher-decision-engine-0"] Mar 16 16:24:33 crc kubenswrapper[5120]: I0316 16:24:33.831400 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-6bf46d9f46-cv8dx"] Mar 16 16:24:33 crc kubenswrapper[5120]: I0316 16:24:33.840303 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-6bf46d9f46-cv8dx"] Mar 16 16:24:33 crc kubenswrapper[5120]: I0316 16:24:33.847537 5120 scope.go:117] "RemoveContainer" containerID="2e47d1a1b6ef394c9e4f761ae69ebb45114b8cfb8609be386af11e1fb6adb4e3" Mar 16 16:24:33 crc kubenswrapper[5120]: I0316 16:24:33.847904 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-7bc85bbbf-4ttl9"] Mar 16 16:24:33 crc kubenswrapper[5120]: I0316 16:24:33.855189 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-7bc85bbbf-4ttl9"] Mar 16 16:24:33 crc kubenswrapper[5120]: I0316 16:24:33.869502 5120 scope.go:117] "RemoveContainer" containerID="48370642f51fb950140c497068c7d992955ae7d6047b48a68307501d1a50da67" Mar 16 16:24:33 crc kubenswrapper[5120]: I0316 16:24:33.897469 5120 scope.go:117] "RemoveContainer" containerID="9eb860bf6d2648fb5b6a19e67714ff9df156e4d633ea711717e4dd7ef09593c3" Mar 16 16:24:33 crc kubenswrapper[5120]: I0316 16:24:33.926029 5120 scope.go:117] "RemoveContainer" containerID="9eb860bf6d2648fb5b6a19e67714ff9df156e4d633ea711717e4dd7ef09593c3" Mar 16 16:24:33 crc kubenswrapper[5120]: E0316 16:24:33.926357 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9eb860bf6d2648fb5b6a19e67714ff9df156e4d633ea711717e4dd7ef09593c3\": container with ID starting with 9eb860bf6d2648fb5b6a19e67714ff9df156e4d633ea711717e4dd7ef09593c3 not found: ID does not exist" containerID="9eb860bf6d2648fb5b6a19e67714ff9df156e4d633ea711717e4dd7ef09593c3" Mar 16 16:24:33 crc kubenswrapper[5120]: I0316 16:24:33.926397 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9eb860bf6d2648fb5b6a19e67714ff9df156e4d633ea711717e4dd7ef09593c3"} err="failed to get container status \"9eb860bf6d2648fb5b6a19e67714ff9df156e4d633ea711717e4dd7ef09593c3\": rpc error: code = NotFound desc = could not find container \"9eb860bf6d2648fb5b6a19e67714ff9df156e4d633ea711717e4dd7ef09593c3\": container with ID starting with 9eb860bf6d2648fb5b6a19e67714ff9df156e4d633ea711717e4dd7ef09593c3 not found: ID does not exist" Mar 16 16:24:34 crc kubenswrapper[5120]: I0316 16:24:34.385431 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:24:34 crc kubenswrapper[5120]: I0316 16:24:34.420461 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m452p\" (UniqueName: \"kubernetes.io/projected/dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93-kube-api-access-m452p\") pod \"dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93\" (UID: \"dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93\") " Mar 16 16:24:34 crc kubenswrapper[5120]: I0316 16:24:34.420551 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93-server-conf\") pod \"dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93\" (UID: \"dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93\") " Mar 16 16:24:34 crc kubenswrapper[5120]: I0316 16:24:34.420629 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93-config-data\") pod \"dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93\" (UID: \"dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93\") " Mar 16 16:24:34 crc kubenswrapper[5120]: I0316 16:24:34.420886 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"persistence\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93\" (UID: \"dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93\") " Mar 16 16:24:34 crc kubenswrapper[5120]: I0316 16:24:34.421052 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93-rabbitmq-confd\") pod \"dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93\" (UID: \"dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93\") " Mar 16 16:24:34 crc kubenswrapper[5120]: I0316 16:24:34.421108 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93-rabbitmq-tls\") pod \"dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93\" (UID: \"dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93\") " Mar 16 16:24:34 crc kubenswrapper[5120]: I0316 16:24:34.421219 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93-rabbitmq-plugins\") pod \"dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93\" (UID: \"dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93\") " Mar 16 16:24:34 crc kubenswrapper[5120]: I0316 16:24:34.421364 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93-rabbitmq-erlang-cookie\") pod \"dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93\" (UID: \"dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93\") " Mar 16 16:24:34 crc kubenswrapper[5120]: I0316 16:24:34.421471 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93-plugins-conf\") pod \"dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93\" (UID: \"dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93\") " Mar 16 16:24:34 crc kubenswrapper[5120]: I0316 16:24:34.421588 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93-pod-info\") pod \"dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93\" (UID: \"dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93\") " Mar 16 16:24:34 crc kubenswrapper[5120]: I0316 16:24:34.421638 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93-erlang-cookie-secret\") pod \"dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93\" (UID: \"dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93\") " Mar 16 16:24:34 crc kubenswrapper[5120]: I0316 16:24:34.424796 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93-rabbitmq-erlang-cookie" (OuterVolumeSpecName: "rabbitmq-erlang-cookie") pod "dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93" (UID: "dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93"). InnerVolumeSpecName "rabbitmq-erlang-cookie". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:24:34 crc kubenswrapper[5120]: I0316 16:24:34.425345 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93-rabbitmq-plugins" (OuterVolumeSpecName: "rabbitmq-plugins") pod "dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93" (UID: "dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93"). InnerVolumeSpecName "rabbitmq-plugins". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:24:34 crc kubenswrapper[5120]: I0316 16:24:34.426181 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93-plugins-conf" (OuterVolumeSpecName: "plugins-conf") pod "dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93" (UID: "dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93"). InnerVolumeSpecName "plugins-conf". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:24:34 crc kubenswrapper[5120]: I0316 16:24:34.427271 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93-erlang-cookie-secret" (OuterVolumeSpecName: "erlang-cookie-secret") pod "dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93" (UID: "dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93"). InnerVolumeSpecName "erlang-cookie-secret". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:24:34 crc kubenswrapper[5120]: I0316 16:24:34.437212 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage08-crc" (OuterVolumeSpecName: "persistence") pod "dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93" (UID: "dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93"). InnerVolumeSpecName "local-storage08-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:24:34 crc kubenswrapper[5120]: I0316 16:24:34.439616 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93-pod-info" (OuterVolumeSpecName: "pod-info") pod "dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93" (UID: "dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93"). InnerVolumeSpecName "pod-info". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Mar 16 16:24:34 crc kubenswrapper[5120]: I0316 16:24:34.440355 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93-kube-api-access-m452p" (OuterVolumeSpecName: "kube-api-access-m452p") pod "dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93" (UID: "dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93"). InnerVolumeSpecName "kube-api-access-m452p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:24:34 crc kubenswrapper[5120]: I0316 16:24:34.446877 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93-config-data" (OuterVolumeSpecName: "config-data") pod "dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93" (UID: "dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:24:34 crc kubenswrapper[5120]: I0316 16:24:34.454936 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93-rabbitmq-tls" (OuterVolumeSpecName: "rabbitmq-tls") pod "dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93" (UID: "dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93"). InnerVolumeSpecName "rabbitmq-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:24:34 crc kubenswrapper[5120]: I0316 16:24:34.498256 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93-server-conf" (OuterVolumeSpecName: "server-conf") pod "dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93" (UID: "dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93"). InnerVolumeSpecName "server-conf". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:24:34 crc kubenswrapper[5120]: I0316 16:24:34.529219 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") on node \"crc\" " Mar 16 16:24:34 crc kubenswrapper[5120]: I0316 16:24:34.529308 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93-rabbitmq-tls\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:34 crc kubenswrapper[5120]: I0316 16:24:34.529332 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93-rabbitmq-plugins\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:34 crc kubenswrapper[5120]: I0316 16:24:34.529354 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93-rabbitmq-erlang-cookie\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:34 crc kubenswrapper[5120]: I0316 16:24:34.529544 5120 reconciler_common.go:299] "Volume detached for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93-plugins-conf\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:34 crc kubenswrapper[5120]: I0316 16:24:34.529569 5120 reconciler_common.go:299] "Volume detached for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93-pod-info\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:34 crc kubenswrapper[5120]: I0316 16:24:34.529586 5120 reconciler_common.go:299] "Volume detached for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93-erlang-cookie-secret\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:34 crc kubenswrapper[5120]: I0316 16:24:34.529604 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m452p\" (UniqueName: \"kubernetes.io/projected/dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93-kube-api-access-m452p\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:34 crc kubenswrapper[5120]: I0316 16:24:34.529621 5120 reconciler_common.go:299] "Volume detached for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93-server-conf\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:34 crc kubenswrapper[5120]: I0316 16:24:34.529638 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:34 crc kubenswrapper[5120]: I0316 16:24:34.542852 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93-rabbitmq-confd" (OuterVolumeSpecName: "rabbitmq-confd") pod "dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93" (UID: "dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93"). InnerVolumeSpecName "rabbitmq-confd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:24:34 crc kubenswrapper[5120]: I0316 16:24:34.554322 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage08-crc" (UniqueName: "kubernetes.io/local-volume/local-storage08-crc") on node "crc" Mar 16 16:24:34 crc kubenswrapper[5120]: I0316 16:24:34.632720 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:34 crc kubenswrapper[5120]: I0316 16:24:34.632790 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93-rabbitmq-confd\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:34 crc kubenswrapper[5120]: I0316 16:24:34.679714 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="11468616-1e2d-4cfd-b172-299b0cc33f6e" path="/var/lib/kubelet/pods/11468616-1e2d-4cfd-b172-299b0cc33f6e/volumes" Mar 16 16:24:34 crc kubenswrapper[5120]: I0316 16:24:34.680502 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3b04c3f7-3328-4aef-92bc-42f328744879" path="/var/lib/kubelet/pods/3b04c3f7-3328-4aef-92bc-42f328744879/volumes" Mar 16 16:24:34 crc kubenswrapper[5120]: I0316 16:24:34.681156 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="69c47154-7063-4a88-af54-c4dba11e7fd6" path="/var/lib/kubelet/pods/69c47154-7063-4a88-af54-c4dba11e7fd6/volumes" Mar 16 16:24:34 crc kubenswrapper[5120]: I0316 16:24:34.682504 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="794d950a-8664-4970-963a-2773749103e0" path="/var/lib/kubelet/pods/794d950a-8664-4970-963a-2773749103e0/volumes" Mar 16 16:24:34 crc kubenswrapper[5120]: I0316 16:24:34.683192 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7b05ec0c-8f80-4a86-8823-629c4e953395" path="/var/lib/kubelet/pods/7b05ec0c-8f80-4a86-8823-629c4e953395/volumes" Mar 16 16:24:34 crc kubenswrapper[5120]: I0316 16:24:34.683849 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8558eb14-801e-455b-8374-1c69e333901c" path="/var/lib/kubelet/pods/8558eb14-801e-455b-8374-1c69e333901c/volumes" Mar 16 16:24:34 crc kubenswrapper[5120]: I0316 16:24:34.685198 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9185c9ac-7b26-4bbc-be42-545c166ba2c8" path="/var/lib/kubelet/pods/9185c9ac-7b26-4bbc-be42-545c166ba2c8/volumes" Mar 16 16:24:34 crc kubenswrapper[5120]: I0316 16:24:34.686014 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d4b88a4e-143e-46bd-ada8-56dece11d6cc" path="/var/lib/kubelet/pods/d4b88a4e-143e-46bd-ada8-56dece11d6cc/volumes" Mar 16 16:24:34 crc kubenswrapper[5120]: I0316 16:24:34.687460 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d5160b65-3a41-4645-9f47-bd4e891fef5f" path="/var/lib/kubelet/pods/d5160b65-3a41-4645-9f47-bd4e891fef5f/volumes" Mar 16 16:24:34 crc kubenswrapper[5120]: I0316 16:24:34.688153 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e15efd1b-6aa8-4a24-b576-4e03e19e19d0" path="/var/lib/kubelet/pods/e15efd1b-6aa8-4a24-b576-4e03e19e19d0/volumes" Mar 16 16:24:34 crc kubenswrapper[5120]: I0316 16:24:34.689504 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ecdbe440-4557-4298-b0b7-e2e89958bf07" path="/var/lib/kubelet/pods/ecdbe440-4557-4298-b0b7-e2e89958bf07/volumes" Mar 16 16:24:34 crc kubenswrapper[5120]: I0316 16:24:34.733752 5120 generic.go:358] "Generic (PLEG): container finished" podID="dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93" containerID="b8e19f90a888ff13c234758eff3ff394d92c8e571dbc711727543bdb57e3ecc7" exitCode=0 Mar 16 16:24:34 crc kubenswrapper[5120]: I0316 16:24:34.734175 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:24:34 crc kubenswrapper[5120]: I0316 16:24:34.735734 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93","Type":"ContainerDied","Data":"b8e19f90a888ff13c234758eff3ff394d92c8e571dbc711727543bdb57e3ecc7"} Mar 16 16:24:34 crc kubenswrapper[5120]: I0316 16:24:34.735832 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93","Type":"ContainerDied","Data":"44a2cccc864973454484f69be739562b1909ac1559b25c7b301cb292e1794ade"} Mar 16 16:24:34 crc kubenswrapper[5120]: I0316 16:24:34.735879 5120 scope.go:117] "RemoveContainer" containerID="b8e19f90a888ff13c234758eff3ff394d92c8e571dbc711727543bdb57e3ecc7" Mar 16 16:24:34 crc kubenswrapper[5120]: I0316 16:24:34.780826 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 16:24:34 crc kubenswrapper[5120]: I0316 16:24:34.785699 5120 scope.go:117] "RemoveContainer" containerID="6a2fb343ca510feb5a32f2ce7721ac643d1503dbfd5a0b3e76d3ce922f56d65e" Mar 16 16:24:34 crc kubenswrapper[5120]: I0316 16:24:34.791551 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 16:24:34 crc kubenswrapper[5120]: I0316 16:24:34.816568 5120 scope.go:117] "RemoveContainer" containerID="b8e19f90a888ff13c234758eff3ff394d92c8e571dbc711727543bdb57e3ecc7" Mar 16 16:24:34 crc kubenswrapper[5120]: E0316 16:24:34.817135 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b8e19f90a888ff13c234758eff3ff394d92c8e571dbc711727543bdb57e3ecc7\": container with ID starting with b8e19f90a888ff13c234758eff3ff394d92c8e571dbc711727543bdb57e3ecc7 not found: ID does not exist" containerID="b8e19f90a888ff13c234758eff3ff394d92c8e571dbc711727543bdb57e3ecc7" Mar 16 16:24:34 crc kubenswrapper[5120]: I0316 16:24:34.817173 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8e19f90a888ff13c234758eff3ff394d92c8e571dbc711727543bdb57e3ecc7"} err="failed to get container status \"b8e19f90a888ff13c234758eff3ff394d92c8e571dbc711727543bdb57e3ecc7\": rpc error: code = NotFound desc = could not find container \"b8e19f90a888ff13c234758eff3ff394d92c8e571dbc711727543bdb57e3ecc7\": container with ID starting with b8e19f90a888ff13c234758eff3ff394d92c8e571dbc711727543bdb57e3ecc7 not found: ID does not exist" Mar 16 16:24:34 crc kubenswrapper[5120]: I0316 16:24:34.817197 5120 scope.go:117] "RemoveContainer" containerID="6a2fb343ca510feb5a32f2ce7721ac643d1503dbfd5a0b3e76d3ce922f56d65e" Mar 16 16:24:34 crc kubenswrapper[5120]: E0316 16:24:34.817582 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a2fb343ca510feb5a32f2ce7721ac643d1503dbfd5a0b3e76d3ce922f56d65e\": container with ID starting with 6a2fb343ca510feb5a32f2ce7721ac643d1503dbfd5a0b3e76d3ce922f56d65e not found: ID does not exist" containerID="6a2fb343ca510feb5a32f2ce7721ac643d1503dbfd5a0b3e76d3ce922f56d65e" Mar 16 16:24:34 crc kubenswrapper[5120]: I0316 16:24:34.817632 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a2fb343ca510feb5a32f2ce7721ac643d1503dbfd5a0b3e76d3ce922f56d65e"} err="failed to get container status \"6a2fb343ca510feb5a32f2ce7721ac643d1503dbfd5a0b3e76d3ce922f56d65e\": rpc error: code = NotFound desc = could not find container \"6a2fb343ca510feb5a32f2ce7721ac643d1503dbfd5a0b3e76d3ce922f56d65e\": container with ID starting with 6a2fb343ca510feb5a32f2ce7721ac643d1503dbfd5a0b3e76d3ce922f56d65e not found: ID does not exist" Mar 16 16:24:35 crc kubenswrapper[5120]: E0316 16:24:35.450621 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 16:24:35 crc kubenswrapper[5120]: E0316 16:24:35.450728 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00712a43-f38b-478f-bd42-a8cb0c2c14b3-combined-ca-bundle podName:00712a43-f38b-478f-bd42-a8cb0c2c14b3 nodeName:}" failed. No retries permitted until 2026-03-16 16:24:43.450681593 +0000 UTC m=+3185.604613250 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/00712a43-f38b-478f-bd42-a8cb0c2c14b3-combined-ca-bundle") pod "nova-cell1-conductor-0" (UID: "00712a43-f38b-478f-bd42-a8cb0c2c14b3") : secret "combined-ca-bundle" not found Mar 16 16:24:35 crc kubenswrapper[5120]: I0316 16:24:35.664035 5120 scope.go:117] "RemoveContainer" containerID="f40e444f89abd558ac90555bfd58e04a1c4379a653ba8035c228d2b7a5443eb5" Mar 16 16:24:35 crc kubenswrapper[5120]: E0316 16:24:35.664507 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:24:36 crc kubenswrapper[5120]: I0316 16:24:36.251690 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:24:36 crc kubenswrapper[5120]: I0316 16:24:36.251933 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="243c208b-8b2f-4041-9adc-aa2fee8f07f9" containerName="nova-scheduler-scheduler" containerID="cri-o://5e6baa9f78619e40ffd6a36cfbb9720f6f4f84ce1842a854e4e515f3444ed405" gracePeriod=30 Mar 16 16:24:36 crc kubenswrapper[5120]: I0316 16:24:36.680576 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93" path="/var/lib/kubelet/pods/dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93/volumes" Mar 16 16:24:37 crc kubenswrapper[5120]: I0316 16:24:37.069314 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 16:24:37 crc kubenswrapper[5120]: I0316 16:24:37.069608 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/memcached-0" podUID="ba0d3286-038b-4735-b0b4-1ce9b3faeed1" containerName="memcached" containerID="cri-o://3a4b5e65bf5e800c769f7c15e8f403de6b226620ed492165a5326a15bf9c76d3" gracePeriod=30 Mar 16 16:24:37 crc kubenswrapper[5120]: I0316 16:24:37.083078 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-2bwpk"] Mar 16 16:24:37 crc kubenswrapper[5120]: I0316 16:24:37.091594 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-2bwpk"] Mar 16 16:24:37 crc kubenswrapper[5120]: I0316 16:24:37.101409 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 16:24:37 crc kubenswrapper[5120]: I0316 16:24:37.101667 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="00712a43-f38b-478f-bd42-a8cb0c2c14b3" containerName="nova-cell1-conductor-conductor" containerID="cri-o://e20d7270f4fe9453876580e96b11e1123f8f3ee72618f8412137ebf03e720b64" gracePeriod=30 Mar 16 16:24:37 crc kubenswrapper[5120]: I0316 16:24:37.113379 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-x6zpt"] Mar 16 16:24:37 crc kubenswrapper[5120]: I0316 16:24:37.120295 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-x6zpt"] Mar 16 16:24:37 crc kubenswrapper[5120]: I0316 16:24:37.640018 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-q5hqq" Mar 16 16:24:37 crc kubenswrapper[5120]: I0316 16:24:37.739696 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-6c9947cfc-tjlwq"] Mar 16 16:24:37 crc kubenswrapper[5120]: I0316 16:24:37.740051 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6c9947cfc-tjlwq" podUID="1195ba16-9c86-4aeb-b62f-a93570eb8b02" containerName="dnsmasq-dns" containerID="cri-o://f0b65a6a153b621263f90d92c1fc08c1e81948794cb1a5a296e5138ea7560e07" gracePeriod=10 Mar 16 16:24:37 crc kubenswrapper[5120]: I0316 16:24:37.787856 5120 generic.go:358] "Generic (PLEG): container finished" podID="ba0d3286-038b-4735-b0b4-1ce9b3faeed1" containerID="3a4b5e65bf5e800c769f7c15e8f403de6b226620ed492165a5326a15bf9c76d3" exitCode=0 Mar 16 16:24:37 crc kubenswrapper[5120]: I0316 16:24:37.788056 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"ba0d3286-038b-4735-b0b4-1ce9b3faeed1","Type":"ContainerDied","Data":"3a4b5e65bf5e800c769f7c15e8f403de6b226620ed492165a5326a15bf9c76d3"} Mar 16 16:24:38 crc kubenswrapper[5120]: I0316 16:24:38.043613 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Mar 16 16:24:38 crc kubenswrapper[5120]: I0316 16:24:38.117751 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/ba0d3286-038b-4735-b0b4-1ce9b3faeed1-config-data\") pod \"ba0d3286-038b-4735-b0b4-1ce9b3faeed1\" (UID: \"ba0d3286-038b-4735-b0b4-1ce9b3faeed1\") " Mar 16 16:24:38 crc kubenswrapper[5120]: I0316 16:24:38.118166 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j4bw4\" (UniqueName: \"kubernetes.io/projected/ba0d3286-038b-4735-b0b4-1ce9b3faeed1-kube-api-access-j4bw4\") pod \"ba0d3286-038b-4735-b0b4-1ce9b3faeed1\" (UID: \"ba0d3286-038b-4735-b0b4-1ce9b3faeed1\") " Mar 16 16:24:38 crc kubenswrapper[5120]: I0316 16:24:38.118329 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/ba0d3286-038b-4735-b0b4-1ce9b3faeed1-kolla-config\") pod \"ba0d3286-038b-4735-b0b4-1ce9b3faeed1\" (UID: \"ba0d3286-038b-4735-b0b4-1ce9b3faeed1\") " Mar 16 16:24:38 crc kubenswrapper[5120]: I0316 16:24:38.118442 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/ba0d3286-038b-4735-b0b4-1ce9b3faeed1-memcached-tls-certs\") pod \"ba0d3286-038b-4735-b0b4-1ce9b3faeed1\" (UID: \"ba0d3286-038b-4735-b0b4-1ce9b3faeed1\") " Mar 16 16:24:38 crc kubenswrapper[5120]: I0316 16:24:38.118521 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ba0d3286-038b-4735-b0b4-1ce9b3faeed1-combined-ca-bundle\") pod \"ba0d3286-038b-4735-b0b4-1ce9b3faeed1\" (UID: \"ba0d3286-038b-4735-b0b4-1ce9b3faeed1\") " Mar 16 16:24:38 crc kubenswrapper[5120]: I0316 16:24:38.118530 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba0d3286-038b-4735-b0b4-1ce9b3faeed1-config-data" (OuterVolumeSpecName: "config-data") pod "ba0d3286-038b-4735-b0b4-1ce9b3faeed1" (UID: "ba0d3286-038b-4735-b0b4-1ce9b3faeed1"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:24:38 crc kubenswrapper[5120]: I0316 16:24:38.118796 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba0d3286-038b-4735-b0b4-1ce9b3faeed1-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "ba0d3286-038b-4735-b0b4-1ce9b3faeed1" (UID: "ba0d3286-038b-4735-b0b4-1ce9b3faeed1"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:24:38 crc kubenswrapper[5120]: I0316 16:24:38.119157 5120 reconciler_common.go:299] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/ba0d3286-038b-4735-b0b4-1ce9b3faeed1-kolla-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:38 crc kubenswrapper[5120]: I0316 16:24:38.119227 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/ba0d3286-038b-4735-b0b4-1ce9b3faeed1-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:38 crc kubenswrapper[5120]: I0316 16:24:38.124883 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba0d3286-038b-4735-b0b4-1ce9b3faeed1-kube-api-access-j4bw4" (OuterVolumeSpecName: "kube-api-access-j4bw4") pod "ba0d3286-038b-4735-b0b4-1ce9b3faeed1" (UID: "ba0d3286-038b-4735-b0b4-1ce9b3faeed1"). InnerVolumeSpecName "kube-api-access-j4bw4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:24:38 crc kubenswrapper[5120]: I0316 16:24:38.160143 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba0d3286-038b-4735-b0b4-1ce9b3faeed1-memcached-tls-certs" (OuterVolumeSpecName: "memcached-tls-certs") pod "ba0d3286-038b-4735-b0b4-1ce9b3faeed1" (UID: "ba0d3286-038b-4735-b0b4-1ce9b3faeed1"). InnerVolumeSpecName "memcached-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:24:38 crc kubenswrapper[5120]: I0316 16:24:38.163358 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba0d3286-038b-4735-b0b4-1ce9b3faeed1-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ba0d3286-038b-4735-b0b4-1ce9b3faeed1" (UID: "ba0d3286-038b-4735-b0b4-1ce9b3faeed1"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:24:38 crc kubenswrapper[5120]: I0316 16:24:38.163731 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6c9947cfc-tjlwq" Mar 16 16:24:38 crc kubenswrapper[5120]: I0316 16:24:38.221094 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j4bw4\" (UniqueName: \"kubernetes.io/projected/ba0d3286-038b-4735-b0b4-1ce9b3faeed1-kube-api-access-j4bw4\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:38 crc kubenswrapper[5120]: I0316 16:24:38.221147 5120 reconciler_common.go:299] "Volume detached for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/ba0d3286-038b-4735-b0b4-1ce9b3faeed1-memcached-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:38 crc kubenswrapper[5120]: I0316 16:24:38.221157 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ba0d3286-038b-4735-b0b4-1ce9b3faeed1-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:38 crc kubenswrapper[5120]: I0316 16:24:38.322993 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/1195ba16-9c86-4aeb-b62f-a93570eb8b02-dns-swift-storage-0\") pod \"1195ba16-9c86-4aeb-b62f-a93570eb8b02\" (UID: \"1195ba16-9c86-4aeb-b62f-a93570eb8b02\") " Mar 16 16:24:38 crc kubenswrapper[5120]: I0316 16:24:38.323982 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1195ba16-9c86-4aeb-b62f-a93570eb8b02-config\") pod \"1195ba16-9c86-4aeb-b62f-a93570eb8b02\" (UID: \"1195ba16-9c86-4aeb-b62f-a93570eb8b02\") " Mar 16 16:24:38 crc kubenswrapper[5120]: I0316 16:24:38.324420 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/1195ba16-9c86-4aeb-b62f-a93570eb8b02-dnsmasq-svc\") pod \"1195ba16-9c86-4aeb-b62f-a93570eb8b02\" (UID: \"1195ba16-9c86-4aeb-b62f-a93570eb8b02\") " Mar 16 16:24:38 crc kubenswrapper[5120]: I0316 16:24:38.324530 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kxkw6\" (UniqueName: \"kubernetes.io/projected/1195ba16-9c86-4aeb-b62f-a93570eb8b02-kube-api-access-kxkw6\") pod \"1195ba16-9c86-4aeb-b62f-a93570eb8b02\" (UID: \"1195ba16-9c86-4aeb-b62f-a93570eb8b02\") " Mar 16 16:24:38 crc kubenswrapper[5120]: I0316 16:24:38.329812 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1195ba16-9c86-4aeb-b62f-a93570eb8b02-kube-api-access-kxkw6" (OuterVolumeSpecName: "kube-api-access-kxkw6") pod "1195ba16-9c86-4aeb-b62f-a93570eb8b02" (UID: "1195ba16-9c86-4aeb-b62f-a93570eb8b02"). InnerVolumeSpecName "kube-api-access-kxkw6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:24:38 crc kubenswrapper[5120]: I0316 16:24:38.358526 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1195ba16-9c86-4aeb-b62f-a93570eb8b02-config" (OuterVolumeSpecName: "config") pod "1195ba16-9c86-4aeb-b62f-a93570eb8b02" (UID: "1195ba16-9c86-4aeb-b62f-a93570eb8b02"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:24:38 crc kubenswrapper[5120]: I0316 16:24:38.375741 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1195ba16-9c86-4aeb-b62f-a93570eb8b02-dns-swift-storage-0" (OuterVolumeSpecName: "dns-swift-storage-0") pod "1195ba16-9c86-4aeb-b62f-a93570eb8b02" (UID: "1195ba16-9c86-4aeb-b62f-a93570eb8b02"). InnerVolumeSpecName "dns-swift-storage-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:24:38 crc kubenswrapper[5120]: I0316 16:24:38.397087 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1195ba16-9c86-4aeb-b62f-a93570eb8b02-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "1195ba16-9c86-4aeb-b62f-a93570eb8b02" (UID: "1195ba16-9c86-4aeb-b62f-a93570eb8b02"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:24:38 crc kubenswrapper[5120]: I0316 16:24:38.427363 5120 reconciler_common.go:299] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/1195ba16-9c86-4aeb-b62f-a93570eb8b02-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:38 crc kubenswrapper[5120]: I0316 16:24:38.427394 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kxkw6\" (UniqueName: \"kubernetes.io/projected/1195ba16-9c86-4aeb-b62f-a93570eb8b02-kube-api-access-kxkw6\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:38 crc kubenswrapper[5120]: I0316 16:24:38.427404 5120 reconciler_common.go:299] "Volume detached for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/1195ba16-9c86-4aeb-b62f-a93570eb8b02-dns-swift-storage-0\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:38 crc kubenswrapper[5120]: I0316 16:24:38.427412 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1195ba16-9c86-4aeb-b62f-a93570eb8b02-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:38 crc kubenswrapper[5120]: I0316 16:24:38.683171 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="596799c6-6d4c-4bac-b499-ce3eee4c68ea" path="/var/lib/kubelet/pods/596799c6-6d4c-4bac-b499-ce3eee4c68ea/volumes" Mar 16 16:24:38 crc kubenswrapper[5120]: I0316 16:24:38.684299 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5db65e99-b0fe-4cf7-975c-6452ca8dfa62" path="/var/lib/kubelet/pods/5db65e99-b0fe-4cf7-975c-6452ca8dfa62/volumes" Mar 16 16:24:38 crc kubenswrapper[5120]: I0316 16:24:38.809172 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Mar 16 16:24:38 crc kubenswrapper[5120]: I0316 16:24:38.809176 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"ba0d3286-038b-4735-b0b4-1ce9b3faeed1","Type":"ContainerDied","Data":"b9f3c464989a1affa3a4f085c00961d5c30aedbd39d59ff691ab4f489b7b0402"} Mar 16 16:24:38 crc kubenswrapper[5120]: I0316 16:24:38.809345 5120 scope.go:117] "RemoveContainer" containerID="3a4b5e65bf5e800c769f7c15e8f403de6b226620ed492165a5326a15bf9c76d3" Mar 16 16:24:38 crc kubenswrapper[5120]: I0316 16:24:38.815200 5120 generic.go:358] "Generic (PLEG): container finished" podID="1195ba16-9c86-4aeb-b62f-a93570eb8b02" containerID="f0b65a6a153b621263f90d92c1fc08c1e81948794cb1a5a296e5138ea7560e07" exitCode=0 Mar 16 16:24:38 crc kubenswrapper[5120]: I0316 16:24:38.815701 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6c9947cfc-tjlwq" event={"ID":"1195ba16-9c86-4aeb-b62f-a93570eb8b02","Type":"ContainerDied","Data":"f0b65a6a153b621263f90d92c1fc08c1e81948794cb1a5a296e5138ea7560e07"} Mar 16 16:24:38 crc kubenswrapper[5120]: I0316 16:24:38.815747 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6c9947cfc-tjlwq" event={"ID":"1195ba16-9c86-4aeb-b62f-a93570eb8b02","Type":"ContainerDied","Data":"d52e407e5ce6d18418b6c5e6c53b6dfc5c15b9fed0c932a46205d56c13d5eac2"} Mar 16 16:24:38 crc kubenswrapper[5120]: I0316 16:24:38.815868 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6c9947cfc-tjlwq" Mar 16 16:24:38 crc kubenswrapper[5120]: I0316 16:24:38.841059 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 16:24:38 crc kubenswrapper[5120]: I0316 16:24:38.847891 5120 scope.go:117] "RemoveContainer" containerID="f0b65a6a153b621263f90d92c1fc08c1e81948794cb1a5a296e5138ea7560e07" Mar 16 16:24:38 crc kubenswrapper[5120]: I0316 16:24:38.851317 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 16:24:38 crc kubenswrapper[5120]: I0316 16:24:38.859675 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-6c9947cfc-tjlwq"] Mar 16 16:24:38 crc kubenswrapper[5120]: I0316 16:24:38.868494 5120 scope.go:117] "RemoveContainer" containerID="58894cc87b2d78e35392e8f10235f6f16cc3bc32f31c6e78ab6be9a3edc0cc33" Mar 16 16:24:38 crc kubenswrapper[5120]: I0316 16:24:38.868660 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-6c9947cfc-tjlwq"] Mar 16 16:24:38 crc kubenswrapper[5120]: I0316 16:24:38.889704 5120 scope.go:117] "RemoveContainer" containerID="f0b65a6a153b621263f90d92c1fc08c1e81948794cb1a5a296e5138ea7560e07" Mar 16 16:24:38 crc kubenswrapper[5120]: E0316 16:24:38.890082 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f0b65a6a153b621263f90d92c1fc08c1e81948794cb1a5a296e5138ea7560e07\": container with ID starting with f0b65a6a153b621263f90d92c1fc08c1e81948794cb1a5a296e5138ea7560e07 not found: ID does not exist" containerID="f0b65a6a153b621263f90d92c1fc08c1e81948794cb1a5a296e5138ea7560e07" Mar 16 16:24:38 crc kubenswrapper[5120]: I0316 16:24:38.890113 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0b65a6a153b621263f90d92c1fc08c1e81948794cb1a5a296e5138ea7560e07"} err="failed to get container status \"f0b65a6a153b621263f90d92c1fc08c1e81948794cb1a5a296e5138ea7560e07\": rpc error: code = NotFound desc = could not find container \"f0b65a6a153b621263f90d92c1fc08c1e81948794cb1a5a296e5138ea7560e07\": container with ID starting with f0b65a6a153b621263f90d92c1fc08c1e81948794cb1a5a296e5138ea7560e07 not found: ID does not exist" Mar 16 16:24:38 crc kubenswrapper[5120]: I0316 16:24:38.890138 5120 scope.go:117] "RemoveContainer" containerID="58894cc87b2d78e35392e8f10235f6f16cc3bc32f31c6e78ab6be9a3edc0cc33" Mar 16 16:24:38 crc kubenswrapper[5120]: E0316 16:24:38.890514 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"58894cc87b2d78e35392e8f10235f6f16cc3bc32f31c6e78ab6be9a3edc0cc33\": container with ID starting with 58894cc87b2d78e35392e8f10235f6f16cc3bc32f31c6e78ab6be9a3edc0cc33 not found: ID does not exist" containerID="58894cc87b2d78e35392e8f10235f6f16cc3bc32f31c6e78ab6be9a3edc0cc33" Mar 16 16:24:38 crc kubenswrapper[5120]: I0316 16:24:38.890557 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58894cc87b2d78e35392e8f10235f6f16cc3bc32f31c6e78ab6be9a3edc0cc33"} err="failed to get container status \"58894cc87b2d78e35392e8f10235f6f16cc3bc32f31c6e78ab6be9a3edc0cc33\": rpc error: code = NotFound desc = could not find container \"58894cc87b2d78e35392e8f10235f6f16cc3bc32f31c6e78ab6be9a3edc0cc33\": container with ID starting with 58894cc87b2d78e35392e8f10235f6f16cc3bc32f31c6e78ab6be9a3edc0cc33 not found: ID does not exist" Mar 16 16:24:39 crc kubenswrapper[5120]: E0316 16:24:39.658831 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="e20d7270f4fe9453876580e96b11e1123f8f3ee72618f8412137ebf03e720b64" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:24:39 crc kubenswrapper[5120]: E0316 16:24:39.662093 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="e20d7270f4fe9453876580e96b11e1123f8f3ee72618f8412137ebf03e720b64" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:24:39 crc kubenswrapper[5120]: E0316 16:24:39.663561 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="e20d7270f4fe9453876580e96b11e1123f8f3ee72618f8412137ebf03e720b64" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:24:39 crc kubenswrapper[5120]: E0316 16:24:39.663598 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="00712a43-f38b-478f-bd42-a8cb0c2c14b3" containerName="nova-cell1-conductor-conductor" probeResult="unknown" Mar 16 16:24:40 crc kubenswrapper[5120]: E0316 16:24:40.212551 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="5e6baa9f78619e40ffd6a36cfbb9720f6f4f84ce1842a854e4e515f3444ed405" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:24:40 crc kubenswrapper[5120]: E0316 16:24:40.215210 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="5e6baa9f78619e40ffd6a36cfbb9720f6f4f84ce1842a854e4e515f3444ed405" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:24:40 crc kubenswrapper[5120]: E0316 16:24:40.216954 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="5e6baa9f78619e40ffd6a36cfbb9720f6f4f84ce1842a854e4e515f3444ed405" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:24:40 crc kubenswrapper[5120]: E0316 16:24:40.217046 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="243c208b-8b2f-4041-9adc-aa2fee8f07f9" containerName="nova-scheduler-scheduler" probeResult="unknown" Mar 16 16:24:40 crc kubenswrapper[5120]: I0316 16:24:40.678925 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1195ba16-9c86-4aeb-b62f-a93570eb8b02" path="/var/lib/kubelet/pods/1195ba16-9c86-4aeb-b62f-a93570eb8b02/volumes" Mar 16 16:24:40 crc kubenswrapper[5120]: I0316 16:24:40.679574 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba0d3286-038b-4735-b0b4-1ce9b3faeed1" path="/var/lib/kubelet/pods/ba0d3286-038b-4735-b0b4-1ce9b3faeed1/volumes" Mar 16 16:24:43 crc kubenswrapper[5120]: E0316 16:24:43.543042 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 16:24:43 crc kubenswrapper[5120]: E0316 16:24:43.544375 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00712a43-f38b-478f-bd42-a8cb0c2c14b3-combined-ca-bundle podName:00712a43-f38b-478f-bd42-a8cb0c2c14b3 nodeName:}" failed. No retries permitted until 2026-03-16 16:24:59.544350485 +0000 UTC m=+3201.698282162 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/00712a43-f38b-478f-bd42-a8cb0c2c14b3-combined-ca-bundle") pod "nova-cell1-conductor-0" (UID: "00712a43-f38b-478f-bd42-a8cb0c2c14b3") : secret "combined-ca-bundle" not found Mar 16 16:24:44 crc kubenswrapper[5120]: E0316 16:24:44.658654 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="e20d7270f4fe9453876580e96b11e1123f8f3ee72618f8412137ebf03e720b64" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:24:44 crc kubenswrapper[5120]: E0316 16:24:44.662706 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="e20d7270f4fe9453876580e96b11e1123f8f3ee72618f8412137ebf03e720b64" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:24:44 crc kubenswrapper[5120]: E0316 16:24:44.665488 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="e20d7270f4fe9453876580e96b11e1123f8f3ee72618f8412137ebf03e720b64" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:24:44 crc kubenswrapper[5120]: E0316 16:24:44.665580 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="00712a43-f38b-478f-bd42-a8cb0c2c14b3" containerName="nova-cell1-conductor-conductor" probeResult="unknown" Mar 16 16:24:45 crc kubenswrapper[5120]: E0316 16:24:45.212272 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="5e6baa9f78619e40ffd6a36cfbb9720f6f4f84ce1842a854e4e515f3444ed405" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:24:45 crc kubenswrapper[5120]: E0316 16:24:45.215743 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="5e6baa9f78619e40ffd6a36cfbb9720f6f4f84ce1842a854e4e515f3444ed405" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:24:45 crc kubenswrapper[5120]: E0316 16:24:45.219112 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="5e6baa9f78619e40ffd6a36cfbb9720f6f4f84ce1842a854e4e515f3444ed405" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:24:45 crc kubenswrapper[5120]: E0316 16:24:45.219226 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="243c208b-8b2f-4041-9adc-aa2fee8f07f9" containerName="nova-scheduler-scheduler" probeResult="unknown" Mar 16 16:24:45 crc kubenswrapper[5120]: I0316 16:24:45.976391 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/neutron-6d4b69cb4d-gjpzv" podUID="1d4fa436-d4ae-48e8-b4db-5e9096c6f51d" containerName="neutron-httpd" probeResult="failure" output="Get \"https://10.217.1.105:9696/\": dial tcp 10.217.1.105:9696: connect: connection refused" Mar 16 16:24:49 crc kubenswrapper[5120]: E0316 16:24:49.658403 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="e20d7270f4fe9453876580e96b11e1123f8f3ee72618f8412137ebf03e720b64" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:24:49 crc kubenswrapper[5120]: E0316 16:24:49.661007 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="e20d7270f4fe9453876580e96b11e1123f8f3ee72618f8412137ebf03e720b64" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:24:49 crc kubenswrapper[5120]: E0316 16:24:49.664140 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="e20d7270f4fe9453876580e96b11e1123f8f3ee72618f8412137ebf03e720b64" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:24:49 crc kubenswrapper[5120]: E0316 16:24:49.664265 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="00712a43-f38b-478f-bd42-a8cb0c2c14b3" containerName="nova-cell1-conductor-conductor" probeResult="unknown" Mar 16 16:24:50 crc kubenswrapper[5120]: E0316 16:24:50.213458 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="5e6baa9f78619e40ffd6a36cfbb9720f6f4f84ce1842a854e4e515f3444ed405" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:24:50 crc kubenswrapper[5120]: E0316 16:24:50.220295 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="5e6baa9f78619e40ffd6a36cfbb9720f6f4f84ce1842a854e4e515f3444ed405" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:24:50 crc kubenswrapper[5120]: E0316 16:24:50.222693 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="5e6baa9f78619e40ffd6a36cfbb9720f6f4f84ce1842a854e4e515f3444ed405" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:24:50 crc kubenswrapper[5120]: E0316 16:24:50.222958 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="243c208b-8b2f-4041-9adc-aa2fee8f07f9" containerName="nova-scheduler-scheduler" probeResult="unknown" Mar 16 16:24:50 crc kubenswrapper[5120]: I0316 16:24:50.665347 5120 scope.go:117] "RemoveContainer" containerID="f40e444f89abd558ac90555bfd58e04a1c4379a653ba8035c228d2b7a5443eb5" Mar 16 16:24:50 crc kubenswrapper[5120]: E0316 16:24:50.667081 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:24:51 crc kubenswrapper[5120]: I0316 16:24:51.403486 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/ceilometer-0" podUID="bd019f3d-1483-40e4-9534-b8bd551ed652" containerName="proxy-httpd" probeResult="failure" output="Get \"https://10.217.1.143:3000/\": dial tcp 10.217.1.143:3000: connect: connection refused" Mar 16 16:24:54 crc kubenswrapper[5120]: E0316 16:24:54.657419 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="e20d7270f4fe9453876580e96b11e1123f8f3ee72618f8412137ebf03e720b64" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:24:54 crc kubenswrapper[5120]: E0316 16:24:54.660636 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="e20d7270f4fe9453876580e96b11e1123f8f3ee72618f8412137ebf03e720b64" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:24:54 crc kubenswrapper[5120]: E0316 16:24:54.662581 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="e20d7270f4fe9453876580e96b11e1123f8f3ee72618f8412137ebf03e720b64" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:24:54 crc kubenswrapper[5120]: E0316 16:24:54.662749 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="00712a43-f38b-478f-bd42-a8cb0c2c14b3" containerName="nova-cell1-conductor-conductor" probeResult="unknown" Mar 16 16:24:55 crc kubenswrapper[5120]: E0316 16:24:55.213807 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="5e6baa9f78619e40ffd6a36cfbb9720f6f4f84ce1842a854e4e515f3444ed405" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:24:55 crc kubenswrapper[5120]: E0316 16:24:55.216937 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="5e6baa9f78619e40ffd6a36cfbb9720f6f4f84ce1842a854e4e515f3444ed405" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:24:55 crc kubenswrapper[5120]: E0316 16:24:55.219324 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="5e6baa9f78619e40ffd6a36cfbb9720f6f4f84ce1842a854e4e515f3444ed405" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:24:55 crc kubenswrapper[5120]: E0316 16:24:55.219425 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="243c208b-8b2f-4041-9adc-aa2fee8f07f9" containerName="nova-scheduler-scheduler" probeResult="unknown" Mar 16 16:24:57 crc kubenswrapper[5120]: I0316 16:24:57.044376 5120 generic.go:358] "Generic (PLEG): container finished" podID="7f5bff08-fc88-42fc-ab9b-6d8db171ee6a" containerID="88d0838f0e55c2ee07fde8bbf71e8df1ae6de7871d90a1d121e8c8c31cc0d30c" exitCode=137 Mar 16 16:24:57 crc kubenswrapper[5120]: I0316 16:24:57.044504 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7f5bff08-fc88-42fc-ab9b-6d8db171ee6a","Type":"ContainerDied","Data":"88d0838f0e55c2ee07fde8bbf71e8df1ae6de7871d90a1d121e8c8c31cc0d30c"} Mar 16 16:24:57 crc kubenswrapper[5120]: I0316 16:24:57.047243 5120 generic.go:358] "Generic (PLEG): container finished" podID="73c9b7cf-53e7-4e3b-81c4-f674f8bfd894" containerID="6d0c744e21abc67d4d22f2172b5ffdd0c1c8058e7ea0636d21a2bf8a35b91b0e" exitCode=137 Mar 16 16:24:57 crc kubenswrapper[5120]: I0316 16:24:57.047501 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"73c9b7cf-53e7-4e3b-81c4-f674f8bfd894","Type":"ContainerDied","Data":"6d0c744e21abc67d4d22f2172b5ffdd0c1c8058e7ea0636d21a2bf8a35b91b0e"} Mar 16 16:24:57 crc kubenswrapper[5120]: I0316 16:24:57.386011 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:24:57 crc kubenswrapper[5120]: I0316 16:24:57.404064 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:24:57 crc kubenswrapper[5120]: I0316 16:24:57.492800 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/73c9b7cf-53e7-4e3b-81c4-f674f8bfd894-scripts\") pod \"73c9b7cf-53e7-4e3b-81c4-f674f8bfd894\" (UID: \"73c9b7cf-53e7-4e3b-81c4-f674f8bfd894\") " Mar 16 16:24:57 crc kubenswrapper[5120]: I0316 16:24:57.492840 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"swift\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"7f5bff08-fc88-42fc-ab9b-6d8db171ee6a\" (UID: \"7f5bff08-fc88-42fc-ab9b-6d8db171ee6a\") " Mar 16 16:24:57 crc kubenswrapper[5120]: I0316 16:24:57.492925 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zzmqk\" (UniqueName: \"kubernetes.io/projected/73c9b7cf-53e7-4e3b-81c4-f674f8bfd894-kube-api-access-zzmqk\") pod \"73c9b7cf-53e7-4e3b-81c4-f674f8bfd894\" (UID: \"73c9b7cf-53e7-4e3b-81c4-f674f8bfd894\") " Mar 16 16:24:57 crc kubenswrapper[5120]: I0316 16:24:57.492975 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/73c9b7cf-53e7-4e3b-81c4-f674f8bfd894-config-data-custom\") pod \"73c9b7cf-53e7-4e3b-81c4-f674f8bfd894\" (UID: \"73c9b7cf-53e7-4e3b-81c4-f674f8bfd894\") " Mar 16 16:24:57 crc kubenswrapper[5120]: I0316 16:24:57.493121 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gc45z\" (UniqueName: \"kubernetes.io/projected/7f5bff08-fc88-42fc-ab9b-6d8db171ee6a-kube-api-access-gc45z\") pod \"7f5bff08-fc88-42fc-ab9b-6d8db171ee6a\" (UID: \"7f5bff08-fc88-42fc-ab9b-6d8db171ee6a\") " Mar 16 16:24:57 crc kubenswrapper[5120]: I0316 16:24:57.493165 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/7f5bff08-fc88-42fc-ab9b-6d8db171ee6a-etc-swift\") pod \"7f5bff08-fc88-42fc-ab9b-6d8db171ee6a\" (UID: \"7f5bff08-fc88-42fc-ab9b-6d8db171ee6a\") " Mar 16 16:24:57 crc kubenswrapper[5120]: I0316 16:24:57.493198 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/7f5bff08-fc88-42fc-ab9b-6d8db171ee6a-cache\") pod \"7f5bff08-fc88-42fc-ab9b-6d8db171ee6a\" (UID: \"7f5bff08-fc88-42fc-ab9b-6d8db171ee6a\") " Mar 16 16:24:57 crc kubenswrapper[5120]: I0316 16:24:57.493264 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/73c9b7cf-53e7-4e3b-81c4-f674f8bfd894-config-data\") pod \"73c9b7cf-53e7-4e3b-81c4-f674f8bfd894\" (UID: \"73c9b7cf-53e7-4e3b-81c4-f674f8bfd894\") " Mar 16 16:24:57 crc kubenswrapper[5120]: I0316 16:24:57.493318 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/7f5bff08-fc88-42fc-ab9b-6d8db171ee6a-lock\") pod \"7f5bff08-fc88-42fc-ab9b-6d8db171ee6a\" (UID: \"7f5bff08-fc88-42fc-ab9b-6d8db171ee6a\") " Mar 16 16:24:57 crc kubenswrapper[5120]: I0316 16:24:57.493354 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/73c9b7cf-53e7-4e3b-81c4-f674f8bfd894-combined-ca-bundle\") pod \"73c9b7cf-53e7-4e3b-81c4-f674f8bfd894\" (UID: \"73c9b7cf-53e7-4e3b-81c4-f674f8bfd894\") " Mar 16 16:24:57 crc kubenswrapper[5120]: I0316 16:24:57.493377 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7f5bff08-fc88-42fc-ab9b-6d8db171ee6a-combined-ca-bundle\") pod \"7f5bff08-fc88-42fc-ab9b-6d8db171ee6a\" (UID: \"7f5bff08-fc88-42fc-ab9b-6d8db171ee6a\") " Mar 16 16:24:57 crc kubenswrapper[5120]: I0316 16:24:57.493492 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/73c9b7cf-53e7-4e3b-81c4-f674f8bfd894-etc-machine-id\") pod \"73c9b7cf-53e7-4e3b-81c4-f674f8bfd894\" (UID: \"73c9b7cf-53e7-4e3b-81c4-f674f8bfd894\") " Mar 16 16:24:57 crc kubenswrapper[5120]: I0316 16:24:57.494008 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/73c9b7cf-53e7-4e3b-81c4-f674f8bfd894-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "73c9b7cf-53e7-4e3b-81c4-f674f8bfd894" (UID: "73c9b7cf-53e7-4e3b-81c4-f674f8bfd894"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 16:24:57 crc kubenswrapper[5120]: I0316 16:24:57.494389 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f5bff08-fc88-42fc-ab9b-6d8db171ee6a-lock" (OuterVolumeSpecName: "lock") pod "7f5bff08-fc88-42fc-ab9b-6d8db171ee6a" (UID: "7f5bff08-fc88-42fc-ab9b-6d8db171ee6a"). InnerVolumeSpecName "lock". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:24:57 crc kubenswrapper[5120]: I0316 16:24:57.494489 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f5bff08-fc88-42fc-ab9b-6d8db171ee6a-cache" (OuterVolumeSpecName: "cache") pod "7f5bff08-fc88-42fc-ab9b-6d8db171ee6a" (UID: "7f5bff08-fc88-42fc-ab9b-6d8db171ee6a"). InnerVolumeSpecName "cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:24:57 crc kubenswrapper[5120]: I0316 16:24:57.500744 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage12-crc" (OuterVolumeSpecName: "swift") pod "7f5bff08-fc88-42fc-ab9b-6d8db171ee6a" (UID: "7f5bff08-fc88-42fc-ab9b-6d8db171ee6a"). InnerVolumeSpecName "local-storage12-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:24:57 crc kubenswrapper[5120]: I0316 16:24:57.500779 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f5bff08-fc88-42fc-ab9b-6d8db171ee6a-kube-api-access-gc45z" (OuterVolumeSpecName: "kube-api-access-gc45z") pod "7f5bff08-fc88-42fc-ab9b-6d8db171ee6a" (UID: "7f5bff08-fc88-42fc-ab9b-6d8db171ee6a"). InnerVolumeSpecName "kube-api-access-gc45z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:24:57 crc kubenswrapper[5120]: I0316 16:24:57.500898 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73c9b7cf-53e7-4e3b-81c4-f674f8bfd894-kube-api-access-zzmqk" (OuterVolumeSpecName: "kube-api-access-zzmqk") pod "73c9b7cf-53e7-4e3b-81c4-f674f8bfd894" (UID: "73c9b7cf-53e7-4e3b-81c4-f674f8bfd894"). InnerVolumeSpecName "kube-api-access-zzmqk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:24:57 crc kubenswrapper[5120]: I0316 16:24:57.500942 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f5bff08-fc88-42fc-ab9b-6d8db171ee6a-etc-swift" (OuterVolumeSpecName: "etc-swift") pod "7f5bff08-fc88-42fc-ab9b-6d8db171ee6a" (UID: "7f5bff08-fc88-42fc-ab9b-6d8db171ee6a"). InnerVolumeSpecName "etc-swift". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:24:57 crc kubenswrapper[5120]: I0316 16:24:57.501066 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/73c9b7cf-53e7-4e3b-81c4-f674f8bfd894-scripts" (OuterVolumeSpecName: "scripts") pod "73c9b7cf-53e7-4e3b-81c4-f674f8bfd894" (UID: "73c9b7cf-53e7-4e3b-81c4-f674f8bfd894"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:24:57 crc kubenswrapper[5120]: I0316 16:24:57.510831 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/73c9b7cf-53e7-4e3b-81c4-f674f8bfd894-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "73c9b7cf-53e7-4e3b-81c4-f674f8bfd894" (UID: "73c9b7cf-53e7-4e3b-81c4-f674f8bfd894"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:24:57 crc kubenswrapper[5120]: I0316 16:24:57.543216 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/73c9b7cf-53e7-4e3b-81c4-f674f8bfd894-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "73c9b7cf-53e7-4e3b-81c4-f674f8bfd894" (UID: "73c9b7cf-53e7-4e3b-81c4-f674f8bfd894"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:24:57 crc kubenswrapper[5120]: I0316 16:24:57.583772 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/73c9b7cf-53e7-4e3b-81c4-f674f8bfd894-config-data" (OuterVolumeSpecName: "config-data") pod "73c9b7cf-53e7-4e3b-81c4-f674f8bfd894" (UID: "73c9b7cf-53e7-4e3b-81c4-f674f8bfd894"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:24:57 crc kubenswrapper[5120]: I0316 16:24:57.595909 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zzmqk\" (UniqueName: \"kubernetes.io/projected/73c9b7cf-53e7-4e3b-81c4-f674f8bfd894-kube-api-access-zzmqk\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:57 crc kubenswrapper[5120]: I0316 16:24:57.595947 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/73c9b7cf-53e7-4e3b-81c4-f674f8bfd894-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:57 crc kubenswrapper[5120]: I0316 16:24:57.595959 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gc45z\" (UniqueName: \"kubernetes.io/projected/7f5bff08-fc88-42fc-ab9b-6d8db171ee6a-kube-api-access-gc45z\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:57 crc kubenswrapper[5120]: I0316 16:24:57.595972 5120 reconciler_common.go:299] "Volume detached for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/7f5bff08-fc88-42fc-ab9b-6d8db171ee6a-etc-swift\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:57 crc kubenswrapper[5120]: I0316 16:24:57.595983 5120 reconciler_common.go:299] "Volume detached for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/7f5bff08-fc88-42fc-ab9b-6d8db171ee6a-cache\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:57 crc kubenswrapper[5120]: I0316 16:24:57.595996 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/73c9b7cf-53e7-4e3b-81c4-f674f8bfd894-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:57 crc kubenswrapper[5120]: I0316 16:24:57.596007 5120 reconciler_common.go:299] "Volume detached for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/7f5bff08-fc88-42fc-ab9b-6d8db171ee6a-lock\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:57 crc kubenswrapper[5120]: I0316 16:24:57.596020 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/73c9b7cf-53e7-4e3b-81c4-f674f8bfd894-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:57 crc kubenswrapper[5120]: I0316 16:24:57.596031 5120 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/73c9b7cf-53e7-4e3b-81c4-f674f8bfd894-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:57 crc kubenswrapper[5120]: I0316 16:24:57.596041 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/73c9b7cf-53e7-4e3b-81c4-f674f8bfd894-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:57 crc kubenswrapper[5120]: I0316 16:24:57.596071 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") on node \"crc\" " Mar 16 16:24:57 crc kubenswrapper[5120]: I0316 16:24:57.601687 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-6d4b69cb4d-gjpzv_1d4fa436-d4ae-48e8-b4db-5e9096c6f51d/neutron-api/0.log" Mar 16 16:24:57 crc kubenswrapper[5120]: I0316 16:24:57.601833 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-6d4b69cb4d-gjpzv" Mar 16 16:24:57 crc kubenswrapper[5120]: I0316 16:24:57.612653 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage12-crc" (UniqueName: "kubernetes.io/local-volume/local-storage12-crc") on node "crc" Mar 16 16:24:57 crc kubenswrapper[5120]: I0316 16:24:57.696730 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/1d4fa436-d4ae-48e8-b4db-5e9096c6f51d-ovndb-tls-certs\") pod \"1d4fa436-d4ae-48e8-b4db-5e9096c6f51d\" (UID: \"1d4fa436-d4ae-48e8-b4db-5e9096c6f51d\") " Mar 16 16:24:57 crc kubenswrapper[5120]: I0316 16:24:57.697099 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/1d4fa436-d4ae-48e8-b4db-5e9096c6f51d-httpd-config\") pod \"1d4fa436-d4ae-48e8-b4db-5e9096c6f51d\" (UID: \"1d4fa436-d4ae-48e8-b4db-5e9096c6f51d\") " Mar 16 16:24:57 crc kubenswrapper[5120]: I0316 16:24:57.697364 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rpxlr\" (UniqueName: \"kubernetes.io/projected/1d4fa436-d4ae-48e8-b4db-5e9096c6f51d-kube-api-access-rpxlr\") pod \"1d4fa436-d4ae-48e8-b4db-5e9096c6f51d\" (UID: \"1d4fa436-d4ae-48e8-b4db-5e9096c6f51d\") " Mar 16 16:24:57 crc kubenswrapper[5120]: I0316 16:24:57.697537 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/1d4fa436-d4ae-48e8-b4db-5e9096c6f51d-public-tls-certs\") pod \"1d4fa436-d4ae-48e8-b4db-5e9096c6f51d\" (UID: \"1d4fa436-d4ae-48e8-b4db-5e9096c6f51d\") " Mar 16 16:24:57 crc kubenswrapper[5120]: I0316 16:24:57.697725 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1d4fa436-d4ae-48e8-b4db-5e9096c6f51d-config\") pod \"1d4fa436-d4ae-48e8-b4db-5e9096c6f51d\" (UID: \"1d4fa436-d4ae-48e8-b4db-5e9096c6f51d\") " Mar 16 16:24:57 crc kubenswrapper[5120]: I0316 16:24:57.697899 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/1d4fa436-d4ae-48e8-b4db-5e9096c6f51d-internal-tls-certs\") pod \"1d4fa436-d4ae-48e8-b4db-5e9096c6f51d\" (UID: \"1d4fa436-d4ae-48e8-b4db-5e9096c6f51d\") " Mar 16 16:24:57 crc kubenswrapper[5120]: I0316 16:24:57.698223 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1d4fa436-d4ae-48e8-b4db-5e9096c6f51d-combined-ca-bundle\") pod \"1d4fa436-d4ae-48e8-b4db-5e9096c6f51d\" (UID: \"1d4fa436-d4ae-48e8-b4db-5e9096c6f51d\") " Mar 16 16:24:57 crc kubenswrapper[5120]: I0316 16:24:57.699010 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:57 crc kubenswrapper[5120]: I0316 16:24:57.700390 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d4fa436-d4ae-48e8-b4db-5e9096c6f51d-kube-api-access-rpxlr" (OuterVolumeSpecName: "kube-api-access-rpxlr") pod "1d4fa436-d4ae-48e8-b4db-5e9096c6f51d" (UID: "1d4fa436-d4ae-48e8-b4db-5e9096c6f51d"). InnerVolumeSpecName "kube-api-access-rpxlr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:24:57 crc kubenswrapper[5120]: I0316 16:24:57.700678 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1d4fa436-d4ae-48e8-b4db-5e9096c6f51d-httpd-config" (OuterVolumeSpecName: "httpd-config") pod "1d4fa436-d4ae-48e8-b4db-5e9096c6f51d" (UID: "1d4fa436-d4ae-48e8-b4db-5e9096c6f51d"). InnerVolumeSpecName "httpd-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:24:57 crc kubenswrapper[5120]: I0316 16:24:57.743344 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1d4fa436-d4ae-48e8-b4db-5e9096c6f51d-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "1d4fa436-d4ae-48e8-b4db-5e9096c6f51d" (UID: "1d4fa436-d4ae-48e8-b4db-5e9096c6f51d"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:24:57 crc kubenswrapper[5120]: I0316 16:24:57.751693 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1d4fa436-d4ae-48e8-b4db-5e9096c6f51d-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "1d4fa436-d4ae-48e8-b4db-5e9096c6f51d" (UID: "1d4fa436-d4ae-48e8-b4db-5e9096c6f51d"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:24:57 crc kubenswrapper[5120]: I0316 16:24:57.760040 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1d4fa436-d4ae-48e8-b4db-5e9096c6f51d-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "1d4fa436-d4ae-48e8-b4db-5e9096c6f51d" (UID: "1d4fa436-d4ae-48e8-b4db-5e9096c6f51d"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:24:57 crc kubenswrapper[5120]: I0316 16:24:57.762459 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1d4fa436-d4ae-48e8-b4db-5e9096c6f51d-config" (OuterVolumeSpecName: "config") pod "1d4fa436-d4ae-48e8-b4db-5e9096c6f51d" (UID: "1d4fa436-d4ae-48e8-b4db-5e9096c6f51d"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:24:57 crc kubenswrapper[5120]: I0316 16:24:57.766601 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1d4fa436-d4ae-48e8-b4db-5e9096c6f51d-ovndb-tls-certs" (OuterVolumeSpecName: "ovndb-tls-certs") pod "1d4fa436-d4ae-48e8-b4db-5e9096c6f51d" (UID: "1d4fa436-d4ae-48e8-b4db-5e9096c6f51d"). InnerVolumeSpecName "ovndb-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:24:57 crc kubenswrapper[5120]: I0316 16:24:57.801469 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/1d4fa436-d4ae-48e8-b4db-5e9096c6f51d-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:57 crc kubenswrapper[5120]: I0316 16:24:57.801519 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/1d4fa436-d4ae-48e8-b4db-5e9096c6f51d-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:57 crc kubenswrapper[5120]: I0316 16:24:57.801542 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1d4fa436-d4ae-48e8-b4db-5e9096c6f51d-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:57 crc kubenswrapper[5120]: I0316 16:24:57.801559 5120 reconciler_common.go:299] "Volume detached for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/1d4fa436-d4ae-48e8-b4db-5e9096c6f51d-ovndb-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:57 crc kubenswrapper[5120]: I0316 16:24:57.801578 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/1d4fa436-d4ae-48e8-b4db-5e9096c6f51d-httpd-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:57 crc kubenswrapper[5120]: I0316 16:24:57.801598 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rpxlr\" (UniqueName: \"kubernetes.io/projected/1d4fa436-d4ae-48e8-b4db-5e9096c6f51d-kube-api-access-rpxlr\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:57 crc kubenswrapper[5120]: I0316 16:24:57.801617 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/1d4fa436-d4ae-48e8-b4db-5e9096c6f51d-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:57 crc kubenswrapper[5120]: I0316 16:24:57.806953 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7f5bff08-fc88-42fc-ab9b-6d8db171ee6a-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "7f5bff08-fc88-42fc-ab9b-6d8db171ee6a" (UID: "7f5bff08-fc88-42fc-ab9b-6d8db171ee6a"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:24:57 crc kubenswrapper[5120]: I0316 16:24:57.904303 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7f5bff08-fc88-42fc-ab9b-6d8db171ee6a-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:58 crc kubenswrapper[5120]: I0316 16:24:58.074533 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7f5bff08-fc88-42fc-ab9b-6d8db171ee6a","Type":"ContainerDied","Data":"a90fd4eb6c42dcd7ec0fdb5e47bf16b9f832482d628f1c82240c796bc1350c00"} Mar 16 16:24:58 crc kubenswrapper[5120]: I0316 16:24:58.074630 5120 scope.go:117] "RemoveContainer" containerID="88d0838f0e55c2ee07fde8bbf71e8df1ae6de7871d90a1d121e8c8c31cc0d30c" Mar 16 16:24:58 crc kubenswrapper[5120]: I0316 16:24:58.074662 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:24:58 crc kubenswrapper[5120]: I0316 16:24:58.079192 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"73c9b7cf-53e7-4e3b-81c4-f674f8bfd894","Type":"ContainerDied","Data":"23878926aa146c7ecaada59e28fe104d88160298b354a974fc41f65e98b026a1"} Mar 16 16:24:58 crc kubenswrapper[5120]: I0316 16:24:58.080158 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:24:58 crc kubenswrapper[5120]: I0316 16:24:58.083406 5120 generic.go:358] "Generic (PLEG): container finished" podID="bd019f3d-1483-40e4-9534-b8bd551ed652" containerID="c976d3b3db94b93e1732bdd7cd1eb5e253e9c1f29aa03aaefc515f7729724645" exitCode=137 Mar 16 16:24:58 crc kubenswrapper[5120]: I0316 16:24:58.083619 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"bd019f3d-1483-40e4-9534-b8bd551ed652","Type":"ContainerDied","Data":"c976d3b3db94b93e1732bdd7cd1eb5e253e9c1f29aa03aaefc515f7729724645"} Mar 16 16:24:58 crc kubenswrapper[5120]: I0316 16:24:58.087913 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-6d4b69cb4d-gjpzv_1d4fa436-d4ae-48e8-b4db-5e9096c6f51d/neutron-api/0.log" Mar 16 16:24:58 crc kubenswrapper[5120]: I0316 16:24:58.087974 5120 generic.go:358] "Generic (PLEG): container finished" podID="1d4fa436-d4ae-48e8-b4db-5e9096c6f51d" containerID="769346ed2040f04a707d25f586265995e85d8fc1000ad07bd25db94424574293" exitCode=137 Mar 16 16:24:58 crc kubenswrapper[5120]: I0316 16:24:58.088116 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-6d4b69cb4d-gjpzv" Mar 16 16:24:58 crc kubenswrapper[5120]: I0316 16:24:58.088290 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-6d4b69cb4d-gjpzv" event={"ID":"1d4fa436-d4ae-48e8-b4db-5e9096c6f51d","Type":"ContainerDied","Data":"769346ed2040f04a707d25f586265995e85d8fc1000ad07bd25db94424574293"} Mar 16 16:24:58 crc kubenswrapper[5120]: I0316 16:24:58.088361 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-6d4b69cb4d-gjpzv" event={"ID":"1d4fa436-d4ae-48e8-b4db-5e9096c6f51d","Type":"ContainerDied","Data":"24c0e6126828b2c9236a97cc04656d2b5b5bb7c609fb8e258917582512a4ff57"} Mar 16 16:24:58 crc kubenswrapper[5120]: I0316 16:24:58.142684 5120 scope.go:117] "RemoveContainer" containerID="6c3e70ac2fbe4fa7acb01497861b03a7149c1e383ad9c493b5591ae3ea540c5c" Mar 16 16:24:58 crc kubenswrapper[5120]: I0316 16:24:58.146830 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 16:24:58 crc kubenswrapper[5120]: I0316 16:24:58.154292 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 16:24:58 crc kubenswrapper[5120]: I0316 16:24:58.167250 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-6d4b69cb4d-gjpzv"] Mar 16 16:24:58 crc kubenswrapper[5120]: I0316 16:24:58.176459 5120 scope.go:117] "RemoveContainer" containerID="6696b7f7b697efa4feabf0a01622540fdb189bc4a1df6611b1c30c76619d0945" Mar 16 16:24:58 crc kubenswrapper[5120]: I0316 16:24:58.181262 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-6d4b69cb4d-gjpzv"] Mar 16 16:24:58 crc kubenswrapper[5120]: I0316 16:24:58.187521 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:24:58 crc kubenswrapper[5120]: I0316 16:24:58.193515 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:24:58 crc kubenswrapper[5120]: I0316 16:24:58.209844 5120 scope.go:117] "RemoveContainer" containerID="43e5191629bf082b0e01836ca76be96391e20c5de3b139199777067a04192339" Mar 16 16:24:58 crc kubenswrapper[5120]: I0316 16:24:58.268954 5120 scope.go:117] "RemoveContainer" containerID="2c2449075b7cb36e869c5f5b1d0cbbf73a489350dbfc1054e715c259e79792ad" Mar 16 16:24:58 crc kubenswrapper[5120]: I0316 16:24:58.292903 5120 scope.go:117] "RemoveContainer" containerID="4399abb79b72fcaae5898a8f46943a6ab6f42d0bb8e6d9531ec308f970c87f67" Mar 16 16:24:58 crc kubenswrapper[5120]: I0316 16:24:58.316786 5120 scope.go:117] "RemoveContainer" containerID="914a1accee31ec9d58f31d18ce16ebc71b52c798b7569e8ba2718c12eb0b6727" Mar 16 16:24:58 crc kubenswrapper[5120]: I0316 16:24:58.341447 5120 scope.go:117] "RemoveContainer" containerID="00a717d1a33a62975a302ddd0726c4e1b1c0c5fd8cc1fc610e198519673ec7b5" Mar 16 16:24:58 crc kubenswrapper[5120]: I0316 16:24:58.366981 5120 scope.go:117] "RemoveContainer" containerID="338c2b64732eb5311f04bd9a566b4c3c11a3210d4d3421b6e4a7d84edcd4d18f" Mar 16 16:24:58 crc kubenswrapper[5120]: I0316 16:24:58.428016 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:24:58 crc kubenswrapper[5120]: I0316 16:24:58.434732 5120 scope.go:117] "RemoveContainer" containerID="da0cebe0fefea2659ee1956f1a037ab95538f3b38f4c90c9544da64c8f4c5a1c" Mar 16 16:24:58 crc kubenswrapper[5120]: I0316 16:24:58.456436 5120 scope.go:117] "RemoveContainer" containerID="02a2ffa3d3a2d7c1552f7589bbf4799a5575b36a6ab8851cfeface45442ecf4c" Mar 16 16:24:58 crc kubenswrapper[5120]: I0316 16:24:58.474513 5120 scope.go:117] "RemoveContainer" containerID="2add8d73118c8e33eeb2d9664e5dfd77ce96c461c1767cd0fd0328b33f5c36fb" Mar 16 16:24:58 crc kubenswrapper[5120]: I0316 16:24:58.493660 5120 scope.go:117] "RemoveContainer" containerID="999c0ea5f7b0027f0c11788a39e8314b09f917d6f6c4ab035c13db24d7b71c5f" Mar 16 16:24:58 crc kubenswrapper[5120]: I0316 16:24:58.513593 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/bd019f3d-1483-40e4-9534-b8bd551ed652-run-httpd\") pod \"bd019f3d-1483-40e4-9534-b8bd551ed652\" (UID: \"bd019f3d-1483-40e4-9534-b8bd551ed652\") " Mar 16 16:24:58 crc kubenswrapper[5120]: I0316 16:24:58.513676 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/bd019f3d-1483-40e4-9534-b8bd551ed652-sg-core-conf-yaml\") pod \"bd019f3d-1483-40e4-9534-b8bd551ed652\" (UID: \"bd019f3d-1483-40e4-9534-b8bd551ed652\") " Mar 16 16:24:58 crc kubenswrapper[5120]: I0316 16:24:58.513730 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bd019f3d-1483-40e4-9534-b8bd551ed652-combined-ca-bundle\") pod \"bd019f3d-1483-40e4-9534-b8bd551ed652\" (UID: \"bd019f3d-1483-40e4-9534-b8bd551ed652\") " Mar 16 16:24:58 crc kubenswrapper[5120]: I0316 16:24:58.513751 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/bd019f3d-1483-40e4-9534-b8bd551ed652-scripts\") pod \"bd019f3d-1483-40e4-9534-b8bd551ed652\" (UID: \"bd019f3d-1483-40e4-9534-b8bd551ed652\") " Mar 16 16:24:58 crc kubenswrapper[5120]: I0316 16:24:58.513838 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/bd019f3d-1483-40e4-9534-b8bd551ed652-log-httpd\") pod \"bd019f3d-1483-40e4-9534-b8bd551ed652\" (UID: \"bd019f3d-1483-40e4-9534-b8bd551ed652\") " Mar 16 16:24:58 crc kubenswrapper[5120]: I0316 16:24:58.513896 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zrz7w\" (UniqueName: \"kubernetes.io/projected/bd019f3d-1483-40e4-9534-b8bd551ed652-kube-api-access-zrz7w\") pod \"bd019f3d-1483-40e4-9534-b8bd551ed652\" (UID: \"bd019f3d-1483-40e4-9534-b8bd551ed652\") " Mar 16 16:24:58 crc kubenswrapper[5120]: I0316 16:24:58.514112 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/bd019f3d-1483-40e4-9534-b8bd551ed652-ceilometer-tls-certs\") pod \"bd019f3d-1483-40e4-9534-b8bd551ed652\" (UID: \"bd019f3d-1483-40e4-9534-b8bd551ed652\") " Mar 16 16:24:58 crc kubenswrapper[5120]: I0316 16:24:58.514173 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bd019f3d-1483-40e4-9534-b8bd551ed652-config-data\") pod \"bd019f3d-1483-40e4-9534-b8bd551ed652\" (UID: \"bd019f3d-1483-40e4-9534-b8bd551ed652\") " Mar 16 16:24:58 crc kubenswrapper[5120]: I0316 16:24:58.514291 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd019f3d-1483-40e4-9534-b8bd551ed652-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "bd019f3d-1483-40e4-9534-b8bd551ed652" (UID: "bd019f3d-1483-40e4-9534-b8bd551ed652"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:24:58 crc kubenswrapper[5120]: I0316 16:24:58.514470 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd019f3d-1483-40e4-9534-b8bd551ed652-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "bd019f3d-1483-40e4-9534-b8bd551ed652" (UID: "bd019f3d-1483-40e4-9534-b8bd551ed652"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:24:58 crc kubenswrapper[5120]: I0316 16:24:58.514903 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/bd019f3d-1483-40e4-9534-b8bd551ed652-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:58 crc kubenswrapper[5120]: I0316 16:24:58.514937 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/bd019f3d-1483-40e4-9534-b8bd551ed652-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:58 crc kubenswrapper[5120]: I0316 16:24:58.518959 5120 scope.go:117] "RemoveContainer" containerID="f92f67038f74d06e99a30d2effb51dbd1ebba2432520a2fba300840396f0f972" Mar 16 16:24:58 crc kubenswrapper[5120]: I0316 16:24:58.519181 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd019f3d-1483-40e4-9534-b8bd551ed652-scripts" (OuterVolumeSpecName: "scripts") pod "bd019f3d-1483-40e4-9534-b8bd551ed652" (UID: "bd019f3d-1483-40e4-9534-b8bd551ed652"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:24:58 crc kubenswrapper[5120]: I0316 16:24:58.520809 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd019f3d-1483-40e4-9534-b8bd551ed652-kube-api-access-zrz7w" (OuterVolumeSpecName: "kube-api-access-zrz7w") pod "bd019f3d-1483-40e4-9534-b8bd551ed652" (UID: "bd019f3d-1483-40e4-9534-b8bd551ed652"). InnerVolumeSpecName "kube-api-access-zrz7w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:24:58 crc kubenswrapper[5120]: I0316 16:24:58.535060 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd019f3d-1483-40e4-9534-b8bd551ed652-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "bd019f3d-1483-40e4-9534-b8bd551ed652" (UID: "bd019f3d-1483-40e4-9534-b8bd551ed652"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:24:58 crc kubenswrapper[5120]: I0316 16:24:58.557004 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd019f3d-1483-40e4-9534-b8bd551ed652-ceilometer-tls-certs" (OuterVolumeSpecName: "ceilometer-tls-certs") pod "bd019f3d-1483-40e4-9534-b8bd551ed652" (UID: "bd019f3d-1483-40e4-9534-b8bd551ed652"). InnerVolumeSpecName "ceilometer-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:24:58 crc kubenswrapper[5120]: I0316 16:24:58.566399 5120 scope.go:117] "RemoveContainer" containerID="293e4eeed9c463f36b54974ddbda55237ad67246ce53a79f496892505134a481" Mar 16 16:24:58 crc kubenswrapper[5120]: I0316 16:24:58.570989 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd019f3d-1483-40e4-9534-b8bd551ed652-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "bd019f3d-1483-40e4-9534-b8bd551ed652" (UID: "bd019f3d-1483-40e4-9534-b8bd551ed652"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:24:58 crc kubenswrapper[5120]: I0316 16:24:58.588411 5120 scope.go:117] "RemoveContainer" containerID="0828e02870000200de6ce67c3eccd85fed823e244bc79a5b6a48e7620b7e3a7b" Mar 16 16:24:58 crc kubenswrapper[5120]: I0316 16:24:58.606165 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd019f3d-1483-40e4-9534-b8bd551ed652-config-data" (OuterVolumeSpecName: "config-data") pod "bd019f3d-1483-40e4-9534-b8bd551ed652" (UID: "bd019f3d-1483-40e4-9534-b8bd551ed652"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:24:58 crc kubenswrapper[5120]: I0316 16:24:58.610079 5120 scope.go:117] "RemoveContainer" containerID="6d0c744e21abc67d4d22f2172b5ffdd0c1c8058e7ea0636d21a2bf8a35b91b0e" Mar 16 16:24:58 crc kubenswrapper[5120]: I0316 16:24:58.616559 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zrz7w\" (UniqueName: \"kubernetes.io/projected/bd019f3d-1483-40e4-9534-b8bd551ed652-kube-api-access-zrz7w\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:58 crc kubenswrapper[5120]: I0316 16:24:58.616585 5120 reconciler_common.go:299] "Volume detached for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/bd019f3d-1483-40e4-9534-b8bd551ed652-ceilometer-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:58 crc kubenswrapper[5120]: I0316 16:24:58.616600 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bd019f3d-1483-40e4-9534-b8bd551ed652-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:58 crc kubenswrapper[5120]: I0316 16:24:58.616612 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/bd019f3d-1483-40e4-9534-b8bd551ed652-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:58 crc kubenswrapper[5120]: I0316 16:24:58.616625 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bd019f3d-1483-40e4-9534-b8bd551ed652-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:58 crc kubenswrapper[5120]: I0316 16:24:58.616636 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/bd019f3d-1483-40e4-9534-b8bd551ed652-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:24:58 crc kubenswrapper[5120]: I0316 16:24:58.628909 5120 scope.go:117] "RemoveContainer" containerID="c006c912d0b81da9cf43cada9cc7e6f4a1e0fac1e38af8ab7eb79480910018da" Mar 16 16:24:58 crc kubenswrapper[5120]: I0316 16:24:58.648457 5120 scope.go:117] "RemoveContainer" containerID="769346ed2040f04a707d25f586265995e85d8fc1000ad07bd25db94424574293" Mar 16 16:24:58 crc kubenswrapper[5120]: I0316 16:24:58.665996 5120 scope.go:117] "RemoveContainer" containerID="c006c912d0b81da9cf43cada9cc7e6f4a1e0fac1e38af8ab7eb79480910018da" Mar 16 16:24:58 crc kubenswrapper[5120]: E0316 16:24:58.666515 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c006c912d0b81da9cf43cada9cc7e6f4a1e0fac1e38af8ab7eb79480910018da\": container with ID starting with c006c912d0b81da9cf43cada9cc7e6f4a1e0fac1e38af8ab7eb79480910018da not found: ID does not exist" containerID="c006c912d0b81da9cf43cada9cc7e6f4a1e0fac1e38af8ab7eb79480910018da" Mar 16 16:24:58 crc kubenswrapper[5120]: I0316 16:24:58.666560 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c006c912d0b81da9cf43cada9cc7e6f4a1e0fac1e38af8ab7eb79480910018da"} err="failed to get container status \"c006c912d0b81da9cf43cada9cc7e6f4a1e0fac1e38af8ab7eb79480910018da\": rpc error: code = NotFound desc = could not find container \"c006c912d0b81da9cf43cada9cc7e6f4a1e0fac1e38af8ab7eb79480910018da\": container with ID starting with c006c912d0b81da9cf43cada9cc7e6f4a1e0fac1e38af8ab7eb79480910018da not found: ID does not exist" Mar 16 16:24:58 crc kubenswrapper[5120]: I0316 16:24:58.666593 5120 scope.go:117] "RemoveContainer" containerID="769346ed2040f04a707d25f586265995e85d8fc1000ad07bd25db94424574293" Mar 16 16:24:58 crc kubenswrapper[5120]: E0316 16:24:58.667074 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"769346ed2040f04a707d25f586265995e85d8fc1000ad07bd25db94424574293\": container with ID starting with 769346ed2040f04a707d25f586265995e85d8fc1000ad07bd25db94424574293 not found: ID does not exist" containerID="769346ed2040f04a707d25f586265995e85d8fc1000ad07bd25db94424574293" Mar 16 16:24:58 crc kubenswrapper[5120]: I0316 16:24:58.667099 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"769346ed2040f04a707d25f586265995e85d8fc1000ad07bd25db94424574293"} err="failed to get container status \"769346ed2040f04a707d25f586265995e85d8fc1000ad07bd25db94424574293\": rpc error: code = NotFound desc = could not find container \"769346ed2040f04a707d25f586265995e85d8fc1000ad07bd25db94424574293\": container with ID starting with 769346ed2040f04a707d25f586265995e85d8fc1000ad07bd25db94424574293 not found: ID does not exist" Mar 16 16:24:58 crc kubenswrapper[5120]: I0316 16:24:58.674785 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1d4fa436-d4ae-48e8-b4db-5e9096c6f51d" path="/var/lib/kubelet/pods/1d4fa436-d4ae-48e8-b4db-5e9096c6f51d/volumes" Mar 16 16:24:58 crc kubenswrapper[5120]: I0316 16:24:58.675735 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="73c9b7cf-53e7-4e3b-81c4-f674f8bfd894" path="/var/lib/kubelet/pods/73c9b7cf-53e7-4e3b-81c4-f674f8bfd894/volumes" Mar 16 16:24:58 crc kubenswrapper[5120]: I0316 16:24:58.676928 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7f5bff08-fc88-42fc-ab9b-6d8db171ee6a" path="/var/lib/kubelet/pods/7f5bff08-fc88-42fc-ab9b-6d8db171ee6a/volumes" Mar 16 16:24:59 crc kubenswrapper[5120]: I0316 16:24:59.107071 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:24:59 crc kubenswrapper[5120]: I0316 16:24:59.107134 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"bd019f3d-1483-40e4-9534-b8bd551ed652","Type":"ContainerDied","Data":"ed71670a7653765c9db84f5701474f386d7ef801cca6e92ffd96b09b675d8a7a"} Mar 16 16:24:59 crc kubenswrapper[5120]: I0316 16:24:59.107696 5120 scope.go:117] "RemoveContainer" containerID="7f7b09d62f8584e17ded7110727a79828e5c99e561c9bf5cd643aa5cc1c74758" Mar 16 16:24:59 crc kubenswrapper[5120]: I0316 16:24:59.156537 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:24:59 crc kubenswrapper[5120]: I0316 16:24:59.172130 5120 scope.go:117] "RemoveContainer" containerID="6b5a370e0ffa16e0b998b02a52647c91125ab7a84492ad3a7f1d5d5a529919e7" Mar 16 16:24:59 crc kubenswrapper[5120]: I0316 16:24:59.195717 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:24:59 crc kubenswrapper[5120]: I0316 16:24:59.222128 5120 scope.go:117] "RemoveContainer" containerID="c976d3b3db94b93e1732bdd7cd1eb5e253e9c1f29aa03aaefc515f7729724645" Mar 16 16:24:59 crc kubenswrapper[5120]: I0316 16:24:59.258754 5120 scope.go:117] "RemoveContainer" containerID="482e3be4b8e8664bade0b2a681aa7e0b736487e8b6c01fc03edf8ad396dc6ad3" Mar 16 16:24:59 crc kubenswrapper[5120]: E0316 16:24:59.635725 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 16:24:59 crc kubenswrapper[5120]: E0316 16:24:59.635984 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00712a43-f38b-478f-bd42-a8cb0c2c14b3-combined-ca-bundle podName:00712a43-f38b-478f-bd42-a8cb0c2c14b3 nodeName:}" failed. No retries permitted until 2026-03-16 16:25:31.635950501 +0000 UTC m=+3233.789882198 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/00712a43-f38b-478f-bd42-a8cb0c2c14b3-combined-ca-bundle") pod "nova-cell1-conductor-0" (UID: "00712a43-f38b-478f-bd42-a8cb0c2c14b3") : secret "combined-ca-bundle" not found Mar 16 16:24:59 crc kubenswrapper[5120]: E0316 16:24:59.658425 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="e20d7270f4fe9453876580e96b11e1123f8f3ee72618f8412137ebf03e720b64" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:24:59 crc kubenswrapper[5120]: E0316 16:24:59.660721 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="e20d7270f4fe9453876580e96b11e1123f8f3ee72618f8412137ebf03e720b64" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:24:59 crc kubenswrapper[5120]: E0316 16:24:59.663160 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="e20d7270f4fe9453876580e96b11e1123f8f3ee72618f8412137ebf03e720b64" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:24:59 crc kubenswrapper[5120]: E0316 16:24:59.663219 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="00712a43-f38b-478f-bd42-a8cb0c2c14b3" containerName="nova-cell1-conductor-conductor" probeResult="unknown" Mar 16 16:25:00 crc kubenswrapper[5120]: E0316 16:25:00.212647 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="5e6baa9f78619e40ffd6a36cfbb9720f6f4f84ce1842a854e4e515f3444ed405" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:25:00 crc kubenswrapper[5120]: E0316 16:25:00.216279 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="5e6baa9f78619e40ffd6a36cfbb9720f6f4f84ce1842a854e4e515f3444ed405" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:25:00 crc kubenswrapper[5120]: E0316 16:25:00.218646 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="5e6baa9f78619e40ffd6a36cfbb9720f6f4f84ce1842a854e4e515f3444ed405" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:25:00 crc kubenswrapper[5120]: E0316 16:25:00.218736 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="243c208b-8b2f-4041-9adc-aa2fee8f07f9" containerName="nova-scheduler-scheduler" probeResult="unknown" Mar 16 16:25:00 crc kubenswrapper[5120]: I0316 16:25:00.675103 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bd019f3d-1483-40e4-9534-b8bd551ed652" path="/var/lib/kubelet/pods/bd019f3d-1483-40e4-9534-b8bd551ed652/volumes" Mar 16 16:25:01 crc kubenswrapper[5120]: I0316 16:25:01.664566 5120 scope.go:117] "RemoveContainer" containerID="f40e444f89abd558ac90555bfd58e04a1c4379a653ba8035c228d2b7a5443eb5" Mar 16 16:25:01 crc kubenswrapper[5120]: E0316 16:25:01.665038 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:25:04 crc kubenswrapper[5120]: E0316 16:25:04.658838 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="e20d7270f4fe9453876580e96b11e1123f8f3ee72618f8412137ebf03e720b64" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:25:04 crc kubenswrapper[5120]: E0316 16:25:04.661855 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="e20d7270f4fe9453876580e96b11e1123f8f3ee72618f8412137ebf03e720b64" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:25:04 crc kubenswrapper[5120]: E0316 16:25:04.663959 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="e20d7270f4fe9453876580e96b11e1123f8f3ee72618f8412137ebf03e720b64" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:25:04 crc kubenswrapper[5120]: E0316 16:25:04.664033 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="00712a43-f38b-478f-bd42-a8cb0c2c14b3" containerName="nova-cell1-conductor-conductor" probeResult="unknown" Mar 16 16:25:05 crc kubenswrapper[5120]: E0316 16:25:05.211659 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="5e6baa9f78619e40ffd6a36cfbb9720f6f4f84ce1842a854e4e515f3444ed405" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:25:05 crc kubenswrapper[5120]: E0316 16:25:05.213713 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="5e6baa9f78619e40ffd6a36cfbb9720f6f4f84ce1842a854e4e515f3444ed405" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:25:05 crc kubenswrapper[5120]: E0316 16:25:05.215839 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="5e6baa9f78619e40ffd6a36cfbb9720f6f4f84ce1842a854e4e515f3444ed405" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:25:05 crc kubenswrapper[5120]: E0316 16:25:05.215963 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="243c208b-8b2f-4041-9adc-aa2fee8f07f9" containerName="nova-scheduler-scheduler" probeResult="unknown" Mar 16 16:25:06 crc kubenswrapper[5120]: I0316 16:25:06.670030 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:25:06 crc kubenswrapper[5120]: I0316 16:25:06.781252 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/243c208b-8b2f-4041-9adc-aa2fee8f07f9-combined-ca-bundle\") pod \"243c208b-8b2f-4041-9adc-aa2fee8f07f9\" (UID: \"243c208b-8b2f-4041-9adc-aa2fee8f07f9\") " Mar 16 16:25:06 crc kubenswrapper[5120]: I0316 16:25:06.781469 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/243c208b-8b2f-4041-9adc-aa2fee8f07f9-config-data\") pod \"243c208b-8b2f-4041-9adc-aa2fee8f07f9\" (UID: \"243c208b-8b2f-4041-9adc-aa2fee8f07f9\") " Mar 16 16:25:06 crc kubenswrapper[5120]: I0316 16:25:06.781654 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r5476\" (UniqueName: \"kubernetes.io/projected/243c208b-8b2f-4041-9adc-aa2fee8f07f9-kube-api-access-r5476\") pod \"243c208b-8b2f-4041-9adc-aa2fee8f07f9\" (UID: \"243c208b-8b2f-4041-9adc-aa2fee8f07f9\") " Mar 16 16:25:06 crc kubenswrapper[5120]: I0316 16:25:06.788950 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/243c208b-8b2f-4041-9adc-aa2fee8f07f9-kube-api-access-r5476" (OuterVolumeSpecName: "kube-api-access-r5476") pod "243c208b-8b2f-4041-9adc-aa2fee8f07f9" (UID: "243c208b-8b2f-4041-9adc-aa2fee8f07f9"). InnerVolumeSpecName "kube-api-access-r5476". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:25:06 crc kubenswrapper[5120]: I0316 16:25:06.821842 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/243c208b-8b2f-4041-9adc-aa2fee8f07f9-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "243c208b-8b2f-4041-9adc-aa2fee8f07f9" (UID: "243c208b-8b2f-4041-9adc-aa2fee8f07f9"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:25:06 crc kubenswrapper[5120]: I0316 16:25:06.828120 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/243c208b-8b2f-4041-9adc-aa2fee8f07f9-config-data" (OuterVolumeSpecName: "config-data") pod "243c208b-8b2f-4041-9adc-aa2fee8f07f9" (UID: "243c208b-8b2f-4041-9adc-aa2fee8f07f9"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:25:06 crc kubenswrapper[5120]: I0316 16:25:06.885855 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/243c208b-8b2f-4041-9adc-aa2fee8f07f9-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:25:06 crc kubenswrapper[5120]: I0316 16:25:06.885920 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/243c208b-8b2f-4041-9adc-aa2fee8f07f9-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:25:06 crc kubenswrapper[5120]: I0316 16:25:06.885939 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r5476\" (UniqueName: \"kubernetes.io/projected/243c208b-8b2f-4041-9adc-aa2fee8f07f9-kube-api-access-r5476\") on node \"crc\" DevicePath \"\"" Mar 16 16:25:07 crc kubenswrapper[5120]: I0316 16:25:07.262168 5120 generic.go:358] "Generic (PLEG): container finished" podID="243c208b-8b2f-4041-9adc-aa2fee8f07f9" containerID="5e6baa9f78619e40ffd6a36cfbb9720f6f4f84ce1842a854e4e515f3444ed405" exitCode=137 Mar 16 16:25:07 crc kubenswrapper[5120]: I0316 16:25:07.262339 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:25:07 crc kubenswrapper[5120]: I0316 16:25:07.262508 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"243c208b-8b2f-4041-9adc-aa2fee8f07f9","Type":"ContainerDied","Data":"5e6baa9f78619e40ffd6a36cfbb9720f6f4f84ce1842a854e4e515f3444ed405"} Mar 16 16:25:07 crc kubenswrapper[5120]: I0316 16:25:07.262991 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"243c208b-8b2f-4041-9adc-aa2fee8f07f9","Type":"ContainerDied","Data":"56e7b7b9098475afdcf6841dee89df06512bdf988810e238467d4a3457db2d0b"} Mar 16 16:25:07 crc kubenswrapper[5120]: I0316 16:25:07.263038 5120 scope.go:117] "RemoveContainer" containerID="5e6baa9f78619e40ffd6a36cfbb9720f6f4f84ce1842a854e4e515f3444ed405" Mar 16 16:25:07 crc kubenswrapper[5120]: I0316 16:25:07.265936 5120 generic.go:358] "Generic (PLEG): container finished" podID="00712a43-f38b-478f-bd42-a8cb0c2c14b3" containerID="e20d7270f4fe9453876580e96b11e1123f8f3ee72618f8412137ebf03e720b64" exitCode=137 Mar 16 16:25:07 crc kubenswrapper[5120]: I0316 16:25:07.266178 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"00712a43-f38b-478f-bd42-a8cb0c2c14b3","Type":"ContainerDied","Data":"e20d7270f4fe9453876580e96b11e1123f8f3ee72618f8412137ebf03e720b64"} Mar 16 16:25:07 crc kubenswrapper[5120]: I0316 16:25:07.314188 5120 scope.go:117] "RemoveContainer" containerID="5e6baa9f78619e40ffd6a36cfbb9720f6f4f84ce1842a854e4e515f3444ed405" Mar 16 16:25:07 crc kubenswrapper[5120]: I0316 16:25:07.315648 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:25:07 crc kubenswrapper[5120]: E0316 16:25:07.315731 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5e6baa9f78619e40ffd6a36cfbb9720f6f4f84ce1842a854e4e515f3444ed405\": container with ID starting with 5e6baa9f78619e40ffd6a36cfbb9720f6f4f84ce1842a854e4e515f3444ed405 not found: ID does not exist" containerID="5e6baa9f78619e40ffd6a36cfbb9720f6f4f84ce1842a854e4e515f3444ed405" Mar 16 16:25:07 crc kubenswrapper[5120]: I0316 16:25:07.315864 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e6baa9f78619e40ffd6a36cfbb9720f6f4f84ce1842a854e4e515f3444ed405"} err="failed to get container status \"5e6baa9f78619e40ffd6a36cfbb9720f6f4f84ce1842a854e4e515f3444ed405\": rpc error: code = NotFound desc = could not find container \"5e6baa9f78619e40ffd6a36cfbb9720f6f4f84ce1842a854e4e515f3444ed405\": container with ID starting with 5e6baa9f78619e40ffd6a36cfbb9720f6f4f84ce1842a854e4e515f3444ed405 not found: ID does not exist" Mar 16 16:25:07 crc kubenswrapper[5120]: I0316 16:25:07.324778 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:25:07 crc kubenswrapper[5120]: I0316 16:25:07.531949 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:25:07 crc kubenswrapper[5120]: I0316 16:25:07.599542 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/00712a43-f38b-478f-bd42-a8cb0c2c14b3-combined-ca-bundle\") pod \"00712a43-f38b-478f-bd42-a8cb0c2c14b3\" (UID: \"00712a43-f38b-478f-bd42-a8cb0c2c14b3\") " Mar 16 16:25:07 crc kubenswrapper[5120]: I0316 16:25:07.599625 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gm4dx\" (UniqueName: \"kubernetes.io/projected/00712a43-f38b-478f-bd42-a8cb0c2c14b3-kube-api-access-gm4dx\") pod \"00712a43-f38b-478f-bd42-a8cb0c2c14b3\" (UID: \"00712a43-f38b-478f-bd42-a8cb0c2c14b3\") " Mar 16 16:25:07 crc kubenswrapper[5120]: I0316 16:25:07.599817 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/00712a43-f38b-478f-bd42-a8cb0c2c14b3-config-data\") pod \"00712a43-f38b-478f-bd42-a8cb0c2c14b3\" (UID: \"00712a43-f38b-478f-bd42-a8cb0c2c14b3\") " Mar 16 16:25:07 crc kubenswrapper[5120]: I0316 16:25:07.604586 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00712a43-f38b-478f-bd42-a8cb0c2c14b3-kube-api-access-gm4dx" (OuterVolumeSpecName: "kube-api-access-gm4dx") pod "00712a43-f38b-478f-bd42-a8cb0c2c14b3" (UID: "00712a43-f38b-478f-bd42-a8cb0c2c14b3"). InnerVolumeSpecName "kube-api-access-gm4dx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:25:07 crc kubenswrapper[5120]: I0316 16:25:07.619147 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/00712a43-f38b-478f-bd42-a8cb0c2c14b3-config-data" (OuterVolumeSpecName: "config-data") pod "00712a43-f38b-478f-bd42-a8cb0c2c14b3" (UID: "00712a43-f38b-478f-bd42-a8cb0c2c14b3"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:25:07 crc kubenswrapper[5120]: I0316 16:25:07.636638 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/00712a43-f38b-478f-bd42-a8cb0c2c14b3-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "00712a43-f38b-478f-bd42-a8cb0c2c14b3" (UID: "00712a43-f38b-478f-bd42-a8cb0c2c14b3"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:25:07 crc kubenswrapper[5120]: I0316 16:25:07.701601 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/00712a43-f38b-478f-bd42-a8cb0c2c14b3-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:25:07 crc kubenswrapper[5120]: I0316 16:25:07.701629 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gm4dx\" (UniqueName: \"kubernetes.io/projected/00712a43-f38b-478f-bd42-a8cb0c2c14b3-kube-api-access-gm4dx\") on node \"crc\" DevicePath \"\"" Mar 16 16:25:07 crc kubenswrapper[5120]: I0316 16:25:07.701640 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/00712a43-f38b-478f-bd42-a8cb0c2c14b3-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:25:07 crc kubenswrapper[5120]: E0316 16:25:07.977507 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1313977 actualBytes=10240 Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.285553 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.285560 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"00712a43-f38b-478f-bd42-a8cb0c2c14b3","Type":"ContainerDied","Data":"3b29a96c14c835876f6b81f6a6b9d6933b75560c30eb2d97914132860ca24756"} Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.285787 5120 scope.go:117] "RemoveContainer" containerID="e20d7270f4fe9453876580e96b11e1123f8f3ee72618f8412137ebf03e720b64" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.358980 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.364852 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.402155 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["crc-storage/crc-storage-crc-dbtb9"] Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.409372 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["crc-storage/crc-storage-crc-dbtb9"] Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.531835 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["crc-storage/crc-storage-crc-gjvct"] Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.533527 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="771204f4-c55f-4a6e-be63-70f3d1c8a51e" containerName="placement-log" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.533573 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="771204f4-c55f-4a6e-be63-70f3d1c8a51e" containerName="placement-log" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.533602 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86686d29-4c19-43e3-97a8-d8373883dc6a" containerName="mariadb-account-create-update" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.533618 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="86686d29-4c19-43e3-97a8-d8373883dc6a" containerName="mariadb-account-create-update" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.533642 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ea8cd10-4026-4603-a76b-b26ebe185441" containerName="cinder-api" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.533654 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ea8cd10-4026-4603-a76b-b26ebe185441" containerName="cinder-api" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.533674 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd019f3d-1483-40e4-9534-b8bd551ed652" containerName="ceilometer-notification-agent" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.533687 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd019f3d-1483-40e4-9534-b8bd551ed652" containerName="ceilometer-notification-agent" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.533712 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ecdbe440-4557-4298-b0b7-e2e89958bf07" containerName="barbican-keystone-listener" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.533724 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ecdbe440-4557-4298-b0b7-e2e89958bf07" containerName="barbican-keystone-listener" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.533739 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd019f3d-1483-40e4-9534-b8bd551ed652" containerName="sg-core" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.533753 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd019f3d-1483-40e4-9534-b8bd551ed652" containerName="sg-core" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.533796 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4b88a4e-143e-46bd-ada8-56dece11d6cc" containerName="glance-httpd" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.533808 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4b88a4e-143e-46bd-ada8-56dece11d6cc" containerName="glance-httpd" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.533823 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f5bff08-fc88-42fc-ab9b-6d8db171ee6a" containerName="container-auditor" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.533835 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f5bff08-fc88-42fc-ab9b-6d8db171ee6a" containerName="container-auditor" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.533849 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1195ba16-9c86-4aeb-b62f-a93570eb8b02" containerName="init" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.533862 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1195ba16-9c86-4aeb-b62f-a93570eb8b02" containerName="init" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.533877 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e15efd1b-6aa8-4a24-b576-4e03e19e19d0" containerName="watcher-api" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.533889 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e15efd1b-6aa8-4a24-b576-4e03e19e19d0" containerName="watcher-api" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.533915 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="771204f4-c55f-4a6e-be63-70f3d1c8a51e" containerName="placement-api" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.533927 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="771204f4-c55f-4a6e-be63-70f3d1c8a51e" containerName="placement-api" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.533951 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b43ebee-5f04-44e0-a8bf-56f70871894e" containerName="init-config-reloader" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.533963 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b43ebee-5f04-44e0-a8bf-56f70871894e" containerName="init-config-reloader" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.533976 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f5bff08-fc88-42fc-ab9b-6d8db171ee6a" containerName="account-replicator" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.533988 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f5bff08-fc88-42fc-ab9b-6d8db171ee6a" containerName="account-replicator" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.534001 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f5bff08-fc88-42fc-ab9b-6d8db171ee6a" containerName="object-expirer" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.534013 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f5bff08-fc88-42fc-ab9b-6d8db171ee6a" containerName="object-expirer" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.534040 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00712a43-f38b-478f-bd42-a8cb0c2c14b3" containerName="nova-cell1-conductor-conductor" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.534056 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="00712a43-f38b-478f-bd42-a8cb0c2c14b3" containerName="nova-cell1-conductor-conductor" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.534079 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86686d29-4c19-43e3-97a8-d8373883dc6a" containerName="mariadb-account-create-update" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.534091 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="86686d29-4c19-43e3-97a8-d8373883dc6a" containerName="mariadb-account-create-update" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.534111 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f5bff08-fc88-42fc-ab9b-6d8db171ee6a" containerName="account-reaper" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.534123 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f5bff08-fc88-42fc-ab9b-6d8db171ee6a" containerName="account-reaper" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.534139 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="794d950a-8664-4970-963a-2773749103e0" containerName="openstack-network-exporter" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.534152 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="794d950a-8664-4970-963a-2773749103e0" containerName="openstack-network-exporter" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.534168 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73c9b7cf-53e7-4e3b-81c4-f674f8bfd894" containerName="cinder-scheduler" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.534181 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="73c9b7cf-53e7-4e3b-81c4-f674f8bfd894" containerName="cinder-scheduler" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.534197 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f90be6a3-f863-476d-b78b-95b9d069037e" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.534209 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f90be6a3-f863-476d-b78b-95b9d069037e" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.534228 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9185c9ac-7b26-4bbc-be42-545c166ba2c8" containerName="mysql-bootstrap" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.534240 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9185c9ac-7b26-4bbc-be42-545c166ba2c8" containerName="mysql-bootstrap" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.534257 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5160b65-3a41-4645-9f47-bd4e891fef5f" containerName="watcher-applier" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.534269 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5160b65-3a41-4645-9f47-bd4e891fef5f" containerName="watcher-applier" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.534295 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93" containerName="setup-container" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.534306 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93" containerName="setup-container" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.534326 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f5bff08-fc88-42fc-ab9b-6d8db171ee6a" containerName="container-updater" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.534339 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f5bff08-fc88-42fc-ab9b-6d8db171ee6a" containerName="container-updater" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.534363 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f5bff08-fc88-42fc-ab9b-6d8db171ee6a" containerName="account-server" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.534374 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f5bff08-fc88-42fc-ab9b-6d8db171ee6a" containerName="account-server" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.534392 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9185c9ac-7b26-4bbc-be42-545c166ba2c8" containerName="galera" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.534404 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9185c9ac-7b26-4bbc-be42-545c166ba2c8" containerName="galera" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.534421 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="436edb75-475a-4096-a9c9-bf235fc92d9c" containerName="init-config-reloader" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.534433 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="436edb75-475a-4096-a9c9-bf235fc92d9c" containerName="init-config-reloader" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.534452 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd019f3d-1483-40e4-9534-b8bd551ed652" containerName="proxy-httpd" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.534465 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd019f3d-1483-40e4-9534-b8bd551ed652" containerName="proxy-httpd" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.534487 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ea3fd85-7822-44e8-a112-9aec7d6f9a7c" containerName="nova-metadata-log" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.534500 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ea3fd85-7822-44e8-a112-9aec7d6f9a7c" containerName="nova-metadata-log" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.534518 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11468616-1e2d-4cfd-b172-299b0cc33f6e" containerName="nova-api-api" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.534530 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="11468616-1e2d-4cfd-b172-299b0cc33f6e" containerName="nova-api-api" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.534552 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b43ebee-5f04-44e0-a8bf-56f70871894e" containerName="config-reloader" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.534565 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b43ebee-5f04-44e0-a8bf-56f70871894e" containerName="config-reloader" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.534582 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ea8cd10-4026-4603-a76b-b26ebe185441" containerName="cinder-api-log" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.534594 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ea8cd10-4026-4603-a76b-b26ebe185441" containerName="cinder-api-log" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.534611 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b04c3f7-3328-4aef-92bc-42f328744879" containerName="watcher-decision-engine" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.534624 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b04c3f7-3328-4aef-92bc-42f328744879" containerName="watcher-decision-engine" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.534649 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b43ebee-5f04-44e0-a8bf-56f70871894e" containerName="alertmanager" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.534661 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b43ebee-5f04-44e0-a8bf-56f70871894e" containerName="alertmanager" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.534674 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f5bff08-fc88-42fc-ab9b-6d8db171ee6a" containerName="swift-recon-cron" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.534686 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f5bff08-fc88-42fc-ab9b-6d8db171ee6a" containerName="swift-recon-cron" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.534701 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1195ba16-9c86-4aeb-b62f-a93570eb8b02" containerName="dnsmasq-dns" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.534713 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1195ba16-9c86-4aeb-b62f-a93570eb8b02" containerName="dnsmasq-dns" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.534733 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73c9b7cf-53e7-4e3b-81c4-f674f8bfd894" containerName="probe" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.534745 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="73c9b7cf-53e7-4e3b-81c4-f674f8bfd894" containerName="probe" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.534784 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ecdbe440-4557-4298-b0b7-e2e89958bf07" containerName="barbican-keystone-listener-log" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.534797 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ecdbe440-4557-4298-b0b7-e2e89958bf07" containerName="barbican-keystone-listener-log" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.534819 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d4fa436-d4ae-48e8-b4db-5e9096c6f51d" containerName="neutron-api" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.534831 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d4fa436-d4ae-48e8-b4db-5e9096c6f51d" containerName="neutron-api" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.534844 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ea3fd85-7822-44e8-a112-9aec7d6f9a7c" containerName="nova-metadata-metadata" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.534858 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ea3fd85-7822-44e8-a112-9aec7d6f9a7c" containerName="nova-metadata-metadata" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.534878 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="243c208b-8b2f-4041-9adc-aa2fee8f07f9" containerName="nova-scheduler-scheduler" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.534890 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="243c208b-8b2f-4041-9adc-aa2fee8f07f9" containerName="nova-scheduler-scheduler" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.534903 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f5bff08-fc88-42fc-ab9b-6d8db171ee6a" containerName="object-auditor" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.534915 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f5bff08-fc88-42fc-ab9b-6d8db171ee6a" containerName="object-auditor" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.534933 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="436edb75-475a-4096-a9c9-bf235fc92d9c" containerName="prometheus" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.534945 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="436edb75-475a-4096-a9c9-bf235fc92d9c" containerName="prometheus" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.534961 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8558eb14-801e-455b-8374-1c69e333901c" containerName="barbican-worker-log" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.534973 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8558eb14-801e-455b-8374-1c69e333901c" containerName="barbican-worker-log" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.534992 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f5bff08-fc88-42fc-ab9b-6d8db171ee6a" containerName="container-server" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.535004 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f5bff08-fc88-42fc-ab9b-6d8db171ee6a" containerName="container-server" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.535018 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f5bff08-fc88-42fc-ab9b-6d8db171ee6a" containerName="object-replicator" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.535030 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f5bff08-fc88-42fc-ab9b-6d8db171ee6a" containerName="object-replicator" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.535045 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69c47154-7063-4a88-af54-c4dba11e7fd6" containerName="barbican-api-log" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.535057 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="69c47154-7063-4a88-af54-c4dba11e7fd6" containerName="barbican-api-log" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.535073 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8558eb14-801e-455b-8374-1c69e333901c" containerName="barbican-worker" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.535086 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8558eb14-801e-455b-8374-1c69e333901c" containerName="barbican-worker" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.535110 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba0d3286-038b-4735-b0b4-1ce9b3faeed1" containerName="memcached" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.535122 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba0d3286-038b-4735-b0b4-1ce9b3faeed1" containerName="memcached" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.535141 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90dbf97e-452f-4fce-8ceb-07fda29e83b8" containerName="proxy-httpd" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.535152 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="90dbf97e-452f-4fce-8ceb-07fda29e83b8" containerName="proxy-httpd" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.535168 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f5bff08-fc88-42fc-ab9b-6d8db171ee6a" containerName="object-server" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.535179 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f5bff08-fc88-42fc-ab9b-6d8db171ee6a" containerName="object-server" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.535202 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f5bff08-fc88-42fc-ab9b-6d8db171ee6a" containerName="account-auditor" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.535213 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f5bff08-fc88-42fc-ab9b-6d8db171ee6a" containerName="account-auditor" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.535231 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90dbf97e-452f-4fce-8ceb-07fda29e83b8" containerName="proxy-server" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.535242 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="90dbf97e-452f-4fce-8ceb-07fda29e83b8" containerName="proxy-server" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.535260 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="436edb75-475a-4096-a9c9-bf235fc92d9c" containerName="thanos-sidecar" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.535272 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="436edb75-475a-4096-a9c9-bf235fc92d9c" containerName="thanos-sidecar" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.535295 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f5bff08-fc88-42fc-ab9b-6d8db171ee6a" containerName="rsync" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.535329 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f5bff08-fc88-42fc-ab9b-6d8db171ee6a" containerName="rsync" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.535349 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d4fa436-d4ae-48e8-b4db-5e9096c6f51d" containerName="neutron-httpd" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.535361 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d4fa436-d4ae-48e8-b4db-5e9096c6f51d" containerName="neutron-httpd" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.535384 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b05ec0c-8f80-4a86-8823-629c4e953395" containerName="keystone-api" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.535395 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b05ec0c-8f80-4a86-8823-629c4e953395" containerName="keystone-api" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.535416 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e15efd1b-6aa8-4a24-b576-4e03e19e19d0" containerName="watcher-api-log" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.535428 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e15efd1b-6aa8-4a24-b576-4e03e19e19d0" containerName="watcher-api-log" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.535443 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f5bff08-fc88-42fc-ab9b-6d8db171ee6a" containerName="object-updater" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.535455 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f5bff08-fc88-42fc-ab9b-6d8db171ee6a" containerName="object-updater" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.535470 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79383c2c-77ce-4694-acfd-f65a93d14d36" containerName="glance-httpd" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.535483 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="79383c2c-77ce-4694-acfd-f65a93d14d36" containerName="glance-httpd" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.535501 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79383c2c-77ce-4694-acfd-f65a93d14d36" containerName="glance-log" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.535513 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="79383c2c-77ce-4694-acfd-f65a93d14d36" containerName="glance-log" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.535533 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93d56b12-9c96-48fa-9343-4a12d639b8a3" containerName="kube-state-metrics" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.535545 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="93d56b12-9c96-48fa-9343-4a12d639b8a3" containerName="kube-state-metrics" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.535562 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93" containerName="rabbitmq" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.535573 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93" containerName="rabbitmq" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.535593 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f5bff08-fc88-42fc-ab9b-6d8db171ee6a" containerName="container-replicator" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.535604 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f5bff08-fc88-42fc-ab9b-6d8db171ee6a" containerName="container-replicator" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.535619 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="794d950a-8664-4970-963a-2773749103e0" containerName="ovn-northd" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.535631 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="794d950a-8664-4970-963a-2773749103e0" containerName="ovn-northd" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.535649 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4b88a4e-143e-46bd-ada8-56dece11d6cc" containerName="glance-log" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.535661 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4b88a4e-143e-46bd-ada8-56dece11d6cc" containerName="glance-log" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.535678 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11468616-1e2d-4cfd-b172-299b0cc33f6e" containerName="nova-api-log" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.535690 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="11468616-1e2d-4cfd-b172-299b0cc33f6e" containerName="nova-api-log" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.535708 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69c47154-7063-4a88-af54-c4dba11e7fd6" containerName="barbican-api" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.535720 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="69c47154-7063-4a88-af54-c4dba11e7fd6" containerName="barbican-api" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.535753 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd019f3d-1483-40e4-9534-b8bd551ed652" containerName="ceilometer-central-agent" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.535791 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd019f3d-1483-40e4-9534-b8bd551ed652" containerName="ceilometer-central-agent" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.535810 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="436edb75-475a-4096-a9c9-bf235fc92d9c" containerName="config-reloader" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.535823 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="436edb75-475a-4096-a9c9-bf235fc92d9c" containerName="config-reloader" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.536063 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="3b04c3f7-3328-4aef-92bc-42f328744879" containerName="watcher-decision-engine" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.536082 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="dacf3ba5-1ecd-46e4-bed9-e33f9b9ffd93" containerName="rabbitmq" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.536107 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1195ba16-9c86-4aeb-b62f-a93570eb8b02" containerName="dnsmasq-dns" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.536121 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="436edb75-475a-4096-a9c9-bf235fc92d9c" containerName="config-reloader" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.536136 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="9185c9ac-7b26-4bbc-be42-545c166ba2c8" containerName="galera" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.536155 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7ea8cd10-4026-4603-a76b-b26ebe185441" containerName="cinder-api" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.536171 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="bd019f3d-1483-40e4-9534-b8bd551ed652" containerName="ceilometer-notification-agent" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.536191 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="11468616-1e2d-4cfd-b172-299b0cc33f6e" containerName="nova-api-log" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.536208 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e15efd1b-6aa8-4a24-b576-4e03e19e19d0" containerName="watcher-api-log" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.536223 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="794d950a-8664-4970-963a-2773749103e0" containerName="openstack-network-exporter" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.536240 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7f5bff08-fc88-42fc-ab9b-6d8db171ee6a" containerName="object-auditor" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.536252 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="73c9b7cf-53e7-4e3b-81c4-f674f8bfd894" containerName="probe" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.536266 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="d4b88a4e-143e-46bd-ada8-56dece11d6cc" containerName="glance-httpd" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.536287 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="86686d29-4c19-43e3-97a8-d8373883dc6a" containerName="mariadb-account-create-update" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.536304 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="73c9b7cf-53e7-4e3b-81c4-f674f8bfd894" containerName="cinder-scheduler" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.536321 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7f5bff08-fc88-42fc-ab9b-6d8db171ee6a" containerName="object-updater" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.536338 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1d4fa436-d4ae-48e8-b4db-5e9096c6f51d" containerName="neutron-httpd" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.536355 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1d4fa436-d4ae-48e8-b4db-5e9096c6f51d" containerName="neutron-api" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.536368 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7b05ec0c-8f80-4a86-8823-629c4e953395" containerName="keystone-api" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.536382 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7ea8cd10-4026-4603-a76b-b26ebe185441" containerName="cinder-api-log" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.536398 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ecdbe440-4557-4298-b0b7-e2e89958bf07" containerName="barbican-keystone-listener" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.536416 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="436edb75-475a-4096-a9c9-bf235fc92d9c" containerName="prometheus" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.536436 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7f5bff08-fc88-42fc-ab9b-6d8db171ee6a" containerName="rsync" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.536453 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7f5bff08-fc88-42fc-ab9b-6d8db171ee6a" containerName="container-auditor" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.536476 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="bd019f3d-1483-40e4-9534-b8bd551ed652" containerName="ceilometer-central-agent" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.536494 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="794d950a-8664-4970-963a-2773749103e0" containerName="ovn-northd" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.536513 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="11468616-1e2d-4cfd-b172-299b0cc33f6e" containerName="nova-api-api" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.536535 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7f5bff08-fc88-42fc-ab9b-6d8db171ee6a" containerName="object-server" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.536551 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="69c47154-7063-4a88-af54-c4dba11e7fd6" containerName="barbican-api" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.536566 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="3ea3fd85-7822-44e8-a112-9aec7d6f9a7c" containerName="nova-metadata-metadata" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.536583 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7f5bff08-fc88-42fc-ab9b-6d8db171ee6a" containerName="account-server" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.536604 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7f5bff08-fc88-42fc-ab9b-6d8db171ee6a" containerName="container-replicator" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.536619 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="8558eb14-801e-455b-8374-1c69e333901c" containerName="barbican-worker" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.536637 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="79383c2c-77ce-4694-acfd-f65a93d14d36" containerName="glance-httpd" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.536656 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ecdbe440-4557-4298-b0b7-e2e89958bf07" containerName="barbican-keystone-listener-log" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.536677 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="90dbf97e-452f-4fce-8ceb-07fda29e83b8" containerName="proxy-httpd" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.536695 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="436edb75-475a-4096-a9c9-bf235fc92d9c" containerName="thanos-sidecar" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.536714 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="00712a43-f38b-478f-bd42-a8cb0c2c14b3" containerName="nova-cell1-conductor-conductor" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.536736 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7f5bff08-fc88-42fc-ab9b-6d8db171ee6a" containerName="swift-recon-cron" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.536755 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7f5bff08-fc88-42fc-ab9b-6d8db171ee6a" containerName="account-replicator" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.536800 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="3ea3fd85-7822-44e8-a112-9aec7d6f9a7c" containerName="nova-metadata-log" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.536823 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e15efd1b-6aa8-4a24-b576-4e03e19e19d0" containerName="watcher-api" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.536836 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7f5bff08-fc88-42fc-ab9b-6d8db171ee6a" containerName="account-auditor" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.536855 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7f5bff08-fc88-42fc-ab9b-6d8db171ee6a" containerName="object-replicator" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.536870 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="bd019f3d-1483-40e4-9534-b8bd551ed652" containerName="sg-core" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.536886 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7f5bff08-fc88-42fc-ab9b-6d8db171ee6a" containerName="container-server" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.536900 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="771204f4-c55f-4a6e-be63-70f3d1c8a51e" containerName="placement-api" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.536916 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ba0d3286-038b-4735-b0b4-1ce9b3faeed1" containerName="memcached" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.536934 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="79383c2c-77ce-4694-acfd-f65a93d14d36" containerName="glance-log" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.536951 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="d4b88a4e-143e-46bd-ada8-56dece11d6cc" containerName="glance-log" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.536970 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7f5bff08-fc88-42fc-ab9b-6d8db171ee6a" containerName="container-updater" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.537005 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="bd019f3d-1483-40e4-9534-b8bd551ed652" containerName="proxy-httpd" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.537028 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="d5160b65-3a41-4645-9f47-bd4e891fef5f" containerName="watcher-applier" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.537052 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7f5bff08-fc88-42fc-ab9b-6d8db171ee6a" containerName="object-expirer" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.537073 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="9b43ebee-5f04-44e0-a8bf-56f70871894e" containerName="alertmanager" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.537101 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7f5bff08-fc88-42fc-ab9b-6d8db171ee6a" containerName="account-reaper" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.537120 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="8558eb14-801e-455b-8374-1c69e333901c" containerName="barbican-worker-log" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.537135 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="69c47154-7063-4a88-af54-c4dba11e7fd6" containerName="barbican-api-log" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.537150 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="90dbf97e-452f-4fce-8ceb-07fda29e83b8" containerName="proxy-server" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.537169 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="243c208b-8b2f-4041-9adc-aa2fee8f07f9" containerName="nova-scheduler-scheduler" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.537189 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="9b43ebee-5f04-44e0-a8bf-56f70871894e" containerName="config-reloader" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.537209 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="771204f4-c55f-4a6e-be63-70f3d1c8a51e" containerName="placement-log" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.537225 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="93d56b12-9c96-48fa-9343-4a12d639b8a3" containerName="kube-state-metrics" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.537243 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f90be6a3-f863-476d-b78b-95b9d069037e" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.545366 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-gjvct" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.548659 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"openshift-service-ca.crt\"" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.548891 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"crc-storage\"" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.550988 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"crc-storage\"/\"crc-storage-dockercfg-s2tht\"" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.552207 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-gjvct"] Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.553396 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"kube-root-ca.crt\"" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.620130 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/930e8df9-cd4a-4510-bc41-870dc7c07640-crc-storage\") pod \"crc-storage-crc-gjvct\" (UID: \"930e8df9-cd4a-4510-bc41-870dc7c07640\") " pod="crc-storage/crc-storage-crc-gjvct" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.620178 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24kmf\" (UniqueName: \"kubernetes.io/projected/930e8df9-cd4a-4510-bc41-870dc7c07640-kube-api-access-24kmf\") pod \"crc-storage-crc-gjvct\" (UID: \"930e8df9-cd4a-4510-bc41-870dc7c07640\") " pod="crc-storage/crc-storage-crc-gjvct" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.620756 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/930e8df9-cd4a-4510-bc41-870dc7c07640-node-mnt\") pod \"crc-storage-crc-gjvct\" (UID: \"930e8df9-cd4a-4510-bc41-870dc7c07640\") " pod="crc-storage/crc-storage-crc-gjvct" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.679838 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="00712a43-f38b-478f-bd42-a8cb0c2c14b3" path="/var/lib/kubelet/pods/00712a43-f38b-478f-bd42-a8cb0c2c14b3/volumes" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.680524 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="243c208b-8b2f-4041-9adc-aa2fee8f07f9" path="/var/lib/kubelet/pods/243c208b-8b2f-4041-9adc-aa2fee8f07f9/volumes" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.681239 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a988117-7627-4f34-9b78-50a8e13adfa6" path="/var/lib/kubelet/pods/9a988117-7627-4f34-9b78-50a8e13adfa6/volumes" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.722665 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/930e8df9-cd4a-4510-bc41-870dc7c07640-node-mnt\") pod \"crc-storage-crc-gjvct\" (UID: \"930e8df9-cd4a-4510-bc41-870dc7c07640\") " pod="crc-storage/crc-storage-crc-gjvct" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.722816 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/930e8df9-cd4a-4510-bc41-870dc7c07640-crc-storage\") pod \"crc-storage-crc-gjvct\" (UID: \"930e8df9-cd4a-4510-bc41-870dc7c07640\") " pod="crc-storage/crc-storage-crc-gjvct" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.722838 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-24kmf\" (UniqueName: \"kubernetes.io/projected/930e8df9-cd4a-4510-bc41-870dc7c07640-kube-api-access-24kmf\") pod \"crc-storage-crc-gjvct\" (UID: \"930e8df9-cd4a-4510-bc41-870dc7c07640\") " pod="crc-storage/crc-storage-crc-gjvct" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.723293 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/930e8df9-cd4a-4510-bc41-870dc7c07640-node-mnt\") pod \"crc-storage-crc-gjvct\" (UID: \"930e8df9-cd4a-4510-bc41-870dc7c07640\") " pod="crc-storage/crc-storage-crc-gjvct" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.723598 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/930e8df9-cd4a-4510-bc41-870dc7c07640-crc-storage\") pod \"crc-storage-crc-gjvct\" (UID: \"930e8df9-cd4a-4510-bc41-870dc7c07640\") " pod="crc-storage/crc-storage-crc-gjvct" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.756518 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-24kmf\" (UniqueName: \"kubernetes.io/projected/930e8df9-cd4a-4510-bc41-870dc7c07640-kube-api-access-24kmf\") pod \"crc-storage-crc-gjvct\" (UID: \"930e8df9-cd4a-4510-bc41-870dc7c07640\") " pod="crc-storage/crc-storage-crc-gjvct" Mar 16 16:25:08 crc kubenswrapper[5120]: I0316 16:25:08.884844 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-gjvct" Mar 16 16:25:09 crc kubenswrapper[5120]: I0316 16:25:09.174084 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-gjvct"] Mar 16 16:25:09 crc kubenswrapper[5120]: I0316 16:25:09.300382 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-gjvct" event={"ID":"930e8df9-cd4a-4510-bc41-870dc7c07640","Type":"ContainerStarted","Data":"4ad028e88f411e0711fb196fcbfd6685f19fb2488f5f62df16d520cef897a5c3"} Mar 16 16:25:10 crc kubenswrapper[5120]: I0316 16:25:10.317244 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-gjvct" event={"ID":"930e8df9-cd4a-4510-bc41-870dc7c07640","Type":"ContainerStarted","Data":"37f52458b19073ff1e8a69d38980542edda8b4606834a40833190d622fd0ea6d"} Mar 16 16:25:10 crc kubenswrapper[5120]: I0316 16:25:10.344648 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="crc-storage/crc-storage-crc-gjvct" podStartSLOduration=1.672546002 podStartE2EDuration="2.344624268s" podCreationTimestamp="2026-03-16 16:25:08 +0000 UTC" firstStartedPulling="2026-03-16 16:25:09.17670027 +0000 UTC m=+3211.330631947" lastFinishedPulling="2026-03-16 16:25:09.848778556 +0000 UTC m=+3212.002710213" observedRunningTime="2026-03-16 16:25:10.340166229 +0000 UTC m=+3212.494097916" watchObservedRunningTime="2026-03-16 16:25:10.344624268 +0000 UTC m=+3212.498555955" Mar 16 16:25:11 crc kubenswrapper[5120]: I0316 16:25:11.336674 5120 generic.go:358] "Generic (PLEG): container finished" podID="930e8df9-cd4a-4510-bc41-870dc7c07640" containerID="37f52458b19073ff1e8a69d38980542edda8b4606834a40833190d622fd0ea6d" exitCode=0 Mar 16 16:25:11 crc kubenswrapper[5120]: I0316 16:25:11.336742 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-gjvct" event={"ID":"930e8df9-cd4a-4510-bc41-870dc7c07640","Type":"ContainerDied","Data":"37f52458b19073ff1e8a69d38980542edda8b4606834a40833190d622fd0ea6d"} Mar 16 16:25:12 crc kubenswrapper[5120]: I0316 16:25:12.752503 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-gjvct" Mar 16 16:25:12 crc kubenswrapper[5120]: I0316 16:25:12.812622 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-24kmf\" (UniqueName: \"kubernetes.io/projected/930e8df9-cd4a-4510-bc41-870dc7c07640-kube-api-access-24kmf\") pod \"930e8df9-cd4a-4510-bc41-870dc7c07640\" (UID: \"930e8df9-cd4a-4510-bc41-870dc7c07640\") " Mar 16 16:25:12 crc kubenswrapper[5120]: I0316 16:25:12.813018 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/930e8df9-cd4a-4510-bc41-870dc7c07640-crc-storage\") pod \"930e8df9-cd4a-4510-bc41-870dc7c07640\" (UID: \"930e8df9-cd4a-4510-bc41-870dc7c07640\") " Mar 16 16:25:12 crc kubenswrapper[5120]: I0316 16:25:12.813313 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/930e8df9-cd4a-4510-bc41-870dc7c07640-node-mnt\") pod \"930e8df9-cd4a-4510-bc41-870dc7c07640\" (UID: \"930e8df9-cd4a-4510-bc41-870dc7c07640\") " Mar 16 16:25:12 crc kubenswrapper[5120]: I0316 16:25:12.814041 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/930e8df9-cd4a-4510-bc41-870dc7c07640-node-mnt" (OuterVolumeSpecName: "node-mnt") pod "930e8df9-cd4a-4510-bc41-870dc7c07640" (UID: "930e8df9-cd4a-4510-bc41-870dc7c07640"). InnerVolumeSpecName "node-mnt". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 16:25:12 crc kubenswrapper[5120]: I0316 16:25:12.825625 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/930e8df9-cd4a-4510-bc41-870dc7c07640-kube-api-access-24kmf" (OuterVolumeSpecName: "kube-api-access-24kmf") pod "930e8df9-cd4a-4510-bc41-870dc7c07640" (UID: "930e8df9-cd4a-4510-bc41-870dc7c07640"). InnerVolumeSpecName "kube-api-access-24kmf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:25:12 crc kubenswrapper[5120]: I0316 16:25:12.852696 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/930e8df9-cd4a-4510-bc41-870dc7c07640-crc-storage" (OuterVolumeSpecName: "crc-storage") pod "930e8df9-cd4a-4510-bc41-870dc7c07640" (UID: "930e8df9-cd4a-4510-bc41-870dc7c07640"). InnerVolumeSpecName "crc-storage". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:25:12 crc kubenswrapper[5120]: I0316 16:25:12.915490 5120 reconciler_common.go:299] "Volume detached for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/930e8df9-cd4a-4510-bc41-870dc7c07640-node-mnt\") on node \"crc\" DevicePath \"\"" Mar 16 16:25:12 crc kubenswrapper[5120]: I0316 16:25:12.915520 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-24kmf\" (UniqueName: \"kubernetes.io/projected/930e8df9-cd4a-4510-bc41-870dc7c07640-kube-api-access-24kmf\") on node \"crc\" DevicePath \"\"" Mar 16 16:25:12 crc kubenswrapper[5120]: I0316 16:25:12.915534 5120 reconciler_common.go:299] "Volume detached for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/930e8df9-cd4a-4510-bc41-870dc7c07640-crc-storage\") on node \"crc\" DevicePath \"\"" Mar 16 16:25:13 crc kubenswrapper[5120]: I0316 16:25:13.389740 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-gjvct" event={"ID":"930e8df9-cd4a-4510-bc41-870dc7c07640","Type":"ContainerDied","Data":"4ad028e88f411e0711fb196fcbfd6685f19fb2488f5f62df16d520cef897a5c3"} Mar 16 16:25:13 crc kubenswrapper[5120]: I0316 16:25:13.390326 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4ad028e88f411e0711fb196fcbfd6685f19fb2488f5f62df16d520cef897a5c3" Mar 16 16:25:13 crc kubenswrapper[5120]: I0316 16:25:13.390427 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-gjvct" Mar 16 16:25:15 crc kubenswrapper[5120]: I0316 16:25:15.787153 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["crc-storage/crc-storage-crc-gjvct"] Mar 16 16:25:15 crc kubenswrapper[5120]: I0316 16:25:15.792848 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["crc-storage/crc-storage-crc-gjvct"] Mar 16 16:25:15 crc kubenswrapper[5120]: I0316 16:25:15.938277 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["crc-storage/crc-storage-crc-47dcv"] Mar 16 16:25:15 crc kubenswrapper[5120]: I0316 16:25:15.939585 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="930e8df9-cd4a-4510-bc41-870dc7c07640" containerName="storage" Mar 16 16:25:15 crc kubenswrapper[5120]: I0316 16:25:15.939600 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="930e8df9-cd4a-4510-bc41-870dc7c07640" containerName="storage" Mar 16 16:25:15 crc kubenswrapper[5120]: I0316 16:25:15.939796 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="86686d29-4c19-43e3-97a8-d8373883dc6a" containerName="mariadb-account-create-update" Mar 16 16:25:15 crc kubenswrapper[5120]: I0316 16:25:15.939837 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="930e8df9-cd4a-4510-bc41-870dc7c07640" containerName="storage" Mar 16 16:25:15 crc kubenswrapper[5120]: I0316 16:25:15.954209 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-47dcv"] Mar 16 16:25:15 crc kubenswrapper[5120]: I0316 16:25:15.954426 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-47dcv" Mar 16 16:25:15 crc kubenswrapper[5120]: I0316 16:25:15.962169 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"kube-root-ca.crt\"" Mar 16 16:25:15 crc kubenswrapper[5120]: I0316 16:25:15.962271 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"crc-storage\"" Mar 16 16:25:15 crc kubenswrapper[5120]: I0316 16:25:15.962529 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"crc-storage\"/\"crc-storage-dockercfg-s2tht\"" Mar 16 16:25:15 crc kubenswrapper[5120]: I0316 16:25:15.962550 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"openshift-service-ca.crt\"" Mar 16 16:25:16 crc kubenswrapper[5120]: I0316 16:25:16.089240 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2fp5\" (UniqueName: \"kubernetes.io/projected/6de2b59f-369e-4c9f-afe3-80c3c7d16a4b-kube-api-access-m2fp5\") pod \"crc-storage-crc-47dcv\" (UID: \"6de2b59f-369e-4c9f-afe3-80c3c7d16a4b\") " pod="crc-storage/crc-storage-crc-47dcv" Mar 16 16:25:16 crc kubenswrapper[5120]: I0316 16:25:16.089387 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/6de2b59f-369e-4c9f-afe3-80c3c7d16a4b-node-mnt\") pod \"crc-storage-crc-47dcv\" (UID: \"6de2b59f-369e-4c9f-afe3-80c3c7d16a4b\") " pod="crc-storage/crc-storage-crc-47dcv" Mar 16 16:25:16 crc kubenswrapper[5120]: I0316 16:25:16.090117 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/6de2b59f-369e-4c9f-afe3-80c3c7d16a4b-crc-storage\") pod \"crc-storage-crc-47dcv\" (UID: \"6de2b59f-369e-4c9f-afe3-80c3c7d16a4b\") " pod="crc-storage/crc-storage-crc-47dcv" Mar 16 16:25:16 crc kubenswrapper[5120]: I0316 16:25:16.192921 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m2fp5\" (UniqueName: \"kubernetes.io/projected/6de2b59f-369e-4c9f-afe3-80c3c7d16a4b-kube-api-access-m2fp5\") pod \"crc-storage-crc-47dcv\" (UID: \"6de2b59f-369e-4c9f-afe3-80c3c7d16a4b\") " pod="crc-storage/crc-storage-crc-47dcv" Mar 16 16:25:16 crc kubenswrapper[5120]: I0316 16:25:16.193051 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/6de2b59f-369e-4c9f-afe3-80c3c7d16a4b-node-mnt\") pod \"crc-storage-crc-47dcv\" (UID: \"6de2b59f-369e-4c9f-afe3-80c3c7d16a4b\") " pod="crc-storage/crc-storage-crc-47dcv" Mar 16 16:25:16 crc kubenswrapper[5120]: I0316 16:25:16.193720 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/6de2b59f-369e-4c9f-afe3-80c3c7d16a4b-node-mnt\") pod \"crc-storage-crc-47dcv\" (UID: \"6de2b59f-369e-4c9f-afe3-80c3c7d16a4b\") " pod="crc-storage/crc-storage-crc-47dcv" Mar 16 16:25:16 crc kubenswrapper[5120]: I0316 16:25:16.194044 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/6de2b59f-369e-4c9f-afe3-80c3c7d16a4b-crc-storage\") pod \"crc-storage-crc-47dcv\" (UID: \"6de2b59f-369e-4c9f-afe3-80c3c7d16a4b\") " pod="crc-storage/crc-storage-crc-47dcv" Mar 16 16:25:16 crc kubenswrapper[5120]: I0316 16:25:16.195479 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/6de2b59f-369e-4c9f-afe3-80c3c7d16a4b-crc-storage\") pod \"crc-storage-crc-47dcv\" (UID: \"6de2b59f-369e-4c9f-afe3-80c3c7d16a4b\") " pod="crc-storage/crc-storage-crc-47dcv" Mar 16 16:25:16 crc kubenswrapper[5120]: I0316 16:25:16.220450 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2fp5\" (UniqueName: \"kubernetes.io/projected/6de2b59f-369e-4c9f-afe3-80c3c7d16a4b-kube-api-access-m2fp5\") pod \"crc-storage-crc-47dcv\" (UID: \"6de2b59f-369e-4c9f-afe3-80c3c7d16a4b\") " pod="crc-storage/crc-storage-crc-47dcv" Mar 16 16:25:16 crc kubenswrapper[5120]: I0316 16:25:16.286484 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-47dcv" Mar 16 16:25:16 crc kubenswrapper[5120]: I0316 16:25:16.582528 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-47dcv"] Mar 16 16:25:16 crc kubenswrapper[5120]: I0316 16:25:16.664233 5120 scope.go:117] "RemoveContainer" containerID="f40e444f89abd558ac90555bfd58e04a1c4379a653ba8035c228d2b7a5443eb5" Mar 16 16:25:16 crc kubenswrapper[5120]: E0316 16:25:16.664603 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:25:16 crc kubenswrapper[5120]: I0316 16:25:16.677594 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="930e8df9-cd4a-4510-bc41-870dc7c07640" path="/var/lib/kubelet/pods/930e8df9-cd4a-4510-bc41-870dc7c07640/volumes" Mar 16 16:25:17 crc kubenswrapper[5120]: I0316 16:25:17.435078 5120 generic.go:358] "Generic (PLEG): container finished" podID="6de2b59f-369e-4c9f-afe3-80c3c7d16a4b" containerID="031a874e817f3d70e6667601bfde112c6b044100d85edb96d5d63dd72629ae13" exitCode=0 Mar 16 16:25:17 crc kubenswrapper[5120]: I0316 16:25:17.435184 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-47dcv" event={"ID":"6de2b59f-369e-4c9f-afe3-80c3c7d16a4b","Type":"ContainerDied","Data":"031a874e817f3d70e6667601bfde112c6b044100d85edb96d5d63dd72629ae13"} Mar 16 16:25:17 crc kubenswrapper[5120]: I0316 16:25:17.435545 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-47dcv" event={"ID":"6de2b59f-369e-4c9f-afe3-80c3c7d16a4b","Type":"ContainerStarted","Data":"d9debd483f81390af254d50fb73f67072de47610c7f00005b2ecfd644ffba91b"} Mar 16 16:25:18 crc kubenswrapper[5120]: I0316 16:25:18.772348 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-47dcv" Mar 16 16:25:18 crc kubenswrapper[5120]: I0316 16:25:18.858018 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/6de2b59f-369e-4c9f-afe3-80c3c7d16a4b-node-mnt\") pod \"6de2b59f-369e-4c9f-afe3-80c3c7d16a4b\" (UID: \"6de2b59f-369e-4c9f-afe3-80c3c7d16a4b\") " Mar 16 16:25:18 crc kubenswrapper[5120]: I0316 16:25:18.858122 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m2fp5\" (UniqueName: \"kubernetes.io/projected/6de2b59f-369e-4c9f-afe3-80c3c7d16a4b-kube-api-access-m2fp5\") pod \"6de2b59f-369e-4c9f-afe3-80c3c7d16a4b\" (UID: \"6de2b59f-369e-4c9f-afe3-80c3c7d16a4b\") " Mar 16 16:25:18 crc kubenswrapper[5120]: I0316 16:25:18.858322 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/6de2b59f-369e-4c9f-afe3-80c3c7d16a4b-crc-storage\") pod \"6de2b59f-369e-4c9f-afe3-80c3c7d16a4b\" (UID: \"6de2b59f-369e-4c9f-afe3-80c3c7d16a4b\") " Mar 16 16:25:18 crc kubenswrapper[5120]: I0316 16:25:18.863465 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/6de2b59f-369e-4c9f-afe3-80c3c7d16a4b-node-mnt" (OuterVolumeSpecName: "node-mnt") pod "6de2b59f-369e-4c9f-afe3-80c3c7d16a4b" (UID: "6de2b59f-369e-4c9f-afe3-80c3c7d16a4b"). InnerVolumeSpecName "node-mnt". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 16:25:18 crc kubenswrapper[5120]: I0316 16:25:18.877495 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6de2b59f-369e-4c9f-afe3-80c3c7d16a4b-kube-api-access-m2fp5" (OuterVolumeSpecName: "kube-api-access-m2fp5") pod "6de2b59f-369e-4c9f-afe3-80c3c7d16a4b" (UID: "6de2b59f-369e-4c9f-afe3-80c3c7d16a4b"). InnerVolumeSpecName "kube-api-access-m2fp5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:25:18 crc kubenswrapper[5120]: I0316 16:25:18.884452 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6de2b59f-369e-4c9f-afe3-80c3c7d16a4b-crc-storage" (OuterVolumeSpecName: "crc-storage") pod "6de2b59f-369e-4c9f-afe3-80c3c7d16a4b" (UID: "6de2b59f-369e-4c9f-afe3-80c3c7d16a4b"). InnerVolumeSpecName "crc-storage". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:25:18 crc kubenswrapper[5120]: I0316 16:25:18.961854 5120 reconciler_common.go:299] "Volume detached for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/6de2b59f-369e-4c9f-afe3-80c3c7d16a4b-crc-storage\") on node \"crc\" DevicePath \"\"" Mar 16 16:25:18 crc kubenswrapper[5120]: I0316 16:25:18.962206 5120 reconciler_common.go:299] "Volume detached for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/6de2b59f-369e-4c9f-afe3-80c3c7d16a4b-node-mnt\") on node \"crc\" DevicePath \"\"" Mar 16 16:25:18 crc kubenswrapper[5120]: I0316 16:25:18.962218 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m2fp5\" (UniqueName: \"kubernetes.io/projected/6de2b59f-369e-4c9f-afe3-80c3c7d16a4b-kube-api-access-m2fp5\") on node \"crc\" DevicePath \"\"" Mar 16 16:25:19 crc kubenswrapper[5120]: I0316 16:25:19.460580 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-47dcv" Mar 16 16:25:19 crc kubenswrapper[5120]: I0316 16:25:19.460577 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-47dcv" event={"ID":"6de2b59f-369e-4c9f-afe3-80c3c7d16a4b","Type":"ContainerDied","Data":"d9debd483f81390af254d50fb73f67072de47610c7f00005b2ecfd644ffba91b"} Mar 16 16:25:19 crc kubenswrapper[5120]: I0316 16:25:19.460735 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d9debd483f81390af254d50fb73f67072de47610c7f00005b2ecfd644ffba91b" Mar 16 16:25:27 crc kubenswrapper[5120]: I0316 16:25:27.663635 5120 scope.go:117] "RemoveContainer" containerID="f40e444f89abd558ac90555bfd58e04a1c4379a653ba8035c228d2b7a5443eb5" Mar 16 16:25:28 crc kubenswrapper[5120]: I0316 16:25:28.551720 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" event={"ID":"e2275cb4-4905-4d66-a87e-8010120db2bd","Type":"ContainerStarted","Data":"81c2458dbde22f960e4dc3bd6169d3e540aa2cf242ee46fc5d79af661a0e3277"} Mar 16 16:25:34 crc kubenswrapper[5120]: I0316 16:25:34.610829 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 16:25:34 crc kubenswrapper[5120]: I0316 16:25:34.613985 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6de2b59f-369e-4c9f-afe3-80c3c7d16a4b" containerName="storage" Mar 16 16:25:34 crc kubenswrapper[5120]: I0316 16:25:34.614032 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="6de2b59f-369e-4c9f-afe3-80c3c7d16a4b" containerName="storage" Mar 16 16:25:34 crc kubenswrapper[5120]: I0316 16:25:34.614356 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="6de2b59f-369e-4c9f-afe3-80c3c7d16a4b" containerName="storage" Mar 16 16:25:34 crc kubenswrapper[5120]: I0316 16:25:34.628028 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:25:34 crc kubenswrapper[5120]: I0316 16:25:34.631264 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-cell1-erlang-cookie\"" Mar 16 16:25:34 crc kubenswrapper[5120]: I0316 16:25:34.633103 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-cell1-server-conf\"" Mar 16 16:25:34 crc kubenswrapper[5120]: I0316 16:25:34.633578 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-cell1-server-dockercfg-xnzsl\"" Mar 16 16:25:34 crc kubenswrapper[5120]: I0316 16:25:34.633594 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-cell1-config-data\"" Mar 16 16:25:34 crc kubenswrapper[5120]: I0316 16:25:34.637846 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-2"] Mar 16 16:25:34 crc kubenswrapper[5120]: I0316 16:25:34.646716 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-2" Mar 16 16:25:34 crc kubenswrapper[5120]: I0316 16:25:34.648353 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-cell1-plugins-conf\"" Mar 16 16:25:34 crc kubenswrapper[5120]: I0316 16:25:34.660461 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 16:25:34 crc kubenswrapper[5120]: I0316 16:25:34.671710 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-cell1-default-user\"" Mar 16 16:25:34 crc kubenswrapper[5120]: I0316 16:25:34.671827 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-rabbitmq-cell1-svc\"" Mar 16 16:25:34 crc kubenswrapper[5120]: I0316 16:25:34.695332 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-1"] Mar 16 16:25:34 crc kubenswrapper[5120]: I0316 16:25:34.707955 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-1"] Mar 16 16:25:34 crc kubenswrapper[5120]: I0316 16:25:34.708188 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-1" Mar 16 16:25:34 crc kubenswrapper[5120]: I0316 16:25:34.713366 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-2"] Mar 16 16:25:34 crc kubenswrapper[5120]: I0316 16:25:34.802964 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/dbe6904f-2249-41c3-bb8a-a1b5817094c5-rabbitmq-erlang-cookie\") pod \"rabbitmq-cell1-server-1\" (UID: \"dbe6904f-2249-41c3-bb8a-a1b5817094c5\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-1" Mar 16 16:25:34 crc kubenswrapper[5120]: I0316 16:25:34.803007 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/dbe6904f-2249-41c3-bb8a-a1b5817094c5-erlang-cookie-secret\") pod \"rabbitmq-cell1-server-1\" (UID: \"dbe6904f-2249-41c3-bb8a-a1b5817094c5\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-1" Mar 16 16:25:34 crc kubenswrapper[5120]: I0316 16:25:34.803030 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/b190faa2-d49d-424d-90bc-3e6e34d1b362-config-data\") pod \"rabbitmq-cell1-server-2\" (UID: \"b190faa2-d49d-424d-90bc-3e6e34d1b362\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-2" Mar 16 16:25:34 crc kubenswrapper[5120]: I0316 16:25:34.803067 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/b190faa2-d49d-424d-90bc-3e6e34d1b362-rabbitmq-confd\") pod \"rabbitmq-cell1-server-2\" (UID: \"b190faa2-d49d-424d-90bc-3e6e34d1b362\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-2" Mar 16 16:25:34 crc kubenswrapper[5120]: I0316 16:25:34.803093 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/e1bf7ad2-f215-405b-84de-9429f90855f8-server-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"e1bf7ad2-f215-405b-84de-9429f90855f8\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:25:34 crc kubenswrapper[5120]: I0316 16:25:34.803108 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/dbe6904f-2249-41c3-bb8a-a1b5817094c5-rabbitmq-tls\") pod \"rabbitmq-cell1-server-1\" (UID: \"dbe6904f-2249-41c3-bb8a-a1b5817094c5\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-1" Mar 16 16:25:34 crc kubenswrapper[5120]: I0316 16:25:34.803126 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/e1bf7ad2-f215-405b-84de-9429f90855f8-rabbitmq-tls\") pod \"rabbitmq-cell1-server-0\" (UID: \"e1bf7ad2-f215-405b-84de-9429f90855f8\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:25:34 crc kubenswrapper[5120]: I0316 16:25:34.803192 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/dbe6904f-2249-41c3-bb8a-a1b5817094c5-plugins-conf\") pod \"rabbitmq-cell1-server-1\" (UID: \"dbe6904f-2249-41c3-bb8a-a1b5817094c5\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-1" Mar 16 16:25:34 crc kubenswrapper[5120]: I0316 16:25:34.803233 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/b190faa2-d49d-424d-90bc-3e6e34d1b362-rabbitmq-erlang-cookie\") pod \"rabbitmq-cell1-server-2\" (UID: \"b190faa2-d49d-424d-90bc-3e6e34d1b362\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-2" Mar 16 16:25:34 crc kubenswrapper[5120]: I0316 16:25:34.803263 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/dbe6904f-2249-41c3-bb8a-a1b5817094c5-rabbitmq-plugins\") pod \"rabbitmq-cell1-server-1\" (UID: \"dbe6904f-2249-41c3-bb8a-a1b5817094c5\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-1" Mar 16 16:25:34 crc kubenswrapper[5120]: I0316 16:25:34.803326 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/e1bf7ad2-f215-405b-84de-9429f90855f8-rabbitmq-plugins\") pod \"rabbitmq-cell1-server-0\" (UID: \"e1bf7ad2-f215-405b-84de-9429f90855f8\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:25:34 crc kubenswrapper[5120]: I0316 16:25:34.803389 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/b190faa2-d49d-424d-90bc-3e6e34d1b362-rabbitmq-tls\") pod \"rabbitmq-cell1-server-2\" (UID: \"b190faa2-d49d-424d-90bc-3e6e34d1b362\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-2" Mar 16 16:25:34 crc kubenswrapper[5120]: I0316 16:25:34.803411 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/e1bf7ad2-f215-405b-84de-9429f90855f8-pod-info\") pod \"rabbitmq-cell1-server-0\" (UID: \"e1bf7ad2-f215-405b-84de-9429f90855f8\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:25:34 crc kubenswrapper[5120]: I0316 16:25:34.803473 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/e1bf7ad2-f215-405b-84de-9429f90855f8-rabbitmq-erlang-cookie\") pod \"rabbitmq-cell1-server-0\" (UID: \"e1bf7ad2-f215-405b-84de-9429f90855f8\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:25:34 crc kubenswrapper[5120]: I0316 16:25:34.803492 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/dbe6904f-2249-41c3-bb8a-a1b5817094c5-server-conf\") pod \"rabbitmq-cell1-server-1\" (UID: \"dbe6904f-2249-41c3-bb8a-a1b5817094c5\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-1" Mar 16 16:25:34 crc kubenswrapper[5120]: I0316 16:25:34.803516 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/b190faa2-d49d-424d-90bc-3e6e34d1b362-erlang-cookie-secret\") pod \"rabbitmq-cell1-server-2\" (UID: \"b190faa2-d49d-424d-90bc-3e6e34d1b362\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-2" Mar 16 16:25:34 crc kubenswrapper[5120]: I0316 16:25:34.803533 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/b190faa2-d49d-424d-90bc-3e6e34d1b362-pod-info\") pod \"rabbitmq-cell1-server-2\" (UID: \"b190faa2-d49d-424d-90bc-3e6e34d1b362\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-2" Mar 16 16:25:34 crc kubenswrapper[5120]: I0316 16:25:34.803605 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/dbe6904f-2249-41c3-bb8a-a1b5817094c5-pod-info\") pod \"rabbitmq-cell1-server-1\" (UID: \"dbe6904f-2249-41c3-bb8a-a1b5817094c5\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-1" Mar 16 16:25:34 crc kubenswrapper[5120]: I0316 16:25:34.803661 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmbrs\" (UniqueName: \"kubernetes.io/projected/dbe6904f-2249-41c3-bb8a-a1b5817094c5-kube-api-access-rmbrs\") pod \"rabbitmq-cell1-server-1\" (UID: \"dbe6904f-2249-41c3-bb8a-a1b5817094c5\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-1" Mar 16 16:25:34 crc kubenswrapper[5120]: I0316 16:25:34.803697 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/e1bf7ad2-f215-405b-84de-9429f90855f8-config-data\") pod \"rabbitmq-cell1-server-0\" (UID: \"e1bf7ad2-f215-405b-84de-9429f90855f8\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:25:34 crc kubenswrapper[5120]: I0316 16:25:34.803738 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/b190faa2-d49d-424d-90bc-3e6e34d1b362-rabbitmq-plugins\") pod \"rabbitmq-cell1-server-2\" (UID: \"b190faa2-d49d-424d-90bc-3e6e34d1b362\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-2" Mar 16 16:25:34 crc kubenswrapper[5120]: I0316 16:25:34.803823 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/e1bf7ad2-f215-405b-84de-9429f90855f8-erlang-cookie-secret\") pod \"rabbitmq-cell1-server-0\" (UID: \"e1bf7ad2-f215-405b-84de-9429f90855f8\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:25:34 crc kubenswrapper[5120]: I0316 16:25:34.803853 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/b190faa2-d49d-424d-90bc-3e6e34d1b362-plugins-conf\") pod \"rabbitmq-cell1-server-2\" (UID: \"b190faa2-d49d-424d-90bc-3e6e34d1b362\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-2" Mar 16 16:25:34 crc kubenswrapper[5120]: I0316 16:25:34.803875 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/e1bf7ad2-f215-405b-84de-9429f90855f8-rabbitmq-confd\") pod \"rabbitmq-cell1-server-0\" (UID: \"e1bf7ad2-f215-405b-84de-9429f90855f8\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:25:34 crc kubenswrapper[5120]: I0316 16:25:34.803890 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/dbe6904f-2249-41c3-bb8a-a1b5817094c5-config-data\") pod \"rabbitmq-cell1-server-1\" (UID: \"dbe6904f-2249-41c3-bb8a-a1b5817094c5\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-1" Mar 16 16:25:34 crc kubenswrapper[5120]: I0316 16:25:34.803931 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") pod \"rabbitmq-cell1-server-2\" (UID: \"b190faa2-d49d-424d-90bc-3e6e34d1b362\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-2" Mar 16 16:25:34 crc kubenswrapper[5120]: I0316 16:25:34.803951 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zh7x4\" (UniqueName: \"kubernetes.io/projected/b190faa2-d49d-424d-90bc-3e6e34d1b362-kube-api-access-zh7x4\") pod \"rabbitmq-cell1-server-2\" (UID: \"b190faa2-d49d-424d-90bc-3e6e34d1b362\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-2" Mar 16 16:25:34 crc kubenswrapper[5120]: I0316 16:25:34.803971 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage18-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"e1bf7ad2-f215-405b-84de-9429f90855f8\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:25:34 crc kubenswrapper[5120]: I0316 16:25:34.803986 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage15-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage15-crc\") pod \"rabbitmq-cell1-server-1\" (UID: \"dbe6904f-2249-41c3-bb8a-a1b5817094c5\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-1" Mar 16 16:25:34 crc kubenswrapper[5120]: I0316 16:25:34.804017 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqwtd\" (UniqueName: \"kubernetes.io/projected/e1bf7ad2-f215-405b-84de-9429f90855f8-kube-api-access-zqwtd\") pod \"rabbitmq-cell1-server-0\" (UID: \"e1bf7ad2-f215-405b-84de-9429f90855f8\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:25:34 crc kubenswrapper[5120]: I0316 16:25:34.804036 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/b190faa2-d49d-424d-90bc-3e6e34d1b362-server-conf\") pod \"rabbitmq-cell1-server-2\" (UID: \"b190faa2-d49d-424d-90bc-3e6e34d1b362\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-2" Mar 16 16:25:34 crc kubenswrapper[5120]: I0316 16:25:34.804060 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/e1bf7ad2-f215-405b-84de-9429f90855f8-plugins-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"e1bf7ad2-f215-405b-84de-9429f90855f8\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:25:34 crc kubenswrapper[5120]: I0316 16:25:34.804078 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/dbe6904f-2249-41c3-bb8a-a1b5817094c5-rabbitmq-confd\") pod \"rabbitmq-cell1-server-1\" (UID: \"dbe6904f-2249-41c3-bb8a-a1b5817094c5\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-1" Mar 16 16:25:34 crc kubenswrapper[5120]: I0316 16:25:34.905457 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") pod \"rabbitmq-cell1-server-2\" (UID: \"b190faa2-d49d-424d-90bc-3e6e34d1b362\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-2" Mar 16 16:25:34 crc kubenswrapper[5120]: I0316 16:25:34.905499 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zh7x4\" (UniqueName: \"kubernetes.io/projected/b190faa2-d49d-424d-90bc-3e6e34d1b362-kube-api-access-zh7x4\") pod \"rabbitmq-cell1-server-2\" (UID: \"b190faa2-d49d-424d-90bc-3e6e34d1b362\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-2" Mar 16 16:25:34 crc kubenswrapper[5120]: I0316 16:25:34.905525 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage18-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"e1bf7ad2-f215-405b-84de-9429f90855f8\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:25:34 crc kubenswrapper[5120]: I0316 16:25:34.905543 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage15-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage15-crc\") pod \"rabbitmq-cell1-server-1\" (UID: \"dbe6904f-2249-41c3-bb8a-a1b5817094c5\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-1" Mar 16 16:25:34 crc kubenswrapper[5120]: I0316 16:25:34.905565 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zqwtd\" (UniqueName: \"kubernetes.io/projected/e1bf7ad2-f215-405b-84de-9429f90855f8-kube-api-access-zqwtd\") pod \"rabbitmq-cell1-server-0\" (UID: \"e1bf7ad2-f215-405b-84de-9429f90855f8\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:25:34 crc kubenswrapper[5120]: I0316 16:25:34.905584 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/b190faa2-d49d-424d-90bc-3e6e34d1b362-server-conf\") pod \"rabbitmq-cell1-server-2\" (UID: \"b190faa2-d49d-424d-90bc-3e6e34d1b362\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-2" Mar 16 16:25:34 crc kubenswrapper[5120]: I0316 16:25:34.905783 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/e1bf7ad2-f215-405b-84de-9429f90855f8-plugins-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"e1bf7ad2-f215-405b-84de-9429f90855f8\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:25:34 crc kubenswrapper[5120]: I0316 16:25:34.905842 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/dbe6904f-2249-41c3-bb8a-a1b5817094c5-rabbitmq-confd\") pod \"rabbitmq-cell1-server-1\" (UID: \"dbe6904f-2249-41c3-bb8a-a1b5817094c5\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-1" Mar 16 16:25:34 crc kubenswrapper[5120]: I0316 16:25:34.905958 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/dbe6904f-2249-41c3-bb8a-a1b5817094c5-rabbitmq-erlang-cookie\") pod \"rabbitmq-cell1-server-1\" (UID: \"dbe6904f-2249-41c3-bb8a-a1b5817094c5\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-1" Mar 16 16:25:34 crc kubenswrapper[5120]: I0316 16:25:34.905976 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage18-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"e1bf7ad2-f215-405b-84de-9429f90855f8\") device mount path \"/mnt/openstack/pv18\"" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:25:34 crc kubenswrapper[5120]: I0316 16:25:34.905983 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") pod \"rabbitmq-cell1-server-2\" (UID: \"b190faa2-d49d-424d-90bc-3e6e34d1b362\") device mount path \"/mnt/openstack/pv14\"" pod="openstack-kuttl-tests/rabbitmq-cell1-server-2" Mar 16 16:25:34 crc kubenswrapper[5120]: I0316 16:25:34.906008 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage15-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage15-crc\") pod \"rabbitmq-cell1-server-1\" (UID: \"dbe6904f-2249-41c3-bb8a-a1b5817094c5\") device mount path \"/mnt/openstack/pv15\"" pod="openstack-kuttl-tests/rabbitmq-cell1-server-1" Mar 16 16:25:34 crc kubenswrapper[5120]: I0316 16:25:34.906062 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/dbe6904f-2249-41c3-bb8a-a1b5817094c5-erlang-cookie-secret\") pod \"rabbitmq-cell1-server-1\" (UID: \"dbe6904f-2249-41c3-bb8a-a1b5817094c5\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-1" Mar 16 16:25:34 crc kubenswrapper[5120]: I0316 16:25:34.906086 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/b190faa2-d49d-424d-90bc-3e6e34d1b362-config-data\") pod \"rabbitmq-cell1-server-2\" (UID: \"b190faa2-d49d-424d-90bc-3e6e34d1b362\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-2" Mar 16 16:25:34 crc kubenswrapper[5120]: I0316 16:25:34.906113 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/b190faa2-d49d-424d-90bc-3e6e34d1b362-rabbitmq-confd\") pod \"rabbitmq-cell1-server-2\" (UID: \"b190faa2-d49d-424d-90bc-3e6e34d1b362\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-2" Mar 16 16:25:34 crc kubenswrapper[5120]: I0316 16:25:34.906137 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/e1bf7ad2-f215-405b-84de-9429f90855f8-server-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"e1bf7ad2-f215-405b-84de-9429f90855f8\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:25:34 crc kubenswrapper[5120]: I0316 16:25:34.906154 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/dbe6904f-2249-41c3-bb8a-a1b5817094c5-rabbitmq-tls\") pod \"rabbitmq-cell1-server-1\" (UID: \"dbe6904f-2249-41c3-bb8a-a1b5817094c5\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-1" Mar 16 16:25:34 crc kubenswrapper[5120]: I0316 16:25:34.906172 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/e1bf7ad2-f215-405b-84de-9429f90855f8-rabbitmq-tls\") pod \"rabbitmq-cell1-server-0\" (UID: \"e1bf7ad2-f215-405b-84de-9429f90855f8\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:25:34 crc kubenswrapper[5120]: I0316 16:25:34.906204 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/dbe6904f-2249-41c3-bb8a-a1b5817094c5-plugins-conf\") pod \"rabbitmq-cell1-server-1\" (UID: \"dbe6904f-2249-41c3-bb8a-a1b5817094c5\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-1" Mar 16 16:25:34 crc kubenswrapper[5120]: I0316 16:25:34.906253 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/b190faa2-d49d-424d-90bc-3e6e34d1b362-rabbitmq-erlang-cookie\") pod \"rabbitmq-cell1-server-2\" (UID: \"b190faa2-d49d-424d-90bc-3e6e34d1b362\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-2" Mar 16 16:25:34 crc kubenswrapper[5120]: I0316 16:25:34.906273 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/dbe6904f-2249-41c3-bb8a-a1b5817094c5-rabbitmq-plugins\") pod \"rabbitmq-cell1-server-1\" (UID: \"dbe6904f-2249-41c3-bb8a-a1b5817094c5\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-1" Mar 16 16:25:34 crc kubenswrapper[5120]: I0316 16:25:34.906292 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/e1bf7ad2-f215-405b-84de-9429f90855f8-rabbitmq-plugins\") pod \"rabbitmq-cell1-server-0\" (UID: \"e1bf7ad2-f215-405b-84de-9429f90855f8\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:25:34 crc kubenswrapper[5120]: I0316 16:25:34.906312 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/b190faa2-d49d-424d-90bc-3e6e34d1b362-rabbitmq-tls\") pod \"rabbitmq-cell1-server-2\" (UID: \"b190faa2-d49d-424d-90bc-3e6e34d1b362\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-2" Mar 16 16:25:34 crc kubenswrapper[5120]: I0316 16:25:34.906329 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/e1bf7ad2-f215-405b-84de-9429f90855f8-pod-info\") pod \"rabbitmq-cell1-server-0\" (UID: \"e1bf7ad2-f215-405b-84de-9429f90855f8\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:25:34 crc kubenswrapper[5120]: I0316 16:25:34.906374 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/e1bf7ad2-f215-405b-84de-9429f90855f8-rabbitmq-erlang-cookie\") pod \"rabbitmq-cell1-server-0\" (UID: \"e1bf7ad2-f215-405b-84de-9429f90855f8\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:25:34 crc kubenswrapper[5120]: I0316 16:25:34.906393 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/dbe6904f-2249-41c3-bb8a-a1b5817094c5-server-conf\") pod \"rabbitmq-cell1-server-1\" (UID: \"dbe6904f-2249-41c3-bb8a-a1b5817094c5\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-1" Mar 16 16:25:34 crc kubenswrapper[5120]: I0316 16:25:34.906424 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/b190faa2-d49d-424d-90bc-3e6e34d1b362-erlang-cookie-secret\") pod \"rabbitmq-cell1-server-2\" (UID: \"b190faa2-d49d-424d-90bc-3e6e34d1b362\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-2" Mar 16 16:25:34 crc kubenswrapper[5120]: I0316 16:25:34.906425 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/dbe6904f-2249-41c3-bb8a-a1b5817094c5-rabbitmq-erlang-cookie\") pod \"rabbitmq-cell1-server-1\" (UID: \"dbe6904f-2249-41c3-bb8a-a1b5817094c5\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-1" Mar 16 16:25:34 crc kubenswrapper[5120]: I0316 16:25:34.906442 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/b190faa2-d49d-424d-90bc-3e6e34d1b362-pod-info\") pod \"rabbitmq-cell1-server-2\" (UID: \"b190faa2-d49d-424d-90bc-3e6e34d1b362\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-2" Mar 16 16:25:34 crc kubenswrapper[5120]: I0316 16:25:34.906476 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/dbe6904f-2249-41c3-bb8a-a1b5817094c5-pod-info\") pod \"rabbitmq-cell1-server-1\" (UID: \"dbe6904f-2249-41c3-bb8a-a1b5817094c5\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-1" Mar 16 16:25:34 crc kubenswrapper[5120]: I0316 16:25:34.906501 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rmbrs\" (UniqueName: \"kubernetes.io/projected/dbe6904f-2249-41c3-bb8a-a1b5817094c5-kube-api-access-rmbrs\") pod \"rabbitmq-cell1-server-1\" (UID: \"dbe6904f-2249-41c3-bb8a-a1b5817094c5\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-1" Mar 16 16:25:34 crc kubenswrapper[5120]: I0316 16:25:34.906524 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/e1bf7ad2-f215-405b-84de-9429f90855f8-config-data\") pod \"rabbitmq-cell1-server-0\" (UID: \"e1bf7ad2-f215-405b-84de-9429f90855f8\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:25:34 crc kubenswrapper[5120]: I0316 16:25:34.906547 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/b190faa2-d49d-424d-90bc-3e6e34d1b362-rabbitmq-plugins\") pod \"rabbitmq-cell1-server-2\" (UID: \"b190faa2-d49d-424d-90bc-3e6e34d1b362\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-2" Mar 16 16:25:34 crc kubenswrapper[5120]: I0316 16:25:34.906571 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/e1bf7ad2-f215-405b-84de-9429f90855f8-erlang-cookie-secret\") pod \"rabbitmq-cell1-server-0\" (UID: \"e1bf7ad2-f215-405b-84de-9429f90855f8\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:25:34 crc kubenswrapper[5120]: I0316 16:25:34.906605 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/b190faa2-d49d-424d-90bc-3e6e34d1b362-plugins-conf\") pod \"rabbitmq-cell1-server-2\" (UID: \"b190faa2-d49d-424d-90bc-3e6e34d1b362\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-2" Mar 16 16:25:34 crc kubenswrapper[5120]: I0316 16:25:34.906635 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/e1bf7ad2-f215-405b-84de-9429f90855f8-rabbitmq-confd\") pod \"rabbitmq-cell1-server-0\" (UID: \"e1bf7ad2-f215-405b-84de-9429f90855f8\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:25:34 crc kubenswrapper[5120]: I0316 16:25:34.906649 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/dbe6904f-2249-41c3-bb8a-a1b5817094c5-config-data\") pod \"rabbitmq-cell1-server-1\" (UID: \"dbe6904f-2249-41c3-bb8a-a1b5817094c5\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-1" Mar 16 16:25:34 crc kubenswrapper[5120]: I0316 16:25:34.906778 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/b190faa2-d49d-424d-90bc-3e6e34d1b362-rabbitmq-erlang-cookie\") pod \"rabbitmq-cell1-server-2\" (UID: \"b190faa2-d49d-424d-90bc-3e6e34d1b362\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-2" Mar 16 16:25:34 crc kubenswrapper[5120]: I0316 16:25:34.907007 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/e1bf7ad2-f215-405b-84de-9429f90855f8-plugins-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"e1bf7ad2-f215-405b-84de-9429f90855f8\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:25:34 crc kubenswrapper[5120]: I0316 16:25:34.907402 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/dbe6904f-2249-41c3-bb8a-a1b5817094c5-config-data\") pod \"rabbitmq-cell1-server-1\" (UID: \"dbe6904f-2249-41c3-bb8a-a1b5817094c5\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-1" Mar 16 16:25:34 crc kubenswrapper[5120]: I0316 16:25:34.908051 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/b190faa2-d49d-424d-90bc-3e6e34d1b362-rabbitmq-plugins\") pod \"rabbitmq-cell1-server-2\" (UID: \"b190faa2-d49d-424d-90bc-3e6e34d1b362\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-2" Mar 16 16:25:34 crc kubenswrapper[5120]: I0316 16:25:34.908814 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/b190faa2-d49d-424d-90bc-3e6e34d1b362-server-conf\") pod \"rabbitmq-cell1-server-2\" (UID: \"b190faa2-d49d-424d-90bc-3e6e34d1b362\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-2" Mar 16 16:25:34 crc kubenswrapper[5120]: I0316 16:25:34.908922 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/e1bf7ad2-f215-405b-84de-9429f90855f8-config-data\") pod \"rabbitmq-cell1-server-0\" (UID: \"e1bf7ad2-f215-405b-84de-9429f90855f8\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:25:34 crc kubenswrapper[5120]: I0316 16:25:34.909454 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/b190faa2-d49d-424d-90bc-3e6e34d1b362-plugins-conf\") pod \"rabbitmq-cell1-server-2\" (UID: \"b190faa2-d49d-424d-90bc-3e6e34d1b362\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-2" Mar 16 16:25:34 crc kubenswrapper[5120]: I0316 16:25:34.909818 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/e1bf7ad2-f215-405b-84de-9429f90855f8-server-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"e1bf7ad2-f215-405b-84de-9429f90855f8\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:25:34 crc kubenswrapper[5120]: I0316 16:25:34.910742 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/b190faa2-d49d-424d-90bc-3e6e34d1b362-config-data\") pod \"rabbitmq-cell1-server-2\" (UID: \"b190faa2-d49d-424d-90bc-3e6e34d1b362\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-2" Mar 16 16:25:34 crc kubenswrapper[5120]: I0316 16:25:34.912756 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/dbe6904f-2249-41c3-bb8a-a1b5817094c5-plugins-conf\") pod \"rabbitmq-cell1-server-1\" (UID: \"dbe6904f-2249-41c3-bb8a-a1b5817094c5\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-1" Mar 16 16:25:34 crc kubenswrapper[5120]: I0316 16:25:34.915288 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/dbe6904f-2249-41c3-bb8a-a1b5817094c5-rabbitmq-confd\") pod \"rabbitmq-cell1-server-1\" (UID: \"dbe6904f-2249-41c3-bb8a-a1b5817094c5\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-1" Mar 16 16:25:34 crc kubenswrapper[5120]: I0316 16:25:34.915288 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/e1bf7ad2-f215-405b-84de-9429f90855f8-rabbitmq-confd\") pod \"rabbitmq-cell1-server-0\" (UID: \"e1bf7ad2-f215-405b-84de-9429f90855f8\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:25:34 crc kubenswrapper[5120]: I0316 16:25:34.915568 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/e1bf7ad2-f215-405b-84de-9429f90855f8-rabbitmq-plugins\") pod \"rabbitmq-cell1-server-0\" (UID: \"e1bf7ad2-f215-405b-84de-9429f90855f8\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:25:34 crc kubenswrapper[5120]: I0316 16:25:34.915813 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/dbe6904f-2249-41c3-bb8a-a1b5817094c5-rabbitmq-plugins\") pod \"rabbitmq-cell1-server-1\" (UID: \"dbe6904f-2249-41c3-bb8a-a1b5817094c5\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-1" Mar 16 16:25:34 crc kubenswrapper[5120]: I0316 16:25:34.916192 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/dbe6904f-2249-41c3-bb8a-a1b5817094c5-server-conf\") pod \"rabbitmq-cell1-server-1\" (UID: \"dbe6904f-2249-41c3-bb8a-a1b5817094c5\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-1" Mar 16 16:25:34 crc kubenswrapper[5120]: I0316 16:25:34.916449 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/e1bf7ad2-f215-405b-84de-9429f90855f8-rabbitmq-erlang-cookie\") pod \"rabbitmq-cell1-server-0\" (UID: \"e1bf7ad2-f215-405b-84de-9429f90855f8\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:25:34 crc kubenswrapper[5120]: I0316 16:25:34.917707 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/b190faa2-d49d-424d-90bc-3e6e34d1b362-rabbitmq-confd\") pod \"rabbitmq-cell1-server-2\" (UID: \"b190faa2-d49d-424d-90bc-3e6e34d1b362\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-2" Mar 16 16:25:34 crc kubenswrapper[5120]: I0316 16:25:34.918846 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/e1bf7ad2-f215-405b-84de-9429f90855f8-rabbitmq-tls\") pod \"rabbitmq-cell1-server-0\" (UID: \"e1bf7ad2-f215-405b-84de-9429f90855f8\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:25:34 crc kubenswrapper[5120]: I0316 16:25:34.920136 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/e1bf7ad2-f215-405b-84de-9429f90855f8-pod-info\") pod \"rabbitmq-cell1-server-0\" (UID: \"e1bf7ad2-f215-405b-84de-9429f90855f8\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:25:34 crc kubenswrapper[5120]: I0316 16:25:34.920801 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/dbe6904f-2249-41c3-bb8a-a1b5817094c5-pod-info\") pod \"rabbitmq-cell1-server-1\" (UID: \"dbe6904f-2249-41c3-bb8a-a1b5817094c5\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-1" Mar 16 16:25:34 crc kubenswrapper[5120]: I0316 16:25:34.921170 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/b190faa2-d49d-424d-90bc-3e6e34d1b362-erlang-cookie-secret\") pod \"rabbitmq-cell1-server-2\" (UID: \"b190faa2-d49d-424d-90bc-3e6e34d1b362\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-2" Mar 16 16:25:34 crc kubenswrapper[5120]: I0316 16:25:34.925225 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/dbe6904f-2249-41c3-bb8a-a1b5817094c5-erlang-cookie-secret\") pod \"rabbitmq-cell1-server-1\" (UID: \"dbe6904f-2249-41c3-bb8a-a1b5817094c5\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-1" Mar 16 16:25:34 crc kubenswrapper[5120]: I0316 16:25:34.933670 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/b190faa2-d49d-424d-90bc-3e6e34d1b362-pod-info\") pod \"rabbitmq-cell1-server-2\" (UID: \"b190faa2-d49d-424d-90bc-3e6e34d1b362\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-2" Mar 16 16:25:34 crc kubenswrapper[5120]: I0316 16:25:34.935128 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/b190faa2-d49d-424d-90bc-3e6e34d1b362-rabbitmq-tls\") pod \"rabbitmq-cell1-server-2\" (UID: \"b190faa2-d49d-424d-90bc-3e6e34d1b362\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-2" Mar 16 16:25:34 crc kubenswrapper[5120]: I0316 16:25:34.935314 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/e1bf7ad2-f215-405b-84de-9429f90855f8-erlang-cookie-secret\") pod \"rabbitmq-cell1-server-0\" (UID: \"e1bf7ad2-f215-405b-84de-9429f90855f8\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:25:34 crc kubenswrapper[5120]: I0316 16:25:34.938586 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/dbe6904f-2249-41c3-bb8a-a1b5817094c5-rabbitmq-tls\") pod \"rabbitmq-cell1-server-1\" (UID: \"dbe6904f-2249-41c3-bb8a-a1b5817094c5\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-1" Mar 16 16:25:34 crc kubenswrapper[5120]: I0316 16:25:34.948161 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqwtd\" (UniqueName: \"kubernetes.io/projected/e1bf7ad2-f215-405b-84de-9429f90855f8-kube-api-access-zqwtd\") pod \"rabbitmq-cell1-server-0\" (UID: \"e1bf7ad2-f215-405b-84de-9429f90855f8\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:25:34 crc kubenswrapper[5120]: I0316 16:25:34.950176 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmbrs\" (UniqueName: \"kubernetes.io/projected/dbe6904f-2249-41c3-bb8a-a1b5817094c5-kube-api-access-rmbrs\") pod \"rabbitmq-cell1-server-1\" (UID: \"dbe6904f-2249-41c3-bb8a-a1b5817094c5\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-1" Mar 16 16:25:34 crc kubenswrapper[5120]: I0316 16:25:34.951537 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zh7x4\" (UniqueName: \"kubernetes.io/projected/b190faa2-d49d-424d-90bc-3e6e34d1b362-kube-api-access-zh7x4\") pod \"rabbitmq-cell1-server-2\" (UID: \"b190faa2-d49d-424d-90bc-3e6e34d1b362\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-2" Mar 16 16:25:34 crc kubenswrapper[5120]: I0316 16:25:34.966830 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage18-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"e1bf7ad2-f215-405b-84de-9429f90855f8\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:25:34 crc kubenswrapper[5120]: I0316 16:25:34.969652 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") pod \"rabbitmq-cell1-server-2\" (UID: \"b190faa2-d49d-424d-90bc-3e6e34d1b362\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-2" Mar 16 16:25:34 crc kubenswrapper[5120]: I0316 16:25:34.971075 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:25:34 crc kubenswrapper[5120]: I0316 16:25:34.984348 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-2" Mar 16 16:25:35 crc kubenswrapper[5120]: I0316 16:25:35.003539 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage15-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage15-crc\") pod \"rabbitmq-cell1-server-1\" (UID: \"dbe6904f-2249-41c3-bb8a-a1b5817094c5\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-1" Mar 16 16:25:35 crc kubenswrapper[5120]: I0316 16:25:35.041434 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-1" Mar 16 16:25:35 crc kubenswrapper[5120]: I0316 16:25:35.419092 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 16:25:35 crc kubenswrapper[5120]: I0316 16:25:35.483467 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-2"] Mar 16 16:25:35 crc kubenswrapper[5120]: I0316 16:25:35.544175 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-1"] Mar 16 16:25:35 crc kubenswrapper[5120]: W0316 16:25:35.566090 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbe6904f_2249_41c3_bb8a_a1b5817094c5.slice/crio-ec044ec59b9dedccde49d5f70a88cbcb9fc06cd0fcd8d9445fcbe5ae63492a94 WatchSource:0}: Error finding container ec044ec59b9dedccde49d5f70a88cbcb9fc06cd0fcd8d9445fcbe5ae63492a94: Status 404 returned error can't find the container with id ec044ec59b9dedccde49d5f70a88cbcb9fc06cd0fcd8d9445fcbe5ae63492a94 Mar 16 16:25:35 crc kubenswrapper[5120]: I0316 16:25:35.645746 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"e1bf7ad2-f215-405b-84de-9429f90855f8","Type":"ContainerStarted","Data":"a9d05618fbce15826083714aac41f723c91770f65de5728e24c0c0da9ba83696"} Mar 16 16:25:35 crc kubenswrapper[5120]: I0316 16:25:35.649646 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-1" event={"ID":"dbe6904f-2249-41c3-bb8a-a1b5817094c5","Type":"ContainerStarted","Data":"ec044ec59b9dedccde49d5f70a88cbcb9fc06cd0fcd8d9445fcbe5ae63492a94"} Mar 16 16:25:35 crc kubenswrapper[5120]: I0316 16:25:35.651804 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-2" event={"ID":"b190faa2-d49d-424d-90bc-3e6e34d1b362","Type":"ContainerStarted","Data":"dbb0c318ea1574974ea3784782543c9b3a04a58b19c5a3183ea2c20e3adf60f6"} Mar 16 16:25:35 crc kubenswrapper[5120]: I0316 16:25:35.888905 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 16:25:35 crc kubenswrapper[5120]: I0316 16:25:35.896237 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:25:35 crc kubenswrapper[5120]: I0316 16:25:35.901072 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-rabbitmq-svc\"" Mar 16 16:25:35 crc kubenswrapper[5120]: I0316 16:25:35.901170 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-plugins-conf\"" Mar 16 16:25:35 crc kubenswrapper[5120]: I0316 16:25:35.901205 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-erlang-cookie\"" Mar 16 16:25:35 crc kubenswrapper[5120]: I0316 16:25:35.901263 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-config-data\"" Mar 16 16:25:35 crc kubenswrapper[5120]: I0316 16:25:35.901268 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-default-user\"" Mar 16 16:25:35 crc kubenswrapper[5120]: I0316 16:25:35.901618 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-server-dockercfg-gbsr6\"" Mar 16 16:25:35 crc kubenswrapper[5120]: I0316 16:25:35.902820 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-server-conf\"" Mar 16 16:25:35 crc kubenswrapper[5120]: I0316 16:25:35.915750 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-2"] Mar 16 16:25:35 crc kubenswrapper[5120]: I0316 16:25:35.922188 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-2" Mar 16 16:25:35 crc kubenswrapper[5120]: I0316 16:25:35.928886 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-1"] Mar 16 16:25:35 crc kubenswrapper[5120]: I0316 16:25:35.944045 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-1" Mar 16 16:25:35 crc kubenswrapper[5120]: I0316 16:25:35.953289 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 16:25:35 crc kubenswrapper[5120]: I0316 16:25:35.967367 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-1"] Mar 16 16:25:35 crc kubenswrapper[5120]: I0316 16:25:35.990837 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-2"] Mar 16 16:25:36 crc kubenswrapper[5120]: I0316 16:25:36.030336 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/9ab03e09-ed0f-4675-82c7-e04f1c3937ce-rabbitmq-tls\") pod \"rabbitmq-server-2\" (UID: \"9ab03e09-ed0f-4675-82c7-e04f1c3937ce\") " pod="openstack-kuttl-tests/rabbitmq-server-2" Mar 16 16:25:36 crc kubenswrapper[5120]: I0316 16:25:36.030413 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/a8e524d7-0cb0-4bec-9948-70d463625805-rabbitmq-confd\") pod \"rabbitmq-server-1\" (UID: \"a8e524d7-0cb0-4bec-9948-70d463625805\") " pod="openstack-kuttl-tests/rabbitmq-server-1" Mar 16 16:25:36 crc kubenswrapper[5120]: I0316 16:25:36.030472 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/4df637ef-8f2d-4eb1-8a51-327814195dbf-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"4df637ef-8f2d-4eb1-8a51-327814195dbf\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:25:36 crc kubenswrapper[5120]: I0316 16:25:36.030644 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/4df637ef-8f2d-4eb1-8a51-327814195dbf-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"4df637ef-8f2d-4eb1-8a51-327814195dbf\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:25:36 crc kubenswrapper[5120]: I0316 16:25:36.030716 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/a8e524d7-0cb0-4bec-9948-70d463625805-plugins-conf\") pod \"rabbitmq-server-1\" (UID: \"a8e524d7-0cb0-4bec-9948-70d463625805\") " pod="openstack-kuttl-tests/rabbitmq-server-1" Mar 16 16:25:36 crc kubenswrapper[5120]: I0316 16:25:36.030781 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/9ab03e09-ed0f-4675-82c7-e04f1c3937ce-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-2\" (UID: \"9ab03e09-ed0f-4675-82c7-e04f1c3937ce\") " pod="openstack-kuttl-tests/rabbitmq-server-2" Mar 16 16:25:36 crc kubenswrapper[5120]: I0316 16:25:36.030814 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/9ab03e09-ed0f-4675-82c7-e04f1c3937ce-rabbitmq-confd\") pod \"rabbitmq-server-2\" (UID: \"9ab03e09-ed0f-4675-82c7-e04f1c3937ce\") " pod="openstack-kuttl-tests/rabbitmq-server-2" Mar 16 16:25:36 crc kubenswrapper[5120]: I0316 16:25:36.030836 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/4df637ef-8f2d-4eb1-8a51-327814195dbf-config-data\") pod \"rabbitmq-server-0\" (UID: \"4df637ef-8f2d-4eb1-8a51-327814195dbf\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:25:36 crc kubenswrapper[5120]: I0316 16:25:36.030924 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8pzc\" (UniqueName: \"kubernetes.io/projected/9ab03e09-ed0f-4675-82c7-e04f1c3937ce-kube-api-access-p8pzc\") pod \"rabbitmq-server-2\" (UID: \"9ab03e09-ed0f-4675-82c7-e04f1c3937ce\") " pod="openstack-kuttl-tests/rabbitmq-server-2" Mar 16 16:25:36 crc kubenswrapper[5120]: I0316 16:25:36.030980 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"rabbitmq-server-0\" (UID: \"4df637ef-8f2d-4eb1-8a51-327814195dbf\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:25:36 crc kubenswrapper[5120]: I0316 16:25:36.031010 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/a8e524d7-0cb0-4bec-9948-70d463625805-pod-info\") pod \"rabbitmq-server-1\" (UID: \"a8e524d7-0cb0-4bec-9948-70d463625805\") " pod="openstack-kuttl-tests/rabbitmq-server-1" Mar 16 16:25:36 crc kubenswrapper[5120]: I0316 16:25:36.031051 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"rabbitmq-server-2\" (UID: \"9ab03e09-ed0f-4675-82c7-e04f1c3937ce\") " pod="openstack-kuttl-tests/rabbitmq-server-2" Mar 16 16:25:36 crc kubenswrapper[5120]: I0316 16:25:36.031097 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/9ab03e09-ed0f-4675-82c7-e04f1c3937ce-pod-info\") pod \"rabbitmq-server-2\" (UID: \"9ab03e09-ed0f-4675-82c7-e04f1c3937ce\") " pod="openstack-kuttl-tests/rabbitmq-server-2" Mar 16 16:25:36 crc kubenswrapper[5120]: I0316 16:25:36.031214 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hr5gz\" (UniqueName: \"kubernetes.io/projected/4df637ef-8f2d-4eb1-8a51-327814195dbf-kube-api-access-hr5gz\") pod \"rabbitmq-server-0\" (UID: \"4df637ef-8f2d-4eb1-8a51-327814195dbf\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:25:36 crc kubenswrapper[5120]: I0316 16:25:36.031269 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/a8e524d7-0cb0-4bec-9948-70d463625805-server-conf\") pod \"rabbitmq-server-1\" (UID: \"a8e524d7-0cb0-4bec-9948-70d463625805\") " pod="openstack-kuttl-tests/rabbitmq-server-1" Mar 16 16:25:36 crc kubenswrapper[5120]: I0316 16:25:36.031331 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/4df637ef-8f2d-4eb1-8a51-327814195dbf-pod-info\") pod \"rabbitmq-server-0\" (UID: \"4df637ef-8f2d-4eb1-8a51-327814195dbf\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:25:36 crc kubenswrapper[5120]: I0316 16:25:36.031372 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/a8e524d7-0cb0-4bec-9948-70d463625805-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-1\" (UID: \"a8e524d7-0cb0-4bec-9948-70d463625805\") " pod="openstack-kuttl-tests/rabbitmq-server-1" Mar 16 16:25:36 crc kubenswrapper[5120]: I0316 16:25:36.031406 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"rabbitmq-server-1\" (UID: \"a8e524d7-0cb0-4bec-9948-70d463625805\") " pod="openstack-kuttl-tests/rabbitmq-server-1" Mar 16 16:25:36 crc kubenswrapper[5120]: I0316 16:25:36.031683 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/4df637ef-8f2d-4eb1-8a51-327814195dbf-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"4df637ef-8f2d-4eb1-8a51-327814195dbf\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:25:36 crc kubenswrapper[5120]: I0316 16:25:36.031727 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/9ab03e09-ed0f-4675-82c7-e04f1c3937ce-config-data\") pod \"rabbitmq-server-2\" (UID: \"9ab03e09-ed0f-4675-82c7-e04f1c3937ce\") " pod="openstack-kuttl-tests/rabbitmq-server-2" Mar 16 16:25:36 crc kubenswrapper[5120]: I0316 16:25:36.031874 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/9ab03e09-ed0f-4675-82c7-e04f1c3937ce-erlang-cookie-secret\") pod \"rabbitmq-server-2\" (UID: \"9ab03e09-ed0f-4675-82c7-e04f1c3937ce\") " pod="openstack-kuttl-tests/rabbitmq-server-2" Mar 16 16:25:36 crc kubenswrapper[5120]: I0316 16:25:36.031914 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/9ab03e09-ed0f-4675-82c7-e04f1c3937ce-rabbitmq-plugins\") pod \"rabbitmq-server-2\" (UID: \"9ab03e09-ed0f-4675-82c7-e04f1c3937ce\") " pod="openstack-kuttl-tests/rabbitmq-server-2" Mar 16 16:25:36 crc kubenswrapper[5120]: I0316 16:25:36.031935 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/9ab03e09-ed0f-4675-82c7-e04f1c3937ce-server-conf\") pod \"rabbitmq-server-2\" (UID: \"9ab03e09-ed0f-4675-82c7-e04f1c3937ce\") " pod="openstack-kuttl-tests/rabbitmq-server-2" Mar 16 16:25:36 crc kubenswrapper[5120]: I0316 16:25:36.031957 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/4df637ef-8f2d-4eb1-8a51-327814195dbf-rabbitmq-tls\") pod \"rabbitmq-server-0\" (UID: \"4df637ef-8f2d-4eb1-8a51-327814195dbf\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:25:36 crc kubenswrapper[5120]: I0316 16:25:36.031990 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/4df637ef-8f2d-4eb1-8a51-327814195dbf-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"4df637ef-8f2d-4eb1-8a51-327814195dbf\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:25:36 crc kubenswrapper[5120]: I0316 16:25:36.032012 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/a8e524d7-0cb0-4bec-9948-70d463625805-rabbitmq-tls\") pod \"rabbitmq-server-1\" (UID: \"a8e524d7-0cb0-4bec-9948-70d463625805\") " pod="openstack-kuttl-tests/rabbitmq-server-1" Mar 16 16:25:36 crc kubenswrapper[5120]: I0316 16:25:36.032031 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/4df637ef-8f2d-4eb1-8a51-327814195dbf-server-conf\") pod \"rabbitmq-server-0\" (UID: \"4df637ef-8f2d-4eb1-8a51-327814195dbf\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:25:36 crc kubenswrapper[5120]: I0316 16:25:36.032061 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/4df637ef-8f2d-4eb1-8a51-327814195dbf-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"4df637ef-8f2d-4eb1-8a51-327814195dbf\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:25:36 crc kubenswrapper[5120]: I0316 16:25:36.032084 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/a8e524d7-0cb0-4bec-9948-70d463625805-rabbitmq-plugins\") pod \"rabbitmq-server-1\" (UID: \"a8e524d7-0cb0-4bec-9948-70d463625805\") " pod="openstack-kuttl-tests/rabbitmq-server-1" Mar 16 16:25:36 crc kubenswrapper[5120]: I0316 16:25:36.032106 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/a8e524d7-0cb0-4bec-9948-70d463625805-config-data\") pod \"rabbitmq-server-1\" (UID: \"a8e524d7-0cb0-4bec-9948-70d463625805\") " pod="openstack-kuttl-tests/rabbitmq-server-1" Mar 16 16:25:36 crc kubenswrapper[5120]: I0316 16:25:36.032140 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8bdx7\" (UniqueName: \"kubernetes.io/projected/a8e524d7-0cb0-4bec-9948-70d463625805-kube-api-access-8bdx7\") pod \"rabbitmq-server-1\" (UID: \"a8e524d7-0cb0-4bec-9948-70d463625805\") " pod="openstack-kuttl-tests/rabbitmq-server-1" Mar 16 16:25:36 crc kubenswrapper[5120]: I0316 16:25:36.032187 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/9ab03e09-ed0f-4675-82c7-e04f1c3937ce-plugins-conf\") pod \"rabbitmq-server-2\" (UID: \"9ab03e09-ed0f-4675-82c7-e04f1c3937ce\") " pod="openstack-kuttl-tests/rabbitmq-server-2" Mar 16 16:25:36 crc kubenswrapper[5120]: I0316 16:25:36.032212 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/a8e524d7-0cb0-4bec-9948-70d463625805-erlang-cookie-secret\") pod \"rabbitmq-server-1\" (UID: \"a8e524d7-0cb0-4bec-9948-70d463625805\") " pod="openstack-kuttl-tests/rabbitmq-server-1" Mar 16 16:25:36 crc kubenswrapper[5120]: I0316 16:25:36.133990 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/4df637ef-8f2d-4eb1-8a51-327814195dbf-rabbitmq-tls\") pod \"rabbitmq-server-0\" (UID: \"4df637ef-8f2d-4eb1-8a51-327814195dbf\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:25:36 crc kubenswrapper[5120]: I0316 16:25:36.134044 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/4df637ef-8f2d-4eb1-8a51-327814195dbf-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"4df637ef-8f2d-4eb1-8a51-327814195dbf\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:25:36 crc kubenswrapper[5120]: I0316 16:25:36.134074 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/a8e524d7-0cb0-4bec-9948-70d463625805-rabbitmq-tls\") pod \"rabbitmq-server-1\" (UID: \"a8e524d7-0cb0-4bec-9948-70d463625805\") " pod="openstack-kuttl-tests/rabbitmq-server-1" Mar 16 16:25:36 crc kubenswrapper[5120]: I0316 16:25:36.134096 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/4df637ef-8f2d-4eb1-8a51-327814195dbf-server-conf\") pod \"rabbitmq-server-0\" (UID: \"4df637ef-8f2d-4eb1-8a51-327814195dbf\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:25:36 crc kubenswrapper[5120]: I0316 16:25:36.134667 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/4df637ef-8f2d-4eb1-8a51-327814195dbf-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"4df637ef-8f2d-4eb1-8a51-327814195dbf\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:25:36 crc kubenswrapper[5120]: I0316 16:25:36.134124 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/4df637ef-8f2d-4eb1-8a51-327814195dbf-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"4df637ef-8f2d-4eb1-8a51-327814195dbf\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:25:36 crc kubenswrapper[5120]: I0316 16:25:36.134910 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/a8e524d7-0cb0-4bec-9948-70d463625805-rabbitmq-plugins\") pod \"rabbitmq-server-1\" (UID: \"a8e524d7-0cb0-4bec-9948-70d463625805\") " pod="openstack-kuttl-tests/rabbitmq-server-1" Mar 16 16:25:36 crc kubenswrapper[5120]: I0316 16:25:36.134932 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/a8e524d7-0cb0-4bec-9948-70d463625805-config-data\") pod \"rabbitmq-server-1\" (UID: \"a8e524d7-0cb0-4bec-9948-70d463625805\") " pod="openstack-kuttl-tests/rabbitmq-server-1" Mar 16 16:25:36 crc kubenswrapper[5120]: I0316 16:25:36.134962 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8bdx7\" (UniqueName: \"kubernetes.io/projected/a8e524d7-0cb0-4bec-9948-70d463625805-kube-api-access-8bdx7\") pod \"rabbitmq-server-1\" (UID: \"a8e524d7-0cb0-4bec-9948-70d463625805\") " pod="openstack-kuttl-tests/rabbitmq-server-1" Mar 16 16:25:36 crc kubenswrapper[5120]: I0316 16:25:36.135006 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/9ab03e09-ed0f-4675-82c7-e04f1c3937ce-plugins-conf\") pod \"rabbitmq-server-2\" (UID: \"9ab03e09-ed0f-4675-82c7-e04f1c3937ce\") " pod="openstack-kuttl-tests/rabbitmq-server-2" Mar 16 16:25:36 crc kubenswrapper[5120]: I0316 16:25:36.135029 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/a8e524d7-0cb0-4bec-9948-70d463625805-erlang-cookie-secret\") pod \"rabbitmq-server-1\" (UID: \"a8e524d7-0cb0-4bec-9948-70d463625805\") " pod="openstack-kuttl-tests/rabbitmq-server-1" Mar 16 16:25:36 crc kubenswrapper[5120]: I0316 16:25:36.135057 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/9ab03e09-ed0f-4675-82c7-e04f1c3937ce-rabbitmq-tls\") pod \"rabbitmq-server-2\" (UID: \"9ab03e09-ed0f-4675-82c7-e04f1c3937ce\") " pod="openstack-kuttl-tests/rabbitmq-server-2" Mar 16 16:25:36 crc kubenswrapper[5120]: I0316 16:25:36.135075 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/a8e524d7-0cb0-4bec-9948-70d463625805-rabbitmq-confd\") pod \"rabbitmq-server-1\" (UID: \"a8e524d7-0cb0-4bec-9948-70d463625805\") " pod="openstack-kuttl-tests/rabbitmq-server-1" Mar 16 16:25:36 crc kubenswrapper[5120]: I0316 16:25:36.135103 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/4df637ef-8f2d-4eb1-8a51-327814195dbf-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"4df637ef-8f2d-4eb1-8a51-327814195dbf\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:25:36 crc kubenswrapper[5120]: I0316 16:25:36.135147 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/4df637ef-8f2d-4eb1-8a51-327814195dbf-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"4df637ef-8f2d-4eb1-8a51-327814195dbf\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:25:36 crc kubenswrapper[5120]: I0316 16:25:36.135173 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/a8e524d7-0cb0-4bec-9948-70d463625805-plugins-conf\") pod \"rabbitmq-server-1\" (UID: \"a8e524d7-0cb0-4bec-9948-70d463625805\") " pod="openstack-kuttl-tests/rabbitmq-server-1" Mar 16 16:25:36 crc kubenswrapper[5120]: I0316 16:25:36.135197 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/9ab03e09-ed0f-4675-82c7-e04f1c3937ce-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-2\" (UID: \"9ab03e09-ed0f-4675-82c7-e04f1c3937ce\") " pod="openstack-kuttl-tests/rabbitmq-server-2" Mar 16 16:25:36 crc kubenswrapper[5120]: I0316 16:25:36.135240 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/9ab03e09-ed0f-4675-82c7-e04f1c3937ce-rabbitmq-confd\") pod \"rabbitmq-server-2\" (UID: \"9ab03e09-ed0f-4675-82c7-e04f1c3937ce\") " pod="openstack-kuttl-tests/rabbitmq-server-2" Mar 16 16:25:36 crc kubenswrapper[5120]: I0316 16:25:36.135264 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/4df637ef-8f2d-4eb1-8a51-327814195dbf-config-data\") pod \"rabbitmq-server-0\" (UID: \"4df637ef-8f2d-4eb1-8a51-327814195dbf\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:25:36 crc kubenswrapper[5120]: I0316 16:25:36.135303 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p8pzc\" (UniqueName: \"kubernetes.io/projected/9ab03e09-ed0f-4675-82c7-e04f1c3937ce-kube-api-access-p8pzc\") pod \"rabbitmq-server-2\" (UID: \"9ab03e09-ed0f-4675-82c7-e04f1c3937ce\") " pod="openstack-kuttl-tests/rabbitmq-server-2" Mar 16 16:25:36 crc kubenswrapper[5120]: I0316 16:25:36.135344 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"rabbitmq-server-0\" (UID: \"4df637ef-8f2d-4eb1-8a51-327814195dbf\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:25:36 crc kubenswrapper[5120]: I0316 16:25:36.135366 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/a8e524d7-0cb0-4bec-9948-70d463625805-pod-info\") pod \"rabbitmq-server-1\" (UID: \"a8e524d7-0cb0-4bec-9948-70d463625805\") " pod="openstack-kuttl-tests/rabbitmq-server-1" Mar 16 16:25:36 crc kubenswrapper[5120]: I0316 16:25:36.135396 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"rabbitmq-server-2\" (UID: \"9ab03e09-ed0f-4675-82c7-e04f1c3937ce\") " pod="openstack-kuttl-tests/rabbitmq-server-2" Mar 16 16:25:36 crc kubenswrapper[5120]: I0316 16:25:36.135423 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/9ab03e09-ed0f-4675-82c7-e04f1c3937ce-pod-info\") pod \"rabbitmq-server-2\" (UID: \"9ab03e09-ed0f-4675-82c7-e04f1c3937ce\") " pod="openstack-kuttl-tests/rabbitmq-server-2" Mar 16 16:25:36 crc kubenswrapper[5120]: I0316 16:25:36.135479 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hr5gz\" (UniqueName: \"kubernetes.io/projected/4df637ef-8f2d-4eb1-8a51-327814195dbf-kube-api-access-hr5gz\") pod \"rabbitmq-server-0\" (UID: \"4df637ef-8f2d-4eb1-8a51-327814195dbf\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:25:36 crc kubenswrapper[5120]: I0316 16:25:36.135505 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/a8e524d7-0cb0-4bec-9948-70d463625805-server-conf\") pod \"rabbitmq-server-1\" (UID: \"a8e524d7-0cb0-4bec-9948-70d463625805\") " pod="openstack-kuttl-tests/rabbitmq-server-1" Mar 16 16:25:36 crc kubenswrapper[5120]: I0316 16:25:36.135537 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/4df637ef-8f2d-4eb1-8a51-327814195dbf-pod-info\") pod \"rabbitmq-server-0\" (UID: \"4df637ef-8f2d-4eb1-8a51-327814195dbf\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:25:36 crc kubenswrapper[5120]: I0316 16:25:36.135560 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/a8e524d7-0cb0-4bec-9948-70d463625805-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-1\" (UID: \"a8e524d7-0cb0-4bec-9948-70d463625805\") " pod="openstack-kuttl-tests/rabbitmq-server-1" Mar 16 16:25:36 crc kubenswrapper[5120]: I0316 16:25:36.135580 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"rabbitmq-server-1\" (UID: \"a8e524d7-0cb0-4bec-9948-70d463625805\") " pod="openstack-kuttl-tests/rabbitmq-server-1" Mar 16 16:25:36 crc kubenswrapper[5120]: I0316 16:25:36.135632 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/4df637ef-8f2d-4eb1-8a51-327814195dbf-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"4df637ef-8f2d-4eb1-8a51-327814195dbf\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:25:36 crc kubenswrapper[5120]: I0316 16:25:36.135653 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/9ab03e09-ed0f-4675-82c7-e04f1c3937ce-config-data\") pod \"rabbitmq-server-2\" (UID: \"9ab03e09-ed0f-4675-82c7-e04f1c3937ce\") " pod="openstack-kuttl-tests/rabbitmq-server-2" Mar 16 16:25:36 crc kubenswrapper[5120]: I0316 16:25:36.135681 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/9ab03e09-ed0f-4675-82c7-e04f1c3937ce-erlang-cookie-secret\") pod \"rabbitmq-server-2\" (UID: \"9ab03e09-ed0f-4675-82c7-e04f1c3937ce\") " pod="openstack-kuttl-tests/rabbitmq-server-2" Mar 16 16:25:36 crc kubenswrapper[5120]: I0316 16:25:36.135726 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/9ab03e09-ed0f-4675-82c7-e04f1c3937ce-rabbitmq-plugins\") pod \"rabbitmq-server-2\" (UID: \"9ab03e09-ed0f-4675-82c7-e04f1c3937ce\") " pod="openstack-kuttl-tests/rabbitmq-server-2" Mar 16 16:25:36 crc kubenswrapper[5120]: I0316 16:25:36.135744 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/9ab03e09-ed0f-4675-82c7-e04f1c3937ce-server-conf\") pod \"rabbitmq-server-2\" (UID: \"9ab03e09-ed0f-4675-82c7-e04f1c3937ce\") " pod="openstack-kuttl-tests/rabbitmq-server-2" Mar 16 16:25:36 crc kubenswrapper[5120]: I0316 16:25:36.136215 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/4df637ef-8f2d-4eb1-8a51-327814195dbf-server-conf\") pod \"rabbitmq-server-0\" (UID: \"4df637ef-8f2d-4eb1-8a51-327814195dbf\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:25:36 crc kubenswrapper[5120]: I0316 16:25:36.136273 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/a8e524d7-0cb0-4bec-9948-70d463625805-rabbitmq-plugins\") pod \"rabbitmq-server-1\" (UID: \"a8e524d7-0cb0-4bec-9948-70d463625805\") " pod="openstack-kuttl-tests/rabbitmq-server-1" Mar 16 16:25:36 crc kubenswrapper[5120]: I0316 16:25:36.136670 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/a8e524d7-0cb0-4bec-9948-70d463625805-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-1\" (UID: \"a8e524d7-0cb0-4bec-9948-70d463625805\") " pod="openstack-kuttl-tests/rabbitmq-server-1" Mar 16 16:25:36 crc kubenswrapper[5120]: I0316 16:25:36.136927 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"rabbitmq-server-2\" (UID: \"9ab03e09-ed0f-4675-82c7-e04f1c3937ce\") device mount path \"/mnt/openstack/pv06\"" pod="openstack-kuttl-tests/rabbitmq-server-2" Mar 16 16:25:36 crc kubenswrapper[5120]: I0316 16:25:36.136989 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/9ab03e09-ed0f-4675-82c7-e04f1c3937ce-plugins-conf\") pod \"rabbitmq-server-2\" (UID: \"9ab03e09-ed0f-4675-82c7-e04f1c3937ce\") " pod="openstack-kuttl-tests/rabbitmq-server-2" Mar 16 16:25:36 crc kubenswrapper[5120]: I0316 16:25:36.137316 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/a8e524d7-0cb0-4bec-9948-70d463625805-config-data\") pod \"rabbitmq-server-1\" (UID: \"a8e524d7-0cb0-4bec-9948-70d463625805\") " pod="openstack-kuttl-tests/rabbitmq-server-1" Mar 16 16:25:36 crc kubenswrapper[5120]: I0316 16:25:36.137976 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/9ab03e09-ed0f-4675-82c7-e04f1c3937ce-config-data\") pod \"rabbitmq-server-2\" (UID: \"9ab03e09-ed0f-4675-82c7-e04f1c3937ce\") " pod="openstack-kuttl-tests/rabbitmq-server-2" Mar 16 16:25:36 crc kubenswrapper[5120]: I0316 16:25:36.138115 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"rabbitmq-server-1\" (UID: \"a8e524d7-0cb0-4bec-9948-70d463625805\") device mount path \"/mnt/openstack/pv01\"" pod="openstack-kuttl-tests/rabbitmq-server-1" Mar 16 16:25:36 crc kubenswrapper[5120]: I0316 16:25:36.138570 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/9ab03e09-ed0f-4675-82c7-e04f1c3937ce-rabbitmq-plugins\") pod \"rabbitmq-server-2\" (UID: \"9ab03e09-ed0f-4675-82c7-e04f1c3937ce\") " pod="openstack-kuttl-tests/rabbitmq-server-2" Mar 16 16:25:36 crc kubenswrapper[5120]: I0316 16:25:36.139452 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/4df637ef-8f2d-4eb1-8a51-327814195dbf-rabbitmq-tls\") pod \"rabbitmq-server-0\" (UID: \"4df637ef-8f2d-4eb1-8a51-327814195dbf\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:25:36 crc kubenswrapper[5120]: I0316 16:25:36.140012 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/9ab03e09-ed0f-4675-82c7-e04f1c3937ce-server-conf\") pod \"rabbitmq-server-2\" (UID: \"9ab03e09-ed0f-4675-82c7-e04f1c3937ce\") " pod="openstack-kuttl-tests/rabbitmq-server-2" Mar 16 16:25:36 crc kubenswrapper[5120]: I0316 16:25:36.140308 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/a8e524d7-0cb0-4bec-9948-70d463625805-plugins-conf\") pod \"rabbitmq-server-1\" (UID: \"a8e524d7-0cb0-4bec-9948-70d463625805\") " pod="openstack-kuttl-tests/rabbitmq-server-1" Mar 16 16:25:36 crc kubenswrapper[5120]: I0316 16:25:36.140635 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/a8e524d7-0cb0-4bec-9948-70d463625805-server-conf\") pod \"rabbitmq-server-1\" (UID: \"a8e524d7-0cb0-4bec-9948-70d463625805\") " pod="openstack-kuttl-tests/rabbitmq-server-1" Mar 16 16:25:36 crc kubenswrapper[5120]: I0316 16:25:36.141369 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/4df637ef-8f2d-4eb1-8a51-327814195dbf-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"4df637ef-8f2d-4eb1-8a51-327814195dbf\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:25:36 crc kubenswrapper[5120]: I0316 16:25:36.145965 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/4df637ef-8f2d-4eb1-8a51-327814195dbf-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"4df637ef-8f2d-4eb1-8a51-327814195dbf\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:25:36 crc kubenswrapper[5120]: I0316 16:25:36.145978 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/9ab03e09-ed0f-4675-82c7-e04f1c3937ce-pod-info\") pod \"rabbitmq-server-2\" (UID: \"9ab03e09-ed0f-4675-82c7-e04f1c3937ce\") " pod="openstack-kuttl-tests/rabbitmq-server-2" Mar 16 16:25:36 crc kubenswrapper[5120]: I0316 16:25:36.146260 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/9ab03e09-ed0f-4675-82c7-e04f1c3937ce-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-2\" (UID: \"9ab03e09-ed0f-4675-82c7-e04f1c3937ce\") " pod="openstack-kuttl-tests/rabbitmq-server-2" Mar 16 16:25:36 crc kubenswrapper[5120]: I0316 16:25:36.146320 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"rabbitmq-server-0\" (UID: \"4df637ef-8f2d-4eb1-8a51-327814195dbf\") device mount path \"/mnt/openstack/pv08\"" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:25:36 crc kubenswrapper[5120]: I0316 16:25:36.154293 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/4df637ef-8f2d-4eb1-8a51-327814195dbf-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"4df637ef-8f2d-4eb1-8a51-327814195dbf\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:25:36 crc kubenswrapper[5120]: I0316 16:25:36.162634 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/9ab03e09-ed0f-4675-82c7-e04f1c3937ce-rabbitmq-tls\") pod \"rabbitmq-server-2\" (UID: \"9ab03e09-ed0f-4675-82c7-e04f1c3937ce\") " pod="openstack-kuttl-tests/rabbitmq-server-2" Mar 16 16:25:36 crc kubenswrapper[5120]: I0316 16:25:36.164696 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/a8e524d7-0cb0-4bec-9948-70d463625805-rabbitmq-confd\") pod \"rabbitmq-server-1\" (UID: \"a8e524d7-0cb0-4bec-9948-70d463625805\") " pod="openstack-kuttl-tests/rabbitmq-server-1" Mar 16 16:25:36 crc kubenswrapper[5120]: I0316 16:25:36.165074 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/9ab03e09-ed0f-4675-82c7-e04f1c3937ce-rabbitmq-confd\") pod \"rabbitmq-server-2\" (UID: \"9ab03e09-ed0f-4675-82c7-e04f1c3937ce\") " pod="openstack-kuttl-tests/rabbitmq-server-2" Mar 16 16:25:36 crc kubenswrapper[5120]: I0316 16:25:36.165240 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/4df637ef-8f2d-4eb1-8a51-327814195dbf-pod-info\") pod \"rabbitmq-server-0\" (UID: \"4df637ef-8f2d-4eb1-8a51-327814195dbf\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:25:36 crc kubenswrapper[5120]: I0316 16:25:36.165468 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/4df637ef-8f2d-4eb1-8a51-327814195dbf-config-data\") pod \"rabbitmq-server-0\" (UID: \"4df637ef-8f2d-4eb1-8a51-327814195dbf\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:25:36 crc kubenswrapper[5120]: I0316 16:25:36.166301 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hr5gz\" (UniqueName: \"kubernetes.io/projected/4df637ef-8f2d-4eb1-8a51-327814195dbf-kube-api-access-hr5gz\") pod \"rabbitmq-server-0\" (UID: \"4df637ef-8f2d-4eb1-8a51-327814195dbf\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:25:36 crc kubenswrapper[5120]: I0316 16:25:36.167592 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/a8e524d7-0cb0-4bec-9948-70d463625805-pod-info\") pod \"rabbitmq-server-1\" (UID: \"a8e524d7-0cb0-4bec-9948-70d463625805\") " pod="openstack-kuttl-tests/rabbitmq-server-1" Mar 16 16:25:36 crc kubenswrapper[5120]: I0316 16:25:36.168542 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8pzc\" (UniqueName: \"kubernetes.io/projected/9ab03e09-ed0f-4675-82c7-e04f1c3937ce-kube-api-access-p8pzc\") pod \"rabbitmq-server-2\" (UID: \"9ab03e09-ed0f-4675-82c7-e04f1c3937ce\") " pod="openstack-kuttl-tests/rabbitmq-server-2" Mar 16 16:25:36 crc kubenswrapper[5120]: I0316 16:25:36.372424 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/a8e524d7-0cb0-4bec-9948-70d463625805-rabbitmq-tls\") pod \"rabbitmq-server-1\" (UID: \"a8e524d7-0cb0-4bec-9948-70d463625805\") " pod="openstack-kuttl-tests/rabbitmq-server-1" Mar 16 16:25:36 crc kubenswrapper[5120]: I0316 16:25:36.389871 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8bdx7\" (UniqueName: \"kubernetes.io/projected/a8e524d7-0cb0-4bec-9948-70d463625805-kube-api-access-8bdx7\") pod \"rabbitmq-server-1\" (UID: \"a8e524d7-0cb0-4bec-9948-70d463625805\") " pod="openstack-kuttl-tests/rabbitmq-server-1" Mar 16 16:25:36 crc kubenswrapper[5120]: I0316 16:25:36.398523 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/a8e524d7-0cb0-4bec-9948-70d463625805-erlang-cookie-secret\") pod \"rabbitmq-server-1\" (UID: \"a8e524d7-0cb0-4bec-9948-70d463625805\") " pod="openstack-kuttl-tests/rabbitmq-server-1" Mar 16 16:25:36 crc kubenswrapper[5120]: I0316 16:25:36.406278 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/9ab03e09-ed0f-4675-82c7-e04f1c3937ce-erlang-cookie-secret\") pod \"rabbitmq-server-2\" (UID: \"9ab03e09-ed0f-4675-82c7-e04f1c3937ce\") " pod="openstack-kuttl-tests/rabbitmq-server-2" Mar 16 16:25:36 crc kubenswrapper[5120]: I0316 16:25:36.408195 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/4df637ef-8f2d-4eb1-8a51-327814195dbf-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"4df637ef-8f2d-4eb1-8a51-327814195dbf\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:25:36 crc kubenswrapper[5120]: I0316 16:25:36.442723 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"rabbitmq-server-1\" (UID: \"a8e524d7-0cb0-4bec-9948-70d463625805\") " pod="openstack-kuttl-tests/rabbitmq-server-1" Mar 16 16:25:36 crc kubenswrapper[5120]: I0316 16:25:36.519935 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"rabbitmq-server-2\" (UID: \"9ab03e09-ed0f-4675-82c7-e04f1c3937ce\") " pod="openstack-kuttl-tests/rabbitmq-server-2" Mar 16 16:25:36 crc kubenswrapper[5120]: I0316 16:25:36.593538 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-2" Mar 16 16:25:36 crc kubenswrapper[5120]: I0316 16:25:36.605227 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-1" Mar 16 16:25:36 crc kubenswrapper[5120]: I0316 16:25:36.709290 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"rabbitmq-server-0\" (UID: \"4df637ef-8f2d-4eb1-8a51-327814195dbf\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:25:36 crc kubenswrapper[5120]: I0316 16:25:36.871857 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:25:37 crc kubenswrapper[5120]: I0316 16:25:37.045556 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-1"] Mar 16 16:25:37 crc kubenswrapper[5120]: I0316 16:25:37.153131 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-2"] Mar 16 16:25:37 crc kubenswrapper[5120]: I0316 16:25:37.317324 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 16:25:37 crc kubenswrapper[5120]: W0316 16:25:37.332924 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4df637ef_8f2d_4eb1_8a51_327814195dbf.slice/crio-27c237fe0fc3d0964b92f1f742a70bdcf1a19e2e3c9f1cef12c7a35735ff9a46 WatchSource:0}: Error finding container 27c237fe0fc3d0964b92f1f742a70bdcf1a19e2e3c9f1cef12c7a35735ff9a46: Status 404 returned error can't find the container with id 27c237fe0fc3d0964b92f1f742a70bdcf1a19e2e3c9f1cef12c7a35735ff9a46 Mar 16 16:25:37 crc kubenswrapper[5120]: I0316 16:25:37.443384 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 16:25:37 crc kubenswrapper[5120]: I0316 16:25:37.453571 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:25:37 crc kubenswrapper[5120]: I0316 16:25:37.460415 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 16:25:37 crc kubenswrapper[5120]: I0316 16:25:37.462192 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"galera-openstack-dockercfg-nj44g\"" Mar 16 16:25:37 crc kubenswrapper[5120]: I0316 16:25:37.462453 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-config-data\"" Mar 16 16:25:37 crc kubenswrapper[5120]: I0316 16:25:37.462700 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-scripts\"" Mar 16 16:25:37 crc kubenswrapper[5120]: I0316 16:25:37.462914 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-galera-openstack-svc\"" Mar 16 16:25:37 crc kubenswrapper[5120]: I0316 16:25:37.468586 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"combined-ca-bundle\"" Mar 16 16:25:37 crc kubenswrapper[5120]: I0316 16:25:37.484213 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstack-galera-2"] Mar 16 16:25:37 crc kubenswrapper[5120]: I0316 16:25:37.488838 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/b2f689fd-70ec-43c9-b2da-275e28deb94c-config-data-default\") pod \"openstack-galera-0\" (UID: \"b2f689fd-70ec-43c9-b2da-275e28deb94c\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:25:37 crc kubenswrapper[5120]: I0316 16:25:37.488934 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/b2f689fd-70ec-43c9-b2da-275e28deb94c-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"b2f689fd-70ec-43c9-b2da-275e28deb94c\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:25:37 crc kubenswrapper[5120]: I0316 16:25:37.488983 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"openstack-galera-0\" (UID: \"b2f689fd-70ec-43c9-b2da-275e28deb94c\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:25:37 crc kubenswrapper[5120]: I0316 16:25:37.489019 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/b2f689fd-70ec-43c9-b2da-275e28deb94c-config-data-generated\") pod \"openstack-galera-0\" (UID: \"b2f689fd-70ec-43c9-b2da-275e28deb94c\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:25:37 crc kubenswrapper[5120]: I0316 16:25:37.489098 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hb2tk\" (UniqueName: \"kubernetes.io/projected/b2f689fd-70ec-43c9-b2da-275e28deb94c-kube-api-access-hb2tk\") pod \"openstack-galera-0\" (UID: \"b2f689fd-70ec-43c9-b2da-275e28deb94c\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:25:37 crc kubenswrapper[5120]: I0316 16:25:37.489141 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/b2f689fd-70ec-43c9-b2da-275e28deb94c-kolla-config\") pod \"openstack-galera-0\" (UID: \"b2f689fd-70ec-43c9-b2da-275e28deb94c\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:25:37 crc kubenswrapper[5120]: I0316 16:25:37.489186 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b2f689fd-70ec-43c9-b2da-275e28deb94c-operator-scripts\") pod \"openstack-galera-0\" (UID: \"b2f689fd-70ec-43c9-b2da-275e28deb94c\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:25:37 crc kubenswrapper[5120]: I0316 16:25:37.489223 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b2f689fd-70ec-43c9-b2da-275e28deb94c-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"b2f689fd-70ec-43c9-b2da-275e28deb94c\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:25:37 crc kubenswrapper[5120]: I0316 16:25:37.504751 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstack-galera-1"] Mar 16 16:25:37 crc kubenswrapper[5120]: I0316 16:25:37.507900 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-2" Mar 16 16:25:37 crc kubenswrapper[5120]: I0316 16:25:37.522558 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-galera-1"] Mar 16 16:25:37 crc kubenswrapper[5120]: I0316 16:25:37.522684 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-1" Mar 16 16:25:37 crc kubenswrapper[5120]: I0316 16:25:37.526334 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-galera-2"] Mar 16 16:25:37 crc kubenswrapper[5120]: I0316 16:25:37.590920 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/b2f689fd-70ec-43c9-b2da-275e28deb94c-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"b2f689fd-70ec-43c9-b2da-275e28deb94c\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:25:37 crc kubenswrapper[5120]: I0316 16:25:37.591002 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"openstack-galera-0\" (UID: \"b2f689fd-70ec-43c9-b2da-275e28deb94c\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:25:37 crc kubenswrapper[5120]: I0316 16:25:37.591240 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/b2f689fd-70ec-43c9-b2da-275e28deb94c-config-data-generated\") pod \"openstack-galera-0\" (UID: \"b2f689fd-70ec-43c9-b2da-275e28deb94c\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:25:37 crc kubenswrapper[5120]: I0316 16:25:37.591348 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"openstack-galera-0\" (UID: \"b2f689fd-70ec-43c9-b2da-275e28deb94c\") device mount path \"/mnt/openstack/pv09\"" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:25:37 crc kubenswrapper[5120]: I0316 16:25:37.591706 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/b2f689fd-70ec-43c9-b2da-275e28deb94c-config-data-generated\") pod \"openstack-galera-0\" (UID: \"b2f689fd-70ec-43c9-b2da-275e28deb94c\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:25:37 crc kubenswrapper[5120]: I0316 16:25:37.591884 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hb2tk\" (UniqueName: \"kubernetes.io/projected/b2f689fd-70ec-43c9-b2da-275e28deb94c-kube-api-access-hb2tk\") pod \"openstack-galera-0\" (UID: \"b2f689fd-70ec-43c9-b2da-275e28deb94c\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:25:37 crc kubenswrapper[5120]: I0316 16:25:37.592483 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/b2f689fd-70ec-43c9-b2da-275e28deb94c-kolla-config\") pod \"openstack-galera-0\" (UID: \"b2f689fd-70ec-43c9-b2da-275e28deb94c\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:25:37 crc kubenswrapper[5120]: I0316 16:25:37.592565 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b2f689fd-70ec-43c9-b2da-275e28deb94c-operator-scripts\") pod \"openstack-galera-0\" (UID: \"b2f689fd-70ec-43c9-b2da-275e28deb94c\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:25:37 crc kubenswrapper[5120]: I0316 16:25:37.592605 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b2f689fd-70ec-43c9-b2da-275e28deb94c-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"b2f689fd-70ec-43c9-b2da-275e28deb94c\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:25:37 crc kubenswrapper[5120]: I0316 16:25:37.593184 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/b2f689fd-70ec-43c9-b2da-275e28deb94c-config-data-default\") pod \"openstack-galera-0\" (UID: \"b2f689fd-70ec-43c9-b2da-275e28deb94c\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:25:37 crc kubenswrapper[5120]: I0316 16:25:37.594161 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/b2f689fd-70ec-43c9-b2da-275e28deb94c-config-data-default\") pod \"openstack-galera-0\" (UID: \"b2f689fd-70ec-43c9-b2da-275e28deb94c\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:25:37 crc kubenswrapper[5120]: I0316 16:25:37.594402 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b2f689fd-70ec-43c9-b2da-275e28deb94c-operator-scripts\") pod \"openstack-galera-0\" (UID: \"b2f689fd-70ec-43c9-b2da-275e28deb94c\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:25:37 crc kubenswrapper[5120]: I0316 16:25:37.595567 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/b2f689fd-70ec-43c9-b2da-275e28deb94c-kolla-config\") pod \"openstack-galera-0\" (UID: \"b2f689fd-70ec-43c9-b2da-275e28deb94c\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:25:37 crc kubenswrapper[5120]: I0316 16:25:37.596140 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/b2f689fd-70ec-43c9-b2da-275e28deb94c-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"b2f689fd-70ec-43c9-b2da-275e28deb94c\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:25:37 crc kubenswrapper[5120]: I0316 16:25:37.596276 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b2f689fd-70ec-43c9-b2da-275e28deb94c-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"b2f689fd-70ec-43c9-b2da-275e28deb94c\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:25:37 crc kubenswrapper[5120]: I0316 16:25:37.624432 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hb2tk\" (UniqueName: \"kubernetes.io/projected/b2f689fd-70ec-43c9-b2da-275e28deb94c-kube-api-access-hb2tk\") pod \"openstack-galera-0\" (UID: \"b2f689fd-70ec-43c9-b2da-275e28deb94c\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:25:37 crc kubenswrapper[5120]: I0316 16:25:37.631389 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"openstack-galera-0\" (UID: \"b2f689fd-70ec-43c9-b2da-275e28deb94c\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:25:37 crc kubenswrapper[5120]: I0316 16:25:37.676068 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"4df637ef-8f2d-4eb1-8a51-327814195dbf","Type":"ContainerStarted","Data":"27c237fe0fc3d0964b92f1f742a70bdcf1a19e2e3c9f1cef12c7a35735ff9a46"} Mar 16 16:25:37 crc kubenswrapper[5120]: I0316 16:25:37.678090 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"e1bf7ad2-f215-405b-84de-9429f90855f8","Type":"ContainerStarted","Data":"19e7beb485630129ef696f327a066c3d26830c322b9edfd670c4fe6b14c203fa"} Mar 16 16:25:37 crc kubenswrapper[5120]: I0316 16:25:37.679939 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-1" event={"ID":"dbe6904f-2249-41c3-bb8a-a1b5817094c5","Type":"ContainerStarted","Data":"d0ac33814164ae216a7ef35d60d9cc7d9e2d05a54d17c01507619259afcfaab8"} Mar 16 16:25:37 crc kubenswrapper[5120]: I0316 16:25:37.681525 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-2" event={"ID":"b190faa2-d49d-424d-90bc-3e6e34d1b362","Type":"ContainerStarted","Data":"3b2fc28702bef6284fe6b43edd4bdce22491e8ae026936351aae301d0cec1a8b"} Mar 16 16:25:37 crc kubenswrapper[5120]: I0316 16:25:37.682508 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-2" event={"ID":"9ab03e09-ed0f-4675-82c7-e04f1c3937ce","Type":"ContainerStarted","Data":"8357a4172d3be5b545714c50cfb0c28d687f4b4b0da5143e42e920caf32ef8f6"} Mar 16 16:25:37 crc kubenswrapper[5120]: I0316 16:25:37.683542 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-1" event={"ID":"a8e524d7-0cb0-4bec-9948-70d463625805","Type":"ContainerStarted","Data":"ac3cfa6ddc0853f95f3a0372431e32f77d805e70ab3d5ab31ec24ed3c0cc5e9e"} Mar 16 16:25:37 crc kubenswrapper[5120]: I0316 16:25:37.695053 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/51ac8589-b6a7-414d-94e5-731e217600c4-operator-scripts\") pod \"openstack-galera-2\" (UID: \"51ac8589-b6a7-414d-94e5-731e217600c4\") " pod="openstack-kuttl-tests/openstack-galera-2" Mar 16 16:25:37 crc kubenswrapper[5120]: I0316 16:25:37.695127 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqp4r\" (UniqueName: \"kubernetes.io/projected/51ac8589-b6a7-414d-94e5-731e217600c4-kube-api-access-hqp4r\") pod \"openstack-galera-2\" (UID: \"51ac8589-b6a7-414d-94e5-731e217600c4\") " pod="openstack-kuttl-tests/openstack-galera-2" Mar 16 16:25:37 crc kubenswrapper[5120]: I0316 16:25:37.695160 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/fdc6ab64-e478-46f4-8e4b-6bf2e4460d91-config-data-default\") pod \"openstack-galera-1\" (UID: \"fdc6ab64-e478-46f4-8e4b-6bf2e4460d91\") " pod="openstack-kuttl-tests/openstack-galera-1" Mar 16 16:25:37 crc kubenswrapper[5120]: I0316 16:25:37.695191 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/fdc6ab64-e478-46f4-8e4b-6bf2e4460d91-config-data-generated\") pod \"openstack-galera-1\" (UID: \"fdc6ab64-e478-46f4-8e4b-6bf2e4460d91\") " pod="openstack-kuttl-tests/openstack-galera-1" Mar 16 16:25:37 crc kubenswrapper[5120]: I0316 16:25:37.695320 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/fdc6ab64-e478-46f4-8e4b-6bf2e4460d91-operator-scripts\") pod \"openstack-galera-1\" (UID: \"fdc6ab64-e478-46f4-8e4b-6bf2e4460d91\") " pod="openstack-kuttl-tests/openstack-galera-1" Mar 16 16:25:37 crc kubenswrapper[5120]: I0316 16:25:37.695365 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/51ac8589-b6a7-414d-94e5-731e217600c4-combined-ca-bundle\") pod \"openstack-galera-2\" (UID: \"51ac8589-b6a7-414d-94e5-731e217600c4\") " pod="openstack-kuttl-tests/openstack-galera-2" Mar 16 16:25:37 crc kubenswrapper[5120]: I0316 16:25:37.695414 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/51ac8589-b6a7-414d-94e5-731e217600c4-config-data-default\") pod \"openstack-galera-2\" (UID: \"51ac8589-b6a7-414d-94e5-731e217600c4\") " pod="openstack-kuttl-tests/openstack-galera-2" Mar 16 16:25:37 crc kubenswrapper[5120]: I0316 16:25:37.695675 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gtjng\" (UniqueName: \"kubernetes.io/projected/fdc6ab64-e478-46f4-8e4b-6bf2e4460d91-kube-api-access-gtjng\") pod \"openstack-galera-1\" (UID: \"fdc6ab64-e478-46f4-8e4b-6bf2e4460d91\") " pod="openstack-kuttl-tests/openstack-galera-1" Mar 16 16:25:37 crc kubenswrapper[5120]: I0316 16:25:37.695828 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"openstack-galera-2\" (UID: \"51ac8589-b6a7-414d-94e5-731e217600c4\") " pod="openstack-kuttl-tests/openstack-galera-2" Mar 16 16:25:37 crc kubenswrapper[5120]: I0316 16:25:37.695866 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/fdc6ab64-e478-46f4-8e4b-6bf2e4460d91-kolla-config\") pod \"openstack-galera-1\" (UID: \"fdc6ab64-e478-46f4-8e4b-6bf2e4460d91\") " pod="openstack-kuttl-tests/openstack-galera-1" Mar 16 16:25:37 crc kubenswrapper[5120]: I0316 16:25:37.695920 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/51ac8589-b6a7-414d-94e5-731e217600c4-kolla-config\") pod \"openstack-galera-2\" (UID: \"51ac8589-b6a7-414d-94e5-731e217600c4\") " pod="openstack-kuttl-tests/openstack-galera-2" Mar 16 16:25:37 crc kubenswrapper[5120]: I0316 16:25:37.696010 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/51ac8589-b6a7-414d-94e5-731e217600c4-config-data-generated\") pod \"openstack-galera-2\" (UID: \"51ac8589-b6a7-414d-94e5-731e217600c4\") " pod="openstack-kuttl-tests/openstack-galera-2" Mar 16 16:25:37 crc kubenswrapper[5120]: I0316 16:25:37.696125 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/fdc6ab64-e478-46f4-8e4b-6bf2e4460d91-galera-tls-certs\") pod \"openstack-galera-1\" (UID: \"fdc6ab64-e478-46f4-8e4b-6bf2e4460d91\") " pod="openstack-kuttl-tests/openstack-galera-1" Mar 16 16:25:37 crc kubenswrapper[5120]: I0316 16:25:37.696162 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/51ac8589-b6a7-414d-94e5-731e217600c4-galera-tls-certs\") pod \"openstack-galera-2\" (UID: \"51ac8589-b6a7-414d-94e5-731e217600c4\") " pod="openstack-kuttl-tests/openstack-galera-2" Mar 16 16:25:37 crc kubenswrapper[5120]: I0316 16:25:37.696243 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fdc6ab64-e478-46f4-8e4b-6bf2e4460d91-combined-ca-bundle\") pod \"openstack-galera-1\" (UID: \"fdc6ab64-e478-46f4-8e4b-6bf2e4460d91\") " pod="openstack-kuttl-tests/openstack-galera-1" Mar 16 16:25:37 crc kubenswrapper[5120]: I0316 16:25:37.696322 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage07-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") pod \"openstack-galera-1\" (UID: \"fdc6ab64-e478-46f4-8e4b-6bf2e4460d91\") " pod="openstack-kuttl-tests/openstack-galera-1" Mar 16 16:25:37 crc kubenswrapper[5120]: I0316 16:25:37.795047 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:25:37 crc kubenswrapper[5120]: I0316 16:25:37.798259 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/51ac8589-b6a7-414d-94e5-731e217600c4-config-data-generated\") pod \"openstack-galera-2\" (UID: \"51ac8589-b6a7-414d-94e5-731e217600c4\") " pod="openstack-kuttl-tests/openstack-galera-2" Mar 16 16:25:37 crc kubenswrapper[5120]: I0316 16:25:37.798396 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/fdc6ab64-e478-46f4-8e4b-6bf2e4460d91-galera-tls-certs\") pod \"openstack-galera-1\" (UID: \"fdc6ab64-e478-46f4-8e4b-6bf2e4460d91\") " pod="openstack-kuttl-tests/openstack-galera-1" Mar 16 16:25:37 crc kubenswrapper[5120]: I0316 16:25:37.798432 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/51ac8589-b6a7-414d-94e5-731e217600c4-galera-tls-certs\") pod \"openstack-galera-2\" (UID: \"51ac8589-b6a7-414d-94e5-731e217600c4\") " pod="openstack-kuttl-tests/openstack-galera-2" Mar 16 16:25:37 crc kubenswrapper[5120]: I0316 16:25:37.798482 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fdc6ab64-e478-46f4-8e4b-6bf2e4460d91-combined-ca-bundle\") pod \"openstack-galera-1\" (UID: \"fdc6ab64-e478-46f4-8e4b-6bf2e4460d91\") " pod="openstack-kuttl-tests/openstack-galera-1" Mar 16 16:25:37 crc kubenswrapper[5120]: I0316 16:25:37.798529 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage07-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") pod \"openstack-galera-1\" (UID: \"fdc6ab64-e478-46f4-8e4b-6bf2e4460d91\") " pod="openstack-kuttl-tests/openstack-galera-1" Mar 16 16:25:37 crc kubenswrapper[5120]: I0316 16:25:37.798614 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/51ac8589-b6a7-414d-94e5-731e217600c4-operator-scripts\") pod \"openstack-galera-2\" (UID: \"51ac8589-b6a7-414d-94e5-731e217600c4\") " pod="openstack-kuttl-tests/openstack-galera-2" Mar 16 16:25:37 crc kubenswrapper[5120]: I0316 16:25:37.798669 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hqp4r\" (UniqueName: \"kubernetes.io/projected/51ac8589-b6a7-414d-94e5-731e217600c4-kube-api-access-hqp4r\") pod \"openstack-galera-2\" (UID: \"51ac8589-b6a7-414d-94e5-731e217600c4\") " pod="openstack-kuttl-tests/openstack-galera-2" Mar 16 16:25:37 crc kubenswrapper[5120]: I0316 16:25:37.798726 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/fdc6ab64-e478-46f4-8e4b-6bf2e4460d91-config-data-default\") pod \"openstack-galera-1\" (UID: \"fdc6ab64-e478-46f4-8e4b-6bf2e4460d91\") " pod="openstack-kuttl-tests/openstack-galera-1" Mar 16 16:25:37 crc kubenswrapper[5120]: I0316 16:25:37.798777 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/fdc6ab64-e478-46f4-8e4b-6bf2e4460d91-config-data-generated\") pod \"openstack-galera-1\" (UID: \"fdc6ab64-e478-46f4-8e4b-6bf2e4460d91\") " pod="openstack-kuttl-tests/openstack-galera-1" Mar 16 16:25:37 crc kubenswrapper[5120]: I0316 16:25:37.798806 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/fdc6ab64-e478-46f4-8e4b-6bf2e4460d91-operator-scripts\") pod \"openstack-galera-1\" (UID: \"fdc6ab64-e478-46f4-8e4b-6bf2e4460d91\") " pod="openstack-kuttl-tests/openstack-galera-1" Mar 16 16:25:37 crc kubenswrapper[5120]: I0316 16:25:37.798829 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/51ac8589-b6a7-414d-94e5-731e217600c4-combined-ca-bundle\") pod \"openstack-galera-2\" (UID: \"51ac8589-b6a7-414d-94e5-731e217600c4\") " pod="openstack-kuttl-tests/openstack-galera-2" Mar 16 16:25:37 crc kubenswrapper[5120]: I0316 16:25:37.798874 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/51ac8589-b6a7-414d-94e5-731e217600c4-config-data-default\") pod \"openstack-galera-2\" (UID: \"51ac8589-b6a7-414d-94e5-731e217600c4\") " pod="openstack-kuttl-tests/openstack-galera-2" Mar 16 16:25:37 crc kubenswrapper[5120]: I0316 16:25:37.799135 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gtjng\" (UniqueName: \"kubernetes.io/projected/fdc6ab64-e478-46f4-8e4b-6bf2e4460d91-kube-api-access-gtjng\") pod \"openstack-galera-1\" (UID: \"fdc6ab64-e478-46f4-8e4b-6bf2e4460d91\") " pod="openstack-kuttl-tests/openstack-galera-1" Mar 16 16:25:37 crc kubenswrapper[5120]: I0316 16:25:37.799281 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"openstack-galera-2\" (UID: \"51ac8589-b6a7-414d-94e5-731e217600c4\") " pod="openstack-kuttl-tests/openstack-galera-2" Mar 16 16:25:37 crc kubenswrapper[5120]: I0316 16:25:37.799310 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/fdc6ab64-e478-46f4-8e4b-6bf2e4460d91-kolla-config\") pod \"openstack-galera-1\" (UID: \"fdc6ab64-e478-46f4-8e4b-6bf2e4460d91\") " pod="openstack-kuttl-tests/openstack-galera-1" Mar 16 16:25:37 crc kubenswrapper[5120]: I0316 16:25:37.799379 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/51ac8589-b6a7-414d-94e5-731e217600c4-kolla-config\") pod \"openstack-galera-2\" (UID: \"51ac8589-b6a7-414d-94e5-731e217600c4\") " pod="openstack-kuttl-tests/openstack-galera-2" Mar 16 16:25:37 crc kubenswrapper[5120]: I0316 16:25:37.800916 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/51ac8589-b6a7-414d-94e5-731e217600c4-config-data-generated\") pod \"openstack-galera-2\" (UID: \"51ac8589-b6a7-414d-94e5-731e217600c4\") " pod="openstack-kuttl-tests/openstack-galera-2" Mar 16 16:25:37 crc kubenswrapper[5120]: I0316 16:25:37.801500 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/fdc6ab64-e478-46f4-8e4b-6bf2e4460d91-config-data-default\") pod \"openstack-galera-1\" (UID: \"fdc6ab64-e478-46f4-8e4b-6bf2e4460d91\") " pod="openstack-kuttl-tests/openstack-galera-1" Mar 16 16:25:37 crc kubenswrapper[5120]: I0316 16:25:37.801881 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/fdc6ab64-e478-46f4-8e4b-6bf2e4460d91-config-data-generated\") pod \"openstack-galera-1\" (UID: \"fdc6ab64-e478-46f4-8e4b-6bf2e4460d91\") " pod="openstack-kuttl-tests/openstack-galera-1" Mar 16 16:25:37 crc kubenswrapper[5120]: I0316 16:25:37.802255 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"openstack-galera-2\" (UID: \"51ac8589-b6a7-414d-94e5-731e217600c4\") device mount path \"/mnt/openstack/pv02\"" pod="openstack-kuttl-tests/openstack-galera-2" Mar 16 16:25:37 crc kubenswrapper[5120]: I0316 16:25:37.802680 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/51ac8589-b6a7-414d-94e5-731e217600c4-operator-scripts\") pod \"openstack-galera-2\" (UID: \"51ac8589-b6a7-414d-94e5-731e217600c4\") " pod="openstack-kuttl-tests/openstack-galera-2" Mar 16 16:25:37 crc kubenswrapper[5120]: I0316 16:25:37.802947 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/fdc6ab64-e478-46f4-8e4b-6bf2e4460d91-kolla-config\") pod \"openstack-galera-1\" (UID: \"fdc6ab64-e478-46f4-8e4b-6bf2e4460d91\") " pod="openstack-kuttl-tests/openstack-galera-1" Mar 16 16:25:37 crc kubenswrapper[5120]: I0316 16:25:37.803330 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/fdc6ab64-e478-46f4-8e4b-6bf2e4460d91-operator-scripts\") pod \"openstack-galera-1\" (UID: \"fdc6ab64-e478-46f4-8e4b-6bf2e4460d91\") " pod="openstack-kuttl-tests/openstack-galera-1" Mar 16 16:25:37 crc kubenswrapper[5120]: I0316 16:25:37.803576 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/51ac8589-b6a7-414d-94e5-731e217600c4-kolla-config\") pod \"openstack-galera-2\" (UID: \"51ac8589-b6a7-414d-94e5-731e217600c4\") " pod="openstack-kuttl-tests/openstack-galera-2" Mar 16 16:25:37 crc kubenswrapper[5120]: I0316 16:25:37.803733 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage07-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") pod \"openstack-galera-1\" (UID: \"fdc6ab64-e478-46f4-8e4b-6bf2e4460d91\") device mount path \"/mnt/openstack/pv07\"" pod="openstack-kuttl-tests/openstack-galera-1" Mar 16 16:25:37 crc kubenswrapper[5120]: I0316 16:25:37.804446 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/51ac8589-b6a7-414d-94e5-731e217600c4-config-data-default\") pod \"openstack-galera-2\" (UID: \"51ac8589-b6a7-414d-94e5-731e217600c4\") " pod="openstack-kuttl-tests/openstack-galera-2" Mar 16 16:25:37 crc kubenswrapper[5120]: I0316 16:25:37.898337 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fdc6ab64-e478-46f4-8e4b-6bf2e4460d91-combined-ca-bundle\") pod \"openstack-galera-1\" (UID: \"fdc6ab64-e478-46f4-8e4b-6bf2e4460d91\") " pod="openstack-kuttl-tests/openstack-galera-1" Mar 16 16:25:37 crc kubenswrapper[5120]: I0316 16:25:37.898372 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/fdc6ab64-e478-46f4-8e4b-6bf2e4460d91-galera-tls-certs\") pod \"openstack-galera-1\" (UID: \"fdc6ab64-e478-46f4-8e4b-6bf2e4460d91\") " pod="openstack-kuttl-tests/openstack-galera-1" Mar 16 16:25:37 crc kubenswrapper[5120]: I0316 16:25:37.898652 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/51ac8589-b6a7-414d-94e5-731e217600c4-galera-tls-certs\") pod \"openstack-galera-2\" (UID: \"51ac8589-b6a7-414d-94e5-731e217600c4\") " pod="openstack-kuttl-tests/openstack-galera-2" Mar 16 16:25:37 crc kubenswrapper[5120]: I0316 16:25:37.898663 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqp4r\" (UniqueName: \"kubernetes.io/projected/51ac8589-b6a7-414d-94e5-731e217600c4-kube-api-access-hqp4r\") pod \"openstack-galera-2\" (UID: \"51ac8589-b6a7-414d-94e5-731e217600c4\") " pod="openstack-kuttl-tests/openstack-galera-2" Mar 16 16:25:37 crc kubenswrapper[5120]: I0316 16:25:37.898886 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/51ac8589-b6a7-414d-94e5-731e217600c4-combined-ca-bundle\") pod \"openstack-galera-2\" (UID: \"51ac8589-b6a7-414d-94e5-731e217600c4\") " pod="openstack-kuttl-tests/openstack-galera-2" Mar 16 16:25:37 crc kubenswrapper[5120]: I0316 16:25:37.900875 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gtjng\" (UniqueName: \"kubernetes.io/projected/fdc6ab64-e478-46f4-8e4b-6bf2e4460d91-kube-api-access-gtjng\") pod \"openstack-galera-1\" (UID: \"fdc6ab64-e478-46f4-8e4b-6bf2e4460d91\") " pod="openstack-kuttl-tests/openstack-galera-1" Mar 16 16:25:37 crc kubenswrapper[5120]: I0316 16:25:37.923329 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"openstack-galera-2\" (UID: \"51ac8589-b6a7-414d-94e5-731e217600c4\") " pod="openstack-kuttl-tests/openstack-galera-2" Mar 16 16:25:38 crc kubenswrapper[5120]: I0316 16:25:38.157106 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-2" Mar 16 16:25:38 crc kubenswrapper[5120]: I0316 16:25:38.436517 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage07-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") pod \"openstack-galera-1\" (UID: \"fdc6ab64-e478-46f4-8e4b-6bf2e4460d91\") " pod="openstack-kuttl-tests/openstack-galera-1" Mar 16 16:25:38 crc kubenswrapper[5120]: I0316 16:25:38.469801 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-1" Mar 16 16:25:38 crc kubenswrapper[5120]: I0316 16:25:38.528792 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 16:25:38 crc kubenswrapper[5120]: I0316 16:25:38.635213 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 16:25:38 crc kubenswrapper[5120]: I0316 16:25:38.648563 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:25:38 crc kubenswrapper[5120]: I0316 16:25:38.654304 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-2"] Mar 16 16:25:38 crc kubenswrapper[5120]: I0316 16:25:38.659285 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-galera-openstack-cell1-svc\"" Mar 16 16:25:38 crc kubenswrapper[5120]: I0316 16:25:38.659749 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-cell1-scripts\"" Mar 16 16:25:38 crc kubenswrapper[5120]: I0316 16:25:38.659945 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-cell1-config-data\"" Mar 16 16:25:38 crc kubenswrapper[5120]: I0316 16:25:38.660555 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"galera-openstack-cell1-dockercfg-7v9wr\"" Mar 16 16:25:38 crc kubenswrapper[5120]: I0316 16:25:38.705694 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-2" Mar 16 16:25:38 crc kubenswrapper[5120]: I0316 16:25:38.706358 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 16:25:38 crc kubenswrapper[5120]: I0316 16:25:38.706392 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"b2f689fd-70ec-43c9-b2da-275e28deb94c","Type":"ContainerStarted","Data":"c06ce3a93a49bfeaa1ee779a5b374ebf95ad0cc08d1b931dbe4a3522f1919a3d"} Mar 16 16:25:38 crc kubenswrapper[5120]: I0316 16:25:38.706414 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-1"] Mar 16 16:25:38 crc kubenswrapper[5120]: I0316 16:25:38.733709 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-1" event={"ID":"a8e524d7-0cb0-4bec-9948-70d463625805","Type":"ContainerStarted","Data":"6b7acd6d38b5a42151c6262787d12910dc418e4e0adb77e42bc25f6f78a2dfcd"} Mar 16 16:25:38 crc kubenswrapper[5120]: I0316 16:25:38.733790 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-1"] Mar 16 16:25:38 crc kubenswrapper[5120]: I0316 16:25:38.733810 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-2"] Mar 16 16:25:38 crc kubenswrapper[5120]: I0316 16:25:38.733965 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-1" Mar 16 16:25:38 crc kubenswrapper[5120]: I0316 16:25:38.755386 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-galera-2"] Mar 16 16:25:38 crc kubenswrapper[5120]: I0316 16:25:38.848891 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/d4a96e7a-b22c-46b2-9fd4-9d8815d9f830-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"d4a96e7a-b22c-46b2-9fd4-9d8815d9f830\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:25:38 crc kubenswrapper[5120]: I0316 16:25:38.849370 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/fa5682a3-5cb9-4da7-8588-678ba2537e0c-config-data-generated\") pod \"openstack-cell1-galera-2\" (UID: \"fa5682a3-5cb9-4da7-8588-678ba2537e0c\") " pod="openstack-kuttl-tests/openstack-cell1-galera-2" Mar 16 16:25:38 crc kubenswrapper[5120]: I0316 16:25:38.849478 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/d4a96e7a-b22c-46b2-9fd4-9d8815d9f830-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"d4a96e7a-b22c-46b2-9fd4-9d8815d9f830\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:25:38 crc kubenswrapper[5120]: I0316 16:25:38.849505 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"openstack-cell1-galera-1\" (UID: \"8690a5a2-3341-452e-8364-2e5e4072c192\") " pod="openstack-kuttl-tests/openstack-cell1-galera-1" Mar 16 16:25:38 crc kubenswrapper[5120]: I0316 16:25:38.849562 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/8690a5a2-3341-452e-8364-2e5e4072c192-config-data-generated\") pod \"openstack-cell1-galera-1\" (UID: \"8690a5a2-3341-452e-8364-2e5e4072c192\") " pod="openstack-kuttl-tests/openstack-cell1-galera-1" Mar 16 16:25:38 crc kubenswrapper[5120]: I0316 16:25:38.849581 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fa5682a3-5cb9-4da7-8588-678ba2537e0c-combined-ca-bundle\") pod \"openstack-cell1-galera-2\" (UID: \"fa5682a3-5cb9-4da7-8588-678ba2537e0c\") " pod="openstack-kuttl-tests/openstack-cell1-galera-2" Mar 16 16:25:38 crc kubenswrapper[5120]: I0316 16:25:38.849709 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/fa5682a3-5cb9-4da7-8588-678ba2537e0c-operator-scripts\") pod \"openstack-cell1-galera-2\" (UID: \"fa5682a3-5cb9-4da7-8588-678ba2537e0c\") " pod="openstack-kuttl-tests/openstack-cell1-galera-2" Mar 16 16:25:38 crc kubenswrapper[5120]: I0316 16:25:38.849743 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d4a96e7a-b22c-46b2-9fd4-9d8815d9f830-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"d4a96e7a-b22c-46b2-9fd4-9d8815d9f830\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:25:38 crc kubenswrapper[5120]: I0316 16:25:38.849910 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d4a96e7a-b22c-46b2-9fd4-9d8815d9f830-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"d4a96e7a-b22c-46b2-9fd4-9d8815d9f830\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:25:38 crc kubenswrapper[5120]: I0316 16:25:38.849953 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8690a5a2-3341-452e-8364-2e5e4072c192-combined-ca-bundle\") pod \"openstack-cell1-galera-1\" (UID: \"8690a5a2-3341-452e-8364-2e5e4072c192\") " pod="openstack-kuttl-tests/openstack-cell1-galera-1" Mar 16 16:25:38 crc kubenswrapper[5120]: I0316 16:25:38.849980 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/fa5682a3-5cb9-4da7-8588-678ba2537e0c-galera-tls-certs\") pod \"openstack-cell1-galera-2\" (UID: \"fa5682a3-5cb9-4da7-8588-678ba2537e0c\") " pod="openstack-kuttl-tests/openstack-cell1-galera-2" Mar 16 16:25:38 crc kubenswrapper[5120]: I0316 16:25:38.850046 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74ghc\" (UniqueName: \"kubernetes.io/projected/fa5682a3-5cb9-4da7-8588-678ba2537e0c-kube-api-access-74ghc\") pod \"openstack-cell1-galera-2\" (UID: \"fa5682a3-5cb9-4da7-8588-678ba2537e0c\") " pod="openstack-kuttl-tests/openstack-cell1-galera-2" Mar 16 16:25:38 crc kubenswrapper[5120]: I0316 16:25:38.850136 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/8690a5a2-3341-452e-8364-2e5e4072c192-galera-tls-certs\") pod \"openstack-cell1-galera-1\" (UID: \"8690a5a2-3341-452e-8364-2e5e4072c192\") " pod="openstack-kuttl-tests/openstack-cell1-galera-1" Mar 16 16:25:38 crc kubenswrapper[5120]: I0316 16:25:38.850192 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") pod \"openstack-cell1-galera-0\" (UID: \"d4a96e7a-b22c-46b2-9fd4-9d8815d9f830\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:25:38 crc kubenswrapper[5120]: I0316 16:25:38.850216 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qftjt\" (UniqueName: \"kubernetes.io/projected/d4a96e7a-b22c-46b2-9fd4-9d8815d9f830-kube-api-access-qftjt\") pod \"openstack-cell1-galera-0\" (UID: \"d4a96e7a-b22c-46b2-9fd4-9d8815d9f830\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:25:38 crc kubenswrapper[5120]: I0316 16:25:38.850243 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/fa5682a3-5cb9-4da7-8588-678ba2537e0c-kolla-config\") pod \"openstack-cell1-galera-2\" (UID: \"fa5682a3-5cb9-4da7-8588-678ba2537e0c\") " pod="openstack-kuttl-tests/openstack-cell1-galera-2" Mar 16 16:25:38 crc kubenswrapper[5120]: I0316 16:25:38.850306 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/8690a5a2-3341-452e-8364-2e5e4072c192-kolla-config\") pod \"openstack-cell1-galera-1\" (UID: \"8690a5a2-3341-452e-8364-2e5e4072c192\") " pod="openstack-kuttl-tests/openstack-cell1-galera-1" Mar 16 16:25:38 crc kubenswrapper[5120]: I0316 16:25:38.850385 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/d4a96e7a-b22c-46b2-9fd4-9d8815d9f830-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"d4a96e7a-b22c-46b2-9fd4-9d8815d9f830\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:25:38 crc kubenswrapper[5120]: I0316 16:25:38.850837 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"openstack-cell1-galera-2\" (UID: \"fa5682a3-5cb9-4da7-8588-678ba2537e0c\") " pod="openstack-kuttl-tests/openstack-cell1-galera-2" Mar 16 16:25:38 crc kubenswrapper[5120]: I0316 16:25:38.850932 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/fa5682a3-5cb9-4da7-8588-678ba2537e0c-config-data-default\") pod \"openstack-cell1-galera-2\" (UID: \"fa5682a3-5cb9-4da7-8588-678ba2537e0c\") " pod="openstack-kuttl-tests/openstack-cell1-galera-2" Mar 16 16:25:38 crc kubenswrapper[5120]: I0316 16:25:38.851062 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4d6w\" (UniqueName: \"kubernetes.io/projected/8690a5a2-3341-452e-8364-2e5e4072c192-kube-api-access-c4d6w\") pod \"openstack-cell1-galera-1\" (UID: \"8690a5a2-3341-452e-8364-2e5e4072c192\") " pod="openstack-kuttl-tests/openstack-cell1-galera-1" Mar 16 16:25:38 crc kubenswrapper[5120]: I0316 16:25:38.851126 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/d4a96e7a-b22c-46b2-9fd4-9d8815d9f830-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"d4a96e7a-b22c-46b2-9fd4-9d8815d9f830\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:25:38 crc kubenswrapper[5120]: I0316 16:25:38.851217 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8690a5a2-3341-452e-8364-2e5e4072c192-operator-scripts\") pod \"openstack-cell1-galera-1\" (UID: \"8690a5a2-3341-452e-8364-2e5e4072c192\") " pod="openstack-kuttl-tests/openstack-cell1-galera-1" Mar 16 16:25:38 crc kubenswrapper[5120]: I0316 16:25:38.851240 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/8690a5a2-3341-452e-8364-2e5e4072c192-config-data-default\") pod \"openstack-cell1-galera-1\" (UID: \"8690a5a2-3341-452e-8364-2e5e4072c192\") " pod="openstack-kuttl-tests/openstack-cell1-galera-1" Mar 16 16:25:38 crc kubenswrapper[5120]: I0316 16:25:38.955495 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/d4a96e7a-b22c-46b2-9fd4-9d8815d9f830-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"d4a96e7a-b22c-46b2-9fd4-9d8815d9f830\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:25:38 crc kubenswrapper[5120]: I0316 16:25:38.955559 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/fa5682a3-5cb9-4da7-8588-678ba2537e0c-config-data-generated\") pod \"openstack-cell1-galera-2\" (UID: \"fa5682a3-5cb9-4da7-8588-678ba2537e0c\") " pod="openstack-kuttl-tests/openstack-cell1-galera-2" Mar 16 16:25:38 crc kubenswrapper[5120]: I0316 16:25:38.955616 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/d4a96e7a-b22c-46b2-9fd4-9d8815d9f830-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"d4a96e7a-b22c-46b2-9fd4-9d8815d9f830\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:25:38 crc kubenswrapper[5120]: I0316 16:25:38.955641 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"openstack-cell1-galera-1\" (UID: \"8690a5a2-3341-452e-8364-2e5e4072c192\") " pod="openstack-kuttl-tests/openstack-cell1-galera-1" Mar 16 16:25:38 crc kubenswrapper[5120]: I0316 16:25:38.955667 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/8690a5a2-3341-452e-8364-2e5e4072c192-config-data-generated\") pod \"openstack-cell1-galera-1\" (UID: \"8690a5a2-3341-452e-8364-2e5e4072c192\") " pod="openstack-kuttl-tests/openstack-cell1-galera-1" Mar 16 16:25:38 crc kubenswrapper[5120]: I0316 16:25:38.955684 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fa5682a3-5cb9-4da7-8588-678ba2537e0c-combined-ca-bundle\") pod \"openstack-cell1-galera-2\" (UID: \"fa5682a3-5cb9-4da7-8588-678ba2537e0c\") " pod="openstack-kuttl-tests/openstack-cell1-galera-2" Mar 16 16:25:38 crc kubenswrapper[5120]: I0316 16:25:38.955740 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/fa5682a3-5cb9-4da7-8588-678ba2537e0c-operator-scripts\") pod \"openstack-cell1-galera-2\" (UID: \"fa5682a3-5cb9-4da7-8588-678ba2537e0c\") " pod="openstack-kuttl-tests/openstack-cell1-galera-2" Mar 16 16:25:38 crc kubenswrapper[5120]: I0316 16:25:38.955783 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d4a96e7a-b22c-46b2-9fd4-9d8815d9f830-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"d4a96e7a-b22c-46b2-9fd4-9d8815d9f830\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:25:38 crc kubenswrapper[5120]: I0316 16:25:38.955810 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d4a96e7a-b22c-46b2-9fd4-9d8815d9f830-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"d4a96e7a-b22c-46b2-9fd4-9d8815d9f830\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:25:38 crc kubenswrapper[5120]: I0316 16:25:38.955826 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8690a5a2-3341-452e-8364-2e5e4072c192-combined-ca-bundle\") pod \"openstack-cell1-galera-1\" (UID: \"8690a5a2-3341-452e-8364-2e5e4072c192\") " pod="openstack-kuttl-tests/openstack-cell1-galera-1" Mar 16 16:25:38 crc kubenswrapper[5120]: I0316 16:25:38.955850 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/fa5682a3-5cb9-4da7-8588-678ba2537e0c-galera-tls-certs\") pod \"openstack-cell1-galera-2\" (UID: \"fa5682a3-5cb9-4da7-8588-678ba2537e0c\") " pod="openstack-kuttl-tests/openstack-cell1-galera-2" Mar 16 16:25:38 crc kubenswrapper[5120]: I0316 16:25:38.955873 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-74ghc\" (UniqueName: \"kubernetes.io/projected/fa5682a3-5cb9-4da7-8588-678ba2537e0c-kube-api-access-74ghc\") pod \"openstack-cell1-galera-2\" (UID: \"fa5682a3-5cb9-4da7-8588-678ba2537e0c\") " pod="openstack-kuttl-tests/openstack-cell1-galera-2" Mar 16 16:25:38 crc kubenswrapper[5120]: I0316 16:25:38.955906 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/8690a5a2-3341-452e-8364-2e5e4072c192-galera-tls-certs\") pod \"openstack-cell1-galera-1\" (UID: \"8690a5a2-3341-452e-8364-2e5e4072c192\") " pod="openstack-kuttl-tests/openstack-cell1-galera-1" Mar 16 16:25:38 crc kubenswrapper[5120]: I0316 16:25:38.955927 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") pod \"openstack-cell1-galera-0\" (UID: \"d4a96e7a-b22c-46b2-9fd4-9d8815d9f830\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:25:38 crc kubenswrapper[5120]: I0316 16:25:38.955949 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qftjt\" (UniqueName: \"kubernetes.io/projected/d4a96e7a-b22c-46b2-9fd4-9d8815d9f830-kube-api-access-qftjt\") pod \"openstack-cell1-galera-0\" (UID: \"d4a96e7a-b22c-46b2-9fd4-9d8815d9f830\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:25:38 crc kubenswrapper[5120]: I0316 16:25:38.955969 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/fa5682a3-5cb9-4da7-8588-678ba2537e0c-kolla-config\") pod \"openstack-cell1-galera-2\" (UID: \"fa5682a3-5cb9-4da7-8588-678ba2537e0c\") " pod="openstack-kuttl-tests/openstack-cell1-galera-2" Mar 16 16:25:38 crc kubenswrapper[5120]: I0316 16:25:38.955986 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/8690a5a2-3341-452e-8364-2e5e4072c192-kolla-config\") pod \"openstack-cell1-galera-1\" (UID: \"8690a5a2-3341-452e-8364-2e5e4072c192\") " pod="openstack-kuttl-tests/openstack-cell1-galera-1" Mar 16 16:25:38 crc kubenswrapper[5120]: I0316 16:25:38.956016 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/d4a96e7a-b22c-46b2-9fd4-9d8815d9f830-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"d4a96e7a-b22c-46b2-9fd4-9d8815d9f830\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:25:38 crc kubenswrapper[5120]: I0316 16:25:38.956087 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"openstack-cell1-galera-2\" (UID: \"fa5682a3-5cb9-4da7-8588-678ba2537e0c\") " pod="openstack-kuttl-tests/openstack-cell1-galera-2" Mar 16 16:25:38 crc kubenswrapper[5120]: I0316 16:25:38.956131 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/fa5682a3-5cb9-4da7-8588-678ba2537e0c-config-data-default\") pod \"openstack-cell1-galera-2\" (UID: \"fa5682a3-5cb9-4da7-8588-678ba2537e0c\") " pod="openstack-kuttl-tests/openstack-cell1-galera-2" Mar 16 16:25:38 crc kubenswrapper[5120]: I0316 16:25:38.956168 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c4d6w\" (UniqueName: \"kubernetes.io/projected/8690a5a2-3341-452e-8364-2e5e4072c192-kube-api-access-c4d6w\") pod \"openstack-cell1-galera-1\" (UID: \"8690a5a2-3341-452e-8364-2e5e4072c192\") " pod="openstack-kuttl-tests/openstack-cell1-galera-1" Mar 16 16:25:38 crc kubenswrapper[5120]: I0316 16:25:38.956203 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/d4a96e7a-b22c-46b2-9fd4-9d8815d9f830-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"d4a96e7a-b22c-46b2-9fd4-9d8815d9f830\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:25:38 crc kubenswrapper[5120]: I0316 16:25:38.956247 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8690a5a2-3341-452e-8364-2e5e4072c192-operator-scripts\") pod \"openstack-cell1-galera-1\" (UID: \"8690a5a2-3341-452e-8364-2e5e4072c192\") " pod="openstack-kuttl-tests/openstack-cell1-galera-1" Mar 16 16:25:38 crc kubenswrapper[5120]: I0316 16:25:38.956263 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/8690a5a2-3341-452e-8364-2e5e4072c192-config-data-default\") pod \"openstack-cell1-galera-1\" (UID: \"8690a5a2-3341-452e-8364-2e5e4072c192\") " pod="openstack-kuttl-tests/openstack-cell1-galera-1" Mar 16 16:25:38 crc kubenswrapper[5120]: I0316 16:25:38.958342 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") pod \"openstack-cell1-galera-0\" (UID: \"d4a96e7a-b22c-46b2-9fd4-9d8815d9f830\") device mount path \"/mnt/openstack/pv11\"" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:25:38 crc kubenswrapper[5120]: I0316 16:25:38.958399 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"openstack-cell1-galera-2\" (UID: \"fa5682a3-5cb9-4da7-8588-678ba2537e0c\") device mount path \"/mnt/openstack/pv04\"" pod="openstack-kuttl-tests/openstack-cell1-galera-2" Mar 16 16:25:38 crc kubenswrapper[5120]: I0316 16:25:38.962633 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/fa5682a3-5cb9-4da7-8588-678ba2537e0c-kolla-config\") pod \"openstack-cell1-galera-2\" (UID: \"fa5682a3-5cb9-4da7-8588-678ba2537e0c\") " pod="openstack-kuttl-tests/openstack-cell1-galera-2" Mar 16 16:25:38 crc kubenswrapper[5120]: I0316 16:25:38.963246 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/8690a5a2-3341-452e-8364-2e5e4072c192-kolla-config\") pod \"openstack-cell1-galera-1\" (UID: \"8690a5a2-3341-452e-8364-2e5e4072c192\") " pod="openstack-kuttl-tests/openstack-cell1-galera-1" Mar 16 16:25:38 crc kubenswrapper[5120]: I0316 16:25:38.963587 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/d4a96e7a-b22c-46b2-9fd4-9d8815d9f830-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"d4a96e7a-b22c-46b2-9fd4-9d8815d9f830\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:25:38 crc kubenswrapper[5120]: I0316 16:25:38.963816 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/8690a5a2-3341-452e-8364-2e5e4072c192-config-data-default\") pod \"openstack-cell1-galera-1\" (UID: \"8690a5a2-3341-452e-8364-2e5e4072c192\") " pod="openstack-kuttl-tests/openstack-cell1-galera-1" Mar 16 16:25:38 crc kubenswrapper[5120]: I0316 16:25:38.963864 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/fa5682a3-5cb9-4da7-8588-678ba2537e0c-config-data-default\") pod \"openstack-cell1-galera-2\" (UID: \"fa5682a3-5cb9-4da7-8588-678ba2537e0c\") " pod="openstack-kuttl-tests/openstack-cell1-galera-2" Mar 16 16:25:38 crc kubenswrapper[5120]: I0316 16:25:38.964486 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8690a5a2-3341-452e-8364-2e5e4072c192-operator-scripts\") pod \"openstack-cell1-galera-1\" (UID: \"8690a5a2-3341-452e-8364-2e5e4072c192\") " pod="openstack-kuttl-tests/openstack-cell1-galera-1" Mar 16 16:25:38 crc kubenswrapper[5120]: I0316 16:25:38.964973 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/d4a96e7a-b22c-46b2-9fd4-9d8815d9f830-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"d4a96e7a-b22c-46b2-9fd4-9d8815d9f830\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:25:38 crc kubenswrapper[5120]: I0316 16:25:38.965366 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/fa5682a3-5cb9-4da7-8588-678ba2537e0c-config-data-generated\") pod \"openstack-cell1-galera-2\" (UID: \"fa5682a3-5cb9-4da7-8588-678ba2537e0c\") " pod="openstack-kuttl-tests/openstack-cell1-galera-2" Mar 16 16:25:38 crc kubenswrapper[5120]: I0316 16:25:38.965625 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/d4a96e7a-b22c-46b2-9fd4-9d8815d9f830-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"d4a96e7a-b22c-46b2-9fd4-9d8815d9f830\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:25:38 crc kubenswrapper[5120]: I0316 16:25:38.965731 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/8690a5a2-3341-452e-8364-2e5e4072c192-galera-tls-certs\") pod \"openstack-cell1-galera-1\" (UID: \"8690a5a2-3341-452e-8364-2e5e4072c192\") " pod="openstack-kuttl-tests/openstack-cell1-galera-1" Mar 16 16:25:38 crc kubenswrapper[5120]: I0316 16:25:38.965715 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/8690a5a2-3341-452e-8364-2e5e4072c192-config-data-generated\") pod \"openstack-cell1-galera-1\" (UID: \"8690a5a2-3341-452e-8364-2e5e4072c192\") " pod="openstack-kuttl-tests/openstack-cell1-galera-1" Mar 16 16:25:38 crc kubenswrapper[5120]: I0316 16:25:38.967143 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d4a96e7a-b22c-46b2-9fd4-9d8815d9f830-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"d4a96e7a-b22c-46b2-9fd4-9d8815d9f830\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:25:38 crc kubenswrapper[5120]: I0316 16:25:38.967270 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/fa5682a3-5cb9-4da7-8588-678ba2537e0c-operator-scripts\") pod \"openstack-cell1-galera-2\" (UID: \"fa5682a3-5cb9-4da7-8588-678ba2537e0c\") " pod="openstack-kuttl-tests/openstack-cell1-galera-2" Mar 16 16:25:38 crc kubenswrapper[5120]: I0316 16:25:38.964753 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"openstack-cell1-galera-1\" (UID: \"8690a5a2-3341-452e-8364-2e5e4072c192\") device mount path \"/mnt/openstack/pv16\"" pod="openstack-kuttl-tests/openstack-cell1-galera-1" Mar 16 16:25:38 crc kubenswrapper[5120]: I0316 16:25:38.974688 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fa5682a3-5cb9-4da7-8588-678ba2537e0c-combined-ca-bundle\") pod \"openstack-cell1-galera-2\" (UID: \"fa5682a3-5cb9-4da7-8588-678ba2537e0c\") " pod="openstack-kuttl-tests/openstack-cell1-galera-2" Mar 16 16:25:38 crc kubenswrapper[5120]: I0316 16:25:38.979462 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/fa5682a3-5cb9-4da7-8588-678ba2537e0c-galera-tls-certs\") pod \"openstack-cell1-galera-2\" (UID: \"fa5682a3-5cb9-4da7-8588-678ba2537e0c\") " pod="openstack-kuttl-tests/openstack-cell1-galera-2" Mar 16 16:25:38 crc kubenswrapper[5120]: I0316 16:25:38.981438 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8690a5a2-3341-452e-8364-2e5e4072c192-combined-ca-bundle\") pod \"openstack-cell1-galera-1\" (UID: \"8690a5a2-3341-452e-8364-2e5e4072c192\") " pod="openstack-kuttl-tests/openstack-cell1-galera-1" Mar 16 16:25:38 crc kubenswrapper[5120]: I0316 16:25:38.981849 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/d4a96e7a-b22c-46b2-9fd4-9d8815d9f830-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"d4a96e7a-b22c-46b2-9fd4-9d8815d9f830\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:25:38 crc kubenswrapper[5120]: I0316 16:25:38.987868 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d4a96e7a-b22c-46b2-9fd4-9d8815d9f830-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"d4a96e7a-b22c-46b2-9fd4-9d8815d9f830\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:25:38 crc kubenswrapper[5120]: I0316 16:25:38.988017 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4d6w\" (UniqueName: \"kubernetes.io/projected/8690a5a2-3341-452e-8364-2e5e4072c192-kube-api-access-c4d6w\") pod \"openstack-cell1-galera-1\" (UID: \"8690a5a2-3341-452e-8364-2e5e4072c192\") " pod="openstack-kuttl-tests/openstack-cell1-galera-1" Mar 16 16:25:38 crc kubenswrapper[5120]: I0316 16:25:38.990478 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qftjt\" (UniqueName: \"kubernetes.io/projected/d4a96e7a-b22c-46b2-9fd4-9d8815d9f830-kube-api-access-qftjt\") pod \"openstack-cell1-galera-0\" (UID: \"d4a96e7a-b22c-46b2-9fd4-9d8815d9f830\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:25:38 crc kubenswrapper[5120]: I0316 16:25:38.990518 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-74ghc\" (UniqueName: \"kubernetes.io/projected/fa5682a3-5cb9-4da7-8588-678ba2537e0c-kube-api-access-74ghc\") pod \"openstack-cell1-galera-2\" (UID: \"fa5682a3-5cb9-4da7-8588-678ba2537e0c\") " pod="openstack-kuttl-tests/openstack-cell1-galera-2" Mar 16 16:25:39 crc kubenswrapper[5120]: I0316 16:25:39.010884 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 16:25:39 crc kubenswrapper[5120]: I0316 16:25:39.025369 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 16:25:39 crc kubenswrapper[5120]: I0316 16:25:39.025476 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Mar 16 16:25:39 crc kubenswrapper[5120]: I0316 16:25:39.053798 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"memcached-config-data\"" Mar 16 16:25:39 crc kubenswrapper[5120]: I0316 16:25:39.054394 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"memcached-memcached-dockercfg-mg8lh\"" Mar 16 16:25:39 crc kubenswrapper[5120]: I0316 16:25:39.054645 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-memcached-svc\"" Mar 16 16:25:39 crc kubenswrapper[5120]: I0316 16:25:39.115921 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"openstack-cell1-galera-2\" (UID: \"fa5682a3-5cb9-4da7-8588-678ba2537e0c\") " pod="openstack-kuttl-tests/openstack-cell1-galera-2" Mar 16 16:25:39 crc kubenswrapper[5120]: I0316 16:25:39.125054 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") pod \"openstack-cell1-galera-0\" (UID: \"d4a96e7a-b22c-46b2-9fd4-9d8815d9f830\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:25:39 crc kubenswrapper[5120]: I0316 16:25:39.128226 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"openstack-cell1-galera-1\" (UID: \"8690a5a2-3341-452e-8364-2e5e4072c192\") " pod="openstack-kuttl-tests/openstack-cell1-galera-1" Mar 16 16:25:39 crc kubenswrapper[5120]: I0316 16:25:39.141063 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-galera-1"] Mar 16 16:25:39 crc kubenswrapper[5120]: I0316 16:25:39.159113 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/9565a662-ca77-4197-8894-6b9633e653fd-memcached-tls-certs\") pod \"memcached-0\" (UID: \"9565a662-ca77-4197-8894-6b9633e653fd\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:25:39 crc kubenswrapper[5120]: I0316 16:25:39.159200 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/9565a662-ca77-4197-8894-6b9633e653fd-config-data\") pod \"memcached-0\" (UID: \"9565a662-ca77-4197-8894-6b9633e653fd\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:25:39 crc kubenswrapper[5120]: I0316 16:25:39.159303 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-blk52\" (UniqueName: \"kubernetes.io/projected/9565a662-ca77-4197-8894-6b9633e653fd-kube-api-access-blk52\") pod \"memcached-0\" (UID: \"9565a662-ca77-4197-8894-6b9633e653fd\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:25:39 crc kubenswrapper[5120]: I0316 16:25:39.159447 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/9565a662-ca77-4197-8894-6b9633e653fd-kolla-config\") pod \"memcached-0\" (UID: \"9565a662-ca77-4197-8894-6b9633e653fd\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:25:39 crc kubenswrapper[5120]: I0316 16:25:39.159521 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9565a662-ca77-4197-8894-6b9633e653fd-combined-ca-bundle\") pod \"memcached-0\" (UID: \"9565a662-ca77-4197-8894-6b9633e653fd\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:25:39 crc kubenswrapper[5120]: I0316 16:25:39.261151 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-blk52\" (UniqueName: \"kubernetes.io/projected/9565a662-ca77-4197-8894-6b9633e653fd-kube-api-access-blk52\") pod \"memcached-0\" (UID: \"9565a662-ca77-4197-8894-6b9633e653fd\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:25:39 crc kubenswrapper[5120]: I0316 16:25:39.261577 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/9565a662-ca77-4197-8894-6b9633e653fd-kolla-config\") pod \"memcached-0\" (UID: \"9565a662-ca77-4197-8894-6b9633e653fd\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:25:39 crc kubenswrapper[5120]: I0316 16:25:39.261617 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9565a662-ca77-4197-8894-6b9633e653fd-combined-ca-bundle\") pod \"memcached-0\" (UID: \"9565a662-ca77-4197-8894-6b9633e653fd\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:25:39 crc kubenswrapper[5120]: I0316 16:25:39.262394 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/9565a662-ca77-4197-8894-6b9633e653fd-kolla-config\") pod \"memcached-0\" (UID: \"9565a662-ca77-4197-8894-6b9633e653fd\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:25:39 crc kubenswrapper[5120]: I0316 16:25:39.262944 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/9565a662-ca77-4197-8894-6b9633e653fd-memcached-tls-certs\") pod \"memcached-0\" (UID: \"9565a662-ca77-4197-8894-6b9633e653fd\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:25:39 crc kubenswrapper[5120]: I0316 16:25:39.263000 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/9565a662-ca77-4197-8894-6b9633e653fd-config-data\") pod \"memcached-0\" (UID: \"9565a662-ca77-4197-8894-6b9633e653fd\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:25:39 crc kubenswrapper[5120]: I0316 16:25:39.263668 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/9565a662-ca77-4197-8894-6b9633e653fd-config-data\") pod \"memcached-0\" (UID: \"9565a662-ca77-4197-8894-6b9633e653fd\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:25:39 crc kubenswrapper[5120]: I0316 16:25:39.267556 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/9565a662-ca77-4197-8894-6b9633e653fd-memcached-tls-certs\") pod \"memcached-0\" (UID: \"9565a662-ca77-4197-8894-6b9633e653fd\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:25:39 crc kubenswrapper[5120]: I0316 16:25:39.268436 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9565a662-ca77-4197-8894-6b9633e653fd-combined-ca-bundle\") pod \"memcached-0\" (UID: \"9565a662-ca77-4197-8894-6b9633e653fd\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:25:39 crc kubenswrapper[5120]: I0316 16:25:39.279454 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-blk52\" (UniqueName: \"kubernetes.io/projected/9565a662-ca77-4197-8894-6b9633e653fd-kube-api-access-blk52\") pod \"memcached-0\" (UID: \"9565a662-ca77-4197-8894-6b9633e653fd\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:25:39 crc kubenswrapper[5120]: I0316 16:25:39.290223 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:25:39 crc kubenswrapper[5120]: I0316 16:25:39.305360 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Mar 16 16:25:39 crc kubenswrapper[5120]: I0316 16:25:39.346157 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-2" Mar 16 16:25:39 crc kubenswrapper[5120]: I0316 16:25:39.394244 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-1" Mar 16 16:25:39 crc kubenswrapper[5120]: I0316 16:25:39.720853 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-2" event={"ID":"9ab03e09-ed0f-4675-82c7-e04f1c3937ce","Type":"ContainerStarted","Data":"d74a3c4991867a062329d3cd6b295cd64d369bbf217d82583bf74e17039fc89d"} Mar 16 16:25:39 crc kubenswrapper[5120]: I0316 16:25:39.722662 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"b2f689fd-70ec-43c9-b2da-275e28deb94c","Type":"ContainerStarted","Data":"0e571b8a3d09eea0ed4f123901d3b7ab1f0e5d31869918b5a25bb4ccfbc9b070"} Mar 16 16:25:39 crc kubenswrapper[5120]: I0316 16:25:39.725438 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"4df637ef-8f2d-4eb1-8a51-327814195dbf","Type":"ContainerStarted","Data":"165262826bdc38dd4fad2923abdc06d2a3dab7f65eb388bea00584b1ceb6a547"} Mar 16 16:25:39 crc kubenswrapper[5120]: I0316 16:25:39.727454 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-2" event={"ID":"51ac8589-b6a7-414d-94e5-731e217600c4","Type":"ContainerStarted","Data":"72701ef16c9ef2e1b50e20366156c0b66413347f948b5144adbc4cfa2684d6ca"} Mar 16 16:25:39 crc kubenswrapper[5120]: I0316 16:25:39.727489 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-2" event={"ID":"51ac8589-b6a7-414d-94e5-731e217600c4","Type":"ContainerStarted","Data":"9f7f30fff2938592df2e74ceb51e4f73de19e2b28d06de976b63ee41a1f42e66"} Mar 16 16:25:39 crc kubenswrapper[5120]: I0316 16:25:39.730481 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-1" event={"ID":"fdc6ab64-e478-46f4-8e4b-6bf2e4460d91","Type":"ContainerStarted","Data":"e0d5654760e70de1ab670d0ca2332b84db7e1b6cadfcf471d3ef946fec9775c0"} Mar 16 16:25:39 crc kubenswrapper[5120]: I0316 16:25:39.730515 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-1" event={"ID":"fdc6ab64-e478-46f4-8e4b-6bf2e4460d91","Type":"ContainerStarted","Data":"aa68c9b3816a486f63defe97b616bb74cd6d1700329bafeb872182309ecb975f"} Mar 16 16:25:39 crc kubenswrapper[5120]: I0316 16:25:39.848524 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 16:25:39 crc kubenswrapper[5120]: W0316 16:25:39.935234 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9565a662_ca77_4197_8894_6b9633e653fd.slice/crio-049c3e0efcdfef6f97e34b50531cbee78cd56c5f741539b0aa702cf2c69dd5e7 WatchSource:0}: Error finding container 049c3e0efcdfef6f97e34b50531cbee78cd56c5f741539b0aa702cf2c69dd5e7: Status 404 returned error can't find the container with id 049c3e0efcdfef6f97e34b50531cbee78cd56c5f741539b0aa702cf2c69dd5e7 Mar 16 16:25:39 crc kubenswrapper[5120]: I0316 16:25:39.940183 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 16:25:39 crc kubenswrapper[5120]: I0316 16:25:39.947394 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-2"] Mar 16 16:25:39 crc kubenswrapper[5120]: W0316 16:25:39.949183 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfa5682a3_5cb9_4da7_8588_678ba2537e0c.slice/crio-49d0bfef2e42359f0642ed0881fe799e08a6b74395644aa5f58044dcf985ba14 WatchSource:0}: Error finding container 49d0bfef2e42359f0642ed0881fe799e08a6b74395644aa5f58044dcf985ba14: Status 404 returned error can't find the container with id 49d0bfef2e42359f0642ed0881fe799e08a6b74395644aa5f58044dcf985ba14 Mar 16 16:25:40 crc kubenswrapper[5120]: I0316 16:25:40.051516 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-1"] Mar 16 16:25:40 crc kubenswrapper[5120]: W0316 16:25:40.056311 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8690a5a2_3341_452e_8364_2e5e4072c192.slice/crio-ab223e1e16f0f8cc1bf5b3521147f206bc926ab141b9ccaa62b8c25b862f8d5a WatchSource:0}: Error finding container ab223e1e16f0f8cc1bf5b3521147f206bc926ab141b9ccaa62b8c25b862f8d5a: Status 404 returned error can't find the container with id ab223e1e16f0f8cc1bf5b3521147f206bc926ab141b9ccaa62b8c25b862f8d5a Mar 16 16:25:40 crc kubenswrapper[5120]: I0316 16:25:40.739723 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"d4a96e7a-b22c-46b2-9fd4-9d8815d9f830","Type":"ContainerStarted","Data":"7cfc94fdd5733bd67d0af246197ff0cee02872b2035a14cf33ad03ce9b87935e"} Mar 16 16:25:40 crc kubenswrapper[5120]: I0316 16:25:40.740048 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"d4a96e7a-b22c-46b2-9fd4-9d8815d9f830","Type":"ContainerStarted","Data":"7acd8406a04b25baea6b928861181cefce694fb01dd2c2ddbe81a36d0c395fed"} Mar 16 16:25:40 crc kubenswrapper[5120]: I0316 16:25:40.742112 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-2" event={"ID":"fa5682a3-5cb9-4da7-8588-678ba2537e0c","Type":"ContainerStarted","Data":"4c01701e23712013375dc91b22a0a1b617bf6e48412365659bdeded27e684262"} Mar 16 16:25:40 crc kubenswrapper[5120]: I0316 16:25:40.742148 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-2" event={"ID":"fa5682a3-5cb9-4da7-8588-678ba2537e0c","Type":"ContainerStarted","Data":"49d0bfef2e42359f0642ed0881fe799e08a6b74395644aa5f58044dcf985ba14"} Mar 16 16:25:40 crc kubenswrapper[5120]: I0316 16:25:40.744665 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-1" event={"ID":"8690a5a2-3341-452e-8364-2e5e4072c192","Type":"ContainerStarted","Data":"d09c5615132d524e6ebe54947498408c78bca6eb878816dc2f76280340a9e5c9"} Mar 16 16:25:40 crc kubenswrapper[5120]: I0316 16:25:40.744702 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-1" event={"ID":"8690a5a2-3341-452e-8364-2e5e4072c192","Type":"ContainerStarted","Data":"ab223e1e16f0f8cc1bf5b3521147f206bc926ab141b9ccaa62b8c25b862f8d5a"} Mar 16 16:25:40 crc kubenswrapper[5120]: I0316 16:25:40.746357 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"9565a662-ca77-4197-8894-6b9633e653fd","Type":"ContainerStarted","Data":"ceec1936c48e3f6be7fd6579209ab2c0807f3a2ee9058527f618607ccce149d6"} Mar 16 16:25:40 crc kubenswrapper[5120]: I0316 16:25:40.746446 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"9565a662-ca77-4197-8894-6b9633e653fd","Type":"ContainerStarted","Data":"049c3e0efcdfef6f97e34b50531cbee78cd56c5f741539b0aa702cf2c69dd5e7"} Mar 16 16:25:40 crc kubenswrapper[5120]: I0316 16:25:40.746515 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/memcached-0" Mar 16 16:25:40 crc kubenswrapper[5120]: I0316 16:25:40.830070 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/memcached-0" podStartSLOduration=2.830047959 podStartE2EDuration="2.830047959s" podCreationTimestamp="2026-03-16 16:25:38 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:25:40.818529991 +0000 UTC m=+3242.972461658" watchObservedRunningTime="2026-03-16 16:25:40.830047959 +0000 UTC m=+3242.983979606" Mar 16 16:25:41 crc kubenswrapper[5120]: I0316 16:25:41.178731 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 16:25:41 crc kubenswrapper[5120]: I0316 16:25:41.185488 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:25:41 crc kubenswrapper[5120]: I0316 16:25:41.190020 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 16:25:41 crc kubenswrapper[5120]: I0316 16:25:41.196127 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"telemetry-ceilometer-dockercfg-dph6f\"" Mar 16 16:25:41 crc kubenswrapper[5120]: I0316 16:25:41.320592 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htgkc\" (UniqueName: \"kubernetes.io/projected/62c35786-83f2-4ef8-8265-647a9216a6f2-kube-api-access-htgkc\") pod \"kube-state-metrics-0\" (UID: \"62c35786-83f2-4ef8-8265-647a9216a6f2\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:25:41 crc kubenswrapper[5120]: I0316 16:25:41.425686 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-htgkc\" (UniqueName: \"kubernetes.io/projected/62c35786-83f2-4ef8-8265-647a9216a6f2-kube-api-access-htgkc\") pod \"kube-state-metrics-0\" (UID: \"62c35786-83f2-4ef8-8265-647a9216a6f2\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:25:41 crc kubenswrapper[5120]: I0316 16:25:41.464916 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-htgkc\" (UniqueName: \"kubernetes.io/projected/62c35786-83f2-4ef8-8265-647a9216a6f2-kube-api-access-htgkc\") pod \"kube-state-metrics-0\" (UID: \"62c35786-83f2-4ef8-8265-647a9216a6f2\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:25:41 crc kubenswrapper[5120]: I0316 16:25:41.505417 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:25:41 crc kubenswrapper[5120]: I0316 16:25:41.984784 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 16:25:41 crc kubenswrapper[5120]: W0316 16:25:41.988874 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod62c35786_83f2_4ef8_8265_647a9216a6f2.slice/crio-36231472538a731d192bb3cb942dd1b57f5fdd86a7a02b6cbfdcfb2c1545f3ef WatchSource:0}: Error finding container 36231472538a731d192bb3cb942dd1b57f5fdd86a7a02b6cbfdcfb2c1545f3ef: Status 404 returned error can't find the container with id 36231472538a731d192bb3cb942dd1b57f5fdd86a7a02b6cbfdcfb2c1545f3ef Mar 16 16:25:42 crc kubenswrapper[5120]: I0316 16:25:42.778873 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"62c35786-83f2-4ef8-8265-647a9216a6f2","Type":"ContainerStarted","Data":"f932ea0ab7ac639e3860ad12ca89338e8c880d34669208bea065ae1dd808a4b7"} Mar 16 16:25:42 crc kubenswrapper[5120]: I0316 16:25:42.780116 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:25:42 crc kubenswrapper[5120]: I0316 16:25:42.780152 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"62c35786-83f2-4ef8-8265-647a9216a6f2","Type":"ContainerStarted","Data":"36231472538a731d192bb3cb942dd1b57f5fdd86a7a02b6cbfdcfb2c1545f3ef"} Mar 16 16:25:43 crc kubenswrapper[5120]: I0316 16:25:43.792959 5120 generic.go:358] "Generic (PLEG): container finished" podID="b2f689fd-70ec-43c9-b2da-275e28deb94c" containerID="0e571b8a3d09eea0ed4f123901d3b7ab1f0e5d31869918b5a25bb4ccfbc9b070" exitCode=0 Mar 16 16:25:43 crc kubenswrapper[5120]: I0316 16:25:43.793213 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"b2f689fd-70ec-43c9-b2da-275e28deb94c","Type":"ContainerDied","Data":"0e571b8a3d09eea0ed4f123901d3b7ab1f0e5d31869918b5a25bb4ccfbc9b070"} Mar 16 16:25:43 crc kubenswrapper[5120]: I0316 16:25:43.798905 5120 generic.go:358] "Generic (PLEG): container finished" podID="51ac8589-b6a7-414d-94e5-731e217600c4" containerID="72701ef16c9ef2e1b50e20366156c0b66413347f948b5144adbc4cfa2684d6ca" exitCode=0 Mar 16 16:25:43 crc kubenswrapper[5120]: I0316 16:25:43.798981 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-2" event={"ID":"51ac8589-b6a7-414d-94e5-731e217600c4","Type":"ContainerDied","Data":"72701ef16c9ef2e1b50e20366156c0b66413347f948b5144adbc4cfa2684d6ca"} Mar 16 16:25:43 crc kubenswrapper[5120]: I0316 16:25:43.804883 5120 generic.go:358] "Generic (PLEG): container finished" podID="fdc6ab64-e478-46f4-8e4b-6bf2e4460d91" containerID="e0d5654760e70de1ab670d0ca2332b84db7e1b6cadfcf471d3ef946fec9775c0" exitCode=0 Mar 16 16:25:43 crc kubenswrapper[5120]: I0316 16:25:43.805587 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-1" event={"ID":"fdc6ab64-e478-46f4-8e4b-6bf2e4460d91","Type":"ContainerDied","Data":"e0d5654760e70de1ab670d0ca2332b84db7e1b6cadfcf471d3ef946fec9775c0"} Mar 16 16:25:43 crc kubenswrapper[5120]: I0316 16:25:43.848372 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/kube-state-metrics-0" podStartSLOduration=2.482343241 podStartE2EDuration="2.84834691s" podCreationTimestamp="2026-03-16 16:25:41 +0000 UTC" firstStartedPulling="2026-03-16 16:25:41.990152539 +0000 UTC m=+3244.144084186" lastFinishedPulling="2026-03-16 16:25:42.356156168 +0000 UTC m=+3244.510087855" observedRunningTime="2026-03-16 16:25:42.797688998 +0000 UTC m=+3244.951620675" watchObservedRunningTime="2026-03-16 16:25:43.84834691 +0000 UTC m=+3246.002278567" Mar 16 16:25:44 crc kubenswrapper[5120]: I0316 16:25:44.135102 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 16:25:44 crc kubenswrapper[5120]: I0316 16:25:44.157169 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 16:25:44 crc kubenswrapper[5120]: I0316 16:25:44.157336 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:25:44 crc kubenswrapper[5120]: I0316 16:25:44.160022 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ovndbcluster-nb-ovndbs\"" Mar 16 16:25:44 crc kubenswrapper[5120]: I0316 16:25:44.160729 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ovncluster-ovndbcluster-nb-dockercfg-8hq42\"" Mar 16 16:25:44 crc kubenswrapper[5120]: I0316 16:25:44.161161 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovndbcluster-nb-scripts\"" Mar 16 16:25:44 crc kubenswrapper[5120]: I0316 16:25:44.161274 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovndbcluster-nb-config\"" Mar 16 16:25:44 crc kubenswrapper[5120]: I0316 16:25:44.161493 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ovn-metrics\"" Mar 16 16:25:44 crc kubenswrapper[5120]: I0316 16:25:44.298406 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/5f1a58aa-0b5e-424c-84d6-c2cdc92ce046-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"5f1a58aa-0b5e-424c-84d6-c2cdc92ce046\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:25:44 crc kubenswrapper[5120]: I0316 16:25:44.298463 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5f1a58aa-0b5e-424c-84d6-c2cdc92ce046-config\") pod \"ovsdbserver-nb-0\" (UID: \"5f1a58aa-0b5e-424c-84d6-c2cdc92ce046\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:25:44 crc kubenswrapper[5120]: I0316 16:25:44.298525 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjbpl\" (UniqueName: \"kubernetes.io/projected/5f1a58aa-0b5e-424c-84d6-c2cdc92ce046-kube-api-access-kjbpl\") pod \"ovsdbserver-nb-0\" (UID: \"5f1a58aa-0b5e-424c-84d6-c2cdc92ce046\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:25:44 crc kubenswrapper[5120]: I0316 16:25:44.298701 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/5f1a58aa-0b5e-424c-84d6-c2cdc92ce046-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"5f1a58aa-0b5e-424c-84d6-c2cdc92ce046\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:25:44 crc kubenswrapper[5120]: I0316 16:25:44.298890 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/5f1a58aa-0b5e-424c-84d6-c2cdc92ce046-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"5f1a58aa-0b5e-424c-84d6-c2cdc92ce046\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:25:44 crc kubenswrapper[5120]: I0316 16:25:44.299143 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/5f1a58aa-0b5e-424c-84d6-c2cdc92ce046-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"5f1a58aa-0b5e-424c-84d6-c2cdc92ce046\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:25:44 crc kubenswrapper[5120]: I0316 16:25:44.299498 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5f1a58aa-0b5e-424c-84d6-c2cdc92ce046-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"5f1a58aa-0b5e-424c-84d6-c2cdc92ce046\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:25:44 crc kubenswrapper[5120]: I0316 16:25:44.299569 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"ovsdbserver-nb-0\" (UID: \"5f1a58aa-0b5e-424c-84d6-c2cdc92ce046\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:25:44 crc kubenswrapper[5120]: I0316 16:25:44.401640 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/5f1a58aa-0b5e-424c-84d6-c2cdc92ce046-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"5f1a58aa-0b5e-424c-84d6-c2cdc92ce046\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:25:44 crc kubenswrapper[5120]: I0316 16:25:44.401709 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/5f1a58aa-0b5e-424c-84d6-c2cdc92ce046-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"5f1a58aa-0b5e-424c-84d6-c2cdc92ce046\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:25:44 crc kubenswrapper[5120]: I0316 16:25:44.402865 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/5f1a58aa-0b5e-424c-84d6-c2cdc92ce046-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"5f1a58aa-0b5e-424c-84d6-c2cdc92ce046\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:25:44 crc kubenswrapper[5120]: I0316 16:25:44.402955 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/5f1a58aa-0b5e-424c-84d6-c2cdc92ce046-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"5f1a58aa-0b5e-424c-84d6-c2cdc92ce046\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:25:44 crc kubenswrapper[5120]: I0316 16:25:44.403357 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5f1a58aa-0b5e-424c-84d6-c2cdc92ce046-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"5f1a58aa-0b5e-424c-84d6-c2cdc92ce046\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:25:44 crc kubenswrapper[5120]: I0316 16:25:44.403725 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"ovsdbserver-nb-0\" (UID: \"5f1a58aa-0b5e-424c-84d6-c2cdc92ce046\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:25:44 crc kubenswrapper[5120]: I0316 16:25:44.403849 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/5f1a58aa-0b5e-424c-84d6-c2cdc92ce046-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"5f1a58aa-0b5e-424c-84d6-c2cdc92ce046\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:25:44 crc kubenswrapper[5120]: I0316 16:25:44.403876 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5f1a58aa-0b5e-424c-84d6-c2cdc92ce046-config\") pod \"ovsdbserver-nb-0\" (UID: \"5f1a58aa-0b5e-424c-84d6-c2cdc92ce046\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:25:44 crc kubenswrapper[5120]: I0316 16:25:44.403907 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kjbpl\" (UniqueName: \"kubernetes.io/projected/5f1a58aa-0b5e-424c-84d6-c2cdc92ce046-kube-api-access-kjbpl\") pod \"ovsdbserver-nb-0\" (UID: \"5f1a58aa-0b5e-424c-84d6-c2cdc92ce046\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:25:44 crc kubenswrapper[5120]: I0316 16:25:44.404491 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"ovsdbserver-nb-0\" (UID: \"5f1a58aa-0b5e-424c-84d6-c2cdc92ce046\") device mount path \"/mnt/openstack/pv05\"" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:25:44 crc kubenswrapper[5120]: I0316 16:25:44.405469 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/5f1a58aa-0b5e-424c-84d6-c2cdc92ce046-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"5f1a58aa-0b5e-424c-84d6-c2cdc92ce046\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:25:44 crc kubenswrapper[5120]: I0316 16:25:44.405576 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5f1a58aa-0b5e-424c-84d6-c2cdc92ce046-config\") pod \"ovsdbserver-nb-0\" (UID: \"5f1a58aa-0b5e-424c-84d6-c2cdc92ce046\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:25:44 crc kubenswrapper[5120]: I0316 16:25:44.408392 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/5f1a58aa-0b5e-424c-84d6-c2cdc92ce046-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"5f1a58aa-0b5e-424c-84d6-c2cdc92ce046\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:25:44 crc kubenswrapper[5120]: I0316 16:25:44.409904 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/5f1a58aa-0b5e-424c-84d6-c2cdc92ce046-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"5f1a58aa-0b5e-424c-84d6-c2cdc92ce046\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:25:44 crc kubenswrapper[5120]: I0316 16:25:44.413375 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5f1a58aa-0b5e-424c-84d6-c2cdc92ce046-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"5f1a58aa-0b5e-424c-84d6-c2cdc92ce046\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:25:44 crc kubenswrapper[5120]: I0316 16:25:44.427065 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjbpl\" (UniqueName: \"kubernetes.io/projected/5f1a58aa-0b5e-424c-84d6-c2cdc92ce046-kube-api-access-kjbpl\") pod \"ovsdbserver-nb-0\" (UID: \"5f1a58aa-0b5e-424c-84d6-c2cdc92ce046\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:25:44 crc kubenswrapper[5120]: I0316 16:25:44.437609 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"ovsdbserver-nb-0\" (UID: \"5f1a58aa-0b5e-424c-84d6-c2cdc92ce046\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:25:44 crc kubenswrapper[5120]: I0316 16:25:44.500952 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:25:44 crc kubenswrapper[5120]: I0316 16:25:44.816638 5120 generic.go:358] "Generic (PLEG): container finished" podID="d4a96e7a-b22c-46b2-9fd4-9d8815d9f830" containerID="7cfc94fdd5733bd67d0af246197ff0cee02872b2035a14cf33ad03ce9b87935e" exitCode=0 Mar 16 16:25:44 crc kubenswrapper[5120]: I0316 16:25:44.816783 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"d4a96e7a-b22c-46b2-9fd4-9d8815d9f830","Type":"ContainerDied","Data":"7cfc94fdd5733bd67d0af246197ff0cee02872b2035a14cf33ad03ce9b87935e"} Mar 16 16:25:44 crc kubenswrapper[5120]: I0316 16:25:44.820091 5120 generic.go:358] "Generic (PLEG): container finished" podID="fa5682a3-5cb9-4da7-8588-678ba2537e0c" containerID="4c01701e23712013375dc91b22a0a1b617bf6e48412365659bdeded27e684262" exitCode=0 Mar 16 16:25:44 crc kubenswrapper[5120]: I0316 16:25:44.820186 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-2" event={"ID":"fa5682a3-5cb9-4da7-8588-678ba2537e0c","Type":"ContainerDied","Data":"4c01701e23712013375dc91b22a0a1b617bf6e48412365659bdeded27e684262"} Mar 16 16:25:44 crc kubenswrapper[5120]: I0316 16:25:44.825456 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-2" event={"ID":"51ac8589-b6a7-414d-94e5-731e217600c4","Type":"ContainerStarted","Data":"06cc9c752fc92ddfe80aca27a3714df85a220637bdd9e5ff98660c5f113511dc"} Mar 16 16:25:44 crc kubenswrapper[5120]: I0316 16:25:44.827854 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-1" event={"ID":"fdc6ab64-e478-46f4-8e4b-6bf2e4460d91","Type":"ContainerStarted","Data":"22bcc82ce48237f9410a024ede2e8c26cf4bb41d79f0bcc346c2026e82f50c35"} Mar 16 16:25:44 crc kubenswrapper[5120]: I0316 16:25:44.832692 5120 generic.go:358] "Generic (PLEG): container finished" podID="8690a5a2-3341-452e-8364-2e5e4072c192" containerID="d09c5615132d524e6ebe54947498408c78bca6eb878816dc2f76280340a9e5c9" exitCode=0 Mar 16 16:25:44 crc kubenswrapper[5120]: I0316 16:25:44.832816 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-1" event={"ID":"8690a5a2-3341-452e-8364-2e5e4072c192","Type":"ContainerDied","Data":"d09c5615132d524e6ebe54947498408c78bca6eb878816dc2f76280340a9e5c9"} Mar 16 16:25:44 crc kubenswrapper[5120]: I0316 16:25:44.839527 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"b2f689fd-70ec-43c9-b2da-275e28deb94c","Type":"ContainerStarted","Data":"d645e41c18aff7040aae9d448377581ed6f256ae5069078c1d8b5d8cdbb7cbea"} Mar 16 16:25:44 crc kubenswrapper[5120]: I0316 16:25:44.865052 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstack-galera-2" podStartSLOduration=8.865033633 podStartE2EDuration="8.865033633s" podCreationTimestamp="2026-03-16 16:25:36 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:25:44.859201918 +0000 UTC m=+3247.013133575" watchObservedRunningTime="2026-03-16 16:25:44.865033633 +0000 UTC m=+3247.018965290" Mar 16 16:25:44 crc kubenswrapper[5120]: I0316 16:25:44.945454 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstack-galera-1" podStartSLOduration=8.945422674 podStartE2EDuration="8.945422674s" podCreationTimestamp="2026-03-16 16:25:36 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:25:44.93333058 +0000 UTC m=+3247.087262247" watchObservedRunningTime="2026-03-16 16:25:44.945422674 +0000 UTC m=+3247.099354331" Mar 16 16:25:44 crc kubenswrapper[5120]: I0316 16:25:44.994274 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 16:25:45 crc kubenswrapper[5120]: I0316 16:25:45.004135 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstack-galera-0" podStartSLOduration=9.004115583 podStartE2EDuration="9.004115583s" podCreationTimestamp="2026-03-16 16:25:36 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:25:44.99388599 +0000 UTC m=+3247.147817647" watchObservedRunningTime="2026-03-16 16:25:45.004115583 +0000 UTC m=+3247.158047240" Mar 16 16:25:45 crc kubenswrapper[5120]: I0316 16:25:45.881723 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"d4a96e7a-b22c-46b2-9fd4-9d8815d9f830","Type":"ContainerStarted","Data":"67536b6d5411454dd60e69e85c9be26aac7288128b3d51416c45cd4056627842"} Mar 16 16:25:45 crc kubenswrapper[5120]: I0316 16:25:45.884237 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-2" event={"ID":"fa5682a3-5cb9-4da7-8588-678ba2537e0c","Type":"ContainerStarted","Data":"641f52ce7e26f90ddbe40cbed9d8e229e77faf2ef6ad82710e0ada5e487095d8"} Mar 16 16:25:45 crc kubenswrapper[5120]: I0316 16:25:45.889495 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"5f1a58aa-0b5e-424c-84d6-c2cdc92ce046","Type":"ContainerStarted","Data":"f82ed5c1d8af30522468a8d3607c34361c11bc4c9e5e0026dad9b12824677da4"} Mar 16 16:25:45 crc kubenswrapper[5120]: I0316 16:25:45.889544 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"5f1a58aa-0b5e-424c-84d6-c2cdc92ce046","Type":"ContainerStarted","Data":"05bdfd82f38eeac19c8042eec194130613916269cca59075e4255e557d7fd1ed"} Mar 16 16:25:45 crc kubenswrapper[5120]: I0316 16:25:45.889556 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"5f1a58aa-0b5e-424c-84d6-c2cdc92ce046","Type":"ContainerStarted","Data":"6e89a89d74245f6f2692c71a7ddc0a2bc33c315c3b0e3551d6f78de302cc892a"} Mar 16 16:25:45 crc kubenswrapper[5120]: I0316 16:25:45.891213 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-1" event={"ID":"8690a5a2-3341-452e-8364-2e5e4072c192","Type":"ContainerStarted","Data":"6e6cc6827a75b6a7267a1f48a96bcedc87a117cb4353ef6624dee5fe5204d958"} Mar 16 16:25:45 crc kubenswrapper[5120]: I0316 16:25:45.905059 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstack-cell1-galera-0" podStartSLOduration=8.905040851 podStartE2EDuration="8.905040851s" podCreationTimestamp="2026-03-16 16:25:37 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:25:45.903012236 +0000 UTC m=+3248.056943883" watchObservedRunningTime="2026-03-16 16:25:45.905040851 +0000 UTC m=+3248.058972508" Mar 16 16:25:45 crc kubenswrapper[5120]: I0316 16:25:45.930859 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstack-cell1-galera-1" podStartSLOduration=8.93083438 podStartE2EDuration="8.93083438s" podCreationTimestamp="2026-03-16 16:25:37 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:25:45.923609897 +0000 UTC m=+3248.077541554" watchObservedRunningTime="2026-03-16 16:25:45.93083438 +0000 UTC m=+3248.084766037" Mar 16 16:25:45 crc kubenswrapper[5120]: I0316 16:25:45.959817 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstack-cell1-galera-2" podStartSLOduration=8.959799725 podStartE2EDuration="8.959799725s" podCreationTimestamp="2026-03-16 16:25:37 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:25:45.956681832 +0000 UTC m=+3248.110613489" watchObservedRunningTime="2026-03-16 16:25:45.959799725 +0000 UTC m=+3248.113731392" Mar 16 16:25:45 crc kubenswrapper[5120]: I0316 16:25:45.977709 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podStartSLOduration=2.977688674 podStartE2EDuration="2.977688674s" podCreationTimestamp="2026-03-16 16:25:43 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:25:45.97082576 +0000 UTC m=+3248.124757417" watchObservedRunningTime="2026-03-16 16:25:45.977688674 +0000 UTC m=+3248.131620331" Mar 16 16:25:46 crc kubenswrapper[5120]: I0316 16:25:46.756536 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/memcached-0" Mar 16 16:25:47 crc kubenswrapper[5120]: I0316 16:25:47.220219 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 16:25:47 crc kubenswrapper[5120]: I0316 16:25:47.230549 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:25:47 crc kubenswrapper[5120]: I0316 16:25:47.233547 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ovncluster-ovndbcluster-sb-dockercfg-8fpph\"" Mar 16 16:25:47 crc kubenswrapper[5120]: I0316 16:25:47.236364 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ovndbcluster-sb-ovndbs\"" Mar 16 16:25:47 crc kubenswrapper[5120]: I0316 16:25:47.236805 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovndbcluster-sb-config\"" Mar 16 16:25:47 crc kubenswrapper[5120]: I0316 16:25:47.240171 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 16:25:47 crc kubenswrapper[5120]: I0316 16:25:47.241429 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovndbcluster-sb-scripts\"" Mar 16 16:25:47 crc kubenswrapper[5120]: I0316 16:25:47.392625 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/6ed22727-fd32-47c8-ae36-f80dddf5c720-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"6ed22727-fd32-47c8-ae36-f80dddf5c720\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:25:47 crc kubenswrapper[5120]: I0316 16:25:47.393194 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/6ed22727-fd32-47c8-ae36-f80dddf5c720-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"6ed22727-fd32-47c8-ae36-f80dddf5c720\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:25:47 crc kubenswrapper[5120]: I0316 16:25:47.393573 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/6ed22727-fd32-47c8-ae36-f80dddf5c720-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"6ed22727-fd32-47c8-ae36-f80dddf5c720\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:25:47 crc kubenswrapper[5120]: I0316 16:25:47.393957 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6ed22727-fd32-47c8-ae36-f80dddf5c720-config\") pod \"ovsdbserver-sb-0\" (UID: \"6ed22727-fd32-47c8-ae36-f80dddf5c720\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:25:47 crc kubenswrapper[5120]: I0316 16:25:47.394063 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/6ed22727-fd32-47c8-ae36-f80dddf5c720-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"6ed22727-fd32-47c8-ae36-f80dddf5c720\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:25:47 crc kubenswrapper[5120]: I0316 16:25:47.394228 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage19-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") pod \"ovsdbserver-sb-0\" (UID: \"6ed22727-fd32-47c8-ae36-f80dddf5c720\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:25:47 crc kubenswrapper[5120]: I0316 16:25:47.394312 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6ed22727-fd32-47c8-ae36-f80dddf5c720-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"6ed22727-fd32-47c8-ae36-f80dddf5c720\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:25:47 crc kubenswrapper[5120]: I0316 16:25:47.394522 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvh6h\" (UniqueName: \"kubernetes.io/projected/6ed22727-fd32-47c8-ae36-f80dddf5c720-kube-api-access-pvh6h\") pod \"ovsdbserver-sb-0\" (UID: \"6ed22727-fd32-47c8-ae36-f80dddf5c720\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:25:47 crc kubenswrapper[5120]: I0316 16:25:47.496300 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6ed22727-fd32-47c8-ae36-f80dddf5c720-config\") pod \"ovsdbserver-sb-0\" (UID: \"6ed22727-fd32-47c8-ae36-f80dddf5c720\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:25:47 crc kubenswrapper[5120]: I0316 16:25:47.496396 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/6ed22727-fd32-47c8-ae36-f80dddf5c720-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"6ed22727-fd32-47c8-ae36-f80dddf5c720\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:25:47 crc kubenswrapper[5120]: I0316 16:25:47.496459 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage19-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") pod \"ovsdbserver-sb-0\" (UID: \"6ed22727-fd32-47c8-ae36-f80dddf5c720\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:25:47 crc kubenswrapper[5120]: I0316 16:25:47.496492 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6ed22727-fd32-47c8-ae36-f80dddf5c720-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"6ed22727-fd32-47c8-ae36-f80dddf5c720\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:25:47 crc kubenswrapper[5120]: I0316 16:25:47.496548 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pvh6h\" (UniqueName: \"kubernetes.io/projected/6ed22727-fd32-47c8-ae36-f80dddf5c720-kube-api-access-pvh6h\") pod \"ovsdbserver-sb-0\" (UID: \"6ed22727-fd32-47c8-ae36-f80dddf5c720\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:25:47 crc kubenswrapper[5120]: I0316 16:25:47.496614 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/6ed22727-fd32-47c8-ae36-f80dddf5c720-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"6ed22727-fd32-47c8-ae36-f80dddf5c720\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:25:47 crc kubenswrapper[5120]: I0316 16:25:47.496670 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/6ed22727-fd32-47c8-ae36-f80dddf5c720-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"6ed22727-fd32-47c8-ae36-f80dddf5c720\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:25:47 crc kubenswrapper[5120]: I0316 16:25:47.496806 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/6ed22727-fd32-47c8-ae36-f80dddf5c720-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"6ed22727-fd32-47c8-ae36-f80dddf5c720\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:25:47 crc kubenswrapper[5120]: I0316 16:25:47.497092 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage19-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") pod \"ovsdbserver-sb-0\" (UID: \"6ed22727-fd32-47c8-ae36-f80dddf5c720\") device mount path \"/mnt/openstack/pv19\"" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:25:47 crc kubenswrapper[5120]: I0316 16:25:47.497483 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/6ed22727-fd32-47c8-ae36-f80dddf5c720-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"6ed22727-fd32-47c8-ae36-f80dddf5c720\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:25:47 crc kubenswrapper[5120]: I0316 16:25:47.497494 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6ed22727-fd32-47c8-ae36-f80dddf5c720-config\") pod \"ovsdbserver-sb-0\" (UID: \"6ed22727-fd32-47c8-ae36-f80dddf5c720\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:25:47 crc kubenswrapper[5120]: I0316 16:25:47.498755 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/6ed22727-fd32-47c8-ae36-f80dddf5c720-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"6ed22727-fd32-47c8-ae36-f80dddf5c720\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:25:47 crc kubenswrapper[5120]: I0316 16:25:47.501711 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:25:47 crc kubenswrapper[5120]: I0316 16:25:47.502841 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/6ed22727-fd32-47c8-ae36-f80dddf5c720-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"6ed22727-fd32-47c8-ae36-f80dddf5c720\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:25:47 crc kubenswrapper[5120]: I0316 16:25:47.503102 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/6ed22727-fd32-47c8-ae36-f80dddf5c720-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"6ed22727-fd32-47c8-ae36-f80dddf5c720\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:25:47 crc kubenswrapper[5120]: I0316 16:25:47.511045 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6ed22727-fd32-47c8-ae36-f80dddf5c720-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"6ed22727-fd32-47c8-ae36-f80dddf5c720\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:25:47 crc kubenswrapper[5120]: I0316 16:25:47.516652 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvh6h\" (UniqueName: \"kubernetes.io/projected/6ed22727-fd32-47c8-ae36-f80dddf5c720-kube-api-access-pvh6h\") pod \"ovsdbserver-sb-0\" (UID: \"6ed22727-fd32-47c8-ae36-f80dddf5c720\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:25:47 crc kubenswrapper[5120]: I0316 16:25:47.541409 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage19-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") pod \"ovsdbserver-sb-0\" (UID: \"6ed22727-fd32-47c8-ae36-f80dddf5c720\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:25:47 crc kubenswrapper[5120]: I0316 16:25:47.565371 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:25:47 crc kubenswrapper[5120]: I0316 16:25:47.795700 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:25:47 crc kubenswrapper[5120]: I0316 16:25:47.795981 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:25:47 crc kubenswrapper[5120]: W0316 16:25:47.992633 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6ed22727_fd32_47c8_ae36_f80dddf5c720.slice/crio-825b29cb1bfa0d48a1722298bd8c938a48828d200b785377b7bf0ad2a6cc4efc WatchSource:0}: Error finding container 825b29cb1bfa0d48a1722298bd8c938a48828d200b785377b7bf0ad2a6cc4efc: Status 404 returned error can't find the container with id 825b29cb1bfa0d48a1722298bd8c938a48828d200b785377b7bf0ad2a6cc4efc Mar 16 16:25:48 crc kubenswrapper[5120]: I0316 16:25:48.000528 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 16:25:48 crc kubenswrapper[5120]: I0316 16:25:48.157556 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/openstack-galera-2" Mar 16 16:25:48 crc kubenswrapper[5120]: I0316 16:25:48.157820 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/openstack-galera-2" Mar 16 16:25:48 crc kubenswrapper[5120]: I0316 16:25:48.469941 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/openstack-galera-1" Mar 16 16:25:48 crc kubenswrapper[5120]: I0316 16:25:48.469987 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/openstack-galera-1" Mar 16 16:25:48 crc kubenswrapper[5120]: I0316 16:25:48.925555 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"6ed22727-fd32-47c8-ae36-f80dddf5c720","Type":"ContainerStarted","Data":"7034d7226b348e254095effb353147b9fc1991d1469e66b85c58a896fe62472f"} Mar 16 16:25:48 crc kubenswrapper[5120]: I0316 16:25:48.925957 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"6ed22727-fd32-47c8-ae36-f80dddf5c720","Type":"ContainerStarted","Data":"e99e3ae5101bdbc62ad21f612132580274e93c17121c53266efb9314890ae18d"} Mar 16 16:25:48 crc kubenswrapper[5120]: I0316 16:25:48.925980 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"6ed22727-fd32-47c8-ae36-f80dddf5c720","Type":"ContainerStarted","Data":"825b29cb1bfa0d48a1722298bd8c938a48828d200b785377b7bf0ad2a6cc4efc"} Mar 16 16:25:48 crc kubenswrapper[5120]: I0316 16:25:48.947132 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podStartSLOduration=2.947113558 podStartE2EDuration="2.947113558s" podCreationTimestamp="2026-03-16 16:25:46 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:25:48.945629859 +0000 UTC m=+3251.099561516" watchObservedRunningTime="2026-03-16 16:25:48.947113558 +0000 UTC m=+3251.101045215" Mar 16 16:25:49 crc kubenswrapper[5120]: I0316 16:25:49.291591 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:25:49 crc kubenswrapper[5120]: I0316 16:25:49.291630 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:25:49 crc kubenswrapper[5120]: I0316 16:25:49.347388 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/openstack-cell1-galera-2" Mar 16 16:25:49 crc kubenswrapper[5120]: I0316 16:25:49.347427 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/openstack-cell1-galera-2" Mar 16 16:25:49 crc kubenswrapper[5120]: I0316 16:25:49.394741 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/openstack-cell1-galera-1" Mar 16 16:25:49 crc kubenswrapper[5120]: I0316 16:25:49.394868 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/openstack-cell1-galera-1" Mar 16 16:25:49 crc kubenswrapper[5120]: I0316 16:25:49.501520 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:25:50 crc kubenswrapper[5120]: I0316 16:25:50.543889 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:25:50 crc kubenswrapper[5120]: I0316 16:25:50.566299 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:25:50 crc kubenswrapper[5120]: I0316 16:25:50.601352 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:25:52 crc kubenswrapper[5120]: I0316 16:25:52.242476 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/openstack-galera-2" Mar 16 16:25:52 crc kubenswrapper[5120]: I0316 16:25:52.328118 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/openstack-galera-2" Mar 16 16:25:52 crc kubenswrapper[5120]: I0316 16:25:52.566244 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:25:52 crc kubenswrapper[5120]: I0316 16:25:52.732802 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 16:25:52 crc kubenswrapper[5120]: I0316 16:25:52.743127 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:25:52 crc kubenswrapper[5120]: I0316 16:25:52.746362 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"swift-ring-files\"" Mar 16 16:25:52 crc kubenswrapper[5120]: I0316 16:25:52.746703 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"swift-conf\"" Mar 16 16:25:52 crc kubenswrapper[5120]: I0316 16:25:52.747096 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"swift-storage-config-data\"" Mar 16 16:25:52 crc kubenswrapper[5120]: I0316 16:25:52.747448 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"swift-swift-dockercfg-5fglt\"" Mar 16 16:25:52 crc kubenswrapper[5120]: I0316 16:25:52.772632 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 16:25:52 crc kubenswrapper[5120]: I0316 16:25:52.829599 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khj44\" (UniqueName: \"kubernetes.io/projected/e4c4e515-3d7d-4436-ab79-c7c6e2bf2867-kube-api-access-khj44\") pod \"swift-storage-0\" (UID: \"e4c4e515-3d7d-4436-ab79-c7c6e2bf2867\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:25:52 crc kubenswrapper[5120]: I0316 16:25:52.829675 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/e4c4e515-3d7d-4436-ab79-c7c6e2bf2867-etc-swift\") pod \"swift-storage-0\" (UID: \"e4c4e515-3d7d-4436-ab79-c7c6e2bf2867\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:25:52 crc kubenswrapper[5120]: I0316 16:25:52.829889 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/e4c4e515-3d7d-4436-ab79-c7c6e2bf2867-lock\") pod \"swift-storage-0\" (UID: \"e4c4e515-3d7d-4436-ab79-c7c6e2bf2867\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:25:52 crc kubenswrapper[5120]: I0316 16:25:52.829965 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/e4c4e515-3d7d-4436-ab79-c7c6e2bf2867-cache\") pod \"swift-storage-0\" (UID: \"e4c4e515-3d7d-4436-ab79-c7c6e2bf2867\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:25:52 crc kubenswrapper[5120]: I0316 16:25:52.829994 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e4c4e515-3d7d-4436-ab79-c7c6e2bf2867-combined-ca-bundle\") pod \"swift-storage-0\" (UID: \"e4c4e515-3d7d-4436-ab79-c7c6e2bf2867\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:25:52 crc kubenswrapper[5120]: I0316 16:25:52.830199 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"swift-storage-0\" (UID: \"e4c4e515-3d7d-4436-ab79-c7c6e2bf2867\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:25:52 crc kubenswrapper[5120]: I0316 16:25:52.932433 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"swift-storage-0\" (UID: \"e4c4e515-3d7d-4436-ab79-c7c6e2bf2867\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:25:52 crc kubenswrapper[5120]: I0316 16:25:52.932684 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-khj44\" (UniqueName: \"kubernetes.io/projected/e4c4e515-3d7d-4436-ab79-c7c6e2bf2867-kube-api-access-khj44\") pod \"swift-storage-0\" (UID: \"e4c4e515-3d7d-4436-ab79-c7c6e2bf2867\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:25:52 crc kubenswrapper[5120]: I0316 16:25:52.932750 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/e4c4e515-3d7d-4436-ab79-c7c6e2bf2867-etc-swift\") pod \"swift-storage-0\" (UID: \"e4c4e515-3d7d-4436-ab79-c7c6e2bf2867\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:25:52 crc kubenswrapper[5120]: I0316 16:25:52.932835 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/e4c4e515-3d7d-4436-ab79-c7c6e2bf2867-lock\") pod \"swift-storage-0\" (UID: \"e4c4e515-3d7d-4436-ab79-c7c6e2bf2867\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:25:52 crc kubenswrapper[5120]: I0316 16:25:52.932866 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/e4c4e515-3d7d-4436-ab79-c7c6e2bf2867-cache\") pod \"swift-storage-0\" (UID: \"e4c4e515-3d7d-4436-ab79-c7c6e2bf2867\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:25:52 crc kubenswrapper[5120]: I0316 16:25:52.932958 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"swift-storage-0\" (UID: \"e4c4e515-3d7d-4436-ab79-c7c6e2bf2867\") device mount path \"/mnt/openstack/pv10\"" pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:25:52 crc kubenswrapper[5120]: I0316 16:25:52.933034 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e4c4e515-3d7d-4436-ab79-c7c6e2bf2867-combined-ca-bundle\") pod \"swift-storage-0\" (UID: \"e4c4e515-3d7d-4436-ab79-c7c6e2bf2867\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:25:52 crc kubenswrapper[5120]: E0316 16:25:52.933032 5120 projected.go:289] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Mar 16 16:25:52 crc kubenswrapper[5120]: E0316 16:25:52.933959 5120 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Mar 16 16:25:52 crc kubenswrapper[5120]: I0316 16:25:52.933447 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/e4c4e515-3d7d-4436-ab79-c7c6e2bf2867-lock\") pod \"swift-storage-0\" (UID: \"e4c4e515-3d7d-4436-ab79-c7c6e2bf2867\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:25:52 crc kubenswrapper[5120]: I0316 16:25:52.933527 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/e4c4e515-3d7d-4436-ab79-c7c6e2bf2867-cache\") pod \"swift-storage-0\" (UID: \"e4c4e515-3d7d-4436-ab79-c7c6e2bf2867\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:25:52 crc kubenswrapper[5120]: E0316 16:25:52.934022 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e4c4e515-3d7d-4436-ab79-c7c6e2bf2867-etc-swift podName:e4c4e515-3d7d-4436-ab79-c7c6e2bf2867 nodeName:}" failed. No retries permitted until 2026-03-16 16:25:53.434001326 +0000 UTC m=+3255.587932993 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/e4c4e515-3d7d-4436-ab79-c7c6e2bf2867-etc-swift") pod "swift-storage-0" (UID: "e4c4e515-3d7d-4436-ab79-c7c6e2bf2867") : configmap "swift-ring-files" not found Mar 16 16:25:52 crc kubenswrapper[5120]: I0316 16:25:52.939705 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e4c4e515-3d7d-4436-ab79-c7c6e2bf2867-combined-ca-bundle\") pod \"swift-storage-0\" (UID: \"e4c4e515-3d7d-4436-ab79-c7c6e2bf2867\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:25:52 crc kubenswrapper[5120]: I0316 16:25:52.966326 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"swift-storage-0\" (UID: \"e4c4e515-3d7d-4436-ab79-c7c6e2bf2867\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:25:52 crc kubenswrapper[5120]: I0316 16:25:52.990459 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-khj44\" (UniqueName: \"kubernetes.io/projected/e4c4e515-3d7d-4436-ab79-c7c6e2bf2867-kube-api-access-khj44\") pod \"swift-storage-0\" (UID: \"e4c4e515-3d7d-4436-ab79-c7c6e2bf2867\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:25:53 crc kubenswrapper[5120]: I0316 16:25:53.188977 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-7lh68"] Mar 16 16:25:53 crc kubenswrapper[5120]: I0316 16:25:53.198178 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-7lh68" Mar 16 16:25:53 crc kubenswrapper[5120]: I0316 16:25:53.200884 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"swift-proxy-config-data\"" Mar 16 16:25:53 crc kubenswrapper[5120]: I0316 16:25:53.201207 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"swift-ring-config-data\"" Mar 16 16:25:53 crc kubenswrapper[5120]: I0316 16:25:53.203128 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"swift-ring-scripts\"" Mar 16 16:25:53 crc kubenswrapper[5120]: I0316 16:25:53.218953 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-7lh68"] Mar 16 16:25:53 crc kubenswrapper[5120]: E0316 16:25:53.219524 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[combined-ca-bundle dispersionconf etc-swift kube-api-access-bn9rh ring-data-devices scripts swiftconf], unattached volumes=[], failed to process volumes=[combined-ca-bundle dispersionconf etc-swift kube-api-access-bn9rh ring-data-devices scripts swiftconf]: context canceled" pod="openstack-kuttl-tests/swift-ring-rebalance-7lh68" podUID="2e8b6c0c-ae02-4fe4-affa-80405f6754d1" Mar 16 16:25:53 crc kubenswrapper[5120]: I0316 16:25:53.230646 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-cv9jf"] Mar 16 16:25:53 crc kubenswrapper[5120]: I0316 16:25:53.237754 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-cv9jf" Mar 16 16:25:53 crc kubenswrapper[5120]: I0316 16:25:53.239743 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/2e8b6c0c-ae02-4fe4-affa-80405f6754d1-ring-data-devices\") pod \"swift-ring-rebalance-7lh68\" (UID: \"2e8b6c0c-ae02-4fe4-affa-80405f6754d1\") " pod="openstack-kuttl-tests/swift-ring-rebalance-7lh68" Mar 16 16:25:53 crc kubenswrapper[5120]: I0316 16:25:53.240436 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/2e8b6c0c-ae02-4fe4-affa-80405f6754d1-swiftconf\") pod \"swift-ring-rebalance-7lh68\" (UID: \"2e8b6c0c-ae02-4fe4-affa-80405f6754d1\") " pod="openstack-kuttl-tests/swift-ring-rebalance-7lh68" Mar 16 16:25:53 crc kubenswrapper[5120]: I0316 16:25:53.240504 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/2e8b6c0c-ae02-4fe4-affa-80405f6754d1-dispersionconf\") pod \"swift-ring-rebalance-7lh68\" (UID: \"2e8b6c0c-ae02-4fe4-affa-80405f6754d1\") " pod="openstack-kuttl-tests/swift-ring-rebalance-7lh68" Mar 16 16:25:53 crc kubenswrapper[5120]: I0316 16:25:53.240602 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2e8b6c0c-ae02-4fe4-affa-80405f6754d1-combined-ca-bundle\") pod \"swift-ring-rebalance-7lh68\" (UID: \"2e8b6c0c-ae02-4fe4-affa-80405f6754d1\") " pod="openstack-kuttl-tests/swift-ring-rebalance-7lh68" Mar 16 16:25:53 crc kubenswrapper[5120]: I0316 16:25:53.240717 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bn9rh\" (UniqueName: \"kubernetes.io/projected/2e8b6c0c-ae02-4fe4-affa-80405f6754d1-kube-api-access-bn9rh\") pod \"swift-ring-rebalance-7lh68\" (UID: \"2e8b6c0c-ae02-4fe4-affa-80405f6754d1\") " pod="openstack-kuttl-tests/swift-ring-rebalance-7lh68" Mar 16 16:25:53 crc kubenswrapper[5120]: I0316 16:25:53.240837 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/2e8b6c0c-ae02-4fe4-affa-80405f6754d1-scripts\") pod \"swift-ring-rebalance-7lh68\" (UID: \"2e8b6c0c-ae02-4fe4-affa-80405f6754d1\") " pod="openstack-kuttl-tests/swift-ring-rebalance-7lh68" Mar 16 16:25:53 crc kubenswrapper[5120]: I0316 16:25:53.241169 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/2e8b6c0c-ae02-4fe4-affa-80405f6754d1-etc-swift\") pod \"swift-ring-rebalance-7lh68\" (UID: \"2e8b6c0c-ae02-4fe4-affa-80405f6754d1\") " pod="openstack-kuttl-tests/swift-ring-rebalance-7lh68" Mar 16 16:25:53 crc kubenswrapper[5120]: I0316 16:25:53.244077 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-7lh68"] Mar 16 16:25:53 crc kubenswrapper[5120]: I0316 16:25:53.261380 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-cv9jf"] Mar 16 16:25:53 crc kubenswrapper[5120]: I0316 16:25:53.342645 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84jqd\" (UniqueName: \"kubernetes.io/projected/41065d35-2cc8-4b66-9767-3fdb3e5e5691-kube-api-access-84jqd\") pod \"swift-ring-rebalance-cv9jf\" (UID: \"41065d35-2cc8-4b66-9767-3fdb3e5e5691\") " pod="openstack-kuttl-tests/swift-ring-rebalance-cv9jf" Mar 16 16:25:53 crc kubenswrapper[5120]: I0316 16:25:53.342908 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2e8b6c0c-ae02-4fe4-affa-80405f6754d1-combined-ca-bundle\") pod \"swift-ring-rebalance-7lh68\" (UID: \"2e8b6c0c-ae02-4fe4-affa-80405f6754d1\") " pod="openstack-kuttl-tests/swift-ring-rebalance-7lh68" Mar 16 16:25:53 crc kubenswrapper[5120]: I0316 16:25:53.343020 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bn9rh\" (UniqueName: \"kubernetes.io/projected/2e8b6c0c-ae02-4fe4-affa-80405f6754d1-kube-api-access-bn9rh\") pod \"swift-ring-rebalance-7lh68\" (UID: \"2e8b6c0c-ae02-4fe4-affa-80405f6754d1\") " pod="openstack-kuttl-tests/swift-ring-rebalance-7lh68" Mar 16 16:25:53 crc kubenswrapper[5120]: I0316 16:25:53.343117 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/41065d35-2cc8-4b66-9767-3fdb3e5e5691-dispersionconf\") pod \"swift-ring-rebalance-cv9jf\" (UID: \"41065d35-2cc8-4b66-9767-3fdb3e5e5691\") " pod="openstack-kuttl-tests/swift-ring-rebalance-cv9jf" Mar 16 16:25:53 crc kubenswrapper[5120]: I0316 16:25:53.343265 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/2e8b6c0c-ae02-4fe4-affa-80405f6754d1-scripts\") pod \"swift-ring-rebalance-7lh68\" (UID: \"2e8b6c0c-ae02-4fe4-affa-80405f6754d1\") " pod="openstack-kuttl-tests/swift-ring-rebalance-7lh68" Mar 16 16:25:53 crc kubenswrapper[5120]: I0316 16:25:53.343408 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/41065d35-2cc8-4b66-9767-3fdb3e5e5691-ring-data-devices\") pod \"swift-ring-rebalance-cv9jf\" (UID: \"41065d35-2cc8-4b66-9767-3fdb3e5e5691\") " pod="openstack-kuttl-tests/swift-ring-rebalance-cv9jf" Mar 16 16:25:53 crc kubenswrapper[5120]: I0316 16:25:53.343515 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/41065d35-2cc8-4b66-9767-3fdb3e5e5691-etc-swift\") pod \"swift-ring-rebalance-cv9jf\" (UID: \"41065d35-2cc8-4b66-9767-3fdb3e5e5691\") " pod="openstack-kuttl-tests/swift-ring-rebalance-cv9jf" Mar 16 16:25:53 crc kubenswrapper[5120]: I0316 16:25:53.343684 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/41065d35-2cc8-4b66-9767-3fdb3e5e5691-swiftconf\") pod \"swift-ring-rebalance-cv9jf\" (UID: \"41065d35-2cc8-4b66-9767-3fdb3e5e5691\") " pod="openstack-kuttl-tests/swift-ring-rebalance-cv9jf" Mar 16 16:25:53 crc kubenswrapper[5120]: I0316 16:25:53.343809 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/41065d35-2cc8-4b66-9767-3fdb3e5e5691-scripts\") pod \"swift-ring-rebalance-cv9jf\" (UID: \"41065d35-2cc8-4b66-9767-3fdb3e5e5691\") " pod="openstack-kuttl-tests/swift-ring-rebalance-cv9jf" Mar 16 16:25:53 crc kubenswrapper[5120]: I0316 16:25:53.343870 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/41065d35-2cc8-4b66-9767-3fdb3e5e5691-combined-ca-bundle\") pod \"swift-ring-rebalance-cv9jf\" (UID: \"41065d35-2cc8-4b66-9767-3fdb3e5e5691\") " pod="openstack-kuttl-tests/swift-ring-rebalance-cv9jf" Mar 16 16:25:53 crc kubenswrapper[5120]: I0316 16:25:53.344030 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/2e8b6c0c-ae02-4fe4-affa-80405f6754d1-etc-swift\") pod \"swift-ring-rebalance-7lh68\" (UID: \"2e8b6c0c-ae02-4fe4-affa-80405f6754d1\") " pod="openstack-kuttl-tests/swift-ring-rebalance-7lh68" Mar 16 16:25:53 crc kubenswrapper[5120]: I0316 16:25:53.344158 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/2e8b6c0c-ae02-4fe4-affa-80405f6754d1-ring-data-devices\") pod \"swift-ring-rebalance-7lh68\" (UID: \"2e8b6c0c-ae02-4fe4-affa-80405f6754d1\") " pod="openstack-kuttl-tests/swift-ring-rebalance-7lh68" Mar 16 16:25:53 crc kubenswrapper[5120]: I0316 16:25:53.344189 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/2e8b6c0c-ae02-4fe4-affa-80405f6754d1-swiftconf\") pod \"swift-ring-rebalance-7lh68\" (UID: \"2e8b6c0c-ae02-4fe4-affa-80405f6754d1\") " pod="openstack-kuttl-tests/swift-ring-rebalance-7lh68" Mar 16 16:25:53 crc kubenswrapper[5120]: I0316 16:25:53.344264 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/2e8b6c0c-ae02-4fe4-affa-80405f6754d1-dispersionconf\") pod \"swift-ring-rebalance-7lh68\" (UID: \"2e8b6c0c-ae02-4fe4-affa-80405f6754d1\") " pod="openstack-kuttl-tests/swift-ring-rebalance-7lh68" Mar 16 16:25:53 crc kubenswrapper[5120]: I0316 16:25:53.344435 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/2e8b6c0c-ae02-4fe4-affa-80405f6754d1-etc-swift\") pod \"swift-ring-rebalance-7lh68\" (UID: \"2e8b6c0c-ae02-4fe4-affa-80405f6754d1\") " pod="openstack-kuttl-tests/swift-ring-rebalance-7lh68" Mar 16 16:25:53 crc kubenswrapper[5120]: I0316 16:25:53.344690 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/2e8b6c0c-ae02-4fe4-affa-80405f6754d1-scripts\") pod \"swift-ring-rebalance-7lh68\" (UID: \"2e8b6c0c-ae02-4fe4-affa-80405f6754d1\") " pod="openstack-kuttl-tests/swift-ring-rebalance-7lh68" Mar 16 16:25:53 crc kubenswrapper[5120]: I0316 16:25:53.344948 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/2e8b6c0c-ae02-4fe4-affa-80405f6754d1-ring-data-devices\") pod \"swift-ring-rebalance-7lh68\" (UID: \"2e8b6c0c-ae02-4fe4-affa-80405f6754d1\") " pod="openstack-kuttl-tests/swift-ring-rebalance-7lh68" Mar 16 16:25:53 crc kubenswrapper[5120]: I0316 16:25:53.348019 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2e8b6c0c-ae02-4fe4-affa-80405f6754d1-combined-ca-bundle\") pod \"swift-ring-rebalance-7lh68\" (UID: \"2e8b6c0c-ae02-4fe4-affa-80405f6754d1\") " pod="openstack-kuttl-tests/swift-ring-rebalance-7lh68" Mar 16 16:25:53 crc kubenswrapper[5120]: I0316 16:25:53.348609 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/2e8b6c0c-ae02-4fe4-affa-80405f6754d1-swiftconf\") pod \"swift-ring-rebalance-7lh68\" (UID: \"2e8b6c0c-ae02-4fe4-affa-80405f6754d1\") " pod="openstack-kuttl-tests/swift-ring-rebalance-7lh68" Mar 16 16:25:53 crc kubenswrapper[5120]: I0316 16:25:53.349935 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/2e8b6c0c-ae02-4fe4-affa-80405f6754d1-dispersionconf\") pod \"swift-ring-rebalance-7lh68\" (UID: \"2e8b6c0c-ae02-4fe4-affa-80405f6754d1\") " pod="openstack-kuttl-tests/swift-ring-rebalance-7lh68" Mar 16 16:25:53 crc kubenswrapper[5120]: I0316 16:25:53.361034 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bn9rh\" (UniqueName: \"kubernetes.io/projected/2e8b6c0c-ae02-4fe4-affa-80405f6754d1-kube-api-access-bn9rh\") pod \"swift-ring-rebalance-7lh68\" (UID: \"2e8b6c0c-ae02-4fe4-affa-80405f6754d1\") " pod="openstack-kuttl-tests/swift-ring-rebalance-7lh68" Mar 16 16:25:53 crc kubenswrapper[5120]: I0316 16:25:53.445480 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/41065d35-2cc8-4b66-9767-3fdb3e5e5691-ring-data-devices\") pod \"swift-ring-rebalance-cv9jf\" (UID: \"41065d35-2cc8-4b66-9767-3fdb3e5e5691\") " pod="openstack-kuttl-tests/swift-ring-rebalance-cv9jf" Mar 16 16:25:53 crc kubenswrapper[5120]: I0316 16:25:53.445536 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/41065d35-2cc8-4b66-9767-3fdb3e5e5691-etc-swift\") pod \"swift-ring-rebalance-cv9jf\" (UID: \"41065d35-2cc8-4b66-9767-3fdb3e5e5691\") " pod="openstack-kuttl-tests/swift-ring-rebalance-cv9jf" Mar 16 16:25:53 crc kubenswrapper[5120]: I0316 16:25:53.445562 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/41065d35-2cc8-4b66-9767-3fdb3e5e5691-swiftconf\") pod \"swift-ring-rebalance-cv9jf\" (UID: \"41065d35-2cc8-4b66-9767-3fdb3e5e5691\") " pod="openstack-kuttl-tests/swift-ring-rebalance-cv9jf" Mar 16 16:25:53 crc kubenswrapper[5120]: I0316 16:25:53.445599 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/41065d35-2cc8-4b66-9767-3fdb3e5e5691-scripts\") pod \"swift-ring-rebalance-cv9jf\" (UID: \"41065d35-2cc8-4b66-9767-3fdb3e5e5691\") " pod="openstack-kuttl-tests/swift-ring-rebalance-cv9jf" Mar 16 16:25:53 crc kubenswrapper[5120]: I0316 16:25:53.445642 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/41065d35-2cc8-4b66-9767-3fdb3e5e5691-combined-ca-bundle\") pod \"swift-ring-rebalance-cv9jf\" (UID: \"41065d35-2cc8-4b66-9767-3fdb3e5e5691\") " pod="openstack-kuttl-tests/swift-ring-rebalance-cv9jf" Mar 16 16:25:53 crc kubenswrapper[5120]: I0316 16:25:53.445742 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/e4c4e515-3d7d-4436-ab79-c7c6e2bf2867-etc-swift\") pod \"swift-storage-0\" (UID: \"e4c4e515-3d7d-4436-ab79-c7c6e2bf2867\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:25:53 crc kubenswrapper[5120]: I0316 16:25:53.445874 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-84jqd\" (UniqueName: \"kubernetes.io/projected/41065d35-2cc8-4b66-9767-3fdb3e5e5691-kube-api-access-84jqd\") pod \"swift-ring-rebalance-cv9jf\" (UID: \"41065d35-2cc8-4b66-9767-3fdb3e5e5691\") " pod="openstack-kuttl-tests/swift-ring-rebalance-cv9jf" Mar 16 16:25:53 crc kubenswrapper[5120]: I0316 16:25:53.445953 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/41065d35-2cc8-4b66-9767-3fdb3e5e5691-dispersionconf\") pod \"swift-ring-rebalance-cv9jf\" (UID: \"41065d35-2cc8-4b66-9767-3fdb3e5e5691\") " pod="openstack-kuttl-tests/swift-ring-rebalance-cv9jf" Mar 16 16:25:53 crc kubenswrapper[5120]: I0316 16:25:53.446923 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/41065d35-2cc8-4b66-9767-3fdb3e5e5691-etc-swift\") pod \"swift-ring-rebalance-cv9jf\" (UID: \"41065d35-2cc8-4b66-9767-3fdb3e5e5691\") " pod="openstack-kuttl-tests/swift-ring-rebalance-cv9jf" Mar 16 16:25:53 crc kubenswrapper[5120]: I0316 16:25:53.447010 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/41065d35-2cc8-4b66-9767-3fdb3e5e5691-scripts\") pod \"swift-ring-rebalance-cv9jf\" (UID: \"41065d35-2cc8-4b66-9767-3fdb3e5e5691\") " pod="openstack-kuttl-tests/swift-ring-rebalance-cv9jf" Mar 16 16:25:53 crc kubenswrapper[5120]: E0316 16:25:53.447097 5120 projected.go:289] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Mar 16 16:25:53 crc kubenswrapper[5120]: E0316 16:25:53.447114 5120 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Mar 16 16:25:53 crc kubenswrapper[5120]: I0316 16:25:53.447117 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/41065d35-2cc8-4b66-9767-3fdb3e5e5691-ring-data-devices\") pod \"swift-ring-rebalance-cv9jf\" (UID: \"41065d35-2cc8-4b66-9767-3fdb3e5e5691\") " pod="openstack-kuttl-tests/swift-ring-rebalance-cv9jf" Mar 16 16:25:53 crc kubenswrapper[5120]: E0316 16:25:53.447153 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e4c4e515-3d7d-4436-ab79-c7c6e2bf2867-etc-swift podName:e4c4e515-3d7d-4436-ab79-c7c6e2bf2867 nodeName:}" failed. No retries permitted until 2026-03-16 16:25:54.447141531 +0000 UTC m=+3256.601073188 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/e4c4e515-3d7d-4436-ab79-c7c6e2bf2867-etc-swift") pod "swift-storage-0" (UID: "e4c4e515-3d7d-4436-ab79-c7c6e2bf2867") : configmap "swift-ring-files" not found Mar 16 16:25:53 crc kubenswrapper[5120]: I0316 16:25:53.449745 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/41065d35-2cc8-4b66-9767-3fdb3e5e5691-dispersionconf\") pod \"swift-ring-rebalance-cv9jf\" (UID: \"41065d35-2cc8-4b66-9767-3fdb3e5e5691\") " pod="openstack-kuttl-tests/swift-ring-rebalance-cv9jf" Mar 16 16:25:53 crc kubenswrapper[5120]: I0316 16:25:53.451666 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/41065d35-2cc8-4b66-9767-3fdb3e5e5691-swiftconf\") pod \"swift-ring-rebalance-cv9jf\" (UID: \"41065d35-2cc8-4b66-9767-3fdb3e5e5691\") " pod="openstack-kuttl-tests/swift-ring-rebalance-cv9jf" Mar 16 16:25:53 crc kubenswrapper[5120]: I0316 16:25:53.452796 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/41065d35-2cc8-4b66-9767-3fdb3e5e5691-combined-ca-bundle\") pod \"swift-ring-rebalance-cv9jf\" (UID: \"41065d35-2cc8-4b66-9767-3fdb3e5e5691\") " pod="openstack-kuttl-tests/swift-ring-rebalance-cv9jf" Mar 16 16:25:53 crc kubenswrapper[5120]: I0316 16:25:53.466221 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-84jqd\" (UniqueName: \"kubernetes.io/projected/41065d35-2cc8-4b66-9767-3fdb3e5e5691-kube-api-access-84jqd\") pod \"swift-ring-rebalance-cv9jf\" (UID: \"41065d35-2cc8-4b66-9767-3fdb3e5e5691\") " pod="openstack-kuttl-tests/swift-ring-rebalance-cv9jf" Mar 16 16:25:53 crc kubenswrapper[5120]: I0316 16:25:53.558578 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-cv9jf" Mar 16 16:25:53 crc kubenswrapper[5120]: E0316 16:25:53.597399 5120 upgradeaware.go:427] Error proxying data from client to backend: readfrom tcp 38.102.83.119:58320->38.102.83.119:44311: write tcp 38.102.83.119:58320->38.102.83.119:44311: write: broken pipe Mar 16 16:25:53 crc kubenswrapper[5120]: I0316 16:25:53.638493 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:25:53 crc kubenswrapper[5120]: I0316 16:25:53.695859 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:25:53 crc kubenswrapper[5120]: I0316 16:25:53.813300 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:25:53 crc kubenswrapper[5120]: I0316 16:25:53.972904 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-7lh68" Mar 16 16:25:53 crc kubenswrapper[5120]: I0316 16:25:53.988748 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 16:25:53 crc kubenswrapper[5120]: I0316 16:25:53.993053 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-7lh68" Mar 16 16:25:53 crc kubenswrapper[5120]: I0316 16:25:53.997371 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:25:54 crc kubenswrapper[5120]: I0316 16:25:54.002106 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovnnorthd-config\"" Mar 16 16:25:54 crc kubenswrapper[5120]: I0316 16:25:54.002180 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ovnnorthd-ovndbs\"" Mar 16 16:25:54 crc kubenswrapper[5120]: I0316 16:25:54.002363 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovnnorthd-scripts\"" Mar 16 16:25:54 crc kubenswrapper[5120]: I0316 16:25:54.002380 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ovnnorthd-ovnnorthd-dockercfg-hslz5\"" Mar 16 16:25:54 crc kubenswrapper[5120]: I0316 16:25:54.007581 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 16:25:54 crc kubenswrapper[5120]: I0316 16:25:54.056346 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bn9rh\" (UniqueName: \"kubernetes.io/projected/2e8b6c0c-ae02-4fe4-affa-80405f6754d1-kube-api-access-bn9rh\") pod \"2e8b6c0c-ae02-4fe4-affa-80405f6754d1\" (UID: \"2e8b6c0c-ae02-4fe4-affa-80405f6754d1\") " Mar 16 16:25:54 crc kubenswrapper[5120]: I0316 16:25:54.056428 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/2e8b6c0c-ae02-4fe4-affa-80405f6754d1-dispersionconf\") pod \"2e8b6c0c-ae02-4fe4-affa-80405f6754d1\" (UID: \"2e8b6c0c-ae02-4fe4-affa-80405f6754d1\") " Mar 16 16:25:54 crc kubenswrapper[5120]: I0316 16:25:54.056696 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/2e8b6c0c-ae02-4fe4-affa-80405f6754d1-ring-data-devices\") pod \"2e8b6c0c-ae02-4fe4-affa-80405f6754d1\" (UID: \"2e8b6c0c-ae02-4fe4-affa-80405f6754d1\") " Mar 16 16:25:54 crc kubenswrapper[5120]: I0316 16:25:54.056792 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/2e8b6c0c-ae02-4fe4-affa-80405f6754d1-scripts\") pod \"2e8b6c0c-ae02-4fe4-affa-80405f6754d1\" (UID: \"2e8b6c0c-ae02-4fe4-affa-80405f6754d1\") " Mar 16 16:25:54 crc kubenswrapper[5120]: I0316 16:25:54.056851 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/2e8b6c0c-ae02-4fe4-affa-80405f6754d1-etc-swift\") pod \"2e8b6c0c-ae02-4fe4-affa-80405f6754d1\" (UID: \"2e8b6c0c-ae02-4fe4-affa-80405f6754d1\") " Mar 16 16:25:54 crc kubenswrapper[5120]: I0316 16:25:54.056893 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/2e8b6c0c-ae02-4fe4-affa-80405f6754d1-swiftconf\") pod \"2e8b6c0c-ae02-4fe4-affa-80405f6754d1\" (UID: \"2e8b6c0c-ae02-4fe4-affa-80405f6754d1\") " Mar 16 16:25:54 crc kubenswrapper[5120]: I0316 16:25:54.057092 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e8b6c0c-ae02-4fe4-affa-80405f6754d1-ring-data-devices" (OuterVolumeSpecName: "ring-data-devices") pod "2e8b6c0c-ae02-4fe4-affa-80405f6754d1" (UID: "2e8b6c0c-ae02-4fe4-affa-80405f6754d1"). InnerVolumeSpecName "ring-data-devices". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:25:54 crc kubenswrapper[5120]: I0316 16:25:54.057192 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2e8b6c0c-ae02-4fe4-affa-80405f6754d1-combined-ca-bundle\") pod \"2e8b6c0c-ae02-4fe4-affa-80405f6754d1\" (UID: \"2e8b6c0c-ae02-4fe4-affa-80405f6754d1\") " Mar 16 16:25:54 crc kubenswrapper[5120]: I0316 16:25:54.057615 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e8b6c0c-ae02-4fe4-affa-80405f6754d1-scripts" (OuterVolumeSpecName: "scripts") pod "2e8b6c0c-ae02-4fe4-affa-80405f6754d1" (UID: "2e8b6c0c-ae02-4fe4-affa-80405f6754d1"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:25:54 crc kubenswrapper[5120]: I0316 16:25:54.057865 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/c88c8ef0-5871-4507-9dcd-4c5312779d29-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"c88c8ef0-5871-4507-9dcd-4c5312779d29\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:25:54 crc kubenswrapper[5120]: I0316 16:25:54.058015 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/c88c8ef0-5871-4507-9dcd-4c5312779d29-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"c88c8ef0-5871-4507-9dcd-4c5312779d29\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:25:54 crc kubenswrapper[5120]: I0316 16:25:54.058177 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/c88c8ef0-5871-4507-9dcd-4c5312779d29-scripts\") pod \"ovn-northd-0\" (UID: \"c88c8ef0-5871-4507-9dcd-4c5312779d29\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:25:54 crc kubenswrapper[5120]: I0316 16:25:54.058317 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c88c8ef0-5871-4507-9dcd-4c5312779d29-config\") pod \"ovn-northd-0\" (UID: \"c88c8ef0-5871-4507-9dcd-4c5312779d29\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:25:54 crc kubenswrapper[5120]: I0316 16:25:54.058865 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e8b6c0c-ae02-4fe4-affa-80405f6754d1-etc-swift" (OuterVolumeSpecName: "etc-swift") pod "2e8b6c0c-ae02-4fe4-affa-80405f6754d1" (UID: "2e8b6c0c-ae02-4fe4-affa-80405f6754d1"). InnerVolumeSpecName "etc-swift". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:25:54 crc kubenswrapper[5120]: I0316 16:25:54.060730 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c88c8ef0-5871-4507-9dcd-4c5312779d29-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"c88c8ef0-5871-4507-9dcd-4c5312779d29\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:25:54 crc kubenswrapper[5120]: I0316 16:25:54.060809 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qh8n6\" (UniqueName: \"kubernetes.io/projected/c88c8ef0-5871-4507-9dcd-4c5312779d29-kube-api-access-qh8n6\") pod \"ovn-northd-0\" (UID: \"c88c8ef0-5871-4507-9dcd-4c5312779d29\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:25:54 crc kubenswrapper[5120]: I0316 16:25:54.060997 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/c88c8ef0-5871-4507-9dcd-4c5312779d29-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"c88c8ef0-5871-4507-9dcd-4c5312779d29\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:25:54 crc kubenswrapper[5120]: I0316 16:25:54.061196 5120 reconciler_common.go:299] "Volume detached for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/2e8b6c0c-ae02-4fe4-affa-80405f6754d1-ring-data-devices\") on node \"crc\" DevicePath \"\"" Mar 16 16:25:54 crc kubenswrapper[5120]: I0316 16:25:54.061215 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/2e8b6c0c-ae02-4fe4-affa-80405f6754d1-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:25:54 crc kubenswrapper[5120]: I0316 16:25:54.061227 5120 reconciler_common.go:299] "Volume detached for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/2e8b6c0c-ae02-4fe4-affa-80405f6754d1-etc-swift\") on node \"crc\" DevicePath \"\"" Mar 16 16:25:54 crc kubenswrapper[5120]: I0316 16:25:54.062354 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e8b6c0c-ae02-4fe4-affa-80405f6754d1-dispersionconf" (OuterVolumeSpecName: "dispersionconf") pod "2e8b6c0c-ae02-4fe4-affa-80405f6754d1" (UID: "2e8b6c0c-ae02-4fe4-affa-80405f6754d1"). InnerVolumeSpecName "dispersionconf". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:25:54 crc kubenswrapper[5120]: I0316 16:25:54.063111 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e8b6c0c-ae02-4fe4-affa-80405f6754d1-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "2e8b6c0c-ae02-4fe4-affa-80405f6754d1" (UID: "2e8b6c0c-ae02-4fe4-affa-80405f6754d1"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:25:54 crc kubenswrapper[5120]: I0316 16:25:54.064195 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e8b6c0c-ae02-4fe4-affa-80405f6754d1-kube-api-access-bn9rh" (OuterVolumeSpecName: "kube-api-access-bn9rh") pod "2e8b6c0c-ae02-4fe4-affa-80405f6754d1" (UID: "2e8b6c0c-ae02-4fe4-affa-80405f6754d1"). InnerVolumeSpecName "kube-api-access-bn9rh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:25:54 crc kubenswrapper[5120]: I0316 16:25:54.066922 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e8b6c0c-ae02-4fe4-affa-80405f6754d1-swiftconf" (OuterVolumeSpecName: "swiftconf") pod "2e8b6c0c-ae02-4fe4-affa-80405f6754d1" (UID: "2e8b6c0c-ae02-4fe4-affa-80405f6754d1"). InnerVolumeSpecName "swiftconf". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:25:54 crc kubenswrapper[5120]: I0316 16:25:54.079083 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-cv9jf"] Mar 16 16:25:54 crc kubenswrapper[5120]: I0316 16:25:54.163960 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c88c8ef0-5871-4507-9dcd-4c5312779d29-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"c88c8ef0-5871-4507-9dcd-4c5312779d29\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:25:54 crc kubenswrapper[5120]: I0316 16:25:54.164037 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qh8n6\" (UniqueName: \"kubernetes.io/projected/c88c8ef0-5871-4507-9dcd-4c5312779d29-kube-api-access-qh8n6\") pod \"ovn-northd-0\" (UID: \"c88c8ef0-5871-4507-9dcd-4c5312779d29\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:25:54 crc kubenswrapper[5120]: I0316 16:25:54.164087 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/c88c8ef0-5871-4507-9dcd-4c5312779d29-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"c88c8ef0-5871-4507-9dcd-4c5312779d29\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:25:54 crc kubenswrapper[5120]: I0316 16:25:54.164309 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/c88c8ef0-5871-4507-9dcd-4c5312779d29-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"c88c8ef0-5871-4507-9dcd-4c5312779d29\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:25:54 crc kubenswrapper[5120]: I0316 16:25:54.164426 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/c88c8ef0-5871-4507-9dcd-4c5312779d29-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"c88c8ef0-5871-4507-9dcd-4c5312779d29\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:25:54 crc kubenswrapper[5120]: I0316 16:25:54.164530 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/c88c8ef0-5871-4507-9dcd-4c5312779d29-scripts\") pod \"ovn-northd-0\" (UID: \"c88c8ef0-5871-4507-9dcd-4c5312779d29\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:25:54 crc kubenswrapper[5120]: I0316 16:25:54.164598 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c88c8ef0-5871-4507-9dcd-4c5312779d29-config\") pod \"ovn-northd-0\" (UID: \"c88c8ef0-5871-4507-9dcd-4c5312779d29\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:25:54 crc kubenswrapper[5120]: I0316 16:25:54.164671 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/c88c8ef0-5871-4507-9dcd-4c5312779d29-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"c88c8ef0-5871-4507-9dcd-4c5312779d29\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:25:54 crc kubenswrapper[5120]: I0316 16:25:54.164683 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bn9rh\" (UniqueName: \"kubernetes.io/projected/2e8b6c0c-ae02-4fe4-affa-80405f6754d1-kube-api-access-bn9rh\") on node \"crc\" DevicePath \"\"" Mar 16 16:25:54 crc kubenswrapper[5120]: I0316 16:25:54.164723 5120 reconciler_common.go:299] "Volume detached for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/2e8b6c0c-ae02-4fe4-affa-80405f6754d1-dispersionconf\") on node \"crc\" DevicePath \"\"" Mar 16 16:25:54 crc kubenswrapper[5120]: I0316 16:25:54.164740 5120 reconciler_common.go:299] "Volume detached for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/2e8b6c0c-ae02-4fe4-affa-80405f6754d1-swiftconf\") on node \"crc\" DevicePath \"\"" Mar 16 16:25:54 crc kubenswrapper[5120]: I0316 16:25:54.164752 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2e8b6c0c-ae02-4fe4-affa-80405f6754d1-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:25:54 crc kubenswrapper[5120]: I0316 16:25:54.165667 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/c88c8ef0-5871-4507-9dcd-4c5312779d29-scripts\") pod \"ovn-northd-0\" (UID: \"c88c8ef0-5871-4507-9dcd-4c5312779d29\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:25:54 crc kubenswrapper[5120]: I0316 16:25:54.165682 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c88c8ef0-5871-4507-9dcd-4c5312779d29-config\") pod \"ovn-northd-0\" (UID: \"c88c8ef0-5871-4507-9dcd-4c5312779d29\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:25:54 crc kubenswrapper[5120]: I0316 16:25:54.170611 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c88c8ef0-5871-4507-9dcd-4c5312779d29-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"c88c8ef0-5871-4507-9dcd-4c5312779d29\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:25:54 crc kubenswrapper[5120]: I0316 16:25:54.170615 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/c88c8ef0-5871-4507-9dcd-4c5312779d29-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"c88c8ef0-5871-4507-9dcd-4c5312779d29\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:25:54 crc kubenswrapper[5120]: I0316 16:25:54.170941 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/c88c8ef0-5871-4507-9dcd-4c5312779d29-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"c88c8ef0-5871-4507-9dcd-4c5312779d29\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:25:54 crc kubenswrapper[5120]: I0316 16:25:54.187668 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qh8n6\" (UniqueName: \"kubernetes.io/projected/c88c8ef0-5871-4507-9dcd-4c5312779d29-kube-api-access-qh8n6\") pod \"ovn-northd-0\" (UID: \"c88c8ef0-5871-4507-9dcd-4c5312779d29\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:25:54 crc kubenswrapper[5120]: I0316 16:25:54.317436 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:25:54 crc kubenswrapper[5120]: I0316 16:25:54.471446 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/e4c4e515-3d7d-4436-ab79-c7c6e2bf2867-etc-swift\") pod \"swift-storage-0\" (UID: \"e4c4e515-3d7d-4436-ab79-c7c6e2bf2867\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:25:54 crc kubenswrapper[5120]: E0316 16:25:54.471640 5120 projected.go:289] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Mar 16 16:25:54 crc kubenswrapper[5120]: E0316 16:25:54.471997 5120 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Mar 16 16:25:54 crc kubenswrapper[5120]: E0316 16:25:54.472060 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e4c4e515-3d7d-4436-ab79-c7c6e2bf2867-etc-swift podName:e4c4e515-3d7d-4436-ab79-c7c6e2bf2867 nodeName:}" failed. No retries permitted until 2026-03-16 16:25:56.472038135 +0000 UTC m=+3258.625969792 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/e4c4e515-3d7d-4436-ab79-c7c6e2bf2867-etc-swift") pod "swift-storage-0" (UID: "e4c4e515-3d7d-4436-ab79-c7c6e2bf2867") : configmap "swift-ring-files" not found Mar 16 16:25:54 crc kubenswrapper[5120]: I0316 16:25:54.761250 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 16:25:54 crc kubenswrapper[5120]: W0316 16:25:54.765753 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc88c8ef0_5871_4507_9dcd_4c5312779d29.slice/crio-7911218e07a123aa96b0e2441bdb7a8203f4010d40d19934b831cb52c79b324d WatchSource:0}: Error finding container 7911218e07a123aa96b0e2441bdb7a8203f4010d40d19934b831cb52c79b324d: Status 404 returned error can't find the container with id 7911218e07a123aa96b0e2441bdb7a8203f4010d40d19934b831cb52c79b324d Mar 16 16:25:54 crc kubenswrapper[5120]: I0316 16:25:54.988653 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"c88c8ef0-5871-4507-9dcd-4c5312779d29","Type":"ContainerStarted","Data":"7911218e07a123aa96b0e2441bdb7a8203f4010d40d19934b831cb52c79b324d"} Mar 16 16:25:54 crc kubenswrapper[5120]: I0316 16:25:54.991180 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-7lh68" Mar 16 16:25:54 crc kubenswrapper[5120]: I0316 16:25:54.991204 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-cv9jf" event={"ID":"41065d35-2cc8-4b66-9767-3fdb3e5e5691","Type":"ContainerStarted","Data":"26a19d2b77733d4ff8bc40e93be569732bc3d22a818c81a13b247fc194ea3117"} Mar 16 16:25:54 crc kubenswrapper[5120]: I0316 16:25:54.991283 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-cv9jf" event={"ID":"41065d35-2cc8-4b66-9767-3fdb3e5e5691","Type":"ContainerStarted","Data":"9b60d4c325370a3ac72a4254cd636a3afa0961d5e25841d3e477c275efd9be36"} Mar 16 16:25:55 crc kubenswrapper[5120]: I0316 16:25:55.034866 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/swift-ring-rebalance-cv9jf" podStartSLOduration=2.034847898 podStartE2EDuration="2.034847898s" podCreationTimestamp="2026-03-16 16:25:53 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:25:55.011720459 +0000 UTC m=+3257.165652116" watchObservedRunningTime="2026-03-16 16:25:55.034847898 +0000 UTC m=+3257.188779555" Mar 16 16:25:55 crc kubenswrapper[5120]: I0316 16:25:55.071464 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-7lh68"] Mar 16 16:25:55 crc kubenswrapper[5120]: I0316 16:25:55.079450 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-7lh68"] Mar 16 16:25:55 crc kubenswrapper[5120]: E0316 16:25:55.152606 5120 upgradeaware.go:427] Error proxying data from client to backend: readfrom tcp 38.102.83.119:58330->38.102.83.119:44311: write tcp 38.102.83.119:58330->38.102.83.119:44311: write: broken pipe Mar 16 16:25:55 crc kubenswrapper[5120]: E0316 16:25:55.204123 5120 upgradeaware.go:427] Error proxying data from client to backend: readfrom tcp 38.102.83.119:58338->38.102.83.119:44311: write tcp 38.102.83.119:58338->38.102.83.119:44311: write: broken pipe Mar 16 16:25:55 crc kubenswrapper[5120]: E0316 16:25:55.443709 5120 upgradeaware.go:427] Error proxying data from client to backend: readfrom tcp 38.102.83.119:58374->38.102.83.119:44311: write tcp 38.102.83.119:58374->38.102.83.119:44311: write: broken pipe Mar 16 16:25:55 crc kubenswrapper[5120]: E0316 16:25:55.674268 5120 upgradeaware.go:427] Error proxying data from client to backend: readfrom tcp 38.102.83.119:58398->38.102.83.119:44311: write tcp 38.102.83.119:58398->38.102.83.119:44311: write: broken pipe Mar 16 16:25:56 crc kubenswrapper[5120]: I0316 16:25:56.029086 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"c88c8ef0-5871-4507-9dcd-4c5312779d29","Type":"ContainerStarted","Data":"cca86ca4bb425959b3293666ee823af2b2b49331f3e113b4ce0a7a9cf086803e"} Mar 16 16:25:56 crc kubenswrapper[5120]: I0316 16:25:56.029143 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"c88c8ef0-5871-4507-9dcd-4c5312779d29","Type":"ContainerStarted","Data":"e1acde98a5a05ec8850ffa2722ab38d50f5f6d3995cf5efd90f9138ab9d44804"} Mar 16 16:25:56 crc kubenswrapper[5120]: I0316 16:25:56.029192 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:25:56 crc kubenswrapper[5120]: I0316 16:25:56.056323 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovn-northd-0" podStartSLOduration=3.056303519 podStartE2EDuration="3.056303519s" podCreationTimestamp="2026-03-16 16:25:53 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:25:56.053661228 +0000 UTC m=+3258.207592915" watchObservedRunningTime="2026-03-16 16:25:56.056303519 +0000 UTC m=+3258.210235196" Mar 16 16:25:56 crc kubenswrapper[5120]: I0316 16:25:56.269996 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/root-account-create-update-bms4j"] Mar 16 16:25:56 crc kubenswrapper[5120]: I0316 16:25:56.279770 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-bms4j"] Mar 16 16:25:56 crc kubenswrapper[5120]: I0316 16:25:56.279932 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-bms4j" Mar 16 16:25:56 crc kubenswrapper[5120]: I0316 16:25:56.285466 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"openstack-mariadb-root-db-secret\"" Mar 16 16:25:56 crc kubenswrapper[5120]: I0316 16:25:56.338105 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46w27\" (UniqueName: \"kubernetes.io/projected/0551ac3d-571d-4f95-a458-317d46bcd64b-kube-api-access-46w27\") pod \"root-account-create-update-bms4j\" (UID: \"0551ac3d-571d-4f95-a458-317d46bcd64b\") " pod="openstack-kuttl-tests/root-account-create-update-bms4j" Mar 16 16:25:56 crc kubenswrapper[5120]: I0316 16:25:56.338964 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0551ac3d-571d-4f95-a458-317d46bcd64b-operator-scripts\") pod \"root-account-create-update-bms4j\" (UID: \"0551ac3d-571d-4f95-a458-317d46bcd64b\") " pod="openstack-kuttl-tests/root-account-create-update-bms4j" Mar 16 16:25:56 crc kubenswrapper[5120]: I0316 16:25:56.441762 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0551ac3d-571d-4f95-a458-317d46bcd64b-operator-scripts\") pod \"root-account-create-update-bms4j\" (UID: \"0551ac3d-571d-4f95-a458-317d46bcd64b\") " pod="openstack-kuttl-tests/root-account-create-update-bms4j" Mar 16 16:25:56 crc kubenswrapper[5120]: I0316 16:25:56.441971 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-46w27\" (UniqueName: \"kubernetes.io/projected/0551ac3d-571d-4f95-a458-317d46bcd64b-kube-api-access-46w27\") pod \"root-account-create-update-bms4j\" (UID: \"0551ac3d-571d-4f95-a458-317d46bcd64b\") " pod="openstack-kuttl-tests/root-account-create-update-bms4j" Mar 16 16:25:56 crc kubenswrapper[5120]: I0316 16:25:56.442596 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0551ac3d-571d-4f95-a458-317d46bcd64b-operator-scripts\") pod \"root-account-create-update-bms4j\" (UID: \"0551ac3d-571d-4f95-a458-317d46bcd64b\") " pod="openstack-kuttl-tests/root-account-create-update-bms4j" Mar 16 16:25:56 crc kubenswrapper[5120]: I0316 16:25:56.460716 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-46w27\" (UniqueName: \"kubernetes.io/projected/0551ac3d-571d-4f95-a458-317d46bcd64b-kube-api-access-46w27\") pod \"root-account-create-update-bms4j\" (UID: \"0551ac3d-571d-4f95-a458-317d46bcd64b\") " pod="openstack-kuttl-tests/root-account-create-update-bms4j" Mar 16 16:25:56 crc kubenswrapper[5120]: I0316 16:25:56.544188 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/e4c4e515-3d7d-4436-ab79-c7c6e2bf2867-etc-swift\") pod \"swift-storage-0\" (UID: \"e4c4e515-3d7d-4436-ab79-c7c6e2bf2867\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:25:56 crc kubenswrapper[5120]: E0316 16:25:56.544404 5120 projected.go:289] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Mar 16 16:25:56 crc kubenswrapper[5120]: E0316 16:25:56.544434 5120 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Mar 16 16:25:56 crc kubenswrapper[5120]: E0316 16:25:56.544502 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e4c4e515-3d7d-4436-ab79-c7c6e2bf2867-etc-swift podName:e4c4e515-3d7d-4436-ab79-c7c6e2bf2867 nodeName:}" failed. No retries permitted until 2026-03-16 16:26:00.544482406 +0000 UTC m=+3262.698414063 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/e4c4e515-3d7d-4436-ab79-c7c6e2bf2867-etc-swift") pod "swift-storage-0" (UID: "e4c4e515-3d7d-4436-ab79-c7c6e2bf2867") : configmap "swift-ring-files" not found Mar 16 16:25:56 crc kubenswrapper[5120]: I0316 16:25:56.603105 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-bms4j" Mar 16 16:25:56 crc kubenswrapper[5120]: I0316 16:25:56.673879 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e8b6c0c-ae02-4fe4-affa-80405f6754d1" path="/var/lib/kubelet/pods/2e8b6c0c-ae02-4fe4-affa-80405f6754d1/volumes" Mar 16 16:25:56 crc kubenswrapper[5120]: I0316 16:25:56.905628 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-db-create-jklt9"] Mar 16 16:25:56 crc kubenswrapper[5120]: I0316 16:25:56.976075 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-db-create-jklt9"] Mar 16 16:25:56 crc kubenswrapper[5120]: I0316 16:25:56.976376 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-8f6f-account-create-update-5zwr9"] Mar 16 16:25:56 crc kubenswrapper[5120]: I0316 16:25:56.976252 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-create-jklt9" Mar 16 16:25:56 crc kubenswrapper[5120]: I0316 16:25:56.982464 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-8f6f-account-create-update-5zwr9"] Mar 16 16:25:56 crc kubenswrapper[5120]: I0316 16:25:56.982581 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-8f6f-account-create-update-5zwr9" Mar 16 16:25:56 crc kubenswrapper[5120]: I0316 16:25:56.987090 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-db-secret\"" Mar 16 16:25:57 crc kubenswrapper[5120]: I0316 16:25:57.061158 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-bms4j"] Mar 16 16:25:57 crc kubenswrapper[5120]: I0316 16:25:57.071942 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r92dd\" (UniqueName: \"kubernetes.io/projected/f692ad11-c485-436b-8624-ae7769b07b98-kube-api-access-r92dd\") pod \"glance-db-create-jklt9\" (UID: \"f692ad11-c485-436b-8624-ae7769b07b98\") " pod="openstack-kuttl-tests/glance-db-create-jklt9" Mar 16 16:25:57 crc kubenswrapper[5120]: I0316 16:25:57.072156 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f692ad11-c485-436b-8624-ae7769b07b98-operator-scripts\") pod \"glance-db-create-jklt9\" (UID: \"f692ad11-c485-436b-8624-ae7769b07b98\") " pod="openstack-kuttl-tests/glance-db-create-jklt9" Mar 16 16:25:57 crc kubenswrapper[5120]: I0316 16:25:57.072201 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/823a8cf3-9912-4721-9fe3-e8b8b8b9f03b-operator-scripts\") pod \"glance-8f6f-account-create-update-5zwr9\" (UID: \"823a8cf3-9912-4721-9fe3-e8b8b8b9f03b\") " pod="openstack-kuttl-tests/glance-8f6f-account-create-update-5zwr9" Mar 16 16:25:57 crc kubenswrapper[5120]: I0316 16:25:57.072344 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tsv2\" (UniqueName: \"kubernetes.io/projected/823a8cf3-9912-4721-9fe3-e8b8b8b9f03b-kube-api-access-8tsv2\") pod \"glance-8f6f-account-create-update-5zwr9\" (UID: \"823a8cf3-9912-4721-9fe3-e8b8b8b9f03b\") " pod="openstack-kuttl-tests/glance-8f6f-account-create-update-5zwr9" Mar 16 16:25:57 crc kubenswrapper[5120]: I0316 16:25:57.173968 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f692ad11-c485-436b-8624-ae7769b07b98-operator-scripts\") pod \"glance-db-create-jklt9\" (UID: \"f692ad11-c485-436b-8624-ae7769b07b98\") " pod="openstack-kuttl-tests/glance-db-create-jklt9" Mar 16 16:25:57 crc kubenswrapper[5120]: I0316 16:25:57.174048 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/823a8cf3-9912-4721-9fe3-e8b8b8b9f03b-operator-scripts\") pod \"glance-8f6f-account-create-update-5zwr9\" (UID: \"823a8cf3-9912-4721-9fe3-e8b8b8b9f03b\") " pod="openstack-kuttl-tests/glance-8f6f-account-create-update-5zwr9" Mar 16 16:25:57 crc kubenswrapper[5120]: I0316 16:25:57.174186 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8tsv2\" (UniqueName: \"kubernetes.io/projected/823a8cf3-9912-4721-9fe3-e8b8b8b9f03b-kube-api-access-8tsv2\") pod \"glance-8f6f-account-create-update-5zwr9\" (UID: \"823a8cf3-9912-4721-9fe3-e8b8b8b9f03b\") " pod="openstack-kuttl-tests/glance-8f6f-account-create-update-5zwr9" Mar 16 16:25:57 crc kubenswrapper[5120]: I0316 16:25:57.174325 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r92dd\" (UniqueName: \"kubernetes.io/projected/f692ad11-c485-436b-8624-ae7769b07b98-kube-api-access-r92dd\") pod \"glance-db-create-jklt9\" (UID: \"f692ad11-c485-436b-8624-ae7769b07b98\") " pod="openstack-kuttl-tests/glance-db-create-jklt9" Mar 16 16:25:57 crc kubenswrapper[5120]: I0316 16:25:57.175497 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f692ad11-c485-436b-8624-ae7769b07b98-operator-scripts\") pod \"glance-db-create-jklt9\" (UID: \"f692ad11-c485-436b-8624-ae7769b07b98\") " pod="openstack-kuttl-tests/glance-db-create-jklt9" Mar 16 16:25:57 crc kubenswrapper[5120]: I0316 16:25:57.175571 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/823a8cf3-9912-4721-9fe3-e8b8b8b9f03b-operator-scripts\") pod \"glance-8f6f-account-create-update-5zwr9\" (UID: \"823a8cf3-9912-4721-9fe3-e8b8b8b9f03b\") " pod="openstack-kuttl-tests/glance-8f6f-account-create-update-5zwr9" Mar 16 16:25:57 crc kubenswrapper[5120]: I0316 16:25:57.197735 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8tsv2\" (UniqueName: \"kubernetes.io/projected/823a8cf3-9912-4721-9fe3-e8b8b8b9f03b-kube-api-access-8tsv2\") pod \"glance-8f6f-account-create-update-5zwr9\" (UID: \"823a8cf3-9912-4721-9fe3-e8b8b8b9f03b\") " pod="openstack-kuttl-tests/glance-8f6f-account-create-update-5zwr9" Mar 16 16:25:57 crc kubenswrapper[5120]: I0316 16:25:57.198012 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r92dd\" (UniqueName: \"kubernetes.io/projected/f692ad11-c485-436b-8624-ae7769b07b98-kube-api-access-r92dd\") pod \"glance-db-create-jklt9\" (UID: \"f692ad11-c485-436b-8624-ae7769b07b98\") " pod="openstack-kuttl-tests/glance-db-create-jklt9" Mar 16 16:25:57 crc kubenswrapper[5120]: I0316 16:25:57.310432 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-create-jklt9" Mar 16 16:25:57 crc kubenswrapper[5120]: I0316 16:25:57.319723 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-8f6f-account-create-update-5zwr9" Mar 16 16:25:57 crc kubenswrapper[5120]: I0316 16:25:57.508157 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/openstack-cell1-galera-2" Mar 16 16:25:57 crc kubenswrapper[5120]: I0316 16:25:57.640140 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/openstack-cell1-galera-2" Mar 16 16:25:57 crc kubenswrapper[5120]: I0316 16:25:57.810509 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-8f6f-account-create-update-5zwr9"] Mar 16 16:25:57 crc kubenswrapper[5120]: W0316 16:25:57.811351 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod823a8cf3_9912_4721_9fe3_e8b8b8b9f03b.slice/crio-846968f3b1a996ce3e3f7dc3a495027b4a2f2936b8cd8753642193258c607aa5 WatchSource:0}: Error finding container 846968f3b1a996ce3e3f7dc3a495027b4a2f2936b8cd8753642193258c607aa5: Status 404 returned error can't find the container with id 846968f3b1a996ce3e3f7dc3a495027b4a2f2936b8cd8753642193258c607aa5 Mar 16 16:25:57 crc kubenswrapper[5120]: I0316 16:25:57.874015 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-db-create-jklt9"] Mar 16 16:25:58 crc kubenswrapper[5120]: I0316 16:25:58.048835 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-create-jklt9" event={"ID":"f692ad11-c485-436b-8624-ae7769b07b98","Type":"ContainerStarted","Data":"bcf697faefd74e07964bc1698506ee680620a3ffb2416c479378a19a2b12cfd8"} Mar 16 16:25:58 crc kubenswrapper[5120]: I0316 16:25:58.050622 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-bms4j" event={"ID":"0551ac3d-571d-4f95-a458-317d46bcd64b","Type":"ContainerStarted","Data":"7023672ce34dba103c8a53dc23b44d6e887538893025cbc8a3a0c2f7d3f52784"} Mar 16 16:25:58 crc kubenswrapper[5120]: I0316 16:25:58.050650 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-bms4j" event={"ID":"0551ac3d-571d-4f95-a458-317d46bcd64b","Type":"ContainerStarted","Data":"e3b7c1917c424110d14fdb4745942a448e4761c5809586d37389ee440a029514"} Mar 16 16:25:58 crc kubenswrapper[5120]: I0316 16:25:58.059125 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-8f6f-account-create-update-5zwr9" event={"ID":"823a8cf3-9912-4721-9fe3-e8b8b8b9f03b","Type":"ContainerStarted","Data":"846968f3b1a996ce3e3f7dc3a495027b4a2f2936b8cd8753642193258c607aa5"} Mar 16 16:25:58 crc kubenswrapper[5120]: I0316 16:25:58.074975 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/root-account-create-update-bms4j" podStartSLOduration=2.074956422 podStartE2EDuration="2.074956422s" podCreationTimestamp="2026-03-16 16:25:56 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:25:58.069359033 +0000 UTC m=+3260.223290710" watchObservedRunningTime="2026-03-16 16:25:58.074956422 +0000 UTC m=+3260.228888089" Mar 16 16:25:59 crc kubenswrapper[5120]: I0316 16:25:59.070418 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-8f6f-account-create-update-5zwr9" event={"ID":"823a8cf3-9912-4721-9fe3-e8b8b8b9f03b","Type":"ContainerStarted","Data":"e51fd4f20644e71d702264472816d4f6ef17d8ebfb695f51448b9c4f3211b7bd"} Mar 16 16:25:59 crc kubenswrapper[5120]: I0316 16:25:59.073789 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-create-jklt9" event={"ID":"f692ad11-c485-436b-8624-ae7769b07b98","Type":"ContainerStarted","Data":"6dc6d19352714b047af5e332526769ac24972837f0aa890874047d7522280d24"} Mar 16 16:25:59 crc kubenswrapper[5120]: I0316 16:25:59.099840 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-8f6f-account-create-update-5zwr9" podStartSLOduration=3.099813804 podStartE2EDuration="3.099813804s" podCreationTimestamp="2026-03-16 16:25:56 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:25:59.089854758 +0000 UTC m=+3261.243786455" watchObservedRunningTime="2026-03-16 16:25:59.099813804 +0000 UTC m=+3261.253745471" Mar 16 16:25:59 crc kubenswrapper[5120]: I0316 16:25:59.115848 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-db-create-jklt9" podStartSLOduration=3.115820102 podStartE2EDuration="3.115820102s" podCreationTimestamp="2026-03-16 16:25:56 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:25:59.112552745 +0000 UTC m=+3261.266484402" watchObservedRunningTime="2026-03-16 16:25:59.115820102 +0000 UTC m=+3261.269751789" Mar 16 16:26:00 crc kubenswrapper[5120]: I0316 16:26:00.129422 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-infra/auto-csr-approver-29561306-dnwwx"] Mar 16 16:26:00 crc kubenswrapper[5120]: I0316 16:26:00.134865 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561306-dnwwx" Mar 16 16:26:00 crc kubenswrapper[5120]: I0316 16:26:00.139616 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"kube-root-ca.crt\"" Mar 16 16:26:00 crc kubenswrapper[5120]: I0316 16:26:00.140419 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"openshift-service-ca.crt\"" Mar 16 16:26:00 crc kubenswrapper[5120]: I0316 16:26:00.140665 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-infra\"/\"csr-approver-sa-dockercfg-x2nsz\"" Mar 16 16:26:00 crc kubenswrapper[5120]: I0316 16:26:00.152565 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561306-dnwwx"] Mar 16 16:26:00 crc kubenswrapper[5120]: I0316 16:26:00.248298 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qr78b\" (UniqueName: \"kubernetes.io/projected/8162a42b-127c-4778-a8cb-f965703da580-kube-api-access-qr78b\") pod \"auto-csr-approver-29561306-dnwwx\" (UID: \"8162a42b-127c-4778-a8cb-f965703da580\") " pod="openshift-infra/auto-csr-approver-29561306-dnwwx" Mar 16 16:26:00 crc kubenswrapper[5120]: I0316 16:26:00.341516 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-db-create-r5v64"] Mar 16 16:26:00 crc kubenswrapper[5120]: I0316 16:26:00.348197 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-create-r5v64" Mar 16 16:26:00 crc kubenswrapper[5120]: I0316 16:26:00.351871 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qr78b\" (UniqueName: \"kubernetes.io/projected/8162a42b-127c-4778-a8cb-f965703da580-kube-api-access-qr78b\") pod \"auto-csr-approver-29561306-dnwwx\" (UID: \"8162a42b-127c-4778-a8cb-f965703da580\") " pod="openshift-infra/auto-csr-approver-29561306-dnwwx" Mar 16 16:26:00 crc kubenswrapper[5120]: I0316 16:26:00.353863 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-db-create-r5v64"] Mar 16 16:26:00 crc kubenswrapper[5120]: I0316 16:26:00.386531 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qr78b\" (UniqueName: \"kubernetes.io/projected/8162a42b-127c-4778-a8cb-f965703da580-kube-api-access-qr78b\") pod \"auto-csr-approver-29561306-dnwwx\" (UID: \"8162a42b-127c-4778-a8cb-f965703da580\") " pod="openshift-infra/auto-csr-approver-29561306-dnwwx" Mar 16 16:26:00 crc kubenswrapper[5120]: I0316 16:26:00.428656 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-aceb-account-create-update-m55hg"] Mar 16 16:26:00 crc kubenswrapper[5120]: I0316 16:26:00.466761 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-aceb-account-create-update-m55hg"] Mar 16 16:26:00 crc kubenswrapper[5120]: I0316 16:26:00.466871 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-aceb-account-create-update-m55hg" Mar 16 16:26:00 crc kubenswrapper[5120]: I0316 16:26:00.467272 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ef37d2ce-771c-4eec-933f-823daddb5817-operator-scripts\") pod \"keystone-db-create-r5v64\" (UID: \"ef37d2ce-771c-4eec-933f-823daddb5817\") " pod="openstack-kuttl-tests/keystone-db-create-r5v64" Mar 16 16:26:00 crc kubenswrapper[5120]: I0316 16:26:00.467386 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nx72l\" (UniqueName: \"kubernetes.io/projected/ef37d2ce-771c-4eec-933f-823daddb5817-kube-api-access-nx72l\") pod \"keystone-db-create-r5v64\" (UID: \"ef37d2ce-771c-4eec-933f-823daddb5817\") " pod="openstack-kuttl-tests/keystone-db-create-r5v64" Mar 16 16:26:00 crc kubenswrapper[5120]: I0316 16:26:00.469381 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-db-secret\"" Mar 16 16:26:00 crc kubenswrapper[5120]: I0316 16:26:00.478872 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561306-dnwwx" Mar 16 16:26:00 crc kubenswrapper[5120]: I0316 16:26:00.553878 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-db-create-n7fcp"] Mar 16 16:26:00 crc kubenswrapper[5120]: I0316 16:26:00.571059 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ef37d2ce-771c-4eec-933f-823daddb5817-operator-scripts\") pod \"keystone-db-create-r5v64\" (UID: \"ef37d2ce-771c-4eec-933f-823daddb5817\") " pod="openstack-kuttl-tests/keystone-db-create-r5v64" Mar 16 16:26:00 crc kubenswrapper[5120]: I0316 16:26:00.571174 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5g2x\" (UniqueName: \"kubernetes.io/projected/8ce00bd2-57d0-4362-9faa-1ce50ba8d07f-kube-api-access-n5g2x\") pod \"keystone-aceb-account-create-update-m55hg\" (UID: \"8ce00bd2-57d0-4362-9faa-1ce50ba8d07f\") " pod="openstack-kuttl-tests/keystone-aceb-account-create-update-m55hg" Mar 16 16:26:00 crc kubenswrapper[5120]: I0316 16:26:00.571204 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nx72l\" (UniqueName: \"kubernetes.io/projected/ef37d2ce-771c-4eec-933f-823daddb5817-kube-api-access-nx72l\") pod \"keystone-db-create-r5v64\" (UID: \"ef37d2ce-771c-4eec-933f-823daddb5817\") " pod="openstack-kuttl-tests/keystone-db-create-r5v64" Mar 16 16:26:00 crc kubenswrapper[5120]: I0316 16:26:00.571243 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8ce00bd2-57d0-4362-9faa-1ce50ba8d07f-operator-scripts\") pod \"keystone-aceb-account-create-update-m55hg\" (UID: \"8ce00bd2-57d0-4362-9faa-1ce50ba8d07f\") " pod="openstack-kuttl-tests/keystone-aceb-account-create-update-m55hg" Mar 16 16:26:00 crc kubenswrapper[5120]: I0316 16:26:00.571328 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/e4c4e515-3d7d-4436-ab79-c7c6e2bf2867-etc-swift\") pod \"swift-storage-0\" (UID: \"e4c4e515-3d7d-4436-ab79-c7c6e2bf2867\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:26:00 crc kubenswrapper[5120]: E0316 16:26:00.571500 5120 projected.go:289] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Mar 16 16:26:00 crc kubenswrapper[5120]: E0316 16:26:00.571514 5120 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Mar 16 16:26:00 crc kubenswrapper[5120]: E0316 16:26:00.571561 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e4c4e515-3d7d-4436-ab79-c7c6e2bf2867-etc-swift podName:e4c4e515-3d7d-4436-ab79-c7c6e2bf2867 nodeName:}" failed. No retries permitted until 2026-03-16 16:26:08.571547209 +0000 UTC m=+3270.725478866 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/e4c4e515-3d7d-4436-ab79-c7c6e2bf2867-etc-swift") pod "swift-storage-0" (UID: "e4c4e515-3d7d-4436-ab79-c7c6e2bf2867") : configmap "swift-ring-files" not found Mar 16 16:26:00 crc kubenswrapper[5120]: I0316 16:26:00.572615 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ef37d2ce-771c-4eec-933f-823daddb5817-operator-scripts\") pod \"keystone-db-create-r5v64\" (UID: \"ef37d2ce-771c-4eec-933f-823daddb5817\") " pod="openstack-kuttl-tests/keystone-db-create-r5v64" Mar 16 16:26:00 crc kubenswrapper[5120]: I0316 16:26:00.574223 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-db-create-n7fcp"] Mar 16 16:26:00 crc kubenswrapper[5120]: I0316 16:26:00.574361 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-create-n7fcp" Mar 16 16:26:00 crc kubenswrapper[5120]: I0316 16:26:00.608267 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nx72l\" (UniqueName: \"kubernetes.io/projected/ef37d2ce-771c-4eec-933f-823daddb5817-kube-api-access-nx72l\") pod \"keystone-db-create-r5v64\" (UID: \"ef37d2ce-771c-4eec-933f-823daddb5817\") " pod="openstack-kuttl-tests/keystone-db-create-r5v64" Mar 16 16:26:00 crc kubenswrapper[5120]: I0316 16:26:00.666243 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-create-r5v64" Mar 16 16:26:00 crc kubenswrapper[5120]: I0316 16:26:00.674486 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/785bf626-cdb3-4701-bd4f-0f34c3b03ec2-operator-scripts\") pod \"placement-db-create-n7fcp\" (UID: \"785bf626-cdb3-4701-bd4f-0f34c3b03ec2\") " pod="openstack-kuttl-tests/placement-db-create-n7fcp" Mar 16 16:26:00 crc kubenswrapper[5120]: I0316 16:26:00.674653 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n5g2x\" (UniqueName: \"kubernetes.io/projected/8ce00bd2-57d0-4362-9faa-1ce50ba8d07f-kube-api-access-n5g2x\") pod \"keystone-aceb-account-create-update-m55hg\" (UID: \"8ce00bd2-57d0-4362-9faa-1ce50ba8d07f\") " pod="openstack-kuttl-tests/keystone-aceb-account-create-update-m55hg" Mar 16 16:26:00 crc kubenswrapper[5120]: I0316 16:26:00.674780 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8ce00bd2-57d0-4362-9faa-1ce50ba8d07f-operator-scripts\") pod \"keystone-aceb-account-create-update-m55hg\" (UID: \"8ce00bd2-57d0-4362-9faa-1ce50ba8d07f\") " pod="openstack-kuttl-tests/keystone-aceb-account-create-update-m55hg" Mar 16 16:26:00 crc kubenswrapper[5120]: I0316 16:26:00.674950 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ss6jf\" (UniqueName: \"kubernetes.io/projected/785bf626-cdb3-4701-bd4f-0f34c3b03ec2-kube-api-access-ss6jf\") pod \"placement-db-create-n7fcp\" (UID: \"785bf626-cdb3-4701-bd4f-0f34c3b03ec2\") " pod="openstack-kuttl-tests/placement-db-create-n7fcp" Mar 16 16:26:00 crc kubenswrapper[5120]: I0316 16:26:00.675466 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8ce00bd2-57d0-4362-9faa-1ce50ba8d07f-operator-scripts\") pod \"keystone-aceb-account-create-update-m55hg\" (UID: \"8ce00bd2-57d0-4362-9faa-1ce50ba8d07f\") " pod="openstack-kuttl-tests/keystone-aceb-account-create-update-m55hg" Mar 16 16:26:00 crc kubenswrapper[5120]: I0316 16:26:00.693404 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-821f-account-create-update-h8xcp"] Mar 16 16:26:00 crc kubenswrapper[5120]: I0316 16:26:00.705712 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5g2x\" (UniqueName: \"kubernetes.io/projected/8ce00bd2-57d0-4362-9faa-1ce50ba8d07f-kube-api-access-n5g2x\") pod \"keystone-aceb-account-create-update-m55hg\" (UID: \"8ce00bd2-57d0-4362-9faa-1ce50ba8d07f\") " pod="openstack-kuttl-tests/keystone-aceb-account-create-update-m55hg" Mar 16 16:26:00 crc kubenswrapper[5120]: I0316 16:26:00.707396 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-821f-account-create-update-h8xcp"] Mar 16 16:26:00 crc kubenswrapper[5120]: I0316 16:26:00.707533 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-821f-account-create-update-h8xcp" Mar 16 16:26:00 crc kubenswrapper[5120]: I0316 16:26:00.709802 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-db-secret\"" Mar 16 16:26:00 crc kubenswrapper[5120]: I0316 16:26:00.779194 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ss6jf\" (UniqueName: \"kubernetes.io/projected/785bf626-cdb3-4701-bd4f-0f34c3b03ec2-kube-api-access-ss6jf\") pod \"placement-db-create-n7fcp\" (UID: \"785bf626-cdb3-4701-bd4f-0f34c3b03ec2\") " pod="openstack-kuttl-tests/placement-db-create-n7fcp" Mar 16 16:26:00 crc kubenswrapper[5120]: I0316 16:26:00.779369 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/785bf626-cdb3-4701-bd4f-0f34c3b03ec2-operator-scripts\") pod \"placement-db-create-n7fcp\" (UID: \"785bf626-cdb3-4701-bd4f-0f34c3b03ec2\") " pod="openstack-kuttl-tests/placement-db-create-n7fcp" Mar 16 16:26:00 crc kubenswrapper[5120]: I0316 16:26:00.781385 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/785bf626-cdb3-4701-bd4f-0f34c3b03ec2-operator-scripts\") pod \"placement-db-create-n7fcp\" (UID: \"785bf626-cdb3-4701-bd4f-0f34c3b03ec2\") " pod="openstack-kuttl-tests/placement-db-create-n7fcp" Mar 16 16:26:00 crc kubenswrapper[5120]: I0316 16:26:00.785366 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-aceb-account-create-update-m55hg" Mar 16 16:26:00 crc kubenswrapper[5120]: I0316 16:26:00.801050 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ss6jf\" (UniqueName: \"kubernetes.io/projected/785bf626-cdb3-4701-bd4f-0f34c3b03ec2-kube-api-access-ss6jf\") pod \"placement-db-create-n7fcp\" (UID: \"785bf626-cdb3-4701-bd4f-0f34c3b03ec2\") " pod="openstack-kuttl-tests/placement-db-create-n7fcp" Mar 16 16:26:00 crc kubenswrapper[5120]: I0316 16:26:00.821237 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-create-n7fcp" Mar 16 16:26:00 crc kubenswrapper[5120]: I0316 16:26:00.882316 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dc88m\" (UniqueName: \"kubernetes.io/projected/86acd223-38d0-4b3e-b13b-e24a5ae829da-kube-api-access-dc88m\") pod \"placement-821f-account-create-update-h8xcp\" (UID: \"86acd223-38d0-4b3e-b13b-e24a5ae829da\") " pod="openstack-kuttl-tests/placement-821f-account-create-update-h8xcp" Mar 16 16:26:00 crc kubenswrapper[5120]: I0316 16:26:00.882528 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/86acd223-38d0-4b3e-b13b-e24a5ae829da-operator-scripts\") pod \"placement-821f-account-create-update-h8xcp\" (UID: \"86acd223-38d0-4b3e-b13b-e24a5ae829da\") " pod="openstack-kuttl-tests/placement-821f-account-create-update-h8xcp" Mar 16 16:26:00 crc kubenswrapper[5120]: I0316 16:26:00.987145 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/86acd223-38d0-4b3e-b13b-e24a5ae829da-operator-scripts\") pod \"placement-821f-account-create-update-h8xcp\" (UID: \"86acd223-38d0-4b3e-b13b-e24a5ae829da\") " pod="openstack-kuttl-tests/placement-821f-account-create-update-h8xcp" Mar 16 16:26:00 crc kubenswrapper[5120]: I0316 16:26:00.987595 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dc88m\" (UniqueName: \"kubernetes.io/projected/86acd223-38d0-4b3e-b13b-e24a5ae829da-kube-api-access-dc88m\") pod \"placement-821f-account-create-update-h8xcp\" (UID: \"86acd223-38d0-4b3e-b13b-e24a5ae829da\") " pod="openstack-kuttl-tests/placement-821f-account-create-update-h8xcp" Mar 16 16:26:00 crc kubenswrapper[5120]: I0316 16:26:00.988202 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/86acd223-38d0-4b3e-b13b-e24a5ae829da-operator-scripts\") pod \"placement-821f-account-create-update-h8xcp\" (UID: \"86acd223-38d0-4b3e-b13b-e24a5ae829da\") " pod="openstack-kuttl-tests/placement-821f-account-create-update-h8xcp" Mar 16 16:26:00 crc kubenswrapper[5120]: I0316 16:26:00.996530 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561306-dnwwx"] Mar 16 16:26:01 crc kubenswrapper[5120]: I0316 16:26:01.018645 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dc88m\" (UniqueName: \"kubernetes.io/projected/86acd223-38d0-4b3e-b13b-e24a5ae829da-kube-api-access-dc88m\") pod \"placement-821f-account-create-update-h8xcp\" (UID: \"86acd223-38d0-4b3e-b13b-e24a5ae829da\") " pod="openstack-kuttl-tests/placement-821f-account-create-update-h8xcp" Mar 16 16:26:01 crc kubenswrapper[5120]: I0316 16:26:01.097518 5120 generic.go:358] "Generic (PLEG): container finished" podID="823a8cf3-9912-4721-9fe3-e8b8b8b9f03b" containerID="e51fd4f20644e71d702264472816d4f6ef17d8ebfb695f51448b9c4f3211b7bd" exitCode=0 Mar 16 16:26:01 crc kubenswrapper[5120]: I0316 16:26:01.097591 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-8f6f-account-create-update-5zwr9" event={"ID":"823a8cf3-9912-4721-9fe3-e8b8b8b9f03b","Type":"ContainerDied","Data":"e51fd4f20644e71d702264472816d4f6ef17d8ebfb695f51448b9c4f3211b7bd"} Mar 16 16:26:01 crc kubenswrapper[5120]: I0316 16:26:01.099802 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561306-dnwwx" event={"ID":"8162a42b-127c-4778-a8cb-f965703da580","Type":"ContainerStarted","Data":"fa2090b0ad32c2aee630a835acd0bc9344f83ec24f8a8b8f424f0a8f85a3617a"} Mar 16 16:26:01 crc kubenswrapper[5120]: I0316 16:26:01.102133 5120 generic.go:358] "Generic (PLEG): container finished" podID="41065d35-2cc8-4b66-9767-3fdb3e5e5691" containerID="26a19d2b77733d4ff8bc40e93be569732bc3d22a818c81a13b247fc194ea3117" exitCode=0 Mar 16 16:26:01 crc kubenswrapper[5120]: I0316 16:26:01.102217 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-cv9jf" event={"ID":"41065d35-2cc8-4b66-9767-3fdb3e5e5691","Type":"ContainerDied","Data":"26a19d2b77733d4ff8bc40e93be569732bc3d22a818c81a13b247fc194ea3117"} Mar 16 16:26:01 crc kubenswrapper[5120]: I0316 16:26:01.104693 5120 generic.go:358] "Generic (PLEG): container finished" podID="f692ad11-c485-436b-8624-ae7769b07b98" containerID="6dc6d19352714b047af5e332526769ac24972837f0aa890874047d7522280d24" exitCode=0 Mar 16 16:26:01 crc kubenswrapper[5120]: I0316 16:26:01.104825 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-create-jklt9" event={"ID":"f692ad11-c485-436b-8624-ae7769b07b98","Type":"ContainerDied","Data":"6dc6d19352714b047af5e332526769ac24972837f0aa890874047d7522280d24"} Mar 16 16:26:01 crc kubenswrapper[5120]: I0316 16:26:01.106693 5120 generic.go:358] "Generic (PLEG): container finished" podID="0551ac3d-571d-4f95-a458-317d46bcd64b" containerID="7023672ce34dba103c8a53dc23b44d6e887538893025cbc8a3a0c2f7d3f52784" exitCode=0 Mar 16 16:26:01 crc kubenswrapper[5120]: I0316 16:26:01.106729 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-bms4j" event={"ID":"0551ac3d-571d-4f95-a458-317d46bcd64b","Type":"ContainerDied","Data":"7023672ce34dba103c8a53dc23b44d6e887538893025cbc8a3a0c2f7d3f52784"} Mar 16 16:26:01 crc kubenswrapper[5120]: I0316 16:26:01.135462 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-821f-account-create-update-h8xcp" Mar 16 16:26:01 crc kubenswrapper[5120]: W0316 16:26:01.171821 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podef37d2ce_771c_4eec_933f_823daddb5817.slice/crio-afe44b60366ac9763ef7803a65586626b09fc8f855167c886ae7356d29e67122 WatchSource:0}: Error finding container afe44b60366ac9763ef7803a65586626b09fc8f855167c886ae7356d29e67122: Status 404 returned error can't find the container with id afe44b60366ac9763ef7803a65586626b09fc8f855167c886ae7356d29e67122 Mar 16 16:26:01 crc kubenswrapper[5120]: I0316 16:26:01.175561 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-db-create-r5v64"] Mar 16 16:26:01 crc kubenswrapper[5120]: I0316 16:26:01.294700 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-db-create-n7fcp"] Mar 16 16:26:01 crc kubenswrapper[5120]: W0316 16:26:01.301118 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod785bf626_cdb3_4701_bd4f_0f34c3b03ec2.slice/crio-579c12c32e20e75cff04eef47a3d08f08497061cb38bb6abc7bf2c2dbb2d8412 WatchSource:0}: Error finding container 579c12c32e20e75cff04eef47a3d08f08497061cb38bb6abc7bf2c2dbb2d8412: Status 404 returned error can't find the container with id 579c12c32e20e75cff04eef47a3d08f08497061cb38bb6abc7bf2c2dbb2d8412 Mar 16 16:26:01 crc kubenswrapper[5120]: I0316 16:26:01.310389 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-aceb-account-create-update-m55hg"] Mar 16 16:26:01 crc kubenswrapper[5120]: I0316 16:26:01.624413 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-821f-account-create-update-h8xcp"] Mar 16 16:26:02 crc kubenswrapper[5120]: I0316 16:26:02.117203 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-aceb-account-create-update-m55hg" event={"ID":"8ce00bd2-57d0-4362-9faa-1ce50ba8d07f","Type":"ContainerStarted","Data":"c581c58f9b70a5e29e5d55f4688ea841750e329b0e7ca1456f075d84f5049fe6"} Mar 16 16:26:02 crc kubenswrapper[5120]: I0316 16:26:02.117494 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-aceb-account-create-update-m55hg" event={"ID":"8ce00bd2-57d0-4362-9faa-1ce50ba8d07f","Type":"ContainerStarted","Data":"fbe190de076db17f3382298065f6af0485de508a349da3cd9025480c932a3449"} Mar 16 16:26:02 crc kubenswrapper[5120]: I0316 16:26:02.119486 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-create-n7fcp" event={"ID":"785bf626-cdb3-4701-bd4f-0f34c3b03ec2","Type":"ContainerStarted","Data":"3c0502000ff01dd33d005a281fd542845cac0a75e1574cba26bf8298a0fc82ed"} Mar 16 16:26:02 crc kubenswrapper[5120]: I0316 16:26:02.119640 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-create-n7fcp" event={"ID":"785bf626-cdb3-4701-bd4f-0f34c3b03ec2","Type":"ContainerStarted","Data":"579c12c32e20e75cff04eef47a3d08f08497061cb38bb6abc7bf2c2dbb2d8412"} Mar 16 16:26:02 crc kubenswrapper[5120]: I0316 16:26:02.122153 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-821f-account-create-update-h8xcp" event={"ID":"86acd223-38d0-4b3e-b13b-e24a5ae829da","Type":"ContainerStarted","Data":"957654f923b45b56dff5590e85bc583b1f635cc06ed245eba52a5fa6a0941204"} Mar 16 16:26:02 crc kubenswrapper[5120]: I0316 16:26:02.122196 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-821f-account-create-update-h8xcp" event={"ID":"86acd223-38d0-4b3e-b13b-e24a5ae829da","Type":"ContainerStarted","Data":"94b2eeba765b2da50f4b1730825557783db529d5fd7566876e167052714ba6fb"} Mar 16 16:26:02 crc kubenswrapper[5120]: I0316 16:26:02.123915 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-create-r5v64" event={"ID":"ef37d2ce-771c-4eec-933f-823daddb5817","Type":"ContainerStarted","Data":"1a21b0b1bb37b825f54861d115c094ef686430fe240cdc438d851c864520b383"} Mar 16 16:26:02 crc kubenswrapper[5120]: I0316 16:26:02.124044 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-create-r5v64" event={"ID":"ef37d2ce-771c-4eec-933f-823daddb5817","Type":"ContainerStarted","Data":"afe44b60366ac9763ef7803a65586626b09fc8f855167c886ae7356d29e67122"} Mar 16 16:26:02 crc kubenswrapper[5120]: I0316 16:26:02.149406 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-aceb-account-create-update-m55hg" podStartSLOduration=2.149383752 podStartE2EDuration="2.149383752s" podCreationTimestamp="2026-03-16 16:26:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:26:02.143836603 +0000 UTC m=+3264.297768270" watchObservedRunningTime="2026-03-16 16:26:02.149383752 +0000 UTC m=+3264.303315409" Mar 16 16:26:02 crc kubenswrapper[5120]: I0316 16:26:02.163395 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-db-create-r5v64" podStartSLOduration=2.163377256 podStartE2EDuration="2.163377256s" podCreationTimestamp="2026-03-16 16:26:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:26:02.159908023 +0000 UTC m=+3264.313839680" watchObservedRunningTime="2026-03-16 16:26:02.163377256 +0000 UTC m=+3264.317308913" Mar 16 16:26:02 crc kubenswrapper[5120]: I0316 16:26:02.185183 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-821f-account-create-update-h8xcp" podStartSLOduration=2.185165028 podStartE2EDuration="2.185165028s" podCreationTimestamp="2026-03-16 16:26:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:26:02.178756577 +0000 UTC m=+3264.332688244" watchObservedRunningTime="2026-03-16 16:26:02.185165028 +0000 UTC m=+3264.339096695" Mar 16 16:26:02 crc kubenswrapper[5120]: I0316 16:26:02.206806 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-db-create-n7fcp" podStartSLOduration=2.206767697 podStartE2EDuration="2.206767697s" podCreationTimestamp="2026-03-16 16:26:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:26:02.199665017 +0000 UTC m=+3264.353596674" watchObservedRunningTime="2026-03-16 16:26:02.206767697 +0000 UTC m=+3264.360699354" Mar 16 16:26:02 crc kubenswrapper[5120]: I0316 16:26:02.324343 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/openstack-galera-2" podUID="51ac8589-b6a7-414d-94e5-731e217600c4" containerName="galera" probeResult="failure" output=< Mar 16 16:26:02 crc kubenswrapper[5120]: wsrep_local_state_comment (Donor/Desynced) differs from Synced Mar 16 16:26:02 crc kubenswrapper[5120]: > Mar 16 16:26:02 crc kubenswrapper[5120]: I0316 16:26:02.649420 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-create-jklt9" Mar 16 16:26:02 crc kubenswrapper[5120]: I0316 16:26:02.733015 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r92dd\" (UniqueName: \"kubernetes.io/projected/f692ad11-c485-436b-8624-ae7769b07b98-kube-api-access-r92dd\") pod \"f692ad11-c485-436b-8624-ae7769b07b98\" (UID: \"f692ad11-c485-436b-8624-ae7769b07b98\") " Mar 16 16:26:02 crc kubenswrapper[5120]: I0316 16:26:02.733355 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f692ad11-c485-436b-8624-ae7769b07b98-operator-scripts\") pod \"f692ad11-c485-436b-8624-ae7769b07b98\" (UID: \"f692ad11-c485-436b-8624-ae7769b07b98\") " Mar 16 16:26:02 crc kubenswrapper[5120]: I0316 16:26:02.734350 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f692ad11-c485-436b-8624-ae7769b07b98-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "f692ad11-c485-436b-8624-ae7769b07b98" (UID: "f692ad11-c485-436b-8624-ae7769b07b98"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:26:02 crc kubenswrapper[5120]: I0316 16:26:02.739836 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f692ad11-c485-436b-8624-ae7769b07b98-kube-api-access-r92dd" (OuterVolumeSpecName: "kube-api-access-r92dd") pod "f692ad11-c485-436b-8624-ae7769b07b98" (UID: "f692ad11-c485-436b-8624-ae7769b07b98"). InnerVolumeSpecName "kube-api-access-r92dd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:26:02 crc kubenswrapper[5120]: I0316 16:26:02.805276 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-cv9jf" Mar 16 16:26:02 crc kubenswrapper[5120]: I0316 16:26:02.816959 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-bms4j" Mar 16 16:26:02 crc kubenswrapper[5120]: I0316 16:26:02.823914 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-8f6f-account-create-update-5zwr9" Mar 16 16:26:02 crc kubenswrapper[5120]: I0316 16:26:02.835751 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/41065d35-2cc8-4b66-9767-3fdb3e5e5691-ring-data-devices\") pod \"41065d35-2cc8-4b66-9767-3fdb3e5e5691\" (UID: \"41065d35-2cc8-4b66-9767-3fdb3e5e5691\") " Mar 16 16:26:02 crc kubenswrapper[5120]: I0316 16:26:02.835828 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-84jqd\" (UniqueName: \"kubernetes.io/projected/41065d35-2cc8-4b66-9767-3fdb3e5e5691-kube-api-access-84jqd\") pod \"41065d35-2cc8-4b66-9767-3fdb3e5e5691\" (UID: \"41065d35-2cc8-4b66-9767-3fdb3e5e5691\") " Mar 16 16:26:02 crc kubenswrapper[5120]: I0316 16:26:02.835906 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/41065d35-2cc8-4b66-9767-3fdb3e5e5691-dispersionconf\") pod \"41065d35-2cc8-4b66-9767-3fdb3e5e5691\" (UID: \"41065d35-2cc8-4b66-9767-3fdb3e5e5691\") " Mar 16 16:26:02 crc kubenswrapper[5120]: I0316 16:26:02.837011 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/41065d35-2cc8-4b66-9767-3fdb3e5e5691-scripts\") pod \"41065d35-2cc8-4b66-9767-3fdb3e5e5691\" (UID: \"41065d35-2cc8-4b66-9767-3fdb3e5e5691\") " Mar 16 16:26:02 crc kubenswrapper[5120]: I0316 16:26:02.837114 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/41065d35-2cc8-4b66-9767-3fdb3e5e5691-swiftconf\") pod \"41065d35-2cc8-4b66-9767-3fdb3e5e5691\" (UID: \"41065d35-2cc8-4b66-9767-3fdb3e5e5691\") " Mar 16 16:26:02 crc kubenswrapper[5120]: I0316 16:26:02.837218 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/41065d35-2cc8-4b66-9767-3fdb3e5e5691-combined-ca-bundle\") pod \"41065d35-2cc8-4b66-9767-3fdb3e5e5691\" (UID: \"41065d35-2cc8-4b66-9767-3fdb3e5e5691\") " Mar 16 16:26:02 crc kubenswrapper[5120]: I0316 16:26:02.837242 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/41065d35-2cc8-4b66-9767-3fdb3e5e5691-etc-swift\") pod \"41065d35-2cc8-4b66-9767-3fdb3e5e5691\" (UID: \"41065d35-2cc8-4b66-9767-3fdb3e5e5691\") " Mar 16 16:26:02 crc kubenswrapper[5120]: I0316 16:26:02.837830 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f692ad11-c485-436b-8624-ae7769b07b98-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:26:02 crc kubenswrapper[5120]: I0316 16:26:02.837843 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r92dd\" (UniqueName: \"kubernetes.io/projected/f692ad11-c485-436b-8624-ae7769b07b98-kube-api-access-r92dd\") on node \"crc\" DevicePath \"\"" Mar 16 16:26:02 crc kubenswrapper[5120]: I0316 16:26:02.839285 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41065d35-2cc8-4b66-9767-3fdb3e5e5691-etc-swift" (OuterVolumeSpecName: "etc-swift") pod "41065d35-2cc8-4b66-9767-3fdb3e5e5691" (UID: "41065d35-2cc8-4b66-9767-3fdb3e5e5691"). InnerVolumeSpecName "etc-swift". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:26:02 crc kubenswrapper[5120]: I0316 16:26:02.840130 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/41065d35-2cc8-4b66-9767-3fdb3e5e5691-ring-data-devices" (OuterVolumeSpecName: "ring-data-devices") pod "41065d35-2cc8-4b66-9767-3fdb3e5e5691" (UID: "41065d35-2cc8-4b66-9767-3fdb3e5e5691"). InnerVolumeSpecName "ring-data-devices". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:26:02 crc kubenswrapper[5120]: I0316 16:26:02.850726 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41065d35-2cc8-4b66-9767-3fdb3e5e5691-kube-api-access-84jqd" (OuterVolumeSpecName: "kube-api-access-84jqd") pod "41065d35-2cc8-4b66-9767-3fdb3e5e5691" (UID: "41065d35-2cc8-4b66-9767-3fdb3e5e5691"). InnerVolumeSpecName "kube-api-access-84jqd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:26:02 crc kubenswrapper[5120]: I0316 16:26:02.854831 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/41065d35-2cc8-4b66-9767-3fdb3e5e5691-dispersionconf" (OuterVolumeSpecName: "dispersionconf") pod "41065d35-2cc8-4b66-9767-3fdb3e5e5691" (UID: "41065d35-2cc8-4b66-9767-3fdb3e5e5691"). InnerVolumeSpecName "dispersionconf". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:26:02 crc kubenswrapper[5120]: I0316 16:26:02.896002 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/41065d35-2cc8-4b66-9767-3fdb3e5e5691-swiftconf" (OuterVolumeSpecName: "swiftconf") pod "41065d35-2cc8-4b66-9767-3fdb3e5e5691" (UID: "41065d35-2cc8-4b66-9767-3fdb3e5e5691"). InnerVolumeSpecName "swiftconf". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:26:02 crc kubenswrapper[5120]: I0316 16:26:02.904424 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/41065d35-2cc8-4b66-9767-3fdb3e5e5691-scripts" (OuterVolumeSpecName: "scripts") pod "41065d35-2cc8-4b66-9767-3fdb3e5e5691" (UID: "41065d35-2cc8-4b66-9767-3fdb3e5e5691"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:26:02 crc kubenswrapper[5120]: I0316 16:26:02.906931 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/41065d35-2cc8-4b66-9767-3fdb3e5e5691-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "41065d35-2cc8-4b66-9767-3fdb3e5e5691" (UID: "41065d35-2cc8-4b66-9767-3fdb3e5e5691"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:26:02 crc kubenswrapper[5120]: I0316 16:26:02.940398 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8tsv2\" (UniqueName: \"kubernetes.io/projected/823a8cf3-9912-4721-9fe3-e8b8b8b9f03b-kube-api-access-8tsv2\") pod \"823a8cf3-9912-4721-9fe3-e8b8b8b9f03b\" (UID: \"823a8cf3-9912-4721-9fe3-e8b8b8b9f03b\") " Mar 16 16:26:02 crc kubenswrapper[5120]: I0316 16:26:02.940698 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0551ac3d-571d-4f95-a458-317d46bcd64b-operator-scripts\") pod \"0551ac3d-571d-4f95-a458-317d46bcd64b\" (UID: \"0551ac3d-571d-4f95-a458-317d46bcd64b\") " Mar 16 16:26:02 crc kubenswrapper[5120]: I0316 16:26:02.940885 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/823a8cf3-9912-4721-9fe3-e8b8b8b9f03b-operator-scripts\") pod \"823a8cf3-9912-4721-9fe3-e8b8b8b9f03b\" (UID: \"823a8cf3-9912-4721-9fe3-e8b8b8b9f03b\") " Mar 16 16:26:02 crc kubenswrapper[5120]: I0316 16:26:02.941021 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-46w27\" (UniqueName: \"kubernetes.io/projected/0551ac3d-571d-4f95-a458-317d46bcd64b-kube-api-access-46w27\") pod \"0551ac3d-571d-4f95-a458-317d46bcd64b\" (UID: \"0551ac3d-571d-4f95-a458-317d46bcd64b\") " Mar 16 16:26:02 crc kubenswrapper[5120]: I0316 16:26:02.941781 5120 reconciler_common.go:299] "Volume detached for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/41065d35-2cc8-4b66-9767-3fdb3e5e5691-ring-data-devices\") on node \"crc\" DevicePath \"\"" Mar 16 16:26:02 crc kubenswrapper[5120]: I0316 16:26:02.941809 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-84jqd\" (UniqueName: \"kubernetes.io/projected/41065d35-2cc8-4b66-9767-3fdb3e5e5691-kube-api-access-84jqd\") on node \"crc\" DevicePath \"\"" Mar 16 16:26:02 crc kubenswrapper[5120]: I0316 16:26:02.941824 5120 reconciler_common.go:299] "Volume detached for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/41065d35-2cc8-4b66-9767-3fdb3e5e5691-dispersionconf\") on node \"crc\" DevicePath \"\"" Mar 16 16:26:02 crc kubenswrapper[5120]: I0316 16:26:02.941837 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/41065d35-2cc8-4b66-9767-3fdb3e5e5691-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:26:02 crc kubenswrapper[5120]: I0316 16:26:02.941867 5120 reconciler_common.go:299] "Volume detached for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/41065d35-2cc8-4b66-9767-3fdb3e5e5691-swiftconf\") on node \"crc\" DevicePath \"\"" Mar 16 16:26:02 crc kubenswrapper[5120]: I0316 16:26:02.941875 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/41065d35-2cc8-4b66-9767-3fdb3e5e5691-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:26:02 crc kubenswrapper[5120]: I0316 16:26:02.941883 5120 reconciler_common.go:299] "Volume detached for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/41065d35-2cc8-4b66-9767-3fdb3e5e5691-etc-swift\") on node \"crc\" DevicePath \"\"" Mar 16 16:26:02 crc kubenswrapper[5120]: I0316 16:26:02.942470 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0551ac3d-571d-4f95-a458-317d46bcd64b-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "0551ac3d-571d-4f95-a458-317d46bcd64b" (UID: "0551ac3d-571d-4f95-a458-317d46bcd64b"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:26:02 crc kubenswrapper[5120]: I0316 16:26:02.943143 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/823a8cf3-9912-4721-9fe3-e8b8b8b9f03b-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "823a8cf3-9912-4721-9fe3-e8b8b8b9f03b" (UID: "823a8cf3-9912-4721-9fe3-e8b8b8b9f03b"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:26:02 crc kubenswrapper[5120]: I0316 16:26:02.946007 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0551ac3d-571d-4f95-a458-317d46bcd64b-kube-api-access-46w27" (OuterVolumeSpecName: "kube-api-access-46w27") pod "0551ac3d-571d-4f95-a458-317d46bcd64b" (UID: "0551ac3d-571d-4f95-a458-317d46bcd64b"). InnerVolumeSpecName "kube-api-access-46w27". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:26:02 crc kubenswrapper[5120]: I0316 16:26:02.946986 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/823a8cf3-9912-4721-9fe3-e8b8b8b9f03b-kube-api-access-8tsv2" (OuterVolumeSpecName: "kube-api-access-8tsv2") pod "823a8cf3-9912-4721-9fe3-e8b8b8b9f03b" (UID: "823a8cf3-9912-4721-9fe3-e8b8b8b9f03b"). InnerVolumeSpecName "kube-api-access-8tsv2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:26:03 crc kubenswrapper[5120]: I0316 16:26:03.044346 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8tsv2\" (UniqueName: \"kubernetes.io/projected/823a8cf3-9912-4721-9fe3-e8b8b8b9f03b-kube-api-access-8tsv2\") on node \"crc\" DevicePath \"\"" Mar 16 16:26:03 crc kubenswrapper[5120]: I0316 16:26:03.044387 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0551ac3d-571d-4f95-a458-317d46bcd64b-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:26:03 crc kubenswrapper[5120]: I0316 16:26:03.044397 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/823a8cf3-9912-4721-9fe3-e8b8b8b9f03b-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:26:03 crc kubenswrapper[5120]: I0316 16:26:03.044406 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-46w27\" (UniqueName: \"kubernetes.io/projected/0551ac3d-571d-4f95-a458-317d46bcd64b-kube-api-access-46w27\") on node \"crc\" DevicePath \"\"" Mar 16 16:26:03 crc kubenswrapper[5120]: I0316 16:26:03.136000 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-8f6f-account-create-update-5zwr9" Mar 16 16:26:03 crc kubenswrapper[5120]: I0316 16:26:03.136047 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-8f6f-account-create-update-5zwr9" event={"ID":"823a8cf3-9912-4721-9fe3-e8b8b8b9f03b","Type":"ContainerDied","Data":"846968f3b1a996ce3e3f7dc3a495027b4a2f2936b8cd8753642193258c607aa5"} Mar 16 16:26:03 crc kubenswrapper[5120]: I0316 16:26:03.136103 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="846968f3b1a996ce3e3f7dc3a495027b4a2f2936b8cd8753642193258c607aa5" Mar 16 16:26:03 crc kubenswrapper[5120]: I0316 16:26:03.138254 5120 generic.go:358] "Generic (PLEG): container finished" podID="8162a42b-127c-4778-a8cb-f965703da580" containerID="64a638080010ae263bb3194e9708de4611ff497752c67d2954e05543bedd296f" exitCode=0 Mar 16 16:26:03 crc kubenswrapper[5120]: I0316 16:26:03.138288 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561306-dnwwx" event={"ID":"8162a42b-127c-4778-a8cb-f965703da580","Type":"ContainerDied","Data":"64a638080010ae263bb3194e9708de4611ff497752c67d2954e05543bedd296f"} Mar 16 16:26:03 crc kubenswrapper[5120]: I0316 16:26:03.140128 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-cv9jf" Mar 16 16:26:03 crc kubenswrapper[5120]: I0316 16:26:03.140122 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-cv9jf" event={"ID":"41065d35-2cc8-4b66-9767-3fdb3e5e5691","Type":"ContainerDied","Data":"9b60d4c325370a3ac72a4254cd636a3afa0961d5e25841d3e477c275efd9be36"} Mar 16 16:26:03 crc kubenswrapper[5120]: I0316 16:26:03.140244 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9b60d4c325370a3ac72a4254cd636a3afa0961d5e25841d3e477c275efd9be36" Mar 16 16:26:03 crc kubenswrapper[5120]: I0316 16:26:03.142021 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-create-jklt9" event={"ID":"f692ad11-c485-436b-8624-ae7769b07b98","Type":"ContainerDied","Data":"bcf697faefd74e07964bc1698506ee680620a3ffb2416c479378a19a2b12cfd8"} Mar 16 16:26:03 crc kubenswrapper[5120]: I0316 16:26:03.142063 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bcf697faefd74e07964bc1698506ee680620a3ffb2416c479378a19a2b12cfd8" Mar 16 16:26:03 crc kubenswrapper[5120]: I0316 16:26:03.142038 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-create-jklt9" Mar 16 16:26:03 crc kubenswrapper[5120]: I0316 16:26:03.143330 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-bms4j" Mar 16 16:26:03 crc kubenswrapper[5120]: I0316 16:26:03.143458 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-bms4j" event={"ID":"0551ac3d-571d-4f95-a458-317d46bcd64b","Type":"ContainerDied","Data":"e3b7c1917c424110d14fdb4745942a448e4761c5809586d37389ee440a029514"} Mar 16 16:26:03 crc kubenswrapper[5120]: I0316 16:26:03.143486 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e3b7c1917c424110d14fdb4745942a448e4761c5809586d37389ee440a029514" Mar 16 16:26:04 crc kubenswrapper[5120]: I0316 16:26:04.165096 5120 generic.go:358] "Generic (PLEG): container finished" podID="8ce00bd2-57d0-4362-9faa-1ce50ba8d07f" containerID="c581c58f9b70a5e29e5d55f4688ea841750e329b0e7ca1456f075d84f5049fe6" exitCode=0 Mar 16 16:26:04 crc kubenswrapper[5120]: I0316 16:26:04.165228 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-aceb-account-create-update-m55hg" event={"ID":"8ce00bd2-57d0-4362-9faa-1ce50ba8d07f","Type":"ContainerDied","Data":"c581c58f9b70a5e29e5d55f4688ea841750e329b0e7ca1456f075d84f5049fe6"} Mar 16 16:26:04 crc kubenswrapper[5120]: I0316 16:26:04.170150 5120 generic.go:358] "Generic (PLEG): container finished" podID="785bf626-cdb3-4701-bd4f-0f34c3b03ec2" containerID="3c0502000ff01dd33d005a281fd542845cac0a75e1574cba26bf8298a0fc82ed" exitCode=0 Mar 16 16:26:04 crc kubenswrapper[5120]: I0316 16:26:04.170254 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-create-n7fcp" event={"ID":"785bf626-cdb3-4701-bd4f-0f34c3b03ec2","Type":"ContainerDied","Data":"3c0502000ff01dd33d005a281fd542845cac0a75e1574cba26bf8298a0fc82ed"} Mar 16 16:26:04 crc kubenswrapper[5120]: I0316 16:26:04.174136 5120 generic.go:358] "Generic (PLEG): container finished" podID="86acd223-38d0-4b3e-b13b-e24a5ae829da" containerID="957654f923b45b56dff5590e85bc583b1f635cc06ed245eba52a5fa6a0941204" exitCode=0 Mar 16 16:26:04 crc kubenswrapper[5120]: I0316 16:26:04.174357 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-821f-account-create-update-h8xcp" event={"ID":"86acd223-38d0-4b3e-b13b-e24a5ae829da","Type":"ContainerDied","Data":"957654f923b45b56dff5590e85bc583b1f635cc06ed245eba52a5fa6a0941204"} Mar 16 16:26:04 crc kubenswrapper[5120]: I0316 16:26:04.178297 5120 generic.go:358] "Generic (PLEG): container finished" podID="ef37d2ce-771c-4eec-933f-823daddb5817" containerID="1a21b0b1bb37b825f54861d115c094ef686430fe240cdc438d851c864520b383" exitCode=0 Mar 16 16:26:04 crc kubenswrapper[5120]: I0316 16:26:04.178408 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-create-r5v64" event={"ID":"ef37d2ce-771c-4eec-933f-823daddb5817","Type":"ContainerDied","Data":"1a21b0b1bb37b825f54861d115c094ef686430fe240cdc438d851c864520b383"} Mar 16 16:26:04 crc kubenswrapper[5120]: I0316 16:26:04.602889 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561306-dnwwx" Mar 16 16:26:04 crc kubenswrapper[5120]: I0316 16:26:04.685066 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qr78b\" (UniqueName: \"kubernetes.io/projected/8162a42b-127c-4778-a8cb-f965703da580-kube-api-access-qr78b\") pod \"8162a42b-127c-4778-a8cb-f965703da580\" (UID: \"8162a42b-127c-4778-a8cb-f965703da580\") " Mar 16 16:26:04 crc kubenswrapper[5120]: I0316 16:26:04.694412 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8162a42b-127c-4778-a8cb-f965703da580-kube-api-access-qr78b" (OuterVolumeSpecName: "kube-api-access-qr78b") pod "8162a42b-127c-4778-a8cb-f965703da580" (UID: "8162a42b-127c-4778-a8cb-f965703da580"). InnerVolumeSpecName "kube-api-access-qr78b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:26:04 crc kubenswrapper[5120]: I0316 16:26:04.788995 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qr78b\" (UniqueName: \"kubernetes.io/projected/8162a42b-127c-4778-a8cb-f965703da580-kube-api-access-qr78b\") on node \"crc\" DevicePath \"\"" Mar 16 16:26:05 crc kubenswrapper[5120]: I0316 16:26:05.188323 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561306-dnwwx" event={"ID":"8162a42b-127c-4778-a8cb-f965703da580","Type":"ContainerDied","Data":"fa2090b0ad32c2aee630a835acd0bc9344f83ec24f8a8b8f424f0a8f85a3617a"} Mar 16 16:26:05 crc kubenswrapper[5120]: I0316 16:26:05.188399 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fa2090b0ad32c2aee630a835acd0bc9344f83ec24f8a8b8f424f0a8f85a3617a" Mar 16 16:26:05 crc kubenswrapper[5120]: I0316 16:26:05.188356 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561306-dnwwx" Mar 16 16:26:05 crc kubenswrapper[5120]: I0316 16:26:05.691827 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-infra/auto-csr-approver-29561300-vrl66"] Mar 16 16:26:05 crc kubenswrapper[5120]: I0316 16:26:05.707307 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-infra/auto-csr-approver-29561300-vrl66"] Mar 16 16:26:05 crc kubenswrapper[5120]: I0316 16:26:05.709839 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-create-r5v64" Mar 16 16:26:05 crc kubenswrapper[5120]: I0316 16:26:05.815602 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ef37d2ce-771c-4eec-933f-823daddb5817-operator-scripts\") pod \"ef37d2ce-771c-4eec-933f-823daddb5817\" (UID: \"ef37d2ce-771c-4eec-933f-823daddb5817\") " Mar 16 16:26:05 crc kubenswrapper[5120]: I0316 16:26:05.816063 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nx72l\" (UniqueName: \"kubernetes.io/projected/ef37d2ce-771c-4eec-933f-823daddb5817-kube-api-access-nx72l\") pod \"ef37d2ce-771c-4eec-933f-823daddb5817\" (UID: \"ef37d2ce-771c-4eec-933f-823daddb5817\") " Mar 16 16:26:05 crc kubenswrapper[5120]: I0316 16:26:05.816661 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ef37d2ce-771c-4eec-933f-823daddb5817-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "ef37d2ce-771c-4eec-933f-823daddb5817" (UID: "ef37d2ce-771c-4eec-933f-823daddb5817"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:26:05 crc kubenswrapper[5120]: I0316 16:26:05.817064 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ef37d2ce-771c-4eec-933f-823daddb5817-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:26:05 crc kubenswrapper[5120]: I0316 16:26:05.821961 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef37d2ce-771c-4eec-933f-823daddb5817-kube-api-access-nx72l" (OuterVolumeSpecName: "kube-api-access-nx72l") pod "ef37d2ce-771c-4eec-933f-823daddb5817" (UID: "ef37d2ce-771c-4eec-933f-823daddb5817"). InnerVolumeSpecName "kube-api-access-nx72l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:26:05 crc kubenswrapper[5120]: I0316 16:26:05.898028 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-create-n7fcp" Mar 16 16:26:05 crc kubenswrapper[5120]: I0316 16:26:05.902426 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-aceb-account-create-update-m55hg" Mar 16 16:26:05 crc kubenswrapper[5120]: I0316 16:26:05.908228 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-821f-account-create-update-h8xcp" Mar 16 16:26:05 crc kubenswrapper[5120]: I0316 16:26:05.919502 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nx72l\" (UniqueName: \"kubernetes.io/projected/ef37d2ce-771c-4eec-933f-823daddb5817-kube-api-access-nx72l\") on node \"crc\" DevicePath \"\"" Mar 16 16:26:06 crc kubenswrapper[5120]: I0316 16:26:06.020644 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/86acd223-38d0-4b3e-b13b-e24a5ae829da-operator-scripts\") pod \"86acd223-38d0-4b3e-b13b-e24a5ae829da\" (UID: \"86acd223-38d0-4b3e-b13b-e24a5ae829da\") " Mar 16 16:26:06 crc kubenswrapper[5120]: I0316 16:26:06.020900 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n5g2x\" (UniqueName: \"kubernetes.io/projected/8ce00bd2-57d0-4362-9faa-1ce50ba8d07f-kube-api-access-n5g2x\") pod \"8ce00bd2-57d0-4362-9faa-1ce50ba8d07f\" (UID: \"8ce00bd2-57d0-4362-9faa-1ce50ba8d07f\") " Mar 16 16:26:06 crc kubenswrapper[5120]: I0316 16:26:06.021001 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8ce00bd2-57d0-4362-9faa-1ce50ba8d07f-operator-scripts\") pod \"8ce00bd2-57d0-4362-9faa-1ce50ba8d07f\" (UID: \"8ce00bd2-57d0-4362-9faa-1ce50ba8d07f\") " Mar 16 16:26:06 crc kubenswrapper[5120]: I0316 16:26:06.021045 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ss6jf\" (UniqueName: \"kubernetes.io/projected/785bf626-cdb3-4701-bd4f-0f34c3b03ec2-kube-api-access-ss6jf\") pod \"785bf626-cdb3-4701-bd4f-0f34c3b03ec2\" (UID: \"785bf626-cdb3-4701-bd4f-0f34c3b03ec2\") " Mar 16 16:26:06 crc kubenswrapper[5120]: I0316 16:26:06.021115 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dc88m\" (UniqueName: \"kubernetes.io/projected/86acd223-38d0-4b3e-b13b-e24a5ae829da-kube-api-access-dc88m\") pod \"86acd223-38d0-4b3e-b13b-e24a5ae829da\" (UID: \"86acd223-38d0-4b3e-b13b-e24a5ae829da\") " Mar 16 16:26:06 crc kubenswrapper[5120]: I0316 16:26:06.021149 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/86acd223-38d0-4b3e-b13b-e24a5ae829da-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "86acd223-38d0-4b3e-b13b-e24a5ae829da" (UID: "86acd223-38d0-4b3e-b13b-e24a5ae829da"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:26:06 crc kubenswrapper[5120]: I0316 16:26:06.021448 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/785bf626-cdb3-4701-bd4f-0f34c3b03ec2-operator-scripts\") pod \"785bf626-cdb3-4701-bd4f-0f34c3b03ec2\" (UID: \"785bf626-cdb3-4701-bd4f-0f34c3b03ec2\") " Mar 16 16:26:06 crc kubenswrapper[5120]: I0316 16:26:06.021625 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ce00bd2-57d0-4362-9faa-1ce50ba8d07f-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "8ce00bd2-57d0-4362-9faa-1ce50ba8d07f" (UID: "8ce00bd2-57d0-4362-9faa-1ce50ba8d07f"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:26:06 crc kubenswrapper[5120]: I0316 16:26:06.021998 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/785bf626-cdb3-4701-bd4f-0f34c3b03ec2-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "785bf626-cdb3-4701-bd4f-0f34c3b03ec2" (UID: "785bf626-cdb3-4701-bd4f-0f34c3b03ec2"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:26:06 crc kubenswrapper[5120]: I0316 16:26:06.022457 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/785bf626-cdb3-4701-bd4f-0f34c3b03ec2-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:26:06 crc kubenswrapper[5120]: I0316 16:26:06.022498 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/86acd223-38d0-4b3e-b13b-e24a5ae829da-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:26:06 crc kubenswrapper[5120]: I0316 16:26:06.022518 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8ce00bd2-57d0-4362-9faa-1ce50ba8d07f-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:26:06 crc kubenswrapper[5120]: I0316 16:26:06.024386 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ce00bd2-57d0-4362-9faa-1ce50ba8d07f-kube-api-access-n5g2x" (OuterVolumeSpecName: "kube-api-access-n5g2x") pod "8ce00bd2-57d0-4362-9faa-1ce50ba8d07f" (UID: "8ce00bd2-57d0-4362-9faa-1ce50ba8d07f"). InnerVolumeSpecName "kube-api-access-n5g2x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:26:06 crc kubenswrapper[5120]: I0316 16:26:06.025276 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86acd223-38d0-4b3e-b13b-e24a5ae829da-kube-api-access-dc88m" (OuterVolumeSpecName: "kube-api-access-dc88m") pod "86acd223-38d0-4b3e-b13b-e24a5ae829da" (UID: "86acd223-38d0-4b3e-b13b-e24a5ae829da"). InnerVolumeSpecName "kube-api-access-dc88m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:26:06 crc kubenswrapper[5120]: I0316 16:26:06.025490 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/785bf626-cdb3-4701-bd4f-0f34c3b03ec2-kube-api-access-ss6jf" (OuterVolumeSpecName: "kube-api-access-ss6jf") pod "785bf626-cdb3-4701-bd4f-0f34c3b03ec2" (UID: "785bf626-cdb3-4701-bd4f-0f34c3b03ec2"). InnerVolumeSpecName "kube-api-access-ss6jf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:26:06 crc kubenswrapper[5120]: I0316 16:26:06.124352 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dc88m\" (UniqueName: \"kubernetes.io/projected/86acd223-38d0-4b3e-b13b-e24a5ae829da-kube-api-access-dc88m\") on node \"crc\" DevicePath \"\"" Mar 16 16:26:06 crc kubenswrapper[5120]: I0316 16:26:06.124662 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n5g2x\" (UniqueName: \"kubernetes.io/projected/8ce00bd2-57d0-4362-9faa-1ce50ba8d07f-kube-api-access-n5g2x\") on node \"crc\" DevicePath \"\"" Mar 16 16:26:06 crc kubenswrapper[5120]: I0316 16:26:06.124672 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ss6jf\" (UniqueName: \"kubernetes.io/projected/785bf626-cdb3-4701-bd4f-0f34c3b03ec2-kube-api-access-ss6jf\") on node \"crc\" DevicePath \"\"" Mar 16 16:26:06 crc kubenswrapper[5120]: I0316 16:26:06.201418 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-create-r5v64" event={"ID":"ef37d2ce-771c-4eec-933f-823daddb5817","Type":"ContainerDied","Data":"afe44b60366ac9763ef7803a65586626b09fc8f855167c886ae7356d29e67122"} Mar 16 16:26:06 crc kubenswrapper[5120]: I0316 16:26:06.201469 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="afe44b60366ac9763ef7803a65586626b09fc8f855167c886ae7356d29e67122" Mar 16 16:26:06 crc kubenswrapper[5120]: I0316 16:26:06.201548 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-create-r5v64" Mar 16 16:26:06 crc kubenswrapper[5120]: I0316 16:26:06.207401 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-aceb-account-create-update-m55hg" Mar 16 16:26:06 crc kubenswrapper[5120]: I0316 16:26:06.207414 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-aceb-account-create-update-m55hg" event={"ID":"8ce00bd2-57d0-4362-9faa-1ce50ba8d07f","Type":"ContainerDied","Data":"fbe190de076db17f3382298065f6af0485de508a349da3cd9025480c932a3449"} Mar 16 16:26:06 crc kubenswrapper[5120]: I0316 16:26:06.207465 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fbe190de076db17f3382298065f6af0485de508a349da3cd9025480c932a3449" Mar 16 16:26:06 crc kubenswrapper[5120]: I0316 16:26:06.210143 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-create-n7fcp" Mar 16 16:26:06 crc kubenswrapper[5120]: I0316 16:26:06.210157 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-create-n7fcp" event={"ID":"785bf626-cdb3-4701-bd4f-0f34c3b03ec2","Type":"ContainerDied","Data":"579c12c32e20e75cff04eef47a3d08f08497061cb38bb6abc7bf2c2dbb2d8412"} Mar 16 16:26:06 crc kubenswrapper[5120]: I0316 16:26:06.210293 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="579c12c32e20e75cff04eef47a3d08f08497061cb38bb6abc7bf2c2dbb2d8412" Mar 16 16:26:06 crc kubenswrapper[5120]: I0316 16:26:06.212142 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-821f-account-create-update-h8xcp" event={"ID":"86acd223-38d0-4b3e-b13b-e24a5ae829da","Type":"ContainerDied","Data":"94b2eeba765b2da50f4b1730825557783db529d5fd7566876e167052714ba6fb"} Mar 16 16:26:06 crc kubenswrapper[5120]: I0316 16:26:06.212192 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="94b2eeba765b2da50f4b1730825557783db529d5fd7566876e167052714ba6fb" Mar 16 16:26:06 crc kubenswrapper[5120]: I0316 16:26:06.212249 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-821f-account-create-update-h8xcp" Mar 16 16:26:06 crc kubenswrapper[5120]: I0316 16:26:06.676643 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8b8f1cab-ef2b-4dda-9cd5-0c7841b17c66" path="/var/lib/kubelet/pods/8b8f1cab-ef2b-4dda-9cd5-0c7841b17c66/volumes" Mar 16 16:26:07 crc kubenswrapper[5120]: I0316 16:26:07.234694 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-db-sync-7qj4k"] Mar 16 16:26:07 crc kubenswrapper[5120]: I0316 16:26:07.236842 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0551ac3d-571d-4f95-a458-317d46bcd64b" containerName="mariadb-account-create-update" Mar 16 16:26:07 crc kubenswrapper[5120]: I0316 16:26:07.236875 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="0551ac3d-571d-4f95-a458-317d46bcd64b" containerName="mariadb-account-create-update" Mar 16 16:26:07 crc kubenswrapper[5120]: I0316 16:26:07.236900 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86acd223-38d0-4b3e-b13b-e24a5ae829da" containerName="mariadb-account-create-update" Mar 16 16:26:07 crc kubenswrapper[5120]: I0316 16:26:07.236913 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="86acd223-38d0-4b3e-b13b-e24a5ae829da" containerName="mariadb-account-create-update" Mar 16 16:26:07 crc kubenswrapper[5120]: I0316 16:26:07.236947 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="823a8cf3-9912-4721-9fe3-e8b8b8b9f03b" containerName="mariadb-account-create-update" Mar 16 16:26:07 crc kubenswrapper[5120]: I0316 16:26:07.236958 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="823a8cf3-9912-4721-9fe3-e8b8b8b9f03b" containerName="mariadb-account-create-update" Mar 16 16:26:07 crc kubenswrapper[5120]: I0316 16:26:07.236979 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8162a42b-127c-4778-a8cb-f965703da580" containerName="oc" Mar 16 16:26:07 crc kubenswrapper[5120]: I0316 16:26:07.236991 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8162a42b-127c-4778-a8cb-f965703da580" containerName="oc" Mar 16 16:26:07 crc kubenswrapper[5120]: I0316 16:26:07.237011 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="785bf626-cdb3-4701-bd4f-0f34c3b03ec2" containerName="mariadb-database-create" Mar 16 16:26:07 crc kubenswrapper[5120]: I0316 16:26:07.237024 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="785bf626-cdb3-4701-bd4f-0f34c3b03ec2" containerName="mariadb-database-create" Mar 16 16:26:07 crc kubenswrapper[5120]: I0316 16:26:07.237082 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f692ad11-c485-436b-8624-ae7769b07b98" containerName="mariadb-database-create" Mar 16 16:26:07 crc kubenswrapper[5120]: I0316 16:26:07.237093 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f692ad11-c485-436b-8624-ae7769b07b98" containerName="mariadb-database-create" Mar 16 16:26:07 crc kubenswrapper[5120]: I0316 16:26:07.237123 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ce00bd2-57d0-4362-9faa-1ce50ba8d07f" containerName="mariadb-account-create-update" Mar 16 16:26:07 crc kubenswrapper[5120]: I0316 16:26:07.237136 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ce00bd2-57d0-4362-9faa-1ce50ba8d07f" containerName="mariadb-account-create-update" Mar 16 16:26:07 crc kubenswrapper[5120]: I0316 16:26:07.237184 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41065d35-2cc8-4b66-9767-3fdb3e5e5691" containerName="swift-ring-rebalance" Mar 16 16:26:07 crc kubenswrapper[5120]: I0316 16:26:07.237196 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="41065d35-2cc8-4b66-9767-3fdb3e5e5691" containerName="swift-ring-rebalance" Mar 16 16:26:07 crc kubenswrapper[5120]: I0316 16:26:07.237215 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef37d2ce-771c-4eec-933f-823daddb5817" containerName="mariadb-database-create" Mar 16 16:26:07 crc kubenswrapper[5120]: I0316 16:26:07.237226 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef37d2ce-771c-4eec-933f-823daddb5817" containerName="mariadb-database-create" Mar 16 16:26:07 crc kubenswrapper[5120]: I0316 16:26:07.237484 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="8ce00bd2-57d0-4362-9faa-1ce50ba8d07f" containerName="mariadb-account-create-update" Mar 16 16:26:07 crc kubenswrapper[5120]: I0316 16:26:07.237507 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f692ad11-c485-436b-8624-ae7769b07b98" containerName="mariadb-database-create" Mar 16 16:26:07 crc kubenswrapper[5120]: I0316 16:26:07.237526 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="785bf626-cdb3-4701-bd4f-0f34c3b03ec2" containerName="mariadb-database-create" Mar 16 16:26:07 crc kubenswrapper[5120]: I0316 16:26:07.237545 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="41065d35-2cc8-4b66-9767-3fdb3e5e5691" containerName="swift-ring-rebalance" Mar 16 16:26:07 crc kubenswrapper[5120]: I0316 16:26:07.237595 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="0551ac3d-571d-4f95-a458-317d46bcd64b" containerName="mariadb-account-create-update" Mar 16 16:26:07 crc kubenswrapper[5120]: I0316 16:26:07.237618 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="823a8cf3-9912-4721-9fe3-e8b8b8b9f03b" containerName="mariadb-account-create-update" Mar 16 16:26:07 crc kubenswrapper[5120]: I0316 16:26:07.237640 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ef37d2ce-771c-4eec-933f-823daddb5817" containerName="mariadb-database-create" Mar 16 16:26:07 crc kubenswrapper[5120]: I0316 16:26:07.237654 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="8162a42b-127c-4778-a8cb-f965703da580" containerName="oc" Mar 16 16:26:07 crc kubenswrapper[5120]: I0316 16:26:07.237672 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="86acd223-38d0-4b3e-b13b-e24a5ae829da" containerName="mariadb-account-create-update" Mar 16 16:26:07 crc kubenswrapper[5120]: I0316 16:26:07.345939 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-7qj4k" Mar 16 16:26:07 crc kubenswrapper[5120]: I0316 16:26:07.346658 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/1f9d9e0a-3afc-4b45-90ff-1e1a3f4635c6-db-sync-config-data\") pod \"glance-db-sync-7qj4k\" (UID: \"1f9d9e0a-3afc-4b45-90ff-1e1a3f4635c6\") " pod="openstack-kuttl-tests/glance-db-sync-7qj4k" Mar 16 16:26:07 crc kubenswrapper[5120]: I0316 16:26:07.346969 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwtzr\" (UniqueName: \"kubernetes.io/projected/1f9d9e0a-3afc-4b45-90ff-1e1a3f4635c6-kube-api-access-zwtzr\") pod \"glance-db-sync-7qj4k\" (UID: \"1f9d9e0a-3afc-4b45-90ff-1e1a3f4635c6\") " pod="openstack-kuttl-tests/glance-db-sync-7qj4k" Mar 16 16:26:07 crc kubenswrapper[5120]: I0316 16:26:07.347080 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1f9d9e0a-3afc-4b45-90ff-1e1a3f4635c6-config-data\") pod \"glance-db-sync-7qj4k\" (UID: \"1f9d9e0a-3afc-4b45-90ff-1e1a3f4635c6\") " pod="openstack-kuttl-tests/glance-db-sync-7qj4k" Mar 16 16:26:07 crc kubenswrapper[5120]: I0316 16:26:07.347264 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1f9d9e0a-3afc-4b45-90ff-1e1a3f4635c6-combined-ca-bundle\") pod \"glance-db-sync-7qj4k\" (UID: \"1f9d9e0a-3afc-4b45-90ff-1e1a3f4635c6\") " pod="openstack-kuttl-tests/glance-db-sync-7qj4k" Mar 16 16:26:07 crc kubenswrapper[5120]: I0316 16:26:07.352073 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-config-data\"" Mar 16 16:26:07 crc kubenswrapper[5120]: I0316 16:26:07.359428 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-glance-dockercfg-lfz7m\"" Mar 16 16:26:07 crc kubenswrapper[5120]: I0316 16:26:07.366012 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-7qj4k"] Mar 16 16:26:07 crc kubenswrapper[5120]: I0316 16:26:07.435515 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:26:07 crc kubenswrapper[5120]: I0316 16:26:07.456166 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zwtzr\" (UniqueName: \"kubernetes.io/projected/1f9d9e0a-3afc-4b45-90ff-1e1a3f4635c6-kube-api-access-zwtzr\") pod \"glance-db-sync-7qj4k\" (UID: \"1f9d9e0a-3afc-4b45-90ff-1e1a3f4635c6\") " pod="openstack-kuttl-tests/glance-db-sync-7qj4k" Mar 16 16:26:07 crc kubenswrapper[5120]: I0316 16:26:07.456270 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1f9d9e0a-3afc-4b45-90ff-1e1a3f4635c6-config-data\") pod \"glance-db-sync-7qj4k\" (UID: \"1f9d9e0a-3afc-4b45-90ff-1e1a3f4635c6\") " pod="openstack-kuttl-tests/glance-db-sync-7qj4k" Mar 16 16:26:07 crc kubenswrapper[5120]: I0316 16:26:07.456831 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1f9d9e0a-3afc-4b45-90ff-1e1a3f4635c6-combined-ca-bundle\") pod \"glance-db-sync-7qj4k\" (UID: \"1f9d9e0a-3afc-4b45-90ff-1e1a3f4635c6\") " pod="openstack-kuttl-tests/glance-db-sync-7qj4k" Mar 16 16:26:07 crc kubenswrapper[5120]: I0316 16:26:07.457457 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/1f9d9e0a-3afc-4b45-90ff-1e1a3f4635c6-db-sync-config-data\") pod \"glance-db-sync-7qj4k\" (UID: \"1f9d9e0a-3afc-4b45-90ff-1e1a3f4635c6\") " pod="openstack-kuttl-tests/glance-db-sync-7qj4k" Mar 16 16:26:07 crc kubenswrapper[5120]: I0316 16:26:07.463846 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1f9d9e0a-3afc-4b45-90ff-1e1a3f4635c6-combined-ca-bundle\") pod \"glance-db-sync-7qj4k\" (UID: \"1f9d9e0a-3afc-4b45-90ff-1e1a3f4635c6\") " pod="openstack-kuttl-tests/glance-db-sync-7qj4k" Mar 16 16:26:07 crc kubenswrapper[5120]: I0316 16:26:07.478338 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/1f9d9e0a-3afc-4b45-90ff-1e1a3f4635c6-db-sync-config-data\") pod \"glance-db-sync-7qj4k\" (UID: \"1f9d9e0a-3afc-4b45-90ff-1e1a3f4635c6\") " pod="openstack-kuttl-tests/glance-db-sync-7qj4k" Mar 16 16:26:07 crc kubenswrapper[5120]: I0316 16:26:07.497505 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1f9d9e0a-3afc-4b45-90ff-1e1a3f4635c6-config-data\") pod \"glance-db-sync-7qj4k\" (UID: \"1f9d9e0a-3afc-4b45-90ff-1e1a3f4635c6\") " pod="openstack-kuttl-tests/glance-db-sync-7qj4k" Mar 16 16:26:07 crc kubenswrapper[5120]: I0316 16:26:07.506207 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwtzr\" (UniqueName: \"kubernetes.io/projected/1f9d9e0a-3afc-4b45-90ff-1e1a3f4635c6-kube-api-access-zwtzr\") pod \"glance-db-sync-7qj4k\" (UID: \"1f9d9e0a-3afc-4b45-90ff-1e1a3f4635c6\") " pod="openstack-kuttl-tests/glance-db-sync-7qj4k" Mar 16 16:26:07 crc kubenswrapper[5120]: I0316 16:26:07.647467 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-bms4j"] Mar 16 16:26:07 crc kubenswrapper[5120]: I0316 16:26:07.661325 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-bms4j"] Mar 16 16:26:07 crc kubenswrapper[5120]: I0316 16:26:07.685506 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-7qj4k" Mar 16 16:26:07 crc kubenswrapper[5120]: I0316 16:26:07.747659 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/root-account-create-update-wwpqn"] Mar 16 16:26:07 crc kubenswrapper[5120]: I0316 16:26:07.753365 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-wwpqn" Mar 16 16:26:07 crc kubenswrapper[5120]: I0316 16:26:07.759546 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"openstack-cell1-mariadb-root-db-secret\"" Mar 16 16:26:07 crc kubenswrapper[5120]: I0316 16:26:07.769513 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5ade2b67-3714-4800-904d-4843bc597e1c-operator-scripts\") pod \"root-account-create-update-wwpqn\" (UID: \"5ade2b67-3714-4800-904d-4843bc597e1c\") " pod="openstack-kuttl-tests/root-account-create-update-wwpqn" Mar 16 16:26:07 crc kubenswrapper[5120]: I0316 16:26:07.769938 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n442k\" (UniqueName: \"kubernetes.io/projected/5ade2b67-3714-4800-904d-4843bc597e1c-kube-api-access-n442k\") pod \"root-account-create-update-wwpqn\" (UID: \"5ade2b67-3714-4800-904d-4843bc597e1c\") " pod="openstack-kuttl-tests/root-account-create-update-wwpqn" Mar 16 16:26:07 crc kubenswrapper[5120]: I0316 16:26:07.780361 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-wwpqn"] Mar 16 16:26:07 crc kubenswrapper[5120]: I0316 16:26:07.872067 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5ade2b67-3714-4800-904d-4843bc597e1c-operator-scripts\") pod \"root-account-create-update-wwpqn\" (UID: \"5ade2b67-3714-4800-904d-4843bc597e1c\") " pod="openstack-kuttl-tests/root-account-create-update-wwpqn" Mar 16 16:26:07 crc kubenswrapper[5120]: I0316 16:26:07.872165 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n442k\" (UniqueName: \"kubernetes.io/projected/5ade2b67-3714-4800-904d-4843bc597e1c-kube-api-access-n442k\") pod \"root-account-create-update-wwpqn\" (UID: \"5ade2b67-3714-4800-904d-4843bc597e1c\") " pod="openstack-kuttl-tests/root-account-create-update-wwpqn" Mar 16 16:26:07 crc kubenswrapper[5120]: I0316 16:26:07.873032 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5ade2b67-3714-4800-904d-4843bc597e1c-operator-scripts\") pod \"root-account-create-update-wwpqn\" (UID: \"5ade2b67-3714-4800-904d-4843bc597e1c\") " pod="openstack-kuttl-tests/root-account-create-update-wwpqn" Mar 16 16:26:07 crc kubenswrapper[5120]: I0316 16:26:07.898183 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n442k\" (UniqueName: \"kubernetes.io/projected/5ade2b67-3714-4800-904d-4843bc597e1c-kube-api-access-n442k\") pod \"root-account-create-update-wwpqn\" (UID: \"5ade2b67-3714-4800-904d-4843bc597e1c\") " pod="openstack-kuttl-tests/root-account-create-update-wwpqn" Mar 16 16:26:08 crc kubenswrapper[5120]: I0316 16:26:08.130028 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-wwpqn" Mar 16 16:26:08 crc kubenswrapper[5120]: I0316 16:26:08.239084 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-7qj4k"] Mar 16 16:26:08 crc kubenswrapper[5120]: I0316 16:26:08.243819 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:26:08 crc kubenswrapper[5120]: W0316 16:26:08.259962 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1f9d9e0a_3afc_4b45_90ff_1e1a3f4635c6.slice/crio-5f89e21813105311f23fc6a02f1189b75634487399d9819a7c1d4d19c366b3e3 WatchSource:0}: Error finding container 5f89e21813105311f23fc6a02f1189b75634487399d9819a7c1d4d19c366b3e3: Status 404 returned error can't find the container with id 5f89e21813105311f23fc6a02f1189b75634487399d9819a7c1d4d19c366b3e3 Mar 16 16:26:08 crc kubenswrapper[5120]: I0316 16:26:08.333970 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:26:08 crc kubenswrapper[5120]: I0316 16:26:08.348382 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:26:08 crc kubenswrapper[5120]: I0316 16:26:08.398858 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-7qj4k" event={"ID":"1f9d9e0a-3afc-4b45-90ff-1e1a3f4635c6","Type":"ContainerStarted","Data":"5f89e21813105311f23fc6a02f1189b75634487399d9819a7c1d4d19c366b3e3"} Mar 16 16:26:08 crc kubenswrapper[5120]: I0316 16:26:08.456457 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:26:08 crc kubenswrapper[5120]: E0316 16:26:08.550115 5120 upgradeaware.go:427] Error proxying data from client to backend: readfrom tcp 38.102.83.119:49690->38.102.83.119:44311: write tcp 38.102.83.119:49690->38.102.83.119:44311: write: broken pipe Mar 16 16:26:08 crc kubenswrapper[5120]: I0316 16:26:08.602340 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/e4c4e515-3d7d-4436-ab79-c7c6e2bf2867-etc-swift\") pod \"swift-storage-0\" (UID: \"e4c4e515-3d7d-4436-ab79-c7c6e2bf2867\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:26:08 crc kubenswrapper[5120]: I0316 16:26:08.610139 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/e4c4e515-3d7d-4436-ab79-c7c6e2bf2867-etc-swift\") pod \"swift-storage-0\" (UID: \"e4c4e515-3d7d-4436-ab79-c7c6e2bf2867\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:26:08 crc kubenswrapper[5120]: I0316 16:26:08.664421 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:26:08 crc kubenswrapper[5120]: I0316 16:26:08.676584 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0551ac3d-571d-4f95-a458-317d46bcd64b" path="/var/lib/kubelet/pods/0551ac3d-571d-4f95-a458-317d46bcd64b/volumes" Mar 16 16:26:08 crc kubenswrapper[5120]: I0316 16:26:08.697326 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-wwpqn"] Mar 16 16:26:08 crc kubenswrapper[5120]: E0316 16:26:08.969381 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1597319 actualBytes=10240 Mar 16 16:26:09 crc kubenswrapper[5120]: I0316 16:26:09.159373 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 16:26:09 crc kubenswrapper[5120]: I0316 16:26:09.414257 5120 generic.go:358] "Generic (PLEG): container finished" podID="e1bf7ad2-f215-405b-84de-9429f90855f8" containerID="19e7beb485630129ef696f327a066c3d26830c322b9edfd670c4fe6b14c203fa" exitCode=0 Mar 16 16:26:09 crc kubenswrapper[5120]: I0316 16:26:09.414391 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"e1bf7ad2-f215-405b-84de-9429f90855f8","Type":"ContainerDied","Data":"19e7beb485630129ef696f327a066c3d26830c322b9edfd670c4fe6b14c203fa"} Mar 16 16:26:09 crc kubenswrapper[5120]: I0316 16:26:09.418515 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-wwpqn" event={"ID":"5ade2b67-3714-4800-904d-4843bc597e1c","Type":"ContainerStarted","Data":"4184228e5a2fff602edff587fd26bf92a795e80dccea49510289085159af992b"} Mar 16 16:26:09 crc kubenswrapper[5120]: I0316 16:26:09.418564 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-wwpqn" event={"ID":"5ade2b67-3714-4800-904d-4843bc597e1c","Type":"ContainerStarted","Data":"7d1ab76f420858f7dca4f56669b00f1e997ae8ec3a56ced667b0d10f6b252434"} Mar 16 16:26:09 crc kubenswrapper[5120]: I0316 16:26:09.423632 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"e4c4e515-3d7d-4436-ab79-c7c6e2bf2867","Type":"ContainerStarted","Data":"3ac7f6046df50253d3eadf80ba177d221a2736f47d24a8d92d25740b867b4645"} Mar 16 16:26:09 crc kubenswrapper[5120]: I0316 16:26:09.429240 5120 generic.go:358] "Generic (PLEG): container finished" podID="dbe6904f-2249-41c3-bb8a-a1b5817094c5" containerID="d0ac33814164ae216a7ef35d60d9cc7d9e2d05a54d17c01507619259afcfaab8" exitCode=0 Mar 16 16:26:09 crc kubenswrapper[5120]: I0316 16:26:09.429348 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-1" event={"ID":"dbe6904f-2249-41c3-bb8a-a1b5817094c5","Type":"ContainerDied","Data":"d0ac33814164ae216a7ef35d60d9cc7d9e2d05a54d17c01507619259afcfaab8"} Mar 16 16:26:09 crc kubenswrapper[5120]: I0316 16:26:09.443437 5120 generic.go:358] "Generic (PLEG): container finished" podID="b190faa2-d49d-424d-90bc-3e6e34d1b362" containerID="3b2fc28702bef6284fe6b43edd4bdce22491e8ae026936351aae301d0cec1a8b" exitCode=0 Mar 16 16:26:09 crc kubenswrapper[5120]: I0316 16:26:09.444167 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-2" event={"ID":"b190faa2-d49d-424d-90bc-3e6e34d1b362","Type":"ContainerDied","Data":"3b2fc28702bef6284fe6b43edd4bdce22491e8ae026936351aae301d0cec1a8b"} Mar 16 16:26:09 crc kubenswrapper[5120]: I0316 16:26:09.483422 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/openstack-galera-1" Mar 16 16:26:09 crc kubenswrapper[5120]: I0316 16:26:09.491675 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/root-account-create-update-wwpqn" podStartSLOduration=2.491654117 podStartE2EDuration="2.491654117s" podCreationTimestamp="2026-03-16 16:26:07 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:26:09.456862737 +0000 UTC m=+3271.610794394" watchObservedRunningTime="2026-03-16 16:26:09.491654117 +0000 UTC m=+3271.645585774" Mar 16 16:26:09 crc kubenswrapper[5120]: I0316 16:26:09.644634 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/openstack-galera-1" Mar 16 16:26:10 crc kubenswrapper[5120]: I0316 16:26:10.458303 5120 generic.go:358] "Generic (PLEG): container finished" podID="4df637ef-8f2d-4eb1-8a51-327814195dbf" containerID="165262826bdc38dd4fad2923abdc06d2a3dab7f65eb388bea00584b1ceb6a547" exitCode=0 Mar 16 16:26:10 crc kubenswrapper[5120]: I0316 16:26:10.458578 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"4df637ef-8f2d-4eb1-8a51-327814195dbf","Type":"ContainerDied","Data":"165262826bdc38dd4fad2923abdc06d2a3dab7f65eb388bea00584b1ceb6a547"} Mar 16 16:26:10 crc kubenswrapper[5120]: I0316 16:26:10.462682 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"e1bf7ad2-f215-405b-84de-9429f90855f8","Type":"ContainerStarted","Data":"e890194391fce067d02b1a137a5f39d7a59911e519be323ded2d6c7dbe78f932"} Mar 16 16:26:10 crc kubenswrapper[5120]: I0316 16:26:10.463628 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:26:10 crc kubenswrapper[5120]: I0316 16:26:10.472348 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"e4c4e515-3d7d-4436-ab79-c7c6e2bf2867","Type":"ContainerStarted","Data":"96b84c6ebe1b0747f05480dc24a682f7a93699950490b8252cf8ed9dd2bd8e77"} Mar 16 16:26:10 crc kubenswrapper[5120]: I0316 16:26:10.472378 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"e4c4e515-3d7d-4436-ab79-c7c6e2bf2867","Type":"ContainerStarted","Data":"8e57dd33a2aa825284690808124c1ecbc5dca938121e8420b3ff5077ff9704bf"} Mar 16 16:26:10 crc kubenswrapper[5120]: I0316 16:26:10.472389 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"e4c4e515-3d7d-4436-ab79-c7c6e2bf2867","Type":"ContainerStarted","Data":"9ec444876101ad416b611d2885a35edb13ab6f3780cd291d8b4f774fbd06ff20"} Mar 16 16:26:10 crc kubenswrapper[5120]: I0316 16:26:10.472398 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"e4c4e515-3d7d-4436-ab79-c7c6e2bf2867","Type":"ContainerStarted","Data":"70f91690ca6860782cfe602660752293b957c3e5d757ab6406b3818a603f33f2"} Mar 16 16:26:10 crc kubenswrapper[5120]: I0316 16:26:10.472407 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"e4c4e515-3d7d-4436-ab79-c7c6e2bf2867","Type":"ContainerStarted","Data":"751ce949d1961a8983b58c560348689c5c84954f76641475fcfa8b6fd3ea7968"} Mar 16 16:26:10 crc kubenswrapper[5120]: I0316 16:26:10.472417 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"e4c4e515-3d7d-4436-ab79-c7c6e2bf2867","Type":"ContainerStarted","Data":"ba7e067e325914eabba7eb247b617294a269cd7bb06ce5d8a84762cbe0e8e442"} Mar 16 16:26:10 crc kubenswrapper[5120]: I0316 16:26:10.477009 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-1" event={"ID":"dbe6904f-2249-41c3-bb8a-a1b5817094c5","Type":"ContainerStarted","Data":"efa6791ca8f5aaec639eb569281ad36ec0672df0bc56d4887c44877a37c8a1e4"} Mar 16 16:26:10 crc kubenswrapper[5120]: I0316 16:26:10.477600 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/rabbitmq-cell1-server-1" Mar 16 16:26:10 crc kubenswrapper[5120]: I0316 16:26:10.486034 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-7qj4k" event={"ID":"1f9d9e0a-3afc-4b45-90ff-1e1a3f4635c6","Type":"ContainerStarted","Data":"5c52a4ba5687378dcbf09f145eaf6ec74af34dcc6b2d37a41f902372f658c6b7"} Mar 16 16:26:10 crc kubenswrapper[5120]: I0316 16:26:10.497917 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-2" event={"ID":"b190faa2-d49d-424d-90bc-3e6e34d1b362","Type":"ContainerStarted","Data":"1af24cc4ef41d3c7f4136a8089e28219a6259af0444d27c19d5201dc4b1a70e5"} Mar 16 16:26:10 crc kubenswrapper[5120]: I0316 16:26:10.498683 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/rabbitmq-cell1-server-2" Mar 16 16:26:10 crc kubenswrapper[5120]: I0316 16:26:10.515171 5120 generic.go:358] "Generic (PLEG): container finished" podID="9ab03e09-ed0f-4675-82c7-e04f1c3937ce" containerID="d74a3c4991867a062329d3cd6b295cd64d369bbf217d82583bf74e17039fc89d" exitCode=0 Mar 16 16:26:10 crc kubenswrapper[5120]: I0316 16:26:10.515286 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-2" event={"ID":"9ab03e09-ed0f-4675-82c7-e04f1c3937ce","Type":"ContainerDied","Data":"d74a3c4991867a062329d3cd6b295cd64d369bbf217d82583bf74e17039fc89d"} Mar 16 16:26:10 crc kubenswrapper[5120]: I0316 16:26:10.522002 5120 generic.go:358] "Generic (PLEG): container finished" podID="a8e524d7-0cb0-4bec-9948-70d463625805" containerID="6b7acd6d38b5a42151c6262787d12910dc418e4e0adb77e42bc25f6f78a2dfcd" exitCode=0 Mar 16 16:26:10 crc kubenswrapper[5120]: I0316 16:26:10.522172 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-1" event={"ID":"a8e524d7-0cb0-4bec-9948-70d463625805","Type":"ContainerDied","Data":"6b7acd6d38b5a42151c6262787d12910dc418e4e0adb77e42bc25f6f78a2dfcd"} Mar 16 16:26:10 crc kubenswrapper[5120]: I0316 16:26:10.523173 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" podStartSLOduration=37.523162917 podStartE2EDuration="37.523162917s" podCreationTimestamp="2026-03-16 16:25:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:26:10.519336315 +0000 UTC m=+3272.673267972" watchObservedRunningTime="2026-03-16 16:26:10.523162917 +0000 UTC m=+3272.677094574" Mar 16 16:26:10 crc kubenswrapper[5120]: I0316 16:26:10.596383 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/rabbitmq-cell1-server-1" podStartSLOduration=37.596358725 podStartE2EDuration="37.596358725s" podCreationTimestamp="2026-03-16 16:25:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:26:10.542603897 +0000 UTC m=+3272.696535554" watchObservedRunningTime="2026-03-16 16:26:10.596358725 +0000 UTC m=+3272.750290382" Mar 16 16:26:10 crc kubenswrapper[5120]: I0316 16:26:10.674735 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-db-sync-7qj4k" podStartSLOduration=3.6747161310000003 podStartE2EDuration="3.674716131s" podCreationTimestamp="2026-03-16 16:26:07 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:26:10.615865677 +0000 UTC m=+3272.769797334" watchObservedRunningTime="2026-03-16 16:26:10.674716131 +0000 UTC m=+3272.828647778" Mar 16 16:26:10 crc kubenswrapper[5120]: I0316 16:26:10.755699 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/rabbitmq-cell1-server-2" podStartSLOduration=37.755674247 podStartE2EDuration="37.755674247s" podCreationTimestamp="2026-03-16 16:25:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:26:10.715531253 +0000 UTC m=+3272.869462900" watchObservedRunningTime="2026-03-16 16:26:10.755674247 +0000 UTC m=+3272.909605904" Mar 16 16:26:11 crc kubenswrapper[5120]: I0316 16:26:11.534339 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-2" event={"ID":"9ab03e09-ed0f-4675-82c7-e04f1c3937ce","Type":"ContainerStarted","Data":"c37ed1da6f16fabdc1a6782a38cfbfcec0a7cc7a1aebfee00bd24988fc28935f"} Mar 16 16:26:11 crc kubenswrapper[5120]: I0316 16:26:11.535656 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/rabbitmq-server-2" Mar 16 16:26:11 crc kubenswrapper[5120]: I0316 16:26:11.539829 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-1" event={"ID":"a8e524d7-0cb0-4bec-9948-70d463625805","Type":"ContainerStarted","Data":"0ffcec825f56c969e28525148d56b9ac9132173717921abf5a8e79272b9d5b39"} Mar 16 16:26:11 crc kubenswrapper[5120]: I0316 16:26:11.540600 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/rabbitmq-server-1" Mar 16 16:26:11 crc kubenswrapper[5120]: I0316 16:26:11.542531 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"4df637ef-8f2d-4eb1-8a51-327814195dbf","Type":"ContainerStarted","Data":"c7da8c850bcfaa6b77764f70b226aa97d27d819990e54a6faad91619f81e9005"} Mar 16 16:26:11 crc kubenswrapper[5120]: I0316 16:26:11.543104 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:26:11 crc kubenswrapper[5120]: I0316 16:26:11.551883 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"e4c4e515-3d7d-4436-ab79-c7c6e2bf2867","Type":"ContainerStarted","Data":"11236707832e2120fc41d5104a2f9b4d27803bed6d28a687cb24b58154784ab0"} Mar 16 16:26:11 crc kubenswrapper[5120]: I0316 16:26:11.551914 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"e4c4e515-3d7d-4436-ab79-c7c6e2bf2867","Type":"ContainerStarted","Data":"f73f6b34fb962826c023fdaeb3f6939041fc2fd39eecb456ee6e023a1e3589cb"} Mar 16 16:26:11 crc kubenswrapper[5120]: I0316 16:26:11.551950 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"e4c4e515-3d7d-4436-ab79-c7c6e2bf2867","Type":"ContainerStarted","Data":"c68aab4be854a460023e8b8f93e43ace66b0a1f2cc56a0afabb12d8d59203372"} Mar 16 16:26:11 crc kubenswrapper[5120]: I0316 16:26:11.551959 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"e4c4e515-3d7d-4436-ab79-c7c6e2bf2867","Type":"ContainerStarted","Data":"5ffea8961d29d9fab0235d9e49ecd3f2bb869266e115ed97f9b97a47c83f280d"} Mar 16 16:26:11 crc kubenswrapper[5120]: I0316 16:26:11.562157 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/rabbitmq-server-2" podStartSLOduration=37.562142098 podStartE2EDuration="37.562142098s" podCreationTimestamp="2026-03-16 16:25:34 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:26:11.557622956 +0000 UTC m=+3273.711554613" watchObservedRunningTime="2026-03-16 16:26:11.562142098 +0000 UTC m=+3273.716073755" Mar 16 16:26:11 crc kubenswrapper[5120]: I0316 16:26:11.599741 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/rabbitmq-server-0" podStartSLOduration=37.599721412 podStartE2EDuration="37.599721412s" podCreationTimestamp="2026-03-16 16:25:34 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:26:11.587862705 +0000 UTC m=+3273.741794362" watchObservedRunningTime="2026-03-16 16:26:11.599721412 +0000 UTC m=+3273.753653069" Mar 16 16:26:11 crc kubenswrapper[5120]: I0316 16:26:11.634897 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/rabbitmq-server-1" podStartSLOduration=37.634866472 podStartE2EDuration="37.634866472s" podCreationTimestamp="2026-03-16 16:25:34 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:26:11.617913698 +0000 UTC m=+3273.771845355" watchObservedRunningTime="2026-03-16 16:26:11.634866472 +0000 UTC m=+3273.788798129" Mar 16 16:26:12 crc kubenswrapper[5120]: I0316 16:26:12.564472 5120 generic.go:358] "Generic (PLEG): container finished" podID="5ade2b67-3714-4800-904d-4843bc597e1c" containerID="4184228e5a2fff602edff587fd26bf92a795e80dccea49510289085159af992b" exitCode=0 Mar 16 16:26:12 crc kubenswrapper[5120]: I0316 16:26:12.565711 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-wwpqn" event={"ID":"5ade2b67-3714-4800-904d-4843bc597e1c","Type":"ContainerDied","Data":"4184228e5a2fff602edff587fd26bf92a795e80dccea49510289085159af992b"} Mar 16 16:26:12 crc kubenswrapper[5120]: I0316 16:26:12.577810 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"e4c4e515-3d7d-4436-ab79-c7c6e2bf2867","Type":"ContainerStarted","Data":"f15bf1aad527f5c095b7bff2dca1db767738973c6277e2a0f00f4724cc41a6d1"} Mar 16 16:26:12 crc kubenswrapper[5120]: I0316 16:26:12.577859 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"e4c4e515-3d7d-4436-ab79-c7c6e2bf2867","Type":"ContainerStarted","Data":"3f2d886d7f02bd132c23ebdd596245f0c4fcdcb60de0f942e9db05d9a554cc06"} Mar 16 16:26:12 crc kubenswrapper[5120]: I0316 16:26:12.577869 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"e4c4e515-3d7d-4436-ab79-c7c6e2bf2867","Type":"ContainerStarted","Data":"3316e7f6d49dbecddd206e93a21152d473303f16fa69403030e6aaaeaa38adab"} Mar 16 16:26:12 crc kubenswrapper[5120]: I0316 16:26:12.577880 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"e4c4e515-3d7d-4436-ab79-c7c6e2bf2867","Type":"ContainerStarted","Data":"0ae219285be2774fd999a00f3eb7b796c400b3bb54670c492ef1a7cd633c9f6b"} Mar 16 16:26:12 crc kubenswrapper[5120]: I0316 16:26:12.577889 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"e4c4e515-3d7d-4436-ab79-c7c6e2bf2867","Type":"ContainerStarted","Data":"ee574a05fc70f725e484eed1c78245bd008ee2dca8d8e5747b40feeb8ea97135"} Mar 16 16:26:12 crc kubenswrapper[5120]: I0316 16:26:12.626550 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/swift-storage-0" podStartSLOduration=21.626517746 podStartE2EDuration="21.626517746s" podCreationTimestamp="2026-03-16 16:25:51 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:26:12.614806522 +0000 UTC m=+3274.768738179" watchObservedRunningTime="2026-03-16 16:26:12.626517746 +0000 UTC m=+3274.780449403" Mar 16 16:26:12 crc kubenswrapper[5120]: I0316 16:26:12.782919 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-74dd7b8bd5-7mv25"] Mar 16 16:26:12 crc kubenswrapper[5120]: I0316 16:26:12.794104 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-74dd7b8bd5-7mv25" Mar 16 16:26:12 crc kubenswrapper[5120]: I0316 16:26:12.796925 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"dns-swift-storage-0\"" Mar 16 16:26:12 crc kubenswrapper[5120]: I0316 16:26:12.798798 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-74dd7b8bd5-7mv25"] Mar 16 16:26:12 crc kubenswrapper[5120]: I0316 16:26:12.837940 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/f6dd7905-5098-43d7-9a6e-e9bd86470598-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-74dd7b8bd5-7mv25\" (UID: \"f6dd7905-5098-43d7-9a6e-e9bd86470598\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-74dd7b8bd5-7mv25" Mar 16 16:26:12 crc kubenswrapper[5120]: I0316 16:26:12.838057 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/f6dd7905-5098-43d7-9a6e-e9bd86470598-dns-swift-storage-0\") pod \"dnsmasq-dnsmasq-74dd7b8bd5-7mv25\" (UID: \"f6dd7905-5098-43d7-9a6e-e9bd86470598\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-74dd7b8bd5-7mv25" Mar 16 16:26:12 crc kubenswrapper[5120]: I0316 16:26:12.838163 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6d9x\" (UniqueName: \"kubernetes.io/projected/f6dd7905-5098-43d7-9a6e-e9bd86470598-kube-api-access-b6d9x\") pod \"dnsmasq-dnsmasq-74dd7b8bd5-7mv25\" (UID: \"f6dd7905-5098-43d7-9a6e-e9bd86470598\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-74dd7b8bd5-7mv25" Mar 16 16:26:12 crc kubenswrapper[5120]: I0316 16:26:12.838331 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f6dd7905-5098-43d7-9a6e-e9bd86470598-config\") pod \"dnsmasq-dnsmasq-74dd7b8bd5-7mv25\" (UID: \"f6dd7905-5098-43d7-9a6e-e9bd86470598\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-74dd7b8bd5-7mv25" Mar 16 16:26:12 crc kubenswrapper[5120]: I0316 16:26:12.941262 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b6d9x\" (UniqueName: \"kubernetes.io/projected/f6dd7905-5098-43d7-9a6e-e9bd86470598-kube-api-access-b6d9x\") pod \"dnsmasq-dnsmasq-74dd7b8bd5-7mv25\" (UID: \"f6dd7905-5098-43d7-9a6e-e9bd86470598\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-74dd7b8bd5-7mv25" Mar 16 16:26:12 crc kubenswrapper[5120]: I0316 16:26:12.941394 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f6dd7905-5098-43d7-9a6e-e9bd86470598-config\") pod \"dnsmasq-dnsmasq-74dd7b8bd5-7mv25\" (UID: \"f6dd7905-5098-43d7-9a6e-e9bd86470598\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-74dd7b8bd5-7mv25" Mar 16 16:26:12 crc kubenswrapper[5120]: I0316 16:26:12.941553 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/f6dd7905-5098-43d7-9a6e-e9bd86470598-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-74dd7b8bd5-7mv25\" (UID: \"f6dd7905-5098-43d7-9a6e-e9bd86470598\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-74dd7b8bd5-7mv25" Mar 16 16:26:12 crc kubenswrapper[5120]: I0316 16:26:12.941672 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/f6dd7905-5098-43d7-9a6e-e9bd86470598-dns-swift-storage-0\") pod \"dnsmasq-dnsmasq-74dd7b8bd5-7mv25\" (UID: \"f6dd7905-5098-43d7-9a6e-e9bd86470598\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-74dd7b8bd5-7mv25" Mar 16 16:26:12 crc kubenswrapper[5120]: I0316 16:26:12.942240 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f6dd7905-5098-43d7-9a6e-e9bd86470598-config\") pod \"dnsmasq-dnsmasq-74dd7b8bd5-7mv25\" (UID: \"f6dd7905-5098-43d7-9a6e-e9bd86470598\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-74dd7b8bd5-7mv25" Mar 16 16:26:12 crc kubenswrapper[5120]: I0316 16:26:12.942626 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/f6dd7905-5098-43d7-9a6e-e9bd86470598-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-74dd7b8bd5-7mv25\" (UID: \"f6dd7905-5098-43d7-9a6e-e9bd86470598\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-74dd7b8bd5-7mv25" Mar 16 16:26:12 crc kubenswrapper[5120]: I0316 16:26:12.943306 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/f6dd7905-5098-43d7-9a6e-e9bd86470598-dns-swift-storage-0\") pod \"dnsmasq-dnsmasq-74dd7b8bd5-7mv25\" (UID: \"f6dd7905-5098-43d7-9a6e-e9bd86470598\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-74dd7b8bd5-7mv25" Mar 16 16:26:12 crc kubenswrapper[5120]: I0316 16:26:12.966199 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6d9x\" (UniqueName: \"kubernetes.io/projected/f6dd7905-5098-43d7-9a6e-e9bd86470598-kube-api-access-b6d9x\") pod \"dnsmasq-dnsmasq-74dd7b8bd5-7mv25\" (UID: \"f6dd7905-5098-43d7-9a6e-e9bd86470598\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-74dd7b8bd5-7mv25" Mar 16 16:26:13 crc kubenswrapper[5120]: I0316 16:26:13.113398 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-74dd7b8bd5-7mv25" Mar 16 16:26:13 crc kubenswrapper[5120]: W0316 16:26:13.619956 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf6dd7905_5098_43d7_9a6e_e9bd86470598.slice/crio-33fb965535f40e26dcb1acc46f394e7d081ded7e76b8d2c631ad3b4570d2cd85 WatchSource:0}: Error finding container 33fb965535f40e26dcb1acc46f394e7d081ded7e76b8d2c631ad3b4570d2cd85: Status 404 returned error can't find the container with id 33fb965535f40e26dcb1acc46f394e7d081ded7e76b8d2c631ad3b4570d2cd85 Mar 16 16:26:13 crc kubenswrapper[5120]: I0316 16:26:13.620617 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-74dd7b8bd5-7mv25"] Mar 16 16:26:14 crc kubenswrapper[5120]: I0316 16:26:14.096346 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-wwpqn" Mar 16 16:26:14 crc kubenswrapper[5120]: I0316 16:26:14.174622 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n442k\" (UniqueName: \"kubernetes.io/projected/5ade2b67-3714-4800-904d-4843bc597e1c-kube-api-access-n442k\") pod \"5ade2b67-3714-4800-904d-4843bc597e1c\" (UID: \"5ade2b67-3714-4800-904d-4843bc597e1c\") " Mar 16 16:26:14 crc kubenswrapper[5120]: I0316 16:26:14.174870 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5ade2b67-3714-4800-904d-4843bc597e1c-operator-scripts\") pod \"5ade2b67-3714-4800-904d-4843bc597e1c\" (UID: \"5ade2b67-3714-4800-904d-4843bc597e1c\") " Mar 16 16:26:14 crc kubenswrapper[5120]: I0316 16:26:14.175847 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ade2b67-3714-4800-904d-4843bc597e1c-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "5ade2b67-3714-4800-904d-4843bc597e1c" (UID: "5ade2b67-3714-4800-904d-4843bc597e1c"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:26:14 crc kubenswrapper[5120]: I0316 16:26:14.180909 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ade2b67-3714-4800-904d-4843bc597e1c-kube-api-access-n442k" (OuterVolumeSpecName: "kube-api-access-n442k") pod "5ade2b67-3714-4800-904d-4843bc597e1c" (UID: "5ade2b67-3714-4800-904d-4843bc597e1c"). InnerVolumeSpecName "kube-api-access-n442k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:26:14 crc kubenswrapper[5120]: I0316 16:26:14.277489 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n442k\" (UniqueName: \"kubernetes.io/projected/5ade2b67-3714-4800-904d-4843bc597e1c-kube-api-access-n442k\") on node \"crc\" DevicePath \"\"" Mar 16 16:26:14 crc kubenswrapper[5120]: I0316 16:26:14.277536 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5ade2b67-3714-4800-904d-4843bc597e1c-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:26:14 crc kubenswrapper[5120]: I0316 16:26:14.344065 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/openstack-cell1-galera-1" Mar 16 16:26:14 crc kubenswrapper[5120]: I0316 16:26:14.435603 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/openstack-cell1-galera-1" Mar 16 16:26:14 crc kubenswrapper[5120]: I0316 16:26:14.600172 5120 generic.go:358] "Generic (PLEG): container finished" podID="f6dd7905-5098-43d7-9a6e-e9bd86470598" containerID="c3831888a512d2d34dd89c6b32e720e2bed9f6c76f6c50765f3ddfbb0cdc5db1" exitCode=0 Mar 16 16:26:14 crc kubenswrapper[5120]: I0316 16:26:14.600337 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-74dd7b8bd5-7mv25" event={"ID":"f6dd7905-5098-43d7-9a6e-e9bd86470598","Type":"ContainerDied","Data":"c3831888a512d2d34dd89c6b32e720e2bed9f6c76f6c50765f3ddfbb0cdc5db1"} Mar 16 16:26:14 crc kubenswrapper[5120]: I0316 16:26:14.600369 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-74dd7b8bd5-7mv25" event={"ID":"f6dd7905-5098-43d7-9a6e-e9bd86470598","Type":"ContainerStarted","Data":"33fb965535f40e26dcb1acc46f394e7d081ded7e76b8d2c631ad3b4570d2cd85"} Mar 16 16:26:14 crc kubenswrapper[5120]: I0316 16:26:14.605173 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-wwpqn" Mar 16 16:26:14 crc kubenswrapper[5120]: I0316 16:26:14.605219 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-wwpqn" event={"ID":"5ade2b67-3714-4800-904d-4843bc597e1c","Type":"ContainerDied","Data":"7d1ab76f420858f7dca4f56669b00f1e997ae8ec3a56ced667b0d10f6b252434"} Mar 16 16:26:14 crc kubenswrapper[5120]: I0316 16:26:14.605258 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7d1ab76f420858f7dca4f56669b00f1e997ae8ec3a56ced667b0d10f6b252434" Mar 16 16:26:15 crc kubenswrapper[5120]: I0316 16:26:15.620953 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-74dd7b8bd5-7mv25" event={"ID":"f6dd7905-5098-43d7-9a6e-e9bd86470598","Type":"ContainerStarted","Data":"622174a9730828fbc1f15662ca12355498b8e3c36864333e71fec689dc9806c8"} Mar 16 16:26:15 crc kubenswrapper[5120]: I0316 16:26:15.621881 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-74dd7b8bd5-7mv25" Mar 16 16:26:16 crc kubenswrapper[5120]: I0316 16:26:16.455736 5120 scope.go:117] "RemoveContainer" containerID="5fa34cfe92c499e9a866c066d9a129f18e0e5590f75287260fd13ac5a7d3c743" Mar 16 16:26:16 crc kubenswrapper[5120]: I0316 16:26:16.542682 5120 scope.go:117] "RemoveContainer" containerID="ef555b565781b0ed51d1e10c66b7f4ccdd9c617065f94ffb19a56c298e670055" Mar 16 16:26:16 crc kubenswrapper[5120]: I0316 16:26:16.566298 5120 scope.go:117] "RemoveContainer" containerID="7585df4078615dabd64c031b0029e70c9446a686bdfd224743c3c5cbe2469b6e" Mar 16 16:26:17 crc kubenswrapper[5120]: I0316 16:26:17.651091 5120 generic.go:358] "Generic (PLEG): container finished" podID="1f9d9e0a-3afc-4b45-90ff-1e1a3f4635c6" containerID="5c52a4ba5687378dcbf09f145eaf6ec74af34dcc6b2d37a41f902372f658c6b7" exitCode=0 Mar 16 16:26:17 crc kubenswrapper[5120]: I0316 16:26:17.651166 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-7qj4k" event={"ID":"1f9d9e0a-3afc-4b45-90ff-1e1a3f4635c6","Type":"ContainerDied","Data":"5c52a4ba5687378dcbf09f145eaf6ec74af34dcc6b2d37a41f902372f658c6b7"} Mar 16 16:26:17 crc kubenswrapper[5120]: I0316 16:26:17.684811 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-74dd7b8bd5-7mv25" podStartSLOduration=5.68479338 podStartE2EDuration="5.68479338s" podCreationTimestamp="2026-03-16 16:26:12 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:26:15.653872619 +0000 UTC m=+3277.807804306" watchObservedRunningTime="2026-03-16 16:26:17.68479338 +0000 UTC m=+3279.838725037" Mar 16 16:26:19 crc kubenswrapper[5120]: I0316 16:26:19.134260 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-7qj4k" Mar 16 16:26:19 crc kubenswrapper[5120]: I0316 16:26:19.300428 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/1f9d9e0a-3afc-4b45-90ff-1e1a3f4635c6-db-sync-config-data\") pod \"1f9d9e0a-3afc-4b45-90ff-1e1a3f4635c6\" (UID: \"1f9d9e0a-3afc-4b45-90ff-1e1a3f4635c6\") " Mar 16 16:26:19 crc kubenswrapper[5120]: I0316 16:26:19.300690 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1f9d9e0a-3afc-4b45-90ff-1e1a3f4635c6-config-data\") pod \"1f9d9e0a-3afc-4b45-90ff-1e1a3f4635c6\" (UID: \"1f9d9e0a-3afc-4b45-90ff-1e1a3f4635c6\") " Mar 16 16:26:19 crc kubenswrapper[5120]: I0316 16:26:19.301582 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1f9d9e0a-3afc-4b45-90ff-1e1a3f4635c6-combined-ca-bundle\") pod \"1f9d9e0a-3afc-4b45-90ff-1e1a3f4635c6\" (UID: \"1f9d9e0a-3afc-4b45-90ff-1e1a3f4635c6\") " Mar 16 16:26:19 crc kubenswrapper[5120]: I0316 16:26:19.301865 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zwtzr\" (UniqueName: \"kubernetes.io/projected/1f9d9e0a-3afc-4b45-90ff-1e1a3f4635c6-kube-api-access-zwtzr\") pod \"1f9d9e0a-3afc-4b45-90ff-1e1a3f4635c6\" (UID: \"1f9d9e0a-3afc-4b45-90ff-1e1a3f4635c6\") " Mar 16 16:26:19 crc kubenswrapper[5120]: I0316 16:26:19.309488 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f9d9e0a-3afc-4b45-90ff-1e1a3f4635c6-kube-api-access-zwtzr" (OuterVolumeSpecName: "kube-api-access-zwtzr") pod "1f9d9e0a-3afc-4b45-90ff-1e1a3f4635c6" (UID: "1f9d9e0a-3afc-4b45-90ff-1e1a3f4635c6"). InnerVolumeSpecName "kube-api-access-zwtzr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:26:19 crc kubenswrapper[5120]: I0316 16:26:19.309852 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f9d9e0a-3afc-4b45-90ff-1e1a3f4635c6-db-sync-config-data" (OuterVolumeSpecName: "db-sync-config-data") pod "1f9d9e0a-3afc-4b45-90ff-1e1a3f4635c6" (UID: "1f9d9e0a-3afc-4b45-90ff-1e1a3f4635c6"). InnerVolumeSpecName "db-sync-config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:26:19 crc kubenswrapper[5120]: I0316 16:26:19.349938 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f9d9e0a-3afc-4b45-90ff-1e1a3f4635c6-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "1f9d9e0a-3afc-4b45-90ff-1e1a3f4635c6" (UID: "1f9d9e0a-3afc-4b45-90ff-1e1a3f4635c6"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:26:19 crc kubenswrapper[5120]: I0316 16:26:19.364774 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f9d9e0a-3afc-4b45-90ff-1e1a3f4635c6-config-data" (OuterVolumeSpecName: "config-data") pod "1f9d9e0a-3afc-4b45-90ff-1e1a3f4635c6" (UID: "1f9d9e0a-3afc-4b45-90ff-1e1a3f4635c6"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:26:19 crc kubenswrapper[5120]: I0316 16:26:19.404023 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zwtzr\" (UniqueName: \"kubernetes.io/projected/1f9d9e0a-3afc-4b45-90ff-1e1a3f4635c6-kube-api-access-zwtzr\") on node \"crc\" DevicePath \"\"" Mar 16 16:26:19 crc kubenswrapper[5120]: I0316 16:26:19.404055 5120 reconciler_common.go:299] "Volume detached for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/1f9d9e0a-3afc-4b45-90ff-1e1a3f4635c6-db-sync-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:26:19 crc kubenswrapper[5120]: I0316 16:26:19.404065 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1f9d9e0a-3afc-4b45-90ff-1e1a3f4635c6-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:26:19 crc kubenswrapper[5120]: I0316 16:26:19.404074 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1f9d9e0a-3afc-4b45-90ff-1e1a3f4635c6-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:26:19 crc kubenswrapper[5120]: I0316 16:26:19.689905 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-7qj4k" Mar 16 16:26:19 crc kubenswrapper[5120]: I0316 16:26:19.689917 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-7qj4k" event={"ID":"1f9d9e0a-3afc-4b45-90ff-1e1a3f4635c6","Type":"ContainerDied","Data":"5f89e21813105311f23fc6a02f1189b75634487399d9819a7c1d4d19c366b3e3"} Mar 16 16:26:19 crc kubenswrapper[5120]: I0316 16:26:19.690723 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5f89e21813105311f23fc6a02f1189b75634487399d9819a7c1d4d19c366b3e3" Mar 16 16:26:21 crc kubenswrapper[5120]: I0316 16:26:21.554170 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/rabbitmq-cell1-server-2" podUID="b190faa2-d49d-424d-90bc-3e6e34d1b362" containerName="rabbitmq" probeResult="failure" output="dial tcp 10.217.1.155:5671: connect: connection refused" Mar 16 16:26:21 crc kubenswrapper[5120]: I0316 16:26:21.554820 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/rabbitmq-cell1-server-1" podUID="dbe6904f-2249-41c3-bb8a-a1b5817094c5" containerName="rabbitmq" probeResult="failure" output="dial tcp 10.217.1.156:5671: connect: connection refused" Mar 16 16:26:21 crc kubenswrapper[5120]: I0316 16:26:21.555220 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" podUID="e1bf7ad2-f215-405b-84de-9429f90855f8" containerName="rabbitmq" probeResult="failure" output="dial tcp 10.217.1.153:5671: connect: connection refused" Mar 16 16:26:21 crc kubenswrapper[5120]: I0316 16:26:21.635951 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-74dd7b8bd5-7mv25" Mar 16 16:26:21 crc kubenswrapper[5120]: I0316 16:26:21.713414 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-q5hqq"] Mar 16 16:26:21 crc kubenswrapper[5120]: I0316 16:26:21.713732 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-q5hqq" podUID="5132805e-c90f-44bf-a405-0a3fae248b25" containerName="dnsmasq-dns" containerID="cri-o://566d78b0f8070276e13b3342ee30e370f030412b271305de46b708db6c533d94" gracePeriod=10 Mar 16 16:26:22 crc kubenswrapper[5120]: I0316 16:26:22.198751 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-q5hqq" Mar 16 16:26:22 crc kubenswrapper[5120]: I0316 16:26:22.267087 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5132805e-c90f-44bf-a405-0a3fae248b25-config\") pod \"5132805e-c90f-44bf-a405-0a3fae248b25\" (UID: \"5132805e-c90f-44bf-a405-0a3fae248b25\") " Mar 16 16:26:22 crc kubenswrapper[5120]: I0316 16:26:22.267153 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4k4dw\" (UniqueName: \"kubernetes.io/projected/5132805e-c90f-44bf-a405-0a3fae248b25-kube-api-access-4k4dw\") pod \"5132805e-c90f-44bf-a405-0a3fae248b25\" (UID: \"5132805e-c90f-44bf-a405-0a3fae248b25\") " Mar 16 16:26:22 crc kubenswrapper[5120]: I0316 16:26:22.267192 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/5132805e-c90f-44bf-a405-0a3fae248b25-dnsmasq-svc\") pod \"5132805e-c90f-44bf-a405-0a3fae248b25\" (UID: \"5132805e-c90f-44bf-a405-0a3fae248b25\") " Mar 16 16:26:22 crc kubenswrapper[5120]: I0316 16:26:22.297387 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5132805e-c90f-44bf-a405-0a3fae248b25-kube-api-access-4k4dw" (OuterVolumeSpecName: "kube-api-access-4k4dw") pod "5132805e-c90f-44bf-a405-0a3fae248b25" (UID: "5132805e-c90f-44bf-a405-0a3fae248b25"). InnerVolumeSpecName "kube-api-access-4k4dw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:26:22 crc kubenswrapper[5120]: I0316 16:26:22.333911 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5132805e-c90f-44bf-a405-0a3fae248b25-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "5132805e-c90f-44bf-a405-0a3fae248b25" (UID: "5132805e-c90f-44bf-a405-0a3fae248b25"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:26:22 crc kubenswrapper[5120]: I0316 16:26:22.343800 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5132805e-c90f-44bf-a405-0a3fae248b25-config" (OuterVolumeSpecName: "config") pod "5132805e-c90f-44bf-a405-0a3fae248b25" (UID: "5132805e-c90f-44bf-a405-0a3fae248b25"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:26:22 crc kubenswrapper[5120]: I0316 16:26:22.369228 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5132805e-c90f-44bf-a405-0a3fae248b25-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:26:22 crc kubenswrapper[5120]: I0316 16:26:22.369258 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4k4dw\" (UniqueName: \"kubernetes.io/projected/5132805e-c90f-44bf-a405-0a3fae248b25-kube-api-access-4k4dw\") on node \"crc\" DevicePath \"\"" Mar 16 16:26:22 crc kubenswrapper[5120]: I0316 16:26:22.369269 5120 reconciler_common.go:299] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/5132805e-c90f-44bf-a405-0a3fae248b25-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Mar 16 16:26:22 crc kubenswrapper[5120]: I0316 16:26:22.578867 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/rabbitmq-server-2" podUID="9ab03e09-ed0f-4675-82c7-e04f1c3937ce" containerName="rabbitmq" probeResult="failure" output="dial tcp 10.217.1.158:5671: connect: connection refused" Mar 16 16:26:22 crc kubenswrapper[5120]: I0316 16:26:22.580850 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/rabbitmq-server-1" podUID="a8e524d7-0cb0-4bec-9948-70d463625805" containerName="rabbitmq" probeResult="failure" output="dial tcp 10.217.1.159:5671: connect: connection refused" Mar 16 16:26:22 crc kubenswrapper[5120]: I0316 16:26:22.580869 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/rabbitmq-server-0" podUID="4df637ef-8f2d-4eb1-8a51-327814195dbf" containerName="rabbitmq" probeResult="failure" output="dial tcp 10.217.1.157:5671: connect: connection refused" Mar 16 16:26:22 crc kubenswrapper[5120]: I0316 16:26:22.724671 5120 generic.go:358] "Generic (PLEG): container finished" podID="5132805e-c90f-44bf-a405-0a3fae248b25" containerID="566d78b0f8070276e13b3342ee30e370f030412b271305de46b708db6c533d94" exitCode=0 Mar 16 16:26:22 crc kubenswrapper[5120]: I0316 16:26:22.724780 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-q5hqq" Mar 16 16:26:22 crc kubenswrapper[5120]: I0316 16:26:22.724782 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-q5hqq" event={"ID":"5132805e-c90f-44bf-a405-0a3fae248b25","Type":"ContainerDied","Data":"566d78b0f8070276e13b3342ee30e370f030412b271305de46b708db6c533d94"} Mar 16 16:26:22 crc kubenswrapper[5120]: I0316 16:26:22.724843 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-q5hqq" event={"ID":"5132805e-c90f-44bf-a405-0a3fae248b25","Type":"ContainerDied","Data":"47c13110662b8fc18494f64f566f22fbeff82c46fb785c90fc9ef2e968a7ac0d"} Mar 16 16:26:22 crc kubenswrapper[5120]: I0316 16:26:22.724865 5120 scope.go:117] "RemoveContainer" containerID="566d78b0f8070276e13b3342ee30e370f030412b271305de46b708db6c533d94" Mar 16 16:26:22 crc kubenswrapper[5120]: I0316 16:26:22.745056 5120 scope.go:117] "RemoveContainer" containerID="fd4e45f2c4670f47db023353f3e953f96c86ceae7f66ae655b1a622dff175c7f" Mar 16 16:26:22 crc kubenswrapper[5120]: I0316 16:26:22.773580 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-q5hqq"] Mar 16 16:26:22 crc kubenswrapper[5120]: I0316 16:26:22.776935 5120 scope.go:117] "RemoveContainer" containerID="566d78b0f8070276e13b3342ee30e370f030412b271305de46b708db6c533d94" Mar 16 16:26:22 crc kubenswrapper[5120]: E0316 16:26:22.777673 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"566d78b0f8070276e13b3342ee30e370f030412b271305de46b708db6c533d94\": container with ID starting with 566d78b0f8070276e13b3342ee30e370f030412b271305de46b708db6c533d94 not found: ID does not exist" containerID="566d78b0f8070276e13b3342ee30e370f030412b271305de46b708db6c533d94" Mar 16 16:26:22 crc kubenswrapper[5120]: I0316 16:26:22.777732 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"566d78b0f8070276e13b3342ee30e370f030412b271305de46b708db6c533d94"} err="failed to get container status \"566d78b0f8070276e13b3342ee30e370f030412b271305de46b708db6c533d94\": rpc error: code = NotFound desc = could not find container \"566d78b0f8070276e13b3342ee30e370f030412b271305de46b708db6c533d94\": container with ID starting with 566d78b0f8070276e13b3342ee30e370f030412b271305de46b708db6c533d94 not found: ID does not exist" Mar 16 16:26:22 crc kubenswrapper[5120]: I0316 16:26:22.777771 5120 scope.go:117] "RemoveContainer" containerID="fd4e45f2c4670f47db023353f3e953f96c86ceae7f66ae655b1a622dff175c7f" Mar 16 16:26:22 crc kubenswrapper[5120]: E0316 16:26:22.778155 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fd4e45f2c4670f47db023353f3e953f96c86ceae7f66ae655b1a622dff175c7f\": container with ID starting with fd4e45f2c4670f47db023353f3e953f96c86ceae7f66ae655b1a622dff175c7f not found: ID does not exist" containerID="fd4e45f2c4670f47db023353f3e953f96c86ceae7f66ae655b1a622dff175c7f" Mar 16 16:26:22 crc kubenswrapper[5120]: I0316 16:26:22.778211 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd4e45f2c4670f47db023353f3e953f96c86ceae7f66ae655b1a622dff175c7f"} err="failed to get container status \"fd4e45f2c4670f47db023353f3e953f96c86ceae7f66ae655b1a622dff175c7f\": rpc error: code = NotFound desc = could not find container \"fd4e45f2c4670f47db023353f3e953f96c86ceae7f66ae655b1a622dff175c7f\": container with ID starting with fd4e45f2c4670f47db023353f3e953f96c86ceae7f66ae655b1a622dff175c7f not found: ID does not exist" Mar 16 16:26:22 crc kubenswrapper[5120]: I0316 16:26:22.783596 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-q5hqq"] Mar 16 16:26:24 crc kubenswrapper[5120]: I0316 16:26:24.675735 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5132805e-c90f-44bf-a405-0a3fae248b25" path="/var/lib/kubelet/pods/5132805e-c90f-44bf-a405-0a3fae248b25/volumes" Mar 16 16:26:31 crc kubenswrapper[5120]: I0316 16:26:31.553496 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/rabbitmq-cell1-server-2" podUID="b190faa2-d49d-424d-90bc-3e6e34d1b362" containerName="rabbitmq" probeResult="failure" output="dial tcp 10.217.1.155:5671: connect: connection refused" Mar 16 16:26:31 crc kubenswrapper[5120]: I0316 16:26:31.554769 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:26:31 crc kubenswrapper[5120]: I0316 16:26:31.555953 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/rabbitmq-cell1-server-1" Mar 16 16:26:32 crc kubenswrapper[5120]: I0316 16:26:32.578352 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/rabbitmq-server-2" Mar 16 16:26:32 crc kubenswrapper[5120]: I0316 16:26:32.580057 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/rabbitmq-server-1" Mar 16 16:26:32 crc kubenswrapper[5120]: I0316 16:26:32.582024 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:26:34 crc kubenswrapper[5120]: I0316 16:26:34.345379 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-db-create-cqrlj"] Mar 16 16:26:34 crc kubenswrapper[5120]: I0316 16:26:34.346919 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f9d9e0a-3afc-4b45-90ff-1e1a3f4635c6" containerName="glance-db-sync" Mar 16 16:26:34 crc kubenswrapper[5120]: I0316 16:26:34.346934 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f9d9e0a-3afc-4b45-90ff-1e1a3f4635c6" containerName="glance-db-sync" Mar 16 16:26:34 crc kubenswrapper[5120]: I0316 16:26:34.346966 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5132805e-c90f-44bf-a405-0a3fae248b25" containerName="init" Mar 16 16:26:34 crc kubenswrapper[5120]: I0316 16:26:34.346972 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="5132805e-c90f-44bf-a405-0a3fae248b25" containerName="init" Mar 16 16:26:34 crc kubenswrapper[5120]: I0316 16:26:34.347002 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5132805e-c90f-44bf-a405-0a3fae248b25" containerName="dnsmasq-dns" Mar 16 16:26:34 crc kubenswrapper[5120]: I0316 16:26:34.347007 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="5132805e-c90f-44bf-a405-0a3fae248b25" containerName="dnsmasq-dns" Mar 16 16:26:34 crc kubenswrapper[5120]: I0316 16:26:34.347017 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ade2b67-3714-4800-904d-4843bc597e1c" containerName="mariadb-account-create-update" Mar 16 16:26:34 crc kubenswrapper[5120]: I0316 16:26:34.347024 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ade2b67-3714-4800-904d-4843bc597e1c" containerName="mariadb-account-create-update" Mar 16 16:26:34 crc kubenswrapper[5120]: I0316 16:26:34.347173 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1f9d9e0a-3afc-4b45-90ff-1e1a3f4635c6" containerName="glance-db-sync" Mar 16 16:26:34 crc kubenswrapper[5120]: I0316 16:26:34.347190 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="5132805e-c90f-44bf-a405-0a3fae248b25" containerName="dnsmasq-dns" Mar 16 16:26:34 crc kubenswrapper[5120]: I0316 16:26:34.347203 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="5ade2b67-3714-4800-904d-4843bc597e1c" containerName="mariadb-account-create-update" Mar 16 16:26:34 crc kubenswrapper[5120]: I0316 16:26:34.357359 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-create-cqrlj" Mar 16 16:26:34 crc kubenswrapper[5120]: I0316 16:26:34.365648 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-a215-account-create-update-jdntm"] Mar 16 16:26:34 crc kubenswrapper[5120]: I0316 16:26:34.370667 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-a215-account-create-update-jdntm" Mar 16 16:26:34 crc kubenswrapper[5120]: I0316 16:26:34.375432 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-db-secret\"" Mar 16 16:26:34 crc kubenswrapper[5120]: I0316 16:26:34.387986 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-db-create-cqrlj"] Mar 16 16:26:34 crc kubenswrapper[5120]: I0316 16:26:34.407006 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-a215-account-create-update-jdntm"] Mar 16 16:26:34 crc kubenswrapper[5120]: I0316 16:26:34.453365 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-db-create-2vc9f"] Mar 16 16:26:34 crc kubenswrapper[5120]: I0316 16:26:34.476627 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-db-create-2vc9f"] Mar 16 16:26:34 crc kubenswrapper[5120]: I0316 16:26:34.476784 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-create-2vc9f" Mar 16 16:26:34 crc kubenswrapper[5120]: I0316 16:26:34.529055 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/63c5f1f5-8359-43a8-a043-9867582182d1-operator-scripts\") pod \"cinder-db-create-cqrlj\" (UID: \"63c5f1f5-8359-43a8-a043-9867582182d1\") " pod="openstack-kuttl-tests/cinder-db-create-cqrlj" Mar 16 16:26:34 crc kubenswrapper[5120]: I0316 16:26:34.529124 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hmbr\" (UniqueName: \"kubernetes.io/projected/63c5f1f5-8359-43a8-a043-9867582182d1-kube-api-access-7hmbr\") pod \"cinder-db-create-cqrlj\" (UID: \"63c5f1f5-8359-43a8-a043-9867582182d1\") " pod="openstack-kuttl-tests/cinder-db-create-cqrlj" Mar 16 16:26:34 crc kubenswrapper[5120]: I0316 16:26:34.529214 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8d066f10-2ae7-4441-8302-a2fc9c744aa8-operator-scripts\") pod \"cinder-a215-account-create-update-jdntm\" (UID: \"8d066f10-2ae7-4441-8302-a2fc9c744aa8\") " pod="openstack-kuttl-tests/cinder-a215-account-create-update-jdntm" Mar 16 16:26:34 crc kubenswrapper[5120]: I0316 16:26:34.529735 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bznfx\" (UniqueName: \"kubernetes.io/projected/8d066f10-2ae7-4441-8302-a2fc9c744aa8-kube-api-access-bznfx\") pod \"cinder-a215-account-create-update-jdntm\" (UID: \"8d066f10-2ae7-4441-8302-a2fc9c744aa8\") " pod="openstack-kuttl-tests/cinder-a215-account-create-update-jdntm" Mar 16 16:26:34 crc kubenswrapper[5120]: I0316 16:26:34.545882 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-8f87-account-create-update-md6vc"] Mar 16 16:26:34 crc kubenswrapper[5120]: I0316 16:26:34.551110 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-8f87-account-create-update-md6vc" Mar 16 16:26:34 crc kubenswrapper[5120]: I0316 16:26:34.553190 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-db-secret\"" Mar 16 16:26:34 crc kubenswrapper[5120]: I0316 16:26:34.565403 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-8f87-account-create-update-md6vc"] Mar 16 16:26:34 crc kubenswrapper[5120]: I0316 16:26:34.620580 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-rqjnm"] Mar 16 16:26:34 crc kubenswrapper[5120]: I0316 16:26:34.626655 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-rqjnm" Mar 16 16:26:34 crc kubenswrapper[5120]: I0316 16:26:34.628510 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-keystone-dockercfg-9hkx9\"" Mar 16 16:26:34 crc kubenswrapper[5120]: I0316 16:26:34.631407 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-config-data\"" Mar 16 16:26:34 crc kubenswrapper[5120]: I0316 16:26:34.631689 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone\"" Mar 16 16:26:34 crc kubenswrapper[5120]: I0316 16:26:34.632276 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-scripts\"" Mar 16 16:26:34 crc kubenswrapper[5120]: I0316 16:26:34.634588 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/906875be-ea9c-49a4-8162-46aa9d27ec42-operator-scripts\") pod \"barbican-8f87-account-create-update-md6vc\" (UID: \"906875be-ea9c-49a4-8162-46aa9d27ec42\") " pod="openstack-kuttl-tests/barbican-8f87-account-create-update-md6vc" Mar 16 16:26:34 crc kubenswrapper[5120]: I0316 16:26:34.634681 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bznfx\" (UniqueName: \"kubernetes.io/projected/8d066f10-2ae7-4441-8302-a2fc9c744aa8-kube-api-access-bznfx\") pod \"cinder-a215-account-create-update-jdntm\" (UID: \"8d066f10-2ae7-4441-8302-a2fc9c744aa8\") " pod="openstack-kuttl-tests/cinder-a215-account-create-update-jdntm" Mar 16 16:26:34 crc kubenswrapper[5120]: I0316 16:26:34.634720 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e622dbb7-5ee2-4b38-a60f-f151f513e13e-combined-ca-bundle\") pod \"keystone-db-sync-rqjnm\" (UID: \"e622dbb7-5ee2-4b38-a60f-f151f513e13e\") " pod="openstack-kuttl-tests/keystone-db-sync-rqjnm" Mar 16 16:26:34 crc kubenswrapper[5120]: I0316 16:26:34.634775 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2a10d584-68ec-45e6-955f-3559e75bc4ee-operator-scripts\") pod \"neutron-db-create-2vc9f\" (UID: \"2a10d584-68ec-45e6-955f-3559e75bc4ee\") " pod="openstack-kuttl-tests/neutron-db-create-2vc9f" Mar 16 16:26:34 crc kubenswrapper[5120]: I0316 16:26:34.634794 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bv96s\" (UniqueName: \"kubernetes.io/projected/2a10d584-68ec-45e6-955f-3559e75bc4ee-kube-api-access-bv96s\") pod \"neutron-db-create-2vc9f\" (UID: \"2a10d584-68ec-45e6-955f-3559e75bc4ee\") " pod="openstack-kuttl-tests/neutron-db-create-2vc9f" Mar 16 16:26:34 crc kubenswrapper[5120]: I0316 16:26:34.634884 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/63c5f1f5-8359-43a8-a043-9867582182d1-operator-scripts\") pod \"cinder-db-create-cqrlj\" (UID: \"63c5f1f5-8359-43a8-a043-9867582182d1\") " pod="openstack-kuttl-tests/cinder-db-create-cqrlj" Mar 16 16:26:34 crc kubenswrapper[5120]: I0316 16:26:34.634931 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7hmbr\" (UniqueName: \"kubernetes.io/projected/63c5f1f5-8359-43a8-a043-9867582182d1-kube-api-access-7hmbr\") pod \"cinder-db-create-cqrlj\" (UID: \"63c5f1f5-8359-43a8-a043-9867582182d1\") " pod="openstack-kuttl-tests/cinder-db-create-cqrlj" Mar 16 16:26:34 crc kubenswrapper[5120]: I0316 16:26:34.634963 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8d066f10-2ae7-4441-8302-a2fc9c744aa8-operator-scripts\") pod \"cinder-a215-account-create-update-jdntm\" (UID: \"8d066f10-2ae7-4441-8302-a2fc9c744aa8\") " pod="openstack-kuttl-tests/cinder-a215-account-create-update-jdntm" Mar 16 16:26:34 crc kubenswrapper[5120]: I0316 16:26:34.634986 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e622dbb7-5ee2-4b38-a60f-f151f513e13e-config-data\") pod \"keystone-db-sync-rqjnm\" (UID: \"e622dbb7-5ee2-4b38-a60f-f151f513e13e\") " pod="openstack-kuttl-tests/keystone-db-sync-rqjnm" Mar 16 16:26:34 crc kubenswrapper[5120]: I0316 16:26:34.636133 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8d066f10-2ae7-4441-8302-a2fc9c744aa8-operator-scripts\") pod \"cinder-a215-account-create-update-jdntm\" (UID: \"8d066f10-2ae7-4441-8302-a2fc9c744aa8\") " pod="openstack-kuttl-tests/cinder-a215-account-create-update-jdntm" Mar 16 16:26:34 crc kubenswrapper[5120]: I0316 16:26:34.636184 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgkt5\" (UniqueName: \"kubernetes.io/projected/906875be-ea9c-49a4-8162-46aa9d27ec42-kube-api-access-bgkt5\") pod \"barbican-8f87-account-create-update-md6vc\" (UID: \"906875be-ea9c-49a4-8162-46aa9d27ec42\") " pod="openstack-kuttl-tests/barbican-8f87-account-create-update-md6vc" Mar 16 16:26:34 crc kubenswrapper[5120]: I0316 16:26:34.636238 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hx959\" (UniqueName: \"kubernetes.io/projected/e622dbb7-5ee2-4b38-a60f-f151f513e13e-kube-api-access-hx959\") pod \"keystone-db-sync-rqjnm\" (UID: \"e622dbb7-5ee2-4b38-a60f-f151f513e13e\") " pod="openstack-kuttl-tests/keystone-db-sync-rqjnm" Mar 16 16:26:34 crc kubenswrapper[5120]: I0316 16:26:34.636556 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/63c5f1f5-8359-43a8-a043-9867582182d1-operator-scripts\") pod \"cinder-db-create-cqrlj\" (UID: \"63c5f1f5-8359-43a8-a043-9867582182d1\") " pod="openstack-kuttl-tests/cinder-db-create-cqrlj" Mar 16 16:26:34 crc kubenswrapper[5120]: I0316 16:26:34.640784 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-rqjnm"] Mar 16 16:26:34 crc kubenswrapper[5120]: I0316 16:26:34.653818 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-db-create-94bn8"] Mar 16 16:26:34 crc kubenswrapper[5120]: I0316 16:26:34.661285 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-create-94bn8" Mar 16 16:26:34 crc kubenswrapper[5120]: I0316 16:26:34.668188 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hmbr\" (UniqueName: \"kubernetes.io/projected/63c5f1f5-8359-43a8-a043-9867582182d1-kube-api-access-7hmbr\") pod \"cinder-db-create-cqrlj\" (UID: \"63c5f1f5-8359-43a8-a043-9867582182d1\") " pod="openstack-kuttl-tests/cinder-db-create-cqrlj" Mar 16 16:26:34 crc kubenswrapper[5120]: I0316 16:26:34.675124 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-db-create-94bn8"] Mar 16 16:26:34 crc kubenswrapper[5120]: I0316 16:26:34.680374 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bznfx\" (UniqueName: \"kubernetes.io/projected/8d066f10-2ae7-4441-8302-a2fc9c744aa8-kube-api-access-bznfx\") pod \"cinder-a215-account-create-update-jdntm\" (UID: \"8d066f10-2ae7-4441-8302-a2fc9c744aa8\") " pod="openstack-kuttl-tests/cinder-a215-account-create-update-jdntm" Mar 16 16:26:34 crc kubenswrapper[5120]: I0316 16:26:34.683613 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-create-cqrlj" Mar 16 16:26:34 crc kubenswrapper[5120]: I0316 16:26:34.686383 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-500e-account-create-update-r59gp"] Mar 16 16:26:34 crc kubenswrapper[5120]: I0316 16:26:34.691879 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-500e-account-create-update-r59gp" Mar 16 16:26:34 crc kubenswrapper[5120]: I0316 16:26:34.693706 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-db-secret\"" Mar 16 16:26:34 crc kubenswrapper[5120]: I0316 16:26:34.704147 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-500e-account-create-update-r59gp"] Mar 16 16:26:34 crc kubenswrapper[5120]: I0316 16:26:34.706999 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-a215-account-create-update-jdntm" Mar 16 16:26:34 crc kubenswrapper[5120]: I0316 16:26:34.737265 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2a10d584-68ec-45e6-955f-3559e75bc4ee-operator-scripts\") pod \"neutron-db-create-2vc9f\" (UID: \"2a10d584-68ec-45e6-955f-3559e75bc4ee\") " pod="openstack-kuttl-tests/neutron-db-create-2vc9f" Mar 16 16:26:34 crc kubenswrapper[5120]: I0316 16:26:34.737323 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bv96s\" (UniqueName: \"kubernetes.io/projected/2a10d584-68ec-45e6-955f-3559e75bc4ee-kube-api-access-bv96s\") pod \"neutron-db-create-2vc9f\" (UID: \"2a10d584-68ec-45e6-955f-3559e75bc4ee\") " pod="openstack-kuttl-tests/neutron-db-create-2vc9f" Mar 16 16:26:34 crc kubenswrapper[5120]: I0316 16:26:34.737525 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e622dbb7-5ee2-4b38-a60f-f151f513e13e-config-data\") pod \"keystone-db-sync-rqjnm\" (UID: \"e622dbb7-5ee2-4b38-a60f-f151f513e13e\") " pod="openstack-kuttl-tests/keystone-db-sync-rqjnm" Mar 16 16:26:34 crc kubenswrapper[5120]: I0316 16:26:34.737583 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b90e76bc-d652-4606-8c72-4b96133ce5c4-operator-scripts\") pod \"barbican-db-create-94bn8\" (UID: \"b90e76bc-d652-4606-8c72-4b96133ce5c4\") " pod="openstack-kuttl-tests/barbican-db-create-94bn8" Mar 16 16:26:34 crc kubenswrapper[5120]: I0316 16:26:34.737692 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bgkt5\" (UniqueName: \"kubernetes.io/projected/906875be-ea9c-49a4-8162-46aa9d27ec42-kube-api-access-bgkt5\") pod \"barbican-8f87-account-create-update-md6vc\" (UID: \"906875be-ea9c-49a4-8162-46aa9d27ec42\") " pod="openstack-kuttl-tests/barbican-8f87-account-create-update-md6vc" Mar 16 16:26:34 crc kubenswrapper[5120]: I0316 16:26:34.737721 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3009831d-c0d7-4ce2-a2ff-7e2b9807c4a3-operator-scripts\") pod \"neutron-500e-account-create-update-r59gp\" (UID: \"3009831d-c0d7-4ce2-a2ff-7e2b9807c4a3\") " pod="openstack-kuttl-tests/neutron-500e-account-create-update-r59gp" Mar 16 16:26:34 crc kubenswrapper[5120]: I0316 16:26:34.737773 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kfsd\" (UniqueName: \"kubernetes.io/projected/3009831d-c0d7-4ce2-a2ff-7e2b9807c4a3-kube-api-access-4kfsd\") pod \"neutron-500e-account-create-update-r59gp\" (UID: \"3009831d-c0d7-4ce2-a2ff-7e2b9807c4a3\") " pod="openstack-kuttl-tests/neutron-500e-account-create-update-r59gp" Mar 16 16:26:34 crc kubenswrapper[5120]: I0316 16:26:34.737886 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hx959\" (UniqueName: \"kubernetes.io/projected/e622dbb7-5ee2-4b38-a60f-f151f513e13e-kube-api-access-hx959\") pod \"keystone-db-sync-rqjnm\" (UID: \"e622dbb7-5ee2-4b38-a60f-f151f513e13e\") " pod="openstack-kuttl-tests/keystone-db-sync-rqjnm" Mar 16 16:26:34 crc kubenswrapper[5120]: I0316 16:26:34.737960 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgr9l\" (UniqueName: \"kubernetes.io/projected/b90e76bc-d652-4606-8c72-4b96133ce5c4-kube-api-access-mgr9l\") pod \"barbican-db-create-94bn8\" (UID: \"b90e76bc-d652-4606-8c72-4b96133ce5c4\") " pod="openstack-kuttl-tests/barbican-db-create-94bn8" Mar 16 16:26:34 crc kubenswrapper[5120]: I0316 16:26:34.737995 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/906875be-ea9c-49a4-8162-46aa9d27ec42-operator-scripts\") pod \"barbican-8f87-account-create-update-md6vc\" (UID: \"906875be-ea9c-49a4-8162-46aa9d27ec42\") " pod="openstack-kuttl-tests/barbican-8f87-account-create-update-md6vc" Mar 16 16:26:34 crc kubenswrapper[5120]: I0316 16:26:34.738071 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e622dbb7-5ee2-4b38-a60f-f151f513e13e-combined-ca-bundle\") pod \"keystone-db-sync-rqjnm\" (UID: \"e622dbb7-5ee2-4b38-a60f-f151f513e13e\") " pod="openstack-kuttl-tests/keystone-db-sync-rqjnm" Mar 16 16:26:34 crc kubenswrapper[5120]: I0316 16:26:34.738679 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2a10d584-68ec-45e6-955f-3559e75bc4ee-operator-scripts\") pod \"neutron-db-create-2vc9f\" (UID: \"2a10d584-68ec-45e6-955f-3559e75bc4ee\") " pod="openstack-kuttl-tests/neutron-db-create-2vc9f" Mar 16 16:26:34 crc kubenswrapper[5120]: I0316 16:26:34.739844 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/906875be-ea9c-49a4-8162-46aa9d27ec42-operator-scripts\") pod \"barbican-8f87-account-create-update-md6vc\" (UID: \"906875be-ea9c-49a4-8162-46aa9d27ec42\") " pod="openstack-kuttl-tests/barbican-8f87-account-create-update-md6vc" Mar 16 16:26:34 crc kubenswrapper[5120]: I0316 16:26:34.743521 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e622dbb7-5ee2-4b38-a60f-f151f513e13e-combined-ca-bundle\") pod \"keystone-db-sync-rqjnm\" (UID: \"e622dbb7-5ee2-4b38-a60f-f151f513e13e\") " pod="openstack-kuttl-tests/keystone-db-sync-rqjnm" Mar 16 16:26:34 crc kubenswrapper[5120]: I0316 16:26:34.744344 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e622dbb7-5ee2-4b38-a60f-f151f513e13e-config-data\") pod \"keystone-db-sync-rqjnm\" (UID: \"e622dbb7-5ee2-4b38-a60f-f151f513e13e\") " pod="openstack-kuttl-tests/keystone-db-sync-rqjnm" Mar 16 16:26:34 crc kubenswrapper[5120]: I0316 16:26:34.768589 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bv96s\" (UniqueName: \"kubernetes.io/projected/2a10d584-68ec-45e6-955f-3559e75bc4ee-kube-api-access-bv96s\") pod \"neutron-db-create-2vc9f\" (UID: \"2a10d584-68ec-45e6-955f-3559e75bc4ee\") " pod="openstack-kuttl-tests/neutron-db-create-2vc9f" Mar 16 16:26:34 crc kubenswrapper[5120]: I0316 16:26:34.768876 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgkt5\" (UniqueName: \"kubernetes.io/projected/906875be-ea9c-49a4-8162-46aa9d27ec42-kube-api-access-bgkt5\") pod \"barbican-8f87-account-create-update-md6vc\" (UID: \"906875be-ea9c-49a4-8162-46aa9d27ec42\") " pod="openstack-kuttl-tests/barbican-8f87-account-create-update-md6vc" Mar 16 16:26:34 crc kubenswrapper[5120]: I0316 16:26:34.769497 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hx959\" (UniqueName: \"kubernetes.io/projected/e622dbb7-5ee2-4b38-a60f-f151f513e13e-kube-api-access-hx959\") pod \"keystone-db-sync-rqjnm\" (UID: \"e622dbb7-5ee2-4b38-a60f-f151f513e13e\") " pod="openstack-kuttl-tests/keystone-db-sync-rqjnm" Mar 16 16:26:34 crc kubenswrapper[5120]: I0316 16:26:34.793134 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-create-2vc9f" Mar 16 16:26:34 crc kubenswrapper[5120]: I0316 16:26:34.839618 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3009831d-c0d7-4ce2-a2ff-7e2b9807c4a3-operator-scripts\") pod \"neutron-500e-account-create-update-r59gp\" (UID: \"3009831d-c0d7-4ce2-a2ff-7e2b9807c4a3\") " pod="openstack-kuttl-tests/neutron-500e-account-create-update-r59gp" Mar 16 16:26:34 crc kubenswrapper[5120]: I0316 16:26:34.839783 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4kfsd\" (UniqueName: \"kubernetes.io/projected/3009831d-c0d7-4ce2-a2ff-7e2b9807c4a3-kube-api-access-4kfsd\") pod \"neutron-500e-account-create-update-r59gp\" (UID: \"3009831d-c0d7-4ce2-a2ff-7e2b9807c4a3\") " pod="openstack-kuttl-tests/neutron-500e-account-create-update-r59gp" Mar 16 16:26:34 crc kubenswrapper[5120]: I0316 16:26:34.839962 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mgr9l\" (UniqueName: \"kubernetes.io/projected/b90e76bc-d652-4606-8c72-4b96133ce5c4-kube-api-access-mgr9l\") pod \"barbican-db-create-94bn8\" (UID: \"b90e76bc-d652-4606-8c72-4b96133ce5c4\") " pod="openstack-kuttl-tests/barbican-db-create-94bn8" Mar 16 16:26:34 crc kubenswrapper[5120]: I0316 16:26:34.840287 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b90e76bc-d652-4606-8c72-4b96133ce5c4-operator-scripts\") pod \"barbican-db-create-94bn8\" (UID: \"b90e76bc-d652-4606-8c72-4b96133ce5c4\") " pod="openstack-kuttl-tests/barbican-db-create-94bn8" Mar 16 16:26:34 crc kubenswrapper[5120]: I0316 16:26:34.841264 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b90e76bc-d652-4606-8c72-4b96133ce5c4-operator-scripts\") pod \"barbican-db-create-94bn8\" (UID: \"b90e76bc-d652-4606-8c72-4b96133ce5c4\") " pod="openstack-kuttl-tests/barbican-db-create-94bn8" Mar 16 16:26:34 crc kubenswrapper[5120]: I0316 16:26:34.843779 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3009831d-c0d7-4ce2-a2ff-7e2b9807c4a3-operator-scripts\") pod \"neutron-500e-account-create-update-r59gp\" (UID: \"3009831d-c0d7-4ce2-a2ff-7e2b9807c4a3\") " pod="openstack-kuttl-tests/neutron-500e-account-create-update-r59gp" Mar 16 16:26:34 crc kubenswrapper[5120]: I0316 16:26:34.863244 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kfsd\" (UniqueName: \"kubernetes.io/projected/3009831d-c0d7-4ce2-a2ff-7e2b9807c4a3-kube-api-access-4kfsd\") pod \"neutron-500e-account-create-update-r59gp\" (UID: \"3009831d-c0d7-4ce2-a2ff-7e2b9807c4a3\") " pod="openstack-kuttl-tests/neutron-500e-account-create-update-r59gp" Mar 16 16:26:34 crc kubenswrapper[5120]: I0316 16:26:34.864645 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgr9l\" (UniqueName: \"kubernetes.io/projected/b90e76bc-d652-4606-8c72-4b96133ce5c4-kube-api-access-mgr9l\") pod \"barbican-db-create-94bn8\" (UID: \"b90e76bc-d652-4606-8c72-4b96133ce5c4\") " pod="openstack-kuttl-tests/barbican-db-create-94bn8" Mar 16 16:26:34 crc kubenswrapper[5120]: I0316 16:26:34.867085 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-8f87-account-create-update-md6vc" Mar 16 16:26:34 crc kubenswrapper[5120]: I0316 16:26:34.892428 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-create-94bn8" Mar 16 16:26:34 crc kubenswrapper[5120]: I0316 16:26:34.902822 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-500e-account-create-update-r59gp" Mar 16 16:26:34 crc kubenswrapper[5120]: I0316 16:26:34.943194 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-rqjnm" Mar 16 16:26:35 crc kubenswrapper[5120]: I0316 16:26:35.245536 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-db-create-cqrlj"] Mar 16 16:26:35 crc kubenswrapper[5120]: I0316 16:26:35.263086 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-a215-account-create-update-jdntm"] Mar 16 16:26:35 crc kubenswrapper[5120]: I0316 16:26:35.395500 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-db-create-2vc9f"] Mar 16 16:26:35 crc kubenswrapper[5120]: I0316 16:26:35.477588 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-500e-account-create-update-r59gp"] Mar 16 16:26:35 crc kubenswrapper[5120]: I0316 16:26:35.484592 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-db-create-94bn8"] Mar 16 16:26:35 crc kubenswrapper[5120]: I0316 16:26:35.495790 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-8f87-account-create-update-md6vc"] Mar 16 16:26:35 crc kubenswrapper[5120]: I0316 16:26:35.653361 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-rqjnm"] Mar 16 16:26:35 crc kubenswrapper[5120]: I0316 16:26:35.882515 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-8f87-account-create-update-md6vc" event={"ID":"906875be-ea9c-49a4-8162-46aa9d27ec42","Type":"ContainerStarted","Data":"1bc47707d28ca9503b3c2eede13693ef7b45d3db1c731917ab18cbe63e9ea80e"} Mar 16 16:26:35 crc kubenswrapper[5120]: I0316 16:26:35.882557 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-8f87-account-create-update-md6vc" event={"ID":"906875be-ea9c-49a4-8162-46aa9d27ec42","Type":"ContainerStarted","Data":"52d2649f75b9666da5949f6589fba6f557b86f4be0c7708bf71ff2a4bfe3f8f2"} Mar 16 16:26:35 crc kubenswrapper[5120]: I0316 16:26:35.884993 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-create-94bn8" event={"ID":"b90e76bc-d652-4606-8c72-4b96133ce5c4","Type":"ContainerStarted","Data":"b75fe15401188ed9e0598b0eeddcd336e8cfd0860ec0b181307c8ac94081f7f0"} Mar 16 16:26:35 crc kubenswrapper[5120]: I0316 16:26:35.885038 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-create-94bn8" event={"ID":"b90e76bc-d652-4606-8c72-4b96133ce5c4","Type":"ContainerStarted","Data":"3e9c4d0e688cfb9e5d06df6c2ef087082ac63e99c2a975d52442c8e208c13639"} Mar 16 16:26:35 crc kubenswrapper[5120]: I0316 16:26:35.886572 5120 generic.go:358] "Generic (PLEG): container finished" podID="8d066f10-2ae7-4441-8302-a2fc9c744aa8" containerID="883e8f50194c97c3619c7e4bb95dcc03b0cb179d3cfafbc9ce23a669e05f29ad" exitCode=0 Mar 16 16:26:35 crc kubenswrapper[5120]: I0316 16:26:35.886676 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-a215-account-create-update-jdntm" event={"ID":"8d066f10-2ae7-4441-8302-a2fc9c744aa8","Type":"ContainerDied","Data":"883e8f50194c97c3619c7e4bb95dcc03b0cb179d3cfafbc9ce23a669e05f29ad"} Mar 16 16:26:35 crc kubenswrapper[5120]: I0316 16:26:35.886706 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-a215-account-create-update-jdntm" event={"ID":"8d066f10-2ae7-4441-8302-a2fc9c744aa8","Type":"ContainerStarted","Data":"a10a09b1b7b3aa93d00288fdf972b003eecd2ddde9b8f78e3183e844af6419d7"} Mar 16 16:26:35 crc kubenswrapper[5120]: I0316 16:26:35.887648 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-rqjnm" event={"ID":"e622dbb7-5ee2-4b38-a60f-f151f513e13e","Type":"ContainerStarted","Data":"c7b6826f8e1efd17de7e6c7c7cce7d894b6808350a7c889552a267c45ae2de01"} Mar 16 16:26:35 crc kubenswrapper[5120]: I0316 16:26:35.890380 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-500e-account-create-update-r59gp" event={"ID":"3009831d-c0d7-4ce2-a2ff-7e2b9807c4a3","Type":"ContainerStarted","Data":"cb7a977b7d5500ed2a0d0f9088212d09f079c06d9e6193a396d5add9bfcc83b7"} Mar 16 16:26:35 crc kubenswrapper[5120]: I0316 16:26:35.891729 5120 generic.go:358] "Generic (PLEG): container finished" podID="63c5f1f5-8359-43a8-a043-9867582182d1" containerID="cd4da9b81130ea8434610952955f3044602ea9c053ca2a5cd8e3e60eb55ed58e" exitCode=0 Mar 16 16:26:35 crc kubenswrapper[5120]: I0316 16:26:35.891980 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-create-cqrlj" event={"ID":"63c5f1f5-8359-43a8-a043-9867582182d1","Type":"ContainerDied","Data":"cd4da9b81130ea8434610952955f3044602ea9c053ca2a5cd8e3e60eb55ed58e"} Mar 16 16:26:35 crc kubenswrapper[5120]: I0316 16:26:35.892002 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-create-cqrlj" event={"ID":"63c5f1f5-8359-43a8-a043-9867582182d1","Type":"ContainerStarted","Data":"3d3e124977b0ceebf0ff280bf11c13586e58b59bbddcfb8dba6a506baae244c1"} Mar 16 16:26:35 crc kubenswrapper[5120]: I0316 16:26:35.893362 5120 generic.go:358] "Generic (PLEG): container finished" podID="2a10d584-68ec-45e6-955f-3559e75bc4ee" containerID="a2ece81b54f2de5b4c412803551a83f25e05e0afbefa7e776295bc3ebf15dd5d" exitCode=0 Mar 16 16:26:35 crc kubenswrapper[5120]: I0316 16:26:35.893446 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-create-2vc9f" event={"ID":"2a10d584-68ec-45e6-955f-3559e75bc4ee","Type":"ContainerDied","Data":"a2ece81b54f2de5b4c412803551a83f25e05e0afbefa7e776295bc3ebf15dd5d"} Mar 16 16:26:35 crc kubenswrapper[5120]: I0316 16:26:35.893461 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-create-2vc9f" event={"ID":"2a10d584-68ec-45e6-955f-3559e75bc4ee","Type":"ContainerStarted","Data":"ef2056185d2375b6705d1c9ee5b517cc9e2f13e3f0de40cca2bd995bfeb2183e"} Mar 16 16:26:35 crc kubenswrapper[5120]: I0316 16:26:35.913195 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-8f87-account-create-update-md6vc" podStartSLOduration=1.913171879 podStartE2EDuration="1.913171879s" podCreationTimestamp="2026-03-16 16:26:34 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:26:35.9030998 +0000 UTC m=+3298.057031457" watchObservedRunningTime="2026-03-16 16:26:35.913171879 +0000 UTC m=+3298.067103536" Mar 16 16:26:35 crc kubenswrapper[5120]: I0316 16:26:35.925234 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-db-create-94bn8" podStartSLOduration=1.925217021 podStartE2EDuration="1.925217021s" podCreationTimestamp="2026-03-16 16:26:34 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:26:35.920223417 +0000 UTC m=+3298.074155074" watchObservedRunningTime="2026-03-16 16:26:35.925217021 +0000 UTC m=+3298.079148678" Mar 16 16:26:36 crc kubenswrapper[5120]: I0316 16:26:36.911162 5120 generic.go:358] "Generic (PLEG): container finished" podID="906875be-ea9c-49a4-8162-46aa9d27ec42" containerID="1bc47707d28ca9503b3c2eede13693ef7b45d3db1c731917ab18cbe63e9ea80e" exitCode=0 Mar 16 16:26:36 crc kubenswrapper[5120]: I0316 16:26:36.911340 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-8f87-account-create-update-md6vc" event={"ID":"906875be-ea9c-49a4-8162-46aa9d27ec42","Type":"ContainerDied","Data":"1bc47707d28ca9503b3c2eede13693ef7b45d3db1c731917ab18cbe63e9ea80e"} Mar 16 16:26:36 crc kubenswrapper[5120]: I0316 16:26:36.914860 5120 generic.go:358] "Generic (PLEG): container finished" podID="b90e76bc-d652-4606-8c72-4b96133ce5c4" containerID="b75fe15401188ed9e0598b0eeddcd336e8cfd0860ec0b181307c8ac94081f7f0" exitCode=0 Mar 16 16:26:36 crc kubenswrapper[5120]: I0316 16:26:36.915006 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-create-94bn8" event={"ID":"b90e76bc-d652-4606-8c72-4b96133ce5c4","Type":"ContainerDied","Data":"b75fe15401188ed9e0598b0eeddcd336e8cfd0860ec0b181307c8ac94081f7f0"} Mar 16 16:26:36 crc kubenswrapper[5120]: I0316 16:26:36.917816 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-rqjnm" event={"ID":"e622dbb7-5ee2-4b38-a60f-f151f513e13e","Type":"ContainerStarted","Data":"2b8ab4e2dd67fbc0e778483ef937aa22d0d08b9056d7b9c5d93309604fe560da"} Mar 16 16:26:36 crc kubenswrapper[5120]: I0316 16:26:36.919507 5120 generic.go:358] "Generic (PLEG): container finished" podID="3009831d-c0d7-4ce2-a2ff-7e2b9807c4a3" containerID="3e2afe1f4371dfcd77b599c3d9748a2be63417d454174497ac2aea38e32f6306" exitCode=0 Mar 16 16:26:36 crc kubenswrapper[5120]: I0316 16:26:36.919733 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-500e-account-create-update-r59gp" event={"ID":"3009831d-c0d7-4ce2-a2ff-7e2b9807c4a3","Type":"ContainerDied","Data":"3e2afe1f4371dfcd77b599c3d9748a2be63417d454174497ac2aea38e32f6306"} Mar 16 16:26:36 crc kubenswrapper[5120]: I0316 16:26:36.998414 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-db-sync-rqjnm" podStartSLOduration=2.9983967959999998 podStartE2EDuration="2.998396796s" podCreationTimestamp="2026-03-16 16:26:34 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:26:36.998028726 +0000 UTC m=+3299.151960403" watchObservedRunningTime="2026-03-16 16:26:36.998396796 +0000 UTC m=+3299.152328473" Mar 16 16:26:37 crc kubenswrapper[5120]: I0316 16:26:37.467969 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-a215-account-create-update-jdntm" Mar 16 16:26:37 crc kubenswrapper[5120]: I0316 16:26:37.478635 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-create-2vc9f" Mar 16 16:26:37 crc kubenswrapper[5120]: I0316 16:26:37.498621 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-create-cqrlj" Mar 16 16:26:37 crc kubenswrapper[5120]: I0316 16:26:37.526413 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bznfx\" (UniqueName: \"kubernetes.io/projected/8d066f10-2ae7-4441-8302-a2fc9c744aa8-kube-api-access-bznfx\") pod \"8d066f10-2ae7-4441-8302-a2fc9c744aa8\" (UID: \"8d066f10-2ae7-4441-8302-a2fc9c744aa8\") " Mar 16 16:26:37 crc kubenswrapper[5120]: I0316 16:26:37.526600 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8d066f10-2ae7-4441-8302-a2fc9c744aa8-operator-scripts\") pod \"8d066f10-2ae7-4441-8302-a2fc9c744aa8\" (UID: \"8d066f10-2ae7-4441-8302-a2fc9c744aa8\") " Mar 16 16:26:37 crc kubenswrapper[5120]: I0316 16:26:37.529562 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d066f10-2ae7-4441-8302-a2fc9c744aa8-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "8d066f10-2ae7-4441-8302-a2fc9c744aa8" (UID: "8d066f10-2ae7-4441-8302-a2fc9c744aa8"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:26:37 crc kubenswrapper[5120]: I0316 16:26:37.540477 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d066f10-2ae7-4441-8302-a2fc9c744aa8-kube-api-access-bznfx" (OuterVolumeSpecName: "kube-api-access-bznfx") pod "8d066f10-2ae7-4441-8302-a2fc9c744aa8" (UID: "8d066f10-2ae7-4441-8302-a2fc9c744aa8"). InnerVolumeSpecName "kube-api-access-bznfx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:26:37 crc kubenswrapper[5120]: I0316 16:26:37.629931 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7hmbr\" (UniqueName: \"kubernetes.io/projected/63c5f1f5-8359-43a8-a043-9867582182d1-kube-api-access-7hmbr\") pod \"63c5f1f5-8359-43a8-a043-9867582182d1\" (UID: \"63c5f1f5-8359-43a8-a043-9867582182d1\") " Mar 16 16:26:37 crc kubenswrapper[5120]: I0316 16:26:37.630082 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bv96s\" (UniqueName: \"kubernetes.io/projected/2a10d584-68ec-45e6-955f-3559e75bc4ee-kube-api-access-bv96s\") pod \"2a10d584-68ec-45e6-955f-3559e75bc4ee\" (UID: \"2a10d584-68ec-45e6-955f-3559e75bc4ee\") " Mar 16 16:26:37 crc kubenswrapper[5120]: I0316 16:26:37.630568 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2a10d584-68ec-45e6-955f-3559e75bc4ee-operator-scripts\") pod \"2a10d584-68ec-45e6-955f-3559e75bc4ee\" (UID: \"2a10d584-68ec-45e6-955f-3559e75bc4ee\") " Mar 16 16:26:37 crc kubenswrapper[5120]: I0316 16:26:37.630675 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/63c5f1f5-8359-43a8-a043-9867582182d1-operator-scripts\") pod \"63c5f1f5-8359-43a8-a043-9867582182d1\" (UID: \"63c5f1f5-8359-43a8-a043-9867582182d1\") " Mar 16 16:26:37 crc kubenswrapper[5120]: I0316 16:26:37.631039 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2a10d584-68ec-45e6-955f-3559e75bc4ee-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "2a10d584-68ec-45e6-955f-3559e75bc4ee" (UID: "2a10d584-68ec-45e6-955f-3559e75bc4ee"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:26:37 crc kubenswrapper[5120]: I0316 16:26:37.631127 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8d066f10-2ae7-4441-8302-a2fc9c744aa8-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:26:37 crc kubenswrapper[5120]: I0316 16:26:37.631141 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bznfx\" (UniqueName: \"kubernetes.io/projected/8d066f10-2ae7-4441-8302-a2fc9c744aa8-kube-api-access-bznfx\") on node \"crc\" DevicePath \"\"" Mar 16 16:26:37 crc kubenswrapper[5120]: I0316 16:26:37.631261 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/63c5f1f5-8359-43a8-a043-9867582182d1-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "63c5f1f5-8359-43a8-a043-9867582182d1" (UID: "63c5f1f5-8359-43a8-a043-9867582182d1"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:26:37 crc kubenswrapper[5120]: I0316 16:26:37.633827 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a10d584-68ec-45e6-955f-3559e75bc4ee-kube-api-access-bv96s" (OuterVolumeSpecName: "kube-api-access-bv96s") pod "2a10d584-68ec-45e6-955f-3559e75bc4ee" (UID: "2a10d584-68ec-45e6-955f-3559e75bc4ee"). InnerVolumeSpecName "kube-api-access-bv96s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:26:37 crc kubenswrapper[5120]: I0316 16:26:37.636678 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63c5f1f5-8359-43a8-a043-9867582182d1-kube-api-access-7hmbr" (OuterVolumeSpecName: "kube-api-access-7hmbr") pod "63c5f1f5-8359-43a8-a043-9867582182d1" (UID: "63c5f1f5-8359-43a8-a043-9867582182d1"). InnerVolumeSpecName "kube-api-access-7hmbr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:26:37 crc kubenswrapper[5120]: I0316 16:26:37.734392 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/63c5f1f5-8359-43a8-a043-9867582182d1-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:26:37 crc kubenswrapper[5120]: I0316 16:26:37.734455 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7hmbr\" (UniqueName: \"kubernetes.io/projected/63c5f1f5-8359-43a8-a043-9867582182d1-kube-api-access-7hmbr\") on node \"crc\" DevicePath \"\"" Mar 16 16:26:37 crc kubenswrapper[5120]: I0316 16:26:37.734478 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bv96s\" (UniqueName: \"kubernetes.io/projected/2a10d584-68ec-45e6-955f-3559e75bc4ee-kube-api-access-bv96s\") on node \"crc\" DevicePath \"\"" Mar 16 16:26:37 crc kubenswrapper[5120]: I0316 16:26:37.734496 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2a10d584-68ec-45e6-955f-3559e75bc4ee-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:26:37 crc kubenswrapper[5120]: I0316 16:26:37.930079 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-a215-account-create-update-jdntm" Mar 16 16:26:37 crc kubenswrapper[5120]: I0316 16:26:37.930133 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-a215-account-create-update-jdntm" event={"ID":"8d066f10-2ae7-4441-8302-a2fc9c744aa8","Type":"ContainerDied","Data":"a10a09b1b7b3aa93d00288fdf972b003eecd2ddde9b8f78e3183e844af6419d7"} Mar 16 16:26:37 crc kubenswrapper[5120]: I0316 16:26:37.930191 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a10a09b1b7b3aa93d00288fdf972b003eecd2ddde9b8f78e3183e844af6419d7" Mar 16 16:26:37 crc kubenswrapper[5120]: I0316 16:26:37.932061 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-create-cqrlj" Mar 16 16:26:37 crc kubenswrapper[5120]: I0316 16:26:37.932105 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-create-cqrlj" event={"ID":"63c5f1f5-8359-43a8-a043-9867582182d1","Type":"ContainerDied","Data":"3d3e124977b0ceebf0ff280bf11c13586e58b59bbddcfb8dba6a506baae244c1"} Mar 16 16:26:37 crc kubenswrapper[5120]: I0316 16:26:37.932204 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3d3e124977b0ceebf0ff280bf11c13586e58b59bbddcfb8dba6a506baae244c1" Mar 16 16:26:37 crc kubenswrapper[5120]: I0316 16:26:37.934119 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-create-2vc9f" Mar 16 16:26:37 crc kubenswrapper[5120]: I0316 16:26:37.934142 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-create-2vc9f" event={"ID":"2a10d584-68ec-45e6-955f-3559e75bc4ee","Type":"ContainerDied","Data":"ef2056185d2375b6705d1c9ee5b517cc9e2f13e3f0de40cca2bd995bfeb2183e"} Mar 16 16:26:37 crc kubenswrapper[5120]: I0316 16:26:37.934175 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ef2056185d2375b6705d1c9ee5b517cc9e2f13e3f0de40cca2bd995bfeb2183e" Mar 16 16:26:38 crc kubenswrapper[5120]: I0316 16:26:38.246205 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-8f87-account-create-update-md6vc" Mar 16 16:26:38 crc kubenswrapper[5120]: I0316 16:26:38.330914 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-create-94bn8" Mar 16 16:26:38 crc kubenswrapper[5120]: I0316 16:26:38.347841 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bgkt5\" (UniqueName: \"kubernetes.io/projected/906875be-ea9c-49a4-8162-46aa9d27ec42-kube-api-access-bgkt5\") pod \"906875be-ea9c-49a4-8162-46aa9d27ec42\" (UID: \"906875be-ea9c-49a4-8162-46aa9d27ec42\") " Mar 16 16:26:38 crc kubenswrapper[5120]: I0316 16:26:38.348142 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/906875be-ea9c-49a4-8162-46aa9d27ec42-operator-scripts\") pod \"906875be-ea9c-49a4-8162-46aa9d27ec42\" (UID: \"906875be-ea9c-49a4-8162-46aa9d27ec42\") " Mar 16 16:26:38 crc kubenswrapper[5120]: I0316 16:26:38.349126 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/906875be-ea9c-49a4-8162-46aa9d27ec42-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "906875be-ea9c-49a4-8162-46aa9d27ec42" (UID: "906875be-ea9c-49a4-8162-46aa9d27ec42"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:26:38 crc kubenswrapper[5120]: I0316 16:26:38.353632 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/906875be-ea9c-49a4-8162-46aa9d27ec42-kube-api-access-bgkt5" (OuterVolumeSpecName: "kube-api-access-bgkt5") pod "906875be-ea9c-49a4-8162-46aa9d27ec42" (UID: "906875be-ea9c-49a4-8162-46aa9d27ec42"). InnerVolumeSpecName "kube-api-access-bgkt5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:26:38 crc kubenswrapper[5120]: I0316 16:26:38.432999 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-500e-account-create-update-r59gp" Mar 16 16:26:38 crc kubenswrapper[5120]: I0316 16:26:38.450111 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b90e76bc-d652-4606-8c72-4b96133ce5c4-operator-scripts\") pod \"b90e76bc-d652-4606-8c72-4b96133ce5c4\" (UID: \"b90e76bc-d652-4606-8c72-4b96133ce5c4\") " Mar 16 16:26:38 crc kubenswrapper[5120]: I0316 16:26:38.450162 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mgr9l\" (UniqueName: \"kubernetes.io/projected/b90e76bc-d652-4606-8c72-4b96133ce5c4-kube-api-access-mgr9l\") pod \"b90e76bc-d652-4606-8c72-4b96133ce5c4\" (UID: \"b90e76bc-d652-4606-8c72-4b96133ce5c4\") " Mar 16 16:26:38 crc kubenswrapper[5120]: I0316 16:26:38.450615 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b90e76bc-d652-4606-8c72-4b96133ce5c4-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "b90e76bc-d652-4606-8c72-4b96133ce5c4" (UID: "b90e76bc-d652-4606-8c72-4b96133ce5c4"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:26:38 crc kubenswrapper[5120]: I0316 16:26:38.450923 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bgkt5\" (UniqueName: \"kubernetes.io/projected/906875be-ea9c-49a4-8162-46aa9d27ec42-kube-api-access-bgkt5\") on node \"crc\" DevicePath \"\"" Mar 16 16:26:38 crc kubenswrapper[5120]: I0316 16:26:38.450952 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/906875be-ea9c-49a4-8162-46aa9d27ec42-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:26:38 crc kubenswrapper[5120]: I0316 16:26:38.450965 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b90e76bc-d652-4606-8c72-4b96133ce5c4-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:26:38 crc kubenswrapper[5120]: I0316 16:26:38.454324 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b90e76bc-d652-4606-8c72-4b96133ce5c4-kube-api-access-mgr9l" (OuterVolumeSpecName: "kube-api-access-mgr9l") pod "b90e76bc-d652-4606-8c72-4b96133ce5c4" (UID: "b90e76bc-d652-4606-8c72-4b96133ce5c4"). InnerVolumeSpecName "kube-api-access-mgr9l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:26:38 crc kubenswrapper[5120]: I0316 16:26:38.556690 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4kfsd\" (UniqueName: \"kubernetes.io/projected/3009831d-c0d7-4ce2-a2ff-7e2b9807c4a3-kube-api-access-4kfsd\") pod \"3009831d-c0d7-4ce2-a2ff-7e2b9807c4a3\" (UID: \"3009831d-c0d7-4ce2-a2ff-7e2b9807c4a3\") " Mar 16 16:26:38 crc kubenswrapper[5120]: I0316 16:26:38.557375 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3009831d-c0d7-4ce2-a2ff-7e2b9807c4a3-operator-scripts\") pod \"3009831d-c0d7-4ce2-a2ff-7e2b9807c4a3\" (UID: \"3009831d-c0d7-4ce2-a2ff-7e2b9807c4a3\") " Mar 16 16:26:38 crc kubenswrapper[5120]: I0316 16:26:38.558497 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3009831d-c0d7-4ce2-a2ff-7e2b9807c4a3-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "3009831d-c0d7-4ce2-a2ff-7e2b9807c4a3" (UID: "3009831d-c0d7-4ce2-a2ff-7e2b9807c4a3"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:26:38 crc kubenswrapper[5120]: I0316 16:26:38.559919 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mgr9l\" (UniqueName: \"kubernetes.io/projected/b90e76bc-d652-4606-8c72-4b96133ce5c4-kube-api-access-mgr9l\") on node \"crc\" DevicePath \"\"" Mar 16 16:26:38 crc kubenswrapper[5120]: I0316 16:26:38.559958 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3009831d-c0d7-4ce2-a2ff-7e2b9807c4a3-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:26:38 crc kubenswrapper[5120]: I0316 16:26:38.566221 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3009831d-c0d7-4ce2-a2ff-7e2b9807c4a3-kube-api-access-4kfsd" (OuterVolumeSpecName: "kube-api-access-4kfsd") pod "3009831d-c0d7-4ce2-a2ff-7e2b9807c4a3" (UID: "3009831d-c0d7-4ce2-a2ff-7e2b9807c4a3"). InnerVolumeSpecName "kube-api-access-4kfsd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:26:38 crc kubenswrapper[5120]: I0316 16:26:38.661531 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4kfsd\" (UniqueName: \"kubernetes.io/projected/3009831d-c0d7-4ce2-a2ff-7e2b9807c4a3-kube-api-access-4kfsd\") on node \"crc\" DevicePath \"\"" Mar 16 16:26:38 crc kubenswrapper[5120]: I0316 16:26:38.949518 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-8f87-account-create-update-md6vc" Mar 16 16:26:38 crc kubenswrapper[5120]: I0316 16:26:38.949502 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-8f87-account-create-update-md6vc" event={"ID":"906875be-ea9c-49a4-8162-46aa9d27ec42","Type":"ContainerDied","Data":"52d2649f75b9666da5949f6589fba6f557b86f4be0c7708bf71ff2a4bfe3f8f2"} Mar 16 16:26:38 crc kubenswrapper[5120]: I0316 16:26:38.949641 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="52d2649f75b9666da5949f6589fba6f557b86f4be0c7708bf71ff2a4bfe3f8f2" Mar 16 16:26:38 crc kubenswrapper[5120]: I0316 16:26:38.952727 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-create-94bn8" event={"ID":"b90e76bc-d652-4606-8c72-4b96133ce5c4","Type":"ContainerDied","Data":"3e9c4d0e688cfb9e5d06df6c2ef087082ac63e99c2a975d52442c8e208c13639"} Mar 16 16:26:38 crc kubenswrapper[5120]: I0316 16:26:38.952791 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3e9c4d0e688cfb9e5d06df6c2ef087082ac63e99c2a975d52442c8e208c13639" Mar 16 16:26:38 crc kubenswrapper[5120]: I0316 16:26:38.952733 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-create-94bn8" Mar 16 16:26:38 crc kubenswrapper[5120]: I0316 16:26:38.956076 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-500e-account-create-update-r59gp" Mar 16 16:26:38 crc kubenswrapper[5120]: I0316 16:26:38.956170 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-500e-account-create-update-r59gp" event={"ID":"3009831d-c0d7-4ce2-a2ff-7e2b9807c4a3","Type":"ContainerDied","Data":"cb7a977b7d5500ed2a0d0f9088212d09f079c06d9e6193a396d5add9bfcc83b7"} Mar 16 16:26:38 crc kubenswrapper[5120]: I0316 16:26:38.956196 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cb7a977b7d5500ed2a0d0f9088212d09f079c06d9e6193a396d5add9bfcc83b7" Mar 16 16:26:39 crc kubenswrapper[5120]: I0316 16:26:39.968637 5120 generic.go:358] "Generic (PLEG): container finished" podID="e622dbb7-5ee2-4b38-a60f-f151f513e13e" containerID="2b8ab4e2dd67fbc0e778483ef937aa22d0d08b9056d7b9c5d93309604fe560da" exitCode=0 Mar 16 16:26:39 crc kubenswrapper[5120]: I0316 16:26:39.968721 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-rqjnm" event={"ID":"e622dbb7-5ee2-4b38-a60f-f151f513e13e","Type":"ContainerDied","Data":"2b8ab4e2dd67fbc0e778483ef937aa22d0d08b9056d7b9c5d93309604fe560da"} Mar 16 16:26:41 crc kubenswrapper[5120]: I0316 16:26:41.339736 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-rqjnm" Mar 16 16:26:41 crc kubenswrapper[5120]: I0316 16:26:41.426617 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e622dbb7-5ee2-4b38-a60f-f151f513e13e-combined-ca-bundle\") pod \"e622dbb7-5ee2-4b38-a60f-f151f513e13e\" (UID: \"e622dbb7-5ee2-4b38-a60f-f151f513e13e\") " Mar 16 16:26:41 crc kubenswrapper[5120]: I0316 16:26:41.426952 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hx959\" (UniqueName: \"kubernetes.io/projected/e622dbb7-5ee2-4b38-a60f-f151f513e13e-kube-api-access-hx959\") pod \"e622dbb7-5ee2-4b38-a60f-f151f513e13e\" (UID: \"e622dbb7-5ee2-4b38-a60f-f151f513e13e\") " Mar 16 16:26:41 crc kubenswrapper[5120]: I0316 16:26:41.427082 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e622dbb7-5ee2-4b38-a60f-f151f513e13e-config-data\") pod \"e622dbb7-5ee2-4b38-a60f-f151f513e13e\" (UID: \"e622dbb7-5ee2-4b38-a60f-f151f513e13e\") " Mar 16 16:26:41 crc kubenswrapper[5120]: I0316 16:26:41.441136 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e622dbb7-5ee2-4b38-a60f-f151f513e13e-kube-api-access-hx959" (OuterVolumeSpecName: "kube-api-access-hx959") pod "e622dbb7-5ee2-4b38-a60f-f151f513e13e" (UID: "e622dbb7-5ee2-4b38-a60f-f151f513e13e"). InnerVolumeSpecName "kube-api-access-hx959". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:26:41 crc kubenswrapper[5120]: I0316 16:26:41.453314 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e622dbb7-5ee2-4b38-a60f-f151f513e13e-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e622dbb7-5ee2-4b38-a60f-f151f513e13e" (UID: "e622dbb7-5ee2-4b38-a60f-f151f513e13e"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:26:41 crc kubenswrapper[5120]: I0316 16:26:41.502124 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e622dbb7-5ee2-4b38-a60f-f151f513e13e-config-data" (OuterVolumeSpecName: "config-data") pod "e622dbb7-5ee2-4b38-a60f-f151f513e13e" (UID: "e622dbb7-5ee2-4b38-a60f-f151f513e13e"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:26:41 crc kubenswrapper[5120]: I0316 16:26:41.530368 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hx959\" (UniqueName: \"kubernetes.io/projected/e622dbb7-5ee2-4b38-a60f-f151f513e13e-kube-api-access-hx959\") on node \"crc\" DevicePath \"\"" Mar 16 16:26:41 crc kubenswrapper[5120]: I0316 16:26:41.530441 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e622dbb7-5ee2-4b38-a60f-f151f513e13e-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:26:41 crc kubenswrapper[5120]: I0316 16:26:41.530459 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e622dbb7-5ee2-4b38-a60f-f151f513e13e-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:26:41 crc kubenswrapper[5120]: I0316 16:26:41.556973 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/rabbitmq-cell1-server-2" Mar 16 16:26:41 crc kubenswrapper[5120]: I0316 16:26:41.988237 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-rqjnm" Mar 16 16:26:41 crc kubenswrapper[5120]: I0316 16:26:41.988280 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-rqjnm" event={"ID":"e622dbb7-5ee2-4b38-a60f-f151f513e13e","Type":"ContainerDied","Data":"c7b6826f8e1efd17de7e6c7c7cce7d894b6808350a7c889552a267c45ae2de01"} Mar 16 16:26:41 crc kubenswrapper[5120]: I0316 16:26:41.988323 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c7b6826f8e1efd17de7e6c7c7cce7d894b6808350a7c889552a267c45ae2de01" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.177024 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-7zwsz"] Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.177974 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63c5f1f5-8359-43a8-a043-9867582182d1" containerName="mariadb-database-create" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.177992 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="63c5f1f5-8359-43a8-a043-9867582182d1" containerName="mariadb-database-create" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.178011 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b90e76bc-d652-4606-8c72-4b96133ce5c4" containerName="mariadb-database-create" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.178023 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="b90e76bc-d652-4606-8c72-4b96133ce5c4" containerName="mariadb-database-create" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.178046 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d066f10-2ae7-4441-8302-a2fc9c744aa8" containerName="mariadb-account-create-update" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.178052 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d066f10-2ae7-4441-8302-a2fc9c744aa8" containerName="mariadb-account-create-update" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.178070 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a10d584-68ec-45e6-955f-3559e75bc4ee" containerName="mariadb-database-create" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.178076 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a10d584-68ec-45e6-955f-3559e75bc4ee" containerName="mariadb-database-create" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.178087 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3009831d-c0d7-4ce2-a2ff-7e2b9807c4a3" containerName="mariadb-account-create-update" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.178093 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="3009831d-c0d7-4ce2-a2ff-7e2b9807c4a3" containerName="mariadb-account-create-update" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.178104 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e622dbb7-5ee2-4b38-a60f-f151f513e13e" containerName="keystone-db-sync" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.178110 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e622dbb7-5ee2-4b38-a60f-f151f513e13e" containerName="keystone-db-sync" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.178121 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="906875be-ea9c-49a4-8162-46aa9d27ec42" containerName="mariadb-account-create-update" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.178127 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="906875be-ea9c-49a4-8162-46aa9d27ec42" containerName="mariadb-account-create-update" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.178292 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="2a10d584-68ec-45e6-955f-3559e75bc4ee" containerName="mariadb-database-create" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.178309 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="8d066f10-2ae7-4441-8302-a2fc9c744aa8" containerName="mariadb-account-create-update" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.178319 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e622dbb7-5ee2-4b38-a60f-f151f513e13e" containerName="keystone-db-sync" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.178327 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="63c5f1f5-8359-43a8-a043-9867582182d1" containerName="mariadb-database-create" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.178336 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="b90e76bc-d652-4606-8c72-4b96133ce5c4" containerName="mariadb-database-create" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.178345 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="906875be-ea9c-49a4-8162-46aa9d27ec42" containerName="mariadb-account-create-update" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.178353 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="3009831d-c0d7-4ce2-a2ff-7e2b9807c4a3" containerName="mariadb-account-create-update" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.189212 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-7zwsz" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.197210 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-scripts\"" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.197300 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-keystone-dockercfg-9hkx9\"" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.197481 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"osp-secret\"" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.197578 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-config-data\"" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.197859 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone\"" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.228836 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-7zwsz"] Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.257083 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/67d3df0a-9de1-42e6-94b0-82bc99459ebf-fernet-keys\") pod \"keystone-bootstrap-7zwsz\" (UID: \"67d3df0a-9de1-42e6-94b0-82bc99459ebf\") " pod="openstack-kuttl-tests/keystone-bootstrap-7zwsz" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.257176 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/67d3df0a-9de1-42e6-94b0-82bc99459ebf-combined-ca-bundle\") pod \"keystone-bootstrap-7zwsz\" (UID: \"67d3df0a-9de1-42e6-94b0-82bc99459ebf\") " pod="openstack-kuttl-tests/keystone-bootstrap-7zwsz" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.257241 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/67d3df0a-9de1-42e6-94b0-82bc99459ebf-scripts\") pod \"keystone-bootstrap-7zwsz\" (UID: \"67d3df0a-9de1-42e6-94b0-82bc99459ebf\") " pod="openstack-kuttl-tests/keystone-bootstrap-7zwsz" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.257447 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sc8xn\" (UniqueName: \"kubernetes.io/projected/67d3df0a-9de1-42e6-94b0-82bc99459ebf-kube-api-access-sc8xn\") pod \"keystone-bootstrap-7zwsz\" (UID: \"67d3df0a-9de1-42e6-94b0-82bc99459ebf\") " pod="openstack-kuttl-tests/keystone-bootstrap-7zwsz" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.257496 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/67d3df0a-9de1-42e6-94b0-82bc99459ebf-config-data\") pod \"keystone-bootstrap-7zwsz\" (UID: \"67d3df0a-9de1-42e6-94b0-82bc99459ebf\") " pod="openstack-kuttl-tests/keystone-bootstrap-7zwsz" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.257523 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/67d3df0a-9de1-42e6-94b0-82bc99459ebf-credential-keys\") pod \"keystone-bootstrap-7zwsz\" (UID: \"67d3df0a-9de1-42e6-94b0-82bc99459ebf\") " pod="openstack-kuttl-tests/keystone-bootstrap-7zwsz" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.365968 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/67d3df0a-9de1-42e6-94b0-82bc99459ebf-fernet-keys\") pod \"keystone-bootstrap-7zwsz\" (UID: \"67d3df0a-9de1-42e6-94b0-82bc99459ebf\") " pod="openstack-kuttl-tests/keystone-bootstrap-7zwsz" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.366034 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/67d3df0a-9de1-42e6-94b0-82bc99459ebf-combined-ca-bundle\") pod \"keystone-bootstrap-7zwsz\" (UID: \"67d3df0a-9de1-42e6-94b0-82bc99459ebf\") " pod="openstack-kuttl-tests/keystone-bootstrap-7zwsz" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.366075 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/67d3df0a-9de1-42e6-94b0-82bc99459ebf-scripts\") pod \"keystone-bootstrap-7zwsz\" (UID: \"67d3df0a-9de1-42e6-94b0-82bc99459ebf\") " pod="openstack-kuttl-tests/keystone-bootstrap-7zwsz" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.366183 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sc8xn\" (UniqueName: \"kubernetes.io/projected/67d3df0a-9de1-42e6-94b0-82bc99459ebf-kube-api-access-sc8xn\") pod \"keystone-bootstrap-7zwsz\" (UID: \"67d3df0a-9de1-42e6-94b0-82bc99459ebf\") " pod="openstack-kuttl-tests/keystone-bootstrap-7zwsz" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.366211 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/67d3df0a-9de1-42e6-94b0-82bc99459ebf-config-data\") pod \"keystone-bootstrap-7zwsz\" (UID: \"67d3df0a-9de1-42e6-94b0-82bc99459ebf\") " pod="openstack-kuttl-tests/keystone-bootstrap-7zwsz" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.366230 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/67d3df0a-9de1-42e6-94b0-82bc99459ebf-credential-keys\") pod \"keystone-bootstrap-7zwsz\" (UID: \"67d3df0a-9de1-42e6-94b0-82bc99459ebf\") " pod="openstack-kuttl-tests/keystone-bootstrap-7zwsz" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.382816 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/67d3df0a-9de1-42e6-94b0-82bc99459ebf-config-data\") pod \"keystone-bootstrap-7zwsz\" (UID: \"67d3df0a-9de1-42e6-94b0-82bc99459ebf\") " pod="openstack-kuttl-tests/keystone-bootstrap-7zwsz" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.383066 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/67d3df0a-9de1-42e6-94b0-82bc99459ebf-scripts\") pod \"keystone-bootstrap-7zwsz\" (UID: \"67d3df0a-9de1-42e6-94b0-82bc99459ebf\") " pod="openstack-kuttl-tests/keystone-bootstrap-7zwsz" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.384401 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/67d3df0a-9de1-42e6-94b0-82bc99459ebf-combined-ca-bundle\") pod \"keystone-bootstrap-7zwsz\" (UID: \"67d3df0a-9de1-42e6-94b0-82bc99459ebf\") " pod="openstack-kuttl-tests/keystone-bootstrap-7zwsz" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.384829 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/67d3df0a-9de1-42e6-94b0-82bc99459ebf-credential-keys\") pod \"keystone-bootstrap-7zwsz\" (UID: \"67d3df0a-9de1-42e6-94b0-82bc99459ebf\") " pod="openstack-kuttl-tests/keystone-bootstrap-7zwsz" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.399358 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/67d3df0a-9de1-42e6-94b0-82bc99459ebf-fernet-keys\") pod \"keystone-bootstrap-7zwsz\" (UID: \"67d3df0a-9de1-42e6-94b0-82bc99459ebf\") " pod="openstack-kuttl-tests/keystone-bootstrap-7zwsz" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.421641 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sc8xn\" (UniqueName: \"kubernetes.io/projected/67d3df0a-9de1-42e6-94b0-82bc99459ebf-kube-api-access-sc8xn\") pod \"keystone-bootstrap-7zwsz\" (UID: \"67d3df0a-9de1-42e6-94b0-82bc99459ebf\") " pod="openstack-kuttl-tests/keystone-bootstrap-7zwsz" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.425957 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.434559 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.440250 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.440539 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.449021 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-db-sync-pv6tf"] Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.468853 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0bd49631-00e4-430c-9659-1f0e7805900a-log-httpd\") pod \"ceilometer-0\" (UID: \"0bd49631-00e4-430c-9659-1f0e7805900a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.468948 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0bd49631-00e4-430c-9659-1f0e7805900a-scripts\") pod \"ceilometer-0\" (UID: \"0bd49631-00e4-430c-9659-1f0e7805900a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.469003 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/0bd49631-00e4-430c-9659-1f0e7805900a-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"0bd49631-00e4-430c-9659-1f0e7805900a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.469046 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0bd49631-00e4-430c-9659-1f0e7805900a-config-data\") pod \"ceilometer-0\" (UID: \"0bd49631-00e4-430c-9659-1f0e7805900a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.469067 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0bd49631-00e4-430c-9659-1f0e7805900a-run-httpd\") pod \"ceilometer-0\" (UID: \"0bd49631-00e4-430c-9659-1f0e7805900a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.469083 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dnhs5\" (UniqueName: \"kubernetes.io/projected/0bd49631-00e4-430c-9659-1f0e7805900a-kube-api-access-dnhs5\") pod \"ceilometer-0\" (UID: \"0bd49631-00e4-430c-9659-1f0e7805900a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.469120 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0bd49631-00e4-430c-9659-1f0e7805900a-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"0bd49631-00e4-430c-9659-1f0e7805900a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.470436 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-pv6tf" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.475822 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-placement-dockercfg-dgk8d\"" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.476034 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-scripts\"" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.484516 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.484929 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-config-data\"" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.522416 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-pv6tf"] Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.537808 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-d8bvp"] Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.550341 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-gs5vn"] Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.552357 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-d8bvp" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.555198 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-scripts\"" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.555390 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-config-data\"" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.555615 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-cinder-dockercfg-c8554\"" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.562211 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-gs5vn"] Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.562319 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-gs5vn" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.569960 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-d8bvp"] Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.574779 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-httpd-config\"" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.575055 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-config\"" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.575174 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-neutron-dockercfg-9rbcd\"" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.579957 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-7zwsz" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.582114 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0bd49631-00e4-430c-9659-1f0e7805900a-config-data\") pod \"ceilometer-0\" (UID: \"0bd49631-00e4-430c-9659-1f0e7805900a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.594900 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0bd49631-00e4-430c-9659-1f0e7805900a-run-httpd\") pod \"ceilometer-0\" (UID: \"0bd49631-00e4-430c-9659-1f0e7805900a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.594939 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dnhs5\" (UniqueName: \"kubernetes.io/projected/0bd49631-00e4-430c-9659-1f0e7805900a-kube-api-access-dnhs5\") pod \"ceilometer-0\" (UID: \"0bd49631-00e4-430c-9659-1f0e7805900a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.595008 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0bd49631-00e4-430c-9659-1f0e7805900a-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"0bd49631-00e4-430c-9659-1f0e7805900a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.595037 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ee9a1dc2-769e-4d3f-a1e0-f1b78c45403a-config-data\") pod \"placement-db-sync-pv6tf\" (UID: \"ee9a1dc2-769e-4d3f-a1e0-f1b78c45403a\") " pod="openstack-kuttl-tests/placement-db-sync-pv6tf" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.595195 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/88e6fbd8-42f7-446d-a9cb-0fc5d8a9c6bb-etc-machine-id\") pod \"cinder-db-sync-d8bvp\" (UID: \"88e6fbd8-42f7-446d-a9cb-0fc5d8a9c6bb\") " pod="openstack-kuttl-tests/cinder-db-sync-d8bvp" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.595225 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bfs2\" (UniqueName: \"kubernetes.io/projected/88e6fbd8-42f7-446d-a9cb-0fc5d8a9c6bb-kube-api-access-2bfs2\") pod \"cinder-db-sync-d8bvp\" (UID: \"88e6fbd8-42f7-446d-a9cb-0fc5d8a9c6bb\") " pod="openstack-kuttl-tests/cinder-db-sync-d8bvp" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.595247 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9c4n5\" (UniqueName: \"kubernetes.io/projected/ee9a1dc2-769e-4d3f-a1e0-f1b78c45403a-kube-api-access-9c4n5\") pod \"placement-db-sync-pv6tf\" (UID: \"ee9a1dc2-769e-4d3f-a1e0-f1b78c45403a\") " pod="openstack-kuttl-tests/placement-db-sync-pv6tf" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.595307 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/88e6fbd8-42f7-446d-a9cb-0fc5d8a9c6bb-config-data\") pod \"cinder-db-sync-d8bvp\" (UID: \"88e6fbd8-42f7-446d-a9cb-0fc5d8a9c6bb\") " pod="openstack-kuttl-tests/cinder-db-sync-d8bvp" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.595330 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/88e6fbd8-42f7-446d-a9cb-0fc5d8a9c6bb-scripts\") pod \"cinder-db-sync-d8bvp\" (UID: \"88e6fbd8-42f7-446d-a9cb-0fc5d8a9c6bb\") " pod="openstack-kuttl-tests/cinder-db-sync-d8bvp" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.595429 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/88e6fbd8-42f7-446d-a9cb-0fc5d8a9c6bb-combined-ca-bundle\") pod \"cinder-db-sync-d8bvp\" (UID: \"88e6fbd8-42f7-446d-a9cb-0fc5d8a9c6bb\") " pod="openstack-kuttl-tests/cinder-db-sync-d8bvp" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.595499 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0bd49631-00e4-430c-9659-1f0e7805900a-log-httpd\") pod \"ceilometer-0\" (UID: \"0bd49631-00e4-430c-9659-1f0e7805900a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.595518 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/88e6fbd8-42f7-446d-a9cb-0fc5d8a9c6bb-db-sync-config-data\") pod \"cinder-db-sync-d8bvp\" (UID: \"88e6fbd8-42f7-446d-a9cb-0fc5d8a9c6bb\") " pod="openstack-kuttl-tests/cinder-db-sync-d8bvp" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.595532 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ee9a1dc2-769e-4d3f-a1e0-f1b78c45403a-scripts\") pod \"placement-db-sync-pv6tf\" (UID: \"ee9a1dc2-769e-4d3f-a1e0-f1b78c45403a\") " pod="openstack-kuttl-tests/placement-db-sync-pv6tf" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.595564 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ee9a1dc2-769e-4d3f-a1e0-f1b78c45403a-combined-ca-bundle\") pod \"placement-db-sync-pv6tf\" (UID: \"ee9a1dc2-769e-4d3f-a1e0-f1b78c45403a\") " pod="openstack-kuttl-tests/placement-db-sync-pv6tf" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.595643 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0bd49631-00e4-430c-9659-1f0e7805900a-scripts\") pod \"ceilometer-0\" (UID: \"0bd49631-00e4-430c-9659-1f0e7805900a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.595668 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ee9a1dc2-769e-4d3f-a1e0-f1b78c45403a-logs\") pod \"placement-db-sync-pv6tf\" (UID: \"ee9a1dc2-769e-4d3f-a1e0-f1b78c45403a\") " pod="openstack-kuttl-tests/placement-db-sync-pv6tf" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.595736 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/0bd49631-00e4-430c-9659-1f0e7805900a-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"0bd49631-00e4-430c-9659-1f0e7805900a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.596491 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0bd49631-00e4-430c-9659-1f0e7805900a-run-httpd\") pod \"ceilometer-0\" (UID: \"0bd49631-00e4-430c-9659-1f0e7805900a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.597313 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0bd49631-00e4-430c-9659-1f0e7805900a-log-httpd\") pod \"ceilometer-0\" (UID: \"0bd49631-00e4-430c-9659-1f0e7805900a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.607181 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/0bd49631-00e4-430c-9659-1f0e7805900a-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"0bd49631-00e4-430c-9659-1f0e7805900a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.608026 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0bd49631-00e4-430c-9659-1f0e7805900a-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"0bd49631-00e4-430c-9659-1f0e7805900a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.608617 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0bd49631-00e4-430c-9659-1f0e7805900a-scripts\") pod \"ceilometer-0\" (UID: \"0bd49631-00e4-430c-9659-1f0e7805900a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.621642 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0bd49631-00e4-430c-9659-1f0e7805900a-config-data\") pod \"ceilometer-0\" (UID: \"0bd49631-00e4-430c-9659-1f0e7805900a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.629596 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnhs5\" (UniqueName: \"kubernetes.io/projected/0bd49631-00e4-430c-9659-1f0e7805900a-kube-api-access-dnhs5\") pod \"ceilometer-0\" (UID: \"0bd49631-00e4-430c-9659-1f0e7805900a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.638434 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-bkr9j"] Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.668527 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-bkr9j" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.673196 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-barbican-dockercfg-bkg7z\"" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.681210 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-config-data\"" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.687099 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-bkr9j"] Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.697128 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/539c0d5c-8a81-47ff-92fc-1c0c09ad57c0-config\") pod \"neutron-db-sync-gs5vn\" (UID: \"539c0d5c-8a81-47ff-92fc-1c0c09ad57c0\") " pod="openstack-kuttl-tests/neutron-db-sync-gs5vn" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.697308 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/88e6fbd8-42f7-446d-a9cb-0fc5d8a9c6bb-combined-ca-bundle\") pod \"cinder-db-sync-d8bvp\" (UID: \"88e6fbd8-42f7-446d-a9cb-0fc5d8a9c6bb\") " pod="openstack-kuttl-tests/cinder-db-sync-d8bvp" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.697424 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrbsh\" (UniqueName: \"kubernetes.io/projected/539c0d5c-8a81-47ff-92fc-1c0c09ad57c0-kube-api-access-nrbsh\") pod \"neutron-db-sync-gs5vn\" (UID: \"539c0d5c-8a81-47ff-92fc-1c0c09ad57c0\") " pod="openstack-kuttl-tests/neutron-db-sync-gs5vn" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.697533 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/88e6fbd8-42f7-446d-a9cb-0fc5d8a9c6bb-db-sync-config-data\") pod \"cinder-db-sync-d8bvp\" (UID: \"88e6fbd8-42f7-446d-a9cb-0fc5d8a9c6bb\") " pod="openstack-kuttl-tests/cinder-db-sync-d8bvp" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.697610 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ee9a1dc2-769e-4d3f-a1e0-f1b78c45403a-scripts\") pod \"placement-db-sync-pv6tf\" (UID: \"ee9a1dc2-769e-4d3f-a1e0-f1b78c45403a\") " pod="openstack-kuttl-tests/placement-db-sync-pv6tf" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.697700 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ee9a1dc2-769e-4d3f-a1e0-f1b78c45403a-combined-ca-bundle\") pod \"placement-db-sync-pv6tf\" (UID: \"ee9a1dc2-769e-4d3f-a1e0-f1b78c45403a\") " pod="openstack-kuttl-tests/placement-db-sync-pv6tf" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.697847 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ee9a1dc2-769e-4d3f-a1e0-f1b78c45403a-logs\") pod \"placement-db-sync-pv6tf\" (UID: \"ee9a1dc2-769e-4d3f-a1e0-f1b78c45403a\") " pod="openstack-kuttl-tests/placement-db-sync-pv6tf" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.697985 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f793dd8c-d824-4c26-9f17-848b016fe52b-combined-ca-bundle\") pod \"barbican-db-sync-bkr9j\" (UID: \"f793dd8c-d824-4c26-9f17-848b016fe52b\") " pod="openstack-kuttl-tests/barbican-db-sync-bkr9j" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.698072 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhjmq\" (UniqueName: \"kubernetes.io/projected/f793dd8c-d824-4c26-9f17-848b016fe52b-kube-api-access-lhjmq\") pod \"barbican-db-sync-bkr9j\" (UID: \"f793dd8c-d824-4c26-9f17-848b016fe52b\") " pod="openstack-kuttl-tests/barbican-db-sync-bkr9j" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.698176 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/539c0d5c-8a81-47ff-92fc-1c0c09ad57c0-combined-ca-bundle\") pod \"neutron-db-sync-gs5vn\" (UID: \"539c0d5c-8a81-47ff-92fc-1c0c09ad57c0\") " pod="openstack-kuttl-tests/neutron-db-sync-gs5vn" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.698293 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ee9a1dc2-769e-4d3f-a1e0-f1b78c45403a-config-data\") pod \"placement-db-sync-pv6tf\" (UID: \"ee9a1dc2-769e-4d3f-a1e0-f1b78c45403a\") " pod="openstack-kuttl-tests/placement-db-sync-pv6tf" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.698390 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/f793dd8c-d824-4c26-9f17-848b016fe52b-db-sync-config-data\") pod \"barbican-db-sync-bkr9j\" (UID: \"f793dd8c-d824-4c26-9f17-848b016fe52b\") " pod="openstack-kuttl-tests/barbican-db-sync-bkr9j" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.698575 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/88e6fbd8-42f7-446d-a9cb-0fc5d8a9c6bb-etc-machine-id\") pod \"cinder-db-sync-d8bvp\" (UID: \"88e6fbd8-42f7-446d-a9cb-0fc5d8a9c6bb\") " pod="openstack-kuttl-tests/cinder-db-sync-d8bvp" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.702688 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2bfs2\" (UniqueName: \"kubernetes.io/projected/88e6fbd8-42f7-446d-a9cb-0fc5d8a9c6bb-kube-api-access-2bfs2\") pod \"cinder-db-sync-d8bvp\" (UID: \"88e6fbd8-42f7-446d-a9cb-0fc5d8a9c6bb\") " pod="openstack-kuttl-tests/cinder-db-sync-d8bvp" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.700043 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ee9a1dc2-769e-4d3f-a1e0-f1b78c45403a-logs\") pod \"placement-db-sync-pv6tf\" (UID: \"ee9a1dc2-769e-4d3f-a1e0-f1b78c45403a\") " pod="openstack-kuttl-tests/placement-db-sync-pv6tf" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.702600 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/88e6fbd8-42f7-446d-a9cb-0fc5d8a9c6bb-etc-machine-id\") pod \"cinder-db-sync-d8bvp\" (UID: \"88e6fbd8-42f7-446d-a9cb-0fc5d8a9c6bb\") " pod="openstack-kuttl-tests/cinder-db-sync-d8bvp" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.708969 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ee9a1dc2-769e-4d3f-a1e0-f1b78c45403a-scripts\") pod \"placement-db-sync-pv6tf\" (UID: \"ee9a1dc2-769e-4d3f-a1e0-f1b78c45403a\") " pod="openstack-kuttl-tests/placement-db-sync-pv6tf" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.708992 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ee9a1dc2-769e-4d3f-a1e0-f1b78c45403a-config-data\") pod \"placement-db-sync-pv6tf\" (UID: \"ee9a1dc2-769e-4d3f-a1e0-f1b78c45403a\") " pod="openstack-kuttl-tests/placement-db-sync-pv6tf" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.709198 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9c4n5\" (UniqueName: \"kubernetes.io/projected/ee9a1dc2-769e-4d3f-a1e0-f1b78c45403a-kube-api-access-9c4n5\") pod \"placement-db-sync-pv6tf\" (UID: \"ee9a1dc2-769e-4d3f-a1e0-f1b78c45403a\") " pod="openstack-kuttl-tests/placement-db-sync-pv6tf" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.709342 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/88e6fbd8-42f7-446d-a9cb-0fc5d8a9c6bb-config-data\") pod \"cinder-db-sync-d8bvp\" (UID: \"88e6fbd8-42f7-446d-a9cb-0fc5d8a9c6bb\") " pod="openstack-kuttl-tests/cinder-db-sync-d8bvp" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.709433 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/88e6fbd8-42f7-446d-a9cb-0fc5d8a9c6bb-scripts\") pod \"cinder-db-sync-d8bvp\" (UID: \"88e6fbd8-42f7-446d-a9cb-0fc5d8a9c6bb\") " pod="openstack-kuttl-tests/cinder-db-sync-d8bvp" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.709232 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/88e6fbd8-42f7-446d-a9cb-0fc5d8a9c6bb-combined-ca-bundle\") pod \"cinder-db-sync-d8bvp\" (UID: \"88e6fbd8-42f7-446d-a9cb-0fc5d8a9c6bb\") " pod="openstack-kuttl-tests/cinder-db-sync-d8bvp" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.720290 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/88e6fbd8-42f7-446d-a9cb-0fc5d8a9c6bb-scripts\") pod \"cinder-db-sync-d8bvp\" (UID: \"88e6fbd8-42f7-446d-a9cb-0fc5d8a9c6bb\") " pod="openstack-kuttl-tests/cinder-db-sync-d8bvp" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.726395 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ee9a1dc2-769e-4d3f-a1e0-f1b78c45403a-combined-ca-bundle\") pod \"placement-db-sync-pv6tf\" (UID: \"ee9a1dc2-769e-4d3f-a1e0-f1b78c45403a\") " pod="openstack-kuttl-tests/placement-db-sync-pv6tf" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.726642 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/88e6fbd8-42f7-446d-a9cb-0fc5d8a9c6bb-db-sync-config-data\") pod \"cinder-db-sync-d8bvp\" (UID: \"88e6fbd8-42f7-446d-a9cb-0fc5d8a9c6bb\") " pod="openstack-kuttl-tests/cinder-db-sync-d8bvp" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.738820 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bfs2\" (UniqueName: \"kubernetes.io/projected/88e6fbd8-42f7-446d-a9cb-0fc5d8a9c6bb-kube-api-access-2bfs2\") pod \"cinder-db-sync-d8bvp\" (UID: \"88e6fbd8-42f7-446d-a9cb-0fc5d8a9c6bb\") " pod="openstack-kuttl-tests/cinder-db-sync-d8bvp" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.739649 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/88e6fbd8-42f7-446d-a9cb-0fc5d8a9c6bb-config-data\") pod \"cinder-db-sync-d8bvp\" (UID: \"88e6fbd8-42f7-446d-a9cb-0fc5d8a9c6bb\") " pod="openstack-kuttl-tests/cinder-db-sync-d8bvp" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.743516 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9c4n5\" (UniqueName: \"kubernetes.io/projected/ee9a1dc2-769e-4d3f-a1e0-f1b78c45403a-kube-api-access-9c4n5\") pod \"placement-db-sync-pv6tf\" (UID: \"ee9a1dc2-769e-4d3f-a1e0-f1b78c45403a\") " pod="openstack-kuttl-tests/placement-db-sync-pv6tf" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.811506 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/539c0d5c-8a81-47ff-92fc-1c0c09ad57c0-config\") pod \"neutron-db-sync-gs5vn\" (UID: \"539c0d5c-8a81-47ff-92fc-1c0c09ad57c0\") " pod="openstack-kuttl-tests/neutron-db-sync-gs5vn" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.811559 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nrbsh\" (UniqueName: \"kubernetes.io/projected/539c0d5c-8a81-47ff-92fc-1c0c09ad57c0-kube-api-access-nrbsh\") pod \"neutron-db-sync-gs5vn\" (UID: \"539c0d5c-8a81-47ff-92fc-1c0c09ad57c0\") " pod="openstack-kuttl-tests/neutron-db-sync-gs5vn" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.811669 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f793dd8c-d824-4c26-9f17-848b016fe52b-combined-ca-bundle\") pod \"barbican-db-sync-bkr9j\" (UID: \"f793dd8c-d824-4c26-9f17-848b016fe52b\") " pod="openstack-kuttl-tests/barbican-db-sync-bkr9j" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.811700 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lhjmq\" (UniqueName: \"kubernetes.io/projected/f793dd8c-d824-4c26-9f17-848b016fe52b-kube-api-access-lhjmq\") pod \"barbican-db-sync-bkr9j\" (UID: \"f793dd8c-d824-4c26-9f17-848b016fe52b\") " pod="openstack-kuttl-tests/barbican-db-sync-bkr9j" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.811726 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/539c0d5c-8a81-47ff-92fc-1c0c09ad57c0-combined-ca-bundle\") pod \"neutron-db-sync-gs5vn\" (UID: \"539c0d5c-8a81-47ff-92fc-1c0c09ad57c0\") " pod="openstack-kuttl-tests/neutron-db-sync-gs5vn" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.811797 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/f793dd8c-d824-4c26-9f17-848b016fe52b-db-sync-config-data\") pod \"barbican-db-sync-bkr9j\" (UID: \"f793dd8c-d824-4c26-9f17-848b016fe52b\") " pod="openstack-kuttl-tests/barbican-db-sync-bkr9j" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.813943 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.816594 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f793dd8c-d824-4c26-9f17-848b016fe52b-combined-ca-bundle\") pod \"barbican-db-sync-bkr9j\" (UID: \"f793dd8c-d824-4c26-9f17-848b016fe52b\") " pod="openstack-kuttl-tests/barbican-db-sync-bkr9j" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.816895 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/539c0d5c-8a81-47ff-92fc-1c0c09ad57c0-config\") pod \"neutron-db-sync-gs5vn\" (UID: \"539c0d5c-8a81-47ff-92fc-1c0c09ad57c0\") " pod="openstack-kuttl-tests/neutron-db-sync-gs5vn" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.820497 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/539c0d5c-8a81-47ff-92fc-1c0c09ad57c0-combined-ca-bundle\") pod \"neutron-db-sync-gs5vn\" (UID: \"539c0d5c-8a81-47ff-92fc-1c0c09ad57c0\") " pod="openstack-kuttl-tests/neutron-db-sync-gs5vn" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.826417 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/f793dd8c-d824-4c26-9f17-848b016fe52b-db-sync-config-data\") pod \"barbican-db-sync-bkr9j\" (UID: \"f793dd8c-d824-4c26-9f17-848b016fe52b\") " pod="openstack-kuttl-tests/barbican-db-sync-bkr9j" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.842409 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhjmq\" (UniqueName: \"kubernetes.io/projected/f793dd8c-d824-4c26-9f17-848b016fe52b-kube-api-access-lhjmq\") pod \"barbican-db-sync-bkr9j\" (UID: \"f793dd8c-d824-4c26-9f17-848b016fe52b\") " pod="openstack-kuttl-tests/barbican-db-sync-bkr9j" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.843589 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-pv6tf" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.846084 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrbsh\" (UniqueName: \"kubernetes.io/projected/539c0d5c-8a81-47ff-92fc-1c0c09ad57c0-kube-api-access-nrbsh\") pod \"neutron-db-sync-gs5vn\" (UID: \"539c0d5c-8a81-47ff-92fc-1c0c09ad57c0\") " pod="openstack-kuttl-tests/neutron-db-sync-gs5vn" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.899521 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-d8bvp" Mar 16 16:26:42 crc kubenswrapper[5120]: I0316 16:26:42.997349 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-gs5vn" Mar 16 16:26:43 crc kubenswrapper[5120]: I0316 16:26:43.000441 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-bkr9j" Mar 16 16:26:43 crc kubenswrapper[5120]: E0316 16:26:43.094907 5120 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb90e76bc_d652_4606_8c72_4b96133ce5c4.slice\": RecentStats: unable to find data in memory cache]" Mar 16 16:26:43 crc kubenswrapper[5120]: I0316 16:26:43.214231 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-7zwsz"] Mar 16 16:26:43 crc kubenswrapper[5120]: I0316 16:26:43.316927 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:26:43 crc kubenswrapper[5120]: I0316 16:26:43.326087 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:26:43 crc kubenswrapper[5120]: I0316 16:26:43.331152 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-glance-dockercfg-lfz7m\"" Mar 16 16:26:43 crc kubenswrapper[5120]: I0316 16:26:43.331360 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-external-config-data\"" Mar 16 16:26:43 crc kubenswrapper[5120]: I0316 16:26:43.331502 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-scripts\"" Mar 16 16:26:43 crc kubenswrapper[5120]: I0316 16:26:43.331736 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-public-svc\"" Mar 16 16:26:43 crc kubenswrapper[5120]: I0316 16:26:43.344116 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:26:43 crc kubenswrapper[5120]: I0316 16:26:43.422994 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/302e89b7-5873-4304-8374-e8de012542fd-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"302e89b7-5873-4304-8374-e8de012542fd\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:26:43 crc kubenswrapper[5120]: I0316 16:26:43.423129 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/302e89b7-5873-4304-8374-e8de012542fd-logs\") pod \"glance-default-external-api-0\" (UID: \"302e89b7-5873-4304-8374-e8de012542fd\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:26:43 crc kubenswrapper[5120]: I0316 16:26:43.423291 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/302e89b7-5873-4304-8374-e8de012542fd-config-data\") pod \"glance-default-external-api-0\" (UID: \"302e89b7-5873-4304-8374-e8de012542fd\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:26:43 crc kubenswrapper[5120]: I0316 16:26:43.423382 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"glance-default-external-api-0\" (UID: \"302e89b7-5873-4304-8374-e8de012542fd\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:26:43 crc kubenswrapper[5120]: I0316 16:26:43.423474 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/302e89b7-5873-4304-8374-e8de012542fd-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"302e89b7-5873-4304-8374-e8de012542fd\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:26:43 crc kubenswrapper[5120]: I0316 16:26:43.423625 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z86q6\" (UniqueName: \"kubernetes.io/projected/302e89b7-5873-4304-8374-e8de012542fd-kube-api-access-z86q6\") pod \"glance-default-external-api-0\" (UID: \"302e89b7-5873-4304-8374-e8de012542fd\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:26:43 crc kubenswrapper[5120]: I0316 16:26:43.423836 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/302e89b7-5873-4304-8374-e8de012542fd-scripts\") pod \"glance-default-external-api-0\" (UID: \"302e89b7-5873-4304-8374-e8de012542fd\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:26:43 crc kubenswrapper[5120]: I0316 16:26:43.424006 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/302e89b7-5873-4304-8374-e8de012542fd-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"302e89b7-5873-4304-8374-e8de012542fd\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:26:43 crc kubenswrapper[5120]: I0316 16:26:43.458865 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:26:43 crc kubenswrapper[5120]: I0316 16:26:43.489044 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:26:43 crc kubenswrapper[5120]: I0316 16:26:43.540886 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/302e89b7-5873-4304-8374-e8de012542fd-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"302e89b7-5873-4304-8374-e8de012542fd\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:26:43 crc kubenswrapper[5120]: I0316 16:26:43.540968 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/302e89b7-5873-4304-8374-e8de012542fd-logs\") pod \"glance-default-external-api-0\" (UID: \"302e89b7-5873-4304-8374-e8de012542fd\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:26:43 crc kubenswrapper[5120]: I0316 16:26:43.541097 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/302e89b7-5873-4304-8374-e8de012542fd-config-data\") pod \"glance-default-external-api-0\" (UID: \"302e89b7-5873-4304-8374-e8de012542fd\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:26:43 crc kubenswrapper[5120]: I0316 16:26:43.541155 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"glance-default-external-api-0\" (UID: \"302e89b7-5873-4304-8374-e8de012542fd\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:26:43 crc kubenswrapper[5120]: I0316 16:26:43.541201 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/302e89b7-5873-4304-8374-e8de012542fd-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"302e89b7-5873-4304-8374-e8de012542fd\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:26:43 crc kubenswrapper[5120]: I0316 16:26:43.541271 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z86q6\" (UniqueName: \"kubernetes.io/projected/302e89b7-5873-4304-8374-e8de012542fd-kube-api-access-z86q6\") pod \"glance-default-external-api-0\" (UID: \"302e89b7-5873-4304-8374-e8de012542fd\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:26:43 crc kubenswrapper[5120]: I0316 16:26:43.541349 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/302e89b7-5873-4304-8374-e8de012542fd-scripts\") pod \"glance-default-external-api-0\" (UID: \"302e89b7-5873-4304-8374-e8de012542fd\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:26:43 crc kubenswrapper[5120]: I0316 16:26:43.541411 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/302e89b7-5873-4304-8374-e8de012542fd-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"302e89b7-5873-4304-8374-e8de012542fd\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:26:43 crc kubenswrapper[5120]: I0316 16:26:43.543163 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/302e89b7-5873-4304-8374-e8de012542fd-logs\") pod \"glance-default-external-api-0\" (UID: \"302e89b7-5873-4304-8374-e8de012542fd\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:26:43 crc kubenswrapper[5120]: I0316 16:26:43.544061 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/302e89b7-5873-4304-8374-e8de012542fd-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"302e89b7-5873-4304-8374-e8de012542fd\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:26:43 crc kubenswrapper[5120]: I0316 16:26:43.549218 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:26:43 crc kubenswrapper[5120]: I0316 16:26:43.549446 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:26:43 crc kubenswrapper[5120]: I0316 16:26:43.553051 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"glance-default-external-api-0\" (UID: \"302e89b7-5873-4304-8374-e8de012542fd\") device mount path \"/mnt/openstack/pv20\"" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:26:43 crc kubenswrapper[5120]: I0316 16:26:43.558510 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-internal-config-data\"" Mar 16 16:26:43 crc kubenswrapper[5120]: I0316 16:26:43.558788 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-internal-svc\"" Mar 16 16:26:43 crc kubenswrapper[5120]: I0316 16:26:43.572157 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/302e89b7-5873-4304-8374-e8de012542fd-config-data\") pod \"glance-default-external-api-0\" (UID: \"302e89b7-5873-4304-8374-e8de012542fd\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:26:43 crc kubenswrapper[5120]: I0316 16:26:43.577468 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/302e89b7-5873-4304-8374-e8de012542fd-scripts\") pod \"glance-default-external-api-0\" (UID: \"302e89b7-5873-4304-8374-e8de012542fd\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:26:43 crc kubenswrapper[5120]: I0316 16:26:43.593444 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z86q6\" (UniqueName: \"kubernetes.io/projected/302e89b7-5873-4304-8374-e8de012542fd-kube-api-access-z86q6\") pod \"glance-default-external-api-0\" (UID: \"302e89b7-5873-4304-8374-e8de012542fd\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:26:43 crc kubenswrapper[5120]: I0316 16:26:43.630557 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/302e89b7-5873-4304-8374-e8de012542fd-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"302e89b7-5873-4304-8374-e8de012542fd\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:26:43 crc kubenswrapper[5120]: I0316 16:26:43.633477 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/302e89b7-5873-4304-8374-e8de012542fd-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"302e89b7-5873-4304-8374-e8de012542fd\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:26:43 crc kubenswrapper[5120]: I0316 16:26:43.659110 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"glance-default-internal-api-0\" (UID: \"8f19bb00-3a90-4acf-8ffb-3b7cc1070d77\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:26:43 crc kubenswrapper[5120]: I0316 16:26:43.659211 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8f19bb00-3a90-4acf-8ffb-3b7cc1070d77-scripts\") pod \"glance-default-internal-api-0\" (UID: \"8f19bb00-3a90-4acf-8ffb-3b7cc1070d77\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:26:43 crc kubenswrapper[5120]: I0316 16:26:43.659323 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/8f19bb00-3a90-4acf-8ffb-3b7cc1070d77-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"8f19bb00-3a90-4acf-8ffb-3b7cc1070d77\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:26:43 crc kubenswrapper[5120]: I0316 16:26:43.659382 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8f19bb00-3a90-4acf-8ffb-3b7cc1070d77-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"8f19bb00-3a90-4acf-8ffb-3b7cc1070d77\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:26:43 crc kubenswrapper[5120]: I0316 16:26:43.659424 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8f19bb00-3a90-4acf-8ffb-3b7cc1070d77-config-data\") pod \"glance-default-internal-api-0\" (UID: \"8f19bb00-3a90-4acf-8ffb-3b7cc1070d77\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:26:43 crc kubenswrapper[5120]: I0316 16:26:43.659458 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/8f19bb00-3a90-4acf-8ffb-3b7cc1070d77-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"8f19bb00-3a90-4acf-8ffb-3b7cc1070d77\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:26:43 crc kubenswrapper[5120]: I0316 16:26:43.659513 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ncnll\" (UniqueName: \"kubernetes.io/projected/8f19bb00-3a90-4acf-8ffb-3b7cc1070d77-kube-api-access-ncnll\") pod \"glance-default-internal-api-0\" (UID: \"8f19bb00-3a90-4acf-8ffb-3b7cc1070d77\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:26:43 crc kubenswrapper[5120]: I0316 16:26:43.659556 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8f19bb00-3a90-4acf-8ffb-3b7cc1070d77-logs\") pod \"glance-default-internal-api-0\" (UID: \"8f19bb00-3a90-4acf-8ffb-3b7cc1070d77\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:26:43 crc kubenswrapper[5120]: I0316 16:26:43.742494 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"glance-default-external-api-0\" (UID: \"302e89b7-5873-4304-8374-e8de012542fd\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:26:43 crc kubenswrapper[5120]: I0316 16:26:43.757235 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-d8bvp"] Mar 16 16:26:43 crc kubenswrapper[5120]: I0316 16:26:43.788610 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"glance-default-internal-api-0\" (UID: \"8f19bb00-3a90-4acf-8ffb-3b7cc1070d77\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:26:43 crc kubenswrapper[5120]: I0316 16:26:43.788659 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8f19bb00-3a90-4acf-8ffb-3b7cc1070d77-scripts\") pod \"glance-default-internal-api-0\" (UID: \"8f19bb00-3a90-4acf-8ffb-3b7cc1070d77\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:26:43 crc kubenswrapper[5120]: I0316 16:26:43.788795 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/8f19bb00-3a90-4acf-8ffb-3b7cc1070d77-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"8f19bb00-3a90-4acf-8ffb-3b7cc1070d77\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:26:43 crc kubenswrapper[5120]: I0316 16:26:43.788865 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8f19bb00-3a90-4acf-8ffb-3b7cc1070d77-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"8f19bb00-3a90-4acf-8ffb-3b7cc1070d77\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:26:43 crc kubenswrapper[5120]: I0316 16:26:43.788918 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8f19bb00-3a90-4acf-8ffb-3b7cc1070d77-config-data\") pod \"glance-default-internal-api-0\" (UID: \"8f19bb00-3a90-4acf-8ffb-3b7cc1070d77\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:26:43 crc kubenswrapper[5120]: I0316 16:26:43.788949 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/8f19bb00-3a90-4acf-8ffb-3b7cc1070d77-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"8f19bb00-3a90-4acf-8ffb-3b7cc1070d77\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:26:43 crc kubenswrapper[5120]: I0316 16:26:43.789011 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ncnll\" (UniqueName: \"kubernetes.io/projected/8f19bb00-3a90-4acf-8ffb-3b7cc1070d77-kube-api-access-ncnll\") pod \"glance-default-internal-api-0\" (UID: \"8f19bb00-3a90-4acf-8ffb-3b7cc1070d77\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:26:43 crc kubenswrapper[5120]: I0316 16:26:43.789049 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8f19bb00-3a90-4acf-8ffb-3b7cc1070d77-logs\") pod \"glance-default-internal-api-0\" (UID: \"8f19bb00-3a90-4acf-8ffb-3b7cc1070d77\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:26:43 crc kubenswrapper[5120]: I0316 16:26:43.789092 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"glance-default-internal-api-0\" (UID: \"8f19bb00-3a90-4acf-8ffb-3b7cc1070d77\") device mount path \"/mnt/openstack/pv03\"" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:26:43 crc kubenswrapper[5120]: I0316 16:26:43.789551 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8f19bb00-3a90-4acf-8ffb-3b7cc1070d77-logs\") pod \"glance-default-internal-api-0\" (UID: \"8f19bb00-3a90-4acf-8ffb-3b7cc1070d77\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:26:43 crc kubenswrapper[5120]: I0316 16:26:43.802872 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8f19bb00-3a90-4acf-8ffb-3b7cc1070d77-scripts\") pod \"glance-default-internal-api-0\" (UID: \"8f19bb00-3a90-4acf-8ffb-3b7cc1070d77\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:26:43 crc kubenswrapper[5120]: I0316 16:26:43.807921 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/8f19bb00-3a90-4acf-8ffb-3b7cc1070d77-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"8f19bb00-3a90-4acf-8ffb-3b7cc1070d77\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:26:43 crc kubenswrapper[5120]: I0316 16:26:43.827829 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-pv6tf"] Mar 16 16:26:43 crc kubenswrapper[5120]: I0316 16:26:43.847611 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/8f19bb00-3a90-4acf-8ffb-3b7cc1070d77-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"8f19bb00-3a90-4acf-8ffb-3b7cc1070d77\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:26:43 crc kubenswrapper[5120]: I0316 16:26:43.852849 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8f19bb00-3a90-4acf-8ffb-3b7cc1070d77-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"8f19bb00-3a90-4acf-8ffb-3b7cc1070d77\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:26:43 crc kubenswrapper[5120]: I0316 16:26:43.857807 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-gs5vn"] Mar 16 16:26:43 crc kubenswrapper[5120]: I0316 16:26:43.872223 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8f19bb00-3a90-4acf-8ffb-3b7cc1070d77-config-data\") pod \"glance-default-internal-api-0\" (UID: \"8f19bb00-3a90-4acf-8ffb-3b7cc1070d77\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:26:43 crc kubenswrapper[5120]: I0316 16:26:43.888223 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ncnll\" (UniqueName: \"kubernetes.io/projected/8f19bb00-3a90-4acf-8ffb-3b7cc1070d77-kube-api-access-ncnll\") pod \"glance-default-internal-api-0\" (UID: \"8f19bb00-3a90-4acf-8ffb-3b7cc1070d77\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:26:43 crc kubenswrapper[5120]: I0316 16:26:43.893577 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-bkr9j"] Mar 16 16:26:43 crc kubenswrapper[5120]: I0316 16:26:43.918167 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"glance-default-internal-api-0\" (UID: \"8f19bb00-3a90-4acf-8ffb-3b7cc1070d77\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:26:43 crc kubenswrapper[5120]: I0316 16:26:43.955187 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:26:44 crc kubenswrapper[5120]: I0316 16:26:44.029997 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-bkr9j" event={"ID":"f793dd8c-d824-4c26-9f17-848b016fe52b","Type":"ContainerStarted","Data":"a31eca488d57b2ddb48b4bfe73b79637cd30d3cecec8e3019a64273a3072d68a"} Mar 16 16:26:44 crc kubenswrapper[5120]: I0316 16:26:44.034096 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-d8bvp" event={"ID":"88e6fbd8-42f7-446d-a9cb-0fc5d8a9c6bb","Type":"ContainerStarted","Data":"3d6394af7cf371f156e7698ccc4615bc7429f52932d5d845b822ea0f7690ac81"} Mar 16 16:26:44 crc kubenswrapper[5120]: I0316 16:26:44.037122 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"0bd49631-00e4-430c-9659-1f0e7805900a","Type":"ContainerStarted","Data":"f9b962224786a28ea388f53fc8f7f78072a05aefcf43baf41467d0cb0b47062a"} Mar 16 16:26:44 crc kubenswrapper[5120]: I0316 16:26:44.040355 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-gs5vn" event={"ID":"539c0d5c-8a81-47ff-92fc-1c0c09ad57c0","Type":"ContainerStarted","Data":"9194564753df3df56d6de6d4ebf7f9f88ef2735f9411a0afca40b447bbd24bbc"} Mar 16 16:26:44 crc kubenswrapper[5120]: I0316 16:26:44.043090 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-pv6tf" event={"ID":"ee9a1dc2-769e-4d3f-a1e0-f1b78c45403a","Type":"ContainerStarted","Data":"4a65e0880021ee1cdb3a19f1f4b9c870cf680a62355f6ef9cf22dad32c716053"} Mar 16 16:26:44 crc kubenswrapper[5120]: I0316 16:26:44.049977 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-7zwsz" event={"ID":"67d3df0a-9de1-42e6-94b0-82bc99459ebf","Type":"ContainerStarted","Data":"0231acb944f49e21e9ebc6ad7724f5c2377405b925dc980593b0e6fb0c965404"} Mar 16 16:26:44 crc kubenswrapper[5120]: I0316 16:26:44.050013 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-7zwsz" event={"ID":"67d3df0a-9de1-42e6-94b0-82bc99459ebf","Type":"ContainerStarted","Data":"fea642621064a02bf2987d6f57e9e8a1c35e6f66eaa6b2bd78c12cee387c5f2a"} Mar 16 16:26:44 crc kubenswrapper[5120]: I0316 16:26:44.068514 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-bootstrap-7zwsz" podStartSLOduration=2.068499892 podStartE2EDuration="2.068499892s" podCreationTimestamp="2026-03-16 16:26:42 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:26:44.066600451 +0000 UTC m=+3306.220532108" watchObservedRunningTime="2026-03-16 16:26:44.068499892 +0000 UTC m=+3306.222431549" Mar 16 16:26:44 crc kubenswrapper[5120]: I0316 16:26:44.095249 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:26:44 crc kubenswrapper[5120]: I0316 16:26:44.524307 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:26:44 crc kubenswrapper[5120]: I0316 16:26:44.719304 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:26:44 crc kubenswrapper[5120]: I0316 16:26:44.782106 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-v822j_ac55471d-4e42-475f-a082-50f611571482/kube-multus/0.log" Mar 16 16:26:44 crc kubenswrapper[5120]: I0316 16:26:44.783491 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-v822j_ac55471d-4e42-475f-a082-50f611571482/kube-multus/0.log" Mar 16 16:26:44 crc kubenswrapper[5120]: I0316 16:26:44.791467 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-crc_9f0bc7fcb0822a2c13eb2d22cd8c0641/kube-controller-manager/0.log" Mar 16 16:26:44 crc kubenswrapper[5120]: I0316 16:26:44.792810 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-crc_9f0bc7fcb0822a2c13eb2d22cd8c0641/kube-controller-manager/0.log" Mar 16 16:26:45 crc kubenswrapper[5120]: I0316 16:26:45.100891 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-bkr9j" event={"ID":"f793dd8c-d824-4c26-9f17-848b016fe52b","Type":"ContainerStarted","Data":"b4c6fc265a60fa84278a8d1b2948bc5d22f504d8dffaa7a10b8773c37fe8f551"} Mar 16 16:26:45 crc kubenswrapper[5120]: I0316 16:26:45.124888 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-db-sync-bkr9j" podStartSLOduration=3.124867376 podStartE2EDuration="3.124867376s" podCreationTimestamp="2026-03-16 16:26:42 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:26:45.118278491 +0000 UTC m=+3307.272210158" watchObservedRunningTime="2026-03-16 16:26:45.124867376 +0000 UTC m=+3307.278799033" Mar 16 16:26:45 crc kubenswrapper[5120]: I0316 16:26:45.140791 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"0bd49631-00e4-430c-9659-1f0e7805900a","Type":"ContainerStarted","Data":"c263e036f554f134259b0c995982fb435f70c80c1c219381ef77a1450b65a8c6"} Mar 16 16:26:45 crc kubenswrapper[5120]: I0316 16:26:45.146840 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-gs5vn" event={"ID":"539c0d5c-8a81-47ff-92fc-1c0c09ad57c0","Type":"ContainerStarted","Data":"174e037af928ab5ddd9ae9c76c17745733eaec6219830d0d7c53066a87259986"} Mar 16 16:26:45 crc kubenswrapper[5120]: I0316 16:26:45.181121 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-pv6tf" event={"ID":"ee9a1dc2-769e-4d3f-a1e0-f1b78c45403a","Type":"ContainerStarted","Data":"f51f8fa918e46f66dcfe0379ccbb4cef96ae9898149769bf5afa18f743414fdd"} Mar 16 16:26:45 crc kubenswrapper[5120]: I0316 16:26:45.184966 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-db-sync-gs5vn" podStartSLOduration=3.184944243 podStartE2EDuration="3.184944243s" podCreationTimestamp="2026-03-16 16:26:42 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:26:45.17546098 +0000 UTC m=+3307.329392627" watchObservedRunningTime="2026-03-16 16:26:45.184944243 +0000 UTC m=+3307.338875900" Mar 16 16:26:45 crc kubenswrapper[5120]: I0316 16:26:45.207488 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"302e89b7-5873-4304-8374-e8de012542fd","Type":"ContainerStarted","Data":"0cc67a876bdb0ad11ded63352adf39e29f3f6d53e7e5cae5b9915d4e6f00c451"} Mar 16 16:26:45 crc kubenswrapper[5120]: I0316 16:26:45.216076 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-db-sync-pv6tf" podStartSLOduration=3.216056676 podStartE2EDuration="3.216056676s" podCreationTimestamp="2026-03-16 16:26:42 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:26:45.199101922 +0000 UTC m=+3307.353033579" watchObservedRunningTime="2026-03-16 16:26:45.216056676 +0000 UTC m=+3307.369988323" Mar 16 16:26:45 crc kubenswrapper[5120]: I0316 16:26:45.219362 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"8f19bb00-3a90-4acf-8ffb-3b7cc1070d77","Type":"ContainerStarted","Data":"d99feb5d9c71e783c3360e7f7df835ecaffbe72b8acb5c6ca0a22e997655cd18"} Mar 16 16:26:45 crc kubenswrapper[5120]: I0316 16:26:45.538356 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:26:45 crc kubenswrapper[5120]: I0316 16:26:45.630160 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:26:45 crc kubenswrapper[5120]: I0316 16:26:45.653472 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:26:46 crc kubenswrapper[5120]: I0316 16:26:46.275519 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"302e89b7-5873-4304-8374-e8de012542fd","Type":"ContainerStarted","Data":"b891fb9d262ae7d9f6f4662a9aec90394656fad8d7394f904b7dfdad3410aeb9"} Mar 16 16:26:46 crc kubenswrapper[5120]: I0316 16:26:46.288134 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"8f19bb00-3a90-4acf-8ffb-3b7cc1070d77","Type":"ContainerStarted","Data":"73941fec21d115b3ae880d859c3f9ad87cac40bf83198f53e5db6b56545c9380"} Mar 16 16:26:46 crc kubenswrapper[5120]: I0316 16:26:46.308977 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"0bd49631-00e4-430c-9659-1f0e7805900a","Type":"ContainerStarted","Data":"efb990183025bc9af58f113dfda3deb92e18e00a232b4bb5f7697ff4539fdc1d"} Mar 16 16:26:47 crc kubenswrapper[5120]: I0316 16:26:47.335461 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"0bd49631-00e4-430c-9659-1f0e7805900a","Type":"ContainerStarted","Data":"adbc0eb0a8bbe7d940bc6ca7568f8d504cab99b4f41692382e1aa252860a5336"} Mar 16 16:26:47 crc kubenswrapper[5120]: I0316 16:26:47.350022 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"302e89b7-5873-4304-8374-e8de012542fd","Type":"ContainerStarted","Data":"5ca31e7f9dd22b8201f85f89441e196f5dadd42e6bf7c08a9eb7356bb54b97e0"} Mar 16 16:26:47 crc kubenswrapper[5120]: I0316 16:26:47.350098 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="302e89b7-5873-4304-8374-e8de012542fd" containerName="glance-log" containerID="cri-o://b891fb9d262ae7d9f6f4662a9aec90394656fad8d7394f904b7dfdad3410aeb9" gracePeriod=30 Mar 16 16:26:47 crc kubenswrapper[5120]: I0316 16:26:47.350147 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="302e89b7-5873-4304-8374-e8de012542fd" containerName="glance-httpd" containerID="cri-o://5ca31e7f9dd22b8201f85f89441e196f5dadd42e6bf7c08a9eb7356bb54b97e0" gracePeriod=30 Mar 16 16:26:47 crc kubenswrapper[5120]: I0316 16:26:47.359350 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"8f19bb00-3a90-4acf-8ffb-3b7cc1070d77","Type":"ContainerStarted","Data":"36340c7d12b630e3b247920d35f67953d49d18fd070833548535f49c64e5ae3b"} Mar 16 16:26:47 crc kubenswrapper[5120]: I0316 16:26:47.359506 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="8f19bb00-3a90-4acf-8ffb-3b7cc1070d77" containerName="glance-log" containerID="cri-o://73941fec21d115b3ae880d859c3f9ad87cac40bf83198f53e5db6b56545c9380" gracePeriod=30 Mar 16 16:26:47 crc kubenswrapper[5120]: I0316 16:26:47.359612 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="8f19bb00-3a90-4acf-8ffb-3b7cc1070d77" containerName="glance-httpd" containerID="cri-o://36340c7d12b630e3b247920d35f67953d49d18fd070833548535f49c64e5ae3b" gracePeriod=30 Mar 16 16:26:47 crc kubenswrapper[5120]: I0316 16:26:47.378306 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-external-api-0" podStartSLOduration=5.37828686 podStartE2EDuration="5.37828686s" podCreationTimestamp="2026-03-16 16:26:42 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:26:47.368995481 +0000 UTC m=+3309.522927138" watchObservedRunningTime="2026-03-16 16:26:47.37828686 +0000 UTC m=+3309.532218517" Mar 16 16:26:47 crc kubenswrapper[5120]: I0316 16:26:47.395627 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-internal-api-0" podStartSLOduration=5.395610073 podStartE2EDuration="5.395610073s" podCreationTimestamp="2026-03-16 16:26:42 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:26:47.390936198 +0000 UTC m=+3309.544867855" watchObservedRunningTime="2026-03-16 16:26:47.395610073 +0000 UTC m=+3309.549541730" Mar 16 16:26:48 crc kubenswrapper[5120]: I0316 16:26:48.222723 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:26:48 crc kubenswrapper[5120]: I0316 16:26:48.313907 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8f19bb00-3a90-4acf-8ffb-3b7cc1070d77-scripts\") pod \"8f19bb00-3a90-4acf-8ffb-3b7cc1070d77\" (UID: \"8f19bb00-3a90-4acf-8ffb-3b7cc1070d77\") " Mar 16 16:26:48 crc kubenswrapper[5120]: I0316 16:26:48.313963 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/8f19bb00-3a90-4acf-8ffb-3b7cc1070d77-httpd-run\") pod \"8f19bb00-3a90-4acf-8ffb-3b7cc1070d77\" (UID: \"8f19bb00-3a90-4acf-8ffb-3b7cc1070d77\") " Mar 16 16:26:48 crc kubenswrapper[5120]: I0316 16:26:48.314162 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"8f19bb00-3a90-4acf-8ffb-3b7cc1070d77\" (UID: \"8f19bb00-3a90-4acf-8ffb-3b7cc1070d77\") " Mar 16 16:26:48 crc kubenswrapper[5120]: I0316 16:26:48.314813 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f19bb00-3a90-4acf-8ffb-3b7cc1070d77-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "8f19bb00-3a90-4acf-8ffb-3b7cc1070d77" (UID: "8f19bb00-3a90-4acf-8ffb-3b7cc1070d77"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:26:48 crc kubenswrapper[5120]: I0316 16:26:48.314830 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/8f19bb00-3a90-4acf-8ffb-3b7cc1070d77-internal-tls-certs\") pod \"8f19bb00-3a90-4acf-8ffb-3b7cc1070d77\" (UID: \"8f19bb00-3a90-4acf-8ffb-3b7cc1070d77\") " Mar 16 16:26:48 crc kubenswrapper[5120]: I0316 16:26:48.315016 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ncnll\" (UniqueName: \"kubernetes.io/projected/8f19bb00-3a90-4acf-8ffb-3b7cc1070d77-kube-api-access-ncnll\") pod \"8f19bb00-3a90-4acf-8ffb-3b7cc1070d77\" (UID: \"8f19bb00-3a90-4acf-8ffb-3b7cc1070d77\") " Mar 16 16:26:48 crc kubenswrapper[5120]: I0316 16:26:48.315051 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8f19bb00-3a90-4acf-8ffb-3b7cc1070d77-logs\") pod \"8f19bb00-3a90-4acf-8ffb-3b7cc1070d77\" (UID: \"8f19bb00-3a90-4acf-8ffb-3b7cc1070d77\") " Mar 16 16:26:48 crc kubenswrapper[5120]: I0316 16:26:48.315085 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8f19bb00-3a90-4acf-8ffb-3b7cc1070d77-config-data\") pod \"8f19bb00-3a90-4acf-8ffb-3b7cc1070d77\" (UID: \"8f19bb00-3a90-4acf-8ffb-3b7cc1070d77\") " Mar 16 16:26:48 crc kubenswrapper[5120]: I0316 16:26:48.315285 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f19bb00-3a90-4acf-8ffb-3b7cc1070d77-logs" (OuterVolumeSpecName: "logs") pod "8f19bb00-3a90-4acf-8ffb-3b7cc1070d77" (UID: "8f19bb00-3a90-4acf-8ffb-3b7cc1070d77"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:26:48 crc kubenswrapper[5120]: I0316 16:26:48.315340 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8f19bb00-3a90-4acf-8ffb-3b7cc1070d77-combined-ca-bundle\") pod \"8f19bb00-3a90-4acf-8ffb-3b7cc1070d77\" (UID: \"8f19bb00-3a90-4acf-8ffb-3b7cc1070d77\") " Mar 16 16:26:48 crc kubenswrapper[5120]: I0316 16:26:48.316973 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/8f19bb00-3a90-4acf-8ffb-3b7cc1070d77-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 16:26:48 crc kubenswrapper[5120]: I0316 16:26:48.316998 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8f19bb00-3a90-4acf-8ffb-3b7cc1070d77-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:26:48 crc kubenswrapper[5120]: I0316 16:26:48.321047 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage03-crc" (OuterVolumeSpecName: "glance") pod "8f19bb00-3a90-4acf-8ffb-3b7cc1070d77" (UID: "8f19bb00-3a90-4acf-8ffb-3b7cc1070d77"). InnerVolumeSpecName "local-storage03-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:26:48 crc kubenswrapper[5120]: I0316 16:26:48.324138 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f19bb00-3a90-4acf-8ffb-3b7cc1070d77-scripts" (OuterVolumeSpecName: "scripts") pod "8f19bb00-3a90-4acf-8ffb-3b7cc1070d77" (UID: "8f19bb00-3a90-4acf-8ffb-3b7cc1070d77"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:26:48 crc kubenswrapper[5120]: I0316 16:26:48.343333 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f19bb00-3a90-4acf-8ffb-3b7cc1070d77-kube-api-access-ncnll" (OuterVolumeSpecName: "kube-api-access-ncnll") pod "8f19bb00-3a90-4acf-8ffb-3b7cc1070d77" (UID: "8f19bb00-3a90-4acf-8ffb-3b7cc1070d77"). InnerVolumeSpecName "kube-api-access-ncnll". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:26:48 crc kubenswrapper[5120]: I0316 16:26:48.372819 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:26:48 crc kubenswrapper[5120]: I0316 16:26:48.373935 5120 generic.go:358] "Generic (PLEG): container finished" podID="302e89b7-5873-4304-8374-e8de012542fd" containerID="5ca31e7f9dd22b8201f85f89441e196f5dadd42e6bf7c08a9eb7356bb54b97e0" exitCode=0 Mar 16 16:26:48 crc kubenswrapper[5120]: I0316 16:26:48.373968 5120 generic.go:358] "Generic (PLEG): container finished" podID="302e89b7-5873-4304-8374-e8de012542fd" containerID="b891fb9d262ae7d9f6f4662a9aec90394656fad8d7394f904b7dfdad3410aeb9" exitCode=143 Mar 16 16:26:48 crc kubenswrapper[5120]: I0316 16:26:48.374147 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"302e89b7-5873-4304-8374-e8de012542fd","Type":"ContainerDied","Data":"5ca31e7f9dd22b8201f85f89441e196f5dadd42e6bf7c08a9eb7356bb54b97e0"} Mar 16 16:26:48 crc kubenswrapper[5120]: I0316 16:26:48.374184 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"302e89b7-5873-4304-8374-e8de012542fd","Type":"ContainerDied","Data":"b891fb9d262ae7d9f6f4662a9aec90394656fad8d7394f904b7dfdad3410aeb9"} Mar 16 16:26:48 crc kubenswrapper[5120]: I0316 16:26:48.374195 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"302e89b7-5873-4304-8374-e8de012542fd","Type":"ContainerDied","Data":"0cc67a876bdb0ad11ded63352adf39e29f3f6d53e7e5cae5b9915d4e6f00c451"} Mar 16 16:26:48 crc kubenswrapper[5120]: I0316 16:26:48.374211 5120 scope.go:117] "RemoveContainer" containerID="5ca31e7f9dd22b8201f85f89441e196f5dadd42e6bf7c08a9eb7356bb54b97e0" Mar 16 16:26:48 crc kubenswrapper[5120]: I0316 16:26:48.380823 5120 generic.go:358] "Generic (PLEG): container finished" podID="8f19bb00-3a90-4acf-8ffb-3b7cc1070d77" containerID="36340c7d12b630e3b247920d35f67953d49d18fd070833548535f49c64e5ae3b" exitCode=0 Mar 16 16:26:48 crc kubenswrapper[5120]: I0316 16:26:48.380842 5120 generic.go:358] "Generic (PLEG): container finished" podID="8f19bb00-3a90-4acf-8ffb-3b7cc1070d77" containerID="73941fec21d115b3ae880d859c3f9ad87cac40bf83198f53e5db6b56545c9380" exitCode=143 Mar 16 16:26:48 crc kubenswrapper[5120]: I0316 16:26:48.380943 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"8f19bb00-3a90-4acf-8ffb-3b7cc1070d77","Type":"ContainerDied","Data":"36340c7d12b630e3b247920d35f67953d49d18fd070833548535f49c64e5ae3b"} Mar 16 16:26:48 crc kubenswrapper[5120]: I0316 16:26:48.380962 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"8f19bb00-3a90-4acf-8ffb-3b7cc1070d77","Type":"ContainerDied","Data":"73941fec21d115b3ae880d859c3f9ad87cac40bf83198f53e5db6b56545c9380"} Mar 16 16:26:48 crc kubenswrapper[5120]: I0316 16:26:48.380972 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"8f19bb00-3a90-4acf-8ffb-3b7cc1070d77","Type":"ContainerDied","Data":"d99feb5d9c71e783c3360e7f7df835ecaffbe72b8acb5c6ca0a22e997655cd18"} Mar 16 16:26:48 crc kubenswrapper[5120]: I0316 16:26:48.381889 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:26:48 crc kubenswrapper[5120]: I0316 16:26:48.384279 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-d8bvp" event={"ID":"88e6fbd8-42f7-446d-a9cb-0fc5d8a9c6bb","Type":"ContainerStarted","Data":"3ea3b93a53d44177134dfe19885a2195f929d6eb949caecb62bf340e324066e7"} Mar 16 16:26:48 crc kubenswrapper[5120]: I0316 16:26:48.393756 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f19bb00-3a90-4acf-8ffb-3b7cc1070d77-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "8f19bb00-3a90-4acf-8ffb-3b7cc1070d77" (UID: "8f19bb00-3a90-4acf-8ffb-3b7cc1070d77"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:26:48 crc kubenswrapper[5120]: I0316 16:26:48.411290 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f19bb00-3a90-4acf-8ffb-3b7cc1070d77-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "8f19bb00-3a90-4acf-8ffb-3b7cc1070d77" (UID: "8f19bb00-3a90-4acf-8ffb-3b7cc1070d77"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:26:48 crc kubenswrapper[5120]: I0316 16:26:48.428595 5120 scope.go:117] "RemoveContainer" containerID="b891fb9d262ae7d9f6f4662a9aec90394656fad8d7394f904b7dfdad3410aeb9" Mar 16 16:26:48 crc kubenswrapper[5120]: I0316 16:26:48.430640 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-db-sync-d8bvp" podStartSLOduration=6.430625096 podStartE2EDuration="6.430625096s" podCreationTimestamp="2026-03-16 16:26:42 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:26:48.42928345 +0000 UTC m=+3310.583215107" watchObservedRunningTime="2026-03-16 16:26:48.430625096 +0000 UTC m=+3310.584556743" Mar 16 16:26:48 crc kubenswrapper[5120]: I0316 16:26:48.442570 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/302e89b7-5873-4304-8374-e8de012542fd-scripts\") pod \"302e89b7-5873-4304-8374-e8de012542fd\" (UID: \"302e89b7-5873-4304-8374-e8de012542fd\") " Mar 16 16:26:48 crc kubenswrapper[5120]: I0316 16:26:48.443501 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"302e89b7-5873-4304-8374-e8de012542fd\" (UID: \"302e89b7-5873-4304-8374-e8de012542fd\") " Mar 16 16:26:48 crc kubenswrapper[5120]: I0316 16:26:48.443717 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/302e89b7-5873-4304-8374-e8de012542fd-config-data\") pod \"302e89b7-5873-4304-8374-e8de012542fd\" (UID: \"302e89b7-5873-4304-8374-e8de012542fd\") " Mar 16 16:26:48 crc kubenswrapper[5120]: I0316 16:26:48.443915 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/302e89b7-5873-4304-8374-e8de012542fd-logs\") pod \"302e89b7-5873-4304-8374-e8de012542fd\" (UID: \"302e89b7-5873-4304-8374-e8de012542fd\") " Mar 16 16:26:48 crc kubenswrapper[5120]: I0316 16:26:48.444243 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/302e89b7-5873-4304-8374-e8de012542fd-logs" (OuterVolumeSpecName: "logs") pod "302e89b7-5873-4304-8374-e8de012542fd" (UID: "302e89b7-5873-4304-8374-e8de012542fd"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:26:48 crc kubenswrapper[5120]: I0316 16:26:48.444509 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/302e89b7-5873-4304-8374-e8de012542fd-combined-ca-bundle\") pod \"302e89b7-5873-4304-8374-e8de012542fd\" (UID: \"302e89b7-5873-4304-8374-e8de012542fd\") " Mar 16 16:26:48 crc kubenswrapper[5120]: I0316 16:26:48.444665 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z86q6\" (UniqueName: \"kubernetes.io/projected/302e89b7-5873-4304-8374-e8de012542fd-kube-api-access-z86q6\") pod \"302e89b7-5873-4304-8374-e8de012542fd\" (UID: \"302e89b7-5873-4304-8374-e8de012542fd\") " Mar 16 16:26:48 crc kubenswrapper[5120]: I0316 16:26:48.445125 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/302e89b7-5873-4304-8374-e8de012542fd-public-tls-certs\") pod \"302e89b7-5873-4304-8374-e8de012542fd\" (UID: \"302e89b7-5873-4304-8374-e8de012542fd\") " Mar 16 16:26:48 crc kubenswrapper[5120]: I0316 16:26:48.445263 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/302e89b7-5873-4304-8374-e8de012542fd-httpd-run\") pod \"302e89b7-5873-4304-8374-e8de012542fd\" (UID: \"302e89b7-5873-4304-8374-e8de012542fd\") " Mar 16 16:26:48 crc kubenswrapper[5120]: I0316 16:26:48.445575 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/302e89b7-5873-4304-8374-e8de012542fd-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "302e89b7-5873-4304-8374-e8de012542fd" (UID: "302e89b7-5873-4304-8374-e8de012542fd"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:26:48 crc kubenswrapper[5120]: I0316 16:26:48.449253 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/8f19bb00-3a90-4acf-8ffb-3b7cc1070d77-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:26:48 crc kubenswrapper[5120]: I0316 16:26:48.450698 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/302e89b7-5873-4304-8374-e8de012542fd-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 16:26:48 crc kubenswrapper[5120]: I0316 16:26:48.451002 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ncnll\" (UniqueName: \"kubernetes.io/projected/8f19bb00-3a90-4acf-8ffb-3b7cc1070d77-kube-api-access-ncnll\") on node \"crc\" DevicePath \"\"" Mar 16 16:26:48 crc kubenswrapper[5120]: I0316 16:26:48.451229 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8f19bb00-3a90-4acf-8ffb-3b7cc1070d77-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:26:48 crc kubenswrapper[5120]: I0316 16:26:48.451501 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8f19bb00-3a90-4acf-8ffb-3b7cc1070d77-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:26:48 crc kubenswrapper[5120]: I0316 16:26:48.451846 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/302e89b7-5873-4304-8374-e8de012542fd-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:26:48 crc kubenswrapper[5120]: I0316 16:26:48.451952 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") on node \"crc\" " Mar 16 16:26:48 crc kubenswrapper[5120]: I0316 16:26:48.451613 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage20-crc" (OuterVolumeSpecName: "glance") pod "302e89b7-5873-4304-8374-e8de012542fd" (UID: "302e89b7-5873-4304-8374-e8de012542fd"). InnerVolumeSpecName "local-storage20-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:26:48 crc kubenswrapper[5120]: I0316 16:26:48.451795 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/302e89b7-5873-4304-8374-e8de012542fd-kube-api-access-z86q6" (OuterVolumeSpecName: "kube-api-access-z86q6") pod "302e89b7-5873-4304-8374-e8de012542fd" (UID: "302e89b7-5873-4304-8374-e8de012542fd"). InnerVolumeSpecName "kube-api-access-z86q6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:26:48 crc kubenswrapper[5120]: I0316 16:26:48.451819 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/302e89b7-5873-4304-8374-e8de012542fd-scripts" (OuterVolumeSpecName: "scripts") pod "302e89b7-5873-4304-8374-e8de012542fd" (UID: "302e89b7-5873-4304-8374-e8de012542fd"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:26:48 crc kubenswrapper[5120]: I0316 16:26:48.464932 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f19bb00-3a90-4acf-8ffb-3b7cc1070d77-config-data" (OuterVolumeSpecName: "config-data") pod "8f19bb00-3a90-4acf-8ffb-3b7cc1070d77" (UID: "8f19bb00-3a90-4acf-8ffb-3b7cc1070d77"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:26:48 crc kubenswrapper[5120]: I0316 16:26:48.476241 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage03-crc" (UniqueName: "kubernetes.io/local-volume/local-storage03-crc") on node "crc" Mar 16 16:26:48 crc kubenswrapper[5120]: I0316 16:26:48.496968 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/302e89b7-5873-4304-8374-e8de012542fd-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "302e89b7-5873-4304-8374-e8de012542fd" (UID: "302e89b7-5873-4304-8374-e8de012542fd"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:26:48 crc kubenswrapper[5120]: I0316 16:26:48.504614 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/302e89b7-5873-4304-8374-e8de012542fd-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "302e89b7-5873-4304-8374-e8de012542fd" (UID: "302e89b7-5873-4304-8374-e8de012542fd"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:26:48 crc kubenswrapper[5120]: I0316 16:26:48.511135 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/302e89b7-5873-4304-8374-e8de012542fd-config-data" (OuterVolumeSpecName: "config-data") pod "302e89b7-5873-4304-8374-e8de012542fd" (UID: "302e89b7-5873-4304-8374-e8de012542fd"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:26:48 crc kubenswrapper[5120]: I0316 16:26:48.560240 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/302e89b7-5873-4304-8374-e8de012542fd-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:26:48 crc kubenswrapper[5120]: I0316 16:26:48.560276 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:26:48 crc kubenswrapper[5120]: I0316 16:26:48.560288 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z86q6\" (UniqueName: \"kubernetes.io/projected/302e89b7-5873-4304-8374-e8de012542fd-kube-api-access-z86q6\") on node \"crc\" DevicePath \"\"" Mar 16 16:26:48 crc kubenswrapper[5120]: I0316 16:26:48.560299 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/302e89b7-5873-4304-8374-e8de012542fd-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:26:48 crc kubenswrapper[5120]: I0316 16:26:48.560307 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8f19bb00-3a90-4acf-8ffb-3b7cc1070d77-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:26:48 crc kubenswrapper[5120]: I0316 16:26:48.560315 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/302e89b7-5873-4304-8374-e8de012542fd-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:26:48 crc kubenswrapper[5120]: I0316 16:26:48.560344 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") on node \"crc\" " Mar 16 16:26:48 crc kubenswrapper[5120]: I0316 16:26:48.560352 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/302e89b7-5873-4304-8374-e8de012542fd-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:26:48 crc kubenswrapper[5120]: I0316 16:26:48.578124 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage20-crc" (UniqueName: "kubernetes.io/local-volume/local-storage20-crc") on node "crc" Mar 16 16:26:48 crc kubenswrapper[5120]: I0316 16:26:48.602900 5120 scope.go:117] "RemoveContainer" containerID="5ca31e7f9dd22b8201f85f89441e196f5dadd42e6bf7c08a9eb7356bb54b97e0" Mar 16 16:26:48 crc kubenswrapper[5120]: E0316 16:26:48.603354 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ca31e7f9dd22b8201f85f89441e196f5dadd42e6bf7c08a9eb7356bb54b97e0\": container with ID starting with 5ca31e7f9dd22b8201f85f89441e196f5dadd42e6bf7c08a9eb7356bb54b97e0 not found: ID does not exist" containerID="5ca31e7f9dd22b8201f85f89441e196f5dadd42e6bf7c08a9eb7356bb54b97e0" Mar 16 16:26:48 crc kubenswrapper[5120]: I0316 16:26:48.603493 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ca31e7f9dd22b8201f85f89441e196f5dadd42e6bf7c08a9eb7356bb54b97e0"} err="failed to get container status \"5ca31e7f9dd22b8201f85f89441e196f5dadd42e6bf7c08a9eb7356bb54b97e0\": rpc error: code = NotFound desc = could not find container \"5ca31e7f9dd22b8201f85f89441e196f5dadd42e6bf7c08a9eb7356bb54b97e0\": container with ID starting with 5ca31e7f9dd22b8201f85f89441e196f5dadd42e6bf7c08a9eb7356bb54b97e0 not found: ID does not exist" Mar 16 16:26:48 crc kubenswrapper[5120]: I0316 16:26:48.603628 5120 scope.go:117] "RemoveContainer" containerID="b891fb9d262ae7d9f6f4662a9aec90394656fad8d7394f904b7dfdad3410aeb9" Mar 16 16:26:48 crc kubenswrapper[5120]: E0316 16:26:48.604141 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b891fb9d262ae7d9f6f4662a9aec90394656fad8d7394f904b7dfdad3410aeb9\": container with ID starting with b891fb9d262ae7d9f6f4662a9aec90394656fad8d7394f904b7dfdad3410aeb9 not found: ID does not exist" containerID="b891fb9d262ae7d9f6f4662a9aec90394656fad8d7394f904b7dfdad3410aeb9" Mar 16 16:26:48 crc kubenswrapper[5120]: I0316 16:26:48.604174 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b891fb9d262ae7d9f6f4662a9aec90394656fad8d7394f904b7dfdad3410aeb9"} err="failed to get container status \"b891fb9d262ae7d9f6f4662a9aec90394656fad8d7394f904b7dfdad3410aeb9\": rpc error: code = NotFound desc = could not find container \"b891fb9d262ae7d9f6f4662a9aec90394656fad8d7394f904b7dfdad3410aeb9\": container with ID starting with b891fb9d262ae7d9f6f4662a9aec90394656fad8d7394f904b7dfdad3410aeb9 not found: ID does not exist" Mar 16 16:26:48 crc kubenswrapper[5120]: I0316 16:26:48.604195 5120 scope.go:117] "RemoveContainer" containerID="5ca31e7f9dd22b8201f85f89441e196f5dadd42e6bf7c08a9eb7356bb54b97e0" Mar 16 16:26:48 crc kubenswrapper[5120]: I0316 16:26:48.604472 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ca31e7f9dd22b8201f85f89441e196f5dadd42e6bf7c08a9eb7356bb54b97e0"} err="failed to get container status \"5ca31e7f9dd22b8201f85f89441e196f5dadd42e6bf7c08a9eb7356bb54b97e0\": rpc error: code = NotFound desc = could not find container \"5ca31e7f9dd22b8201f85f89441e196f5dadd42e6bf7c08a9eb7356bb54b97e0\": container with ID starting with 5ca31e7f9dd22b8201f85f89441e196f5dadd42e6bf7c08a9eb7356bb54b97e0 not found: ID does not exist" Mar 16 16:26:48 crc kubenswrapper[5120]: I0316 16:26:48.604518 5120 scope.go:117] "RemoveContainer" containerID="b891fb9d262ae7d9f6f4662a9aec90394656fad8d7394f904b7dfdad3410aeb9" Mar 16 16:26:48 crc kubenswrapper[5120]: I0316 16:26:48.605097 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b891fb9d262ae7d9f6f4662a9aec90394656fad8d7394f904b7dfdad3410aeb9"} err="failed to get container status \"b891fb9d262ae7d9f6f4662a9aec90394656fad8d7394f904b7dfdad3410aeb9\": rpc error: code = NotFound desc = could not find container \"b891fb9d262ae7d9f6f4662a9aec90394656fad8d7394f904b7dfdad3410aeb9\": container with ID starting with b891fb9d262ae7d9f6f4662a9aec90394656fad8d7394f904b7dfdad3410aeb9 not found: ID does not exist" Mar 16 16:26:48 crc kubenswrapper[5120]: I0316 16:26:48.605246 5120 scope.go:117] "RemoveContainer" containerID="36340c7d12b630e3b247920d35f67953d49d18fd070833548535f49c64e5ae3b" Mar 16 16:26:48 crc kubenswrapper[5120]: I0316 16:26:48.662945 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:26:48 crc kubenswrapper[5120]: I0316 16:26:48.670156 5120 scope.go:117] "RemoveContainer" containerID="73941fec21d115b3ae880d859c3f9ad87cac40bf83198f53e5db6b56545c9380" Mar 16 16:26:48 crc kubenswrapper[5120]: I0316 16:26:48.811403 5120 scope.go:117] "RemoveContainer" containerID="36340c7d12b630e3b247920d35f67953d49d18fd070833548535f49c64e5ae3b" Mar 16 16:26:48 crc kubenswrapper[5120]: E0316 16:26:48.812863 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"36340c7d12b630e3b247920d35f67953d49d18fd070833548535f49c64e5ae3b\": container with ID starting with 36340c7d12b630e3b247920d35f67953d49d18fd070833548535f49c64e5ae3b not found: ID does not exist" containerID="36340c7d12b630e3b247920d35f67953d49d18fd070833548535f49c64e5ae3b" Mar 16 16:26:48 crc kubenswrapper[5120]: I0316 16:26:48.812931 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36340c7d12b630e3b247920d35f67953d49d18fd070833548535f49c64e5ae3b"} err="failed to get container status \"36340c7d12b630e3b247920d35f67953d49d18fd070833548535f49c64e5ae3b\": rpc error: code = NotFound desc = could not find container \"36340c7d12b630e3b247920d35f67953d49d18fd070833548535f49c64e5ae3b\": container with ID starting with 36340c7d12b630e3b247920d35f67953d49d18fd070833548535f49c64e5ae3b not found: ID does not exist" Mar 16 16:26:48 crc kubenswrapper[5120]: I0316 16:26:48.812963 5120 scope.go:117] "RemoveContainer" containerID="73941fec21d115b3ae880d859c3f9ad87cac40bf83198f53e5db6b56545c9380" Mar 16 16:26:48 crc kubenswrapper[5120]: E0316 16:26:48.813783 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"73941fec21d115b3ae880d859c3f9ad87cac40bf83198f53e5db6b56545c9380\": container with ID starting with 73941fec21d115b3ae880d859c3f9ad87cac40bf83198f53e5db6b56545c9380 not found: ID does not exist" containerID="73941fec21d115b3ae880d859c3f9ad87cac40bf83198f53e5db6b56545c9380" Mar 16 16:26:48 crc kubenswrapper[5120]: I0316 16:26:48.813820 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73941fec21d115b3ae880d859c3f9ad87cac40bf83198f53e5db6b56545c9380"} err="failed to get container status \"73941fec21d115b3ae880d859c3f9ad87cac40bf83198f53e5db6b56545c9380\": rpc error: code = NotFound desc = could not find container \"73941fec21d115b3ae880d859c3f9ad87cac40bf83198f53e5db6b56545c9380\": container with ID starting with 73941fec21d115b3ae880d859c3f9ad87cac40bf83198f53e5db6b56545c9380 not found: ID does not exist" Mar 16 16:26:48 crc kubenswrapper[5120]: I0316 16:26:48.813840 5120 scope.go:117] "RemoveContainer" containerID="36340c7d12b630e3b247920d35f67953d49d18fd070833548535f49c64e5ae3b" Mar 16 16:26:48 crc kubenswrapper[5120]: I0316 16:26:48.814099 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36340c7d12b630e3b247920d35f67953d49d18fd070833548535f49c64e5ae3b"} err="failed to get container status \"36340c7d12b630e3b247920d35f67953d49d18fd070833548535f49c64e5ae3b\": rpc error: code = NotFound desc = could not find container \"36340c7d12b630e3b247920d35f67953d49d18fd070833548535f49c64e5ae3b\": container with ID starting with 36340c7d12b630e3b247920d35f67953d49d18fd070833548535f49c64e5ae3b not found: ID does not exist" Mar 16 16:26:48 crc kubenswrapper[5120]: I0316 16:26:48.814123 5120 scope.go:117] "RemoveContainer" containerID="73941fec21d115b3ae880d859c3f9ad87cac40bf83198f53e5db6b56545c9380" Mar 16 16:26:48 crc kubenswrapper[5120]: I0316 16:26:48.814298 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73941fec21d115b3ae880d859c3f9ad87cac40bf83198f53e5db6b56545c9380"} err="failed to get container status \"73941fec21d115b3ae880d859c3f9ad87cac40bf83198f53e5db6b56545c9380\": rpc error: code = NotFound desc = could not find container \"73941fec21d115b3ae880d859c3f9ad87cac40bf83198f53e5db6b56545c9380\": container with ID starting with 73941fec21d115b3ae880d859c3f9ad87cac40bf83198f53e5db6b56545c9380 not found: ID does not exist" Mar 16 16:26:49 crc kubenswrapper[5120]: I0316 16:26:49.406917 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"0bd49631-00e4-430c-9659-1f0e7805900a","Type":"ContainerStarted","Data":"d25c901c17ba55401a5b994fc46dfc911c2e62b7acb1deefab504b6f54cbd94c"} Mar 16 16:26:49 crc kubenswrapper[5120]: I0316 16:26:49.407154 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="0bd49631-00e4-430c-9659-1f0e7805900a" containerName="proxy-httpd" containerID="cri-o://d25c901c17ba55401a5b994fc46dfc911c2e62b7acb1deefab504b6f54cbd94c" gracePeriod=30 Mar 16 16:26:49 crc kubenswrapper[5120]: I0316 16:26:49.406970 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="0bd49631-00e4-430c-9659-1f0e7805900a" containerName="ceilometer-central-agent" containerID="cri-o://c263e036f554f134259b0c995982fb435f70c80c1c219381ef77a1450b65a8c6" gracePeriod=30 Mar 16 16:26:49 crc kubenswrapper[5120]: I0316 16:26:49.407261 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="0bd49631-00e4-430c-9659-1f0e7805900a" containerName="sg-core" containerID="cri-o://adbc0eb0a8bbe7d940bc6ca7568f8d504cab99b4f41692382e1aa252860a5336" gracePeriod=30 Mar 16 16:26:49 crc kubenswrapper[5120]: I0316 16:26:49.407266 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:26:49 crc kubenswrapper[5120]: I0316 16:26:49.407264 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="0bd49631-00e4-430c-9659-1f0e7805900a" containerName="ceilometer-notification-agent" containerID="cri-o://efb990183025bc9af58f113dfda3deb92e18e00a232b4bb5f7697ff4539fdc1d" gracePeriod=30 Mar 16 16:26:49 crc kubenswrapper[5120]: I0316 16:26:49.417104 5120 generic.go:358] "Generic (PLEG): container finished" podID="ee9a1dc2-769e-4d3f-a1e0-f1b78c45403a" containerID="f51f8fa918e46f66dcfe0379ccbb4cef96ae9898149769bf5afa18f743414fdd" exitCode=0 Mar 16 16:26:49 crc kubenswrapper[5120]: I0316 16:26:49.417209 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-pv6tf" event={"ID":"ee9a1dc2-769e-4d3f-a1e0-f1b78c45403a","Type":"ContainerDied","Data":"f51f8fa918e46f66dcfe0379ccbb4cef96ae9898149769bf5afa18f743414fdd"} Mar 16 16:26:49 crc kubenswrapper[5120]: I0316 16:26:49.421190 5120 generic.go:358] "Generic (PLEG): container finished" podID="67d3df0a-9de1-42e6-94b0-82bc99459ebf" containerID="0231acb944f49e21e9ebc6ad7724f5c2377405b925dc980593b0e6fb0c965404" exitCode=0 Mar 16 16:26:49 crc kubenswrapper[5120]: I0316 16:26:49.421360 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-7zwsz" event={"ID":"67d3df0a-9de1-42e6-94b0-82bc99459ebf","Type":"ContainerDied","Data":"0231acb944f49e21e9ebc6ad7724f5c2377405b925dc980593b0e6fb0c965404"} Mar 16 16:26:49 crc kubenswrapper[5120]: I0316 16:26:49.427346 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:26:49 crc kubenswrapper[5120]: I0316 16:26:49.449972 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.240657845 podStartE2EDuration="7.44994789s" podCreationTimestamp="2026-03-16 16:26:42 +0000 UTC" firstStartedPulling="2026-03-16 16:26:43.461024963 +0000 UTC m=+3305.614956620" lastFinishedPulling="2026-03-16 16:26:48.670315008 +0000 UTC m=+3310.824246665" observedRunningTime="2026-03-16 16:26:49.449407366 +0000 UTC m=+3311.603339023" watchObservedRunningTime="2026-03-16 16:26:49.44994789 +0000 UTC m=+3311.603879537" Mar 16 16:26:49 crc kubenswrapper[5120]: I0316 16:26:49.607839 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:26:49 crc kubenswrapper[5120]: I0316 16:26:49.621637 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:26:49 crc kubenswrapper[5120]: I0316 16:26:49.637005 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:26:49 crc kubenswrapper[5120]: I0316 16:26:49.638847 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="302e89b7-5873-4304-8374-e8de012542fd" containerName="glance-httpd" Mar 16 16:26:49 crc kubenswrapper[5120]: I0316 16:26:49.638947 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="302e89b7-5873-4304-8374-e8de012542fd" containerName="glance-httpd" Mar 16 16:26:49 crc kubenswrapper[5120]: I0316 16:26:49.639032 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="302e89b7-5873-4304-8374-e8de012542fd" containerName="glance-log" Mar 16 16:26:49 crc kubenswrapper[5120]: I0316 16:26:49.639096 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="302e89b7-5873-4304-8374-e8de012542fd" containerName="glance-log" Mar 16 16:26:49 crc kubenswrapper[5120]: I0316 16:26:49.639183 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f19bb00-3a90-4acf-8ffb-3b7cc1070d77" containerName="glance-httpd" Mar 16 16:26:49 crc kubenswrapper[5120]: I0316 16:26:49.639240 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f19bb00-3a90-4acf-8ffb-3b7cc1070d77" containerName="glance-httpd" Mar 16 16:26:49 crc kubenswrapper[5120]: I0316 16:26:49.639308 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f19bb00-3a90-4acf-8ffb-3b7cc1070d77" containerName="glance-log" Mar 16 16:26:49 crc kubenswrapper[5120]: I0316 16:26:49.639358 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f19bb00-3a90-4acf-8ffb-3b7cc1070d77" containerName="glance-log" Mar 16 16:26:49 crc kubenswrapper[5120]: I0316 16:26:49.639580 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="302e89b7-5873-4304-8374-e8de012542fd" containerName="glance-httpd" Mar 16 16:26:49 crc kubenswrapper[5120]: I0316 16:26:49.639658 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="8f19bb00-3a90-4acf-8ffb-3b7cc1070d77" containerName="glance-httpd" Mar 16 16:26:49 crc kubenswrapper[5120]: I0316 16:26:49.639725 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="302e89b7-5873-4304-8374-e8de012542fd" containerName="glance-log" Mar 16 16:26:49 crc kubenswrapper[5120]: I0316 16:26:49.639802 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="8f19bb00-3a90-4acf-8ffb-3b7cc1070d77" containerName="glance-log" Mar 16 16:26:49 crc kubenswrapper[5120]: I0316 16:26:49.646539 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:26:49 crc kubenswrapper[5120]: I0316 16:26:49.646842 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:26:49 crc kubenswrapper[5120]: I0316 16:26:49.649870 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-scripts\"" Mar 16 16:26:49 crc kubenswrapper[5120]: I0316 16:26:49.650193 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-external-config-data\"" Mar 16 16:26:49 crc kubenswrapper[5120]: I0316 16:26:49.650346 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-glance-dockercfg-lfz7m\"" Mar 16 16:26:49 crc kubenswrapper[5120]: I0316 16:26:49.650464 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-public-svc\"" Mar 16 16:26:49 crc kubenswrapper[5120]: I0316 16:26:49.816260 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/d4a84888-a119-4cef-9709-e47200b01990-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"d4a84888-a119-4cef-9709-e47200b01990\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:26:49 crc kubenswrapper[5120]: I0316 16:26:49.816352 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d4a84888-a119-4cef-9709-e47200b01990-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"d4a84888-a119-4cef-9709-e47200b01990\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:26:49 crc kubenswrapper[5120]: I0316 16:26:49.816425 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5w85\" (UniqueName: \"kubernetes.io/projected/d4a84888-a119-4cef-9709-e47200b01990-kube-api-access-p5w85\") pod \"glance-default-external-api-0\" (UID: \"d4a84888-a119-4cef-9709-e47200b01990\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:26:49 crc kubenswrapper[5120]: I0316 16:26:49.816476 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d4a84888-a119-4cef-9709-e47200b01990-scripts\") pod \"glance-default-external-api-0\" (UID: \"d4a84888-a119-4cef-9709-e47200b01990\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:26:49 crc kubenswrapper[5120]: I0316 16:26:49.816536 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d4a84888-a119-4cef-9709-e47200b01990-config-data\") pod \"glance-default-external-api-0\" (UID: \"d4a84888-a119-4cef-9709-e47200b01990\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:26:49 crc kubenswrapper[5120]: I0316 16:26:49.816711 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d4a84888-a119-4cef-9709-e47200b01990-logs\") pod \"glance-default-external-api-0\" (UID: \"d4a84888-a119-4cef-9709-e47200b01990\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:26:49 crc kubenswrapper[5120]: I0316 16:26:49.816797 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"glance-default-external-api-0\" (UID: \"d4a84888-a119-4cef-9709-e47200b01990\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:26:49 crc kubenswrapper[5120]: I0316 16:26:49.816832 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/d4a84888-a119-4cef-9709-e47200b01990-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"d4a84888-a119-4cef-9709-e47200b01990\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:26:49 crc kubenswrapper[5120]: I0316 16:26:49.918915 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d4a84888-a119-4cef-9709-e47200b01990-logs\") pod \"glance-default-external-api-0\" (UID: \"d4a84888-a119-4cef-9709-e47200b01990\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:26:49 crc kubenswrapper[5120]: I0316 16:26:49.919029 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"glance-default-external-api-0\" (UID: \"d4a84888-a119-4cef-9709-e47200b01990\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:26:49 crc kubenswrapper[5120]: I0316 16:26:49.919075 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/d4a84888-a119-4cef-9709-e47200b01990-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"d4a84888-a119-4cef-9709-e47200b01990\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:26:49 crc kubenswrapper[5120]: I0316 16:26:49.919126 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/d4a84888-a119-4cef-9709-e47200b01990-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"d4a84888-a119-4cef-9709-e47200b01990\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:26:49 crc kubenswrapper[5120]: I0316 16:26:49.919188 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d4a84888-a119-4cef-9709-e47200b01990-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"d4a84888-a119-4cef-9709-e47200b01990\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:26:49 crc kubenswrapper[5120]: I0316 16:26:49.919290 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p5w85\" (UniqueName: \"kubernetes.io/projected/d4a84888-a119-4cef-9709-e47200b01990-kube-api-access-p5w85\") pod \"glance-default-external-api-0\" (UID: \"d4a84888-a119-4cef-9709-e47200b01990\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:26:49 crc kubenswrapper[5120]: I0316 16:26:49.919334 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"glance-default-external-api-0\" (UID: \"d4a84888-a119-4cef-9709-e47200b01990\") device mount path \"/mnt/openstack/pv20\"" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:26:49 crc kubenswrapper[5120]: I0316 16:26:49.919354 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d4a84888-a119-4cef-9709-e47200b01990-scripts\") pod \"glance-default-external-api-0\" (UID: \"d4a84888-a119-4cef-9709-e47200b01990\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:26:49 crc kubenswrapper[5120]: I0316 16:26:49.919657 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/d4a84888-a119-4cef-9709-e47200b01990-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"d4a84888-a119-4cef-9709-e47200b01990\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:26:49 crc kubenswrapper[5120]: I0316 16:26:49.919664 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d4a84888-a119-4cef-9709-e47200b01990-config-data\") pod \"glance-default-external-api-0\" (UID: \"d4a84888-a119-4cef-9709-e47200b01990\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:26:49 crc kubenswrapper[5120]: I0316 16:26:49.920252 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d4a84888-a119-4cef-9709-e47200b01990-logs\") pod \"glance-default-external-api-0\" (UID: \"d4a84888-a119-4cef-9709-e47200b01990\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:26:49 crc kubenswrapper[5120]: I0316 16:26:49.927656 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d4a84888-a119-4cef-9709-e47200b01990-scripts\") pod \"glance-default-external-api-0\" (UID: \"d4a84888-a119-4cef-9709-e47200b01990\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:26:49 crc kubenswrapper[5120]: I0316 16:26:49.928859 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d4a84888-a119-4cef-9709-e47200b01990-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"d4a84888-a119-4cef-9709-e47200b01990\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:26:49 crc kubenswrapper[5120]: I0316 16:26:49.929545 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/d4a84888-a119-4cef-9709-e47200b01990-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"d4a84888-a119-4cef-9709-e47200b01990\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:26:49 crc kubenswrapper[5120]: I0316 16:26:49.932854 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d4a84888-a119-4cef-9709-e47200b01990-config-data\") pod \"glance-default-external-api-0\" (UID: \"d4a84888-a119-4cef-9709-e47200b01990\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:26:49 crc kubenswrapper[5120]: I0316 16:26:49.942673 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5w85\" (UniqueName: \"kubernetes.io/projected/d4a84888-a119-4cef-9709-e47200b01990-kube-api-access-p5w85\") pod \"glance-default-external-api-0\" (UID: \"d4a84888-a119-4cef-9709-e47200b01990\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:26:49 crc kubenswrapper[5120]: I0316 16:26:49.956041 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"glance-default-external-api-0\" (UID: \"d4a84888-a119-4cef-9709-e47200b01990\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:26:49 crc kubenswrapper[5120]: I0316 16:26:49.972812 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.240018 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.327952 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0bd49631-00e4-430c-9659-1f0e7805900a-scripts\") pod \"0bd49631-00e4-430c-9659-1f0e7805900a\" (UID: \"0bd49631-00e4-430c-9659-1f0e7805900a\") " Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.328148 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0bd49631-00e4-430c-9659-1f0e7805900a-log-httpd\") pod \"0bd49631-00e4-430c-9659-1f0e7805900a\" (UID: \"0bd49631-00e4-430c-9659-1f0e7805900a\") " Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.328277 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0bd49631-00e4-430c-9659-1f0e7805900a-run-httpd\") pod \"0bd49631-00e4-430c-9659-1f0e7805900a\" (UID: \"0bd49631-00e4-430c-9659-1f0e7805900a\") " Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.328345 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/0bd49631-00e4-430c-9659-1f0e7805900a-sg-core-conf-yaml\") pod \"0bd49631-00e4-430c-9659-1f0e7805900a\" (UID: \"0bd49631-00e4-430c-9659-1f0e7805900a\") " Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.328473 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dnhs5\" (UniqueName: \"kubernetes.io/projected/0bd49631-00e4-430c-9659-1f0e7805900a-kube-api-access-dnhs5\") pod \"0bd49631-00e4-430c-9659-1f0e7805900a\" (UID: \"0bd49631-00e4-430c-9659-1f0e7805900a\") " Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.328629 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0bd49631-00e4-430c-9659-1f0e7805900a-combined-ca-bundle\") pod \"0bd49631-00e4-430c-9659-1f0e7805900a\" (UID: \"0bd49631-00e4-430c-9659-1f0e7805900a\") " Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.328699 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0bd49631-00e4-430c-9659-1f0e7805900a-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "0bd49631-00e4-430c-9659-1f0e7805900a" (UID: "0bd49631-00e4-430c-9659-1f0e7805900a"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.328740 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0bd49631-00e4-430c-9659-1f0e7805900a-config-data\") pod \"0bd49631-00e4-430c-9659-1f0e7805900a\" (UID: \"0bd49631-00e4-430c-9659-1f0e7805900a\") " Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.329675 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0bd49631-00e4-430c-9659-1f0e7805900a-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.331810 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0bd49631-00e4-430c-9659-1f0e7805900a-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "0bd49631-00e4-430c-9659-1f0e7805900a" (UID: "0bd49631-00e4-430c-9659-1f0e7805900a"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.333912 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0bd49631-00e4-430c-9659-1f0e7805900a-scripts" (OuterVolumeSpecName: "scripts") pod "0bd49631-00e4-430c-9659-1f0e7805900a" (UID: "0bd49631-00e4-430c-9659-1f0e7805900a"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.335174 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0bd49631-00e4-430c-9659-1f0e7805900a-kube-api-access-dnhs5" (OuterVolumeSpecName: "kube-api-access-dnhs5") pod "0bd49631-00e4-430c-9659-1f0e7805900a" (UID: "0bd49631-00e4-430c-9659-1f0e7805900a"). InnerVolumeSpecName "kube-api-access-dnhs5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.358064 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0bd49631-00e4-430c-9659-1f0e7805900a-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "0bd49631-00e4-430c-9659-1f0e7805900a" (UID: "0bd49631-00e4-430c-9659-1f0e7805900a"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.414218 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0bd49631-00e4-430c-9659-1f0e7805900a-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "0bd49631-00e4-430c-9659-1f0e7805900a" (UID: "0bd49631-00e4-430c-9659-1f0e7805900a"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.431340 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0bd49631-00e4-430c-9659-1f0e7805900a-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.431374 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0bd49631-00e4-430c-9659-1f0e7805900a-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.431384 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0bd49631-00e4-430c-9659-1f0e7805900a-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.431392 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/0bd49631-00e4-430c-9659-1f0e7805900a-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.431401 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dnhs5\" (UniqueName: \"kubernetes.io/projected/0bd49631-00e4-430c-9659-1f0e7805900a-kube-api-access-dnhs5\") on node \"crc\" DevicePath \"\"" Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.440492 5120 generic.go:358] "Generic (PLEG): container finished" podID="f793dd8c-d824-4c26-9f17-848b016fe52b" containerID="b4c6fc265a60fa84278a8d1b2948bc5d22f504d8dffaa7a10b8773c37fe8f551" exitCode=0 Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.440572 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-bkr9j" event={"ID":"f793dd8c-d824-4c26-9f17-848b016fe52b","Type":"ContainerDied","Data":"b4c6fc265a60fa84278a8d1b2948bc5d22f504d8dffaa7a10b8773c37fe8f551"} Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.444921 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0bd49631-00e4-430c-9659-1f0e7805900a-config-data" (OuterVolumeSpecName: "config-data") pod "0bd49631-00e4-430c-9659-1f0e7805900a" (UID: "0bd49631-00e4-430c-9659-1f0e7805900a"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.445027 5120 generic.go:358] "Generic (PLEG): container finished" podID="0bd49631-00e4-430c-9659-1f0e7805900a" containerID="d25c901c17ba55401a5b994fc46dfc911c2e62b7acb1deefab504b6f54cbd94c" exitCode=0 Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.445049 5120 generic.go:358] "Generic (PLEG): container finished" podID="0bd49631-00e4-430c-9659-1f0e7805900a" containerID="adbc0eb0a8bbe7d940bc6ca7568f8d504cab99b4f41692382e1aa252860a5336" exitCode=2 Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.445058 5120 generic.go:358] "Generic (PLEG): container finished" podID="0bd49631-00e4-430c-9659-1f0e7805900a" containerID="efb990183025bc9af58f113dfda3deb92e18e00a232b4bb5f7697ff4539fdc1d" exitCode=0 Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.445064 5120 generic.go:358] "Generic (PLEG): container finished" podID="0bd49631-00e4-430c-9659-1f0e7805900a" containerID="c263e036f554f134259b0c995982fb435f70c80c1c219381ef77a1450b65a8c6" exitCode=0 Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.445415 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.445465 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"0bd49631-00e4-430c-9659-1f0e7805900a","Type":"ContainerDied","Data":"d25c901c17ba55401a5b994fc46dfc911c2e62b7acb1deefab504b6f54cbd94c"} Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.445501 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"0bd49631-00e4-430c-9659-1f0e7805900a","Type":"ContainerDied","Data":"adbc0eb0a8bbe7d940bc6ca7568f8d504cab99b4f41692382e1aa252860a5336"} Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.445514 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"0bd49631-00e4-430c-9659-1f0e7805900a","Type":"ContainerDied","Data":"efb990183025bc9af58f113dfda3deb92e18e00a232b4bb5f7697ff4539fdc1d"} Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.445525 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"0bd49631-00e4-430c-9659-1f0e7805900a","Type":"ContainerDied","Data":"c263e036f554f134259b0c995982fb435f70c80c1c219381ef77a1450b65a8c6"} Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.445537 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"0bd49631-00e4-430c-9659-1f0e7805900a","Type":"ContainerDied","Data":"f9b962224786a28ea388f53fc8f7f78072a05aefcf43baf41467d0cb0b47062a"} Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.445556 5120 scope.go:117] "RemoveContainer" containerID="d25c901c17ba55401a5b994fc46dfc911c2e62b7acb1deefab504b6f54cbd94c" Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.473011 5120 scope.go:117] "RemoveContainer" containerID="adbc0eb0a8bbe7d940bc6ca7568f8d504cab99b4f41692382e1aa252860a5336" Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.488150 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.499747 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.524275 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.533843 5120 scope.go:117] "RemoveContainer" containerID="efb990183025bc9af58f113dfda3deb92e18e00a232b4bb5f7697ff4539fdc1d" Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.534430 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.535194 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0bd49631-00e4-430c-9659-1f0e7805900a-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.536487 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0bd49631-00e4-430c-9659-1f0e7805900a" containerName="ceilometer-central-agent" Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.536509 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="0bd49631-00e4-430c-9659-1f0e7805900a" containerName="ceilometer-central-agent" Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.536572 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0bd49631-00e4-430c-9659-1f0e7805900a" containerName="sg-core" Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.536581 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="0bd49631-00e4-430c-9659-1f0e7805900a" containerName="sg-core" Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.536705 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0bd49631-00e4-430c-9659-1f0e7805900a" containerName="proxy-httpd" Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.536716 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="0bd49631-00e4-430c-9659-1f0e7805900a" containerName="proxy-httpd" Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.536733 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0bd49631-00e4-430c-9659-1f0e7805900a" containerName="ceilometer-notification-agent" Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.536742 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="0bd49631-00e4-430c-9659-1f0e7805900a" containerName="ceilometer-notification-agent" Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.537062 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="0bd49631-00e4-430c-9659-1f0e7805900a" containerName="ceilometer-central-agent" Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.537119 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="0bd49631-00e4-430c-9659-1f0e7805900a" containerName="sg-core" Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.537133 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="0bd49631-00e4-430c-9659-1f0e7805900a" containerName="proxy-httpd" Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.537146 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="0bd49631-00e4-430c-9659-1f0e7805900a" containerName="ceilometer-notification-agent" Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.549193 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.551028 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.553382 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.553599 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.637589 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/0a40a3c3-a3dd-4903-8ca3-dd81b5cc204b-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"0a40a3c3-a3dd-4903-8ca3-dd81b5cc204b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.637932 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0a40a3c3-a3dd-4903-8ca3-dd81b5cc204b-run-httpd\") pod \"ceilometer-0\" (UID: \"0a40a3c3-a3dd-4903-8ca3-dd81b5cc204b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.637962 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0a40a3c3-a3dd-4903-8ca3-dd81b5cc204b-log-httpd\") pod \"ceilometer-0\" (UID: \"0a40a3c3-a3dd-4903-8ca3-dd81b5cc204b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.638080 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0a40a3c3-a3dd-4903-8ca3-dd81b5cc204b-config-data\") pod \"ceilometer-0\" (UID: \"0a40a3c3-a3dd-4903-8ca3-dd81b5cc204b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.638099 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rh264\" (UniqueName: \"kubernetes.io/projected/0a40a3c3-a3dd-4903-8ca3-dd81b5cc204b-kube-api-access-rh264\") pod \"ceilometer-0\" (UID: \"0a40a3c3-a3dd-4903-8ca3-dd81b5cc204b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.638224 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0a40a3c3-a3dd-4903-8ca3-dd81b5cc204b-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"0a40a3c3-a3dd-4903-8ca3-dd81b5cc204b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.638238 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0a40a3c3-a3dd-4903-8ca3-dd81b5cc204b-scripts\") pod \"ceilometer-0\" (UID: \"0a40a3c3-a3dd-4903-8ca3-dd81b5cc204b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.682995 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0bd49631-00e4-430c-9659-1f0e7805900a" path="/var/lib/kubelet/pods/0bd49631-00e4-430c-9659-1f0e7805900a/volumes" Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.683966 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="302e89b7-5873-4304-8374-e8de012542fd" path="/var/lib/kubelet/pods/302e89b7-5873-4304-8374-e8de012542fd/volumes" Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.717342 5120 scope.go:117] "RemoveContainer" containerID="c263e036f554f134259b0c995982fb435f70c80c1c219381ef77a1450b65a8c6" Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.740586 5120 scope.go:117] "RemoveContainer" containerID="d25c901c17ba55401a5b994fc46dfc911c2e62b7acb1deefab504b6f54cbd94c" Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.742626 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0a40a3c3-a3dd-4903-8ca3-dd81b5cc204b-config-data\") pod \"ceilometer-0\" (UID: \"0a40a3c3-a3dd-4903-8ca3-dd81b5cc204b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.742668 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rh264\" (UniqueName: \"kubernetes.io/projected/0a40a3c3-a3dd-4903-8ca3-dd81b5cc204b-kube-api-access-rh264\") pod \"ceilometer-0\" (UID: \"0a40a3c3-a3dd-4903-8ca3-dd81b5cc204b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.742954 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0a40a3c3-a3dd-4903-8ca3-dd81b5cc204b-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"0a40a3c3-a3dd-4903-8ca3-dd81b5cc204b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.742975 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0a40a3c3-a3dd-4903-8ca3-dd81b5cc204b-scripts\") pod \"ceilometer-0\" (UID: \"0a40a3c3-a3dd-4903-8ca3-dd81b5cc204b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.743032 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/0a40a3c3-a3dd-4903-8ca3-dd81b5cc204b-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"0a40a3c3-a3dd-4903-8ca3-dd81b5cc204b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.743094 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0a40a3c3-a3dd-4903-8ca3-dd81b5cc204b-run-httpd\") pod \"ceilometer-0\" (UID: \"0a40a3c3-a3dd-4903-8ca3-dd81b5cc204b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.743137 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0a40a3c3-a3dd-4903-8ca3-dd81b5cc204b-log-httpd\") pod \"ceilometer-0\" (UID: \"0a40a3c3-a3dd-4903-8ca3-dd81b5cc204b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:26:50 crc kubenswrapper[5120]: E0316 16:26:50.743343 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d25c901c17ba55401a5b994fc46dfc911c2e62b7acb1deefab504b6f54cbd94c\": container with ID starting with d25c901c17ba55401a5b994fc46dfc911c2e62b7acb1deefab504b6f54cbd94c not found: ID does not exist" containerID="d25c901c17ba55401a5b994fc46dfc911c2e62b7acb1deefab504b6f54cbd94c" Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.743383 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d25c901c17ba55401a5b994fc46dfc911c2e62b7acb1deefab504b6f54cbd94c"} err="failed to get container status \"d25c901c17ba55401a5b994fc46dfc911c2e62b7acb1deefab504b6f54cbd94c\": rpc error: code = NotFound desc = could not find container \"d25c901c17ba55401a5b994fc46dfc911c2e62b7acb1deefab504b6f54cbd94c\": container with ID starting with d25c901c17ba55401a5b994fc46dfc911c2e62b7acb1deefab504b6f54cbd94c not found: ID does not exist" Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.743408 5120 scope.go:117] "RemoveContainer" containerID="adbc0eb0a8bbe7d940bc6ca7568f8d504cab99b4f41692382e1aa252860a5336" Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.743567 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0a40a3c3-a3dd-4903-8ca3-dd81b5cc204b-log-httpd\") pod \"ceilometer-0\" (UID: \"0a40a3c3-a3dd-4903-8ca3-dd81b5cc204b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.745609 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0a40a3c3-a3dd-4903-8ca3-dd81b5cc204b-run-httpd\") pod \"ceilometer-0\" (UID: \"0a40a3c3-a3dd-4903-8ca3-dd81b5cc204b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:26:50 crc kubenswrapper[5120]: E0316 16:26:50.748293 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"adbc0eb0a8bbe7d940bc6ca7568f8d504cab99b4f41692382e1aa252860a5336\": container with ID starting with adbc0eb0a8bbe7d940bc6ca7568f8d504cab99b4f41692382e1aa252860a5336 not found: ID does not exist" containerID="adbc0eb0a8bbe7d940bc6ca7568f8d504cab99b4f41692382e1aa252860a5336" Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.748339 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"adbc0eb0a8bbe7d940bc6ca7568f8d504cab99b4f41692382e1aa252860a5336"} err="failed to get container status \"adbc0eb0a8bbe7d940bc6ca7568f8d504cab99b4f41692382e1aa252860a5336\": rpc error: code = NotFound desc = could not find container \"adbc0eb0a8bbe7d940bc6ca7568f8d504cab99b4f41692382e1aa252860a5336\": container with ID starting with adbc0eb0a8bbe7d940bc6ca7568f8d504cab99b4f41692382e1aa252860a5336 not found: ID does not exist" Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.748368 5120 scope.go:117] "RemoveContainer" containerID="efb990183025bc9af58f113dfda3deb92e18e00a232b4bb5f7697ff4539fdc1d" Mar 16 16:26:50 crc kubenswrapper[5120]: E0316 16:26:50.750471 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"efb990183025bc9af58f113dfda3deb92e18e00a232b4bb5f7697ff4539fdc1d\": container with ID starting with efb990183025bc9af58f113dfda3deb92e18e00a232b4bb5f7697ff4539fdc1d not found: ID does not exist" containerID="efb990183025bc9af58f113dfda3deb92e18e00a232b4bb5f7697ff4539fdc1d" Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.750511 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"efb990183025bc9af58f113dfda3deb92e18e00a232b4bb5f7697ff4539fdc1d"} err="failed to get container status \"efb990183025bc9af58f113dfda3deb92e18e00a232b4bb5f7697ff4539fdc1d\": rpc error: code = NotFound desc = could not find container \"efb990183025bc9af58f113dfda3deb92e18e00a232b4bb5f7697ff4539fdc1d\": container with ID starting with efb990183025bc9af58f113dfda3deb92e18e00a232b4bb5f7697ff4539fdc1d not found: ID does not exist" Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.750532 5120 scope.go:117] "RemoveContainer" containerID="c263e036f554f134259b0c995982fb435f70c80c1c219381ef77a1450b65a8c6" Mar 16 16:26:50 crc kubenswrapper[5120]: E0316 16:26:50.752084 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c263e036f554f134259b0c995982fb435f70c80c1c219381ef77a1450b65a8c6\": container with ID starting with c263e036f554f134259b0c995982fb435f70c80c1c219381ef77a1450b65a8c6 not found: ID does not exist" containerID="c263e036f554f134259b0c995982fb435f70c80c1c219381ef77a1450b65a8c6" Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.752116 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c263e036f554f134259b0c995982fb435f70c80c1c219381ef77a1450b65a8c6"} err="failed to get container status \"c263e036f554f134259b0c995982fb435f70c80c1c219381ef77a1450b65a8c6\": rpc error: code = NotFound desc = could not find container \"c263e036f554f134259b0c995982fb435f70c80c1c219381ef77a1450b65a8c6\": container with ID starting with c263e036f554f134259b0c995982fb435f70c80c1c219381ef77a1450b65a8c6 not found: ID does not exist" Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.752136 5120 scope.go:117] "RemoveContainer" containerID="d25c901c17ba55401a5b994fc46dfc911c2e62b7acb1deefab504b6f54cbd94c" Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.756652 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/0a40a3c3-a3dd-4903-8ca3-dd81b5cc204b-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"0a40a3c3-a3dd-4903-8ca3-dd81b5cc204b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.757248 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0a40a3c3-a3dd-4903-8ca3-dd81b5cc204b-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"0a40a3c3-a3dd-4903-8ca3-dd81b5cc204b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.759715 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0a40a3c3-a3dd-4903-8ca3-dd81b5cc204b-config-data\") pod \"ceilometer-0\" (UID: \"0a40a3c3-a3dd-4903-8ca3-dd81b5cc204b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.764505 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0a40a3c3-a3dd-4903-8ca3-dd81b5cc204b-scripts\") pod \"ceilometer-0\" (UID: \"0a40a3c3-a3dd-4903-8ca3-dd81b5cc204b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.769778 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rh264\" (UniqueName: \"kubernetes.io/projected/0a40a3c3-a3dd-4903-8ca3-dd81b5cc204b-kube-api-access-rh264\") pod \"ceilometer-0\" (UID: \"0a40a3c3-a3dd-4903-8ca3-dd81b5cc204b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.794689 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d25c901c17ba55401a5b994fc46dfc911c2e62b7acb1deefab504b6f54cbd94c"} err="failed to get container status \"d25c901c17ba55401a5b994fc46dfc911c2e62b7acb1deefab504b6f54cbd94c\": rpc error: code = NotFound desc = could not find container \"d25c901c17ba55401a5b994fc46dfc911c2e62b7acb1deefab504b6f54cbd94c\": container with ID starting with d25c901c17ba55401a5b994fc46dfc911c2e62b7acb1deefab504b6f54cbd94c not found: ID does not exist" Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.794764 5120 scope.go:117] "RemoveContainer" containerID="adbc0eb0a8bbe7d940bc6ca7568f8d504cab99b4f41692382e1aa252860a5336" Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.795733 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"adbc0eb0a8bbe7d940bc6ca7568f8d504cab99b4f41692382e1aa252860a5336"} err="failed to get container status \"adbc0eb0a8bbe7d940bc6ca7568f8d504cab99b4f41692382e1aa252860a5336\": rpc error: code = NotFound desc = could not find container \"adbc0eb0a8bbe7d940bc6ca7568f8d504cab99b4f41692382e1aa252860a5336\": container with ID starting with adbc0eb0a8bbe7d940bc6ca7568f8d504cab99b4f41692382e1aa252860a5336 not found: ID does not exist" Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.795779 5120 scope.go:117] "RemoveContainer" containerID="efb990183025bc9af58f113dfda3deb92e18e00a232b4bb5f7697ff4539fdc1d" Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.796274 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"efb990183025bc9af58f113dfda3deb92e18e00a232b4bb5f7697ff4539fdc1d"} err="failed to get container status \"efb990183025bc9af58f113dfda3deb92e18e00a232b4bb5f7697ff4539fdc1d\": rpc error: code = NotFound desc = could not find container \"efb990183025bc9af58f113dfda3deb92e18e00a232b4bb5f7697ff4539fdc1d\": container with ID starting with efb990183025bc9af58f113dfda3deb92e18e00a232b4bb5f7697ff4539fdc1d not found: ID does not exist" Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.796294 5120 scope.go:117] "RemoveContainer" containerID="c263e036f554f134259b0c995982fb435f70c80c1c219381ef77a1450b65a8c6" Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.796486 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c263e036f554f134259b0c995982fb435f70c80c1c219381ef77a1450b65a8c6"} err="failed to get container status \"c263e036f554f134259b0c995982fb435f70c80c1c219381ef77a1450b65a8c6\": rpc error: code = NotFound desc = could not find container \"c263e036f554f134259b0c995982fb435f70c80c1c219381ef77a1450b65a8c6\": container with ID starting with c263e036f554f134259b0c995982fb435f70c80c1c219381ef77a1450b65a8c6 not found: ID does not exist" Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.796510 5120 scope.go:117] "RemoveContainer" containerID="d25c901c17ba55401a5b994fc46dfc911c2e62b7acb1deefab504b6f54cbd94c" Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.796989 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d25c901c17ba55401a5b994fc46dfc911c2e62b7acb1deefab504b6f54cbd94c"} err="failed to get container status \"d25c901c17ba55401a5b994fc46dfc911c2e62b7acb1deefab504b6f54cbd94c\": rpc error: code = NotFound desc = could not find container \"d25c901c17ba55401a5b994fc46dfc911c2e62b7acb1deefab504b6f54cbd94c\": container with ID starting with d25c901c17ba55401a5b994fc46dfc911c2e62b7acb1deefab504b6f54cbd94c not found: ID does not exist" Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.797011 5120 scope.go:117] "RemoveContainer" containerID="adbc0eb0a8bbe7d940bc6ca7568f8d504cab99b4f41692382e1aa252860a5336" Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.799697 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"adbc0eb0a8bbe7d940bc6ca7568f8d504cab99b4f41692382e1aa252860a5336"} err="failed to get container status \"adbc0eb0a8bbe7d940bc6ca7568f8d504cab99b4f41692382e1aa252860a5336\": rpc error: code = NotFound desc = could not find container \"adbc0eb0a8bbe7d940bc6ca7568f8d504cab99b4f41692382e1aa252860a5336\": container with ID starting with adbc0eb0a8bbe7d940bc6ca7568f8d504cab99b4f41692382e1aa252860a5336 not found: ID does not exist" Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.799736 5120 scope.go:117] "RemoveContainer" containerID="efb990183025bc9af58f113dfda3deb92e18e00a232b4bb5f7697ff4539fdc1d" Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.800293 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"efb990183025bc9af58f113dfda3deb92e18e00a232b4bb5f7697ff4539fdc1d"} err="failed to get container status \"efb990183025bc9af58f113dfda3deb92e18e00a232b4bb5f7697ff4539fdc1d\": rpc error: code = NotFound desc = could not find container \"efb990183025bc9af58f113dfda3deb92e18e00a232b4bb5f7697ff4539fdc1d\": container with ID starting with efb990183025bc9af58f113dfda3deb92e18e00a232b4bb5f7697ff4539fdc1d not found: ID does not exist" Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.800353 5120 scope.go:117] "RemoveContainer" containerID="c263e036f554f134259b0c995982fb435f70c80c1c219381ef77a1450b65a8c6" Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.801155 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c263e036f554f134259b0c995982fb435f70c80c1c219381ef77a1450b65a8c6"} err="failed to get container status \"c263e036f554f134259b0c995982fb435f70c80c1c219381ef77a1450b65a8c6\": rpc error: code = NotFound desc = could not find container \"c263e036f554f134259b0c995982fb435f70c80c1c219381ef77a1450b65a8c6\": container with ID starting with c263e036f554f134259b0c995982fb435f70c80c1c219381ef77a1450b65a8c6 not found: ID does not exist" Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.801181 5120 scope.go:117] "RemoveContainer" containerID="d25c901c17ba55401a5b994fc46dfc911c2e62b7acb1deefab504b6f54cbd94c" Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.802588 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d25c901c17ba55401a5b994fc46dfc911c2e62b7acb1deefab504b6f54cbd94c"} err="failed to get container status \"d25c901c17ba55401a5b994fc46dfc911c2e62b7acb1deefab504b6f54cbd94c\": rpc error: code = NotFound desc = could not find container \"d25c901c17ba55401a5b994fc46dfc911c2e62b7acb1deefab504b6f54cbd94c\": container with ID starting with d25c901c17ba55401a5b994fc46dfc911c2e62b7acb1deefab504b6f54cbd94c not found: ID does not exist" Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.802617 5120 scope.go:117] "RemoveContainer" containerID="adbc0eb0a8bbe7d940bc6ca7568f8d504cab99b4f41692382e1aa252860a5336" Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.803147 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"adbc0eb0a8bbe7d940bc6ca7568f8d504cab99b4f41692382e1aa252860a5336"} err="failed to get container status \"adbc0eb0a8bbe7d940bc6ca7568f8d504cab99b4f41692382e1aa252860a5336\": rpc error: code = NotFound desc = could not find container \"adbc0eb0a8bbe7d940bc6ca7568f8d504cab99b4f41692382e1aa252860a5336\": container with ID starting with adbc0eb0a8bbe7d940bc6ca7568f8d504cab99b4f41692382e1aa252860a5336 not found: ID does not exist" Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.803168 5120 scope.go:117] "RemoveContainer" containerID="efb990183025bc9af58f113dfda3deb92e18e00a232b4bb5f7697ff4539fdc1d" Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.804334 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"efb990183025bc9af58f113dfda3deb92e18e00a232b4bb5f7697ff4539fdc1d"} err="failed to get container status \"efb990183025bc9af58f113dfda3deb92e18e00a232b4bb5f7697ff4539fdc1d\": rpc error: code = NotFound desc = could not find container \"efb990183025bc9af58f113dfda3deb92e18e00a232b4bb5f7697ff4539fdc1d\": container with ID starting with efb990183025bc9af58f113dfda3deb92e18e00a232b4bb5f7697ff4539fdc1d not found: ID does not exist" Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.804358 5120 scope.go:117] "RemoveContainer" containerID="c263e036f554f134259b0c995982fb435f70c80c1c219381ef77a1450b65a8c6" Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.804643 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c263e036f554f134259b0c995982fb435f70c80c1c219381ef77a1450b65a8c6"} err="failed to get container status \"c263e036f554f134259b0c995982fb435f70c80c1c219381ef77a1450b65a8c6\": rpc error: code = NotFound desc = could not find container \"c263e036f554f134259b0c995982fb435f70c80c1c219381ef77a1450b65a8c6\": container with ID starting with c263e036f554f134259b0c995982fb435f70c80c1c219381ef77a1450b65a8c6 not found: ID does not exist" Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.910767 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-7zwsz" Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.936617 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-pv6tf" Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.945413 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/67d3df0a-9de1-42e6-94b0-82bc99459ebf-scripts\") pod \"67d3df0a-9de1-42e6-94b0-82bc99459ebf\" (UID: \"67d3df0a-9de1-42e6-94b0-82bc99459ebf\") " Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.945462 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/67d3df0a-9de1-42e6-94b0-82bc99459ebf-config-data\") pod \"67d3df0a-9de1-42e6-94b0-82bc99459ebf\" (UID: \"67d3df0a-9de1-42e6-94b0-82bc99459ebf\") " Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.945971 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ee9a1dc2-769e-4d3f-a1e0-f1b78c45403a-combined-ca-bundle\") pod \"ee9a1dc2-769e-4d3f-a1e0-f1b78c45403a\" (UID: \"ee9a1dc2-769e-4d3f-a1e0-f1b78c45403a\") " Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.946027 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/67d3df0a-9de1-42e6-94b0-82bc99459ebf-fernet-keys\") pod \"67d3df0a-9de1-42e6-94b0-82bc99459ebf\" (UID: \"67d3df0a-9de1-42e6-94b0-82bc99459ebf\") " Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.946064 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/67d3df0a-9de1-42e6-94b0-82bc99459ebf-combined-ca-bundle\") pod \"67d3df0a-9de1-42e6-94b0-82bc99459ebf\" (UID: \"67d3df0a-9de1-42e6-94b0-82bc99459ebf\") " Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.946126 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sc8xn\" (UniqueName: \"kubernetes.io/projected/67d3df0a-9de1-42e6-94b0-82bc99459ebf-kube-api-access-sc8xn\") pod \"67d3df0a-9de1-42e6-94b0-82bc99459ebf\" (UID: \"67d3df0a-9de1-42e6-94b0-82bc99459ebf\") " Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.946250 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ee9a1dc2-769e-4d3f-a1e0-f1b78c45403a-config-data\") pod \"ee9a1dc2-769e-4d3f-a1e0-f1b78c45403a\" (UID: \"ee9a1dc2-769e-4d3f-a1e0-f1b78c45403a\") " Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.946347 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ee9a1dc2-769e-4d3f-a1e0-f1b78c45403a-scripts\") pod \"ee9a1dc2-769e-4d3f-a1e0-f1b78c45403a\" (UID: \"ee9a1dc2-769e-4d3f-a1e0-f1b78c45403a\") " Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.946397 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9c4n5\" (UniqueName: \"kubernetes.io/projected/ee9a1dc2-769e-4d3f-a1e0-f1b78c45403a-kube-api-access-9c4n5\") pod \"ee9a1dc2-769e-4d3f-a1e0-f1b78c45403a\" (UID: \"ee9a1dc2-769e-4d3f-a1e0-f1b78c45403a\") " Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.946432 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/67d3df0a-9de1-42e6-94b0-82bc99459ebf-credential-keys\") pod \"67d3df0a-9de1-42e6-94b0-82bc99459ebf\" (UID: \"67d3df0a-9de1-42e6-94b0-82bc99459ebf\") " Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.946472 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ee9a1dc2-769e-4d3f-a1e0-f1b78c45403a-logs\") pod \"ee9a1dc2-769e-4d3f-a1e0-f1b78c45403a\" (UID: \"ee9a1dc2-769e-4d3f-a1e0-f1b78c45403a\") " Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.947938 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee9a1dc2-769e-4d3f-a1e0-f1b78c45403a-logs" (OuterVolumeSpecName: "logs") pod "ee9a1dc2-769e-4d3f-a1e0-f1b78c45403a" (UID: "ee9a1dc2-769e-4d3f-a1e0-f1b78c45403a"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.954348 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/67d3df0a-9de1-42e6-94b0-82bc99459ebf-scripts" (OuterVolumeSpecName: "scripts") pod "67d3df0a-9de1-42e6-94b0-82bc99459ebf" (UID: "67d3df0a-9de1-42e6-94b0-82bc99459ebf"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.962678 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee9a1dc2-769e-4d3f-a1e0-f1b78c45403a-kube-api-access-9c4n5" (OuterVolumeSpecName: "kube-api-access-9c4n5") pod "ee9a1dc2-769e-4d3f-a1e0-f1b78c45403a" (UID: "ee9a1dc2-769e-4d3f-a1e0-f1b78c45403a"). InnerVolumeSpecName "kube-api-access-9c4n5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.964406 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/67d3df0a-9de1-42e6-94b0-82bc99459ebf-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "67d3df0a-9de1-42e6-94b0-82bc99459ebf" (UID: "67d3df0a-9de1-42e6-94b0-82bc99459ebf"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.966069 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67d3df0a-9de1-42e6-94b0-82bc99459ebf-kube-api-access-sc8xn" (OuterVolumeSpecName: "kube-api-access-sc8xn") pod "67d3df0a-9de1-42e6-94b0-82bc99459ebf" (UID: "67d3df0a-9de1-42e6-94b0-82bc99459ebf"). InnerVolumeSpecName "kube-api-access-sc8xn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.967082 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ee9a1dc2-769e-4d3f-a1e0-f1b78c45403a-scripts" (OuterVolumeSpecName: "scripts") pod "ee9a1dc2-769e-4d3f-a1e0-f1b78c45403a" (UID: "ee9a1dc2-769e-4d3f-a1e0-f1b78c45403a"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.968901 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/67d3df0a-9de1-42e6-94b0-82bc99459ebf-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "67d3df0a-9de1-42e6-94b0-82bc99459ebf" (UID: "67d3df0a-9de1-42e6-94b0-82bc99459ebf"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.986482 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ee9a1dc2-769e-4d3f-a1e0-f1b78c45403a-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ee9a1dc2-769e-4d3f-a1e0-f1b78c45403a" (UID: "ee9a1dc2-769e-4d3f-a1e0-f1b78c45403a"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.989571 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/67d3df0a-9de1-42e6-94b0-82bc99459ebf-config-data" (OuterVolumeSpecName: "config-data") pod "67d3df0a-9de1-42e6-94b0-82bc99459ebf" (UID: "67d3df0a-9de1-42e6-94b0-82bc99459ebf"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:26:50 crc kubenswrapper[5120]: I0316 16:26:50.994267 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ee9a1dc2-769e-4d3f-a1e0-f1b78c45403a-config-data" (OuterVolumeSpecName: "config-data") pod "ee9a1dc2-769e-4d3f-a1e0-f1b78c45403a" (UID: "ee9a1dc2-769e-4d3f-a1e0-f1b78c45403a"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:26:51 crc kubenswrapper[5120]: I0316 16:26:51.003193 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:26:51 crc kubenswrapper[5120]: I0316 16:26:51.009675 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/67d3df0a-9de1-42e6-94b0-82bc99459ebf-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "67d3df0a-9de1-42e6-94b0-82bc99459ebf" (UID: "67d3df0a-9de1-42e6-94b0-82bc99459ebf"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:26:51 crc kubenswrapper[5120]: I0316 16:26:51.050582 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/67d3df0a-9de1-42e6-94b0-82bc99459ebf-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:26:51 crc kubenswrapper[5120]: I0316 16:26:51.050625 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/67d3df0a-9de1-42e6-94b0-82bc99459ebf-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:26:51 crc kubenswrapper[5120]: I0316 16:26:51.050639 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ee9a1dc2-769e-4d3f-a1e0-f1b78c45403a-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:26:51 crc kubenswrapper[5120]: I0316 16:26:51.050652 5120 reconciler_common.go:299] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/67d3df0a-9de1-42e6-94b0-82bc99459ebf-fernet-keys\") on node \"crc\" DevicePath \"\"" Mar 16 16:26:51 crc kubenswrapper[5120]: I0316 16:26:51.050663 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/67d3df0a-9de1-42e6-94b0-82bc99459ebf-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:26:51 crc kubenswrapper[5120]: I0316 16:26:51.050678 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sc8xn\" (UniqueName: \"kubernetes.io/projected/67d3df0a-9de1-42e6-94b0-82bc99459ebf-kube-api-access-sc8xn\") on node \"crc\" DevicePath \"\"" Mar 16 16:26:51 crc kubenswrapper[5120]: I0316 16:26:51.050691 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ee9a1dc2-769e-4d3f-a1e0-f1b78c45403a-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:26:51 crc kubenswrapper[5120]: I0316 16:26:51.050707 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ee9a1dc2-769e-4d3f-a1e0-f1b78c45403a-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:26:51 crc kubenswrapper[5120]: I0316 16:26:51.050717 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9c4n5\" (UniqueName: \"kubernetes.io/projected/ee9a1dc2-769e-4d3f-a1e0-f1b78c45403a-kube-api-access-9c4n5\") on node \"crc\" DevicePath \"\"" Mar 16 16:26:51 crc kubenswrapper[5120]: I0316 16:26:51.050729 5120 reconciler_common.go:299] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/67d3df0a-9de1-42e6-94b0-82bc99459ebf-credential-keys\") on node \"crc\" DevicePath \"\"" Mar 16 16:26:51 crc kubenswrapper[5120]: I0316 16:26:51.050740 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ee9a1dc2-769e-4d3f-a1e0-f1b78c45403a-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:26:51 crc kubenswrapper[5120]: I0316 16:26:51.448596 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:26:51 crc kubenswrapper[5120]: W0316 16:26:51.453912 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0a40a3c3_a3dd_4903_8ca3_dd81b5cc204b.slice/crio-bcc9a07ae65eeecf566d2fb925330af89b64af29ce8189ffe59d21d2693eef09 WatchSource:0}: Error finding container bcc9a07ae65eeecf566d2fb925330af89b64af29ce8189ffe59d21d2693eef09: Status 404 returned error can't find the container with id bcc9a07ae65eeecf566d2fb925330af89b64af29ce8189ffe59d21d2693eef09 Mar 16 16:26:51 crc kubenswrapper[5120]: I0316 16:26:51.462150 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-pv6tf" Mar 16 16:26:51 crc kubenswrapper[5120]: I0316 16:26:51.462250 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-pv6tf" event={"ID":"ee9a1dc2-769e-4d3f-a1e0-f1b78c45403a","Type":"ContainerDied","Data":"4a65e0880021ee1cdb3a19f1f4b9c870cf680a62355f6ef9cf22dad32c716053"} Mar 16 16:26:51 crc kubenswrapper[5120]: I0316 16:26:51.462305 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4a65e0880021ee1cdb3a19f1f4b9c870cf680a62355f6ef9cf22dad32c716053" Mar 16 16:26:51 crc kubenswrapper[5120]: I0316 16:26:51.468510 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-7zwsz" Mar 16 16:26:51 crc kubenswrapper[5120]: I0316 16:26:51.468622 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-7zwsz" event={"ID":"67d3df0a-9de1-42e6-94b0-82bc99459ebf","Type":"ContainerDied","Data":"fea642621064a02bf2987d6f57e9e8a1c35e6f66eaa6b2bd78c12cee387c5f2a"} Mar 16 16:26:51 crc kubenswrapper[5120]: I0316 16:26:51.468702 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fea642621064a02bf2987d6f57e9e8a1c35e6f66eaa6b2bd78c12cee387c5f2a" Mar 16 16:26:51 crc kubenswrapper[5120]: I0316 16:26:51.473777 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"d4a84888-a119-4cef-9709-e47200b01990","Type":"ContainerStarted","Data":"c1233d07750f7af88a683f1b1460d5f199a63e5472a40f9513c8f0b9440d6f8d"} Mar 16 16:26:51 crc kubenswrapper[5120]: I0316 16:26:51.473821 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"d4a84888-a119-4cef-9709-e47200b01990","Type":"ContainerStarted","Data":"b7b93af1824cc495b6321a32eeb3e9595d66aa5f69b4b026054289badb00a89d"} Mar 16 16:26:51 crc kubenswrapper[5120]: I0316 16:26:51.642349 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-6b678b5478-h7p85"] Mar 16 16:26:51 crc kubenswrapper[5120]: I0316 16:26:51.643577 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67d3df0a-9de1-42e6-94b0-82bc99459ebf" containerName="keystone-bootstrap" Mar 16 16:26:51 crc kubenswrapper[5120]: I0316 16:26:51.643593 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="67d3df0a-9de1-42e6-94b0-82bc99459ebf" containerName="keystone-bootstrap" Mar 16 16:26:51 crc kubenswrapper[5120]: I0316 16:26:51.643636 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee9a1dc2-769e-4d3f-a1e0-f1b78c45403a" containerName="placement-db-sync" Mar 16 16:26:51 crc kubenswrapper[5120]: I0316 16:26:51.643643 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee9a1dc2-769e-4d3f-a1e0-f1b78c45403a" containerName="placement-db-sync" Mar 16 16:26:51 crc kubenswrapper[5120]: I0316 16:26:51.643835 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="67d3df0a-9de1-42e6-94b0-82bc99459ebf" containerName="keystone-bootstrap" Mar 16 16:26:51 crc kubenswrapper[5120]: I0316 16:26:51.643851 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ee9a1dc2-769e-4d3f-a1e0-f1b78c45403a" containerName="placement-db-sync" Mar 16 16:26:51 crc kubenswrapper[5120]: I0316 16:26:51.648405 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-6b678b5478-h7p85" Mar 16 16:26:51 crc kubenswrapper[5120]: I0316 16:26:51.653928 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-placement-internal-svc\"" Mar 16 16:26:51 crc kubenswrapper[5120]: I0316 16:26:51.655559 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-scripts\"" Mar 16 16:26:51 crc kubenswrapper[5120]: I0316 16:26:51.655669 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-placement-public-svc\"" Mar 16 16:26:51 crc kubenswrapper[5120]: I0316 16:26:51.655733 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-placement-dockercfg-dgk8d\"" Mar 16 16:26:51 crc kubenswrapper[5120]: I0316 16:26:51.655984 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-config-data\"" Mar 16 16:26:51 crc kubenswrapper[5120]: I0316 16:26:51.664068 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5b82cd86-0489-4dc6-8d45-b478e71f1083-logs\") pod \"placement-6b678b5478-h7p85\" (UID: \"5b82cd86-0489-4dc6-8d45-b478e71f1083\") " pod="openstack-kuttl-tests/placement-6b678b5478-h7p85" Mar 16 16:26:51 crc kubenswrapper[5120]: I0316 16:26:51.664133 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/5b82cd86-0489-4dc6-8d45-b478e71f1083-public-tls-certs\") pod \"placement-6b678b5478-h7p85\" (UID: \"5b82cd86-0489-4dc6-8d45-b478e71f1083\") " pod="openstack-kuttl-tests/placement-6b678b5478-h7p85" Mar 16 16:26:51 crc kubenswrapper[5120]: I0316 16:26:51.664183 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5b82cd86-0489-4dc6-8d45-b478e71f1083-config-data\") pod \"placement-6b678b5478-h7p85\" (UID: \"5b82cd86-0489-4dc6-8d45-b478e71f1083\") " pod="openstack-kuttl-tests/placement-6b678b5478-h7p85" Mar 16 16:26:51 crc kubenswrapper[5120]: I0316 16:26:51.664891 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wgfp\" (UniqueName: \"kubernetes.io/projected/5b82cd86-0489-4dc6-8d45-b478e71f1083-kube-api-access-7wgfp\") pod \"placement-6b678b5478-h7p85\" (UID: \"5b82cd86-0489-4dc6-8d45-b478e71f1083\") " pod="openstack-kuttl-tests/placement-6b678b5478-h7p85" Mar 16 16:26:51 crc kubenswrapper[5120]: I0316 16:26:51.664987 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/5b82cd86-0489-4dc6-8d45-b478e71f1083-internal-tls-certs\") pod \"placement-6b678b5478-h7p85\" (UID: \"5b82cd86-0489-4dc6-8d45-b478e71f1083\") " pod="openstack-kuttl-tests/placement-6b678b5478-h7p85" Mar 16 16:26:51 crc kubenswrapper[5120]: I0316 16:26:51.665033 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5b82cd86-0489-4dc6-8d45-b478e71f1083-combined-ca-bundle\") pod \"placement-6b678b5478-h7p85\" (UID: \"5b82cd86-0489-4dc6-8d45-b478e71f1083\") " pod="openstack-kuttl-tests/placement-6b678b5478-h7p85" Mar 16 16:26:51 crc kubenswrapper[5120]: I0316 16:26:51.665113 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5b82cd86-0489-4dc6-8d45-b478e71f1083-scripts\") pod \"placement-6b678b5478-h7p85\" (UID: \"5b82cd86-0489-4dc6-8d45-b478e71f1083\") " pod="openstack-kuttl-tests/placement-6b678b5478-h7p85" Mar 16 16:26:51 crc kubenswrapper[5120]: I0316 16:26:51.671461 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-7zwsz"] Mar 16 16:26:51 crc kubenswrapper[5120]: I0316 16:26:51.777753 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7wgfp\" (UniqueName: \"kubernetes.io/projected/5b82cd86-0489-4dc6-8d45-b478e71f1083-kube-api-access-7wgfp\") pod \"placement-6b678b5478-h7p85\" (UID: \"5b82cd86-0489-4dc6-8d45-b478e71f1083\") " pod="openstack-kuttl-tests/placement-6b678b5478-h7p85" Mar 16 16:26:51 crc kubenswrapper[5120]: I0316 16:26:51.777929 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/5b82cd86-0489-4dc6-8d45-b478e71f1083-internal-tls-certs\") pod \"placement-6b678b5478-h7p85\" (UID: \"5b82cd86-0489-4dc6-8d45-b478e71f1083\") " pod="openstack-kuttl-tests/placement-6b678b5478-h7p85" Mar 16 16:26:51 crc kubenswrapper[5120]: I0316 16:26:51.777986 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5b82cd86-0489-4dc6-8d45-b478e71f1083-combined-ca-bundle\") pod \"placement-6b678b5478-h7p85\" (UID: \"5b82cd86-0489-4dc6-8d45-b478e71f1083\") " pod="openstack-kuttl-tests/placement-6b678b5478-h7p85" Mar 16 16:26:51 crc kubenswrapper[5120]: I0316 16:26:51.778087 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5b82cd86-0489-4dc6-8d45-b478e71f1083-scripts\") pod \"placement-6b678b5478-h7p85\" (UID: \"5b82cd86-0489-4dc6-8d45-b478e71f1083\") " pod="openstack-kuttl-tests/placement-6b678b5478-h7p85" Mar 16 16:26:51 crc kubenswrapper[5120]: I0316 16:26:51.778241 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5b82cd86-0489-4dc6-8d45-b478e71f1083-logs\") pod \"placement-6b678b5478-h7p85\" (UID: \"5b82cd86-0489-4dc6-8d45-b478e71f1083\") " pod="openstack-kuttl-tests/placement-6b678b5478-h7p85" Mar 16 16:26:51 crc kubenswrapper[5120]: I0316 16:26:51.778317 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/5b82cd86-0489-4dc6-8d45-b478e71f1083-public-tls-certs\") pod \"placement-6b678b5478-h7p85\" (UID: \"5b82cd86-0489-4dc6-8d45-b478e71f1083\") " pod="openstack-kuttl-tests/placement-6b678b5478-h7p85" Mar 16 16:26:51 crc kubenswrapper[5120]: I0316 16:26:51.778409 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5b82cd86-0489-4dc6-8d45-b478e71f1083-config-data\") pod \"placement-6b678b5478-h7p85\" (UID: \"5b82cd86-0489-4dc6-8d45-b478e71f1083\") " pod="openstack-kuttl-tests/placement-6b678b5478-h7p85" Mar 16 16:26:51 crc kubenswrapper[5120]: I0316 16:26:51.780063 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5b82cd86-0489-4dc6-8d45-b478e71f1083-logs\") pod \"placement-6b678b5478-h7p85\" (UID: \"5b82cd86-0489-4dc6-8d45-b478e71f1083\") " pod="openstack-kuttl-tests/placement-6b678b5478-h7p85" Mar 16 16:26:51 crc kubenswrapper[5120]: I0316 16:26:51.780444 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-7zwsz"] Mar 16 16:26:51 crc kubenswrapper[5120]: I0316 16:26:51.788707 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5b82cd86-0489-4dc6-8d45-b478e71f1083-combined-ca-bundle\") pod \"placement-6b678b5478-h7p85\" (UID: \"5b82cd86-0489-4dc6-8d45-b478e71f1083\") " pod="openstack-kuttl-tests/placement-6b678b5478-h7p85" Mar 16 16:26:51 crc kubenswrapper[5120]: I0316 16:26:51.788989 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/5b82cd86-0489-4dc6-8d45-b478e71f1083-public-tls-certs\") pod \"placement-6b678b5478-h7p85\" (UID: \"5b82cd86-0489-4dc6-8d45-b478e71f1083\") " pod="openstack-kuttl-tests/placement-6b678b5478-h7p85" Mar 16 16:26:51 crc kubenswrapper[5120]: I0316 16:26:51.791536 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/5b82cd86-0489-4dc6-8d45-b478e71f1083-internal-tls-certs\") pod \"placement-6b678b5478-h7p85\" (UID: \"5b82cd86-0489-4dc6-8d45-b478e71f1083\") " pod="openstack-kuttl-tests/placement-6b678b5478-h7p85" Mar 16 16:26:51 crc kubenswrapper[5120]: I0316 16:26:51.803078 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5b82cd86-0489-4dc6-8d45-b478e71f1083-config-data\") pod \"placement-6b678b5478-h7p85\" (UID: \"5b82cd86-0489-4dc6-8d45-b478e71f1083\") " pod="openstack-kuttl-tests/placement-6b678b5478-h7p85" Mar 16 16:26:51 crc kubenswrapper[5120]: I0316 16:26:51.808799 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5b82cd86-0489-4dc6-8d45-b478e71f1083-scripts\") pod \"placement-6b678b5478-h7p85\" (UID: \"5b82cd86-0489-4dc6-8d45-b478e71f1083\") " pod="openstack-kuttl-tests/placement-6b678b5478-h7p85" Mar 16 16:26:51 crc kubenswrapper[5120]: I0316 16:26:51.821727 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-6b678b5478-h7p85"] Mar 16 16:26:51 crc kubenswrapper[5120]: I0316 16:26:51.825629 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wgfp\" (UniqueName: \"kubernetes.io/projected/5b82cd86-0489-4dc6-8d45-b478e71f1083-kube-api-access-7wgfp\") pod \"placement-6b678b5478-h7p85\" (UID: \"5b82cd86-0489-4dc6-8d45-b478e71f1083\") " pod="openstack-kuttl-tests/placement-6b678b5478-h7p85" Mar 16 16:26:51 crc kubenswrapper[5120]: I0316 16:26:51.861782 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-ckqtl"] Mar 16 16:26:51 crc kubenswrapper[5120]: I0316 16:26:51.868876 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-ckqtl" Mar 16 16:26:51 crc kubenswrapper[5120]: I0316 16:26:51.873478 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"osp-secret\"" Mar 16 16:26:51 crc kubenswrapper[5120]: I0316 16:26:51.873724 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-scripts\"" Mar 16 16:26:51 crc kubenswrapper[5120]: I0316 16:26:51.874012 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-keystone-dockercfg-9hkx9\"" Mar 16 16:26:51 crc kubenswrapper[5120]: I0316 16:26:51.874062 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-ckqtl"] Mar 16 16:26:51 crc kubenswrapper[5120]: I0316 16:26:51.875120 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-config-data\"" Mar 16 16:26:51 crc kubenswrapper[5120]: I0316 16:26:51.875983 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone\"" Mar 16 16:26:51 crc kubenswrapper[5120]: I0316 16:26:51.942894 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-bkr9j" Mar 16 16:26:51 crc kubenswrapper[5120]: I0316 16:26:51.967923 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-6b678b5478-h7p85" Mar 16 16:26:51 crc kubenswrapper[5120]: I0316 16:26:51.988235 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lhjmq\" (UniqueName: \"kubernetes.io/projected/f793dd8c-d824-4c26-9f17-848b016fe52b-kube-api-access-lhjmq\") pod \"f793dd8c-d824-4c26-9f17-848b016fe52b\" (UID: \"f793dd8c-d824-4c26-9f17-848b016fe52b\") " Mar 16 16:26:51 crc kubenswrapper[5120]: I0316 16:26:51.989204 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/f793dd8c-d824-4c26-9f17-848b016fe52b-db-sync-config-data\") pod \"f793dd8c-d824-4c26-9f17-848b016fe52b\" (UID: \"f793dd8c-d824-4c26-9f17-848b016fe52b\") " Mar 16 16:26:51 crc kubenswrapper[5120]: I0316 16:26:51.989248 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f793dd8c-d824-4c26-9f17-848b016fe52b-combined-ca-bundle\") pod \"f793dd8c-d824-4c26-9f17-848b016fe52b\" (UID: \"f793dd8c-d824-4c26-9f17-848b016fe52b\") " Mar 16 16:26:51 crc kubenswrapper[5120]: I0316 16:26:51.989540 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f6f3bfb6-6e3f-4a38-b39b-fe1701d8e53d-config-data\") pod \"keystone-bootstrap-ckqtl\" (UID: \"f6f3bfb6-6e3f-4a38-b39b-fe1701d8e53d\") " pod="openstack-kuttl-tests/keystone-bootstrap-ckqtl" Mar 16 16:26:51 crc kubenswrapper[5120]: I0316 16:26:51.990577 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/f6f3bfb6-6e3f-4a38-b39b-fe1701d8e53d-fernet-keys\") pod \"keystone-bootstrap-ckqtl\" (UID: \"f6f3bfb6-6e3f-4a38-b39b-fe1701d8e53d\") " pod="openstack-kuttl-tests/keystone-bootstrap-ckqtl" Mar 16 16:26:51 crc kubenswrapper[5120]: I0316 16:26:51.990701 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f6f3bfb6-6e3f-4a38-b39b-fe1701d8e53d-combined-ca-bundle\") pod \"keystone-bootstrap-ckqtl\" (UID: \"f6f3bfb6-6e3f-4a38-b39b-fe1701d8e53d\") " pod="openstack-kuttl-tests/keystone-bootstrap-ckqtl" Mar 16 16:26:51 crc kubenswrapper[5120]: I0316 16:26:51.992008 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f6f3bfb6-6e3f-4a38-b39b-fe1701d8e53d-scripts\") pod \"keystone-bootstrap-ckqtl\" (UID: \"f6f3bfb6-6e3f-4a38-b39b-fe1701d8e53d\") " pod="openstack-kuttl-tests/keystone-bootstrap-ckqtl" Mar 16 16:26:51 crc kubenswrapper[5120]: I0316 16:26:51.992221 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/f6f3bfb6-6e3f-4a38-b39b-fe1701d8e53d-credential-keys\") pod \"keystone-bootstrap-ckqtl\" (UID: \"f6f3bfb6-6e3f-4a38-b39b-fe1701d8e53d\") " pod="openstack-kuttl-tests/keystone-bootstrap-ckqtl" Mar 16 16:26:51 crc kubenswrapper[5120]: I0316 16:26:51.992286 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwbgh\" (UniqueName: \"kubernetes.io/projected/f6f3bfb6-6e3f-4a38-b39b-fe1701d8e53d-kube-api-access-xwbgh\") pod \"keystone-bootstrap-ckqtl\" (UID: \"f6f3bfb6-6e3f-4a38-b39b-fe1701d8e53d\") " pod="openstack-kuttl-tests/keystone-bootstrap-ckqtl" Mar 16 16:26:51 crc kubenswrapper[5120]: I0316 16:26:51.995135 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f793dd8c-d824-4c26-9f17-848b016fe52b-db-sync-config-data" (OuterVolumeSpecName: "db-sync-config-data") pod "f793dd8c-d824-4c26-9f17-848b016fe52b" (UID: "f793dd8c-d824-4c26-9f17-848b016fe52b"). InnerVolumeSpecName "db-sync-config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:26:51 crc kubenswrapper[5120]: I0316 16:26:51.995237 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f793dd8c-d824-4c26-9f17-848b016fe52b-kube-api-access-lhjmq" (OuterVolumeSpecName: "kube-api-access-lhjmq") pod "f793dd8c-d824-4c26-9f17-848b016fe52b" (UID: "f793dd8c-d824-4c26-9f17-848b016fe52b"). InnerVolumeSpecName "kube-api-access-lhjmq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:26:52 crc kubenswrapper[5120]: I0316 16:26:52.020998 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f793dd8c-d824-4c26-9f17-848b016fe52b-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f793dd8c-d824-4c26-9f17-848b016fe52b" (UID: "f793dd8c-d824-4c26-9f17-848b016fe52b"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:26:52 crc kubenswrapper[5120]: I0316 16:26:52.094653 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f6f3bfb6-6e3f-4a38-b39b-fe1701d8e53d-config-data\") pod \"keystone-bootstrap-ckqtl\" (UID: \"f6f3bfb6-6e3f-4a38-b39b-fe1701d8e53d\") " pod="openstack-kuttl-tests/keystone-bootstrap-ckqtl" Mar 16 16:26:52 crc kubenswrapper[5120]: I0316 16:26:52.095013 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/f6f3bfb6-6e3f-4a38-b39b-fe1701d8e53d-fernet-keys\") pod \"keystone-bootstrap-ckqtl\" (UID: \"f6f3bfb6-6e3f-4a38-b39b-fe1701d8e53d\") " pod="openstack-kuttl-tests/keystone-bootstrap-ckqtl" Mar 16 16:26:52 crc kubenswrapper[5120]: I0316 16:26:52.095052 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f6f3bfb6-6e3f-4a38-b39b-fe1701d8e53d-combined-ca-bundle\") pod \"keystone-bootstrap-ckqtl\" (UID: \"f6f3bfb6-6e3f-4a38-b39b-fe1701d8e53d\") " pod="openstack-kuttl-tests/keystone-bootstrap-ckqtl" Mar 16 16:26:52 crc kubenswrapper[5120]: I0316 16:26:52.095126 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f6f3bfb6-6e3f-4a38-b39b-fe1701d8e53d-scripts\") pod \"keystone-bootstrap-ckqtl\" (UID: \"f6f3bfb6-6e3f-4a38-b39b-fe1701d8e53d\") " pod="openstack-kuttl-tests/keystone-bootstrap-ckqtl" Mar 16 16:26:52 crc kubenswrapper[5120]: I0316 16:26:52.095197 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/f6f3bfb6-6e3f-4a38-b39b-fe1701d8e53d-credential-keys\") pod \"keystone-bootstrap-ckqtl\" (UID: \"f6f3bfb6-6e3f-4a38-b39b-fe1701d8e53d\") " pod="openstack-kuttl-tests/keystone-bootstrap-ckqtl" Mar 16 16:26:52 crc kubenswrapper[5120]: I0316 16:26:52.095238 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xwbgh\" (UniqueName: \"kubernetes.io/projected/f6f3bfb6-6e3f-4a38-b39b-fe1701d8e53d-kube-api-access-xwbgh\") pod \"keystone-bootstrap-ckqtl\" (UID: \"f6f3bfb6-6e3f-4a38-b39b-fe1701d8e53d\") " pod="openstack-kuttl-tests/keystone-bootstrap-ckqtl" Mar 16 16:26:52 crc kubenswrapper[5120]: I0316 16:26:52.095316 5120 reconciler_common.go:299] "Volume detached for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/f793dd8c-d824-4c26-9f17-848b016fe52b-db-sync-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:26:52 crc kubenswrapper[5120]: I0316 16:26:52.095335 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f793dd8c-d824-4c26-9f17-848b016fe52b-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:26:52 crc kubenswrapper[5120]: I0316 16:26:52.095350 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lhjmq\" (UniqueName: \"kubernetes.io/projected/f793dd8c-d824-4c26-9f17-848b016fe52b-kube-api-access-lhjmq\") on node \"crc\" DevicePath \"\"" Mar 16 16:26:52 crc kubenswrapper[5120]: I0316 16:26:52.100489 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/f6f3bfb6-6e3f-4a38-b39b-fe1701d8e53d-credential-keys\") pod \"keystone-bootstrap-ckqtl\" (UID: \"f6f3bfb6-6e3f-4a38-b39b-fe1701d8e53d\") " pod="openstack-kuttl-tests/keystone-bootstrap-ckqtl" Mar 16 16:26:52 crc kubenswrapper[5120]: I0316 16:26:52.101257 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f6f3bfb6-6e3f-4a38-b39b-fe1701d8e53d-combined-ca-bundle\") pod \"keystone-bootstrap-ckqtl\" (UID: \"f6f3bfb6-6e3f-4a38-b39b-fe1701d8e53d\") " pod="openstack-kuttl-tests/keystone-bootstrap-ckqtl" Mar 16 16:26:52 crc kubenswrapper[5120]: I0316 16:26:52.103386 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f6f3bfb6-6e3f-4a38-b39b-fe1701d8e53d-config-data\") pod \"keystone-bootstrap-ckqtl\" (UID: \"f6f3bfb6-6e3f-4a38-b39b-fe1701d8e53d\") " pod="openstack-kuttl-tests/keystone-bootstrap-ckqtl" Mar 16 16:26:52 crc kubenswrapper[5120]: I0316 16:26:52.104678 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/f6f3bfb6-6e3f-4a38-b39b-fe1701d8e53d-fernet-keys\") pod \"keystone-bootstrap-ckqtl\" (UID: \"f6f3bfb6-6e3f-4a38-b39b-fe1701d8e53d\") " pod="openstack-kuttl-tests/keystone-bootstrap-ckqtl" Mar 16 16:26:52 crc kubenswrapper[5120]: I0316 16:26:52.109636 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f6f3bfb6-6e3f-4a38-b39b-fe1701d8e53d-scripts\") pod \"keystone-bootstrap-ckqtl\" (UID: \"f6f3bfb6-6e3f-4a38-b39b-fe1701d8e53d\") " pod="openstack-kuttl-tests/keystone-bootstrap-ckqtl" Mar 16 16:26:52 crc kubenswrapper[5120]: I0316 16:26:52.118815 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwbgh\" (UniqueName: \"kubernetes.io/projected/f6f3bfb6-6e3f-4a38-b39b-fe1701d8e53d-kube-api-access-xwbgh\") pod \"keystone-bootstrap-ckqtl\" (UID: \"f6f3bfb6-6e3f-4a38-b39b-fe1701d8e53d\") " pod="openstack-kuttl-tests/keystone-bootstrap-ckqtl" Mar 16 16:26:52 crc kubenswrapper[5120]: I0316 16:26:52.259668 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-ckqtl" Mar 16 16:26:52 crc kubenswrapper[5120]: I0316 16:26:52.447157 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-6b678b5478-h7p85"] Mar 16 16:26:52 crc kubenswrapper[5120]: I0316 16:26:52.486421 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"d4a84888-a119-4cef-9709-e47200b01990","Type":"ContainerStarted","Data":"17b2f2285a8d3eca412816bab191df4db8417d945641e8d0b886114eb046f8ac"} Mar 16 16:26:52 crc kubenswrapper[5120]: I0316 16:26:52.500355 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-6b678b5478-h7p85" event={"ID":"5b82cd86-0489-4dc6-8d45-b478e71f1083","Type":"ContainerStarted","Data":"47c3fdf9019ebec804ba04a1c88b84948eb5b39abf5f7dec4ba108cd6956c5e4"} Mar 16 16:26:52 crc kubenswrapper[5120]: I0316 16:26:52.518985 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"0a40a3c3-a3dd-4903-8ca3-dd81b5cc204b","Type":"ContainerStarted","Data":"0d04f0fddaec3051829c1b6d0bf13b3ddc5e7584408d31509531e070ee5ec1e9"} Mar 16 16:26:52 crc kubenswrapper[5120]: I0316 16:26:52.519240 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"0a40a3c3-a3dd-4903-8ca3-dd81b5cc204b","Type":"ContainerStarted","Data":"bcc9a07ae65eeecf566d2fb925330af89b64af29ce8189ffe59d21d2693eef09"} Mar 16 16:26:52 crc kubenswrapper[5120]: I0316 16:26:52.574339 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-external-api-0" podStartSLOduration=3.574316949 podStartE2EDuration="3.574316949s" podCreationTimestamp="2026-03-16 16:26:49 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:26:52.511665673 +0000 UTC m=+3314.665597340" watchObservedRunningTime="2026-03-16 16:26:52.574316949 +0000 UTC m=+3314.728248606" Mar 16 16:26:52 crc kubenswrapper[5120]: I0316 16:26:52.585640 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-bkr9j" event={"ID":"f793dd8c-d824-4c26-9f17-848b016fe52b","Type":"ContainerDied","Data":"a31eca488d57b2ddb48b4bfe73b79637cd30d3cecec8e3019a64273a3072d68a"} Mar 16 16:26:52 crc kubenswrapper[5120]: I0316 16:26:52.585685 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a31eca488d57b2ddb48b4bfe73b79637cd30d3cecec8e3019a64273a3072d68a" Mar 16 16:26:52 crc kubenswrapper[5120]: I0316 16:26:52.585790 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-bkr9j" Mar 16 16:26:52 crc kubenswrapper[5120]: I0316 16:26:52.662146 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-worker-54c4c64f95-r2mxb"] Mar 16 16:26:52 crc kubenswrapper[5120]: I0316 16:26:52.663166 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f793dd8c-d824-4c26-9f17-848b016fe52b" containerName="barbican-db-sync" Mar 16 16:26:52 crc kubenswrapper[5120]: I0316 16:26:52.670108 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f793dd8c-d824-4c26-9f17-848b016fe52b" containerName="barbican-db-sync" Mar 16 16:26:52 crc kubenswrapper[5120]: I0316 16:26:52.670541 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f793dd8c-d824-4c26-9f17-848b016fe52b" containerName="barbican-db-sync" Mar 16 16:26:52 crc kubenswrapper[5120]: I0316 16:26:52.682124 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-54c4c64f95-r2mxb" Mar 16 16:26:52 crc kubenswrapper[5120]: I0316 16:26:52.694272 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-barbican-dockercfg-bkg7z\"" Mar 16 16:26:52 crc kubenswrapper[5120]: I0316 16:26:52.694344 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-worker-config-data\"" Mar 16 16:26:52 crc kubenswrapper[5120]: I0316 16:26:52.695034 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-config-data\"" Mar 16 16:26:52 crc kubenswrapper[5120]: I0316 16:26:52.710458 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ffa91919-32b8-43f8-9332-4d7c16575345-logs\") pod \"barbican-worker-54c4c64f95-r2mxb\" (UID: \"ffa91919-32b8-43f8-9332-4d7c16575345\") " pod="openstack-kuttl-tests/barbican-worker-54c4c64f95-r2mxb" Mar 16 16:26:52 crc kubenswrapper[5120]: I0316 16:26:52.710562 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ffa91919-32b8-43f8-9332-4d7c16575345-combined-ca-bundle\") pod \"barbican-worker-54c4c64f95-r2mxb\" (UID: \"ffa91919-32b8-43f8-9332-4d7c16575345\") " pod="openstack-kuttl-tests/barbican-worker-54c4c64f95-r2mxb" Mar 16 16:26:52 crc kubenswrapper[5120]: I0316 16:26:52.710585 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/ffa91919-32b8-43f8-9332-4d7c16575345-config-data-custom\") pod \"barbican-worker-54c4c64f95-r2mxb\" (UID: \"ffa91919-32b8-43f8-9332-4d7c16575345\") " pod="openstack-kuttl-tests/barbican-worker-54c4c64f95-r2mxb" Mar 16 16:26:52 crc kubenswrapper[5120]: I0316 16:26:52.710654 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzmdd\" (UniqueName: \"kubernetes.io/projected/ffa91919-32b8-43f8-9332-4d7c16575345-kube-api-access-nzmdd\") pod \"barbican-worker-54c4c64f95-r2mxb\" (UID: \"ffa91919-32b8-43f8-9332-4d7c16575345\") " pod="openstack-kuttl-tests/barbican-worker-54c4c64f95-r2mxb" Mar 16 16:26:52 crc kubenswrapper[5120]: I0316 16:26:52.710683 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ffa91919-32b8-43f8-9332-4d7c16575345-config-data\") pod \"barbican-worker-54c4c64f95-r2mxb\" (UID: \"ffa91919-32b8-43f8-9332-4d7c16575345\") " pod="openstack-kuttl-tests/barbican-worker-54c4c64f95-r2mxb" Mar 16 16:26:52 crc kubenswrapper[5120]: I0316 16:26:52.727111 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="67d3df0a-9de1-42e6-94b0-82bc99459ebf" path="/var/lib/kubelet/pods/67d3df0a-9de1-42e6-94b0-82bc99459ebf/volumes" Mar 16 16:26:52 crc kubenswrapper[5120]: I0316 16:26:52.728150 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-6b6d87dc7d-zrnjh"] Mar 16 16:26:52 crc kubenswrapper[5120]: I0316 16:26:52.738044 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-54c4c64f95-r2mxb"] Mar 16 16:26:52 crc kubenswrapper[5120]: I0316 16:26:52.738186 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-6b6d87dc7d-zrnjh" Mar 16 16:26:52 crc kubenswrapper[5120]: I0316 16:26:52.743688 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-keystone-listener-config-data\"" Mar 16 16:26:52 crc kubenswrapper[5120]: I0316 16:26:52.756083 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-6b6d87dc7d-zrnjh"] Mar 16 16:26:52 crc kubenswrapper[5120]: I0316 16:26:52.799090 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-api-6cbd8fc548-p4pgf"] Mar 16 16:26:52 crc kubenswrapper[5120]: I0316 16:26:52.811965 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-6cbd8fc548-p4pgf"] Mar 16 16:26:52 crc kubenswrapper[5120]: I0316 16:26:52.816248 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ffa91919-32b8-43f8-9332-4d7c16575345-logs\") pod \"barbican-worker-54c4c64f95-r2mxb\" (UID: \"ffa91919-32b8-43f8-9332-4d7c16575345\") " pod="openstack-kuttl-tests/barbican-worker-54c4c64f95-r2mxb" Mar 16 16:26:52 crc kubenswrapper[5120]: I0316 16:26:52.817126 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/5d85f5fb-0f61-4689-9493-daa49e079f98-config-data-custom\") pod \"barbican-keystone-listener-6b6d87dc7d-zrnjh\" (UID: \"5d85f5fb-0f61-4689-9493-daa49e079f98\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6b6d87dc7d-zrnjh" Mar 16 16:26:52 crc kubenswrapper[5120]: I0316 16:26:52.817213 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ffa91919-32b8-43f8-9332-4d7c16575345-combined-ca-bundle\") pod \"barbican-worker-54c4c64f95-r2mxb\" (UID: \"ffa91919-32b8-43f8-9332-4d7c16575345\") " pod="openstack-kuttl-tests/barbican-worker-54c4c64f95-r2mxb" Mar 16 16:26:52 crc kubenswrapper[5120]: I0316 16:26:52.817250 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/ffa91919-32b8-43f8-9332-4d7c16575345-config-data-custom\") pod \"barbican-worker-54c4c64f95-r2mxb\" (UID: \"ffa91919-32b8-43f8-9332-4d7c16575345\") " pod="openstack-kuttl-tests/barbican-worker-54c4c64f95-r2mxb" Mar 16 16:26:52 crc kubenswrapper[5120]: I0316 16:26:52.817336 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztbsn\" (UniqueName: \"kubernetes.io/projected/5d85f5fb-0f61-4689-9493-daa49e079f98-kube-api-access-ztbsn\") pod \"barbican-keystone-listener-6b6d87dc7d-zrnjh\" (UID: \"5d85f5fb-0f61-4689-9493-daa49e079f98\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6b6d87dc7d-zrnjh" Mar 16 16:26:52 crc kubenswrapper[5120]: I0316 16:26:52.817875 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nzmdd\" (UniqueName: \"kubernetes.io/projected/ffa91919-32b8-43f8-9332-4d7c16575345-kube-api-access-nzmdd\") pod \"barbican-worker-54c4c64f95-r2mxb\" (UID: \"ffa91919-32b8-43f8-9332-4d7c16575345\") " pod="openstack-kuttl-tests/barbican-worker-54c4c64f95-r2mxb" Mar 16 16:26:52 crc kubenswrapper[5120]: I0316 16:26:52.817910 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5d85f5fb-0f61-4689-9493-daa49e079f98-combined-ca-bundle\") pod \"barbican-keystone-listener-6b6d87dc7d-zrnjh\" (UID: \"5d85f5fb-0f61-4689-9493-daa49e079f98\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6b6d87dc7d-zrnjh" Mar 16 16:26:52 crc kubenswrapper[5120]: I0316 16:26:52.817953 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ffa91919-32b8-43f8-9332-4d7c16575345-config-data\") pod \"barbican-worker-54c4c64f95-r2mxb\" (UID: \"ffa91919-32b8-43f8-9332-4d7c16575345\") " pod="openstack-kuttl-tests/barbican-worker-54c4c64f95-r2mxb" Mar 16 16:26:52 crc kubenswrapper[5120]: I0316 16:26:52.817977 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5d85f5fb-0f61-4689-9493-daa49e079f98-logs\") pod \"barbican-keystone-listener-6b6d87dc7d-zrnjh\" (UID: \"5d85f5fb-0f61-4689-9493-daa49e079f98\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6b6d87dc7d-zrnjh" Mar 16 16:26:52 crc kubenswrapper[5120]: I0316 16:26:52.818160 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5d85f5fb-0f61-4689-9493-daa49e079f98-config-data\") pod \"barbican-keystone-listener-6b6d87dc7d-zrnjh\" (UID: \"5d85f5fb-0f61-4689-9493-daa49e079f98\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6b6d87dc7d-zrnjh" Mar 16 16:26:52 crc kubenswrapper[5120]: I0316 16:26:52.818660 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ffa91919-32b8-43f8-9332-4d7c16575345-logs\") pod \"barbican-worker-54c4c64f95-r2mxb\" (UID: \"ffa91919-32b8-43f8-9332-4d7c16575345\") " pod="openstack-kuttl-tests/barbican-worker-54c4c64f95-r2mxb" Mar 16 16:26:52 crc kubenswrapper[5120]: I0316 16:26:52.820135 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-6cbd8fc548-p4pgf" Mar 16 16:26:52 crc kubenswrapper[5120]: I0316 16:26:52.828360 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-api-config-data\"" Mar 16 16:26:52 crc kubenswrapper[5120]: I0316 16:26:52.829823 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/ffa91919-32b8-43f8-9332-4d7c16575345-config-data-custom\") pod \"barbican-worker-54c4c64f95-r2mxb\" (UID: \"ffa91919-32b8-43f8-9332-4d7c16575345\") " pod="openstack-kuttl-tests/barbican-worker-54c4c64f95-r2mxb" Mar 16 16:26:52 crc kubenswrapper[5120]: I0316 16:26:52.841676 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ffa91919-32b8-43f8-9332-4d7c16575345-combined-ca-bundle\") pod \"barbican-worker-54c4c64f95-r2mxb\" (UID: \"ffa91919-32b8-43f8-9332-4d7c16575345\") " pod="openstack-kuttl-tests/barbican-worker-54c4c64f95-r2mxb" Mar 16 16:26:52 crc kubenswrapper[5120]: W0316 16:26:52.858937 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf6f3bfb6_6e3f_4a38_b39b_fe1701d8e53d.slice/crio-ac1df48f6be948edfbc2f3309615f70ea6bad8a16bf44b194d771d7e36250887 WatchSource:0}: Error finding container ac1df48f6be948edfbc2f3309615f70ea6bad8a16bf44b194d771d7e36250887: Status 404 returned error can't find the container with id ac1df48f6be948edfbc2f3309615f70ea6bad8a16bf44b194d771d7e36250887 Mar 16 16:26:52 crc kubenswrapper[5120]: I0316 16:26:52.862554 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-ckqtl"] Mar 16 16:26:52 crc kubenswrapper[5120]: I0316 16:26:52.869428 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ffa91919-32b8-43f8-9332-4d7c16575345-config-data\") pod \"barbican-worker-54c4c64f95-r2mxb\" (UID: \"ffa91919-32b8-43f8-9332-4d7c16575345\") " pod="openstack-kuttl-tests/barbican-worker-54c4c64f95-r2mxb" Mar 16 16:26:52 crc kubenswrapper[5120]: I0316 16:26:52.874827 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzmdd\" (UniqueName: \"kubernetes.io/projected/ffa91919-32b8-43f8-9332-4d7c16575345-kube-api-access-nzmdd\") pod \"barbican-worker-54c4c64f95-r2mxb\" (UID: \"ffa91919-32b8-43f8-9332-4d7c16575345\") " pod="openstack-kuttl-tests/barbican-worker-54c4c64f95-r2mxb" Mar 16 16:26:52 crc kubenswrapper[5120]: I0316 16:26:52.920964 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cd9ea9cd-8e42-4c8a-bb6e-f2ea651f47d6-combined-ca-bundle\") pod \"barbican-api-6cbd8fc548-p4pgf\" (UID: \"cd9ea9cd-8e42-4c8a-bb6e-f2ea651f47d6\") " pod="openstack-kuttl-tests/barbican-api-6cbd8fc548-p4pgf" Mar 16 16:26:52 crc kubenswrapper[5120]: I0316 16:26:52.921041 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/5d85f5fb-0f61-4689-9493-daa49e079f98-config-data-custom\") pod \"barbican-keystone-listener-6b6d87dc7d-zrnjh\" (UID: \"5d85f5fb-0f61-4689-9493-daa49e079f98\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6b6d87dc7d-zrnjh" Mar 16 16:26:52 crc kubenswrapper[5120]: I0316 16:26:52.921108 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/cd9ea9cd-8e42-4c8a-bb6e-f2ea651f47d6-config-data-custom\") pod \"barbican-api-6cbd8fc548-p4pgf\" (UID: \"cd9ea9cd-8e42-4c8a-bb6e-f2ea651f47d6\") " pod="openstack-kuttl-tests/barbican-api-6cbd8fc548-p4pgf" Mar 16 16:26:52 crc kubenswrapper[5120]: I0316 16:26:52.921172 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ztbsn\" (UniqueName: \"kubernetes.io/projected/5d85f5fb-0f61-4689-9493-daa49e079f98-kube-api-access-ztbsn\") pod \"barbican-keystone-listener-6b6d87dc7d-zrnjh\" (UID: \"5d85f5fb-0f61-4689-9493-daa49e079f98\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6b6d87dc7d-zrnjh" Mar 16 16:26:52 crc kubenswrapper[5120]: I0316 16:26:52.921217 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/cd9ea9cd-8e42-4c8a-bb6e-f2ea651f47d6-logs\") pod \"barbican-api-6cbd8fc548-p4pgf\" (UID: \"cd9ea9cd-8e42-4c8a-bb6e-f2ea651f47d6\") " pod="openstack-kuttl-tests/barbican-api-6cbd8fc548-p4pgf" Mar 16 16:26:52 crc kubenswrapper[5120]: I0316 16:26:52.921262 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5d85f5fb-0f61-4689-9493-daa49e079f98-combined-ca-bundle\") pod \"barbican-keystone-listener-6b6d87dc7d-zrnjh\" (UID: \"5d85f5fb-0f61-4689-9493-daa49e079f98\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6b6d87dc7d-zrnjh" Mar 16 16:26:52 crc kubenswrapper[5120]: I0316 16:26:52.921302 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5d85f5fb-0f61-4689-9493-daa49e079f98-logs\") pod \"barbican-keystone-listener-6b6d87dc7d-zrnjh\" (UID: \"5d85f5fb-0f61-4689-9493-daa49e079f98\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6b6d87dc7d-zrnjh" Mar 16 16:26:52 crc kubenswrapper[5120]: I0316 16:26:52.921344 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-645xv\" (UniqueName: \"kubernetes.io/projected/cd9ea9cd-8e42-4c8a-bb6e-f2ea651f47d6-kube-api-access-645xv\") pod \"barbican-api-6cbd8fc548-p4pgf\" (UID: \"cd9ea9cd-8e42-4c8a-bb6e-f2ea651f47d6\") " pod="openstack-kuttl-tests/barbican-api-6cbd8fc548-p4pgf" Mar 16 16:26:52 crc kubenswrapper[5120]: I0316 16:26:52.921415 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5d85f5fb-0f61-4689-9493-daa49e079f98-config-data\") pod \"barbican-keystone-listener-6b6d87dc7d-zrnjh\" (UID: \"5d85f5fb-0f61-4689-9493-daa49e079f98\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6b6d87dc7d-zrnjh" Mar 16 16:26:52 crc kubenswrapper[5120]: I0316 16:26:52.921436 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cd9ea9cd-8e42-4c8a-bb6e-f2ea651f47d6-config-data\") pod \"barbican-api-6cbd8fc548-p4pgf\" (UID: \"cd9ea9cd-8e42-4c8a-bb6e-f2ea651f47d6\") " pod="openstack-kuttl-tests/barbican-api-6cbd8fc548-p4pgf" Mar 16 16:26:52 crc kubenswrapper[5120]: I0316 16:26:52.922090 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5d85f5fb-0f61-4689-9493-daa49e079f98-logs\") pod \"barbican-keystone-listener-6b6d87dc7d-zrnjh\" (UID: \"5d85f5fb-0f61-4689-9493-daa49e079f98\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6b6d87dc7d-zrnjh" Mar 16 16:26:52 crc kubenswrapper[5120]: I0316 16:26:52.926303 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5d85f5fb-0f61-4689-9493-daa49e079f98-combined-ca-bundle\") pod \"barbican-keystone-listener-6b6d87dc7d-zrnjh\" (UID: \"5d85f5fb-0f61-4689-9493-daa49e079f98\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6b6d87dc7d-zrnjh" Mar 16 16:26:52 crc kubenswrapper[5120]: I0316 16:26:52.926949 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5d85f5fb-0f61-4689-9493-daa49e079f98-config-data\") pod \"barbican-keystone-listener-6b6d87dc7d-zrnjh\" (UID: \"5d85f5fb-0f61-4689-9493-daa49e079f98\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6b6d87dc7d-zrnjh" Mar 16 16:26:52 crc kubenswrapper[5120]: I0316 16:26:52.928103 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/5d85f5fb-0f61-4689-9493-daa49e079f98-config-data-custom\") pod \"barbican-keystone-listener-6b6d87dc7d-zrnjh\" (UID: \"5d85f5fb-0f61-4689-9493-daa49e079f98\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6b6d87dc7d-zrnjh" Mar 16 16:26:52 crc kubenswrapper[5120]: I0316 16:26:52.941722 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztbsn\" (UniqueName: \"kubernetes.io/projected/5d85f5fb-0f61-4689-9493-daa49e079f98-kube-api-access-ztbsn\") pod \"barbican-keystone-listener-6b6d87dc7d-zrnjh\" (UID: \"5d85f5fb-0f61-4689-9493-daa49e079f98\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6b6d87dc7d-zrnjh" Mar 16 16:26:53 crc kubenswrapper[5120]: I0316 16:26:53.023054 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cd9ea9cd-8e42-4c8a-bb6e-f2ea651f47d6-config-data\") pod \"barbican-api-6cbd8fc548-p4pgf\" (UID: \"cd9ea9cd-8e42-4c8a-bb6e-f2ea651f47d6\") " pod="openstack-kuttl-tests/barbican-api-6cbd8fc548-p4pgf" Mar 16 16:26:53 crc kubenswrapper[5120]: I0316 16:26:53.023231 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cd9ea9cd-8e42-4c8a-bb6e-f2ea651f47d6-combined-ca-bundle\") pod \"barbican-api-6cbd8fc548-p4pgf\" (UID: \"cd9ea9cd-8e42-4c8a-bb6e-f2ea651f47d6\") " pod="openstack-kuttl-tests/barbican-api-6cbd8fc548-p4pgf" Mar 16 16:26:53 crc kubenswrapper[5120]: I0316 16:26:53.023284 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/cd9ea9cd-8e42-4c8a-bb6e-f2ea651f47d6-config-data-custom\") pod \"barbican-api-6cbd8fc548-p4pgf\" (UID: \"cd9ea9cd-8e42-4c8a-bb6e-f2ea651f47d6\") " pod="openstack-kuttl-tests/barbican-api-6cbd8fc548-p4pgf" Mar 16 16:26:53 crc kubenswrapper[5120]: I0316 16:26:53.023339 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/cd9ea9cd-8e42-4c8a-bb6e-f2ea651f47d6-logs\") pod \"barbican-api-6cbd8fc548-p4pgf\" (UID: \"cd9ea9cd-8e42-4c8a-bb6e-f2ea651f47d6\") " pod="openstack-kuttl-tests/barbican-api-6cbd8fc548-p4pgf" Mar 16 16:26:53 crc kubenswrapper[5120]: I0316 16:26:53.023396 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-645xv\" (UniqueName: \"kubernetes.io/projected/cd9ea9cd-8e42-4c8a-bb6e-f2ea651f47d6-kube-api-access-645xv\") pod \"barbican-api-6cbd8fc548-p4pgf\" (UID: \"cd9ea9cd-8e42-4c8a-bb6e-f2ea651f47d6\") " pod="openstack-kuttl-tests/barbican-api-6cbd8fc548-p4pgf" Mar 16 16:26:53 crc kubenswrapper[5120]: I0316 16:26:53.024516 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/cd9ea9cd-8e42-4c8a-bb6e-f2ea651f47d6-logs\") pod \"barbican-api-6cbd8fc548-p4pgf\" (UID: \"cd9ea9cd-8e42-4c8a-bb6e-f2ea651f47d6\") " pod="openstack-kuttl-tests/barbican-api-6cbd8fc548-p4pgf" Mar 16 16:26:53 crc kubenswrapper[5120]: I0316 16:26:53.027476 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/cd9ea9cd-8e42-4c8a-bb6e-f2ea651f47d6-config-data-custom\") pod \"barbican-api-6cbd8fc548-p4pgf\" (UID: \"cd9ea9cd-8e42-4c8a-bb6e-f2ea651f47d6\") " pod="openstack-kuttl-tests/barbican-api-6cbd8fc548-p4pgf" Mar 16 16:26:53 crc kubenswrapper[5120]: I0316 16:26:53.028293 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cd9ea9cd-8e42-4c8a-bb6e-f2ea651f47d6-combined-ca-bundle\") pod \"barbican-api-6cbd8fc548-p4pgf\" (UID: \"cd9ea9cd-8e42-4c8a-bb6e-f2ea651f47d6\") " pod="openstack-kuttl-tests/barbican-api-6cbd8fc548-p4pgf" Mar 16 16:26:53 crc kubenswrapper[5120]: I0316 16:26:53.029750 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cd9ea9cd-8e42-4c8a-bb6e-f2ea651f47d6-config-data\") pod \"barbican-api-6cbd8fc548-p4pgf\" (UID: \"cd9ea9cd-8e42-4c8a-bb6e-f2ea651f47d6\") " pod="openstack-kuttl-tests/barbican-api-6cbd8fc548-p4pgf" Mar 16 16:26:53 crc kubenswrapper[5120]: I0316 16:26:53.049907 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-645xv\" (UniqueName: \"kubernetes.io/projected/cd9ea9cd-8e42-4c8a-bb6e-f2ea651f47d6-kube-api-access-645xv\") pod \"barbican-api-6cbd8fc548-p4pgf\" (UID: \"cd9ea9cd-8e42-4c8a-bb6e-f2ea651f47d6\") " pod="openstack-kuttl-tests/barbican-api-6cbd8fc548-p4pgf" Mar 16 16:26:53 crc kubenswrapper[5120]: I0316 16:26:53.095604 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-54c4c64f95-r2mxb" Mar 16 16:26:53 crc kubenswrapper[5120]: I0316 16:26:53.103110 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-6b6d87dc7d-zrnjh" Mar 16 16:26:53 crc kubenswrapper[5120]: I0316 16:26:53.314243 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-6cbd8fc548-p4pgf" Mar 16 16:26:53 crc kubenswrapper[5120]: E0316 16:26:53.350279 5120 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb90e76bc_d652_4606_8c72_4b96133ce5c4.slice\": RecentStats: unable to find data in memory cache]" Mar 16 16:26:53 crc kubenswrapper[5120]: I0316 16:26:53.676020 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-ckqtl" event={"ID":"f6f3bfb6-6e3f-4a38-b39b-fe1701d8e53d","Type":"ContainerStarted","Data":"af40068e887848d3652ff4ac2bdf2aa3e37334b0db3ca57dd999b21f07bb65f4"} Mar 16 16:26:53 crc kubenswrapper[5120]: I0316 16:26:53.676074 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-ckqtl" event={"ID":"f6f3bfb6-6e3f-4a38-b39b-fe1701d8e53d","Type":"ContainerStarted","Data":"ac1df48f6be948edfbc2f3309615f70ea6bad8a16bf44b194d771d7e36250887"} Mar 16 16:26:53 crc kubenswrapper[5120]: I0316 16:26:53.682930 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-54c4c64f95-r2mxb"] Mar 16 16:26:53 crc kubenswrapper[5120]: I0316 16:26:53.696855 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-6b678b5478-h7p85" Mar 16 16:26:53 crc kubenswrapper[5120]: I0316 16:26:53.697082 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-6b678b5478-h7p85" Mar 16 16:26:53 crc kubenswrapper[5120]: I0316 16:26:53.697146 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-6b678b5478-h7p85" event={"ID":"5b82cd86-0489-4dc6-8d45-b478e71f1083","Type":"ContainerStarted","Data":"1d966ec507ef8140bae32b68192acf2c779348364fc574d434164a1fabc006d3"} Mar 16 16:26:53 crc kubenswrapper[5120]: I0316 16:26:53.697212 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-6b678b5478-h7p85" event={"ID":"5b82cd86-0489-4dc6-8d45-b478e71f1083","Type":"ContainerStarted","Data":"e8f6039ae2940f7d60f59834673991a6d6bfe9c29f5be1c00e4f4732e54d66a1"} Mar 16 16:26:53 crc kubenswrapper[5120]: I0316 16:26:53.698158 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-bootstrap-ckqtl" podStartSLOduration=2.6981399379999997 podStartE2EDuration="2.698139938s" podCreationTimestamp="2026-03-16 16:26:51 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:26:53.691078139 +0000 UTC m=+3315.845009806" watchObservedRunningTime="2026-03-16 16:26:53.698139938 +0000 UTC m=+3315.852071585" Mar 16 16:26:53 crc kubenswrapper[5120]: W0316 16:26:53.707109 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podffa91919_32b8_43f8_9332_4d7c16575345.slice/crio-eb5cf679b2df96e98fa372572f2b7e91c656d2955be8bc1f2abe423faf66d3eb WatchSource:0}: Error finding container eb5cf679b2df96e98fa372572f2b7e91c656d2955be8bc1f2abe423faf66d3eb: Status 404 returned error can't find the container with id eb5cf679b2df96e98fa372572f2b7e91c656d2955be8bc1f2abe423faf66d3eb Mar 16 16:26:53 crc kubenswrapper[5120]: I0316 16:26:53.727501 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"0a40a3c3-a3dd-4903-8ca3-dd81b5cc204b","Type":"ContainerStarted","Data":"705be4728a99351194f75e5eb5e271de5982d8cab0ee80a1ceb23001118cd3df"} Mar 16 16:26:53 crc kubenswrapper[5120]: I0316 16:26:53.744191 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-6b678b5478-h7p85" podStartSLOduration=2.744170269 podStartE2EDuration="2.744170269s" podCreationTimestamp="2026-03-16 16:26:51 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:26:53.743871581 +0000 UTC m=+3315.897803238" watchObservedRunningTime="2026-03-16 16:26:53.744170269 +0000 UTC m=+3315.898101926" Mar 16 16:26:53 crc kubenswrapper[5120]: I0316 16:26:53.792594 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-6b6d87dc7d-zrnjh"] Mar 16 16:26:53 crc kubenswrapper[5120]: I0316 16:26:53.946920 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-6cbd8fc548-p4pgf"] Mar 16 16:26:54 crc kubenswrapper[5120]: I0316 16:26:54.738181 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-6cbd8fc548-p4pgf" event={"ID":"cd9ea9cd-8e42-4c8a-bb6e-f2ea651f47d6","Type":"ContainerStarted","Data":"51f9523062c88689496ef71fbfff0ce96830c8ad5ae75f4c74b29864a40c4c66"} Mar 16 16:26:54 crc kubenswrapper[5120]: I0316 16:26:54.738541 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-6cbd8fc548-p4pgf" event={"ID":"cd9ea9cd-8e42-4c8a-bb6e-f2ea651f47d6","Type":"ContainerStarted","Data":"e333eeeb4aa33405c67723d15ece34b6b2ae163f412601f9cdfb80afac04b901"} Mar 16 16:26:54 crc kubenswrapper[5120]: I0316 16:26:54.741895 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-6b6d87dc7d-zrnjh" event={"ID":"5d85f5fb-0f61-4689-9493-daa49e079f98","Type":"ContainerStarted","Data":"64045bb385eeaee8a027fca93390992d213763f4e9e281165275617dd4a5c78d"} Mar 16 16:26:54 crc kubenswrapper[5120]: I0316 16:26:54.741953 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-6b6d87dc7d-zrnjh" event={"ID":"5d85f5fb-0f61-4689-9493-daa49e079f98","Type":"ContainerStarted","Data":"cce839ad531cbd7b2e77de0a5e78e87cdc6f6dab2907de89b198891dc84ffa41"} Mar 16 16:26:54 crc kubenswrapper[5120]: I0316 16:26:54.744918 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"0a40a3c3-a3dd-4903-8ca3-dd81b5cc204b","Type":"ContainerStarted","Data":"babc7bcbc51ec79a205b75e7fb1d3eec97b5192ffbc515222bccd315845b9d8d"} Mar 16 16:26:54 crc kubenswrapper[5120]: I0316 16:26:54.747584 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-54c4c64f95-r2mxb" event={"ID":"ffa91919-32b8-43f8-9332-4d7c16575345","Type":"ContainerStarted","Data":"d0deb63230b940185b33fefe5581b8662da802157a78b3fbece72a39b98c9ef5"} Mar 16 16:26:54 crc kubenswrapper[5120]: I0316 16:26:54.747608 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-54c4c64f95-r2mxb" event={"ID":"ffa91919-32b8-43f8-9332-4d7c16575345","Type":"ContainerStarted","Data":"a513a169c61b77a1e92097f1bca1909c5c168bf9972bc9fc9270fdf7e43c64bf"} Mar 16 16:26:54 crc kubenswrapper[5120]: I0316 16:26:54.747617 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-54c4c64f95-r2mxb" event={"ID":"ffa91919-32b8-43f8-9332-4d7c16575345","Type":"ContainerStarted","Data":"eb5cf679b2df96e98fa372572f2b7e91c656d2955be8bc1f2abe423faf66d3eb"} Mar 16 16:26:54 crc kubenswrapper[5120]: I0316 16:26:54.767978 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-worker-54c4c64f95-r2mxb" podStartSLOduration=2.767960213 podStartE2EDuration="2.767960213s" podCreationTimestamp="2026-03-16 16:26:52 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:26:54.766058581 +0000 UTC m=+3316.919990248" watchObservedRunningTime="2026-03-16 16:26:54.767960213 +0000 UTC m=+3316.921891880" Mar 16 16:26:55 crc kubenswrapper[5120]: I0316 16:26:55.294149 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-api-6644db8644-8f7lt"] Mar 16 16:26:55 crc kubenswrapper[5120]: I0316 16:26:55.308718 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-6644db8644-8f7lt" Mar 16 16:26:55 crc kubenswrapper[5120]: I0316 16:26:55.309079 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-6644db8644-8f7lt"] Mar 16 16:26:55 crc kubenswrapper[5120]: I0316 16:26:55.312050 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-barbican-internal-svc\"" Mar 16 16:26:55 crc kubenswrapper[5120]: I0316 16:26:55.312429 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-barbican-public-svc\"" Mar 16 16:26:55 crc kubenswrapper[5120]: I0316 16:26:55.418440 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f01e7eb4-b5fe-4cfc-9657-66955e94fa03-combined-ca-bundle\") pod \"barbican-api-6644db8644-8f7lt\" (UID: \"f01e7eb4-b5fe-4cfc-9657-66955e94fa03\") " pod="openstack-kuttl-tests/barbican-api-6644db8644-8f7lt" Mar 16 16:26:55 crc kubenswrapper[5120]: I0316 16:26:55.418481 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7md6s\" (UniqueName: \"kubernetes.io/projected/f01e7eb4-b5fe-4cfc-9657-66955e94fa03-kube-api-access-7md6s\") pod \"barbican-api-6644db8644-8f7lt\" (UID: \"f01e7eb4-b5fe-4cfc-9657-66955e94fa03\") " pod="openstack-kuttl-tests/barbican-api-6644db8644-8f7lt" Mar 16 16:26:55 crc kubenswrapper[5120]: I0316 16:26:55.418612 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f01e7eb4-b5fe-4cfc-9657-66955e94fa03-logs\") pod \"barbican-api-6644db8644-8f7lt\" (UID: \"f01e7eb4-b5fe-4cfc-9657-66955e94fa03\") " pod="openstack-kuttl-tests/barbican-api-6644db8644-8f7lt" Mar 16 16:26:55 crc kubenswrapper[5120]: I0316 16:26:55.418638 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f01e7eb4-b5fe-4cfc-9657-66955e94fa03-config-data\") pod \"barbican-api-6644db8644-8f7lt\" (UID: \"f01e7eb4-b5fe-4cfc-9657-66955e94fa03\") " pod="openstack-kuttl-tests/barbican-api-6644db8644-8f7lt" Mar 16 16:26:55 crc kubenswrapper[5120]: I0316 16:26:55.418666 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f01e7eb4-b5fe-4cfc-9657-66955e94fa03-internal-tls-certs\") pod \"barbican-api-6644db8644-8f7lt\" (UID: \"f01e7eb4-b5fe-4cfc-9657-66955e94fa03\") " pod="openstack-kuttl-tests/barbican-api-6644db8644-8f7lt" Mar 16 16:26:55 crc kubenswrapper[5120]: I0316 16:26:55.418701 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/f01e7eb4-b5fe-4cfc-9657-66955e94fa03-config-data-custom\") pod \"barbican-api-6644db8644-8f7lt\" (UID: \"f01e7eb4-b5fe-4cfc-9657-66955e94fa03\") " pod="openstack-kuttl-tests/barbican-api-6644db8644-8f7lt" Mar 16 16:26:55 crc kubenswrapper[5120]: I0316 16:26:55.418837 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f01e7eb4-b5fe-4cfc-9657-66955e94fa03-public-tls-certs\") pod \"barbican-api-6644db8644-8f7lt\" (UID: \"f01e7eb4-b5fe-4cfc-9657-66955e94fa03\") " pod="openstack-kuttl-tests/barbican-api-6644db8644-8f7lt" Mar 16 16:26:55 crc kubenswrapper[5120]: I0316 16:26:55.521040 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f01e7eb4-b5fe-4cfc-9657-66955e94fa03-logs\") pod \"barbican-api-6644db8644-8f7lt\" (UID: \"f01e7eb4-b5fe-4cfc-9657-66955e94fa03\") " pod="openstack-kuttl-tests/barbican-api-6644db8644-8f7lt" Mar 16 16:26:55 crc kubenswrapper[5120]: I0316 16:26:55.521089 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f01e7eb4-b5fe-4cfc-9657-66955e94fa03-config-data\") pod \"barbican-api-6644db8644-8f7lt\" (UID: \"f01e7eb4-b5fe-4cfc-9657-66955e94fa03\") " pod="openstack-kuttl-tests/barbican-api-6644db8644-8f7lt" Mar 16 16:26:55 crc kubenswrapper[5120]: I0316 16:26:55.521117 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f01e7eb4-b5fe-4cfc-9657-66955e94fa03-internal-tls-certs\") pod \"barbican-api-6644db8644-8f7lt\" (UID: \"f01e7eb4-b5fe-4cfc-9657-66955e94fa03\") " pod="openstack-kuttl-tests/barbican-api-6644db8644-8f7lt" Mar 16 16:26:55 crc kubenswrapper[5120]: I0316 16:26:55.521154 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/f01e7eb4-b5fe-4cfc-9657-66955e94fa03-config-data-custom\") pod \"barbican-api-6644db8644-8f7lt\" (UID: \"f01e7eb4-b5fe-4cfc-9657-66955e94fa03\") " pod="openstack-kuttl-tests/barbican-api-6644db8644-8f7lt" Mar 16 16:26:55 crc kubenswrapper[5120]: I0316 16:26:55.521260 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f01e7eb4-b5fe-4cfc-9657-66955e94fa03-public-tls-certs\") pod \"barbican-api-6644db8644-8f7lt\" (UID: \"f01e7eb4-b5fe-4cfc-9657-66955e94fa03\") " pod="openstack-kuttl-tests/barbican-api-6644db8644-8f7lt" Mar 16 16:26:55 crc kubenswrapper[5120]: I0316 16:26:55.521341 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f01e7eb4-b5fe-4cfc-9657-66955e94fa03-combined-ca-bundle\") pod \"barbican-api-6644db8644-8f7lt\" (UID: \"f01e7eb4-b5fe-4cfc-9657-66955e94fa03\") " pod="openstack-kuttl-tests/barbican-api-6644db8644-8f7lt" Mar 16 16:26:55 crc kubenswrapper[5120]: I0316 16:26:55.521363 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7md6s\" (UniqueName: \"kubernetes.io/projected/f01e7eb4-b5fe-4cfc-9657-66955e94fa03-kube-api-access-7md6s\") pod \"barbican-api-6644db8644-8f7lt\" (UID: \"f01e7eb4-b5fe-4cfc-9657-66955e94fa03\") " pod="openstack-kuttl-tests/barbican-api-6644db8644-8f7lt" Mar 16 16:26:55 crc kubenswrapper[5120]: I0316 16:26:55.521506 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f01e7eb4-b5fe-4cfc-9657-66955e94fa03-logs\") pod \"barbican-api-6644db8644-8f7lt\" (UID: \"f01e7eb4-b5fe-4cfc-9657-66955e94fa03\") " pod="openstack-kuttl-tests/barbican-api-6644db8644-8f7lt" Mar 16 16:26:55 crc kubenswrapper[5120]: I0316 16:26:55.526929 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/f01e7eb4-b5fe-4cfc-9657-66955e94fa03-config-data-custom\") pod \"barbican-api-6644db8644-8f7lt\" (UID: \"f01e7eb4-b5fe-4cfc-9657-66955e94fa03\") " pod="openstack-kuttl-tests/barbican-api-6644db8644-8f7lt" Mar 16 16:26:55 crc kubenswrapper[5120]: I0316 16:26:55.527181 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f01e7eb4-b5fe-4cfc-9657-66955e94fa03-combined-ca-bundle\") pod \"barbican-api-6644db8644-8f7lt\" (UID: \"f01e7eb4-b5fe-4cfc-9657-66955e94fa03\") " pod="openstack-kuttl-tests/barbican-api-6644db8644-8f7lt" Mar 16 16:26:55 crc kubenswrapper[5120]: I0316 16:26:55.527904 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f01e7eb4-b5fe-4cfc-9657-66955e94fa03-internal-tls-certs\") pod \"barbican-api-6644db8644-8f7lt\" (UID: \"f01e7eb4-b5fe-4cfc-9657-66955e94fa03\") " pod="openstack-kuttl-tests/barbican-api-6644db8644-8f7lt" Mar 16 16:26:55 crc kubenswrapper[5120]: I0316 16:26:55.528114 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f01e7eb4-b5fe-4cfc-9657-66955e94fa03-config-data\") pod \"barbican-api-6644db8644-8f7lt\" (UID: \"f01e7eb4-b5fe-4cfc-9657-66955e94fa03\") " pod="openstack-kuttl-tests/barbican-api-6644db8644-8f7lt" Mar 16 16:26:55 crc kubenswrapper[5120]: I0316 16:26:55.529007 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f01e7eb4-b5fe-4cfc-9657-66955e94fa03-public-tls-certs\") pod \"barbican-api-6644db8644-8f7lt\" (UID: \"f01e7eb4-b5fe-4cfc-9657-66955e94fa03\") " pod="openstack-kuttl-tests/barbican-api-6644db8644-8f7lt" Mar 16 16:26:55 crc kubenswrapper[5120]: I0316 16:26:55.542470 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7md6s\" (UniqueName: \"kubernetes.io/projected/f01e7eb4-b5fe-4cfc-9657-66955e94fa03-kube-api-access-7md6s\") pod \"barbican-api-6644db8644-8f7lt\" (UID: \"f01e7eb4-b5fe-4cfc-9657-66955e94fa03\") " pod="openstack-kuttl-tests/barbican-api-6644db8644-8f7lt" Mar 16 16:26:55 crc kubenswrapper[5120]: I0316 16:26:55.627923 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-6644db8644-8f7lt" Mar 16 16:26:55 crc kubenswrapper[5120]: I0316 16:26:55.787794 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-6b6d87dc7d-zrnjh" event={"ID":"5d85f5fb-0f61-4689-9493-daa49e079f98","Type":"ContainerStarted","Data":"4c6a773512b7a3c9b35b5154fc493c76e16e8601967c0466aeba16db6bcfa5c6"} Mar 16 16:26:55 crc kubenswrapper[5120]: I0316 16:26:55.795120 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-6cbd8fc548-p4pgf" event={"ID":"cd9ea9cd-8e42-4c8a-bb6e-f2ea651f47d6","Type":"ContainerStarted","Data":"bc2f0f9bde0f32d49d1df4f716f7d818727db184ca8e18433ffc6aab79dbf31d"} Mar 16 16:26:55 crc kubenswrapper[5120]: I0316 16:26:55.795529 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-6cbd8fc548-p4pgf" Mar 16 16:26:55 crc kubenswrapper[5120]: I0316 16:26:55.795719 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-6cbd8fc548-p4pgf" Mar 16 16:26:55 crc kubenswrapper[5120]: I0316 16:26:55.805443 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-keystone-listener-6b6d87dc7d-zrnjh" podStartSLOduration=3.805427962 podStartE2EDuration="3.805427962s" podCreationTimestamp="2026-03-16 16:26:52 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:26:55.802408181 +0000 UTC m=+3317.956339838" watchObservedRunningTime="2026-03-16 16:26:55.805427962 +0000 UTC m=+3317.959359619" Mar 16 16:26:56 crc kubenswrapper[5120]: I0316 16:26:56.115396 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-api-6cbd8fc548-p4pgf" podStartSLOduration=4.115376262 podStartE2EDuration="4.115376262s" podCreationTimestamp="2026-03-16 16:26:52 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:26:55.830360678 +0000 UTC m=+3317.984292335" watchObservedRunningTime="2026-03-16 16:26:56.115376262 +0000 UTC m=+3318.269307909" Mar 16 16:26:56 crc kubenswrapper[5120]: I0316 16:26:56.126788 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-6644db8644-8f7lt"] Mar 16 16:26:56 crc kubenswrapper[5120]: I0316 16:26:56.807260 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-6644db8644-8f7lt" event={"ID":"f01e7eb4-b5fe-4cfc-9657-66955e94fa03","Type":"ContainerStarted","Data":"8c6f35ac2a4ae8db4c7f86f87aaa9f9d6f44d088bc2852c398dd7214cf0458c9"} Mar 16 16:26:56 crc kubenswrapper[5120]: I0316 16:26:56.807653 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-6644db8644-8f7lt" Mar 16 16:26:56 crc kubenswrapper[5120]: I0316 16:26:56.807667 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-6644db8644-8f7lt" event={"ID":"f01e7eb4-b5fe-4cfc-9657-66955e94fa03","Type":"ContainerStarted","Data":"507c172a147fc2718d35a597fd31cfd6ff8094f9490ea2b077d0e8181af5ffee"} Mar 16 16:26:56 crc kubenswrapper[5120]: I0316 16:26:56.807678 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-6644db8644-8f7lt" Mar 16 16:26:56 crc kubenswrapper[5120]: I0316 16:26:56.807687 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-6644db8644-8f7lt" event={"ID":"f01e7eb4-b5fe-4cfc-9657-66955e94fa03","Type":"ContainerStarted","Data":"ba12e7a25f4864d971c48a55095397a7ca2c8e3291b48f8e75394c465bad6a7d"} Mar 16 16:26:56 crc kubenswrapper[5120]: I0316 16:26:56.810668 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"0a40a3c3-a3dd-4903-8ca3-dd81b5cc204b","Type":"ContainerStarted","Data":"4e7def1edf6a9706e2c5904fe44a18b12085fa7a0c366fef96164b86a1effb75"} Mar 16 16:26:56 crc kubenswrapper[5120]: I0316 16:26:56.810940 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:26:56 crc kubenswrapper[5120]: I0316 16:26:56.812815 5120 generic.go:358] "Generic (PLEG): container finished" podID="f6f3bfb6-6e3f-4a38-b39b-fe1701d8e53d" containerID="af40068e887848d3652ff4ac2bdf2aa3e37334b0db3ca57dd999b21f07bb65f4" exitCode=0 Mar 16 16:26:56 crc kubenswrapper[5120]: I0316 16:26:56.812888 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-ckqtl" event={"ID":"f6f3bfb6-6e3f-4a38-b39b-fe1701d8e53d","Type":"ContainerDied","Data":"af40068e887848d3652ff4ac2bdf2aa3e37334b0db3ca57dd999b21f07bb65f4"} Mar 16 16:26:56 crc kubenswrapper[5120]: I0316 16:26:56.826260 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-api-6644db8644-8f7lt" podStartSLOduration=1.826242686 podStartE2EDuration="1.826242686s" podCreationTimestamp="2026-03-16 16:26:55 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:26:56.823284087 +0000 UTC m=+3318.977215764" watchObservedRunningTime="2026-03-16 16:26:56.826242686 +0000 UTC m=+3318.980174343" Mar 16 16:26:57 crc kubenswrapper[5120]: I0316 16:26:57.827269 5120 generic.go:358] "Generic (PLEG): container finished" podID="88e6fbd8-42f7-446d-a9cb-0fc5d8a9c6bb" containerID="3ea3b93a53d44177134dfe19885a2195f929d6eb949caecb62bf340e324066e7" exitCode=0 Mar 16 16:26:57 crc kubenswrapper[5120]: I0316 16:26:57.829716 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-d8bvp" event={"ID":"88e6fbd8-42f7-446d-a9cb-0fc5d8a9c6bb","Type":"ContainerDied","Data":"3ea3b93a53d44177134dfe19885a2195f929d6eb949caecb62bf340e324066e7"} Mar 16 16:26:57 crc kubenswrapper[5120]: I0316 16:26:57.865480 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=3.29590321 podStartE2EDuration="7.865459482s" podCreationTimestamp="2026-03-16 16:26:50 +0000 UTC" firstStartedPulling="2026-03-16 16:26:51.458171015 +0000 UTC m=+3313.612102672" lastFinishedPulling="2026-03-16 16:26:56.027727287 +0000 UTC m=+3318.181658944" observedRunningTime="2026-03-16 16:26:56.873202572 +0000 UTC m=+3319.027134239" watchObservedRunningTime="2026-03-16 16:26:57.865459482 +0000 UTC m=+3320.019391139" Mar 16 16:26:58 crc kubenswrapper[5120]: I0316 16:26:58.255427 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-ckqtl" Mar 16 16:26:58 crc kubenswrapper[5120]: I0316 16:26:58.300788 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xwbgh\" (UniqueName: \"kubernetes.io/projected/f6f3bfb6-6e3f-4a38-b39b-fe1701d8e53d-kube-api-access-xwbgh\") pod \"f6f3bfb6-6e3f-4a38-b39b-fe1701d8e53d\" (UID: \"f6f3bfb6-6e3f-4a38-b39b-fe1701d8e53d\") " Mar 16 16:26:58 crc kubenswrapper[5120]: I0316 16:26:58.300895 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f6f3bfb6-6e3f-4a38-b39b-fe1701d8e53d-config-data\") pod \"f6f3bfb6-6e3f-4a38-b39b-fe1701d8e53d\" (UID: \"f6f3bfb6-6e3f-4a38-b39b-fe1701d8e53d\") " Mar 16 16:26:58 crc kubenswrapper[5120]: I0316 16:26:58.301049 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/f6f3bfb6-6e3f-4a38-b39b-fe1701d8e53d-fernet-keys\") pod \"f6f3bfb6-6e3f-4a38-b39b-fe1701d8e53d\" (UID: \"f6f3bfb6-6e3f-4a38-b39b-fe1701d8e53d\") " Mar 16 16:26:58 crc kubenswrapper[5120]: I0316 16:26:58.301210 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f6f3bfb6-6e3f-4a38-b39b-fe1701d8e53d-combined-ca-bundle\") pod \"f6f3bfb6-6e3f-4a38-b39b-fe1701d8e53d\" (UID: \"f6f3bfb6-6e3f-4a38-b39b-fe1701d8e53d\") " Mar 16 16:26:58 crc kubenswrapper[5120]: I0316 16:26:58.301922 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/f6f3bfb6-6e3f-4a38-b39b-fe1701d8e53d-credential-keys\") pod \"f6f3bfb6-6e3f-4a38-b39b-fe1701d8e53d\" (UID: \"f6f3bfb6-6e3f-4a38-b39b-fe1701d8e53d\") " Mar 16 16:26:58 crc kubenswrapper[5120]: I0316 16:26:58.302683 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f6f3bfb6-6e3f-4a38-b39b-fe1701d8e53d-scripts\") pod \"f6f3bfb6-6e3f-4a38-b39b-fe1701d8e53d\" (UID: \"f6f3bfb6-6e3f-4a38-b39b-fe1701d8e53d\") " Mar 16 16:26:58 crc kubenswrapper[5120]: I0316 16:26:58.307653 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f6f3bfb6-6e3f-4a38-b39b-fe1701d8e53d-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "f6f3bfb6-6e3f-4a38-b39b-fe1701d8e53d" (UID: "f6f3bfb6-6e3f-4a38-b39b-fe1701d8e53d"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:26:58 crc kubenswrapper[5120]: I0316 16:26:58.309466 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6f3bfb6-6e3f-4a38-b39b-fe1701d8e53d-kube-api-access-xwbgh" (OuterVolumeSpecName: "kube-api-access-xwbgh") pod "f6f3bfb6-6e3f-4a38-b39b-fe1701d8e53d" (UID: "f6f3bfb6-6e3f-4a38-b39b-fe1701d8e53d"). InnerVolumeSpecName "kube-api-access-xwbgh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:26:58 crc kubenswrapper[5120]: I0316 16:26:58.309968 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f6f3bfb6-6e3f-4a38-b39b-fe1701d8e53d-scripts" (OuterVolumeSpecName: "scripts") pod "f6f3bfb6-6e3f-4a38-b39b-fe1701d8e53d" (UID: "f6f3bfb6-6e3f-4a38-b39b-fe1701d8e53d"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:26:58 crc kubenswrapper[5120]: I0316 16:26:58.310387 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f6f3bfb6-6e3f-4a38-b39b-fe1701d8e53d-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "f6f3bfb6-6e3f-4a38-b39b-fe1701d8e53d" (UID: "f6f3bfb6-6e3f-4a38-b39b-fe1701d8e53d"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:26:58 crc kubenswrapper[5120]: I0316 16:26:58.337582 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f6f3bfb6-6e3f-4a38-b39b-fe1701d8e53d-config-data" (OuterVolumeSpecName: "config-data") pod "f6f3bfb6-6e3f-4a38-b39b-fe1701d8e53d" (UID: "f6f3bfb6-6e3f-4a38-b39b-fe1701d8e53d"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:26:58 crc kubenswrapper[5120]: I0316 16:26:58.339750 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f6f3bfb6-6e3f-4a38-b39b-fe1701d8e53d-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f6f3bfb6-6e3f-4a38-b39b-fe1701d8e53d" (UID: "f6f3bfb6-6e3f-4a38-b39b-fe1701d8e53d"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:26:58 crc kubenswrapper[5120]: I0316 16:26:58.407185 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f6f3bfb6-6e3f-4a38-b39b-fe1701d8e53d-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:26:58 crc kubenswrapper[5120]: I0316 16:26:58.407469 5120 reconciler_common.go:299] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/f6f3bfb6-6e3f-4a38-b39b-fe1701d8e53d-credential-keys\") on node \"crc\" DevicePath \"\"" Mar 16 16:26:58 crc kubenswrapper[5120]: I0316 16:26:58.407480 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f6f3bfb6-6e3f-4a38-b39b-fe1701d8e53d-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:26:58 crc kubenswrapper[5120]: I0316 16:26:58.407489 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xwbgh\" (UniqueName: \"kubernetes.io/projected/f6f3bfb6-6e3f-4a38-b39b-fe1701d8e53d-kube-api-access-xwbgh\") on node \"crc\" DevicePath \"\"" Mar 16 16:26:58 crc kubenswrapper[5120]: I0316 16:26:58.407500 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f6f3bfb6-6e3f-4a38-b39b-fe1701d8e53d-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:26:58 crc kubenswrapper[5120]: I0316 16:26:58.407519 5120 reconciler_common.go:299] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/f6f3bfb6-6e3f-4a38-b39b-fe1701d8e53d-fernet-keys\") on node \"crc\" DevicePath \"\"" Mar 16 16:26:58 crc kubenswrapper[5120]: I0316 16:26:58.846636 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-ckqtl" event={"ID":"f6f3bfb6-6e3f-4a38-b39b-fe1701d8e53d","Type":"ContainerDied","Data":"ac1df48f6be948edfbc2f3309615f70ea6bad8a16bf44b194d771d7e36250887"} Mar 16 16:26:58 crc kubenswrapper[5120]: I0316 16:26:58.846732 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ac1df48f6be948edfbc2f3309615f70ea6bad8a16bf44b194d771d7e36250887" Mar 16 16:26:58 crc kubenswrapper[5120]: I0316 16:26:58.846674 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-ckqtl" Mar 16 16:26:58 crc kubenswrapper[5120]: I0316 16:26:58.956144 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-6bf8d6479c-9rjt6"] Mar 16 16:26:58 crc kubenswrapper[5120]: I0316 16:26:58.958535 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6f3bfb6-6e3f-4a38-b39b-fe1701d8e53d" containerName="keystone-bootstrap" Mar 16 16:26:58 crc kubenswrapper[5120]: I0316 16:26:58.958560 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6f3bfb6-6e3f-4a38-b39b-fe1701d8e53d" containerName="keystone-bootstrap" Mar 16 16:26:58 crc kubenswrapper[5120]: I0316 16:26:58.958790 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f6f3bfb6-6e3f-4a38-b39b-fe1701d8e53d" containerName="keystone-bootstrap" Mar 16 16:26:58 crc kubenswrapper[5120]: I0316 16:26:58.963145 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-6bf8d6479c-9rjt6" Mar 16 16:26:58 crc kubenswrapper[5120]: I0316 16:26:58.967289 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-config-data\"" Mar 16 16:26:58 crc kubenswrapper[5120]: I0316 16:26:58.967652 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-keystone-dockercfg-9hkx9\"" Mar 16 16:26:58 crc kubenswrapper[5120]: I0316 16:26:58.967982 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-keystone-public-svc\"" Mar 16 16:26:58 crc kubenswrapper[5120]: I0316 16:26:58.968202 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-keystone-internal-svc\"" Mar 16 16:26:58 crc kubenswrapper[5120]: I0316 16:26:58.969771 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone\"" Mar 16 16:26:58 crc kubenswrapper[5120]: I0316 16:26:58.974633 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-6bf8d6479c-9rjt6"] Mar 16 16:26:58 crc kubenswrapper[5120]: I0316 16:26:58.976836 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-scripts\"" Mar 16 16:26:59 crc kubenswrapper[5120]: I0316 16:26:59.022395 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0b62aed8-ea87-465a-be46-45ce06fedbb7-config-data\") pod \"keystone-6bf8d6479c-9rjt6\" (UID: \"0b62aed8-ea87-465a-be46-45ce06fedbb7\") " pod="openstack-kuttl-tests/keystone-6bf8d6479c-9rjt6" Mar 16 16:26:59 crc kubenswrapper[5120]: I0316 16:26:59.022494 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/0b62aed8-ea87-465a-be46-45ce06fedbb7-internal-tls-certs\") pod \"keystone-6bf8d6479c-9rjt6\" (UID: \"0b62aed8-ea87-465a-be46-45ce06fedbb7\") " pod="openstack-kuttl-tests/keystone-6bf8d6479c-9rjt6" Mar 16 16:26:59 crc kubenswrapper[5120]: I0316 16:26:59.022534 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/0b62aed8-ea87-465a-be46-45ce06fedbb7-fernet-keys\") pod \"keystone-6bf8d6479c-9rjt6\" (UID: \"0b62aed8-ea87-465a-be46-45ce06fedbb7\") " pod="openstack-kuttl-tests/keystone-6bf8d6479c-9rjt6" Mar 16 16:26:59 crc kubenswrapper[5120]: I0316 16:26:59.022571 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-229t2\" (UniqueName: \"kubernetes.io/projected/0b62aed8-ea87-465a-be46-45ce06fedbb7-kube-api-access-229t2\") pod \"keystone-6bf8d6479c-9rjt6\" (UID: \"0b62aed8-ea87-465a-be46-45ce06fedbb7\") " pod="openstack-kuttl-tests/keystone-6bf8d6479c-9rjt6" Mar 16 16:26:59 crc kubenswrapper[5120]: I0316 16:26:59.022602 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/0b62aed8-ea87-465a-be46-45ce06fedbb7-public-tls-certs\") pod \"keystone-6bf8d6479c-9rjt6\" (UID: \"0b62aed8-ea87-465a-be46-45ce06fedbb7\") " pod="openstack-kuttl-tests/keystone-6bf8d6479c-9rjt6" Mar 16 16:26:59 crc kubenswrapper[5120]: I0316 16:26:59.022698 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/0b62aed8-ea87-465a-be46-45ce06fedbb7-credential-keys\") pod \"keystone-6bf8d6479c-9rjt6\" (UID: \"0b62aed8-ea87-465a-be46-45ce06fedbb7\") " pod="openstack-kuttl-tests/keystone-6bf8d6479c-9rjt6" Mar 16 16:26:59 crc kubenswrapper[5120]: I0316 16:26:59.022722 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0b62aed8-ea87-465a-be46-45ce06fedbb7-scripts\") pod \"keystone-6bf8d6479c-9rjt6\" (UID: \"0b62aed8-ea87-465a-be46-45ce06fedbb7\") " pod="openstack-kuttl-tests/keystone-6bf8d6479c-9rjt6" Mar 16 16:26:59 crc kubenswrapper[5120]: I0316 16:26:59.022804 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0b62aed8-ea87-465a-be46-45ce06fedbb7-combined-ca-bundle\") pod \"keystone-6bf8d6479c-9rjt6\" (UID: \"0b62aed8-ea87-465a-be46-45ce06fedbb7\") " pod="openstack-kuttl-tests/keystone-6bf8d6479c-9rjt6" Mar 16 16:26:59 crc kubenswrapper[5120]: I0316 16:26:59.124930 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/0b62aed8-ea87-465a-be46-45ce06fedbb7-credential-keys\") pod \"keystone-6bf8d6479c-9rjt6\" (UID: \"0b62aed8-ea87-465a-be46-45ce06fedbb7\") " pod="openstack-kuttl-tests/keystone-6bf8d6479c-9rjt6" Mar 16 16:26:59 crc kubenswrapper[5120]: I0316 16:26:59.124982 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0b62aed8-ea87-465a-be46-45ce06fedbb7-scripts\") pod \"keystone-6bf8d6479c-9rjt6\" (UID: \"0b62aed8-ea87-465a-be46-45ce06fedbb7\") " pod="openstack-kuttl-tests/keystone-6bf8d6479c-9rjt6" Mar 16 16:26:59 crc kubenswrapper[5120]: I0316 16:26:59.125050 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0b62aed8-ea87-465a-be46-45ce06fedbb7-combined-ca-bundle\") pod \"keystone-6bf8d6479c-9rjt6\" (UID: \"0b62aed8-ea87-465a-be46-45ce06fedbb7\") " pod="openstack-kuttl-tests/keystone-6bf8d6479c-9rjt6" Mar 16 16:26:59 crc kubenswrapper[5120]: I0316 16:26:59.125121 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0b62aed8-ea87-465a-be46-45ce06fedbb7-config-data\") pod \"keystone-6bf8d6479c-9rjt6\" (UID: \"0b62aed8-ea87-465a-be46-45ce06fedbb7\") " pod="openstack-kuttl-tests/keystone-6bf8d6479c-9rjt6" Mar 16 16:26:59 crc kubenswrapper[5120]: I0316 16:26:59.125197 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/0b62aed8-ea87-465a-be46-45ce06fedbb7-internal-tls-certs\") pod \"keystone-6bf8d6479c-9rjt6\" (UID: \"0b62aed8-ea87-465a-be46-45ce06fedbb7\") " pod="openstack-kuttl-tests/keystone-6bf8d6479c-9rjt6" Mar 16 16:26:59 crc kubenswrapper[5120]: I0316 16:26:59.125228 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/0b62aed8-ea87-465a-be46-45ce06fedbb7-fernet-keys\") pod \"keystone-6bf8d6479c-9rjt6\" (UID: \"0b62aed8-ea87-465a-be46-45ce06fedbb7\") " pod="openstack-kuttl-tests/keystone-6bf8d6479c-9rjt6" Mar 16 16:26:59 crc kubenswrapper[5120]: I0316 16:26:59.125262 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-229t2\" (UniqueName: \"kubernetes.io/projected/0b62aed8-ea87-465a-be46-45ce06fedbb7-kube-api-access-229t2\") pod \"keystone-6bf8d6479c-9rjt6\" (UID: \"0b62aed8-ea87-465a-be46-45ce06fedbb7\") " pod="openstack-kuttl-tests/keystone-6bf8d6479c-9rjt6" Mar 16 16:26:59 crc kubenswrapper[5120]: I0316 16:26:59.125292 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/0b62aed8-ea87-465a-be46-45ce06fedbb7-public-tls-certs\") pod \"keystone-6bf8d6479c-9rjt6\" (UID: \"0b62aed8-ea87-465a-be46-45ce06fedbb7\") " pod="openstack-kuttl-tests/keystone-6bf8d6479c-9rjt6" Mar 16 16:26:59 crc kubenswrapper[5120]: I0316 16:26:59.130682 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/0b62aed8-ea87-465a-be46-45ce06fedbb7-credential-keys\") pod \"keystone-6bf8d6479c-9rjt6\" (UID: \"0b62aed8-ea87-465a-be46-45ce06fedbb7\") " pod="openstack-kuttl-tests/keystone-6bf8d6479c-9rjt6" Mar 16 16:26:59 crc kubenswrapper[5120]: I0316 16:26:59.130699 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/0b62aed8-ea87-465a-be46-45ce06fedbb7-public-tls-certs\") pod \"keystone-6bf8d6479c-9rjt6\" (UID: \"0b62aed8-ea87-465a-be46-45ce06fedbb7\") " pod="openstack-kuttl-tests/keystone-6bf8d6479c-9rjt6" Mar 16 16:26:59 crc kubenswrapper[5120]: I0316 16:26:59.131330 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0b62aed8-ea87-465a-be46-45ce06fedbb7-config-data\") pod \"keystone-6bf8d6479c-9rjt6\" (UID: \"0b62aed8-ea87-465a-be46-45ce06fedbb7\") " pod="openstack-kuttl-tests/keystone-6bf8d6479c-9rjt6" Mar 16 16:26:59 crc kubenswrapper[5120]: I0316 16:26:59.133330 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0b62aed8-ea87-465a-be46-45ce06fedbb7-scripts\") pod \"keystone-6bf8d6479c-9rjt6\" (UID: \"0b62aed8-ea87-465a-be46-45ce06fedbb7\") " pod="openstack-kuttl-tests/keystone-6bf8d6479c-9rjt6" Mar 16 16:26:59 crc kubenswrapper[5120]: I0316 16:26:59.133615 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/0b62aed8-ea87-465a-be46-45ce06fedbb7-fernet-keys\") pod \"keystone-6bf8d6479c-9rjt6\" (UID: \"0b62aed8-ea87-465a-be46-45ce06fedbb7\") " pod="openstack-kuttl-tests/keystone-6bf8d6479c-9rjt6" Mar 16 16:26:59 crc kubenswrapper[5120]: I0316 16:26:59.142706 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/0b62aed8-ea87-465a-be46-45ce06fedbb7-internal-tls-certs\") pod \"keystone-6bf8d6479c-9rjt6\" (UID: \"0b62aed8-ea87-465a-be46-45ce06fedbb7\") " pod="openstack-kuttl-tests/keystone-6bf8d6479c-9rjt6" Mar 16 16:26:59 crc kubenswrapper[5120]: I0316 16:26:59.145299 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-229t2\" (UniqueName: \"kubernetes.io/projected/0b62aed8-ea87-465a-be46-45ce06fedbb7-kube-api-access-229t2\") pod \"keystone-6bf8d6479c-9rjt6\" (UID: \"0b62aed8-ea87-465a-be46-45ce06fedbb7\") " pod="openstack-kuttl-tests/keystone-6bf8d6479c-9rjt6" Mar 16 16:26:59 crc kubenswrapper[5120]: I0316 16:26:59.145880 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0b62aed8-ea87-465a-be46-45ce06fedbb7-combined-ca-bundle\") pod \"keystone-6bf8d6479c-9rjt6\" (UID: \"0b62aed8-ea87-465a-be46-45ce06fedbb7\") " pod="openstack-kuttl-tests/keystone-6bf8d6479c-9rjt6" Mar 16 16:26:59 crc kubenswrapper[5120]: I0316 16:26:59.283104 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-6bf8d6479c-9rjt6" Mar 16 16:26:59 crc kubenswrapper[5120]: I0316 16:26:59.299483 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-d8bvp" Mar 16 16:26:59 crc kubenswrapper[5120]: I0316 16:26:59.329271 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2bfs2\" (UniqueName: \"kubernetes.io/projected/88e6fbd8-42f7-446d-a9cb-0fc5d8a9c6bb-kube-api-access-2bfs2\") pod \"88e6fbd8-42f7-446d-a9cb-0fc5d8a9c6bb\" (UID: \"88e6fbd8-42f7-446d-a9cb-0fc5d8a9c6bb\") " Mar 16 16:26:59 crc kubenswrapper[5120]: I0316 16:26:59.329491 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/88e6fbd8-42f7-446d-a9cb-0fc5d8a9c6bb-etc-machine-id\") pod \"88e6fbd8-42f7-446d-a9cb-0fc5d8a9c6bb\" (UID: \"88e6fbd8-42f7-446d-a9cb-0fc5d8a9c6bb\") " Mar 16 16:26:59 crc kubenswrapper[5120]: I0316 16:26:59.329648 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/88e6fbd8-42f7-446d-a9cb-0fc5d8a9c6bb-combined-ca-bundle\") pod \"88e6fbd8-42f7-446d-a9cb-0fc5d8a9c6bb\" (UID: \"88e6fbd8-42f7-446d-a9cb-0fc5d8a9c6bb\") " Mar 16 16:26:59 crc kubenswrapper[5120]: I0316 16:26:59.329775 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/88e6fbd8-42f7-446d-a9cb-0fc5d8a9c6bb-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "88e6fbd8-42f7-446d-a9cb-0fc5d8a9c6bb" (UID: "88e6fbd8-42f7-446d-a9cb-0fc5d8a9c6bb"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 16:26:59 crc kubenswrapper[5120]: I0316 16:26:59.329926 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/88e6fbd8-42f7-446d-a9cb-0fc5d8a9c6bb-db-sync-config-data\") pod \"88e6fbd8-42f7-446d-a9cb-0fc5d8a9c6bb\" (UID: \"88e6fbd8-42f7-446d-a9cb-0fc5d8a9c6bb\") " Mar 16 16:26:59 crc kubenswrapper[5120]: I0316 16:26:59.330020 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/88e6fbd8-42f7-446d-a9cb-0fc5d8a9c6bb-scripts\") pod \"88e6fbd8-42f7-446d-a9cb-0fc5d8a9c6bb\" (UID: \"88e6fbd8-42f7-446d-a9cb-0fc5d8a9c6bb\") " Mar 16 16:26:59 crc kubenswrapper[5120]: I0316 16:26:59.330143 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/88e6fbd8-42f7-446d-a9cb-0fc5d8a9c6bb-config-data\") pod \"88e6fbd8-42f7-446d-a9cb-0fc5d8a9c6bb\" (UID: \"88e6fbd8-42f7-446d-a9cb-0fc5d8a9c6bb\") " Mar 16 16:26:59 crc kubenswrapper[5120]: I0316 16:26:59.331092 5120 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/88e6fbd8-42f7-446d-a9cb-0fc5d8a9c6bb-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 16:26:59 crc kubenswrapper[5120]: I0316 16:26:59.335464 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88e6fbd8-42f7-446d-a9cb-0fc5d8a9c6bb-kube-api-access-2bfs2" (OuterVolumeSpecName: "kube-api-access-2bfs2") pod "88e6fbd8-42f7-446d-a9cb-0fc5d8a9c6bb" (UID: "88e6fbd8-42f7-446d-a9cb-0fc5d8a9c6bb"). InnerVolumeSpecName "kube-api-access-2bfs2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:26:59 crc kubenswrapper[5120]: I0316 16:26:59.337272 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/88e6fbd8-42f7-446d-a9cb-0fc5d8a9c6bb-db-sync-config-data" (OuterVolumeSpecName: "db-sync-config-data") pod "88e6fbd8-42f7-446d-a9cb-0fc5d8a9c6bb" (UID: "88e6fbd8-42f7-446d-a9cb-0fc5d8a9c6bb"). InnerVolumeSpecName "db-sync-config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:26:59 crc kubenswrapper[5120]: I0316 16:26:59.352060 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/88e6fbd8-42f7-446d-a9cb-0fc5d8a9c6bb-scripts" (OuterVolumeSpecName: "scripts") pod "88e6fbd8-42f7-446d-a9cb-0fc5d8a9c6bb" (UID: "88e6fbd8-42f7-446d-a9cb-0fc5d8a9c6bb"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:26:59 crc kubenswrapper[5120]: I0316 16:26:59.375889 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/88e6fbd8-42f7-446d-a9cb-0fc5d8a9c6bb-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "88e6fbd8-42f7-446d-a9cb-0fc5d8a9c6bb" (UID: "88e6fbd8-42f7-446d-a9cb-0fc5d8a9c6bb"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:26:59 crc kubenswrapper[5120]: I0316 16:26:59.423971 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/88e6fbd8-42f7-446d-a9cb-0fc5d8a9c6bb-config-data" (OuterVolumeSpecName: "config-data") pod "88e6fbd8-42f7-446d-a9cb-0fc5d8a9c6bb" (UID: "88e6fbd8-42f7-446d-a9cb-0fc5d8a9c6bb"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:26:59 crc kubenswrapper[5120]: I0316 16:26:59.433406 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/88e6fbd8-42f7-446d-a9cb-0fc5d8a9c6bb-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:26:59 crc kubenswrapper[5120]: I0316 16:26:59.433441 5120 reconciler_common.go:299] "Volume detached for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/88e6fbd8-42f7-446d-a9cb-0fc5d8a9c6bb-db-sync-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:26:59 crc kubenswrapper[5120]: I0316 16:26:59.433451 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/88e6fbd8-42f7-446d-a9cb-0fc5d8a9c6bb-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:26:59 crc kubenswrapper[5120]: I0316 16:26:59.433459 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/88e6fbd8-42f7-446d-a9cb-0fc5d8a9c6bb-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:26:59 crc kubenswrapper[5120]: I0316 16:26:59.433467 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2bfs2\" (UniqueName: \"kubernetes.io/projected/88e6fbd8-42f7-446d-a9cb-0fc5d8a9c6bb-kube-api-access-2bfs2\") on node \"crc\" DevicePath \"\"" Mar 16 16:26:59 crc kubenswrapper[5120]: I0316 16:26:59.762232 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-6bf8d6479c-9rjt6"] Mar 16 16:26:59 crc kubenswrapper[5120]: W0316 16:26:59.763869 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0b62aed8_ea87_465a_be46_45ce06fedbb7.slice/crio-53d4ad4e12a94e2b07d00ab9c5191113f00c86184d6fafabdf4364f9b75b5fc2 WatchSource:0}: Error finding container 53d4ad4e12a94e2b07d00ab9c5191113f00c86184d6fafabdf4364f9b75b5fc2: Status 404 returned error can't find the container with id 53d4ad4e12a94e2b07d00ab9c5191113f00c86184d6fafabdf4364f9b75b5fc2 Mar 16 16:26:59 crc kubenswrapper[5120]: I0316 16:26:59.861498 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-d8bvp" Mar 16 16:26:59 crc kubenswrapper[5120]: I0316 16:26:59.861569 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-d8bvp" event={"ID":"88e6fbd8-42f7-446d-a9cb-0fc5d8a9c6bb","Type":"ContainerDied","Data":"3d6394af7cf371f156e7698ccc4615bc7429f52932d5d845b822ea0f7690ac81"} Mar 16 16:26:59 crc kubenswrapper[5120]: I0316 16:26:59.861618 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3d6394af7cf371f156e7698ccc4615bc7429f52932d5d845b822ea0f7690ac81" Mar 16 16:26:59 crc kubenswrapper[5120]: I0316 16:26:59.864680 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-6bf8d6479c-9rjt6" event={"ID":"0b62aed8-ea87-465a-be46-45ce06fedbb7","Type":"ContainerStarted","Data":"53d4ad4e12a94e2b07d00ab9c5191113f00c86184d6fafabdf4364f9b75b5fc2"} Mar 16 16:26:59 crc kubenswrapper[5120]: I0316 16:26:59.973867 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:26:59 crc kubenswrapper[5120]: I0316 16:26:59.973918 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:27:00 crc kubenswrapper[5120]: I0316 16:27:00.035234 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:27:00 crc kubenswrapper[5120]: I0316 16:27:00.094071 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:27:00 crc kubenswrapper[5120]: I0316 16:27:00.208644 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:27:00 crc kubenswrapper[5120]: I0316 16:27:00.211393 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88e6fbd8-42f7-446d-a9cb-0fc5d8a9c6bb" containerName="cinder-db-sync" Mar 16 16:27:00 crc kubenswrapper[5120]: I0316 16:27:00.211431 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="88e6fbd8-42f7-446d-a9cb-0fc5d8a9c6bb" containerName="cinder-db-sync" Mar 16 16:27:00 crc kubenswrapper[5120]: I0316 16:27:00.212881 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="88e6fbd8-42f7-446d-a9cb-0fc5d8a9c6bb" containerName="cinder-db-sync" Mar 16 16:27:00 crc kubenswrapper[5120]: I0316 16:27:00.242054 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:27:00 crc kubenswrapper[5120]: I0316 16:27:00.254621 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-scheduler-config-data\"" Mar 16 16:27:00 crc kubenswrapper[5120]: I0316 16:27:00.255192 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-scripts\"" Mar 16 16:27:00 crc kubenswrapper[5120]: I0316 16:27:00.255461 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-config-data\"" Mar 16 16:27:00 crc kubenswrapper[5120]: I0316 16:27:00.255626 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-cinder-dockercfg-c8554\"" Mar 16 16:27:00 crc kubenswrapper[5120]: I0316 16:27:00.274606 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2db2b5ba-7cda-442a-b384-b370dfd6bce9-config-data\") pod \"cinder-scheduler-0\" (UID: \"2db2b5ba-7cda-442a-b384-b370dfd6bce9\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:27:00 crc kubenswrapper[5120]: I0316 16:27:00.274705 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2db2b5ba-7cda-442a-b384-b370dfd6bce9-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"2db2b5ba-7cda-442a-b384-b370dfd6bce9\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:27:00 crc kubenswrapper[5120]: I0316 16:27:00.274872 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/2db2b5ba-7cda-442a-b384-b370dfd6bce9-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"2db2b5ba-7cda-442a-b384-b370dfd6bce9\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:27:00 crc kubenswrapper[5120]: I0316 16:27:00.274958 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2db2b5ba-7cda-442a-b384-b370dfd6bce9-scripts\") pod \"cinder-scheduler-0\" (UID: \"2db2b5ba-7cda-442a-b384-b370dfd6bce9\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:27:00 crc kubenswrapper[5120]: I0316 16:27:00.275886 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r82bh\" (UniqueName: \"kubernetes.io/projected/2db2b5ba-7cda-442a-b384-b370dfd6bce9-kube-api-access-r82bh\") pod \"cinder-scheduler-0\" (UID: \"2db2b5ba-7cda-442a-b384-b370dfd6bce9\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:27:00 crc kubenswrapper[5120]: I0316 16:27:00.282959 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:27:00 crc kubenswrapper[5120]: I0316 16:27:00.285377 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/2db2b5ba-7cda-442a-b384-b370dfd6bce9-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"2db2b5ba-7cda-442a-b384-b370dfd6bce9\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:27:00 crc kubenswrapper[5120]: I0316 16:27:00.326723 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:27:00 crc kubenswrapper[5120]: I0316 16:27:00.327298 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="0a40a3c3-a3dd-4903-8ca3-dd81b5cc204b" containerName="ceilometer-central-agent" containerID="cri-o://0d04f0fddaec3051829c1b6d0bf13b3ddc5e7584408d31509531e070ee5ec1e9" gracePeriod=30 Mar 16 16:27:00 crc kubenswrapper[5120]: I0316 16:27:00.328218 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="0a40a3c3-a3dd-4903-8ca3-dd81b5cc204b" containerName="proxy-httpd" containerID="cri-o://4e7def1edf6a9706e2c5904fe44a18b12085fa7a0c366fef96164b86a1effb75" gracePeriod=30 Mar 16 16:27:00 crc kubenswrapper[5120]: I0316 16:27:00.328315 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="0a40a3c3-a3dd-4903-8ca3-dd81b5cc204b" containerName="sg-core" containerID="cri-o://babc7bcbc51ec79a205b75e7fb1d3eec97b5192ffbc515222bccd315845b9d8d" gracePeriod=30 Mar 16 16:27:00 crc kubenswrapper[5120]: I0316 16:27:00.328389 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="0a40a3c3-a3dd-4903-8ca3-dd81b5cc204b" containerName="ceilometer-notification-agent" containerID="cri-o://705be4728a99351194f75e5eb5e271de5982d8cab0ee80a1ceb23001118cd3df" gracePeriod=30 Mar 16 16:27:00 crc kubenswrapper[5120]: I0316 16:27:00.371964 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:27:00 crc kubenswrapper[5120]: I0316 16:27:00.383155 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:27:00 crc kubenswrapper[5120]: I0316 16:27:00.387294 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/2db2b5ba-7cda-442a-b384-b370dfd6bce9-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"2db2b5ba-7cda-442a-b384-b370dfd6bce9\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:27:00 crc kubenswrapper[5120]: I0316 16:27:00.387505 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2db2b5ba-7cda-442a-b384-b370dfd6bce9-config-data\") pod \"cinder-scheduler-0\" (UID: \"2db2b5ba-7cda-442a-b384-b370dfd6bce9\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:27:00 crc kubenswrapper[5120]: I0316 16:27:00.387602 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2db2b5ba-7cda-442a-b384-b370dfd6bce9-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"2db2b5ba-7cda-442a-b384-b370dfd6bce9\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:27:00 crc kubenswrapper[5120]: I0316 16:27:00.388299 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/2db2b5ba-7cda-442a-b384-b370dfd6bce9-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"2db2b5ba-7cda-442a-b384-b370dfd6bce9\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:27:00 crc kubenswrapper[5120]: I0316 16:27:00.388402 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2db2b5ba-7cda-442a-b384-b370dfd6bce9-scripts\") pod \"cinder-scheduler-0\" (UID: \"2db2b5ba-7cda-442a-b384-b370dfd6bce9\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:27:00 crc kubenswrapper[5120]: I0316 16:27:00.388502 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r82bh\" (UniqueName: \"kubernetes.io/projected/2db2b5ba-7cda-442a-b384-b370dfd6bce9-kube-api-access-r82bh\") pod \"cinder-scheduler-0\" (UID: \"2db2b5ba-7cda-442a-b384-b370dfd6bce9\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:27:00 crc kubenswrapper[5120]: I0316 16:27:00.388975 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/2db2b5ba-7cda-442a-b384-b370dfd6bce9-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"2db2b5ba-7cda-442a-b384-b370dfd6bce9\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:27:00 crc kubenswrapper[5120]: I0316 16:27:00.395265 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2db2b5ba-7cda-442a-b384-b370dfd6bce9-config-data\") pod \"cinder-scheduler-0\" (UID: \"2db2b5ba-7cda-442a-b384-b370dfd6bce9\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:27:00 crc kubenswrapper[5120]: I0316 16:27:00.404739 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-api-config-data\"" Mar 16 16:27:00 crc kubenswrapper[5120]: I0316 16:27:00.407820 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:27:00 crc kubenswrapper[5120]: I0316 16:27:00.409015 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2db2b5ba-7cda-442a-b384-b370dfd6bce9-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"2db2b5ba-7cda-442a-b384-b370dfd6bce9\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:27:00 crc kubenswrapper[5120]: I0316 16:27:00.414255 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r82bh\" (UniqueName: \"kubernetes.io/projected/2db2b5ba-7cda-442a-b384-b370dfd6bce9-kube-api-access-r82bh\") pod \"cinder-scheduler-0\" (UID: \"2db2b5ba-7cda-442a-b384-b370dfd6bce9\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:27:00 crc kubenswrapper[5120]: I0316 16:27:00.423330 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/2db2b5ba-7cda-442a-b384-b370dfd6bce9-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"2db2b5ba-7cda-442a-b384-b370dfd6bce9\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:27:00 crc kubenswrapper[5120]: I0316 16:27:00.424875 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2db2b5ba-7cda-442a-b384-b370dfd6bce9-scripts\") pod \"cinder-scheduler-0\" (UID: \"2db2b5ba-7cda-442a-b384-b370dfd6bce9\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:27:00 crc kubenswrapper[5120]: I0316 16:27:00.490035 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dcb14165-880d-48a0-bb00-5061b8aa1a4b-config-data\") pod \"cinder-api-0\" (UID: \"dcb14165-880d-48a0-bb00-5061b8aa1a4b\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:27:00 crc kubenswrapper[5120]: I0316 16:27:00.490099 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/dcb14165-880d-48a0-bb00-5061b8aa1a4b-config-data-custom\") pod \"cinder-api-0\" (UID: \"dcb14165-880d-48a0-bb00-5061b8aa1a4b\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:27:00 crc kubenswrapper[5120]: I0316 16:27:00.490225 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/dcb14165-880d-48a0-bb00-5061b8aa1a4b-etc-machine-id\") pod \"cinder-api-0\" (UID: \"dcb14165-880d-48a0-bb00-5061b8aa1a4b\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:27:00 crc kubenswrapper[5120]: I0316 16:27:00.490282 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/dcb14165-880d-48a0-bb00-5061b8aa1a4b-scripts\") pod \"cinder-api-0\" (UID: \"dcb14165-880d-48a0-bb00-5061b8aa1a4b\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:27:00 crc kubenswrapper[5120]: I0316 16:27:00.490318 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dcb14165-880d-48a0-bb00-5061b8aa1a4b-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"dcb14165-880d-48a0-bb00-5061b8aa1a4b\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:27:00 crc kubenswrapper[5120]: I0316 16:27:00.490381 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/dcb14165-880d-48a0-bb00-5061b8aa1a4b-logs\") pod \"cinder-api-0\" (UID: \"dcb14165-880d-48a0-bb00-5061b8aa1a4b\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:27:00 crc kubenswrapper[5120]: I0316 16:27:00.490439 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbpxb\" (UniqueName: \"kubernetes.io/projected/dcb14165-880d-48a0-bb00-5061b8aa1a4b-kube-api-access-wbpxb\") pod \"cinder-api-0\" (UID: \"dcb14165-880d-48a0-bb00-5061b8aa1a4b\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:27:00 crc kubenswrapper[5120]: I0316 16:27:00.567424 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:27:00 crc kubenswrapper[5120]: I0316 16:27:00.592531 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wbpxb\" (UniqueName: \"kubernetes.io/projected/dcb14165-880d-48a0-bb00-5061b8aa1a4b-kube-api-access-wbpxb\") pod \"cinder-api-0\" (UID: \"dcb14165-880d-48a0-bb00-5061b8aa1a4b\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:27:00 crc kubenswrapper[5120]: I0316 16:27:00.592887 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dcb14165-880d-48a0-bb00-5061b8aa1a4b-config-data\") pod \"cinder-api-0\" (UID: \"dcb14165-880d-48a0-bb00-5061b8aa1a4b\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:27:00 crc kubenswrapper[5120]: I0316 16:27:00.593044 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/dcb14165-880d-48a0-bb00-5061b8aa1a4b-config-data-custom\") pod \"cinder-api-0\" (UID: \"dcb14165-880d-48a0-bb00-5061b8aa1a4b\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:27:00 crc kubenswrapper[5120]: I0316 16:27:00.593385 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/dcb14165-880d-48a0-bb00-5061b8aa1a4b-etc-machine-id\") pod \"cinder-api-0\" (UID: \"dcb14165-880d-48a0-bb00-5061b8aa1a4b\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:27:00 crc kubenswrapper[5120]: I0316 16:27:00.593614 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/dcb14165-880d-48a0-bb00-5061b8aa1a4b-scripts\") pod \"cinder-api-0\" (UID: \"dcb14165-880d-48a0-bb00-5061b8aa1a4b\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:27:00 crc kubenswrapper[5120]: I0316 16:27:00.593797 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/dcb14165-880d-48a0-bb00-5061b8aa1a4b-etc-machine-id\") pod \"cinder-api-0\" (UID: \"dcb14165-880d-48a0-bb00-5061b8aa1a4b\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:27:00 crc kubenswrapper[5120]: I0316 16:27:00.593801 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dcb14165-880d-48a0-bb00-5061b8aa1a4b-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"dcb14165-880d-48a0-bb00-5061b8aa1a4b\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:27:00 crc kubenswrapper[5120]: I0316 16:27:00.594070 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/dcb14165-880d-48a0-bb00-5061b8aa1a4b-logs\") pod \"cinder-api-0\" (UID: \"dcb14165-880d-48a0-bb00-5061b8aa1a4b\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:27:00 crc kubenswrapper[5120]: I0316 16:27:00.594702 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/dcb14165-880d-48a0-bb00-5061b8aa1a4b-logs\") pod \"cinder-api-0\" (UID: \"dcb14165-880d-48a0-bb00-5061b8aa1a4b\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:27:00 crc kubenswrapper[5120]: I0316 16:27:00.600117 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/dcb14165-880d-48a0-bb00-5061b8aa1a4b-scripts\") pod \"cinder-api-0\" (UID: \"dcb14165-880d-48a0-bb00-5061b8aa1a4b\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:27:00 crc kubenswrapper[5120]: I0316 16:27:00.601594 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dcb14165-880d-48a0-bb00-5061b8aa1a4b-config-data\") pod \"cinder-api-0\" (UID: \"dcb14165-880d-48a0-bb00-5061b8aa1a4b\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:27:00 crc kubenswrapper[5120]: I0316 16:27:00.602449 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dcb14165-880d-48a0-bb00-5061b8aa1a4b-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"dcb14165-880d-48a0-bb00-5061b8aa1a4b\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:27:00 crc kubenswrapper[5120]: I0316 16:27:00.614185 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbpxb\" (UniqueName: \"kubernetes.io/projected/dcb14165-880d-48a0-bb00-5061b8aa1a4b-kube-api-access-wbpxb\") pod \"cinder-api-0\" (UID: \"dcb14165-880d-48a0-bb00-5061b8aa1a4b\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:27:00 crc kubenswrapper[5120]: I0316 16:27:00.619026 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/dcb14165-880d-48a0-bb00-5061b8aa1a4b-config-data-custom\") pod \"cinder-api-0\" (UID: \"dcb14165-880d-48a0-bb00-5061b8aa1a4b\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:27:00 crc kubenswrapper[5120]: I0316 16:27:00.855312 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:27:00 crc kubenswrapper[5120]: I0316 16:27:00.929234 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-6bf8d6479c-9rjt6" event={"ID":"0b62aed8-ea87-465a-be46-45ce06fedbb7","Type":"ContainerStarted","Data":"8074d2bb95bae655f4b9972b3d0c5821b80f93bf6f01feae8526fac4e817b9cb"} Mar 16 16:27:00 crc kubenswrapper[5120]: I0316 16:27:00.929318 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/keystone-6bf8d6479c-9rjt6" Mar 16 16:27:00 crc kubenswrapper[5120]: I0316 16:27:00.936831 5120 generic.go:358] "Generic (PLEG): container finished" podID="0a40a3c3-a3dd-4903-8ca3-dd81b5cc204b" containerID="4e7def1edf6a9706e2c5904fe44a18b12085fa7a0c366fef96164b86a1effb75" exitCode=0 Mar 16 16:27:00 crc kubenswrapper[5120]: I0316 16:27:00.936856 5120 generic.go:358] "Generic (PLEG): container finished" podID="0a40a3c3-a3dd-4903-8ca3-dd81b5cc204b" containerID="babc7bcbc51ec79a205b75e7fb1d3eec97b5192ffbc515222bccd315845b9d8d" exitCode=2 Mar 16 16:27:00 crc kubenswrapper[5120]: I0316 16:27:00.936862 5120 generic.go:358] "Generic (PLEG): container finished" podID="0a40a3c3-a3dd-4903-8ca3-dd81b5cc204b" containerID="0d04f0fddaec3051829c1b6d0bf13b3ddc5e7584408d31509531e070ee5ec1e9" exitCode=0 Mar 16 16:27:00 crc kubenswrapper[5120]: I0316 16:27:00.937806 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"0a40a3c3-a3dd-4903-8ca3-dd81b5cc204b","Type":"ContainerDied","Data":"4e7def1edf6a9706e2c5904fe44a18b12085fa7a0c366fef96164b86a1effb75"} Mar 16 16:27:00 crc kubenswrapper[5120]: I0316 16:27:00.937862 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:27:00 crc kubenswrapper[5120]: I0316 16:27:00.937878 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"0a40a3c3-a3dd-4903-8ca3-dd81b5cc204b","Type":"ContainerDied","Data":"babc7bcbc51ec79a205b75e7fb1d3eec97b5192ffbc515222bccd315845b9d8d"} Mar 16 16:27:00 crc kubenswrapper[5120]: I0316 16:27:00.937889 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"0a40a3c3-a3dd-4903-8ca3-dd81b5cc204b","Type":"ContainerDied","Data":"0d04f0fddaec3051829c1b6d0bf13b3ddc5e7584408d31509531e070ee5ec1e9"} Mar 16 16:27:00 crc kubenswrapper[5120]: I0316 16:27:00.938170 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:27:00 crc kubenswrapper[5120]: I0316 16:27:00.964446 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-6bf8d6479c-9rjt6" podStartSLOduration=2.96442492 podStartE2EDuration="2.96442492s" podCreationTimestamp="2026-03-16 16:26:58 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:27:00.949289615 +0000 UTC m=+3323.103221282" watchObservedRunningTime="2026-03-16 16:27:00.96442492 +0000 UTC m=+3323.118356577" Mar 16 16:27:01 crc kubenswrapper[5120]: I0316 16:27:01.097339 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:27:01 crc kubenswrapper[5120]: I0316 16:27:01.386800 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:27:01 crc kubenswrapper[5120]: I0316 16:27:01.549197 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:27:01 crc kubenswrapper[5120]: I0316 16:27:01.647703 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0a40a3c3-a3dd-4903-8ca3-dd81b5cc204b-log-httpd\") pod \"0a40a3c3-a3dd-4903-8ca3-dd81b5cc204b\" (UID: \"0a40a3c3-a3dd-4903-8ca3-dd81b5cc204b\") " Mar 16 16:27:01 crc kubenswrapper[5120]: I0316 16:27:01.647815 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0a40a3c3-a3dd-4903-8ca3-dd81b5cc204b-scripts\") pod \"0a40a3c3-a3dd-4903-8ca3-dd81b5cc204b\" (UID: \"0a40a3c3-a3dd-4903-8ca3-dd81b5cc204b\") " Mar 16 16:27:01 crc kubenswrapper[5120]: I0316 16:27:01.647881 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0a40a3c3-a3dd-4903-8ca3-dd81b5cc204b-run-httpd\") pod \"0a40a3c3-a3dd-4903-8ca3-dd81b5cc204b\" (UID: \"0a40a3c3-a3dd-4903-8ca3-dd81b5cc204b\") " Mar 16 16:27:01 crc kubenswrapper[5120]: I0316 16:27:01.648082 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0a40a3c3-a3dd-4903-8ca3-dd81b5cc204b-combined-ca-bundle\") pod \"0a40a3c3-a3dd-4903-8ca3-dd81b5cc204b\" (UID: \"0a40a3c3-a3dd-4903-8ca3-dd81b5cc204b\") " Mar 16 16:27:01 crc kubenswrapper[5120]: I0316 16:27:01.649801 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/0a40a3c3-a3dd-4903-8ca3-dd81b5cc204b-sg-core-conf-yaml\") pod \"0a40a3c3-a3dd-4903-8ca3-dd81b5cc204b\" (UID: \"0a40a3c3-a3dd-4903-8ca3-dd81b5cc204b\") " Mar 16 16:27:01 crc kubenswrapper[5120]: I0316 16:27:01.649962 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rh264\" (UniqueName: \"kubernetes.io/projected/0a40a3c3-a3dd-4903-8ca3-dd81b5cc204b-kube-api-access-rh264\") pod \"0a40a3c3-a3dd-4903-8ca3-dd81b5cc204b\" (UID: \"0a40a3c3-a3dd-4903-8ca3-dd81b5cc204b\") " Mar 16 16:27:01 crc kubenswrapper[5120]: I0316 16:27:01.650099 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0a40a3c3-a3dd-4903-8ca3-dd81b5cc204b-config-data\") pod \"0a40a3c3-a3dd-4903-8ca3-dd81b5cc204b\" (UID: \"0a40a3c3-a3dd-4903-8ca3-dd81b5cc204b\") " Mar 16 16:27:01 crc kubenswrapper[5120]: I0316 16:27:01.652128 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a40a3c3-a3dd-4903-8ca3-dd81b5cc204b-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "0a40a3c3-a3dd-4903-8ca3-dd81b5cc204b" (UID: "0a40a3c3-a3dd-4903-8ca3-dd81b5cc204b"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:27:01 crc kubenswrapper[5120]: I0316 16:27:01.652362 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a40a3c3-a3dd-4903-8ca3-dd81b5cc204b-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "0a40a3c3-a3dd-4903-8ca3-dd81b5cc204b" (UID: "0a40a3c3-a3dd-4903-8ca3-dd81b5cc204b"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:27:01 crc kubenswrapper[5120]: I0316 16:27:01.659422 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a40a3c3-a3dd-4903-8ca3-dd81b5cc204b-kube-api-access-rh264" (OuterVolumeSpecName: "kube-api-access-rh264") pod "0a40a3c3-a3dd-4903-8ca3-dd81b5cc204b" (UID: "0a40a3c3-a3dd-4903-8ca3-dd81b5cc204b"). InnerVolumeSpecName "kube-api-access-rh264". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:27:01 crc kubenswrapper[5120]: I0316 16:27:01.663147 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a40a3c3-a3dd-4903-8ca3-dd81b5cc204b-scripts" (OuterVolumeSpecName: "scripts") pod "0a40a3c3-a3dd-4903-8ca3-dd81b5cc204b" (UID: "0a40a3c3-a3dd-4903-8ca3-dd81b5cc204b"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:27:01 crc kubenswrapper[5120]: I0316 16:27:01.698401 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a40a3c3-a3dd-4903-8ca3-dd81b5cc204b-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "0a40a3c3-a3dd-4903-8ca3-dd81b5cc204b" (UID: "0a40a3c3-a3dd-4903-8ca3-dd81b5cc204b"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:27:01 crc kubenswrapper[5120]: I0316 16:27:01.764422 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/0a40a3c3-a3dd-4903-8ca3-dd81b5cc204b-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 16:27:01 crc kubenswrapper[5120]: I0316 16:27:01.764454 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rh264\" (UniqueName: \"kubernetes.io/projected/0a40a3c3-a3dd-4903-8ca3-dd81b5cc204b-kube-api-access-rh264\") on node \"crc\" DevicePath \"\"" Mar 16 16:27:01 crc kubenswrapper[5120]: I0316 16:27:01.764465 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0a40a3c3-a3dd-4903-8ca3-dd81b5cc204b-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:27:01 crc kubenswrapper[5120]: I0316 16:27:01.764474 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0a40a3c3-a3dd-4903-8ca3-dd81b5cc204b-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:27:01 crc kubenswrapper[5120]: I0316 16:27:01.764484 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0a40a3c3-a3dd-4903-8ca3-dd81b5cc204b-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:27:01 crc kubenswrapper[5120]: I0316 16:27:01.783027 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a40a3c3-a3dd-4903-8ca3-dd81b5cc204b-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "0a40a3c3-a3dd-4903-8ca3-dd81b5cc204b" (UID: "0a40a3c3-a3dd-4903-8ca3-dd81b5cc204b"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:27:01 crc kubenswrapper[5120]: I0316 16:27:01.814713 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a40a3c3-a3dd-4903-8ca3-dd81b5cc204b-config-data" (OuterVolumeSpecName: "config-data") pod "0a40a3c3-a3dd-4903-8ca3-dd81b5cc204b" (UID: "0a40a3c3-a3dd-4903-8ca3-dd81b5cc204b"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:27:01 crc kubenswrapper[5120]: I0316 16:27:01.867024 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0a40a3c3-a3dd-4903-8ca3-dd81b5cc204b-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:27:01 crc kubenswrapper[5120]: I0316 16:27:01.867057 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0a40a3c3-a3dd-4903-8ca3-dd81b5cc204b-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:27:01 crc kubenswrapper[5120]: I0316 16:27:01.970984 5120 generic.go:358] "Generic (PLEG): container finished" podID="0a40a3c3-a3dd-4903-8ca3-dd81b5cc204b" containerID="705be4728a99351194f75e5eb5e271de5982d8cab0ee80a1ceb23001118cd3df" exitCode=0 Mar 16 16:27:01 crc kubenswrapper[5120]: I0316 16:27:01.971088 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"0a40a3c3-a3dd-4903-8ca3-dd81b5cc204b","Type":"ContainerDied","Data":"705be4728a99351194f75e5eb5e271de5982d8cab0ee80a1ceb23001118cd3df"} Mar 16 16:27:01 crc kubenswrapper[5120]: I0316 16:27:01.971108 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:27:01 crc kubenswrapper[5120]: I0316 16:27:01.971117 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"0a40a3c3-a3dd-4903-8ca3-dd81b5cc204b","Type":"ContainerDied","Data":"bcc9a07ae65eeecf566d2fb925330af89b64af29ce8189ffe59d21d2693eef09"} Mar 16 16:27:01 crc kubenswrapper[5120]: I0316 16:27:01.971950 5120 scope.go:117] "RemoveContainer" containerID="4e7def1edf6a9706e2c5904fe44a18b12085fa7a0c366fef96164b86a1effb75" Mar 16 16:27:01 crc kubenswrapper[5120]: I0316 16:27:01.979098 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"dcb14165-880d-48a0-bb00-5061b8aa1a4b","Type":"ContainerStarted","Data":"cbbbe8f44e1541da36e1e38893851e7a5f84dda07777ea37aa5a715c8d2db999"} Mar 16 16:27:01 crc kubenswrapper[5120]: I0316 16:27:01.984914 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"2db2b5ba-7cda-442a-b384-b370dfd6bce9","Type":"ContainerStarted","Data":"faa2c2cb4c558622bf3dc358da854ffe8d8a576697aac6569228726775f72f3c"} Mar 16 16:27:02 crc kubenswrapper[5120]: I0316 16:27:02.022477 5120 scope.go:117] "RemoveContainer" containerID="babc7bcbc51ec79a205b75e7fb1d3eec97b5192ffbc515222bccd315845b9d8d" Mar 16 16:27:02 crc kubenswrapper[5120]: I0316 16:27:02.046138 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:27:02 crc kubenswrapper[5120]: I0316 16:27:02.065585 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:27:02 crc kubenswrapper[5120]: I0316 16:27:02.093459 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:27:02 crc kubenswrapper[5120]: I0316 16:27:02.095496 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a40a3c3-a3dd-4903-8ca3-dd81b5cc204b" containerName="ceilometer-notification-agent" Mar 16 16:27:02 crc kubenswrapper[5120]: I0316 16:27:02.095516 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a40a3c3-a3dd-4903-8ca3-dd81b5cc204b" containerName="ceilometer-notification-agent" Mar 16 16:27:02 crc kubenswrapper[5120]: I0316 16:27:02.095533 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a40a3c3-a3dd-4903-8ca3-dd81b5cc204b" containerName="sg-core" Mar 16 16:27:02 crc kubenswrapper[5120]: I0316 16:27:02.095539 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a40a3c3-a3dd-4903-8ca3-dd81b5cc204b" containerName="sg-core" Mar 16 16:27:02 crc kubenswrapper[5120]: I0316 16:27:02.095559 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a40a3c3-a3dd-4903-8ca3-dd81b5cc204b" containerName="ceilometer-central-agent" Mar 16 16:27:02 crc kubenswrapper[5120]: I0316 16:27:02.095565 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a40a3c3-a3dd-4903-8ca3-dd81b5cc204b" containerName="ceilometer-central-agent" Mar 16 16:27:02 crc kubenswrapper[5120]: I0316 16:27:02.095586 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a40a3c3-a3dd-4903-8ca3-dd81b5cc204b" containerName="proxy-httpd" Mar 16 16:27:02 crc kubenswrapper[5120]: I0316 16:27:02.095593 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a40a3c3-a3dd-4903-8ca3-dd81b5cc204b" containerName="proxy-httpd" Mar 16 16:27:02 crc kubenswrapper[5120]: I0316 16:27:02.095797 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="0a40a3c3-a3dd-4903-8ca3-dd81b5cc204b" containerName="sg-core" Mar 16 16:27:02 crc kubenswrapper[5120]: I0316 16:27:02.095810 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="0a40a3c3-a3dd-4903-8ca3-dd81b5cc204b" containerName="ceilometer-central-agent" Mar 16 16:27:02 crc kubenswrapper[5120]: I0316 16:27:02.095823 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="0a40a3c3-a3dd-4903-8ca3-dd81b5cc204b" containerName="proxy-httpd" Mar 16 16:27:02 crc kubenswrapper[5120]: I0316 16:27:02.095837 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="0a40a3c3-a3dd-4903-8ca3-dd81b5cc204b" containerName="ceilometer-notification-agent" Mar 16 16:27:02 crc kubenswrapper[5120]: I0316 16:27:02.114732 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:27:02 crc kubenswrapper[5120]: I0316 16:27:02.114891 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:27:02 crc kubenswrapper[5120]: I0316 16:27:02.115992 5120 scope.go:117] "RemoveContainer" containerID="705be4728a99351194f75e5eb5e271de5982d8cab0ee80a1ceb23001118cd3df" Mar 16 16:27:02 crc kubenswrapper[5120]: I0316 16:27:02.135964 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 16:27:02 crc kubenswrapper[5120]: I0316 16:27:02.155189 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 16:27:02 crc kubenswrapper[5120]: I0316 16:27:02.163228 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:27:02 crc kubenswrapper[5120]: I0316 16:27:02.287727 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qq9zv\" (UniqueName: \"kubernetes.io/projected/e4bad0fb-46f9-4865-a897-c30da4fa8ffc-kube-api-access-qq9zv\") pod \"ceilometer-0\" (UID: \"e4bad0fb-46f9-4865-a897-c30da4fa8ffc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:27:02 crc kubenswrapper[5120]: I0316 16:27:02.287825 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e4bad0fb-46f9-4865-a897-c30da4fa8ffc-run-httpd\") pod \"ceilometer-0\" (UID: \"e4bad0fb-46f9-4865-a897-c30da4fa8ffc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:27:02 crc kubenswrapper[5120]: I0316 16:27:02.287843 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e4bad0fb-46f9-4865-a897-c30da4fa8ffc-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"e4bad0fb-46f9-4865-a897-c30da4fa8ffc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:27:02 crc kubenswrapper[5120]: I0316 16:27:02.287925 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/e4bad0fb-46f9-4865-a897-c30da4fa8ffc-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"e4bad0fb-46f9-4865-a897-c30da4fa8ffc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:27:02 crc kubenswrapper[5120]: I0316 16:27:02.287955 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e4bad0fb-46f9-4865-a897-c30da4fa8ffc-scripts\") pod \"ceilometer-0\" (UID: \"e4bad0fb-46f9-4865-a897-c30da4fa8ffc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:27:02 crc kubenswrapper[5120]: I0316 16:27:02.288084 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e4bad0fb-46f9-4865-a897-c30da4fa8ffc-config-data\") pod \"ceilometer-0\" (UID: \"e4bad0fb-46f9-4865-a897-c30da4fa8ffc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:27:02 crc kubenswrapper[5120]: I0316 16:27:02.288128 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e4bad0fb-46f9-4865-a897-c30da4fa8ffc-log-httpd\") pod \"ceilometer-0\" (UID: \"e4bad0fb-46f9-4865-a897-c30da4fa8ffc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:27:02 crc kubenswrapper[5120]: I0316 16:27:02.289081 5120 scope.go:117] "RemoveContainer" containerID="0d04f0fddaec3051829c1b6d0bf13b3ddc5e7584408d31509531e070ee5ec1e9" Mar 16 16:27:02 crc kubenswrapper[5120]: I0316 16:27:02.390054 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e4bad0fb-46f9-4865-a897-c30da4fa8ffc-run-httpd\") pod \"ceilometer-0\" (UID: \"e4bad0fb-46f9-4865-a897-c30da4fa8ffc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:27:02 crc kubenswrapper[5120]: I0316 16:27:02.390312 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e4bad0fb-46f9-4865-a897-c30da4fa8ffc-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"e4bad0fb-46f9-4865-a897-c30da4fa8ffc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:27:02 crc kubenswrapper[5120]: I0316 16:27:02.390417 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/e4bad0fb-46f9-4865-a897-c30da4fa8ffc-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"e4bad0fb-46f9-4865-a897-c30da4fa8ffc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:27:02 crc kubenswrapper[5120]: I0316 16:27:02.390452 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e4bad0fb-46f9-4865-a897-c30da4fa8ffc-scripts\") pod \"ceilometer-0\" (UID: \"e4bad0fb-46f9-4865-a897-c30da4fa8ffc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:27:02 crc kubenswrapper[5120]: I0316 16:27:02.390580 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e4bad0fb-46f9-4865-a897-c30da4fa8ffc-config-data\") pod \"ceilometer-0\" (UID: \"e4bad0fb-46f9-4865-a897-c30da4fa8ffc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:27:02 crc kubenswrapper[5120]: I0316 16:27:02.390636 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e4bad0fb-46f9-4865-a897-c30da4fa8ffc-log-httpd\") pod \"ceilometer-0\" (UID: \"e4bad0fb-46f9-4865-a897-c30da4fa8ffc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:27:02 crc kubenswrapper[5120]: I0316 16:27:02.390649 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e4bad0fb-46f9-4865-a897-c30da4fa8ffc-run-httpd\") pod \"ceilometer-0\" (UID: \"e4bad0fb-46f9-4865-a897-c30da4fa8ffc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:27:02 crc kubenswrapper[5120]: I0316 16:27:02.390733 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qq9zv\" (UniqueName: \"kubernetes.io/projected/e4bad0fb-46f9-4865-a897-c30da4fa8ffc-kube-api-access-qq9zv\") pod \"ceilometer-0\" (UID: \"e4bad0fb-46f9-4865-a897-c30da4fa8ffc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:27:02 crc kubenswrapper[5120]: I0316 16:27:02.391007 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e4bad0fb-46f9-4865-a897-c30da4fa8ffc-log-httpd\") pod \"ceilometer-0\" (UID: \"e4bad0fb-46f9-4865-a897-c30da4fa8ffc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:27:02 crc kubenswrapper[5120]: I0316 16:27:02.395951 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/e4bad0fb-46f9-4865-a897-c30da4fa8ffc-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"e4bad0fb-46f9-4865-a897-c30da4fa8ffc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:27:02 crc kubenswrapper[5120]: I0316 16:27:02.399431 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e4bad0fb-46f9-4865-a897-c30da4fa8ffc-scripts\") pod \"ceilometer-0\" (UID: \"e4bad0fb-46f9-4865-a897-c30da4fa8ffc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:27:02 crc kubenswrapper[5120]: I0316 16:27:02.401868 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e4bad0fb-46f9-4865-a897-c30da4fa8ffc-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"e4bad0fb-46f9-4865-a897-c30da4fa8ffc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:27:02 crc kubenswrapper[5120]: I0316 16:27:02.407691 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e4bad0fb-46f9-4865-a897-c30da4fa8ffc-config-data\") pod \"ceilometer-0\" (UID: \"e4bad0fb-46f9-4865-a897-c30da4fa8ffc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:27:02 crc kubenswrapper[5120]: I0316 16:27:02.420337 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qq9zv\" (UniqueName: \"kubernetes.io/projected/e4bad0fb-46f9-4865-a897-c30da4fa8ffc-kube-api-access-qq9zv\") pod \"ceilometer-0\" (UID: \"e4bad0fb-46f9-4865-a897-c30da4fa8ffc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:27:02 crc kubenswrapper[5120]: I0316 16:27:02.496919 5120 scope.go:117] "RemoveContainer" containerID="4e7def1edf6a9706e2c5904fe44a18b12085fa7a0c366fef96164b86a1effb75" Mar 16 16:27:02 crc kubenswrapper[5120]: E0316 16:27:02.497372 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e7def1edf6a9706e2c5904fe44a18b12085fa7a0c366fef96164b86a1effb75\": container with ID starting with 4e7def1edf6a9706e2c5904fe44a18b12085fa7a0c366fef96164b86a1effb75 not found: ID does not exist" containerID="4e7def1edf6a9706e2c5904fe44a18b12085fa7a0c366fef96164b86a1effb75" Mar 16 16:27:02 crc kubenswrapper[5120]: I0316 16:27:02.497402 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e7def1edf6a9706e2c5904fe44a18b12085fa7a0c366fef96164b86a1effb75"} err="failed to get container status \"4e7def1edf6a9706e2c5904fe44a18b12085fa7a0c366fef96164b86a1effb75\": rpc error: code = NotFound desc = could not find container \"4e7def1edf6a9706e2c5904fe44a18b12085fa7a0c366fef96164b86a1effb75\": container with ID starting with 4e7def1edf6a9706e2c5904fe44a18b12085fa7a0c366fef96164b86a1effb75 not found: ID does not exist" Mar 16 16:27:02 crc kubenswrapper[5120]: I0316 16:27:02.497421 5120 scope.go:117] "RemoveContainer" containerID="babc7bcbc51ec79a205b75e7fb1d3eec97b5192ffbc515222bccd315845b9d8d" Mar 16 16:27:02 crc kubenswrapper[5120]: E0316 16:27:02.499457 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"babc7bcbc51ec79a205b75e7fb1d3eec97b5192ffbc515222bccd315845b9d8d\": container with ID starting with babc7bcbc51ec79a205b75e7fb1d3eec97b5192ffbc515222bccd315845b9d8d not found: ID does not exist" containerID="babc7bcbc51ec79a205b75e7fb1d3eec97b5192ffbc515222bccd315845b9d8d" Mar 16 16:27:02 crc kubenswrapper[5120]: I0316 16:27:02.499484 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"babc7bcbc51ec79a205b75e7fb1d3eec97b5192ffbc515222bccd315845b9d8d"} err="failed to get container status \"babc7bcbc51ec79a205b75e7fb1d3eec97b5192ffbc515222bccd315845b9d8d\": rpc error: code = NotFound desc = could not find container \"babc7bcbc51ec79a205b75e7fb1d3eec97b5192ffbc515222bccd315845b9d8d\": container with ID starting with babc7bcbc51ec79a205b75e7fb1d3eec97b5192ffbc515222bccd315845b9d8d not found: ID does not exist" Mar 16 16:27:02 crc kubenswrapper[5120]: I0316 16:27:02.499497 5120 scope.go:117] "RemoveContainer" containerID="705be4728a99351194f75e5eb5e271de5982d8cab0ee80a1ceb23001118cd3df" Mar 16 16:27:02 crc kubenswrapper[5120]: E0316 16:27:02.499855 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"705be4728a99351194f75e5eb5e271de5982d8cab0ee80a1ceb23001118cd3df\": container with ID starting with 705be4728a99351194f75e5eb5e271de5982d8cab0ee80a1ceb23001118cd3df not found: ID does not exist" containerID="705be4728a99351194f75e5eb5e271de5982d8cab0ee80a1ceb23001118cd3df" Mar 16 16:27:02 crc kubenswrapper[5120]: I0316 16:27:02.499901 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"705be4728a99351194f75e5eb5e271de5982d8cab0ee80a1ceb23001118cd3df"} err="failed to get container status \"705be4728a99351194f75e5eb5e271de5982d8cab0ee80a1ceb23001118cd3df\": rpc error: code = NotFound desc = could not find container \"705be4728a99351194f75e5eb5e271de5982d8cab0ee80a1ceb23001118cd3df\": container with ID starting with 705be4728a99351194f75e5eb5e271de5982d8cab0ee80a1ceb23001118cd3df not found: ID does not exist" Mar 16 16:27:02 crc kubenswrapper[5120]: I0316 16:27:02.499943 5120 scope.go:117] "RemoveContainer" containerID="0d04f0fddaec3051829c1b6d0bf13b3ddc5e7584408d31509531e070ee5ec1e9" Mar 16 16:27:02 crc kubenswrapper[5120]: E0316 16:27:02.503105 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d04f0fddaec3051829c1b6d0bf13b3ddc5e7584408d31509531e070ee5ec1e9\": container with ID starting with 0d04f0fddaec3051829c1b6d0bf13b3ddc5e7584408d31509531e070ee5ec1e9 not found: ID does not exist" containerID="0d04f0fddaec3051829c1b6d0bf13b3ddc5e7584408d31509531e070ee5ec1e9" Mar 16 16:27:02 crc kubenswrapper[5120]: I0316 16:27:02.503142 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d04f0fddaec3051829c1b6d0bf13b3ddc5e7584408d31509531e070ee5ec1e9"} err="failed to get container status \"0d04f0fddaec3051829c1b6d0bf13b3ddc5e7584408d31509531e070ee5ec1e9\": rpc error: code = NotFound desc = could not find container \"0d04f0fddaec3051829c1b6d0bf13b3ddc5e7584408d31509531e070ee5ec1e9\": container with ID starting with 0d04f0fddaec3051829c1b6d0bf13b3ddc5e7584408d31509531e070ee5ec1e9 not found: ID does not exist" Mar 16 16:27:02 crc kubenswrapper[5120]: I0316 16:27:02.562090 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:27:02 crc kubenswrapper[5120]: I0316 16:27:02.691755 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0a40a3c3-a3dd-4903-8ca3-dd81b5cc204b" path="/var/lib/kubelet/pods/0a40a3c3-a3dd-4903-8ca3-dd81b5cc204b/volumes" Mar 16 16:27:03 crc kubenswrapper[5120]: I0316 16:27:03.026138 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"2db2b5ba-7cda-442a-b384-b370dfd6bce9","Type":"ContainerStarted","Data":"b2f3e9268caa0986cbd59923285757142d00577f2521a52b4fdbb1ead7df292a"} Mar 16 16:27:03 crc kubenswrapper[5120]: I0316 16:27:03.031457 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"dcb14165-880d-48a0-bb00-5061b8aa1a4b","Type":"ContainerStarted","Data":"12d9e72b65fc03ba4e03766289bfe450989ef41457e89fa82c116b2b0e4acdaf"} Mar 16 16:27:03 crc kubenswrapper[5120]: I0316 16:27:03.070277 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:27:03 crc kubenswrapper[5120]: W0316 16:27:03.087322 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode4bad0fb_46f9_4865_a897_c30da4fa8ffc.slice/crio-c0de10cee88917c8d955c749813119589793efa3abdea6674ac2a81ff095f5cc WatchSource:0}: Error finding container c0de10cee88917c8d955c749813119589793efa3abdea6674ac2a81ff095f5cc: Status 404 returned error can't find the container with id c0de10cee88917c8d955c749813119589793efa3abdea6674ac2a81ff095f5cc Mar 16 16:27:03 crc kubenswrapper[5120]: I0316 16:27:03.326286 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:27:03 crc kubenswrapper[5120]: I0316 16:27:03.326413 5120 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Mar 16 16:27:03 crc kubenswrapper[5120]: E0316 16:27:03.706778 5120 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb90e76bc_d652_4606_8c72_4b96133ce5c4.slice\": RecentStats: unable to find data in memory cache]" Mar 16 16:27:04 crc kubenswrapper[5120]: I0316 16:27:04.043778 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"2db2b5ba-7cda-442a-b384-b370dfd6bce9","Type":"ContainerStarted","Data":"a4b6b7975ae4423f96f92300f7d1597d4348b6d6c052013f381e9ba9da669595"} Mar 16 16:27:04 crc kubenswrapper[5120]: I0316 16:27:04.045866 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"e4bad0fb-46f9-4865-a897-c30da4fa8ffc","Type":"ContainerStarted","Data":"c0de10cee88917c8d955c749813119589793efa3abdea6674ac2a81ff095f5cc"} Mar 16 16:27:04 crc kubenswrapper[5120]: I0316 16:27:04.048418 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"dcb14165-880d-48a0-bb00-5061b8aa1a4b","Type":"ContainerStarted","Data":"203c1ae282406a3cae32989f119023af795bcdb4d806e4780d251f6ddd931a38"} Mar 16 16:27:04 crc kubenswrapper[5120]: I0316 16:27:04.048476 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="dcb14165-880d-48a0-bb00-5061b8aa1a4b" containerName="cinder-api-log" containerID="cri-o://12d9e72b65fc03ba4e03766289bfe450989ef41457e89fa82c116b2b0e4acdaf" gracePeriod=30 Mar 16 16:27:04 crc kubenswrapper[5120]: I0316 16:27:04.048515 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:27:04 crc kubenswrapper[5120]: I0316 16:27:04.048556 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="dcb14165-880d-48a0-bb00-5061b8aa1a4b" containerName="cinder-api" containerID="cri-o://203c1ae282406a3cae32989f119023af795bcdb4d806e4780d251f6ddd931a38" gracePeriod=30 Mar 16 16:27:04 crc kubenswrapper[5120]: I0316 16:27:04.060633 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-scheduler-0" podStartSLOduration=4.060615745 podStartE2EDuration="4.060615745s" podCreationTimestamp="2026-03-16 16:27:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:27:04.057942344 +0000 UTC m=+3326.211874011" watchObservedRunningTime="2026-03-16 16:27:04.060615745 +0000 UTC m=+3326.214547402" Mar 16 16:27:04 crc kubenswrapper[5120]: I0316 16:27:04.072917 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-6cbd8fc548-p4pgf" Mar 16 16:27:04 crc kubenswrapper[5120]: I0316 16:27:04.082961 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-api-0" podStartSLOduration=4.082943243 podStartE2EDuration="4.082943243s" podCreationTimestamp="2026-03-16 16:27:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:27:04.075840662 +0000 UTC m=+3326.229772319" watchObservedRunningTime="2026-03-16 16:27:04.082943243 +0000 UTC m=+3326.236874900" Mar 16 16:27:04 crc kubenswrapper[5120]: I0316 16:27:04.141704 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-6cbd8fc548-p4pgf" Mar 16 16:27:04 crc kubenswrapper[5120]: I0316 16:27:04.482200 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-566c6b7f4b-gjml4"] Mar 16 16:27:04 crc kubenswrapper[5120]: I0316 16:27:04.489676 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-566c6b7f4b-gjml4" Mar 16 16:27:04 crc kubenswrapper[5120]: I0316 16:27:04.516831 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-worker-8649c995c9-lzq96"] Mar 16 16:27:04 crc kubenswrapper[5120]: I0316 16:27:04.543332 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9cb535e7-55cc-4b9d-911c-58f8ed50bee6-combined-ca-bundle\") pod \"barbican-keystone-listener-566c6b7f4b-gjml4\" (UID: \"9cb535e7-55cc-4b9d-911c-58f8ed50bee6\") " pod="openstack-kuttl-tests/barbican-keystone-listener-566c6b7f4b-gjml4" Mar 16 16:27:04 crc kubenswrapper[5120]: I0316 16:27:04.543464 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/9cb535e7-55cc-4b9d-911c-58f8ed50bee6-config-data-custom\") pod \"barbican-keystone-listener-566c6b7f4b-gjml4\" (UID: \"9cb535e7-55cc-4b9d-911c-58f8ed50bee6\") " pod="openstack-kuttl-tests/barbican-keystone-listener-566c6b7f4b-gjml4" Mar 16 16:27:04 crc kubenswrapper[5120]: I0316 16:27:04.543487 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwrvp\" (UniqueName: \"kubernetes.io/projected/9cb535e7-55cc-4b9d-911c-58f8ed50bee6-kube-api-access-xwrvp\") pod \"barbican-keystone-listener-566c6b7f4b-gjml4\" (UID: \"9cb535e7-55cc-4b9d-911c-58f8ed50bee6\") " pod="openstack-kuttl-tests/barbican-keystone-listener-566c6b7f4b-gjml4" Mar 16 16:27:04 crc kubenswrapper[5120]: I0316 16:27:04.543530 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9cb535e7-55cc-4b9d-911c-58f8ed50bee6-config-data\") pod \"barbican-keystone-listener-566c6b7f4b-gjml4\" (UID: \"9cb535e7-55cc-4b9d-911c-58f8ed50bee6\") " pod="openstack-kuttl-tests/barbican-keystone-listener-566c6b7f4b-gjml4" Mar 16 16:27:04 crc kubenswrapper[5120]: I0316 16:27:04.543838 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9cb535e7-55cc-4b9d-911c-58f8ed50bee6-logs\") pod \"barbican-keystone-listener-566c6b7f4b-gjml4\" (UID: \"9cb535e7-55cc-4b9d-911c-58f8ed50bee6\") " pod="openstack-kuttl-tests/barbican-keystone-listener-566c6b7f4b-gjml4" Mar 16 16:27:04 crc kubenswrapper[5120]: I0316 16:27:04.548947 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-566c6b7f4b-gjml4"] Mar 16 16:27:04 crc kubenswrapper[5120]: I0316 16:27:04.549096 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-8649c995c9-lzq96" Mar 16 16:27:04 crc kubenswrapper[5120]: I0316 16:27:04.549260 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-8649c995c9-lzq96"] Mar 16 16:27:04 crc kubenswrapper[5120]: I0316 16:27:04.658102 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bbd47432-e63f-4ba0-8daa-edfb3d2b0af9-config-data\") pod \"barbican-worker-8649c995c9-lzq96\" (UID: \"bbd47432-e63f-4ba0-8daa-edfb3d2b0af9\") " pod="openstack-kuttl-tests/barbican-worker-8649c995c9-lzq96" Mar 16 16:27:04 crc kubenswrapper[5120]: I0316 16:27:04.658146 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bbd47432-e63f-4ba0-8daa-edfb3d2b0af9-combined-ca-bundle\") pod \"barbican-worker-8649c995c9-lzq96\" (UID: \"bbd47432-e63f-4ba0-8daa-edfb3d2b0af9\") " pod="openstack-kuttl-tests/barbican-worker-8649c995c9-lzq96" Mar 16 16:27:04 crc kubenswrapper[5120]: I0316 16:27:04.658223 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9cb535e7-55cc-4b9d-911c-58f8ed50bee6-logs\") pod \"barbican-keystone-listener-566c6b7f4b-gjml4\" (UID: \"9cb535e7-55cc-4b9d-911c-58f8ed50bee6\") " pod="openstack-kuttl-tests/barbican-keystone-listener-566c6b7f4b-gjml4" Mar 16 16:27:04 crc kubenswrapper[5120]: I0316 16:27:04.658287 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9cb535e7-55cc-4b9d-911c-58f8ed50bee6-combined-ca-bundle\") pod \"barbican-keystone-listener-566c6b7f4b-gjml4\" (UID: \"9cb535e7-55cc-4b9d-911c-58f8ed50bee6\") " pod="openstack-kuttl-tests/barbican-keystone-listener-566c6b7f4b-gjml4" Mar 16 16:27:04 crc kubenswrapper[5120]: I0316 16:27:04.658313 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/bbd47432-e63f-4ba0-8daa-edfb3d2b0af9-logs\") pod \"barbican-worker-8649c995c9-lzq96\" (UID: \"bbd47432-e63f-4ba0-8daa-edfb3d2b0af9\") " pod="openstack-kuttl-tests/barbican-worker-8649c995c9-lzq96" Mar 16 16:27:04 crc kubenswrapper[5120]: I0316 16:27:04.658355 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/bbd47432-e63f-4ba0-8daa-edfb3d2b0af9-config-data-custom\") pod \"barbican-worker-8649c995c9-lzq96\" (UID: \"bbd47432-e63f-4ba0-8daa-edfb3d2b0af9\") " pod="openstack-kuttl-tests/barbican-worker-8649c995c9-lzq96" Mar 16 16:27:04 crc kubenswrapper[5120]: I0316 16:27:04.658402 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/9cb535e7-55cc-4b9d-911c-58f8ed50bee6-config-data-custom\") pod \"barbican-keystone-listener-566c6b7f4b-gjml4\" (UID: \"9cb535e7-55cc-4b9d-911c-58f8ed50bee6\") " pod="openstack-kuttl-tests/barbican-keystone-listener-566c6b7f4b-gjml4" Mar 16 16:27:04 crc kubenswrapper[5120]: I0316 16:27:04.658424 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xwrvp\" (UniqueName: \"kubernetes.io/projected/9cb535e7-55cc-4b9d-911c-58f8ed50bee6-kube-api-access-xwrvp\") pod \"barbican-keystone-listener-566c6b7f4b-gjml4\" (UID: \"9cb535e7-55cc-4b9d-911c-58f8ed50bee6\") " pod="openstack-kuttl-tests/barbican-keystone-listener-566c6b7f4b-gjml4" Mar 16 16:27:04 crc kubenswrapper[5120]: I0316 16:27:04.658471 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9cb535e7-55cc-4b9d-911c-58f8ed50bee6-config-data\") pod \"barbican-keystone-listener-566c6b7f4b-gjml4\" (UID: \"9cb535e7-55cc-4b9d-911c-58f8ed50bee6\") " pod="openstack-kuttl-tests/barbican-keystone-listener-566c6b7f4b-gjml4" Mar 16 16:27:04 crc kubenswrapper[5120]: I0316 16:27:04.658530 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwg5z\" (UniqueName: \"kubernetes.io/projected/bbd47432-e63f-4ba0-8daa-edfb3d2b0af9-kube-api-access-kwg5z\") pod \"barbican-worker-8649c995c9-lzq96\" (UID: \"bbd47432-e63f-4ba0-8daa-edfb3d2b0af9\") " pod="openstack-kuttl-tests/barbican-worker-8649c995c9-lzq96" Mar 16 16:27:04 crc kubenswrapper[5120]: I0316 16:27:04.659063 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9cb535e7-55cc-4b9d-911c-58f8ed50bee6-logs\") pod \"barbican-keystone-listener-566c6b7f4b-gjml4\" (UID: \"9cb535e7-55cc-4b9d-911c-58f8ed50bee6\") " pod="openstack-kuttl-tests/barbican-keystone-listener-566c6b7f4b-gjml4" Mar 16 16:27:04 crc kubenswrapper[5120]: I0316 16:27:04.677267 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9cb535e7-55cc-4b9d-911c-58f8ed50bee6-combined-ca-bundle\") pod \"barbican-keystone-listener-566c6b7f4b-gjml4\" (UID: \"9cb535e7-55cc-4b9d-911c-58f8ed50bee6\") " pod="openstack-kuttl-tests/barbican-keystone-listener-566c6b7f4b-gjml4" Mar 16 16:27:04 crc kubenswrapper[5120]: I0316 16:27:04.685974 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9cb535e7-55cc-4b9d-911c-58f8ed50bee6-config-data\") pod \"barbican-keystone-listener-566c6b7f4b-gjml4\" (UID: \"9cb535e7-55cc-4b9d-911c-58f8ed50bee6\") " pod="openstack-kuttl-tests/barbican-keystone-listener-566c6b7f4b-gjml4" Mar 16 16:27:04 crc kubenswrapper[5120]: I0316 16:27:04.709600 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/9cb535e7-55cc-4b9d-911c-58f8ed50bee6-config-data-custom\") pod \"barbican-keystone-listener-566c6b7f4b-gjml4\" (UID: \"9cb535e7-55cc-4b9d-911c-58f8ed50bee6\") " pod="openstack-kuttl-tests/barbican-keystone-listener-566c6b7f4b-gjml4" Mar 16 16:27:04 crc kubenswrapper[5120]: I0316 16:27:04.712533 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwrvp\" (UniqueName: \"kubernetes.io/projected/9cb535e7-55cc-4b9d-911c-58f8ed50bee6-kube-api-access-xwrvp\") pod \"barbican-keystone-listener-566c6b7f4b-gjml4\" (UID: \"9cb535e7-55cc-4b9d-911c-58f8ed50bee6\") " pod="openstack-kuttl-tests/barbican-keystone-listener-566c6b7f4b-gjml4" Mar 16 16:27:04 crc kubenswrapper[5120]: I0316 16:27:04.717284 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-6644db8644-8f7lt"] Mar 16 16:27:04 crc kubenswrapper[5120]: I0316 16:27:04.717586 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-6644db8644-8f7lt" podUID="f01e7eb4-b5fe-4cfc-9657-66955e94fa03" containerName="barbican-api-log" containerID="cri-o://507c172a147fc2718d35a597fd31cfd6ff8094f9490ea2b077d0e8181af5ffee" gracePeriod=30 Mar 16 16:27:04 crc kubenswrapper[5120]: I0316 16:27:04.718058 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-6644db8644-8f7lt" podUID="f01e7eb4-b5fe-4cfc-9657-66955e94fa03" containerName="barbican-api" containerID="cri-o://8c6f35ac2a4ae8db4c7f86f87aaa9f9d6f44d088bc2852c398dd7214cf0458c9" gracePeriod=30 Mar 16 16:27:04 crc kubenswrapper[5120]: I0316 16:27:04.741029 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-6644db8644-8f7lt" podUID="f01e7eb4-b5fe-4cfc-9657-66955e94fa03" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.1.208:9311/healthcheck\": EOF" Mar 16 16:27:04 crc kubenswrapper[5120]: I0316 16:27:04.741097 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-6644db8644-8f7lt" podUID="f01e7eb4-b5fe-4cfc-9657-66955e94fa03" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.1.208:9311/healthcheck\": EOF" Mar 16 16:27:04 crc kubenswrapper[5120]: I0316 16:27:04.741581 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openstack-kuttl-tests/barbican-api-6644db8644-8f7lt" podUID="f01e7eb4-b5fe-4cfc-9657-66955e94fa03" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.1.208:9311/healthcheck\": EOF" Mar 16 16:27:04 crc kubenswrapper[5120]: I0316 16:27:04.762003 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/bbd47432-e63f-4ba0-8daa-edfb3d2b0af9-logs\") pod \"barbican-worker-8649c995c9-lzq96\" (UID: \"bbd47432-e63f-4ba0-8daa-edfb3d2b0af9\") " pod="openstack-kuttl-tests/barbican-worker-8649c995c9-lzq96" Mar 16 16:27:04 crc kubenswrapper[5120]: I0316 16:27:04.762083 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/bbd47432-e63f-4ba0-8daa-edfb3d2b0af9-config-data-custom\") pod \"barbican-worker-8649c995c9-lzq96\" (UID: \"bbd47432-e63f-4ba0-8daa-edfb3d2b0af9\") " pod="openstack-kuttl-tests/barbican-worker-8649c995c9-lzq96" Mar 16 16:27:04 crc kubenswrapper[5120]: I0316 16:27:04.762192 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kwg5z\" (UniqueName: \"kubernetes.io/projected/bbd47432-e63f-4ba0-8daa-edfb3d2b0af9-kube-api-access-kwg5z\") pod \"barbican-worker-8649c995c9-lzq96\" (UID: \"bbd47432-e63f-4ba0-8daa-edfb3d2b0af9\") " pod="openstack-kuttl-tests/barbican-worker-8649c995c9-lzq96" Mar 16 16:27:04 crc kubenswrapper[5120]: I0316 16:27:04.762514 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bbd47432-e63f-4ba0-8daa-edfb3d2b0af9-config-data\") pod \"barbican-worker-8649c995c9-lzq96\" (UID: \"bbd47432-e63f-4ba0-8daa-edfb3d2b0af9\") " pod="openstack-kuttl-tests/barbican-worker-8649c995c9-lzq96" Mar 16 16:27:04 crc kubenswrapper[5120]: I0316 16:27:04.762572 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bbd47432-e63f-4ba0-8daa-edfb3d2b0af9-combined-ca-bundle\") pod \"barbican-worker-8649c995c9-lzq96\" (UID: \"bbd47432-e63f-4ba0-8daa-edfb3d2b0af9\") " pod="openstack-kuttl-tests/barbican-worker-8649c995c9-lzq96" Mar 16 16:27:04 crc kubenswrapper[5120]: I0316 16:27:04.762607 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/bbd47432-e63f-4ba0-8daa-edfb3d2b0af9-logs\") pod \"barbican-worker-8649c995c9-lzq96\" (UID: \"bbd47432-e63f-4ba0-8daa-edfb3d2b0af9\") " pod="openstack-kuttl-tests/barbican-worker-8649c995c9-lzq96" Mar 16 16:27:04 crc kubenswrapper[5120]: I0316 16:27:04.775895 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/bbd47432-e63f-4ba0-8daa-edfb3d2b0af9-config-data-custom\") pod \"barbican-worker-8649c995c9-lzq96\" (UID: \"bbd47432-e63f-4ba0-8daa-edfb3d2b0af9\") " pod="openstack-kuttl-tests/barbican-worker-8649c995c9-lzq96" Mar 16 16:27:04 crc kubenswrapper[5120]: I0316 16:27:04.801364 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwg5z\" (UniqueName: \"kubernetes.io/projected/bbd47432-e63f-4ba0-8daa-edfb3d2b0af9-kube-api-access-kwg5z\") pod \"barbican-worker-8649c995c9-lzq96\" (UID: \"bbd47432-e63f-4ba0-8daa-edfb3d2b0af9\") " pod="openstack-kuttl-tests/barbican-worker-8649c995c9-lzq96" Mar 16 16:27:04 crc kubenswrapper[5120]: I0316 16:27:04.803393 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bbd47432-e63f-4ba0-8daa-edfb3d2b0af9-combined-ca-bundle\") pod \"barbican-worker-8649c995c9-lzq96\" (UID: \"bbd47432-e63f-4ba0-8daa-edfb3d2b0af9\") " pod="openstack-kuttl-tests/barbican-worker-8649c995c9-lzq96" Mar 16 16:27:04 crc kubenswrapper[5120]: I0316 16:27:04.805406 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-api-76cb6cf57b-j7csd"] Mar 16 16:27:04 crc kubenswrapper[5120]: I0316 16:27:04.815848 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bbd47432-e63f-4ba0-8daa-edfb3d2b0af9-config-data\") pod \"barbican-worker-8649c995c9-lzq96\" (UID: \"bbd47432-e63f-4ba0-8daa-edfb3d2b0af9\") " pod="openstack-kuttl-tests/barbican-worker-8649c995c9-lzq96" Mar 16 16:27:04 crc kubenswrapper[5120]: I0316 16:27:04.829744 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-76cb6cf57b-j7csd" Mar 16 16:27:04 crc kubenswrapper[5120]: I0316 16:27:04.850501 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-6644db8644-8f7lt" podUID="f01e7eb4-b5fe-4cfc-9657-66955e94fa03" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.1.208:9311/healthcheck\": read tcp 10.217.0.2:35442->10.217.1.208:9311: read: connection reset by peer" Mar 16 16:27:04 crc kubenswrapper[5120]: I0316 16:27:04.850646 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openstack-kuttl-tests/barbican-api-6644db8644-8f7lt" podUID="f01e7eb4-b5fe-4cfc-9657-66955e94fa03" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.1.208:9311/healthcheck\": EOF" Mar 16 16:27:04 crc kubenswrapper[5120]: I0316 16:27:04.858350 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-76cb6cf57b-j7csd"] Mar 16 16:27:04 crc kubenswrapper[5120]: I0316 16:27:04.869720 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3253648c-08a0-4d00-87e2-121fe9240d23-logs\") pod \"barbican-api-76cb6cf57b-j7csd\" (UID: \"3253648c-08a0-4d00-87e2-121fe9240d23\") " pod="openstack-kuttl-tests/barbican-api-76cb6cf57b-j7csd" Mar 16 16:27:04 crc kubenswrapper[5120]: I0316 16:27:04.869873 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8mgn\" (UniqueName: \"kubernetes.io/projected/3253648c-08a0-4d00-87e2-121fe9240d23-kube-api-access-m8mgn\") pod \"barbican-api-76cb6cf57b-j7csd\" (UID: \"3253648c-08a0-4d00-87e2-121fe9240d23\") " pod="openstack-kuttl-tests/barbican-api-76cb6cf57b-j7csd" Mar 16 16:27:04 crc kubenswrapper[5120]: I0316 16:27:04.869898 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3253648c-08a0-4d00-87e2-121fe9240d23-config-data\") pod \"barbican-api-76cb6cf57b-j7csd\" (UID: \"3253648c-08a0-4d00-87e2-121fe9240d23\") " pod="openstack-kuttl-tests/barbican-api-76cb6cf57b-j7csd" Mar 16 16:27:04 crc kubenswrapper[5120]: I0316 16:27:04.869927 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/3253648c-08a0-4d00-87e2-121fe9240d23-public-tls-certs\") pod \"barbican-api-76cb6cf57b-j7csd\" (UID: \"3253648c-08a0-4d00-87e2-121fe9240d23\") " pod="openstack-kuttl-tests/barbican-api-76cb6cf57b-j7csd" Mar 16 16:27:04 crc kubenswrapper[5120]: I0316 16:27:04.869982 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3253648c-08a0-4d00-87e2-121fe9240d23-combined-ca-bundle\") pod \"barbican-api-76cb6cf57b-j7csd\" (UID: \"3253648c-08a0-4d00-87e2-121fe9240d23\") " pod="openstack-kuttl-tests/barbican-api-76cb6cf57b-j7csd" Mar 16 16:27:04 crc kubenswrapper[5120]: I0316 16:27:04.870036 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/3253648c-08a0-4d00-87e2-121fe9240d23-config-data-custom\") pod \"barbican-api-76cb6cf57b-j7csd\" (UID: \"3253648c-08a0-4d00-87e2-121fe9240d23\") " pod="openstack-kuttl-tests/barbican-api-76cb6cf57b-j7csd" Mar 16 16:27:04 crc kubenswrapper[5120]: I0316 16:27:04.870164 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/3253648c-08a0-4d00-87e2-121fe9240d23-internal-tls-certs\") pod \"barbican-api-76cb6cf57b-j7csd\" (UID: \"3253648c-08a0-4d00-87e2-121fe9240d23\") " pod="openstack-kuttl-tests/barbican-api-76cb6cf57b-j7csd" Mar 16 16:27:04 crc kubenswrapper[5120]: I0316 16:27:04.885188 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-566c6b7f4b-gjml4" Mar 16 16:27:04 crc kubenswrapper[5120]: I0316 16:27:04.973110 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/3253648c-08a0-4d00-87e2-121fe9240d23-public-tls-certs\") pod \"barbican-api-76cb6cf57b-j7csd\" (UID: \"3253648c-08a0-4d00-87e2-121fe9240d23\") " pod="openstack-kuttl-tests/barbican-api-76cb6cf57b-j7csd" Mar 16 16:27:04 crc kubenswrapper[5120]: I0316 16:27:04.973506 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3253648c-08a0-4d00-87e2-121fe9240d23-combined-ca-bundle\") pod \"barbican-api-76cb6cf57b-j7csd\" (UID: \"3253648c-08a0-4d00-87e2-121fe9240d23\") " pod="openstack-kuttl-tests/barbican-api-76cb6cf57b-j7csd" Mar 16 16:27:04 crc kubenswrapper[5120]: I0316 16:27:04.973568 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/3253648c-08a0-4d00-87e2-121fe9240d23-config-data-custom\") pod \"barbican-api-76cb6cf57b-j7csd\" (UID: \"3253648c-08a0-4d00-87e2-121fe9240d23\") " pod="openstack-kuttl-tests/barbican-api-76cb6cf57b-j7csd" Mar 16 16:27:04 crc kubenswrapper[5120]: I0316 16:27:04.973677 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/3253648c-08a0-4d00-87e2-121fe9240d23-internal-tls-certs\") pod \"barbican-api-76cb6cf57b-j7csd\" (UID: \"3253648c-08a0-4d00-87e2-121fe9240d23\") " pod="openstack-kuttl-tests/barbican-api-76cb6cf57b-j7csd" Mar 16 16:27:04 crc kubenswrapper[5120]: I0316 16:27:04.973852 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3253648c-08a0-4d00-87e2-121fe9240d23-logs\") pod \"barbican-api-76cb6cf57b-j7csd\" (UID: \"3253648c-08a0-4d00-87e2-121fe9240d23\") " pod="openstack-kuttl-tests/barbican-api-76cb6cf57b-j7csd" Mar 16 16:27:04 crc kubenswrapper[5120]: I0316 16:27:04.973947 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m8mgn\" (UniqueName: \"kubernetes.io/projected/3253648c-08a0-4d00-87e2-121fe9240d23-kube-api-access-m8mgn\") pod \"barbican-api-76cb6cf57b-j7csd\" (UID: \"3253648c-08a0-4d00-87e2-121fe9240d23\") " pod="openstack-kuttl-tests/barbican-api-76cb6cf57b-j7csd" Mar 16 16:27:04 crc kubenswrapper[5120]: I0316 16:27:04.973965 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3253648c-08a0-4d00-87e2-121fe9240d23-config-data\") pod \"barbican-api-76cb6cf57b-j7csd\" (UID: \"3253648c-08a0-4d00-87e2-121fe9240d23\") " pod="openstack-kuttl-tests/barbican-api-76cb6cf57b-j7csd" Mar 16 16:27:04 crc kubenswrapper[5120]: I0316 16:27:04.975401 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3253648c-08a0-4d00-87e2-121fe9240d23-logs\") pod \"barbican-api-76cb6cf57b-j7csd\" (UID: \"3253648c-08a0-4d00-87e2-121fe9240d23\") " pod="openstack-kuttl-tests/barbican-api-76cb6cf57b-j7csd" Mar 16 16:27:04 crc kubenswrapper[5120]: I0316 16:27:04.977818 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-8649c995c9-lzq96" Mar 16 16:27:04 crc kubenswrapper[5120]: I0316 16:27:04.988461 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/3253648c-08a0-4d00-87e2-121fe9240d23-internal-tls-certs\") pod \"barbican-api-76cb6cf57b-j7csd\" (UID: \"3253648c-08a0-4d00-87e2-121fe9240d23\") " pod="openstack-kuttl-tests/barbican-api-76cb6cf57b-j7csd" Mar 16 16:27:04 crc kubenswrapper[5120]: I0316 16:27:04.989029 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/3253648c-08a0-4d00-87e2-121fe9240d23-config-data-custom\") pod \"barbican-api-76cb6cf57b-j7csd\" (UID: \"3253648c-08a0-4d00-87e2-121fe9240d23\") " pod="openstack-kuttl-tests/barbican-api-76cb6cf57b-j7csd" Mar 16 16:27:04 crc kubenswrapper[5120]: I0316 16:27:04.990886 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3253648c-08a0-4d00-87e2-121fe9240d23-config-data\") pod \"barbican-api-76cb6cf57b-j7csd\" (UID: \"3253648c-08a0-4d00-87e2-121fe9240d23\") " pod="openstack-kuttl-tests/barbican-api-76cb6cf57b-j7csd" Mar 16 16:27:05 crc kubenswrapper[5120]: I0316 16:27:04.998080 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/3253648c-08a0-4d00-87e2-121fe9240d23-public-tls-certs\") pod \"barbican-api-76cb6cf57b-j7csd\" (UID: \"3253648c-08a0-4d00-87e2-121fe9240d23\") " pod="openstack-kuttl-tests/barbican-api-76cb6cf57b-j7csd" Mar 16 16:27:05 crc kubenswrapper[5120]: I0316 16:27:05.004385 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3253648c-08a0-4d00-87e2-121fe9240d23-combined-ca-bundle\") pod \"barbican-api-76cb6cf57b-j7csd\" (UID: \"3253648c-08a0-4d00-87e2-121fe9240d23\") " pod="openstack-kuttl-tests/barbican-api-76cb6cf57b-j7csd" Mar 16 16:27:05 crc kubenswrapper[5120]: I0316 16:27:05.004441 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8mgn\" (UniqueName: \"kubernetes.io/projected/3253648c-08a0-4d00-87e2-121fe9240d23-kube-api-access-m8mgn\") pod \"barbican-api-76cb6cf57b-j7csd\" (UID: \"3253648c-08a0-4d00-87e2-121fe9240d23\") " pod="openstack-kuttl-tests/barbican-api-76cb6cf57b-j7csd" Mar 16 16:27:05 crc kubenswrapper[5120]: I0316 16:27:05.082530 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:27:05 crc kubenswrapper[5120]: I0316 16:27:05.101443 5120 generic.go:358] "Generic (PLEG): container finished" podID="dcb14165-880d-48a0-bb00-5061b8aa1a4b" containerID="12d9e72b65fc03ba4e03766289bfe450989ef41457e89fa82c116b2b0e4acdaf" exitCode=143 Mar 16 16:27:05 crc kubenswrapper[5120]: I0316 16:27:05.102189 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"dcb14165-880d-48a0-bb00-5061b8aa1a4b","Type":"ContainerDied","Data":"12d9e72b65fc03ba4e03766289bfe450989ef41457e89fa82c116b2b0e4acdaf"} Mar 16 16:27:05 crc kubenswrapper[5120]: I0316 16:27:05.149423 5120 generic.go:358] "Generic (PLEG): container finished" podID="f01e7eb4-b5fe-4cfc-9657-66955e94fa03" containerID="507c172a147fc2718d35a597fd31cfd6ff8094f9490ea2b077d0e8181af5ffee" exitCode=143 Mar 16 16:27:05 crc kubenswrapper[5120]: I0316 16:27:05.149554 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-6644db8644-8f7lt" event={"ID":"f01e7eb4-b5fe-4cfc-9657-66955e94fa03","Type":"ContainerDied","Data":"507c172a147fc2718d35a597fd31cfd6ff8094f9490ea2b077d0e8181af5ffee"} Mar 16 16:27:05 crc kubenswrapper[5120]: I0316 16:27:05.187389 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-76cb6cf57b-j7csd" Mar 16 16:27:05 crc kubenswrapper[5120]: I0316 16:27:05.383584 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-566c6b7f4b-gjml4"] Mar 16 16:27:05 crc kubenswrapper[5120]: I0316 16:27:05.594802 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:27:05 crc kubenswrapper[5120]: I0316 16:27:05.755443 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-8649c995c9-lzq96"] Mar 16 16:27:05 crc kubenswrapper[5120]: I0316 16:27:05.924164 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-76cb6cf57b-j7csd"] Mar 16 16:27:05 crc kubenswrapper[5120]: W0316 16:27:05.935999 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3253648c_08a0_4d00_87e2_121fe9240d23.slice/crio-fe30a50c4c535c24ddc9f4a5fcc19ef0d415eca8d58703bc903c89990f48bb5c WatchSource:0}: Error finding container fe30a50c4c535c24ddc9f4a5fcc19ef0d415eca8d58703bc903c89990f48bb5c: Status 404 returned error can't find the container with id fe30a50c4c535c24ddc9f4a5fcc19ef0d415eca8d58703bc903c89990f48bb5c Mar 16 16:27:06 crc kubenswrapper[5120]: I0316 16:27:06.206785 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-76cb6cf57b-j7csd" event={"ID":"3253648c-08a0-4d00-87e2-121fe9240d23","Type":"ContainerStarted","Data":"fe30a50c4c535c24ddc9f4a5fcc19ef0d415eca8d58703bc903c89990f48bb5c"} Mar 16 16:27:06 crc kubenswrapper[5120]: I0316 16:27:06.226054 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-566c6b7f4b-gjml4" event={"ID":"9cb535e7-55cc-4b9d-911c-58f8ed50bee6","Type":"ContainerStarted","Data":"4739157a6d4b51c37814000e2ecdb4f3562bd3a81b3434bad9b0d3c2052c6f8e"} Mar 16 16:27:06 crc kubenswrapper[5120]: I0316 16:27:06.226306 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-566c6b7f4b-gjml4" event={"ID":"9cb535e7-55cc-4b9d-911c-58f8ed50bee6","Type":"ContainerStarted","Data":"139fe8432dd1ea7d867e52305d1dac37bbb12ec543822fe2baf07be09cbee599"} Mar 16 16:27:06 crc kubenswrapper[5120]: I0316 16:27:06.232392 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"e4bad0fb-46f9-4865-a897-c30da4fa8ffc","Type":"ContainerStarted","Data":"55e26e26cad1abefe9b7fb7057d8919fe5be21a3e7ef711fcade2da4e30ae1cb"} Mar 16 16:27:06 crc kubenswrapper[5120]: I0316 16:27:06.232422 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"e4bad0fb-46f9-4865-a897-c30da4fa8ffc","Type":"ContainerStarted","Data":"40441b8a582506e4f6bf4812c949b58c4f3c22bfbe65770287d19c52b316caf4"} Mar 16 16:27:06 crc kubenswrapper[5120]: I0316 16:27:06.245618 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-8649c995c9-lzq96" event={"ID":"bbd47432-e63f-4ba0-8daa-edfb3d2b0af9","Type":"ContainerStarted","Data":"ef3f1cf32bdce0edaa87a00b39179f41bb817d5cf035cdf5ced8fda3505edb15"} Mar 16 16:27:06 crc kubenswrapper[5120]: I0316 16:27:06.245658 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-8649c995c9-lzq96" event={"ID":"bbd47432-e63f-4ba0-8daa-edfb3d2b0af9","Type":"ContainerStarted","Data":"8c06713e1c2327f717627562e92208b87909fda67c0d8fabd8687853e1298c1b"} Mar 16 16:27:07 crc kubenswrapper[5120]: I0316 16:27:07.242750 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-6644db8644-8f7lt" Mar 16 16:27:07 crc kubenswrapper[5120]: I0316 16:27:07.256572 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-76cb6cf57b-j7csd" event={"ID":"3253648c-08a0-4d00-87e2-121fe9240d23","Type":"ContainerStarted","Data":"d015c3c14c7d9b3c3a75819d57a9b899aaf097f05482262725fe5621d88fcfeb"} Mar 16 16:27:07 crc kubenswrapper[5120]: I0316 16:27:07.256614 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-76cb6cf57b-j7csd" event={"ID":"3253648c-08a0-4d00-87e2-121fe9240d23","Type":"ContainerStarted","Data":"228e632eee85749f4708dd46a1233dd311e9c155a72567279f23819c8f559297"} Mar 16 16:27:07 crc kubenswrapper[5120]: I0316 16:27:07.256886 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-76cb6cf57b-j7csd" Mar 16 16:27:07 crc kubenswrapper[5120]: I0316 16:27:07.257934 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-76cb6cf57b-j7csd" Mar 16 16:27:07 crc kubenswrapper[5120]: I0316 16:27:07.265868 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-566c6b7f4b-gjml4" event={"ID":"9cb535e7-55cc-4b9d-911c-58f8ed50bee6","Type":"ContainerStarted","Data":"e21b312f4394d0cf417797387371f78390ddb2171778c91b768199fbff017acc"} Mar 16 16:27:07 crc kubenswrapper[5120]: I0316 16:27:07.271317 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"e4bad0fb-46f9-4865-a897-c30da4fa8ffc","Type":"ContainerStarted","Data":"9aea5d08c763b9963d50f97a99cae4377f76e8477e66152b6d28e85ebfc2c346"} Mar 16 16:27:07 crc kubenswrapper[5120]: I0316 16:27:07.275502 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-8649c995c9-lzq96" event={"ID":"bbd47432-e63f-4ba0-8daa-edfb3d2b0af9","Type":"ContainerStarted","Data":"a8d0450cf9b56a1f1a591c22074f8f02a21e970d858afe7341ab0e647e4581ed"} Mar 16 16:27:07 crc kubenswrapper[5120]: I0316 16:27:07.291931 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-api-76cb6cf57b-j7csd" podStartSLOduration=3.291906782 podStartE2EDuration="3.291906782s" podCreationTimestamp="2026-03-16 16:27:04 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:27:07.287049803 +0000 UTC m=+3329.440981470" watchObservedRunningTime="2026-03-16 16:27:07.291906782 +0000 UTC m=+3329.445838439" Mar 16 16:27:07 crc kubenswrapper[5120]: I0316 16:27:07.313498 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-keystone-listener-566c6b7f4b-gjml4" podStartSLOduration=3.31347518 podStartE2EDuration="3.31347518s" podCreationTimestamp="2026-03-16 16:27:04 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:27:07.302300211 +0000 UTC m=+3329.456231868" watchObservedRunningTime="2026-03-16 16:27:07.31347518 +0000 UTC m=+3329.467406837" Mar 16 16:27:07 crc kubenswrapper[5120]: I0316 16:27:07.341223 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-worker-8649c995c9-lzq96" podStartSLOduration=3.341204942 podStartE2EDuration="3.341204942s" podCreationTimestamp="2026-03-16 16:27:04 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:27:07.320555969 +0000 UTC m=+3329.474487626" watchObservedRunningTime="2026-03-16 16:27:07.341204942 +0000 UTC m=+3329.495136599" Mar 16 16:27:07 crc kubenswrapper[5120]: I0316 16:27:07.352965 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-6b6d87dc7d-zrnjh"] Mar 16 16:27:07 crc kubenswrapper[5120]: I0316 16:27:07.353199 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-6b6d87dc7d-zrnjh" podUID="5d85f5fb-0f61-4689-9493-daa49e079f98" containerName="barbican-keystone-listener-log" containerID="cri-o://64045bb385eeaee8a027fca93390992d213763f4e9e281165275617dd4a5c78d" gracePeriod=30 Mar 16 16:27:07 crc kubenswrapper[5120]: I0316 16:27:07.353668 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-6b6d87dc7d-zrnjh" podUID="5d85f5fb-0f61-4689-9493-daa49e079f98" containerName="barbican-keystone-listener" containerID="cri-o://4c6a773512b7a3c9b35b5154fc493c76e16e8601967c0466aeba16db6bcfa5c6" gracePeriod=30 Mar 16 16:27:07 crc kubenswrapper[5120]: I0316 16:27:07.376539 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-54c4c64f95-r2mxb"] Mar 16 16:27:07 crc kubenswrapper[5120]: I0316 16:27:07.377088 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-54c4c64f95-r2mxb" podUID="ffa91919-32b8-43f8-9332-4d7c16575345" containerName="barbican-worker-log" containerID="cri-o://a513a169c61b77a1e92097f1bca1909c5c168bf9972bc9fc9270fdf7e43c64bf" gracePeriod=30 Mar 16 16:27:07 crc kubenswrapper[5120]: I0316 16:27:07.377546 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-54c4c64f95-r2mxb" podUID="ffa91919-32b8-43f8-9332-4d7c16575345" containerName="barbican-worker" containerID="cri-o://d0deb63230b940185b33fefe5581b8662da802157a78b3fbece72a39b98c9ef5" gracePeriod=30 Mar 16 16:27:08 crc kubenswrapper[5120]: E0316 16:27:08.259032 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1915872 actualBytes=10240 Mar 16 16:27:08 crc kubenswrapper[5120]: I0316 16:27:08.290189 5120 generic.go:358] "Generic (PLEG): container finished" podID="ffa91919-32b8-43f8-9332-4d7c16575345" containerID="a513a169c61b77a1e92097f1bca1909c5c168bf9972bc9fc9270fdf7e43c64bf" exitCode=143 Mar 16 16:27:08 crc kubenswrapper[5120]: I0316 16:27:08.290285 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-54c4c64f95-r2mxb" event={"ID":"ffa91919-32b8-43f8-9332-4d7c16575345","Type":"ContainerDied","Data":"a513a169c61b77a1e92097f1bca1909c5c168bf9972bc9fc9270fdf7e43c64bf"} Mar 16 16:27:08 crc kubenswrapper[5120]: I0316 16:27:08.293392 5120 generic.go:358] "Generic (PLEG): container finished" podID="5d85f5fb-0f61-4689-9493-daa49e079f98" containerID="64045bb385eeaee8a027fca93390992d213763f4e9e281165275617dd4a5c78d" exitCode=143 Mar 16 16:27:08 crc kubenswrapper[5120]: I0316 16:27:08.293480 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-6b6d87dc7d-zrnjh" event={"ID":"5d85f5fb-0f61-4689-9493-daa49e079f98","Type":"ContainerDied","Data":"64045bb385eeaee8a027fca93390992d213763f4e9e281165275617dd4a5c78d"} Mar 16 16:27:09 crc kubenswrapper[5120]: I0316 16:27:09.328337 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"e4bad0fb-46f9-4865-a897-c30da4fa8ffc","Type":"ContainerStarted","Data":"b16383c70508646ab1611bdfed8758a7e6a61c8ffe20cff415dbcbb996dbf937"} Mar 16 16:27:09 crc kubenswrapper[5120]: I0316 16:27:09.329812 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:27:09 crc kubenswrapper[5120]: I0316 16:27:09.363852 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=1.963063734 podStartE2EDuration="7.3638258s" podCreationTimestamp="2026-03-16 16:27:02 +0000 UTC" firstStartedPulling="2026-03-16 16:27:03.0898769 +0000 UTC m=+3325.243808557" lastFinishedPulling="2026-03-16 16:27:08.490638966 +0000 UTC m=+3330.644570623" observedRunningTime="2026-03-16 16:27:09.358875569 +0000 UTC m=+3331.512807266" watchObservedRunningTime="2026-03-16 16:27:09.3638258 +0000 UTC m=+3331.517757497" Mar 16 16:27:10 crc kubenswrapper[5120]: I0316 16:27:10.340812 5120 generic.go:358] "Generic (PLEG): container finished" podID="ffa91919-32b8-43f8-9332-4d7c16575345" containerID="d0deb63230b940185b33fefe5581b8662da802157a78b3fbece72a39b98c9ef5" exitCode=0 Mar 16 16:27:10 crc kubenswrapper[5120]: I0316 16:27:10.340851 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-54c4c64f95-r2mxb" event={"ID":"ffa91919-32b8-43f8-9332-4d7c16575345","Type":"ContainerDied","Data":"d0deb63230b940185b33fefe5581b8662da802157a78b3fbece72a39b98c9ef5"} Mar 16 16:27:10 crc kubenswrapper[5120]: I0316 16:27:10.343577 5120 generic.go:358] "Generic (PLEG): container finished" podID="5d85f5fb-0f61-4689-9493-daa49e079f98" containerID="4c6a773512b7a3c9b35b5154fc493c76e16e8601967c0466aeba16db6bcfa5c6" exitCode=0 Mar 16 16:27:10 crc kubenswrapper[5120]: I0316 16:27:10.343662 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-6b6d87dc7d-zrnjh" event={"ID":"5d85f5fb-0f61-4689-9493-daa49e079f98","Type":"ContainerDied","Data":"4c6a773512b7a3c9b35b5154fc493c76e16e8601967c0466aeba16db6bcfa5c6"} Mar 16 16:27:10 crc kubenswrapper[5120]: I0316 16:27:10.602091 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-6b6d87dc7d-zrnjh" Mar 16 16:27:10 crc kubenswrapper[5120]: I0316 16:27:10.613509 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-54c4c64f95-r2mxb" Mar 16 16:27:10 crc kubenswrapper[5120]: I0316 16:27:10.744457 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/5d85f5fb-0f61-4689-9493-daa49e079f98-config-data-custom\") pod \"5d85f5fb-0f61-4689-9493-daa49e079f98\" (UID: \"5d85f5fb-0f61-4689-9493-daa49e079f98\") " Mar 16 16:27:10 crc kubenswrapper[5120]: I0316 16:27:10.744889 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ffa91919-32b8-43f8-9332-4d7c16575345-combined-ca-bundle\") pod \"ffa91919-32b8-43f8-9332-4d7c16575345\" (UID: \"ffa91919-32b8-43f8-9332-4d7c16575345\") " Mar 16 16:27:10 crc kubenswrapper[5120]: I0316 16:27:10.745061 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ffa91919-32b8-43f8-9332-4d7c16575345-config-data\") pod \"ffa91919-32b8-43f8-9332-4d7c16575345\" (UID: \"ffa91919-32b8-43f8-9332-4d7c16575345\") " Mar 16 16:27:10 crc kubenswrapper[5120]: I0316 16:27:10.745622 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ztbsn\" (UniqueName: \"kubernetes.io/projected/5d85f5fb-0f61-4689-9493-daa49e079f98-kube-api-access-ztbsn\") pod \"5d85f5fb-0f61-4689-9493-daa49e079f98\" (UID: \"5d85f5fb-0f61-4689-9493-daa49e079f98\") " Mar 16 16:27:10 crc kubenswrapper[5120]: I0316 16:27:10.746094 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nzmdd\" (UniqueName: \"kubernetes.io/projected/ffa91919-32b8-43f8-9332-4d7c16575345-kube-api-access-nzmdd\") pod \"ffa91919-32b8-43f8-9332-4d7c16575345\" (UID: \"ffa91919-32b8-43f8-9332-4d7c16575345\") " Mar 16 16:27:10 crc kubenswrapper[5120]: I0316 16:27:10.746217 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/ffa91919-32b8-43f8-9332-4d7c16575345-config-data-custom\") pod \"ffa91919-32b8-43f8-9332-4d7c16575345\" (UID: \"ffa91919-32b8-43f8-9332-4d7c16575345\") " Mar 16 16:27:10 crc kubenswrapper[5120]: I0316 16:27:10.746328 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ffa91919-32b8-43f8-9332-4d7c16575345-logs\") pod \"ffa91919-32b8-43f8-9332-4d7c16575345\" (UID: \"ffa91919-32b8-43f8-9332-4d7c16575345\") " Mar 16 16:27:10 crc kubenswrapper[5120]: I0316 16:27:10.746435 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5d85f5fb-0f61-4689-9493-daa49e079f98-logs\") pod \"5d85f5fb-0f61-4689-9493-daa49e079f98\" (UID: \"5d85f5fb-0f61-4689-9493-daa49e079f98\") " Mar 16 16:27:10 crc kubenswrapper[5120]: I0316 16:27:10.746535 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5d85f5fb-0f61-4689-9493-daa49e079f98-config-data\") pod \"5d85f5fb-0f61-4689-9493-daa49e079f98\" (UID: \"5d85f5fb-0f61-4689-9493-daa49e079f98\") " Mar 16 16:27:10 crc kubenswrapper[5120]: I0316 16:27:10.746736 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5d85f5fb-0f61-4689-9493-daa49e079f98-combined-ca-bundle\") pod \"5d85f5fb-0f61-4689-9493-daa49e079f98\" (UID: \"5d85f5fb-0f61-4689-9493-daa49e079f98\") " Mar 16 16:27:10 crc kubenswrapper[5120]: I0316 16:27:10.747142 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ffa91919-32b8-43f8-9332-4d7c16575345-logs" (OuterVolumeSpecName: "logs") pod "ffa91919-32b8-43f8-9332-4d7c16575345" (UID: "ffa91919-32b8-43f8-9332-4d7c16575345"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:27:10 crc kubenswrapper[5120]: I0316 16:27:10.747392 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d85f5fb-0f61-4689-9493-daa49e079f98-logs" (OuterVolumeSpecName: "logs") pod "5d85f5fb-0f61-4689-9493-daa49e079f98" (UID: "5d85f5fb-0f61-4689-9493-daa49e079f98"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:27:10 crc kubenswrapper[5120]: I0316 16:27:10.751124 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d85f5fb-0f61-4689-9493-daa49e079f98-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "5d85f5fb-0f61-4689-9493-daa49e079f98" (UID: "5d85f5fb-0f61-4689-9493-daa49e079f98"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:27:10 crc kubenswrapper[5120]: I0316 16:27:10.752057 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d85f5fb-0f61-4689-9493-daa49e079f98-kube-api-access-ztbsn" (OuterVolumeSpecName: "kube-api-access-ztbsn") pod "5d85f5fb-0f61-4689-9493-daa49e079f98" (UID: "5d85f5fb-0f61-4689-9493-daa49e079f98"). InnerVolumeSpecName "kube-api-access-ztbsn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:27:10 crc kubenswrapper[5120]: I0316 16:27:10.752447 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ffa91919-32b8-43f8-9332-4d7c16575345-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "ffa91919-32b8-43f8-9332-4d7c16575345" (UID: "ffa91919-32b8-43f8-9332-4d7c16575345"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:27:10 crc kubenswrapper[5120]: I0316 16:27:10.752617 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/5d85f5fb-0f61-4689-9493-daa49e079f98-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:27:10 crc kubenswrapper[5120]: I0316 16:27:10.752630 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ztbsn\" (UniqueName: \"kubernetes.io/projected/5d85f5fb-0f61-4689-9493-daa49e079f98-kube-api-access-ztbsn\") on node \"crc\" DevicePath \"\"" Mar 16 16:27:10 crc kubenswrapper[5120]: I0316 16:27:10.752639 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/ffa91919-32b8-43f8-9332-4d7c16575345-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:27:10 crc kubenswrapper[5120]: I0316 16:27:10.752648 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ffa91919-32b8-43f8-9332-4d7c16575345-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:27:10 crc kubenswrapper[5120]: I0316 16:27:10.752657 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5d85f5fb-0f61-4689-9493-daa49e079f98-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:27:10 crc kubenswrapper[5120]: I0316 16:27:10.753196 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ffa91919-32b8-43f8-9332-4d7c16575345-kube-api-access-nzmdd" (OuterVolumeSpecName: "kube-api-access-nzmdd") pod "ffa91919-32b8-43f8-9332-4d7c16575345" (UID: "ffa91919-32b8-43f8-9332-4d7c16575345"). InnerVolumeSpecName "kube-api-access-nzmdd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:27:10 crc kubenswrapper[5120]: I0316 16:27:10.767470 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:27:10 crc kubenswrapper[5120]: I0316 16:27:10.792669 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ffa91919-32b8-43f8-9332-4d7c16575345-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ffa91919-32b8-43f8-9332-4d7c16575345" (UID: "ffa91919-32b8-43f8-9332-4d7c16575345"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:27:10 crc kubenswrapper[5120]: I0316 16:27:10.809129 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:27:10 crc kubenswrapper[5120]: I0316 16:27:10.812116 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d85f5fb-0f61-4689-9493-daa49e079f98-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "5d85f5fb-0f61-4689-9493-daa49e079f98" (UID: "5d85f5fb-0f61-4689-9493-daa49e079f98"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:27:10 crc kubenswrapper[5120]: I0316 16:27:10.832603 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ffa91919-32b8-43f8-9332-4d7c16575345-config-data" (OuterVolumeSpecName: "config-data") pod "ffa91919-32b8-43f8-9332-4d7c16575345" (UID: "ffa91919-32b8-43f8-9332-4d7c16575345"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:27:10 crc kubenswrapper[5120]: I0316 16:27:10.839070 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d85f5fb-0f61-4689-9493-daa49e079f98-config-data" (OuterVolumeSpecName: "config-data") pod "5d85f5fb-0f61-4689-9493-daa49e079f98" (UID: "5d85f5fb-0f61-4689-9493-daa49e079f98"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:27:10 crc kubenswrapper[5120]: I0316 16:27:10.855382 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5d85f5fb-0f61-4689-9493-daa49e079f98-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:27:10 crc kubenswrapper[5120]: I0316 16:27:10.855406 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ffa91919-32b8-43f8-9332-4d7c16575345-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:27:10 crc kubenswrapper[5120]: I0316 16:27:10.855415 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ffa91919-32b8-43f8-9332-4d7c16575345-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:27:10 crc kubenswrapper[5120]: I0316 16:27:10.855424 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nzmdd\" (UniqueName: \"kubernetes.io/projected/ffa91919-32b8-43f8-9332-4d7c16575345-kube-api-access-nzmdd\") on node \"crc\" DevicePath \"\"" Mar 16 16:27:10 crc kubenswrapper[5120]: I0316 16:27:10.855435 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5d85f5fb-0f61-4689-9493-daa49e079f98-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:27:11 crc kubenswrapper[5120]: I0316 16:27:11.030037 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:27:11 crc kubenswrapper[5120]: I0316 16:27:11.262342 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-6644db8644-8f7lt" podUID="f01e7eb4-b5fe-4cfc-9657-66955e94fa03" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.1.208:9311/healthcheck\": read tcp 10.217.0.2:45210->10.217.1.208:9311: read: connection reset by peer" Mar 16 16:27:11 crc kubenswrapper[5120]: I0316 16:27:11.262384 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-6644db8644-8f7lt" podUID="f01e7eb4-b5fe-4cfc-9657-66955e94fa03" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.1.208:9311/healthcheck\": read tcp 10.217.0.2:45224->10.217.1.208:9311: read: connection reset by peer" Mar 16 16:27:11 crc kubenswrapper[5120]: I0316 16:27:11.358071 5120 generic.go:358] "Generic (PLEG): container finished" podID="539c0d5c-8a81-47ff-92fc-1c0c09ad57c0" containerID="174e037af928ab5ddd9ae9c76c17745733eaec6219830d0d7c53066a87259986" exitCode=0 Mar 16 16:27:11 crc kubenswrapper[5120]: I0316 16:27:11.358223 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-gs5vn" event={"ID":"539c0d5c-8a81-47ff-92fc-1c0c09ad57c0","Type":"ContainerDied","Data":"174e037af928ab5ddd9ae9c76c17745733eaec6219830d0d7c53066a87259986"} Mar 16 16:27:11 crc kubenswrapper[5120]: I0316 16:27:11.363416 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-54c4c64f95-r2mxb" event={"ID":"ffa91919-32b8-43f8-9332-4d7c16575345","Type":"ContainerDied","Data":"eb5cf679b2df96e98fa372572f2b7e91c656d2955be8bc1f2abe423faf66d3eb"} Mar 16 16:27:11 crc kubenswrapper[5120]: I0316 16:27:11.363459 5120 scope.go:117] "RemoveContainer" containerID="d0deb63230b940185b33fefe5581b8662da802157a78b3fbece72a39b98c9ef5" Mar 16 16:27:11 crc kubenswrapper[5120]: I0316 16:27:11.363528 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-54c4c64f95-r2mxb" Mar 16 16:27:11 crc kubenswrapper[5120]: I0316 16:27:11.371706 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="2db2b5ba-7cda-442a-b384-b370dfd6bce9" containerName="cinder-scheduler" containerID="cri-o://b2f3e9268caa0986cbd59923285757142d00577f2521a52b4fdbb1ead7df292a" gracePeriod=30 Mar 16 16:27:11 crc kubenswrapper[5120]: I0316 16:27:11.372004 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-6b6d87dc7d-zrnjh" Mar 16 16:27:11 crc kubenswrapper[5120]: I0316 16:27:11.375642 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-6b6d87dc7d-zrnjh" event={"ID":"5d85f5fb-0f61-4689-9493-daa49e079f98","Type":"ContainerDied","Data":"cce839ad531cbd7b2e77de0a5e78e87cdc6f6dab2907de89b198891dc84ffa41"} Mar 16 16:27:11 crc kubenswrapper[5120]: I0316 16:27:11.375690 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="2db2b5ba-7cda-442a-b384-b370dfd6bce9" containerName="probe" containerID="cri-o://a4b6b7975ae4423f96f92300f7d1597d4348b6d6c052013f381e9ba9da669595" gracePeriod=30 Mar 16 16:27:11 crc kubenswrapper[5120]: I0316 16:27:11.446946 5120 scope.go:117] "RemoveContainer" containerID="a513a169c61b77a1e92097f1bca1909c5c168bf9972bc9fc9270fdf7e43c64bf" Mar 16 16:27:11 crc kubenswrapper[5120]: I0316 16:27:11.453918 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-54c4c64f95-r2mxb"] Mar 16 16:27:11 crc kubenswrapper[5120]: I0316 16:27:11.465207 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-worker-54c4c64f95-r2mxb"] Mar 16 16:27:11 crc kubenswrapper[5120]: I0316 16:27:11.473964 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-6b6d87dc7d-zrnjh"] Mar 16 16:27:11 crc kubenswrapper[5120]: I0316 16:27:11.477236 5120 scope.go:117] "RemoveContainer" containerID="4c6a773512b7a3c9b35b5154fc493c76e16e8601967c0466aeba16db6bcfa5c6" Mar 16 16:27:11 crc kubenswrapper[5120]: I0316 16:27:11.480920 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-6b6d87dc7d-zrnjh"] Mar 16 16:27:11 crc kubenswrapper[5120]: I0316 16:27:11.502929 5120 scope.go:117] "RemoveContainer" containerID="64045bb385eeaee8a027fca93390992d213763f4e9e281165275617dd4a5c78d" Mar 16 16:27:11 crc kubenswrapper[5120]: I0316 16:27:11.802920 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-6644db8644-8f7lt" Mar 16 16:27:11 crc kubenswrapper[5120]: I0316 16:27:11.876731 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/f01e7eb4-b5fe-4cfc-9657-66955e94fa03-config-data-custom\") pod \"f01e7eb4-b5fe-4cfc-9657-66955e94fa03\" (UID: \"f01e7eb4-b5fe-4cfc-9657-66955e94fa03\") " Mar 16 16:27:11 crc kubenswrapper[5120]: I0316 16:27:11.876902 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f01e7eb4-b5fe-4cfc-9657-66955e94fa03-combined-ca-bundle\") pod \"f01e7eb4-b5fe-4cfc-9657-66955e94fa03\" (UID: \"f01e7eb4-b5fe-4cfc-9657-66955e94fa03\") " Mar 16 16:27:11 crc kubenswrapper[5120]: I0316 16:27:11.877137 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f01e7eb4-b5fe-4cfc-9657-66955e94fa03-internal-tls-certs\") pod \"f01e7eb4-b5fe-4cfc-9657-66955e94fa03\" (UID: \"f01e7eb4-b5fe-4cfc-9657-66955e94fa03\") " Mar 16 16:27:11 crc kubenswrapper[5120]: I0316 16:27:11.877206 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f01e7eb4-b5fe-4cfc-9657-66955e94fa03-logs\") pod \"f01e7eb4-b5fe-4cfc-9657-66955e94fa03\" (UID: \"f01e7eb4-b5fe-4cfc-9657-66955e94fa03\") " Mar 16 16:27:11 crc kubenswrapper[5120]: I0316 16:27:11.877282 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f01e7eb4-b5fe-4cfc-9657-66955e94fa03-config-data\") pod \"f01e7eb4-b5fe-4cfc-9657-66955e94fa03\" (UID: \"f01e7eb4-b5fe-4cfc-9657-66955e94fa03\") " Mar 16 16:27:11 crc kubenswrapper[5120]: I0316 16:27:11.877327 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f01e7eb4-b5fe-4cfc-9657-66955e94fa03-public-tls-certs\") pod \"f01e7eb4-b5fe-4cfc-9657-66955e94fa03\" (UID: \"f01e7eb4-b5fe-4cfc-9657-66955e94fa03\") " Mar 16 16:27:11 crc kubenswrapper[5120]: I0316 16:27:11.877357 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7md6s\" (UniqueName: \"kubernetes.io/projected/f01e7eb4-b5fe-4cfc-9657-66955e94fa03-kube-api-access-7md6s\") pod \"f01e7eb4-b5fe-4cfc-9657-66955e94fa03\" (UID: \"f01e7eb4-b5fe-4cfc-9657-66955e94fa03\") " Mar 16 16:27:11 crc kubenswrapper[5120]: I0316 16:27:11.883588 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f01e7eb4-b5fe-4cfc-9657-66955e94fa03-logs" (OuterVolumeSpecName: "logs") pod "f01e7eb4-b5fe-4cfc-9657-66955e94fa03" (UID: "f01e7eb4-b5fe-4cfc-9657-66955e94fa03"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:27:11 crc kubenswrapper[5120]: I0316 16:27:11.903988 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f01e7eb4-b5fe-4cfc-9657-66955e94fa03-kube-api-access-7md6s" (OuterVolumeSpecName: "kube-api-access-7md6s") pod "f01e7eb4-b5fe-4cfc-9657-66955e94fa03" (UID: "f01e7eb4-b5fe-4cfc-9657-66955e94fa03"). InnerVolumeSpecName "kube-api-access-7md6s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:27:11 crc kubenswrapper[5120]: I0316 16:27:11.904909 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f01e7eb4-b5fe-4cfc-9657-66955e94fa03-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "f01e7eb4-b5fe-4cfc-9657-66955e94fa03" (UID: "f01e7eb4-b5fe-4cfc-9657-66955e94fa03"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:27:11 crc kubenswrapper[5120]: I0316 16:27:11.918852 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f01e7eb4-b5fe-4cfc-9657-66955e94fa03-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f01e7eb4-b5fe-4cfc-9657-66955e94fa03" (UID: "f01e7eb4-b5fe-4cfc-9657-66955e94fa03"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:27:11 crc kubenswrapper[5120]: I0316 16:27:11.952719 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f01e7eb4-b5fe-4cfc-9657-66955e94fa03-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "f01e7eb4-b5fe-4cfc-9657-66955e94fa03" (UID: "f01e7eb4-b5fe-4cfc-9657-66955e94fa03"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:27:11 crc kubenswrapper[5120]: I0316 16:27:11.954390 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f01e7eb4-b5fe-4cfc-9657-66955e94fa03-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "f01e7eb4-b5fe-4cfc-9657-66955e94fa03" (UID: "f01e7eb4-b5fe-4cfc-9657-66955e94fa03"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:27:11 crc kubenswrapper[5120]: I0316 16:27:11.961744 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f01e7eb4-b5fe-4cfc-9657-66955e94fa03-config-data" (OuterVolumeSpecName: "config-data") pod "f01e7eb4-b5fe-4cfc-9657-66955e94fa03" (UID: "f01e7eb4-b5fe-4cfc-9657-66955e94fa03"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:27:11 crc kubenswrapper[5120]: I0316 16:27:11.979365 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/f01e7eb4-b5fe-4cfc-9657-66955e94fa03-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:27:11 crc kubenswrapper[5120]: I0316 16:27:11.979391 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f01e7eb4-b5fe-4cfc-9657-66955e94fa03-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:27:11 crc kubenswrapper[5120]: I0316 16:27:11.979400 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f01e7eb4-b5fe-4cfc-9657-66955e94fa03-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:27:11 crc kubenswrapper[5120]: I0316 16:27:11.979410 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f01e7eb4-b5fe-4cfc-9657-66955e94fa03-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:27:11 crc kubenswrapper[5120]: I0316 16:27:11.979419 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f01e7eb4-b5fe-4cfc-9657-66955e94fa03-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:27:11 crc kubenswrapper[5120]: I0316 16:27:11.979428 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f01e7eb4-b5fe-4cfc-9657-66955e94fa03-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:27:11 crc kubenswrapper[5120]: I0316 16:27:11.979437 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7md6s\" (UniqueName: \"kubernetes.io/projected/f01e7eb4-b5fe-4cfc-9657-66955e94fa03-kube-api-access-7md6s\") on node \"crc\" DevicePath \"\"" Mar 16 16:27:12 crc kubenswrapper[5120]: I0316 16:27:12.387587 5120 generic.go:358] "Generic (PLEG): container finished" podID="2db2b5ba-7cda-442a-b384-b370dfd6bce9" containerID="a4b6b7975ae4423f96f92300f7d1597d4348b6d6c052013f381e9ba9da669595" exitCode=0 Mar 16 16:27:12 crc kubenswrapper[5120]: I0316 16:27:12.387670 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"2db2b5ba-7cda-442a-b384-b370dfd6bce9","Type":"ContainerDied","Data":"a4b6b7975ae4423f96f92300f7d1597d4348b6d6c052013f381e9ba9da669595"} Mar 16 16:27:12 crc kubenswrapper[5120]: I0316 16:27:12.390877 5120 generic.go:358] "Generic (PLEG): container finished" podID="f01e7eb4-b5fe-4cfc-9657-66955e94fa03" containerID="8c6f35ac2a4ae8db4c7f86f87aaa9f9d6f44d088bc2852c398dd7214cf0458c9" exitCode=0 Mar 16 16:27:12 crc kubenswrapper[5120]: I0316 16:27:12.390962 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-6644db8644-8f7lt" Mar 16 16:27:12 crc kubenswrapper[5120]: I0316 16:27:12.391031 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-6644db8644-8f7lt" event={"ID":"f01e7eb4-b5fe-4cfc-9657-66955e94fa03","Type":"ContainerDied","Data":"8c6f35ac2a4ae8db4c7f86f87aaa9f9d6f44d088bc2852c398dd7214cf0458c9"} Mar 16 16:27:12 crc kubenswrapper[5120]: I0316 16:27:12.391073 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-6644db8644-8f7lt" event={"ID":"f01e7eb4-b5fe-4cfc-9657-66955e94fa03","Type":"ContainerDied","Data":"ba12e7a25f4864d971c48a55095397a7ca2c8e3291b48f8e75394c465bad6a7d"} Mar 16 16:27:12 crc kubenswrapper[5120]: I0316 16:27:12.391095 5120 scope.go:117] "RemoveContainer" containerID="8c6f35ac2a4ae8db4c7f86f87aaa9f9d6f44d088bc2852c398dd7214cf0458c9" Mar 16 16:27:12 crc kubenswrapper[5120]: I0316 16:27:12.441287 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-6644db8644-8f7lt"] Mar 16 16:27:12 crc kubenswrapper[5120]: I0316 16:27:12.452785 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-api-6644db8644-8f7lt"] Mar 16 16:27:12 crc kubenswrapper[5120]: I0316 16:27:12.460556 5120 scope.go:117] "RemoveContainer" containerID="507c172a147fc2718d35a597fd31cfd6ff8094f9490ea2b077d0e8181af5ffee" Mar 16 16:27:12 crc kubenswrapper[5120]: I0316 16:27:12.499860 5120 scope.go:117] "RemoveContainer" containerID="8c6f35ac2a4ae8db4c7f86f87aaa9f9d6f44d088bc2852c398dd7214cf0458c9" Mar 16 16:27:12 crc kubenswrapper[5120]: E0316 16:27:12.500301 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c6f35ac2a4ae8db4c7f86f87aaa9f9d6f44d088bc2852c398dd7214cf0458c9\": container with ID starting with 8c6f35ac2a4ae8db4c7f86f87aaa9f9d6f44d088bc2852c398dd7214cf0458c9 not found: ID does not exist" containerID="8c6f35ac2a4ae8db4c7f86f87aaa9f9d6f44d088bc2852c398dd7214cf0458c9" Mar 16 16:27:12 crc kubenswrapper[5120]: I0316 16:27:12.500329 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c6f35ac2a4ae8db4c7f86f87aaa9f9d6f44d088bc2852c398dd7214cf0458c9"} err="failed to get container status \"8c6f35ac2a4ae8db4c7f86f87aaa9f9d6f44d088bc2852c398dd7214cf0458c9\": rpc error: code = NotFound desc = could not find container \"8c6f35ac2a4ae8db4c7f86f87aaa9f9d6f44d088bc2852c398dd7214cf0458c9\": container with ID starting with 8c6f35ac2a4ae8db4c7f86f87aaa9f9d6f44d088bc2852c398dd7214cf0458c9 not found: ID does not exist" Mar 16 16:27:12 crc kubenswrapper[5120]: I0316 16:27:12.500348 5120 scope.go:117] "RemoveContainer" containerID="507c172a147fc2718d35a597fd31cfd6ff8094f9490ea2b077d0e8181af5ffee" Mar 16 16:27:12 crc kubenswrapper[5120]: E0316 16:27:12.500737 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"507c172a147fc2718d35a597fd31cfd6ff8094f9490ea2b077d0e8181af5ffee\": container with ID starting with 507c172a147fc2718d35a597fd31cfd6ff8094f9490ea2b077d0e8181af5ffee not found: ID does not exist" containerID="507c172a147fc2718d35a597fd31cfd6ff8094f9490ea2b077d0e8181af5ffee" Mar 16 16:27:12 crc kubenswrapper[5120]: I0316 16:27:12.500767 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"507c172a147fc2718d35a597fd31cfd6ff8094f9490ea2b077d0e8181af5ffee"} err="failed to get container status \"507c172a147fc2718d35a597fd31cfd6ff8094f9490ea2b077d0e8181af5ffee\": rpc error: code = NotFound desc = could not find container \"507c172a147fc2718d35a597fd31cfd6ff8094f9490ea2b077d0e8181af5ffee\": container with ID starting with 507c172a147fc2718d35a597fd31cfd6ff8094f9490ea2b077d0e8181af5ffee not found: ID does not exist" Mar 16 16:27:12 crc kubenswrapper[5120]: I0316 16:27:12.673327 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d85f5fb-0f61-4689-9493-daa49e079f98" path="/var/lib/kubelet/pods/5d85f5fb-0f61-4689-9493-daa49e079f98/volumes" Mar 16 16:27:12 crc kubenswrapper[5120]: I0316 16:27:12.673965 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f01e7eb4-b5fe-4cfc-9657-66955e94fa03" path="/var/lib/kubelet/pods/f01e7eb4-b5fe-4cfc-9657-66955e94fa03/volumes" Mar 16 16:27:12 crc kubenswrapper[5120]: I0316 16:27:12.674602 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ffa91919-32b8-43f8-9332-4d7c16575345" path="/var/lib/kubelet/pods/ffa91919-32b8-43f8-9332-4d7c16575345/volumes" Mar 16 16:27:12 crc kubenswrapper[5120]: I0316 16:27:12.896221 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-gs5vn" Mar 16 16:27:13 crc kubenswrapper[5120]: I0316 16:27:13.001324 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nrbsh\" (UniqueName: \"kubernetes.io/projected/539c0d5c-8a81-47ff-92fc-1c0c09ad57c0-kube-api-access-nrbsh\") pod \"539c0d5c-8a81-47ff-92fc-1c0c09ad57c0\" (UID: \"539c0d5c-8a81-47ff-92fc-1c0c09ad57c0\") " Mar 16 16:27:13 crc kubenswrapper[5120]: I0316 16:27:13.001736 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/539c0d5c-8a81-47ff-92fc-1c0c09ad57c0-config\") pod \"539c0d5c-8a81-47ff-92fc-1c0c09ad57c0\" (UID: \"539c0d5c-8a81-47ff-92fc-1c0c09ad57c0\") " Mar 16 16:27:13 crc kubenswrapper[5120]: I0316 16:27:13.002190 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/539c0d5c-8a81-47ff-92fc-1c0c09ad57c0-combined-ca-bundle\") pod \"539c0d5c-8a81-47ff-92fc-1c0c09ad57c0\" (UID: \"539c0d5c-8a81-47ff-92fc-1c0c09ad57c0\") " Mar 16 16:27:13 crc kubenswrapper[5120]: I0316 16:27:13.007742 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/539c0d5c-8a81-47ff-92fc-1c0c09ad57c0-kube-api-access-nrbsh" (OuterVolumeSpecName: "kube-api-access-nrbsh") pod "539c0d5c-8a81-47ff-92fc-1c0c09ad57c0" (UID: "539c0d5c-8a81-47ff-92fc-1c0c09ad57c0"). InnerVolumeSpecName "kube-api-access-nrbsh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:27:13 crc kubenswrapper[5120]: I0316 16:27:13.030092 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/539c0d5c-8a81-47ff-92fc-1c0c09ad57c0-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "539c0d5c-8a81-47ff-92fc-1c0c09ad57c0" (UID: "539c0d5c-8a81-47ff-92fc-1c0c09ad57c0"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:27:13 crc kubenswrapper[5120]: I0316 16:27:13.046896 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/539c0d5c-8a81-47ff-92fc-1c0c09ad57c0-config" (OuterVolumeSpecName: "config") pod "539c0d5c-8a81-47ff-92fc-1c0c09ad57c0" (UID: "539c0d5c-8a81-47ff-92fc-1c0c09ad57c0"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:27:13 crc kubenswrapper[5120]: I0316 16:27:13.105315 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/539c0d5c-8a81-47ff-92fc-1c0c09ad57c0-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:27:13 crc kubenswrapper[5120]: I0316 16:27:13.105357 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/539c0d5c-8a81-47ff-92fc-1c0c09ad57c0-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:27:13 crc kubenswrapper[5120]: I0316 16:27:13.105373 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nrbsh\" (UniqueName: \"kubernetes.io/projected/539c0d5c-8a81-47ff-92fc-1c0c09ad57c0-kube-api-access-nrbsh\") on node \"crc\" DevicePath \"\"" Mar 16 16:27:13 crc kubenswrapper[5120]: I0316 16:27:13.428692 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-gs5vn" event={"ID":"539c0d5c-8a81-47ff-92fc-1c0c09ad57c0","Type":"ContainerDied","Data":"9194564753df3df56d6de6d4ebf7f9f88ef2735f9411a0afca40b447bbd24bbc"} Mar 16 16:27:13 crc kubenswrapper[5120]: I0316 16:27:13.428755 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9194564753df3df56d6de6d4ebf7f9f88ef2735f9411a0afca40b447bbd24bbc" Mar 16 16:27:13 crc kubenswrapper[5120]: I0316 16:27:13.428904 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-gs5vn" Mar 16 16:27:13 crc kubenswrapper[5120]: I0316 16:27:13.684945 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-796df7d745-6tvph"] Mar 16 16:27:13 crc kubenswrapper[5120]: I0316 16:27:13.685947 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ffa91919-32b8-43f8-9332-4d7c16575345" containerName="barbican-worker" Mar 16 16:27:13 crc kubenswrapper[5120]: I0316 16:27:13.685965 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ffa91919-32b8-43f8-9332-4d7c16575345" containerName="barbican-worker" Mar 16 16:27:13 crc kubenswrapper[5120]: I0316 16:27:13.685985 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f01e7eb4-b5fe-4cfc-9657-66955e94fa03" containerName="barbican-api-log" Mar 16 16:27:13 crc kubenswrapper[5120]: I0316 16:27:13.685991 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f01e7eb4-b5fe-4cfc-9657-66955e94fa03" containerName="barbican-api-log" Mar 16 16:27:13 crc kubenswrapper[5120]: I0316 16:27:13.686001 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d85f5fb-0f61-4689-9493-daa49e079f98" containerName="barbican-keystone-listener" Mar 16 16:27:13 crc kubenswrapper[5120]: I0316 16:27:13.686007 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d85f5fb-0f61-4689-9493-daa49e079f98" containerName="barbican-keystone-listener" Mar 16 16:27:13 crc kubenswrapper[5120]: I0316 16:27:13.686027 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d85f5fb-0f61-4689-9493-daa49e079f98" containerName="barbican-keystone-listener-log" Mar 16 16:27:13 crc kubenswrapper[5120]: I0316 16:27:13.686033 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d85f5fb-0f61-4689-9493-daa49e079f98" containerName="barbican-keystone-listener-log" Mar 16 16:27:13 crc kubenswrapper[5120]: I0316 16:27:13.686048 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f01e7eb4-b5fe-4cfc-9657-66955e94fa03" containerName="barbican-api" Mar 16 16:27:13 crc kubenswrapper[5120]: I0316 16:27:13.686054 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f01e7eb4-b5fe-4cfc-9657-66955e94fa03" containerName="barbican-api" Mar 16 16:27:13 crc kubenswrapper[5120]: I0316 16:27:13.686069 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="539c0d5c-8a81-47ff-92fc-1c0c09ad57c0" containerName="neutron-db-sync" Mar 16 16:27:13 crc kubenswrapper[5120]: I0316 16:27:13.686074 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="539c0d5c-8a81-47ff-92fc-1c0c09ad57c0" containerName="neutron-db-sync" Mar 16 16:27:13 crc kubenswrapper[5120]: I0316 16:27:13.686094 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ffa91919-32b8-43f8-9332-4d7c16575345" containerName="barbican-worker-log" Mar 16 16:27:13 crc kubenswrapper[5120]: I0316 16:27:13.686099 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ffa91919-32b8-43f8-9332-4d7c16575345" containerName="barbican-worker-log" Mar 16 16:27:13 crc kubenswrapper[5120]: I0316 16:27:13.686264 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f01e7eb4-b5fe-4cfc-9657-66955e94fa03" containerName="barbican-api-log" Mar 16 16:27:13 crc kubenswrapper[5120]: I0316 16:27:13.686277 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f01e7eb4-b5fe-4cfc-9657-66955e94fa03" containerName="barbican-api" Mar 16 16:27:13 crc kubenswrapper[5120]: I0316 16:27:13.686284 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ffa91919-32b8-43f8-9332-4d7c16575345" containerName="barbican-worker" Mar 16 16:27:13 crc kubenswrapper[5120]: I0316 16:27:13.686295 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="5d85f5fb-0f61-4689-9493-daa49e079f98" containerName="barbican-keystone-listener-log" Mar 16 16:27:13 crc kubenswrapper[5120]: I0316 16:27:13.686303 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="539c0d5c-8a81-47ff-92fc-1c0c09ad57c0" containerName="neutron-db-sync" Mar 16 16:27:13 crc kubenswrapper[5120]: I0316 16:27:13.686312 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="5d85f5fb-0f61-4689-9493-daa49e079f98" containerName="barbican-keystone-listener" Mar 16 16:27:13 crc kubenswrapper[5120]: I0316 16:27:13.686321 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ffa91919-32b8-43f8-9332-4d7c16575345" containerName="barbican-worker-log" Mar 16 16:27:13 crc kubenswrapper[5120]: I0316 16:27:13.698554 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-796df7d745-6tvph" Mar 16 16:27:13 crc kubenswrapper[5120]: I0316 16:27:13.702727 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-796df7d745-6tvph"] Mar 16 16:27:13 crc kubenswrapper[5120]: I0316 16:27:13.703124 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-neutron-dockercfg-9rbcd\"" Mar 16 16:27:13 crc kubenswrapper[5120]: I0316 16:27:13.703531 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-httpd-config\"" Mar 16 16:27:13 crc kubenswrapper[5120]: I0316 16:27:13.703831 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-config\"" Mar 16 16:27:13 crc kubenswrapper[5120]: I0316 16:27:13.703970 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-neutron-ovndbs\"" Mar 16 16:27:13 crc kubenswrapper[5120]: I0316 16:27:13.824824 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a4b43784-8e78-434c-a053-23184660c355-combined-ca-bundle\") pod \"neutron-796df7d745-6tvph\" (UID: \"a4b43784-8e78-434c-a053-23184660c355\") " pod="openstack-kuttl-tests/neutron-796df7d745-6tvph" Mar 16 16:27:13 crc kubenswrapper[5120]: I0316 16:27:13.824893 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a4b43784-8e78-434c-a053-23184660c355-config\") pod \"neutron-796df7d745-6tvph\" (UID: \"a4b43784-8e78-434c-a053-23184660c355\") " pod="openstack-kuttl-tests/neutron-796df7d745-6tvph" Mar 16 16:27:13 crc kubenswrapper[5120]: I0316 16:27:13.825511 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/a4b43784-8e78-434c-a053-23184660c355-ovndb-tls-certs\") pod \"neutron-796df7d745-6tvph\" (UID: \"a4b43784-8e78-434c-a053-23184660c355\") " pod="openstack-kuttl-tests/neutron-796df7d745-6tvph" Mar 16 16:27:13 crc kubenswrapper[5120]: I0316 16:27:13.825736 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fw24\" (UniqueName: \"kubernetes.io/projected/a4b43784-8e78-434c-a053-23184660c355-kube-api-access-6fw24\") pod \"neutron-796df7d745-6tvph\" (UID: \"a4b43784-8e78-434c-a053-23184660c355\") " pod="openstack-kuttl-tests/neutron-796df7d745-6tvph" Mar 16 16:27:13 crc kubenswrapper[5120]: I0316 16:27:13.825847 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/a4b43784-8e78-434c-a053-23184660c355-httpd-config\") pod \"neutron-796df7d745-6tvph\" (UID: \"a4b43784-8e78-434c-a053-23184660c355\") " pod="openstack-kuttl-tests/neutron-796df7d745-6tvph" Mar 16 16:27:13 crc kubenswrapper[5120]: I0316 16:27:13.930654 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/a4b43784-8e78-434c-a053-23184660c355-ovndb-tls-certs\") pod \"neutron-796df7d745-6tvph\" (UID: \"a4b43784-8e78-434c-a053-23184660c355\") " pod="openstack-kuttl-tests/neutron-796df7d745-6tvph" Mar 16 16:27:13 crc kubenswrapper[5120]: I0316 16:27:13.931319 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6fw24\" (UniqueName: \"kubernetes.io/projected/a4b43784-8e78-434c-a053-23184660c355-kube-api-access-6fw24\") pod \"neutron-796df7d745-6tvph\" (UID: \"a4b43784-8e78-434c-a053-23184660c355\") " pod="openstack-kuttl-tests/neutron-796df7d745-6tvph" Mar 16 16:27:13 crc kubenswrapper[5120]: I0316 16:27:13.931424 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/a4b43784-8e78-434c-a053-23184660c355-httpd-config\") pod \"neutron-796df7d745-6tvph\" (UID: \"a4b43784-8e78-434c-a053-23184660c355\") " pod="openstack-kuttl-tests/neutron-796df7d745-6tvph" Mar 16 16:27:13 crc kubenswrapper[5120]: I0316 16:27:13.931639 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a4b43784-8e78-434c-a053-23184660c355-combined-ca-bundle\") pod \"neutron-796df7d745-6tvph\" (UID: \"a4b43784-8e78-434c-a053-23184660c355\") " pod="openstack-kuttl-tests/neutron-796df7d745-6tvph" Mar 16 16:27:13 crc kubenswrapper[5120]: I0316 16:27:13.931698 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a4b43784-8e78-434c-a053-23184660c355-config\") pod \"neutron-796df7d745-6tvph\" (UID: \"a4b43784-8e78-434c-a053-23184660c355\") " pod="openstack-kuttl-tests/neutron-796df7d745-6tvph" Mar 16 16:27:13 crc kubenswrapper[5120]: I0316 16:27:13.938935 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a4b43784-8e78-434c-a053-23184660c355-combined-ca-bundle\") pod \"neutron-796df7d745-6tvph\" (UID: \"a4b43784-8e78-434c-a053-23184660c355\") " pod="openstack-kuttl-tests/neutron-796df7d745-6tvph" Mar 16 16:27:13 crc kubenswrapper[5120]: I0316 16:27:13.950676 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/a4b43784-8e78-434c-a053-23184660c355-httpd-config\") pod \"neutron-796df7d745-6tvph\" (UID: \"a4b43784-8e78-434c-a053-23184660c355\") " pod="openstack-kuttl-tests/neutron-796df7d745-6tvph" Mar 16 16:27:13 crc kubenswrapper[5120]: I0316 16:27:13.950671 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/a4b43784-8e78-434c-a053-23184660c355-ovndb-tls-certs\") pod \"neutron-796df7d745-6tvph\" (UID: \"a4b43784-8e78-434c-a053-23184660c355\") " pod="openstack-kuttl-tests/neutron-796df7d745-6tvph" Mar 16 16:27:13 crc kubenswrapper[5120]: I0316 16:27:13.950689 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/a4b43784-8e78-434c-a053-23184660c355-config\") pod \"neutron-796df7d745-6tvph\" (UID: \"a4b43784-8e78-434c-a053-23184660c355\") " pod="openstack-kuttl-tests/neutron-796df7d745-6tvph" Mar 16 16:27:13 crc kubenswrapper[5120]: I0316 16:27:13.958692 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fw24\" (UniqueName: \"kubernetes.io/projected/a4b43784-8e78-434c-a053-23184660c355-kube-api-access-6fw24\") pod \"neutron-796df7d745-6tvph\" (UID: \"a4b43784-8e78-434c-a053-23184660c355\") " pod="openstack-kuttl-tests/neutron-796df7d745-6tvph" Mar 16 16:27:13 crc kubenswrapper[5120]: E0316 16:27:13.992853 5120 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb90e76bc_d652_4606_8c72_4b96133ce5c4.slice\": RecentStats: unable to find data in memory cache]" Mar 16 16:27:14 crc kubenswrapper[5120]: I0316 16:27:14.020598 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-796df7d745-6tvph" Mar 16 16:27:14 crc kubenswrapper[5120]: I0316 16:27:14.551214 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-796df7d745-6tvph"] Mar 16 16:27:15 crc kubenswrapper[5120]: I0316 16:27:15.486990 5120 generic.go:358] "Generic (PLEG): container finished" podID="2db2b5ba-7cda-442a-b384-b370dfd6bce9" containerID="b2f3e9268caa0986cbd59923285757142d00577f2521a52b4fdbb1ead7df292a" exitCode=0 Mar 16 16:27:15 crc kubenswrapper[5120]: I0316 16:27:15.487026 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"2db2b5ba-7cda-442a-b384-b370dfd6bce9","Type":"ContainerDied","Data":"b2f3e9268caa0986cbd59923285757142d00577f2521a52b4fdbb1ead7df292a"} Mar 16 16:27:15 crc kubenswrapper[5120]: I0316 16:27:15.494870 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-796df7d745-6tvph" event={"ID":"a4b43784-8e78-434c-a053-23184660c355","Type":"ContainerStarted","Data":"23c7dd0e30293a8c34381be9a7c9e6a51d0b082b8ec0ec6fd0c4d48e23ca97af"} Mar 16 16:27:15 crc kubenswrapper[5120]: I0316 16:27:15.494909 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-796df7d745-6tvph" event={"ID":"a4b43784-8e78-434c-a053-23184660c355","Type":"ContainerStarted","Data":"8f91d16f6cc5bc2fcc55b3ca74be0509c763faa9d96bbaa629522702245cf31a"} Mar 16 16:27:15 crc kubenswrapper[5120]: I0316 16:27:15.494919 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-796df7d745-6tvph" event={"ID":"a4b43784-8e78-434c-a053-23184660c355","Type":"ContainerStarted","Data":"a9aa7c31885a95f78152ffe1db8f623de57b09bc5c2c94bbea2ed2c391907ad9"} Mar 16 16:27:15 crc kubenswrapper[5120]: I0316 16:27:15.495878 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/neutron-796df7d745-6tvph" Mar 16 16:27:15 crc kubenswrapper[5120]: I0316 16:27:15.522719 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-796df7d745-6tvph" podStartSLOduration=2.522691433 podStartE2EDuration="2.522691433s" podCreationTimestamp="2026-03-16 16:27:13 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:27:15.51809786 +0000 UTC m=+3337.672029517" watchObservedRunningTime="2026-03-16 16:27:15.522691433 +0000 UTC m=+3337.676623090" Mar 16 16:27:15 crc kubenswrapper[5120]: I0316 16:27:15.818965 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:27:15 crc kubenswrapper[5120]: I0316 16:27:15.919278 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2db2b5ba-7cda-442a-b384-b370dfd6bce9-combined-ca-bundle\") pod \"2db2b5ba-7cda-442a-b384-b370dfd6bce9\" (UID: \"2db2b5ba-7cda-442a-b384-b370dfd6bce9\") " Mar 16 16:27:15 crc kubenswrapper[5120]: I0316 16:27:15.919415 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2db2b5ba-7cda-442a-b384-b370dfd6bce9-scripts\") pod \"2db2b5ba-7cda-442a-b384-b370dfd6bce9\" (UID: \"2db2b5ba-7cda-442a-b384-b370dfd6bce9\") " Mar 16 16:27:15 crc kubenswrapper[5120]: I0316 16:27:15.919727 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r82bh\" (UniqueName: \"kubernetes.io/projected/2db2b5ba-7cda-442a-b384-b370dfd6bce9-kube-api-access-r82bh\") pod \"2db2b5ba-7cda-442a-b384-b370dfd6bce9\" (UID: \"2db2b5ba-7cda-442a-b384-b370dfd6bce9\") " Mar 16 16:27:15 crc kubenswrapper[5120]: I0316 16:27:15.919791 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/2db2b5ba-7cda-442a-b384-b370dfd6bce9-config-data-custom\") pod \"2db2b5ba-7cda-442a-b384-b370dfd6bce9\" (UID: \"2db2b5ba-7cda-442a-b384-b370dfd6bce9\") " Mar 16 16:27:15 crc kubenswrapper[5120]: I0316 16:27:15.919874 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2db2b5ba-7cda-442a-b384-b370dfd6bce9-config-data\") pod \"2db2b5ba-7cda-442a-b384-b370dfd6bce9\" (UID: \"2db2b5ba-7cda-442a-b384-b370dfd6bce9\") " Mar 16 16:27:15 crc kubenswrapper[5120]: I0316 16:27:15.920345 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/2db2b5ba-7cda-442a-b384-b370dfd6bce9-etc-machine-id\") pod \"2db2b5ba-7cda-442a-b384-b370dfd6bce9\" (UID: \"2db2b5ba-7cda-442a-b384-b370dfd6bce9\") " Mar 16 16:27:15 crc kubenswrapper[5120]: I0316 16:27:15.920534 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/2db2b5ba-7cda-442a-b384-b370dfd6bce9-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "2db2b5ba-7cda-442a-b384-b370dfd6bce9" (UID: "2db2b5ba-7cda-442a-b384-b370dfd6bce9"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 16:27:15 crc kubenswrapper[5120]: I0316 16:27:15.921166 5120 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/2db2b5ba-7cda-442a-b384-b370dfd6bce9-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 16:27:15 crc kubenswrapper[5120]: I0316 16:27:15.927613 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2db2b5ba-7cda-442a-b384-b370dfd6bce9-kube-api-access-r82bh" (OuterVolumeSpecName: "kube-api-access-r82bh") pod "2db2b5ba-7cda-442a-b384-b370dfd6bce9" (UID: "2db2b5ba-7cda-442a-b384-b370dfd6bce9"). InnerVolumeSpecName "kube-api-access-r82bh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:27:15 crc kubenswrapper[5120]: I0316 16:27:15.929938 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2db2b5ba-7cda-442a-b384-b370dfd6bce9-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "2db2b5ba-7cda-442a-b384-b370dfd6bce9" (UID: "2db2b5ba-7cda-442a-b384-b370dfd6bce9"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:27:15 crc kubenswrapper[5120]: I0316 16:27:15.931894 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2db2b5ba-7cda-442a-b384-b370dfd6bce9-scripts" (OuterVolumeSpecName: "scripts") pod "2db2b5ba-7cda-442a-b384-b370dfd6bce9" (UID: "2db2b5ba-7cda-442a-b384-b370dfd6bce9"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:27:15 crc kubenswrapper[5120]: I0316 16:27:15.982427 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2db2b5ba-7cda-442a-b384-b370dfd6bce9-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "2db2b5ba-7cda-442a-b384-b370dfd6bce9" (UID: "2db2b5ba-7cda-442a-b384-b370dfd6bce9"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:27:16 crc kubenswrapper[5120]: I0316 16:27:16.022878 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r82bh\" (UniqueName: \"kubernetes.io/projected/2db2b5ba-7cda-442a-b384-b370dfd6bce9-kube-api-access-r82bh\") on node \"crc\" DevicePath \"\"" Mar 16 16:27:16 crc kubenswrapper[5120]: I0316 16:27:16.022917 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/2db2b5ba-7cda-442a-b384-b370dfd6bce9-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:27:16 crc kubenswrapper[5120]: I0316 16:27:16.022929 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2db2b5ba-7cda-442a-b384-b370dfd6bce9-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:27:16 crc kubenswrapper[5120]: I0316 16:27:16.022939 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2db2b5ba-7cda-442a-b384-b370dfd6bce9-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:27:16 crc kubenswrapper[5120]: I0316 16:27:16.083595 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2db2b5ba-7cda-442a-b384-b370dfd6bce9-config-data" (OuterVolumeSpecName: "config-data") pod "2db2b5ba-7cda-442a-b384-b370dfd6bce9" (UID: "2db2b5ba-7cda-442a-b384-b370dfd6bce9"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:27:16 crc kubenswrapper[5120]: I0316 16:27:16.124356 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2db2b5ba-7cda-442a-b384-b370dfd6bce9-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:27:16 crc kubenswrapper[5120]: I0316 16:27:16.305394 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-59d4fdd9db-tttbf"] Mar 16 16:27:16 crc kubenswrapper[5120]: I0316 16:27:16.306831 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2db2b5ba-7cda-442a-b384-b370dfd6bce9" containerName="probe" Mar 16 16:27:16 crc kubenswrapper[5120]: I0316 16:27:16.306850 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="2db2b5ba-7cda-442a-b384-b370dfd6bce9" containerName="probe" Mar 16 16:27:16 crc kubenswrapper[5120]: I0316 16:27:16.306887 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2db2b5ba-7cda-442a-b384-b370dfd6bce9" containerName="cinder-scheduler" Mar 16 16:27:16 crc kubenswrapper[5120]: I0316 16:27:16.306894 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="2db2b5ba-7cda-442a-b384-b370dfd6bce9" containerName="cinder-scheduler" Mar 16 16:27:16 crc kubenswrapper[5120]: I0316 16:27:16.307066 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="2db2b5ba-7cda-442a-b384-b370dfd6bce9" containerName="probe" Mar 16 16:27:16 crc kubenswrapper[5120]: I0316 16:27:16.307088 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="2db2b5ba-7cda-442a-b384-b370dfd6bce9" containerName="cinder-scheduler" Mar 16 16:27:16 crc kubenswrapper[5120]: I0316 16:27:16.331077 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-59d4fdd9db-tttbf" Mar 16 16:27:16 crc kubenswrapper[5120]: I0316 16:27:16.333642 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-59d4fdd9db-tttbf"] Mar 16 16:27:16 crc kubenswrapper[5120]: I0316 16:27:16.333829 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/325f32e1-5461-4d71-a30c-dee2528d6fb3-public-tls-certs\") pod \"neutron-59d4fdd9db-tttbf\" (UID: \"325f32e1-5461-4d71-a30c-dee2528d6fb3\") " pod="openstack-kuttl-tests/neutron-59d4fdd9db-tttbf" Mar 16 16:27:16 crc kubenswrapper[5120]: I0316 16:27:16.333890 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/325f32e1-5461-4d71-a30c-dee2528d6fb3-ovndb-tls-certs\") pod \"neutron-59d4fdd9db-tttbf\" (UID: \"325f32e1-5461-4d71-a30c-dee2528d6fb3\") " pod="openstack-kuttl-tests/neutron-59d4fdd9db-tttbf" Mar 16 16:27:16 crc kubenswrapper[5120]: I0316 16:27:16.333929 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/325f32e1-5461-4d71-a30c-dee2528d6fb3-httpd-config\") pod \"neutron-59d4fdd9db-tttbf\" (UID: \"325f32e1-5461-4d71-a30c-dee2528d6fb3\") " pod="openstack-kuttl-tests/neutron-59d4fdd9db-tttbf" Mar 16 16:27:16 crc kubenswrapper[5120]: I0316 16:27:16.334071 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/325f32e1-5461-4d71-a30c-dee2528d6fb3-internal-tls-certs\") pod \"neutron-59d4fdd9db-tttbf\" (UID: \"325f32e1-5461-4d71-a30c-dee2528d6fb3\") " pod="openstack-kuttl-tests/neutron-59d4fdd9db-tttbf" Mar 16 16:27:16 crc kubenswrapper[5120]: I0316 16:27:16.334706 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/325f32e1-5461-4d71-a30c-dee2528d6fb3-combined-ca-bundle\") pod \"neutron-59d4fdd9db-tttbf\" (UID: \"325f32e1-5461-4d71-a30c-dee2528d6fb3\") " pod="openstack-kuttl-tests/neutron-59d4fdd9db-tttbf" Mar 16 16:27:16 crc kubenswrapper[5120]: I0316 16:27:16.334833 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/325f32e1-5461-4d71-a30c-dee2528d6fb3-config\") pod \"neutron-59d4fdd9db-tttbf\" (UID: \"325f32e1-5461-4d71-a30c-dee2528d6fb3\") " pod="openstack-kuttl-tests/neutron-59d4fdd9db-tttbf" Mar 16 16:27:16 crc kubenswrapper[5120]: I0316 16:27:16.337795 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggztv\" (UniqueName: \"kubernetes.io/projected/325f32e1-5461-4d71-a30c-dee2528d6fb3-kube-api-access-ggztv\") pod \"neutron-59d4fdd9db-tttbf\" (UID: \"325f32e1-5461-4d71-a30c-dee2528d6fb3\") " pod="openstack-kuttl-tests/neutron-59d4fdd9db-tttbf" Mar 16 16:27:16 crc kubenswrapper[5120]: I0316 16:27:16.339357 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-neutron-internal-svc\"" Mar 16 16:27:16 crc kubenswrapper[5120]: I0316 16:27:16.339645 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-neutron-public-svc\"" Mar 16 16:27:16 crc kubenswrapper[5120]: I0316 16:27:16.441174 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/325f32e1-5461-4d71-a30c-dee2528d6fb3-combined-ca-bundle\") pod \"neutron-59d4fdd9db-tttbf\" (UID: \"325f32e1-5461-4d71-a30c-dee2528d6fb3\") " pod="openstack-kuttl-tests/neutron-59d4fdd9db-tttbf" Mar 16 16:27:16 crc kubenswrapper[5120]: I0316 16:27:16.441289 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/325f32e1-5461-4d71-a30c-dee2528d6fb3-config\") pod \"neutron-59d4fdd9db-tttbf\" (UID: \"325f32e1-5461-4d71-a30c-dee2528d6fb3\") " pod="openstack-kuttl-tests/neutron-59d4fdd9db-tttbf" Mar 16 16:27:16 crc kubenswrapper[5120]: I0316 16:27:16.441349 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ggztv\" (UniqueName: \"kubernetes.io/projected/325f32e1-5461-4d71-a30c-dee2528d6fb3-kube-api-access-ggztv\") pod \"neutron-59d4fdd9db-tttbf\" (UID: \"325f32e1-5461-4d71-a30c-dee2528d6fb3\") " pod="openstack-kuttl-tests/neutron-59d4fdd9db-tttbf" Mar 16 16:27:16 crc kubenswrapper[5120]: I0316 16:27:16.441422 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/325f32e1-5461-4d71-a30c-dee2528d6fb3-public-tls-certs\") pod \"neutron-59d4fdd9db-tttbf\" (UID: \"325f32e1-5461-4d71-a30c-dee2528d6fb3\") " pod="openstack-kuttl-tests/neutron-59d4fdd9db-tttbf" Mar 16 16:27:16 crc kubenswrapper[5120]: I0316 16:27:16.441625 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/325f32e1-5461-4d71-a30c-dee2528d6fb3-ovndb-tls-certs\") pod \"neutron-59d4fdd9db-tttbf\" (UID: \"325f32e1-5461-4d71-a30c-dee2528d6fb3\") " pod="openstack-kuttl-tests/neutron-59d4fdd9db-tttbf" Mar 16 16:27:16 crc kubenswrapper[5120]: I0316 16:27:16.441653 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/325f32e1-5461-4d71-a30c-dee2528d6fb3-httpd-config\") pod \"neutron-59d4fdd9db-tttbf\" (UID: \"325f32e1-5461-4d71-a30c-dee2528d6fb3\") " pod="openstack-kuttl-tests/neutron-59d4fdd9db-tttbf" Mar 16 16:27:16 crc kubenswrapper[5120]: I0316 16:27:16.442794 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/325f32e1-5461-4d71-a30c-dee2528d6fb3-internal-tls-certs\") pod \"neutron-59d4fdd9db-tttbf\" (UID: \"325f32e1-5461-4d71-a30c-dee2528d6fb3\") " pod="openstack-kuttl-tests/neutron-59d4fdd9db-tttbf" Mar 16 16:27:16 crc kubenswrapper[5120]: I0316 16:27:16.449008 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/325f32e1-5461-4d71-a30c-dee2528d6fb3-public-tls-certs\") pod \"neutron-59d4fdd9db-tttbf\" (UID: \"325f32e1-5461-4d71-a30c-dee2528d6fb3\") " pod="openstack-kuttl-tests/neutron-59d4fdd9db-tttbf" Mar 16 16:27:16 crc kubenswrapper[5120]: I0316 16:27:16.449508 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/325f32e1-5461-4d71-a30c-dee2528d6fb3-internal-tls-certs\") pod \"neutron-59d4fdd9db-tttbf\" (UID: \"325f32e1-5461-4d71-a30c-dee2528d6fb3\") " pod="openstack-kuttl-tests/neutron-59d4fdd9db-tttbf" Mar 16 16:27:16 crc kubenswrapper[5120]: I0316 16:27:16.449544 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/325f32e1-5461-4d71-a30c-dee2528d6fb3-combined-ca-bundle\") pod \"neutron-59d4fdd9db-tttbf\" (UID: \"325f32e1-5461-4d71-a30c-dee2528d6fb3\") " pod="openstack-kuttl-tests/neutron-59d4fdd9db-tttbf" Mar 16 16:27:16 crc kubenswrapper[5120]: I0316 16:27:16.459659 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/325f32e1-5461-4d71-a30c-dee2528d6fb3-config\") pod \"neutron-59d4fdd9db-tttbf\" (UID: \"325f32e1-5461-4d71-a30c-dee2528d6fb3\") " pod="openstack-kuttl-tests/neutron-59d4fdd9db-tttbf" Mar 16 16:27:16 crc kubenswrapper[5120]: I0316 16:27:16.463983 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/325f32e1-5461-4d71-a30c-dee2528d6fb3-ovndb-tls-certs\") pod \"neutron-59d4fdd9db-tttbf\" (UID: \"325f32e1-5461-4d71-a30c-dee2528d6fb3\") " pod="openstack-kuttl-tests/neutron-59d4fdd9db-tttbf" Mar 16 16:27:16 crc kubenswrapper[5120]: I0316 16:27:16.464441 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/325f32e1-5461-4d71-a30c-dee2528d6fb3-httpd-config\") pod \"neutron-59d4fdd9db-tttbf\" (UID: \"325f32e1-5461-4d71-a30c-dee2528d6fb3\") " pod="openstack-kuttl-tests/neutron-59d4fdd9db-tttbf" Mar 16 16:27:16 crc kubenswrapper[5120]: I0316 16:27:16.484101 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggztv\" (UniqueName: \"kubernetes.io/projected/325f32e1-5461-4d71-a30c-dee2528d6fb3-kube-api-access-ggztv\") pod \"neutron-59d4fdd9db-tttbf\" (UID: \"325f32e1-5461-4d71-a30c-dee2528d6fb3\") " pod="openstack-kuttl-tests/neutron-59d4fdd9db-tttbf" Mar 16 16:27:16 crc kubenswrapper[5120]: I0316 16:27:16.514441 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"2db2b5ba-7cda-442a-b384-b370dfd6bce9","Type":"ContainerDied","Data":"faa2c2cb4c558622bf3dc358da854ffe8d8a576697aac6569228726775f72f3c"} Mar 16 16:27:16 crc kubenswrapper[5120]: I0316 16:27:16.514478 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:27:16 crc kubenswrapper[5120]: I0316 16:27:16.514522 5120 scope.go:117] "RemoveContainer" containerID="a4b6b7975ae4423f96f92300f7d1597d4348b6d6c052013f381e9ba9da669595" Mar 16 16:27:16 crc kubenswrapper[5120]: I0316 16:27:16.577884 5120 scope.go:117] "RemoveContainer" containerID="b2f3e9268caa0986cbd59923285757142d00577f2521a52b4fdbb1ead7df292a" Mar 16 16:27:16 crc kubenswrapper[5120]: I0316 16:27:16.585622 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:27:16 crc kubenswrapper[5120]: I0316 16:27:16.597425 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:27:16 crc kubenswrapper[5120]: I0316 16:27:16.613683 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:27:16 crc kubenswrapper[5120]: I0316 16:27:16.623977 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:27:16 crc kubenswrapper[5120]: I0316 16:27:16.629009 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:27:16 crc kubenswrapper[5120]: I0316 16:27:16.636887 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-scheduler-config-data\"" Mar 16 16:27:16 crc kubenswrapper[5120]: I0316 16:27:16.651159 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/594e9c2b-c42a-4671-9b95-3ca9cc0834da-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"594e9c2b-c42a-4671-9b95-3ca9cc0834da\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:27:16 crc kubenswrapper[5120]: I0316 16:27:16.651405 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/594e9c2b-c42a-4671-9b95-3ca9cc0834da-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"594e9c2b-c42a-4671-9b95-3ca9cc0834da\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:27:16 crc kubenswrapper[5120]: I0316 16:27:16.651476 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/594e9c2b-c42a-4671-9b95-3ca9cc0834da-scripts\") pod \"cinder-scheduler-0\" (UID: \"594e9c2b-c42a-4671-9b95-3ca9cc0834da\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:27:16 crc kubenswrapper[5120]: I0316 16:27:16.651836 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rvks\" (UniqueName: \"kubernetes.io/projected/594e9c2b-c42a-4671-9b95-3ca9cc0834da-kube-api-access-7rvks\") pod \"cinder-scheduler-0\" (UID: \"594e9c2b-c42a-4671-9b95-3ca9cc0834da\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:27:16 crc kubenswrapper[5120]: I0316 16:27:16.651901 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/594e9c2b-c42a-4671-9b95-3ca9cc0834da-config-data\") pod \"cinder-scheduler-0\" (UID: \"594e9c2b-c42a-4671-9b95-3ca9cc0834da\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:27:16 crc kubenswrapper[5120]: I0316 16:27:16.651926 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/594e9c2b-c42a-4671-9b95-3ca9cc0834da-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"594e9c2b-c42a-4671-9b95-3ca9cc0834da\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:27:16 crc kubenswrapper[5120]: I0316 16:27:16.674921 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2db2b5ba-7cda-442a-b384-b370dfd6bce9" path="/var/lib/kubelet/pods/2db2b5ba-7cda-442a-b384-b370dfd6bce9/volumes" Mar 16 16:27:16 crc kubenswrapper[5120]: I0316 16:27:16.675734 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-76cb6cf57b-j7csd" Mar 16 16:27:16 crc kubenswrapper[5120]: I0316 16:27:16.680991 5120 scope.go:117] "RemoveContainer" containerID="101e7bf7aead3babee5e3fc458c097c94e1a0ac7926cd598c2f9ff7a49cc767f" Mar 16 16:27:16 crc kubenswrapper[5120]: I0316 16:27:16.681489 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-59d4fdd9db-tttbf" Mar 16 16:27:16 crc kubenswrapper[5120]: I0316 16:27:16.721078 5120 scope.go:117] "RemoveContainer" containerID="d63fb9b48fd6b1db0dec801b87cbcaa22743a49a59e9f7e340af855fa43fafc8" Mar 16 16:27:16 crc kubenswrapper[5120]: I0316 16:27:16.754853 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7rvks\" (UniqueName: \"kubernetes.io/projected/594e9c2b-c42a-4671-9b95-3ca9cc0834da-kube-api-access-7rvks\") pod \"cinder-scheduler-0\" (UID: \"594e9c2b-c42a-4671-9b95-3ca9cc0834da\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:27:16 crc kubenswrapper[5120]: I0316 16:27:16.754988 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/594e9c2b-c42a-4671-9b95-3ca9cc0834da-config-data\") pod \"cinder-scheduler-0\" (UID: \"594e9c2b-c42a-4671-9b95-3ca9cc0834da\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:27:16 crc kubenswrapper[5120]: I0316 16:27:16.755025 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/594e9c2b-c42a-4671-9b95-3ca9cc0834da-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"594e9c2b-c42a-4671-9b95-3ca9cc0834da\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:27:16 crc kubenswrapper[5120]: I0316 16:27:16.755673 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/594e9c2b-c42a-4671-9b95-3ca9cc0834da-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"594e9c2b-c42a-4671-9b95-3ca9cc0834da\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:27:16 crc kubenswrapper[5120]: I0316 16:27:16.755720 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/594e9c2b-c42a-4671-9b95-3ca9cc0834da-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"594e9c2b-c42a-4671-9b95-3ca9cc0834da\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:27:16 crc kubenswrapper[5120]: I0316 16:27:16.755745 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/594e9c2b-c42a-4671-9b95-3ca9cc0834da-scripts\") pod \"cinder-scheduler-0\" (UID: \"594e9c2b-c42a-4671-9b95-3ca9cc0834da\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:27:16 crc kubenswrapper[5120]: I0316 16:27:16.757998 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/594e9c2b-c42a-4671-9b95-3ca9cc0834da-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"594e9c2b-c42a-4671-9b95-3ca9cc0834da\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:27:16 crc kubenswrapper[5120]: I0316 16:27:16.762022 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/594e9c2b-c42a-4671-9b95-3ca9cc0834da-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"594e9c2b-c42a-4671-9b95-3ca9cc0834da\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:27:16 crc kubenswrapper[5120]: I0316 16:27:16.762104 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/594e9c2b-c42a-4671-9b95-3ca9cc0834da-scripts\") pod \"cinder-scheduler-0\" (UID: \"594e9c2b-c42a-4671-9b95-3ca9cc0834da\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:27:16 crc kubenswrapper[5120]: I0316 16:27:16.762687 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/594e9c2b-c42a-4671-9b95-3ca9cc0834da-config-data\") pod \"cinder-scheduler-0\" (UID: \"594e9c2b-c42a-4671-9b95-3ca9cc0834da\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:27:16 crc kubenswrapper[5120]: I0316 16:27:16.766925 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-76cb6cf57b-j7csd" Mar 16 16:27:16 crc kubenswrapper[5120]: I0316 16:27:16.777309 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/594e9c2b-c42a-4671-9b95-3ca9cc0834da-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"594e9c2b-c42a-4671-9b95-3ca9cc0834da\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:27:16 crc kubenswrapper[5120]: I0316 16:27:16.780483 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rvks\" (UniqueName: \"kubernetes.io/projected/594e9c2b-c42a-4671-9b95-3ca9cc0834da-kube-api-access-7rvks\") pod \"cinder-scheduler-0\" (UID: \"594e9c2b-c42a-4671-9b95-3ca9cc0834da\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:27:16 crc kubenswrapper[5120]: I0316 16:27:16.842477 5120 scope.go:117] "RemoveContainer" containerID="ee2dbd92d8c632c7f11ac63c279c2d0955265a5153094b60dbfed327c9046a88" Mar 16 16:27:16 crc kubenswrapper[5120]: I0316 16:27:16.859353 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-6cbd8fc548-p4pgf"] Mar 16 16:27:16 crc kubenswrapper[5120]: I0316 16:27:16.863027 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-6cbd8fc548-p4pgf" podUID="cd9ea9cd-8e42-4c8a-bb6e-f2ea651f47d6" containerName="barbican-api-log" containerID="cri-o://51f9523062c88689496ef71fbfff0ce96830c8ad5ae75f4c74b29864a40c4c66" gracePeriod=30 Mar 16 16:27:16 crc kubenswrapper[5120]: I0316 16:27:16.863517 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-6cbd8fc548-p4pgf" podUID="cd9ea9cd-8e42-4c8a-bb6e-f2ea651f47d6" containerName="barbican-api" containerID="cri-o://bc2f0f9bde0f32d49d1df4f716f7d818727db184ca8e18433ffc6aab79dbf31d" gracePeriod=30 Mar 16 16:27:16 crc kubenswrapper[5120]: I0316 16:27:16.909127 5120 scope.go:117] "RemoveContainer" containerID="b3f67bac83ec3397d083d4295b6aae920370a632da07ca7a35f4d30b94b1d332" Mar 16 16:27:16 crc kubenswrapper[5120]: I0316 16:27:16.958649 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:27:17 crc kubenswrapper[5120]: I0316 16:27:17.027186 5120 scope.go:117] "RemoveContainer" containerID="349445cbd3dfee7c8b81b92374996f75bc712e1ba0143a36c567c6c5f97c3a1f" Mar 16 16:27:17 crc kubenswrapper[5120]: I0316 16:27:17.092003 5120 scope.go:117] "RemoveContainer" containerID="f0696664c4dc5eed3d986c6feafe1efa35ec333d6dadec50457d294d5d7390ce" Mar 16 16:27:17 crc kubenswrapper[5120]: I0316 16:27:17.163452 5120 scope.go:117] "RemoveContainer" containerID="5c0364e41c63bf0d8ed7a64ae86436707c5e76e490baa4f0457965e28504705c" Mar 16 16:27:17 crc kubenswrapper[5120]: I0316 16:27:17.221832 5120 scope.go:117] "RemoveContainer" containerID="73a77c25908f3c5b0c6feb0c617fcb3f143e685cb50cb5854d59879998d1894d" Mar 16 16:27:17 crc kubenswrapper[5120]: I0316 16:27:17.273394 5120 scope.go:117] "RemoveContainer" containerID="be8b393dfcd7777cccd2fa4b13cfab1c7e081ec46f8ab42dbc4a6ce81b6cc6c9" Mar 16 16:27:17 crc kubenswrapper[5120]: I0316 16:27:17.288123 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-59d4fdd9db-tttbf"] Mar 16 16:27:17 crc kubenswrapper[5120]: I0316 16:27:17.365555 5120 scope.go:117] "RemoveContainer" containerID="deabbef007390ab9aa3e373eade0eb0373e61a45e8ad9c027e1d1a3c0bc7821a" Mar 16 16:27:17 crc kubenswrapper[5120]: I0316 16:27:17.418615 5120 scope.go:117] "RemoveContainer" containerID="5a7249f78b90d7cc4b86766255da1ae161449cc81a4de8c3ba3676aedd314db4" Mar 16 16:27:17 crc kubenswrapper[5120]: I0316 16:27:17.467202 5120 scope.go:117] "RemoveContainer" containerID="85dff6b00aec22ec6ca84fdaff453933b939693c5667ecec87c406987d669331" Mar 16 16:27:17 crc kubenswrapper[5120]: I0316 16:27:17.498438 5120 scope.go:117] "RemoveContainer" containerID="e337b753227a44f99187b6b2ea0dee2cb3bbf9714106544ca9af9264a314b250" Mar 16 16:27:17 crc kubenswrapper[5120]: I0316 16:27:17.533324 5120 scope.go:117] "RemoveContainer" containerID="a0563243f791daf4df3d95b328fc12ff620a6cbda02c76fafaea3cd34b4b0a44" Mar 16 16:27:17 crc kubenswrapper[5120]: I0316 16:27:17.543790 5120 generic.go:358] "Generic (PLEG): container finished" podID="cd9ea9cd-8e42-4c8a-bb6e-f2ea651f47d6" containerID="51f9523062c88689496ef71fbfff0ce96830c8ad5ae75f4c74b29864a40c4c66" exitCode=143 Mar 16 16:27:17 crc kubenswrapper[5120]: I0316 16:27:17.543873 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-6cbd8fc548-p4pgf" event={"ID":"cd9ea9cd-8e42-4c8a-bb6e-f2ea651f47d6","Type":"ContainerDied","Data":"51f9523062c88689496ef71fbfff0ce96830c8ad5ae75f4c74b29864a40c4c66"} Mar 16 16:27:17 crc kubenswrapper[5120]: I0316 16:27:17.563477 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-59d4fdd9db-tttbf" event={"ID":"325f32e1-5461-4d71-a30c-dee2528d6fb3","Type":"ContainerStarted","Data":"257c1718fc36bb384d861841f80dd29610b3a67f6fbd03ac835f047fb5332d48"} Mar 16 16:27:17 crc kubenswrapper[5120]: I0316 16:27:17.601984 5120 scope.go:117] "RemoveContainer" containerID="a70070a0cdf8b938ca28a83896d0eaadeb26a79b3f907ff7a81de44229468628" Mar 16 16:27:17 crc kubenswrapper[5120]: I0316 16:27:17.613048 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:27:17 crc kubenswrapper[5120]: W0316 16:27:17.616160 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod594e9c2b_c42a_4671_9b95_3ca9cc0834da.slice/crio-fd1dab9680cf21172ddc34e17ffea635e18b211cec1a0ae08f038c586ca843c5 WatchSource:0}: Error finding container fd1dab9680cf21172ddc34e17ffea635e18b211cec1a0ae08f038c586ca843c5: Status 404 returned error can't find the container with id fd1dab9680cf21172ddc34e17ffea635e18b211cec1a0ae08f038c586ca843c5 Mar 16 16:27:17 crc kubenswrapper[5120]: I0316 16:27:17.629824 5120 scope.go:117] "RemoveContainer" containerID="f33534b2314eb2fa1de0e0e1418fe05eb2edd62ee516b96d73bbc31c44a5430a" Mar 16 16:27:17 crc kubenswrapper[5120]: I0316 16:27:17.660950 5120 scope.go:117] "RemoveContainer" containerID="c7415f2459acf4be6875a4aaa9a2d82e85a86bd82b444391788352b9e172cd06" Mar 16 16:27:17 crc kubenswrapper[5120]: I0316 16:27:17.686955 5120 scope.go:117] "RemoveContainer" containerID="a5c83d8e90667f73122dcc3a225e1d4b07bb1b3172749937c72924c96311a483" Mar 16 16:27:17 crc kubenswrapper[5120]: I0316 16:27:17.768231 5120 scope.go:117] "RemoveContainer" containerID="feb3be09389db6bd790a30edc6a7f93fb5b8ca057afada47deb12fbf7a3eb22e" Mar 16 16:27:17 crc kubenswrapper[5120]: I0316 16:27:17.900886 5120 scope.go:117] "RemoveContainer" containerID="a9d5fa9921a3eb3e26ff72411dfd9d087b678c51ac514abab8dca1272664f813" Mar 16 16:27:17 crc kubenswrapper[5120]: I0316 16:27:17.944602 5120 scope.go:117] "RemoveContainer" containerID="de1a865384702a742cc4d20ef443ea06dad8d943f54ed62db47f01638c1f4aa5" Mar 16 16:27:17 crc kubenswrapper[5120]: I0316 16:27:17.979166 5120 scope.go:117] "RemoveContainer" containerID="8a6ee3ca882a9586a3d9f41084e7384ef2ab1123a935e1e45a3d2c45a7e2b9fd" Mar 16 16:27:18 crc kubenswrapper[5120]: I0316 16:27:18.031546 5120 scope.go:117] "RemoveContainer" containerID="be811c09ef39e9727c4c3efe23b19799fc17a15a1331470553b4fe9b5bd24323" Mar 16 16:27:18 crc kubenswrapper[5120]: I0316 16:27:18.159173 5120 scope.go:117] "RemoveContainer" containerID="8983190d13953a9f0e86dac603b2cf09d61cf95c6239355ff01d5977e8249984" Mar 16 16:27:18 crc kubenswrapper[5120]: I0316 16:27:18.238874 5120 scope.go:117] "RemoveContainer" containerID="c4cc64c99784d9578e1d73662999f12daacb9b8031f42c96f56295c15bcd7fb1" Mar 16 16:27:18 crc kubenswrapper[5120]: I0316 16:27:18.296735 5120 scope.go:117] "RemoveContainer" containerID="1ddcfd5d034aa6deaf40884273678979b2fe808078bc9c218243bb3aac2ec261" Mar 16 16:27:18 crc kubenswrapper[5120]: I0316 16:27:18.622921 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"594e9c2b-c42a-4671-9b95-3ca9cc0834da","Type":"ContainerStarted","Data":"55d8301ab1f2252931343ebe194e56bf0d2e6005a7f49de190ee54a4c190f30b"} Mar 16 16:27:18 crc kubenswrapper[5120]: I0316 16:27:18.623319 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"594e9c2b-c42a-4671-9b95-3ca9cc0834da","Type":"ContainerStarted","Data":"fd1dab9680cf21172ddc34e17ffea635e18b211cec1a0ae08f038c586ca843c5"} Mar 16 16:27:18 crc kubenswrapper[5120]: I0316 16:27:18.631133 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-59d4fdd9db-tttbf" event={"ID":"325f32e1-5461-4d71-a30c-dee2528d6fb3","Type":"ContainerStarted","Data":"1595763c4adbd5710d1143db484ee9b4d612579aceba19faf0f4e5d27d44445d"} Mar 16 16:27:18 crc kubenswrapper[5120]: I0316 16:27:18.631171 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-59d4fdd9db-tttbf" event={"ID":"325f32e1-5461-4d71-a30c-dee2528d6fb3","Type":"ContainerStarted","Data":"db3e2580ea95177e9d6490933f7a1f793687c66e415fc971c115bd499c92ab81"} Mar 16 16:27:18 crc kubenswrapper[5120]: I0316 16:27:18.631946 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/neutron-59d4fdd9db-tttbf" Mar 16 16:27:18 crc kubenswrapper[5120]: I0316 16:27:18.674174 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-59d4fdd9db-tttbf" podStartSLOduration=2.674155056 podStartE2EDuration="2.674155056s" podCreationTimestamp="2026-03-16 16:27:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:27:18.656676398 +0000 UTC m=+3340.810608055" watchObservedRunningTime="2026-03-16 16:27:18.674155056 +0000 UTC m=+3340.828086713" Mar 16 16:27:18 crc kubenswrapper[5120]: I0316 16:27:18.792979 5120 pod_container_manager_linux.go:217] "Failed to delete cgroup paths" cgroupName=["kubepods","besteffort","pod8f19bb00-3a90-4acf-8ffb-3b7cc1070d77"] err="unable to destroy cgroup paths for cgroup [kubepods besteffort pod8f19bb00-3a90-4acf-8ffb-3b7cc1070d77] : Timed out while waiting for systemd to remove kubepods-besteffort-pod8f19bb00_3a90_4acf_8ffb_3b7cc1070d77.slice" Mar 16 16:27:18 crc kubenswrapper[5120]: E0316 16:27:18.793031 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to delete cgroup paths for [kubepods besteffort pod8f19bb00-3a90-4acf-8ffb-3b7cc1070d77] : unable to destroy cgroup paths for cgroup [kubepods besteffort pod8f19bb00-3a90-4acf-8ffb-3b7cc1070d77] : Timed out while waiting for systemd to remove kubepods-besteffort-pod8f19bb00_3a90_4acf_8ffb_3b7cc1070d77.slice" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="8f19bb00-3a90-4acf-8ffb-3b7cc1070d77" Mar 16 16:27:19 crc kubenswrapper[5120]: I0316 16:27:19.683110 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"594e9c2b-c42a-4671-9b95-3ca9cc0834da","Type":"ContainerStarted","Data":"4738f855f2af9511199dcb63a9d508dbfb5ef2b859371cbd01a2dbeee556de78"} Mar 16 16:27:19 crc kubenswrapper[5120]: I0316 16:27:19.683594 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:27:19 crc kubenswrapper[5120]: I0316 16:27:19.706200 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-scheduler-0" podStartSLOduration=3.70618534 podStartE2EDuration="3.70618534s" podCreationTimestamp="2026-03-16 16:27:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:27:19.704122894 +0000 UTC m=+3341.858054551" watchObservedRunningTime="2026-03-16 16:27:19.70618534 +0000 UTC m=+3341.860116997" Mar 16 16:27:19 crc kubenswrapper[5120]: I0316 16:27:19.750613 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:27:19 crc kubenswrapper[5120]: I0316 16:27:19.761523 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:27:19 crc kubenswrapper[5120]: I0316 16:27:19.774577 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:27:19 crc kubenswrapper[5120]: I0316 16:27:19.782839 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:27:19 crc kubenswrapper[5120]: I0316 16:27:19.782998 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:27:19 crc kubenswrapper[5120]: I0316 16:27:19.791912 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-internal-svc\"" Mar 16 16:27:19 crc kubenswrapper[5120]: I0316 16:27:19.792726 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-internal-config-data\"" Mar 16 16:27:19 crc kubenswrapper[5120]: I0316 16:27:19.836870 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/06b8b1f6-bed1-4548-8bdc-0a143d95aedd-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"06b8b1f6-bed1-4548-8bdc-0a143d95aedd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:27:19 crc kubenswrapper[5120]: I0316 16:27:19.837252 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"glance-default-internal-api-0\" (UID: \"06b8b1f6-bed1-4548-8bdc-0a143d95aedd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:27:19 crc kubenswrapper[5120]: I0316 16:27:19.837378 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/06b8b1f6-bed1-4548-8bdc-0a143d95aedd-config-data\") pod \"glance-default-internal-api-0\" (UID: \"06b8b1f6-bed1-4548-8bdc-0a143d95aedd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:27:19 crc kubenswrapper[5120]: I0316 16:27:19.837519 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/06b8b1f6-bed1-4548-8bdc-0a143d95aedd-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"06b8b1f6-bed1-4548-8bdc-0a143d95aedd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:27:19 crc kubenswrapper[5120]: I0316 16:27:19.837741 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/06b8b1f6-bed1-4548-8bdc-0a143d95aedd-logs\") pod \"glance-default-internal-api-0\" (UID: \"06b8b1f6-bed1-4548-8bdc-0a143d95aedd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:27:19 crc kubenswrapper[5120]: I0316 16:27:19.837904 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/06b8b1f6-bed1-4548-8bdc-0a143d95aedd-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"06b8b1f6-bed1-4548-8bdc-0a143d95aedd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:27:19 crc kubenswrapper[5120]: I0316 16:27:19.838134 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/06b8b1f6-bed1-4548-8bdc-0a143d95aedd-scripts\") pod \"glance-default-internal-api-0\" (UID: \"06b8b1f6-bed1-4548-8bdc-0a143d95aedd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:27:19 crc kubenswrapper[5120]: I0316 16:27:19.838318 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9fvvq\" (UniqueName: \"kubernetes.io/projected/06b8b1f6-bed1-4548-8bdc-0a143d95aedd-kube-api-access-9fvvq\") pod \"glance-default-internal-api-0\" (UID: \"06b8b1f6-bed1-4548-8bdc-0a143d95aedd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:27:19 crc kubenswrapper[5120]: I0316 16:27:19.941050 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9fvvq\" (UniqueName: \"kubernetes.io/projected/06b8b1f6-bed1-4548-8bdc-0a143d95aedd-kube-api-access-9fvvq\") pod \"glance-default-internal-api-0\" (UID: \"06b8b1f6-bed1-4548-8bdc-0a143d95aedd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:27:19 crc kubenswrapper[5120]: I0316 16:27:19.941163 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/06b8b1f6-bed1-4548-8bdc-0a143d95aedd-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"06b8b1f6-bed1-4548-8bdc-0a143d95aedd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:27:19 crc kubenswrapper[5120]: I0316 16:27:19.941205 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"glance-default-internal-api-0\" (UID: \"06b8b1f6-bed1-4548-8bdc-0a143d95aedd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:27:19 crc kubenswrapper[5120]: I0316 16:27:19.941245 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/06b8b1f6-bed1-4548-8bdc-0a143d95aedd-config-data\") pod \"glance-default-internal-api-0\" (UID: \"06b8b1f6-bed1-4548-8bdc-0a143d95aedd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:27:19 crc kubenswrapper[5120]: I0316 16:27:19.941283 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/06b8b1f6-bed1-4548-8bdc-0a143d95aedd-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"06b8b1f6-bed1-4548-8bdc-0a143d95aedd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:27:19 crc kubenswrapper[5120]: I0316 16:27:19.941381 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/06b8b1f6-bed1-4548-8bdc-0a143d95aedd-logs\") pod \"glance-default-internal-api-0\" (UID: \"06b8b1f6-bed1-4548-8bdc-0a143d95aedd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:27:19 crc kubenswrapper[5120]: I0316 16:27:19.941421 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/06b8b1f6-bed1-4548-8bdc-0a143d95aedd-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"06b8b1f6-bed1-4548-8bdc-0a143d95aedd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:27:19 crc kubenswrapper[5120]: I0316 16:27:19.941514 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/06b8b1f6-bed1-4548-8bdc-0a143d95aedd-scripts\") pod \"glance-default-internal-api-0\" (UID: \"06b8b1f6-bed1-4548-8bdc-0a143d95aedd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:27:19 crc kubenswrapper[5120]: I0316 16:27:19.943612 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/06b8b1f6-bed1-4548-8bdc-0a143d95aedd-logs\") pod \"glance-default-internal-api-0\" (UID: \"06b8b1f6-bed1-4548-8bdc-0a143d95aedd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:27:19 crc kubenswrapper[5120]: I0316 16:27:19.945130 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/06b8b1f6-bed1-4548-8bdc-0a143d95aedd-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"06b8b1f6-bed1-4548-8bdc-0a143d95aedd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:27:19 crc kubenswrapper[5120]: I0316 16:27:19.952626 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/06b8b1f6-bed1-4548-8bdc-0a143d95aedd-scripts\") pod \"glance-default-internal-api-0\" (UID: \"06b8b1f6-bed1-4548-8bdc-0a143d95aedd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:27:19 crc kubenswrapper[5120]: I0316 16:27:19.953044 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"glance-default-internal-api-0\" (UID: \"06b8b1f6-bed1-4548-8bdc-0a143d95aedd\") device mount path \"/mnt/openstack/pv03\"" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:27:19 crc kubenswrapper[5120]: I0316 16:27:19.954002 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/06b8b1f6-bed1-4548-8bdc-0a143d95aedd-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"06b8b1f6-bed1-4548-8bdc-0a143d95aedd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:27:19 crc kubenswrapper[5120]: I0316 16:27:19.959701 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/06b8b1f6-bed1-4548-8bdc-0a143d95aedd-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"06b8b1f6-bed1-4548-8bdc-0a143d95aedd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:27:19 crc kubenswrapper[5120]: I0316 16:27:19.981602 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/06b8b1f6-bed1-4548-8bdc-0a143d95aedd-config-data\") pod \"glance-default-internal-api-0\" (UID: \"06b8b1f6-bed1-4548-8bdc-0a143d95aedd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:27:20 crc kubenswrapper[5120]: I0316 16:27:20.010869 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9fvvq\" (UniqueName: \"kubernetes.io/projected/06b8b1f6-bed1-4548-8bdc-0a143d95aedd-kube-api-access-9fvvq\") pod \"glance-default-internal-api-0\" (UID: \"06b8b1f6-bed1-4548-8bdc-0a143d95aedd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:27:20 crc kubenswrapper[5120]: I0316 16:27:20.014027 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"glance-default-internal-api-0\" (UID: \"06b8b1f6-bed1-4548-8bdc-0a143d95aedd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:27:20 crc kubenswrapper[5120]: I0316 16:27:20.117616 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:27:20 crc kubenswrapper[5120]: I0316 16:27:20.142041 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-6cbd8fc548-p4pgf" podUID="cd9ea9cd-8e42-4c8a-bb6e-f2ea651f47d6" containerName="barbican-api" probeResult="failure" output="Get \"http://10.217.1.207:9311/healthcheck\": read tcp 10.217.0.2:39204->10.217.1.207:9311: read: connection reset by peer" Mar 16 16:27:20 crc kubenswrapper[5120]: I0316 16:27:20.640451 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:27:20 crc kubenswrapper[5120]: W0316 16:27:20.645948 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod06b8b1f6_bed1_4548_8bdc_0a143d95aedd.slice/crio-b1088987bd713ec967bc668edb6e3e74467a05566fb10b990836a73a4d15ec4c WatchSource:0}: Error finding container b1088987bd713ec967bc668edb6e3e74467a05566fb10b990836a73a4d15ec4c: Status 404 returned error can't find the container with id b1088987bd713ec967bc668edb6e3e74467a05566fb10b990836a73a4d15ec4c Mar 16 16:27:20 crc kubenswrapper[5120]: I0316 16:27:20.696951 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8f19bb00-3a90-4acf-8ffb-3b7cc1070d77" path="/var/lib/kubelet/pods/8f19bb00-3a90-4acf-8ffb-3b7cc1070d77/volumes" Mar 16 16:27:20 crc kubenswrapper[5120]: I0316 16:27:20.700621 5120 generic.go:358] "Generic (PLEG): container finished" podID="cd9ea9cd-8e42-4c8a-bb6e-f2ea651f47d6" containerID="bc2f0f9bde0f32d49d1df4f716f7d818727db184ca8e18433ffc6aab79dbf31d" exitCode=0 Mar 16 16:27:20 crc kubenswrapper[5120]: I0316 16:27:20.700712 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-6cbd8fc548-p4pgf" event={"ID":"cd9ea9cd-8e42-4c8a-bb6e-f2ea651f47d6","Type":"ContainerDied","Data":"bc2f0f9bde0f32d49d1df4f716f7d818727db184ca8e18433ffc6aab79dbf31d"} Mar 16 16:27:20 crc kubenswrapper[5120]: I0316 16:27:20.702835 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"06b8b1f6-bed1-4548-8bdc-0a143d95aedd","Type":"ContainerStarted","Data":"b1088987bd713ec967bc668edb6e3e74467a05566fb10b990836a73a4d15ec4c"} Mar 16 16:27:20 crc kubenswrapper[5120]: I0316 16:27:20.773586 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-6cbd8fc548-p4pgf" Mar 16 16:27:20 crc kubenswrapper[5120]: I0316 16:27:20.866145 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cd9ea9cd-8e42-4c8a-bb6e-f2ea651f47d6-config-data\") pod \"cd9ea9cd-8e42-4c8a-bb6e-f2ea651f47d6\" (UID: \"cd9ea9cd-8e42-4c8a-bb6e-f2ea651f47d6\") " Mar 16 16:27:20 crc kubenswrapper[5120]: I0316 16:27:20.866506 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/cd9ea9cd-8e42-4c8a-bb6e-f2ea651f47d6-config-data-custom\") pod \"cd9ea9cd-8e42-4c8a-bb6e-f2ea651f47d6\" (UID: \"cd9ea9cd-8e42-4c8a-bb6e-f2ea651f47d6\") " Mar 16 16:27:20 crc kubenswrapper[5120]: I0316 16:27:20.867417 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cd9ea9cd-8e42-4c8a-bb6e-f2ea651f47d6-combined-ca-bundle\") pod \"cd9ea9cd-8e42-4c8a-bb6e-f2ea651f47d6\" (UID: \"cd9ea9cd-8e42-4c8a-bb6e-f2ea651f47d6\") " Mar 16 16:27:20 crc kubenswrapper[5120]: I0316 16:27:20.867452 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/cd9ea9cd-8e42-4c8a-bb6e-f2ea651f47d6-logs\") pod \"cd9ea9cd-8e42-4c8a-bb6e-f2ea651f47d6\" (UID: \"cd9ea9cd-8e42-4c8a-bb6e-f2ea651f47d6\") " Mar 16 16:27:20 crc kubenswrapper[5120]: I0316 16:27:20.867598 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-645xv\" (UniqueName: \"kubernetes.io/projected/cd9ea9cd-8e42-4c8a-bb6e-f2ea651f47d6-kube-api-access-645xv\") pod \"cd9ea9cd-8e42-4c8a-bb6e-f2ea651f47d6\" (UID: \"cd9ea9cd-8e42-4c8a-bb6e-f2ea651f47d6\") " Mar 16 16:27:20 crc kubenswrapper[5120]: I0316 16:27:20.869967 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd9ea9cd-8e42-4c8a-bb6e-f2ea651f47d6-logs" (OuterVolumeSpecName: "logs") pod "cd9ea9cd-8e42-4c8a-bb6e-f2ea651f47d6" (UID: "cd9ea9cd-8e42-4c8a-bb6e-f2ea651f47d6"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:27:20 crc kubenswrapper[5120]: I0316 16:27:20.875487 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd9ea9cd-8e42-4c8a-bb6e-f2ea651f47d6-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "cd9ea9cd-8e42-4c8a-bb6e-f2ea651f47d6" (UID: "cd9ea9cd-8e42-4c8a-bb6e-f2ea651f47d6"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:27:20 crc kubenswrapper[5120]: I0316 16:27:20.875948 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd9ea9cd-8e42-4c8a-bb6e-f2ea651f47d6-kube-api-access-645xv" (OuterVolumeSpecName: "kube-api-access-645xv") pod "cd9ea9cd-8e42-4c8a-bb6e-f2ea651f47d6" (UID: "cd9ea9cd-8e42-4c8a-bb6e-f2ea651f47d6"). InnerVolumeSpecName "kube-api-access-645xv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:27:20 crc kubenswrapper[5120]: I0316 16:27:20.919796 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd9ea9cd-8e42-4c8a-bb6e-f2ea651f47d6-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "cd9ea9cd-8e42-4c8a-bb6e-f2ea651f47d6" (UID: "cd9ea9cd-8e42-4c8a-bb6e-f2ea651f47d6"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:27:20 crc kubenswrapper[5120]: I0316 16:27:20.932848 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd9ea9cd-8e42-4c8a-bb6e-f2ea651f47d6-config-data" (OuterVolumeSpecName: "config-data") pod "cd9ea9cd-8e42-4c8a-bb6e-f2ea651f47d6" (UID: "cd9ea9cd-8e42-4c8a-bb6e-f2ea651f47d6"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:27:20 crc kubenswrapper[5120]: I0316 16:27:20.971385 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-645xv\" (UniqueName: \"kubernetes.io/projected/cd9ea9cd-8e42-4c8a-bb6e-f2ea651f47d6-kube-api-access-645xv\") on node \"crc\" DevicePath \"\"" Mar 16 16:27:20 crc kubenswrapper[5120]: I0316 16:27:20.971422 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cd9ea9cd-8e42-4c8a-bb6e-f2ea651f47d6-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:27:20 crc kubenswrapper[5120]: I0316 16:27:20.971433 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/cd9ea9cd-8e42-4c8a-bb6e-f2ea651f47d6-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:27:20 crc kubenswrapper[5120]: I0316 16:27:20.971442 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cd9ea9cd-8e42-4c8a-bb6e-f2ea651f47d6-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:27:20 crc kubenswrapper[5120]: I0316 16:27:20.971451 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/cd9ea9cd-8e42-4c8a-bb6e-f2ea651f47d6-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:27:21 crc kubenswrapper[5120]: I0316 16:27:21.715438 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-6cbd8fc548-p4pgf" event={"ID":"cd9ea9cd-8e42-4c8a-bb6e-f2ea651f47d6","Type":"ContainerDied","Data":"e333eeeb4aa33405c67723d15ece34b6b2ae163f412601f9cdfb80afac04b901"} Mar 16 16:27:21 crc kubenswrapper[5120]: I0316 16:27:21.715515 5120 scope.go:117] "RemoveContainer" containerID="bc2f0f9bde0f32d49d1df4f716f7d818727db184ca8e18433ffc6aab79dbf31d" Mar 16 16:27:21 crc kubenswrapper[5120]: I0316 16:27:21.715713 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-6cbd8fc548-p4pgf" Mar 16 16:27:21 crc kubenswrapper[5120]: I0316 16:27:21.717588 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"06b8b1f6-bed1-4548-8bdc-0a143d95aedd","Type":"ContainerStarted","Data":"fa480b3baf502dd59bb2e9ee71fe48cb86a8e9040dc07d72ba6da8ea71f26f3d"} Mar 16 16:27:21 crc kubenswrapper[5120]: I0316 16:27:21.757931 5120 scope.go:117] "RemoveContainer" containerID="51f9523062c88689496ef71fbfff0ce96830c8ad5ae75f4c74b29864a40c4c66" Mar 16 16:27:21 crc kubenswrapper[5120]: I0316 16:27:21.762494 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-6cbd8fc548-p4pgf"] Mar 16 16:27:21 crc kubenswrapper[5120]: I0316 16:27:21.771754 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-api-6cbd8fc548-p4pgf"] Mar 16 16:27:21 crc kubenswrapper[5120]: I0316 16:27:21.959729 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:27:22 crc kubenswrapper[5120]: I0316 16:27:22.674669 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cd9ea9cd-8e42-4c8a-bb6e-f2ea651f47d6" path="/var/lib/kubelet/pods/cd9ea9cd-8e42-4c8a-bb6e-f2ea651f47d6/volumes" Mar 16 16:27:22 crc kubenswrapper[5120]: I0316 16:27:22.741117 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"06b8b1f6-bed1-4548-8bdc-0a143d95aedd","Type":"ContainerStarted","Data":"9dbabc0a3d58b62aed75c816865442845fbaca03956a14056838caa0d2b75ce2"} Mar 16 16:27:22 crc kubenswrapper[5120]: I0316 16:27:22.782388 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-internal-api-0" podStartSLOduration=3.782366949 podStartE2EDuration="3.782366949s" podCreationTimestamp="2026-03-16 16:27:19 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:27:22.774402106 +0000 UTC m=+3344.928333803" watchObservedRunningTime="2026-03-16 16:27:22.782366949 +0000 UTC m=+3344.936298616" Mar 16 16:27:24 crc kubenswrapper[5120]: E0316 16:27:24.248487 5120 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb90e76bc_d652_4606_8c72_4b96133ce5c4.slice\": RecentStats: unable to find data in memory cache]" Mar 16 16:27:25 crc kubenswrapper[5120]: I0316 16:27:25.805719 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/placement-6b678b5478-h7p85" Mar 16 16:27:26 crc kubenswrapper[5120]: I0316 16:27:26.734302 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/placement-6b678b5478-h7p85" Mar 16 16:27:26 crc kubenswrapper[5120]: I0316 16:27:26.966458 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-76845cddf4-zlw8q"] Mar 16 16:27:26 crc kubenswrapper[5120]: I0316 16:27:26.967863 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd9ea9cd-8e42-4c8a-bb6e-f2ea651f47d6" containerName="barbican-api-log" Mar 16 16:27:26 crc kubenswrapper[5120]: I0316 16:27:26.967896 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd9ea9cd-8e42-4c8a-bb6e-f2ea651f47d6" containerName="barbican-api-log" Mar 16 16:27:26 crc kubenswrapper[5120]: I0316 16:27:26.967934 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd9ea9cd-8e42-4c8a-bb6e-f2ea651f47d6" containerName="barbican-api" Mar 16 16:27:26 crc kubenswrapper[5120]: I0316 16:27:26.967942 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd9ea9cd-8e42-4c8a-bb6e-f2ea651f47d6" containerName="barbican-api" Mar 16 16:27:26 crc kubenswrapper[5120]: I0316 16:27:26.968181 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="cd9ea9cd-8e42-4c8a-bb6e-f2ea651f47d6" containerName="barbican-api-log" Mar 16 16:27:26 crc kubenswrapper[5120]: I0316 16:27:26.968216 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="cd9ea9cd-8e42-4c8a-bb6e-f2ea651f47d6" containerName="barbican-api" Mar 16 16:27:26 crc kubenswrapper[5120]: I0316 16:27:26.974485 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-76845cddf4-zlw8q" Mar 16 16:27:26 crc kubenswrapper[5120]: I0316 16:27:26.980367 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-76845cddf4-zlw8q"] Mar 16 16:27:27 crc kubenswrapper[5120]: I0316 16:27:27.121464 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/850510ce-da60-453a-88a8-475bc65bb0df-logs\") pod \"placement-76845cddf4-zlw8q\" (UID: \"850510ce-da60-453a-88a8-475bc65bb0df\") " pod="openstack-kuttl-tests/placement-76845cddf4-zlw8q" Mar 16 16:27:27 crc kubenswrapper[5120]: I0316 16:27:27.121783 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/850510ce-da60-453a-88a8-475bc65bb0df-internal-tls-certs\") pod \"placement-76845cddf4-zlw8q\" (UID: \"850510ce-da60-453a-88a8-475bc65bb0df\") " pod="openstack-kuttl-tests/placement-76845cddf4-zlw8q" Mar 16 16:27:27 crc kubenswrapper[5120]: I0316 16:27:27.121844 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/850510ce-da60-453a-88a8-475bc65bb0df-config-data\") pod \"placement-76845cddf4-zlw8q\" (UID: \"850510ce-da60-453a-88a8-475bc65bb0df\") " pod="openstack-kuttl-tests/placement-76845cddf4-zlw8q" Mar 16 16:27:27 crc kubenswrapper[5120]: I0316 16:27:27.122002 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/850510ce-da60-453a-88a8-475bc65bb0df-combined-ca-bundle\") pod \"placement-76845cddf4-zlw8q\" (UID: \"850510ce-da60-453a-88a8-475bc65bb0df\") " pod="openstack-kuttl-tests/placement-76845cddf4-zlw8q" Mar 16 16:27:27 crc kubenswrapper[5120]: I0316 16:27:27.122188 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89fmt\" (UniqueName: \"kubernetes.io/projected/850510ce-da60-453a-88a8-475bc65bb0df-kube-api-access-89fmt\") pod \"placement-76845cddf4-zlw8q\" (UID: \"850510ce-da60-453a-88a8-475bc65bb0df\") " pod="openstack-kuttl-tests/placement-76845cddf4-zlw8q" Mar 16 16:27:27 crc kubenswrapper[5120]: I0316 16:27:27.122345 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/850510ce-da60-453a-88a8-475bc65bb0df-scripts\") pod \"placement-76845cddf4-zlw8q\" (UID: \"850510ce-da60-453a-88a8-475bc65bb0df\") " pod="openstack-kuttl-tests/placement-76845cddf4-zlw8q" Mar 16 16:27:27 crc kubenswrapper[5120]: I0316 16:27:27.122555 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/850510ce-da60-453a-88a8-475bc65bb0df-public-tls-certs\") pod \"placement-76845cddf4-zlw8q\" (UID: \"850510ce-da60-453a-88a8-475bc65bb0df\") " pod="openstack-kuttl-tests/placement-76845cddf4-zlw8q" Mar 16 16:27:27 crc kubenswrapper[5120]: I0316 16:27:27.169562 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:27:27 crc kubenswrapper[5120]: I0316 16:27:27.224600 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/850510ce-da60-453a-88a8-475bc65bb0df-internal-tls-certs\") pod \"placement-76845cddf4-zlw8q\" (UID: \"850510ce-da60-453a-88a8-475bc65bb0df\") " pod="openstack-kuttl-tests/placement-76845cddf4-zlw8q" Mar 16 16:27:27 crc kubenswrapper[5120]: I0316 16:27:27.224658 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/850510ce-da60-453a-88a8-475bc65bb0df-config-data\") pod \"placement-76845cddf4-zlw8q\" (UID: \"850510ce-da60-453a-88a8-475bc65bb0df\") " pod="openstack-kuttl-tests/placement-76845cddf4-zlw8q" Mar 16 16:27:27 crc kubenswrapper[5120]: I0316 16:27:27.224707 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/850510ce-da60-453a-88a8-475bc65bb0df-combined-ca-bundle\") pod \"placement-76845cddf4-zlw8q\" (UID: \"850510ce-da60-453a-88a8-475bc65bb0df\") " pod="openstack-kuttl-tests/placement-76845cddf4-zlw8q" Mar 16 16:27:27 crc kubenswrapper[5120]: I0316 16:27:27.224803 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-89fmt\" (UniqueName: \"kubernetes.io/projected/850510ce-da60-453a-88a8-475bc65bb0df-kube-api-access-89fmt\") pod \"placement-76845cddf4-zlw8q\" (UID: \"850510ce-da60-453a-88a8-475bc65bb0df\") " pod="openstack-kuttl-tests/placement-76845cddf4-zlw8q" Mar 16 16:27:27 crc kubenswrapper[5120]: I0316 16:27:27.224897 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/850510ce-da60-453a-88a8-475bc65bb0df-scripts\") pod \"placement-76845cddf4-zlw8q\" (UID: \"850510ce-da60-453a-88a8-475bc65bb0df\") " pod="openstack-kuttl-tests/placement-76845cddf4-zlw8q" Mar 16 16:27:27 crc kubenswrapper[5120]: I0316 16:27:27.225003 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/850510ce-da60-453a-88a8-475bc65bb0df-public-tls-certs\") pod \"placement-76845cddf4-zlw8q\" (UID: \"850510ce-da60-453a-88a8-475bc65bb0df\") " pod="openstack-kuttl-tests/placement-76845cddf4-zlw8q" Mar 16 16:27:27 crc kubenswrapper[5120]: I0316 16:27:27.225103 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/850510ce-da60-453a-88a8-475bc65bb0df-logs\") pod \"placement-76845cddf4-zlw8q\" (UID: \"850510ce-da60-453a-88a8-475bc65bb0df\") " pod="openstack-kuttl-tests/placement-76845cddf4-zlw8q" Mar 16 16:27:27 crc kubenswrapper[5120]: I0316 16:27:27.225491 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/850510ce-da60-453a-88a8-475bc65bb0df-logs\") pod \"placement-76845cddf4-zlw8q\" (UID: \"850510ce-da60-453a-88a8-475bc65bb0df\") " pod="openstack-kuttl-tests/placement-76845cddf4-zlw8q" Mar 16 16:27:27 crc kubenswrapper[5120]: I0316 16:27:27.231153 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/850510ce-da60-453a-88a8-475bc65bb0df-config-data\") pod \"placement-76845cddf4-zlw8q\" (UID: \"850510ce-da60-453a-88a8-475bc65bb0df\") " pod="openstack-kuttl-tests/placement-76845cddf4-zlw8q" Mar 16 16:27:27 crc kubenswrapper[5120]: I0316 16:27:27.231338 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/850510ce-da60-453a-88a8-475bc65bb0df-scripts\") pod \"placement-76845cddf4-zlw8q\" (UID: \"850510ce-da60-453a-88a8-475bc65bb0df\") " pod="openstack-kuttl-tests/placement-76845cddf4-zlw8q" Mar 16 16:27:27 crc kubenswrapper[5120]: I0316 16:27:27.233542 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/850510ce-da60-453a-88a8-475bc65bb0df-internal-tls-certs\") pod \"placement-76845cddf4-zlw8q\" (UID: \"850510ce-da60-453a-88a8-475bc65bb0df\") " pod="openstack-kuttl-tests/placement-76845cddf4-zlw8q" Mar 16 16:27:27 crc kubenswrapper[5120]: I0316 16:27:27.237395 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/850510ce-da60-453a-88a8-475bc65bb0df-combined-ca-bundle\") pod \"placement-76845cddf4-zlw8q\" (UID: \"850510ce-da60-453a-88a8-475bc65bb0df\") " pod="openstack-kuttl-tests/placement-76845cddf4-zlw8q" Mar 16 16:27:27 crc kubenswrapper[5120]: I0316 16:27:27.240399 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/850510ce-da60-453a-88a8-475bc65bb0df-public-tls-certs\") pod \"placement-76845cddf4-zlw8q\" (UID: \"850510ce-da60-453a-88a8-475bc65bb0df\") " pod="openstack-kuttl-tests/placement-76845cddf4-zlw8q" Mar 16 16:27:27 crc kubenswrapper[5120]: I0316 16:27:27.241389 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-89fmt\" (UniqueName: \"kubernetes.io/projected/850510ce-da60-453a-88a8-475bc65bb0df-kube-api-access-89fmt\") pod \"placement-76845cddf4-zlw8q\" (UID: \"850510ce-da60-453a-88a8-475bc65bb0df\") " pod="openstack-kuttl-tests/placement-76845cddf4-zlw8q" Mar 16 16:27:27 crc kubenswrapper[5120]: I0316 16:27:27.297010 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-76845cddf4-zlw8q" Mar 16 16:27:27 crc kubenswrapper[5120]: I0316 16:27:27.774713 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-76845cddf4-zlw8q"] Mar 16 16:27:27 crc kubenswrapper[5120]: I0316 16:27:27.814926 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-76845cddf4-zlw8q" event={"ID":"850510ce-da60-453a-88a8-475bc65bb0df","Type":"ContainerStarted","Data":"dc950f444adfcfe1c4c6d401ef3f376faffafa4ebc3be9a126b26f622bda1798"} Mar 16 16:27:28 crc kubenswrapper[5120]: I0316 16:27:28.827462 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-76845cddf4-zlw8q" event={"ID":"850510ce-da60-453a-88a8-475bc65bb0df","Type":"ContainerStarted","Data":"0c87f1e5ac81b96f6ef9514dc786d98dfeb76235a80ea1a9c515704f7bb369ab"} Mar 16 16:27:28 crc kubenswrapper[5120]: I0316 16:27:28.827942 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-76845cddf4-zlw8q" Mar 16 16:27:28 crc kubenswrapper[5120]: I0316 16:27:28.827953 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-76845cddf4-zlw8q" event={"ID":"850510ce-da60-453a-88a8-475bc65bb0df","Type":"ContainerStarted","Data":"07ebfddf2a30ff0b748ede18680624ba9dd698382919d1abdbdea7d864ee51b8"} Mar 16 16:27:28 crc kubenswrapper[5120]: I0316 16:27:28.827966 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-76845cddf4-zlw8q" Mar 16 16:27:28 crc kubenswrapper[5120]: I0316 16:27:28.854454 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-76845cddf4-zlw8q" podStartSLOduration=2.854435601 podStartE2EDuration="2.854435601s" podCreationTimestamp="2026-03-16 16:27:26 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:27:28.850205138 +0000 UTC m=+3351.004136795" watchObservedRunningTime="2026-03-16 16:27:28.854435601 +0000 UTC m=+3351.008367258" Mar 16 16:27:30 crc kubenswrapper[5120]: I0316 16:27:30.118448 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:27:30 crc kubenswrapper[5120]: I0316 16:27:30.118793 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:27:30 crc kubenswrapper[5120]: I0316 16:27:30.149785 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:27:30 crc kubenswrapper[5120]: I0316 16:27:30.164145 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:27:30 crc kubenswrapper[5120]: I0316 16:27:30.851216 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:27:30 crc kubenswrapper[5120]: I0316 16:27:30.851276 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:27:32 crc kubenswrapper[5120]: I0316 16:27:32.613175 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:27:32 crc kubenswrapper[5120]: I0316 16:27:32.752100 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:27:33 crc kubenswrapper[5120]: I0316 16:27:33.507283 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/keystone-6bf8d6479c-9rjt6" Mar 16 16:27:34 crc kubenswrapper[5120]: E0316 16:27:34.518790 5120 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb90e76bc_d652_4606_8c72_4b96133ce5c4.slice\": RecentStats: unable to find data in memory cache]" Mar 16 16:27:34 crc kubenswrapper[5120]: I0316 16:27:34.857471 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:27:34 crc kubenswrapper[5120]: I0316 16:27:34.898223 5120 generic.go:358] "Generic (PLEG): container finished" podID="dcb14165-880d-48a0-bb00-5061b8aa1a4b" containerID="203c1ae282406a3cae32989f119023af795bcdb4d806e4780d251f6ddd931a38" exitCode=137 Mar 16 16:27:34 crc kubenswrapper[5120]: I0316 16:27:34.898307 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:27:34 crc kubenswrapper[5120]: I0316 16:27:34.898331 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"dcb14165-880d-48a0-bb00-5061b8aa1a4b","Type":"ContainerDied","Data":"203c1ae282406a3cae32989f119023af795bcdb4d806e4780d251f6ddd931a38"} Mar 16 16:27:34 crc kubenswrapper[5120]: I0316 16:27:34.898383 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"dcb14165-880d-48a0-bb00-5061b8aa1a4b","Type":"ContainerDied","Data":"cbbbe8f44e1541da36e1e38893851e7a5f84dda07777ea37aa5a715c8d2db999"} Mar 16 16:27:34 crc kubenswrapper[5120]: I0316 16:27:34.898408 5120 scope.go:117] "RemoveContainer" containerID="203c1ae282406a3cae32989f119023af795bcdb4d806e4780d251f6ddd931a38" Mar 16 16:27:34 crc kubenswrapper[5120]: I0316 16:27:34.946268 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dcb14165-880d-48a0-bb00-5061b8aa1a4b-config-data\") pod \"dcb14165-880d-48a0-bb00-5061b8aa1a4b\" (UID: \"dcb14165-880d-48a0-bb00-5061b8aa1a4b\") " Mar 16 16:27:34 crc kubenswrapper[5120]: I0316 16:27:34.946312 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dcb14165-880d-48a0-bb00-5061b8aa1a4b-combined-ca-bundle\") pod \"dcb14165-880d-48a0-bb00-5061b8aa1a4b\" (UID: \"dcb14165-880d-48a0-bb00-5061b8aa1a4b\") " Mar 16 16:27:34 crc kubenswrapper[5120]: I0316 16:27:34.946342 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/dcb14165-880d-48a0-bb00-5061b8aa1a4b-logs\") pod \"dcb14165-880d-48a0-bb00-5061b8aa1a4b\" (UID: \"dcb14165-880d-48a0-bb00-5061b8aa1a4b\") " Mar 16 16:27:34 crc kubenswrapper[5120]: I0316 16:27:34.946610 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/dcb14165-880d-48a0-bb00-5061b8aa1a4b-config-data-custom\") pod \"dcb14165-880d-48a0-bb00-5061b8aa1a4b\" (UID: \"dcb14165-880d-48a0-bb00-5061b8aa1a4b\") " Mar 16 16:27:34 crc kubenswrapper[5120]: I0316 16:27:34.946629 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/dcb14165-880d-48a0-bb00-5061b8aa1a4b-etc-machine-id\") pod \"dcb14165-880d-48a0-bb00-5061b8aa1a4b\" (UID: \"dcb14165-880d-48a0-bb00-5061b8aa1a4b\") " Mar 16 16:27:34 crc kubenswrapper[5120]: I0316 16:27:34.946810 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wbpxb\" (UniqueName: \"kubernetes.io/projected/dcb14165-880d-48a0-bb00-5061b8aa1a4b-kube-api-access-wbpxb\") pod \"dcb14165-880d-48a0-bb00-5061b8aa1a4b\" (UID: \"dcb14165-880d-48a0-bb00-5061b8aa1a4b\") " Mar 16 16:27:34 crc kubenswrapper[5120]: I0316 16:27:34.946835 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/dcb14165-880d-48a0-bb00-5061b8aa1a4b-scripts\") pod \"dcb14165-880d-48a0-bb00-5061b8aa1a4b\" (UID: \"dcb14165-880d-48a0-bb00-5061b8aa1a4b\") " Mar 16 16:27:34 crc kubenswrapper[5120]: I0316 16:27:34.947083 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/dcb14165-880d-48a0-bb00-5061b8aa1a4b-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "dcb14165-880d-48a0-bb00-5061b8aa1a4b" (UID: "dcb14165-880d-48a0-bb00-5061b8aa1a4b"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 16:27:34 crc kubenswrapper[5120]: I0316 16:27:34.947343 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dcb14165-880d-48a0-bb00-5061b8aa1a4b-logs" (OuterVolumeSpecName: "logs") pod "dcb14165-880d-48a0-bb00-5061b8aa1a4b" (UID: "dcb14165-880d-48a0-bb00-5061b8aa1a4b"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:27:34 crc kubenswrapper[5120]: I0316 16:27:34.948733 5120 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/dcb14165-880d-48a0-bb00-5061b8aa1a4b-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 16:27:34 crc kubenswrapper[5120]: I0316 16:27:34.948784 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/dcb14165-880d-48a0-bb00-5061b8aa1a4b-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:27:34 crc kubenswrapper[5120]: I0316 16:27:34.955395 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dcb14165-880d-48a0-bb00-5061b8aa1a4b-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "dcb14165-880d-48a0-bb00-5061b8aa1a4b" (UID: "dcb14165-880d-48a0-bb00-5061b8aa1a4b"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:27:34 crc kubenswrapper[5120]: I0316 16:27:34.955898 5120 scope.go:117] "RemoveContainer" containerID="12d9e72b65fc03ba4e03766289bfe450989ef41457e89fa82c116b2b0e4acdaf" Mar 16 16:27:34 crc kubenswrapper[5120]: I0316 16:27:34.958033 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dcb14165-880d-48a0-bb00-5061b8aa1a4b-scripts" (OuterVolumeSpecName: "scripts") pod "dcb14165-880d-48a0-bb00-5061b8aa1a4b" (UID: "dcb14165-880d-48a0-bb00-5061b8aa1a4b"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:27:34 crc kubenswrapper[5120]: I0316 16:27:34.970905 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dcb14165-880d-48a0-bb00-5061b8aa1a4b-kube-api-access-wbpxb" (OuterVolumeSpecName: "kube-api-access-wbpxb") pod "dcb14165-880d-48a0-bb00-5061b8aa1a4b" (UID: "dcb14165-880d-48a0-bb00-5061b8aa1a4b"). InnerVolumeSpecName "kube-api-access-wbpxb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:27:34 crc kubenswrapper[5120]: I0316 16:27:34.981104 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dcb14165-880d-48a0-bb00-5061b8aa1a4b-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "dcb14165-880d-48a0-bb00-5061b8aa1a4b" (UID: "dcb14165-880d-48a0-bb00-5061b8aa1a4b"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:27:35 crc kubenswrapper[5120]: I0316 16:27:35.007906 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dcb14165-880d-48a0-bb00-5061b8aa1a4b-config-data" (OuterVolumeSpecName: "config-data") pod "dcb14165-880d-48a0-bb00-5061b8aa1a4b" (UID: "dcb14165-880d-48a0-bb00-5061b8aa1a4b"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:27:35 crc kubenswrapper[5120]: I0316 16:27:35.050953 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wbpxb\" (UniqueName: \"kubernetes.io/projected/dcb14165-880d-48a0-bb00-5061b8aa1a4b-kube-api-access-wbpxb\") on node \"crc\" DevicePath \"\"" Mar 16 16:27:35 crc kubenswrapper[5120]: I0316 16:27:35.050991 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/dcb14165-880d-48a0-bb00-5061b8aa1a4b-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:27:35 crc kubenswrapper[5120]: I0316 16:27:35.051008 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dcb14165-880d-48a0-bb00-5061b8aa1a4b-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:27:35 crc kubenswrapper[5120]: I0316 16:27:35.051021 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dcb14165-880d-48a0-bb00-5061b8aa1a4b-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:27:35 crc kubenswrapper[5120]: I0316 16:27:35.051035 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/dcb14165-880d-48a0-bb00-5061b8aa1a4b-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:27:35 crc kubenswrapper[5120]: I0316 16:27:35.077258 5120 scope.go:117] "RemoveContainer" containerID="203c1ae282406a3cae32989f119023af795bcdb4d806e4780d251f6ddd931a38" Mar 16 16:27:35 crc kubenswrapper[5120]: E0316 16:27:35.077706 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"203c1ae282406a3cae32989f119023af795bcdb4d806e4780d251f6ddd931a38\": container with ID starting with 203c1ae282406a3cae32989f119023af795bcdb4d806e4780d251f6ddd931a38 not found: ID does not exist" containerID="203c1ae282406a3cae32989f119023af795bcdb4d806e4780d251f6ddd931a38" Mar 16 16:27:35 crc kubenswrapper[5120]: I0316 16:27:35.077742 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"203c1ae282406a3cae32989f119023af795bcdb4d806e4780d251f6ddd931a38"} err="failed to get container status \"203c1ae282406a3cae32989f119023af795bcdb4d806e4780d251f6ddd931a38\": rpc error: code = NotFound desc = could not find container \"203c1ae282406a3cae32989f119023af795bcdb4d806e4780d251f6ddd931a38\": container with ID starting with 203c1ae282406a3cae32989f119023af795bcdb4d806e4780d251f6ddd931a38 not found: ID does not exist" Mar 16 16:27:35 crc kubenswrapper[5120]: I0316 16:27:35.077777 5120 scope.go:117] "RemoveContainer" containerID="12d9e72b65fc03ba4e03766289bfe450989ef41457e89fa82c116b2b0e4acdaf" Mar 16 16:27:35 crc kubenswrapper[5120]: E0316 16:27:35.078033 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"12d9e72b65fc03ba4e03766289bfe450989ef41457e89fa82c116b2b0e4acdaf\": container with ID starting with 12d9e72b65fc03ba4e03766289bfe450989ef41457e89fa82c116b2b0e4acdaf not found: ID does not exist" containerID="12d9e72b65fc03ba4e03766289bfe450989ef41457e89fa82c116b2b0e4acdaf" Mar 16 16:27:35 crc kubenswrapper[5120]: I0316 16:27:35.078087 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"12d9e72b65fc03ba4e03766289bfe450989ef41457e89fa82c116b2b0e4acdaf"} err="failed to get container status \"12d9e72b65fc03ba4e03766289bfe450989ef41457e89fa82c116b2b0e4acdaf\": rpc error: code = NotFound desc = could not find container \"12d9e72b65fc03ba4e03766289bfe450989ef41457e89fa82c116b2b0e4acdaf\": container with ID starting with 12d9e72b65fc03ba4e03766289bfe450989ef41457e89fa82c116b2b0e4acdaf not found: ID does not exist" Mar 16 16:27:35 crc kubenswrapper[5120]: I0316 16:27:35.231271 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:27:35 crc kubenswrapper[5120]: I0316 16:27:35.242511 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:27:35 crc kubenswrapper[5120]: I0316 16:27:35.261641 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:27:35 crc kubenswrapper[5120]: I0316 16:27:35.266952 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dcb14165-880d-48a0-bb00-5061b8aa1a4b" containerName="cinder-api-log" Mar 16 16:27:35 crc kubenswrapper[5120]: I0316 16:27:35.266984 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="dcb14165-880d-48a0-bb00-5061b8aa1a4b" containerName="cinder-api-log" Mar 16 16:27:35 crc kubenswrapper[5120]: I0316 16:27:35.267002 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dcb14165-880d-48a0-bb00-5061b8aa1a4b" containerName="cinder-api" Mar 16 16:27:35 crc kubenswrapper[5120]: I0316 16:27:35.267008 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="dcb14165-880d-48a0-bb00-5061b8aa1a4b" containerName="cinder-api" Mar 16 16:27:35 crc kubenswrapper[5120]: I0316 16:27:35.267182 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="dcb14165-880d-48a0-bb00-5061b8aa1a4b" containerName="cinder-api" Mar 16 16:27:35 crc kubenswrapper[5120]: I0316 16:27:35.267198 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="dcb14165-880d-48a0-bb00-5061b8aa1a4b" containerName="cinder-api-log" Mar 16 16:27:35 crc kubenswrapper[5120]: I0316 16:27:35.273623 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:27:35 crc kubenswrapper[5120]: I0316 16:27:35.276146 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-cinder-public-svc\"" Mar 16 16:27:35 crc kubenswrapper[5120]: I0316 16:27:35.276848 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-api-config-data\"" Mar 16 16:27:35 crc kubenswrapper[5120]: I0316 16:27:35.277093 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-cinder-internal-svc\"" Mar 16 16:27:35 crc kubenswrapper[5120]: I0316 16:27:35.282573 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:27:35 crc kubenswrapper[5120]: I0316 16:27:35.358082 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f1ddadf2-8a01-49e5-a099-b192f793a36d-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"f1ddadf2-8a01-49e5-a099-b192f793a36d\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:27:35 crc kubenswrapper[5120]: I0316 16:27:35.358168 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f1ddadf2-8a01-49e5-a099-b192f793a36d-public-tls-certs\") pod \"cinder-api-0\" (UID: \"f1ddadf2-8a01-49e5-a099-b192f793a36d\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:27:35 crc kubenswrapper[5120]: I0316 16:27:35.358287 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f1ddadf2-8a01-49e5-a099-b192f793a36d-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"f1ddadf2-8a01-49e5-a099-b192f793a36d\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:27:35 crc kubenswrapper[5120]: I0316 16:27:35.358426 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f1ddadf2-8a01-49e5-a099-b192f793a36d-logs\") pod \"cinder-api-0\" (UID: \"f1ddadf2-8a01-49e5-a099-b192f793a36d\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:27:35 crc kubenswrapper[5120]: I0316 16:27:35.358632 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xdrr\" (UniqueName: \"kubernetes.io/projected/f1ddadf2-8a01-49e5-a099-b192f793a36d-kube-api-access-5xdrr\") pod \"cinder-api-0\" (UID: \"f1ddadf2-8a01-49e5-a099-b192f793a36d\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:27:35 crc kubenswrapper[5120]: I0316 16:27:35.358734 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f1ddadf2-8a01-49e5-a099-b192f793a36d-scripts\") pod \"cinder-api-0\" (UID: \"f1ddadf2-8a01-49e5-a099-b192f793a36d\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:27:35 crc kubenswrapper[5120]: I0316 16:27:35.358849 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/f1ddadf2-8a01-49e5-a099-b192f793a36d-config-data-custom\") pod \"cinder-api-0\" (UID: \"f1ddadf2-8a01-49e5-a099-b192f793a36d\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:27:35 crc kubenswrapper[5120]: I0316 16:27:35.358993 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/f1ddadf2-8a01-49e5-a099-b192f793a36d-etc-machine-id\") pod \"cinder-api-0\" (UID: \"f1ddadf2-8a01-49e5-a099-b192f793a36d\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:27:35 crc kubenswrapper[5120]: I0316 16:27:35.359343 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f1ddadf2-8a01-49e5-a099-b192f793a36d-config-data\") pod \"cinder-api-0\" (UID: \"f1ddadf2-8a01-49e5-a099-b192f793a36d\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:27:35 crc kubenswrapper[5120]: I0316 16:27:35.461133 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f1ddadf2-8a01-49e5-a099-b192f793a36d-scripts\") pod \"cinder-api-0\" (UID: \"f1ddadf2-8a01-49e5-a099-b192f793a36d\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:27:35 crc kubenswrapper[5120]: I0316 16:27:35.461205 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/f1ddadf2-8a01-49e5-a099-b192f793a36d-config-data-custom\") pod \"cinder-api-0\" (UID: \"f1ddadf2-8a01-49e5-a099-b192f793a36d\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:27:35 crc kubenswrapper[5120]: I0316 16:27:35.461294 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/f1ddadf2-8a01-49e5-a099-b192f793a36d-etc-machine-id\") pod \"cinder-api-0\" (UID: \"f1ddadf2-8a01-49e5-a099-b192f793a36d\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:27:35 crc kubenswrapper[5120]: I0316 16:27:35.461351 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f1ddadf2-8a01-49e5-a099-b192f793a36d-config-data\") pod \"cinder-api-0\" (UID: \"f1ddadf2-8a01-49e5-a099-b192f793a36d\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:27:35 crc kubenswrapper[5120]: I0316 16:27:35.461421 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f1ddadf2-8a01-49e5-a099-b192f793a36d-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"f1ddadf2-8a01-49e5-a099-b192f793a36d\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:27:35 crc kubenswrapper[5120]: I0316 16:27:35.461478 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f1ddadf2-8a01-49e5-a099-b192f793a36d-public-tls-certs\") pod \"cinder-api-0\" (UID: \"f1ddadf2-8a01-49e5-a099-b192f793a36d\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:27:35 crc kubenswrapper[5120]: I0316 16:27:35.461509 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f1ddadf2-8a01-49e5-a099-b192f793a36d-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"f1ddadf2-8a01-49e5-a099-b192f793a36d\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:27:35 crc kubenswrapper[5120]: I0316 16:27:35.461537 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f1ddadf2-8a01-49e5-a099-b192f793a36d-logs\") pod \"cinder-api-0\" (UID: \"f1ddadf2-8a01-49e5-a099-b192f793a36d\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:27:35 crc kubenswrapper[5120]: I0316 16:27:35.461542 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/f1ddadf2-8a01-49e5-a099-b192f793a36d-etc-machine-id\") pod \"cinder-api-0\" (UID: \"f1ddadf2-8a01-49e5-a099-b192f793a36d\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:27:35 crc kubenswrapper[5120]: I0316 16:27:35.461597 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5xdrr\" (UniqueName: \"kubernetes.io/projected/f1ddadf2-8a01-49e5-a099-b192f793a36d-kube-api-access-5xdrr\") pod \"cinder-api-0\" (UID: \"f1ddadf2-8a01-49e5-a099-b192f793a36d\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:27:35 crc kubenswrapper[5120]: I0316 16:27:35.462098 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f1ddadf2-8a01-49e5-a099-b192f793a36d-logs\") pod \"cinder-api-0\" (UID: \"f1ddadf2-8a01-49e5-a099-b192f793a36d\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:27:35 crc kubenswrapper[5120]: I0316 16:27:35.466198 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f1ddadf2-8a01-49e5-a099-b192f793a36d-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"f1ddadf2-8a01-49e5-a099-b192f793a36d\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:27:35 crc kubenswrapper[5120]: I0316 16:27:35.466217 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f1ddadf2-8a01-49e5-a099-b192f793a36d-scripts\") pod \"cinder-api-0\" (UID: \"f1ddadf2-8a01-49e5-a099-b192f793a36d\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:27:35 crc kubenswrapper[5120]: I0316 16:27:35.466551 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/f1ddadf2-8a01-49e5-a099-b192f793a36d-config-data-custom\") pod \"cinder-api-0\" (UID: \"f1ddadf2-8a01-49e5-a099-b192f793a36d\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:27:35 crc kubenswrapper[5120]: I0316 16:27:35.468659 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f1ddadf2-8a01-49e5-a099-b192f793a36d-config-data\") pod \"cinder-api-0\" (UID: \"f1ddadf2-8a01-49e5-a099-b192f793a36d\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:27:35 crc kubenswrapper[5120]: I0316 16:27:35.468939 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f1ddadf2-8a01-49e5-a099-b192f793a36d-public-tls-certs\") pod \"cinder-api-0\" (UID: \"f1ddadf2-8a01-49e5-a099-b192f793a36d\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:27:35 crc kubenswrapper[5120]: I0316 16:27:35.471363 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f1ddadf2-8a01-49e5-a099-b192f793a36d-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"f1ddadf2-8a01-49e5-a099-b192f793a36d\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:27:35 crc kubenswrapper[5120]: I0316 16:27:35.501238 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xdrr\" (UniqueName: \"kubernetes.io/projected/f1ddadf2-8a01-49e5-a099-b192f793a36d-kube-api-access-5xdrr\") pod \"cinder-api-0\" (UID: \"f1ddadf2-8a01-49e5-a099-b192f793a36d\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:27:35 crc kubenswrapper[5120]: I0316 16:27:35.606680 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:27:35 crc kubenswrapper[5120]: I0316 16:27:35.787155 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 16:27:35 crc kubenswrapper[5120]: I0316 16:27:35.803019 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Mar 16 16:27:35 crc kubenswrapper[5120]: I0316 16:27:35.805751 5120 status_manager.go:895] "Failed to get status for pod" podUID="afb67b47-e1d3-4ea3-af19-cf9e2d74e230" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 16:27:35 crc kubenswrapper[5120]: E0316 16:27:35.805839 5120 reflector.go:200] "Failed to watch" err="failed to list *v1.Secret: secrets \"openstackclient-openstackclient-dockercfg-kg8jf\" is forbidden: User \"system:node:crc\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" logger="UnhandledError" reflector="object-\"openstack-kuttl-tests\"/\"openstackclient-openstackclient-dockercfg-kg8jf\"" type="*v1.Secret" Mar 16 16:27:35 crc kubenswrapper[5120]: E0316 16:27:35.805904 5120 reflector.go:200] "Failed to watch" err="failed to list *v1.Secret: secrets \"openstack-config-secret\" is forbidden: User \"system:node:crc\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" logger="UnhandledError" reflector="object-\"openstack-kuttl-tests\"/\"openstack-config-secret\"" type="*v1.Secret" Mar 16 16:27:35 crc kubenswrapper[5120]: E0316 16:27:35.806061 5120 reflector.go:200] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openstack-config\" is forbidden: User \"system:node:crc\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" logger="UnhandledError" reflector="object-\"openstack-kuttl-tests\"/\"openstack-config\"" type="*v1.ConfigMap" Mar 16 16:27:35 crc kubenswrapper[5120]: I0316 16:27:35.828233 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 16:27:35 crc kubenswrapper[5120]: I0316 16:27:35.842446 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 16:27:35 crc kubenswrapper[5120]: E0316 16:27:35.843466 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[combined-ca-bundle kube-api-access-pgbk4 openstack-config openstack-config-secret], unattached volumes=[], failed to process volumes=[combined-ca-bundle kube-api-access-pgbk4 openstack-config openstack-config-secret]: context canceled" pod="openstack-kuttl-tests/openstackclient" podUID="afb67b47-e1d3-4ea3-af19-cf9e2d74e230" Mar 16 16:27:35 crc kubenswrapper[5120]: I0316 16:27:35.854663 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 16:27:35 crc kubenswrapper[5120]: I0316 16:27:35.863574 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 16:27:35 crc kubenswrapper[5120]: I0316 16:27:35.868946 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Mar 16 16:27:35 crc kubenswrapper[5120]: I0316 16:27:35.881521 5120 status_manager.go:905] "Pod was deleted and then recreated, skipping status update" pod="openstack-kuttl-tests/openstackclient" oldPodUID="afb67b47-e1d3-4ea3-af19-cf9e2d74e230" podUID="5456036b-4cdb-4d1a-9b60-d0effc293043" Mar 16 16:27:35 crc kubenswrapper[5120]: I0316 16:27:35.891741 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 16:27:35 crc kubenswrapper[5120]: I0316 16:27:35.927720 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Mar 16 16:27:35 crc kubenswrapper[5120]: I0316 16:27:35.934135 5120 status_manager.go:905] "Pod was deleted and then recreated, skipping status update" pod="openstack-kuttl-tests/openstackclient" oldPodUID="afb67b47-e1d3-4ea3-af19-cf9e2d74e230" podUID="5456036b-4cdb-4d1a-9b60-d0effc293043" Mar 16 16:27:35 crc kubenswrapper[5120]: I0316 16:27:35.939702 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Mar 16 16:27:35 crc kubenswrapper[5120]: I0316 16:27:35.942003 5120 status_manager.go:905] "Pod was deleted and then recreated, skipping status update" pod="openstack-kuttl-tests/openstackclient" oldPodUID="afb67b47-e1d3-4ea3-af19-cf9e2d74e230" podUID="5456036b-4cdb-4d1a-9b60-d0effc293043" Mar 16 16:27:35 crc kubenswrapper[5120]: I0316 16:27:35.990998 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/5456036b-4cdb-4d1a-9b60-d0effc293043-openstack-config-secret\") pod \"openstackclient\" (UID: \"5456036b-4cdb-4d1a-9b60-d0effc293043\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:27:35 crc kubenswrapper[5120]: I0316 16:27:35.991101 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5456036b-4cdb-4d1a-9b60-d0effc293043-combined-ca-bundle\") pod \"openstackclient\" (UID: \"5456036b-4cdb-4d1a-9b60-d0effc293043\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:27:35 crc kubenswrapper[5120]: I0316 16:27:35.991641 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/5456036b-4cdb-4d1a-9b60-d0effc293043-openstack-config\") pod \"openstackclient\" (UID: \"5456036b-4cdb-4d1a-9b60-d0effc293043\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:27:35 crc kubenswrapper[5120]: I0316 16:27:35.991688 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4cgzk\" (UniqueName: \"kubernetes.io/projected/5456036b-4cdb-4d1a-9b60-d0effc293043-kube-api-access-4cgzk\") pod \"openstackclient\" (UID: \"5456036b-4cdb-4d1a-9b60-d0effc293043\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:27:36 crc kubenswrapper[5120]: I0316 16:27:36.093350 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/5456036b-4cdb-4d1a-9b60-d0effc293043-openstack-config\") pod \"openstackclient\" (UID: \"5456036b-4cdb-4d1a-9b60-d0effc293043\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:27:36 crc kubenswrapper[5120]: I0316 16:27:36.093407 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4cgzk\" (UniqueName: \"kubernetes.io/projected/5456036b-4cdb-4d1a-9b60-d0effc293043-kube-api-access-4cgzk\") pod \"openstackclient\" (UID: \"5456036b-4cdb-4d1a-9b60-d0effc293043\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:27:36 crc kubenswrapper[5120]: I0316 16:27:36.093599 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/5456036b-4cdb-4d1a-9b60-d0effc293043-openstack-config-secret\") pod \"openstackclient\" (UID: \"5456036b-4cdb-4d1a-9b60-d0effc293043\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:27:36 crc kubenswrapper[5120]: I0316 16:27:36.093639 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5456036b-4cdb-4d1a-9b60-d0effc293043-combined-ca-bundle\") pod \"openstackclient\" (UID: \"5456036b-4cdb-4d1a-9b60-d0effc293043\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:27:36 crc kubenswrapper[5120]: I0316 16:27:36.098999 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5456036b-4cdb-4d1a-9b60-d0effc293043-combined-ca-bundle\") pod \"openstackclient\" (UID: \"5456036b-4cdb-4d1a-9b60-d0effc293043\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:27:36 crc kubenswrapper[5120]: I0316 16:27:36.119826 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4cgzk\" (UniqueName: \"kubernetes.io/projected/5456036b-4cdb-4d1a-9b60-d0effc293043-kube-api-access-4cgzk\") pod \"openstackclient\" (UID: \"5456036b-4cdb-4d1a-9b60-d0effc293043\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:27:36 crc kubenswrapper[5120]: I0316 16:27:36.176787 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:27:36 crc kubenswrapper[5120]: W0316 16:27:36.178118 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf1ddadf2_8a01_49e5_a099_b192f793a36d.slice/crio-d7a0097b76c0b0ade46d85ff632a9adc2e1fe222399cb858a61cd6cecf7e4ecb WatchSource:0}: Error finding container d7a0097b76c0b0ade46d85ff632a9adc2e1fe222399cb858a61cd6cecf7e4ecb: Status 404 returned error can't find the container with id d7a0097b76c0b0ade46d85ff632a9adc2e1fe222399cb858a61cd6cecf7e4ecb Mar 16 16:27:36 crc kubenswrapper[5120]: I0316 16:27:36.677851 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="afb67b47-e1d3-4ea3-af19-cf9e2d74e230" path="/var/lib/kubelet/pods/afb67b47-e1d3-4ea3-af19-cf9e2d74e230/volumes" Mar 16 16:27:36 crc kubenswrapper[5120]: I0316 16:27:36.678718 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dcb14165-880d-48a0-bb00-5061b8aa1a4b" path="/var/lib/kubelet/pods/dcb14165-880d-48a0-bb00-5061b8aa1a4b/volumes" Mar 16 16:27:36 crc kubenswrapper[5120]: I0316 16:27:36.687191 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"openstack-config-secret\"" Mar 16 16:27:36 crc kubenswrapper[5120]: I0316 16:27:36.700484 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/5456036b-4cdb-4d1a-9b60-d0effc293043-openstack-config-secret\") pod \"openstackclient\" (UID: \"5456036b-4cdb-4d1a-9b60-d0effc293043\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:27:36 crc kubenswrapper[5120]: I0316 16:27:36.945351 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Mar 16 16:27:36 crc kubenswrapper[5120]: I0316 16:27:36.946271 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"f1ddadf2-8a01-49e5-a099-b192f793a36d","Type":"ContainerStarted","Data":"d7a0097b76c0b0ade46d85ff632a9adc2e1fe222399cb858a61cd6cecf7e4ecb"} Mar 16 16:27:36 crc kubenswrapper[5120]: I0316 16:27:36.949850 5120 status_manager.go:905] "Pod was deleted and then recreated, skipping status update" pod="openstack-kuttl-tests/openstackclient" oldPodUID="afb67b47-e1d3-4ea3-af19-cf9e2d74e230" podUID="5456036b-4cdb-4d1a-9b60-d0effc293043" Mar 16 16:27:36 crc kubenswrapper[5120]: I0316 16:27:36.966264 5120 status_manager.go:905] "Pod was deleted and then recreated, skipping status update" pod="openstack-kuttl-tests/openstackclient" oldPodUID="afb67b47-e1d3-4ea3-af19-cf9e2d74e230" podUID="5456036b-4cdb-4d1a-9b60-d0effc293043" Mar 16 16:27:37 crc kubenswrapper[5120]: I0316 16:27:37.081335 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-config\"" Mar 16 16:27:37 crc kubenswrapper[5120]: I0316 16:27:37.084660 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/5456036b-4cdb-4d1a-9b60-d0effc293043-openstack-config\") pod \"openstackclient\" (UID: \"5456036b-4cdb-4d1a-9b60-d0effc293043\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:27:37 crc kubenswrapper[5120]: I0316 16:27:37.182473 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"openstackclient-openstackclient-dockercfg-kg8jf\"" Mar 16 16:27:37 crc kubenswrapper[5120]: I0316 16:27:37.183722 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Mar 16 16:27:37 crc kubenswrapper[5120]: I0316 16:27:37.663526 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 16:27:37 crc kubenswrapper[5120]: W0316 16:27:37.670462 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5456036b_4cdb_4d1a_9b60_d0effc293043.slice/crio-c7377cb6bb8c68bd17040b4559d5fa85b3a1bd36e865a504e4616d43afa78d04 WatchSource:0}: Error finding container c7377cb6bb8c68bd17040b4559d5fa85b3a1bd36e865a504e4616d43afa78d04: Status 404 returned error can't find the container with id c7377cb6bb8c68bd17040b4559d5fa85b3a1bd36e865a504e4616d43afa78d04 Mar 16 16:27:37 crc kubenswrapper[5120]: I0316 16:27:37.957605 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"f1ddadf2-8a01-49e5-a099-b192f793a36d","Type":"ContainerStarted","Data":"e96e5c721f9e1b4574a1448d5ba3da2db4cdf652e79ca865a8776a290e9a0553"} Mar 16 16:27:37 crc kubenswrapper[5120]: I0316 16:27:37.957955 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"f1ddadf2-8a01-49e5-a099-b192f793a36d","Type":"ContainerStarted","Data":"20a146198364dd3bab31073def314ae19daec57fd0b0b0ae40a65386d19d3bd0"} Mar 16 16:27:37 crc kubenswrapper[5120]: I0316 16:27:37.957980 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:27:37 crc kubenswrapper[5120]: I0316 16:27:37.961155 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstackclient" event={"ID":"5456036b-4cdb-4d1a-9b60-d0effc293043","Type":"ContainerStarted","Data":"b0827a3b77f1f888901fc0c03daaa68e9b8ae643846cc4a639bc12495d1f5f47"} Mar 16 16:27:37 crc kubenswrapper[5120]: I0316 16:27:37.961187 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstackclient" event={"ID":"5456036b-4cdb-4d1a-9b60-d0effc293043","Type":"ContainerStarted","Data":"c7377cb6bb8c68bd17040b4559d5fa85b3a1bd36e865a504e4616d43afa78d04"} Mar 16 16:27:37 crc kubenswrapper[5120]: I0316 16:27:37.978051 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-api-0" podStartSLOduration=2.978035041 podStartE2EDuration="2.978035041s" podCreationTimestamp="2026-03-16 16:27:35 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:27:37.976569272 +0000 UTC m=+3360.130500929" watchObservedRunningTime="2026-03-16 16:27:37.978035041 +0000 UTC m=+3360.131966688" Mar 16 16:27:37 crc kubenswrapper[5120]: I0316 16:27:37.996851 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstackclient" podStartSLOduration=2.996831814 podStartE2EDuration="2.996831814s" podCreationTimestamp="2026-03-16 16:27:35 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:27:37.991991745 +0000 UTC m=+3360.145923402" watchObservedRunningTime="2026-03-16 16:27:37.996831814 +0000 UTC m=+3360.150763471" Mar 16 16:27:40 crc kubenswrapper[5120]: I0316 16:27:40.349990 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:27:41 crc kubenswrapper[5120]: I0316 16:27:41.124212 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:27:41 crc kubenswrapper[5120]: I0316 16:27:41.124969 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="e4bad0fb-46f9-4865-a897-c30da4fa8ffc" containerName="ceilometer-central-agent" containerID="cri-o://55e26e26cad1abefe9b7fb7057d8919fe5be21a3e7ef711fcade2da4e30ae1cb" gracePeriod=30 Mar 16 16:27:41 crc kubenswrapper[5120]: I0316 16:27:41.125087 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="e4bad0fb-46f9-4865-a897-c30da4fa8ffc" containerName="ceilometer-notification-agent" containerID="cri-o://40441b8a582506e4f6bf4812c949b58c4f3c22bfbe65770287d19c52b316caf4" gracePeriod=30 Mar 16 16:27:41 crc kubenswrapper[5120]: I0316 16:27:41.125081 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="e4bad0fb-46f9-4865-a897-c30da4fa8ffc" containerName="proxy-httpd" containerID="cri-o://b16383c70508646ab1611bdfed8758a7e6a61c8ffe20cff415dbcbb996dbf937" gracePeriod=30 Mar 16 16:27:41 crc kubenswrapper[5120]: I0316 16:27:41.125081 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="e4bad0fb-46f9-4865-a897-c30da4fa8ffc" containerName="sg-core" containerID="cri-o://9aea5d08c763b9963d50f97a99cae4377f76e8477e66152b6d28e85ebfc2c346" gracePeriod=30 Mar 16 16:27:41 crc kubenswrapper[5120]: I0316 16:27:41.387250 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-z6jpd"] Mar 16 16:27:41 crc kubenswrapper[5120]: I0316 16:27:41.397893 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-db-create-z6jpd" Mar 16 16:27:41 crc kubenswrapper[5120]: I0316 16:27:41.413075 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-z6jpd"] Mar 16 16:27:41 crc kubenswrapper[5120]: I0316 16:27:41.524562 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-4fxk5"] Mar 16 16:27:41 crc kubenswrapper[5120]: I0316 16:27:41.531617 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-db-create-4fxk5" Mar 16 16:27:41 crc kubenswrapper[5120]: I0316 16:27:41.545988 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-4fxk5"] Mar 16 16:27:41 crc kubenswrapper[5120]: I0316 16:27:41.556149 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/06d95d7b-0750-49bf-b877-8f94a33ef71d-operator-scripts\") pod \"nova-api-db-create-z6jpd\" (UID: \"06d95d7b-0750-49bf-b877-8f94a33ef71d\") " pod="openstack-kuttl-tests/nova-api-db-create-z6jpd" Mar 16 16:27:41 crc kubenswrapper[5120]: I0316 16:27:41.556628 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w827j\" (UniqueName: \"kubernetes.io/projected/06d95d7b-0750-49bf-b877-8f94a33ef71d-kube-api-access-w827j\") pod \"nova-api-db-create-z6jpd\" (UID: \"06d95d7b-0750-49bf-b877-8f94a33ef71d\") " pod="openstack-kuttl-tests/nova-api-db-create-z6jpd" Mar 16 16:27:41 crc kubenswrapper[5120]: I0316 16:27:41.662170 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/06d95d7b-0750-49bf-b877-8f94a33ef71d-operator-scripts\") pod \"nova-api-db-create-z6jpd\" (UID: \"06d95d7b-0750-49bf-b877-8f94a33ef71d\") " pod="openstack-kuttl-tests/nova-api-db-create-z6jpd" Mar 16 16:27:41 crc kubenswrapper[5120]: I0316 16:27:41.662669 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w827j\" (UniqueName: \"kubernetes.io/projected/06d95d7b-0750-49bf-b877-8f94a33ef71d-kube-api-access-w827j\") pod \"nova-api-db-create-z6jpd\" (UID: \"06d95d7b-0750-49bf-b877-8f94a33ef71d\") " pod="openstack-kuttl-tests/nova-api-db-create-z6jpd" Mar 16 16:27:41 crc kubenswrapper[5120]: I0316 16:27:41.662738 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8pgm\" (UniqueName: \"kubernetes.io/projected/a9e8e595-2161-4919-89fa-98913dc78df6-kube-api-access-g8pgm\") pod \"nova-cell0-db-create-4fxk5\" (UID: \"a9e8e595-2161-4919-89fa-98913dc78df6\") " pod="openstack-kuttl-tests/nova-cell0-db-create-4fxk5" Mar 16 16:27:41 crc kubenswrapper[5120]: I0316 16:27:41.662819 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a9e8e595-2161-4919-89fa-98913dc78df6-operator-scripts\") pod \"nova-cell0-db-create-4fxk5\" (UID: \"a9e8e595-2161-4919-89fa-98913dc78df6\") " pod="openstack-kuttl-tests/nova-cell0-db-create-4fxk5" Mar 16 16:27:41 crc kubenswrapper[5120]: I0316 16:27:41.664403 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/06d95d7b-0750-49bf-b877-8f94a33ef71d-operator-scripts\") pod \"nova-api-db-create-z6jpd\" (UID: \"06d95d7b-0750-49bf-b877-8f94a33ef71d\") " pod="openstack-kuttl-tests/nova-api-db-create-z6jpd" Mar 16 16:27:41 crc kubenswrapper[5120]: I0316 16:27:41.699480 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w827j\" (UniqueName: \"kubernetes.io/projected/06d95d7b-0750-49bf-b877-8f94a33ef71d-kube-api-access-w827j\") pod \"nova-api-db-create-z6jpd\" (UID: \"06d95d7b-0750-49bf-b877-8f94a33ef71d\") " pod="openstack-kuttl-tests/nova-api-db-create-z6jpd" Mar 16 16:27:41 crc kubenswrapper[5120]: I0316 16:27:41.717559 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-db-create-z6jpd" Mar 16 16:27:41 crc kubenswrapper[5120]: I0316 16:27:41.719855 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-xpjdr"] Mar 16 16:27:41 crc kubenswrapper[5120]: I0316 16:27:41.729840 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-db-create-xpjdr" Mar 16 16:27:41 crc kubenswrapper[5120]: I0316 16:27:41.764823 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-d7e4-account-create-update-7b8tk"] Mar 16 16:27:41 crc kubenswrapper[5120]: I0316 16:27:41.765654 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g8pgm\" (UniqueName: \"kubernetes.io/projected/a9e8e595-2161-4919-89fa-98913dc78df6-kube-api-access-g8pgm\") pod \"nova-cell0-db-create-4fxk5\" (UID: \"a9e8e595-2161-4919-89fa-98913dc78df6\") " pod="openstack-kuttl-tests/nova-cell0-db-create-4fxk5" Mar 16 16:27:41 crc kubenswrapper[5120]: I0316 16:27:41.766078 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a9e8e595-2161-4919-89fa-98913dc78df6-operator-scripts\") pod \"nova-cell0-db-create-4fxk5\" (UID: \"a9e8e595-2161-4919-89fa-98913dc78df6\") " pod="openstack-kuttl-tests/nova-cell0-db-create-4fxk5" Mar 16 16:27:41 crc kubenswrapper[5120]: I0316 16:27:41.767805 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a9e8e595-2161-4919-89fa-98913dc78df6-operator-scripts\") pod \"nova-cell0-db-create-4fxk5\" (UID: \"a9e8e595-2161-4919-89fa-98913dc78df6\") " pod="openstack-kuttl-tests/nova-cell0-db-create-4fxk5" Mar 16 16:27:41 crc kubenswrapper[5120]: I0316 16:27:41.788258 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8pgm\" (UniqueName: \"kubernetes.io/projected/a9e8e595-2161-4919-89fa-98913dc78df6-kube-api-access-g8pgm\") pod \"nova-cell0-db-create-4fxk5\" (UID: \"a9e8e595-2161-4919-89fa-98913dc78df6\") " pod="openstack-kuttl-tests/nova-cell0-db-create-4fxk5" Mar 16 16:27:41 crc kubenswrapper[5120]: I0316 16:27:41.802937 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-xpjdr"] Mar 16 16:27:41 crc kubenswrapper[5120]: I0316 16:27:41.803093 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-d7e4-account-create-update-7b8tk" Mar 16 16:27:41 crc kubenswrapper[5120]: I0316 16:27:41.807506 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-db-secret\"" Mar 16 16:27:41 crc kubenswrapper[5120]: I0316 16:27:41.810175 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-d7e4-account-create-update-7b8tk"] Mar 16 16:27:41 crc kubenswrapper[5120]: I0316 16:27:41.853981 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-db-create-4fxk5" Mar 16 16:27:41 crc kubenswrapper[5120]: I0316 16:27:41.870905 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5xkd\" (UniqueName: \"kubernetes.io/projected/f45bc0f5-319a-407a-b329-ebad473733f6-kube-api-access-r5xkd\") pod \"nova-cell1-db-create-xpjdr\" (UID: \"f45bc0f5-319a-407a-b329-ebad473733f6\") " pod="openstack-kuttl-tests/nova-cell1-db-create-xpjdr" Mar 16 16:27:41 crc kubenswrapper[5120]: I0316 16:27:41.871068 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f45bc0f5-319a-407a-b329-ebad473733f6-operator-scripts\") pod \"nova-cell1-db-create-xpjdr\" (UID: \"f45bc0f5-319a-407a-b329-ebad473733f6\") " pod="openstack-kuttl-tests/nova-cell1-db-create-xpjdr" Mar 16 16:27:41 crc kubenswrapper[5120]: I0316 16:27:41.976811 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jpsfl\" (UniqueName: \"kubernetes.io/projected/c7086f4e-6b79-4162-874b-4c7cd36c1ae2-kube-api-access-jpsfl\") pod \"nova-api-d7e4-account-create-update-7b8tk\" (UID: \"c7086f4e-6b79-4162-874b-4c7cd36c1ae2\") " pod="openstack-kuttl-tests/nova-api-d7e4-account-create-update-7b8tk" Mar 16 16:27:41 crc kubenswrapper[5120]: I0316 16:27:41.977196 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c7086f4e-6b79-4162-874b-4c7cd36c1ae2-operator-scripts\") pod \"nova-api-d7e4-account-create-update-7b8tk\" (UID: \"c7086f4e-6b79-4162-874b-4c7cd36c1ae2\") " pod="openstack-kuttl-tests/nova-api-d7e4-account-create-update-7b8tk" Mar 16 16:27:41 crc kubenswrapper[5120]: I0316 16:27:41.977348 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r5xkd\" (UniqueName: \"kubernetes.io/projected/f45bc0f5-319a-407a-b329-ebad473733f6-kube-api-access-r5xkd\") pod \"nova-cell1-db-create-xpjdr\" (UID: \"f45bc0f5-319a-407a-b329-ebad473733f6\") " pod="openstack-kuttl-tests/nova-cell1-db-create-xpjdr" Mar 16 16:27:41 crc kubenswrapper[5120]: I0316 16:27:41.977383 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f45bc0f5-319a-407a-b329-ebad473733f6-operator-scripts\") pod \"nova-cell1-db-create-xpjdr\" (UID: \"f45bc0f5-319a-407a-b329-ebad473733f6\") " pod="openstack-kuttl-tests/nova-cell1-db-create-xpjdr" Mar 16 16:27:41 crc kubenswrapper[5120]: I0316 16:27:41.978531 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f45bc0f5-319a-407a-b329-ebad473733f6-operator-scripts\") pod \"nova-cell1-db-create-xpjdr\" (UID: \"f45bc0f5-319a-407a-b329-ebad473733f6\") " pod="openstack-kuttl-tests/nova-cell1-db-create-xpjdr" Mar 16 16:27:41 crc kubenswrapper[5120]: I0316 16:27:41.986833 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-af27-account-create-update-glkjg"] Mar 16 16:27:41 crc kubenswrapper[5120]: I0316 16:27:41.993262 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-af27-account-create-update-glkjg" Mar 16 16:27:41 crc kubenswrapper[5120]: I0316 16:27:41.995788 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-db-secret\"" Mar 16 16:27:42 crc kubenswrapper[5120]: I0316 16:27:42.007805 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5xkd\" (UniqueName: \"kubernetes.io/projected/f45bc0f5-319a-407a-b329-ebad473733f6-kube-api-access-r5xkd\") pod \"nova-cell1-db-create-xpjdr\" (UID: \"f45bc0f5-319a-407a-b329-ebad473733f6\") " pod="openstack-kuttl-tests/nova-cell1-db-create-xpjdr" Mar 16 16:27:42 crc kubenswrapper[5120]: I0316 16:27:42.039673 5120 generic.go:358] "Generic (PLEG): container finished" podID="e4bad0fb-46f9-4865-a897-c30da4fa8ffc" containerID="b16383c70508646ab1611bdfed8758a7e6a61c8ffe20cff415dbcbb996dbf937" exitCode=0 Mar 16 16:27:42 crc kubenswrapper[5120]: I0316 16:27:42.039700 5120 generic.go:358] "Generic (PLEG): container finished" podID="e4bad0fb-46f9-4865-a897-c30da4fa8ffc" containerID="9aea5d08c763b9963d50f97a99cae4377f76e8477e66152b6d28e85ebfc2c346" exitCode=2 Mar 16 16:27:42 crc kubenswrapper[5120]: I0316 16:27:42.039707 5120 generic.go:358] "Generic (PLEG): container finished" podID="e4bad0fb-46f9-4865-a897-c30da4fa8ffc" containerID="55e26e26cad1abefe9b7fb7057d8919fe5be21a3e7ef711fcade2da4e30ae1cb" exitCode=0 Mar 16 16:27:42 crc kubenswrapper[5120]: I0316 16:27:42.039741 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"e4bad0fb-46f9-4865-a897-c30da4fa8ffc","Type":"ContainerDied","Data":"b16383c70508646ab1611bdfed8758a7e6a61c8ffe20cff415dbcbb996dbf937"} Mar 16 16:27:42 crc kubenswrapper[5120]: I0316 16:27:42.039813 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"e4bad0fb-46f9-4865-a897-c30da4fa8ffc","Type":"ContainerDied","Data":"9aea5d08c763b9963d50f97a99cae4377f76e8477e66152b6d28e85ebfc2c346"} Mar 16 16:27:42 crc kubenswrapper[5120]: I0316 16:27:42.039826 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"e4bad0fb-46f9-4865-a897-c30da4fa8ffc","Type":"ContainerDied","Data":"55e26e26cad1abefe9b7fb7057d8919fe5be21a3e7ef711fcade2da4e30ae1cb"} Mar 16 16:27:42 crc kubenswrapper[5120]: I0316 16:27:42.040988 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-af27-account-create-update-glkjg"] Mar 16 16:27:42 crc kubenswrapper[5120]: I0316 16:27:42.080673 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2bqm\" (UniqueName: \"kubernetes.io/projected/b11f89f6-cba8-4f94-ac51-8f4d514e54fb-kube-api-access-d2bqm\") pod \"nova-cell0-af27-account-create-update-glkjg\" (UID: \"b11f89f6-cba8-4f94-ac51-8f4d514e54fb\") " pod="openstack-kuttl-tests/nova-cell0-af27-account-create-update-glkjg" Mar 16 16:27:42 crc kubenswrapper[5120]: I0316 16:27:42.080821 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jpsfl\" (UniqueName: \"kubernetes.io/projected/c7086f4e-6b79-4162-874b-4c7cd36c1ae2-kube-api-access-jpsfl\") pod \"nova-api-d7e4-account-create-update-7b8tk\" (UID: \"c7086f4e-6b79-4162-874b-4c7cd36c1ae2\") " pod="openstack-kuttl-tests/nova-api-d7e4-account-create-update-7b8tk" Mar 16 16:27:42 crc kubenswrapper[5120]: I0316 16:27:42.080906 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b11f89f6-cba8-4f94-ac51-8f4d514e54fb-operator-scripts\") pod \"nova-cell0-af27-account-create-update-glkjg\" (UID: \"b11f89f6-cba8-4f94-ac51-8f4d514e54fb\") " pod="openstack-kuttl-tests/nova-cell0-af27-account-create-update-glkjg" Mar 16 16:27:42 crc kubenswrapper[5120]: I0316 16:27:42.081015 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c7086f4e-6b79-4162-874b-4c7cd36c1ae2-operator-scripts\") pod \"nova-api-d7e4-account-create-update-7b8tk\" (UID: \"c7086f4e-6b79-4162-874b-4c7cd36c1ae2\") " pod="openstack-kuttl-tests/nova-api-d7e4-account-create-update-7b8tk" Mar 16 16:27:42 crc kubenswrapper[5120]: I0316 16:27:42.082084 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c7086f4e-6b79-4162-874b-4c7cd36c1ae2-operator-scripts\") pod \"nova-api-d7e4-account-create-update-7b8tk\" (UID: \"c7086f4e-6b79-4162-874b-4c7cd36c1ae2\") " pod="openstack-kuttl-tests/nova-api-d7e4-account-create-update-7b8tk" Mar 16 16:27:42 crc kubenswrapper[5120]: I0316 16:27:42.087731 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-5b46-account-create-update-2448q"] Mar 16 16:27:42 crc kubenswrapper[5120]: I0316 16:27:42.095799 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-5b46-account-create-update-2448q" Mar 16 16:27:42 crc kubenswrapper[5120]: I0316 16:27:42.097179 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-5b46-account-create-update-2448q"] Mar 16 16:27:42 crc kubenswrapper[5120]: I0316 16:27:42.098207 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-db-secret\"" Mar 16 16:27:42 crc kubenswrapper[5120]: I0316 16:27:42.100120 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jpsfl\" (UniqueName: \"kubernetes.io/projected/c7086f4e-6b79-4162-874b-4c7cd36c1ae2-kube-api-access-jpsfl\") pod \"nova-api-d7e4-account-create-update-7b8tk\" (UID: \"c7086f4e-6b79-4162-874b-4c7cd36c1ae2\") " pod="openstack-kuttl-tests/nova-api-d7e4-account-create-update-7b8tk" Mar 16 16:27:42 crc kubenswrapper[5120]: I0316 16:27:42.157039 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-db-create-xpjdr" Mar 16 16:27:42 crc kubenswrapper[5120]: I0316 16:27:42.168051 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-d7e4-account-create-update-7b8tk" Mar 16 16:27:42 crc kubenswrapper[5120]: I0316 16:27:42.183630 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d2bqm\" (UniqueName: \"kubernetes.io/projected/b11f89f6-cba8-4f94-ac51-8f4d514e54fb-kube-api-access-d2bqm\") pod \"nova-cell0-af27-account-create-update-glkjg\" (UID: \"b11f89f6-cba8-4f94-ac51-8f4d514e54fb\") " pod="openstack-kuttl-tests/nova-cell0-af27-account-create-update-glkjg" Mar 16 16:27:42 crc kubenswrapper[5120]: I0316 16:27:42.183797 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gv4km\" (UniqueName: \"kubernetes.io/projected/96781f8d-3ff9-4c6c-a468-67785be1dfd7-kube-api-access-gv4km\") pod \"nova-cell1-5b46-account-create-update-2448q\" (UID: \"96781f8d-3ff9-4c6c-a468-67785be1dfd7\") " pod="openstack-kuttl-tests/nova-cell1-5b46-account-create-update-2448q" Mar 16 16:27:42 crc kubenswrapper[5120]: I0316 16:27:42.183910 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/96781f8d-3ff9-4c6c-a468-67785be1dfd7-operator-scripts\") pod \"nova-cell1-5b46-account-create-update-2448q\" (UID: \"96781f8d-3ff9-4c6c-a468-67785be1dfd7\") " pod="openstack-kuttl-tests/nova-cell1-5b46-account-create-update-2448q" Mar 16 16:27:42 crc kubenswrapper[5120]: I0316 16:27:42.183956 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b11f89f6-cba8-4f94-ac51-8f4d514e54fb-operator-scripts\") pod \"nova-cell0-af27-account-create-update-glkjg\" (UID: \"b11f89f6-cba8-4f94-ac51-8f4d514e54fb\") " pod="openstack-kuttl-tests/nova-cell0-af27-account-create-update-glkjg" Mar 16 16:27:42 crc kubenswrapper[5120]: I0316 16:27:42.185037 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b11f89f6-cba8-4f94-ac51-8f4d514e54fb-operator-scripts\") pod \"nova-cell0-af27-account-create-update-glkjg\" (UID: \"b11f89f6-cba8-4f94-ac51-8f4d514e54fb\") " pod="openstack-kuttl-tests/nova-cell0-af27-account-create-update-glkjg" Mar 16 16:27:42 crc kubenswrapper[5120]: I0316 16:27:42.204029 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2bqm\" (UniqueName: \"kubernetes.io/projected/b11f89f6-cba8-4f94-ac51-8f4d514e54fb-kube-api-access-d2bqm\") pod \"nova-cell0-af27-account-create-update-glkjg\" (UID: \"b11f89f6-cba8-4f94-ac51-8f4d514e54fb\") " pod="openstack-kuttl-tests/nova-cell0-af27-account-create-update-glkjg" Mar 16 16:27:42 crc kubenswrapper[5120]: I0316 16:27:42.293258 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gv4km\" (UniqueName: \"kubernetes.io/projected/96781f8d-3ff9-4c6c-a468-67785be1dfd7-kube-api-access-gv4km\") pod \"nova-cell1-5b46-account-create-update-2448q\" (UID: \"96781f8d-3ff9-4c6c-a468-67785be1dfd7\") " pod="openstack-kuttl-tests/nova-cell1-5b46-account-create-update-2448q" Mar 16 16:27:42 crc kubenswrapper[5120]: I0316 16:27:42.293566 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/96781f8d-3ff9-4c6c-a468-67785be1dfd7-operator-scripts\") pod \"nova-cell1-5b46-account-create-update-2448q\" (UID: \"96781f8d-3ff9-4c6c-a468-67785be1dfd7\") " pod="openstack-kuttl-tests/nova-cell1-5b46-account-create-update-2448q" Mar 16 16:27:42 crc kubenswrapper[5120]: I0316 16:27:42.294419 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/96781f8d-3ff9-4c6c-a468-67785be1dfd7-operator-scripts\") pod \"nova-cell1-5b46-account-create-update-2448q\" (UID: \"96781f8d-3ff9-4c6c-a468-67785be1dfd7\") " pod="openstack-kuttl-tests/nova-cell1-5b46-account-create-update-2448q" Mar 16 16:27:42 crc kubenswrapper[5120]: I0316 16:27:42.302834 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-z6jpd"] Mar 16 16:27:42 crc kubenswrapper[5120]: I0316 16:27:42.321685 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-af27-account-create-update-glkjg" Mar 16 16:27:42 crc kubenswrapper[5120]: I0316 16:27:42.331481 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gv4km\" (UniqueName: \"kubernetes.io/projected/96781f8d-3ff9-4c6c-a468-67785be1dfd7-kube-api-access-gv4km\") pod \"nova-cell1-5b46-account-create-update-2448q\" (UID: \"96781f8d-3ff9-4c6c-a468-67785be1dfd7\") " pod="openstack-kuttl-tests/nova-cell1-5b46-account-create-update-2448q" Mar 16 16:27:42 crc kubenswrapper[5120]: W0316 16:27:42.332411 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod06d95d7b_0750_49bf_b877_8f94a33ef71d.slice/crio-751d86ecddc1510f76aba84886fd22c2023ebb15a8f43485b679d829c29c00a5 WatchSource:0}: Error finding container 751d86ecddc1510f76aba84886fd22c2023ebb15a8f43485b679d829c29c00a5: Status 404 returned error can't find the container with id 751d86ecddc1510f76aba84886fd22c2023ebb15a8f43485b679d829c29c00a5 Mar 16 16:27:42 crc kubenswrapper[5120]: I0316 16:27:42.439794 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-5b46-account-create-update-2448q" Mar 16 16:27:42 crc kubenswrapper[5120]: I0316 16:27:42.454327 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-4fxk5"] Mar 16 16:27:42 crc kubenswrapper[5120]: W0316 16:27:42.511264 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda9e8e595_2161_4919_89fa_98913dc78df6.slice/crio-22d0a40cc257f82c8a84720a7c40120b747eeec7cebfbb10269b76c4125104d6 WatchSource:0}: Error finding container 22d0a40cc257f82c8a84720a7c40120b747eeec7cebfbb10269b76c4125104d6: Status 404 returned error can't find the container with id 22d0a40cc257f82c8a84720a7c40120b747eeec7cebfbb10269b76c4125104d6 Mar 16 16:27:42 crc kubenswrapper[5120]: I0316 16:27:42.553961 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:27:42 crc kubenswrapper[5120]: I0316 16:27:42.709309 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e4bad0fb-46f9-4865-a897-c30da4fa8ffc-combined-ca-bundle\") pod \"e4bad0fb-46f9-4865-a897-c30da4fa8ffc\" (UID: \"e4bad0fb-46f9-4865-a897-c30da4fa8ffc\") " Mar 16 16:27:42 crc kubenswrapper[5120]: I0316 16:27:42.709706 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e4bad0fb-46f9-4865-a897-c30da4fa8ffc-log-httpd\") pod \"e4bad0fb-46f9-4865-a897-c30da4fa8ffc\" (UID: \"e4bad0fb-46f9-4865-a897-c30da4fa8ffc\") " Mar 16 16:27:42 crc kubenswrapper[5120]: I0316 16:27:42.710036 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qq9zv\" (UniqueName: \"kubernetes.io/projected/e4bad0fb-46f9-4865-a897-c30da4fa8ffc-kube-api-access-qq9zv\") pod \"e4bad0fb-46f9-4865-a897-c30da4fa8ffc\" (UID: \"e4bad0fb-46f9-4865-a897-c30da4fa8ffc\") " Mar 16 16:27:42 crc kubenswrapper[5120]: I0316 16:27:42.710072 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/e4bad0fb-46f9-4865-a897-c30da4fa8ffc-sg-core-conf-yaml\") pod \"e4bad0fb-46f9-4865-a897-c30da4fa8ffc\" (UID: \"e4bad0fb-46f9-4865-a897-c30da4fa8ffc\") " Mar 16 16:27:42 crc kubenswrapper[5120]: I0316 16:27:42.710327 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e4bad0fb-46f9-4865-a897-c30da4fa8ffc-run-httpd\") pod \"e4bad0fb-46f9-4865-a897-c30da4fa8ffc\" (UID: \"e4bad0fb-46f9-4865-a897-c30da4fa8ffc\") " Mar 16 16:27:42 crc kubenswrapper[5120]: I0316 16:27:42.710390 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e4bad0fb-46f9-4865-a897-c30da4fa8ffc-config-data\") pod \"e4bad0fb-46f9-4865-a897-c30da4fa8ffc\" (UID: \"e4bad0fb-46f9-4865-a897-c30da4fa8ffc\") " Mar 16 16:27:42 crc kubenswrapper[5120]: I0316 16:27:42.710442 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e4bad0fb-46f9-4865-a897-c30da4fa8ffc-scripts\") pod \"e4bad0fb-46f9-4865-a897-c30da4fa8ffc\" (UID: \"e4bad0fb-46f9-4865-a897-c30da4fa8ffc\") " Mar 16 16:27:42 crc kubenswrapper[5120]: I0316 16:27:42.719384 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4bad0fb-46f9-4865-a897-c30da4fa8ffc-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "e4bad0fb-46f9-4865-a897-c30da4fa8ffc" (UID: "e4bad0fb-46f9-4865-a897-c30da4fa8ffc"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:27:42 crc kubenswrapper[5120]: I0316 16:27:42.720111 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4bad0fb-46f9-4865-a897-c30da4fa8ffc-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "e4bad0fb-46f9-4865-a897-c30da4fa8ffc" (UID: "e4bad0fb-46f9-4865-a897-c30da4fa8ffc"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:27:42 crc kubenswrapper[5120]: I0316 16:27:42.733712 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e4bad0fb-46f9-4865-a897-c30da4fa8ffc-kube-api-access-qq9zv" (OuterVolumeSpecName: "kube-api-access-qq9zv") pod "e4bad0fb-46f9-4865-a897-c30da4fa8ffc" (UID: "e4bad0fb-46f9-4865-a897-c30da4fa8ffc"). InnerVolumeSpecName "kube-api-access-qq9zv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:27:42 crc kubenswrapper[5120]: I0316 16:27:42.742034 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e4bad0fb-46f9-4865-a897-c30da4fa8ffc-scripts" (OuterVolumeSpecName: "scripts") pod "e4bad0fb-46f9-4865-a897-c30da4fa8ffc" (UID: "e4bad0fb-46f9-4865-a897-c30da4fa8ffc"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:27:42 crc kubenswrapper[5120]: I0316 16:27:42.770184 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e4bad0fb-46f9-4865-a897-c30da4fa8ffc-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "e4bad0fb-46f9-4865-a897-c30da4fa8ffc" (UID: "e4bad0fb-46f9-4865-a897-c30da4fa8ffc"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:27:42 crc kubenswrapper[5120]: I0316 16:27:42.813966 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e4bad0fb-46f9-4865-a897-c30da4fa8ffc-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:27:42 crc kubenswrapper[5120]: I0316 16:27:42.813989 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e4bad0fb-46f9-4865-a897-c30da4fa8ffc-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:27:42 crc kubenswrapper[5120]: I0316 16:27:42.813998 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e4bad0fb-46f9-4865-a897-c30da4fa8ffc-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:27:42 crc kubenswrapper[5120]: I0316 16:27:42.814006 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qq9zv\" (UniqueName: \"kubernetes.io/projected/e4bad0fb-46f9-4865-a897-c30da4fa8ffc-kube-api-access-qq9zv\") on node \"crc\" DevicePath \"\"" Mar 16 16:27:42 crc kubenswrapper[5120]: I0316 16:27:42.814016 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/e4bad0fb-46f9-4865-a897-c30da4fa8ffc-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 16:27:42 crc kubenswrapper[5120]: I0316 16:27:42.815376 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-xpjdr"] Mar 16 16:27:42 crc kubenswrapper[5120]: I0316 16:27:42.875037 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e4bad0fb-46f9-4865-a897-c30da4fa8ffc-config-data" (OuterVolumeSpecName: "config-data") pod "e4bad0fb-46f9-4865-a897-c30da4fa8ffc" (UID: "e4bad0fb-46f9-4865-a897-c30da4fa8ffc"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:27:42 crc kubenswrapper[5120]: I0316 16:27:42.875493 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e4bad0fb-46f9-4865-a897-c30da4fa8ffc-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e4bad0fb-46f9-4865-a897-c30da4fa8ffc" (UID: "e4bad0fb-46f9-4865-a897-c30da4fa8ffc"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:27:42 crc kubenswrapper[5120]: I0316 16:27:42.929167 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e4bad0fb-46f9-4865-a897-c30da4fa8ffc-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:27:42 crc kubenswrapper[5120]: I0316 16:27:42.929206 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e4bad0fb-46f9-4865-a897-c30da4fa8ffc-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:27:42 crc kubenswrapper[5120]: I0316 16:27:42.947744 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-d7e4-account-create-update-7b8tk"] Mar 16 16:27:43 crc kubenswrapper[5120]: I0316 16:27:43.006907 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/swift-proxy-75575cf5bd-xrtzd"] Mar 16 16:27:43 crc kubenswrapper[5120]: I0316 16:27:43.008046 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4bad0fb-46f9-4865-a897-c30da4fa8ffc" containerName="ceilometer-notification-agent" Mar 16 16:27:43 crc kubenswrapper[5120]: I0316 16:27:43.008066 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4bad0fb-46f9-4865-a897-c30da4fa8ffc" containerName="ceilometer-notification-agent" Mar 16 16:27:43 crc kubenswrapper[5120]: I0316 16:27:43.008092 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4bad0fb-46f9-4865-a897-c30da4fa8ffc" containerName="ceilometer-central-agent" Mar 16 16:27:43 crc kubenswrapper[5120]: I0316 16:27:43.008101 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4bad0fb-46f9-4865-a897-c30da4fa8ffc" containerName="ceilometer-central-agent" Mar 16 16:27:43 crc kubenswrapper[5120]: I0316 16:27:43.008148 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4bad0fb-46f9-4865-a897-c30da4fa8ffc" containerName="sg-core" Mar 16 16:27:43 crc kubenswrapper[5120]: I0316 16:27:43.008153 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4bad0fb-46f9-4865-a897-c30da4fa8ffc" containerName="sg-core" Mar 16 16:27:43 crc kubenswrapper[5120]: I0316 16:27:43.008170 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4bad0fb-46f9-4865-a897-c30da4fa8ffc" containerName="proxy-httpd" Mar 16 16:27:43 crc kubenswrapper[5120]: I0316 16:27:43.008175 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4bad0fb-46f9-4865-a897-c30da4fa8ffc" containerName="proxy-httpd" Mar 16 16:27:43 crc kubenswrapper[5120]: I0316 16:27:43.008765 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e4bad0fb-46f9-4865-a897-c30da4fa8ffc" containerName="proxy-httpd" Mar 16 16:27:43 crc kubenswrapper[5120]: I0316 16:27:43.008779 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e4bad0fb-46f9-4865-a897-c30da4fa8ffc" containerName="ceilometer-notification-agent" Mar 16 16:27:43 crc kubenswrapper[5120]: I0316 16:27:43.008789 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e4bad0fb-46f9-4865-a897-c30da4fa8ffc" containerName="sg-core" Mar 16 16:27:43 crc kubenswrapper[5120]: I0316 16:27:43.008812 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e4bad0fb-46f9-4865-a897-c30da4fa8ffc" containerName="ceilometer-central-agent" Mar 16 16:27:43 crc kubenswrapper[5120]: I0316 16:27:43.021700 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-75575cf5bd-xrtzd" Mar 16 16:27:43 crc kubenswrapper[5120]: I0316 16:27:43.024083 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-swift-internal-svc\"" Mar 16 16:27:43 crc kubenswrapper[5120]: I0316 16:27:43.024248 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-swift-public-svc\"" Mar 16 16:27:43 crc kubenswrapper[5120]: I0316 16:27:43.024675 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"swift-proxy-config-data\"" Mar 16 16:27:43 crc kubenswrapper[5120]: I0316 16:27:43.026320 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-proxy-75575cf5bd-xrtzd"] Mar 16 16:27:43 crc kubenswrapper[5120]: I0316 16:27:43.065814 5120 generic.go:358] "Generic (PLEG): container finished" podID="06d95d7b-0750-49bf-b877-8f94a33ef71d" containerID="92febd01ea42f0695408604777f188c059856b8e4bbe245b0228518aca4cf7aa" exitCode=0 Mar 16 16:27:43 crc kubenswrapper[5120]: I0316 16:27:43.065993 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-db-create-z6jpd" event={"ID":"06d95d7b-0750-49bf-b877-8f94a33ef71d","Type":"ContainerDied","Data":"92febd01ea42f0695408604777f188c059856b8e4bbe245b0228518aca4cf7aa"} Mar 16 16:27:43 crc kubenswrapper[5120]: I0316 16:27:43.066056 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-db-create-z6jpd" event={"ID":"06d95d7b-0750-49bf-b877-8f94a33ef71d","Type":"ContainerStarted","Data":"751d86ecddc1510f76aba84886fd22c2023ebb15a8f43485b679d829c29c00a5"} Mar 16 16:27:43 crc kubenswrapper[5120]: I0316 16:27:43.085232 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-db-create-4fxk5" event={"ID":"a9e8e595-2161-4919-89fa-98913dc78df6","Type":"ContainerStarted","Data":"ba0a793f1053b5ed6a86a74ce35716f1e374dde3c6e47a21b90f752bec272c7a"} Mar 16 16:27:43 crc kubenswrapper[5120]: I0316 16:27:43.085273 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-db-create-4fxk5" event={"ID":"a9e8e595-2161-4919-89fa-98913dc78df6","Type":"ContainerStarted","Data":"22d0a40cc257f82c8a84720a7c40120b747eeec7cebfbb10269b76c4125104d6"} Mar 16 16:27:43 crc kubenswrapper[5120]: I0316 16:27:43.091556 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-af27-account-create-update-glkjg"] Mar 16 16:27:43 crc kubenswrapper[5120]: I0316 16:27:43.092281 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-db-create-xpjdr" event={"ID":"f45bc0f5-319a-407a-b329-ebad473733f6","Type":"ContainerStarted","Data":"81b9e2fea070418035b3021a45910efd7f21e01c842e49cc562d7b6d509e791f"} Mar 16 16:27:43 crc kubenswrapper[5120]: I0316 16:27:43.092315 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-db-create-xpjdr" event={"ID":"f45bc0f5-319a-407a-b329-ebad473733f6","Type":"ContainerStarted","Data":"e8e83732968de16d96d18055a4b92768d8b69b1f20baa428078907538aecfdb5"} Mar 16 16:27:43 crc kubenswrapper[5120]: I0316 16:27:43.100234 5120 generic.go:358] "Generic (PLEG): container finished" podID="e4bad0fb-46f9-4865-a897-c30da4fa8ffc" containerID="40441b8a582506e4f6bf4812c949b58c4f3c22bfbe65770287d19c52b316caf4" exitCode=0 Mar 16 16:27:43 crc kubenswrapper[5120]: I0316 16:27:43.100357 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"e4bad0fb-46f9-4865-a897-c30da4fa8ffc","Type":"ContainerDied","Data":"40441b8a582506e4f6bf4812c949b58c4f3c22bfbe65770287d19c52b316caf4"} Mar 16 16:27:43 crc kubenswrapper[5120]: I0316 16:27:43.100385 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"e4bad0fb-46f9-4865-a897-c30da4fa8ffc","Type":"ContainerDied","Data":"c0de10cee88917c8d955c749813119589793efa3abdea6674ac2a81ff095f5cc"} Mar 16 16:27:43 crc kubenswrapper[5120]: I0316 16:27:43.100403 5120 scope.go:117] "RemoveContainer" containerID="b16383c70508646ab1611bdfed8758a7e6a61c8ffe20cff415dbcbb996dbf937" Mar 16 16:27:43 crc kubenswrapper[5120]: I0316 16:27:43.100607 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:27:43 crc kubenswrapper[5120]: I0316 16:27:43.117388 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-d7e4-account-create-update-7b8tk" event={"ID":"c7086f4e-6b79-4162-874b-4c7cd36c1ae2","Type":"ContainerStarted","Data":"7df8c7bb57117f8412438b879e3aa980f0c8e88e81992a24509019f60d9752a9"} Mar 16 16:27:43 crc kubenswrapper[5120]: I0316 16:27:43.117678 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-db-create-4fxk5" podStartSLOduration=2.117668242 podStartE2EDuration="2.117668242s" podCreationTimestamp="2026-03-16 16:27:41 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:27:43.10635016 +0000 UTC m=+3365.260281817" watchObservedRunningTime="2026-03-16 16:27:43.117668242 +0000 UTC m=+3365.271599899" Mar 16 16:27:43 crc kubenswrapper[5120]: I0316 16:27:43.137064 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/7b46f8b0-c3f2-44ec-88e2-8d65566ae937-etc-swift\") pod \"swift-proxy-75575cf5bd-xrtzd\" (UID: \"7b46f8b0-c3f2-44ec-88e2-8d65566ae937\") " pod="openstack-kuttl-tests/swift-proxy-75575cf5bd-xrtzd" Mar 16 16:27:43 crc kubenswrapper[5120]: I0316 16:27:43.137109 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7b46f8b0-c3f2-44ec-88e2-8d65566ae937-combined-ca-bundle\") pod \"swift-proxy-75575cf5bd-xrtzd\" (UID: \"7b46f8b0-c3f2-44ec-88e2-8d65566ae937\") " pod="openstack-kuttl-tests/swift-proxy-75575cf5bd-xrtzd" Mar 16 16:27:43 crc kubenswrapper[5120]: I0316 16:27:43.137144 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7b46f8b0-c3f2-44ec-88e2-8d65566ae937-config-data\") pod \"swift-proxy-75575cf5bd-xrtzd\" (UID: \"7b46f8b0-c3f2-44ec-88e2-8d65566ae937\") " pod="openstack-kuttl-tests/swift-proxy-75575cf5bd-xrtzd" Mar 16 16:27:43 crc kubenswrapper[5120]: I0316 16:27:43.137298 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9ljx\" (UniqueName: \"kubernetes.io/projected/7b46f8b0-c3f2-44ec-88e2-8d65566ae937-kube-api-access-c9ljx\") pod \"swift-proxy-75575cf5bd-xrtzd\" (UID: \"7b46f8b0-c3f2-44ec-88e2-8d65566ae937\") " pod="openstack-kuttl-tests/swift-proxy-75575cf5bd-xrtzd" Mar 16 16:27:43 crc kubenswrapper[5120]: I0316 16:27:43.137322 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7b46f8b0-c3f2-44ec-88e2-8d65566ae937-run-httpd\") pod \"swift-proxy-75575cf5bd-xrtzd\" (UID: \"7b46f8b0-c3f2-44ec-88e2-8d65566ae937\") " pod="openstack-kuttl-tests/swift-proxy-75575cf5bd-xrtzd" Mar 16 16:27:43 crc kubenswrapper[5120]: I0316 16:27:43.137362 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/7b46f8b0-c3f2-44ec-88e2-8d65566ae937-internal-tls-certs\") pod \"swift-proxy-75575cf5bd-xrtzd\" (UID: \"7b46f8b0-c3f2-44ec-88e2-8d65566ae937\") " pod="openstack-kuttl-tests/swift-proxy-75575cf5bd-xrtzd" Mar 16 16:27:43 crc kubenswrapper[5120]: I0316 16:27:43.137449 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/7b46f8b0-c3f2-44ec-88e2-8d65566ae937-public-tls-certs\") pod \"swift-proxy-75575cf5bd-xrtzd\" (UID: \"7b46f8b0-c3f2-44ec-88e2-8d65566ae937\") " pod="openstack-kuttl-tests/swift-proxy-75575cf5bd-xrtzd" Mar 16 16:27:43 crc kubenswrapper[5120]: I0316 16:27:43.137475 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7b46f8b0-c3f2-44ec-88e2-8d65566ae937-log-httpd\") pod \"swift-proxy-75575cf5bd-xrtzd\" (UID: \"7b46f8b0-c3f2-44ec-88e2-8d65566ae937\") " pod="openstack-kuttl-tests/swift-proxy-75575cf5bd-xrtzd" Mar 16 16:27:43 crc kubenswrapper[5120]: I0316 16:27:43.155828 5120 scope.go:117] "RemoveContainer" containerID="9aea5d08c763b9963d50f97a99cae4377f76e8477e66152b6d28e85ebfc2c346" Mar 16 16:27:43 crc kubenswrapper[5120]: I0316 16:27:43.158475 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-db-create-xpjdr" podStartSLOduration=2.158434263 podStartE2EDuration="2.158434263s" podCreationTimestamp="2026-03-16 16:27:41 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:27:43.148370124 +0000 UTC m=+3365.302301781" watchObservedRunningTime="2026-03-16 16:27:43.158434263 +0000 UTC m=+3365.312365920" Mar 16 16:27:43 crc kubenswrapper[5120]: I0316 16:27:43.187694 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:27:43 crc kubenswrapper[5120]: I0316 16:27:43.194310 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:27:43 crc kubenswrapper[5120]: I0316 16:27:43.212445 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:27:43 crc kubenswrapper[5120]: I0316 16:27:43.218482 5120 scope.go:117] "RemoveContainer" containerID="40441b8a582506e4f6bf4812c949b58c4f3c22bfbe65770287d19c52b316caf4" Mar 16 16:27:43 crc kubenswrapper[5120]: I0316 16:27:43.231513 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:27:43 crc kubenswrapper[5120]: I0316 16:27:43.231668 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:27:43 crc kubenswrapper[5120]: I0316 16:27:43.234561 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 16:27:43 crc kubenswrapper[5120]: I0316 16:27:43.234744 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 16:27:43 crc kubenswrapper[5120]: I0316 16:27:43.246179 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/7b46f8b0-c3f2-44ec-88e2-8d65566ae937-public-tls-certs\") pod \"swift-proxy-75575cf5bd-xrtzd\" (UID: \"7b46f8b0-c3f2-44ec-88e2-8d65566ae937\") " pod="openstack-kuttl-tests/swift-proxy-75575cf5bd-xrtzd" Mar 16 16:27:43 crc kubenswrapper[5120]: I0316 16:27:43.257171 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7b46f8b0-c3f2-44ec-88e2-8d65566ae937-log-httpd\") pod \"swift-proxy-75575cf5bd-xrtzd\" (UID: \"7b46f8b0-c3f2-44ec-88e2-8d65566ae937\") " pod="openstack-kuttl-tests/swift-proxy-75575cf5bd-xrtzd" Mar 16 16:27:43 crc kubenswrapper[5120]: I0316 16:27:43.257578 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/7b46f8b0-c3f2-44ec-88e2-8d65566ae937-etc-swift\") pod \"swift-proxy-75575cf5bd-xrtzd\" (UID: \"7b46f8b0-c3f2-44ec-88e2-8d65566ae937\") " pod="openstack-kuttl-tests/swift-proxy-75575cf5bd-xrtzd" Mar 16 16:27:43 crc kubenswrapper[5120]: I0316 16:27:43.257702 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7b46f8b0-c3f2-44ec-88e2-8d65566ae937-combined-ca-bundle\") pod \"swift-proxy-75575cf5bd-xrtzd\" (UID: \"7b46f8b0-c3f2-44ec-88e2-8d65566ae937\") " pod="openstack-kuttl-tests/swift-proxy-75575cf5bd-xrtzd" Mar 16 16:27:43 crc kubenswrapper[5120]: I0316 16:27:43.257746 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7b46f8b0-c3f2-44ec-88e2-8d65566ae937-log-httpd\") pod \"swift-proxy-75575cf5bd-xrtzd\" (UID: \"7b46f8b0-c3f2-44ec-88e2-8d65566ae937\") " pod="openstack-kuttl-tests/swift-proxy-75575cf5bd-xrtzd" Mar 16 16:27:43 crc kubenswrapper[5120]: I0316 16:27:43.257833 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7b46f8b0-c3f2-44ec-88e2-8d65566ae937-config-data\") pod \"swift-proxy-75575cf5bd-xrtzd\" (UID: \"7b46f8b0-c3f2-44ec-88e2-8d65566ae937\") " pod="openstack-kuttl-tests/swift-proxy-75575cf5bd-xrtzd" Mar 16 16:27:43 crc kubenswrapper[5120]: I0316 16:27:43.258280 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c9ljx\" (UniqueName: \"kubernetes.io/projected/7b46f8b0-c3f2-44ec-88e2-8d65566ae937-kube-api-access-c9ljx\") pod \"swift-proxy-75575cf5bd-xrtzd\" (UID: \"7b46f8b0-c3f2-44ec-88e2-8d65566ae937\") " pod="openstack-kuttl-tests/swift-proxy-75575cf5bd-xrtzd" Mar 16 16:27:43 crc kubenswrapper[5120]: I0316 16:27:43.258332 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7b46f8b0-c3f2-44ec-88e2-8d65566ae937-run-httpd\") pod \"swift-proxy-75575cf5bd-xrtzd\" (UID: \"7b46f8b0-c3f2-44ec-88e2-8d65566ae937\") " pod="openstack-kuttl-tests/swift-proxy-75575cf5bd-xrtzd" Mar 16 16:27:43 crc kubenswrapper[5120]: I0316 16:27:43.258413 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/7b46f8b0-c3f2-44ec-88e2-8d65566ae937-internal-tls-certs\") pod \"swift-proxy-75575cf5bd-xrtzd\" (UID: \"7b46f8b0-c3f2-44ec-88e2-8d65566ae937\") " pod="openstack-kuttl-tests/swift-proxy-75575cf5bd-xrtzd" Mar 16 16:27:43 crc kubenswrapper[5120]: I0316 16:27:43.261262 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7b46f8b0-c3f2-44ec-88e2-8d65566ae937-run-httpd\") pod \"swift-proxy-75575cf5bd-xrtzd\" (UID: \"7b46f8b0-c3f2-44ec-88e2-8d65566ae937\") " pod="openstack-kuttl-tests/swift-proxy-75575cf5bd-xrtzd" Mar 16 16:27:43 crc kubenswrapper[5120]: I0316 16:27:43.264798 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7b46f8b0-c3f2-44ec-88e2-8d65566ae937-combined-ca-bundle\") pod \"swift-proxy-75575cf5bd-xrtzd\" (UID: \"7b46f8b0-c3f2-44ec-88e2-8d65566ae937\") " pod="openstack-kuttl-tests/swift-proxy-75575cf5bd-xrtzd" Mar 16 16:27:43 crc kubenswrapper[5120]: I0316 16:27:43.266417 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7b46f8b0-c3f2-44ec-88e2-8d65566ae937-config-data\") pod \"swift-proxy-75575cf5bd-xrtzd\" (UID: \"7b46f8b0-c3f2-44ec-88e2-8d65566ae937\") " pod="openstack-kuttl-tests/swift-proxy-75575cf5bd-xrtzd" Mar 16 16:27:43 crc kubenswrapper[5120]: I0316 16:27:43.266445 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/7b46f8b0-c3f2-44ec-88e2-8d65566ae937-public-tls-certs\") pod \"swift-proxy-75575cf5bd-xrtzd\" (UID: \"7b46f8b0-c3f2-44ec-88e2-8d65566ae937\") " pod="openstack-kuttl-tests/swift-proxy-75575cf5bd-xrtzd" Mar 16 16:27:43 crc kubenswrapper[5120]: W0316 16:27:43.273928 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod96781f8d_3ff9_4c6c_a468_67785be1dfd7.slice/crio-a311d8c11a3189b72b3db43cf5f94293725e15c2180d5a75df5b927b3398ee12 WatchSource:0}: Error finding container a311d8c11a3189b72b3db43cf5f94293725e15c2180d5a75df5b927b3398ee12: Status 404 returned error can't find the container with id a311d8c11a3189b72b3db43cf5f94293725e15c2180d5a75df5b927b3398ee12 Mar 16 16:27:43 crc kubenswrapper[5120]: I0316 16:27:43.277790 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/7b46f8b0-c3f2-44ec-88e2-8d65566ae937-internal-tls-certs\") pod \"swift-proxy-75575cf5bd-xrtzd\" (UID: \"7b46f8b0-c3f2-44ec-88e2-8d65566ae937\") " pod="openstack-kuttl-tests/swift-proxy-75575cf5bd-xrtzd" Mar 16 16:27:43 crc kubenswrapper[5120]: I0316 16:27:43.278806 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-5b46-account-create-update-2448q"] Mar 16 16:27:43 crc kubenswrapper[5120]: I0316 16:27:43.279030 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/7b46f8b0-c3f2-44ec-88e2-8d65566ae937-etc-swift\") pod \"swift-proxy-75575cf5bd-xrtzd\" (UID: \"7b46f8b0-c3f2-44ec-88e2-8d65566ae937\") " pod="openstack-kuttl-tests/swift-proxy-75575cf5bd-xrtzd" Mar 16 16:27:43 crc kubenswrapper[5120]: I0316 16:27:43.292688 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9ljx\" (UniqueName: \"kubernetes.io/projected/7b46f8b0-c3f2-44ec-88e2-8d65566ae937-kube-api-access-c9ljx\") pod \"swift-proxy-75575cf5bd-xrtzd\" (UID: \"7b46f8b0-c3f2-44ec-88e2-8d65566ae937\") " pod="openstack-kuttl-tests/swift-proxy-75575cf5bd-xrtzd" Mar 16 16:27:43 crc kubenswrapper[5120]: I0316 16:27:43.351009 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-75575cf5bd-xrtzd" Mar 16 16:27:43 crc kubenswrapper[5120]: I0316 16:27:43.360050 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qphtc\" (UniqueName: \"kubernetes.io/projected/2245156d-93ad-46d7-ad01-665808d694f0-kube-api-access-qphtc\") pod \"ceilometer-0\" (UID: \"2245156d-93ad-46d7-ad01-665808d694f0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:27:43 crc kubenswrapper[5120]: I0316 16:27:43.360120 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/2245156d-93ad-46d7-ad01-665808d694f0-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"2245156d-93ad-46d7-ad01-665808d694f0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:27:43 crc kubenswrapper[5120]: I0316 16:27:43.360177 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2245156d-93ad-46d7-ad01-665808d694f0-config-data\") pod \"ceilometer-0\" (UID: \"2245156d-93ad-46d7-ad01-665808d694f0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:27:43 crc kubenswrapper[5120]: I0316 16:27:43.360218 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2245156d-93ad-46d7-ad01-665808d694f0-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"2245156d-93ad-46d7-ad01-665808d694f0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:27:43 crc kubenswrapper[5120]: I0316 16:27:43.360302 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2245156d-93ad-46d7-ad01-665808d694f0-scripts\") pod \"ceilometer-0\" (UID: \"2245156d-93ad-46d7-ad01-665808d694f0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:27:43 crc kubenswrapper[5120]: I0316 16:27:43.360359 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2245156d-93ad-46d7-ad01-665808d694f0-run-httpd\") pod \"ceilometer-0\" (UID: \"2245156d-93ad-46d7-ad01-665808d694f0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:27:43 crc kubenswrapper[5120]: I0316 16:27:43.360409 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2245156d-93ad-46d7-ad01-665808d694f0-log-httpd\") pod \"ceilometer-0\" (UID: \"2245156d-93ad-46d7-ad01-665808d694f0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:27:43 crc kubenswrapper[5120]: I0316 16:27:43.463603 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2245156d-93ad-46d7-ad01-665808d694f0-log-httpd\") pod \"ceilometer-0\" (UID: \"2245156d-93ad-46d7-ad01-665808d694f0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:27:43 crc kubenswrapper[5120]: I0316 16:27:43.463724 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qphtc\" (UniqueName: \"kubernetes.io/projected/2245156d-93ad-46d7-ad01-665808d694f0-kube-api-access-qphtc\") pod \"ceilometer-0\" (UID: \"2245156d-93ad-46d7-ad01-665808d694f0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:27:43 crc kubenswrapper[5120]: I0316 16:27:43.463785 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/2245156d-93ad-46d7-ad01-665808d694f0-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"2245156d-93ad-46d7-ad01-665808d694f0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:27:43 crc kubenswrapper[5120]: I0316 16:27:43.463840 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2245156d-93ad-46d7-ad01-665808d694f0-config-data\") pod \"ceilometer-0\" (UID: \"2245156d-93ad-46d7-ad01-665808d694f0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:27:43 crc kubenswrapper[5120]: I0316 16:27:43.463880 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2245156d-93ad-46d7-ad01-665808d694f0-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"2245156d-93ad-46d7-ad01-665808d694f0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:27:43 crc kubenswrapper[5120]: I0316 16:27:43.463967 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2245156d-93ad-46d7-ad01-665808d694f0-scripts\") pod \"ceilometer-0\" (UID: \"2245156d-93ad-46d7-ad01-665808d694f0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:27:43 crc kubenswrapper[5120]: I0316 16:27:43.464023 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2245156d-93ad-46d7-ad01-665808d694f0-run-httpd\") pod \"ceilometer-0\" (UID: \"2245156d-93ad-46d7-ad01-665808d694f0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:27:43 crc kubenswrapper[5120]: I0316 16:27:43.464786 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2245156d-93ad-46d7-ad01-665808d694f0-run-httpd\") pod \"ceilometer-0\" (UID: \"2245156d-93ad-46d7-ad01-665808d694f0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:27:43 crc kubenswrapper[5120]: I0316 16:27:43.465222 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2245156d-93ad-46d7-ad01-665808d694f0-log-httpd\") pod \"ceilometer-0\" (UID: \"2245156d-93ad-46d7-ad01-665808d694f0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:27:43 crc kubenswrapper[5120]: I0316 16:27:43.472477 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/2245156d-93ad-46d7-ad01-665808d694f0-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"2245156d-93ad-46d7-ad01-665808d694f0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:27:43 crc kubenswrapper[5120]: I0316 16:27:43.472575 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2245156d-93ad-46d7-ad01-665808d694f0-scripts\") pod \"ceilometer-0\" (UID: \"2245156d-93ad-46d7-ad01-665808d694f0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:27:43 crc kubenswrapper[5120]: I0316 16:27:43.475042 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2245156d-93ad-46d7-ad01-665808d694f0-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"2245156d-93ad-46d7-ad01-665808d694f0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:27:43 crc kubenswrapper[5120]: I0316 16:27:43.476199 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2245156d-93ad-46d7-ad01-665808d694f0-config-data\") pod \"ceilometer-0\" (UID: \"2245156d-93ad-46d7-ad01-665808d694f0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:27:43 crc kubenswrapper[5120]: I0316 16:27:43.488774 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qphtc\" (UniqueName: \"kubernetes.io/projected/2245156d-93ad-46d7-ad01-665808d694f0-kube-api-access-qphtc\") pod \"ceilometer-0\" (UID: \"2245156d-93ad-46d7-ad01-665808d694f0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:27:43 crc kubenswrapper[5120]: I0316 16:27:43.618510 5120 scope.go:117] "RemoveContainer" containerID="55e26e26cad1abefe9b7fb7057d8919fe5be21a3e7ef711fcade2da4e30ae1cb" Mar 16 16:27:43 crc kubenswrapper[5120]: I0316 16:27:43.639085 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:27:43 crc kubenswrapper[5120]: I0316 16:27:43.689118 5120 scope.go:117] "RemoveContainer" containerID="b16383c70508646ab1611bdfed8758a7e6a61c8ffe20cff415dbcbb996dbf937" Mar 16 16:27:43 crc kubenswrapper[5120]: E0316 16:27:43.696599 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b16383c70508646ab1611bdfed8758a7e6a61c8ffe20cff415dbcbb996dbf937\": container with ID starting with b16383c70508646ab1611bdfed8758a7e6a61c8ffe20cff415dbcbb996dbf937 not found: ID does not exist" containerID="b16383c70508646ab1611bdfed8758a7e6a61c8ffe20cff415dbcbb996dbf937" Mar 16 16:27:43 crc kubenswrapper[5120]: I0316 16:27:43.696658 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b16383c70508646ab1611bdfed8758a7e6a61c8ffe20cff415dbcbb996dbf937"} err="failed to get container status \"b16383c70508646ab1611bdfed8758a7e6a61c8ffe20cff415dbcbb996dbf937\": rpc error: code = NotFound desc = could not find container \"b16383c70508646ab1611bdfed8758a7e6a61c8ffe20cff415dbcbb996dbf937\": container with ID starting with b16383c70508646ab1611bdfed8758a7e6a61c8ffe20cff415dbcbb996dbf937 not found: ID does not exist" Mar 16 16:27:43 crc kubenswrapper[5120]: I0316 16:27:43.696691 5120 scope.go:117] "RemoveContainer" containerID="9aea5d08c763b9963d50f97a99cae4377f76e8477e66152b6d28e85ebfc2c346" Mar 16 16:27:43 crc kubenswrapper[5120]: E0316 16:27:43.697398 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9aea5d08c763b9963d50f97a99cae4377f76e8477e66152b6d28e85ebfc2c346\": container with ID starting with 9aea5d08c763b9963d50f97a99cae4377f76e8477e66152b6d28e85ebfc2c346 not found: ID does not exist" containerID="9aea5d08c763b9963d50f97a99cae4377f76e8477e66152b6d28e85ebfc2c346" Mar 16 16:27:43 crc kubenswrapper[5120]: I0316 16:27:43.697424 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9aea5d08c763b9963d50f97a99cae4377f76e8477e66152b6d28e85ebfc2c346"} err="failed to get container status \"9aea5d08c763b9963d50f97a99cae4377f76e8477e66152b6d28e85ebfc2c346\": rpc error: code = NotFound desc = could not find container \"9aea5d08c763b9963d50f97a99cae4377f76e8477e66152b6d28e85ebfc2c346\": container with ID starting with 9aea5d08c763b9963d50f97a99cae4377f76e8477e66152b6d28e85ebfc2c346 not found: ID does not exist" Mar 16 16:27:43 crc kubenswrapper[5120]: I0316 16:27:43.697440 5120 scope.go:117] "RemoveContainer" containerID="40441b8a582506e4f6bf4812c949b58c4f3c22bfbe65770287d19c52b316caf4" Mar 16 16:27:43 crc kubenswrapper[5120]: E0316 16:27:43.697666 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"40441b8a582506e4f6bf4812c949b58c4f3c22bfbe65770287d19c52b316caf4\": container with ID starting with 40441b8a582506e4f6bf4812c949b58c4f3c22bfbe65770287d19c52b316caf4 not found: ID does not exist" containerID="40441b8a582506e4f6bf4812c949b58c4f3c22bfbe65770287d19c52b316caf4" Mar 16 16:27:43 crc kubenswrapper[5120]: I0316 16:27:43.697699 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40441b8a582506e4f6bf4812c949b58c4f3c22bfbe65770287d19c52b316caf4"} err="failed to get container status \"40441b8a582506e4f6bf4812c949b58c4f3c22bfbe65770287d19c52b316caf4\": rpc error: code = NotFound desc = could not find container \"40441b8a582506e4f6bf4812c949b58c4f3c22bfbe65770287d19c52b316caf4\": container with ID starting with 40441b8a582506e4f6bf4812c949b58c4f3c22bfbe65770287d19c52b316caf4 not found: ID does not exist" Mar 16 16:27:43 crc kubenswrapper[5120]: I0316 16:27:43.697720 5120 scope.go:117] "RemoveContainer" containerID="55e26e26cad1abefe9b7fb7057d8919fe5be21a3e7ef711fcade2da4e30ae1cb" Mar 16 16:27:43 crc kubenswrapper[5120]: E0316 16:27:43.698123 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"55e26e26cad1abefe9b7fb7057d8919fe5be21a3e7ef711fcade2da4e30ae1cb\": container with ID starting with 55e26e26cad1abefe9b7fb7057d8919fe5be21a3e7ef711fcade2da4e30ae1cb not found: ID does not exist" containerID="55e26e26cad1abefe9b7fb7057d8919fe5be21a3e7ef711fcade2da4e30ae1cb" Mar 16 16:27:43 crc kubenswrapper[5120]: I0316 16:27:43.698159 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55e26e26cad1abefe9b7fb7057d8919fe5be21a3e7ef711fcade2da4e30ae1cb"} err="failed to get container status \"55e26e26cad1abefe9b7fb7057d8919fe5be21a3e7ef711fcade2da4e30ae1cb\": rpc error: code = NotFound desc = could not find container \"55e26e26cad1abefe9b7fb7057d8919fe5be21a3e7ef711fcade2da4e30ae1cb\": container with ID starting with 55e26e26cad1abefe9b7fb7057d8919fe5be21a3e7ef711fcade2da4e30ae1cb not found: ID does not exist" Mar 16 16:27:43 crc kubenswrapper[5120]: W0316 16:27:43.868159 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7b46f8b0_c3f2_44ec_88e2_8d65566ae937.slice/crio-9b2d6a760ea1f18322fd2d4ee4644129e94b037792120b0295581b65b943ff83 WatchSource:0}: Error finding container 9b2d6a760ea1f18322fd2d4ee4644129e94b037792120b0295581b65b943ff83: Status 404 returned error can't find the container with id 9b2d6a760ea1f18322fd2d4ee4644129e94b037792120b0295581b65b943ff83 Mar 16 16:27:43 crc kubenswrapper[5120]: I0316 16:27:43.887857 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-proxy-75575cf5bd-xrtzd"] Mar 16 16:27:44 crc kubenswrapper[5120]: I0316 16:27:44.154496 5120 generic.go:358] "Generic (PLEG): container finished" podID="a9e8e595-2161-4919-89fa-98913dc78df6" containerID="ba0a793f1053b5ed6a86a74ce35716f1e374dde3c6e47a21b90f752bec272c7a" exitCode=0 Mar 16 16:27:44 crc kubenswrapper[5120]: I0316 16:27:44.154580 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-db-create-4fxk5" event={"ID":"a9e8e595-2161-4919-89fa-98913dc78df6","Type":"ContainerDied","Data":"ba0a793f1053b5ed6a86a74ce35716f1e374dde3c6e47a21b90f752bec272c7a"} Mar 16 16:27:44 crc kubenswrapper[5120]: I0316 16:27:44.158864 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-5b46-account-create-update-2448q" event={"ID":"96781f8d-3ff9-4c6c-a468-67785be1dfd7","Type":"ContainerStarted","Data":"dd02164555387ce23c90167302ec229465b504ae41ef89fdaa32a90d5aeb9e74"} Mar 16 16:27:44 crc kubenswrapper[5120]: I0316 16:27:44.158892 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-5b46-account-create-update-2448q" event={"ID":"96781f8d-3ff9-4c6c-a468-67785be1dfd7","Type":"ContainerStarted","Data":"a311d8c11a3189b72b3db43cf5f94293725e15c2180d5a75df5b927b3398ee12"} Mar 16 16:27:44 crc kubenswrapper[5120]: I0316 16:27:44.165116 5120 generic.go:358] "Generic (PLEG): container finished" podID="f45bc0f5-319a-407a-b329-ebad473733f6" containerID="81b9e2fea070418035b3021a45910efd7f21e01c842e49cc562d7b6d509e791f" exitCode=0 Mar 16 16:27:44 crc kubenswrapper[5120]: I0316 16:27:44.165407 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-db-create-xpjdr" event={"ID":"f45bc0f5-319a-407a-b329-ebad473733f6","Type":"ContainerDied","Data":"81b9e2fea070418035b3021a45910efd7f21e01c842e49cc562d7b6d509e791f"} Mar 16 16:27:44 crc kubenswrapper[5120]: I0316 16:27:44.176685 5120 generic.go:358] "Generic (PLEG): container finished" podID="b11f89f6-cba8-4f94-ac51-8f4d514e54fb" containerID="c13b2806d0eba671dc3f5433f6b3bcc71933d4ad5f267f5b0c259bad23300e40" exitCode=0 Mar 16 16:27:44 crc kubenswrapper[5120]: I0316 16:27:44.176977 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-af27-account-create-update-glkjg" event={"ID":"b11f89f6-cba8-4f94-ac51-8f4d514e54fb","Type":"ContainerDied","Data":"c13b2806d0eba671dc3f5433f6b3bcc71933d4ad5f267f5b0c259bad23300e40"} Mar 16 16:27:44 crc kubenswrapper[5120]: I0316 16:27:44.177014 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-af27-account-create-update-glkjg" event={"ID":"b11f89f6-cba8-4f94-ac51-8f4d514e54fb","Type":"ContainerStarted","Data":"b1f5264f0eacb2a001c3ca418f86d1e6f618cbcbe19644a819a054306942f2c4"} Mar 16 16:27:44 crc kubenswrapper[5120]: I0316 16:27:44.193726 5120 generic.go:358] "Generic (PLEG): container finished" podID="c7086f4e-6b79-4162-874b-4c7cd36c1ae2" containerID="307544a2abe379238f6873b27816efbf5bb703115ac42bfccc139ce562b1c250" exitCode=0 Mar 16 16:27:44 crc kubenswrapper[5120]: I0316 16:27:44.193982 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-d7e4-account-create-update-7b8tk" event={"ID":"c7086f4e-6b79-4162-874b-4c7cd36c1ae2","Type":"ContainerDied","Data":"307544a2abe379238f6873b27816efbf5bb703115ac42bfccc139ce562b1c250"} Mar 16 16:27:44 crc kubenswrapper[5120]: I0316 16:27:44.200494 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-75575cf5bd-xrtzd" event={"ID":"7b46f8b0-c3f2-44ec-88e2-8d65566ae937","Type":"ContainerStarted","Data":"9b2d6a760ea1f18322fd2d4ee4644129e94b037792120b0295581b65b943ff83"} Mar 16 16:27:44 crc kubenswrapper[5120]: I0316 16:27:44.213987 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:27:44 crc kubenswrapper[5120]: W0316 16:27:44.232207 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2245156d_93ad_46d7_ad01_665808d694f0.slice/crio-53cb4953afd4fe8ec571d07137c180b0ae3076cb3902abda6ceab98c2f735609 WatchSource:0}: Error finding container 53cb4953afd4fe8ec571d07137c180b0ae3076cb3902abda6ceab98c2f735609: Status 404 returned error can't find the container with id 53cb4953afd4fe8ec571d07137c180b0ae3076cb3902abda6ceab98c2f735609 Mar 16 16:27:44 crc kubenswrapper[5120]: I0316 16:27:44.631722 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-db-create-z6jpd" Mar 16 16:27:44 crc kubenswrapper[5120]: I0316 16:27:44.693673 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e4bad0fb-46f9-4865-a897-c30da4fa8ffc" path="/var/lib/kubelet/pods/e4bad0fb-46f9-4865-a897-c30da4fa8ffc/volumes" Mar 16 16:27:44 crc kubenswrapper[5120]: I0316 16:27:44.826898 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w827j\" (UniqueName: \"kubernetes.io/projected/06d95d7b-0750-49bf-b877-8f94a33ef71d-kube-api-access-w827j\") pod \"06d95d7b-0750-49bf-b877-8f94a33ef71d\" (UID: \"06d95d7b-0750-49bf-b877-8f94a33ef71d\") " Mar 16 16:27:44 crc kubenswrapper[5120]: I0316 16:27:44.827211 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/06d95d7b-0750-49bf-b877-8f94a33ef71d-operator-scripts\") pod \"06d95d7b-0750-49bf-b877-8f94a33ef71d\" (UID: \"06d95d7b-0750-49bf-b877-8f94a33ef71d\") " Mar 16 16:27:44 crc kubenswrapper[5120]: I0316 16:27:44.828384 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06d95d7b-0750-49bf-b877-8f94a33ef71d-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "06d95d7b-0750-49bf-b877-8f94a33ef71d" (UID: "06d95d7b-0750-49bf-b877-8f94a33ef71d"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:27:44 crc kubenswrapper[5120]: I0316 16:27:44.837975 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06d95d7b-0750-49bf-b877-8f94a33ef71d-kube-api-access-w827j" (OuterVolumeSpecName: "kube-api-access-w827j") pod "06d95d7b-0750-49bf-b877-8f94a33ef71d" (UID: "06d95d7b-0750-49bf-b877-8f94a33ef71d"). InnerVolumeSpecName "kube-api-access-w827j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:27:44 crc kubenswrapper[5120]: I0316 16:27:44.919120 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:27:44 crc kubenswrapper[5120]: I0316 16:27:44.929498 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/06d95d7b-0750-49bf-b877-8f94a33ef71d-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:27:44 crc kubenswrapper[5120]: I0316 16:27:44.929530 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w827j\" (UniqueName: \"kubernetes.io/projected/06d95d7b-0750-49bf-b877-8f94a33ef71d-kube-api-access-w827j\") on node \"crc\" DevicePath \"\"" Mar 16 16:27:45 crc kubenswrapper[5120]: I0316 16:27:45.215193 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"2245156d-93ad-46d7-ad01-665808d694f0","Type":"ContainerStarted","Data":"096e7b14a2a0ea5024629b8f93c8cb79609e03ba732a618c0044579f24020160"} Mar 16 16:27:45 crc kubenswrapper[5120]: I0316 16:27:45.215291 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"2245156d-93ad-46d7-ad01-665808d694f0","Type":"ContainerStarted","Data":"53cb4953afd4fe8ec571d07137c180b0ae3076cb3902abda6ceab98c2f735609"} Mar 16 16:27:45 crc kubenswrapper[5120]: I0316 16:27:45.218971 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-75575cf5bd-xrtzd" event={"ID":"7b46f8b0-c3f2-44ec-88e2-8d65566ae937","Type":"ContainerStarted","Data":"acb24d66779cebdb73830f94ca9a36930b6848cc20bd4028e1a60ec492a4a2b5"} Mar 16 16:27:45 crc kubenswrapper[5120]: I0316 16:27:45.219494 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-75575cf5bd-xrtzd" event={"ID":"7b46f8b0-c3f2-44ec-88e2-8d65566ae937","Type":"ContainerStarted","Data":"a6a93148c012a86a4db9d9a856d284743e23fe3682ebcefe62653b9a2e3d9836"} Mar 16 16:27:45 crc kubenswrapper[5120]: I0316 16:27:45.219529 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/swift-proxy-75575cf5bd-xrtzd" Mar 16 16:27:45 crc kubenswrapper[5120]: I0316 16:27:45.219574 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/swift-proxy-75575cf5bd-xrtzd" Mar 16 16:27:45 crc kubenswrapper[5120]: I0316 16:27:45.221125 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-db-create-z6jpd" Mar 16 16:27:45 crc kubenswrapper[5120]: I0316 16:27:45.221148 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-db-create-z6jpd" event={"ID":"06d95d7b-0750-49bf-b877-8f94a33ef71d","Type":"ContainerDied","Data":"751d86ecddc1510f76aba84886fd22c2023ebb15a8f43485b679d829c29c00a5"} Mar 16 16:27:45 crc kubenswrapper[5120]: I0316 16:27:45.221174 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="751d86ecddc1510f76aba84886fd22c2023ebb15a8f43485b679d829c29c00a5" Mar 16 16:27:45 crc kubenswrapper[5120]: I0316 16:27:45.222545 5120 generic.go:358] "Generic (PLEG): container finished" podID="96781f8d-3ff9-4c6c-a468-67785be1dfd7" containerID="dd02164555387ce23c90167302ec229465b504ae41ef89fdaa32a90d5aeb9e74" exitCode=0 Mar 16 16:27:45 crc kubenswrapper[5120]: I0316 16:27:45.223027 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-5b46-account-create-update-2448q" event={"ID":"96781f8d-3ff9-4c6c-a468-67785be1dfd7","Type":"ContainerDied","Data":"dd02164555387ce23c90167302ec229465b504ae41ef89fdaa32a90d5aeb9e74"} Mar 16 16:27:45 crc kubenswrapper[5120]: I0316 16:27:45.253103 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/swift-proxy-75575cf5bd-xrtzd" podStartSLOduration=3.253079149 podStartE2EDuration="3.253079149s" podCreationTimestamp="2026-03-16 16:27:42 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:27:45.245475185 +0000 UTC m=+3367.399406862" watchObservedRunningTime="2026-03-16 16:27:45.253079149 +0000 UTC m=+3367.407010806" Mar 16 16:27:45 crc kubenswrapper[5120]: I0316 16:27:45.864456 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-af27-account-create-update-glkjg" Mar 16 16:27:45 crc kubenswrapper[5120]: I0316 16:27:45.883431 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b11f89f6-cba8-4f94-ac51-8f4d514e54fb-operator-scripts\") pod \"b11f89f6-cba8-4f94-ac51-8f4d514e54fb\" (UID: \"b11f89f6-cba8-4f94-ac51-8f4d514e54fb\") " Mar 16 16:27:45 crc kubenswrapper[5120]: I0316 16:27:45.900242 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b11f89f6-cba8-4f94-ac51-8f4d514e54fb-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "b11f89f6-cba8-4f94-ac51-8f4d514e54fb" (UID: "b11f89f6-cba8-4f94-ac51-8f4d514e54fb"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:27:45 crc kubenswrapper[5120]: I0316 16:27:45.986920 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d2bqm\" (UniqueName: \"kubernetes.io/projected/b11f89f6-cba8-4f94-ac51-8f4d514e54fb-kube-api-access-d2bqm\") pod \"b11f89f6-cba8-4f94-ac51-8f4d514e54fb\" (UID: \"b11f89f6-cba8-4f94-ac51-8f4d514e54fb\") " Mar 16 16:27:45 crc kubenswrapper[5120]: I0316 16:27:45.987782 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b11f89f6-cba8-4f94-ac51-8f4d514e54fb-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:27:45 crc kubenswrapper[5120]: I0316 16:27:45.988122 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-5b46-account-create-update-2448q" Mar 16 16:27:46 crc kubenswrapper[5120]: I0316 16:27:46.015800 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b11f89f6-cba8-4f94-ac51-8f4d514e54fb-kube-api-access-d2bqm" (OuterVolumeSpecName: "kube-api-access-d2bqm") pod "b11f89f6-cba8-4f94-ac51-8f4d514e54fb" (UID: "b11f89f6-cba8-4f94-ac51-8f4d514e54fb"). InnerVolumeSpecName "kube-api-access-d2bqm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:27:46 crc kubenswrapper[5120]: I0316 16:27:46.037659 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-db-create-4fxk5" Mar 16 16:27:46 crc kubenswrapper[5120]: I0316 16:27:46.074182 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-db-create-xpjdr" Mar 16 16:27:46 crc kubenswrapper[5120]: I0316 16:27:46.089202 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gv4km\" (UniqueName: \"kubernetes.io/projected/96781f8d-3ff9-4c6c-a468-67785be1dfd7-kube-api-access-gv4km\") pod \"96781f8d-3ff9-4c6c-a468-67785be1dfd7\" (UID: \"96781f8d-3ff9-4c6c-a468-67785be1dfd7\") " Mar 16 16:27:46 crc kubenswrapper[5120]: I0316 16:27:46.089407 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/96781f8d-3ff9-4c6c-a468-67785be1dfd7-operator-scripts\") pod \"96781f8d-3ff9-4c6c-a468-67785be1dfd7\" (UID: \"96781f8d-3ff9-4c6c-a468-67785be1dfd7\") " Mar 16 16:27:46 crc kubenswrapper[5120]: I0316 16:27:46.089543 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g8pgm\" (UniqueName: \"kubernetes.io/projected/a9e8e595-2161-4919-89fa-98913dc78df6-kube-api-access-g8pgm\") pod \"a9e8e595-2161-4919-89fa-98913dc78df6\" (UID: \"a9e8e595-2161-4919-89fa-98913dc78df6\") " Mar 16 16:27:46 crc kubenswrapper[5120]: I0316 16:27:46.089582 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r5xkd\" (UniqueName: \"kubernetes.io/projected/f45bc0f5-319a-407a-b329-ebad473733f6-kube-api-access-r5xkd\") pod \"f45bc0f5-319a-407a-b329-ebad473733f6\" (UID: \"f45bc0f5-319a-407a-b329-ebad473733f6\") " Mar 16 16:27:46 crc kubenswrapper[5120]: I0316 16:27:46.089662 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f45bc0f5-319a-407a-b329-ebad473733f6-operator-scripts\") pod \"f45bc0f5-319a-407a-b329-ebad473733f6\" (UID: \"f45bc0f5-319a-407a-b329-ebad473733f6\") " Mar 16 16:27:46 crc kubenswrapper[5120]: I0316 16:27:46.089710 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a9e8e595-2161-4919-89fa-98913dc78df6-operator-scripts\") pod \"a9e8e595-2161-4919-89fa-98913dc78df6\" (UID: \"a9e8e595-2161-4919-89fa-98913dc78df6\") " Mar 16 16:27:46 crc kubenswrapper[5120]: I0316 16:27:46.090317 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d2bqm\" (UniqueName: \"kubernetes.io/projected/b11f89f6-cba8-4f94-ac51-8f4d514e54fb-kube-api-access-d2bqm\") on node \"crc\" DevicePath \"\"" Mar 16 16:27:46 crc kubenswrapper[5120]: I0316 16:27:46.090873 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f45bc0f5-319a-407a-b329-ebad473733f6-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "f45bc0f5-319a-407a-b329-ebad473733f6" (UID: "f45bc0f5-319a-407a-b329-ebad473733f6"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:27:46 crc kubenswrapper[5120]: I0316 16:27:46.091163 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a9e8e595-2161-4919-89fa-98913dc78df6-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "a9e8e595-2161-4919-89fa-98913dc78df6" (UID: "a9e8e595-2161-4919-89fa-98913dc78df6"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:27:46 crc kubenswrapper[5120]: I0316 16:27:46.091172 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96781f8d-3ff9-4c6c-a468-67785be1dfd7-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "96781f8d-3ff9-4c6c-a468-67785be1dfd7" (UID: "96781f8d-3ff9-4c6c-a468-67785be1dfd7"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:27:46 crc kubenswrapper[5120]: I0316 16:27:46.100418 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f45bc0f5-319a-407a-b329-ebad473733f6-kube-api-access-r5xkd" (OuterVolumeSpecName: "kube-api-access-r5xkd") pod "f45bc0f5-319a-407a-b329-ebad473733f6" (UID: "f45bc0f5-319a-407a-b329-ebad473733f6"). InnerVolumeSpecName "kube-api-access-r5xkd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:27:46 crc kubenswrapper[5120]: I0316 16:27:46.100537 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96781f8d-3ff9-4c6c-a468-67785be1dfd7-kube-api-access-gv4km" (OuterVolumeSpecName: "kube-api-access-gv4km") pod "96781f8d-3ff9-4c6c-a468-67785be1dfd7" (UID: "96781f8d-3ff9-4c6c-a468-67785be1dfd7"). InnerVolumeSpecName "kube-api-access-gv4km". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:27:46 crc kubenswrapper[5120]: I0316 16:27:46.102328 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-d7e4-account-create-update-7b8tk" Mar 16 16:27:46 crc kubenswrapper[5120]: I0316 16:27:46.110011 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a9e8e595-2161-4919-89fa-98913dc78df6-kube-api-access-g8pgm" (OuterVolumeSpecName: "kube-api-access-g8pgm") pod "a9e8e595-2161-4919-89fa-98913dc78df6" (UID: "a9e8e595-2161-4919-89fa-98913dc78df6"). InnerVolumeSpecName "kube-api-access-g8pgm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:27:46 crc kubenswrapper[5120]: I0316 16:27:46.192449 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c7086f4e-6b79-4162-874b-4c7cd36c1ae2-operator-scripts\") pod \"c7086f4e-6b79-4162-874b-4c7cd36c1ae2\" (UID: \"c7086f4e-6b79-4162-874b-4c7cd36c1ae2\") " Mar 16 16:27:46 crc kubenswrapper[5120]: I0316 16:27:46.192512 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jpsfl\" (UniqueName: \"kubernetes.io/projected/c7086f4e-6b79-4162-874b-4c7cd36c1ae2-kube-api-access-jpsfl\") pod \"c7086f4e-6b79-4162-874b-4c7cd36c1ae2\" (UID: \"c7086f4e-6b79-4162-874b-4c7cd36c1ae2\") " Mar 16 16:27:46 crc kubenswrapper[5120]: I0316 16:27:46.193959 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gv4km\" (UniqueName: \"kubernetes.io/projected/96781f8d-3ff9-4c6c-a468-67785be1dfd7-kube-api-access-gv4km\") on node \"crc\" DevicePath \"\"" Mar 16 16:27:46 crc kubenswrapper[5120]: I0316 16:27:46.193990 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/96781f8d-3ff9-4c6c-a468-67785be1dfd7-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:27:46 crc kubenswrapper[5120]: I0316 16:27:46.194002 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g8pgm\" (UniqueName: \"kubernetes.io/projected/a9e8e595-2161-4919-89fa-98913dc78df6-kube-api-access-g8pgm\") on node \"crc\" DevicePath \"\"" Mar 16 16:27:46 crc kubenswrapper[5120]: I0316 16:27:46.194014 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r5xkd\" (UniqueName: \"kubernetes.io/projected/f45bc0f5-319a-407a-b329-ebad473733f6-kube-api-access-r5xkd\") on node \"crc\" DevicePath \"\"" Mar 16 16:27:46 crc kubenswrapper[5120]: I0316 16:27:46.194024 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f45bc0f5-319a-407a-b329-ebad473733f6-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:27:46 crc kubenswrapper[5120]: I0316 16:27:46.194035 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a9e8e595-2161-4919-89fa-98913dc78df6-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:27:46 crc kubenswrapper[5120]: I0316 16:27:46.195683 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c7086f4e-6b79-4162-874b-4c7cd36c1ae2-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "c7086f4e-6b79-4162-874b-4c7cd36c1ae2" (UID: "c7086f4e-6b79-4162-874b-4c7cd36c1ae2"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:27:46 crc kubenswrapper[5120]: I0316 16:27:46.200114 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7086f4e-6b79-4162-874b-4c7cd36c1ae2-kube-api-access-jpsfl" (OuterVolumeSpecName: "kube-api-access-jpsfl") pod "c7086f4e-6b79-4162-874b-4c7cd36c1ae2" (UID: "c7086f4e-6b79-4162-874b-4c7cd36c1ae2"). InnerVolumeSpecName "kube-api-access-jpsfl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:27:46 crc kubenswrapper[5120]: I0316 16:27:46.237583 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-db-create-4fxk5" event={"ID":"a9e8e595-2161-4919-89fa-98913dc78df6","Type":"ContainerDied","Data":"22d0a40cc257f82c8a84720a7c40120b747eeec7cebfbb10269b76c4125104d6"} Mar 16 16:27:46 crc kubenswrapper[5120]: I0316 16:27:46.237621 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="22d0a40cc257f82c8a84720a7c40120b747eeec7cebfbb10269b76c4125104d6" Mar 16 16:27:46 crc kubenswrapper[5120]: I0316 16:27:46.237635 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-db-create-4fxk5" Mar 16 16:27:46 crc kubenswrapper[5120]: I0316 16:27:46.241051 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-5b46-account-create-update-2448q" event={"ID":"96781f8d-3ff9-4c6c-a468-67785be1dfd7","Type":"ContainerDied","Data":"a311d8c11a3189b72b3db43cf5f94293725e15c2180d5a75df5b927b3398ee12"} Mar 16 16:27:46 crc kubenswrapper[5120]: I0316 16:27:46.241076 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a311d8c11a3189b72b3db43cf5f94293725e15c2180d5a75df5b927b3398ee12" Mar 16 16:27:46 crc kubenswrapper[5120]: I0316 16:27:46.241132 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-5b46-account-create-update-2448q" Mar 16 16:27:46 crc kubenswrapper[5120]: I0316 16:27:46.246681 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-db-create-xpjdr" event={"ID":"f45bc0f5-319a-407a-b329-ebad473733f6","Type":"ContainerDied","Data":"e8e83732968de16d96d18055a4b92768d8b69b1f20baa428078907538aecfdb5"} Mar 16 16:27:46 crc kubenswrapper[5120]: I0316 16:27:46.246833 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e8e83732968de16d96d18055a4b92768d8b69b1f20baa428078907538aecfdb5" Mar 16 16:27:46 crc kubenswrapper[5120]: I0316 16:27:46.246702 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-db-create-xpjdr" Mar 16 16:27:46 crc kubenswrapper[5120]: I0316 16:27:46.249061 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-af27-account-create-update-glkjg" event={"ID":"b11f89f6-cba8-4f94-ac51-8f4d514e54fb","Type":"ContainerDied","Data":"b1f5264f0eacb2a001c3ca418f86d1e6f618cbcbe19644a819a054306942f2c4"} Mar 16 16:27:46 crc kubenswrapper[5120]: I0316 16:27:46.249095 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b1f5264f0eacb2a001c3ca418f86d1e6f618cbcbe19644a819a054306942f2c4" Mar 16 16:27:46 crc kubenswrapper[5120]: I0316 16:27:46.249167 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-af27-account-create-update-glkjg" Mar 16 16:27:46 crc kubenswrapper[5120]: I0316 16:27:46.254874 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"2245156d-93ad-46d7-ad01-665808d694f0","Type":"ContainerStarted","Data":"8e457f92e6c9c1c9ea85958426b0b648408763e3f46ef966941e24d89525e149"} Mar 16 16:27:46 crc kubenswrapper[5120]: I0316 16:27:46.258917 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-d7e4-account-create-update-7b8tk" Mar 16 16:27:46 crc kubenswrapper[5120]: I0316 16:27:46.261820 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-d7e4-account-create-update-7b8tk" event={"ID":"c7086f4e-6b79-4162-874b-4c7cd36c1ae2","Type":"ContainerDied","Data":"7df8c7bb57117f8412438b879e3aa980f0c8e88e81992a24509019f60d9752a9"} Mar 16 16:27:46 crc kubenswrapper[5120]: I0316 16:27:46.261871 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7df8c7bb57117f8412438b879e3aa980f0c8e88e81992a24509019f60d9752a9" Mar 16 16:27:46 crc kubenswrapper[5120]: I0316 16:27:46.296748 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c7086f4e-6b79-4162-874b-4c7cd36c1ae2-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:27:46 crc kubenswrapper[5120]: I0316 16:27:46.296803 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jpsfl\" (UniqueName: \"kubernetes.io/projected/c7086f4e-6b79-4162-874b-4c7cd36c1ae2-kube-api-access-jpsfl\") on node \"crc\" DevicePath \"\"" Mar 16 16:27:46 crc kubenswrapper[5120]: I0316 16:27:46.946024 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:27:47 crc kubenswrapper[5120]: I0316 16:27:47.270297 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"2245156d-93ad-46d7-ad01-665808d694f0","Type":"ContainerStarted","Data":"a989f7ffc41666b044b5d0f5eef2d167de9054365ae8ab3620487d460ecaf8ec"} Mar 16 16:27:47 crc kubenswrapper[5120]: I0316 16:27:47.281946 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-h8hsk"] Mar 16 16:27:47 crc kubenswrapper[5120]: I0316 16:27:47.283091 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9e8e595-2161-4919-89fa-98913dc78df6" containerName="mariadb-database-create" Mar 16 16:27:47 crc kubenswrapper[5120]: I0316 16:27:47.283109 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9e8e595-2161-4919-89fa-98913dc78df6" containerName="mariadb-database-create" Mar 16 16:27:47 crc kubenswrapper[5120]: I0316 16:27:47.283136 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f45bc0f5-319a-407a-b329-ebad473733f6" containerName="mariadb-database-create" Mar 16 16:27:47 crc kubenswrapper[5120]: I0316 16:27:47.283143 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f45bc0f5-319a-407a-b329-ebad473733f6" containerName="mariadb-database-create" Mar 16 16:27:47 crc kubenswrapper[5120]: I0316 16:27:47.283156 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96781f8d-3ff9-4c6c-a468-67785be1dfd7" containerName="mariadb-account-create-update" Mar 16 16:27:47 crc kubenswrapper[5120]: I0316 16:27:47.283162 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="96781f8d-3ff9-4c6c-a468-67785be1dfd7" containerName="mariadb-account-create-update" Mar 16 16:27:47 crc kubenswrapper[5120]: I0316 16:27:47.283185 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7086f4e-6b79-4162-874b-4c7cd36c1ae2" containerName="mariadb-account-create-update" Mar 16 16:27:47 crc kubenswrapper[5120]: I0316 16:27:47.283191 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7086f4e-6b79-4162-874b-4c7cd36c1ae2" containerName="mariadb-account-create-update" Mar 16 16:27:47 crc kubenswrapper[5120]: I0316 16:27:47.283215 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b11f89f6-cba8-4f94-ac51-8f4d514e54fb" containerName="mariadb-account-create-update" Mar 16 16:27:47 crc kubenswrapper[5120]: I0316 16:27:47.283220 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="b11f89f6-cba8-4f94-ac51-8f4d514e54fb" containerName="mariadb-account-create-update" Mar 16 16:27:47 crc kubenswrapper[5120]: I0316 16:27:47.283230 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06d95d7b-0750-49bf-b877-8f94a33ef71d" containerName="mariadb-database-create" Mar 16 16:27:47 crc kubenswrapper[5120]: I0316 16:27:47.283236 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="06d95d7b-0750-49bf-b877-8f94a33ef71d" containerName="mariadb-database-create" Mar 16 16:27:47 crc kubenswrapper[5120]: I0316 16:27:47.283408 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f45bc0f5-319a-407a-b329-ebad473733f6" containerName="mariadb-database-create" Mar 16 16:27:47 crc kubenswrapper[5120]: I0316 16:27:47.283419 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="06d95d7b-0750-49bf-b877-8f94a33ef71d" containerName="mariadb-database-create" Mar 16 16:27:47 crc kubenswrapper[5120]: I0316 16:27:47.283433 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c7086f4e-6b79-4162-874b-4c7cd36c1ae2" containerName="mariadb-account-create-update" Mar 16 16:27:47 crc kubenswrapper[5120]: I0316 16:27:47.283445 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="a9e8e595-2161-4919-89fa-98913dc78df6" containerName="mariadb-database-create" Mar 16 16:27:47 crc kubenswrapper[5120]: I0316 16:27:47.283457 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="96781f8d-3ff9-4c6c-a468-67785be1dfd7" containerName="mariadb-account-create-update" Mar 16 16:27:47 crc kubenswrapper[5120]: I0316 16:27:47.283469 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="b11f89f6-cba8-4f94-ac51-8f4d514e54fb" containerName="mariadb-account-create-update" Mar 16 16:27:47 crc kubenswrapper[5120]: I0316 16:27:47.287541 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-h8hsk" Mar 16 16:27:47 crc kubenswrapper[5120]: I0316 16:27:47.292699 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-h8hsk"] Mar 16 16:27:47 crc kubenswrapper[5120]: I0316 16:27:47.293577 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-conductor-scripts\"" Mar 16 16:27:47 crc kubenswrapper[5120]: I0316 16:27:47.294343 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-nova-dockercfg-sfq9d\"" Mar 16 16:27:47 crc kubenswrapper[5120]: I0316 16:27:47.294489 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-conductor-config-data\"" Mar 16 16:27:47 crc kubenswrapper[5120]: I0316 16:27:47.336104 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/08073bb9-e6b3-429c-ba4e-eb22a745252e-config-data\") pod \"nova-cell0-conductor-db-sync-h8hsk\" (UID: \"08073bb9-e6b3-429c-ba4e-eb22a745252e\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-h8hsk" Mar 16 16:27:47 crc kubenswrapper[5120]: I0316 16:27:47.336429 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/08073bb9-e6b3-429c-ba4e-eb22a745252e-combined-ca-bundle\") pod \"nova-cell0-conductor-db-sync-h8hsk\" (UID: \"08073bb9-e6b3-429c-ba4e-eb22a745252e\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-h8hsk" Mar 16 16:27:47 crc kubenswrapper[5120]: I0316 16:27:47.336606 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/08073bb9-e6b3-429c-ba4e-eb22a745252e-scripts\") pod \"nova-cell0-conductor-db-sync-h8hsk\" (UID: \"08073bb9-e6b3-429c-ba4e-eb22a745252e\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-h8hsk" Mar 16 16:27:47 crc kubenswrapper[5120]: I0316 16:27:47.336955 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqkzj\" (UniqueName: \"kubernetes.io/projected/08073bb9-e6b3-429c-ba4e-eb22a745252e-kube-api-access-sqkzj\") pod \"nova-cell0-conductor-db-sync-h8hsk\" (UID: \"08073bb9-e6b3-429c-ba4e-eb22a745252e\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-h8hsk" Mar 16 16:27:47 crc kubenswrapper[5120]: I0316 16:27:47.438647 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/08073bb9-e6b3-429c-ba4e-eb22a745252e-config-data\") pod \"nova-cell0-conductor-db-sync-h8hsk\" (UID: \"08073bb9-e6b3-429c-ba4e-eb22a745252e\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-h8hsk" Mar 16 16:27:47 crc kubenswrapper[5120]: I0316 16:27:47.438834 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/08073bb9-e6b3-429c-ba4e-eb22a745252e-combined-ca-bundle\") pod \"nova-cell0-conductor-db-sync-h8hsk\" (UID: \"08073bb9-e6b3-429c-ba4e-eb22a745252e\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-h8hsk" Mar 16 16:27:47 crc kubenswrapper[5120]: I0316 16:27:47.438959 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/08073bb9-e6b3-429c-ba4e-eb22a745252e-scripts\") pod \"nova-cell0-conductor-db-sync-h8hsk\" (UID: \"08073bb9-e6b3-429c-ba4e-eb22a745252e\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-h8hsk" Mar 16 16:27:47 crc kubenswrapper[5120]: I0316 16:27:47.439079 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sqkzj\" (UniqueName: \"kubernetes.io/projected/08073bb9-e6b3-429c-ba4e-eb22a745252e-kube-api-access-sqkzj\") pod \"nova-cell0-conductor-db-sync-h8hsk\" (UID: \"08073bb9-e6b3-429c-ba4e-eb22a745252e\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-h8hsk" Mar 16 16:27:47 crc kubenswrapper[5120]: I0316 16:27:47.445790 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/08073bb9-e6b3-429c-ba4e-eb22a745252e-scripts\") pod \"nova-cell0-conductor-db-sync-h8hsk\" (UID: \"08073bb9-e6b3-429c-ba4e-eb22a745252e\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-h8hsk" Mar 16 16:27:47 crc kubenswrapper[5120]: I0316 16:27:47.447495 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/08073bb9-e6b3-429c-ba4e-eb22a745252e-config-data\") pod \"nova-cell0-conductor-db-sync-h8hsk\" (UID: \"08073bb9-e6b3-429c-ba4e-eb22a745252e\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-h8hsk" Mar 16 16:27:47 crc kubenswrapper[5120]: I0316 16:27:47.447995 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/08073bb9-e6b3-429c-ba4e-eb22a745252e-combined-ca-bundle\") pod \"nova-cell0-conductor-db-sync-h8hsk\" (UID: \"08073bb9-e6b3-429c-ba4e-eb22a745252e\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-h8hsk" Mar 16 16:27:47 crc kubenswrapper[5120]: I0316 16:27:47.455643 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqkzj\" (UniqueName: \"kubernetes.io/projected/08073bb9-e6b3-429c-ba4e-eb22a745252e-kube-api-access-sqkzj\") pod \"nova-cell0-conductor-db-sync-h8hsk\" (UID: \"08073bb9-e6b3-429c-ba4e-eb22a745252e\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-h8hsk" Mar 16 16:27:47 crc kubenswrapper[5120]: I0316 16:27:47.581496 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/neutron-796df7d745-6tvph" Mar 16 16:27:47 crc kubenswrapper[5120]: I0316 16:27:47.654637 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-h8hsk" Mar 16 16:27:48 crc kubenswrapper[5120]: I0316 16:27:48.157734 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-h8hsk"] Mar 16 16:27:48 crc kubenswrapper[5120]: W0316 16:27:48.163597 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod08073bb9_e6b3_429c_ba4e_eb22a745252e.slice/crio-d474d35c39649b0434e60104dbe29e838e154f066c01f1699c778849a4f59c34 WatchSource:0}: Error finding container d474d35c39649b0434e60104dbe29e838e154f066c01f1699c778849a4f59c34: Status 404 returned error can't find the container with id d474d35c39649b0434e60104dbe29e838e154f066c01f1699c778849a4f59c34 Mar 16 16:27:48 crc kubenswrapper[5120]: I0316 16:27:48.317384 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-h8hsk" event={"ID":"08073bb9-e6b3-429c-ba4e-eb22a745252e","Type":"ContainerStarted","Data":"d474d35c39649b0434e60104dbe29e838e154f066c01f1699c778849a4f59c34"} Mar 16 16:27:49 crc kubenswrapper[5120]: I0316 16:27:49.335810 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"2245156d-93ad-46d7-ad01-665808d694f0","Type":"ContainerStarted","Data":"6eb945a49c098f5ed8580340be7bbe08e3db96a84cd6d8e9c76ace41eb247247"} Mar 16 16:27:49 crc kubenswrapper[5120]: I0316 16:27:49.336160 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:27:49 crc kubenswrapper[5120]: I0316 16:27:49.336011 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="2245156d-93ad-46d7-ad01-665808d694f0" containerName="proxy-httpd" containerID="cri-o://6eb945a49c098f5ed8580340be7bbe08e3db96a84cd6d8e9c76ace41eb247247" gracePeriod=30 Mar 16 16:27:49 crc kubenswrapper[5120]: I0316 16:27:49.335952 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="2245156d-93ad-46d7-ad01-665808d694f0" containerName="ceilometer-central-agent" containerID="cri-o://096e7b14a2a0ea5024629b8f93c8cb79609e03ba732a618c0044579f24020160" gracePeriod=30 Mar 16 16:27:49 crc kubenswrapper[5120]: I0316 16:27:49.336044 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="2245156d-93ad-46d7-ad01-665808d694f0" containerName="sg-core" containerID="cri-o://a989f7ffc41666b044b5d0f5eef2d167de9054365ae8ab3620487d460ecaf8ec" gracePeriod=30 Mar 16 16:27:49 crc kubenswrapper[5120]: I0316 16:27:49.336039 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="2245156d-93ad-46d7-ad01-665808d694f0" containerName="ceilometer-notification-agent" containerID="cri-o://8e457f92e6c9c1c9ea85958426b0b648408763e3f46ef966941e24d89525e149" gracePeriod=30 Mar 16 16:27:49 crc kubenswrapper[5120]: I0316 16:27:49.340689 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-h8hsk" event={"ID":"08073bb9-e6b3-429c-ba4e-eb22a745252e","Type":"ContainerStarted","Data":"d02f6f0569175dc3b390375b76930ff0767123b353b32d8975594e7d2e8d83b7"} Mar 16 16:27:49 crc kubenswrapper[5120]: I0316 16:27:49.376937 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.146460737 podStartE2EDuration="6.37691748s" podCreationTimestamp="2026-03-16 16:27:43 +0000 UTC" firstStartedPulling="2026-03-16 16:27:44.23548196 +0000 UTC m=+3366.389413617" lastFinishedPulling="2026-03-16 16:27:48.465938693 +0000 UTC m=+3370.619870360" observedRunningTime="2026-03-16 16:27:49.36047899 +0000 UTC m=+3371.514410647" watchObservedRunningTime="2026-03-16 16:27:49.37691748 +0000 UTC m=+3371.530849137" Mar 16 16:27:49 crc kubenswrapper[5120]: I0316 16:27:49.389119 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-h8hsk" podStartSLOduration=2.389095866 podStartE2EDuration="2.389095866s" podCreationTimestamp="2026-03-16 16:27:47 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:27:49.379569401 +0000 UTC m=+3371.533501058" watchObservedRunningTime="2026-03-16 16:27:49.389095866 +0000 UTC m=+3371.543027533" Mar 16 16:27:49 crc kubenswrapper[5120]: I0316 16:27:49.692773 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/neutron-59d4fdd9db-tttbf" Mar 16 16:27:49 crc kubenswrapper[5120]: I0316 16:27:49.785850 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-796df7d745-6tvph"] Mar 16 16:27:49 crc kubenswrapper[5120]: I0316 16:27:49.786116 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-796df7d745-6tvph" podUID="a4b43784-8e78-434c-a053-23184660c355" containerName="neutron-api" containerID="cri-o://8f91d16f6cc5bc2fcc55b3ca74be0509c763faa9d96bbaa629522702245cf31a" gracePeriod=30 Mar 16 16:27:49 crc kubenswrapper[5120]: I0316 16:27:49.786219 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-796df7d745-6tvph" podUID="a4b43784-8e78-434c-a053-23184660c355" containerName="neutron-httpd" containerID="cri-o://23c7dd0e30293a8c34381be9a7c9e6a51d0b082b8ec0ec6fd0c4d48e23ca97af" gracePeriod=30 Mar 16 16:27:50 crc kubenswrapper[5120]: I0316 16:27:50.210636 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:27:50 crc kubenswrapper[5120]: I0316 16:27:50.312512 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2245156d-93ad-46d7-ad01-665808d694f0-config-data\") pod \"2245156d-93ad-46d7-ad01-665808d694f0\" (UID: \"2245156d-93ad-46d7-ad01-665808d694f0\") " Mar 16 16:27:50 crc kubenswrapper[5120]: I0316 16:27:50.312858 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qphtc\" (UniqueName: \"kubernetes.io/projected/2245156d-93ad-46d7-ad01-665808d694f0-kube-api-access-qphtc\") pod \"2245156d-93ad-46d7-ad01-665808d694f0\" (UID: \"2245156d-93ad-46d7-ad01-665808d694f0\") " Mar 16 16:27:50 crc kubenswrapper[5120]: I0316 16:27:50.312920 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2245156d-93ad-46d7-ad01-665808d694f0-scripts\") pod \"2245156d-93ad-46d7-ad01-665808d694f0\" (UID: \"2245156d-93ad-46d7-ad01-665808d694f0\") " Mar 16 16:27:50 crc kubenswrapper[5120]: I0316 16:27:50.312984 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2245156d-93ad-46d7-ad01-665808d694f0-log-httpd\") pod \"2245156d-93ad-46d7-ad01-665808d694f0\" (UID: \"2245156d-93ad-46d7-ad01-665808d694f0\") " Mar 16 16:27:50 crc kubenswrapper[5120]: I0316 16:27:50.313232 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2245156d-93ad-46d7-ad01-665808d694f0-run-httpd\") pod \"2245156d-93ad-46d7-ad01-665808d694f0\" (UID: \"2245156d-93ad-46d7-ad01-665808d694f0\") " Mar 16 16:27:50 crc kubenswrapper[5120]: I0316 16:27:50.313336 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/2245156d-93ad-46d7-ad01-665808d694f0-sg-core-conf-yaml\") pod \"2245156d-93ad-46d7-ad01-665808d694f0\" (UID: \"2245156d-93ad-46d7-ad01-665808d694f0\") " Mar 16 16:27:50 crc kubenswrapper[5120]: I0316 16:27:50.313595 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2245156d-93ad-46d7-ad01-665808d694f0-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "2245156d-93ad-46d7-ad01-665808d694f0" (UID: "2245156d-93ad-46d7-ad01-665808d694f0"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:27:50 crc kubenswrapper[5120]: I0316 16:27:50.313729 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2245156d-93ad-46d7-ad01-665808d694f0-combined-ca-bundle\") pod \"2245156d-93ad-46d7-ad01-665808d694f0\" (UID: \"2245156d-93ad-46d7-ad01-665808d694f0\") " Mar 16 16:27:50 crc kubenswrapper[5120]: I0316 16:27:50.314742 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2245156d-93ad-46d7-ad01-665808d694f0-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:27:50 crc kubenswrapper[5120]: I0316 16:27:50.315719 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2245156d-93ad-46d7-ad01-665808d694f0-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "2245156d-93ad-46d7-ad01-665808d694f0" (UID: "2245156d-93ad-46d7-ad01-665808d694f0"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:27:50 crc kubenswrapper[5120]: I0316 16:27:50.319187 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2245156d-93ad-46d7-ad01-665808d694f0-scripts" (OuterVolumeSpecName: "scripts") pod "2245156d-93ad-46d7-ad01-665808d694f0" (UID: "2245156d-93ad-46d7-ad01-665808d694f0"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:27:50 crc kubenswrapper[5120]: I0316 16:27:50.325492 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2245156d-93ad-46d7-ad01-665808d694f0-kube-api-access-qphtc" (OuterVolumeSpecName: "kube-api-access-qphtc") pod "2245156d-93ad-46d7-ad01-665808d694f0" (UID: "2245156d-93ad-46d7-ad01-665808d694f0"). InnerVolumeSpecName "kube-api-access-qphtc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:27:50 crc kubenswrapper[5120]: I0316 16:27:50.354691 5120 generic.go:358] "Generic (PLEG): container finished" podID="a4b43784-8e78-434c-a053-23184660c355" containerID="23c7dd0e30293a8c34381be9a7c9e6a51d0b082b8ec0ec6fd0c4d48e23ca97af" exitCode=0 Mar 16 16:27:50 crc kubenswrapper[5120]: I0316 16:27:50.354807 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-796df7d745-6tvph" event={"ID":"a4b43784-8e78-434c-a053-23184660c355","Type":"ContainerDied","Data":"23c7dd0e30293a8c34381be9a7c9e6a51d0b082b8ec0ec6fd0c4d48e23ca97af"} Mar 16 16:27:50 crc kubenswrapper[5120]: I0316 16:27:50.358013 5120 generic.go:358] "Generic (PLEG): container finished" podID="2245156d-93ad-46d7-ad01-665808d694f0" containerID="6eb945a49c098f5ed8580340be7bbe08e3db96a84cd6d8e9c76ace41eb247247" exitCode=0 Mar 16 16:27:50 crc kubenswrapper[5120]: I0316 16:27:50.358042 5120 generic.go:358] "Generic (PLEG): container finished" podID="2245156d-93ad-46d7-ad01-665808d694f0" containerID="a989f7ffc41666b044b5d0f5eef2d167de9054365ae8ab3620487d460ecaf8ec" exitCode=2 Mar 16 16:27:50 crc kubenswrapper[5120]: I0316 16:27:50.358049 5120 generic.go:358] "Generic (PLEG): container finished" podID="2245156d-93ad-46d7-ad01-665808d694f0" containerID="8e457f92e6c9c1c9ea85958426b0b648408763e3f46ef966941e24d89525e149" exitCode=0 Mar 16 16:27:50 crc kubenswrapper[5120]: I0316 16:27:50.358055 5120 generic.go:358] "Generic (PLEG): container finished" podID="2245156d-93ad-46d7-ad01-665808d694f0" containerID="096e7b14a2a0ea5024629b8f93c8cb79609e03ba732a618c0044579f24020160" exitCode=0 Mar 16 16:27:50 crc kubenswrapper[5120]: I0316 16:27:50.358226 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:27:50 crc kubenswrapper[5120]: I0316 16:27:50.358472 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"2245156d-93ad-46d7-ad01-665808d694f0","Type":"ContainerDied","Data":"6eb945a49c098f5ed8580340be7bbe08e3db96a84cd6d8e9c76ace41eb247247"} Mar 16 16:27:50 crc kubenswrapper[5120]: I0316 16:27:50.358533 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"2245156d-93ad-46d7-ad01-665808d694f0","Type":"ContainerDied","Data":"a989f7ffc41666b044b5d0f5eef2d167de9054365ae8ab3620487d460ecaf8ec"} Mar 16 16:27:50 crc kubenswrapper[5120]: I0316 16:27:50.358549 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"2245156d-93ad-46d7-ad01-665808d694f0","Type":"ContainerDied","Data":"8e457f92e6c9c1c9ea85958426b0b648408763e3f46ef966941e24d89525e149"} Mar 16 16:27:50 crc kubenswrapper[5120]: I0316 16:27:50.358560 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"2245156d-93ad-46d7-ad01-665808d694f0","Type":"ContainerDied","Data":"096e7b14a2a0ea5024629b8f93c8cb79609e03ba732a618c0044579f24020160"} Mar 16 16:27:50 crc kubenswrapper[5120]: I0316 16:27:50.358575 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"2245156d-93ad-46d7-ad01-665808d694f0","Type":"ContainerDied","Data":"53cb4953afd4fe8ec571d07137c180b0ae3076cb3902abda6ceab98c2f735609"} Mar 16 16:27:50 crc kubenswrapper[5120]: I0316 16:27:50.358589 5120 scope.go:117] "RemoveContainer" containerID="6eb945a49c098f5ed8580340be7bbe08e3db96a84cd6d8e9c76ace41eb247247" Mar 16 16:27:50 crc kubenswrapper[5120]: I0316 16:27:50.382715 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2245156d-93ad-46d7-ad01-665808d694f0-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "2245156d-93ad-46d7-ad01-665808d694f0" (UID: "2245156d-93ad-46d7-ad01-665808d694f0"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:27:50 crc kubenswrapper[5120]: I0316 16:27:50.389547 5120 scope.go:117] "RemoveContainer" containerID="a989f7ffc41666b044b5d0f5eef2d167de9054365ae8ab3620487d460ecaf8ec" Mar 16 16:27:50 crc kubenswrapper[5120]: I0316 16:27:50.417431 5120 scope.go:117] "RemoveContainer" containerID="8e457f92e6c9c1c9ea85958426b0b648408763e3f46ef966941e24d89525e149" Mar 16 16:27:50 crc kubenswrapper[5120]: I0316 16:27:50.417598 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qphtc\" (UniqueName: \"kubernetes.io/projected/2245156d-93ad-46d7-ad01-665808d694f0-kube-api-access-qphtc\") on node \"crc\" DevicePath \"\"" Mar 16 16:27:50 crc kubenswrapper[5120]: I0316 16:27:50.417637 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2245156d-93ad-46d7-ad01-665808d694f0-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:27:50 crc kubenswrapper[5120]: I0316 16:27:50.417649 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2245156d-93ad-46d7-ad01-665808d694f0-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:27:50 crc kubenswrapper[5120]: I0316 16:27:50.417663 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/2245156d-93ad-46d7-ad01-665808d694f0-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 16:27:50 crc kubenswrapper[5120]: I0316 16:27:50.443004 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2245156d-93ad-46d7-ad01-665808d694f0-config-data" (OuterVolumeSpecName: "config-data") pod "2245156d-93ad-46d7-ad01-665808d694f0" (UID: "2245156d-93ad-46d7-ad01-665808d694f0"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:27:50 crc kubenswrapper[5120]: I0316 16:27:50.456832 5120 scope.go:117] "RemoveContainer" containerID="096e7b14a2a0ea5024629b8f93c8cb79609e03ba732a618c0044579f24020160" Mar 16 16:27:50 crc kubenswrapper[5120]: I0316 16:27:50.456997 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2245156d-93ad-46d7-ad01-665808d694f0-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "2245156d-93ad-46d7-ad01-665808d694f0" (UID: "2245156d-93ad-46d7-ad01-665808d694f0"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:27:50 crc kubenswrapper[5120]: I0316 16:27:50.491110 5120 scope.go:117] "RemoveContainer" containerID="6eb945a49c098f5ed8580340be7bbe08e3db96a84cd6d8e9c76ace41eb247247" Mar 16 16:27:50 crc kubenswrapper[5120]: E0316 16:27:50.491565 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6eb945a49c098f5ed8580340be7bbe08e3db96a84cd6d8e9c76ace41eb247247\": container with ID starting with 6eb945a49c098f5ed8580340be7bbe08e3db96a84cd6d8e9c76ace41eb247247 not found: ID does not exist" containerID="6eb945a49c098f5ed8580340be7bbe08e3db96a84cd6d8e9c76ace41eb247247" Mar 16 16:27:50 crc kubenswrapper[5120]: I0316 16:27:50.491606 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6eb945a49c098f5ed8580340be7bbe08e3db96a84cd6d8e9c76ace41eb247247"} err="failed to get container status \"6eb945a49c098f5ed8580340be7bbe08e3db96a84cd6d8e9c76ace41eb247247\": rpc error: code = NotFound desc = could not find container \"6eb945a49c098f5ed8580340be7bbe08e3db96a84cd6d8e9c76ace41eb247247\": container with ID starting with 6eb945a49c098f5ed8580340be7bbe08e3db96a84cd6d8e9c76ace41eb247247 not found: ID does not exist" Mar 16 16:27:50 crc kubenswrapper[5120]: I0316 16:27:50.491641 5120 scope.go:117] "RemoveContainer" containerID="a989f7ffc41666b044b5d0f5eef2d167de9054365ae8ab3620487d460ecaf8ec" Mar 16 16:27:50 crc kubenswrapper[5120]: E0316 16:27:50.492487 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a989f7ffc41666b044b5d0f5eef2d167de9054365ae8ab3620487d460ecaf8ec\": container with ID starting with a989f7ffc41666b044b5d0f5eef2d167de9054365ae8ab3620487d460ecaf8ec not found: ID does not exist" containerID="a989f7ffc41666b044b5d0f5eef2d167de9054365ae8ab3620487d460ecaf8ec" Mar 16 16:27:50 crc kubenswrapper[5120]: I0316 16:27:50.492520 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a989f7ffc41666b044b5d0f5eef2d167de9054365ae8ab3620487d460ecaf8ec"} err="failed to get container status \"a989f7ffc41666b044b5d0f5eef2d167de9054365ae8ab3620487d460ecaf8ec\": rpc error: code = NotFound desc = could not find container \"a989f7ffc41666b044b5d0f5eef2d167de9054365ae8ab3620487d460ecaf8ec\": container with ID starting with a989f7ffc41666b044b5d0f5eef2d167de9054365ae8ab3620487d460ecaf8ec not found: ID does not exist" Mar 16 16:27:50 crc kubenswrapper[5120]: I0316 16:27:50.492538 5120 scope.go:117] "RemoveContainer" containerID="8e457f92e6c9c1c9ea85958426b0b648408763e3f46ef966941e24d89525e149" Mar 16 16:27:50 crc kubenswrapper[5120]: E0316 16:27:50.492963 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e457f92e6c9c1c9ea85958426b0b648408763e3f46ef966941e24d89525e149\": container with ID starting with 8e457f92e6c9c1c9ea85958426b0b648408763e3f46ef966941e24d89525e149 not found: ID does not exist" containerID="8e457f92e6c9c1c9ea85958426b0b648408763e3f46ef966941e24d89525e149" Mar 16 16:27:50 crc kubenswrapper[5120]: I0316 16:27:50.493020 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e457f92e6c9c1c9ea85958426b0b648408763e3f46ef966941e24d89525e149"} err="failed to get container status \"8e457f92e6c9c1c9ea85958426b0b648408763e3f46ef966941e24d89525e149\": rpc error: code = NotFound desc = could not find container \"8e457f92e6c9c1c9ea85958426b0b648408763e3f46ef966941e24d89525e149\": container with ID starting with 8e457f92e6c9c1c9ea85958426b0b648408763e3f46ef966941e24d89525e149 not found: ID does not exist" Mar 16 16:27:50 crc kubenswrapper[5120]: I0316 16:27:50.493049 5120 scope.go:117] "RemoveContainer" containerID="096e7b14a2a0ea5024629b8f93c8cb79609e03ba732a618c0044579f24020160" Mar 16 16:27:50 crc kubenswrapper[5120]: E0316 16:27:50.493543 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"096e7b14a2a0ea5024629b8f93c8cb79609e03ba732a618c0044579f24020160\": container with ID starting with 096e7b14a2a0ea5024629b8f93c8cb79609e03ba732a618c0044579f24020160 not found: ID does not exist" containerID="096e7b14a2a0ea5024629b8f93c8cb79609e03ba732a618c0044579f24020160" Mar 16 16:27:50 crc kubenswrapper[5120]: I0316 16:27:50.493569 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"096e7b14a2a0ea5024629b8f93c8cb79609e03ba732a618c0044579f24020160"} err="failed to get container status \"096e7b14a2a0ea5024629b8f93c8cb79609e03ba732a618c0044579f24020160\": rpc error: code = NotFound desc = could not find container \"096e7b14a2a0ea5024629b8f93c8cb79609e03ba732a618c0044579f24020160\": container with ID starting with 096e7b14a2a0ea5024629b8f93c8cb79609e03ba732a618c0044579f24020160 not found: ID does not exist" Mar 16 16:27:50 crc kubenswrapper[5120]: I0316 16:27:50.493585 5120 scope.go:117] "RemoveContainer" containerID="6eb945a49c098f5ed8580340be7bbe08e3db96a84cd6d8e9c76ace41eb247247" Mar 16 16:27:50 crc kubenswrapper[5120]: I0316 16:27:50.493849 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6eb945a49c098f5ed8580340be7bbe08e3db96a84cd6d8e9c76ace41eb247247"} err="failed to get container status \"6eb945a49c098f5ed8580340be7bbe08e3db96a84cd6d8e9c76ace41eb247247\": rpc error: code = NotFound desc = could not find container \"6eb945a49c098f5ed8580340be7bbe08e3db96a84cd6d8e9c76ace41eb247247\": container with ID starting with 6eb945a49c098f5ed8580340be7bbe08e3db96a84cd6d8e9c76ace41eb247247 not found: ID does not exist" Mar 16 16:27:50 crc kubenswrapper[5120]: I0316 16:27:50.493893 5120 scope.go:117] "RemoveContainer" containerID="a989f7ffc41666b044b5d0f5eef2d167de9054365ae8ab3620487d460ecaf8ec" Mar 16 16:27:50 crc kubenswrapper[5120]: I0316 16:27:50.495238 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a989f7ffc41666b044b5d0f5eef2d167de9054365ae8ab3620487d460ecaf8ec"} err="failed to get container status \"a989f7ffc41666b044b5d0f5eef2d167de9054365ae8ab3620487d460ecaf8ec\": rpc error: code = NotFound desc = could not find container \"a989f7ffc41666b044b5d0f5eef2d167de9054365ae8ab3620487d460ecaf8ec\": container with ID starting with a989f7ffc41666b044b5d0f5eef2d167de9054365ae8ab3620487d460ecaf8ec not found: ID does not exist" Mar 16 16:27:50 crc kubenswrapper[5120]: I0316 16:27:50.495265 5120 scope.go:117] "RemoveContainer" containerID="8e457f92e6c9c1c9ea85958426b0b648408763e3f46ef966941e24d89525e149" Mar 16 16:27:50 crc kubenswrapper[5120]: I0316 16:27:50.495515 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e457f92e6c9c1c9ea85958426b0b648408763e3f46ef966941e24d89525e149"} err="failed to get container status \"8e457f92e6c9c1c9ea85958426b0b648408763e3f46ef966941e24d89525e149\": rpc error: code = NotFound desc = could not find container \"8e457f92e6c9c1c9ea85958426b0b648408763e3f46ef966941e24d89525e149\": container with ID starting with 8e457f92e6c9c1c9ea85958426b0b648408763e3f46ef966941e24d89525e149 not found: ID does not exist" Mar 16 16:27:50 crc kubenswrapper[5120]: I0316 16:27:50.495543 5120 scope.go:117] "RemoveContainer" containerID="096e7b14a2a0ea5024629b8f93c8cb79609e03ba732a618c0044579f24020160" Mar 16 16:27:50 crc kubenswrapper[5120]: I0316 16:27:50.495730 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"096e7b14a2a0ea5024629b8f93c8cb79609e03ba732a618c0044579f24020160"} err="failed to get container status \"096e7b14a2a0ea5024629b8f93c8cb79609e03ba732a618c0044579f24020160\": rpc error: code = NotFound desc = could not find container \"096e7b14a2a0ea5024629b8f93c8cb79609e03ba732a618c0044579f24020160\": container with ID starting with 096e7b14a2a0ea5024629b8f93c8cb79609e03ba732a618c0044579f24020160 not found: ID does not exist" Mar 16 16:27:50 crc kubenswrapper[5120]: I0316 16:27:50.495774 5120 scope.go:117] "RemoveContainer" containerID="6eb945a49c098f5ed8580340be7bbe08e3db96a84cd6d8e9c76ace41eb247247" Mar 16 16:27:50 crc kubenswrapper[5120]: I0316 16:27:50.496035 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6eb945a49c098f5ed8580340be7bbe08e3db96a84cd6d8e9c76ace41eb247247"} err="failed to get container status \"6eb945a49c098f5ed8580340be7bbe08e3db96a84cd6d8e9c76ace41eb247247\": rpc error: code = NotFound desc = could not find container \"6eb945a49c098f5ed8580340be7bbe08e3db96a84cd6d8e9c76ace41eb247247\": container with ID starting with 6eb945a49c098f5ed8580340be7bbe08e3db96a84cd6d8e9c76ace41eb247247 not found: ID does not exist" Mar 16 16:27:50 crc kubenswrapper[5120]: I0316 16:27:50.496071 5120 scope.go:117] "RemoveContainer" containerID="a989f7ffc41666b044b5d0f5eef2d167de9054365ae8ab3620487d460ecaf8ec" Mar 16 16:27:50 crc kubenswrapper[5120]: I0316 16:27:50.496361 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a989f7ffc41666b044b5d0f5eef2d167de9054365ae8ab3620487d460ecaf8ec"} err="failed to get container status \"a989f7ffc41666b044b5d0f5eef2d167de9054365ae8ab3620487d460ecaf8ec\": rpc error: code = NotFound desc = could not find container \"a989f7ffc41666b044b5d0f5eef2d167de9054365ae8ab3620487d460ecaf8ec\": container with ID starting with a989f7ffc41666b044b5d0f5eef2d167de9054365ae8ab3620487d460ecaf8ec not found: ID does not exist" Mar 16 16:27:50 crc kubenswrapper[5120]: I0316 16:27:50.496385 5120 scope.go:117] "RemoveContainer" containerID="8e457f92e6c9c1c9ea85958426b0b648408763e3f46ef966941e24d89525e149" Mar 16 16:27:50 crc kubenswrapper[5120]: I0316 16:27:50.496614 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e457f92e6c9c1c9ea85958426b0b648408763e3f46ef966941e24d89525e149"} err="failed to get container status \"8e457f92e6c9c1c9ea85958426b0b648408763e3f46ef966941e24d89525e149\": rpc error: code = NotFound desc = could not find container \"8e457f92e6c9c1c9ea85958426b0b648408763e3f46ef966941e24d89525e149\": container with ID starting with 8e457f92e6c9c1c9ea85958426b0b648408763e3f46ef966941e24d89525e149 not found: ID does not exist" Mar 16 16:27:50 crc kubenswrapper[5120]: I0316 16:27:50.496642 5120 scope.go:117] "RemoveContainer" containerID="096e7b14a2a0ea5024629b8f93c8cb79609e03ba732a618c0044579f24020160" Mar 16 16:27:50 crc kubenswrapper[5120]: I0316 16:27:50.496871 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"096e7b14a2a0ea5024629b8f93c8cb79609e03ba732a618c0044579f24020160"} err="failed to get container status \"096e7b14a2a0ea5024629b8f93c8cb79609e03ba732a618c0044579f24020160\": rpc error: code = NotFound desc = could not find container \"096e7b14a2a0ea5024629b8f93c8cb79609e03ba732a618c0044579f24020160\": container with ID starting with 096e7b14a2a0ea5024629b8f93c8cb79609e03ba732a618c0044579f24020160 not found: ID does not exist" Mar 16 16:27:50 crc kubenswrapper[5120]: I0316 16:27:50.496898 5120 scope.go:117] "RemoveContainer" containerID="6eb945a49c098f5ed8580340be7bbe08e3db96a84cd6d8e9c76ace41eb247247" Mar 16 16:27:50 crc kubenswrapper[5120]: I0316 16:27:50.497154 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6eb945a49c098f5ed8580340be7bbe08e3db96a84cd6d8e9c76ace41eb247247"} err="failed to get container status \"6eb945a49c098f5ed8580340be7bbe08e3db96a84cd6d8e9c76ace41eb247247\": rpc error: code = NotFound desc = could not find container \"6eb945a49c098f5ed8580340be7bbe08e3db96a84cd6d8e9c76ace41eb247247\": container with ID starting with 6eb945a49c098f5ed8580340be7bbe08e3db96a84cd6d8e9c76ace41eb247247 not found: ID does not exist" Mar 16 16:27:50 crc kubenswrapper[5120]: I0316 16:27:50.497183 5120 scope.go:117] "RemoveContainer" containerID="a989f7ffc41666b044b5d0f5eef2d167de9054365ae8ab3620487d460ecaf8ec" Mar 16 16:27:50 crc kubenswrapper[5120]: I0316 16:27:50.497695 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a989f7ffc41666b044b5d0f5eef2d167de9054365ae8ab3620487d460ecaf8ec"} err="failed to get container status \"a989f7ffc41666b044b5d0f5eef2d167de9054365ae8ab3620487d460ecaf8ec\": rpc error: code = NotFound desc = could not find container \"a989f7ffc41666b044b5d0f5eef2d167de9054365ae8ab3620487d460ecaf8ec\": container with ID starting with a989f7ffc41666b044b5d0f5eef2d167de9054365ae8ab3620487d460ecaf8ec not found: ID does not exist" Mar 16 16:27:50 crc kubenswrapper[5120]: I0316 16:27:50.497799 5120 scope.go:117] "RemoveContainer" containerID="8e457f92e6c9c1c9ea85958426b0b648408763e3f46ef966941e24d89525e149" Mar 16 16:27:50 crc kubenswrapper[5120]: I0316 16:27:50.498227 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e457f92e6c9c1c9ea85958426b0b648408763e3f46ef966941e24d89525e149"} err="failed to get container status \"8e457f92e6c9c1c9ea85958426b0b648408763e3f46ef966941e24d89525e149\": rpc error: code = NotFound desc = could not find container \"8e457f92e6c9c1c9ea85958426b0b648408763e3f46ef966941e24d89525e149\": container with ID starting with 8e457f92e6c9c1c9ea85958426b0b648408763e3f46ef966941e24d89525e149 not found: ID does not exist" Mar 16 16:27:50 crc kubenswrapper[5120]: I0316 16:27:50.498271 5120 scope.go:117] "RemoveContainer" containerID="096e7b14a2a0ea5024629b8f93c8cb79609e03ba732a618c0044579f24020160" Mar 16 16:27:50 crc kubenswrapper[5120]: I0316 16:27:50.498599 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"096e7b14a2a0ea5024629b8f93c8cb79609e03ba732a618c0044579f24020160"} err="failed to get container status \"096e7b14a2a0ea5024629b8f93c8cb79609e03ba732a618c0044579f24020160\": rpc error: code = NotFound desc = could not find container \"096e7b14a2a0ea5024629b8f93c8cb79609e03ba732a618c0044579f24020160\": container with ID starting with 096e7b14a2a0ea5024629b8f93c8cb79609e03ba732a618c0044579f24020160 not found: ID does not exist" Mar 16 16:27:50 crc kubenswrapper[5120]: I0316 16:27:50.520497 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2245156d-93ad-46d7-ad01-665808d694f0-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:27:50 crc kubenswrapper[5120]: I0316 16:27:50.520530 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2245156d-93ad-46d7-ad01-665808d694f0-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:27:50 crc kubenswrapper[5120]: I0316 16:27:50.707552 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:27:50 crc kubenswrapper[5120]: I0316 16:27:50.783560 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:27:50 crc kubenswrapper[5120]: I0316 16:27:50.802410 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:27:50 crc kubenswrapper[5120]: I0316 16:27:50.805155 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2245156d-93ad-46d7-ad01-665808d694f0" containerName="ceilometer-central-agent" Mar 16 16:27:50 crc kubenswrapper[5120]: I0316 16:27:50.805185 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="2245156d-93ad-46d7-ad01-665808d694f0" containerName="ceilometer-central-agent" Mar 16 16:27:50 crc kubenswrapper[5120]: I0316 16:27:50.805223 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2245156d-93ad-46d7-ad01-665808d694f0" containerName="sg-core" Mar 16 16:27:50 crc kubenswrapper[5120]: I0316 16:27:50.805232 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="2245156d-93ad-46d7-ad01-665808d694f0" containerName="sg-core" Mar 16 16:27:50 crc kubenswrapper[5120]: I0316 16:27:50.805287 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2245156d-93ad-46d7-ad01-665808d694f0" containerName="proxy-httpd" Mar 16 16:27:50 crc kubenswrapper[5120]: I0316 16:27:50.805296 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="2245156d-93ad-46d7-ad01-665808d694f0" containerName="proxy-httpd" Mar 16 16:27:50 crc kubenswrapper[5120]: I0316 16:27:50.805316 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2245156d-93ad-46d7-ad01-665808d694f0" containerName="ceilometer-notification-agent" Mar 16 16:27:50 crc kubenswrapper[5120]: I0316 16:27:50.805323 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="2245156d-93ad-46d7-ad01-665808d694f0" containerName="ceilometer-notification-agent" Mar 16 16:27:50 crc kubenswrapper[5120]: I0316 16:27:50.805528 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="2245156d-93ad-46d7-ad01-665808d694f0" containerName="ceilometer-notification-agent" Mar 16 16:27:50 crc kubenswrapper[5120]: I0316 16:27:50.805551 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="2245156d-93ad-46d7-ad01-665808d694f0" containerName="ceilometer-central-agent" Mar 16 16:27:50 crc kubenswrapper[5120]: I0316 16:27:50.805568 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="2245156d-93ad-46d7-ad01-665808d694f0" containerName="proxy-httpd" Mar 16 16:27:50 crc kubenswrapper[5120]: I0316 16:27:50.805585 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="2245156d-93ad-46d7-ad01-665808d694f0" containerName="sg-core" Mar 16 16:27:50 crc kubenswrapper[5120]: I0316 16:27:50.826586 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:27:50 crc kubenswrapper[5120]: I0316 16:27:50.826776 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:27:50 crc kubenswrapper[5120]: I0316 16:27:50.829316 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 16:27:50 crc kubenswrapper[5120]: I0316 16:27:50.829907 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 16:27:50 crc kubenswrapper[5120]: I0316 16:27:50.934205 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ecbe2394-e6b8-4b01-a620-d167d0341124-log-httpd\") pod \"ceilometer-0\" (UID: \"ecbe2394-e6b8-4b01-a620-d167d0341124\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:27:50 crc kubenswrapper[5120]: I0316 16:27:50.934454 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ecbe2394-e6b8-4b01-a620-d167d0341124-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"ecbe2394-e6b8-4b01-a620-d167d0341124\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:27:50 crc kubenswrapper[5120]: I0316 16:27:50.934517 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ecbe2394-e6b8-4b01-a620-d167d0341124-config-data\") pod \"ceilometer-0\" (UID: \"ecbe2394-e6b8-4b01-a620-d167d0341124\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:27:50 crc kubenswrapper[5120]: I0316 16:27:50.934581 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ecbe2394-e6b8-4b01-a620-d167d0341124-run-httpd\") pod \"ceilometer-0\" (UID: \"ecbe2394-e6b8-4b01-a620-d167d0341124\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:27:50 crc kubenswrapper[5120]: I0316 16:27:50.934679 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/ecbe2394-e6b8-4b01-a620-d167d0341124-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"ecbe2394-e6b8-4b01-a620-d167d0341124\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:27:50 crc kubenswrapper[5120]: I0316 16:27:50.934812 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tz4kj\" (UniqueName: \"kubernetes.io/projected/ecbe2394-e6b8-4b01-a620-d167d0341124-kube-api-access-tz4kj\") pod \"ceilometer-0\" (UID: \"ecbe2394-e6b8-4b01-a620-d167d0341124\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:27:50 crc kubenswrapper[5120]: I0316 16:27:50.934846 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ecbe2394-e6b8-4b01-a620-d167d0341124-scripts\") pod \"ceilometer-0\" (UID: \"ecbe2394-e6b8-4b01-a620-d167d0341124\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:27:51 crc kubenswrapper[5120]: I0316 16:27:51.037102 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ecbe2394-e6b8-4b01-a620-d167d0341124-config-data\") pod \"ceilometer-0\" (UID: \"ecbe2394-e6b8-4b01-a620-d167d0341124\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:27:51 crc kubenswrapper[5120]: I0316 16:27:51.037145 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ecbe2394-e6b8-4b01-a620-d167d0341124-run-httpd\") pod \"ceilometer-0\" (UID: \"ecbe2394-e6b8-4b01-a620-d167d0341124\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:27:51 crc kubenswrapper[5120]: I0316 16:27:51.037222 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/ecbe2394-e6b8-4b01-a620-d167d0341124-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"ecbe2394-e6b8-4b01-a620-d167d0341124\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:27:51 crc kubenswrapper[5120]: I0316 16:27:51.037294 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tz4kj\" (UniqueName: \"kubernetes.io/projected/ecbe2394-e6b8-4b01-a620-d167d0341124-kube-api-access-tz4kj\") pod \"ceilometer-0\" (UID: \"ecbe2394-e6b8-4b01-a620-d167d0341124\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:27:51 crc kubenswrapper[5120]: I0316 16:27:51.037316 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ecbe2394-e6b8-4b01-a620-d167d0341124-scripts\") pod \"ceilometer-0\" (UID: \"ecbe2394-e6b8-4b01-a620-d167d0341124\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:27:51 crc kubenswrapper[5120]: I0316 16:27:51.037398 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ecbe2394-e6b8-4b01-a620-d167d0341124-log-httpd\") pod \"ceilometer-0\" (UID: \"ecbe2394-e6b8-4b01-a620-d167d0341124\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:27:51 crc kubenswrapper[5120]: I0316 16:27:51.037546 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ecbe2394-e6b8-4b01-a620-d167d0341124-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"ecbe2394-e6b8-4b01-a620-d167d0341124\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:27:51 crc kubenswrapper[5120]: I0316 16:27:51.038423 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ecbe2394-e6b8-4b01-a620-d167d0341124-run-httpd\") pod \"ceilometer-0\" (UID: \"ecbe2394-e6b8-4b01-a620-d167d0341124\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:27:51 crc kubenswrapper[5120]: I0316 16:27:51.038590 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ecbe2394-e6b8-4b01-a620-d167d0341124-log-httpd\") pod \"ceilometer-0\" (UID: \"ecbe2394-e6b8-4b01-a620-d167d0341124\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:27:51 crc kubenswrapper[5120]: I0316 16:27:51.042021 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ecbe2394-e6b8-4b01-a620-d167d0341124-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"ecbe2394-e6b8-4b01-a620-d167d0341124\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:27:51 crc kubenswrapper[5120]: I0316 16:27:51.042264 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ecbe2394-e6b8-4b01-a620-d167d0341124-config-data\") pod \"ceilometer-0\" (UID: \"ecbe2394-e6b8-4b01-a620-d167d0341124\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:27:51 crc kubenswrapper[5120]: I0316 16:27:51.042777 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/ecbe2394-e6b8-4b01-a620-d167d0341124-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"ecbe2394-e6b8-4b01-a620-d167d0341124\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:27:51 crc kubenswrapper[5120]: I0316 16:27:51.057039 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ecbe2394-e6b8-4b01-a620-d167d0341124-scripts\") pod \"ceilometer-0\" (UID: \"ecbe2394-e6b8-4b01-a620-d167d0341124\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:27:51 crc kubenswrapper[5120]: I0316 16:27:51.057281 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tz4kj\" (UniqueName: \"kubernetes.io/projected/ecbe2394-e6b8-4b01-a620-d167d0341124-kube-api-access-tz4kj\") pod \"ceilometer-0\" (UID: \"ecbe2394-e6b8-4b01-a620-d167d0341124\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:27:51 crc kubenswrapper[5120]: I0316 16:27:51.150394 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:27:51 crc kubenswrapper[5120]: I0316 16:27:51.276446 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/swift-proxy-75575cf5bd-xrtzd" Mar 16 16:27:51 crc kubenswrapper[5120]: I0316 16:27:51.294147 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/swift-proxy-75575cf5bd-xrtzd" Mar 16 16:27:51 crc kubenswrapper[5120]: I0316 16:27:51.618497 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:27:51 crc kubenswrapper[5120]: W0316 16:27:51.624475 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podecbe2394_e6b8_4b01_a620_d167d0341124.slice/crio-211768fdff0e16b9588887ebb9fc10380ea2f01c10334775b53b1396fa61ee5c WatchSource:0}: Error finding container 211768fdff0e16b9588887ebb9fc10380ea2f01c10334775b53b1396fa61ee5c: Status 404 returned error can't find the container with id 211768fdff0e16b9588887ebb9fc10380ea2f01c10334775b53b1396fa61ee5c Mar 16 16:27:52 crc kubenswrapper[5120]: I0316 16:27:52.007890 5120 patch_prober.go:28] interesting pod/machine-config-daemon-7bf76 container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 16:27:52 crc kubenswrapper[5120]: I0316 16:27:52.008252 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 16:27:52 crc kubenswrapper[5120]: I0316 16:27:52.379608 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ecbe2394-e6b8-4b01-a620-d167d0341124","Type":"ContainerStarted","Data":"48fc1c45ca60ee2bf4788b29215d711c2a65a560713358f227fccc267ae02b17"} Mar 16 16:27:52 crc kubenswrapper[5120]: I0316 16:27:52.380001 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ecbe2394-e6b8-4b01-a620-d167d0341124","Type":"ContainerStarted","Data":"211768fdff0e16b9588887ebb9fc10380ea2f01c10334775b53b1396fa61ee5c"} Mar 16 16:27:52 crc kubenswrapper[5120]: I0316 16:27:52.481186 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:27:52 crc kubenswrapper[5120]: I0316 16:27:52.676842 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2245156d-93ad-46d7-ad01-665808d694f0" path="/var/lib/kubelet/pods/2245156d-93ad-46d7-ad01-665808d694f0/volumes" Mar 16 16:27:53 crc kubenswrapper[5120]: I0316 16:27:53.411714 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ecbe2394-e6b8-4b01-a620-d167d0341124","Type":"ContainerStarted","Data":"f9c8aec81a9b62f4c081b69d1a2c61afd292508e46e8715caa369cc87baa6efe"} Mar 16 16:27:54 crc kubenswrapper[5120]: I0316 16:27:54.424236 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ecbe2394-e6b8-4b01-a620-d167d0341124","Type":"ContainerStarted","Data":"7ae158419d4338fb5572b1cb7d7832a573bff38a390c2360ad9f7210602fe125"} Mar 16 16:27:56 crc kubenswrapper[5120]: I0316 16:27:56.448344 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ecbe2394-e6b8-4b01-a620-d167d0341124","Type":"ContainerStarted","Data":"6c4084b4624028184f679b56cd08906346c406c50fa214ce42d0a9f7d3e16234"} Mar 16 16:27:56 crc kubenswrapper[5120]: I0316 16:27:56.448878 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:27:56 crc kubenswrapper[5120]: I0316 16:27:56.448444 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="ecbe2394-e6b8-4b01-a620-d167d0341124" containerName="proxy-httpd" containerID="cri-o://6c4084b4624028184f679b56cd08906346c406c50fa214ce42d0a9f7d3e16234" gracePeriod=30 Mar 16 16:27:56 crc kubenswrapper[5120]: I0316 16:27:56.448408 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="ecbe2394-e6b8-4b01-a620-d167d0341124" containerName="ceilometer-central-agent" containerID="cri-o://48fc1c45ca60ee2bf4788b29215d711c2a65a560713358f227fccc267ae02b17" gracePeriod=30 Mar 16 16:27:56 crc kubenswrapper[5120]: I0316 16:27:56.448510 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="ecbe2394-e6b8-4b01-a620-d167d0341124" containerName="sg-core" containerID="cri-o://7ae158419d4338fb5572b1cb7d7832a573bff38a390c2360ad9f7210602fe125" gracePeriod=30 Mar 16 16:27:56 crc kubenswrapper[5120]: I0316 16:27:56.448507 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="ecbe2394-e6b8-4b01-a620-d167d0341124" containerName="ceilometer-notification-agent" containerID="cri-o://f9c8aec81a9b62f4c081b69d1a2c61afd292508e46e8715caa369cc87baa6efe" gracePeriod=30 Mar 16 16:27:56 crc kubenswrapper[5120]: I0316 16:27:56.474571 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.219540522 podStartE2EDuration="6.474553671s" podCreationTimestamp="2026-03-16 16:27:50 +0000 UTC" firstStartedPulling="2026-03-16 16:27:51.628178735 +0000 UTC m=+3373.782110392" lastFinishedPulling="2026-03-16 16:27:55.883191884 +0000 UTC m=+3378.037123541" observedRunningTime="2026-03-16 16:27:56.474252764 +0000 UTC m=+3378.628184431" watchObservedRunningTime="2026-03-16 16:27:56.474553671 +0000 UTC m=+3378.628485328" Mar 16 16:27:57 crc kubenswrapper[5120]: I0316 16:27:57.312430 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:27:57 crc kubenswrapper[5120]: I0316 16:27:57.399406 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ecbe2394-e6b8-4b01-a620-d167d0341124-combined-ca-bundle\") pod \"ecbe2394-e6b8-4b01-a620-d167d0341124\" (UID: \"ecbe2394-e6b8-4b01-a620-d167d0341124\") " Mar 16 16:27:57 crc kubenswrapper[5120]: I0316 16:27:57.399488 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ecbe2394-e6b8-4b01-a620-d167d0341124-run-httpd\") pod \"ecbe2394-e6b8-4b01-a620-d167d0341124\" (UID: \"ecbe2394-e6b8-4b01-a620-d167d0341124\") " Mar 16 16:27:57 crc kubenswrapper[5120]: I0316 16:27:57.399527 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tz4kj\" (UniqueName: \"kubernetes.io/projected/ecbe2394-e6b8-4b01-a620-d167d0341124-kube-api-access-tz4kj\") pod \"ecbe2394-e6b8-4b01-a620-d167d0341124\" (UID: \"ecbe2394-e6b8-4b01-a620-d167d0341124\") " Mar 16 16:27:57 crc kubenswrapper[5120]: I0316 16:27:57.399576 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ecbe2394-e6b8-4b01-a620-d167d0341124-log-httpd\") pod \"ecbe2394-e6b8-4b01-a620-d167d0341124\" (UID: \"ecbe2394-e6b8-4b01-a620-d167d0341124\") " Mar 16 16:27:57 crc kubenswrapper[5120]: I0316 16:27:57.399661 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ecbe2394-e6b8-4b01-a620-d167d0341124-config-data\") pod \"ecbe2394-e6b8-4b01-a620-d167d0341124\" (UID: \"ecbe2394-e6b8-4b01-a620-d167d0341124\") " Mar 16 16:27:57 crc kubenswrapper[5120]: I0316 16:27:57.400023 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ecbe2394-e6b8-4b01-a620-d167d0341124-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "ecbe2394-e6b8-4b01-a620-d167d0341124" (UID: "ecbe2394-e6b8-4b01-a620-d167d0341124"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:27:57 crc kubenswrapper[5120]: I0316 16:27:57.400050 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/ecbe2394-e6b8-4b01-a620-d167d0341124-sg-core-conf-yaml\") pod \"ecbe2394-e6b8-4b01-a620-d167d0341124\" (UID: \"ecbe2394-e6b8-4b01-a620-d167d0341124\") " Mar 16 16:27:57 crc kubenswrapper[5120]: I0316 16:27:57.400226 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ecbe2394-e6b8-4b01-a620-d167d0341124-scripts\") pod \"ecbe2394-e6b8-4b01-a620-d167d0341124\" (UID: \"ecbe2394-e6b8-4b01-a620-d167d0341124\") " Mar 16 16:27:57 crc kubenswrapper[5120]: I0316 16:27:57.400316 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ecbe2394-e6b8-4b01-a620-d167d0341124-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "ecbe2394-e6b8-4b01-a620-d167d0341124" (UID: "ecbe2394-e6b8-4b01-a620-d167d0341124"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:27:57 crc kubenswrapper[5120]: I0316 16:27:57.401445 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ecbe2394-e6b8-4b01-a620-d167d0341124-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:27:57 crc kubenswrapper[5120]: I0316 16:27:57.401461 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ecbe2394-e6b8-4b01-a620-d167d0341124-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:27:57 crc kubenswrapper[5120]: I0316 16:27:57.408285 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ecbe2394-e6b8-4b01-a620-d167d0341124-scripts" (OuterVolumeSpecName: "scripts") pod "ecbe2394-e6b8-4b01-a620-d167d0341124" (UID: "ecbe2394-e6b8-4b01-a620-d167d0341124"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:27:57 crc kubenswrapper[5120]: I0316 16:27:57.409977 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ecbe2394-e6b8-4b01-a620-d167d0341124-kube-api-access-tz4kj" (OuterVolumeSpecName: "kube-api-access-tz4kj") pod "ecbe2394-e6b8-4b01-a620-d167d0341124" (UID: "ecbe2394-e6b8-4b01-a620-d167d0341124"). InnerVolumeSpecName "kube-api-access-tz4kj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:27:57 crc kubenswrapper[5120]: I0316 16:27:57.431199 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ecbe2394-e6b8-4b01-a620-d167d0341124-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "ecbe2394-e6b8-4b01-a620-d167d0341124" (UID: "ecbe2394-e6b8-4b01-a620-d167d0341124"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:27:57 crc kubenswrapper[5120]: I0316 16:27:57.463153 5120 generic.go:358] "Generic (PLEG): container finished" podID="a4b43784-8e78-434c-a053-23184660c355" containerID="8f91d16f6cc5bc2fcc55b3ca74be0509c763faa9d96bbaa629522702245cf31a" exitCode=0 Mar 16 16:27:57 crc kubenswrapper[5120]: I0316 16:27:57.463230 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-796df7d745-6tvph" event={"ID":"a4b43784-8e78-434c-a053-23184660c355","Type":"ContainerDied","Data":"8f91d16f6cc5bc2fcc55b3ca74be0509c763faa9d96bbaa629522702245cf31a"} Mar 16 16:27:57 crc kubenswrapper[5120]: I0316 16:27:57.468057 5120 generic.go:358] "Generic (PLEG): container finished" podID="ecbe2394-e6b8-4b01-a620-d167d0341124" containerID="6c4084b4624028184f679b56cd08906346c406c50fa214ce42d0a9f7d3e16234" exitCode=0 Mar 16 16:27:57 crc kubenswrapper[5120]: I0316 16:27:57.468177 5120 generic.go:358] "Generic (PLEG): container finished" podID="ecbe2394-e6b8-4b01-a620-d167d0341124" containerID="7ae158419d4338fb5572b1cb7d7832a573bff38a390c2360ad9f7210602fe125" exitCode=2 Mar 16 16:27:57 crc kubenswrapper[5120]: I0316 16:27:57.468185 5120 generic.go:358] "Generic (PLEG): container finished" podID="ecbe2394-e6b8-4b01-a620-d167d0341124" containerID="f9c8aec81a9b62f4c081b69d1a2c61afd292508e46e8715caa369cc87baa6efe" exitCode=0 Mar 16 16:27:57 crc kubenswrapper[5120]: I0316 16:27:57.468192 5120 generic.go:358] "Generic (PLEG): container finished" podID="ecbe2394-e6b8-4b01-a620-d167d0341124" containerID="48fc1c45ca60ee2bf4788b29215d711c2a65a560713358f227fccc267ae02b17" exitCode=0 Mar 16 16:27:57 crc kubenswrapper[5120]: I0316 16:27:57.468238 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ecbe2394-e6b8-4b01-a620-d167d0341124","Type":"ContainerDied","Data":"6c4084b4624028184f679b56cd08906346c406c50fa214ce42d0a9f7d3e16234"} Mar 16 16:27:57 crc kubenswrapper[5120]: I0316 16:27:57.468274 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ecbe2394-e6b8-4b01-a620-d167d0341124","Type":"ContainerDied","Data":"7ae158419d4338fb5572b1cb7d7832a573bff38a390c2360ad9f7210602fe125"} Mar 16 16:27:57 crc kubenswrapper[5120]: I0316 16:27:57.468286 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ecbe2394-e6b8-4b01-a620-d167d0341124","Type":"ContainerDied","Data":"f9c8aec81a9b62f4c081b69d1a2c61afd292508e46e8715caa369cc87baa6efe"} Mar 16 16:27:57 crc kubenswrapper[5120]: I0316 16:27:57.468296 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ecbe2394-e6b8-4b01-a620-d167d0341124","Type":"ContainerDied","Data":"48fc1c45ca60ee2bf4788b29215d711c2a65a560713358f227fccc267ae02b17"} Mar 16 16:27:57 crc kubenswrapper[5120]: I0316 16:27:57.468306 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ecbe2394-e6b8-4b01-a620-d167d0341124","Type":"ContainerDied","Data":"211768fdff0e16b9588887ebb9fc10380ea2f01c10334775b53b1396fa61ee5c"} Mar 16 16:27:57 crc kubenswrapper[5120]: I0316 16:27:57.468323 5120 scope.go:117] "RemoveContainer" containerID="6c4084b4624028184f679b56cd08906346c406c50fa214ce42d0a9f7d3e16234" Mar 16 16:27:57 crc kubenswrapper[5120]: I0316 16:27:57.468340 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:27:57 crc kubenswrapper[5120]: I0316 16:27:57.498552 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ecbe2394-e6b8-4b01-a620-d167d0341124-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ecbe2394-e6b8-4b01-a620-d167d0341124" (UID: "ecbe2394-e6b8-4b01-a620-d167d0341124"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:27:57 crc kubenswrapper[5120]: I0316 16:27:57.503180 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/ecbe2394-e6b8-4b01-a620-d167d0341124-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 16:27:57 crc kubenswrapper[5120]: I0316 16:27:57.503212 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ecbe2394-e6b8-4b01-a620-d167d0341124-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:27:57 crc kubenswrapper[5120]: I0316 16:27:57.503222 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ecbe2394-e6b8-4b01-a620-d167d0341124-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:27:57 crc kubenswrapper[5120]: I0316 16:27:57.503230 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tz4kj\" (UniqueName: \"kubernetes.io/projected/ecbe2394-e6b8-4b01-a620-d167d0341124-kube-api-access-tz4kj\") on node \"crc\" DevicePath \"\"" Mar 16 16:27:57 crc kubenswrapper[5120]: I0316 16:27:57.514785 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ecbe2394-e6b8-4b01-a620-d167d0341124-config-data" (OuterVolumeSpecName: "config-data") pod "ecbe2394-e6b8-4b01-a620-d167d0341124" (UID: "ecbe2394-e6b8-4b01-a620-d167d0341124"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:27:57 crc kubenswrapper[5120]: I0316 16:27:57.532362 5120 scope.go:117] "RemoveContainer" containerID="7ae158419d4338fb5572b1cb7d7832a573bff38a390c2360ad9f7210602fe125" Mar 16 16:27:57 crc kubenswrapper[5120]: I0316 16:27:57.556527 5120 scope.go:117] "RemoveContainer" containerID="f9c8aec81a9b62f4c081b69d1a2c61afd292508e46e8715caa369cc87baa6efe" Mar 16 16:27:57 crc kubenswrapper[5120]: I0316 16:27:57.605325 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ecbe2394-e6b8-4b01-a620-d167d0341124-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:27:57 crc kubenswrapper[5120]: I0316 16:27:57.647059 5120 scope.go:117] "RemoveContainer" containerID="48fc1c45ca60ee2bf4788b29215d711c2a65a560713358f227fccc267ae02b17" Mar 16 16:27:57 crc kubenswrapper[5120]: I0316 16:27:57.684693 5120 scope.go:117] "RemoveContainer" containerID="6c4084b4624028184f679b56cd08906346c406c50fa214ce42d0a9f7d3e16234" Mar 16 16:27:57 crc kubenswrapper[5120]: E0316 16:27:57.685870 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c4084b4624028184f679b56cd08906346c406c50fa214ce42d0a9f7d3e16234\": container with ID starting with 6c4084b4624028184f679b56cd08906346c406c50fa214ce42d0a9f7d3e16234 not found: ID does not exist" containerID="6c4084b4624028184f679b56cd08906346c406c50fa214ce42d0a9f7d3e16234" Mar 16 16:27:57 crc kubenswrapper[5120]: I0316 16:27:57.685909 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c4084b4624028184f679b56cd08906346c406c50fa214ce42d0a9f7d3e16234"} err="failed to get container status \"6c4084b4624028184f679b56cd08906346c406c50fa214ce42d0a9f7d3e16234\": rpc error: code = NotFound desc = could not find container \"6c4084b4624028184f679b56cd08906346c406c50fa214ce42d0a9f7d3e16234\": container with ID starting with 6c4084b4624028184f679b56cd08906346c406c50fa214ce42d0a9f7d3e16234 not found: ID does not exist" Mar 16 16:27:57 crc kubenswrapper[5120]: I0316 16:27:57.685968 5120 scope.go:117] "RemoveContainer" containerID="7ae158419d4338fb5572b1cb7d7832a573bff38a390c2360ad9f7210602fe125" Mar 16 16:27:57 crc kubenswrapper[5120]: E0316 16:27:57.686367 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ae158419d4338fb5572b1cb7d7832a573bff38a390c2360ad9f7210602fe125\": container with ID starting with 7ae158419d4338fb5572b1cb7d7832a573bff38a390c2360ad9f7210602fe125 not found: ID does not exist" containerID="7ae158419d4338fb5572b1cb7d7832a573bff38a390c2360ad9f7210602fe125" Mar 16 16:27:57 crc kubenswrapper[5120]: I0316 16:27:57.686399 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ae158419d4338fb5572b1cb7d7832a573bff38a390c2360ad9f7210602fe125"} err="failed to get container status \"7ae158419d4338fb5572b1cb7d7832a573bff38a390c2360ad9f7210602fe125\": rpc error: code = NotFound desc = could not find container \"7ae158419d4338fb5572b1cb7d7832a573bff38a390c2360ad9f7210602fe125\": container with ID starting with 7ae158419d4338fb5572b1cb7d7832a573bff38a390c2360ad9f7210602fe125 not found: ID does not exist" Mar 16 16:27:57 crc kubenswrapper[5120]: I0316 16:27:57.686420 5120 scope.go:117] "RemoveContainer" containerID="f9c8aec81a9b62f4c081b69d1a2c61afd292508e46e8715caa369cc87baa6efe" Mar 16 16:27:57 crc kubenswrapper[5120]: E0316 16:27:57.686602 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f9c8aec81a9b62f4c081b69d1a2c61afd292508e46e8715caa369cc87baa6efe\": container with ID starting with f9c8aec81a9b62f4c081b69d1a2c61afd292508e46e8715caa369cc87baa6efe not found: ID does not exist" containerID="f9c8aec81a9b62f4c081b69d1a2c61afd292508e46e8715caa369cc87baa6efe" Mar 16 16:27:57 crc kubenswrapper[5120]: I0316 16:27:57.686625 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9c8aec81a9b62f4c081b69d1a2c61afd292508e46e8715caa369cc87baa6efe"} err="failed to get container status \"f9c8aec81a9b62f4c081b69d1a2c61afd292508e46e8715caa369cc87baa6efe\": rpc error: code = NotFound desc = could not find container \"f9c8aec81a9b62f4c081b69d1a2c61afd292508e46e8715caa369cc87baa6efe\": container with ID starting with f9c8aec81a9b62f4c081b69d1a2c61afd292508e46e8715caa369cc87baa6efe not found: ID does not exist" Mar 16 16:27:57 crc kubenswrapper[5120]: I0316 16:27:57.686645 5120 scope.go:117] "RemoveContainer" containerID="48fc1c45ca60ee2bf4788b29215d711c2a65a560713358f227fccc267ae02b17" Mar 16 16:27:57 crc kubenswrapper[5120]: E0316 16:27:57.686907 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"48fc1c45ca60ee2bf4788b29215d711c2a65a560713358f227fccc267ae02b17\": container with ID starting with 48fc1c45ca60ee2bf4788b29215d711c2a65a560713358f227fccc267ae02b17 not found: ID does not exist" containerID="48fc1c45ca60ee2bf4788b29215d711c2a65a560713358f227fccc267ae02b17" Mar 16 16:27:57 crc kubenswrapper[5120]: I0316 16:27:57.686933 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48fc1c45ca60ee2bf4788b29215d711c2a65a560713358f227fccc267ae02b17"} err="failed to get container status \"48fc1c45ca60ee2bf4788b29215d711c2a65a560713358f227fccc267ae02b17\": rpc error: code = NotFound desc = could not find container \"48fc1c45ca60ee2bf4788b29215d711c2a65a560713358f227fccc267ae02b17\": container with ID starting with 48fc1c45ca60ee2bf4788b29215d711c2a65a560713358f227fccc267ae02b17 not found: ID does not exist" Mar 16 16:27:57 crc kubenswrapper[5120]: I0316 16:27:57.686946 5120 scope.go:117] "RemoveContainer" containerID="6c4084b4624028184f679b56cd08906346c406c50fa214ce42d0a9f7d3e16234" Mar 16 16:27:57 crc kubenswrapper[5120]: I0316 16:27:57.687412 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c4084b4624028184f679b56cd08906346c406c50fa214ce42d0a9f7d3e16234"} err="failed to get container status \"6c4084b4624028184f679b56cd08906346c406c50fa214ce42d0a9f7d3e16234\": rpc error: code = NotFound desc = could not find container \"6c4084b4624028184f679b56cd08906346c406c50fa214ce42d0a9f7d3e16234\": container with ID starting with 6c4084b4624028184f679b56cd08906346c406c50fa214ce42d0a9f7d3e16234 not found: ID does not exist" Mar 16 16:27:57 crc kubenswrapper[5120]: I0316 16:27:57.687429 5120 scope.go:117] "RemoveContainer" containerID="7ae158419d4338fb5572b1cb7d7832a573bff38a390c2360ad9f7210602fe125" Mar 16 16:27:57 crc kubenswrapper[5120]: I0316 16:27:57.687644 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ae158419d4338fb5572b1cb7d7832a573bff38a390c2360ad9f7210602fe125"} err="failed to get container status \"7ae158419d4338fb5572b1cb7d7832a573bff38a390c2360ad9f7210602fe125\": rpc error: code = NotFound desc = could not find container \"7ae158419d4338fb5572b1cb7d7832a573bff38a390c2360ad9f7210602fe125\": container with ID starting with 7ae158419d4338fb5572b1cb7d7832a573bff38a390c2360ad9f7210602fe125 not found: ID does not exist" Mar 16 16:27:57 crc kubenswrapper[5120]: I0316 16:27:57.687659 5120 scope.go:117] "RemoveContainer" containerID="f9c8aec81a9b62f4c081b69d1a2c61afd292508e46e8715caa369cc87baa6efe" Mar 16 16:27:57 crc kubenswrapper[5120]: I0316 16:27:57.687863 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9c8aec81a9b62f4c081b69d1a2c61afd292508e46e8715caa369cc87baa6efe"} err="failed to get container status \"f9c8aec81a9b62f4c081b69d1a2c61afd292508e46e8715caa369cc87baa6efe\": rpc error: code = NotFound desc = could not find container \"f9c8aec81a9b62f4c081b69d1a2c61afd292508e46e8715caa369cc87baa6efe\": container with ID starting with f9c8aec81a9b62f4c081b69d1a2c61afd292508e46e8715caa369cc87baa6efe not found: ID does not exist" Mar 16 16:27:57 crc kubenswrapper[5120]: I0316 16:27:57.687879 5120 scope.go:117] "RemoveContainer" containerID="48fc1c45ca60ee2bf4788b29215d711c2a65a560713358f227fccc267ae02b17" Mar 16 16:27:57 crc kubenswrapper[5120]: I0316 16:27:57.688108 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48fc1c45ca60ee2bf4788b29215d711c2a65a560713358f227fccc267ae02b17"} err="failed to get container status \"48fc1c45ca60ee2bf4788b29215d711c2a65a560713358f227fccc267ae02b17\": rpc error: code = NotFound desc = could not find container \"48fc1c45ca60ee2bf4788b29215d711c2a65a560713358f227fccc267ae02b17\": container with ID starting with 48fc1c45ca60ee2bf4788b29215d711c2a65a560713358f227fccc267ae02b17 not found: ID does not exist" Mar 16 16:27:57 crc kubenswrapper[5120]: I0316 16:27:57.688137 5120 scope.go:117] "RemoveContainer" containerID="6c4084b4624028184f679b56cd08906346c406c50fa214ce42d0a9f7d3e16234" Mar 16 16:27:57 crc kubenswrapper[5120]: I0316 16:27:57.690358 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c4084b4624028184f679b56cd08906346c406c50fa214ce42d0a9f7d3e16234"} err="failed to get container status \"6c4084b4624028184f679b56cd08906346c406c50fa214ce42d0a9f7d3e16234\": rpc error: code = NotFound desc = could not find container \"6c4084b4624028184f679b56cd08906346c406c50fa214ce42d0a9f7d3e16234\": container with ID starting with 6c4084b4624028184f679b56cd08906346c406c50fa214ce42d0a9f7d3e16234 not found: ID does not exist" Mar 16 16:27:57 crc kubenswrapper[5120]: I0316 16:27:57.690381 5120 scope.go:117] "RemoveContainer" containerID="7ae158419d4338fb5572b1cb7d7832a573bff38a390c2360ad9f7210602fe125" Mar 16 16:27:57 crc kubenswrapper[5120]: I0316 16:27:57.690599 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ae158419d4338fb5572b1cb7d7832a573bff38a390c2360ad9f7210602fe125"} err="failed to get container status \"7ae158419d4338fb5572b1cb7d7832a573bff38a390c2360ad9f7210602fe125\": rpc error: code = NotFound desc = could not find container \"7ae158419d4338fb5572b1cb7d7832a573bff38a390c2360ad9f7210602fe125\": container with ID starting with 7ae158419d4338fb5572b1cb7d7832a573bff38a390c2360ad9f7210602fe125 not found: ID does not exist" Mar 16 16:27:57 crc kubenswrapper[5120]: I0316 16:27:57.690620 5120 scope.go:117] "RemoveContainer" containerID="f9c8aec81a9b62f4c081b69d1a2c61afd292508e46e8715caa369cc87baa6efe" Mar 16 16:27:57 crc kubenswrapper[5120]: I0316 16:27:57.691424 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9c8aec81a9b62f4c081b69d1a2c61afd292508e46e8715caa369cc87baa6efe"} err="failed to get container status \"f9c8aec81a9b62f4c081b69d1a2c61afd292508e46e8715caa369cc87baa6efe\": rpc error: code = NotFound desc = could not find container \"f9c8aec81a9b62f4c081b69d1a2c61afd292508e46e8715caa369cc87baa6efe\": container with ID starting with f9c8aec81a9b62f4c081b69d1a2c61afd292508e46e8715caa369cc87baa6efe not found: ID does not exist" Mar 16 16:27:57 crc kubenswrapper[5120]: I0316 16:27:57.691451 5120 scope.go:117] "RemoveContainer" containerID="48fc1c45ca60ee2bf4788b29215d711c2a65a560713358f227fccc267ae02b17" Mar 16 16:27:57 crc kubenswrapper[5120]: I0316 16:27:57.691777 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48fc1c45ca60ee2bf4788b29215d711c2a65a560713358f227fccc267ae02b17"} err="failed to get container status \"48fc1c45ca60ee2bf4788b29215d711c2a65a560713358f227fccc267ae02b17\": rpc error: code = NotFound desc = could not find container \"48fc1c45ca60ee2bf4788b29215d711c2a65a560713358f227fccc267ae02b17\": container with ID starting with 48fc1c45ca60ee2bf4788b29215d711c2a65a560713358f227fccc267ae02b17 not found: ID does not exist" Mar 16 16:27:57 crc kubenswrapper[5120]: I0316 16:27:57.691805 5120 scope.go:117] "RemoveContainer" containerID="6c4084b4624028184f679b56cd08906346c406c50fa214ce42d0a9f7d3e16234" Mar 16 16:27:57 crc kubenswrapper[5120]: I0316 16:27:57.692075 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c4084b4624028184f679b56cd08906346c406c50fa214ce42d0a9f7d3e16234"} err="failed to get container status \"6c4084b4624028184f679b56cd08906346c406c50fa214ce42d0a9f7d3e16234\": rpc error: code = NotFound desc = could not find container \"6c4084b4624028184f679b56cd08906346c406c50fa214ce42d0a9f7d3e16234\": container with ID starting with 6c4084b4624028184f679b56cd08906346c406c50fa214ce42d0a9f7d3e16234 not found: ID does not exist" Mar 16 16:27:57 crc kubenswrapper[5120]: I0316 16:27:57.692103 5120 scope.go:117] "RemoveContainer" containerID="7ae158419d4338fb5572b1cb7d7832a573bff38a390c2360ad9f7210602fe125" Mar 16 16:27:57 crc kubenswrapper[5120]: I0316 16:27:57.692307 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ae158419d4338fb5572b1cb7d7832a573bff38a390c2360ad9f7210602fe125"} err="failed to get container status \"7ae158419d4338fb5572b1cb7d7832a573bff38a390c2360ad9f7210602fe125\": rpc error: code = NotFound desc = could not find container \"7ae158419d4338fb5572b1cb7d7832a573bff38a390c2360ad9f7210602fe125\": container with ID starting with 7ae158419d4338fb5572b1cb7d7832a573bff38a390c2360ad9f7210602fe125 not found: ID does not exist" Mar 16 16:27:57 crc kubenswrapper[5120]: I0316 16:27:57.692330 5120 scope.go:117] "RemoveContainer" containerID="f9c8aec81a9b62f4c081b69d1a2c61afd292508e46e8715caa369cc87baa6efe" Mar 16 16:27:57 crc kubenswrapper[5120]: I0316 16:27:57.692526 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9c8aec81a9b62f4c081b69d1a2c61afd292508e46e8715caa369cc87baa6efe"} err="failed to get container status \"f9c8aec81a9b62f4c081b69d1a2c61afd292508e46e8715caa369cc87baa6efe\": rpc error: code = NotFound desc = could not find container \"f9c8aec81a9b62f4c081b69d1a2c61afd292508e46e8715caa369cc87baa6efe\": container with ID starting with f9c8aec81a9b62f4c081b69d1a2c61afd292508e46e8715caa369cc87baa6efe not found: ID does not exist" Mar 16 16:27:57 crc kubenswrapper[5120]: I0316 16:27:57.692546 5120 scope.go:117] "RemoveContainer" containerID="48fc1c45ca60ee2bf4788b29215d711c2a65a560713358f227fccc267ae02b17" Mar 16 16:27:57 crc kubenswrapper[5120]: I0316 16:27:57.692736 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48fc1c45ca60ee2bf4788b29215d711c2a65a560713358f227fccc267ae02b17"} err="failed to get container status \"48fc1c45ca60ee2bf4788b29215d711c2a65a560713358f227fccc267ae02b17\": rpc error: code = NotFound desc = could not find container \"48fc1c45ca60ee2bf4788b29215d711c2a65a560713358f227fccc267ae02b17\": container with ID starting with 48fc1c45ca60ee2bf4788b29215d711c2a65a560713358f227fccc267ae02b17 not found: ID does not exist" Mar 16 16:27:57 crc kubenswrapper[5120]: I0316 16:27:57.734834 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-796df7d745-6tvph" Mar 16 16:27:57 crc kubenswrapper[5120]: I0316 16:27:57.805656 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:27:57 crc kubenswrapper[5120]: I0316 16:27:57.811234 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/a4b43784-8e78-434c-a053-23184660c355-httpd-config\") pod \"a4b43784-8e78-434c-a053-23184660c355\" (UID: \"a4b43784-8e78-434c-a053-23184660c355\") " Mar 16 16:27:57 crc kubenswrapper[5120]: I0316 16:27:57.815866 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6fw24\" (UniqueName: \"kubernetes.io/projected/a4b43784-8e78-434c-a053-23184660c355-kube-api-access-6fw24\") pod \"a4b43784-8e78-434c-a053-23184660c355\" (UID: \"a4b43784-8e78-434c-a053-23184660c355\") " Mar 16 16:27:57 crc kubenswrapper[5120]: I0316 16:27:57.816271 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a4b43784-8e78-434c-a053-23184660c355-combined-ca-bundle\") pod \"a4b43784-8e78-434c-a053-23184660c355\" (UID: \"a4b43784-8e78-434c-a053-23184660c355\") " Mar 16 16:27:57 crc kubenswrapper[5120]: I0316 16:27:57.816596 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a4b43784-8e78-434c-a053-23184660c355-config\") pod \"a4b43784-8e78-434c-a053-23184660c355\" (UID: \"a4b43784-8e78-434c-a053-23184660c355\") " Mar 16 16:27:57 crc kubenswrapper[5120]: I0316 16:27:57.816796 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/a4b43784-8e78-434c-a053-23184660c355-ovndb-tls-certs\") pod \"a4b43784-8e78-434c-a053-23184660c355\" (UID: \"a4b43784-8e78-434c-a053-23184660c355\") " Mar 16 16:27:57 crc kubenswrapper[5120]: I0316 16:27:57.822072 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a4b43784-8e78-434c-a053-23184660c355-httpd-config" (OuterVolumeSpecName: "httpd-config") pod "a4b43784-8e78-434c-a053-23184660c355" (UID: "a4b43784-8e78-434c-a053-23184660c355"). InnerVolumeSpecName "httpd-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:27:57 crc kubenswrapper[5120]: I0316 16:27:57.834087 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:27:57 crc kubenswrapper[5120]: I0316 16:27:57.838550 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:27:57 crc kubenswrapper[5120]: I0316 16:27:57.839880 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4b43784-8e78-434c-a053-23184660c355" containerName="neutron-httpd" Mar 16 16:27:57 crc kubenswrapper[5120]: I0316 16:27:57.839904 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4b43784-8e78-434c-a053-23184660c355" containerName="neutron-httpd" Mar 16 16:27:57 crc kubenswrapper[5120]: I0316 16:27:57.839938 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4b43784-8e78-434c-a053-23184660c355" containerName="neutron-api" Mar 16 16:27:57 crc kubenswrapper[5120]: I0316 16:27:57.839946 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4b43784-8e78-434c-a053-23184660c355" containerName="neutron-api" Mar 16 16:27:57 crc kubenswrapper[5120]: I0316 16:27:57.839961 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ecbe2394-e6b8-4b01-a620-d167d0341124" containerName="sg-core" Mar 16 16:27:57 crc kubenswrapper[5120]: I0316 16:27:57.839968 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ecbe2394-e6b8-4b01-a620-d167d0341124" containerName="sg-core" Mar 16 16:27:57 crc kubenswrapper[5120]: I0316 16:27:57.839995 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ecbe2394-e6b8-4b01-a620-d167d0341124" containerName="ceilometer-notification-agent" Mar 16 16:27:57 crc kubenswrapper[5120]: I0316 16:27:57.840003 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ecbe2394-e6b8-4b01-a620-d167d0341124" containerName="ceilometer-notification-agent" Mar 16 16:27:57 crc kubenswrapper[5120]: I0316 16:27:57.840015 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ecbe2394-e6b8-4b01-a620-d167d0341124" containerName="proxy-httpd" Mar 16 16:27:57 crc kubenswrapper[5120]: I0316 16:27:57.840021 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ecbe2394-e6b8-4b01-a620-d167d0341124" containerName="proxy-httpd" Mar 16 16:27:57 crc kubenswrapper[5120]: I0316 16:27:57.840059 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ecbe2394-e6b8-4b01-a620-d167d0341124" containerName="ceilometer-central-agent" Mar 16 16:27:57 crc kubenswrapper[5120]: I0316 16:27:57.840069 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ecbe2394-e6b8-4b01-a620-d167d0341124" containerName="ceilometer-central-agent" Mar 16 16:27:57 crc kubenswrapper[5120]: I0316 16:27:57.840301 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ecbe2394-e6b8-4b01-a620-d167d0341124" containerName="sg-core" Mar 16 16:27:57 crc kubenswrapper[5120]: I0316 16:27:57.840318 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="a4b43784-8e78-434c-a053-23184660c355" containerName="neutron-httpd" Mar 16 16:27:57 crc kubenswrapper[5120]: I0316 16:27:57.840335 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ecbe2394-e6b8-4b01-a620-d167d0341124" containerName="ceilometer-central-agent" Mar 16 16:27:57 crc kubenswrapper[5120]: I0316 16:27:57.840348 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ecbe2394-e6b8-4b01-a620-d167d0341124" containerName="proxy-httpd" Mar 16 16:27:57 crc kubenswrapper[5120]: I0316 16:27:57.840360 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="a4b43784-8e78-434c-a053-23184660c355" containerName="neutron-api" Mar 16 16:27:57 crc kubenswrapper[5120]: I0316 16:27:57.840375 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ecbe2394-e6b8-4b01-a620-d167d0341124" containerName="ceilometer-notification-agent" Mar 16 16:27:57 crc kubenswrapper[5120]: I0316 16:27:57.841822 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a4b43784-8e78-434c-a053-23184660c355-kube-api-access-6fw24" (OuterVolumeSpecName: "kube-api-access-6fw24") pod "a4b43784-8e78-434c-a053-23184660c355" (UID: "a4b43784-8e78-434c-a053-23184660c355"). InnerVolumeSpecName "kube-api-access-6fw24". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:27:57 crc kubenswrapper[5120]: I0316 16:27:57.865019 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:27:57 crc kubenswrapper[5120]: I0316 16:27:57.865178 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:27:57 crc kubenswrapper[5120]: I0316 16:27:57.867642 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 16:27:57 crc kubenswrapper[5120]: I0316 16:27:57.867642 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 16:27:57 crc kubenswrapper[5120]: I0316 16:27:57.904129 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a4b43784-8e78-434c-a053-23184660c355-config" (OuterVolumeSpecName: "config") pod "a4b43784-8e78-434c-a053-23184660c355" (UID: "a4b43784-8e78-434c-a053-23184660c355"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:27:57 crc kubenswrapper[5120]: I0316 16:27:57.914058 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a4b43784-8e78-434c-a053-23184660c355-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "a4b43784-8e78-434c-a053-23184660c355" (UID: "a4b43784-8e78-434c-a053-23184660c355"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:27:57 crc kubenswrapper[5120]: I0316 16:27:57.921473 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a939360a-d99d-43c2-90ff-fb43c7701f33-config-data\") pod \"ceilometer-0\" (UID: \"a939360a-d99d-43c2-90ff-fb43c7701f33\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:27:57 crc kubenswrapper[5120]: I0316 16:27:57.921841 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a939360a-d99d-43c2-90ff-fb43c7701f33-run-httpd\") pod \"ceilometer-0\" (UID: \"a939360a-d99d-43c2-90ff-fb43c7701f33\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:27:57 crc kubenswrapper[5120]: I0316 16:27:57.921886 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a939360a-d99d-43c2-90ff-fb43c7701f33-log-httpd\") pod \"ceilometer-0\" (UID: \"a939360a-d99d-43c2-90ff-fb43c7701f33\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:27:57 crc kubenswrapper[5120]: I0316 16:27:57.921923 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/a939360a-d99d-43c2-90ff-fb43c7701f33-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"a939360a-d99d-43c2-90ff-fb43c7701f33\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:27:57 crc kubenswrapper[5120]: I0316 16:27:57.922044 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5kzp5\" (UniqueName: \"kubernetes.io/projected/a939360a-d99d-43c2-90ff-fb43c7701f33-kube-api-access-5kzp5\") pod \"ceilometer-0\" (UID: \"a939360a-d99d-43c2-90ff-fb43c7701f33\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:27:57 crc kubenswrapper[5120]: I0316 16:27:57.922117 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a939360a-d99d-43c2-90ff-fb43c7701f33-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"a939360a-d99d-43c2-90ff-fb43c7701f33\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:27:57 crc kubenswrapper[5120]: I0316 16:27:57.922186 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a939360a-d99d-43c2-90ff-fb43c7701f33-scripts\") pod \"ceilometer-0\" (UID: \"a939360a-d99d-43c2-90ff-fb43c7701f33\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:27:57 crc kubenswrapper[5120]: I0316 16:27:57.922881 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/a4b43784-8e78-434c-a053-23184660c355-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:27:57 crc kubenswrapper[5120]: I0316 16:27:57.922908 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/a4b43784-8e78-434c-a053-23184660c355-httpd-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:27:57 crc kubenswrapper[5120]: I0316 16:27:57.922924 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6fw24\" (UniqueName: \"kubernetes.io/projected/a4b43784-8e78-434c-a053-23184660c355-kube-api-access-6fw24\") on node \"crc\" DevicePath \"\"" Mar 16 16:27:57 crc kubenswrapper[5120]: I0316 16:27:57.922941 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a4b43784-8e78-434c-a053-23184660c355-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:27:57 crc kubenswrapper[5120]: I0316 16:27:57.952418 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a4b43784-8e78-434c-a053-23184660c355-ovndb-tls-certs" (OuterVolumeSpecName: "ovndb-tls-certs") pod "a4b43784-8e78-434c-a053-23184660c355" (UID: "a4b43784-8e78-434c-a053-23184660c355"). InnerVolumeSpecName "ovndb-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:27:58 crc kubenswrapper[5120]: I0316 16:27:58.025364 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a939360a-d99d-43c2-90ff-fb43c7701f33-config-data\") pod \"ceilometer-0\" (UID: \"a939360a-d99d-43c2-90ff-fb43c7701f33\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:27:58 crc kubenswrapper[5120]: I0316 16:27:58.025481 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a939360a-d99d-43c2-90ff-fb43c7701f33-run-httpd\") pod \"ceilometer-0\" (UID: \"a939360a-d99d-43c2-90ff-fb43c7701f33\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:27:58 crc kubenswrapper[5120]: I0316 16:27:58.025505 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a939360a-d99d-43c2-90ff-fb43c7701f33-log-httpd\") pod \"ceilometer-0\" (UID: \"a939360a-d99d-43c2-90ff-fb43c7701f33\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:27:58 crc kubenswrapper[5120]: I0316 16:27:58.025530 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/a939360a-d99d-43c2-90ff-fb43c7701f33-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"a939360a-d99d-43c2-90ff-fb43c7701f33\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:27:58 crc kubenswrapper[5120]: I0316 16:27:58.025604 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5kzp5\" (UniqueName: \"kubernetes.io/projected/a939360a-d99d-43c2-90ff-fb43c7701f33-kube-api-access-5kzp5\") pod \"ceilometer-0\" (UID: \"a939360a-d99d-43c2-90ff-fb43c7701f33\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:27:58 crc kubenswrapper[5120]: I0316 16:27:58.025625 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a939360a-d99d-43c2-90ff-fb43c7701f33-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"a939360a-d99d-43c2-90ff-fb43c7701f33\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:27:58 crc kubenswrapper[5120]: I0316 16:27:58.025670 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a939360a-d99d-43c2-90ff-fb43c7701f33-scripts\") pod \"ceilometer-0\" (UID: \"a939360a-d99d-43c2-90ff-fb43c7701f33\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:27:58 crc kubenswrapper[5120]: I0316 16:27:58.025837 5120 reconciler_common.go:299] "Volume detached for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/a4b43784-8e78-434c-a053-23184660c355-ovndb-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:27:58 crc kubenswrapper[5120]: I0316 16:27:58.025977 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a939360a-d99d-43c2-90ff-fb43c7701f33-run-httpd\") pod \"ceilometer-0\" (UID: \"a939360a-d99d-43c2-90ff-fb43c7701f33\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:27:58 crc kubenswrapper[5120]: I0316 16:27:58.026064 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a939360a-d99d-43c2-90ff-fb43c7701f33-log-httpd\") pod \"ceilometer-0\" (UID: \"a939360a-d99d-43c2-90ff-fb43c7701f33\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:27:58 crc kubenswrapper[5120]: I0316 16:27:58.030606 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a939360a-d99d-43c2-90ff-fb43c7701f33-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"a939360a-d99d-43c2-90ff-fb43c7701f33\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:27:58 crc kubenswrapper[5120]: I0316 16:27:58.031840 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/a939360a-d99d-43c2-90ff-fb43c7701f33-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"a939360a-d99d-43c2-90ff-fb43c7701f33\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:27:58 crc kubenswrapper[5120]: I0316 16:27:58.035408 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a939360a-d99d-43c2-90ff-fb43c7701f33-scripts\") pod \"ceilometer-0\" (UID: \"a939360a-d99d-43c2-90ff-fb43c7701f33\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:27:58 crc kubenswrapper[5120]: I0316 16:27:58.037702 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a939360a-d99d-43c2-90ff-fb43c7701f33-config-data\") pod \"ceilometer-0\" (UID: \"a939360a-d99d-43c2-90ff-fb43c7701f33\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:27:58 crc kubenswrapper[5120]: I0316 16:27:58.046600 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5kzp5\" (UniqueName: \"kubernetes.io/projected/a939360a-d99d-43c2-90ff-fb43c7701f33-kube-api-access-5kzp5\") pod \"ceilometer-0\" (UID: \"a939360a-d99d-43c2-90ff-fb43c7701f33\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:27:58 crc kubenswrapper[5120]: I0316 16:27:58.206779 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:27:58 crc kubenswrapper[5120]: I0316 16:27:58.484422 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-796df7d745-6tvph" Mar 16 16:27:58 crc kubenswrapper[5120]: I0316 16:27:58.484461 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-796df7d745-6tvph" event={"ID":"a4b43784-8e78-434c-a053-23184660c355","Type":"ContainerDied","Data":"a9aa7c31885a95f78152ffe1db8f623de57b09bc5c2c94bbea2ed2c391907ad9"} Mar 16 16:27:58 crc kubenswrapper[5120]: I0316 16:27:58.484831 5120 scope.go:117] "RemoveContainer" containerID="23c7dd0e30293a8c34381be9a7c9e6a51d0b082b8ec0ec6fd0c4d48e23ca97af" Mar 16 16:27:58 crc kubenswrapper[5120]: I0316 16:27:58.512036 5120 scope.go:117] "RemoveContainer" containerID="8f91d16f6cc5bc2fcc55b3ca74be0509c763faa9d96bbaa629522702245cf31a" Mar 16 16:27:58 crc kubenswrapper[5120]: I0316 16:27:58.519250 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-796df7d745-6tvph"] Mar 16 16:27:58 crc kubenswrapper[5120]: I0316 16:27:58.529902 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-796df7d745-6tvph"] Mar 16 16:27:58 crc kubenswrapper[5120]: W0316 16:27:58.671146 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda939360a_d99d_43c2_90ff_fb43c7701f33.slice/crio-600f365e386c83a1ececd56996dbe5d2ef4ffcb2e16158e9af393068258b8006 WatchSource:0}: Error finding container 600f365e386c83a1ececd56996dbe5d2ef4ffcb2e16158e9af393068258b8006: Status 404 returned error can't find the container with id 600f365e386c83a1ececd56996dbe5d2ef4ffcb2e16158e9af393068258b8006 Mar 16 16:27:58 crc kubenswrapper[5120]: I0316 16:27:58.680841 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a4b43784-8e78-434c-a053-23184660c355" path="/var/lib/kubelet/pods/a4b43784-8e78-434c-a053-23184660c355/volumes" Mar 16 16:27:58 crc kubenswrapper[5120]: I0316 16:27:58.681918 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ecbe2394-e6b8-4b01-a620-d167d0341124" path="/var/lib/kubelet/pods/ecbe2394-e6b8-4b01-a620-d167d0341124/volumes" Mar 16 16:27:58 crc kubenswrapper[5120]: I0316 16:27:58.683004 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:27:59 crc kubenswrapper[5120]: I0316 16:27:59.167795 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:27:59 crc kubenswrapper[5120]: I0316 16:27:59.168042 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="d4a84888-a119-4cef-9709-e47200b01990" containerName="glance-log" containerID="cri-o://c1233d07750f7af88a683f1b1460d5f199a63e5472a40f9513c8f0b9440d6f8d" gracePeriod=30 Mar 16 16:27:59 crc kubenswrapper[5120]: I0316 16:27:59.168550 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="d4a84888-a119-4cef-9709-e47200b01990" containerName="glance-httpd" containerID="cri-o://17b2f2285a8d3eca412816bab191df4db8417d945641e8d0b886114eb046f8ac" gracePeriod=30 Mar 16 16:27:59 crc kubenswrapper[5120]: I0316 16:27:59.501107 5120 generic.go:358] "Generic (PLEG): container finished" podID="d4a84888-a119-4cef-9709-e47200b01990" containerID="c1233d07750f7af88a683f1b1460d5f199a63e5472a40f9513c8f0b9440d6f8d" exitCode=143 Mar 16 16:27:59 crc kubenswrapper[5120]: I0316 16:27:59.501157 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"d4a84888-a119-4cef-9709-e47200b01990","Type":"ContainerDied","Data":"c1233d07750f7af88a683f1b1460d5f199a63e5472a40f9513c8f0b9440d6f8d"} Mar 16 16:27:59 crc kubenswrapper[5120]: I0316 16:27:59.503618 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a939360a-d99d-43c2-90ff-fb43c7701f33","Type":"ContainerStarted","Data":"762a70913ba4d9bf454f34cc252d0bdbb883c2eb9c976407f4125f4803033193"} Mar 16 16:27:59 crc kubenswrapper[5120]: I0316 16:27:59.503733 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a939360a-d99d-43c2-90ff-fb43c7701f33","Type":"ContainerStarted","Data":"600f365e386c83a1ececd56996dbe5d2ef4ffcb2e16158e9af393068258b8006"} Mar 16 16:27:59 crc kubenswrapper[5120]: I0316 16:27:59.865542 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/placement-76845cddf4-zlw8q" Mar 16 16:28:00 crc kubenswrapper[5120]: I0316 16:28:00.143357 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-infra/auto-csr-approver-29561308-97774"] Mar 16 16:28:00 crc kubenswrapper[5120]: I0316 16:28:00.152143 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561308-97774" Mar 16 16:28:00 crc kubenswrapper[5120]: I0316 16:28:00.153987 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-infra\"/\"csr-approver-sa-dockercfg-x2nsz\"" Mar 16 16:28:00 crc kubenswrapper[5120]: I0316 16:28:00.156345 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561308-97774"] Mar 16 16:28:00 crc kubenswrapper[5120]: I0316 16:28:00.156575 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"openshift-service-ca.crt\"" Mar 16 16:28:00 crc kubenswrapper[5120]: I0316 16:28:00.156627 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"kube-root-ca.crt\"" Mar 16 16:28:00 crc kubenswrapper[5120]: I0316 16:28:00.302077 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbzcb\" (UniqueName: \"kubernetes.io/projected/80f9e587-aeb8-49f9-a79a-c3898e9638b6-kube-api-access-hbzcb\") pod \"auto-csr-approver-29561308-97774\" (UID: \"80f9e587-aeb8-49f9-a79a-c3898e9638b6\") " pod="openshift-infra/auto-csr-approver-29561308-97774" Mar 16 16:28:00 crc kubenswrapper[5120]: I0316 16:28:00.404091 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hbzcb\" (UniqueName: \"kubernetes.io/projected/80f9e587-aeb8-49f9-a79a-c3898e9638b6-kube-api-access-hbzcb\") pod \"auto-csr-approver-29561308-97774\" (UID: \"80f9e587-aeb8-49f9-a79a-c3898e9638b6\") " pod="openshift-infra/auto-csr-approver-29561308-97774" Mar 16 16:28:00 crc kubenswrapper[5120]: I0316 16:28:00.422624 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbzcb\" (UniqueName: \"kubernetes.io/projected/80f9e587-aeb8-49f9-a79a-c3898e9638b6-kube-api-access-hbzcb\") pod \"auto-csr-approver-29561308-97774\" (UID: \"80f9e587-aeb8-49f9-a79a-c3898e9638b6\") " pod="openshift-infra/auto-csr-approver-29561308-97774" Mar 16 16:28:00 crc kubenswrapper[5120]: I0316 16:28:00.506747 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561308-97774" Mar 16 16:28:00 crc kubenswrapper[5120]: I0316 16:28:00.531936 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a939360a-d99d-43c2-90ff-fb43c7701f33","Type":"ContainerStarted","Data":"ecd57a8becef854fe7695d21618ffda8f9f7ddc2d5081f731f5cb4f6122a34ce"} Mar 16 16:28:00 crc kubenswrapper[5120]: I0316 16:28:00.570816 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:28:00 crc kubenswrapper[5120]: I0316 16:28:00.571379 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="06b8b1f6-bed1-4548-8bdc-0a143d95aedd" containerName="glance-log" containerID="cri-o://fa480b3baf502dd59bb2e9ee71fe48cb86a8e9040dc07d72ba6da8ea71f26f3d" gracePeriod=30 Mar 16 16:28:00 crc kubenswrapper[5120]: I0316 16:28:00.571520 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="06b8b1f6-bed1-4548-8bdc-0a143d95aedd" containerName="glance-httpd" containerID="cri-o://9dbabc0a3d58b62aed75c816865442845fbaca03956a14056838caa0d2b75ce2" gracePeriod=30 Mar 16 16:28:01 crc kubenswrapper[5120]: I0316 16:28:01.041298 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561308-97774"] Mar 16 16:28:01 crc kubenswrapper[5120]: I0316 16:28:01.163360 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/placement-76845cddf4-zlw8q" Mar 16 16:28:01 crc kubenswrapper[5120]: I0316 16:28:01.236725 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-6b678b5478-h7p85"] Mar 16 16:28:01 crc kubenswrapper[5120]: I0316 16:28:01.237020 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-6b678b5478-h7p85" podUID="5b82cd86-0489-4dc6-8d45-b478e71f1083" containerName="placement-log" containerID="cri-o://e8f6039ae2940f7d60f59834673991a6d6bfe9c29f5be1c00e4f4732e54d66a1" gracePeriod=30 Mar 16 16:28:01 crc kubenswrapper[5120]: I0316 16:28:01.237588 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-6b678b5478-h7p85" podUID="5b82cd86-0489-4dc6-8d45-b478e71f1083" containerName="placement-api" containerID="cri-o://1d966ec507ef8140bae32b68192acf2c779348364fc574d434164a1fabc006d3" gracePeriod=30 Mar 16 16:28:01 crc kubenswrapper[5120]: I0316 16:28:01.543890 5120 generic.go:358] "Generic (PLEG): container finished" podID="06b8b1f6-bed1-4548-8bdc-0a143d95aedd" containerID="fa480b3baf502dd59bb2e9ee71fe48cb86a8e9040dc07d72ba6da8ea71f26f3d" exitCode=143 Mar 16 16:28:01 crc kubenswrapper[5120]: I0316 16:28:01.544068 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"06b8b1f6-bed1-4548-8bdc-0a143d95aedd","Type":"ContainerDied","Data":"fa480b3baf502dd59bb2e9ee71fe48cb86a8e9040dc07d72ba6da8ea71f26f3d"} Mar 16 16:28:01 crc kubenswrapper[5120]: I0316 16:28:01.548746 5120 generic.go:358] "Generic (PLEG): container finished" podID="5b82cd86-0489-4dc6-8d45-b478e71f1083" containerID="e8f6039ae2940f7d60f59834673991a6d6bfe9c29f5be1c00e4f4732e54d66a1" exitCode=143 Mar 16 16:28:01 crc kubenswrapper[5120]: I0316 16:28:01.548865 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-6b678b5478-h7p85" event={"ID":"5b82cd86-0489-4dc6-8d45-b478e71f1083","Type":"ContainerDied","Data":"e8f6039ae2940f7d60f59834673991a6d6bfe9c29f5be1c00e4f4732e54d66a1"} Mar 16 16:28:01 crc kubenswrapper[5120]: I0316 16:28:01.551234 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a939360a-d99d-43c2-90ff-fb43c7701f33","Type":"ContainerStarted","Data":"745819b39d1a2d09c07c3309ac4a926fde00f50c0047d72085af0f2da0185edd"} Mar 16 16:28:01 crc kubenswrapper[5120]: I0316 16:28:01.552778 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561308-97774" event={"ID":"80f9e587-aeb8-49f9-a79a-c3898e9638b6","Type":"ContainerStarted","Data":"4742dbd187546fb0da9a0c5a5cd179f469427f902f1066c4d023f9588b7d2df5"} Mar 16 16:28:02 crc kubenswrapper[5120]: I0316 16:28:02.496049 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:28:03 crc kubenswrapper[5120]: I0316 16:28:03.248977 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:28:03 crc kubenswrapper[5120]: I0316 16:28:03.301955 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d4a84888-a119-4cef-9709-e47200b01990-scripts\") pod \"d4a84888-a119-4cef-9709-e47200b01990\" (UID: \"d4a84888-a119-4cef-9709-e47200b01990\") " Mar 16 16:28:03 crc kubenswrapper[5120]: I0316 16:28:03.302182 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/d4a84888-a119-4cef-9709-e47200b01990-public-tls-certs\") pod \"d4a84888-a119-4cef-9709-e47200b01990\" (UID: \"d4a84888-a119-4cef-9709-e47200b01990\") " Mar 16 16:28:03 crc kubenswrapper[5120]: I0316 16:28:03.302379 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d4a84888-a119-4cef-9709-e47200b01990-logs\") pod \"d4a84888-a119-4cef-9709-e47200b01990\" (UID: \"d4a84888-a119-4cef-9709-e47200b01990\") " Mar 16 16:28:03 crc kubenswrapper[5120]: I0316 16:28:03.302460 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"d4a84888-a119-4cef-9709-e47200b01990\" (UID: \"d4a84888-a119-4cef-9709-e47200b01990\") " Mar 16 16:28:03 crc kubenswrapper[5120]: I0316 16:28:03.302572 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d4a84888-a119-4cef-9709-e47200b01990-combined-ca-bundle\") pod \"d4a84888-a119-4cef-9709-e47200b01990\" (UID: \"d4a84888-a119-4cef-9709-e47200b01990\") " Mar 16 16:28:03 crc kubenswrapper[5120]: I0316 16:28:03.302827 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p5w85\" (UniqueName: \"kubernetes.io/projected/d4a84888-a119-4cef-9709-e47200b01990-kube-api-access-p5w85\") pod \"d4a84888-a119-4cef-9709-e47200b01990\" (UID: \"d4a84888-a119-4cef-9709-e47200b01990\") " Mar 16 16:28:03 crc kubenswrapper[5120]: I0316 16:28:03.302935 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/d4a84888-a119-4cef-9709-e47200b01990-httpd-run\") pod \"d4a84888-a119-4cef-9709-e47200b01990\" (UID: \"d4a84888-a119-4cef-9709-e47200b01990\") " Mar 16 16:28:03 crc kubenswrapper[5120]: I0316 16:28:03.302999 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d4a84888-a119-4cef-9709-e47200b01990-config-data\") pod \"d4a84888-a119-4cef-9709-e47200b01990\" (UID: \"d4a84888-a119-4cef-9709-e47200b01990\") " Mar 16 16:28:03 crc kubenswrapper[5120]: I0316 16:28:03.303404 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4a84888-a119-4cef-9709-e47200b01990-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "d4a84888-a119-4cef-9709-e47200b01990" (UID: "d4a84888-a119-4cef-9709-e47200b01990"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:28:03 crc kubenswrapper[5120]: I0316 16:28:03.304049 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4a84888-a119-4cef-9709-e47200b01990-logs" (OuterVolumeSpecName: "logs") pod "d4a84888-a119-4cef-9709-e47200b01990" (UID: "d4a84888-a119-4cef-9709-e47200b01990"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:28:03 crc kubenswrapper[5120]: I0316 16:28:03.304370 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/d4a84888-a119-4cef-9709-e47200b01990-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 16:28:03 crc kubenswrapper[5120]: I0316 16:28:03.316821 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4a84888-a119-4cef-9709-e47200b01990-kube-api-access-p5w85" (OuterVolumeSpecName: "kube-api-access-p5w85") pod "d4a84888-a119-4cef-9709-e47200b01990" (UID: "d4a84888-a119-4cef-9709-e47200b01990"). InnerVolumeSpecName "kube-api-access-p5w85". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:28:03 crc kubenswrapper[5120]: I0316 16:28:03.325587 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4a84888-a119-4cef-9709-e47200b01990-scripts" (OuterVolumeSpecName: "scripts") pod "d4a84888-a119-4cef-9709-e47200b01990" (UID: "d4a84888-a119-4cef-9709-e47200b01990"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:28:03 crc kubenswrapper[5120]: I0316 16:28:03.325688 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage20-crc" (OuterVolumeSpecName: "glance") pod "d4a84888-a119-4cef-9709-e47200b01990" (UID: "d4a84888-a119-4cef-9709-e47200b01990"). InnerVolumeSpecName "local-storage20-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:28:03 crc kubenswrapper[5120]: I0316 16:28:03.418503 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4a84888-a119-4cef-9709-e47200b01990-config-data" (OuterVolumeSpecName: "config-data") pod "d4a84888-a119-4cef-9709-e47200b01990" (UID: "d4a84888-a119-4cef-9709-e47200b01990"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:28:03 crc kubenswrapper[5120]: I0316 16:28:03.425812 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4a84888-a119-4cef-9709-e47200b01990-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "d4a84888-a119-4cef-9709-e47200b01990" (UID: "d4a84888-a119-4cef-9709-e47200b01990"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:28:03 crc kubenswrapper[5120]: I0316 16:28:03.426215 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/d4a84888-a119-4cef-9709-e47200b01990-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:28:03 crc kubenswrapper[5120]: I0316 16:28:03.426235 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d4a84888-a119-4cef-9709-e47200b01990-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:28:03 crc kubenswrapper[5120]: I0316 16:28:03.426265 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") on node \"crc\" " Mar 16 16:28:03 crc kubenswrapper[5120]: I0316 16:28:03.426275 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p5w85\" (UniqueName: \"kubernetes.io/projected/d4a84888-a119-4cef-9709-e47200b01990-kube-api-access-p5w85\") on node \"crc\" DevicePath \"\"" Mar 16 16:28:03 crc kubenswrapper[5120]: I0316 16:28:03.426286 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d4a84888-a119-4cef-9709-e47200b01990-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:28:03 crc kubenswrapper[5120]: I0316 16:28:03.426294 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d4a84888-a119-4cef-9709-e47200b01990-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:28:03 crc kubenswrapper[5120]: I0316 16:28:03.440478 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4a84888-a119-4cef-9709-e47200b01990-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "d4a84888-a119-4cef-9709-e47200b01990" (UID: "d4a84888-a119-4cef-9709-e47200b01990"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:28:03 crc kubenswrapper[5120]: I0316 16:28:03.468393 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage20-crc" (UniqueName: "kubernetes.io/local-volume/local-storage20-crc") on node "crc" Mar 16 16:28:03 crc kubenswrapper[5120]: I0316 16:28:03.528326 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:28:03 crc kubenswrapper[5120]: I0316 16:28:03.528657 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d4a84888-a119-4cef-9709-e47200b01990-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:28:03 crc kubenswrapper[5120]: I0316 16:28:03.581264 5120 generic.go:358] "Generic (PLEG): container finished" podID="80f9e587-aeb8-49f9-a79a-c3898e9638b6" containerID="328296c307f78ee5b84f1e04978571b2c8e0306f11ba7959a5bac1756086f85f" exitCode=0 Mar 16 16:28:03 crc kubenswrapper[5120]: I0316 16:28:03.582231 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561308-97774" event={"ID":"80f9e587-aeb8-49f9-a79a-c3898e9638b6","Type":"ContainerDied","Data":"328296c307f78ee5b84f1e04978571b2c8e0306f11ba7959a5bac1756086f85f"} Mar 16 16:28:03 crc kubenswrapper[5120]: I0316 16:28:03.586068 5120 generic.go:358] "Generic (PLEG): container finished" podID="d4a84888-a119-4cef-9709-e47200b01990" containerID="17b2f2285a8d3eca412816bab191df4db8417d945641e8d0b886114eb046f8ac" exitCode=0 Mar 16 16:28:03 crc kubenswrapper[5120]: I0316 16:28:03.586152 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"d4a84888-a119-4cef-9709-e47200b01990","Type":"ContainerDied","Data":"17b2f2285a8d3eca412816bab191df4db8417d945641e8d0b886114eb046f8ac"} Mar 16 16:28:03 crc kubenswrapper[5120]: I0316 16:28:03.586183 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:28:03 crc kubenswrapper[5120]: I0316 16:28:03.586205 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"d4a84888-a119-4cef-9709-e47200b01990","Type":"ContainerDied","Data":"b7b93af1824cc495b6321a32eeb3e9595d66aa5f69b4b026054289badb00a89d"} Mar 16 16:28:03 crc kubenswrapper[5120]: I0316 16:28:03.586230 5120 scope.go:117] "RemoveContainer" containerID="17b2f2285a8d3eca412816bab191df4db8417d945641e8d0b886114eb046f8ac" Mar 16 16:28:03 crc kubenswrapper[5120]: I0316 16:28:03.654365 5120 scope.go:117] "RemoveContainer" containerID="c1233d07750f7af88a683f1b1460d5f199a63e5472a40f9513c8f0b9440d6f8d" Mar 16 16:28:03 crc kubenswrapper[5120]: I0316 16:28:03.666435 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:28:03 crc kubenswrapper[5120]: I0316 16:28:03.673806 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:28:03 crc kubenswrapper[5120]: I0316 16:28:03.681335 5120 scope.go:117] "RemoveContainer" containerID="17b2f2285a8d3eca412816bab191df4db8417d945641e8d0b886114eb046f8ac" Mar 16 16:28:03 crc kubenswrapper[5120]: E0316 16:28:03.685030 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"17b2f2285a8d3eca412816bab191df4db8417d945641e8d0b886114eb046f8ac\": container with ID starting with 17b2f2285a8d3eca412816bab191df4db8417d945641e8d0b886114eb046f8ac not found: ID does not exist" containerID="17b2f2285a8d3eca412816bab191df4db8417d945641e8d0b886114eb046f8ac" Mar 16 16:28:03 crc kubenswrapper[5120]: I0316 16:28:03.685077 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17b2f2285a8d3eca412816bab191df4db8417d945641e8d0b886114eb046f8ac"} err="failed to get container status \"17b2f2285a8d3eca412816bab191df4db8417d945641e8d0b886114eb046f8ac\": rpc error: code = NotFound desc = could not find container \"17b2f2285a8d3eca412816bab191df4db8417d945641e8d0b886114eb046f8ac\": container with ID starting with 17b2f2285a8d3eca412816bab191df4db8417d945641e8d0b886114eb046f8ac not found: ID does not exist" Mar 16 16:28:03 crc kubenswrapper[5120]: I0316 16:28:03.685111 5120 scope.go:117] "RemoveContainer" containerID="c1233d07750f7af88a683f1b1460d5f199a63e5472a40f9513c8f0b9440d6f8d" Mar 16 16:28:03 crc kubenswrapper[5120]: E0316 16:28:03.686810 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c1233d07750f7af88a683f1b1460d5f199a63e5472a40f9513c8f0b9440d6f8d\": container with ID starting with c1233d07750f7af88a683f1b1460d5f199a63e5472a40f9513c8f0b9440d6f8d not found: ID does not exist" containerID="c1233d07750f7af88a683f1b1460d5f199a63e5472a40f9513c8f0b9440d6f8d" Mar 16 16:28:03 crc kubenswrapper[5120]: I0316 16:28:03.686865 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1233d07750f7af88a683f1b1460d5f199a63e5472a40f9513c8f0b9440d6f8d"} err="failed to get container status \"c1233d07750f7af88a683f1b1460d5f199a63e5472a40f9513c8f0b9440d6f8d\": rpc error: code = NotFound desc = could not find container \"c1233d07750f7af88a683f1b1460d5f199a63e5472a40f9513c8f0b9440d6f8d\": container with ID starting with c1233d07750f7af88a683f1b1460d5f199a63e5472a40f9513c8f0b9440d6f8d not found: ID does not exist" Mar 16 16:28:03 crc kubenswrapper[5120]: I0316 16:28:03.695328 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:28:03 crc kubenswrapper[5120]: I0316 16:28:03.696709 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4a84888-a119-4cef-9709-e47200b01990" containerName="glance-log" Mar 16 16:28:03 crc kubenswrapper[5120]: I0316 16:28:03.696736 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4a84888-a119-4cef-9709-e47200b01990" containerName="glance-log" Mar 16 16:28:03 crc kubenswrapper[5120]: I0316 16:28:03.696775 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4a84888-a119-4cef-9709-e47200b01990" containerName="glance-httpd" Mar 16 16:28:03 crc kubenswrapper[5120]: I0316 16:28:03.696784 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4a84888-a119-4cef-9709-e47200b01990" containerName="glance-httpd" Mar 16 16:28:03 crc kubenswrapper[5120]: I0316 16:28:03.697081 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="d4a84888-a119-4cef-9709-e47200b01990" containerName="glance-httpd" Mar 16 16:28:03 crc kubenswrapper[5120]: I0316 16:28:03.697125 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="d4a84888-a119-4cef-9709-e47200b01990" containerName="glance-log" Mar 16 16:28:03 crc kubenswrapper[5120]: I0316 16:28:03.703134 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:28:03 crc kubenswrapper[5120]: I0316 16:28:03.708164 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-public-svc\"" Mar 16 16:28:03 crc kubenswrapper[5120]: I0316 16:28:03.708229 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-external-config-data\"" Mar 16 16:28:03 crc kubenswrapper[5120]: I0316 16:28:03.719343 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:28:03 crc kubenswrapper[5120]: I0316 16:28:03.735212 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/cecaa51b-004f-4941-99e2-23272d052fa7-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"cecaa51b-004f-4941-99e2-23272d052fa7\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:28:03 crc kubenswrapper[5120]: I0316 16:28:03.735357 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/cecaa51b-004f-4941-99e2-23272d052fa7-scripts\") pod \"glance-default-external-api-0\" (UID: \"cecaa51b-004f-4941-99e2-23272d052fa7\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:28:03 crc kubenswrapper[5120]: I0316 16:28:03.737096 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c72nf\" (UniqueName: \"kubernetes.io/projected/cecaa51b-004f-4941-99e2-23272d052fa7-kube-api-access-c72nf\") pod \"glance-default-external-api-0\" (UID: \"cecaa51b-004f-4941-99e2-23272d052fa7\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:28:03 crc kubenswrapper[5120]: I0316 16:28:03.737209 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/cecaa51b-004f-4941-99e2-23272d052fa7-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"cecaa51b-004f-4941-99e2-23272d052fa7\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:28:03 crc kubenswrapper[5120]: I0316 16:28:03.737250 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cecaa51b-004f-4941-99e2-23272d052fa7-config-data\") pod \"glance-default-external-api-0\" (UID: \"cecaa51b-004f-4941-99e2-23272d052fa7\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:28:03 crc kubenswrapper[5120]: I0316 16:28:03.737344 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/cecaa51b-004f-4941-99e2-23272d052fa7-logs\") pod \"glance-default-external-api-0\" (UID: \"cecaa51b-004f-4941-99e2-23272d052fa7\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:28:03 crc kubenswrapper[5120]: I0316 16:28:03.737476 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"glance-default-external-api-0\" (UID: \"cecaa51b-004f-4941-99e2-23272d052fa7\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:28:03 crc kubenswrapper[5120]: I0316 16:28:03.737612 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cecaa51b-004f-4941-99e2-23272d052fa7-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"cecaa51b-004f-4941-99e2-23272d052fa7\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:28:03 crc kubenswrapper[5120]: I0316 16:28:03.771387 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="06b8b1f6-bed1-4548-8bdc-0a143d95aedd" containerName="glance-log" probeResult="failure" output="Get \"https://10.217.1.219:9292/healthcheck\": read tcp 10.217.0.2:39390->10.217.1.219:9292: read: connection reset by peer" Mar 16 16:28:03 crc kubenswrapper[5120]: I0316 16:28:03.771509 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="06b8b1f6-bed1-4548-8bdc-0a143d95aedd" containerName="glance-httpd" probeResult="failure" output="Get \"https://10.217.1.219:9292/healthcheck\": read tcp 10.217.0.2:39400->10.217.1.219:9292: read: connection reset by peer" Mar 16 16:28:03 crc kubenswrapper[5120]: I0316 16:28:03.839552 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c72nf\" (UniqueName: \"kubernetes.io/projected/cecaa51b-004f-4941-99e2-23272d052fa7-kube-api-access-c72nf\") pod \"glance-default-external-api-0\" (UID: \"cecaa51b-004f-4941-99e2-23272d052fa7\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:28:03 crc kubenswrapper[5120]: I0316 16:28:03.839992 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/cecaa51b-004f-4941-99e2-23272d052fa7-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"cecaa51b-004f-4941-99e2-23272d052fa7\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:28:03 crc kubenswrapper[5120]: I0316 16:28:03.840035 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cecaa51b-004f-4941-99e2-23272d052fa7-config-data\") pod \"glance-default-external-api-0\" (UID: \"cecaa51b-004f-4941-99e2-23272d052fa7\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:28:03 crc kubenswrapper[5120]: I0316 16:28:03.840077 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/cecaa51b-004f-4941-99e2-23272d052fa7-logs\") pod \"glance-default-external-api-0\" (UID: \"cecaa51b-004f-4941-99e2-23272d052fa7\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:28:03 crc kubenswrapper[5120]: I0316 16:28:03.840145 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"glance-default-external-api-0\" (UID: \"cecaa51b-004f-4941-99e2-23272d052fa7\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:28:03 crc kubenswrapper[5120]: I0316 16:28:03.840719 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/cecaa51b-004f-4941-99e2-23272d052fa7-logs\") pod \"glance-default-external-api-0\" (UID: \"cecaa51b-004f-4941-99e2-23272d052fa7\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:28:03 crc kubenswrapper[5120]: I0316 16:28:03.840803 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cecaa51b-004f-4941-99e2-23272d052fa7-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"cecaa51b-004f-4941-99e2-23272d052fa7\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:28:03 crc kubenswrapper[5120]: I0316 16:28:03.840839 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"glance-default-external-api-0\" (UID: \"cecaa51b-004f-4941-99e2-23272d052fa7\") device mount path \"/mnt/openstack/pv20\"" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:28:03 crc kubenswrapper[5120]: I0316 16:28:03.840856 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/cecaa51b-004f-4941-99e2-23272d052fa7-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"cecaa51b-004f-4941-99e2-23272d052fa7\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:28:03 crc kubenswrapper[5120]: I0316 16:28:03.841157 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/cecaa51b-004f-4941-99e2-23272d052fa7-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"cecaa51b-004f-4941-99e2-23272d052fa7\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:28:03 crc kubenswrapper[5120]: I0316 16:28:03.841222 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/cecaa51b-004f-4941-99e2-23272d052fa7-scripts\") pod \"glance-default-external-api-0\" (UID: \"cecaa51b-004f-4941-99e2-23272d052fa7\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:28:03 crc kubenswrapper[5120]: I0316 16:28:03.845772 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/cecaa51b-004f-4941-99e2-23272d052fa7-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"cecaa51b-004f-4941-99e2-23272d052fa7\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:28:03 crc kubenswrapper[5120]: I0316 16:28:03.845951 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cecaa51b-004f-4941-99e2-23272d052fa7-config-data\") pod \"glance-default-external-api-0\" (UID: \"cecaa51b-004f-4941-99e2-23272d052fa7\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:28:03 crc kubenswrapper[5120]: I0316 16:28:03.846210 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cecaa51b-004f-4941-99e2-23272d052fa7-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"cecaa51b-004f-4941-99e2-23272d052fa7\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:28:03 crc kubenswrapper[5120]: I0316 16:28:03.851374 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/cecaa51b-004f-4941-99e2-23272d052fa7-scripts\") pod \"glance-default-external-api-0\" (UID: \"cecaa51b-004f-4941-99e2-23272d052fa7\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:28:03 crc kubenswrapper[5120]: I0316 16:28:03.864428 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c72nf\" (UniqueName: \"kubernetes.io/projected/cecaa51b-004f-4941-99e2-23272d052fa7-kube-api-access-c72nf\") pod \"glance-default-external-api-0\" (UID: \"cecaa51b-004f-4941-99e2-23272d052fa7\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:28:03 crc kubenswrapper[5120]: I0316 16:28:03.875059 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"glance-default-external-api-0\" (UID: \"cecaa51b-004f-4941-99e2-23272d052fa7\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:28:04 crc kubenswrapper[5120]: I0316 16:28:04.019545 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:28:04 crc kubenswrapper[5120]: I0316 16:28:04.266352 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:28:04 crc kubenswrapper[5120]: I0316 16:28:04.352452 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/06b8b1f6-bed1-4548-8bdc-0a143d95aedd-logs\") pod \"06b8b1f6-bed1-4548-8bdc-0a143d95aedd\" (UID: \"06b8b1f6-bed1-4548-8bdc-0a143d95aedd\") " Mar 16 16:28:04 crc kubenswrapper[5120]: I0316 16:28:04.353217 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/06b8b1f6-bed1-4548-8bdc-0a143d95aedd-httpd-run\") pod \"06b8b1f6-bed1-4548-8bdc-0a143d95aedd\" (UID: \"06b8b1f6-bed1-4548-8bdc-0a143d95aedd\") " Mar 16 16:28:04 crc kubenswrapper[5120]: I0316 16:28:04.353275 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/06b8b1f6-bed1-4548-8bdc-0a143d95aedd-scripts\") pod \"06b8b1f6-bed1-4548-8bdc-0a143d95aedd\" (UID: \"06b8b1f6-bed1-4548-8bdc-0a143d95aedd\") " Mar 16 16:28:04 crc kubenswrapper[5120]: I0316 16:28:04.353743 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06b8b1f6-bed1-4548-8bdc-0a143d95aedd-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "06b8b1f6-bed1-4548-8bdc-0a143d95aedd" (UID: "06b8b1f6-bed1-4548-8bdc-0a143d95aedd"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:28:04 crc kubenswrapper[5120]: I0316 16:28:04.353865 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9fvvq\" (UniqueName: \"kubernetes.io/projected/06b8b1f6-bed1-4548-8bdc-0a143d95aedd-kube-api-access-9fvvq\") pod \"06b8b1f6-bed1-4548-8bdc-0a143d95aedd\" (UID: \"06b8b1f6-bed1-4548-8bdc-0a143d95aedd\") " Mar 16 16:28:04 crc kubenswrapper[5120]: I0316 16:28:04.354284 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"06b8b1f6-bed1-4548-8bdc-0a143d95aedd\" (UID: \"06b8b1f6-bed1-4548-8bdc-0a143d95aedd\") " Mar 16 16:28:04 crc kubenswrapper[5120]: I0316 16:28:04.354426 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/06b8b1f6-bed1-4548-8bdc-0a143d95aedd-config-data\") pod \"06b8b1f6-bed1-4548-8bdc-0a143d95aedd\" (UID: \"06b8b1f6-bed1-4548-8bdc-0a143d95aedd\") " Mar 16 16:28:04 crc kubenswrapper[5120]: I0316 16:28:04.354626 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/06b8b1f6-bed1-4548-8bdc-0a143d95aedd-combined-ca-bundle\") pod \"06b8b1f6-bed1-4548-8bdc-0a143d95aedd\" (UID: \"06b8b1f6-bed1-4548-8bdc-0a143d95aedd\") " Mar 16 16:28:04 crc kubenswrapper[5120]: I0316 16:28:04.354674 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/06b8b1f6-bed1-4548-8bdc-0a143d95aedd-internal-tls-certs\") pod \"06b8b1f6-bed1-4548-8bdc-0a143d95aedd\" (UID: \"06b8b1f6-bed1-4548-8bdc-0a143d95aedd\") " Mar 16 16:28:04 crc kubenswrapper[5120]: I0316 16:28:04.354933 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06b8b1f6-bed1-4548-8bdc-0a143d95aedd-logs" (OuterVolumeSpecName: "logs") pod "06b8b1f6-bed1-4548-8bdc-0a143d95aedd" (UID: "06b8b1f6-bed1-4548-8bdc-0a143d95aedd"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:28:04 crc kubenswrapper[5120]: I0316 16:28:04.363428 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/06b8b1f6-bed1-4548-8bdc-0a143d95aedd-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:28:04 crc kubenswrapper[5120]: I0316 16:28:04.363462 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/06b8b1f6-bed1-4548-8bdc-0a143d95aedd-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 16:28:04 crc kubenswrapper[5120]: I0316 16:28:04.363481 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06b8b1f6-bed1-4548-8bdc-0a143d95aedd-scripts" (OuterVolumeSpecName: "scripts") pod "06b8b1f6-bed1-4548-8bdc-0a143d95aedd" (UID: "06b8b1f6-bed1-4548-8bdc-0a143d95aedd"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:28:04 crc kubenswrapper[5120]: I0316 16:28:04.364919 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage03-crc" (OuterVolumeSpecName: "glance") pod "06b8b1f6-bed1-4548-8bdc-0a143d95aedd" (UID: "06b8b1f6-bed1-4548-8bdc-0a143d95aedd"). InnerVolumeSpecName "local-storage03-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:28:04 crc kubenswrapper[5120]: I0316 16:28:04.368080 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06b8b1f6-bed1-4548-8bdc-0a143d95aedd-kube-api-access-9fvvq" (OuterVolumeSpecName: "kube-api-access-9fvvq") pod "06b8b1f6-bed1-4548-8bdc-0a143d95aedd" (UID: "06b8b1f6-bed1-4548-8bdc-0a143d95aedd"). InnerVolumeSpecName "kube-api-access-9fvvq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:28:04 crc kubenswrapper[5120]: I0316 16:28:04.433144 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06b8b1f6-bed1-4548-8bdc-0a143d95aedd-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "06b8b1f6-bed1-4548-8bdc-0a143d95aedd" (UID: "06b8b1f6-bed1-4548-8bdc-0a143d95aedd"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:28:04 crc kubenswrapper[5120]: I0316 16:28:04.437517 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06b8b1f6-bed1-4548-8bdc-0a143d95aedd-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "06b8b1f6-bed1-4548-8bdc-0a143d95aedd" (UID: "06b8b1f6-bed1-4548-8bdc-0a143d95aedd"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:28:04 crc kubenswrapper[5120]: I0316 16:28:04.439615 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06b8b1f6-bed1-4548-8bdc-0a143d95aedd-config-data" (OuterVolumeSpecName: "config-data") pod "06b8b1f6-bed1-4548-8bdc-0a143d95aedd" (UID: "06b8b1f6-bed1-4548-8bdc-0a143d95aedd"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:28:04 crc kubenswrapper[5120]: I0316 16:28:04.466275 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9fvvq\" (UniqueName: \"kubernetes.io/projected/06b8b1f6-bed1-4548-8bdc-0a143d95aedd-kube-api-access-9fvvq\") on node \"crc\" DevicePath \"\"" Mar 16 16:28:04 crc kubenswrapper[5120]: I0316 16:28:04.466325 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") on node \"crc\" " Mar 16 16:28:04 crc kubenswrapper[5120]: I0316 16:28:04.466336 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/06b8b1f6-bed1-4548-8bdc-0a143d95aedd-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:28:04 crc kubenswrapper[5120]: I0316 16:28:04.466346 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/06b8b1f6-bed1-4548-8bdc-0a143d95aedd-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:28:04 crc kubenswrapper[5120]: I0316 16:28:04.466358 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/06b8b1f6-bed1-4548-8bdc-0a143d95aedd-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:28:04 crc kubenswrapper[5120]: I0316 16:28:04.466368 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/06b8b1f6-bed1-4548-8bdc-0a143d95aedd-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:28:04 crc kubenswrapper[5120]: I0316 16:28:04.493054 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage03-crc" (UniqueName: "kubernetes.io/local-volume/local-storage03-crc") on node "crc" Mar 16 16:28:04 crc kubenswrapper[5120]: I0316 16:28:04.568879 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:28:04 crc kubenswrapper[5120]: I0316 16:28:04.597495 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:28:04 crc kubenswrapper[5120]: I0316 16:28:04.605382 5120 generic.go:358] "Generic (PLEG): container finished" podID="06b8b1f6-bed1-4548-8bdc-0a143d95aedd" containerID="9dbabc0a3d58b62aed75c816865442845fbaca03956a14056838caa0d2b75ce2" exitCode=0 Mar 16 16:28:04 crc kubenswrapper[5120]: I0316 16:28:04.605531 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"06b8b1f6-bed1-4548-8bdc-0a143d95aedd","Type":"ContainerDied","Data":"9dbabc0a3d58b62aed75c816865442845fbaca03956a14056838caa0d2b75ce2"} Mar 16 16:28:04 crc kubenswrapper[5120]: I0316 16:28:04.605566 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"06b8b1f6-bed1-4548-8bdc-0a143d95aedd","Type":"ContainerDied","Data":"b1088987bd713ec967bc668edb6e3e74467a05566fb10b990836a73a4d15ec4c"} Mar 16 16:28:04 crc kubenswrapper[5120]: I0316 16:28:04.605581 5120 scope.go:117] "RemoveContainer" containerID="9dbabc0a3d58b62aed75c816865442845fbaca03956a14056838caa0d2b75ce2" Mar 16 16:28:04 crc kubenswrapper[5120]: I0316 16:28:04.605688 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:28:04 crc kubenswrapper[5120]: I0316 16:28:04.617845 5120 generic.go:358] "Generic (PLEG): container finished" podID="5b82cd86-0489-4dc6-8d45-b478e71f1083" containerID="1d966ec507ef8140bae32b68192acf2c779348364fc574d434164a1fabc006d3" exitCode=0 Mar 16 16:28:04 crc kubenswrapper[5120]: I0316 16:28:04.618091 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-6b678b5478-h7p85" event={"ID":"5b82cd86-0489-4dc6-8d45-b478e71f1083","Type":"ContainerDied","Data":"1d966ec507ef8140bae32b68192acf2c779348364fc574d434164a1fabc006d3"} Mar 16 16:28:04 crc kubenswrapper[5120]: I0316 16:28:04.621938 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a939360a-d99d-43c2-90ff-fb43c7701f33","Type":"ContainerStarted","Data":"174dc712f4a453ee684d74177527a1b836a3bced7ef9c0772e3c3e45df681bc1"} Mar 16 16:28:04 crc kubenswrapper[5120]: I0316 16:28:04.622096 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="a939360a-d99d-43c2-90ff-fb43c7701f33" containerName="proxy-httpd" containerID="cri-o://174dc712f4a453ee684d74177527a1b836a3bced7ef9c0772e3c3e45df681bc1" gracePeriod=30 Mar 16 16:28:04 crc kubenswrapper[5120]: I0316 16:28:04.622084 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="a939360a-d99d-43c2-90ff-fb43c7701f33" containerName="ceilometer-central-agent" containerID="cri-o://762a70913ba4d9bf454f34cc252d0bdbb883c2eb9c976407f4125f4803033193" gracePeriod=30 Mar 16 16:28:04 crc kubenswrapper[5120]: I0316 16:28:04.622106 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:28:04 crc kubenswrapper[5120]: I0316 16:28:04.622182 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="a939360a-d99d-43c2-90ff-fb43c7701f33" containerName="sg-core" containerID="cri-o://745819b39d1a2d09c07c3309ac4a926fde00f50c0047d72085af0f2da0185edd" gracePeriod=30 Mar 16 16:28:04 crc kubenswrapper[5120]: I0316 16:28:04.622231 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="a939360a-d99d-43c2-90ff-fb43c7701f33" containerName="ceilometer-notification-agent" containerID="cri-o://ecd57a8becef854fe7695d21618ffda8f9f7ddc2d5081f731f5cb4f6122a34ce" gracePeriod=30 Mar 16 16:28:04 crc kubenswrapper[5120]: W0316 16:28:04.625681 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcecaa51b_004f_4941_99e2_23272d052fa7.slice/crio-8f1d9fdee51384d61db35b7ecdb29c35878da559c9dd8169d6c70450cb13338a WatchSource:0}: Error finding container 8f1d9fdee51384d61db35b7ecdb29c35878da559c9dd8169d6c70450cb13338a: Status 404 returned error can't find the container with id 8f1d9fdee51384d61db35b7ecdb29c35878da559c9dd8169d6c70450cb13338a Mar 16 16:28:04 crc kubenswrapper[5120]: I0316 16:28:04.670496 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=3.02962392 podStartE2EDuration="7.67047376s" podCreationTimestamp="2026-03-16 16:27:57 +0000 UTC" firstStartedPulling="2026-03-16 16:27:58.673149878 +0000 UTC m=+3380.827081535" lastFinishedPulling="2026-03-16 16:28:03.313999718 +0000 UTC m=+3385.467931375" observedRunningTime="2026-03-16 16:28:04.660533954 +0000 UTC m=+3386.814465611" watchObservedRunningTime="2026-03-16 16:28:04.67047376 +0000 UTC m=+3386.824405417" Mar 16 16:28:04 crc kubenswrapper[5120]: I0316 16:28:04.676919 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d4a84888-a119-4cef-9709-e47200b01990" path="/var/lib/kubelet/pods/d4a84888-a119-4cef-9709-e47200b01990/volumes" Mar 16 16:28:04 crc kubenswrapper[5120]: I0316 16:28:04.750000 5120 scope.go:117] "RemoveContainer" containerID="fa480b3baf502dd59bb2e9ee71fe48cb86a8e9040dc07d72ba6da8ea71f26f3d" Mar 16 16:28:04 crc kubenswrapper[5120]: I0316 16:28:04.752833 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:28:04 crc kubenswrapper[5120]: I0316 16:28:04.788873 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:28:04 crc kubenswrapper[5120]: I0316 16:28:04.800829 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:28:04 crc kubenswrapper[5120]: I0316 16:28:04.802249 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06b8b1f6-bed1-4548-8bdc-0a143d95aedd" containerName="glance-log" Mar 16 16:28:04 crc kubenswrapper[5120]: I0316 16:28:04.802267 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="06b8b1f6-bed1-4548-8bdc-0a143d95aedd" containerName="glance-log" Mar 16 16:28:04 crc kubenswrapper[5120]: I0316 16:28:04.802307 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06b8b1f6-bed1-4548-8bdc-0a143d95aedd" containerName="glance-httpd" Mar 16 16:28:04 crc kubenswrapper[5120]: I0316 16:28:04.802312 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="06b8b1f6-bed1-4548-8bdc-0a143d95aedd" containerName="glance-httpd" Mar 16 16:28:04 crc kubenswrapper[5120]: I0316 16:28:04.802511 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="06b8b1f6-bed1-4548-8bdc-0a143d95aedd" containerName="glance-httpd" Mar 16 16:28:04 crc kubenswrapper[5120]: I0316 16:28:04.802526 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="06b8b1f6-bed1-4548-8bdc-0a143d95aedd" containerName="glance-log" Mar 16 16:28:04 crc kubenswrapper[5120]: I0316 16:28:04.817162 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:28:04 crc kubenswrapper[5120]: I0316 16:28:04.817995 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:28:04 crc kubenswrapper[5120]: I0316 16:28:04.819193 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-internal-config-data\"" Mar 16 16:28:04 crc kubenswrapper[5120]: I0316 16:28:04.819470 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-internal-svc\"" Mar 16 16:28:04 crc kubenswrapper[5120]: I0316 16:28:04.879594 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kst4j\" (UniqueName: \"kubernetes.io/projected/ed1bcd44-0ed6-4cb4-a735-798e033c8b08-kube-api-access-kst4j\") pod \"glance-default-internal-api-0\" (UID: \"ed1bcd44-0ed6-4cb4-a735-798e033c8b08\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:28:04 crc kubenswrapper[5120]: I0316 16:28:04.879711 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/ed1bcd44-0ed6-4cb4-a735-798e033c8b08-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"ed1bcd44-0ed6-4cb4-a735-798e033c8b08\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:28:04 crc kubenswrapper[5120]: I0316 16:28:04.879803 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ed1bcd44-0ed6-4cb4-a735-798e033c8b08-logs\") pod \"glance-default-internal-api-0\" (UID: \"ed1bcd44-0ed6-4cb4-a735-798e033c8b08\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:28:04 crc kubenswrapper[5120]: I0316 16:28:04.879910 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ed1bcd44-0ed6-4cb4-a735-798e033c8b08-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"ed1bcd44-0ed6-4cb4-a735-798e033c8b08\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:28:04 crc kubenswrapper[5120]: I0316 16:28:04.880024 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ed1bcd44-0ed6-4cb4-a735-798e033c8b08-scripts\") pod \"glance-default-internal-api-0\" (UID: \"ed1bcd44-0ed6-4cb4-a735-798e033c8b08\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:28:04 crc kubenswrapper[5120]: I0316 16:28:04.880349 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/ed1bcd44-0ed6-4cb4-a735-798e033c8b08-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"ed1bcd44-0ed6-4cb4-a735-798e033c8b08\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:28:04 crc kubenswrapper[5120]: I0316 16:28:04.880510 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ed1bcd44-0ed6-4cb4-a735-798e033c8b08-config-data\") pod \"glance-default-internal-api-0\" (UID: \"ed1bcd44-0ed6-4cb4-a735-798e033c8b08\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:28:04 crc kubenswrapper[5120]: I0316 16:28:04.880578 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"glance-default-internal-api-0\" (UID: \"ed1bcd44-0ed6-4cb4-a735-798e033c8b08\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:28:04 crc kubenswrapper[5120]: I0316 16:28:04.881574 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-6b678b5478-h7p85" Mar 16 16:28:04 crc kubenswrapper[5120]: I0316 16:28:04.895349 5120 scope.go:117] "RemoveContainer" containerID="9dbabc0a3d58b62aed75c816865442845fbaca03956a14056838caa0d2b75ce2" Mar 16 16:28:04 crc kubenswrapper[5120]: E0316 16:28:04.895856 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9dbabc0a3d58b62aed75c816865442845fbaca03956a14056838caa0d2b75ce2\": container with ID starting with 9dbabc0a3d58b62aed75c816865442845fbaca03956a14056838caa0d2b75ce2 not found: ID does not exist" containerID="9dbabc0a3d58b62aed75c816865442845fbaca03956a14056838caa0d2b75ce2" Mar 16 16:28:04 crc kubenswrapper[5120]: I0316 16:28:04.895894 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9dbabc0a3d58b62aed75c816865442845fbaca03956a14056838caa0d2b75ce2"} err="failed to get container status \"9dbabc0a3d58b62aed75c816865442845fbaca03956a14056838caa0d2b75ce2\": rpc error: code = NotFound desc = could not find container \"9dbabc0a3d58b62aed75c816865442845fbaca03956a14056838caa0d2b75ce2\": container with ID starting with 9dbabc0a3d58b62aed75c816865442845fbaca03956a14056838caa0d2b75ce2 not found: ID does not exist" Mar 16 16:28:04 crc kubenswrapper[5120]: I0316 16:28:04.895923 5120 scope.go:117] "RemoveContainer" containerID="fa480b3baf502dd59bb2e9ee71fe48cb86a8e9040dc07d72ba6da8ea71f26f3d" Mar 16 16:28:04 crc kubenswrapper[5120]: E0316 16:28:04.896655 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa480b3baf502dd59bb2e9ee71fe48cb86a8e9040dc07d72ba6da8ea71f26f3d\": container with ID starting with fa480b3baf502dd59bb2e9ee71fe48cb86a8e9040dc07d72ba6da8ea71f26f3d not found: ID does not exist" containerID="fa480b3baf502dd59bb2e9ee71fe48cb86a8e9040dc07d72ba6da8ea71f26f3d" Mar 16 16:28:04 crc kubenswrapper[5120]: I0316 16:28:04.896686 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa480b3baf502dd59bb2e9ee71fe48cb86a8e9040dc07d72ba6da8ea71f26f3d"} err="failed to get container status \"fa480b3baf502dd59bb2e9ee71fe48cb86a8e9040dc07d72ba6da8ea71f26f3d\": rpc error: code = NotFound desc = could not find container \"fa480b3baf502dd59bb2e9ee71fe48cb86a8e9040dc07d72ba6da8ea71f26f3d\": container with ID starting with fa480b3baf502dd59bb2e9ee71fe48cb86a8e9040dc07d72ba6da8ea71f26f3d not found: ID does not exist" Mar 16 16:28:05 crc kubenswrapper[5120]: I0316 16:28:04.981399 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/5b82cd86-0489-4dc6-8d45-b478e71f1083-internal-tls-certs\") pod \"5b82cd86-0489-4dc6-8d45-b478e71f1083\" (UID: \"5b82cd86-0489-4dc6-8d45-b478e71f1083\") " Mar 16 16:28:05 crc kubenswrapper[5120]: I0316 16:28:04.981460 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7wgfp\" (UniqueName: \"kubernetes.io/projected/5b82cd86-0489-4dc6-8d45-b478e71f1083-kube-api-access-7wgfp\") pod \"5b82cd86-0489-4dc6-8d45-b478e71f1083\" (UID: \"5b82cd86-0489-4dc6-8d45-b478e71f1083\") " Mar 16 16:28:05 crc kubenswrapper[5120]: I0316 16:28:04.981668 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5b82cd86-0489-4dc6-8d45-b478e71f1083-combined-ca-bundle\") pod \"5b82cd86-0489-4dc6-8d45-b478e71f1083\" (UID: \"5b82cd86-0489-4dc6-8d45-b478e71f1083\") " Mar 16 16:28:05 crc kubenswrapper[5120]: I0316 16:28:04.981828 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/5b82cd86-0489-4dc6-8d45-b478e71f1083-public-tls-certs\") pod \"5b82cd86-0489-4dc6-8d45-b478e71f1083\" (UID: \"5b82cd86-0489-4dc6-8d45-b478e71f1083\") " Mar 16 16:28:05 crc kubenswrapper[5120]: I0316 16:28:04.981887 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5b82cd86-0489-4dc6-8d45-b478e71f1083-config-data\") pod \"5b82cd86-0489-4dc6-8d45-b478e71f1083\" (UID: \"5b82cd86-0489-4dc6-8d45-b478e71f1083\") " Mar 16 16:28:05 crc kubenswrapper[5120]: I0316 16:28:04.982139 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5b82cd86-0489-4dc6-8d45-b478e71f1083-logs\") pod \"5b82cd86-0489-4dc6-8d45-b478e71f1083\" (UID: \"5b82cd86-0489-4dc6-8d45-b478e71f1083\") " Mar 16 16:28:05 crc kubenswrapper[5120]: I0316 16:28:04.982197 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5b82cd86-0489-4dc6-8d45-b478e71f1083-scripts\") pod \"5b82cd86-0489-4dc6-8d45-b478e71f1083\" (UID: \"5b82cd86-0489-4dc6-8d45-b478e71f1083\") " Mar 16 16:28:05 crc kubenswrapper[5120]: I0316 16:28:04.982523 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/ed1bcd44-0ed6-4cb4-a735-798e033c8b08-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"ed1bcd44-0ed6-4cb4-a735-798e033c8b08\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:28:05 crc kubenswrapper[5120]: I0316 16:28:04.982601 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ed1bcd44-0ed6-4cb4-a735-798e033c8b08-logs\") pod \"glance-default-internal-api-0\" (UID: \"ed1bcd44-0ed6-4cb4-a735-798e033c8b08\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:28:05 crc kubenswrapper[5120]: I0316 16:28:04.982642 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ed1bcd44-0ed6-4cb4-a735-798e033c8b08-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"ed1bcd44-0ed6-4cb4-a735-798e033c8b08\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:28:05 crc kubenswrapper[5120]: I0316 16:28:04.982700 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ed1bcd44-0ed6-4cb4-a735-798e033c8b08-scripts\") pod \"glance-default-internal-api-0\" (UID: \"ed1bcd44-0ed6-4cb4-a735-798e033c8b08\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:28:05 crc kubenswrapper[5120]: I0316 16:28:04.982964 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/ed1bcd44-0ed6-4cb4-a735-798e033c8b08-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"ed1bcd44-0ed6-4cb4-a735-798e033c8b08\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:28:05 crc kubenswrapper[5120]: I0316 16:28:04.983083 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ed1bcd44-0ed6-4cb4-a735-798e033c8b08-config-data\") pod \"glance-default-internal-api-0\" (UID: \"ed1bcd44-0ed6-4cb4-a735-798e033c8b08\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:28:05 crc kubenswrapper[5120]: I0316 16:28:04.983137 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"glance-default-internal-api-0\" (UID: \"ed1bcd44-0ed6-4cb4-a735-798e033c8b08\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:28:05 crc kubenswrapper[5120]: I0316 16:28:04.983163 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kst4j\" (UniqueName: \"kubernetes.io/projected/ed1bcd44-0ed6-4cb4-a735-798e033c8b08-kube-api-access-kst4j\") pod \"glance-default-internal-api-0\" (UID: \"ed1bcd44-0ed6-4cb4-a735-798e033c8b08\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:28:05 crc kubenswrapper[5120]: I0316 16:28:04.983827 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b82cd86-0489-4dc6-8d45-b478e71f1083-logs" (OuterVolumeSpecName: "logs") pod "5b82cd86-0489-4dc6-8d45-b478e71f1083" (UID: "5b82cd86-0489-4dc6-8d45-b478e71f1083"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:28:05 crc kubenswrapper[5120]: I0316 16:28:04.984932 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/ed1bcd44-0ed6-4cb4-a735-798e033c8b08-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"ed1bcd44-0ed6-4cb4-a735-798e033c8b08\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:28:05 crc kubenswrapper[5120]: I0316 16:28:04.985076 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"glance-default-internal-api-0\" (UID: \"ed1bcd44-0ed6-4cb4-a735-798e033c8b08\") device mount path \"/mnt/openstack/pv03\"" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:28:05 crc kubenswrapper[5120]: I0316 16:28:04.994990 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ed1bcd44-0ed6-4cb4-a735-798e033c8b08-logs\") pod \"glance-default-internal-api-0\" (UID: \"ed1bcd44-0ed6-4cb4-a735-798e033c8b08\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:28:05 crc kubenswrapper[5120]: I0316 16:28:04.998149 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b82cd86-0489-4dc6-8d45-b478e71f1083-kube-api-access-7wgfp" (OuterVolumeSpecName: "kube-api-access-7wgfp") pod "5b82cd86-0489-4dc6-8d45-b478e71f1083" (UID: "5b82cd86-0489-4dc6-8d45-b478e71f1083"). InnerVolumeSpecName "kube-api-access-7wgfp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:28:05 crc kubenswrapper[5120]: I0316 16:28:05.003347 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/ed1bcd44-0ed6-4cb4-a735-798e033c8b08-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"ed1bcd44-0ed6-4cb4-a735-798e033c8b08\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:28:05 crc kubenswrapper[5120]: I0316 16:28:05.007674 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ed1bcd44-0ed6-4cb4-a735-798e033c8b08-scripts\") pod \"glance-default-internal-api-0\" (UID: \"ed1bcd44-0ed6-4cb4-a735-798e033c8b08\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:28:05 crc kubenswrapper[5120]: I0316 16:28:05.010889 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ed1bcd44-0ed6-4cb4-a735-798e033c8b08-config-data\") pod \"glance-default-internal-api-0\" (UID: \"ed1bcd44-0ed6-4cb4-a735-798e033c8b08\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:28:05 crc kubenswrapper[5120]: I0316 16:28:05.012248 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ed1bcd44-0ed6-4cb4-a735-798e033c8b08-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"ed1bcd44-0ed6-4cb4-a735-798e033c8b08\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:28:05 crc kubenswrapper[5120]: I0316 16:28:05.021791 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b82cd86-0489-4dc6-8d45-b478e71f1083-scripts" (OuterVolumeSpecName: "scripts") pod "5b82cd86-0489-4dc6-8d45-b478e71f1083" (UID: "5b82cd86-0489-4dc6-8d45-b478e71f1083"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:28:05 crc kubenswrapper[5120]: I0316 16:28:05.044393 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kst4j\" (UniqueName: \"kubernetes.io/projected/ed1bcd44-0ed6-4cb4-a735-798e033c8b08-kube-api-access-kst4j\") pod \"glance-default-internal-api-0\" (UID: \"ed1bcd44-0ed6-4cb4-a735-798e033c8b08\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:28:05 crc kubenswrapper[5120]: I0316 16:28:05.062401 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"glance-default-internal-api-0\" (UID: \"ed1bcd44-0ed6-4cb4-a735-798e033c8b08\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:28:05 crc kubenswrapper[5120]: I0316 16:28:05.087053 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5b82cd86-0489-4dc6-8d45-b478e71f1083-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:28:05 crc kubenswrapper[5120]: I0316 16:28:05.087918 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5b82cd86-0489-4dc6-8d45-b478e71f1083-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:28:05 crc kubenswrapper[5120]: I0316 16:28:05.087937 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7wgfp\" (UniqueName: \"kubernetes.io/projected/5b82cd86-0489-4dc6-8d45-b478e71f1083-kube-api-access-7wgfp\") on node \"crc\" DevicePath \"\"" Mar 16 16:28:05 crc kubenswrapper[5120]: I0316 16:28:05.100003 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b82cd86-0489-4dc6-8d45-b478e71f1083-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "5b82cd86-0489-4dc6-8d45-b478e71f1083" (UID: "5b82cd86-0489-4dc6-8d45-b478e71f1083"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:28:05 crc kubenswrapper[5120]: I0316 16:28:05.112619 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b82cd86-0489-4dc6-8d45-b478e71f1083-config-data" (OuterVolumeSpecName: "config-data") pod "5b82cd86-0489-4dc6-8d45-b478e71f1083" (UID: "5b82cd86-0489-4dc6-8d45-b478e71f1083"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:28:05 crc kubenswrapper[5120]: I0316 16:28:05.150694 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b82cd86-0489-4dc6-8d45-b478e71f1083-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "5b82cd86-0489-4dc6-8d45-b478e71f1083" (UID: "5b82cd86-0489-4dc6-8d45-b478e71f1083"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:28:05 crc kubenswrapper[5120]: I0316 16:28:05.171074 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b82cd86-0489-4dc6-8d45-b478e71f1083-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "5b82cd86-0489-4dc6-8d45-b478e71f1083" (UID: "5b82cd86-0489-4dc6-8d45-b478e71f1083"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:28:05 crc kubenswrapper[5120]: I0316 16:28:05.180388 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:28:05 crc kubenswrapper[5120]: I0316 16:28:05.189038 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561308-97774" Mar 16 16:28:05 crc kubenswrapper[5120]: I0316 16:28:05.190206 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5b82cd86-0489-4dc6-8d45-b478e71f1083-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:28:05 crc kubenswrapper[5120]: I0316 16:28:05.190252 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/5b82cd86-0489-4dc6-8d45-b478e71f1083-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:28:05 crc kubenswrapper[5120]: I0316 16:28:05.190263 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5b82cd86-0489-4dc6-8d45-b478e71f1083-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:28:05 crc kubenswrapper[5120]: I0316 16:28:05.190271 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/5b82cd86-0489-4dc6-8d45-b478e71f1083-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:28:05 crc kubenswrapper[5120]: I0316 16:28:05.293591 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hbzcb\" (UniqueName: \"kubernetes.io/projected/80f9e587-aeb8-49f9-a79a-c3898e9638b6-kube-api-access-hbzcb\") pod \"80f9e587-aeb8-49f9-a79a-c3898e9638b6\" (UID: \"80f9e587-aeb8-49f9-a79a-c3898e9638b6\") " Mar 16 16:28:05 crc kubenswrapper[5120]: I0316 16:28:05.299630 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80f9e587-aeb8-49f9-a79a-c3898e9638b6-kube-api-access-hbzcb" (OuterVolumeSpecName: "kube-api-access-hbzcb") pod "80f9e587-aeb8-49f9-a79a-c3898e9638b6" (UID: "80f9e587-aeb8-49f9-a79a-c3898e9638b6"). InnerVolumeSpecName "kube-api-access-hbzcb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:28:05 crc kubenswrapper[5120]: I0316 16:28:05.396840 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hbzcb\" (UniqueName: \"kubernetes.io/projected/80f9e587-aeb8-49f9-a79a-c3898e9638b6-kube-api-access-hbzcb\") on node \"crc\" DevicePath \"\"" Mar 16 16:28:05 crc kubenswrapper[5120]: I0316 16:28:05.637129 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-6b678b5478-h7p85" Mar 16 16:28:05 crc kubenswrapper[5120]: I0316 16:28:05.638337 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-6b678b5478-h7p85" event={"ID":"5b82cd86-0489-4dc6-8d45-b478e71f1083","Type":"ContainerDied","Data":"47c3fdf9019ebec804ba04a1c88b84948eb5b39abf5f7dec4ba108cd6956c5e4"} Mar 16 16:28:05 crc kubenswrapper[5120]: I0316 16:28:05.638411 5120 scope.go:117] "RemoveContainer" containerID="1d966ec507ef8140bae32b68192acf2c779348364fc574d434164a1fabc006d3" Mar 16 16:28:05 crc kubenswrapper[5120]: I0316 16:28:05.650447 5120 generic.go:358] "Generic (PLEG): container finished" podID="a939360a-d99d-43c2-90ff-fb43c7701f33" containerID="174dc712f4a453ee684d74177527a1b836a3bced7ef9c0772e3c3e45df681bc1" exitCode=0 Mar 16 16:28:05 crc kubenswrapper[5120]: I0316 16:28:05.650601 5120 generic.go:358] "Generic (PLEG): container finished" podID="a939360a-d99d-43c2-90ff-fb43c7701f33" containerID="745819b39d1a2d09c07c3309ac4a926fde00f50c0047d72085af0f2da0185edd" exitCode=2 Mar 16 16:28:05 crc kubenswrapper[5120]: I0316 16:28:05.650680 5120 generic.go:358] "Generic (PLEG): container finished" podID="a939360a-d99d-43c2-90ff-fb43c7701f33" containerID="ecd57a8becef854fe7695d21618ffda8f9f7ddc2d5081f731f5cb4f6122a34ce" exitCode=0 Mar 16 16:28:05 crc kubenswrapper[5120]: I0316 16:28:05.650743 5120 generic.go:358] "Generic (PLEG): container finished" podID="a939360a-d99d-43c2-90ff-fb43c7701f33" containerID="762a70913ba4d9bf454f34cc252d0bdbb883c2eb9c976407f4125f4803033193" exitCode=0 Mar 16 16:28:05 crc kubenswrapper[5120]: I0316 16:28:05.650484 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a939360a-d99d-43c2-90ff-fb43c7701f33","Type":"ContainerDied","Data":"174dc712f4a453ee684d74177527a1b836a3bced7ef9c0772e3c3e45df681bc1"} Mar 16 16:28:05 crc kubenswrapper[5120]: I0316 16:28:05.651251 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a939360a-d99d-43c2-90ff-fb43c7701f33","Type":"ContainerDied","Data":"745819b39d1a2d09c07c3309ac4a926fde00f50c0047d72085af0f2da0185edd"} Mar 16 16:28:05 crc kubenswrapper[5120]: I0316 16:28:05.651327 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a939360a-d99d-43c2-90ff-fb43c7701f33","Type":"ContainerDied","Data":"ecd57a8becef854fe7695d21618ffda8f9f7ddc2d5081f731f5cb4f6122a34ce"} Mar 16 16:28:05 crc kubenswrapper[5120]: I0316 16:28:05.651391 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a939360a-d99d-43c2-90ff-fb43c7701f33","Type":"ContainerDied","Data":"762a70913ba4d9bf454f34cc252d0bdbb883c2eb9c976407f4125f4803033193"} Mar 16 16:28:05 crc kubenswrapper[5120]: I0316 16:28:05.651992 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a939360a-d99d-43c2-90ff-fb43c7701f33","Type":"ContainerDied","Data":"600f365e386c83a1ececd56996dbe5d2ef4ffcb2e16158e9af393068258b8006"} Mar 16 16:28:05 crc kubenswrapper[5120]: I0316 16:28:05.652081 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="600f365e386c83a1ececd56996dbe5d2ef4ffcb2e16158e9af393068258b8006" Mar 16 16:28:05 crc kubenswrapper[5120]: I0316 16:28:05.656449 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"cecaa51b-004f-4941-99e2-23272d052fa7","Type":"ContainerStarted","Data":"8f1d9fdee51384d61db35b7ecdb29c35878da559c9dd8169d6c70450cb13338a"} Mar 16 16:28:05 crc kubenswrapper[5120]: I0316 16:28:05.678529 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561308-97774" event={"ID":"80f9e587-aeb8-49f9-a79a-c3898e9638b6","Type":"ContainerDied","Data":"4742dbd187546fb0da9a0c5a5cd179f469427f902f1066c4d023f9588b7d2df5"} Mar 16 16:28:05 crc kubenswrapper[5120]: I0316 16:28:05.678570 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4742dbd187546fb0da9a0c5a5cd179f469427f902f1066c4d023f9588b7d2df5" Mar 16 16:28:05 crc kubenswrapper[5120]: I0316 16:28:05.678645 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561308-97774" Mar 16 16:28:05 crc kubenswrapper[5120]: I0316 16:28:05.687512 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:28:05 crc kubenswrapper[5120]: I0316 16:28:05.692797 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-6b678b5478-h7p85"] Mar 16 16:28:05 crc kubenswrapper[5120]: I0316 16:28:05.702067 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a939360a-d99d-43c2-90ff-fb43c7701f33-combined-ca-bundle\") pod \"a939360a-d99d-43c2-90ff-fb43c7701f33\" (UID: \"a939360a-d99d-43c2-90ff-fb43c7701f33\") " Mar 16 16:28:05 crc kubenswrapper[5120]: I0316 16:28:05.702393 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a939360a-d99d-43c2-90ff-fb43c7701f33-config-data\") pod \"a939360a-d99d-43c2-90ff-fb43c7701f33\" (UID: \"a939360a-d99d-43c2-90ff-fb43c7701f33\") " Mar 16 16:28:05 crc kubenswrapper[5120]: I0316 16:28:05.702635 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a939360a-d99d-43c2-90ff-fb43c7701f33-run-httpd\") pod \"a939360a-d99d-43c2-90ff-fb43c7701f33\" (UID: \"a939360a-d99d-43c2-90ff-fb43c7701f33\") " Mar 16 16:28:05 crc kubenswrapper[5120]: I0316 16:28:05.702812 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/a939360a-d99d-43c2-90ff-fb43c7701f33-sg-core-conf-yaml\") pod \"a939360a-d99d-43c2-90ff-fb43c7701f33\" (UID: \"a939360a-d99d-43c2-90ff-fb43c7701f33\") " Mar 16 16:28:05 crc kubenswrapper[5120]: I0316 16:28:05.703229 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a939360a-d99d-43c2-90ff-fb43c7701f33-scripts\") pod \"a939360a-d99d-43c2-90ff-fb43c7701f33\" (UID: \"a939360a-d99d-43c2-90ff-fb43c7701f33\") " Mar 16 16:28:05 crc kubenswrapper[5120]: I0316 16:28:05.703436 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5kzp5\" (UniqueName: \"kubernetes.io/projected/a939360a-d99d-43c2-90ff-fb43c7701f33-kube-api-access-5kzp5\") pod \"a939360a-d99d-43c2-90ff-fb43c7701f33\" (UID: \"a939360a-d99d-43c2-90ff-fb43c7701f33\") " Mar 16 16:28:05 crc kubenswrapper[5120]: I0316 16:28:05.703822 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a939360a-d99d-43c2-90ff-fb43c7701f33-log-httpd\") pod \"a939360a-d99d-43c2-90ff-fb43c7701f33\" (UID: \"a939360a-d99d-43c2-90ff-fb43c7701f33\") " Mar 16 16:28:05 crc kubenswrapper[5120]: I0316 16:28:05.704235 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a939360a-d99d-43c2-90ff-fb43c7701f33-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "a939360a-d99d-43c2-90ff-fb43c7701f33" (UID: "a939360a-d99d-43c2-90ff-fb43c7701f33"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:28:05 crc kubenswrapper[5120]: I0316 16:28:05.706890 5120 scope.go:117] "RemoveContainer" containerID="e8f6039ae2940f7d60f59834673991a6d6bfe9c29f5be1c00e4f4732e54d66a1" Mar 16 16:28:05 crc kubenswrapper[5120]: I0316 16:28:05.710959 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-6b678b5478-h7p85"] Mar 16 16:28:05 crc kubenswrapper[5120]: I0316 16:28:05.711484 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a939360a-d99d-43c2-90ff-fb43c7701f33-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "a939360a-d99d-43c2-90ff-fb43c7701f33" (UID: "a939360a-d99d-43c2-90ff-fb43c7701f33"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:28:05 crc kubenswrapper[5120]: I0316 16:28:05.714271 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a939360a-d99d-43c2-90ff-fb43c7701f33-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:28:05 crc kubenswrapper[5120]: I0316 16:28:05.715366 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a939360a-d99d-43c2-90ff-fb43c7701f33-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:28:05 crc kubenswrapper[5120]: I0316 16:28:05.719017 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a939360a-d99d-43c2-90ff-fb43c7701f33-scripts" (OuterVolumeSpecName: "scripts") pod "a939360a-d99d-43c2-90ff-fb43c7701f33" (UID: "a939360a-d99d-43c2-90ff-fb43c7701f33"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:28:05 crc kubenswrapper[5120]: I0316 16:28:05.729711 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a939360a-d99d-43c2-90ff-fb43c7701f33-kube-api-access-5kzp5" (OuterVolumeSpecName: "kube-api-access-5kzp5") pod "a939360a-d99d-43c2-90ff-fb43c7701f33" (UID: "a939360a-d99d-43c2-90ff-fb43c7701f33"). InnerVolumeSpecName "kube-api-access-5kzp5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:28:05 crc kubenswrapper[5120]: I0316 16:28:05.751930 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a939360a-d99d-43c2-90ff-fb43c7701f33-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "a939360a-d99d-43c2-90ff-fb43c7701f33" (UID: "a939360a-d99d-43c2-90ff-fb43c7701f33"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:28:05 crc kubenswrapper[5120]: W0316 16:28:05.778633 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poded1bcd44_0ed6_4cb4_a735_798e033c8b08.slice/crio-91162a05f9e8008f48b39039d03fe30e8328e83c28c8de431ef0be37619f714f WatchSource:0}: Error finding container 91162a05f9e8008f48b39039d03fe30e8328e83c28c8de431ef0be37619f714f: Status 404 returned error can't find the container with id 91162a05f9e8008f48b39039d03fe30e8328e83c28c8de431ef0be37619f714f Mar 16 16:28:05 crc kubenswrapper[5120]: I0316 16:28:05.789278 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:28:05 crc kubenswrapper[5120]: I0316 16:28:05.819927 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/a939360a-d99d-43c2-90ff-fb43c7701f33-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 16:28:05 crc kubenswrapper[5120]: I0316 16:28:05.820330 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a939360a-d99d-43c2-90ff-fb43c7701f33-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:28:05 crc kubenswrapper[5120]: I0316 16:28:05.820405 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5kzp5\" (UniqueName: \"kubernetes.io/projected/a939360a-d99d-43c2-90ff-fb43c7701f33-kube-api-access-5kzp5\") on node \"crc\" DevicePath \"\"" Mar 16 16:28:05 crc kubenswrapper[5120]: I0316 16:28:05.825502 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a939360a-d99d-43c2-90ff-fb43c7701f33-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "a939360a-d99d-43c2-90ff-fb43c7701f33" (UID: "a939360a-d99d-43c2-90ff-fb43c7701f33"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:28:05 crc kubenswrapper[5120]: I0316 16:28:05.855075 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a939360a-d99d-43c2-90ff-fb43c7701f33-config-data" (OuterVolumeSpecName: "config-data") pod "a939360a-d99d-43c2-90ff-fb43c7701f33" (UID: "a939360a-d99d-43c2-90ff-fb43c7701f33"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:28:05 crc kubenswrapper[5120]: I0316 16:28:05.922854 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a939360a-d99d-43c2-90ff-fb43c7701f33-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:28:05 crc kubenswrapper[5120]: I0316 16:28:05.923101 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a939360a-d99d-43c2-90ff-fb43c7701f33-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:28:06 crc kubenswrapper[5120]: I0316 16:28:06.274467 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-infra/auto-csr-approver-29561302-8vlww"] Mar 16 16:28:06 crc kubenswrapper[5120]: I0316 16:28:06.283359 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-infra/auto-csr-approver-29561302-8vlww"] Mar 16 16:28:06 crc kubenswrapper[5120]: I0316 16:28:06.690455 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="06b8b1f6-bed1-4548-8bdc-0a143d95aedd" path="/var/lib/kubelet/pods/06b8b1f6-bed1-4548-8bdc-0a143d95aedd/volumes" Mar 16 16:28:06 crc kubenswrapper[5120]: I0316 16:28:06.691713 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b82cd86-0489-4dc6-8d45-b478e71f1083" path="/var/lib/kubelet/pods/5b82cd86-0489-4dc6-8d45-b478e71f1083/volumes" Mar 16 16:28:06 crc kubenswrapper[5120]: I0316 16:28:06.692508 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f82ef7e7-0afb-4c91-975f-29517a090cb7" path="/var/lib/kubelet/pods/f82ef7e7-0afb-4c91-975f-29517a090cb7/volumes" Mar 16 16:28:06 crc kubenswrapper[5120]: I0316 16:28:06.711284 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"cecaa51b-004f-4941-99e2-23272d052fa7","Type":"ContainerStarted","Data":"cbdd5e27d1311400d077d840e745e422ae1a420aba181e769227f63c08296f03"} Mar 16 16:28:06 crc kubenswrapper[5120]: I0316 16:28:06.717733 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"ed1bcd44-0ed6-4cb4-a735-798e033c8b08","Type":"ContainerStarted","Data":"a52c969d2547d89e70885b898beb45d313c34fcdb7d0051f70ffe99c7f945c9e"} Mar 16 16:28:06 crc kubenswrapper[5120]: I0316 16:28:06.717790 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"ed1bcd44-0ed6-4cb4-a735-798e033c8b08","Type":"ContainerStarted","Data":"91162a05f9e8008f48b39039d03fe30e8328e83c28c8de431ef0be37619f714f"} Mar 16 16:28:06 crc kubenswrapper[5120]: I0316 16:28:06.720623 5120 generic.go:358] "Generic (PLEG): container finished" podID="08073bb9-e6b3-429c-ba4e-eb22a745252e" containerID="d02f6f0569175dc3b390375b76930ff0767123b353b32d8975594e7d2e8d83b7" exitCode=0 Mar 16 16:28:06 crc kubenswrapper[5120]: I0316 16:28:06.720720 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-h8hsk" event={"ID":"08073bb9-e6b3-429c-ba4e-eb22a745252e","Type":"ContainerDied","Data":"d02f6f0569175dc3b390375b76930ff0767123b353b32d8975594e7d2e8d83b7"} Mar 16 16:28:06 crc kubenswrapper[5120]: I0316 16:28:06.729511 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:28:06 crc kubenswrapper[5120]: I0316 16:28:06.778253 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:28:06 crc kubenswrapper[5120]: I0316 16:28:06.798813 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:28:06 crc kubenswrapper[5120]: I0316 16:28:06.808615 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:28:06 crc kubenswrapper[5120]: I0316 16:28:06.809799 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a939360a-d99d-43c2-90ff-fb43c7701f33" containerName="ceilometer-central-agent" Mar 16 16:28:06 crc kubenswrapper[5120]: I0316 16:28:06.809816 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a939360a-d99d-43c2-90ff-fb43c7701f33" containerName="ceilometer-central-agent" Mar 16 16:28:06 crc kubenswrapper[5120]: I0316 16:28:06.809829 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80f9e587-aeb8-49f9-a79a-c3898e9638b6" containerName="oc" Mar 16 16:28:06 crc kubenswrapper[5120]: I0316 16:28:06.809835 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="80f9e587-aeb8-49f9-a79a-c3898e9638b6" containerName="oc" Mar 16 16:28:06 crc kubenswrapper[5120]: I0316 16:28:06.809847 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a939360a-d99d-43c2-90ff-fb43c7701f33" containerName="sg-core" Mar 16 16:28:06 crc kubenswrapper[5120]: I0316 16:28:06.809852 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a939360a-d99d-43c2-90ff-fb43c7701f33" containerName="sg-core" Mar 16 16:28:06 crc kubenswrapper[5120]: I0316 16:28:06.809869 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a939360a-d99d-43c2-90ff-fb43c7701f33" containerName="proxy-httpd" Mar 16 16:28:06 crc kubenswrapper[5120]: I0316 16:28:06.809877 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a939360a-d99d-43c2-90ff-fb43c7701f33" containerName="proxy-httpd" Mar 16 16:28:06 crc kubenswrapper[5120]: I0316 16:28:06.809900 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a939360a-d99d-43c2-90ff-fb43c7701f33" containerName="ceilometer-notification-agent" Mar 16 16:28:06 crc kubenswrapper[5120]: I0316 16:28:06.809906 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a939360a-d99d-43c2-90ff-fb43c7701f33" containerName="ceilometer-notification-agent" Mar 16 16:28:06 crc kubenswrapper[5120]: I0316 16:28:06.809926 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b82cd86-0489-4dc6-8d45-b478e71f1083" containerName="placement-api" Mar 16 16:28:06 crc kubenswrapper[5120]: I0316 16:28:06.809931 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b82cd86-0489-4dc6-8d45-b478e71f1083" containerName="placement-api" Mar 16 16:28:06 crc kubenswrapper[5120]: I0316 16:28:06.809944 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b82cd86-0489-4dc6-8d45-b478e71f1083" containerName="placement-log" Mar 16 16:28:06 crc kubenswrapper[5120]: I0316 16:28:06.809949 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b82cd86-0489-4dc6-8d45-b478e71f1083" containerName="placement-log" Mar 16 16:28:06 crc kubenswrapper[5120]: I0316 16:28:06.810117 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="a939360a-d99d-43c2-90ff-fb43c7701f33" containerName="ceilometer-central-agent" Mar 16 16:28:06 crc kubenswrapper[5120]: I0316 16:28:06.810135 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="5b82cd86-0489-4dc6-8d45-b478e71f1083" containerName="placement-api" Mar 16 16:28:06 crc kubenswrapper[5120]: I0316 16:28:06.810145 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="a939360a-d99d-43c2-90ff-fb43c7701f33" containerName="ceilometer-notification-agent" Mar 16 16:28:06 crc kubenswrapper[5120]: I0316 16:28:06.810158 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="5b82cd86-0489-4dc6-8d45-b478e71f1083" containerName="placement-log" Mar 16 16:28:06 crc kubenswrapper[5120]: I0316 16:28:06.810168 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="80f9e587-aeb8-49f9-a79a-c3898e9638b6" containerName="oc" Mar 16 16:28:06 crc kubenswrapper[5120]: I0316 16:28:06.810178 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="a939360a-d99d-43c2-90ff-fb43c7701f33" containerName="sg-core" Mar 16 16:28:06 crc kubenswrapper[5120]: I0316 16:28:06.810188 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="a939360a-d99d-43c2-90ff-fb43c7701f33" containerName="proxy-httpd" Mar 16 16:28:06 crc kubenswrapper[5120]: I0316 16:28:06.818550 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:28:06 crc kubenswrapper[5120]: I0316 16:28:06.821378 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 16:28:06 crc kubenswrapper[5120]: I0316 16:28:06.821476 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 16:28:06 crc kubenswrapper[5120]: I0316 16:28:06.826996 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:28:06 crc kubenswrapper[5120]: I0316 16:28:06.977225 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/13e7a600-c09b-48ba-a299-3d1f7f3e9074-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"13e7a600-c09b-48ba-a299-3d1f7f3e9074\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:28:06 crc kubenswrapper[5120]: I0316 16:28:06.977293 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/13e7a600-c09b-48ba-a299-3d1f7f3e9074-run-httpd\") pod \"ceilometer-0\" (UID: \"13e7a600-c09b-48ba-a299-3d1f7f3e9074\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:28:06 crc kubenswrapper[5120]: I0316 16:28:06.977632 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/13e7a600-c09b-48ba-a299-3d1f7f3e9074-log-httpd\") pod \"ceilometer-0\" (UID: \"13e7a600-c09b-48ba-a299-3d1f7f3e9074\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:28:06 crc kubenswrapper[5120]: I0316 16:28:06.977726 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/13e7a600-c09b-48ba-a299-3d1f7f3e9074-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"13e7a600-c09b-48ba-a299-3d1f7f3e9074\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:28:06 crc kubenswrapper[5120]: I0316 16:28:06.977778 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/13e7a600-c09b-48ba-a299-3d1f7f3e9074-config-data\") pod \"ceilometer-0\" (UID: \"13e7a600-c09b-48ba-a299-3d1f7f3e9074\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:28:06 crc kubenswrapper[5120]: I0316 16:28:06.977815 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/13e7a600-c09b-48ba-a299-3d1f7f3e9074-scripts\") pod \"ceilometer-0\" (UID: \"13e7a600-c09b-48ba-a299-3d1f7f3e9074\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:28:06 crc kubenswrapper[5120]: I0316 16:28:06.977878 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8pg9\" (UniqueName: \"kubernetes.io/projected/13e7a600-c09b-48ba-a299-3d1f7f3e9074-kube-api-access-s8pg9\") pod \"ceilometer-0\" (UID: \"13e7a600-c09b-48ba-a299-3d1f7f3e9074\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:28:07 crc kubenswrapper[5120]: I0316 16:28:07.209846 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/13e7a600-c09b-48ba-a299-3d1f7f3e9074-log-httpd\") pod \"ceilometer-0\" (UID: \"13e7a600-c09b-48ba-a299-3d1f7f3e9074\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:28:07 crc kubenswrapper[5120]: I0316 16:28:07.209890 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/13e7a600-c09b-48ba-a299-3d1f7f3e9074-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"13e7a600-c09b-48ba-a299-3d1f7f3e9074\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:28:07 crc kubenswrapper[5120]: I0316 16:28:07.209910 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/13e7a600-c09b-48ba-a299-3d1f7f3e9074-config-data\") pod \"ceilometer-0\" (UID: \"13e7a600-c09b-48ba-a299-3d1f7f3e9074\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:28:07 crc kubenswrapper[5120]: I0316 16:28:07.209934 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/13e7a600-c09b-48ba-a299-3d1f7f3e9074-scripts\") pod \"ceilometer-0\" (UID: \"13e7a600-c09b-48ba-a299-3d1f7f3e9074\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:28:07 crc kubenswrapper[5120]: I0316 16:28:07.209963 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s8pg9\" (UniqueName: \"kubernetes.io/projected/13e7a600-c09b-48ba-a299-3d1f7f3e9074-kube-api-access-s8pg9\") pod \"ceilometer-0\" (UID: \"13e7a600-c09b-48ba-a299-3d1f7f3e9074\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:28:07 crc kubenswrapper[5120]: I0316 16:28:07.210157 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/13e7a600-c09b-48ba-a299-3d1f7f3e9074-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"13e7a600-c09b-48ba-a299-3d1f7f3e9074\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:28:07 crc kubenswrapper[5120]: I0316 16:28:07.210182 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/13e7a600-c09b-48ba-a299-3d1f7f3e9074-run-httpd\") pod \"ceilometer-0\" (UID: \"13e7a600-c09b-48ba-a299-3d1f7f3e9074\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:28:07 crc kubenswrapper[5120]: I0316 16:28:07.210660 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/13e7a600-c09b-48ba-a299-3d1f7f3e9074-run-httpd\") pod \"ceilometer-0\" (UID: \"13e7a600-c09b-48ba-a299-3d1f7f3e9074\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:28:07 crc kubenswrapper[5120]: I0316 16:28:07.211783 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/13e7a600-c09b-48ba-a299-3d1f7f3e9074-log-httpd\") pod \"ceilometer-0\" (UID: \"13e7a600-c09b-48ba-a299-3d1f7f3e9074\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:28:07 crc kubenswrapper[5120]: I0316 16:28:07.223374 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/13e7a600-c09b-48ba-a299-3d1f7f3e9074-config-data\") pod \"ceilometer-0\" (UID: \"13e7a600-c09b-48ba-a299-3d1f7f3e9074\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:28:07 crc kubenswrapper[5120]: I0316 16:28:07.229896 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/13e7a600-c09b-48ba-a299-3d1f7f3e9074-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"13e7a600-c09b-48ba-a299-3d1f7f3e9074\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:28:07 crc kubenswrapper[5120]: I0316 16:28:07.230434 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/13e7a600-c09b-48ba-a299-3d1f7f3e9074-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"13e7a600-c09b-48ba-a299-3d1f7f3e9074\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:28:07 crc kubenswrapper[5120]: I0316 16:28:07.232821 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/13e7a600-c09b-48ba-a299-3d1f7f3e9074-scripts\") pod \"ceilometer-0\" (UID: \"13e7a600-c09b-48ba-a299-3d1f7f3e9074\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:28:07 crc kubenswrapper[5120]: I0316 16:28:07.254774 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8pg9\" (UniqueName: \"kubernetes.io/projected/13e7a600-c09b-48ba-a299-3d1f7f3e9074-kube-api-access-s8pg9\") pod \"ceilometer-0\" (UID: \"13e7a600-c09b-48ba-a299-3d1f7f3e9074\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:28:07 crc kubenswrapper[5120]: I0316 16:28:07.439993 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:28:07 crc kubenswrapper[5120]: I0316 16:28:07.743344 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"cecaa51b-004f-4941-99e2-23272d052fa7","Type":"ContainerStarted","Data":"4ad4e9e2f3e47e3af53e941d93e136f76505815b23580a998ab6986a501c972d"} Mar 16 16:28:07 crc kubenswrapper[5120]: I0316 16:28:07.748668 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"ed1bcd44-0ed6-4cb4-a735-798e033c8b08","Type":"ContainerStarted","Data":"5b81c1575b30f2252e88dd113e244df2352346edfc84f0f6cc943293511aa028"} Mar 16 16:28:07 crc kubenswrapper[5120]: I0316 16:28:07.776572 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-external-api-0" podStartSLOduration=4.776533948 podStartE2EDuration="4.776533948s" podCreationTimestamp="2026-03-16 16:28:03 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:28:07.762899624 +0000 UTC m=+3389.916831301" watchObservedRunningTime="2026-03-16 16:28:07.776533948 +0000 UTC m=+3389.930465605" Mar 16 16:28:07 crc kubenswrapper[5120]: I0316 16:28:07.785983 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-internal-api-0" podStartSLOduration=3.785964651 podStartE2EDuration="3.785964651s" podCreationTimestamp="2026-03-16 16:28:04 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:28:07.785634192 +0000 UTC m=+3389.939565859" watchObservedRunningTime="2026-03-16 16:28:07.785964651 +0000 UTC m=+3389.939896298" Mar 16 16:28:07 crc kubenswrapper[5120]: I0316 16:28:07.929184 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:28:07 crc kubenswrapper[5120]: I0316 16:28:07.937707 5120 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Mar 16 16:28:08 crc kubenswrapper[5120]: I0316 16:28:08.126651 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-h8hsk" Mar 16 16:28:08 crc kubenswrapper[5120]: I0316 16:28:08.244412 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/08073bb9-e6b3-429c-ba4e-eb22a745252e-scripts\") pod \"08073bb9-e6b3-429c-ba4e-eb22a745252e\" (UID: \"08073bb9-e6b3-429c-ba4e-eb22a745252e\") " Mar 16 16:28:08 crc kubenswrapper[5120]: I0316 16:28:08.244648 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/08073bb9-e6b3-429c-ba4e-eb22a745252e-config-data\") pod \"08073bb9-e6b3-429c-ba4e-eb22a745252e\" (UID: \"08073bb9-e6b3-429c-ba4e-eb22a745252e\") " Mar 16 16:28:08 crc kubenswrapper[5120]: I0316 16:28:08.244835 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/08073bb9-e6b3-429c-ba4e-eb22a745252e-combined-ca-bundle\") pod \"08073bb9-e6b3-429c-ba4e-eb22a745252e\" (UID: \"08073bb9-e6b3-429c-ba4e-eb22a745252e\") " Mar 16 16:28:08 crc kubenswrapper[5120]: I0316 16:28:08.245093 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sqkzj\" (UniqueName: \"kubernetes.io/projected/08073bb9-e6b3-429c-ba4e-eb22a745252e-kube-api-access-sqkzj\") pod \"08073bb9-e6b3-429c-ba4e-eb22a745252e\" (UID: \"08073bb9-e6b3-429c-ba4e-eb22a745252e\") " Mar 16 16:28:08 crc kubenswrapper[5120]: I0316 16:28:08.264128 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/08073bb9-e6b3-429c-ba4e-eb22a745252e-scripts" (OuterVolumeSpecName: "scripts") pod "08073bb9-e6b3-429c-ba4e-eb22a745252e" (UID: "08073bb9-e6b3-429c-ba4e-eb22a745252e"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:28:08 crc kubenswrapper[5120]: I0316 16:28:08.264181 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08073bb9-e6b3-429c-ba4e-eb22a745252e-kube-api-access-sqkzj" (OuterVolumeSpecName: "kube-api-access-sqkzj") pod "08073bb9-e6b3-429c-ba4e-eb22a745252e" (UID: "08073bb9-e6b3-429c-ba4e-eb22a745252e"). InnerVolumeSpecName "kube-api-access-sqkzj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:28:08 crc kubenswrapper[5120]: I0316 16:28:08.277425 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/08073bb9-e6b3-429c-ba4e-eb22a745252e-config-data" (OuterVolumeSpecName: "config-data") pod "08073bb9-e6b3-429c-ba4e-eb22a745252e" (UID: "08073bb9-e6b3-429c-ba4e-eb22a745252e"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:28:08 crc kubenswrapper[5120]: I0316 16:28:08.282885 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/08073bb9-e6b3-429c-ba4e-eb22a745252e-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "08073bb9-e6b3-429c-ba4e-eb22a745252e" (UID: "08073bb9-e6b3-429c-ba4e-eb22a745252e"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:28:08 crc kubenswrapper[5120]: I0316 16:28:08.348524 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/08073bb9-e6b3-429c-ba4e-eb22a745252e-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:28:08 crc kubenswrapper[5120]: I0316 16:28:08.348568 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/08073bb9-e6b3-429c-ba4e-eb22a745252e-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:28:08 crc kubenswrapper[5120]: I0316 16:28:08.348585 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sqkzj\" (UniqueName: \"kubernetes.io/projected/08073bb9-e6b3-429c-ba4e-eb22a745252e-kube-api-access-sqkzj\") on node \"crc\" DevicePath \"\"" Mar 16 16:28:08 crc kubenswrapper[5120]: I0316 16:28:08.348598 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/08073bb9-e6b3-429c-ba4e-eb22a745252e-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:28:08 crc kubenswrapper[5120]: I0316 16:28:08.506522 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:28:08 crc kubenswrapper[5120]: I0316 16:28:08.683037 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a939360a-d99d-43c2-90ff-fb43c7701f33" path="/var/lib/kubelet/pods/a939360a-d99d-43c2-90ff-fb43c7701f33/volumes" Mar 16 16:28:08 crc kubenswrapper[5120]: I0316 16:28:08.768871 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-h8hsk" Mar 16 16:28:08 crc kubenswrapper[5120]: I0316 16:28:08.768897 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-h8hsk" event={"ID":"08073bb9-e6b3-429c-ba4e-eb22a745252e","Type":"ContainerDied","Data":"d474d35c39649b0434e60104dbe29e838e154f066c01f1699c778849a4f59c34"} Mar 16 16:28:08 crc kubenswrapper[5120]: I0316 16:28:08.768936 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d474d35c39649b0434e60104dbe29e838e154f066c01f1699c778849a4f59c34" Mar 16 16:28:08 crc kubenswrapper[5120]: I0316 16:28:08.775347 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"13e7a600-c09b-48ba-a299-3d1f7f3e9074","Type":"ContainerStarted","Data":"74aabc4f4f060ddf70dac61b4d84a24df543c2c0b90c0e2d2cec11a0fff2564d"} Mar 16 16:28:08 crc kubenswrapper[5120]: I0316 16:28:08.775452 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"13e7a600-c09b-48ba-a299-3d1f7f3e9074","Type":"ContainerStarted","Data":"c4a7de21015d5e3d268379c3e055d7abdf5f1c3d38df6461352f0f87febfd0ba"} Mar 16 16:28:08 crc kubenswrapper[5120]: E0316 16:28:08.810554 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1907686 actualBytes=10240 Mar 16 16:28:08 crc kubenswrapper[5120]: I0316 16:28:08.818122 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:28:08 crc kubenswrapper[5120]: I0316 16:28:08.819328 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08073bb9-e6b3-429c-ba4e-eb22a745252e" containerName="nova-cell0-conductor-db-sync" Mar 16 16:28:08 crc kubenswrapper[5120]: I0316 16:28:08.819349 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="08073bb9-e6b3-429c-ba4e-eb22a745252e" containerName="nova-cell0-conductor-db-sync" Mar 16 16:28:08 crc kubenswrapper[5120]: I0316 16:28:08.819618 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="08073bb9-e6b3-429c-ba4e-eb22a745252e" containerName="nova-cell0-conductor-db-sync" Mar 16 16:28:08 crc kubenswrapper[5120]: I0316 16:28:08.832736 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:28:08 crc kubenswrapper[5120]: I0316 16:28:08.832971 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:28:08 crc kubenswrapper[5120]: I0316 16:28:08.875811 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-nova-dockercfg-sfq9d\"" Mar 16 16:28:08 crc kubenswrapper[5120]: I0316 16:28:08.876156 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-conductor-config-data\"" Mar 16 16:28:08 crc kubenswrapper[5120]: I0316 16:28:08.979064 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/43c71024-0a80-4f26-a6de-ebc75eeed01e-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"43c71024-0a80-4f26-a6de-ebc75eeed01e\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:28:08 crc kubenswrapper[5120]: I0316 16:28:08.979398 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/43c71024-0a80-4f26-a6de-ebc75eeed01e-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"43c71024-0a80-4f26-a6de-ebc75eeed01e\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:28:08 crc kubenswrapper[5120]: I0316 16:28:08.979423 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-765qv\" (UniqueName: \"kubernetes.io/projected/43c71024-0a80-4f26-a6de-ebc75eeed01e-kube-api-access-765qv\") pod \"nova-cell0-conductor-0\" (UID: \"43c71024-0a80-4f26-a6de-ebc75eeed01e\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:28:09 crc kubenswrapper[5120]: I0316 16:28:09.081475 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/43c71024-0a80-4f26-a6de-ebc75eeed01e-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"43c71024-0a80-4f26-a6de-ebc75eeed01e\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:28:09 crc kubenswrapper[5120]: I0316 16:28:09.081515 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-765qv\" (UniqueName: \"kubernetes.io/projected/43c71024-0a80-4f26-a6de-ebc75eeed01e-kube-api-access-765qv\") pod \"nova-cell0-conductor-0\" (UID: \"43c71024-0a80-4f26-a6de-ebc75eeed01e\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:28:09 crc kubenswrapper[5120]: I0316 16:28:09.081626 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/43c71024-0a80-4f26-a6de-ebc75eeed01e-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"43c71024-0a80-4f26-a6de-ebc75eeed01e\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:28:09 crc kubenswrapper[5120]: I0316 16:28:09.088485 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/43c71024-0a80-4f26-a6de-ebc75eeed01e-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"43c71024-0a80-4f26-a6de-ebc75eeed01e\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:28:09 crc kubenswrapper[5120]: I0316 16:28:09.089479 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/43c71024-0a80-4f26-a6de-ebc75eeed01e-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"43c71024-0a80-4f26-a6de-ebc75eeed01e\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:28:09 crc kubenswrapper[5120]: I0316 16:28:09.112426 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-765qv\" (UniqueName: \"kubernetes.io/projected/43c71024-0a80-4f26-a6de-ebc75eeed01e-kube-api-access-765qv\") pod \"nova-cell0-conductor-0\" (UID: \"43c71024-0a80-4f26-a6de-ebc75eeed01e\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:28:09 crc kubenswrapper[5120]: I0316 16:28:09.191175 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:28:09 crc kubenswrapper[5120]: I0316 16:28:09.659340 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:28:09 crc kubenswrapper[5120]: W0316 16:28:09.660025 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod43c71024_0a80_4f26_a6de_ebc75eeed01e.slice/crio-49f71d046124da568f42fec8e950787aba7ca23d684ae2b65566986d6bab6826 WatchSource:0}: Error finding container 49f71d046124da568f42fec8e950787aba7ca23d684ae2b65566986d6bab6826: Status 404 returned error can't find the container with id 49f71d046124da568f42fec8e950787aba7ca23d684ae2b65566986d6bab6826 Mar 16 16:28:09 crc kubenswrapper[5120]: I0316 16:28:09.789227 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"43c71024-0a80-4f26-a6de-ebc75eeed01e","Type":"ContainerStarted","Data":"49f71d046124da568f42fec8e950787aba7ca23d684ae2b65566986d6bab6826"} Mar 16 16:28:09 crc kubenswrapper[5120]: I0316 16:28:09.794880 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"13e7a600-c09b-48ba-a299-3d1f7f3e9074","Type":"ContainerStarted","Data":"159f3cb833b068248017b9c03056f264033cf6dfa89e905e79aa4ccb261c08f5"} Mar 16 16:28:10 crc kubenswrapper[5120]: I0316 16:28:10.805658 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"43c71024-0a80-4f26-a6de-ebc75eeed01e","Type":"ContainerStarted","Data":"1c288239519e7e76c9b53ae3a58cba524ac10f7a76be8d76feadee9330048b9b"} Mar 16 16:28:10 crc kubenswrapper[5120]: I0316 16:28:10.806004 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:28:10 crc kubenswrapper[5120]: I0316 16:28:10.814103 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"13e7a600-c09b-48ba-a299-3d1f7f3e9074","Type":"ContainerStarted","Data":"879d00e923d6a48e036c9c528f536f5e6c5644835d8fdd1c12dcef95ad1a8408"} Mar 16 16:28:10 crc kubenswrapper[5120]: I0316 16:28:10.825860 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podStartSLOduration=2.825843629 podStartE2EDuration="2.825843629s" podCreationTimestamp="2026-03-16 16:28:08 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:28:10.823860126 +0000 UTC m=+3392.977791773" watchObservedRunningTime="2026-03-16 16:28:10.825843629 +0000 UTC m=+3392.979775286" Mar 16 16:28:12 crc kubenswrapper[5120]: I0316 16:28:12.838137 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"13e7a600-c09b-48ba-a299-3d1f7f3e9074","Type":"ContainerStarted","Data":"52fcd04c31e66c2c41217d577964355f3ecd847c5758d75f4a6feac936487ac8"} Mar 16 16:28:12 crc kubenswrapper[5120]: I0316 16:28:12.838875 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="13e7a600-c09b-48ba-a299-3d1f7f3e9074" containerName="ceilometer-central-agent" containerID="cri-o://74aabc4f4f060ddf70dac61b4d84a24df543c2c0b90c0e2d2cec11a0fff2564d" gracePeriod=30 Mar 16 16:28:12 crc kubenswrapper[5120]: I0316 16:28:12.839142 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:28:12 crc kubenswrapper[5120]: I0316 16:28:12.839447 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="13e7a600-c09b-48ba-a299-3d1f7f3e9074" containerName="proxy-httpd" containerID="cri-o://52fcd04c31e66c2c41217d577964355f3ecd847c5758d75f4a6feac936487ac8" gracePeriod=30 Mar 16 16:28:12 crc kubenswrapper[5120]: I0316 16:28:12.839491 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="13e7a600-c09b-48ba-a299-3d1f7f3e9074" containerName="sg-core" containerID="cri-o://879d00e923d6a48e036c9c528f536f5e6c5644835d8fdd1c12dcef95ad1a8408" gracePeriod=30 Mar 16 16:28:12 crc kubenswrapper[5120]: I0316 16:28:12.839527 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="13e7a600-c09b-48ba-a299-3d1f7f3e9074" containerName="ceilometer-notification-agent" containerID="cri-o://159f3cb833b068248017b9c03056f264033cf6dfa89e905e79aa4ccb261c08f5" gracePeriod=30 Mar 16 16:28:12 crc kubenswrapper[5120]: I0316 16:28:12.867341 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=3.213320719 podStartE2EDuration="6.867323233s" podCreationTimestamp="2026-03-16 16:28:06 +0000 UTC" firstStartedPulling="2026-03-16 16:28:07.937900055 +0000 UTC m=+3390.091831712" lastFinishedPulling="2026-03-16 16:28:11.591902569 +0000 UTC m=+3393.745834226" observedRunningTime="2026-03-16 16:28:12.864003444 +0000 UTC m=+3395.017935101" watchObservedRunningTime="2026-03-16 16:28:12.867323233 +0000 UTC m=+3395.021254890" Mar 16 16:28:13 crc kubenswrapper[5120]: I0316 16:28:13.853886 5120 generic.go:358] "Generic (PLEG): container finished" podID="13e7a600-c09b-48ba-a299-3d1f7f3e9074" containerID="52fcd04c31e66c2c41217d577964355f3ecd847c5758d75f4a6feac936487ac8" exitCode=0 Mar 16 16:28:13 crc kubenswrapper[5120]: I0316 16:28:13.854103 5120 generic.go:358] "Generic (PLEG): container finished" podID="13e7a600-c09b-48ba-a299-3d1f7f3e9074" containerID="879d00e923d6a48e036c9c528f536f5e6c5644835d8fdd1c12dcef95ad1a8408" exitCode=2 Mar 16 16:28:13 crc kubenswrapper[5120]: I0316 16:28:13.854109 5120 generic.go:358] "Generic (PLEG): container finished" podID="13e7a600-c09b-48ba-a299-3d1f7f3e9074" containerID="159f3cb833b068248017b9c03056f264033cf6dfa89e905e79aa4ccb261c08f5" exitCode=0 Mar 16 16:28:13 crc kubenswrapper[5120]: I0316 16:28:13.853985 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"13e7a600-c09b-48ba-a299-3d1f7f3e9074","Type":"ContainerDied","Data":"52fcd04c31e66c2c41217d577964355f3ecd847c5758d75f4a6feac936487ac8"} Mar 16 16:28:13 crc kubenswrapper[5120]: I0316 16:28:13.854261 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"13e7a600-c09b-48ba-a299-3d1f7f3e9074","Type":"ContainerDied","Data":"879d00e923d6a48e036c9c528f536f5e6c5644835d8fdd1c12dcef95ad1a8408"} Mar 16 16:28:13 crc kubenswrapper[5120]: I0316 16:28:13.854288 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"13e7a600-c09b-48ba-a299-3d1f7f3e9074","Type":"ContainerDied","Data":"159f3cb833b068248017b9c03056f264033cf6dfa89e905e79aa4ccb261c08f5"} Mar 16 16:28:14 crc kubenswrapper[5120]: I0316 16:28:14.021445 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:28:14 crc kubenswrapper[5120]: I0316 16:28:14.021487 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:28:14 crc kubenswrapper[5120]: I0316 16:28:14.056166 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:28:14 crc kubenswrapper[5120]: I0316 16:28:14.063078 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:28:14 crc kubenswrapper[5120]: I0316 16:28:14.867479 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:28:14 crc kubenswrapper[5120]: I0316 16:28:14.869362 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:28:15 crc kubenswrapper[5120]: I0316 16:28:15.181135 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:28:15 crc kubenswrapper[5120]: I0316 16:28:15.181188 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:28:15 crc kubenswrapper[5120]: I0316 16:28:15.223643 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:28:15 crc kubenswrapper[5120]: I0316 16:28:15.238055 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:28:15 crc kubenswrapper[5120]: I0316 16:28:15.876636 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:28:15 crc kubenswrapper[5120]: I0316 16:28:15.877031 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:28:16 crc kubenswrapper[5120]: I0316 16:28:16.690851 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:28:16 crc kubenswrapper[5120]: I0316 16:28:16.883638 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:28:16 crc kubenswrapper[5120]: I0316 16:28:16.887104 5120 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Mar 16 16:28:17 crc kubenswrapper[5120]: I0316 16:28:17.037777 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:28:17 crc kubenswrapper[5120]: I0316 16:28:17.636634 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-bnzrd"] Mar 16 16:28:17 crc kubenswrapper[5120]: I0316 16:28:17.643386 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-bnzrd" Mar 16 16:28:17 crc kubenswrapper[5120]: I0316 16:28:17.647931 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-manage-scripts\"" Mar 16 16:28:17 crc kubenswrapper[5120]: I0316 16:28:17.657788 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-bnzrd"] Mar 16 16:28:17 crc kubenswrapper[5120]: I0316 16:28:17.660288 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-manage-config-data\"" Mar 16 16:28:17 crc kubenswrapper[5120]: I0316 16:28:17.721811 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4f828b4b-4ee0-44ac-b3ec-d1dfa524bbf8-config-data\") pod \"nova-cell0-cell-mapping-bnzrd\" (UID: \"4f828b4b-4ee0-44ac-b3ec-d1dfa524bbf8\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-bnzrd" Mar 16 16:28:17 crc kubenswrapper[5120]: I0316 16:28:17.721934 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4f828b4b-4ee0-44ac-b3ec-d1dfa524bbf8-scripts\") pod \"nova-cell0-cell-mapping-bnzrd\" (UID: \"4f828b4b-4ee0-44ac-b3ec-d1dfa524bbf8\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-bnzrd" Mar 16 16:28:17 crc kubenswrapper[5120]: I0316 16:28:17.722102 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xxnf\" (UniqueName: \"kubernetes.io/projected/4f828b4b-4ee0-44ac-b3ec-d1dfa524bbf8-kube-api-access-8xxnf\") pod \"nova-cell0-cell-mapping-bnzrd\" (UID: \"4f828b4b-4ee0-44ac-b3ec-d1dfa524bbf8\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-bnzrd" Mar 16 16:28:17 crc kubenswrapper[5120]: I0316 16:28:17.722206 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4f828b4b-4ee0-44ac-b3ec-d1dfa524bbf8-combined-ca-bundle\") pod \"nova-cell0-cell-mapping-bnzrd\" (UID: \"4f828b4b-4ee0-44ac-b3ec-d1dfa524bbf8\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-bnzrd" Mar 16 16:28:17 crc kubenswrapper[5120]: I0316 16:28:17.767419 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:28:17 crc kubenswrapper[5120]: I0316 16:28:17.784623 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:28:17 crc kubenswrapper[5120]: I0316 16:28:17.786507 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-config-data\"" Mar 16 16:28:17 crc kubenswrapper[5120]: I0316 16:28:17.791013 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:28:17 crc kubenswrapper[5120]: I0316 16:28:17.821313 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:28:17 crc kubenswrapper[5120]: I0316 16:28:17.825159 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4f828b4b-4ee0-44ac-b3ec-d1dfa524bbf8-combined-ca-bundle\") pod \"nova-cell0-cell-mapping-bnzrd\" (UID: \"4f828b4b-4ee0-44ac-b3ec-d1dfa524bbf8\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-bnzrd" Mar 16 16:28:17 crc kubenswrapper[5120]: I0316 16:28:17.825265 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/30cd93ec-58de-4375-a52f-11d5645d7bda-config-data\") pod \"nova-api-0\" (UID: \"30cd93ec-58de-4375-a52f-11d5645d7bda\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:28:17 crc kubenswrapper[5120]: I0316 16:28:17.825290 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4f828b4b-4ee0-44ac-b3ec-d1dfa524bbf8-config-data\") pod \"nova-cell0-cell-mapping-bnzrd\" (UID: \"4f828b4b-4ee0-44ac-b3ec-d1dfa524bbf8\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-bnzrd" Mar 16 16:28:17 crc kubenswrapper[5120]: I0316 16:28:17.825403 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/30cd93ec-58de-4375-a52f-11d5645d7bda-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"30cd93ec-58de-4375-a52f-11d5645d7bda\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:28:17 crc kubenswrapper[5120]: I0316 16:28:17.825429 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4f828b4b-4ee0-44ac-b3ec-d1dfa524bbf8-scripts\") pod \"nova-cell0-cell-mapping-bnzrd\" (UID: \"4f828b4b-4ee0-44ac-b3ec-d1dfa524bbf8\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-bnzrd" Mar 16 16:28:17 crc kubenswrapper[5120]: I0316 16:28:17.825481 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/30cd93ec-58de-4375-a52f-11d5645d7bda-logs\") pod \"nova-api-0\" (UID: \"30cd93ec-58de-4375-a52f-11d5645d7bda\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:28:17 crc kubenswrapper[5120]: I0316 16:28:17.825503 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qlqjw\" (UniqueName: \"kubernetes.io/projected/30cd93ec-58de-4375-a52f-11d5645d7bda-kube-api-access-qlqjw\") pod \"nova-api-0\" (UID: \"30cd93ec-58de-4375-a52f-11d5645d7bda\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:28:17 crc kubenswrapper[5120]: I0316 16:28:17.825628 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8xxnf\" (UniqueName: \"kubernetes.io/projected/4f828b4b-4ee0-44ac-b3ec-d1dfa524bbf8-kube-api-access-8xxnf\") pod \"nova-cell0-cell-mapping-bnzrd\" (UID: \"4f828b4b-4ee0-44ac-b3ec-d1dfa524bbf8\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-bnzrd" Mar 16 16:28:17 crc kubenswrapper[5120]: I0316 16:28:17.834389 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:28:17 crc kubenswrapper[5120]: I0316 16:28:17.837038 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4f828b4b-4ee0-44ac-b3ec-d1dfa524bbf8-config-data\") pod \"nova-cell0-cell-mapping-bnzrd\" (UID: \"4f828b4b-4ee0-44ac-b3ec-d1dfa524bbf8\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-bnzrd" Mar 16 16:28:17 crc kubenswrapper[5120]: I0316 16:28:17.840606 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-novncproxy-config-data\"" Mar 16 16:28:17 crc kubenswrapper[5120]: I0316 16:28:17.846406 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4f828b4b-4ee0-44ac-b3ec-d1dfa524bbf8-combined-ca-bundle\") pod \"nova-cell0-cell-mapping-bnzrd\" (UID: \"4f828b4b-4ee0-44ac-b3ec-d1dfa524bbf8\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-bnzrd" Mar 16 16:28:17 crc kubenswrapper[5120]: I0316 16:28:17.849486 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4f828b4b-4ee0-44ac-b3ec-d1dfa524bbf8-scripts\") pod \"nova-cell0-cell-mapping-bnzrd\" (UID: \"4f828b4b-4ee0-44ac-b3ec-d1dfa524bbf8\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-bnzrd" Mar 16 16:28:17 crc kubenswrapper[5120]: I0316 16:28:17.877803 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:28:17 crc kubenswrapper[5120]: I0316 16:28:17.891272 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xxnf\" (UniqueName: \"kubernetes.io/projected/4f828b4b-4ee0-44ac-b3ec-d1dfa524bbf8-kube-api-access-8xxnf\") pod \"nova-cell0-cell-mapping-bnzrd\" (UID: \"4f828b4b-4ee0-44ac-b3ec-d1dfa524bbf8\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-bnzrd" Mar 16 16:28:17 crc kubenswrapper[5120]: I0316 16:28:17.927715 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a6c25769-b866-4a41-a471-2a397e895990-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"a6c25769-b866-4a41-a471-2a397e895990\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:28:17 crc kubenswrapper[5120]: I0316 16:28:17.927803 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/30cd93ec-58de-4375-a52f-11d5645d7bda-config-data\") pod \"nova-api-0\" (UID: \"30cd93ec-58de-4375-a52f-11d5645d7bda\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:28:17 crc kubenswrapper[5120]: I0316 16:28:17.927905 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/30cd93ec-58de-4375-a52f-11d5645d7bda-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"30cd93ec-58de-4375-a52f-11d5645d7bda\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:28:17 crc kubenswrapper[5120]: I0316 16:28:17.927944 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a6c25769-b866-4a41-a471-2a397e895990-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"a6c25769-b866-4a41-a471-2a397e895990\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:28:17 crc kubenswrapper[5120]: I0316 16:28:17.927977 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/30cd93ec-58de-4375-a52f-11d5645d7bda-logs\") pod \"nova-api-0\" (UID: \"30cd93ec-58de-4375-a52f-11d5645d7bda\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:28:17 crc kubenswrapper[5120]: I0316 16:28:17.928006 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qlqjw\" (UniqueName: \"kubernetes.io/projected/30cd93ec-58de-4375-a52f-11d5645d7bda-kube-api-access-qlqjw\") pod \"nova-api-0\" (UID: \"30cd93ec-58de-4375-a52f-11d5645d7bda\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:28:17 crc kubenswrapper[5120]: I0316 16:28:17.928149 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lc668\" (UniqueName: \"kubernetes.io/projected/a6c25769-b866-4a41-a471-2a397e895990-kube-api-access-lc668\") pod \"nova-cell1-novncproxy-0\" (UID: \"a6c25769-b866-4a41-a471-2a397e895990\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:28:17 crc kubenswrapper[5120]: I0316 16:28:17.937269 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/30cd93ec-58de-4375-a52f-11d5645d7bda-logs\") pod \"nova-api-0\" (UID: \"30cd93ec-58de-4375-a52f-11d5645d7bda\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:28:17 crc kubenswrapper[5120]: I0316 16:28:17.941521 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:28:17 crc kubenswrapper[5120]: I0316 16:28:17.954088 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/30cd93ec-58de-4375-a52f-11d5645d7bda-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"30cd93ec-58de-4375-a52f-11d5645d7bda\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:28:17 crc kubenswrapper[5120]: I0316 16:28:17.962415 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/30cd93ec-58de-4375-a52f-11d5645d7bda-config-data\") pod \"nova-api-0\" (UID: \"30cd93ec-58de-4375-a52f-11d5645d7bda\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:28:17 crc kubenswrapper[5120]: I0316 16:28:17.965851 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qlqjw\" (UniqueName: \"kubernetes.io/projected/30cd93ec-58de-4375-a52f-11d5645d7bda-kube-api-access-qlqjw\") pod \"nova-api-0\" (UID: \"30cd93ec-58de-4375-a52f-11d5645d7bda\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:28:17 crc kubenswrapper[5120]: I0316 16:28:17.972649 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-bnzrd" Mar 16 16:28:17 crc kubenswrapper[5120]: I0316 16:28:17.973046 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:28:17 crc kubenswrapper[5120]: I0316 16:28:17.975934 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-scheduler-config-data\"" Mar 16 16:28:17 crc kubenswrapper[5120]: I0316 16:28:17.987965 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:28:18 crc kubenswrapper[5120]: I0316 16:28:18.017840 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:28:18 crc kubenswrapper[5120]: I0316 16:28:18.025404 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-metadata-config-data\"" Mar 16 16:28:18 crc kubenswrapper[5120]: I0316 16:28:18.031270 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/13e3ea54-b4d8-4995-8ef1-bb45203f4ad8-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"13e3ea54-b4d8-4995-8ef1-bb45203f4ad8\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:28:18 crc kubenswrapper[5120]: I0316 16:28:18.031358 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a6c25769-b866-4a41-a471-2a397e895990-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"a6c25769-b866-4a41-a471-2a397e895990\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:28:18 crc kubenswrapper[5120]: I0316 16:28:18.031450 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/13e3ea54-b4d8-4995-8ef1-bb45203f4ad8-config-data\") pod \"nova-scheduler-0\" (UID: \"13e3ea54-b4d8-4995-8ef1-bb45203f4ad8\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:28:18 crc kubenswrapper[5120]: I0316 16:28:18.031517 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a6c25769-b866-4a41-a471-2a397e895990-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"a6c25769-b866-4a41-a471-2a397e895990\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:28:18 crc kubenswrapper[5120]: I0316 16:28:18.031600 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwldl\" (UniqueName: \"kubernetes.io/projected/13e3ea54-b4d8-4995-8ef1-bb45203f4ad8-kube-api-access-qwldl\") pod \"nova-scheduler-0\" (UID: \"13e3ea54-b4d8-4995-8ef1-bb45203f4ad8\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:28:18 crc kubenswrapper[5120]: I0316 16:28:18.031711 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lc668\" (UniqueName: \"kubernetes.io/projected/a6c25769-b866-4a41-a471-2a397e895990-kube-api-access-lc668\") pod \"nova-cell1-novncproxy-0\" (UID: \"a6c25769-b866-4a41-a471-2a397e895990\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:28:18 crc kubenswrapper[5120]: I0316 16:28:18.033038 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:28:18 crc kubenswrapper[5120]: I0316 16:28:18.072433 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a6c25769-b866-4a41-a471-2a397e895990-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"a6c25769-b866-4a41-a471-2a397e895990\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:28:18 crc kubenswrapper[5120]: I0316 16:28:18.072472 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a6c25769-b866-4a41-a471-2a397e895990-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"a6c25769-b866-4a41-a471-2a397e895990\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:28:18 crc kubenswrapper[5120]: I0316 16:28:18.073589 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lc668\" (UniqueName: \"kubernetes.io/projected/a6c25769-b866-4a41-a471-2a397e895990-kube-api-access-lc668\") pod \"nova-cell1-novncproxy-0\" (UID: \"a6c25769-b866-4a41-a471-2a397e895990\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:28:18 crc kubenswrapper[5120]: I0316 16:28:18.084270 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:28:18 crc kubenswrapper[5120]: I0316 16:28:18.098222 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:28:18 crc kubenswrapper[5120]: I0316 16:28:18.113816 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:28:18 crc kubenswrapper[5120]: I0316 16:28:18.135596 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7cacc96e-084c-4ad7-86ff-e9c12a3fbd9d-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"7cacc96e-084c-4ad7-86ff-e9c12a3fbd9d\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:28:18 crc kubenswrapper[5120]: I0316 16:28:18.135641 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/13e3ea54-b4d8-4995-8ef1-bb45203f4ad8-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"13e3ea54-b4d8-4995-8ef1-bb45203f4ad8\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:28:18 crc kubenswrapper[5120]: I0316 16:28:18.135672 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7cacc96e-084c-4ad7-86ff-e9c12a3fbd9d-logs\") pod \"nova-metadata-0\" (UID: \"7cacc96e-084c-4ad7-86ff-e9c12a3fbd9d\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:28:18 crc kubenswrapper[5120]: I0316 16:28:18.135735 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7cacc96e-084c-4ad7-86ff-e9c12a3fbd9d-config-data\") pod \"nova-metadata-0\" (UID: \"7cacc96e-084c-4ad7-86ff-e9c12a3fbd9d\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:28:18 crc kubenswrapper[5120]: I0316 16:28:18.135800 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9j4rj\" (UniqueName: \"kubernetes.io/projected/7cacc96e-084c-4ad7-86ff-e9c12a3fbd9d-kube-api-access-9j4rj\") pod \"nova-metadata-0\" (UID: \"7cacc96e-084c-4ad7-86ff-e9c12a3fbd9d\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:28:18 crc kubenswrapper[5120]: I0316 16:28:18.135847 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/13e3ea54-b4d8-4995-8ef1-bb45203f4ad8-config-data\") pod \"nova-scheduler-0\" (UID: \"13e3ea54-b4d8-4995-8ef1-bb45203f4ad8\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:28:18 crc kubenswrapper[5120]: I0316 16:28:18.136005 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qwldl\" (UniqueName: \"kubernetes.io/projected/13e3ea54-b4d8-4995-8ef1-bb45203f4ad8-kube-api-access-qwldl\") pod \"nova-scheduler-0\" (UID: \"13e3ea54-b4d8-4995-8ef1-bb45203f4ad8\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:28:18 crc kubenswrapper[5120]: I0316 16:28:18.150300 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/13e3ea54-b4d8-4995-8ef1-bb45203f4ad8-config-data\") pod \"nova-scheduler-0\" (UID: \"13e3ea54-b4d8-4995-8ef1-bb45203f4ad8\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:28:18 crc kubenswrapper[5120]: I0316 16:28:18.154505 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/13e3ea54-b4d8-4995-8ef1-bb45203f4ad8-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"13e3ea54-b4d8-4995-8ef1-bb45203f4ad8\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:28:18 crc kubenswrapper[5120]: I0316 16:28:18.168626 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwldl\" (UniqueName: \"kubernetes.io/projected/13e3ea54-b4d8-4995-8ef1-bb45203f4ad8-kube-api-access-qwldl\") pod \"nova-scheduler-0\" (UID: \"13e3ea54-b4d8-4995-8ef1-bb45203f4ad8\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:28:18 crc kubenswrapper[5120]: I0316 16:28:18.238243 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7cacc96e-084c-4ad7-86ff-e9c12a3fbd9d-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"7cacc96e-084c-4ad7-86ff-e9c12a3fbd9d\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:28:18 crc kubenswrapper[5120]: I0316 16:28:18.238642 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7cacc96e-084c-4ad7-86ff-e9c12a3fbd9d-logs\") pod \"nova-metadata-0\" (UID: \"7cacc96e-084c-4ad7-86ff-e9c12a3fbd9d\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:28:18 crc kubenswrapper[5120]: I0316 16:28:18.238773 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7cacc96e-084c-4ad7-86ff-e9c12a3fbd9d-config-data\") pod \"nova-metadata-0\" (UID: \"7cacc96e-084c-4ad7-86ff-e9c12a3fbd9d\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:28:18 crc kubenswrapper[5120]: I0316 16:28:18.238849 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9j4rj\" (UniqueName: \"kubernetes.io/projected/7cacc96e-084c-4ad7-86ff-e9c12a3fbd9d-kube-api-access-9j4rj\") pod \"nova-metadata-0\" (UID: \"7cacc96e-084c-4ad7-86ff-e9c12a3fbd9d\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:28:18 crc kubenswrapper[5120]: I0316 16:28:18.240085 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7cacc96e-084c-4ad7-86ff-e9c12a3fbd9d-logs\") pod \"nova-metadata-0\" (UID: \"7cacc96e-084c-4ad7-86ff-e9c12a3fbd9d\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:28:18 crc kubenswrapper[5120]: I0316 16:28:18.247439 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7cacc96e-084c-4ad7-86ff-e9c12a3fbd9d-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"7cacc96e-084c-4ad7-86ff-e9c12a3fbd9d\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:28:18 crc kubenswrapper[5120]: I0316 16:28:18.247816 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7cacc96e-084c-4ad7-86ff-e9c12a3fbd9d-config-data\") pod \"nova-metadata-0\" (UID: \"7cacc96e-084c-4ad7-86ff-e9c12a3fbd9d\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:28:18 crc kubenswrapper[5120]: I0316 16:28:18.264162 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9j4rj\" (UniqueName: \"kubernetes.io/projected/7cacc96e-084c-4ad7-86ff-e9c12a3fbd9d-kube-api-access-9j4rj\") pod \"nova-metadata-0\" (UID: \"7cacc96e-084c-4ad7-86ff-e9c12a3fbd9d\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:28:18 crc kubenswrapper[5120]: I0316 16:28:18.419419 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:28:18 crc kubenswrapper[5120]: I0316 16:28:18.433146 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:28:18 crc kubenswrapper[5120]: I0316 16:28:18.532645 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:28:18 crc kubenswrapper[5120]: I0316 16:28:18.533114 5120 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Mar 16 16:28:18 crc kubenswrapper[5120]: I0316 16:28:18.584150 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-bnzrd"] Mar 16 16:28:18 crc kubenswrapper[5120]: I0316 16:28:18.602972 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:28:18 crc kubenswrapper[5120]: W0316 16:28:18.636306 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4f828b4b_4ee0_44ac_b3ec_d1dfa524bbf8.slice/crio-70a180ac2256b4ba5dd8f00c578a0bec6dd38f998cf608a1ea5f35c3ecf406fb WatchSource:0}: Error finding container 70a180ac2256b4ba5dd8f00c578a0bec6dd38f998cf608a1ea5f35c3ecf406fb: Status 404 returned error can't find the container with id 70a180ac2256b4ba5dd8f00c578a0bec6dd38f998cf608a1ea5f35c3ecf406fb Mar 16 16:28:18 crc kubenswrapper[5120]: I0316 16:28:18.807604 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:28:18 crc kubenswrapper[5120]: W0316 16:28:18.827144 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod30cd93ec_58de_4375_a52f_11d5645d7bda.slice/crio-52b59be0011ddbc236e111201496df060ee60d0740bb3c4e83784861dc146888 WatchSource:0}: Error finding container 52b59be0011ddbc236e111201496df060ee60d0740bb3c4e83784861dc146888: Status 404 returned error can't find the container with id 52b59be0011ddbc236e111201496df060ee60d0740bb3c4e83784861dc146888 Mar 16 16:28:18 crc kubenswrapper[5120]: I0316 16:28:18.835090 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:28:18 crc kubenswrapper[5120]: I0316 16:28:18.926103 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-bnzrd" event={"ID":"4f828b4b-4ee0-44ac-b3ec-d1dfa524bbf8","Type":"ContainerStarted","Data":"70a180ac2256b4ba5dd8f00c578a0bec6dd38f998cf608a1ea5f35c3ecf406fb"} Mar 16 16:28:18 crc kubenswrapper[5120]: I0316 16:28:18.937028 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"a6c25769-b866-4a41-a471-2a397e895990","Type":"ContainerStarted","Data":"7506817b2d2ccd204fd476fa94212e33588b9508f886c8e1b72cc0b2c40473c0"} Mar 16 16:28:18 crc kubenswrapper[5120]: I0316 16:28:18.942655 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"30cd93ec-58de-4375-a52f-11d5645d7bda","Type":"ContainerStarted","Data":"52b59be0011ddbc236e111201496df060ee60d0740bb3c4e83784861dc146888"} Mar 16 16:28:19 crc kubenswrapper[5120]: I0316 16:28:19.138386 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:28:19 crc kubenswrapper[5120]: I0316 16:28:19.160229 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:28:19 crc kubenswrapper[5120]: I0316 16:28:19.226054 5120 scope.go:117] "RemoveContainer" containerID="3417c193984ba713d34def8ce1de683131800f1681b1d919c6fc463fb90a4ce1" Mar 16 16:28:19 crc kubenswrapper[5120]: W0316 16:28:19.249387 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7cacc96e_084c_4ad7_86ff_e9c12a3fbd9d.slice/crio-11525ae9f1598a4a77873fca912403f89ed1779e4367ee102c6b028da919d1a7 WatchSource:0}: Error finding container 11525ae9f1598a4a77873fca912403f89ed1779e4367ee102c6b028da919d1a7: Status 404 returned error can't find the container with id 11525ae9f1598a4a77873fca912403f89ed1779e4367ee102c6b028da919d1a7 Mar 16 16:28:19 crc kubenswrapper[5120]: I0316 16:28:19.311322 5120 scope.go:117] "RemoveContainer" containerID="419f3cb8227efffe4cc292792953134a291a4774e5e6894af2479686f7fa97c8" Mar 16 16:28:19 crc kubenswrapper[5120]: I0316 16:28:19.389603 5120 scope.go:117] "RemoveContainer" containerID="581650431b98ec2c16d7a6badc54a9a72e12d063f9f18749b4c73247e67cb6bf" Mar 16 16:28:19 crc kubenswrapper[5120]: I0316 16:28:19.417074 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-42r2f"] Mar 16 16:28:19 crc kubenswrapper[5120]: I0316 16:28:19.425336 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-42r2f" Mar 16 16:28:19 crc kubenswrapper[5120]: I0316 16:28:19.427958 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-42r2f"] Mar 16 16:28:19 crc kubenswrapper[5120]: I0316 16:28:19.437284 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-conductor-scripts\"" Mar 16 16:28:19 crc kubenswrapper[5120]: I0316 16:28:19.440910 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-conductor-config-data\"" Mar 16 16:28:19 crc kubenswrapper[5120]: I0316 16:28:19.501977 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2zt4z\" (UniqueName: \"kubernetes.io/projected/5756d219-d2ba-42b8-a02d-c0681c069fca-kube-api-access-2zt4z\") pod \"nova-cell1-conductor-db-sync-42r2f\" (UID: \"5756d219-d2ba-42b8-a02d-c0681c069fca\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-42r2f" Mar 16 16:28:19 crc kubenswrapper[5120]: I0316 16:28:19.502393 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5756d219-d2ba-42b8-a02d-c0681c069fca-scripts\") pod \"nova-cell1-conductor-db-sync-42r2f\" (UID: \"5756d219-d2ba-42b8-a02d-c0681c069fca\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-42r2f" Mar 16 16:28:19 crc kubenswrapper[5120]: I0316 16:28:19.502912 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5756d219-d2ba-42b8-a02d-c0681c069fca-config-data\") pod \"nova-cell1-conductor-db-sync-42r2f\" (UID: \"5756d219-d2ba-42b8-a02d-c0681c069fca\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-42r2f" Mar 16 16:28:19 crc kubenswrapper[5120]: I0316 16:28:19.502962 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5756d219-d2ba-42b8-a02d-c0681c069fca-combined-ca-bundle\") pod \"nova-cell1-conductor-db-sync-42r2f\" (UID: \"5756d219-d2ba-42b8-a02d-c0681c069fca\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-42r2f" Mar 16 16:28:19 crc kubenswrapper[5120]: I0316 16:28:19.520933 5120 scope.go:117] "RemoveContainer" containerID="7dbb4c76fd47c6ef778b602b465cb11ea5f6da01510471c691a4a9f58e578102" Mar 16 16:28:19 crc kubenswrapper[5120]: I0316 16:28:19.605170 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5756d219-d2ba-42b8-a02d-c0681c069fca-scripts\") pod \"nova-cell1-conductor-db-sync-42r2f\" (UID: \"5756d219-d2ba-42b8-a02d-c0681c069fca\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-42r2f" Mar 16 16:28:19 crc kubenswrapper[5120]: I0316 16:28:19.605350 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5756d219-d2ba-42b8-a02d-c0681c069fca-config-data\") pod \"nova-cell1-conductor-db-sync-42r2f\" (UID: \"5756d219-d2ba-42b8-a02d-c0681c069fca\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-42r2f" Mar 16 16:28:19 crc kubenswrapper[5120]: I0316 16:28:19.605382 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5756d219-d2ba-42b8-a02d-c0681c069fca-combined-ca-bundle\") pod \"nova-cell1-conductor-db-sync-42r2f\" (UID: \"5756d219-d2ba-42b8-a02d-c0681c069fca\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-42r2f" Mar 16 16:28:19 crc kubenswrapper[5120]: I0316 16:28:19.605488 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2zt4z\" (UniqueName: \"kubernetes.io/projected/5756d219-d2ba-42b8-a02d-c0681c069fca-kube-api-access-2zt4z\") pod \"nova-cell1-conductor-db-sync-42r2f\" (UID: \"5756d219-d2ba-42b8-a02d-c0681c069fca\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-42r2f" Mar 16 16:28:19 crc kubenswrapper[5120]: I0316 16:28:19.612539 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5756d219-d2ba-42b8-a02d-c0681c069fca-scripts\") pod \"nova-cell1-conductor-db-sync-42r2f\" (UID: \"5756d219-d2ba-42b8-a02d-c0681c069fca\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-42r2f" Mar 16 16:28:19 crc kubenswrapper[5120]: I0316 16:28:19.615684 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5756d219-d2ba-42b8-a02d-c0681c069fca-combined-ca-bundle\") pod \"nova-cell1-conductor-db-sync-42r2f\" (UID: \"5756d219-d2ba-42b8-a02d-c0681c069fca\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-42r2f" Mar 16 16:28:19 crc kubenswrapper[5120]: I0316 16:28:19.626691 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2zt4z\" (UniqueName: \"kubernetes.io/projected/5756d219-d2ba-42b8-a02d-c0681c069fca-kube-api-access-2zt4z\") pod \"nova-cell1-conductor-db-sync-42r2f\" (UID: \"5756d219-d2ba-42b8-a02d-c0681c069fca\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-42r2f" Mar 16 16:28:19 crc kubenswrapper[5120]: I0316 16:28:19.626941 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5756d219-d2ba-42b8-a02d-c0681c069fca-config-data\") pod \"nova-cell1-conductor-db-sync-42r2f\" (UID: \"5756d219-d2ba-42b8-a02d-c0681c069fca\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-42r2f" Mar 16 16:28:19 crc kubenswrapper[5120]: I0316 16:28:19.769312 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-42r2f" Mar 16 16:28:19 crc kubenswrapper[5120]: I0316 16:28:19.979281 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"7cacc96e-084c-4ad7-86ff-e9c12a3fbd9d","Type":"ContainerStarted","Data":"bb1d430da5e8ad76c8f4bac707d76c5ade8850bee456d0faefb47b0a6fb6f42b"} Mar 16 16:28:19 crc kubenswrapper[5120]: I0316 16:28:19.979598 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"7cacc96e-084c-4ad7-86ff-e9c12a3fbd9d","Type":"ContainerStarted","Data":"11525ae9f1598a4a77873fca912403f89ed1779e4367ee102c6b028da919d1a7"} Mar 16 16:28:19 crc kubenswrapper[5120]: I0316 16:28:19.982160 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"30cd93ec-58de-4375-a52f-11d5645d7bda","Type":"ContainerStarted","Data":"8d9cd1279b634c9b060a2e1fa51344ef3a830ff1f84546f47e7e5d72cc24bcf1"} Mar 16 16:28:19 crc kubenswrapper[5120]: I0316 16:28:19.982182 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"30cd93ec-58de-4375-a52f-11d5645d7bda","Type":"ContainerStarted","Data":"b9e4dfd5e0f24798d200a27ea95502c61c12849b241b0f2beb941ec30d8ea251"} Mar 16 16:28:19 crc kubenswrapper[5120]: I0316 16:28:19.986435 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"13e3ea54-b4d8-4995-8ef1-bb45203f4ad8","Type":"ContainerStarted","Data":"1ba0b27cac3772b9d043f22faf3b845ee8338b9644dd4435cc691903878e8b8b"} Mar 16 16:28:19 crc kubenswrapper[5120]: I0316 16:28:19.986476 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"13e3ea54-b4d8-4995-8ef1-bb45203f4ad8","Type":"ContainerStarted","Data":"ddca7bfcf74ddd940706c0f90e95b01b958c196dfbfb0631f40a6c61780221f8"} Mar 16 16:28:19 crc kubenswrapper[5120]: I0316 16:28:19.999599 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-bnzrd" event={"ID":"4f828b4b-4ee0-44ac-b3ec-d1dfa524bbf8","Type":"ContainerStarted","Data":"59f322a3d7236277d6645148c7840ef488c15805a0793f6d2d317c8f8f20ebcc"} Mar 16 16:28:20 crc kubenswrapper[5120]: I0316 16:28:20.006902 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"a6c25769-b866-4a41-a471-2a397e895990","Type":"ContainerStarted","Data":"da00e81daeecf12a8e0392eebd750a6fc413b64acadc45c12ab5750598d1bbc4"} Mar 16 16:28:20 crc kubenswrapper[5120]: I0316 16:28:20.016366 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=3.016345499 podStartE2EDuration="3.016345499s" podCreationTimestamp="2026-03-16 16:28:17 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:28:20.000504735 +0000 UTC m=+3402.154436402" watchObservedRunningTime="2026-03-16 16:28:20.016345499 +0000 UTC m=+3402.170277156" Mar 16 16:28:20 crc kubenswrapper[5120]: I0316 16:28:20.029001 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-bnzrd" podStartSLOduration=3.028983677 podStartE2EDuration="3.028983677s" podCreationTimestamp="2026-03-16 16:28:17 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:28:20.019312568 +0000 UTC m=+3402.173244225" watchObservedRunningTime="2026-03-16 16:28:20.028983677 +0000 UTC m=+3402.182915334" Mar 16 16:28:20 crc kubenswrapper[5120]: I0316 16:28:20.052237 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-scheduler-0" podStartSLOduration=3.052219259 podStartE2EDuration="3.052219259s" podCreationTimestamp="2026-03-16 16:28:17 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:28:20.039734905 +0000 UTC m=+3402.193666562" watchObservedRunningTime="2026-03-16 16:28:20.052219259 +0000 UTC m=+3402.206150916" Mar 16 16:28:20 crc kubenswrapper[5120]: I0316 16:28:20.067443 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podStartSLOduration=3.067425446 podStartE2EDuration="3.067425446s" podCreationTimestamp="2026-03-16 16:28:17 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:28:20.067145237 +0000 UTC m=+3402.221076894" watchObservedRunningTime="2026-03-16 16:28:20.067425446 +0000 UTC m=+3402.221357103" Mar 16 16:28:20 crc kubenswrapper[5120]: I0316 16:28:20.419585 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-42r2f"] Mar 16 16:28:20 crc kubenswrapper[5120]: I0316 16:28:20.693236 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:28:20 crc kubenswrapper[5120]: I0316 16:28:20.751224 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/13e7a600-c09b-48ba-a299-3d1f7f3e9074-scripts\") pod \"13e7a600-c09b-48ba-a299-3d1f7f3e9074\" (UID: \"13e7a600-c09b-48ba-a299-3d1f7f3e9074\") " Mar 16 16:28:20 crc kubenswrapper[5120]: I0316 16:28:20.751432 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/13e7a600-c09b-48ba-a299-3d1f7f3e9074-combined-ca-bundle\") pod \"13e7a600-c09b-48ba-a299-3d1f7f3e9074\" (UID: \"13e7a600-c09b-48ba-a299-3d1f7f3e9074\") " Mar 16 16:28:20 crc kubenswrapper[5120]: I0316 16:28:20.751467 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/13e7a600-c09b-48ba-a299-3d1f7f3e9074-config-data\") pod \"13e7a600-c09b-48ba-a299-3d1f7f3e9074\" (UID: \"13e7a600-c09b-48ba-a299-3d1f7f3e9074\") " Mar 16 16:28:20 crc kubenswrapper[5120]: I0316 16:28:20.751641 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s8pg9\" (UniqueName: \"kubernetes.io/projected/13e7a600-c09b-48ba-a299-3d1f7f3e9074-kube-api-access-s8pg9\") pod \"13e7a600-c09b-48ba-a299-3d1f7f3e9074\" (UID: \"13e7a600-c09b-48ba-a299-3d1f7f3e9074\") " Mar 16 16:28:20 crc kubenswrapper[5120]: I0316 16:28:20.751730 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/13e7a600-c09b-48ba-a299-3d1f7f3e9074-run-httpd\") pod \"13e7a600-c09b-48ba-a299-3d1f7f3e9074\" (UID: \"13e7a600-c09b-48ba-a299-3d1f7f3e9074\") " Mar 16 16:28:20 crc kubenswrapper[5120]: I0316 16:28:20.751746 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/13e7a600-c09b-48ba-a299-3d1f7f3e9074-log-httpd\") pod \"13e7a600-c09b-48ba-a299-3d1f7f3e9074\" (UID: \"13e7a600-c09b-48ba-a299-3d1f7f3e9074\") " Mar 16 16:28:20 crc kubenswrapper[5120]: I0316 16:28:20.751877 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/13e7a600-c09b-48ba-a299-3d1f7f3e9074-sg-core-conf-yaml\") pod \"13e7a600-c09b-48ba-a299-3d1f7f3e9074\" (UID: \"13e7a600-c09b-48ba-a299-3d1f7f3e9074\") " Mar 16 16:28:20 crc kubenswrapper[5120]: I0316 16:28:20.752059 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13e7a600-c09b-48ba-a299-3d1f7f3e9074-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "13e7a600-c09b-48ba-a299-3d1f7f3e9074" (UID: "13e7a600-c09b-48ba-a299-3d1f7f3e9074"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:28:20 crc kubenswrapper[5120]: I0316 16:28:20.752299 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13e7a600-c09b-48ba-a299-3d1f7f3e9074-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "13e7a600-c09b-48ba-a299-3d1f7f3e9074" (UID: "13e7a600-c09b-48ba-a299-3d1f7f3e9074"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:28:20 crc kubenswrapper[5120]: I0316 16:28:20.752832 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/13e7a600-c09b-48ba-a299-3d1f7f3e9074-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:28:20 crc kubenswrapper[5120]: I0316 16:28:20.752845 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/13e7a600-c09b-48ba-a299-3d1f7f3e9074-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:28:20 crc kubenswrapper[5120]: I0316 16:28:20.757249 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13e7a600-c09b-48ba-a299-3d1f7f3e9074-kube-api-access-s8pg9" (OuterVolumeSpecName: "kube-api-access-s8pg9") pod "13e7a600-c09b-48ba-a299-3d1f7f3e9074" (UID: "13e7a600-c09b-48ba-a299-3d1f7f3e9074"). InnerVolumeSpecName "kube-api-access-s8pg9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:28:20 crc kubenswrapper[5120]: I0316 16:28:20.762620 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/13e7a600-c09b-48ba-a299-3d1f7f3e9074-scripts" (OuterVolumeSpecName: "scripts") pod "13e7a600-c09b-48ba-a299-3d1f7f3e9074" (UID: "13e7a600-c09b-48ba-a299-3d1f7f3e9074"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:28:20 crc kubenswrapper[5120]: I0316 16:28:20.787556 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/13e7a600-c09b-48ba-a299-3d1f7f3e9074-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "13e7a600-c09b-48ba-a299-3d1f7f3e9074" (UID: "13e7a600-c09b-48ba-a299-3d1f7f3e9074"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:28:20 crc kubenswrapper[5120]: I0316 16:28:20.826730 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/13e7a600-c09b-48ba-a299-3d1f7f3e9074-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "13e7a600-c09b-48ba-a299-3d1f7f3e9074" (UID: "13e7a600-c09b-48ba-a299-3d1f7f3e9074"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:28:20 crc kubenswrapper[5120]: I0316 16:28:20.854722 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/13e7a600-c09b-48ba-a299-3d1f7f3e9074-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:28:20 crc kubenswrapper[5120]: I0316 16:28:20.854765 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/13e7a600-c09b-48ba-a299-3d1f7f3e9074-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:28:20 crc kubenswrapper[5120]: I0316 16:28:20.854777 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s8pg9\" (UniqueName: \"kubernetes.io/projected/13e7a600-c09b-48ba-a299-3d1f7f3e9074-kube-api-access-s8pg9\") on node \"crc\" DevicePath \"\"" Mar 16 16:28:20 crc kubenswrapper[5120]: I0316 16:28:20.854789 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/13e7a600-c09b-48ba-a299-3d1f7f3e9074-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 16:28:20 crc kubenswrapper[5120]: I0316 16:28:20.879752 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/13e7a600-c09b-48ba-a299-3d1f7f3e9074-config-data" (OuterVolumeSpecName: "config-data") pod "13e7a600-c09b-48ba-a299-3d1f7f3e9074" (UID: "13e7a600-c09b-48ba-a299-3d1f7f3e9074"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:28:20 crc kubenswrapper[5120]: I0316 16:28:20.957839 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/13e7a600-c09b-48ba-a299-3d1f7f3e9074-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:28:21 crc kubenswrapper[5120]: I0316 16:28:21.018944 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"7cacc96e-084c-4ad7-86ff-e9c12a3fbd9d","Type":"ContainerStarted","Data":"23488bacb84c42476a95f8b062cf29961f9395521f8b327dd8fc03a907f77f8e"} Mar 16 16:28:21 crc kubenswrapper[5120]: I0316 16:28:21.021928 5120 generic.go:358] "Generic (PLEG): container finished" podID="13e7a600-c09b-48ba-a299-3d1f7f3e9074" containerID="74aabc4f4f060ddf70dac61b4d84a24df543c2c0b90c0e2d2cec11a0fff2564d" exitCode=0 Mar 16 16:28:21 crc kubenswrapper[5120]: I0316 16:28:21.021974 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"13e7a600-c09b-48ba-a299-3d1f7f3e9074","Type":"ContainerDied","Data":"74aabc4f4f060ddf70dac61b4d84a24df543c2c0b90c0e2d2cec11a0fff2564d"} Mar 16 16:28:21 crc kubenswrapper[5120]: I0316 16:28:21.022031 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"13e7a600-c09b-48ba-a299-3d1f7f3e9074","Type":"ContainerDied","Data":"c4a7de21015d5e3d268379c3e055d7abdf5f1c3d38df6461352f0f87febfd0ba"} Mar 16 16:28:21 crc kubenswrapper[5120]: I0316 16:28:21.022053 5120 scope.go:117] "RemoveContainer" containerID="52fcd04c31e66c2c41217d577964355f3ecd847c5758d75f4a6feac936487ac8" Mar 16 16:28:21 crc kubenswrapper[5120]: I0316 16:28:21.022063 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:28:21 crc kubenswrapper[5120]: I0316 16:28:21.024831 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-42r2f" event={"ID":"5756d219-d2ba-42b8-a02d-c0681c069fca","Type":"ContainerStarted","Data":"93108a3a5b17fa5c9d5dbb5f8b46764d9de5f49f992564654c8edef477a51664"} Mar 16 16:28:21 crc kubenswrapper[5120]: I0316 16:28:21.024906 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-42r2f" event={"ID":"5756d219-d2ba-42b8-a02d-c0681c069fca","Type":"ContainerStarted","Data":"a507d35e16a6c6da8383a4d07fe0651c5d26d7cc68d3a10c9644f671a04be44b"} Mar 16 16:28:21 crc kubenswrapper[5120]: I0316 16:28:21.045570 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=4.045548457 podStartE2EDuration="4.045548457s" podCreationTimestamp="2026-03-16 16:28:17 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:28:21.033406562 +0000 UTC m=+3403.187338219" watchObservedRunningTime="2026-03-16 16:28:21.045548457 +0000 UTC m=+3403.199480114" Mar 16 16:28:21 crc kubenswrapper[5120]: I0316 16:28:21.063003 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-42r2f" podStartSLOduration=2.062983814 podStartE2EDuration="2.062983814s" podCreationTimestamp="2026-03-16 16:28:19 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:28:21.051867576 +0000 UTC m=+3403.205799233" watchObservedRunningTime="2026-03-16 16:28:21.062983814 +0000 UTC m=+3403.216915471" Mar 16 16:28:21 crc kubenswrapper[5120]: I0316 16:28:21.084427 5120 scope.go:117] "RemoveContainer" containerID="879d00e923d6a48e036c9c528f536f5e6c5644835d8fdd1c12dcef95ad1a8408" Mar 16 16:28:21 crc kubenswrapper[5120]: I0316 16:28:21.086172 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:28:21 crc kubenswrapper[5120]: I0316 16:28:21.113747 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:28:21 crc kubenswrapper[5120]: I0316 16:28:21.148626 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:28:21 crc kubenswrapper[5120]: I0316 16:28:21.151438 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13e7a600-c09b-48ba-a299-3d1f7f3e9074" containerName="proxy-httpd" Mar 16 16:28:21 crc kubenswrapper[5120]: I0316 16:28:21.151461 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="13e7a600-c09b-48ba-a299-3d1f7f3e9074" containerName="proxy-httpd" Mar 16 16:28:21 crc kubenswrapper[5120]: I0316 16:28:21.151491 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13e7a600-c09b-48ba-a299-3d1f7f3e9074" containerName="ceilometer-central-agent" Mar 16 16:28:21 crc kubenswrapper[5120]: I0316 16:28:21.151499 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="13e7a600-c09b-48ba-a299-3d1f7f3e9074" containerName="ceilometer-central-agent" Mar 16 16:28:21 crc kubenswrapper[5120]: I0316 16:28:21.151520 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13e7a600-c09b-48ba-a299-3d1f7f3e9074" containerName="ceilometer-notification-agent" Mar 16 16:28:21 crc kubenswrapper[5120]: I0316 16:28:21.151526 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="13e7a600-c09b-48ba-a299-3d1f7f3e9074" containerName="ceilometer-notification-agent" Mar 16 16:28:21 crc kubenswrapper[5120]: I0316 16:28:21.151544 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13e7a600-c09b-48ba-a299-3d1f7f3e9074" containerName="sg-core" Mar 16 16:28:21 crc kubenswrapper[5120]: I0316 16:28:21.151549 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="13e7a600-c09b-48ba-a299-3d1f7f3e9074" containerName="sg-core" Mar 16 16:28:21 crc kubenswrapper[5120]: I0316 16:28:21.151777 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="13e7a600-c09b-48ba-a299-3d1f7f3e9074" containerName="ceilometer-notification-agent" Mar 16 16:28:21 crc kubenswrapper[5120]: I0316 16:28:21.151797 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="13e7a600-c09b-48ba-a299-3d1f7f3e9074" containerName="ceilometer-central-agent" Mar 16 16:28:21 crc kubenswrapper[5120]: I0316 16:28:21.151808 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="13e7a600-c09b-48ba-a299-3d1f7f3e9074" containerName="sg-core" Mar 16 16:28:21 crc kubenswrapper[5120]: I0316 16:28:21.151818 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="13e7a600-c09b-48ba-a299-3d1f7f3e9074" containerName="proxy-httpd" Mar 16 16:28:21 crc kubenswrapper[5120]: I0316 16:28:21.155904 5120 scope.go:117] "RemoveContainer" containerID="159f3cb833b068248017b9c03056f264033cf6dfa89e905e79aa4ccb261c08f5" Mar 16 16:28:21 crc kubenswrapper[5120]: I0316 16:28:21.163745 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:28:21 crc kubenswrapper[5120]: I0316 16:28:21.163875 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:28:21 crc kubenswrapper[5120]: I0316 16:28:21.175404 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 16:28:21 crc kubenswrapper[5120]: I0316 16:28:21.175666 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 16:28:21 crc kubenswrapper[5120]: I0316 16:28:21.224909 5120 scope.go:117] "RemoveContainer" containerID="74aabc4f4f060ddf70dac61b4d84a24df543c2c0b90c0e2d2cec11a0fff2564d" Mar 16 16:28:21 crc kubenswrapper[5120]: I0316 16:28:21.253649 5120 scope.go:117] "RemoveContainer" containerID="52fcd04c31e66c2c41217d577964355f3ecd847c5758d75f4a6feac936487ac8" Mar 16 16:28:21 crc kubenswrapper[5120]: E0316 16:28:21.254695 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"52fcd04c31e66c2c41217d577964355f3ecd847c5758d75f4a6feac936487ac8\": container with ID starting with 52fcd04c31e66c2c41217d577964355f3ecd847c5758d75f4a6feac936487ac8 not found: ID does not exist" containerID="52fcd04c31e66c2c41217d577964355f3ecd847c5758d75f4a6feac936487ac8" Mar 16 16:28:21 crc kubenswrapper[5120]: I0316 16:28:21.254774 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52fcd04c31e66c2c41217d577964355f3ecd847c5758d75f4a6feac936487ac8"} err="failed to get container status \"52fcd04c31e66c2c41217d577964355f3ecd847c5758d75f4a6feac936487ac8\": rpc error: code = NotFound desc = could not find container \"52fcd04c31e66c2c41217d577964355f3ecd847c5758d75f4a6feac936487ac8\": container with ID starting with 52fcd04c31e66c2c41217d577964355f3ecd847c5758d75f4a6feac936487ac8 not found: ID does not exist" Mar 16 16:28:21 crc kubenswrapper[5120]: I0316 16:28:21.254797 5120 scope.go:117] "RemoveContainer" containerID="879d00e923d6a48e036c9c528f536f5e6c5644835d8fdd1c12dcef95ad1a8408" Mar 16 16:28:21 crc kubenswrapper[5120]: E0316 16:28:21.255211 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"879d00e923d6a48e036c9c528f536f5e6c5644835d8fdd1c12dcef95ad1a8408\": container with ID starting with 879d00e923d6a48e036c9c528f536f5e6c5644835d8fdd1c12dcef95ad1a8408 not found: ID does not exist" containerID="879d00e923d6a48e036c9c528f536f5e6c5644835d8fdd1c12dcef95ad1a8408" Mar 16 16:28:21 crc kubenswrapper[5120]: I0316 16:28:21.255255 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"879d00e923d6a48e036c9c528f536f5e6c5644835d8fdd1c12dcef95ad1a8408"} err="failed to get container status \"879d00e923d6a48e036c9c528f536f5e6c5644835d8fdd1c12dcef95ad1a8408\": rpc error: code = NotFound desc = could not find container \"879d00e923d6a48e036c9c528f536f5e6c5644835d8fdd1c12dcef95ad1a8408\": container with ID starting with 879d00e923d6a48e036c9c528f536f5e6c5644835d8fdd1c12dcef95ad1a8408 not found: ID does not exist" Mar 16 16:28:21 crc kubenswrapper[5120]: I0316 16:28:21.255267 5120 scope.go:117] "RemoveContainer" containerID="159f3cb833b068248017b9c03056f264033cf6dfa89e905e79aa4ccb261c08f5" Mar 16 16:28:21 crc kubenswrapper[5120]: E0316 16:28:21.255577 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"159f3cb833b068248017b9c03056f264033cf6dfa89e905e79aa4ccb261c08f5\": container with ID starting with 159f3cb833b068248017b9c03056f264033cf6dfa89e905e79aa4ccb261c08f5 not found: ID does not exist" containerID="159f3cb833b068248017b9c03056f264033cf6dfa89e905e79aa4ccb261c08f5" Mar 16 16:28:21 crc kubenswrapper[5120]: I0316 16:28:21.255597 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"159f3cb833b068248017b9c03056f264033cf6dfa89e905e79aa4ccb261c08f5"} err="failed to get container status \"159f3cb833b068248017b9c03056f264033cf6dfa89e905e79aa4ccb261c08f5\": rpc error: code = NotFound desc = could not find container \"159f3cb833b068248017b9c03056f264033cf6dfa89e905e79aa4ccb261c08f5\": container with ID starting with 159f3cb833b068248017b9c03056f264033cf6dfa89e905e79aa4ccb261c08f5 not found: ID does not exist" Mar 16 16:28:21 crc kubenswrapper[5120]: I0316 16:28:21.255610 5120 scope.go:117] "RemoveContainer" containerID="74aabc4f4f060ddf70dac61b4d84a24df543c2c0b90c0e2d2cec11a0fff2564d" Mar 16 16:28:21 crc kubenswrapper[5120]: E0316 16:28:21.255888 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"74aabc4f4f060ddf70dac61b4d84a24df543c2c0b90c0e2d2cec11a0fff2564d\": container with ID starting with 74aabc4f4f060ddf70dac61b4d84a24df543c2c0b90c0e2d2cec11a0fff2564d not found: ID does not exist" containerID="74aabc4f4f060ddf70dac61b4d84a24df543c2c0b90c0e2d2cec11a0fff2564d" Mar 16 16:28:21 crc kubenswrapper[5120]: I0316 16:28:21.255907 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74aabc4f4f060ddf70dac61b4d84a24df543c2c0b90c0e2d2cec11a0fff2564d"} err="failed to get container status \"74aabc4f4f060ddf70dac61b4d84a24df543c2c0b90c0e2d2cec11a0fff2564d\": rpc error: code = NotFound desc = could not find container \"74aabc4f4f060ddf70dac61b4d84a24df543c2c0b90c0e2d2cec11a0fff2564d\": container with ID starting with 74aabc4f4f060ddf70dac61b4d84a24df543c2c0b90c0e2d2cec11a0fff2564d not found: ID does not exist" Mar 16 16:28:21 crc kubenswrapper[5120]: I0316 16:28:21.264077 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9d0063b1-d074-4b22-a417-5ee37106b806-scripts\") pod \"ceilometer-0\" (UID: \"9d0063b1-d074-4b22-a417-5ee37106b806\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:28:21 crc kubenswrapper[5120]: I0316 16:28:21.264215 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/9d0063b1-d074-4b22-a417-5ee37106b806-log-httpd\") pod \"ceilometer-0\" (UID: \"9d0063b1-d074-4b22-a417-5ee37106b806\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:28:21 crc kubenswrapper[5120]: I0316 16:28:21.264312 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnt9b\" (UniqueName: \"kubernetes.io/projected/9d0063b1-d074-4b22-a417-5ee37106b806-kube-api-access-cnt9b\") pod \"ceilometer-0\" (UID: \"9d0063b1-d074-4b22-a417-5ee37106b806\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:28:21 crc kubenswrapper[5120]: I0316 16:28:21.264413 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/9d0063b1-d074-4b22-a417-5ee37106b806-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"9d0063b1-d074-4b22-a417-5ee37106b806\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:28:21 crc kubenswrapper[5120]: I0316 16:28:21.264437 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/9d0063b1-d074-4b22-a417-5ee37106b806-run-httpd\") pod \"ceilometer-0\" (UID: \"9d0063b1-d074-4b22-a417-5ee37106b806\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:28:21 crc kubenswrapper[5120]: I0316 16:28:21.264457 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9d0063b1-d074-4b22-a417-5ee37106b806-config-data\") pod \"ceilometer-0\" (UID: \"9d0063b1-d074-4b22-a417-5ee37106b806\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:28:21 crc kubenswrapper[5120]: I0316 16:28:21.264502 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9d0063b1-d074-4b22-a417-5ee37106b806-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"9d0063b1-d074-4b22-a417-5ee37106b806\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:28:21 crc kubenswrapper[5120]: I0316 16:28:21.368081 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/9d0063b1-d074-4b22-a417-5ee37106b806-log-httpd\") pod \"ceilometer-0\" (UID: \"9d0063b1-d074-4b22-a417-5ee37106b806\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:28:21 crc kubenswrapper[5120]: I0316 16:28:21.368235 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cnt9b\" (UniqueName: \"kubernetes.io/projected/9d0063b1-d074-4b22-a417-5ee37106b806-kube-api-access-cnt9b\") pod \"ceilometer-0\" (UID: \"9d0063b1-d074-4b22-a417-5ee37106b806\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:28:21 crc kubenswrapper[5120]: I0316 16:28:21.368389 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/9d0063b1-d074-4b22-a417-5ee37106b806-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"9d0063b1-d074-4b22-a417-5ee37106b806\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:28:21 crc kubenswrapper[5120]: I0316 16:28:21.368411 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/9d0063b1-d074-4b22-a417-5ee37106b806-run-httpd\") pod \"ceilometer-0\" (UID: \"9d0063b1-d074-4b22-a417-5ee37106b806\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:28:21 crc kubenswrapper[5120]: I0316 16:28:21.368441 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9d0063b1-d074-4b22-a417-5ee37106b806-config-data\") pod \"ceilometer-0\" (UID: \"9d0063b1-d074-4b22-a417-5ee37106b806\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:28:21 crc kubenswrapper[5120]: I0316 16:28:21.368511 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9d0063b1-d074-4b22-a417-5ee37106b806-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"9d0063b1-d074-4b22-a417-5ee37106b806\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:28:21 crc kubenswrapper[5120]: I0316 16:28:21.368582 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/9d0063b1-d074-4b22-a417-5ee37106b806-log-httpd\") pod \"ceilometer-0\" (UID: \"9d0063b1-d074-4b22-a417-5ee37106b806\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:28:21 crc kubenswrapper[5120]: I0316 16:28:21.368588 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9d0063b1-d074-4b22-a417-5ee37106b806-scripts\") pod \"ceilometer-0\" (UID: \"9d0063b1-d074-4b22-a417-5ee37106b806\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:28:21 crc kubenswrapper[5120]: I0316 16:28:21.368854 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/9d0063b1-d074-4b22-a417-5ee37106b806-run-httpd\") pod \"ceilometer-0\" (UID: \"9d0063b1-d074-4b22-a417-5ee37106b806\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:28:21 crc kubenswrapper[5120]: I0316 16:28:21.378364 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/9d0063b1-d074-4b22-a417-5ee37106b806-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"9d0063b1-d074-4b22-a417-5ee37106b806\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:28:21 crc kubenswrapper[5120]: I0316 16:28:21.381471 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9d0063b1-d074-4b22-a417-5ee37106b806-config-data\") pod \"ceilometer-0\" (UID: \"9d0063b1-d074-4b22-a417-5ee37106b806\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:28:21 crc kubenswrapper[5120]: I0316 16:28:21.386819 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9d0063b1-d074-4b22-a417-5ee37106b806-scripts\") pod \"ceilometer-0\" (UID: \"9d0063b1-d074-4b22-a417-5ee37106b806\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:28:21 crc kubenswrapper[5120]: I0316 16:28:21.389405 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9d0063b1-d074-4b22-a417-5ee37106b806-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"9d0063b1-d074-4b22-a417-5ee37106b806\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:28:21 crc kubenswrapper[5120]: I0316 16:28:21.391493 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnt9b\" (UniqueName: \"kubernetes.io/projected/9d0063b1-d074-4b22-a417-5ee37106b806-kube-api-access-cnt9b\") pod \"ceilometer-0\" (UID: \"9d0063b1-d074-4b22-a417-5ee37106b806\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:28:21 crc kubenswrapper[5120]: I0316 16:28:21.501385 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:28:21 crc kubenswrapper[5120]: I0316 16:28:21.993034 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:28:22 crc kubenswrapper[5120]: I0316 16:28:22.008377 5120 patch_prober.go:28] interesting pod/machine-config-daemon-7bf76 container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 16:28:22 crc kubenswrapper[5120]: I0316 16:28:22.008450 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 16:28:22 crc kubenswrapper[5120]: I0316 16:28:22.038441 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podUID="a6c25769-b866-4a41-a471-2a397e895990" containerName="nova-cell1-novncproxy-novncproxy" containerID="cri-o://da00e81daeecf12a8e0392eebd750a6fc413b64acadc45c12ab5750598d1bbc4" gracePeriod=30 Mar 16 16:28:22 crc kubenswrapper[5120]: I0316 16:28:22.042990 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:28:22 crc kubenswrapper[5120]: I0316 16:28:22.071083 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:28:22 crc kubenswrapper[5120]: I0316 16:28:22.687539 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="13e7a600-c09b-48ba-a299-3d1f7f3e9074" path="/var/lib/kubelet/pods/13e7a600-c09b-48ba-a299-3d1f7f3e9074/volumes" Mar 16 16:28:23 crc kubenswrapper[5120]: I0316 16:28:23.057842 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"9d0063b1-d074-4b22-a417-5ee37106b806","Type":"ContainerStarted","Data":"3fe4879c12400824d8fb81e983504e34c750e90051ef9376399cb67cadc09487"} Mar 16 16:28:23 crc kubenswrapper[5120]: I0316 16:28:23.057899 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"9d0063b1-d074-4b22-a417-5ee37106b806","Type":"ContainerStarted","Data":"39e0d58d1c0a906c221f31add7b4c3b6bcb5066df7651a89f42d088cc776fb2d"} Mar 16 16:28:23 crc kubenswrapper[5120]: I0316 16:28:23.063176 5120 generic.go:358] "Generic (PLEG): container finished" podID="a6c25769-b866-4a41-a471-2a397e895990" containerID="da00e81daeecf12a8e0392eebd750a6fc413b64acadc45c12ab5750598d1bbc4" exitCode=0 Mar 16 16:28:23 crc kubenswrapper[5120]: I0316 16:28:23.063804 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="7cacc96e-084c-4ad7-86ff-e9c12a3fbd9d" containerName="nova-metadata-log" containerID="cri-o://bb1d430da5e8ad76c8f4bac707d76c5ade8850bee456d0faefb47b0a6fb6f42b" gracePeriod=30 Mar 16 16:28:23 crc kubenswrapper[5120]: I0316 16:28:23.064196 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"a6c25769-b866-4a41-a471-2a397e895990","Type":"ContainerDied","Data":"da00e81daeecf12a8e0392eebd750a6fc413b64acadc45c12ab5750598d1bbc4"} Mar 16 16:28:23 crc kubenswrapper[5120]: I0316 16:28:23.064231 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"a6c25769-b866-4a41-a471-2a397e895990","Type":"ContainerDied","Data":"7506817b2d2ccd204fd476fa94212e33588b9508f886c8e1b72cc0b2c40473c0"} Mar 16 16:28:23 crc kubenswrapper[5120]: I0316 16:28:23.064246 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7506817b2d2ccd204fd476fa94212e33588b9508f886c8e1b72cc0b2c40473c0" Mar 16 16:28:23 crc kubenswrapper[5120]: I0316 16:28:23.064638 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="7cacc96e-084c-4ad7-86ff-e9c12a3fbd9d" containerName="nova-metadata-metadata" containerID="cri-o://23488bacb84c42476a95f8b062cf29961f9395521f8b327dd8fc03a907f77f8e" gracePeriod=30 Mar 16 16:28:23 crc kubenswrapper[5120]: I0316 16:28:23.099445 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:28:23 crc kubenswrapper[5120]: I0316 16:28:23.104820 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:28:23 crc kubenswrapper[5120]: I0316 16:28:23.181331 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a6c25769-b866-4a41-a471-2a397e895990-config-data\") pod \"a6c25769-b866-4a41-a471-2a397e895990\" (UID: \"a6c25769-b866-4a41-a471-2a397e895990\") " Mar 16 16:28:23 crc kubenswrapper[5120]: I0316 16:28:23.181693 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lc668\" (UniqueName: \"kubernetes.io/projected/a6c25769-b866-4a41-a471-2a397e895990-kube-api-access-lc668\") pod \"a6c25769-b866-4a41-a471-2a397e895990\" (UID: \"a6c25769-b866-4a41-a471-2a397e895990\") " Mar 16 16:28:23 crc kubenswrapper[5120]: I0316 16:28:23.181771 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a6c25769-b866-4a41-a471-2a397e895990-combined-ca-bundle\") pod \"a6c25769-b866-4a41-a471-2a397e895990\" (UID: \"a6c25769-b866-4a41-a471-2a397e895990\") " Mar 16 16:28:23 crc kubenswrapper[5120]: I0316 16:28:23.197910 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6c25769-b866-4a41-a471-2a397e895990-kube-api-access-lc668" (OuterVolumeSpecName: "kube-api-access-lc668") pod "a6c25769-b866-4a41-a471-2a397e895990" (UID: "a6c25769-b866-4a41-a471-2a397e895990"). InnerVolumeSpecName "kube-api-access-lc668". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:28:23 crc kubenswrapper[5120]: I0316 16:28:23.229604 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6c25769-b866-4a41-a471-2a397e895990-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "a6c25769-b866-4a41-a471-2a397e895990" (UID: "a6c25769-b866-4a41-a471-2a397e895990"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:28:23 crc kubenswrapper[5120]: I0316 16:28:23.231851 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6c25769-b866-4a41-a471-2a397e895990-config-data" (OuterVolumeSpecName: "config-data") pod "a6c25769-b866-4a41-a471-2a397e895990" (UID: "a6c25769-b866-4a41-a471-2a397e895990"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:28:23 crc kubenswrapper[5120]: I0316 16:28:23.285540 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a6c25769-b866-4a41-a471-2a397e895990-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:28:23 crc kubenswrapper[5120]: I0316 16:28:23.285581 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lc668\" (UniqueName: \"kubernetes.io/projected/a6c25769-b866-4a41-a471-2a397e895990-kube-api-access-lc668\") on node \"crc\" DevicePath \"\"" Mar 16 16:28:23 crc kubenswrapper[5120]: I0316 16:28:23.285598 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a6c25769-b866-4a41-a471-2a397e895990-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:28:23 crc kubenswrapper[5120]: I0316 16:28:23.421289 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:28:23 crc kubenswrapper[5120]: I0316 16:28:23.573493 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:28:23 crc kubenswrapper[5120]: I0316 16:28:23.701397 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9j4rj\" (UniqueName: \"kubernetes.io/projected/7cacc96e-084c-4ad7-86ff-e9c12a3fbd9d-kube-api-access-9j4rj\") pod \"7cacc96e-084c-4ad7-86ff-e9c12a3fbd9d\" (UID: \"7cacc96e-084c-4ad7-86ff-e9c12a3fbd9d\") " Mar 16 16:28:23 crc kubenswrapper[5120]: I0316 16:28:23.701943 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7cacc96e-084c-4ad7-86ff-e9c12a3fbd9d-config-data\") pod \"7cacc96e-084c-4ad7-86ff-e9c12a3fbd9d\" (UID: \"7cacc96e-084c-4ad7-86ff-e9c12a3fbd9d\") " Mar 16 16:28:23 crc kubenswrapper[5120]: I0316 16:28:23.702000 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7cacc96e-084c-4ad7-86ff-e9c12a3fbd9d-combined-ca-bundle\") pod \"7cacc96e-084c-4ad7-86ff-e9c12a3fbd9d\" (UID: \"7cacc96e-084c-4ad7-86ff-e9c12a3fbd9d\") " Mar 16 16:28:23 crc kubenswrapper[5120]: I0316 16:28:23.702469 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7cacc96e-084c-4ad7-86ff-e9c12a3fbd9d-logs\") pod \"7cacc96e-084c-4ad7-86ff-e9c12a3fbd9d\" (UID: \"7cacc96e-084c-4ad7-86ff-e9c12a3fbd9d\") " Mar 16 16:28:23 crc kubenswrapper[5120]: I0316 16:28:23.702855 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7cacc96e-084c-4ad7-86ff-e9c12a3fbd9d-logs" (OuterVolumeSpecName: "logs") pod "7cacc96e-084c-4ad7-86ff-e9c12a3fbd9d" (UID: "7cacc96e-084c-4ad7-86ff-e9c12a3fbd9d"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:28:23 crc kubenswrapper[5120]: I0316 16:28:23.703987 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7cacc96e-084c-4ad7-86ff-e9c12a3fbd9d-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:28:23 crc kubenswrapper[5120]: I0316 16:28:23.707715 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7cacc96e-084c-4ad7-86ff-e9c12a3fbd9d-kube-api-access-9j4rj" (OuterVolumeSpecName: "kube-api-access-9j4rj") pod "7cacc96e-084c-4ad7-86ff-e9c12a3fbd9d" (UID: "7cacc96e-084c-4ad7-86ff-e9c12a3fbd9d"). InnerVolumeSpecName "kube-api-access-9j4rj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:28:23 crc kubenswrapper[5120]: I0316 16:28:23.732326 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7cacc96e-084c-4ad7-86ff-e9c12a3fbd9d-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "7cacc96e-084c-4ad7-86ff-e9c12a3fbd9d" (UID: "7cacc96e-084c-4ad7-86ff-e9c12a3fbd9d"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:28:23 crc kubenswrapper[5120]: I0316 16:28:23.744360 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7cacc96e-084c-4ad7-86ff-e9c12a3fbd9d-config-data" (OuterVolumeSpecName: "config-data") pod "7cacc96e-084c-4ad7-86ff-e9c12a3fbd9d" (UID: "7cacc96e-084c-4ad7-86ff-e9c12a3fbd9d"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:28:23 crc kubenswrapper[5120]: I0316 16:28:23.807118 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9j4rj\" (UniqueName: \"kubernetes.io/projected/7cacc96e-084c-4ad7-86ff-e9c12a3fbd9d-kube-api-access-9j4rj\") on node \"crc\" DevicePath \"\"" Mar 16 16:28:23 crc kubenswrapper[5120]: I0316 16:28:23.807432 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7cacc96e-084c-4ad7-86ff-e9c12a3fbd9d-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:28:23 crc kubenswrapper[5120]: I0316 16:28:23.807543 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7cacc96e-084c-4ad7-86ff-e9c12a3fbd9d-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:28:24 crc kubenswrapper[5120]: I0316 16:28:24.073633 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"9d0063b1-d074-4b22-a417-5ee37106b806","Type":"ContainerStarted","Data":"f466ef11f3c839380e987e10bf6c892187b564a973d3536a09943b4a32848e4b"} Mar 16 16:28:24 crc kubenswrapper[5120]: I0316 16:28:24.076510 5120 generic.go:358] "Generic (PLEG): container finished" podID="13e3ea54-b4d8-4995-8ef1-bb45203f4ad8" containerID="1ba0b27cac3772b9d043f22faf3b845ee8338b9644dd4435cc691903878e8b8b" exitCode=1 Mar 16 16:28:24 crc kubenswrapper[5120]: I0316 16:28:24.076608 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"13e3ea54-b4d8-4995-8ef1-bb45203f4ad8","Type":"ContainerDied","Data":"1ba0b27cac3772b9d043f22faf3b845ee8338b9644dd4435cc691903878e8b8b"} Mar 16 16:28:24 crc kubenswrapper[5120]: I0316 16:28:24.077453 5120 scope.go:117] "RemoveContainer" containerID="1ba0b27cac3772b9d043f22faf3b845ee8338b9644dd4435cc691903878e8b8b" Mar 16 16:28:24 crc kubenswrapper[5120]: I0316 16:28:24.079210 5120 generic.go:358] "Generic (PLEG): container finished" podID="7cacc96e-084c-4ad7-86ff-e9c12a3fbd9d" containerID="23488bacb84c42476a95f8b062cf29961f9395521f8b327dd8fc03a907f77f8e" exitCode=0 Mar 16 16:28:24 crc kubenswrapper[5120]: I0316 16:28:24.079315 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:28:24 crc kubenswrapper[5120]: I0316 16:28:24.079263 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"7cacc96e-084c-4ad7-86ff-e9c12a3fbd9d","Type":"ContainerDied","Data":"23488bacb84c42476a95f8b062cf29961f9395521f8b327dd8fc03a907f77f8e"} Mar 16 16:28:24 crc kubenswrapper[5120]: I0316 16:28:24.079327 5120 generic.go:358] "Generic (PLEG): container finished" podID="7cacc96e-084c-4ad7-86ff-e9c12a3fbd9d" containerID="bb1d430da5e8ad76c8f4bac707d76c5ade8850bee456d0faefb47b0a6fb6f42b" exitCode=143 Mar 16 16:28:24 crc kubenswrapper[5120]: I0316 16:28:24.079617 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"7cacc96e-084c-4ad7-86ff-e9c12a3fbd9d","Type":"ContainerDied","Data":"bb1d430da5e8ad76c8f4bac707d76c5ade8850bee456d0faefb47b0a6fb6f42b"} Mar 16 16:28:24 crc kubenswrapper[5120]: I0316 16:28:24.079698 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"7cacc96e-084c-4ad7-86ff-e9c12a3fbd9d","Type":"ContainerDied","Data":"11525ae9f1598a4a77873fca912403f89ed1779e4367ee102c6b028da919d1a7"} Mar 16 16:28:24 crc kubenswrapper[5120]: I0316 16:28:24.079634 5120 scope.go:117] "RemoveContainer" containerID="23488bacb84c42476a95f8b062cf29961f9395521f8b327dd8fc03a907f77f8e" Mar 16 16:28:24 crc kubenswrapper[5120]: I0316 16:28:24.079868 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:28:24 crc kubenswrapper[5120]: I0316 16:28:24.117666 5120 scope.go:117] "RemoveContainer" containerID="bb1d430da5e8ad76c8f4bac707d76c5ade8850bee456d0faefb47b0a6fb6f42b" Mar 16 16:28:24 crc kubenswrapper[5120]: I0316 16:28:24.148527 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:28:24 crc kubenswrapper[5120]: I0316 16:28:24.178947 5120 scope.go:117] "RemoveContainer" containerID="23488bacb84c42476a95f8b062cf29961f9395521f8b327dd8fc03a907f77f8e" Mar 16 16:28:24 crc kubenswrapper[5120]: I0316 16:28:24.179583 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:28:24 crc kubenswrapper[5120]: E0316 16:28:24.180267 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"23488bacb84c42476a95f8b062cf29961f9395521f8b327dd8fc03a907f77f8e\": container with ID starting with 23488bacb84c42476a95f8b062cf29961f9395521f8b327dd8fc03a907f77f8e not found: ID does not exist" containerID="23488bacb84c42476a95f8b062cf29961f9395521f8b327dd8fc03a907f77f8e" Mar 16 16:28:24 crc kubenswrapper[5120]: I0316 16:28:24.180304 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23488bacb84c42476a95f8b062cf29961f9395521f8b327dd8fc03a907f77f8e"} err="failed to get container status \"23488bacb84c42476a95f8b062cf29961f9395521f8b327dd8fc03a907f77f8e\": rpc error: code = NotFound desc = could not find container \"23488bacb84c42476a95f8b062cf29961f9395521f8b327dd8fc03a907f77f8e\": container with ID starting with 23488bacb84c42476a95f8b062cf29961f9395521f8b327dd8fc03a907f77f8e not found: ID does not exist" Mar 16 16:28:24 crc kubenswrapper[5120]: I0316 16:28:24.180330 5120 scope.go:117] "RemoveContainer" containerID="bb1d430da5e8ad76c8f4bac707d76c5ade8850bee456d0faefb47b0a6fb6f42b" Mar 16 16:28:24 crc kubenswrapper[5120]: E0316 16:28:24.181438 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb1d430da5e8ad76c8f4bac707d76c5ade8850bee456d0faefb47b0a6fb6f42b\": container with ID starting with bb1d430da5e8ad76c8f4bac707d76c5ade8850bee456d0faefb47b0a6fb6f42b not found: ID does not exist" containerID="bb1d430da5e8ad76c8f4bac707d76c5ade8850bee456d0faefb47b0a6fb6f42b" Mar 16 16:28:24 crc kubenswrapper[5120]: I0316 16:28:24.181483 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb1d430da5e8ad76c8f4bac707d76c5ade8850bee456d0faefb47b0a6fb6f42b"} err="failed to get container status \"bb1d430da5e8ad76c8f4bac707d76c5ade8850bee456d0faefb47b0a6fb6f42b\": rpc error: code = NotFound desc = could not find container \"bb1d430da5e8ad76c8f4bac707d76c5ade8850bee456d0faefb47b0a6fb6f42b\": container with ID starting with bb1d430da5e8ad76c8f4bac707d76c5ade8850bee456d0faefb47b0a6fb6f42b not found: ID does not exist" Mar 16 16:28:24 crc kubenswrapper[5120]: I0316 16:28:24.181507 5120 scope.go:117] "RemoveContainer" containerID="23488bacb84c42476a95f8b062cf29961f9395521f8b327dd8fc03a907f77f8e" Mar 16 16:28:24 crc kubenswrapper[5120]: I0316 16:28:24.181964 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23488bacb84c42476a95f8b062cf29961f9395521f8b327dd8fc03a907f77f8e"} err="failed to get container status \"23488bacb84c42476a95f8b062cf29961f9395521f8b327dd8fc03a907f77f8e\": rpc error: code = NotFound desc = could not find container \"23488bacb84c42476a95f8b062cf29961f9395521f8b327dd8fc03a907f77f8e\": container with ID starting with 23488bacb84c42476a95f8b062cf29961f9395521f8b327dd8fc03a907f77f8e not found: ID does not exist" Mar 16 16:28:24 crc kubenswrapper[5120]: I0316 16:28:24.182022 5120 scope.go:117] "RemoveContainer" containerID="bb1d430da5e8ad76c8f4bac707d76c5ade8850bee456d0faefb47b0a6fb6f42b" Mar 16 16:28:24 crc kubenswrapper[5120]: I0316 16:28:24.187120 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb1d430da5e8ad76c8f4bac707d76c5ade8850bee456d0faefb47b0a6fb6f42b"} err="failed to get container status \"bb1d430da5e8ad76c8f4bac707d76c5ade8850bee456d0faefb47b0a6fb6f42b\": rpc error: code = NotFound desc = could not find container \"bb1d430da5e8ad76c8f4bac707d76c5ade8850bee456d0faefb47b0a6fb6f42b\": container with ID starting with bb1d430da5e8ad76c8f4bac707d76c5ade8850bee456d0faefb47b0a6fb6f42b not found: ID does not exist" Mar 16 16:28:24 crc kubenswrapper[5120]: I0316 16:28:24.197032 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:28:24 crc kubenswrapper[5120]: I0316 16:28:24.200136 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6c25769-b866-4a41-a471-2a397e895990" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 16:28:24 crc kubenswrapper[5120]: I0316 16:28:24.200167 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6c25769-b866-4a41-a471-2a397e895990" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 16:28:24 crc kubenswrapper[5120]: I0316 16:28:24.200186 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7cacc96e-084c-4ad7-86ff-e9c12a3fbd9d" containerName="nova-metadata-metadata" Mar 16 16:28:24 crc kubenswrapper[5120]: I0316 16:28:24.200195 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7cacc96e-084c-4ad7-86ff-e9c12a3fbd9d" containerName="nova-metadata-metadata" Mar 16 16:28:24 crc kubenswrapper[5120]: I0316 16:28:24.200273 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7cacc96e-084c-4ad7-86ff-e9c12a3fbd9d" containerName="nova-metadata-log" Mar 16 16:28:24 crc kubenswrapper[5120]: I0316 16:28:24.200281 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7cacc96e-084c-4ad7-86ff-e9c12a3fbd9d" containerName="nova-metadata-log" Mar 16 16:28:24 crc kubenswrapper[5120]: I0316 16:28:24.200601 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="a6c25769-b866-4a41-a471-2a397e895990" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 16:28:24 crc kubenswrapper[5120]: I0316 16:28:24.200623 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7cacc96e-084c-4ad7-86ff-e9c12a3fbd9d" containerName="nova-metadata-log" Mar 16 16:28:24 crc kubenswrapper[5120]: I0316 16:28:24.200658 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7cacc96e-084c-4ad7-86ff-e9c12a3fbd9d" containerName="nova-metadata-metadata" Mar 16 16:28:24 crc kubenswrapper[5120]: I0316 16:28:24.268146 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:28:24 crc kubenswrapper[5120]: I0316 16:28:24.268662 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:28:24 crc kubenswrapper[5120]: I0316 16:28:24.268794 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:28:24 crc kubenswrapper[5120]: I0316 16:28:24.269816 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:28:24 crc kubenswrapper[5120]: I0316 16:28:24.272720 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-metadata-internal-svc\"" Mar 16 16:28:24 crc kubenswrapper[5120]: I0316 16:28:24.273204 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-metadata-config-data\"" Mar 16 16:28:24 crc kubenswrapper[5120]: I0316 16:28:24.337179 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:28:24 crc kubenswrapper[5120]: I0316 16:28:24.371999 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:28:24 crc kubenswrapper[5120]: I0316 16:28:24.372177 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:28:24 crc kubenswrapper[5120]: I0316 16:28:24.377550 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-novncproxy-cell1-vencrypt\"" Mar 16 16:28:24 crc kubenswrapper[5120]: I0316 16:28:24.378160 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-novncproxy-config-data\"" Mar 16 16:28:24 crc kubenswrapper[5120]: I0316 16:28:24.392396 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-novncproxy-cell1-public-svc\"" Mar 16 16:28:24 crc kubenswrapper[5120]: I0316 16:28:24.442720 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/2c5efc2e-a677-4619-807b-c87ad3b18a61-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"2c5efc2e-a677-4619-807b-c87ad3b18a61\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:28:24 crc kubenswrapper[5120]: I0316 16:28:24.442864 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2c5efc2e-a677-4619-807b-c87ad3b18a61-config-data\") pod \"nova-metadata-0\" (UID: \"2c5efc2e-a677-4619-807b-c87ad3b18a61\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:28:24 crc kubenswrapper[5120]: I0316 16:28:24.442906 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2c5efc2e-a677-4619-807b-c87ad3b18a61-logs\") pod \"nova-metadata-0\" (UID: \"2c5efc2e-a677-4619-807b-c87ad3b18a61\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:28:24 crc kubenswrapper[5120]: I0316 16:28:24.443066 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8pkpg\" (UniqueName: \"kubernetes.io/projected/2c5efc2e-a677-4619-807b-c87ad3b18a61-kube-api-access-8pkpg\") pod \"nova-metadata-0\" (UID: \"2c5efc2e-a677-4619-807b-c87ad3b18a61\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:28:24 crc kubenswrapper[5120]: I0316 16:28:24.443114 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2c5efc2e-a677-4619-807b-c87ad3b18a61-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"2c5efc2e-a677-4619-807b-c87ad3b18a61\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:28:24 crc kubenswrapper[5120]: I0316 16:28:24.545467 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/2c5efc2e-a677-4619-807b-c87ad3b18a61-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"2c5efc2e-a677-4619-807b-c87ad3b18a61\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:28:24 crc kubenswrapper[5120]: I0316 16:28:24.545526 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/da2bbfc0-f1f7-4294-b906-02cf338292b3-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"da2bbfc0-f1f7-4294-b906-02cf338292b3\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:28:24 crc kubenswrapper[5120]: I0316 16:28:24.545556 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/da2bbfc0-f1f7-4294-b906-02cf338292b3-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"da2bbfc0-f1f7-4294-b906-02cf338292b3\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:28:24 crc kubenswrapper[5120]: I0316 16:28:24.545599 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/da2bbfc0-f1f7-4294-b906-02cf338292b3-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"da2bbfc0-f1f7-4294-b906-02cf338292b3\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:28:24 crc kubenswrapper[5120]: I0316 16:28:24.545656 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2c5efc2e-a677-4619-807b-c87ad3b18a61-config-data\") pod \"nova-metadata-0\" (UID: \"2c5efc2e-a677-4619-807b-c87ad3b18a61\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:28:24 crc kubenswrapper[5120]: I0316 16:28:24.545693 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2c5efc2e-a677-4619-807b-c87ad3b18a61-logs\") pod \"nova-metadata-0\" (UID: \"2c5efc2e-a677-4619-807b-c87ad3b18a61\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:28:24 crc kubenswrapper[5120]: I0316 16:28:24.545717 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/da2bbfc0-f1f7-4294-b906-02cf338292b3-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"da2bbfc0-f1f7-4294-b906-02cf338292b3\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:28:24 crc kubenswrapper[5120]: I0316 16:28:24.545846 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8fc4q\" (UniqueName: \"kubernetes.io/projected/da2bbfc0-f1f7-4294-b906-02cf338292b3-kube-api-access-8fc4q\") pod \"nova-cell1-novncproxy-0\" (UID: \"da2bbfc0-f1f7-4294-b906-02cf338292b3\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:28:24 crc kubenswrapper[5120]: I0316 16:28:24.545911 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8pkpg\" (UniqueName: \"kubernetes.io/projected/2c5efc2e-a677-4619-807b-c87ad3b18a61-kube-api-access-8pkpg\") pod \"nova-metadata-0\" (UID: \"2c5efc2e-a677-4619-807b-c87ad3b18a61\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:28:24 crc kubenswrapper[5120]: I0316 16:28:24.545945 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2c5efc2e-a677-4619-807b-c87ad3b18a61-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"2c5efc2e-a677-4619-807b-c87ad3b18a61\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:28:24 crc kubenswrapper[5120]: I0316 16:28:24.546609 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2c5efc2e-a677-4619-807b-c87ad3b18a61-logs\") pod \"nova-metadata-0\" (UID: \"2c5efc2e-a677-4619-807b-c87ad3b18a61\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:28:24 crc kubenswrapper[5120]: I0316 16:28:24.551324 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/2c5efc2e-a677-4619-807b-c87ad3b18a61-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"2c5efc2e-a677-4619-807b-c87ad3b18a61\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:28:24 crc kubenswrapper[5120]: I0316 16:28:24.552157 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2c5efc2e-a677-4619-807b-c87ad3b18a61-config-data\") pod \"nova-metadata-0\" (UID: \"2c5efc2e-a677-4619-807b-c87ad3b18a61\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:28:24 crc kubenswrapper[5120]: I0316 16:28:24.552696 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2c5efc2e-a677-4619-807b-c87ad3b18a61-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"2c5efc2e-a677-4619-807b-c87ad3b18a61\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:28:24 crc kubenswrapper[5120]: I0316 16:28:24.566650 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8pkpg\" (UniqueName: \"kubernetes.io/projected/2c5efc2e-a677-4619-807b-c87ad3b18a61-kube-api-access-8pkpg\") pod \"nova-metadata-0\" (UID: \"2c5efc2e-a677-4619-807b-c87ad3b18a61\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:28:24 crc kubenswrapper[5120]: I0316 16:28:24.603095 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:28:24 crc kubenswrapper[5120]: I0316 16:28:24.649515 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/da2bbfc0-f1f7-4294-b906-02cf338292b3-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"da2bbfc0-f1f7-4294-b906-02cf338292b3\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:28:24 crc kubenswrapper[5120]: I0316 16:28:24.649577 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/da2bbfc0-f1f7-4294-b906-02cf338292b3-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"da2bbfc0-f1f7-4294-b906-02cf338292b3\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:28:24 crc kubenswrapper[5120]: I0316 16:28:24.649638 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/da2bbfc0-f1f7-4294-b906-02cf338292b3-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"da2bbfc0-f1f7-4294-b906-02cf338292b3\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:28:24 crc kubenswrapper[5120]: I0316 16:28:24.649785 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/da2bbfc0-f1f7-4294-b906-02cf338292b3-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"da2bbfc0-f1f7-4294-b906-02cf338292b3\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:28:24 crc kubenswrapper[5120]: I0316 16:28:24.651096 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8fc4q\" (UniqueName: \"kubernetes.io/projected/da2bbfc0-f1f7-4294-b906-02cf338292b3-kube-api-access-8fc4q\") pod \"nova-cell1-novncproxy-0\" (UID: \"da2bbfc0-f1f7-4294-b906-02cf338292b3\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:28:24 crc kubenswrapper[5120]: I0316 16:28:24.655968 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/da2bbfc0-f1f7-4294-b906-02cf338292b3-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"da2bbfc0-f1f7-4294-b906-02cf338292b3\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:28:24 crc kubenswrapper[5120]: I0316 16:28:24.656681 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/da2bbfc0-f1f7-4294-b906-02cf338292b3-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"da2bbfc0-f1f7-4294-b906-02cf338292b3\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:28:24 crc kubenswrapper[5120]: I0316 16:28:24.656744 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/da2bbfc0-f1f7-4294-b906-02cf338292b3-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"da2bbfc0-f1f7-4294-b906-02cf338292b3\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:28:24 crc kubenswrapper[5120]: I0316 16:28:24.665454 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/da2bbfc0-f1f7-4294-b906-02cf338292b3-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"da2bbfc0-f1f7-4294-b906-02cf338292b3\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:28:24 crc kubenswrapper[5120]: I0316 16:28:24.671187 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fc4q\" (UniqueName: \"kubernetes.io/projected/da2bbfc0-f1f7-4294-b906-02cf338292b3-kube-api-access-8fc4q\") pod \"nova-cell1-novncproxy-0\" (UID: \"da2bbfc0-f1f7-4294-b906-02cf338292b3\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:28:24 crc kubenswrapper[5120]: I0316 16:28:24.691622 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7cacc96e-084c-4ad7-86ff-e9c12a3fbd9d" path="/var/lib/kubelet/pods/7cacc96e-084c-4ad7-86ff-e9c12a3fbd9d/volumes" Mar 16 16:28:24 crc kubenswrapper[5120]: I0316 16:28:24.692738 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a6c25769-b866-4a41-a471-2a397e895990" path="/var/lib/kubelet/pods/a6c25769-b866-4a41-a471-2a397e895990/volumes" Mar 16 16:28:24 crc kubenswrapper[5120]: I0316 16:28:24.734497 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:28:24 crc kubenswrapper[5120]: I0316 16:28:24.751183 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:28:24 crc kubenswrapper[5120]: I0316 16:28:24.809704 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:28:24 crc kubenswrapper[5120]: I0316 16:28:24.821201 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="30cd93ec-58de-4375-a52f-11d5645d7bda" containerName="nova-api-log" containerID="cri-o://b9e4dfd5e0f24798d200a27ea95502c61c12849b241b0f2beb941ec30d8ea251" gracePeriod=30 Mar 16 16:28:24 crc kubenswrapper[5120]: I0316 16:28:24.821340 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="30cd93ec-58de-4375-a52f-11d5645d7bda" containerName="nova-api-api" containerID="cri-o://8d9cd1279b634c9b060a2e1fa51344ef3a830ff1f84546f47e7e5d72cc24bcf1" gracePeriod=30 Mar 16 16:28:24 crc kubenswrapper[5120]: I0316 16:28:24.884298 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:28:24 crc kubenswrapper[5120]: I0316 16:28:24.927347 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:28:24 crc kubenswrapper[5120]: I0316 16:28:24.927632 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="43c71024-0a80-4f26-a6de-ebc75eeed01e" containerName="nova-cell0-conductor-conductor" containerID="cri-o://1c288239519e7e76c9b53ae3a58cba524ac10f7a76be8d76feadee9330048b9b" gracePeriod=30 Mar 16 16:28:24 crc kubenswrapper[5120]: I0316 16:28:24.941600 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:28:25 crc kubenswrapper[5120]: I0316 16:28:25.136221 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"9d0063b1-d074-4b22-a417-5ee37106b806","Type":"ContainerStarted","Data":"851cd14018b883bd0f742e1e2c418a796039a93013c8ac37618f4183f9df031e"} Mar 16 16:28:25 crc kubenswrapper[5120]: I0316 16:28:25.143555 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"13e3ea54-b4d8-4995-8ef1-bb45203f4ad8","Type":"ContainerStarted","Data":"aedb59a22c20b4a76de6995ba59c4843dfd20b4d148dcaef7594113c601e8c3a"} Mar 16 16:28:25 crc kubenswrapper[5120]: I0316 16:28:25.143740 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="13e3ea54-b4d8-4995-8ef1-bb45203f4ad8" containerName="nova-scheduler-scheduler" containerID="cri-o://aedb59a22c20b4a76de6995ba59c4843dfd20b4d148dcaef7594113c601e8c3a" gracePeriod=30 Mar 16 16:28:25 crc kubenswrapper[5120]: I0316 16:28:25.158970 5120 generic.go:358] "Generic (PLEG): container finished" podID="30cd93ec-58de-4375-a52f-11d5645d7bda" containerID="8d9cd1279b634c9b060a2e1fa51344ef3a830ff1f84546f47e7e5d72cc24bcf1" exitCode=0 Mar 16 16:28:25 crc kubenswrapper[5120]: I0316 16:28:25.159017 5120 generic.go:358] "Generic (PLEG): container finished" podID="30cd93ec-58de-4375-a52f-11d5645d7bda" containerID="b9e4dfd5e0f24798d200a27ea95502c61c12849b241b0f2beb941ec30d8ea251" exitCode=143 Mar 16 16:28:25 crc kubenswrapper[5120]: I0316 16:28:25.159200 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"30cd93ec-58de-4375-a52f-11d5645d7bda","Type":"ContainerDied","Data":"8d9cd1279b634c9b060a2e1fa51344ef3a830ff1f84546f47e7e5d72cc24bcf1"} Mar 16 16:28:25 crc kubenswrapper[5120]: I0316 16:28:25.159232 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"30cd93ec-58de-4375-a52f-11d5645d7bda","Type":"ContainerDied","Data":"b9e4dfd5e0f24798d200a27ea95502c61c12849b241b0f2beb941ec30d8ea251"} Mar 16 16:28:25 crc kubenswrapper[5120]: I0316 16:28:25.268134 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:28:25 crc kubenswrapper[5120]: I0316 16:28:25.385394 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:28:25 crc kubenswrapper[5120]: I0316 16:28:25.540660 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:28:25 crc kubenswrapper[5120]: I0316 16:28:25.585444 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/30cd93ec-58de-4375-a52f-11d5645d7bda-logs\") pod \"30cd93ec-58de-4375-a52f-11d5645d7bda\" (UID: \"30cd93ec-58de-4375-a52f-11d5645d7bda\") " Mar 16 16:28:25 crc kubenswrapper[5120]: I0316 16:28:25.585534 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qlqjw\" (UniqueName: \"kubernetes.io/projected/30cd93ec-58de-4375-a52f-11d5645d7bda-kube-api-access-qlqjw\") pod \"30cd93ec-58de-4375-a52f-11d5645d7bda\" (UID: \"30cd93ec-58de-4375-a52f-11d5645d7bda\") " Mar 16 16:28:25 crc kubenswrapper[5120]: I0316 16:28:25.585604 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/30cd93ec-58de-4375-a52f-11d5645d7bda-config-data\") pod \"30cd93ec-58de-4375-a52f-11d5645d7bda\" (UID: \"30cd93ec-58de-4375-a52f-11d5645d7bda\") " Mar 16 16:28:25 crc kubenswrapper[5120]: I0316 16:28:25.585675 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/30cd93ec-58de-4375-a52f-11d5645d7bda-combined-ca-bundle\") pod \"30cd93ec-58de-4375-a52f-11d5645d7bda\" (UID: \"30cd93ec-58de-4375-a52f-11d5645d7bda\") " Mar 16 16:28:25 crc kubenswrapper[5120]: I0316 16:28:25.592516 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/30cd93ec-58de-4375-a52f-11d5645d7bda-logs" (OuterVolumeSpecName: "logs") pod "30cd93ec-58de-4375-a52f-11d5645d7bda" (UID: "30cd93ec-58de-4375-a52f-11d5645d7bda"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:28:25 crc kubenswrapper[5120]: I0316 16:28:25.601353 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30cd93ec-58de-4375-a52f-11d5645d7bda-kube-api-access-qlqjw" (OuterVolumeSpecName: "kube-api-access-qlqjw") pod "30cd93ec-58de-4375-a52f-11d5645d7bda" (UID: "30cd93ec-58de-4375-a52f-11d5645d7bda"). InnerVolumeSpecName "kube-api-access-qlqjw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:28:25 crc kubenswrapper[5120]: I0316 16:28:25.629452 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/30cd93ec-58de-4375-a52f-11d5645d7bda-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "30cd93ec-58de-4375-a52f-11d5645d7bda" (UID: "30cd93ec-58de-4375-a52f-11d5645d7bda"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:28:25 crc kubenswrapper[5120]: I0316 16:28:25.639473 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/30cd93ec-58de-4375-a52f-11d5645d7bda-config-data" (OuterVolumeSpecName: "config-data") pod "30cd93ec-58de-4375-a52f-11d5645d7bda" (UID: "30cd93ec-58de-4375-a52f-11d5645d7bda"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:28:25 crc kubenswrapper[5120]: I0316 16:28:25.689522 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/30cd93ec-58de-4375-a52f-11d5645d7bda-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:28:25 crc kubenswrapper[5120]: I0316 16:28:25.689574 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qlqjw\" (UniqueName: \"kubernetes.io/projected/30cd93ec-58de-4375-a52f-11d5645d7bda-kube-api-access-qlqjw\") on node \"crc\" DevicePath \"\"" Mar 16 16:28:25 crc kubenswrapper[5120]: I0316 16:28:25.689587 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/30cd93ec-58de-4375-a52f-11d5645d7bda-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:28:25 crc kubenswrapper[5120]: I0316 16:28:25.689597 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/30cd93ec-58de-4375-a52f-11d5645d7bda-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:28:26 crc kubenswrapper[5120]: I0316 16:28:26.170358 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:28:26 crc kubenswrapper[5120]: I0316 16:28:26.170357 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"30cd93ec-58de-4375-a52f-11d5645d7bda","Type":"ContainerDied","Data":"52b59be0011ddbc236e111201496df060ee60d0740bb3c4e83784861dc146888"} Mar 16 16:28:26 crc kubenswrapper[5120]: I0316 16:28:26.170816 5120 scope.go:117] "RemoveContainer" containerID="8d9cd1279b634c9b060a2e1fa51344ef3a830ff1f84546f47e7e5d72cc24bcf1" Mar 16 16:28:26 crc kubenswrapper[5120]: I0316 16:28:26.172699 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"2c5efc2e-a677-4619-807b-c87ad3b18a61","Type":"ContainerStarted","Data":"968e94721e2f6712b0c7a025b5f8e7b05b034de9c8f06d279dac8cec39bf7142"} Mar 16 16:28:26 crc kubenswrapper[5120]: I0316 16:28:26.172730 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"2c5efc2e-a677-4619-807b-c87ad3b18a61","Type":"ContainerStarted","Data":"70a38b96bf5a3f321d1f696edad4ffb6a7a48ff2330d4185e3dcb33e0ec2935c"} Mar 16 16:28:26 crc kubenswrapper[5120]: I0316 16:28:26.172739 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"2c5efc2e-a677-4619-807b-c87ad3b18a61","Type":"ContainerStarted","Data":"cde58d0e3320809a209d0e2167069059d25ba24dfa604b89f19a860b30593084"} Mar 16 16:28:26 crc kubenswrapper[5120]: I0316 16:28:26.172869 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="2c5efc2e-a677-4619-807b-c87ad3b18a61" containerName="nova-metadata-log" containerID="cri-o://70a38b96bf5a3f321d1f696edad4ffb6a7a48ff2330d4185e3dcb33e0ec2935c" gracePeriod=30 Mar 16 16:28:26 crc kubenswrapper[5120]: I0316 16:28:26.173193 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="2c5efc2e-a677-4619-807b-c87ad3b18a61" containerName="nova-metadata-metadata" containerID="cri-o://968e94721e2f6712b0c7a025b5f8e7b05b034de9c8f06d279dac8cec39bf7142" gracePeriod=30 Mar 16 16:28:26 crc kubenswrapper[5120]: I0316 16:28:26.181911 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"da2bbfc0-f1f7-4294-b906-02cf338292b3","Type":"ContainerStarted","Data":"41d01ec19e19459501ca249030d594e8bffcfe58d2d90c9bf956724250844eb2"} Mar 16 16:28:26 crc kubenswrapper[5120]: I0316 16:28:26.181955 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"da2bbfc0-f1f7-4294-b906-02cf338292b3","Type":"ContainerStarted","Data":"060e6a0c2c6e55bad9abce3ef88af7e41dce8676428b1b1dfc127f162fda834a"} Mar 16 16:28:26 crc kubenswrapper[5120]: I0316 16:28:26.182074 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podUID="da2bbfc0-f1f7-4294-b906-02cf338292b3" containerName="nova-cell1-novncproxy-novncproxy" containerID="cri-o://41d01ec19e19459501ca249030d594e8bffcfe58d2d90c9bf956724250844eb2" gracePeriod=30 Mar 16 16:28:26 crc kubenswrapper[5120]: I0316 16:28:26.206438 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=2.206395725 podStartE2EDuration="2.206395725s" podCreationTimestamp="2026-03-16 16:28:24 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:28:26.198131174 +0000 UTC m=+3408.352062841" watchObservedRunningTime="2026-03-16 16:28:26.206395725 +0000 UTC m=+3408.360327382" Mar 16 16:28:26 crc kubenswrapper[5120]: I0316 16:28:26.240993 5120 scope.go:117] "RemoveContainer" containerID="b9e4dfd5e0f24798d200a27ea95502c61c12849b241b0f2beb941ec30d8ea251" Mar 16 16:28:26 crc kubenswrapper[5120]: I0316 16:28:26.262174 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:28:26 crc kubenswrapper[5120]: I0316 16:28:26.289392 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:28:26 crc kubenswrapper[5120]: I0316 16:28:26.305145 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:28:26 crc kubenswrapper[5120]: I0316 16:28:26.307305 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30cd93ec-58de-4375-a52f-11d5645d7bda" containerName="nova-api-api" Mar 16 16:28:26 crc kubenswrapper[5120]: I0316 16:28:26.307330 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="30cd93ec-58de-4375-a52f-11d5645d7bda" containerName="nova-api-api" Mar 16 16:28:26 crc kubenswrapper[5120]: I0316 16:28:26.307342 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30cd93ec-58de-4375-a52f-11d5645d7bda" containerName="nova-api-log" Mar 16 16:28:26 crc kubenswrapper[5120]: I0316 16:28:26.307348 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="30cd93ec-58de-4375-a52f-11d5645d7bda" containerName="nova-api-log" Mar 16 16:28:26 crc kubenswrapper[5120]: I0316 16:28:26.307704 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="30cd93ec-58de-4375-a52f-11d5645d7bda" containerName="nova-api-api" Mar 16 16:28:26 crc kubenswrapper[5120]: I0316 16:28:26.307728 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="30cd93ec-58de-4375-a52f-11d5645d7bda" containerName="nova-api-log" Mar 16 16:28:26 crc kubenswrapper[5120]: I0316 16:28:26.311291 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podStartSLOduration=2.311270401 podStartE2EDuration="2.311270401s" podCreationTimestamp="2026-03-16 16:28:24 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:28:26.253077324 +0000 UTC m=+3408.407008981" watchObservedRunningTime="2026-03-16 16:28:26.311270401 +0000 UTC m=+3408.465202058" Mar 16 16:28:26 crc kubenswrapper[5120]: I0316 16:28:26.319596 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:28:26 crc kubenswrapper[5120]: I0316 16:28:26.323266 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-config-data\"" Mar 16 16:28:26 crc kubenswrapper[5120]: I0316 16:28:26.327662 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:28:26 crc kubenswrapper[5120]: I0316 16:28:26.408378 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/562ac4c6-f1e8-4cbc-bbd7-4aad1f0d4f9a-logs\") pod \"nova-api-0\" (UID: \"562ac4c6-f1e8-4cbc-bbd7-4aad1f0d4f9a\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:28:26 crc kubenswrapper[5120]: I0316 16:28:26.408936 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/562ac4c6-f1e8-4cbc-bbd7-4aad1f0d4f9a-config-data\") pod \"nova-api-0\" (UID: \"562ac4c6-f1e8-4cbc-bbd7-4aad1f0d4f9a\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:28:26 crc kubenswrapper[5120]: I0316 16:28:26.409099 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvqqd\" (UniqueName: \"kubernetes.io/projected/562ac4c6-f1e8-4cbc-bbd7-4aad1f0d4f9a-kube-api-access-xvqqd\") pod \"nova-api-0\" (UID: \"562ac4c6-f1e8-4cbc-bbd7-4aad1f0d4f9a\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:28:26 crc kubenswrapper[5120]: I0316 16:28:26.409338 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/562ac4c6-f1e8-4cbc-bbd7-4aad1f0d4f9a-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"562ac4c6-f1e8-4cbc-bbd7-4aad1f0d4f9a\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:28:26 crc kubenswrapper[5120]: I0316 16:28:26.511619 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/562ac4c6-f1e8-4cbc-bbd7-4aad1f0d4f9a-logs\") pod \"nova-api-0\" (UID: \"562ac4c6-f1e8-4cbc-bbd7-4aad1f0d4f9a\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:28:26 crc kubenswrapper[5120]: I0316 16:28:26.512169 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/562ac4c6-f1e8-4cbc-bbd7-4aad1f0d4f9a-config-data\") pod \"nova-api-0\" (UID: \"562ac4c6-f1e8-4cbc-bbd7-4aad1f0d4f9a\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:28:26 crc kubenswrapper[5120]: I0316 16:28:26.512202 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xvqqd\" (UniqueName: \"kubernetes.io/projected/562ac4c6-f1e8-4cbc-bbd7-4aad1f0d4f9a-kube-api-access-xvqqd\") pod \"nova-api-0\" (UID: \"562ac4c6-f1e8-4cbc-bbd7-4aad1f0d4f9a\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:28:26 crc kubenswrapper[5120]: I0316 16:28:26.512280 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/562ac4c6-f1e8-4cbc-bbd7-4aad1f0d4f9a-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"562ac4c6-f1e8-4cbc-bbd7-4aad1f0d4f9a\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:28:26 crc kubenswrapper[5120]: I0316 16:28:26.513220 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/562ac4c6-f1e8-4cbc-bbd7-4aad1f0d4f9a-logs\") pod \"nova-api-0\" (UID: \"562ac4c6-f1e8-4cbc-bbd7-4aad1f0d4f9a\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:28:26 crc kubenswrapper[5120]: I0316 16:28:26.517174 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/562ac4c6-f1e8-4cbc-bbd7-4aad1f0d4f9a-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"562ac4c6-f1e8-4cbc-bbd7-4aad1f0d4f9a\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:28:26 crc kubenswrapper[5120]: I0316 16:28:26.521702 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/562ac4c6-f1e8-4cbc-bbd7-4aad1f0d4f9a-config-data\") pod \"nova-api-0\" (UID: \"562ac4c6-f1e8-4cbc-bbd7-4aad1f0d4f9a\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:28:26 crc kubenswrapper[5120]: I0316 16:28:26.539886 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvqqd\" (UniqueName: \"kubernetes.io/projected/562ac4c6-f1e8-4cbc-bbd7-4aad1f0d4f9a-kube-api-access-xvqqd\") pod \"nova-api-0\" (UID: \"562ac4c6-f1e8-4cbc-bbd7-4aad1f0d4f9a\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:28:26 crc kubenswrapper[5120]: I0316 16:28:26.683174 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:28:26 crc kubenswrapper[5120]: I0316 16:28:26.692241 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="30cd93ec-58de-4375-a52f-11d5645d7bda" path="/var/lib/kubelet/pods/30cd93ec-58de-4375-a52f-11d5645d7bda/volumes" Mar 16 16:28:26 crc kubenswrapper[5120]: E0316 16:28:26.834132 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 1c288239519e7e76c9b53ae3a58cba524ac10f7a76be8d76feadee9330048b9b is running failed: container process not found" containerID="1c288239519e7e76c9b53ae3a58cba524ac10f7a76be8d76feadee9330048b9b" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:28:26 crc kubenswrapper[5120]: E0316 16:28:26.837943 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 1c288239519e7e76c9b53ae3a58cba524ac10f7a76be8d76feadee9330048b9b is running failed: container process not found" containerID="1c288239519e7e76c9b53ae3a58cba524ac10f7a76be8d76feadee9330048b9b" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:28:26 crc kubenswrapper[5120]: E0316 16:28:26.841222 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 1c288239519e7e76c9b53ae3a58cba524ac10f7a76be8d76feadee9330048b9b is running failed: container process not found" containerID="1c288239519e7e76c9b53ae3a58cba524ac10f7a76be8d76feadee9330048b9b" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:28:26 crc kubenswrapper[5120]: E0316 16:28:26.841274 5120 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 1c288239519e7e76c9b53ae3a58cba524ac10f7a76be8d76feadee9330048b9b is running failed: container process not found" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="43c71024-0a80-4f26-a6de-ebc75eeed01e" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 16:28:26 crc kubenswrapper[5120]: I0316 16:28:26.976901 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:28:27 crc kubenswrapper[5120]: I0316 16:28:27.041600 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/43c71024-0a80-4f26-a6de-ebc75eeed01e-combined-ca-bundle\") pod \"43c71024-0a80-4f26-a6de-ebc75eeed01e\" (UID: \"43c71024-0a80-4f26-a6de-ebc75eeed01e\") " Mar 16 16:28:27 crc kubenswrapper[5120]: I0316 16:28:27.041707 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/43c71024-0a80-4f26-a6de-ebc75eeed01e-config-data\") pod \"43c71024-0a80-4f26-a6de-ebc75eeed01e\" (UID: \"43c71024-0a80-4f26-a6de-ebc75eeed01e\") " Mar 16 16:28:27 crc kubenswrapper[5120]: I0316 16:28:27.041846 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-765qv\" (UniqueName: \"kubernetes.io/projected/43c71024-0a80-4f26-a6de-ebc75eeed01e-kube-api-access-765qv\") pod \"43c71024-0a80-4f26-a6de-ebc75eeed01e\" (UID: \"43c71024-0a80-4f26-a6de-ebc75eeed01e\") " Mar 16 16:28:27 crc kubenswrapper[5120]: I0316 16:28:27.082161 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/43c71024-0a80-4f26-a6de-ebc75eeed01e-kube-api-access-765qv" (OuterVolumeSpecName: "kube-api-access-765qv") pod "43c71024-0a80-4f26-a6de-ebc75eeed01e" (UID: "43c71024-0a80-4f26-a6de-ebc75eeed01e"). InnerVolumeSpecName "kube-api-access-765qv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:28:27 crc kubenswrapper[5120]: I0316 16:28:27.095743 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/43c71024-0a80-4f26-a6de-ebc75eeed01e-config-data" (OuterVolumeSpecName: "config-data") pod "43c71024-0a80-4f26-a6de-ebc75eeed01e" (UID: "43c71024-0a80-4f26-a6de-ebc75eeed01e"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:28:27 crc kubenswrapper[5120]: I0316 16:28:27.131814 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/43c71024-0a80-4f26-a6de-ebc75eeed01e-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "43c71024-0a80-4f26-a6de-ebc75eeed01e" (UID: "43c71024-0a80-4f26-a6de-ebc75eeed01e"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:28:27 crc kubenswrapper[5120]: I0316 16:28:27.151549 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/43c71024-0a80-4f26-a6de-ebc75eeed01e-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:28:27 crc kubenswrapper[5120]: I0316 16:28:27.151642 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/43c71024-0a80-4f26-a6de-ebc75eeed01e-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:28:27 crc kubenswrapper[5120]: I0316 16:28:27.151659 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-765qv\" (UniqueName: \"kubernetes.io/projected/43c71024-0a80-4f26-a6de-ebc75eeed01e-kube-api-access-765qv\") on node \"crc\" DevicePath \"\"" Mar 16 16:28:27 crc kubenswrapper[5120]: I0316 16:28:27.237257 5120 generic.go:358] "Generic (PLEG): container finished" podID="43c71024-0a80-4f26-a6de-ebc75eeed01e" containerID="1c288239519e7e76c9b53ae3a58cba524ac10f7a76be8d76feadee9330048b9b" exitCode=0 Mar 16 16:28:27 crc kubenswrapper[5120]: I0316 16:28:27.237709 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"43c71024-0a80-4f26-a6de-ebc75eeed01e","Type":"ContainerDied","Data":"1c288239519e7e76c9b53ae3a58cba524ac10f7a76be8d76feadee9330048b9b"} Mar 16 16:28:27 crc kubenswrapper[5120]: I0316 16:28:27.237749 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"43c71024-0a80-4f26-a6de-ebc75eeed01e","Type":"ContainerDied","Data":"49f71d046124da568f42fec8e950787aba7ca23d684ae2b65566986d6bab6826"} Mar 16 16:28:27 crc kubenswrapper[5120]: I0316 16:28:27.237794 5120 scope.go:117] "RemoveContainer" containerID="1c288239519e7e76c9b53ae3a58cba524ac10f7a76be8d76feadee9330048b9b" Mar 16 16:28:27 crc kubenswrapper[5120]: I0316 16:28:27.237967 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:28:27 crc kubenswrapper[5120]: I0316 16:28:27.282516 5120 generic.go:358] "Generic (PLEG): container finished" podID="2c5efc2e-a677-4619-807b-c87ad3b18a61" containerID="968e94721e2f6712b0c7a025b5f8e7b05b034de9c8f06d279dac8cec39bf7142" exitCode=0 Mar 16 16:28:27 crc kubenswrapper[5120]: I0316 16:28:27.282551 5120 generic.go:358] "Generic (PLEG): container finished" podID="2c5efc2e-a677-4619-807b-c87ad3b18a61" containerID="70a38b96bf5a3f321d1f696edad4ffb6a7a48ff2330d4185e3dcb33e0ec2935c" exitCode=143 Mar 16 16:28:27 crc kubenswrapper[5120]: I0316 16:28:27.282721 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"2c5efc2e-a677-4619-807b-c87ad3b18a61","Type":"ContainerDied","Data":"968e94721e2f6712b0c7a025b5f8e7b05b034de9c8f06d279dac8cec39bf7142"} Mar 16 16:28:27 crc kubenswrapper[5120]: I0316 16:28:27.282749 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"2c5efc2e-a677-4619-807b-c87ad3b18a61","Type":"ContainerDied","Data":"70a38b96bf5a3f321d1f696edad4ffb6a7a48ff2330d4185e3dcb33e0ec2935c"} Mar 16 16:28:27 crc kubenswrapper[5120]: I0316 16:28:27.284044 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:28:27 crc kubenswrapper[5120]: I0316 16:28:27.301568 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:28:27 crc kubenswrapper[5120]: I0316 16:28:27.314145 5120 scope.go:117] "RemoveContainer" containerID="1c288239519e7e76c9b53ae3a58cba524ac10f7a76be8d76feadee9330048b9b" Mar 16 16:28:27 crc kubenswrapper[5120]: E0316 16:28:27.318199 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c288239519e7e76c9b53ae3a58cba524ac10f7a76be8d76feadee9330048b9b\": container with ID starting with 1c288239519e7e76c9b53ae3a58cba524ac10f7a76be8d76feadee9330048b9b not found: ID does not exist" containerID="1c288239519e7e76c9b53ae3a58cba524ac10f7a76be8d76feadee9330048b9b" Mar 16 16:28:27 crc kubenswrapper[5120]: I0316 16:28:27.318247 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c288239519e7e76c9b53ae3a58cba524ac10f7a76be8d76feadee9330048b9b"} err="failed to get container status \"1c288239519e7e76c9b53ae3a58cba524ac10f7a76be8d76feadee9330048b9b\": rpc error: code = NotFound desc = could not find container \"1c288239519e7e76c9b53ae3a58cba524ac10f7a76be8d76feadee9330048b9b\": container with ID starting with 1c288239519e7e76c9b53ae3a58cba524ac10f7a76be8d76feadee9330048b9b not found: ID does not exist" Mar 16 16:28:27 crc kubenswrapper[5120]: I0316 16:28:27.323528 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:28:27 crc kubenswrapper[5120]: I0316 16:28:27.324750 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43c71024-0a80-4f26-a6de-ebc75eeed01e" containerName="nova-cell0-conductor-conductor" Mar 16 16:28:27 crc kubenswrapper[5120]: I0316 16:28:27.324782 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="43c71024-0a80-4f26-a6de-ebc75eeed01e" containerName="nova-cell0-conductor-conductor" Mar 16 16:28:27 crc kubenswrapper[5120]: I0316 16:28:27.324988 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="43c71024-0a80-4f26-a6de-ebc75eeed01e" containerName="nova-cell0-conductor-conductor" Mar 16 16:28:27 crc kubenswrapper[5120]: I0316 16:28:27.341251 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:28:27 crc kubenswrapper[5120]: I0316 16:28:27.344965 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"9d0063b1-d074-4b22-a417-5ee37106b806","Type":"ContainerStarted","Data":"35d369cd727d62f5ea2286e5d0eb6c624ff32d37ff91882f097e974de6f0ec3d"} Mar 16 16:28:27 crc kubenswrapper[5120]: I0316 16:28:27.345298 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-conductor-config-data\"" Mar 16 16:28:27 crc kubenswrapper[5120]: I0316 16:28:27.346357 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:28:27 crc kubenswrapper[5120]: I0316 16:28:27.386375 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:28:27 crc kubenswrapper[5120]: I0316 16:28:27.412617 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:28:27 crc kubenswrapper[5120]: I0316 16:28:27.427280 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.00922308 podStartE2EDuration="6.42725984s" podCreationTimestamp="2026-03-16 16:28:21 +0000 UTC" firstStartedPulling="2026-03-16 16:28:22.075585368 +0000 UTC m=+3404.229517025" lastFinishedPulling="2026-03-16 16:28:26.493622138 +0000 UTC m=+3408.647553785" observedRunningTime="2026-03-16 16:28:27.424374643 +0000 UTC m=+3409.578306300" watchObservedRunningTime="2026-03-16 16:28:27.42725984 +0000 UTC m=+3409.581191497" Mar 16 16:28:27 crc kubenswrapper[5120]: I0316 16:28:27.478401 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/2c5efc2e-a677-4619-807b-c87ad3b18a61-nova-metadata-tls-certs\") pod \"2c5efc2e-a677-4619-807b-c87ad3b18a61\" (UID: \"2c5efc2e-a677-4619-807b-c87ad3b18a61\") " Mar 16 16:28:27 crc kubenswrapper[5120]: I0316 16:28:27.478478 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8pkpg\" (UniqueName: \"kubernetes.io/projected/2c5efc2e-a677-4619-807b-c87ad3b18a61-kube-api-access-8pkpg\") pod \"2c5efc2e-a677-4619-807b-c87ad3b18a61\" (UID: \"2c5efc2e-a677-4619-807b-c87ad3b18a61\") " Mar 16 16:28:27 crc kubenswrapper[5120]: I0316 16:28:27.478639 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2c5efc2e-a677-4619-807b-c87ad3b18a61-logs\") pod \"2c5efc2e-a677-4619-807b-c87ad3b18a61\" (UID: \"2c5efc2e-a677-4619-807b-c87ad3b18a61\") " Mar 16 16:28:27 crc kubenswrapper[5120]: I0316 16:28:27.478726 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2c5efc2e-a677-4619-807b-c87ad3b18a61-config-data\") pod \"2c5efc2e-a677-4619-807b-c87ad3b18a61\" (UID: \"2c5efc2e-a677-4619-807b-c87ad3b18a61\") " Mar 16 16:28:27 crc kubenswrapper[5120]: I0316 16:28:27.478899 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2c5efc2e-a677-4619-807b-c87ad3b18a61-combined-ca-bundle\") pod \"2c5efc2e-a677-4619-807b-c87ad3b18a61\" (UID: \"2c5efc2e-a677-4619-807b-c87ad3b18a61\") " Mar 16 16:28:27 crc kubenswrapper[5120]: I0316 16:28:27.479138 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7e45bb7a-9982-458f-80b5-60541c2d2daf-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"7e45bb7a-9982-458f-80b5-60541c2d2daf\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:28:27 crc kubenswrapper[5120]: I0316 16:28:27.479373 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7e45bb7a-9982-458f-80b5-60541c2d2daf-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"7e45bb7a-9982-458f-80b5-60541c2d2daf\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:28:27 crc kubenswrapper[5120]: I0316 16:28:27.479409 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4chfs\" (UniqueName: \"kubernetes.io/projected/7e45bb7a-9982-458f-80b5-60541c2d2daf-kube-api-access-4chfs\") pod \"nova-cell0-conductor-0\" (UID: \"7e45bb7a-9982-458f-80b5-60541c2d2daf\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:28:27 crc kubenswrapper[5120]: I0316 16:28:27.481107 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c5efc2e-a677-4619-807b-c87ad3b18a61-logs" (OuterVolumeSpecName: "logs") pod "2c5efc2e-a677-4619-807b-c87ad3b18a61" (UID: "2c5efc2e-a677-4619-807b-c87ad3b18a61"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:28:27 crc kubenswrapper[5120]: I0316 16:28:27.499021 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c5efc2e-a677-4619-807b-c87ad3b18a61-kube-api-access-8pkpg" (OuterVolumeSpecName: "kube-api-access-8pkpg") pod "2c5efc2e-a677-4619-807b-c87ad3b18a61" (UID: "2c5efc2e-a677-4619-807b-c87ad3b18a61"). InnerVolumeSpecName "kube-api-access-8pkpg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:28:27 crc kubenswrapper[5120]: I0316 16:28:27.525707 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2c5efc2e-a677-4619-807b-c87ad3b18a61-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "2c5efc2e-a677-4619-807b-c87ad3b18a61" (UID: "2c5efc2e-a677-4619-807b-c87ad3b18a61"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:28:27 crc kubenswrapper[5120]: I0316 16:28:27.534109 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2c5efc2e-a677-4619-807b-c87ad3b18a61-config-data" (OuterVolumeSpecName: "config-data") pod "2c5efc2e-a677-4619-807b-c87ad3b18a61" (UID: "2c5efc2e-a677-4619-807b-c87ad3b18a61"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:28:27 crc kubenswrapper[5120]: I0316 16:28:27.552309 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2c5efc2e-a677-4619-807b-c87ad3b18a61-nova-metadata-tls-certs" (OuterVolumeSpecName: "nova-metadata-tls-certs") pod "2c5efc2e-a677-4619-807b-c87ad3b18a61" (UID: "2c5efc2e-a677-4619-807b-c87ad3b18a61"). InnerVolumeSpecName "nova-metadata-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:28:27 crc kubenswrapper[5120]: I0316 16:28:27.582987 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7e45bb7a-9982-458f-80b5-60541c2d2daf-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"7e45bb7a-9982-458f-80b5-60541c2d2daf\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:28:27 crc kubenswrapper[5120]: I0316 16:28:27.584967 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7e45bb7a-9982-458f-80b5-60541c2d2daf-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"7e45bb7a-9982-458f-80b5-60541c2d2daf\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:28:27 crc kubenswrapper[5120]: I0316 16:28:27.585033 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4chfs\" (UniqueName: \"kubernetes.io/projected/7e45bb7a-9982-458f-80b5-60541c2d2daf-kube-api-access-4chfs\") pod \"nova-cell0-conductor-0\" (UID: \"7e45bb7a-9982-458f-80b5-60541c2d2daf\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:28:27 crc kubenswrapper[5120]: I0316 16:28:27.587069 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8pkpg\" (UniqueName: \"kubernetes.io/projected/2c5efc2e-a677-4619-807b-c87ad3b18a61-kube-api-access-8pkpg\") on node \"crc\" DevicePath \"\"" Mar 16 16:28:27 crc kubenswrapper[5120]: I0316 16:28:27.587106 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2c5efc2e-a677-4619-807b-c87ad3b18a61-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:28:27 crc kubenswrapper[5120]: I0316 16:28:27.587121 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2c5efc2e-a677-4619-807b-c87ad3b18a61-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:28:27 crc kubenswrapper[5120]: I0316 16:28:27.587133 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2c5efc2e-a677-4619-807b-c87ad3b18a61-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:28:27 crc kubenswrapper[5120]: I0316 16:28:27.587146 5120 reconciler_common.go:299] "Volume detached for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/2c5efc2e-a677-4619-807b-c87ad3b18a61-nova-metadata-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:28:27 crc kubenswrapper[5120]: I0316 16:28:27.593000 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7e45bb7a-9982-458f-80b5-60541c2d2daf-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"7e45bb7a-9982-458f-80b5-60541c2d2daf\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:28:27 crc kubenswrapper[5120]: I0316 16:28:27.593877 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7e45bb7a-9982-458f-80b5-60541c2d2daf-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"7e45bb7a-9982-458f-80b5-60541c2d2daf\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:28:27 crc kubenswrapper[5120]: I0316 16:28:27.608990 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4chfs\" (UniqueName: \"kubernetes.io/projected/7e45bb7a-9982-458f-80b5-60541c2d2daf-kube-api-access-4chfs\") pod \"nova-cell0-conductor-0\" (UID: \"7e45bb7a-9982-458f-80b5-60541c2d2daf\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:28:27 crc kubenswrapper[5120]: W0316 16:28:27.631894 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod562ac4c6_f1e8_4cbc_bbd7_4aad1f0d4f9a.slice/crio-b04d7e96e913a0a44253deb40a741de3f30919f94d86324357b066b246b11753 WatchSource:0}: Error finding container b04d7e96e913a0a44253deb40a741de3f30919f94d86324357b066b246b11753: Status 404 returned error can't find the container with id b04d7e96e913a0a44253deb40a741de3f30919f94d86324357b066b246b11753 Mar 16 16:28:27 crc kubenswrapper[5120]: I0316 16:28:27.635573 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:28:27 crc kubenswrapper[5120]: I0316 16:28:27.695350 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:28:27 crc kubenswrapper[5120]: I0316 16:28:27.990875 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:28:28 crc kubenswrapper[5120]: W0316 16:28:28.203789 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7e45bb7a_9982_458f_80b5_60541c2d2daf.slice/crio-399f98f8c7701af17b6e9f882036ebe8772a78ac2534d0c10eace74a16bc2d75 WatchSource:0}: Error finding container 399f98f8c7701af17b6e9f882036ebe8772a78ac2534d0c10eace74a16bc2d75: Status 404 returned error can't find the container with id 399f98f8c7701af17b6e9f882036ebe8772a78ac2534d0c10eace74a16bc2d75 Mar 16 16:28:28 crc kubenswrapper[5120]: I0316 16:28:28.214265 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:28:28 crc kubenswrapper[5120]: I0316 16:28:28.356406 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"7e45bb7a-9982-458f-80b5-60541c2d2daf","Type":"ContainerStarted","Data":"399f98f8c7701af17b6e9f882036ebe8772a78ac2534d0c10eace74a16bc2d75"} Mar 16 16:28:28 crc kubenswrapper[5120]: I0316 16:28:28.364866 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"562ac4c6-f1e8-4cbc-bbd7-4aad1f0d4f9a","Type":"ContainerStarted","Data":"c25fc08b3018d2bc168e3e2ed8ec320d75b8ec1da161ccf5453c4101491b8e34"} Mar 16 16:28:28 crc kubenswrapper[5120]: I0316 16:28:28.365018 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"562ac4c6-f1e8-4cbc-bbd7-4aad1f0d4f9a","Type":"ContainerStarted","Data":"3cdf53c63844f257c57d6d1af4543cc1082e2101a781f1c7eb5ca71d1ec9e3b7"} Mar 16 16:28:28 crc kubenswrapper[5120]: I0316 16:28:28.365101 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"562ac4c6-f1e8-4cbc-bbd7-4aad1f0d4f9a","Type":"ContainerStarted","Data":"b04d7e96e913a0a44253deb40a741de3f30919f94d86324357b066b246b11753"} Mar 16 16:28:28 crc kubenswrapper[5120]: I0316 16:28:28.368869 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"2c5efc2e-a677-4619-807b-c87ad3b18a61","Type":"ContainerDied","Data":"cde58d0e3320809a209d0e2167069059d25ba24dfa604b89f19a860b30593084"} Mar 16 16:28:28 crc kubenswrapper[5120]: I0316 16:28:28.368908 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:28:28 crc kubenswrapper[5120]: I0316 16:28:28.368923 5120 scope.go:117] "RemoveContainer" containerID="968e94721e2f6712b0c7a025b5f8e7b05b034de9c8f06d279dac8cec39bf7142" Mar 16 16:28:28 crc kubenswrapper[5120]: I0316 16:28:28.385790 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=2.385745927 podStartE2EDuration="2.385745927s" podCreationTimestamp="2026-03-16 16:28:26 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:28:28.381902204 +0000 UTC m=+3410.535833861" watchObservedRunningTime="2026-03-16 16:28:28.385745927 +0000 UTC m=+3410.539677584" Mar 16 16:28:28 crc kubenswrapper[5120]: I0316 16:28:28.420362 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:28:28 crc kubenswrapper[5120]: I0316 16:28:28.455838 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:28:28 crc kubenswrapper[5120]: I0316 16:28:28.465097 5120 scope.go:117] "RemoveContainer" containerID="70a38b96bf5a3f321d1f696edad4ffb6a7a48ff2330d4185e3dcb33e0ec2935c" Mar 16 16:28:28 crc kubenswrapper[5120]: I0316 16:28:28.468858 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:28:28 crc kubenswrapper[5120]: I0316 16:28:28.519277 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:28:28 crc kubenswrapper[5120]: I0316 16:28:28.520468 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c5efc2e-a677-4619-807b-c87ad3b18a61" containerName="nova-metadata-metadata" Mar 16 16:28:28 crc kubenswrapper[5120]: I0316 16:28:28.520557 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c5efc2e-a677-4619-807b-c87ad3b18a61" containerName="nova-metadata-metadata" Mar 16 16:28:28 crc kubenswrapper[5120]: I0316 16:28:28.520649 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c5efc2e-a677-4619-807b-c87ad3b18a61" containerName="nova-metadata-log" Mar 16 16:28:28 crc kubenswrapper[5120]: I0316 16:28:28.520713 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c5efc2e-a677-4619-807b-c87ad3b18a61" containerName="nova-metadata-log" Mar 16 16:28:28 crc kubenswrapper[5120]: I0316 16:28:28.521008 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="2c5efc2e-a677-4619-807b-c87ad3b18a61" containerName="nova-metadata-log" Mar 16 16:28:28 crc kubenswrapper[5120]: I0316 16:28:28.521083 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="2c5efc2e-a677-4619-807b-c87ad3b18a61" containerName="nova-metadata-metadata" Mar 16 16:28:28 crc kubenswrapper[5120]: I0316 16:28:28.528135 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:28:28 crc kubenswrapper[5120]: I0316 16:28:28.532027 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-metadata-internal-svc\"" Mar 16 16:28:28 crc kubenswrapper[5120]: I0316 16:28:28.533361 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-metadata-config-data\"" Mar 16 16:28:28 crc kubenswrapper[5120]: I0316 16:28:28.572865 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:28:28 crc kubenswrapper[5120]: I0316 16:28:28.611007 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fab257f8-7bbb-4b5a-9ed5-3b0c1c79d8f2-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"fab257f8-7bbb-4b5a-9ed5-3b0c1c79d8f2\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:28:28 crc kubenswrapper[5120]: I0316 16:28:28.611158 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fab257f8-7bbb-4b5a-9ed5-3b0c1c79d8f2-config-data\") pod \"nova-metadata-0\" (UID: \"fab257f8-7bbb-4b5a-9ed5-3b0c1c79d8f2\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:28:28 crc kubenswrapper[5120]: I0316 16:28:28.611230 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/fab257f8-7bbb-4b5a-9ed5-3b0c1c79d8f2-logs\") pod \"nova-metadata-0\" (UID: \"fab257f8-7bbb-4b5a-9ed5-3b0c1c79d8f2\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:28:28 crc kubenswrapper[5120]: I0316 16:28:28.611370 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5knb\" (UniqueName: \"kubernetes.io/projected/fab257f8-7bbb-4b5a-9ed5-3b0c1c79d8f2-kube-api-access-t5knb\") pod \"nova-metadata-0\" (UID: \"fab257f8-7bbb-4b5a-9ed5-3b0c1c79d8f2\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:28:28 crc kubenswrapper[5120]: I0316 16:28:28.611559 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/fab257f8-7bbb-4b5a-9ed5-3b0c1c79d8f2-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"fab257f8-7bbb-4b5a-9ed5-3b0c1c79d8f2\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:28:28 crc kubenswrapper[5120]: I0316 16:28:28.677909 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2c5efc2e-a677-4619-807b-c87ad3b18a61" path="/var/lib/kubelet/pods/2c5efc2e-a677-4619-807b-c87ad3b18a61/volumes" Mar 16 16:28:28 crc kubenswrapper[5120]: I0316 16:28:28.683599 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="43c71024-0a80-4f26-a6de-ebc75eeed01e" path="/var/lib/kubelet/pods/43c71024-0a80-4f26-a6de-ebc75eeed01e/volumes" Mar 16 16:28:28 crc kubenswrapper[5120]: I0316 16:28:28.713917 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/fab257f8-7bbb-4b5a-9ed5-3b0c1c79d8f2-logs\") pod \"nova-metadata-0\" (UID: \"fab257f8-7bbb-4b5a-9ed5-3b0c1c79d8f2\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:28:28 crc kubenswrapper[5120]: I0316 16:28:28.714026 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t5knb\" (UniqueName: \"kubernetes.io/projected/fab257f8-7bbb-4b5a-9ed5-3b0c1c79d8f2-kube-api-access-t5knb\") pod \"nova-metadata-0\" (UID: \"fab257f8-7bbb-4b5a-9ed5-3b0c1c79d8f2\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:28:28 crc kubenswrapper[5120]: I0316 16:28:28.714239 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/fab257f8-7bbb-4b5a-9ed5-3b0c1c79d8f2-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"fab257f8-7bbb-4b5a-9ed5-3b0c1c79d8f2\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:28:28 crc kubenswrapper[5120]: I0316 16:28:28.714373 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fab257f8-7bbb-4b5a-9ed5-3b0c1c79d8f2-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"fab257f8-7bbb-4b5a-9ed5-3b0c1c79d8f2\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:28:28 crc kubenswrapper[5120]: I0316 16:28:28.714394 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/fab257f8-7bbb-4b5a-9ed5-3b0c1c79d8f2-logs\") pod \"nova-metadata-0\" (UID: \"fab257f8-7bbb-4b5a-9ed5-3b0c1c79d8f2\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:28:28 crc kubenswrapper[5120]: I0316 16:28:28.714606 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fab257f8-7bbb-4b5a-9ed5-3b0c1c79d8f2-config-data\") pod \"nova-metadata-0\" (UID: \"fab257f8-7bbb-4b5a-9ed5-3b0c1c79d8f2\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:28:28 crc kubenswrapper[5120]: I0316 16:28:28.721515 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/fab257f8-7bbb-4b5a-9ed5-3b0c1c79d8f2-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"fab257f8-7bbb-4b5a-9ed5-3b0c1c79d8f2\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:28:28 crc kubenswrapper[5120]: I0316 16:28:28.721515 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fab257f8-7bbb-4b5a-9ed5-3b0c1c79d8f2-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"fab257f8-7bbb-4b5a-9ed5-3b0c1c79d8f2\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:28:28 crc kubenswrapper[5120]: I0316 16:28:28.726940 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fab257f8-7bbb-4b5a-9ed5-3b0c1c79d8f2-config-data\") pod \"nova-metadata-0\" (UID: \"fab257f8-7bbb-4b5a-9ed5-3b0c1c79d8f2\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:28:28 crc kubenswrapper[5120]: I0316 16:28:28.732198 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5knb\" (UniqueName: \"kubernetes.io/projected/fab257f8-7bbb-4b5a-9ed5-3b0c1c79d8f2-kube-api-access-t5knb\") pod \"nova-metadata-0\" (UID: \"fab257f8-7bbb-4b5a-9ed5-3b0c1c79d8f2\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:28:28 crc kubenswrapper[5120]: I0316 16:28:28.860151 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:28:29 crc kubenswrapper[5120]: I0316 16:28:29.368639 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:28:29 crc kubenswrapper[5120]: I0316 16:28:29.385547 5120 generic.go:358] "Generic (PLEG): container finished" podID="4f828b4b-4ee0-44ac-b3ec-d1dfa524bbf8" containerID="59f322a3d7236277d6645148c7840ef488c15805a0793f6d2d317c8f8f20ebcc" exitCode=0 Mar 16 16:28:29 crc kubenswrapper[5120]: I0316 16:28:29.385799 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-bnzrd" event={"ID":"4f828b4b-4ee0-44ac-b3ec-d1dfa524bbf8","Type":"ContainerDied","Data":"59f322a3d7236277d6645148c7840ef488c15805a0793f6d2d317c8f8f20ebcc"} Mar 16 16:28:29 crc kubenswrapper[5120]: I0316 16:28:29.396274 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="9d0063b1-d074-4b22-a417-5ee37106b806" containerName="ceilometer-central-agent" containerID="cri-o://3fe4879c12400824d8fb81e983504e34c750e90051ef9376399cb67cadc09487" gracePeriod=30 Mar 16 16:28:29 crc kubenswrapper[5120]: I0316 16:28:29.397242 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"7e45bb7a-9982-458f-80b5-60541c2d2daf","Type":"ContainerStarted","Data":"1c7b11899133931bd406f6c19c7e46ecd6ae5021b5ed32c51931ad65ff554972"} Mar 16 16:28:29 crc kubenswrapper[5120]: I0316 16:28:29.397271 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:28:29 crc kubenswrapper[5120]: I0316 16:28:29.397706 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="9d0063b1-d074-4b22-a417-5ee37106b806" containerName="proxy-httpd" containerID="cri-o://35d369cd727d62f5ea2286e5d0eb6c624ff32d37ff91882f097e974de6f0ec3d" gracePeriod=30 Mar 16 16:28:29 crc kubenswrapper[5120]: I0316 16:28:29.397775 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="9d0063b1-d074-4b22-a417-5ee37106b806" containerName="sg-core" containerID="cri-o://851cd14018b883bd0f742e1e2c418a796039a93013c8ac37618f4183f9df031e" gracePeriod=30 Mar 16 16:28:29 crc kubenswrapper[5120]: I0316 16:28:29.397810 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="9d0063b1-d074-4b22-a417-5ee37106b806" containerName="ceilometer-notification-agent" containerID="cri-o://f466ef11f3c839380e987e10bf6c892187b564a973d3536a09943b4a32848e4b" gracePeriod=30 Mar 16 16:28:29 crc kubenswrapper[5120]: I0316 16:28:29.420094 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podStartSLOduration=2.420075912 podStartE2EDuration="2.420075912s" podCreationTimestamp="2026-03-16 16:28:27 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:28:29.413170717 +0000 UTC m=+3411.567102374" watchObservedRunningTime="2026-03-16 16:28:29.420075912 +0000 UTC m=+3411.574007569" Mar 16 16:28:29 crc kubenswrapper[5120]: I0316 16:28:29.734718 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:28:30 crc kubenswrapper[5120]: I0316 16:28:30.444545 5120 generic.go:358] "Generic (PLEG): container finished" podID="9d0063b1-d074-4b22-a417-5ee37106b806" containerID="35d369cd727d62f5ea2286e5d0eb6c624ff32d37ff91882f097e974de6f0ec3d" exitCode=0 Mar 16 16:28:30 crc kubenswrapper[5120]: I0316 16:28:30.444604 5120 generic.go:358] "Generic (PLEG): container finished" podID="9d0063b1-d074-4b22-a417-5ee37106b806" containerID="851cd14018b883bd0f742e1e2c418a796039a93013c8ac37618f4183f9df031e" exitCode=2 Mar 16 16:28:30 crc kubenswrapper[5120]: I0316 16:28:30.444619 5120 generic.go:358] "Generic (PLEG): container finished" podID="9d0063b1-d074-4b22-a417-5ee37106b806" containerID="f466ef11f3c839380e987e10bf6c892187b564a973d3536a09943b4a32848e4b" exitCode=0 Mar 16 16:28:30 crc kubenswrapper[5120]: I0316 16:28:30.444620 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"9d0063b1-d074-4b22-a417-5ee37106b806","Type":"ContainerDied","Data":"35d369cd727d62f5ea2286e5d0eb6c624ff32d37ff91882f097e974de6f0ec3d"} Mar 16 16:28:30 crc kubenswrapper[5120]: I0316 16:28:30.444676 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"9d0063b1-d074-4b22-a417-5ee37106b806","Type":"ContainerDied","Data":"851cd14018b883bd0f742e1e2c418a796039a93013c8ac37618f4183f9df031e"} Mar 16 16:28:30 crc kubenswrapper[5120]: I0316 16:28:30.444692 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"9d0063b1-d074-4b22-a417-5ee37106b806","Type":"ContainerDied","Data":"f466ef11f3c839380e987e10bf6c892187b564a973d3536a09943b4a32848e4b"} Mar 16 16:28:30 crc kubenswrapper[5120]: I0316 16:28:30.449972 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"fab257f8-7bbb-4b5a-9ed5-3b0c1c79d8f2","Type":"ContainerStarted","Data":"3f9931eec3aedf8af846669694317b66e3f17284c57b893df9edb8a2a180c58c"} Mar 16 16:28:30 crc kubenswrapper[5120]: I0316 16:28:30.450012 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"fab257f8-7bbb-4b5a-9ed5-3b0c1c79d8f2","Type":"ContainerStarted","Data":"aaddd0cc9478c5e9ca8ad5d299de956a83ef7e9dd7c41afd191c55da9a39ade4"} Mar 16 16:28:30 crc kubenswrapper[5120]: I0316 16:28:30.450027 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"fab257f8-7bbb-4b5a-9ed5-3b0c1c79d8f2","Type":"ContainerStarted","Data":"e65b5490000b7dad17b0e5f901f8bfbae52e9e48e5b721db937876776c58f6cc"} Mar 16 16:28:30 crc kubenswrapper[5120]: I0316 16:28:30.502329 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=2.5023068090000002 podStartE2EDuration="2.502306809s" podCreationTimestamp="2026-03-16 16:28:28 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:28:30.488373616 +0000 UTC m=+3412.642305313" watchObservedRunningTime="2026-03-16 16:28:30.502306809 +0000 UTC m=+3412.656238476" Mar 16 16:28:30 crc kubenswrapper[5120]: I0316 16:28:30.918458 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-bnzrd" Mar 16 16:28:31 crc kubenswrapper[5120]: I0316 16:28:31.079909 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4f828b4b-4ee0-44ac-b3ec-d1dfa524bbf8-combined-ca-bundle\") pod \"4f828b4b-4ee0-44ac-b3ec-d1dfa524bbf8\" (UID: \"4f828b4b-4ee0-44ac-b3ec-d1dfa524bbf8\") " Mar 16 16:28:31 crc kubenswrapper[5120]: I0316 16:28:31.080094 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8xxnf\" (UniqueName: \"kubernetes.io/projected/4f828b4b-4ee0-44ac-b3ec-d1dfa524bbf8-kube-api-access-8xxnf\") pod \"4f828b4b-4ee0-44ac-b3ec-d1dfa524bbf8\" (UID: \"4f828b4b-4ee0-44ac-b3ec-d1dfa524bbf8\") " Mar 16 16:28:31 crc kubenswrapper[5120]: I0316 16:28:31.080509 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4f828b4b-4ee0-44ac-b3ec-d1dfa524bbf8-scripts\") pod \"4f828b4b-4ee0-44ac-b3ec-d1dfa524bbf8\" (UID: \"4f828b4b-4ee0-44ac-b3ec-d1dfa524bbf8\") " Mar 16 16:28:31 crc kubenswrapper[5120]: I0316 16:28:31.081003 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4f828b4b-4ee0-44ac-b3ec-d1dfa524bbf8-config-data\") pod \"4f828b4b-4ee0-44ac-b3ec-d1dfa524bbf8\" (UID: \"4f828b4b-4ee0-44ac-b3ec-d1dfa524bbf8\") " Mar 16 16:28:31 crc kubenswrapper[5120]: I0316 16:28:31.087144 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4f828b4b-4ee0-44ac-b3ec-d1dfa524bbf8-scripts" (OuterVolumeSpecName: "scripts") pod "4f828b4b-4ee0-44ac-b3ec-d1dfa524bbf8" (UID: "4f828b4b-4ee0-44ac-b3ec-d1dfa524bbf8"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:28:31 crc kubenswrapper[5120]: I0316 16:28:31.093095 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f828b4b-4ee0-44ac-b3ec-d1dfa524bbf8-kube-api-access-8xxnf" (OuterVolumeSpecName: "kube-api-access-8xxnf") pod "4f828b4b-4ee0-44ac-b3ec-d1dfa524bbf8" (UID: "4f828b4b-4ee0-44ac-b3ec-d1dfa524bbf8"). InnerVolumeSpecName "kube-api-access-8xxnf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:28:31 crc kubenswrapper[5120]: I0316 16:28:31.119871 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4f828b4b-4ee0-44ac-b3ec-d1dfa524bbf8-config-data" (OuterVolumeSpecName: "config-data") pod "4f828b4b-4ee0-44ac-b3ec-d1dfa524bbf8" (UID: "4f828b4b-4ee0-44ac-b3ec-d1dfa524bbf8"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:28:31 crc kubenswrapper[5120]: I0316 16:28:31.127017 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4f828b4b-4ee0-44ac-b3ec-d1dfa524bbf8-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "4f828b4b-4ee0-44ac-b3ec-d1dfa524bbf8" (UID: "4f828b4b-4ee0-44ac-b3ec-d1dfa524bbf8"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:28:31 crc kubenswrapper[5120]: I0316 16:28:31.184191 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4f828b4b-4ee0-44ac-b3ec-d1dfa524bbf8-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:28:31 crc kubenswrapper[5120]: I0316 16:28:31.184240 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8xxnf\" (UniqueName: \"kubernetes.io/projected/4f828b4b-4ee0-44ac-b3ec-d1dfa524bbf8-kube-api-access-8xxnf\") on node \"crc\" DevicePath \"\"" Mar 16 16:28:31 crc kubenswrapper[5120]: I0316 16:28:31.184255 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4f828b4b-4ee0-44ac-b3ec-d1dfa524bbf8-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:28:31 crc kubenswrapper[5120]: I0316 16:28:31.184264 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4f828b4b-4ee0-44ac-b3ec-d1dfa524bbf8-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:28:31 crc kubenswrapper[5120]: I0316 16:28:31.463177 5120 generic.go:358] "Generic (PLEG): container finished" podID="5756d219-d2ba-42b8-a02d-c0681c069fca" containerID="93108a3a5b17fa5c9d5dbb5f8b46764d9de5f49f992564654c8edef477a51664" exitCode=0 Mar 16 16:28:31 crc kubenswrapper[5120]: I0316 16:28:31.463270 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-42r2f" event={"ID":"5756d219-d2ba-42b8-a02d-c0681c069fca","Type":"ContainerDied","Data":"93108a3a5b17fa5c9d5dbb5f8b46764d9de5f49f992564654c8edef477a51664"} Mar 16 16:28:31 crc kubenswrapper[5120]: I0316 16:28:31.465860 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-bnzrd" Mar 16 16:28:31 crc kubenswrapper[5120]: I0316 16:28:31.465903 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-bnzrd" event={"ID":"4f828b4b-4ee0-44ac-b3ec-d1dfa524bbf8","Type":"ContainerDied","Data":"70a180ac2256b4ba5dd8f00c578a0bec6dd38f998cf608a1ea5f35c3ecf406fb"} Mar 16 16:28:31 crc kubenswrapper[5120]: I0316 16:28:31.465938 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="70a180ac2256b4ba5dd8f00c578a0bec6dd38f998cf608a1ea5f35c3ecf406fb" Mar 16 16:28:32 crc kubenswrapper[5120]: I0316 16:28:32.865374 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-42r2f" Mar 16 16:28:32 crc kubenswrapper[5120]: I0316 16:28:32.925322 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2zt4z\" (UniqueName: \"kubernetes.io/projected/5756d219-d2ba-42b8-a02d-c0681c069fca-kube-api-access-2zt4z\") pod \"5756d219-d2ba-42b8-a02d-c0681c069fca\" (UID: \"5756d219-d2ba-42b8-a02d-c0681c069fca\") " Mar 16 16:28:32 crc kubenswrapper[5120]: I0316 16:28:32.925546 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5756d219-d2ba-42b8-a02d-c0681c069fca-combined-ca-bundle\") pod \"5756d219-d2ba-42b8-a02d-c0681c069fca\" (UID: \"5756d219-d2ba-42b8-a02d-c0681c069fca\") " Mar 16 16:28:32 crc kubenswrapper[5120]: I0316 16:28:32.926080 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5756d219-d2ba-42b8-a02d-c0681c069fca-config-data\") pod \"5756d219-d2ba-42b8-a02d-c0681c069fca\" (UID: \"5756d219-d2ba-42b8-a02d-c0681c069fca\") " Mar 16 16:28:32 crc kubenswrapper[5120]: I0316 16:28:32.926169 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5756d219-d2ba-42b8-a02d-c0681c069fca-scripts\") pod \"5756d219-d2ba-42b8-a02d-c0681c069fca\" (UID: \"5756d219-d2ba-42b8-a02d-c0681c069fca\") " Mar 16 16:28:32 crc kubenswrapper[5120]: I0316 16:28:32.932420 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5756d219-d2ba-42b8-a02d-c0681c069fca-scripts" (OuterVolumeSpecName: "scripts") pod "5756d219-d2ba-42b8-a02d-c0681c069fca" (UID: "5756d219-d2ba-42b8-a02d-c0681c069fca"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:28:32 crc kubenswrapper[5120]: I0316 16:28:32.937942 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5756d219-d2ba-42b8-a02d-c0681c069fca-kube-api-access-2zt4z" (OuterVolumeSpecName: "kube-api-access-2zt4z") pod "5756d219-d2ba-42b8-a02d-c0681c069fca" (UID: "5756d219-d2ba-42b8-a02d-c0681c069fca"). InnerVolumeSpecName "kube-api-access-2zt4z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:28:32 crc kubenswrapper[5120]: I0316 16:28:32.967598 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5756d219-d2ba-42b8-a02d-c0681c069fca-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "5756d219-d2ba-42b8-a02d-c0681c069fca" (UID: "5756d219-d2ba-42b8-a02d-c0681c069fca"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:28:32 crc kubenswrapper[5120]: I0316 16:28:32.975835 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5756d219-d2ba-42b8-a02d-c0681c069fca-config-data" (OuterVolumeSpecName: "config-data") pod "5756d219-d2ba-42b8-a02d-c0681c069fca" (UID: "5756d219-d2ba-42b8-a02d-c0681c069fca"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:28:33 crc kubenswrapper[5120]: I0316 16:28:33.028938 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5756d219-d2ba-42b8-a02d-c0681c069fca-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:28:33 crc kubenswrapper[5120]: I0316 16:28:33.028972 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5756d219-d2ba-42b8-a02d-c0681c069fca-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:28:33 crc kubenswrapper[5120]: I0316 16:28:33.028983 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2zt4z\" (UniqueName: \"kubernetes.io/projected/5756d219-d2ba-42b8-a02d-c0681c069fca-kube-api-access-2zt4z\") on node \"crc\" DevicePath \"\"" Mar 16 16:28:33 crc kubenswrapper[5120]: I0316 16:28:33.028993 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5756d219-d2ba-42b8-a02d-c0681c069fca-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:28:33 crc kubenswrapper[5120]: I0316 16:28:33.490488 5120 generic.go:358] "Generic (PLEG): container finished" podID="9d0063b1-d074-4b22-a417-5ee37106b806" containerID="3fe4879c12400824d8fb81e983504e34c750e90051ef9376399cb67cadc09487" exitCode=0 Mar 16 16:28:33 crc kubenswrapper[5120]: I0316 16:28:33.490563 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"9d0063b1-d074-4b22-a417-5ee37106b806","Type":"ContainerDied","Data":"3fe4879c12400824d8fb81e983504e34c750e90051ef9376399cb67cadc09487"} Mar 16 16:28:33 crc kubenswrapper[5120]: I0316 16:28:33.493106 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-42r2f" Mar 16 16:28:33 crc kubenswrapper[5120]: I0316 16:28:33.493131 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-42r2f" event={"ID":"5756d219-d2ba-42b8-a02d-c0681c069fca","Type":"ContainerDied","Data":"a507d35e16a6c6da8383a4d07fe0651c5d26d7cc68d3a10c9644f671a04be44b"} Mar 16 16:28:33 crc kubenswrapper[5120]: I0316 16:28:33.493175 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a507d35e16a6c6da8383a4d07fe0651c5d26d7cc68d3a10c9644f671a04be44b" Mar 16 16:28:33 crc kubenswrapper[5120]: I0316 16:28:33.577831 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 16:28:33 crc kubenswrapper[5120]: I0316 16:28:33.579253 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f828b4b-4ee0-44ac-b3ec-d1dfa524bbf8" containerName="nova-manage" Mar 16 16:28:33 crc kubenswrapper[5120]: I0316 16:28:33.579279 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f828b4b-4ee0-44ac-b3ec-d1dfa524bbf8" containerName="nova-manage" Mar 16 16:28:33 crc kubenswrapper[5120]: I0316 16:28:33.579291 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5756d219-d2ba-42b8-a02d-c0681c069fca" containerName="nova-cell1-conductor-db-sync" Mar 16 16:28:33 crc kubenswrapper[5120]: I0316 16:28:33.579298 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="5756d219-d2ba-42b8-a02d-c0681c069fca" containerName="nova-cell1-conductor-db-sync" Mar 16 16:28:33 crc kubenswrapper[5120]: I0316 16:28:33.579538 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="5756d219-d2ba-42b8-a02d-c0681c069fca" containerName="nova-cell1-conductor-db-sync" Mar 16 16:28:33 crc kubenswrapper[5120]: I0316 16:28:33.579612 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="4f828b4b-4ee0-44ac-b3ec-d1dfa524bbf8" containerName="nova-manage" Mar 16 16:28:33 crc kubenswrapper[5120]: I0316 16:28:33.593367 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 16:28:33 crc kubenswrapper[5120]: I0316 16:28:33.593510 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:28:33 crc kubenswrapper[5120]: I0316 16:28:33.600100 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-conductor-config-data\"" Mar 16 16:28:33 crc kubenswrapper[5120]: I0316 16:28:33.646123 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7c3819a8-dcaf-4026-87c2-5f6419c379a9-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"7c3819a8-dcaf-4026-87c2-5f6419c379a9\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:28:33 crc kubenswrapper[5120]: I0316 16:28:33.646222 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7c3819a8-dcaf-4026-87c2-5f6419c379a9-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"7c3819a8-dcaf-4026-87c2-5f6419c379a9\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:28:33 crc kubenswrapper[5120]: I0316 16:28:33.646394 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9f9w\" (UniqueName: \"kubernetes.io/projected/7c3819a8-dcaf-4026-87c2-5f6419c379a9-kube-api-access-q9f9w\") pod \"nova-cell1-conductor-0\" (UID: \"7c3819a8-dcaf-4026-87c2-5f6419c379a9\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:28:33 crc kubenswrapper[5120]: I0316 16:28:33.730187 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:28:33 crc kubenswrapper[5120]: I0316 16:28:33.749669 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9d0063b1-d074-4b22-a417-5ee37106b806-combined-ca-bundle\") pod \"9d0063b1-d074-4b22-a417-5ee37106b806\" (UID: \"9d0063b1-d074-4b22-a417-5ee37106b806\") " Mar 16 16:28:33 crc kubenswrapper[5120]: I0316 16:28:33.749868 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cnt9b\" (UniqueName: \"kubernetes.io/projected/9d0063b1-d074-4b22-a417-5ee37106b806-kube-api-access-cnt9b\") pod \"9d0063b1-d074-4b22-a417-5ee37106b806\" (UID: \"9d0063b1-d074-4b22-a417-5ee37106b806\") " Mar 16 16:28:33 crc kubenswrapper[5120]: I0316 16:28:33.750067 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/9d0063b1-d074-4b22-a417-5ee37106b806-log-httpd\") pod \"9d0063b1-d074-4b22-a417-5ee37106b806\" (UID: \"9d0063b1-d074-4b22-a417-5ee37106b806\") " Mar 16 16:28:33 crc kubenswrapper[5120]: I0316 16:28:33.750109 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/9d0063b1-d074-4b22-a417-5ee37106b806-run-httpd\") pod \"9d0063b1-d074-4b22-a417-5ee37106b806\" (UID: \"9d0063b1-d074-4b22-a417-5ee37106b806\") " Mar 16 16:28:33 crc kubenswrapper[5120]: I0316 16:28:33.750191 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/9d0063b1-d074-4b22-a417-5ee37106b806-sg-core-conf-yaml\") pod \"9d0063b1-d074-4b22-a417-5ee37106b806\" (UID: \"9d0063b1-d074-4b22-a417-5ee37106b806\") " Mar 16 16:28:33 crc kubenswrapper[5120]: I0316 16:28:33.750442 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9d0063b1-d074-4b22-a417-5ee37106b806-scripts\") pod \"9d0063b1-d074-4b22-a417-5ee37106b806\" (UID: \"9d0063b1-d074-4b22-a417-5ee37106b806\") " Mar 16 16:28:33 crc kubenswrapper[5120]: I0316 16:28:33.750500 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9d0063b1-d074-4b22-a417-5ee37106b806-config-data\") pod \"9d0063b1-d074-4b22-a417-5ee37106b806\" (UID: \"9d0063b1-d074-4b22-a417-5ee37106b806\") " Mar 16 16:28:33 crc kubenswrapper[5120]: I0316 16:28:33.751222 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7c3819a8-dcaf-4026-87c2-5f6419c379a9-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"7c3819a8-dcaf-4026-87c2-5f6419c379a9\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:28:33 crc kubenswrapper[5120]: I0316 16:28:33.751299 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7c3819a8-dcaf-4026-87c2-5f6419c379a9-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"7c3819a8-dcaf-4026-87c2-5f6419c379a9\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:28:33 crc kubenswrapper[5120]: I0316 16:28:33.751470 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q9f9w\" (UniqueName: \"kubernetes.io/projected/7c3819a8-dcaf-4026-87c2-5f6419c379a9-kube-api-access-q9f9w\") pod \"nova-cell1-conductor-0\" (UID: \"7c3819a8-dcaf-4026-87c2-5f6419c379a9\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:28:33 crc kubenswrapper[5120]: I0316 16:28:33.755123 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d0063b1-d074-4b22-a417-5ee37106b806-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "9d0063b1-d074-4b22-a417-5ee37106b806" (UID: "9d0063b1-d074-4b22-a417-5ee37106b806"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:28:33 crc kubenswrapper[5120]: I0316 16:28:33.755513 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d0063b1-d074-4b22-a417-5ee37106b806-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "9d0063b1-d074-4b22-a417-5ee37106b806" (UID: "9d0063b1-d074-4b22-a417-5ee37106b806"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:28:33 crc kubenswrapper[5120]: I0316 16:28:33.769013 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9d0063b1-d074-4b22-a417-5ee37106b806-scripts" (OuterVolumeSpecName: "scripts") pod "9d0063b1-d074-4b22-a417-5ee37106b806" (UID: "9d0063b1-d074-4b22-a417-5ee37106b806"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:28:33 crc kubenswrapper[5120]: I0316 16:28:33.770180 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7c3819a8-dcaf-4026-87c2-5f6419c379a9-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"7c3819a8-dcaf-4026-87c2-5f6419c379a9\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:28:33 crc kubenswrapper[5120]: I0316 16:28:33.774641 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d0063b1-d074-4b22-a417-5ee37106b806-kube-api-access-cnt9b" (OuterVolumeSpecName: "kube-api-access-cnt9b") pod "9d0063b1-d074-4b22-a417-5ee37106b806" (UID: "9d0063b1-d074-4b22-a417-5ee37106b806"). InnerVolumeSpecName "kube-api-access-cnt9b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:28:33 crc kubenswrapper[5120]: I0316 16:28:33.782211 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9f9w\" (UniqueName: \"kubernetes.io/projected/7c3819a8-dcaf-4026-87c2-5f6419c379a9-kube-api-access-q9f9w\") pod \"nova-cell1-conductor-0\" (UID: \"7c3819a8-dcaf-4026-87c2-5f6419c379a9\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:28:33 crc kubenswrapper[5120]: I0316 16:28:33.782502 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7c3819a8-dcaf-4026-87c2-5f6419c379a9-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"7c3819a8-dcaf-4026-87c2-5f6419c379a9\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:28:33 crc kubenswrapper[5120]: I0316 16:28:33.792417 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9d0063b1-d074-4b22-a417-5ee37106b806-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "9d0063b1-d074-4b22-a417-5ee37106b806" (UID: "9d0063b1-d074-4b22-a417-5ee37106b806"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:28:33 crc kubenswrapper[5120]: I0316 16:28:33.844066 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9d0063b1-d074-4b22-a417-5ee37106b806-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "9d0063b1-d074-4b22-a417-5ee37106b806" (UID: "9d0063b1-d074-4b22-a417-5ee37106b806"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:28:33 crc kubenswrapper[5120]: I0316 16:28:33.853849 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9d0063b1-d074-4b22-a417-5ee37106b806-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:28:33 crc kubenswrapper[5120]: I0316 16:28:33.853890 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cnt9b\" (UniqueName: \"kubernetes.io/projected/9d0063b1-d074-4b22-a417-5ee37106b806-kube-api-access-cnt9b\") on node \"crc\" DevicePath \"\"" Mar 16 16:28:33 crc kubenswrapper[5120]: I0316 16:28:33.853905 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/9d0063b1-d074-4b22-a417-5ee37106b806-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:28:33 crc kubenswrapper[5120]: I0316 16:28:33.853916 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/9d0063b1-d074-4b22-a417-5ee37106b806-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:28:33 crc kubenswrapper[5120]: I0316 16:28:33.853927 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/9d0063b1-d074-4b22-a417-5ee37106b806-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 16:28:33 crc kubenswrapper[5120]: I0316 16:28:33.853936 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9d0063b1-d074-4b22-a417-5ee37106b806-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:28:33 crc kubenswrapper[5120]: I0316 16:28:33.882162 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9d0063b1-d074-4b22-a417-5ee37106b806-config-data" (OuterVolumeSpecName: "config-data") pod "9d0063b1-d074-4b22-a417-5ee37106b806" (UID: "9d0063b1-d074-4b22-a417-5ee37106b806"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:28:33 crc kubenswrapper[5120]: I0316 16:28:33.919086 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:28:33 crc kubenswrapper[5120]: I0316 16:28:33.956931 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9d0063b1-d074-4b22-a417-5ee37106b806-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:28:34 crc kubenswrapper[5120]: I0316 16:28:34.373238 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 16:28:34 crc kubenswrapper[5120]: W0316 16:28:34.374935 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7c3819a8_dcaf_4026_87c2_5f6419c379a9.slice/crio-a7a4969a1059e0b323096eb4c2f7e14cce1f8f2f2b935f84314dccd6f730b882 WatchSource:0}: Error finding container a7a4969a1059e0b323096eb4c2f7e14cce1f8f2f2b935f84314dccd6f730b882: Status 404 returned error can't find the container with id a7a4969a1059e0b323096eb4c2f7e14cce1f8f2f2b935f84314dccd6f730b882 Mar 16 16:28:34 crc kubenswrapper[5120]: I0316 16:28:34.531910 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"7c3819a8-dcaf-4026-87c2-5f6419c379a9","Type":"ContainerStarted","Data":"a7a4969a1059e0b323096eb4c2f7e14cce1f8f2f2b935f84314dccd6f730b882"} Mar 16 16:28:34 crc kubenswrapper[5120]: I0316 16:28:34.536019 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"9d0063b1-d074-4b22-a417-5ee37106b806","Type":"ContainerDied","Data":"39e0d58d1c0a906c221f31add7b4c3b6bcb5066df7651a89f42d088cc776fb2d"} Mar 16 16:28:34 crc kubenswrapper[5120]: I0316 16:28:34.536084 5120 scope.go:117] "RemoveContainer" containerID="35d369cd727d62f5ea2286e5d0eb6c624ff32d37ff91882f097e974de6f0ec3d" Mar 16 16:28:34 crc kubenswrapper[5120]: I0316 16:28:34.536104 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:28:34 crc kubenswrapper[5120]: I0316 16:28:34.575383 5120 scope.go:117] "RemoveContainer" containerID="851cd14018b883bd0f742e1e2c418a796039a93013c8ac37618f4183f9df031e" Mar 16 16:28:34 crc kubenswrapper[5120]: I0316 16:28:34.590682 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:28:34 crc kubenswrapper[5120]: I0316 16:28:34.604181 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:28:34 crc kubenswrapper[5120]: I0316 16:28:34.610295 5120 scope.go:117] "RemoveContainer" containerID="f466ef11f3c839380e987e10bf6c892187b564a973d3536a09943b4a32848e4b" Mar 16 16:28:34 crc kubenswrapper[5120]: I0316 16:28:34.613058 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:28:34 crc kubenswrapper[5120]: I0316 16:28:34.614505 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d0063b1-d074-4b22-a417-5ee37106b806" containerName="proxy-httpd" Mar 16 16:28:34 crc kubenswrapper[5120]: I0316 16:28:34.614528 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d0063b1-d074-4b22-a417-5ee37106b806" containerName="proxy-httpd" Mar 16 16:28:34 crc kubenswrapper[5120]: I0316 16:28:34.614546 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d0063b1-d074-4b22-a417-5ee37106b806" containerName="ceilometer-notification-agent" Mar 16 16:28:34 crc kubenswrapper[5120]: I0316 16:28:34.614553 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d0063b1-d074-4b22-a417-5ee37106b806" containerName="ceilometer-notification-agent" Mar 16 16:28:34 crc kubenswrapper[5120]: I0316 16:28:34.614610 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d0063b1-d074-4b22-a417-5ee37106b806" containerName="sg-core" Mar 16 16:28:34 crc kubenswrapper[5120]: I0316 16:28:34.614616 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d0063b1-d074-4b22-a417-5ee37106b806" containerName="sg-core" Mar 16 16:28:34 crc kubenswrapper[5120]: I0316 16:28:34.614633 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d0063b1-d074-4b22-a417-5ee37106b806" containerName="ceilometer-central-agent" Mar 16 16:28:34 crc kubenswrapper[5120]: I0316 16:28:34.614639 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d0063b1-d074-4b22-a417-5ee37106b806" containerName="ceilometer-central-agent" Mar 16 16:28:34 crc kubenswrapper[5120]: I0316 16:28:34.614845 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="9d0063b1-d074-4b22-a417-5ee37106b806" containerName="sg-core" Mar 16 16:28:34 crc kubenswrapper[5120]: I0316 16:28:34.614862 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="9d0063b1-d074-4b22-a417-5ee37106b806" containerName="ceilometer-central-agent" Mar 16 16:28:34 crc kubenswrapper[5120]: I0316 16:28:34.614878 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="9d0063b1-d074-4b22-a417-5ee37106b806" containerName="ceilometer-notification-agent" Mar 16 16:28:34 crc kubenswrapper[5120]: I0316 16:28:34.614891 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="9d0063b1-d074-4b22-a417-5ee37106b806" containerName="proxy-httpd" Mar 16 16:28:34 crc kubenswrapper[5120]: I0316 16:28:34.631518 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:28:34 crc kubenswrapper[5120]: I0316 16:28:34.631689 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:28:34 crc kubenswrapper[5120]: I0316 16:28:34.637656 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 16:28:34 crc kubenswrapper[5120]: I0316 16:28:34.638186 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 16:28:34 crc kubenswrapper[5120]: I0316 16:28:34.673926 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/cbea120d-f042-4865-b9ee-99fdd90eac9f-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"cbea120d-f042-4865-b9ee-99fdd90eac9f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:28:34 crc kubenswrapper[5120]: I0316 16:28:34.674291 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxzb9\" (UniqueName: \"kubernetes.io/projected/cbea120d-f042-4865-b9ee-99fdd90eac9f-kube-api-access-jxzb9\") pod \"ceilometer-0\" (UID: \"cbea120d-f042-4865-b9ee-99fdd90eac9f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:28:34 crc kubenswrapper[5120]: I0316 16:28:34.674517 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/cbea120d-f042-4865-b9ee-99fdd90eac9f-scripts\") pod \"ceilometer-0\" (UID: \"cbea120d-f042-4865-b9ee-99fdd90eac9f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:28:34 crc kubenswrapper[5120]: I0316 16:28:34.674748 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/cbea120d-f042-4865-b9ee-99fdd90eac9f-run-httpd\") pod \"ceilometer-0\" (UID: \"cbea120d-f042-4865-b9ee-99fdd90eac9f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:28:34 crc kubenswrapper[5120]: I0316 16:28:34.674880 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cbea120d-f042-4865-b9ee-99fdd90eac9f-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"cbea120d-f042-4865-b9ee-99fdd90eac9f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:28:34 crc kubenswrapper[5120]: I0316 16:28:34.676406 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/cbea120d-f042-4865-b9ee-99fdd90eac9f-log-httpd\") pod \"ceilometer-0\" (UID: \"cbea120d-f042-4865-b9ee-99fdd90eac9f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:28:34 crc kubenswrapper[5120]: I0316 16:28:34.676578 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cbea120d-f042-4865-b9ee-99fdd90eac9f-config-data\") pod \"ceilometer-0\" (UID: \"cbea120d-f042-4865-b9ee-99fdd90eac9f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:28:34 crc kubenswrapper[5120]: I0316 16:28:34.681337 5120 scope.go:117] "RemoveContainer" containerID="3fe4879c12400824d8fb81e983504e34c750e90051ef9376399cb67cadc09487" Mar 16 16:28:34 crc kubenswrapper[5120]: I0316 16:28:34.682600 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9d0063b1-d074-4b22-a417-5ee37106b806" path="/var/lib/kubelet/pods/9d0063b1-d074-4b22-a417-5ee37106b806/volumes" Mar 16 16:28:34 crc kubenswrapper[5120]: I0316 16:28:34.778438 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/cbea120d-f042-4865-b9ee-99fdd90eac9f-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"cbea120d-f042-4865-b9ee-99fdd90eac9f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:28:34 crc kubenswrapper[5120]: I0316 16:28:34.778847 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jxzb9\" (UniqueName: \"kubernetes.io/projected/cbea120d-f042-4865-b9ee-99fdd90eac9f-kube-api-access-jxzb9\") pod \"ceilometer-0\" (UID: \"cbea120d-f042-4865-b9ee-99fdd90eac9f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:28:34 crc kubenswrapper[5120]: I0316 16:28:34.778950 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/cbea120d-f042-4865-b9ee-99fdd90eac9f-scripts\") pod \"ceilometer-0\" (UID: \"cbea120d-f042-4865-b9ee-99fdd90eac9f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:28:34 crc kubenswrapper[5120]: I0316 16:28:34.778984 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/cbea120d-f042-4865-b9ee-99fdd90eac9f-run-httpd\") pod \"ceilometer-0\" (UID: \"cbea120d-f042-4865-b9ee-99fdd90eac9f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:28:34 crc kubenswrapper[5120]: I0316 16:28:34.779002 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cbea120d-f042-4865-b9ee-99fdd90eac9f-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"cbea120d-f042-4865-b9ee-99fdd90eac9f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:28:34 crc kubenswrapper[5120]: I0316 16:28:34.779091 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/cbea120d-f042-4865-b9ee-99fdd90eac9f-log-httpd\") pod \"ceilometer-0\" (UID: \"cbea120d-f042-4865-b9ee-99fdd90eac9f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:28:34 crc kubenswrapper[5120]: I0316 16:28:34.779116 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cbea120d-f042-4865-b9ee-99fdd90eac9f-config-data\") pod \"ceilometer-0\" (UID: \"cbea120d-f042-4865-b9ee-99fdd90eac9f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:28:34 crc kubenswrapper[5120]: I0316 16:28:34.779594 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/cbea120d-f042-4865-b9ee-99fdd90eac9f-run-httpd\") pod \"ceilometer-0\" (UID: \"cbea120d-f042-4865-b9ee-99fdd90eac9f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:28:34 crc kubenswrapper[5120]: I0316 16:28:34.780337 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/cbea120d-f042-4865-b9ee-99fdd90eac9f-log-httpd\") pod \"ceilometer-0\" (UID: \"cbea120d-f042-4865-b9ee-99fdd90eac9f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:28:34 crc kubenswrapper[5120]: I0316 16:28:34.783263 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/cbea120d-f042-4865-b9ee-99fdd90eac9f-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"cbea120d-f042-4865-b9ee-99fdd90eac9f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:28:34 crc kubenswrapper[5120]: I0316 16:28:34.783306 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cbea120d-f042-4865-b9ee-99fdd90eac9f-config-data\") pod \"ceilometer-0\" (UID: \"cbea120d-f042-4865-b9ee-99fdd90eac9f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:28:34 crc kubenswrapper[5120]: I0316 16:28:34.784349 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/cbea120d-f042-4865-b9ee-99fdd90eac9f-scripts\") pod \"ceilometer-0\" (UID: \"cbea120d-f042-4865-b9ee-99fdd90eac9f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:28:34 crc kubenswrapper[5120]: I0316 16:28:34.784577 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cbea120d-f042-4865-b9ee-99fdd90eac9f-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"cbea120d-f042-4865-b9ee-99fdd90eac9f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:28:34 crc kubenswrapper[5120]: I0316 16:28:34.797563 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxzb9\" (UniqueName: \"kubernetes.io/projected/cbea120d-f042-4865-b9ee-99fdd90eac9f-kube-api-access-jxzb9\") pod \"ceilometer-0\" (UID: \"cbea120d-f042-4865-b9ee-99fdd90eac9f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:28:34 crc kubenswrapper[5120]: I0316 16:28:34.951074 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:28:35 crc kubenswrapper[5120]: I0316 16:28:35.483925 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:28:35 crc kubenswrapper[5120]: W0316 16:28:35.489802 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcbea120d_f042_4865_b9ee_99fdd90eac9f.slice/crio-374caaa5d25ae533dda7415399db2d81a04d53081b95b6f0fae6009f7bfe0917 WatchSource:0}: Error finding container 374caaa5d25ae533dda7415399db2d81a04d53081b95b6f0fae6009f7bfe0917: Status 404 returned error can't find the container with id 374caaa5d25ae533dda7415399db2d81a04d53081b95b6f0fae6009f7bfe0917 Mar 16 16:28:35 crc kubenswrapper[5120]: I0316 16:28:35.498094 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:28:35 crc kubenswrapper[5120]: I0316 16:28:35.552621 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"7c3819a8-dcaf-4026-87c2-5f6419c379a9","Type":"ContainerStarted","Data":"b48efa78dedc3f4e6339fe4bb5d889d3c5e126ba2b9c6bd274d193ebe220d8d9"} Mar 16 16:28:35 crc kubenswrapper[5120]: I0316 16:28:35.553239 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:28:35 crc kubenswrapper[5120]: I0316 16:28:35.556048 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"cbea120d-f042-4865-b9ee-99fdd90eac9f","Type":"ContainerStarted","Data":"374caaa5d25ae533dda7415399db2d81a04d53081b95b6f0fae6009f7bfe0917"} Mar 16 16:28:35 crc kubenswrapper[5120]: I0316 16:28:35.577704 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podStartSLOduration=2.577682171 podStartE2EDuration="2.577682171s" podCreationTimestamp="2026-03-16 16:28:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:28:35.574102866 +0000 UTC m=+3417.728034523" watchObservedRunningTime="2026-03-16 16:28:35.577682171 +0000 UTC m=+3417.731613828" Mar 16 16:28:36 crc kubenswrapper[5120]: I0316 16:28:36.072208 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:28:36 crc kubenswrapper[5120]: I0316 16:28:36.076298 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="562ac4c6-f1e8-4cbc-bbd7-4aad1f0d4f9a" containerName="nova-api-log" containerID="cri-o://3cdf53c63844f257c57d6d1af4543cc1082e2101a781f1c7eb5ca71d1ec9e3b7" gracePeriod=30 Mar 16 16:28:36 crc kubenswrapper[5120]: I0316 16:28:36.076407 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="562ac4c6-f1e8-4cbc-bbd7-4aad1f0d4f9a" containerName="nova-api-api" containerID="cri-o://c25fc08b3018d2bc168e3e2ed8ec320d75b8ec1da161ccf5453c4101491b8e34" gracePeriod=30 Mar 16 16:28:36 crc kubenswrapper[5120]: I0316 16:28:36.158847 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:28:36 crc kubenswrapper[5120]: I0316 16:28:36.159840 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="fab257f8-7bbb-4b5a-9ed5-3b0c1c79d8f2" containerName="nova-metadata-log" containerID="cri-o://aaddd0cc9478c5e9ca8ad5d299de956a83ef7e9dd7c41afd191c55da9a39ade4" gracePeriod=30 Mar 16 16:28:36 crc kubenswrapper[5120]: I0316 16:28:36.160019 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="fab257f8-7bbb-4b5a-9ed5-3b0c1c79d8f2" containerName="nova-metadata-metadata" containerID="cri-o://3f9931eec3aedf8af846669694317b66e3f17284c57b893df9edb8a2a180c58c" gracePeriod=30 Mar 16 16:28:36 crc kubenswrapper[5120]: E0316 16:28:36.362062 5120 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod562ac4c6_f1e8_4cbc_bbd7_4aad1f0d4f9a.slice/crio-conmon-3cdf53c63844f257c57d6d1af4543cc1082e2101a781f1c7eb5ca71d1ec9e3b7.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfab257f8_7bbb_4b5a_9ed5_3b0c1c79d8f2.slice/crio-conmon-aaddd0cc9478c5e9ca8ad5d299de956a83ef7e9dd7c41afd191c55da9a39ade4.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod562ac4c6_f1e8_4cbc_bbd7_4aad1f0d4f9a.slice/crio-3cdf53c63844f257c57d6d1af4543cc1082e2101a781f1c7eb5ca71d1ec9e3b7.scope\": RecentStats: unable to find data in memory cache]" Mar 16 16:28:36 crc kubenswrapper[5120]: I0316 16:28:36.576788 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"cbea120d-f042-4865-b9ee-99fdd90eac9f","Type":"ContainerStarted","Data":"e7447c12a77855e08a7c6509353d29f19a1a02ab402d93177bba6026dd48d33d"} Mar 16 16:28:36 crc kubenswrapper[5120]: I0316 16:28:36.580166 5120 generic.go:358] "Generic (PLEG): container finished" podID="fab257f8-7bbb-4b5a-9ed5-3b0c1c79d8f2" containerID="3f9931eec3aedf8af846669694317b66e3f17284c57b893df9edb8a2a180c58c" exitCode=0 Mar 16 16:28:36 crc kubenswrapper[5120]: I0316 16:28:36.580202 5120 generic.go:358] "Generic (PLEG): container finished" podID="fab257f8-7bbb-4b5a-9ed5-3b0c1c79d8f2" containerID="aaddd0cc9478c5e9ca8ad5d299de956a83ef7e9dd7c41afd191c55da9a39ade4" exitCode=143 Mar 16 16:28:36 crc kubenswrapper[5120]: I0316 16:28:36.580212 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"fab257f8-7bbb-4b5a-9ed5-3b0c1c79d8f2","Type":"ContainerDied","Data":"3f9931eec3aedf8af846669694317b66e3f17284c57b893df9edb8a2a180c58c"} Mar 16 16:28:36 crc kubenswrapper[5120]: I0316 16:28:36.580272 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"fab257f8-7bbb-4b5a-9ed5-3b0c1c79d8f2","Type":"ContainerDied","Data":"aaddd0cc9478c5e9ca8ad5d299de956a83ef7e9dd7c41afd191c55da9a39ade4"} Mar 16 16:28:36 crc kubenswrapper[5120]: I0316 16:28:36.582735 5120 generic.go:358] "Generic (PLEG): container finished" podID="562ac4c6-f1e8-4cbc-bbd7-4aad1f0d4f9a" containerID="c25fc08b3018d2bc168e3e2ed8ec320d75b8ec1da161ccf5453c4101491b8e34" exitCode=0 Mar 16 16:28:36 crc kubenswrapper[5120]: I0316 16:28:36.582776 5120 generic.go:358] "Generic (PLEG): container finished" podID="562ac4c6-f1e8-4cbc-bbd7-4aad1f0d4f9a" containerID="3cdf53c63844f257c57d6d1af4543cc1082e2101a781f1c7eb5ca71d1ec9e3b7" exitCode=143 Mar 16 16:28:36 crc kubenswrapper[5120]: I0316 16:28:36.582896 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"562ac4c6-f1e8-4cbc-bbd7-4aad1f0d4f9a","Type":"ContainerDied","Data":"c25fc08b3018d2bc168e3e2ed8ec320d75b8ec1da161ccf5453c4101491b8e34"} Mar 16 16:28:36 crc kubenswrapper[5120]: I0316 16:28:36.582973 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"562ac4c6-f1e8-4cbc-bbd7-4aad1f0d4f9a","Type":"ContainerDied","Data":"3cdf53c63844f257c57d6d1af4543cc1082e2101a781f1c7eb5ca71d1ec9e3b7"} Mar 16 16:28:36 crc kubenswrapper[5120]: I0316 16:28:36.770870 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:28:36 crc kubenswrapper[5120]: I0316 16:28:36.824810 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:28:36 crc kubenswrapper[5120]: I0316 16:28:36.871198 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t5knb\" (UniqueName: \"kubernetes.io/projected/fab257f8-7bbb-4b5a-9ed5-3b0c1c79d8f2-kube-api-access-t5knb\") pod \"fab257f8-7bbb-4b5a-9ed5-3b0c1c79d8f2\" (UID: \"fab257f8-7bbb-4b5a-9ed5-3b0c1c79d8f2\") " Mar 16 16:28:36 crc kubenswrapper[5120]: I0316 16:28:36.871599 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fab257f8-7bbb-4b5a-9ed5-3b0c1c79d8f2-config-data\") pod \"fab257f8-7bbb-4b5a-9ed5-3b0c1c79d8f2\" (UID: \"fab257f8-7bbb-4b5a-9ed5-3b0c1c79d8f2\") " Mar 16 16:28:36 crc kubenswrapper[5120]: I0316 16:28:36.871738 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/fab257f8-7bbb-4b5a-9ed5-3b0c1c79d8f2-logs\") pod \"fab257f8-7bbb-4b5a-9ed5-3b0c1c79d8f2\" (UID: \"fab257f8-7bbb-4b5a-9ed5-3b0c1c79d8f2\") " Mar 16 16:28:36 crc kubenswrapper[5120]: I0316 16:28:36.872117 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fab257f8-7bbb-4b5a-9ed5-3b0c1c79d8f2-logs" (OuterVolumeSpecName: "logs") pod "fab257f8-7bbb-4b5a-9ed5-3b0c1c79d8f2" (UID: "fab257f8-7bbb-4b5a-9ed5-3b0c1c79d8f2"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:28:36 crc kubenswrapper[5120]: I0316 16:28:36.875286 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fab257f8-7bbb-4b5a-9ed5-3b0c1c79d8f2-kube-api-access-t5knb" (OuterVolumeSpecName: "kube-api-access-t5knb") pod "fab257f8-7bbb-4b5a-9ed5-3b0c1c79d8f2" (UID: "fab257f8-7bbb-4b5a-9ed5-3b0c1c79d8f2"). InnerVolumeSpecName "kube-api-access-t5knb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:28:36 crc kubenswrapper[5120]: I0316 16:28:36.875438 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fab257f8-7bbb-4b5a-9ed5-3b0c1c79d8f2-combined-ca-bundle\") pod \"fab257f8-7bbb-4b5a-9ed5-3b0c1c79d8f2\" (UID: \"fab257f8-7bbb-4b5a-9ed5-3b0c1c79d8f2\") " Mar 16 16:28:36 crc kubenswrapper[5120]: I0316 16:28:36.875663 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/fab257f8-7bbb-4b5a-9ed5-3b0c1c79d8f2-nova-metadata-tls-certs\") pod \"fab257f8-7bbb-4b5a-9ed5-3b0c1c79d8f2\" (UID: \"fab257f8-7bbb-4b5a-9ed5-3b0c1c79d8f2\") " Mar 16 16:28:36 crc kubenswrapper[5120]: I0316 16:28:36.877612 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t5knb\" (UniqueName: \"kubernetes.io/projected/fab257f8-7bbb-4b5a-9ed5-3b0c1c79d8f2-kube-api-access-t5knb\") on node \"crc\" DevicePath \"\"" Mar 16 16:28:36 crc kubenswrapper[5120]: I0316 16:28:36.877743 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/fab257f8-7bbb-4b5a-9ed5-3b0c1c79d8f2-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:28:36 crc kubenswrapper[5120]: I0316 16:28:36.942071 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fab257f8-7bbb-4b5a-9ed5-3b0c1c79d8f2-config-data" (OuterVolumeSpecName: "config-data") pod "fab257f8-7bbb-4b5a-9ed5-3b0c1c79d8f2" (UID: "fab257f8-7bbb-4b5a-9ed5-3b0c1c79d8f2"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:28:36 crc kubenswrapper[5120]: I0316 16:28:36.948956 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fab257f8-7bbb-4b5a-9ed5-3b0c1c79d8f2-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "fab257f8-7bbb-4b5a-9ed5-3b0c1c79d8f2" (UID: "fab257f8-7bbb-4b5a-9ed5-3b0c1c79d8f2"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:28:36 crc kubenswrapper[5120]: I0316 16:28:36.952246 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fab257f8-7bbb-4b5a-9ed5-3b0c1c79d8f2-nova-metadata-tls-certs" (OuterVolumeSpecName: "nova-metadata-tls-certs") pod "fab257f8-7bbb-4b5a-9ed5-3b0c1c79d8f2" (UID: "fab257f8-7bbb-4b5a-9ed5-3b0c1c79d8f2"). InnerVolumeSpecName "nova-metadata-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:28:36 crc kubenswrapper[5120]: I0316 16:28:36.979695 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/562ac4c6-f1e8-4cbc-bbd7-4aad1f0d4f9a-config-data\") pod \"562ac4c6-f1e8-4cbc-bbd7-4aad1f0d4f9a\" (UID: \"562ac4c6-f1e8-4cbc-bbd7-4aad1f0d4f9a\") " Mar 16 16:28:36 crc kubenswrapper[5120]: I0316 16:28:36.979812 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xvqqd\" (UniqueName: \"kubernetes.io/projected/562ac4c6-f1e8-4cbc-bbd7-4aad1f0d4f9a-kube-api-access-xvqqd\") pod \"562ac4c6-f1e8-4cbc-bbd7-4aad1f0d4f9a\" (UID: \"562ac4c6-f1e8-4cbc-bbd7-4aad1f0d4f9a\") " Mar 16 16:28:36 crc kubenswrapper[5120]: I0316 16:28:36.979929 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/562ac4c6-f1e8-4cbc-bbd7-4aad1f0d4f9a-combined-ca-bundle\") pod \"562ac4c6-f1e8-4cbc-bbd7-4aad1f0d4f9a\" (UID: \"562ac4c6-f1e8-4cbc-bbd7-4aad1f0d4f9a\") " Mar 16 16:28:36 crc kubenswrapper[5120]: I0316 16:28:36.980327 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/562ac4c6-f1e8-4cbc-bbd7-4aad1f0d4f9a-logs\") pod \"562ac4c6-f1e8-4cbc-bbd7-4aad1f0d4f9a\" (UID: \"562ac4c6-f1e8-4cbc-bbd7-4aad1f0d4f9a\") " Mar 16 16:28:36 crc kubenswrapper[5120]: I0316 16:28:36.981353 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fab257f8-7bbb-4b5a-9ed5-3b0c1c79d8f2-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:28:36 crc kubenswrapper[5120]: I0316 16:28:36.981379 5120 reconciler_common.go:299] "Volume detached for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/fab257f8-7bbb-4b5a-9ed5-3b0c1c79d8f2-nova-metadata-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:28:36 crc kubenswrapper[5120]: I0316 16:28:36.981391 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fab257f8-7bbb-4b5a-9ed5-3b0c1c79d8f2-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:28:36 crc kubenswrapper[5120]: I0316 16:28:36.981962 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/562ac4c6-f1e8-4cbc-bbd7-4aad1f0d4f9a-logs" (OuterVolumeSpecName: "logs") pod "562ac4c6-f1e8-4cbc-bbd7-4aad1f0d4f9a" (UID: "562ac4c6-f1e8-4cbc-bbd7-4aad1f0d4f9a"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:28:36 crc kubenswrapper[5120]: I0316 16:28:36.986002 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/562ac4c6-f1e8-4cbc-bbd7-4aad1f0d4f9a-kube-api-access-xvqqd" (OuterVolumeSpecName: "kube-api-access-xvqqd") pod "562ac4c6-f1e8-4cbc-bbd7-4aad1f0d4f9a" (UID: "562ac4c6-f1e8-4cbc-bbd7-4aad1f0d4f9a"). InnerVolumeSpecName "kube-api-access-xvqqd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:28:37 crc kubenswrapper[5120]: I0316 16:28:37.019141 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/562ac4c6-f1e8-4cbc-bbd7-4aad1f0d4f9a-config-data" (OuterVolumeSpecName: "config-data") pod "562ac4c6-f1e8-4cbc-bbd7-4aad1f0d4f9a" (UID: "562ac4c6-f1e8-4cbc-bbd7-4aad1f0d4f9a"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:28:37 crc kubenswrapper[5120]: I0316 16:28:37.034872 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/562ac4c6-f1e8-4cbc-bbd7-4aad1f0d4f9a-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "562ac4c6-f1e8-4cbc-bbd7-4aad1f0d4f9a" (UID: "562ac4c6-f1e8-4cbc-bbd7-4aad1f0d4f9a"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:28:37 crc kubenswrapper[5120]: I0316 16:28:37.083154 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/562ac4c6-f1e8-4cbc-bbd7-4aad1f0d4f9a-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:28:37 crc kubenswrapper[5120]: I0316 16:28:37.083194 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xvqqd\" (UniqueName: \"kubernetes.io/projected/562ac4c6-f1e8-4cbc-bbd7-4aad1f0d4f9a-kube-api-access-xvqqd\") on node \"crc\" DevicePath \"\"" Mar 16 16:28:37 crc kubenswrapper[5120]: I0316 16:28:37.083207 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/562ac4c6-f1e8-4cbc-bbd7-4aad1f0d4f9a-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:28:37 crc kubenswrapper[5120]: I0316 16:28:37.083216 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/562ac4c6-f1e8-4cbc-bbd7-4aad1f0d4f9a-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:28:37 crc kubenswrapper[5120]: I0316 16:28:37.596161 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:28:37 crc kubenswrapper[5120]: I0316 16:28:37.596169 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"fab257f8-7bbb-4b5a-9ed5-3b0c1c79d8f2","Type":"ContainerDied","Data":"e65b5490000b7dad17b0e5f901f8bfbae52e9e48e5b721db937876776c58f6cc"} Mar 16 16:28:37 crc kubenswrapper[5120]: I0316 16:28:37.596580 5120 scope.go:117] "RemoveContainer" containerID="3f9931eec3aedf8af846669694317b66e3f17284c57b893df9edb8a2a180c58c" Mar 16 16:28:37 crc kubenswrapper[5120]: I0316 16:28:37.600225 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"562ac4c6-f1e8-4cbc-bbd7-4aad1f0d4f9a","Type":"ContainerDied","Data":"b04d7e96e913a0a44253deb40a741de3f30919f94d86324357b066b246b11753"} Mar 16 16:28:37 crc kubenswrapper[5120]: I0316 16:28:37.600374 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:28:37 crc kubenswrapper[5120]: I0316 16:28:37.604733 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"cbea120d-f042-4865-b9ee-99fdd90eac9f","Type":"ContainerStarted","Data":"01172870e91626ffd852c4fe4da6c0fea0d09cbb096d4d5ae8471ddded640a29"} Mar 16 16:28:37 crc kubenswrapper[5120]: I0316 16:28:37.634297 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:28:37 crc kubenswrapper[5120]: I0316 16:28:37.637160 5120 scope.go:117] "RemoveContainer" containerID="aaddd0cc9478c5e9ca8ad5d299de956a83ef7e9dd7c41afd191c55da9a39ade4" Mar 16 16:28:37 crc kubenswrapper[5120]: I0316 16:28:37.647463 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:28:37 crc kubenswrapper[5120]: I0316 16:28:37.662351 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:28:37 crc kubenswrapper[5120]: I0316 16:28:37.679559 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:28:37 crc kubenswrapper[5120]: I0316 16:28:37.685437 5120 scope.go:117] "RemoveContainer" containerID="c25fc08b3018d2bc168e3e2ed8ec320d75b8ec1da161ccf5453c4101491b8e34" Mar 16 16:28:37 crc kubenswrapper[5120]: I0316 16:28:37.694538 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:28:37 crc kubenswrapper[5120]: I0316 16:28:37.713141 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fab257f8-7bbb-4b5a-9ed5-3b0c1c79d8f2" containerName="nova-metadata-metadata" Mar 16 16:28:37 crc kubenswrapper[5120]: I0316 16:28:37.713179 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="fab257f8-7bbb-4b5a-9ed5-3b0c1c79d8f2" containerName="nova-metadata-metadata" Mar 16 16:28:37 crc kubenswrapper[5120]: I0316 16:28:37.713235 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="562ac4c6-f1e8-4cbc-bbd7-4aad1f0d4f9a" containerName="nova-api-api" Mar 16 16:28:37 crc kubenswrapper[5120]: I0316 16:28:37.713245 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="562ac4c6-f1e8-4cbc-bbd7-4aad1f0d4f9a" containerName="nova-api-api" Mar 16 16:28:37 crc kubenswrapper[5120]: I0316 16:28:37.713324 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="562ac4c6-f1e8-4cbc-bbd7-4aad1f0d4f9a" containerName="nova-api-log" Mar 16 16:28:37 crc kubenswrapper[5120]: I0316 16:28:37.713332 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="562ac4c6-f1e8-4cbc-bbd7-4aad1f0d4f9a" containerName="nova-api-log" Mar 16 16:28:37 crc kubenswrapper[5120]: I0316 16:28:37.713360 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fab257f8-7bbb-4b5a-9ed5-3b0c1c79d8f2" containerName="nova-metadata-log" Mar 16 16:28:37 crc kubenswrapper[5120]: I0316 16:28:37.713369 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="fab257f8-7bbb-4b5a-9ed5-3b0c1c79d8f2" containerName="nova-metadata-log" Mar 16 16:28:37 crc kubenswrapper[5120]: I0316 16:28:37.713723 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="562ac4c6-f1e8-4cbc-bbd7-4aad1f0d4f9a" containerName="nova-api-api" Mar 16 16:28:37 crc kubenswrapper[5120]: I0316 16:28:37.713747 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="fab257f8-7bbb-4b5a-9ed5-3b0c1c79d8f2" containerName="nova-metadata-log" Mar 16 16:28:37 crc kubenswrapper[5120]: I0316 16:28:37.713779 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="fab257f8-7bbb-4b5a-9ed5-3b0c1c79d8f2" containerName="nova-metadata-metadata" Mar 16 16:28:37 crc kubenswrapper[5120]: I0316 16:28:37.713806 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="562ac4c6-f1e8-4cbc-bbd7-4aad1f0d4f9a" containerName="nova-api-log" Mar 16 16:28:37 crc kubenswrapper[5120]: I0316 16:28:37.723038 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:28:37 crc kubenswrapper[5120]: I0316 16:28:37.726000 5120 scope.go:117] "RemoveContainer" containerID="3cdf53c63844f257c57d6d1af4543cc1082e2101a781f1c7eb5ca71d1ec9e3b7" Mar 16 16:28:37 crc kubenswrapper[5120]: I0316 16:28:37.726340 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:28:37 crc kubenswrapper[5120]: I0316 16:28:37.733713 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-metadata-config-data\"" Mar 16 16:28:37 crc kubenswrapper[5120]: I0316 16:28:37.733880 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-metadata-internal-svc\"" Mar 16 16:28:37 crc kubenswrapper[5120]: I0316 16:28:37.736242 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:28:37 crc kubenswrapper[5120]: I0316 16:28:37.738341 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-config-data\"" Mar 16 16:28:37 crc kubenswrapper[5120]: I0316 16:28:37.738521 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:28:37 crc kubenswrapper[5120]: I0316 16:28:37.747782 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:28:37 crc kubenswrapper[5120]: I0316 16:28:37.907623 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvjbt\" (UniqueName: \"kubernetes.io/projected/87bada63-5741-4527-90a7-e56a4a3318fa-kube-api-access-tvjbt\") pod \"nova-metadata-0\" (UID: \"87bada63-5741-4527-90a7-e56a4a3318fa\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:28:37 crc kubenswrapper[5120]: I0316 16:28:37.907710 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a18dff22-11a9-4408-b3a8-03c411b4a2b5-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"a18dff22-11a9-4408-b3a8-03c411b4a2b5\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:28:37 crc kubenswrapper[5120]: I0316 16:28:37.908003 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a18dff22-11a9-4408-b3a8-03c411b4a2b5-config-data\") pod \"nova-api-0\" (UID: \"a18dff22-11a9-4408-b3a8-03c411b4a2b5\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:28:37 crc kubenswrapper[5120]: I0316 16:28:37.908050 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/87bada63-5741-4527-90a7-e56a4a3318fa-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"87bada63-5741-4527-90a7-e56a4a3318fa\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:28:37 crc kubenswrapper[5120]: I0316 16:28:37.908185 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a18dff22-11a9-4408-b3a8-03c411b4a2b5-logs\") pod \"nova-api-0\" (UID: \"a18dff22-11a9-4408-b3a8-03c411b4a2b5\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:28:37 crc kubenswrapper[5120]: I0316 16:28:37.908308 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/87bada63-5741-4527-90a7-e56a4a3318fa-config-data\") pod \"nova-metadata-0\" (UID: \"87bada63-5741-4527-90a7-e56a4a3318fa\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:28:37 crc kubenswrapper[5120]: I0316 16:28:37.908471 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/87bada63-5741-4527-90a7-e56a4a3318fa-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"87bada63-5741-4527-90a7-e56a4a3318fa\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:28:37 crc kubenswrapper[5120]: I0316 16:28:37.908562 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/87bada63-5741-4527-90a7-e56a4a3318fa-logs\") pod \"nova-metadata-0\" (UID: \"87bada63-5741-4527-90a7-e56a4a3318fa\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:28:37 crc kubenswrapper[5120]: I0316 16:28:37.908636 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28kj6\" (UniqueName: \"kubernetes.io/projected/a18dff22-11a9-4408-b3a8-03c411b4a2b5-kube-api-access-28kj6\") pod \"nova-api-0\" (UID: \"a18dff22-11a9-4408-b3a8-03c411b4a2b5\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:28:38 crc kubenswrapper[5120]: I0316 16:28:38.011788 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a18dff22-11a9-4408-b3a8-03c411b4a2b5-config-data\") pod \"nova-api-0\" (UID: \"a18dff22-11a9-4408-b3a8-03c411b4a2b5\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:28:38 crc kubenswrapper[5120]: I0316 16:28:38.011861 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/87bada63-5741-4527-90a7-e56a4a3318fa-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"87bada63-5741-4527-90a7-e56a4a3318fa\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:28:38 crc kubenswrapper[5120]: I0316 16:28:38.011919 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a18dff22-11a9-4408-b3a8-03c411b4a2b5-logs\") pod \"nova-api-0\" (UID: \"a18dff22-11a9-4408-b3a8-03c411b4a2b5\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:28:38 crc kubenswrapper[5120]: I0316 16:28:38.011975 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/87bada63-5741-4527-90a7-e56a4a3318fa-config-data\") pod \"nova-metadata-0\" (UID: \"87bada63-5741-4527-90a7-e56a4a3318fa\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:28:38 crc kubenswrapper[5120]: I0316 16:28:38.012029 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/87bada63-5741-4527-90a7-e56a4a3318fa-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"87bada63-5741-4527-90a7-e56a4a3318fa\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:28:38 crc kubenswrapper[5120]: I0316 16:28:38.012072 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/87bada63-5741-4527-90a7-e56a4a3318fa-logs\") pod \"nova-metadata-0\" (UID: \"87bada63-5741-4527-90a7-e56a4a3318fa\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:28:38 crc kubenswrapper[5120]: I0316 16:28:38.012108 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-28kj6\" (UniqueName: \"kubernetes.io/projected/a18dff22-11a9-4408-b3a8-03c411b4a2b5-kube-api-access-28kj6\") pod \"nova-api-0\" (UID: \"a18dff22-11a9-4408-b3a8-03c411b4a2b5\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:28:38 crc kubenswrapper[5120]: I0316 16:28:38.012201 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tvjbt\" (UniqueName: \"kubernetes.io/projected/87bada63-5741-4527-90a7-e56a4a3318fa-kube-api-access-tvjbt\") pod \"nova-metadata-0\" (UID: \"87bada63-5741-4527-90a7-e56a4a3318fa\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:28:38 crc kubenswrapper[5120]: I0316 16:28:38.012284 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a18dff22-11a9-4408-b3a8-03c411b4a2b5-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"a18dff22-11a9-4408-b3a8-03c411b4a2b5\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:28:38 crc kubenswrapper[5120]: I0316 16:28:38.013478 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a18dff22-11a9-4408-b3a8-03c411b4a2b5-logs\") pod \"nova-api-0\" (UID: \"a18dff22-11a9-4408-b3a8-03c411b4a2b5\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:28:38 crc kubenswrapper[5120]: I0316 16:28:38.013849 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/87bada63-5741-4527-90a7-e56a4a3318fa-logs\") pod \"nova-metadata-0\" (UID: \"87bada63-5741-4527-90a7-e56a4a3318fa\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:28:38 crc kubenswrapper[5120]: I0316 16:28:38.021416 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/87bada63-5741-4527-90a7-e56a4a3318fa-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"87bada63-5741-4527-90a7-e56a4a3318fa\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:28:38 crc kubenswrapper[5120]: I0316 16:28:38.021515 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a18dff22-11a9-4408-b3a8-03c411b4a2b5-config-data\") pod \"nova-api-0\" (UID: \"a18dff22-11a9-4408-b3a8-03c411b4a2b5\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:28:38 crc kubenswrapper[5120]: I0316 16:28:38.021549 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a18dff22-11a9-4408-b3a8-03c411b4a2b5-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"a18dff22-11a9-4408-b3a8-03c411b4a2b5\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:28:38 crc kubenswrapper[5120]: I0316 16:28:38.021641 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/87bada63-5741-4527-90a7-e56a4a3318fa-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"87bada63-5741-4527-90a7-e56a4a3318fa\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:28:38 crc kubenswrapper[5120]: I0316 16:28:38.023097 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/87bada63-5741-4527-90a7-e56a4a3318fa-config-data\") pod \"nova-metadata-0\" (UID: \"87bada63-5741-4527-90a7-e56a4a3318fa\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:28:38 crc kubenswrapper[5120]: I0316 16:28:38.033405 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvjbt\" (UniqueName: \"kubernetes.io/projected/87bada63-5741-4527-90a7-e56a4a3318fa-kube-api-access-tvjbt\") pod \"nova-metadata-0\" (UID: \"87bada63-5741-4527-90a7-e56a4a3318fa\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:28:38 crc kubenswrapper[5120]: I0316 16:28:38.034347 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-28kj6\" (UniqueName: \"kubernetes.io/projected/a18dff22-11a9-4408-b3a8-03c411b4a2b5-kube-api-access-28kj6\") pod \"nova-api-0\" (UID: \"a18dff22-11a9-4408-b3a8-03c411b4a2b5\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:28:38 crc kubenswrapper[5120]: I0316 16:28:38.057258 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:28:38 crc kubenswrapper[5120]: I0316 16:28:38.071450 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:28:38 crc kubenswrapper[5120]: I0316 16:28:38.576024 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:28:38 crc kubenswrapper[5120]: W0316 16:28:38.581188 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod87bada63_5741_4527_90a7_e56a4a3318fa.slice/crio-03f84f8b42bc9b4b03cfee1912b521cacda28e549718de08ab83f02b065bd315 WatchSource:0}: Error finding container 03f84f8b42bc9b4b03cfee1912b521cacda28e549718de08ab83f02b065bd315: Status 404 returned error can't find the container with id 03f84f8b42bc9b4b03cfee1912b521cacda28e549718de08ab83f02b065bd315 Mar 16 16:28:38 crc kubenswrapper[5120]: I0316 16:28:38.621014 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"87bada63-5741-4527-90a7-e56a4a3318fa","Type":"ContainerStarted","Data":"03f84f8b42bc9b4b03cfee1912b521cacda28e549718de08ab83f02b065bd315"} Mar 16 16:28:38 crc kubenswrapper[5120]: I0316 16:28:38.628059 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:28:38 crc kubenswrapper[5120]: I0316 16:28:38.639195 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"cbea120d-f042-4865-b9ee-99fdd90eac9f","Type":"ContainerStarted","Data":"0e4dcbb62b536f5017ac2b27bbeb0a2a06a41a12753b01b90712287f20bed196"} Mar 16 16:28:38 crc kubenswrapper[5120]: I0316 16:28:38.686666 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="562ac4c6-f1e8-4cbc-bbd7-4aad1f0d4f9a" path="/var/lib/kubelet/pods/562ac4c6-f1e8-4cbc-bbd7-4aad1f0d4f9a/volumes" Mar 16 16:28:38 crc kubenswrapper[5120]: I0316 16:28:38.687655 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fab257f8-7bbb-4b5a-9ed5-3b0c1c79d8f2" path="/var/lib/kubelet/pods/fab257f8-7bbb-4b5a-9ed5-3b0c1c79d8f2/volumes" Mar 16 16:28:39 crc kubenswrapper[5120]: I0316 16:28:39.651046 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"a18dff22-11a9-4408-b3a8-03c411b4a2b5","Type":"ContainerStarted","Data":"03421e4e66249e753c347752a7939b3311117ca6aaa5a28839cc1dcb51ee21fb"} Mar 16 16:28:39 crc kubenswrapper[5120]: I0316 16:28:39.651640 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"a18dff22-11a9-4408-b3a8-03c411b4a2b5","Type":"ContainerStarted","Data":"9689c8576af5b2aedaa33d2893728726e157ce77bb56c0aedeade2402ab70b10"} Mar 16 16:28:39 crc kubenswrapper[5120]: I0316 16:28:39.651657 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"a18dff22-11a9-4408-b3a8-03c411b4a2b5","Type":"ContainerStarted","Data":"0b658550df53e9f8f0e8b76da0516860ffa0a312e6b53bf59c1b4f7cf0c1f10f"} Mar 16 16:28:39 crc kubenswrapper[5120]: I0316 16:28:39.653178 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"87bada63-5741-4527-90a7-e56a4a3318fa","Type":"ContainerStarted","Data":"ab81e06fc2f95cd3f1007a7982c966c8e4e9526d7c49d3637e68b8c3905b6ea2"} Mar 16 16:28:39 crc kubenswrapper[5120]: I0316 16:28:39.653218 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"87bada63-5741-4527-90a7-e56a4a3318fa","Type":"ContainerStarted","Data":"8ad6958f7b2c51928c962260c39a367c20a901d9eefc8df7da9da3e0e0e1e6b9"} Mar 16 16:28:39 crc kubenswrapper[5120]: I0316 16:28:39.682747 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=2.6827306 podStartE2EDuration="2.6827306s" podCreationTimestamp="2026-03-16 16:28:37 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:28:39.676577216 +0000 UTC m=+3421.830508883" watchObservedRunningTime="2026-03-16 16:28:39.6827306 +0000 UTC m=+3421.836662257" Mar 16 16:28:39 crc kubenswrapper[5120]: I0316 16:28:39.704198 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=2.704177633 podStartE2EDuration="2.704177633s" podCreationTimestamp="2026-03-16 16:28:37 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:28:39.695694697 +0000 UTC m=+3421.849626354" watchObservedRunningTime="2026-03-16 16:28:39.704177633 +0000 UTC m=+3421.858109290" Mar 16 16:28:40 crc kubenswrapper[5120]: I0316 16:28:40.676543 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"cbea120d-f042-4865-b9ee-99fdd90eac9f","Type":"ContainerStarted","Data":"7eb3a4bef235ab6c4850c61fa77e495251ecc771a2506cc7be8d021f127aa208"} Mar 16 16:28:41 crc kubenswrapper[5120]: I0316 16:28:41.622304 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:28:41 crc kubenswrapper[5120]: I0316 16:28:41.648294 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=3.660944823 podStartE2EDuration="7.648276223s" podCreationTimestamp="2026-03-16 16:28:34 +0000 UTC" firstStartedPulling="2026-03-16 16:28:35.492128623 +0000 UTC m=+3417.646060280" lastFinishedPulling="2026-03-16 16:28:39.479460023 +0000 UTC m=+3421.633391680" observedRunningTime="2026-03-16 16:28:40.702073545 +0000 UTC m=+3422.856005232" watchObservedRunningTime="2026-03-16 16:28:41.648276223 +0000 UTC m=+3423.802207880" Mar 16 16:28:41 crc kubenswrapper[5120]: I0316 16:28:41.680972 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:28:45 crc kubenswrapper[5120]: I0316 16:28:45.476819 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-operators-brknw"] Mar 16 16:28:45 crc kubenswrapper[5120]: I0316 16:28:45.490113 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-brknw" Mar 16 16:28:45 crc kubenswrapper[5120]: I0316 16:28:45.502466 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-brknw"] Mar 16 16:28:45 crc kubenswrapper[5120]: I0316 16:28:45.559697 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/128632ac-9a88-4aa7-adc6-5d5eb264a19b-utilities\") pod \"redhat-operators-brknw\" (UID: \"128632ac-9a88-4aa7-adc6-5d5eb264a19b\") " pod="openshift-marketplace/redhat-operators-brknw" Mar 16 16:28:45 crc kubenswrapper[5120]: I0316 16:28:45.559779 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/128632ac-9a88-4aa7-adc6-5d5eb264a19b-catalog-content\") pod \"redhat-operators-brknw\" (UID: \"128632ac-9a88-4aa7-adc6-5d5eb264a19b\") " pod="openshift-marketplace/redhat-operators-brknw" Mar 16 16:28:45 crc kubenswrapper[5120]: I0316 16:28:45.560007 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55btx\" (UniqueName: \"kubernetes.io/projected/128632ac-9a88-4aa7-adc6-5d5eb264a19b-kube-api-access-55btx\") pod \"redhat-operators-brknw\" (UID: \"128632ac-9a88-4aa7-adc6-5d5eb264a19b\") " pod="openshift-marketplace/redhat-operators-brknw" Mar 16 16:28:45 crc kubenswrapper[5120]: I0316 16:28:45.662526 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/128632ac-9a88-4aa7-adc6-5d5eb264a19b-utilities\") pod \"redhat-operators-brknw\" (UID: \"128632ac-9a88-4aa7-adc6-5d5eb264a19b\") " pod="openshift-marketplace/redhat-operators-brknw" Mar 16 16:28:45 crc kubenswrapper[5120]: I0316 16:28:45.662583 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/128632ac-9a88-4aa7-adc6-5d5eb264a19b-catalog-content\") pod \"redhat-operators-brknw\" (UID: \"128632ac-9a88-4aa7-adc6-5d5eb264a19b\") " pod="openshift-marketplace/redhat-operators-brknw" Mar 16 16:28:45 crc kubenswrapper[5120]: I0316 16:28:45.662747 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-55btx\" (UniqueName: \"kubernetes.io/projected/128632ac-9a88-4aa7-adc6-5d5eb264a19b-kube-api-access-55btx\") pod \"redhat-operators-brknw\" (UID: \"128632ac-9a88-4aa7-adc6-5d5eb264a19b\") " pod="openshift-marketplace/redhat-operators-brknw" Mar 16 16:28:45 crc kubenswrapper[5120]: I0316 16:28:45.663182 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/128632ac-9a88-4aa7-adc6-5d5eb264a19b-utilities\") pod \"redhat-operators-brknw\" (UID: \"128632ac-9a88-4aa7-adc6-5d5eb264a19b\") " pod="openshift-marketplace/redhat-operators-brknw" Mar 16 16:28:45 crc kubenswrapper[5120]: I0316 16:28:45.663355 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/128632ac-9a88-4aa7-adc6-5d5eb264a19b-catalog-content\") pod \"redhat-operators-brknw\" (UID: \"128632ac-9a88-4aa7-adc6-5d5eb264a19b\") " pod="openshift-marketplace/redhat-operators-brknw" Mar 16 16:28:45 crc kubenswrapper[5120]: I0316 16:28:45.696038 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-55btx\" (UniqueName: \"kubernetes.io/projected/128632ac-9a88-4aa7-adc6-5d5eb264a19b-kube-api-access-55btx\") pod \"redhat-operators-brknw\" (UID: \"128632ac-9a88-4aa7-adc6-5d5eb264a19b\") " pod="openshift-marketplace/redhat-operators-brknw" Mar 16 16:28:45 crc kubenswrapper[5120]: I0316 16:28:45.814586 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-brknw" Mar 16 16:28:46 crc kubenswrapper[5120]: I0316 16:28:46.295924 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-brknw"] Mar 16 16:28:46 crc kubenswrapper[5120]: I0316 16:28:46.769642 5120 generic.go:358] "Generic (PLEG): container finished" podID="128632ac-9a88-4aa7-adc6-5d5eb264a19b" containerID="28cb2711bf8206e808690cd927dd9a75e3180e78510c69bf71d027eda96968df" exitCode=0 Mar 16 16:28:46 crc kubenswrapper[5120]: I0316 16:28:46.769687 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-brknw" event={"ID":"128632ac-9a88-4aa7-adc6-5d5eb264a19b","Type":"ContainerDied","Data":"28cb2711bf8206e808690cd927dd9a75e3180e78510c69bf71d027eda96968df"} Mar 16 16:28:46 crc kubenswrapper[5120]: I0316 16:28:46.770066 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-brknw" event={"ID":"128632ac-9a88-4aa7-adc6-5d5eb264a19b","Type":"ContainerStarted","Data":"44e4f3e66ef5b9311894c05abc70f058d685c83454ee7395d7863bee57864aa7"} Mar 16 16:28:48 crc kubenswrapper[5120]: I0316 16:28:48.057879 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:28:48 crc kubenswrapper[5120]: I0316 16:28:48.058214 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:28:48 crc kubenswrapper[5120]: I0316 16:28:48.072670 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:28:48 crc kubenswrapper[5120]: I0316 16:28:48.073209 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:28:48 crc kubenswrapper[5120]: I0316 16:28:48.798344 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-brknw" event={"ID":"128632ac-9a88-4aa7-adc6-5d5eb264a19b","Type":"ContainerStarted","Data":"6fa7db4adc7eab36aa80af6c16a2b7db613cf1910dbe99199a656b54c0fc3222"} Mar 16 16:28:49 crc kubenswrapper[5120]: I0316 16:28:49.064963 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="87bada63-5741-4527-90a7-e56a4a3318fa" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"https://10.217.1.254:8775/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 16:28:49 crc kubenswrapper[5120]: I0316 16:28:49.065964 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="87bada63-5741-4527-90a7-e56a4a3318fa" containerName="nova-metadata-log" probeResult="failure" output="Get \"https://10.217.1.254:8775/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Mar 16 16:28:49 crc kubenswrapper[5120]: I0316 16:28:49.113974 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="a18dff22-11a9-4408-b3a8-03c411b4a2b5" containerName="nova-api-api" probeResult="failure" output="Get \"http://10.217.0.10:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 16:28:49 crc kubenswrapper[5120]: I0316 16:28:49.113988 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="a18dff22-11a9-4408-b3a8-03c411b4a2b5" containerName="nova-api-log" probeResult="failure" output="Get \"http://10.217.0.10:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 16:28:51 crc kubenswrapper[5120]: I0316 16:28:51.841837 5120 generic.go:358] "Generic (PLEG): container finished" podID="128632ac-9a88-4aa7-adc6-5d5eb264a19b" containerID="6fa7db4adc7eab36aa80af6c16a2b7db613cf1910dbe99199a656b54c0fc3222" exitCode=0 Mar 16 16:28:51 crc kubenswrapper[5120]: I0316 16:28:51.841908 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-brknw" event={"ID":"128632ac-9a88-4aa7-adc6-5d5eb264a19b","Type":"ContainerDied","Data":"6fa7db4adc7eab36aa80af6c16a2b7db613cf1910dbe99199a656b54c0fc3222"} Mar 16 16:28:52 crc kubenswrapper[5120]: I0316 16:28:52.007546 5120 patch_prober.go:28] interesting pod/machine-config-daemon-7bf76 container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 16:28:52 crc kubenswrapper[5120]: I0316 16:28:52.007600 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 16:28:52 crc kubenswrapper[5120]: I0316 16:28:52.007640 5120 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" Mar 16 16:28:52 crc kubenswrapper[5120]: I0316 16:28:52.008374 5120 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="machine-config-daemon" containerStatusID={"Type":"cri-o","ID":"81c2458dbde22f960e4dc3bd6169d3e540aa2cf242ee46fc5d79af661a0e3277"} pod="openshift-machine-config-operator/machine-config-daemon-7bf76" containerMessage="Container machine-config-daemon failed liveness probe, will be restarted" Mar 16 16:28:52 crc kubenswrapper[5120]: I0316 16:28:52.008434 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" containerID="cri-o://81c2458dbde22f960e4dc3bd6169d3e540aa2cf242ee46fc5d79af661a0e3277" gracePeriod=600 Mar 16 16:28:52 crc kubenswrapper[5120]: I0316 16:28:52.858548 5120 generic.go:358] "Generic (PLEG): container finished" podID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerID="81c2458dbde22f960e4dc3bd6169d3e540aa2cf242ee46fc5d79af661a0e3277" exitCode=0 Mar 16 16:28:52 crc kubenswrapper[5120]: I0316 16:28:52.858611 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" event={"ID":"e2275cb4-4905-4d66-a87e-8010120db2bd","Type":"ContainerDied","Data":"81c2458dbde22f960e4dc3bd6169d3e540aa2cf242ee46fc5d79af661a0e3277"} Mar 16 16:28:52 crc kubenswrapper[5120]: I0316 16:28:52.859282 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" event={"ID":"e2275cb4-4905-4d66-a87e-8010120db2bd","Type":"ContainerStarted","Data":"0a15d5caff30dc8885f782e59962af7d98d58b39ab76059e56e5827e10e7ab8b"} Mar 16 16:28:52 crc kubenswrapper[5120]: I0316 16:28:52.859324 5120 scope.go:117] "RemoveContainer" containerID="f40e444f89abd558ac90555bfd58e04a1c4379a653ba8035c228d2b7a5443eb5" Mar 16 16:28:52 crc kubenswrapper[5120]: I0316 16:28:52.862470 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-brknw" event={"ID":"128632ac-9a88-4aa7-adc6-5d5eb264a19b","Type":"ContainerStarted","Data":"4b349b53220cbe6fbacd3af24eedcd9c7014d9e22b2f92d7666a00c13bc62264"} Mar 16 16:28:52 crc kubenswrapper[5120]: I0316 16:28:52.900148 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/redhat-operators-brknw" podStartSLOduration=6.810632937 podStartE2EDuration="7.900130359s" podCreationTimestamp="2026-03-16 16:28:45 +0000 UTC" firstStartedPulling="2026-03-16 16:28:46.770751485 +0000 UTC m=+3428.924683142" lastFinishedPulling="2026-03-16 16:28:47.860248907 +0000 UTC m=+3430.014180564" observedRunningTime="2026-03-16 16:28:52.894972791 +0000 UTC m=+3435.048904458" watchObservedRunningTime="2026-03-16 16:28:52.900130359 +0000 UTC m=+3435.054062016" Mar 16 16:28:55 crc kubenswrapper[5120]: I0316 16:28:55.690748 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:28:55 crc kubenswrapper[5120]: I0316 16:28:55.776082 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qwldl\" (UniqueName: \"kubernetes.io/projected/13e3ea54-b4d8-4995-8ef1-bb45203f4ad8-kube-api-access-qwldl\") pod \"13e3ea54-b4d8-4995-8ef1-bb45203f4ad8\" (UID: \"13e3ea54-b4d8-4995-8ef1-bb45203f4ad8\") " Mar 16 16:28:55 crc kubenswrapper[5120]: I0316 16:28:55.776389 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/13e3ea54-b4d8-4995-8ef1-bb45203f4ad8-combined-ca-bundle\") pod \"13e3ea54-b4d8-4995-8ef1-bb45203f4ad8\" (UID: \"13e3ea54-b4d8-4995-8ef1-bb45203f4ad8\") " Mar 16 16:28:55 crc kubenswrapper[5120]: I0316 16:28:55.776479 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/13e3ea54-b4d8-4995-8ef1-bb45203f4ad8-config-data\") pod \"13e3ea54-b4d8-4995-8ef1-bb45203f4ad8\" (UID: \"13e3ea54-b4d8-4995-8ef1-bb45203f4ad8\") " Mar 16 16:28:55 crc kubenswrapper[5120]: I0316 16:28:55.790834 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13e3ea54-b4d8-4995-8ef1-bb45203f4ad8-kube-api-access-qwldl" (OuterVolumeSpecName: "kube-api-access-qwldl") pod "13e3ea54-b4d8-4995-8ef1-bb45203f4ad8" (UID: "13e3ea54-b4d8-4995-8ef1-bb45203f4ad8"). InnerVolumeSpecName "kube-api-access-qwldl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:28:55 crc kubenswrapper[5120]: I0316 16:28:55.812023 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/13e3ea54-b4d8-4995-8ef1-bb45203f4ad8-config-data" (OuterVolumeSpecName: "config-data") pod "13e3ea54-b4d8-4995-8ef1-bb45203f4ad8" (UID: "13e3ea54-b4d8-4995-8ef1-bb45203f4ad8"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:28:55 crc kubenswrapper[5120]: I0316 16:28:55.813829 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/13e3ea54-b4d8-4995-8ef1-bb45203f4ad8-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "13e3ea54-b4d8-4995-8ef1-bb45203f4ad8" (UID: "13e3ea54-b4d8-4995-8ef1-bb45203f4ad8"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:28:55 crc kubenswrapper[5120]: I0316 16:28:55.814795 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-operators-brknw" Mar 16 16:28:55 crc kubenswrapper[5120]: I0316 16:28:55.814835 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-marketplace/redhat-operators-brknw" Mar 16 16:28:55 crc kubenswrapper[5120]: I0316 16:28:55.880269 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qwldl\" (UniqueName: \"kubernetes.io/projected/13e3ea54-b4d8-4995-8ef1-bb45203f4ad8-kube-api-access-qwldl\") on node \"crc\" DevicePath \"\"" Mar 16 16:28:55 crc kubenswrapper[5120]: I0316 16:28:55.880305 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/13e3ea54-b4d8-4995-8ef1-bb45203f4ad8-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:28:55 crc kubenswrapper[5120]: I0316 16:28:55.880315 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/13e3ea54-b4d8-4995-8ef1-bb45203f4ad8-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:28:55 crc kubenswrapper[5120]: I0316 16:28:55.901396 5120 generic.go:358] "Generic (PLEG): container finished" podID="13e3ea54-b4d8-4995-8ef1-bb45203f4ad8" containerID="aedb59a22c20b4a76de6995ba59c4843dfd20b4d148dcaef7594113c601e8c3a" exitCode=137 Mar 16 16:28:55 crc kubenswrapper[5120]: I0316 16:28:55.901497 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:28:55 crc kubenswrapper[5120]: I0316 16:28:55.901637 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"13e3ea54-b4d8-4995-8ef1-bb45203f4ad8","Type":"ContainerDied","Data":"aedb59a22c20b4a76de6995ba59c4843dfd20b4d148dcaef7594113c601e8c3a"} Mar 16 16:28:55 crc kubenswrapper[5120]: I0316 16:28:55.901693 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"13e3ea54-b4d8-4995-8ef1-bb45203f4ad8","Type":"ContainerDied","Data":"ddca7bfcf74ddd940706c0f90e95b01b958c196dfbfb0631f40a6c61780221f8"} Mar 16 16:28:55 crc kubenswrapper[5120]: I0316 16:28:55.901717 5120 scope.go:117] "RemoveContainer" containerID="aedb59a22c20b4a76de6995ba59c4843dfd20b4d148dcaef7594113c601e8c3a" Mar 16 16:28:55 crc kubenswrapper[5120]: I0316 16:28:55.934384 5120 scope.go:117] "RemoveContainer" containerID="1ba0b27cac3772b9d043f22faf3b845ee8338b9644dd4435cc691903878e8b8b" Mar 16 16:28:55 crc kubenswrapper[5120]: I0316 16:28:55.938878 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:28:55 crc kubenswrapper[5120]: I0316 16:28:55.955600 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:28:55 crc kubenswrapper[5120]: I0316 16:28:55.980188 5120 scope.go:117] "RemoveContainer" containerID="aedb59a22c20b4a76de6995ba59c4843dfd20b4d148dcaef7594113c601e8c3a" Mar 16 16:28:55 crc kubenswrapper[5120]: E0316 16:28:55.980860 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aedb59a22c20b4a76de6995ba59c4843dfd20b4d148dcaef7594113c601e8c3a\": container with ID starting with aedb59a22c20b4a76de6995ba59c4843dfd20b4d148dcaef7594113c601e8c3a not found: ID does not exist" containerID="aedb59a22c20b4a76de6995ba59c4843dfd20b4d148dcaef7594113c601e8c3a" Mar 16 16:28:55 crc kubenswrapper[5120]: I0316 16:28:55.980919 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aedb59a22c20b4a76de6995ba59c4843dfd20b4d148dcaef7594113c601e8c3a"} err="failed to get container status \"aedb59a22c20b4a76de6995ba59c4843dfd20b4d148dcaef7594113c601e8c3a\": rpc error: code = NotFound desc = could not find container \"aedb59a22c20b4a76de6995ba59c4843dfd20b4d148dcaef7594113c601e8c3a\": container with ID starting with aedb59a22c20b4a76de6995ba59c4843dfd20b4d148dcaef7594113c601e8c3a not found: ID does not exist" Mar 16 16:28:55 crc kubenswrapper[5120]: I0316 16:28:55.980948 5120 scope.go:117] "RemoveContainer" containerID="1ba0b27cac3772b9d043f22faf3b845ee8338b9644dd4435cc691903878e8b8b" Mar 16 16:28:55 crc kubenswrapper[5120]: E0316 16:28:55.981284 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ba0b27cac3772b9d043f22faf3b845ee8338b9644dd4435cc691903878e8b8b\": container with ID starting with 1ba0b27cac3772b9d043f22faf3b845ee8338b9644dd4435cc691903878e8b8b not found: ID does not exist" containerID="1ba0b27cac3772b9d043f22faf3b845ee8338b9644dd4435cc691903878e8b8b" Mar 16 16:28:55 crc kubenswrapper[5120]: I0316 16:28:55.981333 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ba0b27cac3772b9d043f22faf3b845ee8338b9644dd4435cc691903878e8b8b"} err="failed to get container status \"1ba0b27cac3772b9d043f22faf3b845ee8338b9644dd4435cc691903878e8b8b\": rpc error: code = NotFound desc = could not find container \"1ba0b27cac3772b9d043f22faf3b845ee8338b9644dd4435cc691903878e8b8b\": container with ID starting with 1ba0b27cac3772b9d043f22faf3b845ee8338b9644dd4435cc691903878e8b8b not found: ID does not exist" Mar 16 16:28:55 crc kubenswrapper[5120]: I0316 16:28:55.988082 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:28:55 crc kubenswrapper[5120]: I0316 16:28:55.990293 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13e3ea54-b4d8-4995-8ef1-bb45203f4ad8" containerName="nova-scheduler-scheduler" Mar 16 16:28:55 crc kubenswrapper[5120]: I0316 16:28:55.990318 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="13e3ea54-b4d8-4995-8ef1-bb45203f4ad8" containerName="nova-scheduler-scheduler" Mar 16 16:28:55 crc kubenswrapper[5120]: I0316 16:28:55.990948 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="13e3ea54-b4d8-4995-8ef1-bb45203f4ad8" containerName="nova-scheduler-scheduler" Mar 16 16:28:56 crc kubenswrapper[5120]: I0316 16:28:56.020143 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:28:56 crc kubenswrapper[5120]: I0316 16:28:56.020189 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:28:56 crc kubenswrapper[5120]: I0316 16:28:56.022621 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-scheduler-config-data\"" Mar 16 16:28:56 crc kubenswrapper[5120]: I0316 16:28:56.057383 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:28:56 crc kubenswrapper[5120]: I0316 16:28:56.057658 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:28:56 crc kubenswrapper[5120]: I0316 16:28:56.071685 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:28:56 crc kubenswrapper[5120]: I0316 16:28:56.071736 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:28:56 crc kubenswrapper[5120]: I0316 16:28:56.187550 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7772402b-66a6-46eb-8d2e-8016e9f20bbe-config-data\") pod \"nova-scheduler-0\" (UID: \"7772402b-66a6-46eb-8d2e-8016e9f20bbe\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:28:56 crc kubenswrapper[5120]: I0316 16:28:56.187703 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zs4tc\" (UniqueName: \"kubernetes.io/projected/7772402b-66a6-46eb-8d2e-8016e9f20bbe-kube-api-access-zs4tc\") pod \"nova-scheduler-0\" (UID: \"7772402b-66a6-46eb-8d2e-8016e9f20bbe\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:28:56 crc kubenswrapper[5120]: I0316 16:28:56.188179 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7772402b-66a6-46eb-8d2e-8016e9f20bbe-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"7772402b-66a6-46eb-8d2e-8016e9f20bbe\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:28:56 crc kubenswrapper[5120]: I0316 16:28:56.291526 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7772402b-66a6-46eb-8d2e-8016e9f20bbe-config-data\") pod \"nova-scheduler-0\" (UID: \"7772402b-66a6-46eb-8d2e-8016e9f20bbe\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:28:56 crc kubenswrapper[5120]: I0316 16:28:56.291956 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zs4tc\" (UniqueName: \"kubernetes.io/projected/7772402b-66a6-46eb-8d2e-8016e9f20bbe-kube-api-access-zs4tc\") pod \"nova-scheduler-0\" (UID: \"7772402b-66a6-46eb-8d2e-8016e9f20bbe\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:28:56 crc kubenswrapper[5120]: I0316 16:28:56.292309 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7772402b-66a6-46eb-8d2e-8016e9f20bbe-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"7772402b-66a6-46eb-8d2e-8016e9f20bbe\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:28:56 crc kubenswrapper[5120]: I0316 16:28:56.297246 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7772402b-66a6-46eb-8d2e-8016e9f20bbe-config-data\") pod \"nova-scheduler-0\" (UID: \"7772402b-66a6-46eb-8d2e-8016e9f20bbe\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:28:56 crc kubenswrapper[5120]: I0316 16:28:56.300393 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7772402b-66a6-46eb-8d2e-8016e9f20bbe-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"7772402b-66a6-46eb-8d2e-8016e9f20bbe\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:28:56 crc kubenswrapper[5120]: I0316 16:28:56.315400 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zs4tc\" (UniqueName: \"kubernetes.io/projected/7772402b-66a6-46eb-8d2e-8016e9f20bbe-kube-api-access-zs4tc\") pod \"nova-scheduler-0\" (UID: \"7772402b-66a6-46eb-8d2e-8016e9f20bbe\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:28:56 crc kubenswrapper[5120]: I0316 16:28:56.342802 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:28:56 crc kubenswrapper[5120]: I0316 16:28:56.563392 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:28:56 crc kubenswrapper[5120]: I0316 16:28:56.677641 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="13e3ea54-b4d8-4995-8ef1-bb45203f4ad8" path="/var/lib/kubelet/pods/13e3ea54-b4d8-4995-8ef1-bb45203f4ad8/volumes" Mar 16 16:28:56 crc kubenswrapper[5120]: I0316 16:28:56.710187 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/da2bbfc0-f1f7-4294-b906-02cf338292b3-combined-ca-bundle\") pod \"da2bbfc0-f1f7-4294-b906-02cf338292b3\" (UID: \"da2bbfc0-f1f7-4294-b906-02cf338292b3\") " Mar 16 16:28:56 crc kubenswrapper[5120]: I0316 16:28:56.711231 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/da2bbfc0-f1f7-4294-b906-02cf338292b3-config-data\") pod \"da2bbfc0-f1f7-4294-b906-02cf338292b3\" (UID: \"da2bbfc0-f1f7-4294-b906-02cf338292b3\") " Mar 16 16:28:56 crc kubenswrapper[5120]: I0316 16:28:56.711475 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8fc4q\" (UniqueName: \"kubernetes.io/projected/da2bbfc0-f1f7-4294-b906-02cf338292b3-kube-api-access-8fc4q\") pod \"da2bbfc0-f1f7-4294-b906-02cf338292b3\" (UID: \"da2bbfc0-f1f7-4294-b906-02cf338292b3\") " Mar 16 16:28:56 crc kubenswrapper[5120]: I0316 16:28:56.711615 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/da2bbfc0-f1f7-4294-b906-02cf338292b3-vencrypt-tls-certs\") pod \"da2bbfc0-f1f7-4294-b906-02cf338292b3\" (UID: \"da2bbfc0-f1f7-4294-b906-02cf338292b3\") " Mar 16 16:28:56 crc kubenswrapper[5120]: I0316 16:28:56.711733 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/da2bbfc0-f1f7-4294-b906-02cf338292b3-nova-novncproxy-tls-certs\") pod \"da2bbfc0-f1f7-4294-b906-02cf338292b3\" (UID: \"da2bbfc0-f1f7-4294-b906-02cf338292b3\") " Mar 16 16:28:56 crc kubenswrapper[5120]: I0316 16:28:56.718534 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da2bbfc0-f1f7-4294-b906-02cf338292b3-kube-api-access-8fc4q" (OuterVolumeSpecName: "kube-api-access-8fc4q") pod "da2bbfc0-f1f7-4294-b906-02cf338292b3" (UID: "da2bbfc0-f1f7-4294-b906-02cf338292b3"). InnerVolumeSpecName "kube-api-access-8fc4q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:28:56 crc kubenswrapper[5120]: I0316 16:28:56.749872 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da2bbfc0-f1f7-4294-b906-02cf338292b3-config-data" (OuterVolumeSpecName: "config-data") pod "da2bbfc0-f1f7-4294-b906-02cf338292b3" (UID: "da2bbfc0-f1f7-4294-b906-02cf338292b3"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:28:56 crc kubenswrapper[5120]: I0316 16:28:56.752340 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da2bbfc0-f1f7-4294-b906-02cf338292b3-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "da2bbfc0-f1f7-4294-b906-02cf338292b3" (UID: "da2bbfc0-f1f7-4294-b906-02cf338292b3"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:28:56 crc kubenswrapper[5120]: I0316 16:28:56.771710 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da2bbfc0-f1f7-4294-b906-02cf338292b3-nova-novncproxy-tls-certs" (OuterVolumeSpecName: "nova-novncproxy-tls-certs") pod "da2bbfc0-f1f7-4294-b906-02cf338292b3" (UID: "da2bbfc0-f1f7-4294-b906-02cf338292b3"). InnerVolumeSpecName "nova-novncproxy-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:28:56 crc kubenswrapper[5120]: I0316 16:28:56.780178 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da2bbfc0-f1f7-4294-b906-02cf338292b3-vencrypt-tls-certs" (OuterVolumeSpecName: "vencrypt-tls-certs") pod "da2bbfc0-f1f7-4294-b906-02cf338292b3" (UID: "da2bbfc0-f1f7-4294-b906-02cf338292b3"). InnerVolumeSpecName "vencrypt-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:28:56 crc kubenswrapper[5120]: I0316 16:28:56.814841 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8fc4q\" (UniqueName: \"kubernetes.io/projected/da2bbfc0-f1f7-4294-b906-02cf338292b3-kube-api-access-8fc4q\") on node \"crc\" DevicePath \"\"" Mar 16 16:28:56 crc kubenswrapper[5120]: I0316 16:28:56.814885 5120 reconciler_common.go:299] "Volume detached for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/da2bbfc0-f1f7-4294-b906-02cf338292b3-vencrypt-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:28:56 crc kubenswrapper[5120]: I0316 16:28:56.814898 5120 reconciler_common.go:299] "Volume detached for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/da2bbfc0-f1f7-4294-b906-02cf338292b3-nova-novncproxy-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:28:56 crc kubenswrapper[5120]: I0316 16:28:56.814911 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/da2bbfc0-f1f7-4294-b906-02cf338292b3-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:28:56 crc kubenswrapper[5120]: I0316 16:28:56.814922 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/da2bbfc0-f1f7-4294-b906-02cf338292b3-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:28:56 crc kubenswrapper[5120]: I0316 16:28:56.869505 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:28:56 crc kubenswrapper[5120]: I0316 16:28:56.870986 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-marketplace/redhat-operators-brknw" podUID="128632ac-9a88-4aa7-adc6-5d5eb264a19b" containerName="registry-server" probeResult="failure" output=< Mar 16 16:28:56 crc kubenswrapper[5120]: timeout: failed to connect service ":50051" within 1s Mar 16 16:28:56 crc kubenswrapper[5120]: > Mar 16 16:28:56 crc kubenswrapper[5120]: I0316 16:28:56.912590 5120 generic.go:358] "Generic (PLEG): container finished" podID="da2bbfc0-f1f7-4294-b906-02cf338292b3" containerID="41d01ec19e19459501ca249030d594e8bffcfe58d2d90c9bf956724250844eb2" exitCode=137 Mar 16 16:28:56 crc kubenswrapper[5120]: I0316 16:28:56.912655 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:28:56 crc kubenswrapper[5120]: I0316 16:28:56.912901 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"da2bbfc0-f1f7-4294-b906-02cf338292b3","Type":"ContainerDied","Data":"41d01ec19e19459501ca249030d594e8bffcfe58d2d90c9bf956724250844eb2"} Mar 16 16:28:56 crc kubenswrapper[5120]: I0316 16:28:56.913001 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"da2bbfc0-f1f7-4294-b906-02cf338292b3","Type":"ContainerDied","Data":"060e6a0c2c6e55bad9abce3ef88af7e41dce8676428b1b1dfc127f162fda834a"} Mar 16 16:28:56 crc kubenswrapper[5120]: I0316 16:28:56.913103 5120 scope.go:117] "RemoveContainer" containerID="41d01ec19e19459501ca249030d594e8bffcfe58d2d90c9bf956724250844eb2" Mar 16 16:28:56 crc kubenswrapper[5120]: I0316 16:28:56.916781 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"7772402b-66a6-46eb-8d2e-8016e9f20bbe","Type":"ContainerStarted","Data":"a0b2d3ce5edcf0a981ff000fd26ec42d1e0873f1a5c4f0b832cc95d89fde1948"} Mar 16 16:28:56 crc kubenswrapper[5120]: I0316 16:28:56.945685 5120 scope.go:117] "RemoveContainer" containerID="41d01ec19e19459501ca249030d594e8bffcfe58d2d90c9bf956724250844eb2" Mar 16 16:28:56 crc kubenswrapper[5120]: E0316 16:28:56.947202 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"41d01ec19e19459501ca249030d594e8bffcfe58d2d90c9bf956724250844eb2\": container with ID starting with 41d01ec19e19459501ca249030d594e8bffcfe58d2d90c9bf956724250844eb2 not found: ID does not exist" containerID="41d01ec19e19459501ca249030d594e8bffcfe58d2d90c9bf956724250844eb2" Mar 16 16:28:56 crc kubenswrapper[5120]: I0316 16:28:56.947261 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41d01ec19e19459501ca249030d594e8bffcfe58d2d90c9bf956724250844eb2"} err="failed to get container status \"41d01ec19e19459501ca249030d594e8bffcfe58d2d90c9bf956724250844eb2\": rpc error: code = NotFound desc = could not find container \"41d01ec19e19459501ca249030d594e8bffcfe58d2d90c9bf956724250844eb2\": container with ID starting with 41d01ec19e19459501ca249030d594e8bffcfe58d2d90c9bf956724250844eb2 not found: ID does not exist" Mar 16 16:28:56 crc kubenswrapper[5120]: I0316 16:28:56.962363 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:28:56 crc kubenswrapper[5120]: I0316 16:28:56.977889 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:28:56 crc kubenswrapper[5120]: I0316 16:28:56.998415 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:28:56 crc kubenswrapper[5120]: I0316 16:28:56.999653 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13e3ea54-b4d8-4995-8ef1-bb45203f4ad8" containerName="nova-scheduler-scheduler" Mar 16 16:28:56 crc kubenswrapper[5120]: I0316 16:28:56.999675 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="13e3ea54-b4d8-4995-8ef1-bb45203f4ad8" containerName="nova-scheduler-scheduler" Mar 16 16:28:56 crc kubenswrapper[5120]: I0316 16:28:56.999712 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da2bbfc0-f1f7-4294-b906-02cf338292b3" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 16:28:56 crc kubenswrapper[5120]: I0316 16:28:56.999720 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="da2bbfc0-f1f7-4294-b906-02cf338292b3" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 16:28:56 crc kubenswrapper[5120]: I0316 16:28:56.999977 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="da2bbfc0-f1f7-4294-b906-02cf338292b3" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 16:28:57 crc kubenswrapper[5120]: I0316 16:28:57.000000 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="13e3ea54-b4d8-4995-8ef1-bb45203f4ad8" containerName="nova-scheduler-scheduler" Mar 16 16:28:57 crc kubenswrapper[5120]: I0316 16:28:57.005429 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:28:57 crc kubenswrapper[5120]: I0316 16:28:57.008187 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-novncproxy-config-data\"" Mar 16 16:28:57 crc kubenswrapper[5120]: I0316 16:28:57.008208 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-novncproxy-cell1-vencrypt\"" Mar 16 16:28:57 crc kubenswrapper[5120]: I0316 16:28:57.010788 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-novncproxy-cell1-public-svc\"" Mar 16 16:28:57 crc kubenswrapper[5120]: I0316 16:28:57.013664 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:28:57 crc kubenswrapper[5120]: I0316 16:28:57.131492 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2c78e334-9857-4302-af64-dc9b0647ab41-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"2c78e334-9857-4302-af64-dc9b0647ab41\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:28:57 crc kubenswrapper[5120]: I0316 16:28:57.131543 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8sv8t\" (UniqueName: \"kubernetes.io/projected/2c78e334-9857-4302-af64-dc9b0647ab41-kube-api-access-8sv8t\") pod \"nova-cell1-novncproxy-0\" (UID: \"2c78e334-9857-4302-af64-dc9b0647ab41\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:28:57 crc kubenswrapper[5120]: I0316 16:28:57.131817 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2c78e334-9857-4302-af64-dc9b0647ab41-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"2c78e334-9857-4302-af64-dc9b0647ab41\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:28:57 crc kubenswrapper[5120]: I0316 16:28:57.131907 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/2c78e334-9857-4302-af64-dc9b0647ab41-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"2c78e334-9857-4302-af64-dc9b0647ab41\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:28:57 crc kubenswrapper[5120]: I0316 16:28:57.131962 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/2c78e334-9857-4302-af64-dc9b0647ab41-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"2c78e334-9857-4302-af64-dc9b0647ab41\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:28:57 crc kubenswrapper[5120]: I0316 16:28:57.234424 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/2c78e334-9857-4302-af64-dc9b0647ab41-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"2c78e334-9857-4302-af64-dc9b0647ab41\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:28:57 crc kubenswrapper[5120]: I0316 16:28:57.234531 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/2c78e334-9857-4302-af64-dc9b0647ab41-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"2c78e334-9857-4302-af64-dc9b0647ab41\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:28:57 crc kubenswrapper[5120]: I0316 16:28:57.234881 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2c78e334-9857-4302-af64-dc9b0647ab41-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"2c78e334-9857-4302-af64-dc9b0647ab41\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:28:57 crc kubenswrapper[5120]: I0316 16:28:57.235037 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8sv8t\" (UniqueName: \"kubernetes.io/projected/2c78e334-9857-4302-af64-dc9b0647ab41-kube-api-access-8sv8t\") pod \"nova-cell1-novncproxy-0\" (UID: \"2c78e334-9857-4302-af64-dc9b0647ab41\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:28:57 crc kubenswrapper[5120]: I0316 16:28:57.235175 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2c78e334-9857-4302-af64-dc9b0647ab41-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"2c78e334-9857-4302-af64-dc9b0647ab41\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:28:57 crc kubenswrapper[5120]: I0316 16:28:57.241907 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/2c78e334-9857-4302-af64-dc9b0647ab41-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"2c78e334-9857-4302-af64-dc9b0647ab41\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:28:57 crc kubenswrapper[5120]: I0316 16:28:57.242138 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2c78e334-9857-4302-af64-dc9b0647ab41-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"2c78e334-9857-4302-af64-dc9b0647ab41\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:28:57 crc kubenswrapper[5120]: I0316 16:28:57.242528 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/2c78e334-9857-4302-af64-dc9b0647ab41-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"2c78e334-9857-4302-af64-dc9b0647ab41\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:28:57 crc kubenswrapper[5120]: I0316 16:28:57.243417 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2c78e334-9857-4302-af64-dc9b0647ab41-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"2c78e334-9857-4302-af64-dc9b0647ab41\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:28:57 crc kubenswrapper[5120]: I0316 16:28:57.256753 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8sv8t\" (UniqueName: \"kubernetes.io/projected/2c78e334-9857-4302-af64-dc9b0647ab41-kube-api-access-8sv8t\") pod \"nova-cell1-novncproxy-0\" (UID: \"2c78e334-9857-4302-af64-dc9b0647ab41\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:28:57 crc kubenswrapper[5120]: I0316 16:28:57.340833 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:28:57 crc kubenswrapper[5120]: I0316 16:28:57.816608 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:28:57 crc kubenswrapper[5120]: I0316 16:28:57.931133 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"2c78e334-9857-4302-af64-dc9b0647ab41","Type":"ContainerStarted","Data":"6f808a18df0cdf943e2a22b447f40f15fd9ea5b2399c91a18e0aee52f8b38286"} Mar 16 16:28:57 crc kubenswrapper[5120]: I0316 16:28:57.934871 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"7772402b-66a6-46eb-8d2e-8016e9f20bbe","Type":"ContainerStarted","Data":"74c7f36fcc94f1ab835b435b8fe76162b63208684aad69ba896198c2f8a11b83"} Mar 16 16:28:57 crc kubenswrapper[5120]: I0316 16:28:57.957459 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-scheduler-0" podStartSLOduration=2.957439708 podStartE2EDuration="2.957439708s" podCreationTimestamp="2026-03-16 16:28:55 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:28:57.952461145 +0000 UTC m=+3440.106392802" watchObservedRunningTime="2026-03-16 16:28:57.957439708 +0000 UTC m=+3440.111371365" Mar 16 16:28:58 crc kubenswrapper[5120]: I0316 16:28:58.062859 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:28:58 crc kubenswrapper[5120]: I0316 16:28:58.063163 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:28:58 crc kubenswrapper[5120]: I0316 16:28:58.067531 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:28:58 crc kubenswrapper[5120]: I0316 16:28:58.075040 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:28:58 crc kubenswrapper[5120]: I0316 16:28:58.075650 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:28:58 crc kubenswrapper[5120]: I0316 16:28:58.078945 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:28:58 crc kubenswrapper[5120]: I0316 16:28:58.084872 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:28:58 crc kubenswrapper[5120]: I0316 16:28:58.688788 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="da2bbfc0-f1f7-4294-b906-02cf338292b3" path="/var/lib/kubelet/pods/da2bbfc0-f1f7-4294-b906-02cf338292b3/volumes" Mar 16 16:28:58 crc kubenswrapper[5120]: I0316 16:28:58.945302 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"2c78e334-9857-4302-af64-dc9b0647ab41","Type":"ContainerStarted","Data":"1a869b8a440dafdf19113e6a1f3a4d154f04788c22a46805222bf6dc1a4404aa"} Mar 16 16:28:58 crc kubenswrapper[5120]: I0316 16:28:58.954810 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:28:58 crc kubenswrapper[5120]: I0316 16:28:58.971616 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podStartSLOduration=2.971598444 podStartE2EDuration="2.971598444s" podCreationTimestamp="2026-03-16 16:28:56 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:28:58.960222999 +0000 UTC m=+3441.114154656" watchObservedRunningTime="2026-03-16 16:28:58.971598444 +0000 UTC m=+3441.125530101" Mar 16 16:29:00 crc kubenswrapper[5120]: I0316 16:29:00.775716 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:29:00 crc kubenswrapper[5120]: I0316 16:29:00.776738 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="cbea120d-f042-4865-b9ee-99fdd90eac9f" containerName="ceilometer-central-agent" containerID="cri-o://e7447c12a77855e08a7c6509353d29f19a1a02ab402d93177bba6026dd48d33d" gracePeriod=30 Mar 16 16:29:00 crc kubenswrapper[5120]: I0316 16:29:00.777417 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="cbea120d-f042-4865-b9ee-99fdd90eac9f" containerName="proxy-httpd" containerID="cri-o://7eb3a4bef235ab6c4850c61fa77e495251ecc771a2506cc7be8d021f127aa208" gracePeriod=30 Mar 16 16:29:00 crc kubenswrapper[5120]: I0316 16:29:00.777501 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="cbea120d-f042-4865-b9ee-99fdd90eac9f" containerName="sg-core" containerID="cri-o://0e4dcbb62b536f5017ac2b27bbeb0a2a06a41a12753b01b90712287f20bed196" gracePeriod=30 Mar 16 16:29:00 crc kubenswrapper[5120]: I0316 16:29:00.779144 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="cbea120d-f042-4865-b9ee-99fdd90eac9f" containerName="ceilometer-notification-agent" containerID="cri-o://01172870e91626ffd852c4fe4da6c0fea0d09cbb096d4d5ae8471ddded640a29" gracePeriod=30 Mar 16 16:29:00 crc kubenswrapper[5120]: I0316 16:29:00.785370 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/ceilometer-0" podUID="cbea120d-f042-4865-b9ee-99fdd90eac9f" containerName="proxy-httpd" probeResult="failure" output="Get \"http://10.217.1.253:3000/\": EOF" Mar 16 16:29:00 crc kubenswrapper[5120]: I0316 16:29:00.972686 5120 generic.go:358] "Generic (PLEG): container finished" podID="cbea120d-f042-4865-b9ee-99fdd90eac9f" containerID="7eb3a4bef235ab6c4850c61fa77e495251ecc771a2506cc7be8d021f127aa208" exitCode=0 Mar 16 16:29:00 crc kubenswrapper[5120]: I0316 16:29:00.972736 5120 generic.go:358] "Generic (PLEG): container finished" podID="cbea120d-f042-4865-b9ee-99fdd90eac9f" containerID="0e4dcbb62b536f5017ac2b27bbeb0a2a06a41a12753b01b90712287f20bed196" exitCode=2 Mar 16 16:29:00 crc kubenswrapper[5120]: I0316 16:29:00.974319 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"cbea120d-f042-4865-b9ee-99fdd90eac9f","Type":"ContainerDied","Data":"7eb3a4bef235ab6c4850c61fa77e495251ecc771a2506cc7be8d021f127aa208"} Mar 16 16:29:00 crc kubenswrapper[5120]: I0316 16:29:00.974350 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"cbea120d-f042-4865-b9ee-99fdd90eac9f","Type":"ContainerDied","Data":"0e4dcbb62b536f5017ac2b27bbeb0a2a06a41a12753b01b90712287f20bed196"} Mar 16 16:29:01 crc kubenswrapper[5120]: I0316 16:29:01.288096 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:29:01 crc kubenswrapper[5120]: I0316 16:29:01.288619 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="a18dff22-11a9-4408-b3a8-03c411b4a2b5" containerName="nova-api-log" containerID="cri-o://9689c8576af5b2aedaa33d2893728726e157ce77bb56c0aedeade2402ab70b10" gracePeriod=30 Mar 16 16:29:01 crc kubenswrapper[5120]: I0316 16:29:01.288850 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="a18dff22-11a9-4408-b3a8-03c411b4a2b5" containerName="nova-api-api" containerID="cri-o://03421e4e66249e753c347752a7939b3311117ca6aaa5a28839cc1dcb51ee21fb" gracePeriod=30 Mar 16 16:29:01 crc kubenswrapper[5120]: I0316 16:29:01.344520 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:29:01 crc kubenswrapper[5120]: I0316 16:29:01.983702 5120 generic.go:358] "Generic (PLEG): container finished" podID="a18dff22-11a9-4408-b3a8-03c411b4a2b5" containerID="9689c8576af5b2aedaa33d2893728726e157ce77bb56c0aedeade2402ab70b10" exitCode=143 Mar 16 16:29:01 crc kubenswrapper[5120]: I0316 16:29:01.984076 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"a18dff22-11a9-4408-b3a8-03c411b4a2b5","Type":"ContainerDied","Data":"9689c8576af5b2aedaa33d2893728726e157ce77bb56c0aedeade2402ab70b10"} Mar 16 16:29:01 crc kubenswrapper[5120]: I0316 16:29:01.987572 5120 generic.go:358] "Generic (PLEG): container finished" podID="cbea120d-f042-4865-b9ee-99fdd90eac9f" containerID="01172870e91626ffd852c4fe4da6c0fea0d09cbb096d4d5ae8471ddded640a29" exitCode=0 Mar 16 16:29:01 crc kubenswrapper[5120]: I0316 16:29:01.987606 5120 generic.go:358] "Generic (PLEG): container finished" podID="cbea120d-f042-4865-b9ee-99fdd90eac9f" containerID="e7447c12a77855e08a7c6509353d29f19a1a02ab402d93177bba6026dd48d33d" exitCode=0 Mar 16 16:29:01 crc kubenswrapper[5120]: I0316 16:29:01.987640 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"cbea120d-f042-4865-b9ee-99fdd90eac9f","Type":"ContainerDied","Data":"01172870e91626ffd852c4fe4da6c0fea0d09cbb096d4d5ae8471ddded640a29"} Mar 16 16:29:01 crc kubenswrapper[5120]: I0316 16:29:01.987664 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"cbea120d-f042-4865-b9ee-99fdd90eac9f","Type":"ContainerDied","Data":"e7447c12a77855e08a7c6509353d29f19a1a02ab402d93177bba6026dd48d33d"} Mar 16 16:29:01 crc kubenswrapper[5120]: I0316 16:29:01.987673 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"cbea120d-f042-4865-b9ee-99fdd90eac9f","Type":"ContainerDied","Data":"374caaa5d25ae533dda7415399db2d81a04d53081b95b6f0fae6009f7bfe0917"} Mar 16 16:29:01 crc kubenswrapper[5120]: I0316 16:29:01.987682 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="374caaa5d25ae533dda7415399db2d81a04d53081b95b6f0fae6009f7bfe0917" Mar 16 16:29:02 crc kubenswrapper[5120]: I0316 16:29:02.045029 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:29:02 crc kubenswrapper[5120]: I0316 16:29:02.170977 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/cbea120d-f042-4865-b9ee-99fdd90eac9f-sg-core-conf-yaml\") pod \"cbea120d-f042-4865-b9ee-99fdd90eac9f\" (UID: \"cbea120d-f042-4865-b9ee-99fdd90eac9f\") " Mar 16 16:29:02 crc kubenswrapper[5120]: I0316 16:29:02.171034 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cbea120d-f042-4865-b9ee-99fdd90eac9f-combined-ca-bundle\") pod \"cbea120d-f042-4865-b9ee-99fdd90eac9f\" (UID: \"cbea120d-f042-4865-b9ee-99fdd90eac9f\") " Mar 16 16:29:02 crc kubenswrapper[5120]: I0316 16:29:02.171268 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/cbea120d-f042-4865-b9ee-99fdd90eac9f-log-httpd\") pod \"cbea120d-f042-4865-b9ee-99fdd90eac9f\" (UID: \"cbea120d-f042-4865-b9ee-99fdd90eac9f\") " Mar 16 16:29:02 crc kubenswrapper[5120]: I0316 16:29:02.171349 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/cbea120d-f042-4865-b9ee-99fdd90eac9f-scripts\") pod \"cbea120d-f042-4865-b9ee-99fdd90eac9f\" (UID: \"cbea120d-f042-4865-b9ee-99fdd90eac9f\") " Mar 16 16:29:02 crc kubenswrapper[5120]: I0316 16:29:02.171412 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jxzb9\" (UniqueName: \"kubernetes.io/projected/cbea120d-f042-4865-b9ee-99fdd90eac9f-kube-api-access-jxzb9\") pod \"cbea120d-f042-4865-b9ee-99fdd90eac9f\" (UID: \"cbea120d-f042-4865-b9ee-99fdd90eac9f\") " Mar 16 16:29:02 crc kubenswrapper[5120]: I0316 16:29:02.171434 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/cbea120d-f042-4865-b9ee-99fdd90eac9f-run-httpd\") pod \"cbea120d-f042-4865-b9ee-99fdd90eac9f\" (UID: \"cbea120d-f042-4865-b9ee-99fdd90eac9f\") " Mar 16 16:29:02 crc kubenswrapper[5120]: I0316 16:29:02.171539 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cbea120d-f042-4865-b9ee-99fdd90eac9f-config-data\") pod \"cbea120d-f042-4865-b9ee-99fdd90eac9f\" (UID: \"cbea120d-f042-4865-b9ee-99fdd90eac9f\") " Mar 16 16:29:02 crc kubenswrapper[5120]: I0316 16:29:02.172206 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cbea120d-f042-4865-b9ee-99fdd90eac9f-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "cbea120d-f042-4865-b9ee-99fdd90eac9f" (UID: "cbea120d-f042-4865-b9ee-99fdd90eac9f"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:29:02 crc kubenswrapper[5120]: I0316 16:29:02.172340 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cbea120d-f042-4865-b9ee-99fdd90eac9f-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "cbea120d-f042-4865-b9ee-99fdd90eac9f" (UID: "cbea120d-f042-4865-b9ee-99fdd90eac9f"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:29:02 crc kubenswrapper[5120]: I0316 16:29:02.178979 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cbea120d-f042-4865-b9ee-99fdd90eac9f-scripts" (OuterVolumeSpecName: "scripts") pod "cbea120d-f042-4865-b9ee-99fdd90eac9f" (UID: "cbea120d-f042-4865-b9ee-99fdd90eac9f"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:29:02 crc kubenswrapper[5120]: I0316 16:29:02.197228 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cbea120d-f042-4865-b9ee-99fdd90eac9f-kube-api-access-jxzb9" (OuterVolumeSpecName: "kube-api-access-jxzb9") pod "cbea120d-f042-4865-b9ee-99fdd90eac9f" (UID: "cbea120d-f042-4865-b9ee-99fdd90eac9f"). InnerVolumeSpecName "kube-api-access-jxzb9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:29:02 crc kubenswrapper[5120]: I0316 16:29:02.215692 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cbea120d-f042-4865-b9ee-99fdd90eac9f-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "cbea120d-f042-4865-b9ee-99fdd90eac9f" (UID: "cbea120d-f042-4865-b9ee-99fdd90eac9f"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:29:02 crc kubenswrapper[5120]: I0316 16:29:02.274309 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/cbea120d-f042-4865-b9ee-99fdd90eac9f-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:29:02 crc kubenswrapper[5120]: I0316 16:29:02.274343 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/cbea120d-f042-4865-b9ee-99fdd90eac9f-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:29:02 crc kubenswrapper[5120]: I0316 16:29:02.274353 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jxzb9\" (UniqueName: \"kubernetes.io/projected/cbea120d-f042-4865-b9ee-99fdd90eac9f-kube-api-access-jxzb9\") on node \"crc\" DevicePath \"\"" Mar 16 16:29:02 crc kubenswrapper[5120]: I0316 16:29:02.274363 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/cbea120d-f042-4865-b9ee-99fdd90eac9f-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:29:02 crc kubenswrapper[5120]: I0316 16:29:02.274371 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/cbea120d-f042-4865-b9ee-99fdd90eac9f-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 16:29:02 crc kubenswrapper[5120]: I0316 16:29:02.289001 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cbea120d-f042-4865-b9ee-99fdd90eac9f-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "cbea120d-f042-4865-b9ee-99fdd90eac9f" (UID: "cbea120d-f042-4865-b9ee-99fdd90eac9f"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:29:02 crc kubenswrapper[5120]: I0316 16:29:02.325147 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cbea120d-f042-4865-b9ee-99fdd90eac9f-config-data" (OuterVolumeSpecName: "config-data") pod "cbea120d-f042-4865-b9ee-99fdd90eac9f" (UID: "cbea120d-f042-4865-b9ee-99fdd90eac9f"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:29:02 crc kubenswrapper[5120]: I0316 16:29:02.341086 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:29:02 crc kubenswrapper[5120]: I0316 16:29:02.376621 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cbea120d-f042-4865-b9ee-99fdd90eac9f-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:29:02 crc kubenswrapper[5120]: I0316 16:29:02.376668 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cbea120d-f042-4865-b9ee-99fdd90eac9f-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:29:02 crc kubenswrapper[5120]: I0316 16:29:02.997937 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:29:03 crc kubenswrapper[5120]: I0316 16:29:03.024505 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:29:03 crc kubenswrapper[5120]: I0316 16:29:03.033195 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:29:03 crc kubenswrapper[5120]: I0316 16:29:03.049263 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:29:03 crc kubenswrapper[5120]: I0316 16:29:03.050421 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cbea120d-f042-4865-b9ee-99fdd90eac9f" containerName="ceilometer-central-agent" Mar 16 16:29:03 crc kubenswrapper[5120]: I0316 16:29:03.050438 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="cbea120d-f042-4865-b9ee-99fdd90eac9f" containerName="ceilometer-central-agent" Mar 16 16:29:03 crc kubenswrapper[5120]: I0316 16:29:03.050477 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cbea120d-f042-4865-b9ee-99fdd90eac9f" containerName="sg-core" Mar 16 16:29:03 crc kubenswrapper[5120]: I0316 16:29:03.050483 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="cbea120d-f042-4865-b9ee-99fdd90eac9f" containerName="sg-core" Mar 16 16:29:03 crc kubenswrapper[5120]: I0316 16:29:03.050494 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cbea120d-f042-4865-b9ee-99fdd90eac9f" containerName="proxy-httpd" Mar 16 16:29:03 crc kubenswrapper[5120]: I0316 16:29:03.050499 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="cbea120d-f042-4865-b9ee-99fdd90eac9f" containerName="proxy-httpd" Mar 16 16:29:03 crc kubenswrapper[5120]: I0316 16:29:03.050511 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cbea120d-f042-4865-b9ee-99fdd90eac9f" containerName="ceilometer-notification-agent" Mar 16 16:29:03 crc kubenswrapper[5120]: I0316 16:29:03.050517 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="cbea120d-f042-4865-b9ee-99fdd90eac9f" containerName="ceilometer-notification-agent" Mar 16 16:29:03 crc kubenswrapper[5120]: I0316 16:29:03.050689 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="cbea120d-f042-4865-b9ee-99fdd90eac9f" containerName="sg-core" Mar 16 16:29:03 crc kubenswrapper[5120]: I0316 16:29:03.050700 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="cbea120d-f042-4865-b9ee-99fdd90eac9f" containerName="ceilometer-notification-agent" Mar 16 16:29:03 crc kubenswrapper[5120]: I0316 16:29:03.050717 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="cbea120d-f042-4865-b9ee-99fdd90eac9f" containerName="ceilometer-central-agent" Mar 16 16:29:03 crc kubenswrapper[5120]: I0316 16:29:03.050734 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="cbea120d-f042-4865-b9ee-99fdd90eac9f" containerName="proxy-httpd" Mar 16 16:29:03 crc kubenswrapper[5120]: I0316 16:29:03.056366 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:29:03 crc kubenswrapper[5120]: I0316 16:29:03.059104 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 16:29:03 crc kubenswrapper[5120]: I0316 16:29:03.059218 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 16:29:03 crc kubenswrapper[5120]: I0316 16:29:03.059636 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:29:03 crc kubenswrapper[5120]: I0316 16:29:03.207586 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgv59\" (UniqueName: \"kubernetes.io/projected/408c9ee4-d256-4e4a-8556-766d5e984932-kube-api-access-bgv59\") pod \"ceilometer-0\" (UID: \"408c9ee4-d256-4e4a-8556-766d5e984932\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:29:03 crc kubenswrapper[5120]: I0316 16:29:03.207934 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/408c9ee4-d256-4e4a-8556-766d5e984932-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"408c9ee4-d256-4e4a-8556-766d5e984932\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:29:03 crc kubenswrapper[5120]: I0316 16:29:03.208043 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/408c9ee4-d256-4e4a-8556-766d5e984932-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"408c9ee4-d256-4e4a-8556-766d5e984932\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:29:03 crc kubenswrapper[5120]: I0316 16:29:03.208152 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/408c9ee4-d256-4e4a-8556-766d5e984932-config-data\") pod \"ceilometer-0\" (UID: \"408c9ee4-d256-4e4a-8556-766d5e984932\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:29:03 crc kubenswrapper[5120]: I0316 16:29:03.208509 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/408c9ee4-d256-4e4a-8556-766d5e984932-scripts\") pod \"ceilometer-0\" (UID: \"408c9ee4-d256-4e4a-8556-766d5e984932\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:29:03 crc kubenswrapper[5120]: I0316 16:29:03.208698 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/408c9ee4-d256-4e4a-8556-766d5e984932-run-httpd\") pod \"ceilometer-0\" (UID: \"408c9ee4-d256-4e4a-8556-766d5e984932\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:29:03 crc kubenswrapper[5120]: I0316 16:29:03.208879 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/408c9ee4-d256-4e4a-8556-766d5e984932-log-httpd\") pod \"ceilometer-0\" (UID: \"408c9ee4-d256-4e4a-8556-766d5e984932\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:29:03 crc kubenswrapper[5120]: I0316 16:29:03.311538 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/408c9ee4-d256-4e4a-8556-766d5e984932-config-data\") pod \"ceilometer-0\" (UID: \"408c9ee4-d256-4e4a-8556-766d5e984932\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:29:03 crc kubenswrapper[5120]: I0316 16:29:03.311832 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/408c9ee4-d256-4e4a-8556-766d5e984932-scripts\") pod \"ceilometer-0\" (UID: \"408c9ee4-d256-4e4a-8556-766d5e984932\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:29:03 crc kubenswrapper[5120]: I0316 16:29:03.311993 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/408c9ee4-d256-4e4a-8556-766d5e984932-run-httpd\") pod \"ceilometer-0\" (UID: \"408c9ee4-d256-4e4a-8556-766d5e984932\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:29:03 crc kubenswrapper[5120]: I0316 16:29:03.312514 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/408c9ee4-d256-4e4a-8556-766d5e984932-run-httpd\") pod \"ceilometer-0\" (UID: \"408c9ee4-d256-4e4a-8556-766d5e984932\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:29:03 crc kubenswrapper[5120]: I0316 16:29:03.312611 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/408c9ee4-d256-4e4a-8556-766d5e984932-log-httpd\") pod \"ceilometer-0\" (UID: \"408c9ee4-d256-4e4a-8556-766d5e984932\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:29:03 crc kubenswrapper[5120]: I0316 16:29:03.312861 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/408c9ee4-d256-4e4a-8556-766d5e984932-log-httpd\") pod \"ceilometer-0\" (UID: \"408c9ee4-d256-4e4a-8556-766d5e984932\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:29:03 crc kubenswrapper[5120]: I0316 16:29:03.312865 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bgv59\" (UniqueName: \"kubernetes.io/projected/408c9ee4-d256-4e4a-8556-766d5e984932-kube-api-access-bgv59\") pod \"ceilometer-0\" (UID: \"408c9ee4-d256-4e4a-8556-766d5e984932\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:29:03 crc kubenswrapper[5120]: I0316 16:29:03.313086 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/408c9ee4-d256-4e4a-8556-766d5e984932-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"408c9ee4-d256-4e4a-8556-766d5e984932\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:29:03 crc kubenswrapper[5120]: I0316 16:29:03.313142 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/408c9ee4-d256-4e4a-8556-766d5e984932-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"408c9ee4-d256-4e4a-8556-766d5e984932\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:29:03 crc kubenswrapper[5120]: I0316 16:29:03.319448 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/408c9ee4-d256-4e4a-8556-766d5e984932-config-data\") pod \"ceilometer-0\" (UID: \"408c9ee4-d256-4e4a-8556-766d5e984932\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:29:03 crc kubenswrapper[5120]: I0316 16:29:03.319962 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/408c9ee4-d256-4e4a-8556-766d5e984932-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"408c9ee4-d256-4e4a-8556-766d5e984932\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:29:03 crc kubenswrapper[5120]: I0316 16:29:03.321632 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/408c9ee4-d256-4e4a-8556-766d5e984932-scripts\") pod \"ceilometer-0\" (UID: \"408c9ee4-d256-4e4a-8556-766d5e984932\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:29:03 crc kubenswrapper[5120]: I0316 16:29:03.335231 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/408c9ee4-d256-4e4a-8556-766d5e984932-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"408c9ee4-d256-4e4a-8556-766d5e984932\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:29:03 crc kubenswrapper[5120]: I0316 16:29:03.340797 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgv59\" (UniqueName: \"kubernetes.io/projected/408c9ee4-d256-4e4a-8556-766d5e984932-kube-api-access-bgv59\") pod \"ceilometer-0\" (UID: \"408c9ee4-d256-4e4a-8556-766d5e984932\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:29:03 crc kubenswrapper[5120]: I0316 16:29:03.374282 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:29:03 crc kubenswrapper[5120]: I0316 16:29:03.841023 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:29:03 crc kubenswrapper[5120]: W0316 16:29:03.843166 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod408c9ee4_d256_4e4a_8556_766d5e984932.slice/crio-625198882c111406f128758076f0b494dc829376097f188a52c5709b6094fc09 WatchSource:0}: Error finding container 625198882c111406f128758076f0b494dc829376097f188a52c5709b6094fc09: Status 404 returned error can't find the container with id 625198882c111406f128758076f0b494dc829376097f188a52c5709b6094fc09 Mar 16 16:29:04 crc kubenswrapper[5120]: I0316 16:29:04.008155 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"408c9ee4-d256-4e4a-8556-766d5e984932","Type":"ContainerStarted","Data":"625198882c111406f128758076f0b494dc829376097f188a52c5709b6094fc09"} Mar 16 16:29:04 crc kubenswrapper[5120]: I0316 16:29:04.678301 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cbea120d-f042-4865-b9ee-99fdd90eac9f" path="/var/lib/kubelet/pods/cbea120d-f042-4865-b9ee-99fdd90eac9f/volumes" Mar 16 16:29:04 crc kubenswrapper[5120]: I0316 16:29:04.942475 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:29:05 crc kubenswrapper[5120]: I0316 16:29:05.023220 5120 generic.go:358] "Generic (PLEG): container finished" podID="a18dff22-11a9-4408-b3a8-03c411b4a2b5" containerID="03421e4e66249e753c347752a7939b3311117ca6aaa5a28839cc1dcb51ee21fb" exitCode=0 Mar 16 16:29:05 crc kubenswrapper[5120]: I0316 16:29:05.023287 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"a18dff22-11a9-4408-b3a8-03c411b4a2b5","Type":"ContainerDied","Data":"03421e4e66249e753c347752a7939b3311117ca6aaa5a28839cc1dcb51ee21fb"} Mar 16 16:29:05 crc kubenswrapper[5120]: I0316 16:29:05.023516 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"a18dff22-11a9-4408-b3a8-03c411b4a2b5","Type":"ContainerDied","Data":"0b658550df53e9f8f0e8b76da0516860ffa0a312e6b53bf59c1b4f7cf0c1f10f"} Mar 16 16:29:05 crc kubenswrapper[5120]: I0316 16:29:05.023539 5120 scope.go:117] "RemoveContainer" containerID="03421e4e66249e753c347752a7939b3311117ca6aaa5a28839cc1dcb51ee21fb" Mar 16 16:29:05 crc kubenswrapper[5120]: I0316 16:29:05.023330 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:29:05 crc kubenswrapper[5120]: I0316 16:29:05.027248 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"408c9ee4-d256-4e4a-8556-766d5e984932","Type":"ContainerStarted","Data":"08b6130b68045706a6c795516223a6c0684602ba41f2e2e63872f2d33e0ce38c"} Mar 16 16:29:05 crc kubenswrapper[5120]: I0316 16:29:05.051197 5120 scope.go:117] "RemoveContainer" containerID="9689c8576af5b2aedaa33d2893728726e157ce77bb56c0aedeade2402ab70b10" Mar 16 16:29:05 crc kubenswrapper[5120]: I0316 16:29:05.056861 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-28kj6\" (UniqueName: \"kubernetes.io/projected/a18dff22-11a9-4408-b3a8-03c411b4a2b5-kube-api-access-28kj6\") pod \"a18dff22-11a9-4408-b3a8-03c411b4a2b5\" (UID: \"a18dff22-11a9-4408-b3a8-03c411b4a2b5\") " Mar 16 16:29:05 crc kubenswrapper[5120]: I0316 16:29:05.056996 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a18dff22-11a9-4408-b3a8-03c411b4a2b5-config-data\") pod \"a18dff22-11a9-4408-b3a8-03c411b4a2b5\" (UID: \"a18dff22-11a9-4408-b3a8-03c411b4a2b5\") " Mar 16 16:29:05 crc kubenswrapper[5120]: I0316 16:29:05.057059 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a18dff22-11a9-4408-b3a8-03c411b4a2b5-combined-ca-bundle\") pod \"a18dff22-11a9-4408-b3a8-03c411b4a2b5\" (UID: \"a18dff22-11a9-4408-b3a8-03c411b4a2b5\") " Mar 16 16:29:05 crc kubenswrapper[5120]: I0316 16:29:05.057334 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a18dff22-11a9-4408-b3a8-03c411b4a2b5-logs\") pod \"a18dff22-11a9-4408-b3a8-03c411b4a2b5\" (UID: \"a18dff22-11a9-4408-b3a8-03c411b4a2b5\") " Mar 16 16:29:05 crc kubenswrapper[5120]: I0316 16:29:05.058090 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a18dff22-11a9-4408-b3a8-03c411b4a2b5-logs" (OuterVolumeSpecName: "logs") pod "a18dff22-11a9-4408-b3a8-03c411b4a2b5" (UID: "a18dff22-11a9-4408-b3a8-03c411b4a2b5"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:29:05 crc kubenswrapper[5120]: I0316 16:29:05.062629 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a18dff22-11a9-4408-b3a8-03c411b4a2b5-kube-api-access-28kj6" (OuterVolumeSpecName: "kube-api-access-28kj6") pod "a18dff22-11a9-4408-b3a8-03c411b4a2b5" (UID: "a18dff22-11a9-4408-b3a8-03c411b4a2b5"). InnerVolumeSpecName "kube-api-access-28kj6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:29:05 crc kubenswrapper[5120]: I0316 16:29:05.087641 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a18dff22-11a9-4408-b3a8-03c411b4a2b5-config-data" (OuterVolumeSpecName: "config-data") pod "a18dff22-11a9-4408-b3a8-03c411b4a2b5" (UID: "a18dff22-11a9-4408-b3a8-03c411b4a2b5"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:29:05 crc kubenswrapper[5120]: I0316 16:29:05.088216 5120 scope.go:117] "RemoveContainer" containerID="03421e4e66249e753c347752a7939b3311117ca6aaa5a28839cc1dcb51ee21fb" Mar 16 16:29:05 crc kubenswrapper[5120]: E0316 16:29:05.088623 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"03421e4e66249e753c347752a7939b3311117ca6aaa5a28839cc1dcb51ee21fb\": container with ID starting with 03421e4e66249e753c347752a7939b3311117ca6aaa5a28839cc1dcb51ee21fb not found: ID does not exist" containerID="03421e4e66249e753c347752a7939b3311117ca6aaa5a28839cc1dcb51ee21fb" Mar 16 16:29:05 crc kubenswrapper[5120]: I0316 16:29:05.088658 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03421e4e66249e753c347752a7939b3311117ca6aaa5a28839cc1dcb51ee21fb"} err="failed to get container status \"03421e4e66249e753c347752a7939b3311117ca6aaa5a28839cc1dcb51ee21fb\": rpc error: code = NotFound desc = could not find container \"03421e4e66249e753c347752a7939b3311117ca6aaa5a28839cc1dcb51ee21fb\": container with ID starting with 03421e4e66249e753c347752a7939b3311117ca6aaa5a28839cc1dcb51ee21fb not found: ID does not exist" Mar 16 16:29:05 crc kubenswrapper[5120]: I0316 16:29:05.088681 5120 scope.go:117] "RemoveContainer" containerID="9689c8576af5b2aedaa33d2893728726e157ce77bb56c0aedeade2402ab70b10" Mar 16 16:29:05 crc kubenswrapper[5120]: E0316 16:29:05.089149 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9689c8576af5b2aedaa33d2893728726e157ce77bb56c0aedeade2402ab70b10\": container with ID starting with 9689c8576af5b2aedaa33d2893728726e157ce77bb56c0aedeade2402ab70b10 not found: ID does not exist" containerID="9689c8576af5b2aedaa33d2893728726e157ce77bb56c0aedeade2402ab70b10" Mar 16 16:29:05 crc kubenswrapper[5120]: I0316 16:29:05.089182 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9689c8576af5b2aedaa33d2893728726e157ce77bb56c0aedeade2402ab70b10"} err="failed to get container status \"9689c8576af5b2aedaa33d2893728726e157ce77bb56c0aedeade2402ab70b10\": rpc error: code = NotFound desc = could not find container \"9689c8576af5b2aedaa33d2893728726e157ce77bb56c0aedeade2402ab70b10\": container with ID starting with 9689c8576af5b2aedaa33d2893728726e157ce77bb56c0aedeade2402ab70b10 not found: ID does not exist" Mar 16 16:29:05 crc kubenswrapper[5120]: I0316 16:29:05.105386 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a18dff22-11a9-4408-b3a8-03c411b4a2b5-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "a18dff22-11a9-4408-b3a8-03c411b4a2b5" (UID: "a18dff22-11a9-4408-b3a8-03c411b4a2b5"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:29:05 crc kubenswrapper[5120]: I0316 16:29:05.160217 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-28kj6\" (UniqueName: \"kubernetes.io/projected/a18dff22-11a9-4408-b3a8-03c411b4a2b5-kube-api-access-28kj6\") on node \"crc\" DevicePath \"\"" Mar 16 16:29:05 crc kubenswrapper[5120]: I0316 16:29:05.160259 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a18dff22-11a9-4408-b3a8-03c411b4a2b5-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:29:05 crc kubenswrapper[5120]: I0316 16:29:05.160282 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a18dff22-11a9-4408-b3a8-03c411b4a2b5-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:29:05 crc kubenswrapper[5120]: I0316 16:29:05.160296 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a18dff22-11a9-4408-b3a8-03c411b4a2b5-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:29:05 crc kubenswrapper[5120]: I0316 16:29:05.368291 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:29:05 crc kubenswrapper[5120]: I0316 16:29:05.389464 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:29:05 crc kubenswrapper[5120]: I0316 16:29:05.400372 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:29:05 crc kubenswrapper[5120]: I0316 16:29:05.401616 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a18dff22-11a9-4408-b3a8-03c411b4a2b5" containerName="nova-api-log" Mar 16 16:29:05 crc kubenswrapper[5120]: I0316 16:29:05.401639 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a18dff22-11a9-4408-b3a8-03c411b4a2b5" containerName="nova-api-log" Mar 16 16:29:05 crc kubenswrapper[5120]: I0316 16:29:05.401660 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a18dff22-11a9-4408-b3a8-03c411b4a2b5" containerName="nova-api-api" Mar 16 16:29:05 crc kubenswrapper[5120]: I0316 16:29:05.401666 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a18dff22-11a9-4408-b3a8-03c411b4a2b5" containerName="nova-api-api" Mar 16 16:29:05 crc kubenswrapper[5120]: I0316 16:29:05.401884 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="a18dff22-11a9-4408-b3a8-03c411b4a2b5" containerName="nova-api-api" Mar 16 16:29:05 crc kubenswrapper[5120]: I0316 16:29:05.401898 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="a18dff22-11a9-4408-b3a8-03c411b4a2b5" containerName="nova-api-log" Mar 16 16:29:05 crc kubenswrapper[5120]: I0316 16:29:05.407372 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:29:05 crc kubenswrapper[5120]: I0316 16:29:05.409588 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-internal-svc\"" Mar 16 16:29:05 crc kubenswrapper[5120]: I0316 16:29:05.422681 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-public-svc\"" Mar 16 16:29:05 crc kubenswrapper[5120]: I0316 16:29:05.423428 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-config-data\"" Mar 16 16:29:05 crc kubenswrapper[5120]: I0316 16:29:05.429357 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:29:05 crc kubenswrapper[5120]: I0316 16:29:05.469251 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2222ff16-53f4-4814-9321-fe0c8475b658-logs\") pod \"nova-api-0\" (UID: \"2222ff16-53f4-4814-9321-fe0c8475b658\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:29:05 crc kubenswrapper[5120]: I0316 16:29:05.470646 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/2222ff16-53f4-4814-9321-fe0c8475b658-internal-tls-certs\") pod \"nova-api-0\" (UID: \"2222ff16-53f4-4814-9321-fe0c8475b658\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:29:05 crc kubenswrapper[5120]: I0316 16:29:05.470967 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drrsb\" (UniqueName: \"kubernetes.io/projected/2222ff16-53f4-4814-9321-fe0c8475b658-kube-api-access-drrsb\") pod \"nova-api-0\" (UID: \"2222ff16-53f4-4814-9321-fe0c8475b658\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:29:05 crc kubenswrapper[5120]: I0316 16:29:05.471053 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2222ff16-53f4-4814-9321-fe0c8475b658-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"2222ff16-53f4-4814-9321-fe0c8475b658\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:29:05 crc kubenswrapper[5120]: I0316 16:29:05.471350 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2222ff16-53f4-4814-9321-fe0c8475b658-config-data\") pod \"nova-api-0\" (UID: \"2222ff16-53f4-4814-9321-fe0c8475b658\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:29:05 crc kubenswrapper[5120]: I0316 16:29:05.471419 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/2222ff16-53f4-4814-9321-fe0c8475b658-public-tls-certs\") pod \"nova-api-0\" (UID: \"2222ff16-53f4-4814-9321-fe0c8475b658\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:29:05 crc kubenswrapper[5120]: I0316 16:29:05.575741 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-drrsb\" (UniqueName: \"kubernetes.io/projected/2222ff16-53f4-4814-9321-fe0c8475b658-kube-api-access-drrsb\") pod \"nova-api-0\" (UID: \"2222ff16-53f4-4814-9321-fe0c8475b658\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:29:05 crc kubenswrapper[5120]: I0316 16:29:05.575867 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2222ff16-53f4-4814-9321-fe0c8475b658-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"2222ff16-53f4-4814-9321-fe0c8475b658\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:29:05 crc kubenswrapper[5120]: I0316 16:29:05.576119 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2222ff16-53f4-4814-9321-fe0c8475b658-config-data\") pod \"nova-api-0\" (UID: \"2222ff16-53f4-4814-9321-fe0c8475b658\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:29:05 crc kubenswrapper[5120]: I0316 16:29:05.576206 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/2222ff16-53f4-4814-9321-fe0c8475b658-public-tls-certs\") pod \"nova-api-0\" (UID: \"2222ff16-53f4-4814-9321-fe0c8475b658\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:29:05 crc kubenswrapper[5120]: I0316 16:29:05.576313 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2222ff16-53f4-4814-9321-fe0c8475b658-logs\") pod \"nova-api-0\" (UID: \"2222ff16-53f4-4814-9321-fe0c8475b658\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:29:05 crc kubenswrapper[5120]: I0316 16:29:05.576954 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/2222ff16-53f4-4814-9321-fe0c8475b658-internal-tls-certs\") pod \"nova-api-0\" (UID: \"2222ff16-53f4-4814-9321-fe0c8475b658\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:29:05 crc kubenswrapper[5120]: I0316 16:29:05.579239 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2222ff16-53f4-4814-9321-fe0c8475b658-logs\") pod \"nova-api-0\" (UID: \"2222ff16-53f4-4814-9321-fe0c8475b658\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:29:05 crc kubenswrapper[5120]: I0316 16:29:05.589621 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/2222ff16-53f4-4814-9321-fe0c8475b658-internal-tls-certs\") pod \"nova-api-0\" (UID: \"2222ff16-53f4-4814-9321-fe0c8475b658\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:29:05 crc kubenswrapper[5120]: I0316 16:29:05.592650 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2222ff16-53f4-4814-9321-fe0c8475b658-config-data\") pod \"nova-api-0\" (UID: \"2222ff16-53f4-4814-9321-fe0c8475b658\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:29:05 crc kubenswrapper[5120]: I0316 16:29:05.594084 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/2222ff16-53f4-4814-9321-fe0c8475b658-public-tls-certs\") pod \"nova-api-0\" (UID: \"2222ff16-53f4-4814-9321-fe0c8475b658\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:29:05 crc kubenswrapper[5120]: I0316 16:29:05.598697 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2222ff16-53f4-4814-9321-fe0c8475b658-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"2222ff16-53f4-4814-9321-fe0c8475b658\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:29:05 crc kubenswrapper[5120]: I0316 16:29:05.605798 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-drrsb\" (UniqueName: \"kubernetes.io/projected/2222ff16-53f4-4814-9321-fe0c8475b658-kube-api-access-drrsb\") pod \"nova-api-0\" (UID: \"2222ff16-53f4-4814-9321-fe0c8475b658\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:29:05 crc kubenswrapper[5120]: I0316 16:29:05.741752 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:29:05 crc kubenswrapper[5120]: I0316 16:29:05.895198 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-operators-brknw" Mar 16 16:29:05 crc kubenswrapper[5120]: I0316 16:29:05.973585 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-operators-brknw" Mar 16 16:29:06 crc kubenswrapper[5120]: I0316 16:29:06.067523 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"408c9ee4-d256-4e4a-8556-766d5e984932","Type":"ContainerStarted","Data":"c22449fd82f04d62093aec2428075908953a94f0e175765a293ca2df9b50f31c"} Mar 16 16:29:06 crc kubenswrapper[5120]: I0316 16:29:06.137728 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-operators-brknw"] Mar 16 16:29:06 crc kubenswrapper[5120]: I0316 16:29:06.344786 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:29:06 crc kubenswrapper[5120]: I0316 16:29:06.392659 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:29:06 crc kubenswrapper[5120]: I0316 16:29:06.609155 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:29:06 crc kubenswrapper[5120]: I0316 16:29:06.674262 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a18dff22-11a9-4408-b3a8-03c411b4a2b5" path="/var/lib/kubelet/pods/a18dff22-11a9-4408-b3a8-03c411b4a2b5/volumes" Mar 16 16:29:07 crc kubenswrapper[5120]: I0316 16:29:07.088727 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"2222ff16-53f4-4814-9321-fe0c8475b658","Type":"ContainerStarted","Data":"e8e5075ec3a29fb239ec34029b58c5c9064b2a88a2f9862df7a4aac32fae2b92"} Mar 16 16:29:07 crc kubenswrapper[5120]: I0316 16:29:07.089691 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"2222ff16-53f4-4814-9321-fe0c8475b658","Type":"ContainerStarted","Data":"35fa732d11b91cf0798c6bea5614131da51d495c27e8d085d544ff3d358e68f4"} Mar 16 16:29:07 crc kubenswrapper[5120]: I0316 16:29:07.101808 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"408c9ee4-d256-4e4a-8556-766d5e984932","Type":"ContainerStarted","Data":"8985b537fc3aa7457660f262f4654719890ab41800c67adf11093fc3b5ebe83b"} Mar 16 16:29:07 crc kubenswrapper[5120]: I0316 16:29:07.102374 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-marketplace/redhat-operators-brknw" podUID="128632ac-9a88-4aa7-adc6-5d5eb264a19b" containerName="registry-server" containerID="cri-o://4b349b53220cbe6fbacd3af24eedcd9c7014d9e22b2f92d7666a00c13bc62264" gracePeriod=2 Mar 16 16:29:07 crc kubenswrapper[5120]: I0316 16:29:07.136531 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=2.136515533 podStartE2EDuration="2.136515533s" podCreationTimestamp="2026-03-16 16:29:05 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:29:07.132644539 +0000 UTC m=+3449.286576196" watchObservedRunningTime="2026-03-16 16:29:07.136515533 +0000 UTC m=+3449.290447190" Mar 16 16:29:07 crc kubenswrapper[5120]: I0316 16:29:07.144033 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:29:07 crc kubenswrapper[5120]: I0316 16:29:07.342218 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:29:07 crc kubenswrapper[5120]: I0316 16:29:07.380732 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:29:07 crc kubenswrapper[5120]: I0316 16:29:07.576720 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-brknw" Mar 16 16:29:07 crc kubenswrapper[5120]: I0316 16:29:07.637263 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/128632ac-9a88-4aa7-adc6-5d5eb264a19b-utilities\") pod \"128632ac-9a88-4aa7-adc6-5d5eb264a19b\" (UID: \"128632ac-9a88-4aa7-adc6-5d5eb264a19b\") " Mar 16 16:29:07 crc kubenswrapper[5120]: I0316 16:29:07.637407 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-55btx\" (UniqueName: \"kubernetes.io/projected/128632ac-9a88-4aa7-adc6-5d5eb264a19b-kube-api-access-55btx\") pod \"128632ac-9a88-4aa7-adc6-5d5eb264a19b\" (UID: \"128632ac-9a88-4aa7-adc6-5d5eb264a19b\") " Mar 16 16:29:07 crc kubenswrapper[5120]: I0316 16:29:07.637602 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/128632ac-9a88-4aa7-adc6-5d5eb264a19b-catalog-content\") pod \"128632ac-9a88-4aa7-adc6-5d5eb264a19b\" (UID: \"128632ac-9a88-4aa7-adc6-5d5eb264a19b\") " Mar 16 16:29:07 crc kubenswrapper[5120]: I0316 16:29:07.638373 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/128632ac-9a88-4aa7-adc6-5d5eb264a19b-utilities" (OuterVolumeSpecName: "utilities") pod "128632ac-9a88-4aa7-adc6-5d5eb264a19b" (UID: "128632ac-9a88-4aa7-adc6-5d5eb264a19b"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:29:07 crc kubenswrapper[5120]: I0316 16:29:07.646228 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/128632ac-9a88-4aa7-adc6-5d5eb264a19b-kube-api-access-55btx" (OuterVolumeSpecName: "kube-api-access-55btx") pod "128632ac-9a88-4aa7-adc6-5d5eb264a19b" (UID: "128632ac-9a88-4aa7-adc6-5d5eb264a19b"). InnerVolumeSpecName "kube-api-access-55btx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:29:07 crc kubenswrapper[5120]: I0316 16:29:07.743444 5120 reconciler_common.go:299] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/128632ac-9a88-4aa7-adc6-5d5eb264a19b-utilities\") on node \"crc\" DevicePath \"\"" Mar 16 16:29:07 crc kubenswrapper[5120]: I0316 16:29:07.743484 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-55btx\" (UniqueName: \"kubernetes.io/projected/128632ac-9a88-4aa7-adc6-5d5eb264a19b-kube-api-access-55btx\") on node \"crc\" DevicePath \"\"" Mar 16 16:29:07 crc kubenswrapper[5120]: I0316 16:29:07.763995 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/128632ac-9a88-4aa7-adc6-5d5eb264a19b-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "128632ac-9a88-4aa7-adc6-5d5eb264a19b" (UID: "128632ac-9a88-4aa7-adc6-5d5eb264a19b"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:29:07 crc kubenswrapper[5120]: I0316 16:29:07.845608 5120 reconciler_common.go:299] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/128632ac-9a88-4aa7-adc6-5d5eb264a19b-catalog-content\") on node \"crc\" DevicePath \"\"" Mar 16 16:29:08 crc kubenswrapper[5120]: I0316 16:29:08.116380 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"2222ff16-53f4-4814-9321-fe0c8475b658","Type":"ContainerStarted","Data":"84c52923a8d73c22657aa833c3bc70f15d0b60cecf5ba89bf8a91b6c084a8bc3"} Mar 16 16:29:08 crc kubenswrapper[5120]: I0316 16:29:08.119861 5120 generic.go:358] "Generic (PLEG): container finished" podID="128632ac-9a88-4aa7-adc6-5d5eb264a19b" containerID="4b349b53220cbe6fbacd3af24eedcd9c7014d9e22b2f92d7666a00c13bc62264" exitCode=0 Mar 16 16:29:08 crc kubenswrapper[5120]: I0316 16:29:08.119939 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-brknw" Mar 16 16:29:08 crc kubenswrapper[5120]: I0316 16:29:08.120256 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-brknw" event={"ID":"128632ac-9a88-4aa7-adc6-5d5eb264a19b","Type":"ContainerDied","Data":"4b349b53220cbe6fbacd3af24eedcd9c7014d9e22b2f92d7666a00c13bc62264"} Mar 16 16:29:08 crc kubenswrapper[5120]: I0316 16:29:08.120293 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-brknw" event={"ID":"128632ac-9a88-4aa7-adc6-5d5eb264a19b","Type":"ContainerDied","Data":"44e4f3e66ef5b9311894c05abc70f058d685c83454ee7395d7863bee57864aa7"} Mar 16 16:29:08 crc kubenswrapper[5120]: I0316 16:29:08.120311 5120 scope.go:117] "RemoveContainer" containerID="4b349b53220cbe6fbacd3af24eedcd9c7014d9e22b2f92d7666a00c13bc62264" Mar 16 16:29:08 crc kubenswrapper[5120]: I0316 16:29:08.145708 5120 scope.go:117] "RemoveContainer" containerID="6fa7db4adc7eab36aa80af6c16a2b7db613cf1910dbe99199a656b54c0fc3222" Mar 16 16:29:08 crc kubenswrapper[5120]: I0316 16:29:08.157002 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:29:08 crc kubenswrapper[5120]: I0316 16:29:08.160836 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-operators-brknw"] Mar 16 16:29:08 crc kubenswrapper[5120]: I0316 16:29:08.168968 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/redhat-operators-brknw"] Mar 16 16:29:08 crc kubenswrapper[5120]: I0316 16:29:08.180335 5120 scope.go:117] "RemoveContainer" containerID="28cb2711bf8206e808690cd927dd9a75e3180e78510c69bf71d027eda96968df" Mar 16 16:29:08 crc kubenswrapper[5120]: I0316 16:29:08.257478 5120 scope.go:117] "RemoveContainer" containerID="4b349b53220cbe6fbacd3af24eedcd9c7014d9e22b2f92d7666a00c13bc62264" Mar 16 16:29:08 crc kubenswrapper[5120]: E0316 16:29:08.258067 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b349b53220cbe6fbacd3af24eedcd9c7014d9e22b2f92d7666a00c13bc62264\": container with ID starting with 4b349b53220cbe6fbacd3af24eedcd9c7014d9e22b2f92d7666a00c13bc62264 not found: ID does not exist" containerID="4b349b53220cbe6fbacd3af24eedcd9c7014d9e22b2f92d7666a00c13bc62264" Mar 16 16:29:08 crc kubenswrapper[5120]: I0316 16:29:08.258094 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b349b53220cbe6fbacd3af24eedcd9c7014d9e22b2f92d7666a00c13bc62264"} err="failed to get container status \"4b349b53220cbe6fbacd3af24eedcd9c7014d9e22b2f92d7666a00c13bc62264\": rpc error: code = NotFound desc = could not find container \"4b349b53220cbe6fbacd3af24eedcd9c7014d9e22b2f92d7666a00c13bc62264\": container with ID starting with 4b349b53220cbe6fbacd3af24eedcd9c7014d9e22b2f92d7666a00c13bc62264 not found: ID does not exist" Mar 16 16:29:08 crc kubenswrapper[5120]: I0316 16:29:08.258113 5120 scope.go:117] "RemoveContainer" containerID="6fa7db4adc7eab36aa80af6c16a2b7db613cf1910dbe99199a656b54c0fc3222" Mar 16 16:29:08 crc kubenswrapper[5120]: E0316 16:29:08.258354 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6fa7db4adc7eab36aa80af6c16a2b7db613cf1910dbe99199a656b54c0fc3222\": container with ID starting with 6fa7db4adc7eab36aa80af6c16a2b7db613cf1910dbe99199a656b54c0fc3222 not found: ID does not exist" containerID="6fa7db4adc7eab36aa80af6c16a2b7db613cf1910dbe99199a656b54c0fc3222" Mar 16 16:29:08 crc kubenswrapper[5120]: I0316 16:29:08.258376 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6fa7db4adc7eab36aa80af6c16a2b7db613cf1910dbe99199a656b54c0fc3222"} err="failed to get container status \"6fa7db4adc7eab36aa80af6c16a2b7db613cf1910dbe99199a656b54c0fc3222\": rpc error: code = NotFound desc = could not find container \"6fa7db4adc7eab36aa80af6c16a2b7db613cf1910dbe99199a656b54c0fc3222\": container with ID starting with 6fa7db4adc7eab36aa80af6c16a2b7db613cf1910dbe99199a656b54c0fc3222 not found: ID does not exist" Mar 16 16:29:08 crc kubenswrapper[5120]: I0316 16:29:08.258389 5120 scope.go:117] "RemoveContainer" containerID="28cb2711bf8206e808690cd927dd9a75e3180e78510c69bf71d027eda96968df" Mar 16 16:29:08 crc kubenswrapper[5120]: E0316 16:29:08.258631 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"28cb2711bf8206e808690cd927dd9a75e3180e78510c69bf71d027eda96968df\": container with ID starting with 28cb2711bf8206e808690cd927dd9a75e3180e78510c69bf71d027eda96968df not found: ID does not exist" containerID="28cb2711bf8206e808690cd927dd9a75e3180e78510c69bf71d027eda96968df" Mar 16 16:29:08 crc kubenswrapper[5120]: I0316 16:29:08.258650 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28cb2711bf8206e808690cd927dd9a75e3180e78510c69bf71d027eda96968df"} err="failed to get container status \"28cb2711bf8206e808690cd927dd9a75e3180e78510c69bf71d027eda96968df\": rpc error: code = NotFound desc = could not find container \"28cb2711bf8206e808690cd927dd9a75e3180e78510c69bf71d027eda96968df\": container with ID starting with 28cb2711bf8206e808690cd927dd9a75e3180e78510c69bf71d027eda96968df not found: ID does not exist" Mar 16 16:29:08 crc kubenswrapper[5120]: I0316 16:29:08.327296 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-n9ftq"] Mar 16 16:29:08 crc kubenswrapper[5120]: I0316 16:29:08.328605 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="128632ac-9a88-4aa7-adc6-5d5eb264a19b" containerName="extract-content" Mar 16 16:29:08 crc kubenswrapper[5120]: I0316 16:29:08.328629 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="128632ac-9a88-4aa7-adc6-5d5eb264a19b" containerName="extract-content" Mar 16 16:29:08 crc kubenswrapper[5120]: I0316 16:29:08.328665 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="128632ac-9a88-4aa7-adc6-5d5eb264a19b" containerName="extract-utilities" Mar 16 16:29:08 crc kubenswrapper[5120]: I0316 16:29:08.328672 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="128632ac-9a88-4aa7-adc6-5d5eb264a19b" containerName="extract-utilities" Mar 16 16:29:08 crc kubenswrapper[5120]: I0316 16:29:08.328728 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="128632ac-9a88-4aa7-adc6-5d5eb264a19b" containerName="registry-server" Mar 16 16:29:08 crc kubenswrapper[5120]: I0316 16:29:08.328734 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="128632ac-9a88-4aa7-adc6-5d5eb264a19b" containerName="registry-server" Mar 16 16:29:08 crc kubenswrapper[5120]: I0316 16:29:08.328945 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="128632ac-9a88-4aa7-adc6-5d5eb264a19b" containerName="registry-server" Mar 16 16:29:08 crc kubenswrapper[5120]: I0316 16:29:08.336633 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-n9ftq" Mar 16 16:29:08 crc kubenswrapper[5120]: I0316 16:29:08.351545 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-n9ftq"] Mar 16 16:29:08 crc kubenswrapper[5120]: I0316 16:29:08.353058 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-manage-config-data\"" Mar 16 16:29:08 crc kubenswrapper[5120]: I0316 16:29:08.353350 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-manage-scripts\"" Mar 16 16:29:08 crc kubenswrapper[5120]: I0316 16:29:08.462098 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cf1e3f49-2df5-4275-9df5-574067402cc7-config-data\") pod \"nova-cell1-cell-mapping-n9ftq\" (UID: \"cf1e3f49-2df5-4275-9df5-574067402cc7\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-n9ftq" Mar 16 16:29:08 crc kubenswrapper[5120]: I0316 16:29:08.462197 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cf1e3f49-2df5-4275-9df5-574067402cc7-combined-ca-bundle\") pod \"nova-cell1-cell-mapping-n9ftq\" (UID: \"cf1e3f49-2df5-4275-9df5-574067402cc7\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-n9ftq" Mar 16 16:29:08 crc kubenswrapper[5120]: I0316 16:29:08.462574 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/cf1e3f49-2df5-4275-9df5-574067402cc7-scripts\") pod \"nova-cell1-cell-mapping-n9ftq\" (UID: \"cf1e3f49-2df5-4275-9df5-574067402cc7\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-n9ftq" Mar 16 16:29:08 crc kubenswrapper[5120]: I0316 16:29:08.462777 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s85x2\" (UniqueName: \"kubernetes.io/projected/cf1e3f49-2df5-4275-9df5-574067402cc7-kube-api-access-s85x2\") pod \"nova-cell1-cell-mapping-n9ftq\" (UID: \"cf1e3f49-2df5-4275-9df5-574067402cc7\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-n9ftq" Mar 16 16:29:08 crc kubenswrapper[5120]: I0316 16:29:08.565442 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s85x2\" (UniqueName: \"kubernetes.io/projected/cf1e3f49-2df5-4275-9df5-574067402cc7-kube-api-access-s85x2\") pod \"nova-cell1-cell-mapping-n9ftq\" (UID: \"cf1e3f49-2df5-4275-9df5-574067402cc7\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-n9ftq" Mar 16 16:29:08 crc kubenswrapper[5120]: I0316 16:29:08.565985 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cf1e3f49-2df5-4275-9df5-574067402cc7-config-data\") pod \"nova-cell1-cell-mapping-n9ftq\" (UID: \"cf1e3f49-2df5-4275-9df5-574067402cc7\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-n9ftq" Mar 16 16:29:08 crc kubenswrapper[5120]: I0316 16:29:08.566088 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cf1e3f49-2df5-4275-9df5-574067402cc7-combined-ca-bundle\") pod \"nova-cell1-cell-mapping-n9ftq\" (UID: \"cf1e3f49-2df5-4275-9df5-574067402cc7\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-n9ftq" Mar 16 16:29:08 crc kubenswrapper[5120]: I0316 16:29:08.566309 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/cf1e3f49-2df5-4275-9df5-574067402cc7-scripts\") pod \"nova-cell1-cell-mapping-n9ftq\" (UID: \"cf1e3f49-2df5-4275-9df5-574067402cc7\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-n9ftq" Mar 16 16:29:08 crc kubenswrapper[5120]: I0316 16:29:08.577641 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/cf1e3f49-2df5-4275-9df5-574067402cc7-scripts\") pod \"nova-cell1-cell-mapping-n9ftq\" (UID: \"cf1e3f49-2df5-4275-9df5-574067402cc7\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-n9ftq" Mar 16 16:29:08 crc kubenswrapper[5120]: I0316 16:29:08.577993 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cf1e3f49-2df5-4275-9df5-574067402cc7-config-data\") pod \"nova-cell1-cell-mapping-n9ftq\" (UID: \"cf1e3f49-2df5-4275-9df5-574067402cc7\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-n9ftq" Mar 16 16:29:08 crc kubenswrapper[5120]: I0316 16:29:08.587490 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cf1e3f49-2df5-4275-9df5-574067402cc7-combined-ca-bundle\") pod \"nova-cell1-cell-mapping-n9ftq\" (UID: \"cf1e3f49-2df5-4275-9df5-574067402cc7\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-n9ftq" Mar 16 16:29:08 crc kubenswrapper[5120]: I0316 16:29:08.589438 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s85x2\" (UniqueName: \"kubernetes.io/projected/cf1e3f49-2df5-4275-9df5-574067402cc7-kube-api-access-s85x2\") pod \"nova-cell1-cell-mapping-n9ftq\" (UID: \"cf1e3f49-2df5-4275-9df5-574067402cc7\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-n9ftq" Mar 16 16:29:08 crc kubenswrapper[5120]: I0316 16:29:08.686004 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="128632ac-9a88-4aa7-adc6-5d5eb264a19b" path="/var/lib/kubelet/pods/128632ac-9a88-4aa7-adc6-5d5eb264a19b/volumes" Mar 16 16:29:08 crc kubenswrapper[5120]: I0316 16:29:08.715463 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-n9ftq" Mar 16 16:29:09 crc kubenswrapper[5120]: I0316 16:29:09.135563 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"408c9ee4-d256-4e4a-8556-766d5e984932","Type":"ContainerStarted","Data":"97bd869ff302904ff904e816d906fb8c8b0e9795c565cf8f364f4a5b265086c7"} Mar 16 16:29:09 crc kubenswrapper[5120]: I0316 16:29:09.136057 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:29:09 crc kubenswrapper[5120]: I0316 16:29:09.197996 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=1.137775625 podStartE2EDuration="6.197974161s" podCreationTimestamp="2026-03-16 16:29:03 +0000 UTC" firstStartedPulling="2026-03-16 16:29:03.845534698 +0000 UTC m=+3445.999466355" lastFinishedPulling="2026-03-16 16:29:08.905733234 +0000 UTC m=+3451.059664891" observedRunningTime="2026-03-16 16:29:09.189299959 +0000 UTC m=+3451.343231626" watchObservedRunningTime="2026-03-16 16:29:09.197974161 +0000 UTC m=+3451.351905818" Mar 16 16:29:09 crc kubenswrapper[5120]: W0316 16:29:09.220057 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcf1e3f49_2df5_4275_9df5_574067402cc7.slice/crio-85e89666b96c799da6481e51b71a4f83b5f459a7af7a72da55db5b0f1f5418af WatchSource:0}: Error finding container 85e89666b96c799da6481e51b71a4f83b5f459a7af7a72da55db5b0f1f5418af: Status 404 returned error can't find the container with id 85e89666b96c799da6481e51b71a4f83b5f459a7af7a72da55db5b0f1f5418af Mar 16 16:29:09 crc kubenswrapper[5120]: I0316 16:29:09.228404 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-n9ftq"] Mar 16 16:29:09 crc kubenswrapper[5120]: E0316 16:29:09.445587 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=2087036 actualBytes=10240 Mar 16 16:29:10 crc kubenswrapper[5120]: I0316 16:29:10.146714 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-n9ftq" event={"ID":"cf1e3f49-2df5-4275-9df5-574067402cc7","Type":"ContainerStarted","Data":"0eeb60bb39860d8f23bc80ce0eabaf70f69230cb0654b4562cd5bc025b36adf6"} Mar 16 16:29:10 crc kubenswrapper[5120]: I0316 16:29:10.146773 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-n9ftq" event={"ID":"cf1e3f49-2df5-4275-9df5-574067402cc7","Type":"ContainerStarted","Data":"85e89666b96c799da6481e51b71a4f83b5f459a7af7a72da55db5b0f1f5418af"} Mar 16 16:29:10 crc kubenswrapper[5120]: I0316 16:29:10.171332 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-n9ftq" podStartSLOduration=2.171316505 podStartE2EDuration="2.171316505s" podCreationTimestamp="2026-03-16 16:29:08 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:29:10.167470362 +0000 UTC m=+3452.321402019" watchObservedRunningTime="2026-03-16 16:29:10.171316505 +0000 UTC m=+3452.325248162" Mar 16 16:29:14 crc kubenswrapper[5120]: I0316 16:29:14.209167 5120 generic.go:358] "Generic (PLEG): container finished" podID="cf1e3f49-2df5-4275-9df5-574067402cc7" containerID="0eeb60bb39860d8f23bc80ce0eabaf70f69230cb0654b4562cd5bc025b36adf6" exitCode=0 Mar 16 16:29:14 crc kubenswrapper[5120]: I0316 16:29:14.209297 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-n9ftq" event={"ID":"cf1e3f49-2df5-4275-9df5-574067402cc7","Type":"ContainerDied","Data":"0eeb60bb39860d8f23bc80ce0eabaf70f69230cb0654b4562cd5bc025b36adf6"} Mar 16 16:29:15 crc kubenswrapper[5120]: I0316 16:29:15.673059 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-n9ftq" Mar 16 16:29:15 crc kubenswrapper[5120]: I0316 16:29:15.743459 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:29:15 crc kubenswrapper[5120]: I0316 16:29:15.743502 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:29:15 crc kubenswrapper[5120]: I0316 16:29:15.772252 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cf1e3f49-2df5-4275-9df5-574067402cc7-config-data\") pod \"cf1e3f49-2df5-4275-9df5-574067402cc7\" (UID: \"cf1e3f49-2df5-4275-9df5-574067402cc7\") " Mar 16 16:29:15 crc kubenswrapper[5120]: I0316 16:29:15.772558 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s85x2\" (UniqueName: \"kubernetes.io/projected/cf1e3f49-2df5-4275-9df5-574067402cc7-kube-api-access-s85x2\") pod \"cf1e3f49-2df5-4275-9df5-574067402cc7\" (UID: \"cf1e3f49-2df5-4275-9df5-574067402cc7\") " Mar 16 16:29:15 crc kubenswrapper[5120]: I0316 16:29:15.772790 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/cf1e3f49-2df5-4275-9df5-574067402cc7-scripts\") pod \"cf1e3f49-2df5-4275-9df5-574067402cc7\" (UID: \"cf1e3f49-2df5-4275-9df5-574067402cc7\") " Mar 16 16:29:15 crc kubenswrapper[5120]: I0316 16:29:15.772945 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cf1e3f49-2df5-4275-9df5-574067402cc7-combined-ca-bundle\") pod \"cf1e3f49-2df5-4275-9df5-574067402cc7\" (UID: \"cf1e3f49-2df5-4275-9df5-574067402cc7\") " Mar 16 16:29:15 crc kubenswrapper[5120]: I0316 16:29:15.779099 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf1e3f49-2df5-4275-9df5-574067402cc7-scripts" (OuterVolumeSpecName: "scripts") pod "cf1e3f49-2df5-4275-9df5-574067402cc7" (UID: "cf1e3f49-2df5-4275-9df5-574067402cc7"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:29:15 crc kubenswrapper[5120]: I0316 16:29:15.779730 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf1e3f49-2df5-4275-9df5-574067402cc7-kube-api-access-s85x2" (OuterVolumeSpecName: "kube-api-access-s85x2") pod "cf1e3f49-2df5-4275-9df5-574067402cc7" (UID: "cf1e3f49-2df5-4275-9df5-574067402cc7"). InnerVolumeSpecName "kube-api-access-s85x2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:29:15 crc kubenswrapper[5120]: I0316 16:29:15.805783 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf1e3f49-2df5-4275-9df5-574067402cc7-config-data" (OuterVolumeSpecName: "config-data") pod "cf1e3f49-2df5-4275-9df5-574067402cc7" (UID: "cf1e3f49-2df5-4275-9df5-574067402cc7"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:29:15 crc kubenswrapper[5120]: I0316 16:29:15.806700 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf1e3f49-2df5-4275-9df5-574067402cc7-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "cf1e3f49-2df5-4275-9df5-574067402cc7" (UID: "cf1e3f49-2df5-4275-9df5-574067402cc7"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:29:15 crc kubenswrapper[5120]: I0316 16:29:15.876371 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cf1e3f49-2df5-4275-9df5-574067402cc7-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:29:15 crc kubenswrapper[5120]: I0316 16:29:15.876420 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cf1e3f49-2df5-4275-9df5-574067402cc7-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:29:15 crc kubenswrapper[5120]: I0316 16:29:15.876434 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s85x2\" (UniqueName: \"kubernetes.io/projected/cf1e3f49-2df5-4275-9df5-574067402cc7-kube-api-access-s85x2\") on node \"crc\" DevicePath \"\"" Mar 16 16:29:15 crc kubenswrapper[5120]: I0316 16:29:15.876446 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/cf1e3f49-2df5-4275-9df5-574067402cc7-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:29:16 crc kubenswrapper[5120]: I0316 16:29:16.233908 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-n9ftq" Mar 16 16:29:16 crc kubenswrapper[5120]: I0316 16:29:16.234187 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-n9ftq" event={"ID":"cf1e3f49-2df5-4275-9df5-574067402cc7","Type":"ContainerDied","Data":"85e89666b96c799da6481e51b71a4f83b5f459a7af7a72da55db5b0f1f5418af"} Mar 16 16:29:16 crc kubenswrapper[5120]: I0316 16:29:16.234247 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="85e89666b96c799da6481e51b71a4f83b5f459a7af7a72da55db5b0f1f5418af" Mar 16 16:29:16 crc kubenswrapper[5120]: I0316 16:29:16.426050 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:29:16 crc kubenswrapper[5120]: I0316 16:29:16.426270 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="2222ff16-53f4-4814-9321-fe0c8475b658" containerName="nova-api-log" containerID="cri-o://e8e5075ec3a29fb239ec34029b58c5c9064b2a88a2f9862df7a4aac32fae2b92" gracePeriod=30 Mar 16 16:29:16 crc kubenswrapper[5120]: I0316 16:29:16.426845 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="2222ff16-53f4-4814-9321-fe0c8475b658" containerName="nova-api-api" containerID="cri-o://84c52923a8d73c22657aa833c3bc70f15d0b60cecf5ba89bf8a91b6c084a8bc3" gracePeriod=30 Mar 16 16:29:16 crc kubenswrapper[5120]: I0316 16:29:16.433208 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="2222ff16-53f4-4814-9321-fe0c8475b658" containerName="nova-api-api" probeResult="failure" output="Get \"https://10.217.0.48:8774/\": EOF" Mar 16 16:29:16 crc kubenswrapper[5120]: I0316 16:29:16.433451 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="2222ff16-53f4-4814-9321-fe0c8475b658" containerName="nova-api-log" probeResult="failure" output="Get \"https://10.217.0.48:8774/\": EOF" Mar 16 16:29:16 crc kubenswrapper[5120]: I0316 16:29:16.445629 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:29:16 crc kubenswrapper[5120]: I0316 16:29:16.445846 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="7772402b-66a6-46eb-8d2e-8016e9f20bbe" containerName="nova-scheduler-scheduler" containerID="cri-o://74c7f36fcc94f1ab835b435b8fe76162b63208684aad69ba896198c2f8a11b83" gracePeriod=30 Mar 16 16:29:16 crc kubenswrapper[5120]: I0316 16:29:16.469150 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:29:16 crc kubenswrapper[5120]: I0316 16:29:16.469443 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="87bada63-5741-4527-90a7-e56a4a3318fa" containerName="nova-metadata-log" containerID="cri-o://8ad6958f7b2c51928c962260c39a367c20a901d9eefc8df7da9da3e0e0e1e6b9" gracePeriod=30 Mar 16 16:29:16 crc kubenswrapper[5120]: I0316 16:29:16.469924 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="87bada63-5741-4527-90a7-e56a4a3318fa" containerName="nova-metadata-metadata" containerID="cri-o://ab81e06fc2f95cd3f1007a7982c966c8e4e9526d7c49d3637e68b8c3905b6ea2" gracePeriod=30 Mar 16 16:29:17 crc kubenswrapper[5120]: E0316 16:29:17.115894 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="74c7f36fcc94f1ab835b435b8fe76162b63208684aad69ba896198c2f8a11b83" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:29:17 crc kubenswrapper[5120]: E0316 16:29:17.140225 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="74c7f36fcc94f1ab835b435b8fe76162b63208684aad69ba896198c2f8a11b83" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:29:17 crc kubenswrapper[5120]: E0316 16:29:17.154833 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="74c7f36fcc94f1ab835b435b8fe76162b63208684aad69ba896198c2f8a11b83" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:29:17 crc kubenswrapper[5120]: E0316 16:29:17.154904 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="7772402b-66a6-46eb-8d2e-8016e9f20bbe" containerName="nova-scheduler-scheduler" probeResult="unknown" Mar 16 16:29:17 crc kubenswrapper[5120]: I0316 16:29:17.283816 5120 generic.go:358] "Generic (PLEG): container finished" podID="87bada63-5741-4527-90a7-e56a4a3318fa" containerID="8ad6958f7b2c51928c962260c39a367c20a901d9eefc8df7da9da3e0e0e1e6b9" exitCode=143 Mar 16 16:29:17 crc kubenswrapper[5120]: I0316 16:29:17.283903 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"87bada63-5741-4527-90a7-e56a4a3318fa","Type":"ContainerDied","Data":"8ad6958f7b2c51928c962260c39a367c20a901d9eefc8df7da9da3e0e0e1e6b9"} Mar 16 16:29:17 crc kubenswrapper[5120]: I0316 16:29:17.287234 5120 generic.go:358] "Generic (PLEG): container finished" podID="2222ff16-53f4-4814-9321-fe0c8475b658" containerID="e8e5075ec3a29fb239ec34029b58c5c9064b2a88a2f9862df7a4aac32fae2b92" exitCode=143 Mar 16 16:29:17 crc kubenswrapper[5120]: I0316 16:29:17.287313 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"2222ff16-53f4-4814-9321-fe0c8475b658","Type":"ContainerDied","Data":"e8e5075ec3a29fb239ec34029b58c5c9064b2a88a2f9862df7a4aac32fae2b92"} Mar 16 16:29:19 crc kubenswrapper[5120]: I0316 16:29:19.318845 5120 generic.go:358] "Generic (PLEG): container finished" podID="7772402b-66a6-46eb-8d2e-8016e9f20bbe" containerID="74c7f36fcc94f1ab835b435b8fe76162b63208684aad69ba896198c2f8a11b83" exitCode=0 Mar 16 16:29:19 crc kubenswrapper[5120]: I0316 16:29:19.319008 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"7772402b-66a6-46eb-8d2e-8016e9f20bbe","Type":"ContainerDied","Data":"74c7f36fcc94f1ab835b435b8fe76162b63208684aad69ba896198c2f8a11b83"} Mar 16 16:29:19 crc kubenswrapper[5120]: I0316 16:29:19.595347 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/nova-metadata-0" podUID="87bada63-5741-4527-90a7-e56a4a3318fa" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"https://10.217.1.254:8775/\": read tcp 10.217.0.2:34900->10.217.1.254:8775: read: connection reset by peer" Mar 16 16:29:19 crc kubenswrapper[5120]: I0316 16:29:19.753601 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:29:19 crc kubenswrapper[5120]: I0316 16:29:19.885338 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zs4tc\" (UniqueName: \"kubernetes.io/projected/7772402b-66a6-46eb-8d2e-8016e9f20bbe-kube-api-access-zs4tc\") pod \"7772402b-66a6-46eb-8d2e-8016e9f20bbe\" (UID: \"7772402b-66a6-46eb-8d2e-8016e9f20bbe\") " Mar 16 16:29:19 crc kubenswrapper[5120]: I0316 16:29:19.885400 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7772402b-66a6-46eb-8d2e-8016e9f20bbe-combined-ca-bundle\") pod \"7772402b-66a6-46eb-8d2e-8016e9f20bbe\" (UID: \"7772402b-66a6-46eb-8d2e-8016e9f20bbe\") " Mar 16 16:29:19 crc kubenswrapper[5120]: I0316 16:29:19.885606 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7772402b-66a6-46eb-8d2e-8016e9f20bbe-config-data\") pod \"7772402b-66a6-46eb-8d2e-8016e9f20bbe\" (UID: \"7772402b-66a6-46eb-8d2e-8016e9f20bbe\") " Mar 16 16:29:19 crc kubenswrapper[5120]: I0316 16:29:19.893011 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7772402b-66a6-46eb-8d2e-8016e9f20bbe-kube-api-access-zs4tc" (OuterVolumeSpecName: "kube-api-access-zs4tc") pod "7772402b-66a6-46eb-8d2e-8016e9f20bbe" (UID: "7772402b-66a6-46eb-8d2e-8016e9f20bbe"). InnerVolumeSpecName "kube-api-access-zs4tc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:29:19 crc kubenswrapper[5120]: I0316 16:29:19.937137 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7772402b-66a6-46eb-8d2e-8016e9f20bbe-config-data" (OuterVolumeSpecName: "config-data") pod "7772402b-66a6-46eb-8d2e-8016e9f20bbe" (UID: "7772402b-66a6-46eb-8d2e-8016e9f20bbe"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:29:19 crc kubenswrapper[5120]: I0316 16:29:19.938867 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7772402b-66a6-46eb-8d2e-8016e9f20bbe-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "7772402b-66a6-46eb-8d2e-8016e9f20bbe" (UID: "7772402b-66a6-46eb-8d2e-8016e9f20bbe"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:29:19 crc kubenswrapper[5120]: I0316 16:29:19.988103 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zs4tc\" (UniqueName: \"kubernetes.io/projected/7772402b-66a6-46eb-8d2e-8016e9f20bbe-kube-api-access-zs4tc\") on node \"crc\" DevicePath \"\"" Mar 16 16:29:19 crc kubenswrapper[5120]: I0316 16:29:19.988129 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7772402b-66a6-46eb-8d2e-8016e9f20bbe-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:29:19 crc kubenswrapper[5120]: I0316 16:29:19.988138 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7772402b-66a6-46eb-8d2e-8016e9f20bbe-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:29:20 crc kubenswrapper[5120]: I0316 16:29:20.032421 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:29:20 crc kubenswrapper[5120]: I0316 16:29:20.163481 5120 scope.go:117] "RemoveContainer" containerID="b94ec93f56ee6617fe167a4ba516b4eb9fed04f363256f1da3ee498ccfbaba60" Mar 16 16:29:20 crc kubenswrapper[5120]: I0316 16:29:20.192231 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/87bada63-5741-4527-90a7-e56a4a3318fa-nova-metadata-tls-certs\") pod \"87bada63-5741-4527-90a7-e56a4a3318fa\" (UID: \"87bada63-5741-4527-90a7-e56a4a3318fa\") " Mar 16 16:29:20 crc kubenswrapper[5120]: I0316 16:29:20.192318 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tvjbt\" (UniqueName: \"kubernetes.io/projected/87bada63-5741-4527-90a7-e56a4a3318fa-kube-api-access-tvjbt\") pod \"87bada63-5741-4527-90a7-e56a4a3318fa\" (UID: \"87bada63-5741-4527-90a7-e56a4a3318fa\") " Mar 16 16:29:20 crc kubenswrapper[5120]: I0316 16:29:20.192344 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/87bada63-5741-4527-90a7-e56a4a3318fa-combined-ca-bundle\") pod \"87bada63-5741-4527-90a7-e56a4a3318fa\" (UID: \"87bada63-5741-4527-90a7-e56a4a3318fa\") " Mar 16 16:29:20 crc kubenswrapper[5120]: I0316 16:29:20.192639 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/87bada63-5741-4527-90a7-e56a4a3318fa-logs\") pod \"87bada63-5741-4527-90a7-e56a4a3318fa\" (UID: \"87bada63-5741-4527-90a7-e56a4a3318fa\") " Mar 16 16:29:20 crc kubenswrapper[5120]: I0316 16:29:20.192851 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/87bada63-5741-4527-90a7-e56a4a3318fa-config-data\") pod \"87bada63-5741-4527-90a7-e56a4a3318fa\" (UID: \"87bada63-5741-4527-90a7-e56a4a3318fa\") " Mar 16 16:29:20 crc kubenswrapper[5120]: I0316 16:29:20.195521 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87bada63-5741-4527-90a7-e56a4a3318fa-logs" (OuterVolumeSpecName: "logs") pod "87bada63-5741-4527-90a7-e56a4a3318fa" (UID: "87bada63-5741-4527-90a7-e56a4a3318fa"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:29:20 crc kubenswrapper[5120]: I0316 16:29:20.198211 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87bada63-5741-4527-90a7-e56a4a3318fa-kube-api-access-tvjbt" (OuterVolumeSpecName: "kube-api-access-tvjbt") pod "87bada63-5741-4527-90a7-e56a4a3318fa" (UID: "87bada63-5741-4527-90a7-e56a4a3318fa"). InnerVolumeSpecName "kube-api-access-tvjbt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:29:20 crc kubenswrapper[5120]: I0316 16:29:20.222483 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/87bada63-5741-4527-90a7-e56a4a3318fa-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "87bada63-5741-4527-90a7-e56a4a3318fa" (UID: "87bada63-5741-4527-90a7-e56a4a3318fa"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:29:20 crc kubenswrapper[5120]: I0316 16:29:20.223337 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/87bada63-5741-4527-90a7-e56a4a3318fa-config-data" (OuterVolumeSpecName: "config-data") pod "87bada63-5741-4527-90a7-e56a4a3318fa" (UID: "87bada63-5741-4527-90a7-e56a4a3318fa"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:29:20 crc kubenswrapper[5120]: I0316 16:29:20.265302 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/87bada63-5741-4527-90a7-e56a4a3318fa-nova-metadata-tls-certs" (OuterVolumeSpecName: "nova-metadata-tls-certs") pod "87bada63-5741-4527-90a7-e56a4a3318fa" (UID: "87bada63-5741-4527-90a7-e56a4a3318fa"). InnerVolumeSpecName "nova-metadata-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:29:20 crc kubenswrapper[5120]: I0316 16:29:20.295780 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/87bada63-5741-4527-90a7-e56a4a3318fa-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:29:20 crc kubenswrapper[5120]: I0316 16:29:20.295816 5120 reconciler_common.go:299] "Volume detached for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/87bada63-5741-4527-90a7-e56a4a3318fa-nova-metadata-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:29:20 crc kubenswrapper[5120]: I0316 16:29:20.295826 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tvjbt\" (UniqueName: \"kubernetes.io/projected/87bada63-5741-4527-90a7-e56a4a3318fa-kube-api-access-tvjbt\") on node \"crc\" DevicePath \"\"" Mar 16 16:29:20 crc kubenswrapper[5120]: I0316 16:29:20.295835 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/87bada63-5741-4527-90a7-e56a4a3318fa-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:29:20 crc kubenswrapper[5120]: I0316 16:29:20.295844 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/87bada63-5741-4527-90a7-e56a4a3318fa-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:29:20 crc kubenswrapper[5120]: I0316 16:29:20.336173 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:29:20 crc kubenswrapper[5120]: I0316 16:29:20.336167 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"7772402b-66a6-46eb-8d2e-8016e9f20bbe","Type":"ContainerDied","Data":"a0b2d3ce5edcf0a981ff000fd26ec42d1e0873f1a5c4f0b832cc95d89fde1948"} Mar 16 16:29:20 crc kubenswrapper[5120]: I0316 16:29:20.336367 5120 scope.go:117] "RemoveContainer" containerID="74c7f36fcc94f1ab835b435b8fe76162b63208684aad69ba896198c2f8a11b83" Mar 16 16:29:20 crc kubenswrapper[5120]: I0316 16:29:20.344454 5120 generic.go:358] "Generic (PLEG): container finished" podID="87bada63-5741-4527-90a7-e56a4a3318fa" containerID="ab81e06fc2f95cd3f1007a7982c966c8e4e9526d7c49d3637e68b8c3905b6ea2" exitCode=0 Mar 16 16:29:20 crc kubenswrapper[5120]: I0316 16:29:20.344515 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:29:20 crc kubenswrapper[5120]: I0316 16:29:20.344548 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"87bada63-5741-4527-90a7-e56a4a3318fa","Type":"ContainerDied","Data":"ab81e06fc2f95cd3f1007a7982c966c8e4e9526d7c49d3637e68b8c3905b6ea2"} Mar 16 16:29:20 crc kubenswrapper[5120]: I0316 16:29:20.344593 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"87bada63-5741-4527-90a7-e56a4a3318fa","Type":"ContainerDied","Data":"03f84f8b42bc9b4b03cfee1912b521cacda28e549718de08ab83f02b065bd315"} Mar 16 16:29:20 crc kubenswrapper[5120]: I0316 16:29:20.366301 5120 scope.go:117] "RemoveContainer" containerID="aea0fb409f850179130b773a9414fd4e56470e278e2c89d536d55881df43ec8b" Mar 16 16:29:20 crc kubenswrapper[5120]: I0316 16:29:20.399742 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:29:20 crc kubenswrapper[5120]: I0316 16:29:20.407475 5120 scope.go:117] "RemoveContainer" containerID="ab81e06fc2f95cd3f1007a7982c966c8e4e9526d7c49d3637e68b8c3905b6ea2" Mar 16 16:29:20 crc kubenswrapper[5120]: I0316 16:29:20.426486 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:29:20 crc kubenswrapper[5120]: I0316 16:29:20.440056 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:29:20 crc kubenswrapper[5120]: I0316 16:29:20.451357 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:29:20 crc kubenswrapper[5120]: I0316 16:29:20.466672 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:29:20 crc kubenswrapper[5120]: I0316 16:29:20.468982 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87bada63-5741-4527-90a7-e56a4a3318fa" containerName="nova-metadata-log" Mar 16 16:29:20 crc kubenswrapper[5120]: I0316 16:29:20.469005 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="87bada63-5741-4527-90a7-e56a4a3318fa" containerName="nova-metadata-log" Mar 16 16:29:20 crc kubenswrapper[5120]: I0316 16:29:20.469038 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87bada63-5741-4527-90a7-e56a4a3318fa" containerName="nova-metadata-metadata" Mar 16 16:29:20 crc kubenswrapper[5120]: I0316 16:29:20.469046 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="87bada63-5741-4527-90a7-e56a4a3318fa" containerName="nova-metadata-metadata" Mar 16 16:29:20 crc kubenswrapper[5120]: I0316 16:29:20.469053 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7772402b-66a6-46eb-8d2e-8016e9f20bbe" containerName="nova-scheduler-scheduler" Mar 16 16:29:20 crc kubenswrapper[5120]: I0316 16:29:20.469060 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7772402b-66a6-46eb-8d2e-8016e9f20bbe" containerName="nova-scheduler-scheduler" Mar 16 16:29:20 crc kubenswrapper[5120]: I0316 16:29:20.469084 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf1e3f49-2df5-4275-9df5-574067402cc7" containerName="nova-manage" Mar 16 16:29:20 crc kubenswrapper[5120]: I0316 16:29:20.469089 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf1e3f49-2df5-4275-9df5-574067402cc7" containerName="nova-manage" Mar 16 16:29:20 crc kubenswrapper[5120]: I0316 16:29:20.469283 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="87bada63-5741-4527-90a7-e56a4a3318fa" containerName="nova-metadata-metadata" Mar 16 16:29:20 crc kubenswrapper[5120]: I0316 16:29:20.469300 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="87bada63-5741-4527-90a7-e56a4a3318fa" containerName="nova-metadata-log" Mar 16 16:29:20 crc kubenswrapper[5120]: I0316 16:29:20.469320 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="cf1e3f49-2df5-4275-9df5-574067402cc7" containerName="nova-manage" Mar 16 16:29:20 crc kubenswrapper[5120]: I0316 16:29:20.469328 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7772402b-66a6-46eb-8d2e-8016e9f20bbe" containerName="nova-scheduler-scheduler" Mar 16 16:29:20 crc kubenswrapper[5120]: I0316 16:29:20.492167 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:29:20 crc kubenswrapper[5120]: I0316 16:29:20.492414 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:29:20 crc kubenswrapper[5120]: I0316 16:29:20.495157 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-metadata-internal-svc\"" Mar 16 16:29:20 crc kubenswrapper[5120]: I0316 16:29:20.496055 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-metadata-config-data\"" Mar 16 16:29:20 crc kubenswrapper[5120]: I0316 16:29:20.502499 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:29:20 crc kubenswrapper[5120]: I0316 16:29:20.510312 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:29:20 crc kubenswrapper[5120]: I0316 16:29:20.513378 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-scheduler-config-data\"" Mar 16 16:29:20 crc kubenswrapper[5120]: I0316 16:29:20.522891 5120 scope.go:117] "RemoveContainer" containerID="fd11cfec77020da4c9520f2df943d972df61f40850afe3158e1db4ed683e3ab0" Mar 16 16:29:20 crc kubenswrapper[5120]: I0316 16:29:20.527510 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:29:20 crc kubenswrapper[5120]: I0316 16:29:20.540049 5120 scope.go:117] "RemoveContainer" containerID="8ad6958f7b2c51928c962260c39a367c20a901d9eefc8df7da9da3e0e0e1e6b9" Mar 16 16:29:20 crc kubenswrapper[5120]: I0316 16:29:20.552133 5120 scope.go:117] "RemoveContainer" containerID="4598e66dbeea0ce54f3f7c7e600bc881bc3248b3052564bab4c10a1d54fe28fd" Mar 16 16:29:20 crc kubenswrapper[5120]: I0316 16:29:20.562973 5120 scope.go:117] "RemoveContainer" containerID="ab81e06fc2f95cd3f1007a7982c966c8e4e9526d7c49d3637e68b8c3905b6ea2" Mar 16 16:29:20 crc kubenswrapper[5120]: E0316 16:29:20.563414 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab81e06fc2f95cd3f1007a7982c966c8e4e9526d7c49d3637e68b8c3905b6ea2\": container with ID starting with ab81e06fc2f95cd3f1007a7982c966c8e4e9526d7c49d3637e68b8c3905b6ea2 not found: ID does not exist" containerID="ab81e06fc2f95cd3f1007a7982c966c8e4e9526d7c49d3637e68b8c3905b6ea2" Mar 16 16:29:20 crc kubenswrapper[5120]: I0316 16:29:20.563458 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab81e06fc2f95cd3f1007a7982c966c8e4e9526d7c49d3637e68b8c3905b6ea2"} err="failed to get container status \"ab81e06fc2f95cd3f1007a7982c966c8e4e9526d7c49d3637e68b8c3905b6ea2\": rpc error: code = NotFound desc = could not find container \"ab81e06fc2f95cd3f1007a7982c966c8e4e9526d7c49d3637e68b8c3905b6ea2\": container with ID starting with ab81e06fc2f95cd3f1007a7982c966c8e4e9526d7c49d3637e68b8c3905b6ea2 not found: ID does not exist" Mar 16 16:29:20 crc kubenswrapper[5120]: I0316 16:29:20.563690 5120 scope.go:117] "RemoveContainer" containerID="8ad6958f7b2c51928c962260c39a367c20a901d9eefc8df7da9da3e0e0e1e6b9" Mar 16 16:29:20 crc kubenswrapper[5120]: E0316 16:29:20.564051 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ad6958f7b2c51928c962260c39a367c20a901d9eefc8df7da9da3e0e0e1e6b9\": container with ID starting with 8ad6958f7b2c51928c962260c39a367c20a901d9eefc8df7da9da3e0e0e1e6b9 not found: ID does not exist" containerID="8ad6958f7b2c51928c962260c39a367c20a901d9eefc8df7da9da3e0e0e1e6b9" Mar 16 16:29:20 crc kubenswrapper[5120]: I0316 16:29:20.564077 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ad6958f7b2c51928c962260c39a367c20a901d9eefc8df7da9da3e0e0e1e6b9"} err="failed to get container status \"8ad6958f7b2c51928c962260c39a367c20a901d9eefc8df7da9da3e0e0e1e6b9\": rpc error: code = NotFound desc = could not find container \"8ad6958f7b2c51928c962260c39a367c20a901d9eefc8df7da9da3e0e0e1e6b9\": container with ID starting with 8ad6958f7b2c51928c962260c39a367c20a901d9eefc8df7da9da3e0e0e1e6b9 not found: ID does not exist" Mar 16 16:29:20 crc kubenswrapper[5120]: I0316 16:29:20.579177 5120 scope.go:117] "RemoveContainer" containerID="d63b63f896e16ee6ca0499eadf5f4897e18e93018d3e86e30c2fa276b3f8df7d" Mar 16 16:29:20 crc kubenswrapper[5120]: I0316 16:29:20.600142 5120 scope.go:117] "RemoveContainer" containerID="4ccbfad91f89bfb8d7b4609f7c76733ab028c5e8e9735fe9d8a28a9886c6e451" Mar 16 16:29:20 crc kubenswrapper[5120]: I0316 16:29:20.618115 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/9300c420-c173-4f86-ac91-7ada78b25041-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"9300c420-c173-4f86-ac91-7ada78b25041\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:29:20 crc kubenswrapper[5120]: I0316 16:29:20.618178 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/836f3504-5416-46bf-a225-7b7f977fe82c-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"836f3504-5416-46bf-a225-7b7f977fe82c\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:29:20 crc kubenswrapper[5120]: I0316 16:29:20.618319 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/836f3504-5416-46bf-a225-7b7f977fe82c-config-data\") pod \"nova-scheduler-0\" (UID: \"836f3504-5416-46bf-a225-7b7f977fe82c\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:29:20 crc kubenswrapper[5120]: I0316 16:29:20.618390 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brcqc\" (UniqueName: \"kubernetes.io/projected/9300c420-c173-4f86-ac91-7ada78b25041-kube-api-access-brcqc\") pod \"nova-metadata-0\" (UID: \"9300c420-c173-4f86-ac91-7ada78b25041\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:29:20 crc kubenswrapper[5120]: I0316 16:29:20.618495 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9300c420-c173-4f86-ac91-7ada78b25041-logs\") pod \"nova-metadata-0\" (UID: \"9300c420-c173-4f86-ac91-7ada78b25041\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:29:20 crc kubenswrapper[5120]: I0316 16:29:20.618556 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klhhb\" (UniqueName: \"kubernetes.io/projected/836f3504-5416-46bf-a225-7b7f977fe82c-kube-api-access-klhhb\") pod \"nova-scheduler-0\" (UID: \"836f3504-5416-46bf-a225-7b7f977fe82c\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:29:20 crc kubenswrapper[5120]: I0316 16:29:20.618694 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9300c420-c173-4f86-ac91-7ada78b25041-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"9300c420-c173-4f86-ac91-7ada78b25041\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:29:20 crc kubenswrapper[5120]: I0316 16:29:20.618911 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9300c420-c173-4f86-ac91-7ada78b25041-config-data\") pod \"nova-metadata-0\" (UID: \"9300c420-c173-4f86-ac91-7ada78b25041\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:29:20 crc kubenswrapper[5120]: I0316 16:29:20.630586 5120 scope.go:117] "RemoveContainer" containerID="ec2b7b351db4491f5eb3973d4802ee60b890c0212d81d8e0093d1acfc93c3718" Mar 16 16:29:20 crc kubenswrapper[5120]: I0316 16:29:20.674697 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7772402b-66a6-46eb-8d2e-8016e9f20bbe" path="/var/lib/kubelet/pods/7772402b-66a6-46eb-8d2e-8016e9f20bbe/volumes" Mar 16 16:29:20 crc kubenswrapper[5120]: I0316 16:29:20.675457 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="87bada63-5741-4527-90a7-e56a4a3318fa" path="/var/lib/kubelet/pods/87bada63-5741-4527-90a7-e56a4a3318fa/volumes" Mar 16 16:29:20 crc kubenswrapper[5120]: I0316 16:29:20.678154 5120 scope.go:117] "RemoveContainer" containerID="33a4ab6d0801be84ab8ea365dc946cfc333d8e434cce9217ace7dcd436bdd3ae" Mar 16 16:29:20 crc kubenswrapper[5120]: I0316 16:29:20.698524 5120 scope.go:117] "RemoveContainer" containerID="faec934fdf618da87c90e1efafcb15b6b468ceda4e45e61f8abad7b9415796db" Mar 16 16:29:20 crc kubenswrapper[5120]: I0316 16:29:20.719897 5120 scope.go:117] "RemoveContainer" containerID="5b8987748353c1d2e69d60fc0c21b864956f03ab076a25c45a0a35fabf53babd" Mar 16 16:29:20 crc kubenswrapper[5120]: I0316 16:29:20.721342 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9300c420-c173-4f86-ac91-7ada78b25041-config-data\") pod \"nova-metadata-0\" (UID: \"9300c420-c173-4f86-ac91-7ada78b25041\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:29:20 crc kubenswrapper[5120]: I0316 16:29:20.721432 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/9300c420-c173-4f86-ac91-7ada78b25041-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"9300c420-c173-4f86-ac91-7ada78b25041\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:29:20 crc kubenswrapper[5120]: I0316 16:29:20.721489 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/836f3504-5416-46bf-a225-7b7f977fe82c-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"836f3504-5416-46bf-a225-7b7f977fe82c\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:29:20 crc kubenswrapper[5120]: I0316 16:29:20.721546 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/836f3504-5416-46bf-a225-7b7f977fe82c-config-data\") pod \"nova-scheduler-0\" (UID: \"836f3504-5416-46bf-a225-7b7f977fe82c\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:29:20 crc kubenswrapper[5120]: I0316 16:29:20.721582 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-brcqc\" (UniqueName: \"kubernetes.io/projected/9300c420-c173-4f86-ac91-7ada78b25041-kube-api-access-brcqc\") pod \"nova-metadata-0\" (UID: \"9300c420-c173-4f86-ac91-7ada78b25041\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:29:20 crc kubenswrapper[5120]: I0316 16:29:20.721644 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9300c420-c173-4f86-ac91-7ada78b25041-logs\") pod \"nova-metadata-0\" (UID: \"9300c420-c173-4f86-ac91-7ada78b25041\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:29:20 crc kubenswrapper[5120]: I0316 16:29:20.721710 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-klhhb\" (UniqueName: \"kubernetes.io/projected/836f3504-5416-46bf-a225-7b7f977fe82c-kube-api-access-klhhb\") pod \"nova-scheduler-0\" (UID: \"836f3504-5416-46bf-a225-7b7f977fe82c\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:29:20 crc kubenswrapper[5120]: I0316 16:29:20.721793 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9300c420-c173-4f86-ac91-7ada78b25041-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"9300c420-c173-4f86-ac91-7ada78b25041\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:29:20 crc kubenswrapper[5120]: I0316 16:29:20.722684 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9300c420-c173-4f86-ac91-7ada78b25041-logs\") pod \"nova-metadata-0\" (UID: \"9300c420-c173-4f86-ac91-7ada78b25041\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:29:20 crc kubenswrapper[5120]: I0316 16:29:20.728504 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9300c420-c173-4f86-ac91-7ada78b25041-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"9300c420-c173-4f86-ac91-7ada78b25041\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:29:20 crc kubenswrapper[5120]: I0316 16:29:20.728885 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/836f3504-5416-46bf-a225-7b7f977fe82c-config-data\") pod \"nova-scheduler-0\" (UID: \"836f3504-5416-46bf-a225-7b7f977fe82c\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:29:20 crc kubenswrapper[5120]: I0316 16:29:20.729591 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/9300c420-c173-4f86-ac91-7ada78b25041-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"9300c420-c173-4f86-ac91-7ada78b25041\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:29:20 crc kubenswrapper[5120]: I0316 16:29:20.732387 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/836f3504-5416-46bf-a225-7b7f977fe82c-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"836f3504-5416-46bf-a225-7b7f977fe82c\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:29:20 crc kubenswrapper[5120]: I0316 16:29:20.735965 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9300c420-c173-4f86-ac91-7ada78b25041-config-data\") pod \"nova-metadata-0\" (UID: \"9300c420-c173-4f86-ac91-7ada78b25041\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:29:20 crc kubenswrapper[5120]: I0316 16:29:20.740738 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-brcqc\" (UniqueName: \"kubernetes.io/projected/9300c420-c173-4f86-ac91-7ada78b25041-kube-api-access-brcqc\") pod \"nova-metadata-0\" (UID: \"9300c420-c173-4f86-ac91-7ada78b25041\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:29:20 crc kubenswrapper[5120]: I0316 16:29:20.740854 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-klhhb\" (UniqueName: \"kubernetes.io/projected/836f3504-5416-46bf-a225-7b7f977fe82c-kube-api-access-klhhb\") pod \"nova-scheduler-0\" (UID: \"836f3504-5416-46bf-a225-7b7f977fe82c\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:29:20 crc kubenswrapper[5120]: I0316 16:29:20.756956 5120 scope.go:117] "RemoveContainer" containerID="21bce66a707103c0c4494b4b34b9d5756cf82eb2fefafd919a0dae858d454b38" Mar 16 16:29:20 crc kubenswrapper[5120]: I0316 16:29:20.824006 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:29:20 crc kubenswrapper[5120]: I0316 16:29:20.833616 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:29:21 crc kubenswrapper[5120]: I0316 16:29:21.313040 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:29:21 crc kubenswrapper[5120]: I0316 16:29:21.359505 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"9300c420-c173-4f86-ac91-7ada78b25041","Type":"ContainerStarted","Data":"5ea4fe8f33dc24ad2c86cecd0392f16c79471bfc50e42ea582053a96e4635bcb"} Mar 16 16:29:21 crc kubenswrapper[5120]: W0316 16:29:21.420378 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod836f3504_5416_46bf_a225_7b7f977fe82c.slice/crio-791ecf4a564b3e7b10a2fb3f11743fdb0d6ae93fbb21bf5a2ddf6109aeee061c WatchSource:0}: Error finding container 791ecf4a564b3e7b10a2fb3f11743fdb0d6ae93fbb21bf5a2ddf6109aeee061c: Status 404 returned error can't find the container with id 791ecf4a564b3e7b10a2fb3f11743fdb0d6ae93fbb21bf5a2ddf6109aeee061c Mar 16 16:29:21 crc kubenswrapper[5120]: I0316 16:29:21.423727 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:29:22 crc kubenswrapper[5120]: I0316 16:29:22.153248 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:29:22 crc kubenswrapper[5120]: I0316 16:29:22.202391 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/2222ff16-53f4-4814-9321-fe0c8475b658-public-tls-certs\") pod \"2222ff16-53f4-4814-9321-fe0c8475b658\" (UID: \"2222ff16-53f4-4814-9321-fe0c8475b658\") " Mar 16 16:29:22 crc kubenswrapper[5120]: I0316 16:29:22.202602 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-drrsb\" (UniqueName: \"kubernetes.io/projected/2222ff16-53f4-4814-9321-fe0c8475b658-kube-api-access-drrsb\") pod \"2222ff16-53f4-4814-9321-fe0c8475b658\" (UID: \"2222ff16-53f4-4814-9321-fe0c8475b658\") " Mar 16 16:29:22 crc kubenswrapper[5120]: I0316 16:29:22.202671 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/2222ff16-53f4-4814-9321-fe0c8475b658-internal-tls-certs\") pod \"2222ff16-53f4-4814-9321-fe0c8475b658\" (UID: \"2222ff16-53f4-4814-9321-fe0c8475b658\") " Mar 16 16:29:22 crc kubenswrapper[5120]: I0316 16:29:22.202740 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2222ff16-53f4-4814-9321-fe0c8475b658-logs\") pod \"2222ff16-53f4-4814-9321-fe0c8475b658\" (UID: \"2222ff16-53f4-4814-9321-fe0c8475b658\") " Mar 16 16:29:22 crc kubenswrapper[5120]: I0316 16:29:22.202971 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2222ff16-53f4-4814-9321-fe0c8475b658-config-data\") pod \"2222ff16-53f4-4814-9321-fe0c8475b658\" (UID: \"2222ff16-53f4-4814-9321-fe0c8475b658\") " Mar 16 16:29:22 crc kubenswrapper[5120]: I0316 16:29:22.203790 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2222ff16-53f4-4814-9321-fe0c8475b658-combined-ca-bundle\") pod \"2222ff16-53f4-4814-9321-fe0c8475b658\" (UID: \"2222ff16-53f4-4814-9321-fe0c8475b658\") " Mar 16 16:29:22 crc kubenswrapper[5120]: I0316 16:29:22.204387 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2222ff16-53f4-4814-9321-fe0c8475b658-logs" (OuterVolumeSpecName: "logs") pod "2222ff16-53f4-4814-9321-fe0c8475b658" (UID: "2222ff16-53f4-4814-9321-fe0c8475b658"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:29:22 crc kubenswrapper[5120]: I0316 16:29:22.204835 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2222ff16-53f4-4814-9321-fe0c8475b658-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:29:22 crc kubenswrapper[5120]: I0316 16:29:22.212041 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2222ff16-53f4-4814-9321-fe0c8475b658-kube-api-access-drrsb" (OuterVolumeSpecName: "kube-api-access-drrsb") pod "2222ff16-53f4-4814-9321-fe0c8475b658" (UID: "2222ff16-53f4-4814-9321-fe0c8475b658"). InnerVolumeSpecName "kube-api-access-drrsb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:29:22 crc kubenswrapper[5120]: I0316 16:29:22.239626 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2222ff16-53f4-4814-9321-fe0c8475b658-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "2222ff16-53f4-4814-9321-fe0c8475b658" (UID: "2222ff16-53f4-4814-9321-fe0c8475b658"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:29:22 crc kubenswrapper[5120]: I0316 16:29:22.247158 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2222ff16-53f4-4814-9321-fe0c8475b658-config-data" (OuterVolumeSpecName: "config-data") pod "2222ff16-53f4-4814-9321-fe0c8475b658" (UID: "2222ff16-53f4-4814-9321-fe0c8475b658"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:29:22 crc kubenswrapper[5120]: I0316 16:29:22.268871 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2222ff16-53f4-4814-9321-fe0c8475b658-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "2222ff16-53f4-4814-9321-fe0c8475b658" (UID: "2222ff16-53f4-4814-9321-fe0c8475b658"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:29:22 crc kubenswrapper[5120]: I0316 16:29:22.277294 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2222ff16-53f4-4814-9321-fe0c8475b658-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "2222ff16-53f4-4814-9321-fe0c8475b658" (UID: "2222ff16-53f4-4814-9321-fe0c8475b658"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:29:22 crc kubenswrapper[5120]: I0316 16:29:22.306822 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/2222ff16-53f4-4814-9321-fe0c8475b658-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:29:22 crc kubenswrapper[5120]: I0316 16:29:22.306853 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2222ff16-53f4-4814-9321-fe0c8475b658-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:29:22 crc kubenswrapper[5120]: I0316 16:29:22.306862 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2222ff16-53f4-4814-9321-fe0c8475b658-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:29:22 crc kubenswrapper[5120]: I0316 16:29:22.306870 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/2222ff16-53f4-4814-9321-fe0c8475b658-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:29:22 crc kubenswrapper[5120]: I0316 16:29:22.306879 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-drrsb\" (UniqueName: \"kubernetes.io/projected/2222ff16-53f4-4814-9321-fe0c8475b658-kube-api-access-drrsb\") on node \"crc\" DevicePath \"\"" Mar 16 16:29:22 crc kubenswrapper[5120]: I0316 16:29:22.369637 5120 generic.go:358] "Generic (PLEG): container finished" podID="2222ff16-53f4-4814-9321-fe0c8475b658" containerID="84c52923a8d73c22657aa833c3bc70f15d0b60cecf5ba89bf8a91b6c084a8bc3" exitCode=0 Mar 16 16:29:22 crc kubenswrapper[5120]: I0316 16:29:22.369774 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:29:22 crc kubenswrapper[5120]: I0316 16:29:22.369814 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"2222ff16-53f4-4814-9321-fe0c8475b658","Type":"ContainerDied","Data":"84c52923a8d73c22657aa833c3bc70f15d0b60cecf5ba89bf8a91b6c084a8bc3"} Mar 16 16:29:22 crc kubenswrapper[5120]: I0316 16:29:22.369841 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"2222ff16-53f4-4814-9321-fe0c8475b658","Type":"ContainerDied","Data":"35fa732d11b91cf0798c6bea5614131da51d495c27e8d085d544ff3d358e68f4"} Mar 16 16:29:22 crc kubenswrapper[5120]: I0316 16:29:22.369857 5120 scope.go:117] "RemoveContainer" containerID="84c52923a8d73c22657aa833c3bc70f15d0b60cecf5ba89bf8a91b6c084a8bc3" Mar 16 16:29:22 crc kubenswrapper[5120]: I0316 16:29:22.373693 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"836f3504-5416-46bf-a225-7b7f977fe82c","Type":"ContainerStarted","Data":"31eede8ea13e83df778b0cc727f0126cabef5175599f7fcd091680c0e3d991d6"} Mar 16 16:29:22 crc kubenswrapper[5120]: I0316 16:29:22.373749 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"836f3504-5416-46bf-a225-7b7f977fe82c","Type":"ContainerStarted","Data":"791ecf4a564b3e7b10a2fb3f11743fdb0d6ae93fbb21bf5a2ddf6109aeee061c"} Mar 16 16:29:22 crc kubenswrapper[5120]: I0316 16:29:22.376220 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"9300c420-c173-4f86-ac91-7ada78b25041","Type":"ContainerStarted","Data":"fef968df7f37fd8586399f475ea9ec49a678f4f4b47fe252028804652842452c"} Mar 16 16:29:22 crc kubenswrapper[5120]: I0316 16:29:22.376247 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"9300c420-c173-4f86-ac91-7ada78b25041","Type":"ContainerStarted","Data":"f59a6e760a98bbe533ef2a4ac3593867a1408a7b9aea9b121e3a1c5077272558"} Mar 16 16:29:22 crc kubenswrapper[5120]: I0316 16:29:22.393812 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-scheduler-0" podStartSLOduration=2.393788963 podStartE2EDuration="2.393788963s" podCreationTimestamp="2026-03-16 16:29:20 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:29:22.390400802 +0000 UTC m=+3464.544332449" watchObservedRunningTime="2026-03-16 16:29:22.393788963 +0000 UTC m=+3464.547720630" Mar 16 16:29:22 crc kubenswrapper[5120]: I0316 16:29:22.401310 5120 scope.go:117] "RemoveContainer" containerID="e8e5075ec3a29fb239ec34029b58c5c9064b2a88a2f9862df7a4aac32fae2b92" Mar 16 16:29:22 crc kubenswrapper[5120]: I0316 16:29:22.423950 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:29:22 crc kubenswrapper[5120]: I0316 16:29:22.440223 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:29:22 crc kubenswrapper[5120]: I0316 16:29:22.447051 5120 scope.go:117] "RemoveContainer" containerID="84c52923a8d73c22657aa833c3bc70f15d0b60cecf5ba89bf8a91b6c084a8bc3" Mar 16 16:29:22 crc kubenswrapper[5120]: E0316 16:29:22.447574 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"84c52923a8d73c22657aa833c3bc70f15d0b60cecf5ba89bf8a91b6c084a8bc3\": container with ID starting with 84c52923a8d73c22657aa833c3bc70f15d0b60cecf5ba89bf8a91b6c084a8bc3 not found: ID does not exist" containerID="84c52923a8d73c22657aa833c3bc70f15d0b60cecf5ba89bf8a91b6c084a8bc3" Mar 16 16:29:22 crc kubenswrapper[5120]: I0316 16:29:22.447614 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84c52923a8d73c22657aa833c3bc70f15d0b60cecf5ba89bf8a91b6c084a8bc3"} err="failed to get container status \"84c52923a8d73c22657aa833c3bc70f15d0b60cecf5ba89bf8a91b6c084a8bc3\": rpc error: code = NotFound desc = could not find container \"84c52923a8d73c22657aa833c3bc70f15d0b60cecf5ba89bf8a91b6c084a8bc3\": container with ID starting with 84c52923a8d73c22657aa833c3bc70f15d0b60cecf5ba89bf8a91b6c084a8bc3 not found: ID does not exist" Mar 16 16:29:22 crc kubenswrapper[5120]: I0316 16:29:22.447636 5120 scope.go:117] "RemoveContainer" containerID="e8e5075ec3a29fb239ec34029b58c5c9064b2a88a2f9862df7a4aac32fae2b92" Mar 16 16:29:22 crc kubenswrapper[5120]: E0316 16:29:22.448312 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e8e5075ec3a29fb239ec34029b58c5c9064b2a88a2f9862df7a4aac32fae2b92\": container with ID starting with e8e5075ec3a29fb239ec34029b58c5c9064b2a88a2f9862df7a4aac32fae2b92 not found: ID does not exist" containerID="e8e5075ec3a29fb239ec34029b58c5c9064b2a88a2f9862df7a4aac32fae2b92" Mar 16 16:29:22 crc kubenswrapper[5120]: I0316 16:29:22.448402 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8e5075ec3a29fb239ec34029b58c5c9064b2a88a2f9862df7a4aac32fae2b92"} err="failed to get container status \"e8e5075ec3a29fb239ec34029b58c5c9064b2a88a2f9862df7a4aac32fae2b92\": rpc error: code = NotFound desc = could not find container \"e8e5075ec3a29fb239ec34029b58c5c9064b2a88a2f9862df7a4aac32fae2b92\": container with ID starting with e8e5075ec3a29fb239ec34029b58c5c9064b2a88a2f9862df7a4aac32fae2b92 not found: ID does not exist" Mar 16 16:29:22 crc kubenswrapper[5120]: I0316 16:29:22.450362 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=2.450350536 podStartE2EDuration="2.450350536s" podCreationTimestamp="2026-03-16 16:29:20 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:29:22.423837777 +0000 UTC m=+3464.577769444" watchObservedRunningTime="2026-03-16 16:29:22.450350536 +0000 UTC m=+3464.604282193" Mar 16 16:29:22 crc kubenswrapper[5120]: I0316 16:29:22.464896 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:29:22 crc kubenswrapper[5120]: I0316 16:29:22.466486 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2222ff16-53f4-4814-9321-fe0c8475b658" containerName="nova-api-log" Mar 16 16:29:22 crc kubenswrapper[5120]: I0316 16:29:22.466511 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="2222ff16-53f4-4814-9321-fe0c8475b658" containerName="nova-api-log" Mar 16 16:29:22 crc kubenswrapper[5120]: I0316 16:29:22.466574 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2222ff16-53f4-4814-9321-fe0c8475b658" containerName="nova-api-api" Mar 16 16:29:22 crc kubenswrapper[5120]: I0316 16:29:22.466581 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="2222ff16-53f4-4814-9321-fe0c8475b658" containerName="nova-api-api" Mar 16 16:29:22 crc kubenswrapper[5120]: I0316 16:29:22.466886 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="2222ff16-53f4-4814-9321-fe0c8475b658" containerName="nova-api-log" Mar 16 16:29:22 crc kubenswrapper[5120]: I0316 16:29:22.466922 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="2222ff16-53f4-4814-9321-fe0c8475b658" containerName="nova-api-api" Mar 16 16:29:22 crc kubenswrapper[5120]: I0316 16:29:22.472895 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:29:22 crc kubenswrapper[5120]: I0316 16:29:22.477481 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:29:22 crc kubenswrapper[5120]: I0316 16:29:22.478120 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-internal-svc\"" Mar 16 16:29:22 crc kubenswrapper[5120]: I0316 16:29:22.478466 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-public-svc\"" Mar 16 16:29:22 crc kubenswrapper[5120]: I0316 16:29:22.478676 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-config-data\"" Mar 16 16:29:22 crc kubenswrapper[5120]: I0316 16:29:22.510836 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b4e407e7-1e20-455e-b1e5-d87ba8555a7a-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"b4e407e7-1e20-455e-b1e5-d87ba8555a7a\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:29:22 crc kubenswrapper[5120]: I0316 16:29:22.510984 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5q67\" (UniqueName: \"kubernetes.io/projected/b4e407e7-1e20-455e-b1e5-d87ba8555a7a-kube-api-access-l5q67\") pod \"nova-api-0\" (UID: \"b4e407e7-1e20-455e-b1e5-d87ba8555a7a\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:29:22 crc kubenswrapper[5120]: I0316 16:29:22.511169 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b4e407e7-1e20-455e-b1e5-d87ba8555a7a-config-data\") pod \"nova-api-0\" (UID: \"b4e407e7-1e20-455e-b1e5-d87ba8555a7a\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:29:22 crc kubenswrapper[5120]: I0316 16:29:22.511360 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/b4e407e7-1e20-455e-b1e5-d87ba8555a7a-public-tls-certs\") pod \"nova-api-0\" (UID: \"b4e407e7-1e20-455e-b1e5-d87ba8555a7a\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:29:22 crc kubenswrapper[5120]: I0316 16:29:22.511478 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b4e407e7-1e20-455e-b1e5-d87ba8555a7a-logs\") pod \"nova-api-0\" (UID: \"b4e407e7-1e20-455e-b1e5-d87ba8555a7a\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:29:22 crc kubenswrapper[5120]: I0316 16:29:22.511599 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/b4e407e7-1e20-455e-b1e5-d87ba8555a7a-internal-tls-certs\") pod \"nova-api-0\" (UID: \"b4e407e7-1e20-455e-b1e5-d87ba8555a7a\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:29:22 crc kubenswrapper[5120]: I0316 16:29:22.613720 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b4e407e7-1e20-455e-b1e5-d87ba8555a7a-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"b4e407e7-1e20-455e-b1e5-d87ba8555a7a\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:29:22 crc kubenswrapper[5120]: I0316 16:29:22.613841 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l5q67\" (UniqueName: \"kubernetes.io/projected/b4e407e7-1e20-455e-b1e5-d87ba8555a7a-kube-api-access-l5q67\") pod \"nova-api-0\" (UID: \"b4e407e7-1e20-455e-b1e5-d87ba8555a7a\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:29:22 crc kubenswrapper[5120]: I0316 16:29:22.613976 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b4e407e7-1e20-455e-b1e5-d87ba8555a7a-config-data\") pod \"nova-api-0\" (UID: \"b4e407e7-1e20-455e-b1e5-d87ba8555a7a\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:29:22 crc kubenswrapper[5120]: I0316 16:29:22.614055 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/b4e407e7-1e20-455e-b1e5-d87ba8555a7a-public-tls-certs\") pod \"nova-api-0\" (UID: \"b4e407e7-1e20-455e-b1e5-d87ba8555a7a\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:29:22 crc kubenswrapper[5120]: I0316 16:29:22.614079 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b4e407e7-1e20-455e-b1e5-d87ba8555a7a-logs\") pod \"nova-api-0\" (UID: \"b4e407e7-1e20-455e-b1e5-d87ba8555a7a\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:29:22 crc kubenswrapper[5120]: I0316 16:29:22.614113 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/b4e407e7-1e20-455e-b1e5-d87ba8555a7a-internal-tls-certs\") pod \"nova-api-0\" (UID: \"b4e407e7-1e20-455e-b1e5-d87ba8555a7a\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:29:22 crc kubenswrapper[5120]: I0316 16:29:22.614978 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b4e407e7-1e20-455e-b1e5-d87ba8555a7a-logs\") pod \"nova-api-0\" (UID: \"b4e407e7-1e20-455e-b1e5-d87ba8555a7a\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:29:22 crc kubenswrapper[5120]: I0316 16:29:22.618792 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b4e407e7-1e20-455e-b1e5-d87ba8555a7a-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"b4e407e7-1e20-455e-b1e5-d87ba8555a7a\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:29:22 crc kubenswrapper[5120]: I0316 16:29:22.619198 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/b4e407e7-1e20-455e-b1e5-d87ba8555a7a-internal-tls-certs\") pod \"nova-api-0\" (UID: \"b4e407e7-1e20-455e-b1e5-d87ba8555a7a\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:29:22 crc kubenswrapper[5120]: I0316 16:29:22.619841 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b4e407e7-1e20-455e-b1e5-d87ba8555a7a-config-data\") pod \"nova-api-0\" (UID: \"b4e407e7-1e20-455e-b1e5-d87ba8555a7a\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:29:22 crc kubenswrapper[5120]: I0316 16:29:22.623418 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/b4e407e7-1e20-455e-b1e5-d87ba8555a7a-public-tls-certs\") pod \"nova-api-0\" (UID: \"b4e407e7-1e20-455e-b1e5-d87ba8555a7a\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:29:22 crc kubenswrapper[5120]: I0316 16:29:22.646692 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5q67\" (UniqueName: \"kubernetes.io/projected/b4e407e7-1e20-455e-b1e5-d87ba8555a7a-kube-api-access-l5q67\") pod \"nova-api-0\" (UID: \"b4e407e7-1e20-455e-b1e5-d87ba8555a7a\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:29:22 crc kubenswrapper[5120]: I0316 16:29:22.677322 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2222ff16-53f4-4814-9321-fe0c8475b658" path="/var/lib/kubelet/pods/2222ff16-53f4-4814-9321-fe0c8475b658/volumes" Mar 16 16:29:22 crc kubenswrapper[5120]: I0316 16:29:22.810571 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:29:23 crc kubenswrapper[5120]: I0316 16:29:23.285361 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:29:23 crc kubenswrapper[5120]: W0316 16:29:23.291237 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb4e407e7_1e20_455e_b1e5_d87ba8555a7a.slice/crio-a40217a603b1abbf8379975140a56db83c67f69d503c55fdcb645c25162389bc WatchSource:0}: Error finding container a40217a603b1abbf8379975140a56db83c67f69d503c55fdcb645c25162389bc: Status 404 returned error can't find the container with id a40217a603b1abbf8379975140a56db83c67f69d503c55fdcb645c25162389bc Mar 16 16:29:23 crc kubenswrapper[5120]: I0316 16:29:23.391508 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"b4e407e7-1e20-455e-b1e5-d87ba8555a7a","Type":"ContainerStarted","Data":"a40217a603b1abbf8379975140a56db83c67f69d503c55fdcb645c25162389bc"} Mar 16 16:29:24 crc kubenswrapper[5120]: I0316 16:29:24.415307 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"b4e407e7-1e20-455e-b1e5-d87ba8555a7a","Type":"ContainerStarted","Data":"73d36e223ac6cb16ad06c2743a3cc3ff1584c29e05d26a747bc98696b66104be"} Mar 16 16:29:24 crc kubenswrapper[5120]: I0316 16:29:24.415656 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"b4e407e7-1e20-455e-b1e5-d87ba8555a7a","Type":"ContainerStarted","Data":"2eb2cfc44a2ab4da95ff91fbb74bb09793c7659b0ff281328c6d6c9bcd535517"} Mar 16 16:29:24 crc kubenswrapper[5120]: I0316 16:29:24.459733 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=2.45969986 podStartE2EDuration="2.45969986s" podCreationTimestamp="2026-03-16 16:29:22 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:29:24.44771211 +0000 UTC m=+3466.601643777" watchObservedRunningTime="2026-03-16 16:29:24.45969986 +0000 UTC m=+3466.613631557" Mar 16 16:29:25 crc kubenswrapper[5120]: I0316 16:29:25.834077 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:29:30 crc kubenswrapper[5120]: I0316 16:29:30.821319 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:29:30 crc kubenswrapper[5120]: I0316 16:29:30.821737 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:29:30 crc kubenswrapper[5120]: I0316 16:29:30.833724 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:29:30 crc kubenswrapper[5120]: I0316 16:29:30.868010 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:29:31 crc kubenswrapper[5120]: I0316 16:29:31.550769 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:29:31 crc kubenswrapper[5120]: I0316 16:29:31.828927 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="9300c420-c173-4f86-ac91-7ada78b25041" containerName="nova-metadata-log" probeResult="failure" output="Get \"https://10.217.0.50:8775/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Mar 16 16:29:31 crc kubenswrapper[5120]: I0316 16:29:31.828974 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="9300c420-c173-4f86-ac91-7ada78b25041" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"https://10.217.0.50:8775/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Mar 16 16:29:32 crc kubenswrapper[5120]: I0316 16:29:32.811481 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:29:32 crc kubenswrapper[5120]: I0316 16:29:32.811741 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:29:33 crc kubenswrapper[5120]: I0316 16:29:33.816984 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="b4e407e7-1e20-455e-b1e5-d87ba8555a7a" containerName="nova-api-log" probeResult="failure" output="Get \"https://10.217.0.55:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 16:29:33 crc kubenswrapper[5120]: I0316 16:29:33.818053 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="b4e407e7-1e20-455e-b1e5-d87ba8555a7a" containerName="nova-api-api" probeResult="failure" output="Get \"https://10.217.0.55:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 16:29:38 crc kubenswrapper[5120]: I0316 16:29:38.821753 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:29:38 crc kubenswrapper[5120]: I0316 16:29:38.824899 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:29:40 crc kubenswrapper[5120]: I0316 16:29:40.811178 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:29:40 crc kubenswrapper[5120]: I0316 16:29:40.812250 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:29:40 crc kubenswrapper[5120]: I0316 16:29:40.827617 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:29:40 crc kubenswrapper[5120]: I0316 16:29:40.827726 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:29:40 crc kubenswrapper[5120]: I0316 16:29:40.834168 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:29:40 crc kubenswrapper[5120]: I0316 16:29:40.836166 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:29:41 crc kubenswrapper[5120]: I0316 16:29:41.163891 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:29:42 crc kubenswrapper[5120]: I0316 16:29:42.819471 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:29:42 crc kubenswrapper[5120]: I0316 16:29:42.820220 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:29:42 crc kubenswrapper[5120]: I0316 16:29:42.830114 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:29:42 crc kubenswrapper[5120]: I0316 16:29:42.831647 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:29:44 crc kubenswrapper[5120]: I0316 16:29:44.473344 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 16:29:44 crc kubenswrapper[5120]: I0316 16:29:44.473795 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/kube-state-metrics-0" podUID="62c35786-83f2-4ef8-8265-647a9216a6f2" containerName="kube-state-metrics" containerID="cri-o://f932ea0ab7ac639e3860ad12ca89338e8c880d34669208bea065ae1dd808a4b7" gracePeriod=30 Mar 16 16:29:44 crc kubenswrapper[5120]: I0316 16:29:44.665597 5120 generic.go:358] "Generic (PLEG): container finished" podID="62c35786-83f2-4ef8-8265-647a9216a6f2" containerID="f932ea0ab7ac639e3860ad12ca89338e8c880d34669208bea065ae1dd808a4b7" exitCode=2 Mar 16 16:29:44 crc kubenswrapper[5120]: I0316 16:29:44.675367 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"62c35786-83f2-4ef8-8265-647a9216a6f2","Type":"ContainerDied","Data":"f932ea0ab7ac639e3860ad12ca89338e8c880d34669208bea065ae1dd808a4b7"} Mar 16 16:29:44 crc kubenswrapper[5120]: I0316 16:29:44.976440 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:29:45 crc kubenswrapper[5120]: I0316 16:29:45.117148 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-htgkc\" (UniqueName: \"kubernetes.io/projected/62c35786-83f2-4ef8-8265-647a9216a6f2-kube-api-access-htgkc\") pod \"62c35786-83f2-4ef8-8265-647a9216a6f2\" (UID: \"62c35786-83f2-4ef8-8265-647a9216a6f2\") " Mar 16 16:29:45 crc kubenswrapper[5120]: I0316 16:29:45.125900 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62c35786-83f2-4ef8-8265-647a9216a6f2-kube-api-access-htgkc" (OuterVolumeSpecName: "kube-api-access-htgkc") pod "62c35786-83f2-4ef8-8265-647a9216a6f2" (UID: "62c35786-83f2-4ef8-8265-647a9216a6f2"). InnerVolumeSpecName "kube-api-access-htgkc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:29:45 crc kubenswrapper[5120]: I0316 16:29:45.220141 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-htgkc\" (UniqueName: \"kubernetes.io/projected/62c35786-83f2-4ef8-8265-647a9216a6f2-kube-api-access-htgkc\") on node \"crc\" DevicePath \"\"" Mar 16 16:29:45 crc kubenswrapper[5120]: I0316 16:29:45.675463 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:29:45 crc kubenswrapper[5120]: I0316 16:29:45.675500 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"62c35786-83f2-4ef8-8265-647a9216a6f2","Type":"ContainerDied","Data":"36231472538a731d192bb3cb942dd1b57f5fdd86a7a02b6cbfdcfb2c1545f3ef"} Mar 16 16:29:45 crc kubenswrapper[5120]: I0316 16:29:45.675551 5120 scope.go:117] "RemoveContainer" containerID="f932ea0ab7ac639e3860ad12ca89338e8c880d34669208bea065ae1dd808a4b7" Mar 16 16:29:45 crc kubenswrapper[5120]: I0316 16:29:45.731107 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 16:29:45 crc kubenswrapper[5120]: I0316 16:29:45.740899 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 16:29:45 crc kubenswrapper[5120]: I0316 16:29:45.756590 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 16:29:45 crc kubenswrapper[5120]: I0316 16:29:45.758078 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62c35786-83f2-4ef8-8265-647a9216a6f2" containerName="kube-state-metrics" Mar 16 16:29:45 crc kubenswrapper[5120]: I0316 16:29:45.758099 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="62c35786-83f2-4ef8-8265-647a9216a6f2" containerName="kube-state-metrics" Mar 16 16:29:45 crc kubenswrapper[5120]: I0316 16:29:45.758358 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="62c35786-83f2-4ef8-8265-647a9216a6f2" containerName="kube-state-metrics" Mar 16 16:29:45 crc kubenswrapper[5120]: I0316 16:29:45.768313 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:29:45 crc kubenswrapper[5120]: I0316 16:29:45.772201 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 16:29:45 crc kubenswrapper[5120]: I0316 16:29:45.772939 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-kube-state-metrics-svc\"" Mar 16 16:29:45 crc kubenswrapper[5120]: I0316 16:29:45.772977 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"kube-state-metrics-tls-config\"" Mar 16 16:29:45 crc kubenswrapper[5120]: I0316 16:29:45.940355 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dx7sz\" (UniqueName: \"kubernetes.io/projected/56e8d6c4-0222-4e80-bffd-8fb3726e1b75-kube-api-access-dx7sz\") pod \"kube-state-metrics-0\" (UID: \"56e8d6c4-0222-4e80-bffd-8fb3726e1b75\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:29:45 crc kubenswrapper[5120]: I0316 16:29:45.940492 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/56e8d6c4-0222-4e80-bffd-8fb3726e1b75-combined-ca-bundle\") pod \"kube-state-metrics-0\" (UID: \"56e8d6c4-0222-4e80-bffd-8fb3726e1b75\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:29:45 crc kubenswrapper[5120]: I0316 16:29:45.940680 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/56e8d6c4-0222-4e80-bffd-8fb3726e1b75-kube-state-metrics-tls-config\") pod \"kube-state-metrics-0\" (UID: \"56e8d6c4-0222-4e80-bffd-8fb3726e1b75\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:29:45 crc kubenswrapper[5120]: I0316 16:29:45.940741 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/56e8d6c4-0222-4e80-bffd-8fb3726e1b75-kube-state-metrics-tls-certs\") pod \"kube-state-metrics-0\" (UID: \"56e8d6c4-0222-4e80-bffd-8fb3726e1b75\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:29:46 crc kubenswrapper[5120]: I0316 16:29:46.042450 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/56e8d6c4-0222-4e80-bffd-8fb3726e1b75-kube-state-metrics-tls-config\") pod \"kube-state-metrics-0\" (UID: \"56e8d6c4-0222-4e80-bffd-8fb3726e1b75\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:29:46 crc kubenswrapper[5120]: I0316 16:29:46.042556 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/56e8d6c4-0222-4e80-bffd-8fb3726e1b75-kube-state-metrics-tls-certs\") pod \"kube-state-metrics-0\" (UID: \"56e8d6c4-0222-4e80-bffd-8fb3726e1b75\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:29:46 crc kubenswrapper[5120]: I0316 16:29:46.042906 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dx7sz\" (UniqueName: \"kubernetes.io/projected/56e8d6c4-0222-4e80-bffd-8fb3726e1b75-kube-api-access-dx7sz\") pod \"kube-state-metrics-0\" (UID: \"56e8d6c4-0222-4e80-bffd-8fb3726e1b75\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:29:46 crc kubenswrapper[5120]: I0316 16:29:46.042977 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/56e8d6c4-0222-4e80-bffd-8fb3726e1b75-combined-ca-bundle\") pod \"kube-state-metrics-0\" (UID: \"56e8d6c4-0222-4e80-bffd-8fb3726e1b75\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:29:46 crc kubenswrapper[5120]: I0316 16:29:46.048198 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/56e8d6c4-0222-4e80-bffd-8fb3726e1b75-kube-state-metrics-tls-certs\") pod \"kube-state-metrics-0\" (UID: \"56e8d6c4-0222-4e80-bffd-8fb3726e1b75\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:29:46 crc kubenswrapper[5120]: I0316 16:29:46.048401 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/56e8d6c4-0222-4e80-bffd-8fb3726e1b75-kube-state-metrics-tls-config\") pod \"kube-state-metrics-0\" (UID: \"56e8d6c4-0222-4e80-bffd-8fb3726e1b75\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:29:46 crc kubenswrapper[5120]: I0316 16:29:46.054436 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/56e8d6c4-0222-4e80-bffd-8fb3726e1b75-combined-ca-bundle\") pod \"kube-state-metrics-0\" (UID: \"56e8d6c4-0222-4e80-bffd-8fb3726e1b75\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:29:46 crc kubenswrapper[5120]: I0316 16:29:46.059634 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dx7sz\" (UniqueName: \"kubernetes.io/projected/56e8d6c4-0222-4e80-bffd-8fb3726e1b75-kube-api-access-dx7sz\") pod \"kube-state-metrics-0\" (UID: \"56e8d6c4-0222-4e80-bffd-8fb3726e1b75\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:29:46 crc kubenswrapper[5120]: I0316 16:29:46.094284 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:29:46 crc kubenswrapper[5120]: I0316 16:29:46.227751 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:29:46 crc kubenswrapper[5120]: I0316 16:29:46.228220 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="408c9ee4-d256-4e4a-8556-766d5e984932" containerName="ceilometer-central-agent" containerID="cri-o://08b6130b68045706a6c795516223a6c0684602ba41f2e2e63872f2d33e0ce38c" gracePeriod=30 Mar 16 16:29:46 crc kubenswrapper[5120]: I0316 16:29:46.228741 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="408c9ee4-d256-4e4a-8556-766d5e984932" containerName="proxy-httpd" containerID="cri-o://97bd869ff302904ff904e816d906fb8c8b0e9795c565cf8f364f4a5b265086c7" gracePeriod=30 Mar 16 16:29:46 crc kubenswrapper[5120]: I0316 16:29:46.228822 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="408c9ee4-d256-4e4a-8556-766d5e984932" containerName="sg-core" containerID="cri-o://8985b537fc3aa7457660f262f4654719890ab41800c67adf11093fc3b5ebe83b" gracePeriod=30 Mar 16 16:29:46 crc kubenswrapper[5120]: I0316 16:29:46.228866 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="408c9ee4-d256-4e4a-8556-766d5e984932" containerName="ceilometer-notification-agent" containerID="cri-o://c22449fd82f04d62093aec2428075908953a94f0e175765a293ca2df9b50f31c" gracePeriod=30 Mar 16 16:29:46 crc kubenswrapper[5120]: I0316 16:29:46.600138 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 16:29:46 crc kubenswrapper[5120]: I0316 16:29:46.674986 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="62c35786-83f2-4ef8-8265-647a9216a6f2" path="/var/lib/kubelet/pods/62c35786-83f2-4ef8-8265-647a9216a6f2/volumes" Mar 16 16:29:46 crc kubenswrapper[5120]: I0316 16:29:46.688217 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"56e8d6c4-0222-4e80-bffd-8fb3726e1b75","Type":"ContainerStarted","Data":"90cf81e612a1fd6cebf6444651d80944dfa8bdfbef0a8cb6bb90bb9f1d3bd473"} Mar 16 16:29:46 crc kubenswrapper[5120]: I0316 16:29:46.695043 5120 generic.go:358] "Generic (PLEG): container finished" podID="408c9ee4-d256-4e4a-8556-766d5e984932" containerID="97bd869ff302904ff904e816d906fb8c8b0e9795c565cf8f364f4a5b265086c7" exitCode=0 Mar 16 16:29:46 crc kubenswrapper[5120]: I0316 16:29:46.695080 5120 generic.go:358] "Generic (PLEG): container finished" podID="408c9ee4-d256-4e4a-8556-766d5e984932" containerID="8985b537fc3aa7457660f262f4654719890ab41800c67adf11093fc3b5ebe83b" exitCode=2 Mar 16 16:29:46 crc kubenswrapper[5120]: I0316 16:29:46.695090 5120 generic.go:358] "Generic (PLEG): container finished" podID="408c9ee4-d256-4e4a-8556-766d5e984932" containerID="08b6130b68045706a6c795516223a6c0684602ba41f2e2e63872f2d33e0ce38c" exitCode=0 Mar 16 16:29:46 crc kubenswrapper[5120]: I0316 16:29:46.695153 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"408c9ee4-d256-4e4a-8556-766d5e984932","Type":"ContainerDied","Data":"97bd869ff302904ff904e816d906fb8c8b0e9795c565cf8f364f4a5b265086c7"} Mar 16 16:29:46 crc kubenswrapper[5120]: I0316 16:29:46.695185 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"408c9ee4-d256-4e4a-8556-766d5e984932","Type":"ContainerDied","Data":"8985b537fc3aa7457660f262f4654719890ab41800c67adf11093fc3b5ebe83b"} Mar 16 16:29:46 crc kubenswrapper[5120]: I0316 16:29:46.695198 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"408c9ee4-d256-4e4a-8556-766d5e984932","Type":"ContainerDied","Data":"08b6130b68045706a6c795516223a6c0684602ba41f2e2e63872f2d33e0ce38c"} Mar 16 16:29:47 crc kubenswrapper[5120]: I0316 16:29:47.706001 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"56e8d6c4-0222-4e80-bffd-8fb3726e1b75","Type":"ContainerStarted","Data":"65ce1a9fbe046895b733fc4b967f9bf21a74d0cd97349758a275a768087dbc2d"} Mar 16 16:29:47 crc kubenswrapper[5120]: I0316 16:29:47.706545 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:29:47 crc kubenswrapper[5120]: I0316 16:29:47.727924 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/kube-state-metrics-0" podStartSLOduration=2.305576404 podStartE2EDuration="2.72789779s" podCreationTimestamp="2026-03-16 16:29:45 +0000 UTC" firstStartedPulling="2026-03-16 16:29:46.597133005 +0000 UTC m=+3488.751064662" lastFinishedPulling="2026-03-16 16:29:47.019454391 +0000 UTC m=+3489.173386048" observedRunningTime="2026-03-16 16:29:47.724289773 +0000 UTC m=+3489.878221430" watchObservedRunningTime="2026-03-16 16:29:47.72789779 +0000 UTC m=+3489.881829457" Mar 16 16:29:48 crc kubenswrapper[5120]: I0316 16:29:48.730050 5120 generic.go:358] "Generic (PLEG): container finished" podID="408c9ee4-d256-4e4a-8556-766d5e984932" containerID="c22449fd82f04d62093aec2428075908953a94f0e175765a293ca2df9b50f31c" exitCode=0 Mar 16 16:29:48 crc kubenswrapper[5120]: I0316 16:29:48.730203 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"408c9ee4-d256-4e4a-8556-766d5e984932","Type":"ContainerDied","Data":"c22449fd82f04d62093aec2428075908953a94f0e175765a293ca2df9b50f31c"} Mar 16 16:29:48 crc kubenswrapper[5120]: I0316 16:29:48.840242 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:29:48 crc kubenswrapper[5120]: I0316 16:29:48.913850 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bgv59\" (UniqueName: \"kubernetes.io/projected/408c9ee4-d256-4e4a-8556-766d5e984932-kube-api-access-bgv59\") pod \"408c9ee4-d256-4e4a-8556-766d5e984932\" (UID: \"408c9ee4-d256-4e4a-8556-766d5e984932\") " Mar 16 16:29:48 crc kubenswrapper[5120]: I0316 16:29:48.914119 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/408c9ee4-d256-4e4a-8556-766d5e984932-run-httpd\") pod \"408c9ee4-d256-4e4a-8556-766d5e984932\" (UID: \"408c9ee4-d256-4e4a-8556-766d5e984932\") " Mar 16 16:29:48 crc kubenswrapper[5120]: I0316 16:29:48.914278 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/408c9ee4-d256-4e4a-8556-766d5e984932-scripts\") pod \"408c9ee4-d256-4e4a-8556-766d5e984932\" (UID: \"408c9ee4-d256-4e4a-8556-766d5e984932\") " Mar 16 16:29:48 crc kubenswrapper[5120]: I0316 16:29:48.914500 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/408c9ee4-d256-4e4a-8556-766d5e984932-log-httpd\") pod \"408c9ee4-d256-4e4a-8556-766d5e984932\" (UID: \"408c9ee4-d256-4e4a-8556-766d5e984932\") " Mar 16 16:29:48 crc kubenswrapper[5120]: I0316 16:29:48.914554 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/408c9ee4-d256-4e4a-8556-766d5e984932-sg-core-conf-yaml\") pod \"408c9ee4-d256-4e4a-8556-766d5e984932\" (UID: \"408c9ee4-d256-4e4a-8556-766d5e984932\") " Mar 16 16:29:48 crc kubenswrapper[5120]: I0316 16:29:48.914576 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/408c9ee4-d256-4e4a-8556-766d5e984932-config-data\") pod \"408c9ee4-d256-4e4a-8556-766d5e984932\" (UID: \"408c9ee4-d256-4e4a-8556-766d5e984932\") " Mar 16 16:29:48 crc kubenswrapper[5120]: I0316 16:29:48.914838 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/408c9ee4-d256-4e4a-8556-766d5e984932-combined-ca-bundle\") pod \"408c9ee4-d256-4e4a-8556-766d5e984932\" (UID: \"408c9ee4-d256-4e4a-8556-766d5e984932\") " Mar 16 16:29:48 crc kubenswrapper[5120]: I0316 16:29:48.919224 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/408c9ee4-d256-4e4a-8556-766d5e984932-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "408c9ee4-d256-4e4a-8556-766d5e984932" (UID: "408c9ee4-d256-4e4a-8556-766d5e984932"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:29:48 crc kubenswrapper[5120]: I0316 16:29:48.919468 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/408c9ee4-d256-4e4a-8556-766d5e984932-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "408c9ee4-d256-4e4a-8556-766d5e984932" (UID: "408c9ee4-d256-4e4a-8556-766d5e984932"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:29:48 crc kubenswrapper[5120]: I0316 16:29:48.922987 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/408c9ee4-d256-4e4a-8556-766d5e984932-scripts" (OuterVolumeSpecName: "scripts") pod "408c9ee4-d256-4e4a-8556-766d5e984932" (UID: "408c9ee4-d256-4e4a-8556-766d5e984932"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:29:48 crc kubenswrapper[5120]: I0316 16:29:48.923509 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/408c9ee4-d256-4e4a-8556-766d5e984932-kube-api-access-bgv59" (OuterVolumeSpecName: "kube-api-access-bgv59") pod "408c9ee4-d256-4e4a-8556-766d5e984932" (UID: "408c9ee4-d256-4e4a-8556-766d5e984932"). InnerVolumeSpecName "kube-api-access-bgv59". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:29:48 crc kubenswrapper[5120]: I0316 16:29:48.954954 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/408c9ee4-d256-4e4a-8556-766d5e984932-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "408c9ee4-d256-4e4a-8556-766d5e984932" (UID: "408c9ee4-d256-4e4a-8556-766d5e984932"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:29:49 crc kubenswrapper[5120]: I0316 16:29:49.018690 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/408c9ee4-d256-4e4a-8556-766d5e984932-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "408c9ee4-d256-4e4a-8556-766d5e984932" (UID: "408c9ee4-d256-4e4a-8556-766d5e984932"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:29:49 crc kubenswrapper[5120]: I0316 16:29:49.018911 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/408c9ee4-d256-4e4a-8556-766d5e984932-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:29:49 crc kubenswrapper[5120]: I0316 16:29:49.018924 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/408c9ee4-d256-4e4a-8556-766d5e984932-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 16:29:49 crc kubenswrapper[5120]: I0316 16:29:49.018934 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/408c9ee4-d256-4e4a-8556-766d5e984932-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:29:49 crc kubenswrapper[5120]: I0316 16:29:49.018943 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bgv59\" (UniqueName: \"kubernetes.io/projected/408c9ee4-d256-4e4a-8556-766d5e984932-kube-api-access-bgv59\") on node \"crc\" DevicePath \"\"" Mar 16 16:29:49 crc kubenswrapper[5120]: I0316 16:29:49.018953 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/408c9ee4-d256-4e4a-8556-766d5e984932-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:29:49 crc kubenswrapper[5120]: I0316 16:29:49.018963 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/408c9ee4-d256-4e4a-8556-766d5e984932-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:29:49 crc kubenswrapper[5120]: I0316 16:29:49.040230 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/408c9ee4-d256-4e4a-8556-766d5e984932-config-data" (OuterVolumeSpecName: "config-data") pod "408c9ee4-d256-4e4a-8556-766d5e984932" (UID: "408c9ee4-d256-4e4a-8556-766d5e984932"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:29:49 crc kubenswrapper[5120]: I0316 16:29:49.121421 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/408c9ee4-d256-4e4a-8556-766d5e984932-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:29:49 crc kubenswrapper[5120]: I0316 16:29:49.744640 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"408c9ee4-d256-4e4a-8556-766d5e984932","Type":"ContainerDied","Data":"625198882c111406f128758076f0b494dc829376097f188a52c5709b6094fc09"} Mar 16 16:29:49 crc kubenswrapper[5120]: I0316 16:29:49.744701 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:29:49 crc kubenswrapper[5120]: I0316 16:29:49.745039 5120 scope.go:117] "RemoveContainer" containerID="97bd869ff302904ff904e816d906fb8c8b0e9795c565cf8f364f4a5b265086c7" Mar 16 16:29:49 crc kubenswrapper[5120]: I0316 16:29:49.783318 5120 scope.go:117] "RemoveContainer" containerID="8985b537fc3aa7457660f262f4654719890ab41800c67adf11093fc3b5ebe83b" Mar 16 16:29:49 crc kubenswrapper[5120]: I0316 16:29:49.801075 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:29:49 crc kubenswrapper[5120]: I0316 16:29:49.820391 5120 scope.go:117] "RemoveContainer" containerID="c22449fd82f04d62093aec2428075908953a94f0e175765a293ca2df9b50f31c" Mar 16 16:29:49 crc kubenswrapper[5120]: I0316 16:29:49.843950 5120 scope.go:117] "RemoveContainer" containerID="08b6130b68045706a6c795516223a6c0684602ba41f2e2e63872f2d33e0ce38c" Mar 16 16:29:49 crc kubenswrapper[5120]: I0316 16:29:49.851840 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:29:49 crc kubenswrapper[5120]: I0316 16:29:49.868301 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:29:49 crc kubenswrapper[5120]: I0316 16:29:49.871000 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="408c9ee4-d256-4e4a-8556-766d5e984932" containerName="ceilometer-central-agent" Mar 16 16:29:49 crc kubenswrapper[5120]: I0316 16:29:49.871031 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="408c9ee4-d256-4e4a-8556-766d5e984932" containerName="ceilometer-central-agent" Mar 16 16:29:49 crc kubenswrapper[5120]: I0316 16:29:49.871163 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="408c9ee4-d256-4e4a-8556-766d5e984932" containerName="ceilometer-notification-agent" Mar 16 16:29:49 crc kubenswrapper[5120]: I0316 16:29:49.871180 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="408c9ee4-d256-4e4a-8556-766d5e984932" containerName="ceilometer-notification-agent" Mar 16 16:29:49 crc kubenswrapper[5120]: I0316 16:29:49.871198 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="408c9ee4-d256-4e4a-8556-766d5e984932" containerName="proxy-httpd" Mar 16 16:29:49 crc kubenswrapper[5120]: I0316 16:29:49.871207 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="408c9ee4-d256-4e4a-8556-766d5e984932" containerName="proxy-httpd" Mar 16 16:29:49 crc kubenswrapper[5120]: I0316 16:29:49.871303 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="408c9ee4-d256-4e4a-8556-766d5e984932" containerName="sg-core" Mar 16 16:29:49 crc kubenswrapper[5120]: I0316 16:29:49.871312 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="408c9ee4-d256-4e4a-8556-766d5e984932" containerName="sg-core" Mar 16 16:29:49 crc kubenswrapper[5120]: I0316 16:29:49.871740 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="408c9ee4-d256-4e4a-8556-766d5e984932" containerName="sg-core" Mar 16 16:29:49 crc kubenswrapper[5120]: I0316 16:29:49.871807 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="408c9ee4-d256-4e4a-8556-766d5e984932" containerName="ceilometer-notification-agent" Mar 16 16:29:49 crc kubenswrapper[5120]: I0316 16:29:49.871834 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="408c9ee4-d256-4e4a-8556-766d5e984932" containerName="ceilometer-central-agent" Mar 16 16:29:49 crc kubenswrapper[5120]: I0316 16:29:49.871844 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="408c9ee4-d256-4e4a-8556-766d5e984932" containerName="proxy-httpd" Mar 16 16:29:49 crc kubenswrapper[5120]: I0316 16:29:49.883185 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:29:49 crc kubenswrapper[5120]: I0316 16:29:49.883338 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:29:49 crc kubenswrapper[5120]: I0316 16:29:49.886083 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ceilometer-internal-svc\"" Mar 16 16:29:49 crc kubenswrapper[5120]: I0316 16:29:49.886213 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 16:29:49 crc kubenswrapper[5120]: I0316 16:29:49.886233 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 16:29:49 crc kubenswrapper[5120]: I0316 16:29:49.942403 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/abc96fef-3a85-4438-848c-0910513810e0-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"abc96fef-3a85-4438-848c-0910513810e0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:29:49 crc kubenswrapper[5120]: I0316 16:29:49.942492 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/abc96fef-3a85-4438-848c-0910513810e0-log-httpd\") pod \"ceilometer-0\" (UID: \"abc96fef-3a85-4438-848c-0910513810e0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:29:49 crc kubenswrapper[5120]: I0316 16:29:49.942776 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jljjb\" (UniqueName: \"kubernetes.io/projected/abc96fef-3a85-4438-848c-0910513810e0-kube-api-access-jljjb\") pod \"ceilometer-0\" (UID: \"abc96fef-3a85-4438-848c-0910513810e0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:29:49 crc kubenswrapper[5120]: I0316 16:29:49.943015 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/abc96fef-3a85-4438-848c-0910513810e0-scripts\") pod \"ceilometer-0\" (UID: \"abc96fef-3a85-4438-848c-0910513810e0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:29:49 crc kubenswrapper[5120]: I0316 16:29:49.943065 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/abc96fef-3a85-4438-848c-0910513810e0-config-data\") pod \"ceilometer-0\" (UID: \"abc96fef-3a85-4438-848c-0910513810e0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:29:49 crc kubenswrapper[5120]: I0316 16:29:49.943307 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/abc96fef-3a85-4438-848c-0910513810e0-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"abc96fef-3a85-4438-848c-0910513810e0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:29:49 crc kubenswrapper[5120]: I0316 16:29:49.943444 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/abc96fef-3a85-4438-848c-0910513810e0-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"abc96fef-3a85-4438-848c-0910513810e0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:29:49 crc kubenswrapper[5120]: I0316 16:29:49.943491 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/abc96fef-3a85-4438-848c-0910513810e0-run-httpd\") pod \"ceilometer-0\" (UID: \"abc96fef-3a85-4438-848c-0910513810e0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:29:50 crc kubenswrapper[5120]: I0316 16:29:50.045699 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/abc96fef-3a85-4438-848c-0910513810e0-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"abc96fef-3a85-4438-848c-0910513810e0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:29:50 crc kubenswrapper[5120]: I0316 16:29:50.045802 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/abc96fef-3a85-4438-848c-0910513810e0-log-httpd\") pod \"ceilometer-0\" (UID: \"abc96fef-3a85-4438-848c-0910513810e0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:29:50 crc kubenswrapper[5120]: I0316 16:29:50.045922 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jljjb\" (UniqueName: \"kubernetes.io/projected/abc96fef-3a85-4438-848c-0910513810e0-kube-api-access-jljjb\") pod \"ceilometer-0\" (UID: \"abc96fef-3a85-4438-848c-0910513810e0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:29:50 crc kubenswrapper[5120]: I0316 16:29:50.046005 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/abc96fef-3a85-4438-848c-0910513810e0-scripts\") pod \"ceilometer-0\" (UID: \"abc96fef-3a85-4438-848c-0910513810e0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:29:50 crc kubenswrapper[5120]: I0316 16:29:50.046029 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/abc96fef-3a85-4438-848c-0910513810e0-config-data\") pod \"ceilometer-0\" (UID: \"abc96fef-3a85-4438-848c-0910513810e0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:29:50 crc kubenswrapper[5120]: I0316 16:29:50.046166 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/abc96fef-3a85-4438-848c-0910513810e0-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"abc96fef-3a85-4438-848c-0910513810e0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:29:50 crc kubenswrapper[5120]: I0316 16:29:50.046223 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/abc96fef-3a85-4438-848c-0910513810e0-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"abc96fef-3a85-4438-848c-0910513810e0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:29:50 crc kubenswrapper[5120]: I0316 16:29:50.046253 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/abc96fef-3a85-4438-848c-0910513810e0-run-httpd\") pod \"ceilometer-0\" (UID: \"abc96fef-3a85-4438-848c-0910513810e0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:29:50 crc kubenswrapper[5120]: I0316 16:29:50.046744 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/abc96fef-3a85-4438-848c-0910513810e0-log-httpd\") pod \"ceilometer-0\" (UID: \"abc96fef-3a85-4438-848c-0910513810e0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:29:50 crc kubenswrapper[5120]: I0316 16:29:50.046869 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/abc96fef-3a85-4438-848c-0910513810e0-run-httpd\") pod \"ceilometer-0\" (UID: \"abc96fef-3a85-4438-848c-0910513810e0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:29:50 crc kubenswrapper[5120]: I0316 16:29:50.052143 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/abc96fef-3a85-4438-848c-0910513810e0-scripts\") pod \"ceilometer-0\" (UID: \"abc96fef-3a85-4438-848c-0910513810e0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:29:50 crc kubenswrapper[5120]: I0316 16:29:50.052250 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/abc96fef-3a85-4438-848c-0910513810e0-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"abc96fef-3a85-4438-848c-0910513810e0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:29:50 crc kubenswrapper[5120]: I0316 16:29:50.052346 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/abc96fef-3a85-4438-848c-0910513810e0-config-data\") pod \"ceilometer-0\" (UID: \"abc96fef-3a85-4438-848c-0910513810e0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:29:50 crc kubenswrapper[5120]: I0316 16:29:50.052670 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/abc96fef-3a85-4438-848c-0910513810e0-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"abc96fef-3a85-4438-848c-0910513810e0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:29:50 crc kubenswrapper[5120]: I0316 16:29:50.064924 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/abc96fef-3a85-4438-848c-0910513810e0-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"abc96fef-3a85-4438-848c-0910513810e0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:29:50 crc kubenswrapper[5120]: I0316 16:29:50.071262 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jljjb\" (UniqueName: \"kubernetes.io/projected/abc96fef-3a85-4438-848c-0910513810e0-kube-api-access-jljjb\") pod \"ceilometer-0\" (UID: \"abc96fef-3a85-4438-848c-0910513810e0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:29:50 crc kubenswrapper[5120]: I0316 16:29:50.208927 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:29:50 crc kubenswrapper[5120]: I0316 16:29:50.674863 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="408c9ee4-d256-4e4a-8556-766d5e984932" path="/var/lib/kubelet/pods/408c9ee4-d256-4e4a-8556-766d5e984932/volumes" Mar 16 16:29:50 crc kubenswrapper[5120]: I0316 16:29:50.684111 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:29:50 crc kubenswrapper[5120]: W0316 16:29:50.690893 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podabc96fef_3a85_4438_848c_0910513810e0.slice/crio-693e8289e379b6f666acead5d4310edbed2bb37feef02ea682b0f276ccefefba WatchSource:0}: Error finding container 693e8289e379b6f666acead5d4310edbed2bb37feef02ea682b0f276ccefefba: Status 404 returned error can't find the container with id 693e8289e379b6f666acead5d4310edbed2bb37feef02ea682b0f276ccefefba Mar 16 16:29:50 crc kubenswrapper[5120]: I0316 16:29:50.757884 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"abc96fef-3a85-4438-848c-0910513810e0","Type":"ContainerStarted","Data":"693e8289e379b6f666acead5d4310edbed2bb37feef02ea682b0f276ccefefba"} Mar 16 16:29:51 crc kubenswrapper[5120]: I0316 16:29:51.776737 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"abc96fef-3a85-4438-848c-0910513810e0","Type":"ContainerStarted","Data":"b6c94b2508b6c7f40ba9027d248c30720e7dd6666027c56bb02ab67277fa255b"} Mar 16 16:29:52 crc kubenswrapper[5120]: I0316 16:29:52.790704 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"abc96fef-3a85-4438-848c-0910513810e0","Type":"ContainerStarted","Data":"04c42674c25fc500c502ef1e1e999054ad79756a4118b220ebdd2bad3f3baaf6"} Mar 16 16:29:52 crc kubenswrapper[5120]: I0316 16:29:52.791005 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"abc96fef-3a85-4438-848c-0910513810e0","Type":"ContainerStarted","Data":"3b26184bcf959244a04517160ad0256a4a63d93d49413616a3117c699a7df75b"} Mar 16 16:29:54 crc kubenswrapper[5120]: I0316 16:29:54.813734 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"abc96fef-3a85-4438-848c-0910513810e0","Type":"ContainerStarted","Data":"1d97978ec3d113eff242fa345a29d5e1e5b1f9ef9dfe1117c35a88143a78bae6"} Mar 16 16:29:54 crc kubenswrapper[5120]: I0316 16:29:54.814296 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:29:54 crc kubenswrapper[5120]: I0316 16:29:54.869055 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.188147342 podStartE2EDuration="5.869032595s" podCreationTimestamp="2026-03-16 16:29:49 +0000 UTC" firstStartedPulling="2026-03-16 16:29:50.692129095 +0000 UTC m=+3492.846060752" lastFinishedPulling="2026-03-16 16:29:54.373014348 +0000 UTC m=+3496.526946005" observedRunningTime="2026-03-16 16:29:54.840259495 +0000 UTC m=+3496.994191152" watchObservedRunningTime="2026-03-16 16:29:54.869032595 +0000 UTC m=+3497.022964262" Mar 16 16:29:58 crc kubenswrapper[5120]: I0316 16:29:58.740076 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:30:00 crc kubenswrapper[5120]: I0316 16:30:00.155428 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-infra/auto-csr-approver-29561310-bqwsf"] Mar 16 16:30:00 crc kubenswrapper[5120]: I0316 16:30:00.162965 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561310-bqwsf" Mar 16 16:30:00 crc kubenswrapper[5120]: I0316 16:30:00.167107 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"openshift-service-ca.crt\"" Mar 16 16:30:00 crc kubenswrapper[5120]: I0316 16:30:00.167395 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"kube-root-ca.crt\"" Mar 16 16:30:00 crc kubenswrapper[5120]: I0316 16:30:00.173200 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561310-bqwsf"] Mar 16 16:30:00 crc kubenswrapper[5120]: I0316 16:30:00.186407 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-infra\"/\"csr-approver-sa-dockercfg-x2nsz\"" Mar 16 16:30:00 crc kubenswrapper[5120]: I0316 16:30:00.190845 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29561310-46dmp"] Mar 16 16:30:00 crc kubenswrapper[5120]: I0316 16:30:00.222409 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29561310-46dmp"] Mar 16 16:30:00 crc kubenswrapper[5120]: I0316 16:30:00.222601 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29561310-46dmp" Mar 16 16:30:00 crc kubenswrapper[5120]: I0316 16:30:00.226152 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operator-lifecycle-manager\"/\"collect-profiles-dockercfg-vfqp6\"" Mar 16 16:30:00 crc kubenswrapper[5120]: I0316 16:30:00.227494 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operator-lifecycle-manager\"/\"collect-profiles-config\"" Mar 16 16:30:00 crc kubenswrapper[5120]: I0316 16:30:00.245918 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l96dg\" (UniqueName: \"kubernetes.io/projected/97b7bd30-d48c-423d-b25f-f8b32bf60888-kube-api-access-l96dg\") pod \"auto-csr-approver-29561310-bqwsf\" (UID: \"97b7bd30-d48c-423d-b25f-f8b32bf60888\") " pod="openshift-infra/auto-csr-approver-29561310-bqwsf" Mar 16 16:30:00 crc kubenswrapper[5120]: I0316 16:30:00.349788 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6064853b-89f3-446e-8810-bded0e3841ce-config-volume\") pod \"collect-profiles-29561310-46dmp\" (UID: \"6064853b-89f3-446e-8810-bded0e3841ce\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561310-46dmp" Mar 16 16:30:00 crc kubenswrapper[5120]: I0316 16:30:00.349850 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lccvk\" (UniqueName: \"kubernetes.io/projected/6064853b-89f3-446e-8810-bded0e3841ce-kube-api-access-lccvk\") pod \"collect-profiles-29561310-46dmp\" (UID: \"6064853b-89f3-446e-8810-bded0e3841ce\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561310-46dmp" Mar 16 16:30:00 crc kubenswrapper[5120]: I0316 16:30:00.350188 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l96dg\" (UniqueName: \"kubernetes.io/projected/97b7bd30-d48c-423d-b25f-f8b32bf60888-kube-api-access-l96dg\") pod \"auto-csr-approver-29561310-bqwsf\" (UID: \"97b7bd30-d48c-423d-b25f-f8b32bf60888\") " pod="openshift-infra/auto-csr-approver-29561310-bqwsf" Mar 16 16:30:00 crc kubenswrapper[5120]: I0316 16:30:00.350594 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/6064853b-89f3-446e-8810-bded0e3841ce-secret-volume\") pod \"collect-profiles-29561310-46dmp\" (UID: \"6064853b-89f3-446e-8810-bded0e3841ce\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561310-46dmp" Mar 16 16:30:00 crc kubenswrapper[5120]: I0316 16:30:00.372274 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l96dg\" (UniqueName: \"kubernetes.io/projected/97b7bd30-d48c-423d-b25f-f8b32bf60888-kube-api-access-l96dg\") pod \"auto-csr-approver-29561310-bqwsf\" (UID: \"97b7bd30-d48c-423d-b25f-f8b32bf60888\") " pod="openshift-infra/auto-csr-approver-29561310-bqwsf" Mar 16 16:30:00 crc kubenswrapper[5120]: I0316 16:30:00.452456 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6064853b-89f3-446e-8810-bded0e3841ce-config-volume\") pod \"collect-profiles-29561310-46dmp\" (UID: \"6064853b-89f3-446e-8810-bded0e3841ce\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561310-46dmp" Mar 16 16:30:00 crc kubenswrapper[5120]: I0316 16:30:00.452533 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lccvk\" (UniqueName: \"kubernetes.io/projected/6064853b-89f3-446e-8810-bded0e3841ce-kube-api-access-lccvk\") pod \"collect-profiles-29561310-46dmp\" (UID: \"6064853b-89f3-446e-8810-bded0e3841ce\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561310-46dmp" Mar 16 16:30:00 crc kubenswrapper[5120]: I0316 16:30:00.452803 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/6064853b-89f3-446e-8810-bded0e3841ce-secret-volume\") pod \"collect-profiles-29561310-46dmp\" (UID: \"6064853b-89f3-446e-8810-bded0e3841ce\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561310-46dmp" Mar 16 16:30:00 crc kubenswrapper[5120]: I0316 16:30:00.453935 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6064853b-89f3-446e-8810-bded0e3841ce-config-volume\") pod \"collect-profiles-29561310-46dmp\" (UID: \"6064853b-89f3-446e-8810-bded0e3841ce\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561310-46dmp" Mar 16 16:30:00 crc kubenswrapper[5120]: I0316 16:30:00.458807 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/6064853b-89f3-446e-8810-bded0e3841ce-secret-volume\") pod \"collect-profiles-29561310-46dmp\" (UID: \"6064853b-89f3-446e-8810-bded0e3841ce\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561310-46dmp" Mar 16 16:30:00 crc kubenswrapper[5120]: I0316 16:30:00.474855 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lccvk\" (UniqueName: \"kubernetes.io/projected/6064853b-89f3-446e-8810-bded0e3841ce-kube-api-access-lccvk\") pod \"collect-profiles-29561310-46dmp\" (UID: \"6064853b-89f3-446e-8810-bded0e3841ce\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561310-46dmp" Mar 16 16:30:00 crc kubenswrapper[5120]: I0316 16:30:00.486912 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561310-bqwsf" Mar 16 16:30:00 crc kubenswrapper[5120]: I0316 16:30:00.544913 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29561310-46dmp" Mar 16 16:30:01 crc kubenswrapper[5120]: I0316 16:30:01.052796 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29561310-46dmp"] Mar 16 16:30:01 crc kubenswrapper[5120]: W0316 16:30:01.058720 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6064853b_89f3_446e_8810_bded0e3841ce.slice/crio-222d93a8c2d9c1a103256037ef7236abf321254b64ad9618d868e8210442cf10 WatchSource:0}: Error finding container 222d93a8c2d9c1a103256037ef7236abf321254b64ad9618d868e8210442cf10: Status 404 returned error can't find the container with id 222d93a8c2d9c1a103256037ef7236abf321254b64ad9618d868e8210442cf10 Mar 16 16:30:01 crc kubenswrapper[5120]: I0316 16:30:01.108207 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561310-bqwsf"] Mar 16 16:30:01 crc kubenswrapper[5120]: W0316 16:30:01.114989 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod97b7bd30_d48c_423d_b25f_f8b32bf60888.slice/crio-daea388a4220afabb41609284f4d34cdba42251389fd64b8527e6e427d7cf036 WatchSource:0}: Error finding container daea388a4220afabb41609284f4d34cdba42251389fd64b8527e6e427d7cf036: Status 404 returned error can't find the container with id daea388a4220afabb41609284f4d34cdba42251389fd64b8527e6e427d7cf036 Mar 16 16:30:01 crc kubenswrapper[5120]: I0316 16:30:01.901440 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561310-bqwsf" event={"ID":"97b7bd30-d48c-423d-b25f-f8b32bf60888","Type":"ContainerStarted","Data":"daea388a4220afabb41609284f4d34cdba42251389fd64b8527e6e427d7cf036"} Mar 16 16:30:01 crc kubenswrapper[5120]: I0316 16:30:01.904211 5120 generic.go:358] "Generic (PLEG): container finished" podID="6064853b-89f3-446e-8810-bded0e3841ce" containerID="039e995a001dd01ac406fe88fd7c6a4e0cee00e7bd95a63b42b63ac30864905b" exitCode=0 Mar 16 16:30:01 crc kubenswrapper[5120]: I0316 16:30:01.904318 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/collect-profiles-29561310-46dmp" event={"ID":"6064853b-89f3-446e-8810-bded0e3841ce","Type":"ContainerDied","Data":"039e995a001dd01ac406fe88fd7c6a4e0cee00e7bd95a63b42b63ac30864905b"} Mar 16 16:30:01 crc kubenswrapper[5120]: I0316 16:30:01.904367 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/collect-profiles-29561310-46dmp" event={"ID":"6064853b-89f3-446e-8810-bded0e3841ce","Type":"ContainerStarted","Data":"222d93a8c2d9c1a103256037ef7236abf321254b64ad9618d868e8210442cf10"} Mar 16 16:30:03 crc kubenswrapper[5120]: I0316 16:30:03.364610 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29561310-46dmp" Mar 16 16:30:03 crc kubenswrapper[5120]: I0316 16:30:03.436884 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6064853b-89f3-446e-8810-bded0e3841ce-config-volume\") pod \"6064853b-89f3-446e-8810-bded0e3841ce\" (UID: \"6064853b-89f3-446e-8810-bded0e3841ce\") " Mar 16 16:30:03 crc kubenswrapper[5120]: I0316 16:30:03.437079 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lccvk\" (UniqueName: \"kubernetes.io/projected/6064853b-89f3-446e-8810-bded0e3841ce-kube-api-access-lccvk\") pod \"6064853b-89f3-446e-8810-bded0e3841ce\" (UID: \"6064853b-89f3-446e-8810-bded0e3841ce\") " Mar 16 16:30:03 crc kubenswrapper[5120]: I0316 16:30:03.437354 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/6064853b-89f3-446e-8810-bded0e3841ce-secret-volume\") pod \"6064853b-89f3-446e-8810-bded0e3841ce\" (UID: \"6064853b-89f3-446e-8810-bded0e3841ce\") " Mar 16 16:30:03 crc kubenswrapper[5120]: I0316 16:30:03.437874 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6064853b-89f3-446e-8810-bded0e3841ce-config-volume" (OuterVolumeSpecName: "config-volume") pod "6064853b-89f3-446e-8810-bded0e3841ce" (UID: "6064853b-89f3-446e-8810-bded0e3841ce"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:30:03 crc kubenswrapper[5120]: I0316 16:30:03.438366 5120 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6064853b-89f3-446e-8810-bded0e3841ce-config-volume\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:03 crc kubenswrapper[5120]: I0316 16:30:03.443884 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6064853b-89f3-446e-8810-bded0e3841ce-secret-volume" (OuterVolumeSpecName: "secret-volume") pod "6064853b-89f3-446e-8810-bded0e3841ce" (UID: "6064853b-89f3-446e-8810-bded0e3841ce"). InnerVolumeSpecName "secret-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:30:03 crc kubenswrapper[5120]: I0316 16:30:03.443939 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6064853b-89f3-446e-8810-bded0e3841ce-kube-api-access-lccvk" (OuterVolumeSpecName: "kube-api-access-lccvk") pod "6064853b-89f3-446e-8810-bded0e3841ce" (UID: "6064853b-89f3-446e-8810-bded0e3841ce"). InnerVolumeSpecName "kube-api-access-lccvk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:30:03 crc kubenswrapper[5120]: I0316 16:30:03.541856 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lccvk\" (UniqueName: \"kubernetes.io/projected/6064853b-89f3-446e-8810-bded0e3841ce-kube-api-access-lccvk\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:03 crc kubenswrapper[5120]: I0316 16:30:03.541911 5120 reconciler_common.go:299] "Volume detached for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/6064853b-89f3-446e-8810-bded0e3841ce-secret-volume\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:03 crc kubenswrapper[5120]: I0316 16:30:03.930677 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29561310-46dmp" Mar 16 16:30:03 crc kubenswrapper[5120]: I0316 16:30:03.930677 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/collect-profiles-29561310-46dmp" event={"ID":"6064853b-89f3-446e-8810-bded0e3841ce","Type":"ContainerDied","Data":"222d93a8c2d9c1a103256037ef7236abf321254b64ad9618d868e8210442cf10"} Mar 16 16:30:03 crc kubenswrapper[5120]: I0316 16:30:03.930802 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="222d93a8c2d9c1a103256037ef7236abf321254b64ad9618d868e8210442cf10" Mar 16 16:30:03 crc kubenswrapper[5120]: I0316 16:30:03.933348 5120 generic.go:358] "Generic (PLEG): container finished" podID="97b7bd30-d48c-423d-b25f-f8b32bf60888" containerID="108fca00527a3817274826615b98836fba368197ffe0d3e67ec3e35b6f396630" exitCode=0 Mar 16 16:30:03 crc kubenswrapper[5120]: I0316 16:30:03.933551 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561310-bqwsf" event={"ID":"97b7bd30-d48c-423d-b25f-f8b32bf60888","Type":"ContainerDied","Data":"108fca00527a3817274826615b98836fba368197ffe0d3e67ec3e35b6f396630"} Mar 16 16:30:04 crc kubenswrapper[5120]: I0316 16:30:04.448144 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29561265-qt4pj"] Mar 16 16:30:04 crc kubenswrapper[5120]: I0316 16:30:04.459670 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29561265-qt4pj"] Mar 16 16:30:04 crc kubenswrapper[5120]: I0316 16:30:04.674608 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d78869ec-ceb9-4dda-b1cb-3f03d505a647" path="/var/lib/kubelet/pods/d78869ec-ceb9-4dda-b1cb-3f03d505a647/volumes" Mar 16 16:30:05 crc kubenswrapper[5120]: I0316 16:30:05.295749 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561310-bqwsf" Mar 16 16:30:05 crc kubenswrapper[5120]: I0316 16:30:05.391057 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l96dg\" (UniqueName: \"kubernetes.io/projected/97b7bd30-d48c-423d-b25f-f8b32bf60888-kube-api-access-l96dg\") pod \"97b7bd30-d48c-423d-b25f-f8b32bf60888\" (UID: \"97b7bd30-d48c-423d-b25f-f8b32bf60888\") " Mar 16 16:30:05 crc kubenswrapper[5120]: I0316 16:30:05.397779 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97b7bd30-d48c-423d-b25f-f8b32bf60888-kube-api-access-l96dg" (OuterVolumeSpecName: "kube-api-access-l96dg") pod "97b7bd30-d48c-423d-b25f-f8b32bf60888" (UID: "97b7bd30-d48c-423d-b25f-f8b32bf60888"). InnerVolumeSpecName "kube-api-access-l96dg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:30:05 crc kubenswrapper[5120]: I0316 16:30:05.494578 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l96dg\" (UniqueName: \"kubernetes.io/projected/97b7bd30-d48c-423d-b25f-f8b32bf60888-kube-api-access-l96dg\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:05 crc kubenswrapper[5120]: I0316 16:30:05.953466 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561310-bqwsf" event={"ID":"97b7bd30-d48c-423d-b25f-f8b32bf60888","Type":"ContainerDied","Data":"daea388a4220afabb41609284f4d34cdba42251389fd64b8527e6e427d7cf036"} Mar 16 16:30:05 crc kubenswrapper[5120]: I0316 16:30:05.953527 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="daea388a4220afabb41609284f4d34cdba42251389fd64b8527e6e427d7cf036" Mar 16 16:30:05 crc kubenswrapper[5120]: I0316 16:30:05.953478 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561310-bqwsf" Mar 16 16:30:06 crc kubenswrapper[5120]: I0316 16:30:06.354063 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-infra/auto-csr-approver-29561304-tlv7d"] Mar 16 16:30:06 crc kubenswrapper[5120]: I0316 16:30:06.372022 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-infra/auto-csr-approver-29561304-tlv7d"] Mar 16 16:30:06 crc kubenswrapper[5120]: I0316 16:30:06.674596 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9d5e5a11-7dc9-4ba8-ab1e-c63c16c54aac" path="/var/lib/kubelet/pods/9d5e5a11-7dc9-4ba8-ab1e-c63c16c54aac/volumes" Mar 16 16:30:08 crc kubenswrapper[5120]: E0316 16:30:08.111331 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=2078711 actualBytes=10240 Mar 16 16:30:21 crc kubenswrapper[5120]: I0316 16:30:21.303142 5120 scope.go:117] "RemoveContainer" containerID="04e36d71c6a6c65c6cf574a4e03bc47b26eeab3e3b231a1f90003eff30b30590" Mar 16 16:30:21 crc kubenswrapper[5120]: I0316 16:30:21.380413 5120 scope.go:117] "RemoveContainer" containerID="f21b7fd2ffaaa426e057b3f52813d44d88d29e2685857615b0312b38381ba9de" Mar 16 16:30:25 crc kubenswrapper[5120]: I0316 16:30:25.835338 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:30:29 crc kubenswrapper[5120]: I0316 16:30:29.949832 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 16:30:29 crc kubenswrapper[5120]: I0316 16:30:29.950515 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/openstackclient" podUID="5456036b-4cdb-4d1a-9b60-d0effc293043" containerName="openstackclient" containerID="cri-o://b0827a3b77f1f888901fc0c03daaa68e9b8ae643846cc4a639bc12495d1f5f47" gracePeriod=2 Mar 16 16:30:29 crc kubenswrapper[5120]: I0316 16:30:29.956153 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 16:30:29 crc kubenswrapper[5120]: I0316 16:30:29.956794 5120 status_manager.go:895] "Failed to get status for pod" podUID="5456036b-4cdb-4d1a-9b60-d0effc293043" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 16:30:30 crc kubenswrapper[5120]: I0316 16:30:30.012135 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 16:30:30 crc kubenswrapper[5120]: I0316 16:30:30.032119 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-2"] Mar 16 16:30:30 crc kubenswrapper[5120]: I0316 16:30:30.107686 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-1"] Mar 16 16:30:30 crc kubenswrapper[5120]: I0316 16:30:30.139823 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-5b46-account-create-update-llf4v"] Mar 16 16:30:30 crc kubenswrapper[5120]: I0316 16:30:30.141252 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5456036b-4cdb-4d1a-9b60-d0effc293043" containerName="openstackclient" Mar 16 16:30:30 crc kubenswrapper[5120]: I0316 16:30:30.141273 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="5456036b-4cdb-4d1a-9b60-d0effc293043" containerName="openstackclient" Mar 16 16:30:30 crc kubenswrapper[5120]: I0316 16:30:30.141316 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97b7bd30-d48c-423d-b25f-f8b32bf60888" containerName="oc" Mar 16 16:30:30 crc kubenswrapper[5120]: I0316 16:30:30.141322 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="97b7bd30-d48c-423d-b25f-f8b32bf60888" containerName="oc" Mar 16 16:30:30 crc kubenswrapper[5120]: I0316 16:30:30.141373 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6064853b-89f3-446e-8810-bded0e3841ce" containerName="collect-profiles" Mar 16 16:30:30 crc kubenswrapper[5120]: I0316 16:30:30.141381 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="6064853b-89f3-446e-8810-bded0e3841ce" containerName="collect-profiles" Mar 16 16:30:30 crc kubenswrapper[5120]: I0316 16:30:30.141574 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="6064853b-89f3-446e-8810-bded0e3841ce" containerName="collect-profiles" Mar 16 16:30:30 crc kubenswrapper[5120]: I0316 16:30:30.141590 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="5456036b-4cdb-4d1a-9b60-d0effc293043" containerName="openstackclient" Mar 16 16:30:30 crc kubenswrapper[5120]: I0316 16:30:30.141614 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="97b7bd30-d48c-423d-b25f-f8b32bf60888" containerName="oc" Mar 16 16:30:30 crc kubenswrapper[5120]: I0316 16:30:30.152510 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-5b46-account-create-update-llf4v" Mar 16 16:30:30 crc kubenswrapper[5120]: I0316 16:30:30.172324 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-db-secret\"" Mar 16 16:30:30 crc kubenswrapper[5120]: I0316 16:30:30.183831 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/root-account-create-update-gmjzc"] Mar 16 16:30:30 crc kubenswrapper[5120]: I0316 16:30:30.189781 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-gmjzc" Mar 16 16:30:30 crc kubenswrapper[5120]: I0316 16:30:30.200316 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-5b46-account-create-update-llf4v"] Mar 16 16:30:30 crc kubenswrapper[5120]: I0316 16:30:30.207144 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"openstack-mariadb-root-db-secret\"" Mar 16 16:30:30 crc kubenswrapper[5120]: I0316 16:30:30.232005 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-500e-account-create-update-wd7jx"] Mar 16 16:30:30 crc kubenswrapper[5120]: I0316 16:30:30.241653 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9943d2d4-e26d-4c91-942e-a6d788ac8c7e-operator-scripts\") pod \"root-account-create-update-gmjzc\" (UID: \"9943d2d4-e26d-4c91-942e-a6d788ac8c7e\") " pod="openstack-kuttl-tests/root-account-create-update-gmjzc" Mar 16 16:30:30 crc kubenswrapper[5120]: I0316 16:30:30.241887 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gk7tz\" (UniqueName: \"kubernetes.io/projected/9943d2d4-e26d-4c91-942e-a6d788ac8c7e-kube-api-access-gk7tz\") pod \"root-account-create-update-gmjzc\" (UID: \"9943d2d4-e26d-4c91-942e-a6d788ac8c7e\") " pod="openstack-kuttl-tests/root-account-create-update-gmjzc" Mar 16 16:30:30 crc kubenswrapper[5120]: I0316 16:30:30.255130 5120 status_manager.go:895] "Failed to get status for pod" podUID="5456036b-4cdb-4d1a-9b60-d0effc293043" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 16:30:30 crc kubenswrapper[5120]: I0316 16:30:30.265838 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 16:30:30 crc kubenswrapper[5120]: I0316 16:30:30.266166 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovn-northd-0" podUID="c88c8ef0-5871-4507-9dcd-4c5312779d29" containerName="ovn-northd" containerID="cri-o://e1acde98a5a05ec8850ffa2722ab38d50f5f6d3995cf5efd90f9138ab9d44804" gracePeriod=30 Mar 16 16:30:30 crc kubenswrapper[5120]: I0316 16:30:30.266253 5120 status_manager.go:895] "Failed to get status for pod" podUID="5456036b-4cdb-4d1a-9b60-d0effc293043" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 16:30:30 crc kubenswrapper[5120]: I0316 16:30:30.266407 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-500e-account-create-update-wd7jx" Mar 16 16:30:30 crc kubenswrapper[5120]: I0316 16:30:30.267365 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovn-northd-0" podUID="c88c8ef0-5871-4507-9dcd-4c5312779d29" containerName="openstack-network-exporter" containerID="cri-o://cca86ca4bb425959b3293666ee823af2b2b49331f3e113b4ce0a7a9cf086803e" gracePeriod=30 Mar 16 16:30:30 crc kubenswrapper[5120]: I0316 16:30:30.275600 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-db-secret\"" Mar 16 16:30:30 crc kubenswrapper[5120]: I0316 16:30:30.325887 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-5b46-account-create-update-2448q"] Mar 16 16:30:30 crc kubenswrapper[5120]: I0316 16:30:30.345461 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/29ef1c2d-283b-421f-8631-ada83f6ea799-operator-scripts\") pod \"nova-cell1-5b46-account-create-update-llf4v\" (UID: \"29ef1c2d-283b-421f-8631-ada83f6ea799\") " pod="openstack-kuttl-tests/nova-cell1-5b46-account-create-update-llf4v" Mar 16 16:30:30 crc kubenswrapper[5120]: I0316 16:30:30.345545 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gk7tz\" (UniqueName: \"kubernetes.io/projected/9943d2d4-e26d-4c91-942e-a6d788ac8c7e-kube-api-access-gk7tz\") pod \"root-account-create-update-gmjzc\" (UID: \"9943d2d4-e26d-4c91-942e-a6d788ac8c7e\") " pod="openstack-kuttl-tests/root-account-create-update-gmjzc" Mar 16 16:30:30 crc kubenswrapper[5120]: I0316 16:30:30.345963 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46gvh\" (UniqueName: \"kubernetes.io/projected/29ef1c2d-283b-421f-8631-ada83f6ea799-kube-api-access-46gvh\") pod \"nova-cell1-5b46-account-create-update-llf4v\" (UID: \"29ef1c2d-283b-421f-8631-ada83f6ea799\") " pod="openstack-kuttl-tests/nova-cell1-5b46-account-create-update-llf4v" Mar 16 16:30:30 crc kubenswrapper[5120]: I0316 16:30:30.346037 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9943d2d4-e26d-4c91-942e-a6d788ac8c7e-operator-scripts\") pod \"root-account-create-update-gmjzc\" (UID: \"9943d2d4-e26d-4c91-942e-a6d788ac8c7e\") " pod="openstack-kuttl-tests/root-account-create-update-gmjzc" Mar 16 16:30:30 crc kubenswrapper[5120]: I0316 16:30:30.347226 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9943d2d4-e26d-4c91-942e-a6d788ac8c7e-operator-scripts\") pod \"root-account-create-update-gmjzc\" (UID: \"9943d2d4-e26d-4c91-942e-a6d788ac8c7e\") " pod="openstack-kuttl-tests/root-account-create-update-gmjzc" Mar 16 16:30:30 crc kubenswrapper[5120]: I0316 16:30:30.380191 5120 status_manager.go:895] "Failed to get status for pod" podUID="5456036b-4cdb-4d1a-9b60-d0effc293043" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 16:30:30 crc kubenswrapper[5120]: I0316 16:30:30.385398 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-5b46-account-create-update-2448q"] Mar 16 16:30:30 crc kubenswrapper[5120]: I0316 16:30:30.430271 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gk7tz\" (UniqueName: \"kubernetes.io/projected/9943d2d4-e26d-4c91-942e-a6d788ac8c7e-kube-api-access-gk7tz\") pod \"root-account-create-update-gmjzc\" (UID: \"9943d2d4-e26d-4c91-942e-a6d788ac8c7e\") " pod="openstack-kuttl-tests/root-account-create-update-gmjzc" Mar 16 16:30:30 crc kubenswrapper[5120]: I0316 16:30:30.454917 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/29ef1c2d-283b-421f-8631-ada83f6ea799-operator-scripts\") pod \"nova-cell1-5b46-account-create-update-llf4v\" (UID: \"29ef1c2d-283b-421f-8631-ada83f6ea799\") " pod="openstack-kuttl-tests/nova-cell1-5b46-account-create-update-llf4v" Mar 16 16:30:30 crc kubenswrapper[5120]: I0316 16:30:30.455024 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/7d4aa5b5-78e4-464e-bee0-18da0561de5d-operator-scripts\") pod \"neutron-500e-account-create-update-wd7jx\" (UID: \"7d4aa5b5-78e4-464e-bee0-18da0561de5d\") " pod="openstack-kuttl-tests/neutron-500e-account-create-update-wd7jx" Mar 16 16:30:30 crc kubenswrapper[5120]: I0316 16:30:30.455129 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-46gvh\" (UniqueName: \"kubernetes.io/projected/29ef1c2d-283b-421f-8631-ada83f6ea799-kube-api-access-46gvh\") pod \"nova-cell1-5b46-account-create-update-llf4v\" (UID: \"29ef1c2d-283b-421f-8631-ada83f6ea799\") " pod="openstack-kuttl-tests/nova-cell1-5b46-account-create-update-llf4v" Mar 16 16:30:30 crc kubenswrapper[5120]: I0316 16:30:30.455224 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nscjg\" (UniqueName: \"kubernetes.io/projected/7d4aa5b5-78e4-464e-bee0-18da0561de5d-kube-api-access-nscjg\") pod \"neutron-500e-account-create-update-wd7jx\" (UID: \"7d4aa5b5-78e4-464e-bee0-18da0561de5d\") " pod="openstack-kuttl-tests/neutron-500e-account-create-update-wd7jx" Mar 16 16:30:30 crc kubenswrapper[5120]: I0316 16:30:30.455975 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/29ef1c2d-283b-421f-8631-ada83f6ea799-operator-scripts\") pod \"nova-cell1-5b46-account-create-update-llf4v\" (UID: \"29ef1c2d-283b-421f-8631-ada83f6ea799\") " pod="openstack-kuttl-tests/nova-cell1-5b46-account-create-update-llf4v" Mar 16 16:30:30 crc kubenswrapper[5120]: I0316 16:30:30.466997 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-gmjzc"] Mar 16 16:30:30 crc kubenswrapper[5120]: I0316 16:30:30.524290 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-500e-account-create-update-r59gp"] Mar 16 16:30:30 crc kubenswrapper[5120]: I0316 16:30:30.525153 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-gmjzc" Mar 16 16:30:30 crc kubenswrapper[5120]: I0316 16:30:30.558398 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nscjg\" (UniqueName: \"kubernetes.io/projected/7d4aa5b5-78e4-464e-bee0-18da0561de5d-kube-api-access-nscjg\") pod \"neutron-500e-account-create-update-wd7jx\" (UID: \"7d4aa5b5-78e4-464e-bee0-18da0561de5d\") " pod="openstack-kuttl-tests/neutron-500e-account-create-update-wd7jx" Mar 16 16:30:30 crc kubenswrapper[5120]: I0316 16:30:30.558666 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/7d4aa5b5-78e4-464e-bee0-18da0561de5d-operator-scripts\") pod \"neutron-500e-account-create-update-wd7jx\" (UID: \"7d4aa5b5-78e4-464e-bee0-18da0561de5d\") " pod="openstack-kuttl-tests/neutron-500e-account-create-update-wd7jx" Mar 16 16:30:30 crc kubenswrapper[5120]: I0316 16:30:30.559483 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/7d4aa5b5-78e4-464e-bee0-18da0561de5d-operator-scripts\") pod \"neutron-500e-account-create-update-wd7jx\" (UID: \"7d4aa5b5-78e4-464e-bee0-18da0561de5d\") " pod="openstack-kuttl-tests/neutron-500e-account-create-update-wd7jx" Mar 16 16:30:30 crc kubenswrapper[5120]: I0316 16:30:30.590849 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-500e-account-create-update-wd7jx"] Mar 16 16:30:30 crc kubenswrapper[5120]: I0316 16:30:30.610444 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nscjg\" (UniqueName: \"kubernetes.io/projected/7d4aa5b5-78e4-464e-bee0-18da0561de5d-kube-api-access-nscjg\") pod \"neutron-500e-account-create-update-wd7jx\" (UID: \"7d4aa5b5-78e4-464e-bee0-18da0561de5d\") " pod="openstack-kuttl-tests/neutron-500e-account-create-update-wd7jx" Mar 16 16:30:30 crc kubenswrapper[5120]: I0316 16:30:30.611301 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-46gvh\" (UniqueName: \"kubernetes.io/projected/29ef1c2d-283b-421f-8631-ada83f6ea799-kube-api-access-46gvh\") pod \"nova-cell1-5b46-account-create-update-llf4v\" (UID: \"29ef1c2d-283b-421f-8631-ada83f6ea799\") " pod="openstack-kuttl-tests/nova-cell1-5b46-account-create-update-llf4v" Mar 16 16:30:30 crc kubenswrapper[5120]: I0316 16:30:30.646631 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-500e-account-create-update-r59gp"] Mar 16 16:30:30 crc kubenswrapper[5120]: I0316 16:30:30.748548 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3009831d-c0d7-4ce2-a2ff-7e2b9807c4a3" path="/var/lib/kubelet/pods/3009831d-c0d7-4ce2-a2ff-7e2b9807c4a3/volumes" Mar 16 16:30:30 crc kubenswrapper[5120]: I0316 16:30:30.749265 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="96781f8d-3ff9-4c6c-a468-67785be1dfd7" path="/var/lib/kubelet/pods/96781f8d-3ff9-4c6c-a468-67785be1dfd7/volumes" Mar 16 16:30:30 crc kubenswrapper[5120]: I0316 16:30:30.776899 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-8f87-account-create-update-kgjw8"] Mar 16 16:30:30 crc kubenswrapper[5120]: I0316 16:30:30.785334 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-5b46-account-create-update-llf4v" Mar 16 16:30:30 crc kubenswrapper[5120]: I0316 16:30:30.820090 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-8f87-account-create-update-kgjw8"] Mar 16 16:30:30 crc kubenswrapper[5120]: I0316 16:30:30.820128 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-821f-account-create-update-8ph6s"] Mar 16 16:30:30 crc kubenswrapper[5120]: I0316 16:30:30.821130 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-8f87-account-create-update-kgjw8" Mar 16 16:30:30 crc kubenswrapper[5120]: I0316 16:30:30.830452 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-821f-account-create-update-8ph6s" Mar 16 16:30:30 crc kubenswrapper[5120]: I0316 16:30:30.832210 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-821f-account-create-update-8ph6s"] Mar 16 16:30:30 crc kubenswrapper[5120]: I0316 16:30:30.832666 5120 kubelet_pods.go:1019] "Unable to retrieve pull secret, the image pull may not succeed." pod="openstack-kuttl-tests/neutron-59d4fdd9db-tttbf" secret="" err="secret \"neutron-neutron-dockercfg-9rbcd\" not found" Mar 16 16:30:30 crc kubenswrapper[5120]: I0316 16:30:30.860095 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 16:30:30 crc kubenswrapper[5120]: I0316 16:30:30.860450 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podUID="6ed22727-fd32-47c8-ae36-f80dddf5c720" containerName="openstack-network-exporter" containerID="cri-o://7034d7226b348e254095effb353147b9fc1991d1469e66b85c58a896fe62472f" gracePeriod=300 Mar 16 16:30:30 crc kubenswrapper[5120]: I0316 16:30:30.860917 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-db-secret\"" Mar 16 16:30:30 crc kubenswrapper[5120]: I0316 16:30:30.861141 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-db-secret\"" Mar 16 16:30:30 crc kubenswrapper[5120]: I0316 16:30:30.895839 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-500e-account-create-update-wd7jx" Mar 16 16:30:30 crc kubenswrapper[5120]: I0316 16:30:30.908347 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-2"] Mar 16 16:30:30 crc kubenswrapper[5120]: I0316 16:30:30.950487 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-821f-account-create-update-h8xcp"] Mar 16 16:30:31 crc kubenswrapper[5120]: I0316 16:30:31.026427 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podUID="6ed22727-fd32-47c8-ae36-f80dddf5c720" containerName="ovsdbserver-sb" containerID="cri-o://e99e3ae5101bdbc62ad21f612132580274e93c17121c53266efb9314890ae18d" gracePeriod=300 Mar 16 16:30:31 crc kubenswrapper[5120]: I0316 16:30:31.066878 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8l28\" (UniqueName: \"kubernetes.io/projected/b62b0167-9419-454f-a1c2-78d1354baeb2-kube-api-access-l8l28\") pod \"barbican-8f87-account-create-update-kgjw8\" (UID: \"b62b0167-9419-454f-a1c2-78d1354baeb2\") " pod="openstack-kuttl-tests/barbican-8f87-account-create-update-kgjw8" Mar 16 16:30:31 crc kubenswrapper[5120]: I0316 16:30:31.073622 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0c04a9e3-0a3b-4895-8703-bb958c3000fd-operator-scripts\") pod \"placement-821f-account-create-update-8ph6s\" (UID: \"0c04a9e3-0a3b-4895-8703-bb958c3000fd\") " pod="openstack-kuttl-tests/placement-821f-account-create-update-8ph6s" Mar 16 16:30:31 crc kubenswrapper[5120]: I0316 16:30:31.073904 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8gzm\" (UniqueName: \"kubernetes.io/projected/0c04a9e3-0a3b-4895-8703-bb958c3000fd-kube-api-access-s8gzm\") pod \"placement-821f-account-create-update-8ph6s\" (UID: \"0c04a9e3-0a3b-4895-8703-bb958c3000fd\") " pod="openstack-kuttl-tests/placement-821f-account-create-update-8ph6s" Mar 16 16:30:31 crc kubenswrapper[5120]: I0316 16:30:31.075915 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b62b0167-9419-454f-a1c2-78d1354baeb2-operator-scripts\") pod \"barbican-8f87-account-create-update-kgjw8\" (UID: \"b62b0167-9419-454f-a1c2-78d1354baeb2\") " pod="openstack-kuttl-tests/barbican-8f87-account-create-update-kgjw8" Mar 16 16:30:31 crc kubenswrapper[5120]: E0316 16:30:31.077093 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/neutron-config: secret "neutron-config" not found Mar 16 16:30:31 crc kubenswrapper[5120]: E0316 16:30:31.077170 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/325f32e1-5461-4d71-a30c-dee2528d6fb3-config podName:325f32e1-5461-4d71-a30c-dee2528d6fb3 nodeName:}" failed. No retries permitted until 2026-03-16 16:30:31.577145483 +0000 UTC m=+3533.731077130 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "config" (UniqueName: "kubernetes.io/secret/325f32e1-5461-4d71-a30c-dee2528d6fb3-config") pod "neutron-59d4fdd9db-tttbf" (UID: "325f32e1-5461-4d71-a30c-dee2528d6fb3") : secret "neutron-config" not found Mar 16 16:30:31 crc kubenswrapper[5120]: E0316 16:30:31.078228 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/neutron-httpd-config: secret "neutron-httpd-config" not found Mar 16 16:30:31 crc kubenswrapper[5120]: E0316 16:30:31.078270 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/325f32e1-5461-4d71-a30c-dee2528d6fb3-httpd-config podName:325f32e1-5461-4d71-a30c-dee2528d6fb3 nodeName:}" failed. No retries permitted until 2026-03-16 16:30:31.578260033 +0000 UTC m=+3533.732191680 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "httpd-config" (UniqueName: "kubernetes.io/secret/325f32e1-5461-4d71-a30c-dee2528d6fb3-httpd-config") pod "neutron-59d4fdd9db-tttbf" (UID: "325f32e1-5461-4d71-a30c-dee2528d6fb3") : secret "neutron-httpd-config" not found Mar 16 16:30:31 crc kubenswrapper[5120]: E0316 16:30:31.079658 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Mar 16 16:30:31 crc kubenswrapper[5120]: E0316 16:30:31.079698 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b190faa2-d49d-424d-90bc-3e6e34d1b362-config-data podName:b190faa2-d49d-424d-90bc-3e6e34d1b362 nodeName:}" failed. No retries permitted until 2026-03-16 16:30:31.579689131 +0000 UTC m=+3533.733620788 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/b190faa2-d49d-424d-90bc-3e6e34d1b362-config-data") pod "rabbitmq-cell1-server-2" (UID: "b190faa2-d49d-424d-90bc-3e6e34d1b362") : configmap "rabbitmq-cell1-config-data" not found Mar 16 16:30:31 crc kubenswrapper[5120]: I0316 16:30:31.158213 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-8f87-account-create-update-md6vc"] Mar 16 16:30:31 crc kubenswrapper[5120]: I0316 16:30:31.191033 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-821f-account-create-update-h8xcp"] Mar 16 16:30:31 crc kubenswrapper[5120]: I0316 16:30:31.205815 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b62b0167-9419-454f-a1c2-78d1354baeb2-operator-scripts\") pod \"barbican-8f87-account-create-update-kgjw8\" (UID: \"b62b0167-9419-454f-a1c2-78d1354baeb2\") " pod="openstack-kuttl-tests/barbican-8f87-account-create-update-kgjw8" Mar 16 16:30:31 crc kubenswrapper[5120]: I0316 16:30:31.206121 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l8l28\" (UniqueName: \"kubernetes.io/projected/b62b0167-9419-454f-a1c2-78d1354baeb2-kube-api-access-l8l28\") pod \"barbican-8f87-account-create-update-kgjw8\" (UID: \"b62b0167-9419-454f-a1c2-78d1354baeb2\") " pod="openstack-kuttl-tests/barbican-8f87-account-create-update-kgjw8" Mar 16 16:30:31 crc kubenswrapper[5120]: I0316 16:30:31.206244 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0c04a9e3-0a3b-4895-8703-bb958c3000fd-operator-scripts\") pod \"placement-821f-account-create-update-8ph6s\" (UID: \"0c04a9e3-0a3b-4895-8703-bb958c3000fd\") " pod="openstack-kuttl-tests/placement-821f-account-create-update-8ph6s" Mar 16 16:30:31 crc kubenswrapper[5120]: I0316 16:30:31.206356 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s8gzm\" (UniqueName: \"kubernetes.io/projected/0c04a9e3-0a3b-4895-8703-bb958c3000fd-kube-api-access-s8gzm\") pod \"placement-821f-account-create-update-8ph6s\" (UID: \"0c04a9e3-0a3b-4895-8703-bb958c3000fd\") " pod="openstack-kuttl-tests/placement-821f-account-create-update-8ph6s" Mar 16 16:30:31 crc kubenswrapper[5120]: I0316 16:30:31.207634 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b62b0167-9419-454f-a1c2-78d1354baeb2-operator-scripts\") pod \"barbican-8f87-account-create-update-kgjw8\" (UID: \"b62b0167-9419-454f-a1c2-78d1354baeb2\") " pod="openstack-kuttl-tests/barbican-8f87-account-create-update-kgjw8" Mar 16 16:30:31 crc kubenswrapper[5120]: I0316 16:30:31.209666 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0c04a9e3-0a3b-4895-8703-bb958c3000fd-operator-scripts\") pod \"placement-821f-account-create-update-8ph6s\" (UID: \"0c04a9e3-0a3b-4895-8703-bb958c3000fd\") " pod="openstack-kuttl-tests/placement-821f-account-create-update-8ph6s" Mar 16 16:30:31 crc kubenswrapper[5120]: I0316 16:30:31.226138 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-7qj4k"] Mar 16 16:30:31 crc kubenswrapper[5120]: I0316 16:30:31.234355 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 16:30:31 crc kubenswrapper[5120]: I0316 16:30:31.243917 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-8f87-account-create-update-md6vc"] Mar 16 16:30:31 crc kubenswrapper[5120]: I0316 16:30:31.258724 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8l28\" (UniqueName: \"kubernetes.io/projected/b62b0167-9419-454f-a1c2-78d1354baeb2-kube-api-access-l8l28\") pod \"barbican-8f87-account-create-update-kgjw8\" (UID: \"b62b0167-9419-454f-a1c2-78d1354baeb2\") " pod="openstack-kuttl-tests/barbican-8f87-account-create-update-kgjw8" Mar 16 16:30:31 crc kubenswrapper[5120]: I0316 16:30:31.259234 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8gzm\" (UniqueName: \"kubernetes.io/projected/0c04a9e3-0a3b-4895-8703-bb958c3000fd-kube-api-access-s8gzm\") pod \"placement-821f-account-create-update-8ph6s\" (UID: \"0c04a9e3-0a3b-4895-8703-bb958c3000fd\") " pod="openstack-kuttl-tests/placement-821f-account-create-update-8ph6s" Mar 16 16:30:31 crc kubenswrapper[5120]: I0316 16:30:31.285069 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-7qj4k"] Mar 16 16:30:31 crc kubenswrapper[5120]: I0316 16:30:31.308516 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_6ed22727-fd32-47c8-ae36-f80dddf5c720/ovsdbserver-sb/0.log" Mar 16 16:30:31 crc kubenswrapper[5120]: I0316 16:30:31.308608 5120 generic.go:358] "Generic (PLEG): container finished" podID="6ed22727-fd32-47c8-ae36-f80dddf5c720" containerID="7034d7226b348e254095effb353147b9fc1991d1469e66b85c58a896fe62472f" exitCode=2 Mar 16 16:30:31 crc kubenswrapper[5120]: I0316 16:30:31.308640 5120 generic.go:358] "Generic (PLEG): container finished" podID="6ed22727-fd32-47c8-ae36-f80dddf5c720" containerID="e99e3ae5101bdbc62ad21f612132580274e93c17121c53266efb9314890ae18d" exitCode=143 Mar 16 16:30:31 crc kubenswrapper[5120]: I0316 16:30:31.308942 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"6ed22727-fd32-47c8-ae36-f80dddf5c720","Type":"ContainerDied","Data":"7034d7226b348e254095effb353147b9fc1991d1469e66b85c58a896fe62472f"} Mar 16 16:30:31 crc kubenswrapper[5120]: I0316 16:30:31.308984 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"6ed22727-fd32-47c8-ae36-f80dddf5c720","Type":"ContainerDied","Data":"e99e3ae5101bdbc62ad21f612132580274e93c17121c53266efb9314890ae18d"} Mar 16 16:30:31 crc kubenswrapper[5120]: E0316 16:30:31.313229 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Mar 16 16:30:31 crc kubenswrapper[5120]: E0316 16:30:31.313348 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e1bf7ad2-f215-405b-84de-9429f90855f8-config-data podName:e1bf7ad2-f215-405b-84de-9429f90855f8 nodeName:}" failed. No retries permitted until 2026-03-16 16:30:31.81332541 +0000 UTC m=+3533.967257067 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/e1bf7ad2-f215-405b-84de-9429f90855f8-config-data") pod "rabbitmq-cell1-server-0" (UID: "e1bf7ad2-f215-405b-84de-9429f90855f8") : configmap "rabbitmq-cell1-config-data" not found Mar 16 16:30:31 crc kubenswrapper[5120]: I0316 16:30:31.314906 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-wwpqn"] Mar 16 16:30:31 crc kubenswrapper[5120]: I0316 16:30:31.324562 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 16:30:31 crc kubenswrapper[5120]: I0316 16:30:31.333934 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podUID="5f1a58aa-0b5e-424c-84d6-c2cdc92ce046" containerName="openstack-network-exporter" containerID="cri-o://f82ed5c1d8af30522468a8d3607c34361c11bc4c9e5e0026dad9b12824677da4" gracePeriod=300 Mar 16 16:30:31 crc kubenswrapper[5120]: I0316 16:30:31.334860 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-d8bvp"] Mar 16 16:30:31 crc kubenswrapper[5120]: I0316 16:30:31.336193 5120 generic.go:358] "Generic (PLEG): container finished" podID="c88c8ef0-5871-4507-9dcd-4c5312779d29" containerID="cca86ca4bb425959b3293666ee823af2b2b49331f3e113b4ce0a7a9cf086803e" exitCode=2 Mar 16 16:30:31 crc kubenswrapper[5120]: I0316 16:30:31.336226 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"c88c8ef0-5871-4507-9dcd-4c5312779d29","Type":"ContainerDied","Data":"cca86ca4bb425959b3293666ee823af2b2b49331f3e113b4ce0a7a9cf086803e"} Mar 16 16:30:31 crc kubenswrapper[5120]: I0316 16:30:31.344107 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-1"] Mar 16 16:30:31 crc kubenswrapper[5120]: I0316 16:30:31.360586 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-wwpqn"] Mar 16 16:30:31 crc kubenswrapper[5120]: I0316 16:30:31.375558 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-d8bvp"] Mar 16 16:30:31 crc kubenswrapper[5120]: I0316 16:30:31.399827 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-bkr9j"] Mar 16 16:30:31 crc kubenswrapper[5120]: E0316 16:30:31.419227 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Mar 16 16:30:31 crc kubenswrapper[5120]: E0316 16:30:31.419283 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dbe6904f-2249-41c3-bb8a-a1b5817094c5-config-data podName:dbe6904f-2249-41c3-bb8a-a1b5817094c5 nodeName:}" failed. No retries permitted until 2026-03-16 16:30:31.919268974 +0000 UTC m=+3534.073200631 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/dbe6904f-2249-41c3-bb8a-a1b5817094c5-config-data") pod "rabbitmq-cell1-server-1" (UID: "dbe6904f-2249-41c3-bb8a-a1b5817094c5") : configmap "rabbitmq-cell1-config-data" not found Mar 16 16:30:31 crc kubenswrapper[5120]: I0316 16:30:31.453600 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-bkr9j"] Mar 16 16:30:31 crc kubenswrapper[5120]: I0316 16:30:31.471300 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-gs5vn"] Mar 16 16:30:31 crc kubenswrapper[5120]: I0316 16:30:31.483992 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-gs5vn"] Mar 16 16:30:31 crc kubenswrapper[5120]: I0316 16:30:31.503360 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-8f87-account-create-update-kgjw8" Mar 16 16:30:31 crc kubenswrapper[5120]: I0316 16:30:31.505688 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-821f-account-create-update-8ph6s" Mar 16 16:30:31 crc kubenswrapper[5120]: I0316 16:30:31.528694 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-n9ftq"] Mar 16 16:30:31 crc kubenswrapper[5120]: I0316 16:30:31.548229 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-n9ftq"] Mar 16 16:30:31 crc kubenswrapper[5120]: I0316 16:30:31.553641 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podUID="5f1a58aa-0b5e-424c-84d6-c2cdc92ce046" containerName="ovsdbserver-nb" containerID="cri-o://05bdfd82f38eeac19c8042eec194130613916269cca59075e4255e557d7fd1ed" gracePeriod=300 Mar 16 16:30:31 crc kubenswrapper[5120]: I0316 16:30:31.567396 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-bnzrd"] Mar 16 16:30:31 crc kubenswrapper[5120]: I0316 16:30:31.583959 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-bnzrd"] Mar 16 16:30:31 crc kubenswrapper[5120]: E0316 16:30:31.638853 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/neutron-httpd-config: secret "neutron-httpd-config" not found Mar 16 16:30:31 crc kubenswrapper[5120]: E0316 16:30:31.638931 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/325f32e1-5461-4d71-a30c-dee2528d6fb3-httpd-config podName:325f32e1-5461-4d71-a30c-dee2528d6fb3 nodeName:}" failed. No retries permitted until 2026-03-16 16:30:32.638915689 +0000 UTC m=+3534.792847346 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "httpd-config" (UniqueName: "kubernetes.io/secret/325f32e1-5461-4d71-a30c-dee2528d6fb3-httpd-config") pod "neutron-59d4fdd9db-tttbf" (UID: "325f32e1-5461-4d71-a30c-dee2528d6fb3") : secret "neutron-httpd-config" not found Mar 16 16:30:31 crc kubenswrapper[5120]: E0316 16:30:31.639034 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Mar 16 16:30:31 crc kubenswrapper[5120]: E0316 16:30:31.639110 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b190faa2-d49d-424d-90bc-3e6e34d1b362-config-data podName:b190faa2-d49d-424d-90bc-3e6e34d1b362 nodeName:}" failed. No retries permitted until 2026-03-16 16:30:32.639089454 +0000 UTC m=+3534.793021111 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/b190faa2-d49d-424d-90bc-3e6e34d1b362-config-data") pod "rabbitmq-cell1-server-2" (UID: "b190faa2-d49d-424d-90bc-3e6e34d1b362") : configmap "rabbitmq-cell1-config-data" not found Mar 16 16:30:31 crc kubenswrapper[5120]: E0316 16:30:31.639190 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/neutron-config: secret "neutron-config" not found Mar 16 16:30:31 crc kubenswrapper[5120]: E0316 16:30:31.639219 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/325f32e1-5461-4d71-a30c-dee2528d6fb3-config podName:325f32e1-5461-4d71-a30c-dee2528d6fb3 nodeName:}" failed. No retries permitted until 2026-03-16 16:30:32.639211327 +0000 UTC m=+3534.793143084 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "config" (UniqueName: "kubernetes.io/secret/325f32e1-5461-4d71-a30c-dee2528d6fb3-config") pod "neutron-59d4fdd9db-tttbf" (UID: "325f32e1-5461-4d71-a30c-dee2528d6fb3") : secret "neutron-config" not found Mar 16 16:30:31 crc kubenswrapper[5120]: I0316 16:30:31.666771 5120 kubelet_pods.go:1019] "Unable to retrieve pull secret, the image pull may not succeed." pod="openstack-kuttl-tests/barbican-keystone-listener-566c6b7f4b-gjml4" secret="" err="secret \"barbican-barbican-dockercfg-bkg7z\" not found" Mar 16 16:30:31 crc kubenswrapper[5120]: I0316 16:30:31.675404 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-pv6tf"] Mar 16 16:30:31 crc kubenswrapper[5120]: I0316 16:30:31.727820 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-pv6tf"] Mar 16 16:30:31 crc kubenswrapper[5120]: E0316 16:30:31.741587 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/barbican-config-data: secret "barbican-config-data" not found Mar 16 16:30:31 crc kubenswrapper[5120]: E0316 16:30:31.741647 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9cb535e7-55cc-4b9d-911c-58f8ed50bee6-config-data podName:9cb535e7-55cc-4b9d-911c-58f8ed50bee6 nodeName:}" failed. No retries permitted until 2026-03-16 16:30:32.241632576 +0000 UTC m=+3534.395564233 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/secret/9cb535e7-55cc-4b9d-911c-58f8ed50bee6-config-data") pod "barbican-keystone-listener-566c6b7f4b-gjml4" (UID: "9cb535e7-55cc-4b9d-911c-58f8ed50bee6") : secret "barbican-config-data" not found Mar 16 16:30:31 crc kubenswrapper[5120]: E0316 16:30:31.742654 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/barbican-keystone-listener-config-data: secret "barbican-keystone-listener-config-data" not found Mar 16 16:30:31 crc kubenswrapper[5120]: E0316 16:30:31.742741 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9cb535e7-55cc-4b9d-911c-58f8ed50bee6-config-data-custom podName:9cb535e7-55cc-4b9d-911c-58f8ed50bee6 nodeName:}" failed. No retries permitted until 2026-03-16 16:30:32.242720136 +0000 UTC m=+3534.396651793 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "config-data-custom" (UniqueName: "kubernetes.io/secret/9cb535e7-55cc-4b9d-911c-58f8ed50bee6-config-data-custom") pod "barbican-keystone-listener-566c6b7f4b-gjml4" (UID: "9cb535e7-55cc-4b9d-911c-58f8ed50bee6") : secret "barbican-keystone-listener-config-data" not found Mar 16 16:30:31 crc kubenswrapper[5120]: I0316 16:30:31.807939 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:30:31 crc kubenswrapper[5120]: I0316 16:30:31.808206 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="ed1bcd44-0ed6-4cb4-a735-798e033c8b08" containerName="glance-log" containerID="cri-o://a52c969d2547d89e70885b898beb45d313c34fcdb7d0051f70ffe99c7f945c9e" gracePeriod=30 Mar 16 16:30:31 crc kubenswrapper[5120]: I0316 16:30:31.808664 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="ed1bcd44-0ed6-4cb4-a735-798e033c8b08" containerName="glance-httpd" containerID="cri-o://5b81c1575b30f2252e88dd113e244df2352346edfc84f0f6cc943293511aa028" gracePeriod=30 Mar 16 16:30:31 crc kubenswrapper[5120]: I0316 16:30:31.843358 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-cv9jf"] Mar 16 16:30:31 crc kubenswrapper[5120]: E0316 16:30:31.849148 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Mar 16 16:30:31 crc kubenswrapper[5120]: E0316 16:30:31.849221 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e1bf7ad2-f215-405b-84de-9429f90855f8-config-data podName:e1bf7ad2-f215-405b-84de-9429f90855f8 nodeName:}" failed. No retries permitted until 2026-03-16 16:30:32.849205064 +0000 UTC m=+3535.003136721 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/e1bf7ad2-f215-405b-84de-9429f90855f8-config-data") pod "rabbitmq-cell1-server-0" (UID: "e1bf7ad2-f215-405b-84de-9429f90855f8") : configmap "rabbitmq-cell1-config-data" not found Mar 16 16:30:31 crc kubenswrapper[5120]: I0316 16:30:31.872787 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-cv9jf"] Mar 16 16:30:31 crc kubenswrapper[5120]: I0316 16:30:31.914823 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:30:31 crc kubenswrapper[5120]: I0316 16:30:31.915223 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="cecaa51b-004f-4941-99e2-23272d052fa7" containerName="glance-log" containerID="cri-o://cbdd5e27d1311400d077d840e745e422ae1a420aba181e769227f63c08296f03" gracePeriod=30 Mar 16 16:30:31 crc kubenswrapper[5120]: I0316 16:30:31.915833 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="cecaa51b-004f-4941-99e2-23272d052fa7" containerName="glance-httpd" containerID="cri-o://4ad4e9e2f3e47e3af53e941d93e136f76505815b23580a998ab6986a501c972d" gracePeriod=30 Mar 16 16:30:31 crc kubenswrapper[5120]: E0316 16:30:31.964670 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Mar 16 16:30:31 crc kubenswrapper[5120]: E0316 16:30:31.965093 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dbe6904f-2249-41c3-bb8a-a1b5817094c5-config-data podName:dbe6904f-2249-41c3-bb8a-a1b5817094c5 nodeName:}" failed. No retries permitted until 2026-03-16 16:30:32.965049571 +0000 UTC m=+3535.118981228 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/dbe6904f-2249-41c3-bb8a-a1b5817094c5-config-data") pod "rabbitmq-cell1-server-1" (UID: "dbe6904f-2249-41c3-bb8a-a1b5817094c5") : configmap "rabbitmq-cell1-config-data" not found Mar 16 16:30:31 crc kubenswrapper[5120]: I0316 16:30:31.966122 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 16:30:31 crc kubenswrapper[5120]: I0316 16:30:31.967908 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="e4c4e515-3d7d-4436-ab79-c7c6e2bf2867" containerName="object-server" containerID="cri-o://f73f6b34fb962826c023fdaeb3f6939041fc2fd39eecb456ee6e023a1e3589cb" gracePeriod=30 Mar 16 16:30:31 crc kubenswrapper[5120]: I0316 16:30:31.968055 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="e4c4e515-3d7d-4436-ab79-c7c6e2bf2867" containerName="swift-recon-cron" containerID="cri-o://f15bf1aad527f5c095b7bff2dca1db767738973c6277e2a0f00f4724cc41a6d1" gracePeriod=30 Mar 16 16:30:31 crc kubenswrapper[5120]: I0316 16:30:31.968107 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="e4c4e515-3d7d-4436-ab79-c7c6e2bf2867" containerName="rsync" containerID="cri-o://3f2d886d7f02bd132c23ebdd596245f0c4fcdcb60de0f942e9db05d9a554cc06" gracePeriod=30 Mar 16 16:30:31 crc kubenswrapper[5120]: I0316 16:30:31.968150 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="e4c4e515-3d7d-4436-ab79-c7c6e2bf2867" containerName="object-expirer" containerID="cri-o://3316e7f6d49dbecddd206e93a21152d473303f16fa69403030e6aaaeaa38adab" gracePeriod=30 Mar 16 16:30:31 crc kubenswrapper[5120]: I0316 16:30:31.968194 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="e4c4e515-3d7d-4436-ab79-c7c6e2bf2867" containerName="object-updater" containerID="cri-o://0ae219285be2774fd999a00f3eb7b796c400b3bb54670c492ef1a7cd633c9f6b" gracePeriod=30 Mar 16 16:30:31 crc kubenswrapper[5120]: I0316 16:30:31.968245 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="e4c4e515-3d7d-4436-ab79-c7c6e2bf2867" containerName="object-auditor" containerID="cri-o://ee574a05fc70f725e484eed1c78245bd008ee2dca8d8e5747b40feeb8ea97135" gracePeriod=30 Mar 16 16:30:31 crc kubenswrapper[5120]: I0316 16:30:31.968295 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="e4c4e515-3d7d-4436-ab79-c7c6e2bf2867" containerName="object-replicator" containerID="cri-o://11236707832e2120fc41d5104a2f9b4d27803bed6d28a687cb24b58154784ab0" gracePeriod=30 Mar 16 16:30:31 crc kubenswrapper[5120]: I0316 16:30:31.968367 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="e4c4e515-3d7d-4436-ab79-c7c6e2bf2867" containerName="account-auditor" containerID="cri-o://70f91690ca6860782cfe602660752293b957c3e5d757ab6406b3818a603f33f2" gracePeriod=30 Mar 16 16:30:31 crc kubenswrapper[5120]: I0316 16:30:31.968365 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="e4c4e515-3d7d-4436-ab79-c7c6e2bf2867" containerName="container-server" containerID="cri-o://8e57dd33a2aa825284690808124c1ecbc5dca938121e8420b3ff5077ff9704bf" gracePeriod=30 Mar 16 16:30:31 crc kubenswrapper[5120]: I0316 16:30:31.968422 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="e4c4e515-3d7d-4436-ab79-c7c6e2bf2867" containerName="account-reaper" containerID="cri-o://9ec444876101ad416b611d2885a35edb13ab6f3780cd291d8b4f774fbd06ff20" gracePeriod=30 Mar 16 16:30:31 crc kubenswrapper[5120]: I0316 16:30:31.968477 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="e4c4e515-3d7d-4436-ab79-c7c6e2bf2867" containerName="container-auditor" containerID="cri-o://5ffea8961d29d9fab0235d9e49ecd3f2bb869266e115ed97f9b97a47c83f280d" gracePeriod=30 Mar 16 16:30:31 crc kubenswrapper[5120]: I0316 16:30:31.968511 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="e4c4e515-3d7d-4436-ab79-c7c6e2bf2867" containerName="container-replicator" containerID="cri-o://96b84c6ebe1b0747f05480dc24a682f7a93699950490b8252cf8ed9dd2bd8e77" gracePeriod=30 Mar 16 16:30:31 crc kubenswrapper[5120]: I0316 16:30:31.968534 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="e4c4e515-3d7d-4436-ab79-c7c6e2bf2867" containerName="container-updater" containerID="cri-o://c68aab4be854a460023e8b8f93e43ace66b0a1f2cc56a0afabb12d8d59203372" gracePeriod=30 Mar 16 16:30:31 crc kubenswrapper[5120]: I0316 16:30:31.968563 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="e4c4e515-3d7d-4436-ab79-c7c6e2bf2867" containerName="account-replicator" containerID="cri-o://751ce949d1961a8983b58c560348689c5c84954f76641475fcfa8b6fd3ea7968" gracePeriod=30 Mar 16 16:30:31 crc kubenswrapper[5120]: I0316 16:30:31.967867 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="e4c4e515-3d7d-4436-ab79-c7c6e2bf2867" containerName="account-server" containerID="cri-o://ba7e067e325914eabba7eb247b617294a269cd7bb06ce5d8a84762cbe0e8e442" gracePeriod=30 Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.022518 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.023102 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="594e9c2b-c42a-4671-9b95-3ca9cc0834da" containerName="cinder-scheduler" containerID="cri-o://55d8301ab1f2252931343ebe194e56bf0d2e6005a7f49de190ee54a4c190f30b" gracePeriod=30 Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.023616 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="594e9c2b-c42a-4671-9b95-3ca9cc0834da" containerName="probe" containerID="cri-o://4738f855f2af9511199dcb63a9d508dbfb5ef2b859371cbd01a2dbeee556de78" gracePeriod=30 Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.053451 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-59d4fdd9db-tttbf"] Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.053751 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-59d4fdd9db-tttbf" podUID="325f32e1-5461-4d71-a30c-dee2528d6fb3" containerName="neutron-api" containerID="cri-o://db3e2580ea95177e9d6490933f7a1f793687c66e415fc971c115bd499c92ab81" gracePeriod=30 Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.054243 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-59d4fdd9db-tttbf" podUID="325f32e1-5461-4d71-a30c-dee2528d6fb3" containerName="neutron-httpd" containerID="cri-o://1595763c4adbd5710d1143db484ee9b4d612579aceba19faf0f4e5d27d44445d" gracePeriod=30 Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.073222 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-8f6f-account-create-update-5zwr9"] Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.083635 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.084054 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="abc96fef-3a85-4438-848c-0910513810e0" containerName="ceilometer-central-agent" containerID="cri-o://b6c94b2508b6c7f40ba9027d248c30720e7dd6666027c56bb02ab67277fa255b" gracePeriod=30 Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.085432 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="abc96fef-3a85-4438-848c-0910513810e0" containerName="proxy-httpd" containerID="cri-o://1d97978ec3d113eff242fa345a29d5e1e5b1f9ef9dfe1117c35a88143a78bae6" gracePeriod=30 Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.085641 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="abc96fef-3a85-4438-848c-0910513810e0" containerName="ceilometer-notification-agent" containerID="cri-o://3b26184bcf959244a04517160ad0256a4a63d93d49413616a3117c699a7df75b" gracePeriod=30 Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.085705 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="abc96fef-3a85-4438-848c-0910513810e0" containerName="sg-core" containerID="cri-o://04c42674c25fc500c502ef1e1e999054ad79756a4118b220ebdd2bad3f3baaf6" gracePeriod=30 Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.105358 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-8f6f-account-create-update-5zwr9"] Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.121868 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.122137 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="f1ddadf2-8a01-49e5-a099-b192f793a36d" containerName="cinder-api-log" containerID="cri-o://20a146198364dd3bab31073def314ae19daec57fd0b0b0ae40a65386d19d3bd0" gracePeriod=30 Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.122634 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="f1ddadf2-8a01-49e5-a099-b192f793a36d" containerName="cinder-api" containerID="cri-o://e96e5c721f9e1b4574a1448d5ba3da2db4cdf652e79ca865a8776a290e9a0553" gracePeriod=30 Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.141830 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-db-create-cqrlj"] Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.153776 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-db-create-cqrlj"] Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.157334 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_6ed22727-fd32-47c8-ae36-f80dddf5c720/ovsdbserver-sb/0.log" Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.157415 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.192738 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-db-create-jklt9"] Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.245970 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-db-create-jklt9"] Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.265994 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.303558 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovndbcluster-sb-etc-ovn\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") pod \"6ed22727-fd32-47c8-ae36-f80dddf5c720\" (UID: \"6ed22727-fd32-47c8-ae36-f80dddf5c720\") " Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.307251 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ed22727-fd32-47c8-ae36-f80dddf5c720-config" (OuterVolumeSpecName: "config") pod "6ed22727-fd32-47c8-ae36-f80dddf5c720" (UID: "6ed22727-fd32-47c8-ae36-f80dddf5c720"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.309215 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6ed22727-fd32-47c8-ae36-f80dddf5c720-config\") pod \"6ed22727-fd32-47c8-ae36-f80dddf5c720\" (UID: \"6ed22727-fd32-47c8-ae36-f80dddf5c720\") " Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.309363 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/6ed22727-fd32-47c8-ae36-f80dddf5c720-metrics-certs-tls-certs\") pod \"6ed22727-fd32-47c8-ae36-f80dddf5c720\" (UID: \"6ed22727-fd32-47c8-ae36-f80dddf5c720\") " Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.309592 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6ed22727-fd32-47c8-ae36-f80dddf5c720-combined-ca-bundle\") pod \"6ed22727-fd32-47c8-ae36-f80dddf5c720\" (UID: \"6ed22727-fd32-47c8-ae36-f80dddf5c720\") " Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.309882 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/6ed22727-fd32-47c8-ae36-f80dddf5c720-ovsdb-rundir\") pod \"6ed22727-fd32-47c8-ae36-f80dddf5c720\" (UID: \"6ed22727-fd32-47c8-ae36-f80dddf5c720\") " Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.309936 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/6ed22727-fd32-47c8-ae36-f80dddf5c720-scripts\") pod \"6ed22727-fd32-47c8-ae36-f80dddf5c720\" (UID: \"6ed22727-fd32-47c8-ae36-f80dddf5c720\") " Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.310129 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pvh6h\" (UniqueName: \"kubernetes.io/projected/6ed22727-fd32-47c8-ae36-f80dddf5c720-kube-api-access-pvh6h\") pod \"6ed22727-fd32-47c8-ae36-f80dddf5c720\" (UID: \"6ed22727-fd32-47c8-ae36-f80dddf5c720\") " Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.310273 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/6ed22727-fd32-47c8-ae36-f80dddf5c720-ovsdbserver-sb-tls-certs\") pod \"6ed22727-fd32-47c8-ae36-f80dddf5c720\" (UID: \"6ed22727-fd32-47c8-ae36-f80dddf5c720\") " Mar 16 16:30:32 crc kubenswrapper[5120]: E0316 16:30:32.322156 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/barbican-config-data: secret "barbican-config-data" not found Mar 16 16:30:32 crc kubenswrapper[5120]: E0316 16:30:32.322457 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9cb535e7-55cc-4b9d-911c-58f8ed50bee6-config-data podName:9cb535e7-55cc-4b9d-911c-58f8ed50bee6 nodeName:}" failed. No retries permitted until 2026-03-16 16:30:33.322234536 +0000 UTC m=+3535.476166193 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/secret/9cb535e7-55cc-4b9d-911c-58f8ed50bee6-config-data") pod "barbican-keystone-listener-566c6b7f4b-gjml4" (UID: "9cb535e7-55cc-4b9d-911c-58f8ed50bee6") : secret "barbican-config-data" not found Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.326451 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ed22727-fd32-47c8-ae36-f80dddf5c720-ovsdb-rundir" (OuterVolumeSpecName: "ovsdb-rundir") pod "6ed22727-fd32-47c8-ae36-f80dddf5c720" (UID: "6ed22727-fd32-47c8-ae36-f80dddf5c720"). InnerVolumeSpecName "ovsdb-rundir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.331951 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ed22727-fd32-47c8-ae36-f80dddf5c720-scripts" (OuterVolumeSpecName: "scripts") pod "6ed22727-fd32-47c8-ae36-f80dddf5c720" (UID: "6ed22727-fd32-47c8-ae36-f80dddf5c720"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:30:32 crc kubenswrapper[5120]: E0316 16:30:32.332639 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/barbican-keystone-listener-config-data: secret "barbican-keystone-listener-config-data" not found Mar 16 16:30:32 crc kubenswrapper[5120]: E0316 16:30:32.332730 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9cb535e7-55cc-4b9d-911c-58f8ed50bee6-config-data-custom podName:9cb535e7-55cc-4b9d-911c-58f8ed50bee6 nodeName:}" failed. No retries permitted until 2026-03-16 16:30:33.332696065 +0000 UTC m=+3535.486627722 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "config-data-custom" (UniqueName: "kubernetes.io/secret/9cb535e7-55cc-4b9d-911c-58f8ed50bee6-config-data-custom") pod "barbican-keystone-listener-566c6b7f4b-gjml4" (UID: "9cb535e7-55cc-4b9d-911c-58f8ed50bee6") : secret "barbican-keystone-listener-config-data" not found Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.332819 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6ed22727-fd32-47c8-ae36-f80dddf5c720-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.373258 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage19-crc" (OuterVolumeSpecName: "ovndbcluster-sb-etc-ovn") pod "6ed22727-fd32-47c8-ae36-f80dddf5c720" (UID: "6ed22727-fd32-47c8-ae36-f80dddf5c720"). InnerVolumeSpecName "local-storage19-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.373350 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-1"] Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.410205 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ed22727-fd32-47c8-ae36-f80dddf5c720-kube-api-access-pvh6h" (OuterVolumeSpecName: "kube-api-access-pvh6h") pod "6ed22727-fd32-47c8-ae36-f80dddf5c720" (UID: "6ed22727-fd32-47c8-ae36-f80dddf5c720"). InnerVolumeSpecName "kube-api-access-pvh6h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.436540 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage19-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") on node \"crc\" " Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.436580 5120 reconciler_common.go:299] "Volume detached for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/6ed22727-fd32-47c8-ae36-f80dddf5c720-ovsdb-rundir\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.436593 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/6ed22727-fd32-47c8-ae36-f80dddf5c720-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.436605 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pvh6h\" (UniqueName: \"kubernetes.io/projected/6ed22727-fd32-47c8-ae36-f80dddf5c720-kube-api-access-pvh6h\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.454698 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-2"] Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.512802 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-jb5ks"] Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.572778 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/rabbitmq-server-1" podUID="a8e524d7-0cb0-4bec-9948-70d463625805" containerName="rabbitmq" containerID="cri-o://0ffcec825f56c969e28525148d56b9ac9132173717921abf5a8e79272b9d5b39" gracePeriod=604800 Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.574375 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/rabbitmq-server-0" podUID="4df637ef-8f2d-4eb1-8a51-327814195dbf" containerName="rabbitmq" containerID="cri-o://c7da8c850bcfaa6b77764f70b226aa97d27d819990e54a6faad91619f81e9005" gracePeriod=604800 Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.585819 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ed22727-fd32-47c8-ae36-f80dddf5c720" containerName="ovsdbserver-sb" Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.585862 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ed22727-fd32-47c8-ae36-f80dddf5c720" containerName="ovsdbserver-sb" Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.585902 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ed22727-fd32-47c8-ae36-f80dddf5c720" containerName="openstack-network-exporter" Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.585909 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ed22727-fd32-47c8-ae36-f80dddf5c720" containerName="openstack-network-exporter" Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.586092 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="6ed22727-fd32-47c8-ae36-f80dddf5c720" containerName="ovsdbserver-sb" Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.586120 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="6ed22727-fd32-47c8-ae36-f80dddf5c720" containerName="openstack-network-exporter" Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.588491 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/rabbitmq-server-2" podUID="9ab03e09-ed0f-4675-82c7-e04f1c3937ce" containerName="rabbitmq" containerID="cri-o://c37ed1da6f16fabdc1a6782a38cfbfcec0a7cc7a1aebfee00bd24988fc28935f" gracePeriod=604800 Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.607029 5120 generic.go:358] "Generic (PLEG): container finished" podID="cecaa51b-004f-4941-99e2-23272d052fa7" containerID="cbdd5e27d1311400d077d840e745e422ae1a420aba181e769227f63c08296f03" exitCode=143 Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.620165 5120 generic.go:358] "Generic (PLEG): container finished" podID="ed1bcd44-0ed6-4cb4-a735-798e033c8b08" containerID="a52c969d2547d89e70885b898beb45d313c34fcdb7d0051f70ffe99c7f945c9e" exitCode=143 Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.667465 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"cecaa51b-004f-4941-99e2-23272d052fa7","Type":"ContainerDied","Data":"cbdd5e27d1311400d077d840e745e422ae1a420aba181e769227f63c08296f03"} Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.669299 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-jb5ks" Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.671409 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage19-crc" (UniqueName: "kubernetes.io/local-volume/local-storage19-crc") on node "crc" Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.712792 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/09b5d645-c91e-4bff-8b73-0651cf8397b6-config\") pod \"dnsmasq-dnsmasq-79dcd846c5-jb5ks\" (UID: \"09b5d645-c91e-4bff-8b73-0651cf8397b6\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-jb5ks" Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.712932 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbjbz\" (UniqueName: \"kubernetes.io/projected/09b5d645-c91e-4bff-8b73-0651cf8397b6-kube-api-access-tbjbz\") pod \"dnsmasq-dnsmasq-79dcd846c5-jb5ks\" (UID: \"09b5d645-c91e-4bff-8b73-0651cf8397b6\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-jb5ks" Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.712976 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/09b5d645-c91e-4bff-8b73-0651cf8397b6-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-79dcd846c5-jb5ks\" (UID: \"09b5d645-c91e-4bff-8b73-0651cf8397b6\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-jb5ks" Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.713270 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage19-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:32 crc kubenswrapper[5120]: E0316 16:30:32.714715 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Mar 16 16:30:32 crc kubenswrapper[5120]: E0316 16:30:32.714794 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b190faa2-d49d-424d-90bc-3e6e34d1b362-config-data podName:b190faa2-d49d-424d-90bc-3e6e34d1b362 nodeName:}" failed. No retries permitted until 2026-03-16 16:30:34.714778545 +0000 UTC m=+3536.868710192 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/b190faa2-d49d-424d-90bc-3e6e34d1b362-config-data") pod "rabbitmq-cell1-server-2" (UID: "b190faa2-d49d-424d-90bc-3e6e34d1b362") : configmap "rabbitmq-cell1-config-data" not found Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.718773 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_6ed22727-fd32-47c8-ae36-f80dddf5c720/ovsdbserver-sb/0.log" Mar 16 16:30:32 crc kubenswrapper[5120]: E0316 16:30:32.719859 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/neutron-httpd-config: secret "neutron-httpd-config" not found Mar 16 16:30:32 crc kubenswrapper[5120]: E0316 16:30:32.722333 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/325f32e1-5461-4d71-a30c-dee2528d6fb3-httpd-config podName:325f32e1-5461-4d71-a30c-dee2528d6fb3 nodeName:}" failed. No retries permitted until 2026-03-16 16:30:34.722309546 +0000 UTC m=+3536.876241203 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "httpd-config" (UniqueName: "kubernetes.io/secret/325f32e1-5461-4d71-a30c-dee2528d6fb3-httpd-config") pod "neutron-59d4fdd9db-tttbf" (UID: "325f32e1-5461-4d71-a30c-dee2528d6fb3") : secret "neutron-httpd-config" not found Mar 16 16:30:32 crc kubenswrapper[5120]: E0316 16:30:32.720189 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/neutron-config: secret "neutron-config" not found Mar 16 16:30:32 crc kubenswrapper[5120]: E0316 16:30:32.722490 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/325f32e1-5461-4d71-a30c-dee2528d6fb3-config podName:325f32e1-5461-4d71-a30c-dee2528d6fb3 nodeName:}" failed. No retries permitted until 2026-03-16 16:30:34.722480431 +0000 UTC m=+3536.876412088 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "config" (UniqueName: "kubernetes.io/secret/325f32e1-5461-4d71-a30c-dee2528d6fb3-config") pod "neutron-59d4fdd9db-tttbf" (UID: "325f32e1-5461-4d71-a30c-dee2528d6fb3") : secret "neutron-config" not found Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.722519 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.725960 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_5f1a58aa-0b5e-424c-84d6-c2cdc92ce046/ovsdbserver-nb/0.log" Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.726071 5120 generic.go:358] "Generic (PLEG): container finished" podID="5f1a58aa-0b5e-424c-84d6-c2cdc92ce046" containerID="f82ed5c1d8af30522468a8d3607c34361c11bc4c9e5e0026dad9b12824677da4" exitCode=2 Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.726134 5120 generic.go:358] "Generic (PLEG): container finished" podID="5f1a58aa-0b5e-424c-84d6-c2cdc92ce046" containerID="05bdfd82f38eeac19c8042eec194130613916269cca59075e4255e557d7fd1ed" exitCode=143 Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.728396 5120 generic.go:358] "Generic (PLEG): container finished" podID="325f32e1-5461-4d71-a30c-dee2528d6fb3" containerID="1595763c4adbd5710d1143db484ee9b4d612579aceba19faf0f4e5d27d44445d" exitCode=0 Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.729992 5120 generic.go:358] "Generic (PLEG): container finished" podID="5456036b-4cdb-4d1a-9b60-d0effc293043" containerID="b0827a3b77f1f888901fc0c03daaa68e9b8ae643846cc4a639bc12495d1f5f47" exitCode=137 Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.810052 5120 generic.go:358] "Generic (PLEG): container finished" podID="abc96fef-3a85-4438-848c-0910513810e0" containerID="04c42674c25fc500c502ef1e1e999054ad79756a4118b220ebdd2bad3f3baaf6" exitCode=2 Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.815317 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/09b5d645-c91e-4bff-8b73-0651cf8397b6-config\") pod \"dnsmasq-dnsmasq-79dcd846c5-jb5ks\" (UID: \"09b5d645-c91e-4bff-8b73-0651cf8397b6\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-jb5ks" Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.815445 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tbjbz\" (UniqueName: \"kubernetes.io/projected/09b5d645-c91e-4bff-8b73-0651cf8397b6-kube-api-access-tbjbz\") pod \"dnsmasq-dnsmasq-79dcd846c5-jb5ks\" (UID: \"09b5d645-c91e-4bff-8b73-0651cf8397b6\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-jb5ks" Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.815496 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/09b5d645-c91e-4bff-8b73-0651cf8397b6-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-79dcd846c5-jb5ks\" (UID: \"09b5d645-c91e-4bff-8b73-0651cf8397b6\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-jb5ks" Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.816898 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/09b5d645-c91e-4bff-8b73-0651cf8397b6-config\") pod \"dnsmasq-dnsmasq-79dcd846c5-jb5ks\" (UID: \"09b5d645-c91e-4bff-8b73-0651cf8397b6\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-jb5ks" Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.825195 5120 kubelet_pods.go:1019] "Unable to retrieve pull secret, the image pull may not succeed." pod="openstack-kuttl-tests/root-account-create-update-gmjzc" secret="" err="secret \"galera-openstack-dockercfg-nj44g\" not found" Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.830260 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/09b5d645-c91e-4bff-8b73-0651cf8397b6-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-79dcd846c5-jb5ks\" (UID: \"09b5d645-c91e-4bff-8b73-0651cf8397b6\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-jb5ks" Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.836708 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ed22727-fd32-47c8-ae36-f80dddf5c720-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "6ed22727-fd32-47c8-ae36-f80dddf5c720" (UID: "6ed22727-fd32-47c8-ae36-f80dddf5c720"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.837438 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbjbz\" (UniqueName: \"kubernetes.io/projected/09b5d645-c91e-4bff-8b73-0651cf8397b6-kube-api-access-tbjbz\") pod \"dnsmasq-dnsmasq-79dcd846c5-jb5ks\" (UID: \"09b5d645-c91e-4bff-8b73-0651cf8397b6\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-jb5ks" Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.886138 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ed22727-fd32-47c8-ae36-f80dddf5c720-ovsdbserver-sb-tls-certs" (OuterVolumeSpecName: "ovsdbserver-sb-tls-certs") pod "6ed22727-fd32-47c8-ae36-f80dddf5c720" (UID: "6ed22727-fd32-47c8-ae36-f80dddf5c720"). InnerVolumeSpecName "ovsdbserver-sb-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.886244 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ed22727-fd32-47c8-ae36-f80dddf5c720-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "6ed22727-fd32-47c8-ae36-f80dddf5c720" (UID: "6ed22727-fd32-47c8-ae36-f80dddf5c720"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.907938 5120 generic.go:358] "Generic (PLEG): container finished" podID="e4c4e515-3d7d-4436-ab79-c7c6e2bf2867" containerID="3316e7f6d49dbecddd206e93a21152d473303f16fa69403030e6aaaeaa38adab" exitCode=0 Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.907968 5120 generic.go:358] "Generic (PLEG): container finished" podID="e4c4e515-3d7d-4436-ab79-c7c6e2bf2867" containerID="0ae219285be2774fd999a00f3eb7b796c400b3bb54670c492ef1a7cd633c9f6b" exitCode=0 Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.907975 5120 generic.go:358] "Generic (PLEG): container finished" podID="e4c4e515-3d7d-4436-ab79-c7c6e2bf2867" containerID="ee574a05fc70f725e484eed1c78245bd008ee2dca8d8e5747b40feeb8ea97135" exitCode=0 Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.907981 5120 generic.go:358] "Generic (PLEG): container finished" podID="e4c4e515-3d7d-4436-ab79-c7c6e2bf2867" containerID="11236707832e2120fc41d5104a2f9b4d27803bed6d28a687cb24b58154784ab0" exitCode=0 Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.907987 5120 generic.go:358] "Generic (PLEG): container finished" podID="e4c4e515-3d7d-4436-ab79-c7c6e2bf2867" containerID="c68aab4be854a460023e8b8f93e43ace66b0a1f2cc56a0afabb12d8d59203372" exitCode=0 Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.907992 5120 generic.go:358] "Generic (PLEG): container finished" podID="e4c4e515-3d7d-4436-ab79-c7c6e2bf2867" containerID="5ffea8961d29d9fab0235d9e49ecd3f2bb869266e115ed97f9b97a47c83f280d" exitCode=0 Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.907997 5120 generic.go:358] "Generic (PLEG): container finished" podID="e4c4e515-3d7d-4436-ab79-c7c6e2bf2867" containerID="96b84c6ebe1b0747f05480dc24a682f7a93699950490b8252cf8ed9dd2bd8e77" exitCode=0 Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.908003 5120 generic.go:358] "Generic (PLEG): container finished" podID="e4c4e515-3d7d-4436-ab79-c7c6e2bf2867" containerID="9ec444876101ad416b611d2885a35edb13ab6f3780cd291d8b4f774fbd06ff20" exitCode=0 Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.908008 5120 generic.go:358] "Generic (PLEG): container finished" podID="e4c4e515-3d7d-4436-ab79-c7c6e2bf2867" containerID="70f91690ca6860782cfe602660752293b957c3e5d757ab6406b3818a603f33f2" exitCode=0 Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.908014 5120 generic.go:358] "Generic (PLEG): container finished" podID="e4c4e515-3d7d-4436-ab79-c7c6e2bf2867" containerID="751ce949d1961a8983b58c560348689c5c84954f76641475fcfa8b6fd3ea7968" exitCode=0 Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.908713 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f9d9e0a-3afc-4b45-90ff-1e1a3f4635c6" path="/var/lib/kubelet/pods/1f9d9e0a-3afc-4b45-90ff-1e1a3f4635c6/volumes" Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.914196 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="41065d35-2cc8-4b66-9767-3fdb3e5e5691" path="/var/lib/kubelet/pods/41065d35-2cc8-4b66-9767-3fdb3e5e5691/volumes" Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.914786 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4f828b4b-4ee0-44ac-b3ec-d1dfa524bbf8" path="/var/lib/kubelet/pods/4f828b4b-4ee0-44ac-b3ec-d1dfa524bbf8/volumes" Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.915313 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="539c0d5c-8a81-47ff-92fc-1c0c09ad57c0" path="/var/lib/kubelet/pods/539c0d5c-8a81-47ff-92fc-1c0c09ad57c0/volumes" Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.918271 5120 reconciler_common.go:299] "Volume detached for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/6ed22727-fd32-47c8-ae36-f80dddf5c720-ovsdbserver-sb-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.918298 5120 reconciler_common.go:299] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/6ed22727-fd32-47c8-ae36-f80dddf5c720-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.918307 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6ed22727-fd32-47c8-ae36-f80dddf5c720-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:32 crc kubenswrapper[5120]: E0316 16:30:32.918362 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Mar 16 16:30:32 crc kubenswrapper[5120]: E0316 16:30:32.918445 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9943d2d4-e26d-4c91-942e-a6d788ac8c7e-operator-scripts podName:9943d2d4-e26d-4c91-942e-a6d788ac8c7e nodeName:}" failed. No retries permitted until 2026-03-16 16:30:33.418396771 +0000 UTC m=+3535.572328428 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/9943d2d4-e26d-4c91-942e-a6d788ac8c7e-operator-scripts") pod "root-account-create-update-gmjzc" (UID: "9943d2d4-e26d-4c91-942e-a6d788ac8c7e") : configmap "openstack-scripts" not found Mar 16 16:30:32 crc kubenswrapper[5120]: E0316 16:30:32.918540 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Mar 16 16:30:32 crc kubenswrapper[5120]: E0316 16:30:32.918698 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e1bf7ad2-f215-405b-84de-9429f90855f8-config-data podName:e1bf7ad2-f215-405b-84de-9429f90855f8 nodeName:}" failed. No retries permitted until 2026-03-16 16:30:34.918681929 +0000 UTC m=+3537.072613586 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/e1bf7ad2-f215-405b-84de-9429f90855f8-config-data") pod "rabbitmq-cell1-server-0" (UID: "e1bf7ad2-f215-405b-84de-9429f90855f8") : configmap "rabbitmq-cell1-config-data" not found Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.928980 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ade2b67-3714-4800-904d-4843bc597e1c" path="/var/lib/kubelet/pods/5ade2b67-3714-4800-904d-4843bc597e1c/volumes" Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.929613 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="63c5f1f5-8359-43a8-a043-9867582182d1" path="/var/lib/kubelet/pods/63c5f1f5-8359-43a8-a043-9867582182d1/volumes" Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.930266 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="823a8cf3-9912-4721-9fe3-e8b8b8b9f03b" path="/var/lib/kubelet/pods/823a8cf3-9912-4721-9fe3-e8b8b8b9f03b/volumes" Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.931442 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="86acd223-38d0-4b3e-b13b-e24a5ae829da" path="/var/lib/kubelet/pods/86acd223-38d0-4b3e-b13b-e24a5ae829da/volumes" Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.932080 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="88e6fbd8-42f7-446d-a9cb-0fc5d8a9c6bb" path="/var/lib/kubelet/pods/88e6fbd8-42f7-446d-a9cb-0fc5d8a9c6bb/volumes" Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.932962 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="906875be-ea9c-49a4-8162-46aa9d27ec42" path="/var/lib/kubelet/pods/906875be-ea9c-49a4-8162-46aa9d27ec42/volumes" Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.934161 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf1e3f49-2df5-4275-9df5-574067402cc7" path="/var/lib/kubelet/pods/cf1e3f49-2df5-4275-9df5-574067402cc7/volumes" Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.935012 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ee9a1dc2-769e-4d3f-a1e0-f1b78c45403a" path="/var/lib/kubelet/pods/ee9a1dc2-769e-4d3f-a1e0-f1b78c45403a/volumes" Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.935696 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f692ad11-c485-436b-8624-ae7769b07b98" path="/var/lib/kubelet/pods/f692ad11-c485-436b-8624-ae7769b07b98/volumes" Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.936337 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f793dd8c-d824-4c26-9f17-848b016fe52b" path="/var/lib/kubelet/pods/f793dd8c-d824-4c26-9f17-848b016fe52b/volumes" Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.937643 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"ed1bcd44-0ed6-4cb4-a735-798e033c8b08","Type":"ContainerDied","Data":"a52c969d2547d89e70885b898beb45d313c34fcdb7d0051f70ffe99c7f945c9e"} Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.937678 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"6ed22727-fd32-47c8-ae36-f80dddf5c720","Type":"ContainerDied","Data":"825b29cb1bfa0d48a1722298bd8c938a48828d200b785377b7bf0ad2a6cc4efc"} Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.937700 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-jb5ks"] Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.937719 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"5f1a58aa-0b5e-424c-84d6-c2cdc92ce046","Type":"ContainerDied","Data":"f82ed5c1d8af30522468a8d3607c34361c11bc4c9e5e0026dad9b12824677da4"} Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.937733 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-76845cddf4-zlw8q"] Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.937746 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-a215-account-create-update-jdntm"] Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.937791 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"5f1a58aa-0b5e-424c-84d6-c2cdc92ce046","Type":"ContainerDied","Data":"05bdfd82f38eeac19c8042eec194130613916269cca59075e4255e557d7fd1ed"} Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.937804 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-59d4fdd9db-tttbf" event={"ID":"325f32e1-5461-4d71-a30c-dee2528d6fb3","Type":"ContainerDied","Data":"1595763c4adbd5710d1143db484ee9b4d612579aceba19faf0f4e5d27d44445d"} Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.937817 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-a215-account-create-update-jdntm"] Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.937842 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-gmjzc"] Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.937857 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-gmjzc" event={"ID":"9943d2d4-e26d-4c91-942e-a6d788ac8c7e","Type":"ContainerStarted","Data":"c0bc7e279a64621a39a3a9389a1126717ff380d3894cb0c8f3ebb89da4074567"} Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.937868 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-gmjzc" event={"ID":"9943d2d4-e26d-4c91-942e-a6d788ac8c7e","Type":"ContainerStarted","Data":"d8ae9645becd145f126d558c25de4f82a475db1588732e87af907e505e4203a6"} Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.937884 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"abc96fef-3a85-4438-848c-0910513810e0","Type":"ContainerDied","Data":"04c42674c25fc500c502ef1e1e999054ad79756a4118b220ebdd2bad3f3baaf6"} Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.937899 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"e4c4e515-3d7d-4436-ab79-c7c6e2bf2867","Type":"ContainerDied","Data":"3316e7f6d49dbecddd206e93a21152d473303f16fa69403030e6aaaeaa38adab"} Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.937912 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.937925 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"e4c4e515-3d7d-4436-ab79-c7c6e2bf2867","Type":"ContainerDied","Data":"0ae219285be2774fd999a00f3eb7b796c400b3bb54670c492ef1a7cd633c9f6b"} Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.937937 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-db-create-94bn8"] Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.937947 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-db-create-94bn8"] Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.937959 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-1"] Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.937971 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"e4c4e515-3d7d-4436-ab79-c7c6e2bf2867","Type":"ContainerDied","Data":"ee574a05fc70f725e484eed1c78245bd008ee2dca8d8e5747b40feeb8ea97135"} Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.937979 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"e4c4e515-3d7d-4436-ab79-c7c6e2bf2867","Type":"ContainerDied","Data":"11236707832e2120fc41d5104a2f9b4d27803bed6d28a687cb24b58154784ab0"} Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.937988 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"e4c4e515-3d7d-4436-ab79-c7c6e2bf2867","Type":"ContainerDied","Data":"c68aab4be854a460023e8b8f93e43ace66b0a1f2cc56a0afabb12d8d59203372"} Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.937996 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"e4c4e515-3d7d-4436-ab79-c7c6e2bf2867","Type":"ContainerDied","Data":"5ffea8961d29d9fab0235d9e49ecd3f2bb869266e115ed97f9b97a47c83f280d"} Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.938005 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"e4c4e515-3d7d-4436-ab79-c7c6e2bf2867","Type":"ContainerDied","Data":"96b84c6ebe1b0747f05480dc24a682f7a93699950490b8252cf8ed9dd2bd8e77"} Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.938015 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"e4c4e515-3d7d-4436-ab79-c7c6e2bf2867","Type":"ContainerDied","Data":"9ec444876101ad416b611d2885a35edb13ab6f3780cd291d8b4f774fbd06ff20"} Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.938025 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"e4c4e515-3d7d-4436-ab79-c7c6e2bf2867","Type":"ContainerDied","Data":"70f91690ca6860782cfe602660752293b957c3e5d757ab6406b3818a603f33f2"} Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.938035 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"e4c4e515-3d7d-4436-ab79-c7c6e2bf2867","Type":"ContainerDied","Data":"751ce949d1961a8983b58c560348689c5c84954f76641475fcfa8b6fd3ea7968"} Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.938442 5120 scope.go:117] "RemoveContainer" containerID="7034d7226b348e254095effb353147b9fc1991d1469e66b85c58a896fe62472f" Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.938637 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-76845cddf4-zlw8q" podUID="850510ce-da60-453a-88a8-475bc65bb0df" containerName="placement-log" containerID="cri-o://07ebfddf2a30ff0b748ede18680624ba9dd698382919d1abdbdea7d864ee51b8" gracePeriod=30 Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.938943 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="b4e407e7-1e20-455e-b1e5-d87ba8555a7a" containerName="nova-api-log" containerID="cri-o://2eb2cfc44a2ab4da95ff91fbb74bb09793c7659b0ff281328c6d6c9bcd535517" gracePeriod=30 Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.939043 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="b4e407e7-1e20-455e-b1e5-d87ba8555a7a" containerName="nova-api-api" containerID="cri-o://73d36e223ac6cb16ad06c2743a3cc3ff1584c29e05d26a747bc98696b66104be" gracePeriod=30 Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.939083 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-76845cddf4-zlw8q" podUID="850510ce-da60-453a-88a8-475bc65bb0df" containerName="placement-api" containerID="cri-o://0c87f1e5ac81b96f6ef9514dc786d98dfeb76235a80ea1a9c515704f7bb369ab" gracePeriod=30 Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.961061 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.970832 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-2"] Mar 16 16:30:32 crc kubenswrapper[5120]: E0316 16:30:32.979122 5120 kuberuntime_manager.go:1358] "Unhandled Error" err=< Mar 16 16:30:32 crc kubenswrapper[5120]: container &Container{Name:mariadb-account-create-update,Image:quay.io/podified-antelope-centos9/openstack-mariadb@sha256:4caef2b55e01b9a7ee88a22bc69db1893521a91d95c7ad4c8e593f14f17a5f95,Command:[/bin/sh -c #!/bin/bash Mar 16 16:30:32 crc kubenswrapper[5120]: Mar 16 16:30:32 crc kubenswrapper[5120]: MYSQL_REMOTE_HOST="" source /var/lib/operator-scripts/mysql_root_auth.sh Mar 16 16:30:32 crc kubenswrapper[5120]: Mar 16 16:30:32 crc kubenswrapper[5120]: export DatabasePassword=${DatabasePassword:?"Please specify a DatabasePassword variable."} Mar 16 16:30:32 crc kubenswrapper[5120]: Mar 16 16:30:32 crc kubenswrapper[5120]: MYSQL_CMD="mysql -h -u root -P 3306" Mar 16 16:30:32 crc kubenswrapper[5120]: Mar 16 16:30:32 crc kubenswrapper[5120]: if [ -n "barbican" ]; then Mar 16 16:30:32 crc kubenswrapper[5120]: GRANT_DATABASE="barbican" Mar 16 16:30:32 crc kubenswrapper[5120]: else Mar 16 16:30:32 crc kubenswrapper[5120]: GRANT_DATABASE="*" Mar 16 16:30:32 crc kubenswrapper[5120]: fi Mar 16 16:30:32 crc kubenswrapper[5120]: Mar 16 16:30:32 crc kubenswrapper[5120]: # going for maximum compatibility here: Mar 16 16:30:32 crc kubenswrapper[5120]: # 1. MySQL 8 no longer allows implicit create user when GRANT is used Mar 16 16:30:32 crc kubenswrapper[5120]: # 2. MariaDB has "CREATE OR REPLACE", but MySQL does not Mar 16 16:30:32 crc kubenswrapper[5120]: # 3. create user with CREATE but then do all password and TLS with ALTER to Mar 16 16:30:32 crc kubenswrapper[5120]: # support updates Mar 16 16:30:32 crc kubenswrapper[5120]: Mar 16 16:30:32 crc kubenswrapper[5120]: $MYSQL_CMD < logger="UnhandledError" Mar 16 16:30:32 crc kubenswrapper[5120]: E0316 16:30:32.979533 5120 kuberuntime_manager.go:1358] "Unhandled Error" err=< Mar 16 16:30:32 crc kubenswrapper[5120]: container &Container{Name:mariadb-account-create-update,Image:quay.io/podified-antelope-centos9/openstack-mariadb@sha256:4caef2b55e01b9a7ee88a22bc69db1893521a91d95c7ad4c8e593f14f17a5f95,Command:[/bin/sh -c #!/bin/bash Mar 16 16:30:32 crc kubenswrapper[5120]: Mar 16 16:30:32 crc kubenswrapper[5120]: MYSQL_REMOTE_HOST="" source /var/lib/operator-scripts/mysql_root_auth.sh Mar 16 16:30:32 crc kubenswrapper[5120]: Mar 16 16:30:32 crc kubenswrapper[5120]: export DatabasePassword=${DatabasePassword:?"Please specify a DatabasePassword variable."} Mar 16 16:30:32 crc kubenswrapper[5120]: Mar 16 16:30:32 crc kubenswrapper[5120]: MYSQL_CMD="mysql -h -u root -P 3306" Mar 16 16:30:32 crc kubenswrapper[5120]: Mar 16 16:30:32 crc kubenswrapper[5120]: if [ -n "nova_cell1" ]; then Mar 16 16:30:32 crc kubenswrapper[5120]: GRANT_DATABASE="nova_cell1" Mar 16 16:30:32 crc kubenswrapper[5120]: else Mar 16 16:30:32 crc kubenswrapper[5120]: GRANT_DATABASE="*" Mar 16 16:30:32 crc kubenswrapper[5120]: fi Mar 16 16:30:32 crc kubenswrapper[5120]: Mar 16 16:30:32 crc kubenswrapper[5120]: # going for maximum compatibility here: Mar 16 16:30:32 crc kubenswrapper[5120]: # 1. MySQL 8 no longer allows implicit create user when GRANT is used Mar 16 16:30:32 crc kubenswrapper[5120]: # 2. MariaDB has "CREATE OR REPLACE", but MySQL does not Mar 16 16:30:32 crc kubenswrapper[5120]: # 3. create user with CREATE but then do all password and TLS with ALTER to Mar 16 16:30:32 crc kubenswrapper[5120]: # support updates Mar 16 16:30:32 crc kubenswrapper[5120]: Mar 16 16:30:32 crc kubenswrapper[5120]: $MYSQL_CMD < logger="UnhandledError" Mar 16 16:30:32 crc kubenswrapper[5120]: E0316 16:30:32.980278 5120 kuberuntime_manager.go:1358] "Unhandled Error" err=< Mar 16 16:30:32 crc kubenswrapper[5120]: container &Container{Name:mariadb-account-create-update,Image:quay.io/podified-antelope-centos9/openstack-mariadb@sha256:4caef2b55e01b9a7ee88a22bc69db1893521a91d95c7ad4c8e593f14f17a5f95,Command:[/bin/sh -c #!/bin/bash Mar 16 16:30:32 crc kubenswrapper[5120]: Mar 16 16:30:32 crc kubenswrapper[5120]: MYSQL_REMOTE_HOST="" source /var/lib/operator-scripts/mysql_root_auth.sh Mar 16 16:30:32 crc kubenswrapper[5120]: Mar 16 16:30:32 crc kubenswrapper[5120]: export DatabasePassword=${DatabasePassword:?"Please specify a DatabasePassword variable."} Mar 16 16:30:32 crc kubenswrapper[5120]: Mar 16 16:30:32 crc kubenswrapper[5120]: MYSQL_CMD="mysql -h -u root -P 3306" Mar 16 16:30:32 crc kubenswrapper[5120]: Mar 16 16:30:32 crc kubenswrapper[5120]: if [ -n "neutron" ]; then Mar 16 16:30:32 crc kubenswrapper[5120]: GRANT_DATABASE="neutron" Mar 16 16:30:32 crc kubenswrapper[5120]: else Mar 16 16:30:32 crc kubenswrapper[5120]: GRANT_DATABASE="*" Mar 16 16:30:32 crc kubenswrapper[5120]: fi Mar 16 16:30:32 crc kubenswrapper[5120]: Mar 16 16:30:32 crc kubenswrapper[5120]: # going for maximum compatibility here: Mar 16 16:30:32 crc kubenswrapper[5120]: # 1. MySQL 8 no longer allows implicit create user when GRANT is used Mar 16 16:30:32 crc kubenswrapper[5120]: # 2. MariaDB has "CREATE OR REPLACE", but MySQL does not Mar 16 16:30:32 crc kubenswrapper[5120]: # 3. create user with CREATE but then do all password and TLS with ALTER to Mar 16 16:30:32 crc kubenswrapper[5120]: # support updates Mar 16 16:30:32 crc kubenswrapper[5120]: Mar 16 16:30:32 crc kubenswrapper[5120]: $MYSQL_CMD < logger="UnhandledError" Mar 16 16:30:32 crc kubenswrapper[5120]: E0316 16:30:32.980321 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"mariadb-account-create-update\" with CreateContainerConfigError: \"secret \\\"barbican-db-secret\\\" not found\"" pod="openstack-kuttl-tests/barbican-8f87-account-create-update-kgjw8" podUID="b62b0167-9419-454f-a1c2-78d1354baeb2" Mar 16 16:30:32 crc kubenswrapper[5120]: E0316 16:30:32.981200 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"mariadb-account-create-update\" with CreateContainerConfigError: \"secret \\\"nova-cell1-db-secret\\\" not found\"" pod="openstack-kuttl-tests/nova-cell1-5b46-account-create-update-llf4v" podUID="29ef1c2d-283b-421f-8631-ada83f6ea799" Mar 16 16:30:32 crc kubenswrapper[5120]: E0316 16:30:32.982928 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"mariadb-account-create-update\" with CreateContainerConfigError: \"secret \\\"neutron-db-secret\\\" not found\"" pod="openstack-kuttl-tests/neutron-500e-account-create-update-wd7jx" podUID="7d4aa5b5-78e4-464e-bee0-18da0561de5d" Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.987802 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-8f87-account-create-update-kgjw8"] Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.995863 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-proxy-75575cf5bd-xrtzd"] Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.996134 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-proxy-75575cf5bd-xrtzd" podUID="7b46f8b0-c3f2-44ec-88e2-8d65566ae937" containerName="proxy-httpd" containerID="cri-o://a6a93148c012a86a4db9d9a856d284743e23fe3682ebcefe62653b9a2e3d9836" gracePeriod=30 Mar 16 16:30:32 crc kubenswrapper[5120]: I0316 16:30:32.996264 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-proxy-75575cf5bd-xrtzd" podUID="7b46f8b0-c3f2-44ec-88e2-8d65566ae937" containerName="proxy-server" containerID="cri-o://acb24d66779cebdb73830f94ca9a36930b6848cc20bd4028e1a60ec492a4a2b5" gracePeriod=30 Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.002216 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-db-create-2vc9f"] Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.019769 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-76cb6cf57b-j7csd"] Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.020118 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-76cb6cf57b-j7csd" podUID="3253648c-08a0-4d00-87e2-121fe9240d23" containerName="barbican-api-log" containerID="cri-o://d015c3c14c7d9b3c3a75819d57a9b899aaf097f05482262725fe5621d88fcfeb" gracePeriod=30 Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.020280 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-76cb6cf57b-j7csd" podUID="3253648c-08a0-4d00-87e2-121fe9240d23" containerName="barbican-api" containerID="cri-o://228e632eee85749f4708dd46a1233dd311e9c155a72567279f23819c8f559297" gracePeriod=30 Mar 16 16:30:33 crc kubenswrapper[5120]: E0316 16:30:33.021924 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Mar 16 16:30:33 crc kubenswrapper[5120]: E0316 16:30:33.021995 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dbe6904f-2249-41c3-bb8a-a1b5817094c5-config-data podName:dbe6904f-2249-41c3-bb8a-a1b5817094c5 nodeName:}" failed. No retries permitted until 2026-03-16 16:30:35.021980391 +0000 UTC m=+3537.175912048 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/dbe6904f-2249-41c3-bb8a-a1b5817094c5-config-data") pod "rabbitmq-cell1-server-1" (UID: "dbe6904f-2249-41c3-bb8a-a1b5817094c5") : configmap "rabbitmq-cell1-config-data" not found Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.031506 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-db-create-2vc9f"] Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.037481 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-500e-account-create-update-wd7jx"] Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.062844 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-8649c995c9-lzq96"] Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.063186 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-8649c995c9-lzq96" podUID="bbd47432-e63f-4ba0-8daa-edfb3d2b0af9" containerName="barbican-worker-log" containerID="cri-o://ef3f1cf32bdce0edaa87a00b39179f41bb817d5cf035cdf5ced8fda3505edb15" gracePeriod=30 Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.063822 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-8649c995c9-lzq96" podUID="bbd47432-e63f-4ba0-8daa-edfb3d2b0af9" containerName="barbican-worker" containerID="cri-o://a8d0450cf9b56a1f1a591c22074f8f02a21e970d858afe7341ab0e647e4581ed" gracePeriod=30 Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.078218 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-566c6b7f4b-gjml4"] Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.078476 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-566c6b7f4b-gjml4" podUID="9cb535e7-55cc-4b9d-911c-58f8ed50bee6" containerName="barbican-keystone-listener-log" containerID="cri-o://4739157a6d4b51c37814000e2ecdb4f3562bd3a81b3434bad9b0d3c2052c6f8e" gracePeriod=30 Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.079102 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-566c6b7f4b-gjml4" podUID="9cb535e7-55cc-4b9d-911c-58f8ed50bee6" containerName="barbican-keystone-listener" containerID="cri-o://e21b312f4394d0cf417797387371f78390ddb2171778c91b768199fbff017acc" gracePeriod=30 Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.093559 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.094238 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="9300c420-c173-4f86-ac91-7ada78b25041" containerName="nova-metadata-log" containerID="cri-o://f59a6e760a98bbe533ef2a4ac3593867a1408a7b9aea9b121e3a1c5077272558" gracePeriod=30 Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.094832 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="9300c420-c173-4f86-ac91-7ada78b25041" containerName="nova-metadata-metadata" containerID="cri-o://fef968df7f37fd8586399f475ea9ec49a678f4f4b47fe252028804652842452c" gracePeriod=30 Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.104484 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.105261 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/kube-state-metrics-0" podUID="56e8d6c4-0222-4e80-bffd-8fb3726e1b75" containerName="kube-state-metrics" containerID="cri-o://65ce1a9fbe046895b733fc4b967f9bf21a74d0cd97349758a275a768087dbc2d" gracePeriod=30 Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.115916 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-aceb-account-create-update-h7jsn"] Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.133964 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.134188 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podUID="2c78e334-9857-4302-af64-dc9b0647ab41" containerName="nova-cell1-novncproxy-novncproxy" containerID="cri-o://1a869b8a440dafdf19113e6a1f3a4d154f04788c22a46805222bf6dc1a4404aa" gracePeriod=30 Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.134351 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-aceb-account-create-update-h7jsn" Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.136889 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-db-secret\"" Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.137931 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-aceb-account-create-update-h7jsn"] Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.156117 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podUID="2c78e334-9857-4302-af64-dc9b0647ab41" containerName="nova-cell1-novncproxy-novncproxy" probeResult="failure" output="Get \"https://10.217.0.39:6080/vnc_lite.html\": read tcp 10.217.0.2:38460->10.217.0.39:6080: read: connection reset by peer" Mar 16 16:30:33 crc kubenswrapper[5120]: E0316 16:30:33.167882 5120 kuberuntime_manager.go:1358] "Unhandled Error" err=< Mar 16 16:30:33 crc kubenswrapper[5120]: container &Container{Name:mariadb-account-create-update,Image:quay.io/podified-antelope-centos9/openstack-mariadb@sha256:4caef2b55e01b9a7ee88a22bc69db1893521a91d95c7ad4c8e593f14f17a5f95,Command:[/bin/sh -c #!/bin/bash Mar 16 16:30:33 crc kubenswrapper[5120]: Mar 16 16:30:33 crc kubenswrapper[5120]: MYSQL_REMOTE_HOST="" source /var/lib/operator-scripts/mysql_root_auth.sh Mar 16 16:30:33 crc kubenswrapper[5120]: Mar 16 16:30:33 crc kubenswrapper[5120]: export DatabasePassword=${DatabasePassword:?"Please specify a DatabasePassword variable."} Mar 16 16:30:33 crc kubenswrapper[5120]: Mar 16 16:30:33 crc kubenswrapper[5120]: MYSQL_CMD="mysql -h -u root -P 3306" Mar 16 16:30:33 crc kubenswrapper[5120]: Mar 16 16:30:33 crc kubenswrapper[5120]: if [ -n "placement" ]; then Mar 16 16:30:33 crc kubenswrapper[5120]: GRANT_DATABASE="placement" Mar 16 16:30:33 crc kubenswrapper[5120]: else Mar 16 16:30:33 crc kubenswrapper[5120]: GRANT_DATABASE="*" Mar 16 16:30:33 crc kubenswrapper[5120]: fi Mar 16 16:30:33 crc kubenswrapper[5120]: Mar 16 16:30:33 crc kubenswrapper[5120]: # going for maximum compatibility here: Mar 16 16:30:33 crc kubenswrapper[5120]: # 1. MySQL 8 no longer allows implicit create user when GRANT is used Mar 16 16:30:33 crc kubenswrapper[5120]: # 2. MariaDB has "CREATE OR REPLACE", but MySQL does not Mar 16 16:30:33 crc kubenswrapper[5120]: # 3. create user with CREATE but then do all password and TLS with ALTER to Mar 16 16:30:33 crc kubenswrapper[5120]: # support updates Mar 16 16:30:33 crc kubenswrapper[5120]: Mar 16 16:30:33 crc kubenswrapper[5120]: $MYSQL_CMD < logger="UnhandledError" Mar 16 16:30:33 crc kubenswrapper[5120]: E0316 16:30:33.169545 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"mariadb-account-create-update\" with CreateContainerConfigError: \"secret \\\"placement-db-secret\\\" not found\"" pod="openstack-kuttl-tests/placement-821f-account-create-update-8ph6s" podUID="0c04a9e3-0a3b-4895-8703-bb958c3000fd" Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.173826 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-xpjdr"] Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.183823 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-5b46-account-create-update-llf4v"] Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.208128 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-xpjdr"] Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.230056 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-db-create-n7fcp"] Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.231667 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/24ef8cf9-6eb2-44c4-8845-7db782f6a862-operator-scripts\") pod \"keystone-aceb-account-create-update-h7jsn\" (UID: \"24ef8cf9-6eb2-44c4-8845-7db782f6a862\") " pod="openstack-kuttl-tests/keystone-aceb-account-create-update-h7jsn" Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.232472 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxj6m\" (UniqueName: \"kubernetes.io/projected/24ef8cf9-6eb2-44c4-8845-7db782f6a862-kube-api-access-fxj6m\") pod \"keystone-aceb-account-create-update-h7jsn\" (UID: \"24ef8cf9-6eb2-44c4-8845-7db782f6a862\") " pod="openstack-kuttl-tests/keystone-aceb-account-create-update-h7jsn" Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.248096 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-821f-account-create-update-8ph6s"] Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.262816 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-db-create-n7fcp"] Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.297845 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-z6jpd"] Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.324813 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-z6jpd"] Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.334474 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fxj6m\" (UniqueName: \"kubernetes.io/projected/24ef8cf9-6eb2-44c4-8845-7db782f6a862-kube-api-access-fxj6m\") pod \"keystone-aceb-account-create-update-h7jsn\" (UID: \"24ef8cf9-6eb2-44c4-8845-7db782f6a862\") " pod="openstack-kuttl-tests/keystone-aceb-account-create-update-h7jsn" Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.334554 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/24ef8cf9-6eb2-44c4-8845-7db782f6a862-operator-scripts\") pod \"keystone-aceb-account-create-update-h7jsn\" (UID: \"24ef8cf9-6eb2-44c4-8845-7db782f6a862\") " pod="openstack-kuttl-tests/keystone-aceb-account-create-update-h7jsn" Mar 16 16:30:33 crc kubenswrapper[5120]: E0316 16:30:33.336996 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/barbican-config-data: secret "barbican-config-data" not found Mar 16 16:30:33 crc kubenswrapper[5120]: E0316 16:30:33.337085 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9cb535e7-55cc-4b9d-911c-58f8ed50bee6-config-data podName:9cb535e7-55cc-4b9d-911c-58f8ed50bee6 nodeName:}" failed. No retries permitted until 2026-03-16 16:30:35.337064819 +0000 UTC m=+3537.490996476 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/secret/9cb535e7-55cc-4b9d-911c-58f8ed50bee6-config-data") pod "barbican-keystone-listener-566c6b7f4b-gjml4" (UID: "9cb535e7-55cc-4b9d-911c-58f8ed50bee6") : secret "barbican-config-data" not found Mar 16 16:30:33 crc kubenswrapper[5120]: E0316 16:30:33.337260 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Mar 16 16:30:33 crc kubenswrapper[5120]: E0316 16:30:33.337287 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/24ef8cf9-6eb2-44c4-8845-7db782f6a862-operator-scripts podName:24ef8cf9-6eb2-44c4-8845-7db782f6a862 nodeName:}" failed. No retries permitted until 2026-03-16 16:30:33.837279676 +0000 UTC m=+3535.991211333 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/24ef8cf9-6eb2-44c4-8845-7db782f6a862-operator-scripts") pod "keystone-aceb-account-create-update-h7jsn" (UID: "24ef8cf9-6eb2-44c4-8845-7db782f6a862") : configmap "openstack-scripts" not found Mar 16 16:30:33 crc kubenswrapper[5120]: E0316 16:30:33.337350 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/barbican-keystone-listener-config-data: secret "barbican-keystone-listener-config-data" not found Mar 16 16:30:33 crc kubenswrapper[5120]: E0316 16:30:33.337384 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9cb535e7-55cc-4b9d-911c-58f8ed50bee6-config-data-custom podName:9cb535e7-55cc-4b9d-911c-58f8ed50bee6 nodeName:}" failed. No retries permitted until 2026-03-16 16:30:35.337374088 +0000 UTC m=+3537.491305745 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "config-data-custom" (UniqueName: "kubernetes.io/secret/9cb535e7-55cc-4b9d-911c-58f8ed50bee6-config-data-custom") pod "barbican-keystone-listener-566c6b7f4b-gjml4" (UID: "9cb535e7-55cc-4b9d-911c-58f8ed50bee6") : secret "barbican-keystone-listener-config-data" not found Mar 16 16:30:33 crc kubenswrapper[5120]: E0316 16:30:33.344984 5120 projected.go:194] Error preparing data for projected volume kube-api-access-fxj6m for pod openstack-kuttl-tests/keystone-aceb-account-create-update-h7jsn: failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 16:30:33 crc kubenswrapper[5120]: E0316 16:30:33.345994 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/24ef8cf9-6eb2-44c4-8845-7db782f6a862-kube-api-access-fxj6m podName:24ef8cf9-6eb2-44c4-8845-7db782f6a862 nodeName:}" failed. No retries permitted until 2026-03-16 16:30:33.845973868 +0000 UTC m=+3535.999905525 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-fxj6m" (UniqueName: "kubernetes.io/projected/24ef8cf9-6eb2-44c4-8845-7db782f6a862-kube-api-access-fxj6m") pod "keystone-aceb-account-create-update-h7jsn" (UID: "24ef8cf9-6eb2-44c4-8845-7db782f6a862") : failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.357710 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-d7e4-account-create-update-7b8tk"] Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.363792 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-jb5ks" Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.372906 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_5f1a58aa-0b5e-424c-84d6-c2cdc92ce046/ovsdbserver-nb/0.log" Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.372883 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/openstack-cell1-galera-2" podUID="fa5682a3-5cb9-4da7-8588-678ba2537e0c" containerName="galera" containerID="cri-o://641f52ce7e26f90ddbe40cbed9d8e229e77faf2ef6ad82710e0ada5e487095d8" gracePeriod=30 Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.372997 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.374640 5120 scope.go:117] "RemoveContainer" containerID="e99e3ae5101bdbc62ad21f612132580274e93c17121c53266efb9314890ae18d" Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.383323 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.408988 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-d7e4-account-create-update-7b8tk"] Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.435479 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovndbcluster-nb-etc-ovn\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"5f1a58aa-0b5e-424c-84d6-c2cdc92ce046\" (UID: \"5f1a58aa-0b5e-424c-84d6-c2cdc92ce046\") " Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.436680 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/5f1a58aa-0b5e-424c-84d6-c2cdc92ce046-ovsdb-rundir\") pod \"5f1a58aa-0b5e-424c-84d6-c2cdc92ce046\" (UID: \"5f1a58aa-0b5e-424c-84d6-c2cdc92ce046\") " Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.438074 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kjbpl\" (UniqueName: \"kubernetes.io/projected/5f1a58aa-0b5e-424c-84d6-c2cdc92ce046-kube-api-access-kjbpl\") pod \"5f1a58aa-0b5e-424c-84d6-c2cdc92ce046\" (UID: \"5f1a58aa-0b5e-424c-84d6-c2cdc92ce046\") " Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.438998 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/5456036b-4cdb-4d1a-9b60-d0effc293043-openstack-config\") pod \"5456036b-4cdb-4d1a-9b60-d0effc293043\" (UID: \"5456036b-4cdb-4d1a-9b60-d0effc293043\") " Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.437733 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f1a58aa-0b5e-424c-84d6-c2cdc92ce046-ovsdb-rundir" (OuterVolumeSpecName: "ovsdb-rundir") pod "5f1a58aa-0b5e-424c-84d6-c2cdc92ce046" (UID: "5f1a58aa-0b5e-424c-84d6-c2cdc92ce046"). InnerVolumeSpecName "ovsdb-rundir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.437893 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-4fxk5"] Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.440058 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5f1a58aa-0b5e-424c-84d6-c2cdc92ce046-combined-ca-bundle\") pod \"5f1a58aa-0b5e-424c-84d6-c2cdc92ce046\" (UID: \"5f1a58aa-0b5e-424c-84d6-c2cdc92ce046\") " Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.440235 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5f1a58aa-0b5e-424c-84d6-c2cdc92ce046-config\") pod \"5f1a58aa-0b5e-424c-84d6-c2cdc92ce046\" (UID: \"5f1a58aa-0b5e-424c-84d6-c2cdc92ce046\") " Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.441778 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f1a58aa-0b5e-424c-84d6-c2cdc92ce046-config" (OuterVolumeSpecName: "config") pod "5f1a58aa-0b5e-424c-84d6-c2cdc92ce046" (UID: "5f1a58aa-0b5e-424c-84d6-c2cdc92ce046"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.441938 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f1a58aa-0b5e-424c-84d6-c2cdc92ce046-scripts" (OuterVolumeSpecName: "scripts") pod "5f1a58aa-0b5e-424c-84d6-c2cdc92ce046" (UID: "5f1a58aa-0b5e-424c-84d6-c2cdc92ce046"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.442058 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/5f1a58aa-0b5e-424c-84d6-c2cdc92ce046-scripts\") pod \"5f1a58aa-0b5e-424c-84d6-c2cdc92ce046\" (UID: \"5f1a58aa-0b5e-424c-84d6-c2cdc92ce046\") " Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.442410 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/5f1a58aa-0b5e-424c-84d6-c2cdc92ce046-metrics-certs-tls-certs\") pod \"5f1a58aa-0b5e-424c-84d6-c2cdc92ce046\" (UID: \"5f1a58aa-0b5e-424c-84d6-c2cdc92ce046\") " Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.443253 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4cgzk\" (UniqueName: \"kubernetes.io/projected/5456036b-4cdb-4d1a-9b60-d0effc293043-kube-api-access-4cgzk\") pod \"5456036b-4cdb-4d1a-9b60-d0effc293043\" (UID: \"5456036b-4cdb-4d1a-9b60-d0effc293043\") " Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.443710 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5456036b-4cdb-4d1a-9b60-d0effc293043-combined-ca-bundle\") pod \"5456036b-4cdb-4d1a-9b60-d0effc293043\" (UID: \"5456036b-4cdb-4d1a-9b60-d0effc293043\") " Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.443884 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/5456036b-4cdb-4d1a-9b60-d0effc293043-openstack-config-secret\") pod \"5456036b-4cdb-4d1a-9b60-d0effc293043\" (UID: \"5456036b-4cdb-4d1a-9b60-d0effc293043\") " Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.444617 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/5f1a58aa-0b5e-424c-84d6-c2cdc92ce046-ovsdbserver-nb-tls-certs\") pod \"5f1a58aa-0b5e-424c-84d6-c2cdc92ce046\" (UID: \"5f1a58aa-0b5e-424c-84d6-c2cdc92ce046\") " Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.446275 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage05-crc" (OuterVolumeSpecName: "ovndbcluster-nb-etc-ovn") pod "5f1a58aa-0b5e-424c-84d6-c2cdc92ce046" (UID: "5f1a58aa-0b5e-424c-84d6-c2cdc92ce046"). InnerVolumeSpecName "local-storage05-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.450259 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5f1a58aa-0b5e-424c-84d6-c2cdc92ce046-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.450457 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/5f1a58aa-0b5e-424c-84d6-c2cdc92ce046-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.450530 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") on node \"crc\" " Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.450597 5120 reconciler_common.go:299] "Volume detached for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/5f1a58aa-0b5e-424c-84d6-c2cdc92ce046-ovsdb-rundir\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.483524 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f1a58aa-0b5e-424c-84d6-c2cdc92ce046-kube-api-access-kjbpl" (OuterVolumeSpecName: "kube-api-access-kjbpl") pod "5f1a58aa-0b5e-424c-84d6-c2cdc92ce046" (UID: "5f1a58aa-0b5e-424c-84d6-c2cdc92ce046"). InnerVolumeSpecName "kube-api-access-kjbpl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.484473 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5456036b-4cdb-4d1a-9b60-d0effc293043-kube-api-access-4cgzk" (OuterVolumeSpecName: "kube-api-access-4cgzk") pod "5456036b-4cdb-4d1a-9b60-d0effc293043" (UID: "5456036b-4cdb-4d1a-9b60-d0effc293043"). InnerVolumeSpecName "kube-api-access-4cgzk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:30:33 crc kubenswrapper[5120]: E0316 16:30:33.489992 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Mar 16 16:30:33 crc kubenswrapper[5120]: E0316 16:30:33.490079 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9943d2d4-e26d-4c91-942e-a6d788ac8c7e-operator-scripts podName:9943d2d4-e26d-4c91-942e-a6d788ac8c7e nodeName:}" failed. No retries permitted until 2026-03-16 16:30:34.490061542 +0000 UTC m=+3536.643993199 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/9943d2d4-e26d-4c91-942e-a6d788ac8c7e-operator-scripts") pod "root-account-create-update-gmjzc" (UID: "9943d2d4-e26d-4c91-942e-a6d788ac8c7e") : configmap "openstack-scripts" not found Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.553224 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage05-crc" (UniqueName: "kubernetes.io/local-volume/local-storage05-crc") on node "crc" Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.563995 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kjbpl\" (UniqueName: \"kubernetes.io/projected/5f1a58aa-0b5e-424c-84d6-c2cdc92ce046-kube-api-access-kjbpl\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.564684 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4cgzk\" (UniqueName: \"kubernetes.io/projected/5456036b-4cdb-4d1a-9b60-d0effc293043-kube-api-access-4cgzk\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.565471 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.598442 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-4fxk5"] Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.611854 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-af27-account-create-update-glkjg"] Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.624632 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-af27-account-create-update-glkjg"] Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.631136 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5456036b-4cdb-4d1a-9b60-d0effc293043-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "5456036b-4cdb-4d1a-9b60-d0effc293043" (UID: "5456036b-4cdb-4d1a-9b60-d0effc293043"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.639551 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-aceb-account-create-update-m55hg"] Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.647455 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-aceb-account-create-update-m55hg"] Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.652536 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f1a58aa-0b5e-424c-84d6-c2cdc92ce046-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "5f1a58aa-0b5e-424c-84d6-c2cdc92ce046" (UID: "5f1a58aa-0b5e-424c-84d6-c2cdc92ce046"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.669015 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5456036b-4cdb-4d1a-9b60-d0effc293043-openstack-config-secret" (OuterVolumeSpecName: "openstack-config-secret") pod "5456036b-4cdb-4d1a-9b60-d0effc293043" (UID: "5456036b-4cdb-4d1a-9b60-d0effc293043"). InnerVolumeSpecName "openstack-config-secret". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.669528 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f1a58aa-0b5e-424c-84d6-c2cdc92ce046-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "5f1a58aa-0b5e-424c-84d6-c2cdc92ce046" (UID: "5f1a58aa-0b5e-424c-84d6-c2cdc92ce046"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.670621 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5f1a58aa-0b5e-424c-84d6-c2cdc92ce046-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.670644 5120 reconciler_common.go:299] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/5f1a58aa-0b5e-424c-84d6-c2cdc92ce046-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.670655 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5456036b-4cdb-4d1a-9b60-d0effc293043-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.670667 5120 reconciler_common.go:299] "Volume detached for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/5456036b-4cdb-4d1a-9b60-d0effc293043-openstack-config-secret\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.683822 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.687790 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5456036b-4cdb-4d1a-9b60-d0effc293043-openstack-config" (OuterVolumeSpecName: "openstack-config") pod "5456036b-4cdb-4d1a-9b60-d0effc293043" (UID: "5456036b-4cdb-4d1a-9b60-d0effc293043"). InnerVolumeSpecName "openstack-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.702992 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-2"] Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.731899 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-1"] Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.742160 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" podUID="e1bf7ad2-f215-405b-84de-9429f90855f8" containerName="rabbitmq" containerID="cri-o://e890194391fce067d02b1a137a5f39d7a59911e519be323ded2d6c7dbe78f932" gracePeriod=604800 Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.762503 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-h8hsk"] Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.774277 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-h8hsk"] Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.774664 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f1a58aa-0b5e-424c-84d6-c2cdc92ce046-ovsdbserver-nb-tls-certs" (OuterVolumeSpecName: "ovsdbserver-nb-tls-certs") pod "5f1a58aa-0b5e-424c-84d6-c2cdc92ce046" (UID: "5f1a58aa-0b5e-424c-84d6-c2cdc92ce046"). InnerVolumeSpecName "ovsdbserver-nb-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.775076 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/rabbitmq-cell1-server-2" podUID="b190faa2-d49d-424d-90bc-3e6e34d1b362" containerName="rabbitmq" containerID="cri-o://1af24cc4ef41d3c7f4136a8089e28219a6259af0444d27c19d5201dc4b1a70e5" gracePeriod=604800 Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.778035 5120 reconciler_common.go:299] "Volume detached for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/5f1a58aa-0b5e-424c-84d6-c2cdc92ce046-ovsdbserver-nb-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.778057 5120 reconciler_common.go:299] "Volume detached for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/5456036b-4cdb-4d1a-9b60-d0effc293043-openstack-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.782421 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/rabbitmq-cell1-server-1" podUID="dbe6904f-2249-41c3-bb8a-a1b5817094c5" containerName="rabbitmq" containerID="cri-o://efa6791ca8f5aaec639eb569281ad36ec0672df0bc56d4887c44877a37c8a1e4" gracePeriod=604800 Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.783566 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.783903 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="7e45bb7a-9982-458f-80b5-60541c2d2daf" containerName="nova-cell0-conductor-conductor" containerID="cri-o://1c7b11899133931bd406f6c19c7e46ecd6ae5021b5ed32c51931ad65ff554972" gracePeriod=30 Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.805522 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-rqjnm"] Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.809131 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-5b46-account-create-update-llf4v"] Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.817552 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-rqjnm"] Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.834409 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-500e-account-create-update-wd7jx"] Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.850653 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-ckqtl"] Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.851119 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.858611 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-ckqtl"] Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.867469 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-42r2f"] Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.883430 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fxj6m\" (UniqueName: \"kubernetes.io/projected/24ef8cf9-6eb2-44c4-8845-7db782f6a862-kube-api-access-fxj6m\") pod \"keystone-aceb-account-create-update-h7jsn\" (UID: \"24ef8cf9-6eb2-44c4-8845-7db782f6a862\") " pod="openstack-kuttl-tests/keystone-aceb-account-create-update-h7jsn" Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.883538 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/24ef8cf9-6eb2-44c4-8845-7db782f6a862-operator-scripts\") pod \"keystone-aceb-account-create-update-h7jsn\" (UID: \"24ef8cf9-6eb2-44c4-8845-7db782f6a862\") " pod="openstack-kuttl-tests/keystone-aceb-account-create-update-h7jsn" Mar 16 16:30:33 crc kubenswrapper[5120]: E0316 16:30:33.883970 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Mar 16 16:30:33 crc kubenswrapper[5120]: E0316 16:30:33.884148 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/24ef8cf9-6eb2-44c4-8845-7db782f6a862-operator-scripts podName:24ef8cf9-6eb2-44c4-8845-7db782f6a862 nodeName:}" failed. No retries permitted until 2026-03-16 16:30:34.884125012 +0000 UTC m=+3537.038056669 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/24ef8cf9-6eb2-44c4-8845-7db782f6a862-operator-scripts") pod "keystone-aceb-account-create-update-h7jsn" (UID: "24ef8cf9-6eb2-44c4-8845-7db782f6a862") : configmap "openstack-scripts" not found Mar 16 16:30:33 crc kubenswrapper[5120]: E0316 16:30:33.886677 5120 projected.go:194] Error preparing data for projected volume kube-api-access-fxj6m for pod openstack-kuttl-tests/keystone-aceb-account-create-update-h7jsn: failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 16:30:33 crc kubenswrapper[5120]: E0316 16:30:33.886726 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/24ef8cf9-6eb2-44c4-8845-7db782f6a862-kube-api-access-fxj6m podName:24ef8cf9-6eb2-44c4-8845-7db782f6a862 nodeName:}" failed. No retries permitted until 2026-03-16 16:30:34.886715691 +0000 UTC m=+3537.040647348 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-fxj6m" (UniqueName: "kubernetes.io/projected/24ef8cf9-6eb2-44c4-8845-7db782f6a862-kube-api-access-fxj6m") pod "keystone-aceb-account-create-update-h7jsn" (UID: "24ef8cf9-6eb2-44c4-8845-7db782f6a862") : failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.890135 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.890338 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="7c3819a8-dcaf-4026-87c2-5f6419c379a9" containerName="nova-cell1-conductor-conductor" containerID="cri-o://b48efa78dedc3f4e6339fe4bb5d889d3c5e126ba2b9c6bd274d193ebe220d8d9" gracePeriod=30 Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.904819 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-42r2f"] Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.908832 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.909084 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/memcached-0" podUID="9565a662-ca77-4197-8894-6b9633e653fd" containerName="memcached" containerID="cri-o://ceec1936c48e3f6be7fd6579209ab2c0807f3a2ee9058527f618607ccce149d6" gracePeriod=30 Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.935250 5120 generic.go:358] "Generic (PLEG): container finished" podID="850510ce-da60-453a-88a8-475bc65bb0df" containerID="07ebfddf2a30ff0b748ede18680624ba9dd698382919d1abdbdea7d864ee51b8" exitCode=143 Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.935321 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-76845cddf4-zlw8q" event={"ID":"850510ce-da60-453a-88a8-475bc65bb0df","Type":"ContainerDied","Data":"07ebfddf2a30ff0b748ede18680624ba9dd698382919d1abdbdea7d864ee51b8"} Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.953644 5120 generic.go:358] "Generic (PLEG): container finished" podID="abc96fef-3a85-4438-848c-0910513810e0" containerID="1d97978ec3d113eff242fa345a29d5e1e5b1f9ef9dfe1117c35a88143a78bae6" exitCode=0 Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.953926 5120 generic.go:358] "Generic (PLEG): container finished" podID="abc96fef-3a85-4438-848c-0910513810e0" containerID="b6c94b2508b6c7f40ba9027d248c30720e7dd6666027c56bb02ab67277fa255b" exitCode=0 Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.954016 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"abc96fef-3a85-4438-848c-0910513810e0","Type":"ContainerDied","Data":"1d97978ec3d113eff242fa345a29d5e1e5b1f9ef9dfe1117c35a88143a78bae6"} Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.954045 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"abc96fef-3a85-4438-848c-0910513810e0","Type":"ContainerDied","Data":"b6c94b2508b6c7f40ba9027d248c30720e7dd6666027c56bb02ab67277fa255b"} Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.958005 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.958319 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="836f3504-5416-46bf-a225-7b7f977fe82c" containerName="nova-scheduler-scheduler" containerID="cri-o://31eede8ea13e83df778b0cc727f0126cabef5175599f7fcd091680c0e3d991d6" gracePeriod=30 Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.977012 5120 generic.go:358] "Generic (PLEG): container finished" podID="e4c4e515-3d7d-4436-ab79-c7c6e2bf2867" containerID="3f2d886d7f02bd132c23ebdd596245f0c4fcdcb60de0f942e9db05d9a554cc06" exitCode=0 Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.977042 5120 generic.go:358] "Generic (PLEG): container finished" podID="e4c4e515-3d7d-4436-ab79-c7c6e2bf2867" containerID="f73f6b34fb962826c023fdaeb3f6939041fc2fd39eecb456ee6e023a1e3589cb" exitCode=0 Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.977052 5120 generic.go:358] "Generic (PLEG): container finished" podID="e4c4e515-3d7d-4436-ab79-c7c6e2bf2867" containerID="8e57dd33a2aa825284690808124c1ecbc5dca938121e8420b3ff5077ff9704bf" exitCode=0 Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.977058 5120 generic.go:358] "Generic (PLEG): container finished" podID="e4c4e515-3d7d-4436-ab79-c7c6e2bf2867" containerID="ba7e067e325914eabba7eb247b617294a269cd7bb06ce5d8a84762cbe0e8e442" exitCode=0 Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.977121 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"e4c4e515-3d7d-4436-ab79-c7c6e2bf2867","Type":"ContainerDied","Data":"3f2d886d7f02bd132c23ebdd596245f0c4fcdcb60de0f942e9db05d9a554cc06"} Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.977146 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"e4c4e515-3d7d-4436-ab79-c7c6e2bf2867","Type":"ContainerDied","Data":"f73f6b34fb962826c023fdaeb3f6939041fc2fd39eecb456ee6e023a1e3589cb"} Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.977157 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"e4c4e515-3d7d-4436-ab79-c7c6e2bf2867","Type":"ContainerDied","Data":"8e57dd33a2aa825284690808124c1ecbc5dca938121e8420b3ff5077ff9704bf"} Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.977165 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"e4c4e515-3d7d-4436-ab79-c7c6e2bf2867","Type":"ContainerDied","Data":"ba7e067e325914eabba7eb247b617294a269cd7bb06ce5d8a84762cbe0e8e442"} Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.980934 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-aceb-account-create-update-h7jsn"] Mar 16 16:30:33 crc kubenswrapper[5120]: E0316 16:30:33.981982 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-fxj6m operator-scripts], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openstack-kuttl-tests/keystone-aceb-account-create-update-h7jsn" podUID="24ef8cf9-6eb2-44c4-8845-7db782f6a862" Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.985407 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dx7sz\" (UniqueName: \"kubernetes.io/projected/56e8d6c4-0222-4e80-bffd-8fb3726e1b75-kube-api-access-dx7sz\") pod \"56e8d6c4-0222-4e80-bffd-8fb3726e1b75\" (UID: \"56e8d6c4-0222-4e80-bffd-8fb3726e1b75\") " Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.985445 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/56e8d6c4-0222-4e80-bffd-8fb3726e1b75-kube-state-metrics-tls-config\") pod \"56e8d6c4-0222-4e80-bffd-8fb3726e1b75\" (UID: \"56e8d6c4-0222-4e80-bffd-8fb3726e1b75\") " Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.985842 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/56e8d6c4-0222-4e80-bffd-8fb3726e1b75-combined-ca-bundle\") pod \"56e8d6c4-0222-4e80-bffd-8fb3726e1b75\" (UID: \"56e8d6c4-0222-4e80-bffd-8fb3726e1b75\") " Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.985877 5120 generic.go:358] "Generic (PLEG): container finished" podID="9300c420-c173-4f86-ac91-7ada78b25041" containerID="f59a6e760a98bbe533ef2a4ac3593867a1408a7b9aea9b121e3a1c5077272558" exitCode=143 Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.985923 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/56e8d6c4-0222-4e80-bffd-8fb3726e1b75-kube-state-metrics-tls-certs\") pod \"56e8d6c4-0222-4e80-bffd-8fb3726e1b75\" (UID: \"56e8d6c4-0222-4e80-bffd-8fb3726e1b75\") " Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.985970 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"9300c420-c173-4f86-ac91-7ada78b25041","Type":"ContainerDied","Data":"f59a6e760a98bbe533ef2a4ac3593867a1408a7b9aea9b121e3a1c5077272558"} Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.994182 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-75575cf5bd-xrtzd" Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.996842 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56e8d6c4-0222-4e80-bffd-8fb3726e1b75-kube-api-access-dx7sz" (OuterVolumeSpecName: "kube-api-access-dx7sz") pod "56e8d6c4-0222-4e80-bffd-8fb3726e1b75" (UID: "56e8d6c4-0222-4e80-bffd-8fb3726e1b75"). InnerVolumeSpecName "kube-api-access-dx7sz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.997099 5120 generic.go:358] "Generic (PLEG): container finished" podID="b4e407e7-1e20-455e-b1e5-d87ba8555a7a" containerID="2eb2cfc44a2ab4da95ff91fbb74bb09793c7659b0ff281328c6d6c9bcd535517" exitCode=143 Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.997184 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"b4e407e7-1e20-455e-b1e5-d87ba8555a7a","Type":"ContainerDied","Data":"2eb2cfc44a2ab4da95ff91fbb74bb09793c7659b0ff281328c6d6c9bcd535517"} Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.998921 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-6bf8d6479c-9rjt6"] Mar 16 16:30:33 crc kubenswrapper[5120]: I0316 16:30:33.999157 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/keystone-6bf8d6479c-9rjt6" podUID="0b62aed8-ea87-465a-be46-45ce06fedbb7" containerName="keystone-api" containerID="cri-o://8074d2bb95bae655f4b9972b3d0c5821b80f93bf6f01feae8526fac4e817b9cb" gracePeriod=30 Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.002024 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-8f87-account-create-update-kgjw8" event={"ID":"b62b0167-9419-454f-a1c2-78d1354baeb2","Type":"ContainerStarted","Data":"ef36a80208d53d97bfdb34f21d2498c4ac721efc16229da0823ebb58d8ad1696"} Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.027907 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.047027 5120 generic.go:358] "Generic (PLEG): container finished" podID="3253648c-08a0-4d00-87e2-121fe9240d23" containerID="d015c3c14c7d9b3c3a75819d57a9b899aaf097f05482262725fe5621d88fcfeb" exitCode=143 Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.047194 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-galera-2"] Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.047271 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-76cb6cf57b-j7csd" event={"ID":"3253648c-08a0-4d00-87e2-121fe9240d23","Type":"ContainerDied","Data":"d015c3c14c7d9b3c3a75819d57a9b899aaf097f05482262725fe5621d88fcfeb"} Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.055956 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/56e8d6c4-0222-4e80-bffd-8fb3726e1b75-kube-state-metrics-tls-config" (OuterVolumeSpecName: "kube-state-metrics-tls-config") pod "56e8d6c4-0222-4e80-bffd-8fb3726e1b75" (UID: "56e8d6c4-0222-4e80-bffd-8fb3726e1b75"). InnerVolumeSpecName "kube-state-metrics-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.056077 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-galera-1"] Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.066145 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-db-create-r5v64"] Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.070234 5120 generic.go:358] "Generic (PLEG): container finished" podID="2c78e334-9857-4302-af64-dc9b0647ab41" containerID="1a869b8a440dafdf19113e6a1f3a4d154f04788c22a46805222bf6dc1a4404aa" exitCode=0 Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.071041 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"2c78e334-9857-4302-af64-dc9b0647ab41","Type":"ContainerDied","Data":"1a869b8a440dafdf19113e6a1f3a4d154f04788c22a46805222bf6dc1a4404aa"} Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.071813 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-db-create-r5v64"] Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.075195 5120 generic.go:358] "Generic (PLEG): container finished" podID="9cb535e7-55cc-4b9d-911c-58f8ed50bee6" containerID="4739157a6d4b51c37814000e2ecdb4f3562bd3a81b3434bad9b0d3c2052c6f8e" exitCode=143 Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.075278 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-566c6b7f4b-gjml4" event={"ID":"9cb535e7-55cc-4b9d-911c-58f8ed50bee6","Type":"ContainerDied","Data":"4739157a6d4b51c37814000e2ecdb4f3562bd3a81b3434bad9b0d3c2052c6f8e"} Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.077983 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-500e-account-create-update-wd7jx" event={"ID":"7d4aa5b5-78e4-464e-bee0-18da0561de5d","Type":"ContainerStarted","Data":"27c3e52c571fc814ed6e67778e52d1562a682e7eee78d1b2659434c91c84e0ee"} Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.078287 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/root-account-create-update-gmjzc" podStartSLOduration=4.078268815 podStartE2EDuration="4.078268815s" podCreationTimestamp="2026-03-16 16:30:30 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:30:32.785450235 +0000 UTC m=+3534.939381902" watchObservedRunningTime="2026-03-16 16:30:34.078268815 +0000 UTC m=+3536.232200472" Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.078319 5120 kubelet_pods.go:1019] "Unable to retrieve pull secret, the image pull may not succeed." pod="openstack-kuttl-tests/neutron-500e-account-create-update-wd7jx" secret="" err="secret \"galera-openstack-dockercfg-nj44g\" not found" Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.078961 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/56e8d6c4-0222-4e80-bffd-8fb3726e1b75-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "56e8d6c4-0222-4e80-bffd-8fb3726e1b75" (UID: "56e8d6c4-0222-4e80-bffd-8fb3726e1b75"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.101582 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/7b46f8b0-c3f2-44ec-88e2-8d65566ae937-internal-tls-certs\") pod \"7b46f8b0-c3f2-44ec-88e2-8d65566ae937\" (UID: \"7b46f8b0-c3f2-44ec-88e2-8d65566ae937\") " Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.102096 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/7b46f8b0-c3f2-44ec-88e2-8d65566ae937-public-tls-certs\") pod \"7b46f8b0-c3f2-44ec-88e2-8d65566ae937\" (UID: \"7b46f8b0-c3f2-44ec-88e2-8d65566ae937\") " Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.102405 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7b46f8b0-c3f2-44ec-88e2-8d65566ae937-run-httpd\") pod \"7b46f8b0-c3f2-44ec-88e2-8d65566ae937\" (UID: \"7b46f8b0-c3f2-44ec-88e2-8d65566ae937\") " Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.103265 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/7b46f8b0-c3f2-44ec-88e2-8d65566ae937-etc-swift\") pod \"7b46f8b0-c3f2-44ec-88e2-8d65566ae937\" (UID: \"7b46f8b0-c3f2-44ec-88e2-8d65566ae937\") " Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.107037 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7b46f8b0-c3f2-44ec-88e2-8d65566ae937-config-data\") pod \"7b46f8b0-c3f2-44ec-88e2-8d65566ae937\" (UID: \"7b46f8b0-c3f2-44ec-88e2-8d65566ae937\") " Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.107196 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7b46f8b0-c3f2-44ec-88e2-8d65566ae937-combined-ca-bundle\") pod \"7b46f8b0-c3f2-44ec-88e2-8d65566ae937\" (UID: \"7b46f8b0-c3f2-44ec-88e2-8d65566ae937\") " Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.107304 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c9ljx\" (UniqueName: \"kubernetes.io/projected/7b46f8b0-c3f2-44ec-88e2-8d65566ae937-kube-api-access-c9ljx\") pod \"7b46f8b0-c3f2-44ec-88e2-8d65566ae937\" (UID: \"7b46f8b0-c3f2-44ec-88e2-8d65566ae937\") " Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.107336 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7b46f8b0-c3f2-44ec-88e2-8d65566ae937-log-httpd\") pod \"7b46f8b0-c3f2-44ec-88e2-8d65566ae937\" (UID: \"7b46f8b0-c3f2-44ec-88e2-8d65566ae937\") " Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.108539 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dx7sz\" (UniqueName: \"kubernetes.io/projected/56e8d6c4-0222-4e80-bffd-8fb3726e1b75-kube-api-access-dx7sz\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.108553 5120 reconciler_common.go:299] "Volume detached for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/56e8d6c4-0222-4e80-bffd-8fb3726e1b75-kube-state-metrics-tls-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.108565 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/56e8d6c4-0222-4e80-bffd-8fb3726e1b75-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.109079 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b46f8b0-c3f2-44ec-88e2-8d65566ae937-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "7b46f8b0-c3f2-44ec-88e2-8d65566ae937" (UID: "7b46f8b0-c3f2-44ec-88e2-8d65566ae937"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.109124 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-gmjzc"] Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.109163 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-8f87-account-create-update-kgjw8"] Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.112274 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b46f8b0-c3f2-44ec-88e2-8d65566ae937-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "7b46f8b0-c3f2-44ec-88e2-8d65566ae937" (UID: "7b46f8b0-c3f2-44ec-88e2-8d65566ae937"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:30:34 crc kubenswrapper[5120]: E0316 16:30:34.116777 5120 kuberuntime_manager.go:1358] "Unhandled Error" err=< Mar 16 16:30:34 crc kubenswrapper[5120]: container &Container{Name:mariadb-account-create-update,Image:quay.io/podified-antelope-centos9/openstack-mariadb@sha256:4caef2b55e01b9a7ee88a22bc69db1893521a91d95c7ad4c8e593f14f17a5f95,Command:[/bin/sh -c #!/bin/bash Mar 16 16:30:34 crc kubenswrapper[5120]: Mar 16 16:30:34 crc kubenswrapper[5120]: MYSQL_REMOTE_HOST="" source /var/lib/operator-scripts/mysql_root_auth.sh Mar 16 16:30:34 crc kubenswrapper[5120]: Mar 16 16:30:34 crc kubenswrapper[5120]: export DatabasePassword=${DatabasePassword:?"Please specify a DatabasePassword variable."} Mar 16 16:30:34 crc kubenswrapper[5120]: Mar 16 16:30:34 crc kubenswrapper[5120]: MYSQL_CMD="mysql -h -u root -P 3306" Mar 16 16:30:34 crc kubenswrapper[5120]: Mar 16 16:30:34 crc kubenswrapper[5120]: if [ -n "neutron" ]; then Mar 16 16:30:34 crc kubenswrapper[5120]: GRANT_DATABASE="neutron" Mar 16 16:30:34 crc kubenswrapper[5120]: else Mar 16 16:30:34 crc kubenswrapper[5120]: GRANT_DATABASE="*" Mar 16 16:30:34 crc kubenswrapper[5120]: fi Mar 16 16:30:34 crc kubenswrapper[5120]: Mar 16 16:30:34 crc kubenswrapper[5120]: # going for maximum compatibility here: Mar 16 16:30:34 crc kubenswrapper[5120]: # 1. MySQL 8 no longer allows implicit create user when GRANT is used Mar 16 16:30:34 crc kubenswrapper[5120]: # 2. MariaDB has "CREATE OR REPLACE", but MySQL does not Mar 16 16:30:34 crc kubenswrapper[5120]: # 3. create user with CREATE but then do all password and TLS with ALTER to Mar 16 16:30:34 crc kubenswrapper[5120]: # support updates Mar 16 16:30:34 crc kubenswrapper[5120]: Mar 16 16:30:34 crc kubenswrapper[5120]: $MYSQL_CMD < logger="UnhandledError" Mar 16 16:30:34 crc kubenswrapper[5120]: E0316 16:30:34.118016 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"mariadb-account-create-update\" with CreateContainerConfigError: \"secret \\\"neutron-db-secret\\\" not found\"" pod="openstack-kuttl-tests/neutron-500e-account-create-update-wd7jx" podUID="7d4aa5b5-78e4-464e-bee0-18da0561de5d" Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.123543 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_5f1a58aa-0b5e-424c-84d6-c2cdc92ce046/ovsdbserver-nb/0.log" Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.123993 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.124072 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-821f-account-create-update-8ph6s"] Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.124138 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"5f1a58aa-0b5e-424c-84d6-c2cdc92ce046","Type":"ContainerDied","Data":"6e89a89d74245f6f2692c71a7ddc0a2bc33c315c3b0e3551d6f78de302cc892a"} Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.124184 5120 scope.go:117] "RemoveContainer" containerID="f82ed5c1d8af30522468a8d3607c34361c11bc4c9e5e0026dad9b12824677da4" Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.134543 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b46f8b0-c3f2-44ec-88e2-8d65566ae937-etc-swift" (OuterVolumeSpecName: "etc-swift") pod "7b46f8b0-c3f2-44ec-88e2-8d65566ae937" (UID: "7b46f8b0-c3f2-44ec-88e2-8d65566ae937"). InnerVolumeSpecName "etc-swift". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.137829 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b46f8b0-c3f2-44ec-88e2-8d65566ae937-kube-api-access-c9ljx" (OuterVolumeSpecName: "kube-api-access-c9ljx") pod "7b46f8b0-c3f2-44ec-88e2-8d65566ae937" (UID: "7b46f8b0-c3f2-44ec-88e2-8d65566ae937"). InnerVolumeSpecName "kube-api-access-c9ljx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.139877 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-821f-account-create-update-8ph6s" event={"ID":"0c04a9e3-0a3b-4895-8703-bb958c3000fd","Type":"ContainerStarted","Data":"c3bf0538cc6b73f41fffce92e2ca5018103cbb1026839a1dd17c8db4ec6e019c"} Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.141146 5120 kubelet_pods.go:1019] "Unable to retrieve pull secret, the image pull may not succeed." pod="openstack-kuttl-tests/placement-821f-account-create-update-8ph6s" secret="" err="secret \"galera-openstack-dockercfg-nj44g\" not found" Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.141507 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/56e8d6c4-0222-4e80-bffd-8fb3726e1b75-kube-state-metrics-tls-certs" (OuterVolumeSpecName: "kube-state-metrics-tls-certs") pod "56e8d6c4-0222-4e80-bffd-8fb3726e1b75" (UID: "56e8d6c4-0222-4e80-bffd-8fb3726e1b75"). InnerVolumeSpecName "kube-state-metrics-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:30:34 crc kubenswrapper[5120]: E0316 16:30:34.146382 5120 kuberuntime_manager.go:1358] "Unhandled Error" err=< Mar 16 16:30:34 crc kubenswrapper[5120]: container &Container{Name:mariadb-account-create-update,Image:quay.io/podified-antelope-centos9/openstack-mariadb@sha256:4caef2b55e01b9a7ee88a22bc69db1893521a91d95c7ad4c8e593f14f17a5f95,Command:[/bin/sh -c #!/bin/bash Mar 16 16:30:34 crc kubenswrapper[5120]: Mar 16 16:30:34 crc kubenswrapper[5120]: MYSQL_REMOTE_HOST="" source /var/lib/operator-scripts/mysql_root_auth.sh Mar 16 16:30:34 crc kubenswrapper[5120]: Mar 16 16:30:34 crc kubenswrapper[5120]: export DatabasePassword=${DatabasePassword:?"Please specify a DatabasePassword variable."} Mar 16 16:30:34 crc kubenswrapper[5120]: Mar 16 16:30:34 crc kubenswrapper[5120]: MYSQL_CMD="mysql -h -u root -P 3306" Mar 16 16:30:34 crc kubenswrapper[5120]: Mar 16 16:30:34 crc kubenswrapper[5120]: if [ -n "placement" ]; then Mar 16 16:30:34 crc kubenswrapper[5120]: GRANT_DATABASE="placement" Mar 16 16:30:34 crc kubenswrapper[5120]: else Mar 16 16:30:34 crc kubenswrapper[5120]: GRANT_DATABASE="*" Mar 16 16:30:34 crc kubenswrapper[5120]: fi Mar 16 16:30:34 crc kubenswrapper[5120]: Mar 16 16:30:34 crc kubenswrapper[5120]: # going for maximum compatibility here: Mar 16 16:30:34 crc kubenswrapper[5120]: # 1. MySQL 8 no longer allows implicit create user when GRANT is used Mar 16 16:30:34 crc kubenswrapper[5120]: # 2. MariaDB has "CREATE OR REPLACE", but MySQL does not Mar 16 16:30:34 crc kubenswrapper[5120]: # 3. create user with CREATE but then do all password and TLS with ALTER to Mar 16 16:30:34 crc kubenswrapper[5120]: # support updates Mar 16 16:30:34 crc kubenswrapper[5120]: Mar 16 16:30:34 crc kubenswrapper[5120]: $MYSQL_CMD < logger="UnhandledError" Mar 16 16:30:34 crc kubenswrapper[5120]: E0316 16:30:34.147853 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"mariadb-account-create-update\" with CreateContainerConfigError: \"secret \\\"placement-db-secret\\\" not found\"" pod="openstack-kuttl-tests/placement-821f-account-create-update-8ph6s" podUID="0c04a9e3-0a3b-4895-8703-bb958c3000fd" Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.151549 5120 generic.go:358] "Generic (PLEG): container finished" podID="594e9c2b-c42a-4671-9b95-3ca9cc0834da" containerID="4738f855f2af9511199dcb63a9d508dbfb5ef2b859371cbd01a2dbeee556de78" exitCode=0 Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.151678 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"594e9c2b-c42a-4671-9b95-3ca9cc0834da","Type":"ContainerDied","Data":"4738f855f2af9511199dcb63a9d508dbfb5ef2b859371cbd01a2dbeee556de78"} Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.168374 5120 generic.go:358] "Generic (PLEG): container finished" podID="f1ddadf2-8a01-49e5-a099-b192f793a36d" containerID="20a146198364dd3bab31073def314ae19daec57fd0b0b0ae40a65386d19d3bd0" exitCode=143 Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.168506 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"f1ddadf2-8a01-49e5-a099-b192f793a36d","Type":"ContainerDied","Data":"20a146198364dd3bab31073def314ae19daec57fd0b0b0ae40a65386d19d3bd0"} Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.172665 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.177010 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-8649c995c9-lzq96" Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.179233 5120 generic.go:358] "Generic (PLEG): container finished" podID="7b46f8b0-c3f2-44ec-88e2-8d65566ae937" containerID="acb24d66779cebdb73830f94ca9a36930b6848cc20bd4028e1a60ec492a4a2b5" exitCode=0 Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.179258 5120 generic.go:358] "Generic (PLEG): container finished" podID="7b46f8b0-c3f2-44ec-88e2-8d65566ae937" containerID="a6a93148c012a86a4db9d9a856d284743e23fe3682ebcefe62653b9a2e3d9836" exitCode=0 Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.179329 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-75575cf5bd-xrtzd" event={"ID":"7b46f8b0-c3f2-44ec-88e2-8d65566ae937","Type":"ContainerDied","Data":"acb24d66779cebdb73830f94ca9a36930b6848cc20bd4028e1a60ec492a4a2b5"} Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.179354 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-75575cf5bd-xrtzd" event={"ID":"7b46f8b0-c3f2-44ec-88e2-8d65566ae937","Type":"ContainerDied","Data":"a6a93148c012a86a4db9d9a856d284743e23fe3682ebcefe62653b9a2e3d9836"} Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.179417 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-75575cf5bd-xrtzd" Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.187746 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.189210 5120 scope.go:117] "RemoveContainer" containerID="05bdfd82f38eeac19c8042eec194130613916269cca59075e4255e557d7fd1ed" Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.189989 5120 generic.go:358] "Generic (PLEG): container finished" podID="bbd47432-e63f-4ba0-8daa-edfb3d2b0af9" containerID="a8d0450cf9b56a1f1a591c22074f8f02a21e970d858afe7341ab0e647e4581ed" exitCode=0 Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.190013 5120 generic.go:358] "Generic (PLEG): container finished" podID="bbd47432-e63f-4ba0-8daa-edfb3d2b0af9" containerID="ef3f1cf32bdce0edaa87a00b39179f41bb817d5cf035cdf5ced8fda3505edb15" exitCode=143 Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.190137 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-8649c995c9-lzq96" event={"ID":"bbd47432-e63f-4ba0-8daa-edfb3d2b0af9","Type":"ContainerDied","Data":"a8d0450cf9b56a1f1a591c22074f8f02a21e970d858afe7341ab0e647e4581ed"} Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.190169 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-8649c995c9-lzq96" event={"ID":"bbd47432-e63f-4ba0-8daa-edfb3d2b0af9","Type":"ContainerDied","Data":"ef3f1cf32bdce0edaa87a00b39179f41bb817d5cf035cdf5ced8fda3505edb15"} Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.190404 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-8649c995c9-lzq96" Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.197813 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.200078 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b46f8b0-c3f2-44ec-88e2-8d65566ae937-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "7b46f8b0-c3f2-44ec-88e2-8d65566ae937" (UID: "7b46f8b0-c3f2-44ec-88e2-8d65566ae937"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.205464 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-5b46-account-create-update-llf4v" event={"ID":"29ef1c2d-283b-421f-8631-ada83f6ea799","Type":"ContainerStarted","Data":"d720bb1469dd87a059dab5a2a3b9ee5d937db82e06d178d4a27db2f50ca7efe4"} Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.206324 5120 kubelet_pods.go:1019] "Unable to retrieve pull secret, the image pull may not succeed." pod="openstack-kuttl-tests/nova-cell1-5b46-account-create-update-llf4v" secret="" err="secret \"galera-openstack-cell1-dockercfg-7v9wr\" not found" Mar 16 16:30:34 crc kubenswrapper[5120]: E0316 16:30:34.210938 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Mar 16 16:30:34 crc kubenswrapper[5120]: E0316 16:30:34.211296 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7d4aa5b5-78e4-464e-bee0-18da0561de5d-operator-scripts podName:7d4aa5b5-78e4-464e-bee0-18da0561de5d nodeName:}" failed. No retries permitted until 2026-03-16 16:30:34.711276453 +0000 UTC m=+3536.865208110 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/7d4aa5b5-78e4-464e-bee0-18da0561de5d-operator-scripts") pod "neutron-500e-account-create-update-wd7jx" (UID: "7d4aa5b5-78e4-464e-bee0-18da0561de5d") : configmap "openstack-scripts" not found Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.211403 5120 reconciler_common.go:299] "Volume detached for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/56e8d6c4-0222-4e80-bffd-8fb3726e1b75-kube-state-metrics-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.212788 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/7b46f8b0-c3f2-44ec-88e2-8d65566ae937-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.212924 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7b46f8b0-c3f2-44ec-88e2-8d65566ae937-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.213019 5120 reconciler_common.go:299] "Volume detached for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/7b46f8b0-c3f2-44ec-88e2-8d65566ae937-etc-swift\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.213114 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c9ljx\" (UniqueName: \"kubernetes.io/projected/7b46f8b0-c3f2-44ec-88e2-8d65566ae937-kube-api-access-c9ljx\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.213206 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7b46f8b0-c3f2-44ec-88e2-8d65566ae937-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.219374 5120 scope.go:117] "RemoveContainer" containerID="acb24d66779cebdb73830f94ca9a36930b6848cc20bd4028e1a60ec492a4a2b5" Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.241987 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b46f8b0-c3f2-44ec-88e2-8d65566ae937-config-data" (OuterVolumeSpecName: "config-data") pod "7b46f8b0-c3f2-44ec-88e2-8d65566ae937" (UID: "7b46f8b0-c3f2-44ec-88e2-8d65566ae937"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.251200 5120 generic.go:358] "Generic (PLEG): container finished" podID="56e8d6c4-0222-4e80-bffd-8fb3726e1b75" containerID="65ce1a9fbe046895b733fc4b967f9bf21a74d0cd97349758a275a768087dbc2d" exitCode=2 Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.251357 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.251374 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"56e8d6c4-0222-4e80-bffd-8fb3726e1b75","Type":"ContainerDied","Data":"65ce1a9fbe046895b733fc4b967f9bf21a74d0cd97349758a275a768087dbc2d"} Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.251407 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"56e8d6c4-0222-4e80-bffd-8fb3726e1b75","Type":"ContainerDied","Data":"90cf81e612a1fd6cebf6444651d80944dfa8bdfbef0a8cb6bb90bb9f1d3bd473"} Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.252754 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b46f8b0-c3f2-44ec-88e2-8d65566ae937-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "7b46f8b0-c3f2-44ec-88e2-8d65566ae937" (UID: "7b46f8b0-c3f2-44ec-88e2-8d65566ae937"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:30:34 crc kubenswrapper[5120]: E0316 16:30:34.256012 5120 kuberuntime_manager.go:1358] "Unhandled Error" err=< Mar 16 16:30:34 crc kubenswrapper[5120]: container &Container{Name:mariadb-account-create-update,Image:quay.io/podified-antelope-centos9/openstack-mariadb@sha256:4caef2b55e01b9a7ee88a22bc69db1893521a91d95c7ad4c8e593f14f17a5f95,Command:[/bin/sh -c #!/bin/bash Mar 16 16:30:34 crc kubenswrapper[5120]: Mar 16 16:30:34 crc kubenswrapper[5120]: MYSQL_REMOTE_HOST="" source /var/lib/operator-scripts/mysql_root_auth.sh Mar 16 16:30:34 crc kubenswrapper[5120]: Mar 16 16:30:34 crc kubenswrapper[5120]: export DatabasePassword=${DatabasePassword:?"Please specify a DatabasePassword variable."} Mar 16 16:30:34 crc kubenswrapper[5120]: Mar 16 16:30:34 crc kubenswrapper[5120]: MYSQL_CMD="mysql -h -u root -P 3306" Mar 16 16:30:34 crc kubenswrapper[5120]: Mar 16 16:30:34 crc kubenswrapper[5120]: if [ -n "nova_cell1" ]; then Mar 16 16:30:34 crc kubenswrapper[5120]: GRANT_DATABASE="nova_cell1" Mar 16 16:30:34 crc kubenswrapper[5120]: else Mar 16 16:30:34 crc kubenswrapper[5120]: GRANT_DATABASE="*" Mar 16 16:30:34 crc kubenswrapper[5120]: fi Mar 16 16:30:34 crc kubenswrapper[5120]: Mar 16 16:30:34 crc kubenswrapper[5120]: # going for maximum compatibility here: Mar 16 16:30:34 crc kubenswrapper[5120]: # 1. MySQL 8 no longer allows implicit create user when GRANT is used Mar 16 16:30:34 crc kubenswrapper[5120]: # 2. MariaDB has "CREATE OR REPLACE", but MySQL does not Mar 16 16:30:34 crc kubenswrapper[5120]: # 3. create user with CREATE but then do all password and TLS with ALTER to Mar 16 16:30:34 crc kubenswrapper[5120]: # support updates Mar 16 16:30:34 crc kubenswrapper[5120]: Mar 16 16:30:34 crc kubenswrapper[5120]: $MYSQL_CMD < logger="UnhandledError" Mar 16 16:30:34 crc kubenswrapper[5120]: E0316 16:30:34.257094 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"mariadb-account-create-update\" with CreateContainerConfigError: \"secret \\\"nova-cell1-db-secret\\\" not found\"" pod="openstack-kuttl-tests/nova-cell1-5b46-account-create-update-llf4v" podUID="29ef1c2d-283b-421f-8631-ada83f6ea799" Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.260548 5120 generic.go:358] "Generic (PLEG): container finished" podID="9943d2d4-e26d-4c91-942e-a6d788ac8c7e" containerID="c0bc7e279a64621a39a3a9389a1126717ff380d3894cb0c8f3ebb89da4074567" exitCode=1 Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.261154 5120 kubelet_pods.go:1019] "Unable to retrieve pull secret, the image pull may not succeed." pod="openstack-kuttl-tests/root-account-create-update-gmjzc" secret="" err="secret \"galera-openstack-dockercfg-nj44g\" not found" Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.261281 5120 scope.go:117] "RemoveContainer" containerID="c0bc7e279a64621a39a3a9389a1126717ff380d3894cb0c8f3ebb89da4074567" Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.262889 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-gmjzc" event={"ID":"9943d2d4-e26d-4c91-942e-a6d788ac8c7e","Type":"ContainerDied","Data":"c0bc7e279a64621a39a3a9389a1126717ff380d3894cb0c8f3ebb89da4074567"} Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.298584 5120 scope.go:117] "RemoveContainer" containerID="a6a93148c012a86a4db9d9a856d284743e23fe3682ebcefe62653b9a2e3d9836" Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.304565 5120 status_manager.go:895] "Failed to get status for pod" podUID="5456036b-4cdb-4d1a-9b60-d0effc293043" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.343001 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/bbd47432-e63f-4ba0-8daa-edfb3d2b0af9-config-data-custom\") pod \"bbd47432-e63f-4ba0-8daa-edfb3d2b0af9\" (UID: \"bbd47432-e63f-4ba0-8daa-edfb3d2b0af9\") " Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.343045 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/bbd47432-e63f-4ba0-8daa-edfb3d2b0af9-logs\") pod \"bbd47432-e63f-4ba0-8daa-edfb3d2b0af9\" (UID: \"bbd47432-e63f-4ba0-8daa-edfb3d2b0af9\") " Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.343203 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bbd47432-e63f-4ba0-8daa-edfb3d2b0af9-config-data\") pod \"bbd47432-e63f-4ba0-8daa-edfb3d2b0af9\" (UID: \"bbd47432-e63f-4ba0-8daa-edfb3d2b0af9\") " Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.343258 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bbd47432-e63f-4ba0-8daa-edfb3d2b0af9-combined-ca-bundle\") pod \"bbd47432-e63f-4ba0-8daa-edfb3d2b0af9\" (UID: \"bbd47432-e63f-4ba0-8daa-edfb3d2b0af9\") " Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.343294 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kwg5z\" (UniqueName: \"kubernetes.io/projected/bbd47432-e63f-4ba0-8daa-edfb3d2b0af9-kube-api-access-kwg5z\") pod \"bbd47432-e63f-4ba0-8daa-edfb3d2b0af9\" (UID: \"bbd47432-e63f-4ba0-8daa-edfb3d2b0af9\") " Mar 16 16:30:34 crc kubenswrapper[5120]: E0316 16:30:34.344058 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-cell1-scripts: configmap "openstack-cell1-scripts" not found Mar 16 16:30:34 crc kubenswrapper[5120]: E0316 16:30:34.344140 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/29ef1c2d-283b-421f-8631-ada83f6ea799-operator-scripts podName:29ef1c2d-283b-421f-8631-ada83f6ea799 nodeName:}" failed. No retries permitted until 2026-03-16 16:30:34.844119366 +0000 UTC m=+3536.998051023 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/29ef1c2d-283b-421f-8631-ada83f6ea799-operator-scripts") pod "nova-cell1-5b46-account-create-update-llf4v" (UID: "29ef1c2d-283b-421f-8631-ada83f6ea799") : configmap "openstack-cell1-scripts" not found Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.344310 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bbd47432-e63f-4ba0-8daa-edfb3d2b0af9-logs" (OuterVolumeSpecName: "logs") pod "bbd47432-e63f-4ba0-8daa-edfb3d2b0af9" (UID: "bbd47432-e63f-4ba0-8daa-edfb3d2b0af9"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.344348 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7b46f8b0-c3f2-44ec-88e2-8d65566ae937-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:34 crc kubenswrapper[5120]: E0316 16:30:34.344466 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Mar 16 16:30:34 crc kubenswrapper[5120]: E0316 16:30:34.344520 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0c04a9e3-0a3b-4895-8703-bb958c3000fd-operator-scripts podName:0c04a9e3-0a3b-4895-8703-bb958c3000fd nodeName:}" failed. No retries permitted until 2026-03-16 16:30:34.844504316 +0000 UTC m=+3536.998435973 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/0c04a9e3-0a3b-4895-8703-bb958c3000fd-operator-scripts") pod "placement-821f-account-create-update-8ph6s" (UID: "0c04a9e3-0a3b-4895-8703-bb958c3000fd") : configmap "openstack-scripts" not found Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.344608 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/7b46f8b0-c3f2-44ec-88e2-8d65566ae937-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.348085 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bbd47432-e63f-4ba0-8daa-edfb3d2b0af9-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "bbd47432-e63f-4ba0-8daa-edfb3d2b0af9" (UID: "bbd47432-e63f-4ba0-8daa-edfb3d2b0af9"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.348950 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bbd47432-e63f-4ba0-8daa-edfb3d2b0af9-kube-api-access-kwg5z" (OuterVolumeSpecName: "kube-api-access-kwg5z") pod "bbd47432-e63f-4ba0-8daa-edfb3d2b0af9" (UID: "bbd47432-e63f-4ba0-8daa-edfb3d2b0af9"). InnerVolumeSpecName "kube-api-access-kwg5z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.357012 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b46f8b0-c3f2-44ec-88e2-8d65566ae937-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "7b46f8b0-c3f2-44ec-88e2-8d65566ae937" (UID: "7b46f8b0-c3f2-44ec-88e2-8d65566ae937"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.382865 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bbd47432-e63f-4ba0-8daa-edfb3d2b0af9-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "bbd47432-e63f-4ba0-8daa-edfb3d2b0af9" (UID: "bbd47432-e63f-4ba0-8daa-edfb3d2b0af9"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.396909 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/openstack-galera-2" podUID="51ac8589-b6a7-414d-94e5-731e217600c4" containerName="galera" containerID="cri-o://06cc9c752fc92ddfe80aca27a3714df85a220637bdd9e5ff98660c5f113511dc" gracePeriod=30 Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.410291 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.421295 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.429874 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bbd47432-e63f-4ba0-8daa-edfb3d2b0af9-config-data" (OuterVolumeSpecName: "config-data") pod "bbd47432-e63f-4ba0-8daa-edfb3d2b0af9" (UID: "bbd47432-e63f-4ba0-8daa-edfb3d2b0af9"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.501613 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bbd47432-e63f-4ba0-8daa-edfb3d2b0af9-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.501656 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bbd47432-e63f-4ba0-8daa-edfb3d2b0af9-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.501672 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kwg5z\" (UniqueName: \"kubernetes.io/projected/bbd47432-e63f-4ba0-8daa-edfb3d2b0af9-kube-api-access-kwg5z\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.501711 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7b46f8b0-c3f2-44ec-88e2-8d65566ae937-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.501728 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/bbd47432-e63f-4ba0-8daa-edfb3d2b0af9-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.501743 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/bbd47432-e63f-4ba0-8daa-edfb3d2b0af9-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:34 crc kubenswrapper[5120]: E0316 16:30:34.501856 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Mar 16 16:30:34 crc kubenswrapper[5120]: E0316 16:30:34.501933 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9943d2d4-e26d-4c91-942e-a6d788ac8c7e-operator-scripts podName:9943d2d4-e26d-4c91-942e-a6d788ac8c7e nodeName:}" failed. No retries permitted until 2026-03-16 16:30:36.501904996 +0000 UTC m=+3538.655836653 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/9943d2d4-e26d-4c91-942e-a6d788ac8c7e-operator-scripts") pod "root-account-create-update-gmjzc" (UID: "9943d2d4-e26d-4c91-942e-a6d788ac8c7e") : configmap "openstack-scripts" not found Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.538844 5120 scope.go:117] "RemoveContainer" containerID="acb24d66779cebdb73830f94ca9a36930b6848cc20bd4028e1a60ec492a4a2b5" Mar 16 16:30:34 crc kubenswrapper[5120]: E0316 16:30:34.539851 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"acb24d66779cebdb73830f94ca9a36930b6848cc20bd4028e1a60ec492a4a2b5\": container with ID starting with acb24d66779cebdb73830f94ca9a36930b6848cc20bd4028e1a60ec492a4a2b5 not found: ID does not exist" containerID="acb24d66779cebdb73830f94ca9a36930b6848cc20bd4028e1a60ec492a4a2b5" Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.539878 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"acb24d66779cebdb73830f94ca9a36930b6848cc20bd4028e1a60ec492a4a2b5"} err="failed to get container status \"acb24d66779cebdb73830f94ca9a36930b6848cc20bd4028e1a60ec492a4a2b5\": rpc error: code = NotFound desc = could not find container \"acb24d66779cebdb73830f94ca9a36930b6848cc20bd4028e1a60ec492a4a2b5\": container with ID starting with acb24d66779cebdb73830f94ca9a36930b6848cc20bd4028e1a60ec492a4a2b5 not found: ID does not exist" Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.539910 5120 scope.go:117] "RemoveContainer" containerID="a6a93148c012a86a4db9d9a856d284743e23fe3682ebcefe62653b9a2e3d9836" Mar 16 16:30:34 crc kubenswrapper[5120]: E0316 16:30:34.540282 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a6a93148c012a86a4db9d9a856d284743e23fe3682ebcefe62653b9a2e3d9836\": container with ID starting with a6a93148c012a86a4db9d9a856d284743e23fe3682ebcefe62653b9a2e3d9836 not found: ID does not exist" containerID="a6a93148c012a86a4db9d9a856d284743e23fe3682ebcefe62653b9a2e3d9836" Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.540313 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6a93148c012a86a4db9d9a856d284743e23fe3682ebcefe62653b9a2e3d9836"} err="failed to get container status \"a6a93148c012a86a4db9d9a856d284743e23fe3682ebcefe62653b9a2e3d9836\": rpc error: code = NotFound desc = could not find container \"a6a93148c012a86a4db9d9a856d284743e23fe3682ebcefe62653b9a2e3d9836\": container with ID starting with a6a93148c012a86a4db9d9a856d284743e23fe3682ebcefe62653b9a2e3d9836 not found: ID does not exist" Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.540330 5120 scope.go:117] "RemoveContainer" containerID="a8d0450cf9b56a1f1a591c22074f8f02a21e970d858afe7341ab0e647e4581ed" Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.546661 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.593749 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.598212 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-jb5ks"] Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.680879 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="06d95d7b-0750-49bf-b877-8f94a33ef71d" path="/var/lib/kubelet/pods/06d95d7b-0750-49bf-b877-8f94a33ef71d/volumes" Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.681536 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="08073bb9-e6b3-429c-ba4e-eb22a745252e" path="/var/lib/kubelet/pods/08073bb9-e6b3-429c-ba4e-eb22a745252e/volumes" Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.682308 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2a10d584-68ec-45e6-955f-3559e75bc4ee" path="/var/lib/kubelet/pods/2a10d584-68ec-45e6-955f-3559e75bc4ee/volumes" Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.685017 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5456036b-4cdb-4d1a-9b60-d0effc293043" path="/var/lib/kubelet/pods/5456036b-4cdb-4d1a-9b60-d0effc293043/volumes" Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.685818 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="56e8d6c4-0222-4e80-bffd-8fb3726e1b75" path="/var/lib/kubelet/pods/56e8d6c4-0222-4e80-bffd-8fb3726e1b75/volumes" Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.686460 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5756d219-d2ba-42b8-a02d-c0681c069fca" path="/var/lib/kubelet/pods/5756d219-d2ba-42b8-a02d-c0681c069fca/volumes" Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.687537 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5f1a58aa-0b5e-424c-84d6-c2cdc92ce046" path="/var/lib/kubelet/pods/5f1a58aa-0b5e-424c-84d6-c2cdc92ce046/volumes" Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.689381 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ed22727-fd32-47c8-ae36-f80dddf5c720" path="/var/lib/kubelet/pods/6ed22727-fd32-47c8-ae36-f80dddf5c720/volumes" Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.690230 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="785bf626-cdb3-4701-bd4f-0f34c3b03ec2" path="/var/lib/kubelet/pods/785bf626-cdb3-4701-bd4f-0f34c3b03ec2/volumes" Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.691503 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ce00bd2-57d0-4362-9faa-1ce50ba8d07f" path="/var/lib/kubelet/pods/8ce00bd2-57d0-4362-9faa-1ce50ba8d07f/volumes" Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.692149 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8d066f10-2ae7-4441-8302-a2fc9c744aa8" path="/var/lib/kubelet/pods/8d066f10-2ae7-4441-8302-a2fc9c744aa8/volumes" Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.692712 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a9e8e595-2161-4919-89fa-98913dc78df6" path="/var/lib/kubelet/pods/a9e8e595-2161-4919-89fa-98913dc78df6/volumes" Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.693321 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b11f89f6-cba8-4f94-ac51-8f4d514e54fb" path="/var/lib/kubelet/pods/b11f89f6-cba8-4f94-ac51-8f4d514e54fb/volumes" Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.694850 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b90e76bc-d652-4606-8c72-4b96133ce5c4" path="/var/lib/kubelet/pods/b90e76bc-d652-4606-8c72-4b96133ce5c4/volumes" Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.695360 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c7086f4e-6b79-4162-874b-4c7cd36c1ae2" path="/var/lib/kubelet/pods/c7086f4e-6b79-4162-874b-4c7cd36c1ae2/volumes" Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.696590 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e622dbb7-5ee2-4b38-a60f-f151f513e13e" path="/var/lib/kubelet/pods/e622dbb7-5ee2-4b38-a60f-f151f513e13e/volumes" Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.697774 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef37d2ce-771c-4eec-933f-823daddb5817" path="/var/lib/kubelet/pods/ef37d2ce-771c-4eec-933f-823daddb5817/volumes" Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.698469 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f45bc0f5-319a-407a-b329-ebad473733f6" path="/var/lib/kubelet/pods/f45bc0f5-319a-407a-b329-ebad473733f6/volumes" Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.699239 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f6f3bfb6-6e3f-4a38-b39b-fe1701d8e53d" path="/var/lib/kubelet/pods/f6f3bfb6-6e3f-4a38-b39b-fe1701d8e53d/volumes" Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.772436 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.773695 5120 scope.go:117] "RemoveContainer" containerID="ef3f1cf32bdce0edaa87a00b39179f41bb817d5cf035cdf5ced8fda3505edb15" Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.810849 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-8f87-account-create-update-kgjw8" Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.811202 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/2c78e334-9857-4302-af64-dc9b0647ab41-vencrypt-tls-certs\") pod \"2c78e334-9857-4302-af64-dc9b0647ab41\" (UID: \"2c78e334-9857-4302-af64-dc9b0647ab41\") " Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.811526 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2c78e334-9857-4302-af64-dc9b0647ab41-config-data\") pod \"2c78e334-9857-4302-af64-dc9b0647ab41\" (UID: \"2c78e334-9857-4302-af64-dc9b0647ab41\") " Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.811944 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8sv8t\" (UniqueName: \"kubernetes.io/projected/2c78e334-9857-4302-af64-dc9b0647ab41-kube-api-access-8sv8t\") pod \"2c78e334-9857-4302-af64-dc9b0647ab41\" (UID: \"2c78e334-9857-4302-af64-dc9b0647ab41\") " Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.812116 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2c78e334-9857-4302-af64-dc9b0647ab41-combined-ca-bundle\") pod \"2c78e334-9857-4302-af64-dc9b0647ab41\" (UID: \"2c78e334-9857-4302-af64-dc9b0647ab41\") " Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.812176 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/2c78e334-9857-4302-af64-dc9b0647ab41-nova-novncproxy-tls-certs\") pod \"2c78e334-9857-4302-af64-dc9b0647ab41\" (UID: \"2c78e334-9857-4302-af64-dc9b0647ab41\") " Mar 16 16:30:34 crc kubenswrapper[5120]: E0316 16:30:34.813245 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Mar 16 16:30:34 crc kubenswrapper[5120]: E0316 16:30:34.813324 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7d4aa5b5-78e4-464e-bee0-18da0561de5d-operator-scripts podName:7d4aa5b5-78e4-464e-bee0-18da0561de5d nodeName:}" failed. No retries permitted until 2026-03-16 16:30:35.813303895 +0000 UTC m=+3537.967235552 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/7d4aa5b5-78e4-464e-bee0-18da0561de5d-operator-scripts") pod "neutron-500e-account-create-update-wd7jx" (UID: "7d4aa5b5-78e4-464e-bee0-18da0561de5d") : configmap "openstack-scripts" not found Mar 16 16:30:34 crc kubenswrapper[5120]: E0316 16:30:34.813727 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/neutron-config: secret "neutron-config" not found Mar 16 16:30:34 crc kubenswrapper[5120]: E0316 16:30:34.813792 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/325f32e1-5461-4d71-a30c-dee2528d6fb3-config podName:325f32e1-5461-4d71-a30c-dee2528d6fb3 nodeName:}" failed. No retries permitted until 2026-03-16 16:30:38.813781458 +0000 UTC m=+3540.967713115 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "config" (UniqueName: "kubernetes.io/secret/325f32e1-5461-4d71-a30c-dee2528d6fb3-config") pod "neutron-59d4fdd9db-tttbf" (UID: "325f32e1-5461-4d71-a30c-dee2528d6fb3") : secret "neutron-config" not found Mar 16 16:30:34 crc kubenswrapper[5120]: E0316 16:30:34.814253 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/neutron-httpd-config: secret "neutron-httpd-config" not found Mar 16 16:30:34 crc kubenswrapper[5120]: E0316 16:30:34.814302 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/325f32e1-5461-4d71-a30c-dee2528d6fb3-httpd-config podName:325f32e1-5461-4d71-a30c-dee2528d6fb3 nodeName:}" failed. No retries permitted until 2026-03-16 16:30:38.814289921 +0000 UTC m=+3540.968221578 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "httpd-config" (UniqueName: "kubernetes.io/secret/325f32e1-5461-4d71-a30c-dee2528d6fb3-httpd-config") pod "neutron-59d4fdd9db-tttbf" (UID: "325f32e1-5461-4d71-a30c-dee2528d6fb3") : secret "neutron-httpd-config" not found Mar 16 16:30:34 crc kubenswrapper[5120]: E0316 16:30:34.814697 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Mar 16 16:30:34 crc kubenswrapper[5120]: E0316 16:30:34.817625 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b190faa2-d49d-424d-90bc-3e6e34d1b362-config-data podName:b190faa2-d49d-424d-90bc-3e6e34d1b362 nodeName:}" failed. No retries permitted until 2026-03-16 16:30:38.81760368 +0000 UTC m=+3540.971535337 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/b190faa2-d49d-424d-90bc-3e6e34d1b362-config-data") pod "rabbitmq-cell1-server-2" (UID: "b190faa2-d49d-424d-90bc-3e6e34d1b362") : configmap "rabbitmq-cell1-config-data" not found Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.840250 5120 scope.go:117] "RemoveContainer" containerID="a8d0450cf9b56a1f1a591c22074f8f02a21e970d858afe7341ab0e647e4581ed" Mar 16 16:30:34 crc kubenswrapper[5120]: E0316 16:30:34.840661 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a8d0450cf9b56a1f1a591c22074f8f02a21e970d858afe7341ab0e647e4581ed\": container with ID starting with a8d0450cf9b56a1f1a591c22074f8f02a21e970d858afe7341ab0e647e4581ed not found: ID does not exist" containerID="a8d0450cf9b56a1f1a591c22074f8f02a21e970d858afe7341ab0e647e4581ed" Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.840688 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8d0450cf9b56a1f1a591c22074f8f02a21e970d858afe7341ab0e647e4581ed"} err="failed to get container status \"a8d0450cf9b56a1f1a591c22074f8f02a21e970d858afe7341ab0e647e4581ed\": rpc error: code = NotFound desc = could not find container \"a8d0450cf9b56a1f1a591c22074f8f02a21e970d858afe7341ab0e647e4581ed\": container with ID starting with a8d0450cf9b56a1f1a591c22074f8f02a21e970d858afe7341ab0e647e4581ed not found: ID does not exist" Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.840703 5120 scope.go:117] "RemoveContainer" containerID="ef3f1cf32bdce0edaa87a00b39179f41bb817d5cf035cdf5ced8fda3505edb15" Mar 16 16:30:34 crc kubenswrapper[5120]: E0316 16:30:34.840910 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ef3f1cf32bdce0edaa87a00b39179f41bb817d5cf035cdf5ced8fda3505edb15\": container with ID starting with ef3f1cf32bdce0edaa87a00b39179f41bb817d5cf035cdf5ced8fda3505edb15 not found: ID does not exist" containerID="ef3f1cf32bdce0edaa87a00b39179f41bb817d5cf035cdf5ced8fda3505edb15" Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.840928 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef3f1cf32bdce0edaa87a00b39179f41bb817d5cf035cdf5ced8fda3505edb15"} err="failed to get container status \"ef3f1cf32bdce0edaa87a00b39179f41bb817d5cf035cdf5ced8fda3505edb15\": rpc error: code = NotFound desc = could not find container \"ef3f1cf32bdce0edaa87a00b39179f41bb817d5cf035cdf5ced8fda3505edb15\": container with ID starting with ef3f1cf32bdce0edaa87a00b39179f41bb817d5cf035cdf5ced8fda3505edb15 not found: ID does not exist" Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.840941 5120 scope.go:117] "RemoveContainer" containerID="b0827a3b77f1f888901fc0c03daaa68e9b8ae643846cc4a639bc12495d1f5f47" Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.841736 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c78e334-9857-4302-af64-dc9b0647ab41-kube-api-access-8sv8t" (OuterVolumeSpecName: "kube-api-access-8sv8t") pod "2c78e334-9857-4302-af64-dc9b0647ab41" (UID: "2c78e334-9857-4302-af64-dc9b0647ab41"). InnerVolumeSpecName "kube-api-access-8sv8t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.875651 5120 scope.go:117] "RemoveContainer" containerID="65ce1a9fbe046895b733fc4b967f9bf21a74d0cd97349758a275a768087dbc2d" Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.908070 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2c78e334-9857-4302-af64-dc9b0647ab41-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "2c78e334-9857-4302-af64-dc9b0647ab41" (UID: "2c78e334-9857-4302-af64-dc9b0647ab41"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.915025 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l8l28\" (UniqueName: \"kubernetes.io/projected/b62b0167-9419-454f-a1c2-78d1354baeb2-kube-api-access-l8l28\") pod \"b62b0167-9419-454f-a1c2-78d1354baeb2\" (UID: \"b62b0167-9419-454f-a1c2-78d1354baeb2\") " Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.915589 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b62b0167-9419-454f-a1c2-78d1354baeb2-operator-scripts\") pod \"b62b0167-9419-454f-a1c2-78d1354baeb2\" (UID: \"b62b0167-9419-454f-a1c2-78d1354baeb2\") " Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.916052 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fxj6m\" (UniqueName: \"kubernetes.io/projected/24ef8cf9-6eb2-44c4-8845-7db782f6a862-kube-api-access-fxj6m\") pod \"keystone-aceb-account-create-update-h7jsn\" (UID: \"24ef8cf9-6eb2-44c4-8845-7db782f6a862\") " pod="openstack-kuttl-tests/keystone-aceb-account-create-update-h7jsn" Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.916110 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/24ef8cf9-6eb2-44c4-8845-7db782f6a862-operator-scripts\") pod \"keystone-aceb-account-create-update-h7jsn\" (UID: \"24ef8cf9-6eb2-44c4-8845-7db782f6a862\") " pod="openstack-kuttl-tests/keystone-aceb-account-create-update-h7jsn" Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.916325 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8sv8t\" (UniqueName: \"kubernetes.io/projected/2c78e334-9857-4302-af64-dc9b0647ab41-kube-api-access-8sv8t\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.916342 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2c78e334-9857-4302-af64-dc9b0647ab41-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:34 crc kubenswrapper[5120]: E0316 16:30:34.916394 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Mar 16 16:30:34 crc kubenswrapper[5120]: E0316 16:30:34.916451 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0c04a9e3-0a3b-4895-8703-bb958c3000fd-operator-scripts podName:0c04a9e3-0a3b-4895-8703-bb958c3000fd nodeName:}" failed. No retries permitted until 2026-03-16 16:30:35.916436683 +0000 UTC m=+3538.070368330 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/0c04a9e3-0a3b-4895-8703-bb958c3000fd-operator-scripts") pod "placement-821f-account-create-update-8ph6s" (UID: "0c04a9e3-0a3b-4895-8703-bb958c3000fd") : configmap "openstack-scripts" not found Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.918436 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b62b0167-9419-454f-a1c2-78d1354baeb2-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "b62b0167-9419-454f-a1c2-78d1354baeb2" (UID: "b62b0167-9419-454f-a1c2-78d1354baeb2"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:30:34 crc kubenswrapper[5120]: E0316 16:30:34.918515 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-cell1-scripts: configmap "openstack-cell1-scripts" not found Mar 16 16:30:34 crc kubenswrapper[5120]: E0316 16:30:34.918565 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/29ef1c2d-283b-421f-8631-ada83f6ea799-operator-scripts podName:29ef1c2d-283b-421f-8631-ada83f6ea799 nodeName:}" failed. No retries permitted until 2026-03-16 16:30:35.91854689 +0000 UTC m=+3538.072478547 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/29ef1c2d-283b-421f-8631-ada83f6ea799-operator-scripts") pod "nova-cell1-5b46-account-create-update-llf4v" (UID: "29ef1c2d-283b-421f-8631-ada83f6ea799") : configmap "openstack-cell1-scripts" not found Mar 16 16:30:34 crc kubenswrapper[5120]: E0316 16:30:34.918598 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Mar 16 16:30:34 crc kubenswrapper[5120]: E0316 16:30:34.918625 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/24ef8cf9-6eb2-44c4-8845-7db782f6a862-operator-scripts podName:24ef8cf9-6eb2-44c4-8845-7db782f6a862 nodeName:}" failed. No retries permitted until 2026-03-16 16:30:36.918617462 +0000 UTC m=+3539.072549119 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/24ef8cf9-6eb2-44c4-8845-7db782f6a862-operator-scripts") pod "keystone-aceb-account-create-update-h7jsn" (UID: "24ef8cf9-6eb2-44c4-8845-7db782f6a862") : configmap "openstack-scripts" not found Mar 16 16:30:34 crc kubenswrapper[5120]: E0316 16:30:34.929398 5120 projected.go:194] Error preparing data for projected volume kube-api-access-fxj6m for pod openstack-kuttl-tests/keystone-aceb-account-create-update-h7jsn: failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 16:30:34 crc kubenswrapper[5120]: E0316 16:30:34.929879 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/24ef8cf9-6eb2-44c4-8845-7db782f6a862-kube-api-access-fxj6m podName:24ef8cf9-6eb2-44c4-8845-7db782f6a862 nodeName:}" failed. No retries permitted until 2026-03-16 16:30:36.929853032 +0000 UTC m=+3539.083784689 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-fxj6m" (UniqueName: "kubernetes.io/projected/24ef8cf9-6eb2-44c4-8845-7db782f6a862-kube-api-access-fxj6m") pod "keystone-aceb-account-create-update-h7jsn" (UID: "24ef8cf9-6eb2-44c4-8845-7db782f6a862") : failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.931379 5120 scope.go:117] "RemoveContainer" containerID="65ce1a9fbe046895b733fc4b967f9bf21a74d0cd97349758a275a768087dbc2d" Mar 16 16:30:34 crc kubenswrapper[5120]: E0316 16:30:34.935176 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"65ce1a9fbe046895b733fc4b967f9bf21a74d0cd97349758a275a768087dbc2d\": container with ID starting with 65ce1a9fbe046895b733fc4b967f9bf21a74d0cd97349758a275a768087dbc2d not found: ID does not exist" containerID="65ce1a9fbe046895b733fc4b967f9bf21a74d0cd97349758a275a768087dbc2d" Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.935223 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65ce1a9fbe046895b733fc4b967f9bf21a74d0cd97349758a275a768087dbc2d"} err="failed to get container status \"65ce1a9fbe046895b733fc4b967f9bf21a74d0cd97349758a275a768087dbc2d\": rpc error: code = NotFound desc = could not find container \"65ce1a9fbe046895b733fc4b967f9bf21a74d0cd97349758a275a768087dbc2d\": container with ID starting with 65ce1a9fbe046895b733fc4b967f9bf21a74d0cd97349758a275a768087dbc2d not found: ID does not exist" Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.940539 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b62b0167-9419-454f-a1c2-78d1354baeb2-kube-api-access-l8l28" (OuterVolumeSpecName: "kube-api-access-l8l28") pod "b62b0167-9419-454f-a1c2-78d1354baeb2" (UID: "b62b0167-9419-454f-a1c2-78d1354baeb2"). InnerVolumeSpecName "kube-api-access-l8l28". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:30:34 crc kubenswrapper[5120]: I0316 16:30:34.993109 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2c78e334-9857-4302-af64-dc9b0647ab41-config-data" (OuterVolumeSpecName: "config-data") pod "2c78e334-9857-4302-af64-dc9b0647ab41" (UID: "2c78e334-9857-4302-af64-dc9b0647ab41"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:30:35 crc kubenswrapper[5120]: I0316 16:30:35.013863 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2c78e334-9857-4302-af64-dc9b0647ab41-vencrypt-tls-certs" (OuterVolumeSpecName: "vencrypt-tls-certs") pod "2c78e334-9857-4302-af64-dc9b0647ab41" (UID: "2c78e334-9857-4302-af64-dc9b0647ab41"). InnerVolumeSpecName "vencrypt-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:30:35 crc kubenswrapper[5120]: I0316 16:30:35.015171 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Mar 16 16:30:35 crc kubenswrapper[5120]: I0316 16:30:35.019380 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l8l28\" (UniqueName: \"kubernetes.io/projected/b62b0167-9419-454f-a1c2-78d1354baeb2-kube-api-access-l8l28\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:35 crc kubenswrapper[5120]: I0316 16:30:35.019411 5120 reconciler_common.go:299] "Volume detached for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/2c78e334-9857-4302-af64-dc9b0647ab41-vencrypt-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:35 crc kubenswrapper[5120]: I0316 16:30:35.019435 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2c78e334-9857-4302-af64-dc9b0647ab41-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:35 crc kubenswrapper[5120]: I0316 16:30:35.019444 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b62b0167-9419-454f-a1c2-78d1354baeb2-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:35 crc kubenswrapper[5120]: E0316 16:30:35.019502 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Mar 16 16:30:35 crc kubenswrapper[5120]: E0316 16:30:35.019586 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e1bf7ad2-f215-405b-84de-9429f90855f8-config-data podName:e1bf7ad2-f215-405b-84de-9429f90855f8 nodeName:}" failed. No retries permitted until 2026-03-16 16:30:39.019570582 +0000 UTC m=+3541.173502239 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/e1bf7ad2-f215-405b-84de-9429f90855f8-config-data") pod "rabbitmq-cell1-server-0" (UID: "e1bf7ad2-f215-405b-84de-9429f90855f8") : configmap "rabbitmq-cell1-config-data" not found Mar 16 16:30:35 crc kubenswrapper[5120]: I0316 16:30:35.022852 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2c78e334-9857-4302-af64-dc9b0647ab41-nova-novncproxy-tls-certs" (OuterVolumeSpecName: "nova-novncproxy-tls-certs") pod "2c78e334-9857-4302-af64-dc9b0647ab41" (UID: "2c78e334-9857-4302-af64-dc9b0647ab41"). InnerVolumeSpecName "nova-novncproxy-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:30:35 crc kubenswrapper[5120]: I0316 16:30:35.052284 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-2" Mar 16 16:30:35 crc kubenswrapper[5120]: I0316 16:30:35.121389 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"mysql-db\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"fa5682a3-5cb9-4da7-8588-678ba2537e0c\" (UID: \"fa5682a3-5cb9-4da7-8588-678ba2537e0c\") " Mar 16 16:30:35 crc kubenswrapper[5120]: I0316 16:30:35.121500 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/9565a662-ca77-4197-8894-6b9633e653fd-config-data\") pod \"9565a662-ca77-4197-8894-6b9633e653fd\" (UID: \"9565a662-ca77-4197-8894-6b9633e653fd\") " Mar 16 16:30:35 crc kubenswrapper[5120]: I0316 16:30:35.122201 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9565a662-ca77-4197-8894-6b9633e653fd-config-data" (OuterVolumeSpecName: "config-data") pod "9565a662-ca77-4197-8894-6b9633e653fd" (UID: "9565a662-ca77-4197-8894-6b9633e653fd"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:30:35 crc kubenswrapper[5120]: I0316 16:30:35.122244 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/fa5682a3-5cb9-4da7-8588-678ba2537e0c-config-data-default\") pod \"fa5682a3-5cb9-4da7-8588-678ba2537e0c\" (UID: \"fa5682a3-5cb9-4da7-8588-678ba2537e0c\") " Mar 16 16:30:35 crc kubenswrapper[5120]: I0316 16:30:35.122264 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fa5682a3-5cb9-4da7-8588-678ba2537e0c-config-data-default" (OuterVolumeSpecName: "config-data-default") pod "fa5682a3-5cb9-4da7-8588-678ba2537e0c" (UID: "fa5682a3-5cb9-4da7-8588-678ba2537e0c"). InnerVolumeSpecName "config-data-default". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:30:35 crc kubenswrapper[5120]: I0316 16:30:35.122322 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/fa5682a3-5cb9-4da7-8588-678ba2537e0c-config-data-generated\") pod \"fa5682a3-5cb9-4da7-8588-678ba2537e0c\" (UID: \"fa5682a3-5cb9-4da7-8588-678ba2537e0c\") " Mar 16 16:30:35 crc kubenswrapper[5120]: I0316 16:30:35.122491 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/fa5682a3-5cb9-4da7-8588-678ba2537e0c-galera-tls-certs\") pod \"fa5682a3-5cb9-4da7-8588-678ba2537e0c\" (UID: \"fa5682a3-5cb9-4da7-8588-678ba2537e0c\") " Mar 16 16:30:35 crc kubenswrapper[5120]: I0316 16:30:35.122509 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9565a662-ca77-4197-8894-6b9633e653fd-combined-ca-bundle\") pod \"9565a662-ca77-4197-8894-6b9633e653fd\" (UID: \"9565a662-ca77-4197-8894-6b9633e653fd\") " Mar 16 16:30:35 crc kubenswrapper[5120]: I0316 16:30:35.122730 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa5682a3-5cb9-4da7-8588-678ba2537e0c-config-data-generated" (OuterVolumeSpecName: "config-data-generated") pod "fa5682a3-5cb9-4da7-8588-678ba2537e0c" (UID: "fa5682a3-5cb9-4da7-8588-678ba2537e0c"). InnerVolumeSpecName "config-data-generated". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:30:35 crc kubenswrapper[5120]: I0316 16:30:35.123082 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-blk52\" (UniqueName: \"kubernetes.io/projected/9565a662-ca77-4197-8894-6b9633e653fd-kube-api-access-blk52\") pod \"9565a662-ca77-4197-8894-6b9633e653fd\" (UID: \"9565a662-ca77-4197-8894-6b9633e653fd\") " Mar 16 16:30:35 crc kubenswrapper[5120]: I0316 16:30:35.123175 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/fa5682a3-5cb9-4da7-8588-678ba2537e0c-operator-scripts\") pod \"fa5682a3-5cb9-4da7-8588-678ba2537e0c\" (UID: \"fa5682a3-5cb9-4da7-8588-678ba2537e0c\") " Mar 16 16:30:35 crc kubenswrapper[5120]: I0316 16:30:35.123286 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/9565a662-ca77-4197-8894-6b9633e653fd-memcached-tls-certs\") pod \"9565a662-ca77-4197-8894-6b9633e653fd\" (UID: \"9565a662-ca77-4197-8894-6b9633e653fd\") " Mar 16 16:30:35 crc kubenswrapper[5120]: I0316 16:30:35.123597 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/fa5682a3-5cb9-4da7-8588-678ba2537e0c-kolla-config\") pod \"fa5682a3-5cb9-4da7-8588-678ba2537e0c\" (UID: \"fa5682a3-5cb9-4da7-8588-678ba2537e0c\") " Mar 16 16:30:35 crc kubenswrapper[5120]: I0316 16:30:35.123708 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fa5682a3-5cb9-4da7-8588-678ba2537e0c-combined-ca-bundle\") pod \"fa5682a3-5cb9-4da7-8588-678ba2537e0c\" (UID: \"fa5682a3-5cb9-4da7-8588-678ba2537e0c\") " Mar 16 16:30:35 crc kubenswrapper[5120]: I0316 16:30:35.123736 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-74ghc\" (UniqueName: \"kubernetes.io/projected/fa5682a3-5cb9-4da7-8588-678ba2537e0c-kube-api-access-74ghc\") pod \"fa5682a3-5cb9-4da7-8588-678ba2537e0c\" (UID: \"fa5682a3-5cb9-4da7-8588-678ba2537e0c\") " Mar 16 16:30:35 crc kubenswrapper[5120]: I0316 16:30:35.123802 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/9565a662-ca77-4197-8894-6b9633e653fd-kolla-config\") pod \"9565a662-ca77-4197-8894-6b9633e653fd\" (UID: \"9565a662-ca77-4197-8894-6b9633e653fd\") " Mar 16 16:30:35 crc kubenswrapper[5120]: I0316 16:30:35.124113 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fa5682a3-5cb9-4da7-8588-678ba2537e0c-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "fa5682a3-5cb9-4da7-8588-678ba2537e0c" (UID: "fa5682a3-5cb9-4da7-8588-678ba2537e0c"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:30:35 crc kubenswrapper[5120]: I0316 16:30:35.124372 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9565a662-ca77-4197-8894-6b9633e653fd-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "9565a662-ca77-4197-8894-6b9633e653fd" (UID: "9565a662-ca77-4197-8894-6b9633e653fd"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:30:35 crc kubenswrapper[5120]: I0316 16:30:35.124755 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fa5682a3-5cb9-4da7-8588-678ba2537e0c-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "fa5682a3-5cb9-4da7-8588-678ba2537e0c" (UID: "fa5682a3-5cb9-4da7-8588-678ba2537e0c"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:30:35 crc kubenswrapper[5120]: I0316 16:30:35.125220 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/9565a662-ca77-4197-8894-6b9633e653fd-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:35 crc kubenswrapper[5120]: I0316 16:30:35.125236 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/fa5682a3-5cb9-4da7-8588-678ba2537e0c-config-data-default\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:35 crc kubenswrapper[5120]: I0316 16:30:35.125247 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/fa5682a3-5cb9-4da7-8588-678ba2537e0c-config-data-generated\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:35 crc kubenswrapper[5120]: E0316 16:30:35.125250 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Mar 16 16:30:35 crc kubenswrapper[5120]: E0316 16:30:35.125328 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dbe6904f-2249-41c3-bb8a-a1b5817094c5-config-data podName:dbe6904f-2249-41c3-bb8a-a1b5817094c5 nodeName:}" failed. No retries permitted until 2026-03-16 16:30:39.125313461 +0000 UTC m=+3541.279245118 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/dbe6904f-2249-41c3-bb8a-a1b5817094c5-config-data") pod "rabbitmq-cell1-server-1" (UID: "dbe6904f-2249-41c3-bb8a-a1b5817094c5") : configmap "rabbitmq-cell1-config-data" not found Mar 16 16:30:35 crc kubenswrapper[5120]: I0316 16:30:35.125257 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/fa5682a3-5cb9-4da7-8588-678ba2537e0c-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:35 crc kubenswrapper[5120]: I0316 16:30:35.125358 5120 reconciler_common.go:299] "Volume detached for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/2c78e334-9857-4302-af64-dc9b0647ab41-nova-novncproxy-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:35 crc kubenswrapper[5120]: I0316 16:30:35.125382 5120 reconciler_common.go:299] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/fa5682a3-5cb9-4da7-8588-678ba2537e0c-kolla-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:35 crc kubenswrapper[5120]: I0316 16:30:35.125391 5120 reconciler_common.go:299] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/9565a662-ca77-4197-8894-6b9633e653fd-kolla-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:35 crc kubenswrapper[5120]: I0316 16:30:35.127808 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa5682a3-5cb9-4da7-8588-678ba2537e0c-kube-api-access-74ghc" (OuterVolumeSpecName: "kube-api-access-74ghc") pod "fa5682a3-5cb9-4da7-8588-678ba2537e0c" (UID: "fa5682a3-5cb9-4da7-8588-678ba2537e0c"). InnerVolumeSpecName "kube-api-access-74ghc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:30:35 crc kubenswrapper[5120]: I0316 16:30:35.130318 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9565a662-ca77-4197-8894-6b9633e653fd-kube-api-access-blk52" (OuterVolumeSpecName: "kube-api-access-blk52") pod "9565a662-ca77-4197-8894-6b9633e653fd" (UID: "9565a662-ca77-4197-8894-6b9633e653fd"). InnerVolumeSpecName "kube-api-access-blk52". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:30:35 crc kubenswrapper[5120]: I0316 16:30:35.133502 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage04-crc" (OuterVolumeSpecName: "mysql-db") pod "fa5682a3-5cb9-4da7-8588-678ba2537e0c" (UID: "fa5682a3-5cb9-4da7-8588-678ba2537e0c"). InnerVolumeSpecName "local-storage04-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:30:35 crc kubenswrapper[5120]: I0316 16:30:35.158869 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9565a662-ca77-4197-8894-6b9633e653fd-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "9565a662-ca77-4197-8894-6b9633e653fd" (UID: "9565a662-ca77-4197-8894-6b9633e653fd"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:30:35 crc kubenswrapper[5120]: I0316 16:30:35.160893 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa5682a3-5cb9-4da7-8588-678ba2537e0c-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "fa5682a3-5cb9-4da7-8588-678ba2537e0c" (UID: "fa5682a3-5cb9-4da7-8588-678ba2537e0c"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:30:35 crc kubenswrapper[5120]: I0316 16:30:35.174799 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9565a662-ca77-4197-8894-6b9633e653fd-memcached-tls-certs" (OuterVolumeSpecName: "memcached-tls-certs") pod "9565a662-ca77-4197-8894-6b9633e653fd" (UID: "9565a662-ca77-4197-8894-6b9633e653fd"). InnerVolumeSpecName "memcached-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:30:35 crc kubenswrapper[5120]: I0316 16:30:35.179123 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa5682a3-5cb9-4da7-8588-678ba2537e0c-galera-tls-certs" (OuterVolumeSpecName: "galera-tls-certs") pod "fa5682a3-5cb9-4da7-8588-678ba2537e0c" (UID: "fa5682a3-5cb9-4da7-8588-678ba2537e0c"). InnerVolumeSpecName "galera-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:30:35 crc kubenswrapper[5120]: I0316 16:30:35.228573 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") on node \"crc\" " Mar 16 16:30:35 crc kubenswrapper[5120]: I0316 16:30:35.228621 5120 reconciler_common.go:299] "Volume detached for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/fa5682a3-5cb9-4da7-8588-678ba2537e0c-galera-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:35 crc kubenswrapper[5120]: I0316 16:30:35.228637 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9565a662-ca77-4197-8894-6b9633e653fd-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:35 crc kubenswrapper[5120]: I0316 16:30:35.228650 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-blk52\" (UniqueName: \"kubernetes.io/projected/9565a662-ca77-4197-8894-6b9633e653fd-kube-api-access-blk52\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:35 crc kubenswrapper[5120]: I0316 16:30:35.228663 5120 reconciler_common.go:299] "Volume detached for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/9565a662-ca77-4197-8894-6b9633e653fd-memcached-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:35 crc kubenswrapper[5120]: I0316 16:30:35.228675 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fa5682a3-5cb9-4da7-8588-678ba2537e0c-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:35 crc kubenswrapper[5120]: I0316 16:30:35.228689 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-74ghc\" (UniqueName: \"kubernetes.io/projected/fa5682a3-5cb9-4da7-8588-678ba2537e0c-kube-api-access-74ghc\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:35 crc kubenswrapper[5120]: I0316 16:30:35.253924 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage04-crc" (UniqueName: "kubernetes.io/local-volume/local-storage04-crc") on node "crc" Mar 16 16:30:35 crc kubenswrapper[5120]: I0316 16:30:35.272111 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:30:35 crc kubenswrapper[5120]: I0316 16:30:35.279106 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"2c78e334-9857-4302-af64-dc9b0647ab41","Type":"ContainerDied","Data":"6f808a18df0cdf943e2a22b447f40f15fd9ea5b2399c91a18e0aee52f8b38286"} Mar 16 16:30:35 crc kubenswrapper[5120]: I0316 16:30:35.279156 5120 scope.go:117] "RemoveContainer" containerID="1a869b8a440dafdf19113e6a1f3a4d154f04788c22a46805222bf6dc1a4404aa" Mar 16 16:30:35 crc kubenswrapper[5120]: I0316 16:30:35.283046 5120 generic.go:358] "Generic (PLEG): container finished" podID="fa5682a3-5cb9-4da7-8588-678ba2537e0c" containerID="641f52ce7e26f90ddbe40cbed9d8e229e77faf2ef6ad82710e0ada5e487095d8" exitCode=0 Mar 16 16:30:35 crc kubenswrapper[5120]: I0316 16:30:35.283124 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-2" Mar 16 16:30:35 crc kubenswrapper[5120]: I0316 16:30:35.283144 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-2" event={"ID":"fa5682a3-5cb9-4da7-8588-678ba2537e0c","Type":"ContainerDied","Data":"641f52ce7e26f90ddbe40cbed9d8e229e77faf2ef6ad82710e0ada5e487095d8"} Mar 16 16:30:35 crc kubenswrapper[5120]: I0316 16:30:35.283182 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-2" event={"ID":"fa5682a3-5cb9-4da7-8588-678ba2537e0c","Type":"ContainerDied","Data":"49d0bfef2e42359f0642ed0881fe799e08a6b74395644aa5f58044dcf985ba14"} Mar 16 16:30:35 crc kubenswrapper[5120]: I0316 16:30:35.286129 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-75575cf5bd-xrtzd" event={"ID":"7b46f8b0-c3f2-44ec-88e2-8d65566ae937","Type":"ContainerDied","Data":"9b2d6a760ea1f18322fd2d4ee4644129e94b037792120b0295581b65b943ff83"} Mar 16 16:30:35 crc kubenswrapper[5120]: I0316 16:30:35.287439 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-8649c995c9-lzq96" event={"ID":"bbd47432-e63f-4ba0-8daa-edfb3d2b0af9","Type":"ContainerDied","Data":"8c06713e1c2327f717627562e92208b87909fda67c0d8fabd8687853e1298c1b"} Mar 16 16:30:35 crc kubenswrapper[5120]: I0316 16:30:35.291887 5120 generic.go:358] "Generic (PLEG): container finished" podID="9943d2d4-e26d-4c91-942e-a6d788ac8c7e" containerID="acabcc15081b211362ce26edef4be474972cad4d6622576162ea693ce90f39ee" exitCode=1 Mar 16 16:30:35 crc kubenswrapper[5120]: I0316 16:30:35.291977 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-gmjzc" event={"ID":"9943d2d4-e26d-4c91-942e-a6d788ac8c7e","Type":"ContainerDied","Data":"acabcc15081b211362ce26edef4be474972cad4d6622576162ea693ce90f39ee"} Mar 16 16:30:35 crc kubenswrapper[5120]: I0316 16:30:35.296031 5120 generic.go:358] "Generic (PLEG): container finished" podID="9565a662-ca77-4197-8894-6b9633e653fd" containerID="ceec1936c48e3f6be7fd6579209ab2c0807f3a2ee9058527f618607ccce149d6" exitCode=0 Mar 16 16:30:35 crc kubenswrapper[5120]: I0316 16:30:35.296368 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Mar 16 16:30:35 crc kubenswrapper[5120]: I0316 16:30:35.296420 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"9565a662-ca77-4197-8894-6b9633e653fd","Type":"ContainerDied","Data":"ceec1936c48e3f6be7fd6579209ab2c0807f3a2ee9058527f618607ccce149d6"} Mar 16 16:30:35 crc kubenswrapper[5120]: I0316 16:30:35.296457 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"9565a662-ca77-4197-8894-6b9633e653fd","Type":"ContainerDied","Data":"049c3e0efcdfef6f97e34b50531cbee78cd56c5f741539b0aa702cf2c69dd5e7"} Mar 16 16:30:35 crc kubenswrapper[5120]: I0316 16:30:35.299866 5120 generic.go:358] "Generic (PLEG): container finished" podID="09b5d645-c91e-4bff-8b73-0651cf8397b6" containerID="1b03fd5223e0d38a3a8f75a156ae3ce743fc285db2d1a7a8a71dc67ce051ce5b" exitCode=0 Mar 16 16:30:35 crc kubenswrapper[5120]: I0316 16:30:35.299962 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-jb5ks" event={"ID":"09b5d645-c91e-4bff-8b73-0651cf8397b6","Type":"ContainerDied","Data":"1b03fd5223e0d38a3a8f75a156ae3ce743fc285db2d1a7a8a71dc67ce051ce5b"} Mar 16 16:30:35 crc kubenswrapper[5120]: I0316 16:30:35.299978 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-jb5ks" event={"ID":"09b5d645-c91e-4bff-8b73-0651cf8397b6","Type":"ContainerStarted","Data":"a6325ca1a07acbbac4edd76d49a19ed6315d1cb8f0669f40628ab10e0712e8c4"} Mar 16 16:30:35 crc kubenswrapper[5120]: I0316 16:30:35.302669 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-8f87-account-create-update-kgjw8" Mar 16 16:30:35 crc kubenswrapper[5120]: I0316 16:30:35.306003 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-8f87-account-create-update-kgjw8" event={"ID":"b62b0167-9419-454f-a1c2-78d1354baeb2","Type":"ContainerDied","Data":"ef36a80208d53d97bfdb34f21d2498c4ac721efc16229da0823ebb58d8ad1696"} Mar 16 16:30:35 crc kubenswrapper[5120]: I0316 16:30:35.306026 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-aceb-account-create-update-h7jsn" Mar 16 16:30:35 crc kubenswrapper[5120]: I0316 16:30:35.338724 5120 scope.go:117] "RemoveContainer" containerID="641f52ce7e26f90ddbe40cbed9d8e229e77faf2ef6ad82710e0ada5e487095d8" Mar 16 16:30:35 crc kubenswrapper[5120]: I0316 16:30:35.338906 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-aceb-account-create-update-h7jsn" Mar 16 16:30:35 crc kubenswrapper[5120]: E0316 16:30:35.343327 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/barbican-config-data: secret "barbican-config-data" not found Mar 16 16:30:35 crc kubenswrapper[5120]: E0316 16:30:35.344370 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9cb535e7-55cc-4b9d-911c-58f8ed50bee6-config-data podName:9cb535e7-55cc-4b9d-911c-58f8ed50bee6 nodeName:}" failed. No retries permitted until 2026-03-16 16:30:39.344346469 +0000 UTC m=+3541.498278126 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/secret/9cb535e7-55cc-4b9d-911c-58f8ed50bee6-config-data") pod "barbican-keystone-listener-566c6b7f4b-gjml4" (UID: "9cb535e7-55cc-4b9d-911c-58f8ed50bee6") : secret "barbican-config-data" not found Mar 16 16:30:35 crc kubenswrapper[5120]: I0316 16:30:35.345137 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:35 crc kubenswrapper[5120]: E0316 16:30:35.345247 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/barbican-keystone-listener-config-data: secret "barbican-keystone-listener-config-data" not found Mar 16 16:30:35 crc kubenswrapper[5120]: E0316 16:30:35.345337 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9cb535e7-55cc-4b9d-911c-58f8ed50bee6-config-data-custom podName:9cb535e7-55cc-4b9d-911c-58f8ed50bee6 nodeName:}" failed. No retries permitted until 2026-03-16 16:30:39.345326516 +0000 UTC m=+3541.499258173 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "config-data-custom" (UniqueName: "kubernetes.io/secret/9cb535e7-55cc-4b9d-911c-58f8ed50bee6-config-data-custom") pod "barbican-keystone-listener-566c6b7f4b-gjml4" (UID: "9cb535e7-55cc-4b9d-911c-58f8ed50bee6") : secret "barbican-keystone-listener-config-data" not found Mar 16 16:30:35 crc kubenswrapper[5120]: I0316 16:30:35.380845 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:30:35 crc kubenswrapper[5120]: I0316 16:30:35.387674 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:30:35 crc kubenswrapper[5120]: I0316 16:30:35.395880 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-2"] Mar 16 16:30:35 crc kubenswrapper[5120]: I0316 16:30:35.403599 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-2"] Mar 16 16:30:35 crc kubenswrapper[5120]: I0316 16:30:35.413220 5120 scope.go:117] "RemoveContainer" containerID="4c01701e23712013375dc91b22a0a1b617bf6e48412365659bdeded27e684262" Mar 16 16:30:35 crc kubenswrapper[5120]: I0316 16:30:35.413364 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/openstack-cell1-galera-1" podUID="8690a5a2-3341-452e-8364-2e5e4072c192" containerName="galera" containerID="cri-o://6e6cc6827a75b6a7267a1f48a96bcedc87a117cb4353ef6624dee5fe5204d958" gracePeriod=28 Mar 16 16:30:35 crc kubenswrapper[5120]: E0316 16:30:35.476628 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="1c7b11899133931bd406f6c19c7e46ecd6ae5021b5ed32c51931ad65ff554972" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:30:35 crc kubenswrapper[5120]: E0316 16:30:35.482465 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="1c7b11899133931bd406f6c19c7e46ecd6ae5021b5ed32c51931ad65ff554972" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:30:35 crc kubenswrapper[5120]: E0316 16:30:35.484971 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="1c7b11899133931bd406f6c19c7e46ecd6ae5021b5ed32c51931ad65ff554972" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:30:35 crc kubenswrapper[5120]: E0316 16:30:35.485016 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="7e45bb7a-9982-458f-80b5-60541c2d2daf" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 16:30:35 crc kubenswrapper[5120]: I0316 16:30:35.583611 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-8f87-account-create-update-kgjw8"] Mar 16 16:30:35 crc kubenswrapper[5120]: I0316 16:30:35.616012 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-8f87-account-create-update-kgjw8"] Mar 16 16:30:35 crc kubenswrapper[5120]: I0316 16:30:35.622169 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 16:30:35 crc kubenswrapper[5120]: I0316 16:30:35.628472 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 16:30:35 crc kubenswrapper[5120]: I0316 16:30:35.737559 5120 scope.go:117] "RemoveContainer" containerID="641f52ce7e26f90ddbe40cbed9d8e229e77faf2ef6ad82710e0ada5e487095d8" Mar 16 16:30:35 crc kubenswrapper[5120]: E0316 16:30:35.750349 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"641f52ce7e26f90ddbe40cbed9d8e229e77faf2ef6ad82710e0ada5e487095d8\": container with ID starting with 641f52ce7e26f90ddbe40cbed9d8e229e77faf2ef6ad82710e0ada5e487095d8 not found: ID does not exist" containerID="641f52ce7e26f90ddbe40cbed9d8e229e77faf2ef6ad82710e0ada5e487095d8" Mar 16 16:30:35 crc kubenswrapper[5120]: I0316 16:30:35.750395 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"641f52ce7e26f90ddbe40cbed9d8e229e77faf2ef6ad82710e0ada5e487095d8"} err="failed to get container status \"641f52ce7e26f90ddbe40cbed9d8e229e77faf2ef6ad82710e0ada5e487095d8\": rpc error: code = NotFound desc = could not find container \"641f52ce7e26f90ddbe40cbed9d8e229e77faf2ef6ad82710e0ada5e487095d8\": container with ID starting with 641f52ce7e26f90ddbe40cbed9d8e229e77faf2ef6ad82710e0ada5e487095d8 not found: ID does not exist" Mar 16 16:30:35 crc kubenswrapper[5120]: I0316 16:30:35.750429 5120 scope.go:117] "RemoveContainer" containerID="4c01701e23712013375dc91b22a0a1b617bf6e48412365659bdeded27e684262" Mar 16 16:30:35 crc kubenswrapper[5120]: E0316 16:30:35.750814 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c01701e23712013375dc91b22a0a1b617bf6e48412365659bdeded27e684262\": container with ID starting with 4c01701e23712013375dc91b22a0a1b617bf6e48412365659bdeded27e684262 not found: ID does not exist" containerID="4c01701e23712013375dc91b22a0a1b617bf6e48412365659bdeded27e684262" Mar 16 16:30:35 crc kubenswrapper[5120]: I0316 16:30:35.750839 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c01701e23712013375dc91b22a0a1b617bf6e48412365659bdeded27e684262"} err="failed to get container status \"4c01701e23712013375dc91b22a0a1b617bf6e48412365659bdeded27e684262\": rpc error: code = NotFound desc = could not find container \"4c01701e23712013375dc91b22a0a1b617bf6e48412365659bdeded27e684262\": container with ID starting with 4c01701e23712013375dc91b22a0a1b617bf6e48412365659bdeded27e684262 not found: ID does not exist" Mar 16 16:30:35 crc kubenswrapper[5120]: I0316 16:30:35.750857 5120 scope.go:117] "RemoveContainer" containerID="c0bc7e279a64621a39a3a9389a1126717ff380d3894cb0c8f3ebb89da4074567" Mar 16 16:30:35 crc kubenswrapper[5120]: I0316 16:30:35.803394 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-gmjzc" Mar 16 16:30:35 crc kubenswrapper[5120]: I0316 16:30:35.837404 5120 scope.go:117] "RemoveContainer" containerID="ceec1936c48e3f6be7fd6579209ab2c0807f3a2ee9058527f618607ccce149d6" Mar 16 16:30:35 crc kubenswrapper[5120]: I0316 16:30:35.874691 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9943d2d4-e26d-4c91-942e-a6d788ac8c7e-operator-scripts\") pod \"9943d2d4-e26d-4c91-942e-a6d788ac8c7e\" (UID: \"9943d2d4-e26d-4c91-942e-a6d788ac8c7e\") " Mar 16 16:30:35 crc kubenswrapper[5120]: I0316 16:30:35.875404 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gk7tz\" (UniqueName: \"kubernetes.io/projected/9943d2d4-e26d-4c91-942e-a6d788ac8c7e-kube-api-access-gk7tz\") pod \"9943d2d4-e26d-4c91-942e-a6d788ac8c7e\" (UID: \"9943d2d4-e26d-4c91-942e-a6d788ac8c7e\") " Mar 16 16:30:35 crc kubenswrapper[5120]: I0316 16:30:35.876663 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9943d2d4-e26d-4c91-942e-a6d788ac8c7e-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "9943d2d4-e26d-4c91-942e-a6d788ac8c7e" (UID: "9943d2d4-e26d-4c91-942e-a6d788ac8c7e"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:30:35 crc kubenswrapper[5120]: E0316 16:30:35.876740 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Mar 16 16:30:35 crc kubenswrapper[5120]: E0316 16:30:35.876852 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7d4aa5b5-78e4-464e-bee0-18da0561de5d-operator-scripts podName:7d4aa5b5-78e4-464e-bee0-18da0561de5d nodeName:}" failed. No retries permitted until 2026-03-16 16:30:37.876832212 +0000 UTC m=+3540.030763869 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/7d4aa5b5-78e4-464e-bee0-18da0561de5d-operator-scripts") pod "neutron-500e-account-create-update-wd7jx" (UID: "7d4aa5b5-78e4-464e-bee0-18da0561de5d") : configmap "openstack-scripts" not found Mar 16 16:30:35 crc kubenswrapper[5120]: I0316 16:30:35.882972 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9943d2d4-e26d-4c91-942e-a6d788ac8c7e-kube-api-access-gk7tz" (OuterVolumeSpecName: "kube-api-access-gk7tz") pod "9943d2d4-e26d-4c91-942e-a6d788ac8c7e" (UID: "9943d2d4-e26d-4c91-942e-a6d788ac8c7e"). InnerVolumeSpecName "kube-api-access-gk7tz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:30:35 crc kubenswrapper[5120]: I0316 16:30:35.910917 5120 scope.go:117] "RemoveContainer" containerID="ceec1936c48e3f6be7fd6579209ab2c0807f3a2ee9058527f618607ccce149d6" Mar 16 16:30:35 crc kubenswrapper[5120]: E0316 16:30:35.911695 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ceec1936c48e3f6be7fd6579209ab2c0807f3a2ee9058527f618607ccce149d6\": container with ID starting with ceec1936c48e3f6be7fd6579209ab2c0807f3a2ee9058527f618607ccce149d6 not found: ID does not exist" containerID="ceec1936c48e3f6be7fd6579209ab2c0807f3a2ee9058527f618607ccce149d6" Mar 16 16:30:35 crc kubenswrapper[5120]: I0316 16:30:35.911726 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ceec1936c48e3f6be7fd6579209ab2c0807f3a2ee9058527f618607ccce149d6"} err="failed to get container status \"ceec1936c48e3f6be7fd6579209ab2c0807f3a2ee9058527f618607ccce149d6\": rpc error: code = NotFound desc = could not find container \"ceec1936c48e3f6be7fd6579209ab2c0807f3a2ee9058527f618607ccce149d6\": container with ID starting with ceec1936c48e3f6be7fd6579209ab2c0807f3a2ee9058527f618607ccce149d6 not found: ID does not exist" Mar 16 16:30:35 crc kubenswrapper[5120]: I0316 16:30:35.934919 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-821f-account-create-update-8ph6s" Mar 16 16:30:35 crc kubenswrapper[5120]: I0316 16:30:35.936632 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-5b46-account-create-update-llf4v" Mar 16 16:30:35 crc kubenswrapper[5120]: I0316 16:30:35.950709 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-500e-account-create-update-wd7jx" Mar 16 16:30:35 crc kubenswrapper[5120]: I0316 16:30:35.979428 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gk7tz\" (UniqueName: \"kubernetes.io/projected/9943d2d4-e26d-4c91-942e-a6d788ac8c7e-kube-api-access-gk7tz\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:35 crc kubenswrapper[5120]: I0316 16:30:35.979459 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9943d2d4-e26d-4c91-942e-a6d788ac8c7e-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:35 crc kubenswrapper[5120]: E0316 16:30:35.979515 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Mar 16 16:30:35 crc kubenswrapper[5120]: E0316 16:30:35.979559 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0c04a9e3-0a3b-4895-8703-bb958c3000fd-operator-scripts podName:0c04a9e3-0a3b-4895-8703-bb958c3000fd nodeName:}" failed. No retries permitted until 2026-03-16 16:30:37.97954544 +0000 UTC m=+3540.133477097 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/0c04a9e3-0a3b-4895-8703-bb958c3000fd-operator-scripts") pod "placement-821f-account-create-update-8ph6s" (UID: "0c04a9e3-0a3b-4895-8703-bb958c3000fd") : configmap "openstack-scripts" not found Mar 16 16:30:35 crc kubenswrapper[5120]: E0316 16:30:35.979865 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-cell1-scripts: configmap "openstack-cell1-scripts" not found Mar 16 16:30:35 crc kubenswrapper[5120]: E0316 16:30:35.979899 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/29ef1c2d-283b-421f-8631-ada83f6ea799-operator-scripts podName:29ef1c2d-283b-421f-8631-ada83f6ea799 nodeName:}" failed. No retries permitted until 2026-03-16 16:30:37.979890209 +0000 UTC m=+3540.133821866 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/29ef1c2d-283b-421f-8631-ada83f6ea799-operator-scripts") pod "nova-cell1-5b46-account-create-update-llf4v" (UID: "29ef1c2d-283b-421f-8631-ada83f6ea799") : configmap "openstack-cell1-scripts" not found Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.078085 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.080829 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nscjg\" (UniqueName: \"kubernetes.io/projected/7d4aa5b5-78e4-464e-bee0-18da0561de5d-kube-api-access-nscjg\") pod \"7d4aa5b5-78e4-464e-bee0-18da0561de5d\" (UID: \"7d4aa5b5-78e4-464e-bee0-18da0561de5d\") " Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.081003 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/29ef1c2d-283b-421f-8631-ada83f6ea799-operator-scripts\") pod \"29ef1c2d-283b-421f-8631-ada83f6ea799\" (UID: \"29ef1c2d-283b-421f-8631-ada83f6ea799\") " Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.081160 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0c04a9e3-0a3b-4895-8703-bb958c3000fd-operator-scripts\") pod \"0c04a9e3-0a3b-4895-8703-bb958c3000fd\" (UID: \"0c04a9e3-0a3b-4895-8703-bb958c3000fd\") " Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.081286 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-46gvh\" (UniqueName: \"kubernetes.io/projected/29ef1c2d-283b-421f-8631-ada83f6ea799-kube-api-access-46gvh\") pod \"29ef1c2d-283b-421f-8631-ada83f6ea799\" (UID: \"29ef1c2d-283b-421f-8631-ada83f6ea799\") " Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.081426 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/29ef1c2d-283b-421f-8631-ada83f6ea799-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "29ef1c2d-283b-421f-8631-ada83f6ea799" (UID: "29ef1c2d-283b-421f-8631-ada83f6ea799"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.081571 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/7d4aa5b5-78e4-464e-bee0-18da0561de5d-operator-scripts\") pod \"7d4aa5b5-78e4-464e-bee0-18da0561de5d\" (UID: \"7d4aa5b5-78e4-464e-bee0-18da0561de5d\") " Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.081651 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s8gzm\" (UniqueName: \"kubernetes.io/projected/0c04a9e3-0a3b-4895-8703-bb958c3000fd-kube-api-access-s8gzm\") pod \"0c04a9e3-0a3b-4895-8703-bb958c3000fd\" (UID: \"0c04a9e3-0a3b-4895-8703-bb958c3000fd\") " Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.082150 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c04a9e3-0a3b-4895-8703-bb958c3000fd-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "0c04a9e3-0a3b-4895-8703-bb958c3000fd" (UID: "0c04a9e3-0a3b-4895-8703-bb958c3000fd"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.082622 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d4aa5b5-78e4-464e-bee0-18da0561de5d-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "7d4aa5b5-78e4-464e-bee0-18da0561de5d" (UID: "7d4aa5b5-78e4-464e-bee0-18da0561de5d"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.082951 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/7d4aa5b5-78e4-464e-bee0-18da0561de5d-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.082963 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/29ef1c2d-283b-421f-8631-ada83f6ea799-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.082974 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0c04a9e3-0a3b-4895-8703-bb958c3000fd-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.084875 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d4aa5b5-78e4-464e-bee0-18da0561de5d-kube-api-access-nscjg" (OuterVolumeSpecName: "kube-api-access-nscjg") pod "7d4aa5b5-78e4-464e-bee0-18da0561de5d" (UID: "7d4aa5b5-78e4-464e-bee0-18da0561de5d"). InnerVolumeSpecName "kube-api-access-nscjg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.084985 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29ef1c2d-283b-421f-8631-ada83f6ea799-kube-api-access-46gvh" (OuterVolumeSpecName: "kube-api-access-46gvh") pod "29ef1c2d-283b-421f-8631-ada83f6ea799" (UID: "29ef1c2d-283b-421f-8631-ada83f6ea799"). InnerVolumeSpecName "kube-api-access-46gvh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.086677 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c04a9e3-0a3b-4895-8703-bb958c3000fd-kube-api-access-s8gzm" (OuterVolumeSpecName: "kube-api-access-s8gzm") pod "0c04a9e3-0a3b-4895-8703-bb958c3000fd" (UID: "0c04a9e3-0a3b-4895-8703-bb958c3000fd"). InnerVolumeSpecName "kube-api-access-s8gzm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.107991 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.184477 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ed1bcd44-0ed6-4cb4-a735-798e033c8b08-combined-ca-bundle\") pod \"ed1bcd44-0ed6-4cb4-a735-798e033c8b08\" (UID: \"ed1bcd44-0ed6-4cb4-a735-798e033c8b08\") " Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.184531 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kst4j\" (UniqueName: \"kubernetes.io/projected/ed1bcd44-0ed6-4cb4-a735-798e033c8b08-kube-api-access-kst4j\") pod \"ed1bcd44-0ed6-4cb4-a735-798e033c8b08\" (UID: \"ed1bcd44-0ed6-4cb4-a735-798e033c8b08\") " Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.184611 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ed1bcd44-0ed6-4cb4-a735-798e033c8b08-logs\") pod \"ed1bcd44-0ed6-4cb4-a735-798e033c8b08\" (UID: \"ed1bcd44-0ed6-4cb4-a735-798e033c8b08\") " Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.184647 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ed1bcd44-0ed6-4cb4-a735-798e033c8b08-scripts\") pod \"ed1bcd44-0ed6-4cb4-a735-798e033c8b08\" (UID: \"ed1bcd44-0ed6-4cb4-a735-798e033c8b08\") " Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.184784 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"cecaa51b-004f-4941-99e2-23272d052fa7\" (UID: \"cecaa51b-004f-4941-99e2-23272d052fa7\") " Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.184859 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/cecaa51b-004f-4941-99e2-23272d052fa7-public-tls-certs\") pod \"cecaa51b-004f-4941-99e2-23272d052fa7\" (UID: \"cecaa51b-004f-4941-99e2-23272d052fa7\") " Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.184890 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/cecaa51b-004f-4941-99e2-23272d052fa7-httpd-run\") pod \"cecaa51b-004f-4941-99e2-23272d052fa7\" (UID: \"cecaa51b-004f-4941-99e2-23272d052fa7\") " Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.184908 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cecaa51b-004f-4941-99e2-23272d052fa7-combined-ca-bundle\") pod \"cecaa51b-004f-4941-99e2-23272d052fa7\" (UID: \"cecaa51b-004f-4941-99e2-23272d052fa7\") " Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.185070 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"ed1bcd44-0ed6-4cb4-a735-798e033c8b08\" (UID: \"ed1bcd44-0ed6-4cb4-a735-798e033c8b08\") " Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.185190 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cecaa51b-004f-4941-99e2-23272d052fa7-config-data\") pod \"cecaa51b-004f-4941-99e2-23272d052fa7\" (UID: \"cecaa51b-004f-4941-99e2-23272d052fa7\") " Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.185243 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/ed1bcd44-0ed6-4cb4-a735-798e033c8b08-internal-tls-certs\") pod \"ed1bcd44-0ed6-4cb4-a735-798e033c8b08\" (UID: \"ed1bcd44-0ed6-4cb4-a735-798e033c8b08\") " Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.185267 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ed1bcd44-0ed6-4cb4-a735-798e033c8b08-config-data\") pod \"ed1bcd44-0ed6-4cb4-a735-798e033c8b08\" (UID: \"ed1bcd44-0ed6-4cb4-a735-798e033c8b08\") " Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.185360 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/cecaa51b-004f-4941-99e2-23272d052fa7-logs\") pod \"cecaa51b-004f-4941-99e2-23272d052fa7\" (UID: \"cecaa51b-004f-4941-99e2-23272d052fa7\") " Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.185393 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/cecaa51b-004f-4941-99e2-23272d052fa7-scripts\") pod \"cecaa51b-004f-4941-99e2-23272d052fa7\" (UID: \"cecaa51b-004f-4941-99e2-23272d052fa7\") " Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.185427 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/ed1bcd44-0ed6-4cb4-a735-798e033c8b08-httpd-run\") pod \"ed1bcd44-0ed6-4cb4-a735-798e033c8b08\" (UID: \"ed1bcd44-0ed6-4cb4-a735-798e033c8b08\") " Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.185446 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c72nf\" (UniqueName: \"kubernetes.io/projected/cecaa51b-004f-4941-99e2-23272d052fa7-kube-api-access-c72nf\") pod \"cecaa51b-004f-4941-99e2-23272d052fa7\" (UID: \"cecaa51b-004f-4941-99e2-23272d052fa7\") " Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.186188 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-46gvh\" (UniqueName: \"kubernetes.io/projected/29ef1c2d-283b-421f-8631-ada83f6ea799-kube-api-access-46gvh\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.186207 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s8gzm\" (UniqueName: \"kubernetes.io/projected/0c04a9e3-0a3b-4895-8703-bb958c3000fd-kube-api-access-s8gzm\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.186219 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nscjg\" (UniqueName: \"kubernetes.io/projected/7d4aa5b5-78e4-464e-bee0-18da0561de5d-kube-api-access-nscjg\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.188398 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cecaa51b-004f-4941-99e2-23272d052fa7-logs" (OuterVolumeSpecName: "logs") pod "cecaa51b-004f-4941-99e2-23272d052fa7" (UID: "cecaa51b-004f-4941-99e2-23272d052fa7"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.188720 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cecaa51b-004f-4941-99e2-23272d052fa7-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "cecaa51b-004f-4941-99e2-23272d052fa7" (UID: "cecaa51b-004f-4941-99e2-23272d052fa7"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.188935 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed1bcd44-0ed6-4cb4-a735-798e033c8b08-logs" (OuterVolumeSpecName: "logs") pod "ed1bcd44-0ed6-4cb4-a735-798e033c8b08" (UID: "ed1bcd44-0ed6-4cb4-a735-798e033c8b08"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.191088 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed1bcd44-0ed6-4cb4-a735-798e033c8b08-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "ed1bcd44-0ed6-4cb4-a735-798e033c8b08" (UID: "ed1bcd44-0ed6-4cb4-a735-798e033c8b08"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.195683 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed1bcd44-0ed6-4cb4-a735-798e033c8b08-kube-api-access-kst4j" (OuterVolumeSpecName: "kube-api-access-kst4j") pod "ed1bcd44-0ed6-4cb4-a735-798e033c8b08" (UID: "ed1bcd44-0ed6-4cb4-a735-798e033c8b08"). InnerVolumeSpecName "kube-api-access-kst4j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.197320 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cecaa51b-004f-4941-99e2-23272d052fa7-scripts" (OuterVolumeSpecName: "scripts") pod "cecaa51b-004f-4941-99e2-23272d052fa7" (UID: "cecaa51b-004f-4941-99e2-23272d052fa7"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.198528 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed1bcd44-0ed6-4cb4-a735-798e033c8b08-scripts" (OuterVolumeSpecName: "scripts") pod "ed1bcd44-0ed6-4cb4-a735-798e033c8b08" (UID: "ed1bcd44-0ed6-4cb4-a735-798e033c8b08"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.202016 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cecaa51b-004f-4941-99e2-23272d052fa7-kube-api-access-c72nf" (OuterVolumeSpecName: "kube-api-access-c72nf") pod "cecaa51b-004f-4941-99e2-23272d052fa7" (UID: "cecaa51b-004f-4941-99e2-23272d052fa7"). InnerVolumeSpecName "kube-api-access-c72nf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.206307 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage03-crc" (OuterVolumeSpecName: "glance") pod "ed1bcd44-0ed6-4cb4-a735-798e033c8b08" (UID: "ed1bcd44-0ed6-4cb4-a735-798e033c8b08"). InnerVolumeSpecName "local-storage03-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.218067 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage20-crc" (OuterVolumeSpecName: "glance") pod "cecaa51b-004f-4941-99e2-23272d052fa7" (UID: "cecaa51b-004f-4941-99e2-23272d052fa7"). InnerVolumeSpecName "local-storage20-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.219690 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-76cb6cf57b-j7csd" podUID="3253648c-08a0-4d00-87e2-121fe9240d23" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.1.215:9311/healthcheck\": read tcp 10.217.0.2:37950->10.217.1.215:9311: read: connection reset by peer" Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.225425 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cecaa51b-004f-4941-99e2-23272d052fa7-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "cecaa51b-004f-4941-99e2-23272d052fa7" (UID: "cecaa51b-004f-4941-99e2-23272d052fa7"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:30:36 crc kubenswrapper[5120]: E0316 16:30:36.268563 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cecaa51b-004f-4941-99e2-23272d052fa7-public-tls-certs podName:cecaa51b-004f-4941-99e2-23272d052fa7 nodeName:}" failed. No retries permitted until 2026-03-16 16:30:36.768511488 +0000 UTC m=+3538.922443145 (durationBeforeRetry 500ms). Error: error cleaning subPath mounts for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/cecaa51b-004f-4941-99e2-23272d052fa7-public-tls-certs") pod "cecaa51b-004f-4941-99e2-23272d052fa7" (UID: "cecaa51b-004f-4941-99e2-23272d052fa7") : error deleting /var/lib/kubelet/pods/cecaa51b-004f-4941-99e2-23272d052fa7/volume-subpaths: remove /var/lib/kubelet/pods/cecaa51b-004f-4941-99e2-23272d052fa7/volume-subpaths: no such file or directory Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.288223 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/cecaa51b-004f-4941-99e2-23272d052fa7-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.288256 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/cecaa51b-004f-4941-99e2-23272d052fa7-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.288264 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/ed1bcd44-0ed6-4cb4-a735-798e033c8b08-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.288274 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c72nf\" (UniqueName: \"kubernetes.io/projected/cecaa51b-004f-4941-99e2-23272d052fa7-kube-api-access-c72nf\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.288283 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kst4j\" (UniqueName: \"kubernetes.io/projected/ed1bcd44-0ed6-4cb4-a735-798e033c8b08-kube-api-access-kst4j\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.288291 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ed1bcd44-0ed6-4cb4-a735-798e033c8b08-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.288299 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ed1bcd44-0ed6-4cb4-a735-798e033c8b08-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.288323 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") on node \"crc\" " Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.288333 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/cecaa51b-004f-4941-99e2-23272d052fa7-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.288343 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cecaa51b-004f-4941-99e2-23272d052fa7-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.288357 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") on node \"crc\" " Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.331079 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed1bcd44-0ed6-4cb4-a735-798e033c8b08-config-data" (OuterVolumeSpecName: "config-data") pod "ed1bcd44-0ed6-4cb4-a735-798e033c8b08" (UID: "ed1bcd44-0ed6-4cb4-a735-798e033c8b08"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.331195 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cecaa51b-004f-4941-99e2-23272d052fa7-config-data" (OuterVolumeSpecName: "config-data") pod "cecaa51b-004f-4941-99e2-23272d052fa7" (UID: "cecaa51b-004f-4941-99e2-23272d052fa7"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.331586 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/openstack-galera-1" podUID="fdc6ab64-e478-46f4-8e4b-6bf2e4460d91" containerName="galera" containerID="cri-o://22bcc82ce48237f9410a024ede2e8c26cf4bb41d79f0bcc346c2026e82f50c35" gracePeriod=28 Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.334500 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed1bcd44-0ed6-4cb4-a735-798e033c8b08-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ed1bcd44-0ed6-4cb4-a735-798e033c8b08" (UID: "ed1bcd44-0ed6-4cb4-a735-798e033c8b08"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.335148 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed1bcd44-0ed6-4cb4-a735-798e033c8b08-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "ed1bcd44-0ed6-4cb4-a735-798e033c8b08" (UID: "ed1bcd44-0ed6-4cb4-a735-798e033c8b08"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.361357 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage20-crc" (UniqueName: "kubernetes.io/local-volume/local-storage20-crc") on node "crc" Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.365497 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage03-crc" (UniqueName: "kubernetes.io/local-volume/local-storage03-crc") on node "crc" Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.405877 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.405910 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.405920 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cecaa51b-004f-4941-99e2-23272d052fa7-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.405932 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/ed1bcd44-0ed6-4cb4-a735-798e033c8b08-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.405940 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ed1bcd44-0ed6-4cb4-a735-798e033c8b08-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.405949 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ed1bcd44-0ed6-4cb4-a735-798e033c8b08-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.407172 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-500e-account-create-update-wd7jx" event={"ID":"7d4aa5b5-78e4-464e-bee0-18da0561de5d","Type":"ContainerDied","Data":"27c3e52c571fc814ed6e67778e52d1562a682e7eee78d1b2659434c91c84e0ee"} Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.407277 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-500e-account-create-update-wd7jx" Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.415577 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-821f-account-create-update-8ph6s" event={"ID":"0c04a9e3-0a3b-4895-8703-bb958c3000fd","Type":"ContainerDied","Data":"c3bf0538cc6b73f41fffce92e2ca5018103cbb1026839a1dd17c8db4ec6e019c"} Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.415614 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-821f-account-create-update-8ph6s" Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.418149 5120 generic.go:358] "Generic (PLEG): container finished" podID="51ac8589-b6a7-414d-94e5-731e217600c4" containerID="06cc9c752fc92ddfe80aca27a3714df85a220637bdd9e5ff98660c5f113511dc" exitCode=0 Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.418283 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-2" event={"ID":"51ac8589-b6a7-414d-94e5-731e217600c4","Type":"ContainerDied","Data":"06cc9c752fc92ddfe80aca27a3714df85a220637bdd9e5ff98660c5f113511dc"} Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.419588 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-5b46-account-create-update-llf4v" event={"ID":"29ef1c2d-283b-421f-8631-ada83f6ea799","Type":"ContainerDied","Data":"d720bb1469dd87a059dab5a2a3b9ee5d937db82e06d178d4a27db2f50ca7efe4"} Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.419665 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-5b46-account-create-update-llf4v" Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.424434 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-gmjzc" event={"ID":"9943d2d4-e26d-4c91-942e-a6d788ac8c7e","Type":"ContainerDied","Data":"d8ae9645becd145f126d558c25de4f82a475db1588732e87af907e505e4203a6"} Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.424471 5120 scope.go:117] "RemoveContainer" containerID="acabcc15081b211362ce26edef4be474972cad4d6622576162ea693ce90f39ee" Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.424581 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-gmjzc" Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.432563 5120 generic.go:358] "Generic (PLEG): container finished" podID="b4e407e7-1e20-455e-b1e5-d87ba8555a7a" containerID="73d36e223ac6cb16ad06c2743a3cc3ff1584c29e05d26a747bc98696b66104be" exitCode=0 Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.432717 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"b4e407e7-1e20-455e-b1e5-d87ba8555a7a","Type":"ContainerDied","Data":"73d36e223ac6cb16ad06c2743a3cc3ff1584c29e05d26a747bc98696b66104be"} Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.435608 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-jb5ks" event={"ID":"09b5d645-c91e-4bff-8b73-0651cf8397b6","Type":"ContainerStarted","Data":"569051d037ae7e96822d6d480259031583ea3e384c85f39eb6df3c6e6490eedd"} Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.435725 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-jb5ks" Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.442951 5120 generic.go:358] "Generic (PLEG): container finished" podID="cecaa51b-004f-4941-99e2-23272d052fa7" containerID="4ad4e9e2f3e47e3af53e941d93e136f76505815b23580a998ab6986a501c972d" exitCode=0 Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.443053 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"cecaa51b-004f-4941-99e2-23272d052fa7","Type":"ContainerDied","Data":"4ad4e9e2f3e47e3af53e941d93e136f76505815b23580a998ab6986a501c972d"} Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.443088 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"cecaa51b-004f-4941-99e2-23272d052fa7","Type":"ContainerDied","Data":"8f1d9fdee51384d61db35b7ecdb29c35878da559c9dd8169d6c70450cb13338a"} Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.443186 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.451591 5120 generic.go:358] "Generic (PLEG): container finished" podID="3253648c-08a0-4d00-87e2-121fe9240d23" containerID="228e632eee85749f4708dd46a1233dd311e9c155a72567279f23819c8f559297" exitCode=0 Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.451723 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-76cb6cf57b-j7csd" event={"ID":"3253648c-08a0-4d00-87e2-121fe9240d23","Type":"ContainerDied","Data":"228e632eee85749f4708dd46a1233dd311e9c155a72567279f23819c8f559297"} Mar 16 16:30:36 crc kubenswrapper[5120]: E0316 16:30:36.543547 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="31eede8ea13e83df778b0cc727f0126cabef5175599f7fcd091680c0e3d991d6" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:30:36 crc kubenswrapper[5120]: E0316 16:30:36.545323 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="31eede8ea13e83df778b0cc727f0126cabef5175599f7fcd091680c0e3d991d6" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.549137 5120 generic.go:358] "Generic (PLEG): container finished" podID="ed1bcd44-0ed6-4cb4-a735-798e033c8b08" containerID="5b81c1575b30f2252e88dd113e244df2352346edfc84f0f6cc943293511aa028" exitCode=0 Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.549284 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-aceb-account-create-update-h7jsn" Mar 16 16:30:36 crc kubenswrapper[5120]: E0316 16:30:36.552940 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="31eede8ea13e83df778b0cc727f0126cabef5175599f7fcd091680c0e3d991d6" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:30:36 crc kubenswrapper[5120]: E0316 16:30:36.553120 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="836f3504-5416-46bf-a225-7b7f977fe82c" containerName="nova-scheduler-scheduler" probeResult="unknown" Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.553865 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.553938 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"ed1bcd44-0ed6-4cb4-a735-798e033c8b08","Type":"ContainerDied","Data":"5b81c1575b30f2252e88dd113e244df2352346edfc84f0f6cc943293511aa028"} Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.554004 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"ed1bcd44-0ed6-4cb4-a735-798e033c8b08","Type":"ContainerDied","Data":"91162a05f9e8008f48b39039d03fe30e8328e83c28c8de431ef0be37619f714f"} Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.568807 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/nova-metadata-0" podUID="9300c420-c173-4f86-ac91-7ada78b25041" containerName="nova-metadata-log" probeResult="failure" output="Get \"https://10.217.0.50:8775/\": read tcp 10.217.0.2:37800->10.217.0.50:8775: read: connection reset by peer" Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.568852 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/nova-metadata-0" podUID="9300c420-c173-4f86-ac91-7ada78b25041" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"https://10.217.0.50:8775/\": read tcp 10.217.0.2:37784->10.217.0.50:8775: read: connection reset by peer" Mar 16 16:30:36 crc kubenswrapper[5120]: E0316 16:30:36.585221 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="b48efa78dedc3f4e6339fe4bb5d889d3c5e126ba2b9c6bd274d193ebe220d8d9" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:30:36 crc kubenswrapper[5120]: E0316 16:30:36.587641 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="b48efa78dedc3f4e6339fe4bb5d889d3c5e126ba2b9c6bd274d193ebe220d8d9" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:30:36 crc kubenswrapper[5120]: E0316 16:30:36.615997 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="b48efa78dedc3f4e6339fe4bb5d889d3c5e126ba2b9c6bd274d193ebe220d8d9" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:30:36 crc kubenswrapper[5120]: E0316 16:30:36.616074 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="7c3819a8-dcaf-4026-87c2-5f6419c379a9" containerName="nova-cell1-conductor-conductor" probeResult="unknown" Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.654911 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/cinder-api-0" podUID="f1ddadf2-8a01-49e5-a099-b192f793a36d" containerName="cinder-api" probeResult="failure" output="Get \"https://10.217.1.221:8776/healthcheck\": read tcp 10.217.0.2:56388->10.217.1.221:8776: read: connection reset by peer" Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.677424 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2c78e334-9857-4302-af64-dc9b0647ab41" path="/var/lib/kubelet/pods/2c78e334-9857-4302-af64-dc9b0647ab41/volumes" Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.678539 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9565a662-ca77-4197-8894-6b9633e653fd" path="/var/lib/kubelet/pods/9565a662-ca77-4197-8894-6b9633e653fd/volumes" Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.679212 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b62b0167-9419-454f-a1c2-78d1354baeb2" path="/var/lib/kubelet/pods/b62b0167-9419-454f-a1c2-78d1354baeb2/volumes" Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.680010 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fa5682a3-5cb9-4da7-8588-678ba2537e0c" path="/var/lib/kubelet/pods/fa5682a3-5cb9-4da7-8588-678ba2537e0c/volumes" Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.734215 5120 scope.go:117] "RemoveContainer" containerID="4ad4e9e2f3e47e3af53e941d93e136f76505815b23580a998ab6986a501c972d" Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.740939 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.778652 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-jb5ks" podStartSLOduration=5.778605601 podStartE2EDuration="5.778605601s" podCreationTimestamp="2026-03-16 16:30:31 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:30:36.486415767 +0000 UTC m=+3538.640347434" watchObservedRunningTime="2026-03-16 16:30:36.778605601 +0000 UTC m=+3538.932537258" Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.848457 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4e407e7-1e20-455e-b1e5-d87ba8555a7a-logs" (OuterVolumeSpecName: "logs") pod "b4e407e7-1e20-455e-b1e5-d87ba8555a7a" (UID: "b4e407e7-1e20-455e-b1e5-d87ba8555a7a"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.859215 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b4e407e7-1e20-455e-b1e5-d87ba8555a7a-logs\") pod \"b4e407e7-1e20-455e-b1e5-d87ba8555a7a\" (UID: \"b4e407e7-1e20-455e-b1e5-d87ba8555a7a\") " Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.859330 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l5q67\" (UniqueName: \"kubernetes.io/projected/b4e407e7-1e20-455e-b1e5-d87ba8555a7a-kube-api-access-l5q67\") pod \"b4e407e7-1e20-455e-b1e5-d87ba8555a7a\" (UID: \"b4e407e7-1e20-455e-b1e5-d87ba8555a7a\") " Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.859398 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b4e407e7-1e20-455e-b1e5-d87ba8555a7a-combined-ca-bundle\") pod \"b4e407e7-1e20-455e-b1e5-d87ba8555a7a\" (UID: \"b4e407e7-1e20-455e-b1e5-d87ba8555a7a\") " Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.859585 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/cecaa51b-004f-4941-99e2-23272d052fa7-public-tls-certs\") pod \"cecaa51b-004f-4941-99e2-23272d052fa7\" (UID: \"cecaa51b-004f-4941-99e2-23272d052fa7\") " Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.859844 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b4e407e7-1e20-455e-b1e5-d87ba8555a7a-config-data\") pod \"b4e407e7-1e20-455e-b1e5-d87ba8555a7a\" (UID: \"b4e407e7-1e20-455e-b1e5-d87ba8555a7a\") " Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.860022 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/b4e407e7-1e20-455e-b1e5-d87ba8555a7a-public-tls-certs\") pod \"b4e407e7-1e20-455e-b1e5-d87ba8555a7a\" (UID: \"b4e407e7-1e20-455e-b1e5-d87ba8555a7a\") " Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.860076 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/b4e407e7-1e20-455e-b1e5-d87ba8555a7a-internal-tls-certs\") pod \"b4e407e7-1e20-455e-b1e5-d87ba8555a7a\" (UID: \"b4e407e7-1e20-455e-b1e5-d87ba8555a7a\") " Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.860937 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b4e407e7-1e20-455e-b1e5-d87ba8555a7a-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.868040 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4e407e7-1e20-455e-b1e5-d87ba8555a7a-kube-api-access-l5q67" (OuterVolumeSpecName: "kube-api-access-l5q67") pod "b4e407e7-1e20-455e-b1e5-d87ba8555a7a" (UID: "b4e407e7-1e20-455e-b1e5-d87ba8555a7a"). InnerVolumeSpecName "kube-api-access-l5q67". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.868161 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cecaa51b-004f-4941-99e2-23272d052fa7-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "cecaa51b-004f-4941-99e2-23272d052fa7" (UID: "cecaa51b-004f-4941-99e2-23272d052fa7"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.908863 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b4e407e7-1e20-455e-b1e5-d87ba8555a7a-config-data" (OuterVolumeSpecName: "config-data") pod "b4e407e7-1e20-455e-b1e5-d87ba8555a7a" (UID: "b4e407e7-1e20-455e-b1e5-d87ba8555a7a"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.914319 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b4e407e7-1e20-455e-b1e5-d87ba8555a7a-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "b4e407e7-1e20-455e-b1e5-d87ba8555a7a" (UID: "b4e407e7-1e20-455e-b1e5-d87ba8555a7a"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.942401 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b4e407e7-1e20-455e-b1e5-d87ba8555a7a-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "b4e407e7-1e20-455e-b1e5-d87ba8555a7a" (UID: "b4e407e7-1e20-455e-b1e5-d87ba8555a7a"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.962850 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b4e407e7-1e20-455e-b1e5-d87ba8555a7a-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "b4e407e7-1e20-455e-b1e5-d87ba8555a7a" (UID: "b4e407e7-1e20-455e-b1e5-d87ba8555a7a"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.963839 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fxj6m\" (UniqueName: \"kubernetes.io/projected/24ef8cf9-6eb2-44c4-8845-7db782f6a862-kube-api-access-fxj6m\") pod \"keystone-aceb-account-create-update-h7jsn\" (UID: \"24ef8cf9-6eb2-44c4-8845-7db782f6a862\") " pod="openstack-kuttl-tests/keystone-aceb-account-create-update-h7jsn" Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.963993 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/24ef8cf9-6eb2-44c4-8845-7db782f6a862-operator-scripts\") pod \"keystone-aceb-account-create-update-h7jsn\" (UID: \"24ef8cf9-6eb2-44c4-8845-7db782f6a862\") " pod="openstack-kuttl-tests/keystone-aceb-account-create-update-h7jsn" Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.964380 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b4e407e7-1e20-455e-b1e5-d87ba8555a7a-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.964492 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/b4e407e7-1e20-455e-b1e5-d87ba8555a7a-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.964572 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/b4e407e7-1e20-455e-b1e5-d87ba8555a7a-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.964661 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l5q67\" (UniqueName: \"kubernetes.io/projected/b4e407e7-1e20-455e-b1e5-d87ba8555a7a-kube-api-access-l5q67\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.964888 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b4e407e7-1e20-455e-b1e5-d87ba8555a7a-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:36 crc kubenswrapper[5120]: I0316 16:30:36.965121 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/cecaa51b-004f-4941-99e2-23272d052fa7-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:36 crc kubenswrapper[5120]: E0316 16:30:36.965264 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Mar 16 16:30:36 crc kubenswrapper[5120]: E0316 16:30:36.965461 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/24ef8cf9-6eb2-44c4-8845-7db782f6a862-operator-scripts podName:24ef8cf9-6eb2-44c4-8845-7db782f6a862 nodeName:}" failed. No retries permitted until 2026-03-16 16:30:40.965445359 +0000 UTC m=+3543.119377016 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/24ef8cf9-6eb2-44c4-8845-7db782f6a862-operator-scripts") pod "keystone-aceb-account-create-update-h7jsn" (UID: "24ef8cf9-6eb2-44c4-8845-7db782f6a862") : configmap "openstack-scripts" not found Mar 16 16:30:36 crc kubenswrapper[5120]: E0316 16:30:36.973079 5120 projected.go:194] Error preparing data for projected volume kube-api-access-fxj6m for pod openstack-kuttl-tests/keystone-aceb-account-create-update-h7jsn: failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 16:30:36 crc kubenswrapper[5120]: E0316 16:30:36.973172 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/24ef8cf9-6eb2-44c4-8845-7db782f6a862-kube-api-access-fxj6m podName:24ef8cf9-6eb2-44c4-8845-7db782f6a862 nodeName:}" failed. No retries permitted until 2026-03-16 16:30:40.973148275 +0000 UTC m=+3543.127079932 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-fxj6m" (UniqueName: "kubernetes.io/projected/24ef8cf9-6eb2-44c4-8845-7db782f6a862-kube-api-access-fxj6m") pod "keystone-aceb-account-create-update-h7jsn" (UID: "24ef8cf9-6eb2-44c4-8845-7db782f6a862") : failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 16:30:37 crc kubenswrapper[5120]: E0316 16:30:37.040276 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="e1acde98a5a05ec8850ffa2722ab38d50f5f6d3995cf5efd90f9138ab9d44804" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Mar 16 16:30:37 crc kubenswrapper[5120]: E0316 16:30:37.076810 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="e1acde98a5a05ec8850ffa2722ab38d50f5f6d3995cf5efd90f9138ab9d44804" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Mar 16 16:30:37 crc kubenswrapper[5120]: E0316 16:30:37.084038 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="e1acde98a5a05ec8850ffa2722ab38d50f5f6d3995cf5efd90f9138ab9d44804" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Mar 16 16:30:37 crc kubenswrapper[5120]: E0316 16:30:37.084126 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/ovn-northd-0" podUID="c88c8ef0-5871-4507-9dcd-4c5312779d29" containerName="ovn-northd" probeResult="unknown" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.098622 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-2" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.120779 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-76cb6cf57b-j7csd" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.125288 5120 scope.go:117] "RemoveContainer" containerID="cbdd5e27d1311400d077d840e745e422ae1a420aba181e769227f63c08296f03" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.161700 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-76845cddf4-zlw8q" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.169352 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/3253648c-08a0-4d00-87e2-121fe9240d23-config-data-custom\") pod \"3253648c-08a0-4d00-87e2-121fe9240d23\" (UID: \"3253648c-08a0-4d00-87e2-121fe9240d23\") " Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.169401 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/51ac8589-b6a7-414d-94e5-731e217600c4-config-data-default\") pod \"51ac8589-b6a7-414d-94e5-731e217600c4\" (UID: \"51ac8589-b6a7-414d-94e5-731e217600c4\") " Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.169428 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m8mgn\" (UniqueName: \"kubernetes.io/projected/3253648c-08a0-4d00-87e2-121fe9240d23-kube-api-access-m8mgn\") pod \"3253648c-08a0-4d00-87e2-121fe9240d23\" (UID: \"3253648c-08a0-4d00-87e2-121fe9240d23\") " Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.169468 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/51ac8589-b6a7-414d-94e5-731e217600c4-combined-ca-bundle\") pod \"51ac8589-b6a7-414d-94e5-731e217600c4\" (UID: \"51ac8589-b6a7-414d-94e5-731e217600c4\") " Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.169496 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hqp4r\" (UniqueName: \"kubernetes.io/projected/51ac8589-b6a7-414d-94e5-731e217600c4-kube-api-access-hqp4r\") pod \"51ac8589-b6a7-414d-94e5-731e217600c4\" (UID: \"51ac8589-b6a7-414d-94e5-731e217600c4\") " Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.169647 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/3253648c-08a0-4d00-87e2-121fe9240d23-public-tls-certs\") pod \"3253648c-08a0-4d00-87e2-121fe9240d23\" (UID: \"3253648c-08a0-4d00-87e2-121fe9240d23\") " Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.169676 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/51ac8589-b6a7-414d-94e5-731e217600c4-galera-tls-certs\") pod \"51ac8589-b6a7-414d-94e5-731e217600c4\" (UID: \"51ac8589-b6a7-414d-94e5-731e217600c4\") " Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.169844 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/51ac8589-b6a7-414d-94e5-731e217600c4-config-data-generated\") pod \"51ac8589-b6a7-414d-94e5-731e217600c4\" (UID: \"51ac8589-b6a7-414d-94e5-731e217600c4\") " Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.169872 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/3253648c-08a0-4d00-87e2-121fe9240d23-internal-tls-certs\") pod \"3253648c-08a0-4d00-87e2-121fe9240d23\" (UID: \"3253648c-08a0-4d00-87e2-121fe9240d23\") " Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.169951 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3253648c-08a0-4d00-87e2-121fe9240d23-logs\") pod \"3253648c-08a0-4d00-87e2-121fe9240d23\" (UID: \"3253648c-08a0-4d00-87e2-121fe9240d23\") " Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.169999 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/51ac8589-b6a7-414d-94e5-731e217600c4-kolla-config\") pod \"51ac8589-b6a7-414d-94e5-731e217600c4\" (UID: \"51ac8589-b6a7-414d-94e5-731e217600c4\") " Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.170077 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3253648c-08a0-4d00-87e2-121fe9240d23-combined-ca-bundle\") pod \"3253648c-08a0-4d00-87e2-121fe9240d23\" (UID: \"3253648c-08a0-4d00-87e2-121fe9240d23\") " Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.170124 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"mysql-db\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"51ac8589-b6a7-414d-94e5-731e217600c4\" (UID: \"51ac8589-b6a7-414d-94e5-731e217600c4\") " Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.170253 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/51ac8589-b6a7-414d-94e5-731e217600c4-operator-scripts\") pod \"51ac8589-b6a7-414d-94e5-731e217600c4\" (UID: \"51ac8589-b6a7-414d-94e5-731e217600c4\") " Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.170281 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3253648c-08a0-4d00-87e2-121fe9240d23-config-data\") pod \"3253648c-08a0-4d00-87e2-121fe9240d23\" (UID: \"3253648c-08a0-4d00-87e2-121fe9240d23\") " Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.170605 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/51ac8589-b6a7-414d-94e5-731e217600c4-config-data-default" (OuterVolumeSpecName: "config-data-default") pod "51ac8589-b6a7-414d-94e5-731e217600c4" (UID: "51ac8589-b6a7-414d-94e5-731e217600c4"). InnerVolumeSpecName "config-data-default". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.171618 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/51ac8589-b6a7-414d-94e5-731e217600c4-config-data-default\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.177169 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3253648c-08a0-4d00-87e2-121fe9240d23-kube-api-access-m8mgn" (OuterVolumeSpecName: "kube-api-access-m8mgn") pod "3253648c-08a0-4d00-87e2-121fe9240d23" (UID: "3253648c-08a0-4d00-87e2-121fe9240d23"). InnerVolumeSpecName "kube-api-access-m8mgn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.177879 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51ac8589-b6a7-414d-94e5-731e217600c4-config-data-generated" (OuterVolumeSpecName: "config-data-generated") pod "51ac8589-b6a7-414d-94e5-731e217600c4" (UID: "51ac8589-b6a7-414d-94e5-731e217600c4"). InnerVolumeSpecName "config-data-generated". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.179112 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.179795 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/51ac8589-b6a7-414d-94e5-731e217600c4-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "51ac8589-b6a7-414d-94e5-731e217600c4" (UID: "51ac8589-b6a7-414d-94e5-731e217600c4"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.184436 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/51ac8589-b6a7-414d-94e5-731e217600c4-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "51ac8589-b6a7-414d-94e5-731e217600c4" (UID: "51ac8589-b6a7-414d-94e5-731e217600c4"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.185629 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3253648c-08a0-4d00-87e2-121fe9240d23-logs" (OuterVolumeSpecName: "logs") pod "3253648c-08a0-4d00-87e2-121fe9240d23" (UID: "3253648c-08a0-4d00-87e2-121fe9240d23"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.195905 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51ac8589-b6a7-414d-94e5-731e217600c4-kube-api-access-hqp4r" (OuterVolumeSpecName: "kube-api-access-hqp4r") pod "51ac8589-b6a7-414d-94e5-731e217600c4" (UID: "51ac8589-b6a7-414d-94e5-731e217600c4"). InnerVolumeSpecName "kube-api-access-hqp4r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.211774 5120 scope.go:117] "RemoveContainer" containerID="4ad4e9e2f3e47e3af53e941d93e136f76505815b23580a998ab6986a501c972d" Mar 16 16:30:37 crc kubenswrapper[5120]: E0316 16:30:37.222532 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ad4e9e2f3e47e3af53e941d93e136f76505815b23580a998ab6986a501c972d\": container with ID starting with 4ad4e9e2f3e47e3af53e941d93e136f76505815b23580a998ab6986a501c972d not found: ID does not exist" containerID="4ad4e9e2f3e47e3af53e941d93e136f76505815b23580a998ab6986a501c972d" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.222577 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ad4e9e2f3e47e3af53e941d93e136f76505815b23580a998ab6986a501c972d"} err="failed to get container status \"4ad4e9e2f3e47e3af53e941d93e136f76505815b23580a998ab6986a501c972d\": rpc error: code = NotFound desc = could not find container \"4ad4e9e2f3e47e3af53e941d93e136f76505815b23580a998ab6986a501c972d\": container with ID starting with 4ad4e9e2f3e47e3af53e941d93e136f76505815b23580a998ab6986a501c972d not found: ID does not exist" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.222603 5120 scope.go:117] "RemoveContainer" containerID="cbdd5e27d1311400d077d840e745e422ae1a420aba181e769227f63c08296f03" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.229524 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage02-crc" (OuterVolumeSpecName: "mysql-db") pod "51ac8589-b6a7-414d-94e5-731e217600c4" (UID: "51ac8589-b6a7-414d-94e5-731e217600c4"). InnerVolumeSpecName "local-storage02-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:30:37 crc kubenswrapper[5120]: E0316 16:30:37.236798 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cbdd5e27d1311400d077d840e745e422ae1a420aba181e769227f63c08296f03\": container with ID starting with cbdd5e27d1311400d077d840e745e422ae1a420aba181e769227f63c08296f03 not found: ID does not exist" containerID="cbdd5e27d1311400d077d840e745e422ae1a420aba181e769227f63c08296f03" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.236861 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cbdd5e27d1311400d077d840e745e422ae1a420aba181e769227f63c08296f03"} err="failed to get container status \"cbdd5e27d1311400d077d840e745e422ae1a420aba181e769227f63c08296f03\": rpc error: code = NotFound desc = could not find container \"cbdd5e27d1311400d077d840e745e422ae1a420aba181e769227f63c08296f03\": container with ID starting with cbdd5e27d1311400d077d840e745e422ae1a420aba181e769227f63c08296f03 not found: ID does not exist" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.236892 5120 scope.go:117] "RemoveContainer" containerID="5b81c1575b30f2252e88dd113e244df2352346edfc84f0f6cc943293511aa028" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.248413 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3253648c-08a0-4d00-87e2-121fe9240d23-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "3253648c-08a0-4d00-87e2-121fe9240d23" (UID: "3253648c-08a0-4d00-87e2-121fe9240d23"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.254555 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3253648c-08a0-4d00-87e2-121fe9240d23-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "3253648c-08a0-4d00-87e2-121fe9240d23" (UID: "3253648c-08a0-4d00-87e2-121fe9240d23"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.267054 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/51ac8589-b6a7-414d-94e5-731e217600c4-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "51ac8589-b6a7-414d-94e5-731e217600c4" (UID: "51ac8589-b6a7-414d-94e5-731e217600c4"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.270235 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-821f-account-create-update-8ph6s"] Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.272264 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/850510ce-da60-453a-88a8-475bc65bb0df-config-data\") pod \"850510ce-da60-453a-88a8-475bc65bb0df\" (UID: \"850510ce-da60-453a-88a8-475bc65bb0df\") " Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.272388 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-89fmt\" (UniqueName: \"kubernetes.io/projected/850510ce-da60-453a-88a8-475bc65bb0df-kube-api-access-89fmt\") pod \"850510ce-da60-453a-88a8-475bc65bb0df\" (UID: \"850510ce-da60-453a-88a8-475bc65bb0df\") " Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.272413 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/850510ce-da60-453a-88a8-475bc65bb0df-scripts\") pod \"850510ce-da60-453a-88a8-475bc65bb0df\" (UID: \"850510ce-da60-453a-88a8-475bc65bb0df\") " Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.272503 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-brcqc\" (UniqueName: \"kubernetes.io/projected/9300c420-c173-4f86-ac91-7ada78b25041-kube-api-access-brcqc\") pod \"9300c420-c173-4f86-ac91-7ada78b25041\" (UID: \"9300c420-c173-4f86-ac91-7ada78b25041\") " Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.272529 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/850510ce-da60-453a-88a8-475bc65bb0df-combined-ca-bundle\") pod \"850510ce-da60-453a-88a8-475bc65bb0df\" (UID: \"850510ce-da60-453a-88a8-475bc65bb0df\") " Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.272554 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/850510ce-da60-453a-88a8-475bc65bb0df-logs\") pod \"850510ce-da60-453a-88a8-475bc65bb0df\" (UID: \"850510ce-da60-453a-88a8-475bc65bb0df\") " Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.272639 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/850510ce-da60-453a-88a8-475bc65bb0df-internal-tls-certs\") pod \"850510ce-da60-453a-88a8-475bc65bb0df\" (UID: \"850510ce-da60-453a-88a8-475bc65bb0df\") " Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.272683 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9300c420-c173-4f86-ac91-7ada78b25041-combined-ca-bundle\") pod \"9300c420-c173-4f86-ac91-7ada78b25041\" (UID: \"9300c420-c173-4f86-ac91-7ada78b25041\") " Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.272722 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9300c420-c173-4f86-ac91-7ada78b25041-logs\") pod \"9300c420-c173-4f86-ac91-7ada78b25041\" (UID: \"9300c420-c173-4f86-ac91-7ada78b25041\") " Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.272796 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9300c420-c173-4f86-ac91-7ada78b25041-config-data\") pod \"9300c420-c173-4f86-ac91-7ada78b25041\" (UID: \"9300c420-c173-4f86-ac91-7ada78b25041\") " Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.272949 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/850510ce-da60-453a-88a8-475bc65bb0df-public-tls-certs\") pod \"850510ce-da60-453a-88a8-475bc65bb0df\" (UID: \"850510ce-da60-453a-88a8-475bc65bb0df\") " Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.272985 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/9300c420-c173-4f86-ac91-7ada78b25041-nova-metadata-tls-certs\") pod \"9300c420-c173-4f86-ac91-7ada78b25041\" (UID: \"9300c420-c173-4f86-ac91-7ada78b25041\") " Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.273619 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") on node \"crc\" " Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.273638 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/51ac8589-b6a7-414d-94e5-731e217600c4-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.273648 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/3253648c-08a0-4d00-87e2-121fe9240d23-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.273657 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m8mgn\" (UniqueName: \"kubernetes.io/projected/3253648c-08a0-4d00-87e2-121fe9240d23-kube-api-access-m8mgn\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.273666 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/51ac8589-b6a7-414d-94e5-731e217600c4-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.273674 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hqp4r\" (UniqueName: \"kubernetes.io/projected/51ac8589-b6a7-414d-94e5-731e217600c4-kube-api-access-hqp4r\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.273683 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/51ac8589-b6a7-414d-94e5-731e217600c4-config-data-generated\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.273693 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3253648c-08a0-4d00-87e2-121fe9240d23-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.273702 5120 reconciler_common.go:299] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/51ac8589-b6a7-414d-94e5-731e217600c4-kolla-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.273710 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3253648c-08a0-4d00-87e2-121fe9240d23-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.274751 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/850510ce-da60-453a-88a8-475bc65bb0df-logs" (OuterVolumeSpecName: "logs") pod "850510ce-da60-453a-88a8-475bc65bb0df" (UID: "850510ce-da60-453a-88a8-475bc65bb0df"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.274830 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3253648c-08a0-4d00-87e2-121fe9240d23-config-data" (OuterVolumeSpecName: "config-data") pod "3253648c-08a0-4d00-87e2-121fe9240d23" (UID: "3253648c-08a0-4d00-87e2-121fe9240d23"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.275339 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9300c420-c173-4f86-ac91-7ada78b25041-logs" (OuterVolumeSpecName: "logs") pod "9300c420-c173-4f86-ac91-7ada78b25041" (UID: "9300c420-c173-4f86-ac91-7ada78b25041"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.284153 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3253648c-08a0-4d00-87e2-121fe9240d23-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "3253648c-08a0-4d00-87e2-121fe9240d23" (UID: "3253648c-08a0-4d00-87e2-121fe9240d23"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.284497 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/850510ce-da60-453a-88a8-475bc65bb0df-scripts" (OuterVolumeSpecName: "scripts") pod "850510ce-da60-453a-88a8-475bc65bb0df" (UID: "850510ce-da60-453a-88a8-475bc65bb0df"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.300957 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/850510ce-da60-453a-88a8-475bc65bb0df-kube-api-access-89fmt" (OuterVolumeSpecName: "kube-api-access-89fmt") pod "850510ce-da60-453a-88a8-475bc65bb0df" (UID: "850510ce-da60-453a-88a8-475bc65bb0df"). InnerVolumeSpecName "kube-api-access-89fmt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.323511 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-821f-account-create-update-8ph6s"] Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.326267 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/51ac8589-b6a7-414d-94e5-731e217600c4-galera-tls-certs" (OuterVolumeSpecName: "galera-tls-certs") pod "51ac8589-b6a7-414d-94e5-731e217600c4" (UID: "51ac8589-b6a7-414d-94e5-731e217600c4"). InnerVolumeSpecName "galera-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.328107 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9300c420-c173-4f86-ac91-7ada78b25041-kube-api-access-brcqc" (OuterVolumeSpecName: "kube-api-access-brcqc") pod "9300c420-c173-4f86-ac91-7ada78b25041" (UID: "9300c420-c173-4f86-ac91-7ada78b25041"). InnerVolumeSpecName "kube-api-access-brcqc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.330187 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.343902 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-5b46-account-create-update-llf4v"] Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.349952 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-5b46-account-create-update-llf4v"] Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.359175 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage02-crc" (UniqueName: "kubernetes.io/local-volume/local-storage02-crc") on node "crc" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.368968 5120 scope.go:117] "RemoveContainer" containerID="a52c969d2547d89e70885b898beb45d313c34fcdb7d0051f70ffe99c7f945c9e" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.370026 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3253648c-08a0-4d00-87e2-121fe9240d23-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "3253648c-08a0-4d00-87e2-121fe9240d23" (UID: "3253648c-08a0-4d00-87e2-121fe9240d23"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.374436 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f1ddadf2-8a01-49e5-a099-b192f793a36d-logs\") pod \"f1ddadf2-8a01-49e5-a099-b192f793a36d\" (UID: \"f1ddadf2-8a01-49e5-a099-b192f793a36d\") " Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.374497 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/f1ddadf2-8a01-49e5-a099-b192f793a36d-config-data-custom\") pod \"f1ddadf2-8a01-49e5-a099-b192f793a36d\" (UID: \"f1ddadf2-8a01-49e5-a099-b192f793a36d\") " Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.374556 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f1ddadf2-8a01-49e5-a099-b192f793a36d-public-tls-certs\") pod \"f1ddadf2-8a01-49e5-a099-b192f793a36d\" (UID: \"f1ddadf2-8a01-49e5-a099-b192f793a36d\") " Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.375197 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5xdrr\" (UniqueName: \"kubernetes.io/projected/f1ddadf2-8a01-49e5-a099-b192f793a36d-kube-api-access-5xdrr\") pod \"f1ddadf2-8a01-49e5-a099-b192f793a36d\" (UID: \"f1ddadf2-8a01-49e5-a099-b192f793a36d\") " Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.375290 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f1ddadf2-8a01-49e5-a099-b192f793a36d-internal-tls-certs\") pod \"f1ddadf2-8a01-49e5-a099-b192f793a36d\" (UID: \"f1ddadf2-8a01-49e5-a099-b192f793a36d\") " Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.375370 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f1ddadf2-8a01-49e5-a099-b192f793a36d-scripts\") pod \"f1ddadf2-8a01-49e5-a099-b192f793a36d\" (UID: \"f1ddadf2-8a01-49e5-a099-b192f793a36d\") " Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.375504 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f1ddadf2-8a01-49e5-a099-b192f793a36d-config-data\") pod \"f1ddadf2-8a01-49e5-a099-b192f793a36d\" (UID: \"f1ddadf2-8a01-49e5-a099-b192f793a36d\") " Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.375598 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f1ddadf2-8a01-49e5-a099-b192f793a36d-combined-ca-bundle\") pod \"f1ddadf2-8a01-49e5-a099-b192f793a36d\" (UID: \"f1ddadf2-8a01-49e5-a099-b192f793a36d\") " Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.375837 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/f1ddadf2-8a01-49e5-a099-b192f793a36d-etc-machine-id\") pod \"f1ddadf2-8a01-49e5-a099-b192f793a36d\" (UID: \"f1ddadf2-8a01-49e5-a099-b192f793a36d\") " Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.376051 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1ddadf2-8a01-49e5-a099-b192f793a36d-logs" (OuterVolumeSpecName: "logs") pod "f1ddadf2-8a01-49e5-a099-b192f793a36d" (UID: "f1ddadf2-8a01-49e5-a099-b192f793a36d"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.376940 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/850510ce-da60-453a-88a8-475bc65bb0df-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.376960 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/3253648c-08a0-4d00-87e2-121fe9240d23-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.376972 5120 reconciler_common.go:299] "Volume detached for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/51ac8589-b6a7-414d-94e5-731e217600c4-galera-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.376982 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9300c420-c173-4f86-ac91-7ada78b25041-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.376991 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f1ddadf2-8a01-49e5-a099-b192f793a36d-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.377028 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/3253648c-08a0-4d00-87e2-121fe9240d23-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.377042 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.377053 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3253648c-08a0-4d00-87e2-121fe9240d23-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.377063 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-89fmt\" (UniqueName: \"kubernetes.io/projected/850510ce-da60-453a-88a8-475bc65bb0df-kube-api-access-89fmt\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.377101 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/850510ce-da60-453a-88a8-475bc65bb0df-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.377113 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-brcqc\" (UniqueName: \"kubernetes.io/projected/9300c420-c173-4f86-ac91-7ada78b25041-kube-api-access-brcqc\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.377176 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/f1ddadf2-8a01-49e5-a099-b192f793a36d-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "f1ddadf2-8a01-49e5-a099-b192f793a36d" (UID: "f1ddadf2-8a01-49e5-a099-b192f793a36d"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.382477 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-aceb-account-create-update-h7jsn"] Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.391263 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f1ddadf2-8a01-49e5-a099-b192f793a36d-scripts" (OuterVolumeSpecName: "scripts") pod "f1ddadf2-8a01-49e5-a099-b192f793a36d" (UID: "f1ddadf2-8a01-49e5-a099-b192f793a36d"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.394488 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-aceb-account-create-update-h7jsn"] Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.396347 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1ddadf2-8a01-49e5-a099-b192f793a36d-kube-api-access-5xdrr" (OuterVolumeSpecName: "kube-api-access-5xdrr") pod "f1ddadf2-8a01-49e5-a099-b192f793a36d" (UID: "f1ddadf2-8a01-49e5-a099-b192f793a36d"). InnerVolumeSpecName "kube-api-access-5xdrr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.401141 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f1ddadf2-8a01-49e5-a099-b192f793a36d-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "f1ddadf2-8a01-49e5-a099-b192f793a36d" (UID: "f1ddadf2-8a01-49e5-a099-b192f793a36d"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.408858 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-gmjzc"] Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.414592 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-gmjzc"] Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.418015 5120 scope.go:117] "RemoveContainer" containerID="5b81c1575b30f2252e88dd113e244df2352346edfc84f0f6cc943293511aa028" Mar 16 16:30:37 crc kubenswrapper[5120]: E0316 16:30:37.422890 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b81c1575b30f2252e88dd113e244df2352346edfc84f0f6cc943293511aa028\": container with ID starting with 5b81c1575b30f2252e88dd113e244df2352346edfc84f0f6cc943293511aa028 not found: ID does not exist" containerID="5b81c1575b30f2252e88dd113e244df2352346edfc84f0f6cc943293511aa028" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.422934 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b81c1575b30f2252e88dd113e244df2352346edfc84f0f6cc943293511aa028"} err="failed to get container status \"5b81c1575b30f2252e88dd113e244df2352346edfc84f0f6cc943293511aa028\": rpc error: code = NotFound desc = could not find container \"5b81c1575b30f2252e88dd113e244df2352346edfc84f0f6cc943293511aa028\": container with ID starting with 5b81c1575b30f2252e88dd113e244df2352346edfc84f0f6cc943293511aa028 not found: ID does not exist" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.422959 5120 scope.go:117] "RemoveContainer" containerID="a52c969d2547d89e70885b898beb45d313c34fcdb7d0051f70ffe99c7f945c9e" Mar 16 16:30:37 crc kubenswrapper[5120]: E0316 16:30:37.424017 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a52c969d2547d89e70885b898beb45d313c34fcdb7d0051f70ffe99c7f945c9e\": container with ID starting with a52c969d2547d89e70885b898beb45d313c34fcdb7d0051f70ffe99c7f945c9e not found: ID does not exist" containerID="a52c969d2547d89e70885b898beb45d313c34fcdb7d0051f70ffe99c7f945c9e" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.424064 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a52c969d2547d89e70885b898beb45d313c34fcdb7d0051f70ffe99c7f945c9e"} err="failed to get container status \"a52c969d2547d89e70885b898beb45d313c34fcdb7d0051f70ffe99c7f945c9e\": rpc error: code = NotFound desc = could not find container \"a52c969d2547d89e70885b898beb45d313c34fcdb7d0051f70ffe99c7f945c9e\": container with ID starting with a52c969d2547d89e70885b898beb45d313c34fcdb7d0051f70ffe99c7f945c9e not found: ID does not exist" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.428013 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-500e-account-create-update-wd7jx"] Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.439943 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-500e-account-create-update-wd7jx"] Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.450184 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/openstack-cell1-galera-0" podUID="d4a96e7a-b22c-46b2-9fd4-9d8815d9f830" containerName="galera" containerID="cri-o://67536b6d5411454dd60e69e85c9be26aac7288128b3d51416c45cd4056627842" gracePeriod=26 Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.456619 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9300c420-c173-4f86-ac91-7ada78b25041-config-data" (OuterVolumeSpecName: "config-data") pod "9300c420-c173-4f86-ac91-7ada78b25041" (UID: "9300c420-c173-4f86-ac91-7ada78b25041"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.458432 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9300c420-c173-4f86-ac91-7ada78b25041-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "9300c420-c173-4f86-ac91-7ada78b25041" (UID: "9300c420-c173-4f86-ac91-7ada78b25041"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.474204 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/850510ce-da60-453a-88a8-475bc65bb0df-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "850510ce-da60-453a-88a8-475bc65bb0df" (UID: "850510ce-da60-453a-88a8-475bc65bb0df"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.476997 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9300c420-c173-4f86-ac91-7ada78b25041-nova-metadata-tls-certs" (OuterVolumeSpecName: "nova-metadata-tls-certs") pod "9300c420-c173-4f86-ac91-7ada78b25041" (UID: "9300c420-c173-4f86-ac91-7ada78b25041"). InnerVolumeSpecName "nova-metadata-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.479706 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9300c420-c173-4f86-ac91-7ada78b25041-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.480006 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fxj6m\" (UniqueName: \"kubernetes.io/projected/24ef8cf9-6eb2-44c4-8845-7db782f6a862-kube-api-access-fxj6m\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.480130 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/f1ddadf2-8a01-49e5-a099-b192f793a36d-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.480521 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5xdrr\" (UniqueName: \"kubernetes.io/projected/f1ddadf2-8a01-49e5-a099-b192f793a36d-kube-api-access-5xdrr\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.480606 5120 reconciler_common.go:299] "Volume detached for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/9300c420-c173-4f86-ac91-7ada78b25041-nova-metadata-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.480675 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f1ddadf2-8a01-49e5-a099-b192f793a36d-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.480738 5120 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/f1ddadf2-8a01-49e5-a099-b192f793a36d-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.480833 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/24ef8cf9-6eb2-44c4-8845-7db782f6a862-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.480908 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/850510ce-da60-453a-88a8-475bc65bb0df-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.480977 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9300c420-c173-4f86-ac91-7ada78b25041-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.493807 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f1ddadf2-8a01-49e5-a099-b192f793a36d-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f1ddadf2-8a01-49e5-a099-b192f793a36d" (UID: "f1ddadf2-8a01-49e5-a099-b192f793a36d"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.500510 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/850510ce-da60-453a-88a8-475bc65bb0df-config-data" (OuterVolumeSpecName: "config-data") pod "850510ce-da60-453a-88a8-475bc65bb0df" (UID: "850510ce-da60-453a-88a8-475bc65bb0df"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.514880 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.528300 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.560267 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f1ddadf2-8a01-49e5-a099-b192f793a36d-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "f1ddadf2-8a01-49e5-a099-b192f793a36d" (UID: "f1ddadf2-8a01-49e5-a099-b192f793a36d"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.587562 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/850510ce-da60-453a-88a8-475bc65bb0df-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.587599 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f1ddadf2-8a01-49e5-a099-b192f793a36d-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.587611 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f1ddadf2-8a01-49e5-a099-b192f793a36d-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.589618 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f1ddadf2-8a01-49e5-a099-b192f793a36d-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "f1ddadf2-8a01-49e5-a099-b192f793a36d" (UID: "f1ddadf2-8a01-49e5-a099-b192f793a36d"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.595214 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.600907 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.605331 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f1ddadf2-8a01-49e5-a099-b192f793a36d-config-data" (OuterVolumeSpecName: "config-data") pod "f1ddadf2-8a01-49e5-a099-b192f793a36d" (UID: "f1ddadf2-8a01-49e5-a099-b192f793a36d"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.612017 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-76cb6cf57b-j7csd" event={"ID":"3253648c-08a0-4d00-87e2-121fe9240d23","Type":"ContainerDied","Data":"fe30a50c4c535c24ddc9f4a5fcc19ef0d415eca8d58703bc903c89990f48bb5c"} Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.612067 5120 scope.go:117] "RemoveContainer" containerID="228e632eee85749f4708dd46a1233dd311e9c155a72567279f23819c8f559297" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.616458 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-76cb6cf57b-j7csd" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.620590 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/850510ce-da60-453a-88a8-475bc65bb0df-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "850510ce-da60-453a-88a8-475bc65bb0df" (UID: "850510ce-da60-453a-88a8-475bc65bb0df"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.630300 5120 generic.go:358] "Generic (PLEG): container finished" podID="0b62aed8-ea87-465a-be46-45ce06fedbb7" containerID="8074d2bb95bae655f4b9972b3d0c5821b80f93bf6f01feae8526fac4e817b9cb" exitCode=0 Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.630529 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-6bf8d6479c-9rjt6" event={"ID":"0b62aed8-ea87-465a-be46-45ce06fedbb7","Type":"ContainerDied","Data":"8074d2bb95bae655f4b9972b3d0c5821b80f93bf6f01feae8526fac4e817b9cb"} Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.633107 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-2" event={"ID":"51ac8589-b6a7-414d-94e5-731e217600c4","Type":"ContainerDied","Data":"9f7f30fff2938592df2e74ceb51e4f73de19e2b28d06de976b63ee41a1f42e66"} Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.633187 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-2" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.636812 5120 generic.go:358] "Generic (PLEG): container finished" podID="f1ddadf2-8a01-49e5-a099-b192f793a36d" containerID="e96e5c721f9e1b4574a1448d5ba3da2db4cdf652e79ca865a8776a290e9a0553" exitCode=0 Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.636900 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"f1ddadf2-8a01-49e5-a099-b192f793a36d","Type":"ContainerDied","Data":"e96e5c721f9e1b4574a1448d5ba3da2db4cdf652e79ca865a8776a290e9a0553"} Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.636914 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.636930 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"f1ddadf2-8a01-49e5-a099-b192f793a36d","Type":"ContainerDied","Data":"d7a0097b76c0b0ade46d85ff632a9adc2e1fe222399cb858a61cd6cecf7e4ecb"} Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.640496 5120 generic.go:358] "Generic (PLEG): container finished" podID="8690a5a2-3341-452e-8364-2e5e4072c192" containerID="6e6cc6827a75b6a7267a1f48a96bcedc87a117cb4353ef6624dee5fe5204d958" exitCode=0 Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.640586 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-1" event={"ID":"8690a5a2-3341-452e-8364-2e5e4072c192","Type":"ContainerDied","Data":"6e6cc6827a75b6a7267a1f48a96bcedc87a117cb4353ef6624dee5fe5204d958"} Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.644268 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-northd-0_c88c8ef0-5871-4507-9dcd-4c5312779d29/ovn-northd/0.log" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.644299 5120 generic.go:358] "Generic (PLEG): container finished" podID="c88c8ef0-5871-4507-9dcd-4c5312779d29" containerID="e1acde98a5a05ec8850ffa2722ab38d50f5f6d3995cf5efd90f9138ab9d44804" exitCode=139 Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.644397 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"c88c8ef0-5871-4507-9dcd-4c5312779d29","Type":"ContainerDied","Data":"e1acde98a5a05ec8850ffa2722ab38d50f5f6d3995cf5efd90f9138ab9d44804"} Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.645976 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/850510ce-da60-453a-88a8-475bc65bb0df-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "850510ce-da60-453a-88a8-475bc65bb0df" (UID: "850510ce-da60-453a-88a8-475bc65bb0df"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.655454 5120 generic.go:358] "Generic (PLEG): container finished" podID="850510ce-da60-453a-88a8-475bc65bb0df" containerID="0c87f1e5ac81b96f6ef9514dc786d98dfeb76235a80ea1a9c515704f7bb369ab" exitCode=0 Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.655581 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-76845cddf4-zlw8q" event={"ID":"850510ce-da60-453a-88a8-475bc65bb0df","Type":"ContainerDied","Data":"0c87f1e5ac81b96f6ef9514dc786d98dfeb76235a80ea1a9c515704f7bb369ab"} Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.655606 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-76845cddf4-zlw8q" event={"ID":"850510ce-da60-453a-88a8-475bc65bb0df","Type":"ContainerDied","Data":"dc950f444adfcfe1c4c6d401ef3f376faffafa4ebc3be9a126b26f622bda1798"} Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.656015 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-76845cddf4-zlw8q" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.660004 5120 generic.go:358] "Generic (PLEG): container finished" podID="9300c420-c173-4f86-ac91-7ada78b25041" containerID="fef968df7f37fd8586399f475ea9ec49a678f4f4b47fe252028804652842452c" exitCode=0 Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.660120 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"9300c420-c173-4f86-ac91-7ada78b25041","Type":"ContainerDied","Data":"fef968df7f37fd8586399f475ea9ec49a678f4f4b47fe252028804652842452c"} Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.660155 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"9300c420-c173-4f86-ac91-7ada78b25041","Type":"ContainerDied","Data":"5ea4fe8f33dc24ad2c86cecd0392f16c79471bfc50e42ea582053a96e4635bcb"} Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.660409 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.668041 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"b4e407e7-1e20-455e-b1e5-d87ba8555a7a","Type":"ContainerDied","Data":"a40217a603b1abbf8379975140a56db83c67f69d503c55fdcb645c25162389bc"} Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.668219 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.689522 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/850510ce-da60-453a-88a8-475bc65bb0df-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.689551 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f1ddadf2-8a01-49e5-a099-b192f793a36d-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.689563 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/850510ce-da60-453a-88a8-475bc65bb0df-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.689572 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f1ddadf2-8a01-49e5-a099-b192f793a36d-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.744270 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-6bf8d6479c-9rjt6" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.760531 5120 scope.go:117] "RemoveContainer" containerID="d015c3c14c7d9b3c3a75819d57a9b899aaf097f05482262725fe5621d88fcfeb" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.785587 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-northd-0_c88c8ef0-5871-4507-9dcd-4c5312779d29/ovn-northd/0.log" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.785984 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.799923 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/0b62aed8-ea87-465a-be46-45ce06fedbb7-fernet-keys\") pod \"0b62aed8-ea87-465a-be46-45ce06fedbb7\" (UID: \"0b62aed8-ea87-465a-be46-45ce06fedbb7\") " Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.800013 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/0b62aed8-ea87-465a-be46-45ce06fedbb7-credential-keys\") pod \"0b62aed8-ea87-465a-be46-45ce06fedbb7\" (UID: \"0b62aed8-ea87-465a-be46-45ce06fedbb7\") " Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.800055 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0b62aed8-ea87-465a-be46-45ce06fedbb7-combined-ca-bundle\") pod \"0b62aed8-ea87-465a-be46-45ce06fedbb7\" (UID: \"0b62aed8-ea87-465a-be46-45ce06fedbb7\") " Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.800126 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/0b62aed8-ea87-465a-be46-45ce06fedbb7-public-tls-certs\") pod \"0b62aed8-ea87-465a-be46-45ce06fedbb7\" (UID: \"0b62aed8-ea87-465a-be46-45ce06fedbb7\") " Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.800155 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0b62aed8-ea87-465a-be46-45ce06fedbb7-scripts\") pod \"0b62aed8-ea87-465a-be46-45ce06fedbb7\" (UID: \"0b62aed8-ea87-465a-be46-45ce06fedbb7\") " Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.800209 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/0b62aed8-ea87-465a-be46-45ce06fedbb7-internal-tls-certs\") pod \"0b62aed8-ea87-465a-be46-45ce06fedbb7\" (UID: \"0b62aed8-ea87-465a-be46-45ce06fedbb7\") " Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.801370 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0b62aed8-ea87-465a-be46-45ce06fedbb7-config-data\") pod \"0b62aed8-ea87-465a-be46-45ce06fedbb7\" (UID: \"0b62aed8-ea87-465a-be46-45ce06fedbb7\") " Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.801453 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-229t2\" (UniqueName: \"kubernetes.io/projected/0b62aed8-ea87-465a-be46-45ce06fedbb7-kube-api-access-229t2\") pod \"0b62aed8-ea87-465a-be46-45ce06fedbb7\" (UID: \"0b62aed8-ea87-465a-be46-45ce06fedbb7\") " Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.807827 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b62aed8-ea87-465a-be46-45ce06fedbb7-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "0b62aed8-ea87-465a-be46-45ce06fedbb7" (UID: "0b62aed8-ea87-465a-be46-45ce06fedbb7"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.809527 5120 reconciler_common.go:299] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/0b62aed8-ea87-465a-be46-45ce06fedbb7-credential-keys\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.809815 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b62aed8-ea87-465a-be46-45ce06fedbb7-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "0b62aed8-ea87-465a-be46-45ce06fedbb7" (UID: "0b62aed8-ea87-465a-be46-45ce06fedbb7"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.819477 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b62aed8-ea87-465a-be46-45ce06fedbb7-kube-api-access-229t2" (OuterVolumeSpecName: "kube-api-access-229t2") pod "0b62aed8-ea87-465a-be46-45ce06fedbb7" (UID: "0b62aed8-ea87-465a-be46-45ce06fedbb7"). InnerVolumeSpecName "kube-api-access-229t2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.819556 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b62aed8-ea87-465a-be46-45ce06fedbb7-scripts" (OuterVolumeSpecName: "scripts") pod "0b62aed8-ea87-465a-be46-45ce06fedbb7" (UID: "0b62aed8-ea87-465a-be46-45ce06fedbb7"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.819623 5120 scope.go:117] "RemoveContainer" containerID="06cc9c752fc92ddfe80aca27a3714df85a220637bdd9e5ff98660c5f113511dc" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.840136 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.847408 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b62aed8-ea87-465a-be46-45ce06fedbb7-config-data" (OuterVolumeSpecName: "config-data") pod "0b62aed8-ea87-465a-be46-45ce06fedbb7" (UID: "0b62aed8-ea87-465a-be46-45ce06fedbb7"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.867410 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.875471 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-1" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.882110 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-76cb6cf57b-j7csd"] Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.889858 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b62aed8-ea87-465a-be46-45ce06fedbb7-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "0b62aed8-ea87-465a-be46-45ce06fedbb7" (UID: "0b62aed8-ea87-465a-be46-45ce06fedbb7"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.891301 5120 scope.go:117] "RemoveContainer" containerID="72701ef16c9ef2e1b50e20366156c0b66413347f948b5144adbc4cfa2684d6ca" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.889993 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b62aed8-ea87-465a-be46-45ce06fedbb7-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "0b62aed8-ea87-465a-be46-45ce06fedbb7" (UID: "0b62aed8-ea87-465a-be46-45ce06fedbb7"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.892589 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b62aed8-ea87-465a-be46-45ce06fedbb7-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "0b62aed8-ea87-465a-be46-45ce06fedbb7" (UID: "0b62aed8-ea87-465a-be46-45ce06fedbb7"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.893278 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-api-76cb6cf57b-j7csd"] Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.903217 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-galera-2"] Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.911459 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qh8n6\" (UniqueName: \"kubernetes.io/projected/c88c8ef0-5871-4507-9dcd-4c5312779d29-kube-api-access-qh8n6\") pod \"c88c8ef0-5871-4507-9dcd-4c5312779d29\" (UID: \"c88c8ef0-5871-4507-9dcd-4c5312779d29\") " Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.911560 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/c88c8ef0-5871-4507-9dcd-4c5312779d29-scripts\") pod \"c88c8ef0-5871-4507-9dcd-4c5312779d29\" (UID: \"c88c8ef0-5871-4507-9dcd-4c5312779d29\") " Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.911639 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c88c8ef0-5871-4507-9dcd-4c5312779d29-combined-ca-bundle\") pod \"c88c8ef0-5871-4507-9dcd-4c5312779d29\" (UID: \"c88c8ef0-5871-4507-9dcd-4c5312779d29\") " Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.911741 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/c88c8ef0-5871-4507-9dcd-4c5312779d29-ovn-rundir\") pod \"c88c8ef0-5871-4507-9dcd-4c5312779d29\" (UID: \"c88c8ef0-5871-4507-9dcd-4c5312779d29\") " Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.911887 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/c88c8ef0-5871-4507-9dcd-4c5312779d29-ovn-northd-tls-certs\") pod \"c88c8ef0-5871-4507-9dcd-4c5312779d29\" (UID: \"c88c8ef0-5871-4507-9dcd-4c5312779d29\") " Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.911958 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/c88c8ef0-5871-4507-9dcd-4c5312779d29-metrics-certs-tls-certs\") pod \"c88c8ef0-5871-4507-9dcd-4c5312779d29\" (UID: \"c88c8ef0-5871-4507-9dcd-4c5312779d29\") " Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.912039 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c88c8ef0-5871-4507-9dcd-4c5312779d29-config\") pod \"c88c8ef0-5871-4507-9dcd-4c5312779d29\" (UID: \"c88c8ef0-5871-4507-9dcd-4c5312779d29\") " Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.912781 5120 reconciler_common.go:299] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/0b62aed8-ea87-465a-be46-45ce06fedbb7-fernet-keys\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.912800 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0b62aed8-ea87-465a-be46-45ce06fedbb7-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.912810 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/0b62aed8-ea87-465a-be46-45ce06fedbb7-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.912820 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0b62aed8-ea87-465a-be46-45ce06fedbb7-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.912828 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/0b62aed8-ea87-465a-be46-45ce06fedbb7-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.912836 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0b62aed8-ea87-465a-be46-45ce06fedbb7-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.912845 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-229t2\" (UniqueName: \"kubernetes.io/projected/0b62aed8-ea87-465a-be46-45ce06fedbb7-kube-api-access-229t2\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.912859 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c88c8ef0-5871-4507-9dcd-4c5312779d29-scripts" (OuterVolumeSpecName: "scripts") pod "c88c8ef0-5871-4507-9dcd-4c5312779d29" (UID: "c88c8ef0-5871-4507-9dcd-4c5312779d29"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.913300 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c88c8ef0-5871-4507-9dcd-4c5312779d29-config" (OuterVolumeSpecName: "config") pod "c88c8ef0-5871-4507-9dcd-4c5312779d29" (UID: "c88c8ef0-5871-4507-9dcd-4c5312779d29"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.913646 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstack-galera-2"] Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.914194 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c88c8ef0-5871-4507-9dcd-4c5312779d29-ovn-rundir" (OuterVolumeSpecName: "ovn-rundir") pod "c88c8ef0-5871-4507-9dcd-4c5312779d29" (UID: "c88c8ef0-5871-4507-9dcd-4c5312779d29"). InnerVolumeSpecName "ovn-rundir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.917044 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c88c8ef0-5871-4507-9dcd-4c5312779d29-kube-api-access-qh8n6" (OuterVolumeSpecName: "kube-api-access-qh8n6") pod "c88c8ef0-5871-4507-9dcd-4c5312779d29" (UID: "c88c8ef0-5871-4507-9dcd-4c5312779d29"). InnerVolumeSpecName "kube-api-access-qh8n6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.919693 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.930604 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.939094 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-76845cddf4-zlw8q"] Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.957659 5120 scope.go:117] "RemoveContainer" containerID="e96e5c721f9e1b4574a1448d5ba3da2db4cdf652e79ca865a8776a290e9a0553" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.967524 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-76845cddf4-zlw8q"] Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.973913 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c88c8ef0-5871-4507-9dcd-4c5312779d29-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "c88c8ef0-5871-4507-9dcd-4c5312779d29" (UID: "c88c8ef0-5871-4507-9dcd-4c5312779d29"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.978811 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.985133 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:30:37 crc kubenswrapper[5120]: I0316 16:30:37.989978 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c88c8ef0-5871-4507-9dcd-4c5312779d29-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "c88c8ef0-5871-4507-9dcd-4c5312779d29" (UID: "c88c8ef0-5871-4507-9dcd-4c5312779d29"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.009653 5120 scope.go:117] "RemoveContainer" containerID="20a146198364dd3bab31073def314ae19daec57fd0b0b0ae40a65386d19d3bd0" Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.014001 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/8690a5a2-3341-452e-8364-2e5e4072c192-kolla-config\") pod \"8690a5a2-3341-452e-8364-2e5e4072c192\" (UID: \"8690a5a2-3341-452e-8364-2e5e4072c192\") " Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.014721 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8690a5a2-3341-452e-8364-2e5e4072c192-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "8690a5a2-3341-452e-8364-2e5e4072c192" (UID: "8690a5a2-3341-452e-8364-2e5e4072c192"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.015252 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8690a5a2-3341-452e-8364-2e5e4072c192-config-data-generated" (OuterVolumeSpecName: "config-data-generated") pod "8690a5a2-3341-452e-8364-2e5e4072c192" (UID: "8690a5a2-3341-452e-8364-2e5e4072c192"). InnerVolumeSpecName "config-data-generated". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.014466 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/8690a5a2-3341-452e-8364-2e5e4072c192-config-data-generated\") pod \"8690a5a2-3341-452e-8364-2e5e4072c192\" (UID: \"8690a5a2-3341-452e-8364-2e5e4072c192\") " Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.015614 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"mysql-db\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"8690a5a2-3341-452e-8364-2e5e4072c192\" (UID: \"8690a5a2-3341-452e-8364-2e5e4072c192\") " Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.016303 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/8690a5a2-3341-452e-8364-2e5e4072c192-galera-tls-certs\") pod \"8690a5a2-3341-452e-8364-2e5e4072c192\" (UID: \"8690a5a2-3341-452e-8364-2e5e4072c192\") " Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.016453 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8690a5a2-3341-452e-8364-2e5e4072c192-operator-scripts\") pod \"8690a5a2-3341-452e-8364-2e5e4072c192\" (UID: \"8690a5a2-3341-452e-8364-2e5e4072c192\") " Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.016522 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8690a5a2-3341-452e-8364-2e5e4072c192-combined-ca-bundle\") pod \"8690a5a2-3341-452e-8364-2e5e4072c192\" (UID: \"8690a5a2-3341-452e-8364-2e5e4072c192\") " Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.016903 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c4d6w\" (UniqueName: \"kubernetes.io/projected/8690a5a2-3341-452e-8364-2e5e4072c192-kube-api-access-c4d6w\") pod \"8690a5a2-3341-452e-8364-2e5e4072c192\" (UID: \"8690a5a2-3341-452e-8364-2e5e4072c192\") " Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.017121 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/8690a5a2-3341-452e-8364-2e5e4072c192-config-data-default\") pod \"8690a5a2-3341-452e-8364-2e5e4072c192\" (UID: \"8690a5a2-3341-452e-8364-2e5e4072c192\") " Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.017785 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8690a5a2-3341-452e-8364-2e5e4072c192-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "8690a5a2-3341-452e-8364-2e5e4072c192" (UID: "8690a5a2-3341-452e-8364-2e5e4072c192"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.017908 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c88c8ef0-5871-4507-9dcd-4c5312779d29-ovn-northd-tls-certs" (OuterVolumeSpecName: "ovn-northd-tls-certs") pod "c88c8ef0-5871-4507-9dcd-4c5312779d29" (UID: "c88c8ef0-5871-4507-9dcd-4c5312779d29"). InnerVolumeSpecName "ovn-northd-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.018609 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c88c8ef0-5871-4507-9dcd-4c5312779d29-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.018663 5120 reconciler_common.go:299] "Volume detached for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/c88c8ef0-5871-4507-9dcd-4c5312779d29-ovn-rundir\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.018673 5120 reconciler_common.go:299] "Volume detached for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/c88c8ef0-5871-4507-9dcd-4c5312779d29-ovn-northd-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.018684 5120 reconciler_common.go:299] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/8690a5a2-3341-452e-8364-2e5e4072c192-kolla-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.018694 5120 reconciler_common.go:299] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/c88c8ef0-5871-4507-9dcd-4c5312779d29-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.018704 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/8690a5a2-3341-452e-8364-2e5e4072c192-config-data-generated\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.018713 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c88c8ef0-5871-4507-9dcd-4c5312779d29-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.018745 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8690a5a2-3341-452e-8364-2e5e4072c192-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.018739 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8690a5a2-3341-452e-8364-2e5e4072c192-config-data-default" (OuterVolumeSpecName: "config-data-default") pod "8690a5a2-3341-452e-8364-2e5e4072c192" (UID: "8690a5a2-3341-452e-8364-2e5e4072c192"). InnerVolumeSpecName "config-data-default". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.018788 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qh8n6\" (UniqueName: \"kubernetes.io/projected/c88c8ef0-5871-4507-9dcd-4c5312779d29-kube-api-access-qh8n6\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.018805 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/c88c8ef0-5871-4507-9dcd-4c5312779d29-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.021904 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8690a5a2-3341-452e-8364-2e5e4072c192-kube-api-access-c4d6w" (OuterVolumeSpecName: "kube-api-access-c4d6w") pod "8690a5a2-3341-452e-8364-2e5e4072c192" (UID: "8690a5a2-3341-452e-8364-2e5e4072c192"). InnerVolumeSpecName "kube-api-access-c4d6w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.033889 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage16-crc" (OuterVolumeSpecName: "mysql-db") pod "8690a5a2-3341-452e-8364-2e5e4072c192" (UID: "8690a5a2-3341-452e-8364-2e5e4072c192"). InnerVolumeSpecName "local-storage16-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.036980 5120 scope.go:117] "RemoveContainer" containerID="e96e5c721f9e1b4574a1448d5ba3da2db4cdf652e79ca865a8776a290e9a0553" Mar 16 16:30:38 crc kubenswrapper[5120]: E0316 16:30:38.037368 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e96e5c721f9e1b4574a1448d5ba3da2db4cdf652e79ca865a8776a290e9a0553\": container with ID starting with e96e5c721f9e1b4574a1448d5ba3da2db4cdf652e79ca865a8776a290e9a0553 not found: ID does not exist" containerID="e96e5c721f9e1b4574a1448d5ba3da2db4cdf652e79ca865a8776a290e9a0553" Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.037405 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e96e5c721f9e1b4574a1448d5ba3da2db4cdf652e79ca865a8776a290e9a0553"} err="failed to get container status \"e96e5c721f9e1b4574a1448d5ba3da2db4cdf652e79ca865a8776a290e9a0553\": rpc error: code = NotFound desc = could not find container \"e96e5c721f9e1b4574a1448d5ba3da2db4cdf652e79ca865a8776a290e9a0553\": container with ID starting with e96e5c721f9e1b4574a1448d5ba3da2db4cdf652e79ca865a8776a290e9a0553 not found: ID does not exist" Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.037425 5120 scope.go:117] "RemoveContainer" containerID="20a146198364dd3bab31073def314ae19daec57fd0b0b0ae40a65386d19d3bd0" Mar 16 16:30:38 crc kubenswrapper[5120]: E0316 16:30:38.037644 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"20a146198364dd3bab31073def314ae19daec57fd0b0b0ae40a65386d19d3bd0\": container with ID starting with 20a146198364dd3bab31073def314ae19daec57fd0b0b0ae40a65386d19d3bd0 not found: ID does not exist" containerID="20a146198364dd3bab31073def314ae19daec57fd0b0b0ae40a65386d19d3bd0" Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.037666 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20a146198364dd3bab31073def314ae19daec57fd0b0b0ae40a65386d19d3bd0"} err="failed to get container status \"20a146198364dd3bab31073def314ae19daec57fd0b0b0ae40a65386d19d3bd0\": rpc error: code = NotFound desc = could not find container \"20a146198364dd3bab31073def314ae19daec57fd0b0b0ae40a65386d19d3bd0\": container with ID starting with 20a146198364dd3bab31073def314ae19daec57fd0b0b0ae40a65386d19d3bd0 not found: ID does not exist" Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.037678 5120 scope.go:117] "RemoveContainer" containerID="0c87f1e5ac81b96f6ef9514dc786d98dfeb76235a80ea1a9c515704f7bb369ab" Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.054833 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8690a5a2-3341-452e-8364-2e5e4072c192-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "8690a5a2-3341-452e-8364-2e5e4072c192" (UID: "8690a5a2-3341-452e-8364-2e5e4072c192"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.058462 5120 scope.go:117] "RemoveContainer" containerID="07ebfddf2a30ff0b748ede18680624ba9dd698382919d1abdbdea7d864ee51b8" Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.067312 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8690a5a2-3341-452e-8364-2e5e4072c192-galera-tls-certs" (OuterVolumeSpecName: "galera-tls-certs") pod "8690a5a2-3341-452e-8364-2e5e4072c192" (UID: "8690a5a2-3341-452e-8364-2e5e4072c192"). InnerVolumeSpecName "galera-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.120353 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c4d6w\" (UniqueName: \"kubernetes.io/projected/8690a5a2-3341-452e-8364-2e5e4072c192-kube-api-access-c4d6w\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.120390 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/8690a5a2-3341-452e-8364-2e5e4072c192-config-data-default\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.120422 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") on node \"crc\" " Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.120436 5120 reconciler_common.go:299] "Volume detached for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/8690a5a2-3341-452e-8364-2e5e4072c192-galera-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.120446 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8690a5a2-3341-452e-8364-2e5e4072c192-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.129010 5120 scope.go:117] "RemoveContainer" containerID="0c87f1e5ac81b96f6ef9514dc786d98dfeb76235a80ea1a9c515704f7bb369ab" Mar 16 16:30:38 crc kubenswrapper[5120]: E0316 16:30:38.129519 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c87f1e5ac81b96f6ef9514dc786d98dfeb76235a80ea1a9c515704f7bb369ab\": container with ID starting with 0c87f1e5ac81b96f6ef9514dc786d98dfeb76235a80ea1a9c515704f7bb369ab not found: ID does not exist" containerID="0c87f1e5ac81b96f6ef9514dc786d98dfeb76235a80ea1a9c515704f7bb369ab" Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.129590 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c87f1e5ac81b96f6ef9514dc786d98dfeb76235a80ea1a9c515704f7bb369ab"} err="failed to get container status \"0c87f1e5ac81b96f6ef9514dc786d98dfeb76235a80ea1a9c515704f7bb369ab\": rpc error: code = NotFound desc = could not find container \"0c87f1e5ac81b96f6ef9514dc786d98dfeb76235a80ea1a9c515704f7bb369ab\": container with ID starting with 0c87f1e5ac81b96f6ef9514dc786d98dfeb76235a80ea1a9c515704f7bb369ab not found: ID does not exist" Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.129641 5120 scope.go:117] "RemoveContainer" containerID="07ebfddf2a30ff0b748ede18680624ba9dd698382919d1abdbdea7d864ee51b8" Mar 16 16:30:38 crc kubenswrapper[5120]: E0316 16:30:38.130143 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"07ebfddf2a30ff0b748ede18680624ba9dd698382919d1abdbdea7d864ee51b8\": container with ID starting with 07ebfddf2a30ff0b748ede18680624ba9dd698382919d1abdbdea7d864ee51b8 not found: ID does not exist" containerID="07ebfddf2a30ff0b748ede18680624ba9dd698382919d1abdbdea7d864ee51b8" Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.130172 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07ebfddf2a30ff0b748ede18680624ba9dd698382919d1abdbdea7d864ee51b8"} err="failed to get container status \"07ebfddf2a30ff0b748ede18680624ba9dd698382919d1abdbdea7d864ee51b8\": rpc error: code = NotFound desc = could not find container \"07ebfddf2a30ff0b748ede18680624ba9dd698382919d1abdbdea7d864ee51b8\": container with ID starting with 07ebfddf2a30ff0b748ede18680624ba9dd698382919d1abdbdea7d864ee51b8 not found: ID does not exist" Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.130196 5120 scope.go:117] "RemoveContainer" containerID="fef968df7f37fd8586399f475ea9ec49a678f4f4b47fe252028804652842452c" Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.139048 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage16-crc" (UniqueName: "kubernetes.io/local-volume/local-storage16-crc") on node "crc" Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.153228 5120 scope.go:117] "RemoveContainer" containerID="f59a6e760a98bbe533ef2a4ac3593867a1408a7b9aea9b121e3a1c5077272558" Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.173720 5120 scope.go:117] "RemoveContainer" containerID="fef968df7f37fd8586399f475ea9ec49a678f4f4b47fe252028804652842452c" Mar 16 16:30:38 crc kubenswrapper[5120]: E0316 16:30:38.174229 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fef968df7f37fd8586399f475ea9ec49a678f4f4b47fe252028804652842452c\": container with ID starting with fef968df7f37fd8586399f475ea9ec49a678f4f4b47fe252028804652842452c not found: ID does not exist" containerID="fef968df7f37fd8586399f475ea9ec49a678f4f4b47fe252028804652842452c" Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.174268 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fef968df7f37fd8586399f475ea9ec49a678f4f4b47fe252028804652842452c"} err="failed to get container status \"fef968df7f37fd8586399f475ea9ec49a678f4f4b47fe252028804652842452c\": rpc error: code = NotFound desc = could not find container \"fef968df7f37fd8586399f475ea9ec49a678f4f4b47fe252028804652842452c\": container with ID starting with fef968df7f37fd8586399f475ea9ec49a678f4f4b47fe252028804652842452c not found: ID does not exist" Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.174291 5120 scope.go:117] "RemoveContainer" containerID="f59a6e760a98bbe533ef2a4ac3593867a1408a7b9aea9b121e3a1c5077272558" Mar 16 16:30:38 crc kubenswrapper[5120]: E0316 16:30:38.174709 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f59a6e760a98bbe533ef2a4ac3593867a1408a7b9aea9b121e3a1c5077272558\": container with ID starting with f59a6e760a98bbe533ef2a4ac3593867a1408a7b9aea9b121e3a1c5077272558 not found: ID does not exist" containerID="f59a6e760a98bbe533ef2a4ac3593867a1408a7b9aea9b121e3a1c5077272558" Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.174742 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f59a6e760a98bbe533ef2a4ac3593867a1408a7b9aea9b121e3a1c5077272558"} err="failed to get container status \"f59a6e760a98bbe533ef2a4ac3593867a1408a7b9aea9b121e3a1c5077272558\": rpc error: code = NotFound desc = could not find container \"f59a6e760a98bbe533ef2a4ac3593867a1408a7b9aea9b121e3a1c5077272558\": container with ID starting with f59a6e760a98bbe533ef2a4ac3593867a1408a7b9aea9b121e3a1c5077272558 not found: ID does not exist" Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.174779 5120 scope.go:117] "RemoveContainer" containerID="73d36e223ac6cb16ad06c2743a3cc3ff1584c29e05d26a747bc98696b66104be" Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.200790 5120 scope.go:117] "RemoveContainer" containerID="2eb2cfc44a2ab4da95ff91fbb74bb09793c7659b0ff281328c6d6c9bcd535517" Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.223298 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:38 crc kubenswrapper[5120]: E0316 16:30:38.350169 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 67536b6d5411454dd60e69e85c9be26aac7288128b3d51416c45cd4056627842 is running failed: container process not found" containerID="67536b6d5411454dd60e69e85c9be26aac7288128b3d51416c45cd4056627842" cmd=["/bin/bash","/var/lib/operator-scripts/mysql_probe.sh","readiness"] Mar 16 16:30:38 crc kubenswrapper[5120]: E0316 16:30:38.350836 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 67536b6d5411454dd60e69e85c9be26aac7288128b3d51416c45cd4056627842 is running failed: container process not found" containerID="67536b6d5411454dd60e69e85c9be26aac7288128b3d51416c45cd4056627842" cmd=["/bin/bash","/var/lib/operator-scripts/mysql_probe.sh","readiness"] Mar 16 16:30:38 crc kubenswrapper[5120]: E0316 16:30:38.351367 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 67536b6d5411454dd60e69e85c9be26aac7288128b3d51416c45cd4056627842 is running failed: container process not found" containerID="67536b6d5411454dd60e69e85c9be26aac7288128b3d51416c45cd4056627842" cmd=["/bin/bash","/var/lib/operator-scripts/mysql_probe.sh","readiness"] Mar 16 16:30:38 crc kubenswrapper[5120]: E0316 16:30:38.351439 5120 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 67536b6d5411454dd60e69e85c9be26aac7288128b3d51416c45cd4056627842 is running failed: container process not found" probeType="Readiness" pod="openstack-kuttl-tests/openstack-cell1-galera-0" podUID="d4a96e7a-b22c-46b2-9fd4-9d8815d9f830" containerName="galera" probeResult="unknown" Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.399874 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-566c6b7f4b-gjml4" Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.425107 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/openstack-galera-0" podUID="b2f689fd-70ec-43c9-b2da-275e28deb94c" containerName="galera" containerID="cri-o://d645e41c18aff7040aae9d448377581ed6f256ae5069078c1d8b5d8cdbb7cbea" gracePeriod=26 Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.553567 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9cb535e7-55cc-4b9d-911c-58f8ed50bee6-logs\") pod \"9cb535e7-55cc-4b9d-911c-58f8ed50bee6\" (UID: \"9cb535e7-55cc-4b9d-911c-58f8ed50bee6\") " Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.553694 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9cb535e7-55cc-4b9d-911c-58f8ed50bee6-combined-ca-bundle\") pod \"9cb535e7-55cc-4b9d-911c-58f8ed50bee6\" (UID: \"9cb535e7-55cc-4b9d-911c-58f8ed50bee6\") " Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.553887 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9cb535e7-55cc-4b9d-911c-58f8ed50bee6-config-data\") pod \"9cb535e7-55cc-4b9d-911c-58f8ed50bee6\" (UID: \"9cb535e7-55cc-4b9d-911c-58f8ed50bee6\") " Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.554113 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xwrvp\" (UniqueName: \"kubernetes.io/projected/9cb535e7-55cc-4b9d-911c-58f8ed50bee6-kube-api-access-xwrvp\") pod \"9cb535e7-55cc-4b9d-911c-58f8ed50bee6\" (UID: \"9cb535e7-55cc-4b9d-911c-58f8ed50bee6\") " Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.554153 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/9cb535e7-55cc-4b9d-911c-58f8ed50bee6-config-data-custom\") pod \"9cb535e7-55cc-4b9d-911c-58f8ed50bee6\" (UID: \"9cb535e7-55cc-4b9d-911c-58f8ed50bee6\") " Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.556025 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9cb535e7-55cc-4b9d-911c-58f8ed50bee6-logs" (OuterVolumeSpecName: "logs") pod "9cb535e7-55cc-4b9d-911c-58f8ed50bee6" (UID: "9cb535e7-55cc-4b9d-911c-58f8ed50bee6"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.560933 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9cb535e7-55cc-4b9d-911c-58f8ed50bee6-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "9cb535e7-55cc-4b9d-911c-58f8ed50bee6" (UID: "9cb535e7-55cc-4b9d-911c-58f8ed50bee6"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.561045 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9cb535e7-55cc-4b9d-911c-58f8ed50bee6-kube-api-access-xwrvp" (OuterVolumeSpecName: "kube-api-access-xwrvp") pod "9cb535e7-55cc-4b9d-911c-58f8ed50bee6" (UID: "9cb535e7-55cc-4b9d-911c-58f8ed50bee6"). InnerVolumeSpecName "kube-api-access-xwrvp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.598377 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9cb535e7-55cc-4b9d-911c-58f8ed50bee6-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "9cb535e7-55cc-4b9d-911c-58f8ed50bee6" (UID: "9cb535e7-55cc-4b9d-911c-58f8ed50bee6"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.607663 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9cb535e7-55cc-4b9d-911c-58f8ed50bee6-config-data" (OuterVolumeSpecName: "config-data") pod "9cb535e7-55cc-4b9d-911c-58f8ed50bee6" (UID: "9cb535e7-55cc-4b9d-911c-58f8ed50bee6"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.656883 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9cb535e7-55cc-4b9d-911c-58f8ed50bee6-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.656919 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9cb535e7-55cc-4b9d-911c-58f8ed50bee6-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.656933 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xwrvp\" (UniqueName: \"kubernetes.io/projected/9cb535e7-55cc-4b9d-911c-58f8ed50bee6-kube-api-access-xwrvp\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.656946 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/9cb535e7-55cc-4b9d-911c-58f8ed50bee6-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.656956 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9cb535e7-55cc-4b9d-911c-58f8ed50bee6-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.682062 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-6bf8d6479c-9rjt6" Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.683992 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0c04a9e3-0a3b-4895-8703-bb958c3000fd" path="/var/lib/kubelet/pods/0c04a9e3-0a3b-4895-8703-bb958c3000fd/volumes" Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.684367 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="24ef8cf9-6eb2-44c4-8845-7db782f6a862" path="/var/lib/kubelet/pods/24ef8cf9-6eb2-44c4-8845-7db782f6a862/volumes" Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.684799 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="29ef1c2d-283b-421f-8631-ada83f6ea799" path="/var/lib/kubelet/pods/29ef1c2d-283b-421f-8631-ada83f6ea799/volumes" Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.685338 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3253648c-08a0-4d00-87e2-121fe9240d23" path="/var/lib/kubelet/pods/3253648c-08a0-4d00-87e2-121fe9240d23/volumes" Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.686906 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="51ac8589-b6a7-414d-94e5-731e217600c4" path="/var/lib/kubelet/pods/51ac8589-b6a7-414d-94e5-731e217600c4/volumes" Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.687744 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7d4aa5b5-78e4-464e-bee0-18da0561de5d" path="/var/lib/kubelet/pods/7d4aa5b5-78e4-464e-bee0-18da0561de5d/volumes" Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.688324 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="850510ce-da60-453a-88a8-475bc65bb0df" path="/var/lib/kubelet/pods/850510ce-da60-453a-88a8-475bc65bb0df/volumes" Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.689264 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-1" Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.689311 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9300c420-c173-4f86-ac91-7ada78b25041" path="/var/lib/kubelet/pods/9300c420-c173-4f86-ac91-7ada78b25041/volumes" Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.691870 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9943d2d4-e26d-4c91-942e-a6d788ac8c7e" path="/var/lib/kubelet/pods/9943d2d4-e26d-4c91-942e-a6d788ac8c7e/volumes" Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.692752 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-northd-0_c88c8ef0-5871-4507-9dcd-4c5312779d29/ovn-northd/0.log" Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.692777 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b4e407e7-1e20-455e-b1e5-d87ba8555a7a" path="/var/lib/kubelet/pods/b4e407e7-1e20-455e-b1e5-d87ba8555a7a/volumes" Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.693014 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.695517 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cecaa51b-004f-4941-99e2-23272d052fa7" path="/var/lib/kubelet/pods/cecaa51b-004f-4941-99e2-23272d052fa7/volumes" Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.699577 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed1bcd44-0ed6-4cb4-a735-798e033c8b08" path="/var/lib/kubelet/pods/ed1bcd44-0ed6-4cb4-a735-798e033c8b08/volumes" Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.701513 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f1ddadf2-8a01-49e5-a099-b192f793a36d" path="/var/lib/kubelet/pods/f1ddadf2-8a01-49e5-a099-b192f793a36d/volumes" Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.702882 5120 generic.go:358] "Generic (PLEG): container finished" podID="9cb535e7-55cc-4b9d-911c-58f8ed50bee6" containerID="e21b312f4394d0cf417797387371f78390ddb2171778c91b768199fbff017acc" exitCode=0 Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.702991 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-566c6b7f4b-gjml4" Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.707130 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.709679 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-6bf8d6479c-9rjt6" event={"ID":"0b62aed8-ea87-465a-be46-45ce06fedbb7","Type":"ContainerDied","Data":"53d4ad4e12a94e2b07d00ab9c5191113f00c86184d6fafabdf4364f9b75b5fc2"} Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.709728 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-1" event={"ID":"8690a5a2-3341-452e-8364-2e5e4072c192","Type":"ContainerDied","Data":"ab223e1e16f0f8cc1bf5b3521147f206bc926ab141b9ccaa62b8c25b862f8d5a"} Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.709744 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"c88c8ef0-5871-4507-9dcd-4c5312779d29","Type":"ContainerDied","Data":"7911218e07a123aa96b0e2441bdb7a8203f4010d40d19934b831cb52c79b324d"} Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.709804 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-566c6b7f4b-gjml4" event={"ID":"9cb535e7-55cc-4b9d-911c-58f8ed50bee6","Type":"ContainerDied","Data":"e21b312f4394d0cf417797387371f78390ddb2171778c91b768199fbff017acc"} Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.709817 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-566c6b7f4b-gjml4" event={"ID":"9cb535e7-55cc-4b9d-911c-58f8ed50bee6","Type":"ContainerDied","Data":"139fe8432dd1ea7d867e52305d1dac37bbb12ec543822fe2baf07be09cbee599"} Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.709836 5120 scope.go:117] "RemoveContainer" containerID="8074d2bb95bae655f4b9972b3d0c5821b80f93bf6f01feae8526fac4e817b9cb" Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.710581 5120 generic.go:358] "Generic (PLEG): container finished" podID="d4a96e7a-b22c-46b2-9fd4-9d8815d9f830" containerID="67536b6d5411454dd60e69e85c9be26aac7288128b3d51416c45cd4056627842" exitCode=0 Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.710652 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"d4a96e7a-b22c-46b2-9fd4-9d8815d9f830","Type":"ContainerDied","Data":"67536b6d5411454dd60e69e85c9be26aac7288128b3d51416c45cd4056627842"} Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.710682 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"d4a96e7a-b22c-46b2-9fd4-9d8815d9f830","Type":"ContainerDied","Data":"7acd8406a04b25baea6b928861181cefce694fb01dd2c2ddbe81a36d0c395fed"} Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.798796 5120 scope.go:117] "RemoveContainer" containerID="6e6cc6827a75b6a7267a1f48a96bcedc87a117cb4353ef6624dee5fe5204d958" Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.805047 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-1"] Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.839432 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-1"] Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.846294 5120 scope.go:117] "RemoveContainer" containerID="d09c5615132d524e6ebe54947498408c78bca6eb878816dc2f76280340a9e5c9" Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.851257 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-6bf8d6479c-9rjt6"] Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.859459 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-6bf8d6479c-9rjt6"] Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.866565 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-566c6b7f4b-gjml4"] Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.868985 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/d4a96e7a-b22c-46b2-9fd4-9d8815d9f830-config-data-default\") pod \"d4a96e7a-b22c-46b2-9fd4-9d8815d9f830\" (UID: \"d4a96e7a-b22c-46b2-9fd4-9d8815d9f830\") " Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.869283 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qftjt\" (UniqueName: \"kubernetes.io/projected/d4a96e7a-b22c-46b2-9fd4-9d8815d9f830-kube-api-access-qftjt\") pod \"d4a96e7a-b22c-46b2-9fd4-9d8815d9f830\" (UID: \"d4a96e7a-b22c-46b2-9fd4-9d8815d9f830\") " Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.869312 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"mysql-db\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") pod \"d4a96e7a-b22c-46b2-9fd4-9d8815d9f830\" (UID: \"d4a96e7a-b22c-46b2-9fd4-9d8815d9f830\") " Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.869362 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d4a96e7a-b22c-46b2-9fd4-9d8815d9f830-operator-scripts\") pod \"d4a96e7a-b22c-46b2-9fd4-9d8815d9f830\" (UID: \"d4a96e7a-b22c-46b2-9fd4-9d8815d9f830\") " Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.869414 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/d4a96e7a-b22c-46b2-9fd4-9d8815d9f830-galera-tls-certs\") pod \"d4a96e7a-b22c-46b2-9fd4-9d8815d9f830\" (UID: \"d4a96e7a-b22c-46b2-9fd4-9d8815d9f830\") " Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.869549 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/d4a96e7a-b22c-46b2-9fd4-9d8815d9f830-config-data-generated\") pod \"d4a96e7a-b22c-46b2-9fd4-9d8815d9f830\" (UID: \"d4a96e7a-b22c-46b2-9fd4-9d8815d9f830\") " Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.869636 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4a96e7a-b22c-46b2-9fd4-9d8815d9f830-config-data-default" (OuterVolumeSpecName: "config-data-default") pod "d4a96e7a-b22c-46b2-9fd4-9d8815d9f830" (UID: "d4a96e7a-b22c-46b2-9fd4-9d8815d9f830"). InnerVolumeSpecName "config-data-default". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.869671 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d4a96e7a-b22c-46b2-9fd4-9d8815d9f830-combined-ca-bundle\") pod \"d4a96e7a-b22c-46b2-9fd4-9d8815d9f830\" (UID: \"d4a96e7a-b22c-46b2-9fd4-9d8815d9f830\") " Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.869780 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/d4a96e7a-b22c-46b2-9fd4-9d8815d9f830-kolla-config\") pod \"d4a96e7a-b22c-46b2-9fd4-9d8815d9f830\" (UID: \"d4a96e7a-b22c-46b2-9fd4-9d8815d9f830\") " Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.870512 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4a96e7a-b22c-46b2-9fd4-9d8815d9f830-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "d4a96e7a-b22c-46b2-9fd4-9d8815d9f830" (UID: "d4a96e7a-b22c-46b2-9fd4-9d8815d9f830"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:30:38 crc kubenswrapper[5120]: E0316 16:30:38.870602 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Mar 16 16:30:38 crc kubenswrapper[5120]: E0316 16:30:38.870675 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b190faa2-d49d-424d-90bc-3e6e34d1b362-config-data podName:b190faa2-d49d-424d-90bc-3e6e34d1b362 nodeName:}" failed. No retries permitted until 2026-03-16 16:30:46.870655519 +0000 UTC m=+3549.024587176 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/b190faa2-d49d-424d-90bc-3e6e34d1b362-config-data") pod "rabbitmq-cell1-server-2" (UID: "b190faa2-d49d-424d-90bc-3e6e34d1b362") : configmap "rabbitmq-cell1-config-data" not found Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.870930 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d4a96e7a-b22c-46b2-9fd4-9d8815d9f830-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.870949 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/d4a96e7a-b22c-46b2-9fd4-9d8815d9f830-config-data-default\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:38 crc kubenswrapper[5120]: E0316 16:30:38.871457 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/neutron-config: secret "neutron-config" not found Mar 16 16:30:38 crc kubenswrapper[5120]: E0316 16:30:38.871537 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/325f32e1-5461-4d71-a30c-dee2528d6fb3-config podName:325f32e1-5461-4d71-a30c-dee2528d6fb3 nodeName:}" failed. No retries permitted until 2026-03-16 16:30:46.871512691 +0000 UTC m=+3549.025444338 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "config" (UniqueName: "kubernetes.io/secret/325f32e1-5461-4d71-a30c-dee2528d6fb3-config") pod "neutron-59d4fdd9db-tttbf" (UID: "325f32e1-5461-4d71-a30c-dee2528d6fb3") : secret "neutron-config" not found Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.871879 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4a96e7a-b22c-46b2-9fd4-9d8815d9f830-config-data-generated" (OuterVolumeSpecName: "config-data-generated") pod "d4a96e7a-b22c-46b2-9fd4-9d8815d9f830" (UID: "d4a96e7a-b22c-46b2-9fd4-9d8815d9f830"). InnerVolumeSpecName "config-data-generated". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.871935 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4a96e7a-b22c-46b2-9fd4-9d8815d9f830-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "d4a96e7a-b22c-46b2-9fd4-9d8815d9f830" (UID: "d4a96e7a-b22c-46b2-9fd4-9d8815d9f830"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:30:38 crc kubenswrapper[5120]: E0316 16:30:38.871978 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/neutron-httpd-config: secret "neutron-httpd-config" not found Mar 16 16:30:38 crc kubenswrapper[5120]: E0316 16:30:38.872037 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/325f32e1-5461-4d71-a30c-dee2528d6fb3-httpd-config podName:325f32e1-5461-4d71-a30c-dee2528d6fb3 nodeName:}" failed. No retries permitted until 2026-03-16 16:30:46.872017924 +0000 UTC m=+3549.025949661 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "httpd-config" (UniqueName: "kubernetes.io/secret/325f32e1-5461-4d71-a30c-dee2528d6fb3-httpd-config") pod "neutron-59d4fdd9db-tttbf" (UID: "325f32e1-5461-4d71-a30c-dee2528d6fb3") : secret "neutron-httpd-config" not found Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.876225 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-566c6b7f4b-gjml4"] Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.881351 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4a96e7a-b22c-46b2-9fd4-9d8815d9f830-kube-api-access-qftjt" (OuterVolumeSpecName: "kube-api-access-qftjt") pod "d4a96e7a-b22c-46b2-9fd4-9d8815d9f830" (UID: "d4a96e7a-b22c-46b2-9fd4-9d8815d9f830"). InnerVolumeSpecName "kube-api-access-qftjt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.891525 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.893037 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage11-crc" (OuterVolumeSpecName: "mysql-db") pod "d4a96e7a-b22c-46b2-9fd4-9d8815d9f830" (UID: "d4a96e7a-b22c-46b2-9fd4-9d8815d9f830"). InnerVolumeSpecName "local-storage11-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.898473 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.905392 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4a96e7a-b22c-46b2-9fd4-9d8815d9f830-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "d4a96e7a-b22c-46b2-9fd4-9d8815d9f830" (UID: "d4a96e7a-b22c-46b2-9fd4-9d8815d9f830"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.926920 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4a96e7a-b22c-46b2-9fd4-9d8815d9f830-galera-tls-certs" (OuterVolumeSpecName: "galera-tls-certs") pod "d4a96e7a-b22c-46b2-9fd4-9d8815d9f830" (UID: "d4a96e7a-b22c-46b2-9fd4-9d8815d9f830"). InnerVolumeSpecName "galera-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.973027 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qftjt\" (UniqueName: \"kubernetes.io/projected/d4a96e7a-b22c-46b2-9fd4-9d8815d9f830-kube-api-access-qftjt\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.973166 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") on node \"crc\" " Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.973189 5120 reconciler_common.go:299] "Volume detached for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/d4a96e7a-b22c-46b2-9fd4-9d8815d9f830-galera-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.973201 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/d4a96e7a-b22c-46b2-9fd4-9d8815d9f830-config-data-generated\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.973212 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d4a96e7a-b22c-46b2-9fd4-9d8815d9f830-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:38 crc kubenswrapper[5120]: I0316 16:30:38.973222 5120 reconciler_common.go:299] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/d4a96e7a-b22c-46b2-9fd4-9d8815d9f830-kolla-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.004568 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage11-crc" (UniqueName: "kubernetes.io/local-volume/local-storage11-crc") on node "crc" Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.061732 5120 scope.go:117] "RemoveContainer" containerID="cca86ca4bb425959b3293666ee823af2b2b49331f3e113b4ce0a7a9cf086803e" Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.075184 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:39 crc kubenswrapper[5120]: E0316 16:30:39.075269 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Mar 16 16:30:39 crc kubenswrapper[5120]: E0316 16:30:39.075353 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e1bf7ad2-f215-405b-84de-9429f90855f8-config-data podName:e1bf7ad2-f215-405b-84de-9429f90855f8 nodeName:}" failed. No retries permitted until 2026-03-16 16:30:47.075330833 +0000 UTC m=+3549.229262490 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/e1bf7ad2-f215-405b-84de-9429f90855f8-config-data") pod "rabbitmq-cell1-server-0" (UID: "e1bf7ad2-f215-405b-84de-9429f90855f8") : configmap "rabbitmq-cell1-config-data" not found Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.082271 5120 scope.go:117] "RemoveContainer" containerID="e1acde98a5a05ec8850ffa2722ab38d50f5f6d3995cf5efd90f9138ab9d44804" Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.115951 5120 scope.go:117] "RemoveContainer" containerID="e21b312f4394d0cf417797387371f78390ddb2171778c91b768199fbff017acc" Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.140805 5120 scope.go:117] "RemoveContainer" containerID="4739157a6d4b51c37814000e2ecdb4f3562bd3a81b3434bad9b0d3c2052c6f8e" Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.164470 5120 scope.go:117] "RemoveContainer" containerID="e21b312f4394d0cf417797387371f78390ddb2171778c91b768199fbff017acc" Mar 16 16:30:39 crc kubenswrapper[5120]: E0316 16:30:39.164984 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e21b312f4394d0cf417797387371f78390ddb2171778c91b768199fbff017acc\": container with ID starting with e21b312f4394d0cf417797387371f78390ddb2171778c91b768199fbff017acc not found: ID does not exist" containerID="e21b312f4394d0cf417797387371f78390ddb2171778c91b768199fbff017acc" Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.165087 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e21b312f4394d0cf417797387371f78390ddb2171778c91b768199fbff017acc"} err="failed to get container status \"e21b312f4394d0cf417797387371f78390ddb2171778c91b768199fbff017acc\": rpc error: code = NotFound desc = could not find container \"e21b312f4394d0cf417797387371f78390ddb2171778c91b768199fbff017acc\": container with ID starting with e21b312f4394d0cf417797387371f78390ddb2171778c91b768199fbff017acc not found: ID does not exist" Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.165115 5120 scope.go:117] "RemoveContainer" containerID="4739157a6d4b51c37814000e2ecdb4f3562bd3a81b3434bad9b0d3c2052c6f8e" Mar 16 16:30:39 crc kubenswrapper[5120]: E0316 16:30:39.165546 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4739157a6d4b51c37814000e2ecdb4f3562bd3a81b3434bad9b0d3c2052c6f8e\": container with ID starting with 4739157a6d4b51c37814000e2ecdb4f3562bd3a81b3434bad9b0d3c2052c6f8e not found: ID does not exist" containerID="4739157a6d4b51c37814000e2ecdb4f3562bd3a81b3434bad9b0d3c2052c6f8e" Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.165587 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4739157a6d4b51c37814000e2ecdb4f3562bd3a81b3434bad9b0d3c2052c6f8e"} err="failed to get container status \"4739157a6d4b51c37814000e2ecdb4f3562bd3a81b3434bad9b0d3c2052c6f8e\": rpc error: code = NotFound desc = could not find container \"4739157a6d4b51c37814000e2ecdb4f3562bd3a81b3434bad9b0d3c2052c6f8e\": container with ID starting with 4739157a6d4b51c37814000e2ecdb4f3562bd3a81b3434bad9b0d3c2052c6f8e not found: ID does not exist" Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.165599 5120 scope.go:117] "RemoveContainer" containerID="67536b6d5411454dd60e69e85c9be26aac7288128b3d51416c45cd4056627842" Mar 16 16:30:39 crc kubenswrapper[5120]: E0316 16:30:39.176856 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Mar 16 16:30:39 crc kubenswrapper[5120]: E0316 16:30:39.177079 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dbe6904f-2249-41c3-bb8a-a1b5817094c5-config-data podName:dbe6904f-2249-41c3-bb8a-a1b5817094c5 nodeName:}" failed. No retries permitted until 2026-03-16 16:30:47.177054533 +0000 UTC m=+3549.330986200 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/dbe6904f-2249-41c3-bb8a-a1b5817094c5-config-data") pod "rabbitmq-cell1-server-1" (UID: "dbe6904f-2249-41c3-bb8a-a1b5817094c5") : configmap "rabbitmq-cell1-config-data" not found Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.189803 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-2" Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.201909 5120 scope.go:117] "RemoveContainer" containerID="7cfc94fdd5733bd67d0af246197ff0cee02872b2035a14cf33ad03ce9b87935e" Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.229013 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.244683 5120 scope.go:117] "RemoveContainer" containerID="67536b6d5411454dd60e69e85c9be26aac7288128b3d51416c45cd4056627842" Mar 16 16:30:39 crc kubenswrapper[5120]: E0316 16:30:39.245083 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"67536b6d5411454dd60e69e85c9be26aac7288128b3d51416c45cd4056627842\": container with ID starting with 67536b6d5411454dd60e69e85c9be26aac7288128b3d51416c45cd4056627842 not found: ID does not exist" containerID="67536b6d5411454dd60e69e85c9be26aac7288128b3d51416c45cd4056627842" Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.245117 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67536b6d5411454dd60e69e85c9be26aac7288128b3d51416c45cd4056627842"} err="failed to get container status \"67536b6d5411454dd60e69e85c9be26aac7288128b3d51416c45cd4056627842\": rpc error: code = NotFound desc = could not find container \"67536b6d5411454dd60e69e85c9be26aac7288128b3d51416c45cd4056627842\": container with ID starting with 67536b6d5411454dd60e69e85c9be26aac7288128b3d51416c45cd4056627842 not found: ID does not exist" Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.245138 5120 scope.go:117] "RemoveContainer" containerID="7cfc94fdd5733bd67d0af246197ff0cee02872b2035a14cf33ad03ce9b87935e" Mar 16 16:30:39 crc kubenswrapper[5120]: E0316 16:30:39.246041 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7cfc94fdd5733bd67d0af246197ff0cee02872b2035a14cf33ad03ce9b87935e\": container with ID starting with 7cfc94fdd5733bd67d0af246197ff0cee02872b2035a14cf33ad03ce9b87935e not found: ID does not exist" containerID="7cfc94fdd5733bd67d0af246197ff0cee02872b2035a14cf33ad03ce9b87935e" Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.246070 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7cfc94fdd5733bd67d0af246197ff0cee02872b2035a14cf33ad03ce9b87935e"} err="failed to get container status \"7cfc94fdd5733bd67d0af246197ff0cee02872b2035a14cf33ad03ce9b87935e\": rpc error: code = NotFound desc = could not find container \"7cfc94fdd5733bd67d0af246197ff0cee02872b2035a14cf33ad03ce9b87935e\": container with ID starting with 7cfc94fdd5733bd67d0af246197ff0cee02872b2035a14cf33ad03ce9b87935e not found: ID does not exist" Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.278600 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/9ab03e09-ed0f-4675-82c7-e04f1c3937ce-erlang-cookie-secret\") pod \"9ab03e09-ed0f-4675-82c7-e04f1c3937ce\" (UID: \"9ab03e09-ed0f-4675-82c7-e04f1c3937ce\") " Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.278731 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/9ab03e09-ed0f-4675-82c7-e04f1c3937ce-rabbitmq-plugins\") pod \"9ab03e09-ed0f-4675-82c7-e04f1c3937ce\" (UID: \"9ab03e09-ed0f-4675-82c7-e04f1c3937ce\") " Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.278780 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/9ab03e09-ed0f-4675-82c7-e04f1c3937ce-rabbitmq-erlang-cookie\") pod \"9ab03e09-ed0f-4675-82c7-e04f1c3937ce\" (UID: \"9ab03e09-ed0f-4675-82c7-e04f1c3937ce\") " Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.278946 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/9ab03e09-ed0f-4675-82c7-e04f1c3937ce-server-conf\") pod \"9ab03e09-ed0f-4675-82c7-e04f1c3937ce\" (UID: \"9ab03e09-ed0f-4675-82c7-e04f1c3937ce\") " Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.278976 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/9ab03e09-ed0f-4675-82c7-e04f1c3937ce-plugins-conf\") pod \"9ab03e09-ed0f-4675-82c7-e04f1c3937ce\" (UID: \"9ab03e09-ed0f-4675-82c7-e04f1c3937ce\") " Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.279055 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/9ab03e09-ed0f-4675-82c7-e04f1c3937ce-rabbitmq-confd\") pod \"9ab03e09-ed0f-4675-82c7-e04f1c3937ce\" (UID: \"9ab03e09-ed0f-4675-82c7-e04f1c3937ce\") " Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.279093 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"persistence\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"9ab03e09-ed0f-4675-82c7-e04f1c3937ce\" (UID: \"9ab03e09-ed0f-4675-82c7-e04f1c3937ce\") " Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.279116 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p8pzc\" (UniqueName: \"kubernetes.io/projected/9ab03e09-ed0f-4675-82c7-e04f1c3937ce-kube-api-access-p8pzc\") pod \"9ab03e09-ed0f-4675-82c7-e04f1c3937ce\" (UID: \"9ab03e09-ed0f-4675-82c7-e04f1c3937ce\") " Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.279148 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/9ab03e09-ed0f-4675-82c7-e04f1c3937ce-pod-info\") pod \"9ab03e09-ed0f-4675-82c7-e04f1c3937ce\" (UID: \"9ab03e09-ed0f-4675-82c7-e04f1c3937ce\") " Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.279247 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/9ab03e09-ed0f-4675-82c7-e04f1c3937ce-config-data\") pod \"9ab03e09-ed0f-4675-82c7-e04f1c3937ce\" (UID: \"9ab03e09-ed0f-4675-82c7-e04f1c3937ce\") " Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.279327 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/9ab03e09-ed0f-4675-82c7-e04f1c3937ce-rabbitmq-tls\") pod \"9ab03e09-ed0f-4675-82c7-e04f1c3937ce\" (UID: \"9ab03e09-ed0f-4675-82c7-e04f1c3937ce\") " Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.279324 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ab03e09-ed0f-4675-82c7-e04f1c3937ce-rabbitmq-plugins" (OuterVolumeSpecName: "rabbitmq-plugins") pod "9ab03e09-ed0f-4675-82c7-e04f1c3937ce" (UID: "9ab03e09-ed0f-4675-82c7-e04f1c3937ce"). InnerVolumeSpecName "rabbitmq-plugins". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.279528 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ab03e09-ed0f-4675-82c7-e04f1c3937ce-rabbitmq-erlang-cookie" (OuterVolumeSpecName: "rabbitmq-erlang-cookie") pod "9ab03e09-ed0f-4675-82c7-e04f1c3937ce" (UID: "9ab03e09-ed0f-4675-82c7-e04f1c3937ce"). InnerVolumeSpecName "rabbitmq-erlang-cookie". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.280117 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/9ab03e09-ed0f-4675-82c7-e04f1c3937ce-rabbitmq-plugins\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.280135 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/9ab03e09-ed0f-4675-82c7-e04f1c3937ce-rabbitmq-erlang-cookie\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.281214 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ab03e09-ed0f-4675-82c7-e04f1c3937ce-plugins-conf" (OuterVolumeSpecName: "plugins-conf") pod "9ab03e09-ed0f-4675-82c7-e04f1c3937ce" (UID: "9ab03e09-ed0f-4675-82c7-e04f1c3937ce"). InnerVolumeSpecName "plugins-conf". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.284392 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage06-crc" (OuterVolumeSpecName: "persistence") pod "9ab03e09-ed0f-4675-82c7-e04f1c3937ce" (UID: "9ab03e09-ed0f-4675-82c7-e04f1c3937ce"). InnerVolumeSpecName "local-storage06-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.285003 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ab03e09-ed0f-4675-82c7-e04f1c3937ce-rabbitmq-tls" (OuterVolumeSpecName: "rabbitmq-tls") pod "9ab03e09-ed0f-4675-82c7-e04f1c3937ce" (UID: "9ab03e09-ed0f-4675-82c7-e04f1c3937ce"). InnerVolumeSpecName "rabbitmq-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.287255 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ab03e09-ed0f-4675-82c7-e04f1c3937ce-kube-api-access-p8pzc" (OuterVolumeSpecName: "kube-api-access-p8pzc") pod "9ab03e09-ed0f-4675-82c7-e04f1c3937ce" (UID: "9ab03e09-ed0f-4675-82c7-e04f1c3937ce"). InnerVolumeSpecName "kube-api-access-p8pzc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.291386 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9ab03e09-ed0f-4675-82c7-e04f1c3937ce-pod-info" (OuterVolumeSpecName: "pod-info") pod "9ab03e09-ed0f-4675-82c7-e04f1c3937ce" (UID: "9ab03e09-ed0f-4675-82c7-e04f1c3937ce"). InnerVolumeSpecName "pod-info". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.292918 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ab03e09-ed0f-4675-82c7-e04f1c3937ce-erlang-cookie-secret" (OuterVolumeSpecName: "erlang-cookie-secret") pod "9ab03e09-ed0f-4675-82c7-e04f1c3937ce" (UID: "9ab03e09-ed0f-4675-82c7-e04f1c3937ce"). InnerVolumeSpecName "erlang-cookie-secret". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.307960 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ab03e09-ed0f-4675-82c7-e04f1c3937ce-config-data" (OuterVolumeSpecName: "config-data") pod "9ab03e09-ed0f-4675-82c7-e04f1c3937ce" (UID: "9ab03e09-ed0f-4675-82c7-e04f1c3937ce"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.324500 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-1" Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.354554 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ab03e09-ed0f-4675-82c7-e04f1c3937ce-server-conf" (OuterVolumeSpecName: "server-conf") pod "9ab03e09-ed0f-4675-82c7-e04f1c3937ce" (UID: "9ab03e09-ed0f-4675-82c7-e04f1c3937ce"). InnerVolumeSpecName "server-conf". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.381209 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/4df637ef-8f2d-4eb1-8a51-327814195dbf-rabbitmq-erlang-cookie\") pod \"4df637ef-8f2d-4eb1-8a51-327814195dbf\" (UID: \"4df637ef-8f2d-4eb1-8a51-327814195dbf\") " Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.381398 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/4df637ef-8f2d-4eb1-8a51-327814195dbf-server-conf\") pod \"4df637ef-8f2d-4eb1-8a51-327814195dbf\" (UID: \"4df637ef-8f2d-4eb1-8a51-327814195dbf\") " Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.381549 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/4df637ef-8f2d-4eb1-8a51-327814195dbf-rabbitmq-plugins\") pod \"4df637ef-8f2d-4eb1-8a51-327814195dbf\" (UID: \"4df637ef-8f2d-4eb1-8a51-327814195dbf\") " Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.381585 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/4df637ef-8f2d-4eb1-8a51-327814195dbf-rabbitmq-tls\") pod \"4df637ef-8f2d-4eb1-8a51-327814195dbf\" (UID: \"4df637ef-8f2d-4eb1-8a51-327814195dbf\") " Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.381632 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/4df637ef-8f2d-4eb1-8a51-327814195dbf-rabbitmq-confd\") pod \"4df637ef-8f2d-4eb1-8a51-327814195dbf\" (UID: \"4df637ef-8f2d-4eb1-8a51-327814195dbf\") " Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.381711 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"persistence\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"4df637ef-8f2d-4eb1-8a51-327814195dbf\" (UID: \"4df637ef-8f2d-4eb1-8a51-327814195dbf\") " Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.381747 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4df637ef-8f2d-4eb1-8a51-327814195dbf-rabbitmq-erlang-cookie" (OuterVolumeSpecName: "rabbitmq-erlang-cookie") pod "4df637ef-8f2d-4eb1-8a51-327814195dbf" (UID: "4df637ef-8f2d-4eb1-8a51-327814195dbf"). InnerVolumeSpecName "rabbitmq-erlang-cookie". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.381789 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/4df637ef-8f2d-4eb1-8a51-327814195dbf-config-data\") pod \"4df637ef-8f2d-4eb1-8a51-327814195dbf\" (UID: \"4df637ef-8f2d-4eb1-8a51-327814195dbf\") " Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.382057 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4df637ef-8f2d-4eb1-8a51-327814195dbf-rabbitmq-plugins" (OuterVolumeSpecName: "rabbitmq-plugins") pod "4df637ef-8f2d-4eb1-8a51-327814195dbf" (UID: "4df637ef-8f2d-4eb1-8a51-327814195dbf"). InnerVolumeSpecName "rabbitmq-plugins". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.382232 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/4df637ef-8f2d-4eb1-8a51-327814195dbf-plugins-conf\") pod \"4df637ef-8f2d-4eb1-8a51-327814195dbf\" (UID: \"4df637ef-8f2d-4eb1-8a51-327814195dbf\") " Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.382282 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/4df637ef-8f2d-4eb1-8a51-327814195dbf-erlang-cookie-secret\") pod \"4df637ef-8f2d-4eb1-8a51-327814195dbf\" (UID: \"4df637ef-8f2d-4eb1-8a51-327814195dbf\") " Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.382355 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/4df637ef-8f2d-4eb1-8a51-327814195dbf-pod-info\") pod \"4df637ef-8f2d-4eb1-8a51-327814195dbf\" (UID: \"4df637ef-8f2d-4eb1-8a51-327814195dbf\") " Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.382436 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hr5gz\" (UniqueName: \"kubernetes.io/projected/4df637ef-8f2d-4eb1-8a51-327814195dbf-kube-api-access-hr5gz\") pod \"4df637ef-8f2d-4eb1-8a51-327814195dbf\" (UID: \"4df637ef-8f2d-4eb1-8a51-327814195dbf\") " Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.383495 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/9ab03e09-ed0f-4675-82c7-e04f1c3937ce-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.383516 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/9ab03e09-ed0f-4675-82c7-e04f1c3937ce-rabbitmq-tls\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.383526 5120 reconciler_common.go:299] "Volume detached for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/9ab03e09-ed0f-4675-82c7-e04f1c3937ce-erlang-cookie-secret\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.383536 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/4df637ef-8f2d-4eb1-8a51-327814195dbf-rabbitmq-erlang-cookie\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.383545 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/4df637ef-8f2d-4eb1-8a51-327814195dbf-rabbitmq-plugins\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.383554 5120 reconciler_common.go:299] "Volume detached for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/9ab03e09-ed0f-4675-82c7-e04f1c3937ce-server-conf\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.383562 5120 reconciler_common.go:299] "Volume detached for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/9ab03e09-ed0f-4675-82c7-e04f1c3937ce-plugins-conf\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.383580 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") on node \"crc\" " Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.383588 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p8pzc\" (UniqueName: \"kubernetes.io/projected/9ab03e09-ed0f-4675-82c7-e04f1c3937ce-kube-api-access-p8pzc\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.383597 5120 reconciler_common.go:299] "Volume detached for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/9ab03e09-ed0f-4675-82c7-e04f1c3937ce-pod-info\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.386442 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4df637ef-8f2d-4eb1-8a51-327814195dbf-plugins-conf" (OuterVolumeSpecName: "plugins-conf") pod "4df637ef-8f2d-4eb1-8a51-327814195dbf" (UID: "4df637ef-8f2d-4eb1-8a51-327814195dbf"). InnerVolumeSpecName "plugins-conf". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.386588 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4df637ef-8f2d-4eb1-8a51-327814195dbf-rabbitmq-tls" (OuterVolumeSpecName: "rabbitmq-tls") pod "4df637ef-8f2d-4eb1-8a51-327814195dbf" (UID: "4df637ef-8f2d-4eb1-8a51-327814195dbf"). InnerVolumeSpecName "rabbitmq-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.389576 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage08-crc" (OuterVolumeSpecName: "persistence") pod "4df637ef-8f2d-4eb1-8a51-327814195dbf" (UID: "4df637ef-8f2d-4eb1-8a51-327814195dbf"). InnerVolumeSpecName "local-storage08-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.390600 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4df637ef-8f2d-4eb1-8a51-327814195dbf-pod-info" (OuterVolumeSpecName: "pod-info") pod "4df637ef-8f2d-4eb1-8a51-327814195dbf" (UID: "4df637ef-8f2d-4eb1-8a51-327814195dbf"). InnerVolumeSpecName "pod-info". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.392339 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4df637ef-8f2d-4eb1-8a51-327814195dbf-erlang-cookie-secret" (OuterVolumeSpecName: "erlang-cookie-secret") pod "4df637ef-8f2d-4eb1-8a51-327814195dbf" (UID: "4df637ef-8f2d-4eb1-8a51-327814195dbf"). InnerVolumeSpecName "erlang-cookie-secret". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.395009 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4df637ef-8f2d-4eb1-8a51-327814195dbf-kube-api-access-hr5gz" (OuterVolumeSpecName: "kube-api-access-hr5gz") pod "4df637ef-8f2d-4eb1-8a51-327814195dbf" (UID: "4df637ef-8f2d-4eb1-8a51-327814195dbf"). InnerVolumeSpecName "kube-api-access-hr5gz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.401432 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ab03e09-ed0f-4675-82c7-e04f1c3937ce-rabbitmq-confd" (OuterVolumeSpecName: "rabbitmq-confd") pod "9ab03e09-ed0f-4675-82c7-e04f1c3937ce" (UID: "9ab03e09-ed0f-4675-82c7-e04f1c3937ce"). InnerVolumeSpecName "rabbitmq-confd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.405321 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4df637ef-8f2d-4eb1-8a51-327814195dbf-config-data" (OuterVolumeSpecName: "config-data") pod "4df637ef-8f2d-4eb1-8a51-327814195dbf" (UID: "4df637ef-8f2d-4eb1-8a51-327814195dbf"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.406179 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage06-crc" (UniqueName: "kubernetes.io/local-volume/local-storage06-crc") on node "crc" Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.433614 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4df637ef-8f2d-4eb1-8a51-327814195dbf-server-conf" (OuterVolumeSpecName: "server-conf") pod "4df637ef-8f2d-4eb1-8a51-327814195dbf" (UID: "4df637ef-8f2d-4eb1-8a51-327814195dbf"). InnerVolumeSpecName "server-conf". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.486724 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/a8e524d7-0cb0-4bec-9948-70d463625805-config-data\") pod \"a8e524d7-0cb0-4bec-9948-70d463625805\" (UID: \"a8e524d7-0cb0-4bec-9948-70d463625805\") " Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.486881 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/a8e524d7-0cb0-4bec-9948-70d463625805-server-conf\") pod \"a8e524d7-0cb0-4bec-9948-70d463625805\" (UID: \"a8e524d7-0cb0-4bec-9948-70d463625805\") " Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.486919 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/a8e524d7-0cb0-4bec-9948-70d463625805-plugins-conf\") pod \"a8e524d7-0cb0-4bec-9948-70d463625805\" (UID: \"a8e524d7-0cb0-4bec-9948-70d463625805\") " Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.486988 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8bdx7\" (UniqueName: \"kubernetes.io/projected/a8e524d7-0cb0-4bec-9948-70d463625805-kube-api-access-8bdx7\") pod \"a8e524d7-0cb0-4bec-9948-70d463625805\" (UID: \"a8e524d7-0cb0-4bec-9948-70d463625805\") " Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.487008 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"persistence\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"a8e524d7-0cb0-4bec-9948-70d463625805\" (UID: \"a8e524d7-0cb0-4bec-9948-70d463625805\") " Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.487242 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/a8e524d7-0cb0-4bec-9948-70d463625805-rabbitmq-tls\") pod \"a8e524d7-0cb0-4bec-9948-70d463625805\" (UID: \"a8e524d7-0cb0-4bec-9948-70d463625805\") " Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.487341 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/a8e524d7-0cb0-4bec-9948-70d463625805-rabbitmq-plugins\") pod \"a8e524d7-0cb0-4bec-9948-70d463625805\" (UID: \"a8e524d7-0cb0-4bec-9948-70d463625805\") " Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.487397 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/a8e524d7-0cb0-4bec-9948-70d463625805-erlang-cookie-secret\") pod \"a8e524d7-0cb0-4bec-9948-70d463625805\" (UID: \"a8e524d7-0cb0-4bec-9948-70d463625805\") " Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.487482 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/a8e524d7-0cb0-4bec-9948-70d463625805-rabbitmq-erlang-cookie\") pod \"a8e524d7-0cb0-4bec-9948-70d463625805\" (UID: \"a8e524d7-0cb0-4bec-9948-70d463625805\") " Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.487504 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/a8e524d7-0cb0-4bec-9948-70d463625805-rabbitmq-confd\") pod \"a8e524d7-0cb0-4bec-9948-70d463625805\" (UID: \"a8e524d7-0cb0-4bec-9948-70d463625805\") " Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.487576 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/a8e524d7-0cb0-4bec-9948-70d463625805-pod-info\") pod \"a8e524d7-0cb0-4bec-9948-70d463625805\" (UID: \"a8e524d7-0cb0-4bec-9948-70d463625805\") " Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.488263 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hr5gz\" (UniqueName: \"kubernetes.io/projected/4df637ef-8f2d-4eb1-8a51-327814195dbf-kube-api-access-hr5gz\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.488284 5120 reconciler_common.go:299] "Volume detached for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/4df637ef-8f2d-4eb1-8a51-327814195dbf-server-conf\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.488293 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/4df637ef-8f2d-4eb1-8a51-327814195dbf-rabbitmq-tls\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.488311 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") on node \"crc\" " Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.488320 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/4df637ef-8f2d-4eb1-8a51-327814195dbf-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.488329 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/9ab03e09-ed0f-4675-82c7-e04f1c3937ce-rabbitmq-confd\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.488337 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.488345 5120 reconciler_common.go:299] "Volume detached for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/4df637ef-8f2d-4eb1-8a51-327814195dbf-plugins-conf\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.488354 5120 reconciler_common.go:299] "Volume detached for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/4df637ef-8f2d-4eb1-8a51-327814195dbf-erlang-cookie-secret\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.488362 5120 reconciler_common.go:299] "Volume detached for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/4df637ef-8f2d-4eb1-8a51-327814195dbf-pod-info\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.490610 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8e524d7-0cb0-4bec-9948-70d463625805-rabbitmq-erlang-cookie" (OuterVolumeSpecName: "rabbitmq-erlang-cookie") pod "a8e524d7-0cb0-4bec-9948-70d463625805" (UID: "a8e524d7-0cb0-4bec-9948-70d463625805"). InnerVolumeSpecName "rabbitmq-erlang-cookie". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.491189 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8e524d7-0cb0-4bec-9948-70d463625805-rabbitmq-plugins" (OuterVolumeSpecName: "rabbitmq-plugins") pod "a8e524d7-0cb0-4bec-9948-70d463625805" (UID: "a8e524d7-0cb0-4bec-9948-70d463625805"). InnerVolumeSpecName "rabbitmq-plugins". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:30:39 crc kubenswrapper[5120]: E0316 16:30:39.488237 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 22bcc82ce48237f9410a024ede2e8c26cf4bb41d79f0bcc346c2026e82f50c35 is running failed: container process not found" containerID="22bcc82ce48237f9410a024ede2e8c26cf4bb41d79f0bcc346c2026e82f50c35" cmd=["/bin/bash","/var/lib/operator-scripts/mysql_probe.sh","readiness"] Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.491881 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a8e524d7-0cb0-4bec-9948-70d463625805-plugins-conf" (OuterVolumeSpecName: "plugins-conf") pod "a8e524d7-0cb0-4bec-9948-70d463625805" (UID: "a8e524d7-0cb0-4bec-9948-70d463625805"). InnerVolumeSpecName "plugins-conf". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.492084 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4df637ef-8f2d-4eb1-8a51-327814195dbf-rabbitmq-confd" (OuterVolumeSpecName: "rabbitmq-confd") pod "4df637ef-8f2d-4eb1-8a51-327814195dbf" (UID: "4df637ef-8f2d-4eb1-8a51-327814195dbf"). InnerVolumeSpecName "rabbitmq-confd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:30:39 crc kubenswrapper[5120]: E0316 16:30:39.492216 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 22bcc82ce48237f9410a024ede2e8c26cf4bb41d79f0bcc346c2026e82f50c35 is running failed: container process not found" containerID="22bcc82ce48237f9410a024ede2e8c26cf4bb41d79f0bcc346c2026e82f50c35" cmd=["/bin/bash","/var/lib/operator-scripts/mysql_probe.sh","readiness"] Mar 16 16:30:39 crc kubenswrapper[5120]: E0316 16:30:39.494073 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 22bcc82ce48237f9410a024ede2e8c26cf4bb41d79f0bcc346c2026e82f50c35 is running failed: container process not found" containerID="22bcc82ce48237f9410a024ede2e8c26cf4bb41d79f0bcc346c2026e82f50c35" cmd=["/bin/bash","/var/lib/operator-scripts/mysql_probe.sh","readiness"] Mar 16 16:30:39 crc kubenswrapper[5120]: E0316 16:30:39.494132 5120 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 22bcc82ce48237f9410a024ede2e8c26cf4bb41d79f0bcc346c2026e82f50c35 is running failed: container process not found" probeType="Readiness" pod="openstack-kuttl-tests/openstack-galera-1" podUID="fdc6ab64-e478-46f4-8e4b-6bf2e4460d91" containerName="galera" probeResult="unknown" Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.502413 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8e524d7-0cb0-4bec-9948-70d463625805-erlang-cookie-secret" (OuterVolumeSpecName: "erlang-cookie-secret") pod "a8e524d7-0cb0-4bec-9948-70d463625805" (UID: "a8e524d7-0cb0-4bec-9948-70d463625805"). InnerVolumeSpecName "erlang-cookie-secret". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.502479 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a8e524d7-0cb0-4bec-9948-70d463625805-pod-info" (OuterVolumeSpecName: "pod-info") pod "a8e524d7-0cb0-4bec-9948-70d463625805" (UID: "a8e524d7-0cb0-4bec-9948-70d463625805"). InnerVolumeSpecName "pod-info". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.502531 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage01-crc" (OuterVolumeSpecName: "persistence") pod "a8e524d7-0cb0-4bec-9948-70d463625805" (UID: "a8e524d7-0cb0-4bec-9948-70d463625805"). InnerVolumeSpecName "local-storage01-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.502799 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8e524d7-0cb0-4bec-9948-70d463625805-rabbitmq-tls" (OuterVolumeSpecName: "rabbitmq-tls") pod "a8e524d7-0cb0-4bec-9948-70d463625805" (UID: "a8e524d7-0cb0-4bec-9948-70d463625805"). InnerVolumeSpecName "rabbitmq-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.503140 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8e524d7-0cb0-4bec-9948-70d463625805-kube-api-access-8bdx7" (OuterVolumeSpecName: "kube-api-access-8bdx7") pod "a8e524d7-0cb0-4bec-9948-70d463625805" (UID: "a8e524d7-0cb0-4bec-9948-70d463625805"). InnerVolumeSpecName "kube-api-access-8bdx7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.510692 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage08-crc" (UniqueName: "kubernetes.io/local-volume/local-storage08-crc") on node "crc" Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.524012 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a8e524d7-0cb0-4bec-9948-70d463625805-config-data" (OuterVolumeSpecName: "config-data") pod "a8e524d7-0cb0-4bec-9948-70d463625805" (UID: "a8e524d7-0cb0-4bec-9948-70d463625805"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.544609 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a8e524d7-0cb0-4bec-9948-70d463625805-server-conf" (OuterVolumeSpecName: "server-conf") pod "a8e524d7-0cb0-4bec-9948-70d463625805" (UID: "a8e524d7-0cb0-4bec-9948-70d463625805"). InnerVolumeSpecName "server-conf". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.584229 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8e524d7-0cb0-4bec-9948-70d463625805-rabbitmq-confd" (OuterVolumeSpecName: "rabbitmq-confd") pod "a8e524d7-0cb0-4bec-9948-70d463625805" (UID: "a8e524d7-0cb0-4bec-9948-70d463625805"). InnerVolumeSpecName "rabbitmq-confd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.590467 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/a8e524d7-0cb0-4bec-9948-70d463625805-rabbitmq-tls\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.590502 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/a8e524d7-0cb0-4bec-9948-70d463625805-rabbitmq-plugins\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.590513 5120 reconciler_common.go:299] "Volume detached for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/a8e524d7-0cb0-4bec-9948-70d463625805-erlang-cookie-secret\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.590522 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/a8e524d7-0cb0-4bec-9948-70d463625805-rabbitmq-erlang-cookie\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.590532 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/a8e524d7-0cb0-4bec-9948-70d463625805-rabbitmq-confd\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.590540 5120 reconciler_common.go:299] "Volume detached for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/a8e524d7-0cb0-4bec-9948-70d463625805-pod-info\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.590548 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/4df637ef-8f2d-4eb1-8a51-327814195dbf-rabbitmq-confd\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.590556 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/a8e524d7-0cb0-4bec-9948-70d463625805-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.590563 5120 reconciler_common.go:299] "Volume detached for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/a8e524d7-0cb0-4bec-9948-70d463625805-server-conf\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.590572 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.590579 5120 reconciler_common.go:299] "Volume detached for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/a8e524d7-0cb0-4bec-9948-70d463625805-plugins-conf\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.590587 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8bdx7\" (UniqueName: \"kubernetes.io/projected/a8e524d7-0cb0-4bec-9948-70d463625805-kube-api-access-8bdx7\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.590614 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") on node \"crc\" " Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.609929 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage01-crc" (UniqueName: "kubernetes.io/local-volume/local-storage01-crc") on node "crc" Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.692784 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.724536 5120 generic.go:358] "Generic (PLEG): container finished" podID="4df637ef-8f2d-4eb1-8a51-327814195dbf" containerID="c7da8c850bcfaa6b77764f70b226aa97d27d819990e54a6faad91619f81e9005" exitCode=0 Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.724679 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"4df637ef-8f2d-4eb1-8a51-327814195dbf","Type":"ContainerDied","Data":"c7da8c850bcfaa6b77764f70b226aa97d27d819990e54a6faad91619f81e9005"} Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.724717 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"4df637ef-8f2d-4eb1-8a51-327814195dbf","Type":"ContainerDied","Data":"27c237fe0fc3d0964b92f1f742a70bdcf1a19e2e3c9f1cef12c7a35735ff9a46"} Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.724770 5120 scope.go:117] "RemoveContainer" containerID="c7da8c850bcfaa6b77764f70b226aa97d27d819990e54a6faad91619f81e9005" Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.725196 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.729651 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.737985 5120 generic.go:358] "Generic (PLEG): container finished" podID="fdc6ab64-e478-46f4-8e4b-6bf2e4460d91" containerID="22bcc82ce48237f9410a024ede2e8c26cf4bb41d79f0bcc346c2026e82f50c35" exitCode=0 Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.738074 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-1" event={"ID":"fdc6ab64-e478-46f4-8e4b-6bf2e4460d91","Type":"ContainerDied","Data":"22bcc82ce48237f9410a024ede2e8c26cf4bb41d79f0bcc346c2026e82f50c35"} Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.743620 5120 generic.go:358] "Generic (PLEG): container finished" podID="9ab03e09-ed0f-4675-82c7-e04f1c3937ce" containerID="c37ed1da6f16fabdc1a6782a38cfbfcec0a7cc7a1aebfee00bd24988fc28935f" exitCode=0 Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.743690 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-2" event={"ID":"9ab03e09-ed0f-4675-82c7-e04f1c3937ce","Type":"ContainerDied","Data":"c37ed1da6f16fabdc1a6782a38cfbfcec0a7cc7a1aebfee00bd24988fc28935f"} Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.743705 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-2" event={"ID":"9ab03e09-ed0f-4675-82c7-e04f1c3937ce","Type":"ContainerDied","Data":"8357a4172d3be5b545714c50cfb0c28d687f4b4b0da5143e42e920caf32ef8f6"} Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.743811 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-2" Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.749077 5120 generic.go:358] "Generic (PLEG): container finished" podID="a8e524d7-0cb0-4bec-9948-70d463625805" containerID="0ffcec825f56c969e28525148d56b9ac9132173717921abf5a8e79272b9d5b39" exitCode=0 Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.749232 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-1" Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.749310 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-1" event={"ID":"a8e524d7-0cb0-4bec-9948-70d463625805","Type":"ContainerDied","Data":"0ffcec825f56c969e28525148d56b9ac9132173717921abf5a8e79272b9d5b39"} Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.749389 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-1" event={"ID":"a8e524d7-0cb0-4bec-9948-70d463625805","Type":"ContainerDied","Data":"ac3cfa6ddc0853f95f3a0372431e32f77d805e70ab3d5ab31ec24ed3c0cc5e9e"} Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.810823 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-1" Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.828831 5120 scope.go:117] "RemoveContainer" containerID="165262826bdc38dd4fad2923abdc06d2a3dab7f65eb388bea00584b1ceb6a547" Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.853433 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.859427 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.892087 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-1"] Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.900267 5120 scope.go:117] "RemoveContainer" containerID="c7da8c850bcfaa6b77764f70b226aa97d27d819990e54a6faad91619f81e9005" Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.900383 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"mysql-db\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") pod \"fdc6ab64-e478-46f4-8e4b-6bf2e4460d91\" (UID: \"fdc6ab64-e478-46f4-8e4b-6bf2e4460d91\") " Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.900533 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fdc6ab64-e478-46f4-8e4b-6bf2e4460d91-combined-ca-bundle\") pod \"fdc6ab64-e478-46f4-8e4b-6bf2e4460d91\" (UID: \"fdc6ab64-e478-46f4-8e4b-6bf2e4460d91\") " Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.900666 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/fdc6ab64-e478-46f4-8e4b-6bf2e4460d91-config-data-default\") pod \"fdc6ab64-e478-46f4-8e4b-6bf2e4460d91\" (UID: \"fdc6ab64-e478-46f4-8e4b-6bf2e4460d91\") " Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.900749 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/fdc6ab64-e478-46f4-8e4b-6bf2e4460d91-operator-scripts\") pod \"fdc6ab64-e478-46f4-8e4b-6bf2e4460d91\" (UID: \"fdc6ab64-e478-46f4-8e4b-6bf2e4460d91\") " Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.900788 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gtjng\" (UniqueName: \"kubernetes.io/projected/fdc6ab64-e478-46f4-8e4b-6bf2e4460d91-kube-api-access-gtjng\") pod \"fdc6ab64-e478-46f4-8e4b-6bf2e4460d91\" (UID: \"fdc6ab64-e478-46f4-8e4b-6bf2e4460d91\") " Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.900820 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/fdc6ab64-e478-46f4-8e4b-6bf2e4460d91-galera-tls-certs\") pod \"fdc6ab64-e478-46f4-8e4b-6bf2e4460d91\" (UID: \"fdc6ab64-e478-46f4-8e4b-6bf2e4460d91\") " Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.900908 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/fdc6ab64-e478-46f4-8e4b-6bf2e4460d91-config-data-generated\") pod \"fdc6ab64-e478-46f4-8e4b-6bf2e4460d91\" (UID: \"fdc6ab64-e478-46f4-8e4b-6bf2e4460d91\") " Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.900941 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/fdc6ab64-e478-46f4-8e4b-6bf2e4460d91-kolla-config\") pod \"fdc6ab64-e478-46f4-8e4b-6bf2e4460d91\" (UID: \"fdc6ab64-e478-46f4-8e4b-6bf2e4460d91\") " Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.902084 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fdc6ab64-e478-46f4-8e4b-6bf2e4460d91-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "fdc6ab64-e478-46f4-8e4b-6bf2e4460d91" (UID: "fdc6ab64-e478-46f4-8e4b-6bf2e4460d91"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.902814 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fdc6ab64-e478-46f4-8e4b-6bf2e4460d91-config-data-default" (OuterVolumeSpecName: "config-data-default") pod "fdc6ab64-e478-46f4-8e4b-6bf2e4460d91" (UID: "fdc6ab64-e478-46f4-8e4b-6bf2e4460d91"). InnerVolumeSpecName "config-data-default". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:30:39 crc kubenswrapper[5120]: E0316 16:30:39.903252 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c7da8c850bcfaa6b77764f70b226aa97d27d819990e54a6faad91619f81e9005\": container with ID starting with c7da8c850bcfaa6b77764f70b226aa97d27d819990e54a6faad91619f81e9005 not found: ID does not exist" containerID="c7da8c850bcfaa6b77764f70b226aa97d27d819990e54a6faad91619f81e9005" Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.903308 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7da8c850bcfaa6b77764f70b226aa97d27d819990e54a6faad91619f81e9005"} err="failed to get container status \"c7da8c850bcfaa6b77764f70b226aa97d27d819990e54a6faad91619f81e9005\": rpc error: code = NotFound desc = could not find container \"c7da8c850bcfaa6b77764f70b226aa97d27d819990e54a6faad91619f81e9005\": container with ID starting with c7da8c850bcfaa6b77764f70b226aa97d27d819990e54a6faad91619f81e9005 not found: ID does not exist" Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.903332 5120 scope.go:117] "RemoveContainer" containerID="165262826bdc38dd4fad2923abdc06d2a3dab7f65eb388bea00584b1ceb6a547" Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.903419 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fdc6ab64-e478-46f4-8e4b-6bf2e4460d91-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "fdc6ab64-e478-46f4-8e4b-6bf2e4460d91" (UID: "fdc6ab64-e478-46f4-8e4b-6bf2e4460d91"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.903966 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fdc6ab64-e478-46f4-8e4b-6bf2e4460d91-config-data-generated" (OuterVolumeSpecName: "config-data-generated") pod "fdc6ab64-e478-46f4-8e4b-6bf2e4460d91" (UID: "fdc6ab64-e478-46f4-8e4b-6bf2e4460d91"). InnerVolumeSpecName "config-data-generated". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:30:39 crc kubenswrapper[5120]: E0316 16:30:39.905164 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"165262826bdc38dd4fad2923abdc06d2a3dab7f65eb388bea00584b1ceb6a547\": container with ID starting with 165262826bdc38dd4fad2923abdc06d2a3dab7f65eb388bea00584b1ceb6a547 not found: ID does not exist" containerID="165262826bdc38dd4fad2923abdc06d2a3dab7f65eb388bea00584b1ceb6a547" Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.905284 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"165262826bdc38dd4fad2923abdc06d2a3dab7f65eb388bea00584b1ceb6a547"} err="failed to get container status \"165262826bdc38dd4fad2923abdc06d2a3dab7f65eb388bea00584b1ceb6a547\": rpc error: code = NotFound desc = could not find container \"165262826bdc38dd4fad2923abdc06d2a3dab7f65eb388bea00584b1ceb6a547\": container with ID starting with 165262826bdc38dd4fad2923abdc06d2a3dab7f65eb388bea00584b1ceb6a547 not found: ID does not exist" Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.905314 5120 scope.go:117] "RemoveContainer" containerID="c37ed1da6f16fabdc1a6782a38cfbfcec0a7cc7a1aebfee00bd24988fc28935f" Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.918240 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-1"] Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.922041 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fdc6ab64-e478-46f4-8e4b-6bf2e4460d91-kube-api-access-gtjng" (OuterVolumeSpecName: "kube-api-access-gtjng") pod "fdc6ab64-e478-46f4-8e4b-6bf2e4460d91" (UID: "fdc6ab64-e478-46f4-8e4b-6bf2e4460d91"). InnerVolumeSpecName "kube-api-access-gtjng". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.922387 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage07-crc" (OuterVolumeSpecName: "mysql-db") pod "fdc6ab64-e478-46f4-8e4b-6bf2e4460d91" (UID: "fdc6ab64-e478-46f4-8e4b-6bf2e4460d91"). InnerVolumeSpecName "local-storage07-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.925786 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.933803 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.939547 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-2"] Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.942102 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fdc6ab64-e478-46f4-8e4b-6bf2e4460d91-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "fdc6ab64-e478-46f4-8e4b-6bf2e4460d91" (UID: "fdc6ab64-e478-46f4-8e4b-6bf2e4460d91"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.948932 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-2"] Mar 16 16:30:39 crc kubenswrapper[5120]: I0316 16:30:39.960334 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fdc6ab64-e478-46f4-8e4b-6bf2e4460d91-galera-tls-certs" (OuterVolumeSpecName: "galera-tls-certs") pod "fdc6ab64-e478-46f4-8e4b-6bf2e4460d91" (UID: "fdc6ab64-e478-46f4-8e4b-6bf2e4460d91"). InnerVolumeSpecName "galera-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.003375 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/fdc6ab64-e478-46f4-8e4b-6bf2e4460d91-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.003430 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gtjng\" (UniqueName: \"kubernetes.io/projected/fdc6ab64-e478-46f4-8e4b-6bf2e4460d91-kube-api-access-gtjng\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.003451 5120 reconciler_common.go:299] "Volume detached for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/fdc6ab64-e478-46f4-8e4b-6bf2e4460d91-galera-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.003466 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/fdc6ab64-e478-46f4-8e4b-6bf2e4460d91-config-data-generated\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.003482 5120 reconciler_common.go:299] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/fdc6ab64-e478-46f4-8e4b-6bf2e4460d91-kolla-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.003528 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage07-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") on node \"crc\" " Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.003546 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fdc6ab64-e478-46f4-8e4b-6bf2e4460d91-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.003558 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/fdc6ab64-e478-46f4-8e4b-6bf2e4460d91-config-data-default\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.022299 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage07-crc" (UniqueName: "kubernetes.io/local-volume/local-storage07-crc") on node "crc" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.105521 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage07-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.194169 5120 scope.go:117] "RemoveContainer" containerID="d74a3c4991867a062329d3cd6b295cd64d369bbf217d82583bf74e17039fc89d" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.228806 5120 scope.go:117] "RemoveContainer" containerID="c37ed1da6f16fabdc1a6782a38cfbfcec0a7cc7a1aebfee00bd24988fc28935f" Mar 16 16:30:40 crc kubenswrapper[5120]: E0316 16:30:40.229497 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c37ed1da6f16fabdc1a6782a38cfbfcec0a7cc7a1aebfee00bd24988fc28935f\": container with ID starting with c37ed1da6f16fabdc1a6782a38cfbfcec0a7cc7a1aebfee00bd24988fc28935f not found: ID does not exist" containerID="c37ed1da6f16fabdc1a6782a38cfbfcec0a7cc7a1aebfee00bd24988fc28935f" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.229553 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c37ed1da6f16fabdc1a6782a38cfbfcec0a7cc7a1aebfee00bd24988fc28935f"} err="failed to get container status \"c37ed1da6f16fabdc1a6782a38cfbfcec0a7cc7a1aebfee00bd24988fc28935f\": rpc error: code = NotFound desc = could not find container \"c37ed1da6f16fabdc1a6782a38cfbfcec0a7cc7a1aebfee00bd24988fc28935f\": container with ID starting with c37ed1da6f16fabdc1a6782a38cfbfcec0a7cc7a1aebfee00bd24988fc28935f not found: ID does not exist" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.229588 5120 scope.go:117] "RemoveContainer" containerID="d74a3c4991867a062329d3cd6b295cd64d369bbf217d82583bf74e17039fc89d" Mar 16 16:30:40 crc kubenswrapper[5120]: E0316 16:30:40.230089 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d74a3c4991867a062329d3cd6b295cd64d369bbf217d82583bf74e17039fc89d\": container with ID starting with d74a3c4991867a062329d3cd6b295cd64d369bbf217d82583bf74e17039fc89d not found: ID does not exist" containerID="d74a3c4991867a062329d3cd6b295cd64d369bbf217d82583bf74e17039fc89d" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.230131 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d74a3c4991867a062329d3cd6b295cd64d369bbf217d82583bf74e17039fc89d"} err="failed to get container status \"d74a3c4991867a062329d3cd6b295cd64d369bbf217d82583bf74e17039fc89d\": rpc error: code = NotFound desc = could not find container \"d74a3c4991867a062329d3cd6b295cd64d369bbf217d82583bf74e17039fc89d\": container with ID starting with d74a3c4991867a062329d3cd6b295cd64d369bbf217d82583bf74e17039fc89d not found: ID does not exist" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.230158 5120 scope.go:117] "RemoveContainer" containerID="0ffcec825f56c969e28525148d56b9ac9132173717921abf5a8e79272b9d5b39" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.258173 5120 scope.go:117] "RemoveContainer" containerID="6b7acd6d38b5a42151c6262787d12910dc418e4e0adb77e42bc25f6f78a2dfcd" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.285322 5120 scope.go:117] "RemoveContainer" containerID="0ffcec825f56c969e28525148d56b9ac9132173717921abf5a8e79272b9d5b39" Mar 16 16:30:40 crc kubenswrapper[5120]: E0316 16:30:40.285908 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0ffcec825f56c969e28525148d56b9ac9132173717921abf5a8e79272b9d5b39\": container with ID starting with 0ffcec825f56c969e28525148d56b9ac9132173717921abf5a8e79272b9d5b39 not found: ID does not exist" containerID="0ffcec825f56c969e28525148d56b9ac9132173717921abf5a8e79272b9d5b39" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.285952 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ffcec825f56c969e28525148d56b9ac9132173717921abf5a8e79272b9d5b39"} err="failed to get container status \"0ffcec825f56c969e28525148d56b9ac9132173717921abf5a8e79272b9d5b39\": rpc error: code = NotFound desc = could not find container \"0ffcec825f56c969e28525148d56b9ac9132173717921abf5a8e79272b9d5b39\": container with ID starting with 0ffcec825f56c969e28525148d56b9ac9132173717921abf5a8e79272b9d5b39 not found: ID does not exist" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.285977 5120 scope.go:117] "RemoveContainer" containerID="6b7acd6d38b5a42151c6262787d12910dc418e4e0adb77e42bc25f6f78a2dfcd" Mar 16 16:30:40 crc kubenswrapper[5120]: E0316 16:30:40.286289 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b7acd6d38b5a42151c6262787d12910dc418e4e0adb77e42bc25f6f78a2dfcd\": container with ID starting with 6b7acd6d38b5a42151c6262787d12910dc418e4e0adb77e42bc25f6f78a2dfcd not found: ID does not exist" containerID="6b7acd6d38b5a42151c6262787d12910dc418e4e0adb77e42bc25f6f78a2dfcd" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.286325 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b7acd6d38b5a42151c6262787d12910dc418e4e0adb77e42bc25f6f78a2dfcd"} err="failed to get container status \"6b7acd6d38b5a42151c6262787d12910dc418e4e0adb77e42bc25f6f78a2dfcd\": rpc error: code = NotFound desc = could not find container \"6b7acd6d38b5a42151c6262787d12910dc418e4e0adb77e42bc25f6f78a2dfcd\": container with ID starting with 6b7acd6d38b5a42151c6262787d12910dc418e4e0adb77e42bc25f6f78a2dfcd not found: ID does not exist" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.320658 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.358977 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-2" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.416377 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zqwtd\" (UniqueName: \"kubernetes.io/projected/e1bf7ad2-f215-405b-84de-9429f90855f8-kube-api-access-zqwtd\") pod \"e1bf7ad2-f215-405b-84de-9429f90855f8\" (UID: \"e1bf7ad2-f215-405b-84de-9429f90855f8\") " Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.416427 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/e1bf7ad2-f215-405b-84de-9429f90855f8-config-data\") pod \"e1bf7ad2-f215-405b-84de-9429f90855f8\" (UID: \"e1bf7ad2-f215-405b-84de-9429f90855f8\") " Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.416463 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/e1bf7ad2-f215-405b-84de-9429f90855f8-rabbitmq-plugins\") pod \"e1bf7ad2-f215-405b-84de-9429f90855f8\" (UID: \"e1bf7ad2-f215-405b-84de-9429f90855f8\") " Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.416548 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/e1bf7ad2-f215-405b-84de-9429f90855f8-rabbitmq-confd\") pod \"e1bf7ad2-f215-405b-84de-9429f90855f8\" (UID: \"e1bf7ad2-f215-405b-84de-9429f90855f8\") " Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.416622 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/e1bf7ad2-f215-405b-84de-9429f90855f8-rabbitmq-tls\") pod \"e1bf7ad2-f215-405b-84de-9429f90855f8\" (UID: \"e1bf7ad2-f215-405b-84de-9429f90855f8\") " Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.416741 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/e1bf7ad2-f215-405b-84de-9429f90855f8-plugins-conf\") pod \"e1bf7ad2-f215-405b-84de-9429f90855f8\" (UID: \"e1bf7ad2-f215-405b-84de-9429f90855f8\") " Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.416835 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/e1bf7ad2-f215-405b-84de-9429f90855f8-server-conf\") pod \"e1bf7ad2-f215-405b-84de-9429f90855f8\" (UID: \"e1bf7ad2-f215-405b-84de-9429f90855f8\") " Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.416919 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/e1bf7ad2-f215-405b-84de-9429f90855f8-pod-info\") pod \"e1bf7ad2-f215-405b-84de-9429f90855f8\" (UID: \"e1bf7ad2-f215-405b-84de-9429f90855f8\") " Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.417019 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/e1bf7ad2-f215-405b-84de-9429f90855f8-erlang-cookie-secret\") pod \"e1bf7ad2-f215-405b-84de-9429f90855f8\" (UID: \"e1bf7ad2-f215-405b-84de-9429f90855f8\") " Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.417098 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/e1bf7ad2-f215-405b-84de-9429f90855f8-rabbitmq-erlang-cookie\") pod \"e1bf7ad2-f215-405b-84de-9429f90855f8\" (UID: \"e1bf7ad2-f215-405b-84de-9429f90855f8\") " Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.417152 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"persistence\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") pod \"e1bf7ad2-f215-405b-84de-9429f90855f8\" (UID: \"e1bf7ad2-f215-405b-84de-9429f90855f8\") " Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.417274 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1bf7ad2-f215-405b-84de-9429f90855f8-rabbitmq-plugins" (OuterVolumeSpecName: "rabbitmq-plugins") pod "e1bf7ad2-f215-405b-84de-9429f90855f8" (UID: "e1bf7ad2-f215-405b-84de-9429f90855f8"). InnerVolumeSpecName "rabbitmq-plugins". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.417928 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1bf7ad2-f215-405b-84de-9429f90855f8-rabbitmq-erlang-cookie" (OuterVolumeSpecName: "rabbitmq-erlang-cookie") pod "e1bf7ad2-f215-405b-84de-9429f90855f8" (UID: "e1bf7ad2-f215-405b-84de-9429f90855f8"). InnerVolumeSpecName "rabbitmq-erlang-cookie". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.418145 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e1bf7ad2-f215-405b-84de-9429f90855f8-plugins-conf" (OuterVolumeSpecName: "plugins-conf") pod "e1bf7ad2-f215-405b-84de-9429f90855f8" (UID: "e1bf7ad2-f215-405b-84de-9429f90855f8"). InnerVolumeSpecName "plugins-conf". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.418146 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/e1bf7ad2-f215-405b-84de-9429f90855f8-rabbitmq-plugins\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.418202 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/e1bf7ad2-f215-405b-84de-9429f90855f8-rabbitmq-erlang-cookie\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.422681 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage18-crc" (OuterVolumeSpecName: "persistence") pod "e1bf7ad2-f215-405b-84de-9429f90855f8" (UID: "e1bf7ad2-f215-405b-84de-9429f90855f8"). InnerVolumeSpecName "local-storage18-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.423216 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e1bf7ad2-f215-405b-84de-9429f90855f8-pod-info" (OuterVolumeSpecName: "pod-info") pod "e1bf7ad2-f215-405b-84de-9429f90855f8" (UID: "e1bf7ad2-f215-405b-84de-9429f90855f8"). InnerVolumeSpecName "pod-info". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.423658 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1bf7ad2-f215-405b-84de-9429f90855f8-rabbitmq-tls" (OuterVolumeSpecName: "rabbitmq-tls") pod "e1bf7ad2-f215-405b-84de-9429f90855f8" (UID: "e1bf7ad2-f215-405b-84de-9429f90855f8"). InnerVolumeSpecName "rabbitmq-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.426661 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1bf7ad2-f215-405b-84de-9429f90855f8-kube-api-access-zqwtd" (OuterVolumeSpecName: "kube-api-access-zqwtd") pod "e1bf7ad2-f215-405b-84de-9429f90855f8" (UID: "e1bf7ad2-f215-405b-84de-9429f90855f8"). InnerVolumeSpecName "kube-api-access-zqwtd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.430908 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e1bf7ad2-f215-405b-84de-9429f90855f8-erlang-cookie-secret" (OuterVolumeSpecName: "erlang-cookie-secret") pod "e1bf7ad2-f215-405b-84de-9429f90855f8" (UID: "e1bf7ad2-f215-405b-84de-9429f90855f8"). InnerVolumeSpecName "erlang-cookie-secret". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:30:40 crc kubenswrapper[5120]: E0316 16:30:40.454371 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="1c7b11899133931bd406f6c19c7e46ecd6ae5021b5ed32c51931ad65ff554972" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:30:40 crc kubenswrapper[5120]: E0316 16:30:40.470219 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="1c7b11899133931bd406f6c19c7e46ecd6ae5021b5ed32c51931ad65ff554972" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:30:40 crc kubenswrapper[5120]: E0316 16:30:40.473229 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="1c7b11899133931bd406f6c19c7e46ecd6ae5021b5ed32c51931ad65ff554972" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:30:40 crc kubenswrapper[5120]: E0316 16:30:40.473308 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="7e45bb7a-9982-458f-80b5-60541c2d2daf" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.475365 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e1bf7ad2-f215-405b-84de-9429f90855f8-config-data" (OuterVolumeSpecName: "config-data") pod "e1bf7ad2-f215-405b-84de-9429f90855f8" (UID: "e1bf7ad2-f215-405b-84de-9429f90855f8"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.499188 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e1bf7ad2-f215-405b-84de-9429f90855f8-server-conf" (OuterVolumeSpecName: "server-conf") pod "e1bf7ad2-f215-405b-84de-9429f90855f8" (UID: "e1bf7ad2-f215-405b-84de-9429f90855f8"). InnerVolumeSpecName "server-conf". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.519259 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/b190faa2-d49d-424d-90bc-3e6e34d1b362-server-conf\") pod \"b190faa2-d49d-424d-90bc-3e6e34d1b362\" (UID: \"b190faa2-d49d-424d-90bc-3e6e34d1b362\") " Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.519329 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/b190faa2-d49d-424d-90bc-3e6e34d1b362-erlang-cookie-secret\") pod \"b190faa2-d49d-424d-90bc-3e6e34d1b362\" (UID: \"b190faa2-d49d-424d-90bc-3e6e34d1b362\") " Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.519361 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/b190faa2-d49d-424d-90bc-3e6e34d1b362-pod-info\") pod \"b190faa2-d49d-424d-90bc-3e6e34d1b362\" (UID: \"b190faa2-d49d-424d-90bc-3e6e34d1b362\") " Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.519461 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/b190faa2-d49d-424d-90bc-3e6e34d1b362-plugins-conf\") pod \"b190faa2-d49d-424d-90bc-3e6e34d1b362\" (UID: \"b190faa2-d49d-424d-90bc-3e6e34d1b362\") " Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.519540 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/b190faa2-d49d-424d-90bc-3e6e34d1b362-config-data\") pod \"b190faa2-d49d-424d-90bc-3e6e34d1b362\" (UID: \"b190faa2-d49d-424d-90bc-3e6e34d1b362\") " Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.519579 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/b190faa2-d49d-424d-90bc-3e6e34d1b362-rabbitmq-plugins\") pod \"b190faa2-d49d-424d-90bc-3e6e34d1b362\" (UID: \"b190faa2-d49d-424d-90bc-3e6e34d1b362\") " Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.519660 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/b190faa2-d49d-424d-90bc-3e6e34d1b362-rabbitmq-erlang-cookie\") pod \"b190faa2-d49d-424d-90bc-3e6e34d1b362\" (UID: \"b190faa2-d49d-424d-90bc-3e6e34d1b362\") " Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.519774 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zh7x4\" (UniqueName: \"kubernetes.io/projected/b190faa2-d49d-424d-90bc-3e6e34d1b362-kube-api-access-zh7x4\") pod \"b190faa2-d49d-424d-90bc-3e6e34d1b362\" (UID: \"b190faa2-d49d-424d-90bc-3e6e34d1b362\") " Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.519898 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"persistence\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") pod \"b190faa2-d49d-424d-90bc-3e6e34d1b362\" (UID: \"b190faa2-d49d-424d-90bc-3e6e34d1b362\") " Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.519957 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/b190faa2-d49d-424d-90bc-3e6e34d1b362-rabbitmq-confd\") pod \"b190faa2-d49d-424d-90bc-3e6e34d1b362\" (UID: \"b190faa2-d49d-424d-90bc-3e6e34d1b362\") " Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.520098 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/b190faa2-d49d-424d-90bc-3e6e34d1b362-rabbitmq-tls\") pod \"b190faa2-d49d-424d-90bc-3e6e34d1b362\" (UID: \"b190faa2-d49d-424d-90bc-3e6e34d1b362\") " Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.520977 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b190faa2-d49d-424d-90bc-3e6e34d1b362-rabbitmq-erlang-cookie" (OuterVolumeSpecName: "rabbitmq-erlang-cookie") pod "b190faa2-d49d-424d-90bc-3e6e34d1b362" (UID: "b190faa2-d49d-424d-90bc-3e6e34d1b362"). InnerVolumeSpecName "rabbitmq-erlang-cookie". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.521926 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b190faa2-d49d-424d-90bc-3e6e34d1b362-plugins-conf" (OuterVolumeSpecName: "plugins-conf") pod "b190faa2-d49d-424d-90bc-3e6e34d1b362" (UID: "b190faa2-d49d-424d-90bc-3e6e34d1b362"). InnerVolumeSpecName "plugins-conf". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.523365 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b190faa2-d49d-424d-90bc-3e6e34d1b362-rabbitmq-plugins" (OuterVolumeSpecName: "rabbitmq-plugins") pod "b190faa2-d49d-424d-90bc-3e6e34d1b362" (UID: "b190faa2-d49d-424d-90bc-3e6e34d1b362"). InnerVolumeSpecName "rabbitmq-plugins". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.523465 5120 reconciler_common.go:299] "Volume detached for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/e1bf7ad2-f215-405b-84de-9429f90855f8-pod-info\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.523717 5120 reconciler_common.go:299] "Volume detached for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/e1bf7ad2-f215-405b-84de-9429f90855f8-erlang-cookie-secret\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.523752 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage18-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") on node \"crc\" " Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.523784 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zqwtd\" (UniqueName: \"kubernetes.io/projected/e1bf7ad2-f215-405b-84de-9429f90855f8-kube-api-access-zqwtd\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.523801 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/e1bf7ad2-f215-405b-84de-9429f90855f8-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.523813 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/e1bf7ad2-f215-405b-84de-9429f90855f8-rabbitmq-tls\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.523825 5120 reconciler_common.go:299] "Volume detached for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/e1bf7ad2-f215-405b-84de-9429f90855f8-plugins-conf\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.523837 5120 reconciler_common.go:299] "Volume detached for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/e1bf7ad2-f215-405b-84de-9429f90855f8-server-conf\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.530404 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage14-crc" (OuterVolumeSpecName: "persistence") pod "b190faa2-d49d-424d-90bc-3e6e34d1b362" (UID: "b190faa2-d49d-424d-90bc-3e6e34d1b362"). InnerVolumeSpecName "local-storage14-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.530550 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b190faa2-d49d-424d-90bc-3e6e34d1b362-pod-info" (OuterVolumeSpecName: "pod-info") pod "b190faa2-d49d-424d-90bc-3e6e34d1b362" (UID: "b190faa2-d49d-424d-90bc-3e6e34d1b362"). InnerVolumeSpecName "pod-info". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.532012 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b190faa2-d49d-424d-90bc-3e6e34d1b362-kube-api-access-zh7x4" (OuterVolumeSpecName: "kube-api-access-zh7x4") pod "b190faa2-d49d-424d-90bc-3e6e34d1b362" (UID: "b190faa2-d49d-424d-90bc-3e6e34d1b362"). InnerVolumeSpecName "kube-api-access-zh7x4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.538964 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b190faa2-d49d-424d-90bc-3e6e34d1b362-erlang-cookie-secret" (OuterVolumeSpecName: "erlang-cookie-secret") pod "b190faa2-d49d-424d-90bc-3e6e34d1b362" (UID: "b190faa2-d49d-424d-90bc-3e6e34d1b362"). InnerVolumeSpecName "erlang-cookie-secret". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.545487 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b190faa2-d49d-424d-90bc-3e6e34d1b362-rabbitmq-tls" (OuterVolumeSpecName: "rabbitmq-tls") pod "b190faa2-d49d-424d-90bc-3e6e34d1b362" (UID: "b190faa2-d49d-424d-90bc-3e6e34d1b362"). InnerVolumeSpecName "rabbitmq-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.549900 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage18-crc" (UniqueName: "kubernetes.io/local-volume/local-storage18-crc") on node "crc" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.571098 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b190faa2-d49d-424d-90bc-3e6e34d1b362-config-data" (OuterVolumeSpecName: "config-data") pod "b190faa2-d49d-424d-90bc-3e6e34d1b362" (UID: "b190faa2-d49d-424d-90bc-3e6e34d1b362"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.578126 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b190faa2-d49d-424d-90bc-3e6e34d1b362-server-conf" (OuterVolumeSpecName: "server-conf") pod "b190faa2-d49d-424d-90bc-3e6e34d1b362" (UID: "b190faa2-d49d-424d-90bc-3e6e34d1b362"). InnerVolumeSpecName "server-conf". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.597915 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1bf7ad2-f215-405b-84de-9429f90855f8-rabbitmq-confd" (OuterVolumeSpecName: "rabbitmq-confd") pod "e1bf7ad2-f215-405b-84de-9429f90855f8" (UID: "e1bf7ad2-f215-405b-84de-9429f90855f8"). InnerVolumeSpecName "rabbitmq-confd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.620206 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b190faa2-d49d-424d-90bc-3e6e34d1b362-rabbitmq-confd" (OuterVolumeSpecName: "rabbitmq-confd") pod "b190faa2-d49d-424d-90bc-3e6e34d1b362" (UID: "b190faa2-d49d-424d-90bc-3e6e34d1b362"). InnerVolumeSpecName "rabbitmq-confd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.625710 5120 reconciler_common.go:299] "Volume detached for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/b190faa2-d49d-424d-90bc-3e6e34d1b362-plugins-conf\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.625739 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/b190faa2-d49d-424d-90bc-3e6e34d1b362-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.625751 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage18-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.625774 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/b190faa2-d49d-424d-90bc-3e6e34d1b362-rabbitmq-plugins\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.625808 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/b190faa2-d49d-424d-90bc-3e6e34d1b362-rabbitmq-erlang-cookie\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.625823 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zh7x4\" (UniqueName: \"kubernetes.io/projected/b190faa2-d49d-424d-90bc-3e6e34d1b362-kube-api-access-zh7x4\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.625834 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/e1bf7ad2-f215-405b-84de-9429f90855f8-rabbitmq-confd\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.625869 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") on node \"crc\" " Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.625881 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/b190faa2-d49d-424d-90bc-3e6e34d1b362-rabbitmq-confd\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.625894 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/b190faa2-d49d-424d-90bc-3e6e34d1b362-rabbitmq-tls\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.625904 5120 reconciler_common.go:299] "Volume detached for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/b190faa2-d49d-424d-90bc-3e6e34d1b362-server-conf\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.625915 5120 reconciler_common.go:299] "Volume detached for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/b190faa2-d49d-424d-90bc-3e6e34d1b362-erlang-cookie-secret\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.625927 5120 reconciler_common.go:299] "Volume detached for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/b190faa2-d49d-424d-90bc-3e6e34d1b362-pod-info\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.645343 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage14-crc" (UniqueName: "kubernetes.io/local-volume/local-storage14-crc") on node "crc" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.673204 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.674472 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b62aed8-ea87-465a-be46-45ce06fedbb7" path="/var/lib/kubelet/pods/0b62aed8-ea87-465a-be46-45ce06fedbb7/volumes" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.675328 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4df637ef-8f2d-4eb1-8a51-327814195dbf" path="/var/lib/kubelet/pods/4df637ef-8f2d-4eb1-8a51-327814195dbf/volumes" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.676201 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8690a5a2-3341-452e-8364-2e5e4072c192" path="/var/lib/kubelet/pods/8690a5a2-3341-452e-8364-2e5e4072c192/volumes" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.678306 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ab03e09-ed0f-4675-82c7-e04f1c3937ce" path="/var/lib/kubelet/pods/9ab03e09-ed0f-4675-82c7-e04f1c3937ce/volumes" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.678791 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-1" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.679254 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9cb535e7-55cc-4b9d-911c-58f8ed50bee6" path="/var/lib/kubelet/pods/9cb535e7-55cc-4b9d-911c-58f8ed50bee6/volumes" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.680707 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a8e524d7-0cb0-4bec-9948-70d463625805" path="/var/lib/kubelet/pods/a8e524d7-0cb0-4bec-9948-70d463625805/volumes" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.681542 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c88c8ef0-5871-4507-9dcd-4c5312779d29" path="/var/lib/kubelet/pods/c88c8ef0-5871-4507-9dcd-4c5312779d29/volumes" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.682877 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d4a96e7a-b22c-46b2-9fd4-9d8815d9f830" path="/var/lib/kubelet/pods/d4a96e7a-b22c-46b2-9fd4-9d8815d9f830/volumes" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.727345 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b2f689fd-70ec-43c9-b2da-275e28deb94c-operator-scripts\") pod \"b2f689fd-70ec-43c9-b2da-275e28deb94c\" (UID: \"b2f689fd-70ec-43c9-b2da-275e28deb94c\") " Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.727395 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/dbe6904f-2249-41c3-bb8a-a1b5817094c5-rabbitmq-plugins\") pod \"dbe6904f-2249-41c3-bb8a-a1b5817094c5\" (UID: \"dbe6904f-2249-41c3-bb8a-a1b5817094c5\") " Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.727424 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/b2f689fd-70ec-43c9-b2da-275e28deb94c-kolla-config\") pod \"b2f689fd-70ec-43c9-b2da-275e28deb94c\" (UID: \"b2f689fd-70ec-43c9-b2da-275e28deb94c\") " Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.727468 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/dbe6904f-2249-41c3-bb8a-a1b5817094c5-rabbitmq-confd\") pod \"dbe6904f-2249-41c3-bb8a-a1b5817094c5\" (UID: \"dbe6904f-2249-41c3-bb8a-a1b5817094c5\") " Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.727482 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hb2tk\" (UniqueName: \"kubernetes.io/projected/b2f689fd-70ec-43c9-b2da-275e28deb94c-kube-api-access-hb2tk\") pod \"b2f689fd-70ec-43c9-b2da-275e28deb94c\" (UID: \"b2f689fd-70ec-43c9-b2da-275e28deb94c\") " Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.727516 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/dbe6904f-2249-41c3-bb8a-a1b5817094c5-rabbitmq-erlang-cookie\") pod \"dbe6904f-2249-41c3-bb8a-a1b5817094c5\" (UID: \"dbe6904f-2249-41c3-bb8a-a1b5817094c5\") " Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.727540 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/b2f689fd-70ec-43c9-b2da-275e28deb94c-config-data-generated\") pod \"b2f689fd-70ec-43c9-b2da-275e28deb94c\" (UID: \"b2f689fd-70ec-43c9-b2da-275e28deb94c\") " Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.727582 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b2f689fd-70ec-43c9-b2da-275e28deb94c-combined-ca-bundle\") pod \"b2f689fd-70ec-43c9-b2da-275e28deb94c\" (UID: \"b2f689fd-70ec-43c9-b2da-275e28deb94c\") " Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.727609 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/dbe6904f-2249-41c3-bb8a-a1b5817094c5-rabbitmq-tls\") pod \"dbe6904f-2249-41c3-bb8a-a1b5817094c5\" (UID: \"dbe6904f-2249-41c3-bb8a-a1b5817094c5\") " Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.727634 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/dbe6904f-2249-41c3-bb8a-a1b5817094c5-server-conf\") pod \"dbe6904f-2249-41c3-bb8a-a1b5817094c5\" (UID: \"dbe6904f-2249-41c3-bb8a-a1b5817094c5\") " Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.727666 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rmbrs\" (UniqueName: \"kubernetes.io/projected/dbe6904f-2249-41c3-bb8a-a1b5817094c5-kube-api-access-rmbrs\") pod \"dbe6904f-2249-41c3-bb8a-a1b5817094c5\" (UID: \"dbe6904f-2249-41c3-bb8a-a1b5817094c5\") " Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.727687 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/dbe6904f-2249-41c3-bb8a-a1b5817094c5-erlang-cookie-secret\") pod \"dbe6904f-2249-41c3-bb8a-a1b5817094c5\" (UID: \"dbe6904f-2249-41c3-bb8a-a1b5817094c5\") " Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.727701 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/b2f689fd-70ec-43c9-b2da-275e28deb94c-galera-tls-certs\") pod \"b2f689fd-70ec-43c9-b2da-275e28deb94c\" (UID: \"b2f689fd-70ec-43c9-b2da-275e28deb94c\") " Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.727715 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"mysql-db\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"b2f689fd-70ec-43c9-b2da-275e28deb94c\" (UID: \"b2f689fd-70ec-43c9-b2da-275e28deb94c\") " Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.727730 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"persistence\" (UniqueName: \"kubernetes.io/local-volume/local-storage15-crc\") pod \"dbe6904f-2249-41c3-bb8a-a1b5817094c5\" (UID: \"dbe6904f-2249-41c3-bb8a-a1b5817094c5\") " Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.727747 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/dbe6904f-2249-41c3-bb8a-a1b5817094c5-config-data\") pod \"dbe6904f-2249-41c3-bb8a-a1b5817094c5\" (UID: \"dbe6904f-2249-41c3-bb8a-a1b5817094c5\") " Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.727820 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/dbe6904f-2249-41c3-bb8a-a1b5817094c5-plugins-conf\") pod \"dbe6904f-2249-41c3-bb8a-a1b5817094c5\" (UID: \"dbe6904f-2249-41c3-bb8a-a1b5817094c5\") " Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.727878 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/b2f689fd-70ec-43c9-b2da-275e28deb94c-config-data-default\") pod \"b2f689fd-70ec-43c9-b2da-275e28deb94c\" (UID: \"b2f689fd-70ec-43c9-b2da-275e28deb94c\") " Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.727962 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/dbe6904f-2249-41c3-bb8a-a1b5817094c5-pod-info\") pod \"dbe6904f-2249-41c3-bb8a-a1b5817094c5\" (UID: \"dbe6904f-2249-41c3-bb8a-a1b5817094c5\") " Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.728416 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.729990 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbe6904f-2249-41c3-bb8a-a1b5817094c5-rabbitmq-plugins" (OuterVolumeSpecName: "rabbitmq-plugins") pod "dbe6904f-2249-41c3-bb8a-a1b5817094c5" (UID: "dbe6904f-2249-41c3-bb8a-a1b5817094c5"). InnerVolumeSpecName "rabbitmq-plugins". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.730043 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbe6904f-2249-41c3-bb8a-a1b5817094c5-rabbitmq-erlang-cookie" (OuterVolumeSpecName: "rabbitmq-erlang-cookie") pod "dbe6904f-2249-41c3-bb8a-a1b5817094c5" (UID: "dbe6904f-2249-41c3-bb8a-a1b5817094c5"). InnerVolumeSpecName "rabbitmq-erlang-cookie". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.730101 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2f689fd-70ec-43c9-b2da-275e28deb94c-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "b2f689fd-70ec-43c9-b2da-275e28deb94c" (UID: "b2f689fd-70ec-43c9-b2da-275e28deb94c"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.730225 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2f689fd-70ec-43c9-b2da-275e28deb94c-config-data-generated" (OuterVolumeSpecName: "config-data-generated") pod "b2f689fd-70ec-43c9-b2da-275e28deb94c" (UID: "b2f689fd-70ec-43c9-b2da-275e28deb94c"). InnerVolumeSpecName "config-data-generated". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.730614 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dbe6904f-2249-41c3-bb8a-a1b5817094c5-plugins-conf" (OuterVolumeSpecName: "plugins-conf") pod "dbe6904f-2249-41c3-bb8a-a1b5817094c5" (UID: "dbe6904f-2249-41c3-bb8a-a1b5817094c5"). InnerVolumeSpecName "plugins-conf". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.730784 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2f689fd-70ec-43c9-b2da-275e28deb94c-config-data-default" (OuterVolumeSpecName: "config-data-default") pod "b2f689fd-70ec-43c9-b2da-275e28deb94c" (UID: "b2f689fd-70ec-43c9-b2da-275e28deb94c"). InnerVolumeSpecName "config-data-default". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.733020 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/dbe6904f-2249-41c3-bb8a-a1b5817094c5-pod-info" (OuterVolumeSpecName: "pod-info") pod "dbe6904f-2249-41c3-bb8a-a1b5817094c5" (UID: "dbe6904f-2249-41c3-bb8a-a1b5817094c5"). InnerVolumeSpecName "pod-info". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.733370 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dbe6904f-2249-41c3-bb8a-a1b5817094c5-rabbitmq-tls" (OuterVolumeSpecName: "rabbitmq-tls") pod "dbe6904f-2249-41c3-bb8a-a1b5817094c5" (UID: "dbe6904f-2249-41c3-bb8a-a1b5817094c5"). InnerVolumeSpecName "rabbitmq-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.733511 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2f689fd-70ec-43c9-b2da-275e28deb94c-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "b2f689fd-70ec-43c9-b2da-275e28deb94c" (UID: "b2f689fd-70ec-43c9-b2da-275e28deb94c"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.734266 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2f689fd-70ec-43c9-b2da-275e28deb94c-kube-api-access-hb2tk" (OuterVolumeSpecName: "kube-api-access-hb2tk") pod "b2f689fd-70ec-43c9-b2da-275e28deb94c" (UID: "b2f689fd-70ec-43c9-b2da-275e28deb94c"). InnerVolumeSpecName "kube-api-access-hb2tk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.734272 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dbe6904f-2249-41c3-bb8a-a1b5817094c5-erlang-cookie-secret" (OuterVolumeSpecName: "erlang-cookie-secret") pod "dbe6904f-2249-41c3-bb8a-a1b5817094c5" (UID: "dbe6904f-2249-41c3-bb8a-a1b5817094c5"). InnerVolumeSpecName "erlang-cookie-secret". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.734710 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dbe6904f-2249-41c3-bb8a-a1b5817094c5-kube-api-access-rmbrs" (OuterVolumeSpecName: "kube-api-access-rmbrs") pod "dbe6904f-2249-41c3-bb8a-a1b5817094c5" (UID: "dbe6904f-2249-41c3-bb8a-a1b5817094c5"). InnerVolumeSpecName "kube-api-access-rmbrs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.735485 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage15-crc" (OuterVolumeSpecName: "persistence") pod "dbe6904f-2249-41c3-bb8a-a1b5817094c5" (UID: "dbe6904f-2249-41c3-bb8a-a1b5817094c5"). InnerVolumeSpecName "local-storage15-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.750039 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage09-crc" (OuterVolumeSpecName: "mysql-db") pod "b2f689fd-70ec-43c9-b2da-275e28deb94c" (UID: "b2f689fd-70ec-43c9-b2da-275e28deb94c"). InnerVolumeSpecName "local-storage09-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.772139 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dbe6904f-2249-41c3-bb8a-a1b5817094c5-config-data" (OuterVolumeSpecName: "config-data") pod "dbe6904f-2249-41c3-bb8a-a1b5817094c5" (UID: "dbe6904f-2249-41c3-bb8a-a1b5817094c5"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.772422 5120 generic.go:358] "Generic (PLEG): container finished" podID="e1bf7ad2-f215-405b-84de-9429f90855f8" containerID="e890194391fce067d02b1a137a5f39d7a59911e519be323ded2d6c7dbe78f932" exitCode=0 Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.772560 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.772624 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"e1bf7ad2-f215-405b-84de-9429f90855f8","Type":"ContainerDied","Data":"e890194391fce067d02b1a137a5f39d7a59911e519be323ded2d6c7dbe78f932"} Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.772893 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"e1bf7ad2-f215-405b-84de-9429f90855f8","Type":"ContainerDied","Data":"a9d05618fbce15826083714aac41f723c91770f65de5728e24c0c0da9ba83696"} Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.772936 5120 scope.go:117] "RemoveContainer" containerID="e890194391fce067d02b1a137a5f39d7a59911e519be323ded2d6c7dbe78f932" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.775976 5120 generic.go:358] "Generic (PLEG): container finished" podID="dbe6904f-2249-41c3-bb8a-a1b5817094c5" containerID="efa6791ca8f5aaec639eb569281ad36ec0672df0bc56d4887c44877a37c8a1e4" exitCode=0 Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.776063 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-1" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.776067 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-1" event={"ID":"dbe6904f-2249-41c3-bb8a-a1b5817094c5","Type":"ContainerDied","Data":"efa6791ca8f5aaec639eb569281ad36ec0672df0bc56d4887c44877a37c8a1e4"} Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.776095 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-1" event={"ID":"dbe6904f-2249-41c3-bb8a-a1b5817094c5","Type":"ContainerDied","Data":"ec044ec59b9dedccde49d5f70a88cbcb9fc06cd0fcd8d9445fcbe5ae63492a94"} Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.779276 5120 generic.go:358] "Generic (PLEG): container finished" podID="b190faa2-d49d-424d-90bc-3e6e34d1b362" containerID="1af24cc4ef41d3c7f4136a8089e28219a6259af0444d27c19d5201dc4b1a70e5" exitCode=0 Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.779340 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-2" event={"ID":"b190faa2-d49d-424d-90bc-3e6e34d1b362","Type":"ContainerDied","Data":"1af24cc4ef41d3c7f4136a8089e28219a6259af0444d27c19d5201dc4b1a70e5"} Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.779362 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-2" event={"ID":"b190faa2-d49d-424d-90bc-3e6e34d1b362","Type":"ContainerDied","Data":"dbb0c318ea1574974ea3784782543c9b3a04a58b19c5a3183ea2c20e3adf60f6"} Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.779441 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-2" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.785153 5120 generic.go:358] "Generic (PLEG): container finished" podID="b2f689fd-70ec-43c9-b2da-275e28deb94c" containerID="d645e41c18aff7040aae9d448377581ed6f256ae5069078c1d8b5d8cdbb7cbea" exitCode=0 Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.785220 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"b2f689fd-70ec-43c9-b2da-275e28deb94c","Type":"ContainerDied","Data":"d645e41c18aff7040aae9d448377581ed6f256ae5069078c1d8b5d8cdbb7cbea"} Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.785242 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"b2f689fd-70ec-43c9-b2da-275e28deb94c","Type":"ContainerDied","Data":"c06ce3a93a49bfeaa1ee779a5b374ebf95ad0cc08d1b931dbe4a3522f1919a3d"} Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.785250 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b2f689fd-70ec-43c9-b2da-275e28deb94c-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "b2f689fd-70ec-43c9-b2da-275e28deb94c" (UID: "b2f689fd-70ec-43c9-b2da-275e28deb94c"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.785305 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.791048 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-1" event={"ID":"fdc6ab64-e478-46f4-8e4b-6bf2e4460d91","Type":"ContainerDied","Data":"aa68c9b3816a486f63defe97b616bb74cd6d1700329bafeb872182309ecb975f"} Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.791141 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-1" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.795066 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b2f689fd-70ec-43c9-b2da-275e28deb94c-galera-tls-certs" (OuterVolumeSpecName: "galera-tls-certs") pod "b2f689fd-70ec-43c9-b2da-275e28deb94c" (UID: "b2f689fd-70ec-43c9-b2da-275e28deb94c"). InnerVolumeSpecName "galera-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.800079 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dbe6904f-2249-41c3-bb8a-a1b5817094c5-server-conf" (OuterVolumeSpecName: "server-conf") pod "dbe6904f-2249-41c3-bb8a-a1b5817094c5" (UID: "dbe6904f-2249-41c3-bb8a-a1b5817094c5"). InnerVolumeSpecName "server-conf". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.805494 5120 scope.go:117] "RemoveContainer" containerID="19e7beb485630129ef696f327a066c3d26830c322b9edfd670c4fe6b14c203fa" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.817885 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-2"] Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.849498 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/dbe6904f-2249-41c3-bb8a-a1b5817094c5-rabbitmq-plugins\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.849542 5120 reconciler_common.go:299] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/b2f689fd-70ec-43c9-b2da-275e28deb94c-kolla-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.849568 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hb2tk\" (UniqueName: \"kubernetes.io/projected/b2f689fd-70ec-43c9-b2da-275e28deb94c-kube-api-access-hb2tk\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.849587 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/dbe6904f-2249-41c3-bb8a-a1b5817094c5-rabbitmq-erlang-cookie\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.849600 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/b2f689fd-70ec-43c9-b2da-275e28deb94c-config-data-generated\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.853426 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-2"] Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.853541 5120 scope.go:117] "RemoveContainer" containerID="e890194391fce067d02b1a137a5f39d7a59911e519be323ded2d6c7dbe78f932" Mar 16 16:30:40 crc kubenswrapper[5120]: E0316 16:30:40.854032 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e890194391fce067d02b1a137a5f39d7a59911e519be323ded2d6c7dbe78f932\": container with ID starting with e890194391fce067d02b1a137a5f39d7a59911e519be323ded2d6c7dbe78f932 not found: ID does not exist" containerID="e890194391fce067d02b1a137a5f39d7a59911e519be323ded2d6c7dbe78f932" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.854094 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e890194391fce067d02b1a137a5f39d7a59911e519be323ded2d6c7dbe78f932"} err="failed to get container status \"e890194391fce067d02b1a137a5f39d7a59911e519be323ded2d6c7dbe78f932\": rpc error: code = NotFound desc = could not find container \"e890194391fce067d02b1a137a5f39d7a59911e519be323ded2d6c7dbe78f932\": container with ID starting with e890194391fce067d02b1a137a5f39d7a59911e519be323ded2d6c7dbe78f932 not found: ID does not exist" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.854119 5120 scope.go:117] "RemoveContainer" containerID="19e7beb485630129ef696f327a066c3d26830c322b9edfd670c4fe6b14c203fa" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.849613 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b2f689fd-70ec-43c9-b2da-275e28deb94c-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.854368 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/dbe6904f-2249-41c3-bb8a-a1b5817094c5-rabbitmq-tls\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.854385 5120 reconciler_common.go:299] "Volume detached for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/dbe6904f-2249-41c3-bb8a-a1b5817094c5-server-conf\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:40 crc kubenswrapper[5120]: E0316 16:30:40.854390 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"19e7beb485630129ef696f327a066c3d26830c322b9edfd670c4fe6b14c203fa\": container with ID starting with 19e7beb485630129ef696f327a066c3d26830c322b9edfd670c4fe6b14c203fa not found: ID does not exist" containerID="19e7beb485630129ef696f327a066c3d26830c322b9edfd670c4fe6b14c203fa" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.854404 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rmbrs\" (UniqueName: \"kubernetes.io/projected/dbe6904f-2249-41c3-bb8a-a1b5817094c5-kube-api-access-rmbrs\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.854415 5120 reconciler_common.go:299] "Volume detached for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/dbe6904f-2249-41c3-bb8a-a1b5817094c5-erlang-cookie-secret\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.854413 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19e7beb485630129ef696f327a066c3d26830c322b9edfd670c4fe6b14c203fa"} err="failed to get container status \"19e7beb485630129ef696f327a066c3d26830c322b9edfd670c4fe6b14c203fa\": rpc error: code = NotFound desc = could not find container \"19e7beb485630129ef696f327a066c3d26830c322b9edfd670c4fe6b14c203fa\": container with ID starting with 19e7beb485630129ef696f327a066c3d26830c322b9edfd670c4fe6b14c203fa not found: ID does not exist" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.854426 5120 scope.go:117] "RemoveContainer" containerID="efa6791ca8f5aaec639eb569281ad36ec0672df0bc56d4887c44877a37c8a1e4" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.854429 5120 reconciler_common.go:299] "Volume detached for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/b2f689fd-70ec-43c9-b2da-275e28deb94c-galera-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.854456 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") on node \"crc\" " Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.854476 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage15-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage15-crc\") on node \"crc\" " Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.854487 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/dbe6904f-2249-41c3-bb8a-a1b5817094c5-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.854498 5120 reconciler_common.go:299] "Volume detached for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/dbe6904f-2249-41c3-bb8a-a1b5817094c5-plugins-conf\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.854511 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/b2f689fd-70ec-43c9-b2da-275e28deb94c-config-data-default\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.854524 5120 reconciler_common.go:299] "Volume detached for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/dbe6904f-2249-41c3-bb8a-a1b5817094c5-pod-info\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.854534 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b2f689fd-70ec-43c9-b2da-275e28deb94c-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.878832 5120 scope.go:117] "RemoveContainer" containerID="d0ac33814164ae216a7ef35d60d9cc7d9e2d05a54d17c01507619259afcfaab8" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.881295 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage15-crc" (UniqueName: "kubernetes.io/local-volume/local-storage15-crc") on node "crc" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.888628 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage09-crc" (UniqueName: "kubernetes.io/local-volume/local-storage09-crc") on node "crc" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.889036 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.904583 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dbe6904f-2249-41c3-bb8a-a1b5817094c5-rabbitmq-confd" (OuterVolumeSpecName: "rabbitmq-confd") pod "dbe6904f-2249-41c3-bb8a-a1b5817094c5" (UID: "dbe6904f-2249-41c3-bb8a-a1b5817094c5"). InnerVolumeSpecName "rabbitmq-confd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.906483 5120 scope.go:117] "RemoveContainer" containerID="efa6791ca8f5aaec639eb569281ad36ec0672df0bc56d4887c44877a37c8a1e4" Mar 16 16:30:40 crc kubenswrapper[5120]: E0316 16:30:40.908262 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"efa6791ca8f5aaec639eb569281ad36ec0672df0bc56d4887c44877a37c8a1e4\": container with ID starting with efa6791ca8f5aaec639eb569281ad36ec0672df0bc56d4887c44877a37c8a1e4 not found: ID does not exist" containerID="efa6791ca8f5aaec639eb569281ad36ec0672df0bc56d4887c44877a37c8a1e4" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.908293 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"efa6791ca8f5aaec639eb569281ad36ec0672df0bc56d4887c44877a37c8a1e4"} err="failed to get container status \"efa6791ca8f5aaec639eb569281ad36ec0672df0bc56d4887c44877a37c8a1e4\": rpc error: code = NotFound desc = could not find container \"efa6791ca8f5aaec639eb569281ad36ec0672df0bc56d4887c44877a37c8a1e4\": container with ID starting with efa6791ca8f5aaec639eb569281ad36ec0672df0bc56d4887c44877a37c8a1e4 not found: ID does not exist" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.908313 5120 scope.go:117] "RemoveContainer" containerID="d0ac33814164ae216a7ef35d60d9cc7d9e2d05a54d17c01507619259afcfaab8" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.908455 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 16:30:40 crc kubenswrapper[5120]: E0316 16:30:40.908601 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d0ac33814164ae216a7ef35d60d9cc7d9e2d05a54d17c01507619259afcfaab8\": container with ID starting with d0ac33814164ae216a7ef35d60d9cc7d9e2d05a54d17c01507619259afcfaab8 not found: ID does not exist" containerID="d0ac33814164ae216a7ef35d60d9cc7d9e2d05a54d17c01507619259afcfaab8" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.908642 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0ac33814164ae216a7ef35d60d9cc7d9e2d05a54d17c01507619259afcfaab8"} err="failed to get container status \"d0ac33814164ae216a7ef35d60d9cc7d9e2d05a54d17c01507619259afcfaab8\": rpc error: code = NotFound desc = could not find container \"d0ac33814164ae216a7ef35d60d9cc7d9e2d05a54d17c01507619259afcfaab8\": container with ID starting with d0ac33814164ae216a7ef35d60d9cc7d9e2d05a54d17c01507619259afcfaab8 not found: ID does not exist" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.908671 5120 scope.go:117] "RemoveContainer" containerID="1af24cc4ef41d3c7f4136a8089e28219a6259af0444d27c19d5201dc4b1a70e5" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.915001 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-galera-1"] Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.923886 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstack-galera-1"] Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.935548 5120 scope.go:117] "RemoveContainer" containerID="3b2fc28702bef6284fe6b43edd4bdce22491e8ae026936351aae301d0cec1a8b" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.955938 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/dbe6904f-2249-41c3-bb8a-a1b5817094c5-rabbitmq-confd\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.955971 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.955987 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage15-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage15-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.960123 5120 scope.go:117] "RemoveContainer" containerID="1af24cc4ef41d3c7f4136a8089e28219a6259af0444d27c19d5201dc4b1a70e5" Mar 16 16:30:40 crc kubenswrapper[5120]: E0316 16:30:40.960368 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1af24cc4ef41d3c7f4136a8089e28219a6259af0444d27c19d5201dc4b1a70e5\": container with ID starting with 1af24cc4ef41d3c7f4136a8089e28219a6259af0444d27c19d5201dc4b1a70e5 not found: ID does not exist" containerID="1af24cc4ef41d3c7f4136a8089e28219a6259af0444d27c19d5201dc4b1a70e5" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.960405 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1af24cc4ef41d3c7f4136a8089e28219a6259af0444d27c19d5201dc4b1a70e5"} err="failed to get container status \"1af24cc4ef41d3c7f4136a8089e28219a6259af0444d27c19d5201dc4b1a70e5\": rpc error: code = NotFound desc = could not find container \"1af24cc4ef41d3c7f4136a8089e28219a6259af0444d27c19d5201dc4b1a70e5\": container with ID starting with 1af24cc4ef41d3c7f4136a8089e28219a6259af0444d27c19d5201dc4b1a70e5 not found: ID does not exist" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.960428 5120 scope.go:117] "RemoveContainer" containerID="3b2fc28702bef6284fe6b43edd4bdce22491e8ae026936351aae301d0cec1a8b" Mar 16 16:30:40 crc kubenswrapper[5120]: E0316 16:30:40.960794 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b2fc28702bef6284fe6b43edd4bdce22491e8ae026936351aae301d0cec1a8b\": container with ID starting with 3b2fc28702bef6284fe6b43edd4bdce22491e8ae026936351aae301d0cec1a8b not found: ID does not exist" containerID="3b2fc28702bef6284fe6b43edd4bdce22491e8ae026936351aae301d0cec1a8b" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.960821 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b2fc28702bef6284fe6b43edd4bdce22491e8ae026936351aae301d0cec1a8b"} err="failed to get container status \"3b2fc28702bef6284fe6b43edd4bdce22491e8ae026936351aae301d0cec1a8b\": rpc error: code = NotFound desc = could not find container \"3b2fc28702bef6284fe6b43edd4bdce22491e8ae026936351aae301d0cec1a8b\": container with ID starting with 3b2fc28702bef6284fe6b43edd4bdce22491e8ae026936351aae301d0cec1a8b not found: ID does not exist" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.960839 5120 scope.go:117] "RemoveContainer" containerID="d645e41c18aff7040aae9d448377581ed6f256ae5069078c1d8b5d8cdbb7cbea" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.978810 5120 scope.go:117] "RemoveContainer" containerID="0e571b8a3d09eea0ed4f123901d3b7ab1f0e5d31869918b5a25bb4ccfbc9b070" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.997227 5120 scope.go:117] "RemoveContainer" containerID="d645e41c18aff7040aae9d448377581ed6f256ae5069078c1d8b5d8cdbb7cbea" Mar 16 16:30:40 crc kubenswrapper[5120]: E0316 16:30:40.997623 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d645e41c18aff7040aae9d448377581ed6f256ae5069078c1d8b5d8cdbb7cbea\": container with ID starting with d645e41c18aff7040aae9d448377581ed6f256ae5069078c1d8b5d8cdbb7cbea not found: ID does not exist" containerID="d645e41c18aff7040aae9d448377581ed6f256ae5069078c1d8b5d8cdbb7cbea" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.997668 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d645e41c18aff7040aae9d448377581ed6f256ae5069078c1d8b5d8cdbb7cbea"} err="failed to get container status \"d645e41c18aff7040aae9d448377581ed6f256ae5069078c1d8b5d8cdbb7cbea\": rpc error: code = NotFound desc = could not find container \"d645e41c18aff7040aae9d448377581ed6f256ae5069078c1d8b5d8cdbb7cbea\": container with ID starting with d645e41c18aff7040aae9d448377581ed6f256ae5069078c1d8b5d8cdbb7cbea not found: ID does not exist" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.997692 5120 scope.go:117] "RemoveContainer" containerID="0e571b8a3d09eea0ed4f123901d3b7ab1f0e5d31869918b5a25bb4ccfbc9b070" Mar 16 16:30:40 crc kubenswrapper[5120]: E0316 16:30:40.997992 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0e571b8a3d09eea0ed4f123901d3b7ab1f0e5d31869918b5a25bb4ccfbc9b070\": container with ID starting with 0e571b8a3d09eea0ed4f123901d3b7ab1f0e5d31869918b5a25bb4ccfbc9b070 not found: ID does not exist" containerID="0e571b8a3d09eea0ed4f123901d3b7ab1f0e5d31869918b5a25bb4ccfbc9b070" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.998015 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e571b8a3d09eea0ed4f123901d3b7ab1f0e5d31869918b5a25bb4ccfbc9b070"} err="failed to get container status \"0e571b8a3d09eea0ed4f123901d3b7ab1f0e5d31869918b5a25bb4ccfbc9b070\": rpc error: code = NotFound desc = could not find container \"0e571b8a3d09eea0ed4f123901d3b7ab1f0e5d31869918b5a25bb4ccfbc9b070\": container with ID starting with 0e571b8a3d09eea0ed4f123901d3b7ab1f0e5d31869918b5a25bb4ccfbc9b070 not found: ID does not exist" Mar 16 16:30:40 crc kubenswrapper[5120]: I0316 16:30:40.998030 5120 scope.go:117] "RemoveContainer" containerID="22bcc82ce48237f9410a024ede2e8c26cf4bb41d79f0bcc346c2026e82f50c35" Mar 16 16:30:41 crc kubenswrapper[5120]: I0316 16:30:41.019929 5120 scope.go:117] "RemoveContainer" containerID="e0d5654760e70de1ab670d0ca2332b84db7e1b6cadfcf471d3ef946fec9775c0" Mar 16 16:30:41 crc kubenswrapper[5120]: I0316 16:30:41.126965 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-1"] Mar 16 16:30:41 crc kubenswrapper[5120]: I0316 16:30:41.133422 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-1"] Mar 16 16:30:41 crc kubenswrapper[5120]: I0316 16:30:41.139538 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 16:30:41 crc kubenswrapper[5120]: I0316 16:30:41.145686 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 16:30:41 crc kubenswrapper[5120]: E0316 16:30:41.514779 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="31eede8ea13e83df778b0cc727f0126cabef5175599f7fcd091680c0e3d991d6" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:30:41 crc kubenswrapper[5120]: E0316 16:30:41.516831 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="31eede8ea13e83df778b0cc727f0126cabef5175599f7fcd091680c0e3d991d6" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:30:41 crc kubenswrapper[5120]: E0316 16:30:41.518358 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="31eede8ea13e83df778b0cc727f0126cabef5175599f7fcd091680c0e3d991d6" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:30:41 crc kubenswrapper[5120]: E0316 16:30:41.518387 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="836f3504-5416-46bf-a225-7b7f977fe82c" containerName="nova-scheduler-scheduler" probeResult="unknown" Mar 16 16:30:41 crc kubenswrapper[5120]: E0316 16:30:41.586002 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="b48efa78dedc3f4e6339fe4bb5d889d3c5e126ba2b9c6bd274d193ebe220d8d9" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:30:41 crc kubenswrapper[5120]: E0316 16:30:41.587978 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="b48efa78dedc3f4e6339fe4bb5d889d3c5e126ba2b9c6bd274d193ebe220d8d9" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:30:41 crc kubenswrapper[5120]: E0316 16:30:41.589367 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="b48efa78dedc3f4e6339fe4bb5d889d3c5e126ba2b9c6bd274d193ebe220d8d9" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:30:41 crc kubenswrapper[5120]: E0316 16:30:41.589447 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="7c3819a8-dcaf-4026-87c2-5f6419c379a9" containerName="nova-cell1-conductor-conductor" probeResult="unknown" Mar 16 16:30:41 crc kubenswrapper[5120]: I0316 16:30:41.772035 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-76cb6cf57b-j7csd" podUID="3253648c-08a0-4d00-87e2-121fe9240d23" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.1.215:9311/healthcheck\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Mar 16 16:30:42 crc kubenswrapper[5120]: I0316 16:30:42.676435 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b190faa2-d49d-424d-90bc-3e6e34d1b362" path="/var/lib/kubelet/pods/b190faa2-d49d-424d-90bc-3e6e34d1b362/volumes" Mar 16 16:30:42 crc kubenswrapper[5120]: I0316 16:30:42.677443 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b2f689fd-70ec-43c9-b2da-275e28deb94c" path="/var/lib/kubelet/pods/b2f689fd-70ec-43c9-b2da-275e28deb94c/volumes" Mar 16 16:30:42 crc kubenswrapper[5120]: I0316 16:30:42.678624 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dbe6904f-2249-41c3-bb8a-a1b5817094c5" path="/var/lib/kubelet/pods/dbe6904f-2249-41c3-bb8a-a1b5817094c5/volumes" Mar 16 16:30:42 crc kubenswrapper[5120]: I0316 16:30:42.679330 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e1bf7ad2-f215-405b-84de-9429f90855f8" path="/var/lib/kubelet/pods/e1bf7ad2-f215-405b-84de-9429f90855f8/volumes" Mar 16 16:30:42 crc kubenswrapper[5120]: I0316 16:30:42.680373 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fdc6ab64-e478-46f4-8e4b-6bf2e4460d91" path="/var/lib/kubelet/pods/fdc6ab64-e478-46f4-8e4b-6bf2e4460d91/volumes" Mar 16 16:30:42 crc kubenswrapper[5120]: I0316 16:30:42.680935 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-jb5ks" Mar 16 16:30:42 crc kubenswrapper[5120]: I0316 16:30:42.751440 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-74dd7b8bd5-7mv25"] Mar 16 16:30:42 crc kubenswrapper[5120]: I0316 16:30:42.751877 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-74dd7b8bd5-7mv25" podUID="f6dd7905-5098-43d7-9a6e-e9bd86470598" containerName="dnsmasq-dns" containerID="cri-o://622174a9730828fbc1f15662ca12355498b8e3c36864333e71fec689dc9806c8" gracePeriod=10 Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.203525 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-74dd7b8bd5-7mv25" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.303670 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/f6dd7905-5098-43d7-9a6e-e9bd86470598-dnsmasq-svc\") pod \"f6dd7905-5098-43d7-9a6e-e9bd86470598\" (UID: \"f6dd7905-5098-43d7-9a6e-e9bd86470598\") " Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.303733 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b6d9x\" (UniqueName: \"kubernetes.io/projected/f6dd7905-5098-43d7-9a6e-e9bd86470598-kube-api-access-b6d9x\") pod \"f6dd7905-5098-43d7-9a6e-e9bd86470598\" (UID: \"f6dd7905-5098-43d7-9a6e-e9bd86470598\") " Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.303923 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/f6dd7905-5098-43d7-9a6e-e9bd86470598-dns-swift-storage-0\") pod \"f6dd7905-5098-43d7-9a6e-e9bd86470598\" (UID: \"f6dd7905-5098-43d7-9a6e-e9bd86470598\") " Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.303941 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f6dd7905-5098-43d7-9a6e-e9bd86470598-config\") pod \"f6dd7905-5098-43d7-9a6e-e9bd86470598\" (UID: \"f6dd7905-5098-43d7-9a6e-e9bd86470598\") " Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.311352 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6dd7905-5098-43d7-9a6e-e9bd86470598-kube-api-access-b6d9x" (OuterVolumeSpecName: "kube-api-access-b6d9x") pod "f6dd7905-5098-43d7-9a6e-e9bd86470598" (UID: "f6dd7905-5098-43d7-9a6e-e9bd86470598"). InnerVolumeSpecName "kube-api-access-b6d9x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.345235 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f6dd7905-5098-43d7-9a6e-e9bd86470598-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "f6dd7905-5098-43d7-9a6e-e9bd86470598" (UID: "f6dd7905-5098-43d7-9a6e-e9bd86470598"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.349449 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f6dd7905-5098-43d7-9a6e-e9bd86470598-dns-swift-storage-0" (OuterVolumeSpecName: "dns-swift-storage-0") pod "f6dd7905-5098-43d7-9a6e-e9bd86470598" (UID: "f6dd7905-5098-43d7-9a6e-e9bd86470598"). InnerVolumeSpecName "dns-swift-storage-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.354656 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f6dd7905-5098-43d7-9a6e-e9bd86470598-config" (OuterVolumeSpecName: "config") pod "f6dd7905-5098-43d7-9a6e-e9bd86470598" (UID: "f6dd7905-5098-43d7-9a6e-e9bd86470598"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.406330 5120 reconciler_common.go:299] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/f6dd7905-5098-43d7-9a6e-e9bd86470598-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.406365 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b6d9x\" (UniqueName: \"kubernetes.io/projected/f6dd7905-5098-43d7-9a6e-e9bd86470598-kube-api-access-b6d9x\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.406375 5120 reconciler_common.go:299] "Volume detached for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/f6dd7905-5098-43d7-9a6e-e9bd86470598-dns-swift-storage-0\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.406387 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f6dd7905-5098-43d7-9a6e-e9bd86470598-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.827285 5120 generic.go:358] "Generic (PLEG): container finished" podID="f6dd7905-5098-43d7-9a6e-e9bd86470598" containerID="622174a9730828fbc1f15662ca12355498b8e3c36864333e71fec689dc9806c8" exitCode=0 Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.827567 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-74dd7b8bd5-7mv25" event={"ID":"f6dd7905-5098-43d7-9a6e-e9bd86470598","Type":"ContainerDied","Data":"622174a9730828fbc1f15662ca12355498b8e3c36864333e71fec689dc9806c8"} Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.827594 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-74dd7b8bd5-7mv25" event={"ID":"f6dd7905-5098-43d7-9a6e-e9bd86470598","Type":"ContainerDied","Data":"33fb965535f40e26dcb1acc46f394e7d081ded7e76b8d2c631ad3b4570d2cd85"} Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.827610 5120 scope.go:117] "RemoveContainer" containerID="622174a9730828fbc1f15662ca12355498b8e3c36864333e71fec689dc9806c8" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.827718 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-74dd7b8bd5-7mv25" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.887865 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-74dd7b8bd5-7mv25"] Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.891693 5120 scope.go:117] "RemoveContainer" containerID="c3831888a512d2d34dd89c6b32e720e2bed9f6c76f6c50765f3ddfbb0cdc5db1" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.895251 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-74dd7b8bd5-7mv25"] Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.918162 5120 scope.go:117] "RemoveContainer" containerID="622174a9730828fbc1f15662ca12355498b8e3c36864333e71fec689dc9806c8" Mar 16 16:30:43 crc kubenswrapper[5120]: E0316 16:30:43.918613 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"622174a9730828fbc1f15662ca12355498b8e3c36864333e71fec689dc9806c8\": container with ID starting with 622174a9730828fbc1f15662ca12355498b8e3c36864333e71fec689dc9806c8 not found: ID does not exist" containerID="622174a9730828fbc1f15662ca12355498b8e3c36864333e71fec689dc9806c8" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.918664 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"622174a9730828fbc1f15662ca12355498b8e3c36864333e71fec689dc9806c8"} err="failed to get container status \"622174a9730828fbc1f15662ca12355498b8e3c36864333e71fec689dc9806c8\": rpc error: code = NotFound desc = could not find container \"622174a9730828fbc1f15662ca12355498b8e3c36864333e71fec689dc9806c8\": container with ID starting with 622174a9730828fbc1f15662ca12355498b8e3c36864333e71fec689dc9806c8 not found: ID does not exist" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.918703 5120 scope.go:117] "RemoveContainer" containerID="c3831888a512d2d34dd89c6b32e720e2bed9f6c76f6c50765f3ddfbb0cdc5db1" Mar 16 16:30:43 crc kubenswrapper[5120]: E0316 16:30:43.919358 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c3831888a512d2d34dd89c6b32e720e2bed9f6c76f6c50765f3ddfbb0cdc5db1\": container with ID starting with c3831888a512d2d34dd89c6b32e720e2bed9f6c76f6c50765f3ddfbb0cdc5db1 not found: ID does not exist" containerID="c3831888a512d2d34dd89c6b32e720e2bed9f6c76f6c50765f3ddfbb0cdc5db1" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.919389 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3831888a512d2d34dd89c6b32e720e2bed9f6c76f6c50765f3ddfbb0cdc5db1"} err="failed to get container status \"c3831888a512d2d34dd89c6b32e720e2bed9f6c76f6c50765f3ddfbb0cdc5db1\": rpc error: code = NotFound desc = could not find container \"c3831888a512d2d34dd89c6b32e720e2bed9f6c76f6c50765f3ddfbb0cdc5db1\": container with ID starting with c3831888a512d2d34dd89c6b32e720e2bed9f6c76f6c50765f3ddfbb0cdc5db1 not found: ID does not exist" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.973462 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/certified-operators-mx5rt"] Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.974645 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa5682a3-5cb9-4da7-8588-678ba2537e0c" containerName="galera" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.974667 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa5682a3-5cb9-4da7-8588-678ba2537e0c" containerName="galera" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.974687 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1bf7ad2-f215-405b-84de-9429f90855f8" containerName="setup-container" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.974693 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1bf7ad2-f215-405b-84de-9429f90855f8" containerName="setup-container" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.974707 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9565a662-ca77-4197-8894-6b9633e653fd" containerName="memcached" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.974715 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9565a662-ca77-4197-8894-6b9633e653fd" containerName="memcached" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.974726 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8e524d7-0cb0-4bec-9948-70d463625805" containerName="rabbitmq" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.974731 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8e524d7-0cb0-4bec-9948-70d463625805" containerName="rabbitmq" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.974740 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4a96e7a-b22c-46b2-9fd4-9d8815d9f830" containerName="mysql-bootstrap" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.974745 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4a96e7a-b22c-46b2-9fd4-9d8815d9f830" containerName="mysql-bootstrap" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.974752 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed1bcd44-0ed6-4cb4-a735-798e033c8b08" containerName="glance-log" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.974772 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed1bcd44-0ed6-4cb4-a735-798e033c8b08" containerName="glance-log" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.974779 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c88c8ef0-5871-4507-9dcd-4c5312779d29" containerName="ovn-northd" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.974785 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c88c8ef0-5871-4507-9dcd-4c5312779d29" containerName="ovn-northd" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.974794 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b190faa2-d49d-424d-90bc-3e6e34d1b362" containerName="rabbitmq" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.974801 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="b190faa2-d49d-424d-90bc-3e6e34d1b362" containerName="rabbitmq" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.974808 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51ac8589-b6a7-414d-94e5-731e217600c4" containerName="galera" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.974813 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="51ac8589-b6a7-414d-94e5-731e217600c4" containerName="galera" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.974822 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6dd7905-5098-43d7-9a6e-e9bd86470598" containerName="dnsmasq-dns" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.974828 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6dd7905-5098-43d7-9a6e-e9bd86470598" containerName="dnsmasq-dns" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.974837 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4a96e7a-b22c-46b2-9fd4-9d8815d9f830" containerName="galera" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.974843 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4a96e7a-b22c-46b2-9fd4-9d8815d9f830" containerName="galera" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.974852 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9cb535e7-55cc-4b9d-911c-58f8ed50bee6" containerName="barbican-keystone-listener" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.974858 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9cb535e7-55cc-4b9d-911c-58f8ed50bee6" containerName="barbican-keystone-listener" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.974865 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3253648c-08a0-4d00-87e2-121fe9240d23" containerName="barbican-api" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.974870 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="3253648c-08a0-4d00-87e2-121fe9240d23" containerName="barbican-api" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.974880 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9943d2d4-e26d-4c91-942e-a6d788ac8c7e" containerName="mariadb-account-create-update" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.974886 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9943d2d4-e26d-4c91-942e-a6d788ac8c7e" containerName="mariadb-account-create-update" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.974895 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f1a58aa-0b5e-424c-84d6-c2cdc92ce046" containerName="ovsdbserver-nb" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.974902 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f1a58aa-0b5e-424c-84d6-c2cdc92ce046" containerName="ovsdbserver-nb" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.974915 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b46f8b0-c3f2-44ec-88e2-8d65566ae937" containerName="proxy-server" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.974921 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b46f8b0-c3f2-44ec-88e2-8d65566ae937" containerName="proxy-server" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.974933 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8690a5a2-3341-452e-8364-2e5e4072c192" containerName="galera" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.974940 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8690a5a2-3341-452e-8364-2e5e4072c192" containerName="galera" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.974948 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8690a5a2-3341-452e-8364-2e5e4072c192" containerName="mysql-bootstrap" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.974954 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8690a5a2-3341-452e-8364-2e5e4072c192" containerName="mysql-bootstrap" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.974962 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c78e334-9857-4302-af64-dc9b0647ab41" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.974967 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c78e334-9857-4302-af64-dc9b0647ab41" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.974977 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56e8d6c4-0222-4e80-bffd-8fb3726e1b75" containerName="kube-state-metrics" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.974984 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="56e8d6c4-0222-4e80-bffd-8fb3726e1b75" containerName="kube-state-metrics" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.974995 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4e407e7-1e20-455e-b1e5-d87ba8555a7a" containerName="nova-api-api" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.975000 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4e407e7-1e20-455e-b1e5-d87ba8555a7a" containerName="nova-api-api" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.975007 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1ddadf2-8a01-49e5-a099-b192f793a36d" containerName="cinder-api-log" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.975013 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1ddadf2-8a01-49e5-a099-b192f793a36d" containerName="cinder-api-log" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.975023 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9300c420-c173-4f86-ac91-7ada78b25041" containerName="nova-metadata-metadata" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.975029 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9300c420-c173-4f86-ac91-7ada78b25041" containerName="nova-metadata-metadata" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.975039 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4df637ef-8f2d-4eb1-8a51-327814195dbf" containerName="rabbitmq" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.975045 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="4df637ef-8f2d-4eb1-8a51-327814195dbf" containerName="rabbitmq" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.975050 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cecaa51b-004f-4941-99e2-23272d052fa7" containerName="glance-log" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.975056 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="cecaa51b-004f-4941-99e2-23272d052fa7" containerName="glance-log" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.975067 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2f689fd-70ec-43c9-b2da-275e28deb94c" containerName="galera" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.975072 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2f689fd-70ec-43c9-b2da-275e28deb94c" containerName="galera" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.975080 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8e524d7-0cb0-4bec-9948-70d463625805" containerName="setup-container" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.975085 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8e524d7-0cb0-4bec-9948-70d463625805" containerName="setup-container" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.975094 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1ddadf2-8a01-49e5-a099-b192f793a36d" containerName="cinder-api" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.975099 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1ddadf2-8a01-49e5-a099-b192f793a36d" containerName="cinder-api" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.975110 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6dd7905-5098-43d7-9a6e-e9bd86470598" containerName="init" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.975116 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6dd7905-5098-43d7-9a6e-e9bd86470598" containerName="init" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.975126 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c88c8ef0-5871-4507-9dcd-4c5312779d29" containerName="openstack-network-exporter" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.975131 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c88c8ef0-5871-4507-9dcd-4c5312779d29" containerName="openstack-network-exporter" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.975140 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4e407e7-1e20-455e-b1e5-d87ba8555a7a" containerName="nova-api-log" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.975145 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4e407e7-1e20-455e-b1e5-d87ba8555a7a" containerName="nova-api-log" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.975157 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bbd47432-e63f-4ba0-8daa-edfb3d2b0af9" containerName="barbican-worker-log" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.975161 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="bbd47432-e63f-4ba0-8daa-edfb3d2b0af9" containerName="barbican-worker-log" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.975173 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ab03e09-ed0f-4675-82c7-e04f1c3937ce" containerName="rabbitmq" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.975178 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ab03e09-ed0f-4675-82c7-e04f1c3937ce" containerName="rabbitmq" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.975187 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="850510ce-da60-453a-88a8-475bc65bb0df" containerName="placement-log" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.975192 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="850510ce-da60-453a-88a8-475bc65bb0df" containerName="placement-log" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.975206 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51ac8589-b6a7-414d-94e5-731e217600c4" containerName="mysql-bootstrap" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.975216 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="51ac8589-b6a7-414d-94e5-731e217600c4" containerName="mysql-bootstrap" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.975227 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b46f8b0-c3f2-44ec-88e2-8d65566ae937" containerName="proxy-httpd" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.975233 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b46f8b0-c3f2-44ec-88e2-8d65566ae937" containerName="proxy-httpd" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.975243 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9300c420-c173-4f86-ac91-7ada78b25041" containerName="nova-metadata-log" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.975249 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9300c420-c173-4f86-ac91-7ada78b25041" containerName="nova-metadata-log" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.975257 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fdc6ab64-e478-46f4-8e4b-6bf2e4460d91" containerName="galera" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.975264 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="fdc6ab64-e478-46f4-8e4b-6bf2e4460d91" containerName="galera" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.975310 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bbd47432-e63f-4ba0-8daa-edfb3d2b0af9" containerName="barbican-worker" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.975318 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="bbd47432-e63f-4ba0-8daa-edfb3d2b0af9" containerName="barbican-worker" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.975328 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b190faa2-d49d-424d-90bc-3e6e34d1b362" containerName="setup-container" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.975334 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="b190faa2-d49d-424d-90bc-3e6e34d1b362" containerName="setup-container" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.975346 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cecaa51b-004f-4941-99e2-23272d052fa7" containerName="glance-httpd" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.975353 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="cecaa51b-004f-4941-99e2-23272d052fa7" containerName="glance-httpd" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.975362 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4df637ef-8f2d-4eb1-8a51-327814195dbf" containerName="setup-container" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.975368 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="4df637ef-8f2d-4eb1-8a51-327814195dbf" containerName="setup-container" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.975375 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f1a58aa-0b5e-424c-84d6-c2cdc92ce046" containerName="openstack-network-exporter" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.975384 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f1a58aa-0b5e-424c-84d6-c2cdc92ce046" containerName="openstack-network-exporter" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.975402 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="850510ce-da60-453a-88a8-475bc65bb0df" containerName="placement-api" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.975409 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="850510ce-da60-453a-88a8-475bc65bb0df" containerName="placement-api" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.975417 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ab03e09-ed0f-4675-82c7-e04f1c3937ce" containerName="setup-container" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.975423 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ab03e09-ed0f-4675-82c7-e04f1c3937ce" containerName="setup-container" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.975436 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbe6904f-2249-41c3-bb8a-a1b5817094c5" containerName="rabbitmq" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.975443 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbe6904f-2249-41c3-bb8a-a1b5817094c5" containerName="rabbitmq" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.975457 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa5682a3-5cb9-4da7-8588-678ba2537e0c" containerName="mysql-bootstrap" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.975464 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa5682a3-5cb9-4da7-8588-678ba2537e0c" containerName="mysql-bootstrap" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.975472 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b62aed8-ea87-465a-be46-45ce06fedbb7" containerName="keystone-api" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.975479 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b62aed8-ea87-465a-be46-45ce06fedbb7" containerName="keystone-api" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.975490 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbe6904f-2249-41c3-bb8a-a1b5817094c5" containerName="setup-container" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.975497 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbe6904f-2249-41c3-bb8a-a1b5817094c5" containerName="setup-container" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.975505 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fdc6ab64-e478-46f4-8e4b-6bf2e4460d91" containerName="mysql-bootstrap" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.975511 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="fdc6ab64-e478-46f4-8e4b-6bf2e4460d91" containerName="mysql-bootstrap" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.975523 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1bf7ad2-f215-405b-84de-9429f90855f8" containerName="rabbitmq" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.975529 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1bf7ad2-f215-405b-84de-9429f90855f8" containerName="rabbitmq" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.975539 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2f689fd-70ec-43c9-b2da-275e28deb94c" containerName="mysql-bootstrap" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.975545 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2f689fd-70ec-43c9-b2da-275e28deb94c" containerName="mysql-bootstrap" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.975553 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3253648c-08a0-4d00-87e2-121fe9240d23" containerName="barbican-api-log" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.975560 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="3253648c-08a0-4d00-87e2-121fe9240d23" containerName="barbican-api-log" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.975571 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed1bcd44-0ed6-4cb4-a735-798e033c8b08" containerName="glance-httpd" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.975578 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed1bcd44-0ed6-4cb4-a735-798e033c8b08" containerName="glance-httpd" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.975587 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9cb535e7-55cc-4b9d-911c-58f8ed50bee6" containerName="barbican-keystone-listener-log" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.975595 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9cb535e7-55cc-4b9d-911c-58f8ed50bee6" containerName="barbican-keystone-listener-log" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.975733 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="9ab03e09-ed0f-4675-82c7-e04f1c3937ce" containerName="rabbitmq" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.975749 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="2c78e334-9857-4302-af64-dc9b0647ab41" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.975780 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="850510ce-da60-453a-88a8-475bc65bb0df" containerName="placement-log" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.975790 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="b4e407e7-1e20-455e-b1e5-d87ba8555a7a" containerName="nova-api-log" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.975807 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="3253648c-08a0-4d00-87e2-121fe9240d23" containerName="barbican-api" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.975815 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="0b62aed8-ea87-465a-be46-45ce06fedbb7" containerName="keystone-api" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.975824 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="9565a662-ca77-4197-8894-6b9633e653fd" containerName="memcached" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.975831 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="9300c420-c173-4f86-ac91-7ada78b25041" containerName="nova-metadata-metadata" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.975840 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="fa5682a3-5cb9-4da7-8588-678ba2537e0c" containerName="galera" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.975848 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="fdc6ab64-e478-46f4-8e4b-6bf2e4460d91" containerName="galera" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.975855 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="b4e407e7-1e20-455e-b1e5-d87ba8555a7a" containerName="nova-api-api" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.975866 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f1ddadf2-8a01-49e5-a099-b192f793a36d" containerName="cinder-api-log" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.975875 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="3253648c-08a0-4d00-87e2-121fe9240d23" containerName="barbican-api-log" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.975885 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="d4a96e7a-b22c-46b2-9fd4-9d8815d9f830" containerName="galera" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.975894 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="850510ce-da60-453a-88a8-475bc65bb0df" containerName="placement-api" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.975904 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="bbd47432-e63f-4ba0-8daa-edfb3d2b0af9" containerName="barbican-worker-log" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.975916 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7b46f8b0-c3f2-44ec-88e2-8d65566ae937" containerName="proxy-server" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.975927 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="9cb535e7-55cc-4b9d-911c-58f8ed50bee6" containerName="barbican-keystone-listener-log" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.975936 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="8690a5a2-3341-452e-8364-2e5e4072c192" containerName="galera" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.975946 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="b2f689fd-70ec-43c9-b2da-275e28deb94c" containerName="galera" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.975954 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="cecaa51b-004f-4941-99e2-23272d052fa7" containerName="glance-log" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.975966 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ed1bcd44-0ed6-4cb4-a735-798e033c8b08" containerName="glance-log" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.975975 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="5f1a58aa-0b5e-424c-84d6-c2cdc92ce046" containerName="ovsdbserver-nb" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.975983 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="b190faa2-d49d-424d-90bc-3e6e34d1b362" containerName="rabbitmq" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.975990 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f1ddadf2-8a01-49e5-a099-b192f793a36d" containerName="cinder-api" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.975999 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="4df637ef-8f2d-4eb1-8a51-327814195dbf" containerName="rabbitmq" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.976009 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="9300c420-c173-4f86-ac91-7ada78b25041" containerName="nova-metadata-log" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.976018 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="51ac8589-b6a7-414d-94e5-731e217600c4" containerName="galera" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.976028 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="5f1a58aa-0b5e-424c-84d6-c2cdc92ce046" containerName="openstack-network-exporter" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.976039 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e1bf7ad2-f215-405b-84de-9429f90855f8" containerName="rabbitmq" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.976049 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="bbd47432-e63f-4ba0-8daa-edfb3d2b0af9" containerName="barbican-worker" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.976057 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="cecaa51b-004f-4941-99e2-23272d052fa7" containerName="glance-httpd" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.976066 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7b46f8b0-c3f2-44ec-88e2-8d65566ae937" containerName="proxy-httpd" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.976072 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="56e8d6c4-0222-4e80-bffd-8fb3726e1b75" containerName="kube-state-metrics" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.976082 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="9943d2d4-e26d-4c91-942e-a6d788ac8c7e" containerName="mariadb-account-create-update" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.976089 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="a8e524d7-0cb0-4bec-9948-70d463625805" containerName="rabbitmq" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.976095 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="9cb535e7-55cc-4b9d-911c-58f8ed50bee6" containerName="barbican-keystone-listener" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.976104 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c88c8ef0-5871-4507-9dcd-4c5312779d29" containerName="ovn-northd" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.976113 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="dbe6904f-2249-41c3-bb8a-a1b5817094c5" containerName="rabbitmq" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.976119 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="9943d2d4-e26d-4c91-942e-a6d788ac8c7e" containerName="mariadb-account-create-update" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.976126 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f6dd7905-5098-43d7-9a6e-e9bd86470598" containerName="dnsmasq-dns" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.976135 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c88c8ef0-5871-4507-9dcd-4c5312779d29" containerName="openstack-network-exporter" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.976142 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ed1bcd44-0ed6-4cb4-a735-798e033c8b08" containerName="glance-httpd" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.976345 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9943d2d4-e26d-4c91-942e-a6d788ac8c7e" containerName="mariadb-account-create-update" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.976355 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9943d2d4-e26d-4c91-942e-a6d788ac8c7e" containerName="mariadb-account-create-update" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.985688 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-mx5rt" Mar 16 16:30:43 crc kubenswrapper[5120]: I0316 16:30:43.991561 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/certified-operators-mx5rt"] Mar 16 16:30:44 crc kubenswrapper[5120]: E0316 16:30:44.071544 5120 fsHandler.go:119] failed to collect filesystem stats - rootDiskErr: could not stat "/var/lib/containers/storage/overlay/41bc0a3a02b0210d9501df5a359822642510f486cf44301d927b36afbb942337/diff" to get inode usage: stat /var/lib/containers/storage/overlay/41bc0a3a02b0210d9501df5a359822642510f486cf44301d927b36afbb942337/diff: no such file or directory, extraDiskErr: could not stat "/var/log/pods/openstack-kuttl-tests_openstack-galera-1_fdc6ab64-e478-46f4-8e4b-6bf2e4460d91/galera/0.log" to get inode usage: stat /var/log/pods/openstack-kuttl-tests_openstack-galera-1_fdc6ab64-e478-46f4-8e4b-6bf2e4460d91/galera/0.log: no such file or directory Mar 16 16:30:44 crc kubenswrapper[5120]: E0316 16:30:44.079475 5120 fsHandler.go:119] failed to collect filesystem stats - rootDiskErr: could not stat "/var/lib/containers/storage/overlay/ca14602ded060b382786385100d49469e3806d21ce6c90654b71a20f4586513a/diff" to get inode usage: stat /var/lib/containers/storage/overlay/ca14602ded060b382786385100d49469e3806d21ce6c90654b71a20f4586513a/diff: no such file or directory, extraDiskErr: could not stat "/var/log/pods/openstack-kuttl-tests_openstack-galera-0_b2f689fd-70ec-43c9-b2da-275e28deb94c/galera/0.log" to get inode usage: stat /var/log/pods/openstack-kuttl-tests_openstack-galera-0_b2f689fd-70ec-43c9-b2da-275e28deb94c/galera/0.log: no such file or directory Mar 16 16:30:44 crc kubenswrapper[5120]: I0316 16:30:44.119392 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/692399cb-3427-4a68-8677-aee482e1ae16-catalog-content\") pod \"certified-operators-mx5rt\" (UID: \"692399cb-3427-4a68-8677-aee482e1ae16\") " pod="openshift-marketplace/certified-operators-mx5rt" Mar 16 16:30:44 crc kubenswrapper[5120]: I0316 16:30:44.119439 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6z98f\" (UniqueName: \"kubernetes.io/projected/692399cb-3427-4a68-8677-aee482e1ae16-kube-api-access-6z98f\") pod \"certified-operators-mx5rt\" (UID: \"692399cb-3427-4a68-8677-aee482e1ae16\") " pod="openshift-marketplace/certified-operators-mx5rt" Mar 16 16:30:44 crc kubenswrapper[5120]: I0316 16:30:44.119614 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/692399cb-3427-4a68-8677-aee482e1ae16-utilities\") pod \"certified-operators-mx5rt\" (UID: \"692399cb-3427-4a68-8677-aee482e1ae16\") " pod="openshift-marketplace/certified-operators-mx5rt" Mar 16 16:30:44 crc kubenswrapper[5120]: I0316 16:30:44.221403 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/692399cb-3427-4a68-8677-aee482e1ae16-utilities\") pod \"certified-operators-mx5rt\" (UID: \"692399cb-3427-4a68-8677-aee482e1ae16\") " pod="openshift-marketplace/certified-operators-mx5rt" Mar 16 16:30:44 crc kubenswrapper[5120]: I0316 16:30:44.221618 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/692399cb-3427-4a68-8677-aee482e1ae16-catalog-content\") pod \"certified-operators-mx5rt\" (UID: \"692399cb-3427-4a68-8677-aee482e1ae16\") " pod="openshift-marketplace/certified-operators-mx5rt" Mar 16 16:30:44 crc kubenswrapper[5120]: I0316 16:30:44.221645 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6z98f\" (UniqueName: \"kubernetes.io/projected/692399cb-3427-4a68-8677-aee482e1ae16-kube-api-access-6z98f\") pod \"certified-operators-mx5rt\" (UID: \"692399cb-3427-4a68-8677-aee482e1ae16\") " pod="openshift-marketplace/certified-operators-mx5rt" Mar 16 16:30:44 crc kubenswrapper[5120]: I0316 16:30:44.222016 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/692399cb-3427-4a68-8677-aee482e1ae16-utilities\") pod \"certified-operators-mx5rt\" (UID: \"692399cb-3427-4a68-8677-aee482e1ae16\") " pod="openshift-marketplace/certified-operators-mx5rt" Mar 16 16:30:44 crc kubenswrapper[5120]: I0316 16:30:44.222154 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/692399cb-3427-4a68-8677-aee482e1ae16-catalog-content\") pod \"certified-operators-mx5rt\" (UID: \"692399cb-3427-4a68-8677-aee482e1ae16\") " pod="openshift-marketplace/certified-operators-mx5rt" Mar 16 16:30:44 crc kubenswrapper[5120]: I0316 16:30:44.239601 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6z98f\" (UniqueName: \"kubernetes.io/projected/692399cb-3427-4a68-8677-aee482e1ae16-kube-api-access-6z98f\") pod \"certified-operators-mx5rt\" (UID: \"692399cb-3427-4a68-8677-aee482e1ae16\") " pod="openshift-marketplace/certified-operators-mx5rt" Mar 16 16:30:44 crc kubenswrapper[5120]: I0316 16:30:44.308589 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-mx5rt" Mar 16 16:30:44 crc kubenswrapper[5120]: I0316 16:30:44.677148 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f6dd7905-5098-43d7-9a6e-e9bd86470598" path="/var/lib/kubelet/pods/f6dd7905-5098-43d7-9a6e-e9bd86470598/volumes" Mar 16 16:30:44 crc kubenswrapper[5120]: I0316 16:30:44.763837 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/certified-operators-mx5rt"] Mar 16 16:30:44 crc kubenswrapper[5120]: I0316 16:30:44.842426 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-mx5rt" event={"ID":"692399cb-3427-4a68-8677-aee482e1ae16","Type":"ContainerStarted","Data":"fdb9fae019946af6f62519013a9ec6e8e0c90f1c1d1966417710984ece424a02"} Mar 16 16:30:45 crc kubenswrapper[5120]: E0316 16:30:45.453638 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="1c7b11899133931bd406f6c19c7e46ecd6ae5021b5ed32c51931ad65ff554972" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:30:45 crc kubenswrapper[5120]: E0316 16:30:45.454906 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="1c7b11899133931bd406f6c19c7e46ecd6ae5021b5ed32c51931ad65ff554972" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:30:45 crc kubenswrapper[5120]: E0316 16:30:45.456037 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="1c7b11899133931bd406f6c19c7e46ecd6ae5021b5ed32c51931ad65ff554972" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:30:45 crc kubenswrapper[5120]: E0316 16:30:45.456115 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="7e45bb7a-9982-458f-80b5-60541c2d2daf" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 16:30:45 crc kubenswrapper[5120]: I0316 16:30:45.861472 5120 generic.go:358] "Generic (PLEG): container finished" podID="692399cb-3427-4a68-8677-aee482e1ae16" containerID="b82520e4469e686cfd11097e1fef306c27002fe74930a1b424c52b51d3e0bc8b" exitCode=0 Mar 16 16:30:45 crc kubenswrapper[5120]: I0316 16:30:45.861641 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-mx5rt" event={"ID":"692399cb-3427-4a68-8677-aee482e1ae16","Type":"ContainerDied","Data":"b82520e4469e686cfd11097e1fef306c27002fe74930a1b424c52b51d3e0bc8b"} Mar 16 16:30:46 crc kubenswrapper[5120]: E0316 16:30:46.514283 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="31eede8ea13e83df778b0cc727f0126cabef5175599f7fcd091680c0e3d991d6" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:30:46 crc kubenswrapper[5120]: E0316 16:30:46.521194 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="31eede8ea13e83df778b0cc727f0126cabef5175599f7fcd091680c0e3d991d6" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:30:46 crc kubenswrapper[5120]: E0316 16:30:46.522797 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="31eede8ea13e83df778b0cc727f0126cabef5175599f7fcd091680c0e3d991d6" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:30:46 crc kubenswrapper[5120]: E0316 16:30:46.522835 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="836f3504-5416-46bf-a225-7b7f977fe82c" containerName="nova-scheduler-scheduler" probeResult="unknown" Mar 16 16:30:46 crc kubenswrapper[5120]: E0316 16:30:46.585360 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="b48efa78dedc3f4e6339fe4bb5d889d3c5e126ba2b9c6bd274d193ebe220d8d9" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:30:46 crc kubenswrapper[5120]: E0316 16:30:46.592095 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="b48efa78dedc3f4e6339fe4bb5d889d3c5e126ba2b9c6bd274d193ebe220d8d9" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:30:46 crc kubenswrapper[5120]: E0316 16:30:46.593891 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="b48efa78dedc3f4e6339fe4bb5d889d3c5e126ba2b9c6bd274d193ebe220d8d9" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:30:46 crc kubenswrapper[5120]: E0316 16:30:46.593975 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="7c3819a8-dcaf-4026-87c2-5f6419c379a9" containerName="nova-cell1-conductor-conductor" probeResult="unknown" Mar 16 16:30:46 crc kubenswrapper[5120]: E0316 16:30:46.881882 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/neutron-config: secret "neutron-config" not found Mar 16 16:30:46 crc kubenswrapper[5120]: E0316 16:30:46.882008 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/neutron-httpd-config: secret "neutron-httpd-config" not found Mar 16 16:30:46 crc kubenswrapper[5120]: E0316 16:30:46.882019 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/325f32e1-5461-4d71-a30c-dee2528d6fb3-config podName:325f32e1-5461-4d71-a30c-dee2528d6fb3 nodeName:}" failed. No retries permitted until 2026-03-16 16:31:02.881996709 +0000 UTC m=+3565.035928376 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "config" (UniqueName: "kubernetes.io/secret/325f32e1-5461-4d71-a30c-dee2528d6fb3-config") pod "neutron-59d4fdd9db-tttbf" (UID: "325f32e1-5461-4d71-a30c-dee2528d6fb3") : secret "neutron-config" not found Mar 16 16:30:46 crc kubenswrapper[5120]: E0316 16:30:46.882117 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/325f32e1-5461-4d71-a30c-dee2528d6fb3-httpd-config podName:325f32e1-5461-4d71-a30c-dee2528d6fb3 nodeName:}" failed. No retries permitted until 2026-03-16 16:31:02.882092871 +0000 UTC m=+3565.036024538 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "httpd-config" (UniqueName: "kubernetes.io/secret/325f32e1-5461-4d71-a30c-dee2528d6fb3-httpd-config") pod "neutron-59d4fdd9db-tttbf" (UID: "325f32e1-5461-4d71-a30c-dee2528d6fb3") : secret "neutron-httpd-config" not found Mar 16 16:30:47 crc kubenswrapper[5120]: I0316 16:30:47.885297 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-mx5rt" event={"ID":"692399cb-3427-4a68-8677-aee482e1ae16","Type":"ContainerStarted","Data":"5609da216cfa4afbfadedb1a4b6d784dc810a8d8173b16954e0c2cc5b9d135ce"} Mar 16 16:30:48 crc kubenswrapper[5120]: I0316 16:30:48.552356 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-marketplace-nttb7"] Mar 16 16:30:48 crc kubenswrapper[5120]: I0316 16:30:48.561817 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-nttb7"] Mar 16 16:30:48 crc kubenswrapper[5120]: I0316 16:30:48.561945 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-nttb7" Mar 16 16:30:48 crc kubenswrapper[5120]: I0316 16:30:48.722389 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/57c30724-6f23-4b63-b97e-f1e692921ecf-catalog-content\") pod \"redhat-marketplace-nttb7\" (UID: \"57c30724-6f23-4b63-b97e-f1e692921ecf\") " pod="openshift-marketplace/redhat-marketplace-nttb7" Mar 16 16:30:48 crc kubenswrapper[5120]: I0316 16:30:48.723045 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/57c30724-6f23-4b63-b97e-f1e692921ecf-utilities\") pod \"redhat-marketplace-nttb7\" (UID: \"57c30724-6f23-4b63-b97e-f1e692921ecf\") " pod="openshift-marketplace/redhat-marketplace-nttb7" Mar 16 16:30:48 crc kubenswrapper[5120]: I0316 16:30:48.723591 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbxjs\" (UniqueName: \"kubernetes.io/projected/57c30724-6f23-4b63-b97e-f1e692921ecf-kube-api-access-hbxjs\") pod \"redhat-marketplace-nttb7\" (UID: \"57c30724-6f23-4b63-b97e-f1e692921ecf\") " pod="openshift-marketplace/redhat-marketplace-nttb7" Mar 16 16:30:48 crc kubenswrapper[5120]: I0316 16:30:48.825857 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hbxjs\" (UniqueName: \"kubernetes.io/projected/57c30724-6f23-4b63-b97e-f1e692921ecf-kube-api-access-hbxjs\") pod \"redhat-marketplace-nttb7\" (UID: \"57c30724-6f23-4b63-b97e-f1e692921ecf\") " pod="openshift-marketplace/redhat-marketplace-nttb7" Mar 16 16:30:48 crc kubenswrapper[5120]: I0316 16:30:48.825974 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/57c30724-6f23-4b63-b97e-f1e692921ecf-catalog-content\") pod \"redhat-marketplace-nttb7\" (UID: \"57c30724-6f23-4b63-b97e-f1e692921ecf\") " pod="openshift-marketplace/redhat-marketplace-nttb7" Mar 16 16:30:48 crc kubenswrapper[5120]: I0316 16:30:48.826109 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/57c30724-6f23-4b63-b97e-f1e692921ecf-utilities\") pod \"redhat-marketplace-nttb7\" (UID: \"57c30724-6f23-4b63-b97e-f1e692921ecf\") " pod="openshift-marketplace/redhat-marketplace-nttb7" Mar 16 16:30:48 crc kubenswrapper[5120]: I0316 16:30:48.828315 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/57c30724-6f23-4b63-b97e-f1e692921ecf-catalog-content\") pod \"redhat-marketplace-nttb7\" (UID: \"57c30724-6f23-4b63-b97e-f1e692921ecf\") " pod="openshift-marketplace/redhat-marketplace-nttb7" Mar 16 16:30:48 crc kubenswrapper[5120]: I0316 16:30:48.828607 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/57c30724-6f23-4b63-b97e-f1e692921ecf-utilities\") pod \"redhat-marketplace-nttb7\" (UID: \"57c30724-6f23-4b63-b97e-f1e692921ecf\") " pod="openshift-marketplace/redhat-marketplace-nttb7" Mar 16 16:30:48 crc kubenswrapper[5120]: I0316 16:30:48.857832 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbxjs\" (UniqueName: \"kubernetes.io/projected/57c30724-6f23-4b63-b97e-f1e692921ecf-kube-api-access-hbxjs\") pod \"redhat-marketplace-nttb7\" (UID: \"57c30724-6f23-4b63-b97e-f1e692921ecf\") " pod="openshift-marketplace/redhat-marketplace-nttb7" Mar 16 16:30:48 crc kubenswrapper[5120]: I0316 16:30:48.882722 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-nttb7" Mar 16 16:30:48 crc kubenswrapper[5120]: I0316 16:30:48.895789 5120 generic.go:358] "Generic (PLEG): container finished" podID="692399cb-3427-4a68-8677-aee482e1ae16" containerID="5609da216cfa4afbfadedb1a4b6d784dc810a8d8173b16954e0c2cc5b9d135ce" exitCode=0 Mar 16 16:30:48 crc kubenswrapper[5120]: I0316 16:30:48.896093 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-mx5rt" event={"ID":"692399cb-3427-4a68-8677-aee482e1ae16","Type":"ContainerDied","Data":"5609da216cfa4afbfadedb1a4b6d784dc810a8d8173b16954e0c2cc5b9d135ce"} Mar 16 16:30:49 crc kubenswrapper[5120]: I0316 16:30:49.319378 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-nttb7"] Mar 16 16:30:49 crc kubenswrapper[5120]: I0316 16:30:49.686694 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/neutron-59d4fdd9db-tttbf" podUID="325f32e1-5461-4d71-a30c-dee2528d6fb3" containerName="neutron-httpd" probeResult="failure" output="Get \"https://10.217.1.217:9696/\": dial tcp 10.217.1.217:9696: connect: connection refused" Mar 16 16:30:49 crc kubenswrapper[5120]: I0316 16:30:49.908365 5120 generic.go:358] "Generic (PLEG): container finished" podID="57c30724-6f23-4b63-b97e-f1e692921ecf" containerID="518c5b280834d36f18a925ad61f60d88fc7748df5e93b09fba9bb21dd14f7fe4" exitCode=0 Mar 16 16:30:49 crc kubenswrapper[5120]: I0316 16:30:49.909215 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-nttb7" event={"ID":"57c30724-6f23-4b63-b97e-f1e692921ecf","Type":"ContainerDied","Data":"518c5b280834d36f18a925ad61f60d88fc7748df5e93b09fba9bb21dd14f7fe4"} Mar 16 16:30:49 crc kubenswrapper[5120]: I0316 16:30:49.909300 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-nttb7" event={"ID":"57c30724-6f23-4b63-b97e-f1e692921ecf","Type":"ContainerStarted","Data":"cb9b421046a49f5af0e55fb13df5fb2acce03b5007f19e694c2ef48dded9b621"} Mar 16 16:30:49 crc kubenswrapper[5120]: I0316 16:30:49.915137 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-mx5rt" event={"ID":"692399cb-3427-4a68-8677-aee482e1ae16","Type":"ContainerStarted","Data":"c0f2441bb0242aaffa2550dfcfe9ce5b320d0b22d1b0077b763f37179f3be3b6"} Mar 16 16:30:49 crc kubenswrapper[5120]: I0316 16:30:49.946423 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/certified-operators-mx5rt" podStartSLOduration=5.372720013 podStartE2EDuration="6.946405944s" podCreationTimestamp="2026-03-16 16:30:43 +0000 UTC" firstStartedPulling="2026-03-16 16:30:45.86247226 +0000 UTC m=+3548.016403927" lastFinishedPulling="2026-03-16 16:30:47.436158191 +0000 UTC m=+3549.590089858" observedRunningTime="2026-03-16 16:30:49.944121302 +0000 UTC m=+3552.098052959" watchObservedRunningTime="2026-03-16 16:30:49.946405944 +0000 UTC m=+3552.100337601" Mar 16 16:30:50 crc kubenswrapper[5120]: E0316 16:30:50.452561 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="1c7b11899133931bd406f6c19c7e46ecd6ae5021b5ed32c51931ad65ff554972" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:30:50 crc kubenswrapper[5120]: E0316 16:30:50.454112 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="1c7b11899133931bd406f6c19c7e46ecd6ae5021b5ed32c51931ad65ff554972" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:30:50 crc kubenswrapper[5120]: E0316 16:30:50.455428 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="1c7b11899133931bd406f6c19c7e46ecd6ae5021b5ed32c51931ad65ff554972" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:30:50 crc kubenswrapper[5120]: E0316 16:30:50.455466 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="7e45bb7a-9982-458f-80b5-60541c2d2daf" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 16:30:50 crc kubenswrapper[5120]: I0316 16:30:50.933696 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-nttb7" event={"ID":"57c30724-6f23-4b63-b97e-f1e692921ecf","Type":"ContainerStarted","Data":"fc22053a276d9e7441a2d6ef7cb615668a2558e4b1cf319d82c041c13fc38060"} Mar 16 16:30:51 crc kubenswrapper[5120]: E0316 16:30:51.513726 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="31eede8ea13e83df778b0cc727f0126cabef5175599f7fcd091680c0e3d991d6" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:30:51 crc kubenswrapper[5120]: E0316 16:30:51.515507 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="31eede8ea13e83df778b0cc727f0126cabef5175599f7fcd091680c0e3d991d6" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:30:51 crc kubenswrapper[5120]: E0316 16:30:51.517066 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="31eede8ea13e83df778b0cc727f0126cabef5175599f7fcd091680c0e3d991d6" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:30:51 crc kubenswrapper[5120]: E0316 16:30:51.517151 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="836f3504-5416-46bf-a225-7b7f977fe82c" containerName="nova-scheduler-scheduler" probeResult="unknown" Mar 16 16:30:51 crc kubenswrapper[5120]: E0316 16:30:51.586366 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="b48efa78dedc3f4e6339fe4bb5d889d3c5e126ba2b9c6bd274d193ebe220d8d9" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:30:51 crc kubenswrapper[5120]: E0316 16:30:51.588133 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="b48efa78dedc3f4e6339fe4bb5d889d3c5e126ba2b9c6bd274d193ebe220d8d9" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:30:51 crc kubenswrapper[5120]: E0316 16:30:51.589474 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="b48efa78dedc3f4e6339fe4bb5d889d3c5e126ba2b9c6bd274d193ebe220d8d9" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:30:51 crc kubenswrapper[5120]: E0316 16:30:51.589545 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="7c3819a8-dcaf-4026-87c2-5f6419c379a9" containerName="nova-cell1-conductor-conductor" probeResult="unknown" Mar 16 16:30:51 crc kubenswrapper[5120]: I0316 16:30:51.948383 5120 generic.go:358] "Generic (PLEG): container finished" podID="57c30724-6f23-4b63-b97e-f1e692921ecf" containerID="fc22053a276d9e7441a2d6ef7cb615668a2558e4b1cf319d82c041c13fc38060" exitCode=0 Mar 16 16:30:51 crc kubenswrapper[5120]: I0316 16:30:51.948572 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-nttb7" event={"ID":"57c30724-6f23-4b63-b97e-f1e692921ecf","Type":"ContainerDied","Data":"fc22053a276d9e7441a2d6ef7cb615668a2558e4b1cf319d82c041c13fc38060"} Mar 16 16:30:52 crc kubenswrapper[5120]: I0316 16:30:52.008322 5120 patch_prober.go:28] interesting pod/machine-config-daemon-7bf76 container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 16:30:52 crc kubenswrapper[5120]: I0316 16:30:52.008462 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 16:30:52 crc kubenswrapper[5120]: I0316 16:30:52.962211 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-nttb7" event={"ID":"57c30724-6f23-4b63-b97e-f1e692921ecf","Type":"ContainerStarted","Data":"906d1e53be56bc349735250ae9771ca74b2af131d9a67b7d7203c40a713ee31e"} Mar 16 16:30:52 crc kubenswrapper[5120]: I0316 16:30:52.985333 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/redhat-marketplace-nttb7" podStartSLOduration=4.322838126 podStartE2EDuration="4.985316245s" podCreationTimestamp="2026-03-16 16:30:48 +0000 UTC" firstStartedPulling="2026-03-16 16:30:49.910315578 +0000 UTC m=+3552.064247235" lastFinishedPulling="2026-03-16 16:30:50.572793697 +0000 UTC m=+3552.726725354" observedRunningTime="2026-03-16 16:30:52.983687142 +0000 UTC m=+3555.137618799" watchObservedRunningTime="2026-03-16 16:30:52.985316245 +0000 UTC m=+3555.139247902" Mar 16 16:30:54 crc kubenswrapper[5120]: I0316 16:30:54.309974 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/certified-operators-mx5rt" Mar 16 16:30:54 crc kubenswrapper[5120]: I0316 16:30:54.311085 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-marketplace/certified-operators-mx5rt" Mar 16 16:30:54 crc kubenswrapper[5120]: I0316 16:30:54.374812 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/certified-operators-mx5rt" Mar 16 16:30:55 crc kubenswrapper[5120]: I0316 16:30:55.042827 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/certified-operators-mx5rt" Mar 16 16:30:55 crc kubenswrapper[5120]: E0316 16:30:55.453085 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="1c7b11899133931bd406f6c19c7e46ecd6ae5021b5ed32c51931ad65ff554972" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:30:55 crc kubenswrapper[5120]: E0316 16:30:55.455131 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="1c7b11899133931bd406f6c19c7e46ecd6ae5021b5ed32c51931ad65ff554972" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:30:55 crc kubenswrapper[5120]: E0316 16:30:55.456240 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="1c7b11899133931bd406f6c19c7e46ecd6ae5021b5ed32c51931ad65ff554972" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:30:55 crc kubenswrapper[5120]: E0316 16:30:55.456349 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="7e45bb7a-9982-458f-80b5-60541c2d2daf" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 16:30:55 crc kubenswrapper[5120]: I0316 16:30:55.825001 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/ceilometer-0" podUID="abc96fef-3a85-4438-848c-0910513810e0" containerName="proxy-httpd" probeResult="failure" output="Get \"https://10.217.0.67:3000/\": dial tcp 10.217.0.67:3000: connect: connection refused" Mar 16 16:30:56 crc kubenswrapper[5120]: E0316 16:30:56.515637 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="31eede8ea13e83df778b0cc727f0126cabef5175599f7fcd091680c0e3d991d6" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:30:56 crc kubenswrapper[5120]: E0316 16:30:56.519143 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="31eede8ea13e83df778b0cc727f0126cabef5175599f7fcd091680c0e3d991d6" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:30:56 crc kubenswrapper[5120]: E0316 16:30:56.525751 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="31eede8ea13e83df778b0cc727f0126cabef5175599f7fcd091680c0e3d991d6" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:30:56 crc kubenswrapper[5120]: E0316 16:30:56.525879 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="836f3504-5416-46bf-a225-7b7f977fe82c" containerName="nova-scheduler-scheduler" probeResult="unknown" Mar 16 16:30:56 crc kubenswrapper[5120]: I0316 16:30:56.539779 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/certified-operators-mx5rt"] Mar 16 16:30:56 crc kubenswrapper[5120]: E0316 16:30:56.585400 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="b48efa78dedc3f4e6339fe4bb5d889d3c5e126ba2b9c6bd274d193ebe220d8d9" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:30:56 crc kubenswrapper[5120]: E0316 16:30:56.588377 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="b48efa78dedc3f4e6339fe4bb5d889d3c5e126ba2b9c6bd274d193ebe220d8d9" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:30:56 crc kubenswrapper[5120]: E0316 16:30:56.590400 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="b48efa78dedc3f4e6339fe4bb5d889d3c5e126ba2b9c6bd274d193ebe220d8d9" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:30:56 crc kubenswrapper[5120]: E0316 16:30:56.590641 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="7c3819a8-dcaf-4026-87c2-5f6419c379a9" containerName="nova-cell1-conductor-conductor" probeResult="unknown" Mar 16 16:30:58 crc kubenswrapper[5120]: I0316 16:30:58.031122 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-marketplace/certified-operators-mx5rt" podUID="692399cb-3427-4a68-8677-aee482e1ae16" containerName="registry-server" containerID="cri-o://c0f2441bb0242aaffa2550dfcfe9ce5b320d0b22d1b0077b763f37179f3be3b6" gracePeriod=2 Mar 16 16:30:58 crc kubenswrapper[5120]: I0316 16:30:58.500257 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-mx5rt" Mar 16 16:30:58 crc kubenswrapper[5120]: I0316 16:30:58.655915 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/692399cb-3427-4a68-8677-aee482e1ae16-catalog-content\") pod \"692399cb-3427-4a68-8677-aee482e1ae16\" (UID: \"692399cb-3427-4a68-8677-aee482e1ae16\") " Mar 16 16:30:58 crc kubenswrapper[5120]: I0316 16:30:58.656095 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6z98f\" (UniqueName: \"kubernetes.io/projected/692399cb-3427-4a68-8677-aee482e1ae16-kube-api-access-6z98f\") pod \"692399cb-3427-4a68-8677-aee482e1ae16\" (UID: \"692399cb-3427-4a68-8677-aee482e1ae16\") " Mar 16 16:30:58 crc kubenswrapper[5120]: I0316 16:30:58.656914 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/692399cb-3427-4a68-8677-aee482e1ae16-utilities\") pod \"692399cb-3427-4a68-8677-aee482e1ae16\" (UID: \"692399cb-3427-4a68-8677-aee482e1ae16\") " Mar 16 16:30:58 crc kubenswrapper[5120]: I0316 16:30:58.658227 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/692399cb-3427-4a68-8677-aee482e1ae16-utilities" (OuterVolumeSpecName: "utilities") pod "692399cb-3427-4a68-8677-aee482e1ae16" (UID: "692399cb-3427-4a68-8677-aee482e1ae16"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:30:58 crc kubenswrapper[5120]: I0316 16:30:58.661703 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/692399cb-3427-4a68-8677-aee482e1ae16-kube-api-access-6z98f" (OuterVolumeSpecName: "kube-api-access-6z98f") pod "692399cb-3427-4a68-8677-aee482e1ae16" (UID: "692399cb-3427-4a68-8677-aee482e1ae16"). InnerVolumeSpecName "kube-api-access-6z98f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:30:58 crc kubenswrapper[5120]: I0316 16:30:58.740973 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/692399cb-3427-4a68-8677-aee482e1ae16-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "692399cb-3427-4a68-8677-aee482e1ae16" (UID: "692399cb-3427-4a68-8677-aee482e1ae16"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:30:58 crc kubenswrapper[5120]: I0316 16:30:58.759603 5120 reconciler_common.go:299] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/692399cb-3427-4a68-8677-aee482e1ae16-catalog-content\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:58 crc kubenswrapper[5120]: I0316 16:30:58.759651 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6z98f\" (UniqueName: \"kubernetes.io/projected/692399cb-3427-4a68-8677-aee482e1ae16-kube-api-access-6z98f\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:58 crc kubenswrapper[5120]: I0316 16:30:58.759671 5120 reconciler_common.go:299] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/692399cb-3427-4a68-8677-aee482e1ae16-utilities\") on node \"crc\" DevicePath \"\"" Mar 16 16:30:58 crc kubenswrapper[5120]: I0316 16:30:58.884351 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-marketplace-nttb7" Mar 16 16:30:58 crc kubenswrapper[5120]: I0316 16:30:58.884400 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-marketplace/redhat-marketplace-nttb7" Mar 16 16:30:58 crc kubenswrapper[5120]: I0316 16:30:58.948128 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-marketplace-nttb7" Mar 16 16:30:59 crc kubenswrapper[5120]: I0316 16:30:59.047692 5120 generic.go:358] "Generic (PLEG): container finished" podID="692399cb-3427-4a68-8677-aee482e1ae16" containerID="c0f2441bb0242aaffa2550dfcfe9ce5b320d0b22d1b0077b763f37179f3be3b6" exitCode=0 Mar 16 16:30:59 crc kubenswrapper[5120]: I0316 16:30:59.049427 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-mx5rt" Mar 16 16:30:59 crc kubenswrapper[5120]: I0316 16:30:59.050214 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-mx5rt" event={"ID":"692399cb-3427-4a68-8677-aee482e1ae16","Type":"ContainerDied","Data":"c0f2441bb0242aaffa2550dfcfe9ce5b320d0b22d1b0077b763f37179f3be3b6"} Mar 16 16:30:59 crc kubenswrapper[5120]: I0316 16:30:59.050305 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-mx5rt" event={"ID":"692399cb-3427-4a68-8677-aee482e1ae16","Type":"ContainerDied","Data":"fdb9fae019946af6f62519013a9ec6e8e0c90f1c1d1966417710984ece424a02"} Mar 16 16:30:59 crc kubenswrapper[5120]: I0316 16:30:59.050355 5120 scope.go:117] "RemoveContainer" containerID="c0f2441bb0242aaffa2550dfcfe9ce5b320d0b22d1b0077b763f37179f3be3b6" Mar 16 16:30:59 crc kubenswrapper[5120]: I0316 16:30:59.079955 5120 scope.go:117] "RemoveContainer" containerID="5609da216cfa4afbfadedb1a4b6d784dc810a8d8173b16954e0c2cc5b9d135ce" Mar 16 16:30:59 crc kubenswrapper[5120]: I0316 16:30:59.104689 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/certified-operators-mx5rt"] Mar 16 16:30:59 crc kubenswrapper[5120]: I0316 16:30:59.112892 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/certified-operators-mx5rt"] Mar 16 16:30:59 crc kubenswrapper[5120]: I0316 16:30:59.116080 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-marketplace-nttb7" Mar 16 16:30:59 crc kubenswrapper[5120]: I0316 16:30:59.120592 5120 scope.go:117] "RemoveContainer" containerID="b82520e4469e686cfd11097e1fef306c27002fe74930a1b424c52b51d3e0bc8b" Mar 16 16:30:59 crc kubenswrapper[5120]: I0316 16:30:59.165366 5120 scope.go:117] "RemoveContainer" containerID="c0f2441bb0242aaffa2550dfcfe9ce5b320d0b22d1b0077b763f37179f3be3b6" Mar 16 16:30:59 crc kubenswrapper[5120]: E0316 16:30:59.165870 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c0f2441bb0242aaffa2550dfcfe9ce5b320d0b22d1b0077b763f37179f3be3b6\": container with ID starting with c0f2441bb0242aaffa2550dfcfe9ce5b320d0b22d1b0077b763f37179f3be3b6 not found: ID does not exist" containerID="c0f2441bb0242aaffa2550dfcfe9ce5b320d0b22d1b0077b763f37179f3be3b6" Mar 16 16:30:59 crc kubenswrapper[5120]: I0316 16:30:59.165920 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0f2441bb0242aaffa2550dfcfe9ce5b320d0b22d1b0077b763f37179f3be3b6"} err="failed to get container status \"c0f2441bb0242aaffa2550dfcfe9ce5b320d0b22d1b0077b763f37179f3be3b6\": rpc error: code = NotFound desc = could not find container \"c0f2441bb0242aaffa2550dfcfe9ce5b320d0b22d1b0077b763f37179f3be3b6\": container with ID starting with c0f2441bb0242aaffa2550dfcfe9ce5b320d0b22d1b0077b763f37179f3be3b6 not found: ID does not exist" Mar 16 16:30:59 crc kubenswrapper[5120]: I0316 16:30:59.165953 5120 scope.go:117] "RemoveContainer" containerID="5609da216cfa4afbfadedb1a4b6d784dc810a8d8173b16954e0c2cc5b9d135ce" Mar 16 16:30:59 crc kubenswrapper[5120]: E0316 16:30:59.166417 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5609da216cfa4afbfadedb1a4b6d784dc810a8d8173b16954e0c2cc5b9d135ce\": container with ID starting with 5609da216cfa4afbfadedb1a4b6d784dc810a8d8173b16954e0c2cc5b9d135ce not found: ID does not exist" containerID="5609da216cfa4afbfadedb1a4b6d784dc810a8d8173b16954e0c2cc5b9d135ce" Mar 16 16:30:59 crc kubenswrapper[5120]: I0316 16:30:59.166443 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5609da216cfa4afbfadedb1a4b6d784dc810a8d8173b16954e0c2cc5b9d135ce"} err="failed to get container status \"5609da216cfa4afbfadedb1a4b6d784dc810a8d8173b16954e0c2cc5b9d135ce\": rpc error: code = NotFound desc = could not find container \"5609da216cfa4afbfadedb1a4b6d784dc810a8d8173b16954e0c2cc5b9d135ce\": container with ID starting with 5609da216cfa4afbfadedb1a4b6d784dc810a8d8173b16954e0c2cc5b9d135ce not found: ID does not exist" Mar 16 16:30:59 crc kubenswrapper[5120]: I0316 16:30:59.166459 5120 scope.go:117] "RemoveContainer" containerID="b82520e4469e686cfd11097e1fef306c27002fe74930a1b424c52b51d3e0bc8b" Mar 16 16:30:59 crc kubenswrapper[5120]: E0316 16:30:59.167011 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b82520e4469e686cfd11097e1fef306c27002fe74930a1b424c52b51d3e0bc8b\": container with ID starting with b82520e4469e686cfd11097e1fef306c27002fe74930a1b424c52b51d3e0bc8b not found: ID does not exist" containerID="b82520e4469e686cfd11097e1fef306c27002fe74930a1b424c52b51d3e0bc8b" Mar 16 16:30:59 crc kubenswrapper[5120]: I0316 16:30:59.167061 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b82520e4469e686cfd11097e1fef306c27002fe74930a1b424c52b51d3e0bc8b"} err="failed to get container status \"b82520e4469e686cfd11097e1fef306c27002fe74930a1b424c52b51d3e0bc8b\": rpc error: code = NotFound desc = could not find container \"b82520e4469e686cfd11097e1fef306c27002fe74930a1b424c52b51d3e0bc8b\": container with ID starting with b82520e4469e686cfd11097e1fef306c27002fe74930a1b424c52b51d3e0bc8b not found: ID does not exist" Mar 16 16:31:00 crc kubenswrapper[5120]: E0316 16:31:00.455068 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="1c7b11899133931bd406f6c19c7e46ecd6ae5021b5ed32c51931ad65ff554972" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:31:00 crc kubenswrapper[5120]: E0316 16:31:00.457722 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="1c7b11899133931bd406f6c19c7e46ecd6ae5021b5ed32c51931ad65ff554972" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:31:00 crc kubenswrapper[5120]: E0316 16:31:00.460269 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="1c7b11899133931bd406f6c19c7e46ecd6ae5021b5ed32c51931ad65ff554972" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:31:00 crc kubenswrapper[5120]: E0316 16:31:00.460353 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="7e45bb7a-9982-458f-80b5-60541c2d2daf" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 16:31:00 crc kubenswrapper[5120]: I0316 16:31:00.679172 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="692399cb-3427-4a68-8677-aee482e1ae16" path="/var/lib/kubelet/pods/692399cb-3427-4a68-8677-aee482e1ae16/volumes" Mar 16 16:31:01 crc kubenswrapper[5120]: I0316 16:31:01.335857 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-marketplace-nttb7"] Mar 16 16:31:01 crc kubenswrapper[5120]: I0316 16:31:01.336130 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-marketplace/redhat-marketplace-nttb7" podUID="57c30724-6f23-4b63-b97e-f1e692921ecf" containerName="registry-server" containerID="cri-o://906d1e53be56bc349735250ae9771ca74b2af131d9a67b7d7203c40a713ee31e" gracePeriod=2 Mar 16 16:31:01 crc kubenswrapper[5120]: E0316 16:31:01.514241 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="31eede8ea13e83df778b0cc727f0126cabef5175599f7fcd091680c0e3d991d6" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:31:01 crc kubenswrapper[5120]: E0316 16:31:01.515880 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="31eede8ea13e83df778b0cc727f0126cabef5175599f7fcd091680c0e3d991d6" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:31:01 crc kubenswrapper[5120]: E0316 16:31:01.517108 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="31eede8ea13e83df778b0cc727f0126cabef5175599f7fcd091680c0e3d991d6" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:31:01 crc kubenswrapper[5120]: E0316 16:31:01.517139 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="836f3504-5416-46bf-a225-7b7f977fe82c" containerName="nova-scheduler-scheduler" probeResult="unknown" Mar 16 16:31:01 crc kubenswrapper[5120]: E0316 16:31:01.585790 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="b48efa78dedc3f4e6339fe4bb5d889d3c5e126ba2b9c6bd274d193ebe220d8d9" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:31:01 crc kubenswrapper[5120]: E0316 16:31:01.590992 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="b48efa78dedc3f4e6339fe4bb5d889d3c5e126ba2b9c6bd274d193ebe220d8d9" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:31:01 crc kubenswrapper[5120]: E0316 16:31:01.592516 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="b48efa78dedc3f4e6339fe4bb5d889d3c5e126ba2b9c6bd274d193ebe220d8d9" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:31:01 crc kubenswrapper[5120]: E0316 16:31:01.592570 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="7c3819a8-dcaf-4026-87c2-5f6419c379a9" containerName="nova-cell1-conductor-conductor" probeResult="unknown" Mar 16 16:31:01 crc kubenswrapper[5120]: I0316 16:31:01.799581 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-nttb7" Mar 16 16:31:01 crc kubenswrapper[5120]: I0316 16:31:01.936798 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hbxjs\" (UniqueName: \"kubernetes.io/projected/57c30724-6f23-4b63-b97e-f1e692921ecf-kube-api-access-hbxjs\") pod \"57c30724-6f23-4b63-b97e-f1e692921ecf\" (UID: \"57c30724-6f23-4b63-b97e-f1e692921ecf\") " Mar 16 16:31:01 crc kubenswrapper[5120]: I0316 16:31:01.936929 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/57c30724-6f23-4b63-b97e-f1e692921ecf-utilities\") pod \"57c30724-6f23-4b63-b97e-f1e692921ecf\" (UID: \"57c30724-6f23-4b63-b97e-f1e692921ecf\") " Mar 16 16:31:01 crc kubenswrapper[5120]: I0316 16:31:01.937452 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/57c30724-6f23-4b63-b97e-f1e692921ecf-catalog-content\") pod \"57c30724-6f23-4b63-b97e-f1e692921ecf\" (UID: \"57c30724-6f23-4b63-b97e-f1e692921ecf\") " Mar 16 16:31:01 crc kubenswrapper[5120]: I0316 16:31:01.950900 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57c30724-6f23-4b63-b97e-f1e692921ecf-utilities" (OuterVolumeSpecName: "utilities") pod "57c30724-6f23-4b63-b97e-f1e692921ecf" (UID: "57c30724-6f23-4b63-b97e-f1e692921ecf"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:31:01 crc kubenswrapper[5120]: I0316 16:31:01.965695 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57c30724-6f23-4b63-b97e-f1e692921ecf-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "57c30724-6f23-4b63-b97e-f1e692921ecf" (UID: "57c30724-6f23-4b63-b97e-f1e692921ecf"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:31:01 crc kubenswrapper[5120]: I0316 16:31:01.968226 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57c30724-6f23-4b63-b97e-f1e692921ecf-kube-api-access-hbxjs" (OuterVolumeSpecName: "kube-api-access-hbxjs") pod "57c30724-6f23-4b63-b97e-f1e692921ecf" (UID: "57c30724-6f23-4b63-b97e-f1e692921ecf"). InnerVolumeSpecName "kube-api-access-hbxjs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:31:02 crc kubenswrapper[5120]: I0316 16:31:02.040188 5120 reconciler_common.go:299] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/57c30724-6f23-4b63-b97e-f1e692921ecf-catalog-content\") on node \"crc\" DevicePath \"\"" Mar 16 16:31:02 crc kubenswrapper[5120]: I0316 16:31:02.040243 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hbxjs\" (UniqueName: \"kubernetes.io/projected/57c30724-6f23-4b63-b97e-f1e692921ecf-kube-api-access-hbxjs\") on node \"crc\" DevicePath \"\"" Mar 16 16:31:02 crc kubenswrapper[5120]: I0316 16:31:02.040257 5120 reconciler_common.go:299] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/57c30724-6f23-4b63-b97e-f1e692921ecf-utilities\") on node \"crc\" DevicePath \"\"" Mar 16 16:31:02 crc kubenswrapper[5120]: I0316 16:31:02.088213 5120 generic.go:358] "Generic (PLEG): container finished" podID="57c30724-6f23-4b63-b97e-f1e692921ecf" containerID="906d1e53be56bc349735250ae9771ca74b2af131d9a67b7d7203c40a713ee31e" exitCode=0 Mar 16 16:31:02 crc kubenswrapper[5120]: I0316 16:31:02.088350 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-nttb7" event={"ID":"57c30724-6f23-4b63-b97e-f1e692921ecf","Type":"ContainerDied","Data":"906d1e53be56bc349735250ae9771ca74b2af131d9a67b7d7203c40a713ee31e"} Mar 16 16:31:02 crc kubenswrapper[5120]: I0316 16:31:02.088392 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-nttb7" event={"ID":"57c30724-6f23-4b63-b97e-f1e692921ecf","Type":"ContainerDied","Data":"cb9b421046a49f5af0e55fb13df5fb2acce03b5007f19e694c2ef48dded9b621"} Mar 16 16:31:02 crc kubenswrapper[5120]: I0316 16:31:02.088413 5120 scope.go:117] "RemoveContainer" containerID="906d1e53be56bc349735250ae9771ca74b2af131d9a67b7d7203c40a713ee31e" Mar 16 16:31:02 crc kubenswrapper[5120]: I0316 16:31:02.088548 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-nttb7" Mar 16 16:31:02 crc kubenswrapper[5120]: I0316 16:31:02.113438 5120 generic.go:358] "Generic (PLEG): container finished" podID="e4c4e515-3d7d-4436-ab79-c7c6e2bf2867" containerID="f15bf1aad527f5c095b7bff2dca1db767738973c6277e2a0f00f4724cc41a6d1" exitCode=137 Mar 16 16:31:02 crc kubenswrapper[5120]: I0316 16:31:02.113526 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"e4c4e515-3d7d-4436-ab79-c7c6e2bf2867","Type":"ContainerDied","Data":"f15bf1aad527f5c095b7bff2dca1db767738973c6277e2a0f00f4724cc41a6d1"} Mar 16 16:31:02 crc kubenswrapper[5120]: W0316 16:31:02.178183 5120 watcher.go:93] Error while processing event ("/sys/fs/cgroup/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod692399cb_3427_4a68_8677_aee482e1ae16.slice": 0x40000100 == IN_CREATE|IN_ISDIR): inotify_add_watch /sys/fs/cgroup/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod692399cb_3427_4a68_8677_aee482e1ae16.slice: no such file or directory Mar 16 16:31:02 crc kubenswrapper[5120]: I0316 16:31:02.335180 5120 scope.go:117] "RemoveContainer" containerID="fc22053a276d9e7441a2d6ef7cb615668a2558e4b1cf319d82c041c13fc38060" Mar 16 16:31:02 crc kubenswrapper[5120]: I0316 16:31:02.362992 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-marketplace-nttb7"] Mar 16 16:31:02 crc kubenswrapper[5120]: I0316 16:31:02.371430 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/redhat-marketplace-nttb7"] Mar 16 16:31:02 crc kubenswrapper[5120]: I0316 16:31:02.375430 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:31:02 crc kubenswrapper[5120]: I0316 16:31:02.393944 5120 scope.go:117] "RemoveContainer" containerID="518c5b280834d36f18a925ad61f60d88fc7748df5e93b09fba9bb21dd14f7fe4" Mar 16 16:31:02 crc kubenswrapper[5120]: I0316 16:31:02.441136 5120 scope.go:117] "RemoveContainer" containerID="906d1e53be56bc349735250ae9771ca74b2af131d9a67b7d7203c40a713ee31e" Mar 16 16:31:02 crc kubenswrapper[5120]: E0316 16:31:02.441508 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"906d1e53be56bc349735250ae9771ca74b2af131d9a67b7d7203c40a713ee31e\": container with ID starting with 906d1e53be56bc349735250ae9771ca74b2af131d9a67b7d7203c40a713ee31e not found: ID does not exist" containerID="906d1e53be56bc349735250ae9771ca74b2af131d9a67b7d7203c40a713ee31e" Mar 16 16:31:02 crc kubenswrapper[5120]: I0316 16:31:02.441540 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"906d1e53be56bc349735250ae9771ca74b2af131d9a67b7d7203c40a713ee31e"} err="failed to get container status \"906d1e53be56bc349735250ae9771ca74b2af131d9a67b7d7203c40a713ee31e\": rpc error: code = NotFound desc = could not find container \"906d1e53be56bc349735250ae9771ca74b2af131d9a67b7d7203c40a713ee31e\": container with ID starting with 906d1e53be56bc349735250ae9771ca74b2af131d9a67b7d7203c40a713ee31e not found: ID does not exist" Mar 16 16:31:02 crc kubenswrapper[5120]: I0316 16:31:02.441559 5120 scope.go:117] "RemoveContainer" containerID="fc22053a276d9e7441a2d6ef7cb615668a2558e4b1cf319d82c041c13fc38060" Mar 16 16:31:02 crc kubenswrapper[5120]: E0316 16:31:02.465282 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc22053a276d9e7441a2d6ef7cb615668a2558e4b1cf319d82c041c13fc38060\": container with ID starting with fc22053a276d9e7441a2d6ef7cb615668a2558e4b1cf319d82c041c13fc38060 not found: ID does not exist" containerID="fc22053a276d9e7441a2d6ef7cb615668a2558e4b1cf319d82c041c13fc38060" Mar 16 16:31:02 crc kubenswrapper[5120]: I0316 16:31:02.465340 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc22053a276d9e7441a2d6ef7cb615668a2558e4b1cf319d82c041c13fc38060"} err="failed to get container status \"fc22053a276d9e7441a2d6ef7cb615668a2558e4b1cf319d82c041c13fc38060\": rpc error: code = NotFound desc = could not find container \"fc22053a276d9e7441a2d6ef7cb615668a2558e4b1cf319d82c041c13fc38060\": container with ID starting with fc22053a276d9e7441a2d6ef7cb615668a2558e4b1cf319d82c041c13fc38060 not found: ID does not exist" Mar 16 16:31:02 crc kubenswrapper[5120]: I0316 16:31:02.465374 5120 scope.go:117] "RemoveContainer" containerID="518c5b280834d36f18a925ad61f60d88fc7748df5e93b09fba9bb21dd14f7fe4" Mar 16 16:31:02 crc kubenswrapper[5120]: I0316 16:31:02.465919 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-khj44\" (UniqueName: \"kubernetes.io/projected/e4c4e515-3d7d-4436-ab79-c7c6e2bf2867-kube-api-access-khj44\") pod \"e4c4e515-3d7d-4436-ab79-c7c6e2bf2867\" (UID: \"e4c4e515-3d7d-4436-ab79-c7c6e2bf2867\") " Mar 16 16:31:02 crc kubenswrapper[5120]: I0316 16:31:02.466056 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/e4c4e515-3d7d-4436-ab79-c7c6e2bf2867-etc-swift\") pod \"e4c4e515-3d7d-4436-ab79-c7c6e2bf2867\" (UID: \"e4c4e515-3d7d-4436-ab79-c7c6e2bf2867\") " Mar 16 16:31:02 crc kubenswrapper[5120]: I0316 16:31:02.466370 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e4c4e515-3d7d-4436-ab79-c7c6e2bf2867-combined-ca-bundle\") pod \"e4c4e515-3d7d-4436-ab79-c7c6e2bf2867\" (UID: \"e4c4e515-3d7d-4436-ab79-c7c6e2bf2867\") " Mar 16 16:31:02 crc kubenswrapper[5120]: I0316 16:31:02.466465 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"swift\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"e4c4e515-3d7d-4436-ab79-c7c6e2bf2867\" (UID: \"e4c4e515-3d7d-4436-ab79-c7c6e2bf2867\") " Mar 16 16:31:02 crc kubenswrapper[5120]: I0316 16:31:02.466540 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/e4c4e515-3d7d-4436-ab79-c7c6e2bf2867-lock\") pod \"e4c4e515-3d7d-4436-ab79-c7c6e2bf2867\" (UID: \"e4c4e515-3d7d-4436-ab79-c7c6e2bf2867\") " Mar 16 16:31:02 crc kubenswrapper[5120]: I0316 16:31:02.466716 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/e4c4e515-3d7d-4436-ab79-c7c6e2bf2867-cache\") pod \"e4c4e515-3d7d-4436-ab79-c7c6e2bf2867\" (UID: \"e4c4e515-3d7d-4436-ab79-c7c6e2bf2867\") " Mar 16 16:31:02 crc kubenswrapper[5120]: I0316 16:31:02.468061 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4c4e515-3d7d-4436-ab79-c7c6e2bf2867-cache" (OuterVolumeSpecName: "cache") pod "e4c4e515-3d7d-4436-ab79-c7c6e2bf2867" (UID: "e4c4e515-3d7d-4436-ab79-c7c6e2bf2867"). InnerVolumeSpecName "cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:31:02 crc kubenswrapper[5120]: E0316 16:31:02.468320 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"518c5b280834d36f18a925ad61f60d88fc7748df5e93b09fba9bb21dd14f7fe4\": container with ID starting with 518c5b280834d36f18a925ad61f60d88fc7748df5e93b09fba9bb21dd14f7fe4 not found: ID does not exist" containerID="518c5b280834d36f18a925ad61f60d88fc7748df5e93b09fba9bb21dd14f7fe4" Mar 16 16:31:02 crc kubenswrapper[5120]: I0316 16:31:02.468369 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"518c5b280834d36f18a925ad61f60d88fc7748df5e93b09fba9bb21dd14f7fe4"} err="failed to get container status \"518c5b280834d36f18a925ad61f60d88fc7748df5e93b09fba9bb21dd14f7fe4\": rpc error: code = NotFound desc = could not find container \"518c5b280834d36f18a925ad61f60d88fc7748df5e93b09fba9bb21dd14f7fe4\": container with ID starting with 518c5b280834d36f18a925ad61f60d88fc7748df5e93b09fba9bb21dd14f7fe4 not found: ID does not exist" Mar 16 16:31:02 crc kubenswrapper[5120]: I0316 16:31:02.468751 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4c4e515-3d7d-4436-ab79-c7c6e2bf2867-lock" (OuterVolumeSpecName: "lock") pod "e4c4e515-3d7d-4436-ab79-c7c6e2bf2867" (UID: "e4c4e515-3d7d-4436-ab79-c7c6e2bf2867"). InnerVolumeSpecName "lock". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:31:02 crc kubenswrapper[5120]: I0316 16:31:02.473521 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e4c4e515-3d7d-4436-ab79-c7c6e2bf2867-kube-api-access-khj44" (OuterVolumeSpecName: "kube-api-access-khj44") pod "e4c4e515-3d7d-4436-ab79-c7c6e2bf2867" (UID: "e4c4e515-3d7d-4436-ab79-c7c6e2bf2867"). InnerVolumeSpecName "kube-api-access-khj44". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:31:02 crc kubenswrapper[5120]: I0316 16:31:02.475890 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage10-crc" (OuterVolumeSpecName: "swift") pod "e4c4e515-3d7d-4436-ab79-c7c6e2bf2867" (UID: "e4c4e515-3d7d-4436-ab79-c7c6e2bf2867"). InnerVolumeSpecName "local-storage10-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:31:02 crc kubenswrapper[5120]: I0316 16:31:02.478482 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e4c4e515-3d7d-4436-ab79-c7c6e2bf2867-etc-swift" (OuterVolumeSpecName: "etc-swift") pod "e4c4e515-3d7d-4436-ab79-c7c6e2bf2867" (UID: "e4c4e515-3d7d-4436-ab79-c7c6e2bf2867"). InnerVolumeSpecName "etc-swift". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:31:02 crc kubenswrapper[5120]: E0316 16:31:02.545187 5120 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8690a5a2_3341_452e_8364_2e5e4072c192.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57c30724_6f23_4b63_b97e_f1e692921ecf.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57c30724_6f23_4b63_b97e_f1e692921ecf.slice/crio-cb9b421046a49f5af0e55fb13df5fb2acce03b5007f19e694c2ef48dded9b621\": RecentStats: unable to find data in memory cache]" Mar 16 16:31:02 crc kubenswrapper[5120]: I0316 16:31:02.569794 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") on node \"crc\" " Mar 16 16:31:02 crc kubenswrapper[5120]: I0316 16:31:02.570325 5120 reconciler_common.go:299] "Volume detached for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/e4c4e515-3d7d-4436-ab79-c7c6e2bf2867-lock\") on node \"crc\" DevicePath \"\"" Mar 16 16:31:02 crc kubenswrapper[5120]: I0316 16:31:02.570335 5120 reconciler_common.go:299] "Volume detached for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/e4c4e515-3d7d-4436-ab79-c7c6e2bf2867-cache\") on node \"crc\" DevicePath \"\"" Mar 16 16:31:02 crc kubenswrapper[5120]: I0316 16:31:02.570345 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-khj44\" (UniqueName: \"kubernetes.io/projected/e4c4e515-3d7d-4436-ab79-c7c6e2bf2867-kube-api-access-khj44\") on node \"crc\" DevicePath \"\"" Mar 16 16:31:02 crc kubenswrapper[5120]: I0316 16:31:02.570357 5120 reconciler_common.go:299] "Volume detached for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/e4c4e515-3d7d-4436-ab79-c7c6e2bf2867-etc-swift\") on node \"crc\" DevicePath \"\"" Mar 16 16:31:02 crc kubenswrapper[5120]: I0316 16:31:02.586462 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage10-crc" (UniqueName: "kubernetes.io/local-volume/local-storage10-crc") on node "crc" Mar 16 16:31:02 crc kubenswrapper[5120]: I0316 16:31:02.644237 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:31:02 crc kubenswrapper[5120]: I0316 16:31:02.660138 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:31:02 crc kubenswrapper[5120]: I0316 16:31:02.661056 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-59d4fdd9db-tttbf_325f32e1-5461-4d71-a30c-dee2528d6fb3/neutron-api/0.log" Mar 16 16:31:02 crc kubenswrapper[5120]: I0316 16:31:02.661232 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-59d4fdd9db-tttbf" Mar 16 16:31:02 crc kubenswrapper[5120]: I0316 16:31:02.670961 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/abc96fef-3a85-4438-848c-0910513810e0-run-httpd\") pod \"abc96fef-3a85-4438-848c-0910513810e0\" (UID: \"abc96fef-3a85-4438-848c-0910513810e0\") " Mar 16 16:31:02 crc kubenswrapper[5120]: I0316 16:31:02.671033 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/abc96fef-3a85-4438-848c-0910513810e0-scripts\") pod \"abc96fef-3a85-4438-848c-0910513810e0\" (UID: \"abc96fef-3a85-4438-848c-0910513810e0\") " Mar 16 16:31:02 crc kubenswrapper[5120]: I0316 16:31:02.671099 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jljjb\" (UniqueName: \"kubernetes.io/projected/abc96fef-3a85-4438-848c-0910513810e0-kube-api-access-jljjb\") pod \"abc96fef-3a85-4438-848c-0910513810e0\" (UID: \"abc96fef-3a85-4438-848c-0910513810e0\") " Mar 16 16:31:02 crc kubenswrapper[5120]: I0316 16:31:02.671130 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/abc96fef-3a85-4438-848c-0910513810e0-config-data\") pod \"abc96fef-3a85-4438-848c-0910513810e0\" (UID: \"abc96fef-3a85-4438-848c-0910513810e0\") " Mar 16 16:31:02 crc kubenswrapper[5120]: I0316 16:31:02.671186 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/325f32e1-5461-4d71-a30c-dee2528d6fb3-ovndb-tls-certs\") pod \"325f32e1-5461-4d71-a30c-dee2528d6fb3\" (UID: \"325f32e1-5461-4d71-a30c-dee2528d6fb3\") " Mar 16 16:31:02 crc kubenswrapper[5120]: I0316 16:31:02.671242 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7rvks\" (UniqueName: \"kubernetes.io/projected/594e9c2b-c42a-4671-9b95-3ca9cc0834da-kube-api-access-7rvks\") pod \"594e9c2b-c42a-4671-9b95-3ca9cc0834da\" (UID: \"594e9c2b-c42a-4671-9b95-3ca9cc0834da\") " Mar 16 16:31:02 crc kubenswrapper[5120]: I0316 16:31:02.671262 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/594e9c2b-c42a-4671-9b95-3ca9cc0834da-scripts\") pod \"594e9c2b-c42a-4671-9b95-3ca9cc0834da\" (UID: \"594e9c2b-c42a-4671-9b95-3ca9cc0834da\") " Mar 16 16:31:02 crc kubenswrapper[5120]: I0316 16:31:02.671285 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/abc96fef-3a85-4438-848c-0910513810e0-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "abc96fef-3a85-4438-848c-0910513810e0" (UID: "abc96fef-3a85-4438-848c-0910513810e0"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:31:02 crc kubenswrapper[5120]: I0316 16:31:02.671299 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/325f32e1-5461-4d71-a30c-dee2528d6fb3-combined-ca-bundle\") pod \"325f32e1-5461-4d71-a30c-dee2528d6fb3\" (UID: \"325f32e1-5461-4d71-a30c-dee2528d6fb3\") " Mar 16 16:31:02 crc kubenswrapper[5120]: I0316 16:31:02.671374 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/abc96fef-3a85-4438-848c-0910513810e0-log-httpd\") pod \"abc96fef-3a85-4438-848c-0910513810e0\" (UID: \"abc96fef-3a85-4438-848c-0910513810e0\") " Mar 16 16:31:02 crc kubenswrapper[5120]: I0316 16:31:02.671409 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/594e9c2b-c42a-4671-9b95-3ca9cc0834da-config-data-custom\") pod \"594e9c2b-c42a-4671-9b95-3ca9cc0834da\" (UID: \"594e9c2b-c42a-4671-9b95-3ca9cc0834da\") " Mar 16 16:31:02 crc kubenswrapper[5120]: I0316 16:31:02.671432 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/325f32e1-5461-4d71-a30c-dee2528d6fb3-httpd-config\") pod \"325f32e1-5461-4d71-a30c-dee2528d6fb3\" (UID: \"325f32e1-5461-4d71-a30c-dee2528d6fb3\") " Mar 16 16:31:02 crc kubenswrapper[5120]: I0316 16:31:02.671451 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/594e9c2b-c42a-4671-9b95-3ca9cc0834da-config-data\") pod \"594e9c2b-c42a-4671-9b95-3ca9cc0834da\" (UID: \"594e9c2b-c42a-4671-9b95-3ca9cc0834da\") " Mar 16 16:31:02 crc kubenswrapper[5120]: I0316 16:31:02.671478 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/abc96fef-3a85-4438-848c-0910513810e0-ceilometer-tls-certs\") pod \"abc96fef-3a85-4438-848c-0910513810e0\" (UID: \"abc96fef-3a85-4438-848c-0910513810e0\") " Mar 16 16:31:02 crc kubenswrapper[5120]: I0316 16:31:02.671496 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/594e9c2b-c42a-4671-9b95-3ca9cc0834da-etc-machine-id\") pod \"594e9c2b-c42a-4671-9b95-3ca9cc0834da\" (UID: \"594e9c2b-c42a-4671-9b95-3ca9cc0834da\") " Mar 16 16:31:02 crc kubenswrapper[5120]: I0316 16:31:02.671524 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/325f32e1-5461-4d71-a30c-dee2528d6fb3-public-tls-certs\") pod \"325f32e1-5461-4d71-a30c-dee2528d6fb3\" (UID: \"325f32e1-5461-4d71-a30c-dee2528d6fb3\") " Mar 16 16:31:02 crc kubenswrapper[5120]: I0316 16:31:02.671542 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/325f32e1-5461-4d71-a30c-dee2528d6fb3-config\") pod \"325f32e1-5461-4d71-a30c-dee2528d6fb3\" (UID: \"325f32e1-5461-4d71-a30c-dee2528d6fb3\") " Mar 16 16:31:02 crc kubenswrapper[5120]: I0316 16:31:02.671660 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/325f32e1-5461-4d71-a30c-dee2528d6fb3-internal-tls-certs\") pod \"325f32e1-5461-4d71-a30c-dee2528d6fb3\" (UID: \"325f32e1-5461-4d71-a30c-dee2528d6fb3\") " Mar 16 16:31:02 crc kubenswrapper[5120]: I0316 16:31:02.671696 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/594e9c2b-c42a-4671-9b95-3ca9cc0834da-combined-ca-bundle\") pod \"594e9c2b-c42a-4671-9b95-3ca9cc0834da\" (UID: \"594e9c2b-c42a-4671-9b95-3ca9cc0834da\") " Mar 16 16:31:02 crc kubenswrapper[5120]: I0316 16:31:02.671770 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/abc96fef-3a85-4438-848c-0910513810e0-sg-core-conf-yaml\") pod \"abc96fef-3a85-4438-848c-0910513810e0\" (UID: \"abc96fef-3a85-4438-848c-0910513810e0\") " Mar 16 16:31:02 crc kubenswrapper[5120]: I0316 16:31:02.671802 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/abc96fef-3a85-4438-848c-0910513810e0-combined-ca-bundle\") pod \"abc96fef-3a85-4438-848c-0910513810e0\" (UID: \"abc96fef-3a85-4438-848c-0910513810e0\") " Mar 16 16:31:02 crc kubenswrapper[5120]: I0316 16:31:02.671815 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/abc96fef-3a85-4438-848c-0910513810e0-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "abc96fef-3a85-4438-848c-0910513810e0" (UID: "abc96fef-3a85-4438-848c-0910513810e0"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:31:02 crc kubenswrapper[5120]: I0316 16:31:02.671842 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ggztv\" (UniqueName: \"kubernetes.io/projected/325f32e1-5461-4d71-a30c-dee2528d6fb3-kube-api-access-ggztv\") pod \"325f32e1-5461-4d71-a30c-dee2528d6fb3\" (UID: \"325f32e1-5461-4d71-a30c-dee2528d6fb3\") " Mar 16 16:31:02 crc kubenswrapper[5120]: I0316 16:31:02.672737 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/abc96fef-3a85-4438-848c-0910513810e0-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:31:02 crc kubenswrapper[5120]: I0316 16:31:02.672785 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:31:02 crc kubenswrapper[5120]: I0316 16:31:02.672798 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/abc96fef-3a85-4438-848c-0910513810e0-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:31:02 crc kubenswrapper[5120]: I0316 16:31:02.676926 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="57c30724-6f23-4b63-b97e-f1e692921ecf" path="/var/lib/kubelet/pods/57c30724-6f23-4b63-b97e-f1e692921ecf/volumes" Mar 16 16:31:02 crc kubenswrapper[5120]: I0316 16:31:02.705051 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/abc96fef-3a85-4438-848c-0910513810e0-scripts" (OuterVolumeSpecName: "scripts") pod "abc96fef-3a85-4438-848c-0910513810e0" (UID: "abc96fef-3a85-4438-848c-0910513810e0"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:31:02 crc kubenswrapper[5120]: I0316 16:31:02.705250 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/594e9c2b-c42a-4671-9b95-3ca9cc0834da-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "594e9c2b-c42a-4671-9b95-3ca9cc0834da" (UID: "594e9c2b-c42a-4671-9b95-3ca9cc0834da"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 16:31:02 crc kubenswrapper[5120]: I0316 16:31:02.705468 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/325f32e1-5461-4d71-a30c-dee2528d6fb3-kube-api-access-ggztv" (OuterVolumeSpecName: "kube-api-access-ggztv") pod "325f32e1-5461-4d71-a30c-dee2528d6fb3" (UID: "325f32e1-5461-4d71-a30c-dee2528d6fb3"). InnerVolumeSpecName "kube-api-access-ggztv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:31:02 crc kubenswrapper[5120]: I0316 16:31:02.710167 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/594e9c2b-c42a-4671-9b95-3ca9cc0834da-kube-api-access-7rvks" (OuterVolumeSpecName: "kube-api-access-7rvks") pod "594e9c2b-c42a-4671-9b95-3ca9cc0834da" (UID: "594e9c2b-c42a-4671-9b95-3ca9cc0834da"). InnerVolumeSpecName "kube-api-access-7rvks". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:31:02 crc kubenswrapper[5120]: I0316 16:31:02.711636 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/325f32e1-5461-4d71-a30c-dee2528d6fb3-httpd-config" (OuterVolumeSpecName: "httpd-config") pod "325f32e1-5461-4d71-a30c-dee2528d6fb3" (UID: "325f32e1-5461-4d71-a30c-dee2528d6fb3"). InnerVolumeSpecName "httpd-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:31:02 crc kubenswrapper[5120]: I0316 16:31:02.711715 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/594e9c2b-c42a-4671-9b95-3ca9cc0834da-scripts" (OuterVolumeSpecName: "scripts") pod "594e9c2b-c42a-4671-9b95-3ca9cc0834da" (UID: "594e9c2b-c42a-4671-9b95-3ca9cc0834da"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:31:02 crc kubenswrapper[5120]: I0316 16:31:02.711829 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/abc96fef-3a85-4438-848c-0910513810e0-kube-api-access-jljjb" (OuterVolumeSpecName: "kube-api-access-jljjb") pod "abc96fef-3a85-4438-848c-0910513810e0" (UID: "abc96fef-3a85-4438-848c-0910513810e0"). InnerVolumeSpecName "kube-api-access-jljjb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:31:02 crc kubenswrapper[5120]: I0316 16:31:02.728629 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/594e9c2b-c42a-4671-9b95-3ca9cc0834da-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "594e9c2b-c42a-4671-9b95-3ca9cc0834da" (UID: "594e9c2b-c42a-4671-9b95-3ca9cc0834da"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:31:02 crc kubenswrapper[5120]: I0316 16:31:02.735852 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/abc96fef-3a85-4438-848c-0910513810e0-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "abc96fef-3a85-4438-848c-0910513810e0" (UID: "abc96fef-3a85-4438-848c-0910513810e0"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:31:02 crc kubenswrapper[5120]: I0316 16:31:02.759303 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/abc96fef-3a85-4438-848c-0910513810e0-ceilometer-tls-certs" (OuterVolumeSpecName: "ceilometer-tls-certs") pod "abc96fef-3a85-4438-848c-0910513810e0" (UID: "abc96fef-3a85-4438-848c-0910513810e0"). InnerVolumeSpecName "ceilometer-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:31:02 crc kubenswrapper[5120]: I0316 16:31:02.767938 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/325f32e1-5461-4d71-a30c-dee2528d6fb3-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "325f32e1-5461-4d71-a30c-dee2528d6fb3" (UID: "325f32e1-5461-4d71-a30c-dee2528d6fb3"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:31:02 crc kubenswrapper[5120]: I0316 16:31:02.773992 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/abc96fef-3a85-4438-848c-0910513810e0-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 16:31:02 crc kubenswrapper[5120]: I0316 16:31:02.774022 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ggztv\" (UniqueName: \"kubernetes.io/projected/325f32e1-5461-4d71-a30c-dee2528d6fb3-kube-api-access-ggztv\") on node \"crc\" DevicePath \"\"" Mar 16 16:31:02 crc kubenswrapper[5120]: I0316 16:31:02.774035 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/abc96fef-3a85-4438-848c-0910513810e0-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:31:02 crc kubenswrapper[5120]: I0316 16:31:02.774044 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jljjb\" (UniqueName: \"kubernetes.io/projected/abc96fef-3a85-4438-848c-0910513810e0-kube-api-access-jljjb\") on node \"crc\" DevicePath \"\"" Mar 16 16:31:02 crc kubenswrapper[5120]: I0316 16:31:02.774053 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7rvks\" (UniqueName: \"kubernetes.io/projected/594e9c2b-c42a-4671-9b95-3ca9cc0834da-kube-api-access-7rvks\") on node \"crc\" DevicePath \"\"" Mar 16 16:31:02 crc kubenswrapper[5120]: I0316 16:31:02.774061 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/594e9c2b-c42a-4671-9b95-3ca9cc0834da-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:31:02 crc kubenswrapper[5120]: I0316 16:31:02.774070 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/325f32e1-5461-4d71-a30c-dee2528d6fb3-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:31:02 crc kubenswrapper[5120]: I0316 16:31:02.774078 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/594e9c2b-c42a-4671-9b95-3ca9cc0834da-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:31:02 crc kubenswrapper[5120]: I0316 16:31:02.774088 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/325f32e1-5461-4d71-a30c-dee2528d6fb3-httpd-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:31:02 crc kubenswrapper[5120]: I0316 16:31:02.774096 5120 reconciler_common.go:299] "Volume detached for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/abc96fef-3a85-4438-848c-0910513810e0-ceilometer-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:31:02 crc kubenswrapper[5120]: I0316 16:31:02.774104 5120 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/594e9c2b-c42a-4671-9b95-3ca9cc0834da-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 16:31:02 crc kubenswrapper[5120]: I0316 16:31:02.789985 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/594e9c2b-c42a-4671-9b95-3ca9cc0834da-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "594e9c2b-c42a-4671-9b95-3ca9cc0834da" (UID: "594e9c2b-c42a-4671-9b95-3ca9cc0834da"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:31:02 crc kubenswrapper[5120]: I0316 16:31:02.791327 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/abc96fef-3a85-4438-848c-0910513810e0-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "abc96fef-3a85-4438-848c-0910513810e0" (UID: "abc96fef-3a85-4438-848c-0910513810e0"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:31:02 crc kubenswrapper[5120]: I0316 16:31:02.793427 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/325f32e1-5461-4d71-a30c-dee2528d6fb3-ovndb-tls-certs" (OuterVolumeSpecName: "ovndb-tls-certs") pod "325f32e1-5461-4d71-a30c-dee2528d6fb3" (UID: "325f32e1-5461-4d71-a30c-dee2528d6fb3"). InnerVolumeSpecName "ovndb-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:31:02 crc kubenswrapper[5120]: I0316 16:31:02.793895 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/325f32e1-5461-4d71-a30c-dee2528d6fb3-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "325f32e1-5461-4d71-a30c-dee2528d6fb3" (UID: "325f32e1-5461-4d71-a30c-dee2528d6fb3"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:31:02 crc kubenswrapper[5120]: I0316 16:31:02.797970 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/325f32e1-5461-4d71-a30c-dee2528d6fb3-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "325f32e1-5461-4d71-a30c-dee2528d6fb3" (UID: "325f32e1-5461-4d71-a30c-dee2528d6fb3"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:31:02 crc kubenswrapper[5120]: I0316 16:31:02.799778 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/abc96fef-3a85-4438-848c-0910513810e0-config-data" (OuterVolumeSpecName: "config-data") pod "abc96fef-3a85-4438-848c-0910513810e0" (UID: "abc96fef-3a85-4438-848c-0910513810e0"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:31:02 crc kubenswrapper[5120]: I0316 16:31:02.804549 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/325f32e1-5461-4d71-a30c-dee2528d6fb3-config" (OuterVolumeSpecName: "config") pod "325f32e1-5461-4d71-a30c-dee2528d6fb3" (UID: "325f32e1-5461-4d71-a30c-dee2528d6fb3"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:31:02 crc kubenswrapper[5120]: I0316 16:31:02.831555 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/594e9c2b-c42a-4671-9b95-3ca9cc0834da-config-data" (OuterVolumeSpecName: "config-data") pod "594e9c2b-c42a-4671-9b95-3ca9cc0834da" (UID: "594e9c2b-c42a-4671-9b95-3ca9cc0834da"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:31:02 crc kubenswrapper[5120]: I0316 16:31:02.856487 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e4c4e515-3d7d-4436-ab79-c7c6e2bf2867-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e4c4e515-3d7d-4436-ab79-c7c6e2bf2867" (UID: "e4c4e515-3d7d-4436-ab79-c7c6e2bf2867"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:31:02 crc kubenswrapper[5120]: I0316 16:31:02.876774 5120 reconciler_common.go:299] "Volume detached for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/325f32e1-5461-4d71-a30c-dee2528d6fb3-ovndb-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:31:02 crc kubenswrapper[5120]: I0316 16:31:02.876811 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/594e9c2b-c42a-4671-9b95-3ca9cc0834da-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:31:02 crc kubenswrapper[5120]: I0316 16:31:02.876821 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/325f32e1-5461-4d71-a30c-dee2528d6fb3-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:31:02 crc kubenswrapper[5120]: I0316 16:31:02.876833 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/325f32e1-5461-4d71-a30c-dee2528d6fb3-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:31:02 crc kubenswrapper[5120]: I0316 16:31:02.876841 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/325f32e1-5461-4d71-a30c-dee2528d6fb3-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:31:02 crc kubenswrapper[5120]: I0316 16:31:02.876851 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/594e9c2b-c42a-4671-9b95-3ca9cc0834da-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:31:02 crc kubenswrapper[5120]: I0316 16:31:02.876860 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/abc96fef-3a85-4438-848c-0910513810e0-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:31:02 crc kubenswrapper[5120]: I0316 16:31:02.876869 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e4c4e515-3d7d-4436-ab79-c7c6e2bf2867-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:31:02 crc kubenswrapper[5120]: I0316 16:31:02.876877 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/abc96fef-3a85-4438-848c-0910513810e0-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:31:03 crc kubenswrapper[5120]: I0316 16:31:03.129125 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-59d4fdd9db-tttbf_325f32e1-5461-4d71-a30c-dee2528d6fb3/neutron-api/0.log" Mar 16 16:31:03 crc kubenswrapper[5120]: I0316 16:31:03.129395 5120 generic.go:358] "Generic (PLEG): container finished" podID="325f32e1-5461-4d71-a30c-dee2528d6fb3" containerID="db3e2580ea95177e9d6490933f7a1f793687c66e415fc971c115bd499c92ab81" exitCode=137 Mar 16 16:31:03 crc kubenswrapper[5120]: I0316 16:31:03.129463 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-59d4fdd9db-tttbf" event={"ID":"325f32e1-5461-4d71-a30c-dee2528d6fb3","Type":"ContainerDied","Data":"db3e2580ea95177e9d6490933f7a1f793687c66e415fc971c115bd499c92ab81"} Mar 16 16:31:03 crc kubenswrapper[5120]: I0316 16:31:03.129546 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-59d4fdd9db-tttbf" event={"ID":"325f32e1-5461-4d71-a30c-dee2528d6fb3","Type":"ContainerDied","Data":"257c1718fc36bb384d861841f80dd29610b3a67f6fbd03ac835f047fb5332d48"} Mar 16 16:31:03 crc kubenswrapper[5120]: I0316 16:31:03.129579 5120 scope.go:117] "RemoveContainer" containerID="1595763c4adbd5710d1143db484ee9b4d612579aceba19faf0f4e5d27d44445d" Mar 16 16:31:03 crc kubenswrapper[5120]: I0316 16:31:03.129881 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-59d4fdd9db-tttbf" Mar 16 16:31:03 crc kubenswrapper[5120]: I0316 16:31:03.135670 5120 generic.go:358] "Generic (PLEG): container finished" podID="abc96fef-3a85-4438-848c-0910513810e0" containerID="3b26184bcf959244a04517160ad0256a4a63d93d49413616a3117c699a7df75b" exitCode=137 Mar 16 16:31:03 crc kubenswrapper[5120]: I0316 16:31:03.135788 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:31:03 crc kubenswrapper[5120]: I0316 16:31:03.135805 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"abc96fef-3a85-4438-848c-0910513810e0","Type":"ContainerDied","Data":"3b26184bcf959244a04517160ad0256a4a63d93d49413616a3117c699a7df75b"} Mar 16 16:31:03 crc kubenswrapper[5120]: I0316 16:31:03.135950 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"abc96fef-3a85-4438-848c-0910513810e0","Type":"ContainerDied","Data":"693e8289e379b6f666acead5d4310edbed2bb37feef02ea682b0f276ccefefba"} Mar 16 16:31:03 crc kubenswrapper[5120]: I0316 16:31:03.144385 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"e4c4e515-3d7d-4436-ab79-c7c6e2bf2867","Type":"ContainerDied","Data":"3ac7f6046df50253d3eadf80ba177d221a2736f47d24a8d92d25740b867b4645"} Mar 16 16:31:03 crc kubenswrapper[5120]: I0316 16:31:03.144538 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:31:03 crc kubenswrapper[5120]: I0316 16:31:03.150569 5120 generic.go:358] "Generic (PLEG): container finished" podID="594e9c2b-c42a-4671-9b95-3ca9cc0834da" containerID="55d8301ab1f2252931343ebe194e56bf0d2e6005a7f49de190ee54a4c190f30b" exitCode=137 Mar 16 16:31:03 crc kubenswrapper[5120]: I0316 16:31:03.150606 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"594e9c2b-c42a-4671-9b95-3ca9cc0834da","Type":"ContainerDied","Data":"55d8301ab1f2252931343ebe194e56bf0d2e6005a7f49de190ee54a4c190f30b"} Mar 16 16:31:03 crc kubenswrapper[5120]: I0316 16:31:03.150622 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"594e9c2b-c42a-4671-9b95-3ca9cc0834da","Type":"ContainerDied","Data":"fd1dab9680cf21172ddc34e17ffea635e18b211cec1a0ae08f038c586ca843c5"} Mar 16 16:31:03 crc kubenswrapper[5120]: I0316 16:31:03.150681 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:31:03 crc kubenswrapper[5120]: I0316 16:31:03.154880 5120 scope.go:117] "RemoveContainer" containerID="db3e2580ea95177e9d6490933f7a1f793687c66e415fc971c115bd499c92ab81" Mar 16 16:31:03 crc kubenswrapper[5120]: I0316 16:31:03.178314 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:31:03 crc kubenswrapper[5120]: I0316 16:31:03.183623 5120 scope.go:117] "RemoveContainer" containerID="1595763c4adbd5710d1143db484ee9b4d612579aceba19faf0f4e5d27d44445d" Mar 16 16:31:03 crc kubenswrapper[5120]: E0316 16:31:03.184189 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1595763c4adbd5710d1143db484ee9b4d612579aceba19faf0f4e5d27d44445d\": container with ID starting with 1595763c4adbd5710d1143db484ee9b4d612579aceba19faf0f4e5d27d44445d not found: ID does not exist" containerID="1595763c4adbd5710d1143db484ee9b4d612579aceba19faf0f4e5d27d44445d" Mar 16 16:31:03 crc kubenswrapper[5120]: I0316 16:31:03.184237 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1595763c4adbd5710d1143db484ee9b4d612579aceba19faf0f4e5d27d44445d"} err="failed to get container status \"1595763c4adbd5710d1143db484ee9b4d612579aceba19faf0f4e5d27d44445d\": rpc error: code = NotFound desc = could not find container \"1595763c4adbd5710d1143db484ee9b4d612579aceba19faf0f4e5d27d44445d\": container with ID starting with 1595763c4adbd5710d1143db484ee9b4d612579aceba19faf0f4e5d27d44445d not found: ID does not exist" Mar 16 16:31:03 crc kubenswrapper[5120]: I0316 16:31:03.184265 5120 scope.go:117] "RemoveContainer" containerID="db3e2580ea95177e9d6490933f7a1f793687c66e415fc971c115bd499c92ab81" Mar 16 16:31:03 crc kubenswrapper[5120]: E0316 16:31:03.184935 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db3e2580ea95177e9d6490933f7a1f793687c66e415fc971c115bd499c92ab81\": container with ID starting with db3e2580ea95177e9d6490933f7a1f793687c66e415fc971c115bd499c92ab81 not found: ID does not exist" containerID="db3e2580ea95177e9d6490933f7a1f793687c66e415fc971c115bd499c92ab81" Mar 16 16:31:03 crc kubenswrapper[5120]: I0316 16:31:03.184954 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:31:03 crc kubenswrapper[5120]: I0316 16:31:03.184970 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db3e2580ea95177e9d6490933f7a1f793687c66e415fc971c115bd499c92ab81"} err="failed to get container status \"db3e2580ea95177e9d6490933f7a1f793687c66e415fc971c115bd499c92ab81\": rpc error: code = NotFound desc = could not find container \"db3e2580ea95177e9d6490933f7a1f793687c66e415fc971c115bd499c92ab81\": container with ID starting with db3e2580ea95177e9d6490933f7a1f793687c66e415fc971c115bd499c92ab81 not found: ID does not exist" Mar 16 16:31:03 crc kubenswrapper[5120]: I0316 16:31:03.184993 5120 scope.go:117] "RemoveContainer" containerID="1d97978ec3d113eff242fa345a29d5e1e5b1f9ef9dfe1117c35a88143a78bae6" Mar 16 16:31:03 crc kubenswrapper[5120]: I0316 16:31:03.201358 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-59d4fdd9db-tttbf"] Mar 16 16:31:03 crc kubenswrapper[5120]: I0316 16:31:03.214729 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-59d4fdd9db-tttbf"] Mar 16 16:31:03 crc kubenswrapper[5120]: I0316 16:31:03.222031 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 16:31:03 crc kubenswrapper[5120]: I0316 16:31:03.228596 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 16:31:03 crc kubenswrapper[5120]: I0316 16:31:03.231858 5120 scope.go:117] "RemoveContainer" containerID="04c42674c25fc500c502ef1e1e999054ad79756a4118b220ebdd2bad3f3baaf6" Mar 16 16:31:03 crc kubenswrapper[5120]: I0316 16:31:03.234892 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:31:03 crc kubenswrapper[5120]: I0316 16:31:03.240077 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:31:03 crc kubenswrapper[5120]: I0316 16:31:03.248639 5120 scope.go:117] "RemoveContainer" containerID="3b26184bcf959244a04517160ad0256a4a63d93d49413616a3117c699a7df75b" Mar 16 16:31:03 crc kubenswrapper[5120]: I0316 16:31:03.265717 5120 scope.go:117] "RemoveContainer" containerID="b6c94b2508b6c7f40ba9027d248c30720e7dd6666027c56bb02ab67277fa255b" Mar 16 16:31:03 crc kubenswrapper[5120]: I0316 16:31:03.277484 5120 pod_container_manager_linux.go:217] "Failed to delete cgroup paths" cgroupName=["kubepods","besteffort","pod6ed22727-fd32-47c8-ae36-f80dddf5c720"] err="unable to destroy cgroup paths for cgroup [kubepods besteffort pod6ed22727-fd32-47c8-ae36-f80dddf5c720] : Timed out while waiting for systemd to remove kubepods-besteffort-pod6ed22727_fd32_47c8_ae36_f80dddf5c720.slice" Mar 16 16:31:03 crc kubenswrapper[5120]: I0316 16:31:03.284158 5120 scope.go:117] "RemoveContainer" containerID="1d97978ec3d113eff242fa345a29d5e1e5b1f9ef9dfe1117c35a88143a78bae6" Mar 16 16:31:03 crc kubenswrapper[5120]: E0316 16:31:03.284528 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1d97978ec3d113eff242fa345a29d5e1e5b1f9ef9dfe1117c35a88143a78bae6\": container with ID starting with 1d97978ec3d113eff242fa345a29d5e1e5b1f9ef9dfe1117c35a88143a78bae6 not found: ID does not exist" containerID="1d97978ec3d113eff242fa345a29d5e1e5b1f9ef9dfe1117c35a88143a78bae6" Mar 16 16:31:03 crc kubenswrapper[5120]: I0316 16:31:03.284570 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d97978ec3d113eff242fa345a29d5e1e5b1f9ef9dfe1117c35a88143a78bae6"} err="failed to get container status \"1d97978ec3d113eff242fa345a29d5e1e5b1f9ef9dfe1117c35a88143a78bae6\": rpc error: code = NotFound desc = could not find container \"1d97978ec3d113eff242fa345a29d5e1e5b1f9ef9dfe1117c35a88143a78bae6\": container with ID starting with 1d97978ec3d113eff242fa345a29d5e1e5b1f9ef9dfe1117c35a88143a78bae6 not found: ID does not exist" Mar 16 16:31:03 crc kubenswrapper[5120]: I0316 16:31:03.284597 5120 scope.go:117] "RemoveContainer" containerID="04c42674c25fc500c502ef1e1e999054ad79756a4118b220ebdd2bad3f3baaf6" Mar 16 16:31:03 crc kubenswrapper[5120]: E0316 16:31:03.284893 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"04c42674c25fc500c502ef1e1e999054ad79756a4118b220ebdd2bad3f3baaf6\": container with ID starting with 04c42674c25fc500c502ef1e1e999054ad79756a4118b220ebdd2bad3f3baaf6 not found: ID does not exist" containerID="04c42674c25fc500c502ef1e1e999054ad79756a4118b220ebdd2bad3f3baaf6" Mar 16 16:31:03 crc kubenswrapper[5120]: I0316 16:31:03.284948 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04c42674c25fc500c502ef1e1e999054ad79756a4118b220ebdd2bad3f3baaf6"} err="failed to get container status \"04c42674c25fc500c502ef1e1e999054ad79756a4118b220ebdd2bad3f3baaf6\": rpc error: code = NotFound desc = could not find container \"04c42674c25fc500c502ef1e1e999054ad79756a4118b220ebdd2bad3f3baaf6\": container with ID starting with 04c42674c25fc500c502ef1e1e999054ad79756a4118b220ebdd2bad3f3baaf6 not found: ID does not exist" Mar 16 16:31:03 crc kubenswrapper[5120]: I0316 16:31:03.284964 5120 scope.go:117] "RemoveContainer" containerID="3b26184bcf959244a04517160ad0256a4a63d93d49413616a3117c699a7df75b" Mar 16 16:31:03 crc kubenswrapper[5120]: E0316 16:31:03.285179 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b26184bcf959244a04517160ad0256a4a63d93d49413616a3117c699a7df75b\": container with ID starting with 3b26184bcf959244a04517160ad0256a4a63d93d49413616a3117c699a7df75b not found: ID does not exist" containerID="3b26184bcf959244a04517160ad0256a4a63d93d49413616a3117c699a7df75b" Mar 16 16:31:03 crc kubenswrapper[5120]: I0316 16:31:03.285203 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b26184bcf959244a04517160ad0256a4a63d93d49413616a3117c699a7df75b"} err="failed to get container status \"3b26184bcf959244a04517160ad0256a4a63d93d49413616a3117c699a7df75b\": rpc error: code = NotFound desc = could not find container \"3b26184bcf959244a04517160ad0256a4a63d93d49413616a3117c699a7df75b\": container with ID starting with 3b26184bcf959244a04517160ad0256a4a63d93d49413616a3117c699a7df75b not found: ID does not exist" Mar 16 16:31:03 crc kubenswrapper[5120]: I0316 16:31:03.285223 5120 scope.go:117] "RemoveContainer" containerID="b6c94b2508b6c7f40ba9027d248c30720e7dd6666027c56bb02ab67277fa255b" Mar 16 16:31:03 crc kubenswrapper[5120]: E0316 16:31:03.285439 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b6c94b2508b6c7f40ba9027d248c30720e7dd6666027c56bb02ab67277fa255b\": container with ID starting with b6c94b2508b6c7f40ba9027d248c30720e7dd6666027c56bb02ab67277fa255b not found: ID does not exist" containerID="b6c94b2508b6c7f40ba9027d248c30720e7dd6666027c56bb02ab67277fa255b" Mar 16 16:31:03 crc kubenswrapper[5120]: I0316 16:31:03.285459 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6c94b2508b6c7f40ba9027d248c30720e7dd6666027c56bb02ab67277fa255b"} err="failed to get container status \"b6c94b2508b6c7f40ba9027d248c30720e7dd6666027c56bb02ab67277fa255b\": rpc error: code = NotFound desc = could not find container \"b6c94b2508b6c7f40ba9027d248c30720e7dd6666027c56bb02ab67277fa255b\": container with ID starting with b6c94b2508b6c7f40ba9027d248c30720e7dd6666027c56bb02ab67277fa255b not found: ID does not exist" Mar 16 16:31:03 crc kubenswrapper[5120]: I0316 16:31:03.285472 5120 scope.go:117] "RemoveContainer" containerID="f15bf1aad527f5c095b7bff2dca1db767738973c6277e2a0f00f4724cc41a6d1" Mar 16 16:31:03 crc kubenswrapper[5120]: I0316 16:31:03.304681 5120 scope.go:117] "RemoveContainer" containerID="3f2d886d7f02bd132c23ebdd596245f0c4fcdcb60de0f942e9db05d9a554cc06" Mar 16 16:31:03 crc kubenswrapper[5120]: I0316 16:31:03.336197 5120 scope.go:117] "RemoveContainer" containerID="3316e7f6d49dbecddd206e93a21152d473303f16fa69403030e6aaaeaa38adab" Mar 16 16:31:03 crc kubenswrapper[5120]: I0316 16:31:03.364071 5120 scope.go:117] "RemoveContainer" containerID="0ae219285be2774fd999a00f3eb7b796c400b3bb54670c492ef1a7cd633c9f6b" Mar 16 16:31:03 crc kubenswrapper[5120]: I0316 16:31:03.382064 5120 scope.go:117] "RemoveContainer" containerID="ee574a05fc70f725e484eed1c78245bd008ee2dca8d8e5747b40feeb8ea97135" Mar 16 16:31:03 crc kubenswrapper[5120]: I0316 16:31:03.401965 5120 scope.go:117] "RemoveContainer" containerID="11236707832e2120fc41d5104a2f9b4d27803bed6d28a687cb24b58154784ab0" Mar 16 16:31:03 crc kubenswrapper[5120]: I0316 16:31:03.421428 5120 scope.go:117] "RemoveContainer" containerID="f73f6b34fb962826c023fdaeb3f6939041fc2fd39eecb456ee6e023a1e3589cb" Mar 16 16:31:03 crc kubenswrapper[5120]: I0316 16:31:03.441277 5120 scope.go:117] "RemoveContainer" containerID="c68aab4be854a460023e8b8f93e43ace66b0a1f2cc56a0afabb12d8d59203372" Mar 16 16:31:03 crc kubenswrapper[5120]: I0316 16:31:03.547097 5120 scope.go:117] "RemoveContainer" containerID="5ffea8961d29d9fab0235d9e49ecd3f2bb869266e115ed97f9b97a47c83f280d" Mar 16 16:31:03 crc kubenswrapper[5120]: I0316 16:31:03.567579 5120 scope.go:117] "RemoveContainer" containerID="96b84c6ebe1b0747f05480dc24a682f7a93699950490b8252cf8ed9dd2bd8e77" Mar 16 16:31:03 crc kubenswrapper[5120]: I0316 16:31:03.583849 5120 scope.go:117] "RemoveContainer" containerID="8e57dd33a2aa825284690808124c1ecbc5dca938121e8420b3ff5077ff9704bf" Mar 16 16:31:03 crc kubenswrapper[5120]: I0316 16:31:03.601085 5120 scope.go:117] "RemoveContainer" containerID="9ec444876101ad416b611d2885a35edb13ab6f3780cd291d8b4f774fbd06ff20" Mar 16 16:31:03 crc kubenswrapper[5120]: I0316 16:31:03.617702 5120 scope.go:117] "RemoveContainer" containerID="70f91690ca6860782cfe602660752293b957c3e5d757ab6406b3818a603f33f2" Mar 16 16:31:03 crc kubenswrapper[5120]: I0316 16:31:03.632891 5120 scope.go:117] "RemoveContainer" containerID="751ce949d1961a8983b58c560348689c5c84954f76641475fcfa8b6fd3ea7968" Mar 16 16:31:03 crc kubenswrapper[5120]: I0316 16:31:03.648438 5120 scope.go:117] "RemoveContainer" containerID="ba7e067e325914eabba7eb247b617294a269cd7bb06ce5d8a84762cbe0e8e442" Mar 16 16:31:03 crc kubenswrapper[5120]: I0316 16:31:03.667276 5120 scope.go:117] "RemoveContainer" containerID="4738f855f2af9511199dcb63a9d508dbfb5ef2b859371cbd01a2dbeee556de78" Mar 16 16:31:03 crc kubenswrapper[5120]: I0316 16:31:03.684463 5120 scope.go:117] "RemoveContainer" containerID="55d8301ab1f2252931343ebe194e56bf0d2e6005a7f49de190ee54a4c190f30b" Mar 16 16:31:03 crc kubenswrapper[5120]: I0316 16:31:03.703050 5120 scope.go:117] "RemoveContainer" containerID="4738f855f2af9511199dcb63a9d508dbfb5ef2b859371cbd01a2dbeee556de78" Mar 16 16:31:03 crc kubenswrapper[5120]: E0316 16:31:03.703451 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4738f855f2af9511199dcb63a9d508dbfb5ef2b859371cbd01a2dbeee556de78\": container with ID starting with 4738f855f2af9511199dcb63a9d508dbfb5ef2b859371cbd01a2dbeee556de78 not found: ID does not exist" containerID="4738f855f2af9511199dcb63a9d508dbfb5ef2b859371cbd01a2dbeee556de78" Mar 16 16:31:03 crc kubenswrapper[5120]: I0316 16:31:03.703482 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4738f855f2af9511199dcb63a9d508dbfb5ef2b859371cbd01a2dbeee556de78"} err="failed to get container status \"4738f855f2af9511199dcb63a9d508dbfb5ef2b859371cbd01a2dbeee556de78\": rpc error: code = NotFound desc = could not find container \"4738f855f2af9511199dcb63a9d508dbfb5ef2b859371cbd01a2dbeee556de78\": container with ID starting with 4738f855f2af9511199dcb63a9d508dbfb5ef2b859371cbd01a2dbeee556de78 not found: ID does not exist" Mar 16 16:31:03 crc kubenswrapper[5120]: I0316 16:31:03.703510 5120 scope.go:117] "RemoveContainer" containerID="55d8301ab1f2252931343ebe194e56bf0d2e6005a7f49de190ee54a4c190f30b" Mar 16 16:31:03 crc kubenswrapper[5120]: E0316 16:31:03.703892 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"55d8301ab1f2252931343ebe194e56bf0d2e6005a7f49de190ee54a4c190f30b\": container with ID starting with 55d8301ab1f2252931343ebe194e56bf0d2e6005a7f49de190ee54a4c190f30b not found: ID does not exist" containerID="55d8301ab1f2252931343ebe194e56bf0d2e6005a7f49de190ee54a4c190f30b" Mar 16 16:31:03 crc kubenswrapper[5120]: I0316 16:31:03.703917 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55d8301ab1f2252931343ebe194e56bf0d2e6005a7f49de190ee54a4c190f30b"} err="failed to get container status \"55d8301ab1f2252931343ebe194e56bf0d2e6005a7f49de190ee54a4c190f30b\": rpc error: code = NotFound desc = could not find container \"55d8301ab1f2252931343ebe194e56bf0d2e6005a7f49de190ee54a4c190f30b\": container with ID starting with 55d8301ab1f2252931343ebe194e56bf0d2e6005a7f49de190ee54a4c190f30b not found: ID does not exist" Mar 16 16:31:04 crc kubenswrapper[5120]: I0316 16:31:04.161993 5120 generic.go:358] "Generic (PLEG): container finished" podID="7c3819a8-dcaf-4026-87c2-5f6419c379a9" containerID="b48efa78dedc3f4e6339fe4bb5d889d3c5e126ba2b9c6bd274d193ebe220d8d9" exitCode=137 Mar 16 16:31:04 crc kubenswrapper[5120]: I0316 16:31:04.162576 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"7c3819a8-dcaf-4026-87c2-5f6419c379a9","Type":"ContainerDied","Data":"b48efa78dedc3f4e6339fe4bb5d889d3c5e126ba2b9c6bd274d193ebe220d8d9"} Mar 16 16:31:04 crc kubenswrapper[5120]: I0316 16:31:04.179145 5120 generic.go:358] "Generic (PLEG): container finished" podID="836f3504-5416-46bf-a225-7b7f977fe82c" containerID="31eede8ea13e83df778b0cc727f0126cabef5175599f7fcd091680c0e3d991d6" exitCode=137 Mar 16 16:31:04 crc kubenswrapper[5120]: I0316 16:31:04.179238 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"836f3504-5416-46bf-a225-7b7f977fe82c","Type":"ContainerDied","Data":"31eede8ea13e83df778b0cc727f0126cabef5175599f7fcd091680c0e3d991d6"} Mar 16 16:31:04 crc kubenswrapper[5120]: I0316 16:31:04.181124 5120 generic.go:358] "Generic (PLEG): container finished" podID="7e45bb7a-9982-458f-80b5-60541c2d2daf" containerID="1c7b11899133931bd406f6c19c7e46ecd6ae5021b5ed32c51931ad65ff554972" exitCode=137 Mar 16 16:31:04 crc kubenswrapper[5120]: I0316 16:31:04.181212 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"7e45bb7a-9982-458f-80b5-60541c2d2daf","Type":"ContainerDied","Data":"1c7b11899133931bd406f6c19c7e46ecd6ae5021b5ed32c51931ad65ff554972"} Mar 16 16:31:04 crc kubenswrapper[5120]: I0316 16:31:04.247628 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:31:04 crc kubenswrapper[5120]: I0316 16:31:04.304007 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4chfs\" (UniqueName: \"kubernetes.io/projected/7e45bb7a-9982-458f-80b5-60541c2d2daf-kube-api-access-4chfs\") pod \"7e45bb7a-9982-458f-80b5-60541c2d2daf\" (UID: \"7e45bb7a-9982-458f-80b5-60541c2d2daf\") " Mar 16 16:31:04 crc kubenswrapper[5120]: I0316 16:31:04.304262 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7e45bb7a-9982-458f-80b5-60541c2d2daf-config-data\") pod \"7e45bb7a-9982-458f-80b5-60541c2d2daf\" (UID: \"7e45bb7a-9982-458f-80b5-60541c2d2daf\") " Mar 16 16:31:04 crc kubenswrapper[5120]: I0316 16:31:04.304367 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7e45bb7a-9982-458f-80b5-60541c2d2daf-combined-ca-bundle\") pod \"7e45bb7a-9982-458f-80b5-60541c2d2daf\" (UID: \"7e45bb7a-9982-458f-80b5-60541c2d2daf\") " Mar 16 16:31:04 crc kubenswrapper[5120]: I0316 16:31:04.309673 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e45bb7a-9982-458f-80b5-60541c2d2daf-kube-api-access-4chfs" (OuterVolumeSpecName: "kube-api-access-4chfs") pod "7e45bb7a-9982-458f-80b5-60541c2d2daf" (UID: "7e45bb7a-9982-458f-80b5-60541c2d2daf"). InnerVolumeSpecName "kube-api-access-4chfs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:31:04 crc kubenswrapper[5120]: I0316 16:31:04.332554 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e45bb7a-9982-458f-80b5-60541c2d2daf-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "7e45bb7a-9982-458f-80b5-60541c2d2daf" (UID: "7e45bb7a-9982-458f-80b5-60541c2d2daf"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:31:04 crc kubenswrapper[5120]: I0316 16:31:04.332584 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e45bb7a-9982-458f-80b5-60541c2d2daf-config-data" (OuterVolumeSpecName: "config-data") pod "7e45bb7a-9982-458f-80b5-60541c2d2daf" (UID: "7e45bb7a-9982-458f-80b5-60541c2d2daf"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:31:04 crc kubenswrapper[5120]: I0316 16:31:04.344912 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:31:04 crc kubenswrapper[5120]: I0316 16:31:04.374963 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:31:04 crc kubenswrapper[5120]: I0316 16:31:04.406024 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7c3819a8-dcaf-4026-87c2-5f6419c379a9-config-data\") pod \"7c3819a8-dcaf-4026-87c2-5f6419c379a9\" (UID: \"7c3819a8-dcaf-4026-87c2-5f6419c379a9\") " Mar 16 16:31:04 crc kubenswrapper[5120]: I0316 16:31:04.406192 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-klhhb\" (UniqueName: \"kubernetes.io/projected/836f3504-5416-46bf-a225-7b7f977fe82c-kube-api-access-klhhb\") pod \"836f3504-5416-46bf-a225-7b7f977fe82c\" (UID: \"836f3504-5416-46bf-a225-7b7f977fe82c\") " Mar 16 16:31:04 crc kubenswrapper[5120]: I0316 16:31:04.406218 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7c3819a8-dcaf-4026-87c2-5f6419c379a9-combined-ca-bundle\") pod \"7c3819a8-dcaf-4026-87c2-5f6419c379a9\" (UID: \"7c3819a8-dcaf-4026-87c2-5f6419c379a9\") " Mar 16 16:31:04 crc kubenswrapper[5120]: I0316 16:31:04.406257 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/836f3504-5416-46bf-a225-7b7f977fe82c-combined-ca-bundle\") pod \"836f3504-5416-46bf-a225-7b7f977fe82c\" (UID: \"836f3504-5416-46bf-a225-7b7f977fe82c\") " Mar 16 16:31:04 crc kubenswrapper[5120]: I0316 16:31:04.406304 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/836f3504-5416-46bf-a225-7b7f977fe82c-config-data\") pod \"836f3504-5416-46bf-a225-7b7f977fe82c\" (UID: \"836f3504-5416-46bf-a225-7b7f977fe82c\") " Mar 16 16:31:04 crc kubenswrapper[5120]: I0316 16:31:04.406401 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q9f9w\" (UniqueName: \"kubernetes.io/projected/7c3819a8-dcaf-4026-87c2-5f6419c379a9-kube-api-access-q9f9w\") pod \"7c3819a8-dcaf-4026-87c2-5f6419c379a9\" (UID: \"7c3819a8-dcaf-4026-87c2-5f6419c379a9\") " Mar 16 16:31:04 crc kubenswrapper[5120]: I0316 16:31:04.406772 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7e45bb7a-9982-458f-80b5-60541c2d2daf-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:31:04 crc kubenswrapper[5120]: I0316 16:31:04.406788 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7e45bb7a-9982-458f-80b5-60541c2d2daf-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:31:04 crc kubenswrapper[5120]: I0316 16:31:04.406800 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4chfs\" (UniqueName: \"kubernetes.io/projected/7e45bb7a-9982-458f-80b5-60541c2d2daf-kube-api-access-4chfs\") on node \"crc\" DevicePath \"\"" Mar 16 16:31:04 crc kubenswrapper[5120]: I0316 16:31:04.409751 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/836f3504-5416-46bf-a225-7b7f977fe82c-kube-api-access-klhhb" (OuterVolumeSpecName: "kube-api-access-klhhb") pod "836f3504-5416-46bf-a225-7b7f977fe82c" (UID: "836f3504-5416-46bf-a225-7b7f977fe82c"). InnerVolumeSpecName "kube-api-access-klhhb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:31:04 crc kubenswrapper[5120]: I0316 16:31:04.409914 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c3819a8-dcaf-4026-87c2-5f6419c379a9-kube-api-access-q9f9w" (OuterVolumeSpecName: "kube-api-access-q9f9w") pod "7c3819a8-dcaf-4026-87c2-5f6419c379a9" (UID: "7c3819a8-dcaf-4026-87c2-5f6419c379a9"). InnerVolumeSpecName "kube-api-access-q9f9w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:31:04 crc kubenswrapper[5120]: I0316 16:31:04.425521 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c3819a8-dcaf-4026-87c2-5f6419c379a9-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "7c3819a8-dcaf-4026-87c2-5f6419c379a9" (UID: "7c3819a8-dcaf-4026-87c2-5f6419c379a9"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:31:04 crc kubenswrapper[5120]: I0316 16:31:04.425907 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c3819a8-dcaf-4026-87c2-5f6419c379a9-config-data" (OuterVolumeSpecName: "config-data") pod "7c3819a8-dcaf-4026-87c2-5f6419c379a9" (UID: "7c3819a8-dcaf-4026-87c2-5f6419c379a9"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:31:04 crc kubenswrapper[5120]: I0316 16:31:04.425984 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/836f3504-5416-46bf-a225-7b7f977fe82c-config-data" (OuterVolumeSpecName: "config-data") pod "836f3504-5416-46bf-a225-7b7f977fe82c" (UID: "836f3504-5416-46bf-a225-7b7f977fe82c"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:31:04 crc kubenswrapper[5120]: I0316 16:31:04.428191 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/836f3504-5416-46bf-a225-7b7f977fe82c-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "836f3504-5416-46bf-a225-7b7f977fe82c" (UID: "836f3504-5416-46bf-a225-7b7f977fe82c"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:31:04 crc kubenswrapper[5120]: I0316 16:31:04.508109 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q9f9w\" (UniqueName: \"kubernetes.io/projected/7c3819a8-dcaf-4026-87c2-5f6419c379a9-kube-api-access-q9f9w\") on node \"crc\" DevicePath \"\"" Mar 16 16:31:04 crc kubenswrapper[5120]: I0316 16:31:04.508155 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7c3819a8-dcaf-4026-87c2-5f6419c379a9-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:31:04 crc kubenswrapper[5120]: I0316 16:31:04.508167 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-klhhb\" (UniqueName: \"kubernetes.io/projected/836f3504-5416-46bf-a225-7b7f977fe82c-kube-api-access-klhhb\") on node \"crc\" DevicePath \"\"" Mar 16 16:31:04 crc kubenswrapper[5120]: I0316 16:31:04.508179 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7c3819a8-dcaf-4026-87c2-5f6419c379a9-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:31:04 crc kubenswrapper[5120]: I0316 16:31:04.508188 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/836f3504-5416-46bf-a225-7b7f977fe82c-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:31:04 crc kubenswrapper[5120]: I0316 16:31:04.508195 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/836f3504-5416-46bf-a225-7b7f977fe82c-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:31:04 crc kubenswrapper[5120]: I0316 16:31:04.676947 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="325f32e1-5461-4d71-a30c-dee2528d6fb3" path="/var/lib/kubelet/pods/325f32e1-5461-4d71-a30c-dee2528d6fb3/volumes" Mar 16 16:31:04 crc kubenswrapper[5120]: I0316 16:31:04.677540 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="594e9c2b-c42a-4671-9b95-3ca9cc0834da" path="/var/lib/kubelet/pods/594e9c2b-c42a-4671-9b95-3ca9cc0834da/volumes" Mar 16 16:31:04 crc kubenswrapper[5120]: I0316 16:31:04.678246 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="abc96fef-3a85-4438-848c-0910513810e0" path="/var/lib/kubelet/pods/abc96fef-3a85-4438-848c-0910513810e0/volumes" Mar 16 16:31:04 crc kubenswrapper[5120]: I0316 16:31:04.679390 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e4c4e515-3d7d-4436-ab79-c7c6e2bf2867" path="/var/lib/kubelet/pods/e4c4e515-3d7d-4436-ab79-c7c6e2bf2867/volumes" Mar 16 16:31:04 crc kubenswrapper[5120]: I0316 16:31:04.739979 5120 pod_container_manager_linux.go:217] "Failed to delete cgroup paths" cgroupName=["kubepods","besteffort","pod7b46f8b0-c3f2-44ec-88e2-8d65566ae937"] err="unable to destroy cgroup paths for cgroup [kubepods besteffort pod7b46f8b0-c3f2-44ec-88e2-8d65566ae937] : Timed out while waiting for systemd to remove kubepods-besteffort-pod7b46f8b0_c3f2_44ec_88e2_8d65566ae937.slice" Mar 16 16:31:04 crc kubenswrapper[5120]: E0316 16:31:04.740501 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to delete cgroup paths for [kubepods besteffort pod7b46f8b0-c3f2-44ec-88e2-8d65566ae937] : unable to destroy cgroup paths for cgroup [kubepods besteffort pod7b46f8b0-c3f2-44ec-88e2-8d65566ae937] : Timed out while waiting for systemd to remove kubepods-besteffort-pod7b46f8b0_c3f2_44ec_88e2_8d65566ae937.slice" pod="openstack-kuttl-tests/swift-proxy-75575cf5bd-xrtzd" podUID="7b46f8b0-c3f2-44ec-88e2-8d65566ae937" Mar 16 16:31:04 crc kubenswrapper[5120]: I0316 16:31:04.755800 5120 pod_container_manager_linux.go:217] "Failed to delete cgroup paths" cgroupName=["kubepods","besteffort","podbbd47432-e63f-4ba0-8daa-edfb3d2b0af9"] err="unable to destroy cgroup paths for cgroup [kubepods besteffort podbbd47432-e63f-4ba0-8daa-edfb3d2b0af9] : Timed out while waiting for systemd to remove kubepods-besteffort-podbbd47432_e63f_4ba0_8daa_edfb3d2b0af9.slice" Mar 16 16:31:04 crc kubenswrapper[5120]: E0316 16:31:04.755898 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to delete cgroup paths for [kubepods besteffort podbbd47432-e63f-4ba0-8daa-edfb3d2b0af9] : unable to destroy cgroup paths for cgroup [kubepods besteffort podbbd47432-e63f-4ba0-8daa-edfb3d2b0af9] : Timed out while waiting for systemd to remove kubepods-besteffort-podbbd47432_e63f_4ba0_8daa_edfb3d2b0af9.slice" pod="openstack-kuttl-tests/barbican-worker-8649c995c9-lzq96" podUID="bbd47432-e63f-4ba0-8daa-edfb3d2b0af9" Mar 16 16:31:05 crc kubenswrapper[5120]: I0316 16:31:05.197962 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:31:05 crc kubenswrapper[5120]: I0316 16:31:05.198033 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"836f3504-5416-46bf-a225-7b7f977fe82c","Type":"ContainerDied","Data":"791ecf4a564b3e7b10a2fb3f11743fdb0d6ae93fbb21bf5a2ddf6109aeee061c"} Mar 16 16:31:05 crc kubenswrapper[5120]: I0316 16:31:05.198091 5120 scope.go:117] "RemoveContainer" containerID="31eede8ea13e83df778b0cc727f0126cabef5175599f7fcd091680c0e3d991d6" Mar 16 16:31:05 crc kubenswrapper[5120]: I0316 16:31:05.204086 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"7e45bb7a-9982-458f-80b5-60541c2d2daf","Type":"ContainerDied","Data":"399f98f8c7701af17b6e9f882036ebe8772a78ac2534d0c10eace74a16bc2d75"} Mar 16 16:31:05 crc kubenswrapper[5120]: I0316 16:31:05.204101 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:31:05 crc kubenswrapper[5120]: I0316 16:31:05.206946 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:31:05 crc kubenswrapper[5120]: I0316 16:31:05.206942 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"7c3819a8-dcaf-4026-87c2-5f6419c379a9","Type":"ContainerDied","Data":"a7a4969a1059e0b323096eb4c2f7e14cce1f8f2f2b935f84314dccd6f730b882"} Mar 16 16:31:05 crc kubenswrapper[5120]: I0316 16:31:05.207773 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-75575cf5bd-xrtzd" Mar 16 16:31:05 crc kubenswrapper[5120]: I0316 16:31:05.207841 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-8649c995c9-lzq96" Mar 16 16:31:05 crc kubenswrapper[5120]: I0316 16:31:05.227305 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:31:05 crc kubenswrapper[5120]: I0316 16:31:05.241442 5120 scope.go:117] "RemoveContainer" containerID="1c7b11899133931bd406f6c19c7e46ecd6ae5021b5ed32c51931ad65ff554972" Mar 16 16:31:05 crc kubenswrapper[5120]: I0316 16:31:05.243438 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:31:05 crc kubenswrapper[5120]: I0316 16:31:05.256432 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:31:05 crc kubenswrapper[5120]: I0316 16:31:05.268068 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:31:05 crc kubenswrapper[5120]: I0316 16:31:05.276894 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 16:31:05 crc kubenswrapper[5120]: I0316 16:31:05.286004 5120 scope.go:117] "RemoveContainer" containerID="b48efa78dedc3f4e6339fe4bb5d889d3c5e126ba2b9c6bd274d193ebe220d8d9" Mar 16 16:31:05 crc kubenswrapper[5120]: I0316 16:31:05.286913 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 16:31:05 crc kubenswrapper[5120]: I0316 16:31:05.298511 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-proxy-75575cf5bd-xrtzd"] Mar 16 16:31:05 crc kubenswrapper[5120]: I0316 16:31:05.308673 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/swift-proxy-75575cf5bd-xrtzd"] Mar 16 16:31:05 crc kubenswrapper[5120]: I0316 16:31:05.318267 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-8649c995c9-lzq96"] Mar 16 16:31:05 crc kubenswrapper[5120]: I0316 16:31:05.326926 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-worker-8649c995c9-lzq96"] Mar 16 16:31:06 crc kubenswrapper[5120]: I0316 16:31:06.673562 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7b46f8b0-c3f2-44ec-88e2-8d65566ae937" path="/var/lib/kubelet/pods/7b46f8b0-c3f2-44ec-88e2-8d65566ae937/volumes" Mar 16 16:31:06 crc kubenswrapper[5120]: I0316 16:31:06.674140 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c3819a8-dcaf-4026-87c2-5f6419c379a9" path="/var/lib/kubelet/pods/7c3819a8-dcaf-4026-87c2-5f6419c379a9/volumes" Mar 16 16:31:06 crc kubenswrapper[5120]: I0316 16:31:06.674584 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7e45bb7a-9982-458f-80b5-60541c2d2daf" path="/var/lib/kubelet/pods/7e45bb7a-9982-458f-80b5-60541c2d2daf/volumes" Mar 16 16:31:06 crc kubenswrapper[5120]: I0316 16:31:06.675506 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="836f3504-5416-46bf-a225-7b7f977fe82c" path="/var/lib/kubelet/pods/836f3504-5416-46bf-a225-7b7f977fe82c/volumes" Mar 16 16:31:06 crc kubenswrapper[5120]: I0316 16:31:06.677030 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bbd47432-e63f-4ba0-8daa-edfb3d2b0af9" path="/var/lib/kubelet/pods/bbd47432-e63f-4ba0-8daa-edfb3d2b0af9/volumes" Mar 16 16:31:07 crc kubenswrapper[5120]: E0316 16:31:07.838143 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1304860 actualBytes=10240 Mar 16 16:31:12 crc kubenswrapper[5120]: E0316 16:31:12.712206 5120 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8690a5a2_3341_452e_8364_2e5e4072c192.slice\": RecentStats: unable to find data in memory cache]" Mar 16 16:31:12 crc kubenswrapper[5120]: I0316 16:31:12.817849 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["crc-storage/crc-storage-crc-47dcv"] Mar 16 16:31:12 crc kubenswrapper[5120]: I0316 16:31:12.825415 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["crc-storage/crc-storage-crc-47dcv"] Mar 16 16:31:12 crc kubenswrapper[5120]: I0316 16:31:12.937570 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["crc-storage/crc-storage-crc-hchbr"] Mar 16 16:31:12 crc kubenswrapper[5120]: I0316 16:31:12.939192 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4c4e515-3d7d-4436-ab79-c7c6e2bf2867" containerName="object-server" Mar 16 16:31:12 crc kubenswrapper[5120]: I0316 16:31:12.939211 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4c4e515-3d7d-4436-ab79-c7c6e2bf2867" containerName="object-server" Mar 16 16:31:12 crc kubenswrapper[5120]: I0316 16:31:12.939235 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4c4e515-3d7d-4436-ab79-c7c6e2bf2867" containerName="account-auditor" Mar 16 16:31:12 crc kubenswrapper[5120]: I0316 16:31:12.939242 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4c4e515-3d7d-4436-ab79-c7c6e2bf2867" containerName="account-auditor" Mar 16 16:31:12 crc kubenswrapper[5120]: I0316 16:31:12.939257 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4c4e515-3d7d-4436-ab79-c7c6e2bf2867" containerName="swift-recon-cron" Mar 16 16:31:12 crc kubenswrapper[5120]: I0316 16:31:12.939264 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4c4e515-3d7d-4436-ab79-c7c6e2bf2867" containerName="swift-recon-cron" Mar 16 16:31:12 crc kubenswrapper[5120]: I0316 16:31:12.939273 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57c30724-6f23-4b63-b97e-f1e692921ecf" containerName="extract-utilities" Mar 16 16:31:12 crc kubenswrapper[5120]: I0316 16:31:12.939280 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="57c30724-6f23-4b63-b97e-f1e692921ecf" containerName="extract-utilities" Mar 16 16:31:12 crc kubenswrapper[5120]: I0316 16:31:12.939295 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="abc96fef-3a85-4438-848c-0910513810e0" containerName="ceilometer-central-agent" Mar 16 16:31:12 crc kubenswrapper[5120]: I0316 16:31:12.939302 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="abc96fef-3a85-4438-848c-0910513810e0" containerName="ceilometer-central-agent" Mar 16 16:31:12 crc kubenswrapper[5120]: I0316 16:31:12.939312 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="325f32e1-5461-4d71-a30c-dee2528d6fb3" containerName="neutron-httpd" Mar 16 16:31:12 crc kubenswrapper[5120]: I0316 16:31:12.939318 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="325f32e1-5461-4d71-a30c-dee2528d6fb3" containerName="neutron-httpd" Mar 16 16:31:12 crc kubenswrapper[5120]: I0316 16:31:12.939339 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4c4e515-3d7d-4436-ab79-c7c6e2bf2867" containerName="account-reaper" Mar 16 16:31:12 crc kubenswrapper[5120]: I0316 16:31:12.939346 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4c4e515-3d7d-4436-ab79-c7c6e2bf2867" containerName="account-reaper" Mar 16 16:31:12 crc kubenswrapper[5120]: I0316 16:31:12.939355 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="abc96fef-3a85-4438-848c-0910513810e0" containerName="ceilometer-notification-agent" Mar 16 16:31:12 crc kubenswrapper[5120]: I0316 16:31:12.939362 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="abc96fef-3a85-4438-848c-0910513810e0" containerName="ceilometer-notification-agent" Mar 16 16:31:12 crc kubenswrapper[5120]: I0316 16:31:12.939375 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="325f32e1-5461-4d71-a30c-dee2528d6fb3" containerName="neutron-api" Mar 16 16:31:12 crc kubenswrapper[5120]: I0316 16:31:12.939382 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="325f32e1-5461-4d71-a30c-dee2528d6fb3" containerName="neutron-api" Mar 16 16:31:12 crc kubenswrapper[5120]: I0316 16:31:12.939394 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4c4e515-3d7d-4436-ab79-c7c6e2bf2867" containerName="object-updater" Mar 16 16:31:12 crc kubenswrapper[5120]: I0316 16:31:12.939403 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4c4e515-3d7d-4436-ab79-c7c6e2bf2867" containerName="object-updater" Mar 16 16:31:12 crc kubenswrapper[5120]: I0316 16:31:12.939412 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="692399cb-3427-4a68-8677-aee482e1ae16" containerName="extract-utilities" Mar 16 16:31:12 crc kubenswrapper[5120]: I0316 16:31:12.939419 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="692399cb-3427-4a68-8677-aee482e1ae16" containerName="extract-utilities" Mar 16 16:31:12 crc kubenswrapper[5120]: I0316 16:31:12.939428 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="594e9c2b-c42a-4671-9b95-3ca9cc0834da" containerName="probe" Mar 16 16:31:12 crc kubenswrapper[5120]: I0316 16:31:12.939435 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="594e9c2b-c42a-4671-9b95-3ca9cc0834da" containerName="probe" Mar 16 16:31:12 crc kubenswrapper[5120]: I0316 16:31:12.939444 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="692399cb-3427-4a68-8677-aee482e1ae16" containerName="extract-content" Mar 16 16:31:12 crc kubenswrapper[5120]: I0316 16:31:12.939451 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="692399cb-3427-4a68-8677-aee482e1ae16" containerName="extract-content" Mar 16 16:31:12 crc kubenswrapper[5120]: I0316 16:31:12.939464 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="abc96fef-3a85-4438-848c-0910513810e0" containerName="proxy-httpd" Mar 16 16:31:12 crc kubenswrapper[5120]: I0316 16:31:12.939471 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="abc96fef-3a85-4438-848c-0910513810e0" containerName="proxy-httpd" Mar 16 16:31:12 crc kubenswrapper[5120]: I0316 16:31:12.939482 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4c4e515-3d7d-4436-ab79-c7c6e2bf2867" containerName="account-server" Mar 16 16:31:12 crc kubenswrapper[5120]: I0316 16:31:12.939489 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4c4e515-3d7d-4436-ab79-c7c6e2bf2867" containerName="account-server" Mar 16 16:31:12 crc kubenswrapper[5120]: I0316 16:31:12.939504 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4c4e515-3d7d-4436-ab79-c7c6e2bf2867" containerName="container-updater" Mar 16 16:31:12 crc kubenswrapper[5120]: I0316 16:31:12.939511 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4c4e515-3d7d-4436-ab79-c7c6e2bf2867" containerName="container-updater" Mar 16 16:31:12 crc kubenswrapper[5120]: I0316 16:31:12.939521 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="836f3504-5416-46bf-a225-7b7f977fe82c" containerName="nova-scheduler-scheduler" Mar 16 16:31:12 crc kubenswrapper[5120]: I0316 16:31:12.939527 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="836f3504-5416-46bf-a225-7b7f977fe82c" containerName="nova-scheduler-scheduler" Mar 16 16:31:12 crc kubenswrapper[5120]: I0316 16:31:12.939539 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4c4e515-3d7d-4436-ab79-c7c6e2bf2867" containerName="container-auditor" Mar 16 16:31:12 crc kubenswrapper[5120]: I0316 16:31:12.939545 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4c4e515-3d7d-4436-ab79-c7c6e2bf2867" containerName="container-auditor" Mar 16 16:31:12 crc kubenswrapper[5120]: I0316 16:31:12.939558 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c3819a8-dcaf-4026-87c2-5f6419c379a9" containerName="nova-cell1-conductor-conductor" Mar 16 16:31:12 crc kubenswrapper[5120]: I0316 16:31:12.939565 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c3819a8-dcaf-4026-87c2-5f6419c379a9" containerName="nova-cell1-conductor-conductor" Mar 16 16:31:12 crc kubenswrapper[5120]: I0316 16:31:12.939580 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4c4e515-3d7d-4436-ab79-c7c6e2bf2867" containerName="rsync" Mar 16 16:31:12 crc kubenswrapper[5120]: I0316 16:31:12.939586 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4c4e515-3d7d-4436-ab79-c7c6e2bf2867" containerName="rsync" Mar 16 16:31:12 crc kubenswrapper[5120]: I0316 16:31:12.939598 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4c4e515-3d7d-4436-ab79-c7c6e2bf2867" containerName="object-replicator" Mar 16 16:31:12 crc kubenswrapper[5120]: I0316 16:31:12.939605 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4c4e515-3d7d-4436-ab79-c7c6e2bf2867" containerName="object-replicator" Mar 16 16:31:12 crc kubenswrapper[5120]: I0316 16:31:12.939622 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4c4e515-3d7d-4436-ab79-c7c6e2bf2867" containerName="object-expirer" Mar 16 16:31:12 crc kubenswrapper[5120]: I0316 16:31:12.939629 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4c4e515-3d7d-4436-ab79-c7c6e2bf2867" containerName="object-expirer" Mar 16 16:31:12 crc kubenswrapper[5120]: I0316 16:31:12.939645 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="692399cb-3427-4a68-8677-aee482e1ae16" containerName="registry-server" Mar 16 16:31:12 crc kubenswrapper[5120]: I0316 16:31:12.939654 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="692399cb-3427-4a68-8677-aee482e1ae16" containerName="registry-server" Mar 16 16:31:12 crc kubenswrapper[5120]: I0316 16:31:12.939670 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="abc96fef-3a85-4438-848c-0910513810e0" containerName="sg-core" Mar 16 16:31:12 crc kubenswrapper[5120]: I0316 16:31:12.939678 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="abc96fef-3a85-4438-848c-0910513810e0" containerName="sg-core" Mar 16 16:31:12 crc kubenswrapper[5120]: I0316 16:31:12.939690 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57c30724-6f23-4b63-b97e-f1e692921ecf" containerName="registry-server" Mar 16 16:31:12 crc kubenswrapper[5120]: I0316 16:31:12.939697 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="57c30724-6f23-4b63-b97e-f1e692921ecf" containerName="registry-server" Mar 16 16:31:12 crc kubenswrapper[5120]: I0316 16:31:12.939707 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57c30724-6f23-4b63-b97e-f1e692921ecf" containerName="extract-content" Mar 16 16:31:12 crc kubenswrapper[5120]: I0316 16:31:12.939714 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="57c30724-6f23-4b63-b97e-f1e692921ecf" containerName="extract-content" Mar 16 16:31:12 crc kubenswrapper[5120]: I0316 16:31:12.939731 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4c4e515-3d7d-4436-ab79-c7c6e2bf2867" containerName="account-replicator" Mar 16 16:31:12 crc kubenswrapper[5120]: I0316 16:31:12.939738 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4c4e515-3d7d-4436-ab79-c7c6e2bf2867" containerName="account-replicator" Mar 16 16:31:12 crc kubenswrapper[5120]: I0316 16:31:12.939747 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4c4e515-3d7d-4436-ab79-c7c6e2bf2867" containerName="container-server" Mar 16 16:31:12 crc kubenswrapper[5120]: I0316 16:31:12.939772 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4c4e515-3d7d-4436-ab79-c7c6e2bf2867" containerName="container-server" Mar 16 16:31:12 crc kubenswrapper[5120]: I0316 16:31:12.939789 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4c4e515-3d7d-4436-ab79-c7c6e2bf2867" containerName="container-replicator" Mar 16 16:31:12 crc kubenswrapper[5120]: I0316 16:31:12.939796 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4c4e515-3d7d-4436-ab79-c7c6e2bf2867" containerName="container-replicator" Mar 16 16:31:12 crc kubenswrapper[5120]: I0316 16:31:12.939805 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4c4e515-3d7d-4436-ab79-c7c6e2bf2867" containerName="object-auditor" Mar 16 16:31:12 crc kubenswrapper[5120]: I0316 16:31:12.939815 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4c4e515-3d7d-4436-ab79-c7c6e2bf2867" containerName="object-auditor" Mar 16 16:31:12 crc kubenswrapper[5120]: I0316 16:31:12.939826 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e45bb7a-9982-458f-80b5-60541c2d2daf" containerName="nova-cell0-conductor-conductor" Mar 16 16:31:12 crc kubenswrapper[5120]: I0316 16:31:12.939833 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e45bb7a-9982-458f-80b5-60541c2d2daf" containerName="nova-cell0-conductor-conductor" Mar 16 16:31:12 crc kubenswrapper[5120]: I0316 16:31:12.939902 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="594e9c2b-c42a-4671-9b95-3ca9cc0834da" containerName="cinder-scheduler" Mar 16 16:31:12 crc kubenswrapper[5120]: I0316 16:31:12.939913 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="594e9c2b-c42a-4671-9b95-3ca9cc0834da" containerName="cinder-scheduler" Mar 16 16:31:12 crc kubenswrapper[5120]: I0316 16:31:12.940066 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e4c4e515-3d7d-4436-ab79-c7c6e2bf2867" containerName="swift-recon-cron" Mar 16 16:31:12 crc kubenswrapper[5120]: I0316 16:31:12.940087 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="325f32e1-5461-4d71-a30c-dee2528d6fb3" containerName="neutron-api" Mar 16 16:31:12 crc kubenswrapper[5120]: I0316 16:31:12.940096 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e4c4e515-3d7d-4436-ab79-c7c6e2bf2867" containerName="account-reaper" Mar 16 16:31:12 crc kubenswrapper[5120]: I0316 16:31:12.940110 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e4c4e515-3d7d-4436-ab79-c7c6e2bf2867" containerName="object-updater" Mar 16 16:31:12 crc kubenswrapper[5120]: I0316 16:31:12.940121 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="325f32e1-5461-4d71-a30c-dee2528d6fb3" containerName="neutron-httpd" Mar 16 16:31:12 crc kubenswrapper[5120]: I0316 16:31:12.940131 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e4c4e515-3d7d-4436-ab79-c7c6e2bf2867" containerName="object-server" Mar 16 16:31:12 crc kubenswrapper[5120]: I0316 16:31:12.940143 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e4c4e515-3d7d-4436-ab79-c7c6e2bf2867" containerName="object-replicator" Mar 16 16:31:12 crc kubenswrapper[5120]: I0316 16:31:12.940153 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="57c30724-6f23-4b63-b97e-f1e692921ecf" containerName="registry-server" Mar 16 16:31:12 crc kubenswrapper[5120]: I0316 16:31:12.940165 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="abc96fef-3a85-4438-848c-0910513810e0" containerName="proxy-httpd" Mar 16 16:31:12 crc kubenswrapper[5120]: I0316 16:31:12.940176 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e4c4e515-3d7d-4436-ab79-c7c6e2bf2867" containerName="object-auditor" Mar 16 16:31:12 crc kubenswrapper[5120]: I0316 16:31:12.940184 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e4c4e515-3d7d-4436-ab79-c7c6e2bf2867" containerName="container-replicator" Mar 16 16:31:12 crc kubenswrapper[5120]: I0316 16:31:12.940196 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="abc96fef-3a85-4438-848c-0910513810e0" containerName="ceilometer-central-agent" Mar 16 16:31:12 crc kubenswrapper[5120]: I0316 16:31:12.940208 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="abc96fef-3a85-4438-848c-0910513810e0" containerName="sg-core" Mar 16 16:31:12 crc kubenswrapper[5120]: I0316 16:31:12.940217 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="abc96fef-3a85-4438-848c-0910513810e0" containerName="ceilometer-notification-agent" Mar 16 16:31:12 crc kubenswrapper[5120]: I0316 16:31:12.940228 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e4c4e515-3d7d-4436-ab79-c7c6e2bf2867" containerName="account-auditor" Mar 16 16:31:12 crc kubenswrapper[5120]: I0316 16:31:12.940238 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7e45bb7a-9982-458f-80b5-60541c2d2daf" containerName="nova-cell0-conductor-conductor" Mar 16 16:31:12 crc kubenswrapper[5120]: I0316 16:31:12.940250 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e4c4e515-3d7d-4436-ab79-c7c6e2bf2867" containerName="account-replicator" Mar 16 16:31:12 crc kubenswrapper[5120]: I0316 16:31:12.940260 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e4c4e515-3d7d-4436-ab79-c7c6e2bf2867" containerName="container-auditor" Mar 16 16:31:12 crc kubenswrapper[5120]: I0316 16:31:12.940271 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e4c4e515-3d7d-4436-ab79-c7c6e2bf2867" containerName="object-expirer" Mar 16 16:31:12 crc kubenswrapper[5120]: I0316 16:31:12.940285 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e4c4e515-3d7d-4436-ab79-c7c6e2bf2867" containerName="container-server" Mar 16 16:31:12 crc kubenswrapper[5120]: I0316 16:31:12.940295 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="692399cb-3427-4a68-8677-aee482e1ae16" containerName="registry-server" Mar 16 16:31:12 crc kubenswrapper[5120]: I0316 16:31:12.940305 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e4c4e515-3d7d-4436-ab79-c7c6e2bf2867" containerName="container-updater" Mar 16 16:31:12 crc kubenswrapper[5120]: I0316 16:31:12.940314 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e4c4e515-3d7d-4436-ab79-c7c6e2bf2867" containerName="account-server" Mar 16 16:31:12 crc kubenswrapper[5120]: I0316 16:31:12.940327 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7c3819a8-dcaf-4026-87c2-5f6419c379a9" containerName="nova-cell1-conductor-conductor" Mar 16 16:31:12 crc kubenswrapper[5120]: I0316 16:31:12.940338 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e4c4e515-3d7d-4436-ab79-c7c6e2bf2867" containerName="rsync" Mar 16 16:31:12 crc kubenswrapper[5120]: I0316 16:31:12.940349 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="594e9c2b-c42a-4671-9b95-3ca9cc0834da" containerName="cinder-scheduler" Mar 16 16:31:12 crc kubenswrapper[5120]: I0316 16:31:12.940360 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="836f3504-5416-46bf-a225-7b7f977fe82c" containerName="nova-scheduler-scheduler" Mar 16 16:31:12 crc kubenswrapper[5120]: I0316 16:31:12.940373 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="594e9c2b-c42a-4671-9b95-3ca9cc0834da" containerName="probe" Mar 16 16:31:12 crc kubenswrapper[5120]: I0316 16:31:12.955072 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-hchbr"] Mar 16 16:31:12 crc kubenswrapper[5120]: I0316 16:31:12.955195 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-hchbr" Mar 16 16:31:12 crc kubenswrapper[5120]: I0316 16:31:12.966637 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"crc-storage\"/\"crc-storage-dockercfg-s2tht\"" Mar 16 16:31:12 crc kubenswrapper[5120]: I0316 16:31:12.966728 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"crc-storage\"" Mar 16 16:31:12 crc kubenswrapper[5120]: I0316 16:31:12.967033 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"openshift-service-ca.crt\"" Mar 16 16:31:12 crc kubenswrapper[5120]: I0316 16:31:12.967292 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"kube-root-ca.crt\"" Mar 16 16:31:12 crc kubenswrapper[5120]: I0316 16:31:12.969353 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/43cabb85-7f2c-452f-ace1-2cb200464473-crc-storage\") pod \"crc-storage-crc-hchbr\" (UID: \"43cabb85-7f2c-452f-ace1-2cb200464473\") " pod="crc-storage/crc-storage-crc-hchbr" Mar 16 16:31:12 crc kubenswrapper[5120]: I0316 16:31:12.969434 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/43cabb85-7f2c-452f-ace1-2cb200464473-node-mnt\") pod \"crc-storage-crc-hchbr\" (UID: \"43cabb85-7f2c-452f-ace1-2cb200464473\") " pod="crc-storage/crc-storage-crc-hchbr" Mar 16 16:31:12 crc kubenswrapper[5120]: I0316 16:31:12.969513 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqrpv\" (UniqueName: \"kubernetes.io/projected/43cabb85-7f2c-452f-ace1-2cb200464473-kube-api-access-lqrpv\") pod \"crc-storage-crc-hchbr\" (UID: \"43cabb85-7f2c-452f-ace1-2cb200464473\") " pod="crc-storage/crc-storage-crc-hchbr" Mar 16 16:31:13 crc kubenswrapper[5120]: I0316 16:31:13.070553 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/43cabb85-7f2c-452f-ace1-2cb200464473-crc-storage\") pod \"crc-storage-crc-hchbr\" (UID: \"43cabb85-7f2c-452f-ace1-2cb200464473\") " pod="crc-storage/crc-storage-crc-hchbr" Mar 16 16:31:13 crc kubenswrapper[5120]: I0316 16:31:13.070618 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/43cabb85-7f2c-452f-ace1-2cb200464473-node-mnt\") pod \"crc-storage-crc-hchbr\" (UID: \"43cabb85-7f2c-452f-ace1-2cb200464473\") " pod="crc-storage/crc-storage-crc-hchbr" Mar 16 16:31:13 crc kubenswrapper[5120]: I0316 16:31:13.070668 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lqrpv\" (UniqueName: \"kubernetes.io/projected/43cabb85-7f2c-452f-ace1-2cb200464473-kube-api-access-lqrpv\") pod \"crc-storage-crc-hchbr\" (UID: \"43cabb85-7f2c-452f-ace1-2cb200464473\") " pod="crc-storage/crc-storage-crc-hchbr" Mar 16 16:31:13 crc kubenswrapper[5120]: I0316 16:31:13.070913 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/43cabb85-7f2c-452f-ace1-2cb200464473-node-mnt\") pod \"crc-storage-crc-hchbr\" (UID: \"43cabb85-7f2c-452f-ace1-2cb200464473\") " pod="crc-storage/crc-storage-crc-hchbr" Mar 16 16:31:13 crc kubenswrapper[5120]: I0316 16:31:13.071630 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/43cabb85-7f2c-452f-ace1-2cb200464473-crc-storage\") pod \"crc-storage-crc-hchbr\" (UID: \"43cabb85-7f2c-452f-ace1-2cb200464473\") " pod="crc-storage/crc-storage-crc-hchbr" Mar 16 16:31:13 crc kubenswrapper[5120]: I0316 16:31:13.087169 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqrpv\" (UniqueName: \"kubernetes.io/projected/43cabb85-7f2c-452f-ace1-2cb200464473-kube-api-access-lqrpv\") pod \"crc-storage-crc-hchbr\" (UID: \"43cabb85-7f2c-452f-ace1-2cb200464473\") " pod="crc-storage/crc-storage-crc-hchbr" Mar 16 16:31:13 crc kubenswrapper[5120]: I0316 16:31:13.288594 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-hchbr" Mar 16 16:31:13 crc kubenswrapper[5120]: I0316 16:31:13.722973 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-hchbr"] Mar 16 16:31:13 crc kubenswrapper[5120]: W0316 16:31:13.726168 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod43cabb85_7f2c_452f_ace1_2cb200464473.slice/crio-664778fd546efc766123a4f0c52178609980e577db2714aa7d874b9f03ecca80 WatchSource:0}: Error finding container 664778fd546efc766123a4f0c52178609980e577db2714aa7d874b9f03ecca80: Status 404 returned error can't find the container with id 664778fd546efc766123a4f0c52178609980e577db2714aa7d874b9f03ecca80 Mar 16 16:31:14 crc kubenswrapper[5120]: I0316 16:31:14.387203 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-hchbr" event={"ID":"43cabb85-7f2c-452f-ace1-2cb200464473","Type":"ContainerStarted","Data":"664778fd546efc766123a4f0c52178609980e577db2714aa7d874b9f03ecca80"} Mar 16 16:31:14 crc kubenswrapper[5120]: I0316 16:31:14.673986 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6de2b59f-369e-4c9f-afe3-80c3c7d16a4b" path="/var/lib/kubelet/pods/6de2b59f-369e-4c9f-afe3-80c3c7d16a4b/volumes" Mar 16 16:31:15 crc kubenswrapper[5120]: I0316 16:31:15.402229 5120 generic.go:358] "Generic (PLEG): container finished" podID="43cabb85-7f2c-452f-ace1-2cb200464473" containerID="36ac89da2257ee0943c9591a98ca94e5b5d62e323bd4ab556d4334c4ea9a86cc" exitCode=0 Mar 16 16:31:15 crc kubenswrapper[5120]: I0316 16:31:15.402289 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-hchbr" event={"ID":"43cabb85-7f2c-452f-ace1-2cb200464473","Type":"ContainerDied","Data":"36ac89da2257ee0943c9591a98ca94e5b5d62e323bd4ab556d4334c4ea9a86cc"} Mar 16 16:31:16 crc kubenswrapper[5120]: I0316 16:31:16.745496 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-hchbr" Mar 16 16:31:16 crc kubenswrapper[5120]: I0316 16:31:16.837523 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/43cabb85-7f2c-452f-ace1-2cb200464473-node-mnt\") pod \"43cabb85-7f2c-452f-ace1-2cb200464473\" (UID: \"43cabb85-7f2c-452f-ace1-2cb200464473\") " Mar 16 16:31:16 crc kubenswrapper[5120]: I0316 16:31:16.837649 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/43cabb85-7f2c-452f-ace1-2cb200464473-crc-storage\") pod \"43cabb85-7f2c-452f-ace1-2cb200464473\" (UID: \"43cabb85-7f2c-452f-ace1-2cb200464473\") " Mar 16 16:31:16 crc kubenswrapper[5120]: I0316 16:31:16.837880 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lqrpv\" (UniqueName: \"kubernetes.io/projected/43cabb85-7f2c-452f-ace1-2cb200464473-kube-api-access-lqrpv\") pod \"43cabb85-7f2c-452f-ace1-2cb200464473\" (UID: \"43cabb85-7f2c-452f-ace1-2cb200464473\") " Mar 16 16:31:16 crc kubenswrapper[5120]: I0316 16:31:16.839098 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/43cabb85-7f2c-452f-ace1-2cb200464473-node-mnt" (OuterVolumeSpecName: "node-mnt") pod "43cabb85-7f2c-452f-ace1-2cb200464473" (UID: "43cabb85-7f2c-452f-ace1-2cb200464473"). InnerVolumeSpecName "node-mnt". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 16:31:16 crc kubenswrapper[5120]: I0316 16:31:16.845981 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/43cabb85-7f2c-452f-ace1-2cb200464473-kube-api-access-lqrpv" (OuterVolumeSpecName: "kube-api-access-lqrpv") pod "43cabb85-7f2c-452f-ace1-2cb200464473" (UID: "43cabb85-7f2c-452f-ace1-2cb200464473"). InnerVolumeSpecName "kube-api-access-lqrpv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:31:16 crc kubenswrapper[5120]: I0316 16:31:16.864535 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/43cabb85-7f2c-452f-ace1-2cb200464473-crc-storage" (OuterVolumeSpecName: "crc-storage") pod "43cabb85-7f2c-452f-ace1-2cb200464473" (UID: "43cabb85-7f2c-452f-ace1-2cb200464473"). InnerVolumeSpecName "crc-storage". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:31:16 crc kubenswrapper[5120]: I0316 16:31:16.939961 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lqrpv\" (UniqueName: \"kubernetes.io/projected/43cabb85-7f2c-452f-ace1-2cb200464473-kube-api-access-lqrpv\") on node \"crc\" DevicePath \"\"" Mar 16 16:31:16 crc kubenswrapper[5120]: I0316 16:31:16.940005 5120 reconciler_common.go:299] "Volume detached for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/43cabb85-7f2c-452f-ace1-2cb200464473-node-mnt\") on node \"crc\" DevicePath \"\"" Mar 16 16:31:16 crc kubenswrapper[5120]: I0316 16:31:16.940016 5120 reconciler_common.go:299] "Volume detached for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/43cabb85-7f2c-452f-ace1-2cb200464473-crc-storage\") on node \"crc\" DevicePath \"\"" Mar 16 16:31:17 crc kubenswrapper[5120]: I0316 16:31:17.429078 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-hchbr" Mar 16 16:31:17 crc kubenswrapper[5120]: I0316 16:31:17.429104 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-hchbr" event={"ID":"43cabb85-7f2c-452f-ace1-2cb200464473","Type":"ContainerDied","Data":"664778fd546efc766123a4f0c52178609980e577db2714aa7d874b9f03ecca80"} Mar 16 16:31:17 crc kubenswrapper[5120]: I0316 16:31:17.429170 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="664778fd546efc766123a4f0c52178609980e577db2714aa7d874b9f03ecca80" Mar 16 16:31:20 crc kubenswrapper[5120]: I0316 16:31:20.166949 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["crc-storage/crc-storage-crc-hchbr"] Mar 16 16:31:20 crc kubenswrapper[5120]: I0316 16:31:20.173962 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["crc-storage/crc-storage-crc-hchbr"] Mar 16 16:31:20 crc kubenswrapper[5120]: I0316 16:31:20.305579 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["crc-storage/crc-storage-crc-2sqkt"] Mar 16 16:31:20 crc kubenswrapper[5120]: I0316 16:31:20.307185 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43cabb85-7f2c-452f-ace1-2cb200464473" containerName="storage" Mar 16 16:31:20 crc kubenswrapper[5120]: I0316 16:31:20.307221 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="43cabb85-7f2c-452f-ace1-2cb200464473" containerName="storage" Mar 16 16:31:20 crc kubenswrapper[5120]: I0316 16:31:20.307520 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="43cabb85-7f2c-452f-ace1-2cb200464473" containerName="storage" Mar 16 16:31:20 crc kubenswrapper[5120]: I0316 16:31:20.316648 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-2sqkt"] Mar 16 16:31:20 crc kubenswrapper[5120]: I0316 16:31:20.316828 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-2sqkt" Mar 16 16:31:20 crc kubenswrapper[5120]: I0316 16:31:20.324290 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"kube-root-ca.crt\"" Mar 16 16:31:20 crc kubenswrapper[5120]: I0316 16:31:20.324319 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"openshift-service-ca.crt\"" Mar 16 16:31:20 crc kubenswrapper[5120]: I0316 16:31:20.324376 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"crc-storage\"" Mar 16 16:31:20 crc kubenswrapper[5120]: I0316 16:31:20.326415 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"crc-storage\"/\"crc-storage-dockercfg-s2tht\"" Mar 16 16:31:20 crc kubenswrapper[5120]: I0316 16:31:20.407918 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/ce725cde-c352-4b82-ba40-eff46d6bcd87-node-mnt\") pod \"crc-storage-crc-2sqkt\" (UID: \"ce725cde-c352-4b82-ba40-eff46d6bcd87\") " pod="crc-storage/crc-storage-crc-2sqkt" Mar 16 16:31:20 crc kubenswrapper[5120]: I0316 16:31:20.408380 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/ce725cde-c352-4b82-ba40-eff46d6bcd87-crc-storage\") pod \"crc-storage-crc-2sqkt\" (UID: \"ce725cde-c352-4b82-ba40-eff46d6bcd87\") " pod="crc-storage/crc-storage-crc-2sqkt" Mar 16 16:31:20 crc kubenswrapper[5120]: I0316 16:31:20.408537 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ts47\" (UniqueName: \"kubernetes.io/projected/ce725cde-c352-4b82-ba40-eff46d6bcd87-kube-api-access-6ts47\") pod \"crc-storage-crc-2sqkt\" (UID: \"ce725cde-c352-4b82-ba40-eff46d6bcd87\") " pod="crc-storage/crc-storage-crc-2sqkt" Mar 16 16:31:20 crc kubenswrapper[5120]: I0316 16:31:20.510599 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/ce725cde-c352-4b82-ba40-eff46d6bcd87-node-mnt\") pod \"crc-storage-crc-2sqkt\" (UID: \"ce725cde-c352-4b82-ba40-eff46d6bcd87\") " pod="crc-storage/crc-storage-crc-2sqkt" Mar 16 16:31:20 crc kubenswrapper[5120]: I0316 16:31:20.510854 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/ce725cde-c352-4b82-ba40-eff46d6bcd87-crc-storage\") pod \"crc-storage-crc-2sqkt\" (UID: \"ce725cde-c352-4b82-ba40-eff46d6bcd87\") " pod="crc-storage/crc-storage-crc-2sqkt" Mar 16 16:31:20 crc kubenswrapper[5120]: I0316 16:31:20.510954 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/ce725cde-c352-4b82-ba40-eff46d6bcd87-node-mnt\") pod \"crc-storage-crc-2sqkt\" (UID: \"ce725cde-c352-4b82-ba40-eff46d6bcd87\") " pod="crc-storage/crc-storage-crc-2sqkt" Mar 16 16:31:20 crc kubenswrapper[5120]: I0316 16:31:20.511175 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6ts47\" (UniqueName: \"kubernetes.io/projected/ce725cde-c352-4b82-ba40-eff46d6bcd87-kube-api-access-6ts47\") pod \"crc-storage-crc-2sqkt\" (UID: \"ce725cde-c352-4b82-ba40-eff46d6bcd87\") " pod="crc-storage/crc-storage-crc-2sqkt" Mar 16 16:31:20 crc kubenswrapper[5120]: I0316 16:31:20.511815 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/ce725cde-c352-4b82-ba40-eff46d6bcd87-crc-storage\") pod \"crc-storage-crc-2sqkt\" (UID: \"ce725cde-c352-4b82-ba40-eff46d6bcd87\") " pod="crc-storage/crc-storage-crc-2sqkt" Mar 16 16:31:20 crc kubenswrapper[5120]: I0316 16:31:20.537492 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ts47\" (UniqueName: \"kubernetes.io/projected/ce725cde-c352-4b82-ba40-eff46d6bcd87-kube-api-access-6ts47\") pod \"crc-storage-crc-2sqkt\" (UID: \"ce725cde-c352-4b82-ba40-eff46d6bcd87\") " pod="crc-storage/crc-storage-crc-2sqkt" Mar 16 16:31:20 crc kubenswrapper[5120]: I0316 16:31:20.640827 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-2sqkt" Mar 16 16:31:20 crc kubenswrapper[5120]: I0316 16:31:20.674876 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="43cabb85-7f2c-452f-ace1-2cb200464473" path="/var/lib/kubelet/pods/43cabb85-7f2c-452f-ace1-2cb200464473/volumes" Mar 16 16:31:21 crc kubenswrapper[5120]: I0316 16:31:21.076225 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-2sqkt"] Mar 16 16:31:21 crc kubenswrapper[5120]: I0316 16:31:21.482825 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-2sqkt" event={"ID":"ce725cde-c352-4b82-ba40-eff46d6bcd87","Type":"ContainerStarted","Data":"a2f7e0c3739d3ad4efd164186f0f9e37cfa22ccfd75474c209f059dc0f51c108"} Mar 16 16:31:21 crc kubenswrapper[5120]: I0316 16:31:21.520203 5120 scope.go:117] "RemoveContainer" containerID="031a874e817f3d70e6667601bfde112c6b044100d85edb96d5d63dd72629ae13" Mar 16 16:31:21 crc kubenswrapper[5120]: I0316 16:31:21.564985 5120 scope.go:117] "RemoveContainer" containerID="37f52458b19073ff1e8a69d38980542edda8b4606834a40833190d622fd0ea6d" Mar 16 16:31:22 crc kubenswrapper[5120]: I0316 16:31:22.008027 5120 patch_prober.go:28] interesting pod/machine-config-daemon-7bf76 container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 16:31:22 crc kubenswrapper[5120]: I0316 16:31:22.008084 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 16:31:22 crc kubenswrapper[5120]: I0316 16:31:22.493705 5120 generic.go:358] "Generic (PLEG): container finished" podID="ce725cde-c352-4b82-ba40-eff46d6bcd87" containerID="2441f44bcdc714632e85ed0f78fd194b2ca1f178f2ae17390f61a0db203e3beb" exitCode=0 Mar 16 16:31:22 crc kubenswrapper[5120]: I0316 16:31:22.493802 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-2sqkt" event={"ID":"ce725cde-c352-4b82-ba40-eff46d6bcd87","Type":"ContainerDied","Data":"2441f44bcdc714632e85ed0f78fd194b2ca1f178f2ae17390f61a0db203e3beb"} Mar 16 16:31:22 crc kubenswrapper[5120]: E0316 16:31:22.906204 5120 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8690a5a2_3341_452e_8364_2e5e4072c192.slice\": RecentStats: unable to find data in memory cache]" Mar 16 16:31:23 crc kubenswrapper[5120]: I0316 16:31:23.801902 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-2sqkt" Mar 16 16:31:23 crc kubenswrapper[5120]: I0316 16:31:23.875234 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/ce725cde-c352-4b82-ba40-eff46d6bcd87-node-mnt\") pod \"ce725cde-c352-4b82-ba40-eff46d6bcd87\" (UID: \"ce725cde-c352-4b82-ba40-eff46d6bcd87\") " Mar 16 16:31:23 crc kubenswrapper[5120]: I0316 16:31:23.875412 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/ce725cde-c352-4b82-ba40-eff46d6bcd87-crc-storage\") pod \"ce725cde-c352-4b82-ba40-eff46d6bcd87\" (UID: \"ce725cde-c352-4b82-ba40-eff46d6bcd87\") " Mar 16 16:31:23 crc kubenswrapper[5120]: I0316 16:31:23.875402 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/ce725cde-c352-4b82-ba40-eff46d6bcd87-node-mnt" (OuterVolumeSpecName: "node-mnt") pod "ce725cde-c352-4b82-ba40-eff46d6bcd87" (UID: "ce725cde-c352-4b82-ba40-eff46d6bcd87"). InnerVolumeSpecName "node-mnt". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 16:31:23 crc kubenswrapper[5120]: I0316 16:31:23.876377 5120 reconciler_common.go:299] "Volume detached for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/ce725cde-c352-4b82-ba40-eff46d6bcd87-node-mnt\") on node \"crc\" DevicePath \"\"" Mar 16 16:31:23 crc kubenswrapper[5120]: I0316 16:31:23.898750 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce725cde-c352-4b82-ba40-eff46d6bcd87-crc-storage" (OuterVolumeSpecName: "crc-storage") pod "ce725cde-c352-4b82-ba40-eff46d6bcd87" (UID: "ce725cde-c352-4b82-ba40-eff46d6bcd87"). InnerVolumeSpecName "crc-storage". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:31:23 crc kubenswrapper[5120]: I0316 16:31:23.976982 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6ts47\" (UniqueName: \"kubernetes.io/projected/ce725cde-c352-4b82-ba40-eff46d6bcd87-kube-api-access-6ts47\") pod \"ce725cde-c352-4b82-ba40-eff46d6bcd87\" (UID: \"ce725cde-c352-4b82-ba40-eff46d6bcd87\") " Mar 16 16:31:23 crc kubenswrapper[5120]: I0316 16:31:23.977393 5120 reconciler_common.go:299] "Volume detached for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/ce725cde-c352-4b82-ba40-eff46d6bcd87-crc-storage\") on node \"crc\" DevicePath \"\"" Mar 16 16:31:23 crc kubenswrapper[5120]: I0316 16:31:23.980336 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce725cde-c352-4b82-ba40-eff46d6bcd87-kube-api-access-6ts47" (OuterVolumeSpecName: "kube-api-access-6ts47") pod "ce725cde-c352-4b82-ba40-eff46d6bcd87" (UID: "ce725cde-c352-4b82-ba40-eff46d6bcd87"). InnerVolumeSpecName "kube-api-access-6ts47". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:31:24 crc kubenswrapper[5120]: I0316 16:31:24.079744 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6ts47\" (UniqueName: \"kubernetes.io/projected/ce725cde-c352-4b82-ba40-eff46d6bcd87-kube-api-access-6ts47\") on node \"crc\" DevicePath \"\"" Mar 16 16:31:24 crc kubenswrapper[5120]: I0316 16:31:24.513651 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-2sqkt" Mar 16 16:31:24 crc kubenswrapper[5120]: I0316 16:31:24.513682 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-2sqkt" event={"ID":"ce725cde-c352-4b82-ba40-eff46d6bcd87","Type":"ContainerDied","Data":"a2f7e0c3739d3ad4efd164186f0f9e37cfa22ccfd75474c209f059dc0f51c108"} Mar 16 16:31:24 crc kubenswrapper[5120]: I0316 16:31:24.514089 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a2f7e0c3739d3ad4efd164186f0f9e37cfa22ccfd75474c209f059dc0f51c108" Mar 16 16:31:33 crc kubenswrapper[5120]: E0316 16:31:33.094593 5120 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8690a5a2_3341_452e_8364_2e5e4072c192.slice\": RecentStats: unable to find data in memory cache]" Mar 16 16:31:36 crc kubenswrapper[5120]: I0316 16:31:36.212063 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 16:31:36 crc kubenswrapper[5120]: I0316 16:31:36.213522 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce725cde-c352-4b82-ba40-eff46d6bcd87" containerName="storage" Mar 16 16:31:36 crc kubenswrapper[5120]: I0316 16:31:36.213552 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce725cde-c352-4b82-ba40-eff46d6bcd87" containerName="storage" Mar 16 16:31:36 crc kubenswrapper[5120]: I0316 16:31:36.213705 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ce725cde-c352-4b82-ba40-eff46d6bcd87" containerName="storage" Mar 16 16:31:36 crc kubenswrapper[5120]: I0316 16:31:36.229605 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:31:36 crc kubenswrapper[5120]: I0316 16:31:36.231998 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-cell1-default-user\"" Mar 16 16:31:36 crc kubenswrapper[5120]: I0316 16:31:36.232432 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-cell1-config-data\"" Mar 16 16:31:36 crc kubenswrapper[5120]: I0316 16:31:36.233559 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-cell1-plugins-conf\"" Mar 16 16:31:36 crc kubenswrapper[5120]: I0316 16:31:36.235070 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-cell1-erlang-cookie\"" Mar 16 16:31:36 crc kubenswrapper[5120]: I0316 16:31:36.235442 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-rabbitmq-cell1-svc\"" Mar 16 16:31:36 crc kubenswrapper[5120]: I0316 16:31:36.235692 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-cell1-server-dockercfg-vvd2q\"" Mar 16 16:31:36 crc kubenswrapper[5120]: I0316 16:31:36.239534 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 16:31:36 crc kubenswrapper[5120]: I0316 16:31:36.240749 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-cell1-server-conf\"" Mar 16 16:31:36 crc kubenswrapper[5120]: I0316 16:31:36.334861 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/1cd39de5-ca7d-4ed7-8052-17c5613718fc-rabbitmq-confd\") pod \"rabbitmq-cell1-server-0\" (UID: \"1cd39de5-ca7d-4ed7-8052-17c5613718fc\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:31:36 crc kubenswrapper[5120]: I0316 16:31:36.334959 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/1cd39de5-ca7d-4ed7-8052-17c5613718fc-plugins-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"1cd39de5-ca7d-4ed7-8052-17c5613718fc\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:31:36 crc kubenswrapper[5120]: I0316 16:31:36.335036 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/1cd39de5-ca7d-4ed7-8052-17c5613718fc-config-data\") pod \"rabbitmq-cell1-server-0\" (UID: \"1cd39de5-ca7d-4ed7-8052-17c5613718fc\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:31:36 crc kubenswrapper[5120]: I0316 16:31:36.335058 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/1cd39de5-ca7d-4ed7-8052-17c5613718fc-pod-info\") pod \"rabbitmq-cell1-server-0\" (UID: \"1cd39de5-ca7d-4ed7-8052-17c5613718fc\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:31:36 crc kubenswrapper[5120]: I0316 16:31:36.335109 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/1cd39de5-ca7d-4ed7-8052-17c5613718fc-rabbitmq-erlang-cookie\") pod \"rabbitmq-cell1-server-0\" (UID: \"1cd39de5-ca7d-4ed7-8052-17c5613718fc\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:31:36 crc kubenswrapper[5120]: I0316 16:31:36.335156 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/1cd39de5-ca7d-4ed7-8052-17c5613718fc-rabbitmq-plugins\") pod \"rabbitmq-cell1-server-0\" (UID: \"1cd39de5-ca7d-4ed7-8052-17c5613718fc\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:31:36 crc kubenswrapper[5120]: I0316 16:31:36.335208 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhxck\" (UniqueName: \"kubernetes.io/projected/1cd39de5-ca7d-4ed7-8052-17c5613718fc-kube-api-access-nhxck\") pod \"rabbitmq-cell1-server-0\" (UID: \"1cd39de5-ca7d-4ed7-8052-17c5613718fc\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:31:36 crc kubenswrapper[5120]: I0316 16:31:36.335242 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"1cd39de5-ca7d-4ed7-8052-17c5613718fc\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:31:36 crc kubenswrapper[5120]: I0316 16:31:36.335277 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/1cd39de5-ca7d-4ed7-8052-17c5613718fc-server-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"1cd39de5-ca7d-4ed7-8052-17c5613718fc\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:31:36 crc kubenswrapper[5120]: I0316 16:31:36.335314 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/1cd39de5-ca7d-4ed7-8052-17c5613718fc-erlang-cookie-secret\") pod \"rabbitmq-cell1-server-0\" (UID: \"1cd39de5-ca7d-4ed7-8052-17c5613718fc\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:31:36 crc kubenswrapper[5120]: I0316 16:31:36.335349 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/1cd39de5-ca7d-4ed7-8052-17c5613718fc-rabbitmq-tls\") pod \"rabbitmq-cell1-server-0\" (UID: \"1cd39de5-ca7d-4ed7-8052-17c5613718fc\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:31:36 crc kubenswrapper[5120]: I0316 16:31:36.437188 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nhxck\" (UniqueName: \"kubernetes.io/projected/1cd39de5-ca7d-4ed7-8052-17c5613718fc-kube-api-access-nhxck\") pod \"rabbitmq-cell1-server-0\" (UID: \"1cd39de5-ca7d-4ed7-8052-17c5613718fc\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:31:36 crc kubenswrapper[5120]: I0316 16:31:36.437241 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"1cd39de5-ca7d-4ed7-8052-17c5613718fc\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:31:36 crc kubenswrapper[5120]: I0316 16:31:36.437395 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/1cd39de5-ca7d-4ed7-8052-17c5613718fc-server-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"1cd39de5-ca7d-4ed7-8052-17c5613718fc\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:31:36 crc kubenswrapper[5120]: I0316 16:31:36.437475 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/1cd39de5-ca7d-4ed7-8052-17c5613718fc-erlang-cookie-secret\") pod \"rabbitmq-cell1-server-0\" (UID: \"1cd39de5-ca7d-4ed7-8052-17c5613718fc\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:31:36 crc kubenswrapper[5120]: I0316 16:31:36.437509 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/1cd39de5-ca7d-4ed7-8052-17c5613718fc-rabbitmq-tls\") pod \"rabbitmq-cell1-server-0\" (UID: \"1cd39de5-ca7d-4ed7-8052-17c5613718fc\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:31:36 crc kubenswrapper[5120]: I0316 16:31:36.437601 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/1cd39de5-ca7d-4ed7-8052-17c5613718fc-rabbitmq-confd\") pod \"rabbitmq-cell1-server-0\" (UID: \"1cd39de5-ca7d-4ed7-8052-17c5613718fc\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:31:36 crc kubenswrapper[5120]: I0316 16:31:36.437609 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"1cd39de5-ca7d-4ed7-8052-17c5613718fc\") device mount path \"/mnt/openstack/pv02\"" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:31:36 crc kubenswrapper[5120]: I0316 16:31:36.437882 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/1cd39de5-ca7d-4ed7-8052-17c5613718fc-plugins-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"1cd39de5-ca7d-4ed7-8052-17c5613718fc\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:31:36 crc kubenswrapper[5120]: I0316 16:31:36.438034 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/1cd39de5-ca7d-4ed7-8052-17c5613718fc-config-data\") pod \"rabbitmq-cell1-server-0\" (UID: \"1cd39de5-ca7d-4ed7-8052-17c5613718fc\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:31:36 crc kubenswrapper[5120]: I0316 16:31:36.438057 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/1cd39de5-ca7d-4ed7-8052-17c5613718fc-pod-info\") pod \"rabbitmq-cell1-server-0\" (UID: \"1cd39de5-ca7d-4ed7-8052-17c5613718fc\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:31:36 crc kubenswrapper[5120]: I0316 16:31:36.438120 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/1cd39de5-ca7d-4ed7-8052-17c5613718fc-rabbitmq-erlang-cookie\") pod \"rabbitmq-cell1-server-0\" (UID: \"1cd39de5-ca7d-4ed7-8052-17c5613718fc\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:31:36 crc kubenswrapper[5120]: I0316 16:31:36.438179 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/1cd39de5-ca7d-4ed7-8052-17c5613718fc-rabbitmq-plugins\") pod \"rabbitmq-cell1-server-0\" (UID: \"1cd39de5-ca7d-4ed7-8052-17c5613718fc\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:31:36 crc kubenswrapper[5120]: I0316 16:31:36.438743 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/1cd39de5-ca7d-4ed7-8052-17c5613718fc-rabbitmq-plugins\") pod \"rabbitmq-cell1-server-0\" (UID: \"1cd39de5-ca7d-4ed7-8052-17c5613718fc\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:31:36 crc kubenswrapper[5120]: I0316 16:31:36.438924 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/1cd39de5-ca7d-4ed7-8052-17c5613718fc-config-data\") pod \"rabbitmq-cell1-server-0\" (UID: \"1cd39de5-ca7d-4ed7-8052-17c5613718fc\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:31:36 crc kubenswrapper[5120]: I0316 16:31:36.439346 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/1cd39de5-ca7d-4ed7-8052-17c5613718fc-server-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"1cd39de5-ca7d-4ed7-8052-17c5613718fc\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:31:36 crc kubenswrapper[5120]: I0316 16:31:36.439432 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/1cd39de5-ca7d-4ed7-8052-17c5613718fc-rabbitmq-erlang-cookie\") pod \"rabbitmq-cell1-server-0\" (UID: \"1cd39de5-ca7d-4ed7-8052-17c5613718fc\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:31:36 crc kubenswrapper[5120]: I0316 16:31:36.439608 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/1cd39de5-ca7d-4ed7-8052-17c5613718fc-plugins-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"1cd39de5-ca7d-4ed7-8052-17c5613718fc\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:31:36 crc kubenswrapper[5120]: I0316 16:31:36.444213 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/1cd39de5-ca7d-4ed7-8052-17c5613718fc-rabbitmq-confd\") pod \"rabbitmq-cell1-server-0\" (UID: \"1cd39de5-ca7d-4ed7-8052-17c5613718fc\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:31:36 crc kubenswrapper[5120]: I0316 16:31:36.461358 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/1cd39de5-ca7d-4ed7-8052-17c5613718fc-erlang-cookie-secret\") pod \"rabbitmq-cell1-server-0\" (UID: \"1cd39de5-ca7d-4ed7-8052-17c5613718fc\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:31:36 crc kubenswrapper[5120]: I0316 16:31:36.461531 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/1cd39de5-ca7d-4ed7-8052-17c5613718fc-pod-info\") pod \"rabbitmq-cell1-server-0\" (UID: \"1cd39de5-ca7d-4ed7-8052-17c5613718fc\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:31:36 crc kubenswrapper[5120]: I0316 16:31:36.461666 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/1cd39de5-ca7d-4ed7-8052-17c5613718fc-rabbitmq-tls\") pod \"rabbitmq-cell1-server-0\" (UID: \"1cd39de5-ca7d-4ed7-8052-17c5613718fc\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:31:36 crc kubenswrapper[5120]: I0316 16:31:36.464934 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhxck\" (UniqueName: \"kubernetes.io/projected/1cd39de5-ca7d-4ed7-8052-17c5613718fc-kube-api-access-nhxck\") pod \"rabbitmq-cell1-server-0\" (UID: \"1cd39de5-ca7d-4ed7-8052-17c5613718fc\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:31:36 crc kubenswrapper[5120]: I0316 16:31:36.465096 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"1cd39de5-ca7d-4ed7-8052-17c5613718fc\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:31:36 crc kubenswrapper[5120]: I0316 16:31:36.472851 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 16:31:36 crc kubenswrapper[5120]: I0316 16:31:36.485022 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 16:31:36 crc kubenswrapper[5120]: I0316 16:31:36.485195 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:31:36 crc kubenswrapper[5120]: I0316 16:31:36.487641 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-server-conf\"" Mar 16 16:31:36 crc kubenswrapper[5120]: I0316 16:31:36.487861 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-default-user\"" Mar 16 16:31:36 crc kubenswrapper[5120]: I0316 16:31:36.487931 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-rabbitmq-svc\"" Mar 16 16:31:36 crc kubenswrapper[5120]: I0316 16:31:36.489176 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-config-data\"" Mar 16 16:31:36 crc kubenswrapper[5120]: I0316 16:31:36.489640 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-plugins-conf\"" Mar 16 16:31:36 crc kubenswrapper[5120]: I0316 16:31:36.489891 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-server-dockercfg-zw4jf\"" Mar 16 16:31:36 crc kubenswrapper[5120]: I0316 16:31:36.490064 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-erlang-cookie\"" Mar 16 16:31:36 crc kubenswrapper[5120]: I0316 16:31:36.539459 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/27f4616b-6d51-4cd6-bdb1-1596dccca5db-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"27f4616b-6d51-4cd6-bdb1-1596dccca5db\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:31:36 crc kubenswrapper[5120]: I0316 16:31:36.539508 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/27f4616b-6d51-4cd6-bdb1-1596dccca5db-pod-info\") pod \"rabbitmq-server-0\" (UID: \"27f4616b-6d51-4cd6-bdb1-1596dccca5db\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:31:36 crc kubenswrapper[5120]: I0316 16:31:36.539587 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/27f4616b-6d51-4cd6-bdb1-1596dccca5db-config-data\") pod \"rabbitmq-server-0\" (UID: \"27f4616b-6d51-4cd6-bdb1-1596dccca5db\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:31:36 crc kubenswrapper[5120]: I0316 16:31:36.539632 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6nb6z\" (UniqueName: \"kubernetes.io/projected/27f4616b-6d51-4cd6-bdb1-1596dccca5db-kube-api-access-6nb6z\") pod \"rabbitmq-server-0\" (UID: \"27f4616b-6d51-4cd6-bdb1-1596dccca5db\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:31:36 crc kubenswrapper[5120]: I0316 16:31:36.539657 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/27f4616b-6d51-4cd6-bdb1-1596dccca5db-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"27f4616b-6d51-4cd6-bdb1-1596dccca5db\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:31:36 crc kubenswrapper[5120]: I0316 16:31:36.539726 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/27f4616b-6d51-4cd6-bdb1-1596dccca5db-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"27f4616b-6d51-4cd6-bdb1-1596dccca5db\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:31:36 crc kubenswrapper[5120]: I0316 16:31:36.539747 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/27f4616b-6d51-4cd6-bdb1-1596dccca5db-server-conf\") pod \"rabbitmq-server-0\" (UID: \"27f4616b-6d51-4cd6-bdb1-1596dccca5db\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:31:36 crc kubenswrapper[5120]: I0316 16:31:36.539860 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/27f4616b-6d51-4cd6-bdb1-1596dccca5db-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"27f4616b-6d51-4cd6-bdb1-1596dccca5db\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:31:36 crc kubenswrapper[5120]: I0316 16:31:36.539934 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/27f4616b-6d51-4cd6-bdb1-1596dccca5db-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"27f4616b-6d51-4cd6-bdb1-1596dccca5db\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:31:36 crc kubenswrapper[5120]: I0316 16:31:36.539961 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/27f4616b-6d51-4cd6-bdb1-1596dccca5db-rabbitmq-tls\") pod \"rabbitmq-server-0\" (UID: \"27f4616b-6d51-4cd6-bdb1-1596dccca5db\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:31:36 crc kubenswrapper[5120]: I0316 16:31:36.540069 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"rabbitmq-server-0\" (UID: \"27f4616b-6d51-4cd6-bdb1-1596dccca5db\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:31:36 crc kubenswrapper[5120]: I0316 16:31:36.550916 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:31:36 crc kubenswrapper[5120]: I0316 16:31:36.642065 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/27f4616b-6d51-4cd6-bdb1-1596dccca5db-config-data\") pod \"rabbitmq-server-0\" (UID: \"27f4616b-6d51-4cd6-bdb1-1596dccca5db\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:31:36 crc kubenswrapper[5120]: I0316 16:31:36.642134 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6nb6z\" (UniqueName: \"kubernetes.io/projected/27f4616b-6d51-4cd6-bdb1-1596dccca5db-kube-api-access-6nb6z\") pod \"rabbitmq-server-0\" (UID: \"27f4616b-6d51-4cd6-bdb1-1596dccca5db\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:31:36 crc kubenswrapper[5120]: I0316 16:31:36.642167 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/27f4616b-6d51-4cd6-bdb1-1596dccca5db-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"27f4616b-6d51-4cd6-bdb1-1596dccca5db\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:31:36 crc kubenswrapper[5120]: I0316 16:31:36.642213 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/27f4616b-6d51-4cd6-bdb1-1596dccca5db-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"27f4616b-6d51-4cd6-bdb1-1596dccca5db\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:31:36 crc kubenswrapper[5120]: I0316 16:31:36.642233 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/27f4616b-6d51-4cd6-bdb1-1596dccca5db-server-conf\") pod \"rabbitmq-server-0\" (UID: \"27f4616b-6d51-4cd6-bdb1-1596dccca5db\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:31:36 crc kubenswrapper[5120]: I0316 16:31:36.642322 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/27f4616b-6d51-4cd6-bdb1-1596dccca5db-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"27f4616b-6d51-4cd6-bdb1-1596dccca5db\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:31:36 crc kubenswrapper[5120]: I0316 16:31:36.642394 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/27f4616b-6d51-4cd6-bdb1-1596dccca5db-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"27f4616b-6d51-4cd6-bdb1-1596dccca5db\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:31:36 crc kubenswrapper[5120]: I0316 16:31:36.642430 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/27f4616b-6d51-4cd6-bdb1-1596dccca5db-rabbitmq-tls\") pod \"rabbitmq-server-0\" (UID: \"27f4616b-6d51-4cd6-bdb1-1596dccca5db\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:31:36 crc kubenswrapper[5120]: I0316 16:31:36.642494 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"rabbitmq-server-0\" (UID: \"27f4616b-6d51-4cd6-bdb1-1596dccca5db\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:31:36 crc kubenswrapper[5120]: I0316 16:31:36.642591 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/27f4616b-6d51-4cd6-bdb1-1596dccca5db-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"27f4616b-6d51-4cd6-bdb1-1596dccca5db\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:31:36 crc kubenswrapper[5120]: I0316 16:31:36.642616 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/27f4616b-6d51-4cd6-bdb1-1596dccca5db-pod-info\") pod \"rabbitmq-server-0\" (UID: \"27f4616b-6d51-4cd6-bdb1-1596dccca5db\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:31:36 crc kubenswrapper[5120]: I0316 16:31:36.642933 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"rabbitmq-server-0\" (UID: \"27f4616b-6d51-4cd6-bdb1-1596dccca5db\") device mount path \"/mnt/openstack/pv03\"" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:31:36 crc kubenswrapper[5120]: I0316 16:31:36.643035 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/27f4616b-6d51-4cd6-bdb1-1596dccca5db-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"27f4616b-6d51-4cd6-bdb1-1596dccca5db\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:31:36 crc kubenswrapper[5120]: I0316 16:31:36.643409 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/27f4616b-6d51-4cd6-bdb1-1596dccca5db-config-data\") pod \"rabbitmq-server-0\" (UID: \"27f4616b-6d51-4cd6-bdb1-1596dccca5db\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:31:36 crc kubenswrapper[5120]: I0316 16:31:36.643831 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/27f4616b-6d51-4cd6-bdb1-1596dccca5db-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"27f4616b-6d51-4cd6-bdb1-1596dccca5db\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:31:36 crc kubenswrapper[5120]: I0316 16:31:36.644045 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/27f4616b-6d51-4cd6-bdb1-1596dccca5db-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"27f4616b-6d51-4cd6-bdb1-1596dccca5db\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:31:36 crc kubenswrapper[5120]: I0316 16:31:36.645729 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/27f4616b-6d51-4cd6-bdb1-1596dccca5db-server-conf\") pod \"rabbitmq-server-0\" (UID: \"27f4616b-6d51-4cd6-bdb1-1596dccca5db\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:31:36 crc kubenswrapper[5120]: I0316 16:31:36.648257 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/27f4616b-6d51-4cd6-bdb1-1596dccca5db-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"27f4616b-6d51-4cd6-bdb1-1596dccca5db\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:31:36 crc kubenswrapper[5120]: I0316 16:31:36.648647 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/27f4616b-6d51-4cd6-bdb1-1596dccca5db-pod-info\") pod \"rabbitmq-server-0\" (UID: \"27f4616b-6d51-4cd6-bdb1-1596dccca5db\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:31:36 crc kubenswrapper[5120]: I0316 16:31:36.648788 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/27f4616b-6d51-4cd6-bdb1-1596dccca5db-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"27f4616b-6d51-4cd6-bdb1-1596dccca5db\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:31:36 crc kubenswrapper[5120]: I0316 16:31:36.668541 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/27f4616b-6d51-4cd6-bdb1-1596dccca5db-rabbitmq-tls\") pod \"rabbitmq-server-0\" (UID: \"27f4616b-6d51-4cd6-bdb1-1596dccca5db\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:31:36 crc kubenswrapper[5120]: I0316 16:31:36.672490 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6nb6z\" (UniqueName: \"kubernetes.io/projected/27f4616b-6d51-4cd6-bdb1-1596dccca5db-kube-api-access-6nb6z\") pod \"rabbitmq-server-0\" (UID: \"27f4616b-6d51-4cd6-bdb1-1596dccca5db\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:31:36 crc kubenswrapper[5120]: I0316 16:31:36.682104 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"rabbitmq-server-0\" (UID: \"27f4616b-6d51-4cd6-bdb1-1596dccca5db\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:31:36 crc kubenswrapper[5120]: I0316 16:31:36.835244 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:31:37 crc kubenswrapper[5120]: I0316 16:31:37.023215 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 16:31:37 crc kubenswrapper[5120]: W0316 16:31:37.324844 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27f4616b_6d51_4cd6_bdb1_1596dccca5db.slice/crio-fc96c2be59f943e6a1f984a0a213fc52002a4a606eca81241dc8c2aa03e5c243 WatchSource:0}: Error finding container fc96c2be59f943e6a1f984a0a213fc52002a4a606eca81241dc8c2aa03e5c243: Status 404 returned error can't find the container with id fc96c2be59f943e6a1f984a0a213fc52002a4a606eca81241dc8c2aa03e5c243 Mar 16 16:31:37 crc kubenswrapper[5120]: I0316 16:31:37.325666 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 16:31:37 crc kubenswrapper[5120]: I0316 16:31:37.629228 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"1cd39de5-ca7d-4ed7-8052-17c5613718fc","Type":"ContainerStarted","Data":"2f761a6bf5b802967d5ba97baf996c7c1075109b551e99caaf7c5bec02bac695"} Mar 16 16:31:37 crc kubenswrapper[5120]: I0316 16:31:37.630779 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"27f4616b-6d51-4cd6-bdb1-1596dccca5db","Type":"ContainerStarted","Data":"fc96c2be59f943e6a1f984a0a213fc52002a4a606eca81241dc8c2aa03e5c243"} Mar 16 16:31:37 crc kubenswrapper[5120]: I0316 16:31:37.987176 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 16:31:37 crc kubenswrapper[5120]: I0316 16:31:37.994109 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:31:37 crc kubenswrapper[5120]: I0316 16:31:37.996993 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-config-data\"" Mar 16 16:31:37 crc kubenswrapper[5120]: I0316 16:31:37.997069 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-galera-openstack-svc\"" Mar 16 16:31:37 crc kubenswrapper[5120]: I0316 16:31:37.998405 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-scripts\"" Mar 16 16:31:37 crc kubenswrapper[5120]: I0316 16:31:37.998554 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"galera-openstack-dockercfg-hswtf\"" Mar 16 16:31:38 crc kubenswrapper[5120]: I0316 16:31:38.001018 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 16:31:38 crc kubenswrapper[5120]: I0316 16:31:38.009102 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"combined-ca-bundle\"" Mar 16 16:31:38 crc kubenswrapper[5120]: I0316 16:31:38.069002 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f8b2ced8-a236-4ae1-88cd-7f14c5aee21b-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"f8b2ced8-a236-4ae1-88cd-7f14c5aee21b\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:31:38 crc kubenswrapper[5120]: I0316 16:31:38.069056 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"openstack-galera-0\" (UID: \"f8b2ced8-a236-4ae1-88cd-7f14c5aee21b\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:31:38 crc kubenswrapper[5120]: I0316 16:31:38.069077 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f8b2ced8-a236-4ae1-88cd-7f14c5aee21b-operator-scripts\") pod \"openstack-galera-0\" (UID: \"f8b2ced8-a236-4ae1-88cd-7f14c5aee21b\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:31:38 crc kubenswrapper[5120]: I0316 16:31:38.069168 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/f8b2ced8-a236-4ae1-88cd-7f14c5aee21b-kolla-config\") pod \"openstack-galera-0\" (UID: \"f8b2ced8-a236-4ae1-88cd-7f14c5aee21b\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:31:38 crc kubenswrapper[5120]: I0316 16:31:38.069207 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmjld\" (UniqueName: \"kubernetes.io/projected/f8b2ced8-a236-4ae1-88cd-7f14c5aee21b-kube-api-access-zmjld\") pod \"openstack-galera-0\" (UID: \"f8b2ced8-a236-4ae1-88cd-7f14c5aee21b\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:31:38 crc kubenswrapper[5120]: I0316 16:31:38.069267 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/f8b2ced8-a236-4ae1-88cd-7f14c5aee21b-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"f8b2ced8-a236-4ae1-88cd-7f14c5aee21b\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:31:38 crc kubenswrapper[5120]: I0316 16:31:38.069398 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/f8b2ced8-a236-4ae1-88cd-7f14c5aee21b-config-data-default\") pod \"openstack-galera-0\" (UID: \"f8b2ced8-a236-4ae1-88cd-7f14c5aee21b\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:31:38 crc kubenswrapper[5120]: I0316 16:31:38.069484 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/f8b2ced8-a236-4ae1-88cd-7f14c5aee21b-config-data-generated\") pod \"openstack-galera-0\" (UID: \"f8b2ced8-a236-4ae1-88cd-7f14c5aee21b\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:31:38 crc kubenswrapper[5120]: I0316 16:31:38.171206 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f8b2ced8-a236-4ae1-88cd-7f14c5aee21b-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"f8b2ced8-a236-4ae1-88cd-7f14c5aee21b\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:31:38 crc kubenswrapper[5120]: I0316 16:31:38.171420 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"openstack-galera-0\" (UID: \"f8b2ced8-a236-4ae1-88cd-7f14c5aee21b\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:31:38 crc kubenswrapper[5120]: I0316 16:31:38.171495 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f8b2ced8-a236-4ae1-88cd-7f14c5aee21b-operator-scripts\") pod \"openstack-galera-0\" (UID: \"f8b2ced8-a236-4ae1-88cd-7f14c5aee21b\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:31:38 crc kubenswrapper[5120]: I0316 16:31:38.171640 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/f8b2ced8-a236-4ae1-88cd-7f14c5aee21b-kolla-config\") pod \"openstack-galera-0\" (UID: \"f8b2ced8-a236-4ae1-88cd-7f14c5aee21b\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:31:38 crc kubenswrapper[5120]: I0316 16:31:38.171704 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zmjld\" (UniqueName: \"kubernetes.io/projected/f8b2ced8-a236-4ae1-88cd-7f14c5aee21b-kube-api-access-zmjld\") pod \"openstack-galera-0\" (UID: \"f8b2ced8-a236-4ae1-88cd-7f14c5aee21b\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:31:38 crc kubenswrapper[5120]: I0316 16:31:38.171850 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/f8b2ced8-a236-4ae1-88cd-7f14c5aee21b-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"f8b2ced8-a236-4ae1-88cd-7f14c5aee21b\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:31:38 crc kubenswrapper[5120]: I0316 16:31:38.171987 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/f8b2ced8-a236-4ae1-88cd-7f14c5aee21b-config-data-default\") pod \"openstack-galera-0\" (UID: \"f8b2ced8-a236-4ae1-88cd-7f14c5aee21b\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:31:38 crc kubenswrapper[5120]: I0316 16:31:38.172077 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/f8b2ced8-a236-4ae1-88cd-7f14c5aee21b-config-data-generated\") pod \"openstack-galera-0\" (UID: \"f8b2ced8-a236-4ae1-88cd-7f14c5aee21b\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:31:38 crc kubenswrapper[5120]: I0316 16:31:38.172531 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/f8b2ced8-a236-4ae1-88cd-7f14c5aee21b-config-data-generated\") pod \"openstack-galera-0\" (UID: \"f8b2ced8-a236-4ae1-88cd-7f14c5aee21b\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:31:38 crc kubenswrapper[5120]: I0316 16:31:38.171706 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"openstack-galera-0\" (UID: \"f8b2ced8-a236-4ae1-88cd-7f14c5aee21b\") device mount path \"/mnt/openstack/pv10\"" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:31:38 crc kubenswrapper[5120]: I0316 16:31:38.173138 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/f8b2ced8-a236-4ae1-88cd-7f14c5aee21b-kolla-config\") pod \"openstack-galera-0\" (UID: \"f8b2ced8-a236-4ae1-88cd-7f14c5aee21b\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:31:38 crc kubenswrapper[5120]: I0316 16:31:38.173179 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f8b2ced8-a236-4ae1-88cd-7f14c5aee21b-operator-scripts\") pod \"openstack-galera-0\" (UID: \"f8b2ced8-a236-4ae1-88cd-7f14c5aee21b\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:31:38 crc kubenswrapper[5120]: I0316 16:31:38.173991 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/f8b2ced8-a236-4ae1-88cd-7f14c5aee21b-config-data-default\") pod \"openstack-galera-0\" (UID: \"f8b2ced8-a236-4ae1-88cd-7f14c5aee21b\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:31:38 crc kubenswrapper[5120]: I0316 16:31:38.197954 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/f8b2ced8-a236-4ae1-88cd-7f14c5aee21b-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"f8b2ced8-a236-4ae1-88cd-7f14c5aee21b\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:31:38 crc kubenswrapper[5120]: I0316 16:31:38.198006 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f8b2ced8-a236-4ae1-88cd-7f14c5aee21b-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"f8b2ced8-a236-4ae1-88cd-7f14c5aee21b\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:31:38 crc kubenswrapper[5120]: I0316 16:31:38.198030 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmjld\" (UniqueName: \"kubernetes.io/projected/f8b2ced8-a236-4ae1-88cd-7f14c5aee21b-kube-api-access-zmjld\") pod \"openstack-galera-0\" (UID: \"f8b2ced8-a236-4ae1-88cd-7f14c5aee21b\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:31:38 crc kubenswrapper[5120]: I0316 16:31:38.221447 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"openstack-galera-0\" (UID: \"f8b2ced8-a236-4ae1-88cd-7f14c5aee21b\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:31:38 crc kubenswrapper[5120]: I0316 16:31:38.323682 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:31:38 crc kubenswrapper[5120]: I0316 16:31:38.645190 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"27f4616b-6d51-4cd6-bdb1-1596dccca5db","Type":"ContainerStarted","Data":"3c52ae2e0cf0d03c546a140465a963dad65f514a4b32e937e791be9544743276"} Mar 16 16:31:38 crc kubenswrapper[5120]: I0316 16:31:38.648821 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"1cd39de5-ca7d-4ed7-8052-17c5613718fc","Type":"ContainerStarted","Data":"7c7fc3b544bfbb7386466592ee272ecfebf74da460a7679279743af631928389"} Mar 16 16:31:38 crc kubenswrapper[5120]: I0316 16:31:38.773355 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 16:31:38 crc kubenswrapper[5120]: W0316 16:31:38.777819 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf8b2ced8_a236_4ae1_88cd_7f14c5aee21b.slice/crio-3695dfbb0a9b36cbd6a90e303dbb9d50b7f44c7bd02c4fb07c729f2b79def671 WatchSource:0}: Error finding container 3695dfbb0a9b36cbd6a90e303dbb9d50b7f44c7bd02c4fb07c729f2b79def671: Status 404 returned error can't find the container with id 3695dfbb0a9b36cbd6a90e303dbb9d50b7f44c7bd02c4fb07c729f2b79def671 Mar 16 16:31:39 crc kubenswrapper[5120]: I0316 16:31:39.351965 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 16:31:39 crc kubenswrapper[5120]: I0316 16:31:39.358361 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:31:39 crc kubenswrapper[5120]: I0316 16:31:39.362626 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-cell1-config-data\"" Mar 16 16:31:39 crc kubenswrapper[5120]: I0316 16:31:39.363356 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-galera-openstack-cell1-svc\"" Mar 16 16:31:39 crc kubenswrapper[5120]: I0316 16:31:39.363606 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-cell1-scripts\"" Mar 16 16:31:39 crc kubenswrapper[5120]: I0316 16:31:39.363852 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"galera-openstack-cell1-dockercfg-kxmw8\"" Mar 16 16:31:39 crc kubenswrapper[5120]: I0316 16:31:39.370578 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 16:31:39 crc kubenswrapper[5120]: I0316 16:31:39.500304 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d24d09c6-d2a8-418d-8ddf-a5e64672f554-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"d24d09c6-d2a8-418d-8ddf-a5e64672f554\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:31:39 crc kubenswrapper[5120]: I0316 16:31:39.500355 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"openstack-cell1-galera-0\" (UID: \"d24d09c6-d2a8-418d-8ddf-a5e64672f554\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:31:39 crc kubenswrapper[5120]: I0316 16:31:39.500657 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/d24d09c6-d2a8-418d-8ddf-a5e64672f554-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"d24d09c6-d2a8-418d-8ddf-a5e64672f554\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:31:39 crc kubenswrapper[5120]: I0316 16:31:39.500876 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/d24d09c6-d2a8-418d-8ddf-a5e64672f554-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"d24d09c6-d2a8-418d-8ddf-a5e64672f554\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:31:39 crc kubenswrapper[5120]: I0316 16:31:39.501024 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/d24d09c6-d2a8-418d-8ddf-a5e64672f554-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"d24d09c6-d2a8-418d-8ddf-a5e64672f554\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:31:39 crc kubenswrapper[5120]: I0316 16:31:39.501161 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d24d09c6-d2a8-418d-8ddf-a5e64672f554-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"d24d09c6-d2a8-418d-8ddf-a5e64672f554\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:31:39 crc kubenswrapper[5120]: I0316 16:31:39.501240 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/d24d09c6-d2a8-418d-8ddf-a5e64672f554-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"d24d09c6-d2a8-418d-8ddf-a5e64672f554\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:31:39 crc kubenswrapper[5120]: I0316 16:31:39.501351 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtqkz\" (UniqueName: \"kubernetes.io/projected/d24d09c6-d2a8-418d-8ddf-a5e64672f554-kube-api-access-xtqkz\") pod \"openstack-cell1-galera-0\" (UID: \"d24d09c6-d2a8-418d-8ddf-a5e64672f554\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:31:39 crc kubenswrapper[5120]: I0316 16:31:39.602863 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d24d09c6-d2a8-418d-8ddf-a5e64672f554-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"d24d09c6-d2a8-418d-8ddf-a5e64672f554\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:31:39 crc kubenswrapper[5120]: I0316 16:31:39.602925 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/d24d09c6-d2a8-418d-8ddf-a5e64672f554-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"d24d09c6-d2a8-418d-8ddf-a5e64672f554\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:31:39 crc kubenswrapper[5120]: I0316 16:31:39.602970 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xtqkz\" (UniqueName: \"kubernetes.io/projected/d24d09c6-d2a8-418d-8ddf-a5e64672f554-kube-api-access-xtqkz\") pod \"openstack-cell1-galera-0\" (UID: \"d24d09c6-d2a8-418d-8ddf-a5e64672f554\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:31:39 crc kubenswrapper[5120]: I0316 16:31:39.603031 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d24d09c6-d2a8-418d-8ddf-a5e64672f554-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"d24d09c6-d2a8-418d-8ddf-a5e64672f554\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:31:39 crc kubenswrapper[5120]: I0316 16:31:39.603051 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"openstack-cell1-galera-0\" (UID: \"d24d09c6-d2a8-418d-8ddf-a5e64672f554\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:31:39 crc kubenswrapper[5120]: I0316 16:31:39.603164 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/d24d09c6-d2a8-418d-8ddf-a5e64672f554-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"d24d09c6-d2a8-418d-8ddf-a5e64672f554\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:31:39 crc kubenswrapper[5120]: I0316 16:31:39.603227 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/d24d09c6-d2a8-418d-8ddf-a5e64672f554-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"d24d09c6-d2a8-418d-8ddf-a5e64672f554\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:31:39 crc kubenswrapper[5120]: I0316 16:31:39.603270 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/d24d09c6-d2a8-418d-8ddf-a5e64672f554-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"d24d09c6-d2a8-418d-8ddf-a5e64672f554\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:31:39 crc kubenswrapper[5120]: I0316 16:31:39.603713 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/d24d09c6-d2a8-418d-8ddf-a5e64672f554-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"d24d09c6-d2a8-418d-8ddf-a5e64672f554\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:31:39 crc kubenswrapper[5120]: I0316 16:31:39.604048 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"openstack-cell1-galera-0\" (UID: \"d24d09c6-d2a8-418d-8ddf-a5e64672f554\") device mount path \"/mnt/openstack/pv05\"" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:31:39 crc kubenswrapper[5120]: I0316 16:31:39.604721 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/d24d09c6-d2a8-418d-8ddf-a5e64672f554-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"d24d09c6-d2a8-418d-8ddf-a5e64672f554\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:31:39 crc kubenswrapper[5120]: I0316 16:31:39.604790 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d24d09c6-d2a8-418d-8ddf-a5e64672f554-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"d24d09c6-d2a8-418d-8ddf-a5e64672f554\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:31:39 crc kubenswrapper[5120]: I0316 16:31:39.606272 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/d24d09c6-d2a8-418d-8ddf-a5e64672f554-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"d24d09c6-d2a8-418d-8ddf-a5e64672f554\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:31:39 crc kubenswrapper[5120]: I0316 16:31:39.612578 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d24d09c6-d2a8-418d-8ddf-a5e64672f554-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"d24d09c6-d2a8-418d-8ddf-a5e64672f554\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:31:39 crc kubenswrapper[5120]: I0316 16:31:39.616493 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/d24d09c6-d2a8-418d-8ddf-a5e64672f554-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"d24d09c6-d2a8-418d-8ddf-a5e64672f554\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:31:39 crc kubenswrapper[5120]: I0316 16:31:39.623341 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtqkz\" (UniqueName: \"kubernetes.io/projected/d24d09c6-d2a8-418d-8ddf-a5e64672f554-kube-api-access-xtqkz\") pod \"openstack-cell1-galera-0\" (UID: \"d24d09c6-d2a8-418d-8ddf-a5e64672f554\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:31:39 crc kubenswrapper[5120]: I0316 16:31:39.627286 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"openstack-cell1-galera-0\" (UID: \"d24d09c6-d2a8-418d-8ddf-a5e64672f554\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:31:39 crc kubenswrapper[5120]: I0316 16:31:39.653519 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 16:31:39 crc kubenswrapper[5120]: I0316 16:31:39.689168 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:31:39 crc kubenswrapper[5120]: I0316 16:31:39.689374 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 16:31:39 crc kubenswrapper[5120]: I0316 16:31:39.691125 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Mar 16 16:31:39 crc kubenswrapper[5120]: I0316 16:31:39.696346 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-memcached-svc\"" Mar 16 16:31:39 crc kubenswrapper[5120]: I0316 16:31:39.696656 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"memcached-config-data\"" Mar 16 16:31:39 crc kubenswrapper[5120]: I0316 16:31:39.696890 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"memcached-memcached-dockercfg-9ts45\"" Mar 16 16:31:39 crc kubenswrapper[5120]: I0316 16:31:39.707387 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"f8b2ced8-a236-4ae1-88cd-7f14c5aee21b","Type":"ContainerStarted","Data":"a6c1668f56c4fe692eb1aabbecd9b81c11f99230ce0ca29f30ff0c69de96b354"} Mar 16 16:31:39 crc kubenswrapper[5120]: I0316 16:31:39.707430 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"f8b2ced8-a236-4ae1-88cd-7f14c5aee21b","Type":"ContainerStarted","Data":"3695dfbb0a9b36cbd6a90e303dbb9d50b7f44c7bd02c4fb07c729f2b79def671"} Mar 16 16:31:39 crc kubenswrapper[5120]: I0316 16:31:39.806558 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9998e1ac-8e55-4be8-8b49-ff3f7434b699-combined-ca-bundle\") pod \"memcached-0\" (UID: \"9998e1ac-8e55-4be8-8b49-ff3f7434b699\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:31:39 crc kubenswrapper[5120]: I0316 16:31:39.806724 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/9998e1ac-8e55-4be8-8b49-ff3f7434b699-memcached-tls-certs\") pod \"memcached-0\" (UID: \"9998e1ac-8e55-4be8-8b49-ff3f7434b699\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:31:39 crc kubenswrapper[5120]: I0316 16:31:39.806861 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/9998e1ac-8e55-4be8-8b49-ff3f7434b699-kolla-config\") pod \"memcached-0\" (UID: \"9998e1ac-8e55-4be8-8b49-ff3f7434b699\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:31:39 crc kubenswrapper[5120]: I0316 16:31:39.807068 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/9998e1ac-8e55-4be8-8b49-ff3f7434b699-config-data\") pod \"memcached-0\" (UID: \"9998e1ac-8e55-4be8-8b49-ff3f7434b699\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:31:39 crc kubenswrapper[5120]: I0316 16:31:39.807098 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2df6n\" (UniqueName: \"kubernetes.io/projected/9998e1ac-8e55-4be8-8b49-ff3f7434b699-kube-api-access-2df6n\") pod \"memcached-0\" (UID: \"9998e1ac-8e55-4be8-8b49-ff3f7434b699\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:31:39 crc kubenswrapper[5120]: I0316 16:31:39.908505 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/9998e1ac-8e55-4be8-8b49-ff3f7434b699-config-data\") pod \"memcached-0\" (UID: \"9998e1ac-8e55-4be8-8b49-ff3f7434b699\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:31:39 crc kubenswrapper[5120]: I0316 16:31:39.908551 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2df6n\" (UniqueName: \"kubernetes.io/projected/9998e1ac-8e55-4be8-8b49-ff3f7434b699-kube-api-access-2df6n\") pod \"memcached-0\" (UID: \"9998e1ac-8e55-4be8-8b49-ff3f7434b699\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:31:39 crc kubenswrapper[5120]: I0316 16:31:39.908655 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9998e1ac-8e55-4be8-8b49-ff3f7434b699-combined-ca-bundle\") pod \"memcached-0\" (UID: \"9998e1ac-8e55-4be8-8b49-ff3f7434b699\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:31:39 crc kubenswrapper[5120]: I0316 16:31:39.908717 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/9998e1ac-8e55-4be8-8b49-ff3f7434b699-memcached-tls-certs\") pod \"memcached-0\" (UID: \"9998e1ac-8e55-4be8-8b49-ff3f7434b699\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:31:39 crc kubenswrapper[5120]: I0316 16:31:39.908785 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/9998e1ac-8e55-4be8-8b49-ff3f7434b699-kolla-config\") pod \"memcached-0\" (UID: \"9998e1ac-8e55-4be8-8b49-ff3f7434b699\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:31:39 crc kubenswrapper[5120]: I0316 16:31:39.909661 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/9998e1ac-8e55-4be8-8b49-ff3f7434b699-kolla-config\") pod \"memcached-0\" (UID: \"9998e1ac-8e55-4be8-8b49-ff3f7434b699\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:31:39 crc kubenswrapper[5120]: I0316 16:31:39.909798 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/9998e1ac-8e55-4be8-8b49-ff3f7434b699-config-data\") pod \"memcached-0\" (UID: \"9998e1ac-8e55-4be8-8b49-ff3f7434b699\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:31:39 crc kubenswrapper[5120]: I0316 16:31:39.914295 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9998e1ac-8e55-4be8-8b49-ff3f7434b699-combined-ca-bundle\") pod \"memcached-0\" (UID: \"9998e1ac-8e55-4be8-8b49-ff3f7434b699\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:31:39 crc kubenswrapper[5120]: I0316 16:31:39.917210 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/9998e1ac-8e55-4be8-8b49-ff3f7434b699-memcached-tls-certs\") pod \"memcached-0\" (UID: \"9998e1ac-8e55-4be8-8b49-ff3f7434b699\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:31:39 crc kubenswrapper[5120]: I0316 16:31:39.925594 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2df6n\" (UniqueName: \"kubernetes.io/projected/9998e1ac-8e55-4be8-8b49-ff3f7434b699-kube-api-access-2df6n\") pod \"memcached-0\" (UID: \"9998e1ac-8e55-4be8-8b49-ff3f7434b699\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:31:40 crc kubenswrapper[5120]: I0316 16:31:40.044439 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Mar 16 16:31:40 crc kubenswrapper[5120]: I0316 16:31:40.138870 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 16:31:40 crc kubenswrapper[5120]: W0316 16:31:40.156953 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd24d09c6_d2a8_418d_8ddf_a5e64672f554.slice/crio-314a82fa6f173fea0c6644ca1242d60b1dccb681f17ee341ba54334eb9d89328 WatchSource:0}: Error finding container 314a82fa6f173fea0c6644ca1242d60b1dccb681f17ee341ba54334eb9d89328: Status 404 returned error can't find the container with id 314a82fa6f173fea0c6644ca1242d60b1dccb681f17ee341ba54334eb9d89328 Mar 16 16:31:40 crc kubenswrapper[5120]: I0316 16:31:40.472949 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 16:31:40 crc kubenswrapper[5120]: W0316 16:31:40.473136 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9998e1ac_8e55_4be8_8b49_ff3f7434b699.slice/crio-37a093355c6f041de9ec50749bf505e0d7752f099e879b011e1dfe9368f83661 WatchSource:0}: Error finding container 37a093355c6f041de9ec50749bf505e0d7752f099e879b011e1dfe9368f83661: Status 404 returned error can't find the container with id 37a093355c6f041de9ec50749bf505e0d7752f099e879b011e1dfe9368f83661 Mar 16 16:31:40 crc kubenswrapper[5120]: I0316 16:31:40.715137 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"d24d09c6-d2a8-418d-8ddf-a5e64672f554","Type":"ContainerStarted","Data":"b454ba7ff6358569221d35993b9f7e68c71c2f5fbecd5354108cf5d5b7d3a428"} Mar 16 16:31:40 crc kubenswrapper[5120]: I0316 16:31:40.715881 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"d24d09c6-d2a8-418d-8ddf-a5e64672f554","Type":"ContainerStarted","Data":"314a82fa6f173fea0c6644ca1242d60b1dccb681f17ee341ba54334eb9d89328"} Mar 16 16:31:40 crc kubenswrapper[5120]: I0316 16:31:40.716682 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"9998e1ac-8e55-4be8-8b49-ff3f7434b699","Type":"ContainerStarted","Data":"feaf6123410f7a55102df33a09bc007e0934725d3b55bc9552638bb6be54ab98"} Mar 16 16:31:40 crc kubenswrapper[5120]: I0316 16:31:40.716732 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"9998e1ac-8e55-4be8-8b49-ff3f7434b699","Type":"ContainerStarted","Data":"37a093355c6f041de9ec50749bf505e0d7752f099e879b011e1dfe9368f83661"} Mar 16 16:31:40 crc kubenswrapper[5120]: I0316 16:31:40.716837 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/memcached-0" Mar 16 16:31:40 crc kubenswrapper[5120]: I0316 16:31:40.753508 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/memcached-0" podStartSLOduration=1.753490633 podStartE2EDuration="1.753490633s" podCreationTimestamp="2026-03-16 16:31:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:31:40.751172422 +0000 UTC m=+3602.905104089" watchObservedRunningTime="2026-03-16 16:31:40.753490633 +0000 UTC m=+3602.907422290" Mar 16 16:31:41 crc kubenswrapper[5120]: I0316 16:31:41.797101 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 16:31:41 crc kubenswrapper[5120]: I0316 16:31:41.807204 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 16:31:41 crc kubenswrapper[5120]: I0316 16:31:41.807333 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:31:41 crc kubenswrapper[5120]: I0316 16:31:41.809651 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"telemetry-ceilometer-dockercfg-9mgvk\"" Mar 16 16:31:41 crc kubenswrapper[5120]: I0316 16:31:41.949741 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gr6zn\" (UniqueName: \"kubernetes.io/projected/5af6cf0b-bf71-4453-ba3e-ab4016bc58cb-kube-api-access-gr6zn\") pod \"kube-state-metrics-0\" (UID: \"5af6cf0b-bf71-4453-ba3e-ab4016bc58cb\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:31:42 crc kubenswrapper[5120]: I0316 16:31:42.051381 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gr6zn\" (UniqueName: \"kubernetes.io/projected/5af6cf0b-bf71-4453-ba3e-ab4016bc58cb-kube-api-access-gr6zn\") pod \"kube-state-metrics-0\" (UID: \"5af6cf0b-bf71-4453-ba3e-ab4016bc58cb\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:31:42 crc kubenswrapper[5120]: I0316 16:31:42.094360 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gr6zn\" (UniqueName: \"kubernetes.io/projected/5af6cf0b-bf71-4453-ba3e-ab4016bc58cb-kube-api-access-gr6zn\") pod \"kube-state-metrics-0\" (UID: \"5af6cf0b-bf71-4453-ba3e-ab4016bc58cb\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:31:42 crc kubenswrapper[5120]: I0316 16:31:42.136176 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:31:42 crc kubenswrapper[5120]: I0316 16:31:42.598268 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 16:31:42 crc kubenswrapper[5120]: I0316 16:31:42.731635 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"5af6cf0b-bf71-4453-ba3e-ab4016bc58cb","Type":"ContainerStarted","Data":"a876c8fded14b3f4ac5a66b84d60aef3778ae4a4650f70f38188974d86e264bc"} Mar 16 16:31:42 crc kubenswrapper[5120]: I0316 16:31:42.733363 5120 generic.go:358] "Generic (PLEG): container finished" podID="f8b2ced8-a236-4ae1-88cd-7f14c5aee21b" containerID="a6c1668f56c4fe692eb1aabbecd9b81c11f99230ce0ca29f30ff0c69de96b354" exitCode=0 Mar 16 16:31:42 crc kubenswrapper[5120]: I0316 16:31:42.733389 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"f8b2ced8-a236-4ae1-88cd-7f14c5aee21b","Type":"ContainerDied","Data":"a6c1668f56c4fe692eb1aabbecd9b81c11f99230ce0ca29f30ff0c69de96b354"} Mar 16 16:31:43 crc kubenswrapper[5120]: I0316 16:31:43.742103 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"f8b2ced8-a236-4ae1-88cd-7f14c5aee21b","Type":"ContainerStarted","Data":"a6da655c3ab3c081a862ed09a600b2b898335b09cbe7c305e5bbc8934c874f4b"} Mar 16 16:31:43 crc kubenswrapper[5120]: I0316 16:31:43.745332 5120 generic.go:358] "Generic (PLEG): container finished" podID="d24d09c6-d2a8-418d-8ddf-a5e64672f554" containerID="b454ba7ff6358569221d35993b9f7e68c71c2f5fbecd5354108cf5d5b7d3a428" exitCode=0 Mar 16 16:31:43 crc kubenswrapper[5120]: I0316 16:31:43.745384 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"d24d09c6-d2a8-418d-8ddf-a5e64672f554","Type":"ContainerDied","Data":"b454ba7ff6358569221d35993b9f7e68c71c2f5fbecd5354108cf5d5b7d3a428"} Mar 16 16:31:43 crc kubenswrapper[5120]: I0316 16:31:43.777075 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstack-galera-0" podStartSLOduration=7.777055712 podStartE2EDuration="7.777055712s" podCreationTimestamp="2026-03-16 16:31:36 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:31:43.759240107 +0000 UTC m=+3605.913171784" watchObservedRunningTime="2026-03-16 16:31:43.777055712 +0000 UTC m=+3605.930987369" Mar 16 16:31:44 crc kubenswrapper[5120]: I0316 16:31:44.756374 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"d24d09c6-d2a8-418d-8ddf-a5e64672f554","Type":"ContainerStarted","Data":"da18e02e60563fdf4b993a489a08f0afac75c00cbf47e05276bd0256d2e32f2c"} Mar 16 16:31:44 crc kubenswrapper[5120]: I0316 16:31:44.758145 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"5af6cf0b-bf71-4453-ba3e-ab4016bc58cb","Type":"ContainerStarted","Data":"db1f9c8dfa0a470e347e0af019f978f1af994f2b39341dcf82591bee56315ee5"} Mar 16 16:31:44 crc kubenswrapper[5120]: I0316 16:31:44.758221 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:31:44 crc kubenswrapper[5120]: I0316 16:31:44.783643 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstack-cell1-galera-0" podStartSLOduration=6.783623868 podStartE2EDuration="6.783623868s" podCreationTimestamp="2026-03-16 16:31:38 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:31:44.777215771 +0000 UTC m=+3606.931147428" watchObservedRunningTime="2026-03-16 16:31:44.783623868 +0000 UTC m=+3606.937555525" Mar 16 16:31:44 crc kubenswrapper[5120]: I0316 16:31:44.796921 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/kube-state-metrics-0" podStartSLOduration=2.798643118 podStartE2EDuration="3.796884886s" podCreationTimestamp="2026-03-16 16:31:41 +0000 UTC" firstStartedPulling="2026-03-16 16:31:42.599644067 +0000 UTC m=+3604.753575724" lastFinishedPulling="2026-03-16 16:31:43.597885835 +0000 UTC m=+3605.751817492" observedRunningTime="2026-03-16 16:31:44.790726894 +0000 UTC m=+3606.944658561" watchObservedRunningTime="2026-03-16 16:31:44.796884886 +0000 UTC m=+3606.950816543" Mar 16 16:31:44 crc kubenswrapper[5120]: I0316 16:31:44.912348 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-v822j_ac55471d-4e42-475f-a082-50f611571482/kube-multus/0.log" Mar 16 16:31:44 crc kubenswrapper[5120]: I0316 16:31:44.913573 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-v822j_ac55471d-4e42-475f-a082-50f611571482/kube-multus/0.log" Mar 16 16:31:44 crc kubenswrapper[5120]: I0316 16:31:44.917740 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-crc_9f0bc7fcb0822a2c13eb2d22cd8c0641/kube-controller-manager/0.log" Mar 16 16:31:44 crc kubenswrapper[5120]: I0316 16:31:44.918512 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-crc_9f0bc7fcb0822a2c13eb2d22cd8c0641/kube-controller-manager/0.log" Mar 16 16:31:45 crc kubenswrapper[5120]: I0316 16:31:45.431050 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 16:31:45 crc kubenswrapper[5120]: I0316 16:31:45.441990 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:31:45 crc kubenswrapper[5120]: I0316 16:31:45.444605 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovndbcluster-nb-config\"" Mar 16 16:31:45 crc kubenswrapper[5120]: I0316 16:31:45.444741 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovndbcluster-nb-scripts\"" Mar 16 16:31:45 crc kubenswrapper[5120]: I0316 16:31:45.446366 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ovncluster-ovndbcluster-nb-dockercfg-648qh\"" Mar 16 16:31:45 crc kubenswrapper[5120]: I0316 16:31:45.446580 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ovndbcluster-nb-ovndbs\"" Mar 16 16:31:45 crc kubenswrapper[5120]: I0316 16:31:45.446662 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 16:31:45 crc kubenswrapper[5120]: I0316 16:31:45.447286 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ovn-metrics\"" Mar 16 16:31:45 crc kubenswrapper[5120]: I0316 16:31:45.524360 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4e17300c-81c6-4f7f-a4ae-4e3e04e27bc2-config\") pod \"ovsdbserver-nb-0\" (UID: \"4e17300c-81c6-4f7f-a4ae-4e3e04e27bc2\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:31:45 crc kubenswrapper[5120]: I0316 16:31:45.524461 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjkqf\" (UniqueName: \"kubernetes.io/projected/4e17300c-81c6-4f7f-a4ae-4e3e04e27bc2-kube-api-access-cjkqf\") pod \"ovsdbserver-nb-0\" (UID: \"4e17300c-81c6-4f7f-a4ae-4e3e04e27bc2\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:31:45 crc kubenswrapper[5120]: I0316 16:31:45.524596 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4e17300c-81c6-4f7f-a4ae-4e3e04e27bc2-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"4e17300c-81c6-4f7f-a4ae-4e3e04e27bc2\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:31:45 crc kubenswrapper[5120]: I0316 16:31:45.524645 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"ovsdbserver-nb-0\" (UID: \"4e17300c-81c6-4f7f-a4ae-4e3e04e27bc2\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:31:45 crc kubenswrapper[5120]: I0316 16:31:45.524775 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/4e17300c-81c6-4f7f-a4ae-4e3e04e27bc2-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"4e17300c-81c6-4f7f-a4ae-4e3e04e27bc2\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:31:45 crc kubenswrapper[5120]: I0316 16:31:45.524886 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/4e17300c-81c6-4f7f-a4ae-4e3e04e27bc2-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"4e17300c-81c6-4f7f-a4ae-4e3e04e27bc2\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:31:45 crc kubenswrapper[5120]: I0316 16:31:45.524970 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/4e17300c-81c6-4f7f-a4ae-4e3e04e27bc2-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"4e17300c-81c6-4f7f-a4ae-4e3e04e27bc2\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:31:45 crc kubenswrapper[5120]: I0316 16:31:45.525055 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/4e17300c-81c6-4f7f-a4ae-4e3e04e27bc2-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"4e17300c-81c6-4f7f-a4ae-4e3e04e27bc2\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:31:45 crc kubenswrapper[5120]: I0316 16:31:45.627850 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/4e17300c-81c6-4f7f-a4ae-4e3e04e27bc2-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"4e17300c-81c6-4f7f-a4ae-4e3e04e27bc2\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:31:45 crc kubenswrapper[5120]: I0316 16:31:45.628004 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/4e17300c-81c6-4f7f-a4ae-4e3e04e27bc2-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"4e17300c-81c6-4f7f-a4ae-4e3e04e27bc2\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:31:45 crc kubenswrapper[5120]: I0316 16:31:45.628105 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/4e17300c-81c6-4f7f-a4ae-4e3e04e27bc2-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"4e17300c-81c6-4f7f-a4ae-4e3e04e27bc2\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:31:45 crc kubenswrapper[5120]: I0316 16:31:45.628574 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/4e17300c-81c6-4f7f-a4ae-4e3e04e27bc2-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"4e17300c-81c6-4f7f-a4ae-4e3e04e27bc2\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:31:45 crc kubenswrapper[5120]: I0316 16:31:45.628633 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4e17300c-81c6-4f7f-a4ae-4e3e04e27bc2-config\") pod \"ovsdbserver-nb-0\" (UID: \"4e17300c-81c6-4f7f-a4ae-4e3e04e27bc2\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:31:45 crc kubenswrapper[5120]: I0316 16:31:45.628733 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cjkqf\" (UniqueName: \"kubernetes.io/projected/4e17300c-81c6-4f7f-a4ae-4e3e04e27bc2-kube-api-access-cjkqf\") pod \"ovsdbserver-nb-0\" (UID: \"4e17300c-81c6-4f7f-a4ae-4e3e04e27bc2\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:31:45 crc kubenswrapper[5120]: I0316 16:31:45.628844 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4e17300c-81c6-4f7f-a4ae-4e3e04e27bc2-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"4e17300c-81c6-4f7f-a4ae-4e3e04e27bc2\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:31:45 crc kubenswrapper[5120]: I0316 16:31:45.628886 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"ovsdbserver-nb-0\" (UID: \"4e17300c-81c6-4f7f-a4ae-4e3e04e27bc2\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:31:45 crc kubenswrapper[5120]: I0316 16:31:45.629014 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/4e17300c-81c6-4f7f-a4ae-4e3e04e27bc2-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"4e17300c-81c6-4f7f-a4ae-4e3e04e27bc2\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:31:45 crc kubenswrapper[5120]: I0316 16:31:45.629271 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"ovsdbserver-nb-0\" (UID: \"4e17300c-81c6-4f7f-a4ae-4e3e04e27bc2\") device mount path \"/mnt/openstack/pv12\"" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:31:45 crc kubenswrapper[5120]: I0316 16:31:45.629486 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4e17300c-81c6-4f7f-a4ae-4e3e04e27bc2-config\") pod \"ovsdbserver-nb-0\" (UID: \"4e17300c-81c6-4f7f-a4ae-4e3e04e27bc2\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:31:45 crc kubenswrapper[5120]: I0316 16:31:45.629661 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/4e17300c-81c6-4f7f-a4ae-4e3e04e27bc2-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"4e17300c-81c6-4f7f-a4ae-4e3e04e27bc2\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:31:45 crc kubenswrapper[5120]: I0316 16:31:45.634482 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/4e17300c-81c6-4f7f-a4ae-4e3e04e27bc2-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"4e17300c-81c6-4f7f-a4ae-4e3e04e27bc2\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:31:45 crc kubenswrapper[5120]: I0316 16:31:45.638589 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/4e17300c-81c6-4f7f-a4ae-4e3e04e27bc2-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"4e17300c-81c6-4f7f-a4ae-4e3e04e27bc2\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:31:45 crc kubenswrapper[5120]: I0316 16:31:45.638698 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4e17300c-81c6-4f7f-a4ae-4e3e04e27bc2-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"4e17300c-81c6-4f7f-a4ae-4e3e04e27bc2\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:31:45 crc kubenswrapper[5120]: I0316 16:31:45.652804 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjkqf\" (UniqueName: \"kubernetes.io/projected/4e17300c-81c6-4f7f-a4ae-4e3e04e27bc2-kube-api-access-cjkqf\") pod \"ovsdbserver-nb-0\" (UID: \"4e17300c-81c6-4f7f-a4ae-4e3e04e27bc2\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:31:45 crc kubenswrapper[5120]: I0316 16:31:45.662348 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"ovsdbserver-nb-0\" (UID: \"4e17300c-81c6-4f7f-a4ae-4e3e04e27bc2\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:31:45 crc kubenswrapper[5120]: I0316 16:31:45.764849 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:31:46 crc kubenswrapper[5120]: I0316 16:31:46.231590 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 16:31:46 crc kubenswrapper[5120]: I0316 16:31:46.725934 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/memcached-0" Mar 16 16:31:46 crc kubenswrapper[5120]: I0316 16:31:46.777292 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"4e17300c-81c6-4f7f-a4ae-4e3e04e27bc2","Type":"ContainerStarted","Data":"1c712f1ab4a4bf6db5d6a3ef760d82aab111911989481abe53cf8716a0fae5f5"} Mar 16 16:31:46 crc kubenswrapper[5120]: I0316 16:31:46.777334 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"4e17300c-81c6-4f7f-a4ae-4e3e04e27bc2","Type":"ContainerStarted","Data":"bb4b7b2d023f41d825191da2f6b23e84c1c5f2e32e37e7b1e1677ac812bbde7c"} Mar 16 16:31:46 crc kubenswrapper[5120]: I0316 16:31:46.777345 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"4e17300c-81c6-4f7f-a4ae-4e3e04e27bc2","Type":"ContainerStarted","Data":"159fe5bebe454d952ad06d8e017b115904c959cc27e4b58ed9cc612d9f866c55"} Mar 16 16:31:46 crc kubenswrapper[5120]: I0316 16:31:46.799301 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podStartSLOduration=2.799281937 podStartE2EDuration="2.799281937s" podCreationTimestamp="2026-03-16 16:31:44 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:31:46.797418919 +0000 UTC m=+3608.951350586" watchObservedRunningTime="2026-03-16 16:31:46.799281937 +0000 UTC m=+3608.953213594" Mar 16 16:31:47 crc kubenswrapper[5120]: I0316 16:31:47.776283 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 16:31:47 crc kubenswrapper[5120]: I0316 16:31:47.781653 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:31:47 crc kubenswrapper[5120]: I0316 16:31:47.785899 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ovncluster-ovndbcluster-sb-dockercfg-8s25s\"" Mar 16 16:31:47 crc kubenswrapper[5120]: I0316 16:31:47.786256 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovndbcluster-sb-config\"" Mar 16 16:31:47 crc kubenswrapper[5120]: I0316 16:31:47.786475 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovndbcluster-sb-scripts\"" Mar 16 16:31:47 crc kubenswrapper[5120]: I0316 16:31:47.787673 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ovndbcluster-sb-ovndbs\"" Mar 16 16:31:47 crc kubenswrapper[5120]: I0316 16:31:47.797497 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 16:31:47 crc kubenswrapper[5120]: I0316 16:31:47.869672 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0bcb2925-74a9-4e24-b7bc-a6e5bf665e85-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"0bcb2925-74a9-4e24-b7bc-a6e5bf665e85\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:31:47 crc kubenswrapper[5120]: I0316 16:31:47.869789 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/0bcb2925-74a9-4e24-b7bc-a6e5bf665e85-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"0bcb2925-74a9-4e24-b7bc-a6e5bf665e85\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:31:47 crc kubenswrapper[5120]: I0316 16:31:47.869825 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/0bcb2925-74a9-4e24-b7bc-a6e5bf665e85-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"0bcb2925-74a9-4e24-b7bc-a6e5bf665e85\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:31:47 crc kubenswrapper[5120]: I0316 16:31:47.869886 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/0bcb2925-74a9-4e24-b7bc-a6e5bf665e85-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"0bcb2925-74a9-4e24-b7bc-a6e5bf665e85\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:31:47 crc kubenswrapper[5120]: I0316 16:31:47.870165 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/0bcb2925-74a9-4e24-b7bc-a6e5bf665e85-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"0bcb2925-74a9-4e24-b7bc-a6e5bf665e85\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:31:47 crc kubenswrapper[5120]: I0316 16:31:47.870205 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0bcb2925-74a9-4e24-b7bc-a6e5bf665e85-config\") pod \"ovsdbserver-sb-0\" (UID: \"0bcb2925-74a9-4e24-b7bc-a6e5bf665e85\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:31:47 crc kubenswrapper[5120]: I0316 16:31:47.870314 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bk5fr\" (UniqueName: \"kubernetes.io/projected/0bcb2925-74a9-4e24-b7bc-a6e5bf665e85-kube-api-access-bk5fr\") pod \"ovsdbserver-sb-0\" (UID: \"0bcb2925-74a9-4e24-b7bc-a6e5bf665e85\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:31:47 crc kubenswrapper[5120]: I0316 16:31:47.870692 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"ovsdbserver-sb-0\" (UID: \"0bcb2925-74a9-4e24-b7bc-a6e5bf665e85\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:31:47 crc kubenswrapper[5120]: I0316 16:31:47.972562 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bk5fr\" (UniqueName: \"kubernetes.io/projected/0bcb2925-74a9-4e24-b7bc-a6e5bf665e85-kube-api-access-bk5fr\") pod \"ovsdbserver-sb-0\" (UID: \"0bcb2925-74a9-4e24-b7bc-a6e5bf665e85\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:31:47 crc kubenswrapper[5120]: I0316 16:31:47.972638 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"ovsdbserver-sb-0\" (UID: \"0bcb2925-74a9-4e24-b7bc-a6e5bf665e85\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:31:47 crc kubenswrapper[5120]: I0316 16:31:47.973095 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0bcb2925-74a9-4e24-b7bc-a6e5bf665e85-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"0bcb2925-74a9-4e24-b7bc-a6e5bf665e85\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:31:47 crc kubenswrapper[5120]: I0316 16:31:47.973161 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"ovsdbserver-sb-0\" (UID: \"0bcb2925-74a9-4e24-b7bc-a6e5bf665e85\") device mount path \"/mnt/openstack/pv04\"" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:31:47 crc kubenswrapper[5120]: I0316 16:31:47.974127 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/0bcb2925-74a9-4e24-b7bc-a6e5bf665e85-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"0bcb2925-74a9-4e24-b7bc-a6e5bf665e85\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:31:47 crc kubenswrapper[5120]: I0316 16:31:47.974163 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/0bcb2925-74a9-4e24-b7bc-a6e5bf665e85-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"0bcb2925-74a9-4e24-b7bc-a6e5bf665e85\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:31:47 crc kubenswrapper[5120]: I0316 16:31:47.974211 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/0bcb2925-74a9-4e24-b7bc-a6e5bf665e85-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"0bcb2925-74a9-4e24-b7bc-a6e5bf665e85\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:31:47 crc kubenswrapper[5120]: I0316 16:31:47.974430 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/0bcb2925-74a9-4e24-b7bc-a6e5bf665e85-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"0bcb2925-74a9-4e24-b7bc-a6e5bf665e85\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:31:47 crc kubenswrapper[5120]: I0316 16:31:47.974559 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0bcb2925-74a9-4e24-b7bc-a6e5bf665e85-config\") pod \"ovsdbserver-sb-0\" (UID: \"0bcb2925-74a9-4e24-b7bc-a6e5bf665e85\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:31:47 crc kubenswrapper[5120]: I0316 16:31:47.974594 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/0bcb2925-74a9-4e24-b7bc-a6e5bf665e85-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"0bcb2925-74a9-4e24-b7bc-a6e5bf665e85\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:31:47 crc kubenswrapper[5120]: I0316 16:31:47.975568 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/0bcb2925-74a9-4e24-b7bc-a6e5bf665e85-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"0bcb2925-74a9-4e24-b7bc-a6e5bf665e85\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:31:47 crc kubenswrapper[5120]: I0316 16:31:47.975727 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0bcb2925-74a9-4e24-b7bc-a6e5bf665e85-config\") pod \"ovsdbserver-sb-0\" (UID: \"0bcb2925-74a9-4e24-b7bc-a6e5bf665e85\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:31:47 crc kubenswrapper[5120]: I0316 16:31:47.980242 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/0bcb2925-74a9-4e24-b7bc-a6e5bf665e85-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"0bcb2925-74a9-4e24-b7bc-a6e5bf665e85\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:31:47 crc kubenswrapper[5120]: I0316 16:31:47.980605 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0bcb2925-74a9-4e24-b7bc-a6e5bf665e85-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"0bcb2925-74a9-4e24-b7bc-a6e5bf665e85\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:31:47 crc kubenswrapper[5120]: I0316 16:31:47.981576 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/0bcb2925-74a9-4e24-b7bc-a6e5bf665e85-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"0bcb2925-74a9-4e24-b7bc-a6e5bf665e85\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:31:47 crc kubenswrapper[5120]: I0316 16:31:47.992976 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bk5fr\" (UniqueName: \"kubernetes.io/projected/0bcb2925-74a9-4e24-b7bc-a6e5bf665e85-kube-api-access-bk5fr\") pod \"ovsdbserver-sb-0\" (UID: \"0bcb2925-74a9-4e24-b7bc-a6e5bf665e85\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:31:47 crc kubenswrapper[5120]: I0316 16:31:47.998576 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"ovsdbserver-sb-0\" (UID: \"0bcb2925-74a9-4e24-b7bc-a6e5bf665e85\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:31:48 crc kubenswrapper[5120]: I0316 16:31:48.111124 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:31:48 crc kubenswrapper[5120]: I0316 16:31:48.325192 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:31:48 crc kubenswrapper[5120]: I0316 16:31:48.325752 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:31:48 crc kubenswrapper[5120]: I0316 16:31:48.543417 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 16:31:48 crc kubenswrapper[5120]: I0316 16:31:48.765603 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:31:48 crc kubenswrapper[5120]: I0316 16:31:48.798878 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"0bcb2925-74a9-4e24-b7bc-a6e5bf665e85","Type":"ContainerStarted","Data":"29dab27e446b0853e54b0515784441c770aa038f9edc982a5d8d601206692ff9"} Mar 16 16:31:48 crc kubenswrapper[5120]: I0316 16:31:48.798932 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"0bcb2925-74a9-4e24-b7bc-a6e5bf665e85","Type":"ContainerStarted","Data":"7c25b55c8d2a002fe32d7985ae3d99c930d47eab5fedd9af04ad31f7824809de"} Mar 16 16:31:49 crc kubenswrapper[5120]: I0316 16:31:49.689909 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:31:49 crc kubenswrapper[5120]: I0316 16:31:49.690166 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:31:49 crc kubenswrapper[5120]: I0316 16:31:49.809957 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"0bcb2925-74a9-4e24-b7bc-a6e5bf665e85","Type":"ContainerStarted","Data":"043def99c65b5ced43f64fecfe74484bb82998b03aaf4b66e3b2c0cf56a692a5"} Mar 16 16:31:49 crc kubenswrapper[5120]: I0316 16:31:49.840597 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podStartSLOduration=3.840574951 podStartE2EDuration="3.840574951s" podCreationTimestamp="2026-03-16 16:31:46 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:31:49.830241581 +0000 UTC m=+3611.984173258" watchObservedRunningTime="2026-03-16 16:31:49.840574951 +0000 UTC m=+3611.994506598" Mar 16 16:31:50 crc kubenswrapper[5120]: I0316 16:31:50.605396 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:31:50 crc kubenswrapper[5120]: I0316 16:31:50.681483 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:31:50 crc kubenswrapper[5120]: I0316 16:31:50.765872 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:31:51 crc kubenswrapper[5120]: I0316 16:31:51.039704 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-db-create-55rq8"] Mar 16 16:31:51 crc kubenswrapper[5120]: I0316 16:31:51.048892 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-create-55rq8" Mar 16 16:31:51 crc kubenswrapper[5120]: I0316 16:31:51.053826 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-db-create-55rq8"] Mar 16 16:31:51 crc kubenswrapper[5120]: I0316 16:31:51.111993 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:31:51 crc kubenswrapper[5120]: I0316 16:31:51.141515 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-e1fd-account-create-update-bp9s5"] Mar 16 16:31:51 crc kubenswrapper[5120]: I0316 16:31:51.142573 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ee35bceb-0e83-4ec9-8592-e6f6a3a630ac-operator-scripts\") pod \"keystone-db-create-55rq8\" (UID: \"ee35bceb-0e83-4ec9-8592-e6f6a3a630ac\") " pod="openstack-kuttl-tests/keystone-db-create-55rq8" Mar 16 16:31:51 crc kubenswrapper[5120]: I0316 16:31:51.142766 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qk6d8\" (UniqueName: \"kubernetes.io/projected/ee35bceb-0e83-4ec9-8592-e6f6a3a630ac-kube-api-access-qk6d8\") pod \"keystone-db-create-55rq8\" (UID: \"ee35bceb-0e83-4ec9-8592-e6f6a3a630ac\") " pod="openstack-kuttl-tests/keystone-db-create-55rq8" Mar 16 16:31:51 crc kubenswrapper[5120]: I0316 16:31:51.147690 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-e1fd-account-create-update-bp9s5" Mar 16 16:31:51 crc kubenswrapper[5120]: I0316 16:31:51.152209 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-db-secret\"" Mar 16 16:31:51 crc kubenswrapper[5120]: I0316 16:31:51.154487 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:31:51 crc kubenswrapper[5120]: I0316 16:31:51.156214 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-e1fd-account-create-update-bp9s5"] Mar 16 16:31:51 crc kubenswrapper[5120]: I0316 16:31:51.244663 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-db-create-ghhn6"] Mar 16 16:31:51 crc kubenswrapper[5120]: I0316 16:31:51.245253 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/cabe287f-9672-4e34-a32e-20211d186718-operator-scripts\") pod \"keystone-e1fd-account-create-update-bp9s5\" (UID: \"cabe287f-9672-4e34-a32e-20211d186718\") " pod="openstack-kuttl-tests/keystone-e1fd-account-create-update-bp9s5" Mar 16 16:31:51 crc kubenswrapper[5120]: I0316 16:31:51.245322 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hflll\" (UniqueName: \"kubernetes.io/projected/cabe287f-9672-4e34-a32e-20211d186718-kube-api-access-hflll\") pod \"keystone-e1fd-account-create-update-bp9s5\" (UID: \"cabe287f-9672-4e34-a32e-20211d186718\") " pod="openstack-kuttl-tests/keystone-e1fd-account-create-update-bp9s5" Mar 16 16:31:51 crc kubenswrapper[5120]: I0316 16:31:51.245443 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ee35bceb-0e83-4ec9-8592-e6f6a3a630ac-operator-scripts\") pod \"keystone-db-create-55rq8\" (UID: \"ee35bceb-0e83-4ec9-8592-e6f6a3a630ac\") " pod="openstack-kuttl-tests/keystone-db-create-55rq8" Mar 16 16:31:51 crc kubenswrapper[5120]: I0316 16:31:51.245493 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qk6d8\" (UniqueName: \"kubernetes.io/projected/ee35bceb-0e83-4ec9-8592-e6f6a3a630ac-kube-api-access-qk6d8\") pod \"keystone-db-create-55rq8\" (UID: \"ee35bceb-0e83-4ec9-8592-e6f6a3a630ac\") " pod="openstack-kuttl-tests/keystone-db-create-55rq8" Mar 16 16:31:51 crc kubenswrapper[5120]: I0316 16:31:51.246863 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ee35bceb-0e83-4ec9-8592-e6f6a3a630ac-operator-scripts\") pod \"keystone-db-create-55rq8\" (UID: \"ee35bceb-0e83-4ec9-8592-e6f6a3a630ac\") " pod="openstack-kuttl-tests/keystone-db-create-55rq8" Mar 16 16:31:51 crc kubenswrapper[5120]: I0316 16:31:51.251915 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-create-ghhn6" Mar 16 16:31:51 crc kubenswrapper[5120]: I0316 16:31:51.257156 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-db-create-ghhn6"] Mar 16 16:31:51 crc kubenswrapper[5120]: I0316 16:31:51.270510 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qk6d8\" (UniqueName: \"kubernetes.io/projected/ee35bceb-0e83-4ec9-8592-e6f6a3a630ac-kube-api-access-qk6d8\") pod \"keystone-db-create-55rq8\" (UID: \"ee35bceb-0e83-4ec9-8592-e6f6a3a630ac\") " pod="openstack-kuttl-tests/keystone-db-create-55rq8" Mar 16 16:31:51 crc kubenswrapper[5120]: I0316 16:31:51.345579 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-e7be-account-create-update-996kw"] Mar 16 16:31:51 crc kubenswrapper[5120]: I0316 16:31:51.346911 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hflll\" (UniqueName: \"kubernetes.io/projected/cabe287f-9672-4e34-a32e-20211d186718-kube-api-access-hflll\") pod \"keystone-e1fd-account-create-update-bp9s5\" (UID: \"cabe287f-9672-4e34-a32e-20211d186718\") " pod="openstack-kuttl-tests/keystone-e1fd-account-create-update-bp9s5" Mar 16 16:31:51 crc kubenswrapper[5120]: I0316 16:31:51.347040 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/fa8543ca-1770-4c76-b0d0-ce3311515b72-operator-scripts\") pod \"placement-db-create-ghhn6\" (UID: \"fa8543ca-1770-4c76-b0d0-ce3311515b72\") " pod="openstack-kuttl-tests/placement-db-create-ghhn6" Mar 16 16:31:51 crc kubenswrapper[5120]: I0316 16:31:51.347210 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4x64\" (UniqueName: \"kubernetes.io/projected/fa8543ca-1770-4c76-b0d0-ce3311515b72-kube-api-access-p4x64\") pod \"placement-db-create-ghhn6\" (UID: \"fa8543ca-1770-4c76-b0d0-ce3311515b72\") " pod="openstack-kuttl-tests/placement-db-create-ghhn6" Mar 16 16:31:51 crc kubenswrapper[5120]: I0316 16:31:51.347462 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/cabe287f-9672-4e34-a32e-20211d186718-operator-scripts\") pod \"keystone-e1fd-account-create-update-bp9s5\" (UID: \"cabe287f-9672-4e34-a32e-20211d186718\") " pod="openstack-kuttl-tests/keystone-e1fd-account-create-update-bp9s5" Mar 16 16:31:51 crc kubenswrapper[5120]: I0316 16:31:51.348368 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/cabe287f-9672-4e34-a32e-20211d186718-operator-scripts\") pod \"keystone-e1fd-account-create-update-bp9s5\" (UID: \"cabe287f-9672-4e34-a32e-20211d186718\") " pod="openstack-kuttl-tests/keystone-e1fd-account-create-update-bp9s5" Mar 16 16:31:51 crc kubenswrapper[5120]: I0316 16:31:51.351373 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-e7be-account-create-update-996kw" Mar 16 16:31:51 crc kubenswrapper[5120]: I0316 16:31:51.355305 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-db-secret\"" Mar 16 16:31:51 crc kubenswrapper[5120]: I0316 16:31:51.381240 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-create-55rq8" Mar 16 16:31:51 crc kubenswrapper[5120]: I0316 16:31:51.383699 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hflll\" (UniqueName: \"kubernetes.io/projected/cabe287f-9672-4e34-a32e-20211d186718-kube-api-access-hflll\") pod \"keystone-e1fd-account-create-update-bp9s5\" (UID: \"cabe287f-9672-4e34-a32e-20211d186718\") " pod="openstack-kuttl-tests/keystone-e1fd-account-create-update-bp9s5" Mar 16 16:31:51 crc kubenswrapper[5120]: I0316 16:31:51.395355 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-e7be-account-create-update-996kw"] Mar 16 16:31:51 crc kubenswrapper[5120]: I0316 16:31:51.449788 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/39db1e20-c1e5-4541-950b-fc86c04b5663-operator-scripts\") pod \"placement-e7be-account-create-update-996kw\" (UID: \"39db1e20-c1e5-4541-950b-fc86c04b5663\") " pod="openstack-kuttl-tests/placement-e7be-account-create-update-996kw" Mar 16 16:31:51 crc kubenswrapper[5120]: I0316 16:31:51.450492 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/fa8543ca-1770-4c76-b0d0-ce3311515b72-operator-scripts\") pod \"placement-db-create-ghhn6\" (UID: \"fa8543ca-1770-4c76-b0d0-ce3311515b72\") " pod="openstack-kuttl-tests/placement-db-create-ghhn6" Mar 16 16:31:51 crc kubenswrapper[5120]: I0316 16:31:51.450685 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p4x64\" (UniqueName: \"kubernetes.io/projected/fa8543ca-1770-4c76-b0d0-ce3311515b72-kube-api-access-p4x64\") pod \"placement-db-create-ghhn6\" (UID: \"fa8543ca-1770-4c76-b0d0-ce3311515b72\") " pod="openstack-kuttl-tests/placement-db-create-ghhn6" Mar 16 16:31:51 crc kubenswrapper[5120]: I0316 16:31:51.450722 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svsls\" (UniqueName: \"kubernetes.io/projected/39db1e20-c1e5-4541-950b-fc86c04b5663-kube-api-access-svsls\") pod \"placement-e7be-account-create-update-996kw\" (UID: \"39db1e20-c1e5-4541-950b-fc86c04b5663\") " pod="openstack-kuttl-tests/placement-e7be-account-create-update-996kw" Mar 16 16:31:51 crc kubenswrapper[5120]: I0316 16:31:51.451256 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/fa8543ca-1770-4c76-b0d0-ce3311515b72-operator-scripts\") pod \"placement-db-create-ghhn6\" (UID: \"fa8543ca-1770-4c76-b0d0-ce3311515b72\") " pod="openstack-kuttl-tests/placement-db-create-ghhn6" Mar 16 16:31:51 crc kubenswrapper[5120]: I0316 16:31:51.468377 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4x64\" (UniqueName: \"kubernetes.io/projected/fa8543ca-1770-4c76-b0d0-ce3311515b72-kube-api-access-p4x64\") pod \"placement-db-create-ghhn6\" (UID: \"fa8543ca-1770-4c76-b0d0-ce3311515b72\") " pod="openstack-kuttl-tests/placement-db-create-ghhn6" Mar 16 16:31:51 crc kubenswrapper[5120]: I0316 16:31:51.478049 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-e1fd-account-create-update-bp9s5" Mar 16 16:31:51 crc kubenswrapper[5120]: I0316 16:31:51.553009 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-svsls\" (UniqueName: \"kubernetes.io/projected/39db1e20-c1e5-4541-950b-fc86c04b5663-kube-api-access-svsls\") pod \"placement-e7be-account-create-update-996kw\" (UID: \"39db1e20-c1e5-4541-950b-fc86c04b5663\") " pod="openstack-kuttl-tests/placement-e7be-account-create-update-996kw" Mar 16 16:31:51 crc kubenswrapper[5120]: I0316 16:31:51.553373 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/39db1e20-c1e5-4541-950b-fc86c04b5663-operator-scripts\") pod \"placement-e7be-account-create-update-996kw\" (UID: \"39db1e20-c1e5-4541-950b-fc86c04b5663\") " pod="openstack-kuttl-tests/placement-e7be-account-create-update-996kw" Mar 16 16:31:51 crc kubenswrapper[5120]: I0316 16:31:51.554228 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/39db1e20-c1e5-4541-950b-fc86c04b5663-operator-scripts\") pod \"placement-e7be-account-create-update-996kw\" (UID: \"39db1e20-c1e5-4541-950b-fc86c04b5663\") " pod="openstack-kuttl-tests/placement-e7be-account-create-update-996kw" Mar 16 16:31:51 crc kubenswrapper[5120]: I0316 16:31:51.571987 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-create-ghhn6" Mar 16 16:31:51 crc kubenswrapper[5120]: I0316 16:31:51.573697 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-svsls\" (UniqueName: \"kubernetes.io/projected/39db1e20-c1e5-4541-950b-fc86c04b5663-kube-api-access-svsls\") pod \"placement-e7be-account-create-update-996kw\" (UID: \"39db1e20-c1e5-4541-950b-fc86c04b5663\") " pod="openstack-kuttl-tests/placement-e7be-account-create-update-996kw" Mar 16 16:31:51 crc kubenswrapper[5120]: I0316 16:31:51.701944 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-e7be-account-create-update-996kw" Mar 16 16:31:51 crc kubenswrapper[5120]: I0316 16:31:51.810751 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-db-create-55rq8"] Mar 16 16:31:51 crc kubenswrapper[5120]: I0316 16:31:51.816349 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:31:51 crc kubenswrapper[5120]: W0316 16:31:51.821740 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podee35bceb_0e83_4ec9_8592_e6f6a3a630ac.slice/crio-8829931ba0eb00eb61b2c4d894e374e25598810ba802fc206ad1cf42bd1be47d WatchSource:0}: Error finding container 8829931ba0eb00eb61b2c4d894e374e25598810ba802fc206ad1cf42bd1be47d: Status 404 returned error can't find the container with id 8829931ba0eb00eb61b2c4d894e374e25598810ba802fc206ad1cf42bd1be47d Mar 16 16:31:51 crc kubenswrapper[5120]: I0316 16:31:51.827560 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:31:51 crc kubenswrapper[5120]: I0316 16:31:51.858506 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:31:51 crc kubenswrapper[5120]: I0316 16:31:51.956507 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-e1fd-account-create-update-bp9s5"] Mar 16 16:31:52 crc kubenswrapper[5120]: I0316 16:31:52.008248 5120 patch_prober.go:28] interesting pod/machine-config-daemon-7bf76 container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 16:31:52 crc kubenswrapper[5120]: I0316 16:31:52.008520 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 16:31:52 crc kubenswrapper[5120]: I0316 16:31:52.008566 5120 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" Mar 16 16:31:52 crc kubenswrapper[5120]: I0316 16:31:52.009201 5120 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="machine-config-daemon" containerStatusID={"Type":"cri-o","ID":"0a15d5caff30dc8885f782e59962af7d98d58b39ab76059e56e5827e10e7ab8b"} pod="openshift-machine-config-operator/machine-config-daemon-7bf76" containerMessage="Container machine-config-daemon failed liveness probe, will be restarted" Mar 16 16:31:52 crc kubenswrapper[5120]: I0316 16:31:52.009263 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" containerID="cri-o://0a15d5caff30dc8885f782e59962af7d98d58b39ab76059e56e5827e10e7ab8b" gracePeriod=600 Mar 16 16:31:52 crc kubenswrapper[5120]: I0316 16:31:52.030701 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:31:52 crc kubenswrapper[5120]: I0316 16:31:52.069139 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-db-create-ghhn6"] Mar 16 16:31:52 crc kubenswrapper[5120]: W0316 16:31:52.086530 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfa8543ca_1770_4c76_b0d0_ce3311515b72.slice/crio-30b606cf2e8af305c2364083436405a53396ddf56d566e7b4245fd3d579c7ff8 WatchSource:0}: Error finding container 30b606cf2e8af305c2364083436405a53396ddf56d566e7b4245fd3d579c7ff8: Status 404 returned error can't find the container with id 30b606cf2e8af305c2364083436405a53396ddf56d566e7b4245fd3d579c7ff8 Mar 16 16:31:52 crc kubenswrapper[5120]: E0316 16:31:52.133990 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:31:52 crc kubenswrapper[5120]: I0316 16:31:52.154121 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:31:52 crc kubenswrapper[5120]: I0316 16:31:52.191619 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-e7be-account-create-update-996kw"] Mar 16 16:31:52 crc kubenswrapper[5120]: I0316 16:31:52.837365 5120 generic.go:358] "Generic (PLEG): container finished" podID="cabe287f-9672-4e34-a32e-20211d186718" containerID="8334b5ff1a5baea8e41bee8bf7f0f586033458052e22b079705db8c8eab4d1ea" exitCode=0 Mar 16 16:31:52 crc kubenswrapper[5120]: I0316 16:31:52.837541 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-e1fd-account-create-update-bp9s5" event={"ID":"cabe287f-9672-4e34-a32e-20211d186718","Type":"ContainerDied","Data":"8334b5ff1a5baea8e41bee8bf7f0f586033458052e22b079705db8c8eab4d1ea"} Mar 16 16:31:52 crc kubenswrapper[5120]: I0316 16:31:52.837620 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-e1fd-account-create-update-bp9s5" event={"ID":"cabe287f-9672-4e34-a32e-20211d186718","Type":"ContainerStarted","Data":"40b24b655b2dfd7ac3a7cdfc2fe2817b15eaf322e399c4d4a725c6880d8cc3cc"} Mar 16 16:31:52 crc kubenswrapper[5120]: I0316 16:31:52.840637 5120 generic.go:358] "Generic (PLEG): container finished" podID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerID="0a15d5caff30dc8885f782e59962af7d98d58b39ab76059e56e5827e10e7ab8b" exitCode=0 Mar 16 16:31:52 crc kubenswrapper[5120]: I0316 16:31:52.840719 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" event={"ID":"e2275cb4-4905-4d66-a87e-8010120db2bd","Type":"ContainerDied","Data":"0a15d5caff30dc8885f782e59962af7d98d58b39ab76059e56e5827e10e7ab8b"} Mar 16 16:31:52 crc kubenswrapper[5120]: I0316 16:31:52.840783 5120 scope.go:117] "RemoveContainer" containerID="81c2458dbde22f960e4dc3bd6169d3e540aa2cf242ee46fc5d79af661a0e3277" Mar 16 16:31:52 crc kubenswrapper[5120]: I0316 16:31:52.841289 5120 scope.go:117] "RemoveContainer" containerID="0a15d5caff30dc8885f782e59962af7d98d58b39ab76059e56e5827e10e7ab8b" Mar 16 16:31:52 crc kubenswrapper[5120]: E0316 16:31:52.841581 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:31:52 crc kubenswrapper[5120]: I0316 16:31:52.842691 5120 generic.go:358] "Generic (PLEG): container finished" podID="fa8543ca-1770-4c76-b0d0-ce3311515b72" containerID="ecb0c00da0ec7cf25bbd888d22a9adafe4995624efd529ba2c17a327e257bfcc" exitCode=0 Mar 16 16:31:52 crc kubenswrapper[5120]: I0316 16:31:52.842796 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-create-ghhn6" event={"ID":"fa8543ca-1770-4c76-b0d0-ce3311515b72","Type":"ContainerDied","Data":"ecb0c00da0ec7cf25bbd888d22a9adafe4995624efd529ba2c17a327e257bfcc"} Mar 16 16:31:52 crc kubenswrapper[5120]: I0316 16:31:52.842830 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-create-ghhn6" event={"ID":"fa8543ca-1770-4c76-b0d0-ce3311515b72","Type":"ContainerStarted","Data":"30b606cf2e8af305c2364083436405a53396ddf56d566e7b4245fd3d579c7ff8"} Mar 16 16:31:52 crc kubenswrapper[5120]: I0316 16:31:52.844252 5120 generic.go:358] "Generic (PLEG): container finished" podID="ee35bceb-0e83-4ec9-8592-e6f6a3a630ac" containerID="3b753731da61d8d35a3b195d773852ae4cdbbff0695d566a50656c167709938e" exitCode=0 Mar 16 16:31:52 crc kubenswrapper[5120]: I0316 16:31:52.844381 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-create-55rq8" event={"ID":"ee35bceb-0e83-4ec9-8592-e6f6a3a630ac","Type":"ContainerDied","Data":"3b753731da61d8d35a3b195d773852ae4cdbbff0695d566a50656c167709938e"} Mar 16 16:31:52 crc kubenswrapper[5120]: I0316 16:31:52.844467 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-create-55rq8" event={"ID":"ee35bceb-0e83-4ec9-8592-e6f6a3a630ac","Type":"ContainerStarted","Data":"8829931ba0eb00eb61b2c4d894e374e25598810ba802fc206ad1cf42bd1be47d"} Mar 16 16:31:52 crc kubenswrapper[5120]: I0316 16:31:52.845905 5120 generic.go:358] "Generic (PLEG): container finished" podID="39db1e20-c1e5-4541-950b-fc86c04b5663" containerID="a80b8f0291f5a2c0a566173d713a44f2c805f1838c96857e42d00d57a663cffd" exitCode=0 Mar 16 16:31:52 crc kubenswrapper[5120]: I0316 16:31:52.846028 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-e7be-account-create-update-996kw" event={"ID":"39db1e20-c1e5-4541-950b-fc86c04b5663","Type":"ContainerDied","Data":"a80b8f0291f5a2c0a566173d713a44f2c805f1838c96857e42d00d57a663cffd"} Mar 16 16:31:52 crc kubenswrapper[5120]: I0316 16:31:52.846065 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-e7be-account-create-update-996kw" event={"ID":"39db1e20-c1e5-4541-950b-fc86c04b5663","Type":"ContainerStarted","Data":"1d9dde92c44ec0be5ba3d049de7a01571c605a65bc9641c710e04eb27a10f2a4"} Mar 16 16:31:53 crc kubenswrapper[5120]: I0316 16:31:53.242782 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 16:31:53 crc kubenswrapper[5120]: I0316 16:31:53.260208 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 16:31:53 crc kubenswrapper[5120]: I0316 16:31:53.260484 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:31:53 crc kubenswrapper[5120]: I0316 16:31:53.262676 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"swift-conf\"" Mar 16 16:31:53 crc kubenswrapper[5120]: I0316 16:31:53.262925 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"swift-storage-config-data\"" Mar 16 16:31:53 crc kubenswrapper[5120]: I0316 16:31:53.263181 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"swift-swift-dockercfg-45fk4\"" Mar 16 16:31:53 crc kubenswrapper[5120]: I0316 16:31:53.263465 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"swift-ring-files\"" Mar 16 16:31:53 crc kubenswrapper[5120]: I0316 16:31:53.402651 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/68089cb0-f9b0-4b76-9778-e2edffaa4f55-etc-swift\") pod \"swift-storage-0\" (UID: \"68089cb0-f9b0-4b76-9778-e2edffaa4f55\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:31:53 crc kubenswrapper[5120]: I0316 16:31:53.403125 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czp6s\" (UniqueName: \"kubernetes.io/projected/68089cb0-f9b0-4b76-9778-e2edffaa4f55-kube-api-access-czp6s\") pod \"swift-storage-0\" (UID: \"68089cb0-f9b0-4b76-9778-e2edffaa4f55\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:31:53 crc kubenswrapper[5120]: I0316 16:31:53.403258 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/68089cb0-f9b0-4b76-9778-e2edffaa4f55-cache\") pod \"swift-storage-0\" (UID: \"68089cb0-f9b0-4b76-9778-e2edffaa4f55\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:31:53 crc kubenswrapper[5120]: I0316 16:31:53.403281 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/68089cb0-f9b0-4b76-9778-e2edffaa4f55-lock\") pod \"swift-storage-0\" (UID: \"68089cb0-f9b0-4b76-9778-e2edffaa4f55\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:31:53 crc kubenswrapper[5120]: I0316 16:31:53.403304 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/68089cb0-f9b0-4b76-9778-e2edffaa4f55-combined-ca-bundle\") pod \"swift-storage-0\" (UID: \"68089cb0-f9b0-4b76-9778-e2edffaa4f55\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:31:53 crc kubenswrapper[5120]: I0316 16:31:53.403331 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"swift-storage-0\" (UID: \"68089cb0-f9b0-4b76-9778-e2edffaa4f55\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:31:53 crc kubenswrapper[5120]: I0316 16:31:53.505831 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/68089cb0-f9b0-4b76-9778-e2edffaa4f55-etc-swift\") pod \"swift-storage-0\" (UID: \"68089cb0-f9b0-4b76-9778-e2edffaa4f55\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:31:53 crc kubenswrapper[5120]: I0316 16:31:53.505913 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-czp6s\" (UniqueName: \"kubernetes.io/projected/68089cb0-f9b0-4b76-9778-e2edffaa4f55-kube-api-access-czp6s\") pod \"swift-storage-0\" (UID: \"68089cb0-f9b0-4b76-9778-e2edffaa4f55\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:31:53 crc kubenswrapper[5120]: I0316 16:31:53.506095 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/68089cb0-f9b0-4b76-9778-e2edffaa4f55-cache\") pod \"swift-storage-0\" (UID: \"68089cb0-f9b0-4b76-9778-e2edffaa4f55\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:31:53 crc kubenswrapper[5120]: I0316 16:31:53.506121 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/68089cb0-f9b0-4b76-9778-e2edffaa4f55-lock\") pod \"swift-storage-0\" (UID: \"68089cb0-f9b0-4b76-9778-e2edffaa4f55\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:31:53 crc kubenswrapper[5120]: I0316 16:31:53.506141 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/68089cb0-f9b0-4b76-9778-e2edffaa4f55-combined-ca-bundle\") pod \"swift-storage-0\" (UID: \"68089cb0-f9b0-4b76-9778-e2edffaa4f55\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:31:53 crc kubenswrapper[5120]: I0316 16:31:53.506164 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"swift-storage-0\" (UID: \"68089cb0-f9b0-4b76-9778-e2edffaa4f55\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:31:53 crc kubenswrapper[5120]: I0316 16:31:53.506593 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"swift-storage-0\" (UID: \"68089cb0-f9b0-4b76-9778-e2edffaa4f55\") device mount path \"/mnt/openstack/pv09\"" pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:31:53 crc kubenswrapper[5120]: E0316 16:31:53.507103 5120 projected.go:289] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Mar 16 16:31:53 crc kubenswrapper[5120]: E0316 16:31:53.507143 5120 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Mar 16 16:31:53 crc kubenswrapper[5120]: E0316 16:31:53.507220 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/68089cb0-f9b0-4b76-9778-e2edffaa4f55-etc-swift podName:68089cb0-f9b0-4b76-9778-e2edffaa4f55 nodeName:}" failed. No retries permitted until 2026-03-16 16:31:54.007197517 +0000 UTC m=+3616.161129174 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/68089cb0-f9b0-4b76-9778-e2edffaa4f55-etc-swift") pod "swift-storage-0" (UID: "68089cb0-f9b0-4b76-9778-e2edffaa4f55") : configmap "swift-ring-files" not found Mar 16 16:31:53 crc kubenswrapper[5120]: I0316 16:31:53.507426 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/68089cb0-f9b0-4b76-9778-e2edffaa4f55-cache\") pod \"swift-storage-0\" (UID: \"68089cb0-f9b0-4b76-9778-e2edffaa4f55\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:31:53 crc kubenswrapper[5120]: I0316 16:31:53.507448 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/68089cb0-f9b0-4b76-9778-e2edffaa4f55-lock\") pod \"swift-storage-0\" (UID: \"68089cb0-f9b0-4b76-9778-e2edffaa4f55\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:31:53 crc kubenswrapper[5120]: I0316 16:31:53.524945 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/68089cb0-f9b0-4b76-9778-e2edffaa4f55-combined-ca-bundle\") pod \"swift-storage-0\" (UID: \"68089cb0-f9b0-4b76-9778-e2edffaa4f55\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:31:53 crc kubenswrapper[5120]: I0316 16:31:53.525242 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-czp6s\" (UniqueName: \"kubernetes.io/projected/68089cb0-f9b0-4b76-9778-e2edffaa4f55-kube-api-access-czp6s\") pod \"swift-storage-0\" (UID: \"68089cb0-f9b0-4b76-9778-e2edffaa4f55\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:31:53 crc kubenswrapper[5120]: I0316 16:31:53.529336 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"swift-storage-0\" (UID: \"68089cb0-f9b0-4b76-9778-e2edffaa4f55\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:31:54 crc kubenswrapper[5120]: I0316 16:31:54.018309 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/68089cb0-f9b0-4b76-9778-e2edffaa4f55-etc-swift\") pod \"swift-storage-0\" (UID: \"68089cb0-f9b0-4b76-9778-e2edffaa4f55\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:31:54 crc kubenswrapper[5120]: E0316 16:31:54.018590 5120 projected.go:289] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Mar 16 16:31:54 crc kubenswrapper[5120]: E0316 16:31:54.018817 5120 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Mar 16 16:31:54 crc kubenswrapper[5120]: E0316 16:31:54.018914 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/68089cb0-f9b0-4b76-9778-e2edffaa4f55-etc-swift podName:68089cb0-f9b0-4b76-9778-e2edffaa4f55 nodeName:}" failed. No retries permitted until 2026-03-16 16:31:55.018885955 +0000 UTC m=+3617.172817622 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/68089cb0-f9b0-4b76-9778-e2edffaa4f55-etc-swift") pod "swift-storage-0" (UID: "68089cb0-f9b0-4b76-9778-e2edffaa4f55") : configmap "swift-ring-files" not found Mar 16 16:31:54 crc kubenswrapper[5120]: I0316 16:31:54.336563 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-create-55rq8" Mar 16 16:31:54 crc kubenswrapper[5120]: I0316 16:31:54.429584 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ee35bceb-0e83-4ec9-8592-e6f6a3a630ac-operator-scripts\") pod \"ee35bceb-0e83-4ec9-8592-e6f6a3a630ac\" (UID: \"ee35bceb-0e83-4ec9-8592-e6f6a3a630ac\") " Mar 16 16:31:54 crc kubenswrapper[5120]: I0316 16:31:54.429641 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qk6d8\" (UniqueName: \"kubernetes.io/projected/ee35bceb-0e83-4ec9-8592-e6f6a3a630ac-kube-api-access-qk6d8\") pod \"ee35bceb-0e83-4ec9-8592-e6f6a3a630ac\" (UID: \"ee35bceb-0e83-4ec9-8592-e6f6a3a630ac\") " Mar 16 16:31:54 crc kubenswrapper[5120]: I0316 16:31:54.430422 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ee35bceb-0e83-4ec9-8592-e6f6a3a630ac-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "ee35bceb-0e83-4ec9-8592-e6f6a3a630ac" (UID: "ee35bceb-0e83-4ec9-8592-e6f6a3a630ac"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:31:54 crc kubenswrapper[5120]: I0316 16:31:54.431714 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ee35bceb-0e83-4ec9-8592-e6f6a3a630ac-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:31:54 crc kubenswrapper[5120]: I0316 16:31:54.436176 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee35bceb-0e83-4ec9-8592-e6f6a3a630ac-kube-api-access-qk6d8" (OuterVolumeSpecName: "kube-api-access-qk6d8") pod "ee35bceb-0e83-4ec9-8592-e6f6a3a630ac" (UID: "ee35bceb-0e83-4ec9-8592-e6f6a3a630ac"). InnerVolumeSpecName "kube-api-access-qk6d8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:31:54 crc kubenswrapper[5120]: I0316 16:31:54.491694 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-e1fd-account-create-update-bp9s5" Mar 16 16:31:54 crc kubenswrapper[5120]: I0316 16:31:54.498102 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-e7be-account-create-update-996kw" Mar 16 16:31:54 crc kubenswrapper[5120]: I0316 16:31:54.510116 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-create-ghhn6" Mar 16 16:31:54 crc kubenswrapper[5120]: I0316 16:31:54.532555 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-svsls\" (UniqueName: \"kubernetes.io/projected/39db1e20-c1e5-4541-950b-fc86c04b5663-kube-api-access-svsls\") pod \"39db1e20-c1e5-4541-950b-fc86c04b5663\" (UID: \"39db1e20-c1e5-4541-950b-fc86c04b5663\") " Mar 16 16:31:54 crc kubenswrapper[5120]: I0316 16:31:54.532689 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/cabe287f-9672-4e34-a32e-20211d186718-operator-scripts\") pod \"cabe287f-9672-4e34-a32e-20211d186718\" (UID: \"cabe287f-9672-4e34-a32e-20211d186718\") " Mar 16 16:31:54 crc kubenswrapper[5120]: I0316 16:31:54.533210 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p4x64\" (UniqueName: \"kubernetes.io/projected/fa8543ca-1770-4c76-b0d0-ce3311515b72-kube-api-access-p4x64\") pod \"fa8543ca-1770-4c76-b0d0-ce3311515b72\" (UID: \"fa8543ca-1770-4c76-b0d0-ce3311515b72\") " Mar 16 16:31:54 crc kubenswrapper[5120]: I0316 16:31:54.533214 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cabe287f-9672-4e34-a32e-20211d186718-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "cabe287f-9672-4e34-a32e-20211d186718" (UID: "cabe287f-9672-4e34-a32e-20211d186718"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:31:54 crc kubenswrapper[5120]: I0316 16:31:54.533525 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hflll\" (UniqueName: \"kubernetes.io/projected/cabe287f-9672-4e34-a32e-20211d186718-kube-api-access-hflll\") pod \"cabe287f-9672-4e34-a32e-20211d186718\" (UID: \"cabe287f-9672-4e34-a32e-20211d186718\") " Mar 16 16:31:54 crc kubenswrapper[5120]: I0316 16:31:54.533697 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/fa8543ca-1770-4c76-b0d0-ce3311515b72-operator-scripts\") pod \"fa8543ca-1770-4c76-b0d0-ce3311515b72\" (UID: \"fa8543ca-1770-4c76-b0d0-ce3311515b72\") " Mar 16 16:31:54 crc kubenswrapper[5120]: I0316 16:31:54.533849 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/39db1e20-c1e5-4541-950b-fc86c04b5663-operator-scripts\") pod \"39db1e20-c1e5-4541-950b-fc86c04b5663\" (UID: \"39db1e20-c1e5-4541-950b-fc86c04b5663\") " Mar 16 16:31:54 crc kubenswrapper[5120]: I0316 16:31:54.534461 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/cabe287f-9672-4e34-a32e-20211d186718-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:31:54 crc kubenswrapper[5120]: I0316 16:31:54.534483 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qk6d8\" (UniqueName: \"kubernetes.io/projected/ee35bceb-0e83-4ec9-8592-e6f6a3a630ac-kube-api-access-qk6d8\") on node \"crc\" DevicePath \"\"" Mar 16 16:31:54 crc kubenswrapper[5120]: I0316 16:31:54.534574 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fa8543ca-1770-4c76-b0d0-ce3311515b72-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "fa8543ca-1770-4c76-b0d0-ce3311515b72" (UID: "fa8543ca-1770-4c76-b0d0-ce3311515b72"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:31:54 crc kubenswrapper[5120]: I0316 16:31:54.534827 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39db1e20-c1e5-4541-950b-fc86c04b5663-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "39db1e20-c1e5-4541-950b-fc86c04b5663" (UID: "39db1e20-c1e5-4541-950b-fc86c04b5663"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:31:54 crc kubenswrapper[5120]: I0316 16:31:54.536837 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa8543ca-1770-4c76-b0d0-ce3311515b72-kube-api-access-p4x64" (OuterVolumeSpecName: "kube-api-access-p4x64") pod "fa8543ca-1770-4c76-b0d0-ce3311515b72" (UID: "fa8543ca-1770-4c76-b0d0-ce3311515b72"). InnerVolumeSpecName "kube-api-access-p4x64". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:31:54 crc kubenswrapper[5120]: I0316 16:31:54.536998 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39db1e20-c1e5-4541-950b-fc86c04b5663-kube-api-access-svsls" (OuterVolumeSpecName: "kube-api-access-svsls") pod "39db1e20-c1e5-4541-950b-fc86c04b5663" (UID: "39db1e20-c1e5-4541-950b-fc86c04b5663"). InnerVolumeSpecName "kube-api-access-svsls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:31:54 crc kubenswrapper[5120]: I0316 16:31:54.537362 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cabe287f-9672-4e34-a32e-20211d186718-kube-api-access-hflll" (OuterVolumeSpecName: "kube-api-access-hflll") pod "cabe287f-9672-4e34-a32e-20211d186718" (UID: "cabe287f-9672-4e34-a32e-20211d186718"). InnerVolumeSpecName "kube-api-access-hflll". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:31:54 crc kubenswrapper[5120]: I0316 16:31:54.636116 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-svsls\" (UniqueName: \"kubernetes.io/projected/39db1e20-c1e5-4541-950b-fc86c04b5663-kube-api-access-svsls\") on node \"crc\" DevicePath \"\"" Mar 16 16:31:54 crc kubenswrapper[5120]: I0316 16:31:54.636173 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p4x64\" (UniqueName: \"kubernetes.io/projected/fa8543ca-1770-4c76-b0d0-ce3311515b72-kube-api-access-p4x64\") on node \"crc\" DevicePath \"\"" Mar 16 16:31:54 crc kubenswrapper[5120]: I0316 16:31:54.636184 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hflll\" (UniqueName: \"kubernetes.io/projected/cabe287f-9672-4e34-a32e-20211d186718-kube-api-access-hflll\") on node \"crc\" DevicePath \"\"" Mar 16 16:31:54 crc kubenswrapper[5120]: I0316 16:31:54.636194 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/fa8543ca-1770-4c76-b0d0-ce3311515b72-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:31:54 crc kubenswrapper[5120]: I0316 16:31:54.636205 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/39db1e20-c1e5-4541-950b-fc86c04b5663-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:31:54 crc kubenswrapper[5120]: I0316 16:31:54.886264 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-create-ghhn6" event={"ID":"fa8543ca-1770-4c76-b0d0-ce3311515b72","Type":"ContainerDied","Data":"30b606cf2e8af305c2364083436405a53396ddf56d566e7b4245fd3d579c7ff8"} Mar 16 16:31:54 crc kubenswrapper[5120]: I0316 16:31:54.886313 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="30b606cf2e8af305c2364083436405a53396ddf56d566e7b4245fd3d579c7ff8" Mar 16 16:31:54 crc kubenswrapper[5120]: I0316 16:31:54.886319 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-create-ghhn6" Mar 16 16:31:54 crc kubenswrapper[5120]: I0316 16:31:54.888605 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-create-55rq8" event={"ID":"ee35bceb-0e83-4ec9-8592-e6f6a3a630ac","Type":"ContainerDied","Data":"8829931ba0eb00eb61b2c4d894e374e25598810ba802fc206ad1cf42bd1be47d"} Mar 16 16:31:54 crc kubenswrapper[5120]: I0316 16:31:54.888643 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8829931ba0eb00eb61b2c4d894e374e25598810ba802fc206ad1cf42bd1be47d" Mar 16 16:31:54 crc kubenswrapper[5120]: I0316 16:31:54.888730 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-create-55rq8" Mar 16 16:31:54 crc kubenswrapper[5120]: I0316 16:31:54.890872 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-e7be-account-create-update-996kw" event={"ID":"39db1e20-c1e5-4541-950b-fc86c04b5663","Type":"ContainerDied","Data":"1d9dde92c44ec0be5ba3d049de7a01571c605a65bc9641c710e04eb27a10f2a4"} Mar 16 16:31:54 crc kubenswrapper[5120]: I0316 16:31:54.890897 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1d9dde92c44ec0be5ba3d049de7a01571c605a65bc9641c710e04eb27a10f2a4" Mar 16 16:31:54 crc kubenswrapper[5120]: I0316 16:31:54.890951 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-e7be-account-create-update-996kw" Mar 16 16:31:54 crc kubenswrapper[5120]: I0316 16:31:54.892672 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-e1fd-account-create-update-bp9s5" event={"ID":"cabe287f-9672-4e34-a32e-20211d186718","Type":"ContainerDied","Data":"40b24b655b2dfd7ac3a7cdfc2fe2817b15eaf322e399c4d4a725c6880d8cc3cc"} Mar 16 16:31:54 crc kubenswrapper[5120]: I0316 16:31:54.892709 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="40b24b655b2dfd7ac3a7cdfc2fe2817b15eaf322e399c4d4a725c6880d8cc3cc" Mar 16 16:31:54 crc kubenswrapper[5120]: I0316 16:31:54.892841 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-e1fd-account-create-update-bp9s5" Mar 16 16:31:55 crc kubenswrapper[5120]: I0316 16:31:55.043724 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/68089cb0-f9b0-4b76-9778-e2edffaa4f55-etc-swift\") pod \"swift-storage-0\" (UID: \"68089cb0-f9b0-4b76-9778-e2edffaa4f55\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:31:55 crc kubenswrapper[5120]: E0316 16:31:55.043992 5120 projected.go:289] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Mar 16 16:31:55 crc kubenswrapper[5120]: E0316 16:31:55.044013 5120 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Mar 16 16:31:55 crc kubenswrapper[5120]: E0316 16:31:55.044076 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/68089cb0-f9b0-4b76-9778-e2edffaa4f55-etc-swift podName:68089cb0-f9b0-4b76-9778-e2edffaa4f55 nodeName:}" failed. No retries permitted until 2026-03-16 16:31:57.044057258 +0000 UTC m=+3619.197988915 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/68089cb0-f9b0-4b76-9778-e2edffaa4f55-etc-swift") pod "swift-storage-0" (UID: "68089cb0-f9b0-4b76-9778-e2edffaa4f55") : configmap "swift-ring-files" not found Mar 16 16:31:55 crc kubenswrapper[5120]: I0316 16:31:55.771043 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:31:56 crc kubenswrapper[5120]: I0316 16:31:56.932955 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-db-create-xkmkh"] Mar 16 16:31:56 crc kubenswrapper[5120]: I0316 16:31:56.934218 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa8543ca-1770-4c76-b0d0-ce3311515b72" containerName="mariadb-database-create" Mar 16 16:31:56 crc kubenswrapper[5120]: I0316 16:31:56.934235 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa8543ca-1770-4c76-b0d0-ce3311515b72" containerName="mariadb-database-create" Mar 16 16:31:56 crc kubenswrapper[5120]: I0316 16:31:56.934250 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cabe287f-9672-4e34-a32e-20211d186718" containerName="mariadb-account-create-update" Mar 16 16:31:56 crc kubenswrapper[5120]: I0316 16:31:56.934256 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="cabe287f-9672-4e34-a32e-20211d186718" containerName="mariadb-account-create-update" Mar 16 16:31:56 crc kubenswrapper[5120]: I0316 16:31:56.934311 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee35bceb-0e83-4ec9-8592-e6f6a3a630ac" containerName="mariadb-database-create" Mar 16 16:31:56 crc kubenswrapper[5120]: I0316 16:31:56.934322 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee35bceb-0e83-4ec9-8592-e6f6a3a630ac" containerName="mariadb-database-create" Mar 16 16:31:56 crc kubenswrapper[5120]: I0316 16:31:56.934339 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39db1e20-c1e5-4541-950b-fc86c04b5663" containerName="mariadb-account-create-update" Mar 16 16:31:56 crc kubenswrapper[5120]: I0316 16:31:56.934345 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="39db1e20-c1e5-4541-950b-fc86c04b5663" containerName="mariadb-account-create-update" Mar 16 16:31:56 crc kubenswrapper[5120]: I0316 16:31:56.934512 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="fa8543ca-1770-4c76-b0d0-ce3311515b72" containerName="mariadb-database-create" Mar 16 16:31:56 crc kubenswrapper[5120]: I0316 16:31:56.934529 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="cabe287f-9672-4e34-a32e-20211d186718" containerName="mariadb-account-create-update" Mar 16 16:31:56 crc kubenswrapper[5120]: I0316 16:31:56.934537 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="39db1e20-c1e5-4541-950b-fc86c04b5663" containerName="mariadb-account-create-update" Mar 16 16:31:56 crc kubenswrapper[5120]: I0316 16:31:56.934547 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ee35bceb-0e83-4ec9-8592-e6f6a3a630ac" containerName="mariadb-database-create" Mar 16 16:31:56 crc kubenswrapper[5120]: I0316 16:31:56.940256 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-create-xkmkh" Mar 16 16:31:56 crc kubenswrapper[5120]: I0316 16:31:56.940414 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-db-create-xkmkh"] Mar 16 16:31:56 crc kubenswrapper[5120]: I0316 16:31:56.983802 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wv7fl\" (UniqueName: \"kubernetes.io/projected/1e360f6f-ac8a-4bab-a5de-5aa4658444b6-kube-api-access-wv7fl\") pod \"glance-db-create-xkmkh\" (UID: \"1e360f6f-ac8a-4bab-a5de-5aa4658444b6\") " pod="openstack-kuttl-tests/glance-db-create-xkmkh" Mar 16 16:31:56 crc kubenswrapper[5120]: I0316 16:31:56.985838 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/1e360f6f-ac8a-4bab-a5de-5aa4658444b6-operator-scripts\") pod \"glance-db-create-xkmkh\" (UID: \"1e360f6f-ac8a-4bab-a5de-5aa4658444b6\") " pod="openstack-kuttl-tests/glance-db-create-xkmkh" Mar 16 16:31:56 crc kubenswrapper[5120]: I0316 16:31:56.993998 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-89ftb"] Mar 16 16:31:57 crc kubenswrapper[5120]: I0316 16:31:57.001089 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-89ftb" Mar 16 16:31:57 crc kubenswrapper[5120]: I0316 16:31:57.004835 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"swift-ring-scripts\"" Mar 16 16:31:57 crc kubenswrapper[5120]: I0316 16:31:57.004973 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"swift-ring-config-data\"" Mar 16 16:31:57 crc kubenswrapper[5120]: I0316 16:31:57.005238 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"swift-proxy-config-data\"" Mar 16 16:31:57 crc kubenswrapper[5120]: I0316 16:31:57.017972 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-fe40-account-create-update-prnl2"] Mar 16 16:31:57 crc kubenswrapper[5120]: I0316 16:31:57.030430 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-fe40-account-create-update-prnl2" Mar 16 16:31:57 crc kubenswrapper[5120]: I0316 16:31:57.036838 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-db-secret\"" Mar 16 16:31:57 crc kubenswrapper[5120]: I0316 16:31:57.039584 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-fe40-account-create-update-prnl2"] Mar 16 16:31:57 crc kubenswrapper[5120]: I0316 16:31:57.049218 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-89ftb"] Mar 16 16:31:57 crc kubenswrapper[5120]: I0316 16:31:57.090857 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/be43c69b-cb44-44e0-bb6c-a220d59ef207-scripts\") pod \"swift-ring-rebalance-89ftb\" (UID: \"be43c69b-cb44-44e0-bb6c-a220d59ef207\") " pod="openstack-kuttl-tests/swift-ring-rebalance-89ftb" Mar 16 16:31:57 crc kubenswrapper[5120]: I0316 16:31:57.091468 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/be43c69b-cb44-44e0-bb6c-a220d59ef207-combined-ca-bundle\") pod \"swift-ring-rebalance-89ftb\" (UID: \"be43c69b-cb44-44e0-bb6c-a220d59ef207\") " pod="openstack-kuttl-tests/swift-ring-rebalance-89ftb" Mar 16 16:31:57 crc kubenswrapper[5120]: I0316 16:31:57.091659 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/1e360f6f-ac8a-4bab-a5de-5aa4658444b6-operator-scripts\") pod \"glance-db-create-xkmkh\" (UID: \"1e360f6f-ac8a-4bab-a5de-5aa4658444b6\") " pod="openstack-kuttl-tests/glance-db-create-xkmkh" Mar 16 16:31:57 crc kubenswrapper[5120]: I0316 16:31:57.092511 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzg5f\" (UniqueName: \"kubernetes.io/projected/be43c69b-cb44-44e0-bb6c-a220d59ef207-kube-api-access-xzg5f\") pod \"swift-ring-rebalance-89ftb\" (UID: \"be43c69b-cb44-44e0-bb6c-a220d59ef207\") " pod="openstack-kuttl-tests/swift-ring-rebalance-89ftb" Mar 16 16:31:57 crc kubenswrapper[5120]: I0316 16:31:57.092453 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/1e360f6f-ac8a-4bab-a5de-5aa4658444b6-operator-scripts\") pod \"glance-db-create-xkmkh\" (UID: \"1e360f6f-ac8a-4bab-a5de-5aa4658444b6\") " pod="openstack-kuttl-tests/glance-db-create-xkmkh" Mar 16 16:31:57 crc kubenswrapper[5120]: I0316 16:31:57.093167 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/416ad117-1241-46b5-8e7f-92967c3fa54b-operator-scripts\") pod \"glance-fe40-account-create-update-prnl2\" (UID: \"416ad117-1241-46b5-8e7f-92967c3fa54b\") " pod="openstack-kuttl-tests/glance-fe40-account-create-update-prnl2" Mar 16 16:31:57 crc kubenswrapper[5120]: I0316 16:31:57.093270 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ff7v\" (UniqueName: \"kubernetes.io/projected/416ad117-1241-46b5-8e7f-92967c3fa54b-kube-api-access-9ff7v\") pod \"glance-fe40-account-create-update-prnl2\" (UID: \"416ad117-1241-46b5-8e7f-92967c3fa54b\") " pod="openstack-kuttl-tests/glance-fe40-account-create-update-prnl2" Mar 16 16:31:57 crc kubenswrapper[5120]: I0316 16:31:57.093423 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/be43c69b-cb44-44e0-bb6c-a220d59ef207-dispersionconf\") pod \"swift-ring-rebalance-89ftb\" (UID: \"be43c69b-cb44-44e0-bb6c-a220d59ef207\") " pod="openstack-kuttl-tests/swift-ring-rebalance-89ftb" Mar 16 16:31:57 crc kubenswrapper[5120]: I0316 16:31:57.093537 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/be43c69b-cb44-44e0-bb6c-a220d59ef207-etc-swift\") pod \"swift-ring-rebalance-89ftb\" (UID: \"be43c69b-cb44-44e0-bb6c-a220d59ef207\") " pod="openstack-kuttl-tests/swift-ring-rebalance-89ftb" Mar 16 16:31:57 crc kubenswrapper[5120]: I0316 16:31:57.093665 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/be43c69b-cb44-44e0-bb6c-a220d59ef207-ring-data-devices\") pod \"swift-ring-rebalance-89ftb\" (UID: \"be43c69b-cb44-44e0-bb6c-a220d59ef207\") " pod="openstack-kuttl-tests/swift-ring-rebalance-89ftb" Mar 16 16:31:57 crc kubenswrapper[5120]: I0316 16:31:57.093805 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wv7fl\" (UniqueName: \"kubernetes.io/projected/1e360f6f-ac8a-4bab-a5de-5aa4658444b6-kube-api-access-wv7fl\") pod \"glance-db-create-xkmkh\" (UID: \"1e360f6f-ac8a-4bab-a5de-5aa4658444b6\") " pod="openstack-kuttl-tests/glance-db-create-xkmkh" Mar 16 16:31:57 crc kubenswrapper[5120]: I0316 16:31:57.093894 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/be43c69b-cb44-44e0-bb6c-a220d59ef207-swiftconf\") pod \"swift-ring-rebalance-89ftb\" (UID: \"be43c69b-cb44-44e0-bb6c-a220d59ef207\") " pod="openstack-kuttl-tests/swift-ring-rebalance-89ftb" Mar 16 16:31:57 crc kubenswrapper[5120]: I0316 16:31:57.094022 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/68089cb0-f9b0-4b76-9778-e2edffaa4f55-etc-swift\") pod \"swift-storage-0\" (UID: \"68089cb0-f9b0-4b76-9778-e2edffaa4f55\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:31:57 crc kubenswrapper[5120]: E0316 16:31:57.094228 5120 projected.go:289] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Mar 16 16:31:57 crc kubenswrapper[5120]: E0316 16:31:57.094837 5120 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Mar 16 16:31:57 crc kubenswrapper[5120]: E0316 16:31:57.094942 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/68089cb0-f9b0-4b76-9778-e2edffaa4f55-etc-swift podName:68089cb0-f9b0-4b76-9778-e2edffaa4f55 nodeName:}" failed. No retries permitted until 2026-03-16 16:32:01.094918347 +0000 UTC m=+3623.248850014 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/68089cb0-f9b0-4b76-9778-e2edffaa4f55-etc-swift") pod "swift-storage-0" (UID: "68089cb0-f9b0-4b76-9778-e2edffaa4f55") : configmap "swift-ring-files" not found Mar 16 16:31:57 crc kubenswrapper[5120]: I0316 16:31:57.096429 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/root-account-create-update-q729t"] Mar 16 16:31:57 crc kubenswrapper[5120]: I0316 16:31:57.109768 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-q729t"] Mar 16 16:31:57 crc kubenswrapper[5120]: I0316 16:31:57.109992 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-q729t" Mar 16 16:31:57 crc kubenswrapper[5120]: I0316 16:31:57.113655 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"openstack-mariadb-root-db-secret\"" Mar 16 16:31:57 crc kubenswrapper[5120]: I0316 16:31:57.126731 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wv7fl\" (UniqueName: \"kubernetes.io/projected/1e360f6f-ac8a-4bab-a5de-5aa4658444b6-kube-api-access-wv7fl\") pod \"glance-db-create-xkmkh\" (UID: \"1e360f6f-ac8a-4bab-a5de-5aa4658444b6\") " pod="openstack-kuttl-tests/glance-db-create-xkmkh" Mar 16 16:31:57 crc kubenswrapper[5120]: I0316 16:31:57.195901 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92gqr\" (UniqueName: \"kubernetes.io/projected/74ab8af1-6b3c-451f-802b-a50f2c8db886-kube-api-access-92gqr\") pod \"root-account-create-update-q729t\" (UID: \"74ab8af1-6b3c-451f-802b-a50f2c8db886\") " pod="openstack-kuttl-tests/root-account-create-update-q729t" Mar 16 16:31:57 crc kubenswrapper[5120]: I0316 16:31:57.195961 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/416ad117-1241-46b5-8e7f-92967c3fa54b-operator-scripts\") pod \"glance-fe40-account-create-update-prnl2\" (UID: \"416ad117-1241-46b5-8e7f-92967c3fa54b\") " pod="openstack-kuttl-tests/glance-fe40-account-create-update-prnl2" Mar 16 16:31:57 crc kubenswrapper[5120]: I0316 16:31:57.195984 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9ff7v\" (UniqueName: \"kubernetes.io/projected/416ad117-1241-46b5-8e7f-92967c3fa54b-kube-api-access-9ff7v\") pod \"glance-fe40-account-create-update-prnl2\" (UID: \"416ad117-1241-46b5-8e7f-92967c3fa54b\") " pod="openstack-kuttl-tests/glance-fe40-account-create-update-prnl2" Mar 16 16:31:57 crc kubenswrapper[5120]: I0316 16:31:57.196022 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/be43c69b-cb44-44e0-bb6c-a220d59ef207-dispersionconf\") pod \"swift-ring-rebalance-89ftb\" (UID: \"be43c69b-cb44-44e0-bb6c-a220d59ef207\") " pod="openstack-kuttl-tests/swift-ring-rebalance-89ftb" Mar 16 16:31:57 crc kubenswrapper[5120]: I0316 16:31:57.196073 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/be43c69b-cb44-44e0-bb6c-a220d59ef207-etc-swift\") pod \"swift-ring-rebalance-89ftb\" (UID: \"be43c69b-cb44-44e0-bb6c-a220d59ef207\") " pod="openstack-kuttl-tests/swift-ring-rebalance-89ftb" Mar 16 16:31:57 crc kubenswrapper[5120]: I0316 16:31:57.196094 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/74ab8af1-6b3c-451f-802b-a50f2c8db886-operator-scripts\") pod \"root-account-create-update-q729t\" (UID: \"74ab8af1-6b3c-451f-802b-a50f2c8db886\") " pod="openstack-kuttl-tests/root-account-create-update-q729t" Mar 16 16:31:57 crc kubenswrapper[5120]: I0316 16:31:57.196135 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/be43c69b-cb44-44e0-bb6c-a220d59ef207-ring-data-devices\") pod \"swift-ring-rebalance-89ftb\" (UID: \"be43c69b-cb44-44e0-bb6c-a220d59ef207\") " pod="openstack-kuttl-tests/swift-ring-rebalance-89ftb" Mar 16 16:31:57 crc kubenswrapper[5120]: I0316 16:31:57.196160 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/be43c69b-cb44-44e0-bb6c-a220d59ef207-swiftconf\") pod \"swift-ring-rebalance-89ftb\" (UID: \"be43c69b-cb44-44e0-bb6c-a220d59ef207\") " pod="openstack-kuttl-tests/swift-ring-rebalance-89ftb" Mar 16 16:31:57 crc kubenswrapper[5120]: I0316 16:31:57.196215 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/be43c69b-cb44-44e0-bb6c-a220d59ef207-scripts\") pod \"swift-ring-rebalance-89ftb\" (UID: \"be43c69b-cb44-44e0-bb6c-a220d59ef207\") " pod="openstack-kuttl-tests/swift-ring-rebalance-89ftb" Mar 16 16:31:57 crc kubenswrapper[5120]: I0316 16:31:57.196230 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/be43c69b-cb44-44e0-bb6c-a220d59ef207-combined-ca-bundle\") pod \"swift-ring-rebalance-89ftb\" (UID: \"be43c69b-cb44-44e0-bb6c-a220d59ef207\") " pod="openstack-kuttl-tests/swift-ring-rebalance-89ftb" Mar 16 16:31:57 crc kubenswrapper[5120]: I0316 16:31:57.196304 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xzg5f\" (UniqueName: \"kubernetes.io/projected/be43c69b-cb44-44e0-bb6c-a220d59ef207-kube-api-access-xzg5f\") pod \"swift-ring-rebalance-89ftb\" (UID: \"be43c69b-cb44-44e0-bb6c-a220d59ef207\") " pod="openstack-kuttl-tests/swift-ring-rebalance-89ftb" Mar 16 16:31:57 crc kubenswrapper[5120]: I0316 16:31:57.196820 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/416ad117-1241-46b5-8e7f-92967c3fa54b-operator-scripts\") pod \"glance-fe40-account-create-update-prnl2\" (UID: \"416ad117-1241-46b5-8e7f-92967c3fa54b\") " pod="openstack-kuttl-tests/glance-fe40-account-create-update-prnl2" Mar 16 16:31:57 crc kubenswrapper[5120]: I0316 16:31:57.197489 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/be43c69b-cb44-44e0-bb6c-a220d59ef207-etc-swift\") pod \"swift-ring-rebalance-89ftb\" (UID: \"be43c69b-cb44-44e0-bb6c-a220d59ef207\") " pod="openstack-kuttl-tests/swift-ring-rebalance-89ftb" Mar 16 16:31:57 crc kubenswrapper[5120]: I0316 16:31:57.197681 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/be43c69b-cb44-44e0-bb6c-a220d59ef207-ring-data-devices\") pod \"swift-ring-rebalance-89ftb\" (UID: \"be43c69b-cb44-44e0-bb6c-a220d59ef207\") " pod="openstack-kuttl-tests/swift-ring-rebalance-89ftb" Mar 16 16:31:57 crc kubenswrapper[5120]: I0316 16:31:57.199087 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/be43c69b-cb44-44e0-bb6c-a220d59ef207-scripts\") pod \"swift-ring-rebalance-89ftb\" (UID: \"be43c69b-cb44-44e0-bb6c-a220d59ef207\") " pod="openstack-kuttl-tests/swift-ring-rebalance-89ftb" Mar 16 16:31:57 crc kubenswrapper[5120]: I0316 16:31:57.199909 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/be43c69b-cb44-44e0-bb6c-a220d59ef207-swiftconf\") pod \"swift-ring-rebalance-89ftb\" (UID: \"be43c69b-cb44-44e0-bb6c-a220d59ef207\") " pod="openstack-kuttl-tests/swift-ring-rebalance-89ftb" Mar 16 16:31:57 crc kubenswrapper[5120]: I0316 16:31:57.201460 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/be43c69b-cb44-44e0-bb6c-a220d59ef207-combined-ca-bundle\") pod \"swift-ring-rebalance-89ftb\" (UID: \"be43c69b-cb44-44e0-bb6c-a220d59ef207\") " pod="openstack-kuttl-tests/swift-ring-rebalance-89ftb" Mar 16 16:31:57 crc kubenswrapper[5120]: I0316 16:31:57.203211 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/be43c69b-cb44-44e0-bb6c-a220d59ef207-dispersionconf\") pod \"swift-ring-rebalance-89ftb\" (UID: \"be43c69b-cb44-44e0-bb6c-a220d59ef207\") " pod="openstack-kuttl-tests/swift-ring-rebalance-89ftb" Mar 16 16:31:57 crc kubenswrapper[5120]: I0316 16:31:57.212219 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzg5f\" (UniqueName: \"kubernetes.io/projected/be43c69b-cb44-44e0-bb6c-a220d59ef207-kube-api-access-xzg5f\") pod \"swift-ring-rebalance-89ftb\" (UID: \"be43c69b-cb44-44e0-bb6c-a220d59ef207\") " pod="openstack-kuttl-tests/swift-ring-rebalance-89ftb" Mar 16 16:31:57 crc kubenswrapper[5120]: I0316 16:31:57.215281 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ff7v\" (UniqueName: \"kubernetes.io/projected/416ad117-1241-46b5-8e7f-92967c3fa54b-kube-api-access-9ff7v\") pod \"glance-fe40-account-create-update-prnl2\" (UID: \"416ad117-1241-46b5-8e7f-92967c3fa54b\") " pod="openstack-kuttl-tests/glance-fe40-account-create-update-prnl2" Mar 16 16:31:57 crc kubenswrapper[5120]: I0316 16:31:57.283415 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-create-xkmkh" Mar 16 16:31:57 crc kubenswrapper[5120]: I0316 16:31:57.297928 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-92gqr\" (UniqueName: \"kubernetes.io/projected/74ab8af1-6b3c-451f-802b-a50f2c8db886-kube-api-access-92gqr\") pod \"root-account-create-update-q729t\" (UID: \"74ab8af1-6b3c-451f-802b-a50f2c8db886\") " pod="openstack-kuttl-tests/root-account-create-update-q729t" Mar 16 16:31:57 crc kubenswrapper[5120]: I0316 16:31:57.298078 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/74ab8af1-6b3c-451f-802b-a50f2c8db886-operator-scripts\") pod \"root-account-create-update-q729t\" (UID: \"74ab8af1-6b3c-451f-802b-a50f2c8db886\") " pod="openstack-kuttl-tests/root-account-create-update-q729t" Mar 16 16:31:57 crc kubenswrapper[5120]: I0316 16:31:57.298818 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/74ab8af1-6b3c-451f-802b-a50f2c8db886-operator-scripts\") pod \"root-account-create-update-q729t\" (UID: \"74ab8af1-6b3c-451f-802b-a50f2c8db886\") " pod="openstack-kuttl-tests/root-account-create-update-q729t" Mar 16 16:31:57 crc kubenswrapper[5120]: I0316 16:31:57.316503 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-92gqr\" (UniqueName: \"kubernetes.io/projected/74ab8af1-6b3c-451f-802b-a50f2c8db886-kube-api-access-92gqr\") pod \"root-account-create-update-q729t\" (UID: \"74ab8af1-6b3c-451f-802b-a50f2c8db886\") " pod="openstack-kuttl-tests/root-account-create-update-q729t" Mar 16 16:31:57 crc kubenswrapper[5120]: I0316 16:31:57.320493 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-89ftb" Mar 16 16:31:57 crc kubenswrapper[5120]: I0316 16:31:57.351528 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-fe40-account-create-update-prnl2" Mar 16 16:31:57 crc kubenswrapper[5120]: I0316 16:31:57.460495 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-q729t" Mar 16 16:31:57 crc kubenswrapper[5120]: I0316 16:31:57.752278 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-db-create-xkmkh"] Mar 16 16:31:57 crc kubenswrapper[5120]: I0316 16:31:57.844952 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-89ftb"] Mar 16 16:31:57 crc kubenswrapper[5120]: W0316 16:31:57.850793 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbe43c69b_cb44_44e0_bb6c_a220d59ef207.slice/crio-265d31bac6a366eb4a3ed9ef97d954f1d4d989b30cdf9eefc9b3c20729c024b8 WatchSource:0}: Error finding container 265d31bac6a366eb4a3ed9ef97d954f1d4d989b30cdf9eefc9b3c20729c024b8: Status 404 returned error can't find the container with id 265d31bac6a366eb4a3ed9ef97d954f1d4d989b30cdf9eefc9b3c20729c024b8 Mar 16 16:31:57 crc kubenswrapper[5120]: I0316 16:31:57.885646 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:31:57 crc kubenswrapper[5120]: I0316 16:31:57.943555 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-fe40-account-create-update-prnl2"] Mar 16 16:31:57 crc kubenswrapper[5120]: I0316 16:31:57.951636 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-89ftb" event={"ID":"be43c69b-cb44-44e0-bb6c-a220d59ef207","Type":"ContainerStarted","Data":"265d31bac6a366eb4a3ed9ef97d954f1d4d989b30cdf9eefc9b3c20729c024b8"} Mar 16 16:31:57 crc kubenswrapper[5120]: I0316 16:31:57.955291 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-create-xkmkh" event={"ID":"1e360f6f-ac8a-4bab-a5de-5aa4658444b6","Type":"ContainerStarted","Data":"192abcde65f629b9f67af0f476ee7940f214c0d93b3f49ee18262581dc8d2575"} Mar 16 16:31:57 crc kubenswrapper[5120]: W0316 16:31:57.958796 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod416ad117_1241_46b5_8e7f_92967c3fa54b.slice/crio-e4b5f049403cb20d139190372576f6a909917d99e34ac59fdfb66d0ff5d261b0 WatchSource:0}: Error finding container e4b5f049403cb20d139190372576f6a909917d99e34ac59fdfb66d0ff5d261b0: Status 404 returned error can't find the container with id e4b5f049403cb20d139190372576f6a909917d99e34ac59fdfb66d0ff5d261b0 Mar 16 16:31:58 crc kubenswrapper[5120]: W0316 16:31:58.015485 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod74ab8af1_6b3c_451f_802b_a50f2c8db886.slice/crio-54184fc2bf1fe06344b9e993e1c03af1946591d79c87bced96ee91261462544d WatchSource:0}: Error finding container 54184fc2bf1fe06344b9e993e1c03af1946591d79c87bced96ee91261462544d: Status 404 returned error can't find the container with id 54184fc2bf1fe06344b9e993e1c03af1946591d79c87bced96ee91261462544d Mar 16 16:31:58 crc kubenswrapper[5120]: I0316 16:31:58.015619 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-q729t"] Mar 16 16:31:58 crc kubenswrapper[5120]: I0316 16:31:58.213494 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 16:31:58 crc kubenswrapper[5120]: I0316 16:31:58.219466 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:31:58 crc kubenswrapper[5120]: I0316 16:31:58.223652 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovnnorthd-scripts\"" Mar 16 16:31:58 crc kubenswrapper[5120]: I0316 16:31:58.223878 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ovnnorthd-ovndbs\"" Mar 16 16:31:58 crc kubenswrapper[5120]: I0316 16:31:58.224187 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovnnorthd-config\"" Mar 16 16:31:58 crc kubenswrapper[5120]: I0316 16:31:58.224319 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ovnnorthd-ovnnorthd-dockercfg-22bt4\"" Mar 16 16:31:58 crc kubenswrapper[5120]: I0316 16:31:58.237748 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 16:31:58 crc kubenswrapper[5120]: I0316 16:31:58.323616 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b338d0b9-ef27-4f2b-9ede-7b8c7bdc340c-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"b338d0b9-ef27-4f2b-9ede-7b8c7bdc340c\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:31:58 crc kubenswrapper[5120]: I0316 16:31:58.323684 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/b338d0b9-ef27-4f2b-9ede-7b8c7bdc340c-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"b338d0b9-ef27-4f2b-9ede-7b8c7bdc340c\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:31:58 crc kubenswrapper[5120]: I0316 16:31:58.323719 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-glwdx\" (UniqueName: \"kubernetes.io/projected/b338d0b9-ef27-4f2b-9ede-7b8c7bdc340c-kube-api-access-glwdx\") pod \"ovn-northd-0\" (UID: \"b338d0b9-ef27-4f2b-9ede-7b8c7bdc340c\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:31:58 crc kubenswrapper[5120]: I0316 16:31:58.323839 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/b338d0b9-ef27-4f2b-9ede-7b8c7bdc340c-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"b338d0b9-ef27-4f2b-9ede-7b8c7bdc340c\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:31:58 crc kubenswrapper[5120]: I0316 16:31:58.323868 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/b338d0b9-ef27-4f2b-9ede-7b8c7bdc340c-scripts\") pod \"ovn-northd-0\" (UID: \"b338d0b9-ef27-4f2b-9ede-7b8c7bdc340c\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:31:58 crc kubenswrapper[5120]: I0316 16:31:58.324006 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/b338d0b9-ef27-4f2b-9ede-7b8c7bdc340c-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"b338d0b9-ef27-4f2b-9ede-7b8c7bdc340c\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:31:58 crc kubenswrapper[5120]: I0316 16:31:58.324198 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b338d0b9-ef27-4f2b-9ede-7b8c7bdc340c-config\") pod \"ovn-northd-0\" (UID: \"b338d0b9-ef27-4f2b-9ede-7b8c7bdc340c\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:31:58 crc kubenswrapper[5120]: I0316 16:31:58.426025 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b338d0b9-ef27-4f2b-9ede-7b8c7bdc340c-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"b338d0b9-ef27-4f2b-9ede-7b8c7bdc340c\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:31:58 crc kubenswrapper[5120]: I0316 16:31:58.426292 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/b338d0b9-ef27-4f2b-9ede-7b8c7bdc340c-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"b338d0b9-ef27-4f2b-9ede-7b8c7bdc340c\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:31:58 crc kubenswrapper[5120]: I0316 16:31:58.426330 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-glwdx\" (UniqueName: \"kubernetes.io/projected/b338d0b9-ef27-4f2b-9ede-7b8c7bdc340c-kube-api-access-glwdx\") pod \"ovn-northd-0\" (UID: \"b338d0b9-ef27-4f2b-9ede-7b8c7bdc340c\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:31:58 crc kubenswrapper[5120]: I0316 16:31:58.426598 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/b338d0b9-ef27-4f2b-9ede-7b8c7bdc340c-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"b338d0b9-ef27-4f2b-9ede-7b8c7bdc340c\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:31:58 crc kubenswrapper[5120]: I0316 16:31:58.427394 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/b338d0b9-ef27-4f2b-9ede-7b8c7bdc340c-scripts\") pod \"ovn-northd-0\" (UID: \"b338d0b9-ef27-4f2b-9ede-7b8c7bdc340c\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:31:58 crc kubenswrapper[5120]: I0316 16:31:58.427559 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/b338d0b9-ef27-4f2b-9ede-7b8c7bdc340c-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"b338d0b9-ef27-4f2b-9ede-7b8c7bdc340c\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:31:58 crc kubenswrapper[5120]: I0316 16:31:58.427724 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b338d0b9-ef27-4f2b-9ede-7b8c7bdc340c-config\") pod \"ovn-northd-0\" (UID: \"b338d0b9-ef27-4f2b-9ede-7b8c7bdc340c\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:31:58 crc kubenswrapper[5120]: I0316 16:31:58.428424 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/b338d0b9-ef27-4f2b-9ede-7b8c7bdc340c-scripts\") pod \"ovn-northd-0\" (UID: \"b338d0b9-ef27-4f2b-9ede-7b8c7bdc340c\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:31:58 crc kubenswrapper[5120]: I0316 16:31:58.428615 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b338d0b9-ef27-4f2b-9ede-7b8c7bdc340c-config\") pod \"ovn-northd-0\" (UID: \"b338d0b9-ef27-4f2b-9ede-7b8c7bdc340c\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:31:58 crc kubenswrapper[5120]: I0316 16:31:58.428951 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/b338d0b9-ef27-4f2b-9ede-7b8c7bdc340c-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"b338d0b9-ef27-4f2b-9ede-7b8c7bdc340c\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:31:58 crc kubenswrapper[5120]: I0316 16:31:58.432121 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/b338d0b9-ef27-4f2b-9ede-7b8c7bdc340c-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"b338d0b9-ef27-4f2b-9ede-7b8c7bdc340c\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:31:58 crc kubenswrapper[5120]: I0316 16:31:58.432432 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/b338d0b9-ef27-4f2b-9ede-7b8c7bdc340c-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"b338d0b9-ef27-4f2b-9ede-7b8c7bdc340c\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:31:58 crc kubenswrapper[5120]: I0316 16:31:58.432558 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b338d0b9-ef27-4f2b-9ede-7b8c7bdc340c-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"b338d0b9-ef27-4f2b-9ede-7b8c7bdc340c\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:31:58 crc kubenswrapper[5120]: I0316 16:31:58.443490 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-glwdx\" (UniqueName: \"kubernetes.io/projected/b338d0b9-ef27-4f2b-9ede-7b8c7bdc340c-kube-api-access-glwdx\") pod \"ovn-northd-0\" (UID: \"b338d0b9-ef27-4f2b-9ede-7b8c7bdc340c\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:31:58 crc kubenswrapper[5120]: I0316 16:31:58.539195 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:31:58 crc kubenswrapper[5120]: I0316 16:31:58.964883 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-89ftb" event={"ID":"be43c69b-cb44-44e0-bb6c-a220d59ef207","Type":"ContainerStarted","Data":"57687390448bcc2265e1a799e55b69e9d40e9eda293b3c9c3313d35a47e5da14"} Mar 16 16:31:58 crc kubenswrapper[5120]: I0316 16:31:58.968164 5120 generic.go:358] "Generic (PLEG): container finished" podID="416ad117-1241-46b5-8e7f-92967c3fa54b" containerID="ea6d47f0ec571023b61526cc19a34ccf3c33a6f73b20dbf7b82d054f7e5df747" exitCode=0 Mar 16 16:31:58 crc kubenswrapper[5120]: I0316 16:31:58.968633 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-fe40-account-create-update-prnl2" event={"ID":"416ad117-1241-46b5-8e7f-92967c3fa54b","Type":"ContainerDied","Data":"ea6d47f0ec571023b61526cc19a34ccf3c33a6f73b20dbf7b82d054f7e5df747"} Mar 16 16:31:58 crc kubenswrapper[5120]: I0316 16:31:58.968732 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-fe40-account-create-update-prnl2" event={"ID":"416ad117-1241-46b5-8e7f-92967c3fa54b","Type":"ContainerStarted","Data":"e4b5f049403cb20d139190372576f6a909917d99e34ac59fdfb66d0ff5d261b0"} Mar 16 16:31:58 crc kubenswrapper[5120]: I0316 16:31:58.970927 5120 generic.go:358] "Generic (PLEG): container finished" podID="74ab8af1-6b3c-451f-802b-a50f2c8db886" containerID="8adf58898f3d43249b3bfdbf4783a9eb7fb39167b029caf84c8efa99a098b342" exitCode=0 Mar 16 16:31:58 crc kubenswrapper[5120]: I0316 16:31:58.971068 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-q729t" event={"ID":"74ab8af1-6b3c-451f-802b-a50f2c8db886","Type":"ContainerDied","Data":"8adf58898f3d43249b3bfdbf4783a9eb7fb39167b029caf84c8efa99a098b342"} Mar 16 16:31:58 crc kubenswrapper[5120]: I0316 16:31:58.971094 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-q729t" event={"ID":"74ab8af1-6b3c-451f-802b-a50f2c8db886","Type":"ContainerStarted","Data":"54184fc2bf1fe06344b9e993e1c03af1946591d79c87bced96ee91261462544d"} Mar 16 16:31:58 crc kubenswrapper[5120]: I0316 16:31:58.973231 5120 generic.go:358] "Generic (PLEG): container finished" podID="1e360f6f-ac8a-4bab-a5de-5aa4658444b6" containerID="484d0c35bfa0263f44925d453776161f308782a577e8f562fb88ffa30b99a4b4" exitCode=0 Mar 16 16:31:58 crc kubenswrapper[5120]: I0316 16:31:58.973508 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-create-xkmkh" event={"ID":"1e360f6f-ac8a-4bab-a5de-5aa4658444b6","Type":"ContainerDied","Data":"484d0c35bfa0263f44925d453776161f308782a577e8f562fb88ffa30b99a4b4"} Mar 16 16:31:58 crc kubenswrapper[5120]: I0316 16:31:58.994048 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/swift-ring-rebalance-89ftb" podStartSLOduration=2.994025257 podStartE2EDuration="2.994025257s" podCreationTimestamp="2026-03-16 16:31:56 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:31:58.989781036 +0000 UTC m=+3621.143712693" watchObservedRunningTime="2026-03-16 16:31:58.994025257 +0000 UTC m=+3621.147956914" Mar 16 16:31:59 crc kubenswrapper[5120]: I0316 16:31:59.012557 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 16:31:59 crc kubenswrapper[5120]: I0316 16:31:59.984027 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"b338d0b9-ef27-4f2b-9ede-7b8c7bdc340c","Type":"ContainerStarted","Data":"73db1999d966547a044d3aaec5511a5efc66907f7326abbc3f17534a8a44887e"} Mar 16 16:31:59 crc kubenswrapper[5120]: I0316 16:31:59.986443 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:31:59 crc kubenswrapper[5120]: I0316 16:31:59.986567 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"b338d0b9-ef27-4f2b-9ede-7b8c7bdc340c","Type":"ContainerStarted","Data":"ca9d3b2a88dcee0195ef7ca1ee4e2649b606030f101dabe1372a8df6254de533"} Mar 16 16:31:59 crc kubenswrapper[5120]: I0316 16:31:59.986665 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"b338d0b9-ef27-4f2b-9ede-7b8c7bdc340c","Type":"ContainerStarted","Data":"6ccf8a98e432490306536dca38893b0c1d5e70dc92a31b9969c331f0c11e831f"} Mar 16 16:32:00 crc kubenswrapper[5120]: I0316 16:32:00.129150 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovn-northd-0" podStartSLOduration=2.129133795 podStartE2EDuration="2.129133795s" podCreationTimestamp="2026-03-16 16:31:58 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:32:00.006019204 +0000 UTC m=+3622.159950991" watchObservedRunningTime="2026-03-16 16:32:00.129133795 +0000 UTC m=+3622.283065452" Mar 16 16:32:00 crc kubenswrapper[5120]: I0316 16:32:00.131837 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-infra/auto-csr-approver-29561312-5lswt"] Mar 16 16:32:00 crc kubenswrapper[5120]: I0316 16:32:00.138599 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561312-5lswt" Mar 16 16:32:00 crc kubenswrapper[5120]: I0316 16:32:00.138810 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561312-5lswt"] Mar 16 16:32:00 crc kubenswrapper[5120]: I0316 16:32:00.141967 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"openshift-service-ca.crt\"" Mar 16 16:32:00 crc kubenswrapper[5120]: I0316 16:32:00.142059 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"kube-root-ca.crt\"" Mar 16 16:32:00 crc kubenswrapper[5120]: I0316 16:32:00.142411 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-infra\"/\"csr-approver-sa-dockercfg-x2nsz\"" Mar 16 16:32:00 crc kubenswrapper[5120]: I0316 16:32:00.267081 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2zhw\" (UniqueName: \"kubernetes.io/projected/3793e4e0-aa5c-4271-b10c-232e173f113f-kube-api-access-q2zhw\") pod \"auto-csr-approver-29561312-5lswt\" (UID: \"3793e4e0-aa5c-4271-b10c-232e173f113f\") " pod="openshift-infra/auto-csr-approver-29561312-5lswt" Mar 16 16:32:00 crc kubenswrapper[5120]: I0316 16:32:00.369563 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q2zhw\" (UniqueName: \"kubernetes.io/projected/3793e4e0-aa5c-4271-b10c-232e173f113f-kube-api-access-q2zhw\") pod \"auto-csr-approver-29561312-5lswt\" (UID: \"3793e4e0-aa5c-4271-b10c-232e173f113f\") " pod="openshift-infra/auto-csr-approver-29561312-5lswt" Mar 16 16:32:00 crc kubenswrapper[5120]: I0316 16:32:00.390237 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2zhw\" (UniqueName: \"kubernetes.io/projected/3793e4e0-aa5c-4271-b10c-232e173f113f-kube-api-access-q2zhw\") pod \"auto-csr-approver-29561312-5lswt\" (UID: \"3793e4e0-aa5c-4271-b10c-232e173f113f\") " pod="openshift-infra/auto-csr-approver-29561312-5lswt" Mar 16 16:32:00 crc kubenswrapper[5120]: I0316 16:32:00.464002 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561312-5lswt" Mar 16 16:32:00 crc kubenswrapper[5120]: I0316 16:32:00.471113 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-create-xkmkh" Mar 16 16:32:00 crc kubenswrapper[5120]: I0316 16:32:00.572675 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wv7fl\" (UniqueName: \"kubernetes.io/projected/1e360f6f-ac8a-4bab-a5de-5aa4658444b6-kube-api-access-wv7fl\") pod \"1e360f6f-ac8a-4bab-a5de-5aa4658444b6\" (UID: \"1e360f6f-ac8a-4bab-a5de-5aa4658444b6\") " Mar 16 16:32:00 crc kubenswrapper[5120]: I0316 16:32:00.573290 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/1e360f6f-ac8a-4bab-a5de-5aa4658444b6-operator-scripts\") pod \"1e360f6f-ac8a-4bab-a5de-5aa4658444b6\" (UID: \"1e360f6f-ac8a-4bab-a5de-5aa4658444b6\") " Mar 16 16:32:00 crc kubenswrapper[5120]: I0316 16:32:00.573885 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e360f6f-ac8a-4bab-a5de-5aa4658444b6-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "1e360f6f-ac8a-4bab-a5de-5aa4658444b6" (UID: "1e360f6f-ac8a-4bab-a5de-5aa4658444b6"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:32:00 crc kubenswrapper[5120]: I0316 16:32:00.579626 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e360f6f-ac8a-4bab-a5de-5aa4658444b6-kube-api-access-wv7fl" (OuterVolumeSpecName: "kube-api-access-wv7fl") pod "1e360f6f-ac8a-4bab-a5de-5aa4658444b6" (UID: "1e360f6f-ac8a-4bab-a5de-5aa4658444b6"). InnerVolumeSpecName "kube-api-access-wv7fl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:32:00 crc kubenswrapper[5120]: I0316 16:32:00.621280 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-q729t" Mar 16 16:32:00 crc kubenswrapper[5120]: I0316 16:32:00.639295 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-fe40-account-create-update-prnl2" Mar 16 16:32:00 crc kubenswrapper[5120]: I0316 16:32:00.675390 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wv7fl\" (UniqueName: \"kubernetes.io/projected/1e360f6f-ac8a-4bab-a5de-5aa4658444b6-kube-api-access-wv7fl\") on node \"crc\" DevicePath \"\"" Mar 16 16:32:00 crc kubenswrapper[5120]: I0316 16:32:00.675430 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/1e360f6f-ac8a-4bab-a5de-5aa4658444b6-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:32:00 crc kubenswrapper[5120]: I0316 16:32:00.776851 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/74ab8af1-6b3c-451f-802b-a50f2c8db886-operator-scripts\") pod \"74ab8af1-6b3c-451f-802b-a50f2c8db886\" (UID: \"74ab8af1-6b3c-451f-802b-a50f2c8db886\") " Mar 16 16:32:00 crc kubenswrapper[5120]: I0316 16:32:00.776979 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/416ad117-1241-46b5-8e7f-92967c3fa54b-operator-scripts\") pod \"416ad117-1241-46b5-8e7f-92967c3fa54b\" (UID: \"416ad117-1241-46b5-8e7f-92967c3fa54b\") " Mar 16 16:32:00 crc kubenswrapper[5120]: I0316 16:32:00.777196 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9ff7v\" (UniqueName: \"kubernetes.io/projected/416ad117-1241-46b5-8e7f-92967c3fa54b-kube-api-access-9ff7v\") pod \"416ad117-1241-46b5-8e7f-92967c3fa54b\" (UID: \"416ad117-1241-46b5-8e7f-92967c3fa54b\") " Mar 16 16:32:00 crc kubenswrapper[5120]: I0316 16:32:00.777369 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-92gqr\" (UniqueName: \"kubernetes.io/projected/74ab8af1-6b3c-451f-802b-a50f2c8db886-kube-api-access-92gqr\") pod \"74ab8af1-6b3c-451f-802b-a50f2c8db886\" (UID: \"74ab8af1-6b3c-451f-802b-a50f2c8db886\") " Mar 16 16:32:00 crc kubenswrapper[5120]: I0316 16:32:00.777393 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74ab8af1-6b3c-451f-802b-a50f2c8db886-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "74ab8af1-6b3c-451f-802b-a50f2c8db886" (UID: "74ab8af1-6b3c-451f-802b-a50f2c8db886"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:32:00 crc kubenswrapper[5120]: I0316 16:32:00.777464 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/416ad117-1241-46b5-8e7f-92967c3fa54b-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "416ad117-1241-46b5-8e7f-92967c3fa54b" (UID: "416ad117-1241-46b5-8e7f-92967c3fa54b"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:32:00 crc kubenswrapper[5120]: I0316 16:32:00.778349 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/74ab8af1-6b3c-451f-802b-a50f2c8db886-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:32:00 crc kubenswrapper[5120]: I0316 16:32:00.778382 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/416ad117-1241-46b5-8e7f-92967c3fa54b-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:32:00 crc kubenswrapper[5120]: I0316 16:32:00.781707 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74ab8af1-6b3c-451f-802b-a50f2c8db886-kube-api-access-92gqr" (OuterVolumeSpecName: "kube-api-access-92gqr") pod "74ab8af1-6b3c-451f-802b-a50f2c8db886" (UID: "74ab8af1-6b3c-451f-802b-a50f2c8db886"). InnerVolumeSpecName "kube-api-access-92gqr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:32:00 crc kubenswrapper[5120]: I0316 16:32:00.782228 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/416ad117-1241-46b5-8e7f-92967c3fa54b-kube-api-access-9ff7v" (OuterVolumeSpecName: "kube-api-access-9ff7v") pod "416ad117-1241-46b5-8e7f-92967c3fa54b" (UID: "416ad117-1241-46b5-8e7f-92967c3fa54b"). InnerVolumeSpecName "kube-api-access-9ff7v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:32:00 crc kubenswrapper[5120]: I0316 16:32:00.879920 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9ff7v\" (UniqueName: \"kubernetes.io/projected/416ad117-1241-46b5-8e7f-92967c3fa54b-kube-api-access-9ff7v\") on node \"crc\" DevicePath \"\"" Mar 16 16:32:00 crc kubenswrapper[5120]: I0316 16:32:00.879954 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-92gqr\" (UniqueName: \"kubernetes.io/projected/74ab8af1-6b3c-451f-802b-a50f2c8db886-kube-api-access-92gqr\") on node \"crc\" DevicePath \"\"" Mar 16 16:32:00 crc kubenswrapper[5120]: W0316 16:32:00.976079 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3793e4e0_aa5c_4271_b10c_232e173f113f.slice/crio-ea88fc0c5de4fa60ed93cf21316e5c49a89474d0aed147f91c2ad05686d358da WatchSource:0}: Error finding container ea88fc0c5de4fa60ed93cf21316e5c49a89474d0aed147f91c2ad05686d358da: Status 404 returned error can't find the container with id ea88fc0c5de4fa60ed93cf21316e5c49a89474d0aed147f91c2ad05686d358da Mar 16 16:32:00 crc kubenswrapper[5120]: I0316 16:32:00.979195 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561312-5lswt"] Mar 16 16:32:00 crc kubenswrapper[5120]: I0316 16:32:00.993914 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-create-xkmkh" Mar 16 16:32:00 crc kubenswrapper[5120]: I0316 16:32:00.993903 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-create-xkmkh" event={"ID":"1e360f6f-ac8a-4bab-a5de-5aa4658444b6","Type":"ContainerDied","Data":"192abcde65f629b9f67af0f476ee7940f214c0d93b3f49ee18262581dc8d2575"} Mar 16 16:32:00 crc kubenswrapper[5120]: I0316 16:32:00.994058 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="192abcde65f629b9f67af0f476ee7940f214c0d93b3f49ee18262581dc8d2575" Mar 16 16:32:00 crc kubenswrapper[5120]: I0316 16:32:00.996170 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-fe40-account-create-update-prnl2" event={"ID":"416ad117-1241-46b5-8e7f-92967c3fa54b","Type":"ContainerDied","Data":"e4b5f049403cb20d139190372576f6a909917d99e34ac59fdfb66d0ff5d261b0"} Mar 16 16:32:00 crc kubenswrapper[5120]: I0316 16:32:00.996219 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e4b5f049403cb20d139190372576f6a909917d99e34ac59fdfb66d0ff5d261b0" Mar 16 16:32:00 crc kubenswrapper[5120]: I0316 16:32:00.996348 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-fe40-account-create-update-prnl2" Mar 16 16:32:00 crc kubenswrapper[5120]: I0316 16:32:00.999611 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561312-5lswt" event={"ID":"3793e4e0-aa5c-4271-b10c-232e173f113f","Type":"ContainerStarted","Data":"ea88fc0c5de4fa60ed93cf21316e5c49a89474d0aed147f91c2ad05686d358da"} Mar 16 16:32:01 crc kubenswrapper[5120]: I0316 16:32:01.001989 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-q729t" event={"ID":"74ab8af1-6b3c-451f-802b-a50f2c8db886","Type":"ContainerDied","Data":"54184fc2bf1fe06344b9e993e1c03af1946591d79c87bced96ee91261462544d"} Mar 16 16:32:01 crc kubenswrapper[5120]: I0316 16:32:01.002020 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="54184fc2bf1fe06344b9e993e1c03af1946591d79c87bced96ee91261462544d" Mar 16 16:32:01 crc kubenswrapper[5120]: I0316 16:32:01.002027 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-q729t" Mar 16 16:32:01 crc kubenswrapper[5120]: I0316 16:32:01.185553 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/68089cb0-f9b0-4b76-9778-e2edffaa4f55-etc-swift\") pod \"swift-storage-0\" (UID: \"68089cb0-f9b0-4b76-9778-e2edffaa4f55\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:32:01 crc kubenswrapper[5120]: E0316 16:32:01.185791 5120 projected.go:289] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Mar 16 16:32:01 crc kubenswrapper[5120]: E0316 16:32:01.185879 5120 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Mar 16 16:32:01 crc kubenswrapper[5120]: E0316 16:32:01.186472 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/68089cb0-f9b0-4b76-9778-e2edffaa4f55-etc-swift podName:68089cb0-f9b0-4b76-9778-e2edffaa4f55 nodeName:}" failed. No retries permitted until 2026-03-16 16:32:09.186446099 +0000 UTC m=+3631.340377756 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/68089cb0-f9b0-4b76-9778-e2edffaa4f55-etc-swift") pod "swift-storage-0" (UID: "68089cb0-f9b0-4b76-9778-e2edffaa4f55") : configmap "swift-ring-files" not found Mar 16 16:32:02 crc kubenswrapper[5120]: I0316 16:32:02.147927 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-db-sync-lb7cd"] Mar 16 16:32:02 crc kubenswrapper[5120]: I0316 16:32:02.149418 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="416ad117-1241-46b5-8e7f-92967c3fa54b" containerName="mariadb-account-create-update" Mar 16 16:32:02 crc kubenswrapper[5120]: I0316 16:32:02.149445 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="416ad117-1241-46b5-8e7f-92967c3fa54b" containerName="mariadb-account-create-update" Mar 16 16:32:02 crc kubenswrapper[5120]: I0316 16:32:02.149504 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74ab8af1-6b3c-451f-802b-a50f2c8db886" containerName="mariadb-account-create-update" Mar 16 16:32:02 crc kubenswrapper[5120]: I0316 16:32:02.149516 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="74ab8af1-6b3c-451f-802b-a50f2c8db886" containerName="mariadb-account-create-update" Mar 16 16:32:02 crc kubenswrapper[5120]: I0316 16:32:02.149532 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e360f6f-ac8a-4bab-a5de-5aa4658444b6" containerName="mariadb-database-create" Mar 16 16:32:02 crc kubenswrapper[5120]: I0316 16:32:02.149539 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e360f6f-ac8a-4bab-a5de-5aa4658444b6" containerName="mariadb-database-create" Mar 16 16:32:02 crc kubenswrapper[5120]: I0316 16:32:02.149708 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1e360f6f-ac8a-4bab-a5de-5aa4658444b6" containerName="mariadb-database-create" Mar 16 16:32:02 crc kubenswrapper[5120]: I0316 16:32:02.149734 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="416ad117-1241-46b5-8e7f-92967c3fa54b" containerName="mariadb-account-create-update" Mar 16 16:32:02 crc kubenswrapper[5120]: I0316 16:32:02.149742 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="74ab8af1-6b3c-451f-802b-a50f2c8db886" containerName="mariadb-account-create-update" Mar 16 16:32:02 crc kubenswrapper[5120]: I0316 16:32:02.154235 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-lb7cd" Mar 16 16:32:02 crc kubenswrapper[5120]: I0316 16:32:02.156583 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-config-data\"" Mar 16 16:32:02 crc kubenswrapper[5120]: I0316 16:32:02.156741 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-glance-dockercfg-fnn75\"" Mar 16 16:32:02 crc kubenswrapper[5120]: I0316 16:32:02.158523 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-lb7cd"] Mar 16 16:32:02 crc kubenswrapper[5120]: I0316 16:32:02.315343 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/f301c55e-0c1a-4861-9acb-e2cdb9e539f2-db-sync-config-data\") pod \"glance-db-sync-lb7cd\" (UID: \"f301c55e-0c1a-4861-9acb-e2cdb9e539f2\") " pod="openstack-kuttl-tests/glance-db-sync-lb7cd" Mar 16 16:32:02 crc kubenswrapper[5120]: I0316 16:32:02.315928 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f301c55e-0c1a-4861-9acb-e2cdb9e539f2-config-data\") pod \"glance-db-sync-lb7cd\" (UID: \"f301c55e-0c1a-4861-9acb-e2cdb9e539f2\") " pod="openstack-kuttl-tests/glance-db-sync-lb7cd" Mar 16 16:32:02 crc kubenswrapper[5120]: I0316 16:32:02.316097 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xv7xq\" (UniqueName: \"kubernetes.io/projected/f301c55e-0c1a-4861-9acb-e2cdb9e539f2-kube-api-access-xv7xq\") pod \"glance-db-sync-lb7cd\" (UID: \"f301c55e-0c1a-4861-9acb-e2cdb9e539f2\") " pod="openstack-kuttl-tests/glance-db-sync-lb7cd" Mar 16 16:32:02 crc kubenswrapper[5120]: I0316 16:32:02.316602 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f301c55e-0c1a-4861-9acb-e2cdb9e539f2-combined-ca-bundle\") pod \"glance-db-sync-lb7cd\" (UID: \"f301c55e-0c1a-4861-9acb-e2cdb9e539f2\") " pod="openstack-kuttl-tests/glance-db-sync-lb7cd" Mar 16 16:32:02 crc kubenswrapper[5120]: I0316 16:32:02.418892 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f301c55e-0c1a-4861-9acb-e2cdb9e539f2-combined-ca-bundle\") pod \"glance-db-sync-lb7cd\" (UID: \"f301c55e-0c1a-4861-9acb-e2cdb9e539f2\") " pod="openstack-kuttl-tests/glance-db-sync-lb7cd" Mar 16 16:32:02 crc kubenswrapper[5120]: I0316 16:32:02.419038 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/f301c55e-0c1a-4861-9acb-e2cdb9e539f2-db-sync-config-data\") pod \"glance-db-sync-lb7cd\" (UID: \"f301c55e-0c1a-4861-9acb-e2cdb9e539f2\") " pod="openstack-kuttl-tests/glance-db-sync-lb7cd" Mar 16 16:32:02 crc kubenswrapper[5120]: I0316 16:32:02.419086 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f301c55e-0c1a-4861-9acb-e2cdb9e539f2-config-data\") pod \"glance-db-sync-lb7cd\" (UID: \"f301c55e-0c1a-4861-9acb-e2cdb9e539f2\") " pod="openstack-kuttl-tests/glance-db-sync-lb7cd" Mar 16 16:32:02 crc kubenswrapper[5120]: I0316 16:32:02.419134 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xv7xq\" (UniqueName: \"kubernetes.io/projected/f301c55e-0c1a-4861-9acb-e2cdb9e539f2-kube-api-access-xv7xq\") pod \"glance-db-sync-lb7cd\" (UID: \"f301c55e-0c1a-4861-9acb-e2cdb9e539f2\") " pod="openstack-kuttl-tests/glance-db-sync-lb7cd" Mar 16 16:32:02 crc kubenswrapper[5120]: I0316 16:32:02.426672 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/f301c55e-0c1a-4861-9acb-e2cdb9e539f2-db-sync-config-data\") pod \"glance-db-sync-lb7cd\" (UID: \"f301c55e-0c1a-4861-9acb-e2cdb9e539f2\") " pod="openstack-kuttl-tests/glance-db-sync-lb7cd" Mar 16 16:32:02 crc kubenswrapper[5120]: I0316 16:32:02.427178 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f301c55e-0c1a-4861-9acb-e2cdb9e539f2-config-data\") pod \"glance-db-sync-lb7cd\" (UID: \"f301c55e-0c1a-4861-9acb-e2cdb9e539f2\") " pod="openstack-kuttl-tests/glance-db-sync-lb7cd" Mar 16 16:32:02 crc kubenswrapper[5120]: I0316 16:32:02.431150 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f301c55e-0c1a-4861-9acb-e2cdb9e539f2-combined-ca-bundle\") pod \"glance-db-sync-lb7cd\" (UID: \"f301c55e-0c1a-4861-9acb-e2cdb9e539f2\") " pod="openstack-kuttl-tests/glance-db-sync-lb7cd" Mar 16 16:32:02 crc kubenswrapper[5120]: I0316 16:32:02.447125 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xv7xq\" (UniqueName: \"kubernetes.io/projected/f301c55e-0c1a-4861-9acb-e2cdb9e539f2-kube-api-access-xv7xq\") pod \"glance-db-sync-lb7cd\" (UID: \"f301c55e-0c1a-4861-9acb-e2cdb9e539f2\") " pod="openstack-kuttl-tests/glance-db-sync-lb7cd" Mar 16 16:32:02 crc kubenswrapper[5120]: I0316 16:32:02.470622 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-lb7cd" Mar 16 16:32:02 crc kubenswrapper[5120]: I0316 16:32:02.928622 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-lb7cd"] Mar 16 16:32:03 crc kubenswrapper[5120]: I0316 16:32:03.026396 5120 generic.go:358] "Generic (PLEG): container finished" podID="3793e4e0-aa5c-4271-b10c-232e173f113f" containerID="192c3a9ab1613f3bb6ee17986151d5a0022fe60e91339fb2fc4a8768e7821c2d" exitCode=0 Mar 16 16:32:03 crc kubenswrapper[5120]: I0316 16:32:03.026504 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561312-5lswt" event={"ID":"3793e4e0-aa5c-4271-b10c-232e173f113f","Type":"ContainerDied","Data":"192c3a9ab1613f3bb6ee17986151d5a0022fe60e91339fb2fc4a8768e7821c2d"} Mar 16 16:32:03 crc kubenswrapper[5120]: I0316 16:32:03.028965 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-lb7cd" event={"ID":"f301c55e-0c1a-4861-9acb-e2cdb9e539f2","Type":"ContainerStarted","Data":"32c8a577521191915bd636f62c2f99c59cd154c9f2b4e3791e2d8776e9f0879f"} Mar 16 16:32:03 crc kubenswrapper[5120]: I0316 16:32:03.410983 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-q729t"] Mar 16 16:32:03 crc kubenswrapper[5120]: I0316 16:32:03.422157 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-q729t"] Mar 16 16:32:04 crc kubenswrapper[5120]: I0316 16:32:04.040176 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-lb7cd" event={"ID":"f301c55e-0c1a-4861-9acb-e2cdb9e539f2","Type":"ContainerStarted","Data":"ff75c817947243b5be26e301418ba335521570748023d806d32965c0968e802e"} Mar 16 16:32:04 crc kubenswrapper[5120]: I0316 16:32:04.062737 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-db-sync-lb7cd" podStartSLOduration=2.062716246 podStartE2EDuration="2.062716246s" podCreationTimestamp="2026-03-16 16:32:02 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:32:04.054097001 +0000 UTC m=+3626.208028658" watchObservedRunningTime="2026-03-16 16:32:04.062716246 +0000 UTC m=+3626.216647903" Mar 16 16:32:04 crc kubenswrapper[5120]: I0316 16:32:04.397323 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561312-5lswt" Mar 16 16:32:04 crc kubenswrapper[5120]: I0316 16:32:04.561621 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q2zhw\" (UniqueName: \"kubernetes.io/projected/3793e4e0-aa5c-4271-b10c-232e173f113f-kube-api-access-q2zhw\") pod \"3793e4e0-aa5c-4271-b10c-232e173f113f\" (UID: \"3793e4e0-aa5c-4271-b10c-232e173f113f\") " Mar 16 16:32:04 crc kubenswrapper[5120]: I0316 16:32:04.570607 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3793e4e0-aa5c-4271-b10c-232e173f113f-kube-api-access-q2zhw" (OuterVolumeSpecName: "kube-api-access-q2zhw") pod "3793e4e0-aa5c-4271-b10c-232e173f113f" (UID: "3793e4e0-aa5c-4271-b10c-232e173f113f"). InnerVolumeSpecName "kube-api-access-q2zhw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:32:04 crc kubenswrapper[5120]: I0316 16:32:04.663984 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q2zhw\" (UniqueName: \"kubernetes.io/projected/3793e4e0-aa5c-4271-b10c-232e173f113f-kube-api-access-q2zhw\") on node \"crc\" DevicePath \"\"" Mar 16 16:32:04 crc kubenswrapper[5120]: I0316 16:32:04.673711 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="74ab8af1-6b3c-451f-802b-a50f2c8db886" path="/var/lib/kubelet/pods/74ab8af1-6b3c-451f-802b-a50f2c8db886/volumes" Mar 16 16:32:05 crc kubenswrapper[5120]: I0316 16:32:05.050753 5120 generic.go:358] "Generic (PLEG): container finished" podID="be43c69b-cb44-44e0-bb6c-a220d59ef207" containerID="57687390448bcc2265e1a799e55b69e9d40e9eda293b3c9c3313d35a47e5da14" exitCode=0 Mar 16 16:32:05 crc kubenswrapper[5120]: I0316 16:32:05.050961 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-89ftb" event={"ID":"be43c69b-cb44-44e0-bb6c-a220d59ef207","Type":"ContainerDied","Data":"57687390448bcc2265e1a799e55b69e9d40e9eda293b3c9c3313d35a47e5da14"} Mar 16 16:32:05 crc kubenswrapper[5120]: I0316 16:32:05.055061 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561312-5lswt" Mar 16 16:32:05 crc kubenswrapper[5120]: I0316 16:32:05.055532 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561312-5lswt" event={"ID":"3793e4e0-aa5c-4271-b10c-232e173f113f","Type":"ContainerDied","Data":"ea88fc0c5de4fa60ed93cf21316e5c49a89474d0aed147f91c2ad05686d358da"} Mar 16 16:32:05 crc kubenswrapper[5120]: I0316 16:32:05.055562 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ea88fc0c5de4fa60ed93cf21316e5c49a89474d0aed147f91c2ad05686d358da" Mar 16 16:32:05 crc kubenswrapper[5120]: I0316 16:32:05.445697 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-infra/auto-csr-approver-29561306-dnwwx"] Mar 16 16:32:05 crc kubenswrapper[5120]: I0316 16:32:05.454166 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-infra/auto-csr-approver-29561306-dnwwx"] Mar 16 16:32:06 crc kubenswrapper[5120]: I0316 16:32:06.456230 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-89ftb" Mar 16 16:32:06 crc kubenswrapper[5120]: I0316 16:32:06.504046 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/be43c69b-cb44-44e0-bb6c-a220d59ef207-scripts\") pod \"be43c69b-cb44-44e0-bb6c-a220d59ef207\" (UID: \"be43c69b-cb44-44e0-bb6c-a220d59ef207\") " Mar 16 16:32:06 crc kubenswrapper[5120]: I0316 16:32:06.504220 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xzg5f\" (UniqueName: \"kubernetes.io/projected/be43c69b-cb44-44e0-bb6c-a220d59ef207-kube-api-access-xzg5f\") pod \"be43c69b-cb44-44e0-bb6c-a220d59ef207\" (UID: \"be43c69b-cb44-44e0-bb6c-a220d59ef207\") " Mar 16 16:32:06 crc kubenswrapper[5120]: I0316 16:32:06.504395 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/be43c69b-cb44-44e0-bb6c-a220d59ef207-dispersionconf\") pod \"be43c69b-cb44-44e0-bb6c-a220d59ef207\" (UID: \"be43c69b-cb44-44e0-bb6c-a220d59ef207\") " Mar 16 16:32:06 crc kubenswrapper[5120]: I0316 16:32:06.504511 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/be43c69b-cb44-44e0-bb6c-a220d59ef207-ring-data-devices\") pod \"be43c69b-cb44-44e0-bb6c-a220d59ef207\" (UID: \"be43c69b-cb44-44e0-bb6c-a220d59ef207\") " Mar 16 16:32:06 crc kubenswrapper[5120]: I0316 16:32:06.504579 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/be43c69b-cb44-44e0-bb6c-a220d59ef207-combined-ca-bundle\") pod \"be43c69b-cb44-44e0-bb6c-a220d59ef207\" (UID: \"be43c69b-cb44-44e0-bb6c-a220d59ef207\") " Mar 16 16:32:06 crc kubenswrapper[5120]: I0316 16:32:06.504650 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/be43c69b-cb44-44e0-bb6c-a220d59ef207-etc-swift\") pod \"be43c69b-cb44-44e0-bb6c-a220d59ef207\" (UID: \"be43c69b-cb44-44e0-bb6c-a220d59ef207\") " Mar 16 16:32:06 crc kubenswrapper[5120]: I0316 16:32:06.504683 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/be43c69b-cb44-44e0-bb6c-a220d59ef207-swiftconf\") pod \"be43c69b-cb44-44e0-bb6c-a220d59ef207\" (UID: \"be43c69b-cb44-44e0-bb6c-a220d59ef207\") " Mar 16 16:32:06 crc kubenswrapper[5120]: I0316 16:32:06.507411 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be43c69b-cb44-44e0-bb6c-a220d59ef207-etc-swift" (OuterVolumeSpecName: "etc-swift") pod "be43c69b-cb44-44e0-bb6c-a220d59ef207" (UID: "be43c69b-cb44-44e0-bb6c-a220d59ef207"). InnerVolumeSpecName "etc-swift". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:32:06 crc kubenswrapper[5120]: I0316 16:32:06.508058 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be43c69b-cb44-44e0-bb6c-a220d59ef207-ring-data-devices" (OuterVolumeSpecName: "ring-data-devices") pod "be43c69b-cb44-44e0-bb6c-a220d59ef207" (UID: "be43c69b-cb44-44e0-bb6c-a220d59ef207"). InnerVolumeSpecName "ring-data-devices". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:32:06 crc kubenswrapper[5120]: I0316 16:32:06.514569 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be43c69b-cb44-44e0-bb6c-a220d59ef207-kube-api-access-xzg5f" (OuterVolumeSpecName: "kube-api-access-xzg5f") pod "be43c69b-cb44-44e0-bb6c-a220d59ef207" (UID: "be43c69b-cb44-44e0-bb6c-a220d59ef207"). InnerVolumeSpecName "kube-api-access-xzg5f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:32:06 crc kubenswrapper[5120]: I0316 16:32:06.517480 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/be43c69b-cb44-44e0-bb6c-a220d59ef207-dispersionconf" (OuterVolumeSpecName: "dispersionconf") pod "be43c69b-cb44-44e0-bb6c-a220d59ef207" (UID: "be43c69b-cb44-44e0-bb6c-a220d59ef207"). InnerVolumeSpecName "dispersionconf". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:32:06 crc kubenswrapper[5120]: I0316 16:32:06.537025 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/be43c69b-cb44-44e0-bb6c-a220d59ef207-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "be43c69b-cb44-44e0-bb6c-a220d59ef207" (UID: "be43c69b-cb44-44e0-bb6c-a220d59ef207"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:32:06 crc kubenswrapper[5120]: I0316 16:32:06.538750 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be43c69b-cb44-44e0-bb6c-a220d59ef207-scripts" (OuterVolumeSpecName: "scripts") pod "be43c69b-cb44-44e0-bb6c-a220d59ef207" (UID: "be43c69b-cb44-44e0-bb6c-a220d59ef207"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:32:06 crc kubenswrapper[5120]: I0316 16:32:06.539951 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/be43c69b-cb44-44e0-bb6c-a220d59ef207-swiftconf" (OuterVolumeSpecName: "swiftconf") pod "be43c69b-cb44-44e0-bb6c-a220d59ef207" (UID: "be43c69b-cb44-44e0-bb6c-a220d59ef207"). InnerVolumeSpecName "swiftconf". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:32:06 crc kubenswrapper[5120]: I0316 16:32:06.606928 5120 reconciler_common.go:299] "Volume detached for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/be43c69b-cb44-44e0-bb6c-a220d59ef207-dispersionconf\") on node \"crc\" DevicePath \"\"" Mar 16 16:32:06 crc kubenswrapper[5120]: I0316 16:32:06.606972 5120 reconciler_common.go:299] "Volume detached for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/be43c69b-cb44-44e0-bb6c-a220d59ef207-ring-data-devices\") on node \"crc\" DevicePath \"\"" Mar 16 16:32:06 crc kubenswrapper[5120]: I0316 16:32:06.606987 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/be43c69b-cb44-44e0-bb6c-a220d59ef207-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:32:06 crc kubenswrapper[5120]: I0316 16:32:06.606998 5120 reconciler_common.go:299] "Volume detached for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/be43c69b-cb44-44e0-bb6c-a220d59ef207-etc-swift\") on node \"crc\" DevicePath \"\"" Mar 16 16:32:06 crc kubenswrapper[5120]: I0316 16:32:06.607007 5120 reconciler_common.go:299] "Volume detached for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/be43c69b-cb44-44e0-bb6c-a220d59ef207-swiftconf\") on node \"crc\" DevicePath \"\"" Mar 16 16:32:06 crc kubenswrapper[5120]: I0316 16:32:06.607016 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/be43c69b-cb44-44e0-bb6c-a220d59ef207-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:32:06 crc kubenswrapper[5120]: I0316 16:32:06.607028 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xzg5f\" (UniqueName: \"kubernetes.io/projected/be43c69b-cb44-44e0-bb6c-a220d59ef207-kube-api-access-xzg5f\") on node \"crc\" DevicePath \"\"" Mar 16 16:32:06 crc kubenswrapper[5120]: I0316 16:32:06.674261 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8162a42b-127c-4778-a8cb-f965703da580" path="/var/lib/kubelet/pods/8162a42b-127c-4778-a8cb-f965703da580/volumes" Mar 16 16:32:07 crc kubenswrapper[5120]: I0316 16:32:07.084268 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-89ftb" event={"ID":"be43c69b-cb44-44e0-bb6c-a220d59ef207","Type":"ContainerDied","Data":"265d31bac6a366eb4a3ed9ef97d954f1d4d989b30cdf9eefc9b3c20729c024b8"} Mar 16 16:32:07 crc kubenswrapper[5120]: I0316 16:32:07.084323 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="265d31bac6a366eb4a3ed9ef97d954f1d4d989b30cdf9eefc9b3c20729c024b8" Mar 16 16:32:07 crc kubenswrapper[5120]: I0316 16:32:07.084415 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-89ftb" Mar 16 16:32:07 crc kubenswrapper[5120]: I0316 16:32:07.664375 5120 scope.go:117] "RemoveContainer" containerID="0a15d5caff30dc8885f782e59962af7d98d58b39ab76059e56e5827e10e7ab8b" Mar 16 16:32:07 crc kubenswrapper[5120]: E0316 16:32:07.665455 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:32:08 crc kubenswrapper[5120]: E0316 16:32:08.221254 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1439259 actualBytes=10240 Mar 16 16:32:08 crc kubenswrapper[5120]: I0316 16:32:08.403415 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/root-account-create-update-zztjd"] Mar 16 16:32:08 crc kubenswrapper[5120]: I0316 16:32:08.404331 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3793e4e0-aa5c-4271-b10c-232e173f113f" containerName="oc" Mar 16 16:32:08 crc kubenswrapper[5120]: I0316 16:32:08.404352 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="3793e4e0-aa5c-4271-b10c-232e173f113f" containerName="oc" Mar 16 16:32:08 crc kubenswrapper[5120]: I0316 16:32:08.404371 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be43c69b-cb44-44e0-bb6c-a220d59ef207" containerName="swift-ring-rebalance" Mar 16 16:32:08 crc kubenswrapper[5120]: I0316 16:32:08.404378 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="be43c69b-cb44-44e0-bb6c-a220d59ef207" containerName="swift-ring-rebalance" Mar 16 16:32:08 crc kubenswrapper[5120]: I0316 16:32:08.404549 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="be43c69b-cb44-44e0-bb6c-a220d59ef207" containerName="swift-ring-rebalance" Mar 16 16:32:08 crc kubenswrapper[5120]: I0316 16:32:08.404566 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="3793e4e0-aa5c-4271-b10c-232e173f113f" containerName="oc" Mar 16 16:32:08 crc kubenswrapper[5120]: I0316 16:32:08.409461 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-zztjd" Mar 16 16:32:08 crc kubenswrapper[5120]: I0316 16:32:08.411411 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-zztjd"] Mar 16 16:32:08 crc kubenswrapper[5120]: I0316 16:32:08.411798 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"openstack-cell1-mariadb-root-db-secret\"" Mar 16 16:32:08 crc kubenswrapper[5120]: I0316 16:32:08.441689 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0687afe7-6d7e-432f-940f-340f727dbdc8-operator-scripts\") pod \"root-account-create-update-zztjd\" (UID: \"0687afe7-6d7e-432f-940f-340f727dbdc8\") " pod="openstack-kuttl-tests/root-account-create-update-zztjd" Mar 16 16:32:08 crc kubenswrapper[5120]: I0316 16:32:08.441906 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7n8vh\" (UniqueName: \"kubernetes.io/projected/0687afe7-6d7e-432f-940f-340f727dbdc8-kube-api-access-7n8vh\") pod \"root-account-create-update-zztjd\" (UID: \"0687afe7-6d7e-432f-940f-340f727dbdc8\") " pod="openstack-kuttl-tests/root-account-create-update-zztjd" Mar 16 16:32:08 crc kubenswrapper[5120]: I0316 16:32:08.543440 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0687afe7-6d7e-432f-940f-340f727dbdc8-operator-scripts\") pod \"root-account-create-update-zztjd\" (UID: \"0687afe7-6d7e-432f-940f-340f727dbdc8\") " pod="openstack-kuttl-tests/root-account-create-update-zztjd" Mar 16 16:32:08 crc kubenswrapper[5120]: I0316 16:32:08.543492 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7n8vh\" (UniqueName: \"kubernetes.io/projected/0687afe7-6d7e-432f-940f-340f727dbdc8-kube-api-access-7n8vh\") pod \"root-account-create-update-zztjd\" (UID: \"0687afe7-6d7e-432f-940f-340f727dbdc8\") " pod="openstack-kuttl-tests/root-account-create-update-zztjd" Mar 16 16:32:08 crc kubenswrapper[5120]: I0316 16:32:08.545076 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0687afe7-6d7e-432f-940f-340f727dbdc8-operator-scripts\") pod \"root-account-create-update-zztjd\" (UID: \"0687afe7-6d7e-432f-940f-340f727dbdc8\") " pod="openstack-kuttl-tests/root-account-create-update-zztjd" Mar 16 16:32:08 crc kubenswrapper[5120]: I0316 16:32:08.561570 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7n8vh\" (UniqueName: \"kubernetes.io/projected/0687afe7-6d7e-432f-940f-340f727dbdc8-kube-api-access-7n8vh\") pod \"root-account-create-update-zztjd\" (UID: \"0687afe7-6d7e-432f-940f-340f727dbdc8\") " pod="openstack-kuttl-tests/root-account-create-update-zztjd" Mar 16 16:32:08 crc kubenswrapper[5120]: I0316 16:32:08.739185 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-zztjd" Mar 16 16:32:09 crc kubenswrapper[5120]: I0316 16:32:09.192540 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-zztjd"] Mar 16 16:32:09 crc kubenswrapper[5120]: I0316 16:32:09.258647 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/68089cb0-f9b0-4b76-9778-e2edffaa4f55-etc-swift\") pod \"swift-storage-0\" (UID: \"68089cb0-f9b0-4b76-9778-e2edffaa4f55\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:32:09 crc kubenswrapper[5120]: I0316 16:32:09.265553 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/68089cb0-f9b0-4b76-9778-e2edffaa4f55-etc-swift\") pod \"swift-storage-0\" (UID: \"68089cb0-f9b0-4b76-9778-e2edffaa4f55\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:32:09 crc kubenswrapper[5120]: I0316 16:32:09.492402 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:32:09 crc kubenswrapper[5120]: I0316 16:32:09.946231 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 16:32:09 crc kubenswrapper[5120]: W0316 16:32:09.956995 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod68089cb0_f9b0_4b76_9778_e2edffaa4f55.slice/crio-9988bca8a5f464ca11f298198976984df87470781c2b00519eb5597597419683 WatchSource:0}: Error finding container 9988bca8a5f464ca11f298198976984df87470781c2b00519eb5597597419683: Status 404 returned error can't find the container with id 9988bca8a5f464ca11f298198976984df87470781c2b00519eb5597597419683 Mar 16 16:32:10 crc kubenswrapper[5120]: I0316 16:32:10.113284 5120 generic.go:358] "Generic (PLEG): container finished" podID="f301c55e-0c1a-4861-9acb-e2cdb9e539f2" containerID="ff75c817947243b5be26e301418ba335521570748023d806d32965c0968e802e" exitCode=0 Mar 16 16:32:10 crc kubenswrapper[5120]: I0316 16:32:10.113384 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-lb7cd" event={"ID":"f301c55e-0c1a-4861-9acb-e2cdb9e539f2","Type":"ContainerDied","Data":"ff75c817947243b5be26e301418ba335521570748023d806d32965c0968e802e"} Mar 16 16:32:10 crc kubenswrapper[5120]: I0316 16:32:10.117812 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"68089cb0-f9b0-4b76-9778-e2edffaa4f55","Type":"ContainerStarted","Data":"9988bca8a5f464ca11f298198976984df87470781c2b00519eb5597597419683"} Mar 16 16:32:10 crc kubenswrapper[5120]: I0316 16:32:10.120606 5120 generic.go:358] "Generic (PLEG): container finished" podID="1cd39de5-ca7d-4ed7-8052-17c5613718fc" containerID="7c7fc3b544bfbb7386466592ee272ecfebf74da460a7679279743af631928389" exitCode=0 Mar 16 16:32:10 crc kubenswrapper[5120]: I0316 16:32:10.120683 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"1cd39de5-ca7d-4ed7-8052-17c5613718fc","Type":"ContainerDied","Data":"7c7fc3b544bfbb7386466592ee272ecfebf74da460a7679279743af631928389"} Mar 16 16:32:10 crc kubenswrapper[5120]: I0316 16:32:10.123015 5120 generic.go:358] "Generic (PLEG): container finished" podID="0687afe7-6d7e-432f-940f-340f727dbdc8" containerID="cc1d3e51cd8be12f68e684df22cbad5dece7d1e653cec629b214b67ec84784f3" exitCode=0 Mar 16 16:32:10 crc kubenswrapper[5120]: I0316 16:32:10.123071 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-zztjd" event={"ID":"0687afe7-6d7e-432f-940f-340f727dbdc8","Type":"ContainerDied","Data":"cc1d3e51cd8be12f68e684df22cbad5dece7d1e653cec629b214b67ec84784f3"} Mar 16 16:32:10 crc kubenswrapper[5120]: I0316 16:32:10.123156 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-zztjd" event={"ID":"0687afe7-6d7e-432f-940f-340f727dbdc8","Type":"ContainerStarted","Data":"547ceed1f7ae47e85b6ff5e550affc01bde579ff3283f56882cb6b58ca2378dd"} Mar 16 16:32:11 crc kubenswrapper[5120]: I0316 16:32:11.057703 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:32:11 crc kubenswrapper[5120]: I0316 16:32:11.133993 5120 generic.go:358] "Generic (PLEG): container finished" podID="27f4616b-6d51-4cd6-bdb1-1596dccca5db" containerID="3c52ae2e0cf0d03c546a140465a963dad65f514a4b32e937e791be9544743276" exitCode=0 Mar 16 16:32:11 crc kubenswrapper[5120]: I0316 16:32:11.134245 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"27f4616b-6d51-4cd6-bdb1-1596dccca5db","Type":"ContainerDied","Data":"3c52ae2e0cf0d03c546a140465a963dad65f514a4b32e937e791be9544743276"} Mar 16 16:32:11 crc kubenswrapper[5120]: I0316 16:32:11.146546 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"68089cb0-f9b0-4b76-9778-e2edffaa4f55","Type":"ContainerStarted","Data":"6c2e9e23b6576fc2a9ba6d556319b9df1b2c25022fca788477700ea2cab3db1d"} Mar 16 16:32:11 crc kubenswrapper[5120]: I0316 16:32:11.146589 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"68089cb0-f9b0-4b76-9778-e2edffaa4f55","Type":"ContainerStarted","Data":"8f419d8d72ab94d7bb8b30064068f9e2053fe497727f9e55de513d7dd5786cb2"} Mar 16 16:32:11 crc kubenswrapper[5120]: I0316 16:32:11.146603 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"68089cb0-f9b0-4b76-9778-e2edffaa4f55","Type":"ContainerStarted","Data":"8af6bcb946bdfa26f8e4fdf72e4b7c90f7536fc40756b5c6dec1a3a61051ec9b"} Mar 16 16:32:11 crc kubenswrapper[5120]: I0316 16:32:11.146613 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"68089cb0-f9b0-4b76-9778-e2edffaa4f55","Type":"ContainerStarted","Data":"5f7141dbd0cf79e47a2a0694e8bb1ee25f24e45613ac19c363191df3d5bd8962"} Mar 16 16:32:11 crc kubenswrapper[5120]: I0316 16:32:11.146622 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"68089cb0-f9b0-4b76-9778-e2edffaa4f55","Type":"ContainerStarted","Data":"f6201cdf3cad8158121c3b8225a265abde1e721d5969401a866ae07675028dac"} Mar 16 16:32:11 crc kubenswrapper[5120]: I0316 16:32:11.149638 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"1cd39de5-ca7d-4ed7-8052-17c5613718fc","Type":"ContainerStarted","Data":"187eb647447164e295bccc1b07863b41812af3639cc3d67076881a085711ead6"} Mar 16 16:32:11 crc kubenswrapper[5120]: I0316 16:32:11.150226 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:32:11 crc kubenswrapper[5120]: I0316 16:32:11.200907 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" podStartSLOduration=36.200869672 podStartE2EDuration="36.200869672s" podCreationTimestamp="2026-03-16 16:31:35 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:32:11.194351421 +0000 UTC m=+3633.348283088" watchObservedRunningTime="2026-03-16 16:32:11.200869672 +0000 UTC m=+3633.354801329" Mar 16 16:32:11 crc kubenswrapper[5120]: I0316 16:32:11.619407 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-lb7cd" Mar 16 16:32:11 crc kubenswrapper[5120]: I0316 16:32:11.712353 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-zztjd" Mar 16 16:32:11 crc kubenswrapper[5120]: I0316 16:32:11.715839 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f301c55e-0c1a-4861-9acb-e2cdb9e539f2-combined-ca-bundle\") pod \"f301c55e-0c1a-4861-9acb-e2cdb9e539f2\" (UID: \"f301c55e-0c1a-4861-9acb-e2cdb9e539f2\") " Mar 16 16:32:11 crc kubenswrapper[5120]: I0316 16:32:11.715916 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/f301c55e-0c1a-4861-9acb-e2cdb9e539f2-db-sync-config-data\") pod \"f301c55e-0c1a-4861-9acb-e2cdb9e539f2\" (UID: \"f301c55e-0c1a-4861-9acb-e2cdb9e539f2\") " Mar 16 16:32:11 crc kubenswrapper[5120]: I0316 16:32:11.715964 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xv7xq\" (UniqueName: \"kubernetes.io/projected/f301c55e-0c1a-4861-9acb-e2cdb9e539f2-kube-api-access-xv7xq\") pod \"f301c55e-0c1a-4861-9acb-e2cdb9e539f2\" (UID: \"f301c55e-0c1a-4861-9acb-e2cdb9e539f2\") " Mar 16 16:32:11 crc kubenswrapper[5120]: I0316 16:32:11.716004 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f301c55e-0c1a-4861-9acb-e2cdb9e539f2-config-data\") pod \"f301c55e-0c1a-4861-9acb-e2cdb9e539f2\" (UID: \"f301c55e-0c1a-4861-9acb-e2cdb9e539f2\") " Mar 16 16:32:11 crc kubenswrapper[5120]: I0316 16:32:11.724929 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f301c55e-0c1a-4861-9acb-e2cdb9e539f2-db-sync-config-data" (OuterVolumeSpecName: "db-sync-config-data") pod "f301c55e-0c1a-4861-9acb-e2cdb9e539f2" (UID: "f301c55e-0c1a-4861-9acb-e2cdb9e539f2"). InnerVolumeSpecName "db-sync-config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:32:11 crc kubenswrapper[5120]: I0316 16:32:11.724990 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f301c55e-0c1a-4861-9acb-e2cdb9e539f2-kube-api-access-xv7xq" (OuterVolumeSpecName: "kube-api-access-xv7xq") pod "f301c55e-0c1a-4861-9acb-e2cdb9e539f2" (UID: "f301c55e-0c1a-4861-9acb-e2cdb9e539f2"). InnerVolumeSpecName "kube-api-access-xv7xq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:32:11 crc kubenswrapper[5120]: I0316 16:32:11.762894 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f301c55e-0c1a-4861-9acb-e2cdb9e539f2-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f301c55e-0c1a-4861-9acb-e2cdb9e539f2" (UID: "f301c55e-0c1a-4861-9acb-e2cdb9e539f2"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:32:11 crc kubenswrapper[5120]: I0316 16:32:11.784995 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f301c55e-0c1a-4861-9acb-e2cdb9e539f2-config-data" (OuterVolumeSpecName: "config-data") pod "f301c55e-0c1a-4861-9acb-e2cdb9e539f2" (UID: "f301c55e-0c1a-4861-9acb-e2cdb9e539f2"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:32:11 crc kubenswrapper[5120]: I0316 16:32:11.817786 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7n8vh\" (UniqueName: \"kubernetes.io/projected/0687afe7-6d7e-432f-940f-340f727dbdc8-kube-api-access-7n8vh\") pod \"0687afe7-6d7e-432f-940f-340f727dbdc8\" (UID: \"0687afe7-6d7e-432f-940f-340f727dbdc8\") " Mar 16 16:32:11 crc kubenswrapper[5120]: I0316 16:32:11.817870 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0687afe7-6d7e-432f-940f-340f727dbdc8-operator-scripts\") pod \"0687afe7-6d7e-432f-940f-340f727dbdc8\" (UID: \"0687afe7-6d7e-432f-940f-340f727dbdc8\") " Mar 16 16:32:11 crc kubenswrapper[5120]: I0316 16:32:11.818354 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f301c55e-0c1a-4861-9acb-e2cdb9e539f2-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:32:11 crc kubenswrapper[5120]: I0316 16:32:11.818371 5120 reconciler_common.go:299] "Volume detached for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/f301c55e-0c1a-4861-9acb-e2cdb9e539f2-db-sync-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:32:11 crc kubenswrapper[5120]: I0316 16:32:11.818382 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xv7xq\" (UniqueName: \"kubernetes.io/projected/f301c55e-0c1a-4861-9acb-e2cdb9e539f2-kube-api-access-xv7xq\") on node \"crc\" DevicePath \"\"" Mar 16 16:32:11 crc kubenswrapper[5120]: I0316 16:32:11.818393 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f301c55e-0c1a-4861-9acb-e2cdb9e539f2-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:32:11 crc kubenswrapper[5120]: I0316 16:32:11.819101 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0687afe7-6d7e-432f-940f-340f727dbdc8-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "0687afe7-6d7e-432f-940f-340f727dbdc8" (UID: "0687afe7-6d7e-432f-940f-340f727dbdc8"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:32:11 crc kubenswrapper[5120]: I0316 16:32:11.822705 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0687afe7-6d7e-432f-940f-340f727dbdc8-kube-api-access-7n8vh" (OuterVolumeSpecName: "kube-api-access-7n8vh") pod "0687afe7-6d7e-432f-940f-340f727dbdc8" (UID: "0687afe7-6d7e-432f-940f-340f727dbdc8"). InnerVolumeSpecName "kube-api-access-7n8vh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:32:11 crc kubenswrapper[5120]: I0316 16:32:11.920028 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7n8vh\" (UniqueName: \"kubernetes.io/projected/0687afe7-6d7e-432f-940f-340f727dbdc8-kube-api-access-7n8vh\") on node \"crc\" DevicePath \"\"" Mar 16 16:32:11 crc kubenswrapper[5120]: I0316 16:32:11.920087 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0687afe7-6d7e-432f-940f-340f727dbdc8-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:32:12 crc kubenswrapper[5120]: I0316 16:32:12.200561 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"27f4616b-6d51-4cd6-bdb1-1596dccca5db","Type":"ContainerStarted","Data":"07933e1c2eb28569f75dec800bc0d7b02d1a53c0784920c28fb194aa2c3fc15a"} Mar 16 16:32:12 crc kubenswrapper[5120]: I0316 16:32:12.200960 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:32:12 crc kubenswrapper[5120]: I0316 16:32:12.205829 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-lb7cd" event={"ID":"f301c55e-0c1a-4861-9acb-e2cdb9e539f2","Type":"ContainerDied","Data":"32c8a577521191915bd636f62c2f99c59cd154c9f2b4e3791e2d8776e9f0879f"} Mar 16 16:32:12 crc kubenswrapper[5120]: I0316 16:32:12.205866 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="32c8a577521191915bd636f62c2f99c59cd154c9f2b4e3791e2d8776e9f0879f" Mar 16 16:32:12 crc kubenswrapper[5120]: I0316 16:32:12.205938 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-lb7cd" Mar 16 16:32:12 crc kubenswrapper[5120]: I0316 16:32:12.215753 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"68089cb0-f9b0-4b76-9778-e2edffaa4f55","Type":"ContainerStarted","Data":"afe5190e423949163505bc79590f2d599a6b431f474f2fcabb56da77844d8a11"} Mar 16 16:32:12 crc kubenswrapper[5120]: I0316 16:32:12.215977 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"68089cb0-f9b0-4b76-9778-e2edffaa4f55","Type":"ContainerStarted","Data":"7f6e37c552b309e5dc614d49c37a3d12d02090ee33a7533af716ad9dd4eed3ad"} Mar 16 16:32:12 crc kubenswrapper[5120]: I0316 16:32:12.216036 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"68089cb0-f9b0-4b76-9778-e2edffaa4f55","Type":"ContainerStarted","Data":"a65e2e3da3516c3727074c62fc6b9251f1f45049075f88d761d5c9cecc497707"} Mar 16 16:32:12 crc kubenswrapper[5120]: I0316 16:32:12.216060 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"68089cb0-f9b0-4b76-9778-e2edffaa4f55","Type":"ContainerStarted","Data":"ddfdaba140c32cd80e6973b4267f27a416f672ad90fd39e23b4abbdab58d45ac"} Mar 16 16:32:12 crc kubenswrapper[5120]: I0316 16:32:12.216127 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"68089cb0-f9b0-4b76-9778-e2edffaa4f55","Type":"ContainerStarted","Data":"3045e329b7334cfdf59c5f7569d481ddcf6b9cef5a1d41651bdf7a09fe16cce6"} Mar 16 16:32:12 crc kubenswrapper[5120]: I0316 16:32:12.216189 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"68089cb0-f9b0-4b76-9778-e2edffaa4f55","Type":"ContainerStarted","Data":"bc16f7898a0f29b9a468ef6b20c3e906bab78b7b5706cf556c27a2eca4e6d0d0"} Mar 16 16:32:12 crc kubenswrapper[5120]: I0316 16:32:12.221642 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-zztjd" Mar 16 16:32:12 crc kubenswrapper[5120]: I0316 16:32:12.224495 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-zztjd" event={"ID":"0687afe7-6d7e-432f-940f-340f727dbdc8","Type":"ContainerDied","Data":"547ceed1f7ae47e85b6ff5e550affc01bde579ff3283f56882cb6b58ca2378dd"} Mar 16 16:32:12 crc kubenswrapper[5120]: I0316 16:32:12.224572 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="547ceed1f7ae47e85b6ff5e550affc01bde579ff3283f56882cb6b58ca2378dd" Mar 16 16:32:12 crc kubenswrapper[5120]: I0316 16:32:12.225524 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/rabbitmq-server-0" podStartSLOduration=37.225498851 podStartE2EDuration="37.225498851s" podCreationTimestamp="2026-03-16 16:31:35 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:32:12.225068609 +0000 UTC m=+3634.379000276" watchObservedRunningTime="2026-03-16 16:32:12.225498851 +0000 UTC m=+3634.379430508" Mar 16 16:32:13 crc kubenswrapper[5120]: I0316 16:32:13.287460 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"68089cb0-f9b0-4b76-9778-e2edffaa4f55","Type":"ContainerStarted","Data":"080f8540395015e16b1273c588e9a186dfbd64eee3d6314236006160630adf34"} Mar 16 16:32:13 crc kubenswrapper[5120]: I0316 16:32:13.288153 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"68089cb0-f9b0-4b76-9778-e2edffaa4f55","Type":"ContainerStarted","Data":"2ac4108315559f612a567fff03f8ef9fecb013f02a2aade950e30e5def4a5997"} Mar 16 16:32:13 crc kubenswrapper[5120]: I0316 16:32:13.288168 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"68089cb0-f9b0-4b76-9778-e2edffaa4f55","Type":"ContainerStarted","Data":"d8a01b8e047f292f7e2f4b25d537ee3665462d6fe0f49fa52dabe5c9f3858a7b"} Mar 16 16:32:13 crc kubenswrapper[5120]: I0316 16:32:13.288178 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"68089cb0-f9b0-4b76-9778-e2edffaa4f55","Type":"ContainerStarted","Data":"cf6905d45807f576db3849ba958c470b3cd948bbfde79600771f3019e54489d0"} Mar 16 16:32:13 crc kubenswrapper[5120]: I0316 16:32:13.344166 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/swift-storage-0" podStartSLOduration=21.344135929 podStartE2EDuration="21.344135929s" podCreationTimestamp="2026-03-16 16:31:52 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:32:13.329575548 +0000 UTC m=+3635.483507215" watchObservedRunningTime="2026-03-16 16:32:13.344135929 +0000 UTC m=+3635.498067586" Mar 16 16:32:13 crc kubenswrapper[5120]: I0316 16:32:13.569891 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-bf486487c-4dtfb"] Mar 16 16:32:13 crc kubenswrapper[5120]: I0316 16:32:13.572177 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0687afe7-6d7e-432f-940f-340f727dbdc8" containerName="mariadb-account-create-update" Mar 16 16:32:13 crc kubenswrapper[5120]: I0316 16:32:13.572213 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="0687afe7-6d7e-432f-940f-340f727dbdc8" containerName="mariadb-account-create-update" Mar 16 16:32:13 crc kubenswrapper[5120]: I0316 16:32:13.572239 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f301c55e-0c1a-4861-9acb-e2cdb9e539f2" containerName="glance-db-sync" Mar 16 16:32:13 crc kubenswrapper[5120]: I0316 16:32:13.572247 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f301c55e-0c1a-4861-9acb-e2cdb9e539f2" containerName="glance-db-sync" Mar 16 16:32:13 crc kubenswrapper[5120]: I0316 16:32:13.572457 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="0687afe7-6d7e-432f-940f-340f727dbdc8" containerName="mariadb-account-create-update" Mar 16 16:32:13 crc kubenswrapper[5120]: I0316 16:32:13.572487 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f301c55e-0c1a-4861-9acb-e2cdb9e539f2" containerName="glance-db-sync" Mar 16 16:32:13 crc kubenswrapper[5120]: I0316 16:32:13.581308 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-bf486487c-4dtfb" Mar 16 16:32:13 crc kubenswrapper[5120]: I0316 16:32:13.585285 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"dns-swift-storage-0\"" Mar 16 16:32:13 crc kubenswrapper[5120]: I0316 16:32:13.600737 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-bf486487c-4dtfb"] Mar 16 16:32:13 crc kubenswrapper[5120]: I0316 16:32:13.659640 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hg6jk\" (UniqueName: \"kubernetes.io/projected/4d2aa91c-6d54-4ca1-97c9-528d23d4335b-kube-api-access-hg6jk\") pod \"dnsmasq-dnsmasq-bf486487c-4dtfb\" (UID: \"4d2aa91c-6d54-4ca1-97c9-528d23d4335b\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-bf486487c-4dtfb" Mar 16 16:32:13 crc kubenswrapper[5120]: I0316 16:32:13.659715 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/4d2aa91c-6d54-4ca1-97c9-528d23d4335b-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-bf486487c-4dtfb\" (UID: \"4d2aa91c-6d54-4ca1-97c9-528d23d4335b\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-bf486487c-4dtfb" Mar 16 16:32:13 crc kubenswrapper[5120]: I0316 16:32:13.659892 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4d2aa91c-6d54-4ca1-97c9-528d23d4335b-config\") pod \"dnsmasq-dnsmasq-bf486487c-4dtfb\" (UID: \"4d2aa91c-6d54-4ca1-97c9-528d23d4335b\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-bf486487c-4dtfb" Mar 16 16:32:13 crc kubenswrapper[5120]: I0316 16:32:13.659929 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/4d2aa91c-6d54-4ca1-97c9-528d23d4335b-dns-swift-storage-0\") pod \"dnsmasq-dnsmasq-bf486487c-4dtfb\" (UID: \"4d2aa91c-6d54-4ca1-97c9-528d23d4335b\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-bf486487c-4dtfb" Mar 16 16:32:13 crc kubenswrapper[5120]: I0316 16:32:13.762283 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hg6jk\" (UniqueName: \"kubernetes.io/projected/4d2aa91c-6d54-4ca1-97c9-528d23d4335b-kube-api-access-hg6jk\") pod \"dnsmasq-dnsmasq-bf486487c-4dtfb\" (UID: \"4d2aa91c-6d54-4ca1-97c9-528d23d4335b\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-bf486487c-4dtfb" Mar 16 16:32:13 crc kubenswrapper[5120]: I0316 16:32:13.762350 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/4d2aa91c-6d54-4ca1-97c9-528d23d4335b-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-bf486487c-4dtfb\" (UID: \"4d2aa91c-6d54-4ca1-97c9-528d23d4335b\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-bf486487c-4dtfb" Mar 16 16:32:13 crc kubenswrapper[5120]: I0316 16:32:13.762400 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4d2aa91c-6d54-4ca1-97c9-528d23d4335b-config\") pod \"dnsmasq-dnsmasq-bf486487c-4dtfb\" (UID: \"4d2aa91c-6d54-4ca1-97c9-528d23d4335b\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-bf486487c-4dtfb" Mar 16 16:32:13 crc kubenswrapper[5120]: I0316 16:32:13.762417 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/4d2aa91c-6d54-4ca1-97c9-528d23d4335b-dns-swift-storage-0\") pod \"dnsmasq-dnsmasq-bf486487c-4dtfb\" (UID: \"4d2aa91c-6d54-4ca1-97c9-528d23d4335b\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-bf486487c-4dtfb" Mar 16 16:32:13 crc kubenswrapper[5120]: I0316 16:32:13.763412 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/4d2aa91c-6d54-4ca1-97c9-528d23d4335b-dns-swift-storage-0\") pod \"dnsmasq-dnsmasq-bf486487c-4dtfb\" (UID: \"4d2aa91c-6d54-4ca1-97c9-528d23d4335b\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-bf486487c-4dtfb" Mar 16 16:32:13 crc kubenswrapper[5120]: I0316 16:32:13.764508 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/4d2aa91c-6d54-4ca1-97c9-528d23d4335b-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-bf486487c-4dtfb\" (UID: \"4d2aa91c-6d54-4ca1-97c9-528d23d4335b\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-bf486487c-4dtfb" Mar 16 16:32:13 crc kubenswrapper[5120]: I0316 16:32:13.765250 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4d2aa91c-6d54-4ca1-97c9-528d23d4335b-config\") pod \"dnsmasq-dnsmasq-bf486487c-4dtfb\" (UID: \"4d2aa91c-6d54-4ca1-97c9-528d23d4335b\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-bf486487c-4dtfb" Mar 16 16:32:13 crc kubenswrapper[5120]: I0316 16:32:13.802349 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hg6jk\" (UniqueName: \"kubernetes.io/projected/4d2aa91c-6d54-4ca1-97c9-528d23d4335b-kube-api-access-hg6jk\") pod \"dnsmasq-dnsmasq-bf486487c-4dtfb\" (UID: \"4d2aa91c-6d54-4ca1-97c9-528d23d4335b\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-bf486487c-4dtfb" Mar 16 16:32:13 crc kubenswrapper[5120]: I0316 16:32:13.916734 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-bf486487c-4dtfb" Mar 16 16:32:14 crc kubenswrapper[5120]: I0316 16:32:14.401390 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-bf486487c-4dtfb"] Mar 16 16:32:14 crc kubenswrapper[5120]: W0316 16:32:14.403960 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4d2aa91c_6d54_4ca1_97c9_528d23d4335b.slice/crio-1168be5402a4f1f4bf8654bb080a037de51c9981d5a2c22d98434ec6511af4e2 WatchSource:0}: Error finding container 1168be5402a4f1f4bf8654bb080a037de51c9981d5a2c22d98434ec6511af4e2: Status 404 returned error can't find the container with id 1168be5402a4f1f4bf8654bb080a037de51c9981d5a2c22d98434ec6511af4e2 Mar 16 16:32:15 crc kubenswrapper[5120]: I0316 16:32:15.307118 5120 generic.go:358] "Generic (PLEG): container finished" podID="4d2aa91c-6d54-4ca1-97c9-528d23d4335b" containerID="7af84f8e395d6b609d5d679546e422a552f34f997d69d5ad8cf8e9ba8abfefc9" exitCode=0 Mar 16 16:32:15 crc kubenswrapper[5120]: I0316 16:32:15.307243 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-bf486487c-4dtfb" event={"ID":"4d2aa91c-6d54-4ca1-97c9-528d23d4335b","Type":"ContainerDied","Data":"7af84f8e395d6b609d5d679546e422a552f34f997d69d5ad8cf8e9ba8abfefc9"} Mar 16 16:32:15 crc kubenswrapper[5120]: I0316 16:32:15.307783 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-bf486487c-4dtfb" event={"ID":"4d2aa91c-6d54-4ca1-97c9-528d23d4335b","Type":"ContainerStarted","Data":"1168be5402a4f1f4bf8654bb080a037de51c9981d5a2c22d98434ec6511af4e2"} Mar 16 16:32:16 crc kubenswrapper[5120]: I0316 16:32:16.319789 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-bf486487c-4dtfb" event={"ID":"4d2aa91c-6d54-4ca1-97c9-528d23d4335b","Type":"ContainerStarted","Data":"477c0c902f0b62f18a9c7f78d09355012a71b86484ecfa9f255581d96dc56221"} Mar 16 16:32:16 crc kubenswrapper[5120]: I0316 16:32:16.319973 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-bf486487c-4dtfb" Mar 16 16:32:16 crc kubenswrapper[5120]: I0316 16:32:16.341895 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-bf486487c-4dtfb" podStartSLOduration=3.341863243 podStartE2EDuration="3.341863243s" podCreationTimestamp="2026-03-16 16:32:13 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:32:16.337107678 +0000 UTC m=+3638.491039345" watchObservedRunningTime="2026-03-16 16:32:16.341863243 +0000 UTC m=+3638.495794900" Mar 16 16:32:20 crc kubenswrapper[5120]: I0316 16:32:20.676690 5120 scope.go:117] "RemoveContainer" containerID="0a15d5caff30dc8885f782e59962af7d98d58b39ab76059e56e5827e10e7ab8b" Mar 16 16:32:20 crc kubenswrapper[5120]: E0316 16:32:20.677592 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:32:22 crc kubenswrapper[5120]: I0316 16:32:22.227046 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:32:22 crc kubenswrapper[5120]: I0316 16:32:22.307697 5120 scope.go:117] "RemoveContainer" containerID="4184228e5a2fff602edff587fd26bf92a795e80dccea49510289085159af992b" Mar 16 16:32:22 crc kubenswrapper[5120]: I0316 16:32:22.334052 5120 scope.go:117] "RemoveContainer" containerID="c581c58f9b70a5e29e5d55f4688ea841750e329b0e7ca1456f075d84f5049fe6" Mar 16 16:32:22 crc kubenswrapper[5120]: I0316 16:32:22.335053 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-bf486487c-4dtfb" Mar 16 16:32:22 crc kubenswrapper[5120]: I0316 16:32:22.380137 5120 scope.go:117] "RemoveContainer" containerID="5c52a4ba5687378dcbf09f145eaf6ec74af34dcc6b2d37a41f902372f658c6b7" Mar 16 16:32:22 crc kubenswrapper[5120]: I0316 16:32:22.394844 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-jb5ks"] Mar 16 16:32:22 crc kubenswrapper[5120]: I0316 16:32:22.395112 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-jb5ks" podUID="09b5d645-c91e-4bff-8b73-0651cf8397b6" containerName="dnsmasq-dns" containerID="cri-o://569051d037ae7e96822d6d480259031583ea3e384c85f39eb6df3c6e6490eedd" gracePeriod=10 Mar 16 16:32:22 crc kubenswrapper[5120]: I0316 16:32:22.488972 5120 scope.go:117] "RemoveContainer" containerID="1a21b0b1bb37b825f54861d115c094ef686430fe240cdc438d851c864520b383" Mar 16 16:32:22 crc kubenswrapper[5120]: I0316 16:32:22.563647 5120 scope.go:117] "RemoveContainer" containerID="e51fd4f20644e71d702264472816d4f6ef17d8ebfb695f51448b9c4f3211b7bd" Mar 16 16:32:22 crc kubenswrapper[5120]: I0316 16:32:22.608851 5120 scope.go:117] "RemoveContainer" containerID="64a638080010ae263bb3194e9708de4611ff497752c67d2954e05543bedd296f" Mar 16 16:32:22 crc kubenswrapper[5120]: I0316 16:32:22.677854 5120 scope.go:117] "RemoveContainer" containerID="957654f923b45b56dff5590e85bc583b1f635cc06ed245eba52a5fa6a0941204" Mar 16 16:32:22 crc kubenswrapper[5120]: I0316 16:32:22.708360 5120 scope.go:117] "RemoveContainer" containerID="6dc6d19352714b047af5e332526769ac24972837f0aa890874047d7522280d24" Mar 16 16:32:22 crc kubenswrapper[5120]: I0316 16:32:22.734899 5120 scope.go:117] "RemoveContainer" containerID="26a19d2b77733d4ff8bc40e93be569732bc3d22a818c81a13b247fc194ea3117" Mar 16 16:32:22 crc kubenswrapper[5120]: I0316 16:32:22.755806 5120 scope.go:117] "RemoveContainer" containerID="3c0502000ff01dd33d005a281fd542845cac0a75e1574cba26bf8298a0fc82ed" Mar 16 16:32:22 crc kubenswrapper[5120]: I0316 16:32:22.776219 5120 scope.go:117] "RemoveContainer" containerID="7023672ce34dba103c8a53dc23b44d6e887538893025cbc8a3a0c2f7d3f52784" Mar 16 16:32:22 crc kubenswrapper[5120]: I0316 16:32:22.814273 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-jb5ks" Mar 16 16:32:22 crc kubenswrapper[5120]: I0316 16:32:22.872629 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/09b5d645-c91e-4bff-8b73-0651cf8397b6-config\") pod \"09b5d645-c91e-4bff-8b73-0651cf8397b6\" (UID: \"09b5d645-c91e-4bff-8b73-0651cf8397b6\") " Mar 16 16:32:22 crc kubenswrapper[5120]: I0316 16:32:22.872710 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tbjbz\" (UniqueName: \"kubernetes.io/projected/09b5d645-c91e-4bff-8b73-0651cf8397b6-kube-api-access-tbjbz\") pod \"09b5d645-c91e-4bff-8b73-0651cf8397b6\" (UID: \"09b5d645-c91e-4bff-8b73-0651cf8397b6\") " Mar 16 16:32:22 crc kubenswrapper[5120]: I0316 16:32:22.875126 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/09b5d645-c91e-4bff-8b73-0651cf8397b6-dnsmasq-svc\") pod \"09b5d645-c91e-4bff-8b73-0651cf8397b6\" (UID: \"09b5d645-c91e-4bff-8b73-0651cf8397b6\") " Mar 16 16:32:22 crc kubenswrapper[5120]: I0316 16:32:22.887705 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09b5d645-c91e-4bff-8b73-0651cf8397b6-kube-api-access-tbjbz" (OuterVolumeSpecName: "kube-api-access-tbjbz") pod "09b5d645-c91e-4bff-8b73-0651cf8397b6" (UID: "09b5d645-c91e-4bff-8b73-0651cf8397b6"). InnerVolumeSpecName "kube-api-access-tbjbz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:32:22 crc kubenswrapper[5120]: I0316 16:32:22.934350 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/09b5d645-c91e-4bff-8b73-0651cf8397b6-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "09b5d645-c91e-4bff-8b73-0651cf8397b6" (UID: "09b5d645-c91e-4bff-8b73-0651cf8397b6"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:32:22 crc kubenswrapper[5120]: I0316 16:32:22.935312 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/09b5d645-c91e-4bff-8b73-0651cf8397b6-config" (OuterVolumeSpecName: "config") pod "09b5d645-c91e-4bff-8b73-0651cf8397b6" (UID: "09b5d645-c91e-4bff-8b73-0651cf8397b6"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:32:22 crc kubenswrapper[5120]: I0316 16:32:22.977716 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/09b5d645-c91e-4bff-8b73-0651cf8397b6-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:32:22 crc kubenswrapper[5120]: I0316 16:32:22.977787 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tbjbz\" (UniqueName: \"kubernetes.io/projected/09b5d645-c91e-4bff-8b73-0651cf8397b6-kube-api-access-tbjbz\") on node \"crc\" DevicePath \"\"" Mar 16 16:32:22 crc kubenswrapper[5120]: I0316 16:32:22.977804 5120 reconciler_common.go:299] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/09b5d645-c91e-4bff-8b73-0651cf8397b6-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Mar 16 16:32:23 crc kubenswrapper[5120]: I0316 16:32:23.291035 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:32:23 crc kubenswrapper[5120]: I0316 16:32:23.426342 5120 generic.go:358] "Generic (PLEG): container finished" podID="09b5d645-c91e-4bff-8b73-0651cf8397b6" containerID="569051d037ae7e96822d6d480259031583ea3e384c85f39eb6df3c6e6490eedd" exitCode=0 Mar 16 16:32:23 crc kubenswrapper[5120]: I0316 16:32:23.426557 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-jb5ks" event={"ID":"09b5d645-c91e-4bff-8b73-0651cf8397b6","Type":"ContainerDied","Data":"569051d037ae7e96822d6d480259031583ea3e384c85f39eb6df3c6e6490eedd"} Mar 16 16:32:23 crc kubenswrapper[5120]: I0316 16:32:23.426585 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-jb5ks" event={"ID":"09b5d645-c91e-4bff-8b73-0651cf8397b6","Type":"ContainerDied","Data":"a6325ca1a07acbbac4edd76d49a19ed6315d1cb8f0669f40628ab10e0712e8c4"} Mar 16 16:32:23 crc kubenswrapper[5120]: I0316 16:32:23.426612 5120 scope.go:117] "RemoveContainer" containerID="569051d037ae7e96822d6d480259031583ea3e384c85f39eb6df3c6e6490eedd" Mar 16 16:32:23 crc kubenswrapper[5120]: I0316 16:32:23.426823 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-jb5ks" Mar 16 16:32:23 crc kubenswrapper[5120]: I0316 16:32:23.449774 5120 scope.go:117] "RemoveContainer" containerID="1b03fd5223e0d38a3a8f75a156ae3ce743fc285db2d1a7a8a71dc67ce051ce5b" Mar 16 16:32:23 crc kubenswrapper[5120]: I0316 16:32:23.463744 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-jb5ks"] Mar 16 16:32:23 crc kubenswrapper[5120]: I0316 16:32:23.469876 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-jb5ks"] Mar 16 16:32:23 crc kubenswrapper[5120]: I0316 16:32:23.490900 5120 scope.go:117] "RemoveContainer" containerID="569051d037ae7e96822d6d480259031583ea3e384c85f39eb6df3c6e6490eedd" Mar 16 16:32:23 crc kubenswrapper[5120]: E0316 16:32:23.491382 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"569051d037ae7e96822d6d480259031583ea3e384c85f39eb6df3c6e6490eedd\": container with ID starting with 569051d037ae7e96822d6d480259031583ea3e384c85f39eb6df3c6e6490eedd not found: ID does not exist" containerID="569051d037ae7e96822d6d480259031583ea3e384c85f39eb6df3c6e6490eedd" Mar 16 16:32:23 crc kubenswrapper[5120]: I0316 16:32:23.491406 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"569051d037ae7e96822d6d480259031583ea3e384c85f39eb6df3c6e6490eedd"} err="failed to get container status \"569051d037ae7e96822d6d480259031583ea3e384c85f39eb6df3c6e6490eedd\": rpc error: code = NotFound desc = could not find container \"569051d037ae7e96822d6d480259031583ea3e384c85f39eb6df3c6e6490eedd\": container with ID starting with 569051d037ae7e96822d6d480259031583ea3e384c85f39eb6df3c6e6490eedd not found: ID does not exist" Mar 16 16:32:23 crc kubenswrapper[5120]: I0316 16:32:23.491424 5120 scope.go:117] "RemoveContainer" containerID="1b03fd5223e0d38a3a8f75a156ae3ce743fc285db2d1a7a8a71dc67ce051ce5b" Mar 16 16:32:23 crc kubenswrapper[5120]: E0316 16:32:23.491938 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1b03fd5223e0d38a3a8f75a156ae3ce743fc285db2d1a7a8a71dc67ce051ce5b\": container with ID starting with 1b03fd5223e0d38a3a8f75a156ae3ce743fc285db2d1a7a8a71dc67ce051ce5b not found: ID does not exist" containerID="1b03fd5223e0d38a3a8f75a156ae3ce743fc285db2d1a7a8a71dc67ce051ce5b" Mar 16 16:32:23 crc kubenswrapper[5120]: I0316 16:32:23.492056 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b03fd5223e0d38a3a8f75a156ae3ce743fc285db2d1a7a8a71dc67ce051ce5b"} err="failed to get container status \"1b03fd5223e0d38a3a8f75a156ae3ce743fc285db2d1a7a8a71dc67ce051ce5b\": rpc error: code = NotFound desc = could not find container \"1b03fd5223e0d38a3a8f75a156ae3ce743fc285db2d1a7a8a71dc67ce051ce5b\": container with ID starting with 1b03fd5223e0d38a3a8f75a156ae3ce743fc285db2d1a7a8a71dc67ce051ce5b not found: ID does not exist" Mar 16 16:32:23 crc kubenswrapper[5120]: I0316 16:32:23.903436 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-db-create-zzpvz"] Mar 16 16:32:23 crc kubenswrapper[5120]: I0316 16:32:23.906129 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09b5d645-c91e-4bff-8b73-0651cf8397b6" containerName="init" Mar 16 16:32:23 crc kubenswrapper[5120]: I0316 16:32:23.906173 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="09b5d645-c91e-4bff-8b73-0651cf8397b6" containerName="init" Mar 16 16:32:23 crc kubenswrapper[5120]: I0316 16:32:23.906227 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09b5d645-c91e-4bff-8b73-0651cf8397b6" containerName="dnsmasq-dns" Mar 16 16:32:23 crc kubenswrapper[5120]: I0316 16:32:23.906237 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="09b5d645-c91e-4bff-8b73-0651cf8397b6" containerName="dnsmasq-dns" Mar 16 16:32:23 crc kubenswrapper[5120]: I0316 16:32:23.906449 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="09b5d645-c91e-4bff-8b73-0651cf8397b6" containerName="dnsmasq-dns" Mar 16 16:32:23 crc kubenswrapper[5120]: I0316 16:32:23.962041 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-create-zzpvz" Mar 16 16:32:24 crc kubenswrapper[5120]: I0316 16:32:24.002279 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-db-create-zzpvz"] Mar 16 16:32:24 crc kubenswrapper[5120]: I0316 16:32:24.037676 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-db-create-j72fx"] Mar 16 16:32:24 crc kubenswrapper[5120]: I0316 16:32:24.057159 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-create-j72fx" Mar 16 16:32:24 crc kubenswrapper[5120]: I0316 16:32:24.068333 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-5115-account-create-update-jvsp2"] Mar 16 16:32:24 crc kubenswrapper[5120]: I0316 16:32:24.080355 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-5115-account-create-update-jvsp2" Mar 16 16:32:24 crc kubenswrapper[5120]: I0316 16:32:24.086381 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-db-create-j72fx"] Mar 16 16:32:24 crc kubenswrapper[5120]: I0316 16:32:24.087209 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-db-secret\"" Mar 16 16:32:24 crc kubenswrapper[5120]: I0316 16:32:24.092152 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-5115-account-create-update-jvsp2"] Mar 16 16:32:24 crc kubenswrapper[5120]: I0316 16:32:24.106272 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/61133921-00f6-44cf-a641-de9817b67634-operator-scripts\") pod \"neutron-db-create-j72fx\" (UID: \"61133921-00f6-44cf-a641-de9817b67634\") " pod="openstack-kuttl-tests/neutron-db-create-j72fx" Mar 16 16:32:24 crc kubenswrapper[5120]: I0316 16:32:24.106366 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8bvwx\" (UniqueName: \"kubernetes.io/projected/61133921-00f6-44cf-a641-de9817b67634-kube-api-access-8bvwx\") pod \"neutron-db-create-j72fx\" (UID: \"61133921-00f6-44cf-a641-de9817b67634\") " pod="openstack-kuttl-tests/neutron-db-create-j72fx" Mar 16 16:32:24 crc kubenswrapper[5120]: I0316 16:32:24.106388 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57fq4\" (UniqueName: \"kubernetes.io/projected/6752488d-f177-4cc7-a58b-08533527272d-kube-api-access-57fq4\") pod \"cinder-db-create-zzpvz\" (UID: \"6752488d-f177-4cc7-a58b-08533527272d\") " pod="openstack-kuttl-tests/cinder-db-create-zzpvz" Mar 16 16:32:24 crc kubenswrapper[5120]: I0316 16:32:24.106492 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/6752488d-f177-4cc7-a58b-08533527272d-operator-scripts\") pod \"cinder-db-create-zzpvz\" (UID: \"6752488d-f177-4cc7-a58b-08533527272d\") " pod="openstack-kuttl-tests/cinder-db-create-zzpvz" Mar 16 16:32:24 crc kubenswrapper[5120]: I0316 16:32:24.207779 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/61133921-00f6-44cf-a641-de9817b67634-operator-scripts\") pod \"neutron-db-create-j72fx\" (UID: \"61133921-00f6-44cf-a641-de9817b67634\") " pod="openstack-kuttl-tests/neutron-db-create-j72fx" Mar 16 16:32:24 crc kubenswrapper[5120]: I0316 16:32:24.207839 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d08d9407-af61-432f-abcd-f0e65aa2a342-operator-scripts\") pod \"cinder-5115-account-create-update-jvsp2\" (UID: \"d08d9407-af61-432f-abcd-f0e65aa2a342\") " pod="openstack-kuttl-tests/cinder-5115-account-create-update-jvsp2" Mar 16 16:32:24 crc kubenswrapper[5120]: I0316 16:32:24.207926 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8bvwx\" (UniqueName: \"kubernetes.io/projected/61133921-00f6-44cf-a641-de9817b67634-kube-api-access-8bvwx\") pod \"neutron-db-create-j72fx\" (UID: \"61133921-00f6-44cf-a641-de9817b67634\") " pod="openstack-kuttl-tests/neutron-db-create-j72fx" Mar 16 16:32:24 crc kubenswrapper[5120]: I0316 16:32:24.208032 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-57fq4\" (UniqueName: \"kubernetes.io/projected/6752488d-f177-4cc7-a58b-08533527272d-kube-api-access-57fq4\") pod \"cinder-db-create-zzpvz\" (UID: \"6752488d-f177-4cc7-a58b-08533527272d\") " pod="openstack-kuttl-tests/cinder-db-create-zzpvz" Mar 16 16:32:24 crc kubenswrapper[5120]: I0316 16:32:24.208249 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/6752488d-f177-4cc7-a58b-08533527272d-operator-scripts\") pod \"cinder-db-create-zzpvz\" (UID: \"6752488d-f177-4cc7-a58b-08533527272d\") " pod="openstack-kuttl-tests/cinder-db-create-zzpvz" Mar 16 16:32:24 crc kubenswrapper[5120]: I0316 16:32:24.208443 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2slrq\" (UniqueName: \"kubernetes.io/projected/d08d9407-af61-432f-abcd-f0e65aa2a342-kube-api-access-2slrq\") pod \"cinder-5115-account-create-update-jvsp2\" (UID: \"d08d9407-af61-432f-abcd-f0e65aa2a342\") " pod="openstack-kuttl-tests/cinder-5115-account-create-update-jvsp2" Mar 16 16:32:24 crc kubenswrapper[5120]: I0316 16:32:24.208549 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/61133921-00f6-44cf-a641-de9817b67634-operator-scripts\") pod \"neutron-db-create-j72fx\" (UID: \"61133921-00f6-44cf-a641-de9817b67634\") " pod="openstack-kuttl-tests/neutron-db-create-j72fx" Mar 16 16:32:24 crc kubenswrapper[5120]: I0316 16:32:24.209072 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/6752488d-f177-4cc7-a58b-08533527272d-operator-scripts\") pod \"cinder-db-create-zzpvz\" (UID: \"6752488d-f177-4cc7-a58b-08533527272d\") " pod="openstack-kuttl-tests/cinder-db-create-zzpvz" Mar 16 16:32:24 crc kubenswrapper[5120]: I0316 16:32:24.237144 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-57fq4\" (UniqueName: \"kubernetes.io/projected/6752488d-f177-4cc7-a58b-08533527272d-kube-api-access-57fq4\") pod \"cinder-db-create-zzpvz\" (UID: \"6752488d-f177-4cc7-a58b-08533527272d\") " pod="openstack-kuttl-tests/cinder-db-create-zzpvz" Mar 16 16:32:24 crc kubenswrapper[5120]: I0316 16:32:24.243516 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8bvwx\" (UniqueName: \"kubernetes.io/projected/61133921-00f6-44cf-a641-de9817b67634-kube-api-access-8bvwx\") pod \"neutron-db-create-j72fx\" (UID: \"61133921-00f6-44cf-a641-de9817b67634\") " pod="openstack-kuttl-tests/neutron-db-create-j72fx" Mar 16 16:32:24 crc kubenswrapper[5120]: I0316 16:32:24.256472 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-wl7hj"] Mar 16 16:32:24 crc kubenswrapper[5120]: I0316 16:32:24.268778 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-wl7hj"] Mar 16 16:32:24 crc kubenswrapper[5120]: I0316 16:32:24.268951 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-wl7hj" Mar 16 16:32:24 crc kubenswrapper[5120]: I0316 16:32:24.271190 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-config-data\"" Mar 16 16:32:24 crc kubenswrapper[5120]: I0316 16:32:24.271632 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-scripts\"" Mar 16 16:32:24 crc kubenswrapper[5120]: I0316 16:32:24.271868 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone\"" Mar 16 16:32:24 crc kubenswrapper[5120]: I0316 16:32:24.272285 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-keystone-dockercfg-nqmkd\"" Mar 16 16:32:24 crc kubenswrapper[5120]: I0316 16:32:24.294270 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-create-zzpvz" Mar 16 16:32:24 crc kubenswrapper[5120]: I0316 16:32:24.310070 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2slrq\" (UniqueName: \"kubernetes.io/projected/d08d9407-af61-432f-abcd-f0e65aa2a342-kube-api-access-2slrq\") pod \"cinder-5115-account-create-update-jvsp2\" (UID: \"d08d9407-af61-432f-abcd-f0e65aa2a342\") " pod="openstack-kuttl-tests/cinder-5115-account-create-update-jvsp2" Mar 16 16:32:24 crc kubenswrapper[5120]: I0316 16:32:24.310577 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d08d9407-af61-432f-abcd-f0e65aa2a342-operator-scripts\") pod \"cinder-5115-account-create-update-jvsp2\" (UID: \"d08d9407-af61-432f-abcd-f0e65aa2a342\") " pod="openstack-kuttl-tests/cinder-5115-account-create-update-jvsp2" Mar 16 16:32:24 crc kubenswrapper[5120]: I0316 16:32:24.311173 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d08d9407-af61-432f-abcd-f0e65aa2a342-operator-scripts\") pod \"cinder-5115-account-create-update-jvsp2\" (UID: \"d08d9407-af61-432f-abcd-f0e65aa2a342\") " pod="openstack-kuttl-tests/cinder-5115-account-create-update-jvsp2" Mar 16 16:32:24 crc kubenswrapper[5120]: I0316 16:32:24.338609 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2slrq\" (UniqueName: \"kubernetes.io/projected/d08d9407-af61-432f-abcd-f0e65aa2a342-kube-api-access-2slrq\") pod \"cinder-5115-account-create-update-jvsp2\" (UID: \"d08d9407-af61-432f-abcd-f0e65aa2a342\") " pod="openstack-kuttl-tests/cinder-5115-account-create-update-jvsp2" Mar 16 16:32:24 crc kubenswrapper[5120]: I0316 16:32:24.339001 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-db-create-vh69f"] Mar 16 16:32:24 crc kubenswrapper[5120]: I0316 16:32:24.356908 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-53bd-account-create-update-54r7n"] Mar 16 16:32:24 crc kubenswrapper[5120]: I0316 16:32:24.357003 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-create-vh69f" Mar 16 16:32:24 crc kubenswrapper[5120]: I0316 16:32:24.372137 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-db-create-vh69f"] Mar 16 16:32:24 crc kubenswrapper[5120]: I0316 16:32:24.372415 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-53bd-account-create-update-54r7n"] Mar 16 16:32:24 crc kubenswrapper[5120]: I0316 16:32:24.372640 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-53bd-account-create-update-54r7n" Mar 16 16:32:24 crc kubenswrapper[5120]: I0316 16:32:24.374353 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-db-secret\"" Mar 16 16:32:24 crc kubenswrapper[5120]: I0316 16:32:24.379815 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-create-j72fx" Mar 16 16:32:24 crc kubenswrapper[5120]: I0316 16:32:24.405538 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-5115-account-create-update-jvsp2" Mar 16 16:32:24 crc kubenswrapper[5120]: I0316 16:32:24.412779 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a4244b14-9780-41af-a54c-3535782ca04d-config-data\") pod \"keystone-db-sync-wl7hj\" (UID: \"a4244b14-9780-41af-a54c-3535782ca04d\") " pod="openstack-kuttl-tests/keystone-db-sync-wl7hj" Mar 16 16:32:24 crc kubenswrapper[5120]: I0316 16:32:24.413110 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a4244b14-9780-41af-a54c-3535782ca04d-combined-ca-bundle\") pod \"keystone-db-sync-wl7hj\" (UID: \"a4244b14-9780-41af-a54c-3535782ca04d\") " pod="openstack-kuttl-tests/keystone-db-sync-wl7hj" Mar 16 16:32:24 crc kubenswrapper[5120]: I0316 16:32:24.413253 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gsfmp\" (UniqueName: \"kubernetes.io/projected/a6475f4b-6adc-469e-941b-ff0d57fcad5f-kube-api-access-gsfmp\") pod \"barbican-db-create-vh69f\" (UID: \"a6475f4b-6adc-469e-941b-ff0d57fcad5f\") " pod="openstack-kuttl-tests/barbican-db-create-vh69f" Mar 16 16:32:24 crc kubenswrapper[5120]: I0316 16:32:24.413450 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbtcq\" (UniqueName: \"kubernetes.io/projected/a4244b14-9780-41af-a54c-3535782ca04d-kube-api-access-jbtcq\") pod \"keystone-db-sync-wl7hj\" (UID: \"a4244b14-9780-41af-a54c-3535782ca04d\") " pod="openstack-kuttl-tests/keystone-db-sync-wl7hj" Mar 16 16:32:24 crc kubenswrapper[5120]: I0316 16:32:24.413626 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a6475f4b-6adc-469e-941b-ff0d57fcad5f-operator-scripts\") pod \"barbican-db-create-vh69f\" (UID: \"a6475f4b-6adc-469e-941b-ff0d57fcad5f\") " pod="openstack-kuttl-tests/barbican-db-create-vh69f" Mar 16 16:32:24 crc kubenswrapper[5120]: I0316 16:32:24.433879 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-a4c2-account-create-update-hlwsp"] Mar 16 16:32:24 crc kubenswrapper[5120]: I0316 16:32:24.443376 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-a4c2-account-create-update-hlwsp" Mar 16 16:32:24 crc kubenswrapper[5120]: I0316 16:32:24.444163 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-a4c2-account-create-update-hlwsp"] Mar 16 16:32:24 crc kubenswrapper[5120]: I0316 16:32:24.447291 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-db-secret\"" Mar 16 16:32:24 crc kubenswrapper[5120]: I0316 16:32:24.519072 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a4244b14-9780-41af-a54c-3535782ca04d-config-data\") pod \"keystone-db-sync-wl7hj\" (UID: \"a4244b14-9780-41af-a54c-3535782ca04d\") " pod="openstack-kuttl-tests/keystone-db-sync-wl7hj" Mar 16 16:32:24 crc kubenswrapper[5120]: I0316 16:32:24.519400 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chkn2\" (UniqueName: \"kubernetes.io/projected/d5ec5258-dfa5-4bb1-b1e7-1af5fb826a9d-kube-api-access-chkn2\") pod \"neutron-a4c2-account-create-update-hlwsp\" (UID: \"d5ec5258-dfa5-4bb1-b1e7-1af5fb826a9d\") " pod="openstack-kuttl-tests/neutron-a4c2-account-create-update-hlwsp" Mar 16 16:32:24 crc kubenswrapper[5120]: I0316 16:32:24.519424 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d5ec5258-dfa5-4bb1-b1e7-1af5fb826a9d-operator-scripts\") pod \"neutron-a4c2-account-create-update-hlwsp\" (UID: \"d5ec5258-dfa5-4bb1-b1e7-1af5fb826a9d\") " pod="openstack-kuttl-tests/neutron-a4c2-account-create-update-hlwsp" Mar 16 16:32:24 crc kubenswrapper[5120]: I0316 16:32:24.519481 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phslw\" (UniqueName: \"kubernetes.io/projected/5a4a6700-0b46-409f-9205-5e7660b99d89-kube-api-access-phslw\") pod \"barbican-53bd-account-create-update-54r7n\" (UID: \"5a4a6700-0b46-409f-9205-5e7660b99d89\") " pod="openstack-kuttl-tests/barbican-53bd-account-create-update-54r7n" Mar 16 16:32:24 crc kubenswrapper[5120]: I0316 16:32:24.519515 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a4244b14-9780-41af-a54c-3535782ca04d-combined-ca-bundle\") pod \"keystone-db-sync-wl7hj\" (UID: \"a4244b14-9780-41af-a54c-3535782ca04d\") " pod="openstack-kuttl-tests/keystone-db-sync-wl7hj" Mar 16 16:32:24 crc kubenswrapper[5120]: I0316 16:32:24.519593 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5a4a6700-0b46-409f-9205-5e7660b99d89-operator-scripts\") pod \"barbican-53bd-account-create-update-54r7n\" (UID: \"5a4a6700-0b46-409f-9205-5e7660b99d89\") " pod="openstack-kuttl-tests/barbican-53bd-account-create-update-54r7n" Mar 16 16:32:24 crc kubenswrapper[5120]: I0316 16:32:24.519631 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gsfmp\" (UniqueName: \"kubernetes.io/projected/a6475f4b-6adc-469e-941b-ff0d57fcad5f-kube-api-access-gsfmp\") pod \"barbican-db-create-vh69f\" (UID: \"a6475f4b-6adc-469e-941b-ff0d57fcad5f\") " pod="openstack-kuttl-tests/barbican-db-create-vh69f" Mar 16 16:32:24 crc kubenswrapper[5120]: I0316 16:32:24.519660 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jbtcq\" (UniqueName: \"kubernetes.io/projected/a4244b14-9780-41af-a54c-3535782ca04d-kube-api-access-jbtcq\") pod \"keystone-db-sync-wl7hj\" (UID: \"a4244b14-9780-41af-a54c-3535782ca04d\") " pod="openstack-kuttl-tests/keystone-db-sync-wl7hj" Mar 16 16:32:24 crc kubenswrapper[5120]: I0316 16:32:24.519706 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a6475f4b-6adc-469e-941b-ff0d57fcad5f-operator-scripts\") pod \"barbican-db-create-vh69f\" (UID: \"a6475f4b-6adc-469e-941b-ff0d57fcad5f\") " pod="openstack-kuttl-tests/barbican-db-create-vh69f" Mar 16 16:32:24 crc kubenswrapper[5120]: I0316 16:32:24.520417 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a6475f4b-6adc-469e-941b-ff0d57fcad5f-operator-scripts\") pod \"barbican-db-create-vh69f\" (UID: \"a6475f4b-6adc-469e-941b-ff0d57fcad5f\") " pod="openstack-kuttl-tests/barbican-db-create-vh69f" Mar 16 16:32:24 crc kubenswrapper[5120]: I0316 16:32:24.539348 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a4244b14-9780-41af-a54c-3535782ca04d-combined-ca-bundle\") pod \"keystone-db-sync-wl7hj\" (UID: \"a4244b14-9780-41af-a54c-3535782ca04d\") " pod="openstack-kuttl-tests/keystone-db-sync-wl7hj" Mar 16 16:32:24 crc kubenswrapper[5120]: I0316 16:32:24.540612 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbtcq\" (UniqueName: \"kubernetes.io/projected/a4244b14-9780-41af-a54c-3535782ca04d-kube-api-access-jbtcq\") pod \"keystone-db-sync-wl7hj\" (UID: \"a4244b14-9780-41af-a54c-3535782ca04d\") " pod="openstack-kuttl-tests/keystone-db-sync-wl7hj" Mar 16 16:32:24 crc kubenswrapper[5120]: I0316 16:32:24.544025 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gsfmp\" (UniqueName: \"kubernetes.io/projected/a6475f4b-6adc-469e-941b-ff0d57fcad5f-kube-api-access-gsfmp\") pod \"barbican-db-create-vh69f\" (UID: \"a6475f4b-6adc-469e-941b-ff0d57fcad5f\") " pod="openstack-kuttl-tests/barbican-db-create-vh69f" Mar 16 16:32:24 crc kubenswrapper[5120]: I0316 16:32:24.548343 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a4244b14-9780-41af-a54c-3535782ca04d-config-data\") pod \"keystone-db-sync-wl7hj\" (UID: \"a4244b14-9780-41af-a54c-3535782ca04d\") " pod="openstack-kuttl-tests/keystone-db-sync-wl7hj" Mar 16 16:32:24 crc kubenswrapper[5120]: I0316 16:32:24.621268 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5a4a6700-0b46-409f-9205-5e7660b99d89-operator-scripts\") pod \"barbican-53bd-account-create-update-54r7n\" (UID: \"5a4a6700-0b46-409f-9205-5e7660b99d89\") " pod="openstack-kuttl-tests/barbican-53bd-account-create-update-54r7n" Mar 16 16:32:24 crc kubenswrapper[5120]: I0316 16:32:24.621498 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-chkn2\" (UniqueName: \"kubernetes.io/projected/d5ec5258-dfa5-4bb1-b1e7-1af5fb826a9d-kube-api-access-chkn2\") pod \"neutron-a4c2-account-create-update-hlwsp\" (UID: \"d5ec5258-dfa5-4bb1-b1e7-1af5fb826a9d\") " pod="openstack-kuttl-tests/neutron-a4c2-account-create-update-hlwsp" Mar 16 16:32:24 crc kubenswrapper[5120]: I0316 16:32:24.621527 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d5ec5258-dfa5-4bb1-b1e7-1af5fb826a9d-operator-scripts\") pod \"neutron-a4c2-account-create-update-hlwsp\" (UID: \"d5ec5258-dfa5-4bb1-b1e7-1af5fb826a9d\") " pod="openstack-kuttl-tests/neutron-a4c2-account-create-update-hlwsp" Mar 16 16:32:24 crc kubenswrapper[5120]: I0316 16:32:24.621601 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-phslw\" (UniqueName: \"kubernetes.io/projected/5a4a6700-0b46-409f-9205-5e7660b99d89-kube-api-access-phslw\") pod \"barbican-53bd-account-create-update-54r7n\" (UID: \"5a4a6700-0b46-409f-9205-5e7660b99d89\") " pod="openstack-kuttl-tests/barbican-53bd-account-create-update-54r7n" Mar 16 16:32:24 crc kubenswrapper[5120]: I0316 16:32:24.622638 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5a4a6700-0b46-409f-9205-5e7660b99d89-operator-scripts\") pod \"barbican-53bd-account-create-update-54r7n\" (UID: \"5a4a6700-0b46-409f-9205-5e7660b99d89\") " pod="openstack-kuttl-tests/barbican-53bd-account-create-update-54r7n" Mar 16 16:32:24 crc kubenswrapper[5120]: I0316 16:32:24.634257 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d5ec5258-dfa5-4bb1-b1e7-1af5fb826a9d-operator-scripts\") pod \"neutron-a4c2-account-create-update-hlwsp\" (UID: \"d5ec5258-dfa5-4bb1-b1e7-1af5fb826a9d\") " pod="openstack-kuttl-tests/neutron-a4c2-account-create-update-hlwsp" Mar 16 16:32:24 crc kubenswrapper[5120]: I0316 16:32:24.639178 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-phslw\" (UniqueName: \"kubernetes.io/projected/5a4a6700-0b46-409f-9205-5e7660b99d89-kube-api-access-phslw\") pod \"barbican-53bd-account-create-update-54r7n\" (UID: \"5a4a6700-0b46-409f-9205-5e7660b99d89\") " pod="openstack-kuttl-tests/barbican-53bd-account-create-update-54r7n" Mar 16 16:32:24 crc kubenswrapper[5120]: I0316 16:32:24.645560 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-chkn2\" (UniqueName: \"kubernetes.io/projected/d5ec5258-dfa5-4bb1-b1e7-1af5fb826a9d-kube-api-access-chkn2\") pod \"neutron-a4c2-account-create-update-hlwsp\" (UID: \"d5ec5258-dfa5-4bb1-b1e7-1af5fb826a9d\") " pod="openstack-kuttl-tests/neutron-a4c2-account-create-update-hlwsp" Mar 16 16:32:24 crc kubenswrapper[5120]: I0316 16:32:24.676893 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="09b5d645-c91e-4bff-8b73-0651cf8397b6" path="/var/lib/kubelet/pods/09b5d645-c91e-4bff-8b73-0651cf8397b6/volumes" Mar 16 16:32:24 crc kubenswrapper[5120]: I0316 16:32:24.701897 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-wl7hj" Mar 16 16:32:24 crc kubenswrapper[5120]: I0316 16:32:24.722646 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-create-vh69f" Mar 16 16:32:24 crc kubenswrapper[5120]: I0316 16:32:24.732334 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-53bd-account-create-update-54r7n" Mar 16 16:32:24 crc kubenswrapper[5120]: I0316 16:32:24.903894 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-a4c2-account-create-update-hlwsp" Mar 16 16:32:24 crc kubenswrapper[5120]: I0316 16:32:24.918829 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-db-create-zzpvz"] Mar 16 16:32:25 crc kubenswrapper[5120]: I0316 16:32:25.015385 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-db-create-j72fx"] Mar 16 16:32:25 crc kubenswrapper[5120]: I0316 16:32:25.027149 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-5115-account-create-update-jvsp2"] Mar 16 16:32:25 crc kubenswrapper[5120]: W0316 16:32:25.053166 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd08d9407_af61_432f_abcd_f0e65aa2a342.slice/crio-099365b3fd0c14843cb20d9237e01e31c01593c858ded3d783b97dfdd802df0a WatchSource:0}: Error finding container 099365b3fd0c14843cb20d9237e01e31c01593c858ded3d783b97dfdd802df0a: Status 404 returned error can't find the container with id 099365b3fd0c14843cb20d9237e01e31c01593c858ded3d783b97dfdd802df0a Mar 16 16:32:25 crc kubenswrapper[5120]: I0316 16:32:25.247813 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-wl7hj"] Mar 16 16:32:25 crc kubenswrapper[5120]: W0316 16:32:25.250388 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda4244b14_9780_41af_a54c_3535782ca04d.slice/crio-1a8ac7a0356f5c1a34b778865ea2ca3582bcf83d2d0ca4ec89595e6d0a9bad1c WatchSource:0}: Error finding container 1a8ac7a0356f5c1a34b778865ea2ca3582bcf83d2d0ca4ec89595e6d0a9bad1c: Status 404 returned error can't find the container with id 1a8ac7a0356f5c1a34b778865ea2ca3582bcf83d2d0ca4ec89595e6d0a9bad1c Mar 16 16:32:25 crc kubenswrapper[5120]: I0316 16:32:25.373662 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-db-create-vh69f"] Mar 16 16:32:25 crc kubenswrapper[5120]: I0316 16:32:25.396776 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-53bd-account-create-update-54r7n"] Mar 16 16:32:25 crc kubenswrapper[5120]: W0316 16:32:25.399747 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5a4a6700_0b46_409f_9205_5e7660b99d89.slice/crio-7d3e85979b9f8a4c75abba0d2e855f16b78c1a8abf3e37805a948dfc3be8860b WatchSource:0}: Error finding container 7d3e85979b9f8a4c75abba0d2e855f16b78c1a8abf3e37805a948dfc3be8860b: Status 404 returned error can't find the container with id 7d3e85979b9f8a4c75abba0d2e855f16b78c1a8abf3e37805a948dfc3be8860b Mar 16 16:32:25 crc kubenswrapper[5120]: I0316 16:32:25.490176 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-create-j72fx" event={"ID":"61133921-00f6-44cf-a641-de9817b67634","Type":"ContainerStarted","Data":"a57da68ced84fcdae7a70112c8b318b169d3a3299c7e34a1d2c569b72f921d93"} Mar 16 16:32:25 crc kubenswrapper[5120]: I0316 16:32:25.490228 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-create-j72fx" event={"ID":"61133921-00f6-44cf-a641-de9817b67634","Type":"ContainerStarted","Data":"9cd9a5325fa507465c02a0b9ff24fc6c9176b3c3fe3ac71fbbf91a01b1573b61"} Mar 16 16:32:25 crc kubenswrapper[5120]: I0316 16:32:25.505655 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-wl7hj" event={"ID":"a4244b14-9780-41af-a54c-3535782ca04d","Type":"ContainerStarted","Data":"1a8ac7a0356f5c1a34b778865ea2ca3582bcf83d2d0ca4ec89595e6d0a9bad1c"} Mar 16 16:32:25 crc kubenswrapper[5120]: I0316 16:32:25.517928 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-db-create-j72fx" podStartSLOduration=2.517904109 podStartE2EDuration="2.517904109s" podCreationTimestamp="2026-03-16 16:32:23 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:32:25.506210463 +0000 UTC m=+3647.660142120" watchObservedRunningTime="2026-03-16 16:32:25.517904109 +0000 UTC m=+3647.671835766" Mar 16 16:32:25 crc kubenswrapper[5120]: I0316 16:32:25.519699 5120 generic.go:358] "Generic (PLEG): container finished" podID="6752488d-f177-4cc7-a58b-08533527272d" containerID="01b5445a4207bf5953afa9c301ae2b0e57017967426bdfe340180d2669092cdb" exitCode=0 Mar 16 16:32:25 crc kubenswrapper[5120]: I0316 16:32:25.520121 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-create-zzpvz" event={"ID":"6752488d-f177-4cc7-a58b-08533527272d","Type":"ContainerDied","Data":"01b5445a4207bf5953afa9c301ae2b0e57017967426bdfe340180d2669092cdb"} Mar 16 16:32:25 crc kubenswrapper[5120]: I0316 16:32:25.520177 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-create-zzpvz" event={"ID":"6752488d-f177-4cc7-a58b-08533527272d","Type":"ContainerStarted","Data":"8103585c0f9116860c0d09088a89be1c19bd926003fc8959bb063d99cfe7e9f4"} Mar 16 16:32:25 crc kubenswrapper[5120]: I0316 16:32:25.528257 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-53bd-account-create-update-54r7n" event={"ID":"5a4a6700-0b46-409f-9205-5e7660b99d89","Type":"ContainerStarted","Data":"7d3e85979b9f8a4c75abba0d2e855f16b78c1a8abf3e37805a948dfc3be8860b"} Mar 16 16:32:25 crc kubenswrapper[5120]: I0316 16:32:25.532671 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-create-vh69f" event={"ID":"a6475f4b-6adc-469e-941b-ff0d57fcad5f","Type":"ContainerStarted","Data":"b4b1879a0fe4ef23ce8585b0b3ef5fd8929d389c79ba9840f9c3ab39477d0f2c"} Mar 16 16:32:25 crc kubenswrapper[5120]: I0316 16:32:25.545828 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-5115-account-create-update-jvsp2" event={"ID":"d08d9407-af61-432f-abcd-f0e65aa2a342","Type":"ContainerStarted","Data":"d5b7943a5a6c5f3b05232b8a073776524fa939ad41492fb3551282c557accfb7"} Mar 16 16:32:25 crc kubenswrapper[5120]: I0316 16:32:25.545876 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-5115-account-create-update-jvsp2" event={"ID":"d08d9407-af61-432f-abcd-f0e65aa2a342","Type":"ContainerStarted","Data":"099365b3fd0c14843cb20d9237e01e31c01593c858ded3d783b97dfdd802df0a"} Mar 16 16:32:25 crc kubenswrapper[5120]: W0316 16:32:25.552535 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd5ec5258_dfa5_4bb1_b1e7_1af5fb826a9d.slice/crio-69ac55b3eef3502820759de0e70048b261f9599c045149c4a008db81b8cfc8d1 WatchSource:0}: Error finding container 69ac55b3eef3502820759de0e70048b261f9599c045149c4a008db81b8cfc8d1: Status 404 returned error can't find the container with id 69ac55b3eef3502820759de0e70048b261f9599c045149c4a008db81b8cfc8d1 Mar 16 16:32:25 crc kubenswrapper[5120]: I0316 16:32:25.588562 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-a4c2-account-create-update-hlwsp"] Mar 16 16:32:25 crc kubenswrapper[5120]: I0316 16:32:25.593413 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-5115-account-create-update-jvsp2" podStartSLOduration=2.593394934 podStartE2EDuration="2.593394934s" podCreationTimestamp="2026-03-16 16:32:23 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:32:25.57449545 +0000 UTC m=+3647.728427107" watchObservedRunningTime="2026-03-16 16:32:25.593394934 +0000 UTC m=+3647.747326591" Mar 16 16:32:26 crc kubenswrapper[5120]: I0316 16:32:26.555620 5120 generic.go:358] "Generic (PLEG): container finished" podID="5a4a6700-0b46-409f-9205-5e7660b99d89" containerID="291d216b683443c84b2f1796e40c85982981e2c6f17c626efe4146dedb5aa69e" exitCode=0 Mar 16 16:32:26 crc kubenswrapper[5120]: I0316 16:32:26.555745 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-53bd-account-create-update-54r7n" event={"ID":"5a4a6700-0b46-409f-9205-5e7660b99d89","Type":"ContainerDied","Data":"291d216b683443c84b2f1796e40c85982981e2c6f17c626efe4146dedb5aa69e"} Mar 16 16:32:26 crc kubenswrapper[5120]: I0316 16:32:26.559751 5120 generic.go:358] "Generic (PLEG): container finished" podID="a6475f4b-6adc-469e-941b-ff0d57fcad5f" containerID="e7552998c047982a5a2b1f7b36a0f809d754f53eeab0a3fc6dfb6b67a22e1482" exitCode=0 Mar 16 16:32:26 crc kubenswrapper[5120]: I0316 16:32:26.559870 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-create-vh69f" event={"ID":"a6475f4b-6adc-469e-941b-ff0d57fcad5f","Type":"ContainerDied","Data":"e7552998c047982a5a2b1f7b36a0f809d754f53eeab0a3fc6dfb6b67a22e1482"} Mar 16 16:32:26 crc kubenswrapper[5120]: I0316 16:32:26.561321 5120 generic.go:358] "Generic (PLEG): container finished" podID="d08d9407-af61-432f-abcd-f0e65aa2a342" containerID="d5b7943a5a6c5f3b05232b8a073776524fa939ad41492fb3551282c557accfb7" exitCode=0 Mar 16 16:32:26 crc kubenswrapper[5120]: I0316 16:32:26.561365 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-5115-account-create-update-jvsp2" event={"ID":"d08d9407-af61-432f-abcd-f0e65aa2a342","Type":"ContainerDied","Data":"d5b7943a5a6c5f3b05232b8a073776524fa939ad41492fb3551282c557accfb7"} Mar 16 16:32:26 crc kubenswrapper[5120]: I0316 16:32:26.563239 5120 generic.go:358] "Generic (PLEG): container finished" podID="d5ec5258-dfa5-4bb1-b1e7-1af5fb826a9d" containerID="ee24c81f31b37fc2f0bda0ce2b2c37f761ab08dcb89d6c5ba807ad6a7faa8718" exitCode=0 Mar 16 16:32:26 crc kubenswrapper[5120]: I0316 16:32:26.563281 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-a4c2-account-create-update-hlwsp" event={"ID":"d5ec5258-dfa5-4bb1-b1e7-1af5fb826a9d","Type":"ContainerDied","Data":"ee24c81f31b37fc2f0bda0ce2b2c37f761ab08dcb89d6c5ba807ad6a7faa8718"} Mar 16 16:32:26 crc kubenswrapper[5120]: I0316 16:32:26.563350 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-a4c2-account-create-update-hlwsp" event={"ID":"d5ec5258-dfa5-4bb1-b1e7-1af5fb826a9d","Type":"ContainerStarted","Data":"69ac55b3eef3502820759de0e70048b261f9599c045149c4a008db81b8cfc8d1"} Mar 16 16:32:26 crc kubenswrapper[5120]: I0316 16:32:26.564974 5120 generic.go:358] "Generic (PLEG): container finished" podID="61133921-00f6-44cf-a641-de9817b67634" containerID="a57da68ced84fcdae7a70112c8b318b169d3a3299c7e34a1d2c569b72f921d93" exitCode=0 Mar 16 16:32:26 crc kubenswrapper[5120]: I0316 16:32:26.565083 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-create-j72fx" event={"ID":"61133921-00f6-44cf-a641-de9817b67634","Type":"ContainerDied","Data":"a57da68ced84fcdae7a70112c8b318b169d3a3299c7e34a1d2c569b72f921d93"} Mar 16 16:32:26 crc kubenswrapper[5120]: I0316 16:32:26.567372 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-wl7hj" event={"ID":"a4244b14-9780-41af-a54c-3535782ca04d","Type":"ContainerStarted","Data":"ad0993b0521dbce57da1135798e270310c63a2a11641bcbaeda6a6634232fa0e"} Mar 16 16:32:26 crc kubenswrapper[5120]: I0316 16:32:26.601213 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-db-sync-wl7hj" podStartSLOduration=2.601183403 podStartE2EDuration="2.601183403s" podCreationTimestamp="2026-03-16 16:32:24 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:32:26.594274072 +0000 UTC m=+3648.748205759" watchObservedRunningTime="2026-03-16 16:32:26.601183403 +0000 UTC m=+3648.755115090" Mar 16 16:32:26 crc kubenswrapper[5120]: I0316 16:32:26.951020 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-create-zzpvz" Mar 16 16:32:27 crc kubenswrapper[5120]: I0316 16:32:27.075190 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/6752488d-f177-4cc7-a58b-08533527272d-operator-scripts\") pod \"6752488d-f177-4cc7-a58b-08533527272d\" (UID: \"6752488d-f177-4cc7-a58b-08533527272d\") " Mar 16 16:32:27 crc kubenswrapper[5120]: I0316 16:32:27.075294 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-57fq4\" (UniqueName: \"kubernetes.io/projected/6752488d-f177-4cc7-a58b-08533527272d-kube-api-access-57fq4\") pod \"6752488d-f177-4cc7-a58b-08533527272d\" (UID: \"6752488d-f177-4cc7-a58b-08533527272d\") " Mar 16 16:32:27 crc kubenswrapper[5120]: I0316 16:32:27.076985 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6752488d-f177-4cc7-a58b-08533527272d-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "6752488d-f177-4cc7-a58b-08533527272d" (UID: "6752488d-f177-4cc7-a58b-08533527272d"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:32:27 crc kubenswrapper[5120]: I0316 16:32:27.095320 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6752488d-f177-4cc7-a58b-08533527272d-kube-api-access-57fq4" (OuterVolumeSpecName: "kube-api-access-57fq4") pod "6752488d-f177-4cc7-a58b-08533527272d" (UID: "6752488d-f177-4cc7-a58b-08533527272d"). InnerVolumeSpecName "kube-api-access-57fq4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:32:27 crc kubenswrapper[5120]: I0316 16:32:27.179052 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/6752488d-f177-4cc7-a58b-08533527272d-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:32:27 crc kubenswrapper[5120]: I0316 16:32:27.179092 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-57fq4\" (UniqueName: \"kubernetes.io/projected/6752488d-f177-4cc7-a58b-08533527272d-kube-api-access-57fq4\") on node \"crc\" DevicePath \"\"" Mar 16 16:32:27 crc kubenswrapper[5120]: I0316 16:32:27.576922 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-create-zzpvz" event={"ID":"6752488d-f177-4cc7-a58b-08533527272d","Type":"ContainerDied","Data":"8103585c0f9116860c0d09088a89be1c19bd926003fc8959bb063d99cfe7e9f4"} Mar 16 16:32:27 crc kubenswrapper[5120]: I0316 16:32:27.577235 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8103585c0f9116860c0d09088a89be1c19bd926003fc8959bb063d99cfe7e9f4" Mar 16 16:32:27 crc kubenswrapper[5120]: I0316 16:32:27.576933 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-create-zzpvz" Mar 16 16:32:27 crc kubenswrapper[5120]: I0316 16:32:27.670033 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-jb5ks" podUID="09b5d645-c91e-4bff-8b73-0651cf8397b6" containerName="dnsmasq-dns" probeResult="failure" output="dial tcp 10.217.0.103:5353: i/o timeout" Mar 16 16:32:28 crc kubenswrapper[5120]: I0316 16:32:28.003730 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-5115-account-create-update-jvsp2" Mar 16 16:32:28 crc kubenswrapper[5120]: I0316 16:32:28.101732 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d08d9407-af61-432f-abcd-f0e65aa2a342-operator-scripts\") pod \"d08d9407-af61-432f-abcd-f0e65aa2a342\" (UID: \"d08d9407-af61-432f-abcd-f0e65aa2a342\") " Mar 16 16:32:28 crc kubenswrapper[5120]: I0316 16:32:28.102119 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2slrq\" (UniqueName: \"kubernetes.io/projected/d08d9407-af61-432f-abcd-f0e65aa2a342-kube-api-access-2slrq\") pod \"d08d9407-af61-432f-abcd-f0e65aa2a342\" (UID: \"d08d9407-af61-432f-abcd-f0e65aa2a342\") " Mar 16 16:32:28 crc kubenswrapper[5120]: I0316 16:32:28.103372 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d08d9407-af61-432f-abcd-f0e65aa2a342-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "d08d9407-af61-432f-abcd-f0e65aa2a342" (UID: "d08d9407-af61-432f-abcd-f0e65aa2a342"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:32:28 crc kubenswrapper[5120]: I0316 16:32:28.108588 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d08d9407-af61-432f-abcd-f0e65aa2a342-kube-api-access-2slrq" (OuterVolumeSpecName: "kube-api-access-2slrq") pod "d08d9407-af61-432f-abcd-f0e65aa2a342" (UID: "d08d9407-af61-432f-abcd-f0e65aa2a342"). InnerVolumeSpecName "kube-api-access-2slrq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:32:28 crc kubenswrapper[5120]: I0316 16:32:28.174176 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-create-vh69f" Mar 16 16:32:28 crc kubenswrapper[5120]: I0316 16:32:28.181599 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-create-j72fx" Mar 16 16:32:28 crc kubenswrapper[5120]: I0316 16:32:28.193155 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-53bd-account-create-update-54r7n" Mar 16 16:32:28 crc kubenswrapper[5120]: I0316 16:32:28.201332 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-a4c2-account-create-update-hlwsp" Mar 16 16:32:28 crc kubenswrapper[5120]: I0316 16:32:28.204401 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d08d9407-af61-432f-abcd-f0e65aa2a342-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:32:28 crc kubenswrapper[5120]: I0316 16:32:28.204444 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2slrq\" (UniqueName: \"kubernetes.io/projected/d08d9407-af61-432f-abcd-f0e65aa2a342-kube-api-access-2slrq\") on node \"crc\" DevicePath \"\"" Mar 16 16:32:28 crc kubenswrapper[5120]: I0316 16:32:28.305350 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gsfmp\" (UniqueName: \"kubernetes.io/projected/a6475f4b-6adc-469e-941b-ff0d57fcad5f-kube-api-access-gsfmp\") pod \"a6475f4b-6adc-469e-941b-ff0d57fcad5f\" (UID: \"a6475f4b-6adc-469e-941b-ff0d57fcad5f\") " Mar 16 16:32:28 crc kubenswrapper[5120]: I0316 16:32:28.305511 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5a4a6700-0b46-409f-9205-5e7660b99d89-operator-scripts\") pod \"5a4a6700-0b46-409f-9205-5e7660b99d89\" (UID: \"5a4a6700-0b46-409f-9205-5e7660b99d89\") " Mar 16 16:32:28 crc kubenswrapper[5120]: I0316 16:32:28.305582 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d5ec5258-dfa5-4bb1-b1e7-1af5fb826a9d-operator-scripts\") pod \"d5ec5258-dfa5-4bb1-b1e7-1af5fb826a9d\" (UID: \"d5ec5258-dfa5-4bb1-b1e7-1af5fb826a9d\") " Mar 16 16:32:28 crc kubenswrapper[5120]: I0316 16:32:28.305606 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/61133921-00f6-44cf-a641-de9817b67634-operator-scripts\") pod \"61133921-00f6-44cf-a641-de9817b67634\" (UID: \"61133921-00f6-44cf-a641-de9817b67634\") " Mar 16 16:32:28 crc kubenswrapper[5120]: I0316 16:32:28.305655 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8bvwx\" (UniqueName: \"kubernetes.io/projected/61133921-00f6-44cf-a641-de9817b67634-kube-api-access-8bvwx\") pod \"61133921-00f6-44cf-a641-de9817b67634\" (UID: \"61133921-00f6-44cf-a641-de9817b67634\") " Mar 16 16:32:28 crc kubenswrapper[5120]: I0316 16:32:28.305735 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a6475f4b-6adc-469e-941b-ff0d57fcad5f-operator-scripts\") pod \"a6475f4b-6adc-469e-941b-ff0d57fcad5f\" (UID: \"a6475f4b-6adc-469e-941b-ff0d57fcad5f\") " Mar 16 16:32:28 crc kubenswrapper[5120]: I0316 16:32:28.305829 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-phslw\" (UniqueName: \"kubernetes.io/projected/5a4a6700-0b46-409f-9205-5e7660b99d89-kube-api-access-phslw\") pod \"5a4a6700-0b46-409f-9205-5e7660b99d89\" (UID: \"5a4a6700-0b46-409f-9205-5e7660b99d89\") " Mar 16 16:32:28 crc kubenswrapper[5120]: I0316 16:32:28.305902 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-chkn2\" (UniqueName: \"kubernetes.io/projected/d5ec5258-dfa5-4bb1-b1e7-1af5fb826a9d-kube-api-access-chkn2\") pod \"d5ec5258-dfa5-4bb1-b1e7-1af5fb826a9d\" (UID: \"d5ec5258-dfa5-4bb1-b1e7-1af5fb826a9d\") " Mar 16 16:32:28 crc kubenswrapper[5120]: I0316 16:32:28.306313 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d5ec5258-dfa5-4bb1-b1e7-1af5fb826a9d-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "d5ec5258-dfa5-4bb1-b1e7-1af5fb826a9d" (UID: "d5ec5258-dfa5-4bb1-b1e7-1af5fb826a9d"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:32:28 crc kubenswrapper[5120]: I0316 16:32:28.306674 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/61133921-00f6-44cf-a641-de9817b67634-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "61133921-00f6-44cf-a641-de9817b67634" (UID: "61133921-00f6-44cf-a641-de9817b67634"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:32:28 crc kubenswrapper[5120]: I0316 16:32:28.306738 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6475f4b-6adc-469e-941b-ff0d57fcad5f-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "a6475f4b-6adc-469e-941b-ff0d57fcad5f" (UID: "a6475f4b-6adc-469e-941b-ff0d57fcad5f"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:32:28 crc kubenswrapper[5120]: I0316 16:32:28.307358 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d5ec5258-dfa5-4bb1-b1e7-1af5fb826a9d-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:32:28 crc kubenswrapper[5120]: I0316 16:32:28.307384 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/61133921-00f6-44cf-a641-de9817b67634-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:32:28 crc kubenswrapper[5120]: I0316 16:32:28.307375 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a4a6700-0b46-409f-9205-5e7660b99d89-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "5a4a6700-0b46-409f-9205-5e7660b99d89" (UID: "5a4a6700-0b46-409f-9205-5e7660b99d89"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:32:28 crc kubenswrapper[5120]: I0316 16:32:28.307395 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a6475f4b-6adc-469e-941b-ff0d57fcad5f-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:32:28 crc kubenswrapper[5120]: I0316 16:32:28.310342 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61133921-00f6-44cf-a641-de9817b67634-kube-api-access-8bvwx" (OuterVolumeSpecName: "kube-api-access-8bvwx") pod "61133921-00f6-44cf-a641-de9817b67634" (UID: "61133921-00f6-44cf-a641-de9817b67634"). InnerVolumeSpecName "kube-api-access-8bvwx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:32:28 crc kubenswrapper[5120]: I0316 16:32:28.310542 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6475f4b-6adc-469e-941b-ff0d57fcad5f-kube-api-access-gsfmp" (OuterVolumeSpecName: "kube-api-access-gsfmp") pod "a6475f4b-6adc-469e-941b-ff0d57fcad5f" (UID: "a6475f4b-6adc-469e-941b-ff0d57fcad5f"). InnerVolumeSpecName "kube-api-access-gsfmp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:32:28 crc kubenswrapper[5120]: I0316 16:32:28.310749 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a4a6700-0b46-409f-9205-5e7660b99d89-kube-api-access-phslw" (OuterVolumeSpecName: "kube-api-access-phslw") pod "5a4a6700-0b46-409f-9205-5e7660b99d89" (UID: "5a4a6700-0b46-409f-9205-5e7660b99d89"). InnerVolumeSpecName "kube-api-access-phslw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:32:28 crc kubenswrapper[5120]: I0316 16:32:28.312022 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5ec5258-dfa5-4bb1-b1e7-1af5fb826a9d-kube-api-access-chkn2" (OuterVolumeSpecName: "kube-api-access-chkn2") pod "d5ec5258-dfa5-4bb1-b1e7-1af5fb826a9d" (UID: "d5ec5258-dfa5-4bb1-b1e7-1af5fb826a9d"). InnerVolumeSpecName "kube-api-access-chkn2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:32:28 crc kubenswrapper[5120]: I0316 16:32:28.409289 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-chkn2\" (UniqueName: \"kubernetes.io/projected/d5ec5258-dfa5-4bb1-b1e7-1af5fb826a9d-kube-api-access-chkn2\") on node \"crc\" DevicePath \"\"" Mar 16 16:32:28 crc kubenswrapper[5120]: I0316 16:32:28.409325 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gsfmp\" (UniqueName: \"kubernetes.io/projected/a6475f4b-6adc-469e-941b-ff0d57fcad5f-kube-api-access-gsfmp\") on node \"crc\" DevicePath \"\"" Mar 16 16:32:28 crc kubenswrapper[5120]: I0316 16:32:28.409335 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5a4a6700-0b46-409f-9205-5e7660b99d89-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:32:28 crc kubenswrapper[5120]: I0316 16:32:28.409343 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8bvwx\" (UniqueName: \"kubernetes.io/projected/61133921-00f6-44cf-a641-de9817b67634-kube-api-access-8bvwx\") on node \"crc\" DevicePath \"\"" Mar 16 16:32:28 crc kubenswrapper[5120]: I0316 16:32:28.409351 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-phslw\" (UniqueName: \"kubernetes.io/projected/5a4a6700-0b46-409f-9205-5e7660b99d89-kube-api-access-phslw\") on node \"crc\" DevicePath \"\"" Mar 16 16:32:28 crc kubenswrapper[5120]: I0316 16:32:28.586812 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-create-vh69f" event={"ID":"a6475f4b-6adc-469e-941b-ff0d57fcad5f","Type":"ContainerDied","Data":"b4b1879a0fe4ef23ce8585b0b3ef5fd8929d389c79ba9840f9c3ab39477d0f2c"} Mar 16 16:32:28 crc kubenswrapper[5120]: I0316 16:32:28.586863 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b4b1879a0fe4ef23ce8585b0b3ef5fd8929d389c79ba9840f9c3ab39477d0f2c" Mar 16 16:32:28 crc kubenswrapper[5120]: I0316 16:32:28.586840 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-create-vh69f" Mar 16 16:32:28 crc kubenswrapper[5120]: I0316 16:32:28.588799 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-5115-account-create-update-jvsp2" Mar 16 16:32:28 crc kubenswrapper[5120]: I0316 16:32:28.588802 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-5115-account-create-update-jvsp2" event={"ID":"d08d9407-af61-432f-abcd-f0e65aa2a342","Type":"ContainerDied","Data":"099365b3fd0c14843cb20d9237e01e31c01593c858ded3d783b97dfdd802df0a"} Mar 16 16:32:28 crc kubenswrapper[5120]: I0316 16:32:28.588992 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="099365b3fd0c14843cb20d9237e01e31c01593c858ded3d783b97dfdd802df0a" Mar 16 16:32:28 crc kubenswrapper[5120]: I0316 16:32:28.590472 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-a4c2-account-create-update-hlwsp" event={"ID":"d5ec5258-dfa5-4bb1-b1e7-1af5fb826a9d","Type":"ContainerDied","Data":"69ac55b3eef3502820759de0e70048b261f9599c045149c4a008db81b8cfc8d1"} Mar 16 16:32:28 crc kubenswrapper[5120]: I0316 16:32:28.590504 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="69ac55b3eef3502820759de0e70048b261f9599c045149c4a008db81b8cfc8d1" Mar 16 16:32:28 crc kubenswrapper[5120]: I0316 16:32:28.590550 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-a4c2-account-create-update-hlwsp" Mar 16 16:32:28 crc kubenswrapper[5120]: I0316 16:32:28.592628 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-create-j72fx" Mar 16 16:32:28 crc kubenswrapper[5120]: I0316 16:32:28.592717 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-create-j72fx" event={"ID":"61133921-00f6-44cf-a641-de9817b67634","Type":"ContainerDied","Data":"9cd9a5325fa507465c02a0b9ff24fc6c9176b3c3fe3ac71fbbf91a01b1573b61"} Mar 16 16:32:28 crc kubenswrapper[5120]: I0316 16:32:28.593002 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9cd9a5325fa507465c02a0b9ff24fc6c9176b3c3fe3ac71fbbf91a01b1573b61" Mar 16 16:32:28 crc kubenswrapper[5120]: I0316 16:32:28.595530 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-53bd-account-create-update-54r7n" event={"ID":"5a4a6700-0b46-409f-9205-5e7660b99d89","Type":"ContainerDied","Data":"7d3e85979b9f8a4c75abba0d2e855f16b78c1a8abf3e37805a948dfc3be8860b"} Mar 16 16:32:28 crc kubenswrapper[5120]: I0316 16:32:28.595566 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7d3e85979b9f8a4c75abba0d2e855f16b78c1a8abf3e37805a948dfc3be8860b" Mar 16 16:32:28 crc kubenswrapper[5120]: I0316 16:32:28.595637 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-53bd-account-create-update-54r7n" Mar 16 16:32:29 crc kubenswrapper[5120]: I0316 16:32:29.605748 5120 generic.go:358] "Generic (PLEG): container finished" podID="a4244b14-9780-41af-a54c-3535782ca04d" containerID="ad0993b0521dbce57da1135798e270310c63a2a11641bcbaeda6a6634232fa0e" exitCode=0 Mar 16 16:32:29 crc kubenswrapper[5120]: I0316 16:32:29.606470 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-wl7hj" event={"ID":"a4244b14-9780-41af-a54c-3535782ca04d","Type":"ContainerDied","Data":"ad0993b0521dbce57da1135798e270310c63a2a11641bcbaeda6a6634232fa0e"} Mar 16 16:32:30 crc kubenswrapper[5120]: I0316 16:32:30.928816 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-wl7hj" Mar 16 16:32:30 crc kubenswrapper[5120]: I0316 16:32:30.989360 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jbtcq\" (UniqueName: \"kubernetes.io/projected/a4244b14-9780-41af-a54c-3535782ca04d-kube-api-access-jbtcq\") pod \"a4244b14-9780-41af-a54c-3535782ca04d\" (UID: \"a4244b14-9780-41af-a54c-3535782ca04d\") " Mar 16 16:32:30 crc kubenswrapper[5120]: I0316 16:32:30.989534 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a4244b14-9780-41af-a54c-3535782ca04d-config-data\") pod \"a4244b14-9780-41af-a54c-3535782ca04d\" (UID: \"a4244b14-9780-41af-a54c-3535782ca04d\") " Mar 16 16:32:30 crc kubenswrapper[5120]: I0316 16:32:30.989779 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a4244b14-9780-41af-a54c-3535782ca04d-combined-ca-bundle\") pod \"a4244b14-9780-41af-a54c-3535782ca04d\" (UID: \"a4244b14-9780-41af-a54c-3535782ca04d\") " Mar 16 16:32:31 crc kubenswrapper[5120]: I0316 16:32:30.999053 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a4244b14-9780-41af-a54c-3535782ca04d-kube-api-access-jbtcq" (OuterVolumeSpecName: "kube-api-access-jbtcq") pod "a4244b14-9780-41af-a54c-3535782ca04d" (UID: "a4244b14-9780-41af-a54c-3535782ca04d"). InnerVolumeSpecName "kube-api-access-jbtcq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:32:31 crc kubenswrapper[5120]: I0316 16:32:31.035486 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a4244b14-9780-41af-a54c-3535782ca04d-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "a4244b14-9780-41af-a54c-3535782ca04d" (UID: "a4244b14-9780-41af-a54c-3535782ca04d"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:32:31 crc kubenswrapper[5120]: I0316 16:32:31.039040 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a4244b14-9780-41af-a54c-3535782ca04d-config-data" (OuterVolumeSpecName: "config-data") pod "a4244b14-9780-41af-a54c-3535782ca04d" (UID: "a4244b14-9780-41af-a54c-3535782ca04d"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:32:31 crc kubenswrapper[5120]: I0316 16:32:31.091663 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jbtcq\" (UniqueName: \"kubernetes.io/projected/a4244b14-9780-41af-a54c-3535782ca04d-kube-api-access-jbtcq\") on node \"crc\" DevicePath \"\"" Mar 16 16:32:31 crc kubenswrapper[5120]: I0316 16:32:31.091696 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a4244b14-9780-41af-a54c-3535782ca04d-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:32:31 crc kubenswrapper[5120]: I0316 16:32:31.091708 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a4244b14-9780-41af-a54c-3535782ca04d-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:32:31 crc kubenswrapper[5120]: I0316 16:32:31.632880 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-wl7hj" event={"ID":"a4244b14-9780-41af-a54c-3535782ca04d","Type":"ContainerDied","Data":"1a8ac7a0356f5c1a34b778865ea2ca3582bcf83d2d0ca4ec89595e6d0a9bad1c"} Mar 16 16:32:31 crc kubenswrapper[5120]: I0316 16:32:31.632936 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1a8ac7a0356f5c1a34b778865ea2ca3582bcf83d2d0ca4ec89595e6d0a9bad1c" Mar 16 16:32:31 crc kubenswrapper[5120]: I0316 16:32:31.632939 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-wl7hj" Mar 16 16:32:31 crc kubenswrapper[5120]: I0316 16:32:31.817553 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-tvpzx"] Mar 16 16:32:31 crc kubenswrapper[5120]: I0316 16:32:31.818909 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6475f4b-6adc-469e-941b-ff0d57fcad5f" containerName="mariadb-database-create" Mar 16 16:32:31 crc kubenswrapper[5120]: I0316 16:32:31.818927 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6475f4b-6adc-469e-941b-ff0d57fcad5f" containerName="mariadb-database-create" Mar 16 16:32:31 crc kubenswrapper[5120]: I0316 16:32:31.818943 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5ec5258-dfa5-4bb1-b1e7-1af5fb826a9d" containerName="mariadb-account-create-update" Mar 16 16:32:31 crc kubenswrapper[5120]: I0316 16:32:31.818950 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5ec5258-dfa5-4bb1-b1e7-1af5fb826a9d" containerName="mariadb-account-create-update" Mar 16 16:32:31 crc kubenswrapper[5120]: I0316 16:32:31.818968 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4244b14-9780-41af-a54c-3535782ca04d" containerName="keystone-db-sync" Mar 16 16:32:31 crc kubenswrapper[5120]: I0316 16:32:31.818974 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4244b14-9780-41af-a54c-3535782ca04d" containerName="keystone-db-sync" Mar 16 16:32:31 crc kubenswrapper[5120]: I0316 16:32:31.818997 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d08d9407-af61-432f-abcd-f0e65aa2a342" containerName="mariadb-account-create-update" Mar 16 16:32:31 crc kubenswrapper[5120]: I0316 16:32:31.819004 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="d08d9407-af61-432f-abcd-f0e65aa2a342" containerName="mariadb-account-create-update" Mar 16 16:32:31 crc kubenswrapper[5120]: I0316 16:32:31.819017 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61133921-00f6-44cf-a641-de9817b67634" containerName="mariadb-database-create" Mar 16 16:32:31 crc kubenswrapper[5120]: I0316 16:32:31.819022 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="61133921-00f6-44cf-a641-de9817b67634" containerName="mariadb-database-create" Mar 16 16:32:31 crc kubenswrapper[5120]: I0316 16:32:31.819030 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a4a6700-0b46-409f-9205-5e7660b99d89" containerName="mariadb-account-create-update" Mar 16 16:32:31 crc kubenswrapper[5120]: I0316 16:32:31.819036 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a4a6700-0b46-409f-9205-5e7660b99d89" containerName="mariadb-account-create-update" Mar 16 16:32:31 crc kubenswrapper[5120]: I0316 16:32:31.819057 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6752488d-f177-4cc7-a58b-08533527272d" containerName="mariadb-database-create" Mar 16 16:32:31 crc kubenswrapper[5120]: I0316 16:32:31.819062 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="6752488d-f177-4cc7-a58b-08533527272d" containerName="mariadb-database-create" Mar 16 16:32:31 crc kubenswrapper[5120]: I0316 16:32:31.819213 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="d5ec5258-dfa5-4bb1-b1e7-1af5fb826a9d" containerName="mariadb-account-create-update" Mar 16 16:32:31 crc kubenswrapper[5120]: I0316 16:32:31.819226 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="61133921-00f6-44cf-a641-de9817b67634" containerName="mariadb-database-create" Mar 16 16:32:31 crc kubenswrapper[5120]: I0316 16:32:31.819242 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="d08d9407-af61-432f-abcd-f0e65aa2a342" containerName="mariadb-account-create-update" Mar 16 16:32:31 crc kubenswrapper[5120]: I0316 16:32:31.819256 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="a6475f4b-6adc-469e-941b-ff0d57fcad5f" containerName="mariadb-database-create" Mar 16 16:32:31 crc kubenswrapper[5120]: I0316 16:32:31.819266 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="5a4a6700-0b46-409f-9205-5e7660b99d89" containerName="mariadb-account-create-update" Mar 16 16:32:31 crc kubenswrapper[5120]: I0316 16:32:31.819275 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="a4244b14-9780-41af-a54c-3535782ca04d" containerName="keystone-db-sync" Mar 16 16:32:31 crc kubenswrapper[5120]: I0316 16:32:31.819284 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="6752488d-f177-4cc7-a58b-08533527272d" containerName="mariadb-database-create" Mar 16 16:32:31 crc kubenswrapper[5120]: I0316 16:32:31.829626 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-tvpzx" Mar 16 16:32:31 crc kubenswrapper[5120]: I0316 16:32:31.835299 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-config-data\"" Mar 16 16:32:31 crc kubenswrapper[5120]: I0316 16:32:31.835534 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone\"" Mar 16 16:32:31 crc kubenswrapper[5120]: I0316 16:32:31.836041 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-keystone-dockercfg-nqmkd\"" Mar 16 16:32:31 crc kubenswrapper[5120]: I0316 16:32:31.836194 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-scripts\"" Mar 16 16:32:31 crc kubenswrapper[5120]: I0316 16:32:31.836328 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"osp-secret\"" Mar 16 16:32:31 crc kubenswrapper[5120]: I0316 16:32:31.842448 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-tvpzx"] Mar 16 16:32:31 crc kubenswrapper[5120]: I0316 16:32:31.907353 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/408af245-438e-482c-ab14-fb2b7b947f8c-fernet-keys\") pod \"keystone-bootstrap-tvpzx\" (UID: \"408af245-438e-482c-ab14-fb2b7b947f8c\") " pod="openstack-kuttl-tests/keystone-bootstrap-tvpzx" Mar 16 16:32:31 crc kubenswrapper[5120]: I0316 16:32:31.907500 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/408af245-438e-482c-ab14-fb2b7b947f8c-config-data\") pod \"keystone-bootstrap-tvpzx\" (UID: \"408af245-438e-482c-ab14-fb2b7b947f8c\") " pod="openstack-kuttl-tests/keystone-bootstrap-tvpzx" Mar 16 16:32:31 crc kubenswrapper[5120]: I0316 16:32:31.907637 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/408af245-438e-482c-ab14-fb2b7b947f8c-credential-keys\") pod \"keystone-bootstrap-tvpzx\" (UID: \"408af245-438e-482c-ab14-fb2b7b947f8c\") " pod="openstack-kuttl-tests/keystone-bootstrap-tvpzx" Mar 16 16:32:31 crc kubenswrapper[5120]: I0316 16:32:31.907721 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/408af245-438e-482c-ab14-fb2b7b947f8c-scripts\") pod \"keystone-bootstrap-tvpzx\" (UID: \"408af245-438e-482c-ab14-fb2b7b947f8c\") " pod="openstack-kuttl-tests/keystone-bootstrap-tvpzx" Mar 16 16:32:31 crc kubenswrapper[5120]: I0316 16:32:31.907772 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhlgw\" (UniqueName: \"kubernetes.io/projected/408af245-438e-482c-ab14-fb2b7b947f8c-kube-api-access-jhlgw\") pod \"keystone-bootstrap-tvpzx\" (UID: \"408af245-438e-482c-ab14-fb2b7b947f8c\") " pod="openstack-kuttl-tests/keystone-bootstrap-tvpzx" Mar 16 16:32:31 crc kubenswrapper[5120]: I0316 16:32:31.907818 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/408af245-438e-482c-ab14-fb2b7b947f8c-combined-ca-bundle\") pod \"keystone-bootstrap-tvpzx\" (UID: \"408af245-438e-482c-ab14-fb2b7b947f8c\") " pod="openstack-kuttl-tests/keystone-bootstrap-tvpzx" Mar 16 16:32:31 crc kubenswrapper[5120]: I0316 16:32:31.980109 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-5fdqd"] Mar 16 16:32:31 crc kubenswrapper[5120]: I0316 16:32:31.987170 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-5fdqd" Mar 16 16:32:31 crc kubenswrapper[5120]: I0316 16:32:31.992894 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-scripts\"" Mar 16 16:32:31 crc kubenswrapper[5120]: I0316 16:32:31.992907 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-config-data\"" Mar 16 16:32:31 crc kubenswrapper[5120]: I0316 16:32:31.993013 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-cinder-dockercfg-zqh64\"" Mar 16 16:32:32 crc kubenswrapper[5120]: I0316 16:32:32.001472 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-5fdqd"] Mar 16 16:32:32 crc kubenswrapper[5120]: I0316 16:32:32.009983 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f21b59e7-258d-40b6-ac7f-14f44058aa3b-combined-ca-bundle\") pod \"cinder-db-sync-5fdqd\" (UID: \"f21b59e7-258d-40b6-ac7f-14f44058aa3b\") " pod="openstack-kuttl-tests/cinder-db-sync-5fdqd" Mar 16 16:32:32 crc kubenswrapper[5120]: I0316 16:32:32.010036 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/408af245-438e-482c-ab14-fb2b7b947f8c-config-data\") pod \"keystone-bootstrap-tvpzx\" (UID: \"408af245-438e-482c-ab14-fb2b7b947f8c\") " pod="openstack-kuttl-tests/keystone-bootstrap-tvpzx" Mar 16 16:32:32 crc kubenswrapper[5120]: I0316 16:32:32.010194 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctz2p\" (UniqueName: \"kubernetes.io/projected/f21b59e7-258d-40b6-ac7f-14f44058aa3b-kube-api-access-ctz2p\") pod \"cinder-db-sync-5fdqd\" (UID: \"f21b59e7-258d-40b6-ac7f-14f44058aa3b\") " pod="openstack-kuttl-tests/cinder-db-sync-5fdqd" Mar 16 16:32:32 crc kubenswrapper[5120]: I0316 16:32:32.010352 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/408af245-438e-482c-ab14-fb2b7b947f8c-credential-keys\") pod \"keystone-bootstrap-tvpzx\" (UID: \"408af245-438e-482c-ab14-fb2b7b947f8c\") " pod="openstack-kuttl-tests/keystone-bootstrap-tvpzx" Mar 16 16:32:32 crc kubenswrapper[5120]: I0316 16:32:32.010433 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/f21b59e7-258d-40b6-ac7f-14f44058aa3b-db-sync-config-data\") pod \"cinder-db-sync-5fdqd\" (UID: \"f21b59e7-258d-40b6-ac7f-14f44058aa3b\") " pod="openstack-kuttl-tests/cinder-db-sync-5fdqd" Mar 16 16:32:32 crc kubenswrapper[5120]: I0316 16:32:32.010467 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f21b59e7-258d-40b6-ac7f-14f44058aa3b-config-data\") pod \"cinder-db-sync-5fdqd\" (UID: \"f21b59e7-258d-40b6-ac7f-14f44058aa3b\") " pod="openstack-kuttl-tests/cinder-db-sync-5fdqd" Mar 16 16:32:32 crc kubenswrapper[5120]: I0316 16:32:32.010525 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/408af245-438e-482c-ab14-fb2b7b947f8c-scripts\") pod \"keystone-bootstrap-tvpzx\" (UID: \"408af245-438e-482c-ab14-fb2b7b947f8c\") " pod="openstack-kuttl-tests/keystone-bootstrap-tvpzx" Mar 16 16:32:32 crc kubenswrapper[5120]: I0316 16:32:32.010589 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jhlgw\" (UniqueName: \"kubernetes.io/projected/408af245-438e-482c-ab14-fb2b7b947f8c-kube-api-access-jhlgw\") pod \"keystone-bootstrap-tvpzx\" (UID: \"408af245-438e-482c-ab14-fb2b7b947f8c\") " pod="openstack-kuttl-tests/keystone-bootstrap-tvpzx" Mar 16 16:32:32 crc kubenswrapper[5120]: I0316 16:32:32.010690 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/408af245-438e-482c-ab14-fb2b7b947f8c-combined-ca-bundle\") pod \"keystone-bootstrap-tvpzx\" (UID: \"408af245-438e-482c-ab14-fb2b7b947f8c\") " pod="openstack-kuttl-tests/keystone-bootstrap-tvpzx" Mar 16 16:32:32 crc kubenswrapper[5120]: I0316 16:32:32.010746 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/408af245-438e-482c-ab14-fb2b7b947f8c-fernet-keys\") pod \"keystone-bootstrap-tvpzx\" (UID: \"408af245-438e-482c-ab14-fb2b7b947f8c\") " pod="openstack-kuttl-tests/keystone-bootstrap-tvpzx" Mar 16 16:32:32 crc kubenswrapper[5120]: I0316 16:32:32.010799 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f21b59e7-258d-40b6-ac7f-14f44058aa3b-scripts\") pod \"cinder-db-sync-5fdqd\" (UID: \"f21b59e7-258d-40b6-ac7f-14f44058aa3b\") " pod="openstack-kuttl-tests/cinder-db-sync-5fdqd" Mar 16 16:32:32 crc kubenswrapper[5120]: I0316 16:32:32.010866 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/f21b59e7-258d-40b6-ac7f-14f44058aa3b-etc-machine-id\") pod \"cinder-db-sync-5fdqd\" (UID: \"f21b59e7-258d-40b6-ac7f-14f44058aa3b\") " pod="openstack-kuttl-tests/cinder-db-sync-5fdqd" Mar 16 16:32:32 crc kubenswrapper[5120]: I0316 16:32:32.016848 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/408af245-438e-482c-ab14-fb2b7b947f8c-config-data\") pod \"keystone-bootstrap-tvpzx\" (UID: \"408af245-438e-482c-ab14-fb2b7b947f8c\") " pod="openstack-kuttl-tests/keystone-bootstrap-tvpzx" Mar 16 16:32:32 crc kubenswrapper[5120]: I0316 16:32:32.018989 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/408af245-438e-482c-ab14-fb2b7b947f8c-scripts\") pod \"keystone-bootstrap-tvpzx\" (UID: \"408af245-438e-482c-ab14-fb2b7b947f8c\") " pod="openstack-kuttl-tests/keystone-bootstrap-tvpzx" Mar 16 16:32:32 crc kubenswrapper[5120]: I0316 16:32:32.020987 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/408af245-438e-482c-ab14-fb2b7b947f8c-credential-keys\") pod \"keystone-bootstrap-tvpzx\" (UID: \"408af245-438e-482c-ab14-fb2b7b947f8c\") " pod="openstack-kuttl-tests/keystone-bootstrap-tvpzx" Mar 16 16:32:32 crc kubenswrapper[5120]: I0316 16:32:32.021711 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/408af245-438e-482c-ab14-fb2b7b947f8c-combined-ca-bundle\") pod \"keystone-bootstrap-tvpzx\" (UID: \"408af245-438e-482c-ab14-fb2b7b947f8c\") " pod="openstack-kuttl-tests/keystone-bootstrap-tvpzx" Mar 16 16:32:32 crc kubenswrapper[5120]: I0316 16:32:32.021433 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/408af245-438e-482c-ab14-fb2b7b947f8c-fernet-keys\") pod \"keystone-bootstrap-tvpzx\" (UID: \"408af245-438e-482c-ab14-fb2b7b947f8c\") " pod="openstack-kuttl-tests/keystone-bootstrap-tvpzx" Mar 16 16:32:32 crc kubenswrapper[5120]: I0316 16:32:32.072377 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhlgw\" (UniqueName: \"kubernetes.io/projected/408af245-438e-482c-ab14-fb2b7b947f8c-kube-api-access-jhlgw\") pod \"keystone-bootstrap-tvpzx\" (UID: \"408af245-438e-482c-ab14-fb2b7b947f8c\") " pod="openstack-kuttl-tests/keystone-bootstrap-tvpzx" Mar 16 16:32:32 crc kubenswrapper[5120]: I0316 16:32:32.097273 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:32:32 crc kubenswrapper[5120]: I0316 16:32:32.117915 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f21b59e7-258d-40b6-ac7f-14f44058aa3b-scripts\") pod \"cinder-db-sync-5fdqd\" (UID: \"f21b59e7-258d-40b6-ac7f-14f44058aa3b\") " pod="openstack-kuttl-tests/cinder-db-sync-5fdqd" Mar 16 16:32:32 crc kubenswrapper[5120]: I0316 16:32:32.117986 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/f21b59e7-258d-40b6-ac7f-14f44058aa3b-etc-machine-id\") pod \"cinder-db-sync-5fdqd\" (UID: \"f21b59e7-258d-40b6-ac7f-14f44058aa3b\") " pod="openstack-kuttl-tests/cinder-db-sync-5fdqd" Mar 16 16:32:32 crc kubenswrapper[5120]: I0316 16:32:32.118040 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f21b59e7-258d-40b6-ac7f-14f44058aa3b-combined-ca-bundle\") pod \"cinder-db-sync-5fdqd\" (UID: \"f21b59e7-258d-40b6-ac7f-14f44058aa3b\") " pod="openstack-kuttl-tests/cinder-db-sync-5fdqd" Mar 16 16:32:32 crc kubenswrapper[5120]: I0316 16:32:32.118110 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ctz2p\" (UniqueName: \"kubernetes.io/projected/f21b59e7-258d-40b6-ac7f-14f44058aa3b-kube-api-access-ctz2p\") pod \"cinder-db-sync-5fdqd\" (UID: \"f21b59e7-258d-40b6-ac7f-14f44058aa3b\") " pod="openstack-kuttl-tests/cinder-db-sync-5fdqd" Mar 16 16:32:32 crc kubenswrapper[5120]: I0316 16:32:32.118101 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/f21b59e7-258d-40b6-ac7f-14f44058aa3b-etc-machine-id\") pod \"cinder-db-sync-5fdqd\" (UID: \"f21b59e7-258d-40b6-ac7f-14f44058aa3b\") " pod="openstack-kuttl-tests/cinder-db-sync-5fdqd" Mar 16 16:32:32 crc kubenswrapper[5120]: I0316 16:32:32.118312 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/f21b59e7-258d-40b6-ac7f-14f44058aa3b-db-sync-config-data\") pod \"cinder-db-sync-5fdqd\" (UID: \"f21b59e7-258d-40b6-ac7f-14f44058aa3b\") " pod="openstack-kuttl-tests/cinder-db-sync-5fdqd" Mar 16 16:32:32 crc kubenswrapper[5120]: I0316 16:32:32.118347 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f21b59e7-258d-40b6-ac7f-14f44058aa3b-config-data\") pod \"cinder-db-sync-5fdqd\" (UID: \"f21b59e7-258d-40b6-ac7f-14f44058aa3b\") " pod="openstack-kuttl-tests/cinder-db-sync-5fdqd" Mar 16 16:32:32 crc kubenswrapper[5120]: I0316 16:32:32.124617 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f21b59e7-258d-40b6-ac7f-14f44058aa3b-scripts\") pod \"cinder-db-sync-5fdqd\" (UID: \"f21b59e7-258d-40b6-ac7f-14f44058aa3b\") " pod="openstack-kuttl-tests/cinder-db-sync-5fdqd" Mar 16 16:32:32 crc kubenswrapper[5120]: I0316 16:32:32.128742 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:32:32 crc kubenswrapper[5120]: I0316 16:32:32.128929 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:32:32 crc kubenswrapper[5120]: I0316 16:32:32.129840 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f21b59e7-258d-40b6-ac7f-14f44058aa3b-combined-ca-bundle\") pod \"cinder-db-sync-5fdqd\" (UID: \"f21b59e7-258d-40b6-ac7f-14f44058aa3b\") " pod="openstack-kuttl-tests/cinder-db-sync-5fdqd" Mar 16 16:32:32 crc kubenswrapper[5120]: I0316 16:32:32.137312 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/f21b59e7-258d-40b6-ac7f-14f44058aa3b-db-sync-config-data\") pod \"cinder-db-sync-5fdqd\" (UID: \"f21b59e7-258d-40b6-ac7f-14f44058aa3b\") " pod="openstack-kuttl-tests/cinder-db-sync-5fdqd" Mar 16 16:32:32 crc kubenswrapper[5120]: I0316 16:32:32.137405 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 16:32:32 crc kubenswrapper[5120]: I0316 16:32:32.137471 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 16:32:32 crc kubenswrapper[5120]: I0316 16:32:32.141733 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f21b59e7-258d-40b6-ac7f-14f44058aa3b-config-data\") pod \"cinder-db-sync-5fdqd\" (UID: \"f21b59e7-258d-40b6-ac7f-14f44058aa3b\") " pod="openstack-kuttl-tests/cinder-db-sync-5fdqd" Mar 16 16:32:32 crc kubenswrapper[5120]: I0316 16:32:32.146242 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctz2p\" (UniqueName: \"kubernetes.io/projected/f21b59e7-258d-40b6-ac7f-14f44058aa3b-kube-api-access-ctz2p\") pod \"cinder-db-sync-5fdqd\" (UID: \"f21b59e7-258d-40b6-ac7f-14f44058aa3b\") " pod="openstack-kuttl-tests/cinder-db-sync-5fdqd" Mar 16 16:32:32 crc kubenswrapper[5120]: I0316 16:32:32.174197 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-g6hww"] Mar 16 16:32:32 crc kubenswrapper[5120]: I0316 16:32:32.178014 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-tvpzx" Mar 16 16:32:32 crc kubenswrapper[5120]: I0316 16:32:32.199979 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-g6hww"] Mar 16 16:32:32 crc kubenswrapper[5120]: I0316 16:32:32.200107 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-g6hww" Mar 16 16:32:32 crc kubenswrapper[5120]: I0316 16:32:32.203102 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-barbican-dockercfg-p792w\"" Mar 16 16:32:32 crc kubenswrapper[5120]: I0316 16:32:32.203288 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-config-data\"" Mar 16 16:32:32 crc kubenswrapper[5120]: I0316 16:32:32.219903 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/5c5ca400-22f5-457a-987f-0efd2139f18e-db-sync-config-data\") pod \"barbican-db-sync-g6hww\" (UID: \"5c5ca400-22f5-457a-987f-0efd2139f18e\") " pod="openstack-kuttl-tests/barbican-db-sync-g6hww" Mar 16 16:32:32 crc kubenswrapper[5120]: I0316 16:32:32.220248 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2aeaa955-5410-4726-9eb7-0b99cff87b61-config-data\") pod \"ceilometer-0\" (UID: \"2aeaa955-5410-4726-9eb7-0b99cff87b61\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:32:32 crc kubenswrapper[5120]: I0316 16:32:32.221061 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/2aeaa955-5410-4726-9eb7-0b99cff87b61-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"2aeaa955-5410-4726-9eb7-0b99cff87b61\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:32:32 crc kubenswrapper[5120]: I0316 16:32:32.221160 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpkgd\" (UniqueName: \"kubernetes.io/projected/5c5ca400-22f5-457a-987f-0efd2139f18e-kube-api-access-xpkgd\") pod \"barbican-db-sync-g6hww\" (UID: \"5c5ca400-22f5-457a-987f-0efd2139f18e\") " pod="openstack-kuttl-tests/barbican-db-sync-g6hww" Mar 16 16:32:32 crc kubenswrapper[5120]: I0316 16:32:32.222147 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2aeaa955-5410-4726-9eb7-0b99cff87b61-scripts\") pod \"ceilometer-0\" (UID: \"2aeaa955-5410-4726-9eb7-0b99cff87b61\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:32:32 crc kubenswrapper[5120]: I0316 16:32:32.222172 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6r6j\" (UniqueName: \"kubernetes.io/projected/2aeaa955-5410-4726-9eb7-0b99cff87b61-kube-api-access-n6r6j\") pod \"ceilometer-0\" (UID: \"2aeaa955-5410-4726-9eb7-0b99cff87b61\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:32:32 crc kubenswrapper[5120]: I0316 16:32:32.222282 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2aeaa955-5410-4726-9eb7-0b99cff87b61-run-httpd\") pod \"ceilometer-0\" (UID: \"2aeaa955-5410-4726-9eb7-0b99cff87b61\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:32:32 crc kubenswrapper[5120]: I0316 16:32:32.222355 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2aeaa955-5410-4726-9eb7-0b99cff87b61-log-httpd\") pod \"ceilometer-0\" (UID: \"2aeaa955-5410-4726-9eb7-0b99cff87b61\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:32:32 crc kubenswrapper[5120]: I0316 16:32:32.222415 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5c5ca400-22f5-457a-987f-0efd2139f18e-combined-ca-bundle\") pod \"barbican-db-sync-g6hww\" (UID: \"5c5ca400-22f5-457a-987f-0efd2139f18e\") " pod="openstack-kuttl-tests/barbican-db-sync-g6hww" Mar 16 16:32:32 crc kubenswrapper[5120]: I0316 16:32:32.222497 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2aeaa955-5410-4726-9eb7-0b99cff87b61-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"2aeaa955-5410-4726-9eb7-0b99cff87b61\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:32:32 crc kubenswrapper[5120]: I0316 16:32:32.223747 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-db-sync-bmmdk"] Mar 16 16:32:32 crc kubenswrapper[5120]: I0316 16:32:32.253944 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-bmmdk" Mar 16 16:32:32 crc kubenswrapper[5120]: I0316 16:32:32.258584 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-bmmdk"] Mar 16 16:32:32 crc kubenswrapper[5120]: I0316 16:32:32.259937 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-scripts\"" Mar 16 16:32:32 crc kubenswrapper[5120]: I0316 16:32:32.260278 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-config-data\"" Mar 16 16:32:32 crc kubenswrapper[5120]: I0316 16:32:32.260458 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-placement-dockercfg-crlqd\"" Mar 16 16:32:32 crc kubenswrapper[5120]: I0316 16:32:32.307609 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-5fdqd" Mar 16 16:32:32 crc kubenswrapper[5120]: I0316 16:32:32.324334 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/5c5ca400-22f5-457a-987f-0efd2139f18e-db-sync-config-data\") pod \"barbican-db-sync-g6hww\" (UID: \"5c5ca400-22f5-457a-987f-0efd2139f18e\") " pod="openstack-kuttl-tests/barbican-db-sync-g6hww" Mar 16 16:32:32 crc kubenswrapper[5120]: I0316 16:32:32.324386 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2aeaa955-5410-4726-9eb7-0b99cff87b61-config-data\") pod \"ceilometer-0\" (UID: \"2aeaa955-5410-4726-9eb7-0b99cff87b61\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:32:32 crc kubenswrapper[5120]: I0316 16:32:32.324428 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/46f918f9-8750-4631-9cf3-5f060522c045-logs\") pod \"placement-db-sync-bmmdk\" (UID: \"46f918f9-8750-4631-9cf3-5f060522c045\") " pod="openstack-kuttl-tests/placement-db-sync-bmmdk" Mar 16 16:32:32 crc kubenswrapper[5120]: I0316 16:32:32.324477 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/46f918f9-8750-4631-9cf3-5f060522c045-combined-ca-bundle\") pod \"placement-db-sync-bmmdk\" (UID: \"46f918f9-8750-4631-9cf3-5f060522c045\") " pod="openstack-kuttl-tests/placement-db-sync-bmmdk" Mar 16 16:32:32 crc kubenswrapper[5120]: I0316 16:32:32.324499 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/2aeaa955-5410-4726-9eb7-0b99cff87b61-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"2aeaa955-5410-4726-9eb7-0b99cff87b61\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:32:32 crc kubenswrapper[5120]: I0316 16:32:32.324544 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xpkgd\" (UniqueName: \"kubernetes.io/projected/5c5ca400-22f5-457a-987f-0efd2139f18e-kube-api-access-xpkgd\") pod \"barbican-db-sync-g6hww\" (UID: \"5c5ca400-22f5-457a-987f-0efd2139f18e\") " pod="openstack-kuttl-tests/barbican-db-sync-g6hww" Mar 16 16:32:32 crc kubenswrapper[5120]: I0316 16:32:32.324578 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2aeaa955-5410-4726-9eb7-0b99cff87b61-scripts\") pod \"ceilometer-0\" (UID: \"2aeaa955-5410-4726-9eb7-0b99cff87b61\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:32:32 crc kubenswrapper[5120]: I0316 16:32:32.324598 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n6r6j\" (UniqueName: \"kubernetes.io/projected/2aeaa955-5410-4726-9eb7-0b99cff87b61-kube-api-access-n6r6j\") pod \"ceilometer-0\" (UID: \"2aeaa955-5410-4726-9eb7-0b99cff87b61\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:32:32 crc kubenswrapper[5120]: I0316 16:32:32.324632 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5cnq\" (UniqueName: \"kubernetes.io/projected/46f918f9-8750-4631-9cf3-5f060522c045-kube-api-access-q5cnq\") pod \"placement-db-sync-bmmdk\" (UID: \"46f918f9-8750-4631-9cf3-5f060522c045\") " pod="openstack-kuttl-tests/placement-db-sync-bmmdk" Mar 16 16:32:32 crc kubenswrapper[5120]: I0316 16:32:32.324669 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2aeaa955-5410-4726-9eb7-0b99cff87b61-run-httpd\") pod \"ceilometer-0\" (UID: \"2aeaa955-5410-4726-9eb7-0b99cff87b61\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:32:32 crc kubenswrapper[5120]: I0316 16:32:32.324702 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/46f918f9-8750-4631-9cf3-5f060522c045-scripts\") pod \"placement-db-sync-bmmdk\" (UID: \"46f918f9-8750-4631-9cf3-5f060522c045\") " pod="openstack-kuttl-tests/placement-db-sync-bmmdk" Mar 16 16:32:32 crc kubenswrapper[5120]: I0316 16:32:32.324718 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2aeaa955-5410-4726-9eb7-0b99cff87b61-log-httpd\") pod \"ceilometer-0\" (UID: \"2aeaa955-5410-4726-9eb7-0b99cff87b61\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:32:32 crc kubenswrapper[5120]: I0316 16:32:32.324745 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5c5ca400-22f5-457a-987f-0efd2139f18e-combined-ca-bundle\") pod \"barbican-db-sync-g6hww\" (UID: \"5c5ca400-22f5-457a-987f-0efd2139f18e\") " pod="openstack-kuttl-tests/barbican-db-sync-g6hww" Mar 16 16:32:32 crc kubenswrapper[5120]: I0316 16:32:32.324802 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2aeaa955-5410-4726-9eb7-0b99cff87b61-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"2aeaa955-5410-4726-9eb7-0b99cff87b61\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:32:32 crc kubenswrapper[5120]: I0316 16:32:32.324855 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/46f918f9-8750-4631-9cf3-5f060522c045-config-data\") pod \"placement-db-sync-bmmdk\" (UID: \"46f918f9-8750-4631-9cf3-5f060522c045\") " pod="openstack-kuttl-tests/placement-db-sync-bmmdk" Mar 16 16:32:32 crc kubenswrapper[5120]: I0316 16:32:32.326931 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2aeaa955-5410-4726-9eb7-0b99cff87b61-log-httpd\") pod \"ceilometer-0\" (UID: \"2aeaa955-5410-4726-9eb7-0b99cff87b61\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:32:32 crc kubenswrapper[5120]: I0316 16:32:32.327172 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2aeaa955-5410-4726-9eb7-0b99cff87b61-run-httpd\") pod \"ceilometer-0\" (UID: \"2aeaa955-5410-4726-9eb7-0b99cff87b61\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:32:32 crc kubenswrapper[5120]: I0316 16:32:32.330146 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/2aeaa955-5410-4726-9eb7-0b99cff87b61-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"2aeaa955-5410-4726-9eb7-0b99cff87b61\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:32:32 crc kubenswrapper[5120]: I0316 16:32:32.331379 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5c5ca400-22f5-457a-987f-0efd2139f18e-combined-ca-bundle\") pod \"barbican-db-sync-g6hww\" (UID: \"5c5ca400-22f5-457a-987f-0efd2139f18e\") " pod="openstack-kuttl-tests/barbican-db-sync-g6hww" Mar 16 16:32:32 crc kubenswrapper[5120]: I0316 16:32:32.331415 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2aeaa955-5410-4726-9eb7-0b99cff87b61-scripts\") pod \"ceilometer-0\" (UID: \"2aeaa955-5410-4726-9eb7-0b99cff87b61\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:32:32 crc kubenswrapper[5120]: I0316 16:32:32.332216 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2aeaa955-5410-4726-9eb7-0b99cff87b61-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"2aeaa955-5410-4726-9eb7-0b99cff87b61\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:32:32 crc kubenswrapper[5120]: I0316 16:32:32.337510 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/5c5ca400-22f5-457a-987f-0efd2139f18e-db-sync-config-data\") pod \"barbican-db-sync-g6hww\" (UID: \"5c5ca400-22f5-457a-987f-0efd2139f18e\") " pod="openstack-kuttl-tests/barbican-db-sync-g6hww" Mar 16 16:32:32 crc kubenswrapper[5120]: I0316 16:32:32.344212 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2aeaa955-5410-4726-9eb7-0b99cff87b61-config-data\") pod \"ceilometer-0\" (UID: \"2aeaa955-5410-4726-9eb7-0b99cff87b61\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:32:32 crc kubenswrapper[5120]: I0316 16:32:32.347412 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpkgd\" (UniqueName: \"kubernetes.io/projected/5c5ca400-22f5-457a-987f-0efd2139f18e-kube-api-access-xpkgd\") pod \"barbican-db-sync-g6hww\" (UID: \"5c5ca400-22f5-457a-987f-0efd2139f18e\") " pod="openstack-kuttl-tests/barbican-db-sync-g6hww" Mar 16 16:32:32 crc kubenswrapper[5120]: I0316 16:32:32.350472 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6r6j\" (UniqueName: \"kubernetes.io/projected/2aeaa955-5410-4726-9eb7-0b99cff87b61-kube-api-access-n6r6j\") pod \"ceilometer-0\" (UID: \"2aeaa955-5410-4726-9eb7-0b99cff87b61\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:32:32 crc kubenswrapper[5120]: I0316 16:32:32.427295 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/46f918f9-8750-4631-9cf3-5f060522c045-logs\") pod \"placement-db-sync-bmmdk\" (UID: \"46f918f9-8750-4631-9cf3-5f060522c045\") " pod="openstack-kuttl-tests/placement-db-sync-bmmdk" Mar 16 16:32:32 crc kubenswrapper[5120]: I0316 16:32:32.427374 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/46f918f9-8750-4631-9cf3-5f060522c045-combined-ca-bundle\") pod \"placement-db-sync-bmmdk\" (UID: \"46f918f9-8750-4631-9cf3-5f060522c045\") " pod="openstack-kuttl-tests/placement-db-sync-bmmdk" Mar 16 16:32:32 crc kubenswrapper[5120]: I0316 16:32:32.427450 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q5cnq\" (UniqueName: \"kubernetes.io/projected/46f918f9-8750-4631-9cf3-5f060522c045-kube-api-access-q5cnq\") pod \"placement-db-sync-bmmdk\" (UID: \"46f918f9-8750-4631-9cf3-5f060522c045\") " pod="openstack-kuttl-tests/placement-db-sync-bmmdk" Mar 16 16:32:32 crc kubenswrapper[5120]: I0316 16:32:32.427502 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/46f918f9-8750-4631-9cf3-5f060522c045-scripts\") pod \"placement-db-sync-bmmdk\" (UID: \"46f918f9-8750-4631-9cf3-5f060522c045\") " pod="openstack-kuttl-tests/placement-db-sync-bmmdk" Mar 16 16:32:32 crc kubenswrapper[5120]: I0316 16:32:32.427578 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/46f918f9-8750-4631-9cf3-5f060522c045-config-data\") pod \"placement-db-sync-bmmdk\" (UID: \"46f918f9-8750-4631-9cf3-5f060522c045\") " pod="openstack-kuttl-tests/placement-db-sync-bmmdk" Mar 16 16:32:32 crc kubenswrapper[5120]: I0316 16:32:32.430073 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/46f918f9-8750-4631-9cf3-5f060522c045-logs\") pod \"placement-db-sync-bmmdk\" (UID: \"46f918f9-8750-4631-9cf3-5f060522c045\") " pod="openstack-kuttl-tests/placement-db-sync-bmmdk" Mar 16 16:32:32 crc kubenswrapper[5120]: I0316 16:32:32.433713 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/46f918f9-8750-4631-9cf3-5f060522c045-scripts\") pod \"placement-db-sync-bmmdk\" (UID: \"46f918f9-8750-4631-9cf3-5f060522c045\") " pod="openstack-kuttl-tests/placement-db-sync-bmmdk" Mar 16 16:32:32 crc kubenswrapper[5120]: I0316 16:32:32.434772 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/46f918f9-8750-4631-9cf3-5f060522c045-combined-ca-bundle\") pod \"placement-db-sync-bmmdk\" (UID: \"46f918f9-8750-4631-9cf3-5f060522c045\") " pod="openstack-kuttl-tests/placement-db-sync-bmmdk" Mar 16 16:32:32 crc kubenswrapper[5120]: I0316 16:32:32.435147 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/46f918f9-8750-4631-9cf3-5f060522c045-config-data\") pod \"placement-db-sync-bmmdk\" (UID: \"46f918f9-8750-4631-9cf3-5f060522c045\") " pod="openstack-kuttl-tests/placement-db-sync-bmmdk" Mar 16 16:32:32 crc kubenswrapper[5120]: I0316 16:32:32.449486 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5cnq\" (UniqueName: \"kubernetes.io/projected/46f918f9-8750-4631-9cf3-5f060522c045-kube-api-access-q5cnq\") pod \"placement-db-sync-bmmdk\" (UID: \"46f918f9-8750-4631-9cf3-5f060522c045\") " pod="openstack-kuttl-tests/placement-db-sync-bmmdk" Mar 16 16:32:32 crc kubenswrapper[5120]: I0316 16:32:32.512731 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:32:32 crc kubenswrapper[5120]: I0316 16:32:32.525503 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-g6hww" Mar 16 16:32:32 crc kubenswrapper[5120]: I0316 16:32:32.575482 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-bmmdk" Mar 16 16:32:32 crc kubenswrapper[5120]: I0316 16:32:32.666992 5120 scope.go:117] "RemoveContainer" containerID="0a15d5caff30dc8885f782e59962af7d98d58b39ab76059e56e5827e10e7ab8b" Mar 16 16:32:32 crc kubenswrapper[5120]: E0316 16:32:32.667448 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:32:32 crc kubenswrapper[5120]: I0316 16:32:32.706473 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-tvpzx"] Mar 16 16:32:32 crc kubenswrapper[5120]: I0316 16:32:32.791995 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-5fdqd"] Mar 16 16:32:32 crc kubenswrapper[5120]: I0316 16:32:32.913707 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:32:32 crc kubenswrapper[5120]: I0316 16:32:32.924217 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:32:32 crc kubenswrapper[5120]: I0316 16:32:32.925973 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-public-svc\"" Mar 16 16:32:32 crc kubenswrapper[5120]: I0316 16:32:32.927839 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-external-config-data\"" Mar 16 16:32:32 crc kubenswrapper[5120]: I0316 16:32:32.927992 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-glance-dockercfg-fnn75\"" Mar 16 16:32:32 crc kubenswrapper[5120]: I0316 16:32:32.928128 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-scripts\"" Mar 16 16:32:32 crc kubenswrapper[5120]: I0316 16:32:32.929059 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:32:32 crc kubenswrapper[5120]: I0316 16:32:32.993322 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:32:33 crc kubenswrapper[5120]: I0316 16:32:33.006648 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:32:33 crc kubenswrapper[5120]: I0316 16:32:33.006889 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:32:33 crc kubenswrapper[5120]: I0316 16:32:33.009631 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-internal-config-data\"" Mar 16 16:32:33 crc kubenswrapper[5120]: I0316 16:32:33.009898 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-internal-svc\"" Mar 16 16:32:33 crc kubenswrapper[5120]: I0316 16:32:33.045896 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0a8a20fa-c913-4637-b923-f7404113831d-config-data\") pod \"glance-default-external-api-0\" (UID: \"0a8a20fa-c913-4637-b923-f7404113831d\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:32:33 crc kubenswrapper[5120]: I0316 16:32:33.046257 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/0a8a20fa-c913-4637-b923-f7404113831d-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"0a8a20fa-c913-4637-b923-f7404113831d\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:32:33 crc kubenswrapper[5120]: I0316 16:32:33.046302 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rp7ws\" (UniqueName: \"kubernetes.io/projected/0a8a20fa-c913-4637-b923-f7404113831d-kube-api-access-rp7ws\") pod \"glance-default-external-api-0\" (UID: \"0a8a20fa-c913-4637-b923-f7404113831d\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:32:33 crc kubenswrapper[5120]: I0316 16:32:33.046649 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"glance-default-external-api-0\" (UID: \"0a8a20fa-c913-4637-b923-f7404113831d\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:32:33 crc kubenswrapper[5120]: I0316 16:32:33.046714 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0a8a20fa-c913-4637-b923-f7404113831d-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"0a8a20fa-c913-4637-b923-f7404113831d\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:32:33 crc kubenswrapper[5120]: I0316 16:32:33.046846 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/0a8a20fa-c913-4637-b923-f7404113831d-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"0a8a20fa-c913-4637-b923-f7404113831d\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:32:33 crc kubenswrapper[5120]: I0316 16:32:33.046936 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0a8a20fa-c913-4637-b923-f7404113831d-logs\") pod \"glance-default-external-api-0\" (UID: \"0a8a20fa-c913-4637-b923-f7404113831d\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:32:33 crc kubenswrapper[5120]: I0316 16:32:33.046996 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0a8a20fa-c913-4637-b923-f7404113831d-scripts\") pod \"glance-default-external-api-0\" (UID: \"0a8a20fa-c913-4637-b923-f7404113831d\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:32:33 crc kubenswrapper[5120]: I0316 16:32:33.062742 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:32:33 crc kubenswrapper[5120]: W0316 16:32:33.075901 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2aeaa955_5410_4726_9eb7_0b99cff87b61.slice/crio-79b73064f07cf7f2ed460b397a5db2dfd23414ecc9c585413770292b368c2883 WatchSource:0}: Error finding container 79b73064f07cf7f2ed460b397a5db2dfd23414ecc9c585413770292b368c2883: Status 404 returned error can't find the container with id 79b73064f07cf7f2ed460b397a5db2dfd23414ecc9c585413770292b368c2883 Mar 16 16:32:33 crc kubenswrapper[5120]: I0316 16:32:33.122839 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-g6hww"] Mar 16 16:32:33 crc kubenswrapper[5120]: I0316 16:32:33.132371 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-bmmdk"] Mar 16 16:32:33 crc kubenswrapper[5120]: I0316 16:32:33.151915 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage19-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") pod \"glance-default-internal-api-0\" (UID: \"582ba829-6c97-4e79-8b3a-5ce51c47d9d2\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:32:33 crc kubenswrapper[5120]: I0316 16:32:33.151996 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/582ba829-6c97-4e79-8b3a-5ce51c47d9d2-scripts\") pod \"glance-default-internal-api-0\" (UID: \"582ba829-6c97-4e79-8b3a-5ce51c47d9d2\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:32:33 crc kubenswrapper[5120]: I0316 16:32:33.152061 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/582ba829-6c97-4e79-8b3a-5ce51c47d9d2-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"582ba829-6c97-4e79-8b3a-5ce51c47d9d2\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:32:33 crc kubenswrapper[5120]: I0316 16:32:33.152085 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0a8a20fa-c913-4637-b923-f7404113831d-config-data\") pod \"glance-default-external-api-0\" (UID: \"0a8a20fa-c913-4637-b923-f7404113831d\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:32:33 crc kubenswrapper[5120]: I0316 16:32:33.152140 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/0a8a20fa-c913-4637-b923-f7404113831d-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"0a8a20fa-c913-4637-b923-f7404113831d\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:32:33 crc kubenswrapper[5120]: I0316 16:32:33.152159 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rp7ws\" (UniqueName: \"kubernetes.io/projected/0a8a20fa-c913-4637-b923-f7404113831d-kube-api-access-rp7ws\") pod \"glance-default-external-api-0\" (UID: \"0a8a20fa-c913-4637-b923-f7404113831d\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:32:33 crc kubenswrapper[5120]: I0316 16:32:33.152249 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/582ba829-6c97-4e79-8b3a-5ce51c47d9d2-logs\") pod \"glance-default-internal-api-0\" (UID: \"582ba829-6c97-4e79-8b3a-5ce51c47d9d2\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:32:33 crc kubenswrapper[5120]: I0316 16:32:33.152300 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/582ba829-6c97-4e79-8b3a-5ce51c47d9d2-config-data\") pod \"glance-default-internal-api-0\" (UID: \"582ba829-6c97-4e79-8b3a-5ce51c47d9d2\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:32:33 crc kubenswrapper[5120]: I0316 16:32:33.152383 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"glance-default-external-api-0\" (UID: \"0a8a20fa-c913-4637-b923-f7404113831d\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:32:33 crc kubenswrapper[5120]: I0316 16:32:33.153236 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"glance-default-external-api-0\" (UID: \"0a8a20fa-c913-4637-b923-f7404113831d\") device mount path \"/mnt/openstack/pv01\"" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:32:33 crc kubenswrapper[5120]: I0316 16:32:33.153522 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0a8a20fa-c913-4637-b923-f7404113831d-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"0a8a20fa-c913-4637-b923-f7404113831d\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:32:33 crc kubenswrapper[5120]: I0316 16:32:33.154980 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4l7j7\" (UniqueName: \"kubernetes.io/projected/582ba829-6c97-4e79-8b3a-5ce51c47d9d2-kube-api-access-4l7j7\") pod \"glance-default-internal-api-0\" (UID: \"582ba829-6c97-4e79-8b3a-5ce51c47d9d2\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:32:33 crc kubenswrapper[5120]: I0316 16:32:33.155020 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/582ba829-6c97-4e79-8b3a-5ce51c47d9d2-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"582ba829-6c97-4e79-8b3a-5ce51c47d9d2\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:32:33 crc kubenswrapper[5120]: I0316 16:32:33.155556 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/0a8a20fa-c913-4637-b923-f7404113831d-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"0a8a20fa-c913-4637-b923-f7404113831d\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:32:33 crc kubenswrapper[5120]: I0316 16:32:33.155658 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/582ba829-6c97-4e79-8b3a-5ce51c47d9d2-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"582ba829-6c97-4e79-8b3a-5ce51c47d9d2\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:32:33 crc kubenswrapper[5120]: I0316 16:32:33.155854 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0a8a20fa-c913-4637-b923-f7404113831d-logs\") pod \"glance-default-external-api-0\" (UID: \"0a8a20fa-c913-4637-b923-f7404113831d\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:32:33 crc kubenswrapper[5120]: I0316 16:32:33.155985 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0a8a20fa-c913-4637-b923-f7404113831d-scripts\") pod \"glance-default-external-api-0\" (UID: \"0a8a20fa-c913-4637-b923-f7404113831d\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:32:33 crc kubenswrapper[5120]: I0316 16:32:33.156308 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/0a8a20fa-c913-4637-b923-f7404113831d-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"0a8a20fa-c913-4637-b923-f7404113831d\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:32:33 crc kubenswrapper[5120]: I0316 16:32:33.156684 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0a8a20fa-c913-4637-b923-f7404113831d-logs\") pod \"glance-default-external-api-0\" (UID: \"0a8a20fa-c913-4637-b923-f7404113831d\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:32:33 crc kubenswrapper[5120]: I0316 16:32:33.160586 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/0a8a20fa-c913-4637-b923-f7404113831d-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"0a8a20fa-c913-4637-b923-f7404113831d\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:32:33 crc kubenswrapper[5120]: I0316 16:32:33.161956 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0a8a20fa-c913-4637-b923-f7404113831d-scripts\") pod \"glance-default-external-api-0\" (UID: \"0a8a20fa-c913-4637-b923-f7404113831d\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:32:33 crc kubenswrapper[5120]: I0316 16:32:33.163234 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0a8a20fa-c913-4637-b923-f7404113831d-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"0a8a20fa-c913-4637-b923-f7404113831d\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:32:33 crc kubenswrapper[5120]: I0316 16:32:33.166914 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0a8a20fa-c913-4637-b923-f7404113831d-config-data\") pod \"glance-default-external-api-0\" (UID: \"0a8a20fa-c913-4637-b923-f7404113831d\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:32:33 crc kubenswrapper[5120]: I0316 16:32:33.173563 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rp7ws\" (UniqueName: \"kubernetes.io/projected/0a8a20fa-c913-4637-b923-f7404113831d-kube-api-access-rp7ws\") pod \"glance-default-external-api-0\" (UID: \"0a8a20fa-c913-4637-b923-f7404113831d\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:32:33 crc kubenswrapper[5120]: I0316 16:32:33.191126 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"glance-default-external-api-0\" (UID: \"0a8a20fa-c913-4637-b923-f7404113831d\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:32:33 crc kubenswrapper[5120]: I0316 16:32:33.267329 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/582ba829-6c97-4e79-8b3a-5ce51c47d9d2-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"582ba829-6c97-4e79-8b3a-5ce51c47d9d2\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:32:33 crc kubenswrapper[5120]: I0316 16:32:33.267631 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage19-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") pod \"glance-default-internal-api-0\" (UID: \"582ba829-6c97-4e79-8b3a-5ce51c47d9d2\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:32:33 crc kubenswrapper[5120]: I0316 16:32:33.267742 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/582ba829-6c97-4e79-8b3a-5ce51c47d9d2-scripts\") pod \"glance-default-internal-api-0\" (UID: \"582ba829-6c97-4e79-8b3a-5ce51c47d9d2\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:32:33 crc kubenswrapper[5120]: I0316 16:32:33.267859 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/582ba829-6c97-4e79-8b3a-5ce51c47d9d2-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"582ba829-6c97-4e79-8b3a-5ce51c47d9d2\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:32:33 crc kubenswrapper[5120]: I0316 16:32:33.268088 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/582ba829-6c97-4e79-8b3a-5ce51c47d9d2-logs\") pod \"glance-default-internal-api-0\" (UID: \"582ba829-6c97-4e79-8b3a-5ce51c47d9d2\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:32:33 crc kubenswrapper[5120]: I0316 16:32:33.268677 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/582ba829-6c97-4e79-8b3a-5ce51c47d9d2-config-data\") pod \"glance-default-internal-api-0\" (UID: \"582ba829-6c97-4e79-8b3a-5ce51c47d9d2\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:32:33 crc kubenswrapper[5120]: I0316 16:32:33.269018 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4l7j7\" (UniqueName: \"kubernetes.io/projected/582ba829-6c97-4e79-8b3a-5ce51c47d9d2-kube-api-access-4l7j7\") pod \"glance-default-internal-api-0\" (UID: \"582ba829-6c97-4e79-8b3a-5ce51c47d9d2\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:32:33 crc kubenswrapper[5120]: I0316 16:32:33.269063 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/582ba829-6c97-4e79-8b3a-5ce51c47d9d2-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"582ba829-6c97-4e79-8b3a-5ce51c47d9d2\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:32:33 crc kubenswrapper[5120]: I0316 16:32:33.269566 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/582ba829-6c97-4e79-8b3a-5ce51c47d9d2-logs\") pod \"glance-default-internal-api-0\" (UID: \"582ba829-6c97-4e79-8b3a-5ce51c47d9d2\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:32:33 crc kubenswrapper[5120]: I0316 16:32:33.270962 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage19-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") pod \"glance-default-internal-api-0\" (UID: \"582ba829-6c97-4e79-8b3a-5ce51c47d9d2\") device mount path \"/mnt/openstack/pv19\"" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:32:33 crc kubenswrapper[5120]: I0316 16:32:33.275909 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/582ba829-6c97-4e79-8b3a-5ce51c47d9d2-config-data\") pod \"glance-default-internal-api-0\" (UID: \"582ba829-6c97-4e79-8b3a-5ce51c47d9d2\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:32:33 crc kubenswrapper[5120]: I0316 16:32:33.276383 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/582ba829-6c97-4e79-8b3a-5ce51c47d9d2-scripts\") pod \"glance-default-internal-api-0\" (UID: \"582ba829-6c97-4e79-8b3a-5ce51c47d9d2\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:32:33 crc kubenswrapper[5120]: I0316 16:32:33.278022 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:32:33 crc kubenswrapper[5120]: I0316 16:32:33.278474 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/582ba829-6c97-4e79-8b3a-5ce51c47d9d2-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"582ba829-6c97-4e79-8b3a-5ce51c47d9d2\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:32:33 crc kubenswrapper[5120]: I0316 16:32:33.278638 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/582ba829-6c97-4e79-8b3a-5ce51c47d9d2-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"582ba829-6c97-4e79-8b3a-5ce51c47d9d2\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:32:33 crc kubenswrapper[5120]: I0316 16:32:33.282139 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/582ba829-6c97-4e79-8b3a-5ce51c47d9d2-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"582ba829-6c97-4e79-8b3a-5ce51c47d9d2\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:32:33 crc kubenswrapper[5120]: I0316 16:32:33.303490 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4l7j7\" (UniqueName: \"kubernetes.io/projected/582ba829-6c97-4e79-8b3a-5ce51c47d9d2-kube-api-access-4l7j7\") pod \"glance-default-internal-api-0\" (UID: \"582ba829-6c97-4e79-8b3a-5ce51c47d9d2\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:32:33 crc kubenswrapper[5120]: I0316 16:32:33.325343 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage19-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") pod \"glance-default-internal-api-0\" (UID: \"582ba829-6c97-4e79-8b3a-5ce51c47d9d2\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:32:33 crc kubenswrapper[5120]: I0316 16:32:33.555288 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:32:33 crc kubenswrapper[5120]: I0316 16:32:33.691498 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-tvpzx" event={"ID":"408af245-438e-482c-ab14-fb2b7b947f8c","Type":"ContainerStarted","Data":"1669972057cc8dbbfa6dc0e00026f2df8e5c1f76fed58fb6972e3087284a4a2d"} Mar 16 16:32:33 crc kubenswrapper[5120]: I0316 16:32:33.691551 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-tvpzx" event={"ID":"408af245-438e-482c-ab14-fb2b7b947f8c","Type":"ContainerStarted","Data":"305f6fc3dbe6e062a425ebbcf3644469f5f83a37fb9b4fcf46ffbbebdee39e66"} Mar 16 16:32:33 crc kubenswrapper[5120]: I0316 16:32:33.697673 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"2aeaa955-5410-4726-9eb7-0b99cff87b61","Type":"ContainerStarted","Data":"79b73064f07cf7f2ed460b397a5db2dfd23414ecc9c585413770292b368c2883"} Mar 16 16:32:33 crc kubenswrapper[5120]: I0316 16:32:33.714049 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-bmmdk" event={"ID":"46f918f9-8750-4631-9cf3-5f060522c045","Type":"ContainerStarted","Data":"26030c8756e65169fb649caea1f3b28f100ef19f6ffef14b023b74d2c5089d06"} Mar 16 16:32:33 crc kubenswrapper[5120]: I0316 16:32:33.714097 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-bmmdk" event={"ID":"46f918f9-8750-4631-9cf3-5f060522c045","Type":"ContainerStarted","Data":"5b15aa6acff48f339b0d0fc01ae9e29dffab2d12d4ef0def53fc802c33fd8ba6"} Mar 16 16:32:33 crc kubenswrapper[5120]: I0316 16:32:33.735728 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-g6hww" event={"ID":"5c5ca400-22f5-457a-987f-0efd2139f18e","Type":"ContainerStarted","Data":"1ef00ba08ecceb8b41ac0c3ea5c6198a46e197013b171930c1ab10d5b8fac58a"} Mar 16 16:32:33 crc kubenswrapper[5120]: I0316 16:32:33.736064 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-g6hww" event={"ID":"5c5ca400-22f5-457a-987f-0efd2139f18e","Type":"ContainerStarted","Data":"8ac6474a6f96e76e7d559abeed6412836b47671e21271dd9ee35d07dad47b2da"} Mar 16 16:32:33 crc kubenswrapper[5120]: I0316 16:32:33.739627 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-bootstrap-tvpzx" podStartSLOduration=2.739614155 podStartE2EDuration="2.739614155s" podCreationTimestamp="2026-03-16 16:32:31 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:32:33.734966464 +0000 UTC m=+3655.888898121" watchObservedRunningTime="2026-03-16 16:32:33.739614155 +0000 UTC m=+3655.893545812" Mar 16 16:32:33 crc kubenswrapper[5120]: I0316 16:32:33.747148 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-5fdqd" event={"ID":"f21b59e7-258d-40b6-ac7f-14f44058aa3b","Type":"ContainerStarted","Data":"bfca222d6c127657152658f3163ef82ecc2200c0fdde2c09266bace0dc55823e"} Mar 16 16:32:33 crc kubenswrapper[5120]: I0316 16:32:33.776331 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-db-sync-bmmdk" podStartSLOduration=1.776311336 podStartE2EDuration="1.776311336s" podCreationTimestamp="2026-03-16 16:32:32 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:32:33.758236913 +0000 UTC m=+3655.912168560" watchObservedRunningTime="2026-03-16 16:32:33.776311336 +0000 UTC m=+3655.930242993" Mar 16 16:32:33 crc kubenswrapper[5120]: I0316 16:32:33.792373 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-db-sync-g6hww" podStartSLOduration=1.7923532450000002 podStartE2EDuration="1.792353245s" podCreationTimestamp="2026-03-16 16:32:32 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:32:33.787268262 +0000 UTC m=+3655.941199919" watchObservedRunningTime="2026-03-16 16:32:33.792353245 +0000 UTC m=+3655.946284902" Mar 16 16:32:33 crc kubenswrapper[5120]: I0316 16:32:33.838162 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:32:34 crc kubenswrapper[5120]: I0316 16:32:34.261269 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:32:34 crc kubenswrapper[5120]: I0316 16:32:34.283948 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:32:34 crc kubenswrapper[5120]: I0316 16:32:34.358800 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:32:34 crc kubenswrapper[5120]: I0316 16:32:34.407802 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:32:34 crc kubenswrapper[5120]: I0316 16:32:34.441210 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-bp5pw"] Mar 16 16:32:34 crc kubenswrapper[5120]: I0316 16:32:34.474202 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-bp5pw"] Mar 16 16:32:34 crc kubenswrapper[5120]: I0316 16:32:34.474368 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-bp5pw" Mar 16 16:32:34 crc kubenswrapper[5120]: I0316 16:32:34.477603 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-httpd-config\"" Mar 16 16:32:34 crc kubenswrapper[5120]: I0316 16:32:34.478048 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-config\"" Mar 16 16:32:34 crc kubenswrapper[5120]: I0316 16:32:34.479150 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-neutron-dockercfg-lj228\"" Mar 16 16:32:34 crc kubenswrapper[5120]: I0316 16:32:34.507704 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/75b3e230-9ea5-42dd-8274-44d38ed2bb4c-combined-ca-bundle\") pod \"neutron-db-sync-bp5pw\" (UID: \"75b3e230-9ea5-42dd-8274-44d38ed2bb4c\") " pod="openstack-kuttl-tests/neutron-db-sync-bp5pw" Mar 16 16:32:34 crc kubenswrapper[5120]: I0316 16:32:34.507797 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/75b3e230-9ea5-42dd-8274-44d38ed2bb4c-config\") pod \"neutron-db-sync-bp5pw\" (UID: \"75b3e230-9ea5-42dd-8274-44d38ed2bb4c\") " pod="openstack-kuttl-tests/neutron-db-sync-bp5pw" Mar 16 16:32:34 crc kubenswrapper[5120]: I0316 16:32:34.507893 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhw8z\" (UniqueName: \"kubernetes.io/projected/75b3e230-9ea5-42dd-8274-44d38ed2bb4c-kube-api-access-rhw8z\") pod \"neutron-db-sync-bp5pw\" (UID: \"75b3e230-9ea5-42dd-8274-44d38ed2bb4c\") " pod="openstack-kuttl-tests/neutron-db-sync-bp5pw" Mar 16 16:32:34 crc kubenswrapper[5120]: I0316 16:32:34.610185 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/75b3e230-9ea5-42dd-8274-44d38ed2bb4c-combined-ca-bundle\") pod \"neutron-db-sync-bp5pw\" (UID: \"75b3e230-9ea5-42dd-8274-44d38ed2bb4c\") " pod="openstack-kuttl-tests/neutron-db-sync-bp5pw" Mar 16 16:32:34 crc kubenswrapper[5120]: I0316 16:32:34.610288 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/75b3e230-9ea5-42dd-8274-44d38ed2bb4c-config\") pod \"neutron-db-sync-bp5pw\" (UID: \"75b3e230-9ea5-42dd-8274-44d38ed2bb4c\") " pod="openstack-kuttl-tests/neutron-db-sync-bp5pw" Mar 16 16:32:34 crc kubenswrapper[5120]: I0316 16:32:34.610400 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rhw8z\" (UniqueName: \"kubernetes.io/projected/75b3e230-9ea5-42dd-8274-44d38ed2bb4c-kube-api-access-rhw8z\") pod \"neutron-db-sync-bp5pw\" (UID: \"75b3e230-9ea5-42dd-8274-44d38ed2bb4c\") " pod="openstack-kuttl-tests/neutron-db-sync-bp5pw" Mar 16 16:32:34 crc kubenswrapper[5120]: I0316 16:32:34.643818 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhw8z\" (UniqueName: \"kubernetes.io/projected/75b3e230-9ea5-42dd-8274-44d38ed2bb4c-kube-api-access-rhw8z\") pod \"neutron-db-sync-bp5pw\" (UID: \"75b3e230-9ea5-42dd-8274-44d38ed2bb4c\") " pod="openstack-kuttl-tests/neutron-db-sync-bp5pw" Mar 16 16:32:34 crc kubenswrapper[5120]: I0316 16:32:34.689013 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/75b3e230-9ea5-42dd-8274-44d38ed2bb4c-combined-ca-bundle\") pod \"neutron-db-sync-bp5pw\" (UID: \"75b3e230-9ea5-42dd-8274-44d38ed2bb4c\") " pod="openstack-kuttl-tests/neutron-db-sync-bp5pw" Mar 16 16:32:34 crc kubenswrapper[5120]: I0316 16:32:34.691203 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/75b3e230-9ea5-42dd-8274-44d38ed2bb4c-config\") pod \"neutron-db-sync-bp5pw\" (UID: \"75b3e230-9ea5-42dd-8274-44d38ed2bb4c\") " pod="openstack-kuttl-tests/neutron-db-sync-bp5pw" Mar 16 16:32:34 crc kubenswrapper[5120]: I0316 16:32:34.785879 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"0a8a20fa-c913-4637-b923-f7404113831d","Type":"ContainerStarted","Data":"5bc681f9ba2a14024e5b0cacb278f9e3b1383f0a09c4b619e94c16c4472320ce"} Mar 16 16:32:34 crc kubenswrapper[5120]: I0316 16:32:34.791320 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"582ba829-6c97-4e79-8b3a-5ce51c47d9d2","Type":"ContainerStarted","Data":"8c6880c54334a6967957d2d9136c7de7999293479aa8c1c1a112cdec9eb75fe6"} Mar 16 16:32:34 crc kubenswrapper[5120]: I0316 16:32:34.802654 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"2aeaa955-5410-4726-9eb7-0b99cff87b61","Type":"ContainerStarted","Data":"c50fe560a0d30b1510a93acbf5114422de874b8bd5d471e63de4d2b192ed81b5"} Mar 16 16:32:34 crc kubenswrapper[5120]: I0316 16:32:34.859792 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-bp5pw" Mar 16 16:32:35 crc kubenswrapper[5120]: I0316 16:32:35.401457 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-bp5pw"] Mar 16 16:32:35 crc kubenswrapper[5120]: I0316 16:32:35.816175 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"582ba829-6c97-4e79-8b3a-5ce51c47d9d2","Type":"ContainerStarted","Data":"a8e6da9753fca24be9b74d48f1986eae13406f9de64f517059c1ce66f7619fd0"} Mar 16 16:32:35 crc kubenswrapper[5120]: I0316 16:32:35.819496 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"2aeaa955-5410-4726-9eb7-0b99cff87b61","Type":"ContainerStarted","Data":"ee5e8b2d7871e01f8a103964f89004f68a4cde75548df0a719ce99d0c2647aac"} Mar 16 16:32:35 crc kubenswrapper[5120]: I0316 16:32:35.825772 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-bp5pw" event={"ID":"75b3e230-9ea5-42dd-8274-44d38ed2bb4c","Type":"ContainerStarted","Data":"dcf9fa8b1116cc44c55ea4dea19a89a3dc344ff083773e2ae76a8f51807827f7"} Mar 16 16:32:35 crc kubenswrapper[5120]: I0316 16:32:35.825824 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-bp5pw" event={"ID":"75b3e230-9ea5-42dd-8274-44d38ed2bb4c","Type":"ContainerStarted","Data":"50ebb00c95687988a835773f65cea2103bbe1e25a0ded782ac6cd99c10041851"} Mar 16 16:32:35 crc kubenswrapper[5120]: I0316 16:32:35.828469 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"0a8a20fa-c913-4637-b923-f7404113831d","Type":"ContainerStarted","Data":"fef5654cd48df1fd5bb3f83f7bf117d8db26e32f9a99b34bfe7caefcc55d3dff"} Mar 16 16:32:35 crc kubenswrapper[5120]: I0316 16:32:35.848010 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-db-sync-bp5pw" podStartSLOduration=1.84799375 podStartE2EDuration="1.84799375s" podCreationTimestamp="2026-03-16 16:32:34 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:32:35.841626894 +0000 UTC m=+3657.995558551" watchObservedRunningTime="2026-03-16 16:32:35.84799375 +0000 UTC m=+3658.001925407" Mar 16 16:32:36 crc kubenswrapper[5120]: I0316 16:32:36.841172 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"582ba829-6c97-4e79-8b3a-5ce51c47d9d2","Type":"ContainerStarted","Data":"f4621f3723b064d8fdf442494b59f080148b7e5040753bffd4282104787197ca"} Mar 16 16:32:36 crc kubenswrapper[5120]: I0316 16:32:36.841539 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="582ba829-6c97-4e79-8b3a-5ce51c47d9d2" containerName="glance-log" containerID="cri-o://a8e6da9753fca24be9b74d48f1986eae13406f9de64f517059c1ce66f7619fd0" gracePeriod=30 Mar 16 16:32:36 crc kubenswrapper[5120]: I0316 16:32:36.841676 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="582ba829-6c97-4e79-8b3a-5ce51c47d9d2" containerName="glance-httpd" containerID="cri-o://f4621f3723b064d8fdf442494b59f080148b7e5040753bffd4282104787197ca" gracePeriod=30 Mar 16 16:32:36 crc kubenswrapper[5120]: I0316 16:32:36.855340 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"2aeaa955-5410-4726-9eb7-0b99cff87b61","Type":"ContainerStarted","Data":"43a0cc1070f7fa54cf27a958a9d3094b0db1608bdebb7bb1e46d5a316f148013"} Mar 16 16:32:36 crc kubenswrapper[5120]: I0316 16:32:36.858412 5120 generic.go:358] "Generic (PLEG): container finished" podID="46f918f9-8750-4631-9cf3-5f060522c045" containerID="26030c8756e65169fb649caea1f3b28f100ef19f6ffef14b023b74d2c5089d06" exitCode=0 Mar 16 16:32:36 crc kubenswrapper[5120]: I0316 16:32:36.858691 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-bmmdk" event={"ID":"46f918f9-8750-4631-9cf3-5f060522c045","Type":"ContainerDied","Data":"26030c8756e65169fb649caea1f3b28f100ef19f6ffef14b023b74d2c5089d06"} Mar 16 16:32:36 crc kubenswrapper[5120]: I0316 16:32:36.870525 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-5fdqd" event={"ID":"f21b59e7-258d-40b6-ac7f-14f44058aa3b","Type":"ContainerStarted","Data":"cf0ade454712d54bbd6566c19455cca6ef17295f8323872af8aec43cc9f70c86"} Mar 16 16:32:36 crc kubenswrapper[5120]: I0316 16:32:36.873414 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-internal-api-0" podStartSLOduration=5.87339692 podStartE2EDuration="5.87339692s" podCreationTimestamp="2026-03-16 16:32:31 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:32:36.871834468 +0000 UTC m=+3659.025766115" watchObservedRunningTime="2026-03-16 16:32:36.87339692 +0000 UTC m=+3659.027328577" Mar 16 16:32:36 crc kubenswrapper[5120]: I0316 16:32:36.883319 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="0a8a20fa-c913-4637-b923-f7404113831d" containerName="glance-log" containerID="cri-o://fef5654cd48df1fd5bb3f83f7bf117d8db26e32f9a99b34bfe7caefcc55d3dff" gracePeriod=30 Mar 16 16:32:36 crc kubenswrapper[5120]: I0316 16:32:36.883661 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"0a8a20fa-c913-4637-b923-f7404113831d","Type":"ContainerStarted","Data":"448e7a90607ac4296d53eac2a98e8c11d6b172efe9c43ff388edf2066419d210"} Mar 16 16:32:36 crc kubenswrapper[5120]: I0316 16:32:36.883743 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="0a8a20fa-c913-4637-b923-f7404113831d" containerName="glance-httpd" containerID="cri-o://448e7a90607ac4296d53eac2a98e8c11d6b172efe9c43ff388edf2066419d210" gracePeriod=30 Mar 16 16:32:36 crc kubenswrapper[5120]: I0316 16:32:36.901751 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-db-sync-5fdqd" podStartSLOduration=5.9017319409999995 podStartE2EDuration="5.901731941s" podCreationTimestamp="2026-03-16 16:32:31 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:32:36.895474647 +0000 UTC m=+3659.049406294" watchObservedRunningTime="2026-03-16 16:32:36.901731941 +0000 UTC m=+3659.055663598" Mar 16 16:32:36 crc kubenswrapper[5120]: I0316 16:32:36.946476 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-external-api-0" podStartSLOduration=5.946451241 podStartE2EDuration="5.946451241s" podCreationTimestamp="2026-03-16 16:32:31 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:32:36.937708551 +0000 UTC m=+3659.091640218" watchObservedRunningTime="2026-03-16 16:32:36.946451241 +0000 UTC m=+3659.100382898" Mar 16 16:32:37 crc kubenswrapper[5120]: I0316 16:32:37.724450 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:32:37 crc kubenswrapper[5120]: I0316 16:32:37.783900 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:32:37 crc kubenswrapper[5120]: I0316 16:32:37.818367 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/582ba829-6c97-4e79-8b3a-5ce51c47d9d2-scripts\") pod \"582ba829-6c97-4e79-8b3a-5ce51c47d9d2\" (UID: \"582ba829-6c97-4e79-8b3a-5ce51c47d9d2\") " Mar 16 16:32:37 crc kubenswrapper[5120]: I0316 16:32:37.818421 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/582ba829-6c97-4e79-8b3a-5ce51c47d9d2-internal-tls-certs\") pod \"582ba829-6c97-4e79-8b3a-5ce51c47d9d2\" (UID: \"582ba829-6c97-4e79-8b3a-5ce51c47d9d2\") " Mar 16 16:32:37 crc kubenswrapper[5120]: I0316 16:32:37.818471 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4l7j7\" (UniqueName: \"kubernetes.io/projected/582ba829-6c97-4e79-8b3a-5ce51c47d9d2-kube-api-access-4l7j7\") pod \"582ba829-6c97-4e79-8b3a-5ce51c47d9d2\" (UID: \"582ba829-6c97-4e79-8b3a-5ce51c47d9d2\") " Mar 16 16:32:37 crc kubenswrapper[5120]: I0316 16:32:37.818561 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/582ba829-6c97-4e79-8b3a-5ce51c47d9d2-logs\") pod \"582ba829-6c97-4e79-8b3a-5ce51c47d9d2\" (UID: \"582ba829-6c97-4e79-8b3a-5ce51c47d9d2\") " Mar 16 16:32:37 crc kubenswrapper[5120]: I0316 16:32:37.818592 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/582ba829-6c97-4e79-8b3a-5ce51c47d9d2-httpd-run\") pod \"582ba829-6c97-4e79-8b3a-5ce51c47d9d2\" (UID: \"582ba829-6c97-4e79-8b3a-5ce51c47d9d2\") " Mar 16 16:32:37 crc kubenswrapper[5120]: I0316 16:32:37.818615 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") pod \"582ba829-6c97-4e79-8b3a-5ce51c47d9d2\" (UID: \"582ba829-6c97-4e79-8b3a-5ce51c47d9d2\") " Mar 16 16:32:37 crc kubenswrapper[5120]: I0316 16:32:37.819212 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/582ba829-6c97-4e79-8b3a-5ce51c47d9d2-logs" (OuterVolumeSpecName: "logs") pod "582ba829-6c97-4e79-8b3a-5ce51c47d9d2" (UID: "582ba829-6c97-4e79-8b3a-5ce51c47d9d2"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:32:37 crc kubenswrapper[5120]: I0316 16:32:37.819229 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/582ba829-6c97-4e79-8b3a-5ce51c47d9d2-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "582ba829-6c97-4e79-8b3a-5ce51c47d9d2" (UID: "582ba829-6c97-4e79-8b3a-5ce51c47d9d2"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:32:37 crc kubenswrapper[5120]: I0316 16:32:37.818865 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/582ba829-6c97-4e79-8b3a-5ce51c47d9d2-combined-ca-bundle\") pod \"582ba829-6c97-4e79-8b3a-5ce51c47d9d2\" (UID: \"582ba829-6c97-4e79-8b3a-5ce51c47d9d2\") " Mar 16 16:32:37 crc kubenswrapper[5120]: I0316 16:32:37.819609 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/582ba829-6c97-4e79-8b3a-5ce51c47d9d2-config-data\") pod \"582ba829-6c97-4e79-8b3a-5ce51c47d9d2\" (UID: \"582ba829-6c97-4e79-8b3a-5ce51c47d9d2\") " Mar 16 16:32:37 crc kubenswrapper[5120]: I0316 16:32:37.820336 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/582ba829-6c97-4e79-8b3a-5ce51c47d9d2-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:32:37 crc kubenswrapper[5120]: I0316 16:32:37.820353 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/582ba829-6c97-4e79-8b3a-5ce51c47d9d2-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 16:32:37 crc kubenswrapper[5120]: I0316 16:32:37.827959 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/582ba829-6c97-4e79-8b3a-5ce51c47d9d2-kube-api-access-4l7j7" (OuterVolumeSpecName: "kube-api-access-4l7j7") pod "582ba829-6c97-4e79-8b3a-5ce51c47d9d2" (UID: "582ba829-6c97-4e79-8b3a-5ce51c47d9d2"). InnerVolumeSpecName "kube-api-access-4l7j7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:32:37 crc kubenswrapper[5120]: I0316 16:32:37.828974 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage19-crc" (OuterVolumeSpecName: "glance") pod "582ba829-6c97-4e79-8b3a-5ce51c47d9d2" (UID: "582ba829-6c97-4e79-8b3a-5ce51c47d9d2"). InnerVolumeSpecName "local-storage19-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:32:37 crc kubenswrapper[5120]: I0316 16:32:37.834940 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/582ba829-6c97-4e79-8b3a-5ce51c47d9d2-scripts" (OuterVolumeSpecName: "scripts") pod "582ba829-6c97-4e79-8b3a-5ce51c47d9d2" (UID: "582ba829-6c97-4e79-8b3a-5ce51c47d9d2"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:32:37 crc kubenswrapper[5120]: I0316 16:32:37.882311 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/582ba829-6c97-4e79-8b3a-5ce51c47d9d2-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "582ba829-6c97-4e79-8b3a-5ce51c47d9d2" (UID: "582ba829-6c97-4e79-8b3a-5ce51c47d9d2"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:32:37 crc kubenswrapper[5120]: I0316 16:32:37.886705 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/582ba829-6c97-4e79-8b3a-5ce51c47d9d2-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "582ba829-6c97-4e79-8b3a-5ce51c47d9d2" (UID: "582ba829-6c97-4e79-8b3a-5ce51c47d9d2"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:32:37 crc kubenswrapper[5120]: I0316 16:32:37.890801 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/582ba829-6c97-4e79-8b3a-5ce51c47d9d2-config-data" (OuterVolumeSpecName: "config-data") pod "582ba829-6c97-4e79-8b3a-5ce51c47d9d2" (UID: "582ba829-6c97-4e79-8b3a-5ce51c47d9d2"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:32:37 crc kubenswrapper[5120]: I0316 16:32:37.895292 5120 generic.go:358] "Generic (PLEG): container finished" podID="0a8a20fa-c913-4637-b923-f7404113831d" containerID="448e7a90607ac4296d53eac2a98e8c11d6b172efe9c43ff388edf2066419d210" exitCode=0 Mar 16 16:32:37 crc kubenswrapper[5120]: I0316 16:32:37.895322 5120 generic.go:358] "Generic (PLEG): container finished" podID="0a8a20fa-c913-4637-b923-f7404113831d" containerID="fef5654cd48df1fd5bb3f83f7bf117d8db26e32f9a99b34bfe7caefcc55d3dff" exitCode=143 Mar 16 16:32:37 crc kubenswrapper[5120]: I0316 16:32:37.895410 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"0a8a20fa-c913-4637-b923-f7404113831d","Type":"ContainerDied","Data":"448e7a90607ac4296d53eac2a98e8c11d6b172efe9c43ff388edf2066419d210"} Mar 16 16:32:37 crc kubenswrapper[5120]: I0316 16:32:37.895441 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"0a8a20fa-c913-4637-b923-f7404113831d","Type":"ContainerDied","Data":"fef5654cd48df1fd5bb3f83f7bf117d8db26e32f9a99b34bfe7caefcc55d3dff"} Mar 16 16:32:37 crc kubenswrapper[5120]: I0316 16:32:37.895458 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"0a8a20fa-c913-4637-b923-f7404113831d","Type":"ContainerDied","Data":"5bc681f9ba2a14024e5b0cacb278f9e3b1383f0a09c4b619e94c16c4472320ce"} Mar 16 16:32:37 crc kubenswrapper[5120]: I0316 16:32:37.895475 5120 scope.go:117] "RemoveContainer" containerID="448e7a90607ac4296d53eac2a98e8c11d6b172efe9c43ff388edf2066419d210" Mar 16 16:32:37 crc kubenswrapper[5120]: I0316 16:32:37.895642 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:32:37 crc kubenswrapper[5120]: I0316 16:32:37.900151 5120 generic.go:358] "Generic (PLEG): container finished" podID="582ba829-6c97-4e79-8b3a-5ce51c47d9d2" containerID="f4621f3723b064d8fdf442494b59f080148b7e5040753bffd4282104787197ca" exitCode=0 Mar 16 16:32:37 crc kubenswrapper[5120]: I0316 16:32:37.900185 5120 generic.go:358] "Generic (PLEG): container finished" podID="582ba829-6c97-4e79-8b3a-5ce51c47d9d2" containerID="a8e6da9753fca24be9b74d48f1986eae13406f9de64f517059c1ce66f7619fd0" exitCode=143 Mar 16 16:32:37 crc kubenswrapper[5120]: I0316 16:32:37.900354 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"582ba829-6c97-4e79-8b3a-5ce51c47d9d2","Type":"ContainerDied","Data":"f4621f3723b064d8fdf442494b59f080148b7e5040753bffd4282104787197ca"} Mar 16 16:32:37 crc kubenswrapper[5120]: I0316 16:32:37.900387 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"582ba829-6c97-4e79-8b3a-5ce51c47d9d2","Type":"ContainerDied","Data":"a8e6da9753fca24be9b74d48f1986eae13406f9de64f517059c1ce66f7619fd0"} Mar 16 16:32:37 crc kubenswrapper[5120]: I0316 16:32:37.900402 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"582ba829-6c97-4e79-8b3a-5ce51c47d9d2","Type":"ContainerDied","Data":"8c6880c54334a6967957d2d9136c7de7999293479aa8c1c1a112cdec9eb75fe6"} Mar 16 16:32:37 crc kubenswrapper[5120]: I0316 16:32:37.900488 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:32:37 crc kubenswrapper[5120]: I0316 16:32:37.906048 5120 generic.go:358] "Generic (PLEG): container finished" podID="408af245-438e-482c-ab14-fb2b7b947f8c" containerID="1669972057cc8dbbfa6dc0e00026f2df8e5c1f76fed58fb6972e3087284a4a2d" exitCode=0 Mar 16 16:32:37 crc kubenswrapper[5120]: I0316 16:32:37.906303 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-tvpzx" event={"ID":"408af245-438e-482c-ab14-fb2b7b947f8c","Type":"ContainerDied","Data":"1669972057cc8dbbfa6dc0e00026f2df8e5c1f76fed58fb6972e3087284a4a2d"} Mar 16 16:32:37 crc kubenswrapper[5120]: I0316 16:32:37.909712 5120 generic.go:358] "Generic (PLEG): container finished" podID="5c5ca400-22f5-457a-987f-0efd2139f18e" containerID="1ef00ba08ecceb8b41ac0c3ea5c6198a46e197013b171930c1ab10d5b8fac58a" exitCode=0 Mar 16 16:32:37 crc kubenswrapper[5120]: I0316 16:32:37.910042 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-g6hww" event={"ID":"5c5ca400-22f5-457a-987f-0efd2139f18e","Type":"ContainerDied","Data":"1ef00ba08ecceb8b41ac0c3ea5c6198a46e197013b171930c1ab10d5b8fac58a"} Mar 16 16:32:37 crc kubenswrapper[5120]: I0316 16:32:37.926353 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0a8a20fa-c913-4637-b923-f7404113831d-scripts\") pod \"0a8a20fa-c913-4637-b923-f7404113831d\" (UID: \"0a8a20fa-c913-4637-b923-f7404113831d\") " Mar 16 16:32:37 crc kubenswrapper[5120]: I0316 16:32:37.926401 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0a8a20fa-c913-4637-b923-f7404113831d-config-data\") pod \"0a8a20fa-c913-4637-b923-f7404113831d\" (UID: \"0a8a20fa-c913-4637-b923-f7404113831d\") " Mar 16 16:32:37 crc kubenswrapper[5120]: I0316 16:32:37.926471 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0a8a20fa-c913-4637-b923-f7404113831d-logs\") pod \"0a8a20fa-c913-4637-b923-f7404113831d\" (UID: \"0a8a20fa-c913-4637-b923-f7404113831d\") " Mar 16 16:32:37 crc kubenswrapper[5120]: I0316 16:32:37.926538 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"0a8a20fa-c913-4637-b923-f7404113831d\" (UID: \"0a8a20fa-c913-4637-b923-f7404113831d\") " Mar 16 16:32:37 crc kubenswrapper[5120]: I0316 16:32:37.926627 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rp7ws\" (UniqueName: \"kubernetes.io/projected/0a8a20fa-c913-4637-b923-f7404113831d-kube-api-access-rp7ws\") pod \"0a8a20fa-c913-4637-b923-f7404113831d\" (UID: \"0a8a20fa-c913-4637-b923-f7404113831d\") " Mar 16 16:32:37 crc kubenswrapper[5120]: I0316 16:32:37.926706 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/0a8a20fa-c913-4637-b923-f7404113831d-public-tls-certs\") pod \"0a8a20fa-c913-4637-b923-f7404113831d\" (UID: \"0a8a20fa-c913-4637-b923-f7404113831d\") " Mar 16 16:32:37 crc kubenswrapper[5120]: I0316 16:32:37.926751 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0a8a20fa-c913-4637-b923-f7404113831d-combined-ca-bundle\") pod \"0a8a20fa-c913-4637-b923-f7404113831d\" (UID: \"0a8a20fa-c913-4637-b923-f7404113831d\") " Mar 16 16:32:37 crc kubenswrapper[5120]: I0316 16:32:37.926865 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/0a8a20fa-c913-4637-b923-f7404113831d-httpd-run\") pod \"0a8a20fa-c913-4637-b923-f7404113831d\" (UID: \"0a8a20fa-c913-4637-b923-f7404113831d\") " Mar 16 16:32:37 crc kubenswrapper[5120]: I0316 16:32:37.928099 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/582ba829-6c97-4e79-8b3a-5ce51c47d9d2-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:32:37 crc kubenswrapper[5120]: I0316 16:32:37.928130 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/582ba829-6c97-4e79-8b3a-5ce51c47d9d2-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:32:37 crc kubenswrapper[5120]: I0316 16:32:37.928145 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/582ba829-6c97-4e79-8b3a-5ce51c47d9d2-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:32:37 crc kubenswrapper[5120]: I0316 16:32:37.928157 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/582ba829-6c97-4e79-8b3a-5ce51c47d9d2-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:32:37 crc kubenswrapper[5120]: I0316 16:32:37.928169 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4l7j7\" (UniqueName: \"kubernetes.io/projected/582ba829-6c97-4e79-8b3a-5ce51c47d9d2-kube-api-access-4l7j7\") on node \"crc\" DevicePath \"\"" Mar 16 16:32:37 crc kubenswrapper[5120]: I0316 16:32:37.928194 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage19-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") on node \"crc\" " Mar 16 16:32:37 crc kubenswrapper[5120]: I0316 16:32:37.931360 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a8a20fa-c913-4637-b923-f7404113831d-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "0a8a20fa-c913-4637-b923-f7404113831d" (UID: "0a8a20fa-c913-4637-b923-f7404113831d"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:32:37 crc kubenswrapper[5120]: I0316 16:32:37.931385 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a8a20fa-c913-4637-b923-f7404113831d-logs" (OuterVolumeSpecName: "logs") pod "0a8a20fa-c913-4637-b923-f7404113831d" (UID: "0a8a20fa-c913-4637-b923-f7404113831d"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:32:37 crc kubenswrapper[5120]: I0316 16:32:37.932632 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage01-crc" (OuterVolumeSpecName: "glance") pod "0a8a20fa-c913-4637-b923-f7404113831d" (UID: "0a8a20fa-c913-4637-b923-f7404113831d"). InnerVolumeSpecName "local-storage01-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:32:37 crc kubenswrapper[5120]: I0316 16:32:37.934499 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a8a20fa-c913-4637-b923-f7404113831d-kube-api-access-rp7ws" (OuterVolumeSpecName: "kube-api-access-rp7ws") pod "0a8a20fa-c913-4637-b923-f7404113831d" (UID: "0a8a20fa-c913-4637-b923-f7404113831d"). InnerVolumeSpecName "kube-api-access-rp7ws". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:32:37 crc kubenswrapper[5120]: I0316 16:32:37.943840 5120 scope.go:117] "RemoveContainer" containerID="fef5654cd48df1fd5bb3f83f7bf117d8db26e32f9a99b34bfe7caefcc55d3dff" Mar 16 16:32:37 crc kubenswrapper[5120]: I0316 16:32:37.945081 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a8a20fa-c913-4637-b923-f7404113831d-scripts" (OuterVolumeSpecName: "scripts") pod "0a8a20fa-c913-4637-b923-f7404113831d" (UID: "0a8a20fa-c913-4637-b923-f7404113831d"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:32:37 crc kubenswrapper[5120]: I0316 16:32:37.981495 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage19-crc" (UniqueName: "kubernetes.io/local-volume/local-storage19-crc") on node "crc" Mar 16 16:32:37 crc kubenswrapper[5120]: I0316 16:32:37.989049 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a8a20fa-c913-4637-b923-f7404113831d-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "0a8a20fa-c913-4637-b923-f7404113831d" (UID: "0a8a20fa-c913-4637-b923-f7404113831d"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:32:37 crc kubenswrapper[5120]: I0316 16:32:37.994224 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.007050 5120 scope.go:117] "RemoveContainer" containerID="448e7a90607ac4296d53eac2a98e8c11d6b172efe9c43ff388edf2066419d210" Mar 16 16:32:38 crc kubenswrapper[5120]: E0316 16:32:38.007473 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"448e7a90607ac4296d53eac2a98e8c11d6b172efe9c43ff388edf2066419d210\": container with ID starting with 448e7a90607ac4296d53eac2a98e8c11d6b172efe9c43ff388edf2066419d210 not found: ID does not exist" containerID="448e7a90607ac4296d53eac2a98e8c11d6b172efe9c43ff388edf2066419d210" Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.007554 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"448e7a90607ac4296d53eac2a98e8c11d6b172efe9c43ff388edf2066419d210"} err="failed to get container status \"448e7a90607ac4296d53eac2a98e8c11d6b172efe9c43ff388edf2066419d210\": rpc error: code = NotFound desc = could not find container \"448e7a90607ac4296d53eac2a98e8c11d6b172efe9c43ff388edf2066419d210\": container with ID starting with 448e7a90607ac4296d53eac2a98e8c11d6b172efe9c43ff388edf2066419d210 not found: ID does not exist" Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.007581 5120 scope.go:117] "RemoveContainer" containerID="fef5654cd48df1fd5bb3f83f7bf117d8db26e32f9a99b34bfe7caefcc55d3dff" Mar 16 16:32:38 crc kubenswrapper[5120]: E0316 16:32:38.020046 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fef5654cd48df1fd5bb3f83f7bf117d8db26e32f9a99b34bfe7caefcc55d3dff\": container with ID starting with fef5654cd48df1fd5bb3f83f7bf117d8db26e32f9a99b34bfe7caefcc55d3dff not found: ID does not exist" containerID="fef5654cd48df1fd5bb3f83f7bf117d8db26e32f9a99b34bfe7caefcc55d3dff" Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.020089 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fef5654cd48df1fd5bb3f83f7bf117d8db26e32f9a99b34bfe7caefcc55d3dff"} err="failed to get container status \"fef5654cd48df1fd5bb3f83f7bf117d8db26e32f9a99b34bfe7caefcc55d3dff\": rpc error: code = NotFound desc = could not find container \"fef5654cd48df1fd5bb3f83f7bf117d8db26e32f9a99b34bfe7caefcc55d3dff\": container with ID starting with fef5654cd48df1fd5bb3f83f7bf117d8db26e32f9a99b34bfe7caefcc55d3dff not found: ID does not exist" Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.020124 5120 scope.go:117] "RemoveContainer" containerID="448e7a90607ac4296d53eac2a98e8c11d6b172efe9c43ff388edf2066419d210" Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.028058 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"448e7a90607ac4296d53eac2a98e8c11d6b172efe9c43ff388edf2066419d210"} err="failed to get container status \"448e7a90607ac4296d53eac2a98e8c11d6b172efe9c43ff388edf2066419d210\": rpc error: code = NotFound desc = could not find container \"448e7a90607ac4296d53eac2a98e8c11d6b172efe9c43ff388edf2066419d210\": container with ID starting with 448e7a90607ac4296d53eac2a98e8c11d6b172efe9c43ff388edf2066419d210 not found: ID does not exist" Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.028095 5120 scope.go:117] "RemoveContainer" containerID="fef5654cd48df1fd5bb3f83f7bf117d8db26e32f9a99b34bfe7caefcc55d3dff" Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.028924 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fef5654cd48df1fd5bb3f83f7bf117d8db26e32f9a99b34bfe7caefcc55d3dff"} err="failed to get container status \"fef5654cd48df1fd5bb3f83f7bf117d8db26e32f9a99b34bfe7caefcc55d3dff\": rpc error: code = NotFound desc = could not find container \"fef5654cd48df1fd5bb3f83f7bf117d8db26e32f9a99b34bfe7caefcc55d3dff\": container with ID starting with fef5654cd48df1fd5bb3f83f7bf117d8db26e32f9a99b34bfe7caefcc55d3dff not found: ID does not exist" Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.028971 5120 scope.go:117] "RemoveContainer" containerID="f4621f3723b064d8fdf442494b59f080148b7e5040753bffd4282104787197ca" Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.029965 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage19-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.029983 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0a8a20fa-c913-4637-b923-f7404113831d-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.029992 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0a8a20fa-c913-4637-b923-f7404113831d-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.030010 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") on node \"crc\" " Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.030020 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rp7ws\" (UniqueName: \"kubernetes.io/projected/0a8a20fa-c913-4637-b923-f7404113831d-kube-api-access-rp7ws\") on node \"crc\" DevicePath \"\"" Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.030030 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0a8a20fa-c913-4637-b923-f7404113831d-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.030038 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/0a8a20fa-c913-4637-b923-f7404113831d-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.046229 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.051067 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage01-crc" (UniqueName: "kubernetes.io/local-volume/local-storage01-crc") on node "crc" Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.052004 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a8a20fa-c913-4637-b923-f7404113831d-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "0a8a20fa-c913-4637-b923-f7404113831d" (UID: "0a8a20fa-c913-4637-b923-f7404113831d"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.072813 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a8a20fa-c913-4637-b923-f7404113831d-config-data" (OuterVolumeSpecName: "config-data") pod "0a8a20fa-c913-4637-b923-f7404113831d" (UID: "0a8a20fa-c913-4637-b923-f7404113831d"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.080839 5120 scope.go:117] "RemoveContainer" containerID="a8e6da9753fca24be9b74d48f1986eae13406f9de64f517059c1ce66f7619fd0" Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.107400 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.109786 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a8a20fa-c913-4637-b923-f7404113831d" containerName="glance-httpd" Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.109820 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a8a20fa-c913-4637-b923-f7404113831d" containerName="glance-httpd" Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.109848 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="582ba829-6c97-4e79-8b3a-5ce51c47d9d2" containerName="glance-httpd" Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.109856 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="582ba829-6c97-4e79-8b3a-5ce51c47d9d2" containerName="glance-httpd" Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.109873 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="582ba829-6c97-4e79-8b3a-5ce51c47d9d2" containerName="glance-log" Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.109881 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="582ba829-6c97-4e79-8b3a-5ce51c47d9d2" containerName="glance-log" Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.109940 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a8a20fa-c913-4637-b923-f7404113831d" containerName="glance-log" Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.109949 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a8a20fa-c913-4637-b923-f7404113831d" containerName="glance-log" Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.110286 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="582ba829-6c97-4e79-8b3a-5ce51c47d9d2" containerName="glance-httpd" Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.110312 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="0a8a20fa-c913-4637-b923-f7404113831d" containerName="glance-log" Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.110339 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="582ba829-6c97-4e79-8b3a-5ce51c47d9d2" containerName="glance-log" Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.110529 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="0a8a20fa-c913-4637-b923-f7404113831d" containerName="glance-httpd" Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.122103 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.139838 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-internal-config-data\"" Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.140558 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0a8a20fa-c913-4637-b923-f7404113831d-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.140584 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.140597 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/0a8a20fa-c913-4637-b923-f7404113831d-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.140686 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-internal-svc\"" Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.156746 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.213865 5120 scope.go:117] "RemoveContainer" containerID="f4621f3723b064d8fdf442494b59f080148b7e5040753bffd4282104787197ca" Mar 16 16:32:38 crc kubenswrapper[5120]: E0316 16:32:38.214745 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f4621f3723b064d8fdf442494b59f080148b7e5040753bffd4282104787197ca\": container with ID starting with f4621f3723b064d8fdf442494b59f080148b7e5040753bffd4282104787197ca not found: ID does not exist" containerID="f4621f3723b064d8fdf442494b59f080148b7e5040753bffd4282104787197ca" Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.214798 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4621f3723b064d8fdf442494b59f080148b7e5040753bffd4282104787197ca"} err="failed to get container status \"f4621f3723b064d8fdf442494b59f080148b7e5040753bffd4282104787197ca\": rpc error: code = NotFound desc = could not find container \"f4621f3723b064d8fdf442494b59f080148b7e5040753bffd4282104787197ca\": container with ID starting with f4621f3723b064d8fdf442494b59f080148b7e5040753bffd4282104787197ca not found: ID does not exist" Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.214822 5120 scope.go:117] "RemoveContainer" containerID="a8e6da9753fca24be9b74d48f1986eae13406f9de64f517059c1ce66f7619fd0" Mar 16 16:32:38 crc kubenswrapper[5120]: E0316 16:32:38.215261 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a8e6da9753fca24be9b74d48f1986eae13406f9de64f517059c1ce66f7619fd0\": container with ID starting with a8e6da9753fca24be9b74d48f1986eae13406f9de64f517059c1ce66f7619fd0 not found: ID does not exist" containerID="a8e6da9753fca24be9b74d48f1986eae13406f9de64f517059c1ce66f7619fd0" Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.215291 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8e6da9753fca24be9b74d48f1986eae13406f9de64f517059c1ce66f7619fd0"} err="failed to get container status \"a8e6da9753fca24be9b74d48f1986eae13406f9de64f517059c1ce66f7619fd0\": rpc error: code = NotFound desc = could not find container \"a8e6da9753fca24be9b74d48f1986eae13406f9de64f517059c1ce66f7619fd0\": container with ID starting with a8e6da9753fca24be9b74d48f1986eae13406f9de64f517059c1ce66f7619fd0 not found: ID does not exist" Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.215310 5120 scope.go:117] "RemoveContainer" containerID="f4621f3723b064d8fdf442494b59f080148b7e5040753bffd4282104787197ca" Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.215560 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4621f3723b064d8fdf442494b59f080148b7e5040753bffd4282104787197ca"} err="failed to get container status \"f4621f3723b064d8fdf442494b59f080148b7e5040753bffd4282104787197ca\": rpc error: code = NotFound desc = could not find container \"f4621f3723b064d8fdf442494b59f080148b7e5040753bffd4282104787197ca\": container with ID starting with f4621f3723b064d8fdf442494b59f080148b7e5040753bffd4282104787197ca not found: ID does not exist" Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.215582 5120 scope.go:117] "RemoveContainer" containerID="a8e6da9753fca24be9b74d48f1986eae13406f9de64f517059c1ce66f7619fd0" Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.215877 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8e6da9753fca24be9b74d48f1986eae13406f9de64f517059c1ce66f7619fd0"} err="failed to get container status \"a8e6da9753fca24be9b74d48f1986eae13406f9de64f517059c1ce66f7619fd0\": rpc error: code = NotFound desc = could not find container \"a8e6da9753fca24be9b74d48f1986eae13406f9de64f517059c1ce66f7619fd0\": container with ID starting with a8e6da9753fca24be9b74d48f1986eae13406f9de64f517059c1ce66f7619fd0 not found: ID does not exist" Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.242609 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/66747957-79a6-4233-93a5-be994ddc995f-scripts\") pod \"glance-default-internal-api-0\" (UID: \"66747957-79a6-4233-93a5-be994ddc995f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.242684 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/66747957-79a6-4233-93a5-be994ddc995f-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"66747957-79a6-4233-93a5-be994ddc995f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.242783 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/66747957-79a6-4233-93a5-be994ddc995f-config-data\") pod \"glance-default-internal-api-0\" (UID: \"66747957-79a6-4233-93a5-be994ddc995f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.242822 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/66747957-79a6-4233-93a5-be994ddc995f-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"66747957-79a6-4233-93a5-be994ddc995f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.242861 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/66747957-79a6-4233-93a5-be994ddc995f-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"66747957-79a6-4233-93a5-be994ddc995f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.242910 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/66747957-79a6-4233-93a5-be994ddc995f-logs\") pod \"glance-default-internal-api-0\" (UID: \"66747957-79a6-4233-93a5-be994ddc995f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.242967 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vsrpf\" (UniqueName: \"kubernetes.io/projected/66747957-79a6-4233-93a5-be994ddc995f-kube-api-access-vsrpf\") pod \"glance-default-internal-api-0\" (UID: \"66747957-79a6-4233-93a5-be994ddc995f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.243005 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage19-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") pod \"glance-default-internal-api-0\" (UID: \"66747957-79a6-4233-93a5-be994ddc995f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.251262 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.276746 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.310340 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.319136 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.322058 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.330654 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-external-config-data\"" Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.330942 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-public-svc\"" Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.345402 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vsrpf\" (UniqueName: \"kubernetes.io/projected/66747957-79a6-4233-93a5-be994ddc995f-kube-api-access-vsrpf\") pod \"glance-default-internal-api-0\" (UID: \"66747957-79a6-4233-93a5-be994ddc995f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.345471 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage19-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") pod \"glance-default-internal-api-0\" (UID: \"66747957-79a6-4233-93a5-be994ddc995f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.345673 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/66747957-79a6-4233-93a5-be994ddc995f-scripts\") pod \"glance-default-internal-api-0\" (UID: \"66747957-79a6-4233-93a5-be994ddc995f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.345695 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/66747957-79a6-4233-93a5-be994ddc995f-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"66747957-79a6-4233-93a5-be994ddc995f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.345748 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/66747957-79a6-4233-93a5-be994ddc995f-config-data\") pod \"glance-default-internal-api-0\" (UID: \"66747957-79a6-4233-93a5-be994ddc995f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.345806 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/66747957-79a6-4233-93a5-be994ddc995f-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"66747957-79a6-4233-93a5-be994ddc995f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.345837 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/66747957-79a6-4233-93a5-be994ddc995f-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"66747957-79a6-4233-93a5-be994ddc995f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.345896 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/66747957-79a6-4233-93a5-be994ddc995f-logs\") pod \"glance-default-internal-api-0\" (UID: \"66747957-79a6-4233-93a5-be994ddc995f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.348106 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage19-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") pod \"glance-default-internal-api-0\" (UID: \"66747957-79a6-4233-93a5-be994ddc995f\") device mount path \"/mnt/openstack/pv19\"" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.348325 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/66747957-79a6-4233-93a5-be994ddc995f-logs\") pod \"glance-default-internal-api-0\" (UID: \"66747957-79a6-4233-93a5-be994ddc995f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.348706 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/66747957-79a6-4233-93a5-be994ddc995f-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"66747957-79a6-4233-93a5-be994ddc995f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.353328 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/66747957-79a6-4233-93a5-be994ddc995f-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"66747957-79a6-4233-93a5-be994ddc995f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.354506 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/66747957-79a6-4233-93a5-be994ddc995f-config-data\") pod \"glance-default-internal-api-0\" (UID: \"66747957-79a6-4233-93a5-be994ddc995f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.357668 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/66747957-79a6-4233-93a5-be994ddc995f-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"66747957-79a6-4233-93a5-be994ddc995f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.368808 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vsrpf\" (UniqueName: \"kubernetes.io/projected/66747957-79a6-4233-93a5-be994ddc995f-kube-api-access-vsrpf\") pod \"glance-default-internal-api-0\" (UID: \"66747957-79a6-4233-93a5-be994ddc995f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.369627 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/66747957-79a6-4233-93a5-be994ddc995f-scripts\") pod \"glance-default-internal-api-0\" (UID: \"66747957-79a6-4233-93a5-be994ddc995f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.380505 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage19-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") pod \"glance-default-internal-api-0\" (UID: \"66747957-79a6-4233-93a5-be994ddc995f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.437350 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-bmmdk" Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.447579 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"glance-default-external-api-0\" (UID: \"e0796e9e-184f-47cc-b5b7-5c06434a59a6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.447665 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e0796e9e-184f-47cc-b5b7-5c06434a59a6-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"e0796e9e-184f-47cc-b5b7-5c06434a59a6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.447701 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e0796e9e-184f-47cc-b5b7-5c06434a59a6-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"e0796e9e-184f-47cc-b5b7-5c06434a59a6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.447726 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/e0796e9e-184f-47cc-b5b7-5c06434a59a6-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"e0796e9e-184f-47cc-b5b7-5c06434a59a6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.447822 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzngx\" (UniqueName: \"kubernetes.io/projected/e0796e9e-184f-47cc-b5b7-5c06434a59a6-kube-api-access-zzngx\") pod \"glance-default-external-api-0\" (UID: \"e0796e9e-184f-47cc-b5b7-5c06434a59a6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.447966 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e0796e9e-184f-47cc-b5b7-5c06434a59a6-logs\") pod \"glance-default-external-api-0\" (UID: \"e0796e9e-184f-47cc-b5b7-5c06434a59a6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.448030 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e0796e9e-184f-47cc-b5b7-5c06434a59a6-config-data\") pod \"glance-default-external-api-0\" (UID: \"e0796e9e-184f-47cc-b5b7-5c06434a59a6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.448107 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e0796e9e-184f-47cc-b5b7-5c06434a59a6-scripts\") pod \"glance-default-external-api-0\" (UID: \"e0796e9e-184f-47cc-b5b7-5c06434a59a6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.513372 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.551516 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/46f918f9-8750-4631-9cf3-5f060522c045-scripts\") pod \"46f918f9-8750-4631-9cf3-5f060522c045\" (UID: \"46f918f9-8750-4631-9cf3-5f060522c045\") " Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.551853 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/46f918f9-8750-4631-9cf3-5f060522c045-combined-ca-bundle\") pod \"46f918f9-8750-4631-9cf3-5f060522c045\" (UID: \"46f918f9-8750-4631-9cf3-5f060522c045\") " Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.551996 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q5cnq\" (UniqueName: \"kubernetes.io/projected/46f918f9-8750-4631-9cf3-5f060522c045-kube-api-access-q5cnq\") pod \"46f918f9-8750-4631-9cf3-5f060522c045\" (UID: \"46f918f9-8750-4631-9cf3-5f060522c045\") " Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.552051 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/46f918f9-8750-4631-9cf3-5f060522c045-config-data\") pod \"46f918f9-8750-4631-9cf3-5f060522c045\" (UID: \"46f918f9-8750-4631-9cf3-5f060522c045\") " Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.552094 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/46f918f9-8750-4631-9cf3-5f060522c045-logs\") pod \"46f918f9-8750-4631-9cf3-5f060522c045\" (UID: \"46f918f9-8750-4631-9cf3-5f060522c045\") " Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.552364 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e0796e9e-184f-47cc-b5b7-5c06434a59a6-config-data\") pod \"glance-default-external-api-0\" (UID: \"e0796e9e-184f-47cc-b5b7-5c06434a59a6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.552447 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e0796e9e-184f-47cc-b5b7-5c06434a59a6-scripts\") pod \"glance-default-external-api-0\" (UID: \"e0796e9e-184f-47cc-b5b7-5c06434a59a6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.552701 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"glance-default-external-api-0\" (UID: \"e0796e9e-184f-47cc-b5b7-5c06434a59a6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.552734 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e0796e9e-184f-47cc-b5b7-5c06434a59a6-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"e0796e9e-184f-47cc-b5b7-5c06434a59a6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.552782 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e0796e9e-184f-47cc-b5b7-5c06434a59a6-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"e0796e9e-184f-47cc-b5b7-5c06434a59a6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.552807 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/e0796e9e-184f-47cc-b5b7-5c06434a59a6-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"e0796e9e-184f-47cc-b5b7-5c06434a59a6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.552865 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zzngx\" (UniqueName: \"kubernetes.io/projected/e0796e9e-184f-47cc-b5b7-5c06434a59a6-kube-api-access-zzngx\") pod \"glance-default-external-api-0\" (UID: \"e0796e9e-184f-47cc-b5b7-5c06434a59a6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.552989 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e0796e9e-184f-47cc-b5b7-5c06434a59a6-logs\") pod \"glance-default-external-api-0\" (UID: \"e0796e9e-184f-47cc-b5b7-5c06434a59a6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.553324 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"glance-default-external-api-0\" (UID: \"e0796e9e-184f-47cc-b5b7-5c06434a59a6\") device mount path \"/mnt/openstack/pv01\"" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.553503 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e0796e9e-184f-47cc-b5b7-5c06434a59a6-logs\") pod \"glance-default-external-api-0\" (UID: \"e0796e9e-184f-47cc-b5b7-5c06434a59a6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.554092 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/e0796e9e-184f-47cc-b5b7-5c06434a59a6-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"e0796e9e-184f-47cc-b5b7-5c06434a59a6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.556245 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46f918f9-8750-4631-9cf3-5f060522c045-logs" (OuterVolumeSpecName: "logs") pod "46f918f9-8750-4631-9cf3-5f060522c045" (UID: "46f918f9-8750-4631-9cf3-5f060522c045"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.561494 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e0796e9e-184f-47cc-b5b7-5c06434a59a6-config-data\") pod \"glance-default-external-api-0\" (UID: \"e0796e9e-184f-47cc-b5b7-5c06434a59a6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.562810 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e0796e9e-184f-47cc-b5b7-5c06434a59a6-scripts\") pod \"glance-default-external-api-0\" (UID: \"e0796e9e-184f-47cc-b5b7-5c06434a59a6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.562914 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e0796e9e-184f-47cc-b5b7-5c06434a59a6-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"e0796e9e-184f-47cc-b5b7-5c06434a59a6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.563605 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e0796e9e-184f-47cc-b5b7-5c06434a59a6-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"e0796e9e-184f-47cc-b5b7-5c06434a59a6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.564875 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/46f918f9-8750-4631-9cf3-5f060522c045-scripts" (OuterVolumeSpecName: "scripts") pod "46f918f9-8750-4631-9cf3-5f060522c045" (UID: "46f918f9-8750-4631-9cf3-5f060522c045"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.565645 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46f918f9-8750-4631-9cf3-5f060522c045-kube-api-access-q5cnq" (OuterVolumeSpecName: "kube-api-access-q5cnq") pod "46f918f9-8750-4631-9cf3-5f060522c045" (UID: "46f918f9-8750-4631-9cf3-5f060522c045"). InnerVolumeSpecName "kube-api-access-q5cnq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.572582 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzngx\" (UniqueName: \"kubernetes.io/projected/e0796e9e-184f-47cc-b5b7-5c06434a59a6-kube-api-access-zzngx\") pod \"glance-default-external-api-0\" (UID: \"e0796e9e-184f-47cc-b5b7-5c06434a59a6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:32:38 crc kubenswrapper[5120]: E0316 16:32:38.593313 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46f918f9-8750-4631-9cf3-5f060522c045-combined-ca-bundle podName:46f918f9-8750-4631-9cf3-5f060522c045 nodeName:}" failed. No retries permitted until 2026-03-16 16:32:39.093281489 +0000 UTC m=+3661.247213146 (durationBeforeRetry 500ms). Error: error cleaning subPath mounts for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/46f918f9-8750-4631-9cf3-5f060522c045-combined-ca-bundle") pod "46f918f9-8750-4631-9cf3-5f060522c045" (UID: "46f918f9-8750-4631-9cf3-5f060522c045") : error deleting /var/lib/kubelet/pods/46f918f9-8750-4631-9cf3-5f060522c045/volume-subpaths: remove /var/lib/kubelet/pods/46f918f9-8750-4631-9cf3-5f060522c045/volume-subpaths: no such file or directory Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.597276 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/46f918f9-8750-4631-9cf3-5f060522c045-config-data" (OuterVolumeSpecName: "config-data") pod "46f918f9-8750-4631-9cf3-5f060522c045" (UID: "46f918f9-8750-4631-9cf3-5f060522c045"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.600443 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"glance-default-external-api-0\" (UID: \"e0796e9e-184f-47cc-b5b7-5c06434a59a6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.655633 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q5cnq\" (UniqueName: \"kubernetes.io/projected/46f918f9-8750-4631-9cf3-5f060522c045-kube-api-access-q5cnq\") on node \"crc\" DevicePath \"\"" Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.655663 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/46f918f9-8750-4631-9cf3-5f060522c045-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.655673 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/46f918f9-8750-4631-9cf3-5f060522c045-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.655683 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/46f918f9-8750-4631-9cf3-5f060522c045-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.700469 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0a8a20fa-c913-4637-b923-f7404113831d" path="/var/lib/kubelet/pods/0a8a20fa-c913-4637-b923-f7404113831d/volumes" Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.701340 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="582ba829-6c97-4e79-8b3a-5ce51c47d9d2" path="/var/lib/kubelet/pods/582ba829-6c97-4e79-8b3a-5ce51c47d9d2/volumes" Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.750292 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.937103 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"2aeaa955-5410-4726-9eb7-0b99cff87b61","Type":"ContainerStarted","Data":"2d24f2d1aa7acd6d7147e38022246746c62910741a4d8ca55702b8661c99b3e7"} Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.937328 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="2aeaa955-5410-4726-9eb7-0b99cff87b61" containerName="ceilometer-central-agent" containerID="cri-o://c50fe560a0d30b1510a93acbf5114422de874b8bd5d471e63de4d2b192ed81b5" gracePeriod=30 Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.937427 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.939252 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="2aeaa955-5410-4726-9eb7-0b99cff87b61" containerName="proxy-httpd" containerID="cri-o://2d24f2d1aa7acd6d7147e38022246746c62910741a4d8ca55702b8661c99b3e7" gracePeriod=30 Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.940464 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="2aeaa955-5410-4726-9eb7-0b99cff87b61" containerName="sg-core" containerID="cri-o://43a0cc1070f7fa54cf27a958a9d3094b0db1608bdebb7bb1e46d5a316f148013" gracePeriod=30 Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.940525 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="2aeaa955-5410-4726-9eb7-0b99cff87b61" containerName="ceilometer-notification-agent" containerID="cri-o://ee5e8b2d7871e01f8a103964f89004f68a4cde75548df0a719ce99d0c2647aac" gracePeriod=30 Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.954990 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-bmmdk" Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.955199 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-bmmdk" event={"ID":"46f918f9-8750-4631-9cf3-5f060522c045","Type":"ContainerDied","Data":"5b15aa6acff48f339b0d0fc01ae9e29dffab2d12d4ef0def53fc802c33fd8ba6"} Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.955224 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5b15aa6acff48f339b0d0fc01ae9e29dffab2d12d4ef0def53fc802c33fd8ba6" Mar 16 16:32:38 crc kubenswrapper[5120]: I0316 16:32:38.994907 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.227422489 podStartE2EDuration="6.994888347s" podCreationTimestamp="2026-03-16 16:32:32 +0000 UTC" firstStartedPulling="2026-03-16 16:32:33.077174953 +0000 UTC m=+3655.231106620" lastFinishedPulling="2026-03-16 16:32:37.844640821 +0000 UTC m=+3659.998572478" observedRunningTime="2026-03-16 16:32:38.971108515 +0000 UTC m=+3661.125040172" watchObservedRunningTime="2026-03-16 16:32:38.994888347 +0000 UTC m=+3661.148820004" Mar 16 16:32:39 crc kubenswrapper[5120]: W0316 16:32:39.006650 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod66747957_79a6_4233_93a5_be994ddc995f.slice/crio-26f968b45d6b728dd9beeb9510fed3376c381a43a34f2b5f80ab95bf964b3bda WatchSource:0}: Error finding container 26f968b45d6b728dd9beeb9510fed3376c381a43a34f2b5f80ab95bf964b3bda: Status 404 returned error can't find the container with id 26f968b45d6b728dd9beeb9510fed3376c381a43a34f2b5f80ab95bf964b3bda Mar 16 16:32:39 crc kubenswrapper[5120]: I0316 16:32:39.010688 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:32:39 crc kubenswrapper[5120]: I0316 16:32:39.117734 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-d47d8c655-p8r55"] Mar 16 16:32:39 crc kubenswrapper[5120]: I0316 16:32:39.119308 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46f918f9-8750-4631-9cf3-5f060522c045" containerName="placement-db-sync" Mar 16 16:32:39 crc kubenswrapper[5120]: I0316 16:32:39.119335 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="46f918f9-8750-4631-9cf3-5f060522c045" containerName="placement-db-sync" Mar 16 16:32:39 crc kubenswrapper[5120]: I0316 16:32:39.119629 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="46f918f9-8750-4631-9cf3-5f060522c045" containerName="placement-db-sync" Mar 16 16:32:39 crc kubenswrapper[5120]: I0316 16:32:39.129544 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-d47d8c655-p8r55" Mar 16 16:32:39 crc kubenswrapper[5120]: I0316 16:32:39.138740 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-placement-internal-svc\"" Mar 16 16:32:39 crc kubenswrapper[5120]: I0316 16:32:39.139590 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-placement-public-svc\"" Mar 16 16:32:39 crc kubenswrapper[5120]: I0316 16:32:39.156979 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-d47d8c655-p8r55"] Mar 16 16:32:39 crc kubenswrapper[5120]: I0316 16:32:39.181628 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/46f918f9-8750-4631-9cf3-5f060522c045-combined-ca-bundle\") pod \"46f918f9-8750-4631-9cf3-5f060522c045\" (UID: \"46f918f9-8750-4631-9cf3-5f060522c045\") " Mar 16 16:32:39 crc kubenswrapper[5120]: I0316 16:32:39.197673 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/46f918f9-8750-4631-9cf3-5f060522c045-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "46f918f9-8750-4631-9cf3-5f060522c045" (UID: "46f918f9-8750-4631-9cf3-5f060522c045"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:32:39 crc kubenswrapper[5120]: I0316 16:32:39.246454 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:32:39 crc kubenswrapper[5120]: I0316 16:32:39.285832 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/716a6317-5231-4c6a-8728-7162c24ff8fb-scripts\") pod \"placement-d47d8c655-p8r55\" (UID: \"716a6317-5231-4c6a-8728-7162c24ff8fb\") " pod="openstack-kuttl-tests/placement-d47d8c655-p8r55" Mar 16 16:32:39 crc kubenswrapper[5120]: I0316 16:32:39.285880 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/716a6317-5231-4c6a-8728-7162c24ff8fb-combined-ca-bundle\") pod \"placement-d47d8c655-p8r55\" (UID: \"716a6317-5231-4c6a-8728-7162c24ff8fb\") " pod="openstack-kuttl-tests/placement-d47d8c655-p8r55" Mar 16 16:32:39 crc kubenswrapper[5120]: I0316 16:32:39.285906 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/716a6317-5231-4c6a-8728-7162c24ff8fb-logs\") pod \"placement-d47d8c655-p8r55\" (UID: \"716a6317-5231-4c6a-8728-7162c24ff8fb\") " pod="openstack-kuttl-tests/placement-d47d8c655-p8r55" Mar 16 16:32:39 crc kubenswrapper[5120]: I0316 16:32:39.285989 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/716a6317-5231-4c6a-8728-7162c24ff8fb-config-data\") pod \"placement-d47d8c655-p8r55\" (UID: \"716a6317-5231-4c6a-8728-7162c24ff8fb\") " pod="openstack-kuttl-tests/placement-d47d8c655-p8r55" Mar 16 16:32:39 crc kubenswrapper[5120]: I0316 16:32:39.286028 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/716a6317-5231-4c6a-8728-7162c24ff8fb-internal-tls-certs\") pod \"placement-d47d8c655-p8r55\" (UID: \"716a6317-5231-4c6a-8728-7162c24ff8fb\") " pod="openstack-kuttl-tests/placement-d47d8c655-p8r55" Mar 16 16:32:39 crc kubenswrapper[5120]: I0316 16:32:39.286133 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttfww\" (UniqueName: \"kubernetes.io/projected/716a6317-5231-4c6a-8728-7162c24ff8fb-kube-api-access-ttfww\") pod \"placement-d47d8c655-p8r55\" (UID: \"716a6317-5231-4c6a-8728-7162c24ff8fb\") " pod="openstack-kuttl-tests/placement-d47d8c655-p8r55" Mar 16 16:32:39 crc kubenswrapper[5120]: I0316 16:32:39.286170 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/716a6317-5231-4c6a-8728-7162c24ff8fb-public-tls-certs\") pod \"placement-d47d8c655-p8r55\" (UID: \"716a6317-5231-4c6a-8728-7162c24ff8fb\") " pod="openstack-kuttl-tests/placement-d47d8c655-p8r55" Mar 16 16:32:39 crc kubenswrapper[5120]: I0316 16:32:39.286234 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/46f918f9-8750-4631-9cf3-5f060522c045-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:32:39 crc kubenswrapper[5120]: I0316 16:32:39.388374 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/716a6317-5231-4c6a-8728-7162c24ff8fb-public-tls-certs\") pod \"placement-d47d8c655-p8r55\" (UID: \"716a6317-5231-4c6a-8728-7162c24ff8fb\") " pod="openstack-kuttl-tests/placement-d47d8c655-p8r55" Mar 16 16:32:39 crc kubenswrapper[5120]: I0316 16:32:39.389152 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/716a6317-5231-4c6a-8728-7162c24ff8fb-scripts\") pod \"placement-d47d8c655-p8r55\" (UID: \"716a6317-5231-4c6a-8728-7162c24ff8fb\") " pod="openstack-kuttl-tests/placement-d47d8c655-p8r55" Mar 16 16:32:39 crc kubenswrapper[5120]: I0316 16:32:39.389241 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/716a6317-5231-4c6a-8728-7162c24ff8fb-combined-ca-bundle\") pod \"placement-d47d8c655-p8r55\" (UID: \"716a6317-5231-4c6a-8728-7162c24ff8fb\") " pod="openstack-kuttl-tests/placement-d47d8c655-p8r55" Mar 16 16:32:39 crc kubenswrapper[5120]: I0316 16:32:39.389286 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/716a6317-5231-4c6a-8728-7162c24ff8fb-logs\") pod \"placement-d47d8c655-p8r55\" (UID: \"716a6317-5231-4c6a-8728-7162c24ff8fb\") " pod="openstack-kuttl-tests/placement-d47d8c655-p8r55" Mar 16 16:32:39 crc kubenswrapper[5120]: I0316 16:32:39.389434 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/716a6317-5231-4c6a-8728-7162c24ff8fb-config-data\") pod \"placement-d47d8c655-p8r55\" (UID: \"716a6317-5231-4c6a-8728-7162c24ff8fb\") " pod="openstack-kuttl-tests/placement-d47d8c655-p8r55" Mar 16 16:32:39 crc kubenswrapper[5120]: I0316 16:32:39.389511 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/716a6317-5231-4c6a-8728-7162c24ff8fb-internal-tls-certs\") pod \"placement-d47d8c655-p8r55\" (UID: \"716a6317-5231-4c6a-8728-7162c24ff8fb\") " pod="openstack-kuttl-tests/placement-d47d8c655-p8r55" Mar 16 16:32:39 crc kubenswrapper[5120]: I0316 16:32:39.389719 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ttfww\" (UniqueName: \"kubernetes.io/projected/716a6317-5231-4c6a-8728-7162c24ff8fb-kube-api-access-ttfww\") pod \"placement-d47d8c655-p8r55\" (UID: \"716a6317-5231-4c6a-8728-7162c24ff8fb\") " pod="openstack-kuttl-tests/placement-d47d8c655-p8r55" Mar 16 16:32:39 crc kubenswrapper[5120]: I0316 16:32:39.391713 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/716a6317-5231-4c6a-8728-7162c24ff8fb-logs\") pod \"placement-d47d8c655-p8r55\" (UID: \"716a6317-5231-4c6a-8728-7162c24ff8fb\") " pod="openstack-kuttl-tests/placement-d47d8c655-p8r55" Mar 16 16:32:39 crc kubenswrapper[5120]: I0316 16:32:39.394190 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/716a6317-5231-4c6a-8728-7162c24ff8fb-scripts\") pod \"placement-d47d8c655-p8r55\" (UID: \"716a6317-5231-4c6a-8728-7162c24ff8fb\") " pod="openstack-kuttl-tests/placement-d47d8c655-p8r55" Mar 16 16:32:39 crc kubenswrapper[5120]: I0316 16:32:39.394258 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/716a6317-5231-4c6a-8728-7162c24ff8fb-public-tls-certs\") pod \"placement-d47d8c655-p8r55\" (UID: \"716a6317-5231-4c6a-8728-7162c24ff8fb\") " pod="openstack-kuttl-tests/placement-d47d8c655-p8r55" Mar 16 16:32:39 crc kubenswrapper[5120]: I0316 16:32:39.394857 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/716a6317-5231-4c6a-8728-7162c24ff8fb-combined-ca-bundle\") pod \"placement-d47d8c655-p8r55\" (UID: \"716a6317-5231-4c6a-8728-7162c24ff8fb\") " pod="openstack-kuttl-tests/placement-d47d8c655-p8r55" Mar 16 16:32:39 crc kubenswrapper[5120]: I0316 16:32:39.396367 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/716a6317-5231-4c6a-8728-7162c24ff8fb-internal-tls-certs\") pod \"placement-d47d8c655-p8r55\" (UID: \"716a6317-5231-4c6a-8728-7162c24ff8fb\") " pod="openstack-kuttl-tests/placement-d47d8c655-p8r55" Mar 16 16:32:39 crc kubenswrapper[5120]: I0316 16:32:39.400100 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/716a6317-5231-4c6a-8728-7162c24ff8fb-config-data\") pod \"placement-d47d8c655-p8r55\" (UID: \"716a6317-5231-4c6a-8728-7162c24ff8fb\") " pod="openstack-kuttl-tests/placement-d47d8c655-p8r55" Mar 16 16:32:39 crc kubenswrapper[5120]: I0316 16:32:39.408282 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttfww\" (UniqueName: \"kubernetes.io/projected/716a6317-5231-4c6a-8728-7162c24ff8fb-kube-api-access-ttfww\") pod \"placement-d47d8c655-p8r55\" (UID: \"716a6317-5231-4c6a-8728-7162c24ff8fb\") " pod="openstack-kuttl-tests/placement-d47d8c655-p8r55" Mar 16 16:32:39 crc kubenswrapper[5120]: I0316 16:32:39.521219 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-g6hww" Mar 16 16:32:39 crc kubenswrapper[5120]: I0316 16:32:39.555644 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-d47d8c655-p8r55" Mar 16 16:32:39 crc kubenswrapper[5120]: I0316 16:32:39.620934 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-tvpzx" Mar 16 16:32:39 crc kubenswrapper[5120]: I0316 16:32:39.697109 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/5c5ca400-22f5-457a-987f-0efd2139f18e-db-sync-config-data\") pod \"5c5ca400-22f5-457a-987f-0efd2139f18e\" (UID: \"5c5ca400-22f5-457a-987f-0efd2139f18e\") " Mar 16 16:32:39 crc kubenswrapper[5120]: I0316 16:32:39.697362 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5c5ca400-22f5-457a-987f-0efd2139f18e-combined-ca-bundle\") pod \"5c5ca400-22f5-457a-987f-0efd2139f18e\" (UID: \"5c5ca400-22f5-457a-987f-0efd2139f18e\") " Mar 16 16:32:39 crc kubenswrapper[5120]: I0316 16:32:39.699276 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xpkgd\" (UniqueName: \"kubernetes.io/projected/5c5ca400-22f5-457a-987f-0efd2139f18e-kube-api-access-xpkgd\") pod \"5c5ca400-22f5-457a-987f-0efd2139f18e\" (UID: \"5c5ca400-22f5-457a-987f-0efd2139f18e\") " Mar 16 16:32:39 crc kubenswrapper[5120]: I0316 16:32:39.703848 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c5ca400-22f5-457a-987f-0efd2139f18e-db-sync-config-data" (OuterVolumeSpecName: "db-sync-config-data") pod "5c5ca400-22f5-457a-987f-0efd2139f18e" (UID: "5c5ca400-22f5-457a-987f-0efd2139f18e"). InnerVolumeSpecName "db-sync-config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:32:39 crc kubenswrapper[5120]: I0316 16:32:39.705020 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c5ca400-22f5-457a-987f-0efd2139f18e-kube-api-access-xpkgd" (OuterVolumeSpecName: "kube-api-access-xpkgd") pod "5c5ca400-22f5-457a-987f-0efd2139f18e" (UID: "5c5ca400-22f5-457a-987f-0efd2139f18e"). InnerVolumeSpecName "kube-api-access-xpkgd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:32:39 crc kubenswrapper[5120]: I0316 16:32:39.746830 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c5ca400-22f5-457a-987f-0efd2139f18e-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "5c5ca400-22f5-457a-987f-0efd2139f18e" (UID: "5c5ca400-22f5-457a-987f-0efd2139f18e"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:32:39 crc kubenswrapper[5120]: I0316 16:32:39.809730 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/408af245-438e-482c-ab14-fb2b7b947f8c-credential-keys\") pod \"408af245-438e-482c-ab14-fb2b7b947f8c\" (UID: \"408af245-438e-482c-ab14-fb2b7b947f8c\") " Mar 16 16:32:39 crc kubenswrapper[5120]: I0316 16:32:39.810129 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/408af245-438e-482c-ab14-fb2b7b947f8c-fernet-keys\") pod \"408af245-438e-482c-ab14-fb2b7b947f8c\" (UID: \"408af245-438e-482c-ab14-fb2b7b947f8c\") " Mar 16 16:32:39 crc kubenswrapper[5120]: I0316 16:32:39.810400 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/408af245-438e-482c-ab14-fb2b7b947f8c-scripts\") pod \"408af245-438e-482c-ab14-fb2b7b947f8c\" (UID: \"408af245-438e-482c-ab14-fb2b7b947f8c\") " Mar 16 16:32:39 crc kubenswrapper[5120]: I0316 16:32:39.810434 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/408af245-438e-482c-ab14-fb2b7b947f8c-combined-ca-bundle\") pod \"408af245-438e-482c-ab14-fb2b7b947f8c\" (UID: \"408af245-438e-482c-ab14-fb2b7b947f8c\") " Mar 16 16:32:39 crc kubenswrapper[5120]: I0316 16:32:39.810515 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jhlgw\" (UniqueName: \"kubernetes.io/projected/408af245-438e-482c-ab14-fb2b7b947f8c-kube-api-access-jhlgw\") pod \"408af245-438e-482c-ab14-fb2b7b947f8c\" (UID: \"408af245-438e-482c-ab14-fb2b7b947f8c\") " Mar 16 16:32:39 crc kubenswrapper[5120]: I0316 16:32:39.810576 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/408af245-438e-482c-ab14-fb2b7b947f8c-config-data\") pod \"408af245-438e-482c-ab14-fb2b7b947f8c\" (UID: \"408af245-438e-482c-ab14-fb2b7b947f8c\") " Mar 16 16:32:39 crc kubenswrapper[5120]: I0316 16:32:39.811652 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xpkgd\" (UniqueName: \"kubernetes.io/projected/5c5ca400-22f5-457a-987f-0efd2139f18e-kube-api-access-xpkgd\") on node \"crc\" DevicePath \"\"" Mar 16 16:32:39 crc kubenswrapper[5120]: I0316 16:32:39.811678 5120 reconciler_common.go:299] "Volume detached for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/5c5ca400-22f5-457a-987f-0efd2139f18e-db-sync-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:32:39 crc kubenswrapper[5120]: I0316 16:32:39.811690 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5c5ca400-22f5-457a-987f-0efd2139f18e-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:32:39 crc kubenswrapper[5120]: I0316 16:32:39.819007 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/408af245-438e-482c-ab14-fb2b7b947f8c-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "408af245-438e-482c-ab14-fb2b7b947f8c" (UID: "408af245-438e-482c-ab14-fb2b7b947f8c"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:32:39 crc kubenswrapper[5120]: I0316 16:32:39.818988 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/408af245-438e-482c-ab14-fb2b7b947f8c-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "408af245-438e-482c-ab14-fb2b7b947f8c" (UID: "408af245-438e-482c-ab14-fb2b7b947f8c"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:32:39 crc kubenswrapper[5120]: I0316 16:32:39.819650 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/408af245-438e-482c-ab14-fb2b7b947f8c-scripts" (OuterVolumeSpecName: "scripts") pod "408af245-438e-482c-ab14-fb2b7b947f8c" (UID: "408af245-438e-482c-ab14-fb2b7b947f8c"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:32:39 crc kubenswrapper[5120]: I0316 16:32:39.823917 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/408af245-438e-482c-ab14-fb2b7b947f8c-kube-api-access-jhlgw" (OuterVolumeSpecName: "kube-api-access-jhlgw") pod "408af245-438e-482c-ab14-fb2b7b947f8c" (UID: "408af245-438e-482c-ab14-fb2b7b947f8c"). InnerVolumeSpecName "kube-api-access-jhlgw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:32:39 crc kubenswrapper[5120]: I0316 16:32:39.842639 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/408af245-438e-482c-ab14-fb2b7b947f8c-config-data" (OuterVolumeSpecName: "config-data") pod "408af245-438e-482c-ab14-fb2b7b947f8c" (UID: "408af245-438e-482c-ab14-fb2b7b947f8c"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:32:39 crc kubenswrapper[5120]: I0316 16:32:39.848789 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/408af245-438e-482c-ab14-fb2b7b947f8c-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "408af245-438e-482c-ab14-fb2b7b947f8c" (UID: "408af245-438e-482c-ab14-fb2b7b947f8c"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:32:39 crc kubenswrapper[5120]: I0316 16:32:39.913407 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/408af245-438e-482c-ab14-fb2b7b947f8c-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:32:39 crc kubenswrapper[5120]: I0316 16:32:39.913472 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/408af245-438e-482c-ab14-fb2b7b947f8c-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:32:39 crc kubenswrapper[5120]: I0316 16:32:39.913483 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jhlgw\" (UniqueName: \"kubernetes.io/projected/408af245-438e-482c-ab14-fb2b7b947f8c-kube-api-access-jhlgw\") on node \"crc\" DevicePath \"\"" Mar 16 16:32:39 crc kubenswrapper[5120]: I0316 16:32:39.913491 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/408af245-438e-482c-ab14-fb2b7b947f8c-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:32:39 crc kubenswrapper[5120]: I0316 16:32:39.913500 5120 reconciler_common.go:299] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/408af245-438e-482c-ab14-fb2b7b947f8c-credential-keys\") on node \"crc\" DevicePath \"\"" Mar 16 16:32:39 crc kubenswrapper[5120]: I0316 16:32:39.913508 5120 reconciler_common.go:299] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/408af245-438e-482c-ab14-fb2b7b947f8c-fernet-keys\") on node \"crc\" DevicePath \"\"" Mar 16 16:32:39 crc kubenswrapper[5120]: I0316 16:32:39.960441 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:32:39 crc kubenswrapper[5120]: I0316 16:32:39.987992 5120 generic.go:358] "Generic (PLEG): container finished" podID="2aeaa955-5410-4726-9eb7-0b99cff87b61" containerID="2d24f2d1aa7acd6d7147e38022246746c62910741a4d8ca55702b8661c99b3e7" exitCode=0 Mar 16 16:32:39 crc kubenswrapper[5120]: I0316 16:32:39.988032 5120 generic.go:358] "Generic (PLEG): container finished" podID="2aeaa955-5410-4726-9eb7-0b99cff87b61" containerID="43a0cc1070f7fa54cf27a958a9d3094b0db1608bdebb7bb1e46d5a316f148013" exitCode=2 Mar 16 16:32:39 crc kubenswrapper[5120]: I0316 16:32:39.988043 5120 generic.go:358] "Generic (PLEG): container finished" podID="2aeaa955-5410-4726-9eb7-0b99cff87b61" containerID="ee5e8b2d7871e01f8a103964f89004f68a4cde75548df0a719ce99d0c2647aac" exitCode=0 Mar 16 16:32:39 crc kubenswrapper[5120]: I0316 16:32:39.988053 5120 generic.go:358] "Generic (PLEG): container finished" podID="2aeaa955-5410-4726-9eb7-0b99cff87b61" containerID="c50fe560a0d30b1510a93acbf5114422de874b8bd5d471e63de4d2b192ed81b5" exitCode=0 Mar 16 16:32:39 crc kubenswrapper[5120]: I0316 16:32:39.988131 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:32:39 crc kubenswrapper[5120]: I0316 16:32:39.988147 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"2aeaa955-5410-4726-9eb7-0b99cff87b61","Type":"ContainerDied","Data":"2d24f2d1aa7acd6d7147e38022246746c62910741a4d8ca55702b8661c99b3e7"} Mar 16 16:32:39 crc kubenswrapper[5120]: I0316 16:32:39.988208 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"2aeaa955-5410-4726-9eb7-0b99cff87b61","Type":"ContainerDied","Data":"43a0cc1070f7fa54cf27a958a9d3094b0db1608bdebb7bb1e46d5a316f148013"} Mar 16 16:32:39 crc kubenswrapper[5120]: I0316 16:32:39.988220 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"2aeaa955-5410-4726-9eb7-0b99cff87b61","Type":"ContainerDied","Data":"ee5e8b2d7871e01f8a103964f89004f68a4cde75548df0a719ce99d0c2647aac"} Mar 16 16:32:39 crc kubenswrapper[5120]: I0316 16:32:39.988230 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"2aeaa955-5410-4726-9eb7-0b99cff87b61","Type":"ContainerDied","Data":"c50fe560a0d30b1510a93acbf5114422de874b8bd5d471e63de4d2b192ed81b5"} Mar 16 16:32:39 crc kubenswrapper[5120]: I0316 16:32:39.988249 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"2aeaa955-5410-4726-9eb7-0b99cff87b61","Type":"ContainerDied","Data":"79b73064f07cf7f2ed460b397a5db2dfd23414ecc9c585413770292b368c2883"} Mar 16 16:32:39 crc kubenswrapper[5120]: I0316 16:32:39.988266 5120 scope.go:117] "RemoveContainer" containerID="2d24f2d1aa7acd6d7147e38022246746c62910741a4d8ca55702b8661c99b3e7" Mar 16 16:32:39 crc kubenswrapper[5120]: I0316 16:32:39.996248 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"66747957-79a6-4233-93a5-be994ddc995f","Type":"ContainerStarted","Data":"26f968b45d6b728dd9beeb9510fed3376c381a43a34f2b5f80ab95bf964b3bda"} Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.009797 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-g6hww" event={"ID":"5c5ca400-22f5-457a-987f-0efd2139f18e","Type":"ContainerDied","Data":"8ac6474a6f96e76e7d559abeed6412836b47671e21271dd9ee35d07dad47b2da"} Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.009843 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8ac6474a6f96e76e7d559abeed6412836b47671e21271dd9ee35d07dad47b2da" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.009870 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-g6hww" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.015000 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2aeaa955-5410-4726-9eb7-0b99cff87b61-scripts\") pod \"2aeaa955-5410-4726-9eb7-0b99cff87b61\" (UID: \"2aeaa955-5410-4726-9eb7-0b99cff87b61\") " Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.015080 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2aeaa955-5410-4726-9eb7-0b99cff87b61-log-httpd\") pod \"2aeaa955-5410-4726-9eb7-0b99cff87b61\" (UID: \"2aeaa955-5410-4726-9eb7-0b99cff87b61\") " Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.015143 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/2aeaa955-5410-4726-9eb7-0b99cff87b61-sg-core-conf-yaml\") pod \"2aeaa955-5410-4726-9eb7-0b99cff87b61\" (UID: \"2aeaa955-5410-4726-9eb7-0b99cff87b61\") " Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.015263 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2aeaa955-5410-4726-9eb7-0b99cff87b61-run-httpd\") pod \"2aeaa955-5410-4726-9eb7-0b99cff87b61\" (UID: \"2aeaa955-5410-4726-9eb7-0b99cff87b61\") " Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.015405 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n6r6j\" (UniqueName: \"kubernetes.io/projected/2aeaa955-5410-4726-9eb7-0b99cff87b61-kube-api-access-n6r6j\") pod \"2aeaa955-5410-4726-9eb7-0b99cff87b61\" (UID: \"2aeaa955-5410-4726-9eb7-0b99cff87b61\") " Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.015528 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2aeaa955-5410-4726-9eb7-0b99cff87b61-combined-ca-bundle\") pod \"2aeaa955-5410-4726-9eb7-0b99cff87b61\" (UID: \"2aeaa955-5410-4726-9eb7-0b99cff87b61\") " Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.015575 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2aeaa955-5410-4726-9eb7-0b99cff87b61-config-data\") pod \"2aeaa955-5410-4726-9eb7-0b99cff87b61\" (UID: \"2aeaa955-5410-4726-9eb7-0b99cff87b61\") " Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.017278 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2aeaa955-5410-4726-9eb7-0b99cff87b61-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "2aeaa955-5410-4726-9eb7-0b99cff87b61" (UID: "2aeaa955-5410-4726-9eb7-0b99cff87b61"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.017380 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2aeaa955-5410-4726-9eb7-0b99cff87b61-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "2aeaa955-5410-4726-9eb7-0b99cff87b61" (UID: "2aeaa955-5410-4726-9eb7-0b99cff87b61"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.021684 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"e0796e9e-184f-47cc-b5b7-5c06434a59a6","Type":"ContainerStarted","Data":"19588b190101793b524a3b9676912411ed9f1d27d44354beec556719aa7d9593"} Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.024474 5120 scope.go:117] "RemoveContainer" containerID="43a0cc1070f7fa54cf27a958a9d3094b0db1608bdebb7bb1e46d5a316f148013" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.024579 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2aeaa955-5410-4726-9eb7-0b99cff87b61-kube-api-access-n6r6j" (OuterVolumeSpecName: "kube-api-access-n6r6j") pod "2aeaa955-5410-4726-9eb7-0b99cff87b61" (UID: "2aeaa955-5410-4726-9eb7-0b99cff87b61"). InnerVolumeSpecName "kube-api-access-n6r6j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.024743 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2aeaa955-5410-4726-9eb7-0b99cff87b61-scripts" (OuterVolumeSpecName: "scripts") pod "2aeaa955-5410-4726-9eb7-0b99cff87b61" (UID: "2aeaa955-5410-4726-9eb7-0b99cff87b61"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.026031 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-tvpzx" event={"ID":"408af245-438e-482c-ab14-fb2b7b947f8c","Type":"ContainerDied","Data":"305f6fc3dbe6e062a425ebbcf3644469f5f83a37fb9b4fcf46ffbbebdee39e66"} Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.026075 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-tvpzx" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.026091 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="305f6fc3dbe6e062a425ebbcf3644469f5f83a37fb9b4fcf46ffbbebdee39e66" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.052786 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-tvpzx"] Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.065494 5120 status_manager.go:895] "Failed to get status for pod" podUID="408af245-438e-482c-ab14-fb2b7b947f8c" pod="openstack-kuttl-tests/keystone-bootstrap-tvpzx" err="pods \"keystone-bootstrap-tvpzx\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.066941 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-tvpzx"] Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.067143 5120 scope.go:117] "RemoveContainer" containerID="ee5e8b2d7871e01f8a103964f89004f68a4cde75548df0a719ce99d0c2647aac" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.080703 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2aeaa955-5410-4726-9eb7-0b99cff87b61-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "2aeaa955-5410-4726-9eb7-0b99cff87b61" (UID: "2aeaa955-5410-4726-9eb7-0b99cff87b61"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.112817 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-v6zxd"] Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.117150 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2aeaa955-5410-4726-9eb7-0b99cff87b61" containerName="sg-core" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.117178 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="2aeaa955-5410-4726-9eb7-0b99cff87b61" containerName="sg-core" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.117227 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c5ca400-22f5-457a-987f-0efd2139f18e" containerName="barbican-db-sync" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.117235 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c5ca400-22f5-457a-987f-0efd2139f18e" containerName="barbican-db-sync" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.117247 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2aeaa955-5410-4726-9eb7-0b99cff87b61" containerName="ceilometer-central-agent" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.117253 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="2aeaa955-5410-4726-9eb7-0b99cff87b61" containerName="ceilometer-central-agent" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.117278 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2aeaa955-5410-4726-9eb7-0b99cff87b61" containerName="ceilometer-notification-agent" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.117286 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="2aeaa955-5410-4726-9eb7-0b99cff87b61" containerName="ceilometer-notification-agent" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.117296 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2aeaa955-5410-4726-9eb7-0b99cff87b61" containerName="proxy-httpd" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.117301 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="2aeaa955-5410-4726-9eb7-0b99cff87b61" containerName="proxy-httpd" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.117315 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="408af245-438e-482c-ab14-fb2b7b947f8c" containerName="keystone-bootstrap" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.117320 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="408af245-438e-482c-ab14-fb2b7b947f8c" containerName="keystone-bootstrap" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.117459 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="2aeaa955-5410-4726-9eb7-0b99cff87b61" containerName="ceilometer-central-agent" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.117476 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="2aeaa955-5410-4726-9eb7-0b99cff87b61" containerName="ceilometer-notification-agent" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.117488 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="5c5ca400-22f5-457a-987f-0efd2139f18e" containerName="barbican-db-sync" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.117505 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="2aeaa955-5410-4726-9eb7-0b99cff87b61" containerName="proxy-httpd" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.117519 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="2aeaa955-5410-4726-9eb7-0b99cff87b61" containerName="sg-core" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.117529 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="408af245-438e-482c-ab14-fb2b7b947f8c" containerName="keystone-bootstrap" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.117593 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2aeaa955-5410-4726-9eb7-0b99cff87b61-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.117624 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2aeaa955-5410-4726-9eb7-0b99cff87b61-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.117636 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/2aeaa955-5410-4726-9eb7-0b99cff87b61-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.117645 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2aeaa955-5410-4726-9eb7-0b99cff87b61-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.117655 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n6r6j\" (UniqueName: \"kubernetes.io/projected/2aeaa955-5410-4726-9eb7-0b99cff87b61-kube-api-access-n6r6j\") on node \"crc\" DevicePath \"\"" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.164872 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-v6zxd"] Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.165295 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-v6zxd" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.168363 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-d47d8c655-p8r55"] Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.174228 5120 status_manager.go:895] "Failed to get status for pod" podUID="408af245-438e-482c-ab14-fb2b7b947f8c" pod="openstack-kuttl-tests/keystone-bootstrap-tvpzx" err="pods \"keystone-bootstrap-tvpzx\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.174697 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"osp-secret\"" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.174960 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-config-data\"" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.175117 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone\"" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.175256 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-keystone-dockercfg-nqmkd\"" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.176012 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-scripts\"" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.205408 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-worker-574f947b6-n4thn"] Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.220818 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/cc2bd316-2e78-455c-a6dd-42328212b951-scripts\") pod \"keystone-bootstrap-v6zxd\" (UID: \"cc2bd316-2e78-455c-a6dd-42328212b951\") " pod="openstack-kuttl-tests/keystone-bootstrap-v6zxd" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.220918 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cc2bd316-2e78-455c-a6dd-42328212b951-config-data\") pod \"keystone-bootstrap-v6zxd\" (UID: \"cc2bd316-2e78-455c-a6dd-42328212b951\") " pod="openstack-kuttl-tests/keystone-bootstrap-v6zxd" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.220963 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/cc2bd316-2e78-455c-a6dd-42328212b951-fernet-keys\") pod \"keystone-bootstrap-v6zxd\" (UID: \"cc2bd316-2e78-455c-a6dd-42328212b951\") " pod="openstack-kuttl-tests/keystone-bootstrap-v6zxd" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.220998 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cc2bd316-2e78-455c-a6dd-42328212b951-combined-ca-bundle\") pod \"keystone-bootstrap-v6zxd\" (UID: \"cc2bd316-2e78-455c-a6dd-42328212b951\") " pod="openstack-kuttl-tests/keystone-bootstrap-v6zxd" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.221034 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/cc2bd316-2e78-455c-a6dd-42328212b951-credential-keys\") pod \"keystone-bootstrap-v6zxd\" (UID: \"cc2bd316-2e78-455c-a6dd-42328212b951\") " pod="openstack-kuttl-tests/keystone-bootstrap-v6zxd" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.221078 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4769\" (UniqueName: \"kubernetes.io/projected/cc2bd316-2e78-455c-a6dd-42328212b951-kube-api-access-h4769\") pod \"keystone-bootstrap-v6zxd\" (UID: \"cc2bd316-2e78-455c-a6dd-42328212b951\") " pod="openstack-kuttl-tests/keystone-bootstrap-v6zxd" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.232458 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-6f799fddf5-d8q8w"] Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.236749 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-574f947b6-n4thn" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.239736 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-worker-config-data\"" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.241943 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-config-data\"" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.242151 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-barbican-dockercfg-p792w\"" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.259467 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-6f799fddf5-d8q8w"] Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.259502 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-574f947b6-n4thn"] Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.259622 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-6f799fddf5-d8q8w" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.262287 5120 status_manager.go:895] "Failed to get status for pod" podUID="408af245-438e-482c-ab14-fb2b7b947f8c" pod="openstack-kuttl-tests/keystone-bootstrap-tvpzx" err="pods \"keystone-bootstrap-tvpzx\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.262794 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-keystone-listener-config-data\"" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.271037 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2aeaa955-5410-4726-9eb7-0b99cff87b61-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "2aeaa955-5410-4726-9eb7-0b99cff87b61" (UID: "2aeaa955-5410-4726-9eb7-0b99cff87b61"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.282535 5120 status_manager.go:895] "Failed to get status for pod" podUID="408af245-438e-482c-ab14-fb2b7b947f8c" pod="openstack-kuttl-tests/keystone-bootstrap-tvpzx" err="pods \"keystone-bootstrap-tvpzx\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.324498 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/cc2bd316-2e78-455c-a6dd-42328212b951-scripts\") pod \"keystone-bootstrap-v6zxd\" (UID: \"cc2bd316-2e78-455c-a6dd-42328212b951\") " pod="openstack-kuttl-tests/keystone-bootstrap-v6zxd" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.324670 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cc2bd316-2e78-455c-a6dd-42328212b951-config-data\") pod \"keystone-bootstrap-v6zxd\" (UID: \"cc2bd316-2e78-455c-a6dd-42328212b951\") " pod="openstack-kuttl-tests/keystone-bootstrap-v6zxd" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.324777 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/cc2bd316-2e78-455c-a6dd-42328212b951-fernet-keys\") pod \"keystone-bootstrap-v6zxd\" (UID: \"cc2bd316-2e78-455c-a6dd-42328212b951\") " pod="openstack-kuttl-tests/keystone-bootstrap-v6zxd" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.324844 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cc2bd316-2e78-455c-a6dd-42328212b951-combined-ca-bundle\") pod \"keystone-bootstrap-v6zxd\" (UID: \"cc2bd316-2e78-455c-a6dd-42328212b951\") " pod="openstack-kuttl-tests/keystone-bootstrap-v6zxd" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.324910 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/cc2bd316-2e78-455c-a6dd-42328212b951-credential-keys\") pod \"keystone-bootstrap-v6zxd\" (UID: \"cc2bd316-2e78-455c-a6dd-42328212b951\") " pod="openstack-kuttl-tests/keystone-bootstrap-v6zxd" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.325001 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h4769\" (UniqueName: \"kubernetes.io/projected/cc2bd316-2e78-455c-a6dd-42328212b951-kube-api-access-h4769\") pod \"keystone-bootstrap-v6zxd\" (UID: \"cc2bd316-2e78-455c-a6dd-42328212b951\") " pod="openstack-kuttl-tests/keystone-bootstrap-v6zxd" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.335729 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cc2bd316-2e78-455c-a6dd-42328212b951-config-data\") pod \"keystone-bootstrap-v6zxd\" (UID: \"cc2bd316-2e78-455c-a6dd-42328212b951\") " pod="openstack-kuttl-tests/keystone-bootstrap-v6zxd" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.342951 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2aeaa955-5410-4726-9eb7-0b99cff87b61-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.361565 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cc2bd316-2e78-455c-a6dd-42328212b951-combined-ca-bundle\") pod \"keystone-bootstrap-v6zxd\" (UID: \"cc2bd316-2e78-455c-a6dd-42328212b951\") " pod="openstack-kuttl-tests/keystone-bootstrap-v6zxd" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.373531 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4769\" (UniqueName: \"kubernetes.io/projected/cc2bd316-2e78-455c-a6dd-42328212b951-kube-api-access-h4769\") pod \"keystone-bootstrap-v6zxd\" (UID: \"cc2bd316-2e78-455c-a6dd-42328212b951\") " pod="openstack-kuttl-tests/keystone-bootstrap-v6zxd" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.375577 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/cc2bd316-2e78-455c-a6dd-42328212b951-fernet-keys\") pod \"keystone-bootstrap-v6zxd\" (UID: \"cc2bd316-2e78-455c-a6dd-42328212b951\") " pod="openstack-kuttl-tests/keystone-bootstrap-v6zxd" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.376569 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/cc2bd316-2e78-455c-a6dd-42328212b951-credential-keys\") pod \"keystone-bootstrap-v6zxd\" (UID: \"cc2bd316-2e78-455c-a6dd-42328212b951\") " pod="openstack-kuttl-tests/keystone-bootstrap-v6zxd" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.398101 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/cc2bd316-2e78-455c-a6dd-42328212b951-scripts\") pod \"keystone-bootstrap-v6zxd\" (UID: \"cc2bd316-2e78-455c-a6dd-42328212b951\") " pod="openstack-kuttl-tests/keystone-bootstrap-v6zxd" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.413661 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-api-5975dccf9f-xrcl8"] Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.437030 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-5975dccf9f-xrcl8" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.439132 5120 status_manager.go:895] "Failed to get status for pod" podUID="408af245-438e-482c-ab14-fb2b7b947f8c" pod="openstack-kuttl-tests/keystone-bootstrap-tvpzx" err="pods \"keystone-bootstrap-tvpzx\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.440023 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-api-config-data\"" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.445966 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8789d77e-5501-4888-8248-254c4a42ffaf-config-data\") pod \"barbican-worker-574f947b6-n4thn\" (UID: \"8789d77e-5501-4888-8248-254c4a42ffaf\") " pod="openstack-kuttl-tests/barbican-worker-574f947b6-n4thn" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.446010 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8789d77e-5501-4888-8248-254c4a42ffaf-combined-ca-bundle\") pod \"barbican-worker-574f947b6-n4thn\" (UID: \"8789d77e-5501-4888-8248-254c4a42ffaf\") " pod="openstack-kuttl-tests/barbican-worker-574f947b6-n4thn" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.446033 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/482fd661-96ea-439b-8cd7-ee5a5321e981-logs\") pod \"barbican-keystone-listener-6f799fddf5-d8q8w\" (UID: \"482fd661-96ea-439b-8cd7-ee5a5321e981\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6f799fddf5-d8q8w" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.446058 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8789d77e-5501-4888-8248-254c4a42ffaf-logs\") pod \"barbican-worker-574f947b6-n4thn\" (UID: \"8789d77e-5501-4888-8248-254c4a42ffaf\") " pod="openstack-kuttl-tests/barbican-worker-574f947b6-n4thn" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.446158 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/482fd661-96ea-439b-8cd7-ee5a5321e981-config-data-custom\") pod \"barbican-keystone-listener-6f799fddf5-d8q8w\" (UID: \"482fd661-96ea-439b-8cd7-ee5a5321e981\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6f799fddf5-d8q8w" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.446184 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/482fd661-96ea-439b-8cd7-ee5a5321e981-combined-ca-bundle\") pod \"barbican-keystone-listener-6f799fddf5-d8q8w\" (UID: \"482fd661-96ea-439b-8cd7-ee5a5321e981\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6f799fddf5-d8q8w" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.446315 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdvzr\" (UniqueName: \"kubernetes.io/projected/8789d77e-5501-4888-8248-254c4a42ffaf-kube-api-access-tdvzr\") pod \"barbican-worker-574f947b6-n4thn\" (UID: \"8789d77e-5501-4888-8248-254c4a42ffaf\") " pod="openstack-kuttl-tests/barbican-worker-574f947b6-n4thn" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.446364 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/482fd661-96ea-439b-8cd7-ee5a5321e981-config-data\") pod \"barbican-keystone-listener-6f799fddf5-d8q8w\" (UID: \"482fd661-96ea-439b-8cd7-ee5a5321e981\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6f799fddf5-d8q8w" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.446383 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/8789d77e-5501-4888-8248-254c4a42ffaf-config-data-custom\") pod \"barbican-worker-574f947b6-n4thn\" (UID: \"8789d77e-5501-4888-8248-254c4a42ffaf\") " pod="openstack-kuttl-tests/barbican-worker-574f947b6-n4thn" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.446499 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzf97\" (UniqueName: \"kubernetes.io/projected/482fd661-96ea-439b-8cd7-ee5a5321e981-kube-api-access-rzf97\") pod \"barbican-keystone-listener-6f799fddf5-d8q8w\" (UID: \"482fd661-96ea-439b-8cd7-ee5a5321e981\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6f799fddf5-d8q8w" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.446938 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-5975dccf9f-xrcl8"] Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.453803 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2aeaa955-5410-4726-9eb7-0b99cff87b61-config-data" (OuterVolumeSpecName: "config-data") pod "2aeaa955-5410-4726-9eb7-0b99cff87b61" (UID: "2aeaa955-5410-4726-9eb7-0b99cff87b61"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.455950 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-v6zxd" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.486898 5120 scope.go:117] "RemoveContainer" containerID="c50fe560a0d30b1510a93acbf5114422de874b8bd5d471e63de4d2b192ed81b5" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.548303 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2613977e-8fa5-4c77-85b3-d9ee626e58bc-config-data\") pod \"barbican-api-5975dccf9f-xrcl8\" (UID: \"2613977e-8fa5-4c77-85b3-d9ee626e58bc\") " pod="openstack-kuttl-tests/barbican-api-5975dccf9f-xrcl8" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.548383 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rzf97\" (UniqueName: \"kubernetes.io/projected/482fd661-96ea-439b-8cd7-ee5a5321e981-kube-api-access-rzf97\") pod \"barbican-keystone-listener-6f799fddf5-d8q8w\" (UID: \"482fd661-96ea-439b-8cd7-ee5a5321e981\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6f799fddf5-d8q8w" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.548418 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8789d77e-5501-4888-8248-254c4a42ffaf-config-data\") pod \"barbican-worker-574f947b6-n4thn\" (UID: \"8789d77e-5501-4888-8248-254c4a42ffaf\") " pod="openstack-kuttl-tests/barbican-worker-574f947b6-n4thn" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.548447 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8789d77e-5501-4888-8248-254c4a42ffaf-combined-ca-bundle\") pod \"barbican-worker-574f947b6-n4thn\" (UID: \"8789d77e-5501-4888-8248-254c4a42ffaf\") " pod="openstack-kuttl-tests/barbican-worker-574f947b6-n4thn" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.548470 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/482fd661-96ea-439b-8cd7-ee5a5321e981-logs\") pod \"barbican-keystone-listener-6f799fddf5-d8q8w\" (UID: \"482fd661-96ea-439b-8cd7-ee5a5321e981\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6f799fddf5-d8q8w" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.548490 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2613977e-8fa5-4c77-85b3-d9ee626e58bc-logs\") pod \"barbican-api-5975dccf9f-xrcl8\" (UID: \"2613977e-8fa5-4c77-85b3-d9ee626e58bc\") " pod="openstack-kuttl-tests/barbican-api-5975dccf9f-xrcl8" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.548529 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8789d77e-5501-4888-8248-254c4a42ffaf-logs\") pod \"barbican-worker-574f947b6-n4thn\" (UID: \"8789d77e-5501-4888-8248-254c4a42ffaf\") " pod="openstack-kuttl-tests/barbican-worker-574f947b6-n4thn" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.548604 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/482fd661-96ea-439b-8cd7-ee5a5321e981-config-data-custom\") pod \"barbican-keystone-listener-6f799fddf5-d8q8w\" (UID: \"482fd661-96ea-439b-8cd7-ee5a5321e981\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6f799fddf5-d8q8w" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.548630 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/482fd661-96ea-439b-8cd7-ee5a5321e981-combined-ca-bundle\") pod \"barbican-keystone-listener-6f799fddf5-d8q8w\" (UID: \"482fd661-96ea-439b-8cd7-ee5a5321e981\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6f799fddf5-d8q8w" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.548713 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/2613977e-8fa5-4c77-85b3-d9ee626e58bc-config-data-custom\") pod \"barbican-api-5975dccf9f-xrcl8\" (UID: \"2613977e-8fa5-4c77-85b3-d9ee626e58bc\") " pod="openstack-kuttl-tests/barbican-api-5975dccf9f-xrcl8" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.548886 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2613977e-8fa5-4c77-85b3-d9ee626e58bc-combined-ca-bundle\") pod \"barbican-api-5975dccf9f-xrcl8\" (UID: \"2613977e-8fa5-4c77-85b3-d9ee626e58bc\") " pod="openstack-kuttl-tests/barbican-api-5975dccf9f-xrcl8" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.548917 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tdvzr\" (UniqueName: \"kubernetes.io/projected/8789d77e-5501-4888-8248-254c4a42ffaf-kube-api-access-tdvzr\") pod \"barbican-worker-574f947b6-n4thn\" (UID: \"8789d77e-5501-4888-8248-254c4a42ffaf\") " pod="openstack-kuttl-tests/barbican-worker-574f947b6-n4thn" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.548970 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/482fd661-96ea-439b-8cd7-ee5a5321e981-config-data\") pod \"barbican-keystone-listener-6f799fddf5-d8q8w\" (UID: \"482fd661-96ea-439b-8cd7-ee5a5321e981\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6f799fddf5-d8q8w" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.549001 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/8789d77e-5501-4888-8248-254c4a42ffaf-config-data-custom\") pod \"barbican-worker-574f947b6-n4thn\" (UID: \"8789d77e-5501-4888-8248-254c4a42ffaf\") " pod="openstack-kuttl-tests/barbican-worker-574f947b6-n4thn" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.549111 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-756r9\" (UniqueName: \"kubernetes.io/projected/2613977e-8fa5-4c77-85b3-d9ee626e58bc-kube-api-access-756r9\") pod \"barbican-api-5975dccf9f-xrcl8\" (UID: \"2613977e-8fa5-4c77-85b3-d9ee626e58bc\") " pod="openstack-kuttl-tests/barbican-api-5975dccf9f-xrcl8" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.549173 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2aeaa955-5410-4726-9eb7-0b99cff87b61-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.549584 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8789d77e-5501-4888-8248-254c4a42ffaf-logs\") pod \"barbican-worker-574f947b6-n4thn\" (UID: \"8789d77e-5501-4888-8248-254c4a42ffaf\") " pod="openstack-kuttl-tests/barbican-worker-574f947b6-n4thn" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.550347 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/482fd661-96ea-439b-8cd7-ee5a5321e981-logs\") pod \"barbican-keystone-listener-6f799fddf5-d8q8w\" (UID: \"482fd661-96ea-439b-8cd7-ee5a5321e981\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6f799fddf5-d8q8w" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.553718 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/482fd661-96ea-439b-8cd7-ee5a5321e981-config-data\") pod \"barbican-keystone-listener-6f799fddf5-d8q8w\" (UID: \"482fd661-96ea-439b-8cd7-ee5a5321e981\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6f799fddf5-d8q8w" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.557966 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/482fd661-96ea-439b-8cd7-ee5a5321e981-combined-ca-bundle\") pod \"barbican-keystone-listener-6f799fddf5-d8q8w\" (UID: \"482fd661-96ea-439b-8cd7-ee5a5321e981\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6f799fddf5-d8q8w" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.558500 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8789d77e-5501-4888-8248-254c4a42ffaf-combined-ca-bundle\") pod \"barbican-worker-574f947b6-n4thn\" (UID: \"8789d77e-5501-4888-8248-254c4a42ffaf\") " pod="openstack-kuttl-tests/barbican-worker-574f947b6-n4thn" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.559079 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/8789d77e-5501-4888-8248-254c4a42ffaf-config-data-custom\") pod \"barbican-worker-574f947b6-n4thn\" (UID: \"8789d77e-5501-4888-8248-254c4a42ffaf\") " pod="openstack-kuttl-tests/barbican-worker-574f947b6-n4thn" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.562282 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/482fd661-96ea-439b-8cd7-ee5a5321e981-config-data-custom\") pod \"barbican-keystone-listener-6f799fddf5-d8q8w\" (UID: \"482fd661-96ea-439b-8cd7-ee5a5321e981\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6f799fddf5-d8q8w" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.570359 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8789d77e-5501-4888-8248-254c4a42ffaf-config-data\") pod \"barbican-worker-574f947b6-n4thn\" (UID: \"8789d77e-5501-4888-8248-254c4a42ffaf\") " pod="openstack-kuttl-tests/barbican-worker-574f947b6-n4thn" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.575062 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdvzr\" (UniqueName: \"kubernetes.io/projected/8789d77e-5501-4888-8248-254c4a42ffaf-kube-api-access-tdvzr\") pod \"barbican-worker-574f947b6-n4thn\" (UID: \"8789d77e-5501-4888-8248-254c4a42ffaf\") " pod="openstack-kuttl-tests/barbican-worker-574f947b6-n4thn" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.578423 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzf97\" (UniqueName: \"kubernetes.io/projected/482fd661-96ea-439b-8cd7-ee5a5321e981-kube-api-access-rzf97\") pod \"barbican-keystone-listener-6f799fddf5-d8q8w\" (UID: \"482fd661-96ea-439b-8cd7-ee5a5321e981\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6f799fddf5-d8q8w" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.583435 5120 scope.go:117] "RemoveContainer" containerID="2d24f2d1aa7acd6d7147e38022246746c62910741a4d8ca55702b8661c99b3e7" Mar 16 16:32:40 crc kubenswrapper[5120]: E0316 16:32:40.585623 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d24f2d1aa7acd6d7147e38022246746c62910741a4d8ca55702b8661c99b3e7\": container with ID starting with 2d24f2d1aa7acd6d7147e38022246746c62910741a4d8ca55702b8661c99b3e7 not found: ID does not exist" containerID="2d24f2d1aa7acd6d7147e38022246746c62910741a4d8ca55702b8661c99b3e7" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.585669 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d24f2d1aa7acd6d7147e38022246746c62910741a4d8ca55702b8661c99b3e7"} err="failed to get container status \"2d24f2d1aa7acd6d7147e38022246746c62910741a4d8ca55702b8661c99b3e7\": rpc error: code = NotFound desc = could not find container \"2d24f2d1aa7acd6d7147e38022246746c62910741a4d8ca55702b8661c99b3e7\": container with ID starting with 2d24f2d1aa7acd6d7147e38022246746c62910741a4d8ca55702b8661c99b3e7 not found: ID does not exist" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.585695 5120 scope.go:117] "RemoveContainer" containerID="43a0cc1070f7fa54cf27a958a9d3094b0db1608bdebb7bb1e46d5a316f148013" Mar 16 16:32:40 crc kubenswrapper[5120]: E0316 16:32:40.587013 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"43a0cc1070f7fa54cf27a958a9d3094b0db1608bdebb7bb1e46d5a316f148013\": container with ID starting with 43a0cc1070f7fa54cf27a958a9d3094b0db1608bdebb7bb1e46d5a316f148013 not found: ID does not exist" containerID="43a0cc1070f7fa54cf27a958a9d3094b0db1608bdebb7bb1e46d5a316f148013" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.587055 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43a0cc1070f7fa54cf27a958a9d3094b0db1608bdebb7bb1e46d5a316f148013"} err="failed to get container status \"43a0cc1070f7fa54cf27a958a9d3094b0db1608bdebb7bb1e46d5a316f148013\": rpc error: code = NotFound desc = could not find container \"43a0cc1070f7fa54cf27a958a9d3094b0db1608bdebb7bb1e46d5a316f148013\": container with ID starting with 43a0cc1070f7fa54cf27a958a9d3094b0db1608bdebb7bb1e46d5a316f148013 not found: ID does not exist" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.587081 5120 scope.go:117] "RemoveContainer" containerID="ee5e8b2d7871e01f8a103964f89004f68a4cde75548df0a719ce99d0c2647aac" Mar 16 16:32:40 crc kubenswrapper[5120]: E0316 16:32:40.587659 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee5e8b2d7871e01f8a103964f89004f68a4cde75548df0a719ce99d0c2647aac\": container with ID starting with ee5e8b2d7871e01f8a103964f89004f68a4cde75548df0a719ce99d0c2647aac not found: ID does not exist" containerID="ee5e8b2d7871e01f8a103964f89004f68a4cde75548df0a719ce99d0c2647aac" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.587695 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee5e8b2d7871e01f8a103964f89004f68a4cde75548df0a719ce99d0c2647aac"} err="failed to get container status \"ee5e8b2d7871e01f8a103964f89004f68a4cde75548df0a719ce99d0c2647aac\": rpc error: code = NotFound desc = could not find container \"ee5e8b2d7871e01f8a103964f89004f68a4cde75548df0a719ce99d0c2647aac\": container with ID starting with ee5e8b2d7871e01f8a103964f89004f68a4cde75548df0a719ce99d0c2647aac not found: ID does not exist" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.587714 5120 scope.go:117] "RemoveContainer" containerID="c50fe560a0d30b1510a93acbf5114422de874b8bd5d471e63de4d2b192ed81b5" Mar 16 16:32:40 crc kubenswrapper[5120]: E0316 16:32:40.588037 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c50fe560a0d30b1510a93acbf5114422de874b8bd5d471e63de4d2b192ed81b5\": container with ID starting with c50fe560a0d30b1510a93acbf5114422de874b8bd5d471e63de4d2b192ed81b5 not found: ID does not exist" containerID="c50fe560a0d30b1510a93acbf5114422de874b8bd5d471e63de4d2b192ed81b5" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.588090 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c50fe560a0d30b1510a93acbf5114422de874b8bd5d471e63de4d2b192ed81b5"} err="failed to get container status \"c50fe560a0d30b1510a93acbf5114422de874b8bd5d471e63de4d2b192ed81b5\": rpc error: code = NotFound desc = could not find container \"c50fe560a0d30b1510a93acbf5114422de874b8bd5d471e63de4d2b192ed81b5\": container with ID starting with c50fe560a0d30b1510a93acbf5114422de874b8bd5d471e63de4d2b192ed81b5 not found: ID does not exist" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.588108 5120 scope.go:117] "RemoveContainer" containerID="2d24f2d1aa7acd6d7147e38022246746c62910741a4d8ca55702b8661c99b3e7" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.589342 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d24f2d1aa7acd6d7147e38022246746c62910741a4d8ca55702b8661c99b3e7"} err="failed to get container status \"2d24f2d1aa7acd6d7147e38022246746c62910741a4d8ca55702b8661c99b3e7\": rpc error: code = NotFound desc = could not find container \"2d24f2d1aa7acd6d7147e38022246746c62910741a4d8ca55702b8661c99b3e7\": container with ID starting with 2d24f2d1aa7acd6d7147e38022246746c62910741a4d8ca55702b8661c99b3e7 not found: ID does not exist" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.589378 5120 scope.go:117] "RemoveContainer" containerID="43a0cc1070f7fa54cf27a958a9d3094b0db1608bdebb7bb1e46d5a316f148013" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.589943 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43a0cc1070f7fa54cf27a958a9d3094b0db1608bdebb7bb1e46d5a316f148013"} err="failed to get container status \"43a0cc1070f7fa54cf27a958a9d3094b0db1608bdebb7bb1e46d5a316f148013\": rpc error: code = NotFound desc = could not find container \"43a0cc1070f7fa54cf27a958a9d3094b0db1608bdebb7bb1e46d5a316f148013\": container with ID starting with 43a0cc1070f7fa54cf27a958a9d3094b0db1608bdebb7bb1e46d5a316f148013 not found: ID does not exist" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.589994 5120 scope.go:117] "RemoveContainer" containerID="ee5e8b2d7871e01f8a103964f89004f68a4cde75548df0a719ce99d0c2647aac" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.590577 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee5e8b2d7871e01f8a103964f89004f68a4cde75548df0a719ce99d0c2647aac"} err="failed to get container status \"ee5e8b2d7871e01f8a103964f89004f68a4cde75548df0a719ce99d0c2647aac\": rpc error: code = NotFound desc = could not find container \"ee5e8b2d7871e01f8a103964f89004f68a4cde75548df0a719ce99d0c2647aac\": container with ID starting with ee5e8b2d7871e01f8a103964f89004f68a4cde75548df0a719ce99d0c2647aac not found: ID does not exist" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.590624 5120 scope.go:117] "RemoveContainer" containerID="c50fe560a0d30b1510a93acbf5114422de874b8bd5d471e63de4d2b192ed81b5" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.590998 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c50fe560a0d30b1510a93acbf5114422de874b8bd5d471e63de4d2b192ed81b5"} err="failed to get container status \"c50fe560a0d30b1510a93acbf5114422de874b8bd5d471e63de4d2b192ed81b5\": rpc error: code = NotFound desc = could not find container \"c50fe560a0d30b1510a93acbf5114422de874b8bd5d471e63de4d2b192ed81b5\": container with ID starting with c50fe560a0d30b1510a93acbf5114422de874b8bd5d471e63de4d2b192ed81b5 not found: ID does not exist" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.591023 5120 scope.go:117] "RemoveContainer" containerID="2d24f2d1aa7acd6d7147e38022246746c62910741a4d8ca55702b8661c99b3e7" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.591228 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d24f2d1aa7acd6d7147e38022246746c62910741a4d8ca55702b8661c99b3e7"} err="failed to get container status \"2d24f2d1aa7acd6d7147e38022246746c62910741a4d8ca55702b8661c99b3e7\": rpc error: code = NotFound desc = could not find container \"2d24f2d1aa7acd6d7147e38022246746c62910741a4d8ca55702b8661c99b3e7\": container with ID starting with 2d24f2d1aa7acd6d7147e38022246746c62910741a4d8ca55702b8661c99b3e7 not found: ID does not exist" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.591260 5120 scope.go:117] "RemoveContainer" containerID="43a0cc1070f7fa54cf27a958a9d3094b0db1608bdebb7bb1e46d5a316f148013" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.591619 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43a0cc1070f7fa54cf27a958a9d3094b0db1608bdebb7bb1e46d5a316f148013"} err="failed to get container status \"43a0cc1070f7fa54cf27a958a9d3094b0db1608bdebb7bb1e46d5a316f148013\": rpc error: code = NotFound desc = could not find container \"43a0cc1070f7fa54cf27a958a9d3094b0db1608bdebb7bb1e46d5a316f148013\": container with ID starting with 43a0cc1070f7fa54cf27a958a9d3094b0db1608bdebb7bb1e46d5a316f148013 not found: ID does not exist" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.591647 5120 scope.go:117] "RemoveContainer" containerID="ee5e8b2d7871e01f8a103964f89004f68a4cde75548df0a719ce99d0c2647aac" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.591911 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee5e8b2d7871e01f8a103964f89004f68a4cde75548df0a719ce99d0c2647aac"} err="failed to get container status \"ee5e8b2d7871e01f8a103964f89004f68a4cde75548df0a719ce99d0c2647aac\": rpc error: code = NotFound desc = could not find container \"ee5e8b2d7871e01f8a103964f89004f68a4cde75548df0a719ce99d0c2647aac\": container with ID starting with ee5e8b2d7871e01f8a103964f89004f68a4cde75548df0a719ce99d0c2647aac not found: ID does not exist" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.591933 5120 scope.go:117] "RemoveContainer" containerID="c50fe560a0d30b1510a93acbf5114422de874b8bd5d471e63de4d2b192ed81b5" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.592127 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c50fe560a0d30b1510a93acbf5114422de874b8bd5d471e63de4d2b192ed81b5"} err="failed to get container status \"c50fe560a0d30b1510a93acbf5114422de874b8bd5d471e63de4d2b192ed81b5\": rpc error: code = NotFound desc = could not find container \"c50fe560a0d30b1510a93acbf5114422de874b8bd5d471e63de4d2b192ed81b5\": container with ID starting with c50fe560a0d30b1510a93acbf5114422de874b8bd5d471e63de4d2b192ed81b5 not found: ID does not exist" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.592150 5120 scope.go:117] "RemoveContainer" containerID="2d24f2d1aa7acd6d7147e38022246746c62910741a4d8ca55702b8661c99b3e7" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.593234 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d24f2d1aa7acd6d7147e38022246746c62910741a4d8ca55702b8661c99b3e7"} err="failed to get container status \"2d24f2d1aa7acd6d7147e38022246746c62910741a4d8ca55702b8661c99b3e7\": rpc error: code = NotFound desc = could not find container \"2d24f2d1aa7acd6d7147e38022246746c62910741a4d8ca55702b8661c99b3e7\": container with ID starting with 2d24f2d1aa7acd6d7147e38022246746c62910741a4d8ca55702b8661c99b3e7 not found: ID does not exist" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.593263 5120 scope.go:117] "RemoveContainer" containerID="43a0cc1070f7fa54cf27a958a9d3094b0db1608bdebb7bb1e46d5a316f148013" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.593547 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43a0cc1070f7fa54cf27a958a9d3094b0db1608bdebb7bb1e46d5a316f148013"} err="failed to get container status \"43a0cc1070f7fa54cf27a958a9d3094b0db1608bdebb7bb1e46d5a316f148013\": rpc error: code = NotFound desc = could not find container \"43a0cc1070f7fa54cf27a958a9d3094b0db1608bdebb7bb1e46d5a316f148013\": container with ID starting with 43a0cc1070f7fa54cf27a958a9d3094b0db1608bdebb7bb1e46d5a316f148013 not found: ID does not exist" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.593573 5120 scope.go:117] "RemoveContainer" containerID="ee5e8b2d7871e01f8a103964f89004f68a4cde75548df0a719ce99d0c2647aac" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.593836 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee5e8b2d7871e01f8a103964f89004f68a4cde75548df0a719ce99d0c2647aac"} err="failed to get container status \"ee5e8b2d7871e01f8a103964f89004f68a4cde75548df0a719ce99d0c2647aac\": rpc error: code = NotFound desc = could not find container \"ee5e8b2d7871e01f8a103964f89004f68a4cde75548df0a719ce99d0c2647aac\": container with ID starting with ee5e8b2d7871e01f8a103964f89004f68a4cde75548df0a719ce99d0c2647aac not found: ID does not exist" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.593874 5120 scope.go:117] "RemoveContainer" containerID="c50fe560a0d30b1510a93acbf5114422de874b8bd5d471e63de4d2b192ed81b5" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.594264 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c50fe560a0d30b1510a93acbf5114422de874b8bd5d471e63de4d2b192ed81b5"} err="failed to get container status \"c50fe560a0d30b1510a93acbf5114422de874b8bd5d471e63de4d2b192ed81b5\": rpc error: code = NotFound desc = could not find container \"c50fe560a0d30b1510a93acbf5114422de874b8bd5d471e63de4d2b192ed81b5\": container with ID starting with c50fe560a0d30b1510a93acbf5114422de874b8bd5d471e63de4d2b192ed81b5 not found: ID does not exist" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.614356 5120 status_manager.go:895] "Failed to get status for pod" podUID="408af245-438e-482c-ab14-fb2b7b947f8c" pod="openstack-kuttl-tests/keystone-bootstrap-tvpzx" err="pods \"keystone-bootstrap-tvpzx\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.642651 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.661965 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/2613977e-8fa5-4c77-85b3-d9ee626e58bc-config-data-custom\") pod \"barbican-api-5975dccf9f-xrcl8\" (UID: \"2613977e-8fa5-4c77-85b3-d9ee626e58bc\") " pod="openstack-kuttl-tests/barbican-api-5975dccf9f-xrcl8" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.662123 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2613977e-8fa5-4c77-85b3-d9ee626e58bc-combined-ca-bundle\") pod \"barbican-api-5975dccf9f-xrcl8\" (UID: \"2613977e-8fa5-4c77-85b3-d9ee626e58bc\") " pod="openstack-kuttl-tests/barbican-api-5975dccf9f-xrcl8" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.662300 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-756r9\" (UniqueName: \"kubernetes.io/projected/2613977e-8fa5-4c77-85b3-d9ee626e58bc-kube-api-access-756r9\") pod \"barbican-api-5975dccf9f-xrcl8\" (UID: \"2613977e-8fa5-4c77-85b3-d9ee626e58bc\") " pod="openstack-kuttl-tests/barbican-api-5975dccf9f-xrcl8" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.662337 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2613977e-8fa5-4c77-85b3-d9ee626e58bc-config-data\") pod \"barbican-api-5975dccf9f-xrcl8\" (UID: \"2613977e-8fa5-4c77-85b3-d9ee626e58bc\") " pod="openstack-kuttl-tests/barbican-api-5975dccf9f-xrcl8" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.662455 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2613977e-8fa5-4c77-85b3-d9ee626e58bc-logs\") pod \"barbican-api-5975dccf9f-xrcl8\" (UID: \"2613977e-8fa5-4c77-85b3-d9ee626e58bc\") " pod="openstack-kuttl-tests/barbican-api-5975dccf9f-xrcl8" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.664349 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.664416 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2613977e-8fa5-4c77-85b3-d9ee626e58bc-logs\") pod \"barbican-api-5975dccf9f-xrcl8\" (UID: \"2613977e-8fa5-4c77-85b3-d9ee626e58bc\") " pod="openstack-kuttl-tests/barbican-api-5975dccf9f-xrcl8" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.675888 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/2613977e-8fa5-4c77-85b3-d9ee626e58bc-config-data-custom\") pod \"barbican-api-5975dccf9f-xrcl8\" (UID: \"2613977e-8fa5-4c77-85b3-d9ee626e58bc\") " pod="openstack-kuttl-tests/barbican-api-5975dccf9f-xrcl8" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.685558 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2613977e-8fa5-4c77-85b3-d9ee626e58bc-combined-ca-bundle\") pod \"barbican-api-5975dccf9f-xrcl8\" (UID: \"2613977e-8fa5-4c77-85b3-d9ee626e58bc\") " pod="openstack-kuttl-tests/barbican-api-5975dccf9f-xrcl8" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.685750 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2613977e-8fa5-4c77-85b3-d9ee626e58bc-config-data\") pod \"barbican-api-5975dccf9f-xrcl8\" (UID: \"2613977e-8fa5-4c77-85b3-d9ee626e58bc\") " pod="openstack-kuttl-tests/barbican-api-5975dccf9f-xrcl8" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.687644 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-756r9\" (UniqueName: \"kubernetes.io/projected/2613977e-8fa5-4c77-85b3-d9ee626e58bc-kube-api-access-756r9\") pod \"barbican-api-5975dccf9f-xrcl8\" (UID: \"2613977e-8fa5-4c77-85b3-d9ee626e58bc\") " pod="openstack-kuttl-tests/barbican-api-5975dccf9f-xrcl8" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.692449 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2aeaa955-5410-4726-9eb7-0b99cff87b61" path="/var/lib/kubelet/pods/2aeaa955-5410-4726-9eb7-0b99cff87b61/volumes" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.693349 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="408af245-438e-482c-ab14-fb2b7b947f8c" path="/var/lib/kubelet/pods/408af245-438e-482c-ab14-fb2b7b947f8c/volumes" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.704116 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.725430 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.725670 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.731668 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.731863 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.763650 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f563b41f-83a2-4093-b167-d4e4a335986a-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"f563b41f-83a2-4093-b167-d4e4a335986a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.763825 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f563b41f-83a2-4093-b167-d4e4a335986a-run-httpd\") pod \"ceilometer-0\" (UID: \"f563b41f-83a2-4093-b167-d4e4a335986a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.763894 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f563b41f-83a2-4093-b167-d4e4a335986a-config-data\") pod \"ceilometer-0\" (UID: \"f563b41f-83a2-4093-b167-d4e4a335986a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.764047 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pfxt7\" (UniqueName: \"kubernetes.io/projected/f563b41f-83a2-4093-b167-d4e4a335986a-kube-api-access-pfxt7\") pod \"ceilometer-0\" (UID: \"f563b41f-83a2-4093-b167-d4e4a335986a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.764097 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/f563b41f-83a2-4093-b167-d4e4a335986a-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"f563b41f-83a2-4093-b167-d4e4a335986a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.764143 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f563b41f-83a2-4093-b167-d4e4a335986a-log-httpd\") pod \"ceilometer-0\" (UID: \"f563b41f-83a2-4093-b167-d4e4a335986a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.764166 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f563b41f-83a2-4093-b167-d4e4a335986a-scripts\") pod \"ceilometer-0\" (UID: \"f563b41f-83a2-4093-b167-d4e4a335986a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.770887 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-574f947b6-n4thn" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.791072 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-6f799fddf5-d8q8w" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.796393 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-5975dccf9f-xrcl8" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.867311 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f563b41f-83a2-4093-b167-d4e4a335986a-run-httpd\") pod \"ceilometer-0\" (UID: \"f563b41f-83a2-4093-b167-d4e4a335986a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.867386 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f563b41f-83a2-4093-b167-d4e4a335986a-config-data\") pod \"ceilometer-0\" (UID: \"f563b41f-83a2-4093-b167-d4e4a335986a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.867470 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pfxt7\" (UniqueName: \"kubernetes.io/projected/f563b41f-83a2-4093-b167-d4e4a335986a-kube-api-access-pfxt7\") pod \"ceilometer-0\" (UID: \"f563b41f-83a2-4093-b167-d4e4a335986a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.867542 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/f563b41f-83a2-4093-b167-d4e4a335986a-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"f563b41f-83a2-4093-b167-d4e4a335986a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.867609 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f563b41f-83a2-4093-b167-d4e4a335986a-log-httpd\") pod \"ceilometer-0\" (UID: \"f563b41f-83a2-4093-b167-d4e4a335986a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.867640 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f563b41f-83a2-4093-b167-d4e4a335986a-scripts\") pod \"ceilometer-0\" (UID: \"f563b41f-83a2-4093-b167-d4e4a335986a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.867777 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f563b41f-83a2-4093-b167-d4e4a335986a-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"f563b41f-83a2-4093-b167-d4e4a335986a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.870052 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f563b41f-83a2-4093-b167-d4e4a335986a-log-httpd\") pod \"ceilometer-0\" (UID: \"f563b41f-83a2-4093-b167-d4e4a335986a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.872042 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f563b41f-83a2-4093-b167-d4e4a335986a-run-httpd\") pod \"ceilometer-0\" (UID: \"f563b41f-83a2-4093-b167-d4e4a335986a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.874060 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f563b41f-83a2-4093-b167-d4e4a335986a-config-data\") pod \"ceilometer-0\" (UID: \"f563b41f-83a2-4093-b167-d4e4a335986a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.877601 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f563b41f-83a2-4093-b167-d4e4a335986a-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"f563b41f-83a2-4093-b167-d4e4a335986a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.879638 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f563b41f-83a2-4093-b167-d4e4a335986a-scripts\") pod \"ceilometer-0\" (UID: \"f563b41f-83a2-4093-b167-d4e4a335986a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.886488 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/f563b41f-83a2-4093-b167-d4e4a335986a-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"f563b41f-83a2-4093-b167-d4e4a335986a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:32:40 crc kubenswrapper[5120]: I0316 16:32:40.891385 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pfxt7\" (UniqueName: \"kubernetes.io/projected/f563b41f-83a2-4093-b167-d4e4a335986a-kube-api-access-pfxt7\") pod \"ceilometer-0\" (UID: \"f563b41f-83a2-4093-b167-d4e4a335986a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:32:41 crc kubenswrapper[5120]: I0316 16:32:41.062674 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:32:41 crc kubenswrapper[5120]: I0316 16:32:41.132547 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"66747957-79a6-4233-93a5-be994ddc995f","Type":"ContainerStarted","Data":"2f5cb2d85d3d7ce59d3c6313e0cfc9d1017f7d619e472d48c96c845d78895d5a"} Mar 16 16:32:41 crc kubenswrapper[5120]: I0316 16:32:41.165536 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-v6zxd"] Mar 16 16:32:41 crc kubenswrapper[5120]: I0316 16:32:41.179511 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-d47d8c655-p8r55" event={"ID":"716a6317-5231-4c6a-8728-7162c24ff8fb","Type":"ContainerStarted","Data":"f219d9d7fd258e4a5b604f8b479078504b8ca4ef1f05e09bb3c47fef2b35364c"} Mar 16 16:32:41 crc kubenswrapper[5120]: I0316 16:32:41.179558 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-d47d8c655-p8r55" event={"ID":"716a6317-5231-4c6a-8728-7162c24ff8fb","Type":"ContainerStarted","Data":"4c5a780d227188c28469de37acf2a604949c11617a4eb81e214e3e9b80ac6f17"} Mar 16 16:32:41 crc kubenswrapper[5120]: I0316 16:32:41.186731 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"e0796e9e-184f-47cc-b5b7-5c06434a59a6","Type":"ContainerStarted","Data":"e51b5d7a1b22fbe662527e006b5f92746058cd54fdd5f8dd5fc011441296b073"} Mar 16 16:32:41 crc kubenswrapper[5120]: I0316 16:32:41.409066 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-574f947b6-n4thn"] Mar 16 16:32:41 crc kubenswrapper[5120]: I0316 16:32:41.578899 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-6f799fddf5-d8q8w"] Mar 16 16:32:41 crc kubenswrapper[5120]: I0316 16:32:41.713427 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-5975dccf9f-xrcl8"] Mar 16 16:32:41 crc kubenswrapper[5120]: I0316 16:32:41.883024 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:32:42 crc kubenswrapper[5120]: I0316 16:32:42.204175 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"f563b41f-83a2-4093-b167-d4e4a335986a","Type":"ContainerStarted","Data":"98fe037e715e8bffd7d2b357ef712fa6fa70affcb7ddb16ba8eaf50dbbbe2c98"} Mar 16 16:32:42 crc kubenswrapper[5120]: I0316 16:32:42.208383 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-574f947b6-n4thn" event={"ID":"8789d77e-5501-4888-8248-254c4a42ffaf","Type":"ContainerStarted","Data":"28edc047bab9b6544e6d431f3f9c09c48dc40a55e926542d02fc4de947b72903"} Mar 16 16:32:42 crc kubenswrapper[5120]: I0316 16:32:42.208428 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-574f947b6-n4thn" event={"ID":"8789d77e-5501-4888-8248-254c4a42ffaf","Type":"ContainerStarted","Data":"49acae90ca3cde0ea58ce3f2c7682650f88c16a67f8ea1c0e1840c8e6c1a8750"} Mar 16 16:32:42 crc kubenswrapper[5120]: I0316 16:32:42.208440 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-574f947b6-n4thn" event={"ID":"8789d77e-5501-4888-8248-254c4a42ffaf","Type":"ContainerStarted","Data":"209ab22e3e956f77411e4ca38b5bf749429b5f347685e175e89d9855ed22290a"} Mar 16 16:32:42 crc kubenswrapper[5120]: I0316 16:32:42.211020 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"e0796e9e-184f-47cc-b5b7-5c06434a59a6","Type":"ContainerStarted","Data":"e08499fa0045d74d6308fba6c5956ff25d0913010b386b67319bd167e2fc0938"} Mar 16 16:32:42 crc kubenswrapper[5120]: I0316 16:32:42.213166 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-6f799fddf5-d8q8w" event={"ID":"482fd661-96ea-439b-8cd7-ee5a5321e981","Type":"ContainerStarted","Data":"b65a7138052afabe4d51fce29c540230c6c50c956a3a538bb146359fda5c781a"} Mar 16 16:32:42 crc kubenswrapper[5120]: I0316 16:32:42.213215 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-6f799fddf5-d8q8w" event={"ID":"482fd661-96ea-439b-8cd7-ee5a5321e981","Type":"ContainerStarted","Data":"296d6bcfaa5bf0d87c8e51368ec27c05edb44b2f923967694aa0ecab78e54070"} Mar 16 16:32:42 crc kubenswrapper[5120]: I0316 16:32:42.213229 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-6f799fddf5-d8q8w" event={"ID":"482fd661-96ea-439b-8cd7-ee5a5321e981","Type":"ContainerStarted","Data":"edccfac66cbb28d724f2ae455350372ee6cf4aba5ae9c3f806e411658910bff3"} Mar 16 16:32:42 crc kubenswrapper[5120]: I0316 16:32:42.217358 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-5975dccf9f-xrcl8" event={"ID":"2613977e-8fa5-4c77-85b3-d9ee626e58bc","Type":"ContainerStarted","Data":"ea7a1e07ead684d8ab119f44156093afc27c47f0e08e921bc2307c0294baf9eb"} Mar 16 16:32:42 crc kubenswrapper[5120]: I0316 16:32:42.217463 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-5975dccf9f-xrcl8" Mar 16 16:32:42 crc kubenswrapper[5120]: I0316 16:32:42.217501 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-5975dccf9f-xrcl8" Mar 16 16:32:42 crc kubenswrapper[5120]: I0316 16:32:42.217513 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-5975dccf9f-xrcl8" event={"ID":"2613977e-8fa5-4c77-85b3-d9ee626e58bc","Type":"ContainerStarted","Data":"4dd0233715164898c2755653545b23422f02ff3fdc2610f410c5f0603b8ec5f8"} Mar 16 16:32:42 crc kubenswrapper[5120]: I0316 16:32:42.217533 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-5975dccf9f-xrcl8" event={"ID":"2613977e-8fa5-4c77-85b3-d9ee626e58bc","Type":"ContainerStarted","Data":"e1f5bc2140c624160eb033aa42303f1f31513b1f04b4adbd8f74b99c72e1649e"} Mar 16 16:32:42 crc kubenswrapper[5120]: I0316 16:32:42.223086 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"66747957-79a6-4233-93a5-be994ddc995f","Type":"ContainerStarted","Data":"912bd3364ca361d86430ef689160af954803620513e903e6bfbe209134858c72"} Mar 16 16:32:42 crc kubenswrapper[5120]: I0316 16:32:42.227025 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-d47d8c655-p8r55" event={"ID":"716a6317-5231-4c6a-8728-7162c24ff8fb","Type":"ContainerStarted","Data":"b5f73bc2fcc71694ac4ec71e57ce1500caeee856064147ad378ad48a3951a8d1"} Mar 16 16:32:42 crc kubenswrapper[5120]: I0316 16:32:42.227338 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-d47d8c655-p8r55" Mar 16 16:32:42 crc kubenswrapper[5120]: I0316 16:32:42.227358 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-d47d8c655-p8r55" Mar 16 16:32:42 crc kubenswrapper[5120]: I0316 16:32:42.229452 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-v6zxd" event={"ID":"cc2bd316-2e78-455c-a6dd-42328212b951","Type":"ContainerStarted","Data":"5e086b84acb9eb1dded1cd232e9ece3bd6c8f4f2b1365e0ecd334ec230fd3a55"} Mar 16 16:32:42 crc kubenswrapper[5120]: I0316 16:32:42.229495 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-v6zxd" event={"ID":"cc2bd316-2e78-455c-a6dd-42328212b951","Type":"ContainerStarted","Data":"bb93bcb9e5c229bd37ef589e8687702f0814631b997c12ec248152fb320251a3"} Mar 16 16:32:42 crc kubenswrapper[5120]: I0316 16:32:42.239013 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-worker-574f947b6-n4thn" podStartSLOduration=2.238982257 podStartE2EDuration="2.238982257s" podCreationTimestamp="2026-03-16 16:32:40 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:32:42.227804475 +0000 UTC m=+3664.381736132" watchObservedRunningTime="2026-03-16 16:32:42.238982257 +0000 UTC m=+3664.392913924" Mar 16 16:32:42 crc kubenswrapper[5120]: I0316 16:32:42.261512 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-internal-api-0" podStartSLOduration=5.2614907859999995 podStartE2EDuration="5.261490786s" podCreationTimestamp="2026-03-16 16:32:37 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:32:42.253340283 +0000 UTC m=+3664.407271940" watchObservedRunningTime="2026-03-16 16:32:42.261490786 +0000 UTC m=+3664.415422443" Mar 16 16:32:42 crc kubenswrapper[5120]: I0316 16:32:42.294247 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-keystone-listener-6f799fddf5-d8q8w" podStartSLOduration=2.294226512 podStartE2EDuration="2.294226512s" podCreationTimestamp="2026-03-16 16:32:40 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:32:42.283908143 +0000 UTC m=+3664.437839800" watchObservedRunningTime="2026-03-16 16:32:42.294226512 +0000 UTC m=+3664.448158169" Mar 16 16:32:42 crc kubenswrapper[5120]: I0316 16:32:42.315788 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-api-5975dccf9f-xrcl8" podStartSLOduration=2.315748286 podStartE2EDuration="2.315748286s" podCreationTimestamp="2026-03-16 16:32:40 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:32:42.310778255 +0000 UTC m=+3664.464709912" watchObservedRunningTime="2026-03-16 16:32:42.315748286 +0000 UTC m=+3664.469679943" Mar 16 16:32:42 crc kubenswrapper[5120]: I0316 16:32:42.343246 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-d47d8c655-p8r55" podStartSLOduration=3.343227354 podStartE2EDuration="3.343227354s" podCreationTimestamp="2026-03-16 16:32:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:32:42.331654032 +0000 UTC m=+3664.485585699" watchObservedRunningTime="2026-03-16 16:32:42.343227354 +0000 UTC m=+3664.497159011" Mar 16 16:32:42 crc kubenswrapper[5120]: I0316 16:32:42.357455 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-external-api-0" podStartSLOduration=4.357432096 podStartE2EDuration="4.357432096s" podCreationTimestamp="2026-03-16 16:32:38 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:32:42.352710553 +0000 UTC m=+3664.506642220" watchObservedRunningTime="2026-03-16 16:32:42.357432096 +0000 UTC m=+3664.511363753" Mar 16 16:32:42 crc kubenswrapper[5120]: I0316 16:32:42.374544 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-bootstrap-v6zxd" podStartSLOduration=2.374527374 podStartE2EDuration="2.374527374s" podCreationTimestamp="2026-03-16 16:32:40 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:32:42.367707915 +0000 UTC m=+3664.521639572" watchObservedRunningTime="2026-03-16 16:32:42.374527374 +0000 UTC m=+3664.528459031" Mar 16 16:32:42 crc kubenswrapper[5120]: I0316 16:32:42.863681 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-api-558fbfdd47-v976s"] Mar 16 16:32:42 crc kubenswrapper[5120]: I0316 16:32:42.876862 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-558fbfdd47-v976s"] Mar 16 16:32:42 crc kubenswrapper[5120]: I0316 16:32:42.877061 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-558fbfdd47-v976s" Mar 16 16:32:42 crc kubenswrapper[5120]: I0316 16:32:42.883010 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-barbican-internal-svc\"" Mar 16 16:32:42 crc kubenswrapper[5120]: I0316 16:32:42.883184 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-barbican-public-svc\"" Mar 16 16:32:42 crc kubenswrapper[5120]: I0316 16:32:42.945453 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9a15bc36-5f09-421b-a175-df44f218f875-combined-ca-bundle\") pod \"barbican-api-558fbfdd47-v976s\" (UID: \"9a15bc36-5f09-421b-a175-df44f218f875\") " pod="openstack-kuttl-tests/barbican-api-558fbfdd47-v976s" Mar 16 16:32:42 crc kubenswrapper[5120]: I0316 16:32:42.945554 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9a15bc36-5f09-421b-a175-df44f218f875-config-data\") pod \"barbican-api-558fbfdd47-v976s\" (UID: \"9a15bc36-5f09-421b-a175-df44f218f875\") " pod="openstack-kuttl-tests/barbican-api-558fbfdd47-v976s" Mar 16 16:32:42 crc kubenswrapper[5120]: I0316 16:32:42.945664 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvbm7\" (UniqueName: \"kubernetes.io/projected/9a15bc36-5f09-421b-a175-df44f218f875-kube-api-access-wvbm7\") pod \"barbican-api-558fbfdd47-v976s\" (UID: \"9a15bc36-5f09-421b-a175-df44f218f875\") " pod="openstack-kuttl-tests/barbican-api-558fbfdd47-v976s" Mar 16 16:32:42 crc kubenswrapper[5120]: I0316 16:32:42.945699 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9a15bc36-5f09-421b-a175-df44f218f875-logs\") pod \"barbican-api-558fbfdd47-v976s\" (UID: \"9a15bc36-5f09-421b-a175-df44f218f875\") " pod="openstack-kuttl-tests/barbican-api-558fbfdd47-v976s" Mar 16 16:32:42 crc kubenswrapper[5120]: I0316 16:32:42.946230 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/9a15bc36-5f09-421b-a175-df44f218f875-internal-tls-certs\") pod \"barbican-api-558fbfdd47-v976s\" (UID: \"9a15bc36-5f09-421b-a175-df44f218f875\") " pod="openstack-kuttl-tests/barbican-api-558fbfdd47-v976s" Mar 16 16:32:42 crc kubenswrapper[5120]: I0316 16:32:42.946357 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/9a15bc36-5f09-421b-a175-df44f218f875-config-data-custom\") pod \"barbican-api-558fbfdd47-v976s\" (UID: \"9a15bc36-5f09-421b-a175-df44f218f875\") " pod="openstack-kuttl-tests/barbican-api-558fbfdd47-v976s" Mar 16 16:32:42 crc kubenswrapper[5120]: I0316 16:32:42.946428 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/9a15bc36-5f09-421b-a175-df44f218f875-public-tls-certs\") pod \"barbican-api-558fbfdd47-v976s\" (UID: \"9a15bc36-5f09-421b-a175-df44f218f875\") " pod="openstack-kuttl-tests/barbican-api-558fbfdd47-v976s" Mar 16 16:32:43 crc kubenswrapper[5120]: I0316 16:32:43.047990 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9a15bc36-5f09-421b-a175-df44f218f875-logs\") pod \"barbican-api-558fbfdd47-v976s\" (UID: \"9a15bc36-5f09-421b-a175-df44f218f875\") " pod="openstack-kuttl-tests/barbican-api-558fbfdd47-v976s" Mar 16 16:32:43 crc kubenswrapper[5120]: I0316 16:32:43.048165 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/9a15bc36-5f09-421b-a175-df44f218f875-internal-tls-certs\") pod \"barbican-api-558fbfdd47-v976s\" (UID: \"9a15bc36-5f09-421b-a175-df44f218f875\") " pod="openstack-kuttl-tests/barbican-api-558fbfdd47-v976s" Mar 16 16:32:43 crc kubenswrapper[5120]: I0316 16:32:43.048220 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/9a15bc36-5f09-421b-a175-df44f218f875-config-data-custom\") pod \"barbican-api-558fbfdd47-v976s\" (UID: \"9a15bc36-5f09-421b-a175-df44f218f875\") " pod="openstack-kuttl-tests/barbican-api-558fbfdd47-v976s" Mar 16 16:32:43 crc kubenswrapper[5120]: I0316 16:32:43.048597 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/9a15bc36-5f09-421b-a175-df44f218f875-public-tls-certs\") pod \"barbican-api-558fbfdd47-v976s\" (UID: \"9a15bc36-5f09-421b-a175-df44f218f875\") " pod="openstack-kuttl-tests/barbican-api-558fbfdd47-v976s" Mar 16 16:32:43 crc kubenswrapper[5120]: I0316 16:32:43.048647 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9a15bc36-5f09-421b-a175-df44f218f875-logs\") pod \"barbican-api-558fbfdd47-v976s\" (UID: \"9a15bc36-5f09-421b-a175-df44f218f875\") " pod="openstack-kuttl-tests/barbican-api-558fbfdd47-v976s" Mar 16 16:32:43 crc kubenswrapper[5120]: I0316 16:32:43.048893 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9a15bc36-5f09-421b-a175-df44f218f875-combined-ca-bundle\") pod \"barbican-api-558fbfdd47-v976s\" (UID: \"9a15bc36-5f09-421b-a175-df44f218f875\") " pod="openstack-kuttl-tests/barbican-api-558fbfdd47-v976s" Mar 16 16:32:43 crc kubenswrapper[5120]: I0316 16:32:43.048934 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9a15bc36-5f09-421b-a175-df44f218f875-config-data\") pod \"barbican-api-558fbfdd47-v976s\" (UID: \"9a15bc36-5f09-421b-a175-df44f218f875\") " pod="openstack-kuttl-tests/barbican-api-558fbfdd47-v976s" Mar 16 16:32:43 crc kubenswrapper[5120]: I0316 16:32:43.049085 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wvbm7\" (UniqueName: \"kubernetes.io/projected/9a15bc36-5f09-421b-a175-df44f218f875-kube-api-access-wvbm7\") pod \"barbican-api-558fbfdd47-v976s\" (UID: \"9a15bc36-5f09-421b-a175-df44f218f875\") " pod="openstack-kuttl-tests/barbican-api-558fbfdd47-v976s" Mar 16 16:32:43 crc kubenswrapper[5120]: I0316 16:32:43.054845 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/9a15bc36-5f09-421b-a175-df44f218f875-public-tls-certs\") pod \"barbican-api-558fbfdd47-v976s\" (UID: \"9a15bc36-5f09-421b-a175-df44f218f875\") " pod="openstack-kuttl-tests/barbican-api-558fbfdd47-v976s" Mar 16 16:32:43 crc kubenswrapper[5120]: I0316 16:32:43.054957 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9a15bc36-5f09-421b-a175-df44f218f875-combined-ca-bundle\") pod \"barbican-api-558fbfdd47-v976s\" (UID: \"9a15bc36-5f09-421b-a175-df44f218f875\") " pod="openstack-kuttl-tests/barbican-api-558fbfdd47-v976s" Mar 16 16:32:43 crc kubenswrapper[5120]: I0316 16:32:43.055461 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9a15bc36-5f09-421b-a175-df44f218f875-config-data\") pod \"barbican-api-558fbfdd47-v976s\" (UID: \"9a15bc36-5f09-421b-a175-df44f218f875\") " pod="openstack-kuttl-tests/barbican-api-558fbfdd47-v976s" Mar 16 16:32:43 crc kubenswrapper[5120]: I0316 16:32:43.055979 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/9a15bc36-5f09-421b-a175-df44f218f875-config-data-custom\") pod \"barbican-api-558fbfdd47-v976s\" (UID: \"9a15bc36-5f09-421b-a175-df44f218f875\") " pod="openstack-kuttl-tests/barbican-api-558fbfdd47-v976s" Mar 16 16:32:43 crc kubenswrapper[5120]: I0316 16:32:43.065337 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/9a15bc36-5f09-421b-a175-df44f218f875-internal-tls-certs\") pod \"barbican-api-558fbfdd47-v976s\" (UID: \"9a15bc36-5f09-421b-a175-df44f218f875\") " pod="openstack-kuttl-tests/barbican-api-558fbfdd47-v976s" Mar 16 16:32:43 crc kubenswrapper[5120]: I0316 16:32:43.079349 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvbm7\" (UniqueName: \"kubernetes.io/projected/9a15bc36-5f09-421b-a175-df44f218f875-kube-api-access-wvbm7\") pod \"barbican-api-558fbfdd47-v976s\" (UID: \"9a15bc36-5f09-421b-a175-df44f218f875\") " pod="openstack-kuttl-tests/barbican-api-558fbfdd47-v976s" Mar 16 16:32:43 crc kubenswrapper[5120]: I0316 16:32:43.208862 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-558fbfdd47-v976s" Mar 16 16:32:43 crc kubenswrapper[5120]: I0316 16:32:43.246522 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"f563b41f-83a2-4093-b167-d4e4a335986a","Type":"ContainerStarted","Data":"090a552e77af505fb9117d3156af00921a13ceede2f199b297039568e45924c9"} Mar 16 16:32:43 crc kubenswrapper[5120]: I0316 16:32:43.692546 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-558fbfdd47-v976s"] Mar 16 16:32:44 crc kubenswrapper[5120]: I0316 16:32:44.263071 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-558fbfdd47-v976s" event={"ID":"9a15bc36-5f09-421b-a175-df44f218f875","Type":"ContainerStarted","Data":"5a27d444a2b29795a9e750d0543943d54446ab5493bef69e2cccf083124184bf"} Mar 16 16:32:44 crc kubenswrapper[5120]: I0316 16:32:44.263479 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-558fbfdd47-v976s" Mar 16 16:32:44 crc kubenswrapper[5120]: I0316 16:32:44.263519 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-558fbfdd47-v976s" Mar 16 16:32:44 crc kubenswrapper[5120]: I0316 16:32:44.263531 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-558fbfdd47-v976s" event={"ID":"9a15bc36-5f09-421b-a175-df44f218f875","Type":"ContainerStarted","Data":"e6fd592e7b69681015c9c5ee62b89fabe9eeb0eaac28a238ec9c5be8a7c13951"} Mar 16 16:32:44 crc kubenswrapper[5120]: I0316 16:32:44.263543 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-558fbfdd47-v976s" event={"ID":"9a15bc36-5f09-421b-a175-df44f218f875","Type":"ContainerStarted","Data":"91fb094589ae2fb45955b7778ed6b8fe71fdcfebc0fe21c3edf2f790e6fbbd52"} Mar 16 16:32:44 crc kubenswrapper[5120]: I0316 16:32:44.265432 5120 generic.go:358] "Generic (PLEG): container finished" podID="f21b59e7-258d-40b6-ac7f-14f44058aa3b" containerID="cf0ade454712d54bbd6566c19455cca6ef17295f8323872af8aec43cc9f70c86" exitCode=0 Mar 16 16:32:44 crc kubenswrapper[5120]: I0316 16:32:44.265520 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-5fdqd" event={"ID":"f21b59e7-258d-40b6-ac7f-14f44058aa3b","Type":"ContainerDied","Data":"cf0ade454712d54bbd6566c19455cca6ef17295f8323872af8aec43cc9f70c86"} Mar 16 16:32:44 crc kubenswrapper[5120]: I0316 16:32:44.267999 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"f563b41f-83a2-4093-b167-d4e4a335986a","Type":"ContainerStarted","Data":"b6208a694882957c0c09eafdde432abef4c7042ccd108a7e96cb38fb14074db7"} Mar 16 16:32:44 crc kubenswrapper[5120]: I0316 16:32:44.290434 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-api-558fbfdd47-v976s" podStartSLOduration=2.290410122 podStartE2EDuration="2.290410122s" podCreationTimestamp="2026-03-16 16:32:42 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:32:44.284832966 +0000 UTC m=+3666.438764623" watchObservedRunningTime="2026-03-16 16:32:44.290410122 +0000 UTC m=+3666.444341779" Mar 16 16:32:45 crc kubenswrapper[5120]: I0316 16:32:45.279261 5120 generic.go:358] "Generic (PLEG): container finished" podID="cc2bd316-2e78-455c-a6dd-42328212b951" containerID="5e086b84acb9eb1dded1cd232e9ece3bd6c8f4f2b1365e0ecd334ec230fd3a55" exitCode=0 Mar 16 16:32:45 crc kubenswrapper[5120]: I0316 16:32:45.279367 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-v6zxd" event={"ID":"cc2bd316-2e78-455c-a6dd-42328212b951","Type":"ContainerDied","Data":"5e086b84acb9eb1dded1cd232e9ece3bd6c8f4f2b1365e0ecd334ec230fd3a55"} Mar 16 16:32:45 crc kubenswrapper[5120]: I0316 16:32:45.672606 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-5fdqd" Mar 16 16:32:45 crc kubenswrapper[5120]: I0316 16:32:45.721430 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/f21b59e7-258d-40b6-ac7f-14f44058aa3b-db-sync-config-data\") pod \"f21b59e7-258d-40b6-ac7f-14f44058aa3b\" (UID: \"f21b59e7-258d-40b6-ac7f-14f44058aa3b\") " Mar 16 16:32:45 crc kubenswrapper[5120]: I0316 16:32:45.721692 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f21b59e7-258d-40b6-ac7f-14f44058aa3b-scripts\") pod \"f21b59e7-258d-40b6-ac7f-14f44058aa3b\" (UID: \"f21b59e7-258d-40b6-ac7f-14f44058aa3b\") " Mar 16 16:32:45 crc kubenswrapper[5120]: I0316 16:32:45.721808 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/f21b59e7-258d-40b6-ac7f-14f44058aa3b-etc-machine-id\") pod \"f21b59e7-258d-40b6-ac7f-14f44058aa3b\" (UID: \"f21b59e7-258d-40b6-ac7f-14f44058aa3b\") " Mar 16 16:32:45 crc kubenswrapper[5120]: I0316 16:32:45.721887 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ctz2p\" (UniqueName: \"kubernetes.io/projected/f21b59e7-258d-40b6-ac7f-14f44058aa3b-kube-api-access-ctz2p\") pod \"f21b59e7-258d-40b6-ac7f-14f44058aa3b\" (UID: \"f21b59e7-258d-40b6-ac7f-14f44058aa3b\") " Mar 16 16:32:45 crc kubenswrapper[5120]: I0316 16:32:45.721936 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f21b59e7-258d-40b6-ac7f-14f44058aa3b-combined-ca-bundle\") pod \"f21b59e7-258d-40b6-ac7f-14f44058aa3b\" (UID: \"f21b59e7-258d-40b6-ac7f-14f44058aa3b\") " Mar 16 16:32:45 crc kubenswrapper[5120]: I0316 16:32:45.722032 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f21b59e7-258d-40b6-ac7f-14f44058aa3b-config-data\") pod \"f21b59e7-258d-40b6-ac7f-14f44058aa3b\" (UID: \"f21b59e7-258d-40b6-ac7f-14f44058aa3b\") " Mar 16 16:32:45 crc kubenswrapper[5120]: I0316 16:32:45.722067 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/f21b59e7-258d-40b6-ac7f-14f44058aa3b-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "f21b59e7-258d-40b6-ac7f-14f44058aa3b" (UID: "f21b59e7-258d-40b6-ac7f-14f44058aa3b"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 16:32:45 crc kubenswrapper[5120]: I0316 16:32:45.722646 5120 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/f21b59e7-258d-40b6-ac7f-14f44058aa3b-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 16:32:45 crc kubenswrapper[5120]: I0316 16:32:45.727209 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f21b59e7-258d-40b6-ac7f-14f44058aa3b-scripts" (OuterVolumeSpecName: "scripts") pod "f21b59e7-258d-40b6-ac7f-14f44058aa3b" (UID: "f21b59e7-258d-40b6-ac7f-14f44058aa3b"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:32:45 crc kubenswrapper[5120]: I0316 16:32:45.735232 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f21b59e7-258d-40b6-ac7f-14f44058aa3b-db-sync-config-data" (OuterVolumeSpecName: "db-sync-config-data") pod "f21b59e7-258d-40b6-ac7f-14f44058aa3b" (UID: "f21b59e7-258d-40b6-ac7f-14f44058aa3b"). InnerVolumeSpecName "db-sync-config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:32:45 crc kubenswrapper[5120]: I0316 16:32:45.736299 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f21b59e7-258d-40b6-ac7f-14f44058aa3b-kube-api-access-ctz2p" (OuterVolumeSpecName: "kube-api-access-ctz2p") pod "f21b59e7-258d-40b6-ac7f-14f44058aa3b" (UID: "f21b59e7-258d-40b6-ac7f-14f44058aa3b"). InnerVolumeSpecName "kube-api-access-ctz2p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:32:45 crc kubenswrapper[5120]: I0316 16:32:45.754737 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f21b59e7-258d-40b6-ac7f-14f44058aa3b-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f21b59e7-258d-40b6-ac7f-14f44058aa3b" (UID: "f21b59e7-258d-40b6-ac7f-14f44058aa3b"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:32:45 crc kubenswrapper[5120]: I0316 16:32:45.784624 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f21b59e7-258d-40b6-ac7f-14f44058aa3b-config-data" (OuterVolumeSpecName: "config-data") pod "f21b59e7-258d-40b6-ac7f-14f44058aa3b" (UID: "f21b59e7-258d-40b6-ac7f-14f44058aa3b"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:32:45 crc kubenswrapper[5120]: I0316 16:32:45.824569 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f21b59e7-258d-40b6-ac7f-14f44058aa3b-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:32:45 crc kubenswrapper[5120]: I0316 16:32:45.824606 5120 reconciler_common.go:299] "Volume detached for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/f21b59e7-258d-40b6-ac7f-14f44058aa3b-db-sync-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:32:45 crc kubenswrapper[5120]: I0316 16:32:45.824619 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f21b59e7-258d-40b6-ac7f-14f44058aa3b-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:32:45 crc kubenswrapper[5120]: I0316 16:32:45.824628 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ctz2p\" (UniqueName: \"kubernetes.io/projected/f21b59e7-258d-40b6-ac7f-14f44058aa3b-kube-api-access-ctz2p\") on node \"crc\" DevicePath \"\"" Mar 16 16:32:45 crc kubenswrapper[5120]: I0316 16:32:45.824637 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f21b59e7-258d-40b6-ac7f-14f44058aa3b-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:32:46 crc kubenswrapper[5120]: I0316 16:32:46.289534 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-5fdqd" Mar 16 16:32:46 crc kubenswrapper[5120]: I0316 16:32:46.289543 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-5fdqd" event={"ID":"f21b59e7-258d-40b6-ac7f-14f44058aa3b","Type":"ContainerDied","Data":"bfca222d6c127657152658f3163ef82ecc2200c0fdde2c09266bace0dc55823e"} Mar 16 16:32:46 crc kubenswrapper[5120]: I0316 16:32:46.289684 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bfca222d6c127657152658f3163ef82ecc2200c0fdde2c09266bace0dc55823e" Mar 16 16:32:46 crc kubenswrapper[5120]: I0316 16:32:46.292907 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"f563b41f-83a2-4093-b167-d4e4a335986a","Type":"ContainerStarted","Data":"209dc9257d849269285a2216b1c1bb2a8f87886b4927e1cd28028fcbd67da3e2"} Mar 16 16:32:46 crc kubenswrapper[5120]: I0316 16:32:46.583434 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:32:46 crc kubenswrapper[5120]: I0316 16:32:46.584431 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f21b59e7-258d-40b6-ac7f-14f44058aa3b" containerName="cinder-db-sync" Mar 16 16:32:46 crc kubenswrapper[5120]: I0316 16:32:46.584454 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f21b59e7-258d-40b6-ac7f-14f44058aa3b" containerName="cinder-db-sync" Mar 16 16:32:46 crc kubenswrapper[5120]: I0316 16:32:46.584652 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f21b59e7-258d-40b6-ac7f-14f44058aa3b" containerName="cinder-db-sync" Mar 16 16:32:46 crc kubenswrapper[5120]: I0316 16:32:46.617563 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:32:46 crc kubenswrapper[5120]: I0316 16:32:46.617691 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:32:46 crc kubenswrapper[5120]: I0316 16:32:46.620224 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-scheduler-config-data\"" Mar 16 16:32:46 crc kubenswrapper[5120]: I0316 16:32:46.620568 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-cinder-dockercfg-zqh64\"" Mar 16 16:32:46 crc kubenswrapper[5120]: I0316 16:32:46.625845 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-scripts\"" Mar 16 16:32:46 crc kubenswrapper[5120]: I0316 16:32:46.626156 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-config-data\"" Mar 16 16:32:46 crc kubenswrapper[5120]: I0316 16:32:46.703644 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-v6zxd" Mar 16 16:32:46 crc kubenswrapper[5120]: I0316 16:32:46.752651 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h4769\" (UniqueName: \"kubernetes.io/projected/cc2bd316-2e78-455c-a6dd-42328212b951-kube-api-access-h4769\") pod \"cc2bd316-2e78-455c-a6dd-42328212b951\" (UID: \"cc2bd316-2e78-455c-a6dd-42328212b951\") " Mar 16 16:32:46 crc kubenswrapper[5120]: I0316 16:32:46.752960 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cc2bd316-2e78-455c-a6dd-42328212b951-config-data\") pod \"cc2bd316-2e78-455c-a6dd-42328212b951\" (UID: \"cc2bd316-2e78-455c-a6dd-42328212b951\") " Mar 16 16:32:46 crc kubenswrapper[5120]: I0316 16:32:46.753017 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/cc2bd316-2e78-455c-a6dd-42328212b951-credential-keys\") pod \"cc2bd316-2e78-455c-a6dd-42328212b951\" (UID: \"cc2bd316-2e78-455c-a6dd-42328212b951\") " Mar 16 16:32:46 crc kubenswrapper[5120]: I0316 16:32:46.753140 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/cc2bd316-2e78-455c-a6dd-42328212b951-scripts\") pod \"cc2bd316-2e78-455c-a6dd-42328212b951\" (UID: \"cc2bd316-2e78-455c-a6dd-42328212b951\") " Mar 16 16:32:46 crc kubenswrapper[5120]: I0316 16:32:46.753184 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/cc2bd316-2e78-455c-a6dd-42328212b951-fernet-keys\") pod \"cc2bd316-2e78-455c-a6dd-42328212b951\" (UID: \"cc2bd316-2e78-455c-a6dd-42328212b951\") " Mar 16 16:32:46 crc kubenswrapper[5120]: I0316 16:32:46.753222 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cc2bd316-2e78-455c-a6dd-42328212b951-combined-ca-bundle\") pod \"cc2bd316-2e78-455c-a6dd-42328212b951\" (UID: \"cc2bd316-2e78-455c-a6dd-42328212b951\") " Mar 16 16:32:46 crc kubenswrapper[5120]: I0316 16:32:46.753822 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2ad10a31-4609-47b6-a992-baa9724d3652-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"2ad10a31-4609-47b6-a992-baa9724d3652\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:32:46 crc kubenswrapper[5120]: I0316 16:32:46.753987 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2ad10a31-4609-47b6-a992-baa9724d3652-scripts\") pod \"cinder-scheduler-0\" (UID: \"2ad10a31-4609-47b6-a992-baa9724d3652\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:32:46 crc kubenswrapper[5120]: I0316 16:32:46.754002 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2ad10a31-4609-47b6-a992-baa9724d3652-config-data\") pod \"cinder-scheduler-0\" (UID: \"2ad10a31-4609-47b6-a992-baa9724d3652\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:32:46 crc kubenswrapper[5120]: I0316 16:32:46.754041 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/2ad10a31-4609-47b6-a992-baa9724d3652-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"2ad10a31-4609-47b6-a992-baa9724d3652\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:32:46 crc kubenswrapper[5120]: I0316 16:32:46.754197 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/2ad10a31-4609-47b6-a992-baa9724d3652-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"2ad10a31-4609-47b6-a992-baa9724d3652\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:32:46 crc kubenswrapper[5120]: I0316 16:32:46.754222 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vnpsd\" (UniqueName: \"kubernetes.io/projected/2ad10a31-4609-47b6-a992-baa9724d3652-kube-api-access-vnpsd\") pod \"cinder-scheduler-0\" (UID: \"2ad10a31-4609-47b6-a992-baa9724d3652\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:32:46 crc kubenswrapper[5120]: I0316 16:32:46.759617 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc2bd316-2e78-455c-a6dd-42328212b951-kube-api-access-h4769" (OuterVolumeSpecName: "kube-api-access-h4769") pod "cc2bd316-2e78-455c-a6dd-42328212b951" (UID: "cc2bd316-2e78-455c-a6dd-42328212b951"). InnerVolumeSpecName "kube-api-access-h4769". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:32:46 crc kubenswrapper[5120]: I0316 16:32:46.762404 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc2bd316-2e78-455c-a6dd-42328212b951-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "cc2bd316-2e78-455c-a6dd-42328212b951" (UID: "cc2bd316-2e78-455c-a6dd-42328212b951"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:32:46 crc kubenswrapper[5120]: I0316 16:32:46.796278 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:32:46 crc kubenswrapper[5120]: I0316 16:32:46.803283 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc2bd316-2e78-455c-a6dd-42328212b951" containerName="keystone-bootstrap" Mar 16 16:32:46 crc kubenswrapper[5120]: I0316 16:32:46.803326 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc2bd316-2e78-455c-a6dd-42328212b951" containerName="keystone-bootstrap" Mar 16 16:32:46 crc kubenswrapper[5120]: I0316 16:32:46.803578 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="cc2bd316-2e78-455c-a6dd-42328212b951" containerName="keystone-bootstrap" Mar 16 16:32:46 crc kubenswrapper[5120]: I0316 16:32:46.809517 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc2bd316-2e78-455c-a6dd-42328212b951-scripts" (OuterVolumeSpecName: "scripts") pod "cc2bd316-2e78-455c-a6dd-42328212b951" (UID: "cc2bd316-2e78-455c-a6dd-42328212b951"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:32:46 crc kubenswrapper[5120]: I0316 16:32:46.810344 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc2bd316-2e78-455c-a6dd-42328212b951-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "cc2bd316-2e78-455c-a6dd-42328212b951" (UID: "cc2bd316-2e78-455c-a6dd-42328212b951"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:32:46 crc kubenswrapper[5120]: I0316 16:32:46.818556 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:32:46 crc kubenswrapper[5120]: I0316 16:32:46.821174 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-api-config-data\"" Mar 16 16:32:46 crc kubenswrapper[5120]: I0316 16:32:46.822002 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc2bd316-2e78-455c-a6dd-42328212b951-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "cc2bd316-2e78-455c-a6dd-42328212b951" (UID: "cc2bd316-2e78-455c-a6dd-42328212b951"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:32:46 crc kubenswrapper[5120]: I0316 16:32:46.823896 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc2bd316-2e78-455c-a6dd-42328212b951-config-data" (OuterVolumeSpecName: "config-data") pod "cc2bd316-2e78-455c-a6dd-42328212b951" (UID: "cc2bd316-2e78-455c-a6dd-42328212b951"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:32:46 crc kubenswrapper[5120]: I0316 16:32:46.838648 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:32:46 crc kubenswrapper[5120]: I0316 16:32:46.860754 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2ad10a31-4609-47b6-a992-baa9724d3652-scripts\") pod \"cinder-scheduler-0\" (UID: \"2ad10a31-4609-47b6-a992-baa9724d3652\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:32:46 crc kubenswrapper[5120]: I0316 16:32:46.860852 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2ad10a31-4609-47b6-a992-baa9724d3652-config-data\") pod \"cinder-scheduler-0\" (UID: \"2ad10a31-4609-47b6-a992-baa9724d3652\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:32:46 crc kubenswrapper[5120]: I0316 16:32:46.860910 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/2ad10a31-4609-47b6-a992-baa9724d3652-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"2ad10a31-4609-47b6-a992-baa9724d3652\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:32:46 crc kubenswrapper[5120]: I0316 16:32:46.861003 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/2ad10a31-4609-47b6-a992-baa9724d3652-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"2ad10a31-4609-47b6-a992-baa9724d3652\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:32:46 crc kubenswrapper[5120]: I0316 16:32:46.861027 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vnpsd\" (UniqueName: \"kubernetes.io/projected/2ad10a31-4609-47b6-a992-baa9724d3652-kube-api-access-vnpsd\") pod \"cinder-scheduler-0\" (UID: \"2ad10a31-4609-47b6-a992-baa9724d3652\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:32:46 crc kubenswrapper[5120]: I0316 16:32:46.861197 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2ad10a31-4609-47b6-a992-baa9724d3652-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"2ad10a31-4609-47b6-a992-baa9724d3652\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:32:46 crc kubenswrapper[5120]: I0316 16:32:46.861321 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/cc2bd316-2e78-455c-a6dd-42328212b951-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:32:46 crc kubenswrapper[5120]: I0316 16:32:46.861335 5120 reconciler_common.go:299] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/cc2bd316-2e78-455c-a6dd-42328212b951-fernet-keys\") on node \"crc\" DevicePath \"\"" Mar 16 16:32:46 crc kubenswrapper[5120]: I0316 16:32:46.861346 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cc2bd316-2e78-455c-a6dd-42328212b951-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:32:46 crc kubenswrapper[5120]: I0316 16:32:46.861367 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h4769\" (UniqueName: \"kubernetes.io/projected/cc2bd316-2e78-455c-a6dd-42328212b951-kube-api-access-h4769\") on node \"crc\" DevicePath \"\"" Mar 16 16:32:46 crc kubenswrapper[5120]: I0316 16:32:46.861380 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cc2bd316-2e78-455c-a6dd-42328212b951-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:32:46 crc kubenswrapper[5120]: I0316 16:32:46.861392 5120 reconciler_common.go:299] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/cc2bd316-2e78-455c-a6dd-42328212b951-credential-keys\") on node \"crc\" DevicePath \"\"" Mar 16 16:32:46 crc kubenswrapper[5120]: I0316 16:32:46.872999 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/2ad10a31-4609-47b6-a992-baa9724d3652-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"2ad10a31-4609-47b6-a992-baa9724d3652\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:32:46 crc kubenswrapper[5120]: I0316 16:32:46.881312 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2ad10a31-4609-47b6-a992-baa9724d3652-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"2ad10a31-4609-47b6-a992-baa9724d3652\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:32:46 crc kubenswrapper[5120]: I0316 16:32:46.889588 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2ad10a31-4609-47b6-a992-baa9724d3652-config-data\") pod \"cinder-scheduler-0\" (UID: \"2ad10a31-4609-47b6-a992-baa9724d3652\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:32:46 crc kubenswrapper[5120]: I0316 16:32:46.890861 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vnpsd\" (UniqueName: \"kubernetes.io/projected/2ad10a31-4609-47b6-a992-baa9724d3652-kube-api-access-vnpsd\") pod \"cinder-scheduler-0\" (UID: \"2ad10a31-4609-47b6-a992-baa9724d3652\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:32:46 crc kubenswrapper[5120]: I0316 16:32:46.909962 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/2ad10a31-4609-47b6-a992-baa9724d3652-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"2ad10a31-4609-47b6-a992-baa9724d3652\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:32:46 crc kubenswrapper[5120]: I0316 16:32:46.915400 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2ad10a31-4609-47b6-a992-baa9724d3652-scripts\") pod \"cinder-scheduler-0\" (UID: \"2ad10a31-4609-47b6-a992-baa9724d3652\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:32:46 crc kubenswrapper[5120]: I0316 16:32:46.963452 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggvf7\" (UniqueName: \"kubernetes.io/projected/58a1579c-59e5-4830-8864-6e0bb86ea553-kube-api-access-ggvf7\") pod \"cinder-api-0\" (UID: \"58a1579c-59e5-4830-8864-6e0bb86ea553\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:32:46 crc kubenswrapper[5120]: I0316 16:32:46.963512 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/58a1579c-59e5-4830-8864-6e0bb86ea553-config-data-custom\") pod \"cinder-api-0\" (UID: \"58a1579c-59e5-4830-8864-6e0bb86ea553\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:32:46 crc kubenswrapper[5120]: I0316 16:32:46.963748 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/58a1579c-59e5-4830-8864-6e0bb86ea553-etc-machine-id\") pod \"cinder-api-0\" (UID: \"58a1579c-59e5-4830-8864-6e0bb86ea553\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:32:46 crc kubenswrapper[5120]: I0316 16:32:46.964211 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/58a1579c-59e5-4830-8864-6e0bb86ea553-scripts\") pod \"cinder-api-0\" (UID: \"58a1579c-59e5-4830-8864-6e0bb86ea553\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:32:46 crc kubenswrapper[5120]: I0316 16:32:46.964242 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/58a1579c-59e5-4830-8864-6e0bb86ea553-logs\") pod \"cinder-api-0\" (UID: \"58a1579c-59e5-4830-8864-6e0bb86ea553\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:32:46 crc kubenswrapper[5120]: I0316 16:32:46.964391 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/58a1579c-59e5-4830-8864-6e0bb86ea553-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"58a1579c-59e5-4830-8864-6e0bb86ea553\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:32:46 crc kubenswrapper[5120]: I0316 16:32:46.964488 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/58a1579c-59e5-4830-8864-6e0bb86ea553-config-data\") pod \"cinder-api-0\" (UID: \"58a1579c-59e5-4830-8864-6e0bb86ea553\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:32:47 crc kubenswrapper[5120]: I0316 16:32:47.025215 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:32:47 crc kubenswrapper[5120]: I0316 16:32:47.069404 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/58a1579c-59e5-4830-8864-6e0bb86ea553-scripts\") pod \"cinder-api-0\" (UID: \"58a1579c-59e5-4830-8864-6e0bb86ea553\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:32:47 crc kubenswrapper[5120]: I0316 16:32:47.069723 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/58a1579c-59e5-4830-8864-6e0bb86ea553-logs\") pod \"cinder-api-0\" (UID: \"58a1579c-59e5-4830-8864-6e0bb86ea553\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:32:47 crc kubenswrapper[5120]: I0316 16:32:47.069889 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/58a1579c-59e5-4830-8864-6e0bb86ea553-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"58a1579c-59e5-4830-8864-6e0bb86ea553\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:32:47 crc kubenswrapper[5120]: I0316 16:32:47.069927 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/58a1579c-59e5-4830-8864-6e0bb86ea553-config-data\") pod \"cinder-api-0\" (UID: \"58a1579c-59e5-4830-8864-6e0bb86ea553\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:32:47 crc kubenswrapper[5120]: I0316 16:32:47.070016 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ggvf7\" (UniqueName: \"kubernetes.io/projected/58a1579c-59e5-4830-8864-6e0bb86ea553-kube-api-access-ggvf7\") pod \"cinder-api-0\" (UID: \"58a1579c-59e5-4830-8864-6e0bb86ea553\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:32:47 crc kubenswrapper[5120]: I0316 16:32:47.070039 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/58a1579c-59e5-4830-8864-6e0bb86ea553-config-data-custom\") pod \"cinder-api-0\" (UID: \"58a1579c-59e5-4830-8864-6e0bb86ea553\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:32:47 crc kubenswrapper[5120]: I0316 16:32:47.070096 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/58a1579c-59e5-4830-8864-6e0bb86ea553-etc-machine-id\") pod \"cinder-api-0\" (UID: \"58a1579c-59e5-4830-8864-6e0bb86ea553\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:32:47 crc kubenswrapper[5120]: I0316 16:32:47.070276 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/58a1579c-59e5-4830-8864-6e0bb86ea553-etc-machine-id\") pod \"cinder-api-0\" (UID: \"58a1579c-59e5-4830-8864-6e0bb86ea553\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:32:47 crc kubenswrapper[5120]: I0316 16:32:47.070954 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/58a1579c-59e5-4830-8864-6e0bb86ea553-logs\") pod \"cinder-api-0\" (UID: \"58a1579c-59e5-4830-8864-6e0bb86ea553\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:32:47 crc kubenswrapper[5120]: I0316 16:32:47.075573 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/58a1579c-59e5-4830-8864-6e0bb86ea553-config-data\") pod \"cinder-api-0\" (UID: \"58a1579c-59e5-4830-8864-6e0bb86ea553\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:32:47 crc kubenswrapper[5120]: I0316 16:32:47.076486 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/58a1579c-59e5-4830-8864-6e0bb86ea553-config-data-custom\") pod \"cinder-api-0\" (UID: \"58a1579c-59e5-4830-8864-6e0bb86ea553\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:32:47 crc kubenswrapper[5120]: I0316 16:32:47.076825 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/58a1579c-59e5-4830-8864-6e0bb86ea553-scripts\") pod \"cinder-api-0\" (UID: \"58a1579c-59e5-4830-8864-6e0bb86ea553\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:32:47 crc kubenswrapper[5120]: I0316 16:32:47.079049 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/58a1579c-59e5-4830-8864-6e0bb86ea553-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"58a1579c-59e5-4830-8864-6e0bb86ea553\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:32:47 crc kubenswrapper[5120]: I0316 16:32:47.089615 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggvf7\" (UniqueName: \"kubernetes.io/projected/58a1579c-59e5-4830-8864-6e0bb86ea553-kube-api-access-ggvf7\") pod \"cinder-api-0\" (UID: \"58a1579c-59e5-4830-8864-6e0bb86ea553\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:32:47 crc kubenswrapper[5120]: I0316 16:32:47.230216 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:32:47 crc kubenswrapper[5120]: I0316 16:32:47.327312 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-v6zxd" Mar 16 16:32:47 crc kubenswrapper[5120]: I0316 16:32:47.327310 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-v6zxd" event={"ID":"cc2bd316-2e78-455c-a6dd-42328212b951","Type":"ContainerDied","Data":"bb93bcb9e5c229bd37ef589e8687702f0814631b997c12ec248152fb320251a3"} Mar 16 16:32:47 crc kubenswrapper[5120]: I0316 16:32:47.327708 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bb93bcb9e5c229bd37ef589e8687702f0814631b997c12ec248152fb320251a3" Mar 16 16:32:47 crc kubenswrapper[5120]: I0316 16:32:47.418483 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-768f4979c4-gbb88"] Mar 16 16:32:47 crc kubenswrapper[5120]: I0316 16:32:47.428130 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-768f4979c4-gbb88" Mar 16 16:32:47 crc kubenswrapper[5120]: I0316 16:32:47.432119 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-scripts\"" Mar 16 16:32:47 crc kubenswrapper[5120]: I0316 16:32:47.432186 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-keystone-dockercfg-nqmkd\"" Mar 16 16:32:47 crc kubenswrapper[5120]: I0316 16:32:47.432463 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-keystone-public-svc\"" Mar 16 16:32:47 crc kubenswrapper[5120]: I0316 16:32:47.432525 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-keystone-internal-svc\"" Mar 16 16:32:47 crc kubenswrapper[5120]: I0316 16:32:47.432623 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone\"" Mar 16 16:32:47 crc kubenswrapper[5120]: I0316 16:32:47.432684 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-config-data\"" Mar 16 16:32:47 crc kubenswrapper[5120]: I0316 16:32:47.442798 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-768f4979c4-gbb88"] Mar 16 16:32:47 crc kubenswrapper[5120]: I0316 16:32:47.525920 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:32:47 crc kubenswrapper[5120]: I0316 16:32:47.587698 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/ccd55653-57a9-4f28-90b6-6882e92b937e-fernet-keys\") pod \"keystone-768f4979c4-gbb88\" (UID: \"ccd55653-57a9-4f28-90b6-6882e92b937e\") " pod="openstack-kuttl-tests/keystone-768f4979c4-gbb88" Mar 16 16:32:47 crc kubenswrapper[5120]: I0316 16:32:47.587814 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ccd55653-57a9-4f28-90b6-6882e92b937e-public-tls-certs\") pod \"keystone-768f4979c4-gbb88\" (UID: \"ccd55653-57a9-4f28-90b6-6882e92b937e\") " pod="openstack-kuttl-tests/keystone-768f4979c4-gbb88" Mar 16 16:32:47 crc kubenswrapper[5120]: I0316 16:32:47.587993 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tv8s2\" (UniqueName: \"kubernetes.io/projected/ccd55653-57a9-4f28-90b6-6882e92b937e-kube-api-access-tv8s2\") pod \"keystone-768f4979c4-gbb88\" (UID: \"ccd55653-57a9-4f28-90b6-6882e92b937e\") " pod="openstack-kuttl-tests/keystone-768f4979c4-gbb88" Mar 16 16:32:47 crc kubenswrapper[5120]: I0316 16:32:47.588174 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ccd55653-57a9-4f28-90b6-6882e92b937e-scripts\") pod \"keystone-768f4979c4-gbb88\" (UID: \"ccd55653-57a9-4f28-90b6-6882e92b937e\") " pod="openstack-kuttl-tests/keystone-768f4979c4-gbb88" Mar 16 16:32:47 crc kubenswrapper[5120]: I0316 16:32:47.588248 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ccd55653-57a9-4f28-90b6-6882e92b937e-config-data\") pod \"keystone-768f4979c4-gbb88\" (UID: \"ccd55653-57a9-4f28-90b6-6882e92b937e\") " pod="openstack-kuttl-tests/keystone-768f4979c4-gbb88" Mar 16 16:32:47 crc kubenswrapper[5120]: I0316 16:32:47.588273 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ccd55653-57a9-4f28-90b6-6882e92b937e-combined-ca-bundle\") pod \"keystone-768f4979c4-gbb88\" (UID: \"ccd55653-57a9-4f28-90b6-6882e92b937e\") " pod="openstack-kuttl-tests/keystone-768f4979c4-gbb88" Mar 16 16:32:47 crc kubenswrapper[5120]: I0316 16:32:47.588342 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/ccd55653-57a9-4f28-90b6-6882e92b937e-credential-keys\") pod \"keystone-768f4979c4-gbb88\" (UID: \"ccd55653-57a9-4f28-90b6-6882e92b937e\") " pod="openstack-kuttl-tests/keystone-768f4979c4-gbb88" Mar 16 16:32:47 crc kubenswrapper[5120]: I0316 16:32:47.588443 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/ccd55653-57a9-4f28-90b6-6882e92b937e-internal-tls-certs\") pod \"keystone-768f4979c4-gbb88\" (UID: \"ccd55653-57a9-4f28-90b6-6882e92b937e\") " pod="openstack-kuttl-tests/keystone-768f4979c4-gbb88" Mar 16 16:32:47 crc kubenswrapper[5120]: I0316 16:32:47.669183 5120 scope.go:117] "RemoveContainer" containerID="0a15d5caff30dc8885f782e59962af7d98d58b39ab76059e56e5827e10e7ab8b" Mar 16 16:32:47 crc kubenswrapper[5120]: E0316 16:32:47.669497 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:32:47 crc kubenswrapper[5120]: I0316 16:32:47.689970 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tv8s2\" (UniqueName: \"kubernetes.io/projected/ccd55653-57a9-4f28-90b6-6882e92b937e-kube-api-access-tv8s2\") pod \"keystone-768f4979c4-gbb88\" (UID: \"ccd55653-57a9-4f28-90b6-6882e92b937e\") " pod="openstack-kuttl-tests/keystone-768f4979c4-gbb88" Mar 16 16:32:47 crc kubenswrapper[5120]: I0316 16:32:47.690350 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ccd55653-57a9-4f28-90b6-6882e92b937e-scripts\") pod \"keystone-768f4979c4-gbb88\" (UID: \"ccd55653-57a9-4f28-90b6-6882e92b937e\") " pod="openstack-kuttl-tests/keystone-768f4979c4-gbb88" Mar 16 16:32:47 crc kubenswrapper[5120]: I0316 16:32:47.690406 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ccd55653-57a9-4f28-90b6-6882e92b937e-config-data\") pod \"keystone-768f4979c4-gbb88\" (UID: \"ccd55653-57a9-4f28-90b6-6882e92b937e\") " pod="openstack-kuttl-tests/keystone-768f4979c4-gbb88" Mar 16 16:32:47 crc kubenswrapper[5120]: I0316 16:32:47.690438 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ccd55653-57a9-4f28-90b6-6882e92b937e-combined-ca-bundle\") pod \"keystone-768f4979c4-gbb88\" (UID: \"ccd55653-57a9-4f28-90b6-6882e92b937e\") " pod="openstack-kuttl-tests/keystone-768f4979c4-gbb88" Mar 16 16:32:47 crc kubenswrapper[5120]: I0316 16:32:47.690498 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/ccd55653-57a9-4f28-90b6-6882e92b937e-credential-keys\") pod \"keystone-768f4979c4-gbb88\" (UID: \"ccd55653-57a9-4f28-90b6-6882e92b937e\") " pod="openstack-kuttl-tests/keystone-768f4979c4-gbb88" Mar 16 16:32:47 crc kubenswrapper[5120]: I0316 16:32:47.690586 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/ccd55653-57a9-4f28-90b6-6882e92b937e-internal-tls-certs\") pod \"keystone-768f4979c4-gbb88\" (UID: \"ccd55653-57a9-4f28-90b6-6882e92b937e\") " pod="openstack-kuttl-tests/keystone-768f4979c4-gbb88" Mar 16 16:32:47 crc kubenswrapper[5120]: I0316 16:32:47.690701 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/ccd55653-57a9-4f28-90b6-6882e92b937e-fernet-keys\") pod \"keystone-768f4979c4-gbb88\" (UID: \"ccd55653-57a9-4f28-90b6-6882e92b937e\") " pod="openstack-kuttl-tests/keystone-768f4979c4-gbb88" Mar 16 16:32:47 crc kubenswrapper[5120]: I0316 16:32:47.690750 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ccd55653-57a9-4f28-90b6-6882e92b937e-public-tls-certs\") pod \"keystone-768f4979c4-gbb88\" (UID: \"ccd55653-57a9-4f28-90b6-6882e92b937e\") " pod="openstack-kuttl-tests/keystone-768f4979c4-gbb88" Mar 16 16:32:47 crc kubenswrapper[5120]: I0316 16:32:47.706008 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ccd55653-57a9-4f28-90b6-6882e92b937e-public-tls-certs\") pod \"keystone-768f4979c4-gbb88\" (UID: \"ccd55653-57a9-4f28-90b6-6882e92b937e\") " pod="openstack-kuttl-tests/keystone-768f4979c4-gbb88" Mar 16 16:32:47 crc kubenswrapper[5120]: I0316 16:32:47.712818 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/ccd55653-57a9-4f28-90b6-6882e92b937e-credential-keys\") pod \"keystone-768f4979c4-gbb88\" (UID: \"ccd55653-57a9-4f28-90b6-6882e92b937e\") " pod="openstack-kuttl-tests/keystone-768f4979c4-gbb88" Mar 16 16:32:47 crc kubenswrapper[5120]: I0316 16:32:47.715131 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ccd55653-57a9-4f28-90b6-6882e92b937e-scripts\") pod \"keystone-768f4979c4-gbb88\" (UID: \"ccd55653-57a9-4f28-90b6-6882e92b937e\") " pod="openstack-kuttl-tests/keystone-768f4979c4-gbb88" Mar 16 16:32:47 crc kubenswrapper[5120]: I0316 16:32:47.715557 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ccd55653-57a9-4f28-90b6-6882e92b937e-config-data\") pod \"keystone-768f4979c4-gbb88\" (UID: \"ccd55653-57a9-4f28-90b6-6882e92b937e\") " pod="openstack-kuttl-tests/keystone-768f4979c4-gbb88" Mar 16 16:32:47 crc kubenswrapper[5120]: I0316 16:32:47.715980 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/ccd55653-57a9-4f28-90b6-6882e92b937e-internal-tls-certs\") pod \"keystone-768f4979c4-gbb88\" (UID: \"ccd55653-57a9-4f28-90b6-6882e92b937e\") " pod="openstack-kuttl-tests/keystone-768f4979c4-gbb88" Mar 16 16:32:47 crc kubenswrapper[5120]: I0316 16:32:47.717303 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/ccd55653-57a9-4f28-90b6-6882e92b937e-fernet-keys\") pod \"keystone-768f4979c4-gbb88\" (UID: \"ccd55653-57a9-4f28-90b6-6882e92b937e\") " pod="openstack-kuttl-tests/keystone-768f4979c4-gbb88" Mar 16 16:32:47 crc kubenswrapper[5120]: I0316 16:32:47.736422 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tv8s2\" (UniqueName: \"kubernetes.io/projected/ccd55653-57a9-4f28-90b6-6882e92b937e-kube-api-access-tv8s2\") pod \"keystone-768f4979c4-gbb88\" (UID: \"ccd55653-57a9-4f28-90b6-6882e92b937e\") " pod="openstack-kuttl-tests/keystone-768f4979c4-gbb88" Mar 16 16:32:47 crc kubenswrapper[5120]: I0316 16:32:47.745269 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ccd55653-57a9-4f28-90b6-6882e92b937e-combined-ca-bundle\") pod \"keystone-768f4979c4-gbb88\" (UID: \"ccd55653-57a9-4f28-90b6-6882e92b937e\") " pod="openstack-kuttl-tests/keystone-768f4979c4-gbb88" Mar 16 16:32:47 crc kubenswrapper[5120]: I0316 16:32:47.761543 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-768f4979c4-gbb88" Mar 16 16:32:47 crc kubenswrapper[5120]: I0316 16:32:47.867647 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:32:48 crc kubenswrapper[5120]: I0316 16:32:48.363606 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"58a1579c-59e5-4830-8864-6e0bb86ea553","Type":"ContainerStarted","Data":"daa5795127b1c15392732751fff3cdd4929f88b395cef1bcc56a4ef150a7f779"} Mar 16 16:32:48 crc kubenswrapper[5120]: I0316 16:32:48.393241 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"2ad10a31-4609-47b6-a992-baa9724d3652","Type":"ContainerStarted","Data":"feb3f037e7d90c0bfafea03ca01bb803ea900b881c1e17af7e49c4789cfdf853"} Mar 16 16:32:48 crc kubenswrapper[5120]: I0316 16:32:48.454031 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"f563b41f-83a2-4093-b167-d4e4a335986a","Type":"ContainerStarted","Data":"cf711f4d60ffe5afca6c10d9f1426bfd4744e88b550d6f0118f6f49dd63dc10b"} Mar 16 16:32:48 crc kubenswrapper[5120]: I0316 16:32:48.455498 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:32:48 crc kubenswrapper[5120]: I0316 16:32:48.456237 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-768f4979c4-gbb88"] Mar 16 16:32:48 crc kubenswrapper[5120]: I0316 16:32:48.498169 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.696818897 podStartE2EDuration="8.498149235s" podCreationTimestamp="2026-03-16 16:32:40 +0000 UTC" firstStartedPulling="2026-03-16 16:32:41.91880784 +0000 UTC m=+3664.072739487" lastFinishedPulling="2026-03-16 16:32:47.720138178 +0000 UTC m=+3669.874069825" observedRunningTime="2026-03-16 16:32:48.488587264 +0000 UTC m=+3670.642518931" watchObservedRunningTime="2026-03-16 16:32:48.498149235 +0000 UTC m=+3670.652080892" Mar 16 16:32:48 crc kubenswrapper[5120]: I0316 16:32:48.515563 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:32:48 crc kubenswrapper[5120]: I0316 16:32:48.516803 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:32:48 crc kubenswrapper[5120]: I0316 16:32:48.558390 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:32:48 crc kubenswrapper[5120]: I0316 16:32:48.616044 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:32:48 crc kubenswrapper[5120]: I0316 16:32:48.751320 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:32:48 crc kubenswrapper[5120]: I0316 16:32:48.753078 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:32:48 crc kubenswrapper[5120]: I0316 16:32:48.845927 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:32:48 crc kubenswrapper[5120]: I0316 16:32:48.858237 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:32:49 crc kubenswrapper[5120]: I0316 16:32:49.058393 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:32:49 crc kubenswrapper[5120]: I0316 16:32:49.292566 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:32:49 crc kubenswrapper[5120]: I0316 16:32:49.510836 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-768f4979c4-gbb88" event={"ID":"ccd55653-57a9-4f28-90b6-6882e92b937e","Type":"ContainerStarted","Data":"7fa7e7af3841675a24bfbd9a2b6742b345635242bdc066da72bb7d0b19aa4765"} Mar 16 16:32:49 crc kubenswrapper[5120]: I0316 16:32:49.510912 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/keystone-768f4979c4-gbb88" Mar 16 16:32:49 crc kubenswrapper[5120]: I0316 16:32:49.510926 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-768f4979c4-gbb88" event={"ID":"ccd55653-57a9-4f28-90b6-6882e92b937e","Type":"ContainerStarted","Data":"a069ff3a8050fb417cb0e8f46c2dfe1402ebf891f59d8eaddd2693534794ebe3"} Mar 16 16:32:49 crc kubenswrapper[5120]: I0316 16:32:49.522638 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"2ad10a31-4609-47b6-a992-baa9724d3652","Type":"ContainerStarted","Data":"801e54778f96f4fcc6177b47190cb6a35c5b94f51610a06ab650720884fc39ef"} Mar 16 16:32:49 crc kubenswrapper[5120]: I0316 16:32:49.550823 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"58a1579c-59e5-4830-8864-6e0bb86ea553","Type":"ContainerStarted","Data":"8852c4c7bfcc325ddd2dd315f62d6cdd322dffca571b64520e0bd913b4a33f91"} Mar 16 16:32:49 crc kubenswrapper[5120]: I0316 16:32:49.553954 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:32:49 crc kubenswrapper[5120]: I0316 16:32:49.553998 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:32:49 crc kubenswrapper[5120]: I0316 16:32:49.554009 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:32:49 crc kubenswrapper[5120]: I0316 16:32:49.554019 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:32:49 crc kubenswrapper[5120]: I0316 16:32:49.592527 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-768f4979c4-gbb88" podStartSLOduration=2.592504488 podStartE2EDuration="2.592504488s" podCreationTimestamp="2026-03-16 16:32:47 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:32:49.531478601 +0000 UTC m=+3671.685410258" watchObservedRunningTime="2026-03-16 16:32:49.592504488 +0000 UTC m=+3671.746436145" Mar 16 16:32:50 crc kubenswrapper[5120]: I0316 16:32:50.596845 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-5975dccf9f-xrcl8" Mar 16 16:32:50 crc kubenswrapper[5120]: I0316 16:32:50.605345 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"2ad10a31-4609-47b6-a992-baa9724d3652","Type":"ContainerStarted","Data":"bfa860c9a330a36ed895b9bce3540bd71e2ec75f0e0b4f0f8713240235ba5dc6"} Mar 16 16:32:50 crc kubenswrapper[5120]: I0316 16:32:50.606662 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="f563b41f-83a2-4093-b167-d4e4a335986a" containerName="ceilometer-central-agent" containerID="cri-o://090a552e77af505fb9117d3156af00921a13ceede2f199b297039568e45924c9" gracePeriod=30 Mar 16 16:32:50 crc kubenswrapper[5120]: I0316 16:32:50.606809 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="f563b41f-83a2-4093-b167-d4e4a335986a" containerName="proxy-httpd" containerID="cri-o://cf711f4d60ffe5afca6c10d9f1426bfd4744e88b550d6f0118f6f49dd63dc10b" gracePeriod=30 Mar 16 16:32:50 crc kubenswrapper[5120]: I0316 16:32:50.606850 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="f563b41f-83a2-4093-b167-d4e4a335986a" containerName="sg-core" containerID="cri-o://209dc9257d849269285a2216b1c1bb2a8f87886b4927e1cd28028fcbd67da3e2" gracePeriod=30 Mar 16 16:32:50 crc kubenswrapper[5120]: I0316 16:32:50.606882 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="f563b41f-83a2-4093-b167-d4e4a335986a" containerName="ceilometer-notification-agent" containerID="cri-o://b6208a694882957c0c09eafdde432abef4c7042ccd108a7e96cb38fb14074db7" gracePeriod=30 Mar 16 16:32:51 crc kubenswrapper[5120]: I0316 16:32:51.345834 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-5975dccf9f-xrcl8" Mar 16 16:32:51 crc kubenswrapper[5120]: I0316 16:32:51.372405 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-scheduler-0" podStartSLOduration=5.372383498 podStartE2EDuration="5.372383498s" podCreationTimestamp="2026-03-16 16:32:46 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:32:50.646491114 +0000 UTC m=+3672.800422771" watchObservedRunningTime="2026-03-16 16:32:51.372383498 +0000 UTC m=+3673.526315155" Mar 16 16:32:51 crc kubenswrapper[5120]: I0316 16:32:51.545189 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-7d8dbd4879-pzj6v"] Mar 16 16:32:51 crc kubenswrapper[5120]: I0316 16:32:51.553492 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-7d8dbd4879-pzj6v" Mar 16 16:32:51 crc kubenswrapper[5120]: I0316 16:32:51.564921 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-worker-665c46bb4d-7xhgk"] Mar 16 16:32:51 crc kubenswrapper[5120]: I0316 16:32:51.576099 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-665c46bb4d-7xhgk" Mar 16 16:32:51 crc kubenswrapper[5120]: I0316 16:32:51.586990 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-665c46bb4d-7xhgk"] Mar 16 16:32:51 crc kubenswrapper[5120]: I0316 16:32:51.614016 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-7d8dbd4879-pzj6v"] Mar 16 16:32:51 crc kubenswrapper[5120]: I0316 16:32:51.649948 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ebe474a7-759d-4e64-974d-fafd32020f70-logs\") pod \"barbican-keystone-listener-7d8dbd4879-pzj6v\" (UID: \"ebe474a7-759d-4e64-974d-fafd32020f70\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7d8dbd4879-pzj6v" Mar 16 16:32:51 crc kubenswrapper[5120]: I0316 16:32:51.650006 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4qsv\" (UniqueName: \"kubernetes.io/projected/ebe474a7-759d-4e64-974d-fafd32020f70-kube-api-access-g4qsv\") pod \"barbican-keystone-listener-7d8dbd4879-pzj6v\" (UID: \"ebe474a7-759d-4e64-974d-fafd32020f70\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7d8dbd4879-pzj6v" Mar 16 16:32:51 crc kubenswrapper[5120]: I0316 16:32:51.650053 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/ebe474a7-759d-4e64-974d-fafd32020f70-config-data-custom\") pod \"barbican-keystone-listener-7d8dbd4879-pzj6v\" (UID: \"ebe474a7-759d-4e64-974d-fafd32020f70\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7d8dbd4879-pzj6v" Mar 16 16:32:51 crc kubenswrapper[5120]: I0316 16:32:51.650212 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ebe474a7-759d-4e64-974d-fafd32020f70-config-data\") pod \"barbican-keystone-listener-7d8dbd4879-pzj6v\" (UID: \"ebe474a7-759d-4e64-974d-fafd32020f70\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7d8dbd4879-pzj6v" Mar 16 16:32:51 crc kubenswrapper[5120]: I0316 16:32:51.650258 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ebe474a7-759d-4e64-974d-fafd32020f70-combined-ca-bundle\") pod \"barbican-keystone-listener-7d8dbd4879-pzj6v\" (UID: \"ebe474a7-759d-4e64-974d-fafd32020f70\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7d8dbd4879-pzj6v" Mar 16 16:32:51 crc kubenswrapper[5120]: I0316 16:32:51.658381 5120 generic.go:358] "Generic (PLEG): container finished" podID="f563b41f-83a2-4093-b167-d4e4a335986a" containerID="cf711f4d60ffe5afca6c10d9f1426bfd4744e88b550d6f0118f6f49dd63dc10b" exitCode=0 Mar 16 16:32:51 crc kubenswrapper[5120]: I0316 16:32:51.658408 5120 generic.go:358] "Generic (PLEG): container finished" podID="f563b41f-83a2-4093-b167-d4e4a335986a" containerID="209dc9257d849269285a2216b1c1bb2a8f87886b4927e1cd28028fcbd67da3e2" exitCode=2 Mar 16 16:32:51 crc kubenswrapper[5120]: I0316 16:32:51.658415 5120 generic.go:358] "Generic (PLEG): container finished" podID="f563b41f-83a2-4093-b167-d4e4a335986a" containerID="b6208a694882957c0c09eafdde432abef4c7042ccd108a7e96cb38fb14074db7" exitCode=0 Mar 16 16:32:51 crc kubenswrapper[5120]: I0316 16:32:51.658421 5120 generic.go:358] "Generic (PLEG): container finished" podID="f563b41f-83a2-4093-b167-d4e4a335986a" containerID="090a552e77af505fb9117d3156af00921a13ceede2f199b297039568e45924c9" exitCode=0 Mar 16 16:32:51 crc kubenswrapper[5120]: I0316 16:32:51.658541 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"f563b41f-83a2-4093-b167-d4e4a335986a","Type":"ContainerDied","Data":"cf711f4d60ffe5afca6c10d9f1426bfd4744e88b550d6f0118f6f49dd63dc10b"} Mar 16 16:32:51 crc kubenswrapper[5120]: I0316 16:32:51.658567 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"f563b41f-83a2-4093-b167-d4e4a335986a","Type":"ContainerDied","Data":"209dc9257d849269285a2216b1c1bb2a8f87886b4927e1cd28028fcbd67da3e2"} Mar 16 16:32:51 crc kubenswrapper[5120]: I0316 16:32:51.658576 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"f563b41f-83a2-4093-b167-d4e4a335986a","Type":"ContainerDied","Data":"b6208a694882957c0c09eafdde432abef4c7042ccd108a7e96cb38fb14074db7"} Mar 16 16:32:51 crc kubenswrapper[5120]: I0316 16:32:51.658583 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"f563b41f-83a2-4093-b167-d4e4a335986a","Type":"ContainerDied","Data":"090a552e77af505fb9117d3156af00921a13ceede2f199b297039568e45924c9"} Mar 16 16:32:51 crc kubenswrapper[5120]: I0316 16:32:51.673826 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"58a1579c-59e5-4830-8864-6e0bb86ea553","Type":"ContainerStarted","Data":"beef2fa020882673a2f2f9a3ac6ec8e82b1fa7a5c231ba0e3a8fdb2137d6fd99"} Mar 16 16:32:51 crc kubenswrapper[5120]: I0316 16:32:51.674044 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="58a1579c-59e5-4830-8864-6e0bb86ea553" containerName="cinder-api-log" containerID="cri-o://8852c4c7bfcc325ddd2dd315f62d6cdd322dffca571b64520e0bd913b4a33f91" gracePeriod=30 Mar 16 16:32:51 crc kubenswrapper[5120]: I0316 16:32:51.674357 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:32:51 crc kubenswrapper[5120]: I0316 16:32:51.674608 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="58a1579c-59e5-4830-8864-6e0bb86ea553" containerName="cinder-api" containerID="cri-o://beef2fa020882673a2f2f9a3ac6ec8e82b1fa7a5c231ba0e3a8fdb2137d6fd99" gracePeriod=30 Mar 16 16:32:51 crc kubenswrapper[5120]: I0316 16:32:51.674718 5120 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Mar 16 16:32:51 crc kubenswrapper[5120]: I0316 16:32:51.674725 5120 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Mar 16 16:32:51 crc kubenswrapper[5120]: I0316 16:32:51.675789 5120 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Mar 16 16:32:51 crc kubenswrapper[5120]: I0316 16:32:51.675805 5120 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Mar 16 16:32:51 crc kubenswrapper[5120]: I0316 16:32:51.677424 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-558fbfdd47-v976s"] Mar 16 16:32:51 crc kubenswrapper[5120]: I0316 16:32:51.677614 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-558fbfdd47-v976s" podUID="9a15bc36-5f09-421b-a175-df44f218f875" containerName="barbican-api-log" containerID="cri-o://e6fd592e7b69681015c9c5ee62b89fabe9eeb0eaac28a238ec9c5be8a7c13951" gracePeriod=30 Mar 16 16:32:51 crc kubenswrapper[5120]: I0316 16:32:51.677735 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-558fbfdd47-v976s" podUID="9a15bc36-5f09-421b-a175-df44f218f875" containerName="barbican-api" containerID="cri-o://5a27d444a2b29795a9e750d0543943d54446ab5493bef69e2cccf083124184bf" gracePeriod=30 Mar 16 16:32:51 crc kubenswrapper[5120]: I0316 16:32:51.697685 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openstack-kuttl-tests/barbican-api-558fbfdd47-v976s" podUID="9a15bc36-5f09-421b-a175-df44f218f875" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.0.154:9311/healthcheck\": EOF" Mar 16 16:32:51 crc kubenswrapper[5120]: I0316 16:32:51.698172 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-558fbfdd47-v976s" podUID="9a15bc36-5f09-421b-a175-df44f218f875" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.0.154:9311/healthcheck\": EOF" Mar 16 16:32:51 crc kubenswrapper[5120]: I0316 16:32:51.704932 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-558fbfdd47-v976s" podUID="9a15bc36-5f09-421b-a175-df44f218f875" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.0.154:9311/healthcheck\": EOF" Mar 16 16:32:51 crc kubenswrapper[5120]: I0316 16:32:51.709308 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-api-7d985d96b7-jk8xr"] Mar 16 16:32:51 crc kubenswrapper[5120]: I0316 16:32:51.721973 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-7d985d96b7-jk8xr" Mar 16 16:32:51 crc kubenswrapper[5120]: I0316 16:32:51.752320 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ebe474a7-759d-4e64-974d-fafd32020f70-config-data\") pod \"barbican-keystone-listener-7d8dbd4879-pzj6v\" (UID: \"ebe474a7-759d-4e64-974d-fafd32020f70\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7d8dbd4879-pzj6v" Mar 16 16:32:51 crc kubenswrapper[5120]: I0316 16:32:51.752366 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/000bd178-fd75-4c35-985c-1e2dd60a7c5e-combined-ca-bundle\") pod \"barbican-worker-665c46bb4d-7xhgk\" (UID: \"000bd178-fd75-4c35-985c-1e2dd60a7c5e\") " pod="openstack-kuttl-tests/barbican-worker-665c46bb4d-7xhgk" Mar 16 16:32:51 crc kubenswrapper[5120]: I0316 16:32:51.752416 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/000bd178-fd75-4c35-985c-1e2dd60a7c5e-config-data\") pod \"barbican-worker-665c46bb4d-7xhgk\" (UID: \"000bd178-fd75-4c35-985c-1e2dd60a7c5e\") " pod="openstack-kuttl-tests/barbican-worker-665c46bb4d-7xhgk" Mar 16 16:32:51 crc kubenswrapper[5120]: I0316 16:32:51.752440 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ebe474a7-759d-4e64-974d-fafd32020f70-combined-ca-bundle\") pod \"barbican-keystone-listener-7d8dbd4879-pzj6v\" (UID: \"ebe474a7-759d-4e64-974d-fafd32020f70\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7d8dbd4879-pzj6v" Mar 16 16:32:51 crc kubenswrapper[5120]: I0316 16:32:51.752493 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/000bd178-fd75-4c35-985c-1e2dd60a7c5e-config-data-custom\") pod \"barbican-worker-665c46bb4d-7xhgk\" (UID: \"000bd178-fd75-4c35-985c-1e2dd60a7c5e\") " pod="openstack-kuttl-tests/barbican-worker-665c46bb4d-7xhgk" Mar 16 16:32:51 crc kubenswrapper[5120]: I0316 16:32:51.752510 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpfsn\" (UniqueName: \"kubernetes.io/projected/000bd178-fd75-4c35-985c-1e2dd60a7c5e-kube-api-access-hpfsn\") pod \"barbican-worker-665c46bb4d-7xhgk\" (UID: \"000bd178-fd75-4c35-985c-1e2dd60a7c5e\") " pod="openstack-kuttl-tests/barbican-worker-665c46bb4d-7xhgk" Mar 16 16:32:51 crc kubenswrapper[5120]: I0316 16:32:51.752607 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ebe474a7-759d-4e64-974d-fafd32020f70-logs\") pod \"barbican-keystone-listener-7d8dbd4879-pzj6v\" (UID: \"ebe474a7-759d-4e64-974d-fafd32020f70\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7d8dbd4879-pzj6v" Mar 16 16:32:51 crc kubenswrapper[5120]: I0316 16:32:51.752653 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g4qsv\" (UniqueName: \"kubernetes.io/projected/ebe474a7-759d-4e64-974d-fafd32020f70-kube-api-access-g4qsv\") pod \"barbican-keystone-listener-7d8dbd4879-pzj6v\" (UID: \"ebe474a7-759d-4e64-974d-fafd32020f70\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7d8dbd4879-pzj6v" Mar 16 16:32:51 crc kubenswrapper[5120]: I0316 16:32:51.752771 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/ebe474a7-759d-4e64-974d-fafd32020f70-config-data-custom\") pod \"barbican-keystone-listener-7d8dbd4879-pzj6v\" (UID: \"ebe474a7-759d-4e64-974d-fafd32020f70\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7d8dbd4879-pzj6v" Mar 16 16:32:51 crc kubenswrapper[5120]: I0316 16:32:51.752882 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/000bd178-fd75-4c35-985c-1e2dd60a7c5e-logs\") pod \"barbican-worker-665c46bb4d-7xhgk\" (UID: \"000bd178-fd75-4c35-985c-1e2dd60a7c5e\") " pod="openstack-kuttl-tests/barbican-worker-665c46bb4d-7xhgk" Mar 16 16:32:51 crc kubenswrapper[5120]: I0316 16:32:51.762904 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/ebe474a7-759d-4e64-974d-fafd32020f70-config-data-custom\") pod \"barbican-keystone-listener-7d8dbd4879-pzj6v\" (UID: \"ebe474a7-759d-4e64-974d-fafd32020f70\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7d8dbd4879-pzj6v" Mar 16 16:32:51 crc kubenswrapper[5120]: I0316 16:32:51.766192 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ebe474a7-759d-4e64-974d-fafd32020f70-logs\") pod \"barbican-keystone-listener-7d8dbd4879-pzj6v\" (UID: \"ebe474a7-759d-4e64-974d-fafd32020f70\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7d8dbd4879-pzj6v" Mar 16 16:32:51 crc kubenswrapper[5120]: I0316 16:32:51.777956 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ebe474a7-759d-4e64-974d-fafd32020f70-config-data\") pod \"barbican-keystone-listener-7d8dbd4879-pzj6v\" (UID: \"ebe474a7-759d-4e64-974d-fafd32020f70\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7d8dbd4879-pzj6v" Mar 16 16:32:51 crc kubenswrapper[5120]: I0316 16:32:51.778488 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ebe474a7-759d-4e64-974d-fafd32020f70-combined-ca-bundle\") pod \"barbican-keystone-listener-7d8dbd4879-pzj6v\" (UID: \"ebe474a7-759d-4e64-974d-fafd32020f70\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7d8dbd4879-pzj6v" Mar 16 16:32:51 crc kubenswrapper[5120]: I0316 16:32:51.794058 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-7d985d96b7-jk8xr"] Mar 16 16:32:51 crc kubenswrapper[5120]: I0316 16:32:51.806170 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4qsv\" (UniqueName: \"kubernetes.io/projected/ebe474a7-759d-4e64-974d-fafd32020f70-kube-api-access-g4qsv\") pod \"barbican-keystone-listener-7d8dbd4879-pzj6v\" (UID: \"ebe474a7-759d-4e64-974d-fafd32020f70\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7d8dbd4879-pzj6v" Mar 16 16:32:51 crc kubenswrapper[5120]: I0316 16:32:51.834060 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-api-0" podStartSLOduration=5.834034327 podStartE2EDuration="5.834034327s" podCreationTimestamp="2026-03-16 16:32:46 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:32:51.700073191 +0000 UTC m=+3673.854004858" watchObservedRunningTime="2026-03-16 16:32:51.834034327 +0000 UTC m=+3673.987965984" Mar 16 16:32:51 crc kubenswrapper[5120]: I0316 16:32:51.858291 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/000bd178-fd75-4c35-985c-1e2dd60a7c5e-logs\") pod \"barbican-worker-665c46bb4d-7xhgk\" (UID: \"000bd178-fd75-4c35-985c-1e2dd60a7c5e\") " pod="openstack-kuttl-tests/barbican-worker-665c46bb4d-7xhgk" Mar 16 16:32:51 crc kubenswrapper[5120]: I0316 16:32:51.858553 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a2be00a2-fcd5-4862-aadf-b2947d6d138b-logs\") pod \"barbican-api-7d985d96b7-jk8xr\" (UID: \"a2be00a2-fcd5-4862-aadf-b2947d6d138b\") " pod="openstack-kuttl-tests/barbican-api-7d985d96b7-jk8xr" Mar 16 16:32:51 crc kubenswrapper[5120]: I0316 16:32:51.858728 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/000bd178-fd75-4c35-985c-1e2dd60a7c5e-combined-ca-bundle\") pod \"barbican-worker-665c46bb4d-7xhgk\" (UID: \"000bd178-fd75-4c35-985c-1e2dd60a7c5e\") " pod="openstack-kuttl-tests/barbican-worker-665c46bb4d-7xhgk" Mar 16 16:32:51 crc kubenswrapper[5120]: I0316 16:32:51.858850 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/000bd178-fd75-4c35-985c-1e2dd60a7c5e-config-data\") pod \"barbican-worker-665c46bb4d-7xhgk\" (UID: \"000bd178-fd75-4c35-985c-1e2dd60a7c5e\") " pod="openstack-kuttl-tests/barbican-worker-665c46bb4d-7xhgk" Mar 16 16:32:51 crc kubenswrapper[5120]: I0316 16:32:51.858986 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/a2be00a2-fcd5-4862-aadf-b2947d6d138b-internal-tls-certs\") pod \"barbican-api-7d985d96b7-jk8xr\" (UID: \"a2be00a2-fcd5-4862-aadf-b2947d6d138b\") " pod="openstack-kuttl-tests/barbican-api-7d985d96b7-jk8xr" Mar 16 16:32:51 crc kubenswrapper[5120]: I0316 16:32:51.859148 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2g64\" (UniqueName: \"kubernetes.io/projected/a2be00a2-fcd5-4862-aadf-b2947d6d138b-kube-api-access-v2g64\") pod \"barbican-api-7d985d96b7-jk8xr\" (UID: \"a2be00a2-fcd5-4862-aadf-b2947d6d138b\") " pod="openstack-kuttl-tests/barbican-api-7d985d96b7-jk8xr" Mar 16 16:32:51 crc kubenswrapper[5120]: I0316 16:32:51.859268 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/000bd178-fd75-4c35-985c-1e2dd60a7c5e-config-data-custom\") pod \"barbican-worker-665c46bb4d-7xhgk\" (UID: \"000bd178-fd75-4c35-985c-1e2dd60a7c5e\") " pod="openstack-kuttl-tests/barbican-worker-665c46bb4d-7xhgk" Mar 16 16:32:51 crc kubenswrapper[5120]: I0316 16:32:51.859364 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hpfsn\" (UniqueName: \"kubernetes.io/projected/000bd178-fd75-4c35-985c-1e2dd60a7c5e-kube-api-access-hpfsn\") pod \"barbican-worker-665c46bb4d-7xhgk\" (UID: \"000bd178-fd75-4c35-985c-1e2dd60a7c5e\") " pod="openstack-kuttl-tests/barbican-worker-665c46bb4d-7xhgk" Mar 16 16:32:51 crc kubenswrapper[5120]: I0316 16:32:51.859637 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a2be00a2-fcd5-4862-aadf-b2947d6d138b-config-data\") pod \"barbican-api-7d985d96b7-jk8xr\" (UID: \"a2be00a2-fcd5-4862-aadf-b2947d6d138b\") " pod="openstack-kuttl-tests/barbican-api-7d985d96b7-jk8xr" Mar 16 16:32:51 crc kubenswrapper[5120]: I0316 16:32:51.859729 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a2be00a2-fcd5-4862-aadf-b2947d6d138b-combined-ca-bundle\") pod \"barbican-api-7d985d96b7-jk8xr\" (UID: \"a2be00a2-fcd5-4862-aadf-b2947d6d138b\") " pod="openstack-kuttl-tests/barbican-api-7d985d96b7-jk8xr" Mar 16 16:32:51 crc kubenswrapper[5120]: I0316 16:32:51.859968 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/a2be00a2-fcd5-4862-aadf-b2947d6d138b-config-data-custom\") pod \"barbican-api-7d985d96b7-jk8xr\" (UID: \"a2be00a2-fcd5-4862-aadf-b2947d6d138b\") " pod="openstack-kuttl-tests/barbican-api-7d985d96b7-jk8xr" Mar 16 16:32:51 crc kubenswrapper[5120]: I0316 16:32:51.860068 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/a2be00a2-fcd5-4862-aadf-b2947d6d138b-public-tls-certs\") pod \"barbican-api-7d985d96b7-jk8xr\" (UID: \"a2be00a2-fcd5-4862-aadf-b2947d6d138b\") " pod="openstack-kuttl-tests/barbican-api-7d985d96b7-jk8xr" Mar 16 16:32:51 crc kubenswrapper[5120]: I0316 16:32:51.861787 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/000bd178-fd75-4c35-985c-1e2dd60a7c5e-logs\") pod \"barbican-worker-665c46bb4d-7xhgk\" (UID: \"000bd178-fd75-4c35-985c-1e2dd60a7c5e\") " pod="openstack-kuttl-tests/barbican-worker-665c46bb4d-7xhgk" Mar 16 16:32:51 crc kubenswrapper[5120]: I0316 16:32:51.894108 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/000bd178-fd75-4c35-985c-1e2dd60a7c5e-combined-ca-bundle\") pod \"barbican-worker-665c46bb4d-7xhgk\" (UID: \"000bd178-fd75-4c35-985c-1e2dd60a7c5e\") " pod="openstack-kuttl-tests/barbican-worker-665c46bb4d-7xhgk" Mar 16 16:32:51 crc kubenswrapper[5120]: I0316 16:32:51.894682 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-7d8dbd4879-pzj6v" Mar 16 16:32:51 crc kubenswrapper[5120]: I0316 16:32:51.898372 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/000bd178-fd75-4c35-985c-1e2dd60a7c5e-config-data\") pod \"barbican-worker-665c46bb4d-7xhgk\" (UID: \"000bd178-fd75-4c35-985c-1e2dd60a7c5e\") " pod="openstack-kuttl-tests/barbican-worker-665c46bb4d-7xhgk" Mar 16 16:32:51 crc kubenswrapper[5120]: I0316 16:32:51.919644 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpfsn\" (UniqueName: \"kubernetes.io/projected/000bd178-fd75-4c35-985c-1e2dd60a7c5e-kube-api-access-hpfsn\") pod \"barbican-worker-665c46bb4d-7xhgk\" (UID: \"000bd178-fd75-4c35-985c-1e2dd60a7c5e\") " pod="openstack-kuttl-tests/barbican-worker-665c46bb4d-7xhgk" Mar 16 16:32:51 crc kubenswrapper[5120]: I0316 16:32:51.930361 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/000bd178-fd75-4c35-985c-1e2dd60a7c5e-config-data-custom\") pod \"barbican-worker-665c46bb4d-7xhgk\" (UID: \"000bd178-fd75-4c35-985c-1e2dd60a7c5e\") " pod="openstack-kuttl-tests/barbican-worker-665c46bb4d-7xhgk" Mar 16 16:32:51 crc kubenswrapper[5120]: I0316 16:32:51.961835 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a2be00a2-fcd5-4862-aadf-b2947d6d138b-logs\") pod \"barbican-api-7d985d96b7-jk8xr\" (UID: \"a2be00a2-fcd5-4862-aadf-b2947d6d138b\") " pod="openstack-kuttl-tests/barbican-api-7d985d96b7-jk8xr" Mar 16 16:32:51 crc kubenswrapper[5120]: I0316 16:32:51.961968 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/a2be00a2-fcd5-4862-aadf-b2947d6d138b-internal-tls-certs\") pod \"barbican-api-7d985d96b7-jk8xr\" (UID: \"a2be00a2-fcd5-4862-aadf-b2947d6d138b\") " pod="openstack-kuttl-tests/barbican-api-7d985d96b7-jk8xr" Mar 16 16:32:51 crc kubenswrapper[5120]: I0316 16:32:51.961994 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v2g64\" (UniqueName: \"kubernetes.io/projected/a2be00a2-fcd5-4862-aadf-b2947d6d138b-kube-api-access-v2g64\") pod \"barbican-api-7d985d96b7-jk8xr\" (UID: \"a2be00a2-fcd5-4862-aadf-b2947d6d138b\") " pod="openstack-kuttl-tests/barbican-api-7d985d96b7-jk8xr" Mar 16 16:32:51 crc kubenswrapper[5120]: I0316 16:32:51.962046 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a2be00a2-fcd5-4862-aadf-b2947d6d138b-config-data\") pod \"barbican-api-7d985d96b7-jk8xr\" (UID: \"a2be00a2-fcd5-4862-aadf-b2947d6d138b\") " pod="openstack-kuttl-tests/barbican-api-7d985d96b7-jk8xr" Mar 16 16:32:51 crc kubenswrapper[5120]: I0316 16:32:51.962071 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a2be00a2-fcd5-4862-aadf-b2947d6d138b-combined-ca-bundle\") pod \"barbican-api-7d985d96b7-jk8xr\" (UID: \"a2be00a2-fcd5-4862-aadf-b2947d6d138b\") " pod="openstack-kuttl-tests/barbican-api-7d985d96b7-jk8xr" Mar 16 16:32:51 crc kubenswrapper[5120]: I0316 16:32:51.962119 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/a2be00a2-fcd5-4862-aadf-b2947d6d138b-config-data-custom\") pod \"barbican-api-7d985d96b7-jk8xr\" (UID: \"a2be00a2-fcd5-4862-aadf-b2947d6d138b\") " pod="openstack-kuttl-tests/barbican-api-7d985d96b7-jk8xr" Mar 16 16:32:51 crc kubenswrapper[5120]: I0316 16:32:51.962137 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/a2be00a2-fcd5-4862-aadf-b2947d6d138b-public-tls-certs\") pod \"barbican-api-7d985d96b7-jk8xr\" (UID: \"a2be00a2-fcd5-4862-aadf-b2947d6d138b\") " pod="openstack-kuttl-tests/barbican-api-7d985d96b7-jk8xr" Mar 16 16:32:51 crc kubenswrapper[5120]: I0316 16:32:51.962853 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a2be00a2-fcd5-4862-aadf-b2947d6d138b-logs\") pod \"barbican-api-7d985d96b7-jk8xr\" (UID: \"a2be00a2-fcd5-4862-aadf-b2947d6d138b\") " pod="openstack-kuttl-tests/barbican-api-7d985d96b7-jk8xr" Mar 16 16:32:51 crc kubenswrapper[5120]: I0316 16:32:51.967469 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/a2be00a2-fcd5-4862-aadf-b2947d6d138b-public-tls-certs\") pod \"barbican-api-7d985d96b7-jk8xr\" (UID: \"a2be00a2-fcd5-4862-aadf-b2947d6d138b\") " pod="openstack-kuttl-tests/barbican-api-7d985d96b7-jk8xr" Mar 16 16:32:51 crc kubenswrapper[5120]: I0316 16:32:51.970546 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/a2be00a2-fcd5-4862-aadf-b2947d6d138b-internal-tls-certs\") pod \"barbican-api-7d985d96b7-jk8xr\" (UID: \"a2be00a2-fcd5-4862-aadf-b2947d6d138b\") " pod="openstack-kuttl-tests/barbican-api-7d985d96b7-jk8xr" Mar 16 16:32:51 crc kubenswrapper[5120]: I0316 16:32:51.971177 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a2be00a2-fcd5-4862-aadf-b2947d6d138b-combined-ca-bundle\") pod \"barbican-api-7d985d96b7-jk8xr\" (UID: \"a2be00a2-fcd5-4862-aadf-b2947d6d138b\") " pod="openstack-kuttl-tests/barbican-api-7d985d96b7-jk8xr" Mar 16 16:32:51 crc kubenswrapper[5120]: I0316 16:32:51.972156 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a2be00a2-fcd5-4862-aadf-b2947d6d138b-config-data\") pod \"barbican-api-7d985d96b7-jk8xr\" (UID: \"a2be00a2-fcd5-4862-aadf-b2947d6d138b\") " pod="openstack-kuttl-tests/barbican-api-7d985d96b7-jk8xr" Mar 16 16:32:51 crc kubenswrapper[5120]: I0316 16:32:51.975926 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/a2be00a2-fcd5-4862-aadf-b2947d6d138b-config-data-custom\") pod \"barbican-api-7d985d96b7-jk8xr\" (UID: \"a2be00a2-fcd5-4862-aadf-b2947d6d138b\") " pod="openstack-kuttl-tests/barbican-api-7d985d96b7-jk8xr" Mar 16 16:32:51 crc kubenswrapper[5120]: I0316 16:32:51.984344 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2g64\" (UniqueName: \"kubernetes.io/projected/a2be00a2-fcd5-4862-aadf-b2947d6d138b-kube-api-access-v2g64\") pod \"barbican-api-7d985d96b7-jk8xr\" (UID: \"a2be00a2-fcd5-4862-aadf-b2947d6d138b\") " pod="openstack-kuttl-tests/barbican-api-7d985d96b7-jk8xr" Mar 16 16:32:52 crc kubenswrapper[5120]: I0316 16:32:52.026073 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:32:52 crc kubenswrapper[5120]: I0316 16:32:52.157729 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:32:52 crc kubenswrapper[5120]: I0316 16:32:52.207124 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-665c46bb4d-7xhgk" Mar 16 16:32:52 crc kubenswrapper[5120]: I0316 16:32:52.268721 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pfxt7\" (UniqueName: \"kubernetes.io/projected/f563b41f-83a2-4093-b167-d4e4a335986a-kube-api-access-pfxt7\") pod \"f563b41f-83a2-4093-b167-d4e4a335986a\" (UID: \"f563b41f-83a2-4093-b167-d4e4a335986a\") " Mar 16 16:32:52 crc kubenswrapper[5120]: I0316 16:32:52.268961 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f563b41f-83a2-4093-b167-d4e4a335986a-config-data\") pod \"f563b41f-83a2-4093-b167-d4e4a335986a\" (UID: \"f563b41f-83a2-4093-b167-d4e4a335986a\") " Mar 16 16:32:52 crc kubenswrapper[5120]: I0316 16:32:52.268992 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f563b41f-83a2-4093-b167-d4e4a335986a-scripts\") pod \"f563b41f-83a2-4093-b167-d4e4a335986a\" (UID: \"f563b41f-83a2-4093-b167-d4e4a335986a\") " Mar 16 16:32:52 crc kubenswrapper[5120]: I0316 16:32:52.269077 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/f563b41f-83a2-4093-b167-d4e4a335986a-sg-core-conf-yaml\") pod \"f563b41f-83a2-4093-b167-d4e4a335986a\" (UID: \"f563b41f-83a2-4093-b167-d4e4a335986a\") " Mar 16 16:32:52 crc kubenswrapper[5120]: I0316 16:32:52.269192 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f563b41f-83a2-4093-b167-d4e4a335986a-log-httpd\") pod \"f563b41f-83a2-4093-b167-d4e4a335986a\" (UID: \"f563b41f-83a2-4093-b167-d4e4a335986a\") " Mar 16 16:32:52 crc kubenswrapper[5120]: I0316 16:32:52.269237 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f563b41f-83a2-4093-b167-d4e4a335986a-combined-ca-bundle\") pod \"f563b41f-83a2-4093-b167-d4e4a335986a\" (UID: \"f563b41f-83a2-4093-b167-d4e4a335986a\") " Mar 16 16:32:52 crc kubenswrapper[5120]: I0316 16:32:52.269289 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f563b41f-83a2-4093-b167-d4e4a335986a-run-httpd\") pod \"f563b41f-83a2-4093-b167-d4e4a335986a\" (UID: \"f563b41f-83a2-4093-b167-d4e4a335986a\") " Mar 16 16:32:52 crc kubenswrapper[5120]: I0316 16:32:52.271603 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f563b41f-83a2-4093-b167-d4e4a335986a-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "f563b41f-83a2-4093-b167-d4e4a335986a" (UID: "f563b41f-83a2-4093-b167-d4e4a335986a"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:32:52 crc kubenswrapper[5120]: I0316 16:32:52.273147 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f563b41f-83a2-4093-b167-d4e4a335986a-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "f563b41f-83a2-4093-b167-d4e4a335986a" (UID: "f563b41f-83a2-4093-b167-d4e4a335986a"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:32:52 crc kubenswrapper[5120]: I0316 16:32:52.282726 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-7d985d96b7-jk8xr" Mar 16 16:32:52 crc kubenswrapper[5120]: I0316 16:32:52.284299 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f563b41f-83a2-4093-b167-d4e4a335986a-kube-api-access-pfxt7" (OuterVolumeSpecName: "kube-api-access-pfxt7") pod "f563b41f-83a2-4093-b167-d4e4a335986a" (UID: "f563b41f-83a2-4093-b167-d4e4a335986a"). InnerVolumeSpecName "kube-api-access-pfxt7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:32:52 crc kubenswrapper[5120]: I0316 16:32:52.292030 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f563b41f-83a2-4093-b167-d4e4a335986a-scripts" (OuterVolumeSpecName: "scripts") pod "f563b41f-83a2-4093-b167-d4e4a335986a" (UID: "f563b41f-83a2-4093-b167-d4e4a335986a"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:32:52 crc kubenswrapper[5120]: I0316 16:32:52.333638 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f563b41f-83a2-4093-b167-d4e4a335986a-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "f563b41f-83a2-4093-b167-d4e4a335986a" (UID: "f563b41f-83a2-4093-b167-d4e4a335986a"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:32:52 crc kubenswrapper[5120]: I0316 16:32:52.372550 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pfxt7\" (UniqueName: \"kubernetes.io/projected/f563b41f-83a2-4093-b167-d4e4a335986a-kube-api-access-pfxt7\") on node \"crc\" DevicePath \"\"" Mar 16 16:32:52 crc kubenswrapper[5120]: I0316 16:32:52.372584 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f563b41f-83a2-4093-b167-d4e4a335986a-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:32:52 crc kubenswrapper[5120]: I0316 16:32:52.372594 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/f563b41f-83a2-4093-b167-d4e4a335986a-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 16:32:52 crc kubenswrapper[5120]: I0316 16:32:52.372603 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f563b41f-83a2-4093-b167-d4e4a335986a-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:32:52 crc kubenswrapper[5120]: I0316 16:32:52.372611 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f563b41f-83a2-4093-b167-d4e4a335986a-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:32:52 crc kubenswrapper[5120]: I0316 16:32:52.426932 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f563b41f-83a2-4093-b167-d4e4a335986a-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f563b41f-83a2-4093-b167-d4e4a335986a" (UID: "f563b41f-83a2-4093-b167-d4e4a335986a"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:32:52 crc kubenswrapper[5120]: I0316 16:32:52.451868 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f563b41f-83a2-4093-b167-d4e4a335986a-config-data" (OuterVolumeSpecName: "config-data") pod "f563b41f-83a2-4093-b167-d4e4a335986a" (UID: "f563b41f-83a2-4093-b167-d4e4a335986a"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:32:52 crc kubenswrapper[5120]: I0316 16:32:52.474864 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f563b41f-83a2-4093-b167-d4e4a335986a-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:32:52 crc kubenswrapper[5120]: I0316 16:32:52.474899 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f563b41f-83a2-4093-b167-d4e4a335986a-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:32:52 crc kubenswrapper[5120]: I0316 16:32:52.531588 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:32:52 crc kubenswrapper[5120]: I0316 16:32:52.606430 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:32:52 crc kubenswrapper[5120]: I0316 16:32:52.642463 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:32:52 crc kubenswrapper[5120]: I0316 16:32:52.643573 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:32:52 crc kubenswrapper[5120]: I0316 16:32:52.645069 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-7d8dbd4879-pzj6v"] Mar 16 16:32:52 crc kubenswrapper[5120]: I0316 16:32:52.718317 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-7d8dbd4879-pzj6v" event={"ID":"ebe474a7-759d-4e64-974d-fafd32020f70","Type":"ContainerStarted","Data":"c6c99f8df7bd78406d442c23284e42edcd2bf8d87d5fd1aa43583cba6ce57b64"} Mar 16 16:32:52 crc kubenswrapper[5120]: I0316 16:32:52.740460 5120 generic.go:358] "Generic (PLEG): container finished" podID="9a15bc36-5f09-421b-a175-df44f218f875" containerID="e6fd592e7b69681015c9c5ee62b89fabe9eeb0eaac28a238ec9c5be8a7c13951" exitCode=143 Mar 16 16:32:52 crc kubenswrapper[5120]: I0316 16:32:52.740885 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-558fbfdd47-v976s" event={"ID":"9a15bc36-5f09-421b-a175-df44f218f875","Type":"ContainerDied","Data":"e6fd592e7b69681015c9c5ee62b89fabe9eeb0eaac28a238ec9c5be8a7c13951"} Mar 16 16:32:52 crc kubenswrapper[5120]: I0316 16:32:52.755484 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"f563b41f-83a2-4093-b167-d4e4a335986a","Type":"ContainerDied","Data":"98fe037e715e8bffd7d2b357ef712fa6fa70affcb7ddb16ba8eaf50dbbbe2c98"} Mar 16 16:32:52 crc kubenswrapper[5120]: I0316 16:32:52.755532 5120 scope.go:117] "RemoveContainer" containerID="cf711f4d60ffe5afca6c10d9f1426bfd4744e88b550d6f0118f6f49dd63dc10b" Mar 16 16:32:52 crc kubenswrapper[5120]: I0316 16:32:52.755684 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:32:52 crc kubenswrapper[5120]: I0316 16:32:52.765235 5120 generic.go:358] "Generic (PLEG): container finished" podID="58a1579c-59e5-4830-8864-6e0bb86ea553" containerID="beef2fa020882673a2f2f9a3ac6ec8e82b1fa7a5c231ba0e3a8fdb2137d6fd99" exitCode=0 Mar 16 16:32:52 crc kubenswrapper[5120]: I0316 16:32:52.765260 5120 generic.go:358] "Generic (PLEG): container finished" podID="58a1579c-59e5-4830-8864-6e0bb86ea553" containerID="8852c4c7bfcc325ddd2dd315f62d6cdd322dffca571b64520e0bd913b4a33f91" exitCode=143 Mar 16 16:32:52 crc kubenswrapper[5120]: I0316 16:32:52.766255 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"58a1579c-59e5-4830-8864-6e0bb86ea553","Type":"ContainerDied","Data":"beef2fa020882673a2f2f9a3ac6ec8e82b1fa7a5c231ba0e3a8fdb2137d6fd99"} Mar 16 16:32:52 crc kubenswrapper[5120]: I0316 16:32:52.766287 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"58a1579c-59e5-4830-8864-6e0bb86ea553","Type":"ContainerDied","Data":"8852c4c7bfcc325ddd2dd315f62d6cdd322dffca571b64520e0bd913b4a33f91"} Mar 16 16:32:52 crc kubenswrapper[5120]: I0316 16:32:52.790962 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:32:52 crc kubenswrapper[5120]: I0316 16:32:52.807401 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:32:52 crc kubenswrapper[5120]: I0316 16:32:52.815261 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:32:52 crc kubenswrapper[5120]: I0316 16:32:52.816663 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f563b41f-83a2-4093-b167-d4e4a335986a" containerName="ceilometer-central-agent" Mar 16 16:32:52 crc kubenswrapper[5120]: I0316 16:32:52.816686 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f563b41f-83a2-4093-b167-d4e4a335986a" containerName="ceilometer-central-agent" Mar 16 16:32:52 crc kubenswrapper[5120]: I0316 16:32:52.816698 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f563b41f-83a2-4093-b167-d4e4a335986a" containerName="ceilometer-notification-agent" Mar 16 16:32:52 crc kubenswrapper[5120]: I0316 16:32:52.816705 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f563b41f-83a2-4093-b167-d4e4a335986a" containerName="ceilometer-notification-agent" Mar 16 16:32:52 crc kubenswrapper[5120]: I0316 16:32:52.816775 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f563b41f-83a2-4093-b167-d4e4a335986a" containerName="sg-core" Mar 16 16:32:52 crc kubenswrapper[5120]: I0316 16:32:52.824599 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f563b41f-83a2-4093-b167-d4e4a335986a" containerName="sg-core" Mar 16 16:32:52 crc kubenswrapper[5120]: I0316 16:32:52.824644 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f563b41f-83a2-4093-b167-d4e4a335986a" containerName="proxy-httpd" Mar 16 16:32:52 crc kubenswrapper[5120]: I0316 16:32:52.824651 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f563b41f-83a2-4093-b167-d4e4a335986a" containerName="proxy-httpd" Mar 16 16:32:52 crc kubenswrapper[5120]: I0316 16:32:52.825118 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f563b41f-83a2-4093-b167-d4e4a335986a" containerName="proxy-httpd" Mar 16 16:32:52 crc kubenswrapper[5120]: I0316 16:32:52.825140 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f563b41f-83a2-4093-b167-d4e4a335986a" containerName="ceilometer-central-agent" Mar 16 16:32:52 crc kubenswrapper[5120]: I0316 16:32:52.825165 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f563b41f-83a2-4093-b167-d4e4a335986a" containerName="ceilometer-notification-agent" Mar 16 16:32:52 crc kubenswrapper[5120]: I0316 16:32:52.825173 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f563b41f-83a2-4093-b167-d4e4a335986a" containerName="sg-core" Mar 16 16:32:52 crc kubenswrapper[5120]: I0316 16:32:52.837093 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:32:52 crc kubenswrapper[5120]: I0316 16:32:52.839505 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 16:32:52 crc kubenswrapper[5120]: I0316 16:32:52.844275 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 16:32:52 crc kubenswrapper[5120]: I0316 16:32:52.873369 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:32:52 crc kubenswrapper[5120]: I0316 16:32:52.893249 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/67fe9146-c519-453c-8f10-76ae241f8889-scripts\") pod \"ceilometer-0\" (UID: \"67fe9146-c519-453c-8f10-76ae241f8889\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:32:52 crc kubenswrapper[5120]: I0316 16:32:52.893363 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzrrw\" (UniqueName: \"kubernetes.io/projected/67fe9146-c519-453c-8f10-76ae241f8889-kube-api-access-hzrrw\") pod \"ceilometer-0\" (UID: \"67fe9146-c519-453c-8f10-76ae241f8889\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:32:52 crc kubenswrapper[5120]: I0316 16:32:52.893392 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/67fe9146-c519-453c-8f10-76ae241f8889-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"67fe9146-c519-453c-8f10-76ae241f8889\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:32:52 crc kubenswrapper[5120]: I0316 16:32:52.893423 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/67fe9146-c519-453c-8f10-76ae241f8889-log-httpd\") pod \"ceilometer-0\" (UID: \"67fe9146-c519-453c-8f10-76ae241f8889\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:32:52 crc kubenswrapper[5120]: I0316 16:32:52.893616 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/67fe9146-c519-453c-8f10-76ae241f8889-config-data\") pod \"ceilometer-0\" (UID: \"67fe9146-c519-453c-8f10-76ae241f8889\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:32:52 crc kubenswrapper[5120]: I0316 16:32:52.893692 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/67fe9146-c519-453c-8f10-76ae241f8889-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"67fe9146-c519-453c-8f10-76ae241f8889\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:32:52 crc kubenswrapper[5120]: I0316 16:32:52.893724 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/67fe9146-c519-453c-8f10-76ae241f8889-run-httpd\") pod \"ceilometer-0\" (UID: \"67fe9146-c519-453c-8f10-76ae241f8889\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:32:52 crc kubenswrapper[5120]: I0316 16:32:52.963723 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:32:53 crc kubenswrapper[5120]: I0316 16:32:52.996209 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/67fe9146-c519-453c-8f10-76ae241f8889-config-data\") pod \"ceilometer-0\" (UID: \"67fe9146-c519-453c-8f10-76ae241f8889\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:32:53 crc kubenswrapper[5120]: I0316 16:32:52.996266 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/67fe9146-c519-453c-8f10-76ae241f8889-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"67fe9146-c519-453c-8f10-76ae241f8889\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:32:53 crc kubenswrapper[5120]: I0316 16:32:52.996285 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/67fe9146-c519-453c-8f10-76ae241f8889-run-httpd\") pod \"ceilometer-0\" (UID: \"67fe9146-c519-453c-8f10-76ae241f8889\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:32:53 crc kubenswrapper[5120]: I0316 16:32:52.996452 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/67fe9146-c519-453c-8f10-76ae241f8889-scripts\") pod \"ceilometer-0\" (UID: \"67fe9146-c519-453c-8f10-76ae241f8889\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:32:53 crc kubenswrapper[5120]: I0316 16:32:52.996495 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hzrrw\" (UniqueName: \"kubernetes.io/projected/67fe9146-c519-453c-8f10-76ae241f8889-kube-api-access-hzrrw\") pod \"ceilometer-0\" (UID: \"67fe9146-c519-453c-8f10-76ae241f8889\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:32:53 crc kubenswrapper[5120]: I0316 16:32:52.996511 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/67fe9146-c519-453c-8f10-76ae241f8889-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"67fe9146-c519-453c-8f10-76ae241f8889\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:32:53 crc kubenswrapper[5120]: I0316 16:32:52.996531 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/67fe9146-c519-453c-8f10-76ae241f8889-log-httpd\") pod \"ceilometer-0\" (UID: \"67fe9146-c519-453c-8f10-76ae241f8889\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:32:53 crc kubenswrapper[5120]: I0316 16:32:52.998296 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/67fe9146-c519-453c-8f10-76ae241f8889-log-httpd\") pod \"ceilometer-0\" (UID: \"67fe9146-c519-453c-8f10-76ae241f8889\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:32:53 crc kubenswrapper[5120]: I0316 16:32:53.002120 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/67fe9146-c519-453c-8f10-76ae241f8889-run-httpd\") pod \"ceilometer-0\" (UID: \"67fe9146-c519-453c-8f10-76ae241f8889\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:32:53 crc kubenswrapper[5120]: I0316 16:32:53.010163 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/67fe9146-c519-453c-8f10-76ae241f8889-config-data\") pod \"ceilometer-0\" (UID: \"67fe9146-c519-453c-8f10-76ae241f8889\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:32:53 crc kubenswrapper[5120]: I0316 16:32:53.014543 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/67fe9146-c519-453c-8f10-76ae241f8889-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"67fe9146-c519-453c-8f10-76ae241f8889\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:32:53 crc kubenswrapper[5120]: I0316 16:32:53.020591 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/67fe9146-c519-453c-8f10-76ae241f8889-scripts\") pod \"ceilometer-0\" (UID: \"67fe9146-c519-453c-8f10-76ae241f8889\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:32:53 crc kubenswrapper[5120]: I0316 16:32:53.021666 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/67fe9146-c519-453c-8f10-76ae241f8889-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"67fe9146-c519-453c-8f10-76ae241f8889\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:32:53 crc kubenswrapper[5120]: I0316 16:32:53.024688 5120 scope.go:117] "RemoveContainer" containerID="209dc9257d849269285a2216b1c1bb2a8f87886b4927e1cd28028fcbd67da3e2" Mar 16 16:32:53 crc kubenswrapper[5120]: I0316 16:32:53.031010 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzrrw\" (UniqueName: \"kubernetes.io/projected/67fe9146-c519-453c-8f10-76ae241f8889-kube-api-access-hzrrw\") pod \"ceilometer-0\" (UID: \"67fe9146-c519-453c-8f10-76ae241f8889\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:32:53 crc kubenswrapper[5120]: I0316 16:32:53.102497 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/58a1579c-59e5-4830-8864-6e0bb86ea553-combined-ca-bundle\") pod \"58a1579c-59e5-4830-8864-6e0bb86ea553\" (UID: \"58a1579c-59e5-4830-8864-6e0bb86ea553\") " Mar 16 16:32:53 crc kubenswrapper[5120]: I0316 16:32:53.102614 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/58a1579c-59e5-4830-8864-6e0bb86ea553-config-data-custom\") pod \"58a1579c-59e5-4830-8864-6e0bb86ea553\" (UID: \"58a1579c-59e5-4830-8864-6e0bb86ea553\") " Mar 16 16:32:53 crc kubenswrapper[5120]: I0316 16:32:53.103062 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/58a1579c-59e5-4830-8864-6e0bb86ea553-logs\") pod \"58a1579c-59e5-4830-8864-6e0bb86ea553\" (UID: \"58a1579c-59e5-4830-8864-6e0bb86ea553\") " Mar 16 16:32:53 crc kubenswrapper[5120]: I0316 16:32:53.103135 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/58a1579c-59e5-4830-8864-6e0bb86ea553-scripts\") pod \"58a1579c-59e5-4830-8864-6e0bb86ea553\" (UID: \"58a1579c-59e5-4830-8864-6e0bb86ea553\") " Mar 16 16:32:53 crc kubenswrapper[5120]: I0316 16:32:53.103304 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ggvf7\" (UniqueName: \"kubernetes.io/projected/58a1579c-59e5-4830-8864-6e0bb86ea553-kube-api-access-ggvf7\") pod \"58a1579c-59e5-4830-8864-6e0bb86ea553\" (UID: \"58a1579c-59e5-4830-8864-6e0bb86ea553\") " Mar 16 16:32:53 crc kubenswrapper[5120]: I0316 16:32:53.103375 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/58a1579c-59e5-4830-8864-6e0bb86ea553-config-data\") pod \"58a1579c-59e5-4830-8864-6e0bb86ea553\" (UID: \"58a1579c-59e5-4830-8864-6e0bb86ea553\") " Mar 16 16:32:53 crc kubenswrapper[5120]: I0316 16:32:53.103442 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/58a1579c-59e5-4830-8864-6e0bb86ea553-etc-machine-id\") pod \"58a1579c-59e5-4830-8864-6e0bb86ea553\" (UID: \"58a1579c-59e5-4830-8864-6e0bb86ea553\") " Mar 16 16:32:53 crc kubenswrapper[5120]: I0316 16:32:53.104394 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/58a1579c-59e5-4830-8864-6e0bb86ea553-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "58a1579c-59e5-4830-8864-6e0bb86ea553" (UID: "58a1579c-59e5-4830-8864-6e0bb86ea553"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 16:32:53 crc kubenswrapper[5120]: I0316 16:32:53.109380 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58a1579c-59e5-4830-8864-6e0bb86ea553-logs" (OuterVolumeSpecName: "logs") pod "58a1579c-59e5-4830-8864-6e0bb86ea553" (UID: "58a1579c-59e5-4830-8864-6e0bb86ea553"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:32:53 crc kubenswrapper[5120]: I0316 16:32:53.111918 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58a1579c-59e5-4830-8864-6e0bb86ea553-scripts" (OuterVolumeSpecName: "scripts") pod "58a1579c-59e5-4830-8864-6e0bb86ea553" (UID: "58a1579c-59e5-4830-8864-6e0bb86ea553"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:32:53 crc kubenswrapper[5120]: I0316 16:32:53.117219 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58a1579c-59e5-4830-8864-6e0bb86ea553-kube-api-access-ggvf7" (OuterVolumeSpecName: "kube-api-access-ggvf7") pod "58a1579c-59e5-4830-8864-6e0bb86ea553" (UID: "58a1579c-59e5-4830-8864-6e0bb86ea553"). InnerVolumeSpecName "kube-api-access-ggvf7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:32:53 crc kubenswrapper[5120]: I0316 16:32:53.118288 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58a1579c-59e5-4830-8864-6e0bb86ea553-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "58a1579c-59e5-4830-8864-6e0bb86ea553" (UID: "58a1579c-59e5-4830-8864-6e0bb86ea553"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:32:53 crc kubenswrapper[5120]: I0316 16:32:53.130078 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-665c46bb4d-7xhgk"] Mar 16 16:32:53 crc kubenswrapper[5120]: I0316 16:32:53.133193 5120 scope.go:117] "RemoveContainer" containerID="b6208a694882957c0c09eafdde432abef4c7042ccd108a7e96cb38fb14074db7" Mar 16 16:32:53 crc kubenswrapper[5120]: I0316 16:32:53.182977 5120 scope.go:117] "RemoveContainer" containerID="090a552e77af505fb9117d3156af00921a13ceede2f199b297039568e45924c9" Mar 16 16:32:53 crc kubenswrapper[5120]: I0316 16:32:53.186863 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58a1579c-59e5-4830-8864-6e0bb86ea553-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "58a1579c-59e5-4830-8864-6e0bb86ea553" (UID: "58a1579c-59e5-4830-8864-6e0bb86ea553"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:32:53 crc kubenswrapper[5120]: I0316 16:32:53.206922 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/58a1579c-59e5-4830-8864-6e0bb86ea553-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:32:53 crc kubenswrapper[5120]: I0316 16:32:53.206952 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/58a1579c-59e5-4830-8864-6e0bb86ea553-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:32:53 crc kubenswrapper[5120]: I0316 16:32:53.206962 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/58a1579c-59e5-4830-8864-6e0bb86ea553-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:32:53 crc kubenswrapper[5120]: I0316 16:32:53.206970 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ggvf7\" (UniqueName: \"kubernetes.io/projected/58a1579c-59e5-4830-8864-6e0bb86ea553-kube-api-access-ggvf7\") on node \"crc\" DevicePath \"\"" Mar 16 16:32:53 crc kubenswrapper[5120]: I0316 16:32:53.206981 5120 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/58a1579c-59e5-4830-8864-6e0bb86ea553-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 16:32:53 crc kubenswrapper[5120]: I0316 16:32:53.206989 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/58a1579c-59e5-4830-8864-6e0bb86ea553-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:32:53 crc kubenswrapper[5120]: I0316 16:32:53.226082 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58a1579c-59e5-4830-8864-6e0bb86ea553-config-data" (OuterVolumeSpecName: "config-data") pod "58a1579c-59e5-4830-8864-6e0bb86ea553" (UID: "58a1579c-59e5-4830-8864-6e0bb86ea553"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:32:53 crc kubenswrapper[5120]: I0316 16:32:53.279294 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:32:53 crc kubenswrapper[5120]: I0316 16:32:53.317078 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/58a1579c-59e5-4830-8864-6e0bb86ea553-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:32:53 crc kubenswrapper[5120]: I0316 16:32:53.372095 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-7d985d96b7-jk8xr"] Mar 16 16:32:53 crc kubenswrapper[5120]: W0316 16:32:53.378625 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda2be00a2_fcd5_4862_aadf_b2947d6d138b.slice/crio-4bef52102966475fede0a43a9c81dab880961b4acd612f6d18e3d43adfcb9939 WatchSource:0}: Error finding container 4bef52102966475fede0a43a9c81dab880961b4acd612f6d18e3d43adfcb9939: Status 404 returned error can't find the container with id 4bef52102966475fede0a43a9c81dab880961b4acd612f6d18e3d43adfcb9939 Mar 16 16:32:53 crc kubenswrapper[5120]: I0316 16:32:53.818389 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-7d8dbd4879-pzj6v" event={"ID":"ebe474a7-759d-4e64-974d-fafd32020f70","Type":"ContainerStarted","Data":"dd9eb8403f4030118d3b36ba746e82ca91a3cfe3c961ee54d747966b9a45d5b7"} Mar 16 16:32:53 crc kubenswrapper[5120]: I0316 16:32:53.818858 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-7d8dbd4879-pzj6v" event={"ID":"ebe474a7-759d-4e64-974d-fafd32020f70","Type":"ContainerStarted","Data":"eda27ff3b94a96a06a6622ff993e4e8c3cf41581cfe4ab3b447a062892589cb0"} Mar 16 16:32:53 crc kubenswrapper[5120]: I0316 16:32:53.835463 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-7d985d96b7-jk8xr" event={"ID":"a2be00a2-fcd5-4862-aadf-b2947d6d138b","Type":"ContainerStarted","Data":"11f572bb3df0bc5e7708e98ac5a8d05753561c760e4a29bd7ced507de9fdbda2"} Mar 16 16:32:53 crc kubenswrapper[5120]: I0316 16:32:53.835751 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-7d985d96b7-jk8xr" event={"ID":"a2be00a2-fcd5-4862-aadf-b2947d6d138b","Type":"ContainerStarted","Data":"4bef52102966475fede0a43a9c81dab880961b4acd612f6d18e3d43adfcb9939"} Mar 16 16:32:53 crc kubenswrapper[5120]: I0316 16:32:53.859500 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"58a1579c-59e5-4830-8864-6e0bb86ea553","Type":"ContainerDied","Data":"daa5795127b1c15392732751fff3cdd4929f88b395cef1bcc56a4ef150a7f779"} Mar 16 16:32:53 crc kubenswrapper[5120]: I0316 16:32:53.859549 5120 scope.go:117] "RemoveContainer" containerID="beef2fa020882673a2f2f9a3ac6ec8e82b1fa7a5c231ba0e3a8fdb2137d6fd99" Mar 16 16:32:53 crc kubenswrapper[5120]: I0316 16:32:53.859683 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:32:53 crc kubenswrapper[5120]: I0316 16:32:53.896853 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:32:53 crc kubenswrapper[5120]: I0316 16:32:53.905165 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-665c46bb4d-7xhgk" event={"ID":"000bd178-fd75-4c35-985c-1e2dd60a7c5e","Type":"ContainerStarted","Data":"991fab175bf58adabc385c61a11ffb100168afab5737d5474c6261641322a276"} Mar 16 16:32:53 crc kubenswrapper[5120]: I0316 16:32:53.905217 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-665c46bb4d-7xhgk" event={"ID":"000bd178-fd75-4c35-985c-1e2dd60a7c5e","Type":"ContainerStarted","Data":"08a9e88c90cd9c79e7c4045a39c01661f3c530c9d9689f749173b311825c8645"} Mar 16 16:32:53 crc kubenswrapper[5120]: I0316 16:32:53.905229 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-665c46bb4d-7xhgk" event={"ID":"000bd178-fd75-4c35-985c-1e2dd60a7c5e","Type":"ContainerStarted","Data":"14e5d34a134946386f8bc40e6a621d4576cb2696b4c3d201c16984b7bf0f2f66"} Mar 16 16:32:53 crc kubenswrapper[5120]: I0316 16:32:53.907893 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-keystone-listener-7d8dbd4879-pzj6v" podStartSLOduration=2.907873357 podStartE2EDuration="2.907873357s" podCreationTimestamp="2026-03-16 16:32:51 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:32:53.842996489 +0000 UTC m=+3675.996928146" watchObservedRunningTime="2026-03-16 16:32:53.907873357 +0000 UTC m=+3676.061805014" Mar 16 16:32:53 crc kubenswrapper[5120]: I0316 16:32:53.938117 5120 scope.go:117] "RemoveContainer" containerID="8852c4c7bfcc325ddd2dd315f62d6cdd322dffca571b64520e0bd913b4a33f91" Mar 16 16:32:53 crc kubenswrapper[5120]: I0316 16:32:53.942076 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-6f799fddf5-d8q8w"] Mar 16 16:32:53 crc kubenswrapper[5120]: I0316 16:32:53.942355 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-6f799fddf5-d8q8w" podUID="482fd661-96ea-439b-8cd7-ee5a5321e981" containerName="barbican-keystone-listener-log" containerID="cri-o://296d6bcfaa5bf0d87c8e51368ec27c05edb44b2f923967694aa0ecab78e54070" gracePeriod=30 Mar 16 16:32:53 crc kubenswrapper[5120]: I0316 16:32:53.942448 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-6f799fddf5-d8q8w" podUID="482fd661-96ea-439b-8cd7-ee5a5321e981" containerName="barbican-keystone-listener" containerID="cri-o://b65a7138052afabe4d51fce29c540230c6c50c956a3a538bb146359fda5c781a" gracePeriod=30 Mar 16 16:32:53 crc kubenswrapper[5120]: I0316 16:32:53.947440 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-worker-665c46bb4d-7xhgk" podStartSLOduration=2.9474124120000003 podStartE2EDuration="2.947412412s" podCreationTimestamp="2026-03-16 16:32:51 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:32:53.932748378 +0000 UTC m=+3676.086680045" watchObservedRunningTime="2026-03-16 16:32:53.947412412 +0000 UTC m=+3676.101344069" Mar 16 16:32:53 crc kubenswrapper[5120]: I0316 16:32:53.974912 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:32:53 crc kubenswrapper[5120]: I0316 16:32:53.986935 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:32:54 crc kubenswrapper[5120]: I0316 16:32:54.000661 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-574f947b6-n4thn"] Mar 16 16:32:54 crc kubenswrapper[5120]: I0316 16:32:54.001075 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-574f947b6-n4thn" podUID="8789d77e-5501-4888-8248-254c4a42ffaf" containerName="barbican-worker-log" containerID="cri-o://49acae90ca3cde0ea58ce3f2c7682650f88c16a67f8ea1c0e1840c8e6c1a8750" gracePeriod=30 Mar 16 16:32:54 crc kubenswrapper[5120]: I0316 16:32:54.001539 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-574f947b6-n4thn" podUID="8789d77e-5501-4888-8248-254c4a42ffaf" containerName="barbican-worker" containerID="cri-o://28edc047bab9b6544e6d431f3f9c09c48dc40a55e926542d02fc4de947b72903" gracePeriod=30 Mar 16 16:32:54 crc kubenswrapper[5120]: I0316 16:32:54.016271 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:32:54 crc kubenswrapper[5120]: I0316 16:32:54.029233 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58a1579c-59e5-4830-8864-6e0bb86ea553" containerName="cinder-api-log" Mar 16 16:32:54 crc kubenswrapper[5120]: I0316 16:32:54.029278 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="58a1579c-59e5-4830-8864-6e0bb86ea553" containerName="cinder-api-log" Mar 16 16:32:54 crc kubenswrapper[5120]: I0316 16:32:54.029331 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58a1579c-59e5-4830-8864-6e0bb86ea553" containerName="cinder-api" Mar 16 16:32:54 crc kubenswrapper[5120]: I0316 16:32:54.029340 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="58a1579c-59e5-4830-8864-6e0bb86ea553" containerName="cinder-api" Mar 16 16:32:54 crc kubenswrapper[5120]: I0316 16:32:54.029682 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="58a1579c-59e5-4830-8864-6e0bb86ea553" containerName="cinder-api" Mar 16 16:32:54 crc kubenswrapper[5120]: I0316 16:32:54.029726 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="58a1579c-59e5-4830-8864-6e0bb86ea553" containerName="cinder-api-log" Mar 16 16:32:54 crc kubenswrapper[5120]: I0316 16:32:54.046582 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:32:54 crc kubenswrapper[5120]: I0316 16:32:54.054190 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-api-config-data\"" Mar 16 16:32:54 crc kubenswrapper[5120]: I0316 16:32:54.054333 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-cinder-public-svc\"" Mar 16 16:32:54 crc kubenswrapper[5120]: I0316 16:32:54.054374 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-cinder-internal-svc\"" Mar 16 16:32:54 crc kubenswrapper[5120]: I0316 16:32:54.092847 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:32:54 crc kubenswrapper[5120]: I0316 16:32:54.154537 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e8ee374e-6e54-498b-9c76-2ea7caf3cad8-public-tls-certs\") pod \"cinder-api-0\" (UID: \"e8ee374e-6e54-498b-9c76-2ea7caf3cad8\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:32:54 crc kubenswrapper[5120]: I0316 16:32:54.154595 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e8ee374e-6e54-498b-9c76-2ea7caf3cad8-logs\") pod \"cinder-api-0\" (UID: \"e8ee374e-6e54-498b-9c76-2ea7caf3cad8\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:32:54 crc kubenswrapper[5120]: I0316 16:32:54.154647 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e8ee374e-6e54-498b-9c76-2ea7caf3cad8-config-data\") pod \"cinder-api-0\" (UID: \"e8ee374e-6e54-498b-9c76-2ea7caf3cad8\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:32:54 crc kubenswrapper[5120]: I0316 16:32:54.154778 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qcjkz\" (UniqueName: \"kubernetes.io/projected/e8ee374e-6e54-498b-9c76-2ea7caf3cad8-kube-api-access-qcjkz\") pod \"cinder-api-0\" (UID: \"e8ee374e-6e54-498b-9c76-2ea7caf3cad8\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:32:54 crc kubenswrapper[5120]: I0316 16:32:54.154910 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e8ee374e-6e54-498b-9c76-2ea7caf3cad8-scripts\") pod \"cinder-api-0\" (UID: \"e8ee374e-6e54-498b-9c76-2ea7caf3cad8\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:32:54 crc kubenswrapper[5120]: I0316 16:32:54.154975 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/e8ee374e-6e54-498b-9c76-2ea7caf3cad8-etc-machine-id\") pod \"cinder-api-0\" (UID: \"e8ee374e-6e54-498b-9c76-2ea7caf3cad8\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:32:54 crc kubenswrapper[5120]: I0316 16:32:54.155094 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e8ee374e-6e54-498b-9c76-2ea7caf3cad8-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"e8ee374e-6e54-498b-9c76-2ea7caf3cad8\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:32:54 crc kubenswrapper[5120]: I0316 16:32:54.155121 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e8ee374e-6e54-498b-9c76-2ea7caf3cad8-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"e8ee374e-6e54-498b-9c76-2ea7caf3cad8\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:32:54 crc kubenswrapper[5120]: I0316 16:32:54.155202 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/e8ee374e-6e54-498b-9c76-2ea7caf3cad8-config-data-custom\") pod \"cinder-api-0\" (UID: \"e8ee374e-6e54-498b-9c76-2ea7caf3cad8\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:32:54 crc kubenswrapper[5120]: I0316 16:32:54.257063 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e8ee374e-6e54-498b-9c76-2ea7caf3cad8-config-data\") pod \"cinder-api-0\" (UID: \"e8ee374e-6e54-498b-9c76-2ea7caf3cad8\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:32:54 crc kubenswrapper[5120]: I0316 16:32:54.257191 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qcjkz\" (UniqueName: \"kubernetes.io/projected/e8ee374e-6e54-498b-9c76-2ea7caf3cad8-kube-api-access-qcjkz\") pod \"cinder-api-0\" (UID: \"e8ee374e-6e54-498b-9c76-2ea7caf3cad8\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:32:54 crc kubenswrapper[5120]: I0316 16:32:54.257310 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e8ee374e-6e54-498b-9c76-2ea7caf3cad8-scripts\") pod \"cinder-api-0\" (UID: \"e8ee374e-6e54-498b-9c76-2ea7caf3cad8\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:32:54 crc kubenswrapper[5120]: I0316 16:32:54.257372 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/e8ee374e-6e54-498b-9c76-2ea7caf3cad8-etc-machine-id\") pod \"cinder-api-0\" (UID: \"e8ee374e-6e54-498b-9c76-2ea7caf3cad8\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:32:54 crc kubenswrapper[5120]: I0316 16:32:54.262072 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e8ee374e-6e54-498b-9c76-2ea7caf3cad8-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"e8ee374e-6e54-498b-9c76-2ea7caf3cad8\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:32:54 crc kubenswrapper[5120]: I0316 16:32:54.262244 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e8ee374e-6e54-498b-9c76-2ea7caf3cad8-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"e8ee374e-6e54-498b-9c76-2ea7caf3cad8\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:32:54 crc kubenswrapper[5120]: I0316 16:32:54.262365 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/e8ee374e-6e54-498b-9c76-2ea7caf3cad8-config-data-custom\") pod \"cinder-api-0\" (UID: \"e8ee374e-6e54-498b-9c76-2ea7caf3cad8\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:32:54 crc kubenswrapper[5120]: I0316 16:32:54.262519 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e8ee374e-6e54-498b-9c76-2ea7caf3cad8-public-tls-certs\") pod \"cinder-api-0\" (UID: \"e8ee374e-6e54-498b-9c76-2ea7caf3cad8\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:32:54 crc kubenswrapper[5120]: I0316 16:32:54.262559 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e8ee374e-6e54-498b-9c76-2ea7caf3cad8-logs\") pod \"cinder-api-0\" (UID: \"e8ee374e-6e54-498b-9c76-2ea7caf3cad8\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:32:54 crc kubenswrapper[5120]: I0316 16:32:54.263137 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e8ee374e-6e54-498b-9c76-2ea7caf3cad8-logs\") pod \"cinder-api-0\" (UID: \"e8ee374e-6e54-498b-9c76-2ea7caf3cad8\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:32:54 crc kubenswrapper[5120]: I0316 16:32:54.264894 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/e8ee374e-6e54-498b-9c76-2ea7caf3cad8-etc-machine-id\") pod \"cinder-api-0\" (UID: \"e8ee374e-6e54-498b-9c76-2ea7caf3cad8\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:32:54 crc kubenswrapper[5120]: I0316 16:32:54.279376 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e8ee374e-6e54-498b-9c76-2ea7caf3cad8-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"e8ee374e-6e54-498b-9c76-2ea7caf3cad8\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:32:54 crc kubenswrapper[5120]: I0316 16:32:54.295458 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e8ee374e-6e54-498b-9c76-2ea7caf3cad8-scripts\") pod \"cinder-api-0\" (UID: \"e8ee374e-6e54-498b-9c76-2ea7caf3cad8\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:32:54 crc kubenswrapper[5120]: I0316 16:32:54.297782 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qcjkz\" (UniqueName: \"kubernetes.io/projected/e8ee374e-6e54-498b-9c76-2ea7caf3cad8-kube-api-access-qcjkz\") pod \"cinder-api-0\" (UID: \"e8ee374e-6e54-498b-9c76-2ea7caf3cad8\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:32:54 crc kubenswrapper[5120]: I0316 16:32:54.298679 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e8ee374e-6e54-498b-9c76-2ea7caf3cad8-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"e8ee374e-6e54-498b-9c76-2ea7caf3cad8\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:32:54 crc kubenswrapper[5120]: I0316 16:32:54.300028 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/e8ee374e-6e54-498b-9c76-2ea7caf3cad8-config-data-custom\") pod \"cinder-api-0\" (UID: \"e8ee374e-6e54-498b-9c76-2ea7caf3cad8\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:32:54 crc kubenswrapper[5120]: I0316 16:32:54.325595 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e8ee374e-6e54-498b-9c76-2ea7caf3cad8-config-data\") pod \"cinder-api-0\" (UID: \"e8ee374e-6e54-498b-9c76-2ea7caf3cad8\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:32:54 crc kubenswrapper[5120]: I0316 16:32:54.336377 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e8ee374e-6e54-498b-9c76-2ea7caf3cad8-public-tls-certs\") pod \"cinder-api-0\" (UID: \"e8ee374e-6e54-498b-9c76-2ea7caf3cad8\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:32:54 crc kubenswrapper[5120]: I0316 16:32:54.487424 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:32:54 crc kubenswrapper[5120]: I0316 16:32:54.687534 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="58a1579c-59e5-4830-8864-6e0bb86ea553" path="/var/lib/kubelet/pods/58a1579c-59e5-4830-8864-6e0bb86ea553/volumes" Mar 16 16:32:54 crc kubenswrapper[5120]: I0316 16:32:54.688369 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f563b41f-83a2-4093-b167-d4e4a335986a" path="/var/lib/kubelet/pods/f563b41f-83a2-4093-b167-d4e4a335986a/volumes" Mar 16 16:32:54 crc kubenswrapper[5120]: I0316 16:32:54.920940 5120 generic.go:358] "Generic (PLEG): container finished" podID="8789d77e-5501-4888-8248-254c4a42ffaf" containerID="49acae90ca3cde0ea58ce3f2c7682650f88c16a67f8ea1c0e1840c8e6c1a8750" exitCode=143 Mar 16 16:32:54 crc kubenswrapper[5120]: I0316 16:32:54.921032 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-574f947b6-n4thn" event={"ID":"8789d77e-5501-4888-8248-254c4a42ffaf","Type":"ContainerDied","Data":"49acae90ca3cde0ea58ce3f2c7682650f88c16a67f8ea1c0e1840c8e6c1a8750"} Mar 16 16:32:54 crc kubenswrapper[5120]: I0316 16:32:54.925265 5120 generic.go:358] "Generic (PLEG): container finished" podID="482fd661-96ea-439b-8cd7-ee5a5321e981" containerID="296d6bcfaa5bf0d87c8e51368ec27c05edb44b2f923967694aa0ecab78e54070" exitCode=143 Mar 16 16:32:54 crc kubenswrapper[5120]: I0316 16:32:54.925433 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-6f799fddf5-d8q8w" event={"ID":"482fd661-96ea-439b-8cd7-ee5a5321e981","Type":"ContainerDied","Data":"296d6bcfaa5bf0d87c8e51368ec27c05edb44b2f923967694aa0ecab78e54070"} Mar 16 16:32:54 crc kubenswrapper[5120]: I0316 16:32:54.927260 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"67fe9146-c519-453c-8f10-76ae241f8889","Type":"ContainerStarted","Data":"2cd15243ad2b9728e19e51c7a7f081c3c5dda1c485eca453f09c8100fe0dc7e7"} Mar 16 16:32:54 crc kubenswrapper[5120]: I0316 16:32:54.927389 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"67fe9146-c519-453c-8f10-76ae241f8889","Type":"ContainerStarted","Data":"f05b958cfdea4c618faa63ec9ba4ec7c8a6ec2d3cd14497142992eae48c7e0b0"} Mar 16 16:32:54 crc kubenswrapper[5120]: I0316 16:32:54.929092 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-7d985d96b7-jk8xr" event={"ID":"a2be00a2-fcd5-4862-aadf-b2947d6d138b","Type":"ContainerStarted","Data":"b2c6ac53e732bb240cf7102085bff535675ef1590ebcbfa604a497b748bdacb6"} Mar 16 16:32:54 crc kubenswrapper[5120]: I0316 16:32:54.930851 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-7d985d96b7-jk8xr" Mar 16 16:32:54 crc kubenswrapper[5120]: I0316 16:32:54.930994 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-7d985d96b7-jk8xr" Mar 16 16:32:54 crc kubenswrapper[5120]: I0316 16:32:54.933374 5120 generic.go:358] "Generic (PLEG): container finished" podID="75b3e230-9ea5-42dd-8274-44d38ed2bb4c" containerID="dcf9fa8b1116cc44c55ea4dea19a89a3dc344ff083773e2ae76a8f51807827f7" exitCode=0 Mar 16 16:32:54 crc kubenswrapper[5120]: I0316 16:32:54.933889 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-bp5pw" event={"ID":"75b3e230-9ea5-42dd-8274-44d38ed2bb4c","Type":"ContainerDied","Data":"dcf9fa8b1116cc44c55ea4dea19a89a3dc344ff083773e2ae76a8f51807827f7"} Mar 16 16:32:54 crc kubenswrapper[5120]: I0316 16:32:54.992618 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-api-7d985d96b7-jk8xr" podStartSLOduration=3.992596619 podStartE2EDuration="3.992596619s" podCreationTimestamp="2026-03-16 16:32:51 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:32:54.967099121 +0000 UTC m=+3677.121030778" watchObservedRunningTime="2026-03-16 16:32:54.992596619 +0000 UTC m=+3677.146528276" Mar 16 16:32:55 crc kubenswrapper[5120]: I0316 16:32:55.051817 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:32:55 crc kubenswrapper[5120]: I0316 16:32:55.949142 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"67fe9146-c519-453c-8f10-76ae241f8889","Type":"ContainerStarted","Data":"2b88f219480a1e4d7c2d8d9f50e7e899d2b50b8f4e39cb8e957e5016b4eb629a"} Mar 16 16:32:55 crc kubenswrapper[5120]: I0316 16:32:55.951322 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"e8ee374e-6e54-498b-9c76-2ea7caf3cad8","Type":"ContainerStarted","Data":"293a8c9b65d2dc593bd393e16d6b5dfe15f0954f1386ecb80ce43bc0943e1af4"} Mar 16 16:32:55 crc kubenswrapper[5120]: I0316 16:32:55.951392 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"e8ee374e-6e54-498b-9c76-2ea7caf3cad8","Type":"ContainerStarted","Data":"6bf4212b75ebf8c42a813f69ea5158f87f44e6a264262eb9be3cce1af7c2a298"} Mar 16 16:32:56 crc kubenswrapper[5120]: I0316 16:32:56.282478 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-bp5pw" Mar 16 16:32:56 crc kubenswrapper[5120]: I0316 16:32:56.320300 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/75b3e230-9ea5-42dd-8274-44d38ed2bb4c-config\") pod \"75b3e230-9ea5-42dd-8274-44d38ed2bb4c\" (UID: \"75b3e230-9ea5-42dd-8274-44d38ed2bb4c\") " Mar 16 16:32:56 crc kubenswrapper[5120]: I0316 16:32:56.320477 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/75b3e230-9ea5-42dd-8274-44d38ed2bb4c-combined-ca-bundle\") pod \"75b3e230-9ea5-42dd-8274-44d38ed2bb4c\" (UID: \"75b3e230-9ea5-42dd-8274-44d38ed2bb4c\") " Mar 16 16:32:56 crc kubenswrapper[5120]: I0316 16:32:56.320612 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rhw8z\" (UniqueName: \"kubernetes.io/projected/75b3e230-9ea5-42dd-8274-44d38ed2bb4c-kube-api-access-rhw8z\") pod \"75b3e230-9ea5-42dd-8274-44d38ed2bb4c\" (UID: \"75b3e230-9ea5-42dd-8274-44d38ed2bb4c\") " Mar 16 16:32:56 crc kubenswrapper[5120]: I0316 16:32:56.325988 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75b3e230-9ea5-42dd-8274-44d38ed2bb4c-kube-api-access-rhw8z" (OuterVolumeSpecName: "kube-api-access-rhw8z") pod "75b3e230-9ea5-42dd-8274-44d38ed2bb4c" (UID: "75b3e230-9ea5-42dd-8274-44d38ed2bb4c"). InnerVolumeSpecName "kube-api-access-rhw8z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:32:56 crc kubenswrapper[5120]: I0316 16:32:56.349585 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75b3e230-9ea5-42dd-8274-44d38ed2bb4c-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "75b3e230-9ea5-42dd-8274-44d38ed2bb4c" (UID: "75b3e230-9ea5-42dd-8274-44d38ed2bb4c"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:32:56 crc kubenswrapper[5120]: I0316 16:32:56.351016 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75b3e230-9ea5-42dd-8274-44d38ed2bb4c-config" (OuterVolumeSpecName: "config") pod "75b3e230-9ea5-42dd-8274-44d38ed2bb4c" (UID: "75b3e230-9ea5-42dd-8274-44d38ed2bb4c"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:32:56 crc kubenswrapper[5120]: I0316 16:32:56.424174 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/75b3e230-9ea5-42dd-8274-44d38ed2bb4c-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:32:56 crc kubenswrapper[5120]: I0316 16:32:56.424214 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/75b3e230-9ea5-42dd-8274-44d38ed2bb4c-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:32:56 crc kubenswrapper[5120]: I0316 16:32:56.424225 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rhw8z\" (UniqueName: \"kubernetes.io/projected/75b3e230-9ea5-42dd-8274-44d38ed2bb4c-kube-api-access-rhw8z\") on node \"crc\" DevicePath \"\"" Mar 16 16:32:56 crc kubenswrapper[5120]: I0316 16:32:56.698585 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-558fbfdd47-v976s" podUID="9a15bc36-5f09-421b-a175-df44f218f875" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.0.154:9311/healthcheck\": context deadline exceeded" Mar 16 16:32:56 crc kubenswrapper[5120]: I0316 16:32:56.706093 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-558fbfdd47-v976s" podUID="9a15bc36-5f09-421b-a175-df44f218f875" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.0.154:9311/healthcheck\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Mar 16 16:32:56 crc kubenswrapper[5120]: I0316 16:32:56.973421 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"67fe9146-c519-453c-8f10-76ae241f8889","Type":"ContainerStarted","Data":"99e6c67de1ba5520b48f1f66a97b2fe080b042c92fb9b1b374091de04f457ea7"} Mar 16 16:32:56 crc kubenswrapper[5120]: I0316 16:32:56.976022 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-bp5pw" event={"ID":"75b3e230-9ea5-42dd-8274-44d38ed2bb4c","Type":"ContainerDied","Data":"50ebb00c95687988a835773f65cea2103bbe1e25a0ded782ac6cd99c10041851"} Mar 16 16:32:56 crc kubenswrapper[5120]: I0316 16:32:56.976048 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-bp5pw" Mar 16 16:32:56 crc kubenswrapper[5120]: I0316 16:32:56.976064 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="50ebb00c95687988a835773f65cea2103bbe1e25a0ded782ac6cd99c10041851" Mar 16 16:32:56 crc kubenswrapper[5120]: I0316 16:32:56.979614 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"e8ee374e-6e54-498b-9c76-2ea7caf3cad8","Type":"ContainerStarted","Data":"127258b57c230c7843d8cc012a76f9e30a721fab3cab2462fbdac98abf8f8ae9"} Mar 16 16:32:56 crc kubenswrapper[5120]: I0316 16:32:56.979810 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:32:57 crc kubenswrapper[5120]: I0316 16:32:57.006388 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-api-0" podStartSLOduration=4.006366568 podStartE2EDuration="4.006366568s" podCreationTimestamp="2026-03-16 16:32:53 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:32:57.000983407 +0000 UTC m=+3679.154915074" watchObservedRunningTime="2026-03-16 16:32:57.006366568 +0000 UTC m=+3679.160298215" Mar 16 16:32:57 crc kubenswrapper[5120]: I0316 16:32:57.133670 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-558fbfdd47-v976s" podUID="9a15bc36-5f09-421b-a175-df44f218f875" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.0.154:9311/healthcheck\": read tcp 10.217.0.2:36276->10.217.0.154:9311: read: connection reset by peer" Mar 16 16:32:57 crc kubenswrapper[5120]: I0316 16:32:57.133852 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-558fbfdd47-v976s" podUID="9a15bc36-5f09-421b-a175-df44f218f875" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.0.154:9311/healthcheck\": read tcp 10.217.0.2:36262->10.217.0.154:9311: read: connection reset by peer" Mar 16 16:32:57 crc kubenswrapper[5120]: I0316 16:32:57.275739 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-587c77d488-zm2nq"] Mar 16 16:32:57 crc kubenswrapper[5120]: I0316 16:32:57.277087 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75b3e230-9ea5-42dd-8274-44d38ed2bb4c" containerName="neutron-db-sync" Mar 16 16:32:57 crc kubenswrapper[5120]: I0316 16:32:57.277105 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="75b3e230-9ea5-42dd-8274-44d38ed2bb4c" containerName="neutron-db-sync" Mar 16 16:32:57 crc kubenswrapper[5120]: I0316 16:32:57.277264 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="75b3e230-9ea5-42dd-8274-44d38ed2bb4c" containerName="neutron-db-sync" Mar 16 16:32:57 crc kubenswrapper[5120]: I0316 16:32:57.284722 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-587c77d488-zm2nq" Mar 16 16:32:57 crc kubenswrapper[5120]: I0316 16:32:57.287044 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-neutron-dockercfg-lj228\"" Mar 16 16:32:57 crc kubenswrapper[5120]: I0316 16:32:57.287388 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-httpd-config\"" Mar 16 16:32:57 crc kubenswrapper[5120]: I0316 16:32:57.287773 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-config\"" Mar 16 16:32:57 crc kubenswrapper[5120]: I0316 16:32:57.287959 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-neutron-ovndbs\"" Mar 16 16:32:57 crc kubenswrapper[5120]: I0316 16:32:57.291689 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-587c77d488-zm2nq"] Mar 16 16:32:57 crc kubenswrapper[5120]: I0316 16:32:57.344622 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6aae3bc4-66a0-436a-b3b3-13d2be73a3de-combined-ca-bundle\") pod \"neutron-587c77d488-zm2nq\" (UID: \"6aae3bc4-66a0-436a-b3b3-13d2be73a3de\") " pod="openstack-kuttl-tests/neutron-587c77d488-zm2nq" Mar 16 16:32:57 crc kubenswrapper[5120]: I0316 16:32:57.344715 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/6aae3bc4-66a0-436a-b3b3-13d2be73a3de-httpd-config\") pod \"neutron-587c77d488-zm2nq\" (UID: \"6aae3bc4-66a0-436a-b3b3-13d2be73a3de\") " pod="openstack-kuttl-tests/neutron-587c77d488-zm2nq" Mar 16 16:32:57 crc kubenswrapper[5120]: I0316 16:32:57.344860 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6aae3bc4-66a0-436a-b3b3-13d2be73a3de-config\") pod \"neutron-587c77d488-zm2nq\" (UID: \"6aae3bc4-66a0-436a-b3b3-13d2be73a3de\") " pod="openstack-kuttl-tests/neutron-587c77d488-zm2nq" Mar 16 16:32:57 crc kubenswrapper[5120]: I0316 16:32:57.344888 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfw8h\" (UniqueName: \"kubernetes.io/projected/6aae3bc4-66a0-436a-b3b3-13d2be73a3de-kube-api-access-mfw8h\") pod \"neutron-587c77d488-zm2nq\" (UID: \"6aae3bc4-66a0-436a-b3b3-13d2be73a3de\") " pod="openstack-kuttl-tests/neutron-587c77d488-zm2nq" Mar 16 16:32:57 crc kubenswrapper[5120]: I0316 16:32:57.345101 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/6aae3bc4-66a0-436a-b3b3-13d2be73a3de-ovndb-tls-certs\") pod \"neutron-587c77d488-zm2nq\" (UID: \"6aae3bc4-66a0-436a-b3b3-13d2be73a3de\") " pod="openstack-kuttl-tests/neutron-587c77d488-zm2nq" Mar 16 16:32:57 crc kubenswrapper[5120]: I0316 16:32:57.365171 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:32:57 crc kubenswrapper[5120]: I0316 16:32:57.427952 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:32:57 crc kubenswrapper[5120]: I0316 16:32:57.446566 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6aae3bc4-66a0-436a-b3b3-13d2be73a3de-config\") pod \"neutron-587c77d488-zm2nq\" (UID: \"6aae3bc4-66a0-436a-b3b3-13d2be73a3de\") " pod="openstack-kuttl-tests/neutron-587c77d488-zm2nq" Mar 16 16:32:57 crc kubenswrapper[5120]: I0316 16:32:57.446609 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mfw8h\" (UniqueName: \"kubernetes.io/projected/6aae3bc4-66a0-436a-b3b3-13d2be73a3de-kube-api-access-mfw8h\") pod \"neutron-587c77d488-zm2nq\" (UID: \"6aae3bc4-66a0-436a-b3b3-13d2be73a3de\") " pod="openstack-kuttl-tests/neutron-587c77d488-zm2nq" Mar 16 16:32:57 crc kubenswrapper[5120]: I0316 16:32:57.446815 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/6aae3bc4-66a0-436a-b3b3-13d2be73a3de-ovndb-tls-certs\") pod \"neutron-587c77d488-zm2nq\" (UID: \"6aae3bc4-66a0-436a-b3b3-13d2be73a3de\") " pod="openstack-kuttl-tests/neutron-587c77d488-zm2nq" Mar 16 16:32:57 crc kubenswrapper[5120]: I0316 16:32:57.446846 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6aae3bc4-66a0-436a-b3b3-13d2be73a3de-combined-ca-bundle\") pod \"neutron-587c77d488-zm2nq\" (UID: \"6aae3bc4-66a0-436a-b3b3-13d2be73a3de\") " pod="openstack-kuttl-tests/neutron-587c77d488-zm2nq" Mar 16 16:32:57 crc kubenswrapper[5120]: I0316 16:32:57.446917 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/6aae3bc4-66a0-436a-b3b3-13d2be73a3de-httpd-config\") pod \"neutron-587c77d488-zm2nq\" (UID: \"6aae3bc4-66a0-436a-b3b3-13d2be73a3de\") " pod="openstack-kuttl-tests/neutron-587c77d488-zm2nq" Mar 16 16:32:57 crc kubenswrapper[5120]: I0316 16:32:57.454279 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/6aae3bc4-66a0-436a-b3b3-13d2be73a3de-config\") pod \"neutron-587c77d488-zm2nq\" (UID: \"6aae3bc4-66a0-436a-b3b3-13d2be73a3de\") " pod="openstack-kuttl-tests/neutron-587c77d488-zm2nq" Mar 16 16:32:57 crc kubenswrapper[5120]: I0316 16:32:57.456068 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/6aae3bc4-66a0-436a-b3b3-13d2be73a3de-httpd-config\") pod \"neutron-587c77d488-zm2nq\" (UID: \"6aae3bc4-66a0-436a-b3b3-13d2be73a3de\") " pod="openstack-kuttl-tests/neutron-587c77d488-zm2nq" Mar 16 16:32:57 crc kubenswrapper[5120]: I0316 16:32:57.475490 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/6aae3bc4-66a0-436a-b3b3-13d2be73a3de-ovndb-tls-certs\") pod \"neutron-587c77d488-zm2nq\" (UID: \"6aae3bc4-66a0-436a-b3b3-13d2be73a3de\") " pod="openstack-kuttl-tests/neutron-587c77d488-zm2nq" Mar 16 16:32:57 crc kubenswrapper[5120]: I0316 16:32:57.476584 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6aae3bc4-66a0-436a-b3b3-13d2be73a3de-combined-ca-bundle\") pod \"neutron-587c77d488-zm2nq\" (UID: \"6aae3bc4-66a0-436a-b3b3-13d2be73a3de\") " pod="openstack-kuttl-tests/neutron-587c77d488-zm2nq" Mar 16 16:32:57 crc kubenswrapper[5120]: I0316 16:32:57.479450 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfw8h\" (UniqueName: \"kubernetes.io/projected/6aae3bc4-66a0-436a-b3b3-13d2be73a3de-kube-api-access-mfw8h\") pod \"neutron-587c77d488-zm2nq\" (UID: \"6aae3bc4-66a0-436a-b3b3-13d2be73a3de\") " pod="openstack-kuttl-tests/neutron-587c77d488-zm2nq" Mar 16 16:32:57 crc kubenswrapper[5120]: I0316 16:32:57.615623 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-587c77d488-zm2nq" Mar 16 16:32:57 crc kubenswrapper[5120]: I0316 16:32:57.731948 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-558fbfdd47-v976s" Mar 16 16:32:57 crc kubenswrapper[5120]: I0316 16:32:57.754522 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/9a15bc36-5f09-421b-a175-df44f218f875-config-data-custom\") pod \"9a15bc36-5f09-421b-a175-df44f218f875\" (UID: \"9a15bc36-5f09-421b-a175-df44f218f875\") " Mar 16 16:32:57 crc kubenswrapper[5120]: I0316 16:32:57.754567 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/9a15bc36-5f09-421b-a175-df44f218f875-internal-tls-certs\") pod \"9a15bc36-5f09-421b-a175-df44f218f875\" (UID: \"9a15bc36-5f09-421b-a175-df44f218f875\") " Mar 16 16:32:57 crc kubenswrapper[5120]: I0316 16:32:57.754633 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9a15bc36-5f09-421b-a175-df44f218f875-logs\") pod \"9a15bc36-5f09-421b-a175-df44f218f875\" (UID: \"9a15bc36-5f09-421b-a175-df44f218f875\") " Mar 16 16:32:57 crc kubenswrapper[5120]: I0316 16:32:57.754658 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/9a15bc36-5f09-421b-a175-df44f218f875-public-tls-certs\") pod \"9a15bc36-5f09-421b-a175-df44f218f875\" (UID: \"9a15bc36-5f09-421b-a175-df44f218f875\") " Mar 16 16:32:57 crc kubenswrapper[5120]: I0316 16:32:57.754703 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9a15bc36-5f09-421b-a175-df44f218f875-config-data\") pod \"9a15bc36-5f09-421b-a175-df44f218f875\" (UID: \"9a15bc36-5f09-421b-a175-df44f218f875\") " Mar 16 16:32:57 crc kubenswrapper[5120]: I0316 16:32:57.755123 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wvbm7\" (UniqueName: \"kubernetes.io/projected/9a15bc36-5f09-421b-a175-df44f218f875-kube-api-access-wvbm7\") pod \"9a15bc36-5f09-421b-a175-df44f218f875\" (UID: \"9a15bc36-5f09-421b-a175-df44f218f875\") " Mar 16 16:32:57 crc kubenswrapper[5120]: I0316 16:32:57.755167 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9a15bc36-5f09-421b-a175-df44f218f875-combined-ca-bundle\") pod \"9a15bc36-5f09-421b-a175-df44f218f875\" (UID: \"9a15bc36-5f09-421b-a175-df44f218f875\") " Mar 16 16:32:57 crc kubenswrapper[5120]: I0316 16:32:57.767661 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a15bc36-5f09-421b-a175-df44f218f875-logs" (OuterVolumeSpecName: "logs") pod "9a15bc36-5f09-421b-a175-df44f218f875" (UID: "9a15bc36-5f09-421b-a175-df44f218f875"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:32:57 crc kubenswrapper[5120]: I0316 16:32:57.779472 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a15bc36-5f09-421b-a175-df44f218f875-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "9a15bc36-5f09-421b-a175-df44f218f875" (UID: "9a15bc36-5f09-421b-a175-df44f218f875"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:32:57 crc kubenswrapper[5120]: I0316 16:32:57.782813 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a15bc36-5f09-421b-a175-df44f218f875-kube-api-access-wvbm7" (OuterVolumeSpecName: "kube-api-access-wvbm7") pod "9a15bc36-5f09-421b-a175-df44f218f875" (UID: "9a15bc36-5f09-421b-a175-df44f218f875"). InnerVolumeSpecName "kube-api-access-wvbm7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:32:57 crc kubenswrapper[5120]: I0316 16:32:57.872504 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a15bc36-5f09-421b-a175-df44f218f875-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "9a15bc36-5f09-421b-a175-df44f218f875" (UID: "9a15bc36-5f09-421b-a175-df44f218f875"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:32:57 crc kubenswrapper[5120]: I0316 16:32:57.873839 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/9a15bc36-5f09-421b-a175-df44f218f875-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:32:57 crc kubenswrapper[5120]: I0316 16:32:57.873861 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9a15bc36-5f09-421b-a175-df44f218f875-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:32:57 crc kubenswrapper[5120]: I0316 16:32:57.873871 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wvbm7\" (UniqueName: \"kubernetes.io/projected/9a15bc36-5f09-421b-a175-df44f218f875-kube-api-access-wvbm7\") on node \"crc\" DevicePath \"\"" Mar 16 16:32:57 crc kubenswrapper[5120]: I0316 16:32:57.873882 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9a15bc36-5f09-421b-a175-df44f218f875-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:32:57 crc kubenswrapper[5120]: I0316 16:32:57.890877 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a15bc36-5f09-421b-a175-df44f218f875-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "9a15bc36-5f09-421b-a175-df44f218f875" (UID: "9a15bc36-5f09-421b-a175-df44f218f875"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:32:57 crc kubenswrapper[5120]: I0316 16:32:57.894037 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a15bc36-5f09-421b-a175-df44f218f875-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "9a15bc36-5f09-421b-a175-df44f218f875" (UID: "9a15bc36-5f09-421b-a175-df44f218f875"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:32:57 crc kubenswrapper[5120]: I0316 16:32:57.916849 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a15bc36-5f09-421b-a175-df44f218f875-config-data" (OuterVolumeSpecName: "config-data") pod "9a15bc36-5f09-421b-a175-df44f218f875" (UID: "9a15bc36-5f09-421b-a175-df44f218f875"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:32:57 crc kubenswrapper[5120]: I0316 16:32:57.964629 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-574f947b6-n4thn" Mar 16 16:32:57 crc kubenswrapper[5120]: I0316 16:32:57.980039 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/9a15bc36-5f09-421b-a175-df44f218f875-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:32:57 crc kubenswrapper[5120]: I0316 16:32:57.980630 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/9a15bc36-5f09-421b-a175-df44f218f875-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:32:57 crc kubenswrapper[5120]: I0316 16:32:57.980641 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9a15bc36-5f09-421b-a175-df44f218f875-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:32:57 crc kubenswrapper[5120]: I0316 16:32:57.998323 5120 generic.go:358] "Generic (PLEG): container finished" podID="8789d77e-5501-4888-8248-254c4a42ffaf" containerID="28edc047bab9b6544e6d431f3f9c09c48dc40a55e926542d02fc4de947b72903" exitCode=0 Mar 16 16:32:57 crc kubenswrapper[5120]: I0316 16:32:57.998883 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-574f947b6-n4thn" Mar 16 16:32:57 crc kubenswrapper[5120]: I0316 16:32:57.999776 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-574f947b6-n4thn" event={"ID":"8789d77e-5501-4888-8248-254c4a42ffaf","Type":"ContainerDied","Data":"28edc047bab9b6544e6d431f3f9c09c48dc40a55e926542d02fc4de947b72903"} Mar 16 16:32:57 crc kubenswrapper[5120]: I0316 16:32:57.999822 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-574f947b6-n4thn" event={"ID":"8789d77e-5501-4888-8248-254c4a42ffaf","Type":"ContainerDied","Data":"209ab22e3e956f77411e4ca38b5bf749429b5f347685e175e89d9855ed22290a"} Mar 16 16:32:58 crc kubenswrapper[5120]: I0316 16:32:57.999964 5120 scope.go:117] "RemoveContainer" containerID="28edc047bab9b6544e6d431f3f9c09c48dc40a55e926542d02fc4de947b72903" Mar 16 16:32:58 crc kubenswrapper[5120]: I0316 16:32:58.007191 5120 generic.go:358] "Generic (PLEG): container finished" podID="9a15bc36-5f09-421b-a175-df44f218f875" containerID="5a27d444a2b29795a9e750d0543943d54446ab5493bef69e2cccf083124184bf" exitCode=0 Mar 16 16:32:58 crc kubenswrapper[5120]: I0316 16:32:58.007606 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-558fbfdd47-v976s" event={"ID":"9a15bc36-5f09-421b-a175-df44f218f875","Type":"ContainerDied","Data":"5a27d444a2b29795a9e750d0543943d54446ab5493bef69e2cccf083124184bf"} Mar 16 16:32:58 crc kubenswrapper[5120]: I0316 16:32:58.007679 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-558fbfdd47-v976s" event={"ID":"9a15bc36-5f09-421b-a175-df44f218f875","Type":"ContainerDied","Data":"91fb094589ae2fb45955b7778ed6b8fe71fdcfebc0fe21c3edf2f790e6fbbd52"} Mar 16 16:32:58 crc kubenswrapper[5120]: I0316 16:32:58.007900 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-558fbfdd47-v976s" Mar 16 16:32:58 crc kubenswrapper[5120]: I0316 16:32:58.008826 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="2ad10a31-4609-47b6-a992-baa9724d3652" containerName="probe" containerID="cri-o://bfa860c9a330a36ed895b9bce3540bd71e2ec75f0e0b4f0f8713240235ba5dc6" gracePeriod=30 Mar 16 16:32:58 crc kubenswrapper[5120]: I0316 16:32:58.010259 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="2ad10a31-4609-47b6-a992-baa9724d3652" containerName="cinder-scheduler" containerID="cri-o://801e54778f96f4fcc6177b47190cb6a35c5b94f51610a06ab650720884fc39ef" gracePeriod=30 Mar 16 16:32:58 crc kubenswrapper[5120]: I0316 16:32:58.034110 5120 scope.go:117] "RemoveContainer" containerID="49acae90ca3cde0ea58ce3f2c7682650f88c16a67f8ea1c0e1840c8e6c1a8750" Mar 16 16:32:58 crc kubenswrapper[5120]: I0316 16:32:58.050816 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-558fbfdd47-v976s"] Mar 16 16:32:58 crc kubenswrapper[5120]: I0316 16:32:58.060725 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-api-558fbfdd47-v976s"] Mar 16 16:32:58 crc kubenswrapper[5120]: I0316 16:32:58.071553 5120 scope.go:117] "RemoveContainer" containerID="28edc047bab9b6544e6d431f3f9c09c48dc40a55e926542d02fc4de947b72903" Mar 16 16:32:58 crc kubenswrapper[5120]: E0316 16:32:58.071894 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"28edc047bab9b6544e6d431f3f9c09c48dc40a55e926542d02fc4de947b72903\": container with ID starting with 28edc047bab9b6544e6d431f3f9c09c48dc40a55e926542d02fc4de947b72903 not found: ID does not exist" containerID="28edc047bab9b6544e6d431f3f9c09c48dc40a55e926542d02fc4de947b72903" Mar 16 16:32:58 crc kubenswrapper[5120]: I0316 16:32:58.071925 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28edc047bab9b6544e6d431f3f9c09c48dc40a55e926542d02fc4de947b72903"} err="failed to get container status \"28edc047bab9b6544e6d431f3f9c09c48dc40a55e926542d02fc4de947b72903\": rpc error: code = NotFound desc = could not find container \"28edc047bab9b6544e6d431f3f9c09c48dc40a55e926542d02fc4de947b72903\": container with ID starting with 28edc047bab9b6544e6d431f3f9c09c48dc40a55e926542d02fc4de947b72903 not found: ID does not exist" Mar 16 16:32:58 crc kubenswrapper[5120]: I0316 16:32:58.071943 5120 scope.go:117] "RemoveContainer" containerID="49acae90ca3cde0ea58ce3f2c7682650f88c16a67f8ea1c0e1840c8e6c1a8750" Mar 16 16:32:58 crc kubenswrapper[5120]: E0316 16:32:58.072340 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"49acae90ca3cde0ea58ce3f2c7682650f88c16a67f8ea1c0e1840c8e6c1a8750\": container with ID starting with 49acae90ca3cde0ea58ce3f2c7682650f88c16a67f8ea1c0e1840c8e6c1a8750 not found: ID does not exist" containerID="49acae90ca3cde0ea58ce3f2c7682650f88c16a67f8ea1c0e1840c8e6c1a8750" Mar 16 16:32:58 crc kubenswrapper[5120]: I0316 16:32:58.072360 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49acae90ca3cde0ea58ce3f2c7682650f88c16a67f8ea1c0e1840c8e6c1a8750"} err="failed to get container status \"49acae90ca3cde0ea58ce3f2c7682650f88c16a67f8ea1c0e1840c8e6c1a8750\": rpc error: code = NotFound desc = could not find container \"49acae90ca3cde0ea58ce3f2c7682650f88c16a67f8ea1c0e1840c8e6c1a8750\": container with ID starting with 49acae90ca3cde0ea58ce3f2c7682650f88c16a67f8ea1c0e1840c8e6c1a8750 not found: ID does not exist" Mar 16 16:32:58 crc kubenswrapper[5120]: I0316 16:32:58.072374 5120 scope.go:117] "RemoveContainer" containerID="5a27d444a2b29795a9e750d0543943d54446ab5493bef69e2cccf083124184bf" Mar 16 16:32:58 crc kubenswrapper[5120]: I0316 16:32:58.081261 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8789d77e-5501-4888-8248-254c4a42ffaf-combined-ca-bundle\") pod \"8789d77e-5501-4888-8248-254c4a42ffaf\" (UID: \"8789d77e-5501-4888-8248-254c4a42ffaf\") " Mar 16 16:32:58 crc kubenswrapper[5120]: I0316 16:32:58.081333 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8789d77e-5501-4888-8248-254c4a42ffaf-config-data\") pod \"8789d77e-5501-4888-8248-254c4a42ffaf\" (UID: \"8789d77e-5501-4888-8248-254c4a42ffaf\") " Mar 16 16:32:58 crc kubenswrapper[5120]: I0316 16:32:58.081384 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8789d77e-5501-4888-8248-254c4a42ffaf-logs\") pod \"8789d77e-5501-4888-8248-254c4a42ffaf\" (UID: \"8789d77e-5501-4888-8248-254c4a42ffaf\") " Mar 16 16:32:58 crc kubenswrapper[5120]: I0316 16:32:58.083208 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/8789d77e-5501-4888-8248-254c4a42ffaf-config-data-custom\") pod \"8789d77e-5501-4888-8248-254c4a42ffaf\" (UID: \"8789d77e-5501-4888-8248-254c4a42ffaf\") " Mar 16 16:32:58 crc kubenswrapper[5120]: I0316 16:32:58.083586 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tdvzr\" (UniqueName: \"kubernetes.io/projected/8789d77e-5501-4888-8248-254c4a42ffaf-kube-api-access-tdvzr\") pod \"8789d77e-5501-4888-8248-254c4a42ffaf\" (UID: \"8789d77e-5501-4888-8248-254c4a42ffaf\") " Mar 16 16:32:58 crc kubenswrapper[5120]: I0316 16:32:58.087688 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8789d77e-5501-4888-8248-254c4a42ffaf-logs" (OuterVolumeSpecName: "logs") pod "8789d77e-5501-4888-8248-254c4a42ffaf" (UID: "8789d77e-5501-4888-8248-254c4a42ffaf"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:32:58 crc kubenswrapper[5120]: I0316 16:32:58.089664 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-587c77d488-zm2nq"] Mar 16 16:32:58 crc kubenswrapper[5120]: I0316 16:32:58.094619 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8789d77e-5501-4888-8248-254c4a42ffaf-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "8789d77e-5501-4888-8248-254c4a42ffaf" (UID: "8789d77e-5501-4888-8248-254c4a42ffaf"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:32:58 crc kubenswrapper[5120]: I0316 16:32:58.095458 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8789d77e-5501-4888-8248-254c4a42ffaf-kube-api-access-tdvzr" (OuterVolumeSpecName: "kube-api-access-tdvzr") pod "8789d77e-5501-4888-8248-254c4a42ffaf" (UID: "8789d77e-5501-4888-8248-254c4a42ffaf"). InnerVolumeSpecName "kube-api-access-tdvzr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:32:58 crc kubenswrapper[5120]: I0316 16:32:58.128391 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8789d77e-5501-4888-8248-254c4a42ffaf-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "8789d77e-5501-4888-8248-254c4a42ffaf" (UID: "8789d77e-5501-4888-8248-254c4a42ffaf"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:32:58 crc kubenswrapper[5120]: I0316 16:32:58.167672 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8789d77e-5501-4888-8248-254c4a42ffaf-config-data" (OuterVolumeSpecName: "config-data") pod "8789d77e-5501-4888-8248-254c4a42ffaf" (UID: "8789d77e-5501-4888-8248-254c4a42ffaf"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:32:58 crc kubenswrapper[5120]: I0316 16:32:58.187198 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tdvzr\" (UniqueName: \"kubernetes.io/projected/8789d77e-5501-4888-8248-254c4a42ffaf-kube-api-access-tdvzr\") on node \"crc\" DevicePath \"\"" Mar 16 16:32:58 crc kubenswrapper[5120]: I0316 16:32:58.187275 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8789d77e-5501-4888-8248-254c4a42ffaf-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:32:58 crc kubenswrapper[5120]: I0316 16:32:58.187289 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8789d77e-5501-4888-8248-254c4a42ffaf-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:32:58 crc kubenswrapper[5120]: I0316 16:32:58.187301 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8789d77e-5501-4888-8248-254c4a42ffaf-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:32:58 crc kubenswrapper[5120]: I0316 16:32:58.187312 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/8789d77e-5501-4888-8248-254c4a42ffaf-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:32:58 crc kubenswrapper[5120]: I0316 16:32:58.217236 5120 scope.go:117] "RemoveContainer" containerID="e6fd592e7b69681015c9c5ee62b89fabe9eeb0eaac28a238ec9c5be8a7c13951" Mar 16 16:32:58 crc kubenswrapper[5120]: I0316 16:32:58.278029 5120 scope.go:117] "RemoveContainer" containerID="5a27d444a2b29795a9e750d0543943d54446ab5493bef69e2cccf083124184bf" Mar 16 16:32:58 crc kubenswrapper[5120]: E0316 16:32:58.278813 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5a27d444a2b29795a9e750d0543943d54446ab5493bef69e2cccf083124184bf\": container with ID starting with 5a27d444a2b29795a9e750d0543943d54446ab5493bef69e2cccf083124184bf not found: ID does not exist" containerID="5a27d444a2b29795a9e750d0543943d54446ab5493bef69e2cccf083124184bf" Mar 16 16:32:58 crc kubenswrapper[5120]: I0316 16:32:58.278870 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a27d444a2b29795a9e750d0543943d54446ab5493bef69e2cccf083124184bf"} err="failed to get container status \"5a27d444a2b29795a9e750d0543943d54446ab5493bef69e2cccf083124184bf\": rpc error: code = NotFound desc = could not find container \"5a27d444a2b29795a9e750d0543943d54446ab5493bef69e2cccf083124184bf\": container with ID starting with 5a27d444a2b29795a9e750d0543943d54446ab5493bef69e2cccf083124184bf not found: ID does not exist" Mar 16 16:32:58 crc kubenswrapper[5120]: I0316 16:32:58.278899 5120 scope.go:117] "RemoveContainer" containerID="e6fd592e7b69681015c9c5ee62b89fabe9eeb0eaac28a238ec9c5be8a7c13951" Mar 16 16:32:58 crc kubenswrapper[5120]: E0316 16:32:58.279292 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e6fd592e7b69681015c9c5ee62b89fabe9eeb0eaac28a238ec9c5be8a7c13951\": container with ID starting with e6fd592e7b69681015c9c5ee62b89fabe9eeb0eaac28a238ec9c5be8a7c13951 not found: ID does not exist" containerID="e6fd592e7b69681015c9c5ee62b89fabe9eeb0eaac28a238ec9c5be8a7c13951" Mar 16 16:32:58 crc kubenswrapper[5120]: I0316 16:32:58.279348 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6fd592e7b69681015c9c5ee62b89fabe9eeb0eaac28a238ec9c5be8a7c13951"} err="failed to get container status \"e6fd592e7b69681015c9c5ee62b89fabe9eeb0eaac28a238ec9c5be8a7c13951\": rpc error: code = NotFound desc = could not find container \"e6fd592e7b69681015c9c5ee62b89fabe9eeb0eaac28a238ec9c5be8a7c13951\": container with ID starting with e6fd592e7b69681015c9c5ee62b89fabe9eeb0eaac28a238ec9c5be8a7c13951 not found: ID does not exist" Mar 16 16:32:58 crc kubenswrapper[5120]: I0316 16:32:58.349398 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-574f947b6-n4thn"] Mar 16 16:32:58 crc kubenswrapper[5120]: I0316 16:32:58.357457 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-worker-574f947b6-n4thn"] Mar 16 16:32:58 crc kubenswrapper[5120]: I0316 16:32:58.675326 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-6f799fddf5-d8q8w" Mar 16 16:32:58 crc kubenswrapper[5120]: I0316 16:32:58.676378 5120 scope.go:117] "RemoveContainer" containerID="0a15d5caff30dc8885f782e59962af7d98d58b39ab76059e56e5827e10e7ab8b" Mar 16 16:32:58 crc kubenswrapper[5120]: E0316 16:32:58.676880 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:32:58 crc kubenswrapper[5120]: I0316 16:32:58.679507 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8789d77e-5501-4888-8248-254c4a42ffaf" path="/var/lib/kubelet/pods/8789d77e-5501-4888-8248-254c4a42ffaf/volumes" Mar 16 16:32:58 crc kubenswrapper[5120]: I0316 16:32:58.680224 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a15bc36-5f09-421b-a175-df44f218f875" path="/var/lib/kubelet/pods/9a15bc36-5f09-421b-a175-df44f218f875/volumes" Mar 16 16:32:58 crc kubenswrapper[5120]: I0316 16:32:58.803976 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/482fd661-96ea-439b-8cd7-ee5a5321e981-config-data\") pod \"482fd661-96ea-439b-8cd7-ee5a5321e981\" (UID: \"482fd661-96ea-439b-8cd7-ee5a5321e981\") " Mar 16 16:32:58 crc kubenswrapper[5120]: I0316 16:32:58.804383 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/482fd661-96ea-439b-8cd7-ee5a5321e981-combined-ca-bundle\") pod \"482fd661-96ea-439b-8cd7-ee5a5321e981\" (UID: \"482fd661-96ea-439b-8cd7-ee5a5321e981\") " Mar 16 16:32:58 crc kubenswrapper[5120]: I0316 16:32:58.804448 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/482fd661-96ea-439b-8cd7-ee5a5321e981-config-data-custom\") pod \"482fd661-96ea-439b-8cd7-ee5a5321e981\" (UID: \"482fd661-96ea-439b-8cd7-ee5a5321e981\") " Mar 16 16:32:58 crc kubenswrapper[5120]: I0316 16:32:58.804509 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rzf97\" (UniqueName: \"kubernetes.io/projected/482fd661-96ea-439b-8cd7-ee5a5321e981-kube-api-access-rzf97\") pod \"482fd661-96ea-439b-8cd7-ee5a5321e981\" (UID: \"482fd661-96ea-439b-8cd7-ee5a5321e981\") " Mar 16 16:32:58 crc kubenswrapper[5120]: I0316 16:32:58.804678 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/482fd661-96ea-439b-8cd7-ee5a5321e981-logs\") pod \"482fd661-96ea-439b-8cd7-ee5a5321e981\" (UID: \"482fd661-96ea-439b-8cd7-ee5a5321e981\") " Mar 16 16:32:58 crc kubenswrapper[5120]: I0316 16:32:58.805079 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/482fd661-96ea-439b-8cd7-ee5a5321e981-logs" (OuterVolumeSpecName: "logs") pod "482fd661-96ea-439b-8cd7-ee5a5321e981" (UID: "482fd661-96ea-439b-8cd7-ee5a5321e981"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:32:58 crc kubenswrapper[5120]: I0316 16:32:58.805582 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/482fd661-96ea-439b-8cd7-ee5a5321e981-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:32:58 crc kubenswrapper[5120]: I0316 16:32:58.816040 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/482fd661-96ea-439b-8cd7-ee5a5321e981-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "482fd661-96ea-439b-8cd7-ee5a5321e981" (UID: "482fd661-96ea-439b-8cd7-ee5a5321e981"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:32:58 crc kubenswrapper[5120]: I0316 16:32:58.816234 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/482fd661-96ea-439b-8cd7-ee5a5321e981-kube-api-access-rzf97" (OuterVolumeSpecName: "kube-api-access-rzf97") pod "482fd661-96ea-439b-8cd7-ee5a5321e981" (UID: "482fd661-96ea-439b-8cd7-ee5a5321e981"). InnerVolumeSpecName "kube-api-access-rzf97". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:32:58 crc kubenswrapper[5120]: I0316 16:32:58.834611 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/482fd661-96ea-439b-8cd7-ee5a5321e981-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "482fd661-96ea-439b-8cd7-ee5a5321e981" (UID: "482fd661-96ea-439b-8cd7-ee5a5321e981"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:32:58 crc kubenswrapper[5120]: I0316 16:32:58.866924 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/482fd661-96ea-439b-8cd7-ee5a5321e981-config-data" (OuterVolumeSpecName: "config-data") pod "482fd661-96ea-439b-8cd7-ee5a5321e981" (UID: "482fd661-96ea-439b-8cd7-ee5a5321e981"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:32:58 crc kubenswrapper[5120]: I0316 16:32:58.907699 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/482fd661-96ea-439b-8cd7-ee5a5321e981-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:32:58 crc kubenswrapper[5120]: I0316 16:32:58.907740 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/482fd661-96ea-439b-8cd7-ee5a5321e981-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:32:58 crc kubenswrapper[5120]: I0316 16:32:58.907752 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/482fd661-96ea-439b-8cd7-ee5a5321e981-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:32:58 crc kubenswrapper[5120]: I0316 16:32:58.907778 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rzf97\" (UniqueName: \"kubernetes.io/projected/482fd661-96ea-439b-8cd7-ee5a5321e981-kube-api-access-rzf97\") on node \"crc\" DevicePath \"\"" Mar 16 16:32:59 crc kubenswrapper[5120]: I0316 16:32:59.023330 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"67fe9146-c519-453c-8f10-76ae241f8889","Type":"ContainerStarted","Data":"9a8355b26250445bed4bc196db99137c598f6231ee1a1f588c1869380a29016d"} Mar 16 16:32:59 crc kubenswrapper[5120]: I0316 16:32:59.024721 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:32:59 crc kubenswrapper[5120]: I0316 16:32:59.029177 5120 generic.go:358] "Generic (PLEG): container finished" podID="2ad10a31-4609-47b6-a992-baa9724d3652" containerID="bfa860c9a330a36ed895b9bce3540bd71e2ec75f0e0b4f0f8713240235ba5dc6" exitCode=0 Mar 16 16:32:59 crc kubenswrapper[5120]: I0316 16:32:59.029245 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"2ad10a31-4609-47b6-a992-baa9724d3652","Type":"ContainerDied","Data":"bfa860c9a330a36ed895b9bce3540bd71e2ec75f0e0b4f0f8713240235ba5dc6"} Mar 16 16:32:59 crc kubenswrapper[5120]: I0316 16:32:59.032119 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-587c77d488-zm2nq" event={"ID":"6aae3bc4-66a0-436a-b3b3-13d2be73a3de","Type":"ContainerStarted","Data":"3481a847d550596ff4f99fb9a428c4176854acc79aad578f33aa84b1279b7056"} Mar 16 16:32:59 crc kubenswrapper[5120]: I0316 16:32:59.032142 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-587c77d488-zm2nq" event={"ID":"6aae3bc4-66a0-436a-b3b3-13d2be73a3de","Type":"ContainerStarted","Data":"edd70813de326d9b1be3219b269f0e85d5c87d8f9ade26f447611458a3b1b08a"} Mar 16 16:32:59 crc kubenswrapper[5120]: I0316 16:32:59.032153 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-587c77d488-zm2nq" event={"ID":"6aae3bc4-66a0-436a-b3b3-13d2be73a3de","Type":"ContainerStarted","Data":"5d4527a705e224cd69735bbcf43ab9f4299bcea63e3463877a9ab791646a8064"} Mar 16 16:32:59 crc kubenswrapper[5120]: I0316 16:32:59.032237 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/neutron-587c77d488-zm2nq" Mar 16 16:32:59 crc kubenswrapper[5120]: I0316 16:32:59.038088 5120 generic.go:358] "Generic (PLEG): container finished" podID="482fd661-96ea-439b-8cd7-ee5a5321e981" containerID="b65a7138052afabe4d51fce29c540230c6c50c956a3a538bb146359fda5c781a" exitCode=0 Mar 16 16:32:59 crc kubenswrapper[5120]: I0316 16:32:59.038177 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-6f799fddf5-d8q8w" event={"ID":"482fd661-96ea-439b-8cd7-ee5a5321e981","Type":"ContainerDied","Data":"b65a7138052afabe4d51fce29c540230c6c50c956a3a538bb146359fda5c781a"} Mar 16 16:32:59 crc kubenswrapper[5120]: I0316 16:32:59.038236 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-6f799fddf5-d8q8w" event={"ID":"482fd661-96ea-439b-8cd7-ee5a5321e981","Type":"ContainerDied","Data":"edccfac66cbb28d724f2ae455350372ee6cf4aba5ae9c3f806e411658910bff3"} Mar 16 16:32:59 crc kubenswrapper[5120]: I0316 16:32:59.038262 5120 scope.go:117] "RemoveContainer" containerID="b65a7138052afabe4d51fce29c540230c6c50c956a3a538bb146359fda5c781a" Mar 16 16:32:59 crc kubenswrapper[5120]: I0316 16:32:59.038199 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-6f799fddf5-d8q8w" Mar 16 16:32:59 crc kubenswrapper[5120]: I0316 16:32:59.054739 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.850349878 podStartE2EDuration="7.054722502s" podCreationTimestamp="2026-03-16 16:32:52 +0000 UTC" firstStartedPulling="2026-03-16 16:32:53.895075923 +0000 UTC m=+3676.049007580" lastFinishedPulling="2026-03-16 16:32:58.099448547 +0000 UTC m=+3680.253380204" observedRunningTime="2026-03-16 16:32:59.047739779 +0000 UTC m=+3681.201671436" watchObservedRunningTime="2026-03-16 16:32:59.054722502 +0000 UTC m=+3681.208654159" Mar 16 16:32:59 crc kubenswrapper[5120]: I0316 16:32:59.081071 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-587c77d488-zm2nq" podStartSLOduration=2.081045371 podStartE2EDuration="2.081045371s" podCreationTimestamp="2026-03-16 16:32:57 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:32:59.068665497 +0000 UTC m=+3681.222597154" watchObservedRunningTime="2026-03-16 16:32:59.081045371 +0000 UTC m=+3681.234977028" Mar 16 16:32:59 crc kubenswrapper[5120]: I0316 16:32:59.099901 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-6f799fddf5-d8q8w"] Mar 16 16:32:59 crc kubenswrapper[5120]: I0316 16:32:59.110216 5120 scope.go:117] "RemoveContainer" containerID="296d6bcfaa5bf0d87c8e51368ec27c05edb44b2f923967694aa0ecab78e54070" Mar 16 16:32:59 crc kubenswrapper[5120]: I0316 16:32:59.110912 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-6f799fddf5-d8q8w"] Mar 16 16:32:59 crc kubenswrapper[5120]: I0316 16:32:59.138623 5120 scope.go:117] "RemoveContainer" containerID="b65a7138052afabe4d51fce29c540230c6c50c956a3a538bb146359fda5c781a" Mar 16 16:32:59 crc kubenswrapper[5120]: E0316 16:32:59.139099 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b65a7138052afabe4d51fce29c540230c6c50c956a3a538bb146359fda5c781a\": container with ID starting with b65a7138052afabe4d51fce29c540230c6c50c956a3a538bb146359fda5c781a not found: ID does not exist" containerID="b65a7138052afabe4d51fce29c540230c6c50c956a3a538bb146359fda5c781a" Mar 16 16:32:59 crc kubenswrapper[5120]: I0316 16:32:59.139134 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b65a7138052afabe4d51fce29c540230c6c50c956a3a538bb146359fda5c781a"} err="failed to get container status \"b65a7138052afabe4d51fce29c540230c6c50c956a3a538bb146359fda5c781a\": rpc error: code = NotFound desc = could not find container \"b65a7138052afabe4d51fce29c540230c6c50c956a3a538bb146359fda5c781a\": container with ID starting with b65a7138052afabe4d51fce29c540230c6c50c956a3a538bb146359fda5c781a not found: ID does not exist" Mar 16 16:32:59 crc kubenswrapper[5120]: I0316 16:32:59.139157 5120 scope.go:117] "RemoveContainer" containerID="296d6bcfaa5bf0d87c8e51368ec27c05edb44b2f923967694aa0ecab78e54070" Mar 16 16:32:59 crc kubenswrapper[5120]: E0316 16:32:59.139679 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"296d6bcfaa5bf0d87c8e51368ec27c05edb44b2f923967694aa0ecab78e54070\": container with ID starting with 296d6bcfaa5bf0d87c8e51368ec27c05edb44b2f923967694aa0ecab78e54070 not found: ID does not exist" containerID="296d6bcfaa5bf0d87c8e51368ec27c05edb44b2f923967694aa0ecab78e54070" Mar 16 16:32:59 crc kubenswrapper[5120]: I0316 16:32:59.139701 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"296d6bcfaa5bf0d87c8e51368ec27c05edb44b2f923967694aa0ecab78e54070"} err="failed to get container status \"296d6bcfaa5bf0d87c8e51368ec27c05edb44b2f923967694aa0ecab78e54070\": rpc error: code = NotFound desc = could not find container \"296d6bcfaa5bf0d87c8e51368ec27c05edb44b2f923967694aa0ecab78e54070\": container with ID starting with 296d6bcfaa5bf0d87c8e51368ec27c05edb44b2f923967694aa0ecab78e54070 not found: ID does not exist" Mar 16 16:32:59 crc kubenswrapper[5120]: I0316 16:32:59.166144 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-5465fdbb4f-kmfhc"] Mar 16 16:32:59 crc kubenswrapper[5120]: I0316 16:32:59.167464 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8789d77e-5501-4888-8248-254c4a42ffaf" containerName="barbican-worker" Mar 16 16:32:59 crc kubenswrapper[5120]: I0316 16:32:59.167485 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8789d77e-5501-4888-8248-254c4a42ffaf" containerName="barbican-worker" Mar 16 16:32:59 crc kubenswrapper[5120]: I0316 16:32:59.167519 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a15bc36-5f09-421b-a175-df44f218f875" containerName="barbican-api-log" Mar 16 16:32:59 crc kubenswrapper[5120]: I0316 16:32:59.167528 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a15bc36-5f09-421b-a175-df44f218f875" containerName="barbican-api-log" Mar 16 16:32:59 crc kubenswrapper[5120]: I0316 16:32:59.167546 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="482fd661-96ea-439b-8cd7-ee5a5321e981" containerName="barbican-keystone-listener-log" Mar 16 16:32:59 crc kubenswrapper[5120]: I0316 16:32:59.167554 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="482fd661-96ea-439b-8cd7-ee5a5321e981" containerName="barbican-keystone-listener-log" Mar 16 16:32:59 crc kubenswrapper[5120]: I0316 16:32:59.167604 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8789d77e-5501-4888-8248-254c4a42ffaf" containerName="barbican-worker-log" Mar 16 16:32:59 crc kubenswrapper[5120]: I0316 16:32:59.167611 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8789d77e-5501-4888-8248-254c4a42ffaf" containerName="barbican-worker-log" Mar 16 16:32:59 crc kubenswrapper[5120]: I0316 16:32:59.167618 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="482fd661-96ea-439b-8cd7-ee5a5321e981" containerName="barbican-keystone-listener" Mar 16 16:32:59 crc kubenswrapper[5120]: I0316 16:32:59.167624 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="482fd661-96ea-439b-8cd7-ee5a5321e981" containerName="barbican-keystone-listener" Mar 16 16:32:59 crc kubenswrapper[5120]: I0316 16:32:59.167633 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a15bc36-5f09-421b-a175-df44f218f875" containerName="barbican-api" Mar 16 16:32:59 crc kubenswrapper[5120]: I0316 16:32:59.167639 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a15bc36-5f09-421b-a175-df44f218f875" containerName="barbican-api" Mar 16 16:32:59 crc kubenswrapper[5120]: I0316 16:32:59.167810 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="482fd661-96ea-439b-8cd7-ee5a5321e981" containerName="barbican-keystone-listener-log" Mar 16 16:32:59 crc kubenswrapper[5120]: I0316 16:32:59.167821 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="9a15bc36-5f09-421b-a175-df44f218f875" containerName="barbican-api-log" Mar 16 16:32:59 crc kubenswrapper[5120]: I0316 16:32:59.167843 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="482fd661-96ea-439b-8cd7-ee5a5321e981" containerName="barbican-keystone-listener" Mar 16 16:32:59 crc kubenswrapper[5120]: I0316 16:32:59.167854 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="8789d77e-5501-4888-8248-254c4a42ffaf" containerName="barbican-worker" Mar 16 16:32:59 crc kubenswrapper[5120]: I0316 16:32:59.167863 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="8789d77e-5501-4888-8248-254c4a42ffaf" containerName="barbican-worker-log" Mar 16 16:32:59 crc kubenswrapper[5120]: I0316 16:32:59.167873 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="9a15bc36-5f09-421b-a175-df44f218f875" containerName="barbican-api" Mar 16 16:32:59 crc kubenswrapper[5120]: I0316 16:32:59.172513 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-5465fdbb4f-kmfhc" Mar 16 16:32:59 crc kubenswrapper[5120]: I0316 16:32:59.177642 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-neutron-internal-svc\"" Mar 16 16:32:59 crc kubenswrapper[5120]: I0316 16:32:59.177981 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-neutron-public-svc\"" Mar 16 16:32:59 crc kubenswrapper[5120]: I0316 16:32:59.179539 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-5465fdbb4f-kmfhc"] Mar 16 16:32:59 crc kubenswrapper[5120]: I0316 16:32:59.323951 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/5d856ccc-313e-4833-8548-c8e34d0852ba-public-tls-certs\") pod \"neutron-5465fdbb4f-kmfhc\" (UID: \"5d856ccc-313e-4833-8548-c8e34d0852ba\") " pod="openstack-kuttl-tests/neutron-5465fdbb4f-kmfhc" Mar 16 16:32:59 crc kubenswrapper[5120]: I0316 16:32:59.324141 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/5d856ccc-313e-4833-8548-c8e34d0852ba-internal-tls-certs\") pod \"neutron-5465fdbb4f-kmfhc\" (UID: \"5d856ccc-313e-4833-8548-c8e34d0852ba\") " pod="openstack-kuttl-tests/neutron-5465fdbb4f-kmfhc" Mar 16 16:32:59 crc kubenswrapper[5120]: I0316 16:32:59.324329 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9g6wh\" (UniqueName: \"kubernetes.io/projected/5d856ccc-313e-4833-8548-c8e34d0852ba-kube-api-access-9g6wh\") pod \"neutron-5465fdbb4f-kmfhc\" (UID: \"5d856ccc-313e-4833-8548-c8e34d0852ba\") " pod="openstack-kuttl-tests/neutron-5465fdbb4f-kmfhc" Mar 16 16:32:59 crc kubenswrapper[5120]: I0316 16:32:59.324440 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5d856ccc-313e-4833-8548-c8e34d0852ba-config\") pod \"neutron-5465fdbb4f-kmfhc\" (UID: \"5d856ccc-313e-4833-8548-c8e34d0852ba\") " pod="openstack-kuttl-tests/neutron-5465fdbb4f-kmfhc" Mar 16 16:32:59 crc kubenswrapper[5120]: I0316 16:32:59.324733 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/5d856ccc-313e-4833-8548-c8e34d0852ba-httpd-config\") pod \"neutron-5465fdbb4f-kmfhc\" (UID: \"5d856ccc-313e-4833-8548-c8e34d0852ba\") " pod="openstack-kuttl-tests/neutron-5465fdbb4f-kmfhc" Mar 16 16:32:59 crc kubenswrapper[5120]: I0316 16:32:59.324931 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5d856ccc-313e-4833-8548-c8e34d0852ba-combined-ca-bundle\") pod \"neutron-5465fdbb4f-kmfhc\" (UID: \"5d856ccc-313e-4833-8548-c8e34d0852ba\") " pod="openstack-kuttl-tests/neutron-5465fdbb4f-kmfhc" Mar 16 16:32:59 crc kubenswrapper[5120]: I0316 16:32:59.325208 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/5d856ccc-313e-4833-8548-c8e34d0852ba-ovndb-tls-certs\") pod \"neutron-5465fdbb4f-kmfhc\" (UID: \"5d856ccc-313e-4833-8548-c8e34d0852ba\") " pod="openstack-kuttl-tests/neutron-5465fdbb4f-kmfhc" Mar 16 16:32:59 crc kubenswrapper[5120]: I0316 16:32:59.427337 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/5d856ccc-313e-4833-8548-c8e34d0852ba-internal-tls-certs\") pod \"neutron-5465fdbb4f-kmfhc\" (UID: \"5d856ccc-313e-4833-8548-c8e34d0852ba\") " pod="openstack-kuttl-tests/neutron-5465fdbb4f-kmfhc" Mar 16 16:32:59 crc kubenswrapper[5120]: I0316 16:32:59.427500 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9g6wh\" (UniqueName: \"kubernetes.io/projected/5d856ccc-313e-4833-8548-c8e34d0852ba-kube-api-access-9g6wh\") pod \"neutron-5465fdbb4f-kmfhc\" (UID: \"5d856ccc-313e-4833-8548-c8e34d0852ba\") " pod="openstack-kuttl-tests/neutron-5465fdbb4f-kmfhc" Mar 16 16:32:59 crc kubenswrapper[5120]: I0316 16:32:59.427561 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5d856ccc-313e-4833-8548-c8e34d0852ba-config\") pod \"neutron-5465fdbb4f-kmfhc\" (UID: \"5d856ccc-313e-4833-8548-c8e34d0852ba\") " pod="openstack-kuttl-tests/neutron-5465fdbb4f-kmfhc" Mar 16 16:32:59 crc kubenswrapper[5120]: I0316 16:32:59.427601 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/5d856ccc-313e-4833-8548-c8e34d0852ba-httpd-config\") pod \"neutron-5465fdbb4f-kmfhc\" (UID: \"5d856ccc-313e-4833-8548-c8e34d0852ba\") " pod="openstack-kuttl-tests/neutron-5465fdbb4f-kmfhc" Mar 16 16:32:59 crc kubenswrapper[5120]: I0316 16:32:59.427624 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5d856ccc-313e-4833-8548-c8e34d0852ba-combined-ca-bundle\") pod \"neutron-5465fdbb4f-kmfhc\" (UID: \"5d856ccc-313e-4833-8548-c8e34d0852ba\") " pod="openstack-kuttl-tests/neutron-5465fdbb4f-kmfhc" Mar 16 16:32:59 crc kubenswrapper[5120]: I0316 16:32:59.427682 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/5d856ccc-313e-4833-8548-c8e34d0852ba-ovndb-tls-certs\") pod \"neutron-5465fdbb4f-kmfhc\" (UID: \"5d856ccc-313e-4833-8548-c8e34d0852ba\") " pod="openstack-kuttl-tests/neutron-5465fdbb4f-kmfhc" Mar 16 16:32:59 crc kubenswrapper[5120]: I0316 16:32:59.427829 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/5d856ccc-313e-4833-8548-c8e34d0852ba-public-tls-certs\") pod \"neutron-5465fdbb4f-kmfhc\" (UID: \"5d856ccc-313e-4833-8548-c8e34d0852ba\") " pod="openstack-kuttl-tests/neutron-5465fdbb4f-kmfhc" Mar 16 16:32:59 crc kubenswrapper[5120]: I0316 16:32:59.432746 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/5d856ccc-313e-4833-8548-c8e34d0852ba-public-tls-certs\") pod \"neutron-5465fdbb4f-kmfhc\" (UID: \"5d856ccc-313e-4833-8548-c8e34d0852ba\") " pod="openstack-kuttl-tests/neutron-5465fdbb4f-kmfhc" Mar 16 16:32:59 crc kubenswrapper[5120]: I0316 16:32:59.432868 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/5d856ccc-313e-4833-8548-c8e34d0852ba-internal-tls-certs\") pod \"neutron-5465fdbb4f-kmfhc\" (UID: \"5d856ccc-313e-4833-8548-c8e34d0852ba\") " pod="openstack-kuttl-tests/neutron-5465fdbb4f-kmfhc" Mar 16 16:32:59 crc kubenswrapper[5120]: I0316 16:32:59.433125 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/5d856ccc-313e-4833-8548-c8e34d0852ba-config\") pod \"neutron-5465fdbb4f-kmfhc\" (UID: \"5d856ccc-313e-4833-8548-c8e34d0852ba\") " pod="openstack-kuttl-tests/neutron-5465fdbb4f-kmfhc" Mar 16 16:32:59 crc kubenswrapper[5120]: I0316 16:32:59.434543 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/5d856ccc-313e-4833-8548-c8e34d0852ba-httpd-config\") pod \"neutron-5465fdbb4f-kmfhc\" (UID: \"5d856ccc-313e-4833-8548-c8e34d0852ba\") " pod="openstack-kuttl-tests/neutron-5465fdbb4f-kmfhc" Mar 16 16:32:59 crc kubenswrapper[5120]: I0316 16:32:59.443576 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/5d856ccc-313e-4833-8548-c8e34d0852ba-ovndb-tls-certs\") pod \"neutron-5465fdbb4f-kmfhc\" (UID: \"5d856ccc-313e-4833-8548-c8e34d0852ba\") " pod="openstack-kuttl-tests/neutron-5465fdbb4f-kmfhc" Mar 16 16:32:59 crc kubenswrapper[5120]: I0316 16:32:59.447859 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5d856ccc-313e-4833-8548-c8e34d0852ba-combined-ca-bundle\") pod \"neutron-5465fdbb4f-kmfhc\" (UID: \"5d856ccc-313e-4833-8548-c8e34d0852ba\") " pod="openstack-kuttl-tests/neutron-5465fdbb4f-kmfhc" Mar 16 16:32:59 crc kubenswrapper[5120]: I0316 16:32:59.448661 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9g6wh\" (UniqueName: \"kubernetes.io/projected/5d856ccc-313e-4833-8548-c8e34d0852ba-kube-api-access-9g6wh\") pod \"neutron-5465fdbb4f-kmfhc\" (UID: \"5d856ccc-313e-4833-8548-c8e34d0852ba\") " pod="openstack-kuttl-tests/neutron-5465fdbb4f-kmfhc" Mar 16 16:32:59 crc kubenswrapper[5120]: I0316 16:32:59.500370 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-5465fdbb4f-kmfhc" Mar 16 16:32:59 crc kubenswrapper[5120]: I0316 16:32:59.965395 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-5465fdbb4f-kmfhc"] Mar 16 16:32:59 crc kubenswrapper[5120]: W0316 16:32:59.966357 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5d856ccc_313e_4833_8548_c8e34d0852ba.slice/crio-943524f8530ee8c8b122880c51a1f6701ca93daebf74b3769cd36788492d564d WatchSource:0}: Error finding container 943524f8530ee8c8b122880c51a1f6701ca93daebf74b3769cd36788492d564d: Status 404 returned error can't find the container with id 943524f8530ee8c8b122880c51a1f6701ca93daebf74b3769cd36788492d564d Mar 16 16:33:00 crc kubenswrapper[5120]: I0316 16:33:00.062839 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-5465fdbb4f-kmfhc" event={"ID":"5d856ccc-313e-4833-8548-c8e34d0852ba","Type":"ContainerStarted","Data":"943524f8530ee8c8b122880c51a1f6701ca93daebf74b3769cd36788492d564d"} Mar 16 16:33:00 crc kubenswrapper[5120]: I0316 16:33:00.674807 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="482fd661-96ea-439b-8cd7-ee5a5321e981" path="/var/lib/kubelet/pods/482fd661-96ea-439b-8cd7-ee5a5321e981/volumes" Mar 16 16:33:01 crc kubenswrapper[5120]: I0316 16:33:01.078076 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-5465fdbb4f-kmfhc" event={"ID":"5d856ccc-313e-4833-8548-c8e34d0852ba","Type":"ContainerStarted","Data":"919fbcb5f5c708d3d71add68a29194c1b6ef9cd341c8a87d23bcd6654768a044"} Mar 16 16:33:01 crc kubenswrapper[5120]: I0316 16:33:01.078133 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-5465fdbb4f-kmfhc" event={"ID":"5d856ccc-313e-4833-8548-c8e34d0852ba","Type":"ContainerStarted","Data":"0c7a14a52c399c07522843c53d42edbfe74d08ad0b9dd13a8dc530c5065e6623"} Mar 16 16:33:01 crc kubenswrapper[5120]: I0316 16:33:01.111665 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-5465fdbb4f-kmfhc" podStartSLOduration=2.1116389 podStartE2EDuration="2.1116389s" podCreationTimestamp="2026-03-16 16:32:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:33:01.102671945 +0000 UTC m=+3683.256603602" watchObservedRunningTime="2026-03-16 16:33:01.1116389 +0000 UTC m=+3683.265570557" Mar 16 16:33:01 crc kubenswrapper[5120]: I0316 16:33:01.665369 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:33:01 crc kubenswrapper[5120]: I0316 16:33:01.781159 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2ad10a31-4609-47b6-a992-baa9724d3652-scripts\") pod \"2ad10a31-4609-47b6-a992-baa9724d3652\" (UID: \"2ad10a31-4609-47b6-a992-baa9724d3652\") " Mar 16 16:33:01 crc kubenswrapper[5120]: I0316 16:33:01.781279 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2ad10a31-4609-47b6-a992-baa9724d3652-config-data\") pod \"2ad10a31-4609-47b6-a992-baa9724d3652\" (UID: \"2ad10a31-4609-47b6-a992-baa9724d3652\") " Mar 16 16:33:01 crc kubenswrapper[5120]: I0316 16:33:01.781322 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vnpsd\" (UniqueName: \"kubernetes.io/projected/2ad10a31-4609-47b6-a992-baa9724d3652-kube-api-access-vnpsd\") pod \"2ad10a31-4609-47b6-a992-baa9724d3652\" (UID: \"2ad10a31-4609-47b6-a992-baa9724d3652\") " Mar 16 16:33:01 crc kubenswrapper[5120]: I0316 16:33:01.781382 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/2ad10a31-4609-47b6-a992-baa9724d3652-config-data-custom\") pod \"2ad10a31-4609-47b6-a992-baa9724d3652\" (UID: \"2ad10a31-4609-47b6-a992-baa9724d3652\") " Mar 16 16:33:01 crc kubenswrapper[5120]: I0316 16:33:01.781448 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2ad10a31-4609-47b6-a992-baa9724d3652-combined-ca-bundle\") pod \"2ad10a31-4609-47b6-a992-baa9724d3652\" (UID: \"2ad10a31-4609-47b6-a992-baa9724d3652\") " Mar 16 16:33:01 crc kubenswrapper[5120]: I0316 16:33:01.781703 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/2ad10a31-4609-47b6-a992-baa9724d3652-etc-machine-id\") pod \"2ad10a31-4609-47b6-a992-baa9724d3652\" (UID: \"2ad10a31-4609-47b6-a992-baa9724d3652\") " Mar 16 16:33:01 crc kubenswrapper[5120]: I0316 16:33:01.781755 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/2ad10a31-4609-47b6-a992-baa9724d3652-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "2ad10a31-4609-47b6-a992-baa9724d3652" (UID: "2ad10a31-4609-47b6-a992-baa9724d3652"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 16:33:01 crc kubenswrapper[5120]: I0316 16:33:01.782213 5120 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/2ad10a31-4609-47b6-a992-baa9724d3652-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 16:33:01 crc kubenswrapper[5120]: I0316 16:33:01.787296 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2ad10a31-4609-47b6-a992-baa9724d3652-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "2ad10a31-4609-47b6-a992-baa9724d3652" (UID: "2ad10a31-4609-47b6-a992-baa9724d3652"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:33:01 crc kubenswrapper[5120]: I0316 16:33:01.787576 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ad10a31-4609-47b6-a992-baa9724d3652-kube-api-access-vnpsd" (OuterVolumeSpecName: "kube-api-access-vnpsd") pod "2ad10a31-4609-47b6-a992-baa9724d3652" (UID: "2ad10a31-4609-47b6-a992-baa9724d3652"). InnerVolumeSpecName "kube-api-access-vnpsd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:33:01 crc kubenswrapper[5120]: I0316 16:33:01.787715 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2ad10a31-4609-47b6-a992-baa9724d3652-scripts" (OuterVolumeSpecName: "scripts") pod "2ad10a31-4609-47b6-a992-baa9724d3652" (UID: "2ad10a31-4609-47b6-a992-baa9724d3652"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:33:01 crc kubenswrapper[5120]: I0316 16:33:01.861340 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2ad10a31-4609-47b6-a992-baa9724d3652-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "2ad10a31-4609-47b6-a992-baa9724d3652" (UID: "2ad10a31-4609-47b6-a992-baa9724d3652"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:33:01 crc kubenswrapper[5120]: I0316 16:33:01.885288 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2ad10a31-4609-47b6-a992-baa9724d3652-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:33:01 crc kubenswrapper[5120]: I0316 16:33:01.885319 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vnpsd\" (UniqueName: \"kubernetes.io/projected/2ad10a31-4609-47b6-a992-baa9724d3652-kube-api-access-vnpsd\") on node \"crc\" DevicePath \"\"" Mar 16 16:33:01 crc kubenswrapper[5120]: I0316 16:33:01.885330 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/2ad10a31-4609-47b6-a992-baa9724d3652-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:33:01 crc kubenswrapper[5120]: I0316 16:33:01.885339 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2ad10a31-4609-47b6-a992-baa9724d3652-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:33:01 crc kubenswrapper[5120]: I0316 16:33:01.921722 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2ad10a31-4609-47b6-a992-baa9724d3652-config-data" (OuterVolumeSpecName: "config-data") pod "2ad10a31-4609-47b6-a992-baa9724d3652" (UID: "2ad10a31-4609-47b6-a992-baa9724d3652"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:33:01 crc kubenswrapper[5120]: I0316 16:33:01.988064 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2ad10a31-4609-47b6-a992-baa9724d3652-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:33:02 crc kubenswrapper[5120]: I0316 16:33:02.092303 5120 generic.go:358] "Generic (PLEG): container finished" podID="2ad10a31-4609-47b6-a992-baa9724d3652" containerID="801e54778f96f4fcc6177b47190cb6a35c5b94f51610a06ab650720884fc39ef" exitCode=0 Mar 16 16:33:02 crc kubenswrapper[5120]: I0316 16:33:02.092398 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:33:02 crc kubenswrapper[5120]: I0316 16:33:02.092423 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"2ad10a31-4609-47b6-a992-baa9724d3652","Type":"ContainerDied","Data":"801e54778f96f4fcc6177b47190cb6a35c5b94f51610a06ab650720884fc39ef"} Mar 16 16:33:02 crc kubenswrapper[5120]: I0316 16:33:02.092460 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"2ad10a31-4609-47b6-a992-baa9724d3652","Type":"ContainerDied","Data":"feb3f037e7d90c0bfafea03ca01bb803ea900b881c1e17af7e49c4789cfdf853"} Mar 16 16:33:02 crc kubenswrapper[5120]: I0316 16:33:02.092477 5120 scope.go:117] "RemoveContainer" containerID="bfa860c9a330a36ed895b9bce3540bd71e2ec75f0e0b4f0f8713240235ba5dc6" Mar 16 16:33:02 crc kubenswrapper[5120]: I0316 16:33:02.093117 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/neutron-5465fdbb4f-kmfhc" Mar 16 16:33:02 crc kubenswrapper[5120]: I0316 16:33:02.127105 5120 scope.go:117] "RemoveContainer" containerID="801e54778f96f4fcc6177b47190cb6a35c5b94f51610a06ab650720884fc39ef" Mar 16 16:33:02 crc kubenswrapper[5120]: I0316 16:33:02.130566 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:33:02 crc kubenswrapper[5120]: I0316 16:33:02.141056 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:33:02 crc kubenswrapper[5120]: I0316 16:33:02.162898 5120 scope.go:117] "RemoveContainer" containerID="bfa860c9a330a36ed895b9bce3540bd71e2ec75f0e0b4f0f8713240235ba5dc6" Mar 16 16:33:02 crc kubenswrapper[5120]: I0316 16:33:02.164159 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:33:02 crc kubenswrapper[5120]: E0316 16:33:02.164391 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bfa860c9a330a36ed895b9bce3540bd71e2ec75f0e0b4f0f8713240235ba5dc6\": container with ID starting with bfa860c9a330a36ed895b9bce3540bd71e2ec75f0e0b4f0f8713240235ba5dc6 not found: ID does not exist" containerID="bfa860c9a330a36ed895b9bce3540bd71e2ec75f0e0b4f0f8713240235ba5dc6" Mar 16 16:33:02 crc kubenswrapper[5120]: I0316 16:33:02.164431 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bfa860c9a330a36ed895b9bce3540bd71e2ec75f0e0b4f0f8713240235ba5dc6"} err="failed to get container status \"bfa860c9a330a36ed895b9bce3540bd71e2ec75f0e0b4f0f8713240235ba5dc6\": rpc error: code = NotFound desc = could not find container \"bfa860c9a330a36ed895b9bce3540bd71e2ec75f0e0b4f0f8713240235ba5dc6\": container with ID starting with bfa860c9a330a36ed895b9bce3540bd71e2ec75f0e0b4f0f8713240235ba5dc6 not found: ID does not exist" Mar 16 16:33:02 crc kubenswrapper[5120]: I0316 16:33:02.164453 5120 scope.go:117] "RemoveContainer" containerID="801e54778f96f4fcc6177b47190cb6a35c5b94f51610a06ab650720884fc39ef" Mar 16 16:33:02 crc kubenswrapper[5120]: E0316 16:33:02.164810 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"801e54778f96f4fcc6177b47190cb6a35c5b94f51610a06ab650720884fc39ef\": container with ID starting with 801e54778f96f4fcc6177b47190cb6a35c5b94f51610a06ab650720884fc39ef not found: ID does not exist" containerID="801e54778f96f4fcc6177b47190cb6a35c5b94f51610a06ab650720884fc39ef" Mar 16 16:33:02 crc kubenswrapper[5120]: I0316 16:33:02.164851 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"801e54778f96f4fcc6177b47190cb6a35c5b94f51610a06ab650720884fc39ef"} err="failed to get container status \"801e54778f96f4fcc6177b47190cb6a35c5b94f51610a06ab650720884fc39ef\": rpc error: code = NotFound desc = could not find container \"801e54778f96f4fcc6177b47190cb6a35c5b94f51610a06ab650720884fc39ef\": container with ID starting with 801e54778f96f4fcc6177b47190cb6a35c5b94f51610a06ab650720884fc39ef not found: ID does not exist" Mar 16 16:33:02 crc kubenswrapper[5120]: I0316 16:33:02.165224 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ad10a31-4609-47b6-a992-baa9724d3652" containerName="cinder-scheduler" Mar 16 16:33:02 crc kubenswrapper[5120]: I0316 16:33:02.165245 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ad10a31-4609-47b6-a992-baa9724d3652" containerName="cinder-scheduler" Mar 16 16:33:02 crc kubenswrapper[5120]: I0316 16:33:02.165295 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ad10a31-4609-47b6-a992-baa9724d3652" containerName="probe" Mar 16 16:33:02 crc kubenswrapper[5120]: I0316 16:33:02.165301 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ad10a31-4609-47b6-a992-baa9724d3652" containerName="probe" Mar 16 16:33:02 crc kubenswrapper[5120]: I0316 16:33:02.165461 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="2ad10a31-4609-47b6-a992-baa9724d3652" containerName="cinder-scheduler" Mar 16 16:33:02 crc kubenswrapper[5120]: I0316 16:33:02.165475 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="2ad10a31-4609-47b6-a992-baa9724d3652" containerName="probe" Mar 16 16:33:02 crc kubenswrapper[5120]: I0316 16:33:02.173412 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:33:02 crc kubenswrapper[5120]: I0316 16:33:02.173524 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:33:02 crc kubenswrapper[5120]: I0316 16:33:02.180309 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-scheduler-config-data\"" Mar 16 16:33:02 crc kubenswrapper[5120]: I0316 16:33:02.295480 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/63d9a98c-175f-4caa-bd33-41eb82d6e06b-scripts\") pod \"cinder-scheduler-0\" (UID: \"63d9a98c-175f-4caa-bd33-41eb82d6e06b\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:33:02 crc kubenswrapper[5120]: I0316 16:33:02.295812 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/63d9a98c-175f-4caa-bd33-41eb82d6e06b-config-data\") pod \"cinder-scheduler-0\" (UID: \"63d9a98c-175f-4caa-bd33-41eb82d6e06b\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:33:02 crc kubenswrapper[5120]: I0316 16:33:02.295916 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/63d9a98c-175f-4caa-bd33-41eb82d6e06b-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"63d9a98c-175f-4caa-bd33-41eb82d6e06b\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:33:02 crc kubenswrapper[5120]: I0316 16:33:02.295973 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/63d9a98c-175f-4caa-bd33-41eb82d6e06b-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"63d9a98c-175f-4caa-bd33-41eb82d6e06b\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:33:02 crc kubenswrapper[5120]: I0316 16:33:02.296275 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/63d9a98c-175f-4caa-bd33-41eb82d6e06b-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"63d9a98c-175f-4caa-bd33-41eb82d6e06b\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:33:02 crc kubenswrapper[5120]: I0316 16:33:02.296464 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgzzx\" (UniqueName: \"kubernetes.io/projected/63d9a98c-175f-4caa-bd33-41eb82d6e06b-kube-api-access-xgzzx\") pod \"cinder-scheduler-0\" (UID: \"63d9a98c-175f-4caa-bd33-41eb82d6e06b\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:33:02 crc kubenswrapper[5120]: I0316 16:33:02.399006 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/63d9a98c-175f-4caa-bd33-41eb82d6e06b-config-data\") pod \"cinder-scheduler-0\" (UID: \"63d9a98c-175f-4caa-bd33-41eb82d6e06b\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:33:02 crc kubenswrapper[5120]: I0316 16:33:02.399057 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/63d9a98c-175f-4caa-bd33-41eb82d6e06b-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"63d9a98c-175f-4caa-bd33-41eb82d6e06b\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:33:02 crc kubenswrapper[5120]: I0316 16:33:02.399130 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/63d9a98c-175f-4caa-bd33-41eb82d6e06b-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"63d9a98c-175f-4caa-bd33-41eb82d6e06b\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:33:02 crc kubenswrapper[5120]: I0316 16:33:02.399234 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/63d9a98c-175f-4caa-bd33-41eb82d6e06b-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"63d9a98c-175f-4caa-bd33-41eb82d6e06b\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:33:02 crc kubenswrapper[5120]: I0316 16:33:02.399298 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xgzzx\" (UniqueName: \"kubernetes.io/projected/63d9a98c-175f-4caa-bd33-41eb82d6e06b-kube-api-access-xgzzx\") pod \"cinder-scheduler-0\" (UID: \"63d9a98c-175f-4caa-bd33-41eb82d6e06b\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:33:02 crc kubenswrapper[5120]: I0316 16:33:02.399309 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/63d9a98c-175f-4caa-bd33-41eb82d6e06b-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"63d9a98c-175f-4caa-bd33-41eb82d6e06b\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:33:02 crc kubenswrapper[5120]: I0316 16:33:02.399441 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/63d9a98c-175f-4caa-bd33-41eb82d6e06b-scripts\") pod \"cinder-scheduler-0\" (UID: \"63d9a98c-175f-4caa-bd33-41eb82d6e06b\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:33:02 crc kubenswrapper[5120]: I0316 16:33:02.405876 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/63d9a98c-175f-4caa-bd33-41eb82d6e06b-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"63d9a98c-175f-4caa-bd33-41eb82d6e06b\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:33:02 crc kubenswrapper[5120]: I0316 16:33:02.405907 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/63d9a98c-175f-4caa-bd33-41eb82d6e06b-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"63d9a98c-175f-4caa-bd33-41eb82d6e06b\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:33:02 crc kubenswrapper[5120]: I0316 16:33:02.407106 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/63d9a98c-175f-4caa-bd33-41eb82d6e06b-config-data\") pod \"cinder-scheduler-0\" (UID: \"63d9a98c-175f-4caa-bd33-41eb82d6e06b\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:33:02 crc kubenswrapper[5120]: I0316 16:33:02.421154 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/63d9a98c-175f-4caa-bd33-41eb82d6e06b-scripts\") pod \"cinder-scheduler-0\" (UID: \"63d9a98c-175f-4caa-bd33-41eb82d6e06b\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:33:02 crc kubenswrapper[5120]: I0316 16:33:02.423528 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgzzx\" (UniqueName: \"kubernetes.io/projected/63d9a98c-175f-4caa-bd33-41eb82d6e06b-kube-api-access-xgzzx\") pod \"cinder-scheduler-0\" (UID: \"63d9a98c-175f-4caa-bd33-41eb82d6e06b\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:33:02 crc kubenswrapper[5120]: I0316 16:33:02.505463 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:33:02 crc kubenswrapper[5120]: I0316 16:33:02.675544 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2ad10a31-4609-47b6-a992-baa9724d3652" path="/var/lib/kubelet/pods/2ad10a31-4609-47b6-a992-baa9724d3652/volumes" Mar 16 16:33:02 crc kubenswrapper[5120]: I0316 16:33:02.990611 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:33:03 crc kubenswrapper[5120]: W0316 16:33:03.006618 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod63d9a98c_175f_4caa_bd33_41eb82d6e06b.slice/crio-5f1b71df4cb307f83b9005e68b40676feb922878370c09aadaf4b20885a0264c WatchSource:0}: Error finding container 5f1b71df4cb307f83b9005e68b40676feb922878370c09aadaf4b20885a0264c: Status 404 returned error can't find the container with id 5f1b71df4cb307f83b9005e68b40676feb922878370c09aadaf4b20885a0264c Mar 16 16:33:03 crc kubenswrapper[5120]: I0316 16:33:03.109423 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"63d9a98c-175f-4caa-bd33-41eb82d6e06b","Type":"ContainerStarted","Data":"5f1b71df4cb307f83b9005e68b40676feb922878370c09aadaf4b20885a0264c"} Mar 16 16:33:03 crc kubenswrapper[5120]: I0316 16:33:03.544649 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-7d985d96b7-jk8xr" Mar 16 16:33:03 crc kubenswrapper[5120]: I0316 16:33:03.658369 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-7d985d96b7-jk8xr" Mar 16 16:33:03 crc kubenswrapper[5120]: I0316 16:33:03.745164 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-5975dccf9f-xrcl8"] Mar 16 16:33:03 crc kubenswrapper[5120]: I0316 16:33:03.745400 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-5975dccf9f-xrcl8" podUID="2613977e-8fa5-4c77-85b3-d9ee626e58bc" containerName="barbican-api-log" containerID="cri-o://4dd0233715164898c2755653545b23422f02ff3fdc2610f410c5f0603b8ec5f8" gracePeriod=30 Mar 16 16:33:03 crc kubenswrapper[5120]: I0316 16:33:03.745624 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-5975dccf9f-xrcl8" podUID="2613977e-8fa5-4c77-85b3-d9ee626e58bc" containerName="barbican-api" containerID="cri-o://ea7a1e07ead684d8ab119f44156093afc27c47f0e08e921bc2307c0294baf9eb" gracePeriod=30 Mar 16 16:33:04 crc kubenswrapper[5120]: I0316 16:33:04.129443 5120 generic.go:358] "Generic (PLEG): container finished" podID="2613977e-8fa5-4c77-85b3-d9ee626e58bc" containerID="4dd0233715164898c2755653545b23422f02ff3fdc2610f410c5f0603b8ec5f8" exitCode=143 Mar 16 16:33:04 crc kubenswrapper[5120]: I0316 16:33:04.130054 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-5975dccf9f-xrcl8" event={"ID":"2613977e-8fa5-4c77-85b3-d9ee626e58bc","Type":"ContainerDied","Data":"4dd0233715164898c2755653545b23422f02ff3fdc2610f410c5f0603b8ec5f8"} Mar 16 16:33:04 crc kubenswrapper[5120]: I0316 16:33:04.138752 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"63d9a98c-175f-4caa-bd33-41eb82d6e06b","Type":"ContainerStarted","Data":"3251b55607768a1c1602f007772fd47d988206a579b6573f7b1196b6855a2d19"} Mar 16 16:33:05 crc kubenswrapper[5120]: I0316 16:33:05.149409 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"63d9a98c-175f-4caa-bd33-41eb82d6e06b","Type":"ContainerStarted","Data":"597efc0dd871c2e1f82f46bb284d3a25d9d02fb8817ac7c029ec870416fbaef4"} Mar 16 16:33:05 crc kubenswrapper[5120]: I0316 16:33:05.170260 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-scheduler-0" podStartSLOduration=3.170240851 podStartE2EDuration="3.170240851s" podCreationTimestamp="2026-03-16 16:33:02 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:33:05.165661171 +0000 UTC m=+3687.319592828" watchObservedRunningTime="2026-03-16 16:33:05.170240851 +0000 UTC m=+3687.324172508" Mar 16 16:33:05 crc kubenswrapper[5120]: I0316 16:33:05.249704 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:33:06 crc kubenswrapper[5120]: I0316 16:33:06.935919 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-5975dccf9f-xrcl8" podUID="2613977e-8fa5-4c77-85b3-d9ee626e58bc" containerName="barbican-api" probeResult="failure" output="Get \"http://10.217.0.152:9311/healthcheck\": read tcp 10.217.0.2:52914->10.217.0.152:9311: read: connection reset by peer" Mar 16 16:33:07 crc kubenswrapper[5120]: I0316 16:33:07.174226 5120 generic.go:358] "Generic (PLEG): container finished" podID="2613977e-8fa5-4c77-85b3-d9ee626e58bc" containerID="ea7a1e07ead684d8ab119f44156093afc27c47f0e08e921bc2307c0294baf9eb" exitCode=0 Mar 16 16:33:07 crc kubenswrapper[5120]: I0316 16:33:07.174301 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-5975dccf9f-xrcl8" event={"ID":"2613977e-8fa5-4c77-85b3-d9ee626e58bc","Type":"ContainerDied","Data":"ea7a1e07ead684d8ab119f44156093afc27c47f0e08e921bc2307c0294baf9eb"} Mar 16 16:33:07 crc kubenswrapper[5120]: I0316 16:33:07.393882 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-5975dccf9f-xrcl8" Mar 16 16:33:08 crc kubenswrapper[5120]: I0316 16:33:08.045918 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:33:08 crc kubenswrapper[5120]: I0316 16:33:08.056723 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-756r9\" (UniqueName: \"kubernetes.io/projected/2613977e-8fa5-4c77-85b3-d9ee626e58bc-kube-api-access-756r9\") pod \"2613977e-8fa5-4c77-85b3-d9ee626e58bc\" (UID: \"2613977e-8fa5-4c77-85b3-d9ee626e58bc\") " Mar 16 16:33:08 crc kubenswrapper[5120]: I0316 16:33:08.056821 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2613977e-8fa5-4c77-85b3-d9ee626e58bc-config-data\") pod \"2613977e-8fa5-4c77-85b3-d9ee626e58bc\" (UID: \"2613977e-8fa5-4c77-85b3-d9ee626e58bc\") " Mar 16 16:33:08 crc kubenswrapper[5120]: I0316 16:33:08.056849 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2613977e-8fa5-4c77-85b3-d9ee626e58bc-combined-ca-bundle\") pod \"2613977e-8fa5-4c77-85b3-d9ee626e58bc\" (UID: \"2613977e-8fa5-4c77-85b3-d9ee626e58bc\") " Mar 16 16:33:08 crc kubenswrapper[5120]: I0316 16:33:08.056916 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2613977e-8fa5-4c77-85b3-d9ee626e58bc-logs\") pod \"2613977e-8fa5-4c77-85b3-d9ee626e58bc\" (UID: \"2613977e-8fa5-4c77-85b3-d9ee626e58bc\") " Mar 16 16:33:08 crc kubenswrapper[5120]: I0316 16:33:08.057402 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/2613977e-8fa5-4c77-85b3-d9ee626e58bc-config-data-custom\") pod \"2613977e-8fa5-4c77-85b3-d9ee626e58bc\" (UID: \"2613977e-8fa5-4c77-85b3-d9ee626e58bc\") " Mar 16 16:33:08 crc kubenswrapper[5120]: I0316 16:33:08.062549 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2613977e-8fa5-4c77-85b3-d9ee626e58bc-logs" (OuterVolumeSpecName: "logs") pod "2613977e-8fa5-4c77-85b3-d9ee626e58bc" (UID: "2613977e-8fa5-4c77-85b3-d9ee626e58bc"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:33:08 crc kubenswrapper[5120]: I0316 16:33:08.067664 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2613977e-8fa5-4c77-85b3-d9ee626e58bc-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "2613977e-8fa5-4c77-85b3-d9ee626e58bc" (UID: "2613977e-8fa5-4c77-85b3-d9ee626e58bc"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:33:08 crc kubenswrapper[5120]: I0316 16:33:08.071029 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2613977e-8fa5-4c77-85b3-d9ee626e58bc-kube-api-access-756r9" (OuterVolumeSpecName: "kube-api-access-756r9") pod "2613977e-8fa5-4c77-85b3-d9ee626e58bc" (UID: "2613977e-8fa5-4c77-85b3-d9ee626e58bc"). InnerVolumeSpecName "kube-api-access-756r9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:33:08 crc kubenswrapper[5120]: I0316 16:33:08.109874 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2613977e-8fa5-4c77-85b3-d9ee626e58bc-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "2613977e-8fa5-4c77-85b3-d9ee626e58bc" (UID: "2613977e-8fa5-4c77-85b3-d9ee626e58bc"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:33:08 crc kubenswrapper[5120]: I0316 16:33:08.136463 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2613977e-8fa5-4c77-85b3-d9ee626e58bc-config-data" (OuterVolumeSpecName: "config-data") pod "2613977e-8fa5-4c77-85b3-d9ee626e58bc" (UID: "2613977e-8fa5-4c77-85b3-d9ee626e58bc"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:33:08 crc kubenswrapper[5120]: I0316 16:33:08.159692 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/2613977e-8fa5-4c77-85b3-d9ee626e58bc-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:33:08 crc kubenswrapper[5120]: I0316 16:33:08.159728 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-756r9\" (UniqueName: \"kubernetes.io/projected/2613977e-8fa5-4c77-85b3-d9ee626e58bc-kube-api-access-756r9\") on node \"crc\" DevicePath \"\"" Mar 16 16:33:08 crc kubenswrapper[5120]: I0316 16:33:08.159738 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2613977e-8fa5-4c77-85b3-d9ee626e58bc-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:33:08 crc kubenswrapper[5120]: I0316 16:33:08.159748 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2613977e-8fa5-4c77-85b3-d9ee626e58bc-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:33:08 crc kubenswrapper[5120]: I0316 16:33:08.159793 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2613977e-8fa5-4c77-85b3-d9ee626e58bc-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:33:08 crc kubenswrapper[5120]: I0316 16:33:08.190090 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-5975dccf9f-xrcl8" event={"ID":"2613977e-8fa5-4c77-85b3-d9ee626e58bc","Type":"ContainerDied","Data":"e1f5bc2140c624160eb033aa42303f1f31513b1f04b4adbd8f74b99c72e1649e"} Mar 16 16:33:08 crc kubenswrapper[5120]: I0316 16:33:08.190268 5120 scope.go:117] "RemoveContainer" containerID="ea7a1e07ead684d8ab119f44156093afc27c47f0e08e921bc2307c0294baf9eb" Mar 16 16:33:08 crc kubenswrapper[5120]: I0316 16:33:08.190129 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-5975dccf9f-xrcl8" Mar 16 16:33:08 crc kubenswrapper[5120]: I0316 16:33:08.231731 5120 scope.go:117] "RemoveContainer" containerID="4dd0233715164898c2755653545b23422f02ff3fdc2610f410c5f0603b8ec5f8" Mar 16 16:33:08 crc kubenswrapper[5120]: I0316 16:33:08.241578 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-5975dccf9f-xrcl8"] Mar 16 16:33:08 crc kubenswrapper[5120]: I0316 16:33:08.251837 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-api-5975dccf9f-xrcl8"] Mar 16 16:33:08 crc kubenswrapper[5120]: I0316 16:33:08.279571 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:33:08 crc kubenswrapper[5120]: I0316 16:33:08.676979 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2613977e-8fa5-4c77-85b3-d9ee626e58bc" path="/var/lib/kubelet/pods/2613977e-8fa5-4c77-85b3-d9ee626e58bc/volumes" Mar 16 16:33:08 crc kubenswrapper[5120]: E0316 16:33:08.803624 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1756140 actualBytes=10240 Mar 16 16:33:13 crc kubenswrapper[5120]: I0316 16:33:13.255902 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/placement-d47d8c655-p8r55" Mar 16 16:33:13 crc kubenswrapper[5120]: I0316 16:33:13.664365 5120 scope.go:117] "RemoveContainer" containerID="0a15d5caff30dc8885f782e59962af7d98d58b39ab76059e56e5827e10e7ab8b" Mar 16 16:33:13 crc kubenswrapper[5120]: E0316 16:33:13.665012 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:33:14 crc kubenswrapper[5120]: I0316 16:33:14.165860 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/placement-d47d8c655-p8r55" Mar 16 16:33:14 crc kubenswrapper[5120]: I0316 16:33:14.414097 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-6bc576559-vg8zd"] Mar 16 16:33:14 crc kubenswrapper[5120]: I0316 16:33:14.415429 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2613977e-8fa5-4c77-85b3-d9ee626e58bc" containerName="barbican-api" Mar 16 16:33:14 crc kubenswrapper[5120]: I0316 16:33:14.415449 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="2613977e-8fa5-4c77-85b3-d9ee626e58bc" containerName="barbican-api" Mar 16 16:33:14 crc kubenswrapper[5120]: I0316 16:33:14.415469 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2613977e-8fa5-4c77-85b3-d9ee626e58bc" containerName="barbican-api-log" Mar 16 16:33:14 crc kubenswrapper[5120]: I0316 16:33:14.415479 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="2613977e-8fa5-4c77-85b3-d9ee626e58bc" containerName="barbican-api-log" Mar 16 16:33:14 crc kubenswrapper[5120]: I0316 16:33:14.415725 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="2613977e-8fa5-4c77-85b3-d9ee626e58bc" containerName="barbican-api" Mar 16 16:33:14 crc kubenswrapper[5120]: I0316 16:33:14.415746 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="2613977e-8fa5-4c77-85b3-d9ee626e58bc" containerName="barbican-api-log" Mar 16 16:33:14 crc kubenswrapper[5120]: I0316 16:33:14.424660 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-6bc576559-vg8zd" Mar 16 16:33:14 crc kubenswrapper[5120]: I0316 16:33:14.434670 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-6bc576559-vg8zd"] Mar 16 16:33:14 crc kubenswrapper[5120]: I0316 16:33:14.503456 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/62429cf4-f6d6-4708-91b3-c81a2b9cb1b6-scripts\") pod \"placement-6bc576559-vg8zd\" (UID: \"62429cf4-f6d6-4708-91b3-c81a2b9cb1b6\") " pod="openstack-kuttl-tests/placement-6bc576559-vg8zd" Mar 16 16:33:14 crc kubenswrapper[5120]: I0316 16:33:14.503913 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/62429cf4-f6d6-4708-91b3-c81a2b9cb1b6-combined-ca-bundle\") pod \"placement-6bc576559-vg8zd\" (UID: \"62429cf4-f6d6-4708-91b3-c81a2b9cb1b6\") " pod="openstack-kuttl-tests/placement-6bc576559-vg8zd" Mar 16 16:33:14 crc kubenswrapper[5120]: I0316 16:33:14.504074 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/62429cf4-f6d6-4708-91b3-c81a2b9cb1b6-public-tls-certs\") pod \"placement-6bc576559-vg8zd\" (UID: \"62429cf4-f6d6-4708-91b3-c81a2b9cb1b6\") " pod="openstack-kuttl-tests/placement-6bc576559-vg8zd" Mar 16 16:33:14 crc kubenswrapper[5120]: I0316 16:33:14.504228 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7fgfq\" (UniqueName: \"kubernetes.io/projected/62429cf4-f6d6-4708-91b3-c81a2b9cb1b6-kube-api-access-7fgfq\") pod \"placement-6bc576559-vg8zd\" (UID: \"62429cf4-f6d6-4708-91b3-c81a2b9cb1b6\") " pod="openstack-kuttl-tests/placement-6bc576559-vg8zd" Mar 16 16:33:14 crc kubenswrapper[5120]: I0316 16:33:14.504433 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/62429cf4-f6d6-4708-91b3-c81a2b9cb1b6-internal-tls-certs\") pod \"placement-6bc576559-vg8zd\" (UID: \"62429cf4-f6d6-4708-91b3-c81a2b9cb1b6\") " pod="openstack-kuttl-tests/placement-6bc576559-vg8zd" Mar 16 16:33:14 crc kubenswrapper[5120]: I0316 16:33:14.504712 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/62429cf4-f6d6-4708-91b3-c81a2b9cb1b6-logs\") pod \"placement-6bc576559-vg8zd\" (UID: \"62429cf4-f6d6-4708-91b3-c81a2b9cb1b6\") " pod="openstack-kuttl-tests/placement-6bc576559-vg8zd" Mar 16 16:33:14 crc kubenswrapper[5120]: I0316 16:33:14.504969 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/62429cf4-f6d6-4708-91b3-c81a2b9cb1b6-config-data\") pod \"placement-6bc576559-vg8zd\" (UID: \"62429cf4-f6d6-4708-91b3-c81a2b9cb1b6\") " pod="openstack-kuttl-tests/placement-6bc576559-vg8zd" Mar 16 16:33:14 crc kubenswrapper[5120]: I0316 16:33:14.606577 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/62429cf4-f6d6-4708-91b3-c81a2b9cb1b6-scripts\") pod \"placement-6bc576559-vg8zd\" (UID: \"62429cf4-f6d6-4708-91b3-c81a2b9cb1b6\") " pod="openstack-kuttl-tests/placement-6bc576559-vg8zd" Mar 16 16:33:14 crc kubenswrapper[5120]: I0316 16:33:14.606945 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/62429cf4-f6d6-4708-91b3-c81a2b9cb1b6-combined-ca-bundle\") pod \"placement-6bc576559-vg8zd\" (UID: \"62429cf4-f6d6-4708-91b3-c81a2b9cb1b6\") " pod="openstack-kuttl-tests/placement-6bc576559-vg8zd" Mar 16 16:33:14 crc kubenswrapper[5120]: I0316 16:33:14.607047 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/62429cf4-f6d6-4708-91b3-c81a2b9cb1b6-public-tls-certs\") pod \"placement-6bc576559-vg8zd\" (UID: \"62429cf4-f6d6-4708-91b3-c81a2b9cb1b6\") " pod="openstack-kuttl-tests/placement-6bc576559-vg8zd" Mar 16 16:33:14 crc kubenswrapper[5120]: I0316 16:33:14.607138 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7fgfq\" (UniqueName: \"kubernetes.io/projected/62429cf4-f6d6-4708-91b3-c81a2b9cb1b6-kube-api-access-7fgfq\") pod \"placement-6bc576559-vg8zd\" (UID: \"62429cf4-f6d6-4708-91b3-c81a2b9cb1b6\") " pod="openstack-kuttl-tests/placement-6bc576559-vg8zd" Mar 16 16:33:14 crc kubenswrapper[5120]: I0316 16:33:14.607254 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/62429cf4-f6d6-4708-91b3-c81a2b9cb1b6-internal-tls-certs\") pod \"placement-6bc576559-vg8zd\" (UID: \"62429cf4-f6d6-4708-91b3-c81a2b9cb1b6\") " pod="openstack-kuttl-tests/placement-6bc576559-vg8zd" Mar 16 16:33:14 crc kubenswrapper[5120]: I0316 16:33:14.607457 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/62429cf4-f6d6-4708-91b3-c81a2b9cb1b6-logs\") pod \"placement-6bc576559-vg8zd\" (UID: \"62429cf4-f6d6-4708-91b3-c81a2b9cb1b6\") " pod="openstack-kuttl-tests/placement-6bc576559-vg8zd" Mar 16 16:33:14 crc kubenswrapper[5120]: I0316 16:33:14.607578 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/62429cf4-f6d6-4708-91b3-c81a2b9cb1b6-config-data\") pod \"placement-6bc576559-vg8zd\" (UID: \"62429cf4-f6d6-4708-91b3-c81a2b9cb1b6\") " pod="openstack-kuttl-tests/placement-6bc576559-vg8zd" Mar 16 16:33:14 crc kubenswrapper[5120]: I0316 16:33:14.608074 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/62429cf4-f6d6-4708-91b3-c81a2b9cb1b6-logs\") pod \"placement-6bc576559-vg8zd\" (UID: \"62429cf4-f6d6-4708-91b3-c81a2b9cb1b6\") " pod="openstack-kuttl-tests/placement-6bc576559-vg8zd" Mar 16 16:33:14 crc kubenswrapper[5120]: I0316 16:33:14.613801 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/62429cf4-f6d6-4708-91b3-c81a2b9cb1b6-internal-tls-certs\") pod \"placement-6bc576559-vg8zd\" (UID: \"62429cf4-f6d6-4708-91b3-c81a2b9cb1b6\") " pod="openstack-kuttl-tests/placement-6bc576559-vg8zd" Mar 16 16:33:14 crc kubenswrapper[5120]: I0316 16:33:14.614719 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/62429cf4-f6d6-4708-91b3-c81a2b9cb1b6-public-tls-certs\") pod \"placement-6bc576559-vg8zd\" (UID: \"62429cf4-f6d6-4708-91b3-c81a2b9cb1b6\") " pod="openstack-kuttl-tests/placement-6bc576559-vg8zd" Mar 16 16:33:14 crc kubenswrapper[5120]: I0316 16:33:14.615129 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/62429cf4-f6d6-4708-91b3-c81a2b9cb1b6-config-data\") pod \"placement-6bc576559-vg8zd\" (UID: \"62429cf4-f6d6-4708-91b3-c81a2b9cb1b6\") " pod="openstack-kuttl-tests/placement-6bc576559-vg8zd" Mar 16 16:33:14 crc kubenswrapper[5120]: I0316 16:33:14.615424 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/62429cf4-f6d6-4708-91b3-c81a2b9cb1b6-scripts\") pod \"placement-6bc576559-vg8zd\" (UID: \"62429cf4-f6d6-4708-91b3-c81a2b9cb1b6\") " pod="openstack-kuttl-tests/placement-6bc576559-vg8zd" Mar 16 16:33:14 crc kubenswrapper[5120]: I0316 16:33:14.616037 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/62429cf4-f6d6-4708-91b3-c81a2b9cb1b6-combined-ca-bundle\") pod \"placement-6bc576559-vg8zd\" (UID: \"62429cf4-f6d6-4708-91b3-c81a2b9cb1b6\") " pod="openstack-kuttl-tests/placement-6bc576559-vg8zd" Mar 16 16:33:14 crc kubenswrapper[5120]: I0316 16:33:14.627647 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7fgfq\" (UniqueName: \"kubernetes.io/projected/62429cf4-f6d6-4708-91b3-c81a2b9cb1b6-kube-api-access-7fgfq\") pod \"placement-6bc576559-vg8zd\" (UID: \"62429cf4-f6d6-4708-91b3-c81a2b9cb1b6\") " pod="openstack-kuttl-tests/placement-6bc576559-vg8zd" Mar 16 16:33:14 crc kubenswrapper[5120]: I0316 16:33:14.746878 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-6bc576559-vg8zd" Mar 16 16:33:15 crc kubenswrapper[5120]: I0316 16:33:15.202726 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-6bc576559-vg8zd"] Mar 16 16:33:15 crc kubenswrapper[5120]: W0316 16:33:15.206094 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod62429cf4_f6d6_4708_91b3_c81a2b9cb1b6.slice/crio-57da3037a658c494e50db04497610a578d09c96d960a3d33a1fda8e8e167de9f WatchSource:0}: Error finding container 57da3037a658c494e50db04497610a578d09c96d960a3d33a1fda8e8e167de9f: Status 404 returned error can't find the container with id 57da3037a658c494e50db04497610a578d09c96d960a3d33a1fda8e8e167de9f Mar 16 16:33:15 crc kubenswrapper[5120]: I0316 16:33:15.208607 5120 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Mar 16 16:33:15 crc kubenswrapper[5120]: I0316 16:33:15.265776 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-6bc576559-vg8zd" event={"ID":"62429cf4-f6d6-4708-91b3-c81a2b9cb1b6","Type":"ContainerStarted","Data":"57da3037a658c494e50db04497610a578d09c96d960a3d33a1fda8e8e167de9f"} Mar 16 16:33:16 crc kubenswrapper[5120]: I0316 16:33:16.280972 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-6bc576559-vg8zd" event={"ID":"62429cf4-f6d6-4708-91b3-c81a2b9cb1b6","Type":"ContainerStarted","Data":"6ded548d5be3fad9d15cf337acf6ace6ec026ccee3c3ad8e74f84c40ec38788c"} Mar 16 16:33:16 crc kubenswrapper[5120]: I0316 16:33:16.281387 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-6bc576559-vg8zd" Mar 16 16:33:16 crc kubenswrapper[5120]: I0316 16:33:16.281405 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-6bc576559-vg8zd" event={"ID":"62429cf4-f6d6-4708-91b3-c81a2b9cb1b6","Type":"ContainerStarted","Data":"d4ad382e7c7b2ae921dda545fc65a411c0a7a592e6f1c788317a46bc2af5d081"} Mar 16 16:33:16 crc kubenswrapper[5120]: I0316 16:33:16.281425 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-6bc576559-vg8zd" Mar 16 16:33:16 crc kubenswrapper[5120]: I0316 16:33:16.302924 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-6bc576559-vg8zd" podStartSLOduration=2.3029037199999998 podStartE2EDuration="2.30290372s" podCreationTimestamp="2026-03-16 16:33:14 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:33:16.300793494 +0000 UTC m=+3698.454725161" watchObservedRunningTime="2026-03-16 16:33:16.30290372 +0000 UTC m=+3698.456835377" Mar 16 16:33:22 crc kubenswrapper[5120]: I0316 16:33:22.143356 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/keystone-768f4979c4-gbb88" Mar 16 16:33:23 crc kubenswrapper[5120]: I0316 16:33:23.015134 5120 scope.go:117] "RemoveContainer" containerID="3e2afe1f4371dfcd77b599c3d9748a2be63417d454174497ac2aea38e32f6306" Mar 16 16:33:23 crc kubenswrapper[5120]: I0316 16:33:23.045836 5120 scope.go:117] "RemoveContainer" containerID="af40068e887848d3652ff4ac2bdf2aa3e37334b0db3ca57dd999b21f07bb65f4" Mar 16 16:33:23 crc kubenswrapper[5120]: I0316 16:33:23.106513 5120 scope.go:117] "RemoveContainer" containerID="b75fe15401188ed9e0598b0eeddcd336e8cfd0860ec0b181307c8ac94081f7f0" Mar 16 16:33:23 crc kubenswrapper[5120]: I0316 16:33:23.130449 5120 scope.go:117] "RemoveContainer" containerID="883e8f50194c97c3619c7e4bb95dcc03b0cb179d3cfafbc9ce23a669e05f29ad" Mar 16 16:33:23 crc kubenswrapper[5120]: I0316 16:33:23.175344 5120 scope.go:117] "RemoveContainer" containerID="cd4da9b81130ea8434610952955f3044602ea9c053ca2a5cd8e3e60eb55ed58e" Mar 16 16:33:23 crc kubenswrapper[5120]: I0316 16:33:23.218294 5120 scope.go:117] "RemoveContainer" containerID="3ea3b93a53d44177134dfe19885a2195f929d6eb949caecb62bf340e324066e7" Mar 16 16:33:23 crc kubenswrapper[5120]: I0316 16:33:23.302897 5120 scope.go:117] "RemoveContainer" containerID="a2ece81b54f2de5b4c412803551a83f25e05e0afbefa7e776295bc3ebf15dd5d" Mar 16 16:33:23 crc kubenswrapper[5120]: I0316 16:33:23.333175 5120 scope.go:117] "RemoveContainer" containerID="b4c6fc265a60fa84278a8d1b2948bc5d22f504d8dffaa7a10b8773c37fe8f551" Mar 16 16:33:23 crc kubenswrapper[5120]: I0316 16:33:23.369088 5120 scope.go:117] "RemoveContainer" containerID="f51f8fa918e46f66dcfe0379ccbb4cef96ae9898149769bf5afa18f743414fdd" Mar 16 16:33:23 crc kubenswrapper[5120]: I0316 16:33:23.396634 5120 scope.go:117] "RemoveContainer" containerID="0231acb944f49e21e9ebc6ad7724f5c2377405b925dc980593b0e6fb0c965404" Mar 16 16:33:23 crc kubenswrapper[5120]: I0316 16:33:23.446566 5120 scope.go:117] "RemoveContainer" containerID="2b8ab4e2dd67fbc0e778483ef937aa22d0d08b9056d7b9c5d93309604fe560da" Mar 16 16:33:23 crc kubenswrapper[5120]: I0316 16:33:23.475637 5120 scope.go:117] "RemoveContainer" containerID="174e037af928ab5ddd9ae9c76c17745733eaec6219830d0d7c53066a87259986" Mar 16 16:33:23 crc kubenswrapper[5120]: I0316 16:33:23.521992 5120 scope.go:117] "RemoveContainer" containerID="1bc47707d28ca9503b3c2eede13693ef7b45d3db1c731917ab18cbe63e9ea80e" Mar 16 16:33:24 crc kubenswrapper[5120]: I0316 16:33:24.664328 5120 scope.go:117] "RemoveContainer" containerID="0a15d5caff30dc8885f782e59962af7d98d58b39ab76059e56e5827e10e7ab8b" Mar 16 16:33:24 crc kubenswrapper[5120]: E0316 16:33:24.664690 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:33:26 crc kubenswrapper[5120]: I0316 16:33:26.466217 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 16:33:26 crc kubenswrapper[5120]: I0316 16:33:26.473799 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Mar 16 16:33:26 crc kubenswrapper[5120]: I0316 16:33:26.477275 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 16:33:26 crc kubenswrapper[5120]: I0316 16:33:26.477522 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"openstackclient-openstackclient-dockercfg-gr594\"" Mar 16 16:33:26 crc kubenswrapper[5120]: I0316 16:33:26.477642 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"openstack-config-secret\"" Mar 16 16:33:26 crc kubenswrapper[5120]: I0316 16:33:26.477687 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-config\"" Mar 16 16:33:26 crc kubenswrapper[5120]: I0316 16:33:26.589839 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqs48\" (UniqueName: \"kubernetes.io/projected/a3c1d88e-f441-4b4d-97c8-111682a67174-kube-api-access-jqs48\") pod \"openstackclient\" (UID: \"a3c1d88e-f441-4b4d-97c8-111682a67174\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:33:26 crc kubenswrapper[5120]: I0316 16:33:26.589920 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/a3c1d88e-f441-4b4d-97c8-111682a67174-openstack-config\") pod \"openstackclient\" (UID: \"a3c1d88e-f441-4b4d-97c8-111682a67174\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:33:26 crc kubenswrapper[5120]: I0316 16:33:26.590058 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a3c1d88e-f441-4b4d-97c8-111682a67174-combined-ca-bundle\") pod \"openstackclient\" (UID: \"a3c1d88e-f441-4b4d-97c8-111682a67174\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:33:26 crc kubenswrapper[5120]: I0316 16:33:26.590155 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/a3c1d88e-f441-4b4d-97c8-111682a67174-openstack-config-secret\") pod \"openstackclient\" (UID: \"a3c1d88e-f441-4b4d-97c8-111682a67174\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:33:26 crc kubenswrapper[5120]: I0316 16:33:26.692077 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jqs48\" (UniqueName: \"kubernetes.io/projected/a3c1d88e-f441-4b4d-97c8-111682a67174-kube-api-access-jqs48\") pod \"openstackclient\" (UID: \"a3c1d88e-f441-4b4d-97c8-111682a67174\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:33:26 crc kubenswrapper[5120]: I0316 16:33:26.692153 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/a3c1d88e-f441-4b4d-97c8-111682a67174-openstack-config\") pod \"openstackclient\" (UID: \"a3c1d88e-f441-4b4d-97c8-111682a67174\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:33:26 crc kubenswrapper[5120]: I0316 16:33:26.692266 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a3c1d88e-f441-4b4d-97c8-111682a67174-combined-ca-bundle\") pod \"openstackclient\" (UID: \"a3c1d88e-f441-4b4d-97c8-111682a67174\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:33:26 crc kubenswrapper[5120]: I0316 16:33:26.694960 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/a3c1d88e-f441-4b4d-97c8-111682a67174-openstack-config-secret\") pod \"openstackclient\" (UID: \"a3c1d88e-f441-4b4d-97c8-111682a67174\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:33:26 crc kubenswrapper[5120]: I0316 16:33:26.746518 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/a3c1d88e-f441-4b4d-97c8-111682a67174-openstack-config\") pod \"openstackclient\" (UID: \"a3c1d88e-f441-4b4d-97c8-111682a67174\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:33:26 crc kubenswrapper[5120]: I0316 16:33:26.746561 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/a3c1d88e-f441-4b4d-97c8-111682a67174-openstack-config-secret\") pod \"openstackclient\" (UID: \"a3c1d88e-f441-4b4d-97c8-111682a67174\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:33:26 crc kubenswrapper[5120]: I0316 16:33:26.746630 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a3c1d88e-f441-4b4d-97c8-111682a67174-combined-ca-bundle\") pod \"openstackclient\" (UID: \"a3c1d88e-f441-4b4d-97c8-111682a67174\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:33:26 crc kubenswrapper[5120]: I0316 16:33:26.750273 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqs48\" (UniqueName: \"kubernetes.io/projected/a3c1d88e-f441-4b4d-97c8-111682a67174-kube-api-access-jqs48\") pod \"openstackclient\" (UID: \"a3c1d88e-f441-4b4d-97c8-111682a67174\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:33:26 crc kubenswrapper[5120]: I0316 16:33:26.800956 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Mar 16 16:33:27 crc kubenswrapper[5120]: W0316 16:33:27.290149 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda3c1d88e_f441_4b4d_97c8_111682a67174.slice/crio-312eaaae7eca7321b9703d03aa9dec350fe29d094afc4b9cb57acb6addf7cb61 WatchSource:0}: Error finding container 312eaaae7eca7321b9703d03aa9dec350fe29d094afc4b9cb57acb6addf7cb61: Status 404 returned error can't find the container with id 312eaaae7eca7321b9703d03aa9dec350fe29d094afc4b9cb57acb6addf7cb61 Mar 16 16:33:27 crc kubenswrapper[5120]: I0316 16:33:27.290635 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 16:33:27 crc kubenswrapper[5120]: I0316 16:33:27.429964 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstackclient" event={"ID":"a3c1d88e-f441-4b4d-97c8-111682a67174","Type":"ContainerStarted","Data":"312eaaae7eca7321b9703d03aa9dec350fe29d094afc4b9cb57acb6addf7cb61"} Mar 16 16:33:28 crc kubenswrapper[5120]: I0316 16:33:28.446436 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstackclient" event={"ID":"a3c1d88e-f441-4b4d-97c8-111682a67174","Type":"ContainerStarted","Data":"62cc59bc413d7a87f2df901178e58ae330c336829d397ee0126fb83e5086ce15"} Mar 16 16:33:28 crc kubenswrapper[5120]: I0316 16:33:28.474119 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstackclient" podStartSLOduration=2.474094091 podStartE2EDuration="2.474094091s" podCreationTimestamp="2026-03-16 16:33:26 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:33:28.464358066 +0000 UTC m=+3710.618289723" watchObservedRunningTime="2026-03-16 16:33:28.474094091 +0000 UTC m=+3710.628025738" Mar 16 16:33:30 crc kubenswrapper[5120]: I0316 16:33:30.070982 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/neutron-587c77d488-zm2nq" Mar 16 16:33:30 crc kubenswrapper[5120]: I0316 16:33:30.405724 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/swift-proxy-598db64bc5-jp86s"] Mar 16 16:33:30 crc kubenswrapper[5120]: I0316 16:33:30.416846 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-598db64bc5-jp86s" Mar 16 16:33:30 crc kubenswrapper[5120]: I0316 16:33:30.419693 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-swift-internal-svc\"" Mar 16 16:33:30 crc kubenswrapper[5120]: I0316 16:33:30.419817 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"swift-proxy-config-data\"" Mar 16 16:33:30 crc kubenswrapper[5120]: I0316 16:33:30.420248 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-swift-public-svc\"" Mar 16 16:33:30 crc kubenswrapper[5120]: I0316 16:33:30.424956 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-proxy-598db64bc5-jp86s"] Mar 16 16:33:30 crc kubenswrapper[5120]: I0316 16:33:30.525893 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/46b6f5ef-ac2f-4add-8c6b-1157abccfbfe-run-httpd\") pod \"swift-proxy-598db64bc5-jp86s\" (UID: \"46b6f5ef-ac2f-4add-8c6b-1157abccfbfe\") " pod="openstack-kuttl-tests/swift-proxy-598db64bc5-jp86s" Mar 16 16:33:30 crc kubenswrapper[5120]: I0316 16:33:30.526208 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/46b6f5ef-ac2f-4add-8c6b-1157abccfbfe-config-data\") pod \"swift-proxy-598db64bc5-jp86s\" (UID: \"46b6f5ef-ac2f-4add-8c6b-1157abccfbfe\") " pod="openstack-kuttl-tests/swift-proxy-598db64bc5-jp86s" Mar 16 16:33:30 crc kubenswrapper[5120]: I0316 16:33:30.526254 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/46b6f5ef-ac2f-4add-8c6b-1157abccfbfe-combined-ca-bundle\") pod \"swift-proxy-598db64bc5-jp86s\" (UID: \"46b6f5ef-ac2f-4add-8c6b-1157abccfbfe\") " pod="openstack-kuttl-tests/swift-proxy-598db64bc5-jp86s" Mar 16 16:33:30 crc kubenswrapper[5120]: I0316 16:33:30.526458 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/46b6f5ef-ac2f-4add-8c6b-1157abccfbfe-public-tls-certs\") pod \"swift-proxy-598db64bc5-jp86s\" (UID: \"46b6f5ef-ac2f-4add-8c6b-1157abccfbfe\") " pod="openstack-kuttl-tests/swift-proxy-598db64bc5-jp86s" Mar 16 16:33:30 crc kubenswrapper[5120]: I0316 16:33:30.526524 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/46b6f5ef-ac2f-4add-8c6b-1157abccfbfe-log-httpd\") pod \"swift-proxy-598db64bc5-jp86s\" (UID: \"46b6f5ef-ac2f-4add-8c6b-1157abccfbfe\") " pod="openstack-kuttl-tests/swift-proxy-598db64bc5-jp86s" Mar 16 16:33:30 crc kubenswrapper[5120]: I0316 16:33:30.526575 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/46b6f5ef-ac2f-4add-8c6b-1157abccfbfe-etc-swift\") pod \"swift-proxy-598db64bc5-jp86s\" (UID: \"46b6f5ef-ac2f-4add-8c6b-1157abccfbfe\") " pod="openstack-kuttl-tests/swift-proxy-598db64bc5-jp86s" Mar 16 16:33:30 crc kubenswrapper[5120]: I0316 16:33:30.526601 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/46b6f5ef-ac2f-4add-8c6b-1157abccfbfe-internal-tls-certs\") pod \"swift-proxy-598db64bc5-jp86s\" (UID: \"46b6f5ef-ac2f-4add-8c6b-1157abccfbfe\") " pod="openstack-kuttl-tests/swift-proxy-598db64bc5-jp86s" Mar 16 16:33:30 crc kubenswrapper[5120]: I0316 16:33:30.526854 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fb2gk\" (UniqueName: \"kubernetes.io/projected/46b6f5ef-ac2f-4add-8c6b-1157abccfbfe-kube-api-access-fb2gk\") pod \"swift-proxy-598db64bc5-jp86s\" (UID: \"46b6f5ef-ac2f-4add-8c6b-1157abccfbfe\") " pod="openstack-kuttl-tests/swift-proxy-598db64bc5-jp86s" Mar 16 16:33:30 crc kubenswrapper[5120]: I0316 16:33:30.629199 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/46b6f5ef-ac2f-4add-8c6b-1157abccfbfe-public-tls-certs\") pod \"swift-proxy-598db64bc5-jp86s\" (UID: \"46b6f5ef-ac2f-4add-8c6b-1157abccfbfe\") " pod="openstack-kuttl-tests/swift-proxy-598db64bc5-jp86s" Mar 16 16:33:30 crc kubenswrapper[5120]: I0316 16:33:30.629271 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/46b6f5ef-ac2f-4add-8c6b-1157abccfbfe-log-httpd\") pod \"swift-proxy-598db64bc5-jp86s\" (UID: \"46b6f5ef-ac2f-4add-8c6b-1157abccfbfe\") " pod="openstack-kuttl-tests/swift-proxy-598db64bc5-jp86s" Mar 16 16:33:30 crc kubenswrapper[5120]: I0316 16:33:30.629306 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/46b6f5ef-ac2f-4add-8c6b-1157abccfbfe-etc-swift\") pod \"swift-proxy-598db64bc5-jp86s\" (UID: \"46b6f5ef-ac2f-4add-8c6b-1157abccfbfe\") " pod="openstack-kuttl-tests/swift-proxy-598db64bc5-jp86s" Mar 16 16:33:30 crc kubenswrapper[5120]: I0316 16:33:30.629329 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/46b6f5ef-ac2f-4add-8c6b-1157abccfbfe-internal-tls-certs\") pod \"swift-proxy-598db64bc5-jp86s\" (UID: \"46b6f5ef-ac2f-4add-8c6b-1157abccfbfe\") " pod="openstack-kuttl-tests/swift-proxy-598db64bc5-jp86s" Mar 16 16:33:30 crc kubenswrapper[5120]: I0316 16:33:30.629411 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fb2gk\" (UniqueName: \"kubernetes.io/projected/46b6f5ef-ac2f-4add-8c6b-1157abccfbfe-kube-api-access-fb2gk\") pod \"swift-proxy-598db64bc5-jp86s\" (UID: \"46b6f5ef-ac2f-4add-8c6b-1157abccfbfe\") " pod="openstack-kuttl-tests/swift-proxy-598db64bc5-jp86s" Mar 16 16:33:30 crc kubenswrapper[5120]: I0316 16:33:30.629523 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/46b6f5ef-ac2f-4add-8c6b-1157abccfbfe-run-httpd\") pod \"swift-proxy-598db64bc5-jp86s\" (UID: \"46b6f5ef-ac2f-4add-8c6b-1157abccfbfe\") " pod="openstack-kuttl-tests/swift-proxy-598db64bc5-jp86s" Mar 16 16:33:30 crc kubenswrapper[5120]: I0316 16:33:30.629570 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/46b6f5ef-ac2f-4add-8c6b-1157abccfbfe-config-data\") pod \"swift-proxy-598db64bc5-jp86s\" (UID: \"46b6f5ef-ac2f-4add-8c6b-1157abccfbfe\") " pod="openstack-kuttl-tests/swift-proxy-598db64bc5-jp86s" Mar 16 16:33:30 crc kubenswrapper[5120]: I0316 16:33:30.629610 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/46b6f5ef-ac2f-4add-8c6b-1157abccfbfe-combined-ca-bundle\") pod \"swift-proxy-598db64bc5-jp86s\" (UID: \"46b6f5ef-ac2f-4add-8c6b-1157abccfbfe\") " pod="openstack-kuttl-tests/swift-proxy-598db64bc5-jp86s" Mar 16 16:33:30 crc kubenswrapper[5120]: I0316 16:33:30.631366 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/46b6f5ef-ac2f-4add-8c6b-1157abccfbfe-log-httpd\") pod \"swift-proxy-598db64bc5-jp86s\" (UID: \"46b6f5ef-ac2f-4add-8c6b-1157abccfbfe\") " pod="openstack-kuttl-tests/swift-proxy-598db64bc5-jp86s" Mar 16 16:33:30 crc kubenswrapper[5120]: I0316 16:33:30.631621 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/46b6f5ef-ac2f-4add-8c6b-1157abccfbfe-run-httpd\") pod \"swift-proxy-598db64bc5-jp86s\" (UID: \"46b6f5ef-ac2f-4add-8c6b-1157abccfbfe\") " pod="openstack-kuttl-tests/swift-proxy-598db64bc5-jp86s" Mar 16 16:33:30 crc kubenswrapper[5120]: I0316 16:33:30.636685 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/46b6f5ef-ac2f-4add-8c6b-1157abccfbfe-combined-ca-bundle\") pod \"swift-proxy-598db64bc5-jp86s\" (UID: \"46b6f5ef-ac2f-4add-8c6b-1157abccfbfe\") " pod="openstack-kuttl-tests/swift-proxy-598db64bc5-jp86s" Mar 16 16:33:30 crc kubenswrapper[5120]: I0316 16:33:30.637455 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/46b6f5ef-ac2f-4add-8c6b-1157abccfbfe-public-tls-certs\") pod \"swift-proxy-598db64bc5-jp86s\" (UID: \"46b6f5ef-ac2f-4add-8c6b-1157abccfbfe\") " pod="openstack-kuttl-tests/swift-proxy-598db64bc5-jp86s" Mar 16 16:33:30 crc kubenswrapper[5120]: I0316 16:33:30.638645 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/46b6f5ef-ac2f-4add-8c6b-1157abccfbfe-etc-swift\") pod \"swift-proxy-598db64bc5-jp86s\" (UID: \"46b6f5ef-ac2f-4add-8c6b-1157abccfbfe\") " pod="openstack-kuttl-tests/swift-proxy-598db64bc5-jp86s" Mar 16 16:33:30 crc kubenswrapper[5120]: I0316 16:33:30.640138 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/46b6f5ef-ac2f-4add-8c6b-1157abccfbfe-config-data\") pod \"swift-proxy-598db64bc5-jp86s\" (UID: \"46b6f5ef-ac2f-4add-8c6b-1157abccfbfe\") " pod="openstack-kuttl-tests/swift-proxy-598db64bc5-jp86s" Mar 16 16:33:30 crc kubenswrapper[5120]: I0316 16:33:30.651442 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/46b6f5ef-ac2f-4add-8c6b-1157abccfbfe-internal-tls-certs\") pod \"swift-proxy-598db64bc5-jp86s\" (UID: \"46b6f5ef-ac2f-4add-8c6b-1157abccfbfe\") " pod="openstack-kuttl-tests/swift-proxy-598db64bc5-jp86s" Mar 16 16:33:30 crc kubenswrapper[5120]: I0316 16:33:30.652023 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fb2gk\" (UniqueName: \"kubernetes.io/projected/46b6f5ef-ac2f-4add-8c6b-1157abccfbfe-kube-api-access-fb2gk\") pod \"swift-proxy-598db64bc5-jp86s\" (UID: \"46b6f5ef-ac2f-4add-8c6b-1157abccfbfe\") " pod="openstack-kuttl-tests/swift-proxy-598db64bc5-jp86s" Mar 16 16:33:30 crc kubenswrapper[5120]: I0316 16:33:30.744080 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-598db64bc5-jp86s" Mar 16 16:33:31 crc kubenswrapper[5120]: I0316 16:33:31.090911 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:33:31 crc kubenswrapper[5120]: I0316 16:33:31.199963 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-proxy-598db64bc5-jp86s"] Mar 16 16:33:31 crc kubenswrapper[5120]: I0316 16:33:31.485498 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-598db64bc5-jp86s" event={"ID":"46b6f5ef-ac2f-4add-8c6b-1157abccfbfe","Type":"ContainerStarted","Data":"6239d9262ea4e6d804dc34e524958245dbc975aa665284c54c62b5dca2c72739"} Mar 16 16:33:31 crc kubenswrapper[5120]: I0316 16:33:31.486027 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-598db64bc5-jp86s" event={"ID":"46b6f5ef-ac2f-4add-8c6b-1157abccfbfe","Type":"ContainerStarted","Data":"2cb1e8ce355f34e54850aadb2fc6be3bf01ec242c62e643f18e7610b869ff57a"} Mar 16 16:33:31 crc kubenswrapper[5120]: I0316 16:33:31.576420 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-p6mhd"] Mar 16 16:33:31 crc kubenswrapper[5120]: I0316 16:33:31.587432 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-db-create-p6mhd" Mar 16 16:33:31 crc kubenswrapper[5120]: I0316 16:33:31.601863 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-p6mhd"] Mar 16 16:33:31 crc kubenswrapper[5120]: I0316 16:33:31.725175 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-pnmcl"] Mar 16 16:33:31 crc kubenswrapper[5120]: I0316 16:33:31.733182 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-db-create-pnmcl" Mar 16 16:33:31 crc kubenswrapper[5120]: I0316 16:33:31.754015 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-8044-account-create-update-hd6hq"] Mar 16 16:33:31 crc kubenswrapper[5120]: I0316 16:33:31.762325 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-8044-account-create-update-hd6hq" Mar 16 16:33:31 crc kubenswrapper[5120]: I0316 16:33:31.764042 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-pnmcl"] Mar 16 16:33:31 crc kubenswrapper[5120]: I0316 16:33:31.765933 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-db-secret\"" Mar 16 16:33:31 crc kubenswrapper[5120]: I0316 16:33:31.771633 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ch8q6\" (UniqueName: \"kubernetes.io/projected/51f5578b-db33-480b-bced-d7472406f411-kube-api-access-ch8q6\") pod \"nova-api-db-create-p6mhd\" (UID: \"51f5578b-db33-480b-bced-d7472406f411\") " pod="openstack-kuttl-tests/nova-api-db-create-p6mhd" Mar 16 16:33:31 crc kubenswrapper[5120]: I0316 16:33:31.771909 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/51f5578b-db33-480b-bced-d7472406f411-operator-scripts\") pod \"nova-api-db-create-p6mhd\" (UID: \"51f5578b-db33-480b-bced-d7472406f411\") " pod="openstack-kuttl-tests/nova-api-db-create-p6mhd" Mar 16 16:33:31 crc kubenswrapper[5120]: I0316 16:33:31.776221 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-8044-account-create-update-hd6hq"] Mar 16 16:33:31 crc kubenswrapper[5120]: I0316 16:33:31.874101 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/51f5578b-db33-480b-bced-d7472406f411-operator-scripts\") pod \"nova-api-db-create-p6mhd\" (UID: \"51f5578b-db33-480b-bced-d7472406f411\") " pod="openstack-kuttl-tests/nova-api-db-create-p6mhd" Mar 16 16:33:31 crc kubenswrapper[5120]: I0316 16:33:31.874585 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ch8q6\" (UniqueName: \"kubernetes.io/projected/51f5578b-db33-480b-bced-d7472406f411-kube-api-access-ch8q6\") pod \"nova-api-db-create-p6mhd\" (UID: \"51f5578b-db33-480b-bced-d7472406f411\") " pod="openstack-kuttl-tests/nova-api-db-create-p6mhd" Mar 16 16:33:31 crc kubenswrapper[5120]: I0316 16:33:31.874639 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a43b68af-dd50-4ff9-847a-45a6f48d7193-operator-scripts\") pod \"nova-api-8044-account-create-update-hd6hq\" (UID: \"a43b68af-dd50-4ff9-847a-45a6f48d7193\") " pod="openstack-kuttl-tests/nova-api-8044-account-create-update-hd6hq" Mar 16 16:33:31 crc kubenswrapper[5120]: I0316 16:33:31.874661 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5chfq\" (UniqueName: \"kubernetes.io/projected/e553ce53-4668-4c11-b0e1-65cc12d6f455-kube-api-access-5chfq\") pod \"nova-cell0-db-create-pnmcl\" (UID: \"e553ce53-4668-4c11-b0e1-65cc12d6f455\") " pod="openstack-kuttl-tests/nova-cell0-db-create-pnmcl" Mar 16 16:33:31 crc kubenswrapper[5120]: I0316 16:33:31.874699 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q6pk6\" (UniqueName: \"kubernetes.io/projected/a43b68af-dd50-4ff9-847a-45a6f48d7193-kube-api-access-q6pk6\") pod \"nova-api-8044-account-create-update-hd6hq\" (UID: \"a43b68af-dd50-4ff9-847a-45a6f48d7193\") " pod="openstack-kuttl-tests/nova-api-8044-account-create-update-hd6hq" Mar 16 16:33:31 crc kubenswrapper[5120]: I0316 16:33:31.874801 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e553ce53-4668-4c11-b0e1-65cc12d6f455-operator-scripts\") pod \"nova-cell0-db-create-pnmcl\" (UID: \"e553ce53-4668-4c11-b0e1-65cc12d6f455\") " pod="openstack-kuttl-tests/nova-cell0-db-create-pnmcl" Mar 16 16:33:31 crc kubenswrapper[5120]: I0316 16:33:31.875416 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/51f5578b-db33-480b-bced-d7472406f411-operator-scripts\") pod \"nova-api-db-create-p6mhd\" (UID: \"51f5578b-db33-480b-bced-d7472406f411\") " pod="openstack-kuttl-tests/nova-api-db-create-p6mhd" Mar 16 16:33:31 crc kubenswrapper[5120]: I0316 16:33:31.880173 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-mddwp"] Mar 16 16:33:31 crc kubenswrapper[5120]: I0316 16:33:31.903798 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-db-create-mddwp" Mar 16 16:33:31 crc kubenswrapper[5120]: I0316 16:33:31.904513 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ch8q6\" (UniqueName: \"kubernetes.io/projected/51f5578b-db33-480b-bced-d7472406f411-kube-api-access-ch8q6\") pod \"nova-api-db-create-p6mhd\" (UID: \"51f5578b-db33-480b-bced-d7472406f411\") " pod="openstack-kuttl-tests/nova-api-db-create-p6mhd" Mar 16 16:33:31 crc kubenswrapper[5120]: I0316 16:33:31.907308 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-db-create-p6mhd" Mar 16 16:33:31 crc kubenswrapper[5120]: I0316 16:33:31.925388 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-a054-account-create-update-hfxct"] Mar 16 16:33:31 crc kubenswrapper[5120]: I0316 16:33:31.934517 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-a054-account-create-update-hfxct" Mar 16 16:33:31 crc kubenswrapper[5120]: I0316 16:33:31.938819 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-a054-account-create-update-hfxct"] Mar 16 16:33:31 crc kubenswrapper[5120]: I0316 16:33:31.939101 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-db-secret\"" Mar 16 16:33:31 crc kubenswrapper[5120]: I0316 16:33:31.949106 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-mddwp"] Mar 16 16:33:31 crc kubenswrapper[5120]: I0316 16:33:31.978220 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e553ce53-4668-4c11-b0e1-65cc12d6f455-operator-scripts\") pod \"nova-cell0-db-create-pnmcl\" (UID: \"e553ce53-4668-4c11-b0e1-65cc12d6f455\") " pod="openstack-kuttl-tests/nova-cell0-db-create-pnmcl" Mar 16 16:33:31 crc kubenswrapper[5120]: I0316 16:33:31.978533 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a43b68af-dd50-4ff9-847a-45a6f48d7193-operator-scripts\") pod \"nova-api-8044-account-create-update-hd6hq\" (UID: \"a43b68af-dd50-4ff9-847a-45a6f48d7193\") " pod="openstack-kuttl-tests/nova-api-8044-account-create-update-hd6hq" Mar 16 16:33:31 crc kubenswrapper[5120]: I0316 16:33:31.978572 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5chfq\" (UniqueName: \"kubernetes.io/projected/e553ce53-4668-4c11-b0e1-65cc12d6f455-kube-api-access-5chfq\") pod \"nova-cell0-db-create-pnmcl\" (UID: \"e553ce53-4668-4c11-b0e1-65cc12d6f455\") " pod="openstack-kuttl-tests/nova-cell0-db-create-pnmcl" Mar 16 16:33:31 crc kubenswrapper[5120]: I0316 16:33:31.978628 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q6pk6\" (UniqueName: \"kubernetes.io/projected/a43b68af-dd50-4ff9-847a-45a6f48d7193-kube-api-access-q6pk6\") pod \"nova-api-8044-account-create-update-hd6hq\" (UID: \"a43b68af-dd50-4ff9-847a-45a6f48d7193\") " pod="openstack-kuttl-tests/nova-api-8044-account-create-update-hd6hq" Mar 16 16:33:31 crc kubenswrapper[5120]: I0316 16:33:31.979692 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a43b68af-dd50-4ff9-847a-45a6f48d7193-operator-scripts\") pod \"nova-api-8044-account-create-update-hd6hq\" (UID: \"a43b68af-dd50-4ff9-847a-45a6f48d7193\") " pod="openstack-kuttl-tests/nova-api-8044-account-create-update-hd6hq" Mar 16 16:33:31 crc kubenswrapper[5120]: I0316 16:33:31.981333 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e553ce53-4668-4c11-b0e1-65cc12d6f455-operator-scripts\") pod \"nova-cell0-db-create-pnmcl\" (UID: \"e553ce53-4668-4c11-b0e1-65cc12d6f455\") " pod="openstack-kuttl-tests/nova-cell0-db-create-pnmcl" Mar 16 16:33:31 crc kubenswrapper[5120]: I0316 16:33:31.998585 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q6pk6\" (UniqueName: \"kubernetes.io/projected/a43b68af-dd50-4ff9-847a-45a6f48d7193-kube-api-access-q6pk6\") pod \"nova-api-8044-account-create-update-hd6hq\" (UID: \"a43b68af-dd50-4ff9-847a-45a6f48d7193\") " pod="openstack-kuttl-tests/nova-api-8044-account-create-update-hd6hq" Mar 16 16:33:31 crc kubenswrapper[5120]: I0316 16:33:31.999660 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5chfq\" (UniqueName: \"kubernetes.io/projected/e553ce53-4668-4c11-b0e1-65cc12d6f455-kube-api-access-5chfq\") pod \"nova-cell0-db-create-pnmcl\" (UID: \"e553ce53-4668-4c11-b0e1-65cc12d6f455\") " pod="openstack-kuttl-tests/nova-cell0-db-create-pnmcl" Mar 16 16:33:32 crc kubenswrapper[5120]: I0316 16:33:32.063608 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-db-create-pnmcl" Mar 16 16:33:32 crc kubenswrapper[5120]: I0316 16:33:32.084158 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-8044-account-create-update-hd6hq" Mar 16 16:33:32 crc kubenswrapper[5120]: I0316 16:33:32.086193 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8445\" (UniqueName: \"kubernetes.io/projected/ad1d93e8-5bf9-4703-b308-9fff8ba5aa04-kube-api-access-p8445\") pod \"nova-cell1-db-create-mddwp\" (UID: \"ad1d93e8-5bf9-4703-b308-9fff8ba5aa04\") " pod="openstack-kuttl-tests/nova-cell1-db-create-mddwp" Mar 16 16:33:32 crc kubenswrapper[5120]: I0316 16:33:32.086269 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ad1d93e8-5bf9-4703-b308-9fff8ba5aa04-operator-scripts\") pod \"nova-cell1-db-create-mddwp\" (UID: \"ad1d93e8-5bf9-4703-b308-9fff8ba5aa04\") " pod="openstack-kuttl-tests/nova-cell1-db-create-mddwp" Mar 16 16:33:32 crc kubenswrapper[5120]: I0316 16:33:32.086399 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqgx9\" (UniqueName: \"kubernetes.io/projected/b417595b-2cb6-4a24-960d-c1d717a3238d-kube-api-access-wqgx9\") pod \"nova-cell0-a054-account-create-update-hfxct\" (UID: \"b417595b-2cb6-4a24-960d-c1d717a3238d\") " pod="openstack-kuttl-tests/nova-cell0-a054-account-create-update-hfxct" Mar 16 16:33:32 crc kubenswrapper[5120]: I0316 16:33:32.086463 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b417595b-2cb6-4a24-960d-c1d717a3238d-operator-scripts\") pod \"nova-cell0-a054-account-create-update-hfxct\" (UID: \"b417595b-2cb6-4a24-960d-c1d717a3238d\") " pod="openstack-kuttl-tests/nova-cell0-a054-account-create-update-hfxct" Mar 16 16:33:32 crc kubenswrapper[5120]: I0316 16:33:32.113619 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-207b-account-create-update-7vtdj"] Mar 16 16:33:32 crc kubenswrapper[5120]: I0316 16:33:32.122392 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-207b-account-create-update-7vtdj" Mar 16 16:33:32 crc kubenswrapper[5120]: I0316 16:33:32.124479 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-db-secret\"" Mar 16 16:33:32 crc kubenswrapper[5120]: I0316 16:33:32.129036 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-207b-account-create-update-7vtdj"] Mar 16 16:33:32 crc kubenswrapper[5120]: I0316 16:33:32.188532 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p8445\" (UniqueName: \"kubernetes.io/projected/ad1d93e8-5bf9-4703-b308-9fff8ba5aa04-kube-api-access-p8445\") pod \"nova-cell1-db-create-mddwp\" (UID: \"ad1d93e8-5bf9-4703-b308-9fff8ba5aa04\") " pod="openstack-kuttl-tests/nova-cell1-db-create-mddwp" Mar 16 16:33:32 crc kubenswrapper[5120]: I0316 16:33:32.188615 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ad1d93e8-5bf9-4703-b308-9fff8ba5aa04-operator-scripts\") pod \"nova-cell1-db-create-mddwp\" (UID: \"ad1d93e8-5bf9-4703-b308-9fff8ba5aa04\") " pod="openstack-kuttl-tests/nova-cell1-db-create-mddwp" Mar 16 16:33:32 crc kubenswrapper[5120]: I0316 16:33:32.188710 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wqgx9\" (UniqueName: \"kubernetes.io/projected/b417595b-2cb6-4a24-960d-c1d717a3238d-kube-api-access-wqgx9\") pod \"nova-cell0-a054-account-create-update-hfxct\" (UID: \"b417595b-2cb6-4a24-960d-c1d717a3238d\") " pod="openstack-kuttl-tests/nova-cell0-a054-account-create-update-hfxct" Mar 16 16:33:32 crc kubenswrapper[5120]: I0316 16:33:32.188814 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b417595b-2cb6-4a24-960d-c1d717a3238d-operator-scripts\") pod \"nova-cell0-a054-account-create-update-hfxct\" (UID: \"b417595b-2cb6-4a24-960d-c1d717a3238d\") " pod="openstack-kuttl-tests/nova-cell0-a054-account-create-update-hfxct" Mar 16 16:33:32 crc kubenswrapper[5120]: I0316 16:33:32.189490 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b417595b-2cb6-4a24-960d-c1d717a3238d-operator-scripts\") pod \"nova-cell0-a054-account-create-update-hfxct\" (UID: \"b417595b-2cb6-4a24-960d-c1d717a3238d\") " pod="openstack-kuttl-tests/nova-cell0-a054-account-create-update-hfxct" Mar 16 16:33:32 crc kubenswrapper[5120]: I0316 16:33:32.190893 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ad1d93e8-5bf9-4703-b308-9fff8ba5aa04-operator-scripts\") pod \"nova-cell1-db-create-mddwp\" (UID: \"ad1d93e8-5bf9-4703-b308-9fff8ba5aa04\") " pod="openstack-kuttl-tests/nova-cell1-db-create-mddwp" Mar 16 16:33:32 crc kubenswrapper[5120]: I0316 16:33:32.211725 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8445\" (UniqueName: \"kubernetes.io/projected/ad1d93e8-5bf9-4703-b308-9fff8ba5aa04-kube-api-access-p8445\") pod \"nova-cell1-db-create-mddwp\" (UID: \"ad1d93e8-5bf9-4703-b308-9fff8ba5aa04\") " pod="openstack-kuttl-tests/nova-cell1-db-create-mddwp" Mar 16 16:33:32 crc kubenswrapper[5120]: I0316 16:33:32.225200 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqgx9\" (UniqueName: \"kubernetes.io/projected/b417595b-2cb6-4a24-960d-c1d717a3238d-kube-api-access-wqgx9\") pod \"nova-cell0-a054-account-create-update-hfxct\" (UID: \"b417595b-2cb6-4a24-960d-c1d717a3238d\") " pod="openstack-kuttl-tests/nova-cell0-a054-account-create-update-hfxct" Mar 16 16:33:32 crc kubenswrapper[5120]: I0316 16:33:32.290327 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nddxz\" (UniqueName: \"kubernetes.io/projected/d82588c0-32ac-4ba3-b73b-23395c68fc07-kube-api-access-nddxz\") pod \"nova-cell1-207b-account-create-update-7vtdj\" (UID: \"d82588c0-32ac-4ba3-b73b-23395c68fc07\") " pod="openstack-kuttl-tests/nova-cell1-207b-account-create-update-7vtdj" Mar 16 16:33:32 crc kubenswrapper[5120]: I0316 16:33:32.290523 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d82588c0-32ac-4ba3-b73b-23395c68fc07-operator-scripts\") pod \"nova-cell1-207b-account-create-update-7vtdj\" (UID: \"d82588c0-32ac-4ba3-b73b-23395c68fc07\") " pod="openstack-kuttl-tests/nova-cell1-207b-account-create-update-7vtdj" Mar 16 16:33:32 crc kubenswrapper[5120]: I0316 16:33:32.392352 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nddxz\" (UniqueName: \"kubernetes.io/projected/d82588c0-32ac-4ba3-b73b-23395c68fc07-kube-api-access-nddxz\") pod \"nova-cell1-207b-account-create-update-7vtdj\" (UID: \"d82588c0-32ac-4ba3-b73b-23395c68fc07\") " pod="openstack-kuttl-tests/nova-cell1-207b-account-create-update-7vtdj" Mar 16 16:33:32 crc kubenswrapper[5120]: I0316 16:33:32.392492 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d82588c0-32ac-4ba3-b73b-23395c68fc07-operator-scripts\") pod \"nova-cell1-207b-account-create-update-7vtdj\" (UID: \"d82588c0-32ac-4ba3-b73b-23395c68fc07\") " pod="openstack-kuttl-tests/nova-cell1-207b-account-create-update-7vtdj" Mar 16 16:33:32 crc kubenswrapper[5120]: I0316 16:33:32.393290 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d82588c0-32ac-4ba3-b73b-23395c68fc07-operator-scripts\") pod \"nova-cell1-207b-account-create-update-7vtdj\" (UID: \"d82588c0-32ac-4ba3-b73b-23395c68fc07\") " pod="openstack-kuttl-tests/nova-cell1-207b-account-create-update-7vtdj" Mar 16 16:33:32 crc kubenswrapper[5120]: I0316 16:33:32.406627 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-p6mhd"] Mar 16 16:33:32 crc kubenswrapper[5120]: I0316 16:33:32.411675 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nddxz\" (UniqueName: \"kubernetes.io/projected/d82588c0-32ac-4ba3-b73b-23395c68fc07-kube-api-access-nddxz\") pod \"nova-cell1-207b-account-create-update-7vtdj\" (UID: \"d82588c0-32ac-4ba3-b73b-23395c68fc07\") " pod="openstack-kuttl-tests/nova-cell1-207b-account-create-update-7vtdj" Mar 16 16:33:32 crc kubenswrapper[5120]: I0316 16:33:32.424110 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-db-create-mddwp" Mar 16 16:33:32 crc kubenswrapper[5120]: I0316 16:33:32.462672 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-a054-account-create-update-hfxct" Mar 16 16:33:32 crc kubenswrapper[5120]: I0316 16:33:32.481926 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-207b-account-create-update-7vtdj" Mar 16 16:33:32 crc kubenswrapper[5120]: I0316 16:33:32.507005 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-db-create-p6mhd" event={"ID":"51f5578b-db33-480b-bced-d7472406f411","Type":"ContainerStarted","Data":"153b9a1dc5cd3049056877c6b26177231db67c35be7539e132ad47047f1235c8"} Mar 16 16:33:32 crc kubenswrapper[5120]: I0316 16:33:32.510963 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-598db64bc5-jp86s" event={"ID":"46b6f5ef-ac2f-4add-8c6b-1157abccfbfe","Type":"ContainerStarted","Data":"58d160f133e7a544995711ab2da546c604a09aa66243ab21dcd76c000103b09f"} Mar 16 16:33:32 crc kubenswrapper[5120]: I0316 16:33:32.511254 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/swift-proxy-598db64bc5-jp86s" Mar 16 16:33:32 crc kubenswrapper[5120]: I0316 16:33:32.511378 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/swift-proxy-598db64bc5-jp86s" Mar 16 16:33:32 crc kubenswrapper[5120]: I0316 16:33:32.540837 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/swift-proxy-598db64bc5-jp86s" podStartSLOduration=2.540817615 podStartE2EDuration="2.540817615s" podCreationTimestamp="2026-03-16 16:33:30 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:33:32.529906919 +0000 UTC m=+3714.683838576" watchObservedRunningTime="2026-03-16 16:33:32.540817615 +0000 UTC m=+3714.694749292" Mar 16 16:33:32 crc kubenswrapper[5120]: I0316 16:33:32.704966 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-pnmcl"] Mar 16 16:33:32 crc kubenswrapper[5120]: I0316 16:33:32.713617 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-8044-account-create-update-hd6hq"] Mar 16 16:33:32 crc kubenswrapper[5120]: I0316 16:33:32.918281 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-mddwp"] Mar 16 16:33:32 crc kubenswrapper[5120]: W0316 16:33:32.941708 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podad1d93e8_5bf9_4703_b308_9fff8ba5aa04.slice/crio-dc20f6d0b9ddcdd4eb5840c181993af7dc76ab28b88caa50d601812247461a83 WatchSource:0}: Error finding container dc20f6d0b9ddcdd4eb5840c181993af7dc76ab28b88caa50d601812247461a83: Status 404 returned error can't find the container with id dc20f6d0b9ddcdd4eb5840c181993af7dc76ab28b88caa50d601812247461a83 Mar 16 16:33:33 crc kubenswrapper[5120]: I0316 16:33:33.018516 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:33:33 crc kubenswrapper[5120]: I0316 16:33:33.018870 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="67fe9146-c519-453c-8f10-76ae241f8889" containerName="ceilometer-central-agent" containerID="cri-o://2cd15243ad2b9728e19e51c7a7f081c3c5dda1c485eca453f09c8100fe0dc7e7" gracePeriod=30 Mar 16 16:33:33 crc kubenswrapper[5120]: I0316 16:33:33.018958 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="67fe9146-c519-453c-8f10-76ae241f8889" containerName="sg-core" containerID="cri-o://99e6c67de1ba5520b48f1f66a97b2fe080b042c92fb9b1b374091de04f457ea7" gracePeriod=30 Mar 16 16:33:33 crc kubenswrapper[5120]: I0316 16:33:33.019020 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="67fe9146-c519-453c-8f10-76ae241f8889" containerName="ceilometer-notification-agent" containerID="cri-o://2b88f219480a1e4d7c2d8d9f50e7e899d2b50b8f4e39cb8e957e5016b4eb629a" gracePeriod=30 Mar 16 16:33:33 crc kubenswrapper[5120]: I0316 16:33:33.019042 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="67fe9146-c519-453c-8f10-76ae241f8889" containerName="proxy-httpd" containerID="cri-o://9a8355b26250445bed4bc196db99137c598f6231ee1a1f588c1869380a29016d" gracePeriod=30 Mar 16 16:33:33 crc kubenswrapper[5120]: I0316 16:33:33.073712 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-207b-account-create-update-7vtdj"] Mar 16 16:33:33 crc kubenswrapper[5120]: I0316 16:33:33.087049 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-a054-account-create-update-hfxct"] Mar 16 16:33:33 crc kubenswrapper[5120]: I0316 16:33:33.129544 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/neutron-5465fdbb4f-kmfhc" Mar 16 16:33:33 crc kubenswrapper[5120]: W0316 16:33:33.134219 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd82588c0_32ac_4ba3_b73b_23395c68fc07.slice/crio-90773ae1ea5f427796f4c392525fee5dda1f13708f1e751d0ede71e660584cb1 WatchSource:0}: Error finding container 90773ae1ea5f427796f4c392525fee5dda1f13708f1e751d0ede71e660584cb1: Status 404 returned error can't find the container with id 90773ae1ea5f427796f4c392525fee5dda1f13708f1e751d0ede71e660584cb1 Mar 16 16:33:33 crc kubenswrapper[5120]: I0316 16:33:33.226242 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-587c77d488-zm2nq"] Mar 16 16:33:33 crc kubenswrapper[5120]: I0316 16:33:33.234246 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-587c77d488-zm2nq" podUID="6aae3bc4-66a0-436a-b3b3-13d2be73a3de" containerName="neutron-api" containerID="cri-o://edd70813de326d9b1be3219b269f0e85d5c87d8f9ade26f447611458a3b1b08a" gracePeriod=30 Mar 16 16:33:33 crc kubenswrapper[5120]: I0316 16:33:33.238145 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-587c77d488-zm2nq" podUID="6aae3bc4-66a0-436a-b3b3-13d2be73a3de" containerName="neutron-httpd" containerID="cri-o://3481a847d550596ff4f99fb9a428c4176854acc79aad578f33aa84b1279b7056" gracePeriod=30 Mar 16 16:33:33 crc kubenswrapper[5120]: I0316 16:33:33.523463 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-207b-account-create-update-7vtdj" event={"ID":"d82588c0-32ac-4ba3-b73b-23395c68fc07","Type":"ContainerStarted","Data":"90773ae1ea5f427796f4c392525fee5dda1f13708f1e751d0ede71e660584cb1"} Mar 16 16:33:33 crc kubenswrapper[5120]: I0316 16:33:33.528786 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-8044-account-create-update-hd6hq" event={"ID":"a43b68af-dd50-4ff9-847a-45a6f48d7193","Type":"ContainerStarted","Data":"352145ddc81c9667c8c20eb76dca8937936777645b2daca8321845282269bd64"} Mar 16 16:33:33 crc kubenswrapper[5120]: I0316 16:33:33.528831 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-8044-account-create-update-hd6hq" event={"ID":"a43b68af-dd50-4ff9-847a-45a6f48d7193","Type":"ContainerStarted","Data":"87a69a2180feccfae16e4f21b187700904307d7d4ca1e906811fcfcd3dafd78e"} Mar 16 16:33:33 crc kubenswrapper[5120]: I0316 16:33:33.535398 5120 generic.go:358] "Generic (PLEG): container finished" podID="67fe9146-c519-453c-8f10-76ae241f8889" containerID="9a8355b26250445bed4bc196db99137c598f6231ee1a1f588c1869380a29016d" exitCode=0 Mar 16 16:33:33 crc kubenswrapper[5120]: I0316 16:33:33.535674 5120 generic.go:358] "Generic (PLEG): container finished" podID="67fe9146-c519-453c-8f10-76ae241f8889" containerID="99e6c67de1ba5520b48f1f66a97b2fe080b042c92fb9b1b374091de04f457ea7" exitCode=2 Mar 16 16:33:33 crc kubenswrapper[5120]: I0316 16:33:33.535553 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"67fe9146-c519-453c-8f10-76ae241f8889","Type":"ContainerDied","Data":"9a8355b26250445bed4bc196db99137c598f6231ee1a1f588c1869380a29016d"} Mar 16 16:33:33 crc kubenswrapper[5120]: I0316 16:33:33.536030 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"67fe9146-c519-453c-8f10-76ae241f8889","Type":"ContainerDied","Data":"99e6c67de1ba5520b48f1f66a97b2fe080b042c92fb9b1b374091de04f457ea7"} Mar 16 16:33:33 crc kubenswrapper[5120]: I0316 16:33:33.540768 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-db-create-pnmcl" event={"ID":"e553ce53-4668-4c11-b0e1-65cc12d6f455","Type":"ContainerStarted","Data":"edcee23b482215175c93820ecb4ceeb31c4a6de19a3a1b412e998ea3b9523cfe"} Mar 16 16:33:33 crc kubenswrapper[5120]: I0316 16:33:33.540824 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-db-create-pnmcl" event={"ID":"e553ce53-4668-4c11-b0e1-65cc12d6f455","Type":"ContainerStarted","Data":"82428b4ea2a32bd739ea64a3c3e51e72c62fd4b1ff5bb2c784cf6ab1278903a4"} Mar 16 16:33:33 crc kubenswrapper[5120]: I0316 16:33:33.550640 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-8044-account-create-update-hd6hq" podStartSLOduration=2.550617916 podStartE2EDuration="2.550617916s" podCreationTimestamp="2026-03-16 16:33:31 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:33:33.545580035 +0000 UTC m=+3715.699511692" watchObservedRunningTime="2026-03-16 16:33:33.550617916 +0000 UTC m=+3715.704549573" Mar 16 16:33:33 crc kubenswrapper[5120]: I0316 16:33:33.555523 5120 generic.go:358] "Generic (PLEG): container finished" podID="6aae3bc4-66a0-436a-b3b3-13d2be73a3de" containerID="3481a847d550596ff4f99fb9a428c4176854acc79aad578f33aa84b1279b7056" exitCode=0 Mar 16 16:33:33 crc kubenswrapper[5120]: I0316 16:33:33.555627 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-587c77d488-zm2nq" event={"ID":"6aae3bc4-66a0-436a-b3b3-13d2be73a3de","Type":"ContainerDied","Data":"3481a847d550596ff4f99fb9a428c4176854acc79aad578f33aa84b1279b7056"} Mar 16 16:33:33 crc kubenswrapper[5120]: I0316 16:33:33.564836 5120 generic.go:358] "Generic (PLEG): container finished" podID="51f5578b-db33-480b-bced-d7472406f411" containerID="2f0197921197297f3b4a375ee9279f84519da583a740b60f6bf4262e900e44be" exitCode=0 Mar 16 16:33:33 crc kubenswrapper[5120]: I0316 16:33:33.564937 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-db-create-p6mhd" event={"ID":"51f5578b-db33-480b-bced-d7472406f411","Type":"ContainerDied","Data":"2f0197921197297f3b4a375ee9279f84519da583a740b60f6bf4262e900e44be"} Mar 16 16:33:33 crc kubenswrapper[5120]: I0316 16:33:33.573151 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-db-create-mddwp" event={"ID":"ad1d93e8-5bf9-4703-b308-9fff8ba5aa04","Type":"ContainerStarted","Data":"361a6a3387bc4a7f0bcb0d924b9b6fc999732a9610b1f04bc2fbec9b3b0e159d"} Mar 16 16:33:33 crc kubenswrapper[5120]: I0316 16:33:33.573207 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-db-create-mddwp" event={"ID":"ad1d93e8-5bf9-4703-b308-9fff8ba5aa04","Type":"ContainerStarted","Data":"dc20f6d0b9ddcdd4eb5840c181993af7dc76ab28b88caa50d601812247461a83"} Mar 16 16:33:33 crc kubenswrapper[5120]: I0316 16:33:33.573862 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-db-create-pnmcl" podStartSLOduration=2.573847184 podStartE2EDuration="2.573847184s" podCreationTimestamp="2026-03-16 16:33:31 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:33:33.560986658 +0000 UTC m=+3715.714918315" watchObservedRunningTime="2026-03-16 16:33:33.573847184 +0000 UTC m=+3715.727778851" Mar 16 16:33:33 crc kubenswrapper[5120]: I0316 16:33:33.581747 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-a054-account-create-update-hfxct" event={"ID":"b417595b-2cb6-4a24-960d-c1d717a3238d","Type":"ContainerStarted","Data":"da42208ca834b5faf4cfe6eadc785d8123014fb3fb8d12b92c7d0fbc6e853a7a"} Mar 16 16:33:33 crc kubenswrapper[5120]: I0316 16:33:33.613615 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-db-create-mddwp" podStartSLOduration=2.613590843 podStartE2EDuration="2.613590843s" podCreationTimestamp="2026-03-16 16:33:31 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:33:33.603095539 +0000 UTC m=+3715.757027196" watchObservedRunningTime="2026-03-16 16:33:33.613590843 +0000 UTC m=+3715.767522500" Mar 16 16:33:33 crc kubenswrapper[5120]: I0316 16:33:33.673181 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-a054-account-create-update-hfxct" podStartSLOduration=2.673155732 podStartE2EDuration="2.673155732s" podCreationTimestamp="2026-03-16 16:33:31 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:33:33.649191696 +0000 UTC m=+3715.803123353" watchObservedRunningTime="2026-03-16 16:33:33.673155732 +0000 UTC m=+3715.827087399" Mar 16 16:33:34 crc kubenswrapper[5120]: I0316 16:33:34.152814 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:33:34 crc kubenswrapper[5120]: I0316 16:33:34.254630 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/67fe9146-c519-453c-8f10-76ae241f8889-combined-ca-bundle\") pod \"67fe9146-c519-453c-8f10-76ae241f8889\" (UID: \"67fe9146-c519-453c-8f10-76ae241f8889\") " Mar 16 16:33:34 crc kubenswrapper[5120]: I0316 16:33:34.254835 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/67fe9146-c519-453c-8f10-76ae241f8889-scripts\") pod \"67fe9146-c519-453c-8f10-76ae241f8889\" (UID: \"67fe9146-c519-453c-8f10-76ae241f8889\") " Mar 16 16:33:34 crc kubenswrapper[5120]: I0316 16:33:34.254869 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/67fe9146-c519-453c-8f10-76ae241f8889-log-httpd\") pod \"67fe9146-c519-453c-8f10-76ae241f8889\" (UID: \"67fe9146-c519-453c-8f10-76ae241f8889\") " Mar 16 16:33:34 crc kubenswrapper[5120]: I0316 16:33:34.254929 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hzrrw\" (UniqueName: \"kubernetes.io/projected/67fe9146-c519-453c-8f10-76ae241f8889-kube-api-access-hzrrw\") pod \"67fe9146-c519-453c-8f10-76ae241f8889\" (UID: \"67fe9146-c519-453c-8f10-76ae241f8889\") " Mar 16 16:33:34 crc kubenswrapper[5120]: I0316 16:33:34.254978 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/67fe9146-c519-453c-8f10-76ae241f8889-run-httpd\") pod \"67fe9146-c519-453c-8f10-76ae241f8889\" (UID: \"67fe9146-c519-453c-8f10-76ae241f8889\") " Mar 16 16:33:34 crc kubenswrapper[5120]: I0316 16:33:34.255062 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/67fe9146-c519-453c-8f10-76ae241f8889-config-data\") pod \"67fe9146-c519-453c-8f10-76ae241f8889\" (UID: \"67fe9146-c519-453c-8f10-76ae241f8889\") " Mar 16 16:33:34 crc kubenswrapper[5120]: I0316 16:33:34.255122 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/67fe9146-c519-453c-8f10-76ae241f8889-sg-core-conf-yaml\") pod \"67fe9146-c519-453c-8f10-76ae241f8889\" (UID: \"67fe9146-c519-453c-8f10-76ae241f8889\") " Mar 16 16:33:34 crc kubenswrapper[5120]: I0316 16:33:34.255436 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67fe9146-c519-453c-8f10-76ae241f8889-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "67fe9146-c519-453c-8f10-76ae241f8889" (UID: "67fe9146-c519-453c-8f10-76ae241f8889"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:33:34 crc kubenswrapper[5120]: I0316 16:33:34.256011 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67fe9146-c519-453c-8f10-76ae241f8889-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "67fe9146-c519-453c-8f10-76ae241f8889" (UID: "67fe9146-c519-453c-8f10-76ae241f8889"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:33:34 crc kubenswrapper[5120]: I0316 16:33:34.256481 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/67fe9146-c519-453c-8f10-76ae241f8889-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:33:34 crc kubenswrapper[5120]: I0316 16:33:34.256504 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/67fe9146-c519-453c-8f10-76ae241f8889-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:33:34 crc kubenswrapper[5120]: I0316 16:33:34.263045 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67fe9146-c519-453c-8f10-76ae241f8889-kube-api-access-hzrrw" (OuterVolumeSpecName: "kube-api-access-hzrrw") pod "67fe9146-c519-453c-8f10-76ae241f8889" (UID: "67fe9146-c519-453c-8f10-76ae241f8889"). InnerVolumeSpecName "kube-api-access-hzrrw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:33:34 crc kubenswrapper[5120]: I0316 16:33:34.270402 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/67fe9146-c519-453c-8f10-76ae241f8889-scripts" (OuterVolumeSpecName: "scripts") pod "67fe9146-c519-453c-8f10-76ae241f8889" (UID: "67fe9146-c519-453c-8f10-76ae241f8889"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:33:34 crc kubenswrapper[5120]: I0316 16:33:34.295228 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/67fe9146-c519-453c-8f10-76ae241f8889-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "67fe9146-c519-453c-8f10-76ae241f8889" (UID: "67fe9146-c519-453c-8f10-76ae241f8889"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:33:34 crc kubenswrapper[5120]: I0316 16:33:34.346185 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/67fe9146-c519-453c-8f10-76ae241f8889-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "67fe9146-c519-453c-8f10-76ae241f8889" (UID: "67fe9146-c519-453c-8f10-76ae241f8889"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:33:34 crc kubenswrapper[5120]: I0316 16:33:34.359933 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hzrrw\" (UniqueName: \"kubernetes.io/projected/67fe9146-c519-453c-8f10-76ae241f8889-kube-api-access-hzrrw\") on node \"crc\" DevicePath \"\"" Mar 16 16:33:34 crc kubenswrapper[5120]: I0316 16:33:34.360308 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/67fe9146-c519-453c-8f10-76ae241f8889-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 16:33:34 crc kubenswrapper[5120]: I0316 16:33:34.360324 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/67fe9146-c519-453c-8f10-76ae241f8889-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:33:34 crc kubenswrapper[5120]: I0316 16:33:34.360337 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/67fe9146-c519-453c-8f10-76ae241f8889-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:33:34 crc kubenswrapper[5120]: I0316 16:33:34.367153 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/67fe9146-c519-453c-8f10-76ae241f8889-config-data" (OuterVolumeSpecName: "config-data") pod "67fe9146-c519-453c-8f10-76ae241f8889" (UID: "67fe9146-c519-453c-8f10-76ae241f8889"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:33:34 crc kubenswrapper[5120]: I0316 16:33:34.461957 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/67fe9146-c519-453c-8f10-76ae241f8889-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:33:34 crc kubenswrapper[5120]: I0316 16:33:34.592864 5120 generic.go:358] "Generic (PLEG): container finished" podID="ad1d93e8-5bf9-4703-b308-9fff8ba5aa04" containerID="361a6a3387bc4a7f0bcb0d924b9b6fc999732a9610b1f04bc2fbec9b3b0e159d" exitCode=0 Mar 16 16:33:34 crc kubenswrapper[5120]: I0316 16:33:34.592921 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-db-create-mddwp" event={"ID":"ad1d93e8-5bf9-4703-b308-9fff8ba5aa04","Type":"ContainerDied","Data":"361a6a3387bc4a7f0bcb0d924b9b6fc999732a9610b1f04bc2fbec9b3b0e159d"} Mar 16 16:33:34 crc kubenswrapper[5120]: I0316 16:33:34.595816 5120 generic.go:358] "Generic (PLEG): container finished" podID="b417595b-2cb6-4a24-960d-c1d717a3238d" containerID="fa416404210ba9884e92dd1be2f328de4273ed8f8cdcad1414a712c0b73c392c" exitCode=0 Mar 16 16:33:34 crc kubenswrapper[5120]: I0316 16:33:34.596016 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-a054-account-create-update-hfxct" event={"ID":"b417595b-2cb6-4a24-960d-c1d717a3238d","Type":"ContainerDied","Data":"fa416404210ba9884e92dd1be2f328de4273ed8f8cdcad1414a712c0b73c392c"} Mar 16 16:33:34 crc kubenswrapper[5120]: I0316 16:33:34.599600 5120 generic.go:358] "Generic (PLEG): container finished" podID="d82588c0-32ac-4ba3-b73b-23395c68fc07" containerID="476e79bc976be0e2457fee61d3ac73832939cb61a6a76b093c5e115b93b5ce56" exitCode=0 Mar 16 16:33:34 crc kubenswrapper[5120]: I0316 16:33:34.599801 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-207b-account-create-update-7vtdj" event={"ID":"d82588c0-32ac-4ba3-b73b-23395c68fc07","Type":"ContainerDied","Data":"476e79bc976be0e2457fee61d3ac73832939cb61a6a76b093c5e115b93b5ce56"} Mar 16 16:33:34 crc kubenswrapper[5120]: I0316 16:33:34.602997 5120 generic.go:358] "Generic (PLEG): container finished" podID="a43b68af-dd50-4ff9-847a-45a6f48d7193" containerID="352145ddc81c9667c8c20eb76dca8937936777645b2daca8321845282269bd64" exitCode=0 Mar 16 16:33:34 crc kubenswrapper[5120]: I0316 16:33:34.603120 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-8044-account-create-update-hd6hq" event={"ID":"a43b68af-dd50-4ff9-847a-45a6f48d7193","Type":"ContainerDied","Data":"352145ddc81c9667c8c20eb76dca8937936777645b2daca8321845282269bd64"} Mar 16 16:33:34 crc kubenswrapper[5120]: I0316 16:33:34.607887 5120 generic.go:358] "Generic (PLEG): container finished" podID="67fe9146-c519-453c-8f10-76ae241f8889" containerID="2b88f219480a1e4d7c2d8d9f50e7e899d2b50b8f4e39cb8e957e5016b4eb629a" exitCode=0 Mar 16 16:33:34 crc kubenswrapper[5120]: I0316 16:33:34.608128 5120 generic.go:358] "Generic (PLEG): container finished" podID="67fe9146-c519-453c-8f10-76ae241f8889" containerID="2cd15243ad2b9728e19e51c7a7f081c3c5dda1c485eca453f09c8100fe0dc7e7" exitCode=0 Mar 16 16:33:34 crc kubenswrapper[5120]: I0316 16:33:34.608113 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:33:34 crc kubenswrapper[5120]: I0316 16:33:34.608002 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"67fe9146-c519-453c-8f10-76ae241f8889","Type":"ContainerDied","Data":"2b88f219480a1e4d7c2d8d9f50e7e899d2b50b8f4e39cb8e957e5016b4eb629a"} Mar 16 16:33:34 crc kubenswrapper[5120]: I0316 16:33:34.609004 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"67fe9146-c519-453c-8f10-76ae241f8889","Type":"ContainerDied","Data":"2cd15243ad2b9728e19e51c7a7f081c3c5dda1c485eca453f09c8100fe0dc7e7"} Mar 16 16:33:34 crc kubenswrapper[5120]: I0316 16:33:34.609039 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"67fe9146-c519-453c-8f10-76ae241f8889","Type":"ContainerDied","Data":"f05b958cfdea4c618faa63ec9ba4ec7c8a6ec2d3cd14497142992eae48c7e0b0"} Mar 16 16:33:34 crc kubenswrapper[5120]: I0316 16:33:34.609063 5120 scope.go:117] "RemoveContainer" containerID="9a8355b26250445bed4bc196db99137c598f6231ee1a1f588c1869380a29016d" Mar 16 16:33:34 crc kubenswrapper[5120]: I0316 16:33:34.617315 5120 generic.go:358] "Generic (PLEG): container finished" podID="e553ce53-4668-4c11-b0e1-65cc12d6f455" containerID="edcee23b482215175c93820ecb4ceeb31c4a6de19a3a1b412e998ea3b9523cfe" exitCode=0 Mar 16 16:33:34 crc kubenswrapper[5120]: I0316 16:33:34.617697 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-db-create-pnmcl" event={"ID":"e553ce53-4668-4c11-b0e1-65cc12d6f455","Type":"ContainerDied","Data":"edcee23b482215175c93820ecb4ceeb31c4a6de19a3a1b412e998ea3b9523cfe"} Mar 16 16:33:34 crc kubenswrapper[5120]: I0316 16:33:34.669195 5120 scope.go:117] "RemoveContainer" containerID="99e6c67de1ba5520b48f1f66a97b2fe080b042c92fb9b1b374091de04f457ea7" Mar 16 16:33:34 crc kubenswrapper[5120]: I0316 16:33:34.710619 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:33:34 crc kubenswrapper[5120]: I0316 16:33:34.720390 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:33:34 crc kubenswrapper[5120]: I0316 16:33:34.733483 5120 scope.go:117] "RemoveContainer" containerID="2b88f219480a1e4d7c2d8d9f50e7e899d2b50b8f4e39cb8e957e5016b4eb629a" Mar 16 16:33:34 crc kubenswrapper[5120]: I0316 16:33:34.747448 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:33:34 crc kubenswrapper[5120]: I0316 16:33:34.750160 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67fe9146-c519-453c-8f10-76ae241f8889" containerName="sg-core" Mar 16 16:33:34 crc kubenswrapper[5120]: I0316 16:33:34.750186 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="67fe9146-c519-453c-8f10-76ae241f8889" containerName="sg-core" Mar 16 16:33:34 crc kubenswrapper[5120]: I0316 16:33:34.750200 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67fe9146-c519-453c-8f10-76ae241f8889" containerName="ceilometer-notification-agent" Mar 16 16:33:34 crc kubenswrapper[5120]: I0316 16:33:34.750208 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="67fe9146-c519-453c-8f10-76ae241f8889" containerName="ceilometer-notification-agent" Mar 16 16:33:34 crc kubenswrapper[5120]: I0316 16:33:34.750231 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67fe9146-c519-453c-8f10-76ae241f8889" containerName="ceilometer-central-agent" Mar 16 16:33:34 crc kubenswrapper[5120]: I0316 16:33:34.750237 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="67fe9146-c519-453c-8f10-76ae241f8889" containerName="ceilometer-central-agent" Mar 16 16:33:34 crc kubenswrapper[5120]: I0316 16:33:34.750247 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67fe9146-c519-453c-8f10-76ae241f8889" containerName="proxy-httpd" Mar 16 16:33:34 crc kubenswrapper[5120]: I0316 16:33:34.750252 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="67fe9146-c519-453c-8f10-76ae241f8889" containerName="proxy-httpd" Mar 16 16:33:34 crc kubenswrapper[5120]: I0316 16:33:34.750448 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="67fe9146-c519-453c-8f10-76ae241f8889" containerName="sg-core" Mar 16 16:33:34 crc kubenswrapper[5120]: I0316 16:33:34.750457 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="67fe9146-c519-453c-8f10-76ae241f8889" containerName="ceilometer-notification-agent" Mar 16 16:33:34 crc kubenswrapper[5120]: I0316 16:33:34.750467 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="67fe9146-c519-453c-8f10-76ae241f8889" containerName="proxy-httpd" Mar 16 16:33:34 crc kubenswrapper[5120]: I0316 16:33:34.750477 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="67fe9146-c519-453c-8f10-76ae241f8889" containerName="ceilometer-central-agent" Mar 16 16:33:34 crc kubenswrapper[5120]: I0316 16:33:34.757855 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:33:34 crc kubenswrapper[5120]: I0316 16:33:34.758023 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:33:34 crc kubenswrapper[5120]: I0316 16:33:34.760321 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 16:33:34 crc kubenswrapper[5120]: I0316 16:33:34.764260 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 16:33:34 crc kubenswrapper[5120]: I0316 16:33:34.765634 5120 scope.go:117] "RemoveContainer" containerID="2cd15243ad2b9728e19e51c7a7f081c3c5dda1c485eca453f09c8100fe0dc7e7" Mar 16 16:33:34 crc kubenswrapper[5120]: I0316 16:33:34.767938 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ec6aab94-5ad4-4bd4-b657-108802dfb9b3-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"ec6aab94-5ad4-4bd4-b657-108802dfb9b3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:33:34 crc kubenswrapper[5120]: I0316 16:33:34.768089 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnrmc\" (UniqueName: \"kubernetes.io/projected/ec6aab94-5ad4-4bd4-b657-108802dfb9b3-kube-api-access-jnrmc\") pod \"ceilometer-0\" (UID: \"ec6aab94-5ad4-4bd4-b657-108802dfb9b3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:33:34 crc kubenswrapper[5120]: I0316 16:33:34.768154 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/ec6aab94-5ad4-4bd4-b657-108802dfb9b3-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"ec6aab94-5ad4-4bd4-b657-108802dfb9b3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:33:34 crc kubenswrapper[5120]: I0316 16:33:34.768195 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ec6aab94-5ad4-4bd4-b657-108802dfb9b3-scripts\") pod \"ceilometer-0\" (UID: \"ec6aab94-5ad4-4bd4-b657-108802dfb9b3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:33:34 crc kubenswrapper[5120]: I0316 16:33:34.768236 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ec6aab94-5ad4-4bd4-b657-108802dfb9b3-config-data\") pod \"ceilometer-0\" (UID: \"ec6aab94-5ad4-4bd4-b657-108802dfb9b3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:33:34 crc kubenswrapper[5120]: I0316 16:33:34.768325 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ec6aab94-5ad4-4bd4-b657-108802dfb9b3-run-httpd\") pod \"ceilometer-0\" (UID: \"ec6aab94-5ad4-4bd4-b657-108802dfb9b3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:33:34 crc kubenswrapper[5120]: I0316 16:33:34.768466 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ec6aab94-5ad4-4bd4-b657-108802dfb9b3-log-httpd\") pod \"ceilometer-0\" (UID: \"ec6aab94-5ad4-4bd4-b657-108802dfb9b3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:33:34 crc kubenswrapper[5120]: I0316 16:33:34.801194 5120 scope.go:117] "RemoveContainer" containerID="9a8355b26250445bed4bc196db99137c598f6231ee1a1f588c1869380a29016d" Mar 16 16:33:34 crc kubenswrapper[5120]: E0316 16:33:34.801732 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a8355b26250445bed4bc196db99137c598f6231ee1a1f588c1869380a29016d\": container with ID starting with 9a8355b26250445bed4bc196db99137c598f6231ee1a1f588c1869380a29016d not found: ID does not exist" containerID="9a8355b26250445bed4bc196db99137c598f6231ee1a1f588c1869380a29016d" Mar 16 16:33:34 crc kubenswrapper[5120]: I0316 16:33:34.801776 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a8355b26250445bed4bc196db99137c598f6231ee1a1f588c1869380a29016d"} err="failed to get container status \"9a8355b26250445bed4bc196db99137c598f6231ee1a1f588c1869380a29016d\": rpc error: code = NotFound desc = could not find container \"9a8355b26250445bed4bc196db99137c598f6231ee1a1f588c1869380a29016d\": container with ID starting with 9a8355b26250445bed4bc196db99137c598f6231ee1a1f588c1869380a29016d not found: ID does not exist" Mar 16 16:33:34 crc kubenswrapper[5120]: I0316 16:33:34.801803 5120 scope.go:117] "RemoveContainer" containerID="99e6c67de1ba5520b48f1f66a97b2fe080b042c92fb9b1b374091de04f457ea7" Mar 16 16:33:34 crc kubenswrapper[5120]: E0316 16:33:34.803324 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"99e6c67de1ba5520b48f1f66a97b2fe080b042c92fb9b1b374091de04f457ea7\": container with ID starting with 99e6c67de1ba5520b48f1f66a97b2fe080b042c92fb9b1b374091de04f457ea7 not found: ID does not exist" containerID="99e6c67de1ba5520b48f1f66a97b2fe080b042c92fb9b1b374091de04f457ea7" Mar 16 16:33:34 crc kubenswrapper[5120]: I0316 16:33:34.803357 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99e6c67de1ba5520b48f1f66a97b2fe080b042c92fb9b1b374091de04f457ea7"} err="failed to get container status \"99e6c67de1ba5520b48f1f66a97b2fe080b042c92fb9b1b374091de04f457ea7\": rpc error: code = NotFound desc = could not find container \"99e6c67de1ba5520b48f1f66a97b2fe080b042c92fb9b1b374091de04f457ea7\": container with ID starting with 99e6c67de1ba5520b48f1f66a97b2fe080b042c92fb9b1b374091de04f457ea7 not found: ID does not exist" Mar 16 16:33:34 crc kubenswrapper[5120]: I0316 16:33:34.803374 5120 scope.go:117] "RemoveContainer" containerID="2b88f219480a1e4d7c2d8d9f50e7e899d2b50b8f4e39cb8e957e5016b4eb629a" Mar 16 16:33:34 crc kubenswrapper[5120]: E0316 16:33:34.806402 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b88f219480a1e4d7c2d8d9f50e7e899d2b50b8f4e39cb8e957e5016b4eb629a\": container with ID starting with 2b88f219480a1e4d7c2d8d9f50e7e899d2b50b8f4e39cb8e957e5016b4eb629a not found: ID does not exist" containerID="2b88f219480a1e4d7c2d8d9f50e7e899d2b50b8f4e39cb8e957e5016b4eb629a" Mar 16 16:33:34 crc kubenswrapper[5120]: I0316 16:33:34.806441 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b88f219480a1e4d7c2d8d9f50e7e899d2b50b8f4e39cb8e957e5016b4eb629a"} err="failed to get container status \"2b88f219480a1e4d7c2d8d9f50e7e899d2b50b8f4e39cb8e957e5016b4eb629a\": rpc error: code = NotFound desc = could not find container \"2b88f219480a1e4d7c2d8d9f50e7e899d2b50b8f4e39cb8e957e5016b4eb629a\": container with ID starting with 2b88f219480a1e4d7c2d8d9f50e7e899d2b50b8f4e39cb8e957e5016b4eb629a not found: ID does not exist" Mar 16 16:33:34 crc kubenswrapper[5120]: I0316 16:33:34.806482 5120 scope.go:117] "RemoveContainer" containerID="2cd15243ad2b9728e19e51c7a7f081c3c5dda1c485eca453f09c8100fe0dc7e7" Mar 16 16:33:34 crc kubenswrapper[5120]: E0316 16:33:34.808403 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2cd15243ad2b9728e19e51c7a7f081c3c5dda1c485eca453f09c8100fe0dc7e7\": container with ID starting with 2cd15243ad2b9728e19e51c7a7f081c3c5dda1c485eca453f09c8100fe0dc7e7 not found: ID does not exist" containerID="2cd15243ad2b9728e19e51c7a7f081c3c5dda1c485eca453f09c8100fe0dc7e7" Mar 16 16:33:34 crc kubenswrapper[5120]: I0316 16:33:34.808481 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2cd15243ad2b9728e19e51c7a7f081c3c5dda1c485eca453f09c8100fe0dc7e7"} err="failed to get container status \"2cd15243ad2b9728e19e51c7a7f081c3c5dda1c485eca453f09c8100fe0dc7e7\": rpc error: code = NotFound desc = could not find container \"2cd15243ad2b9728e19e51c7a7f081c3c5dda1c485eca453f09c8100fe0dc7e7\": container with ID starting with 2cd15243ad2b9728e19e51c7a7f081c3c5dda1c485eca453f09c8100fe0dc7e7 not found: ID does not exist" Mar 16 16:33:34 crc kubenswrapper[5120]: I0316 16:33:34.808501 5120 scope.go:117] "RemoveContainer" containerID="9a8355b26250445bed4bc196db99137c598f6231ee1a1f588c1869380a29016d" Mar 16 16:33:34 crc kubenswrapper[5120]: I0316 16:33:34.808810 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a8355b26250445bed4bc196db99137c598f6231ee1a1f588c1869380a29016d"} err="failed to get container status \"9a8355b26250445bed4bc196db99137c598f6231ee1a1f588c1869380a29016d\": rpc error: code = NotFound desc = could not find container \"9a8355b26250445bed4bc196db99137c598f6231ee1a1f588c1869380a29016d\": container with ID starting with 9a8355b26250445bed4bc196db99137c598f6231ee1a1f588c1869380a29016d not found: ID does not exist" Mar 16 16:33:34 crc kubenswrapper[5120]: I0316 16:33:34.808851 5120 scope.go:117] "RemoveContainer" containerID="99e6c67de1ba5520b48f1f66a97b2fe080b042c92fb9b1b374091de04f457ea7" Mar 16 16:33:34 crc kubenswrapper[5120]: I0316 16:33:34.809334 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99e6c67de1ba5520b48f1f66a97b2fe080b042c92fb9b1b374091de04f457ea7"} err="failed to get container status \"99e6c67de1ba5520b48f1f66a97b2fe080b042c92fb9b1b374091de04f457ea7\": rpc error: code = NotFound desc = could not find container \"99e6c67de1ba5520b48f1f66a97b2fe080b042c92fb9b1b374091de04f457ea7\": container with ID starting with 99e6c67de1ba5520b48f1f66a97b2fe080b042c92fb9b1b374091de04f457ea7 not found: ID does not exist" Mar 16 16:33:34 crc kubenswrapper[5120]: I0316 16:33:34.809360 5120 scope.go:117] "RemoveContainer" containerID="2b88f219480a1e4d7c2d8d9f50e7e899d2b50b8f4e39cb8e957e5016b4eb629a" Mar 16 16:33:34 crc kubenswrapper[5120]: I0316 16:33:34.810393 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b88f219480a1e4d7c2d8d9f50e7e899d2b50b8f4e39cb8e957e5016b4eb629a"} err="failed to get container status \"2b88f219480a1e4d7c2d8d9f50e7e899d2b50b8f4e39cb8e957e5016b4eb629a\": rpc error: code = NotFound desc = could not find container \"2b88f219480a1e4d7c2d8d9f50e7e899d2b50b8f4e39cb8e957e5016b4eb629a\": container with ID starting with 2b88f219480a1e4d7c2d8d9f50e7e899d2b50b8f4e39cb8e957e5016b4eb629a not found: ID does not exist" Mar 16 16:33:34 crc kubenswrapper[5120]: I0316 16:33:34.810430 5120 scope.go:117] "RemoveContainer" containerID="2cd15243ad2b9728e19e51c7a7f081c3c5dda1c485eca453f09c8100fe0dc7e7" Mar 16 16:33:34 crc kubenswrapper[5120]: I0316 16:33:34.811392 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2cd15243ad2b9728e19e51c7a7f081c3c5dda1c485eca453f09c8100fe0dc7e7"} err="failed to get container status \"2cd15243ad2b9728e19e51c7a7f081c3c5dda1c485eca453f09c8100fe0dc7e7\": rpc error: code = NotFound desc = could not find container \"2cd15243ad2b9728e19e51c7a7f081c3c5dda1c485eca453f09c8100fe0dc7e7\": container with ID starting with 2cd15243ad2b9728e19e51c7a7f081c3c5dda1c485eca453f09c8100fe0dc7e7 not found: ID does not exist" Mar 16 16:33:34 crc kubenswrapper[5120]: I0316 16:33:34.873047 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/ec6aab94-5ad4-4bd4-b657-108802dfb9b3-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"ec6aab94-5ad4-4bd4-b657-108802dfb9b3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:33:34 crc kubenswrapper[5120]: I0316 16:33:34.873109 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ec6aab94-5ad4-4bd4-b657-108802dfb9b3-scripts\") pod \"ceilometer-0\" (UID: \"ec6aab94-5ad4-4bd4-b657-108802dfb9b3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:33:34 crc kubenswrapper[5120]: I0316 16:33:34.873153 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ec6aab94-5ad4-4bd4-b657-108802dfb9b3-config-data\") pod \"ceilometer-0\" (UID: \"ec6aab94-5ad4-4bd4-b657-108802dfb9b3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:33:34 crc kubenswrapper[5120]: I0316 16:33:34.873230 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ec6aab94-5ad4-4bd4-b657-108802dfb9b3-run-httpd\") pod \"ceilometer-0\" (UID: \"ec6aab94-5ad4-4bd4-b657-108802dfb9b3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:33:34 crc kubenswrapper[5120]: I0316 16:33:34.873342 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ec6aab94-5ad4-4bd4-b657-108802dfb9b3-log-httpd\") pod \"ceilometer-0\" (UID: \"ec6aab94-5ad4-4bd4-b657-108802dfb9b3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:33:34 crc kubenswrapper[5120]: I0316 16:33:34.873444 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ec6aab94-5ad4-4bd4-b657-108802dfb9b3-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"ec6aab94-5ad4-4bd4-b657-108802dfb9b3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:33:34 crc kubenswrapper[5120]: I0316 16:33:34.873590 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jnrmc\" (UniqueName: \"kubernetes.io/projected/ec6aab94-5ad4-4bd4-b657-108802dfb9b3-kube-api-access-jnrmc\") pod \"ceilometer-0\" (UID: \"ec6aab94-5ad4-4bd4-b657-108802dfb9b3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:33:34 crc kubenswrapper[5120]: I0316 16:33:34.876253 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ec6aab94-5ad4-4bd4-b657-108802dfb9b3-log-httpd\") pod \"ceilometer-0\" (UID: \"ec6aab94-5ad4-4bd4-b657-108802dfb9b3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:33:34 crc kubenswrapper[5120]: I0316 16:33:34.876599 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ec6aab94-5ad4-4bd4-b657-108802dfb9b3-run-httpd\") pod \"ceilometer-0\" (UID: \"ec6aab94-5ad4-4bd4-b657-108802dfb9b3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:33:34 crc kubenswrapper[5120]: I0316 16:33:34.883549 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ec6aab94-5ad4-4bd4-b657-108802dfb9b3-scripts\") pod \"ceilometer-0\" (UID: \"ec6aab94-5ad4-4bd4-b657-108802dfb9b3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:33:34 crc kubenswrapper[5120]: I0316 16:33:34.886701 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ec6aab94-5ad4-4bd4-b657-108802dfb9b3-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"ec6aab94-5ad4-4bd4-b657-108802dfb9b3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:33:34 crc kubenswrapper[5120]: I0316 16:33:34.892292 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/ec6aab94-5ad4-4bd4-b657-108802dfb9b3-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"ec6aab94-5ad4-4bd4-b657-108802dfb9b3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:33:34 crc kubenswrapper[5120]: I0316 16:33:34.895931 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ec6aab94-5ad4-4bd4-b657-108802dfb9b3-config-data\") pod \"ceilometer-0\" (UID: \"ec6aab94-5ad4-4bd4-b657-108802dfb9b3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:33:34 crc kubenswrapper[5120]: I0316 16:33:34.896488 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnrmc\" (UniqueName: \"kubernetes.io/projected/ec6aab94-5ad4-4bd4-b657-108802dfb9b3-kube-api-access-jnrmc\") pod \"ceilometer-0\" (UID: \"ec6aab94-5ad4-4bd4-b657-108802dfb9b3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:33:35 crc kubenswrapper[5120]: I0316 16:33:35.048943 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-db-create-p6mhd" Mar 16 16:33:35 crc kubenswrapper[5120]: I0316 16:33:35.077204 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/51f5578b-db33-480b-bced-d7472406f411-operator-scripts\") pod \"51f5578b-db33-480b-bced-d7472406f411\" (UID: \"51f5578b-db33-480b-bced-d7472406f411\") " Mar 16 16:33:35 crc kubenswrapper[5120]: I0316 16:33:35.077471 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ch8q6\" (UniqueName: \"kubernetes.io/projected/51f5578b-db33-480b-bced-d7472406f411-kube-api-access-ch8q6\") pod \"51f5578b-db33-480b-bced-d7472406f411\" (UID: \"51f5578b-db33-480b-bced-d7472406f411\") " Mar 16 16:33:35 crc kubenswrapper[5120]: I0316 16:33:35.078380 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/51f5578b-db33-480b-bced-d7472406f411-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "51f5578b-db33-480b-bced-d7472406f411" (UID: "51f5578b-db33-480b-bced-d7472406f411"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:33:35 crc kubenswrapper[5120]: I0316 16:33:35.081517 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:33:35 crc kubenswrapper[5120]: I0316 16:33:35.081569 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51f5578b-db33-480b-bced-d7472406f411-kube-api-access-ch8q6" (OuterVolumeSpecName: "kube-api-access-ch8q6") pod "51f5578b-db33-480b-bced-d7472406f411" (UID: "51f5578b-db33-480b-bced-d7472406f411"). InnerVolumeSpecName "kube-api-access-ch8q6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:33:35 crc kubenswrapper[5120]: I0316 16:33:35.180655 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/51f5578b-db33-480b-bced-d7472406f411-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:33:35 crc kubenswrapper[5120]: I0316 16:33:35.180981 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ch8q6\" (UniqueName: \"kubernetes.io/projected/51f5578b-db33-480b-bced-d7472406f411-kube-api-access-ch8q6\") on node \"crc\" DevicePath \"\"" Mar 16 16:33:35 crc kubenswrapper[5120]: I0316 16:33:35.520054 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:33:35 crc kubenswrapper[5120]: W0316 16:33:35.523357 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podec6aab94_5ad4_4bd4_b657_108802dfb9b3.slice/crio-eee1a9deb10a038dde26ac231698c47c2769a5cb63c74f240eae25d3d016537d WatchSource:0}: Error finding container eee1a9deb10a038dde26ac231698c47c2769a5cb63c74f240eae25d3d016537d: Status 404 returned error can't find the container with id eee1a9deb10a038dde26ac231698c47c2769a5cb63c74f240eae25d3d016537d Mar 16 16:33:35 crc kubenswrapper[5120]: I0316 16:33:35.629090 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-db-create-p6mhd" Mar 16 16:33:35 crc kubenswrapper[5120]: I0316 16:33:35.629108 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-db-create-p6mhd" event={"ID":"51f5578b-db33-480b-bced-d7472406f411","Type":"ContainerDied","Data":"153b9a1dc5cd3049056877c6b26177231db67c35be7539e132ad47047f1235c8"} Mar 16 16:33:35 crc kubenswrapper[5120]: I0316 16:33:35.629160 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="153b9a1dc5cd3049056877c6b26177231db67c35be7539e132ad47047f1235c8" Mar 16 16:33:35 crc kubenswrapper[5120]: I0316 16:33:35.630335 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ec6aab94-5ad4-4bd4-b657-108802dfb9b3","Type":"ContainerStarted","Data":"eee1a9deb10a038dde26ac231698c47c2769a5cb63c74f240eae25d3d016537d"} Mar 16 16:33:35 crc kubenswrapper[5120]: I0316 16:33:35.996092 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-207b-account-create-update-7vtdj" Mar 16 16:33:36 crc kubenswrapper[5120]: I0316 16:33:36.105626 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nddxz\" (UniqueName: \"kubernetes.io/projected/d82588c0-32ac-4ba3-b73b-23395c68fc07-kube-api-access-nddxz\") pod \"d82588c0-32ac-4ba3-b73b-23395c68fc07\" (UID: \"d82588c0-32ac-4ba3-b73b-23395c68fc07\") " Mar 16 16:33:36 crc kubenswrapper[5120]: I0316 16:33:36.106248 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d82588c0-32ac-4ba3-b73b-23395c68fc07-operator-scripts\") pod \"d82588c0-32ac-4ba3-b73b-23395c68fc07\" (UID: \"d82588c0-32ac-4ba3-b73b-23395c68fc07\") " Mar 16 16:33:36 crc kubenswrapper[5120]: I0316 16:33:36.107679 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d82588c0-32ac-4ba3-b73b-23395c68fc07-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "d82588c0-32ac-4ba3-b73b-23395c68fc07" (UID: "d82588c0-32ac-4ba3-b73b-23395c68fc07"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:33:36 crc kubenswrapper[5120]: I0316 16:33:36.111675 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d82588c0-32ac-4ba3-b73b-23395c68fc07-kube-api-access-nddxz" (OuterVolumeSpecName: "kube-api-access-nddxz") pod "d82588c0-32ac-4ba3-b73b-23395c68fc07" (UID: "d82588c0-32ac-4ba3-b73b-23395c68fc07"). InnerVolumeSpecName "kube-api-access-nddxz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:33:36 crc kubenswrapper[5120]: I0316 16:33:36.201432 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-db-create-mddwp" Mar 16 16:33:36 crc kubenswrapper[5120]: I0316 16:33:36.209364 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nddxz\" (UniqueName: \"kubernetes.io/projected/d82588c0-32ac-4ba3-b73b-23395c68fc07-kube-api-access-nddxz\") on node \"crc\" DevicePath \"\"" Mar 16 16:33:36 crc kubenswrapper[5120]: I0316 16:33:36.209410 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d82588c0-32ac-4ba3-b73b-23395c68fc07-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:33:36 crc kubenswrapper[5120]: I0316 16:33:36.222350 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-a054-account-create-update-hfxct" Mar 16 16:33:36 crc kubenswrapper[5120]: I0316 16:33:36.249895 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-8044-account-create-update-hd6hq" Mar 16 16:33:36 crc kubenswrapper[5120]: I0316 16:33:36.260559 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-db-create-pnmcl" Mar 16 16:33:36 crc kubenswrapper[5120]: I0316 16:33:36.310269 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wqgx9\" (UniqueName: \"kubernetes.io/projected/b417595b-2cb6-4a24-960d-c1d717a3238d-kube-api-access-wqgx9\") pod \"b417595b-2cb6-4a24-960d-c1d717a3238d\" (UID: \"b417595b-2cb6-4a24-960d-c1d717a3238d\") " Mar 16 16:33:36 crc kubenswrapper[5120]: I0316 16:33:36.310372 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b417595b-2cb6-4a24-960d-c1d717a3238d-operator-scripts\") pod \"b417595b-2cb6-4a24-960d-c1d717a3238d\" (UID: \"b417595b-2cb6-4a24-960d-c1d717a3238d\") " Mar 16 16:33:36 crc kubenswrapper[5120]: I0316 16:33:36.310490 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q6pk6\" (UniqueName: \"kubernetes.io/projected/a43b68af-dd50-4ff9-847a-45a6f48d7193-kube-api-access-q6pk6\") pod \"a43b68af-dd50-4ff9-847a-45a6f48d7193\" (UID: \"a43b68af-dd50-4ff9-847a-45a6f48d7193\") " Mar 16 16:33:36 crc kubenswrapper[5120]: I0316 16:33:36.310573 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ad1d93e8-5bf9-4703-b308-9fff8ba5aa04-operator-scripts\") pod \"ad1d93e8-5bf9-4703-b308-9fff8ba5aa04\" (UID: \"ad1d93e8-5bf9-4703-b308-9fff8ba5aa04\") " Mar 16 16:33:36 crc kubenswrapper[5120]: I0316 16:33:36.310666 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e553ce53-4668-4c11-b0e1-65cc12d6f455-operator-scripts\") pod \"e553ce53-4668-4c11-b0e1-65cc12d6f455\" (UID: \"e553ce53-4668-4c11-b0e1-65cc12d6f455\") " Mar 16 16:33:36 crc kubenswrapper[5120]: I0316 16:33:36.310892 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a43b68af-dd50-4ff9-847a-45a6f48d7193-operator-scripts\") pod \"a43b68af-dd50-4ff9-847a-45a6f48d7193\" (UID: \"a43b68af-dd50-4ff9-847a-45a6f48d7193\") " Mar 16 16:33:36 crc kubenswrapper[5120]: I0316 16:33:36.310927 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5chfq\" (UniqueName: \"kubernetes.io/projected/e553ce53-4668-4c11-b0e1-65cc12d6f455-kube-api-access-5chfq\") pod \"e553ce53-4668-4c11-b0e1-65cc12d6f455\" (UID: \"e553ce53-4668-4c11-b0e1-65cc12d6f455\") " Mar 16 16:33:36 crc kubenswrapper[5120]: I0316 16:33:36.311019 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p8445\" (UniqueName: \"kubernetes.io/projected/ad1d93e8-5bf9-4703-b308-9fff8ba5aa04-kube-api-access-p8445\") pod \"ad1d93e8-5bf9-4703-b308-9fff8ba5aa04\" (UID: \"ad1d93e8-5bf9-4703-b308-9fff8ba5aa04\") " Mar 16 16:33:36 crc kubenswrapper[5120]: I0316 16:33:36.311206 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b417595b-2cb6-4a24-960d-c1d717a3238d-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "b417595b-2cb6-4a24-960d-c1d717a3238d" (UID: "b417595b-2cb6-4a24-960d-c1d717a3238d"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:33:36 crc kubenswrapper[5120]: I0316 16:33:36.312002 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b417595b-2cb6-4a24-960d-c1d717a3238d-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:33:36 crc kubenswrapper[5120]: I0316 16:33:36.312265 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e553ce53-4668-4c11-b0e1-65cc12d6f455-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "e553ce53-4668-4c11-b0e1-65cc12d6f455" (UID: "e553ce53-4668-4c11-b0e1-65cc12d6f455"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:33:36 crc kubenswrapper[5120]: I0316 16:33:36.312312 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a43b68af-dd50-4ff9-847a-45a6f48d7193-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "a43b68af-dd50-4ff9-847a-45a6f48d7193" (UID: "a43b68af-dd50-4ff9-847a-45a6f48d7193"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:33:36 crc kubenswrapper[5120]: I0316 16:33:36.312603 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ad1d93e8-5bf9-4703-b308-9fff8ba5aa04-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "ad1d93e8-5bf9-4703-b308-9fff8ba5aa04" (UID: "ad1d93e8-5bf9-4703-b308-9fff8ba5aa04"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:33:36 crc kubenswrapper[5120]: I0316 16:33:36.315629 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b417595b-2cb6-4a24-960d-c1d717a3238d-kube-api-access-wqgx9" (OuterVolumeSpecName: "kube-api-access-wqgx9") pod "b417595b-2cb6-4a24-960d-c1d717a3238d" (UID: "b417595b-2cb6-4a24-960d-c1d717a3238d"). InnerVolumeSpecName "kube-api-access-wqgx9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:33:36 crc kubenswrapper[5120]: I0316 16:33:36.316186 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a43b68af-dd50-4ff9-847a-45a6f48d7193-kube-api-access-q6pk6" (OuterVolumeSpecName: "kube-api-access-q6pk6") pod "a43b68af-dd50-4ff9-847a-45a6f48d7193" (UID: "a43b68af-dd50-4ff9-847a-45a6f48d7193"). InnerVolumeSpecName "kube-api-access-q6pk6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:33:36 crc kubenswrapper[5120]: I0316 16:33:36.316382 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad1d93e8-5bf9-4703-b308-9fff8ba5aa04-kube-api-access-p8445" (OuterVolumeSpecName: "kube-api-access-p8445") pod "ad1d93e8-5bf9-4703-b308-9fff8ba5aa04" (UID: "ad1d93e8-5bf9-4703-b308-9fff8ba5aa04"). InnerVolumeSpecName "kube-api-access-p8445". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:33:36 crc kubenswrapper[5120]: I0316 16:33:36.317958 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e553ce53-4668-4c11-b0e1-65cc12d6f455-kube-api-access-5chfq" (OuterVolumeSpecName: "kube-api-access-5chfq") pod "e553ce53-4668-4c11-b0e1-65cc12d6f455" (UID: "e553ce53-4668-4c11-b0e1-65cc12d6f455"). InnerVolumeSpecName "kube-api-access-5chfq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:33:36 crc kubenswrapper[5120]: I0316 16:33:36.422691 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ad1d93e8-5bf9-4703-b308-9fff8ba5aa04-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:33:36 crc kubenswrapper[5120]: I0316 16:33:36.423031 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e553ce53-4668-4c11-b0e1-65cc12d6f455-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:33:36 crc kubenswrapper[5120]: I0316 16:33:36.423146 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a43b68af-dd50-4ff9-847a-45a6f48d7193-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:33:36 crc kubenswrapper[5120]: I0316 16:33:36.423248 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5chfq\" (UniqueName: \"kubernetes.io/projected/e553ce53-4668-4c11-b0e1-65cc12d6f455-kube-api-access-5chfq\") on node \"crc\" DevicePath \"\"" Mar 16 16:33:36 crc kubenswrapper[5120]: I0316 16:33:36.423342 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p8445\" (UniqueName: \"kubernetes.io/projected/ad1d93e8-5bf9-4703-b308-9fff8ba5aa04-kube-api-access-p8445\") on node \"crc\" DevicePath \"\"" Mar 16 16:33:36 crc kubenswrapper[5120]: I0316 16:33:36.423437 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wqgx9\" (UniqueName: \"kubernetes.io/projected/b417595b-2cb6-4a24-960d-c1d717a3238d-kube-api-access-wqgx9\") on node \"crc\" DevicePath \"\"" Mar 16 16:33:36 crc kubenswrapper[5120]: I0316 16:33:36.423537 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q6pk6\" (UniqueName: \"kubernetes.io/projected/a43b68af-dd50-4ff9-847a-45a6f48d7193-kube-api-access-q6pk6\") on node \"crc\" DevicePath \"\"" Mar 16 16:33:36 crc kubenswrapper[5120]: I0316 16:33:36.641748 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-db-create-mddwp" event={"ID":"ad1d93e8-5bf9-4703-b308-9fff8ba5aa04","Type":"ContainerDied","Data":"dc20f6d0b9ddcdd4eb5840c181993af7dc76ab28b88caa50d601812247461a83"} Mar 16 16:33:36 crc kubenswrapper[5120]: I0316 16:33:36.641811 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dc20f6d0b9ddcdd4eb5840c181993af7dc76ab28b88caa50d601812247461a83" Mar 16 16:33:36 crc kubenswrapper[5120]: I0316 16:33:36.641908 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-db-create-mddwp" Mar 16 16:33:36 crc kubenswrapper[5120]: I0316 16:33:36.644734 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-a054-account-create-update-hfxct" Mar 16 16:33:36 crc kubenswrapper[5120]: I0316 16:33:36.644726 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-a054-account-create-update-hfxct" event={"ID":"b417595b-2cb6-4a24-960d-c1d717a3238d","Type":"ContainerDied","Data":"da42208ca834b5faf4cfe6eadc785d8123014fb3fb8d12b92c7d0fbc6e853a7a"} Mar 16 16:33:36 crc kubenswrapper[5120]: I0316 16:33:36.644859 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="da42208ca834b5faf4cfe6eadc785d8123014fb3fb8d12b92c7d0fbc6e853a7a" Mar 16 16:33:36 crc kubenswrapper[5120]: I0316 16:33:36.646516 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ec6aab94-5ad4-4bd4-b657-108802dfb9b3","Type":"ContainerStarted","Data":"d014128265c58b9b2b8c6dfd16f8aceeab1f67c108a5c1e9e0955c516bed6cf8"} Mar 16 16:33:36 crc kubenswrapper[5120]: I0316 16:33:36.648062 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-207b-account-create-update-7vtdj" Mar 16 16:33:36 crc kubenswrapper[5120]: I0316 16:33:36.648149 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-207b-account-create-update-7vtdj" event={"ID":"d82588c0-32ac-4ba3-b73b-23395c68fc07","Type":"ContainerDied","Data":"90773ae1ea5f427796f4c392525fee5dda1f13708f1e751d0ede71e660584cb1"} Mar 16 16:33:36 crc kubenswrapper[5120]: I0316 16:33:36.648176 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="90773ae1ea5f427796f4c392525fee5dda1f13708f1e751d0ede71e660584cb1" Mar 16 16:33:36 crc kubenswrapper[5120]: I0316 16:33:36.650368 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-8044-account-create-update-hd6hq" event={"ID":"a43b68af-dd50-4ff9-847a-45a6f48d7193","Type":"ContainerDied","Data":"87a69a2180feccfae16e4f21b187700904307d7d4ca1e906811fcfcd3dafd78e"} Mar 16 16:33:36 crc kubenswrapper[5120]: I0316 16:33:36.650523 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="87a69a2180feccfae16e4f21b187700904307d7d4ca1e906811fcfcd3dafd78e" Mar 16 16:33:36 crc kubenswrapper[5120]: I0316 16:33:36.650714 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-8044-account-create-update-hd6hq" Mar 16 16:33:36 crc kubenswrapper[5120]: I0316 16:33:36.655119 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-db-create-pnmcl" event={"ID":"e553ce53-4668-4c11-b0e1-65cc12d6f455","Type":"ContainerDied","Data":"82428b4ea2a32bd739ea64a3c3e51e72c62fd4b1ff5bb2c784cf6ab1278903a4"} Mar 16 16:33:36 crc kubenswrapper[5120]: I0316 16:33:36.655249 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="82428b4ea2a32bd739ea64a3c3e51e72c62fd4b1ff5bb2c784cf6ab1278903a4" Mar 16 16:33:36 crc kubenswrapper[5120]: I0316 16:33:36.655338 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-db-create-pnmcl" Mar 16 16:33:36 crc kubenswrapper[5120]: I0316 16:33:36.682303 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="67fe9146-c519-453c-8f10-76ae241f8889" path="/var/lib/kubelet/pods/67fe9146-c519-453c-8f10-76ae241f8889/volumes" Mar 16 16:33:37 crc kubenswrapper[5120]: I0316 16:33:37.669239 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ec6aab94-5ad4-4bd4-b657-108802dfb9b3","Type":"ContainerStarted","Data":"211d6d5a1e4fb22ed4a4ddee5aaa11d4309e56c2dfc4fa52d6b7976e13e48bbc"} Mar 16 16:33:38 crc kubenswrapper[5120]: I0316 16:33:38.589037 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/swift-proxy-598db64bc5-jp86s" Mar 16 16:33:38 crc kubenswrapper[5120]: I0316 16:33:38.593081 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/swift-proxy-598db64bc5-jp86s" Mar 16 16:33:38 crc kubenswrapper[5120]: I0316 16:33:38.664346 5120 scope.go:117] "RemoveContainer" containerID="0a15d5caff30dc8885f782e59962af7d98d58b39ab76059e56e5827e10e7ab8b" Mar 16 16:33:38 crc kubenswrapper[5120]: E0316 16:33:38.664548 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:33:38 crc kubenswrapper[5120]: I0316 16:33:38.708982 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ec6aab94-5ad4-4bd4-b657-108802dfb9b3","Type":"ContainerStarted","Data":"0fc2bf9f81abb6bf6c20e102c82297189eabc046994f3dea24d7304be0bedd78"} Mar 16 16:33:40 crc kubenswrapper[5120]: I0316 16:33:40.400891 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:33:40 crc kubenswrapper[5120]: I0316 16:33:40.728688 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ec6aab94-5ad4-4bd4-b657-108802dfb9b3","Type":"ContainerStarted","Data":"c7776680ac2791ab2d16c46163296cf0775717ab1a8eb2b6e5bb8f0972a347e0"} Mar 16 16:33:40 crc kubenswrapper[5120]: I0316 16:33:40.730148 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:33:40 crc kubenswrapper[5120]: I0316 16:33:40.760791 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.571081275 podStartE2EDuration="6.760771786s" podCreationTimestamp="2026-03-16 16:33:34 +0000 UTC" firstStartedPulling="2026-03-16 16:33:35.524901232 +0000 UTC m=+3717.678832889" lastFinishedPulling="2026-03-16 16:33:39.714591733 +0000 UTC m=+3721.868523400" observedRunningTime="2026-03-16 16:33:40.751817571 +0000 UTC m=+3722.905749258" watchObservedRunningTime="2026-03-16 16:33:40.760771786 +0000 UTC m=+3722.914703463" Mar 16 16:33:41 crc kubenswrapper[5120]: I0316 16:33:41.739072 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="ec6aab94-5ad4-4bd4-b657-108802dfb9b3" containerName="ceilometer-central-agent" containerID="cri-o://d014128265c58b9b2b8c6dfd16f8aceeab1f67c108a5c1e9e0955c516bed6cf8" gracePeriod=30 Mar 16 16:33:41 crc kubenswrapper[5120]: I0316 16:33:41.739167 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="ec6aab94-5ad4-4bd4-b657-108802dfb9b3" containerName="sg-core" containerID="cri-o://0fc2bf9f81abb6bf6c20e102c82297189eabc046994f3dea24d7304be0bedd78" gracePeriod=30 Mar 16 16:33:41 crc kubenswrapper[5120]: I0316 16:33:41.739138 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="ec6aab94-5ad4-4bd4-b657-108802dfb9b3" containerName="proxy-httpd" containerID="cri-o://c7776680ac2791ab2d16c46163296cf0775717ab1a8eb2b6e5bb8f0972a347e0" gracePeriod=30 Mar 16 16:33:41 crc kubenswrapper[5120]: I0316 16:33:41.739184 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="ec6aab94-5ad4-4bd4-b657-108802dfb9b3" containerName="ceilometer-notification-agent" containerID="cri-o://211d6d5a1e4fb22ed4a4ddee5aaa11d4309e56c2dfc4fa52d6b7976e13e48bbc" gracePeriod=30 Mar 16 16:33:42 crc kubenswrapper[5120]: I0316 16:33:42.176598 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-s66xx"] Mar 16 16:33:42 crc kubenswrapper[5120]: I0316 16:33:42.178821 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e553ce53-4668-4c11-b0e1-65cc12d6f455" containerName="mariadb-database-create" Mar 16 16:33:42 crc kubenswrapper[5120]: I0316 16:33:42.178924 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e553ce53-4668-4c11-b0e1-65cc12d6f455" containerName="mariadb-database-create" Mar 16 16:33:42 crc kubenswrapper[5120]: I0316 16:33:42.178989 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad1d93e8-5bf9-4703-b308-9fff8ba5aa04" containerName="mariadb-database-create" Mar 16 16:33:42 crc kubenswrapper[5120]: I0316 16:33:42.179064 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad1d93e8-5bf9-4703-b308-9fff8ba5aa04" containerName="mariadb-database-create" Mar 16 16:33:42 crc kubenswrapper[5120]: I0316 16:33:42.179143 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51f5578b-db33-480b-bced-d7472406f411" containerName="mariadb-database-create" Mar 16 16:33:42 crc kubenswrapper[5120]: I0316 16:33:42.179204 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="51f5578b-db33-480b-bced-d7472406f411" containerName="mariadb-database-create" Mar 16 16:33:42 crc kubenswrapper[5120]: I0316 16:33:42.179292 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d82588c0-32ac-4ba3-b73b-23395c68fc07" containerName="mariadb-account-create-update" Mar 16 16:33:42 crc kubenswrapper[5120]: I0316 16:33:42.179359 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="d82588c0-32ac-4ba3-b73b-23395c68fc07" containerName="mariadb-account-create-update" Mar 16 16:33:42 crc kubenswrapper[5120]: I0316 16:33:42.179415 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b417595b-2cb6-4a24-960d-c1d717a3238d" containerName="mariadb-account-create-update" Mar 16 16:33:42 crc kubenswrapper[5120]: I0316 16:33:42.179475 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="b417595b-2cb6-4a24-960d-c1d717a3238d" containerName="mariadb-account-create-update" Mar 16 16:33:42 crc kubenswrapper[5120]: I0316 16:33:42.179573 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a43b68af-dd50-4ff9-847a-45a6f48d7193" containerName="mariadb-account-create-update" Mar 16 16:33:42 crc kubenswrapper[5120]: I0316 16:33:42.179630 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a43b68af-dd50-4ff9-847a-45a6f48d7193" containerName="mariadb-account-create-update" Mar 16 16:33:42 crc kubenswrapper[5120]: I0316 16:33:42.180042 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ad1d93e8-5bf9-4703-b308-9fff8ba5aa04" containerName="mariadb-database-create" Mar 16 16:33:42 crc kubenswrapper[5120]: I0316 16:33:42.180132 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="51f5578b-db33-480b-bced-d7472406f411" containerName="mariadb-database-create" Mar 16 16:33:42 crc kubenswrapper[5120]: I0316 16:33:42.180204 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="d82588c0-32ac-4ba3-b73b-23395c68fc07" containerName="mariadb-account-create-update" Mar 16 16:33:42 crc kubenswrapper[5120]: I0316 16:33:42.180287 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="a43b68af-dd50-4ff9-847a-45a6f48d7193" containerName="mariadb-account-create-update" Mar 16 16:33:42 crc kubenswrapper[5120]: I0316 16:33:42.180352 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="b417595b-2cb6-4a24-960d-c1d717a3238d" containerName="mariadb-account-create-update" Mar 16 16:33:42 crc kubenswrapper[5120]: I0316 16:33:42.180415 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e553ce53-4668-4c11-b0e1-65cc12d6f455" containerName="mariadb-database-create" Mar 16 16:33:42 crc kubenswrapper[5120]: I0316 16:33:42.188209 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-s66xx" Mar 16 16:33:42 crc kubenswrapper[5120]: I0316 16:33:42.192209 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-nova-dockercfg-82lps\"" Mar 16 16:33:42 crc kubenswrapper[5120]: I0316 16:33:42.192410 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-conductor-config-data\"" Mar 16 16:33:42 crc kubenswrapper[5120]: I0316 16:33:42.192528 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-conductor-scripts\"" Mar 16 16:33:42 crc kubenswrapper[5120]: I0316 16:33:42.201486 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-s66xx"] Mar 16 16:33:42 crc kubenswrapper[5120]: I0316 16:33:42.272437 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thg99\" (UniqueName: \"kubernetes.io/projected/8bdf17ec-c07e-48a9-b713-e065819e9978-kube-api-access-thg99\") pod \"nova-cell0-conductor-db-sync-s66xx\" (UID: \"8bdf17ec-c07e-48a9-b713-e065819e9978\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-s66xx" Mar 16 16:33:42 crc kubenswrapper[5120]: I0316 16:33:42.272544 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8bdf17ec-c07e-48a9-b713-e065819e9978-combined-ca-bundle\") pod \"nova-cell0-conductor-db-sync-s66xx\" (UID: \"8bdf17ec-c07e-48a9-b713-e065819e9978\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-s66xx" Mar 16 16:33:42 crc kubenswrapper[5120]: I0316 16:33:42.272602 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8bdf17ec-c07e-48a9-b713-e065819e9978-scripts\") pod \"nova-cell0-conductor-db-sync-s66xx\" (UID: \"8bdf17ec-c07e-48a9-b713-e065819e9978\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-s66xx" Mar 16 16:33:42 crc kubenswrapper[5120]: I0316 16:33:42.272869 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8bdf17ec-c07e-48a9-b713-e065819e9978-config-data\") pod \"nova-cell0-conductor-db-sync-s66xx\" (UID: \"8bdf17ec-c07e-48a9-b713-e065819e9978\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-s66xx" Mar 16 16:33:42 crc kubenswrapper[5120]: I0316 16:33:42.374967 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8bdf17ec-c07e-48a9-b713-e065819e9978-config-data\") pod \"nova-cell0-conductor-db-sync-s66xx\" (UID: \"8bdf17ec-c07e-48a9-b713-e065819e9978\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-s66xx" Mar 16 16:33:42 crc kubenswrapper[5120]: I0316 16:33:42.375234 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-thg99\" (UniqueName: \"kubernetes.io/projected/8bdf17ec-c07e-48a9-b713-e065819e9978-kube-api-access-thg99\") pod \"nova-cell0-conductor-db-sync-s66xx\" (UID: \"8bdf17ec-c07e-48a9-b713-e065819e9978\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-s66xx" Mar 16 16:33:42 crc kubenswrapper[5120]: I0316 16:33:42.375292 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8bdf17ec-c07e-48a9-b713-e065819e9978-combined-ca-bundle\") pod \"nova-cell0-conductor-db-sync-s66xx\" (UID: \"8bdf17ec-c07e-48a9-b713-e065819e9978\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-s66xx" Mar 16 16:33:42 crc kubenswrapper[5120]: I0316 16:33:42.375332 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8bdf17ec-c07e-48a9-b713-e065819e9978-scripts\") pod \"nova-cell0-conductor-db-sync-s66xx\" (UID: \"8bdf17ec-c07e-48a9-b713-e065819e9978\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-s66xx" Mar 16 16:33:42 crc kubenswrapper[5120]: I0316 16:33:42.383068 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8bdf17ec-c07e-48a9-b713-e065819e9978-config-data\") pod \"nova-cell0-conductor-db-sync-s66xx\" (UID: \"8bdf17ec-c07e-48a9-b713-e065819e9978\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-s66xx" Mar 16 16:33:42 crc kubenswrapper[5120]: I0316 16:33:42.385277 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8bdf17ec-c07e-48a9-b713-e065819e9978-scripts\") pod \"nova-cell0-conductor-db-sync-s66xx\" (UID: \"8bdf17ec-c07e-48a9-b713-e065819e9978\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-s66xx" Mar 16 16:33:42 crc kubenswrapper[5120]: I0316 16:33:42.385680 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8bdf17ec-c07e-48a9-b713-e065819e9978-combined-ca-bundle\") pod \"nova-cell0-conductor-db-sync-s66xx\" (UID: \"8bdf17ec-c07e-48a9-b713-e065819e9978\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-s66xx" Mar 16 16:33:42 crc kubenswrapper[5120]: I0316 16:33:42.394196 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-thg99\" (UniqueName: \"kubernetes.io/projected/8bdf17ec-c07e-48a9-b713-e065819e9978-kube-api-access-thg99\") pod \"nova-cell0-conductor-db-sync-s66xx\" (UID: \"8bdf17ec-c07e-48a9-b713-e065819e9978\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-s66xx" Mar 16 16:33:42 crc kubenswrapper[5120]: I0316 16:33:42.524335 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-s66xx" Mar 16 16:33:42 crc kubenswrapper[5120]: I0316 16:33:42.753129 5120 generic.go:358] "Generic (PLEG): container finished" podID="ec6aab94-5ad4-4bd4-b657-108802dfb9b3" containerID="c7776680ac2791ab2d16c46163296cf0775717ab1a8eb2b6e5bb8f0972a347e0" exitCode=0 Mar 16 16:33:42 crc kubenswrapper[5120]: I0316 16:33:42.753498 5120 generic.go:358] "Generic (PLEG): container finished" podID="ec6aab94-5ad4-4bd4-b657-108802dfb9b3" containerID="0fc2bf9f81abb6bf6c20e102c82297189eabc046994f3dea24d7304be0bedd78" exitCode=2 Mar 16 16:33:42 crc kubenswrapper[5120]: I0316 16:33:42.753507 5120 generic.go:358] "Generic (PLEG): container finished" podID="ec6aab94-5ad4-4bd4-b657-108802dfb9b3" containerID="211d6d5a1e4fb22ed4a4ddee5aaa11d4309e56c2dfc4fa52d6b7976e13e48bbc" exitCode=0 Mar 16 16:33:42 crc kubenswrapper[5120]: I0316 16:33:42.754013 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ec6aab94-5ad4-4bd4-b657-108802dfb9b3","Type":"ContainerDied","Data":"c7776680ac2791ab2d16c46163296cf0775717ab1a8eb2b6e5bb8f0972a347e0"} Mar 16 16:33:42 crc kubenswrapper[5120]: I0316 16:33:42.754074 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ec6aab94-5ad4-4bd4-b657-108802dfb9b3","Type":"ContainerDied","Data":"0fc2bf9f81abb6bf6c20e102c82297189eabc046994f3dea24d7304be0bedd78"} Mar 16 16:33:42 crc kubenswrapper[5120]: I0316 16:33:42.754089 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ec6aab94-5ad4-4bd4-b657-108802dfb9b3","Type":"ContainerDied","Data":"211d6d5a1e4fb22ed4a4ddee5aaa11d4309e56c2dfc4fa52d6b7976e13e48bbc"} Mar 16 16:33:42 crc kubenswrapper[5120]: I0316 16:33:42.973847 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-s66xx"] Mar 16 16:33:42 crc kubenswrapper[5120]: W0316 16:33:42.988886 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8bdf17ec_c07e_48a9_b713_e065819e9978.slice/crio-135f5138538e6f3dfed2e1beb4b86f34e530e9bc99a6b9f4179af43326d1e522 WatchSource:0}: Error finding container 135f5138538e6f3dfed2e1beb4b86f34e530e9bc99a6b9f4179af43326d1e522: Status 404 returned error can't find the container with id 135f5138538e6f3dfed2e1beb4b86f34e530e9bc99a6b9f4179af43326d1e522 Mar 16 16:33:43 crc kubenswrapper[5120]: I0316 16:33:43.766049 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-s66xx" event={"ID":"8bdf17ec-c07e-48a9-b713-e065819e9978","Type":"ContainerStarted","Data":"1d054768b62c314b704f4287a575c43e550c03ae01ecc0e24f377fdbbace0e63"} Mar 16 16:33:43 crc kubenswrapper[5120]: I0316 16:33:43.766377 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-s66xx" event={"ID":"8bdf17ec-c07e-48a9-b713-e065819e9978","Type":"ContainerStarted","Data":"135f5138538e6f3dfed2e1beb4b86f34e530e9bc99a6b9f4179af43326d1e522"} Mar 16 16:33:43 crc kubenswrapper[5120]: I0316 16:33:43.782066 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-s66xx" podStartSLOduration=1.782049776 podStartE2EDuration="1.782049776s" podCreationTimestamp="2026-03-16 16:33:42 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:33:43.778654557 +0000 UTC m=+3725.932586214" watchObservedRunningTime="2026-03-16 16:33:43.782049776 +0000 UTC m=+3725.935981433" Mar 16 16:33:46 crc kubenswrapper[5120]: I0316 16:33:46.280342 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:33:46 crc kubenswrapper[5120]: I0316 16:33:46.281016 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="e0796e9e-184f-47cc-b5b7-5c06434a59a6" containerName="glance-log" containerID="cri-o://e51b5d7a1b22fbe662527e006b5f92746058cd54fdd5f8dd5fc011441296b073" gracePeriod=30 Mar 16 16:33:46 crc kubenswrapper[5120]: I0316 16:33:46.281173 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="e0796e9e-184f-47cc-b5b7-5c06434a59a6" containerName="glance-httpd" containerID="cri-o://e08499fa0045d74d6308fba6c5956ff25d0913010b386b67319bd167e2fc0938" gracePeriod=30 Mar 16 16:33:46 crc kubenswrapper[5120]: I0316 16:33:46.799484 5120 generic.go:358] "Generic (PLEG): container finished" podID="ec6aab94-5ad4-4bd4-b657-108802dfb9b3" containerID="d014128265c58b9b2b8c6dfd16f8aceeab1f67c108a5c1e9e0955c516bed6cf8" exitCode=0 Mar 16 16:33:46 crc kubenswrapper[5120]: I0316 16:33:46.799587 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ec6aab94-5ad4-4bd4-b657-108802dfb9b3","Type":"ContainerDied","Data":"d014128265c58b9b2b8c6dfd16f8aceeab1f67c108a5c1e9e0955c516bed6cf8"} Mar 16 16:33:46 crc kubenswrapper[5120]: I0316 16:33:46.803015 5120 generic.go:358] "Generic (PLEG): container finished" podID="e0796e9e-184f-47cc-b5b7-5c06434a59a6" containerID="e51b5d7a1b22fbe662527e006b5f92746058cd54fdd5f8dd5fc011441296b073" exitCode=143 Mar 16 16:33:46 crc kubenswrapper[5120]: I0316 16:33:46.803525 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"e0796e9e-184f-47cc-b5b7-5c06434a59a6","Type":"ContainerDied","Data":"e51b5d7a1b22fbe662527e006b5f92746058cd54fdd5f8dd5fc011441296b073"} Mar 16 16:33:46 crc kubenswrapper[5120]: I0316 16:33:46.968361 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:33:47 crc kubenswrapper[5120]: I0316 16:33:47.081882 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/ec6aab94-5ad4-4bd4-b657-108802dfb9b3-sg-core-conf-yaml\") pod \"ec6aab94-5ad4-4bd4-b657-108802dfb9b3\" (UID: \"ec6aab94-5ad4-4bd4-b657-108802dfb9b3\") " Mar 16 16:33:47 crc kubenswrapper[5120]: I0316 16:33:47.082290 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ec6aab94-5ad4-4bd4-b657-108802dfb9b3-config-data\") pod \"ec6aab94-5ad4-4bd4-b657-108802dfb9b3\" (UID: \"ec6aab94-5ad4-4bd4-b657-108802dfb9b3\") " Mar 16 16:33:47 crc kubenswrapper[5120]: I0316 16:33:47.082402 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ec6aab94-5ad4-4bd4-b657-108802dfb9b3-scripts\") pod \"ec6aab94-5ad4-4bd4-b657-108802dfb9b3\" (UID: \"ec6aab94-5ad4-4bd4-b657-108802dfb9b3\") " Mar 16 16:33:47 crc kubenswrapper[5120]: I0316 16:33:47.082717 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jnrmc\" (UniqueName: \"kubernetes.io/projected/ec6aab94-5ad4-4bd4-b657-108802dfb9b3-kube-api-access-jnrmc\") pod \"ec6aab94-5ad4-4bd4-b657-108802dfb9b3\" (UID: \"ec6aab94-5ad4-4bd4-b657-108802dfb9b3\") " Mar 16 16:33:47 crc kubenswrapper[5120]: I0316 16:33:47.082859 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ec6aab94-5ad4-4bd4-b657-108802dfb9b3-run-httpd\") pod \"ec6aab94-5ad4-4bd4-b657-108802dfb9b3\" (UID: \"ec6aab94-5ad4-4bd4-b657-108802dfb9b3\") " Mar 16 16:33:47 crc kubenswrapper[5120]: I0316 16:33:47.082972 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ec6aab94-5ad4-4bd4-b657-108802dfb9b3-log-httpd\") pod \"ec6aab94-5ad4-4bd4-b657-108802dfb9b3\" (UID: \"ec6aab94-5ad4-4bd4-b657-108802dfb9b3\") " Mar 16 16:33:47 crc kubenswrapper[5120]: I0316 16:33:47.083029 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ec6aab94-5ad4-4bd4-b657-108802dfb9b3-combined-ca-bundle\") pod \"ec6aab94-5ad4-4bd4-b657-108802dfb9b3\" (UID: \"ec6aab94-5ad4-4bd4-b657-108802dfb9b3\") " Mar 16 16:33:47 crc kubenswrapper[5120]: I0316 16:33:47.083489 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec6aab94-5ad4-4bd4-b657-108802dfb9b3-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "ec6aab94-5ad4-4bd4-b657-108802dfb9b3" (UID: "ec6aab94-5ad4-4bd4-b657-108802dfb9b3"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:33:47 crc kubenswrapper[5120]: I0316 16:33:47.083518 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec6aab94-5ad4-4bd4-b657-108802dfb9b3-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "ec6aab94-5ad4-4bd4-b657-108802dfb9b3" (UID: "ec6aab94-5ad4-4bd4-b657-108802dfb9b3"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:33:47 crc kubenswrapper[5120]: I0316 16:33:47.084544 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ec6aab94-5ad4-4bd4-b657-108802dfb9b3-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:33:47 crc kubenswrapper[5120]: I0316 16:33:47.084575 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ec6aab94-5ad4-4bd4-b657-108802dfb9b3-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:33:47 crc kubenswrapper[5120]: I0316 16:33:47.089598 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec6aab94-5ad4-4bd4-b657-108802dfb9b3-kube-api-access-jnrmc" (OuterVolumeSpecName: "kube-api-access-jnrmc") pod "ec6aab94-5ad4-4bd4-b657-108802dfb9b3" (UID: "ec6aab94-5ad4-4bd4-b657-108802dfb9b3"). InnerVolumeSpecName "kube-api-access-jnrmc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:33:47 crc kubenswrapper[5120]: I0316 16:33:47.091279 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec6aab94-5ad4-4bd4-b657-108802dfb9b3-scripts" (OuterVolumeSpecName: "scripts") pod "ec6aab94-5ad4-4bd4-b657-108802dfb9b3" (UID: "ec6aab94-5ad4-4bd4-b657-108802dfb9b3"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:33:47 crc kubenswrapper[5120]: I0316 16:33:47.119639 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec6aab94-5ad4-4bd4-b657-108802dfb9b3-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "ec6aab94-5ad4-4bd4-b657-108802dfb9b3" (UID: "ec6aab94-5ad4-4bd4-b657-108802dfb9b3"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:33:47 crc kubenswrapper[5120]: I0316 16:33:47.178703 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec6aab94-5ad4-4bd4-b657-108802dfb9b3-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ec6aab94-5ad4-4bd4-b657-108802dfb9b3" (UID: "ec6aab94-5ad4-4bd4-b657-108802dfb9b3"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:33:47 crc kubenswrapper[5120]: I0316 16:33:47.186603 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jnrmc\" (UniqueName: \"kubernetes.io/projected/ec6aab94-5ad4-4bd4-b657-108802dfb9b3-kube-api-access-jnrmc\") on node \"crc\" DevicePath \"\"" Mar 16 16:33:47 crc kubenswrapper[5120]: I0316 16:33:47.186649 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ec6aab94-5ad4-4bd4-b657-108802dfb9b3-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:33:47 crc kubenswrapper[5120]: I0316 16:33:47.186658 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/ec6aab94-5ad4-4bd4-b657-108802dfb9b3-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 16:33:47 crc kubenswrapper[5120]: I0316 16:33:47.186667 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ec6aab94-5ad4-4bd4-b657-108802dfb9b3-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:33:47 crc kubenswrapper[5120]: I0316 16:33:47.194559 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec6aab94-5ad4-4bd4-b657-108802dfb9b3-config-data" (OuterVolumeSpecName: "config-data") pod "ec6aab94-5ad4-4bd4-b657-108802dfb9b3" (UID: "ec6aab94-5ad4-4bd4-b657-108802dfb9b3"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:33:47 crc kubenswrapper[5120]: I0316 16:33:47.275355 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:33:47 crc kubenswrapper[5120]: I0316 16:33:47.275638 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="66747957-79a6-4233-93a5-be994ddc995f" containerName="glance-log" containerID="cri-o://2f5cb2d85d3d7ce59d3c6313e0cfc9d1017f7d619e472d48c96c845d78895d5a" gracePeriod=30 Mar 16 16:33:47 crc kubenswrapper[5120]: I0316 16:33:47.275768 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="66747957-79a6-4233-93a5-be994ddc995f" containerName="glance-httpd" containerID="cri-o://912bd3364ca361d86430ef689160af954803620513e903e6bfbe209134858c72" gracePeriod=30 Mar 16 16:33:47 crc kubenswrapper[5120]: I0316 16:33:47.288960 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ec6aab94-5ad4-4bd4-b657-108802dfb9b3-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:33:47 crc kubenswrapper[5120]: I0316 16:33:47.308957 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/placement-6bc576559-vg8zd" Mar 16 16:33:47 crc kubenswrapper[5120]: I0316 16:33:47.832117 5120 generic.go:358] "Generic (PLEG): container finished" podID="66747957-79a6-4233-93a5-be994ddc995f" containerID="2f5cb2d85d3d7ce59d3c6313e0cfc9d1017f7d619e472d48c96c845d78895d5a" exitCode=143 Mar 16 16:33:47 crc kubenswrapper[5120]: I0316 16:33:47.833229 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"66747957-79a6-4233-93a5-be994ddc995f","Type":"ContainerDied","Data":"2f5cb2d85d3d7ce59d3c6313e0cfc9d1017f7d619e472d48c96c845d78895d5a"} Mar 16 16:33:47 crc kubenswrapper[5120]: I0316 16:33:47.838534 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ec6aab94-5ad4-4bd4-b657-108802dfb9b3","Type":"ContainerDied","Data":"eee1a9deb10a038dde26ac231698c47c2769a5cb63c74f240eae25d3d016537d"} Mar 16 16:33:47 crc kubenswrapper[5120]: I0316 16:33:47.838590 5120 scope.go:117] "RemoveContainer" containerID="c7776680ac2791ab2d16c46163296cf0775717ab1a8eb2b6e5bb8f0972a347e0" Mar 16 16:33:47 crc kubenswrapper[5120]: I0316 16:33:47.838816 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:33:47 crc kubenswrapper[5120]: I0316 16:33:47.870967 5120 scope.go:117] "RemoveContainer" containerID="0fc2bf9f81abb6bf6c20e102c82297189eabc046994f3dea24d7304be0bedd78" Mar 16 16:33:47 crc kubenswrapper[5120]: I0316 16:33:47.897166 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:33:47 crc kubenswrapper[5120]: I0316 16:33:47.914246 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:33:47 crc kubenswrapper[5120]: I0316 16:33:47.923200 5120 scope.go:117] "RemoveContainer" containerID="211d6d5a1e4fb22ed4a4ddee5aaa11d4309e56c2dfc4fa52d6b7976e13e48bbc" Mar 16 16:33:47 crc kubenswrapper[5120]: I0316 16:33:47.928191 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:33:47 crc kubenswrapper[5120]: I0316 16:33:47.930164 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec6aab94-5ad4-4bd4-b657-108802dfb9b3" containerName="ceilometer-central-agent" Mar 16 16:33:47 crc kubenswrapper[5120]: I0316 16:33:47.930203 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec6aab94-5ad4-4bd4-b657-108802dfb9b3" containerName="ceilometer-central-agent" Mar 16 16:33:47 crc kubenswrapper[5120]: I0316 16:33:47.930221 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec6aab94-5ad4-4bd4-b657-108802dfb9b3" containerName="proxy-httpd" Mar 16 16:33:47 crc kubenswrapper[5120]: I0316 16:33:47.930229 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec6aab94-5ad4-4bd4-b657-108802dfb9b3" containerName="proxy-httpd" Mar 16 16:33:47 crc kubenswrapper[5120]: I0316 16:33:47.930241 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec6aab94-5ad4-4bd4-b657-108802dfb9b3" containerName="sg-core" Mar 16 16:33:47 crc kubenswrapper[5120]: I0316 16:33:47.930247 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec6aab94-5ad4-4bd4-b657-108802dfb9b3" containerName="sg-core" Mar 16 16:33:47 crc kubenswrapper[5120]: I0316 16:33:47.930283 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec6aab94-5ad4-4bd4-b657-108802dfb9b3" containerName="ceilometer-notification-agent" Mar 16 16:33:47 crc kubenswrapper[5120]: I0316 16:33:47.930309 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec6aab94-5ad4-4bd4-b657-108802dfb9b3" containerName="ceilometer-notification-agent" Mar 16 16:33:47 crc kubenswrapper[5120]: I0316 16:33:47.930545 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ec6aab94-5ad4-4bd4-b657-108802dfb9b3" containerName="ceilometer-notification-agent" Mar 16 16:33:47 crc kubenswrapper[5120]: I0316 16:33:47.930605 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ec6aab94-5ad4-4bd4-b657-108802dfb9b3" containerName="proxy-httpd" Mar 16 16:33:47 crc kubenswrapper[5120]: I0316 16:33:47.930616 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ec6aab94-5ad4-4bd4-b657-108802dfb9b3" containerName="sg-core" Mar 16 16:33:47 crc kubenswrapper[5120]: I0316 16:33:47.930624 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ec6aab94-5ad4-4bd4-b657-108802dfb9b3" containerName="ceilometer-central-agent" Mar 16 16:33:47 crc kubenswrapper[5120]: I0316 16:33:47.937254 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:33:47 crc kubenswrapper[5120]: I0316 16:33:47.941518 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 16:33:47 crc kubenswrapper[5120]: I0316 16:33:47.947246 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 16:33:47 crc kubenswrapper[5120]: I0316 16:33:47.960508 5120 scope.go:117] "RemoveContainer" containerID="d014128265c58b9b2b8c6dfd16f8aceeab1f67c108a5c1e9e0955c516bed6cf8" Mar 16 16:33:47 crc kubenswrapper[5120]: I0316 16:33:47.967694 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:33:48 crc kubenswrapper[5120]: I0316 16:33:48.116192 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a852d347-fc5c-4b18-99f0-dac8917749e5-config-data\") pod \"ceilometer-0\" (UID: \"a852d347-fc5c-4b18-99f0-dac8917749e5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:33:48 crc kubenswrapper[5120]: I0316 16:33:48.116231 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/a852d347-fc5c-4b18-99f0-dac8917749e5-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"a852d347-fc5c-4b18-99f0-dac8917749e5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:33:48 crc kubenswrapper[5120]: I0316 16:33:48.116255 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a852d347-fc5c-4b18-99f0-dac8917749e5-log-httpd\") pod \"ceilometer-0\" (UID: \"a852d347-fc5c-4b18-99f0-dac8917749e5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:33:48 crc kubenswrapper[5120]: I0316 16:33:48.116326 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a852d347-fc5c-4b18-99f0-dac8917749e5-scripts\") pod \"ceilometer-0\" (UID: \"a852d347-fc5c-4b18-99f0-dac8917749e5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:33:48 crc kubenswrapper[5120]: I0316 16:33:48.116398 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9pxk\" (UniqueName: \"kubernetes.io/projected/a852d347-fc5c-4b18-99f0-dac8917749e5-kube-api-access-t9pxk\") pod \"ceilometer-0\" (UID: \"a852d347-fc5c-4b18-99f0-dac8917749e5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:33:48 crc kubenswrapper[5120]: I0316 16:33:48.116444 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a852d347-fc5c-4b18-99f0-dac8917749e5-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"a852d347-fc5c-4b18-99f0-dac8917749e5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:33:48 crc kubenswrapper[5120]: I0316 16:33:48.116511 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a852d347-fc5c-4b18-99f0-dac8917749e5-run-httpd\") pod \"ceilometer-0\" (UID: \"a852d347-fc5c-4b18-99f0-dac8917749e5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:33:48 crc kubenswrapper[5120]: I0316 16:33:48.218105 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t9pxk\" (UniqueName: \"kubernetes.io/projected/a852d347-fc5c-4b18-99f0-dac8917749e5-kube-api-access-t9pxk\") pod \"ceilometer-0\" (UID: \"a852d347-fc5c-4b18-99f0-dac8917749e5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:33:48 crc kubenswrapper[5120]: I0316 16:33:48.218184 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a852d347-fc5c-4b18-99f0-dac8917749e5-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"a852d347-fc5c-4b18-99f0-dac8917749e5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:33:48 crc kubenswrapper[5120]: I0316 16:33:48.218263 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a852d347-fc5c-4b18-99f0-dac8917749e5-run-httpd\") pod \"ceilometer-0\" (UID: \"a852d347-fc5c-4b18-99f0-dac8917749e5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:33:48 crc kubenswrapper[5120]: I0316 16:33:48.218422 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a852d347-fc5c-4b18-99f0-dac8917749e5-config-data\") pod \"ceilometer-0\" (UID: \"a852d347-fc5c-4b18-99f0-dac8917749e5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:33:48 crc kubenswrapper[5120]: I0316 16:33:48.218481 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/a852d347-fc5c-4b18-99f0-dac8917749e5-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"a852d347-fc5c-4b18-99f0-dac8917749e5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:33:48 crc kubenswrapper[5120]: I0316 16:33:48.218504 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a852d347-fc5c-4b18-99f0-dac8917749e5-log-httpd\") pod \"ceilometer-0\" (UID: \"a852d347-fc5c-4b18-99f0-dac8917749e5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:33:48 crc kubenswrapper[5120]: I0316 16:33:48.218607 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a852d347-fc5c-4b18-99f0-dac8917749e5-scripts\") pod \"ceilometer-0\" (UID: \"a852d347-fc5c-4b18-99f0-dac8917749e5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:33:48 crc kubenswrapper[5120]: I0316 16:33:48.219032 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a852d347-fc5c-4b18-99f0-dac8917749e5-run-httpd\") pod \"ceilometer-0\" (UID: \"a852d347-fc5c-4b18-99f0-dac8917749e5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:33:48 crc kubenswrapper[5120]: I0316 16:33:48.219066 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a852d347-fc5c-4b18-99f0-dac8917749e5-log-httpd\") pod \"ceilometer-0\" (UID: \"a852d347-fc5c-4b18-99f0-dac8917749e5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:33:48 crc kubenswrapper[5120]: I0316 16:33:48.223775 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/a852d347-fc5c-4b18-99f0-dac8917749e5-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"a852d347-fc5c-4b18-99f0-dac8917749e5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:33:48 crc kubenswrapper[5120]: I0316 16:33:48.224852 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a852d347-fc5c-4b18-99f0-dac8917749e5-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"a852d347-fc5c-4b18-99f0-dac8917749e5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:33:48 crc kubenswrapper[5120]: I0316 16:33:48.225452 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a852d347-fc5c-4b18-99f0-dac8917749e5-scripts\") pod \"ceilometer-0\" (UID: \"a852d347-fc5c-4b18-99f0-dac8917749e5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:33:48 crc kubenswrapper[5120]: I0316 16:33:48.225874 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a852d347-fc5c-4b18-99f0-dac8917749e5-config-data\") pod \"ceilometer-0\" (UID: \"a852d347-fc5c-4b18-99f0-dac8917749e5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:33:48 crc kubenswrapper[5120]: I0316 16:33:48.239716 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9pxk\" (UniqueName: \"kubernetes.io/projected/a852d347-fc5c-4b18-99f0-dac8917749e5-kube-api-access-t9pxk\") pod \"ceilometer-0\" (UID: \"a852d347-fc5c-4b18-99f0-dac8917749e5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:33:48 crc kubenswrapper[5120]: I0316 16:33:48.250194 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/placement-6bc576559-vg8zd" Mar 16 16:33:48 crc kubenswrapper[5120]: I0316 16:33:48.268700 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:33:48 crc kubenswrapper[5120]: I0316 16:33:48.350836 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-d47d8c655-p8r55"] Mar 16 16:33:48 crc kubenswrapper[5120]: I0316 16:33:48.351281 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-d47d8c655-p8r55" podUID="716a6317-5231-4c6a-8728-7162c24ff8fb" containerName="placement-api" containerID="cri-o://b5f73bc2fcc71694ac4ec71e57ce1500caeee856064147ad378ad48a3951a8d1" gracePeriod=30 Mar 16 16:33:48 crc kubenswrapper[5120]: I0316 16:33:48.353074 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-d47d8c655-p8r55" podUID="716a6317-5231-4c6a-8728-7162c24ff8fb" containerName="placement-log" containerID="cri-o://f219d9d7fd258e4a5b604f8b479078504b8ca4ef1f05e09bb3c47fef2b35364c" gracePeriod=30 Mar 16 16:33:48 crc kubenswrapper[5120]: I0316 16:33:48.678177 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec6aab94-5ad4-4bd4-b657-108802dfb9b3" path="/var/lib/kubelet/pods/ec6aab94-5ad4-4bd4-b657-108802dfb9b3/volumes" Mar 16 16:33:48 crc kubenswrapper[5120]: I0316 16:33:48.855354 5120 generic.go:358] "Generic (PLEG): container finished" podID="716a6317-5231-4c6a-8728-7162c24ff8fb" containerID="f219d9d7fd258e4a5b604f8b479078504b8ca4ef1f05e09bb3c47fef2b35364c" exitCode=143 Mar 16 16:33:48 crc kubenswrapper[5120]: I0316 16:33:48.855498 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-d47d8c655-p8r55" event={"ID":"716a6317-5231-4c6a-8728-7162c24ff8fb","Type":"ContainerDied","Data":"f219d9d7fd258e4a5b604f8b479078504b8ca4ef1f05e09bb3c47fef2b35364c"} Mar 16 16:33:48 crc kubenswrapper[5120]: I0316 16:33:48.883705 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:33:49 crc kubenswrapper[5120]: I0316 16:33:49.593957 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:33:49 crc kubenswrapper[5120]: I0316 16:33:49.870213 5120 generic.go:358] "Generic (PLEG): container finished" podID="e0796e9e-184f-47cc-b5b7-5c06434a59a6" containerID="e08499fa0045d74d6308fba6c5956ff25d0913010b386b67319bd167e2fc0938" exitCode=0 Mar 16 16:33:49 crc kubenswrapper[5120]: I0316 16:33:49.870386 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"e0796e9e-184f-47cc-b5b7-5c06434a59a6","Type":"ContainerDied","Data":"e08499fa0045d74d6308fba6c5956ff25d0913010b386b67319bd167e2fc0938"} Mar 16 16:33:49 crc kubenswrapper[5120]: I0316 16:33:49.872193 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a852d347-fc5c-4b18-99f0-dac8917749e5","Type":"ContainerStarted","Data":"cfd5b873f90e7d7e4f493eeb7e6ff00d240377e00e412d12ad29a0ab70a1315a"} Mar 16 16:33:50 crc kubenswrapper[5120]: I0316 16:33:50.045167 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:33:50 crc kubenswrapper[5120]: I0316 16:33:50.075223 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e0796e9e-184f-47cc-b5b7-5c06434a59a6-public-tls-certs\") pod \"e0796e9e-184f-47cc-b5b7-5c06434a59a6\" (UID: \"e0796e9e-184f-47cc-b5b7-5c06434a59a6\") " Mar 16 16:33:50 crc kubenswrapper[5120]: I0316 16:33:50.075393 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/e0796e9e-184f-47cc-b5b7-5c06434a59a6-httpd-run\") pod \"e0796e9e-184f-47cc-b5b7-5c06434a59a6\" (UID: \"e0796e9e-184f-47cc-b5b7-5c06434a59a6\") " Mar 16 16:33:50 crc kubenswrapper[5120]: I0316 16:33:50.075447 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e0796e9e-184f-47cc-b5b7-5c06434a59a6-scripts\") pod \"e0796e9e-184f-47cc-b5b7-5c06434a59a6\" (UID: \"e0796e9e-184f-47cc-b5b7-5c06434a59a6\") " Mar 16 16:33:50 crc kubenswrapper[5120]: I0316 16:33:50.075482 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e0796e9e-184f-47cc-b5b7-5c06434a59a6-logs\") pod \"e0796e9e-184f-47cc-b5b7-5c06434a59a6\" (UID: \"e0796e9e-184f-47cc-b5b7-5c06434a59a6\") " Mar 16 16:33:50 crc kubenswrapper[5120]: I0316 16:33:50.075537 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"e0796e9e-184f-47cc-b5b7-5c06434a59a6\" (UID: \"e0796e9e-184f-47cc-b5b7-5c06434a59a6\") " Mar 16 16:33:50 crc kubenswrapper[5120]: I0316 16:33:50.075575 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e0796e9e-184f-47cc-b5b7-5c06434a59a6-config-data\") pod \"e0796e9e-184f-47cc-b5b7-5c06434a59a6\" (UID: \"e0796e9e-184f-47cc-b5b7-5c06434a59a6\") " Mar 16 16:33:50 crc kubenswrapper[5120]: I0316 16:33:50.075736 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zzngx\" (UniqueName: \"kubernetes.io/projected/e0796e9e-184f-47cc-b5b7-5c06434a59a6-kube-api-access-zzngx\") pod \"e0796e9e-184f-47cc-b5b7-5c06434a59a6\" (UID: \"e0796e9e-184f-47cc-b5b7-5c06434a59a6\") " Mar 16 16:33:50 crc kubenswrapper[5120]: I0316 16:33:50.075826 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e0796e9e-184f-47cc-b5b7-5c06434a59a6-combined-ca-bundle\") pod \"e0796e9e-184f-47cc-b5b7-5c06434a59a6\" (UID: \"e0796e9e-184f-47cc-b5b7-5c06434a59a6\") " Mar 16 16:33:50 crc kubenswrapper[5120]: I0316 16:33:50.077406 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0796e9e-184f-47cc-b5b7-5c06434a59a6-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "e0796e9e-184f-47cc-b5b7-5c06434a59a6" (UID: "e0796e9e-184f-47cc-b5b7-5c06434a59a6"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:33:50 crc kubenswrapper[5120]: I0316 16:33:50.080779 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0796e9e-184f-47cc-b5b7-5c06434a59a6-logs" (OuterVolumeSpecName: "logs") pod "e0796e9e-184f-47cc-b5b7-5c06434a59a6" (UID: "e0796e9e-184f-47cc-b5b7-5c06434a59a6"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:33:50 crc kubenswrapper[5120]: I0316 16:33:50.085120 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage01-crc" (OuterVolumeSpecName: "glance") pod "e0796e9e-184f-47cc-b5b7-5c06434a59a6" (UID: "e0796e9e-184f-47cc-b5b7-5c06434a59a6"). InnerVolumeSpecName "local-storage01-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:33:50 crc kubenswrapper[5120]: I0316 16:33:50.095970 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0796e9e-184f-47cc-b5b7-5c06434a59a6-scripts" (OuterVolumeSpecName: "scripts") pod "e0796e9e-184f-47cc-b5b7-5c06434a59a6" (UID: "e0796e9e-184f-47cc-b5b7-5c06434a59a6"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:33:50 crc kubenswrapper[5120]: I0316 16:33:50.099159 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0796e9e-184f-47cc-b5b7-5c06434a59a6-kube-api-access-zzngx" (OuterVolumeSpecName: "kube-api-access-zzngx") pod "e0796e9e-184f-47cc-b5b7-5c06434a59a6" (UID: "e0796e9e-184f-47cc-b5b7-5c06434a59a6"). InnerVolumeSpecName "kube-api-access-zzngx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:33:50 crc kubenswrapper[5120]: I0316 16:33:50.142729 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0796e9e-184f-47cc-b5b7-5c06434a59a6-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e0796e9e-184f-47cc-b5b7-5c06434a59a6" (UID: "e0796e9e-184f-47cc-b5b7-5c06434a59a6"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:33:50 crc kubenswrapper[5120]: I0316 16:33:50.147372 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0796e9e-184f-47cc-b5b7-5c06434a59a6-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "e0796e9e-184f-47cc-b5b7-5c06434a59a6" (UID: "e0796e9e-184f-47cc-b5b7-5c06434a59a6"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:33:50 crc kubenswrapper[5120]: I0316 16:33:50.178821 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e0796e9e-184f-47cc-b5b7-5c06434a59a6-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:33:50 crc kubenswrapper[5120]: I0316 16:33:50.178872 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/e0796e9e-184f-47cc-b5b7-5c06434a59a6-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 16:33:50 crc kubenswrapper[5120]: I0316 16:33:50.178885 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e0796e9e-184f-47cc-b5b7-5c06434a59a6-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:33:50 crc kubenswrapper[5120]: I0316 16:33:50.178898 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e0796e9e-184f-47cc-b5b7-5c06434a59a6-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:33:50 crc kubenswrapper[5120]: I0316 16:33:50.178941 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") on node \"crc\" " Mar 16 16:33:50 crc kubenswrapper[5120]: I0316 16:33:50.178955 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zzngx\" (UniqueName: \"kubernetes.io/projected/e0796e9e-184f-47cc-b5b7-5c06434a59a6-kube-api-access-zzngx\") on node \"crc\" DevicePath \"\"" Mar 16 16:33:50 crc kubenswrapper[5120]: I0316 16:33:50.178971 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e0796e9e-184f-47cc-b5b7-5c06434a59a6-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:33:50 crc kubenswrapper[5120]: I0316 16:33:50.180705 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0796e9e-184f-47cc-b5b7-5c06434a59a6-config-data" (OuterVolumeSpecName: "config-data") pod "e0796e9e-184f-47cc-b5b7-5c06434a59a6" (UID: "e0796e9e-184f-47cc-b5b7-5c06434a59a6"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:33:50 crc kubenswrapper[5120]: I0316 16:33:50.204089 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage01-crc" (UniqueName: "kubernetes.io/local-volume/local-storage01-crc") on node "crc" Mar 16 16:33:50 crc kubenswrapper[5120]: I0316 16:33:50.281471 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:33:50 crc kubenswrapper[5120]: I0316 16:33:50.281541 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e0796e9e-184f-47cc-b5b7-5c06434a59a6-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:33:50 crc kubenswrapper[5120]: I0316 16:33:50.901445 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a852d347-fc5c-4b18-99f0-dac8917749e5","Type":"ContainerStarted","Data":"b36170e2bb77d50900804cd1777a276283bfe4d0bf59d5eda92021db37cd521c"} Mar 16 16:33:50 crc kubenswrapper[5120]: I0316 16:33:50.909522 5120 generic.go:358] "Generic (PLEG): container finished" podID="66747957-79a6-4233-93a5-be994ddc995f" containerID="912bd3364ca361d86430ef689160af954803620513e903e6bfbe209134858c72" exitCode=0 Mar 16 16:33:50 crc kubenswrapper[5120]: I0316 16:33:50.911384 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"66747957-79a6-4233-93a5-be994ddc995f","Type":"ContainerDied","Data":"912bd3364ca361d86430ef689160af954803620513e903e6bfbe209134858c72"} Mar 16 16:33:50 crc kubenswrapper[5120]: I0316 16:33:50.920695 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"e0796e9e-184f-47cc-b5b7-5c06434a59a6","Type":"ContainerDied","Data":"19588b190101793b524a3b9676912411ed9f1d27d44354beec556719aa7d9593"} Mar 16 16:33:50 crc kubenswrapper[5120]: I0316 16:33:50.920752 5120 scope.go:117] "RemoveContainer" containerID="e08499fa0045d74d6308fba6c5956ff25d0913010b386b67319bd167e2fc0938" Mar 16 16:33:50 crc kubenswrapper[5120]: I0316 16:33:50.920999 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:33:50 crc kubenswrapper[5120]: I0316 16:33:50.949648 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:33:50 crc kubenswrapper[5120]: I0316 16:33:50.960583 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:33:50 crc kubenswrapper[5120]: I0316 16:33:50.980120 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:33:50 crc kubenswrapper[5120]: I0316 16:33:50.981512 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0796e9e-184f-47cc-b5b7-5c06434a59a6" containerName="glance-log" Mar 16 16:33:50 crc kubenswrapper[5120]: I0316 16:33:50.981534 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0796e9e-184f-47cc-b5b7-5c06434a59a6" containerName="glance-log" Mar 16 16:33:50 crc kubenswrapper[5120]: I0316 16:33:50.981615 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0796e9e-184f-47cc-b5b7-5c06434a59a6" containerName="glance-httpd" Mar 16 16:33:50 crc kubenswrapper[5120]: I0316 16:33:50.981626 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0796e9e-184f-47cc-b5b7-5c06434a59a6" containerName="glance-httpd" Mar 16 16:33:50 crc kubenswrapper[5120]: I0316 16:33:50.981839 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e0796e9e-184f-47cc-b5b7-5c06434a59a6" containerName="glance-log" Mar 16 16:33:50 crc kubenswrapper[5120]: I0316 16:33:50.981862 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e0796e9e-184f-47cc-b5b7-5c06434a59a6" containerName="glance-httpd" Mar 16 16:33:50 crc kubenswrapper[5120]: I0316 16:33:50.990198 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:33:50 crc kubenswrapper[5120]: I0316 16:33:50.990324 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:33:51 crc kubenswrapper[5120]: I0316 16:33:51.004586 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-public-svc\"" Mar 16 16:33:51 crc kubenswrapper[5120]: I0316 16:33:51.005175 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-external-config-data\"" Mar 16 16:33:51 crc kubenswrapper[5120]: I0316 16:33:51.053395 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:33:51 crc kubenswrapper[5120]: I0316 16:33:51.063452 5120 scope.go:117] "RemoveContainer" containerID="e51b5d7a1b22fbe662527e006b5f92746058cd54fdd5f8dd5fc011441296b073" Mar 16 16:33:51 crc kubenswrapper[5120]: I0316 16:33:51.110332 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/66747957-79a6-4233-93a5-be994ddc995f-config-data\") pod \"66747957-79a6-4233-93a5-be994ddc995f\" (UID: \"66747957-79a6-4233-93a5-be994ddc995f\") " Mar 16 16:33:51 crc kubenswrapper[5120]: I0316 16:33:51.110444 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vsrpf\" (UniqueName: \"kubernetes.io/projected/66747957-79a6-4233-93a5-be994ddc995f-kube-api-access-vsrpf\") pod \"66747957-79a6-4233-93a5-be994ddc995f\" (UID: \"66747957-79a6-4233-93a5-be994ddc995f\") " Mar 16 16:33:51 crc kubenswrapper[5120]: I0316 16:33:51.110473 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") pod \"66747957-79a6-4233-93a5-be994ddc995f\" (UID: \"66747957-79a6-4233-93a5-be994ddc995f\") " Mar 16 16:33:51 crc kubenswrapper[5120]: I0316 16:33:51.110848 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/66747957-79a6-4233-93a5-be994ddc995f-scripts\") pod \"66747957-79a6-4233-93a5-be994ddc995f\" (UID: \"66747957-79a6-4233-93a5-be994ddc995f\") " Mar 16 16:33:51 crc kubenswrapper[5120]: I0316 16:33:51.111136 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/66747957-79a6-4233-93a5-be994ddc995f-combined-ca-bundle\") pod \"66747957-79a6-4233-93a5-be994ddc995f\" (UID: \"66747957-79a6-4233-93a5-be994ddc995f\") " Mar 16 16:33:51 crc kubenswrapper[5120]: I0316 16:33:51.111308 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/66747957-79a6-4233-93a5-be994ddc995f-httpd-run\") pod \"66747957-79a6-4233-93a5-be994ddc995f\" (UID: \"66747957-79a6-4233-93a5-be994ddc995f\") " Mar 16 16:33:51 crc kubenswrapper[5120]: I0316 16:33:51.111338 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/66747957-79a6-4233-93a5-be994ddc995f-internal-tls-certs\") pod \"66747957-79a6-4233-93a5-be994ddc995f\" (UID: \"66747957-79a6-4233-93a5-be994ddc995f\") " Mar 16 16:33:51 crc kubenswrapper[5120]: I0316 16:33:51.111367 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/66747957-79a6-4233-93a5-be994ddc995f-logs\") pod \"66747957-79a6-4233-93a5-be994ddc995f\" (UID: \"66747957-79a6-4233-93a5-be994ddc995f\") " Mar 16 16:33:51 crc kubenswrapper[5120]: I0316 16:33:51.111678 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/48a68bcb-2d44-4992-b9a9-0409c2348fb1-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"48a68bcb-2d44-4992-b9a9-0409c2348fb1\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:33:51 crc kubenswrapper[5120]: I0316 16:33:51.111858 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/48a68bcb-2d44-4992-b9a9-0409c2348fb1-scripts\") pod \"glance-default-external-api-0\" (UID: \"48a68bcb-2d44-4992-b9a9-0409c2348fb1\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:33:51 crc kubenswrapper[5120]: I0316 16:33:51.111967 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/48a68bcb-2d44-4992-b9a9-0409c2348fb1-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"48a68bcb-2d44-4992-b9a9-0409c2348fb1\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:33:51 crc kubenswrapper[5120]: I0316 16:33:51.111999 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/48a68bcb-2d44-4992-b9a9-0409c2348fb1-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"48a68bcb-2d44-4992-b9a9-0409c2348fb1\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:33:51 crc kubenswrapper[5120]: I0316 16:33:51.112041 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/48a68bcb-2d44-4992-b9a9-0409c2348fb1-logs\") pod \"glance-default-external-api-0\" (UID: \"48a68bcb-2d44-4992-b9a9-0409c2348fb1\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:33:51 crc kubenswrapper[5120]: I0316 16:33:51.112193 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"glance-default-external-api-0\" (UID: \"48a68bcb-2d44-4992-b9a9-0409c2348fb1\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:33:51 crc kubenswrapper[5120]: I0316 16:33:51.112210 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66747957-79a6-4233-93a5-be994ddc995f-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "66747957-79a6-4233-93a5-be994ddc995f" (UID: "66747957-79a6-4233-93a5-be994ddc995f"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:33:51 crc kubenswrapper[5120]: I0316 16:33:51.112224 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/48a68bcb-2d44-4992-b9a9-0409c2348fb1-config-data\") pod \"glance-default-external-api-0\" (UID: \"48a68bcb-2d44-4992-b9a9-0409c2348fb1\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:33:51 crc kubenswrapper[5120]: I0316 16:33:51.112504 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66747957-79a6-4233-93a5-be994ddc995f-logs" (OuterVolumeSpecName: "logs") pod "66747957-79a6-4233-93a5-be994ddc995f" (UID: "66747957-79a6-4233-93a5-be994ddc995f"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:33:51 crc kubenswrapper[5120]: I0316 16:33:51.116656 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66747957-79a6-4233-93a5-be994ddc995f-kube-api-access-vsrpf" (OuterVolumeSpecName: "kube-api-access-vsrpf") pod "66747957-79a6-4233-93a5-be994ddc995f" (UID: "66747957-79a6-4233-93a5-be994ddc995f"). InnerVolumeSpecName "kube-api-access-vsrpf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:33:51 crc kubenswrapper[5120]: I0316 16:33:51.117321 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgm2l\" (UniqueName: \"kubernetes.io/projected/48a68bcb-2d44-4992-b9a9-0409c2348fb1-kube-api-access-mgm2l\") pod \"glance-default-external-api-0\" (UID: \"48a68bcb-2d44-4992-b9a9-0409c2348fb1\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:33:51 crc kubenswrapper[5120]: I0316 16:33:51.119062 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage19-crc" (OuterVolumeSpecName: "glance") pod "66747957-79a6-4233-93a5-be994ddc995f" (UID: "66747957-79a6-4233-93a5-be994ddc995f"). InnerVolumeSpecName "local-storage19-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:33:51 crc kubenswrapper[5120]: I0316 16:33:51.119274 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vsrpf\" (UniqueName: \"kubernetes.io/projected/66747957-79a6-4233-93a5-be994ddc995f-kube-api-access-vsrpf\") on node \"crc\" DevicePath \"\"" Mar 16 16:33:51 crc kubenswrapper[5120]: I0316 16:33:51.119304 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/66747957-79a6-4233-93a5-be994ddc995f-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 16:33:51 crc kubenswrapper[5120]: I0316 16:33:51.119318 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/66747957-79a6-4233-93a5-be994ddc995f-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:33:51 crc kubenswrapper[5120]: I0316 16:33:51.123381 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/66747957-79a6-4233-93a5-be994ddc995f-scripts" (OuterVolumeSpecName: "scripts") pod "66747957-79a6-4233-93a5-be994ddc995f" (UID: "66747957-79a6-4233-93a5-be994ddc995f"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:33:51 crc kubenswrapper[5120]: I0316 16:33:51.179995 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/66747957-79a6-4233-93a5-be994ddc995f-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "66747957-79a6-4233-93a5-be994ddc995f" (UID: "66747957-79a6-4233-93a5-be994ddc995f"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:33:51 crc kubenswrapper[5120]: I0316 16:33:51.186905 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/66747957-79a6-4233-93a5-be994ddc995f-config-data" (OuterVolumeSpecName: "config-data") pod "66747957-79a6-4233-93a5-be994ddc995f" (UID: "66747957-79a6-4233-93a5-be994ddc995f"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:33:51 crc kubenswrapper[5120]: I0316 16:33:51.198839 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/66747957-79a6-4233-93a5-be994ddc995f-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "66747957-79a6-4233-93a5-be994ddc995f" (UID: "66747957-79a6-4233-93a5-be994ddc995f"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:33:51 crc kubenswrapper[5120]: I0316 16:33:51.222086 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"glance-default-external-api-0\" (UID: \"48a68bcb-2d44-4992-b9a9-0409c2348fb1\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:33:51 crc kubenswrapper[5120]: I0316 16:33:51.222144 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/48a68bcb-2d44-4992-b9a9-0409c2348fb1-config-data\") pod \"glance-default-external-api-0\" (UID: \"48a68bcb-2d44-4992-b9a9-0409c2348fb1\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:33:51 crc kubenswrapper[5120]: I0316 16:33:51.222187 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mgm2l\" (UniqueName: \"kubernetes.io/projected/48a68bcb-2d44-4992-b9a9-0409c2348fb1-kube-api-access-mgm2l\") pod \"glance-default-external-api-0\" (UID: \"48a68bcb-2d44-4992-b9a9-0409c2348fb1\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:33:51 crc kubenswrapper[5120]: I0316 16:33:51.222296 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/48a68bcb-2d44-4992-b9a9-0409c2348fb1-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"48a68bcb-2d44-4992-b9a9-0409c2348fb1\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:33:51 crc kubenswrapper[5120]: I0316 16:33:51.222390 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/48a68bcb-2d44-4992-b9a9-0409c2348fb1-scripts\") pod \"glance-default-external-api-0\" (UID: \"48a68bcb-2d44-4992-b9a9-0409c2348fb1\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:33:51 crc kubenswrapper[5120]: I0316 16:33:51.222454 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/48a68bcb-2d44-4992-b9a9-0409c2348fb1-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"48a68bcb-2d44-4992-b9a9-0409c2348fb1\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:33:51 crc kubenswrapper[5120]: I0316 16:33:51.222472 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/48a68bcb-2d44-4992-b9a9-0409c2348fb1-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"48a68bcb-2d44-4992-b9a9-0409c2348fb1\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:33:51 crc kubenswrapper[5120]: I0316 16:33:51.222498 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/48a68bcb-2d44-4992-b9a9-0409c2348fb1-logs\") pod \"glance-default-external-api-0\" (UID: \"48a68bcb-2d44-4992-b9a9-0409c2348fb1\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:33:51 crc kubenswrapper[5120]: I0316 16:33:51.222605 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/66747957-79a6-4233-93a5-be994ddc995f-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:33:51 crc kubenswrapper[5120]: I0316 16:33:51.222620 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/66747957-79a6-4233-93a5-be994ddc995f-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:33:51 crc kubenswrapper[5120]: I0316 16:33:51.222630 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/66747957-79a6-4233-93a5-be994ddc995f-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:33:51 crc kubenswrapper[5120]: I0316 16:33:51.222641 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/66747957-79a6-4233-93a5-be994ddc995f-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:33:51 crc kubenswrapper[5120]: I0316 16:33:51.222667 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage19-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") on node \"crc\" " Mar 16 16:33:51 crc kubenswrapper[5120]: I0316 16:33:51.223871 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/48a68bcb-2d44-4992-b9a9-0409c2348fb1-logs\") pod \"glance-default-external-api-0\" (UID: \"48a68bcb-2d44-4992-b9a9-0409c2348fb1\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:33:51 crc kubenswrapper[5120]: I0316 16:33:51.224211 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"glance-default-external-api-0\" (UID: \"48a68bcb-2d44-4992-b9a9-0409c2348fb1\") device mount path \"/mnt/openstack/pv01\"" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:33:51 crc kubenswrapper[5120]: I0316 16:33:51.225201 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/48a68bcb-2d44-4992-b9a9-0409c2348fb1-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"48a68bcb-2d44-4992-b9a9-0409c2348fb1\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:33:51 crc kubenswrapper[5120]: I0316 16:33:51.228424 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/48a68bcb-2d44-4992-b9a9-0409c2348fb1-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"48a68bcb-2d44-4992-b9a9-0409c2348fb1\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:33:51 crc kubenswrapper[5120]: I0316 16:33:51.230471 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/48a68bcb-2d44-4992-b9a9-0409c2348fb1-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"48a68bcb-2d44-4992-b9a9-0409c2348fb1\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:33:51 crc kubenswrapper[5120]: I0316 16:33:51.231699 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/48a68bcb-2d44-4992-b9a9-0409c2348fb1-scripts\") pod \"glance-default-external-api-0\" (UID: \"48a68bcb-2d44-4992-b9a9-0409c2348fb1\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:33:51 crc kubenswrapper[5120]: I0316 16:33:51.231861 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/48a68bcb-2d44-4992-b9a9-0409c2348fb1-config-data\") pod \"glance-default-external-api-0\" (UID: \"48a68bcb-2d44-4992-b9a9-0409c2348fb1\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:33:51 crc kubenswrapper[5120]: I0316 16:33:51.243224 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgm2l\" (UniqueName: \"kubernetes.io/projected/48a68bcb-2d44-4992-b9a9-0409c2348fb1-kube-api-access-mgm2l\") pod \"glance-default-external-api-0\" (UID: \"48a68bcb-2d44-4992-b9a9-0409c2348fb1\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:33:51 crc kubenswrapper[5120]: I0316 16:33:51.247241 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage19-crc" (UniqueName: "kubernetes.io/local-volume/local-storage19-crc") on node "crc" Mar 16 16:33:51 crc kubenswrapper[5120]: I0316 16:33:51.256588 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"glance-default-external-api-0\" (UID: \"48a68bcb-2d44-4992-b9a9-0409c2348fb1\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:33:51 crc kubenswrapper[5120]: I0316 16:33:51.326395 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage19-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:33:51 crc kubenswrapper[5120]: I0316 16:33:51.359482 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:33:51 crc kubenswrapper[5120]: I0316 16:33:51.852059 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:33:51 crc kubenswrapper[5120]: I0316 16:33:51.934295 5120 generic.go:358] "Generic (PLEG): container finished" podID="716a6317-5231-4c6a-8728-7162c24ff8fb" containerID="b5f73bc2fcc71694ac4ec71e57ce1500caeee856064147ad378ad48a3951a8d1" exitCode=0 Mar 16 16:33:51 crc kubenswrapper[5120]: I0316 16:33:51.934408 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-d47d8c655-p8r55" event={"ID":"716a6317-5231-4c6a-8728-7162c24ff8fb","Type":"ContainerDied","Data":"b5f73bc2fcc71694ac4ec71e57ce1500caeee856064147ad378ad48a3951a8d1"} Mar 16 16:33:51 crc kubenswrapper[5120]: I0316 16:33:51.934435 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-d47d8c655-p8r55" event={"ID":"716a6317-5231-4c6a-8728-7162c24ff8fb","Type":"ContainerDied","Data":"4c5a780d227188c28469de37acf2a604949c11617a4eb81e214e3e9b80ac6f17"} Mar 16 16:33:51 crc kubenswrapper[5120]: I0316 16:33:51.934446 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4c5a780d227188c28469de37acf2a604949c11617a4eb81e214e3e9b80ac6f17" Mar 16 16:33:51 crc kubenswrapper[5120]: I0316 16:33:51.936868 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"48a68bcb-2d44-4992-b9a9-0409c2348fb1","Type":"ContainerStarted","Data":"c09ec5597d8f16a211335c9f0b9121095d157a7ed38959c90a7bfaf0ff54cb1b"} Mar 16 16:33:51 crc kubenswrapper[5120]: I0316 16:33:51.942387 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a852d347-fc5c-4b18-99f0-dac8917749e5","Type":"ContainerStarted","Data":"7f9b1ce291d3e9971cc2c84756c8527288cc97a5bf68f6a05aa1c4a290707ab1"} Mar 16 16:33:51 crc kubenswrapper[5120]: I0316 16:33:51.948105 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"66747957-79a6-4233-93a5-be994ddc995f","Type":"ContainerDied","Data":"26f968b45d6b728dd9beeb9510fed3376c381a43a34f2b5f80ab95bf964b3bda"} Mar 16 16:33:51 crc kubenswrapper[5120]: I0316 16:33:51.948146 5120 scope.go:117] "RemoveContainer" containerID="912bd3364ca361d86430ef689160af954803620513e903e6bfbe209134858c72" Mar 16 16:33:51 crc kubenswrapper[5120]: I0316 16:33:51.948259 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:33:52 crc kubenswrapper[5120]: I0316 16:33:52.012437 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-d47d8c655-p8r55" Mar 16 16:33:52 crc kubenswrapper[5120]: I0316 16:33:52.015210 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:33:52 crc kubenswrapper[5120]: I0316 16:33:52.046889 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:33:52 crc kubenswrapper[5120]: I0316 16:33:52.071530 5120 scope.go:117] "RemoveContainer" containerID="2f5cb2d85d3d7ce59d3c6313e0cfc9d1017f7d619e472d48c96c845d78895d5a" Mar 16 16:33:52 crc kubenswrapper[5120]: I0316 16:33:52.080831 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:33:52 crc kubenswrapper[5120]: I0316 16:33:52.081874 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66747957-79a6-4233-93a5-be994ddc995f" containerName="glance-httpd" Mar 16 16:33:52 crc kubenswrapper[5120]: I0316 16:33:52.081887 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="66747957-79a6-4233-93a5-be994ddc995f" containerName="glance-httpd" Mar 16 16:33:52 crc kubenswrapper[5120]: I0316 16:33:52.081908 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="716a6317-5231-4c6a-8728-7162c24ff8fb" containerName="placement-api" Mar 16 16:33:52 crc kubenswrapper[5120]: I0316 16:33:52.081913 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="716a6317-5231-4c6a-8728-7162c24ff8fb" containerName="placement-api" Mar 16 16:33:52 crc kubenswrapper[5120]: I0316 16:33:52.081929 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="716a6317-5231-4c6a-8728-7162c24ff8fb" containerName="placement-log" Mar 16 16:33:52 crc kubenswrapper[5120]: I0316 16:33:52.081936 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="716a6317-5231-4c6a-8728-7162c24ff8fb" containerName="placement-log" Mar 16 16:33:52 crc kubenswrapper[5120]: I0316 16:33:52.081957 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66747957-79a6-4233-93a5-be994ddc995f" containerName="glance-log" Mar 16 16:33:52 crc kubenswrapper[5120]: I0316 16:33:52.081962 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="66747957-79a6-4233-93a5-be994ddc995f" containerName="glance-log" Mar 16 16:33:52 crc kubenswrapper[5120]: I0316 16:33:52.082152 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="66747957-79a6-4233-93a5-be994ddc995f" containerName="glance-log" Mar 16 16:33:52 crc kubenswrapper[5120]: I0316 16:33:52.082165 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="66747957-79a6-4233-93a5-be994ddc995f" containerName="glance-httpd" Mar 16 16:33:52 crc kubenswrapper[5120]: I0316 16:33:52.082179 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="716a6317-5231-4c6a-8728-7162c24ff8fb" containerName="placement-log" Mar 16 16:33:52 crc kubenswrapper[5120]: I0316 16:33:52.082193 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="716a6317-5231-4c6a-8728-7162c24ff8fb" containerName="placement-api" Mar 16 16:33:52 crc kubenswrapper[5120]: I0316 16:33:52.086278 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:33:52 crc kubenswrapper[5120]: I0316 16:33:52.089050 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:33:52 crc kubenswrapper[5120]: I0316 16:33:52.089398 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-internal-svc\"" Mar 16 16:33:52 crc kubenswrapper[5120]: I0316 16:33:52.089564 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-internal-config-data\"" Mar 16 16:33:52 crc kubenswrapper[5120]: I0316 16:33:52.145793 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/716a6317-5231-4c6a-8728-7162c24ff8fb-public-tls-certs\") pod \"716a6317-5231-4c6a-8728-7162c24ff8fb\" (UID: \"716a6317-5231-4c6a-8728-7162c24ff8fb\") " Mar 16 16:33:52 crc kubenswrapper[5120]: I0316 16:33:52.145921 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ttfww\" (UniqueName: \"kubernetes.io/projected/716a6317-5231-4c6a-8728-7162c24ff8fb-kube-api-access-ttfww\") pod \"716a6317-5231-4c6a-8728-7162c24ff8fb\" (UID: \"716a6317-5231-4c6a-8728-7162c24ff8fb\") " Mar 16 16:33:52 crc kubenswrapper[5120]: I0316 16:33:52.145981 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/716a6317-5231-4c6a-8728-7162c24ff8fb-combined-ca-bundle\") pod \"716a6317-5231-4c6a-8728-7162c24ff8fb\" (UID: \"716a6317-5231-4c6a-8728-7162c24ff8fb\") " Mar 16 16:33:52 crc kubenswrapper[5120]: I0316 16:33:52.146006 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/716a6317-5231-4c6a-8728-7162c24ff8fb-internal-tls-certs\") pod \"716a6317-5231-4c6a-8728-7162c24ff8fb\" (UID: \"716a6317-5231-4c6a-8728-7162c24ff8fb\") " Mar 16 16:33:52 crc kubenswrapper[5120]: I0316 16:33:52.146179 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/716a6317-5231-4c6a-8728-7162c24ff8fb-logs\") pod \"716a6317-5231-4c6a-8728-7162c24ff8fb\" (UID: \"716a6317-5231-4c6a-8728-7162c24ff8fb\") " Mar 16 16:33:52 crc kubenswrapper[5120]: I0316 16:33:52.146214 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/716a6317-5231-4c6a-8728-7162c24ff8fb-scripts\") pod \"716a6317-5231-4c6a-8728-7162c24ff8fb\" (UID: \"716a6317-5231-4c6a-8728-7162c24ff8fb\") " Mar 16 16:33:52 crc kubenswrapper[5120]: I0316 16:33:52.146352 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/716a6317-5231-4c6a-8728-7162c24ff8fb-config-data\") pod \"716a6317-5231-4c6a-8728-7162c24ff8fb\" (UID: \"716a6317-5231-4c6a-8728-7162c24ff8fb\") " Mar 16 16:33:52 crc kubenswrapper[5120]: I0316 16:33:52.146632 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/eea6594f-2384-40f5-9061-e3925083e279-logs\") pod \"glance-default-internal-api-0\" (UID: \"eea6594f-2384-40f5-9061-e3925083e279\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:33:52 crc kubenswrapper[5120]: I0316 16:33:52.146672 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/eea6594f-2384-40f5-9061-e3925083e279-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"eea6594f-2384-40f5-9061-e3925083e279\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:33:52 crc kubenswrapper[5120]: I0316 16:33:52.146730 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/eea6594f-2384-40f5-9061-e3925083e279-config-data\") pod \"glance-default-internal-api-0\" (UID: \"eea6594f-2384-40f5-9061-e3925083e279\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:33:52 crc kubenswrapper[5120]: I0316 16:33:52.146907 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage19-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") pod \"glance-default-internal-api-0\" (UID: \"eea6594f-2384-40f5-9061-e3925083e279\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:33:52 crc kubenswrapper[5120]: I0316 16:33:52.146946 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/eea6594f-2384-40f5-9061-e3925083e279-scripts\") pod \"glance-default-internal-api-0\" (UID: \"eea6594f-2384-40f5-9061-e3925083e279\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:33:52 crc kubenswrapper[5120]: I0316 16:33:52.146989 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eea6594f-2384-40f5-9061-e3925083e279-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"eea6594f-2384-40f5-9061-e3925083e279\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:33:52 crc kubenswrapper[5120]: I0316 16:33:52.147023 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/eea6594f-2384-40f5-9061-e3925083e279-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"eea6594f-2384-40f5-9061-e3925083e279\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:33:52 crc kubenswrapper[5120]: I0316 16:33:52.147059 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4cfbr\" (UniqueName: \"kubernetes.io/projected/eea6594f-2384-40f5-9061-e3925083e279-kube-api-access-4cfbr\") pod \"glance-default-internal-api-0\" (UID: \"eea6594f-2384-40f5-9061-e3925083e279\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:33:52 crc kubenswrapper[5120]: I0316 16:33:52.152614 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/716a6317-5231-4c6a-8728-7162c24ff8fb-logs" (OuterVolumeSpecName: "logs") pod "716a6317-5231-4c6a-8728-7162c24ff8fb" (UID: "716a6317-5231-4c6a-8728-7162c24ff8fb"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:33:52 crc kubenswrapper[5120]: I0316 16:33:52.156249 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/716a6317-5231-4c6a-8728-7162c24ff8fb-kube-api-access-ttfww" (OuterVolumeSpecName: "kube-api-access-ttfww") pod "716a6317-5231-4c6a-8728-7162c24ff8fb" (UID: "716a6317-5231-4c6a-8728-7162c24ff8fb"). InnerVolumeSpecName "kube-api-access-ttfww". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:33:52 crc kubenswrapper[5120]: I0316 16:33:52.157839 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/716a6317-5231-4c6a-8728-7162c24ff8fb-scripts" (OuterVolumeSpecName: "scripts") pod "716a6317-5231-4c6a-8728-7162c24ff8fb" (UID: "716a6317-5231-4c6a-8728-7162c24ff8fb"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:33:52 crc kubenswrapper[5120]: I0316 16:33:52.230466 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/716a6317-5231-4c6a-8728-7162c24ff8fb-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "716a6317-5231-4c6a-8728-7162c24ff8fb" (UID: "716a6317-5231-4c6a-8728-7162c24ff8fb"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:33:52 crc kubenswrapper[5120]: I0316 16:33:52.243619 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/716a6317-5231-4c6a-8728-7162c24ff8fb-config-data" (OuterVolumeSpecName: "config-data") pod "716a6317-5231-4c6a-8728-7162c24ff8fb" (UID: "716a6317-5231-4c6a-8728-7162c24ff8fb"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:33:52 crc kubenswrapper[5120]: I0316 16:33:52.249283 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/eea6594f-2384-40f5-9061-e3925083e279-config-data\") pod \"glance-default-internal-api-0\" (UID: \"eea6594f-2384-40f5-9061-e3925083e279\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:33:52 crc kubenswrapper[5120]: I0316 16:33:52.249572 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage19-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") pod \"glance-default-internal-api-0\" (UID: \"eea6594f-2384-40f5-9061-e3925083e279\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:33:52 crc kubenswrapper[5120]: I0316 16:33:52.249630 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/eea6594f-2384-40f5-9061-e3925083e279-scripts\") pod \"glance-default-internal-api-0\" (UID: \"eea6594f-2384-40f5-9061-e3925083e279\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:33:52 crc kubenswrapper[5120]: I0316 16:33:52.249704 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eea6594f-2384-40f5-9061-e3925083e279-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"eea6594f-2384-40f5-9061-e3925083e279\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:33:52 crc kubenswrapper[5120]: I0316 16:33:52.249782 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/eea6594f-2384-40f5-9061-e3925083e279-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"eea6594f-2384-40f5-9061-e3925083e279\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:33:52 crc kubenswrapper[5120]: I0316 16:33:52.249843 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4cfbr\" (UniqueName: \"kubernetes.io/projected/eea6594f-2384-40f5-9061-e3925083e279-kube-api-access-4cfbr\") pod \"glance-default-internal-api-0\" (UID: \"eea6594f-2384-40f5-9061-e3925083e279\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:33:52 crc kubenswrapper[5120]: I0316 16:33:52.249960 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/eea6594f-2384-40f5-9061-e3925083e279-logs\") pod \"glance-default-internal-api-0\" (UID: \"eea6594f-2384-40f5-9061-e3925083e279\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:33:52 crc kubenswrapper[5120]: I0316 16:33:52.250034 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/eea6594f-2384-40f5-9061-e3925083e279-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"eea6594f-2384-40f5-9061-e3925083e279\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:33:52 crc kubenswrapper[5120]: I0316 16:33:52.250084 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage19-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") pod \"glance-default-internal-api-0\" (UID: \"eea6594f-2384-40f5-9061-e3925083e279\") device mount path \"/mnt/openstack/pv19\"" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:33:52 crc kubenswrapper[5120]: I0316 16:33:52.251734 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/eea6594f-2384-40f5-9061-e3925083e279-logs\") pod \"glance-default-internal-api-0\" (UID: \"eea6594f-2384-40f5-9061-e3925083e279\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:33:52 crc kubenswrapper[5120]: I0316 16:33:52.263372 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/eea6594f-2384-40f5-9061-e3925083e279-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"eea6594f-2384-40f5-9061-e3925083e279\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:33:52 crc kubenswrapper[5120]: I0316 16:33:52.263503 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ttfww\" (UniqueName: \"kubernetes.io/projected/716a6317-5231-4c6a-8728-7162c24ff8fb-kube-api-access-ttfww\") on node \"crc\" DevicePath \"\"" Mar 16 16:33:52 crc kubenswrapper[5120]: I0316 16:33:52.263532 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/716a6317-5231-4c6a-8728-7162c24ff8fb-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:33:52 crc kubenswrapper[5120]: I0316 16:33:52.263550 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/716a6317-5231-4c6a-8728-7162c24ff8fb-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:33:52 crc kubenswrapper[5120]: I0316 16:33:52.263560 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/716a6317-5231-4c6a-8728-7162c24ff8fb-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:33:52 crc kubenswrapper[5120]: I0316 16:33:52.263574 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/716a6317-5231-4c6a-8728-7162c24ff8fb-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:33:52 crc kubenswrapper[5120]: I0316 16:33:52.264044 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/eea6594f-2384-40f5-9061-e3925083e279-config-data\") pod \"glance-default-internal-api-0\" (UID: \"eea6594f-2384-40f5-9061-e3925083e279\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:33:52 crc kubenswrapper[5120]: I0316 16:33:52.304119 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eea6594f-2384-40f5-9061-e3925083e279-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"eea6594f-2384-40f5-9061-e3925083e279\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:33:52 crc kubenswrapper[5120]: I0316 16:33:52.305778 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/eea6594f-2384-40f5-9061-e3925083e279-scripts\") pod \"glance-default-internal-api-0\" (UID: \"eea6594f-2384-40f5-9061-e3925083e279\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:33:52 crc kubenswrapper[5120]: I0316 16:33:52.308636 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/eea6594f-2384-40f5-9061-e3925083e279-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"eea6594f-2384-40f5-9061-e3925083e279\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:33:52 crc kubenswrapper[5120]: I0316 16:33:52.319699 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4cfbr\" (UniqueName: \"kubernetes.io/projected/eea6594f-2384-40f5-9061-e3925083e279-kube-api-access-4cfbr\") pod \"glance-default-internal-api-0\" (UID: \"eea6594f-2384-40f5-9061-e3925083e279\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:33:52 crc kubenswrapper[5120]: I0316 16:33:52.343664 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage19-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") pod \"glance-default-internal-api-0\" (UID: \"eea6594f-2384-40f5-9061-e3925083e279\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:33:52 crc kubenswrapper[5120]: I0316 16:33:52.354199 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/716a6317-5231-4c6a-8728-7162c24ff8fb-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "716a6317-5231-4c6a-8728-7162c24ff8fb" (UID: "716a6317-5231-4c6a-8728-7162c24ff8fb"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:33:52 crc kubenswrapper[5120]: I0316 16:33:52.366296 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/716a6317-5231-4c6a-8728-7162c24ff8fb-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:33:52 crc kubenswrapper[5120]: I0316 16:33:52.376908 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/716a6317-5231-4c6a-8728-7162c24ff8fb-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "716a6317-5231-4c6a-8728-7162c24ff8fb" (UID: "716a6317-5231-4c6a-8728-7162c24ff8fb"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:33:52 crc kubenswrapper[5120]: I0316 16:33:52.409643 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:33:52 crc kubenswrapper[5120]: I0316 16:33:52.469048 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/716a6317-5231-4c6a-8728-7162c24ff8fb-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:33:52 crc kubenswrapper[5120]: I0316 16:33:52.670506 5120 scope.go:117] "RemoveContainer" containerID="0a15d5caff30dc8885f782e59962af7d98d58b39ab76059e56e5827e10e7ab8b" Mar 16 16:33:52 crc kubenswrapper[5120]: E0316 16:33:52.671150 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:33:52 crc kubenswrapper[5120]: I0316 16:33:52.690797 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="66747957-79a6-4233-93a5-be994ddc995f" path="/var/lib/kubelet/pods/66747957-79a6-4233-93a5-be994ddc995f/volumes" Mar 16 16:33:52 crc kubenswrapper[5120]: I0316 16:33:52.691587 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e0796e9e-184f-47cc-b5b7-5c06434a59a6" path="/var/lib/kubelet/pods/e0796e9e-184f-47cc-b5b7-5c06434a59a6/volumes" Mar 16 16:33:52 crc kubenswrapper[5120]: I0316 16:33:52.910340 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:33:52 crc kubenswrapper[5120]: I0316 16:33:52.987792 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"48a68bcb-2d44-4992-b9a9-0409c2348fb1","Type":"ContainerStarted","Data":"b535d5c7264d6875c6464d6d5e6b6d6d01fd828d88739e2ac33b940143614c43"} Mar 16 16:33:53 crc kubenswrapper[5120]: I0316 16:33:53.002929 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"eea6594f-2384-40f5-9061-e3925083e279","Type":"ContainerStarted","Data":"b98cb9933dd96e0dc2187ba1a89b78b4fca5cd424ce2c02f561b0a2519487dce"} Mar 16 16:33:53 crc kubenswrapper[5120]: I0316 16:33:53.010343 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-d47d8c655-p8r55" Mar 16 16:33:53 crc kubenswrapper[5120]: I0316 16:33:53.011360 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a852d347-fc5c-4b18-99f0-dac8917749e5","Type":"ContainerStarted","Data":"c6f3972e3a74ec9462317de3fd811c947837c67280fbc7fc210b0c5c4bb59a78"} Mar 16 16:33:53 crc kubenswrapper[5120]: I0316 16:33:53.039240 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-d47d8c655-p8r55"] Mar 16 16:33:53 crc kubenswrapper[5120]: I0316 16:33:53.049740 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-d47d8c655-p8r55"] Mar 16 16:33:54 crc kubenswrapper[5120]: I0316 16:33:54.032438 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"eea6594f-2384-40f5-9061-e3925083e279","Type":"ContainerStarted","Data":"a090be84f2bc4f63da6fe24ea6fd1308ca4da6645a70816deb3537d0041816e9"} Mar 16 16:33:54 crc kubenswrapper[5120]: I0316 16:33:54.040736 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"48a68bcb-2d44-4992-b9a9-0409c2348fb1","Type":"ContainerStarted","Data":"bed66acd818bf9ec3122212cf7b4cdbe084eaee25adc4cc27a99522f61b452e7"} Mar 16 16:33:54 crc kubenswrapper[5120]: I0316 16:33:54.063091 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-external-api-0" podStartSLOduration=4.063074212 podStartE2EDuration="4.063074212s" podCreationTimestamp="2026-03-16 16:33:50 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:33:54.061890112 +0000 UTC m=+3736.215821759" watchObservedRunningTime="2026-03-16 16:33:54.063074212 +0000 UTC m=+3736.217005869" Mar 16 16:33:54 crc kubenswrapper[5120]: I0316 16:33:54.679795 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="716a6317-5231-4c6a-8728-7162c24ff8fb" path="/var/lib/kubelet/pods/716a6317-5231-4c6a-8728-7162c24ff8fb/volumes" Mar 16 16:33:55 crc kubenswrapper[5120]: I0316 16:33:55.051801 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"eea6594f-2384-40f5-9061-e3925083e279","Type":"ContainerStarted","Data":"5093e2092031a93c0f43b9aa524141d4066c5a5b18cd23e768cf403e05b7da66"} Mar 16 16:33:55 crc kubenswrapper[5120]: I0316 16:33:55.054666 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a852d347-fc5c-4b18-99f0-dac8917749e5","Type":"ContainerStarted","Data":"87797890bed4153c8c1800b5f0fade5e09055dbc5a07a2cf0fc76fbf4e30fd96"} Mar 16 16:33:55 crc kubenswrapper[5120]: I0316 16:33:55.054779 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="a852d347-fc5c-4b18-99f0-dac8917749e5" containerName="ceilometer-central-agent" containerID="cri-o://b36170e2bb77d50900804cd1777a276283bfe4d0bf59d5eda92021db37cd521c" gracePeriod=30 Mar 16 16:33:55 crc kubenswrapper[5120]: I0316 16:33:55.054809 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="a852d347-fc5c-4b18-99f0-dac8917749e5" containerName="sg-core" containerID="cri-o://c6f3972e3a74ec9462317de3fd811c947837c67280fbc7fc210b0c5c4bb59a78" gracePeriod=30 Mar 16 16:33:55 crc kubenswrapper[5120]: I0316 16:33:55.054813 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="a852d347-fc5c-4b18-99f0-dac8917749e5" containerName="proxy-httpd" containerID="cri-o://87797890bed4153c8c1800b5f0fade5e09055dbc5a07a2cf0fc76fbf4e30fd96" gracePeriod=30 Mar 16 16:33:55 crc kubenswrapper[5120]: I0316 16:33:55.054847 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="a852d347-fc5c-4b18-99f0-dac8917749e5" containerName="ceilometer-notification-agent" containerID="cri-o://7f9b1ce291d3e9971cc2c84756c8527288cc97a5bf68f6a05aa1c4a290707ab1" gracePeriod=30 Mar 16 16:33:55 crc kubenswrapper[5120]: I0316 16:33:55.054828 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:33:55 crc kubenswrapper[5120]: I0316 16:33:55.078372 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-internal-api-0" podStartSLOduration=3.078352627 podStartE2EDuration="3.078352627s" podCreationTimestamp="2026-03-16 16:33:52 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:33:55.070638864 +0000 UTC m=+3737.224570531" watchObservedRunningTime="2026-03-16 16:33:55.078352627 +0000 UTC m=+3737.232284284" Mar 16 16:33:55 crc kubenswrapper[5120]: I0316 16:33:55.104814 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.737827635 podStartE2EDuration="8.104793848s" podCreationTimestamp="2026-03-16 16:33:47 +0000 UTC" firstStartedPulling="2026-03-16 16:33:48.898942826 +0000 UTC m=+3731.052874483" lastFinishedPulling="2026-03-16 16:33:54.265909039 +0000 UTC m=+3736.419840696" observedRunningTime="2026-03-16 16:33:55.100458964 +0000 UTC m=+3737.254390621" watchObservedRunningTime="2026-03-16 16:33:55.104793848 +0000 UTC m=+3737.258725505" Mar 16 16:33:56 crc kubenswrapper[5120]: I0316 16:33:56.067079 5120 generic.go:358] "Generic (PLEG): container finished" podID="8bdf17ec-c07e-48a9-b713-e065819e9978" containerID="1d054768b62c314b704f4287a575c43e550c03ae01ecc0e24f377fdbbace0e63" exitCode=0 Mar 16 16:33:56 crc kubenswrapper[5120]: I0316 16:33:56.067187 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-s66xx" event={"ID":"8bdf17ec-c07e-48a9-b713-e065819e9978","Type":"ContainerDied","Data":"1d054768b62c314b704f4287a575c43e550c03ae01ecc0e24f377fdbbace0e63"} Mar 16 16:33:56 crc kubenswrapper[5120]: I0316 16:33:56.070639 5120 generic.go:358] "Generic (PLEG): container finished" podID="a852d347-fc5c-4b18-99f0-dac8917749e5" containerID="87797890bed4153c8c1800b5f0fade5e09055dbc5a07a2cf0fc76fbf4e30fd96" exitCode=0 Mar 16 16:33:56 crc kubenswrapper[5120]: I0316 16:33:56.070673 5120 generic.go:358] "Generic (PLEG): container finished" podID="a852d347-fc5c-4b18-99f0-dac8917749e5" containerID="c6f3972e3a74ec9462317de3fd811c947837c67280fbc7fc210b0c5c4bb59a78" exitCode=2 Mar 16 16:33:56 crc kubenswrapper[5120]: I0316 16:33:56.070682 5120 generic.go:358] "Generic (PLEG): container finished" podID="a852d347-fc5c-4b18-99f0-dac8917749e5" containerID="7f9b1ce291d3e9971cc2c84756c8527288cc97a5bf68f6a05aa1c4a290707ab1" exitCode=0 Mar 16 16:33:56 crc kubenswrapper[5120]: I0316 16:33:56.070724 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a852d347-fc5c-4b18-99f0-dac8917749e5","Type":"ContainerDied","Data":"87797890bed4153c8c1800b5f0fade5e09055dbc5a07a2cf0fc76fbf4e30fd96"} Mar 16 16:33:56 crc kubenswrapper[5120]: I0316 16:33:56.070851 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a852d347-fc5c-4b18-99f0-dac8917749e5","Type":"ContainerDied","Data":"c6f3972e3a74ec9462317de3fd811c947837c67280fbc7fc210b0c5c4bb59a78"} Mar 16 16:33:56 crc kubenswrapper[5120]: I0316 16:33:56.070863 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a852d347-fc5c-4b18-99f0-dac8917749e5","Type":"ContainerDied","Data":"7f9b1ce291d3e9971cc2c84756c8527288cc97a5bf68f6a05aa1c4a290707ab1"} Mar 16 16:33:57 crc kubenswrapper[5120]: I0316 16:33:57.459044 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-s66xx" Mar 16 16:33:57 crc kubenswrapper[5120]: I0316 16:33:57.606932 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8bdf17ec-c07e-48a9-b713-e065819e9978-scripts\") pod \"8bdf17ec-c07e-48a9-b713-e065819e9978\" (UID: \"8bdf17ec-c07e-48a9-b713-e065819e9978\") " Mar 16 16:33:57 crc kubenswrapper[5120]: I0316 16:33:57.607263 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8bdf17ec-c07e-48a9-b713-e065819e9978-config-data\") pod \"8bdf17ec-c07e-48a9-b713-e065819e9978\" (UID: \"8bdf17ec-c07e-48a9-b713-e065819e9978\") " Mar 16 16:33:57 crc kubenswrapper[5120]: I0316 16:33:57.607378 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-thg99\" (UniqueName: \"kubernetes.io/projected/8bdf17ec-c07e-48a9-b713-e065819e9978-kube-api-access-thg99\") pod \"8bdf17ec-c07e-48a9-b713-e065819e9978\" (UID: \"8bdf17ec-c07e-48a9-b713-e065819e9978\") " Mar 16 16:33:57 crc kubenswrapper[5120]: I0316 16:33:57.607499 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8bdf17ec-c07e-48a9-b713-e065819e9978-combined-ca-bundle\") pod \"8bdf17ec-c07e-48a9-b713-e065819e9978\" (UID: \"8bdf17ec-c07e-48a9-b713-e065819e9978\") " Mar 16 16:33:57 crc kubenswrapper[5120]: I0316 16:33:57.615906 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8bdf17ec-c07e-48a9-b713-e065819e9978-scripts" (OuterVolumeSpecName: "scripts") pod "8bdf17ec-c07e-48a9-b713-e065819e9978" (UID: "8bdf17ec-c07e-48a9-b713-e065819e9978"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:33:57 crc kubenswrapper[5120]: I0316 16:33:57.616502 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8bdf17ec-c07e-48a9-b713-e065819e9978-kube-api-access-thg99" (OuterVolumeSpecName: "kube-api-access-thg99") pod "8bdf17ec-c07e-48a9-b713-e065819e9978" (UID: "8bdf17ec-c07e-48a9-b713-e065819e9978"). InnerVolumeSpecName "kube-api-access-thg99". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:33:57 crc kubenswrapper[5120]: I0316 16:33:57.633742 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8bdf17ec-c07e-48a9-b713-e065819e9978-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "8bdf17ec-c07e-48a9-b713-e065819e9978" (UID: "8bdf17ec-c07e-48a9-b713-e065819e9978"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:33:57 crc kubenswrapper[5120]: I0316 16:33:57.634266 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8bdf17ec-c07e-48a9-b713-e065819e9978-config-data" (OuterVolumeSpecName: "config-data") pod "8bdf17ec-c07e-48a9-b713-e065819e9978" (UID: "8bdf17ec-c07e-48a9-b713-e065819e9978"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:33:57 crc kubenswrapper[5120]: I0316 16:33:57.709911 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8bdf17ec-c07e-48a9-b713-e065819e9978-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:33:57 crc kubenswrapper[5120]: I0316 16:33:57.709943 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-thg99\" (UniqueName: \"kubernetes.io/projected/8bdf17ec-c07e-48a9-b713-e065819e9978-kube-api-access-thg99\") on node \"crc\" DevicePath \"\"" Mar 16 16:33:57 crc kubenswrapper[5120]: I0316 16:33:57.709955 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8bdf17ec-c07e-48a9-b713-e065819e9978-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:33:57 crc kubenswrapper[5120]: I0316 16:33:57.709964 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8bdf17ec-c07e-48a9-b713-e065819e9978-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:33:58 crc kubenswrapper[5120]: I0316 16:33:58.095185 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-s66xx" event={"ID":"8bdf17ec-c07e-48a9-b713-e065819e9978","Type":"ContainerDied","Data":"135f5138538e6f3dfed2e1beb4b86f34e530e9bc99a6b9f4179af43326d1e522"} Mar 16 16:33:58 crc kubenswrapper[5120]: I0316 16:33:58.095221 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="135f5138538e6f3dfed2e1beb4b86f34e530e9bc99a6b9f4179af43326d1e522" Mar 16 16:33:58 crc kubenswrapper[5120]: I0316 16:33:58.095282 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-s66xx" Mar 16 16:33:58 crc kubenswrapper[5120]: I0316 16:33:58.177417 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:33:58 crc kubenswrapper[5120]: I0316 16:33:58.178495 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8bdf17ec-c07e-48a9-b713-e065819e9978" containerName="nova-cell0-conductor-db-sync" Mar 16 16:33:58 crc kubenswrapper[5120]: I0316 16:33:58.178516 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8bdf17ec-c07e-48a9-b713-e065819e9978" containerName="nova-cell0-conductor-db-sync" Mar 16 16:33:58 crc kubenswrapper[5120]: I0316 16:33:58.178695 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="8bdf17ec-c07e-48a9-b713-e065819e9978" containerName="nova-cell0-conductor-db-sync" Mar 16 16:33:58 crc kubenswrapper[5120]: I0316 16:33:58.186809 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:33:58 crc kubenswrapper[5120]: I0316 16:33:58.187972 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:33:58 crc kubenswrapper[5120]: I0316 16:33:58.190526 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-nova-dockercfg-82lps\"" Mar 16 16:33:58 crc kubenswrapper[5120]: I0316 16:33:58.190893 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-conductor-config-data\"" Mar 16 16:33:58 crc kubenswrapper[5120]: I0316 16:33:58.324454 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzrbl\" (UniqueName: \"kubernetes.io/projected/84f67b87-419d-457b-a40c-b47e8406d39c-kube-api-access-gzrbl\") pod \"nova-cell0-conductor-0\" (UID: \"84f67b87-419d-457b-a40c-b47e8406d39c\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:33:58 crc kubenswrapper[5120]: I0316 16:33:58.324850 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/84f67b87-419d-457b-a40c-b47e8406d39c-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"84f67b87-419d-457b-a40c-b47e8406d39c\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:33:58 crc kubenswrapper[5120]: I0316 16:33:58.324912 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/84f67b87-419d-457b-a40c-b47e8406d39c-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"84f67b87-419d-457b-a40c-b47e8406d39c\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:33:58 crc kubenswrapper[5120]: I0316 16:33:58.427444 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/84f67b87-419d-457b-a40c-b47e8406d39c-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"84f67b87-419d-457b-a40c-b47e8406d39c\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:33:58 crc kubenswrapper[5120]: I0316 16:33:58.427525 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/84f67b87-419d-457b-a40c-b47e8406d39c-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"84f67b87-419d-457b-a40c-b47e8406d39c\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:33:58 crc kubenswrapper[5120]: I0316 16:33:58.427816 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gzrbl\" (UniqueName: \"kubernetes.io/projected/84f67b87-419d-457b-a40c-b47e8406d39c-kube-api-access-gzrbl\") pod \"nova-cell0-conductor-0\" (UID: \"84f67b87-419d-457b-a40c-b47e8406d39c\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:33:58 crc kubenswrapper[5120]: I0316 16:33:58.435242 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/84f67b87-419d-457b-a40c-b47e8406d39c-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"84f67b87-419d-457b-a40c-b47e8406d39c\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:33:58 crc kubenswrapper[5120]: I0316 16:33:58.443697 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/84f67b87-419d-457b-a40c-b47e8406d39c-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"84f67b87-419d-457b-a40c-b47e8406d39c\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:33:58 crc kubenswrapper[5120]: I0316 16:33:58.459690 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzrbl\" (UniqueName: \"kubernetes.io/projected/84f67b87-419d-457b-a40c-b47e8406d39c-kube-api-access-gzrbl\") pod \"nova-cell0-conductor-0\" (UID: \"84f67b87-419d-457b-a40c-b47e8406d39c\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:33:58 crc kubenswrapper[5120]: I0316 16:33:58.517740 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:33:58 crc kubenswrapper[5120]: I0316 16:33:58.978587 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:33:58 crc kubenswrapper[5120]: W0316 16:33:58.981439 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod84f67b87_419d_457b_a40c_b47e8406d39c.slice/crio-177d6605320fd629c2fc0ed86661de02605dd521b4cfe567ea8ef6002666d57f WatchSource:0}: Error finding container 177d6605320fd629c2fc0ed86661de02605dd521b4cfe567ea8ef6002666d57f: Status 404 returned error can't find the container with id 177d6605320fd629c2fc0ed86661de02605dd521b4cfe567ea8ef6002666d57f Mar 16 16:33:59 crc kubenswrapper[5120]: I0316 16:33:59.125077 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"84f67b87-419d-457b-a40c-b47e8406d39c","Type":"ContainerStarted","Data":"177d6605320fd629c2fc0ed86661de02605dd521b4cfe567ea8ef6002666d57f"} Mar 16 16:33:59 crc kubenswrapper[5120]: I0316 16:33:59.955259 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:34:00 crc kubenswrapper[5120]: I0316 16:34:00.069182 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/neutron-587c77d488-zm2nq" podUID="6aae3bc4-66a0-436a-b3b3-13d2be73a3de" containerName="neutron-httpd" probeResult="failure" output="Get \"http://10.217.0.163:9696/\": dial tcp 10.217.0.163:9696: connect: connection refused" Mar 16 16:34:00 crc kubenswrapper[5120]: I0316 16:34:00.080388 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a852d347-fc5c-4b18-99f0-dac8917749e5-combined-ca-bundle\") pod \"a852d347-fc5c-4b18-99f0-dac8917749e5\" (UID: \"a852d347-fc5c-4b18-99f0-dac8917749e5\") " Mar 16 16:34:00 crc kubenswrapper[5120]: I0316 16:34:00.080562 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a852d347-fc5c-4b18-99f0-dac8917749e5-run-httpd\") pod \"a852d347-fc5c-4b18-99f0-dac8917749e5\" (UID: \"a852d347-fc5c-4b18-99f0-dac8917749e5\") " Mar 16 16:34:00 crc kubenswrapper[5120]: I0316 16:34:00.080820 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a852d347-fc5c-4b18-99f0-dac8917749e5-scripts\") pod \"a852d347-fc5c-4b18-99f0-dac8917749e5\" (UID: \"a852d347-fc5c-4b18-99f0-dac8917749e5\") " Mar 16 16:34:00 crc kubenswrapper[5120]: I0316 16:34:00.081038 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a852d347-fc5c-4b18-99f0-dac8917749e5-config-data\") pod \"a852d347-fc5c-4b18-99f0-dac8917749e5\" (UID: \"a852d347-fc5c-4b18-99f0-dac8917749e5\") " Mar 16 16:34:00 crc kubenswrapper[5120]: I0316 16:34:00.081114 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t9pxk\" (UniqueName: \"kubernetes.io/projected/a852d347-fc5c-4b18-99f0-dac8917749e5-kube-api-access-t9pxk\") pod \"a852d347-fc5c-4b18-99f0-dac8917749e5\" (UID: \"a852d347-fc5c-4b18-99f0-dac8917749e5\") " Mar 16 16:34:00 crc kubenswrapper[5120]: I0316 16:34:00.081039 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a852d347-fc5c-4b18-99f0-dac8917749e5-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "a852d347-fc5c-4b18-99f0-dac8917749e5" (UID: "a852d347-fc5c-4b18-99f0-dac8917749e5"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:34:00 crc kubenswrapper[5120]: I0316 16:34:00.081223 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/a852d347-fc5c-4b18-99f0-dac8917749e5-sg-core-conf-yaml\") pod \"a852d347-fc5c-4b18-99f0-dac8917749e5\" (UID: \"a852d347-fc5c-4b18-99f0-dac8917749e5\") " Mar 16 16:34:00 crc kubenswrapper[5120]: I0316 16:34:00.081429 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a852d347-fc5c-4b18-99f0-dac8917749e5-log-httpd\") pod \"a852d347-fc5c-4b18-99f0-dac8917749e5\" (UID: \"a852d347-fc5c-4b18-99f0-dac8917749e5\") " Mar 16 16:34:00 crc kubenswrapper[5120]: I0316 16:34:00.082018 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a852d347-fc5c-4b18-99f0-dac8917749e5-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:34:00 crc kubenswrapper[5120]: I0316 16:34:00.082682 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a852d347-fc5c-4b18-99f0-dac8917749e5-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "a852d347-fc5c-4b18-99f0-dac8917749e5" (UID: "a852d347-fc5c-4b18-99f0-dac8917749e5"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:34:00 crc kubenswrapper[5120]: I0316 16:34:00.087166 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a852d347-fc5c-4b18-99f0-dac8917749e5-kube-api-access-t9pxk" (OuterVolumeSpecName: "kube-api-access-t9pxk") pod "a852d347-fc5c-4b18-99f0-dac8917749e5" (UID: "a852d347-fc5c-4b18-99f0-dac8917749e5"). InnerVolumeSpecName "kube-api-access-t9pxk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:34:00 crc kubenswrapper[5120]: I0316 16:34:00.099023 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a852d347-fc5c-4b18-99f0-dac8917749e5-scripts" (OuterVolumeSpecName: "scripts") pod "a852d347-fc5c-4b18-99f0-dac8917749e5" (UID: "a852d347-fc5c-4b18-99f0-dac8917749e5"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:34:00 crc kubenswrapper[5120]: I0316 16:34:00.135085 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a852d347-fc5c-4b18-99f0-dac8917749e5-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "a852d347-fc5c-4b18-99f0-dac8917749e5" (UID: "a852d347-fc5c-4b18-99f0-dac8917749e5"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:34:00 crc kubenswrapper[5120]: I0316 16:34:00.154252 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-infra/auto-csr-approver-29561314-s8vrr"] Mar 16 16:34:00 crc kubenswrapper[5120]: I0316 16:34:00.155289 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a852d347-fc5c-4b18-99f0-dac8917749e5" containerName="proxy-httpd" Mar 16 16:34:00 crc kubenswrapper[5120]: I0316 16:34:00.155311 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a852d347-fc5c-4b18-99f0-dac8917749e5" containerName="proxy-httpd" Mar 16 16:34:00 crc kubenswrapper[5120]: I0316 16:34:00.155337 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a852d347-fc5c-4b18-99f0-dac8917749e5" containerName="ceilometer-notification-agent" Mar 16 16:34:00 crc kubenswrapper[5120]: I0316 16:34:00.155344 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a852d347-fc5c-4b18-99f0-dac8917749e5" containerName="ceilometer-notification-agent" Mar 16 16:34:00 crc kubenswrapper[5120]: I0316 16:34:00.155391 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a852d347-fc5c-4b18-99f0-dac8917749e5" containerName="sg-core" Mar 16 16:34:00 crc kubenswrapper[5120]: I0316 16:34:00.155396 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a852d347-fc5c-4b18-99f0-dac8917749e5" containerName="sg-core" Mar 16 16:34:00 crc kubenswrapper[5120]: I0316 16:34:00.155406 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a852d347-fc5c-4b18-99f0-dac8917749e5" containerName="ceilometer-central-agent" Mar 16 16:34:00 crc kubenswrapper[5120]: I0316 16:34:00.155411 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a852d347-fc5c-4b18-99f0-dac8917749e5" containerName="ceilometer-central-agent" Mar 16 16:34:00 crc kubenswrapper[5120]: I0316 16:34:00.155575 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="a852d347-fc5c-4b18-99f0-dac8917749e5" containerName="ceilometer-notification-agent" Mar 16 16:34:00 crc kubenswrapper[5120]: I0316 16:34:00.155592 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="a852d347-fc5c-4b18-99f0-dac8917749e5" containerName="proxy-httpd" Mar 16 16:34:00 crc kubenswrapper[5120]: I0316 16:34:00.155604 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="a852d347-fc5c-4b18-99f0-dac8917749e5" containerName="ceilometer-central-agent" Mar 16 16:34:00 crc kubenswrapper[5120]: I0316 16:34:00.155612 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="a852d347-fc5c-4b18-99f0-dac8917749e5" containerName="sg-core" Mar 16 16:34:00 crc kubenswrapper[5120]: I0316 16:34:00.160845 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561314-s8vrr" Mar 16 16:34:00 crc kubenswrapper[5120]: I0316 16:34:00.163311 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"kube-root-ca.crt\"" Mar 16 16:34:00 crc kubenswrapper[5120]: I0316 16:34:00.163602 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-infra\"/\"csr-approver-sa-dockercfg-x2nsz\"" Mar 16 16:34:00 crc kubenswrapper[5120]: I0316 16:34:00.164319 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"84f67b87-419d-457b-a40c-b47e8406d39c","Type":"ContainerStarted","Data":"20b14cb73912a1ea8aaef52cb856cecb710f82e72aeb94e10fec11a89f661054"} Mar 16 16:34:00 crc kubenswrapper[5120]: I0316 16:34:00.164375 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561314-s8vrr"] Mar 16 16:34:00 crc kubenswrapper[5120]: I0316 16:34:00.164420 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:34:00 crc kubenswrapper[5120]: I0316 16:34:00.167570 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"openshift-service-ca.crt\"" Mar 16 16:34:00 crc kubenswrapper[5120]: I0316 16:34:00.171748 5120 generic.go:358] "Generic (PLEG): container finished" podID="a852d347-fc5c-4b18-99f0-dac8917749e5" containerID="b36170e2bb77d50900804cd1777a276283bfe4d0bf59d5eda92021db37cd521c" exitCode=0 Mar 16 16:34:00 crc kubenswrapper[5120]: I0316 16:34:00.175092 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a852d347-fc5c-4b18-99f0-dac8917749e5","Type":"ContainerDied","Data":"b36170e2bb77d50900804cd1777a276283bfe4d0bf59d5eda92021db37cd521c"} Mar 16 16:34:00 crc kubenswrapper[5120]: I0316 16:34:00.175134 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a852d347-fc5c-4b18-99f0-dac8917749e5","Type":"ContainerDied","Data":"cfd5b873f90e7d7e4f493eeb7e6ff00d240377e00e412d12ad29a0ab70a1315a"} Mar 16 16:34:00 crc kubenswrapper[5120]: I0316 16:34:00.175149 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:34:00 crc kubenswrapper[5120]: I0316 16:34:00.175157 5120 scope.go:117] "RemoveContainer" containerID="87797890bed4153c8c1800b5f0fade5e09055dbc5a07a2cf0fc76fbf4e30fd96" Mar 16 16:34:00 crc kubenswrapper[5120]: I0316 16:34:00.184393 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t9pxk\" (UniqueName: \"kubernetes.io/projected/a852d347-fc5c-4b18-99f0-dac8917749e5-kube-api-access-t9pxk\") on node \"crc\" DevicePath \"\"" Mar 16 16:34:00 crc kubenswrapper[5120]: I0316 16:34:00.184424 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/a852d347-fc5c-4b18-99f0-dac8917749e5-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 16:34:00 crc kubenswrapper[5120]: I0316 16:34:00.184441 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a852d347-fc5c-4b18-99f0-dac8917749e5-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:34:00 crc kubenswrapper[5120]: I0316 16:34:00.184452 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a852d347-fc5c-4b18-99f0-dac8917749e5-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:34:00 crc kubenswrapper[5120]: I0316 16:34:00.200862 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podStartSLOduration=2.200841073 podStartE2EDuration="2.200841073s" podCreationTimestamp="2026-03-16 16:33:58 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:34:00.190651007 +0000 UTC m=+3742.344582664" watchObservedRunningTime="2026-03-16 16:34:00.200841073 +0000 UTC m=+3742.354772730" Mar 16 16:34:00 crc kubenswrapper[5120]: I0316 16:34:00.202506 5120 scope.go:117] "RemoveContainer" containerID="c6f3972e3a74ec9462317de3fd811c947837c67280fbc7fc210b0c5c4bb59a78" Mar 16 16:34:00 crc kubenswrapper[5120]: I0316 16:34:00.203921 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a852d347-fc5c-4b18-99f0-dac8917749e5-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "a852d347-fc5c-4b18-99f0-dac8917749e5" (UID: "a852d347-fc5c-4b18-99f0-dac8917749e5"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:34:00 crc kubenswrapper[5120]: I0316 16:34:00.222271 5120 scope.go:117] "RemoveContainer" containerID="7f9b1ce291d3e9971cc2c84756c8527288cc97a5bf68f6a05aa1c4a290707ab1" Mar 16 16:34:00 crc kubenswrapper[5120]: I0316 16:34:00.235154 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a852d347-fc5c-4b18-99f0-dac8917749e5-config-data" (OuterVolumeSpecName: "config-data") pod "a852d347-fc5c-4b18-99f0-dac8917749e5" (UID: "a852d347-fc5c-4b18-99f0-dac8917749e5"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:34:00 crc kubenswrapper[5120]: I0316 16:34:00.243742 5120 scope.go:117] "RemoveContainer" containerID="b36170e2bb77d50900804cd1777a276283bfe4d0bf59d5eda92021db37cd521c" Mar 16 16:34:00 crc kubenswrapper[5120]: I0316 16:34:00.263517 5120 scope.go:117] "RemoveContainer" containerID="87797890bed4153c8c1800b5f0fade5e09055dbc5a07a2cf0fc76fbf4e30fd96" Mar 16 16:34:00 crc kubenswrapper[5120]: E0316 16:34:00.264053 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"87797890bed4153c8c1800b5f0fade5e09055dbc5a07a2cf0fc76fbf4e30fd96\": container with ID starting with 87797890bed4153c8c1800b5f0fade5e09055dbc5a07a2cf0fc76fbf4e30fd96 not found: ID does not exist" containerID="87797890bed4153c8c1800b5f0fade5e09055dbc5a07a2cf0fc76fbf4e30fd96" Mar 16 16:34:00 crc kubenswrapper[5120]: I0316 16:34:00.264082 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87797890bed4153c8c1800b5f0fade5e09055dbc5a07a2cf0fc76fbf4e30fd96"} err="failed to get container status \"87797890bed4153c8c1800b5f0fade5e09055dbc5a07a2cf0fc76fbf4e30fd96\": rpc error: code = NotFound desc = could not find container \"87797890bed4153c8c1800b5f0fade5e09055dbc5a07a2cf0fc76fbf4e30fd96\": container with ID starting with 87797890bed4153c8c1800b5f0fade5e09055dbc5a07a2cf0fc76fbf4e30fd96 not found: ID does not exist" Mar 16 16:34:00 crc kubenswrapper[5120]: I0316 16:34:00.264101 5120 scope.go:117] "RemoveContainer" containerID="c6f3972e3a74ec9462317de3fd811c947837c67280fbc7fc210b0c5c4bb59a78" Mar 16 16:34:00 crc kubenswrapper[5120]: E0316 16:34:00.264569 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c6f3972e3a74ec9462317de3fd811c947837c67280fbc7fc210b0c5c4bb59a78\": container with ID starting with c6f3972e3a74ec9462317de3fd811c947837c67280fbc7fc210b0c5c4bb59a78 not found: ID does not exist" containerID="c6f3972e3a74ec9462317de3fd811c947837c67280fbc7fc210b0c5c4bb59a78" Mar 16 16:34:00 crc kubenswrapper[5120]: I0316 16:34:00.264593 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6f3972e3a74ec9462317de3fd811c947837c67280fbc7fc210b0c5c4bb59a78"} err="failed to get container status \"c6f3972e3a74ec9462317de3fd811c947837c67280fbc7fc210b0c5c4bb59a78\": rpc error: code = NotFound desc = could not find container \"c6f3972e3a74ec9462317de3fd811c947837c67280fbc7fc210b0c5c4bb59a78\": container with ID starting with c6f3972e3a74ec9462317de3fd811c947837c67280fbc7fc210b0c5c4bb59a78 not found: ID does not exist" Mar 16 16:34:00 crc kubenswrapper[5120]: I0316 16:34:00.264607 5120 scope.go:117] "RemoveContainer" containerID="7f9b1ce291d3e9971cc2c84756c8527288cc97a5bf68f6a05aa1c4a290707ab1" Mar 16 16:34:00 crc kubenswrapper[5120]: E0316 16:34:00.264985 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f9b1ce291d3e9971cc2c84756c8527288cc97a5bf68f6a05aa1c4a290707ab1\": container with ID starting with 7f9b1ce291d3e9971cc2c84756c8527288cc97a5bf68f6a05aa1c4a290707ab1 not found: ID does not exist" containerID="7f9b1ce291d3e9971cc2c84756c8527288cc97a5bf68f6a05aa1c4a290707ab1" Mar 16 16:34:00 crc kubenswrapper[5120]: I0316 16:34:00.265003 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f9b1ce291d3e9971cc2c84756c8527288cc97a5bf68f6a05aa1c4a290707ab1"} err="failed to get container status \"7f9b1ce291d3e9971cc2c84756c8527288cc97a5bf68f6a05aa1c4a290707ab1\": rpc error: code = NotFound desc = could not find container \"7f9b1ce291d3e9971cc2c84756c8527288cc97a5bf68f6a05aa1c4a290707ab1\": container with ID starting with 7f9b1ce291d3e9971cc2c84756c8527288cc97a5bf68f6a05aa1c4a290707ab1 not found: ID does not exist" Mar 16 16:34:00 crc kubenswrapper[5120]: I0316 16:34:00.265014 5120 scope.go:117] "RemoveContainer" containerID="b36170e2bb77d50900804cd1777a276283bfe4d0bf59d5eda92021db37cd521c" Mar 16 16:34:00 crc kubenswrapper[5120]: E0316 16:34:00.265223 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b36170e2bb77d50900804cd1777a276283bfe4d0bf59d5eda92021db37cd521c\": container with ID starting with b36170e2bb77d50900804cd1777a276283bfe4d0bf59d5eda92021db37cd521c not found: ID does not exist" containerID="b36170e2bb77d50900804cd1777a276283bfe4d0bf59d5eda92021db37cd521c" Mar 16 16:34:00 crc kubenswrapper[5120]: I0316 16:34:00.265251 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b36170e2bb77d50900804cd1777a276283bfe4d0bf59d5eda92021db37cd521c"} err="failed to get container status \"b36170e2bb77d50900804cd1777a276283bfe4d0bf59d5eda92021db37cd521c\": rpc error: code = NotFound desc = could not find container \"b36170e2bb77d50900804cd1777a276283bfe4d0bf59d5eda92021db37cd521c\": container with ID starting with b36170e2bb77d50900804cd1777a276283bfe4d0bf59d5eda92021db37cd521c not found: ID does not exist" Mar 16 16:34:00 crc kubenswrapper[5120]: I0316 16:34:00.286233 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52697\" (UniqueName: \"kubernetes.io/projected/564c9119-4d4c-4ff2-b7ae-7c066f8bdf57-kube-api-access-52697\") pod \"auto-csr-approver-29561314-s8vrr\" (UID: \"564c9119-4d4c-4ff2-b7ae-7c066f8bdf57\") " pod="openshift-infra/auto-csr-approver-29561314-s8vrr" Mar 16 16:34:00 crc kubenswrapper[5120]: I0316 16:34:00.286601 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a852d347-fc5c-4b18-99f0-dac8917749e5-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:34:00 crc kubenswrapper[5120]: I0316 16:34:00.286623 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a852d347-fc5c-4b18-99f0-dac8917749e5-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:34:00 crc kubenswrapper[5120]: I0316 16:34:00.388543 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-52697\" (UniqueName: \"kubernetes.io/projected/564c9119-4d4c-4ff2-b7ae-7c066f8bdf57-kube-api-access-52697\") pod \"auto-csr-approver-29561314-s8vrr\" (UID: \"564c9119-4d4c-4ff2-b7ae-7c066f8bdf57\") " pod="openshift-infra/auto-csr-approver-29561314-s8vrr" Mar 16 16:34:00 crc kubenswrapper[5120]: I0316 16:34:00.406460 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-52697\" (UniqueName: \"kubernetes.io/projected/564c9119-4d4c-4ff2-b7ae-7c066f8bdf57-kube-api-access-52697\") pod \"auto-csr-approver-29561314-s8vrr\" (UID: \"564c9119-4d4c-4ff2-b7ae-7c066f8bdf57\") " pod="openshift-infra/auto-csr-approver-29561314-s8vrr" Mar 16 16:34:00 crc kubenswrapper[5120]: I0316 16:34:00.495981 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561314-s8vrr" Mar 16 16:34:00 crc kubenswrapper[5120]: I0316 16:34:00.519364 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:34:00 crc kubenswrapper[5120]: I0316 16:34:00.542103 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:34:00 crc kubenswrapper[5120]: I0316 16:34:00.553529 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:34:00 crc kubenswrapper[5120]: I0316 16:34:00.565567 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:34:00 crc kubenswrapper[5120]: I0316 16:34:00.568016 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 16:34:00 crc kubenswrapper[5120]: I0316 16:34:00.568222 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 16:34:00 crc kubenswrapper[5120]: I0316 16:34:00.587135 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:34:00 crc kubenswrapper[5120]: I0316 16:34:00.680092 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a852d347-fc5c-4b18-99f0-dac8917749e5" path="/var/lib/kubelet/pods/a852d347-fc5c-4b18-99f0-dac8917749e5/volumes" Mar 16 16:34:00 crc kubenswrapper[5120]: I0316 16:34:00.695882 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/c807ead6-beff-4a5b-bf14-c56bf9e4c0f0-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"c807ead6-beff-4a5b-bf14-c56bf9e4c0f0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:34:00 crc kubenswrapper[5120]: I0316 16:34:00.696147 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c807ead6-beff-4a5b-bf14-c56bf9e4c0f0-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"c807ead6-beff-4a5b-bf14-c56bf9e4c0f0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:34:00 crc kubenswrapper[5120]: I0316 16:34:00.696184 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c807ead6-beff-4a5b-bf14-c56bf9e4c0f0-run-httpd\") pod \"ceilometer-0\" (UID: \"c807ead6-beff-4a5b-bf14-c56bf9e4c0f0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:34:00 crc kubenswrapper[5120]: I0316 16:34:00.696251 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2sbpp\" (UniqueName: \"kubernetes.io/projected/c807ead6-beff-4a5b-bf14-c56bf9e4c0f0-kube-api-access-2sbpp\") pod \"ceilometer-0\" (UID: \"c807ead6-beff-4a5b-bf14-c56bf9e4c0f0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:34:00 crc kubenswrapper[5120]: I0316 16:34:00.696277 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c807ead6-beff-4a5b-bf14-c56bf9e4c0f0-log-httpd\") pod \"ceilometer-0\" (UID: \"c807ead6-beff-4a5b-bf14-c56bf9e4c0f0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:34:00 crc kubenswrapper[5120]: I0316 16:34:00.696402 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c807ead6-beff-4a5b-bf14-c56bf9e4c0f0-config-data\") pod \"ceilometer-0\" (UID: \"c807ead6-beff-4a5b-bf14-c56bf9e4c0f0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:34:00 crc kubenswrapper[5120]: I0316 16:34:00.696912 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c807ead6-beff-4a5b-bf14-c56bf9e4c0f0-scripts\") pod \"ceilometer-0\" (UID: \"c807ead6-beff-4a5b-bf14-c56bf9e4c0f0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:34:00 crc kubenswrapper[5120]: I0316 16:34:00.798949 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/c807ead6-beff-4a5b-bf14-c56bf9e4c0f0-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"c807ead6-beff-4a5b-bf14-c56bf9e4c0f0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:34:00 crc kubenswrapper[5120]: I0316 16:34:00.799410 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c807ead6-beff-4a5b-bf14-c56bf9e4c0f0-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"c807ead6-beff-4a5b-bf14-c56bf9e4c0f0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:34:00 crc kubenswrapper[5120]: I0316 16:34:00.799454 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c807ead6-beff-4a5b-bf14-c56bf9e4c0f0-run-httpd\") pod \"ceilometer-0\" (UID: \"c807ead6-beff-4a5b-bf14-c56bf9e4c0f0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:34:00 crc kubenswrapper[5120]: I0316 16:34:00.799509 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2sbpp\" (UniqueName: \"kubernetes.io/projected/c807ead6-beff-4a5b-bf14-c56bf9e4c0f0-kube-api-access-2sbpp\") pod \"ceilometer-0\" (UID: \"c807ead6-beff-4a5b-bf14-c56bf9e4c0f0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:34:00 crc kubenswrapper[5120]: I0316 16:34:00.799534 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c807ead6-beff-4a5b-bf14-c56bf9e4c0f0-log-httpd\") pod \"ceilometer-0\" (UID: \"c807ead6-beff-4a5b-bf14-c56bf9e4c0f0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:34:00 crc kubenswrapper[5120]: I0316 16:34:00.799619 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c807ead6-beff-4a5b-bf14-c56bf9e4c0f0-config-data\") pod \"ceilometer-0\" (UID: \"c807ead6-beff-4a5b-bf14-c56bf9e4c0f0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:34:00 crc kubenswrapper[5120]: I0316 16:34:00.799767 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c807ead6-beff-4a5b-bf14-c56bf9e4c0f0-scripts\") pod \"ceilometer-0\" (UID: \"c807ead6-beff-4a5b-bf14-c56bf9e4c0f0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:34:00 crc kubenswrapper[5120]: I0316 16:34:00.801251 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c807ead6-beff-4a5b-bf14-c56bf9e4c0f0-run-httpd\") pod \"ceilometer-0\" (UID: \"c807ead6-beff-4a5b-bf14-c56bf9e4c0f0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:34:00 crc kubenswrapper[5120]: I0316 16:34:00.802818 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c807ead6-beff-4a5b-bf14-c56bf9e4c0f0-log-httpd\") pod \"ceilometer-0\" (UID: \"c807ead6-beff-4a5b-bf14-c56bf9e4c0f0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:34:00 crc kubenswrapper[5120]: I0316 16:34:00.808668 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c807ead6-beff-4a5b-bf14-c56bf9e4c0f0-scripts\") pod \"ceilometer-0\" (UID: \"c807ead6-beff-4a5b-bf14-c56bf9e4c0f0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:34:00 crc kubenswrapper[5120]: I0316 16:34:00.809043 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c807ead6-beff-4a5b-bf14-c56bf9e4c0f0-config-data\") pod \"ceilometer-0\" (UID: \"c807ead6-beff-4a5b-bf14-c56bf9e4c0f0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:34:00 crc kubenswrapper[5120]: I0316 16:34:00.809586 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c807ead6-beff-4a5b-bf14-c56bf9e4c0f0-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"c807ead6-beff-4a5b-bf14-c56bf9e4c0f0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:34:00 crc kubenswrapper[5120]: I0316 16:34:00.812169 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/c807ead6-beff-4a5b-bf14-c56bf9e4c0f0-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"c807ead6-beff-4a5b-bf14-c56bf9e4c0f0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:34:00 crc kubenswrapper[5120]: I0316 16:34:00.819700 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2sbpp\" (UniqueName: \"kubernetes.io/projected/c807ead6-beff-4a5b-bf14-c56bf9e4c0f0-kube-api-access-2sbpp\") pod \"ceilometer-0\" (UID: \"c807ead6-beff-4a5b-bf14-c56bf9e4c0f0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:34:00 crc kubenswrapper[5120]: I0316 16:34:00.937697 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:34:01 crc kubenswrapper[5120]: I0316 16:34:01.013786 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561314-s8vrr"] Mar 16 16:34:01 crc kubenswrapper[5120]: I0316 16:34:01.190158 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561314-s8vrr" event={"ID":"564c9119-4d4c-4ff2-b7ae-7c066f8bdf57","Type":"ContainerStarted","Data":"007ba505a5749180c19e52bf2947c550049fd2cbc518cebc7556fba92d231a36"} Mar 16 16:34:01 crc kubenswrapper[5120]: I0316 16:34:01.360831 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:34:01 crc kubenswrapper[5120]: I0316 16:34:01.360889 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:34:01 crc kubenswrapper[5120]: I0316 16:34:01.396477 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:34:01 crc kubenswrapper[5120]: I0316 16:34:01.400007 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:34:01 crc kubenswrapper[5120]: I0316 16:34:01.407884 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:34:02 crc kubenswrapper[5120]: I0316 16:34:02.213404 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"c807ead6-beff-4a5b-bf14-c56bf9e4c0f0","Type":"ContainerStarted","Data":"08aaeb17b6cb85886578bbe37fdaa92cd247c3368ce379e44c23517f30c1ba73"} Mar 16 16:34:02 crc kubenswrapper[5120]: I0316 16:34:02.213956 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:34:02 crc kubenswrapper[5120]: I0316 16:34:02.214001 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"c807ead6-beff-4a5b-bf14-c56bf9e4c0f0","Type":"ContainerStarted","Data":"eff711e187a65e0a8a5e62e874f07d9b9b970f2b60ddefa16868cec9afa94777"} Mar 16 16:34:02 crc kubenswrapper[5120]: I0316 16:34:02.214066 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:34:02 crc kubenswrapper[5120]: I0316 16:34:02.412031 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:34:02 crc kubenswrapper[5120]: I0316 16:34:02.412508 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:34:02 crc kubenswrapper[5120]: I0316 16:34:02.461885 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:34:02 crc kubenswrapper[5120]: I0316 16:34:02.475594 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:34:03 crc kubenswrapper[5120]: I0316 16:34:03.225881 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"c807ead6-beff-4a5b-bf14-c56bf9e4c0f0","Type":"ContainerStarted","Data":"de5cc50c83c4257da798af24f5eed50af4cdd1e04aaf8625514902b4843fff87"} Mar 16 16:34:03 crc kubenswrapper[5120]: I0316 16:34:03.228391 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561314-s8vrr" event={"ID":"564c9119-4d4c-4ff2-b7ae-7c066f8bdf57","Type":"ContainerStarted","Data":"580ba5e6ec51e7055a14fa3afa5c3881995cac61570ad545bbe7467fac11d8df"} Mar 16 16:34:03 crc kubenswrapper[5120]: I0316 16:34:03.228959 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:34:03 crc kubenswrapper[5120]: I0316 16:34:03.228998 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:34:03 crc kubenswrapper[5120]: I0316 16:34:03.254810 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-infra/auto-csr-approver-29561314-s8vrr" podStartSLOduration=1.988952209 podStartE2EDuration="3.254786488s" podCreationTimestamp="2026-03-16 16:34:00 +0000 UTC" firstStartedPulling="2026-03-16 16:34:01.011215707 +0000 UTC m=+3743.165147364" lastFinishedPulling="2026-03-16 16:34:02.277049986 +0000 UTC m=+3744.430981643" observedRunningTime="2026-03-16 16:34:03.247331673 +0000 UTC m=+3745.401263330" watchObservedRunningTime="2026-03-16 16:34:03.254786488 +0000 UTC m=+3745.408718145" Mar 16 16:34:03 crc kubenswrapper[5120]: I0316 16:34:03.634015 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-587c77d488-zm2nq_6aae3bc4-66a0-436a-b3b3-13d2be73a3de/neutron-api/0.log" Mar 16 16:34:03 crc kubenswrapper[5120]: I0316 16:34:03.634335 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-587c77d488-zm2nq" Mar 16 16:34:03 crc kubenswrapper[5120]: I0316 16:34:03.678777 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mfw8h\" (UniqueName: \"kubernetes.io/projected/6aae3bc4-66a0-436a-b3b3-13d2be73a3de-kube-api-access-mfw8h\") pod \"6aae3bc4-66a0-436a-b3b3-13d2be73a3de\" (UID: \"6aae3bc4-66a0-436a-b3b3-13d2be73a3de\") " Mar 16 16:34:03 crc kubenswrapper[5120]: I0316 16:34:03.679111 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6aae3bc4-66a0-436a-b3b3-13d2be73a3de-config\") pod \"6aae3bc4-66a0-436a-b3b3-13d2be73a3de\" (UID: \"6aae3bc4-66a0-436a-b3b3-13d2be73a3de\") " Mar 16 16:34:03 crc kubenswrapper[5120]: I0316 16:34:03.679203 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/6aae3bc4-66a0-436a-b3b3-13d2be73a3de-ovndb-tls-certs\") pod \"6aae3bc4-66a0-436a-b3b3-13d2be73a3de\" (UID: \"6aae3bc4-66a0-436a-b3b3-13d2be73a3de\") " Mar 16 16:34:03 crc kubenswrapper[5120]: I0316 16:34:03.679470 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/6aae3bc4-66a0-436a-b3b3-13d2be73a3de-httpd-config\") pod \"6aae3bc4-66a0-436a-b3b3-13d2be73a3de\" (UID: \"6aae3bc4-66a0-436a-b3b3-13d2be73a3de\") " Mar 16 16:34:03 crc kubenswrapper[5120]: I0316 16:34:03.679568 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6aae3bc4-66a0-436a-b3b3-13d2be73a3de-combined-ca-bundle\") pod \"6aae3bc4-66a0-436a-b3b3-13d2be73a3de\" (UID: \"6aae3bc4-66a0-436a-b3b3-13d2be73a3de\") " Mar 16 16:34:03 crc kubenswrapper[5120]: I0316 16:34:03.702751 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6aae3bc4-66a0-436a-b3b3-13d2be73a3de-kube-api-access-mfw8h" (OuterVolumeSpecName: "kube-api-access-mfw8h") pod "6aae3bc4-66a0-436a-b3b3-13d2be73a3de" (UID: "6aae3bc4-66a0-436a-b3b3-13d2be73a3de"). InnerVolumeSpecName "kube-api-access-mfw8h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:34:03 crc kubenswrapper[5120]: I0316 16:34:03.719616 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6aae3bc4-66a0-436a-b3b3-13d2be73a3de-httpd-config" (OuterVolumeSpecName: "httpd-config") pod "6aae3bc4-66a0-436a-b3b3-13d2be73a3de" (UID: "6aae3bc4-66a0-436a-b3b3-13d2be73a3de"). InnerVolumeSpecName "httpd-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:34:03 crc kubenswrapper[5120]: I0316 16:34:03.759788 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6aae3bc4-66a0-436a-b3b3-13d2be73a3de-config" (OuterVolumeSpecName: "config") pod "6aae3bc4-66a0-436a-b3b3-13d2be73a3de" (UID: "6aae3bc4-66a0-436a-b3b3-13d2be73a3de"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:34:03 crc kubenswrapper[5120]: I0316 16:34:03.784847 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mfw8h\" (UniqueName: \"kubernetes.io/projected/6aae3bc4-66a0-436a-b3b3-13d2be73a3de-kube-api-access-mfw8h\") on node \"crc\" DevicePath \"\"" Mar 16 16:34:03 crc kubenswrapper[5120]: I0316 16:34:03.784892 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/6aae3bc4-66a0-436a-b3b3-13d2be73a3de-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:34:03 crc kubenswrapper[5120]: I0316 16:34:03.784906 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/6aae3bc4-66a0-436a-b3b3-13d2be73a3de-httpd-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:34:03 crc kubenswrapper[5120]: I0316 16:34:03.786191 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6aae3bc4-66a0-436a-b3b3-13d2be73a3de-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "6aae3bc4-66a0-436a-b3b3-13d2be73a3de" (UID: "6aae3bc4-66a0-436a-b3b3-13d2be73a3de"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:34:03 crc kubenswrapper[5120]: I0316 16:34:03.839862 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6aae3bc4-66a0-436a-b3b3-13d2be73a3de-ovndb-tls-certs" (OuterVolumeSpecName: "ovndb-tls-certs") pod "6aae3bc4-66a0-436a-b3b3-13d2be73a3de" (UID: "6aae3bc4-66a0-436a-b3b3-13d2be73a3de"). InnerVolumeSpecName "ovndb-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:34:03 crc kubenswrapper[5120]: I0316 16:34:03.887160 5120 reconciler_common.go:299] "Volume detached for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/6aae3bc4-66a0-436a-b3b3-13d2be73a3de-ovndb-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:34:03 crc kubenswrapper[5120]: I0316 16:34:03.887424 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6aae3bc4-66a0-436a-b3b3-13d2be73a3de-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:34:04 crc kubenswrapper[5120]: I0316 16:34:04.241062 5120 generic.go:358] "Generic (PLEG): container finished" podID="564c9119-4d4c-4ff2-b7ae-7c066f8bdf57" containerID="580ba5e6ec51e7055a14fa3afa5c3881995cac61570ad545bbe7467fac11d8df" exitCode=0 Mar 16 16:34:04 crc kubenswrapper[5120]: I0316 16:34:04.241521 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561314-s8vrr" event={"ID":"564c9119-4d4c-4ff2-b7ae-7c066f8bdf57","Type":"ContainerDied","Data":"580ba5e6ec51e7055a14fa3afa5c3881995cac61570ad545bbe7467fac11d8df"} Mar 16 16:34:04 crc kubenswrapper[5120]: I0316 16:34:04.245221 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-587c77d488-zm2nq_6aae3bc4-66a0-436a-b3b3-13d2be73a3de/neutron-api/0.log" Mar 16 16:34:04 crc kubenswrapper[5120]: I0316 16:34:04.245280 5120 generic.go:358] "Generic (PLEG): container finished" podID="6aae3bc4-66a0-436a-b3b3-13d2be73a3de" containerID="edd70813de326d9b1be3219b269f0e85d5c87d8f9ade26f447611458a3b1b08a" exitCode=137 Mar 16 16:34:04 crc kubenswrapper[5120]: I0316 16:34:04.245476 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-587c77d488-zm2nq" Mar 16 16:34:04 crc kubenswrapper[5120]: I0316 16:34:04.246829 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-587c77d488-zm2nq" event={"ID":"6aae3bc4-66a0-436a-b3b3-13d2be73a3de","Type":"ContainerDied","Data":"edd70813de326d9b1be3219b269f0e85d5c87d8f9ade26f447611458a3b1b08a"} Mar 16 16:34:04 crc kubenswrapper[5120]: I0316 16:34:04.246891 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-587c77d488-zm2nq" event={"ID":"6aae3bc4-66a0-436a-b3b3-13d2be73a3de","Type":"ContainerDied","Data":"5d4527a705e224cd69735bbcf43ab9f4299bcea63e3463877a9ab791646a8064"} Mar 16 16:34:04 crc kubenswrapper[5120]: I0316 16:34:04.246920 5120 scope.go:117] "RemoveContainer" containerID="3481a847d550596ff4f99fb9a428c4176854acc79aad578f33aa84b1279b7056" Mar 16 16:34:04 crc kubenswrapper[5120]: I0316 16:34:04.255591 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"c807ead6-beff-4a5b-bf14-c56bf9e4c0f0","Type":"ContainerStarted","Data":"e70da958b40a1214806e2e41be0d1bc42e3a3e588238a1bbc33512f5ddfb1ea8"} Mar 16 16:34:04 crc kubenswrapper[5120]: I0316 16:34:04.297740 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-587c77d488-zm2nq"] Mar 16 16:34:04 crc kubenswrapper[5120]: I0316 16:34:04.301448 5120 scope.go:117] "RemoveContainer" containerID="edd70813de326d9b1be3219b269f0e85d5c87d8f9ade26f447611458a3b1b08a" Mar 16 16:34:04 crc kubenswrapper[5120]: I0316 16:34:04.304684 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-587c77d488-zm2nq"] Mar 16 16:34:04 crc kubenswrapper[5120]: I0316 16:34:04.335545 5120 scope.go:117] "RemoveContainer" containerID="3481a847d550596ff4f99fb9a428c4176854acc79aad578f33aa84b1279b7056" Mar 16 16:34:04 crc kubenswrapper[5120]: E0316 16:34:04.336892 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3481a847d550596ff4f99fb9a428c4176854acc79aad578f33aa84b1279b7056\": container with ID starting with 3481a847d550596ff4f99fb9a428c4176854acc79aad578f33aa84b1279b7056 not found: ID does not exist" containerID="3481a847d550596ff4f99fb9a428c4176854acc79aad578f33aa84b1279b7056" Mar 16 16:34:04 crc kubenswrapper[5120]: I0316 16:34:04.336969 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3481a847d550596ff4f99fb9a428c4176854acc79aad578f33aa84b1279b7056"} err="failed to get container status \"3481a847d550596ff4f99fb9a428c4176854acc79aad578f33aa84b1279b7056\": rpc error: code = NotFound desc = could not find container \"3481a847d550596ff4f99fb9a428c4176854acc79aad578f33aa84b1279b7056\": container with ID starting with 3481a847d550596ff4f99fb9a428c4176854acc79aad578f33aa84b1279b7056 not found: ID does not exist" Mar 16 16:34:04 crc kubenswrapper[5120]: I0316 16:34:04.336995 5120 scope.go:117] "RemoveContainer" containerID="edd70813de326d9b1be3219b269f0e85d5c87d8f9ade26f447611458a3b1b08a" Mar 16 16:34:04 crc kubenswrapper[5120]: E0316 16:34:04.337668 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"edd70813de326d9b1be3219b269f0e85d5c87d8f9ade26f447611458a3b1b08a\": container with ID starting with edd70813de326d9b1be3219b269f0e85d5c87d8f9ade26f447611458a3b1b08a not found: ID does not exist" containerID="edd70813de326d9b1be3219b269f0e85d5c87d8f9ade26f447611458a3b1b08a" Mar 16 16:34:04 crc kubenswrapper[5120]: I0316 16:34:04.337748 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"edd70813de326d9b1be3219b269f0e85d5c87d8f9ade26f447611458a3b1b08a"} err="failed to get container status \"edd70813de326d9b1be3219b269f0e85d5c87d8f9ade26f447611458a3b1b08a\": rpc error: code = NotFound desc = could not find container \"edd70813de326d9b1be3219b269f0e85d5c87d8f9ade26f447611458a3b1b08a\": container with ID starting with edd70813de326d9b1be3219b269f0e85d5c87d8f9ade26f447611458a3b1b08a not found: ID does not exist" Mar 16 16:34:04 crc kubenswrapper[5120]: I0316 16:34:04.554486 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:34:04 crc kubenswrapper[5120]: I0316 16:34:04.554625 5120 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Mar 16 16:34:04 crc kubenswrapper[5120]: I0316 16:34:04.657946 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:34:04 crc kubenswrapper[5120]: I0316 16:34:04.664649 5120 scope.go:117] "RemoveContainer" containerID="0a15d5caff30dc8885f782e59962af7d98d58b39ab76059e56e5827e10e7ab8b" Mar 16 16:34:04 crc kubenswrapper[5120]: E0316 16:34:04.665077 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:34:04 crc kubenswrapper[5120]: I0316 16:34:04.677067 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6aae3bc4-66a0-436a-b3b3-13d2be73a3de" path="/var/lib/kubelet/pods/6aae3bc4-66a0-436a-b3b3-13d2be73a3de/volumes" Mar 16 16:34:05 crc kubenswrapper[5120]: I0316 16:34:05.298279 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:34:05 crc kubenswrapper[5120]: I0316 16:34:05.298779 5120 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Mar 16 16:34:05 crc kubenswrapper[5120]: I0316 16:34:05.415914 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:34:05 crc kubenswrapper[5120]: I0316 16:34:05.679498 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561314-s8vrr" Mar 16 16:34:05 crc kubenswrapper[5120]: I0316 16:34:05.750131 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-52697\" (UniqueName: \"kubernetes.io/projected/564c9119-4d4c-4ff2-b7ae-7c066f8bdf57-kube-api-access-52697\") pod \"564c9119-4d4c-4ff2-b7ae-7c066f8bdf57\" (UID: \"564c9119-4d4c-4ff2-b7ae-7c066f8bdf57\") " Mar 16 16:34:05 crc kubenswrapper[5120]: I0316 16:34:05.763961 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/564c9119-4d4c-4ff2-b7ae-7c066f8bdf57-kube-api-access-52697" (OuterVolumeSpecName: "kube-api-access-52697") pod "564c9119-4d4c-4ff2-b7ae-7c066f8bdf57" (UID: "564c9119-4d4c-4ff2-b7ae-7c066f8bdf57"). InnerVolumeSpecName "kube-api-access-52697". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:34:05 crc kubenswrapper[5120]: I0316 16:34:05.852931 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-52697\" (UniqueName: \"kubernetes.io/projected/564c9119-4d4c-4ff2-b7ae-7c066f8bdf57-kube-api-access-52697\") on node \"crc\" DevicePath \"\"" Mar 16 16:34:06 crc kubenswrapper[5120]: I0316 16:34:06.283919 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"c807ead6-beff-4a5b-bf14-c56bf9e4c0f0","Type":"ContainerStarted","Data":"aa5640a79d727b5cf5c9d7f6c4b8c6df5f7edbbd9f5a893b66ca4830f9b1b628"} Mar 16 16:34:06 crc kubenswrapper[5120]: I0316 16:34:06.284266 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:34:06 crc kubenswrapper[5120]: I0316 16:34:06.295534 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561314-s8vrr" Mar 16 16:34:06 crc kubenswrapper[5120]: I0316 16:34:06.296152 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561314-s8vrr" event={"ID":"564c9119-4d4c-4ff2-b7ae-7c066f8bdf57","Type":"ContainerDied","Data":"007ba505a5749180c19e52bf2947c550049fd2cbc518cebc7556fba92d231a36"} Mar 16 16:34:06 crc kubenswrapper[5120]: I0316 16:34:06.296199 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="007ba505a5749180c19e52bf2947c550049fd2cbc518cebc7556fba92d231a36" Mar 16 16:34:06 crc kubenswrapper[5120]: I0316 16:34:06.327906 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=1.6872730439999999 podStartE2EDuration="6.327890984s" podCreationTimestamp="2026-03-16 16:34:00 +0000 UTC" firstStartedPulling="2026-03-16 16:34:01.412126246 +0000 UTC m=+3743.566057903" lastFinishedPulling="2026-03-16 16:34:06.052744186 +0000 UTC m=+3748.206675843" observedRunningTime="2026-03-16 16:34:06.316225619 +0000 UTC m=+3748.470157286" watchObservedRunningTime="2026-03-16 16:34:06.327890984 +0000 UTC m=+3748.481822631" Mar 16 16:34:06 crc kubenswrapper[5120]: I0316 16:34:06.349815 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-infra/auto-csr-approver-29561308-97774"] Mar 16 16:34:06 crc kubenswrapper[5120]: I0316 16:34:06.358411 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-infra/auto-csr-approver-29561308-97774"] Mar 16 16:34:06 crc kubenswrapper[5120]: I0316 16:34:06.678283 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="80f9e587-aeb8-49f9-a79a-c3898e9638b6" path="/var/lib/kubelet/pods/80f9e587-aeb8-49f9-a79a-c3898e9638b6/volumes" Mar 16 16:34:07 crc kubenswrapper[5120]: I0316 16:34:07.241797 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:34:07 crc kubenswrapper[5120]: I0316 16:34:07.938927 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-s56kl"] Mar 16 16:34:07 crc kubenswrapper[5120]: I0316 16:34:07.940034 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6aae3bc4-66a0-436a-b3b3-13d2be73a3de" containerName="neutron-api" Mar 16 16:34:07 crc kubenswrapper[5120]: I0316 16:34:07.940057 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="6aae3bc4-66a0-436a-b3b3-13d2be73a3de" containerName="neutron-api" Mar 16 16:34:07 crc kubenswrapper[5120]: I0316 16:34:07.940074 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6aae3bc4-66a0-436a-b3b3-13d2be73a3de" containerName="neutron-httpd" Mar 16 16:34:07 crc kubenswrapper[5120]: I0316 16:34:07.940080 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="6aae3bc4-66a0-436a-b3b3-13d2be73a3de" containerName="neutron-httpd" Mar 16 16:34:07 crc kubenswrapper[5120]: I0316 16:34:07.940097 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="564c9119-4d4c-4ff2-b7ae-7c066f8bdf57" containerName="oc" Mar 16 16:34:07 crc kubenswrapper[5120]: I0316 16:34:07.940103 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="564c9119-4d4c-4ff2-b7ae-7c066f8bdf57" containerName="oc" Mar 16 16:34:07 crc kubenswrapper[5120]: I0316 16:34:07.940284 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="6aae3bc4-66a0-436a-b3b3-13d2be73a3de" containerName="neutron-api" Mar 16 16:34:07 crc kubenswrapper[5120]: I0316 16:34:07.940301 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="6aae3bc4-66a0-436a-b3b3-13d2be73a3de" containerName="neutron-httpd" Mar 16 16:34:07 crc kubenswrapper[5120]: I0316 16:34:07.940313 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="564c9119-4d4c-4ff2-b7ae-7c066f8bdf57" containerName="oc" Mar 16 16:34:07 crc kubenswrapper[5120]: I0316 16:34:07.945774 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-s56kl" Mar 16 16:34:07 crc kubenswrapper[5120]: I0316 16:34:07.947932 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-manage-config-data\"" Mar 16 16:34:07 crc kubenswrapper[5120]: I0316 16:34:07.948024 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-manage-scripts\"" Mar 16 16:34:07 crc kubenswrapper[5120]: I0316 16:34:07.954847 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-s56kl"] Mar 16 16:34:08 crc kubenswrapper[5120]: I0316 16:34:08.069293 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:34:08 crc kubenswrapper[5120]: I0316 16:34:08.078161 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:34:08 crc kubenswrapper[5120]: I0316 16:34:08.081676 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:34:08 crc kubenswrapper[5120]: I0316 16:34:08.082107 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-novncproxy-config-data\"" Mar 16 16:34:08 crc kubenswrapper[5120]: I0316 16:34:08.124679 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/628685cb-eaf0-45f8-b678-c093de257dbc-combined-ca-bundle\") pod \"nova-cell0-cell-mapping-s56kl\" (UID: \"628685cb-eaf0-45f8-b678-c093de257dbc\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-s56kl" Mar 16 16:34:08 crc kubenswrapper[5120]: I0316 16:34:08.124828 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/628685cb-eaf0-45f8-b678-c093de257dbc-config-data\") pod \"nova-cell0-cell-mapping-s56kl\" (UID: \"628685cb-eaf0-45f8-b678-c093de257dbc\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-s56kl" Mar 16 16:34:08 crc kubenswrapper[5120]: I0316 16:34:08.125176 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/628685cb-eaf0-45f8-b678-c093de257dbc-scripts\") pod \"nova-cell0-cell-mapping-s56kl\" (UID: \"628685cb-eaf0-45f8-b678-c093de257dbc\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-s56kl" Mar 16 16:34:08 crc kubenswrapper[5120]: I0316 16:34:08.125589 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9sl75\" (UniqueName: \"kubernetes.io/projected/628685cb-eaf0-45f8-b678-c093de257dbc-kube-api-access-9sl75\") pod \"nova-cell0-cell-mapping-s56kl\" (UID: \"628685cb-eaf0-45f8-b678-c093de257dbc\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-s56kl" Mar 16 16:34:08 crc kubenswrapper[5120]: I0316 16:34:08.190824 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:34:08 crc kubenswrapper[5120]: I0316 16:34:08.220069 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:34:08 crc kubenswrapper[5120]: I0316 16:34:08.230384 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-config-data\"" Mar 16 16:34:08 crc kubenswrapper[5120]: I0316 16:34:08.231215 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:34:08 crc kubenswrapper[5120]: I0316 16:34:08.243480 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/628685cb-eaf0-45f8-b678-c093de257dbc-scripts\") pod \"nova-cell0-cell-mapping-s56kl\" (UID: \"628685cb-eaf0-45f8-b678-c093de257dbc\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-s56kl" Mar 16 16:34:08 crc kubenswrapper[5120]: I0316 16:34:08.243608 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3e509149-94ac-458c-89ad-320aae1598cc-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"3e509149-94ac-458c-89ad-320aae1598cc\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:34:08 crc kubenswrapper[5120]: I0316 16:34:08.243633 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3e509149-94ac-458c-89ad-320aae1598cc-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"3e509149-94ac-458c-89ad-320aae1598cc\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:34:08 crc kubenswrapper[5120]: I0316 16:34:08.243731 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9sl75\" (UniqueName: \"kubernetes.io/projected/628685cb-eaf0-45f8-b678-c093de257dbc-kube-api-access-9sl75\") pod \"nova-cell0-cell-mapping-s56kl\" (UID: \"628685cb-eaf0-45f8-b678-c093de257dbc\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-s56kl" Mar 16 16:34:08 crc kubenswrapper[5120]: I0316 16:34:08.243834 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/628685cb-eaf0-45f8-b678-c093de257dbc-combined-ca-bundle\") pod \"nova-cell0-cell-mapping-s56kl\" (UID: \"628685cb-eaf0-45f8-b678-c093de257dbc\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-s56kl" Mar 16 16:34:08 crc kubenswrapper[5120]: I0316 16:34:08.243912 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/628685cb-eaf0-45f8-b678-c093de257dbc-config-data\") pod \"nova-cell0-cell-mapping-s56kl\" (UID: \"628685cb-eaf0-45f8-b678-c093de257dbc\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-s56kl" Mar 16 16:34:08 crc kubenswrapper[5120]: I0316 16:34:08.244075 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zj8lf\" (UniqueName: \"kubernetes.io/projected/3e509149-94ac-458c-89ad-320aae1598cc-kube-api-access-zj8lf\") pod \"nova-cell1-novncproxy-0\" (UID: \"3e509149-94ac-458c-89ad-320aae1598cc\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:34:08 crc kubenswrapper[5120]: I0316 16:34:08.259022 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/628685cb-eaf0-45f8-b678-c093de257dbc-combined-ca-bundle\") pod \"nova-cell0-cell-mapping-s56kl\" (UID: \"628685cb-eaf0-45f8-b678-c093de257dbc\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-s56kl" Mar 16 16:34:08 crc kubenswrapper[5120]: I0316 16:34:08.269682 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/628685cb-eaf0-45f8-b678-c093de257dbc-config-data\") pod \"nova-cell0-cell-mapping-s56kl\" (UID: \"628685cb-eaf0-45f8-b678-c093de257dbc\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-s56kl" Mar 16 16:34:08 crc kubenswrapper[5120]: I0316 16:34:08.269727 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/628685cb-eaf0-45f8-b678-c093de257dbc-scripts\") pod \"nova-cell0-cell-mapping-s56kl\" (UID: \"628685cb-eaf0-45f8-b678-c093de257dbc\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-s56kl" Mar 16 16:34:08 crc kubenswrapper[5120]: I0316 16:34:08.275836 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:34:08 crc kubenswrapper[5120]: I0316 16:34:08.280832 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9sl75\" (UniqueName: \"kubernetes.io/projected/628685cb-eaf0-45f8-b678-c093de257dbc-kube-api-access-9sl75\") pod \"nova-cell0-cell-mapping-s56kl\" (UID: \"628685cb-eaf0-45f8-b678-c093de257dbc\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-s56kl" Mar 16 16:34:08 crc kubenswrapper[5120]: I0316 16:34:08.310530 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:34:08 crc kubenswrapper[5120]: I0316 16:34:08.310663 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:34:08 crc kubenswrapper[5120]: I0316 16:34:08.318235 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-metadata-config-data\"" Mar 16 16:34:08 crc kubenswrapper[5120]: I0316 16:34:08.349517 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zj8lf\" (UniqueName: \"kubernetes.io/projected/3e509149-94ac-458c-89ad-320aae1598cc-kube-api-access-zj8lf\") pod \"nova-cell1-novncproxy-0\" (UID: \"3e509149-94ac-458c-89ad-320aae1598cc\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:34:08 crc kubenswrapper[5120]: I0316 16:34:08.349614 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/bba795d8-6362-41cc-b73f-1b4101d28c26-logs\") pod \"nova-api-0\" (UID: \"bba795d8-6362-41cc-b73f-1b4101d28c26\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:34:08 crc kubenswrapper[5120]: I0316 16:34:08.350137 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bba795d8-6362-41cc-b73f-1b4101d28c26-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"bba795d8-6362-41cc-b73f-1b4101d28c26\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:34:08 crc kubenswrapper[5120]: I0316 16:34:08.359577 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xwx4\" (UniqueName: \"kubernetes.io/projected/bba795d8-6362-41cc-b73f-1b4101d28c26-kube-api-access-8xwx4\") pod \"nova-api-0\" (UID: \"bba795d8-6362-41cc-b73f-1b4101d28c26\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:34:08 crc kubenswrapper[5120]: I0316 16:34:08.359655 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3e509149-94ac-458c-89ad-320aae1598cc-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"3e509149-94ac-458c-89ad-320aae1598cc\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:34:08 crc kubenswrapper[5120]: I0316 16:34:08.359673 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3e509149-94ac-458c-89ad-320aae1598cc-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"3e509149-94ac-458c-89ad-320aae1598cc\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:34:08 crc kubenswrapper[5120]: I0316 16:34:08.359972 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bba795d8-6362-41cc-b73f-1b4101d28c26-config-data\") pod \"nova-api-0\" (UID: \"bba795d8-6362-41cc-b73f-1b4101d28c26\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:34:08 crc kubenswrapper[5120]: I0316 16:34:08.370011 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:34:08 crc kubenswrapper[5120]: I0316 16:34:08.373418 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3e509149-94ac-458c-89ad-320aae1598cc-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"3e509149-94ac-458c-89ad-320aae1598cc\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:34:08 crc kubenswrapper[5120]: I0316 16:34:08.374112 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3e509149-94ac-458c-89ad-320aae1598cc-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"3e509149-94ac-458c-89ad-320aae1598cc\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:34:08 crc kubenswrapper[5120]: I0316 16:34:08.375425 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zj8lf\" (UniqueName: \"kubernetes.io/projected/3e509149-94ac-458c-89ad-320aae1598cc-kube-api-access-zj8lf\") pod \"nova-cell1-novncproxy-0\" (UID: \"3e509149-94ac-458c-89ad-320aae1598cc\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:34:08 crc kubenswrapper[5120]: I0316 16:34:08.381215 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:34:08 crc kubenswrapper[5120]: I0316 16:34:08.385831 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-scheduler-config-data\"" Mar 16 16:34:08 crc kubenswrapper[5120]: I0316 16:34:08.404235 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:34:08 crc kubenswrapper[5120]: I0316 16:34:08.405373 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:34:08 crc kubenswrapper[5120]: I0316 16:34:08.461723 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bec1e292-e023-489e-9d12-c9ccbc1488e2-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"bec1e292-e023-489e-9d12-c9ccbc1488e2\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:34:08 crc kubenswrapper[5120]: I0316 16:34:08.462147 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/adce08fd-d30b-4413-ae7a-a030d47a528b-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"adce08fd-d30b-4413-ae7a-a030d47a528b\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:34:08 crc kubenswrapper[5120]: I0316 16:34:08.462186 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/bba795d8-6362-41cc-b73f-1b4101d28c26-logs\") pod \"nova-api-0\" (UID: \"bba795d8-6362-41cc-b73f-1b4101d28c26\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:34:08 crc kubenswrapper[5120]: I0316 16:34:08.462224 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/adce08fd-d30b-4413-ae7a-a030d47a528b-logs\") pod \"nova-metadata-0\" (UID: \"adce08fd-d30b-4413-ae7a-a030d47a528b\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:34:08 crc kubenswrapper[5120]: I0316 16:34:08.462267 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bba795d8-6362-41cc-b73f-1b4101d28c26-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"bba795d8-6362-41cc-b73f-1b4101d28c26\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:34:08 crc kubenswrapper[5120]: I0316 16:34:08.462285 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8xwx4\" (UniqueName: \"kubernetes.io/projected/bba795d8-6362-41cc-b73f-1b4101d28c26-kube-api-access-8xwx4\") pod \"nova-api-0\" (UID: \"bba795d8-6362-41cc-b73f-1b4101d28c26\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:34:08 crc kubenswrapper[5120]: I0316 16:34:08.462332 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bec1e292-e023-489e-9d12-c9ccbc1488e2-config-data\") pod \"nova-scheduler-0\" (UID: \"bec1e292-e023-489e-9d12-c9ccbc1488e2\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:34:08 crc kubenswrapper[5120]: I0316 16:34:08.462391 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/adce08fd-d30b-4413-ae7a-a030d47a528b-config-data\") pod \"nova-metadata-0\" (UID: \"adce08fd-d30b-4413-ae7a-a030d47a528b\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:34:08 crc kubenswrapper[5120]: I0316 16:34:08.462412 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bba795d8-6362-41cc-b73f-1b4101d28c26-config-data\") pod \"nova-api-0\" (UID: \"bba795d8-6362-41cc-b73f-1b4101d28c26\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:34:08 crc kubenswrapper[5120]: I0316 16:34:08.462443 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6mkd\" (UniqueName: \"kubernetes.io/projected/adce08fd-d30b-4413-ae7a-a030d47a528b-kube-api-access-k6mkd\") pod \"nova-metadata-0\" (UID: \"adce08fd-d30b-4413-ae7a-a030d47a528b\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:34:08 crc kubenswrapper[5120]: I0316 16:34:08.462529 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxc46\" (UniqueName: \"kubernetes.io/projected/bec1e292-e023-489e-9d12-c9ccbc1488e2-kube-api-access-wxc46\") pod \"nova-scheduler-0\" (UID: \"bec1e292-e023-489e-9d12-c9ccbc1488e2\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:34:08 crc kubenswrapper[5120]: I0316 16:34:08.468606 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bba795d8-6362-41cc-b73f-1b4101d28c26-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"bba795d8-6362-41cc-b73f-1b4101d28c26\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:34:08 crc kubenswrapper[5120]: I0316 16:34:08.468745 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bba795d8-6362-41cc-b73f-1b4101d28c26-config-data\") pod \"nova-api-0\" (UID: \"bba795d8-6362-41cc-b73f-1b4101d28c26\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:34:08 crc kubenswrapper[5120]: I0316 16:34:08.469327 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/bba795d8-6362-41cc-b73f-1b4101d28c26-logs\") pod \"nova-api-0\" (UID: \"bba795d8-6362-41cc-b73f-1b4101d28c26\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:34:08 crc kubenswrapper[5120]: I0316 16:34:08.483205 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xwx4\" (UniqueName: \"kubernetes.io/projected/bba795d8-6362-41cc-b73f-1b4101d28c26-kube-api-access-8xwx4\") pod \"nova-api-0\" (UID: \"bba795d8-6362-41cc-b73f-1b4101d28c26\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:34:08 crc kubenswrapper[5120]: I0316 16:34:08.566074 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bec1e292-e023-489e-9d12-c9ccbc1488e2-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"bec1e292-e023-489e-9d12-c9ccbc1488e2\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:34:08 crc kubenswrapper[5120]: I0316 16:34:08.566176 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/adce08fd-d30b-4413-ae7a-a030d47a528b-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"adce08fd-d30b-4413-ae7a-a030d47a528b\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:34:08 crc kubenswrapper[5120]: I0316 16:34:08.566230 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/adce08fd-d30b-4413-ae7a-a030d47a528b-logs\") pod \"nova-metadata-0\" (UID: \"adce08fd-d30b-4413-ae7a-a030d47a528b\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:34:08 crc kubenswrapper[5120]: I0316 16:34:08.566333 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bec1e292-e023-489e-9d12-c9ccbc1488e2-config-data\") pod \"nova-scheduler-0\" (UID: \"bec1e292-e023-489e-9d12-c9ccbc1488e2\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:34:08 crc kubenswrapper[5120]: I0316 16:34:08.566429 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/adce08fd-d30b-4413-ae7a-a030d47a528b-config-data\") pod \"nova-metadata-0\" (UID: \"adce08fd-d30b-4413-ae7a-a030d47a528b\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:34:08 crc kubenswrapper[5120]: I0316 16:34:08.566495 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k6mkd\" (UniqueName: \"kubernetes.io/projected/adce08fd-d30b-4413-ae7a-a030d47a528b-kube-api-access-k6mkd\") pod \"nova-metadata-0\" (UID: \"adce08fd-d30b-4413-ae7a-a030d47a528b\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:34:08 crc kubenswrapper[5120]: I0316 16:34:08.566644 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wxc46\" (UniqueName: \"kubernetes.io/projected/bec1e292-e023-489e-9d12-c9ccbc1488e2-kube-api-access-wxc46\") pod \"nova-scheduler-0\" (UID: \"bec1e292-e023-489e-9d12-c9ccbc1488e2\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:34:08 crc kubenswrapper[5120]: I0316 16:34:08.567829 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/adce08fd-d30b-4413-ae7a-a030d47a528b-logs\") pod \"nova-metadata-0\" (UID: \"adce08fd-d30b-4413-ae7a-a030d47a528b\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:34:08 crc kubenswrapper[5120]: I0316 16:34:08.575393 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-s56kl" Mar 16 16:34:08 crc kubenswrapper[5120]: I0316 16:34:08.578816 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bec1e292-e023-489e-9d12-c9ccbc1488e2-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"bec1e292-e023-489e-9d12-c9ccbc1488e2\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:34:08 crc kubenswrapper[5120]: I0316 16:34:08.578844 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bec1e292-e023-489e-9d12-c9ccbc1488e2-config-data\") pod \"nova-scheduler-0\" (UID: \"bec1e292-e023-489e-9d12-c9ccbc1488e2\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:34:08 crc kubenswrapper[5120]: I0316 16:34:08.579344 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/adce08fd-d30b-4413-ae7a-a030d47a528b-config-data\") pod \"nova-metadata-0\" (UID: \"adce08fd-d30b-4413-ae7a-a030d47a528b\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:34:08 crc kubenswrapper[5120]: I0316 16:34:08.587472 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/adce08fd-d30b-4413-ae7a-a030d47a528b-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"adce08fd-d30b-4413-ae7a-a030d47a528b\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:34:08 crc kubenswrapper[5120]: I0316 16:34:08.597919 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxc46\" (UniqueName: \"kubernetes.io/projected/bec1e292-e023-489e-9d12-c9ccbc1488e2-kube-api-access-wxc46\") pod \"nova-scheduler-0\" (UID: \"bec1e292-e023-489e-9d12-c9ccbc1488e2\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:34:08 crc kubenswrapper[5120]: I0316 16:34:08.613032 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6mkd\" (UniqueName: \"kubernetes.io/projected/adce08fd-d30b-4413-ae7a-a030d47a528b-kube-api-access-k6mkd\") pod \"nova-metadata-0\" (UID: \"adce08fd-d30b-4413-ae7a-a030d47a528b\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:34:08 crc kubenswrapper[5120]: I0316 16:34:08.671592 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:34:08 crc kubenswrapper[5120]: I0316 16:34:08.805193 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:34:08 crc kubenswrapper[5120]: I0316 16:34:08.815808 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:34:08 crc kubenswrapper[5120]: I0316 16:34:08.933612 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:34:08 crc kubenswrapper[5120]: W0316 16:34:08.960242 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3e509149_94ac_458c_89ad_320aae1598cc.slice/crio-e87e21f6407891062cdfa4a930c22197efb308764db984fe429accc154bc3739 WatchSource:0}: Error finding container e87e21f6407891062cdfa4a930c22197efb308764db984fe429accc154bc3739: Status 404 returned error can't find the container with id e87e21f6407891062cdfa4a930c22197efb308764db984fe429accc154bc3739 Mar 16 16:34:09 crc kubenswrapper[5120]: I0316 16:34:09.104697 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-s56kl"] Mar 16 16:34:09 crc kubenswrapper[5120]: I0316 16:34:09.226100 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:34:09 crc kubenswrapper[5120]: I0316 16:34:09.338852 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-sdp7k"] Mar 16 16:34:09 crc kubenswrapper[5120]: I0316 16:34:09.348151 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-sdp7k" Mar 16 16:34:09 crc kubenswrapper[5120]: I0316 16:34:09.349509 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-sdp7k"] Mar 16 16:34:09 crc kubenswrapper[5120]: I0316 16:34:09.352617 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-conductor-config-data\"" Mar 16 16:34:09 crc kubenswrapper[5120]: I0316 16:34:09.352848 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-conductor-scripts\"" Mar 16 16:34:09 crc kubenswrapper[5120]: I0316 16:34:09.402709 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:34:09 crc kubenswrapper[5120]: I0316 16:34:09.429559 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7d70927c-1432-4edb-a414-ca8fc40dd220-scripts\") pod \"nova-cell1-conductor-db-sync-sdp7k\" (UID: \"7d70927c-1432-4edb-a414-ca8fc40dd220\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-sdp7k" Mar 16 16:34:09 crc kubenswrapper[5120]: I0316 16:34:09.429805 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7d70927c-1432-4edb-a414-ca8fc40dd220-combined-ca-bundle\") pod \"nova-cell1-conductor-db-sync-sdp7k\" (UID: \"7d70927c-1432-4edb-a414-ca8fc40dd220\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-sdp7k" Mar 16 16:34:09 crc kubenswrapper[5120]: I0316 16:34:09.429849 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xdrm\" (UniqueName: \"kubernetes.io/projected/7d70927c-1432-4edb-a414-ca8fc40dd220-kube-api-access-4xdrm\") pod \"nova-cell1-conductor-db-sync-sdp7k\" (UID: \"7d70927c-1432-4edb-a414-ca8fc40dd220\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-sdp7k" Mar 16 16:34:09 crc kubenswrapper[5120]: I0316 16:34:09.430087 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7d70927c-1432-4edb-a414-ca8fc40dd220-config-data\") pod \"nova-cell1-conductor-db-sync-sdp7k\" (UID: \"7d70927c-1432-4edb-a414-ca8fc40dd220\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-sdp7k" Mar 16 16:34:09 crc kubenswrapper[5120]: I0316 16:34:09.500230 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-s56kl" event={"ID":"628685cb-eaf0-45f8-b678-c093de257dbc","Type":"ContainerStarted","Data":"b7b403272bde3368f11c52e8f3d8c9d567bf2262eb5725eba40dfd9261c5268c"} Mar 16 16:34:09 crc kubenswrapper[5120]: I0316 16:34:09.534714 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7d70927c-1432-4edb-a414-ca8fc40dd220-config-data\") pod \"nova-cell1-conductor-db-sync-sdp7k\" (UID: \"7d70927c-1432-4edb-a414-ca8fc40dd220\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-sdp7k" Mar 16 16:34:09 crc kubenswrapper[5120]: I0316 16:34:09.534955 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7d70927c-1432-4edb-a414-ca8fc40dd220-scripts\") pod \"nova-cell1-conductor-db-sync-sdp7k\" (UID: \"7d70927c-1432-4edb-a414-ca8fc40dd220\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-sdp7k" Mar 16 16:34:09 crc kubenswrapper[5120]: I0316 16:34:09.535081 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7d70927c-1432-4edb-a414-ca8fc40dd220-combined-ca-bundle\") pod \"nova-cell1-conductor-db-sync-sdp7k\" (UID: \"7d70927c-1432-4edb-a414-ca8fc40dd220\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-sdp7k" Mar 16 16:34:09 crc kubenswrapper[5120]: I0316 16:34:09.535102 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4xdrm\" (UniqueName: \"kubernetes.io/projected/7d70927c-1432-4edb-a414-ca8fc40dd220-kube-api-access-4xdrm\") pod \"nova-cell1-conductor-db-sync-sdp7k\" (UID: \"7d70927c-1432-4edb-a414-ca8fc40dd220\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-sdp7k" Mar 16 16:34:09 crc kubenswrapper[5120]: I0316 16:34:09.548627 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7d70927c-1432-4edb-a414-ca8fc40dd220-config-data\") pod \"nova-cell1-conductor-db-sync-sdp7k\" (UID: \"7d70927c-1432-4edb-a414-ca8fc40dd220\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-sdp7k" Mar 16 16:34:09 crc kubenswrapper[5120]: I0316 16:34:09.552241 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:34:09 crc kubenswrapper[5120]: I0316 16:34:09.559457 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"3e509149-94ac-458c-89ad-320aae1598cc","Type":"ContainerStarted","Data":"a2922eddbea84661735919544816b95f3ad219ecd456570ef7c38eebcd7756d2"} Mar 16 16:34:09 crc kubenswrapper[5120]: I0316 16:34:09.559490 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"3e509149-94ac-458c-89ad-320aae1598cc","Type":"ContainerStarted","Data":"e87e21f6407891062cdfa4a930c22197efb308764db984fe429accc154bc3739"} Mar 16 16:34:09 crc kubenswrapper[5120]: I0316 16:34:09.561662 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7d70927c-1432-4edb-a414-ca8fc40dd220-combined-ca-bundle\") pod \"nova-cell1-conductor-db-sync-sdp7k\" (UID: \"7d70927c-1432-4edb-a414-ca8fc40dd220\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-sdp7k" Mar 16 16:34:09 crc kubenswrapper[5120]: I0316 16:34:09.561888 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"bba795d8-6362-41cc-b73f-1b4101d28c26","Type":"ContainerStarted","Data":"623ef091f79cee835c4384c5ca63b3e24a23ed8f064051c7d77715d9128ecb6a"} Mar 16 16:34:09 crc kubenswrapper[5120]: I0316 16:34:09.563553 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7d70927c-1432-4edb-a414-ca8fc40dd220-scripts\") pod \"nova-cell1-conductor-db-sync-sdp7k\" (UID: \"7d70927c-1432-4edb-a414-ca8fc40dd220\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-sdp7k" Mar 16 16:34:09 crc kubenswrapper[5120]: I0316 16:34:09.568625 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xdrm\" (UniqueName: \"kubernetes.io/projected/7d70927c-1432-4edb-a414-ca8fc40dd220-kube-api-access-4xdrm\") pod \"nova-cell1-conductor-db-sync-sdp7k\" (UID: \"7d70927c-1432-4edb-a414-ca8fc40dd220\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-sdp7k" Mar 16 16:34:09 crc kubenswrapper[5120]: I0316 16:34:09.590309 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podStartSLOduration=1.5902862629999999 podStartE2EDuration="1.590286263s" podCreationTimestamp="2026-03-16 16:34:08 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:34:09.578385192 +0000 UTC m=+3751.732316869" watchObservedRunningTime="2026-03-16 16:34:09.590286263 +0000 UTC m=+3751.744217920" Mar 16 16:34:09 crc kubenswrapper[5120]: I0316 16:34:09.864402 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-sdp7k" Mar 16 16:34:10 crc kubenswrapper[5120]: E0316 16:34:10.339048 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1764600 actualBytes=10240 Mar 16 16:34:10 crc kubenswrapper[5120]: W0316 16:34:10.443294 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7d70927c_1432_4edb_a414_ca8fc40dd220.slice/crio-4e02905c4296b6d2985eb6dce04b67a8c0092cb47f47a253ca288e1bdcb22d6b WatchSource:0}: Error finding container 4e02905c4296b6d2985eb6dce04b67a8c0092cb47f47a253ca288e1bdcb22d6b: Status 404 returned error can't find the container with id 4e02905c4296b6d2985eb6dce04b67a8c0092cb47f47a253ca288e1bdcb22d6b Mar 16 16:34:10 crc kubenswrapper[5120]: I0316 16:34:10.454023 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-sdp7k"] Mar 16 16:34:10 crc kubenswrapper[5120]: I0316 16:34:10.618323 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"adce08fd-d30b-4413-ae7a-a030d47a528b","Type":"ContainerStarted","Data":"de43d1bdb28fdbcb168c9cd8b521a529a61e81310a4bdee84e1411be8cb627e5"} Mar 16 16:34:10 crc kubenswrapper[5120]: I0316 16:34:10.618368 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"adce08fd-d30b-4413-ae7a-a030d47a528b","Type":"ContainerStarted","Data":"5fa609ae9948c70d9074f06c118cd5cb7142f01d5b6471525d0a07c73b9fd079"} Mar 16 16:34:10 crc kubenswrapper[5120]: I0316 16:34:10.618379 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"adce08fd-d30b-4413-ae7a-a030d47a528b","Type":"ContainerStarted","Data":"ebbdf9f4c39d941aa064954b9ab1622385a48ad58de9f0bd0c331cc84ba2a790"} Mar 16 16:34:10 crc kubenswrapper[5120]: I0316 16:34:10.627157 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-sdp7k" event={"ID":"7d70927c-1432-4edb-a414-ca8fc40dd220","Type":"ContainerStarted","Data":"4e02905c4296b6d2985eb6dce04b67a8c0092cb47f47a253ca288e1bdcb22d6b"} Mar 16 16:34:10 crc kubenswrapper[5120]: I0316 16:34:10.628785 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"bec1e292-e023-489e-9d12-c9ccbc1488e2","Type":"ContainerStarted","Data":"ad8e2ec5b87993e63a39edc2e193772a2f831e952f623a27fc9e87d4868bf786"} Mar 16 16:34:10 crc kubenswrapper[5120]: I0316 16:34:10.628821 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"bec1e292-e023-489e-9d12-c9ccbc1488e2","Type":"ContainerStarted","Data":"7ae00c0d35af430c527b977b5f82eb1281fc0be25b94218f44e9560d28d89025"} Mar 16 16:34:10 crc kubenswrapper[5120]: I0316 16:34:10.639098 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-s56kl" event={"ID":"628685cb-eaf0-45f8-b678-c093de257dbc","Type":"ContainerStarted","Data":"46ccaf02befecb80356a3298d07b3fe888196e2a5b4f748f7f46d129cc9dc198"} Mar 16 16:34:10 crc kubenswrapper[5120]: I0316 16:34:10.646221 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=2.64620159 podStartE2EDuration="2.64620159s" podCreationTimestamp="2026-03-16 16:34:08 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:34:10.644073285 +0000 UTC m=+3752.798004952" watchObservedRunningTime="2026-03-16 16:34:10.64620159 +0000 UTC m=+3752.800133247" Mar 16 16:34:10 crc kubenswrapper[5120]: I0316 16:34:10.683003 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-s56kl" podStartSLOduration=3.682987213 podStartE2EDuration="3.682987213s" podCreationTimestamp="2026-03-16 16:34:07 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:34:10.67408109 +0000 UTC m=+3752.828012747" watchObservedRunningTime="2026-03-16 16:34:10.682987213 +0000 UTC m=+3752.836918870" Mar 16 16:34:10 crc kubenswrapper[5120]: I0316 16:34:10.675445 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"bba795d8-6362-41cc-b73f-1b4101d28c26","Type":"ContainerStarted","Data":"a892fc7bbd72e1b6b01130437df347bf98d1ecea87ce341b1e3fe9e9257246a9"} Mar 16 16:34:10 crc kubenswrapper[5120]: I0316 16:34:10.731038 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"bba795d8-6362-41cc-b73f-1b4101d28c26","Type":"ContainerStarted","Data":"8a49af4de18f552f63e6bb5d67e800d9991f5bb6b5b27ea2181fbe7a25888ea1"} Mar 16 16:34:10 crc kubenswrapper[5120]: I0316 16:34:10.748893 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-scheduler-0" podStartSLOduration=2.748869137 podStartE2EDuration="2.748869137s" podCreationTimestamp="2026-03-16 16:34:08 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:34:10.695238293 +0000 UTC m=+3752.849169960" watchObservedRunningTime="2026-03-16 16:34:10.748869137 +0000 UTC m=+3752.902800794" Mar 16 16:34:10 crc kubenswrapper[5120]: I0316 16:34:10.754843 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=2.754825243 podStartE2EDuration="2.754825243s" podCreationTimestamp="2026-03-16 16:34:08 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:34:10.732729244 +0000 UTC m=+3752.886660911" watchObservedRunningTime="2026-03-16 16:34:10.754825243 +0000 UTC m=+3752.908756900" Mar 16 16:34:11 crc kubenswrapper[5120]: I0316 16:34:11.054607 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:34:11 crc kubenswrapper[5120]: I0316 16:34:11.069724 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:34:11 crc kubenswrapper[5120]: I0316 16:34:11.682284 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-sdp7k" event={"ID":"7d70927c-1432-4edb-a414-ca8fc40dd220","Type":"ContainerStarted","Data":"9dabeafb0b740b3ad03a7b9cfcd7fe649e2992960a96553a85c939a2509080c4"} Mar 16 16:34:11 crc kubenswrapper[5120]: I0316 16:34:11.684957 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podUID="3e509149-94ac-458c-89ad-320aae1598cc" containerName="nova-cell1-novncproxy-novncproxy" containerID="cri-o://a2922eddbea84661735919544816b95f3ad219ecd456570ef7c38eebcd7756d2" gracePeriod=30 Mar 16 16:34:11 crc kubenswrapper[5120]: I0316 16:34:11.716677 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-sdp7k" podStartSLOduration=2.716650788 podStartE2EDuration="2.716650788s" podCreationTimestamp="2026-03-16 16:34:09 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:34:11.713564428 +0000 UTC m=+3753.867496095" watchObservedRunningTime="2026-03-16 16:34:11.716650788 +0000 UTC m=+3753.870582485" Mar 16 16:34:12 crc kubenswrapper[5120]: I0316 16:34:12.588972 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:34:12 crc kubenswrapper[5120]: I0316 16:34:12.695561 5120 generic.go:358] "Generic (PLEG): container finished" podID="3e509149-94ac-458c-89ad-320aae1598cc" containerID="a2922eddbea84661735919544816b95f3ad219ecd456570ef7c38eebcd7756d2" exitCode=0 Mar 16 16:34:12 crc kubenswrapper[5120]: I0316 16:34:12.695986 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:34:12 crc kubenswrapper[5120]: I0316 16:34:12.696075 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"3e509149-94ac-458c-89ad-320aae1598cc","Type":"ContainerDied","Data":"a2922eddbea84661735919544816b95f3ad219ecd456570ef7c38eebcd7756d2"} Mar 16 16:34:12 crc kubenswrapper[5120]: I0316 16:34:12.696114 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"3e509149-94ac-458c-89ad-320aae1598cc","Type":"ContainerDied","Data":"e87e21f6407891062cdfa4a930c22197efb308764db984fe429accc154bc3739"} Mar 16 16:34:12 crc kubenswrapper[5120]: I0316 16:34:12.696130 5120 scope.go:117] "RemoveContainer" containerID="a2922eddbea84661735919544816b95f3ad219ecd456570ef7c38eebcd7756d2" Mar 16 16:34:12 crc kubenswrapper[5120]: I0316 16:34:12.697358 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="adce08fd-d30b-4413-ae7a-a030d47a528b" containerName="nova-metadata-log" containerID="cri-o://5fa609ae9948c70d9074f06c118cd5cb7142f01d5b6471525d0a07c73b9fd079" gracePeriod=30 Mar 16 16:34:12 crc kubenswrapper[5120]: I0316 16:34:12.697752 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="adce08fd-d30b-4413-ae7a-a030d47a528b" containerName="nova-metadata-metadata" containerID="cri-o://de43d1bdb28fdbcb168c9cd8b521a529a61e81310a4bdee84e1411be8cb627e5" gracePeriod=30 Mar 16 16:34:12 crc kubenswrapper[5120]: I0316 16:34:12.731634 5120 scope.go:117] "RemoveContainer" containerID="a2922eddbea84661735919544816b95f3ad219ecd456570ef7c38eebcd7756d2" Mar 16 16:34:12 crc kubenswrapper[5120]: E0316 16:34:12.732319 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a2922eddbea84661735919544816b95f3ad219ecd456570ef7c38eebcd7756d2\": container with ID starting with a2922eddbea84661735919544816b95f3ad219ecd456570ef7c38eebcd7756d2 not found: ID does not exist" containerID="a2922eddbea84661735919544816b95f3ad219ecd456570ef7c38eebcd7756d2" Mar 16 16:34:12 crc kubenswrapper[5120]: I0316 16:34:12.732368 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2922eddbea84661735919544816b95f3ad219ecd456570ef7c38eebcd7756d2"} err="failed to get container status \"a2922eddbea84661735919544816b95f3ad219ecd456570ef7c38eebcd7756d2\": rpc error: code = NotFound desc = could not find container \"a2922eddbea84661735919544816b95f3ad219ecd456570ef7c38eebcd7756d2\": container with ID starting with a2922eddbea84661735919544816b95f3ad219ecd456570ef7c38eebcd7756d2 not found: ID does not exist" Mar 16 16:34:12 crc kubenswrapper[5120]: I0316 16:34:12.748594 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3e509149-94ac-458c-89ad-320aae1598cc-combined-ca-bundle\") pod \"3e509149-94ac-458c-89ad-320aae1598cc\" (UID: \"3e509149-94ac-458c-89ad-320aae1598cc\") " Mar 16 16:34:12 crc kubenswrapper[5120]: I0316 16:34:12.749170 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zj8lf\" (UniqueName: \"kubernetes.io/projected/3e509149-94ac-458c-89ad-320aae1598cc-kube-api-access-zj8lf\") pod \"3e509149-94ac-458c-89ad-320aae1598cc\" (UID: \"3e509149-94ac-458c-89ad-320aae1598cc\") " Mar 16 16:34:12 crc kubenswrapper[5120]: I0316 16:34:12.749287 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3e509149-94ac-458c-89ad-320aae1598cc-config-data\") pod \"3e509149-94ac-458c-89ad-320aae1598cc\" (UID: \"3e509149-94ac-458c-89ad-320aae1598cc\") " Mar 16 16:34:12 crc kubenswrapper[5120]: I0316 16:34:12.757351 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e509149-94ac-458c-89ad-320aae1598cc-kube-api-access-zj8lf" (OuterVolumeSpecName: "kube-api-access-zj8lf") pod "3e509149-94ac-458c-89ad-320aae1598cc" (UID: "3e509149-94ac-458c-89ad-320aae1598cc"). InnerVolumeSpecName "kube-api-access-zj8lf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:34:12 crc kubenswrapper[5120]: I0316 16:34:12.781621 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e509149-94ac-458c-89ad-320aae1598cc-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "3e509149-94ac-458c-89ad-320aae1598cc" (UID: "3e509149-94ac-458c-89ad-320aae1598cc"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:34:12 crc kubenswrapper[5120]: I0316 16:34:12.790384 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e509149-94ac-458c-89ad-320aae1598cc-config-data" (OuterVolumeSpecName: "config-data") pod "3e509149-94ac-458c-89ad-320aae1598cc" (UID: "3e509149-94ac-458c-89ad-320aae1598cc"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:34:12 crc kubenswrapper[5120]: I0316 16:34:12.852500 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zj8lf\" (UniqueName: \"kubernetes.io/projected/3e509149-94ac-458c-89ad-320aae1598cc-kube-api-access-zj8lf\") on node \"crc\" DevicePath \"\"" Mar 16 16:34:12 crc kubenswrapper[5120]: I0316 16:34:12.852541 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3e509149-94ac-458c-89ad-320aae1598cc-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:34:12 crc kubenswrapper[5120]: I0316 16:34:12.852553 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3e509149-94ac-458c-89ad-320aae1598cc-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:34:13 crc kubenswrapper[5120]: I0316 16:34:13.038233 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:34:13 crc kubenswrapper[5120]: I0316 16:34:13.046954 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:34:13 crc kubenswrapper[5120]: I0316 16:34:13.067928 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:34:13 crc kubenswrapper[5120]: I0316 16:34:13.070287 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e509149-94ac-458c-89ad-320aae1598cc" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 16:34:13 crc kubenswrapper[5120]: I0316 16:34:13.070330 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e509149-94ac-458c-89ad-320aae1598cc" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 16:34:13 crc kubenswrapper[5120]: I0316 16:34:13.070656 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="3e509149-94ac-458c-89ad-320aae1598cc" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 16:34:13 crc kubenswrapper[5120]: I0316 16:34:13.080457 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:34:13 crc kubenswrapper[5120]: I0316 16:34:13.082703 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-novncproxy-cell1-public-svc\"" Mar 16 16:34:13 crc kubenswrapper[5120]: I0316 16:34:13.083910 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-novncproxy-cell1-vencrypt\"" Mar 16 16:34:13 crc kubenswrapper[5120]: I0316 16:34:13.084049 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-novncproxy-config-data\"" Mar 16 16:34:13 crc kubenswrapper[5120]: I0316 16:34:13.086537 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:34:13 crc kubenswrapper[5120]: I0316 16:34:13.166867 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/364bfdcf-9673-41c8-b692-941d68257973-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"364bfdcf-9673-41c8-b692-941d68257973\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:34:13 crc kubenswrapper[5120]: I0316 16:34:13.166933 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/364bfdcf-9673-41c8-b692-941d68257973-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"364bfdcf-9673-41c8-b692-941d68257973\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:34:13 crc kubenswrapper[5120]: I0316 16:34:13.167016 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/364bfdcf-9673-41c8-b692-941d68257973-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"364bfdcf-9673-41c8-b692-941d68257973\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:34:13 crc kubenswrapper[5120]: I0316 16:34:13.167314 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/364bfdcf-9673-41c8-b692-941d68257973-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"364bfdcf-9673-41c8-b692-941d68257973\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:34:13 crc kubenswrapper[5120]: I0316 16:34:13.167370 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqgwh\" (UniqueName: \"kubernetes.io/projected/364bfdcf-9673-41c8-b692-941d68257973-kube-api-access-rqgwh\") pod \"nova-cell1-novncproxy-0\" (UID: \"364bfdcf-9673-41c8-b692-941d68257973\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:34:13 crc kubenswrapper[5120]: I0316 16:34:13.270619 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/364bfdcf-9673-41c8-b692-941d68257973-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"364bfdcf-9673-41c8-b692-941d68257973\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:34:13 crc kubenswrapper[5120]: I0316 16:34:13.272808 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/364bfdcf-9673-41c8-b692-941d68257973-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"364bfdcf-9673-41c8-b692-941d68257973\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:34:13 crc kubenswrapper[5120]: I0316 16:34:13.273310 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/364bfdcf-9673-41c8-b692-941d68257973-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"364bfdcf-9673-41c8-b692-941d68257973\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:34:13 crc kubenswrapper[5120]: I0316 16:34:13.273394 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rqgwh\" (UniqueName: \"kubernetes.io/projected/364bfdcf-9673-41c8-b692-941d68257973-kube-api-access-rqgwh\") pod \"nova-cell1-novncproxy-0\" (UID: \"364bfdcf-9673-41c8-b692-941d68257973\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:34:13 crc kubenswrapper[5120]: I0316 16:34:13.273496 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/364bfdcf-9673-41c8-b692-941d68257973-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"364bfdcf-9673-41c8-b692-941d68257973\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:34:13 crc kubenswrapper[5120]: I0316 16:34:13.278517 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/364bfdcf-9673-41c8-b692-941d68257973-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"364bfdcf-9673-41c8-b692-941d68257973\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:34:13 crc kubenswrapper[5120]: I0316 16:34:13.284798 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/364bfdcf-9673-41c8-b692-941d68257973-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"364bfdcf-9673-41c8-b692-941d68257973\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:34:13 crc kubenswrapper[5120]: I0316 16:34:13.285591 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/364bfdcf-9673-41c8-b692-941d68257973-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"364bfdcf-9673-41c8-b692-941d68257973\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:34:13 crc kubenswrapper[5120]: I0316 16:34:13.291443 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/364bfdcf-9673-41c8-b692-941d68257973-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"364bfdcf-9673-41c8-b692-941d68257973\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:34:13 crc kubenswrapper[5120]: I0316 16:34:13.293077 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqgwh\" (UniqueName: \"kubernetes.io/projected/364bfdcf-9673-41c8-b692-941d68257973-kube-api-access-rqgwh\") pod \"nova-cell1-novncproxy-0\" (UID: \"364bfdcf-9673-41c8-b692-941d68257973\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:34:13 crc kubenswrapper[5120]: I0316 16:34:13.366490 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:34:13 crc kubenswrapper[5120]: I0316 16:34:13.377364 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/adce08fd-d30b-4413-ae7a-a030d47a528b-combined-ca-bundle\") pod \"adce08fd-d30b-4413-ae7a-a030d47a528b\" (UID: \"adce08fd-d30b-4413-ae7a-a030d47a528b\") " Mar 16 16:34:13 crc kubenswrapper[5120]: I0316 16:34:13.377632 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k6mkd\" (UniqueName: \"kubernetes.io/projected/adce08fd-d30b-4413-ae7a-a030d47a528b-kube-api-access-k6mkd\") pod \"adce08fd-d30b-4413-ae7a-a030d47a528b\" (UID: \"adce08fd-d30b-4413-ae7a-a030d47a528b\") " Mar 16 16:34:13 crc kubenswrapper[5120]: I0316 16:34:13.377888 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/adce08fd-d30b-4413-ae7a-a030d47a528b-logs\") pod \"adce08fd-d30b-4413-ae7a-a030d47a528b\" (UID: \"adce08fd-d30b-4413-ae7a-a030d47a528b\") " Mar 16 16:34:13 crc kubenswrapper[5120]: I0316 16:34:13.378054 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/adce08fd-d30b-4413-ae7a-a030d47a528b-config-data\") pod \"adce08fd-d30b-4413-ae7a-a030d47a528b\" (UID: \"adce08fd-d30b-4413-ae7a-a030d47a528b\") " Mar 16 16:34:13 crc kubenswrapper[5120]: I0316 16:34:13.379506 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/adce08fd-d30b-4413-ae7a-a030d47a528b-logs" (OuterVolumeSpecName: "logs") pod "adce08fd-d30b-4413-ae7a-a030d47a528b" (UID: "adce08fd-d30b-4413-ae7a-a030d47a528b"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:34:13 crc kubenswrapper[5120]: I0316 16:34:13.388263 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/adce08fd-d30b-4413-ae7a-a030d47a528b-kube-api-access-k6mkd" (OuterVolumeSpecName: "kube-api-access-k6mkd") pod "adce08fd-d30b-4413-ae7a-a030d47a528b" (UID: "adce08fd-d30b-4413-ae7a-a030d47a528b"). InnerVolumeSpecName "kube-api-access-k6mkd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:34:13 crc kubenswrapper[5120]: I0316 16:34:13.398249 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:34:13 crc kubenswrapper[5120]: I0316 16:34:13.423634 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/adce08fd-d30b-4413-ae7a-a030d47a528b-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "adce08fd-d30b-4413-ae7a-a030d47a528b" (UID: "adce08fd-d30b-4413-ae7a-a030d47a528b"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:34:13 crc kubenswrapper[5120]: I0316 16:34:13.448267 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/adce08fd-d30b-4413-ae7a-a030d47a528b-config-data" (OuterVolumeSpecName: "config-data") pod "adce08fd-d30b-4413-ae7a-a030d47a528b" (UID: "adce08fd-d30b-4413-ae7a-a030d47a528b"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:34:13 crc kubenswrapper[5120]: I0316 16:34:13.480693 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/adce08fd-d30b-4413-ae7a-a030d47a528b-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:34:13 crc kubenswrapper[5120]: I0316 16:34:13.480728 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k6mkd\" (UniqueName: \"kubernetes.io/projected/adce08fd-d30b-4413-ae7a-a030d47a528b-kube-api-access-k6mkd\") on node \"crc\" DevicePath \"\"" Mar 16 16:34:13 crc kubenswrapper[5120]: I0316 16:34:13.480737 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/adce08fd-d30b-4413-ae7a-a030d47a528b-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:34:13 crc kubenswrapper[5120]: I0316 16:34:13.480747 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/adce08fd-d30b-4413-ae7a-a030d47a528b-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:34:13 crc kubenswrapper[5120]: I0316 16:34:13.709001 5120 generic.go:358] "Generic (PLEG): container finished" podID="adce08fd-d30b-4413-ae7a-a030d47a528b" containerID="de43d1bdb28fdbcb168c9cd8b521a529a61e81310a4bdee84e1411be8cb627e5" exitCode=0 Mar 16 16:34:13 crc kubenswrapper[5120]: I0316 16:34:13.709291 5120 generic.go:358] "Generic (PLEG): container finished" podID="adce08fd-d30b-4413-ae7a-a030d47a528b" containerID="5fa609ae9948c70d9074f06c118cd5cb7142f01d5b6471525d0a07c73b9fd079" exitCode=143 Mar 16 16:34:13 crc kubenswrapper[5120]: I0316 16:34:13.709085 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:34:13 crc kubenswrapper[5120]: I0316 16:34:13.709103 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"adce08fd-d30b-4413-ae7a-a030d47a528b","Type":"ContainerDied","Data":"de43d1bdb28fdbcb168c9cd8b521a529a61e81310a4bdee84e1411be8cb627e5"} Mar 16 16:34:13 crc kubenswrapper[5120]: I0316 16:34:13.709448 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"adce08fd-d30b-4413-ae7a-a030d47a528b","Type":"ContainerDied","Data":"5fa609ae9948c70d9074f06c118cd5cb7142f01d5b6471525d0a07c73b9fd079"} Mar 16 16:34:13 crc kubenswrapper[5120]: I0316 16:34:13.709460 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"adce08fd-d30b-4413-ae7a-a030d47a528b","Type":"ContainerDied","Data":"ebbdf9f4c39d941aa064954b9ab1622385a48ad58de9f0bd0c331cc84ba2a790"} Mar 16 16:34:13 crc kubenswrapper[5120]: I0316 16:34:13.709476 5120 scope.go:117] "RemoveContainer" containerID="de43d1bdb28fdbcb168c9cd8b521a529a61e81310a4bdee84e1411be8cb627e5" Mar 16 16:34:13 crc kubenswrapper[5120]: I0316 16:34:13.733980 5120 scope.go:117] "RemoveContainer" containerID="5fa609ae9948c70d9074f06c118cd5cb7142f01d5b6471525d0a07c73b9fd079" Mar 16 16:34:13 crc kubenswrapper[5120]: I0316 16:34:13.752214 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:34:13 crc kubenswrapper[5120]: I0316 16:34:13.763650 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:34:13 crc kubenswrapper[5120]: I0316 16:34:13.779474 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:34:13 crc kubenswrapper[5120]: I0316 16:34:13.781236 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="adce08fd-d30b-4413-ae7a-a030d47a528b" containerName="nova-metadata-log" Mar 16 16:34:13 crc kubenswrapper[5120]: I0316 16:34:13.781262 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="adce08fd-d30b-4413-ae7a-a030d47a528b" containerName="nova-metadata-log" Mar 16 16:34:13 crc kubenswrapper[5120]: I0316 16:34:13.781274 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="adce08fd-d30b-4413-ae7a-a030d47a528b" containerName="nova-metadata-metadata" Mar 16 16:34:13 crc kubenswrapper[5120]: I0316 16:34:13.781282 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="adce08fd-d30b-4413-ae7a-a030d47a528b" containerName="nova-metadata-metadata" Mar 16 16:34:13 crc kubenswrapper[5120]: I0316 16:34:13.781466 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="adce08fd-d30b-4413-ae7a-a030d47a528b" containerName="nova-metadata-log" Mar 16 16:34:13 crc kubenswrapper[5120]: I0316 16:34:13.781479 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="adce08fd-d30b-4413-ae7a-a030d47a528b" containerName="nova-metadata-metadata" Mar 16 16:34:13 crc kubenswrapper[5120]: I0316 16:34:13.790368 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:34:13 crc kubenswrapper[5120]: I0316 16:34:13.795742 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-metadata-config-data\"" Mar 16 16:34:13 crc kubenswrapper[5120]: I0316 16:34:13.795938 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-metadata-internal-svc\"" Mar 16 16:34:13 crc kubenswrapper[5120]: I0316 16:34:13.796659 5120 scope.go:117] "RemoveContainer" containerID="de43d1bdb28fdbcb168c9cd8b521a529a61e81310a4bdee84e1411be8cb627e5" Mar 16 16:34:13 crc kubenswrapper[5120]: E0316 16:34:13.798654 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de43d1bdb28fdbcb168c9cd8b521a529a61e81310a4bdee84e1411be8cb627e5\": container with ID starting with de43d1bdb28fdbcb168c9cd8b521a529a61e81310a4bdee84e1411be8cb627e5 not found: ID does not exist" containerID="de43d1bdb28fdbcb168c9cd8b521a529a61e81310a4bdee84e1411be8cb627e5" Mar 16 16:34:13 crc kubenswrapper[5120]: I0316 16:34:13.798712 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de43d1bdb28fdbcb168c9cd8b521a529a61e81310a4bdee84e1411be8cb627e5"} err="failed to get container status \"de43d1bdb28fdbcb168c9cd8b521a529a61e81310a4bdee84e1411be8cb627e5\": rpc error: code = NotFound desc = could not find container \"de43d1bdb28fdbcb168c9cd8b521a529a61e81310a4bdee84e1411be8cb627e5\": container with ID starting with de43d1bdb28fdbcb168c9cd8b521a529a61e81310a4bdee84e1411be8cb627e5 not found: ID does not exist" Mar 16 16:34:13 crc kubenswrapper[5120]: I0316 16:34:13.798736 5120 scope.go:117] "RemoveContainer" containerID="5fa609ae9948c70d9074f06c118cd5cb7142f01d5b6471525d0a07c73b9fd079" Mar 16 16:34:13 crc kubenswrapper[5120]: E0316 16:34:13.799535 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5fa609ae9948c70d9074f06c118cd5cb7142f01d5b6471525d0a07c73b9fd079\": container with ID starting with 5fa609ae9948c70d9074f06c118cd5cb7142f01d5b6471525d0a07c73b9fd079 not found: ID does not exist" containerID="5fa609ae9948c70d9074f06c118cd5cb7142f01d5b6471525d0a07c73b9fd079" Mar 16 16:34:13 crc kubenswrapper[5120]: I0316 16:34:13.799564 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5fa609ae9948c70d9074f06c118cd5cb7142f01d5b6471525d0a07c73b9fd079"} err="failed to get container status \"5fa609ae9948c70d9074f06c118cd5cb7142f01d5b6471525d0a07c73b9fd079\": rpc error: code = NotFound desc = could not find container \"5fa609ae9948c70d9074f06c118cd5cb7142f01d5b6471525d0a07c73b9fd079\": container with ID starting with 5fa609ae9948c70d9074f06c118cd5cb7142f01d5b6471525d0a07c73b9fd079 not found: ID does not exist" Mar 16 16:34:13 crc kubenswrapper[5120]: I0316 16:34:13.799581 5120 scope.go:117] "RemoveContainer" containerID="de43d1bdb28fdbcb168c9cd8b521a529a61e81310a4bdee84e1411be8cb627e5" Mar 16 16:34:13 crc kubenswrapper[5120]: I0316 16:34:13.800095 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de43d1bdb28fdbcb168c9cd8b521a529a61e81310a4bdee84e1411be8cb627e5"} err="failed to get container status \"de43d1bdb28fdbcb168c9cd8b521a529a61e81310a4bdee84e1411be8cb627e5\": rpc error: code = NotFound desc = could not find container \"de43d1bdb28fdbcb168c9cd8b521a529a61e81310a4bdee84e1411be8cb627e5\": container with ID starting with de43d1bdb28fdbcb168c9cd8b521a529a61e81310a4bdee84e1411be8cb627e5 not found: ID does not exist" Mar 16 16:34:13 crc kubenswrapper[5120]: I0316 16:34:13.800143 5120 scope.go:117] "RemoveContainer" containerID="5fa609ae9948c70d9074f06c118cd5cb7142f01d5b6471525d0a07c73b9fd079" Mar 16 16:34:13 crc kubenswrapper[5120]: I0316 16:34:13.800698 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5fa609ae9948c70d9074f06c118cd5cb7142f01d5b6471525d0a07c73b9fd079"} err="failed to get container status \"5fa609ae9948c70d9074f06c118cd5cb7142f01d5b6471525d0a07c73b9fd079\": rpc error: code = NotFound desc = could not find container \"5fa609ae9948c70d9074f06c118cd5cb7142f01d5b6471525d0a07c73b9fd079\": container with ID starting with 5fa609ae9948c70d9074f06c118cd5cb7142f01d5b6471525d0a07c73b9fd079 not found: ID does not exist" Mar 16 16:34:13 crc kubenswrapper[5120]: I0316 16:34:13.806937 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:34:13 crc kubenswrapper[5120]: I0316 16:34:13.817095 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:34:13 crc kubenswrapper[5120]: I0316 16:34:13.851246 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:34:13 crc kubenswrapper[5120]: W0316 16:34:13.852635 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod364bfdcf_9673_41c8_b692_941d68257973.slice/crio-a397d7903b516bbcf556d04b25c769d0d17a40153ae4bf6f729f049c61381a60 WatchSource:0}: Error finding container a397d7903b516bbcf556d04b25c769d0d17a40153ae4bf6f729f049c61381a60: Status 404 returned error can't find the container with id a397d7903b516bbcf556d04b25c769d0d17a40153ae4bf6f729f049c61381a60 Mar 16 16:34:13 crc kubenswrapper[5120]: I0316 16:34:13.895060 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/dd9bd7b7-ae55-453f-b9fa-f0844f885e05-logs\") pod \"nova-metadata-0\" (UID: \"dd9bd7b7-ae55-453f-b9fa-f0844f885e05\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:34:13 crc kubenswrapper[5120]: I0316 16:34:13.895381 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/dd9bd7b7-ae55-453f-b9fa-f0844f885e05-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"dd9bd7b7-ae55-453f-b9fa-f0844f885e05\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:34:13 crc kubenswrapper[5120]: I0316 16:34:13.895781 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stzkl\" (UniqueName: \"kubernetes.io/projected/dd9bd7b7-ae55-453f-b9fa-f0844f885e05-kube-api-access-stzkl\") pod \"nova-metadata-0\" (UID: \"dd9bd7b7-ae55-453f-b9fa-f0844f885e05\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:34:13 crc kubenswrapper[5120]: I0316 16:34:13.895890 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dd9bd7b7-ae55-453f-b9fa-f0844f885e05-config-data\") pod \"nova-metadata-0\" (UID: \"dd9bd7b7-ae55-453f-b9fa-f0844f885e05\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:34:13 crc kubenswrapper[5120]: I0316 16:34:13.896108 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dd9bd7b7-ae55-453f-b9fa-f0844f885e05-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"dd9bd7b7-ae55-453f-b9fa-f0844f885e05\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:34:14 crc kubenswrapper[5120]: I0316 16:34:14.008864 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dd9bd7b7-ae55-453f-b9fa-f0844f885e05-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"dd9bd7b7-ae55-453f-b9fa-f0844f885e05\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:34:14 crc kubenswrapper[5120]: I0316 16:34:14.009055 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/dd9bd7b7-ae55-453f-b9fa-f0844f885e05-logs\") pod \"nova-metadata-0\" (UID: \"dd9bd7b7-ae55-453f-b9fa-f0844f885e05\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:34:14 crc kubenswrapper[5120]: I0316 16:34:14.009466 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/dd9bd7b7-ae55-453f-b9fa-f0844f885e05-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"dd9bd7b7-ae55-453f-b9fa-f0844f885e05\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:34:14 crc kubenswrapper[5120]: I0316 16:34:14.009671 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-stzkl\" (UniqueName: \"kubernetes.io/projected/dd9bd7b7-ae55-453f-b9fa-f0844f885e05-kube-api-access-stzkl\") pod \"nova-metadata-0\" (UID: \"dd9bd7b7-ae55-453f-b9fa-f0844f885e05\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:34:14 crc kubenswrapper[5120]: I0316 16:34:14.009694 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dd9bd7b7-ae55-453f-b9fa-f0844f885e05-config-data\") pod \"nova-metadata-0\" (UID: \"dd9bd7b7-ae55-453f-b9fa-f0844f885e05\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:34:14 crc kubenswrapper[5120]: I0316 16:34:14.010740 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/dd9bd7b7-ae55-453f-b9fa-f0844f885e05-logs\") pod \"nova-metadata-0\" (UID: \"dd9bd7b7-ae55-453f-b9fa-f0844f885e05\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:34:14 crc kubenswrapper[5120]: I0316 16:34:14.014532 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/dd9bd7b7-ae55-453f-b9fa-f0844f885e05-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"dd9bd7b7-ae55-453f-b9fa-f0844f885e05\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:34:14 crc kubenswrapper[5120]: I0316 16:34:14.014527 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dd9bd7b7-ae55-453f-b9fa-f0844f885e05-config-data\") pod \"nova-metadata-0\" (UID: \"dd9bd7b7-ae55-453f-b9fa-f0844f885e05\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:34:14 crc kubenswrapper[5120]: I0316 16:34:14.015283 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dd9bd7b7-ae55-453f-b9fa-f0844f885e05-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"dd9bd7b7-ae55-453f-b9fa-f0844f885e05\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:34:14 crc kubenswrapper[5120]: I0316 16:34:14.030858 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-stzkl\" (UniqueName: \"kubernetes.io/projected/dd9bd7b7-ae55-453f-b9fa-f0844f885e05-kube-api-access-stzkl\") pod \"nova-metadata-0\" (UID: \"dd9bd7b7-ae55-453f-b9fa-f0844f885e05\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:34:14 crc kubenswrapper[5120]: I0316 16:34:14.117956 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:34:14 crc kubenswrapper[5120]: I0316 16:34:14.553591 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:34:14 crc kubenswrapper[5120]: W0316 16:34:14.569933 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddd9bd7b7_ae55_453f_b9fa_f0844f885e05.slice/crio-8ae86074e9139fe13cb5f2b12f8827530d90a4572e6b53f3955cb29946fa0d53 WatchSource:0}: Error finding container 8ae86074e9139fe13cb5f2b12f8827530d90a4572e6b53f3955cb29946fa0d53: Status 404 returned error can't find the container with id 8ae86074e9139fe13cb5f2b12f8827530d90a4572e6b53f3955cb29946fa0d53 Mar 16 16:34:14 crc kubenswrapper[5120]: I0316 16:34:14.681032 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3e509149-94ac-458c-89ad-320aae1598cc" path="/var/lib/kubelet/pods/3e509149-94ac-458c-89ad-320aae1598cc/volumes" Mar 16 16:34:14 crc kubenswrapper[5120]: I0316 16:34:14.681805 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="adce08fd-d30b-4413-ae7a-a030d47a528b" path="/var/lib/kubelet/pods/adce08fd-d30b-4413-ae7a-a030d47a528b/volumes" Mar 16 16:34:14 crc kubenswrapper[5120]: I0316 16:34:14.722091 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"364bfdcf-9673-41c8-b692-941d68257973","Type":"ContainerStarted","Data":"3436ec6db1208b559eb91d991c3a73a3c9159ecad9eb1aeb50786f88a3c7bc52"} Mar 16 16:34:14 crc kubenswrapper[5120]: I0316 16:34:14.722139 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"364bfdcf-9673-41c8-b692-941d68257973","Type":"ContainerStarted","Data":"a397d7903b516bbcf556d04b25c769d0d17a40153ae4bf6f729f049c61381a60"} Mar 16 16:34:14 crc kubenswrapper[5120]: I0316 16:34:14.726873 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"dd9bd7b7-ae55-453f-b9fa-f0844f885e05","Type":"ContainerStarted","Data":"8ae86074e9139fe13cb5f2b12f8827530d90a4572e6b53f3955cb29946fa0d53"} Mar 16 16:34:14 crc kubenswrapper[5120]: I0316 16:34:14.746454 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podStartSLOduration=1.746431391 podStartE2EDuration="1.746431391s" podCreationTimestamp="2026-03-16 16:34:13 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:34:14.738620406 +0000 UTC m=+3756.892552063" watchObservedRunningTime="2026-03-16 16:34:14.746431391 +0000 UTC m=+3756.900363048" Mar 16 16:34:15 crc kubenswrapper[5120]: I0316 16:34:15.753118 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"dd9bd7b7-ae55-453f-b9fa-f0844f885e05","Type":"ContainerStarted","Data":"26879c8ed60256a8bf95f80164be27d1d893c3f9225fa9051293a0b93c1b321f"} Mar 16 16:34:15 crc kubenswrapper[5120]: I0316 16:34:15.753192 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"dd9bd7b7-ae55-453f-b9fa-f0844f885e05","Type":"ContainerStarted","Data":"793e973de9c370f43d386bec7ae5f2ff6aeb3d1f08a3240cba04e1114ca3ee2e"} Mar 16 16:34:15 crc kubenswrapper[5120]: I0316 16:34:15.773664 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=2.773641557 podStartE2EDuration="2.773641557s" podCreationTimestamp="2026-03-16 16:34:13 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:34:15.771696206 +0000 UTC m=+3757.925627883" watchObservedRunningTime="2026-03-16 16:34:15.773641557 +0000 UTC m=+3757.927573214" Mar 16 16:34:17 crc kubenswrapper[5120]: E0316 16:34:17.281175 5120 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod628685cb_eaf0_45f8_b678_c093de257dbc.slice/crio-46ccaf02befecb80356a3298d07b3fe888196e2a5b4f748f7f46d129cc9dc198.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod628685cb_eaf0_45f8_b678_c093de257dbc.slice/crio-conmon-46ccaf02befecb80356a3298d07b3fe888196e2a5b4f748f7f46d129cc9dc198.scope\": RecentStats: unable to find data in memory cache]" Mar 16 16:34:17 crc kubenswrapper[5120]: I0316 16:34:17.789888 5120 generic.go:358] "Generic (PLEG): container finished" podID="628685cb-eaf0-45f8-b678-c093de257dbc" containerID="46ccaf02befecb80356a3298d07b3fe888196e2a5b4f748f7f46d129cc9dc198" exitCode=0 Mar 16 16:34:17 crc kubenswrapper[5120]: I0316 16:34:17.789997 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-s56kl" event={"ID":"628685cb-eaf0-45f8-b678-c093de257dbc","Type":"ContainerDied","Data":"46ccaf02befecb80356a3298d07b3fe888196e2a5b4f748f7f46d129cc9dc198"} Mar 16 16:34:18 crc kubenswrapper[5120]: I0316 16:34:18.398955 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:34:18 crc kubenswrapper[5120]: I0316 16:34:18.680883 5120 scope.go:117] "RemoveContainer" containerID="0a15d5caff30dc8885f782e59962af7d98d58b39ab76059e56e5827e10e7ab8b" Mar 16 16:34:18 crc kubenswrapper[5120]: E0316 16:34:18.681725 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:34:18 crc kubenswrapper[5120]: I0316 16:34:18.694229 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:34:18 crc kubenswrapper[5120]: I0316 16:34:18.694293 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:34:18 crc kubenswrapper[5120]: I0316 16:34:18.817314 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:34:18 crc kubenswrapper[5120]: I0316 16:34:18.866885 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:34:19 crc kubenswrapper[5120]: I0316 16:34:19.199361 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-s56kl" Mar 16 16:34:19 crc kubenswrapper[5120]: I0316 16:34:19.348106 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/628685cb-eaf0-45f8-b678-c093de257dbc-combined-ca-bundle\") pod \"628685cb-eaf0-45f8-b678-c093de257dbc\" (UID: \"628685cb-eaf0-45f8-b678-c093de257dbc\") " Mar 16 16:34:19 crc kubenswrapper[5120]: I0316 16:34:19.348634 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9sl75\" (UniqueName: \"kubernetes.io/projected/628685cb-eaf0-45f8-b678-c093de257dbc-kube-api-access-9sl75\") pod \"628685cb-eaf0-45f8-b678-c093de257dbc\" (UID: \"628685cb-eaf0-45f8-b678-c093de257dbc\") " Mar 16 16:34:19 crc kubenswrapper[5120]: I0316 16:34:19.348897 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/628685cb-eaf0-45f8-b678-c093de257dbc-config-data\") pod \"628685cb-eaf0-45f8-b678-c093de257dbc\" (UID: \"628685cb-eaf0-45f8-b678-c093de257dbc\") " Mar 16 16:34:19 crc kubenswrapper[5120]: I0316 16:34:19.349040 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/628685cb-eaf0-45f8-b678-c093de257dbc-scripts\") pod \"628685cb-eaf0-45f8-b678-c093de257dbc\" (UID: \"628685cb-eaf0-45f8-b678-c093de257dbc\") " Mar 16 16:34:19 crc kubenswrapper[5120]: I0316 16:34:19.355859 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/628685cb-eaf0-45f8-b678-c093de257dbc-kube-api-access-9sl75" (OuterVolumeSpecName: "kube-api-access-9sl75") pod "628685cb-eaf0-45f8-b678-c093de257dbc" (UID: "628685cb-eaf0-45f8-b678-c093de257dbc"). InnerVolumeSpecName "kube-api-access-9sl75". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:34:19 crc kubenswrapper[5120]: I0316 16:34:19.355921 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/628685cb-eaf0-45f8-b678-c093de257dbc-scripts" (OuterVolumeSpecName: "scripts") pod "628685cb-eaf0-45f8-b678-c093de257dbc" (UID: "628685cb-eaf0-45f8-b678-c093de257dbc"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:34:19 crc kubenswrapper[5120]: I0316 16:34:19.386446 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/628685cb-eaf0-45f8-b678-c093de257dbc-config-data" (OuterVolumeSpecName: "config-data") pod "628685cb-eaf0-45f8-b678-c093de257dbc" (UID: "628685cb-eaf0-45f8-b678-c093de257dbc"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:34:19 crc kubenswrapper[5120]: I0316 16:34:19.393867 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/628685cb-eaf0-45f8-b678-c093de257dbc-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "628685cb-eaf0-45f8-b678-c093de257dbc" (UID: "628685cb-eaf0-45f8-b678-c093de257dbc"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:34:19 crc kubenswrapper[5120]: I0316 16:34:19.452281 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/628685cb-eaf0-45f8-b678-c093de257dbc-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:34:19 crc kubenswrapper[5120]: I0316 16:34:19.452354 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9sl75\" (UniqueName: \"kubernetes.io/projected/628685cb-eaf0-45f8-b678-c093de257dbc-kube-api-access-9sl75\") on node \"crc\" DevicePath \"\"" Mar 16 16:34:19 crc kubenswrapper[5120]: I0316 16:34:19.452370 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/628685cb-eaf0-45f8-b678-c093de257dbc-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:34:19 crc kubenswrapper[5120]: I0316 16:34:19.452382 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/628685cb-eaf0-45f8-b678-c093de257dbc-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:34:19 crc kubenswrapper[5120]: I0316 16:34:19.721068 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="bba795d8-6362-41cc-b73f-1b4101d28c26" containerName="nova-api-log" probeResult="failure" output="Get \"http://10.217.0.185:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 16:34:19 crc kubenswrapper[5120]: I0316 16:34:19.723143 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="bba795d8-6362-41cc-b73f-1b4101d28c26" containerName="nova-api-api" probeResult="failure" output="Get \"http://10.217.0.185:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 16:34:19 crc kubenswrapper[5120]: I0316 16:34:19.813973 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-s56kl" Mar 16 16:34:19 crc kubenswrapper[5120]: I0316 16:34:19.814597 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-s56kl" event={"ID":"628685cb-eaf0-45f8-b678-c093de257dbc","Type":"ContainerDied","Data":"b7b403272bde3368f11c52e8f3d8c9d567bf2262eb5725eba40dfd9261c5268c"} Mar 16 16:34:19 crc kubenswrapper[5120]: I0316 16:34:19.814638 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b7b403272bde3368f11c52e8f3d8c9d567bf2262eb5725eba40dfd9261c5268c" Mar 16 16:34:19 crc kubenswrapper[5120]: I0316 16:34:19.852214 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:34:19 crc kubenswrapper[5120]: I0316 16:34:19.992125 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:34:19 crc kubenswrapper[5120]: I0316 16:34:19.992498 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="bba795d8-6362-41cc-b73f-1b4101d28c26" containerName="nova-api-log" containerID="cri-o://8a49af4de18f552f63e6bb5d67e800d9991f5bb6b5b27ea2181fbe7a25888ea1" gracePeriod=30 Mar 16 16:34:19 crc kubenswrapper[5120]: I0316 16:34:19.993342 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="bba795d8-6362-41cc-b73f-1b4101d28c26" containerName="nova-api-api" containerID="cri-o://a892fc7bbd72e1b6b01130437df347bf98d1ecea87ce341b1e3fe9e9257246a9" gracePeriod=30 Mar 16 16:34:20 crc kubenswrapper[5120]: I0316 16:34:20.023709 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:34:20 crc kubenswrapper[5120]: I0316 16:34:20.024403 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="dd9bd7b7-ae55-453f-b9fa-f0844f885e05" containerName="nova-metadata-metadata" containerID="cri-o://26879c8ed60256a8bf95f80164be27d1d893c3f9225fa9051293a0b93c1b321f" gracePeriod=30 Mar 16 16:34:20 crc kubenswrapper[5120]: I0316 16:34:20.026132 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="dd9bd7b7-ae55-453f-b9fa-f0844f885e05" containerName="nova-metadata-log" containerID="cri-o://793e973de9c370f43d386bec7ae5f2ff6aeb3d1f08a3240cba04e1114ca3ee2e" gracePeriod=30 Mar 16 16:34:20 crc kubenswrapper[5120]: I0316 16:34:20.690035 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:34:20 crc kubenswrapper[5120]: I0316 16:34:20.834425 5120 generic.go:358] "Generic (PLEG): container finished" podID="bba795d8-6362-41cc-b73f-1b4101d28c26" containerID="8a49af4de18f552f63e6bb5d67e800d9991f5bb6b5b27ea2181fbe7a25888ea1" exitCode=143 Mar 16 16:34:20 crc kubenswrapper[5120]: I0316 16:34:20.834917 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"bba795d8-6362-41cc-b73f-1b4101d28c26","Type":"ContainerDied","Data":"8a49af4de18f552f63e6bb5d67e800d9991f5bb6b5b27ea2181fbe7a25888ea1"} Mar 16 16:34:20 crc kubenswrapper[5120]: I0316 16:34:20.852363 5120 generic.go:358] "Generic (PLEG): container finished" podID="dd9bd7b7-ae55-453f-b9fa-f0844f885e05" containerID="26879c8ed60256a8bf95f80164be27d1d893c3f9225fa9051293a0b93c1b321f" exitCode=0 Mar 16 16:34:20 crc kubenswrapper[5120]: I0316 16:34:20.852400 5120 generic.go:358] "Generic (PLEG): container finished" podID="dd9bd7b7-ae55-453f-b9fa-f0844f885e05" containerID="793e973de9c370f43d386bec7ae5f2ff6aeb3d1f08a3240cba04e1114ca3ee2e" exitCode=143 Mar 16 16:34:20 crc kubenswrapper[5120]: I0316 16:34:20.852716 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"dd9bd7b7-ae55-453f-b9fa-f0844f885e05","Type":"ContainerDied","Data":"26879c8ed60256a8bf95f80164be27d1d893c3f9225fa9051293a0b93c1b321f"} Mar 16 16:34:20 crc kubenswrapper[5120]: I0316 16:34:20.852881 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"dd9bd7b7-ae55-453f-b9fa-f0844f885e05","Type":"ContainerDied","Data":"793e973de9c370f43d386bec7ae5f2ff6aeb3d1f08a3240cba04e1114ca3ee2e"} Mar 16 16:34:20 crc kubenswrapper[5120]: I0316 16:34:20.858444 5120 generic.go:358] "Generic (PLEG): container finished" podID="7d70927c-1432-4edb-a414-ca8fc40dd220" containerID="9dabeafb0b740b3ad03a7b9cfcd7fe649e2992960a96553a85c939a2509080c4" exitCode=0 Mar 16 16:34:20 crc kubenswrapper[5120]: I0316 16:34:20.863501 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-sdp7k" event={"ID":"7d70927c-1432-4edb-a414-ca8fc40dd220","Type":"ContainerDied","Data":"9dabeafb0b740b3ad03a7b9cfcd7fe649e2992960a96553a85c939a2509080c4"} Mar 16 16:34:21 crc kubenswrapper[5120]: I0316 16:34:21.187729 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:34:21 crc kubenswrapper[5120]: I0316 16:34:21.305313 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dd9bd7b7-ae55-453f-b9fa-f0844f885e05-config-data\") pod \"dd9bd7b7-ae55-453f-b9fa-f0844f885e05\" (UID: \"dd9bd7b7-ae55-453f-b9fa-f0844f885e05\") " Mar 16 16:34:21 crc kubenswrapper[5120]: I0316 16:34:21.306225 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/dd9bd7b7-ae55-453f-b9fa-f0844f885e05-nova-metadata-tls-certs\") pod \"dd9bd7b7-ae55-453f-b9fa-f0844f885e05\" (UID: \"dd9bd7b7-ae55-453f-b9fa-f0844f885e05\") " Mar 16 16:34:21 crc kubenswrapper[5120]: I0316 16:34:21.306424 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-stzkl\" (UniqueName: \"kubernetes.io/projected/dd9bd7b7-ae55-453f-b9fa-f0844f885e05-kube-api-access-stzkl\") pod \"dd9bd7b7-ae55-453f-b9fa-f0844f885e05\" (UID: \"dd9bd7b7-ae55-453f-b9fa-f0844f885e05\") " Mar 16 16:34:21 crc kubenswrapper[5120]: I0316 16:34:21.306680 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dd9bd7b7-ae55-453f-b9fa-f0844f885e05-combined-ca-bundle\") pod \"dd9bd7b7-ae55-453f-b9fa-f0844f885e05\" (UID: \"dd9bd7b7-ae55-453f-b9fa-f0844f885e05\") " Mar 16 16:34:21 crc kubenswrapper[5120]: I0316 16:34:21.306862 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/dd9bd7b7-ae55-453f-b9fa-f0844f885e05-logs\") pod \"dd9bd7b7-ae55-453f-b9fa-f0844f885e05\" (UID: \"dd9bd7b7-ae55-453f-b9fa-f0844f885e05\") " Mar 16 16:34:21 crc kubenswrapper[5120]: I0316 16:34:21.307478 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd9bd7b7-ae55-453f-b9fa-f0844f885e05-logs" (OuterVolumeSpecName: "logs") pod "dd9bd7b7-ae55-453f-b9fa-f0844f885e05" (UID: "dd9bd7b7-ae55-453f-b9fa-f0844f885e05"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:34:21 crc kubenswrapper[5120]: I0316 16:34:21.307999 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/dd9bd7b7-ae55-453f-b9fa-f0844f885e05-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:34:21 crc kubenswrapper[5120]: I0316 16:34:21.312269 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd9bd7b7-ae55-453f-b9fa-f0844f885e05-kube-api-access-stzkl" (OuterVolumeSpecName: "kube-api-access-stzkl") pod "dd9bd7b7-ae55-453f-b9fa-f0844f885e05" (UID: "dd9bd7b7-ae55-453f-b9fa-f0844f885e05"). InnerVolumeSpecName "kube-api-access-stzkl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:34:21 crc kubenswrapper[5120]: I0316 16:34:21.339053 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd9bd7b7-ae55-453f-b9fa-f0844f885e05-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "dd9bd7b7-ae55-453f-b9fa-f0844f885e05" (UID: "dd9bd7b7-ae55-453f-b9fa-f0844f885e05"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:34:21 crc kubenswrapper[5120]: I0316 16:34:21.341632 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd9bd7b7-ae55-453f-b9fa-f0844f885e05-config-data" (OuterVolumeSpecName: "config-data") pod "dd9bd7b7-ae55-453f-b9fa-f0844f885e05" (UID: "dd9bd7b7-ae55-453f-b9fa-f0844f885e05"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:34:21 crc kubenswrapper[5120]: I0316 16:34:21.377705 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd9bd7b7-ae55-453f-b9fa-f0844f885e05-nova-metadata-tls-certs" (OuterVolumeSpecName: "nova-metadata-tls-certs") pod "dd9bd7b7-ae55-453f-b9fa-f0844f885e05" (UID: "dd9bd7b7-ae55-453f-b9fa-f0844f885e05"). InnerVolumeSpecName "nova-metadata-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:34:21 crc kubenswrapper[5120]: I0316 16:34:21.410510 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dd9bd7b7-ae55-453f-b9fa-f0844f885e05-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:34:21 crc kubenswrapper[5120]: I0316 16:34:21.410550 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dd9bd7b7-ae55-453f-b9fa-f0844f885e05-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:34:21 crc kubenswrapper[5120]: I0316 16:34:21.410561 5120 reconciler_common.go:299] "Volume detached for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/dd9bd7b7-ae55-453f-b9fa-f0844f885e05-nova-metadata-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:34:21 crc kubenswrapper[5120]: I0316 16:34:21.410572 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-stzkl\" (UniqueName: \"kubernetes.io/projected/dd9bd7b7-ae55-453f-b9fa-f0844f885e05-kube-api-access-stzkl\") on node \"crc\" DevicePath \"\"" Mar 16 16:34:21 crc kubenswrapper[5120]: I0316 16:34:21.871134 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:34:21 crc kubenswrapper[5120]: I0316 16:34:21.871152 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"dd9bd7b7-ae55-453f-b9fa-f0844f885e05","Type":"ContainerDied","Data":"8ae86074e9139fe13cb5f2b12f8827530d90a4572e6b53f3955cb29946fa0d53"} Mar 16 16:34:21 crc kubenswrapper[5120]: I0316 16:34:21.871236 5120 scope.go:117] "RemoveContainer" containerID="26879c8ed60256a8bf95f80164be27d1d893c3f9225fa9051293a0b93c1b321f" Mar 16 16:34:21 crc kubenswrapper[5120]: I0316 16:34:21.872910 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="bec1e292-e023-489e-9d12-c9ccbc1488e2" containerName="nova-scheduler-scheduler" containerID="cri-o://ad8e2ec5b87993e63a39edc2e193772a2f831e952f623a27fc9e87d4868bf786" gracePeriod=30 Mar 16 16:34:21 crc kubenswrapper[5120]: I0316 16:34:21.917847 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:34:21 crc kubenswrapper[5120]: I0316 16:34:21.922184 5120 scope.go:117] "RemoveContainer" containerID="793e973de9c370f43d386bec7ae5f2ff6aeb3d1f08a3240cba04e1114ca3ee2e" Mar 16 16:34:21 crc kubenswrapper[5120]: I0316 16:34:21.930247 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:34:21 crc kubenswrapper[5120]: I0316 16:34:21.945836 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:34:21 crc kubenswrapper[5120]: I0316 16:34:21.947165 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd9bd7b7-ae55-453f-b9fa-f0844f885e05" containerName="nova-metadata-log" Mar 16 16:34:21 crc kubenswrapper[5120]: I0316 16:34:21.947193 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd9bd7b7-ae55-453f-b9fa-f0844f885e05" containerName="nova-metadata-log" Mar 16 16:34:21 crc kubenswrapper[5120]: I0316 16:34:21.947221 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd9bd7b7-ae55-453f-b9fa-f0844f885e05" containerName="nova-metadata-metadata" Mar 16 16:34:21 crc kubenswrapper[5120]: I0316 16:34:21.947228 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd9bd7b7-ae55-453f-b9fa-f0844f885e05" containerName="nova-metadata-metadata" Mar 16 16:34:21 crc kubenswrapper[5120]: I0316 16:34:21.947261 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="628685cb-eaf0-45f8-b678-c093de257dbc" containerName="nova-manage" Mar 16 16:34:21 crc kubenswrapper[5120]: I0316 16:34:21.947267 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="628685cb-eaf0-45f8-b678-c093de257dbc" containerName="nova-manage" Mar 16 16:34:21 crc kubenswrapper[5120]: I0316 16:34:21.947494 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="dd9bd7b7-ae55-453f-b9fa-f0844f885e05" containerName="nova-metadata-log" Mar 16 16:34:21 crc kubenswrapper[5120]: I0316 16:34:21.947513 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="628685cb-eaf0-45f8-b678-c093de257dbc" containerName="nova-manage" Mar 16 16:34:21 crc kubenswrapper[5120]: I0316 16:34:21.947535 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="dd9bd7b7-ae55-453f-b9fa-f0844f885e05" containerName="nova-metadata-metadata" Mar 16 16:34:21 crc kubenswrapper[5120]: I0316 16:34:21.957191 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:34:21 crc kubenswrapper[5120]: I0316 16:34:21.957340 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:34:21 crc kubenswrapper[5120]: I0316 16:34:21.962129 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-metadata-config-data\"" Mar 16 16:34:21 crc kubenswrapper[5120]: I0316 16:34:21.962389 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-metadata-internal-svc\"" Mar 16 16:34:22 crc kubenswrapper[5120]: I0316 16:34:22.026817 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2b177362-e72c-4e7d-b029-e1a88c988fec-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"2b177362-e72c-4e7d-b029-e1a88c988fec\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:34:22 crc kubenswrapper[5120]: I0316 16:34:22.027217 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdz8r\" (UniqueName: \"kubernetes.io/projected/2b177362-e72c-4e7d-b029-e1a88c988fec-kube-api-access-vdz8r\") pod \"nova-metadata-0\" (UID: \"2b177362-e72c-4e7d-b029-e1a88c988fec\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:34:22 crc kubenswrapper[5120]: I0316 16:34:22.027372 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2b177362-e72c-4e7d-b029-e1a88c988fec-config-data\") pod \"nova-metadata-0\" (UID: \"2b177362-e72c-4e7d-b029-e1a88c988fec\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:34:22 crc kubenswrapper[5120]: I0316 16:34:22.027747 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/2b177362-e72c-4e7d-b029-e1a88c988fec-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"2b177362-e72c-4e7d-b029-e1a88c988fec\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:34:22 crc kubenswrapper[5120]: I0316 16:34:22.027895 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2b177362-e72c-4e7d-b029-e1a88c988fec-logs\") pod \"nova-metadata-0\" (UID: \"2b177362-e72c-4e7d-b029-e1a88c988fec\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:34:22 crc kubenswrapper[5120]: I0316 16:34:22.129377 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2b177362-e72c-4e7d-b029-e1a88c988fec-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"2b177362-e72c-4e7d-b029-e1a88c988fec\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:34:22 crc kubenswrapper[5120]: I0316 16:34:22.129443 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vdz8r\" (UniqueName: \"kubernetes.io/projected/2b177362-e72c-4e7d-b029-e1a88c988fec-kube-api-access-vdz8r\") pod \"nova-metadata-0\" (UID: \"2b177362-e72c-4e7d-b029-e1a88c988fec\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:34:22 crc kubenswrapper[5120]: I0316 16:34:22.129552 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2b177362-e72c-4e7d-b029-e1a88c988fec-config-data\") pod \"nova-metadata-0\" (UID: \"2b177362-e72c-4e7d-b029-e1a88c988fec\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:34:22 crc kubenswrapper[5120]: I0316 16:34:22.130154 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/2b177362-e72c-4e7d-b029-e1a88c988fec-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"2b177362-e72c-4e7d-b029-e1a88c988fec\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:34:22 crc kubenswrapper[5120]: I0316 16:34:22.130184 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2b177362-e72c-4e7d-b029-e1a88c988fec-logs\") pod \"nova-metadata-0\" (UID: \"2b177362-e72c-4e7d-b029-e1a88c988fec\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:34:22 crc kubenswrapper[5120]: I0316 16:34:22.130552 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2b177362-e72c-4e7d-b029-e1a88c988fec-logs\") pod \"nova-metadata-0\" (UID: \"2b177362-e72c-4e7d-b029-e1a88c988fec\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:34:22 crc kubenswrapper[5120]: I0316 16:34:22.135562 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/2b177362-e72c-4e7d-b029-e1a88c988fec-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"2b177362-e72c-4e7d-b029-e1a88c988fec\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:34:22 crc kubenswrapper[5120]: I0316 16:34:22.135689 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2b177362-e72c-4e7d-b029-e1a88c988fec-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"2b177362-e72c-4e7d-b029-e1a88c988fec\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:34:22 crc kubenswrapper[5120]: I0316 16:34:22.137324 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2b177362-e72c-4e7d-b029-e1a88c988fec-config-data\") pod \"nova-metadata-0\" (UID: \"2b177362-e72c-4e7d-b029-e1a88c988fec\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:34:22 crc kubenswrapper[5120]: I0316 16:34:22.147550 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdz8r\" (UniqueName: \"kubernetes.io/projected/2b177362-e72c-4e7d-b029-e1a88c988fec-kube-api-access-vdz8r\") pod \"nova-metadata-0\" (UID: \"2b177362-e72c-4e7d-b029-e1a88c988fec\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:34:22 crc kubenswrapper[5120]: I0316 16:34:22.286665 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:34:22 crc kubenswrapper[5120]: I0316 16:34:22.310480 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-sdp7k" Mar 16 16:34:22 crc kubenswrapper[5120]: I0316 16:34:22.445635 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7d70927c-1432-4edb-a414-ca8fc40dd220-scripts\") pod \"7d70927c-1432-4edb-a414-ca8fc40dd220\" (UID: \"7d70927c-1432-4edb-a414-ca8fc40dd220\") " Mar 16 16:34:22 crc kubenswrapper[5120]: I0316 16:34:22.445776 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7d70927c-1432-4edb-a414-ca8fc40dd220-config-data\") pod \"7d70927c-1432-4edb-a414-ca8fc40dd220\" (UID: \"7d70927c-1432-4edb-a414-ca8fc40dd220\") " Mar 16 16:34:22 crc kubenswrapper[5120]: I0316 16:34:22.445998 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7d70927c-1432-4edb-a414-ca8fc40dd220-combined-ca-bundle\") pod \"7d70927c-1432-4edb-a414-ca8fc40dd220\" (UID: \"7d70927c-1432-4edb-a414-ca8fc40dd220\") " Mar 16 16:34:22 crc kubenswrapper[5120]: I0316 16:34:22.446078 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4xdrm\" (UniqueName: \"kubernetes.io/projected/7d70927c-1432-4edb-a414-ca8fc40dd220-kube-api-access-4xdrm\") pod \"7d70927c-1432-4edb-a414-ca8fc40dd220\" (UID: \"7d70927c-1432-4edb-a414-ca8fc40dd220\") " Mar 16 16:34:22 crc kubenswrapper[5120]: I0316 16:34:22.454984 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d70927c-1432-4edb-a414-ca8fc40dd220-kube-api-access-4xdrm" (OuterVolumeSpecName: "kube-api-access-4xdrm") pod "7d70927c-1432-4edb-a414-ca8fc40dd220" (UID: "7d70927c-1432-4edb-a414-ca8fc40dd220"). InnerVolumeSpecName "kube-api-access-4xdrm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:34:22 crc kubenswrapper[5120]: I0316 16:34:22.455528 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d70927c-1432-4edb-a414-ca8fc40dd220-scripts" (OuterVolumeSpecName: "scripts") pod "7d70927c-1432-4edb-a414-ca8fc40dd220" (UID: "7d70927c-1432-4edb-a414-ca8fc40dd220"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:34:22 crc kubenswrapper[5120]: I0316 16:34:22.490070 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d70927c-1432-4edb-a414-ca8fc40dd220-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "7d70927c-1432-4edb-a414-ca8fc40dd220" (UID: "7d70927c-1432-4edb-a414-ca8fc40dd220"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:34:22 crc kubenswrapper[5120]: I0316 16:34:22.491521 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d70927c-1432-4edb-a414-ca8fc40dd220-config-data" (OuterVolumeSpecName: "config-data") pod "7d70927c-1432-4edb-a414-ca8fc40dd220" (UID: "7d70927c-1432-4edb-a414-ca8fc40dd220"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:34:22 crc kubenswrapper[5120]: I0316 16:34:22.550532 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7d70927c-1432-4edb-a414-ca8fc40dd220-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:34:22 crc kubenswrapper[5120]: I0316 16:34:22.551119 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4xdrm\" (UniqueName: \"kubernetes.io/projected/7d70927c-1432-4edb-a414-ca8fc40dd220-kube-api-access-4xdrm\") on node \"crc\" DevicePath \"\"" Mar 16 16:34:22 crc kubenswrapper[5120]: I0316 16:34:22.551237 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7d70927c-1432-4edb-a414-ca8fc40dd220-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:34:22 crc kubenswrapper[5120]: I0316 16:34:22.551324 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7d70927c-1432-4edb-a414-ca8fc40dd220-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:34:22 crc kubenswrapper[5120]: I0316 16:34:22.683825 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dd9bd7b7-ae55-453f-b9fa-f0844f885e05" path="/var/lib/kubelet/pods/dd9bd7b7-ae55-453f-b9fa-f0844f885e05/volumes" Mar 16 16:34:22 crc kubenswrapper[5120]: W0316 16:34:22.762524 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2b177362_e72c_4e7d_b029_e1a88c988fec.slice/crio-893415923fc6fa61c3c31c9d9ad7f9800013a2ddf5f0f45b0c0ec41d8a327fcf WatchSource:0}: Error finding container 893415923fc6fa61c3c31c9d9ad7f9800013a2ddf5f0f45b0c0ec41d8a327fcf: Status 404 returned error can't find the container with id 893415923fc6fa61c3c31c9d9ad7f9800013a2ddf5f0f45b0c0ec41d8a327fcf Mar 16 16:34:22 crc kubenswrapper[5120]: I0316 16:34:22.763778 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:34:22 crc kubenswrapper[5120]: I0316 16:34:22.884553 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-sdp7k" Mar 16 16:34:22 crc kubenswrapper[5120]: I0316 16:34:22.884544 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-sdp7k" event={"ID":"7d70927c-1432-4edb-a414-ca8fc40dd220","Type":"ContainerDied","Data":"4e02905c4296b6d2985eb6dce04b67a8c0092cb47f47a253ca288e1bdcb22d6b"} Mar 16 16:34:22 crc kubenswrapper[5120]: I0316 16:34:22.884743 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4e02905c4296b6d2985eb6dce04b67a8c0092cb47f47a253ca288e1bdcb22d6b" Mar 16 16:34:22 crc kubenswrapper[5120]: I0316 16:34:22.888007 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"2b177362-e72c-4e7d-b029-e1a88c988fec","Type":"ContainerStarted","Data":"893415923fc6fa61c3c31c9d9ad7f9800013a2ddf5f0f45b0c0ec41d8a327fcf"} Mar 16 16:34:22 crc kubenswrapper[5120]: I0316 16:34:22.985893 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 16:34:22 crc kubenswrapper[5120]: I0316 16:34:22.987035 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d70927c-1432-4edb-a414-ca8fc40dd220" containerName="nova-cell1-conductor-db-sync" Mar 16 16:34:22 crc kubenswrapper[5120]: I0316 16:34:22.987050 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d70927c-1432-4edb-a414-ca8fc40dd220" containerName="nova-cell1-conductor-db-sync" Mar 16 16:34:22 crc kubenswrapper[5120]: I0316 16:34:22.987279 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7d70927c-1432-4edb-a414-ca8fc40dd220" containerName="nova-cell1-conductor-db-sync" Mar 16 16:34:22 crc kubenswrapper[5120]: I0316 16:34:22.996647 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:34:22 crc kubenswrapper[5120]: I0316 16:34:22.996886 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 16:34:23 crc kubenswrapper[5120]: I0316 16:34:23.000489 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-conductor-config-data\"" Mar 16 16:34:23 crc kubenswrapper[5120]: I0316 16:34:23.064003 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e88b61c1-a3d0-4b23-820a-b117cf5b90c1-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"e88b61c1-a3d0-4b23-820a-b117cf5b90c1\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:34:23 crc kubenswrapper[5120]: I0316 16:34:23.064546 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xcvk\" (UniqueName: \"kubernetes.io/projected/e88b61c1-a3d0-4b23-820a-b117cf5b90c1-kube-api-access-8xcvk\") pod \"nova-cell1-conductor-0\" (UID: \"e88b61c1-a3d0-4b23-820a-b117cf5b90c1\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:34:23 crc kubenswrapper[5120]: I0316 16:34:23.064801 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e88b61c1-a3d0-4b23-820a-b117cf5b90c1-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"e88b61c1-a3d0-4b23-820a-b117cf5b90c1\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:34:23 crc kubenswrapper[5120]: I0316 16:34:23.166607 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e88b61c1-a3d0-4b23-820a-b117cf5b90c1-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"e88b61c1-a3d0-4b23-820a-b117cf5b90c1\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:34:23 crc kubenswrapper[5120]: I0316 16:34:23.167058 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e88b61c1-a3d0-4b23-820a-b117cf5b90c1-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"e88b61c1-a3d0-4b23-820a-b117cf5b90c1\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:34:23 crc kubenswrapper[5120]: I0316 16:34:23.167292 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8xcvk\" (UniqueName: \"kubernetes.io/projected/e88b61c1-a3d0-4b23-820a-b117cf5b90c1-kube-api-access-8xcvk\") pod \"nova-cell1-conductor-0\" (UID: \"e88b61c1-a3d0-4b23-820a-b117cf5b90c1\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:34:23 crc kubenswrapper[5120]: I0316 16:34:23.171599 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e88b61c1-a3d0-4b23-820a-b117cf5b90c1-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"e88b61c1-a3d0-4b23-820a-b117cf5b90c1\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:34:23 crc kubenswrapper[5120]: I0316 16:34:23.172614 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e88b61c1-a3d0-4b23-820a-b117cf5b90c1-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"e88b61c1-a3d0-4b23-820a-b117cf5b90c1\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:34:23 crc kubenswrapper[5120]: I0316 16:34:23.197543 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xcvk\" (UniqueName: \"kubernetes.io/projected/e88b61c1-a3d0-4b23-820a-b117cf5b90c1-kube-api-access-8xcvk\") pod \"nova-cell1-conductor-0\" (UID: \"e88b61c1-a3d0-4b23-820a-b117cf5b90c1\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:34:23 crc kubenswrapper[5120]: I0316 16:34:23.319119 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:34:23 crc kubenswrapper[5120]: I0316 16:34:23.399056 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:34:23 crc kubenswrapper[5120]: I0316 16:34:23.422048 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:34:23 crc kubenswrapper[5120]: I0316 16:34:23.767115 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 16:34:23 crc kubenswrapper[5120]: I0316 16:34:23.903107 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"2b177362-e72c-4e7d-b029-e1a88c988fec","Type":"ContainerStarted","Data":"c68ece73025e33e3545fef021a08c454bda7ff66411e1dd56ad98a17562e0a31"} Mar 16 16:34:23 crc kubenswrapper[5120]: I0316 16:34:23.903161 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"2b177362-e72c-4e7d-b029-e1a88c988fec","Type":"ContainerStarted","Data":"26185cae285f17b199d2065f17d902449ad5aee8c03aa9de8535f1cb74f1aa13"} Mar 16 16:34:23 crc kubenswrapper[5120]: I0316 16:34:23.906020 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"e88b61c1-a3d0-4b23-820a-b117cf5b90c1","Type":"ContainerStarted","Data":"30bfec87cd6562510e1cea987111107cec023effe499c68e52895663e25cd257"} Mar 16 16:34:23 crc kubenswrapper[5120]: I0316 16:34:23.923536 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=2.923512354 podStartE2EDuration="2.923512354s" podCreationTimestamp="2026-03-16 16:34:21 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:34:23.920864724 +0000 UTC m=+3766.074796401" watchObservedRunningTime="2026-03-16 16:34:23.923512354 +0000 UTC m=+3766.077444011" Mar 16 16:34:23 crc kubenswrapper[5120]: I0316 16:34:23.932583 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:34:23 crc kubenswrapper[5120]: I0316 16:34:23.934314 5120 scope.go:117] "RemoveContainer" containerID="c13b2806d0eba671dc3f5433f6b3bcc71933d4ad5f267f5b0c259bad23300e40" Mar 16 16:34:23 crc kubenswrapper[5120]: I0316 16:34:23.966919 5120 scope.go:117] "RemoveContainer" containerID="307544a2abe379238f6873b27816efbf5bb703115ac42bfccc139ce562b1c250" Mar 16 16:34:24 crc kubenswrapper[5120]: I0316 16:34:24.031578 5120 scope.go:117] "RemoveContainer" containerID="d02f6f0569175dc3b390375b76930ff0767123b353b32d8975594e7d2e8d83b7" Mar 16 16:34:24 crc kubenswrapper[5120]: I0316 16:34:24.073251 5120 scope.go:117] "RemoveContainer" containerID="da00e81daeecf12a8e0392eebd750a6fc413b64acadc45c12ab5750598d1bbc4" Mar 16 16:34:24 crc kubenswrapper[5120]: I0316 16:34:24.093542 5120 scope.go:117] "RemoveContainer" containerID="ba0a793f1053b5ed6a86a74ce35716f1e374dde3c6e47a21b90f752bec272c7a" Mar 16 16:34:24 crc kubenswrapper[5120]: I0316 16:34:24.116288 5120 scope.go:117] "RemoveContainer" containerID="93108a3a5b17fa5c9d5dbb5f8b46764d9de5f49f992564654c8edef477a51664" Mar 16 16:34:24 crc kubenswrapper[5120]: I0316 16:34:24.160226 5120 scope.go:117] "RemoveContainer" containerID="59f322a3d7236277d6645148c7840ef488c15805a0793f6d2d317c8f8f20ebcc" Mar 16 16:34:24 crc kubenswrapper[5120]: I0316 16:34:24.209629 5120 scope.go:117] "RemoveContainer" containerID="ecd57a8becef854fe7695d21618ffda8f9f7ddc2d5081f731f5cb4f6122a34ce" Mar 16 16:34:24 crc kubenswrapper[5120]: I0316 16:34:24.251445 5120 scope.go:117] "RemoveContainer" containerID="92febd01ea42f0695408604777f188c059856b8e4bbe245b0228518aca4cf7aa" Mar 16 16:34:24 crc kubenswrapper[5120]: I0316 16:34:24.272364 5120 scope.go:117] "RemoveContainer" containerID="174dc712f4a453ee684d74177527a1b836a3bced7ef9c0772e3c3e45df681bc1" Mar 16 16:34:24 crc kubenswrapper[5120]: I0316 16:34:24.315121 5120 scope.go:117] "RemoveContainer" containerID="745819b39d1a2d09c07c3309ac4a926fde00f50c0047d72085af0f2da0185edd" Mar 16 16:34:24 crc kubenswrapper[5120]: I0316 16:34:24.340121 5120 scope.go:117] "RemoveContainer" containerID="762a70913ba4d9bf454f34cc252d0bdbb883c2eb9c976407f4125f4803033193" Mar 16 16:34:24 crc kubenswrapper[5120]: I0316 16:34:24.373396 5120 scope.go:117] "RemoveContainer" containerID="dd02164555387ce23c90167302ec229465b504ae41ef89fdaa32a90d5aeb9e74" Mar 16 16:34:24 crc kubenswrapper[5120]: I0316 16:34:24.394974 5120 scope.go:117] "RemoveContainer" containerID="81b9e2fea070418035b3021a45910efd7f21e01c842e49cc562d7b6d509e791f" Mar 16 16:34:24 crc kubenswrapper[5120]: I0316 16:34:24.447298 5120 scope.go:117] "RemoveContainer" containerID="328296c307f78ee5b84f1e04978571b2c8e0306f11ba7959a5bac1756086f85f" Mar 16 16:34:24 crc kubenswrapper[5120]: E0316 16:34:24.817001 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="ad8e2ec5b87993e63a39edc2e193772a2f831e952f623a27fc9e87d4868bf786" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:34:24 crc kubenswrapper[5120]: E0316 16:34:24.818200 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="ad8e2ec5b87993e63a39edc2e193772a2f831e952f623a27fc9e87d4868bf786" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:34:24 crc kubenswrapper[5120]: E0316 16:34:24.819670 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="ad8e2ec5b87993e63a39edc2e193772a2f831e952f623a27fc9e87d4868bf786" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:34:24 crc kubenswrapper[5120]: E0316 16:34:24.819712 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="bec1e292-e023-489e-9d12-c9ccbc1488e2" containerName="nova-scheduler-scheduler" probeResult="unknown" Mar 16 16:34:24 crc kubenswrapper[5120]: I0316 16:34:24.916935 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"e88b61c1-a3d0-4b23-820a-b117cf5b90c1","Type":"ContainerStarted","Data":"be1a1d5e32a89360e321dcc84bcfed9e4606efded0431d2d9b776329af9d0675"} Mar 16 16:34:24 crc kubenswrapper[5120]: I0316 16:34:24.917002 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:34:24 crc kubenswrapper[5120]: I0316 16:34:24.936595 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podStartSLOduration=2.9365749 podStartE2EDuration="2.9365749s" podCreationTimestamp="2026-03-16 16:34:22 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:34:24.932073992 +0000 UTC m=+3767.086005669" watchObservedRunningTime="2026-03-16 16:34:24.9365749 +0000 UTC m=+3767.090506557" Mar 16 16:34:25 crc kubenswrapper[5120]: I0316 16:34:25.931694 5120 generic.go:358] "Generic (PLEG): container finished" podID="bba795d8-6362-41cc-b73f-1b4101d28c26" containerID="a892fc7bbd72e1b6b01130437df347bf98d1ecea87ce341b1e3fe9e9257246a9" exitCode=0 Mar 16 16:34:25 crc kubenswrapper[5120]: I0316 16:34:25.931851 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"bba795d8-6362-41cc-b73f-1b4101d28c26","Type":"ContainerDied","Data":"a892fc7bbd72e1b6b01130437df347bf98d1ecea87ce341b1e3fe9e9257246a9"} Mar 16 16:34:25 crc kubenswrapper[5120]: I0316 16:34:25.932409 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"bba795d8-6362-41cc-b73f-1b4101d28c26","Type":"ContainerDied","Data":"623ef091f79cee835c4384c5ca63b3e24a23ed8f064051c7d77715d9128ecb6a"} Mar 16 16:34:25 crc kubenswrapper[5120]: I0316 16:34:25.932428 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="623ef091f79cee835c4384c5ca63b3e24a23ed8f064051c7d77715d9128ecb6a" Mar 16 16:34:25 crc kubenswrapper[5120]: I0316 16:34:25.954020 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:34:26 crc kubenswrapper[5120]: I0316 16:34:26.043440 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bba795d8-6362-41cc-b73f-1b4101d28c26-combined-ca-bundle\") pod \"bba795d8-6362-41cc-b73f-1b4101d28c26\" (UID: \"bba795d8-6362-41cc-b73f-1b4101d28c26\") " Mar 16 16:34:26 crc kubenswrapper[5120]: I0316 16:34:26.043623 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/bba795d8-6362-41cc-b73f-1b4101d28c26-logs\") pod \"bba795d8-6362-41cc-b73f-1b4101d28c26\" (UID: \"bba795d8-6362-41cc-b73f-1b4101d28c26\") " Mar 16 16:34:26 crc kubenswrapper[5120]: I0316 16:34:26.043735 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8xwx4\" (UniqueName: \"kubernetes.io/projected/bba795d8-6362-41cc-b73f-1b4101d28c26-kube-api-access-8xwx4\") pod \"bba795d8-6362-41cc-b73f-1b4101d28c26\" (UID: \"bba795d8-6362-41cc-b73f-1b4101d28c26\") " Mar 16 16:34:26 crc kubenswrapper[5120]: I0316 16:34:26.044326 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bba795d8-6362-41cc-b73f-1b4101d28c26-logs" (OuterVolumeSpecName: "logs") pod "bba795d8-6362-41cc-b73f-1b4101d28c26" (UID: "bba795d8-6362-41cc-b73f-1b4101d28c26"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:34:26 crc kubenswrapper[5120]: I0316 16:34:26.044920 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bba795d8-6362-41cc-b73f-1b4101d28c26-config-data\") pod \"bba795d8-6362-41cc-b73f-1b4101d28c26\" (UID: \"bba795d8-6362-41cc-b73f-1b4101d28c26\") " Mar 16 16:34:26 crc kubenswrapper[5120]: I0316 16:34:26.046545 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/bba795d8-6362-41cc-b73f-1b4101d28c26-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:34:26 crc kubenswrapper[5120]: I0316 16:34:26.050279 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bba795d8-6362-41cc-b73f-1b4101d28c26-kube-api-access-8xwx4" (OuterVolumeSpecName: "kube-api-access-8xwx4") pod "bba795d8-6362-41cc-b73f-1b4101d28c26" (UID: "bba795d8-6362-41cc-b73f-1b4101d28c26"). InnerVolumeSpecName "kube-api-access-8xwx4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:34:26 crc kubenswrapper[5120]: I0316 16:34:26.072438 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bba795d8-6362-41cc-b73f-1b4101d28c26-config-data" (OuterVolumeSpecName: "config-data") pod "bba795d8-6362-41cc-b73f-1b4101d28c26" (UID: "bba795d8-6362-41cc-b73f-1b4101d28c26"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:34:26 crc kubenswrapper[5120]: I0316 16:34:26.074849 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bba795d8-6362-41cc-b73f-1b4101d28c26-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "bba795d8-6362-41cc-b73f-1b4101d28c26" (UID: "bba795d8-6362-41cc-b73f-1b4101d28c26"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:34:26 crc kubenswrapper[5120]: I0316 16:34:26.148661 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8xwx4\" (UniqueName: \"kubernetes.io/projected/bba795d8-6362-41cc-b73f-1b4101d28c26-kube-api-access-8xwx4\") on node \"crc\" DevicePath \"\"" Mar 16 16:34:26 crc kubenswrapper[5120]: I0316 16:34:26.148710 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bba795d8-6362-41cc-b73f-1b4101d28c26-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:34:26 crc kubenswrapper[5120]: I0316 16:34:26.148726 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bba795d8-6362-41cc-b73f-1b4101d28c26-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:34:26 crc kubenswrapper[5120]: I0316 16:34:26.945567 5120 generic.go:358] "Generic (PLEG): container finished" podID="bec1e292-e023-489e-9d12-c9ccbc1488e2" containerID="ad8e2ec5b87993e63a39edc2e193772a2f831e952f623a27fc9e87d4868bf786" exitCode=0 Mar 16 16:34:26 crc kubenswrapper[5120]: I0316 16:34:26.946067 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"bec1e292-e023-489e-9d12-c9ccbc1488e2","Type":"ContainerDied","Data":"ad8e2ec5b87993e63a39edc2e193772a2f831e952f623a27fc9e87d4868bf786"} Mar 16 16:34:26 crc kubenswrapper[5120]: I0316 16:34:26.946114 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"bec1e292-e023-489e-9d12-c9ccbc1488e2","Type":"ContainerDied","Data":"7ae00c0d35af430c527b977b5f82eb1281fc0be25b94218f44e9560d28d89025"} Mar 16 16:34:26 crc kubenswrapper[5120]: I0316 16:34:26.946125 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7ae00c0d35af430c527b977b5f82eb1281fc0be25b94218f44e9560d28d89025" Mar 16 16:34:26 crc kubenswrapper[5120]: I0316 16:34:26.946380 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:34:27 crc kubenswrapper[5120]: I0316 16:34:27.004054 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:34:27 crc kubenswrapper[5120]: I0316 16:34:27.019270 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:34:27 crc kubenswrapper[5120]: I0316 16:34:27.043949 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:34:27 crc kubenswrapper[5120]: I0316 16:34:27.058499 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:34:27 crc kubenswrapper[5120]: I0316 16:34:27.059830 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bec1e292-e023-489e-9d12-c9ccbc1488e2" containerName="nova-scheduler-scheduler" Mar 16 16:34:27 crc kubenswrapper[5120]: I0316 16:34:27.059856 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="bec1e292-e023-489e-9d12-c9ccbc1488e2" containerName="nova-scheduler-scheduler" Mar 16 16:34:27 crc kubenswrapper[5120]: I0316 16:34:27.059867 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bba795d8-6362-41cc-b73f-1b4101d28c26" containerName="nova-api-api" Mar 16 16:34:27 crc kubenswrapper[5120]: I0316 16:34:27.059875 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="bba795d8-6362-41cc-b73f-1b4101d28c26" containerName="nova-api-api" Mar 16 16:34:27 crc kubenswrapper[5120]: I0316 16:34:27.059889 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bba795d8-6362-41cc-b73f-1b4101d28c26" containerName="nova-api-log" Mar 16 16:34:27 crc kubenswrapper[5120]: I0316 16:34:27.059897 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="bba795d8-6362-41cc-b73f-1b4101d28c26" containerName="nova-api-log" Mar 16 16:34:27 crc kubenswrapper[5120]: I0316 16:34:27.060271 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="bba795d8-6362-41cc-b73f-1b4101d28c26" containerName="nova-api-api" Mar 16 16:34:27 crc kubenswrapper[5120]: I0316 16:34:27.060309 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="bec1e292-e023-489e-9d12-c9ccbc1488e2" containerName="nova-scheduler-scheduler" Mar 16 16:34:27 crc kubenswrapper[5120]: I0316 16:34:27.060327 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="bba795d8-6362-41cc-b73f-1b4101d28c26" containerName="nova-api-log" Mar 16 16:34:27 crc kubenswrapper[5120]: I0316 16:34:27.075959 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:34:27 crc kubenswrapper[5120]: I0316 16:34:27.079658 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-config-data\"" Mar 16 16:34:27 crc kubenswrapper[5120]: I0316 16:34:27.085969 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:34:27 crc kubenswrapper[5120]: I0316 16:34:27.175437 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bec1e292-e023-489e-9d12-c9ccbc1488e2-config-data\") pod \"bec1e292-e023-489e-9d12-c9ccbc1488e2\" (UID: \"bec1e292-e023-489e-9d12-c9ccbc1488e2\") " Mar 16 16:34:27 crc kubenswrapper[5120]: I0316 16:34:27.175737 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bec1e292-e023-489e-9d12-c9ccbc1488e2-combined-ca-bundle\") pod \"bec1e292-e023-489e-9d12-c9ccbc1488e2\" (UID: \"bec1e292-e023-489e-9d12-c9ccbc1488e2\") " Mar 16 16:34:27 crc kubenswrapper[5120]: I0316 16:34:27.176080 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wxc46\" (UniqueName: \"kubernetes.io/projected/bec1e292-e023-489e-9d12-c9ccbc1488e2-kube-api-access-wxc46\") pod \"bec1e292-e023-489e-9d12-c9ccbc1488e2\" (UID: \"bec1e292-e023-489e-9d12-c9ccbc1488e2\") " Mar 16 16:34:27 crc kubenswrapper[5120]: I0316 16:34:27.176339 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0d3704f3-b041-4512-89cf-accbfc73e3cf-logs\") pod \"nova-api-0\" (UID: \"0d3704f3-b041-4512-89cf-accbfc73e3cf\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:34:27 crc kubenswrapper[5120]: I0316 16:34:27.176784 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwp7c\" (UniqueName: \"kubernetes.io/projected/0d3704f3-b041-4512-89cf-accbfc73e3cf-kube-api-access-nwp7c\") pod \"nova-api-0\" (UID: \"0d3704f3-b041-4512-89cf-accbfc73e3cf\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:34:27 crc kubenswrapper[5120]: I0316 16:34:27.176862 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0d3704f3-b041-4512-89cf-accbfc73e3cf-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"0d3704f3-b041-4512-89cf-accbfc73e3cf\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:34:27 crc kubenswrapper[5120]: I0316 16:34:27.177171 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0d3704f3-b041-4512-89cf-accbfc73e3cf-config-data\") pod \"nova-api-0\" (UID: \"0d3704f3-b041-4512-89cf-accbfc73e3cf\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:34:27 crc kubenswrapper[5120]: I0316 16:34:27.183323 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bec1e292-e023-489e-9d12-c9ccbc1488e2-kube-api-access-wxc46" (OuterVolumeSpecName: "kube-api-access-wxc46") pod "bec1e292-e023-489e-9d12-c9ccbc1488e2" (UID: "bec1e292-e023-489e-9d12-c9ccbc1488e2"). InnerVolumeSpecName "kube-api-access-wxc46". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:34:27 crc kubenswrapper[5120]: I0316 16:34:27.207530 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bec1e292-e023-489e-9d12-c9ccbc1488e2-config-data" (OuterVolumeSpecName: "config-data") pod "bec1e292-e023-489e-9d12-c9ccbc1488e2" (UID: "bec1e292-e023-489e-9d12-c9ccbc1488e2"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:34:27 crc kubenswrapper[5120]: I0316 16:34:27.208585 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bec1e292-e023-489e-9d12-c9ccbc1488e2-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "bec1e292-e023-489e-9d12-c9ccbc1488e2" (UID: "bec1e292-e023-489e-9d12-c9ccbc1488e2"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:34:27 crc kubenswrapper[5120]: I0316 16:34:27.279583 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0d3704f3-b041-4512-89cf-accbfc73e3cf-config-data\") pod \"nova-api-0\" (UID: \"0d3704f3-b041-4512-89cf-accbfc73e3cf\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:34:27 crc kubenswrapper[5120]: I0316 16:34:27.280072 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0d3704f3-b041-4512-89cf-accbfc73e3cf-logs\") pod \"nova-api-0\" (UID: \"0d3704f3-b041-4512-89cf-accbfc73e3cf\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:34:27 crc kubenswrapper[5120]: I0316 16:34:27.280279 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nwp7c\" (UniqueName: \"kubernetes.io/projected/0d3704f3-b041-4512-89cf-accbfc73e3cf-kube-api-access-nwp7c\") pod \"nova-api-0\" (UID: \"0d3704f3-b041-4512-89cf-accbfc73e3cf\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:34:27 crc kubenswrapper[5120]: I0316 16:34:27.280324 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0d3704f3-b041-4512-89cf-accbfc73e3cf-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"0d3704f3-b041-4512-89cf-accbfc73e3cf\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:34:27 crc kubenswrapper[5120]: I0316 16:34:27.280470 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bec1e292-e023-489e-9d12-c9ccbc1488e2-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:34:27 crc kubenswrapper[5120]: I0316 16:34:27.280491 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bec1e292-e023-489e-9d12-c9ccbc1488e2-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:34:27 crc kubenswrapper[5120]: I0316 16:34:27.280504 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wxc46\" (UniqueName: \"kubernetes.io/projected/bec1e292-e023-489e-9d12-c9ccbc1488e2-kube-api-access-wxc46\") on node \"crc\" DevicePath \"\"" Mar 16 16:34:27 crc kubenswrapper[5120]: I0316 16:34:27.280631 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0d3704f3-b041-4512-89cf-accbfc73e3cf-logs\") pod \"nova-api-0\" (UID: \"0d3704f3-b041-4512-89cf-accbfc73e3cf\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:34:27 crc kubenswrapper[5120]: I0316 16:34:27.285461 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0d3704f3-b041-4512-89cf-accbfc73e3cf-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"0d3704f3-b041-4512-89cf-accbfc73e3cf\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:34:27 crc kubenswrapper[5120]: I0316 16:34:27.285685 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0d3704f3-b041-4512-89cf-accbfc73e3cf-config-data\") pod \"nova-api-0\" (UID: \"0d3704f3-b041-4512-89cf-accbfc73e3cf\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:34:27 crc kubenswrapper[5120]: I0316 16:34:27.302433 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwp7c\" (UniqueName: \"kubernetes.io/projected/0d3704f3-b041-4512-89cf-accbfc73e3cf-kube-api-access-nwp7c\") pod \"nova-api-0\" (UID: \"0d3704f3-b041-4512-89cf-accbfc73e3cf\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:34:27 crc kubenswrapper[5120]: I0316 16:34:27.399557 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:34:27 crc kubenswrapper[5120]: I0316 16:34:27.882279 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:34:27 crc kubenswrapper[5120]: I0316 16:34:27.959596 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"0d3704f3-b041-4512-89cf-accbfc73e3cf","Type":"ContainerStarted","Data":"bce0dd78139d7beceba2ffb5e6ef436738da3a4cc268301656ab830e9483f400"} Mar 16 16:34:27 crc kubenswrapper[5120]: I0316 16:34:27.960185 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:34:28 crc kubenswrapper[5120]: I0316 16:34:28.044303 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:34:28 crc kubenswrapper[5120]: I0316 16:34:28.064593 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:34:28 crc kubenswrapper[5120]: I0316 16:34:28.080481 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:34:28 crc kubenswrapper[5120]: I0316 16:34:28.090095 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:34:28 crc kubenswrapper[5120]: I0316 16:34:28.092441 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-scheduler-config-data\"" Mar 16 16:34:28 crc kubenswrapper[5120]: I0316 16:34:28.096213 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:34:28 crc kubenswrapper[5120]: I0316 16:34:28.202793 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-496zb\" (UniqueName: \"kubernetes.io/projected/2b171fb9-014c-41df-a05b-d2d376d8d507-kube-api-access-496zb\") pod \"nova-scheduler-0\" (UID: \"2b171fb9-014c-41df-a05b-d2d376d8d507\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:34:28 crc kubenswrapper[5120]: I0316 16:34:28.203028 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2b171fb9-014c-41df-a05b-d2d376d8d507-config-data\") pod \"nova-scheduler-0\" (UID: \"2b171fb9-014c-41df-a05b-d2d376d8d507\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:34:28 crc kubenswrapper[5120]: I0316 16:34:28.203124 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2b171fb9-014c-41df-a05b-d2d376d8d507-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"2b171fb9-014c-41df-a05b-d2d376d8d507\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:34:28 crc kubenswrapper[5120]: I0316 16:34:28.306212 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2b171fb9-014c-41df-a05b-d2d376d8d507-config-data\") pod \"nova-scheduler-0\" (UID: \"2b171fb9-014c-41df-a05b-d2d376d8d507\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:34:28 crc kubenswrapper[5120]: I0316 16:34:28.306403 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2b171fb9-014c-41df-a05b-d2d376d8d507-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"2b171fb9-014c-41df-a05b-d2d376d8d507\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:34:28 crc kubenswrapper[5120]: I0316 16:34:28.306577 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-496zb\" (UniqueName: \"kubernetes.io/projected/2b171fb9-014c-41df-a05b-d2d376d8d507-kube-api-access-496zb\") pod \"nova-scheduler-0\" (UID: \"2b171fb9-014c-41df-a05b-d2d376d8d507\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:34:28 crc kubenswrapper[5120]: I0316 16:34:28.311068 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2b171fb9-014c-41df-a05b-d2d376d8d507-config-data\") pod \"nova-scheduler-0\" (UID: \"2b171fb9-014c-41df-a05b-d2d376d8d507\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:34:28 crc kubenswrapper[5120]: I0316 16:34:28.311905 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2b171fb9-014c-41df-a05b-d2d376d8d507-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"2b171fb9-014c-41df-a05b-d2d376d8d507\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:34:28 crc kubenswrapper[5120]: I0316 16:34:28.325421 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-496zb\" (UniqueName: \"kubernetes.io/projected/2b171fb9-014c-41df-a05b-d2d376d8d507-kube-api-access-496zb\") pod \"nova-scheduler-0\" (UID: \"2b171fb9-014c-41df-a05b-d2d376d8d507\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:34:28 crc kubenswrapper[5120]: I0316 16:34:28.418377 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:34:28 crc kubenswrapper[5120]: I0316 16:34:28.679201 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bba795d8-6362-41cc-b73f-1b4101d28c26" path="/var/lib/kubelet/pods/bba795d8-6362-41cc-b73f-1b4101d28c26/volumes" Mar 16 16:34:28 crc kubenswrapper[5120]: I0316 16:34:28.680671 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bec1e292-e023-489e-9d12-c9ccbc1488e2" path="/var/lib/kubelet/pods/bec1e292-e023-489e-9d12-c9ccbc1488e2/volumes" Mar 16 16:34:28 crc kubenswrapper[5120]: I0316 16:34:28.860104 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:34:28 crc kubenswrapper[5120]: I0316 16:34:28.991521 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"2b171fb9-014c-41df-a05b-d2d376d8d507","Type":"ContainerStarted","Data":"45a291bf6d6dd2a6287b119c4d1349cfd966945907d7ad74e73c962266b8802d"} Mar 16 16:34:28 crc kubenswrapper[5120]: I0316 16:34:28.995050 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"0d3704f3-b041-4512-89cf-accbfc73e3cf","Type":"ContainerStarted","Data":"fa37d31ad7bcd4a5110e71e6feaa642ca3850c15283ac0ef042893bc4e9920da"} Mar 16 16:34:28 crc kubenswrapper[5120]: I0316 16:34:28.995131 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"0d3704f3-b041-4512-89cf-accbfc73e3cf","Type":"ContainerStarted","Data":"7832196ae07a4790a885e3883e0dfaa3a7952b0b9eed6a61f230c7651efde062"} Mar 16 16:34:29 crc kubenswrapper[5120]: I0316 16:34:29.029798 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=2.029776126 podStartE2EDuration="2.029776126s" podCreationTimestamp="2026-03-16 16:34:27 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:34:29.019630791 +0000 UTC m=+3771.173562448" watchObservedRunningTime="2026-03-16 16:34:29.029776126 +0000 UTC m=+3771.183707783" Mar 16 16:34:30 crc kubenswrapper[5120]: I0316 16:34:30.008834 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"2b171fb9-014c-41df-a05b-d2d376d8d507","Type":"ContainerStarted","Data":"1bd12854601538398d6984520b192c05a7127f7b5949a607c485d1b967a6dff8"} Mar 16 16:34:30 crc kubenswrapper[5120]: I0316 16:34:30.033885 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-scheduler-0" podStartSLOduration=2.033866116 podStartE2EDuration="2.033866116s" podCreationTimestamp="2026-03-16 16:34:28 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:34:30.024498741 +0000 UTC m=+3772.178430398" watchObservedRunningTime="2026-03-16 16:34:30.033866116 +0000 UTC m=+3772.187797773" Mar 16 16:34:30 crc kubenswrapper[5120]: I0316 16:34:30.663545 5120 scope.go:117] "RemoveContainer" containerID="0a15d5caff30dc8885f782e59962af7d98d58b39ab76059e56e5827e10e7ab8b" Mar 16 16:34:30 crc kubenswrapper[5120]: E0316 16:34:30.663940 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:34:30 crc kubenswrapper[5120]: I0316 16:34:30.964588 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:34:31 crc kubenswrapper[5120]: I0316 16:34:31.540709 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-4grts"] Mar 16 16:34:31 crc kubenswrapper[5120]: I0316 16:34:31.558406 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-4grts"] Mar 16 16:34:31 crc kubenswrapper[5120]: I0316 16:34:31.558574 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-4grts" Mar 16 16:34:31 crc kubenswrapper[5120]: I0316 16:34:31.561053 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-manage-scripts\"" Mar 16 16:34:31 crc kubenswrapper[5120]: I0316 16:34:31.561341 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-manage-config-data\"" Mar 16 16:34:31 crc kubenswrapper[5120]: I0316 16:34:31.697216 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xrtw\" (UniqueName: \"kubernetes.io/projected/b9ea3d3a-7ea8-4e4f-a075-60297d8672b5-kube-api-access-6xrtw\") pod \"nova-cell1-cell-mapping-4grts\" (UID: \"b9ea3d3a-7ea8-4e4f-a075-60297d8672b5\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-4grts" Mar 16 16:34:31 crc kubenswrapper[5120]: I0316 16:34:31.697495 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b9ea3d3a-7ea8-4e4f-a075-60297d8672b5-config-data\") pod \"nova-cell1-cell-mapping-4grts\" (UID: \"b9ea3d3a-7ea8-4e4f-a075-60297d8672b5\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-4grts" Mar 16 16:34:31 crc kubenswrapper[5120]: I0316 16:34:31.697562 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b9ea3d3a-7ea8-4e4f-a075-60297d8672b5-combined-ca-bundle\") pod \"nova-cell1-cell-mapping-4grts\" (UID: \"b9ea3d3a-7ea8-4e4f-a075-60297d8672b5\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-4grts" Mar 16 16:34:31 crc kubenswrapper[5120]: I0316 16:34:31.697622 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b9ea3d3a-7ea8-4e4f-a075-60297d8672b5-scripts\") pod \"nova-cell1-cell-mapping-4grts\" (UID: \"b9ea3d3a-7ea8-4e4f-a075-60297d8672b5\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-4grts" Mar 16 16:34:31 crc kubenswrapper[5120]: I0316 16:34:31.800594 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b9ea3d3a-7ea8-4e4f-a075-60297d8672b5-scripts\") pod \"nova-cell1-cell-mapping-4grts\" (UID: \"b9ea3d3a-7ea8-4e4f-a075-60297d8672b5\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-4grts" Mar 16 16:34:31 crc kubenswrapper[5120]: I0316 16:34:31.801582 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6xrtw\" (UniqueName: \"kubernetes.io/projected/b9ea3d3a-7ea8-4e4f-a075-60297d8672b5-kube-api-access-6xrtw\") pod \"nova-cell1-cell-mapping-4grts\" (UID: \"b9ea3d3a-7ea8-4e4f-a075-60297d8672b5\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-4grts" Mar 16 16:34:31 crc kubenswrapper[5120]: I0316 16:34:31.802055 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b9ea3d3a-7ea8-4e4f-a075-60297d8672b5-config-data\") pod \"nova-cell1-cell-mapping-4grts\" (UID: \"b9ea3d3a-7ea8-4e4f-a075-60297d8672b5\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-4grts" Mar 16 16:34:31 crc kubenswrapper[5120]: I0316 16:34:31.802134 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b9ea3d3a-7ea8-4e4f-a075-60297d8672b5-combined-ca-bundle\") pod \"nova-cell1-cell-mapping-4grts\" (UID: \"b9ea3d3a-7ea8-4e4f-a075-60297d8672b5\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-4grts" Mar 16 16:34:31 crc kubenswrapper[5120]: I0316 16:34:31.807555 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b9ea3d3a-7ea8-4e4f-a075-60297d8672b5-combined-ca-bundle\") pod \"nova-cell1-cell-mapping-4grts\" (UID: \"b9ea3d3a-7ea8-4e4f-a075-60297d8672b5\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-4grts" Mar 16 16:34:31 crc kubenswrapper[5120]: I0316 16:34:31.808195 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b9ea3d3a-7ea8-4e4f-a075-60297d8672b5-config-data\") pod \"nova-cell1-cell-mapping-4grts\" (UID: \"b9ea3d3a-7ea8-4e4f-a075-60297d8672b5\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-4grts" Mar 16 16:34:31 crc kubenswrapper[5120]: I0316 16:34:31.825555 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b9ea3d3a-7ea8-4e4f-a075-60297d8672b5-scripts\") pod \"nova-cell1-cell-mapping-4grts\" (UID: \"b9ea3d3a-7ea8-4e4f-a075-60297d8672b5\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-4grts" Mar 16 16:34:31 crc kubenswrapper[5120]: I0316 16:34:31.828118 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xrtw\" (UniqueName: \"kubernetes.io/projected/b9ea3d3a-7ea8-4e4f-a075-60297d8672b5-kube-api-access-6xrtw\") pod \"nova-cell1-cell-mapping-4grts\" (UID: \"b9ea3d3a-7ea8-4e4f-a075-60297d8672b5\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-4grts" Mar 16 16:34:31 crc kubenswrapper[5120]: I0316 16:34:31.894354 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-4grts" Mar 16 16:34:32 crc kubenswrapper[5120]: I0316 16:34:32.287160 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:34:32 crc kubenswrapper[5120]: I0316 16:34:32.287487 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:34:32 crc kubenswrapper[5120]: I0316 16:34:32.390344 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-4grts"] Mar 16 16:34:32 crc kubenswrapper[5120]: W0316 16:34:32.392110 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb9ea3d3a_7ea8_4e4f_a075_60297d8672b5.slice/crio-d1e7492081b6d2c6c30267967c96e1cd4650d651dd2cd1553dc23c2566ffda5e WatchSource:0}: Error finding container d1e7492081b6d2c6c30267967c96e1cd4650d651dd2cd1553dc23c2566ffda5e: Status 404 returned error can't find the container with id d1e7492081b6d2c6c30267967c96e1cd4650d651dd2cd1553dc23c2566ffda5e Mar 16 16:34:33 crc kubenswrapper[5120]: I0316 16:34:33.048608 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-4grts" event={"ID":"b9ea3d3a-7ea8-4e4f-a075-60297d8672b5","Type":"ContainerStarted","Data":"f4bef8ba5d70241c574c293edb9fc02039cb7eb72be0c9938e5b281718f7d77e"} Mar 16 16:34:33 crc kubenswrapper[5120]: I0316 16:34:33.048670 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-4grts" event={"ID":"b9ea3d3a-7ea8-4e4f-a075-60297d8672b5","Type":"ContainerStarted","Data":"d1e7492081b6d2c6c30267967c96e1cd4650d651dd2cd1553dc23c2566ffda5e"} Mar 16 16:34:33 crc kubenswrapper[5120]: I0316 16:34:33.074928 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-4grts" podStartSLOduration=2.074903194 podStartE2EDuration="2.074903194s" podCreationTimestamp="2026-03-16 16:34:31 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:34:33.066624017 +0000 UTC m=+3775.220555694" watchObservedRunningTime="2026-03-16 16:34:33.074903194 +0000 UTC m=+3775.228834851" Mar 16 16:34:33 crc kubenswrapper[5120]: I0316 16:34:33.292973 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="2b177362-e72c-4e7d-b029-e1a88c988fec" containerName="nova-metadata-log" probeResult="failure" output="Get \"https://10.217.0.191:8775/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 16:34:33 crc kubenswrapper[5120]: I0316 16:34:33.292979 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="2b177362-e72c-4e7d-b029-e1a88c988fec" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"https://10.217.0.191:8775/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 16:34:33 crc kubenswrapper[5120]: I0316 16:34:33.419264 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:34:37 crc kubenswrapper[5120]: I0316 16:34:37.310075 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:34:37 crc kubenswrapper[5120]: I0316 16:34:37.400211 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:34:37 crc kubenswrapper[5120]: I0316 16:34:37.400262 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:34:38 crc kubenswrapper[5120]: I0316 16:34:38.109988 5120 generic.go:358] "Generic (PLEG): container finished" podID="b9ea3d3a-7ea8-4e4f-a075-60297d8672b5" containerID="f4bef8ba5d70241c574c293edb9fc02039cb7eb72be0c9938e5b281718f7d77e" exitCode=0 Mar 16 16:34:38 crc kubenswrapper[5120]: I0316 16:34:38.110174 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-4grts" event={"ID":"b9ea3d3a-7ea8-4e4f-a075-60297d8672b5","Type":"ContainerDied","Data":"f4bef8ba5d70241c574c293edb9fc02039cb7eb72be0c9938e5b281718f7d77e"} Mar 16 16:34:38 crc kubenswrapper[5120]: I0316 16:34:38.418989 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:34:38 crc kubenswrapper[5120]: I0316 16:34:38.441979 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="0d3704f3-b041-4512-89cf-accbfc73e3cf" containerName="nova-api-api" probeResult="failure" output="Get \"http://10.217.0.193:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 16:34:38 crc kubenswrapper[5120]: I0316 16:34:38.442952 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="0d3704f3-b041-4512-89cf-accbfc73e3cf" containerName="nova-api-log" probeResult="failure" output="Get \"http://10.217.0.193:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 16:34:38 crc kubenswrapper[5120]: I0316 16:34:38.449366 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:34:39 crc kubenswrapper[5120]: I0316 16:34:39.159050 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:34:39 crc kubenswrapper[5120]: I0316 16:34:39.518397 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-4grts" Mar 16 16:34:39 crc kubenswrapper[5120]: I0316 16:34:39.635997 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b9ea3d3a-7ea8-4e4f-a075-60297d8672b5-config-data\") pod \"b9ea3d3a-7ea8-4e4f-a075-60297d8672b5\" (UID: \"b9ea3d3a-7ea8-4e4f-a075-60297d8672b5\") " Mar 16 16:34:39 crc kubenswrapper[5120]: I0316 16:34:39.636191 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6xrtw\" (UniqueName: \"kubernetes.io/projected/b9ea3d3a-7ea8-4e4f-a075-60297d8672b5-kube-api-access-6xrtw\") pod \"b9ea3d3a-7ea8-4e4f-a075-60297d8672b5\" (UID: \"b9ea3d3a-7ea8-4e4f-a075-60297d8672b5\") " Mar 16 16:34:39 crc kubenswrapper[5120]: I0316 16:34:39.636350 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b9ea3d3a-7ea8-4e4f-a075-60297d8672b5-combined-ca-bundle\") pod \"b9ea3d3a-7ea8-4e4f-a075-60297d8672b5\" (UID: \"b9ea3d3a-7ea8-4e4f-a075-60297d8672b5\") " Mar 16 16:34:39 crc kubenswrapper[5120]: I0316 16:34:39.636707 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b9ea3d3a-7ea8-4e4f-a075-60297d8672b5-scripts\") pod \"b9ea3d3a-7ea8-4e4f-a075-60297d8672b5\" (UID: \"b9ea3d3a-7ea8-4e4f-a075-60297d8672b5\") " Mar 16 16:34:39 crc kubenswrapper[5120]: I0316 16:34:39.643652 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9ea3d3a-7ea8-4e4f-a075-60297d8672b5-kube-api-access-6xrtw" (OuterVolumeSpecName: "kube-api-access-6xrtw") pod "b9ea3d3a-7ea8-4e4f-a075-60297d8672b5" (UID: "b9ea3d3a-7ea8-4e4f-a075-60297d8672b5"). InnerVolumeSpecName "kube-api-access-6xrtw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:34:39 crc kubenswrapper[5120]: I0316 16:34:39.644142 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9ea3d3a-7ea8-4e4f-a075-60297d8672b5-scripts" (OuterVolumeSpecName: "scripts") pod "b9ea3d3a-7ea8-4e4f-a075-60297d8672b5" (UID: "b9ea3d3a-7ea8-4e4f-a075-60297d8672b5"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:34:39 crc kubenswrapper[5120]: I0316 16:34:39.674927 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9ea3d3a-7ea8-4e4f-a075-60297d8672b5-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "b9ea3d3a-7ea8-4e4f-a075-60297d8672b5" (UID: "b9ea3d3a-7ea8-4e4f-a075-60297d8672b5"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:34:39 crc kubenswrapper[5120]: I0316 16:34:39.690193 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9ea3d3a-7ea8-4e4f-a075-60297d8672b5-config-data" (OuterVolumeSpecName: "config-data") pod "b9ea3d3a-7ea8-4e4f-a075-60297d8672b5" (UID: "b9ea3d3a-7ea8-4e4f-a075-60297d8672b5"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:34:39 crc kubenswrapper[5120]: I0316 16:34:39.740282 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6xrtw\" (UniqueName: \"kubernetes.io/projected/b9ea3d3a-7ea8-4e4f-a075-60297d8672b5-kube-api-access-6xrtw\") on node \"crc\" DevicePath \"\"" Mar 16 16:34:39 crc kubenswrapper[5120]: I0316 16:34:39.740314 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b9ea3d3a-7ea8-4e4f-a075-60297d8672b5-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:34:39 crc kubenswrapper[5120]: I0316 16:34:39.740324 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b9ea3d3a-7ea8-4e4f-a075-60297d8672b5-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:34:39 crc kubenswrapper[5120]: I0316 16:34:39.740334 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b9ea3d3a-7ea8-4e4f-a075-60297d8672b5-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:34:40 crc kubenswrapper[5120]: I0316 16:34:40.143747 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-4grts" Mar 16 16:34:40 crc kubenswrapper[5120]: I0316 16:34:40.143732 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-4grts" event={"ID":"b9ea3d3a-7ea8-4e4f-a075-60297d8672b5","Type":"ContainerDied","Data":"d1e7492081b6d2c6c30267967c96e1cd4650d651dd2cd1553dc23c2566ffda5e"} Mar 16 16:34:40 crc kubenswrapper[5120]: I0316 16:34:40.143941 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d1e7492081b6d2c6c30267967c96e1cd4650d651dd2cd1553dc23c2566ffda5e" Mar 16 16:34:40 crc kubenswrapper[5120]: I0316 16:34:40.301693 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:34:40 crc kubenswrapper[5120]: I0316 16:34:40.302582 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:34:40 crc kubenswrapper[5120]: I0316 16:34:40.306980 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:34:40 crc kubenswrapper[5120]: I0316 16:34:40.307283 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="0d3704f3-b041-4512-89cf-accbfc73e3cf" containerName="nova-api-log" containerID="cri-o://7832196ae07a4790a885e3883e0dfaa3a7952b0b9eed6a61f230c7651efde062" gracePeriod=30 Mar 16 16:34:40 crc kubenswrapper[5120]: I0316 16:34:40.307366 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="0d3704f3-b041-4512-89cf-accbfc73e3cf" containerName="nova-api-api" containerID="cri-o://fa37d31ad7bcd4a5110e71e6feaa642ca3850c15283ac0ef042893bc4e9920da" gracePeriod=30 Mar 16 16:34:40 crc kubenswrapper[5120]: I0316 16:34:40.320843 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:34:40 crc kubenswrapper[5120]: I0316 16:34:40.367696 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:34:41 crc kubenswrapper[5120]: I0316 16:34:41.164245 5120 generic.go:358] "Generic (PLEG): container finished" podID="0d3704f3-b041-4512-89cf-accbfc73e3cf" containerID="7832196ae07a4790a885e3883e0dfaa3a7952b0b9eed6a61f230c7651efde062" exitCode=143 Mar 16 16:34:41 crc kubenswrapper[5120]: I0316 16:34:41.165173 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="2b171fb9-014c-41df-a05b-d2d376d8d507" containerName="nova-scheduler-scheduler" containerID="cri-o://1bd12854601538398d6984520b192c05a7127f7b5949a607c485d1b967a6dff8" gracePeriod=30 Mar 16 16:34:41 crc kubenswrapper[5120]: I0316 16:34:41.165526 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"0d3704f3-b041-4512-89cf-accbfc73e3cf","Type":"ContainerDied","Data":"7832196ae07a4790a885e3883e0dfaa3a7952b0b9eed6a61f230c7651efde062"} Mar 16 16:34:41 crc kubenswrapper[5120]: I0316 16:34:41.663730 5120 scope.go:117] "RemoveContainer" containerID="0a15d5caff30dc8885f782e59962af7d98d58b39ab76059e56e5827e10e7ab8b" Mar 16 16:34:41 crc kubenswrapper[5120]: E0316 16:34:41.664231 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:34:41 crc kubenswrapper[5120]: I0316 16:34:41.700864 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 16:34:41 crc kubenswrapper[5120]: I0316 16:34:41.701159 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/kube-state-metrics-0" podUID="5af6cf0b-bf71-4453-ba3e-ab4016bc58cb" containerName="kube-state-metrics" containerID="cri-o://db1f9c8dfa0a470e347e0af019f978f1af994f2b39341dcf82591bee56315ee5" gracePeriod=30 Mar 16 16:34:42 crc kubenswrapper[5120]: I0316 16:34:42.179987 5120 generic.go:358] "Generic (PLEG): container finished" podID="5af6cf0b-bf71-4453-ba3e-ab4016bc58cb" containerID="db1f9c8dfa0a470e347e0af019f978f1af994f2b39341dcf82591bee56315ee5" exitCode=2 Mar 16 16:34:42 crc kubenswrapper[5120]: I0316 16:34:42.180083 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"5af6cf0b-bf71-4453-ba3e-ab4016bc58cb","Type":"ContainerDied","Data":"db1f9c8dfa0a470e347e0af019f978f1af994f2b39341dcf82591bee56315ee5"} Mar 16 16:34:42 crc kubenswrapper[5120]: I0316 16:34:42.180529 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"5af6cf0b-bf71-4453-ba3e-ab4016bc58cb","Type":"ContainerDied","Data":"a876c8fded14b3f4ac5a66b84d60aef3778ae4a4650f70f38188974d86e264bc"} Mar 16 16:34:42 crc kubenswrapper[5120]: I0316 16:34:42.180548 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a876c8fded14b3f4ac5a66b84d60aef3778ae4a4650f70f38188974d86e264bc" Mar 16 16:34:42 crc kubenswrapper[5120]: I0316 16:34:42.180959 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="2b177362-e72c-4e7d-b029-e1a88c988fec" containerName="nova-metadata-log" containerID="cri-o://26185cae285f17b199d2065f17d902449ad5aee8c03aa9de8535f1cb74f1aa13" gracePeriod=30 Mar 16 16:34:42 crc kubenswrapper[5120]: I0316 16:34:42.181466 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="2b177362-e72c-4e7d-b029-e1a88c988fec" containerName="nova-metadata-metadata" containerID="cri-o://c68ece73025e33e3545fef021a08c454bda7ff66411e1dd56ad98a17562e0a31" gracePeriod=30 Mar 16 16:34:42 crc kubenswrapper[5120]: I0316 16:34:42.199874 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:34:42 crc kubenswrapper[5120]: I0316 16:34:42.306140 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gr6zn\" (UniqueName: \"kubernetes.io/projected/5af6cf0b-bf71-4453-ba3e-ab4016bc58cb-kube-api-access-gr6zn\") pod \"5af6cf0b-bf71-4453-ba3e-ab4016bc58cb\" (UID: \"5af6cf0b-bf71-4453-ba3e-ab4016bc58cb\") " Mar 16 16:34:42 crc kubenswrapper[5120]: I0316 16:34:42.315854 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5af6cf0b-bf71-4453-ba3e-ab4016bc58cb-kube-api-access-gr6zn" (OuterVolumeSpecName: "kube-api-access-gr6zn") pod "5af6cf0b-bf71-4453-ba3e-ab4016bc58cb" (UID: "5af6cf0b-bf71-4453-ba3e-ab4016bc58cb"). InnerVolumeSpecName "kube-api-access-gr6zn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:34:42 crc kubenswrapper[5120]: I0316 16:34:42.409353 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gr6zn\" (UniqueName: \"kubernetes.io/projected/5af6cf0b-bf71-4453-ba3e-ab4016bc58cb-kube-api-access-gr6zn\") on node \"crc\" DevicePath \"\"" Mar 16 16:34:43 crc kubenswrapper[5120]: I0316 16:34:43.193851 5120 generic.go:358] "Generic (PLEG): container finished" podID="2b177362-e72c-4e7d-b029-e1a88c988fec" containerID="26185cae285f17b199d2065f17d902449ad5aee8c03aa9de8535f1cb74f1aa13" exitCode=143 Mar 16 16:34:43 crc kubenswrapper[5120]: I0316 16:34:43.193946 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"2b177362-e72c-4e7d-b029-e1a88c988fec","Type":"ContainerDied","Data":"26185cae285f17b199d2065f17d902449ad5aee8c03aa9de8535f1cb74f1aa13"} Mar 16 16:34:43 crc kubenswrapper[5120]: I0316 16:34:43.194659 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:34:43 crc kubenswrapper[5120]: I0316 16:34:43.218676 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 16:34:43 crc kubenswrapper[5120]: I0316 16:34:43.228460 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 16:34:43 crc kubenswrapper[5120]: I0316 16:34:43.243303 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 16:34:43 crc kubenswrapper[5120]: I0316 16:34:43.244772 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5af6cf0b-bf71-4453-ba3e-ab4016bc58cb" containerName="kube-state-metrics" Mar 16 16:34:43 crc kubenswrapper[5120]: I0316 16:34:43.244796 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="5af6cf0b-bf71-4453-ba3e-ab4016bc58cb" containerName="kube-state-metrics" Mar 16 16:34:43 crc kubenswrapper[5120]: I0316 16:34:43.244893 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9ea3d3a-7ea8-4e4f-a075-60297d8672b5" containerName="nova-manage" Mar 16 16:34:43 crc kubenswrapper[5120]: I0316 16:34:43.244903 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9ea3d3a-7ea8-4e4f-a075-60297d8672b5" containerName="nova-manage" Mar 16 16:34:43 crc kubenswrapper[5120]: I0316 16:34:43.245135 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="b9ea3d3a-7ea8-4e4f-a075-60297d8672b5" containerName="nova-manage" Mar 16 16:34:43 crc kubenswrapper[5120]: I0316 16:34:43.245169 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="5af6cf0b-bf71-4453-ba3e-ab4016bc58cb" containerName="kube-state-metrics" Mar 16 16:34:43 crc kubenswrapper[5120]: I0316 16:34:43.249970 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:34:43 crc kubenswrapper[5120]: I0316 16:34:43.252206 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-kube-state-metrics-svc\"" Mar 16 16:34:43 crc kubenswrapper[5120]: I0316 16:34:43.252443 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"kube-state-metrics-tls-config\"" Mar 16 16:34:43 crc kubenswrapper[5120]: I0316 16:34:43.254567 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 16:34:43 crc kubenswrapper[5120]: I0316 16:34:43.438818 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmb55\" (UniqueName: \"kubernetes.io/projected/f99422e5-686e-4d1d-8986-ba6e747db255-kube-api-access-xmb55\") pod \"kube-state-metrics-0\" (UID: \"f99422e5-686e-4d1d-8986-ba6e747db255\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:34:43 crc kubenswrapper[5120]: I0316 16:34:43.438974 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/f99422e5-686e-4d1d-8986-ba6e747db255-kube-state-metrics-tls-certs\") pod \"kube-state-metrics-0\" (UID: \"f99422e5-686e-4d1d-8986-ba6e747db255\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:34:43 crc kubenswrapper[5120]: I0316 16:34:43.439319 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f99422e5-686e-4d1d-8986-ba6e747db255-combined-ca-bundle\") pod \"kube-state-metrics-0\" (UID: \"f99422e5-686e-4d1d-8986-ba6e747db255\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:34:43 crc kubenswrapper[5120]: I0316 16:34:43.439396 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/f99422e5-686e-4d1d-8986-ba6e747db255-kube-state-metrics-tls-config\") pod \"kube-state-metrics-0\" (UID: \"f99422e5-686e-4d1d-8986-ba6e747db255\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:34:43 crc kubenswrapper[5120]: I0316 16:34:43.441687 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:34:43 crc kubenswrapper[5120]: I0316 16:34:43.442112 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="c807ead6-beff-4a5b-bf14-c56bf9e4c0f0" containerName="ceilometer-central-agent" containerID="cri-o://08aaeb17b6cb85886578bbe37fdaa92cd247c3368ce379e44c23517f30c1ba73" gracePeriod=30 Mar 16 16:34:43 crc kubenswrapper[5120]: I0316 16:34:43.442192 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="c807ead6-beff-4a5b-bf14-c56bf9e4c0f0" containerName="sg-core" containerID="cri-o://e70da958b40a1214806e2e41be0d1bc42e3a3e588238a1bbc33512f5ddfb1ea8" gracePeriod=30 Mar 16 16:34:43 crc kubenswrapper[5120]: I0316 16:34:43.442189 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="c807ead6-beff-4a5b-bf14-c56bf9e4c0f0" containerName="ceilometer-notification-agent" containerID="cri-o://de5cc50c83c4257da798af24f5eed50af4cdd1e04aaf8625514902b4843fff87" gracePeriod=30 Mar 16 16:34:43 crc kubenswrapper[5120]: I0316 16:34:43.442216 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="c807ead6-beff-4a5b-bf14-c56bf9e4c0f0" containerName="proxy-httpd" containerID="cri-o://aa5640a79d727b5cf5c9d7f6c4b8c6df5f7edbbd9f5a893b66ca4830f9b1b628" gracePeriod=30 Mar 16 16:34:43 crc kubenswrapper[5120]: I0316 16:34:43.541994 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xmb55\" (UniqueName: \"kubernetes.io/projected/f99422e5-686e-4d1d-8986-ba6e747db255-kube-api-access-xmb55\") pod \"kube-state-metrics-0\" (UID: \"f99422e5-686e-4d1d-8986-ba6e747db255\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:34:43 crc kubenswrapper[5120]: I0316 16:34:43.542447 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/f99422e5-686e-4d1d-8986-ba6e747db255-kube-state-metrics-tls-certs\") pod \"kube-state-metrics-0\" (UID: \"f99422e5-686e-4d1d-8986-ba6e747db255\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:34:43 crc kubenswrapper[5120]: I0316 16:34:43.542581 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f99422e5-686e-4d1d-8986-ba6e747db255-combined-ca-bundle\") pod \"kube-state-metrics-0\" (UID: \"f99422e5-686e-4d1d-8986-ba6e747db255\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:34:43 crc kubenswrapper[5120]: I0316 16:34:43.542620 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/f99422e5-686e-4d1d-8986-ba6e747db255-kube-state-metrics-tls-config\") pod \"kube-state-metrics-0\" (UID: \"f99422e5-686e-4d1d-8986-ba6e747db255\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:34:43 crc kubenswrapper[5120]: I0316 16:34:43.548525 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/f99422e5-686e-4d1d-8986-ba6e747db255-kube-state-metrics-tls-config\") pod \"kube-state-metrics-0\" (UID: \"f99422e5-686e-4d1d-8986-ba6e747db255\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:34:43 crc kubenswrapper[5120]: I0316 16:34:43.549548 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/f99422e5-686e-4d1d-8986-ba6e747db255-kube-state-metrics-tls-certs\") pod \"kube-state-metrics-0\" (UID: \"f99422e5-686e-4d1d-8986-ba6e747db255\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:34:43 crc kubenswrapper[5120]: I0316 16:34:43.550726 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f99422e5-686e-4d1d-8986-ba6e747db255-combined-ca-bundle\") pod \"kube-state-metrics-0\" (UID: \"f99422e5-686e-4d1d-8986-ba6e747db255\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:34:43 crc kubenswrapper[5120]: I0316 16:34:43.566721 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmb55\" (UniqueName: \"kubernetes.io/projected/f99422e5-686e-4d1d-8986-ba6e747db255-kube-api-access-xmb55\") pod \"kube-state-metrics-0\" (UID: \"f99422e5-686e-4d1d-8986-ba6e747db255\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:34:43 crc kubenswrapper[5120]: I0316 16:34:43.577801 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:34:43 crc kubenswrapper[5120]: I0316 16:34:43.910822 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:34:43 crc kubenswrapper[5120]: I0316 16:34:43.953985 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nwp7c\" (UniqueName: \"kubernetes.io/projected/0d3704f3-b041-4512-89cf-accbfc73e3cf-kube-api-access-nwp7c\") pod \"0d3704f3-b041-4512-89cf-accbfc73e3cf\" (UID: \"0d3704f3-b041-4512-89cf-accbfc73e3cf\") " Mar 16 16:34:43 crc kubenswrapper[5120]: I0316 16:34:43.954112 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0d3704f3-b041-4512-89cf-accbfc73e3cf-config-data\") pod \"0d3704f3-b041-4512-89cf-accbfc73e3cf\" (UID: \"0d3704f3-b041-4512-89cf-accbfc73e3cf\") " Mar 16 16:34:43 crc kubenswrapper[5120]: I0316 16:34:43.954587 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0d3704f3-b041-4512-89cf-accbfc73e3cf-logs\") pod \"0d3704f3-b041-4512-89cf-accbfc73e3cf\" (UID: \"0d3704f3-b041-4512-89cf-accbfc73e3cf\") " Mar 16 16:34:43 crc kubenswrapper[5120]: I0316 16:34:43.954732 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0d3704f3-b041-4512-89cf-accbfc73e3cf-combined-ca-bundle\") pod \"0d3704f3-b041-4512-89cf-accbfc73e3cf\" (UID: \"0d3704f3-b041-4512-89cf-accbfc73e3cf\") " Mar 16 16:34:43 crc kubenswrapper[5120]: I0316 16:34:43.955793 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d3704f3-b041-4512-89cf-accbfc73e3cf-logs" (OuterVolumeSpecName: "logs") pod "0d3704f3-b041-4512-89cf-accbfc73e3cf" (UID: "0d3704f3-b041-4512-89cf-accbfc73e3cf"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:34:43 crc kubenswrapper[5120]: I0316 16:34:43.962048 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d3704f3-b041-4512-89cf-accbfc73e3cf-kube-api-access-nwp7c" (OuterVolumeSpecName: "kube-api-access-nwp7c") pod "0d3704f3-b041-4512-89cf-accbfc73e3cf" (UID: "0d3704f3-b041-4512-89cf-accbfc73e3cf"). InnerVolumeSpecName "kube-api-access-nwp7c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:34:43 crc kubenswrapper[5120]: I0316 16:34:43.985452 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0d3704f3-b041-4512-89cf-accbfc73e3cf-config-data" (OuterVolumeSpecName: "config-data") pod "0d3704f3-b041-4512-89cf-accbfc73e3cf" (UID: "0d3704f3-b041-4512-89cf-accbfc73e3cf"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:34:43 crc kubenswrapper[5120]: I0316 16:34:43.987315 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0d3704f3-b041-4512-89cf-accbfc73e3cf-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "0d3704f3-b041-4512-89cf-accbfc73e3cf" (UID: "0d3704f3-b041-4512-89cf-accbfc73e3cf"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:34:44 crc kubenswrapper[5120]: I0316 16:34:44.058256 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0d3704f3-b041-4512-89cf-accbfc73e3cf-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:34:44 crc kubenswrapper[5120]: I0316 16:34:44.058298 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0d3704f3-b041-4512-89cf-accbfc73e3cf-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:34:44 crc kubenswrapper[5120]: I0316 16:34:44.058311 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nwp7c\" (UniqueName: \"kubernetes.io/projected/0d3704f3-b041-4512-89cf-accbfc73e3cf-kube-api-access-nwp7c\") on node \"crc\" DevicePath \"\"" Mar 16 16:34:44 crc kubenswrapper[5120]: I0316 16:34:44.058338 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0d3704f3-b041-4512-89cf-accbfc73e3cf-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:34:44 crc kubenswrapper[5120]: E0316 16:34:44.124716 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="1bd12854601538398d6984520b192c05a7127f7b5949a607c485d1b967a6dff8" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:34:44 crc kubenswrapper[5120]: E0316 16:34:44.126964 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="1bd12854601538398d6984520b192c05a7127f7b5949a607c485d1b967a6dff8" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:34:44 crc kubenswrapper[5120]: E0316 16:34:44.129423 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="1bd12854601538398d6984520b192c05a7127f7b5949a607c485d1b967a6dff8" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:34:44 crc kubenswrapper[5120]: E0316 16:34:44.129536 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="2b171fb9-014c-41df-a05b-d2d376d8d507" containerName="nova-scheduler-scheduler" probeResult="unknown" Mar 16 16:34:44 crc kubenswrapper[5120]: W0316 16:34:44.144090 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf99422e5_686e_4d1d_8986_ba6e747db255.slice/crio-83b0d65aa16963f5ca38511db01ad7c30a95c88f629bae8141169631eb0190f0 WatchSource:0}: Error finding container 83b0d65aa16963f5ca38511db01ad7c30a95c88f629bae8141169631eb0190f0: Status 404 returned error can't find the container with id 83b0d65aa16963f5ca38511db01ad7c30a95c88f629bae8141169631eb0190f0 Mar 16 16:34:44 crc kubenswrapper[5120]: I0316 16:34:44.149662 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 16:34:44 crc kubenswrapper[5120]: I0316 16:34:44.209251 5120 generic.go:358] "Generic (PLEG): container finished" podID="c807ead6-beff-4a5b-bf14-c56bf9e4c0f0" containerID="aa5640a79d727b5cf5c9d7f6c4b8c6df5f7edbbd9f5a893b66ca4830f9b1b628" exitCode=0 Mar 16 16:34:44 crc kubenswrapper[5120]: I0316 16:34:44.209298 5120 generic.go:358] "Generic (PLEG): container finished" podID="c807ead6-beff-4a5b-bf14-c56bf9e4c0f0" containerID="e70da958b40a1214806e2e41be0d1bc42e3a3e588238a1bbc33512f5ddfb1ea8" exitCode=2 Mar 16 16:34:44 crc kubenswrapper[5120]: I0316 16:34:44.209309 5120 generic.go:358] "Generic (PLEG): container finished" podID="c807ead6-beff-4a5b-bf14-c56bf9e4c0f0" containerID="08aaeb17b6cb85886578bbe37fdaa92cd247c3368ce379e44c23517f30c1ba73" exitCode=0 Mar 16 16:34:44 crc kubenswrapper[5120]: I0316 16:34:44.209990 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"c807ead6-beff-4a5b-bf14-c56bf9e4c0f0","Type":"ContainerDied","Data":"aa5640a79d727b5cf5c9d7f6c4b8c6df5f7edbbd9f5a893b66ca4830f9b1b628"} Mar 16 16:34:44 crc kubenswrapper[5120]: I0316 16:34:44.210041 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"c807ead6-beff-4a5b-bf14-c56bf9e4c0f0","Type":"ContainerDied","Data":"e70da958b40a1214806e2e41be0d1bc42e3a3e588238a1bbc33512f5ddfb1ea8"} Mar 16 16:34:44 crc kubenswrapper[5120]: I0316 16:34:44.210055 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"c807ead6-beff-4a5b-bf14-c56bf9e4c0f0","Type":"ContainerDied","Data":"08aaeb17b6cb85886578bbe37fdaa92cd247c3368ce379e44c23517f30c1ba73"} Mar 16 16:34:44 crc kubenswrapper[5120]: I0316 16:34:44.214531 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"f99422e5-686e-4d1d-8986-ba6e747db255","Type":"ContainerStarted","Data":"83b0d65aa16963f5ca38511db01ad7c30a95c88f629bae8141169631eb0190f0"} Mar 16 16:34:44 crc kubenswrapper[5120]: I0316 16:34:44.218654 5120 generic.go:358] "Generic (PLEG): container finished" podID="0d3704f3-b041-4512-89cf-accbfc73e3cf" containerID="fa37d31ad7bcd4a5110e71e6feaa642ca3850c15283ac0ef042893bc4e9920da" exitCode=0 Mar 16 16:34:44 crc kubenswrapper[5120]: I0316 16:34:44.218801 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"0d3704f3-b041-4512-89cf-accbfc73e3cf","Type":"ContainerDied","Data":"fa37d31ad7bcd4a5110e71e6feaa642ca3850c15283ac0ef042893bc4e9920da"} Mar 16 16:34:44 crc kubenswrapper[5120]: I0316 16:34:44.218832 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"0d3704f3-b041-4512-89cf-accbfc73e3cf","Type":"ContainerDied","Data":"bce0dd78139d7beceba2ffb5e6ef436738da3a4cc268301656ab830e9483f400"} Mar 16 16:34:44 crc kubenswrapper[5120]: I0316 16:34:44.218856 5120 scope.go:117] "RemoveContainer" containerID="fa37d31ad7bcd4a5110e71e6feaa642ca3850c15283ac0ef042893bc4e9920da" Mar 16 16:34:44 crc kubenswrapper[5120]: I0316 16:34:44.219136 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:34:44 crc kubenswrapper[5120]: I0316 16:34:44.256140 5120 scope.go:117] "RemoveContainer" containerID="7832196ae07a4790a885e3883e0dfaa3a7952b0b9eed6a61f230c7651efde062" Mar 16 16:34:44 crc kubenswrapper[5120]: I0316 16:34:44.262161 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:34:44 crc kubenswrapper[5120]: I0316 16:34:44.284630 5120 scope.go:117] "RemoveContainer" containerID="fa37d31ad7bcd4a5110e71e6feaa642ca3850c15283ac0ef042893bc4e9920da" Mar 16 16:34:44 crc kubenswrapper[5120]: I0316 16:34:44.284696 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:34:44 crc kubenswrapper[5120]: E0316 16:34:44.285101 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa37d31ad7bcd4a5110e71e6feaa642ca3850c15283ac0ef042893bc4e9920da\": container with ID starting with fa37d31ad7bcd4a5110e71e6feaa642ca3850c15283ac0ef042893bc4e9920da not found: ID does not exist" containerID="fa37d31ad7bcd4a5110e71e6feaa642ca3850c15283ac0ef042893bc4e9920da" Mar 16 16:34:44 crc kubenswrapper[5120]: I0316 16:34:44.285134 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa37d31ad7bcd4a5110e71e6feaa642ca3850c15283ac0ef042893bc4e9920da"} err="failed to get container status \"fa37d31ad7bcd4a5110e71e6feaa642ca3850c15283ac0ef042893bc4e9920da\": rpc error: code = NotFound desc = could not find container \"fa37d31ad7bcd4a5110e71e6feaa642ca3850c15283ac0ef042893bc4e9920da\": container with ID starting with fa37d31ad7bcd4a5110e71e6feaa642ca3850c15283ac0ef042893bc4e9920da not found: ID does not exist" Mar 16 16:34:44 crc kubenswrapper[5120]: I0316 16:34:44.285155 5120 scope.go:117] "RemoveContainer" containerID="7832196ae07a4790a885e3883e0dfaa3a7952b0b9eed6a61f230c7651efde062" Mar 16 16:34:44 crc kubenswrapper[5120]: E0316 16:34:44.285451 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7832196ae07a4790a885e3883e0dfaa3a7952b0b9eed6a61f230c7651efde062\": container with ID starting with 7832196ae07a4790a885e3883e0dfaa3a7952b0b9eed6a61f230c7651efde062 not found: ID does not exist" containerID="7832196ae07a4790a885e3883e0dfaa3a7952b0b9eed6a61f230c7651efde062" Mar 16 16:34:44 crc kubenswrapper[5120]: I0316 16:34:44.285494 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7832196ae07a4790a885e3883e0dfaa3a7952b0b9eed6a61f230c7651efde062"} err="failed to get container status \"7832196ae07a4790a885e3883e0dfaa3a7952b0b9eed6a61f230c7651efde062\": rpc error: code = NotFound desc = could not find container \"7832196ae07a4790a885e3883e0dfaa3a7952b0b9eed6a61f230c7651efde062\": container with ID starting with 7832196ae07a4790a885e3883e0dfaa3a7952b0b9eed6a61f230c7651efde062 not found: ID does not exist" Mar 16 16:34:44 crc kubenswrapper[5120]: I0316 16:34:44.301861 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:34:44 crc kubenswrapper[5120]: I0316 16:34:44.303129 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d3704f3-b041-4512-89cf-accbfc73e3cf" containerName="nova-api-api" Mar 16 16:34:44 crc kubenswrapper[5120]: I0316 16:34:44.303152 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d3704f3-b041-4512-89cf-accbfc73e3cf" containerName="nova-api-api" Mar 16 16:34:44 crc kubenswrapper[5120]: I0316 16:34:44.303205 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d3704f3-b041-4512-89cf-accbfc73e3cf" containerName="nova-api-log" Mar 16 16:34:44 crc kubenswrapper[5120]: I0316 16:34:44.303212 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d3704f3-b041-4512-89cf-accbfc73e3cf" containerName="nova-api-log" Mar 16 16:34:44 crc kubenswrapper[5120]: I0316 16:34:44.303369 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="0d3704f3-b041-4512-89cf-accbfc73e3cf" containerName="nova-api-log" Mar 16 16:34:44 crc kubenswrapper[5120]: I0316 16:34:44.303394 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="0d3704f3-b041-4512-89cf-accbfc73e3cf" containerName="nova-api-api" Mar 16 16:34:44 crc kubenswrapper[5120]: I0316 16:34:44.310179 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:34:44 crc kubenswrapper[5120]: I0316 16:34:44.313041 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-config-data\"" Mar 16 16:34:44 crc kubenswrapper[5120]: I0316 16:34:44.324045 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:34:44 crc kubenswrapper[5120]: I0316 16:34:44.366387 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t56ld\" (UniqueName: \"kubernetes.io/projected/eadb9039-baf8-429d-82ea-01531fd18a12-kube-api-access-t56ld\") pod \"nova-api-0\" (UID: \"eadb9039-baf8-429d-82ea-01531fd18a12\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:34:44 crc kubenswrapper[5120]: I0316 16:34:44.366580 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eadb9039-baf8-429d-82ea-01531fd18a12-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"eadb9039-baf8-429d-82ea-01531fd18a12\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:34:44 crc kubenswrapper[5120]: I0316 16:34:44.367107 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/eadb9039-baf8-429d-82ea-01531fd18a12-logs\") pod \"nova-api-0\" (UID: \"eadb9039-baf8-429d-82ea-01531fd18a12\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:34:44 crc kubenswrapper[5120]: I0316 16:34:44.367211 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/eadb9039-baf8-429d-82ea-01531fd18a12-config-data\") pod \"nova-api-0\" (UID: \"eadb9039-baf8-429d-82ea-01531fd18a12\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:34:44 crc kubenswrapper[5120]: I0316 16:34:44.468862 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/eadb9039-baf8-429d-82ea-01531fd18a12-logs\") pod \"nova-api-0\" (UID: \"eadb9039-baf8-429d-82ea-01531fd18a12\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:34:44 crc kubenswrapper[5120]: I0316 16:34:44.468937 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/eadb9039-baf8-429d-82ea-01531fd18a12-config-data\") pod \"nova-api-0\" (UID: \"eadb9039-baf8-429d-82ea-01531fd18a12\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:34:44 crc kubenswrapper[5120]: I0316 16:34:44.468982 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t56ld\" (UniqueName: \"kubernetes.io/projected/eadb9039-baf8-429d-82ea-01531fd18a12-kube-api-access-t56ld\") pod \"nova-api-0\" (UID: \"eadb9039-baf8-429d-82ea-01531fd18a12\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:34:44 crc kubenswrapper[5120]: I0316 16:34:44.469098 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eadb9039-baf8-429d-82ea-01531fd18a12-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"eadb9039-baf8-429d-82ea-01531fd18a12\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:34:44 crc kubenswrapper[5120]: I0316 16:34:44.469727 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/eadb9039-baf8-429d-82ea-01531fd18a12-logs\") pod \"nova-api-0\" (UID: \"eadb9039-baf8-429d-82ea-01531fd18a12\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:34:44 crc kubenswrapper[5120]: I0316 16:34:44.475944 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/eadb9039-baf8-429d-82ea-01531fd18a12-config-data\") pod \"nova-api-0\" (UID: \"eadb9039-baf8-429d-82ea-01531fd18a12\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:34:44 crc kubenswrapper[5120]: I0316 16:34:44.476197 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eadb9039-baf8-429d-82ea-01531fd18a12-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"eadb9039-baf8-429d-82ea-01531fd18a12\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:34:44 crc kubenswrapper[5120]: I0316 16:34:44.488805 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t56ld\" (UniqueName: \"kubernetes.io/projected/eadb9039-baf8-429d-82ea-01531fd18a12-kube-api-access-t56ld\") pod \"nova-api-0\" (UID: \"eadb9039-baf8-429d-82ea-01531fd18a12\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:34:44 crc kubenswrapper[5120]: I0316 16:34:44.638195 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:34:44 crc kubenswrapper[5120]: I0316 16:34:44.694559 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d3704f3-b041-4512-89cf-accbfc73e3cf" path="/var/lib/kubelet/pods/0d3704f3-b041-4512-89cf-accbfc73e3cf/volumes" Mar 16 16:34:44 crc kubenswrapper[5120]: I0316 16:34:44.695295 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5af6cf0b-bf71-4453-ba3e-ab4016bc58cb" path="/var/lib/kubelet/pods/5af6cf0b-bf71-4453-ba3e-ab4016bc58cb/volumes" Mar 16 16:34:45 crc kubenswrapper[5120]: I0316 16:34:45.144837 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:34:45 crc kubenswrapper[5120]: W0316 16:34:45.146833 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podeadb9039_baf8_429d_82ea_01531fd18a12.slice/crio-f3bced4c5c807e04165e240ab3f906e50ebb21b09410b9b9f318ccde62bd5c7d WatchSource:0}: Error finding container f3bced4c5c807e04165e240ab3f906e50ebb21b09410b9b9f318ccde62bd5c7d: Status 404 returned error can't find the container with id f3bced4c5c807e04165e240ab3f906e50ebb21b09410b9b9f318ccde62bd5c7d Mar 16 16:34:45 crc kubenswrapper[5120]: I0316 16:34:45.233045 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"f99422e5-686e-4d1d-8986-ba6e747db255","Type":"ContainerStarted","Data":"a130b33bcc067dd6c3adb134433231928cbd2b5634c364451c12b069eb703117"} Mar 16 16:34:45 crc kubenswrapper[5120]: I0316 16:34:45.233330 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:34:45 crc kubenswrapper[5120]: I0316 16:34:45.237545 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"eadb9039-baf8-429d-82ea-01531fd18a12","Type":"ContainerStarted","Data":"f3bced4c5c807e04165e240ab3f906e50ebb21b09410b9b9f318ccde62bd5c7d"} Mar 16 16:34:45 crc kubenswrapper[5120]: I0316 16:34:45.263229 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/kube-state-metrics-0" podStartSLOduration=1.8277070100000001 podStartE2EDuration="2.263202304s" podCreationTimestamp="2026-03-16 16:34:43 +0000 UTC" firstStartedPulling="2026-03-16 16:34:44.147542373 +0000 UTC m=+3786.301474030" lastFinishedPulling="2026-03-16 16:34:44.583037667 +0000 UTC m=+3786.736969324" observedRunningTime="2026-03-16 16:34:45.252752881 +0000 UTC m=+3787.406684538" watchObservedRunningTime="2026-03-16 16:34:45.263202304 +0000 UTC m=+3787.417133961" Mar 16 16:34:45 crc kubenswrapper[5120]: I0316 16:34:45.824012 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:34:45 crc kubenswrapper[5120]: I0316 16:34:45.912255 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2b177362-e72c-4e7d-b029-e1a88c988fec-config-data\") pod \"2b177362-e72c-4e7d-b029-e1a88c988fec\" (UID: \"2b177362-e72c-4e7d-b029-e1a88c988fec\") " Mar 16 16:34:45 crc kubenswrapper[5120]: I0316 16:34:45.912404 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2b177362-e72c-4e7d-b029-e1a88c988fec-combined-ca-bundle\") pod \"2b177362-e72c-4e7d-b029-e1a88c988fec\" (UID: \"2b177362-e72c-4e7d-b029-e1a88c988fec\") " Mar 16 16:34:45 crc kubenswrapper[5120]: I0316 16:34:45.912515 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vdz8r\" (UniqueName: \"kubernetes.io/projected/2b177362-e72c-4e7d-b029-e1a88c988fec-kube-api-access-vdz8r\") pod \"2b177362-e72c-4e7d-b029-e1a88c988fec\" (UID: \"2b177362-e72c-4e7d-b029-e1a88c988fec\") " Mar 16 16:34:45 crc kubenswrapper[5120]: I0316 16:34:45.912694 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2b177362-e72c-4e7d-b029-e1a88c988fec-logs\") pod \"2b177362-e72c-4e7d-b029-e1a88c988fec\" (UID: \"2b177362-e72c-4e7d-b029-e1a88c988fec\") " Mar 16 16:34:45 crc kubenswrapper[5120]: I0316 16:34:45.912995 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/2b177362-e72c-4e7d-b029-e1a88c988fec-nova-metadata-tls-certs\") pod \"2b177362-e72c-4e7d-b029-e1a88c988fec\" (UID: \"2b177362-e72c-4e7d-b029-e1a88c988fec\") " Mar 16 16:34:45 crc kubenswrapper[5120]: I0316 16:34:45.916791 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b177362-e72c-4e7d-b029-e1a88c988fec-logs" (OuterVolumeSpecName: "logs") pod "2b177362-e72c-4e7d-b029-e1a88c988fec" (UID: "2b177362-e72c-4e7d-b029-e1a88c988fec"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:34:45 crc kubenswrapper[5120]: I0316 16:34:45.931831 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b177362-e72c-4e7d-b029-e1a88c988fec-kube-api-access-vdz8r" (OuterVolumeSpecName: "kube-api-access-vdz8r") pod "2b177362-e72c-4e7d-b029-e1a88c988fec" (UID: "2b177362-e72c-4e7d-b029-e1a88c988fec"). InnerVolumeSpecName "kube-api-access-vdz8r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:34:45 crc kubenswrapper[5120]: I0316 16:34:45.941728 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b177362-e72c-4e7d-b029-e1a88c988fec-config-data" (OuterVolumeSpecName: "config-data") pod "2b177362-e72c-4e7d-b029-e1a88c988fec" (UID: "2b177362-e72c-4e7d-b029-e1a88c988fec"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:34:45 crc kubenswrapper[5120]: I0316 16:34:45.949266 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b177362-e72c-4e7d-b029-e1a88c988fec-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "2b177362-e72c-4e7d-b029-e1a88c988fec" (UID: "2b177362-e72c-4e7d-b029-e1a88c988fec"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:34:45 crc kubenswrapper[5120]: I0316 16:34:45.988004 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b177362-e72c-4e7d-b029-e1a88c988fec-nova-metadata-tls-certs" (OuterVolumeSpecName: "nova-metadata-tls-certs") pod "2b177362-e72c-4e7d-b029-e1a88c988fec" (UID: "2b177362-e72c-4e7d-b029-e1a88c988fec"). InnerVolumeSpecName "nova-metadata-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:34:46 crc kubenswrapper[5120]: I0316 16:34:46.015673 5120 reconciler_common.go:299] "Volume detached for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/2b177362-e72c-4e7d-b029-e1a88c988fec-nova-metadata-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:34:46 crc kubenswrapper[5120]: I0316 16:34:46.015727 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2b177362-e72c-4e7d-b029-e1a88c988fec-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:34:46 crc kubenswrapper[5120]: I0316 16:34:46.015741 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2b177362-e72c-4e7d-b029-e1a88c988fec-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:34:46 crc kubenswrapper[5120]: I0316 16:34:46.015768 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vdz8r\" (UniqueName: \"kubernetes.io/projected/2b177362-e72c-4e7d-b029-e1a88c988fec-kube-api-access-vdz8r\") on node \"crc\" DevicePath \"\"" Mar 16 16:34:46 crc kubenswrapper[5120]: I0316 16:34:46.015782 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2b177362-e72c-4e7d-b029-e1a88c988fec-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:34:46 crc kubenswrapper[5120]: I0316 16:34:46.033783 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:34:46 crc kubenswrapper[5120]: I0316 16:34:46.117408 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2b171fb9-014c-41df-a05b-d2d376d8d507-config-data\") pod \"2b171fb9-014c-41df-a05b-d2d376d8d507\" (UID: \"2b171fb9-014c-41df-a05b-d2d376d8d507\") " Mar 16 16:34:46 crc kubenswrapper[5120]: I0316 16:34:46.117569 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2b171fb9-014c-41df-a05b-d2d376d8d507-combined-ca-bundle\") pod \"2b171fb9-014c-41df-a05b-d2d376d8d507\" (UID: \"2b171fb9-014c-41df-a05b-d2d376d8d507\") " Mar 16 16:34:46 crc kubenswrapper[5120]: I0316 16:34:46.117742 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-496zb\" (UniqueName: \"kubernetes.io/projected/2b171fb9-014c-41df-a05b-d2d376d8d507-kube-api-access-496zb\") pod \"2b171fb9-014c-41df-a05b-d2d376d8d507\" (UID: \"2b171fb9-014c-41df-a05b-d2d376d8d507\") " Mar 16 16:34:46 crc kubenswrapper[5120]: I0316 16:34:46.121905 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b171fb9-014c-41df-a05b-d2d376d8d507-kube-api-access-496zb" (OuterVolumeSpecName: "kube-api-access-496zb") pod "2b171fb9-014c-41df-a05b-d2d376d8d507" (UID: "2b171fb9-014c-41df-a05b-d2d376d8d507"). InnerVolumeSpecName "kube-api-access-496zb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:34:46 crc kubenswrapper[5120]: E0316 16:34:46.147058 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b171fb9-014c-41df-a05b-d2d376d8d507-config-data podName:2b171fb9-014c-41df-a05b-d2d376d8d507 nodeName:}" failed. No retries permitted until 2026-03-16 16:34:46.647024368 +0000 UTC m=+3788.800956025 (durationBeforeRetry 500ms). Error: error cleaning subPath mounts for volume "config-data" (UniqueName: "kubernetes.io/secret/2b171fb9-014c-41df-a05b-d2d376d8d507-config-data") pod "2b171fb9-014c-41df-a05b-d2d376d8d507" (UID: "2b171fb9-014c-41df-a05b-d2d376d8d507") : error deleting /var/lib/kubelet/pods/2b171fb9-014c-41df-a05b-d2d376d8d507/volume-subpaths: remove /var/lib/kubelet/pods/2b171fb9-014c-41df-a05b-d2d376d8d507/volume-subpaths: no such file or directory Mar 16 16:34:46 crc kubenswrapper[5120]: I0316 16:34:46.150383 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b171fb9-014c-41df-a05b-d2d376d8d507-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "2b171fb9-014c-41df-a05b-d2d376d8d507" (UID: "2b171fb9-014c-41df-a05b-d2d376d8d507"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:34:46 crc kubenswrapper[5120]: I0316 16:34:46.221315 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2b171fb9-014c-41df-a05b-d2d376d8d507-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:34:46 crc kubenswrapper[5120]: I0316 16:34:46.221362 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-496zb\" (UniqueName: \"kubernetes.io/projected/2b171fb9-014c-41df-a05b-d2d376d8d507-kube-api-access-496zb\") on node \"crc\" DevicePath \"\"" Mar 16 16:34:46 crc kubenswrapper[5120]: I0316 16:34:46.261316 5120 generic.go:358] "Generic (PLEG): container finished" podID="2b177362-e72c-4e7d-b029-e1a88c988fec" containerID="c68ece73025e33e3545fef021a08c454bda7ff66411e1dd56ad98a17562e0a31" exitCode=0 Mar 16 16:34:46 crc kubenswrapper[5120]: I0316 16:34:46.261450 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"2b177362-e72c-4e7d-b029-e1a88c988fec","Type":"ContainerDied","Data":"c68ece73025e33e3545fef021a08c454bda7ff66411e1dd56ad98a17562e0a31"} Mar 16 16:34:46 crc kubenswrapper[5120]: I0316 16:34:46.261476 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:34:46 crc kubenswrapper[5120]: I0316 16:34:46.261517 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"2b177362-e72c-4e7d-b029-e1a88c988fec","Type":"ContainerDied","Data":"893415923fc6fa61c3c31c9d9ad7f9800013a2ddf5f0f45b0c0ec41d8a327fcf"} Mar 16 16:34:46 crc kubenswrapper[5120]: I0316 16:34:46.261548 5120 scope.go:117] "RemoveContainer" containerID="c68ece73025e33e3545fef021a08c454bda7ff66411e1dd56ad98a17562e0a31" Mar 16 16:34:46 crc kubenswrapper[5120]: I0316 16:34:46.268009 5120 generic.go:358] "Generic (PLEG): container finished" podID="2b171fb9-014c-41df-a05b-d2d376d8d507" containerID="1bd12854601538398d6984520b192c05a7127f7b5949a607c485d1b967a6dff8" exitCode=0 Mar 16 16:34:46 crc kubenswrapper[5120]: I0316 16:34:46.268112 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:34:46 crc kubenswrapper[5120]: I0316 16:34:46.268109 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"2b171fb9-014c-41df-a05b-d2d376d8d507","Type":"ContainerDied","Data":"1bd12854601538398d6984520b192c05a7127f7b5949a607c485d1b967a6dff8"} Mar 16 16:34:46 crc kubenswrapper[5120]: I0316 16:34:46.268166 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"2b171fb9-014c-41df-a05b-d2d376d8d507","Type":"ContainerDied","Data":"45a291bf6d6dd2a6287b119c4d1349cfd966945907d7ad74e73c962266b8802d"} Mar 16 16:34:46 crc kubenswrapper[5120]: I0316 16:34:46.273537 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"eadb9039-baf8-429d-82ea-01531fd18a12","Type":"ContainerStarted","Data":"7320aef7bfb81dca07022c118df9073ea5d0e46d810717a31309609d525979de"} Mar 16 16:34:46 crc kubenswrapper[5120]: I0316 16:34:46.273626 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"eadb9039-baf8-429d-82ea-01531fd18a12","Type":"ContainerStarted","Data":"25f0942b159beec776bb0914c8098eb2d0ae06cb5b289de798b8ab5b3d16d583"} Mar 16 16:34:46 crc kubenswrapper[5120]: I0316 16:34:46.305608 5120 scope.go:117] "RemoveContainer" containerID="26185cae285f17b199d2065f17d902449ad5aee8c03aa9de8535f1cb74f1aa13" Mar 16 16:34:46 crc kubenswrapper[5120]: I0316 16:34:46.307730 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=2.307705132 podStartE2EDuration="2.307705132s" podCreationTimestamp="2026-03-16 16:34:44 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:34:46.300136475 +0000 UTC m=+3788.454068152" watchObservedRunningTime="2026-03-16 16:34:46.307705132 +0000 UTC m=+3788.461636789" Mar 16 16:34:46 crc kubenswrapper[5120]: I0316 16:34:46.339425 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:34:46 crc kubenswrapper[5120]: I0316 16:34:46.350418 5120 scope.go:117] "RemoveContainer" containerID="c68ece73025e33e3545fef021a08c454bda7ff66411e1dd56ad98a17562e0a31" Mar 16 16:34:46 crc kubenswrapper[5120]: E0316 16:34:46.353989 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c68ece73025e33e3545fef021a08c454bda7ff66411e1dd56ad98a17562e0a31\": container with ID starting with c68ece73025e33e3545fef021a08c454bda7ff66411e1dd56ad98a17562e0a31 not found: ID does not exist" containerID="c68ece73025e33e3545fef021a08c454bda7ff66411e1dd56ad98a17562e0a31" Mar 16 16:34:46 crc kubenswrapper[5120]: I0316 16:34:46.354049 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c68ece73025e33e3545fef021a08c454bda7ff66411e1dd56ad98a17562e0a31"} err="failed to get container status \"c68ece73025e33e3545fef021a08c454bda7ff66411e1dd56ad98a17562e0a31\": rpc error: code = NotFound desc = could not find container \"c68ece73025e33e3545fef021a08c454bda7ff66411e1dd56ad98a17562e0a31\": container with ID starting with c68ece73025e33e3545fef021a08c454bda7ff66411e1dd56ad98a17562e0a31 not found: ID does not exist" Mar 16 16:34:46 crc kubenswrapper[5120]: I0316 16:34:46.354082 5120 scope.go:117] "RemoveContainer" containerID="26185cae285f17b199d2065f17d902449ad5aee8c03aa9de8535f1cb74f1aa13" Mar 16 16:34:46 crc kubenswrapper[5120]: E0316 16:34:46.354354 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"26185cae285f17b199d2065f17d902449ad5aee8c03aa9de8535f1cb74f1aa13\": container with ID starting with 26185cae285f17b199d2065f17d902449ad5aee8c03aa9de8535f1cb74f1aa13 not found: ID does not exist" containerID="26185cae285f17b199d2065f17d902449ad5aee8c03aa9de8535f1cb74f1aa13" Mar 16 16:34:46 crc kubenswrapper[5120]: I0316 16:34:46.354386 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26185cae285f17b199d2065f17d902449ad5aee8c03aa9de8535f1cb74f1aa13"} err="failed to get container status \"26185cae285f17b199d2065f17d902449ad5aee8c03aa9de8535f1cb74f1aa13\": rpc error: code = NotFound desc = could not find container \"26185cae285f17b199d2065f17d902449ad5aee8c03aa9de8535f1cb74f1aa13\": container with ID starting with 26185cae285f17b199d2065f17d902449ad5aee8c03aa9de8535f1cb74f1aa13 not found: ID does not exist" Mar 16 16:34:46 crc kubenswrapper[5120]: I0316 16:34:46.354406 5120 scope.go:117] "RemoveContainer" containerID="1bd12854601538398d6984520b192c05a7127f7b5949a607c485d1b967a6dff8" Mar 16 16:34:46 crc kubenswrapper[5120]: I0316 16:34:46.357451 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:34:46 crc kubenswrapper[5120]: I0316 16:34:46.373995 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:34:46 crc kubenswrapper[5120]: I0316 16:34:46.376059 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b177362-e72c-4e7d-b029-e1a88c988fec" containerName="nova-metadata-metadata" Mar 16 16:34:46 crc kubenswrapper[5120]: I0316 16:34:46.376088 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b177362-e72c-4e7d-b029-e1a88c988fec" containerName="nova-metadata-metadata" Mar 16 16:34:46 crc kubenswrapper[5120]: I0316 16:34:46.376151 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b177362-e72c-4e7d-b029-e1a88c988fec" containerName="nova-metadata-log" Mar 16 16:34:46 crc kubenswrapper[5120]: I0316 16:34:46.376160 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b177362-e72c-4e7d-b029-e1a88c988fec" containerName="nova-metadata-log" Mar 16 16:34:46 crc kubenswrapper[5120]: I0316 16:34:46.376203 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b171fb9-014c-41df-a05b-d2d376d8d507" containerName="nova-scheduler-scheduler" Mar 16 16:34:46 crc kubenswrapper[5120]: I0316 16:34:46.376217 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b171fb9-014c-41df-a05b-d2d376d8d507" containerName="nova-scheduler-scheduler" Mar 16 16:34:46 crc kubenswrapper[5120]: I0316 16:34:46.376418 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="2b177362-e72c-4e7d-b029-e1a88c988fec" containerName="nova-metadata-log" Mar 16 16:34:46 crc kubenswrapper[5120]: I0316 16:34:46.376460 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="2b177362-e72c-4e7d-b029-e1a88c988fec" containerName="nova-metadata-metadata" Mar 16 16:34:46 crc kubenswrapper[5120]: I0316 16:34:46.376477 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="2b171fb9-014c-41df-a05b-d2d376d8d507" containerName="nova-scheduler-scheduler" Mar 16 16:34:46 crc kubenswrapper[5120]: I0316 16:34:46.393098 5120 scope.go:117] "RemoveContainer" containerID="1bd12854601538398d6984520b192c05a7127f7b5949a607c485d1b967a6dff8" Mar 16 16:34:46 crc kubenswrapper[5120]: E0316 16:34:46.393560 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1bd12854601538398d6984520b192c05a7127f7b5949a607c485d1b967a6dff8\": container with ID starting with 1bd12854601538398d6984520b192c05a7127f7b5949a607c485d1b967a6dff8 not found: ID does not exist" containerID="1bd12854601538398d6984520b192c05a7127f7b5949a607c485d1b967a6dff8" Mar 16 16:34:46 crc kubenswrapper[5120]: I0316 16:34:46.393616 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1bd12854601538398d6984520b192c05a7127f7b5949a607c485d1b967a6dff8"} err="failed to get container status \"1bd12854601538398d6984520b192c05a7127f7b5949a607c485d1b967a6dff8\": rpc error: code = NotFound desc = could not find container \"1bd12854601538398d6984520b192c05a7127f7b5949a607c485d1b967a6dff8\": container with ID starting with 1bd12854601538398d6984520b192c05a7127f7b5949a607c485d1b967a6dff8 not found: ID does not exist" Mar 16 16:34:46 crc kubenswrapper[5120]: I0316 16:34:46.402782 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:34:46 crc kubenswrapper[5120]: I0316 16:34:46.402952 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:34:46 crc kubenswrapper[5120]: I0316 16:34:46.406477 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-metadata-config-data\"" Mar 16 16:34:46 crc kubenswrapper[5120]: I0316 16:34:46.407129 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-metadata-internal-svc\"" Mar 16 16:34:46 crc kubenswrapper[5120]: I0316 16:34:46.427131 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7c83e22b-e8f6-4228-95a3-9874368d9534-logs\") pod \"nova-metadata-0\" (UID: \"7c83e22b-e8f6-4228-95a3-9874368d9534\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:34:46 crc kubenswrapper[5120]: I0316 16:34:46.427195 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7c83e22b-e8f6-4228-95a3-9874368d9534-config-data\") pod \"nova-metadata-0\" (UID: \"7c83e22b-e8f6-4228-95a3-9874368d9534\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:34:46 crc kubenswrapper[5120]: I0316 16:34:46.427226 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7c83e22b-e8f6-4228-95a3-9874368d9534-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"7c83e22b-e8f6-4228-95a3-9874368d9534\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:34:46 crc kubenswrapper[5120]: I0316 16:34:46.427296 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhwz9\" (UniqueName: \"kubernetes.io/projected/7c83e22b-e8f6-4228-95a3-9874368d9534-kube-api-access-mhwz9\") pod \"nova-metadata-0\" (UID: \"7c83e22b-e8f6-4228-95a3-9874368d9534\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:34:46 crc kubenswrapper[5120]: I0316 16:34:46.427442 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/7c83e22b-e8f6-4228-95a3-9874368d9534-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"7c83e22b-e8f6-4228-95a3-9874368d9534\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:34:46 crc kubenswrapper[5120]: I0316 16:34:46.529187 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7c83e22b-e8f6-4228-95a3-9874368d9534-config-data\") pod \"nova-metadata-0\" (UID: \"7c83e22b-e8f6-4228-95a3-9874368d9534\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:34:46 crc kubenswrapper[5120]: I0316 16:34:46.529255 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7c83e22b-e8f6-4228-95a3-9874368d9534-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"7c83e22b-e8f6-4228-95a3-9874368d9534\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:34:46 crc kubenswrapper[5120]: I0316 16:34:46.529288 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mhwz9\" (UniqueName: \"kubernetes.io/projected/7c83e22b-e8f6-4228-95a3-9874368d9534-kube-api-access-mhwz9\") pod \"nova-metadata-0\" (UID: \"7c83e22b-e8f6-4228-95a3-9874368d9534\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:34:46 crc kubenswrapper[5120]: I0316 16:34:46.529344 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/7c83e22b-e8f6-4228-95a3-9874368d9534-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"7c83e22b-e8f6-4228-95a3-9874368d9534\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:34:46 crc kubenswrapper[5120]: I0316 16:34:46.533200 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7c83e22b-e8f6-4228-95a3-9874368d9534-logs\") pod \"nova-metadata-0\" (UID: \"7c83e22b-e8f6-4228-95a3-9874368d9534\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:34:46 crc kubenswrapper[5120]: I0316 16:34:46.533713 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7c83e22b-e8f6-4228-95a3-9874368d9534-logs\") pod \"nova-metadata-0\" (UID: \"7c83e22b-e8f6-4228-95a3-9874368d9534\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:34:46 crc kubenswrapper[5120]: I0316 16:34:46.535588 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/7c83e22b-e8f6-4228-95a3-9874368d9534-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"7c83e22b-e8f6-4228-95a3-9874368d9534\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:34:46 crc kubenswrapper[5120]: I0316 16:34:46.542655 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7c83e22b-e8f6-4228-95a3-9874368d9534-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"7c83e22b-e8f6-4228-95a3-9874368d9534\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:34:46 crc kubenswrapper[5120]: I0316 16:34:46.544069 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7c83e22b-e8f6-4228-95a3-9874368d9534-config-data\") pod \"nova-metadata-0\" (UID: \"7c83e22b-e8f6-4228-95a3-9874368d9534\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:34:46 crc kubenswrapper[5120]: I0316 16:34:46.546800 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhwz9\" (UniqueName: \"kubernetes.io/projected/7c83e22b-e8f6-4228-95a3-9874368d9534-kube-api-access-mhwz9\") pod \"nova-metadata-0\" (UID: \"7c83e22b-e8f6-4228-95a3-9874368d9534\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:34:46 crc kubenswrapper[5120]: I0316 16:34:46.678208 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b177362-e72c-4e7d-b029-e1a88c988fec" path="/var/lib/kubelet/pods/2b177362-e72c-4e7d-b029-e1a88c988fec/volumes" Mar 16 16:34:46 crc kubenswrapper[5120]: I0316 16:34:46.722117 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:34:46 crc kubenswrapper[5120]: I0316 16:34:46.737121 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2b171fb9-014c-41df-a05b-d2d376d8d507-config-data\") pod \"2b171fb9-014c-41df-a05b-d2d376d8d507\" (UID: \"2b171fb9-014c-41df-a05b-d2d376d8d507\") " Mar 16 16:34:46 crc kubenswrapper[5120]: I0316 16:34:46.742969 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b171fb9-014c-41df-a05b-d2d376d8d507-config-data" (OuterVolumeSpecName: "config-data") pod "2b171fb9-014c-41df-a05b-d2d376d8d507" (UID: "2b171fb9-014c-41df-a05b-d2d376d8d507"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:34:46 crc kubenswrapper[5120]: I0316 16:34:46.839701 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2b171fb9-014c-41df-a05b-d2d376d8d507-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:34:46 crc kubenswrapper[5120]: I0316 16:34:46.909932 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:34:46 crc kubenswrapper[5120]: I0316 16:34:46.951980 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:34:46 crc kubenswrapper[5120]: I0316 16:34:46.965288 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:34:46 crc kubenswrapper[5120]: I0316 16:34:46.984491 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:34:46 crc kubenswrapper[5120]: I0316 16:34:46.988045 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-scheduler-config-data\"" Mar 16 16:34:46 crc kubenswrapper[5120]: I0316 16:34:46.990094 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:34:47 crc kubenswrapper[5120]: I0316 16:34:47.048476 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7c9566ce-4767-48d0-b606-410f234e9cf2-config-data\") pod \"nova-scheduler-0\" (UID: \"7c9566ce-4767-48d0-b606-410f234e9cf2\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:34:47 crc kubenswrapper[5120]: I0316 16:34:47.048641 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78whc\" (UniqueName: \"kubernetes.io/projected/7c9566ce-4767-48d0-b606-410f234e9cf2-kube-api-access-78whc\") pod \"nova-scheduler-0\" (UID: \"7c9566ce-4767-48d0-b606-410f234e9cf2\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:34:47 crc kubenswrapper[5120]: I0316 16:34:47.048836 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7c9566ce-4767-48d0-b606-410f234e9cf2-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"7c9566ce-4767-48d0-b606-410f234e9cf2\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:34:47 crc kubenswrapper[5120]: I0316 16:34:47.151330 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-78whc\" (UniqueName: \"kubernetes.io/projected/7c9566ce-4767-48d0-b606-410f234e9cf2-kube-api-access-78whc\") pod \"nova-scheduler-0\" (UID: \"7c9566ce-4767-48d0-b606-410f234e9cf2\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:34:47 crc kubenswrapper[5120]: I0316 16:34:47.151711 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7c9566ce-4767-48d0-b606-410f234e9cf2-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"7c9566ce-4767-48d0-b606-410f234e9cf2\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:34:47 crc kubenswrapper[5120]: I0316 16:34:47.152147 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7c9566ce-4767-48d0-b606-410f234e9cf2-config-data\") pod \"nova-scheduler-0\" (UID: \"7c9566ce-4767-48d0-b606-410f234e9cf2\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:34:47 crc kubenswrapper[5120]: I0316 16:34:47.162677 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7c9566ce-4767-48d0-b606-410f234e9cf2-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"7c9566ce-4767-48d0-b606-410f234e9cf2\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:34:47 crc kubenswrapper[5120]: I0316 16:34:47.162976 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7c9566ce-4767-48d0-b606-410f234e9cf2-config-data\") pod \"nova-scheduler-0\" (UID: \"7c9566ce-4767-48d0-b606-410f234e9cf2\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:34:47 crc kubenswrapper[5120]: I0316 16:34:47.173367 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-78whc\" (UniqueName: \"kubernetes.io/projected/7c9566ce-4767-48d0-b606-410f234e9cf2-kube-api-access-78whc\") pod \"nova-scheduler-0\" (UID: \"7c9566ce-4767-48d0-b606-410f234e9cf2\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:34:47 crc kubenswrapper[5120]: W0316 16:34:47.186519 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7c83e22b_e8f6_4228_95a3_9874368d9534.slice/crio-1c6134df54d185a21d062fe534fe2a2028b396e9dbc9a309606244cd6d3350e4 WatchSource:0}: Error finding container 1c6134df54d185a21d062fe534fe2a2028b396e9dbc9a309606244cd6d3350e4: Status 404 returned error can't find the container with id 1c6134df54d185a21d062fe534fe2a2028b396e9dbc9a309606244cd6d3350e4 Mar 16 16:34:47 crc kubenswrapper[5120]: I0316 16:34:47.186784 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:34:47 crc kubenswrapper[5120]: I0316 16:34:47.287199 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"7c83e22b-e8f6-4228-95a3-9874368d9534","Type":"ContainerStarted","Data":"1c6134df54d185a21d062fe534fe2a2028b396e9dbc9a309606244cd6d3350e4"} Mar 16 16:34:47 crc kubenswrapper[5120]: I0316 16:34:47.290194 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:34:47 crc kubenswrapper[5120]: I0316 16:34:47.293014 5120 generic.go:358] "Generic (PLEG): container finished" podID="c807ead6-beff-4a5b-bf14-c56bf9e4c0f0" containerID="de5cc50c83c4257da798af24f5eed50af4cdd1e04aaf8625514902b4843fff87" exitCode=0 Mar 16 16:34:47 crc kubenswrapper[5120]: I0316 16:34:47.293205 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"c807ead6-beff-4a5b-bf14-c56bf9e4c0f0","Type":"ContainerDied","Data":"de5cc50c83c4257da798af24f5eed50af4cdd1e04aaf8625514902b4843fff87"} Mar 16 16:34:47 crc kubenswrapper[5120]: I0316 16:34:47.293241 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"c807ead6-beff-4a5b-bf14-c56bf9e4c0f0","Type":"ContainerDied","Data":"eff711e187a65e0a8a5e62e874f07d9b9b970f2b60ddefa16868cec9afa94777"} Mar 16 16:34:47 crc kubenswrapper[5120]: I0316 16:34:47.293260 5120 scope.go:117] "RemoveContainer" containerID="aa5640a79d727b5cf5c9d7f6c4b8c6df5f7edbbd9f5a893b66ca4830f9b1b628" Mar 16 16:34:47 crc kubenswrapper[5120]: I0316 16:34:47.336580 5120 scope.go:117] "RemoveContainer" containerID="e70da958b40a1214806e2e41be0d1bc42e3a3e588238a1bbc33512f5ddfb1ea8" Mar 16 16:34:47 crc kubenswrapper[5120]: I0316 16:34:47.356266 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c807ead6-beff-4a5b-bf14-c56bf9e4c0f0-config-data\") pod \"c807ead6-beff-4a5b-bf14-c56bf9e4c0f0\" (UID: \"c807ead6-beff-4a5b-bf14-c56bf9e4c0f0\") " Mar 16 16:34:47 crc kubenswrapper[5120]: I0316 16:34:47.356728 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/c807ead6-beff-4a5b-bf14-c56bf9e4c0f0-sg-core-conf-yaml\") pod \"c807ead6-beff-4a5b-bf14-c56bf9e4c0f0\" (UID: \"c807ead6-beff-4a5b-bf14-c56bf9e4c0f0\") " Mar 16 16:34:47 crc kubenswrapper[5120]: I0316 16:34:47.356827 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c807ead6-beff-4a5b-bf14-c56bf9e4c0f0-log-httpd\") pod \"c807ead6-beff-4a5b-bf14-c56bf9e4c0f0\" (UID: \"c807ead6-beff-4a5b-bf14-c56bf9e4c0f0\") " Mar 16 16:34:47 crc kubenswrapper[5120]: I0316 16:34:47.356953 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2sbpp\" (UniqueName: \"kubernetes.io/projected/c807ead6-beff-4a5b-bf14-c56bf9e4c0f0-kube-api-access-2sbpp\") pod \"c807ead6-beff-4a5b-bf14-c56bf9e4c0f0\" (UID: \"c807ead6-beff-4a5b-bf14-c56bf9e4c0f0\") " Mar 16 16:34:47 crc kubenswrapper[5120]: I0316 16:34:47.357173 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c807ead6-beff-4a5b-bf14-c56bf9e4c0f0-scripts\") pod \"c807ead6-beff-4a5b-bf14-c56bf9e4c0f0\" (UID: \"c807ead6-beff-4a5b-bf14-c56bf9e4c0f0\") " Mar 16 16:34:47 crc kubenswrapper[5120]: I0316 16:34:47.357487 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c807ead6-beff-4a5b-bf14-c56bf9e4c0f0-run-httpd\") pod \"c807ead6-beff-4a5b-bf14-c56bf9e4c0f0\" (UID: \"c807ead6-beff-4a5b-bf14-c56bf9e4c0f0\") " Mar 16 16:34:47 crc kubenswrapper[5120]: I0316 16:34:47.357528 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c807ead6-beff-4a5b-bf14-c56bf9e4c0f0-combined-ca-bundle\") pod \"c807ead6-beff-4a5b-bf14-c56bf9e4c0f0\" (UID: \"c807ead6-beff-4a5b-bf14-c56bf9e4c0f0\") " Mar 16 16:34:47 crc kubenswrapper[5120]: I0316 16:34:47.358151 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c807ead6-beff-4a5b-bf14-c56bf9e4c0f0-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "c807ead6-beff-4a5b-bf14-c56bf9e4c0f0" (UID: "c807ead6-beff-4a5b-bf14-c56bf9e4c0f0"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:34:47 crc kubenswrapper[5120]: I0316 16:34:47.358339 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c807ead6-beff-4a5b-bf14-c56bf9e4c0f0-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "c807ead6-beff-4a5b-bf14-c56bf9e4c0f0" (UID: "c807ead6-beff-4a5b-bf14-c56bf9e4c0f0"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:34:47 crc kubenswrapper[5120]: I0316 16:34:47.359604 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c807ead6-beff-4a5b-bf14-c56bf9e4c0f0-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:34:47 crc kubenswrapper[5120]: I0316 16:34:47.359625 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c807ead6-beff-4a5b-bf14-c56bf9e4c0f0-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:34:47 crc kubenswrapper[5120]: I0316 16:34:47.365370 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c807ead6-beff-4a5b-bf14-c56bf9e4c0f0-kube-api-access-2sbpp" (OuterVolumeSpecName: "kube-api-access-2sbpp") pod "c807ead6-beff-4a5b-bf14-c56bf9e4c0f0" (UID: "c807ead6-beff-4a5b-bf14-c56bf9e4c0f0"). InnerVolumeSpecName "kube-api-access-2sbpp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:34:47 crc kubenswrapper[5120]: I0316 16:34:47.365521 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c807ead6-beff-4a5b-bf14-c56bf9e4c0f0-scripts" (OuterVolumeSpecName: "scripts") pod "c807ead6-beff-4a5b-bf14-c56bf9e4c0f0" (UID: "c807ead6-beff-4a5b-bf14-c56bf9e4c0f0"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:34:47 crc kubenswrapper[5120]: I0316 16:34:47.371543 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:34:47 crc kubenswrapper[5120]: I0316 16:34:47.390683 5120 scope.go:117] "RemoveContainer" containerID="de5cc50c83c4257da798af24f5eed50af4cdd1e04aaf8625514902b4843fff87" Mar 16 16:34:47 crc kubenswrapper[5120]: I0316 16:34:47.420946 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c807ead6-beff-4a5b-bf14-c56bf9e4c0f0-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "c807ead6-beff-4a5b-bf14-c56bf9e4c0f0" (UID: "c807ead6-beff-4a5b-bf14-c56bf9e4c0f0"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:34:47 crc kubenswrapper[5120]: I0316 16:34:47.425926 5120 scope.go:117] "RemoveContainer" containerID="08aaeb17b6cb85886578bbe37fdaa92cd247c3368ce379e44c23517f30c1ba73" Mar 16 16:34:47 crc kubenswrapper[5120]: I0316 16:34:47.456832 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c807ead6-beff-4a5b-bf14-c56bf9e4c0f0-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "c807ead6-beff-4a5b-bf14-c56bf9e4c0f0" (UID: "c807ead6-beff-4a5b-bf14-c56bf9e4c0f0"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:34:47 crc kubenswrapper[5120]: I0316 16:34:47.461658 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c807ead6-beff-4a5b-bf14-c56bf9e4c0f0-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:34:47 crc kubenswrapper[5120]: I0316 16:34:47.462195 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c807ead6-beff-4a5b-bf14-c56bf9e4c0f0-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:34:47 crc kubenswrapper[5120]: I0316 16:34:47.462292 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/c807ead6-beff-4a5b-bf14-c56bf9e4c0f0-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 16:34:47 crc kubenswrapper[5120]: I0316 16:34:47.462375 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2sbpp\" (UniqueName: \"kubernetes.io/projected/c807ead6-beff-4a5b-bf14-c56bf9e4c0f0-kube-api-access-2sbpp\") on node \"crc\" DevicePath \"\"" Mar 16 16:34:47 crc kubenswrapper[5120]: I0316 16:34:47.463607 5120 scope.go:117] "RemoveContainer" containerID="aa5640a79d727b5cf5c9d7f6c4b8c6df5f7edbbd9f5a893b66ca4830f9b1b628" Mar 16 16:34:47 crc kubenswrapper[5120]: E0316 16:34:47.464164 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa5640a79d727b5cf5c9d7f6c4b8c6df5f7edbbd9f5a893b66ca4830f9b1b628\": container with ID starting with aa5640a79d727b5cf5c9d7f6c4b8c6df5f7edbbd9f5a893b66ca4830f9b1b628 not found: ID does not exist" containerID="aa5640a79d727b5cf5c9d7f6c4b8c6df5f7edbbd9f5a893b66ca4830f9b1b628" Mar 16 16:34:47 crc kubenswrapper[5120]: I0316 16:34:47.464195 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa5640a79d727b5cf5c9d7f6c4b8c6df5f7edbbd9f5a893b66ca4830f9b1b628"} err="failed to get container status \"aa5640a79d727b5cf5c9d7f6c4b8c6df5f7edbbd9f5a893b66ca4830f9b1b628\": rpc error: code = NotFound desc = could not find container \"aa5640a79d727b5cf5c9d7f6c4b8c6df5f7edbbd9f5a893b66ca4830f9b1b628\": container with ID starting with aa5640a79d727b5cf5c9d7f6c4b8c6df5f7edbbd9f5a893b66ca4830f9b1b628 not found: ID does not exist" Mar 16 16:34:47 crc kubenswrapper[5120]: I0316 16:34:47.464214 5120 scope.go:117] "RemoveContainer" containerID="e70da958b40a1214806e2e41be0d1bc42e3a3e588238a1bbc33512f5ddfb1ea8" Mar 16 16:34:47 crc kubenswrapper[5120]: E0316 16:34:47.464460 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e70da958b40a1214806e2e41be0d1bc42e3a3e588238a1bbc33512f5ddfb1ea8\": container with ID starting with e70da958b40a1214806e2e41be0d1bc42e3a3e588238a1bbc33512f5ddfb1ea8 not found: ID does not exist" containerID="e70da958b40a1214806e2e41be0d1bc42e3a3e588238a1bbc33512f5ddfb1ea8" Mar 16 16:34:47 crc kubenswrapper[5120]: I0316 16:34:47.464498 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e70da958b40a1214806e2e41be0d1bc42e3a3e588238a1bbc33512f5ddfb1ea8"} err="failed to get container status \"e70da958b40a1214806e2e41be0d1bc42e3a3e588238a1bbc33512f5ddfb1ea8\": rpc error: code = NotFound desc = could not find container \"e70da958b40a1214806e2e41be0d1bc42e3a3e588238a1bbc33512f5ddfb1ea8\": container with ID starting with e70da958b40a1214806e2e41be0d1bc42e3a3e588238a1bbc33512f5ddfb1ea8 not found: ID does not exist" Mar 16 16:34:47 crc kubenswrapper[5120]: I0316 16:34:47.464523 5120 scope.go:117] "RemoveContainer" containerID="de5cc50c83c4257da798af24f5eed50af4cdd1e04aaf8625514902b4843fff87" Mar 16 16:34:47 crc kubenswrapper[5120]: E0316 16:34:47.464915 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de5cc50c83c4257da798af24f5eed50af4cdd1e04aaf8625514902b4843fff87\": container with ID starting with de5cc50c83c4257da798af24f5eed50af4cdd1e04aaf8625514902b4843fff87 not found: ID does not exist" containerID="de5cc50c83c4257da798af24f5eed50af4cdd1e04aaf8625514902b4843fff87" Mar 16 16:34:47 crc kubenswrapper[5120]: I0316 16:34:47.464936 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de5cc50c83c4257da798af24f5eed50af4cdd1e04aaf8625514902b4843fff87"} err="failed to get container status \"de5cc50c83c4257da798af24f5eed50af4cdd1e04aaf8625514902b4843fff87\": rpc error: code = NotFound desc = could not find container \"de5cc50c83c4257da798af24f5eed50af4cdd1e04aaf8625514902b4843fff87\": container with ID starting with de5cc50c83c4257da798af24f5eed50af4cdd1e04aaf8625514902b4843fff87 not found: ID does not exist" Mar 16 16:34:47 crc kubenswrapper[5120]: I0316 16:34:47.464949 5120 scope.go:117] "RemoveContainer" containerID="08aaeb17b6cb85886578bbe37fdaa92cd247c3368ce379e44c23517f30c1ba73" Mar 16 16:34:47 crc kubenswrapper[5120]: E0316 16:34:47.465240 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"08aaeb17b6cb85886578bbe37fdaa92cd247c3368ce379e44c23517f30c1ba73\": container with ID starting with 08aaeb17b6cb85886578bbe37fdaa92cd247c3368ce379e44c23517f30c1ba73 not found: ID does not exist" containerID="08aaeb17b6cb85886578bbe37fdaa92cd247c3368ce379e44c23517f30c1ba73" Mar 16 16:34:47 crc kubenswrapper[5120]: I0316 16:34:47.465261 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08aaeb17b6cb85886578bbe37fdaa92cd247c3368ce379e44c23517f30c1ba73"} err="failed to get container status \"08aaeb17b6cb85886578bbe37fdaa92cd247c3368ce379e44c23517f30c1ba73\": rpc error: code = NotFound desc = could not find container \"08aaeb17b6cb85886578bbe37fdaa92cd247c3368ce379e44c23517f30c1ba73\": container with ID starting with 08aaeb17b6cb85886578bbe37fdaa92cd247c3368ce379e44c23517f30c1ba73 not found: ID does not exist" Mar 16 16:34:47 crc kubenswrapper[5120]: I0316 16:34:47.500136 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c807ead6-beff-4a5b-bf14-c56bf9e4c0f0-config-data" (OuterVolumeSpecName: "config-data") pod "c807ead6-beff-4a5b-bf14-c56bf9e4c0f0" (UID: "c807ead6-beff-4a5b-bf14-c56bf9e4c0f0"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:34:47 crc kubenswrapper[5120]: I0316 16:34:47.566269 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c807ead6-beff-4a5b-bf14-c56bf9e4c0f0-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:34:47 crc kubenswrapper[5120]: I0316 16:34:47.884002 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:34:47 crc kubenswrapper[5120]: W0316 16:34:47.886279 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7c9566ce_4767_48d0_b606_410f234e9cf2.slice/crio-0c257097cf1710fe8e76fd71e1a50ae1ef3386729944ea929385fe7c496743ba WatchSource:0}: Error finding container 0c257097cf1710fe8e76fd71e1a50ae1ef3386729944ea929385fe7c496743ba: Status 404 returned error can't find the container with id 0c257097cf1710fe8e76fd71e1a50ae1ef3386729944ea929385fe7c496743ba Mar 16 16:34:48 crc kubenswrapper[5120]: I0316 16:34:48.305641 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"7c9566ce-4767-48d0-b606-410f234e9cf2","Type":"ContainerStarted","Data":"c8679e06fbfeaddd2c356f909c632c829f8292eb82529143e243db09bd7464c4"} Mar 16 16:34:48 crc kubenswrapper[5120]: I0316 16:34:48.305692 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"7c9566ce-4767-48d0-b606-410f234e9cf2","Type":"ContainerStarted","Data":"0c257097cf1710fe8e76fd71e1a50ae1ef3386729944ea929385fe7c496743ba"} Mar 16 16:34:48 crc kubenswrapper[5120]: I0316 16:34:48.308962 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"7c83e22b-e8f6-4228-95a3-9874368d9534","Type":"ContainerStarted","Data":"e163ad55192dbc5251d5fc25b1137a1e6ec11964a33c4a5ec18c748abe611356"} Mar 16 16:34:48 crc kubenswrapper[5120]: I0316 16:34:48.308999 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"7c83e22b-e8f6-4228-95a3-9874368d9534","Type":"ContainerStarted","Data":"abde150290ce828331e2e06b6c3eda33f7634800c0fb62b8fb73b6774f0bbfd7"} Mar 16 16:34:48 crc kubenswrapper[5120]: I0316 16:34:48.310993 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:34:48 crc kubenswrapper[5120]: I0316 16:34:48.339025 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-scheduler-0" podStartSLOduration=2.339009011 podStartE2EDuration="2.339009011s" podCreationTimestamp="2026-03-16 16:34:46 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:34:48.32216463 +0000 UTC m=+3790.476096317" watchObservedRunningTime="2026-03-16 16:34:48.339009011 +0000 UTC m=+3790.492940668" Mar 16 16:34:48 crc kubenswrapper[5120]: I0316 16:34:48.358073 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=2.358025039 podStartE2EDuration="2.358025039s" podCreationTimestamp="2026-03-16 16:34:46 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:34:48.349789593 +0000 UTC m=+3790.503721250" watchObservedRunningTime="2026-03-16 16:34:48.358025039 +0000 UTC m=+3790.511956696" Mar 16 16:34:48 crc kubenswrapper[5120]: I0316 16:34:48.395507 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:34:48 crc kubenswrapper[5120]: I0316 16:34:48.411683 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:34:48 crc kubenswrapper[5120]: I0316 16:34:48.423584 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:34:48 crc kubenswrapper[5120]: I0316 16:34:48.428960 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c807ead6-beff-4a5b-bf14-c56bf9e4c0f0" containerName="ceilometer-central-agent" Mar 16 16:34:48 crc kubenswrapper[5120]: I0316 16:34:48.429004 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c807ead6-beff-4a5b-bf14-c56bf9e4c0f0" containerName="ceilometer-central-agent" Mar 16 16:34:48 crc kubenswrapper[5120]: I0316 16:34:48.429020 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c807ead6-beff-4a5b-bf14-c56bf9e4c0f0" containerName="ceilometer-notification-agent" Mar 16 16:34:48 crc kubenswrapper[5120]: I0316 16:34:48.429029 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c807ead6-beff-4a5b-bf14-c56bf9e4c0f0" containerName="ceilometer-notification-agent" Mar 16 16:34:48 crc kubenswrapper[5120]: I0316 16:34:48.429051 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c807ead6-beff-4a5b-bf14-c56bf9e4c0f0" containerName="sg-core" Mar 16 16:34:48 crc kubenswrapper[5120]: I0316 16:34:48.429060 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c807ead6-beff-4a5b-bf14-c56bf9e4c0f0" containerName="sg-core" Mar 16 16:34:48 crc kubenswrapper[5120]: I0316 16:34:48.429082 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c807ead6-beff-4a5b-bf14-c56bf9e4c0f0" containerName="proxy-httpd" Mar 16 16:34:48 crc kubenswrapper[5120]: I0316 16:34:48.429090 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c807ead6-beff-4a5b-bf14-c56bf9e4c0f0" containerName="proxy-httpd" Mar 16 16:34:48 crc kubenswrapper[5120]: I0316 16:34:48.429318 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c807ead6-beff-4a5b-bf14-c56bf9e4c0f0" containerName="ceilometer-central-agent" Mar 16 16:34:48 crc kubenswrapper[5120]: I0316 16:34:48.429341 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c807ead6-beff-4a5b-bf14-c56bf9e4c0f0" containerName="ceilometer-notification-agent" Mar 16 16:34:48 crc kubenswrapper[5120]: I0316 16:34:48.429356 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c807ead6-beff-4a5b-bf14-c56bf9e4c0f0" containerName="proxy-httpd" Mar 16 16:34:48 crc kubenswrapper[5120]: I0316 16:34:48.429375 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c807ead6-beff-4a5b-bf14-c56bf9e4c0f0" containerName="sg-core" Mar 16 16:34:48 crc kubenswrapper[5120]: I0316 16:34:48.437427 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:34:48 crc kubenswrapper[5120]: I0316 16:34:48.437556 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:34:48 crc kubenswrapper[5120]: I0316 16:34:48.441438 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 16:34:48 crc kubenswrapper[5120]: I0316 16:34:48.442177 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ceilometer-internal-svc\"" Mar 16 16:34:48 crc kubenswrapper[5120]: I0316 16:34:48.453441 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 16:34:48 crc kubenswrapper[5120]: I0316 16:34:48.488308 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qxgx\" (UniqueName: \"kubernetes.io/projected/7b38e8f8-9a5c-44cf-a669-05a72b82016e-kube-api-access-8qxgx\") pod \"ceilometer-0\" (UID: \"7b38e8f8-9a5c-44cf-a669-05a72b82016e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:34:48 crc kubenswrapper[5120]: I0316 16:34:48.488508 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/7b38e8f8-9a5c-44cf-a669-05a72b82016e-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"7b38e8f8-9a5c-44cf-a669-05a72b82016e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:34:48 crc kubenswrapper[5120]: I0316 16:34:48.488608 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7b38e8f8-9a5c-44cf-a669-05a72b82016e-run-httpd\") pod \"ceilometer-0\" (UID: \"7b38e8f8-9a5c-44cf-a669-05a72b82016e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:34:48 crc kubenswrapper[5120]: I0316 16:34:48.488803 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7b38e8f8-9a5c-44cf-a669-05a72b82016e-config-data\") pod \"ceilometer-0\" (UID: \"7b38e8f8-9a5c-44cf-a669-05a72b82016e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:34:48 crc kubenswrapper[5120]: I0316 16:34:48.488826 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7b38e8f8-9a5c-44cf-a669-05a72b82016e-log-httpd\") pod \"ceilometer-0\" (UID: \"7b38e8f8-9a5c-44cf-a669-05a72b82016e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:34:48 crc kubenswrapper[5120]: I0316 16:34:48.488970 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/7b38e8f8-9a5c-44cf-a669-05a72b82016e-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"7b38e8f8-9a5c-44cf-a669-05a72b82016e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:34:48 crc kubenswrapper[5120]: I0316 16:34:48.489074 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7b38e8f8-9a5c-44cf-a669-05a72b82016e-scripts\") pod \"ceilometer-0\" (UID: \"7b38e8f8-9a5c-44cf-a669-05a72b82016e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:34:48 crc kubenswrapper[5120]: I0316 16:34:48.489186 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7b38e8f8-9a5c-44cf-a669-05a72b82016e-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"7b38e8f8-9a5c-44cf-a669-05a72b82016e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:34:48 crc kubenswrapper[5120]: I0316 16:34:48.591556 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/7b38e8f8-9a5c-44cf-a669-05a72b82016e-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"7b38e8f8-9a5c-44cf-a669-05a72b82016e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:34:48 crc kubenswrapper[5120]: I0316 16:34:48.592834 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7b38e8f8-9a5c-44cf-a669-05a72b82016e-run-httpd\") pod \"ceilometer-0\" (UID: \"7b38e8f8-9a5c-44cf-a669-05a72b82016e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:34:48 crc kubenswrapper[5120]: I0316 16:34:48.592987 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7b38e8f8-9a5c-44cf-a669-05a72b82016e-config-data\") pod \"ceilometer-0\" (UID: \"7b38e8f8-9a5c-44cf-a669-05a72b82016e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:34:48 crc kubenswrapper[5120]: I0316 16:34:48.593019 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7b38e8f8-9a5c-44cf-a669-05a72b82016e-log-httpd\") pod \"ceilometer-0\" (UID: \"7b38e8f8-9a5c-44cf-a669-05a72b82016e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:34:48 crc kubenswrapper[5120]: I0316 16:34:48.593138 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/7b38e8f8-9a5c-44cf-a669-05a72b82016e-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"7b38e8f8-9a5c-44cf-a669-05a72b82016e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:34:48 crc kubenswrapper[5120]: I0316 16:34:48.593234 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7b38e8f8-9a5c-44cf-a669-05a72b82016e-scripts\") pod \"ceilometer-0\" (UID: \"7b38e8f8-9a5c-44cf-a669-05a72b82016e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:34:48 crc kubenswrapper[5120]: I0316 16:34:48.593251 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7b38e8f8-9a5c-44cf-a669-05a72b82016e-run-httpd\") pod \"ceilometer-0\" (UID: \"7b38e8f8-9a5c-44cf-a669-05a72b82016e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:34:48 crc kubenswrapper[5120]: I0316 16:34:48.593356 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7b38e8f8-9a5c-44cf-a669-05a72b82016e-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"7b38e8f8-9a5c-44cf-a669-05a72b82016e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:34:48 crc kubenswrapper[5120]: I0316 16:34:48.593470 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8qxgx\" (UniqueName: \"kubernetes.io/projected/7b38e8f8-9a5c-44cf-a669-05a72b82016e-kube-api-access-8qxgx\") pod \"ceilometer-0\" (UID: \"7b38e8f8-9a5c-44cf-a669-05a72b82016e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:34:48 crc kubenswrapper[5120]: I0316 16:34:48.593814 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7b38e8f8-9a5c-44cf-a669-05a72b82016e-log-httpd\") pod \"ceilometer-0\" (UID: \"7b38e8f8-9a5c-44cf-a669-05a72b82016e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:34:48 crc kubenswrapper[5120]: I0316 16:34:48.601144 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7b38e8f8-9a5c-44cf-a669-05a72b82016e-config-data\") pod \"ceilometer-0\" (UID: \"7b38e8f8-9a5c-44cf-a669-05a72b82016e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:34:48 crc kubenswrapper[5120]: I0316 16:34:48.601138 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7b38e8f8-9a5c-44cf-a669-05a72b82016e-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"7b38e8f8-9a5c-44cf-a669-05a72b82016e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:34:48 crc kubenswrapper[5120]: I0316 16:34:48.601678 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7b38e8f8-9a5c-44cf-a669-05a72b82016e-scripts\") pod \"ceilometer-0\" (UID: \"7b38e8f8-9a5c-44cf-a669-05a72b82016e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:34:48 crc kubenswrapper[5120]: I0316 16:34:48.604147 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/7b38e8f8-9a5c-44cf-a669-05a72b82016e-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"7b38e8f8-9a5c-44cf-a669-05a72b82016e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:34:48 crc kubenswrapper[5120]: I0316 16:34:48.604152 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/7b38e8f8-9a5c-44cf-a669-05a72b82016e-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"7b38e8f8-9a5c-44cf-a669-05a72b82016e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:34:48 crc kubenswrapper[5120]: I0316 16:34:48.614345 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qxgx\" (UniqueName: \"kubernetes.io/projected/7b38e8f8-9a5c-44cf-a669-05a72b82016e-kube-api-access-8qxgx\") pod \"ceilometer-0\" (UID: \"7b38e8f8-9a5c-44cf-a669-05a72b82016e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:34:48 crc kubenswrapper[5120]: I0316 16:34:48.679208 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b171fb9-014c-41df-a05b-d2d376d8d507" path="/var/lib/kubelet/pods/2b171fb9-014c-41df-a05b-d2d376d8d507/volumes" Mar 16 16:34:48 crc kubenswrapper[5120]: I0316 16:34:48.680433 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c807ead6-beff-4a5b-bf14-c56bf9e4c0f0" path="/var/lib/kubelet/pods/c807ead6-beff-4a5b-bf14-c56bf9e4c0f0/volumes" Mar 16 16:34:48 crc kubenswrapper[5120]: I0316 16:34:48.759238 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:34:49 crc kubenswrapper[5120]: W0316 16:34:49.279776 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7b38e8f8_9a5c_44cf_a669_05a72b82016e.slice/crio-c91b8d7fa4f65d42b697e7e4698fd6e28d9e0d473429d1abc32d7fa685598f62 WatchSource:0}: Error finding container c91b8d7fa4f65d42b697e7e4698fd6e28d9e0d473429d1abc32d7fa685598f62: Status 404 returned error can't find the container with id c91b8d7fa4f65d42b697e7e4698fd6e28d9e0d473429d1abc32d7fa685598f62 Mar 16 16:34:49 crc kubenswrapper[5120]: I0316 16:34:49.280535 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:34:49 crc kubenswrapper[5120]: I0316 16:34:49.325520 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7b38e8f8-9a5c-44cf-a669-05a72b82016e","Type":"ContainerStarted","Data":"c91b8d7fa4f65d42b697e7e4698fd6e28d9e0d473429d1abc32d7fa685598f62"} Mar 16 16:34:50 crc kubenswrapper[5120]: I0316 16:34:50.336895 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7b38e8f8-9a5c-44cf-a669-05a72b82016e","Type":"ContainerStarted","Data":"4e99a3d07bc6bfb3cb70caf9801fab9a29006cd96d5ed4a662af92bb1073a5fc"} Mar 16 16:34:51 crc kubenswrapper[5120]: I0316 16:34:51.350530 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7b38e8f8-9a5c-44cf-a669-05a72b82016e","Type":"ContainerStarted","Data":"a2b06387edafca72d782988355b666eebd24106c6f8c480d012554a07ca97456"} Mar 16 16:34:52 crc kubenswrapper[5120]: I0316 16:34:52.364095 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7b38e8f8-9a5c-44cf-a669-05a72b82016e","Type":"ContainerStarted","Data":"f15898f46022785566aca1fbc6fe9d1ebda61a2866ebe4ad1792f99889955e5f"} Mar 16 16:34:52 crc kubenswrapper[5120]: I0316 16:34:52.372029 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:34:52 crc kubenswrapper[5120]: I0316 16:34:52.664208 5120 scope.go:117] "RemoveContainer" containerID="0a15d5caff30dc8885f782e59962af7d98d58b39ab76059e56e5827e10e7ab8b" Mar 16 16:34:52 crc kubenswrapper[5120]: E0316 16:34:52.664806 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:34:54 crc kubenswrapper[5120]: I0316 16:34:54.387997 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7b38e8f8-9a5c-44cf-a669-05a72b82016e","Type":"ContainerStarted","Data":"e1462a04dbca719734f0d0cc403523964424e8b3be5667c8618131b452e44a65"} Mar 16 16:34:54 crc kubenswrapper[5120]: I0316 16:34:54.388605 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:34:54 crc kubenswrapper[5120]: I0316 16:34:54.416815 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=1.985030678 podStartE2EDuration="6.416795703s" podCreationTimestamp="2026-03-16 16:34:48 +0000 UTC" firstStartedPulling="2026-03-16 16:34:49.282438465 +0000 UTC m=+3791.436370122" lastFinishedPulling="2026-03-16 16:34:53.71420349 +0000 UTC m=+3795.868135147" observedRunningTime="2026-03-16 16:34:54.414200015 +0000 UTC m=+3796.568131682" watchObservedRunningTime="2026-03-16 16:34:54.416795703 +0000 UTC m=+3796.570727360" Mar 16 16:34:54 crc kubenswrapper[5120]: I0316 16:34:54.639723 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:34:54 crc kubenswrapper[5120]: I0316 16:34:54.639793 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:34:55 crc kubenswrapper[5120]: I0316 16:34:55.680941 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="eadb9039-baf8-429d-82ea-01531fd18a12" containerName="nova-api-api" probeResult="failure" output="Get \"http://10.217.0.197:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 16:34:55 crc kubenswrapper[5120]: I0316 16:34:55.680957 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="eadb9039-baf8-429d-82ea-01531fd18a12" containerName="nova-api-log" probeResult="failure" output="Get \"http://10.217.0.197:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 16:34:56 crc kubenswrapper[5120]: I0316 16:34:56.284291 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:34:56 crc kubenswrapper[5120]: I0316 16:34:56.723994 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:34:56 crc kubenswrapper[5120]: I0316 16:34:56.724066 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:34:57 crc kubenswrapper[5120]: I0316 16:34:57.369411 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/community-operators-d6kwz"] Mar 16 16:34:57 crc kubenswrapper[5120]: I0316 16:34:57.390798 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/community-operators-d6kwz"] Mar 16 16:34:57 crc kubenswrapper[5120]: I0316 16:34:57.390849 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:34:57 crc kubenswrapper[5120]: I0316 16:34:57.391332 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-d6kwz" Mar 16 16:34:57 crc kubenswrapper[5120]: I0316 16:34:57.421856 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:34:57 crc kubenswrapper[5120]: I0316 16:34:57.471508 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:34:57 crc kubenswrapper[5120]: I0316 16:34:57.539532 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/174340db-fc47-45b2-a03e-864610c3d398-utilities\") pod \"community-operators-d6kwz\" (UID: \"174340db-fc47-45b2-a03e-864610c3d398\") " pod="openshift-marketplace/community-operators-d6kwz" Mar 16 16:34:57 crc kubenswrapper[5120]: I0316 16:34:57.539617 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/174340db-fc47-45b2-a03e-864610c3d398-catalog-content\") pod \"community-operators-d6kwz\" (UID: \"174340db-fc47-45b2-a03e-864610c3d398\") " pod="openshift-marketplace/community-operators-d6kwz" Mar 16 16:34:57 crc kubenswrapper[5120]: I0316 16:34:57.539667 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mlh2\" (UniqueName: \"kubernetes.io/projected/174340db-fc47-45b2-a03e-864610c3d398-kube-api-access-8mlh2\") pod \"community-operators-d6kwz\" (UID: \"174340db-fc47-45b2-a03e-864610c3d398\") " pod="openshift-marketplace/community-operators-d6kwz" Mar 16 16:34:57 crc kubenswrapper[5120]: I0316 16:34:57.642708 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/174340db-fc47-45b2-a03e-864610c3d398-utilities\") pod \"community-operators-d6kwz\" (UID: \"174340db-fc47-45b2-a03e-864610c3d398\") " pod="openshift-marketplace/community-operators-d6kwz" Mar 16 16:34:57 crc kubenswrapper[5120]: I0316 16:34:57.642791 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/174340db-fc47-45b2-a03e-864610c3d398-catalog-content\") pod \"community-operators-d6kwz\" (UID: \"174340db-fc47-45b2-a03e-864610c3d398\") " pod="openshift-marketplace/community-operators-d6kwz" Mar 16 16:34:57 crc kubenswrapper[5120]: I0316 16:34:57.642830 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8mlh2\" (UniqueName: \"kubernetes.io/projected/174340db-fc47-45b2-a03e-864610c3d398-kube-api-access-8mlh2\") pod \"community-operators-d6kwz\" (UID: \"174340db-fc47-45b2-a03e-864610c3d398\") " pod="openshift-marketplace/community-operators-d6kwz" Mar 16 16:34:57 crc kubenswrapper[5120]: I0316 16:34:57.643848 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/174340db-fc47-45b2-a03e-864610c3d398-utilities\") pod \"community-operators-d6kwz\" (UID: \"174340db-fc47-45b2-a03e-864610c3d398\") " pod="openshift-marketplace/community-operators-d6kwz" Mar 16 16:34:57 crc kubenswrapper[5120]: I0316 16:34:57.643904 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/174340db-fc47-45b2-a03e-864610c3d398-catalog-content\") pod \"community-operators-d6kwz\" (UID: \"174340db-fc47-45b2-a03e-864610c3d398\") " pod="openshift-marketplace/community-operators-d6kwz" Mar 16 16:34:57 crc kubenswrapper[5120]: I0316 16:34:57.666359 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mlh2\" (UniqueName: \"kubernetes.io/projected/174340db-fc47-45b2-a03e-864610c3d398-kube-api-access-8mlh2\") pod \"community-operators-d6kwz\" (UID: \"174340db-fc47-45b2-a03e-864610c3d398\") " pod="openshift-marketplace/community-operators-d6kwz" Mar 16 16:34:57 crc kubenswrapper[5120]: I0316 16:34:57.720033 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-d6kwz" Mar 16 16:34:57 crc kubenswrapper[5120]: I0316 16:34:57.730003 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="7c83e22b-e8f6-4228-95a3-9874368d9534" containerName="nova-metadata-log" probeResult="failure" output="Get \"https://10.217.0.198:8775/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 16:34:57 crc kubenswrapper[5120]: I0316 16:34:57.731781 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="7c83e22b-e8f6-4228-95a3-9874368d9534" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"https://10.217.0.198:8775/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 16:34:58 crc kubenswrapper[5120]: I0316 16:34:58.272253 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/community-operators-d6kwz"] Mar 16 16:34:58 crc kubenswrapper[5120]: I0316 16:34:58.440610 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-d6kwz" event={"ID":"174340db-fc47-45b2-a03e-864610c3d398","Type":"ContainerStarted","Data":"165ce0a7cc5574dfe4a37fa313938f80f53895e8f312d378ccae9bf0ec2339cf"} Mar 16 16:34:59 crc kubenswrapper[5120]: I0316 16:34:59.452582 5120 generic.go:358] "Generic (PLEG): container finished" podID="174340db-fc47-45b2-a03e-864610c3d398" containerID="646d780d5965737f10ee5a57afc7d18262ff45c2639455c492cab76ebd9cc2e6" exitCode=0 Mar 16 16:34:59 crc kubenswrapper[5120]: I0316 16:34:59.452955 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-d6kwz" event={"ID":"174340db-fc47-45b2-a03e-864610c3d398","Type":"ContainerDied","Data":"646d780d5965737f10ee5a57afc7d18262ff45c2639455c492cab76ebd9cc2e6"} Mar 16 16:35:00 crc kubenswrapper[5120]: I0316 16:35:00.464196 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-d6kwz" event={"ID":"174340db-fc47-45b2-a03e-864610c3d398","Type":"ContainerStarted","Data":"92bc6f62f93514ec6d87f72695000ad8c3d02b48071f13a8f9658b31bc1b7e14"} Mar 16 16:35:02 crc kubenswrapper[5120]: I0316 16:35:02.639193 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:35:02 crc kubenswrapper[5120]: I0316 16:35:02.639551 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:35:04 crc kubenswrapper[5120]: I0316 16:35:04.503419 5120 generic.go:358] "Generic (PLEG): container finished" podID="174340db-fc47-45b2-a03e-864610c3d398" containerID="92bc6f62f93514ec6d87f72695000ad8c3d02b48071f13a8f9658b31bc1b7e14" exitCode=0 Mar 16 16:35:04 crc kubenswrapper[5120]: I0316 16:35:04.503748 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-d6kwz" event={"ID":"174340db-fc47-45b2-a03e-864610c3d398","Type":"ContainerDied","Data":"92bc6f62f93514ec6d87f72695000ad8c3d02b48071f13a8f9658b31bc1b7e14"} Mar 16 16:35:04 crc kubenswrapper[5120]: I0316 16:35:04.642544 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:35:04 crc kubenswrapper[5120]: I0316 16:35:04.644157 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:35:04 crc kubenswrapper[5120]: I0316 16:35:04.647124 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:35:04 crc kubenswrapper[5120]: I0316 16:35:04.724047 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:35:04 crc kubenswrapper[5120]: I0316 16:35:04.724104 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:35:05 crc kubenswrapper[5120]: I0316 16:35:05.545741 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-d6kwz" event={"ID":"174340db-fc47-45b2-a03e-864610c3d398","Type":"ContainerStarted","Data":"5d90aba53d1460bb21e5b28b4ca3090caa7ff9afdca620b736cd6b3a84b6ed2e"} Mar 16 16:35:05 crc kubenswrapper[5120]: I0316 16:35:05.553196 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:35:05 crc kubenswrapper[5120]: I0316 16:35:05.570912 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/community-operators-d6kwz" podStartSLOduration=7.958716936 podStartE2EDuration="8.570892013s" podCreationTimestamp="2026-03-16 16:34:57 +0000 UTC" firstStartedPulling="2026-03-16 16:34:59.454122572 +0000 UTC m=+3801.608054229" lastFinishedPulling="2026-03-16 16:35:00.066297649 +0000 UTC m=+3802.220229306" observedRunningTime="2026-03-16 16:35:05.561319283 +0000 UTC m=+3807.715250940" watchObservedRunningTime="2026-03-16 16:35:05.570892013 +0000 UTC m=+3807.724823660" Mar 16 16:35:05 crc kubenswrapper[5120]: I0316 16:35:05.668275 5120 scope.go:117] "RemoveContainer" containerID="0a15d5caff30dc8885f782e59962af7d98d58b39ab76059e56e5827e10e7ab8b" Mar 16 16:35:05 crc kubenswrapper[5120]: E0316 16:35:05.668673 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:35:06 crc kubenswrapper[5120]: I0316 16:35:06.752046 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:35:06 crc kubenswrapper[5120]: I0316 16:35:06.752521 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:35:06 crc kubenswrapper[5120]: I0316 16:35:06.759548 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:35:06 crc kubenswrapper[5120]: I0316 16:35:06.764243 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:35:07 crc kubenswrapper[5120]: I0316 16:35:07.720851 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-marketplace/community-operators-d6kwz" Mar 16 16:35:07 crc kubenswrapper[5120]: I0316 16:35:07.721203 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/community-operators-d6kwz" Mar 16 16:35:07 crc kubenswrapper[5120]: I0316 16:35:07.776582 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/community-operators-d6kwz" Mar 16 16:35:07 crc kubenswrapper[5120]: I0316 16:35:07.836931 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:35:07 crc kubenswrapper[5120]: I0316 16:35:07.837466 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="7b38e8f8-9a5c-44cf-a669-05a72b82016e" containerName="ceilometer-central-agent" containerID="cri-o://4e99a3d07bc6bfb3cb70caf9801fab9a29006cd96d5ed4a662af92bb1073a5fc" gracePeriod=30 Mar 16 16:35:07 crc kubenswrapper[5120]: I0316 16:35:07.837621 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="7b38e8f8-9a5c-44cf-a669-05a72b82016e" containerName="ceilometer-notification-agent" containerID="cri-o://a2b06387edafca72d782988355b666eebd24106c6f8c480d012554a07ca97456" gracePeriod=30 Mar 16 16:35:07 crc kubenswrapper[5120]: I0316 16:35:07.837599 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="7b38e8f8-9a5c-44cf-a669-05a72b82016e" containerName="sg-core" containerID="cri-o://f15898f46022785566aca1fbc6fe9d1ebda61a2866ebe4ad1792f99889955e5f" gracePeriod=30 Mar 16 16:35:07 crc kubenswrapper[5120]: I0316 16:35:07.839277 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="7b38e8f8-9a5c-44cf-a669-05a72b82016e" containerName="proxy-httpd" containerID="cri-o://e1462a04dbca719734f0d0cc403523964424e8b3be5667c8618131b452e44a65" gracePeriod=30 Mar 16 16:35:07 crc kubenswrapper[5120]: I0316 16:35:07.847103 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/ceilometer-0" podUID="7b38e8f8-9a5c-44cf-a669-05a72b82016e" containerName="proxy-httpd" probeResult="failure" output="Get \"https://10.217.0.200:3000/\": EOF" Mar 16 16:35:08 crc kubenswrapper[5120]: E0316 16:35:08.561661 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1899232 actualBytes=10240 Mar 16 16:35:08 crc kubenswrapper[5120]: I0316 16:35:08.591269 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:35:08 crc kubenswrapper[5120]: I0316 16:35:08.626743 5120 generic.go:358] "Generic (PLEG): container finished" podID="7b38e8f8-9a5c-44cf-a669-05a72b82016e" containerID="e1462a04dbca719734f0d0cc403523964424e8b3be5667c8618131b452e44a65" exitCode=0 Mar 16 16:35:08 crc kubenswrapper[5120]: I0316 16:35:08.626811 5120 generic.go:358] "Generic (PLEG): container finished" podID="7b38e8f8-9a5c-44cf-a669-05a72b82016e" containerID="f15898f46022785566aca1fbc6fe9d1ebda61a2866ebe4ad1792f99889955e5f" exitCode=2 Mar 16 16:35:08 crc kubenswrapper[5120]: I0316 16:35:08.626820 5120 generic.go:358] "Generic (PLEG): container finished" podID="7b38e8f8-9a5c-44cf-a669-05a72b82016e" containerID="a2b06387edafca72d782988355b666eebd24106c6f8c480d012554a07ca97456" exitCode=0 Mar 16 16:35:08 crc kubenswrapper[5120]: I0316 16:35:08.626838 5120 generic.go:358] "Generic (PLEG): container finished" podID="7b38e8f8-9a5c-44cf-a669-05a72b82016e" containerID="4e99a3d07bc6bfb3cb70caf9801fab9a29006cd96d5ed4a662af92bb1073a5fc" exitCode=0 Mar 16 16:35:08 crc kubenswrapper[5120]: I0316 16:35:08.627170 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7b38e8f8-9a5c-44cf-a669-05a72b82016e","Type":"ContainerDied","Data":"e1462a04dbca719734f0d0cc403523964424e8b3be5667c8618131b452e44a65"} Mar 16 16:35:08 crc kubenswrapper[5120]: I0316 16:35:08.627236 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7b38e8f8-9a5c-44cf-a669-05a72b82016e","Type":"ContainerDied","Data":"f15898f46022785566aca1fbc6fe9d1ebda61a2866ebe4ad1792f99889955e5f"} Mar 16 16:35:08 crc kubenswrapper[5120]: I0316 16:35:08.627249 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7b38e8f8-9a5c-44cf-a669-05a72b82016e","Type":"ContainerDied","Data":"a2b06387edafca72d782988355b666eebd24106c6f8c480d012554a07ca97456"} Mar 16 16:35:08 crc kubenswrapper[5120]: I0316 16:35:08.627262 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7b38e8f8-9a5c-44cf-a669-05a72b82016e","Type":"ContainerDied","Data":"4e99a3d07bc6bfb3cb70caf9801fab9a29006cd96d5ed4a662af92bb1073a5fc"} Mar 16 16:35:08 crc kubenswrapper[5120]: I0316 16:35:08.628168 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="eadb9039-baf8-429d-82ea-01531fd18a12" containerName="nova-api-log" containerID="cri-o://25f0942b159beec776bb0914c8098eb2d0ae06cb5b289de798b8ab5b3d16d583" gracePeriod=30 Mar 16 16:35:08 crc kubenswrapper[5120]: I0316 16:35:08.628286 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="eadb9039-baf8-429d-82ea-01531fd18a12" containerName="nova-api-api" containerID="cri-o://7320aef7bfb81dca07022c118df9073ea5d0e46d810717a31309609d525979de" gracePeriod=30 Mar 16 16:35:08 crc kubenswrapper[5120]: I0316 16:35:08.828087 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:35:08 crc kubenswrapper[5120]: I0316 16:35:08.898792 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7b38e8f8-9a5c-44cf-a669-05a72b82016e-combined-ca-bundle\") pod \"7b38e8f8-9a5c-44cf-a669-05a72b82016e\" (UID: \"7b38e8f8-9a5c-44cf-a669-05a72b82016e\") " Mar 16 16:35:08 crc kubenswrapper[5120]: I0316 16:35:08.898864 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7b38e8f8-9a5c-44cf-a669-05a72b82016e-config-data\") pod \"7b38e8f8-9a5c-44cf-a669-05a72b82016e\" (UID: \"7b38e8f8-9a5c-44cf-a669-05a72b82016e\") " Mar 16 16:35:08 crc kubenswrapper[5120]: I0316 16:35:08.898889 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7b38e8f8-9a5c-44cf-a669-05a72b82016e-scripts\") pod \"7b38e8f8-9a5c-44cf-a669-05a72b82016e\" (UID: \"7b38e8f8-9a5c-44cf-a669-05a72b82016e\") " Mar 16 16:35:08 crc kubenswrapper[5120]: I0316 16:35:08.899074 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7b38e8f8-9a5c-44cf-a669-05a72b82016e-log-httpd\") pod \"7b38e8f8-9a5c-44cf-a669-05a72b82016e\" (UID: \"7b38e8f8-9a5c-44cf-a669-05a72b82016e\") " Mar 16 16:35:08 crc kubenswrapper[5120]: I0316 16:35:08.899373 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7b38e8f8-9a5c-44cf-a669-05a72b82016e-run-httpd\") pod \"7b38e8f8-9a5c-44cf-a669-05a72b82016e\" (UID: \"7b38e8f8-9a5c-44cf-a669-05a72b82016e\") " Mar 16 16:35:08 crc kubenswrapper[5120]: I0316 16:35:08.899415 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8qxgx\" (UniqueName: \"kubernetes.io/projected/7b38e8f8-9a5c-44cf-a669-05a72b82016e-kube-api-access-8qxgx\") pod \"7b38e8f8-9a5c-44cf-a669-05a72b82016e\" (UID: \"7b38e8f8-9a5c-44cf-a669-05a72b82016e\") " Mar 16 16:35:08 crc kubenswrapper[5120]: I0316 16:35:08.899583 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/7b38e8f8-9a5c-44cf-a669-05a72b82016e-ceilometer-tls-certs\") pod \"7b38e8f8-9a5c-44cf-a669-05a72b82016e\" (UID: \"7b38e8f8-9a5c-44cf-a669-05a72b82016e\") " Mar 16 16:35:08 crc kubenswrapper[5120]: I0316 16:35:08.899663 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/7b38e8f8-9a5c-44cf-a669-05a72b82016e-sg-core-conf-yaml\") pod \"7b38e8f8-9a5c-44cf-a669-05a72b82016e\" (UID: \"7b38e8f8-9a5c-44cf-a669-05a72b82016e\") " Mar 16 16:35:08 crc kubenswrapper[5120]: I0316 16:35:08.912569 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b38e8f8-9a5c-44cf-a669-05a72b82016e-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "7b38e8f8-9a5c-44cf-a669-05a72b82016e" (UID: "7b38e8f8-9a5c-44cf-a669-05a72b82016e"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:35:08 crc kubenswrapper[5120]: I0316 16:35:08.912925 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b38e8f8-9a5c-44cf-a669-05a72b82016e-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "7b38e8f8-9a5c-44cf-a669-05a72b82016e" (UID: "7b38e8f8-9a5c-44cf-a669-05a72b82016e"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:35:08 crc kubenswrapper[5120]: I0316 16:35:08.932054 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b38e8f8-9a5c-44cf-a669-05a72b82016e-scripts" (OuterVolumeSpecName: "scripts") pod "7b38e8f8-9a5c-44cf-a669-05a72b82016e" (UID: "7b38e8f8-9a5c-44cf-a669-05a72b82016e"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:35:08 crc kubenswrapper[5120]: I0316 16:35:08.937533 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b38e8f8-9a5c-44cf-a669-05a72b82016e-kube-api-access-8qxgx" (OuterVolumeSpecName: "kube-api-access-8qxgx") pod "7b38e8f8-9a5c-44cf-a669-05a72b82016e" (UID: "7b38e8f8-9a5c-44cf-a669-05a72b82016e"). InnerVolumeSpecName "kube-api-access-8qxgx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:35:09 crc kubenswrapper[5120]: I0316 16:35:09.012675 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7b38e8f8-9a5c-44cf-a669-05a72b82016e-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:35:09 crc kubenswrapper[5120]: I0316 16:35:09.012720 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7b38e8f8-9a5c-44cf-a669-05a72b82016e-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:35:09 crc kubenswrapper[5120]: I0316 16:35:09.012733 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7b38e8f8-9a5c-44cf-a669-05a72b82016e-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:35:09 crc kubenswrapper[5120]: I0316 16:35:09.012745 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8qxgx\" (UniqueName: \"kubernetes.io/projected/7b38e8f8-9a5c-44cf-a669-05a72b82016e-kube-api-access-8qxgx\") on node \"crc\" DevicePath \"\"" Mar 16 16:35:09 crc kubenswrapper[5120]: I0316 16:35:09.032417 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b38e8f8-9a5c-44cf-a669-05a72b82016e-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "7b38e8f8-9a5c-44cf-a669-05a72b82016e" (UID: "7b38e8f8-9a5c-44cf-a669-05a72b82016e"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:35:09 crc kubenswrapper[5120]: I0316 16:35:09.069240 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b38e8f8-9a5c-44cf-a669-05a72b82016e-ceilometer-tls-certs" (OuterVolumeSpecName: "ceilometer-tls-certs") pod "7b38e8f8-9a5c-44cf-a669-05a72b82016e" (UID: "7b38e8f8-9a5c-44cf-a669-05a72b82016e"). InnerVolumeSpecName "ceilometer-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:35:09 crc kubenswrapper[5120]: I0316 16:35:09.109119 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b38e8f8-9a5c-44cf-a669-05a72b82016e-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "7b38e8f8-9a5c-44cf-a669-05a72b82016e" (UID: "7b38e8f8-9a5c-44cf-a669-05a72b82016e"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:35:09 crc kubenswrapper[5120]: I0316 16:35:09.114550 5120 reconciler_common.go:299] "Volume detached for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/7b38e8f8-9a5c-44cf-a669-05a72b82016e-ceilometer-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:35:09 crc kubenswrapper[5120]: I0316 16:35:09.114585 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/7b38e8f8-9a5c-44cf-a669-05a72b82016e-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 16:35:09 crc kubenswrapper[5120]: I0316 16:35:09.114595 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7b38e8f8-9a5c-44cf-a669-05a72b82016e-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:35:09 crc kubenswrapper[5120]: I0316 16:35:09.139206 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b38e8f8-9a5c-44cf-a669-05a72b82016e-config-data" (OuterVolumeSpecName: "config-data") pod "7b38e8f8-9a5c-44cf-a669-05a72b82016e" (UID: "7b38e8f8-9a5c-44cf-a669-05a72b82016e"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:35:09 crc kubenswrapper[5120]: I0316 16:35:09.217428 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7b38e8f8-9a5c-44cf-a669-05a72b82016e-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:35:09 crc kubenswrapper[5120]: I0316 16:35:09.642306 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7b38e8f8-9a5c-44cf-a669-05a72b82016e","Type":"ContainerDied","Data":"c91b8d7fa4f65d42b697e7e4698fd6e28d9e0d473429d1abc32d7fa685598f62"} Mar 16 16:35:09 crc kubenswrapper[5120]: I0316 16:35:09.642326 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:35:09 crc kubenswrapper[5120]: I0316 16:35:09.642380 5120 scope.go:117] "RemoveContainer" containerID="e1462a04dbca719734f0d0cc403523964424e8b3be5667c8618131b452e44a65" Mar 16 16:35:09 crc kubenswrapper[5120]: I0316 16:35:09.647119 5120 generic.go:358] "Generic (PLEG): container finished" podID="eadb9039-baf8-429d-82ea-01531fd18a12" containerID="25f0942b159beec776bb0914c8098eb2d0ae06cb5b289de798b8ab5b3d16d583" exitCode=143 Mar 16 16:35:09 crc kubenswrapper[5120]: I0316 16:35:09.648011 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"eadb9039-baf8-429d-82ea-01531fd18a12","Type":"ContainerDied","Data":"25f0942b159beec776bb0914c8098eb2d0ae06cb5b289de798b8ab5b3d16d583"} Mar 16 16:35:09 crc kubenswrapper[5120]: I0316 16:35:09.666553 5120 scope.go:117] "RemoveContainer" containerID="f15898f46022785566aca1fbc6fe9d1ebda61a2866ebe4ad1792f99889955e5f" Mar 16 16:35:09 crc kubenswrapper[5120]: I0316 16:35:09.685222 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:35:09 crc kubenswrapper[5120]: I0316 16:35:09.697277 5120 scope.go:117] "RemoveContainer" containerID="a2b06387edafca72d782988355b666eebd24106c6f8c480d012554a07ca97456" Mar 16 16:35:09 crc kubenswrapper[5120]: I0316 16:35:09.698154 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:35:09 crc kubenswrapper[5120]: I0316 16:35:09.713314 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:35:09 crc kubenswrapper[5120]: I0316 16:35:09.715099 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b38e8f8-9a5c-44cf-a669-05a72b82016e" containerName="ceilometer-central-agent" Mar 16 16:35:09 crc kubenswrapper[5120]: I0316 16:35:09.715119 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b38e8f8-9a5c-44cf-a669-05a72b82016e" containerName="ceilometer-central-agent" Mar 16 16:35:09 crc kubenswrapper[5120]: I0316 16:35:09.715177 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b38e8f8-9a5c-44cf-a669-05a72b82016e" containerName="proxy-httpd" Mar 16 16:35:09 crc kubenswrapper[5120]: I0316 16:35:09.715185 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b38e8f8-9a5c-44cf-a669-05a72b82016e" containerName="proxy-httpd" Mar 16 16:35:09 crc kubenswrapper[5120]: I0316 16:35:09.715211 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b38e8f8-9a5c-44cf-a669-05a72b82016e" containerName="sg-core" Mar 16 16:35:09 crc kubenswrapper[5120]: I0316 16:35:09.715219 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b38e8f8-9a5c-44cf-a669-05a72b82016e" containerName="sg-core" Mar 16 16:35:09 crc kubenswrapper[5120]: I0316 16:35:09.715244 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b38e8f8-9a5c-44cf-a669-05a72b82016e" containerName="ceilometer-notification-agent" Mar 16 16:35:09 crc kubenswrapper[5120]: I0316 16:35:09.715252 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b38e8f8-9a5c-44cf-a669-05a72b82016e" containerName="ceilometer-notification-agent" Mar 16 16:35:09 crc kubenswrapper[5120]: I0316 16:35:09.715475 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7b38e8f8-9a5c-44cf-a669-05a72b82016e" containerName="ceilometer-central-agent" Mar 16 16:35:09 crc kubenswrapper[5120]: I0316 16:35:09.715491 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7b38e8f8-9a5c-44cf-a669-05a72b82016e" containerName="proxy-httpd" Mar 16 16:35:09 crc kubenswrapper[5120]: I0316 16:35:09.715508 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7b38e8f8-9a5c-44cf-a669-05a72b82016e" containerName="sg-core" Mar 16 16:35:09 crc kubenswrapper[5120]: I0316 16:35:09.715530 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7b38e8f8-9a5c-44cf-a669-05a72b82016e" containerName="ceilometer-notification-agent" Mar 16 16:35:09 crc kubenswrapper[5120]: I0316 16:35:09.740720 5120 scope.go:117] "RemoveContainer" containerID="4e99a3d07bc6bfb3cb70caf9801fab9a29006cd96d5ed4a662af92bb1073a5fc" Mar 16 16:35:09 crc kubenswrapper[5120]: I0316 16:35:09.743330 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/community-operators-d6kwz" Mar 16 16:35:09 crc kubenswrapper[5120]: I0316 16:35:09.743363 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:35:09 crc kubenswrapper[5120]: I0316 16:35:09.743463 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:35:09 crc kubenswrapper[5120]: I0316 16:35:09.747001 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 16:35:09 crc kubenswrapper[5120]: I0316 16:35:09.747184 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 16:35:09 crc kubenswrapper[5120]: I0316 16:35:09.748710 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ceilometer-internal-svc\"" Mar 16 16:35:09 crc kubenswrapper[5120]: I0316 16:35:09.817372 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/community-operators-d6kwz"] Mar 16 16:35:09 crc kubenswrapper[5120]: I0316 16:35:09.832423 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1b4d71ef-4a0e-4e99-8cf4-c541830d7379-scripts\") pod \"ceilometer-0\" (UID: \"1b4d71ef-4a0e-4e99-8cf4-c541830d7379\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:35:09 crc kubenswrapper[5120]: I0316 16:35:09.832814 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1b4d71ef-4a0e-4e99-8cf4-c541830d7379-config-data\") pod \"ceilometer-0\" (UID: \"1b4d71ef-4a0e-4e99-8cf4-c541830d7379\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:35:09 crc kubenswrapper[5120]: I0316 16:35:09.832951 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1b4d71ef-4a0e-4e99-8cf4-c541830d7379-log-httpd\") pod \"ceilometer-0\" (UID: \"1b4d71ef-4a0e-4e99-8cf4-c541830d7379\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:35:09 crc kubenswrapper[5120]: I0316 16:35:09.833120 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/1b4d71ef-4a0e-4e99-8cf4-c541830d7379-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"1b4d71ef-4a0e-4e99-8cf4-c541830d7379\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:35:09 crc kubenswrapper[5120]: I0316 16:35:09.833248 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1b4d71ef-4a0e-4e99-8cf4-c541830d7379-run-httpd\") pod \"ceilometer-0\" (UID: \"1b4d71ef-4a0e-4e99-8cf4-c541830d7379\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:35:09 crc kubenswrapper[5120]: I0316 16:35:09.833474 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1b4d71ef-4a0e-4e99-8cf4-c541830d7379-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"1b4d71ef-4a0e-4e99-8cf4-c541830d7379\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:35:09 crc kubenswrapper[5120]: I0316 16:35:09.833523 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/1b4d71ef-4a0e-4e99-8cf4-c541830d7379-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"1b4d71ef-4a0e-4e99-8cf4-c541830d7379\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:35:09 crc kubenswrapper[5120]: I0316 16:35:09.833550 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6f56v\" (UniqueName: \"kubernetes.io/projected/1b4d71ef-4a0e-4e99-8cf4-c541830d7379-kube-api-access-6f56v\") pod \"ceilometer-0\" (UID: \"1b4d71ef-4a0e-4e99-8cf4-c541830d7379\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:35:09 crc kubenswrapper[5120]: I0316 16:35:09.935718 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1b4d71ef-4a0e-4e99-8cf4-c541830d7379-scripts\") pod \"ceilometer-0\" (UID: \"1b4d71ef-4a0e-4e99-8cf4-c541830d7379\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:35:09 crc kubenswrapper[5120]: I0316 16:35:09.936082 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1b4d71ef-4a0e-4e99-8cf4-c541830d7379-config-data\") pod \"ceilometer-0\" (UID: \"1b4d71ef-4a0e-4e99-8cf4-c541830d7379\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:35:09 crc kubenswrapper[5120]: I0316 16:35:09.936144 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1b4d71ef-4a0e-4e99-8cf4-c541830d7379-log-httpd\") pod \"ceilometer-0\" (UID: \"1b4d71ef-4a0e-4e99-8cf4-c541830d7379\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:35:09 crc kubenswrapper[5120]: I0316 16:35:09.936686 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1b4d71ef-4a0e-4e99-8cf4-c541830d7379-log-httpd\") pod \"ceilometer-0\" (UID: \"1b4d71ef-4a0e-4e99-8cf4-c541830d7379\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:35:09 crc kubenswrapper[5120]: I0316 16:35:09.936225 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/1b4d71ef-4a0e-4e99-8cf4-c541830d7379-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"1b4d71ef-4a0e-4e99-8cf4-c541830d7379\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:35:09 crc kubenswrapper[5120]: I0316 16:35:09.937250 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1b4d71ef-4a0e-4e99-8cf4-c541830d7379-run-httpd\") pod \"ceilometer-0\" (UID: \"1b4d71ef-4a0e-4e99-8cf4-c541830d7379\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:35:09 crc kubenswrapper[5120]: I0316 16:35:09.937577 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1b4d71ef-4a0e-4e99-8cf4-c541830d7379-run-httpd\") pod \"ceilometer-0\" (UID: \"1b4d71ef-4a0e-4e99-8cf4-c541830d7379\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:35:09 crc kubenswrapper[5120]: I0316 16:35:09.937714 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1b4d71ef-4a0e-4e99-8cf4-c541830d7379-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"1b4d71ef-4a0e-4e99-8cf4-c541830d7379\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:35:09 crc kubenswrapper[5120]: I0316 16:35:09.937743 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/1b4d71ef-4a0e-4e99-8cf4-c541830d7379-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"1b4d71ef-4a0e-4e99-8cf4-c541830d7379\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:35:09 crc kubenswrapper[5120]: I0316 16:35:09.938296 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6f56v\" (UniqueName: \"kubernetes.io/projected/1b4d71ef-4a0e-4e99-8cf4-c541830d7379-kube-api-access-6f56v\") pod \"ceilometer-0\" (UID: \"1b4d71ef-4a0e-4e99-8cf4-c541830d7379\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:35:09 crc kubenswrapper[5120]: I0316 16:35:09.942668 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1b4d71ef-4a0e-4e99-8cf4-c541830d7379-scripts\") pod \"ceilometer-0\" (UID: \"1b4d71ef-4a0e-4e99-8cf4-c541830d7379\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:35:09 crc kubenswrapper[5120]: I0316 16:35:09.942686 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/1b4d71ef-4a0e-4e99-8cf4-c541830d7379-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"1b4d71ef-4a0e-4e99-8cf4-c541830d7379\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:35:09 crc kubenswrapper[5120]: I0316 16:35:09.942665 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/1b4d71ef-4a0e-4e99-8cf4-c541830d7379-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"1b4d71ef-4a0e-4e99-8cf4-c541830d7379\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:35:09 crc kubenswrapper[5120]: I0316 16:35:09.942856 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1b4d71ef-4a0e-4e99-8cf4-c541830d7379-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"1b4d71ef-4a0e-4e99-8cf4-c541830d7379\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:35:09 crc kubenswrapper[5120]: I0316 16:35:09.944392 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1b4d71ef-4a0e-4e99-8cf4-c541830d7379-config-data\") pod \"ceilometer-0\" (UID: \"1b4d71ef-4a0e-4e99-8cf4-c541830d7379\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:35:09 crc kubenswrapper[5120]: I0316 16:35:09.958742 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6f56v\" (UniqueName: \"kubernetes.io/projected/1b4d71ef-4a0e-4e99-8cf4-c541830d7379-kube-api-access-6f56v\") pod \"ceilometer-0\" (UID: \"1b4d71ef-4a0e-4e99-8cf4-c541830d7379\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:35:10 crc kubenswrapper[5120]: I0316 16:35:10.067542 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:35:10 crc kubenswrapper[5120]: I0316 16:35:10.096226 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:35:10 crc kubenswrapper[5120]: I0316 16:35:10.577857 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:35:10 crc kubenswrapper[5120]: I0316 16:35:10.674282 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7b38e8f8-9a5c-44cf-a669-05a72b82016e" path="/var/lib/kubelet/pods/7b38e8f8-9a5c-44cf-a669-05a72b82016e/volumes" Mar 16 16:35:10 crc kubenswrapper[5120]: I0316 16:35:10.675297 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1b4d71ef-4a0e-4e99-8cf4-c541830d7379","Type":"ContainerStarted","Data":"3f6002ffa89543e88e727f14a237086bd61e8dff59c91981323e4cea5b09549f"} Mar 16 16:35:11 crc kubenswrapper[5120]: I0316 16:35:11.677067 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-marketplace/community-operators-d6kwz" podUID="174340db-fc47-45b2-a03e-864610c3d398" containerName="registry-server" containerID="cri-o://5d90aba53d1460bb21e5b28b4ca3090caa7ff9afdca620b736cd6b3a84b6ed2e" gracePeriod=2 Mar 16 16:35:11 crc kubenswrapper[5120]: I0316 16:35:11.677679 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1b4d71ef-4a0e-4e99-8cf4-c541830d7379","Type":"ContainerStarted","Data":"53547576c13b4e2d2b2ed200e15a8147cf02a4125aec8d5bcb1c3a361db1125e"} Mar 16 16:35:12 crc kubenswrapper[5120]: I0316 16:35:12.121346 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-d6kwz" Mar 16 16:35:12 crc kubenswrapper[5120]: I0316 16:35:12.300347 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/174340db-fc47-45b2-a03e-864610c3d398-catalog-content\") pod \"174340db-fc47-45b2-a03e-864610c3d398\" (UID: \"174340db-fc47-45b2-a03e-864610c3d398\") " Mar 16 16:35:12 crc kubenswrapper[5120]: I0316 16:35:12.300878 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8mlh2\" (UniqueName: \"kubernetes.io/projected/174340db-fc47-45b2-a03e-864610c3d398-kube-api-access-8mlh2\") pod \"174340db-fc47-45b2-a03e-864610c3d398\" (UID: \"174340db-fc47-45b2-a03e-864610c3d398\") " Mar 16 16:35:12 crc kubenswrapper[5120]: I0316 16:35:12.300973 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/174340db-fc47-45b2-a03e-864610c3d398-utilities\") pod \"174340db-fc47-45b2-a03e-864610c3d398\" (UID: \"174340db-fc47-45b2-a03e-864610c3d398\") " Mar 16 16:35:12 crc kubenswrapper[5120]: I0316 16:35:12.302097 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/174340db-fc47-45b2-a03e-864610c3d398-utilities" (OuterVolumeSpecName: "utilities") pod "174340db-fc47-45b2-a03e-864610c3d398" (UID: "174340db-fc47-45b2-a03e-864610c3d398"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:35:12 crc kubenswrapper[5120]: I0316 16:35:12.307462 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/174340db-fc47-45b2-a03e-864610c3d398-kube-api-access-8mlh2" (OuterVolumeSpecName: "kube-api-access-8mlh2") pod "174340db-fc47-45b2-a03e-864610c3d398" (UID: "174340db-fc47-45b2-a03e-864610c3d398"). InnerVolumeSpecName "kube-api-access-8mlh2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:35:12 crc kubenswrapper[5120]: I0316 16:35:12.359906 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/174340db-fc47-45b2-a03e-864610c3d398-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "174340db-fc47-45b2-a03e-864610c3d398" (UID: "174340db-fc47-45b2-a03e-864610c3d398"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:35:12 crc kubenswrapper[5120]: I0316 16:35:12.403637 5120 reconciler_common.go:299] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/174340db-fc47-45b2-a03e-864610c3d398-catalog-content\") on node \"crc\" DevicePath \"\"" Mar 16 16:35:12 crc kubenswrapper[5120]: I0316 16:35:12.403671 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8mlh2\" (UniqueName: \"kubernetes.io/projected/174340db-fc47-45b2-a03e-864610c3d398-kube-api-access-8mlh2\") on node \"crc\" DevicePath \"\"" Mar 16 16:35:12 crc kubenswrapper[5120]: I0316 16:35:12.403684 5120 reconciler_common.go:299] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/174340db-fc47-45b2-a03e-864610c3d398-utilities\") on node \"crc\" DevicePath \"\"" Mar 16 16:35:12 crc kubenswrapper[5120]: I0316 16:35:12.643914 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:35:12 crc kubenswrapper[5120]: I0316 16:35:12.712415 5120 generic.go:358] "Generic (PLEG): container finished" podID="eadb9039-baf8-429d-82ea-01531fd18a12" containerID="7320aef7bfb81dca07022c118df9073ea5d0e46d810717a31309609d525979de" exitCode=0 Mar 16 16:35:12 crc kubenswrapper[5120]: I0316 16:35:12.712471 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"eadb9039-baf8-429d-82ea-01531fd18a12","Type":"ContainerDied","Data":"7320aef7bfb81dca07022c118df9073ea5d0e46d810717a31309609d525979de"} Mar 16 16:35:12 crc kubenswrapper[5120]: I0316 16:35:12.713027 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"eadb9039-baf8-429d-82ea-01531fd18a12","Type":"ContainerDied","Data":"f3bced4c5c807e04165e240ab3f906e50ebb21b09410b9b9f318ccde62bd5c7d"} Mar 16 16:35:12 crc kubenswrapper[5120]: I0316 16:35:12.713055 5120 scope.go:117] "RemoveContainer" containerID="7320aef7bfb81dca07022c118df9073ea5d0e46d810717a31309609d525979de" Mar 16 16:35:12 crc kubenswrapper[5120]: I0316 16:35:12.712521 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:35:12 crc kubenswrapper[5120]: I0316 16:35:12.729183 5120 generic.go:358] "Generic (PLEG): container finished" podID="174340db-fc47-45b2-a03e-864610c3d398" containerID="5d90aba53d1460bb21e5b28b4ca3090caa7ff9afdca620b736cd6b3a84b6ed2e" exitCode=0 Mar 16 16:35:12 crc kubenswrapper[5120]: I0316 16:35:12.729289 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-d6kwz" Mar 16 16:35:12 crc kubenswrapper[5120]: I0316 16:35:12.729344 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-d6kwz" event={"ID":"174340db-fc47-45b2-a03e-864610c3d398","Type":"ContainerDied","Data":"5d90aba53d1460bb21e5b28b4ca3090caa7ff9afdca620b736cd6b3a84b6ed2e"} Mar 16 16:35:12 crc kubenswrapper[5120]: I0316 16:35:12.729371 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-d6kwz" event={"ID":"174340db-fc47-45b2-a03e-864610c3d398","Type":"ContainerDied","Data":"165ce0a7cc5574dfe4a37fa313938f80f53895e8f312d378ccae9bf0ec2339cf"} Mar 16 16:35:12 crc kubenswrapper[5120]: I0316 16:35:12.739308 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1b4d71ef-4a0e-4e99-8cf4-c541830d7379","Type":"ContainerStarted","Data":"c08cba5a20adcf460548b921816266c5ad327372c87ad9251b60f3622811b1ae"} Mar 16 16:35:12 crc kubenswrapper[5120]: I0316 16:35:12.760287 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/community-operators-d6kwz"] Mar 16 16:35:12 crc kubenswrapper[5120]: I0316 16:35:12.763397 5120 scope.go:117] "RemoveContainer" containerID="25f0942b159beec776bb0914c8098eb2d0ae06cb5b289de798b8ab5b3d16d583" Mar 16 16:35:12 crc kubenswrapper[5120]: I0316 16:35:12.775210 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/community-operators-d6kwz"] Mar 16 16:35:12 crc kubenswrapper[5120]: I0316 16:35:12.793035 5120 scope.go:117] "RemoveContainer" containerID="7320aef7bfb81dca07022c118df9073ea5d0e46d810717a31309609d525979de" Mar 16 16:35:12 crc kubenswrapper[5120]: E0316 16:35:12.793489 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7320aef7bfb81dca07022c118df9073ea5d0e46d810717a31309609d525979de\": container with ID starting with 7320aef7bfb81dca07022c118df9073ea5d0e46d810717a31309609d525979de not found: ID does not exist" containerID="7320aef7bfb81dca07022c118df9073ea5d0e46d810717a31309609d525979de" Mar 16 16:35:12 crc kubenswrapper[5120]: I0316 16:35:12.793525 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7320aef7bfb81dca07022c118df9073ea5d0e46d810717a31309609d525979de"} err="failed to get container status \"7320aef7bfb81dca07022c118df9073ea5d0e46d810717a31309609d525979de\": rpc error: code = NotFound desc = could not find container \"7320aef7bfb81dca07022c118df9073ea5d0e46d810717a31309609d525979de\": container with ID starting with 7320aef7bfb81dca07022c118df9073ea5d0e46d810717a31309609d525979de not found: ID does not exist" Mar 16 16:35:12 crc kubenswrapper[5120]: I0316 16:35:12.793554 5120 scope.go:117] "RemoveContainer" containerID="25f0942b159beec776bb0914c8098eb2d0ae06cb5b289de798b8ab5b3d16d583" Mar 16 16:35:12 crc kubenswrapper[5120]: E0316 16:35:12.793895 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"25f0942b159beec776bb0914c8098eb2d0ae06cb5b289de798b8ab5b3d16d583\": container with ID starting with 25f0942b159beec776bb0914c8098eb2d0ae06cb5b289de798b8ab5b3d16d583 not found: ID does not exist" containerID="25f0942b159beec776bb0914c8098eb2d0ae06cb5b289de798b8ab5b3d16d583" Mar 16 16:35:12 crc kubenswrapper[5120]: I0316 16:35:12.793918 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25f0942b159beec776bb0914c8098eb2d0ae06cb5b289de798b8ab5b3d16d583"} err="failed to get container status \"25f0942b159beec776bb0914c8098eb2d0ae06cb5b289de798b8ab5b3d16d583\": rpc error: code = NotFound desc = could not find container \"25f0942b159beec776bb0914c8098eb2d0ae06cb5b289de798b8ab5b3d16d583\": container with ID starting with 25f0942b159beec776bb0914c8098eb2d0ae06cb5b289de798b8ab5b3d16d583 not found: ID does not exist" Mar 16 16:35:12 crc kubenswrapper[5120]: I0316 16:35:12.793931 5120 scope.go:117] "RemoveContainer" containerID="5d90aba53d1460bb21e5b28b4ca3090caa7ff9afdca620b736cd6b3a84b6ed2e" Mar 16 16:35:12 crc kubenswrapper[5120]: I0316 16:35:12.815821 5120 scope.go:117] "RemoveContainer" containerID="92bc6f62f93514ec6d87f72695000ad8c3d02b48071f13a8f9658b31bc1b7e14" Mar 16 16:35:12 crc kubenswrapper[5120]: I0316 16:35:12.815971 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/eadb9039-baf8-429d-82ea-01531fd18a12-config-data\") pod \"eadb9039-baf8-429d-82ea-01531fd18a12\" (UID: \"eadb9039-baf8-429d-82ea-01531fd18a12\") " Mar 16 16:35:12 crc kubenswrapper[5120]: I0316 16:35:12.816308 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/eadb9039-baf8-429d-82ea-01531fd18a12-logs\") pod \"eadb9039-baf8-429d-82ea-01531fd18a12\" (UID: \"eadb9039-baf8-429d-82ea-01531fd18a12\") " Mar 16 16:35:12 crc kubenswrapper[5120]: I0316 16:35:12.817037 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eadb9039-baf8-429d-82ea-01531fd18a12-logs" (OuterVolumeSpecName: "logs") pod "eadb9039-baf8-429d-82ea-01531fd18a12" (UID: "eadb9039-baf8-429d-82ea-01531fd18a12"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:35:12 crc kubenswrapper[5120]: I0316 16:35:12.818208 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t56ld\" (UniqueName: \"kubernetes.io/projected/eadb9039-baf8-429d-82ea-01531fd18a12-kube-api-access-t56ld\") pod \"eadb9039-baf8-429d-82ea-01531fd18a12\" (UID: \"eadb9039-baf8-429d-82ea-01531fd18a12\") " Mar 16 16:35:12 crc kubenswrapper[5120]: I0316 16:35:12.818380 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eadb9039-baf8-429d-82ea-01531fd18a12-combined-ca-bundle\") pod \"eadb9039-baf8-429d-82ea-01531fd18a12\" (UID: \"eadb9039-baf8-429d-82ea-01531fd18a12\") " Mar 16 16:35:12 crc kubenswrapper[5120]: I0316 16:35:12.819416 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/eadb9039-baf8-429d-82ea-01531fd18a12-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:35:12 crc kubenswrapper[5120]: I0316 16:35:12.825227 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eadb9039-baf8-429d-82ea-01531fd18a12-kube-api-access-t56ld" (OuterVolumeSpecName: "kube-api-access-t56ld") pod "eadb9039-baf8-429d-82ea-01531fd18a12" (UID: "eadb9039-baf8-429d-82ea-01531fd18a12"). InnerVolumeSpecName "kube-api-access-t56ld". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:35:12 crc kubenswrapper[5120]: I0316 16:35:12.841052 5120 scope.go:117] "RemoveContainer" containerID="646d780d5965737f10ee5a57afc7d18262ff45c2639455c492cab76ebd9cc2e6" Mar 16 16:35:12 crc kubenswrapper[5120]: I0316 16:35:12.852348 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eadb9039-baf8-429d-82ea-01531fd18a12-config-data" (OuterVolumeSpecName: "config-data") pod "eadb9039-baf8-429d-82ea-01531fd18a12" (UID: "eadb9039-baf8-429d-82ea-01531fd18a12"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:35:12 crc kubenswrapper[5120]: I0316 16:35:12.855447 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eadb9039-baf8-429d-82ea-01531fd18a12-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "eadb9039-baf8-429d-82ea-01531fd18a12" (UID: "eadb9039-baf8-429d-82ea-01531fd18a12"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:35:12 crc kubenswrapper[5120]: I0316 16:35:12.865883 5120 scope.go:117] "RemoveContainer" containerID="5d90aba53d1460bb21e5b28b4ca3090caa7ff9afdca620b736cd6b3a84b6ed2e" Mar 16 16:35:12 crc kubenswrapper[5120]: E0316 16:35:12.866521 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d90aba53d1460bb21e5b28b4ca3090caa7ff9afdca620b736cd6b3a84b6ed2e\": container with ID starting with 5d90aba53d1460bb21e5b28b4ca3090caa7ff9afdca620b736cd6b3a84b6ed2e not found: ID does not exist" containerID="5d90aba53d1460bb21e5b28b4ca3090caa7ff9afdca620b736cd6b3a84b6ed2e" Mar 16 16:35:12 crc kubenswrapper[5120]: I0316 16:35:12.866602 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d90aba53d1460bb21e5b28b4ca3090caa7ff9afdca620b736cd6b3a84b6ed2e"} err="failed to get container status \"5d90aba53d1460bb21e5b28b4ca3090caa7ff9afdca620b736cd6b3a84b6ed2e\": rpc error: code = NotFound desc = could not find container \"5d90aba53d1460bb21e5b28b4ca3090caa7ff9afdca620b736cd6b3a84b6ed2e\": container with ID starting with 5d90aba53d1460bb21e5b28b4ca3090caa7ff9afdca620b736cd6b3a84b6ed2e not found: ID does not exist" Mar 16 16:35:12 crc kubenswrapper[5120]: I0316 16:35:12.866626 5120 scope.go:117] "RemoveContainer" containerID="92bc6f62f93514ec6d87f72695000ad8c3d02b48071f13a8f9658b31bc1b7e14" Mar 16 16:35:12 crc kubenswrapper[5120]: E0316 16:35:12.866962 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"92bc6f62f93514ec6d87f72695000ad8c3d02b48071f13a8f9658b31bc1b7e14\": container with ID starting with 92bc6f62f93514ec6d87f72695000ad8c3d02b48071f13a8f9658b31bc1b7e14 not found: ID does not exist" containerID="92bc6f62f93514ec6d87f72695000ad8c3d02b48071f13a8f9658b31bc1b7e14" Mar 16 16:35:12 crc kubenswrapper[5120]: I0316 16:35:12.866996 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92bc6f62f93514ec6d87f72695000ad8c3d02b48071f13a8f9658b31bc1b7e14"} err="failed to get container status \"92bc6f62f93514ec6d87f72695000ad8c3d02b48071f13a8f9658b31bc1b7e14\": rpc error: code = NotFound desc = could not find container \"92bc6f62f93514ec6d87f72695000ad8c3d02b48071f13a8f9658b31bc1b7e14\": container with ID starting with 92bc6f62f93514ec6d87f72695000ad8c3d02b48071f13a8f9658b31bc1b7e14 not found: ID does not exist" Mar 16 16:35:12 crc kubenswrapper[5120]: I0316 16:35:12.867012 5120 scope.go:117] "RemoveContainer" containerID="646d780d5965737f10ee5a57afc7d18262ff45c2639455c492cab76ebd9cc2e6" Mar 16 16:35:12 crc kubenswrapper[5120]: E0316 16:35:12.867519 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"646d780d5965737f10ee5a57afc7d18262ff45c2639455c492cab76ebd9cc2e6\": container with ID starting with 646d780d5965737f10ee5a57afc7d18262ff45c2639455c492cab76ebd9cc2e6 not found: ID does not exist" containerID="646d780d5965737f10ee5a57afc7d18262ff45c2639455c492cab76ebd9cc2e6" Mar 16 16:35:12 crc kubenswrapper[5120]: I0316 16:35:12.867547 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"646d780d5965737f10ee5a57afc7d18262ff45c2639455c492cab76ebd9cc2e6"} err="failed to get container status \"646d780d5965737f10ee5a57afc7d18262ff45c2639455c492cab76ebd9cc2e6\": rpc error: code = NotFound desc = could not find container \"646d780d5965737f10ee5a57afc7d18262ff45c2639455c492cab76ebd9cc2e6\": container with ID starting with 646d780d5965737f10ee5a57afc7d18262ff45c2639455c492cab76ebd9cc2e6 not found: ID does not exist" Mar 16 16:35:12 crc kubenswrapper[5120]: I0316 16:35:12.921643 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/eadb9039-baf8-429d-82ea-01531fd18a12-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:35:12 crc kubenswrapper[5120]: I0316 16:35:12.921688 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t56ld\" (UniqueName: \"kubernetes.io/projected/eadb9039-baf8-429d-82ea-01531fd18a12-kube-api-access-t56ld\") on node \"crc\" DevicePath \"\"" Mar 16 16:35:12 crc kubenswrapper[5120]: I0316 16:35:12.921700 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eadb9039-baf8-429d-82ea-01531fd18a12-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:35:13 crc kubenswrapper[5120]: I0316 16:35:13.062971 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:35:13 crc kubenswrapper[5120]: I0316 16:35:13.087237 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:35:13 crc kubenswrapper[5120]: I0316 16:35:13.098406 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:35:13 crc kubenswrapper[5120]: I0316 16:35:13.099577 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="174340db-fc47-45b2-a03e-864610c3d398" containerName="registry-server" Mar 16 16:35:13 crc kubenswrapper[5120]: I0316 16:35:13.099601 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="174340db-fc47-45b2-a03e-864610c3d398" containerName="registry-server" Mar 16 16:35:13 crc kubenswrapper[5120]: I0316 16:35:13.099642 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="174340db-fc47-45b2-a03e-864610c3d398" containerName="extract-content" Mar 16 16:35:13 crc kubenswrapper[5120]: I0316 16:35:13.099651 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="174340db-fc47-45b2-a03e-864610c3d398" containerName="extract-content" Mar 16 16:35:13 crc kubenswrapper[5120]: I0316 16:35:13.099686 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="174340db-fc47-45b2-a03e-864610c3d398" containerName="extract-utilities" Mar 16 16:35:13 crc kubenswrapper[5120]: I0316 16:35:13.099693 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="174340db-fc47-45b2-a03e-864610c3d398" containerName="extract-utilities" Mar 16 16:35:13 crc kubenswrapper[5120]: I0316 16:35:13.099705 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eadb9039-baf8-429d-82ea-01531fd18a12" containerName="nova-api-log" Mar 16 16:35:13 crc kubenswrapper[5120]: I0316 16:35:13.099710 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="eadb9039-baf8-429d-82ea-01531fd18a12" containerName="nova-api-log" Mar 16 16:35:13 crc kubenswrapper[5120]: I0316 16:35:13.099721 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eadb9039-baf8-429d-82ea-01531fd18a12" containerName="nova-api-api" Mar 16 16:35:13 crc kubenswrapper[5120]: I0316 16:35:13.099727 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="eadb9039-baf8-429d-82ea-01531fd18a12" containerName="nova-api-api" Mar 16 16:35:13 crc kubenswrapper[5120]: I0316 16:35:13.099917 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="eadb9039-baf8-429d-82ea-01531fd18a12" containerName="nova-api-log" Mar 16 16:35:13 crc kubenswrapper[5120]: I0316 16:35:13.099928 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="eadb9039-baf8-429d-82ea-01531fd18a12" containerName="nova-api-api" Mar 16 16:35:13 crc kubenswrapper[5120]: I0316 16:35:13.099942 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="174340db-fc47-45b2-a03e-864610c3d398" containerName="registry-server" Mar 16 16:35:13 crc kubenswrapper[5120]: I0316 16:35:13.110323 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:35:13 crc kubenswrapper[5120]: I0316 16:35:13.110451 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:35:13 crc kubenswrapper[5120]: I0316 16:35:13.115494 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-internal-svc\"" Mar 16 16:35:13 crc kubenswrapper[5120]: I0316 16:35:13.115634 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-public-svc\"" Mar 16 16:35:13 crc kubenswrapper[5120]: I0316 16:35:13.115820 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-config-data\"" Mar 16 16:35:13 crc kubenswrapper[5120]: I0316 16:35:13.238170 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b8725613-8c6b-4e92-9ff7-c9aeaff10f59-config-data\") pod \"nova-api-0\" (UID: \"b8725613-8c6b-4e92-9ff7-c9aeaff10f59\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:35:13 crc kubenswrapper[5120]: I0316 16:35:13.238254 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/b8725613-8c6b-4e92-9ff7-c9aeaff10f59-internal-tls-certs\") pod \"nova-api-0\" (UID: \"b8725613-8c6b-4e92-9ff7-c9aeaff10f59\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:35:13 crc kubenswrapper[5120]: I0316 16:35:13.238353 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfdvh\" (UniqueName: \"kubernetes.io/projected/b8725613-8c6b-4e92-9ff7-c9aeaff10f59-kube-api-access-mfdvh\") pod \"nova-api-0\" (UID: \"b8725613-8c6b-4e92-9ff7-c9aeaff10f59\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:35:13 crc kubenswrapper[5120]: I0316 16:35:13.238387 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/b8725613-8c6b-4e92-9ff7-c9aeaff10f59-public-tls-certs\") pod \"nova-api-0\" (UID: \"b8725613-8c6b-4e92-9ff7-c9aeaff10f59\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:35:13 crc kubenswrapper[5120]: I0316 16:35:13.238412 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b8725613-8c6b-4e92-9ff7-c9aeaff10f59-logs\") pod \"nova-api-0\" (UID: \"b8725613-8c6b-4e92-9ff7-c9aeaff10f59\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:35:13 crc kubenswrapper[5120]: I0316 16:35:13.238441 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b8725613-8c6b-4e92-9ff7-c9aeaff10f59-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"b8725613-8c6b-4e92-9ff7-c9aeaff10f59\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:35:13 crc kubenswrapper[5120]: I0316 16:35:13.340151 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b8725613-8c6b-4e92-9ff7-c9aeaff10f59-config-data\") pod \"nova-api-0\" (UID: \"b8725613-8c6b-4e92-9ff7-c9aeaff10f59\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:35:13 crc kubenswrapper[5120]: I0316 16:35:13.340421 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/b8725613-8c6b-4e92-9ff7-c9aeaff10f59-internal-tls-certs\") pod \"nova-api-0\" (UID: \"b8725613-8c6b-4e92-9ff7-c9aeaff10f59\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:35:13 crc kubenswrapper[5120]: I0316 16:35:13.340661 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mfdvh\" (UniqueName: \"kubernetes.io/projected/b8725613-8c6b-4e92-9ff7-c9aeaff10f59-kube-api-access-mfdvh\") pod \"nova-api-0\" (UID: \"b8725613-8c6b-4e92-9ff7-c9aeaff10f59\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:35:13 crc kubenswrapper[5120]: I0316 16:35:13.340792 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/b8725613-8c6b-4e92-9ff7-c9aeaff10f59-public-tls-certs\") pod \"nova-api-0\" (UID: \"b8725613-8c6b-4e92-9ff7-c9aeaff10f59\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:35:13 crc kubenswrapper[5120]: I0316 16:35:13.340905 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b8725613-8c6b-4e92-9ff7-c9aeaff10f59-logs\") pod \"nova-api-0\" (UID: \"b8725613-8c6b-4e92-9ff7-c9aeaff10f59\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:35:13 crc kubenswrapper[5120]: I0316 16:35:13.342215 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b8725613-8c6b-4e92-9ff7-c9aeaff10f59-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"b8725613-8c6b-4e92-9ff7-c9aeaff10f59\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:35:13 crc kubenswrapper[5120]: I0316 16:35:13.341503 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b8725613-8c6b-4e92-9ff7-c9aeaff10f59-logs\") pod \"nova-api-0\" (UID: \"b8725613-8c6b-4e92-9ff7-c9aeaff10f59\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:35:13 crc kubenswrapper[5120]: I0316 16:35:13.351583 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/b8725613-8c6b-4e92-9ff7-c9aeaff10f59-internal-tls-certs\") pod \"nova-api-0\" (UID: \"b8725613-8c6b-4e92-9ff7-c9aeaff10f59\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:35:13 crc kubenswrapper[5120]: I0316 16:35:13.351635 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/b8725613-8c6b-4e92-9ff7-c9aeaff10f59-public-tls-certs\") pod \"nova-api-0\" (UID: \"b8725613-8c6b-4e92-9ff7-c9aeaff10f59\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:35:13 crc kubenswrapper[5120]: I0316 16:35:13.351686 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b8725613-8c6b-4e92-9ff7-c9aeaff10f59-config-data\") pod \"nova-api-0\" (UID: \"b8725613-8c6b-4e92-9ff7-c9aeaff10f59\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:35:13 crc kubenswrapper[5120]: I0316 16:35:13.352083 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b8725613-8c6b-4e92-9ff7-c9aeaff10f59-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"b8725613-8c6b-4e92-9ff7-c9aeaff10f59\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:35:13 crc kubenswrapper[5120]: I0316 16:35:13.358383 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfdvh\" (UniqueName: \"kubernetes.io/projected/b8725613-8c6b-4e92-9ff7-c9aeaff10f59-kube-api-access-mfdvh\") pod \"nova-api-0\" (UID: \"b8725613-8c6b-4e92-9ff7-c9aeaff10f59\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:35:13 crc kubenswrapper[5120]: I0316 16:35:13.435637 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:35:13 crc kubenswrapper[5120]: I0316 16:35:13.757302 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1b4d71ef-4a0e-4e99-8cf4-c541830d7379","Type":"ContainerStarted","Data":"5aa6331f9621c81bb92d77cc6b8423483b3d4e52f6d47e2b08dee62ef3ad47a0"} Mar 16 16:35:13 crc kubenswrapper[5120]: I0316 16:35:13.935794 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:35:13 crc kubenswrapper[5120]: W0316 16:35:13.938433 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb8725613_8c6b_4e92_9ff7_c9aeaff10f59.slice/crio-58e739bc89d877dac70ed7b3bccba27ad38c34c8e98da1d1e25e48172e23f42a WatchSource:0}: Error finding container 58e739bc89d877dac70ed7b3bccba27ad38c34c8e98da1d1e25e48172e23f42a: Status 404 returned error can't find the container with id 58e739bc89d877dac70ed7b3bccba27ad38c34c8e98da1d1e25e48172e23f42a Mar 16 16:35:14 crc kubenswrapper[5120]: I0316 16:35:14.674525 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="174340db-fc47-45b2-a03e-864610c3d398" path="/var/lib/kubelet/pods/174340db-fc47-45b2-a03e-864610c3d398/volumes" Mar 16 16:35:14 crc kubenswrapper[5120]: I0316 16:35:14.675992 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eadb9039-baf8-429d-82ea-01531fd18a12" path="/var/lib/kubelet/pods/eadb9039-baf8-429d-82ea-01531fd18a12/volumes" Mar 16 16:35:14 crc kubenswrapper[5120]: I0316 16:35:14.769174 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"b8725613-8c6b-4e92-9ff7-c9aeaff10f59","Type":"ContainerStarted","Data":"a165c25cb76cda11d364c5b15d44fa2906e650d5ab895aacb333f78bb6096ffd"} Mar 16 16:35:14 crc kubenswrapper[5120]: I0316 16:35:14.769223 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"b8725613-8c6b-4e92-9ff7-c9aeaff10f59","Type":"ContainerStarted","Data":"43ff2c8b27976e7f451cd3418a68822e68a6023ebdb30af40b8cdec7cec06b55"} Mar 16 16:35:14 crc kubenswrapper[5120]: I0316 16:35:14.769239 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"b8725613-8c6b-4e92-9ff7-c9aeaff10f59","Type":"ContainerStarted","Data":"58e739bc89d877dac70ed7b3bccba27ad38c34c8e98da1d1e25e48172e23f42a"} Mar 16 16:35:14 crc kubenswrapper[5120]: I0316 16:35:14.785916 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=1.785894538 podStartE2EDuration="1.785894538s" podCreationTimestamp="2026-03-16 16:35:13 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:35:14.783661879 +0000 UTC m=+3816.937593536" watchObservedRunningTime="2026-03-16 16:35:14.785894538 +0000 UTC m=+3816.939826195" Mar 16 16:35:16 crc kubenswrapper[5120]: I0316 16:35:16.792731 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1b4d71ef-4a0e-4e99-8cf4-c541830d7379","Type":"ContainerStarted","Data":"64a1b4ea06c9be28645cfb7ff5443bd3d95d204193caacc5e442cc6c653f2176"} Mar 16 16:35:16 crc kubenswrapper[5120]: I0316 16:35:16.794336 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:35:16 crc kubenswrapper[5120]: I0316 16:35:16.793769 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="1b4d71ef-4a0e-4e99-8cf4-c541830d7379" containerName="proxy-httpd" containerID="cri-o://64a1b4ea06c9be28645cfb7ff5443bd3d95d204193caacc5e442cc6c653f2176" gracePeriod=30 Mar 16 16:35:16 crc kubenswrapper[5120]: I0316 16:35:16.793118 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="1b4d71ef-4a0e-4e99-8cf4-c541830d7379" containerName="ceilometer-central-agent" containerID="cri-o://53547576c13b4e2d2b2ed200e15a8147cf02a4125aec8d5bcb1c3a361db1125e" gracePeriod=30 Mar 16 16:35:16 crc kubenswrapper[5120]: I0316 16:35:16.793800 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="1b4d71ef-4a0e-4e99-8cf4-c541830d7379" containerName="ceilometer-notification-agent" containerID="cri-o://c08cba5a20adcf460548b921816266c5ad327372c87ad9251b60f3622811b1ae" gracePeriod=30 Mar 16 16:35:16 crc kubenswrapper[5120]: I0316 16:35:16.793789 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="1b4d71ef-4a0e-4e99-8cf4-c541830d7379" containerName="sg-core" containerID="cri-o://5aa6331f9621c81bb92d77cc6b8423483b3d4e52f6d47e2b08dee62ef3ad47a0" gracePeriod=30 Mar 16 16:35:16 crc kubenswrapper[5120]: I0316 16:35:16.832119 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.596859758 podStartE2EDuration="7.832098195s" podCreationTimestamp="2026-03-16 16:35:09 +0000 UTC" firstStartedPulling="2026-03-16 16:35:10.583311919 +0000 UTC m=+3812.737243576" lastFinishedPulling="2026-03-16 16:35:15.818550356 +0000 UTC m=+3817.972482013" observedRunningTime="2026-03-16 16:35:16.820497812 +0000 UTC m=+3818.974429479" watchObservedRunningTime="2026-03-16 16:35:16.832098195 +0000 UTC m=+3818.986029852" Mar 16 16:35:17 crc kubenswrapper[5120]: I0316 16:35:17.517518 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:35:17 crc kubenswrapper[5120]: I0316 16:35:17.670045 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1b4d71ef-4a0e-4e99-8cf4-c541830d7379-combined-ca-bundle\") pod \"1b4d71ef-4a0e-4e99-8cf4-c541830d7379\" (UID: \"1b4d71ef-4a0e-4e99-8cf4-c541830d7379\") " Mar 16 16:35:17 crc kubenswrapper[5120]: I0316 16:35:17.670347 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1b4d71ef-4a0e-4e99-8cf4-c541830d7379-log-httpd\") pod \"1b4d71ef-4a0e-4e99-8cf4-c541830d7379\" (UID: \"1b4d71ef-4a0e-4e99-8cf4-c541830d7379\") " Mar 16 16:35:17 crc kubenswrapper[5120]: I0316 16:35:17.670482 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/1b4d71ef-4a0e-4e99-8cf4-c541830d7379-ceilometer-tls-certs\") pod \"1b4d71ef-4a0e-4e99-8cf4-c541830d7379\" (UID: \"1b4d71ef-4a0e-4e99-8cf4-c541830d7379\") " Mar 16 16:35:17 crc kubenswrapper[5120]: I0316 16:35:17.670537 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1b4d71ef-4a0e-4e99-8cf4-c541830d7379-run-httpd\") pod \"1b4d71ef-4a0e-4e99-8cf4-c541830d7379\" (UID: \"1b4d71ef-4a0e-4e99-8cf4-c541830d7379\") " Mar 16 16:35:17 crc kubenswrapper[5120]: I0316 16:35:17.670578 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1b4d71ef-4a0e-4e99-8cf4-c541830d7379-scripts\") pod \"1b4d71ef-4a0e-4e99-8cf4-c541830d7379\" (UID: \"1b4d71ef-4a0e-4e99-8cf4-c541830d7379\") " Mar 16 16:35:17 crc kubenswrapper[5120]: I0316 16:35:17.670625 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/1b4d71ef-4a0e-4e99-8cf4-c541830d7379-sg-core-conf-yaml\") pod \"1b4d71ef-4a0e-4e99-8cf4-c541830d7379\" (UID: \"1b4d71ef-4a0e-4e99-8cf4-c541830d7379\") " Mar 16 16:35:17 crc kubenswrapper[5120]: I0316 16:35:17.670692 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1b4d71ef-4a0e-4e99-8cf4-c541830d7379-config-data\") pod \"1b4d71ef-4a0e-4e99-8cf4-c541830d7379\" (UID: \"1b4d71ef-4a0e-4e99-8cf4-c541830d7379\") " Mar 16 16:35:17 crc kubenswrapper[5120]: I0316 16:35:17.670996 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b4d71ef-4a0e-4e99-8cf4-c541830d7379-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "1b4d71ef-4a0e-4e99-8cf4-c541830d7379" (UID: "1b4d71ef-4a0e-4e99-8cf4-c541830d7379"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:35:17 crc kubenswrapper[5120]: I0316 16:35:17.671441 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b4d71ef-4a0e-4e99-8cf4-c541830d7379-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "1b4d71ef-4a0e-4e99-8cf4-c541830d7379" (UID: "1b4d71ef-4a0e-4e99-8cf4-c541830d7379"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:35:17 crc kubenswrapper[5120]: I0316 16:35:17.671473 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6f56v\" (UniqueName: \"kubernetes.io/projected/1b4d71ef-4a0e-4e99-8cf4-c541830d7379-kube-api-access-6f56v\") pod \"1b4d71ef-4a0e-4e99-8cf4-c541830d7379\" (UID: \"1b4d71ef-4a0e-4e99-8cf4-c541830d7379\") " Mar 16 16:35:17 crc kubenswrapper[5120]: I0316 16:35:17.672535 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1b4d71ef-4a0e-4e99-8cf4-c541830d7379-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:35:17 crc kubenswrapper[5120]: I0316 16:35:17.672554 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1b4d71ef-4a0e-4e99-8cf4-c541830d7379-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:35:17 crc kubenswrapper[5120]: I0316 16:35:17.676678 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1b4d71ef-4a0e-4e99-8cf4-c541830d7379-scripts" (OuterVolumeSpecName: "scripts") pod "1b4d71ef-4a0e-4e99-8cf4-c541830d7379" (UID: "1b4d71ef-4a0e-4e99-8cf4-c541830d7379"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:35:17 crc kubenswrapper[5120]: I0316 16:35:17.676849 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b4d71ef-4a0e-4e99-8cf4-c541830d7379-kube-api-access-6f56v" (OuterVolumeSpecName: "kube-api-access-6f56v") pod "1b4d71ef-4a0e-4e99-8cf4-c541830d7379" (UID: "1b4d71ef-4a0e-4e99-8cf4-c541830d7379"). InnerVolumeSpecName "kube-api-access-6f56v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:35:17 crc kubenswrapper[5120]: I0316 16:35:17.701286 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1b4d71ef-4a0e-4e99-8cf4-c541830d7379-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "1b4d71ef-4a0e-4e99-8cf4-c541830d7379" (UID: "1b4d71ef-4a0e-4e99-8cf4-c541830d7379"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:35:17 crc kubenswrapper[5120]: I0316 16:35:17.725422 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1b4d71ef-4a0e-4e99-8cf4-c541830d7379-ceilometer-tls-certs" (OuterVolumeSpecName: "ceilometer-tls-certs") pod "1b4d71ef-4a0e-4e99-8cf4-c541830d7379" (UID: "1b4d71ef-4a0e-4e99-8cf4-c541830d7379"). InnerVolumeSpecName "ceilometer-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:35:17 crc kubenswrapper[5120]: I0316 16:35:17.751701 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1b4d71ef-4a0e-4e99-8cf4-c541830d7379-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "1b4d71ef-4a0e-4e99-8cf4-c541830d7379" (UID: "1b4d71ef-4a0e-4e99-8cf4-c541830d7379"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:35:17 crc kubenswrapper[5120]: I0316 16:35:17.765945 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1b4d71ef-4a0e-4e99-8cf4-c541830d7379-config-data" (OuterVolumeSpecName: "config-data") pod "1b4d71ef-4a0e-4e99-8cf4-c541830d7379" (UID: "1b4d71ef-4a0e-4e99-8cf4-c541830d7379"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:35:17 crc kubenswrapper[5120]: I0316 16:35:17.774842 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1b4d71ef-4a0e-4e99-8cf4-c541830d7379-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:35:17 crc kubenswrapper[5120]: I0316 16:35:17.774876 5120 reconciler_common.go:299] "Volume detached for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/1b4d71ef-4a0e-4e99-8cf4-c541830d7379-ceilometer-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:35:17 crc kubenswrapper[5120]: I0316 16:35:17.774886 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1b4d71ef-4a0e-4e99-8cf4-c541830d7379-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:35:17 crc kubenswrapper[5120]: I0316 16:35:17.774898 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/1b4d71ef-4a0e-4e99-8cf4-c541830d7379-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 16:35:17 crc kubenswrapper[5120]: I0316 16:35:17.774907 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1b4d71ef-4a0e-4e99-8cf4-c541830d7379-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:35:17 crc kubenswrapper[5120]: I0316 16:35:17.774916 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6f56v\" (UniqueName: \"kubernetes.io/projected/1b4d71ef-4a0e-4e99-8cf4-c541830d7379-kube-api-access-6f56v\") on node \"crc\" DevicePath \"\"" Mar 16 16:35:17 crc kubenswrapper[5120]: I0316 16:35:17.806380 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1b4d71ef-4a0e-4e99-8cf4-c541830d7379","Type":"ContainerDied","Data":"64a1b4ea06c9be28645cfb7ff5443bd3d95d204193caacc5e442cc6c653f2176"} Mar 16 16:35:17 crc kubenswrapper[5120]: I0316 16:35:17.806438 5120 scope.go:117] "RemoveContainer" containerID="64a1b4ea06c9be28645cfb7ff5443bd3d95d204193caacc5e442cc6c653f2176" Mar 16 16:35:17 crc kubenswrapper[5120]: I0316 16:35:17.806341 5120 generic.go:358] "Generic (PLEG): container finished" podID="1b4d71ef-4a0e-4e99-8cf4-c541830d7379" containerID="64a1b4ea06c9be28645cfb7ff5443bd3d95d204193caacc5e442cc6c653f2176" exitCode=0 Mar 16 16:35:17 crc kubenswrapper[5120]: I0316 16:35:17.806467 5120 generic.go:358] "Generic (PLEG): container finished" podID="1b4d71ef-4a0e-4e99-8cf4-c541830d7379" containerID="5aa6331f9621c81bb92d77cc6b8423483b3d4e52f6d47e2b08dee62ef3ad47a0" exitCode=2 Mar 16 16:35:17 crc kubenswrapper[5120]: I0316 16:35:17.806481 5120 generic.go:358] "Generic (PLEG): container finished" podID="1b4d71ef-4a0e-4e99-8cf4-c541830d7379" containerID="c08cba5a20adcf460548b921816266c5ad327372c87ad9251b60f3622811b1ae" exitCode=0 Mar 16 16:35:17 crc kubenswrapper[5120]: I0316 16:35:17.806488 5120 generic.go:358] "Generic (PLEG): container finished" podID="1b4d71ef-4a0e-4e99-8cf4-c541830d7379" containerID="53547576c13b4e2d2b2ed200e15a8147cf02a4125aec8d5bcb1c3a361db1125e" exitCode=0 Mar 16 16:35:17 crc kubenswrapper[5120]: I0316 16:35:17.806433 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:35:17 crc kubenswrapper[5120]: I0316 16:35:17.806632 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1b4d71ef-4a0e-4e99-8cf4-c541830d7379","Type":"ContainerDied","Data":"5aa6331f9621c81bb92d77cc6b8423483b3d4e52f6d47e2b08dee62ef3ad47a0"} Mar 16 16:35:17 crc kubenswrapper[5120]: I0316 16:35:17.806675 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1b4d71ef-4a0e-4e99-8cf4-c541830d7379","Type":"ContainerDied","Data":"c08cba5a20adcf460548b921816266c5ad327372c87ad9251b60f3622811b1ae"} Mar 16 16:35:17 crc kubenswrapper[5120]: I0316 16:35:17.806690 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1b4d71ef-4a0e-4e99-8cf4-c541830d7379","Type":"ContainerDied","Data":"53547576c13b4e2d2b2ed200e15a8147cf02a4125aec8d5bcb1c3a361db1125e"} Mar 16 16:35:17 crc kubenswrapper[5120]: I0316 16:35:17.806702 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1b4d71ef-4a0e-4e99-8cf4-c541830d7379","Type":"ContainerDied","Data":"3f6002ffa89543e88e727f14a237086bd61e8dff59c91981323e4cea5b09549f"} Mar 16 16:35:17 crc kubenswrapper[5120]: I0316 16:35:17.840462 5120 scope.go:117] "RemoveContainer" containerID="5aa6331f9621c81bb92d77cc6b8423483b3d4e52f6d47e2b08dee62ef3ad47a0" Mar 16 16:35:17 crc kubenswrapper[5120]: I0316 16:35:17.848779 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:35:17 crc kubenswrapper[5120]: I0316 16:35:17.869251 5120 scope.go:117] "RemoveContainer" containerID="c08cba5a20adcf460548b921816266c5ad327372c87ad9251b60f3622811b1ae" Mar 16 16:35:17 crc kubenswrapper[5120]: I0316 16:35:17.876229 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:35:17 crc kubenswrapper[5120]: I0316 16:35:17.886735 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:35:17 crc kubenswrapper[5120]: I0316 16:35:17.888161 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b4d71ef-4a0e-4e99-8cf4-c541830d7379" containerName="ceilometer-central-agent" Mar 16 16:35:17 crc kubenswrapper[5120]: I0316 16:35:17.888185 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b4d71ef-4a0e-4e99-8cf4-c541830d7379" containerName="ceilometer-central-agent" Mar 16 16:35:17 crc kubenswrapper[5120]: I0316 16:35:17.888203 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b4d71ef-4a0e-4e99-8cf4-c541830d7379" containerName="proxy-httpd" Mar 16 16:35:17 crc kubenswrapper[5120]: I0316 16:35:17.888212 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b4d71ef-4a0e-4e99-8cf4-c541830d7379" containerName="proxy-httpd" Mar 16 16:35:17 crc kubenswrapper[5120]: I0316 16:35:17.888220 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b4d71ef-4a0e-4e99-8cf4-c541830d7379" containerName="sg-core" Mar 16 16:35:17 crc kubenswrapper[5120]: I0316 16:35:17.888225 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b4d71ef-4a0e-4e99-8cf4-c541830d7379" containerName="sg-core" Mar 16 16:35:17 crc kubenswrapper[5120]: I0316 16:35:17.888252 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b4d71ef-4a0e-4e99-8cf4-c541830d7379" containerName="ceilometer-notification-agent" Mar 16 16:35:17 crc kubenswrapper[5120]: I0316 16:35:17.888259 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b4d71ef-4a0e-4e99-8cf4-c541830d7379" containerName="ceilometer-notification-agent" Mar 16 16:35:17 crc kubenswrapper[5120]: I0316 16:35:17.888450 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1b4d71ef-4a0e-4e99-8cf4-c541830d7379" containerName="ceilometer-notification-agent" Mar 16 16:35:17 crc kubenswrapper[5120]: I0316 16:35:17.888470 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1b4d71ef-4a0e-4e99-8cf4-c541830d7379" containerName="ceilometer-central-agent" Mar 16 16:35:17 crc kubenswrapper[5120]: I0316 16:35:17.888499 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1b4d71ef-4a0e-4e99-8cf4-c541830d7379" containerName="proxy-httpd" Mar 16 16:35:17 crc kubenswrapper[5120]: I0316 16:35:17.888508 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1b4d71ef-4a0e-4e99-8cf4-c541830d7379" containerName="sg-core" Mar 16 16:35:17 crc kubenswrapper[5120]: I0316 16:35:17.901927 5120 scope.go:117] "RemoveContainer" containerID="53547576c13b4e2d2b2ed200e15a8147cf02a4125aec8d5bcb1c3a361db1125e" Mar 16 16:35:17 crc kubenswrapper[5120]: I0316 16:35:17.914826 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:35:17 crc kubenswrapper[5120]: I0316 16:35:17.914967 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:35:17 crc kubenswrapper[5120]: I0316 16:35:17.917305 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ceilometer-internal-svc\"" Mar 16 16:35:17 crc kubenswrapper[5120]: I0316 16:35:17.918520 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 16:35:17 crc kubenswrapper[5120]: I0316 16:35:17.918528 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 16:35:17 crc kubenswrapper[5120]: I0316 16:35:17.981716 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/4093a7c4-51d9-4119-8e47-c06f29723894-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"4093a7c4-51d9-4119-8e47-c06f29723894\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:35:17 crc kubenswrapper[5120]: I0316 16:35:17.983057 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/4093a7c4-51d9-4119-8e47-c06f29723894-log-httpd\") pod \"ceilometer-0\" (UID: \"4093a7c4-51d9-4119-8e47-c06f29723894\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:35:17 crc kubenswrapper[5120]: I0316 16:35:17.983215 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5dq8\" (UniqueName: \"kubernetes.io/projected/4093a7c4-51d9-4119-8e47-c06f29723894-kube-api-access-c5dq8\") pod \"ceilometer-0\" (UID: \"4093a7c4-51d9-4119-8e47-c06f29723894\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:35:17 crc kubenswrapper[5120]: I0316 16:35:17.983428 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4093a7c4-51d9-4119-8e47-c06f29723894-scripts\") pod \"ceilometer-0\" (UID: \"4093a7c4-51d9-4119-8e47-c06f29723894\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:35:17 crc kubenswrapper[5120]: I0316 16:35:17.983565 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4093a7c4-51d9-4119-8e47-c06f29723894-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"4093a7c4-51d9-4119-8e47-c06f29723894\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:35:17 crc kubenswrapper[5120]: I0316 16:35:17.983699 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/4093a7c4-51d9-4119-8e47-c06f29723894-run-httpd\") pod \"ceilometer-0\" (UID: \"4093a7c4-51d9-4119-8e47-c06f29723894\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:35:17 crc kubenswrapper[5120]: I0316 16:35:17.983942 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/4093a7c4-51d9-4119-8e47-c06f29723894-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"4093a7c4-51d9-4119-8e47-c06f29723894\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:35:17 crc kubenswrapper[5120]: I0316 16:35:17.984048 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4093a7c4-51d9-4119-8e47-c06f29723894-config-data\") pod \"ceilometer-0\" (UID: \"4093a7c4-51d9-4119-8e47-c06f29723894\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:35:17 crc kubenswrapper[5120]: I0316 16:35:17.987676 5120 scope.go:117] "RemoveContainer" containerID="64a1b4ea06c9be28645cfb7ff5443bd3d95d204193caacc5e442cc6c653f2176" Mar 16 16:35:17 crc kubenswrapper[5120]: E0316 16:35:17.988191 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"64a1b4ea06c9be28645cfb7ff5443bd3d95d204193caacc5e442cc6c653f2176\": container with ID starting with 64a1b4ea06c9be28645cfb7ff5443bd3d95d204193caacc5e442cc6c653f2176 not found: ID does not exist" containerID="64a1b4ea06c9be28645cfb7ff5443bd3d95d204193caacc5e442cc6c653f2176" Mar 16 16:35:17 crc kubenswrapper[5120]: I0316 16:35:17.988230 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64a1b4ea06c9be28645cfb7ff5443bd3d95d204193caacc5e442cc6c653f2176"} err="failed to get container status \"64a1b4ea06c9be28645cfb7ff5443bd3d95d204193caacc5e442cc6c653f2176\": rpc error: code = NotFound desc = could not find container \"64a1b4ea06c9be28645cfb7ff5443bd3d95d204193caacc5e442cc6c653f2176\": container with ID starting with 64a1b4ea06c9be28645cfb7ff5443bd3d95d204193caacc5e442cc6c653f2176 not found: ID does not exist" Mar 16 16:35:17 crc kubenswrapper[5120]: I0316 16:35:17.988260 5120 scope.go:117] "RemoveContainer" containerID="5aa6331f9621c81bb92d77cc6b8423483b3d4e52f6d47e2b08dee62ef3ad47a0" Mar 16 16:35:17 crc kubenswrapper[5120]: E0316 16:35:17.988613 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5aa6331f9621c81bb92d77cc6b8423483b3d4e52f6d47e2b08dee62ef3ad47a0\": container with ID starting with 5aa6331f9621c81bb92d77cc6b8423483b3d4e52f6d47e2b08dee62ef3ad47a0 not found: ID does not exist" containerID="5aa6331f9621c81bb92d77cc6b8423483b3d4e52f6d47e2b08dee62ef3ad47a0" Mar 16 16:35:17 crc kubenswrapper[5120]: I0316 16:35:17.988721 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5aa6331f9621c81bb92d77cc6b8423483b3d4e52f6d47e2b08dee62ef3ad47a0"} err="failed to get container status \"5aa6331f9621c81bb92d77cc6b8423483b3d4e52f6d47e2b08dee62ef3ad47a0\": rpc error: code = NotFound desc = could not find container \"5aa6331f9621c81bb92d77cc6b8423483b3d4e52f6d47e2b08dee62ef3ad47a0\": container with ID starting with 5aa6331f9621c81bb92d77cc6b8423483b3d4e52f6d47e2b08dee62ef3ad47a0 not found: ID does not exist" Mar 16 16:35:17 crc kubenswrapper[5120]: I0316 16:35:17.988827 5120 scope.go:117] "RemoveContainer" containerID="c08cba5a20adcf460548b921816266c5ad327372c87ad9251b60f3622811b1ae" Mar 16 16:35:17 crc kubenswrapper[5120]: E0316 16:35:17.989292 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c08cba5a20adcf460548b921816266c5ad327372c87ad9251b60f3622811b1ae\": container with ID starting with c08cba5a20adcf460548b921816266c5ad327372c87ad9251b60f3622811b1ae not found: ID does not exist" containerID="c08cba5a20adcf460548b921816266c5ad327372c87ad9251b60f3622811b1ae" Mar 16 16:35:17 crc kubenswrapper[5120]: I0316 16:35:17.989338 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c08cba5a20adcf460548b921816266c5ad327372c87ad9251b60f3622811b1ae"} err="failed to get container status \"c08cba5a20adcf460548b921816266c5ad327372c87ad9251b60f3622811b1ae\": rpc error: code = NotFound desc = could not find container \"c08cba5a20adcf460548b921816266c5ad327372c87ad9251b60f3622811b1ae\": container with ID starting with c08cba5a20adcf460548b921816266c5ad327372c87ad9251b60f3622811b1ae not found: ID does not exist" Mar 16 16:35:17 crc kubenswrapper[5120]: I0316 16:35:17.989378 5120 scope.go:117] "RemoveContainer" containerID="53547576c13b4e2d2b2ed200e15a8147cf02a4125aec8d5bcb1c3a361db1125e" Mar 16 16:35:17 crc kubenswrapper[5120]: E0316 16:35:17.989696 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"53547576c13b4e2d2b2ed200e15a8147cf02a4125aec8d5bcb1c3a361db1125e\": container with ID starting with 53547576c13b4e2d2b2ed200e15a8147cf02a4125aec8d5bcb1c3a361db1125e not found: ID does not exist" containerID="53547576c13b4e2d2b2ed200e15a8147cf02a4125aec8d5bcb1c3a361db1125e" Mar 16 16:35:17 crc kubenswrapper[5120]: I0316 16:35:17.989808 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53547576c13b4e2d2b2ed200e15a8147cf02a4125aec8d5bcb1c3a361db1125e"} err="failed to get container status \"53547576c13b4e2d2b2ed200e15a8147cf02a4125aec8d5bcb1c3a361db1125e\": rpc error: code = NotFound desc = could not find container \"53547576c13b4e2d2b2ed200e15a8147cf02a4125aec8d5bcb1c3a361db1125e\": container with ID starting with 53547576c13b4e2d2b2ed200e15a8147cf02a4125aec8d5bcb1c3a361db1125e not found: ID does not exist" Mar 16 16:35:17 crc kubenswrapper[5120]: I0316 16:35:17.989895 5120 scope.go:117] "RemoveContainer" containerID="64a1b4ea06c9be28645cfb7ff5443bd3d95d204193caacc5e442cc6c653f2176" Mar 16 16:35:17 crc kubenswrapper[5120]: I0316 16:35:17.990266 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64a1b4ea06c9be28645cfb7ff5443bd3d95d204193caacc5e442cc6c653f2176"} err="failed to get container status \"64a1b4ea06c9be28645cfb7ff5443bd3d95d204193caacc5e442cc6c653f2176\": rpc error: code = NotFound desc = could not find container \"64a1b4ea06c9be28645cfb7ff5443bd3d95d204193caacc5e442cc6c653f2176\": container with ID starting with 64a1b4ea06c9be28645cfb7ff5443bd3d95d204193caacc5e442cc6c653f2176 not found: ID does not exist" Mar 16 16:35:17 crc kubenswrapper[5120]: I0316 16:35:17.990295 5120 scope.go:117] "RemoveContainer" containerID="5aa6331f9621c81bb92d77cc6b8423483b3d4e52f6d47e2b08dee62ef3ad47a0" Mar 16 16:35:17 crc kubenswrapper[5120]: I0316 16:35:17.991330 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5aa6331f9621c81bb92d77cc6b8423483b3d4e52f6d47e2b08dee62ef3ad47a0"} err="failed to get container status \"5aa6331f9621c81bb92d77cc6b8423483b3d4e52f6d47e2b08dee62ef3ad47a0\": rpc error: code = NotFound desc = could not find container \"5aa6331f9621c81bb92d77cc6b8423483b3d4e52f6d47e2b08dee62ef3ad47a0\": container with ID starting with 5aa6331f9621c81bb92d77cc6b8423483b3d4e52f6d47e2b08dee62ef3ad47a0 not found: ID does not exist" Mar 16 16:35:17 crc kubenswrapper[5120]: I0316 16:35:17.991354 5120 scope.go:117] "RemoveContainer" containerID="c08cba5a20adcf460548b921816266c5ad327372c87ad9251b60f3622811b1ae" Mar 16 16:35:17 crc kubenswrapper[5120]: I0316 16:35:17.991682 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c08cba5a20adcf460548b921816266c5ad327372c87ad9251b60f3622811b1ae"} err="failed to get container status \"c08cba5a20adcf460548b921816266c5ad327372c87ad9251b60f3622811b1ae\": rpc error: code = NotFound desc = could not find container \"c08cba5a20adcf460548b921816266c5ad327372c87ad9251b60f3622811b1ae\": container with ID starting with c08cba5a20adcf460548b921816266c5ad327372c87ad9251b60f3622811b1ae not found: ID does not exist" Mar 16 16:35:17 crc kubenswrapper[5120]: I0316 16:35:17.991738 5120 scope.go:117] "RemoveContainer" containerID="53547576c13b4e2d2b2ed200e15a8147cf02a4125aec8d5bcb1c3a361db1125e" Mar 16 16:35:17 crc kubenswrapper[5120]: I0316 16:35:17.992177 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53547576c13b4e2d2b2ed200e15a8147cf02a4125aec8d5bcb1c3a361db1125e"} err="failed to get container status \"53547576c13b4e2d2b2ed200e15a8147cf02a4125aec8d5bcb1c3a361db1125e\": rpc error: code = NotFound desc = could not find container \"53547576c13b4e2d2b2ed200e15a8147cf02a4125aec8d5bcb1c3a361db1125e\": container with ID starting with 53547576c13b4e2d2b2ed200e15a8147cf02a4125aec8d5bcb1c3a361db1125e not found: ID does not exist" Mar 16 16:35:17 crc kubenswrapper[5120]: I0316 16:35:17.992200 5120 scope.go:117] "RemoveContainer" containerID="64a1b4ea06c9be28645cfb7ff5443bd3d95d204193caacc5e442cc6c653f2176" Mar 16 16:35:17 crc kubenswrapper[5120]: I0316 16:35:17.992406 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64a1b4ea06c9be28645cfb7ff5443bd3d95d204193caacc5e442cc6c653f2176"} err="failed to get container status \"64a1b4ea06c9be28645cfb7ff5443bd3d95d204193caacc5e442cc6c653f2176\": rpc error: code = NotFound desc = could not find container \"64a1b4ea06c9be28645cfb7ff5443bd3d95d204193caacc5e442cc6c653f2176\": container with ID starting with 64a1b4ea06c9be28645cfb7ff5443bd3d95d204193caacc5e442cc6c653f2176 not found: ID does not exist" Mar 16 16:35:17 crc kubenswrapper[5120]: I0316 16:35:17.992495 5120 scope.go:117] "RemoveContainer" containerID="5aa6331f9621c81bb92d77cc6b8423483b3d4e52f6d47e2b08dee62ef3ad47a0" Mar 16 16:35:17 crc kubenswrapper[5120]: I0316 16:35:17.992779 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5aa6331f9621c81bb92d77cc6b8423483b3d4e52f6d47e2b08dee62ef3ad47a0"} err="failed to get container status \"5aa6331f9621c81bb92d77cc6b8423483b3d4e52f6d47e2b08dee62ef3ad47a0\": rpc error: code = NotFound desc = could not find container \"5aa6331f9621c81bb92d77cc6b8423483b3d4e52f6d47e2b08dee62ef3ad47a0\": container with ID starting with 5aa6331f9621c81bb92d77cc6b8423483b3d4e52f6d47e2b08dee62ef3ad47a0 not found: ID does not exist" Mar 16 16:35:17 crc kubenswrapper[5120]: I0316 16:35:17.992807 5120 scope.go:117] "RemoveContainer" containerID="c08cba5a20adcf460548b921816266c5ad327372c87ad9251b60f3622811b1ae" Mar 16 16:35:17 crc kubenswrapper[5120]: I0316 16:35:17.993053 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c08cba5a20adcf460548b921816266c5ad327372c87ad9251b60f3622811b1ae"} err="failed to get container status \"c08cba5a20adcf460548b921816266c5ad327372c87ad9251b60f3622811b1ae\": rpc error: code = NotFound desc = could not find container \"c08cba5a20adcf460548b921816266c5ad327372c87ad9251b60f3622811b1ae\": container with ID starting with c08cba5a20adcf460548b921816266c5ad327372c87ad9251b60f3622811b1ae not found: ID does not exist" Mar 16 16:35:17 crc kubenswrapper[5120]: I0316 16:35:17.993152 5120 scope.go:117] "RemoveContainer" containerID="53547576c13b4e2d2b2ed200e15a8147cf02a4125aec8d5bcb1c3a361db1125e" Mar 16 16:35:17 crc kubenswrapper[5120]: I0316 16:35:17.993574 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53547576c13b4e2d2b2ed200e15a8147cf02a4125aec8d5bcb1c3a361db1125e"} err="failed to get container status \"53547576c13b4e2d2b2ed200e15a8147cf02a4125aec8d5bcb1c3a361db1125e\": rpc error: code = NotFound desc = could not find container \"53547576c13b4e2d2b2ed200e15a8147cf02a4125aec8d5bcb1c3a361db1125e\": container with ID starting with 53547576c13b4e2d2b2ed200e15a8147cf02a4125aec8d5bcb1c3a361db1125e not found: ID does not exist" Mar 16 16:35:17 crc kubenswrapper[5120]: I0316 16:35:17.993599 5120 scope.go:117] "RemoveContainer" containerID="64a1b4ea06c9be28645cfb7ff5443bd3d95d204193caacc5e442cc6c653f2176" Mar 16 16:35:17 crc kubenswrapper[5120]: I0316 16:35:17.993932 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64a1b4ea06c9be28645cfb7ff5443bd3d95d204193caacc5e442cc6c653f2176"} err="failed to get container status \"64a1b4ea06c9be28645cfb7ff5443bd3d95d204193caacc5e442cc6c653f2176\": rpc error: code = NotFound desc = could not find container \"64a1b4ea06c9be28645cfb7ff5443bd3d95d204193caacc5e442cc6c653f2176\": container with ID starting with 64a1b4ea06c9be28645cfb7ff5443bd3d95d204193caacc5e442cc6c653f2176 not found: ID does not exist" Mar 16 16:35:17 crc kubenswrapper[5120]: I0316 16:35:17.993963 5120 scope.go:117] "RemoveContainer" containerID="5aa6331f9621c81bb92d77cc6b8423483b3d4e52f6d47e2b08dee62ef3ad47a0" Mar 16 16:35:17 crc kubenswrapper[5120]: I0316 16:35:17.994173 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5aa6331f9621c81bb92d77cc6b8423483b3d4e52f6d47e2b08dee62ef3ad47a0"} err="failed to get container status \"5aa6331f9621c81bb92d77cc6b8423483b3d4e52f6d47e2b08dee62ef3ad47a0\": rpc error: code = NotFound desc = could not find container \"5aa6331f9621c81bb92d77cc6b8423483b3d4e52f6d47e2b08dee62ef3ad47a0\": container with ID starting with 5aa6331f9621c81bb92d77cc6b8423483b3d4e52f6d47e2b08dee62ef3ad47a0 not found: ID does not exist" Mar 16 16:35:17 crc kubenswrapper[5120]: I0316 16:35:17.994201 5120 scope.go:117] "RemoveContainer" containerID="c08cba5a20adcf460548b921816266c5ad327372c87ad9251b60f3622811b1ae" Mar 16 16:35:17 crc kubenswrapper[5120]: I0316 16:35:17.994377 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c08cba5a20adcf460548b921816266c5ad327372c87ad9251b60f3622811b1ae"} err="failed to get container status \"c08cba5a20adcf460548b921816266c5ad327372c87ad9251b60f3622811b1ae\": rpc error: code = NotFound desc = could not find container \"c08cba5a20adcf460548b921816266c5ad327372c87ad9251b60f3622811b1ae\": container with ID starting with c08cba5a20adcf460548b921816266c5ad327372c87ad9251b60f3622811b1ae not found: ID does not exist" Mar 16 16:35:17 crc kubenswrapper[5120]: I0316 16:35:17.994399 5120 scope.go:117] "RemoveContainer" containerID="53547576c13b4e2d2b2ed200e15a8147cf02a4125aec8d5bcb1c3a361db1125e" Mar 16 16:35:17 crc kubenswrapper[5120]: I0316 16:35:17.994802 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53547576c13b4e2d2b2ed200e15a8147cf02a4125aec8d5bcb1c3a361db1125e"} err="failed to get container status \"53547576c13b4e2d2b2ed200e15a8147cf02a4125aec8d5bcb1c3a361db1125e\": rpc error: code = NotFound desc = could not find container \"53547576c13b4e2d2b2ed200e15a8147cf02a4125aec8d5bcb1c3a361db1125e\": container with ID starting with 53547576c13b4e2d2b2ed200e15a8147cf02a4125aec8d5bcb1c3a361db1125e not found: ID does not exist" Mar 16 16:35:18 crc kubenswrapper[5120]: I0316 16:35:18.085782 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/4093a7c4-51d9-4119-8e47-c06f29723894-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"4093a7c4-51d9-4119-8e47-c06f29723894\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:35:18 crc kubenswrapper[5120]: I0316 16:35:18.085836 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4093a7c4-51d9-4119-8e47-c06f29723894-config-data\") pod \"ceilometer-0\" (UID: \"4093a7c4-51d9-4119-8e47-c06f29723894\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:35:18 crc kubenswrapper[5120]: I0316 16:35:18.085922 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/4093a7c4-51d9-4119-8e47-c06f29723894-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"4093a7c4-51d9-4119-8e47-c06f29723894\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:35:18 crc kubenswrapper[5120]: I0316 16:35:18.086006 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/4093a7c4-51d9-4119-8e47-c06f29723894-log-httpd\") pod \"ceilometer-0\" (UID: \"4093a7c4-51d9-4119-8e47-c06f29723894\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:35:18 crc kubenswrapper[5120]: I0316 16:35:18.086050 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c5dq8\" (UniqueName: \"kubernetes.io/projected/4093a7c4-51d9-4119-8e47-c06f29723894-kube-api-access-c5dq8\") pod \"ceilometer-0\" (UID: \"4093a7c4-51d9-4119-8e47-c06f29723894\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:35:18 crc kubenswrapper[5120]: I0316 16:35:18.086149 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4093a7c4-51d9-4119-8e47-c06f29723894-scripts\") pod \"ceilometer-0\" (UID: \"4093a7c4-51d9-4119-8e47-c06f29723894\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:35:18 crc kubenswrapper[5120]: I0316 16:35:18.086188 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4093a7c4-51d9-4119-8e47-c06f29723894-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"4093a7c4-51d9-4119-8e47-c06f29723894\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:35:18 crc kubenswrapper[5120]: I0316 16:35:18.086240 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/4093a7c4-51d9-4119-8e47-c06f29723894-run-httpd\") pod \"ceilometer-0\" (UID: \"4093a7c4-51d9-4119-8e47-c06f29723894\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:35:18 crc kubenswrapper[5120]: I0316 16:35:18.086717 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/4093a7c4-51d9-4119-8e47-c06f29723894-run-httpd\") pod \"ceilometer-0\" (UID: \"4093a7c4-51d9-4119-8e47-c06f29723894\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:35:18 crc kubenswrapper[5120]: I0316 16:35:18.088000 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/4093a7c4-51d9-4119-8e47-c06f29723894-log-httpd\") pod \"ceilometer-0\" (UID: \"4093a7c4-51d9-4119-8e47-c06f29723894\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:35:18 crc kubenswrapper[5120]: I0316 16:35:18.091896 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/4093a7c4-51d9-4119-8e47-c06f29723894-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"4093a7c4-51d9-4119-8e47-c06f29723894\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:35:18 crc kubenswrapper[5120]: I0316 16:35:18.093089 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4093a7c4-51d9-4119-8e47-c06f29723894-scripts\") pod \"ceilometer-0\" (UID: \"4093a7c4-51d9-4119-8e47-c06f29723894\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:35:18 crc kubenswrapper[5120]: I0316 16:35:18.093476 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4093a7c4-51d9-4119-8e47-c06f29723894-config-data\") pod \"ceilometer-0\" (UID: \"4093a7c4-51d9-4119-8e47-c06f29723894\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:35:18 crc kubenswrapper[5120]: I0316 16:35:18.093830 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/4093a7c4-51d9-4119-8e47-c06f29723894-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"4093a7c4-51d9-4119-8e47-c06f29723894\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:35:18 crc kubenswrapper[5120]: I0316 16:35:18.105418 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4093a7c4-51d9-4119-8e47-c06f29723894-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"4093a7c4-51d9-4119-8e47-c06f29723894\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:35:18 crc kubenswrapper[5120]: I0316 16:35:18.107934 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5dq8\" (UniqueName: \"kubernetes.io/projected/4093a7c4-51d9-4119-8e47-c06f29723894-kube-api-access-c5dq8\") pod \"ceilometer-0\" (UID: \"4093a7c4-51d9-4119-8e47-c06f29723894\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:35:18 crc kubenswrapper[5120]: I0316 16:35:18.287575 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:35:18 crc kubenswrapper[5120]: I0316 16:35:18.676647 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1b4d71ef-4a0e-4e99-8cf4-c541830d7379" path="/var/lib/kubelet/pods/1b4d71ef-4a0e-4e99-8cf4-c541830d7379/volumes" Mar 16 16:35:18 crc kubenswrapper[5120]: W0316 16:35:18.738811 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4093a7c4_51d9_4119_8e47_c06f29723894.slice/crio-7f14f40d832c0ae5ef9636a53cb87d30eb157abd9081c75337edcbd56e308a26 WatchSource:0}: Error finding container 7f14f40d832c0ae5ef9636a53cb87d30eb157abd9081c75337edcbd56e308a26: Status 404 returned error can't find the container with id 7f14f40d832c0ae5ef9636a53cb87d30eb157abd9081c75337edcbd56e308a26 Mar 16 16:35:18 crc kubenswrapper[5120]: I0316 16:35:18.738976 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:35:18 crc kubenswrapper[5120]: I0316 16:35:18.819806 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"4093a7c4-51d9-4119-8e47-c06f29723894","Type":"ContainerStarted","Data":"7f14f40d832c0ae5ef9636a53cb87d30eb157abd9081c75337edcbd56e308a26"} Mar 16 16:35:20 crc kubenswrapper[5120]: I0316 16:35:20.663969 5120 scope.go:117] "RemoveContainer" containerID="0a15d5caff30dc8885f782e59962af7d98d58b39ab76059e56e5827e10e7ab8b" Mar 16 16:35:20 crc kubenswrapper[5120]: E0316 16:35:20.664567 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:35:20 crc kubenswrapper[5120]: I0316 16:35:20.850079 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"4093a7c4-51d9-4119-8e47-c06f29723894","Type":"ContainerStarted","Data":"60385fabe480fed7555f36dc6f1b4459b21a84b49a3a1f92af6eb03c6e2df9c9"} Mar 16 16:35:21 crc kubenswrapper[5120]: I0316 16:35:21.863904 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"4093a7c4-51d9-4119-8e47-c06f29723894","Type":"ContainerStarted","Data":"90578380dd3689e88764f9ad9d1a470340f3570e79e4db8d8c234d43e57fa7e3"} Mar 16 16:35:22 crc kubenswrapper[5120]: I0316 16:35:22.890503 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"4093a7c4-51d9-4119-8e47-c06f29723894","Type":"ContainerStarted","Data":"5fc6451d2a211fee6ddf7a8ff791952c877013378fed995f98d0db78c21a3e5f"} Mar 16 16:35:23 crc kubenswrapper[5120]: I0316 16:35:23.435950 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:35:23 crc kubenswrapper[5120]: I0316 16:35:23.436337 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:35:24 crc kubenswrapper[5120]: I0316 16:35:24.440924 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="b8725613-8c6b-4e92-9ff7-c9aeaff10f59" containerName="nova-api-api" probeResult="failure" output="Get \"https://10.217.0.203:8774/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Mar 16 16:35:24 crc kubenswrapper[5120]: I0316 16:35:24.443943 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="b8725613-8c6b-4e92-9ff7-c9aeaff10f59" containerName="nova-api-log" probeResult="failure" output="Get \"https://10.217.0.203:8774/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Mar 16 16:35:24 crc kubenswrapper[5120]: I0316 16:35:24.900716 5120 scope.go:117] "RemoveContainer" containerID="7eb3a4bef235ab6c4850c61fa77e495251ecc771a2506cc7be8d021f127aa208" Mar 16 16:35:24 crc kubenswrapper[5120]: I0316 16:35:24.928355 5120 scope.go:117] "RemoveContainer" containerID="0eeb60bb39860d8f23bc80ce0eabaf70f69230cb0654b4562cd5bc025b36adf6" Mar 16 16:35:24 crc kubenswrapper[5120]: I0316 16:35:24.990047 5120 scope.go:117] "RemoveContainer" containerID="e7447c12a77855e08a7c6509353d29f19a1a02ab402d93177bba6026dd48d33d" Mar 16 16:35:25 crc kubenswrapper[5120]: I0316 16:35:25.010380 5120 scope.go:117] "RemoveContainer" containerID="0e4dcbb62b536f5017ac2b27bbeb0a2a06a41a12753b01b90712287f20bed196" Mar 16 16:35:25 crc kubenswrapper[5120]: I0316 16:35:25.030346 5120 scope.go:117] "RemoveContainer" containerID="01172870e91626ffd852c4fe4da6c0fea0d09cbb096d4d5ae8471ddded640a29" Mar 16 16:35:25 crc kubenswrapper[5120]: I0316 16:35:25.923688 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"4093a7c4-51d9-4119-8e47-c06f29723894","Type":"ContainerStarted","Data":"b745117a770fe11c46e5d61e279fc7ab89054b2bf87b4f50cde54ce2c47689c6"} Mar 16 16:35:25 crc kubenswrapper[5120]: I0316 16:35:25.924279 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:35:25 crc kubenswrapper[5120]: I0316 16:35:25.959557 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.342468507 podStartE2EDuration="8.959533359s" podCreationTimestamp="2026-03-16 16:35:17 +0000 UTC" firstStartedPulling="2026-03-16 16:35:18.741146085 +0000 UTC m=+3820.895077742" lastFinishedPulling="2026-03-16 16:35:25.358210937 +0000 UTC m=+3827.512142594" observedRunningTime="2026-03-16 16:35:25.946869868 +0000 UTC m=+3828.100801545" watchObservedRunningTime="2026-03-16 16:35:25.959533359 +0000 UTC m=+3828.113465016" Mar 16 16:35:31 crc kubenswrapper[5120]: I0316 16:35:31.436084 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:35:31 crc kubenswrapper[5120]: I0316 16:35:31.436786 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:35:32 crc kubenswrapper[5120]: I0316 16:35:32.664363 5120 scope.go:117] "RemoveContainer" containerID="0a15d5caff30dc8885f782e59962af7d98d58b39ab76059e56e5827e10e7ab8b" Mar 16 16:35:32 crc kubenswrapper[5120]: E0316 16:35:32.665079 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:35:33 crc kubenswrapper[5120]: I0316 16:35:33.445223 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:35:33 crc kubenswrapper[5120]: I0316 16:35:33.445304 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:35:33 crc kubenswrapper[5120]: I0316 16:35:33.452889 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:35:33 crc kubenswrapper[5120]: I0316 16:35:33.454134 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:35:44 crc kubenswrapper[5120]: I0316 16:35:44.663739 5120 scope.go:117] "RemoveContainer" containerID="0a15d5caff30dc8885f782e59962af7d98d58b39ab76059e56e5827e10e7ab8b" Mar 16 16:35:44 crc kubenswrapper[5120]: E0316 16:35:44.664464 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:35:56 crc kubenswrapper[5120]: I0316 16:35:56.674837 5120 scope.go:117] "RemoveContainer" containerID="0a15d5caff30dc8885f782e59962af7d98d58b39ab76059e56e5827e10e7ab8b" Mar 16 16:35:56 crc kubenswrapper[5120]: E0316 16:35:56.675665 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:35:56 crc kubenswrapper[5120]: I0316 16:35:56.942054 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:36:00 crc kubenswrapper[5120]: I0316 16:36:00.150733 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-infra/auto-csr-approver-29561316-m6nsl"] Mar 16 16:36:00 crc kubenswrapper[5120]: I0316 16:36:00.160591 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561316-m6nsl" Mar 16 16:36:00 crc kubenswrapper[5120]: I0316 16:36:00.162684 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561316-m6nsl"] Mar 16 16:36:00 crc kubenswrapper[5120]: I0316 16:36:00.166412 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"openshift-service-ca.crt\"" Mar 16 16:36:00 crc kubenswrapper[5120]: I0316 16:36:00.166618 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-infra\"/\"csr-approver-sa-dockercfg-x2nsz\"" Mar 16 16:36:00 crc kubenswrapper[5120]: I0316 16:36:00.167067 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"kube-root-ca.crt\"" Mar 16 16:36:00 crc kubenswrapper[5120]: I0316 16:36:00.223815 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22qjv\" (UniqueName: \"kubernetes.io/projected/cab9c74d-69a9-44ee-965f-bd31954a1976-kube-api-access-22qjv\") pod \"auto-csr-approver-29561316-m6nsl\" (UID: \"cab9c74d-69a9-44ee-965f-bd31954a1976\") " pod="openshift-infra/auto-csr-approver-29561316-m6nsl" Mar 16 16:36:00 crc kubenswrapper[5120]: I0316 16:36:00.255484 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 16:36:00 crc kubenswrapper[5120]: I0316 16:36:00.312343 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 16:36:00 crc kubenswrapper[5120]: I0316 16:36:00.312785 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/memcached-0" podUID="9998e1ac-8e55-4be8-8b49-ff3f7434b699" containerName="memcached" containerID="cri-o://feaf6123410f7a55102df33a09bc007e0934725d3b55bc9552638bb6be54ab98" gracePeriod=30 Mar 16 16:36:00 crc kubenswrapper[5120]: I0316 16:36:00.328509 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 16:36:00 crc kubenswrapper[5120]: I0316 16:36:00.329326 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podUID="4e17300c-81c6-4f7f-a4ae-4e3e04e27bc2" containerName="openstack-network-exporter" containerID="cri-o://1c712f1ab4a4bf6db5d6a3ef760d82aab111911989481abe53cf8716a0fae5f5" gracePeriod=300 Mar 16 16:36:00 crc kubenswrapper[5120]: I0316 16:36:00.330028 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-22qjv\" (UniqueName: \"kubernetes.io/projected/cab9c74d-69a9-44ee-965f-bd31954a1976-kube-api-access-22qjv\") pod \"auto-csr-approver-29561316-m6nsl\" (UID: \"cab9c74d-69a9-44ee-965f-bd31954a1976\") " pod="openshift-infra/auto-csr-approver-29561316-m6nsl" Mar 16 16:36:00 crc kubenswrapper[5120]: I0316 16:36:00.348850 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 16:36:00 crc kubenswrapper[5120]: I0316 16:36:00.380747 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 16:36:00 crc kubenswrapper[5120]: I0316 16:36:00.387286 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-22qjv\" (UniqueName: \"kubernetes.io/projected/cab9c74d-69a9-44ee-965f-bd31954a1976-kube-api-access-22qjv\") pod \"auto-csr-approver-29561316-m6nsl\" (UID: \"cab9c74d-69a9-44ee-965f-bd31954a1976\") " pod="openshift-infra/auto-csr-approver-29561316-m6nsl" Mar 16 16:36:00 crc kubenswrapper[5120]: I0316 16:36:00.400114 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 16:36:00 crc kubenswrapper[5120]: I0316 16:36:00.400520 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovn-northd-0" podUID="b338d0b9-ef27-4f2b-9ede-7b8c7bdc340c" containerName="ovn-northd" containerID="cri-o://ca9d3b2a88dcee0195ef7ca1ee4e2649b606030f101dabe1372a8df6254de533" gracePeriod=30 Mar 16 16:36:00 crc kubenswrapper[5120]: I0316 16:36:00.400781 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovn-northd-0" podUID="b338d0b9-ef27-4f2b-9ede-7b8c7bdc340c" containerName="openstack-network-exporter" containerID="cri-o://73db1999d966547a044d3aaec5511a5efc66907f7326abbc3f17534a8a44887e" gracePeriod=30 Mar 16 16:36:00 crc kubenswrapper[5120]: I0316 16:36:00.470458 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podUID="4e17300c-81c6-4f7f-a4ae-4e3e04e27bc2" containerName="ovsdbserver-nb" containerID="cri-o://bb4b7b2d023f41d825191da2f6b23e84c1c5f2e32e37e7b1e1677ac812bbde7c" gracePeriod=300 Mar 16 16:36:00 crc kubenswrapper[5120]: I0316 16:36:00.493114 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561316-m6nsl" Mar 16 16:36:00 crc kubenswrapper[5120]: I0316 16:36:00.510908 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 16:36:00 crc kubenswrapper[5120]: I0316 16:36:00.597891 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 16:36:00 crc kubenswrapper[5120]: I0316 16:36:00.598223 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podUID="0bcb2925-74a9-4e24-b7bc-a6e5bf665e85" containerName="openstack-network-exporter" containerID="cri-o://043def99c65b5ced43f64fecfe74484bb82998b03aaf4b66e3b2c0cf56a692a5" gracePeriod=300 Mar 16 16:36:00 crc kubenswrapper[5120]: I0316 16:36:00.658802 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-wl7hj"] Mar 16 16:36:00 crc kubenswrapper[5120]: I0316 16:36:00.691379 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-wl7hj"] Mar 16 16:36:00 crc kubenswrapper[5120]: I0316 16:36:00.708961 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-bmmdk"] Mar 16 16:36:00 crc kubenswrapper[5120]: I0316 16:36:00.812374 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-bmmdk"] Mar 16 16:36:00 crc kubenswrapper[5120]: I0316 16:36:00.847457 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-vqvr9"] Mar 16 16:36:00 crc kubenswrapper[5120]: I0316 16:36:00.898734 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-vqvr9" Mar 16 16:36:00 crc kubenswrapper[5120]: I0316 16:36:00.906204 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-lb7cd"] Mar 16 16:36:00 crc kubenswrapper[5120]: I0316 16:36:00.943022 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/openstack-cell1-galera-0" podUID="d24d09c6-d2a8-418d-8ddf-a5e64672f554" containerName="galera" containerID="cri-o://da18e02e60563fdf4b993a489a08f0afac75c00cbf47e05276bd0256d2e32f2c" gracePeriod=30 Mar 16 16:36:00 crc kubenswrapper[5120]: I0316 16:36:00.948272 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podUID="0bcb2925-74a9-4e24-b7bc-a6e5bf665e85" containerName="ovsdbserver-sb" containerID="cri-o://29dab27e446b0853e54b0515784441c770aa038f9edc982a5d8d601206692ff9" gracePeriod=300 Mar 16 16:36:00 crc kubenswrapper[5120]: I0316 16:36:00.955321 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-vqvr9"] Mar 16 16:36:00 crc kubenswrapper[5120]: I0316 16:36:00.973827 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-lb7cd"] Mar 16 16:36:00 crc kubenswrapper[5120]: I0316 16:36:00.994917 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-5fdqd"] Mar 16 16:36:01 crc kubenswrapper[5120]: E0316 16:36:01.002730 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of ca9d3b2a88dcee0195ef7ca1ee4e2649b606030f101dabe1372a8df6254de533 is running failed: container process not found" containerID="ca9d3b2a88dcee0195ef7ca1ee4e2649b606030f101dabe1372a8df6254de533" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Mar 16 16:36:01 crc kubenswrapper[5120]: E0316 16:36:01.003043 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of ca9d3b2a88dcee0195ef7ca1ee4e2649b606030f101dabe1372a8df6254de533 is running failed: container process not found" containerID="ca9d3b2a88dcee0195ef7ca1ee4e2649b606030f101dabe1372a8df6254de533" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Mar 16 16:36:01 crc kubenswrapper[5120]: E0316 16:36:01.003369 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of ca9d3b2a88dcee0195ef7ca1ee4e2649b606030f101dabe1372a8df6254de533 is running failed: container process not found" containerID="ca9d3b2a88dcee0195ef7ca1ee4e2649b606030f101dabe1372a8df6254de533" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Mar 16 16:36:01 crc kubenswrapper[5120]: E0316 16:36:01.003396 5120 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of ca9d3b2a88dcee0195ef7ca1ee4e2649b606030f101dabe1372a8df6254de533 is running failed: container process not found" probeType="Readiness" pod="openstack-kuttl-tests/ovn-northd-0" podUID="b338d0b9-ef27-4f2b-9ede-7b8c7bdc340c" containerName="ovn-northd" probeResult="unknown" Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.008874 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d9bb0c66-45a6-4915-8878-03f17055f4ab-combined-ca-bundle\") pod \"keystone-db-sync-vqvr9\" (UID: \"d9bb0c66-45a6-4915-8878-03f17055f4ab\") " pod="openstack-kuttl-tests/keystone-db-sync-vqvr9" Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.009051 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d9bb0c66-45a6-4915-8878-03f17055f4ab-config-data\") pod \"keystone-db-sync-vqvr9\" (UID: \"d9bb0c66-45a6-4915-8878-03f17055f4ab\") " pod="openstack-kuttl-tests/keystone-db-sync-vqvr9" Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.009082 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5xzj\" (UniqueName: \"kubernetes.io/projected/d9bb0c66-45a6-4915-8878-03f17055f4ab-kube-api-access-t5xzj\") pod \"keystone-db-sync-vqvr9\" (UID: \"d9bb0c66-45a6-4915-8878-03f17055f4ab\") " pod="openstack-kuttl-tests/keystone-db-sync-vqvr9" Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.029960 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-5fdqd"] Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.054877 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-db-sync-bmfrv"] Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.082326 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-bmfrv" Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.094620 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-d42sq"] Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.105648 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-d42sq" Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.111515 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d9bb0c66-45a6-4915-8878-03f17055f4ab-combined-ca-bundle\") pod \"keystone-db-sync-vqvr9\" (UID: \"d9bb0c66-45a6-4915-8878-03f17055f4ab\") " pod="openstack-kuttl-tests/keystone-db-sync-vqvr9" Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.111692 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d9bb0c66-45a6-4915-8878-03f17055f4ab-config-data\") pod \"keystone-db-sync-vqvr9\" (UID: \"d9bb0c66-45a6-4915-8878-03f17055f4ab\") " pod="openstack-kuttl-tests/keystone-db-sync-vqvr9" Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.111726 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t5xzj\" (UniqueName: \"kubernetes.io/projected/d9bb0c66-45a6-4915-8878-03f17055f4ab-kube-api-access-t5xzj\") pod \"keystone-db-sync-vqvr9\" (UID: \"d9bb0c66-45a6-4915-8878-03f17055f4ab\") " pod="openstack-kuttl-tests/keystone-db-sync-vqvr9" Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.123641 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d9bb0c66-45a6-4915-8878-03f17055f4ab-combined-ca-bundle\") pod \"keystone-db-sync-vqvr9\" (UID: \"d9bb0c66-45a6-4915-8878-03f17055f4ab\") " pod="openstack-kuttl-tests/keystone-db-sync-vqvr9" Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.123748 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d9bb0c66-45a6-4915-8878-03f17055f4ab-config-data\") pod \"keystone-db-sync-vqvr9\" (UID: \"d9bb0c66-45a6-4915-8878-03f17055f4ab\") " pod="openstack-kuttl-tests/keystone-db-sync-vqvr9" Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.148586 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-bmfrv"] Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.149381 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5xzj\" (UniqueName: \"kubernetes.io/projected/d9bb0c66-45a6-4915-8878-03f17055f4ab-kube-api-access-t5xzj\") pod \"keystone-db-sync-vqvr9\" (UID: \"d9bb0c66-45a6-4915-8878-03f17055f4ab\") " pod="openstack-kuttl-tests/keystone-db-sync-vqvr9" Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.158378 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/openstack-galera-0" podUID="f8b2ced8-a236-4ae1-88cd-7f14c5aee21b" containerName="galera" containerID="cri-o://a6da655c3ab3c081a862ed09a600b2b898335b09cbe7c305e5bbc8934c874f4b" gracePeriod=30 Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.167378 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-db-sync-b5trh"] Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.189421 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-b5trh" Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.197715 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-config-data\"" Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.201192 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-d42sq"] Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.214198 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87hzc\" (UniqueName: \"kubernetes.io/projected/d0d98630-1fca-41f0-ba40-03f42f303121-kube-api-access-87hzc\") pod \"placement-db-sync-bmfrv\" (UID: \"d0d98630-1fca-41f0-ba40-03f42f303121\") " pod="openstack-kuttl-tests/placement-db-sync-bmfrv" Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.214291 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/7ecbc5c7-9802-4143-bba3-6552d5b8e3ba-etc-machine-id\") pod \"cinder-db-sync-d42sq\" (UID: \"7ecbc5c7-9802-4143-bba3-6552d5b8e3ba\") " pod="openstack-kuttl-tests/cinder-db-sync-d42sq" Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.214340 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6pj5\" (UniqueName: \"kubernetes.io/projected/7ecbc5c7-9802-4143-bba3-6552d5b8e3ba-kube-api-access-z6pj5\") pod \"cinder-db-sync-d42sq\" (UID: \"7ecbc5c7-9802-4143-bba3-6552d5b8e3ba\") " pod="openstack-kuttl-tests/cinder-db-sync-d42sq" Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.214377 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d0d98630-1fca-41f0-ba40-03f42f303121-logs\") pod \"placement-db-sync-bmfrv\" (UID: \"d0d98630-1fca-41f0-ba40-03f42f303121\") " pod="openstack-kuttl-tests/placement-db-sync-bmfrv" Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.214426 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d0d98630-1fca-41f0-ba40-03f42f303121-config-data\") pod \"placement-db-sync-bmfrv\" (UID: \"d0d98630-1fca-41f0-ba40-03f42f303121\") " pod="openstack-kuttl-tests/placement-db-sync-bmfrv" Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.214454 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7ecbc5c7-9802-4143-bba3-6552d5b8e3ba-combined-ca-bundle\") pod \"cinder-db-sync-d42sq\" (UID: \"7ecbc5c7-9802-4143-bba3-6552d5b8e3ba\") " pod="openstack-kuttl-tests/cinder-db-sync-d42sq" Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.214646 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/7ecbc5c7-9802-4143-bba3-6552d5b8e3ba-db-sync-config-data\") pod \"cinder-db-sync-d42sq\" (UID: \"7ecbc5c7-9802-4143-bba3-6552d5b8e3ba\") " pod="openstack-kuttl-tests/cinder-db-sync-d42sq" Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.214676 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7ecbc5c7-9802-4143-bba3-6552d5b8e3ba-scripts\") pod \"cinder-db-sync-d42sq\" (UID: \"7ecbc5c7-9802-4143-bba3-6552d5b8e3ba\") " pod="openstack-kuttl-tests/cinder-db-sync-d42sq" Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.218199 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7ecbc5c7-9802-4143-bba3-6552d5b8e3ba-config-data\") pod \"cinder-db-sync-d42sq\" (UID: \"7ecbc5c7-9802-4143-bba3-6552d5b8e3ba\") " pod="openstack-kuttl-tests/cinder-db-sync-d42sq" Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.218364 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d0d98630-1fca-41f0-ba40-03f42f303121-combined-ca-bundle\") pod \"placement-db-sync-bmfrv\" (UID: \"d0d98630-1fca-41f0-ba40-03f42f303121\") " pod="openstack-kuttl-tests/placement-db-sync-bmfrv" Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.218422 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d0d98630-1fca-41f0-ba40-03f42f303121-scripts\") pod \"placement-db-sync-bmfrv\" (UID: \"d0d98630-1fca-41f0-ba40-03f42f303121\") " pod="openstack-kuttl-tests/placement-db-sync-bmfrv" Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.229031 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-b5trh"] Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.265155 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-vqvr9" Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.266192 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-bp5pw"] Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.273727 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-northd-0_b338d0b9-ef27-4f2b-9ede-7b8c7bdc340c/ovn-northd/0.log" Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.273983 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.296407 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-bp5pw"] Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.320968 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d0d98630-1fca-41f0-ba40-03f42f303121-combined-ca-bundle\") pod \"placement-db-sync-bmfrv\" (UID: \"d0d98630-1fca-41f0-ba40-03f42f303121\") " pod="openstack-kuttl-tests/placement-db-sync-bmfrv" Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.321274 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d0d98630-1fca-41f0-ba40-03f42f303121-scripts\") pod \"placement-db-sync-bmfrv\" (UID: \"d0d98630-1fca-41f0-ba40-03f42f303121\") " pod="openstack-kuttl-tests/placement-db-sync-bmfrv" Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.321414 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/91d6af93-90b1-4d80-86df-11a701664a68-config-data\") pod \"glance-db-sync-b5trh\" (UID: \"91d6af93-90b1-4d80-86df-11a701664a68\") " pod="openstack-kuttl-tests/glance-db-sync-b5trh" Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.321594 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-87hzc\" (UniqueName: \"kubernetes.io/projected/d0d98630-1fca-41f0-ba40-03f42f303121-kube-api-access-87hzc\") pod \"placement-db-sync-bmfrv\" (UID: \"d0d98630-1fca-41f0-ba40-03f42f303121\") " pod="openstack-kuttl-tests/placement-db-sync-bmfrv" Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.321712 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/7ecbc5c7-9802-4143-bba3-6552d5b8e3ba-etc-machine-id\") pod \"cinder-db-sync-d42sq\" (UID: \"7ecbc5c7-9802-4143-bba3-6552d5b8e3ba\") " pod="openstack-kuttl-tests/cinder-db-sync-d42sq" Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.321839 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z6pj5\" (UniqueName: \"kubernetes.io/projected/7ecbc5c7-9802-4143-bba3-6552d5b8e3ba-kube-api-access-z6pj5\") pod \"cinder-db-sync-d42sq\" (UID: \"7ecbc5c7-9802-4143-bba3-6552d5b8e3ba\") " pod="openstack-kuttl-tests/cinder-db-sync-d42sq" Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.321975 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d0d98630-1fca-41f0-ba40-03f42f303121-logs\") pod \"placement-db-sync-bmfrv\" (UID: \"d0d98630-1fca-41f0-ba40-03f42f303121\") " pod="openstack-kuttl-tests/placement-db-sync-bmfrv" Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.322099 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d0d98630-1fca-41f0-ba40-03f42f303121-config-data\") pod \"placement-db-sync-bmfrv\" (UID: \"d0d98630-1fca-41f0-ba40-03f42f303121\") " pod="openstack-kuttl-tests/placement-db-sync-bmfrv" Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.322206 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7ecbc5c7-9802-4143-bba3-6552d5b8e3ba-combined-ca-bundle\") pod \"cinder-db-sync-d42sq\" (UID: \"7ecbc5c7-9802-4143-bba3-6552d5b8e3ba\") " pod="openstack-kuttl-tests/cinder-db-sync-d42sq" Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.322405 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/91d6af93-90b1-4d80-86df-11a701664a68-db-sync-config-data\") pod \"glance-db-sync-b5trh\" (UID: \"91d6af93-90b1-4d80-86df-11a701664a68\") " pod="openstack-kuttl-tests/glance-db-sync-b5trh" Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.322552 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f85dt\" (UniqueName: \"kubernetes.io/projected/91d6af93-90b1-4d80-86df-11a701664a68-kube-api-access-f85dt\") pod \"glance-db-sync-b5trh\" (UID: \"91d6af93-90b1-4d80-86df-11a701664a68\") " pod="openstack-kuttl-tests/glance-db-sync-b5trh" Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.322694 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/7ecbc5c7-9802-4143-bba3-6552d5b8e3ba-db-sync-config-data\") pod \"cinder-db-sync-d42sq\" (UID: \"7ecbc5c7-9802-4143-bba3-6552d5b8e3ba\") " pod="openstack-kuttl-tests/cinder-db-sync-d42sq" Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.322851 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7ecbc5c7-9802-4143-bba3-6552d5b8e3ba-scripts\") pod \"cinder-db-sync-d42sq\" (UID: \"7ecbc5c7-9802-4143-bba3-6552d5b8e3ba\") " pod="openstack-kuttl-tests/cinder-db-sync-d42sq" Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.323020 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7ecbc5c7-9802-4143-bba3-6552d5b8e3ba-config-data\") pod \"cinder-db-sync-d42sq\" (UID: \"7ecbc5c7-9802-4143-bba3-6552d5b8e3ba\") " pod="openstack-kuttl-tests/cinder-db-sync-d42sq" Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.323139 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/91d6af93-90b1-4d80-86df-11a701664a68-combined-ca-bundle\") pod \"glance-db-sync-b5trh\" (UID: \"91d6af93-90b1-4d80-86df-11a701664a68\") " pod="openstack-kuttl-tests/glance-db-sync-b5trh" Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.321988 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/7ecbc5c7-9802-4143-bba3-6552d5b8e3ba-etc-machine-id\") pod \"cinder-db-sync-d42sq\" (UID: \"7ecbc5c7-9802-4143-bba3-6552d5b8e3ba\") " pod="openstack-kuttl-tests/cinder-db-sync-d42sq" Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.322436 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d0d98630-1fca-41f0-ba40-03f42f303121-logs\") pod \"placement-db-sync-bmfrv\" (UID: \"d0d98630-1fca-41f0-ba40-03f42f303121\") " pod="openstack-kuttl-tests/placement-db-sync-bmfrv" Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.330303 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/7ecbc5c7-9802-4143-bba3-6552d5b8e3ba-db-sync-config-data\") pod \"cinder-db-sync-d42sq\" (UID: \"7ecbc5c7-9802-4143-bba3-6552d5b8e3ba\") " pod="openstack-kuttl-tests/cinder-db-sync-d42sq" Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.330354 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d0d98630-1fca-41f0-ba40-03f42f303121-scripts\") pod \"placement-db-sync-bmfrv\" (UID: \"d0d98630-1fca-41f0-ba40-03f42f303121\") " pod="openstack-kuttl-tests/placement-db-sync-bmfrv" Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.330546 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7ecbc5c7-9802-4143-bba3-6552d5b8e3ba-combined-ca-bundle\") pod \"cinder-db-sync-d42sq\" (UID: \"7ecbc5c7-9802-4143-bba3-6552d5b8e3ba\") " pod="openstack-kuttl-tests/cinder-db-sync-d42sq" Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.331151 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d0d98630-1fca-41f0-ba40-03f42f303121-combined-ca-bundle\") pod \"placement-db-sync-bmfrv\" (UID: \"d0d98630-1fca-41f0-ba40-03f42f303121\") " pod="openstack-kuttl-tests/placement-db-sync-bmfrv" Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.336602 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-northd-0_b338d0b9-ef27-4f2b-9ede-7b8c7bdc340c/ovn-northd/0.log" Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.336643 5120 generic.go:358] "Generic (PLEG): container finished" podID="b338d0b9-ef27-4f2b-9ede-7b8c7bdc340c" containerID="73db1999d966547a044d3aaec5511a5efc66907f7326abbc3f17534a8a44887e" exitCode=2 Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.336657 5120 generic.go:358] "Generic (PLEG): container finished" podID="b338d0b9-ef27-4f2b-9ede-7b8c7bdc340c" containerID="ca9d3b2a88dcee0195ef7ca1ee4e2649b606030f101dabe1372a8df6254de533" exitCode=143 Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.336963 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"b338d0b9-ef27-4f2b-9ede-7b8c7bdc340c","Type":"ContainerDied","Data":"73db1999d966547a044d3aaec5511a5efc66907f7326abbc3f17534a8a44887e"} Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.336992 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"b338d0b9-ef27-4f2b-9ede-7b8c7bdc340c","Type":"ContainerDied","Data":"ca9d3b2a88dcee0195ef7ca1ee4e2649b606030f101dabe1372a8df6254de533"} Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.337003 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"b338d0b9-ef27-4f2b-9ede-7b8c7bdc340c","Type":"ContainerDied","Data":"6ccf8a98e432490306536dca38893b0c1d5e70dc92a31b9969c331f0c11e831f"} Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.337018 5120 scope.go:117] "RemoveContainer" containerID="73db1999d966547a044d3aaec5511a5efc66907f7326abbc3f17534a8a44887e" Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.337073 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.337592 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d0d98630-1fca-41f0-ba40-03f42f303121-config-data\") pod \"placement-db-sync-bmfrv\" (UID: \"d0d98630-1fca-41f0-ba40-03f42f303121\") " pod="openstack-kuttl-tests/placement-db-sync-bmfrv" Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.340543 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7ecbc5c7-9802-4143-bba3-6552d5b8e3ba-config-data\") pod \"cinder-db-sync-d42sq\" (UID: \"7ecbc5c7-9802-4143-bba3-6552d5b8e3ba\") " pod="openstack-kuttl-tests/cinder-db-sync-d42sq" Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.342369 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7ecbc5c7-9802-4143-bba3-6552d5b8e3ba-scripts\") pod \"cinder-db-sync-d42sq\" (UID: \"7ecbc5c7-9802-4143-bba3-6552d5b8e3ba\") " pod="openstack-kuttl-tests/cinder-db-sync-d42sq" Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.357648 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-87hzc\" (UniqueName: \"kubernetes.io/projected/d0d98630-1fca-41f0-ba40-03f42f303121-kube-api-access-87hzc\") pod \"placement-db-sync-bmfrv\" (UID: \"d0d98630-1fca-41f0-ba40-03f42f303121\") " pod="openstack-kuttl-tests/placement-db-sync-bmfrv" Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.362817 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6pj5\" (UniqueName: \"kubernetes.io/projected/7ecbc5c7-9802-4143-bba3-6552d5b8e3ba-kube-api-access-z6pj5\") pod \"cinder-db-sync-d42sq\" (UID: \"7ecbc5c7-9802-4143-bba3-6552d5b8e3ba\") " pod="openstack-kuttl-tests/cinder-db-sync-d42sq" Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.382565 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_0bcb2925-74a9-4e24-b7bc-a6e5bf665e85/ovsdbserver-sb/0.log" Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.382626 5120 generic.go:358] "Generic (PLEG): container finished" podID="0bcb2925-74a9-4e24-b7bc-a6e5bf665e85" containerID="043def99c65b5ced43f64fecfe74484bb82998b03aaf4b66e3b2c0cf56a692a5" exitCode=2 Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.382645 5120 generic.go:358] "Generic (PLEG): container finished" podID="0bcb2925-74a9-4e24-b7bc-a6e5bf665e85" containerID="29dab27e446b0853e54b0515784441c770aa038f9edc982a5d8d601206692ff9" exitCode=143 Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.382944 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"0bcb2925-74a9-4e24-b7bc-a6e5bf665e85","Type":"ContainerDied","Data":"043def99c65b5ced43f64fecfe74484bb82998b03aaf4b66e3b2c0cf56a692a5"} Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.382987 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"0bcb2925-74a9-4e24-b7bc-a6e5bf665e85","Type":"ContainerDied","Data":"29dab27e446b0853e54b0515784441c770aa038f9edc982a5d8d601206692ff9"} Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.402499 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_4e17300c-81c6-4f7f-a4ae-4e3e04e27bc2/ovsdbserver-nb/0.log" Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.413820 5120 generic.go:358] "Generic (PLEG): container finished" podID="4e17300c-81c6-4f7f-a4ae-4e3e04e27bc2" containerID="1c712f1ab4a4bf6db5d6a3ef760d82aab111911989481abe53cf8716a0fae5f5" exitCode=2 Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.413919 5120 generic.go:358] "Generic (PLEG): container finished" podID="4e17300c-81c6-4f7f-a4ae-4e3e04e27bc2" containerID="bb4b7b2d023f41d825191da2f6b23e84c1c5f2e32e37e7b1e1677ac812bbde7c" exitCode=143 Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.414121 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"4e17300c-81c6-4f7f-a4ae-4e3e04e27bc2","Type":"ContainerDied","Data":"1c712f1ab4a4bf6db5d6a3ef760d82aab111911989481abe53cf8716a0fae5f5"} Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.414209 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"4e17300c-81c6-4f7f-a4ae-4e3e04e27bc2","Type":"ContainerDied","Data":"bb4b7b2d023f41d825191da2f6b23e84c1c5f2e32e37e7b1e1677ac812bbde7c"} Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.416613 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-bmfrv" Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.424554 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/b338d0b9-ef27-4f2b-9ede-7b8c7bdc340c-scripts\") pod \"b338d0b9-ef27-4f2b-9ede-7b8c7bdc340c\" (UID: \"b338d0b9-ef27-4f2b-9ede-7b8c7bdc340c\") " Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.424656 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b338d0b9-ef27-4f2b-9ede-7b8c7bdc340c-combined-ca-bundle\") pod \"b338d0b9-ef27-4f2b-9ede-7b8c7bdc340c\" (UID: \"b338d0b9-ef27-4f2b-9ede-7b8c7bdc340c\") " Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.424791 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b338d0b9-ef27-4f2b-9ede-7b8c7bdc340c-config\") pod \"b338d0b9-ef27-4f2b-9ede-7b8c7bdc340c\" (UID: \"b338d0b9-ef27-4f2b-9ede-7b8c7bdc340c\") " Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.424854 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-glwdx\" (UniqueName: \"kubernetes.io/projected/b338d0b9-ef27-4f2b-9ede-7b8c7bdc340c-kube-api-access-glwdx\") pod \"b338d0b9-ef27-4f2b-9ede-7b8c7bdc340c\" (UID: \"b338d0b9-ef27-4f2b-9ede-7b8c7bdc340c\") " Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.425029 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/b338d0b9-ef27-4f2b-9ede-7b8c7bdc340c-metrics-certs-tls-certs\") pod \"b338d0b9-ef27-4f2b-9ede-7b8c7bdc340c\" (UID: \"b338d0b9-ef27-4f2b-9ede-7b8c7bdc340c\") " Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.425142 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/b338d0b9-ef27-4f2b-9ede-7b8c7bdc340c-ovn-northd-tls-certs\") pod \"b338d0b9-ef27-4f2b-9ede-7b8c7bdc340c\" (UID: \"b338d0b9-ef27-4f2b-9ede-7b8c7bdc340c\") " Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.426434 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b338d0b9-ef27-4f2b-9ede-7b8c7bdc340c-config" (OuterVolumeSpecName: "config") pod "b338d0b9-ef27-4f2b-9ede-7b8c7bdc340c" (UID: "b338d0b9-ef27-4f2b-9ede-7b8c7bdc340c"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.426636 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b338d0b9-ef27-4f2b-9ede-7b8c7bdc340c-scripts" (OuterVolumeSpecName: "scripts") pod "b338d0b9-ef27-4f2b-9ede-7b8c7bdc340c" (UID: "b338d0b9-ef27-4f2b-9ede-7b8c7bdc340c"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.429874 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/b338d0b9-ef27-4f2b-9ede-7b8c7bdc340c-ovn-rundir\") pod \"b338d0b9-ef27-4f2b-9ede-7b8c7bdc340c\" (UID: \"b338d0b9-ef27-4f2b-9ede-7b8c7bdc340c\") " Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.430449 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/91d6af93-90b1-4d80-86df-11a701664a68-config-data\") pod \"glance-db-sync-b5trh\" (UID: \"91d6af93-90b1-4d80-86df-11a701664a68\") " pod="openstack-kuttl-tests/glance-db-sync-b5trh" Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.430884 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/91d6af93-90b1-4d80-86df-11a701664a68-db-sync-config-data\") pod \"glance-db-sync-b5trh\" (UID: \"91d6af93-90b1-4d80-86df-11a701664a68\") " pod="openstack-kuttl-tests/glance-db-sync-b5trh" Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.431029 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f85dt\" (UniqueName: \"kubernetes.io/projected/91d6af93-90b1-4d80-86df-11a701664a68-kube-api-access-f85dt\") pod \"glance-db-sync-b5trh\" (UID: \"91d6af93-90b1-4d80-86df-11a701664a68\") " pod="openstack-kuttl-tests/glance-db-sync-b5trh" Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.431257 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/91d6af93-90b1-4d80-86df-11a701664a68-combined-ca-bundle\") pod \"glance-db-sync-b5trh\" (UID: \"91d6af93-90b1-4d80-86df-11a701664a68\") " pod="openstack-kuttl-tests/glance-db-sync-b5trh" Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.431473 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/b338d0b9-ef27-4f2b-9ede-7b8c7bdc340c-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.431559 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b338d0b9-ef27-4f2b-9ede-7b8c7bdc340c-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.433712 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-r8627"] Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.442288 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/91d6af93-90b1-4d80-86df-11a701664a68-combined-ca-bundle\") pod \"glance-db-sync-b5trh\" (UID: \"91d6af93-90b1-4d80-86df-11a701664a68\") " pod="openstack-kuttl-tests/glance-db-sync-b5trh" Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.442718 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b338d0b9-ef27-4f2b-9ede-7b8c7bdc340c-ovn-rundir" (OuterVolumeSpecName: "ovn-rundir") pod "b338d0b9-ef27-4f2b-9ede-7b8c7bdc340c" (UID: "b338d0b9-ef27-4f2b-9ede-7b8c7bdc340c"). InnerVolumeSpecName "ovn-rundir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.444208 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b338d0b9-ef27-4f2b-9ede-7b8c7bdc340c-kube-api-access-glwdx" (OuterVolumeSpecName: "kube-api-access-glwdx") pod "b338d0b9-ef27-4f2b-9ede-7b8c7bdc340c" (UID: "b338d0b9-ef27-4f2b-9ede-7b8c7bdc340c"). InnerVolumeSpecName "kube-api-access-glwdx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.452003 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b338d0b9-ef27-4f2b-9ede-7b8c7bdc340c" containerName="openstack-network-exporter" Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.452104 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="b338d0b9-ef27-4f2b-9ede-7b8c7bdc340c" containerName="openstack-network-exporter" Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.452213 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b338d0b9-ef27-4f2b-9ede-7b8c7bdc340c" containerName="ovn-northd" Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.452286 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="b338d0b9-ef27-4f2b-9ede-7b8c7bdc340c" containerName="ovn-northd" Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.452556 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="b338d0b9-ef27-4f2b-9ede-7b8c7bdc340c" containerName="openstack-network-exporter" Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.452636 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="b338d0b9-ef27-4f2b-9ede-7b8c7bdc340c" containerName="ovn-northd" Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.465155 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-d42sq" Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.472569 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-r8627" Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.479274 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/91d6af93-90b1-4d80-86df-11a701664a68-config-data\") pod \"glance-db-sync-b5trh\" (UID: \"91d6af93-90b1-4d80-86df-11a701664a68\") " pod="openstack-kuttl-tests/glance-db-sync-b5trh" Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.491258 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/91d6af93-90b1-4d80-86df-11a701664a68-db-sync-config-data\") pod \"glance-db-sync-b5trh\" (UID: \"91d6af93-90b1-4d80-86df-11a701664a68\") " pod="openstack-kuttl-tests/glance-db-sync-b5trh" Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.522503 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f85dt\" (UniqueName: \"kubernetes.io/projected/91d6af93-90b1-4d80-86df-11a701664a68-kube-api-access-f85dt\") pod \"glance-db-sync-b5trh\" (UID: \"91d6af93-90b1-4d80-86df-11a701664a68\") " pod="openstack-kuttl-tests/glance-db-sync-b5trh" Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.526280 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-r8627"] Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.535472 5120 reconciler_common.go:299] "Volume detached for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/b338d0b9-ef27-4f2b-9ede-7b8c7bdc340c-ovn-rundir\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.535521 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-glwdx\" (UniqueName: \"kubernetes.io/projected/b338d0b9-ef27-4f2b-9ede-7b8c7bdc340c-kube-api-access-glwdx\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.542160 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b338d0b9-ef27-4f2b-9ede-7b8c7bdc340c-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "b338d0b9-ef27-4f2b-9ede-7b8c7bdc340c" (UID: "b338d0b9-ef27-4f2b-9ede-7b8c7bdc340c"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.610497 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b338d0b9-ef27-4f2b-9ede-7b8c7bdc340c-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "b338d0b9-ef27-4f2b-9ede-7b8c7bdc340c" (UID: "b338d0b9-ef27-4f2b-9ede-7b8c7bdc340c"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.641227 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1b9d0a58-9639-4577-9b99-d34345657929-config\") pod \"neutron-db-sync-r8627\" (UID: \"1b9d0a58-9639-4577-9b99-d34345657929\") " pod="openstack-kuttl-tests/neutron-db-sync-r8627" Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.641521 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ltjl\" (UniqueName: \"kubernetes.io/projected/1b9d0a58-9639-4577-9b99-d34345657929-kube-api-access-5ltjl\") pod \"neutron-db-sync-r8627\" (UID: \"1b9d0a58-9639-4577-9b99-d34345657929\") " pod="openstack-kuttl-tests/neutron-db-sync-r8627" Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.641600 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1b9d0a58-9639-4577-9b99-d34345657929-combined-ca-bundle\") pod \"neutron-db-sync-r8627\" (UID: \"1b9d0a58-9639-4577-9b99-d34345657929\") " pod="openstack-kuttl-tests/neutron-db-sync-r8627" Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.641804 5120 reconciler_common.go:299] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/b338d0b9-ef27-4f2b-9ede-7b8c7bdc340c-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.641816 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b338d0b9-ef27-4f2b-9ede-7b8c7bdc340c-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.649464 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.649706 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podUID="364bfdcf-9673-41c8-b692-941d68257973" containerName="nova-cell1-novncproxy-novncproxy" containerID="cri-o://3436ec6db1208b559eb91d991c3a73a3c9159ecad9eb1aeb50786f88a3c7bc52" gracePeriod=30 Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.725891 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/memcached-0" podUID="9998e1ac-8e55-4be8-8b49-ff3f7434b699" containerName="memcached" probeResult="failure" output="dial tcp 10.217.0.113:11211: connect: connection refused" Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.749075 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-g6hww"] Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.749428 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1b9d0a58-9639-4577-9b99-d34345657929-config\") pod \"neutron-db-sync-r8627\" (UID: \"1b9d0a58-9639-4577-9b99-d34345657929\") " pod="openstack-kuttl-tests/neutron-db-sync-r8627" Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.750181 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5ltjl\" (UniqueName: \"kubernetes.io/projected/1b9d0a58-9639-4577-9b99-d34345657929-kube-api-access-5ltjl\") pod \"neutron-db-sync-r8627\" (UID: \"1b9d0a58-9639-4577-9b99-d34345657929\") " pod="openstack-kuttl-tests/neutron-db-sync-r8627" Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.750512 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1b9d0a58-9639-4577-9b99-d34345657929-combined-ca-bundle\") pod \"neutron-db-sync-r8627\" (UID: \"1b9d0a58-9639-4577-9b99-d34345657929\") " pod="openstack-kuttl-tests/neutron-db-sync-r8627" Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.776150 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/1b9d0a58-9639-4577-9b99-d34345657929-config\") pod \"neutron-db-sync-r8627\" (UID: \"1b9d0a58-9639-4577-9b99-d34345657929\") " pod="openstack-kuttl-tests/neutron-db-sync-r8627" Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.778225 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1b9d0a58-9639-4577-9b99-d34345657929-combined-ca-bundle\") pod \"neutron-db-sync-r8627\" (UID: \"1b9d0a58-9639-4577-9b99-d34345657929\") " pod="openstack-kuttl-tests/neutron-db-sync-r8627" Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.787593 5120 scope.go:117] "RemoveContainer" containerID="ca9d3b2a88dcee0195ef7ca1ee4e2649b606030f101dabe1372a8df6254de533" Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.808168 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b338d0b9-ef27-4f2b-9ede-7b8c7bdc340c-ovn-northd-tls-certs" (OuterVolumeSpecName: "ovn-northd-tls-certs") pod "b338d0b9-ef27-4f2b-9ede-7b8c7bdc340c" (UID: "b338d0b9-ef27-4f2b-9ede-7b8c7bdc340c"). InnerVolumeSpecName "ovn-northd-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.816150 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_4e17300c-81c6-4f7f-a4ae-4e3e04e27bc2/ovsdbserver-nb/0.log" Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.816235 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.819023 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-b5trh" Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.853708 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ltjl\" (UniqueName: \"kubernetes.io/projected/1b9d0a58-9639-4577-9b99-d34345657929-kube-api-access-5ltjl\") pod \"neutron-db-sync-r8627\" (UID: \"1b9d0a58-9639-4577-9b99-d34345657929\") " pod="openstack-kuttl-tests/neutron-db-sync-r8627" Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.855342 5120 reconciler_common.go:299] "Volume detached for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/b338d0b9-ef27-4f2b-9ede-7b8c7bdc340c-ovn-northd-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.864839 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-g6hww"] Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.923861 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-89ftb"] Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.946324 5120 scope.go:117] "RemoveContainer" containerID="73db1999d966547a044d3aaec5511a5efc66907f7326abbc3f17534a8a44887e" Mar 16 16:36:01 crc kubenswrapper[5120]: E0316 16:36:01.952000 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"73db1999d966547a044d3aaec5511a5efc66907f7326abbc3f17534a8a44887e\": container with ID starting with 73db1999d966547a044d3aaec5511a5efc66907f7326abbc3f17534a8a44887e not found: ID does not exist" containerID="73db1999d966547a044d3aaec5511a5efc66907f7326abbc3f17534a8a44887e" Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.952049 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73db1999d966547a044d3aaec5511a5efc66907f7326abbc3f17534a8a44887e"} err="failed to get container status \"73db1999d966547a044d3aaec5511a5efc66907f7326abbc3f17534a8a44887e\": rpc error: code = NotFound desc = could not find container \"73db1999d966547a044d3aaec5511a5efc66907f7326abbc3f17534a8a44887e\": container with ID starting with 73db1999d966547a044d3aaec5511a5efc66907f7326abbc3f17534a8a44887e not found: ID does not exist" Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.952078 5120 scope.go:117] "RemoveContainer" containerID="ca9d3b2a88dcee0195ef7ca1ee4e2649b606030f101dabe1372a8df6254de533" Mar 16 16:36:01 crc kubenswrapper[5120]: E0316 16:36:01.958945 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca9d3b2a88dcee0195ef7ca1ee4e2649b606030f101dabe1372a8df6254de533\": container with ID starting with ca9d3b2a88dcee0195ef7ca1ee4e2649b606030f101dabe1372a8df6254de533 not found: ID does not exist" containerID="ca9d3b2a88dcee0195ef7ca1ee4e2649b606030f101dabe1372a8df6254de533" Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.959030 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca9d3b2a88dcee0195ef7ca1ee4e2649b606030f101dabe1372a8df6254de533"} err="failed to get container status \"ca9d3b2a88dcee0195ef7ca1ee4e2649b606030f101dabe1372a8df6254de533\": rpc error: code = NotFound desc = could not find container \"ca9d3b2a88dcee0195ef7ca1ee4e2649b606030f101dabe1372a8df6254de533\": container with ID starting with ca9d3b2a88dcee0195ef7ca1ee4e2649b606030f101dabe1372a8df6254de533 not found: ID does not exist" Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.959059 5120 scope.go:117] "RemoveContainer" containerID="73db1999d966547a044d3aaec5511a5efc66907f7326abbc3f17534a8a44887e" Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.959927 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/4e17300c-81c6-4f7f-a4ae-4e3e04e27bc2-ovsdb-rundir\") pod \"4e17300c-81c6-4f7f-a4ae-4e3e04e27bc2\" (UID: \"4e17300c-81c6-4f7f-a4ae-4e3e04e27bc2\") " Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.960000 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4e17300c-81c6-4f7f-a4ae-4e3e04e27bc2-combined-ca-bundle\") pod \"4e17300c-81c6-4f7f-a4ae-4e3e04e27bc2\" (UID: \"4e17300c-81c6-4f7f-a4ae-4e3e04e27bc2\") " Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.960114 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovndbcluster-nb-etc-ovn\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"4e17300c-81c6-4f7f-a4ae-4e3e04e27bc2\" (UID: \"4e17300c-81c6-4f7f-a4ae-4e3e04e27bc2\") " Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.960363 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4e17300c-81c6-4f7f-a4ae-4e3e04e27bc2-config\") pod \"4e17300c-81c6-4f7f-a4ae-4e3e04e27bc2\" (UID: \"4e17300c-81c6-4f7f-a4ae-4e3e04e27bc2\") " Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.960669 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/4e17300c-81c6-4f7f-a4ae-4e3e04e27bc2-scripts\") pod \"4e17300c-81c6-4f7f-a4ae-4e3e04e27bc2\" (UID: \"4e17300c-81c6-4f7f-a4ae-4e3e04e27bc2\") " Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.960715 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/4e17300c-81c6-4f7f-a4ae-4e3e04e27bc2-metrics-certs-tls-certs\") pod \"4e17300c-81c6-4f7f-a4ae-4e3e04e27bc2\" (UID: \"4e17300c-81c6-4f7f-a4ae-4e3e04e27bc2\") " Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.960739 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cjkqf\" (UniqueName: \"kubernetes.io/projected/4e17300c-81c6-4f7f-a4ae-4e3e04e27bc2-kube-api-access-cjkqf\") pod \"4e17300c-81c6-4f7f-a4ae-4e3e04e27bc2\" (UID: \"4e17300c-81c6-4f7f-a4ae-4e3e04e27bc2\") " Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.962893 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/4e17300c-81c6-4f7f-a4ae-4e3e04e27bc2-ovsdbserver-nb-tls-certs\") pod \"4e17300c-81c6-4f7f-a4ae-4e3e04e27bc2\" (UID: \"4e17300c-81c6-4f7f-a4ae-4e3e04e27bc2\") " Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.964949 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e17300c-81c6-4f7f-a4ae-4e3e04e27bc2-ovsdb-rundir" (OuterVolumeSpecName: "ovsdb-rundir") pod "4e17300c-81c6-4f7f-a4ae-4e3e04e27bc2" (UID: "4e17300c-81c6-4f7f-a4ae-4e3e04e27bc2"). InnerVolumeSpecName "ovsdb-rundir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.965984 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73db1999d966547a044d3aaec5511a5efc66907f7326abbc3f17534a8a44887e"} err="failed to get container status \"73db1999d966547a044d3aaec5511a5efc66907f7326abbc3f17534a8a44887e\": rpc error: code = NotFound desc = could not find container \"73db1999d966547a044d3aaec5511a5efc66907f7326abbc3f17534a8a44887e\": container with ID starting with 73db1999d966547a044d3aaec5511a5efc66907f7326abbc3f17534a8a44887e not found: ID does not exist" Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.966031 5120 scope.go:117] "RemoveContainer" containerID="ca9d3b2a88dcee0195ef7ca1ee4e2649b606030f101dabe1372a8df6254de533" Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.966934 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4e17300c-81c6-4f7f-a4ae-4e3e04e27bc2-config" (OuterVolumeSpecName: "config") pod "4e17300c-81c6-4f7f-a4ae-4e3e04e27bc2" (UID: "4e17300c-81c6-4f7f-a4ae-4e3e04e27bc2"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.968360 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4e17300c-81c6-4f7f-a4ae-4e3e04e27bc2-scripts" (OuterVolumeSpecName: "scripts") pod "4e17300c-81c6-4f7f-a4ae-4e3e04e27bc2" (UID: "4e17300c-81c6-4f7f-a4ae-4e3e04e27bc2"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:36:01 crc kubenswrapper[5120]: I0316 16:36:01.980880 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca9d3b2a88dcee0195ef7ca1ee4e2649b606030f101dabe1372a8df6254de533"} err="failed to get container status \"ca9d3b2a88dcee0195ef7ca1ee4e2649b606030f101dabe1372a8df6254de533\": rpc error: code = NotFound desc = could not find container \"ca9d3b2a88dcee0195ef7ca1ee4e2649b606030f101dabe1372a8df6254de533\": container with ID starting with ca9d3b2a88dcee0195ef7ca1ee4e2649b606030f101dabe1372a8df6254de533 not found: ID does not exist" Mar 16 16:36:02 crc kubenswrapper[5120]: I0316 16:36:02.002375 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e17300c-81c6-4f7f-a4ae-4e3e04e27bc2-kube-api-access-cjkqf" (OuterVolumeSpecName: "kube-api-access-cjkqf") pod "4e17300c-81c6-4f7f-a4ae-4e3e04e27bc2" (UID: "4e17300c-81c6-4f7f-a4ae-4e3e04e27bc2"). InnerVolumeSpecName "kube-api-access-cjkqf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:36:02 crc kubenswrapper[5120]: I0316 16:36:02.015698 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_0bcb2925-74a9-4e24-b7bc-a6e5bf665e85/ovsdbserver-sb/0.log" Mar 16 16:36:02 crc kubenswrapper[5120]: I0316 16:36:02.015838 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:36:02 crc kubenswrapper[5120]: I0316 16:36:02.018443 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage12-crc" (OuterVolumeSpecName: "ovndbcluster-nb-etc-ovn") pod "4e17300c-81c6-4f7f-a4ae-4e3e04e27bc2" (UID: "4e17300c-81c6-4f7f-a4ae-4e3e04e27bc2"). InnerVolumeSpecName "local-storage12-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:36:02 crc kubenswrapper[5120]: E0316 16:36:02.058625 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="da18e02e60563fdf4b993a489a08f0afac75c00cbf47e05276bd0256d2e32f2c" cmd=["/bin/bash","/var/lib/operator-scripts/mysql_probe.sh","readiness"] Mar 16 16:36:02 crc kubenswrapper[5120]: I0316 16:36:02.079017 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4e17300c-81c6-4f7f-a4ae-4e3e04e27bc2-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "4e17300c-81c6-4f7f-a4ae-4e3e04e27bc2" (UID: "4e17300c-81c6-4f7f-a4ae-4e3e04e27bc2"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:36:02 crc kubenswrapper[5120]: I0316 16:36:02.079659 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4e17300c-81c6-4f7f-a4ae-4e3e04e27bc2-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:02 crc kubenswrapper[5120]: I0316 16:36:02.079684 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/4e17300c-81c6-4f7f-a4ae-4e3e04e27bc2-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:02 crc kubenswrapper[5120]: I0316 16:36:02.079695 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cjkqf\" (UniqueName: \"kubernetes.io/projected/4e17300c-81c6-4f7f-a4ae-4e3e04e27bc2-kube-api-access-cjkqf\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:02 crc kubenswrapper[5120]: I0316 16:36:02.079705 5120 reconciler_common.go:299] "Volume detached for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/4e17300c-81c6-4f7f-a4ae-4e3e04e27bc2-ovsdb-rundir\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:02 crc kubenswrapper[5120]: I0316 16:36:02.079714 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4e17300c-81c6-4f7f-a4ae-4e3e04e27bc2-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:02 crc kubenswrapper[5120]: I0316 16:36:02.079737 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") on node \"crc\" " Mar 16 16:36:02 crc kubenswrapper[5120]: E0316 16:36:02.080018 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="da18e02e60563fdf4b993a489a08f0afac75c00cbf47e05276bd0256d2e32f2c" cmd=["/bin/bash","/var/lib/operator-scripts/mysql_probe.sh","readiness"] Mar 16 16:36:02 crc kubenswrapper[5120]: I0316 16:36:02.097205 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-r8627" Mar 16 16:36:02 crc kubenswrapper[5120]: E0316 16:36:02.101716 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="da18e02e60563fdf4b993a489a08f0afac75c00cbf47e05276bd0256d2e32f2c" cmd=["/bin/bash","/var/lib/operator-scripts/mysql_probe.sh","readiness"] Mar 16 16:36:02 crc kubenswrapper[5120]: E0316 16:36:02.101834 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/openstack-cell1-galera-0" podUID="d24d09c6-d2a8-418d-8ddf-a5e64672f554" containerName="galera" probeResult="unknown" Mar 16 16:36:02 crc kubenswrapper[5120]: I0316 16:36:02.136832 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-89ftb"] Mar 16 16:36:02 crc kubenswrapper[5120]: I0316 16:36:02.184010 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0bcb2925-74a9-4e24-b7bc-a6e5bf665e85-config\") pod \"0bcb2925-74a9-4e24-b7bc-a6e5bf665e85\" (UID: \"0bcb2925-74a9-4e24-b7bc-a6e5bf665e85\") " Mar 16 16:36:02 crc kubenswrapper[5120]: I0316 16:36:02.184338 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bk5fr\" (UniqueName: \"kubernetes.io/projected/0bcb2925-74a9-4e24-b7bc-a6e5bf665e85-kube-api-access-bk5fr\") pod \"0bcb2925-74a9-4e24-b7bc-a6e5bf665e85\" (UID: \"0bcb2925-74a9-4e24-b7bc-a6e5bf665e85\") " Mar 16 16:36:02 crc kubenswrapper[5120]: I0316 16:36:02.184403 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/0bcb2925-74a9-4e24-b7bc-a6e5bf665e85-scripts\") pod \"0bcb2925-74a9-4e24-b7bc-a6e5bf665e85\" (UID: \"0bcb2925-74a9-4e24-b7bc-a6e5bf665e85\") " Mar 16 16:36:02 crc kubenswrapper[5120]: I0316 16:36:02.184485 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovndbcluster-sb-etc-ovn\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"0bcb2925-74a9-4e24-b7bc-a6e5bf665e85\" (UID: \"0bcb2925-74a9-4e24-b7bc-a6e5bf665e85\") " Mar 16 16:36:02 crc kubenswrapper[5120]: I0316 16:36:02.184549 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/0bcb2925-74a9-4e24-b7bc-a6e5bf665e85-ovsdb-rundir\") pod \"0bcb2925-74a9-4e24-b7bc-a6e5bf665e85\" (UID: \"0bcb2925-74a9-4e24-b7bc-a6e5bf665e85\") " Mar 16 16:36:02 crc kubenswrapper[5120]: I0316 16:36:02.184734 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/0bcb2925-74a9-4e24-b7bc-a6e5bf665e85-ovsdbserver-sb-tls-certs\") pod \"0bcb2925-74a9-4e24-b7bc-a6e5bf665e85\" (UID: \"0bcb2925-74a9-4e24-b7bc-a6e5bf665e85\") " Mar 16 16:36:02 crc kubenswrapper[5120]: I0316 16:36:02.184800 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0bcb2925-74a9-4e24-b7bc-a6e5bf665e85-combined-ca-bundle\") pod \"0bcb2925-74a9-4e24-b7bc-a6e5bf665e85\" (UID: \"0bcb2925-74a9-4e24-b7bc-a6e5bf665e85\") " Mar 16 16:36:02 crc kubenswrapper[5120]: I0316 16:36:02.184901 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/0bcb2925-74a9-4e24-b7bc-a6e5bf665e85-metrics-certs-tls-certs\") pod \"0bcb2925-74a9-4e24-b7bc-a6e5bf665e85\" (UID: \"0bcb2925-74a9-4e24-b7bc-a6e5bf665e85\") " Mar 16 16:36:02 crc kubenswrapper[5120]: I0316 16:36:02.198013 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0bcb2925-74a9-4e24-b7bc-a6e5bf665e85-scripts" (OuterVolumeSpecName: "scripts") pod "0bcb2925-74a9-4e24-b7bc-a6e5bf665e85" (UID: "0bcb2925-74a9-4e24-b7bc-a6e5bf665e85"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:36:02 crc kubenswrapper[5120]: I0316 16:36:02.198659 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0bcb2925-74a9-4e24-b7bc-a6e5bf665e85-ovsdb-rundir" (OuterVolumeSpecName: "ovsdb-rundir") pod "0bcb2925-74a9-4e24-b7bc-a6e5bf665e85" (UID: "0bcb2925-74a9-4e24-b7bc-a6e5bf665e85"). InnerVolumeSpecName "ovsdb-rundir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:36:02 crc kubenswrapper[5120]: I0316 16:36:02.199272 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0bcb2925-74a9-4e24-b7bc-a6e5bf665e85-config" (OuterVolumeSpecName: "config") pod "0bcb2925-74a9-4e24-b7bc-a6e5bf665e85" (UID: "0bcb2925-74a9-4e24-b7bc-a6e5bf665e85"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:36:02 crc kubenswrapper[5120]: I0316 16:36:02.200904 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-426ss"] Mar 16 16:36:02 crc kubenswrapper[5120]: I0316 16:36:02.202727 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0bcb2925-74a9-4e24-b7bc-a6e5bf665e85" containerName="openstack-network-exporter" Mar 16 16:36:02 crc kubenswrapper[5120]: I0316 16:36:02.202754 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="0bcb2925-74a9-4e24-b7bc-a6e5bf665e85" containerName="openstack-network-exporter" Mar 16 16:36:02 crc kubenswrapper[5120]: I0316 16:36:02.202787 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0bcb2925-74a9-4e24-b7bc-a6e5bf665e85" containerName="ovsdbserver-sb" Mar 16 16:36:02 crc kubenswrapper[5120]: I0316 16:36:02.202794 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="0bcb2925-74a9-4e24-b7bc-a6e5bf665e85" containerName="ovsdbserver-sb" Mar 16 16:36:02 crc kubenswrapper[5120]: I0316 16:36:02.202803 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e17300c-81c6-4f7f-a4ae-4e3e04e27bc2" containerName="ovsdbserver-nb" Mar 16 16:36:02 crc kubenswrapper[5120]: I0316 16:36:02.202810 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e17300c-81c6-4f7f-a4ae-4e3e04e27bc2" containerName="ovsdbserver-nb" Mar 16 16:36:02 crc kubenswrapper[5120]: I0316 16:36:02.202869 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e17300c-81c6-4f7f-a4ae-4e3e04e27bc2" containerName="openstack-network-exporter" Mar 16 16:36:02 crc kubenswrapper[5120]: I0316 16:36:02.202875 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e17300c-81c6-4f7f-a4ae-4e3e04e27bc2" containerName="openstack-network-exporter" Mar 16 16:36:02 crc kubenswrapper[5120]: I0316 16:36:02.203074 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="0bcb2925-74a9-4e24-b7bc-a6e5bf665e85" containerName="ovsdbserver-sb" Mar 16 16:36:02 crc kubenswrapper[5120]: I0316 16:36:02.203083 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="4e17300c-81c6-4f7f-a4ae-4e3e04e27bc2" containerName="openstack-network-exporter" Mar 16 16:36:02 crc kubenswrapper[5120]: I0316 16:36:02.203100 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="0bcb2925-74a9-4e24-b7bc-a6e5bf665e85" containerName="openstack-network-exporter" Mar 16 16:36:02 crc kubenswrapper[5120]: I0316 16:36:02.203108 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="4e17300c-81c6-4f7f-a4ae-4e3e04e27bc2" containerName="ovsdbserver-nb" Mar 16 16:36:02 crc kubenswrapper[5120]: I0316 16:36:02.215162 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0bcb2925-74a9-4e24-b7bc-a6e5bf665e85-kube-api-access-bk5fr" (OuterVolumeSpecName: "kube-api-access-bk5fr") pod "0bcb2925-74a9-4e24-b7bc-a6e5bf665e85" (UID: "0bcb2925-74a9-4e24-b7bc-a6e5bf665e85"). InnerVolumeSpecName "kube-api-access-bk5fr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:36:02 crc kubenswrapper[5120]: I0316 16:36:02.215314 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4e17300c-81c6-4f7f-a4ae-4e3e04e27bc2-ovsdbserver-nb-tls-certs" (OuterVolumeSpecName: "ovsdbserver-nb-tls-certs") pod "4e17300c-81c6-4f7f-a4ae-4e3e04e27bc2" (UID: "4e17300c-81c6-4f7f-a4ae-4e3e04e27bc2"). InnerVolumeSpecName "ovsdbserver-nb-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:36:02 crc kubenswrapper[5120]: I0316 16:36:02.246976 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage04-crc" (OuterVolumeSpecName: "ovndbcluster-sb-etc-ovn") pod "0bcb2925-74a9-4e24-b7bc-a6e5bf665e85" (UID: "0bcb2925-74a9-4e24-b7bc-a6e5bf665e85"). InnerVolumeSpecName "local-storage04-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:36:02 crc kubenswrapper[5120]: I0316 16:36:02.248293 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage12-crc" (UniqueName: "kubernetes.io/local-volume/local-storage12-crc") on node "crc" Mar 16 16:36:02 crc kubenswrapper[5120]: I0316 16:36:02.296639 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-426ss" Mar 16 16:36:02 crc kubenswrapper[5120]: I0316 16:36:02.319813 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c951a6f5-568c-4da3-b6b3-e0310ca934bc-combined-ca-bundle\") pod \"barbican-db-sync-426ss\" (UID: \"c951a6f5-568c-4da3-b6b3-e0310ca934bc\") " pod="openstack-kuttl-tests/barbican-db-sync-426ss" Mar 16 16:36:02 crc kubenswrapper[5120]: I0316 16:36:02.329584 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5t8g\" (UniqueName: \"kubernetes.io/projected/c951a6f5-568c-4da3-b6b3-e0310ca934bc-kube-api-access-q5t8g\") pod \"barbican-db-sync-426ss\" (UID: \"c951a6f5-568c-4da3-b6b3-e0310ca934bc\") " pod="openstack-kuttl-tests/barbican-db-sync-426ss" Mar 16 16:36:02 crc kubenswrapper[5120]: I0316 16:36:02.330471 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/c951a6f5-568c-4da3-b6b3-e0310ca934bc-db-sync-config-data\") pod \"barbican-db-sync-426ss\" (UID: \"c951a6f5-568c-4da3-b6b3-e0310ca934bc\") " pod="openstack-kuttl-tests/barbican-db-sync-426ss" Mar 16 16:36:02 crc kubenswrapper[5120]: I0316 16:36:02.330702 5120 reconciler_common.go:299] "Volume detached for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/4e17300c-81c6-4f7f-a4ae-4e3e04e27bc2-ovsdbserver-nb-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:02 crc kubenswrapper[5120]: I0316 16:36:02.330718 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0bcb2925-74a9-4e24-b7bc-a6e5bf665e85-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:02 crc kubenswrapper[5120]: I0316 16:36:02.330734 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bk5fr\" (UniqueName: \"kubernetes.io/projected/0bcb2925-74a9-4e24-b7bc-a6e5bf665e85-kube-api-access-bk5fr\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:02 crc kubenswrapper[5120]: I0316 16:36:02.330746 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/0bcb2925-74a9-4e24-b7bc-a6e5bf665e85-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:02 crc kubenswrapper[5120]: I0316 16:36:02.330770 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:02 crc kubenswrapper[5120]: I0316 16:36:02.330797 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") on node \"crc\" " Mar 16 16:36:02 crc kubenswrapper[5120]: I0316 16:36:02.330806 5120 reconciler_common.go:299] "Volume detached for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/0bcb2925-74a9-4e24-b7bc-a6e5bf665e85-ovsdb-rundir\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:02 crc kubenswrapper[5120]: I0316 16:36:02.364523 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4e17300c-81c6-4f7f-a4ae-4e3e04e27bc2-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "4e17300c-81c6-4f7f-a4ae-4e3e04e27bc2" (UID: "4e17300c-81c6-4f7f-a4ae-4e3e04e27bc2"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:36:02 crc kubenswrapper[5120]: I0316 16:36:02.502158 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-sdp7k"] Mar 16 16:36:02 crc kubenswrapper[5120]: I0316 16:36:02.532129 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0bcb2925-74a9-4e24-b7bc-a6e5bf665e85-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "0bcb2925-74a9-4e24-b7bc-a6e5bf665e85" (UID: "0bcb2925-74a9-4e24-b7bc-a6e5bf665e85"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:36:02 crc kubenswrapper[5120]: I0316 16:36:02.548705 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q5t8g\" (UniqueName: \"kubernetes.io/projected/c951a6f5-568c-4da3-b6b3-e0310ca934bc-kube-api-access-q5t8g\") pod \"barbican-db-sync-426ss\" (UID: \"c951a6f5-568c-4da3-b6b3-e0310ca934bc\") " pod="openstack-kuttl-tests/barbican-db-sync-426ss" Mar 16 16:36:02 crc kubenswrapper[5120]: I0316 16:36:02.548935 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/c951a6f5-568c-4da3-b6b3-e0310ca934bc-db-sync-config-data\") pod \"barbican-db-sync-426ss\" (UID: \"c951a6f5-568c-4da3-b6b3-e0310ca934bc\") " pod="openstack-kuttl-tests/barbican-db-sync-426ss" Mar 16 16:36:02 crc kubenswrapper[5120]: I0316 16:36:02.549047 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c951a6f5-568c-4da3-b6b3-e0310ca934bc-combined-ca-bundle\") pod \"barbican-db-sync-426ss\" (UID: \"c951a6f5-568c-4da3-b6b3-e0310ca934bc\") " pod="openstack-kuttl-tests/barbican-db-sync-426ss" Mar 16 16:36:02 crc kubenswrapper[5120]: I0316 16:36:02.549276 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0bcb2925-74a9-4e24-b7bc-a6e5bf665e85-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:02 crc kubenswrapper[5120]: I0316 16:36:02.549296 5120 reconciler_common.go:299] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/4e17300c-81c6-4f7f-a4ae-4e3e04e27bc2-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:02 crc kubenswrapper[5120]: I0316 16:36:02.558326 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561316-m6nsl" event={"ID":"cab9c74d-69a9-44ee-965f-bd31954a1976","Type":"ContainerStarted","Data":"e3bbde011fe98da6e54940bf5c8333c6dea9b75b39b4839d7779aeccd30f868d"} Mar 16 16:36:02 crc kubenswrapper[5120]: I0316 16:36:02.570548 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/c951a6f5-568c-4da3-b6b3-e0310ca934bc-db-sync-config-data\") pod \"barbican-db-sync-426ss\" (UID: \"c951a6f5-568c-4da3-b6b3-e0310ca934bc\") " pod="openstack-kuttl-tests/barbican-db-sync-426ss" Mar 16 16:36:02 crc kubenswrapper[5120]: I0316 16:36:02.573652 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c951a6f5-568c-4da3-b6b3-e0310ca934bc-combined-ca-bundle\") pod \"barbican-db-sync-426ss\" (UID: \"c951a6f5-568c-4da3-b6b3-e0310ca934bc\") " pod="openstack-kuttl-tests/barbican-db-sync-426ss" Mar 16 16:36:02 crc kubenswrapper[5120]: I0316 16:36:02.573966 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0bcb2925-74a9-4e24-b7bc-a6e5bf665e85-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "0bcb2925-74a9-4e24-b7bc-a6e5bf665e85" (UID: "0bcb2925-74a9-4e24-b7bc-a6e5bf665e85"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:36:02 crc kubenswrapper[5120]: I0316 16:36:02.577467 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_0bcb2925-74a9-4e24-b7bc-a6e5bf665e85/ovsdbserver-sb/0.log" Mar 16 16:36:02 crc kubenswrapper[5120]: I0316 16:36:02.577794 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"0bcb2925-74a9-4e24-b7bc-a6e5bf665e85","Type":"ContainerDied","Data":"7c25b55c8d2a002fe32d7985ae3d99c930d47eab5fedd9af04ad31f7824809de"} Mar 16 16:36:02 crc kubenswrapper[5120]: I0316 16:36:02.577842 5120 scope.go:117] "RemoveContainer" containerID="043def99c65b5ced43f64fecfe74484bb82998b03aaf4b66e3b2c0cf56a692a5" Mar 16 16:36:02 crc kubenswrapper[5120]: I0316 16:36:02.578060 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:36:02 crc kubenswrapper[5120]: I0316 16:36:02.656890 5120 reconciler_common.go:299] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/0bcb2925-74a9-4e24-b7bc-a6e5bf665e85-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:02 crc kubenswrapper[5120]: I0316 16:36:02.673386 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage04-crc" (UniqueName: "kubernetes.io/local-volume/local-storage04-crc") on node "crc" Mar 16 16:36:02 crc kubenswrapper[5120]: I0316 16:36:02.701516 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_4e17300c-81c6-4f7f-a4ae-4e3e04e27bc2/ovsdbserver-nb/0.log" Mar 16 16:36:02 crc kubenswrapper[5120]: I0316 16:36:02.701823 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:36:02 crc kubenswrapper[5120]: I0316 16:36:02.768553 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:02 crc kubenswrapper[5120]: I0316 16:36:02.777085 5120 scope.go:117] "RemoveContainer" containerID="29dab27e446b0853e54b0515784441c770aa038f9edc982a5d8d601206692ff9" Mar 16 16:36:02 crc kubenswrapper[5120]: I0316 16:36:02.777455 5120 generic.go:358] "Generic (PLEG): container finished" podID="9998e1ac-8e55-4be8-8b49-ff3f7434b699" containerID="feaf6123410f7a55102df33a09bc007e0934725d3b55bc9552638bb6be54ab98" exitCode=0 Mar 16 16:36:02 crc kubenswrapper[5120]: I0316 16:36:02.818883 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5t8g\" (UniqueName: \"kubernetes.io/projected/c951a6f5-568c-4da3-b6b3-e0310ca934bc-kube-api-access-q5t8g\") pod \"barbican-db-sync-426ss\" (UID: \"c951a6f5-568c-4da3-b6b3-e0310ca934bc\") " pod="openstack-kuttl-tests/barbican-db-sync-426ss" Mar 16 16:36:02 crc kubenswrapper[5120]: I0316 16:36:02.829261 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="46f918f9-8750-4631-9cf3-5f060522c045" path="/var/lib/kubelet/pods/46f918f9-8750-4631-9cf3-5f060522c045/volumes" Mar 16 16:36:02 crc kubenswrapper[5120]: I0316 16:36:02.830022 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c5ca400-22f5-457a-987f-0efd2139f18e" path="/var/lib/kubelet/pods/5c5ca400-22f5-457a-987f-0efd2139f18e/volumes" Mar 16 16:36:02 crc kubenswrapper[5120]: I0316 16:36:02.830703 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="75b3e230-9ea5-42dd-8274-44d38ed2bb4c" path="/var/lib/kubelet/pods/75b3e230-9ea5-42dd-8274-44d38ed2bb4c/volumes" Mar 16 16:36:02 crc kubenswrapper[5120]: I0316 16:36:02.839051 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a4244b14-9780-41af-a54c-3535782ca04d" path="/var/lib/kubelet/pods/a4244b14-9780-41af-a54c-3535782ca04d/volumes" Mar 16 16:36:02 crc kubenswrapper[5120]: I0316 16:36:02.846680 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="be43c69b-cb44-44e0-bb6c-a220d59ef207" path="/var/lib/kubelet/pods/be43c69b-cb44-44e0-bb6c-a220d59ef207/volumes" Mar 16 16:36:02 crc kubenswrapper[5120]: I0316 16:36:02.847743 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f21b59e7-258d-40b6-ac7f-14f44058aa3b" path="/var/lib/kubelet/pods/f21b59e7-258d-40b6-ac7f-14f44058aa3b/volumes" Mar 16 16:36:02 crc kubenswrapper[5120]: I0316 16:36:02.848806 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f301c55e-0c1a-4861-9acb-e2cdb9e539f2" path="/var/lib/kubelet/pods/f301c55e-0c1a-4861-9acb-e2cdb9e539f2/volumes" Mar 16 16:36:02 crc kubenswrapper[5120]: I0316 16:36:02.862985 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="63d9a98c-175f-4caa-bd33-41eb82d6e06b" containerName="cinder-scheduler" probeResult="failure" output="HTTP probe failed with statuscode: 500" Mar 16 16:36:02 crc kubenswrapper[5120]: I0316 16:36:02.866568 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0bcb2925-74a9-4e24-b7bc-a6e5bf665e85-ovsdbserver-sb-tls-certs" (OuterVolumeSpecName: "ovsdbserver-sb-tls-certs") pod "0bcb2925-74a9-4e24-b7bc-a6e5bf665e85" (UID: "0bcb2925-74a9-4e24-b7bc-a6e5bf665e85"). InnerVolumeSpecName "ovsdbserver-sb-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:36:02 crc kubenswrapper[5120]: I0316 16:36:02.874647 5120 reconciler_common.go:299] "Volume detached for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/0bcb2925-74a9-4e24-b7bc-a6e5bf665e85-ovsdbserver-sb-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:02 crc kubenswrapper[5120]: I0316 16:36:02.883554 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"4e17300c-81c6-4f7f-a4ae-4e3e04e27bc2","Type":"ContainerDied","Data":"159fe5bebe454d952ad06d8e017b115904c959cc27e4b58ed9cc612d9f866c55"} Mar 16 16:36:02 crc kubenswrapper[5120]: I0316 16:36:02.883815 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"9998e1ac-8e55-4be8-8b49-ff3f7434b699","Type":"ContainerDied","Data":"feaf6123410f7a55102df33a09bc007e0934725d3b55bc9552638bb6be54ab98"} Mar 16 16:36:02 crc kubenswrapper[5120]: I0316 16:36:02.883902 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-sdp7k"] Mar 16 16:36:02 crc kubenswrapper[5120]: I0316 16:36:02.883981 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-s66xx"] Mar 16 16:36:02 crc kubenswrapper[5120]: I0316 16:36:02.906154 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-nhhml"] Mar 16 16:36:02 crc kubenswrapper[5120]: I0316 16:36:02.972684 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-nhhml" Mar 16 16:36:02 crc kubenswrapper[5120]: I0316 16:36:02.986847 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-426ss"] Mar 16 16:36:02 crc kubenswrapper[5120]: I0316 16:36:02.986921 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561316-m6nsl"] Mar 16 16:36:02 crc kubenswrapper[5120]: I0316 16:36:02.988644 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-426ss" Mar 16 16:36:02 crc kubenswrapper[5120]: I0316 16:36:02.997905 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-s66xx"] Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.007664 5120 scope.go:117] "RemoveContainer" containerID="1c712f1ab4a4bf6db5d6a3ef760d82aab111911989481abe53cf8716a0fae5f5" Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.011155 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.020668 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"swift-ring-scripts\"" Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.021293 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"swift-ring-config-data\"" Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.049681 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-nhhml"] Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.079595 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.091536 5120 scope.go:117] "RemoveContainer" containerID="bb4b7b2d023f41d825191da2f6b23e84c1c5f2e32e37e7b1e1677ac812bbde7c" Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.106276 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/1ccbf25a-f71f-4428-ac40-883041c2b302-scripts\") pod \"swift-ring-rebalance-nhhml\" (UID: \"1ccbf25a-f71f-4428-ac40-883041c2b302\") " pod="openstack-kuttl-tests/swift-ring-rebalance-nhhml" Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.110999 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/1ccbf25a-f71f-4428-ac40-883041c2b302-ring-data-devices\") pod \"swift-ring-rebalance-nhhml\" (UID: \"1ccbf25a-f71f-4428-ac40-883041c2b302\") " pod="openstack-kuttl-tests/swift-ring-rebalance-nhhml" Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.111078 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/1ccbf25a-f71f-4428-ac40-883041c2b302-dispersionconf\") pod \"swift-ring-rebalance-nhhml\" (UID: \"1ccbf25a-f71f-4428-ac40-883041c2b302\") " pod="openstack-kuttl-tests/swift-ring-rebalance-nhhml" Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.111288 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1ccbf25a-f71f-4428-ac40-883041c2b302-combined-ca-bundle\") pod \"swift-ring-rebalance-nhhml\" (UID: \"1ccbf25a-f71f-4428-ac40-883041c2b302\") " pod="openstack-kuttl-tests/swift-ring-rebalance-nhhml" Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.112424 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjj92\" (UniqueName: \"kubernetes.io/projected/1ccbf25a-f71f-4428-ac40-883041c2b302-kube-api-access-mjj92\") pod \"swift-ring-rebalance-nhhml\" (UID: \"1ccbf25a-f71f-4428-ac40-883041c2b302\") " pod="openstack-kuttl-tests/swift-ring-rebalance-nhhml" Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.112926 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/1ccbf25a-f71f-4428-ac40-883041c2b302-etc-swift\") pod \"swift-ring-rebalance-nhhml\" (UID: \"1ccbf25a-f71f-4428-ac40-883041c2b302\") " pod="openstack-kuttl-tests/swift-ring-rebalance-nhhml" Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.128470 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/1ccbf25a-f71f-4428-ac40-883041c2b302-swiftconf\") pod \"swift-ring-rebalance-nhhml\" (UID: \"1ccbf25a-f71f-4428-ac40-883041c2b302\") " pod="openstack-kuttl-tests/swift-ring-rebalance-nhhml" Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.144033 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.144702 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="4093a7c4-51d9-4119-8e47-c06f29723894" containerName="ceilometer-central-agent" containerID="cri-o://60385fabe480fed7555f36dc6f1b4459b21a84b49a3a1f92af6eb03c6e2df9c9" gracePeriod=30 Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.150205 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="4093a7c4-51d9-4119-8e47-c06f29723894" containerName="proxy-httpd" containerID="cri-o://b745117a770fe11c46e5d61e279fc7ab89054b2bf87b4f50cde54ce2c47689c6" gracePeriod=30 Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.150294 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="4093a7c4-51d9-4119-8e47-c06f29723894" containerName="sg-core" containerID="cri-o://5fc6451d2a211fee6ddf7a8ff791952c877013378fed995f98d0db78c21a3e5f" gracePeriod=30 Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.150338 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="4093a7c4-51d9-4119-8e47-c06f29723894" containerName="ceilometer-notification-agent" containerID="cri-o://90578380dd3689e88764f9ad9d1a470340f3570e79e4db8d8c234d43e57fa7e3" gracePeriod=30 Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.170529 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.181212 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.199218 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-4ckj9"] Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.199864 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ovnnorthd-ovndbs\"" Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.200081 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovnnorthd-scripts\"" Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.200584 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovnnorthd-config\"" Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.201043 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ovnnorthd-ovnnorthd-dockercfg-22bt4\"" Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.202147 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ovn-metrics\"" Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.215494 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-4ckj9" Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.219714 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-conductor-scripts\"" Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.224011 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-4ckj9"] Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.232282 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mjj92\" (UniqueName: \"kubernetes.io/projected/1ccbf25a-f71f-4428-ac40-883041c2b302-kube-api-access-mjj92\") pod \"swift-ring-rebalance-nhhml\" (UID: \"1ccbf25a-f71f-4428-ac40-883041c2b302\") " pod="openstack-kuttl-tests/swift-ring-rebalance-nhhml" Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.232349 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/1ccbf25a-f71f-4428-ac40-883041c2b302-etc-swift\") pod \"swift-ring-rebalance-nhhml\" (UID: \"1ccbf25a-f71f-4428-ac40-883041c2b302\") " pod="openstack-kuttl-tests/swift-ring-rebalance-nhhml" Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.232439 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/1ccbf25a-f71f-4428-ac40-883041c2b302-swiftconf\") pod \"swift-ring-rebalance-nhhml\" (UID: \"1ccbf25a-f71f-4428-ac40-883041c2b302\") " pod="openstack-kuttl-tests/swift-ring-rebalance-nhhml" Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.232476 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/1ccbf25a-f71f-4428-ac40-883041c2b302-scripts\") pod \"swift-ring-rebalance-nhhml\" (UID: \"1ccbf25a-f71f-4428-ac40-883041c2b302\") " pod="openstack-kuttl-tests/swift-ring-rebalance-nhhml" Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.232548 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/1ccbf25a-f71f-4428-ac40-883041c2b302-ring-data-devices\") pod \"swift-ring-rebalance-nhhml\" (UID: \"1ccbf25a-f71f-4428-ac40-883041c2b302\") " pod="openstack-kuttl-tests/swift-ring-rebalance-nhhml" Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.232580 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/1ccbf25a-f71f-4428-ac40-883041c2b302-dispersionconf\") pod \"swift-ring-rebalance-nhhml\" (UID: \"1ccbf25a-f71f-4428-ac40-883041c2b302\") " pod="openstack-kuttl-tests/swift-ring-rebalance-nhhml" Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.232662 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1ccbf25a-f71f-4428-ac40-883041c2b302-combined-ca-bundle\") pod \"swift-ring-rebalance-nhhml\" (UID: \"1ccbf25a-f71f-4428-ac40-883041c2b302\") " pod="openstack-kuttl-tests/swift-ring-rebalance-nhhml" Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.235115 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/1ccbf25a-f71f-4428-ac40-883041c2b302-scripts\") pod \"swift-ring-rebalance-nhhml\" (UID: \"1ccbf25a-f71f-4428-ac40-883041c2b302\") " pod="openstack-kuttl-tests/swift-ring-rebalance-nhhml" Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.235253 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/1ccbf25a-f71f-4428-ac40-883041c2b302-ring-data-devices\") pod \"swift-ring-rebalance-nhhml\" (UID: \"1ccbf25a-f71f-4428-ac40-883041c2b302\") " pod="openstack-kuttl-tests/swift-ring-rebalance-nhhml" Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.235380 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/1ccbf25a-f71f-4428-ac40-883041c2b302-etc-swift\") pod \"swift-ring-rebalance-nhhml\" (UID: \"1ccbf25a-f71f-4428-ac40-883041c2b302\") " pod="openstack-kuttl-tests/swift-ring-rebalance-nhhml" Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.238605 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1ccbf25a-f71f-4428-ac40-883041c2b302-combined-ca-bundle\") pod \"swift-ring-rebalance-nhhml\" (UID: \"1ccbf25a-f71f-4428-ac40-883041c2b302\") " pod="openstack-kuttl-tests/swift-ring-rebalance-nhhml" Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.239131 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/1ccbf25a-f71f-4428-ac40-883041c2b302-dispersionconf\") pod \"swift-ring-rebalance-nhhml\" (UID: \"1ccbf25a-f71f-4428-ac40-883041c2b302\") " pod="openstack-kuttl-tests/swift-ring-rebalance-nhhml" Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.251377 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-vqvr9"] Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.252623 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/1ccbf25a-f71f-4428-ac40-883041c2b302-swiftconf\") pod \"swift-ring-rebalance-nhhml\" (UID: \"1ccbf25a-f71f-4428-ac40-883041c2b302\") " pod="openstack-kuttl-tests/swift-ring-rebalance-nhhml" Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.263282 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.265485 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjj92\" (UniqueName: \"kubernetes.io/projected/1ccbf25a-f71f-4428-ac40-883041c2b302-kube-api-access-mjj92\") pod \"swift-ring-rebalance-nhhml\" (UID: \"1ccbf25a-f71f-4428-ac40-883041c2b302\") " pod="openstack-kuttl-tests/swift-ring-rebalance-nhhml" Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.276951 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-9nksc"] Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.335513 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4c9nj\" (UniqueName: \"kubernetes.io/projected/adeefc4f-7632-4673-ae4f-0104e9e65d1d-kube-api-access-4c9nj\") pod \"ovn-northd-0\" (UID: \"adeefc4f-7632-4673-ae4f-0104e9e65d1d\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.336049 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2e6d012a-b39a-4bfa-ab56-77bc12e2902e-combined-ca-bundle\") pod \"nova-cell1-conductor-db-sync-4ckj9\" (UID: \"2e6d012a-b39a-4bfa-ab56-77bc12e2902e\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-4ckj9" Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.336226 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/adeefc4f-7632-4673-ae4f-0104e9e65d1d-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"adeefc4f-7632-4673-ae4f-0104e9e65d1d\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.336352 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/adeefc4f-7632-4673-ae4f-0104e9e65d1d-scripts\") pod \"ovn-northd-0\" (UID: \"adeefc4f-7632-4673-ae4f-0104e9e65d1d\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.336460 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/adeefc4f-7632-4673-ae4f-0104e9e65d1d-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"adeefc4f-7632-4673-ae4f-0104e9e65d1d\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.336548 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rcvkx\" (UniqueName: \"kubernetes.io/projected/2e6d012a-b39a-4bfa-ab56-77bc12e2902e-kube-api-access-rcvkx\") pod \"nova-cell1-conductor-db-sync-4ckj9\" (UID: \"2e6d012a-b39a-4bfa-ab56-77bc12e2902e\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-4ckj9" Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.336631 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2e6d012a-b39a-4bfa-ab56-77bc12e2902e-config-data\") pod \"nova-cell1-conductor-db-sync-4ckj9\" (UID: \"2e6d012a-b39a-4bfa-ab56-77bc12e2902e\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-4ckj9" Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.336792 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2e6d012a-b39a-4bfa-ab56-77bc12e2902e-scripts\") pod \"nova-cell1-conductor-db-sync-4ckj9\" (UID: \"2e6d012a-b39a-4bfa-ab56-77bc12e2902e\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-4ckj9" Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.336949 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/adeefc4f-7632-4673-ae4f-0104e9e65d1d-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"adeefc4f-7632-4673-ae4f-0104e9e65d1d\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.337060 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/adeefc4f-7632-4673-ae4f-0104e9e65d1d-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"adeefc4f-7632-4673-ae4f-0104e9e65d1d\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.337167 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/adeefc4f-7632-4673-ae4f-0104e9e65d1d-config\") pod \"ovn-northd-0\" (UID: \"adeefc4f-7632-4673-ae4f-0104e9e65d1d\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.356260 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.356822 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="68089cb0-f9b0-4b76-9778-e2edffaa4f55" containerName="account-server" containerID="cri-o://f6201cdf3cad8158121c3b8225a265abde1e721d5969401a866ae07675028dac" gracePeriod=30 Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.357307 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-9nksc" Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.361882 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="68089cb0-f9b0-4b76-9778-e2edffaa4f55" containerName="container-updater" containerID="cri-o://ddfdaba140c32cd80e6973b4267f27a416f672ad90fd39e23b4abbdab58d45ac" gracePeriod=30 Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.362103 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="68089cb0-f9b0-4b76-9778-e2edffaa4f55" containerName="swift-recon-cron" containerID="cri-o://080f8540395015e16b1273c588e9a186dfbd64eee3d6314236006160630adf34" gracePeriod=30 Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.362222 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="68089cb0-f9b0-4b76-9778-e2edffaa4f55" containerName="rsync" containerID="cri-o://2ac4108315559f612a567fff03f8ef9fecb013f02a2aade950e30e5def4a5997" gracePeriod=30 Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.362344 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="68089cb0-f9b0-4b76-9778-e2edffaa4f55" containerName="object-expirer" containerID="cri-o://d8a01b8e047f292f7e2f4b25d537ee3665462d6fe0f49fa52dabe5c9f3858a7b" gracePeriod=30 Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.362476 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="68089cb0-f9b0-4b76-9778-e2edffaa4f55" containerName="object-updater" containerID="cri-o://cf6905d45807f576db3849ba958c470b3cd948bbfde79600771f3019e54489d0" gracePeriod=30 Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.362577 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="68089cb0-f9b0-4b76-9778-e2edffaa4f55" containerName="object-auditor" containerID="cri-o://afe5190e423949163505bc79590f2d599a6b431f474f2fcabb56da77844d8a11" gracePeriod=30 Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.362709 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="68089cb0-f9b0-4b76-9778-e2edffaa4f55" containerName="object-replicator" containerID="cri-o://7f6e37c552b309e5dc614d49c37a3d12d02090ee33a7533af716ad9dd4eed3ad" gracePeriod=30 Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.362732 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="68089cb0-f9b0-4b76-9778-e2edffaa4f55" containerName="account-reaper" containerID="cri-o://8f419d8d72ab94d7bb8b30064068f9e2053fe497727f9e55de513d7dd5786cb2" gracePeriod=30 Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.362884 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="68089cb0-f9b0-4b76-9778-e2edffaa4f55" containerName="account-auditor" containerID="cri-o://8af6bcb946bdfa26f8e4fdf72e4b7c90f7536fc40756b5c6dec1a3a61051ec9b" gracePeriod=30 Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.362959 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="68089cb0-f9b0-4b76-9778-e2edffaa4f55" containerName="account-replicator" containerID="cri-o://5f7141dbd0cf79e47a2a0694e8bb1ee25f24e45613ac19c363191df3d5bd8962" gracePeriod=30 Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.362976 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="68089cb0-f9b0-4b76-9778-e2edffaa4f55" containerName="container-replicator" containerID="cri-o://bc16f7898a0f29b9a468ef6b20c3e906bab78b7b5706cf556c27a2eca4e6d0d0" gracePeriod=30 Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.362961 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="68089cb0-f9b0-4b76-9778-e2edffaa4f55" containerName="container-auditor" containerID="cri-o://3045e329b7334cfdf59c5f7569d481ddcf6b9cef5a1d41651bdf7a09fe16cce6" gracePeriod=30 Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.363052 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="68089cb0-f9b0-4b76-9778-e2edffaa4f55" containerName="container-server" containerID="cri-o://6c2e9e23b6576fc2a9ba6d556319b9df1b2c25022fca788477700ea2cab3db1d" gracePeriod=30 Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.363149 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="68089cb0-f9b0-4b76-9778-e2edffaa4f55" containerName="object-server" containerID="cri-o://a65e2e3da3516c3727074c62fc6b9251f1f45049075f88d761d5c9cecc497707" gracePeriod=30 Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.379215 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-nhhml" Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.383829 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-9nksc"] Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.410226 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.410597 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/kube-state-metrics-0" podUID="f99422e5-686e-4d1d-8986-ba6e747db255" containerName="kube-state-metrics" containerID="cri-o://a130b33bcc067dd6c3adb134433231928cbd2b5634c364451c12b069eb703117" gracePeriod=30 Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.411203 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-conductor-scripts\"" Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.445654 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/adeefc4f-7632-4673-ae4f-0104e9e65d1d-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"adeefc4f-7632-4673-ae4f-0104e9e65d1d\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.445703 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4346558c-b16e-474a-b782-569ca0bbb7cd-combined-ca-bundle\") pod \"nova-cell0-conductor-db-sync-9nksc\" (UID: \"4346558c-b16e-474a-b782-569ca0bbb7cd\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-9nksc" Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.445731 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/adeefc4f-7632-4673-ae4f-0104e9e65d1d-config\") pod \"ovn-northd-0\" (UID: \"adeefc4f-7632-4673-ae4f-0104e9e65d1d\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.445834 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4c9nj\" (UniqueName: \"kubernetes.io/projected/adeefc4f-7632-4673-ae4f-0104e9e65d1d-kube-api-access-4c9nj\") pod \"ovn-northd-0\" (UID: \"adeefc4f-7632-4673-ae4f-0104e9e65d1d\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.445925 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2e6d012a-b39a-4bfa-ab56-77bc12e2902e-combined-ca-bundle\") pod \"nova-cell1-conductor-db-sync-4ckj9\" (UID: \"2e6d012a-b39a-4bfa-ab56-77bc12e2902e\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-4ckj9" Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.445970 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4346558c-b16e-474a-b782-569ca0bbb7cd-config-data\") pod \"nova-cell0-conductor-db-sync-9nksc\" (UID: \"4346558c-b16e-474a-b782-569ca0bbb7cd\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-9nksc" Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.446045 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/adeefc4f-7632-4673-ae4f-0104e9e65d1d-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"adeefc4f-7632-4673-ae4f-0104e9e65d1d\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.446084 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/adeefc4f-7632-4673-ae4f-0104e9e65d1d-scripts\") pod \"ovn-northd-0\" (UID: \"adeefc4f-7632-4673-ae4f-0104e9e65d1d\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.446136 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4346558c-b16e-474a-b782-569ca0bbb7cd-scripts\") pod \"nova-cell0-conductor-db-sync-9nksc\" (UID: \"4346558c-b16e-474a-b782-569ca0bbb7cd\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-9nksc" Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.446183 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/adeefc4f-7632-4673-ae4f-0104e9e65d1d-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"adeefc4f-7632-4673-ae4f-0104e9e65d1d\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.446230 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rcvkx\" (UniqueName: \"kubernetes.io/projected/2e6d012a-b39a-4bfa-ab56-77bc12e2902e-kube-api-access-rcvkx\") pod \"nova-cell1-conductor-db-sync-4ckj9\" (UID: \"2e6d012a-b39a-4bfa-ab56-77bc12e2902e\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-4ckj9" Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.446264 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2e6d012a-b39a-4bfa-ab56-77bc12e2902e-config-data\") pod \"nova-cell1-conductor-db-sync-4ckj9\" (UID: \"2e6d012a-b39a-4bfa-ab56-77bc12e2902e\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-4ckj9" Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.446313 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxwjh\" (UniqueName: \"kubernetes.io/projected/4346558c-b16e-474a-b782-569ca0bbb7cd-kube-api-access-sxwjh\") pod \"nova-cell0-conductor-db-sync-9nksc\" (UID: \"4346558c-b16e-474a-b782-569ca0bbb7cd\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-9nksc" Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.446400 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2e6d012a-b39a-4bfa-ab56-77bc12e2902e-scripts\") pod \"nova-cell1-conductor-db-sync-4ckj9\" (UID: \"2e6d012a-b39a-4bfa-ab56-77bc12e2902e\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-4ckj9" Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.446524 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/adeefc4f-7632-4673-ae4f-0104e9e65d1d-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"adeefc4f-7632-4673-ae4f-0104e9e65d1d\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.461545 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.463373 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/adeefc4f-7632-4673-ae4f-0104e9e65d1d-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"adeefc4f-7632-4673-ae4f-0104e9e65d1d\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.463393 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/adeefc4f-7632-4673-ae4f-0104e9e65d1d-config\") pod \"ovn-northd-0\" (UID: \"adeefc4f-7632-4673-ae4f-0104e9e65d1d\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.464769 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/adeefc4f-7632-4673-ae4f-0104e9e65d1d-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"adeefc4f-7632-4673-ae4f-0104e9e65d1d\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.478088 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2e6d012a-b39a-4bfa-ab56-77bc12e2902e-combined-ca-bundle\") pod \"nova-cell1-conductor-db-sync-4ckj9\" (UID: \"2e6d012a-b39a-4bfa-ab56-77bc12e2902e\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-4ckj9" Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.480224 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2e6d012a-b39a-4bfa-ab56-77bc12e2902e-scripts\") pod \"nova-cell1-conductor-db-sync-4ckj9\" (UID: \"2e6d012a-b39a-4bfa-ab56-77bc12e2902e\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-4ckj9" Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.480251 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.485428 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/adeefc4f-7632-4673-ae4f-0104e9e65d1d-scripts\") pod \"ovn-northd-0\" (UID: \"adeefc4f-7632-4673-ae4f-0104e9e65d1d\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.487153 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.489133 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/adeefc4f-7632-4673-ae4f-0104e9e65d1d-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"adeefc4f-7632-4673-ae4f-0104e9e65d1d\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.504673 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcvkx\" (UniqueName: \"kubernetes.io/projected/2e6d012a-b39a-4bfa-ab56-77bc12e2902e-kube-api-access-rcvkx\") pod \"nova-cell1-conductor-db-sync-4ckj9\" (UID: \"2e6d012a-b39a-4bfa-ab56-77bc12e2902e\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-4ckj9" Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.509689 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/adeefc4f-7632-4673-ae4f-0104e9e65d1d-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"adeefc4f-7632-4673-ae4f-0104e9e65d1d\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.512092 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2e6d012a-b39a-4bfa-ab56-77bc12e2902e-config-data\") pod \"nova-cell1-conductor-db-sync-4ckj9\" (UID: \"2e6d012a-b39a-4bfa-ab56-77bc12e2902e\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-4ckj9" Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.516614 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.520584 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-d42sq"] Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.521187 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4c9nj\" (UniqueName: \"kubernetes.io/projected/adeefc4f-7632-4673-ae4f-0104e9e65d1d-kube-api-access-4c9nj\") pod \"ovn-northd-0\" (UID: \"adeefc4f-7632-4673-ae4f-0104e9e65d1d\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.549232 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4346558c-b16e-474a-b782-569ca0bbb7cd-combined-ca-bundle\") pod \"nova-cell0-conductor-db-sync-9nksc\" (UID: \"4346558c-b16e-474a-b782-569ca0bbb7cd\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-9nksc" Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.549399 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4346558c-b16e-474a-b782-569ca0bbb7cd-config-data\") pod \"nova-cell0-conductor-db-sync-9nksc\" (UID: \"4346558c-b16e-474a-b782-569ca0bbb7cd\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-9nksc" Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.549503 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4346558c-b16e-474a-b782-569ca0bbb7cd-scripts\") pod \"nova-cell0-conductor-db-sync-9nksc\" (UID: \"4346558c-b16e-474a-b782-569ca0bbb7cd\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-9nksc" Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.549598 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sxwjh\" (UniqueName: \"kubernetes.io/projected/4346558c-b16e-474a-b782-569ca0bbb7cd-kube-api-access-sxwjh\") pod \"nova-cell0-conductor-db-sync-9nksc\" (UID: \"4346558c-b16e-474a-b782-569ca0bbb7cd\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-9nksc" Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.551026 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.581225 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-4ckj9" Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.603994 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ovndbcluster-nb-ovndbs\"" Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.604735 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovndbcluster-nb-config\"" Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.604955 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovndbcluster-nb-scripts\"" Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.605149 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ovncluster-ovndbcluster-nb-dockercfg-648qh\"" Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.607127 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxwjh\" (UniqueName: \"kubernetes.io/projected/4346558c-b16e-474a-b782-569ca0bbb7cd-kube-api-access-sxwjh\") pod \"nova-cell0-conductor-db-sync-9nksc\" (UID: \"4346558c-b16e-474a-b782-569ca0bbb7cd\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-9nksc" Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.607203 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4346558c-b16e-474a-b782-569ca0bbb7cd-scripts\") pod \"nova-cell0-conductor-db-sync-9nksc\" (UID: \"4346558c-b16e-474a-b782-569ca0bbb7cd\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-9nksc" Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.617501 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4346558c-b16e-474a-b782-569ca0bbb7cd-config-data\") pod \"nova-cell0-conductor-db-sync-9nksc\" (UID: \"4346558c-b16e-474a-b782-569ca0bbb7cd\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-9nksc" Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.619184 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4346558c-b16e-474a-b782-569ca0bbb7cd-combined-ca-bundle\") pod \"nova-cell0-conductor-db-sync-9nksc\" (UID: \"4346558c-b16e-474a-b782-569ca0bbb7cd\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-9nksc" Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.673119 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/1fe0dc2f-7c59-4d24-9b66-47c888321f7d-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"1fe0dc2f-7c59-4d24-9b66-47c888321f7d\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.673215 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1fe0dc2f-7c59-4d24-9b66-47c888321f7d-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"1fe0dc2f-7c59-4d24-9b66-47c888321f7d\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.673248 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/1fe0dc2f-7c59-4d24-9b66-47c888321f7d-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"1fe0dc2f-7c59-4d24-9b66-47c888321f7d\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.673305 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/1fe0dc2f-7c59-4d24-9b66-47c888321f7d-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"1fe0dc2f-7c59-4d24-9b66-47c888321f7d\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.673353 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkhjx\" (UniqueName: \"kubernetes.io/projected/1fe0dc2f-7c59-4d24-9b66-47c888321f7d-kube-api-access-hkhjx\") pod \"ovsdbserver-nb-0\" (UID: \"1fe0dc2f-7c59-4d24-9b66-47c888321f7d\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.673413 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1fe0dc2f-7c59-4d24-9b66-47c888321f7d-config\") pod \"ovsdbserver-nb-0\" (UID: \"1fe0dc2f-7c59-4d24-9b66-47c888321f7d\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.673460 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"ovsdbserver-nb-0\" (UID: \"1fe0dc2f-7c59-4d24-9b66-47c888321f7d\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.673531 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/1fe0dc2f-7c59-4d24-9b66-47c888321f7d-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"1fe0dc2f-7c59-4d24-9b66-47c888321f7d\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.706219 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.733597 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.748835 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.791509 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"ovsdbserver-nb-0\" (UID: \"1fe0dc2f-7c59-4d24-9b66-47c888321f7d\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.791613 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/1fe0dc2f-7c59-4d24-9b66-47c888321f7d-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"1fe0dc2f-7c59-4d24-9b66-47c888321f7d\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.791854 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/1fe0dc2f-7c59-4d24-9b66-47c888321f7d-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"1fe0dc2f-7c59-4d24-9b66-47c888321f7d\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.791950 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1fe0dc2f-7c59-4d24-9b66-47c888321f7d-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"1fe0dc2f-7c59-4d24-9b66-47c888321f7d\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.791990 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/1fe0dc2f-7c59-4d24-9b66-47c888321f7d-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"1fe0dc2f-7c59-4d24-9b66-47c888321f7d\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.792084 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/1fe0dc2f-7c59-4d24-9b66-47c888321f7d-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"1fe0dc2f-7c59-4d24-9b66-47c888321f7d\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.792149 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hkhjx\" (UniqueName: \"kubernetes.io/projected/1fe0dc2f-7c59-4d24-9b66-47c888321f7d-kube-api-access-hkhjx\") pod \"ovsdbserver-nb-0\" (UID: \"1fe0dc2f-7c59-4d24-9b66-47c888321f7d\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.792243 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1fe0dc2f-7c59-4d24-9b66-47c888321f7d-config\") pod \"ovsdbserver-nb-0\" (UID: \"1fe0dc2f-7c59-4d24-9b66-47c888321f7d\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.807388 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1fe0dc2f-7c59-4d24-9b66-47c888321f7d-config\") pod \"ovsdbserver-nb-0\" (UID: \"1fe0dc2f-7c59-4d24-9b66-47c888321f7d\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.808428 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"ovsdbserver-nb-0\" (UID: \"1fe0dc2f-7c59-4d24-9b66-47c888321f7d\") device mount path \"/mnt/openstack/pv12\"" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.841429 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/1fe0dc2f-7c59-4d24-9b66-47c888321f7d-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"1fe0dc2f-7c59-4d24-9b66-47c888321f7d\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.847325 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/1fe0dc2f-7c59-4d24-9b66-47c888321f7d-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"1fe0dc2f-7c59-4d24-9b66-47c888321f7d\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.848285 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1fe0dc2f-7c59-4d24-9b66-47c888321f7d-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"1fe0dc2f-7c59-4d24-9b66-47c888321f7d\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.851748 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/1fe0dc2f-7c59-4d24-9b66-47c888321f7d-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"1fe0dc2f-7c59-4d24-9b66-47c888321f7d\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.864799 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-9nksc" Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.910610 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/1fe0dc2f-7c59-4d24-9b66-47c888321f7d-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"1fe0dc2f-7c59-4d24-9b66-47c888321f7d\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.927447 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkhjx\" (UniqueName: \"kubernetes.io/projected/1fe0dc2f-7c59-4d24-9b66-47c888321f7d-kube-api-access-hkhjx\") pod \"ovsdbserver-nb-0\" (UID: \"1fe0dc2f-7c59-4d24-9b66-47c888321f7d\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:36:03 crc kubenswrapper[5120]: I0316 16:36:03.983050 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Mar 16 16:36:04 crc kubenswrapper[5120]: I0316 16:36:04.016279 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9998e1ac-8e55-4be8-8b49-ff3f7434b699-combined-ca-bundle\") pod \"9998e1ac-8e55-4be8-8b49-ff3f7434b699\" (UID: \"9998e1ac-8e55-4be8-8b49-ff3f7434b699\") " Mar 16 16:36:04 crc kubenswrapper[5120]: I0316 16:36:04.016808 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/9998e1ac-8e55-4be8-8b49-ff3f7434b699-kolla-config\") pod \"9998e1ac-8e55-4be8-8b49-ff3f7434b699\" (UID: \"9998e1ac-8e55-4be8-8b49-ff3f7434b699\") " Mar 16 16:36:04 crc kubenswrapper[5120]: I0316 16:36:04.016936 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2df6n\" (UniqueName: \"kubernetes.io/projected/9998e1ac-8e55-4be8-8b49-ff3f7434b699-kube-api-access-2df6n\") pod \"9998e1ac-8e55-4be8-8b49-ff3f7434b699\" (UID: \"9998e1ac-8e55-4be8-8b49-ff3f7434b699\") " Mar 16 16:36:04 crc kubenswrapper[5120]: I0316 16:36:04.017013 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/9998e1ac-8e55-4be8-8b49-ff3f7434b699-config-data\") pod \"9998e1ac-8e55-4be8-8b49-ff3f7434b699\" (UID: \"9998e1ac-8e55-4be8-8b49-ff3f7434b699\") " Mar 16 16:36:04 crc kubenswrapper[5120]: I0316 16:36:04.017055 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/9998e1ac-8e55-4be8-8b49-ff3f7434b699-memcached-tls-certs\") pod \"9998e1ac-8e55-4be8-8b49-ff3f7434b699\" (UID: \"9998e1ac-8e55-4be8-8b49-ff3f7434b699\") " Mar 16 16:36:04 crc kubenswrapper[5120]: I0316 16:36:04.018315 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9998e1ac-8e55-4be8-8b49-ff3f7434b699-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "9998e1ac-8e55-4be8-8b49-ff3f7434b699" (UID: "9998e1ac-8e55-4be8-8b49-ff3f7434b699"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:36:04 crc kubenswrapper[5120]: I0316 16:36:04.018545 5120 reconciler_common.go:299] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/9998e1ac-8e55-4be8-8b49-ff3f7434b699-kolla-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:04 crc kubenswrapper[5120]: I0316 16:36:04.026350 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9998e1ac-8e55-4be8-8b49-ff3f7434b699-config-data" (OuterVolumeSpecName: "config-data") pod "9998e1ac-8e55-4be8-8b49-ff3f7434b699" (UID: "9998e1ac-8e55-4be8-8b49-ff3f7434b699"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:36:04 crc kubenswrapper[5120]: I0316 16:36:04.034415 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9998e1ac-8e55-4be8-8b49-ff3f7434b699-kube-api-access-2df6n" (OuterVolumeSpecName: "kube-api-access-2df6n") pod "9998e1ac-8e55-4be8-8b49-ff3f7434b699" (UID: "9998e1ac-8e55-4be8-8b49-ff3f7434b699"). InnerVolumeSpecName "kube-api-access-2df6n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:36:04 crc kubenswrapper[5120]: I0316 16:36:04.121473 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-bmfrv"] Mar 16 16:36:04 crc kubenswrapper[5120]: I0316 16:36:04.131834 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"ovsdbserver-nb-0\" (UID: \"1fe0dc2f-7c59-4d24-9b66-47c888321f7d\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:36:04 crc kubenswrapper[5120]: I0316 16:36:04.139658 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2df6n\" (UniqueName: \"kubernetes.io/projected/9998e1ac-8e55-4be8-8b49-ff3f7434b699-kube-api-access-2df6n\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:04 crc kubenswrapper[5120]: I0316 16:36:04.140106 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/9998e1ac-8e55-4be8-8b49-ff3f7434b699-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:04 crc kubenswrapper[5120]: I0316 16:36:04.145837 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:36:04 crc kubenswrapper[5120]: I0316 16:36:04.152316 5120 generic.go:358] "Generic (PLEG): container finished" podID="68089cb0-f9b0-4b76-9778-e2edffaa4f55" containerID="d8a01b8e047f292f7e2f4b25d537ee3665462d6fe0f49fa52dabe5c9f3858a7b" exitCode=0 Mar 16 16:36:04 crc kubenswrapper[5120]: I0316 16:36:04.152350 5120 generic.go:358] "Generic (PLEG): container finished" podID="68089cb0-f9b0-4b76-9778-e2edffaa4f55" containerID="cf6905d45807f576db3849ba958c470b3cd948bbfde79600771f3019e54489d0" exitCode=0 Mar 16 16:36:04 crc kubenswrapper[5120]: I0316 16:36:04.152358 5120 generic.go:358] "Generic (PLEG): container finished" podID="68089cb0-f9b0-4b76-9778-e2edffaa4f55" containerID="afe5190e423949163505bc79590f2d599a6b431f474f2fcabb56da77844d8a11" exitCode=0 Mar 16 16:36:04 crc kubenswrapper[5120]: I0316 16:36:04.152363 5120 generic.go:358] "Generic (PLEG): container finished" podID="68089cb0-f9b0-4b76-9778-e2edffaa4f55" containerID="7f6e37c552b309e5dc614d49c37a3d12d02090ee33a7533af716ad9dd4eed3ad" exitCode=0 Mar 16 16:36:04 crc kubenswrapper[5120]: I0316 16:36:04.152369 5120 generic.go:358] "Generic (PLEG): container finished" podID="68089cb0-f9b0-4b76-9778-e2edffaa4f55" containerID="ddfdaba140c32cd80e6973b4267f27a416f672ad90fd39e23b4abbdab58d45ac" exitCode=0 Mar 16 16:36:04 crc kubenswrapper[5120]: I0316 16:36:04.152374 5120 generic.go:358] "Generic (PLEG): container finished" podID="68089cb0-f9b0-4b76-9778-e2edffaa4f55" containerID="bc16f7898a0f29b9a468ef6b20c3e906bab78b7b5706cf556c27a2eca4e6d0d0" exitCode=0 Mar 16 16:36:04 crc kubenswrapper[5120]: I0316 16:36:04.152379 5120 generic.go:358] "Generic (PLEG): container finished" podID="68089cb0-f9b0-4b76-9778-e2edffaa4f55" containerID="8f419d8d72ab94d7bb8b30064068f9e2053fe497727f9e55de513d7dd5786cb2" exitCode=0 Mar 16 16:36:04 crc kubenswrapper[5120]: I0316 16:36:04.152385 5120 generic.go:358] "Generic (PLEG): container finished" podID="68089cb0-f9b0-4b76-9778-e2edffaa4f55" containerID="8af6bcb946bdfa26f8e4fdf72e4b7c90f7536fc40756b5c6dec1a3a61051ec9b" exitCode=0 Mar 16 16:36:04 crc kubenswrapper[5120]: I0316 16:36:04.152390 5120 generic.go:358] "Generic (PLEG): container finished" podID="68089cb0-f9b0-4b76-9778-e2edffaa4f55" containerID="5f7141dbd0cf79e47a2a0694e8bb1ee25f24e45613ac19c363191df3d5bd8962" exitCode=0 Mar 16 16:36:04 crc kubenswrapper[5120]: I0316 16:36:04.152462 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"68089cb0-f9b0-4b76-9778-e2edffaa4f55","Type":"ContainerDied","Data":"d8a01b8e047f292f7e2f4b25d537ee3665462d6fe0f49fa52dabe5c9f3858a7b"} Mar 16 16:36:04 crc kubenswrapper[5120]: I0316 16:36:04.152490 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"68089cb0-f9b0-4b76-9778-e2edffaa4f55","Type":"ContainerDied","Data":"cf6905d45807f576db3849ba958c470b3cd948bbfde79600771f3019e54489d0"} Mar 16 16:36:04 crc kubenswrapper[5120]: I0316 16:36:04.152500 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"68089cb0-f9b0-4b76-9778-e2edffaa4f55","Type":"ContainerDied","Data":"afe5190e423949163505bc79590f2d599a6b431f474f2fcabb56da77844d8a11"} Mar 16 16:36:04 crc kubenswrapper[5120]: I0316 16:36:04.152508 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"68089cb0-f9b0-4b76-9778-e2edffaa4f55","Type":"ContainerDied","Data":"7f6e37c552b309e5dc614d49c37a3d12d02090ee33a7533af716ad9dd4eed3ad"} Mar 16 16:36:04 crc kubenswrapper[5120]: I0316 16:36:04.152516 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"68089cb0-f9b0-4b76-9778-e2edffaa4f55","Type":"ContainerDied","Data":"ddfdaba140c32cd80e6973b4267f27a416f672ad90fd39e23b4abbdab58d45ac"} Mar 16 16:36:04 crc kubenswrapper[5120]: I0316 16:36:04.152525 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"68089cb0-f9b0-4b76-9778-e2edffaa4f55","Type":"ContainerDied","Data":"bc16f7898a0f29b9a468ef6b20c3e906bab78b7b5706cf556c27a2eca4e6d0d0"} Mar 16 16:36:04 crc kubenswrapper[5120]: I0316 16:36:04.152533 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"68089cb0-f9b0-4b76-9778-e2edffaa4f55","Type":"ContainerDied","Data":"8f419d8d72ab94d7bb8b30064068f9e2053fe497727f9e55de513d7dd5786cb2"} Mar 16 16:36:04 crc kubenswrapper[5120]: I0316 16:36:04.152542 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"68089cb0-f9b0-4b76-9778-e2edffaa4f55","Type":"ContainerDied","Data":"8af6bcb946bdfa26f8e4fdf72e4b7c90f7536fc40756b5c6dec1a3a61051ec9b"} Mar 16 16:36:04 crc kubenswrapper[5120]: I0316 16:36:04.152550 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"68089cb0-f9b0-4b76-9778-e2edffaa4f55","Type":"ContainerDied","Data":"5f7141dbd0cf79e47a2a0694e8bb1ee25f24e45613ac19c363191df3d5bd8962"} Mar 16 16:36:04 crc kubenswrapper[5120]: I0316 16:36:04.164725 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9998e1ac-8e55-4be8-8b49-ff3f7434b699-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "9998e1ac-8e55-4be8-8b49-ff3f7434b699" (UID: "9998e1ac-8e55-4be8-8b49-ff3f7434b699"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:36:04 crc kubenswrapper[5120]: I0316 16:36:04.164801 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 16:36:04 crc kubenswrapper[5120]: I0316 16:36:04.166598 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="364bfdcf-9673-41c8-b692-941d68257973" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 16:36:04 crc kubenswrapper[5120]: I0316 16:36:04.166621 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="364bfdcf-9673-41c8-b692-941d68257973" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 16:36:04 crc kubenswrapper[5120]: I0316 16:36:04.166682 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9998e1ac-8e55-4be8-8b49-ff3f7434b699" containerName="memcached" Mar 16 16:36:04 crc kubenswrapper[5120]: I0316 16:36:04.166689 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9998e1ac-8e55-4be8-8b49-ff3f7434b699" containerName="memcached" Mar 16 16:36:04 crc kubenswrapper[5120]: I0316 16:36:04.166883 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="9998e1ac-8e55-4be8-8b49-ff3f7434b699" containerName="memcached" Mar 16 16:36:04 crc kubenswrapper[5120]: I0316 16:36:04.166895 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="364bfdcf-9673-41c8-b692-941d68257973" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 16:36:04 crc kubenswrapper[5120]: I0316 16:36:04.226301 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:36:04 crc kubenswrapper[5120]: I0316 16:36:04.229667 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:36:04 crc kubenswrapper[5120]: I0316 16:36:04.231459 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ovncluster-ovndbcluster-sb-dockercfg-8s25s\"" Mar 16 16:36:04 crc kubenswrapper[5120]: I0316 16:36:04.232254 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovndbcluster-sb-config\"" Mar 16 16:36:04 crc kubenswrapper[5120]: I0316 16:36:04.232379 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ovndbcluster-sb-ovndbs\"" Mar 16 16:36:04 crc kubenswrapper[5120]: I0316 16:36:04.232402 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovndbcluster-sb-scripts\"" Mar 16 16:36:04 crc kubenswrapper[5120]: I0316 16:36:04.239554 5120 generic.go:358] "Generic (PLEG): container finished" podID="4093a7c4-51d9-4119-8e47-c06f29723894" containerID="b745117a770fe11c46e5d61e279fc7ab89054b2bf87b4f50cde54ce2c47689c6" exitCode=0 Mar 16 16:36:04 crc kubenswrapper[5120]: I0316 16:36:04.239586 5120 generic.go:358] "Generic (PLEG): container finished" podID="4093a7c4-51d9-4119-8e47-c06f29723894" containerID="5fc6451d2a211fee6ddf7a8ff791952c877013378fed995f98d0db78c21a3e5f" exitCode=2 Mar 16 16:36:04 crc kubenswrapper[5120]: I0316 16:36:04.239814 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"4093a7c4-51d9-4119-8e47-c06f29723894","Type":"ContainerDied","Data":"b745117a770fe11c46e5d61e279fc7ab89054b2bf87b4f50cde54ce2c47689c6"} Mar 16 16:36:04 crc kubenswrapper[5120]: I0316 16:36:04.239847 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"4093a7c4-51d9-4119-8e47-c06f29723894","Type":"ContainerDied","Data":"5fc6451d2a211fee6ddf7a8ff791952c877013378fed995f98d0db78c21a3e5f"} Mar 16 16:36:04 crc kubenswrapper[5120]: I0316 16:36:04.264615 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 16:36:04 crc kubenswrapper[5120]: I0316 16:36:04.265277 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9998e1ac-8e55-4be8-8b49-ff3f7434b699-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:04 crc kubenswrapper[5120]: I0316 16:36:04.276397 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-bmfrv" event={"ID":"d0d98630-1fca-41f0-ba40-03f42f303121","Type":"ContainerStarted","Data":"695f4e6057e254dadc80ee04deb7d1eeaa00dae619ca2a29d7fd7499f0447a7d"} Mar 16 16:36:04 crc kubenswrapper[5120]: I0316 16:36:04.306496 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9998e1ac-8e55-4be8-8b49-ff3f7434b699-memcached-tls-certs" (OuterVolumeSpecName: "memcached-tls-certs") pod "9998e1ac-8e55-4be8-8b49-ff3f7434b699" (UID: "9998e1ac-8e55-4be8-8b49-ff3f7434b699"). InnerVolumeSpecName "memcached-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:36:04 crc kubenswrapper[5120]: I0316 16:36:04.309678 5120 generic.go:358] "Generic (PLEG): container finished" podID="d24d09c6-d2a8-418d-8ddf-a5e64672f554" containerID="da18e02e60563fdf4b993a489a08f0afac75c00cbf47e05276bd0256d2e32f2c" exitCode=0 Mar 16 16:36:04 crc kubenswrapper[5120]: I0316 16:36:04.310146 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"d24d09c6-d2a8-418d-8ddf-a5e64672f554","Type":"ContainerDied","Data":"da18e02e60563fdf4b993a489a08f0afac75c00cbf47e05276bd0256d2e32f2c"} Mar 16 16:36:04 crc kubenswrapper[5120]: I0316 16:36:04.366990 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/364bfdcf-9673-41c8-b692-941d68257973-vencrypt-tls-certs\") pod \"364bfdcf-9673-41c8-b692-941d68257973\" (UID: \"364bfdcf-9673-41c8-b692-941d68257973\") " Mar 16 16:36:04 crc kubenswrapper[5120]: I0316 16:36:04.367188 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/364bfdcf-9673-41c8-b692-941d68257973-nova-novncproxy-tls-certs\") pod \"364bfdcf-9673-41c8-b692-941d68257973\" (UID: \"364bfdcf-9673-41c8-b692-941d68257973\") " Mar 16 16:36:04 crc kubenswrapper[5120]: I0316 16:36:04.367378 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/364bfdcf-9673-41c8-b692-941d68257973-combined-ca-bundle\") pod \"364bfdcf-9673-41c8-b692-941d68257973\" (UID: \"364bfdcf-9673-41c8-b692-941d68257973\") " Mar 16 16:36:04 crc kubenswrapper[5120]: I0316 16:36:04.367546 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/364bfdcf-9673-41c8-b692-941d68257973-config-data\") pod \"364bfdcf-9673-41c8-b692-941d68257973\" (UID: \"364bfdcf-9673-41c8-b692-941d68257973\") " Mar 16 16:36:04 crc kubenswrapper[5120]: I0316 16:36:04.367706 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rqgwh\" (UniqueName: \"kubernetes.io/projected/364bfdcf-9673-41c8-b692-941d68257973-kube-api-access-rqgwh\") pod \"364bfdcf-9673-41c8-b692-941d68257973\" (UID: \"364bfdcf-9673-41c8-b692-941d68257973\") " Mar 16 16:36:04 crc kubenswrapper[5120]: I0316 16:36:04.368152 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"ovsdbserver-sb-0\" (UID: \"58b4ac02-d549-4064-89d2-db3e507c0efc\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:36:04 crc kubenswrapper[5120]: I0316 16:36:04.368224 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/58b4ac02-d549-4064-89d2-db3e507c0efc-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"58b4ac02-d549-4064-89d2-db3e507c0efc\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:36:04 crc kubenswrapper[5120]: I0316 16:36:04.368264 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/58b4ac02-d549-4064-89d2-db3e507c0efc-config\") pod \"ovsdbserver-sb-0\" (UID: \"58b4ac02-d549-4064-89d2-db3e507c0efc\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:36:04 crc kubenswrapper[5120]: I0316 16:36:04.368329 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nz47s\" (UniqueName: \"kubernetes.io/projected/58b4ac02-d549-4064-89d2-db3e507c0efc-kube-api-access-nz47s\") pod \"ovsdbserver-sb-0\" (UID: \"58b4ac02-d549-4064-89d2-db3e507c0efc\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:36:04 crc kubenswrapper[5120]: I0316 16:36:04.368416 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/58b4ac02-d549-4064-89d2-db3e507c0efc-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"58b4ac02-d549-4064-89d2-db3e507c0efc\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:36:04 crc kubenswrapper[5120]: I0316 16:36:04.368535 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/58b4ac02-d549-4064-89d2-db3e507c0efc-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"58b4ac02-d549-4064-89d2-db3e507c0efc\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:36:04 crc kubenswrapper[5120]: I0316 16:36:04.368563 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/58b4ac02-d549-4064-89d2-db3e507c0efc-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"58b4ac02-d549-4064-89d2-db3e507c0efc\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:36:04 crc kubenswrapper[5120]: I0316 16:36:04.368604 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/58b4ac02-d549-4064-89d2-db3e507c0efc-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"58b4ac02-d549-4064-89d2-db3e507c0efc\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:36:04 crc kubenswrapper[5120]: I0316 16:36:04.368702 5120 reconciler_common.go:299] "Volume detached for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/9998e1ac-8e55-4be8-8b49-ff3f7434b699-memcached-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:04 crc kubenswrapper[5120]: I0316 16:36:04.381982 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-b5trh"] Mar 16 16:36:04 crc kubenswrapper[5120]: I0316 16:36:04.396706 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-r8627"] Mar 16 16:36:04 crc kubenswrapper[5120]: I0316 16:36:04.402722 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/364bfdcf-9673-41c8-b692-941d68257973-kube-api-access-rqgwh" (OuterVolumeSpecName: "kube-api-access-rqgwh") pod "364bfdcf-9673-41c8-b692-941d68257973" (UID: "364bfdcf-9673-41c8-b692-941d68257973"). InnerVolumeSpecName "kube-api-access-rqgwh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:36:04 crc kubenswrapper[5120]: I0316 16:36:04.415169 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-d42sq" event={"ID":"7ecbc5c7-9802-4143-bba3-6552d5b8e3ba","Type":"ContainerStarted","Data":"93808c35a462dbda60181ff80956adc7a66441544333b09c336f585d91690965"} Mar 16 16:36:04 crc kubenswrapper[5120]: I0316 16:36:04.454886 5120 generic.go:358] "Generic (PLEG): container finished" podID="f99422e5-686e-4d1d-8986-ba6e747db255" containerID="a130b33bcc067dd6c3adb134433231928cbd2b5634c364451c12b069eb703117" exitCode=2 Mar 16 16:36:04 crc kubenswrapper[5120]: I0316 16:36:04.455800 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"f99422e5-686e-4d1d-8986-ba6e747db255","Type":"ContainerDied","Data":"a130b33bcc067dd6c3adb134433231928cbd2b5634c364451c12b069eb703117"} Mar 16 16:36:04 crc kubenswrapper[5120]: I0316 16:36:04.470469 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"ovsdbserver-sb-0\" (UID: \"58b4ac02-d549-4064-89d2-db3e507c0efc\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:36:04 crc kubenswrapper[5120]: I0316 16:36:04.470556 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/58b4ac02-d549-4064-89d2-db3e507c0efc-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"58b4ac02-d549-4064-89d2-db3e507c0efc\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:36:04 crc kubenswrapper[5120]: I0316 16:36:04.470608 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/58b4ac02-d549-4064-89d2-db3e507c0efc-config\") pod \"ovsdbserver-sb-0\" (UID: \"58b4ac02-d549-4064-89d2-db3e507c0efc\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:36:04 crc kubenswrapper[5120]: I0316 16:36:04.470672 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nz47s\" (UniqueName: \"kubernetes.io/projected/58b4ac02-d549-4064-89d2-db3e507c0efc-kube-api-access-nz47s\") pod \"ovsdbserver-sb-0\" (UID: \"58b4ac02-d549-4064-89d2-db3e507c0efc\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:36:04 crc kubenswrapper[5120]: I0316 16:36:04.470745 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/58b4ac02-d549-4064-89d2-db3e507c0efc-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"58b4ac02-d549-4064-89d2-db3e507c0efc\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:36:04 crc kubenswrapper[5120]: I0316 16:36:04.470855 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/58b4ac02-d549-4064-89d2-db3e507c0efc-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"58b4ac02-d549-4064-89d2-db3e507c0efc\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:36:04 crc kubenswrapper[5120]: I0316 16:36:04.470875 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/58b4ac02-d549-4064-89d2-db3e507c0efc-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"58b4ac02-d549-4064-89d2-db3e507c0efc\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:36:04 crc kubenswrapper[5120]: I0316 16:36:04.470909 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/58b4ac02-d549-4064-89d2-db3e507c0efc-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"58b4ac02-d549-4064-89d2-db3e507c0efc\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:36:04 crc kubenswrapper[5120]: I0316 16:36:04.470966 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rqgwh\" (UniqueName: \"kubernetes.io/projected/364bfdcf-9673-41c8-b692-941d68257973-kube-api-access-rqgwh\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:04 crc kubenswrapper[5120]: I0316 16:36:04.474423 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-db-sync-bmfrv" podStartSLOduration=4.474398749 podStartE2EDuration="4.474398749s" podCreationTimestamp="2026-03-16 16:36:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:36:04.30591815 +0000 UTC m=+3866.459849807" watchObservedRunningTime="2026-03-16 16:36:04.474398749 +0000 UTC m=+3866.628330406" Mar 16 16:36:04 crc kubenswrapper[5120]: I0316 16:36:04.492579 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/58b4ac02-d549-4064-89d2-db3e507c0efc-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"58b4ac02-d549-4064-89d2-db3e507c0efc\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:36:04 crc kubenswrapper[5120]: I0316 16:36:04.492946 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"ovsdbserver-sb-0\" (UID: \"58b4ac02-d549-4064-89d2-db3e507c0efc\") device mount path \"/mnt/openstack/pv04\"" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:36:04 crc kubenswrapper[5120]: I0316 16:36:04.493312 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/58b4ac02-d549-4064-89d2-db3e507c0efc-config\") pod \"ovsdbserver-sb-0\" (UID: \"58b4ac02-d549-4064-89d2-db3e507c0efc\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:36:04 crc kubenswrapper[5120]: I0316 16:36:04.495394 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/58b4ac02-d549-4064-89d2-db3e507c0efc-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"58b4ac02-d549-4064-89d2-db3e507c0efc\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:36:04 crc kubenswrapper[5120]: I0316 16:36:04.498491 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"9998e1ac-8e55-4be8-8b49-ff3f7434b699","Type":"ContainerDied","Data":"37a093355c6f041de9ec50749bf505e0d7752f099e879b011e1dfe9368f83661"} Mar 16 16:36:04 crc kubenswrapper[5120]: I0316 16:36:04.498548 5120 scope.go:117] "RemoveContainer" containerID="feaf6123410f7a55102df33a09bc007e0934725d3b55bc9552638bb6be54ab98" Mar 16 16:36:04 crc kubenswrapper[5120]: I0316 16:36:04.498738 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Mar 16 16:36:04 crc kubenswrapper[5120]: I0316 16:36:04.498821 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/58b4ac02-d549-4064-89d2-db3e507c0efc-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"58b4ac02-d549-4064-89d2-db3e507c0efc\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:36:04 crc kubenswrapper[5120]: I0316 16:36:04.508676 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/364bfdcf-9673-41c8-b692-941d68257973-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "364bfdcf-9673-41c8-b692-941d68257973" (UID: "364bfdcf-9673-41c8-b692-941d68257973"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:36:04 crc kubenswrapper[5120]: I0316 16:36:04.534320 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/58b4ac02-d549-4064-89d2-db3e507c0efc-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"58b4ac02-d549-4064-89d2-db3e507c0efc\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:36:04 crc kubenswrapper[5120]: I0316 16:36:04.535140 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/58b4ac02-d549-4064-89d2-db3e507c0efc-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"58b4ac02-d549-4064-89d2-db3e507c0efc\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:36:04 crc kubenswrapper[5120]: I0316 16:36:04.560274 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-vqvr9" event={"ID":"d9bb0c66-45a6-4915-8878-03f17055f4ab","Type":"ContainerStarted","Data":"72f9451d2179670d44ae1425f3b91ca6ef1324b3c61d90d387f96872979dfe18"} Mar 16 16:36:04 crc kubenswrapper[5120]: I0316 16:36:04.560324 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-vqvr9" event={"ID":"d9bb0c66-45a6-4915-8878-03f17055f4ab","Type":"ContainerStarted","Data":"91a93df38fab37ac85ad3da31b55d82da93c031bdc678b706e7886bf0aaa6368"} Mar 16 16:36:04 crc kubenswrapper[5120]: I0316 16:36:04.569740 5120 generic.go:358] "Generic (PLEG): container finished" podID="364bfdcf-9673-41c8-b692-941d68257973" containerID="3436ec6db1208b559eb91d991c3a73a3c9159ecad9eb1aeb50786f88a3c7bc52" exitCode=0 Mar 16 16:36:04 crc kubenswrapper[5120]: I0316 16:36:04.569816 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"364bfdcf-9673-41c8-b692-941d68257973","Type":"ContainerDied","Data":"3436ec6db1208b559eb91d991c3a73a3c9159ecad9eb1aeb50786f88a3c7bc52"} Mar 16 16:36:04 crc kubenswrapper[5120]: I0316 16:36:04.569918 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:36:04 crc kubenswrapper[5120]: I0316 16:36:04.573308 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/364bfdcf-9673-41c8-b692-941d68257973-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:04 crc kubenswrapper[5120]: I0316 16:36:04.609224 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nz47s\" (UniqueName: \"kubernetes.io/projected/58b4ac02-d549-4064-89d2-db3e507c0efc-kube-api-access-nz47s\") pod \"ovsdbserver-sb-0\" (UID: \"58b4ac02-d549-4064-89d2-db3e507c0efc\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:36:04 crc kubenswrapper[5120]: I0316 16:36:04.620568 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/364bfdcf-9673-41c8-b692-941d68257973-config-data" (OuterVolumeSpecName: "config-data") pod "364bfdcf-9673-41c8-b692-941d68257973" (UID: "364bfdcf-9673-41c8-b692-941d68257973"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:36:04 crc kubenswrapper[5120]: I0316 16:36:04.676933 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/364bfdcf-9673-41c8-b692-941d68257973-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:04 crc kubenswrapper[5120]: I0316 16:36:04.678997 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"ovsdbserver-sb-0\" (UID: \"58b4ac02-d549-4064-89d2-db3e507c0efc\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:36:04 crc kubenswrapper[5120]: I0316 16:36:04.717999 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/364bfdcf-9673-41c8-b692-941d68257973-vencrypt-tls-certs" (OuterVolumeSpecName: "vencrypt-tls-certs") pod "364bfdcf-9673-41c8-b692-941d68257973" (UID: "364bfdcf-9673-41c8-b692-941d68257973"). InnerVolumeSpecName "vencrypt-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:36:04 crc kubenswrapper[5120]: I0316 16:36:04.733920 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/364bfdcf-9673-41c8-b692-941d68257973-nova-novncproxy-tls-certs" (OuterVolumeSpecName: "nova-novncproxy-tls-certs") pod "364bfdcf-9673-41c8-b692-941d68257973" (UID: "364bfdcf-9673-41c8-b692-941d68257973"). InnerVolumeSpecName "nova-novncproxy-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:36:04 crc kubenswrapper[5120]: I0316 16:36:04.780679 5120 reconciler_common.go:299] "Volume detached for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/364bfdcf-9673-41c8-b692-941d68257973-vencrypt-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:04 crc kubenswrapper[5120]: I0316 16:36:04.805374 5120 reconciler_common.go:299] "Volume detached for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/364bfdcf-9673-41c8-b692-941d68257973-nova-novncproxy-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:04 crc kubenswrapper[5120]: I0316 16:36:04.868533 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0bcb2925-74a9-4e24-b7bc-a6e5bf665e85" path="/var/lib/kubelet/pods/0bcb2925-74a9-4e24-b7bc-a6e5bf665e85/volumes" Mar 16 16:36:04 crc kubenswrapper[5120]: I0316 16:36:04.897391 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4e17300c-81c6-4f7f-a4ae-4e3e04e27bc2" path="/var/lib/kubelet/pods/4e17300c-81c6-4f7f-a4ae-4e3e04e27bc2/volumes" Mar 16 16:36:04 crc kubenswrapper[5120]: I0316 16:36:04.898409 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7d70927c-1432-4edb-a414-ca8fc40dd220" path="/var/lib/kubelet/pods/7d70927c-1432-4edb-a414-ca8fc40dd220/volumes" Mar 16 16:36:04 crc kubenswrapper[5120]: I0316 16:36:04.899102 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8bdf17ec-c07e-48a9-b713-e065819e9978" path="/var/lib/kubelet/pods/8bdf17ec-c07e-48a9-b713-e065819e9978/volumes" Mar 16 16:36:04 crc kubenswrapper[5120]: I0316 16:36:04.901178 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b338d0b9-ef27-4f2b-9ede-7b8c7bdc340c" path="/var/lib/kubelet/pods/b338d0b9-ef27-4f2b-9ede-7b8c7bdc340c/volumes" Mar 16 16:36:04 crc kubenswrapper[5120]: I0316 16:36:04.930242 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:36:05 crc kubenswrapper[5120]: I0316 16:36:05.052230 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:36:05 crc kubenswrapper[5120]: I0316 16:36:05.072184 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-db-sync-vqvr9" podStartSLOduration=5.072159919 podStartE2EDuration="5.072159919s" podCreationTimestamp="2026-03-16 16:36:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:36:04.598361012 +0000 UTC m=+3866.752292669" watchObservedRunningTime="2026-03-16 16:36:05.072159919 +0000 UTC m=+3867.226091576" Mar 16 16:36:05 crc kubenswrapper[5120]: I0316 16:36:05.073247 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 16:36:05 crc kubenswrapper[5120]: I0316 16:36:05.098812 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 16:36:05 crc kubenswrapper[5120]: I0316 16:36:05.113246 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 16:36:05 crc kubenswrapper[5120]: I0316 16:36:05.114407 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f99422e5-686e-4d1d-8986-ba6e747db255" containerName="kube-state-metrics" Mar 16 16:36:05 crc kubenswrapper[5120]: I0316 16:36:05.114421 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f99422e5-686e-4d1d-8986-ba6e747db255" containerName="kube-state-metrics" Mar 16 16:36:05 crc kubenswrapper[5120]: I0316 16:36:05.114635 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f99422e5-686e-4d1d-8986-ba6e747db255" containerName="kube-state-metrics" Mar 16 16:36:05 crc kubenswrapper[5120]: I0316 16:36:05.124581 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Mar 16 16:36:05 crc kubenswrapper[5120]: I0316 16:36:05.129181 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-memcached-svc\"" Mar 16 16:36:05 crc kubenswrapper[5120]: I0316 16:36:05.129562 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"memcached-memcached-dockercfg-9ts45\"" Mar 16 16:36:05 crc kubenswrapper[5120]: I0316 16:36:05.140532 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"memcached-config-data\"" Mar 16 16:36:05 crc kubenswrapper[5120]: I0316 16:36:05.155648 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 16:36:05 crc kubenswrapper[5120]: I0316 16:36:05.193574 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-426ss"] Mar 16 16:36:05 crc kubenswrapper[5120]: I0316 16:36:05.232703 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f99422e5-686e-4d1d-8986-ba6e747db255-combined-ca-bundle\") pod \"f99422e5-686e-4d1d-8986-ba6e747db255\" (UID: \"f99422e5-686e-4d1d-8986-ba6e747db255\") " Mar 16 16:36:05 crc kubenswrapper[5120]: I0316 16:36:05.234123 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/f99422e5-686e-4d1d-8986-ba6e747db255-kube-state-metrics-tls-config\") pod \"f99422e5-686e-4d1d-8986-ba6e747db255\" (UID: \"f99422e5-686e-4d1d-8986-ba6e747db255\") " Mar 16 16:36:05 crc kubenswrapper[5120]: I0316 16:36:05.234301 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/f99422e5-686e-4d1d-8986-ba6e747db255-kube-state-metrics-tls-certs\") pod \"f99422e5-686e-4d1d-8986-ba6e747db255\" (UID: \"f99422e5-686e-4d1d-8986-ba6e747db255\") " Mar 16 16:36:05 crc kubenswrapper[5120]: I0316 16:36:05.234721 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xmb55\" (UniqueName: \"kubernetes.io/projected/f99422e5-686e-4d1d-8986-ba6e747db255-kube-api-access-xmb55\") pod \"f99422e5-686e-4d1d-8986-ba6e747db255\" (UID: \"f99422e5-686e-4d1d-8986-ba6e747db255\") " Mar 16 16:36:05 crc kubenswrapper[5120]: I0316 16:36:05.235177 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/2cc5c2d3-3da0-4d0c-9541-78f0bf375648-memcached-tls-certs\") pod \"memcached-0\" (UID: \"2cc5c2d3-3da0-4d0c-9541-78f0bf375648\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:36:05 crc kubenswrapper[5120]: I0316 16:36:05.235603 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54b2m\" (UniqueName: \"kubernetes.io/projected/2cc5c2d3-3da0-4d0c-9541-78f0bf375648-kube-api-access-54b2m\") pod \"memcached-0\" (UID: \"2cc5c2d3-3da0-4d0c-9541-78f0bf375648\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:36:05 crc kubenswrapper[5120]: I0316 16:36:05.235745 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/2cc5c2d3-3da0-4d0c-9541-78f0bf375648-config-data\") pod \"memcached-0\" (UID: \"2cc5c2d3-3da0-4d0c-9541-78f0bf375648\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:36:05 crc kubenswrapper[5120]: I0316 16:36:05.235779 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/2cc5c2d3-3da0-4d0c-9541-78f0bf375648-kolla-config\") pod \"memcached-0\" (UID: \"2cc5c2d3-3da0-4d0c-9541-78f0bf375648\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:36:05 crc kubenswrapper[5120]: I0316 16:36:05.235798 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2cc5c2d3-3da0-4d0c-9541-78f0bf375648-combined-ca-bundle\") pod \"memcached-0\" (UID: \"2cc5c2d3-3da0-4d0c-9541-78f0bf375648\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:36:05 crc kubenswrapper[5120]: I0316 16:36:05.255975 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f99422e5-686e-4d1d-8986-ba6e747db255-kube-api-access-xmb55" (OuterVolumeSpecName: "kube-api-access-xmb55") pod "f99422e5-686e-4d1d-8986-ba6e747db255" (UID: "f99422e5-686e-4d1d-8986-ba6e747db255"). InnerVolumeSpecName "kube-api-access-xmb55". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:36:05 crc kubenswrapper[5120]: I0316 16:36:05.280382 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f99422e5-686e-4d1d-8986-ba6e747db255-kube-state-metrics-tls-config" (OuterVolumeSpecName: "kube-state-metrics-tls-config") pod "f99422e5-686e-4d1d-8986-ba6e747db255" (UID: "f99422e5-686e-4d1d-8986-ba6e747db255"). InnerVolumeSpecName "kube-state-metrics-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:36:05 crc kubenswrapper[5120]: I0316 16:36:05.301170 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f99422e5-686e-4d1d-8986-ba6e747db255-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f99422e5-686e-4d1d-8986-ba6e747db255" (UID: "f99422e5-686e-4d1d-8986-ba6e747db255"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:36:05 crc kubenswrapper[5120]: I0316 16:36:05.338787 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-54b2m\" (UniqueName: \"kubernetes.io/projected/2cc5c2d3-3da0-4d0c-9541-78f0bf375648-kube-api-access-54b2m\") pod \"memcached-0\" (UID: \"2cc5c2d3-3da0-4d0c-9541-78f0bf375648\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:36:05 crc kubenswrapper[5120]: I0316 16:36:05.339057 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/2cc5c2d3-3da0-4d0c-9541-78f0bf375648-config-data\") pod \"memcached-0\" (UID: \"2cc5c2d3-3da0-4d0c-9541-78f0bf375648\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:36:05 crc kubenswrapper[5120]: I0316 16:36:05.339092 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/2cc5c2d3-3da0-4d0c-9541-78f0bf375648-kolla-config\") pod \"memcached-0\" (UID: \"2cc5c2d3-3da0-4d0c-9541-78f0bf375648\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:36:05 crc kubenswrapper[5120]: I0316 16:36:05.339118 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2cc5c2d3-3da0-4d0c-9541-78f0bf375648-combined-ca-bundle\") pod \"memcached-0\" (UID: \"2cc5c2d3-3da0-4d0c-9541-78f0bf375648\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:36:05 crc kubenswrapper[5120]: I0316 16:36:05.339223 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/2cc5c2d3-3da0-4d0c-9541-78f0bf375648-memcached-tls-certs\") pod \"memcached-0\" (UID: \"2cc5c2d3-3da0-4d0c-9541-78f0bf375648\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:36:05 crc kubenswrapper[5120]: I0316 16:36:05.339321 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xmb55\" (UniqueName: \"kubernetes.io/projected/f99422e5-686e-4d1d-8986-ba6e747db255-kube-api-access-xmb55\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:05 crc kubenswrapper[5120]: I0316 16:36:05.339336 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f99422e5-686e-4d1d-8986-ba6e747db255-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:05 crc kubenswrapper[5120]: I0316 16:36:05.339348 5120 reconciler_common.go:299] "Volume detached for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/f99422e5-686e-4d1d-8986-ba6e747db255-kube-state-metrics-tls-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:05 crc kubenswrapper[5120]: I0316 16:36:05.340519 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/2cc5c2d3-3da0-4d0c-9541-78f0bf375648-kolla-config\") pod \"memcached-0\" (UID: \"2cc5c2d3-3da0-4d0c-9541-78f0bf375648\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:36:05 crc kubenswrapper[5120]: I0316 16:36:05.341870 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/2cc5c2d3-3da0-4d0c-9541-78f0bf375648-config-data\") pod \"memcached-0\" (UID: \"2cc5c2d3-3da0-4d0c-9541-78f0bf375648\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:36:05 crc kubenswrapper[5120]: I0316 16:36:05.352455 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2cc5c2d3-3da0-4d0c-9541-78f0bf375648-combined-ca-bundle\") pod \"memcached-0\" (UID: \"2cc5c2d3-3da0-4d0c-9541-78f0bf375648\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:36:05 crc kubenswrapper[5120]: I0316 16:36:05.364795 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/2cc5c2d3-3da0-4d0c-9541-78f0bf375648-memcached-tls-certs\") pod \"memcached-0\" (UID: \"2cc5c2d3-3da0-4d0c-9541-78f0bf375648\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:36:05 crc kubenswrapper[5120]: I0316 16:36:05.374129 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-54b2m\" (UniqueName: \"kubernetes.io/projected/2cc5c2d3-3da0-4d0c-9541-78f0bf375648-kube-api-access-54b2m\") pod \"memcached-0\" (UID: \"2cc5c2d3-3da0-4d0c-9541-78f0bf375648\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:36:05 crc kubenswrapper[5120]: I0316 16:36:05.380442 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:36:05 crc kubenswrapper[5120]: I0316 16:36:05.394407 5120 scope.go:117] "RemoveContainer" containerID="3436ec6db1208b559eb91d991c3a73a3c9159ecad9eb1aeb50786f88a3c7bc52" Mar 16 16:36:05 crc kubenswrapper[5120]: I0316 16:36:05.398678 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f99422e5-686e-4d1d-8986-ba6e747db255-kube-state-metrics-tls-certs" (OuterVolumeSpecName: "kube-state-metrics-tls-certs") pod "f99422e5-686e-4d1d-8986-ba6e747db255" (UID: "f99422e5-686e-4d1d-8986-ba6e747db255"). InnerVolumeSpecName "kube-state-metrics-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:36:05 crc kubenswrapper[5120]: I0316 16:36:05.445122 5120 reconciler_common.go:299] "Volume detached for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/f99422e5-686e-4d1d-8986-ba6e747db255-kube-state-metrics-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:05 crc kubenswrapper[5120]: I0316 16:36:05.455114 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Mar 16 16:36:05 crc kubenswrapper[5120]: I0316 16:36:05.541064 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-nhhml"] Mar 16 16:36:05 crc kubenswrapper[5120]: I0316 16:36:05.547254 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/d24d09c6-d2a8-418d-8ddf-a5e64672f554-galera-tls-certs\") pod \"d24d09c6-d2a8-418d-8ddf-a5e64672f554\" (UID: \"d24d09c6-d2a8-418d-8ddf-a5e64672f554\") " Mar 16 16:36:05 crc kubenswrapper[5120]: I0316 16:36:05.547314 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/d24d09c6-d2a8-418d-8ddf-a5e64672f554-kolla-config\") pod \"d24d09c6-d2a8-418d-8ddf-a5e64672f554\" (UID: \"d24d09c6-d2a8-418d-8ddf-a5e64672f554\") " Mar 16 16:36:05 crc kubenswrapper[5120]: I0316 16:36:05.547382 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d24d09c6-d2a8-418d-8ddf-a5e64672f554-combined-ca-bundle\") pod \"d24d09c6-d2a8-418d-8ddf-a5e64672f554\" (UID: \"d24d09c6-d2a8-418d-8ddf-a5e64672f554\") " Mar 16 16:36:05 crc kubenswrapper[5120]: I0316 16:36:05.547421 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/d24d09c6-d2a8-418d-8ddf-a5e64672f554-config-data-default\") pod \"d24d09c6-d2a8-418d-8ddf-a5e64672f554\" (UID: \"d24d09c6-d2a8-418d-8ddf-a5e64672f554\") " Mar 16 16:36:05 crc kubenswrapper[5120]: I0316 16:36:05.547699 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d24d09c6-d2a8-418d-8ddf-a5e64672f554-operator-scripts\") pod \"d24d09c6-d2a8-418d-8ddf-a5e64672f554\" (UID: \"d24d09c6-d2a8-418d-8ddf-a5e64672f554\") " Mar 16 16:36:05 crc kubenswrapper[5120]: I0316 16:36:05.547905 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"mysql-db\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"d24d09c6-d2a8-418d-8ddf-a5e64672f554\" (UID: \"d24d09c6-d2a8-418d-8ddf-a5e64672f554\") " Mar 16 16:36:05 crc kubenswrapper[5120]: I0316 16:36:05.547950 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xtqkz\" (UniqueName: \"kubernetes.io/projected/d24d09c6-d2a8-418d-8ddf-a5e64672f554-kube-api-access-xtqkz\") pod \"d24d09c6-d2a8-418d-8ddf-a5e64672f554\" (UID: \"d24d09c6-d2a8-418d-8ddf-a5e64672f554\") " Mar 16 16:36:05 crc kubenswrapper[5120]: I0316 16:36:05.548246 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/d24d09c6-d2a8-418d-8ddf-a5e64672f554-config-data-generated\") pod \"d24d09c6-d2a8-418d-8ddf-a5e64672f554\" (UID: \"d24d09c6-d2a8-418d-8ddf-a5e64672f554\") " Mar 16 16:36:05 crc kubenswrapper[5120]: I0316 16:36:05.554835 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d24d09c6-d2a8-418d-8ddf-a5e64672f554-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "d24d09c6-d2a8-418d-8ddf-a5e64672f554" (UID: "d24d09c6-d2a8-418d-8ddf-a5e64672f554"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:36:05 crc kubenswrapper[5120]: I0316 16:36:05.555144 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d24d09c6-d2a8-418d-8ddf-a5e64672f554-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "d24d09c6-d2a8-418d-8ddf-a5e64672f554" (UID: "d24d09c6-d2a8-418d-8ddf-a5e64672f554"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:36:05 crc kubenswrapper[5120]: I0316 16:36:05.555228 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d24d09c6-d2a8-418d-8ddf-a5e64672f554-config-data-default" (OuterVolumeSpecName: "config-data-default") pod "d24d09c6-d2a8-418d-8ddf-a5e64672f554" (UID: "d24d09c6-d2a8-418d-8ddf-a5e64672f554"). InnerVolumeSpecName "config-data-default". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:36:05 crc kubenswrapper[5120]: I0316 16:36:05.589316 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d24d09c6-d2a8-418d-8ddf-a5e64672f554-config-data-generated" (OuterVolumeSpecName: "config-data-generated") pod "d24d09c6-d2a8-418d-8ddf-a5e64672f554" (UID: "d24d09c6-d2a8-418d-8ddf-a5e64672f554"). InnerVolumeSpecName "config-data-generated". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:36:05 crc kubenswrapper[5120]: I0316 16:36:05.592474 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d24d09c6-d2a8-418d-8ddf-a5e64672f554-kube-api-access-xtqkz" (OuterVolumeSpecName: "kube-api-access-xtqkz") pod "d24d09c6-d2a8-418d-8ddf-a5e64672f554" (UID: "d24d09c6-d2a8-418d-8ddf-a5e64672f554"). InnerVolumeSpecName "kube-api-access-xtqkz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:36:05 crc kubenswrapper[5120]: I0316 16:36:05.633421 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:36:05 crc kubenswrapper[5120]: I0316 16:36:05.635456 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"f99422e5-686e-4d1d-8986-ba6e747db255","Type":"ContainerDied","Data":"83b0d65aa16963f5ca38511db01ad7c30a95c88f629bae8141169631eb0190f0"} Mar 16 16:36:05 crc kubenswrapper[5120]: I0316 16:36:05.635689 5120 scope.go:117] "RemoveContainer" containerID="a130b33bcc067dd6c3adb134433231928cbd2b5634c364451c12b069eb703117" Mar 16 16:36:05 crc kubenswrapper[5120]: I0316 16:36:05.652124 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d24d09c6-d2a8-418d-8ddf-a5e64672f554-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:05 crc kubenswrapper[5120]: I0316 16:36:05.652162 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xtqkz\" (UniqueName: \"kubernetes.io/projected/d24d09c6-d2a8-418d-8ddf-a5e64672f554-kube-api-access-xtqkz\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:05 crc kubenswrapper[5120]: I0316 16:36:05.652176 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/d24d09c6-d2a8-418d-8ddf-a5e64672f554-config-data-generated\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:05 crc kubenswrapper[5120]: I0316 16:36:05.652188 5120 reconciler_common.go:299] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/d24d09c6-d2a8-418d-8ddf-a5e64672f554-kolla-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:05 crc kubenswrapper[5120]: I0316 16:36:05.652202 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/d24d09c6-d2a8-418d-8ddf-a5e64672f554-config-data-default\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:05 crc kubenswrapper[5120]: I0316 16:36:05.663802 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage05-crc" (OuterVolumeSpecName: "mysql-db") pod "d24d09c6-d2a8-418d-8ddf-a5e64672f554" (UID: "d24d09c6-d2a8-418d-8ddf-a5e64672f554"). InnerVolumeSpecName "local-storage05-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:36:05 crc kubenswrapper[5120]: I0316 16:36:05.695632 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-b5trh" event={"ID":"91d6af93-90b1-4d80-86df-11a701664a68","Type":"ContainerStarted","Data":"38385cceddb8eb34b90b293e25b867b6b891c23d41c0c7f8de139a587a430982"} Mar 16 16:36:05 crc kubenswrapper[5120]: I0316 16:36:05.700700 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"364bfdcf-9673-41c8-b692-941d68257973","Type":"ContainerDied","Data":"a397d7903b516bbcf556d04b25c769d0d17a40153ae4bf6f729f049c61381a60"} Mar 16 16:36:05 crc kubenswrapper[5120]: I0316 16:36:05.754503 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") on node \"crc\" " Mar 16 16:36:05 crc kubenswrapper[5120]: I0316 16:36:05.759551 5120 generic.go:358] "Generic (PLEG): container finished" podID="68089cb0-f9b0-4b76-9778-e2edffaa4f55" containerID="2ac4108315559f612a567fff03f8ef9fecb013f02a2aade950e30e5def4a5997" exitCode=0 Mar 16 16:36:05 crc kubenswrapper[5120]: I0316 16:36:05.759584 5120 generic.go:358] "Generic (PLEG): container finished" podID="68089cb0-f9b0-4b76-9778-e2edffaa4f55" containerID="a65e2e3da3516c3727074c62fc6b9251f1f45049075f88d761d5c9cecc497707" exitCode=0 Mar 16 16:36:05 crc kubenswrapper[5120]: I0316 16:36:05.759594 5120 generic.go:358] "Generic (PLEG): container finished" podID="68089cb0-f9b0-4b76-9778-e2edffaa4f55" containerID="3045e329b7334cfdf59c5f7569d481ddcf6b9cef5a1d41651bdf7a09fe16cce6" exitCode=0 Mar 16 16:36:05 crc kubenswrapper[5120]: I0316 16:36:05.759604 5120 generic.go:358] "Generic (PLEG): container finished" podID="68089cb0-f9b0-4b76-9778-e2edffaa4f55" containerID="6c2e9e23b6576fc2a9ba6d556319b9df1b2c25022fca788477700ea2cab3db1d" exitCode=0 Mar 16 16:36:05 crc kubenswrapper[5120]: I0316 16:36:05.759613 5120 generic.go:358] "Generic (PLEG): container finished" podID="68089cb0-f9b0-4b76-9778-e2edffaa4f55" containerID="f6201cdf3cad8158121c3b8225a265abde1e721d5969401a866ae07675028dac" exitCode=0 Mar 16 16:36:05 crc kubenswrapper[5120]: I0316 16:36:05.759714 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"68089cb0-f9b0-4b76-9778-e2edffaa4f55","Type":"ContainerDied","Data":"2ac4108315559f612a567fff03f8ef9fecb013f02a2aade950e30e5def4a5997"} Mar 16 16:36:05 crc kubenswrapper[5120]: I0316 16:36:05.759747 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"68089cb0-f9b0-4b76-9778-e2edffaa4f55","Type":"ContainerDied","Data":"a65e2e3da3516c3727074c62fc6b9251f1f45049075f88d761d5c9cecc497707"} Mar 16 16:36:05 crc kubenswrapper[5120]: I0316 16:36:05.759779 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"68089cb0-f9b0-4b76-9778-e2edffaa4f55","Type":"ContainerDied","Data":"3045e329b7334cfdf59c5f7569d481ddcf6b9cef5a1d41651bdf7a09fe16cce6"} Mar 16 16:36:05 crc kubenswrapper[5120]: I0316 16:36:05.759795 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"68089cb0-f9b0-4b76-9778-e2edffaa4f55","Type":"ContainerDied","Data":"6c2e9e23b6576fc2a9ba6d556319b9df1b2c25022fca788477700ea2cab3db1d"} Mar 16 16:36:05 crc kubenswrapper[5120]: I0316 16:36:05.759806 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"68089cb0-f9b0-4b76-9778-e2edffaa4f55","Type":"ContainerDied","Data":"f6201cdf3cad8158121c3b8225a265abde1e721d5969401a866ae07675028dac"} Mar 16 16:36:05 crc kubenswrapper[5120]: I0316 16:36:05.769233 5120 generic.go:358] "Generic (PLEG): container finished" podID="4093a7c4-51d9-4119-8e47-c06f29723894" containerID="90578380dd3689e88764f9ad9d1a470340f3570e79e4db8d8c234d43e57fa7e3" exitCode=0 Mar 16 16:36:05 crc kubenswrapper[5120]: I0316 16:36:05.769667 5120 generic.go:358] "Generic (PLEG): container finished" podID="4093a7c4-51d9-4119-8e47-c06f29723894" containerID="60385fabe480fed7555f36dc6f1b4459b21a84b49a3a1f92af6eb03c6e2df9c9" exitCode=0 Mar 16 16:36:05 crc kubenswrapper[5120]: I0316 16:36:05.769673 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"4093a7c4-51d9-4119-8e47-c06f29723894","Type":"ContainerDied","Data":"90578380dd3689e88764f9ad9d1a470340f3570e79e4db8d8c234d43e57fa7e3"} Mar 16 16:36:05 crc kubenswrapper[5120]: I0316 16:36:05.769717 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"4093a7c4-51d9-4119-8e47-c06f29723894","Type":"ContainerDied","Data":"60385fabe480fed7555f36dc6f1b4459b21a84b49a3a1f92af6eb03c6e2df9c9"} Mar 16 16:36:05 crc kubenswrapper[5120]: I0316 16:36:05.791018 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-bmfrv" event={"ID":"d0d98630-1fca-41f0-ba40-03f42f303121","Type":"ContainerStarted","Data":"313b3b5a843c78582407f033efb01a381513dcfd6dee421e1f746fb551f6bebd"} Mar 16 16:36:05 crc kubenswrapper[5120]: I0316 16:36:05.813017 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"d24d09c6-d2a8-418d-8ddf-a5e64672f554","Type":"ContainerDied","Data":"314a82fa6f173fea0c6644ca1242d60b1dccb681f17ee341ba54334eb9d89328"} Mar 16 16:36:05 crc kubenswrapper[5120]: I0316 16:36:05.813137 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:36:05 crc kubenswrapper[5120]: I0316 16:36:05.817690 5120 generic.go:358] "Generic (PLEG): container finished" podID="f8b2ced8-a236-4ae1-88cd-7f14c5aee21b" containerID="a6da655c3ab3c081a862ed09a600b2b898335b09cbe7c305e5bbc8934c874f4b" exitCode=0 Mar 16 16:36:05 crc kubenswrapper[5120]: I0316 16:36:05.818018 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"f8b2ced8-a236-4ae1-88cd-7f14c5aee21b","Type":"ContainerDied","Data":"a6da655c3ab3c081a862ed09a600b2b898335b09cbe7c305e5bbc8934c874f4b"} Mar 16 16:36:05 crc kubenswrapper[5120]: I0316 16:36:05.822518 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-r8627" event={"ID":"1b9d0a58-9639-4577-9b99-d34345657929","Type":"ContainerStarted","Data":"ef734edf4d11c23060843c1cffe2dfb6dfe3cf94314d828dcf60d85936dffb88"} Mar 16 16:36:05 crc kubenswrapper[5120]: I0316 16:36:05.832381 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-426ss" event={"ID":"c951a6f5-568c-4da3-b6b3-e0310ca934bc","Type":"ContainerStarted","Data":"96bf78dcc6461fcc634f8815ca4cccb23ca7636159d8167fce7fa1164c84b12b"} Mar 16 16:36:06 crc kubenswrapper[5120]: I0316 16:36:06.009690 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-4ckj9"] Mar 16 16:36:06 crc kubenswrapper[5120]: I0316 16:36:06.065546 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d24d09c6-d2a8-418d-8ddf-a5e64672f554-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "d24d09c6-d2a8-418d-8ddf-a5e64672f554" (UID: "d24d09c6-d2a8-418d-8ddf-a5e64672f554"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:36:06 crc kubenswrapper[5120]: I0316 16:36:06.076413 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage05-crc" (UniqueName: "kubernetes.io/local-volume/local-storage05-crc") on node "crc" Mar 16 16:36:06 crc kubenswrapper[5120]: I0316 16:36:06.084584 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:06 crc kubenswrapper[5120]: I0316 16:36:06.084620 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d24d09c6-d2a8-418d-8ddf-a5e64672f554-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:06 crc kubenswrapper[5120]: I0316 16:36:06.124909 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d24d09c6-d2a8-418d-8ddf-a5e64672f554-galera-tls-certs" (OuterVolumeSpecName: "galera-tls-certs") pod "d24d09c6-d2a8-418d-8ddf-a5e64672f554" (UID: "d24d09c6-d2a8-418d-8ddf-a5e64672f554"). InnerVolumeSpecName "galera-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:36:06 crc kubenswrapper[5120]: I0316 16:36:06.207457 5120 reconciler_common.go:299] "Volume detached for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/d24d09c6-d2a8-418d-8ddf-a5e64672f554-galera-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:06 crc kubenswrapper[5120]: I0316 16:36:06.233664 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-9nksc"] Mar 16 16:36:06 crc kubenswrapper[5120]: I0316 16:36:06.279344 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 16:36:06 crc kubenswrapper[5120]: I0316 16:36:06.327897 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 16:36:06 crc kubenswrapper[5120]: I0316 16:36:06.353793 5120 scope.go:117] "RemoveContainer" containerID="da18e02e60563fdf4b993a489a08f0afac75c00cbf47e05276bd0256d2e32f2c" Mar 16 16:36:06 crc kubenswrapper[5120]: I0316 16:36:06.355547 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 16:36:06 crc kubenswrapper[5120]: I0316 16:36:06.370035 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 16:36:06 crc kubenswrapper[5120]: I0316 16:36:06.409161 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:36:06 crc kubenswrapper[5120]: I0316 16:36:06.518244 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f8b2ced8-a236-4ae1-88cd-7f14c5aee21b-operator-scripts\") pod \"f8b2ced8-a236-4ae1-88cd-7f14c5aee21b\" (UID: \"f8b2ced8-a236-4ae1-88cd-7f14c5aee21b\") " Mar 16 16:36:06 crc kubenswrapper[5120]: I0316 16:36:06.518508 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f8b2ced8-a236-4ae1-88cd-7f14c5aee21b-combined-ca-bundle\") pod \"f8b2ced8-a236-4ae1-88cd-7f14c5aee21b\" (UID: \"f8b2ced8-a236-4ae1-88cd-7f14c5aee21b\") " Mar 16 16:36:06 crc kubenswrapper[5120]: I0316 16:36:06.518623 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/f8b2ced8-a236-4ae1-88cd-7f14c5aee21b-config-data-generated\") pod \"f8b2ced8-a236-4ae1-88cd-7f14c5aee21b\" (UID: \"f8b2ced8-a236-4ae1-88cd-7f14c5aee21b\") " Mar 16 16:36:06 crc kubenswrapper[5120]: I0316 16:36:06.518672 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/f8b2ced8-a236-4ae1-88cd-7f14c5aee21b-config-data-default\") pod \"f8b2ced8-a236-4ae1-88cd-7f14c5aee21b\" (UID: \"f8b2ced8-a236-4ae1-88cd-7f14c5aee21b\") " Mar 16 16:36:06 crc kubenswrapper[5120]: I0316 16:36:06.518696 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/f8b2ced8-a236-4ae1-88cd-7f14c5aee21b-kolla-config\") pod \"f8b2ced8-a236-4ae1-88cd-7f14c5aee21b\" (UID: \"f8b2ced8-a236-4ae1-88cd-7f14c5aee21b\") " Mar 16 16:36:06 crc kubenswrapper[5120]: I0316 16:36:06.518836 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"mysql-db\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"f8b2ced8-a236-4ae1-88cd-7f14c5aee21b\" (UID: \"f8b2ced8-a236-4ae1-88cd-7f14c5aee21b\") " Mar 16 16:36:06 crc kubenswrapper[5120]: I0316 16:36:06.518981 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/f8b2ced8-a236-4ae1-88cd-7f14c5aee21b-galera-tls-certs\") pod \"f8b2ced8-a236-4ae1-88cd-7f14c5aee21b\" (UID: \"f8b2ced8-a236-4ae1-88cd-7f14c5aee21b\") " Mar 16 16:36:06 crc kubenswrapper[5120]: I0316 16:36:06.519083 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zmjld\" (UniqueName: \"kubernetes.io/projected/f8b2ced8-a236-4ae1-88cd-7f14c5aee21b-kube-api-access-zmjld\") pod \"f8b2ced8-a236-4ae1-88cd-7f14c5aee21b\" (UID: \"f8b2ced8-a236-4ae1-88cd-7f14c5aee21b\") " Mar 16 16:36:06 crc kubenswrapper[5120]: I0316 16:36:06.522151 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f8b2ced8-a236-4ae1-88cd-7f14c5aee21b-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "f8b2ced8-a236-4ae1-88cd-7f14c5aee21b" (UID: "f8b2ced8-a236-4ae1-88cd-7f14c5aee21b"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:36:06 crc kubenswrapper[5120]: I0316 16:36:06.527023 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f8b2ced8-a236-4ae1-88cd-7f14c5aee21b-config-data-default" (OuterVolumeSpecName: "config-data-default") pod "f8b2ced8-a236-4ae1-88cd-7f14c5aee21b" (UID: "f8b2ced8-a236-4ae1-88cd-7f14c5aee21b"). InnerVolumeSpecName "config-data-default". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:36:06 crc kubenswrapper[5120]: I0316 16:36:06.529483 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8b2ced8-a236-4ae1-88cd-7f14c5aee21b-config-data-generated" (OuterVolumeSpecName: "config-data-generated") pod "f8b2ced8-a236-4ae1-88cd-7f14c5aee21b" (UID: "f8b2ced8-a236-4ae1-88cd-7f14c5aee21b"). InnerVolumeSpecName "config-data-generated". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:36:06 crc kubenswrapper[5120]: I0316 16:36:06.532302 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f8b2ced8-a236-4ae1-88cd-7f14c5aee21b-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "f8b2ced8-a236-4ae1-88cd-7f14c5aee21b" (UID: "f8b2ced8-a236-4ae1-88cd-7f14c5aee21b"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:36:06 crc kubenswrapper[5120]: I0316 16:36:06.575554 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8b2ced8-a236-4ae1-88cd-7f14c5aee21b-kube-api-access-zmjld" (OuterVolumeSpecName: "kube-api-access-zmjld") pod "f8b2ced8-a236-4ae1-88cd-7f14c5aee21b" (UID: "f8b2ced8-a236-4ae1-88cd-7f14c5aee21b"). InnerVolumeSpecName "kube-api-access-zmjld". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:36:06 crc kubenswrapper[5120]: I0316 16:36:06.579216 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 16:36:06 crc kubenswrapper[5120]: I0316 16:36:06.579247 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 16:36:06 crc kubenswrapper[5120]: I0316 16:36:06.580686 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d24d09c6-d2a8-418d-8ddf-a5e64672f554" containerName="galera" Mar 16 16:36:06 crc kubenswrapper[5120]: I0316 16:36:06.580704 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="d24d09c6-d2a8-418d-8ddf-a5e64672f554" containerName="galera" Mar 16 16:36:06 crc kubenswrapper[5120]: I0316 16:36:06.580737 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8b2ced8-a236-4ae1-88cd-7f14c5aee21b" containerName="mysql-bootstrap" Mar 16 16:36:06 crc kubenswrapper[5120]: I0316 16:36:06.580743 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8b2ced8-a236-4ae1-88cd-7f14c5aee21b" containerName="mysql-bootstrap" Mar 16 16:36:06 crc kubenswrapper[5120]: I0316 16:36:06.582784 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d24d09c6-d2a8-418d-8ddf-a5e64672f554" containerName="mysql-bootstrap" Mar 16 16:36:06 crc kubenswrapper[5120]: I0316 16:36:06.582805 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="d24d09c6-d2a8-418d-8ddf-a5e64672f554" containerName="mysql-bootstrap" Mar 16 16:36:06 crc kubenswrapper[5120]: I0316 16:36:06.582831 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8b2ced8-a236-4ae1-88cd-7f14c5aee21b" containerName="galera" Mar 16 16:36:06 crc kubenswrapper[5120]: I0316 16:36:06.582837 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8b2ced8-a236-4ae1-88cd-7f14c5aee21b" containerName="galera" Mar 16 16:36:06 crc kubenswrapper[5120]: I0316 16:36:06.583048 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="d24d09c6-d2a8-418d-8ddf-a5e64672f554" containerName="galera" Mar 16 16:36:06 crc kubenswrapper[5120]: I0316 16:36:06.583073 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f8b2ced8-a236-4ae1-88cd-7f14c5aee21b" containerName="galera" Mar 16 16:36:06 crc kubenswrapper[5120]: I0316 16:36:06.599217 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 16:36:06 crc kubenswrapper[5120]: I0316 16:36:06.599369 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:36:06 crc kubenswrapper[5120]: I0316 16:36:06.618332 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage10-crc" (OuterVolumeSpecName: "mysql-db") pod "f8b2ced8-a236-4ae1-88cd-7f14c5aee21b" (UID: "f8b2ced8-a236-4ae1-88cd-7f14c5aee21b"). InnerVolumeSpecName "local-storage10-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:36:06 crc kubenswrapper[5120]: I0316 16:36:06.618576 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"kube-state-metrics-tls-config\"" Mar 16 16:36:06 crc kubenswrapper[5120]: I0316 16:36:06.618867 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-kube-state-metrics-svc\"" Mar 16 16:36:06 crc kubenswrapper[5120]: I0316 16:36:06.622042 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") on node \"crc\" " Mar 16 16:36:06 crc kubenswrapper[5120]: I0316 16:36:06.622083 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zmjld\" (UniqueName: \"kubernetes.io/projected/f8b2ced8-a236-4ae1-88cd-7f14c5aee21b-kube-api-access-zmjld\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:06 crc kubenswrapper[5120]: I0316 16:36:06.622095 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f8b2ced8-a236-4ae1-88cd-7f14c5aee21b-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:06 crc kubenswrapper[5120]: I0316 16:36:06.622105 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/f8b2ced8-a236-4ae1-88cd-7f14c5aee21b-config-data-generated\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:06 crc kubenswrapper[5120]: I0316 16:36:06.622114 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/f8b2ced8-a236-4ae1-88cd-7f14c5aee21b-config-data-default\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:06 crc kubenswrapper[5120]: I0316 16:36:06.622123 5120 reconciler_common.go:299] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/f8b2ced8-a236-4ae1-88cd-7f14c5aee21b-kolla-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:06 crc kubenswrapper[5120]: I0316 16:36:06.656029 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f8b2ced8-a236-4ae1-88cd-7f14c5aee21b-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f8b2ced8-a236-4ae1-88cd-7f14c5aee21b" (UID: "f8b2ced8-a236-4ae1-88cd-7f14c5aee21b"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:36:06 crc kubenswrapper[5120]: I0316 16:36:06.675031 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f8b2ced8-a236-4ae1-88cd-7f14c5aee21b-galera-tls-certs" (OuterVolumeSpecName: "galera-tls-certs") pod "f8b2ced8-a236-4ae1-88cd-7f14c5aee21b" (UID: "f8b2ced8-a236-4ae1-88cd-7f14c5aee21b"). InnerVolumeSpecName "galera-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:36:06 crc kubenswrapper[5120]: I0316 16:36:06.709051 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9998e1ac-8e55-4be8-8b49-ff3f7434b699" path="/var/lib/kubelet/pods/9998e1ac-8e55-4be8-8b49-ff3f7434b699/volumes" Mar 16 16:36:06 crc kubenswrapper[5120]: I0316 16:36:06.710117 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f99422e5-686e-4d1d-8986-ba6e747db255" path="/var/lib/kubelet/pods/f99422e5-686e-4d1d-8986-ba6e747db255/volumes" Mar 16 16:36:06 crc kubenswrapper[5120]: I0316 16:36:06.723828 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/2c50d5a6-1160-4c1d-a0ee-6dff4d5e6b87-kube-state-metrics-tls-certs\") pod \"kube-state-metrics-0\" (UID: \"2c50d5a6-1160-4c1d-a0ee-6dff4d5e6b87\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:36:06 crc kubenswrapper[5120]: I0316 16:36:06.723938 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2c50d5a6-1160-4c1d-a0ee-6dff4d5e6b87-combined-ca-bundle\") pod \"kube-state-metrics-0\" (UID: \"2c50d5a6-1160-4c1d-a0ee-6dff4d5e6b87\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:36:06 crc kubenswrapper[5120]: I0316 16:36:06.724026 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7d8m\" (UniqueName: \"kubernetes.io/projected/2c50d5a6-1160-4c1d-a0ee-6dff4d5e6b87-kube-api-access-f7d8m\") pod \"kube-state-metrics-0\" (UID: \"2c50d5a6-1160-4c1d-a0ee-6dff4d5e6b87\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:36:06 crc kubenswrapper[5120]: I0316 16:36:06.724133 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/2c50d5a6-1160-4c1d-a0ee-6dff4d5e6b87-kube-state-metrics-tls-config\") pod \"kube-state-metrics-0\" (UID: \"2c50d5a6-1160-4c1d-a0ee-6dff4d5e6b87\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:36:06 crc kubenswrapper[5120]: I0316 16:36:06.724298 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f8b2ced8-a236-4ae1-88cd-7f14c5aee21b-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:06 crc kubenswrapper[5120]: I0316 16:36:06.724317 5120 reconciler_common.go:299] "Volume detached for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/f8b2ced8-a236-4ae1-88cd-7f14c5aee21b-galera-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:06 crc kubenswrapper[5120]: I0316 16:36:06.779624 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="63d9a98c-175f-4caa-bd33-41eb82d6e06b" containerName="cinder-scheduler" probeResult="failure" output="HTTP probe failed with statuscode: 500" Mar 16 16:36:06 crc kubenswrapper[5120]: I0316 16:36:06.798536 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage10-crc" (UniqueName: "kubernetes.io/local-volume/local-storage10-crc") on node "crc" Mar 16 16:36:06 crc kubenswrapper[5120]: I0316 16:36:06.826512 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:36:06 crc kubenswrapper[5120]: I0316 16:36:06.828462 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/2c50d5a6-1160-4c1d-a0ee-6dff4d5e6b87-kube-state-metrics-tls-certs\") pod \"kube-state-metrics-0\" (UID: \"2c50d5a6-1160-4c1d-a0ee-6dff4d5e6b87\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:36:06 crc kubenswrapper[5120]: I0316 16:36:06.828557 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2c50d5a6-1160-4c1d-a0ee-6dff4d5e6b87-combined-ca-bundle\") pod \"kube-state-metrics-0\" (UID: \"2c50d5a6-1160-4c1d-a0ee-6dff4d5e6b87\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:36:06 crc kubenswrapper[5120]: I0316 16:36:06.828638 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f7d8m\" (UniqueName: \"kubernetes.io/projected/2c50d5a6-1160-4c1d-a0ee-6dff4d5e6b87-kube-api-access-f7d8m\") pod \"kube-state-metrics-0\" (UID: \"2c50d5a6-1160-4c1d-a0ee-6dff4d5e6b87\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:36:06 crc kubenswrapper[5120]: I0316 16:36:06.830114 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/2c50d5a6-1160-4c1d-a0ee-6dff4d5e6b87-kube-state-metrics-tls-config\") pod \"kube-state-metrics-0\" (UID: \"2c50d5a6-1160-4c1d-a0ee-6dff4d5e6b87\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:36:06 crc kubenswrapper[5120]: I0316 16:36:06.830323 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:06 crc kubenswrapper[5120]: I0316 16:36:06.838243 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/2c50d5a6-1160-4c1d-a0ee-6dff4d5e6b87-kube-state-metrics-tls-certs\") pod \"kube-state-metrics-0\" (UID: \"2c50d5a6-1160-4c1d-a0ee-6dff4d5e6b87\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:36:06 crc kubenswrapper[5120]: I0316 16:36:06.840882 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/2c50d5a6-1160-4c1d-a0ee-6dff4d5e6b87-kube-state-metrics-tls-config\") pod \"kube-state-metrics-0\" (UID: \"2c50d5a6-1160-4c1d-a0ee-6dff4d5e6b87\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:36:06 crc kubenswrapper[5120]: I0316 16:36:06.841363 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2c50d5a6-1160-4c1d-a0ee-6dff4d5e6b87-combined-ca-bundle\") pod \"kube-state-metrics-0\" (UID: \"2c50d5a6-1160-4c1d-a0ee-6dff4d5e6b87\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:36:06 crc kubenswrapper[5120]: I0316 16:36:06.858063 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-r8627" event={"ID":"1b9d0a58-9639-4577-9b99-d34345657929","Type":"ContainerStarted","Data":"0b5fa35e8908630cc7fea95fb76a8e5a82208855c38e6f33e82c2cfae6e4da96"} Mar 16 16:36:06 crc kubenswrapper[5120]: I0316 16:36:06.877550 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 16:36:06 crc kubenswrapper[5120]: I0316 16:36:06.885930 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7d8m\" (UniqueName: \"kubernetes.io/projected/2c50d5a6-1160-4c1d-a0ee-6dff4d5e6b87-kube-api-access-f7d8m\") pod \"kube-state-metrics-0\" (UID: \"2c50d5a6-1160-4c1d-a0ee-6dff4d5e6b87\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:36:06 crc kubenswrapper[5120]: I0316 16:36:06.913905 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-db-sync-r8627" podStartSLOduration=5.913885067 podStartE2EDuration="5.913885067s" podCreationTimestamp="2026-03-16 16:36:01 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:36:06.893447562 +0000 UTC m=+3869.047379219" watchObservedRunningTime="2026-03-16 16:36:06.913885067 +0000 UTC m=+3869.067816724" Mar 16 16:36:06 crc kubenswrapper[5120]: I0316 16:36:06.920851 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"58b4ac02-d549-4064-89d2-db3e507c0efc","Type":"ContainerStarted","Data":"f96c9824e7fb564df3108df933aee644e19dbdc59f2b5b60d4cb376596a9d099"} Mar 16 16:36:06 crc kubenswrapper[5120]: I0316 16:36:06.931135 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/4093a7c4-51d9-4119-8e47-c06f29723894-ceilometer-tls-certs\") pod \"4093a7c4-51d9-4119-8e47-c06f29723894\" (UID: \"4093a7c4-51d9-4119-8e47-c06f29723894\") " Mar 16 16:36:06 crc kubenswrapper[5120]: I0316 16:36:06.931270 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/4093a7c4-51d9-4119-8e47-c06f29723894-sg-core-conf-yaml\") pod \"4093a7c4-51d9-4119-8e47-c06f29723894\" (UID: \"4093a7c4-51d9-4119-8e47-c06f29723894\") " Mar 16 16:36:06 crc kubenswrapper[5120]: I0316 16:36:06.931301 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4093a7c4-51d9-4119-8e47-c06f29723894-scripts\") pod \"4093a7c4-51d9-4119-8e47-c06f29723894\" (UID: \"4093a7c4-51d9-4119-8e47-c06f29723894\") " Mar 16 16:36:06 crc kubenswrapper[5120]: I0316 16:36:06.931360 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/4093a7c4-51d9-4119-8e47-c06f29723894-log-httpd\") pod \"4093a7c4-51d9-4119-8e47-c06f29723894\" (UID: \"4093a7c4-51d9-4119-8e47-c06f29723894\") " Mar 16 16:36:06 crc kubenswrapper[5120]: I0316 16:36:06.931396 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/4093a7c4-51d9-4119-8e47-c06f29723894-run-httpd\") pod \"4093a7c4-51d9-4119-8e47-c06f29723894\" (UID: \"4093a7c4-51d9-4119-8e47-c06f29723894\") " Mar 16 16:36:06 crc kubenswrapper[5120]: I0316 16:36:06.931628 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c5dq8\" (UniqueName: \"kubernetes.io/projected/4093a7c4-51d9-4119-8e47-c06f29723894-kube-api-access-c5dq8\") pod \"4093a7c4-51d9-4119-8e47-c06f29723894\" (UID: \"4093a7c4-51d9-4119-8e47-c06f29723894\") " Mar 16 16:36:06 crc kubenswrapper[5120]: I0316 16:36:06.932336 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-d42sq" event={"ID":"7ecbc5c7-9802-4143-bba3-6552d5b8e3ba","Type":"ContainerStarted","Data":"05afde781643fd53002b9bc00aafac856fb24fc4f74ae53ee06b3dee10f01576"} Mar 16 16:36:06 crc kubenswrapper[5120]: I0316 16:36:06.933226 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4093a7c4-51d9-4119-8e47-c06f29723894-config-data\") pod \"4093a7c4-51d9-4119-8e47-c06f29723894\" (UID: \"4093a7c4-51d9-4119-8e47-c06f29723894\") " Mar 16 16:36:06 crc kubenswrapper[5120]: I0316 16:36:06.933265 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4093a7c4-51d9-4119-8e47-c06f29723894-combined-ca-bundle\") pod \"4093a7c4-51d9-4119-8e47-c06f29723894\" (UID: \"4093a7c4-51d9-4119-8e47-c06f29723894\") " Mar 16 16:36:06 crc kubenswrapper[5120]: I0316 16:36:06.934183 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4093a7c4-51d9-4119-8e47-c06f29723894-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "4093a7c4-51d9-4119-8e47-c06f29723894" (UID: "4093a7c4-51d9-4119-8e47-c06f29723894"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:36:06 crc kubenswrapper[5120]: I0316 16:36:06.935089 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4093a7c4-51d9-4119-8e47-c06f29723894-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "4093a7c4-51d9-4119-8e47-c06f29723894" (UID: "4093a7c4-51d9-4119-8e47-c06f29723894"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:36:06 crc kubenswrapper[5120]: I0316 16:36:06.935119 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 16:36:06 crc kubenswrapper[5120]: I0316 16:36:06.944510 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 16:36:06 crc kubenswrapper[5120]: I0316 16:36:06.971474 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4093a7c4-51d9-4119-8e47-c06f29723894-scripts" (OuterVolumeSpecName: "scripts") pod "4093a7c4-51d9-4119-8e47-c06f29723894" (UID: "4093a7c4-51d9-4119-8e47-c06f29723894"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:36:06 crc kubenswrapper[5120]: I0316 16:36:06.984251 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"adeefc4f-7632-4673-ae4f-0104e9e65d1d","Type":"ContainerStarted","Data":"764ff091d98b7b7ac9adc04b584728fb0aaecbdf34b6c11014ebdab665537c1d"} Mar 16 16:36:06 crc kubenswrapper[5120]: I0316 16:36:06.993942 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"4093a7c4-51d9-4119-8e47-c06f29723894","Type":"ContainerDied","Data":"7f14f40d832c0ae5ef9636a53cb87d30eb157abd9081c75337edcbd56e308a26"} Mar 16 16:36:06 crc kubenswrapper[5120]: I0316 16:36:06.994082 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:36:07 crc kubenswrapper[5120]: I0316 16:36:07.000264 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 16:36:07 crc kubenswrapper[5120]: I0316 16:36:07.001342 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4093a7c4-51d9-4119-8e47-c06f29723894" containerName="proxy-httpd" Mar 16 16:36:07 crc kubenswrapper[5120]: I0316 16:36:07.001363 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="4093a7c4-51d9-4119-8e47-c06f29723894" containerName="proxy-httpd" Mar 16 16:36:07 crc kubenswrapper[5120]: I0316 16:36:07.001391 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4093a7c4-51d9-4119-8e47-c06f29723894" containerName="ceilometer-central-agent" Mar 16 16:36:07 crc kubenswrapper[5120]: I0316 16:36:07.001399 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="4093a7c4-51d9-4119-8e47-c06f29723894" containerName="ceilometer-central-agent" Mar 16 16:36:07 crc kubenswrapper[5120]: I0316 16:36:07.001413 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4093a7c4-51d9-4119-8e47-c06f29723894" containerName="ceilometer-notification-agent" Mar 16 16:36:07 crc kubenswrapper[5120]: I0316 16:36:07.001421 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="4093a7c4-51d9-4119-8e47-c06f29723894" containerName="ceilometer-notification-agent" Mar 16 16:36:07 crc kubenswrapper[5120]: I0316 16:36:07.001432 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4093a7c4-51d9-4119-8e47-c06f29723894" containerName="sg-core" Mar 16 16:36:07 crc kubenswrapper[5120]: I0316 16:36:07.001437 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="4093a7c4-51d9-4119-8e47-c06f29723894" containerName="sg-core" Mar 16 16:36:07 crc kubenswrapper[5120]: I0316 16:36:07.001664 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="4093a7c4-51d9-4119-8e47-c06f29723894" containerName="proxy-httpd" Mar 16 16:36:07 crc kubenswrapper[5120]: I0316 16:36:07.001689 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="4093a7c4-51d9-4119-8e47-c06f29723894" containerName="ceilometer-notification-agent" Mar 16 16:36:07 crc kubenswrapper[5120]: I0316 16:36:07.001706 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="4093a7c4-51d9-4119-8e47-c06f29723894" containerName="ceilometer-central-agent" Mar 16 16:36:07 crc kubenswrapper[5120]: I0316 16:36:07.001717 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="4093a7c4-51d9-4119-8e47-c06f29723894" containerName="sg-core" Mar 16 16:36:07 crc kubenswrapper[5120]: I0316 16:36:07.012302 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:36:07 crc kubenswrapper[5120]: I0316 16:36:07.014503 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-db-sync-d42sq" podStartSLOduration=7.014482689 podStartE2EDuration="7.014482689s" podCreationTimestamp="2026-03-16 16:36:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:36:07.004127238 +0000 UTC m=+3869.158058905" watchObservedRunningTime="2026-03-16 16:36:07.014482689 +0000 UTC m=+3869.168414346" Mar 16 16:36:07 crc kubenswrapper[5120]: I0316 16:36:07.016722 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-9nksc" event={"ID":"4346558c-b16e-474a-b782-569ca0bbb7cd","Type":"ContainerStarted","Data":"7308b1a78f058af53d6e97c05ac8904765baa2fa77661f22dd478d857daa3f4c"} Mar 16 16:36:07 crc kubenswrapper[5120]: I0316 16:36:07.016962 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4093a7c4-51d9-4119-8e47-c06f29723894-kube-api-access-c5dq8" (OuterVolumeSpecName: "kube-api-access-c5dq8") pod "4093a7c4-51d9-4119-8e47-c06f29723894" (UID: "4093a7c4-51d9-4119-8e47-c06f29723894"). InnerVolumeSpecName "kube-api-access-c5dq8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:36:07 crc kubenswrapper[5120]: I0316 16:36:07.020311 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-galera-openstack-cell1-svc\"" Mar 16 16:36:07 crc kubenswrapper[5120]: I0316 16:36:07.021620 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-cell1-config-data\"" Mar 16 16:36:07 crc kubenswrapper[5120]: I0316 16:36:07.022706 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"galera-openstack-cell1-dockercfg-kxmw8\"" Mar 16 16:36:07 crc kubenswrapper[5120]: I0316 16:36:07.023113 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-cell1-scripts\"" Mar 16 16:36:07 crc kubenswrapper[5120]: I0316 16:36:07.040748 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4093a7c4-51d9-4119-8e47-c06f29723894-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:07 crc kubenswrapper[5120]: I0316 16:36:07.040879 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/4093a7c4-51d9-4119-8e47-c06f29723894-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:07 crc kubenswrapper[5120]: I0316 16:36:07.040893 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/4093a7c4-51d9-4119-8e47-c06f29723894-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:07 crc kubenswrapper[5120]: I0316 16:36:07.040904 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c5dq8\" (UniqueName: \"kubernetes.io/projected/4093a7c4-51d9-4119-8e47-c06f29723894-kube-api-access-c5dq8\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:07 crc kubenswrapper[5120]: I0316 16:36:07.054851 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-4ckj9" event={"ID":"2e6d012a-b39a-4bfa-ab56-77bc12e2902e","Type":"ContainerStarted","Data":"f8218485b9d60751fc806237716631ddf4ffa06a4cece50120bd2115f4771393"} Mar 16 16:36:07 crc kubenswrapper[5120]: I0316 16:36:07.069021 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 16:36:07 crc kubenswrapper[5120]: I0316 16:36:07.077570 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-nhhml" event={"ID":"1ccbf25a-f71f-4428-ac40-883041c2b302","Type":"ContainerStarted","Data":"7f759d8c9d601826b436781a46c420dc78fb1376d8390bd237c032c4f0d043e8"} Mar 16 16:36:07 crc kubenswrapper[5120]: I0316 16:36:07.107920 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"1fe0dc2f-7c59-4d24-9b66-47c888321f7d","Type":"ContainerStarted","Data":"9948d355415e06f8426d3919add60b0aaaba3e17fc094f9712f57d1a2b033233"} Mar 16 16:36:07 crc kubenswrapper[5120]: I0316 16:36:07.125290 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:36:07 crc kubenswrapper[5120]: I0316 16:36:07.125598 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"f8b2ced8-a236-4ae1-88cd-7f14c5aee21b","Type":"ContainerDied","Data":"3695dfbb0a9b36cbd6a90e303dbb9d50b7f44c7bd02c4fb07c729f2b79def671"} Mar 16 16:36:07 crc kubenswrapper[5120]: I0316 16:36:07.150710 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"openstack-cell1-galera-0\" (UID: \"3a737f89-e391-4a23-b3d5-fa2e2cd8b768\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:36:07 crc kubenswrapper[5120]: I0316 16:36:07.150938 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/3a737f89-e391-4a23-b3d5-fa2e2cd8b768-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"3a737f89-e391-4a23-b3d5-fa2e2cd8b768\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:36:07 crc kubenswrapper[5120]: I0316 16:36:07.151049 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/3a737f89-e391-4a23-b3d5-fa2e2cd8b768-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"3a737f89-e391-4a23-b3d5-fa2e2cd8b768\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:36:07 crc kubenswrapper[5120]: I0316 16:36:07.151154 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3a737f89-e391-4a23-b3d5-fa2e2cd8b768-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"3a737f89-e391-4a23-b3d5-fa2e2cd8b768\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:36:07 crc kubenswrapper[5120]: I0316 16:36:07.151220 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/3a737f89-e391-4a23-b3d5-fa2e2cd8b768-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"3a737f89-e391-4a23-b3d5-fa2e2cd8b768\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:36:07 crc kubenswrapper[5120]: I0316 16:36:07.151417 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3a737f89-e391-4a23-b3d5-fa2e2cd8b768-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"3a737f89-e391-4a23-b3d5-fa2e2cd8b768\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:36:07 crc kubenswrapper[5120]: I0316 16:36:07.151445 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/3a737f89-e391-4a23-b3d5-fa2e2cd8b768-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"3a737f89-e391-4a23-b3d5-fa2e2cd8b768\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:36:07 crc kubenswrapper[5120]: I0316 16:36:07.151467 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6w6t4\" (UniqueName: \"kubernetes.io/projected/3a737f89-e391-4a23-b3d5-fa2e2cd8b768-kube-api-access-6w6t4\") pod \"openstack-cell1-galera-0\" (UID: \"3a737f89-e391-4a23-b3d5-fa2e2cd8b768\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:36:07 crc kubenswrapper[5120]: I0316 16:36:07.166901 5120 scope.go:117] "RemoveContainer" containerID="b454ba7ff6358569221d35993b9f7e68c71c2f5fbecd5354108cf5d5b7d3a428" Mar 16 16:36:07 crc kubenswrapper[5120]: I0316 16:36:07.172170 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:36:07 crc kubenswrapper[5120]: I0316 16:36:07.207505 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 16:36:07 crc kubenswrapper[5120]: I0316 16:36:07.256049 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3a737f89-e391-4a23-b3d5-fa2e2cd8b768-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"3a737f89-e391-4a23-b3d5-fa2e2cd8b768\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:36:07 crc kubenswrapper[5120]: I0316 16:36:07.256105 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/3a737f89-e391-4a23-b3d5-fa2e2cd8b768-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"3a737f89-e391-4a23-b3d5-fa2e2cd8b768\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:36:07 crc kubenswrapper[5120]: I0316 16:36:07.256128 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6w6t4\" (UniqueName: \"kubernetes.io/projected/3a737f89-e391-4a23-b3d5-fa2e2cd8b768-kube-api-access-6w6t4\") pod \"openstack-cell1-galera-0\" (UID: \"3a737f89-e391-4a23-b3d5-fa2e2cd8b768\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:36:07 crc kubenswrapper[5120]: I0316 16:36:07.256159 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"openstack-cell1-galera-0\" (UID: \"3a737f89-e391-4a23-b3d5-fa2e2cd8b768\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:36:07 crc kubenswrapper[5120]: I0316 16:36:07.256192 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/3a737f89-e391-4a23-b3d5-fa2e2cd8b768-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"3a737f89-e391-4a23-b3d5-fa2e2cd8b768\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:36:07 crc kubenswrapper[5120]: I0316 16:36:07.256329 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/3a737f89-e391-4a23-b3d5-fa2e2cd8b768-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"3a737f89-e391-4a23-b3d5-fa2e2cd8b768\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:36:07 crc kubenswrapper[5120]: I0316 16:36:07.256507 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3a737f89-e391-4a23-b3d5-fa2e2cd8b768-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"3a737f89-e391-4a23-b3d5-fa2e2cd8b768\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:36:07 crc kubenswrapper[5120]: I0316 16:36:07.256602 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/3a737f89-e391-4a23-b3d5-fa2e2cd8b768-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"3a737f89-e391-4a23-b3d5-fa2e2cd8b768\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:36:07 crc kubenswrapper[5120]: I0316 16:36:07.257664 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"openstack-cell1-galera-0\" (UID: \"3a737f89-e391-4a23-b3d5-fa2e2cd8b768\") device mount path \"/mnt/openstack/pv05\"" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:36:07 crc kubenswrapper[5120]: I0316 16:36:07.258522 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/3a737f89-e391-4a23-b3d5-fa2e2cd8b768-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"3a737f89-e391-4a23-b3d5-fa2e2cd8b768\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:36:07 crc kubenswrapper[5120]: I0316 16:36:07.259871 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/3a737f89-e391-4a23-b3d5-fa2e2cd8b768-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"3a737f89-e391-4a23-b3d5-fa2e2cd8b768\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:36:07 crc kubenswrapper[5120]: I0316 16:36:07.260366 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/3a737f89-e391-4a23-b3d5-fa2e2cd8b768-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"3a737f89-e391-4a23-b3d5-fa2e2cd8b768\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:36:07 crc kubenswrapper[5120]: I0316 16:36:07.261805 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3a737f89-e391-4a23-b3d5-fa2e2cd8b768-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"3a737f89-e391-4a23-b3d5-fa2e2cd8b768\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:36:07 crc kubenswrapper[5120]: I0316 16:36:07.261868 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 16:36:07 crc kubenswrapper[5120]: I0316 16:36:07.321298 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 16:36:07 crc kubenswrapper[5120]: I0316 16:36:07.341942 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:36:07 crc kubenswrapper[5120]: I0316 16:36:07.349891 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-galera-openstack-svc\"" Mar 16 16:36:07 crc kubenswrapper[5120]: I0316 16:36:07.350257 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"galera-openstack-dockercfg-hswtf\"" Mar 16 16:36:07 crc kubenswrapper[5120]: I0316 16:36:07.350589 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-scripts\"" Mar 16 16:36:07 crc kubenswrapper[5120]: I0316 16:36:07.350735 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-config-data\"" Mar 16 16:36:07 crc kubenswrapper[5120]: I0316 16:36:07.381689 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/3a737f89-e391-4a23-b3d5-fa2e2cd8b768-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"3a737f89-e391-4a23-b3d5-fa2e2cd8b768\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:36:07 crc kubenswrapper[5120]: I0316 16:36:07.398045 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 16:36:07 crc kubenswrapper[5120]: I0316 16:36:07.402810 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6w6t4\" (UniqueName: \"kubernetes.io/projected/3a737f89-e391-4a23-b3d5-fa2e2cd8b768-kube-api-access-6w6t4\") pod \"openstack-cell1-galera-0\" (UID: \"3a737f89-e391-4a23-b3d5-fa2e2cd8b768\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:36:07 crc kubenswrapper[5120]: I0316 16:36:07.406434 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3a737f89-e391-4a23-b3d5-fa2e2cd8b768-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"3a737f89-e391-4a23-b3d5-fa2e2cd8b768\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:36:07 crc kubenswrapper[5120]: I0316 16:36:07.466186 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/rabbitmq-server-0" podUID="27f4616b-6d51-4cd6-bdb1-1596dccca5db" containerName="rabbitmq" containerID="cri-o://07933e1c2eb28569f75dec800bc0d7b02d1a53c0784920c28fb194aa2c3fc15a" gracePeriod=604793 Mar 16 16:36:07 crc kubenswrapper[5120]: I0316 16:36:07.470253 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/49fde0a2-0250-4ab2-92c6-e88c419aa313-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"49fde0a2-0250-4ab2-92c6-e88c419aa313\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:36:07 crc kubenswrapper[5120]: I0316 16:36:07.470816 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bszrj\" (UniqueName: \"kubernetes.io/projected/49fde0a2-0250-4ab2-92c6-e88c419aa313-kube-api-access-bszrj\") pod \"openstack-galera-0\" (UID: \"49fde0a2-0250-4ab2-92c6-e88c419aa313\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:36:07 crc kubenswrapper[5120]: I0316 16:36:07.470891 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/49fde0a2-0250-4ab2-92c6-e88c419aa313-config-data-generated\") pod \"openstack-galera-0\" (UID: \"49fde0a2-0250-4ab2-92c6-e88c419aa313\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:36:07 crc kubenswrapper[5120]: I0316 16:36:07.471321 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"openstack-galera-0\" (UID: \"49fde0a2-0250-4ab2-92c6-e88c419aa313\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:36:07 crc kubenswrapper[5120]: I0316 16:36:07.471490 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/49fde0a2-0250-4ab2-92c6-e88c419aa313-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"49fde0a2-0250-4ab2-92c6-e88c419aa313\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:36:07 crc kubenswrapper[5120]: I0316 16:36:07.471674 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/49fde0a2-0250-4ab2-92c6-e88c419aa313-operator-scripts\") pod \"openstack-galera-0\" (UID: \"49fde0a2-0250-4ab2-92c6-e88c419aa313\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:36:07 crc kubenswrapper[5120]: I0316 16:36:07.471737 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/49fde0a2-0250-4ab2-92c6-e88c419aa313-config-data-default\") pod \"openstack-galera-0\" (UID: \"49fde0a2-0250-4ab2-92c6-e88c419aa313\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:36:07 crc kubenswrapper[5120]: I0316 16:36:07.471989 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/49fde0a2-0250-4ab2-92c6-e88c419aa313-kolla-config\") pod \"openstack-galera-0\" (UID: \"49fde0a2-0250-4ab2-92c6-e88c419aa313\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:36:07 crc kubenswrapper[5120]: I0316 16:36:07.475009 5120 scope.go:117] "RemoveContainer" containerID="b745117a770fe11c46e5d61e279fc7ab89054b2bf87b4f50cde54ce2c47689c6" Mar 16 16:36:07 crc kubenswrapper[5120]: I0316 16:36:07.550419 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" podUID="1cd39de5-ca7d-4ed7-8052-17c5613718fc" containerName="rabbitmq" containerID="cri-o://187eb647447164e295bccc1b07863b41812af3639cc3d67076881a085711ead6" gracePeriod=604793 Mar 16 16:36:07 crc kubenswrapper[5120]: I0316 16:36:07.574794 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bszrj\" (UniqueName: \"kubernetes.io/projected/49fde0a2-0250-4ab2-92c6-e88c419aa313-kube-api-access-bszrj\") pod \"openstack-galera-0\" (UID: \"49fde0a2-0250-4ab2-92c6-e88c419aa313\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:36:07 crc kubenswrapper[5120]: I0316 16:36:07.574881 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/49fde0a2-0250-4ab2-92c6-e88c419aa313-config-data-generated\") pod \"openstack-galera-0\" (UID: \"49fde0a2-0250-4ab2-92c6-e88c419aa313\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:36:07 crc kubenswrapper[5120]: I0316 16:36:07.575038 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"openstack-galera-0\" (UID: \"49fde0a2-0250-4ab2-92c6-e88c419aa313\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:36:07 crc kubenswrapper[5120]: I0316 16:36:07.575097 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/49fde0a2-0250-4ab2-92c6-e88c419aa313-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"49fde0a2-0250-4ab2-92c6-e88c419aa313\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:36:07 crc kubenswrapper[5120]: I0316 16:36:07.575190 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/49fde0a2-0250-4ab2-92c6-e88c419aa313-operator-scripts\") pod \"openstack-galera-0\" (UID: \"49fde0a2-0250-4ab2-92c6-e88c419aa313\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:36:07 crc kubenswrapper[5120]: I0316 16:36:07.575236 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/49fde0a2-0250-4ab2-92c6-e88c419aa313-config-data-default\") pod \"openstack-galera-0\" (UID: \"49fde0a2-0250-4ab2-92c6-e88c419aa313\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:36:07 crc kubenswrapper[5120]: I0316 16:36:07.575279 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/49fde0a2-0250-4ab2-92c6-e88c419aa313-kolla-config\") pod \"openstack-galera-0\" (UID: \"49fde0a2-0250-4ab2-92c6-e88c419aa313\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:36:07 crc kubenswrapper[5120]: I0316 16:36:07.575414 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/49fde0a2-0250-4ab2-92c6-e88c419aa313-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"49fde0a2-0250-4ab2-92c6-e88c419aa313\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:36:07 crc kubenswrapper[5120]: I0316 16:36:07.575497 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/49fde0a2-0250-4ab2-92c6-e88c419aa313-config-data-generated\") pod \"openstack-galera-0\" (UID: \"49fde0a2-0250-4ab2-92c6-e88c419aa313\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:36:07 crc kubenswrapper[5120]: I0316 16:36:07.576323 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"openstack-galera-0\" (UID: \"49fde0a2-0250-4ab2-92c6-e88c419aa313\") device mount path \"/mnt/openstack/pv10\"" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:36:07 crc kubenswrapper[5120]: I0316 16:36:07.576485 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/49fde0a2-0250-4ab2-92c6-e88c419aa313-kolla-config\") pod \"openstack-galera-0\" (UID: \"49fde0a2-0250-4ab2-92c6-e88c419aa313\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:36:07 crc kubenswrapper[5120]: I0316 16:36:07.577960 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/49fde0a2-0250-4ab2-92c6-e88c419aa313-operator-scripts\") pod \"openstack-galera-0\" (UID: \"49fde0a2-0250-4ab2-92c6-e88c419aa313\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:36:07 crc kubenswrapper[5120]: I0316 16:36:07.578260 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/49fde0a2-0250-4ab2-92c6-e88c419aa313-config-data-default\") pod \"openstack-galera-0\" (UID: \"49fde0a2-0250-4ab2-92c6-e88c419aa313\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:36:07 crc kubenswrapper[5120]: I0316 16:36:07.584532 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/49fde0a2-0250-4ab2-92c6-e88c419aa313-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"49fde0a2-0250-4ab2-92c6-e88c419aa313\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:36:07 crc kubenswrapper[5120]: I0316 16:36:07.586022 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/49fde0a2-0250-4ab2-92c6-e88c419aa313-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"49fde0a2-0250-4ab2-92c6-e88c419aa313\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:36:07 crc kubenswrapper[5120]: I0316 16:36:07.613676 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bszrj\" (UniqueName: \"kubernetes.io/projected/49fde0a2-0250-4ab2-92c6-e88c419aa313-kube-api-access-bszrj\") pod \"openstack-galera-0\" (UID: \"49fde0a2-0250-4ab2-92c6-e88c419aa313\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:36:07 crc kubenswrapper[5120]: I0316 16:36:07.750164 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"openstack-cell1-galera-0\" (UID: \"3a737f89-e391-4a23-b3d5-fa2e2cd8b768\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:36:07 crc kubenswrapper[5120]: I0316 16:36:07.908479 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 16:36:07 crc kubenswrapper[5120]: W0316 16:36:07.956134 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2c50d5a6_1160_4c1d_a0ee_6dff4d5e6b87.slice/crio-f8e4b511b04673e09ae05973bfb5a1826b20d78b667290d933c5c35a7a3386fc WatchSource:0}: Error finding container f8e4b511b04673e09ae05973bfb5a1826b20d78b667290d933c5c35a7a3386fc: Status 404 returned error can't find the container with id f8e4b511b04673e09ae05973bfb5a1826b20d78b667290d933c5c35a7a3386fc Mar 16 16:36:07 crc kubenswrapper[5120]: I0316 16:36:07.957936 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:36:08 crc kubenswrapper[5120]: I0316 16:36:08.027894 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"openstack-galera-0\" (UID: \"49fde0a2-0250-4ab2-92c6-e88c419aa313\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:36:08 crc kubenswrapper[5120]: I0316 16:36:08.149361 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4093a7c4-51d9-4119-8e47-c06f29723894-ceilometer-tls-certs" (OuterVolumeSpecName: "ceilometer-tls-certs") pod "4093a7c4-51d9-4119-8e47-c06f29723894" (UID: "4093a7c4-51d9-4119-8e47-c06f29723894"). InnerVolumeSpecName "ceilometer-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:36:08 crc kubenswrapper[5120]: I0316 16:36:08.183982 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4093a7c4-51d9-4119-8e47-c06f29723894-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "4093a7c4-51d9-4119-8e47-c06f29723894" (UID: "4093a7c4-51d9-4119-8e47-c06f29723894"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:36:08 crc kubenswrapper[5120]: I0316 16:36:08.197061 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4093a7c4-51d9-4119-8e47-c06f29723894-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "4093a7c4-51d9-4119-8e47-c06f29723894" (UID: "4093a7c4-51d9-4119-8e47-c06f29723894"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:36:08 crc kubenswrapper[5120]: I0316 16:36:08.202538 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4093a7c4-51d9-4119-8e47-c06f29723894-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:08 crc kubenswrapper[5120]: I0316 16:36:08.202578 5120 reconciler_common.go:299] "Volume detached for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/4093a7c4-51d9-4119-8e47-c06f29723894-ceilometer-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:08 crc kubenswrapper[5120]: I0316 16:36:08.202590 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/4093a7c4-51d9-4119-8e47-c06f29723894-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:08 crc kubenswrapper[5120]: I0316 16:36:08.213584 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-9nksc" event={"ID":"4346558c-b16e-474a-b782-569ca0bbb7cd","Type":"ContainerStarted","Data":"5af2f8d5f4776cb0a460db5c1757b19b33071548ffa7ba0bd64ab52782aba9d5"} Mar 16 16:36:08 crc kubenswrapper[5120]: I0316 16:36:08.233208 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-4ckj9" event={"ID":"2e6d012a-b39a-4bfa-ab56-77bc12e2902e","Type":"ContainerStarted","Data":"ac5a80648ecd4f9c2670c944aefcdce68c3e2f73aa9abcc6d8834733b6b1b99e"} Mar 16 16:36:08 crc kubenswrapper[5120]: I0316 16:36:08.236341 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-nhhml" event={"ID":"1ccbf25a-f71f-4428-ac40-883041c2b302","Type":"ContainerStarted","Data":"ac561281d49b95085f75deca1a2fae047fa2827f32f42ca0477b0454b5fc81ad"} Mar 16 16:36:08 crc kubenswrapper[5120]: I0316 16:36:08.246151 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561316-m6nsl" event={"ID":"cab9c74d-69a9-44ee-965f-bd31954a1976","Type":"ContainerStarted","Data":"ed955fa3ce6cceff64977964b5f2652d3ce0b800a55c3c28002b4af4567e87e1"} Mar 16 16:36:08 crc kubenswrapper[5120]: I0316 16:36:08.257185 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-9nksc" podStartSLOduration=6.257143112 podStartE2EDuration="6.257143112s" podCreationTimestamp="2026-03-16 16:36:02 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:36:08.250588641 +0000 UTC m=+3870.404520298" watchObservedRunningTime="2026-03-16 16:36:08.257143112 +0000 UTC m=+3870.411074769" Mar 16 16:36:08 crc kubenswrapper[5120]: I0316 16:36:08.270975 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"2c50d5a6-1160-4c1d-a0ee-6dff4d5e6b87","Type":"ContainerStarted","Data":"f8e4b511b04673e09ae05973bfb5a1826b20d78b667290d933c5c35a7a3386fc"} Mar 16 16:36:08 crc kubenswrapper[5120]: I0316 16:36:08.280646 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"2cc5c2d3-3da0-4d0c-9541-78f0bf375648","Type":"ContainerStarted","Data":"22a1b2bd8f23376d419b393135ec1f2f0655a30fa4c5781c022e10637b50ff05"} Mar 16 16:36:08 crc kubenswrapper[5120]: I0316 16:36:08.291287 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:36:08 crc kubenswrapper[5120]: I0316 16:36:08.292487 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"1fe0dc2f-7c59-4d24-9b66-47c888321f7d","Type":"ContainerStarted","Data":"2441426552b9c7ba899987c6de98919a6b1047e8cd66f27cd918a9ef6539609f"} Mar 16 16:36:08 crc kubenswrapper[5120]: I0316 16:36:08.347413 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-426ss" event={"ID":"c951a6f5-568c-4da3-b6b3-e0310ca934bc","Type":"ContainerStarted","Data":"ee1809e3d0fec16a77b3f05dc2b85697eba66eb29834160eec5cdd65cb2f6926"} Mar 16 16:36:08 crc kubenswrapper[5120]: I0316 16:36:08.389617 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/swift-ring-rebalance-nhhml" podStartSLOduration=7.389157327 podStartE2EDuration="7.389157327s" podCreationTimestamp="2026-03-16 16:36:01 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:36:08.288218926 +0000 UTC m=+3870.442150603" watchObservedRunningTime="2026-03-16 16:36:08.389157327 +0000 UTC m=+3870.543089014" Mar 16 16:36:08 crc kubenswrapper[5120]: I0316 16:36:08.395877 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-4ckj9" podStartSLOduration=6.395850882 podStartE2EDuration="6.395850882s" podCreationTimestamp="2026-03-16 16:36:02 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:36:08.315023527 +0000 UTC m=+3870.468955184" watchObservedRunningTime="2026-03-16 16:36:08.395850882 +0000 UTC m=+3870.549782539" Mar 16 16:36:08 crc kubenswrapper[5120]: I0316 16:36:08.410116 5120 scope.go:117] "RemoveContainer" containerID="5fc6451d2a211fee6ddf7a8ff791952c877013378fed995f98d0db78c21a3e5f" Mar 16 16:36:08 crc kubenswrapper[5120]: I0316 16:36:08.473775 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4093a7c4-51d9-4119-8e47-c06f29723894-config-data" (OuterVolumeSpecName: "config-data") pod "4093a7c4-51d9-4119-8e47-c06f29723894" (UID: "4093a7c4-51d9-4119-8e47-c06f29723894"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:36:08 crc kubenswrapper[5120]: I0316 16:36:08.490106 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-infra/auto-csr-approver-29561316-m6nsl" podStartSLOduration=5.287492133 podStartE2EDuration="8.490078097s" podCreationTimestamp="2026-03-16 16:36:00 +0000 UTC" firstStartedPulling="2026-03-16 16:36:02.148446622 +0000 UTC m=+3864.302378289" lastFinishedPulling="2026-03-16 16:36:05.351032596 +0000 UTC m=+3867.504964253" observedRunningTime="2026-03-16 16:36:08.337074754 +0000 UTC m=+3870.491006411" watchObservedRunningTime="2026-03-16 16:36:08.490078097 +0000 UTC m=+3870.644009754" Mar 16 16:36:08 crc kubenswrapper[5120]: I0316 16:36:08.498819 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-db-sync-426ss" podStartSLOduration=7.498793855 podStartE2EDuration="7.498793855s" podCreationTimestamp="2026-03-16 16:36:01 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:36:08.369084671 +0000 UTC m=+3870.523016328" watchObservedRunningTime="2026-03-16 16:36:08.498793855 +0000 UTC m=+3870.652725512" Mar 16 16:36:08 crc kubenswrapper[5120]: I0316 16:36:08.526171 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4093a7c4-51d9-4119-8e47-c06f29723894-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:08 crc kubenswrapper[5120]: I0316 16:36:08.595361 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="63d9a98c-175f-4caa-bd33-41eb82d6e06b" containerName="cinder-scheduler" probeResult="failure" output="HTTP probe failed with statuscode: 500" Mar 16 16:36:08 crc kubenswrapper[5120]: I0316 16:36:08.595444 5120 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:36:08 crc kubenswrapper[5120]: I0316 16:36:08.596338 5120 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="cinder-scheduler" containerStatusID={"Type":"cri-o","ID":"3251b55607768a1c1602f007772fd47d988206a579b6573f7b1196b6855a2d19"} pod="openstack-kuttl-tests/cinder-scheduler-0" containerMessage="Container cinder-scheduler failed liveness probe, will be restarted" Mar 16 16:36:08 crc kubenswrapper[5120]: I0316 16:36:08.596404 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="63d9a98c-175f-4caa-bd33-41eb82d6e06b" containerName="cinder-scheduler" containerID="cri-o://3251b55607768a1c1602f007772fd47d988206a579b6573f7b1196b6855a2d19" gracePeriod=30 Mar 16 16:36:08 crc kubenswrapper[5120]: I0316 16:36:08.643009 5120 scope.go:117] "RemoveContainer" containerID="90578380dd3689e88764f9ad9d1a470340f3570e79e4db8d8c234d43e57fa7e3" Mar 16 16:36:08 crc kubenswrapper[5120]: I0316 16:36:08.657963 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 16:36:08 crc kubenswrapper[5120]: I0316 16:36:08.775839 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d24d09c6-d2a8-418d-8ddf-a5e64672f554" path="/var/lib/kubelet/pods/d24d09c6-d2a8-418d-8ddf-a5e64672f554/volumes" Mar 16 16:36:08 crc kubenswrapper[5120]: I0316 16:36:08.776905 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f8b2ced8-a236-4ae1-88cd-7f14c5aee21b" path="/var/lib/kubelet/pods/f8b2ced8-a236-4ae1-88cd-7f14c5aee21b/volumes" Mar 16 16:36:08 crc kubenswrapper[5120]: I0316 16:36:08.777535 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:36:08 crc kubenswrapper[5120]: I0316 16:36:08.777560 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:36:08 crc kubenswrapper[5120]: I0316 16:36:08.842534 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:36:08 crc kubenswrapper[5120]: I0316 16:36:08.906837 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podUID="364bfdcf-9673-41c8-b692-941d68257973" containerName="nova-cell1-novncproxy-novncproxy" probeResult="failure" output="Get \"https://10.217.0.189:6080/vnc_lite.html\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 16:36:08 crc kubenswrapper[5120]: I0316 16:36:08.930380 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:36:08 crc kubenswrapper[5120]: I0316 16:36:08.931227 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:36:08 crc kubenswrapper[5120]: I0316 16:36:08.937394 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 16:36:08 crc kubenswrapper[5120]: I0316 16:36:08.937872 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ceilometer-internal-svc\"" Mar 16 16:36:08 crc kubenswrapper[5120]: I0316 16:36:08.938078 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 16:36:08 crc kubenswrapper[5120]: I0316 16:36:08.958779 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wx5dl\" (UniqueName: \"kubernetes.io/projected/579eb838-c3c3-42d5-bac1-df49697195f1-kube-api-access-wx5dl\") pod \"ceilometer-0\" (UID: \"579eb838-c3c3-42d5-bac1-df49697195f1\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:36:08 crc kubenswrapper[5120]: I0316 16:36:08.962048 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/579eb838-c3c3-42d5-bac1-df49697195f1-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"579eb838-c3c3-42d5-bac1-df49697195f1\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:36:08 crc kubenswrapper[5120]: I0316 16:36:08.963076 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/579eb838-c3c3-42d5-bac1-df49697195f1-log-httpd\") pod \"ceilometer-0\" (UID: \"579eb838-c3c3-42d5-bac1-df49697195f1\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:36:08 crc kubenswrapper[5120]: I0316 16:36:08.963199 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/579eb838-c3c3-42d5-bac1-df49697195f1-run-httpd\") pod \"ceilometer-0\" (UID: \"579eb838-c3c3-42d5-bac1-df49697195f1\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:36:08 crc kubenswrapper[5120]: I0316 16:36:08.963428 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/579eb838-c3c3-42d5-bac1-df49697195f1-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"579eb838-c3c3-42d5-bac1-df49697195f1\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:36:08 crc kubenswrapper[5120]: I0316 16:36:08.968927 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/579eb838-c3c3-42d5-bac1-df49697195f1-config-data\") pod \"ceilometer-0\" (UID: \"579eb838-c3c3-42d5-bac1-df49697195f1\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:36:08 crc kubenswrapper[5120]: I0316 16:36:08.969233 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/579eb838-c3c3-42d5-bac1-df49697195f1-scripts\") pod \"ceilometer-0\" (UID: \"579eb838-c3c3-42d5-bac1-df49697195f1\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:36:08 crc kubenswrapper[5120]: I0316 16:36:08.969331 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/579eb838-c3c3-42d5-bac1-df49697195f1-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"579eb838-c3c3-42d5-bac1-df49697195f1\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:36:09 crc kubenswrapper[5120]: I0316 16:36:09.043953 5120 scope.go:117] "RemoveContainer" containerID="60385fabe480fed7555f36dc6f1b4459b21a84b49a3a1f92af6eb03c6e2df9c9" Mar 16 16:36:09 crc kubenswrapper[5120]: I0316 16:36:09.072485 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/579eb838-c3c3-42d5-bac1-df49697195f1-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"579eb838-c3c3-42d5-bac1-df49697195f1\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:36:09 crc kubenswrapper[5120]: I0316 16:36:09.072581 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/579eb838-c3c3-42d5-bac1-df49697195f1-config-data\") pod \"ceilometer-0\" (UID: \"579eb838-c3c3-42d5-bac1-df49697195f1\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:36:09 crc kubenswrapper[5120]: I0316 16:36:09.072704 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/579eb838-c3c3-42d5-bac1-df49697195f1-scripts\") pod \"ceilometer-0\" (UID: \"579eb838-c3c3-42d5-bac1-df49697195f1\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:36:09 crc kubenswrapper[5120]: I0316 16:36:09.072728 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/579eb838-c3c3-42d5-bac1-df49697195f1-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"579eb838-c3c3-42d5-bac1-df49697195f1\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:36:09 crc kubenswrapper[5120]: I0316 16:36:09.072855 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wx5dl\" (UniqueName: \"kubernetes.io/projected/579eb838-c3c3-42d5-bac1-df49697195f1-kube-api-access-wx5dl\") pod \"ceilometer-0\" (UID: \"579eb838-c3c3-42d5-bac1-df49697195f1\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:36:09 crc kubenswrapper[5120]: I0316 16:36:09.072924 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/579eb838-c3c3-42d5-bac1-df49697195f1-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"579eb838-c3c3-42d5-bac1-df49697195f1\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:36:09 crc kubenswrapper[5120]: I0316 16:36:09.073178 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/579eb838-c3c3-42d5-bac1-df49697195f1-log-httpd\") pod \"ceilometer-0\" (UID: \"579eb838-c3c3-42d5-bac1-df49697195f1\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:36:09 crc kubenswrapper[5120]: I0316 16:36:09.073207 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/579eb838-c3c3-42d5-bac1-df49697195f1-run-httpd\") pod \"ceilometer-0\" (UID: \"579eb838-c3c3-42d5-bac1-df49697195f1\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:36:09 crc kubenswrapper[5120]: I0316 16:36:09.073695 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/579eb838-c3c3-42d5-bac1-df49697195f1-run-httpd\") pod \"ceilometer-0\" (UID: \"579eb838-c3c3-42d5-bac1-df49697195f1\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:36:09 crc kubenswrapper[5120]: I0316 16:36:09.077536 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/579eb838-c3c3-42d5-bac1-df49697195f1-log-httpd\") pod \"ceilometer-0\" (UID: \"579eb838-c3c3-42d5-bac1-df49697195f1\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:36:09 crc kubenswrapper[5120]: I0316 16:36:09.084620 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 16:36:09 crc kubenswrapper[5120]: I0316 16:36:09.087626 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/579eb838-c3c3-42d5-bac1-df49697195f1-scripts\") pod \"ceilometer-0\" (UID: \"579eb838-c3c3-42d5-bac1-df49697195f1\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:36:09 crc kubenswrapper[5120]: I0316 16:36:09.087629 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/579eb838-c3c3-42d5-bac1-df49697195f1-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"579eb838-c3c3-42d5-bac1-df49697195f1\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:36:09 crc kubenswrapper[5120]: I0316 16:36:09.087736 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/579eb838-c3c3-42d5-bac1-df49697195f1-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"579eb838-c3c3-42d5-bac1-df49697195f1\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:36:09 crc kubenswrapper[5120]: I0316 16:36:09.088993 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/579eb838-c3c3-42d5-bac1-df49697195f1-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"579eb838-c3c3-42d5-bac1-df49697195f1\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:36:09 crc kubenswrapper[5120]: I0316 16:36:09.118310 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/579eb838-c3c3-42d5-bac1-df49697195f1-config-data\") pod \"ceilometer-0\" (UID: \"579eb838-c3c3-42d5-bac1-df49697195f1\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:36:09 crc kubenswrapper[5120]: I0316 16:36:09.127461 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wx5dl\" (UniqueName: \"kubernetes.io/projected/579eb838-c3c3-42d5-bac1-df49697195f1-kube-api-access-wx5dl\") pod \"ceilometer-0\" (UID: \"579eb838-c3c3-42d5-bac1-df49697195f1\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:36:09 crc kubenswrapper[5120]: W0316 16:36:09.140139 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod49fde0a2_0250_4ab2_92c6_e88c419aa313.slice/crio-a4aeeb58592b7d7412d3f0a3387880a49b592d7141aa6011cf1b9eb71709944a WatchSource:0}: Error finding container a4aeeb58592b7d7412d3f0a3387880a49b592d7141aa6011cf1b9eb71709944a: Status 404 returned error can't find the container with id a4aeeb58592b7d7412d3f0a3387880a49b592d7141aa6011cf1b9eb71709944a Mar 16 16:36:09 crc kubenswrapper[5120]: I0316 16:36:09.234944 5120 scope.go:117] "RemoveContainer" containerID="a6da655c3ab3c081a862ed09a600b2b898335b09cbe7c305e5bbc8934c874f4b" Mar 16 16:36:09 crc kubenswrapper[5120]: I0316 16:36:09.280435 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:36:09 crc kubenswrapper[5120]: I0316 16:36:09.369061 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"49fde0a2-0250-4ab2-92c6-e88c419aa313","Type":"ContainerStarted","Data":"a4aeeb58592b7d7412d3f0a3387880a49b592d7141aa6011cf1b9eb71709944a"} Mar 16 16:36:09 crc kubenswrapper[5120]: I0316 16:36:09.374648 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"adeefc4f-7632-4673-ae4f-0104e9e65d1d","Type":"ContainerStarted","Data":"da5b7b3662dbec12f059c3403e92b3f66241a0648ce9cb26b0e022725a195476"} Mar 16 16:36:09 crc kubenswrapper[5120]: I0316 16:36:09.390242 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-b5trh" event={"ID":"91d6af93-90b1-4d80-86df-11a701664a68","Type":"ContainerStarted","Data":"51a9e72749469a4f7a85f36e4d05b97332822e031201c75e32f8aeca6440579f"} Mar 16 16:36:09 crc kubenswrapper[5120]: I0316 16:36:09.412291 5120 generic.go:358] "Generic (PLEG): container finished" podID="cab9c74d-69a9-44ee-965f-bd31954a1976" containerID="ed955fa3ce6cceff64977964b5f2652d3ce0b800a55c3c28002b4af4567e87e1" exitCode=0 Mar 16 16:36:09 crc kubenswrapper[5120]: I0316 16:36:09.412525 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561316-m6nsl" event={"ID":"cab9c74d-69a9-44ee-965f-bd31954a1976","Type":"ContainerDied","Data":"ed955fa3ce6cceff64977964b5f2652d3ce0b800a55c3c28002b4af4567e87e1"} Mar 16 16:36:09 crc kubenswrapper[5120]: I0316 16:36:09.412321 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-db-sync-b5trh" podStartSLOduration=9.412306917 podStartE2EDuration="9.412306917s" podCreationTimestamp="2026-03-16 16:36:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:36:09.410054458 +0000 UTC m=+3871.563986115" watchObservedRunningTime="2026-03-16 16:36:09.412306917 +0000 UTC m=+3871.566238584" Mar 16 16:36:09 crc kubenswrapper[5120]: I0316 16:36:09.457941 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:36:09 crc kubenswrapper[5120]: I0316 16:36:09.482154 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"2cc5c2d3-3da0-4d0c-9541-78f0bf375648","Type":"ContainerStarted","Data":"6d1704088789e653abcbf79fddac9aafb1b85dd5351eeff9d35a0a4e7c2f3a76"} Mar 16 16:36:09 crc kubenswrapper[5120]: I0316 16:36:09.483537 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/memcached-0" Mar 16 16:36:09 crc kubenswrapper[5120]: I0316 16:36:09.485405 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/kube-state-metrics-0" podStartSLOduration=2.785976029 podStartE2EDuration="3.485382289s" podCreationTimestamp="2026-03-16 16:36:06 +0000 UTC" firstStartedPulling="2026-03-16 16:36:07.958655412 +0000 UTC m=+3870.112587069" lastFinishedPulling="2026-03-16 16:36:08.658061672 +0000 UTC m=+3870.811993329" observedRunningTime="2026-03-16 16:36:09.475018787 +0000 UTC m=+3871.628950444" watchObservedRunningTime="2026-03-16 16:36:09.485382289 +0000 UTC m=+3871.639313946" Mar 16 16:36:09 crc kubenswrapper[5120]: I0316 16:36:09.508722 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/memcached-0" podStartSLOduration=4.508696788 podStartE2EDuration="4.508696788s" podCreationTimestamp="2026-03-16 16:36:05 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:36:09.50571012 +0000 UTC m=+3871.659641787" watchObservedRunningTime="2026-03-16 16:36:09.508696788 +0000 UTC m=+3871.662628445" Mar 16 16:36:09 crc kubenswrapper[5120]: I0316 16:36:09.512876 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"1fe0dc2f-7c59-4d24-9b66-47c888321f7d","Type":"ContainerStarted","Data":"42526f0f9c3f55eac6d24c984410946cd8fd6b2fa6f059df3465b160546db980"} Mar 16 16:36:09 crc kubenswrapper[5120]: I0316 16:36:09.517895 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"3a737f89-e391-4a23-b3d5-fa2e2cd8b768","Type":"ContainerStarted","Data":"78d9289c7102c80ea0265c052b718b078407d1a28800b146af53cab179c73c96"} Mar 16 16:36:09 crc kubenswrapper[5120]: I0316 16:36:09.524311 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"58b4ac02-d549-4064-89d2-db3e507c0efc","Type":"ContainerStarted","Data":"859edba2ba4875e9d0c09dd3f81a753ca7b238627f93916a8b819cad16f263ae"} Mar 16 16:36:09 crc kubenswrapper[5120]: I0316 16:36:09.524364 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"58b4ac02-d549-4064-89d2-db3e507c0efc","Type":"ContainerStarted","Data":"03385e9ae67fcf4097376f7428334bec3cd413165e04d4d4cd67056a46fb256f"} Mar 16 16:36:09 crc kubenswrapper[5120]: I0316 16:36:09.547681 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podStartSLOduration=6.547659428 podStartE2EDuration="6.547659428s" podCreationTimestamp="2026-03-16 16:36:03 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:36:09.540350917 +0000 UTC m=+3871.694282594" watchObservedRunningTime="2026-03-16 16:36:09.547659428 +0000 UTC m=+3871.701591085" Mar 16 16:36:09 crc kubenswrapper[5120]: I0316 16:36:09.559052 5120 scope.go:117] "RemoveContainer" containerID="a6c1668f56c4fe692eb1aabbecd9b81c11f99230ce0ca29f30ff0c69de96b354" Mar 16 16:36:09 crc kubenswrapper[5120]: I0316 16:36:09.577922 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podStartSLOduration=6.577903139 podStartE2EDuration="6.577903139s" podCreationTimestamp="2026-03-16 16:36:03 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:36:09.564450237 +0000 UTC m=+3871.718381894" watchObservedRunningTime="2026-03-16 16:36:09.577903139 +0000 UTC m=+3871.731834796" Mar 16 16:36:09 crc kubenswrapper[5120]: I0316 16:36:09.931292 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:36:10 crc kubenswrapper[5120]: I0316 16:36:10.096974 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:36:10 crc kubenswrapper[5120]: I0316 16:36:10.231612 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:36:10 crc kubenswrapper[5120]: I0316 16:36:10.536207 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"49fde0a2-0250-4ab2-92c6-e88c419aa313","Type":"ContainerStarted","Data":"e2c2ea5d5676a4a91547a32d6859178f558c834eafca188cc3dfcb7c21ce8283"} Mar 16 16:36:10 crc kubenswrapper[5120]: I0316 16:36:10.541657 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"adeefc4f-7632-4673-ae4f-0104e9e65d1d","Type":"ContainerStarted","Data":"e721f5e109c58db9c89bf8981961ec04fbce03cce2818b300c8d7256493e363b"} Mar 16 16:36:10 crc kubenswrapper[5120]: I0316 16:36:10.542745 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:36:10 crc kubenswrapper[5120]: I0316 16:36:10.551964 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"2c50d5a6-1160-4c1d-a0ee-6dff4d5e6b87","Type":"ContainerStarted","Data":"41961b7f6a4344f5d5acb2c636cf873512a3d165e3ee4ef16e249ba7fed1aec1"} Mar 16 16:36:10 crc kubenswrapper[5120]: I0316 16:36:10.563315 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"3a737f89-e391-4a23-b3d5-fa2e2cd8b768","Type":"ContainerStarted","Data":"a5eb8dbb0ca15b32b6b02e507ce778d950835eb65ff811dc3ddac108e7cf01e9"} Mar 16 16:36:10 crc kubenswrapper[5120]: I0316 16:36:10.575289 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"579eb838-c3c3-42d5-bac1-df49697195f1","Type":"ContainerStarted","Data":"b1d609d20318e14d39ff611b57543d28abd8088bf8d5c847661bec2583ebaf33"} Mar 16 16:36:10 crc kubenswrapper[5120]: I0316 16:36:10.602705 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovn-northd-0" podStartSLOduration=8.602684812 podStartE2EDuration="8.602684812s" podCreationTimestamp="2026-03-16 16:36:02 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:36:10.596811359 +0000 UTC m=+3872.750743026" watchObservedRunningTime="2026-03-16 16:36:10.602684812 +0000 UTC m=+3872.756616479" Mar 16 16:36:10 crc kubenswrapper[5120]: I0316 16:36:10.665519 5120 scope.go:117] "RemoveContainer" containerID="0a15d5caff30dc8885f782e59962af7d98d58b39ab76059e56e5827e10e7ab8b" Mar 16 16:36:10 crc kubenswrapper[5120]: E0316 16:36:10.666262 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:36:10 crc kubenswrapper[5120]: I0316 16:36:10.715500 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4093a7c4-51d9-4119-8e47-c06f29723894" path="/var/lib/kubelet/pods/4093a7c4-51d9-4119-8e47-c06f29723894/volumes" Mar 16 16:36:10 crc kubenswrapper[5120]: E0316 16:36:10.735099 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1984569 actualBytes=10240 Mar 16 16:36:10 crc kubenswrapper[5120]: I0316 16:36:10.933712 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:36:10 crc kubenswrapper[5120]: I0316 16:36:10.949094 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561316-m6nsl" Mar 16 16:36:10 crc kubenswrapper[5120]: I0316 16:36:10.976712 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-22qjv\" (UniqueName: \"kubernetes.io/projected/cab9c74d-69a9-44ee-965f-bd31954a1976-kube-api-access-22qjv\") pod \"cab9c74d-69a9-44ee-965f-bd31954a1976\" (UID: \"cab9c74d-69a9-44ee-965f-bd31954a1976\") " Mar 16 16:36:10 crc kubenswrapper[5120]: I0316 16:36:10.991891 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cab9c74d-69a9-44ee-965f-bd31954a1976-kube-api-access-22qjv" (OuterVolumeSpecName: "kube-api-access-22qjv") pod "cab9c74d-69a9-44ee-965f-bd31954a1976" (UID: "cab9c74d-69a9-44ee-965f-bd31954a1976"). InnerVolumeSpecName "kube-api-access-22qjv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:36:11 crc kubenswrapper[5120]: I0316 16:36:11.081126 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-22qjv\" (UniqueName: \"kubernetes.io/projected/cab9c74d-69a9-44ee-965f-bd31954a1976-kube-api-access-22qjv\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:11 crc kubenswrapper[5120]: I0316 16:36:11.395353 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-infra/auto-csr-approver-29561310-bqwsf"] Mar 16 16:36:11 crc kubenswrapper[5120]: I0316 16:36:11.404748 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-infra/auto-csr-approver-29561310-bqwsf"] Mar 16 16:36:11 crc kubenswrapper[5120]: I0316 16:36:11.587399 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561316-m6nsl" event={"ID":"cab9c74d-69a9-44ee-965f-bd31954a1976","Type":"ContainerDied","Data":"e3bbde011fe98da6e54940bf5c8333c6dea9b75b39b4839d7779aeccd30f868d"} Mar 16 16:36:11 crc kubenswrapper[5120]: I0316 16:36:11.587422 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561316-m6nsl" Mar 16 16:36:11 crc kubenswrapper[5120]: I0316 16:36:11.587441 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e3bbde011fe98da6e54940bf5c8333c6dea9b75b39b4839d7779aeccd30f868d" Mar 16 16:36:11 crc kubenswrapper[5120]: I0316 16:36:11.591128 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"579eb838-c3c3-42d5-bac1-df49697195f1","Type":"ContainerStarted","Data":"6b88570797a3db9d2d05b1a61c7b26d1fdf425c43a21a2217d8bc252c8923598"} Mar 16 16:36:12 crc kubenswrapper[5120]: I0316 16:36:12.224370 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" podUID="1cd39de5-ca7d-4ed7-8052-17c5613718fc" containerName="rabbitmq" probeResult="failure" output="dial tcp 10.217.0.109:5671: connect: connection refused" Mar 16 16:36:12 crc kubenswrapper[5120]: I0316 16:36:12.607823 5120 generic.go:358] "Generic (PLEG): container finished" podID="3a737f89-e391-4a23-b3d5-fa2e2cd8b768" containerID="a5eb8dbb0ca15b32b6b02e507ce778d950835eb65ff811dc3ddac108e7cf01e9" exitCode=0 Mar 16 16:36:12 crc kubenswrapper[5120]: I0316 16:36:12.607911 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"3a737f89-e391-4a23-b3d5-fa2e2cd8b768","Type":"ContainerDied","Data":"a5eb8dbb0ca15b32b6b02e507ce778d950835eb65ff811dc3ddac108e7cf01e9"} Mar 16 16:36:12 crc kubenswrapper[5120]: I0316 16:36:12.613992 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"579eb838-c3c3-42d5-bac1-df49697195f1","Type":"ContainerStarted","Data":"40eee810e5dd4240d04d09a8d96eb6efded23b51060cd70d18574627129f1b12"} Mar 16 16:36:12 crc kubenswrapper[5120]: I0316 16:36:12.614039 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"579eb838-c3c3-42d5-bac1-df49697195f1","Type":"ContainerStarted","Data":"f96358180f96673ed535465e5a27c22d217be6620ffe544778e8af58fedd96b4"} Mar 16 16:36:12 crc kubenswrapper[5120]: I0316 16:36:12.616083 5120 generic.go:358] "Generic (PLEG): container finished" podID="49fde0a2-0250-4ab2-92c6-e88c419aa313" containerID="e2c2ea5d5676a4a91547a32d6859178f558c834eafca188cc3dfcb7c21ce8283" exitCode=0 Mar 16 16:36:12 crc kubenswrapper[5120]: I0316 16:36:12.616115 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"49fde0a2-0250-4ab2-92c6-e88c419aa313","Type":"ContainerDied","Data":"e2c2ea5d5676a4a91547a32d6859178f558c834eafca188cc3dfcb7c21ce8283"} Mar 16 16:36:12 crc kubenswrapper[5120]: I0316 16:36:12.679916 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="97b7bd30-d48c-423d-b25f-f8b32bf60888" path="/var/lib/kubelet/pods/97b7bd30-d48c-423d-b25f-f8b32bf60888/volumes" Mar 16 16:36:13 crc kubenswrapper[5120]: I0316 16:36:13.284322 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:36:13 crc kubenswrapper[5120]: I0316 16:36:13.284895 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:36:13 crc kubenswrapper[5120]: I0316 16:36:13.288901 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/rabbitmq-server-0" podUID="27f4616b-6d51-4cd6-bdb1-1596dccca5db" containerName="rabbitmq" probeResult="failure" output="dial tcp 10.217.0.110:5671: connect: connection refused" Mar 16 16:36:13 crc kubenswrapper[5120]: I0316 16:36:13.335796 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:36:13 crc kubenswrapper[5120]: I0316 16:36:13.630623 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"3a737f89-e391-4a23-b3d5-fa2e2cd8b768","Type":"ContainerStarted","Data":"650c8959379827c8edd34466a6aa9f4175cc2896a05564a554694bce366f363b"} Mar 16 16:36:13 crc kubenswrapper[5120]: I0316 16:36:13.635362 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"49fde0a2-0250-4ab2-92c6-e88c419aa313","Type":"ContainerStarted","Data":"79a3a517e19aaedf82517a946a3950f61bc6eb918aab15f9840833ae6e238d1d"} Mar 16 16:36:13 crc kubenswrapper[5120]: I0316 16:36:13.662598 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstack-cell1-galera-0" podStartSLOduration=7.662578102 podStartE2EDuration="7.662578102s" podCreationTimestamp="2026-03-16 16:36:06 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:36:13.653201417 +0000 UTC m=+3875.807133084" watchObservedRunningTime="2026-03-16 16:36:13.662578102 +0000 UTC m=+3875.816509769" Mar 16 16:36:13 crc kubenswrapper[5120]: I0316 16:36:13.681221 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstack-galera-0" podStartSLOduration=6.681197479 podStartE2EDuration="6.681197479s" podCreationTimestamp="2026-03-16 16:36:07 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:36:13.674213937 +0000 UTC m=+3875.828145604" watchObservedRunningTime="2026-03-16 16:36:13.681197479 +0000 UTC m=+3875.835129136" Mar 16 16:36:13 crc kubenswrapper[5120]: I0316 16:36:13.994028 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.077500 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.194128 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.271361 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/27f4616b-6d51-4cd6-bdb1-1596dccca5db-rabbitmq-tls\") pod \"27f4616b-6d51-4cd6-bdb1-1596dccca5db\" (UID: \"27f4616b-6d51-4cd6-bdb1-1596dccca5db\") " Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.271532 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/27f4616b-6d51-4cd6-bdb1-1596dccca5db-erlang-cookie-secret\") pod \"27f4616b-6d51-4cd6-bdb1-1596dccca5db\" (UID: \"27f4616b-6d51-4cd6-bdb1-1596dccca5db\") " Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.271691 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/27f4616b-6d51-4cd6-bdb1-1596dccca5db-config-data\") pod \"27f4616b-6d51-4cd6-bdb1-1596dccca5db\" (UID: \"27f4616b-6d51-4cd6-bdb1-1596dccca5db\") " Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.271719 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6nb6z\" (UniqueName: \"kubernetes.io/projected/27f4616b-6d51-4cd6-bdb1-1596dccca5db-kube-api-access-6nb6z\") pod \"27f4616b-6d51-4cd6-bdb1-1596dccca5db\" (UID: \"27f4616b-6d51-4cd6-bdb1-1596dccca5db\") " Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.271853 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"persistence\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"27f4616b-6d51-4cd6-bdb1-1596dccca5db\" (UID: \"27f4616b-6d51-4cd6-bdb1-1596dccca5db\") " Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.272015 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/27f4616b-6d51-4cd6-bdb1-1596dccca5db-pod-info\") pod \"27f4616b-6d51-4cd6-bdb1-1596dccca5db\" (UID: \"27f4616b-6d51-4cd6-bdb1-1596dccca5db\") " Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.272127 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/27f4616b-6d51-4cd6-bdb1-1596dccca5db-rabbitmq-plugins\") pod \"27f4616b-6d51-4cd6-bdb1-1596dccca5db\" (UID: \"27f4616b-6d51-4cd6-bdb1-1596dccca5db\") " Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.272230 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/27f4616b-6d51-4cd6-bdb1-1596dccca5db-rabbitmq-confd\") pod \"27f4616b-6d51-4cd6-bdb1-1596dccca5db\" (UID: \"27f4616b-6d51-4cd6-bdb1-1596dccca5db\") " Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.272410 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/27f4616b-6d51-4cd6-bdb1-1596dccca5db-server-conf\") pod \"27f4616b-6d51-4cd6-bdb1-1596dccca5db\" (UID: \"27f4616b-6d51-4cd6-bdb1-1596dccca5db\") " Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.272502 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/27f4616b-6d51-4cd6-bdb1-1596dccca5db-plugins-conf\") pod \"27f4616b-6d51-4cd6-bdb1-1596dccca5db\" (UID: \"27f4616b-6d51-4cd6-bdb1-1596dccca5db\") " Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.272587 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/27f4616b-6d51-4cd6-bdb1-1596dccca5db-rabbitmq-erlang-cookie\") pod \"27f4616b-6d51-4cd6-bdb1-1596dccca5db\" (UID: \"27f4616b-6d51-4cd6-bdb1-1596dccca5db\") " Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.289445 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27f4616b-6d51-4cd6-bdb1-1596dccca5db-rabbitmq-tls" (OuterVolumeSpecName: "rabbitmq-tls") pod "27f4616b-6d51-4cd6-bdb1-1596dccca5db" (UID: "27f4616b-6d51-4cd6-bdb1-1596dccca5db"). InnerVolumeSpecName "rabbitmq-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.289490 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27f4616b-6d51-4cd6-bdb1-1596dccca5db-rabbitmq-plugins" (OuterVolumeSpecName: "rabbitmq-plugins") pod "27f4616b-6d51-4cd6-bdb1-1596dccca5db" (UID: "27f4616b-6d51-4cd6-bdb1-1596dccca5db"). InnerVolumeSpecName "rabbitmq-plugins". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.290364 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27f4616b-6d51-4cd6-bdb1-1596dccca5db-plugins-conf" (OuterVolumeSpecName: "plugins-conf") pod "27f4616b-6d51-4cd6-bdb1-1596dccca5db" (UID: "27f4616b-6d51-4cd6-bdb1-1596dccca5db"). InnerVolumeSpecName "plugins-conf". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.290951 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27f4616b-6d51-4cd6-bdb1-1596dccca5db-rabbitmq-erlang-cookie" (OuterVolumeSpecName: "rabbitmq-erlang-cookie") pod "27f4616b-6d51-4cd6-bdb1-1596dccca5db" (UID: "27f4616b-6d51-4cd6-bdb1-1596dccca5db"). InnerVolumeSpecName "rabbitmq-erlang-cookie". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.292628 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage03-crc" (OuterVolumeSpecName: "persistence") pod "27f4616b-6d51-4cd6-bdb1-1596dccca5db" (UID: "27f4616b-6d51-4cd6-bdb1-1596dccca5db"). InnerVolumeSpecName "local-storage03-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.295313 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27f4616b-6d51-4cd6-bdb1-1596dccca5db-erlang-cookie-secret" (OuterVolumeSpecName: "erlang-cookie-secret") pod "27f4616b-6d51-4cd6-bdb1-1596dccca5db" (UID: "27f4616b-6d51-4cd6-bdb1-1596dccca5db"). InnerVolumeSpecName "erlang-cookie-secret". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.322405 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/27f4616b-6d51-4cd6-bdb1-1596dccca5db-pod-info" (OuterVolumeSpecName: "pod-info") pod "27f4616b-6d51-4cd6-bdb1-1596dccca5db" (UID: "27f4616b-6d51-4cd6-bdb1-1596dccca5db"). InnerVolumeSpecName "pod-info". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.340339 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27f4616b-6d51-4cd6-bdb1-1596dccca5db-kube-api-access-6nb6z" (OuterVolumeSpecName: "kube-api-access-6nb6z") pod "27f4616b-6d51-4cd6-bdb1-1596dccca5db" (UID: "27f4616b-6d51-4cd6-bdb1-1596dccca5db"). InnerVolumeSpecName "kube-api-access-6nb6z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.347448 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27f4616b-6d51-4cd6-bdb1-1596dccca5db-config-data" (OuterVolumeSpecName: "config-data") pod "27f4616b-6d51-4cd6-bdb1-1596dccca5db" (UID: "27f4616b-6d51-4cd6-bdb1-1596dccca5db"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.349681 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.381546 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/27f4616b-6d51-4cd6-bdb1-1596dccca5db-rabbitmq-tls\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.381578 5120 reconciler_common.go:299] "Volume detached for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/27f4616b-6d51-4cd6-bdb1-1596dccca5db-erlang-cookie-secret\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.381589 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/27f4616b-6d51-4cd6-bdb1-1596dccca5db-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.381597 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6nb6z\" (UniqueName: \"kubernetes.io/projected/27f4616b-6d51-4cd6-bdb1-1596dccca5db-kube-api-access-6nb6z\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.381631 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") on node \"crc\" " Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.381640 5120 reconciler_common.go:299] "Volume detached for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/27f4616b-6d51-4cd6-bdb1-1596dccca5db-pod-info\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.381648 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/27f4616b-6d51-4cd6-bdb1-1596dccca5db-rabbitmq-plugins\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.381656 5120 reconciler_common.go:299] "Volume detached for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/27f4616b-6d51-4cd6-bdb1-1596dccca5db-plugins-conf\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.381664 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/27f4616b-6d51-4cd6-bdb1-1596dccca5db-rabbitmq-erlang-cookie\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.408327 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage03-crc" (UniqueName: "kubernetes.io/local-volume/local-storage03-crc") on node "crc" Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.417529 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27f4616b-6d51-4cd6-bdb1-1596dccca5db-server-conf" (OuterVolumeSpecName: "server-conf") pod "27f4616b-6d51-4cd6-bdb1-1596dccca5db" (UID: "27f4616b-6d51-4cd6-bdb1-1596dccca5db"). InnerVolumeSpecName "server-conf". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.469028 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27f4616b-6d51-4cd6-bdb1-1596dccca5db-rabbitmq-confd" (OuterVolumeSpecName: "rabbitmq-confd") pod "27f4616b-6d51-4cd6-bdb1-1596dccca5db" (UID: "27f4616b-6d51-4cd6-bdb1-1596dccca5db"). InnerVolumeSpecName "rabbitmq-confd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.483413 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/1cd39de5-ca7d-4ed7-8052-17c5613718fc-rabbitmq-tls\") pod \"1cd39de5-ca7d-4ed7-8052-17c5613718fc\" (UID: \"1cd39de5-ca7d-4ed7-8052-17c5613718fc\") " Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.483552 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/1cd39de5-ca7d-4ed7-8052-17c5613718fc-pod-info\") pod \"1cd39de5-ca7d-4ed7-8052-17c5613718fc\" (UID: \"1cd39de5-ca7d-4ed7-8052-17c5613718fc\") " Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.483588 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"persistence\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"1cd39de5-ca7d-4ed7-8052-17c5613718fc\" (UID: \"1cd39de5-ca7d-4ed7-8052-17c5613718fc\") " Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.483832 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/1cd39de5-ca7d-4ed7-8052-17c5613718fc-config-data\") pod \"1cd39de5-ca7d-4ed7-8052-17c5613718fc\" (UID: \"1cd39de5-ca7d-4ed7-8052-17c5613718fc\") " Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.483969 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/1cd39de5-ca7d-4ed7-8052-17c5613718fc-erlang-cookie-secret\") pod \"1cd39de5-ca7d-4ed7-8052-17c5613718fc\" (UID: \"1cd39de5-ca7d-4ed7-8052-17c5613718fc\") " Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.484084 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/1cd39de5-ca7d-4ed7-8052-17c5613718fc-server-conf\") pod \"1cd39de5-ca7d-4ed7-8052-17c5613718fc\" (UID: \"1cd39de5-ca7d-4ed7-8052-17c5613718fc\") " Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.484498 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/1cd39de5-ca7d-4ed7-8052-17c5613718fc-plugins-conf\") pod \"1cd39de5-ca7d-4ed7-8052-17c5613718fc\" (UID: \"1cd39de5-ca7d-4ed7-8052-17c5613718fc\") " Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.484567 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/1cd39de5-ca7d-4ed7-8052-17c5613718fc-rabbitmq-plugins\") pod \"1cd39de5-ca7d-4ed7-8052-17c5613718fc\" (UID: \"1cd39de5-ca7d-4ed7-8052-17c5613718fc\") " Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.484602 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nhxck\" (UniqueName: \"kubernetes.io/projected/1cd39de5-ca7d-4ed7-8052-17c5613718fc-kube-api-access-nhxck\") pod \"1cd39de5-ca7d-4ed7-8052-17c5613718fc\" (UID: \"1cd39de5-ca7d-4ed7-8052-17c5613718fc\") " Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.484658 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/1cd39de5-ca7d-4ed7-8052-17c5613718fc-rabbitmq-erlang-cookie\") pod \"1cd39de5-ca7d-4ed7-8052-17c5613718fc\" (UID: \"1cd39de5-ca7d-4ed7-8052-17c5613718fc\") " Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.484699 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/1cd39de5-ca7d-4ed7-8052-17c5613718fc-rabbitmq-confd\") pod \"1cd39de5-ca7d-4ed7-8052-17c5613718fc\" (UID: \"1cd39de5-ca7d-4ed7-8052-17c5613718fc\") " Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.485116 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1cd39de5-ca7d-4ed7-8052-17c5613718fc-rabbitmq-plugins" (OuterVolumeSpecName: "rabbitmq-plugins") pod "1cd39de5-ca7d-4ed7-8052-17c5613718fc" (UID: "1cd39de5-ca7d-4ed7-8052-17c5613718fc"). InnerVolumeSpecName "rabbitmq-plugins". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.485708 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.485732 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/1cd39de5-ca7d-4ed7-8052-17c5613718fc-rabbitmq-plugins\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.485748 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/27f4616b-6d51-4cd6-bdb1-1596dccca5db-rabbitmq-confd\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.485798 5120 reconciler_common.go:299] "Volume detached for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/27f4616b-6d51-4cd6-bdb1-1596dccca5db-server-conf\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.486221 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1cd39de5-ca7d-4ed7-8052-17c5613718fc-plugins-conf" (OuterVolumeSpecName: "plugins-conf") pod "1cd39de5-ca7d-4ed7-8052-17c5613718fc" (UID: "1cd39de5-ca7d-4ed7-8052-17c5613718fc"). InnerVolumeSpecName "plugins-conf". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.486298 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1cd39de5-ca7d-4ed7-8052-17c5613718fc-rabbitmq-erlang-cookie" (OuterVolumeSpecName: "rabbitmq-erlang-cookie") pod "1cd39de5-ca7d-4ed7-8052-17c5613718fc" (UID: "1cd39de5-ca7d-4ed7-8052-17c5613718fc"). InnerVolumeSpecName "rabbitmq-erlang-cookie". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.491184 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1cd39de5-ca7d-4ed7-8052-17c5613718fc-kube-api-access-nhxck" (OuterVolumeSpecName: "kube-api-access-nhxck") pod "1cd39de5-ca7d-4ed7-8052-17c5613718fc" (UID: "1cd39de5-ca7d-4ed7-8052-17c5613718fc"). InnerVolumeSpecName "kube-api-access-nhxck". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.491254 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1cd39de5-ca7d-4ed7-8052-17c5613718fc-rabbitmq-tls" (OuterVolumeSpecName: "rabbitmq-tls") pod "1cd39de5-ca7d-4ed7-8052-17c5613718fc" (UID: "1cd39de5-ca7d-4ed7-8052-17c5613718fc"). InnerVolumeSpecName "rabbitmq-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.491411 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1cd39de5-ca7d-4ed7-8052-17c5613718fc-pod-info" (OuterVolumeSpecName: "pod-info") pod "1cd39de5-ca7d-4ed7-8052-17c5613718fc" (UID: "1cd39de5-ca7d-4ed7-8052-17c5613718fc"). InnerVolumeSpecName "pod-info". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.492997 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage02-crc" (OuterVolumeSpecName: "persistence") pod "1cd39de5-ca7d-4ed7-8052-17c5613718fc" (UID: "1cd39de5-ca7d-4ed7-8052-17c5613718fc"). InnerVolumeSpecName "local-storage02-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.496640 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1cd39de5-ca7d-4ed7-8052-17c5613718fc-erlang-cookie-secret" (OuterVolumeSpecName: "erlang-cookie-secret") pod "1cd39de5-ca7d-4ed7-8052-17c5613718fc" (UID: "1cd39de5-ca7d-4ed7-8052-17c5613718fc"). InnerVolumeSpecName "erlang-cookie-secret". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.512816 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1cd39de5-ca7d-4ed7-8052-17c5613718fc-config-data" (OuterVolumeSpecName: "config-data") pod "1cd39de5-ca7d-4ed7-8052-17c5613718fc" (UID: "1cd39de5-ca7d-4ed7-8052-17c5613718fc"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.545604 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1cd39de5-ca7d-4ed7-8052-17c5613718fc-server-conf" (OuterVolumeSpecName: "server-conf") pod "1cd39de5-ca7d-4ed7-8052-17c5613718fc" (UID: "1cd39de5-ca7d-4ed7-8052-17c5613718fc"). InnerVolumeSpecName "server-conf". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.591525 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/1cd39de5-ca7d-4ed7-8052-17c5613718fc-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.591579 5120 reconciler_common.go:299] "Volume detached for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/1cd39de5-ca7d-4ed7-8052-17c5613718fc-erlang-cookie-secret\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.591592 5120 reconciler_common.go:299] "Volume detached for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/1cd39de5-ca7d-4ed7-8052-17c5613718fc-server-conf\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.591606 5120 reconciler_common.go:299] "Volume detached for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/1cd39de5-ca7d-4ed7-8052-17c5613718fc-plugins-conf\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.591618 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nhxck\" (UniqueName: \"kubernetes.io/projected/1cd39de5-ca7d-4ed7-8052-17c5613718fc-kube-api-access-nhxck\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.591630 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/1cd39de5-ca7d-4ed7-8052-17c5613718fc-rabbitmq-erlang-cookie\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.591642 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/1cd39de5-ca7d-4ed7-8052-17c5613718fc-rabbitmq-tls\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.591651 5120 reconciler_common.go:299] "Volume detached for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/1cd39de5-ca7d-4ed7-8052-17c5613718fc-pod-info\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.591690 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") on node \"crc\" " Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.616507 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1cd39de5-ca7d-4ed7-8052-17c5613718fc-rabbitmq-confd" (OuterVolumeSpecName: "rabbitmq-confd") pod "1cd39de5-ca7d-4ed7-8052-17c5613718fc" (UID: "1cd39de5-ca7d-4ed7-8052-17c5613718fc"). InnerVolumeSpecName "rabbitmq-confd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.621459 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage02-crc" (UniqueName: "kubernetes.io/local-volume/local-storage02-crc") on node "crc" Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.654307 5120 generic.go:358] "Generic (PLEG): container finished" podID="27f4616b-6d51-4cd6-bdb1-1596dccca5db" containerID="07933e1c2eb28569f75dec800bc0d7b02d1a53c0784920c28fb194aa2c3fc15a" exitCode=0 Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.654421 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.654957 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"27f4616b-6d51-4cd6-bdb1-1596dccca5db","Type":"ContainerDied","Data":"07933e1c2eb28569f75dec800bc0d7b02d1a53c0784920c28fb194aa2c3fc15a"} Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.655034 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"27f4616b-6d51-4cd6-bdb1-1596dccca5db","Type":"ContainerDied","Data":"fc96c2be59f943e6a1f984a0a213fc52002a4a606eca81241dc8c2aa03e5c243"} Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.655122 5120 scope.go:117] "RemoveContainer" containerID="07933e1c2eb28569f75dec800bc0d7b02d1a53c0784920c28fb194aa2c3fc15a" Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.665696 5120 generic.go:358] "Generic (PLEG): container finished" podID="1cd39de5-ca7d-4ed7-8052-17c5613718fc" containerID="187eb647447164e295bccc1b07863b41812af3639cc3d67076881a085711ead6" exitCode=0 Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.665849 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.679285 5120 generic.go:358] "Generic (PLEG): container finished" podID="1ccbf25a-f71f-4428-ac40-883041c2b302" containerID="ac561281d49b95085f75deca1a2fae047fa2827f32f42ca0477b0454b5fc81ad" exitCode=0 Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.682984 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"1cd39de5-ca7d-4ed7-8052-17c5613718fc","Type":"ContainerDied","Data":"187eb647447164e295bccc1b07863b41812af3639cc3d67076881a085711ead6"} Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.683032 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"1cd39de5-ca7d-4ed7-8052-17c5613718fc","Type":"ContainerDied","Data":"2f761a6bf5b802967d5ba97baf996c7c1075109b551e99caaf7c5bec02bac695"} Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.683045 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-nhhml" event={"ID":"1ccbf25a-f71f-4428-ac40-883041c2b302","Type":"ContainerDied","Data":"ac561281d49b95085f75deca1a2fae047fa2827f32f42ca0477b0454b5fc81ad"} Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.694274 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/1cd39de5-ca7d-4ed7-8052-17c5613718fc-rabbitmq-confd\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.694312 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.722881 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.727079 5120 scope.go:117] "RemoveContainer" containerID="3c52ae2e0cf0d03c546a140465a963dad65f514a4b32e937e791be9544743276" Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.736396 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.749975 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.770855 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.820226 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.847020 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1cd39de5-ca7d-4ed7-8052-17c5613718fc" containerName="rabbitmq" Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.847054 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1cd39de5-ca7d-4ed7-8052-17c5613718fc" containerName="rabbitmq" Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.847080 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cab9c74d-69a9-44ee-965f-bd31954a1976" containerName="oc" Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.847088 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="cab9c74d-69a9-44ee-965f-bd31954a1976" containerName="oc" Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.847180 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27f4616b-6d51-4cd6-bdb1-1596dccca5db" containerName="setup-container" Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.847200 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="27f4616b-6d51-4cd6-bdb1-1596dccca5db" containerName="setup-container" Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.847224 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1cd39de5-ca7d-4ed7-8052-17c5613718fc" containerName="setup-container" Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.847231 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1cd39de5-ca7d-4ed7-8052-17c5613718fc" containerName="setup-container" Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.847247 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27f4616b-6d51-4cd6-bdb1-1596dccca5db" containerName="rabbitmq" Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.847255 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="27f4616b-6d51-4cd6-bdb1-1596dccca5db" containerName="rabbitmq" Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.847538 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="27f4616b-6d51-4cd6-bdb1-1596dccca5db" containerName="rabbitmq" Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.847566 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="cab9c74d-69a9-44ee-965f-bd31954a1976" containerName="oc" Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.847582 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1cd39de5-ca7d-4ed7-8052-17c5613718fc" containerName="rabbitmq" Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.863124 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.863290 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.867064 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-default-user\"" Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.867317 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-erlang-cookie\"" Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.867491 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-config-data\"" Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.867682 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-server-dockercfg-zw4jf\"" Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.867861 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-rabbitmq-svc\"" Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.867972 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-plugins-conf\"" Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.868140 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-server-conf\"" Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.869625 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.881570 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.881735 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.882692 5120 scope.go:117] "RemoveContainer" containerID="07933e1c2eb28569f75dec800bc0d7b02d1a53c0784920c28fb194aa2c3fc15a" Mar 16 16:36:14 crc kubenswrapper[5120]: E0316 16:36:14.884492 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"07933e1c2eb28569f75dec800bc0d7b02d1a53c0784920c28fb194aa2c3fc15a\": container with ID starting with 07933e1c2eb28569f75dec800bc0d7b02d1a53c0784920c28fb194aa2c3fc15a not found: ID does not exist" containerID="07933e1c2eb28569f75dec800bc0d7b02d1a53c0784920c28fb194aa2c3fc15a" Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.884541 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07933e1c2eb28569f75dec800bc0d7b02d1a53c0784920c28fb194aa2c3fc15a"} err="failed to get container status \"07933e1c2eb28569f75dec800bc0d7b02d1a53c0784920c28fb194aa2c3fc15a\": rpc error: code = NotFound desc = could not find container \"07933e1c2eb28569f75dec800bc0d7b02d1a53c0784920c28fb194aa2c3fc15a\": container with ID starting with 07933e1c2eb28569f75dec800bc0d7b02d1a53c0784920c28fb194aa2c3fc15a not found: ID does not exist" Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.884570 5120 scope.go:117] "RemoveContainer" containerID="3c52ae2e0cf0d03c546a140465a963dad65f514a4b32e937e791be9544743276" Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.884851 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-cell1-server-conf\"" Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.885029 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-cell1-default-user\"" Mar 16 16:36:14 crc kubenswrapper[5120]: E0316 16:36:14.885115 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3c52ae2e0cf0d03c546a140465a963dad65f514a4b32e937e791be9544743276\": container with ID starting with 3c52ae2e0cf0d03c546a140465a963dad65f514a4b32e937e791be9544743276 not found: ID does not exist" containerID="3c52ae2e0cf0d03c546a140465a963dad65f514a4b32e937e791be9544743276" Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.885148 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c52ae2e0cf0d03c546a140465a963dad65f514a4b32e937e791be9544743276"} err="failed to get container status \"3c52ae2e0cf0d03c546a140465a963dad65f514a4b32e937e791be9544743276\": rpc error: code = NotFound desc = could not find container \"3c52ae2e0cf0d03c546a140465a963dad65f514a4b32e937e791be9544743276\": container with ID starting with 3c52ae2e0cf0d03c546a140465a963dad65f514a4b32e937e791be9544743276 not found: ID does not exist" Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.885168 5120 scope.go:117] "RemoveContainer" containerID="187eb647447164e295bccc1b07863b41812af3639cc3d67076881a085711ead6" Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.886442 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-cell1-plugins-conf\"" Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.886470 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-rabbitmq-cell1-svc\"" Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.886639 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-cell1-erlang-cookie\"" Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.886921 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-cell1-config-data\"" Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.887077 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-cell1-server-dockercfg-vvd2q\"" Mar 16 16:36:14 crc kubenswrapper[5120]: I0316 16:36:14.971303 5120 scope.go:117] "RemoveContainer" containerID="7c7fc3b544bfbb7386466592ee272ecfebf74da460a7679279743af631928389" Mar 16 16:36:15 crc kubenswrapper[5120]: I0316 16:36:15.008650 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/a03095a2-0907-4be8-ac85-43befd648111-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"a03095a2-0907-4be8-ac85-43befd648111\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:36:15 crc kubenswrapper[5120]: I0316 16:36:15.008743 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/05e90410-2cfb-438d-95df-8b2a70319257-rabbitmq-tls\") pod \"rabbitmq-cell1-server-0\" (UID: \"05e90410-2cfb-438d-95df-8b2a70319257\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:36:15 crc kubenswrapper[5120]: I0316 16:36:15.008789 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/05e90410-2cfb-438d-95df-8b2a70319257-config-data\") pod \"rabbitmq-cell1-server-0\" (UID: \"05e90410-2cfb-438d-95df-8b2a70319257\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:36:15 crc kubenswrapper[5120]: I0316 16:36:15.008811 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"rabbitmq-server-0\" (UID: \"a03095a2-0907-4be8-ac85-43befd648111\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:36:15 crc kubenswrapper[5120]: I0316 16:36:15.008852 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/05e90410-2cfb-438d-95df-8b2a70319257-plugins-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"05e90410-2cfb-438d-95df-8b2a70319257\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:36:15 crc kubenswrapper[5120]: I0316 16:36:15.008898 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/a03095a2-0907-4be8-ac85-43befd648111-rabbitmq-tls\") pod \"rabbitmq-server-0\" (UID: \"a03095a2-0907-4be8-ac85-43befd648111\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:36:15 crc kubenswrapper[5120]: I0316 16:36:15.008948 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/a03095a2-0907-4be8-ac85-43befd648111-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"a03095a2-0907-4be8-ac85-43befd648111\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:36:15 crc kubenswrapper[5120]: I0316 16:36:15.009016 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/05e90410-2cfb-438d-95df-8b2a70319257-server-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"05e90410-2cfb-438d-95df-8b2a70319257\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:36:15 crc kubenswrapper[5120]: I0316 16:36:15.009045 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/05e90410-2cfb-438d-95df-8b2a70319257-rabbitmq-confd\") pod \"rabbitmq-cell1-server-0\" (UID: \"05e90410-2cfb-438d-95df-8b2a70319257\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:36:15 crc kubenswrapper[5120]: I0316 16:36:15.009090 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/05e90410-2cfb-438d-95df-8b2a70319257-rabbitmq-plugins\") pod \"rabbitmq-cell1-server-0\" (UID: \"05e90410-2cfb-438d-95df-8b2a70319257\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:36:15 crc kubenswrapper[5120]: I0316 16:36:15.009160 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/a03095a2-0907-4be8-ac85-43befd648111-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"a03095a2-0907-4be8-ac85-43befd648111\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:36:15 crc kubenswrapper[5120]: I0316 16:36:15.009197 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"05e90410-2cfb-438d-95df-8b2a70319257\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:36:15 crc kubenswrapper[5120]: I0316 16:36:15.009240 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/05e90410-2cfb-438d-95df-8b2a70319257-rabbitmq-erlang-cookie\") pod \"rabbitmq-cell1-server-0\" (UID: \"05e90410-2cfb-438d-95df-8b2a70319257\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:36:15 crc kubenswrapper[5120]: I0316 16:36:15.009331 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/a03095a2-0907-4be8-ac85-43befd648111-config-data\") pod \"rabbitmq-server-0\" (UID: \"a03095a2-0907-4be8-ac85-43befd648111\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:36:15 crc kubenswrapper[5120]: I0316 16:36:15.009355 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/a03095a2-0907-4be8-ac85-43befd648111-pod-info\") pod \"rabbitmq-server-0\" (UID: \"a03095a2-0907-4be8-ac85-43befd648111\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:36:15 crc kubenswrapper[5120]: I0316 16:36:15.009395 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8n8r\" (UniqueName: \"kubernetes.io/projected/05e90410-2cfb-438d-95df-8b2a70319257-kube-api-access-k8n8r\") pod \"rabbitmq-cell1-server-0\" (UID: \"05e90410-2cfb-438d-95df-8b2a70319257\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:36:15 crc kubenswrapper[5120]: I0316 16:36:15.009443 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/05e90410-2cfb-438d-95df-8b2a70319257-erlang-cookie-secret\") pod \"rabbitmq-cell1-server-0\" (UID: \"05e90410-2cfb-438d-95df-8b2a70319257\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:36:15 crc kubenswrapper[5120]: I0316 16:36:15.009526 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/05e90410-2cfb-438d-95df-8b2a70319257-pod-info\") pod \"rabbitmq-cell1-server-0\" (UID: \"05e90410-2cfb-438d-95df-8b2a70319257\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:36:15 crc kubenswrapper[5120]: I0316 16:36:15.009592 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/a03095a2-0907-4be8-ac85-43befd648111-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"a03095a2-0907-4be8-ac85-43befd648111\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:36:15 crc kubenswrapper[5120]: I0316 16:36:15.009626 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lgrsr\" (UniqueName: \"kubernetes.io/projected/a03095a2-0907-4be8-ac85-43befd648111-kube-api-access-lgrsr\") pod \"rabbitmq-server-0\" (UID: \"a03095a2-0907-4be8-ac85-43befd648111\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:36:15 crc kubenswrapper[5120]: I0316 16:36:15.009676 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/a03095a2-0907-4be8-ac85-43befd648111-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"a03095a2-0907-4be8-ac85-43befd648111\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:36:15 crc kubenswrapper[5120]: I0316 16:36:15.009791 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/a03095a2-0907-4be8-ac85-43befd648111-server-conf\") pod \"rabbitmq-server-0\" (UID: \"a03095a2-0907-4be8-ac85-43befd648111\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:36:15 crc kubenswrapper[5120]: I0316 16:36:15.021400 5120 scope.go:117] "RemoveContainer" containerID="187eb647447164e295bccc1b07863b41812af3639cc3d67076881a085711ead6" Mar 16 16:36:15 crc kubenswrapper[5120]: E0316 16:36:15.028094 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"187eb647447164e295bccc1b07863b41812af3639cc3d67076881a085711ead6\": container with ID starting with 187eb647447164e295bccc1b07863b41812af3639cc3d67076881a085711ead6 not found: ID does not exist" containerID="187eb647447164e295bccc1b07863b41812af3639cc3d67076881a085711ead6" Mar 16 16:36:15 crc kubenswrapper[5120]: I0316 16:36:15.028150 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"187eb647447164e295bccc1b07863b41812af3639cc3d67076881a085711ead6"} err="failed to get container status \"187eb647447164e295bccc1b07863b41812af3639cc3d67076881a085711ead6\": rpc error: code = NotFound desc = could not find container \"187eb647447164e295bccc1b07863b41812af3639cc3d67076881a085711ead6\": container with ID starting with 187eb647447164e295bccc1b07863b41812af3639cc3d67076881a085711ead6 not found: ID does not exist" Mar 16 16:36:15 crc kubenswrapper[5120]: I0316 16:36:15.028179 5120 scope.go:117] "RemoveContainer" containerID="7c7fc3b544bfbb7386466592ee272ecfebf74da460a7679279743af631928389" Mar 16 16:36:15 crc kubenswrapper[5120]: E0316 16:36:15.028631 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c7fc3b544bfbb7386466592ee272ecfebf74da460a7679279743af631928389\": container with ID starting with 7c7fc3b544bfbb7386466592ee272ecfebf74da460a7679279743af631928389 not found: ID does not exist" containerID="7c7fc3b544bfbb7386466592ee272ecfebf74da460a7679279743af631928389" Mar 16 16:36:15 crc kubenswrapper[5120]: I0316 16:36:15.028663 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c7fc3b544bfbb7386466592ee272ecfebf74da460a7679279743af631928389"} err="failed to get container status \"7c7fc3b544bfbb7386466592ee272ecfebf74da460a7679279743af631928389\": rpc error: code = NotFound desc = could not find container \"7c7fc3b544bfbb7386466592ee272ecfebf74da460a7679279743af631928389\": container with ID starting with 7c7fc3b544bfbb7386466592ee272ecfebf74da460a7679279743af631928389 not found: ID does not exist" Mar 16 16:36:15 crc kubenswrapper[5120]: I0316 16:36:15.111584 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/a03095a2-0907-4be8-ac85-43befd648111-server-conf\") pod \"rabbitmq-server-0\" (UID: \"a03095a2-0907-4be8-ac85-43befd648111\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:36:15 crc kubenswrapper[5120]: I0316 16:36:15.111655 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/a03095a2-0907-4be8-ac85-43befd648111-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"a03095a2-0907-4be8-ac85-43befd648111\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:36:15 crc kubenswrapper[5120]: I0316 16:36:15.111709 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/05e90410-2cfb-438d-95df-8b2a70319257-rabbitmq-tls\") pod \"rabbitmq-cell1-server-0\" (UID: \"05e90410-2cfb-438d-95df-8b2a70319257\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:36:15 crc kubenswrapper[5120]: I0316 16:36:15.111745 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/05e90410-2cfb-438d-95df-8b2a70319257-config-data\") pod \"rabbitmq-cell1-server-0\" (UID: \"05e90410-2cfb-438d-95df-8b2a70319257\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:36:15 crc kubenswrapper[5120]: I0316 16:36:15.111788 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"rabbitmq-server-0\" (UID: \"a03095a2-0907-4be8-ac85-43befd648111\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:36:15 crc kubenswrapper[5120]: I0316 16:36:15.111829 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/05e90410-2cfb-438d-95df-8b2a70319257-plugins-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"05e90410-2cfb-438d-95df-8b2a70319257\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:36:15 crc kubenswrapper[5120]: I0316 16:36:15.111853 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/a03095a2-0907-4be8-ac85-43befd648111-rabbitmq-tls\") pod \"rabbitmq-server-0\" (UID: \"a03095a2-0907-4be8-ac85-43befd648111\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:36:15 crc kubenswrapper[5120]: I0316 16:36:15.111901 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/a03095a2-0907-4be8-ac85-43befd648111-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"a03095a2-0907-4be8-ac85-43befd648111\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:36:15 crc kubenswrapper[5120]: I0316 16:36:15.111973 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/05e90410-2cfb-438d-95df-8b2a70319257-server-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"05e90410-2cfb-438d-95df-8b2a70319257\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:36:15 crc kubenswrapper[5120]: I0316 16:36:15.112006 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/05e90410-2cfb-438d-95df-8b2a70319257-rabbitmq-confd\") pod \"rabbitmq-cell1-server-0\" (UID: \"05e90410-2cfb-438d-95df-8b2a70319257\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:36:15 crc kubenswrapper[5120]: I0316 16:36:15.112055 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/05e90410-2cfb-438d-95df-8b2a70319257-rabbitmq-plugins\") pod \"rabbitmq-cell1-server-0\" (UID: \"05e90410-2cfb-438d-95df-8b2a70319257\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:36:15 crc kubenswrapper[5120]: I0316 16:36:15.112127 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/a03095a2-0907-4be8-ac85-43befd648111-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"a03095a2-0907-4be8-ac85-43befd648111\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:36:15 crc kubenswrapper[5120]: I0316 16:36:15.112169 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"05e90410-2cfb-438d-95df-8b2a70319257\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:36:15 crc kubenswrapper[5120]: I0316 16:36:15.112209 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/05e90410-2cfb-438d-95df-8b2a70319257-rabbitmq-erlang-cookie\") pod \"rabbitmq-cell1-server-0\" (UID: \"05e90410-2cfb-438d-95df-8b2a70319257\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:36:15 crc kubenswrapper[5120]: I0316 16:36:15.112325 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/a03095a2-0907-4be8-ac85-43befd648111-config-data\") pod \"rabbitmq-server-0\" (UID: \"a03095a2-0907-4be8-ac85-43befd648111\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:36:15 crc kubenswrapper[5120]: I0316 16:36:15.112353 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/a03095a2-0907-4be8-ac85-43befd648111-pod-info\") pod \"rabbitmq-server-0\" (UID: \"a03095a2-0907-4be8-ac85-43befd648111\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:36:15 crc kubenswrapper[5120]: I0316 16:36:15.112397 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k8n8r\" (UniqueName: \"kubernetes.io/projected/05e90410-2cfb-438d-95df-8b2a70319257-kube-api-access-k8n8r\") pod \"rabbitmq-cell1-server-0\" (UID: \"05e90410-2cfb-438d-95df-8b2a70319257\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:36:15 crc kubenswrapper[5120]: I0316 16:36:15.112451 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/05e90410-2cfb-438d-95df-8b2a70319257-erlang-cookie-secret\") pod \"rabbitmq-cell1-server-0\" (UID: \"05e90410-2cfb-438d-95df-8b2a70319257\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:36:15 crc kubenswrapper[5120]: I0316 16:36:15.112546 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/05e90410-2cfb-438d-95df-8b2a70319257-pod-info\") pod \"rabbitmq-cell1-server-0\" (UID: \"05e90410-2cfb-438d-95df-8b2a70319257\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:36:15 crc kubenswrapper[5120]: I0316 16:36:15.112587 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/a03095a2-0907-4be8-ac85-43befd648111-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"a03095a2-0907-4be8-ac85-43befd648111\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:36:15 crc kubenswrapper[5120]: I0316 16:36:15.112620 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lgrsr\" (UniqueName: \"kubernetes.io/projected/a03095a2-0907-4be8-ac85-43befd648111-kube-api-access-lgrsr\") pod \"rabbitmq-server-0\" (UID: \"a03095a2-0907-4be8-ac85-43befd648111\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:36:15 crc kubenswrapper[5120]: I0316 16:36:15.112680 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/a03095a2-0907-4be8-ac85-43befd648111-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"a03095a2-0907-4be8-ac85-43befd648111\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:36:15 crc kubenswrapper[5120]: I0316 16:36:15.112693 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/a03095a2-0907-4be8-ac85-43befd648111-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"a03095a2-0907-4be8-ac85-43befd648111\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:36:15 crc kubenswrapper[5120]: I0316 16:36:15.112963 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"rabbitmq-server-0\" (UID: \"a03095a2-0907-4be8-ac85-43befd648111\") device mount path \"/mnt/openstack/pv03\"" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:36:15 crc kubenswrapper[5120]: I0316 16:36:15.113157 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/a03095a2-0907-4be8-ac85-43befd648111-server-conf\") pod \"rabbitmq-server-0\" (UID: \"a03095a2-0907-4be8-ac85-43befd648111\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:36:15 crc kubenswrapper[5120]: I0316 16:36:15.113824 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/05e90410-2cfb-438d-95df-8b2a70319257-plugins-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"05e90410-2cfb-438d-95df-8b2a70319257\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:36:15 crc kubenswrapper[5120]: I0316 16:36:15.113825 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/05e90410-2cfb-438d-95df-8b2a70319257-config-data\") pod \"rabbitmq-cell1-server-0\" (UID: \"05e90410-2cfb-438d-95df-8b2a70319257\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:36:15 crc kubenswrapper[5120]: I0316 16:36:15.114240 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/a03095a2-0907-4be8-ac85-43befd648111-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"a03095a2-0907-4be8-ac85-43befd648111\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:36:15 crc kubenswrapper[5120]: I0316 16:36:15.114414 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/a03095a2-0907-4be8-ac85-43befd648111-config-data\") pod \"rabbitmq-server-0\" (UID: \"a03095a2-0907-4be8-ac85-43befd648111\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:36:15 crc kubenswrapper[5120]: I0316 16:36:15.114542 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/a03095a2-0907-4be8-ac85-43befd648111-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"a03095a2-0907-4be8-ac85-43befd648111\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:36:15 crc kubenswrapper[5120]: I0316 16:36:15.117519 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"05e90410-2cfb-438d-95df-8b2a70319257\") device mount path \"/mnt/openstack/pv02\"" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:36:15 crc kubenswrapper[5120]: I0316 16:36:15.117967 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/a03095a2-0907-4be8-ac85-43befd648111-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"a03095a2-0907-4be8-ac85-43befd648111\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:36:15 crc kubenswrapper[5120]: I0316 16:36:15.118507 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/05e90410-2cfb-438d-95df-8b2a70319257-rabbitmq-erlang-cookie\") pod \"rabbitmq-cell1-server-0\" (UID: \"05e90410-2cfb-438d-95df-8b2a70319257\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:36:15 crc kubenswrapper[5120]: I0316 16:36:15.121245 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/05e90410-2cfb-438d-95df-8b2a70319257-pod-info\") pod \"rabbitmq-cell1-server-0\" (UID: \"05e90410-2cfb-438d-95df-8b2a70319257\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:36:15 crc kubenswrapper[5120]: I0316 16:36:15.121315 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/05e90410-2cfb-438d-95df-8b2a70319257-rabbitmq-plugins\") pod \"rabbitmq-cell1-server-0\" (UID: \"05e90410-2cfb-438d-95df-8b2a70319257\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:36:15 crc kubenswrapper[5120]: I0316 16:36:15.121995 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/05e90410-2cfb-438d-95df-8b2a70319257-server-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"05e90410-2cfb-438d-95df-8b2a70319257\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:36:15 crc kubenswrapper[5120]: I0316 16:36:15.123170 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/05e90410-2cfb-438d-95df-8b2a70319257-erlang-cookie-secret\") pod \"rabbitmq-cell1-server-0\" (UID: \"05e90410-2cfb-438d-95df-8b2a70319257\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:36:15 crc kubenswrapper[5120]: I0316 16:36:15.126705 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/a03095a2-0907-4be8-ac85-43befd648111-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"a03095a2-0907-4be8-ac85-43befd648111\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:36:15 crc kubenswrapper[5120]: I0316 16:36:15.127535 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/05e90410-2cfb-438d-95df-8b2a70319257-rabbitmq-confd\") pod \"rabbitmq-cell1-server-0\" (UID: \"05e90410-2cfb-438d-95df-8b2a70319257\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:36:15 crc kubenswrapper[5120]: I0316 16:36:15.127704 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/a03095a2-0907-4be8-ac85-43befd648111-rabbitmq-tls\") pod \"rabbitmq-server-0\" (UID: \"a03095a2-0907-4be8-ac85-43befd648111\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:36:15 crc kubenswrapper[5120]: I0316 16:36:15.131456 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lgrsr\" (UniqueName: \"kubernetes.io/projected/a03095a2-0907-4be8-ac85-43befd648111-kube-api-access-lgrsr\") pod \"rabbitmq-server-0\" (UID: \"a03095a2-0907-4be8-ac85-43befd648111\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:36:15 crc kubenswrapper[5120]: I0316 16:36:15.132188 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/05e90410-2cfb-438d-95df-8b2a70319257-rabbitmq-tls\") pod \"rabbitmq-cell1-server-0\" (UID: \"05e90410-2cfb-438d-95df-8b2a70319257\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:36:15 crc kubenswrapper[5120]: I0316 16:36:15.141483 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/a03095a2-0907-4be8-ac85-43befd648111-pod-info\") pod \"rabbitmq-server-0\" (UID: \"a03095a2-0907-4be8-ac85-43befd648111\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:36:15 crc kubenswrapper[5120]: I0316 16:36:15.142513 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8n8r\" (UniqueName: \"kubernetes.io/projected/05e90410-2cfb-438d-95df-8b2a70319257-kube-api-access-k8n8r\") pod \"rabbitmq-cell1-server-0\" (UID: \"05e90410-2cfb-438d-95df-8b2a70319257\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:36:15 crc kubenswrapper[5120]: I0316 16:36:15.157366 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"rabbitmq-server-0\" (UID: \"a03095a2-0907-4be8-ac85-43befd648111\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:36:15 crc kubenswrapper[5120]: I0316 16:36:15.160728 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"05e90410-2cfb-438d-95df-8b2a70319257\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:36:15 crc kubenswrapper[5120]: I0316 16:36:15.257178 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:36:15 crc kubenswrapper[5120]: I0316 16:36:15.291015 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:36:15 crc kubenswrapper[5120]: I0316 16:36:15.700788 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"579eb838-c3c3-42d5-bac1-df49697195f1","Type":"ContainerStarted","Data":"87ab077524744f5ba1ea405c0e9405f23987c77a3137d588309d999859d1f44c"} Mar 16 16:36:15 crc kubenswrapper[5120]: I0316 16:36:15.701202 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:36:15 crc kubenswrapper[5120]: I0316 16:36:15.713113 5120 generic.go:358] "Generic (PLEG): container finished" podID="63d9a98c-175f-4caa-bd33-41eb82d6e06b" containerID="3251b55607768a1c1602f007772fd47d988206a579b6573f7b1196b6855a2d19" exitCode=0 Mar 16 16:36:15 crc kubenswrapper[5120]: I0316 16:36:15.713403 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"63d9a98c-175f-4caa-bd33-41eb82d6e06b","Type":"ContainerDied","Data":"3251b55607768a1c1602f007772fd47d988206a579b6573f7b1196b6855a2d19"} Mar 16 16:36:15 crc kubenswrapper[5120]: I0316 16:36:15.746301 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=3.253168591 podStartE2EDuration="7.746280451s" podCreationTimestamp="2026-03-16 16:36:08 +0000 UTC" firstStartedPulling="2026-03-16 16:36:10.121905262 +0000 UTC m=+3872.275836919" lastFinishedPulling="2026-03-16 16:36:14.615017122 +0000 UTC m=+3876.768948779" observedRunningTime="2026-03-16 16:36:15.725587841 +0000 UTC m=+3877.879519518" watchObservedRunningTime="2026-03-16 16:36:15.746280451 +0000 UTC m=+3877.900212108" Mar 16 16:36:15 crc kubenswrapper[5120]: I0316 16:36:15.785033 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 16:36:15 crc kubenswrapper[5120]: W0316 16:36:15.834252 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda03095a2_0907_4be8_ac85_43befd648111.slice/crio-bbcd170cc2e9b97e08745dcc85e6d4dfcae3c911719f07221c51d0d7499b33d8 WatchSource:0}: Error finding container bbcd170cc2e9b97e08745dcc85e6d4dfcae3c911719f07221c51d0d7499b33d8: Status 404 returned error can't find the container with id bbcd170cc2e9b97e08745dcc85e6d4dfcae3c911719f07221c51d0d7499b33d8 Mar 16 16:36:15 crc kubenswrapper[5120]: I0316 16:36:15.890227 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 16:36:15 crc kubenswrapper[5120]: W0316 16:36:15.948793 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05e90410_2cfb_438d_95df_8b2a70319257.slice/crio-5386639494b23a12a89af0457eaa7079513fc27e60562f0c964be2194e198a87 WatchSource:0}: Error finding container 5386639494b23a12a89af0457eaa7079513fc27e60562f0c964be2194e198a87: Status 404 returned error can't find the container with id 5386639494b23a12a89af0457eaa7079513fc27e60562f0c964be2194e198a87 Mar 16 16:36:16 crc kubenswrapper[5120]: I0316 16:36:16.149176 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-nhhml" Mar 16 16:36:16 crc kubenswrapper[5120]: I0316 16:36:16.274858 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/1ccbf25a-f71f-4428-ac40-883041c2b302-ring-data-devices\") pod \"1ccbf25a-f71f-4428-ac40-883041c2b302\" (UID: \"1ccbf25a-f71f-4428-ac40-883041c2b302\") " Mar 16 16:36:16 crc kubenswrapper[5120]: I0316 16:36:16.274962 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1ccbf25a-f71f-4428-ac40-883041c2b302-combined-ca-bundle\") pod \"1ccbf25a-f71f-4428-ac40-883041c2b302\" (UID: \"1ccbf25a-f71f-4428-ac40-883041c2b302\") " Mar 16 16:36:16 crc kubenswrapper[5120]: I0316 16:36:16.275057 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/1ccbf25a-f71f-4428-ac40-883041c2b302-etc-swift\") pod \"1ccbf25a-f71f-4428-ac40-883041c2b302\" (UID: \"1ccbf25a-f71f-4428-ac40-883041c2b302\") " Mar 16 16:36:16 crc kubenswrapper[5120]: I0316 16:36:16.275266 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/1ccbf25a-f71f-4428-ac40-883041c2b302-scripts\") pod \"1ccbf25a-f71f-4428-ac40-883041c2b302\" (UID: \"1ccbf25a-f71f-4428-ac40-883041c2b302\") " Mar 16 16:36:16 crc kubenswrapper[5120]: I0316 16:36:16.275359 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/1ccbf25a-f71f-4428-ac40-883041c2b302-swiftconf\") pod \"1ccbf25a-f71f-4428-ac40-883041c2b302\" (UID: \"1ccbf25a-f71f-4428-ac40-883041c2b302\") " Mar 16 16:36:16 crc kubenswrapper[5120]: I0316 16:36:16.275400 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mjj92\" (UniqueName: \"kubernetes.io/projected/1ccbf25a-f71f-4428-ac40-883041c2b302-kube-api-access-mjj92\") pod \"1ccbf25a-f71f-4428-ac40-883041c2b302\" (UID: \"1ccbf25a-f71f-4428-ac40-883041c2b302\") " Mar 16 16:36:16 crc kubenswrapper[5120]: I0316 16:36:16.275500 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/1ccbf25a-f71f-4428-ac40-883041c2b302-dispersionconf\") pod \"1ccbf25a-f71f-4428-ac40-883041c2b302\" (UID: \"1ccbf25a-f71f-4428-ac40-883041c2b302\") " Mar 16 16:36:16 crc kubenswrapper[5120]: I0316 16:36:16.277311 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ccbf25a-f71f-4428-ac40-883041c2b302-etc-swift" (OuterVolumeSpecName: "etc-swift") pod "1ccbf25a-f71f-4428-ac40-883041c2b302" (UID: "1ccbf25a-f71f-4428-ac40-883041c2b302"). InnerVolumeSpecName "etc-swift". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:36:16 crc kubenswrapper[5120]: I0316 16:36:16.278132 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ccbf25a-f71f-4428-ac40-883041c2b302-ring-data-devices" (OuterVolumeSpecName: "ring-data-devices") pod "1ccbf25a-f71f-4428-ac40-883041c2b302" (UID: "1ccbf25a-f71f-4428-ac40-883041c2b302"). InnerVolumeSpecName "ring-data-devices". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:36:16 crc kubenswrapper[5120]: I0316 16:36:16.281085 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ccbf25a-f71f-4428-ac40-883041c2b302-kube-api-access-mjj92" (OuterVolumeSpecName: "kube-api-access-mjj92") pod "1ccbf25a-f71f-4428-ac40-883041c2b302" (UID: "1ccbf25a-f71f-4428-ac40-883041c2b302"). InnerVolumeSpecName "kube-api-access-mjj92". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:36:16 crc kubenswrapper[5120]: I0316 16:36:16.303498 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ccbf25a-f71f-4428-ac40-883041c2b302-dispersionconf" (OuterVolumeSpecName: "dispersionconf") pod "1ccbf25a-f71f-4428-ac40-883041c2b302" (UID: "1ccbf25a-f71f-4428-ac40-883041c2b302"). InnerVolumeSpecName "dispersionconf". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:36:16 crc kubenswrapper[5120]: I0316 16:36:16.307238 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ccbf25a-f71f-4428-ac40-883041c2b302-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "1ccbf25a-f71f-4428-ac40-883041c2b302" (UID: "1ccbf25a-f71f-4428-ac40-883041c2b302"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:36:16 crc kubenswrapper[5120]: I0316 16:36:16.308259 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ccbf25a-f71f-4428-ac40-883041c2b302-swiftconf" (OuterVolumeSpecName: "swiftconf") pod "1ccbf25a-f71f-4428-ac40-883041c2b302" (UID: "1ccbf25a-f71f-4428-ac40-883041c2b302"). InnerVolumeSpecName "swiftconf". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:36:16 crc kubenswrapper[5120]: I0316 16:36:16.308702 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ccbf25a-f71f-4428-ac40-883041c2b302-scripts" (OuterVolumeSpecName: "scripts") pod "1ccbf25a-f71f-4428-ac40-883041c2b302" (UID: "1ccbf25a-f71f-4428-ac40-883041c2b302"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:36:16 crc kubenswrapper[5120]: I0316 16:36:16.378011 5120 reconciler_common.go:299] "Volume detached for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/1ccbf25a-f71f-4428-ac40-883041c2b302-dispersionconf\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:16 crc kubenswrapper[5120]: I0316 16:36:16.378056 5120 reconciler_common.go:299] "Volume detached for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/1ccbf25a-f71f-4428-ac40-883041c2b302-ring-data-devices\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:16 crc kubenswrapper[5120]: I0316 16:36:16.378070 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1ccbf25a-f71f-4428-ac40-883041c2b302-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:16 crc kubenswrapper[5120]: I0316 16:36:16.378081 5120 reconciler_common.go:299] "Volume detached for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/1ccbf25a-f71f-4428-ac40-883041c2b302-etc-swift\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:16 crc kubenswrapper[5120]: I0316 16:36:16.378097 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/1ccbf25a-f71f-4428-ac40-883041c2b302-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:16 crc kubenswrapper[5120]: I0316 16:36:16.378110 5120 reconciler_common.go:299] "Volume detached for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/1ccbf25a-f71f-4428-ac40-883041c2b302-swiftconf\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:16 crc kubenswrapper[5120]: I0316 16:36:16.378122 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mjj92\" (UniqueName: \"kubernetes.io/projected/1ccbf25a-f71f-4428-ac40-883041c2b302-kube-api-access-mjj92\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:16 crc kubenswrapper[5120]: I0316 16:36:16.593448 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/memcached-0" Mar 16 16:36:16 crc kubenswrapper[5120]: I0316 16:36:16.677589 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1cd39de5-ca7d-4ed7-8052-17c5613718fc" path="/var/lib/kubelet/pods/1cd39de5-ca7d-4ed7-8052-17c5613718fc/volumes" Mar 16 16:36:16 crc kubenswrapper[5120]: I0316 16:36:16.678586 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="27f4616b-6d51-4cd6-bdb1-1596dccca5db" path="/var/lib/kubelet/pods/27f4616b-6d51-4cd6-bdb1-1596dccca5db/volumes" Mar 16 16:36:16 crc kubenswrapper[5120]: I0316 16:36:16.725533 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"a03095a2-0907-4be8-ac85-43befd648111","Type":"ContainerStarted","Data":"bbcd170cc2e9b97e08745dcc85e6d4dfcae3c911719f07221c51d0d7499b33d8"} Mar 16 16:36:16 crc kubenswrapper[5120]: I0316 16:36:16.727067 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-nhhml" event={"ID":"1ccbf25a-f71f-4428-ac40-883041c2b302","Type":"ContainerDied","Data":"7f759d8c9d601826b436781a46c420dc78fb1376d8390bd237c032c4f0d043e8"} Mar 16 16:36:16 crc kubenswrapper[5120]: I0316 16:36:16.727094 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7f759d8c9d601826b436781a46c420dc78fb1376d8390bd237c032c4f0d043e8" Mar 16 16:36:16 crc kubenswrapper[5120]: I0316 16:36:16.727169 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-nhhml" Mar 16 16:36:16 crc kubenswrapper[5120]: I0316 16:36:16.735215 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"63d9a98c-175f-4caa-bd33-41eb82d6e06b","Type":"ContainerStarted","Data":"e33584a62e63e94b8ee772c464bae71158a771a227951bc7d1483783fd437d31"} Mar 16 16:36:16 crc kubenswrapper[5120]: I0316 16:36:16.741187 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"05e90410-2cfb-438d-95df-8b2a70319257","Type":"ContainerStarted","Data":"5386639494b23a12a89af0457eaa7079513fc27e60562f0c964be2194e198a87"} Mar 16 16:36:17 crc kubenswrapper[5120]: I0316 16:36:17.505859 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:36:17 crc kubenswrapper[5120]: I0316 16:36:17.752512 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"a03095a2-0907-4be8-ac85-43befd648111","Type":"ContainerStarted","Data":"92fec9271b324df350d5b12d702dd5be44b1de1d7ed388b9fcff65b549278624"} Mar 16 16:36:17 crc kubenswrapper[5120]: I0316 16:36:17.756375 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"05e90410-2cfb-438d-95df-8b2a70319257","Type":"ContainerStarted","Data":"c81e95f5038d7d226294b881d501dd9e830cf87edf6aba2428d1ad4470cca082"} Mar 16 16:36:17 crc kubenswrapper[5120]: I0316 16:36:17.959131 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:36:17 crc kubenswrapper[5120]: I0316 16:36:17.959401 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:36:18 crc kubenswrapper[5120]: I0316 16:36:18.122948 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:36:18 crc kubenswrapper[5120]: I0316 16:36:18.293497 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:36:18 crc kubenswrapper[5120]: I0316 16:36:18.293573 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:36:18 crc kubenswrapper[5120]: I0316 16:36:18.421776 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:36:18 crc kubenswrapper[5120]: I0316 16:36:18.843087 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:36:18 crc kubenswrapper[5120]: I0316 16:36:18.848402 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:36:20 crc kubenswrapper[5120]: I0316 16:36:20.785878 5120 generic.go:358] "Generic (PLEG): container finished" podID="1b9d0a58-9639-4577-9b99-d34345657929" containerID="0b5fa35e8908630cc7fea95fb76a8e5a82208855c38e6f33e82c2cfae6e4da96" exitCode=0 Mar 16 16:36:20 crc kubenswrapper[5120]: I0316 16:36:20.786612 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-r8627" event={"ID":"1b9d0a58-9639-4577-9b99-d34345657929","Type":"ContainerDied","Data":"0b5fa35e8908630cc7fea95fb76a8e5a82208855c38e6f33e82c2cfae6e4da96"} Mar 16 16:36:20 crc kubenswrapper[5120]: I0316 16:36:20.789570 5120 generic.go:358] "Generic (PLEG): container finished" podID="7ecbc5c7-9802-4143-bba3-6552d5b8e3ba" containerID="05afde781643fd53002b9bc00aafac856fb24fc4f74ae53ee06b3dee10f01576" exitCode=0 Mar 16 16:36:20 crc kubenswrapper[5120]: I0316 16:36:20.789796 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-d42sq" event={"ID":"7ecbc5c7-9802-4143-bba3-6552d5b8e3ba","Type":"ContainerDied","Data":"05afde781643fd53002b9bc00aafac856fb24fc4f74ae53ee06b3dee10f01576"} Mar 16 16:36:20 crc kubenswrapper[5120]: I0316 16:36:20.950569 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:36:20 crc kubenswrapper[5120]: I0316 16:36:20.950984 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="579eb838-c3c3-42d5-bac1-df49697195f1" containerName="ceilometer-central-agent" containerID="cri-o://6b88570797a3db9d2d05b1a61c7b26d1fdf425c43a21a2217d8bc252c8923598" gracePeriod=30 Mar 16 16:36:20 crc kubenswrapper[5120]: I0316 16:36:20.951042 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="579eb838-c3c3-42d5-bac1-df49697195f1" containerName="proxy-httpd" containerID="cri-o://87ab077524744f5ba1ea405c0e9405f23987c77a3137d588309d999859d1f44c" gracePeriod=30 Mar 16 16:36:20 crc kubenswrapper[5120]: I0316 16:36:20.951202 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="579eb838-c3c3-42d5-bac1-df49697195f1" containerName="sg-core" containerID="cri-o://40eee810e5dd4240d04d09a8d96eb6efded23b51060cd70d18574627129f1b12" gracePeriod=30 Mar 16 16:36:20 crc kubenswrapper[5120]: I0316 16:36:20.951276 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="579eb838-c3c3-42d5-bac1-df49697195f1" containerName="ceilometer-notification-agent" containerID="cri-o://f96358180f96673ed535465e5a27c22d217be6620ffe544778e8af58fedd96b4" gracePeriod=30 Mar 16 16:36:21 crc kubenswrapper[5120]: I0316 16:36:21.602830 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:36:21 crc kubenswrapper[5120]: I0316 16:36:21.664553 5120 scope.go:117] "RemoveContainer" containerID="0a15d5caff30dc8885f782e59962af7d98d58b39ab76059e56e5827e10e7ab8b" Mar 16 16:36:21 crc kubenswrapper[5120]: E0316 16:36:21.664972 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:36:21 crc kubenswrapper[5120]: I0316 16:36:21.672020 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:36:21 crc kubenswrapper[5120]: I0316 16:36:21.803045 5120 generic.go:358] "Generic (PLEG): container finished" podID="579eb838-c3c3-42d5-bac1-df49697195f1" containerID="87ab077524744f5ba1ea405c0e9405f23987c77a3137d588309d999859d1f44c" exitCode=0 Mar 16 16:36:21 crc kubenswrapper[5120]: I0316 16:36:21.803403 5120 generic.go:358] "Generic (PLEG): container finished" podID="579eb838-c3c3-42d5-bac1-df49697195f1" containerID="40eee810e5dd4240d04d09a8d96eb6efded23b51060cd70d18574627129f1b12" exitCode=2 Mar 16 16:36:21 crc kubenswrapper[5120]: I0316 16:36:21.803413 5120 generic.go:358] "Generic (PLEG): container finished" podID="579eb838-c3c3-42d5-bac1-df49697195f1" containerID="f96358180f96673ed535465e5a27c22d217be6620ffe544778e8af58fedd96b4" exitCode=0 Mar 16 16:36:21 crc kubenswrapper[5120]: I0316 16:36:21.803420 5120 generic.go:358] "Generic (PLEG): container finished" podID="579eb838-c3c3-42d5-bac1-df49697195f1" containerID="6b88570797a3db9d2d05b1a61c7b26d1fdf425c43a21a2217d8bc252c8923598" exitCode=0 Mar 16 16:36:21 crc kubenswrapper[5120]: I0316 16:36:21.803951 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"579eb838-c3c3-42d5-bac1-df49697195f1","Type":"ContainerDied","Data":"87ab077524744f5ba1ea405c0e9405f23987c77a3137d588309d999859d1f44c"} Mar 16 16:36:21 crc kubenswrapper[5120]: I0316 16:36:21.803985 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"579eb838-c3c3-42d5-bac1-df49697195f1","Type":"ContainerDied","Data":"40eee810e5dd4240d04d09a8d96eb6efded23b51060cd70d18574627129f1b12"} Mar 16 16:36:21 crc kubenswrapper[5120]: I0316 16:36:21.803998 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"579eb838-c3c3-42d5-bac1-df49697195f1","Type":"ContainerDied","Data":"f96358180f96673ed535465e5a27c22d217be6620ffe544778e8af58fedd96b4"} Mar 16 16:36:21 crc kubenswrapper[5120]: I0316 16:36:21.804008 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"579eb838-c3c3-42d5-bac1-df49697195f1","Type":"ContainerDied","Data":"6b88570797a3db9d2d05b1a61c7b26d1fdf425c43a21a2217d8bc252c8923598"} Mar 16 16:36:21 crc kubenswrapper[5120]: I0316 16:36:21.804019 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"579eb838-c3c3-42d5-bac1-df49697195f1","Type":"ContainerDied","Data":"b1d609d20318e14d39ff611b57543d28abd8088bf8d5c847661bec2583ebaf33"} Mar 16 16:36:21 crc kubenswrapper[5120]: I0316 16:36:21.804037 5120 scope.go:117] "RemoveContainer" containerID="87ab077524744f5ba1ea405c0e9405f23987c77a3137d588309d999859d1f44c" Mar 16 16:36:21 crc kubenswrapper[5120]: I0316 16:36:21.804215 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:36:21 crc kubenswrapper[5120]: I0316 16:36:21.809616 5120 generic.go:358] "Generic (PLEG): container finished" podID="2e6d012a-b39a-4bfa-ab56-77bc12e2902e" containerID="ac5a80648ecd4f9c2670c944aefcdce68c3e2f73aa9abcc6d8834733b6b1b99e" exitCode=0 Mar 16 16:36:21 crc kubenswrapper[5120]: I0316 16:36:21.810106 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-4ckj9" event={"ID":"2e6d012a-b39a-4bfa-ab56-77bc12e2902e","Type":"ContainerDied","Data":"ac5a80648ecd4f9c2670c944aefcdce68c3e2f73aa9abcc6d8834733b6b1b99e"} Mar 16 16:36:21 crc kubenswrapper[5120]: I0316 16:36:21.818752 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/579eb838-c3c3-42d5-bac1-df49697195f1-log-httpd\") pod \"579eb838-c3c3-42d5-bac1-df49697195f1\" (UID: \"579eb838-c3c3-42d5-bac1-df49697195f1\") " Mar 16 16:36:21 crc kubenswrapper[5120]: I0316 16:36:21.818854 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/579eb838-c3c3-42d5-bac1-df49697195f1-scripts\") pod \"579eb838-c3c3-42d5-bac1-df49697195f1\" (UID: \"579eb838-c3c3-42d5-bac1-df49697195f1\") " Mar 16 16:36:21 crc kubenswrapper[5120]: I0316 16:36:21.820278 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/579eb838-c3c3-42d5-bac1-df49697195f1-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "579eb838-c3c3-42d5-bac1-df49697195f1" (UID: "579eb838-c3c3-42d5-bac1-df49697195f1"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:36:21 crc kubenswrapper[5120]: I0316 16:36:21.821735 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/579eb838-c3c3-42d5-bac1-df49697195f1-config-data\") pod \"579eb838-c3c3-42d5-bac1-df49697195f1\" (UID: \"579eb838-c3c3-42d5-bac1-df49697195f1\") " Mar 16 16:36:21 crc kubenswrapper[5120]: I0316 16:36:21.822421 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/579eb838-c3c3-42d5-bac1-df49697195f1-sg-core-conf-yaml\") pod \"579eb838-c3c3-42d5-bac1-df49697195f1\" (UID: \"579eb838-c3c3-42d5-bac1-df49697195f1\") " Mar 16 16:36:21 crc kubenswrapper[5120]: I0316 16:36:21.822490 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/579eb838-c3c3-42d5-bac1-df49697195f1-combined-ca-bundle\") pod \"579eb838-c3c3-42d5-bac1-df49697195f1\" (UID: \"579eb838-c3c3-42d5-bac1-df49697195f1\") " Mar 16 16:36:21 crc kubenswrapper[5120]: I0316 16:36:21.822563 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/579eb838-c3c3-42d5-bac1-df49697195f1-run-httpd\") pod \"579eb838-c3c3-42d5-bac1-df49697195f1\" (UID: \"579eb838-c3c3-42d5-bac1-df49697195f1\") " Mar 16 16:36:21 crc kubenswrapper[5120]: I0316 16:36:21.822597 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wx5dl\" (UniqueName: \"kubernetes.io/projected/579eb838-c3c3-42d5-bac1-df49697195f1-kube-api-access-wx5dl\") pod \"579eb838-c3c3-42d5-bac1-df49697195f1\" (UID: \"579eb838-c3c3-42d5-bac1-df49697195f1\") " Mar 16 16:36:21 crc kubenswrapper[5120]: I0316 16:36:21.822880 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/579eb838-c3c3-42d5-bac1-df49697195f1-ceilometer-tls-certs\") pod \"579eb838-c3c3-42d5-bac1-df49697195f1\" (UID: \"579eb838-c3c3-42d5-bac1-df49697195f1\") " Mar 16 16:36:21 crc kubenswrapper[5120]: I0316 16:36:21.825435 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/579eb838-c3c3-42d5-bac1-df49697195f1-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "579eb838-c3c3-42d5-bac1-df49697195f1" (UID: "579eb838-c3c3-42d5-bac1-df49697195f1"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:36:21 crc kubenswrapper[5120]: I0316 16:36:21.827451 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/579eb838-c3c3-42d5-bac1-df49697195f1-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:21 crc kubenswrapper[5120]: I0316 16:36:21.827508 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/579eb838-c3c3-42d5-bac1-df49697195f1-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:21 crc kubenswrapper[5120]: I0316 16:36:21.833930 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/579eb838-c3c3-42d5-bac1-df49697195f1-kube-api-access-wx5dl" (OuterVolumeSpecName: "kube-api-access-wx5dl") pod "579eb838-c3c3-42d5-bac1-df49697195f1" (UID: "579eb838-c3c3-42d5-bac1-df49697195f1"). InnerVolumeSpecName "kube-api-access-wx5dl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:36:21 crc kubenswrapper[5120]: I0316 16:36:21.841906 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/579eb838-c3c3-42d5-bac1-df49697195f1-scripts" (OuterVolumeSpecName: "scripts") pod "579eb838-c3c3-42d5-bac1-df49697195f1" (UID: "579eb838-c3c3-42d5-bac1-df49697195f1"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:36:21 crc kubenswrapper[5120]: I0316 16:36:21.863088 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/579eb838-c3c3-42d5-bac1-df49697195f1-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "579eb838-c3c3-42d5-bac1-df49697195f1" (UID: "579eb838-c3c3-42d5-bac1-df49697195f1"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:36:21 crc kubenswrapper[5120]: I0316 16:36:21.904444 5120 scope.go:117] "RemoveContainer" containerID="40eee810e5dd4240d04d09a8d96eb6efded23b51060cd70d18574627129f1b12" Mar 16 16:36:21 crc kubenswrapper[5120]: I0316 16:36:21.906420 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/579eb838-c3c3-42d5-bac1-df49697195f1-ceilometer-tls-certs" (OuterVolumeSpecName: "ceilometer-tls-certs") pod "579eb838-c3c3-42d5-bac1-df49697195f1" (UID: "579eb838-c3c3-42d5-bac1-df49697195f1"). InnerVolumeSpecName "ceilometer-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:36:21 crc kubenswrapper[5120]: I0316 16:36:21.929653 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/579eb838-c3c3-42d5-bac1-df49697195f1-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:21 crc kubenswrapper[5120]: I0316 16:36:21.929696 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wx5dl\" (UniqueName: \"kubernetes.io/projected/579eb838-c3c3-42d5-bac1-df49697195f1-kube-api-access-wx5dl\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:21 crc kubenswrapper[5120]: I0316 16:36:21.929713 5120 reconciler_common.go:299] "Volume detached for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/579eb838-c3c3-42d5-bac1-df49697195f1-ceilometer-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:21 crc kubenswrapper[5120]: I0316 16:36:21.929725 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/579eb838-c3c3-42d5-bac1-df49697195f1-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:21 crc kubenswrapper[5120]: I0316 16:36:21.930014 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/579eb838-c3c3-42d5-bac1-df49697195f1-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "579eb838-c3c3-42d5-bac1-df49697195f1" (UID: "579eb838-c3c3-42d5-bac1-df49697195f1"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:36:21 crc kubenswrapper[5120]: I0316 16:36:21.954659 5120 scope.go:117] "RemoveContainer" containerID="f96358180f96673ed535465e5a27c22d217be6620ffe544778e8af58fedd96b4" Mar 16 16:36:21 crc kubenswrapper[5120]: I0316 16:36:21.972084 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/579eb838-c3c3-42d5-bac1-df49697195f1-config-data" (OuterVolumeSpecName: "config-data") pod "579eb838-c3c3-42d5-bac1-df49697195f1" (UID: "579eb838-c3c3-42d5-bac1-df49697195f1"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.000495 5120 scope.go:117] "RemoveContainer" containerID="6b88570797a3db9d2d05b1a61c7b26d1fdf425c43a21a2217d8bc252c8923598" Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.021139 5120 scope.go:117] "RemoveContainer" containerID="87ab077524744f5ba1ea405c0e9405f23987c77a3137d588309d999859d1f44c" Mar 16 16:36:22 crc kubenswrapper[5120]: E0316 16:36:22.024884 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"87ab077524744f5ba1ea405c0e9405f23987c77a3137d588309d999859d1f44c\": container with ID starting with 87ab077524744f5ba1ea405c0e9405f23987c77a3137d588309d999859d1f44c not found: ID does not exist" containerID="87ab077524744f5ba1ea405c0e9405f23987c77a3137d588309d999859d1f44c" Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.024941 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87ab077524744f5ba1ea405c0e9405f23987c77a3137d588309d999859d1f44c"} err="failed to get container status \"87ab077524744f5ba1ea405c0e9405f23987c77a3137d588309d999859d1f44c\": rpc error: code = NotFound desc = could not find container \"87ab077524744f5ba1ea405c0e9405f23987c77a3137d588309d999859d1f44c\": container with ID starting with 87ab077524744f5ba1ea405c0e9405f23987c77a3137d588309d999859d1f44c not found: ID does not exist" Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.024973 5120 scope.go:117] "RemoveContainer" containerID="40eee810e5dd4240d04d09a8d96eb6efded23b51060cd70d18574627129f1b12" Mar 16 16:36:22 crc kubenswrapper[5120]: E0316 16:36:22.025455 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"40eee810e5dd4240d04d09a8d96eb6efded23b51060cd70d18574627129f1b12\": container with ID starting with 40eee810e5dd4240d04d09a8d96eb6efded23b51060cd70d18574627129f1b12 not found: ID does not exist" containerID="40eee810e5dd4240d04d09a8d96eb6efded23b51060cd70d18574627129f1b12" Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.025511 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40eee810e5dd4240d04d09a8d96eb6efded23b51060cd70d18574627129f1b12"} err="failed to get container status \"40eee810e5dd4240d04d09a8d96eb6efded23b51060cd70d18574627129f1b12\": rpc error: code = NotFound desc = could not find container \"40eee810e5dd4240d04d09a8d96eb6efded23b51060cd70d18574627129f1b12\": container with ID starting with 40eee810e5dd4240d04d09a8d96eb6efded23b51060cd70d18574627129f1b12 not found: ID does not exist" Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.025543 5120 scope.go:117] "RemoveContainer" containerID="f96358180f96673ed535465e5a27c22d217be6620ffe544778e8af58fedd96b4" Mar 16 16:36:22 crc kubenswrapper[5120]: E0316 16:36:22.029711 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f96358180f96673ed535465e5a27c22d217be6620ffe544778e8af58fedd96b4\": container with ID starting with f96358180f96673ed535465e5a27c22d217be6620ffe544778e8af58fedd96b4 not found: ID does not exist" containerID="f96358180f96673ed535465e5a27c22d217be6620ffe544778e8af58fedd96b4" Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.029778 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f96358180f96673ed535465e5a27c22d217be6620ffe544778e8af58fedd96b4"} err="failed to get container status \"f96358180f96673ed535465e5a27c22d217be6620ffe544778e8af58fedd96b4\": rpc error: code = NotFound desc = could not find container \"f96358180f96673ed535465e5a27c22d217be6620ffe544778e8af58fedd96b4\": container with ID starting with f96358180f96673ed535465e5a27c22d217be6620ffe544778e8af58fedd96b4 not found: ID does not exist" Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.029810 5120 scope.go:117] "RemoveContainer" containerID="6b88570797a3db9d2d05b1a61c7b26d1fdf425c43a21a2217d8bc252c8923598" Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.032221 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/579eb838-c3c3-42d5-bac1-df49697195f1-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.032256 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/579eb838-c3c3-42d5-bac1-df49697195f1-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:22 crc kubenswrapper[5120]: E0316 16:36:22.032491 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b88570797a3db9d2d05b1a61c7b26d1fdf425c43a21a2217d8bc252c8923598\": container with ID starting with 6b88570797a3db9d2d05b1a61c7b26d1fdf425c43a21a2217d8bc252c8923598 not found: ID does not exist" containerID="6b88570797a3db9d2d05b1a61c7b26d1fdf425c43a21a2217d8bc252c8923598" Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.032527 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b88570797a3db9d2d05b1a61c7b26d1fdf425c43a21a2217d8bc252c8923598"} err="failed to get container status \"6b88570797a3db9d2d05b1a61c7b26d1fdf425c43a21a2217d8bc252c8923598\": rpc error: code = NotFound desc = could not find container \"6b88570797a3db9d2d05b1a61c7b26d1fdf425c43a21a2217d8bc252c8923598\": container with ID starting with 6b88570797a3db9d2d05b1a61c7b26d1fdf425c43a21a2217d8bc252c8923598 not found: ID does not exist" Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.032554 5120 scope.go:117] "RemoveContainer" containerID="87ab077524744f5ba1ea405c0e9405f23987c77a3137d588309d999859d1f44c" Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.032890 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87ab077524744f5ba1ea405c0e9405f23987c77a3137d588309d999859d1f44c"} err="failed to get container status \"87ab077524744f5ba1ea405c0e9405f23987c77a3137d588309d999859d1f44c\": rpc error: code = NotFound desc = could not find container \"87ab077524744f5ba1ea405c0e9405f23987c77a3137d588309d999859d1f44c\": container with ID starting with 87ab077524744f5ba1ea405c0e9405f23987c77a3137d588309d999859d1f44c not found: ID does not exist" Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.032919 5120 scope.go:117] "RemoveContainer" containerID="40eee810e5dd4240d04d09a8d96eb6efded23b51060cd70d18574627129f1b12" Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.033295 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40eee810e5dd4240d04d09a8d96eb6efded23b51060cd70d18574627129f1b12"} err="failed to get container status \"40eee810e5dd4240d04d09a8d96eb6efded23b51060cd70d18574627129f1b12\": rpc error: code = NotFound desc = could not find container \"40eee810e5dd4240d04d09a8d96eb6efded23b51060cd70d18574627129f1b12\": container with ID starting with 40eee810e5dd4240d04d09a8d96eb6efded23b51060cd70d18574627129f1b12 not found: ID does not exist" Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.033322 5120 scope.go:117] "RemoveContainer" containerID="f96358180f96673ed535465e5a27c22d217be6620ffe544778e8af58fedd96b4" Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.033567 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f96358180f96673ed535465e5a27c22d217be6620ffe544778e8af58fedd96b4"} err="failed to get container status \"f96358180f96673ed535465e5a27c22d217be6620ffe544778e8af58fedd96b4\": rpc error: code = NotFound desc = could not find container \"f96358180f96673ed535465e5a27c22d217be6620ffe544778e8af58fedd96b4\": container with ID starting with f96358180f96673ed535465e5a27c22d217be6620ffe544778e8af58fedd96b4 not found: ID does not exist" Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.033599 5120 scope.go:117] "RemoveContainer" containerID="6b88570797a3db9d2d05b1a61c7b26d1fdf425c43a21a2217d8bc252c8923598" Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.033843 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b88570797a3db9d2d05b1a61c7b26d1fdf425c43a21a2217d8bc252c8923598"} err="failed to get container status \"6b88570797a3db9d2d05b1a61c7b26d1fdf425c43a21a2217d8bc252c8923598\": rpc error: code = NotFound desc = could not find container \"6b88570797a3db9d2d05b1a61c7b26d1fdf425c43a21a2217d8bc252c8923598\": container with ID starting with 6b88570797a3db9d2d05b1a61c7b26d1fdf425c43a21a2217d8bc252c8923598 not found: ID does not exist" Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.033870 5120 scope.go:117] "RemoveContainer" containerID="87ab077524744f5ba1ea405c0e9405f23987c77a3137d588309d999859d1f44c" Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.034110 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87ab077524744f5ba1ea405c0e9405f23987c77a3137d588309d999859d1f44c"} err="failed to get container status \"87ab077524744f5ba1ea405c0e9405f23987c77a3137d588309d999859d1f44c\": rpc error: code = NotFound desc = could not find container \"87ab077524744f5ba1ea405c0e9405f23987c77a3137d588309d999859d1f44c\": container with ID starting with 87ab077524744f5ba1ea405c0e9405f23987c77a3137d588309d999859d1f44c not found: ID does not exist" Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.034144 5120 scope.go:117] "RemoveContainer" containerID="40eee810e5dd4240d04d09a8d96eb6efded23b51060cd70d18574627129f1b12" Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.034360 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40eee810e5dd4240d04d09a8d96eb6efded23b51060cd70d18574627129f1b12"} err="failed to get container status \"40eee810e5dd4240d04d09a8d96eb6efded23b51060cd70d18574627129f1b12\": rpc error: code = NotFound desc = could not find container \"40eee810e5dd4240d04d09a8d96eb6efded23b51060cd70d18574627129f1b12\": container with ID starting with 40eee810e5dd4240d04d09a8d96eb6efded23b51060cd70d18574627129f1b12 not found: ID does not exist" Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.034389 5120 scope.go:117] "RemoveContainer" containerID="f96358180f96673ed535465e5a27c22d217be6620ffe544778e8af58fedd96b4" Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.034612 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f96358180f96673ed535465e5a27c22d217be6620ffe544778e8af58fedd96b4"} err="failed to get container status \"f96358180f96673ed535465e5a27c22d217be6620ffe544778e8af58fedd96b4\": rpc error: code = NotFound desc = could not find container \"f96358180f96673ed535465e5a27c22d217be6620ffe544778e8af58fedd96b4\": container with ID starting with f96358180f96673ed535465e5a27c22d217be6620ffe544778e8af58fedd96b4 not found: ID does not exist" Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.034643 5120 scope.go:117] "RemoveContainer" containerID="6b88570797a3db9d2d05b1a61c7b26d1fdf425c43a21a2217d8bc252c8923598" Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.035167 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b88570797a3db9d2d05b1a61c7b26d1fdf425c43a21a2217d8bc252c8923598"} err="failed to get container status \"6b88570797a3db9d2d05b1a61c7b26d1fdf425c43a21a2217d8bc252c8923598\": rpc error: code = NotFound desc = could not find container \"6b88570797a3db9d2d05b1a61c7b26d1fdf425c43a21a2217d8bc252c8923598\": container with ID starting with 6b88570797a3db9d2d05b1a61c7b26d1fdf425c43a21a2217d8bc252c8923598 not found: ID does not exist" Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.035192 5120 scope.go:117] "RemoveContainer" containerID="87ab077524744f5ba1ea405c0e9405f23987c77a3137d588309d999859d1f44c" Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.035408 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87ab077524744f5ba1ea405c0e9405f23987c77a3137d588309d999859d1f44c"} err="failed to get container status \"87ab077524744f5ba1ea405c0e9405f23987c77a3137d588309d999859d1f44c\": rpc error: code = NotFound desc = could not find container \"87ab077524744f5ba1ea405c0e9405f23987c77a3137d588309d999859d1f44c\": container with ID starting with 87ab077524744f5ba1ea405c0e9405f23987c77a3137d588309d999859d1f44c not found: ID does not exist" Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.035428 5120 scope.go:117] "RemoveContainer" containerID="40eee810e5dd4240d04d09a8d96eb6efded23b51060cd70d18574627129f1b12" Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.035721 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40eee810e5dd4240d04d09a8d96eb6efded23b51060cd70d18574627129f1b12"} err="failed to get container status \"40eee810e5dd4240d04d09a8d96eb6efded23b51060cd70d18574627129f1b12\": rpc error: code = NotFound desc = could not find container \"40eee810e5dd4240d04d09a8d96eb6efded23b51060cd70d18574627129f1b12\": container with ID starting with 40eee810e5dd4240d04d09a8d96eb6efded23b51060cd70d18574627129f1b12 not found: ID does not exist" Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.035742 5120 scope.go:117] "RemoveContainer" containerID="f96358180f96673ed535465e5a27c22d217be6620ffe544778e8af58fedd96b4" Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.036010 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f96358180f96673ed535465e5a27c22d217be6620ffe544778e8af58fedd96b4"} err="failed to get container status \"f96358180f96673ed535465e5a27c22d217be6620ffe544778e8af58fedd96b4\": rpc error: code = NotFound desc = could not find container \"f96358180f96673ed535465e5a27c22d217be6620ffe544778e8af58fedd96b4\": container with ID starting with f96358180f96673ed535465e5a27c22d217be6620ffe544778e8af58fedd96b4 not found: ID does not exist" Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.036036 5120 scope.go:117] "RemoveContainer" containerID="6b88570797a3db9d2d05b1a61c7b26d1fdf425c43a21a2217d8bc252c8923598" Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.036233 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b88570797a3db9d2d05b1a61c7b26d1fdf425c43a21a2217d8bc252c8923598"} err="failed to get container status \"6b88570797a3db9d2d05b1a61c7b26d1fdf425c43a21a2217d8bc252c8923598\": rpc error: code = NotFound desc = could not find container \"6b88570797a3db9d2d05b1a61c7b26d1fdf425c43a21a2217d8bc252c8923598\": container with ID starting with 6b88570797a3db9d2d05b1a61c7b26d1fdf425c43a21a2217d8bc252c8923598 not found: ID does not exist" Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.206994 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-r8627" Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.245186 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.268916 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.277541 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.278987 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="579eb838-c3c3-42d5-bac1-df49697195f1" containerName="sg-core" Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.279012 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="579eb838-c3c3-42d5-bac1-df49697195f1" containerName="sg-core" Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.279029 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="579eb838-c3c3-42d5-bac1-df49697195f1" containerName="ceilometer-notification-agent" Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.279037 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="579eb838-c3c3-42d5-bac1-df49697195f1" containerName="ceilometer-notification-agent" Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.279063 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ccbf25a-f71f-4428-ac40-883041c2b302" containerName="swift-ring-rebalance" Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.279070 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ccbf25a-f71f-4428-ac40-883041c2b302" containerName="swift-ring-rebalance" Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.279081 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="579eb838-c3c3-42d5-bac1-df49697195f1" containerName="proxy-httpd" Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.279086 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="579eb838-c3c3-42d5-bac1-df49697195f1" containerName="proxy-httpd" Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.279139 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b9d0a58-9639-4577-9b99-d34345657929" containerName="neutron-db-sync" Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.279147 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b9d0a58-9639-4577-9b99-d34345657929" containerName="neutron-db-sync" Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.279159 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="579eb838-c3c3-42d5-bac1-df49697195f1" containerName="ceilometer-central-agent" Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.279165 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="579eb838-c3c3-42d5-bac1-df49697195f1" containerName="ceilometer-central-agent" Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.279361 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1b9d0a58-9639-4577-9b99-d34345657929" containerName="neutron-db-sync" Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.279377 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="579eb838-c3c3-42d5-bac1-df49697195f1" containerName="ceilometer-central-agent" Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.279391 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="579eb838-c3c3-42d5-bac1-df49697195f1" containerName="proxy-httpd" Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.279410 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="579eb838-c3c3-42d5-bac1-df49697195f1" containerName="ceilometer-notification-agent" Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.279425 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="579eb838-c3c3-42d5-bac1-df49697195f1" containerName="sg-core" Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.279436 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1ccbf25a-f71f-4428-ac40-883041c2b302" containerName="swift-ring-rebalance" Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.321362 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.321548 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.325021 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ceilometer-internal-svc\"" Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.325325 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.326814 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.343155 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1b9d0a58-9639-4577-9b99-d34345657929-combined-ca-bundle\") pod \"1b9d0a58-9639-4577-9b99-d34345657929\" (UID: \"1b9d0a58-9639-4577-9b99-d34345657929\") " Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.343391 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5ltjl\" (UniqueName: \"kubernetes.io/projected/1b9d0a58-9639-4577-9b99-d34345657929-kube-api-access-5ltjl\") pod \"1b9d0a58-9639-4577-9b99-d34345657929\" (UID: \"1b9d0a58-9639-4577-9b99-d34345657929\") " Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.343853 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1b9d0a58-9639-4577-9b99-d34345657929-config\") pod \"1b9d0a58-9639-4577-9b99-d34345657929\" (UID: \"1b9d0a58-9639-4577-9b99-d34345657929\") " Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.348574 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-d42sq" Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.369269 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b9d0a58-9639-4577-9b99-d34345657929-kube-api-access-5ltjl" (OuterVolumeSpecName: "kube-api-access-5ltjl") pod "1b9d0a58-9639-4577-9b99-d34345657929" (UID: "1b9d0a58-9639-4577-9b99-d34345657929"). InnerVolumeSpecName "kube-api-access-5ltjl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.373181 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1b9d0a58-9639-4577-9b99-d34345657929-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "1b9d0a58-9639-4577-9b99-d34345657929" (UID: "1b9d0a58-9639-4577-9b99-d34345657929"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.386611 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1b9d0a58-9639-4577-9b99-d34345657929-config" (OuterVolumeSpecName: "config") pod "1b9d0a58-9639-4577-9b99-d34345657929" (UID: "1b9d0a58-9639-4577-9b99-d34345657929"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.445642 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/7ecbc5c7-9802-4143-bba3-6552d5b8e3ba-etc-machine-id\") pod \"7ecbc5c7-9802-4143-bba3-6552d5b8e3ba\" (UID: \"7ecbc5c7-9802-4143-bba3-6552d5b8e3ba\") " Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.445705 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z6pj5\" (UniqueName: \"kubernetes.io/projected/7ecbc5c7-9802-4143-bba3-6552d5b8e3ba-kube-api-access-z6pj5\") pod \"7ecbc5c7-9802-4143-bba3-6552d5b8e3ba\" (UID: \"7ecbc5c7-9802-4143-bba3-6552d5b8e3ba\") " Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.445749 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7ecbc5c7-9802-4143-bba3-6552d5b8e3ba-config-data\") pod \"7ecbc5c7-9802-4143-bba3-6552d5b8e3ba\" (UID: \"7ecbc5c7-9802-4143-bba3-6552d5b8e3ba\") " Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.445868 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7ecbc5c7-9802-4143-bba3-6552d5b8e3ba-combined-ca-bundle\") pod \"7ecbc5c7-9802-4143-bba3-6552d5b8e3ba\" (UID: \"7ecbc5c7-9802-4143-bba3-6552d5b8e3ba\") " Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.446137 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/7ecbc5c7-9802-4143-bba3-6552d5b8e3ba-db-sync-config-data\") pod \"7ecbc5c7-9802-4143-bba3-6552d5b8e3ba\" (UID: \"7ecbc5c7-9802-4143-bba3-6552d5b8e3ba\") " Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.446167 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7ecbc5c7-9802-4143-bba3-6552d5b8e3ba-scripts\") pod \"7ecbc5c7-9802-4143-bba3-6552d5b8e3ba\" (UID: \"7ecbc5c7-9802-4143-bba3-6552d5b8e3ba\") " Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.446373 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/204ff621-b59e-44f0-84a5-c9e4eaaf86bf-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"204ff621-b59e-44f0-84a5-c9e4eaaf86bf\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.446437 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/204ff621-b59e-44f0-84a5-c9e4eaaf86bf-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"204ff621-b59e-44f0-84a5-c9e4eaaf86bf\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.446453 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mkqs\" (UniqueName: \"kubernetes.io/projected/204ff621-b59e-44f0-84a5-c9e4eaaf86bf-kube-api-access-4mkqs\") pod \"ceilometer-0\" (UID: \"204ff621-b59e-44f0-84a5-c9e4eaaf86bf\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.446550 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/204ff621-b59e-44f0-84a5-c9e4eaaf86bf-scripts\") pod \"ceilometer-0\" (UID: \"204ff621-b59e-44f0-84a5-c9e4eaaf86bf\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.446626 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/204ff621-b59e-44f0-84a5-c9e4eaaf86bf-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"204ff621-b59e-44f0-84a5-c9e4eaaf86bf\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.446656 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/204ff621-b59e-44f0-84a5-c9e4eaaf86bf-log-httpd\") pod \"ceilometer-0\" (UID: \"204ff621-b59e-44f0-84a5-c9e4eaaf86bf\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.446682 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/204ff621-b59e-44f0-84a5-c9e4eaaf86bf-run-httpd\") pod \"ceilometer-0\" (UID: \"204ff621-b59e-44f0-84a5-c9e4eaaf86bf\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.446773 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/204ff621-b59e-44f0-84a5-c9e4eaaf86bf-config-data\") pod \"ceilometer-0\" (UID: \"204ff621-b59e-44f0-84a5-c9e4eaaf86bf\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.446905 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1b9d0a58-9639-4577-9b99-d34345657929-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.446921 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5ltjl\" (UniqueName: \"kubernetes.io/projected/1b9d0a58-9639-4577-9b99-d34345657929-kube-api-access-5ltjl\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.446931 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/1b9d0a58-9639-4577-9b99-d34345657929-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.446992 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/7ecbc5c7-9802-4143-bba3-6552d5b8e3ba-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "7ecbc5c7-9802-4143-bba3-6552d5b8e3ba" (UID: "7ecbc5c7-9802-4143-bba3-6552d5b8e3ba"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.451256 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7ecbc5c7-9802-4143-bba3-6552d5b8e3ba-db-sync-config-data" (OuterVolumeSpecName: "db-sync-config-data") pod "7ecbc5c7-9802-4143-bba3-6552d5b8e3ba" (UID: "7ecbc5c7-9802-4143-bba3-6552d5b8e3ba"). InnerVolumeSpecName "db-sync-config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.451748 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7ecbc5c7-9802-4143-bba3-6552d5b8e3ba-scripts" (OuterVolumeSpecName: "scripts") pod "7ecbc5c7-9802-4143-bba3-6552d5b8e3ba" (UID: "7ecbc5c7-9802-4143-bba3-6552d5b8e3ba"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.453242 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ecbc5c7-9802-4143-bba3-6552d5b8e3ba-kube-api-access-z6pj5" (OuterVolumeSpecName: "kube-api-access-z6pj5") pod "7ecbc5c7-9802-4143-bba3-6552d5b8e3ba" (UID: "7ecbc5c7-9802-4143-bba3-6552d5b8e3ba"). InnerVolumeSpecName "kube-api-access-z6pj5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.474688 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7ecbc5c7-9802-4143-bba3-6552d5b8e3ba-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "7ecbc5c7-9802-4143-bba3-6552d5b8e3ba" (UID: "7ecbc5c7-9802-4143-bba3-6552d5b8e3ba"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.500290 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7ecbc5c7-9802-4143-bba3-6552d5b8e3ba-config-data" (OuterVolumeSpecName: "config-data") pod "7ecbc5c7-9802-4143-bba3-6552d5b8e3ba" (UID: "7ecbc5c7-9802-4143-bba3-6552d5b8e3ba"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.532440 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.549020 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/204ff621-b59e-44f0-84a5-c9e4eaaf86bf-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"204ff621-b59e-44f0-84a5-c9e4eaaf86bf\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.549141 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/204ff621-b59e-44f0-84a5-c9e4eaaf86bf-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"204ff621-b59e-44f0-84a5-c9e4eaaf86bf\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.549173 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4mkqs\" (UniqueName: \"kubernetes.io/projected/204ff621-b59e-44f0-84a5-c9e4eaaf86bf-kube-api-access-4mkqs\") pod \"ceilometer-0\" (UID: \"204ff621-b59e-44f0-84a5-c9e4eaaf86bf\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.549335 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/204ff621-b59e-44f0-84a5-c9e4eaaf86bf-scripts\") pod \"ceilometer-0\" (UID: \"204ff621-b59e-44f0-84a5-c9e4eaaf86bf\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.549440 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/204ff621-b59e-44f0-84a5-c9e4eaaf86bf-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"204ff621-b59e-44f0-84a5-c9e4eaaf86bf\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.549494 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/204ff621-b59e-44f0-84a5-c9e4eaaf86bf-log-httpd\") pod \"ceilometer-0\" (UID: \"204ff621-b59e-44f0-84a5-c9e4eaaf86bf\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.549535 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/204ff621-b59e-44f0-84a5-c9e4eaaf86bf-run-httpd\") pod \"ceilometer-0\" (UID: \"204ff621-b59e-44f0-84a5-c9e4eaaf86bf\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.549646 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/204ff621-b59e-44f0-84a5-c9e4eaaf86bf-config-data\") pod \"ceilometer-0\" (UID: \"204ff621-b59e-44f0-84a5-c9e4eaaf86bf\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.549846 5120 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/7ecbc5c7-9802-4143-bba3-6552d5b8e3ba-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.549868 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z6pj5\" (UniqueName: \"kubernetes.io/projected/7ecbc5c7-9802-4143-bba3-6552d5b8e3ba-kube-api-access-z6pj5\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.549883 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7ecbc5c7-9802-4143-bba3-6552d5b8e3ba-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.549894 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7ecbc5c7-9802-4143-bba3-6552d5b8e3ba-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.549905 5120 reconciler_common.go:299] "Volume detached for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/7ecbc5c7-9802-4143-bba3-6552d5b8e3ba-db-sync-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.549915 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7ecbc5c7-9802-4143-bba3-6552d5b8e3ba-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.552361 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/204ff621-b59e-44f0-84a5-c9e4eaaf86bf-log-httpd\") pod \"ceilometer-0\" (UID: \"204ff621-b59e-44f0-84a5-c9e4eaaf86bf\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.552611 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/204ff621-b59e-44f0-84a5-c9e4eaaf86bf-run-httpd\") pod \"ceilometer-0\" (UID: \"204ff621-b59e-44f0-84a5-c9e4eaaf86bf\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.555740 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/204ff621-b59e-44f0-84a5-c9e4eaaf86bf-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"204ff621-b59e-44f0-84a5-c9e4eaaf86bf\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.555741 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/204ff621-b59e-44f0-84a5-c9e4eaaf86bf-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"204ff621-b59e-44f0-84a5-c9e4eaaf86bf\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.555964 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/204ff621-b59e-44f0-84a5-c9e4eaaf86bf-scripts\") pod \"ceilometer-0\" (UID: \"204ff621-b59e-44f0-84a5-c9e4eaaf86bf\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.556600 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/204ff621-b59e-44f0-84a5-c9e4eaaf86bf-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"204ff621-b59e-44f0-84a5-c9e4eaaf86bf\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.564026 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/204ff621-b59e-44f0-84a5-c9e4eaaf86bf-config-data\") pod \"ceilometer-0\" (UID: \"204ff621-b59e-44f0-84a5-c9e4eaaf86bf\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.570723 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mkqs\" (UniqueName: \"kubernetes.io/projected/204ff621-b59e-44f0-84a5-c9e4eaaf86bf-kube-api-access-4mkqs\") pod \"ceilometer-0\" (UID: \"204ff621-b59e-44f0-84a5-c9e4eaaf86bf\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.674686 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="579eb838-c3c3-42d5-bac1-df49697195f1" path="/var/lib/kubelet/pods/579eb838-c3c3-42d5-bac1-df49697195f1/volumes" Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.676076 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.698713 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.853391 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-r8627" event={"ID":"1b9d0a58-9639-4577-9b99-d34345657929","Type":"ContainerDied","Data":"ef734edf4d11c23060843c1cffe2dfb6dfe3cf94314d828dcf60d85936dffb88"} Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.853460 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ef734edf4d11c23060843c1cffe2dfb6dfe3cf94314d828dcf60d85936dffb88" Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.853575 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-r8627" Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.859628 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-d42sq" event={"ID":"7ecbc5c7-9802-4143-bba3-6552d5b8e3ba","Type":"ContainerDied","Data":"93808c35a462dbda60181ff80956adc7a66441544333b09c336f585d91690965"} Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.859671 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="93808c35a462dbda60181ff80956adc7a66441544333b09c336f585d91690965" Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.859737 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-d42sq" Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.864523 5120 generic.go:358] "Generic (PLEG): container finished" podID="91d6af93-90b1-4d80-86df-11a701664a68" containerID="51a9e72749469a4f7a85f36e4d05b97332822e031201c75e32f8aeca6440579f" exitCode=0 Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.864977 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-b5trh" event={"ID":"91d6af93-90b1-4d80-86df-11a701664a68","Type":"ContainerDied","Data":"51a9e72749469a4f7a85f36e4d05b97332822e031201c75e32f8aeca6440579f"} Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.972064 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.975289 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="63d9a98c-175f-4caa-bd33-41eb82d6e06b" containerName="cinder-scheduler" containerID="cri-o://e33584a62e63e94b8ee772c464bae71158a771a227951bc7d1483783fd437d31" gracePeriod=30 Mar 16 16:36:22 crc kubenswrapper[5120]: I0316 16:36:22.982034 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="63d9a98c-175f-4caa-bd33-41eb82d6e06b" containerName="probe" containerID="cri-o://597efc0dd871c2e1f82f46bb284d3a25d9d02fb8817ac7c029ec870416fbaef4" gracePeriod=30 Mar 16 16:36:23 crc kubenswrapper[5120]: I0316 16:36:23.009695 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-8bf565768-57qhf"] Mar 16 16:36:23 crc kubenswrapper[5120]: I0316 16:36:23.011139 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ecbc5c7-9802-4143-bba3-6552d5b8e3ba" containerName="cinder-db-sync" Mar 16 16:36:23 crc kubenswrapper[5120]: I0316 16:36:23.011159 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ecbc5c7-9802-4143-bba3-6552d5b8e3ba" containerName="cinder-db-sync" Mar 16 16:36:23 crc kubenswrapper[5120]: I0316 16:36:23.011463 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7ecbc5c7-9802-4143-bba3-6552d5b8e3ba" containerName="cinder-db-sync" Mar 16 16:36:23 crc kubenswrapper[5120]: I0316 16:36:23.019644 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-8bf565768-57qhf" Mar 16 16:36:23 crc kubenswrapper[5120]: I0316 16:36:23.036835 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-8bf565768-57qhf"] Mar 16 16:36:23 crc kubenswrapper[5120]: I0316 16:36:23.056976 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:36:23 crc kubenswrapper[5120]: I0316 16:36:23.057330 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="e8ee374e-6e54-498b-9c76-2ea7caf3cad8" containerName="cinder-api-log" containerID="cri-o://293a8c9b65d2dc593bd393e16d6b5dfe15f0954f1386ecb80ce43bc0943e1af4" gracePeriod=30 Mar 16 16:36:23 crc kubenswrapper[5120]: I0316 16:36:23.057605 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="e8ee374e-6e54-498b-9c76-2ea7caf3cad8" containerName="cinder-api" containerID="cri-o://127258b57c230c7843d8cc012a76f9e30a721fab3cab2462fbdac98abf8f8ae9" gracePeriod=30 Mar 16 16:36:23 crc kubenswrapper[5120]: I0316 16:36:23.071388 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/cinder-api-0" podUID="e8ee374e-6e54-498b-9c76-2ea7caf3cad8" containerName="cinder-api" probeResult="failure" output="Get \"https://10.217.0.162:8776/healthcheck\": EOF" Mar 16 16:36:23 crc kubenswrapper[5120]: I0316 16:36:23.172742 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b21fb0d1-eae4-4ac7-b3fe-6b62df9f6453-config\") pod \"neutron-8bf565768-57qhf\" (UID: \"b21fb0d1-eae4-4ac7-b3fe-6b62df9f6453\") " pod="openstack-kuttl-tests/neutron-8bf565768-57qhf" Mar 16 16:36:23 crc kubenswrapper[5120]: I0316 16:36:23.173021 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sq5s4\" (UniqueName: \"kubernetes.io/projected/b21fb0d1-eae4-4ac7-b3fe-6b62df9f6453-kube-api-access-sq5s4\") pod \"neutron-8bf565768-57qhf\" (UID: \"b21fb0d1-eae4-4ac7-b3fe-6b62df9f6453\") " pod="openstack-kuttl-tests/neutron-8bf565768-57qhf" Mar 16 16:36:23 crc kubenswrapper[5120]: I0316 16:36:23.173188 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/b21fb0d1-eae4-4ac7-b3fe-6b62df9f6453-httpd-config\") pod \"neutron-8bf565768-57qhf\" (UID: \"b21fb0d1-eae4-4ac7-b3fe-6b62df9f6453\") " pod="openstack-kuttl-tests/neutron-8bf565768-57qhf" Mar 16 16:36:23 crc kubenswrapper[5120]: I0316 16:36:23.173279 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/b21fb0d1-eae4-4ac7-b3fe-6b62df9f6453-ovndb-tls-certs\") pod \"neutron-8bf565768-57qhf\" (UID: \"b21fb0d1-eae4-4ac7-b3fe-6b62df9f6453\") " pod="openstack-kuttl-tests/neutron-8bf565768-57qhf" Mar 16 16:36:23 crc kubenswrapper[5120]: I0316 16:36:23.173368 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b21fb0d1-eae4-4ac7-b3fe-6b62df9f6453-combined-ca-bundle\") pod \"neutron-8bf565768-57qhf\" (UID: \"b21fb0d1-eae4-4ac7-b3fe-6b62df9f6453\") " pod="openstack-kuttl-tests/neutron-8bf565768-57qhf" Mar 16 16:36:23 crc kubenswrapper[5120]: I0316 16:36:23.173421 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/b21fb0d1-eae4-4ac7-b3fe-6b62df9f6453-internal-tls-certs\") pod \"neutron-8bf565768-57qhf\" (UID: \"b21fb0d1-eae4-4ac7-b3fe-6b62df9f6453\") " pod="openstack-kuttl-tests/neutron-8bf565768-57qhf" Mar 16 16:36:23 crc kubenswrapper[5120]: I0316 16:36:23.173466 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/b21fb0d1-eae4-4ac7-b3fe-6b62df9f6453-public-tls-certs\") pod \"neutron-8bf565768-57qhf\" (UID: \"b21fb0d1-eae4-4ac7-b3fe-6b62df9f6453\") " pod="openstack-kuttl-tests/neutron-8bf565768-57qhf" Mar 16 16:36:23 crc kubenswrapper[5120]: I0316 16:36:23.275627 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:36:23 crc kubenswrapper[5120]: I0316 16:36:23.275676 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b21fb0d1-eae4-4ac7-b3fe-6b62df9f6453-config\") pod \"neutron-8bf565768-57qhf\" (UID: \"b21fb0d1-eae4-4ac7-b3fe-6b62df9f6453\") " pod="openstack-kuttl-tests/neutron-8bf565768-57qhf" Mar 16 16:36:23 crc kubenswrapper[5120]: I0316 16:36:23.275838 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sq5s4\" (UniqueName: \"kubernetes.io/projected/b21fb0d1-eae4-4ac7-b3fe-6b62df9f6453-kube-api-access-sq5s4\") pod \"neutron-8bf565768-57qhf\" (UID: \"b21fb0d1-eae4-4ac7-b3fe-6b62df9f6453\") " pod="openstack-kuttl-tests/neutron-8bf565768-57qhf" Mar 16 16:36:23 crc kubenswrapper[5120]: I0316 16:36:23.275914 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/b21fb0d1-eae4-4ac7-b3fe-6b62df9f6453-httpd-config\") pod \"neutron-8bf565768-57qhf\" (UID: \"b21fb0d1-eae4-4ac7-b3fe-6b62df9f6453\") " pod="openstack-kuttl-tests/neutron-8bf565768-57qhf" Mar 16 16:36:23 crc kubenswrapper[5120]: I0316 16:36:23.275953 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/b21fb0d1-eae4-4ac7-b3fe-6b62df9f6453-ovndb-tls-certs\") pod \"neutron-8bf565768-57qhf\" (UID: \"b21fb0d1-eae4-4ac7-b3fe-6b62df9f6453\") " pod="openstack-kuttl-tests/neutron-8bf565768-57qhf" Mar 16 16:36:23 crc kubenswrapper[5120]: I0316 16:36:23.276009 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b21fb0d1-eae4-4ac7-b3fe-6b62df9f6453-combined-ca-bundle\") pod \"neutron-8bf565768-57qhf\" (UID: \"b21fb0d1-eae4-4ac7-b3fe-6b62df9f6453\") " pod="openstack-kuttl-tests/neutron-8bf565768-57qhf" Mar 16 16:36:23 crc kubenswrapper[5120]: I0316 16:36:23.276042 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/b21fb0d1-eae4-4ac7-b3fe-6b62df9f6453-internal-tls-certs\") pod \"neutron-8bf565768-57qhf\" (UID: \"b21fb0d1-eae4-4ac7-b3fe-6b62df9f6453\") " pod="openstack-kuttl-tests/neutron-8bf565768-57qhf" Mar 16 16:36:23 crc kubenswrapper[5120]: I0316 16:36:23.276078 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/b21fb0d1-eae4-4ac7-b3fe-6b62df9f6453-public-tls-certs\") pod \"neutron-8bf565768-57qhf\" (UID: \"b21fb0d1-eae4-4ac7-b3fe-6b62df9f6453\") " pod="openstack-kuttl-tests/neutron-8bf565768-57qhf" Mar 16 16:36:23 crc kubenswrapper[5120]: I0316 16:36:23.282666 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/b21fb0d1-eae4-4ac7-b3fe-6b62df9f6453-config\") pod \"neutron-8bf565768-57qhf\" (UID: \"b21fb0d1-eae4-4ac7-b3fe-6b62df9f6453\") " pod="openstack-kuttl-tests/neutron-8bf565768-57qhf" Mar 16 16:36:23 crc kubenswrapper[5120]: I0316 16:36:23.283213 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/b21fb0d1-eae4-4ac7-b3fe-6b62df9f6453-public-tls-certs\") pod \"neutron-8bf565768-57qhf\" (UID: \"b21fb0d1-eae4-4ac7-b3fe-6b62df9f6453\") " pod="openstack-kuttl-tests/neutron-8bf565768-57qhf" Mar 16 16:36:23 crc kubenswrapper[5120]: I0316 16:36:23.283510 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/b21fb0d1-eae4-4ac7-b3fe-6b62df9f6453-ovndb-tls-certs\") pod \"neutron-8bf565768-57qhf\" (UID: \"b21fb0d1-eae4-4ac7-b3fe-6b62df9f6453\") " pod="openstack-kuttl-tests/neutron-8bf565768-57qhf" Mar 16 16:36:23 crc kubenswrapper[5120]: I0316 16:36:23.285557 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/b21fb0d1-eae4-4ac7-b3fe-6b62df9f6453-httpd-config\") pod \"neutron-8bf565768-57qhf\" (UID: \"b21fb0d1-eae4-4ac7-b3fe-6b62df9f6453\") " pod="openstack-kuttl-tests/neutron-8bf565768-57qhf" Mar 16 16:36:23 crc kubenswrapper[5120]: I0316 16:36:23.293649 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/b21fb0d1-eae4-4ac7-b3fe-6b62df9f6453-internal-tls-certs\") pod \"neutron-8bf565768-57qhf\" (UID: \"b21fb0d1-eae4-4ac7-b3fe-6b62df9f6453\") " pod="openstack-kuttl-tests/neutron-8bf565768-57qhf" Mar 16 16:36:23 crc kubenswrapper[5120]: I0316 16:36:23.303016 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b21fb0d1-eae4-4ac7-b3fe-6b62df9f6453-combined-ca-bundle\") pod \"neutron-8bf565768-57qhf\" (UID: \"b21fb0d1-eae4-4ac7-b3fe-6b62df9f6453\") " pod="openstack-kuttl-tests/neutron-8bf565768-57qhf" Mar 16 16:36:23 crc kubenswrapper[5120]: I0316 16:36:23.304562 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sq5s4\" (UniqueName: \"kubernetes.io/projected/b21fb0d1-eae4-4ac7-b3fe-6b62df9f6453-kube-api-access-sq5s4\") pod \"neutron-8bf565768-57qhf\" (UID: \"b21fb0d1-eae4-4ac7-b3fe-6b62df9f6453\") " pod="openstack-kuttl-tests/neutron-8bf565768-57qhf" Mar 16 16:36:23 crc kubenswrapper[5120]: I0316 16:36:23.358241 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-8bf565768-57qhf" Mar 16 16:36:23 crc kubenswrapper[5120]: W0316 16:36:23.369275 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod204ff621_b59e_44f0_84a5_c9e4eaaf86bf.slice/crio-a4f0f47792c541bbdfdc4aa02957d9f5d001f8eb68aad9f21183153a7f7350eb WatchSource:0}: Error finding container a4f0f47792c541bbdfdc4aa02957d9f5d001f8eb68aad9f21183153a7f7350eb: Status 404 returned error can't find the container with id a4f0f47792c541bbdfdc4aa02957d9f5d001f8eb68aad9f21183153a7f7350eb Mar 16 16:36:23 crc kubenswrapper[5120]: I0316 16:36:23.423231 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-4ckj9" Mar 16 16:36:23 crc kubenswrapper[5120]: I0316 16:36:23.583393 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2e6d012a-b39a-4bfa-ab56-77bc12e2902e-scripts\") pod \"2e6d012a-b39a-4bfa-ab56-77bc12e2902e\" (UID: \"2e6d012a-b39a-4bfa-ab56-77bc12e2902e\") " Mar 16 16:36:23 crc kubenswrapper[5120]: I0316 16:36:23.583496 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2e6d012a-b39a-4bfa-ab56-77bc12e2902e-config-data\") pod \"2e6d012a-b39a-4bfa-ab56-77bc12e2902e\" (UID: \"2e6d012a-b39a-4bfa-ab56-77bc12e2902e\") " Mar 16 16:36:23 crc kubenswrapper[5120]: I0316 16:36:23.584162 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rcvkx\" (UniqueName: \"kubernetes.io/projected/2e6d012a-b39a-4bfa-ab56-77bc12e2902e-kube-api-access-rcvkx\") pod \"2e6d012a-b39a-4bfa-ab56-77bc12e2902e\" (UID: \"2e6d012a-b39a-4bfa-ab56-77bc12e2902e\") " Mar 16 16:36:23 crc kubenswrapper[5120]: I0316 16:36:23.584241 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2e6d012a-b39a-4bfa-ab56-77bc12e2902e-combined-ca-bundle\") pod \"2e6d012a-b39a-4bfa-ab56-77bc12e2902e\" (UID: \"2e6d012a-b39a-4bfa-ab56-77bc12e2902e\") " Mar 16 16:36:23 crc kubenswrapper[5120]: I0316 16:36:23.589941 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e6d012a-b39a-4bfa-ab56-77bc12e2902e-scripts" (OuterVolumeSpecName: "scripts") pod "2e6d012a-b39a-4bfa-ab56-77bc12e2902e" (UID: "2e6d012a-b39a-4bfa-ab56-77bc12e2902e"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:36:23 crc kubenswrapper[5120]: I0316 16:36:23.590346 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e6d012a-b39a-4bfa-ab56-77bc12e2902e-kube-api-access-rcvkx" (OuterVolumeSpecName: "kube-api-access-rcvkx") pod "2e6d012a-b39a-4bfa-ab56-77bc12e2902e" (UID: "2e6d012a-b39a-4bfa-ab56-77bc12e2902e"). InnerVolumeSpecName "kube-api-access-rcvkx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:36:23 crc kubenswrapper[5120]: I0316 16:36:23.642962 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e6d012a-b39a-4bfa-ab56-77bc12e2902e-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "2e6d012a-b39a-4bfa-ab56-77bc12e2902e" (UID: "2e6d012a-b39a-4bfa-ab56-77bc12e2902e"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:36:23 crc kubenswrapper[5120]: I0316 16:36:23.651580 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e6d012a-b39a-4bfa-ab56-77bc12e2902e-config-data" (OuterVolumeSpecName: "config-data") pod "2e6d012a-b39a-4bfa-ab56-77bc12e2902e" (UID: "2e6d012a-b39a-4bfa-ab56-77bc12e2902e"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:36:23 crc kubenswrapper[5120]: I0316 16:36:23.687043 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rcvkx\" (UniqueName: \"kubernetes.io/projected/2e6d012a-b39a-4bfa-ab56-77bc12e2902e-kube-api-access-rcvkx\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:23 crc kubenswrapper[5120]: I0316 16:36:23.687100 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2e6d012a-b39a-4bfa-ab56-77bc12e2902e-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:23 crc kubenswrapper[5120]: I0316 16:36:23.687113 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2e6d012a-b39a-4bfa-ab56-77bc12e2902e-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:23 crc kubenswrapper[5120]: I0316 16:36:23.687124 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2e6d012a-b39a-4bfa-ab56-77bc12e2902e-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:23 crc kubenswrapper[5120]: I0316 16:36:23.877541 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"204ff621-b59e-44f0-84a5-c9e4eaaf86bf","Type":"ContainerStarted","Data":"a4f0f47792c541bbdfdc4aa02957d9f5d001f8eb68aad9f21183153a7f7350eb"} Mar 16 16:36:23 crc kubenswrapper[5120]: I0316 16:36:23.881229 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-4ckj9" Mar 16 16:36:23 crc kubenswrapper[5120]: I0316 16:36:23.881253 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-4ckj9" event={"ID":"2e6d012a-b39a-4bfa-ab56-77bc12e2902e","Type":"ContainerDied","Data":"f8218485b9d60751fc806237716631ddf4ffa06a4cece50120bd2115f4771393"} Mar 16 16:36:23 crc kubenswrapper[5120]: I0316 16:36:23.881287 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f8218485b9d60751fc806237716631ddf4ffa06a4cece50120bd2115f4771393" Mar 16 16:36:23 crc kubenswrapper[5120]: I0316 16:36:23.902942 5120 generic.go:358] "Generic (PLEG): container finished" podID="63d9a98c-175f-4caa-bd33-41eb82d6e06b" containerID="597efc0dd871c2e1f82f46bb284d3a25d9d02fb8817ac7c029ec870416fbaef4" exitCode=0 Mar 16 16:36:23 crc kubenswrapper[5120]: I0316 16:36:23.903103 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"63d9a98c-175f-4caa-bd33-41eb82d6e06b","Type":"ContainerDied","Data":"597efc0dd871c2e1f82f46bb284d3a25d9d02fb8817ac7c029ec870416fbaef4"} Mar 16 16:36:23 crc kubenswrapper[5120]: I0316 16:36:23.908411 5120 generic.go:358] "Generic (PLEG): container finished" podID="e8ee374e-6e54-498b-9c76-2ea7caf3cad8" containerID="293a8c9b65d2dc593bd393e16d6b5dfe15f0954f1386ecb80ce43bc0943e1af4" exitCode=143 Mar 16 16:36:23 crc kubenswrapper[5120]: I0316 16:36:23.908507 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"e8ee374e-6e54-498b-9c76-2ea7caf3cad8","Type":"ContainerDied","Data":"293a8c9b65d2dc593bd393e16d6b5dfe15f0954f1386ecb80ce43bc0943e1af4"} Mar 16 16:36:23 crc kubenswrapper[5120]: I0316 16:36:23.916239 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-8bf565768-57qhf"] Mar 16 16:36:23 crc kubenswrapper[5120]: I0316 16:36:23.930447 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 16:36:23 crc kubenswrapper[5120]: I0316 16:36:23.930918 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="e88b61c1-a3d0-4b23-820a-b117cf5b90c1" containerName="nova-cell1-conductor-conductor" containerID="cri-o://be1a1d5e32a89360e321dcc84bcfed9e4606efded0431d2d9b776329af9d0675" gracePeriod=30 Mar 16 16:36:24 crc kubenswrapper[5120]: I0316 16:36:24.248284 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-b5trh" Mar 16 16:36:24 crc kubenswrapper[5120]: I0316 16:36:24.403690 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/91d6af93-90b1-4d80-86df-11a701664a68-combined-ca-bundle\") pod \"91d6af93-90b1-4d80-86df-11a701664a68\" (UID: \"91d6af93-90b1-4d80-86df-11a701664a68\") " Mar 16 16:36:24 crc kubenswrapper[5120]: I0316 16:36:24.404114 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/91d6af93-90b1-4d80-86df-11a701664a68-config-data\") pod \"91d6af93-90b1-4d80-86df-11a701664a68\" (UID: \"91d6af93-90b1-4d80-86df-11a701664a68\") " Mar 16 16:36:24 crc kubenswrapper[5120]: I0316 16:36:24.404594 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/91d6af93-90b1-4d80-86df-11a701664a68-db-sync-config-data\") pod \"91d6af93-90b1-4d80-86df-11a701664a68\" (UID: \"91d6af93-90b1-4d80-86df-11a701664a68\") " Mar 16 16:36:24 crc kubenswrapper[5120]: I0316 16:36:24.404773 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f85dt\" (UniqueName: \"kubernetes.io/projected/91d6af93-90b1-4d80-86df-11a701664a68-kube-api-access-f85dt\") pod \"91d6af93-90b1-4d80-86df-11a701664a68\" (UID: \"91d6af93-90b1-4d80-86df-11a701664a68\") " Mar 16 16:36:24 crc kubenswrapper[5120]: I0316 16:36:24.408036 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91d6af93-90b1-4d80-86df-11a701664a68-db-sync-config-data" (OuterVolumeSpecName: "db-sync-config-data") pod "91d6af93-90b1-4d80-86df-11a701664a68" (UID: "91d6af93-90b1-4d80-86df-11a701664a68"). InnerVolumeSpecName "db-sync-config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:36:24 crc kubenswrapper[5120]: I0316 16:36:24.409575 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91d6af93-90b1-4d80-86df-11a701664a68-kube-api-access-f85dt" (OuterVolumeSpecName: "kube-api-access-f85dt") pod "91d6af93-90b1-4d80-86df-11a701664a68" (UID: "91d6af93-90b1-4d80-86df-11a701664a68"). InnerVolumeSpecName "kube-api-access-f85dt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:36:24 crc kubenswrapper[5120]: I0316 16:36:24.415005 5120 reconciler_common.go:299] "Volume detached for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/91d6af93-90b1-4d80-86df-11a701664a68-db-sync-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:24 crc kubenswrapper[5120]: I0316 16:36:24.415052 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f85dt\" (UniqueName: \"kubernetes.io/projected/91d6af93-90b1-4d80-86df-11a701664a68-kube-api-access-f85dt\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:24 crc kubenswrapper[5120]: I0316 16:36:24.438206 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91d6af93-90b1-4d80-86df-11a701664a68-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "91d6af93-90b1-4d80-86df-11a701664a68" (UID: "91d6af93-90b1-4d80-86df-11a701664a68"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:36:24 crc kubenswrapper[5120]: I0316 16:36:24.470114 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91d6af93-90b1-4d80-86df-11a701664a68-config-data" (OuterVolumeSpecName: "config-data") pod "91d6af93-90b1-4d80-86df-11a701664a68" (UID: "91d6af93-90b1-4d80-86df-11a701664a68"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:36:24 crc kubenswrapper[5120]: I0316 16:36:24.517068 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/91d6af93-90b1-4d80-86df-11a701664a68-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:24 crc kubenswrapper[5120]: I0316 16:36:24.517108 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/91d6af93-90b1-4d80-86df-11a701664a68-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:24 crc kubenswrapper[5120]: I0316 16:36:24.932535 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-b5trh" event={"ID":"91d6af93-90b1-4d80-86df-11a701664a68","Type":"ContainerDied","Data":"38385cceddb8eb34b90b293e25b867b6b891c23d41c0c7f8de139a587a430982"} Mar 16 16:36:24 crc kubenswrapper[5120]: I0316 16:36:24.932576 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="38385cceddb8eb34b90b293e25b867b6b891c23d41c0c7f8de139a587a430982" Mar 16 16:36:24 crc kubenswrapper[5120]: I0316 16:36:24.932640 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-b5trh" Mar 16 16:36:24 crc kubenswrapper[5120]: I0316 16:36:24.935409 5120 generic.go:358] "Generic (PLEG): container finished" podID="4346558c-b16e-474a-b782-569ca0bbb7cd" containerID="5af2f8d5f4776cb0a460db5c1757b19b33071548ffa7ba0bd64ab52782aba9d5" exitCode=0 Mar 16 16:36:24 crc kubenswrapper[5120]: I0316 16:36:24.936006 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-9nksc" event={"ID":"4346558c-b16e-474a-b782-569ca0bbb7cd","Type":"ContainerDied","Data":"5af2f8d5f4776cb0a460db5c1757b19b33071548ffa7ba0bd64ab52782aba9d5"} Mar 16 16:36:24 crc kubenswrapper[5120]: I0316 16:36:24.942591 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"204ff621-b59e-44f0-84a5-c9e4eaaf86bf","Type":"ContainerStarted","Data":"56d4baebbb806417e5fc468a17b33231ff7a0538573b3437ce67ad2bd53c1afa"} Mar 16 16:36:24 crc kubenswrapper[5120]: I0316 16:36:24.951478 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-8bf565768-57qhf" event={"ID":"b21fb0d1-eae4-4ac7-b3fe-6b62df9f6453","Type":"ContainerStarted","Data":"8c5e84274c475c693350d79928da2fd5c749fcd40da0a8b00a22b4228017d725"} Mar 16 16:36:24 crc kubenswrapper[5120]: I0316 16:36:24.951521 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-8bf565768-57qhf" event={"ID":"b21fb0d1-eae4-4ac7-b3fe-6b62df9f6453","Type":"ContainerStarted","Data":"af00e50dfeb61c52a43b77c9704c742bf39ac86ed2a55361286ca4bd073e109a"} Mar 16 16:36:24 crc kubenswrapper[5120]: I0316 16:36:24.951531 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-8bf565768-57qhf" event={"ID":"b21fb0d1-eae4-4ac7-b3fe-6b62df9f6453","Type":"ContainerStarted","Data":"36801e42c338e66156d1bffccb4634e0c0f297738ff7b4a412ee37107cfd6cfe"} Mar 16 16:36:24 crc kubenswrapper[5120]: I0316 16:36:24.951571 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/neutron-8bf565768-57qhf" Mar 16 16:36:24 crc kubenswrapper[5120]: I0316 16:36:24.989091 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-8bf565768-57qhf" podStartSLOduration=2.989070964 podStartE2EDuration="2.989070964s" podCreationTimestamp="2026-03-16 16:36:22 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:36:24.975201921 +0000 UTC m=+3887.129133588" watchObservedRunningTime="2026-03-16 16:36:24.989070964 +0000 UTC m=+3887.143002621" Mar 16 16:36:25 crc kubenswrapper[5120]: I0316 16:36:25.084672 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:36:25 crc kubenswrapper[5120]: I0316 16:36:25.084932 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="48a68bcb-2d44-4992-b9a9-0409c2348fb1" containerName="glance-log" containerID="cri-o://b535d5c7264d6875c6464d6d5e6b6d6d01fd828d88739e2ac33b940143614c43" gracePeriod=30 Mar 16 16:36:25 crc kubenswrapper[5120]: I0316 16:36:25.085065 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="48a68bcb-2d44-4992-b9a9-0409c2348fb1" containerName="glance-httpd" containerID="cri-o://bed66acd818bf9ec3122212cf7b4cdbe084eaee25adc4cc27a99522f61b452e7" gracePeriod=30 Mar 16 16:36:25 crc kubenswrapper[5120]: I0316 16:36:25.135634 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:36:25 crc kubenswrapper[5120]: I0316 16:36:25.135898 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="eea6594f-2384-40f5-9061-e3925083e279" containerName="glance-log" containerID="cri-o://a090be84f2bc4f63da6fe24ea6fd1308ca4da6645a70816deb3537d0041816e9" gracePeriod=30 Mar 16 16:36:25 crc kubenswrapper[5120]: I0316 16:36:25.136378 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="eea6594f-2384-40f5-9061-e3925083e279" containerName="glance-httpd" containerID="cri-o://5093e2092031a93c0f43b9aa524141d4066c5a5b18cd23e768cf403e05b7da66" gracePeriod=30 Mar 16 16:36:25 crc kubenswrapper[5120]: I0316 16:36:25.290986 5120 scope.go:117] "RemoveContainer" containerID="108fca00527a3817274826615b98836fba368197ffe0d3e67ec3e35b6f396630" Mar 16 16:36:25 crc kubenswrapper[5120]: E0316 16:36:25.936161 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="be1a1d5e32a89360e321dcc84bcfed9e4606efded0431d2d9b776329af9d0675" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:36:25 crc kubenswrapper[5120]: E0316 16:36:25.938593 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="be1a1d5e32a89360e321dcc84bcfed9e4606efded0431d2d9b776329af9d0675" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:36:25 crc kubenswrapper[5120]: E0316 16:36:25.939937 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="be1a1d5e32a89360e321dcc84bcfed9e4606efded0431d2d9b776329af9d0675" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:36:25 crc kubenswrapper[5120]: E0316 16:36:25.939973 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="e88b61c1-a3d0-4b23-820a-b117cf5b90c1" containerName="nova-cell1-conductor-conductor" probeResult="unknown" Mar 16 16:36:25 crc kubenswrapper[5120]: I0316 16:36:25.963926 5120 generic.go:358] "Generic (PLEG): container finished" podID="eea6594f-2384-40f5-9061-e3925083e279" containerID="a090be84f2bc4f63da6fe24ea6fd1308ca4da6645a70816deb3537d0041816e9" exitCode=143 Mar 16 16:36:25 crc kubenswrapper[5120]: I0316 16:36:25.964148 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"eea6594f-2384-40f5-9061-e3925083e279","Type":"ContainerDied","Data":"a090be84f2bc4f63da6fe24ea6fd1308ca4da6645a70816deb3537d0041816e9"} Mar 16 16:36:25 crc kubenswrapper[5120]: I0316 16:36:25.968462 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"204ff621-b59e-44f0-84a5-c9e4eaaf86bf","Type":"ContainerStarted","Data":"e711ed4c2337b57b3fae4b8721cc0ce19eb8f9e19cb8d9a26a1a2dd0974c03ef"} Mar 16 16:36:25 crc kubenswrapper[5120]: I0316 16:36:25.968532 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"204ff621-b59e-44f0-84a5-c9e4eaaf86bf","Type":"ContainerStarted","Data":"36a38b9c8971280678407303957af16f6e151a9ccb5c0f41ffc3a4f90e4185cb"} Mar 16 16:36:25 crc kubenswrapper[5120]: I0316 16:36:25.971913 5120 generic.go:358] "Generic (PLEG): container finished" podID="48a68bcb-2d44-4992-b9a9-0409c2348fb1" containerID="b535d5c7264d6875c6464d6d5e6b6d6d01fd828d88739e2ac33b940143614c43" exitCode=143 Mar 16 16:36:25 crc kubenswrapper[5120]: I0316 16:36:25.972012 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"48a68bcb-2d44-4992-b9a9-0409c2348fb1","Type":"ContainerDied","Data":"b535d5c7264d6875c6464d6d5e6b6d6d01fd828d88739e2ac33b940143614c43"} Mar 16 16:36:26 crc kubenswrapper[5120]: I0316 16:36:26.401691 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-9nksc" Mar 16 16:36:26 crc kubenswrapper[5120]: I0316 16:36:26.496475 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4346558c-b16e-474a-b782-569ca0bbb7cd-config-data\") pod \"4346558c-b16e-474a-b782-569ca0bbb7cd\" (UID: \"4346558c-b16e-474a-b782-569ca0bbb7cd\") " Mar 16 16:36:26 crc kubenswrapper[5120]: I0316 16:36:26.496783 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sxwjh\" (UniqueName: \"kubernetes.io/projected/4346558c-b16e-474a-b782-569ca0bbb7cd-kube-api-access-sxwjh\") pod \"4346558c-b16e-474a-b782-569ca0bbb7cd\" (UID: \"4346558c-b16e-474a-b782-569ca0bbb7cd\") " Mar 16 16:36:26 crc kubenswrapper[5120]: I0316 16:36:26.496806 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4346558c-b16e-474a-b782-569ca0bbb7cd-combined-ca-bundle\") pod \"4346558c-b16e-474a-b782-569ca0bbb7cd\" (UID: \"4346558c-b16e-474a-b782-569ca0bbb7cd\") " Mar 16 16:36:26 crc kubenswrapper[5120]: I0316 16:36:26.496947 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4346558c-b16e-474a-b782-569ca0bbb7cd-scripts\") pod \"4346558c-b16e-474a-b782-569ca0bbb7cd\" (UID: \"4346558c-b16e-474a-b782-569ca0bbb7cd\") " Mar 16 16:36:26 crc kubenswrapper[5120]: I0316 16:36:26.504866 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4346558c-b16e-474a-b782-569ca0bbb7cd-kube-api-access-sxwjh" (OuterVolumeSpecName: "kube-api-access-sxwjh") pod "4346558c-b16e-474a-b782-569ca0bbb7cd" (UID: "4346558c-b16e-474a-b782-569ca0bbb7cd"). InnerVolumeSpecName "kube-api-access-sxwjh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:36:26 crc kubenswrapper[5120]: I0316 16:36:26.505074 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4346558c-b16e-474a-b782-569ca0bbb7cd-scripts" (OuterVolumeSpecName: "scripts") pod "4346558c-b16e-474a-b782-569ca0bbb7cd" (UID: "4346558c-b16e-474a-b782-569ca0bbb7cd"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:36:26 crc kubenswrapper[5120]: I0316 16:36:26.529901 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4346558c-b16e-474a-b782-569ca0bbb7cd-config-data" (OuterVolumeSpecName: "config-data") pod "4346558c-b16e-474a-b782-569ca0bbb7cd" (UID: "4346558c-b16e-474a-b782-569ca0bbb7cd"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:36:26 crc kubenswrapper[5120]: I0316 16:36:26.535141 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4346558c-b16e-474a-b782-569ca0bbb7cd-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "4346558c-b16e-474a-b782-569ca0bbb7cd" (UID: "4346558c-b16e-474a-b782-569ca0bbb7cd"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:36:26 crc kubenswrapper[5120]: I0316 16:36:26.599839 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4346558c-b16e-474a-b782-569ca0bbb7cd-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:26 crc kubenswrapper[5120]: I0316 16:36:26.599880 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sxwjh\" (UniqueName: \"kubernetes.io/projected/4346558c-b16e-474a-b782-569ca0bbb7cd-kube-api-access-sxwjh\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:26 crc kubenswrapper[5120]: I0316 16:36:26.599894 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4346558c-b16e-474a-b782-569ca0bbb7cd-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:26 crc kubenswrapper[5120]: I0316 16:36:26.599905 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4346558c-b16e-474a-b782-569ca0bbb7cd-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:26 crc kubenswrapper[5120]: I0316 16:36:26.985884 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-9nksc" Mar 16 16:36:26 crc kubenswrapper[5120]: I0316 16:36:26.985946 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-9nksc" event={"ID":"4346558c-b16e-474a-b782-569ca0bbb7cd","Type":"ContainerDied","Data":"7308b1a78f058af53d6e97c05ac8904765baa2fa77661f22dd478d857daa3f4c"} Mar 16 16:36:26 crc kubenswrapper[5120]: I0316 16:36:26.986007 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7308b1a78f058af53d6e97c05ac8904765baa2fa77661f22dd478d857daa3f4c" Mar 16 16:36:27 crc kubenswrapper[5120]: I0316 16:36:27.029341 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:36:27 crc kubenswrapper[5120]: I0316 16:36:27.029634 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="84f67b87-419d-457b-a40c-b47e8406d39c" containerName="nova-cell0-conductor-conductor" containerID="cri-o://20b14cb73912a1ea8aaef52cb856cecb710f82e72aeb94e10fec11a89f661054" gracePeriod=30 Mar 16 16:36:27 crc kubenswrapper[5120]: E0316 16:36:27.216127 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="20b14cb73912a1ea8aaef52cb856cecb710f82e72aeb94e10fec11a89f661054" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:36:27 crc kubenswrapper[5120]: E0316 16:36:27.218155 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="20b14cb73912a1ea8aaef52cb856cecb710f82e72aeb94e10fec11a89f661054" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:36:27 crc kubenswrapper[5120]: E0316 16:36:27.220680 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="20b14cb73912a1ea8aaef52cb856cecb710f82e72aeb94e10fec11a89f661054" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:36:27 crc kubenswrapper[5120]: E0316 16:36:27.220740 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="84f67b87-419d-457b-a40c-b47e8406d39c" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 16:36:28 crc kubenswrapper[5120]: I0316 16:36:28.005389 5120 generic.go:358] "Generic (PLEG): container finished" podID="d9bb0c66-45a6-4915-8878-03f17055f4ab" containerID="72f9451d2179670d44ae1425f3b91ca6ef1324b3c61d90d387f96872979dfe18" exitCode=0 Mar 16 16:36:28 crc kubenswrapper[5120]: I0316 16:36:28.005665 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-vqvr9" event={"ID":"d9bb0c66-45a6-4915-8878-03f17055f4ab","Type":"ContainerDied","Data":"72f9451d2179670d44ae1425f3b91ca6ef1324b3c61d90d387f96872979dfe18"} Mar 16 16:36:28 crc kubenswrapper[5120]: I0316 16:36:28.011171 5120 generic.go:358] "Generic (PLEG): container finished" podID="e8ee374e-6e54-498b-9c76-2ea7caf3cad8" containerID="127258b57c230c7843d8cc012a76f9e30a721fab3cab2462fbdac98abf8f8ae9" exitCode=0 Mar 16 16:36:28 crc kubenswrapper[5120]: I0316 16:36:28.011295 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"e8ee374e-6e54-498b-9c76-2ea7caf3cad8","Type":"ContainerDied","Data":"127258b57c230c7843d8cc012a76f9e30a721fab3cab2462fbdac98abf8f8ae9"} Mar 16 16:36:28 crc kubenswrapper[5120]: I0316 16:36:28.013577 5120 generic.go:358] "Generic (PLEG): container finished" podID="d0d98630-1fca-41f0-ba40-03f42f303121" containerID="313b3b5a843c78582407f033efb01a381513dcfd6dee421e1f746fb551f6bebd" exitCode=0 Mar 16 16:36:28 crc kubenswrapper[5120]: I0316 16:36:28.013812 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-bmfrv" event={"ID":"d0d98630-1fca-41f0-ba40-03f42f303121","Type":"ContainerDied","Data":"313b3b5a843c78582407f033efb01a381513dcfd6dee421e1f746fb551f6bebd"} Mar 16 16:36:28 crc kubenswrapper[5120]: I0316 16:36:28.127708 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:36:28 crc kubenswrapper[5120]: I0316 16:36:28.244487 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e8ee374e-6e54-498b-9c76-2ea7caf3cad8-config-data\") pod \"e8ee374e-6e54-498b-9c76-2ea7caf3cad8\" (UID: \"e8ee374e-6e54-498b-9c76-2ea7caf3cad8\") " Mar 16 16:36:28 crc kubenswrapper[5120]: I0316 16:36:28.244741 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e8ee374e-6e54-498b-9c76-2ea7caf3cad8-scripts\") pod \"e8ee374e-6e54-498b-9c76-2ea7caf3cad8\" (UID: \"e8ee374e-6e54-498b-9c76-2ea7caf3cad8\") " Mar 16 16:36:28 crc kubenswrapper[5120]: I0316 16:36:28.244807 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qcjkz\" (UniqueName: \"kubernetes.io/projected/e8ee374e-6e54-498b-9c76-2ea7caf3cad8-kube-api-access-qcjkz\") pod \"e8ee374e-6e54-498b-9c76-2ea7caf3cad8\" (UID: \"e8ee374e-6e54-498b-9c76-2ea7caf3cad8\") " Mar 16 16:36:28 crc kubenswrapper[5120]: I0316 16:36:28.245012 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e8ee374e-6e54-498b-9c76-2ea7caf3cad8-internal-tls-certs\") pod \"e8ee374e-6e54-498b-9c76-2ea7caf3cad8\" (UID: \"e8ee374e-6e54-498b-9c76-2ea7caf3cad8\") " Mar 16 16:36:28 crc kubenswrapper[5120]: I0316 16:36:28.245051 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/e8ee374e-6e54-498b-9c76-2ea7caf3cad8-config-data-custom\") pod \"e8ee374e-6e54-498b-9c76-2ea7caf3cad8\" (UID: \"e8ee374e-6e54-498b-9c76-2ea7caf3cad8\") " Mar 16 16:36:28 crc kubenswrapper[5120]: I0316 16:36:28.251362 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8ee374e-6e54-498b-9c76-2ea7caf3cad8-kube-api-access-qcjkz" (OuterVolumeSpecName: "kube-api-access-qcjkz") pod "e8ee374e-6e54-498b-9c76-2ea7caf3cad8" (UID: "e8ee374e-6e54-498b-9c76-2ea7caf3cad8"). InnerVolumeSpecName "kube-api-access-qcjkz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:36:28 crc kubenswrapper[5120]: I0316 16:36:28.256241 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e8ee374e-6e54-498b-9c76-2ea7caf3cad8-public-tls-certs\") pod \"e8ee374e-6e54-498b-9c76-2ea7caf3cad8\" (UID: \"e8ee374e-6e54-498b-9c76-2ea7caf3cad8\") " Mar 16 16:36:28 crc kubenswrapper[5120]: I0316 16:36:28.256272 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8ee374e-6e54-498b-9c76-2ea7caf3cad8-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "e8ee374e-6e54-498b-9c76-2ea7caf3cad8" (UID: "e8ee374e-6e54-498b-9c76-2ea7caf3cad8"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:36:28 crc kubenswrapper[5120]: I0316 16:36:28.256902 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e8ee374e-6e54-498b-9c76-2ea7caf3cad8-logs\") pod \"e8ee374e-6e54-498b-9c76-2ea7caf3cad8\" (UID: \"e8ee374e-6e54-498b-9c76-2ea7caf3cad8\") " Mar 16 16:36:28 crc kubenswrapper[5120]: I0316 16:36:28.257063 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e8ee374e-6e54-498b-9c76-2ea7caf3cad8-combined-ca-bundle\") pod \"e8ee374e-6e54-498b-9c76-2ea7caf3cad8\" (UID: \"e8ee374e-6e54-498b-9c76-2ea7caf3cad8\") " Mar 16 16:36:28 crc kubenswrapper[5120]: I0316 16:36:28.257121 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/e8ee374e-6e54-498b-9c76-2ea7caf3cad8-etc-machine-id\") pod \"e8ee374e-6e54-498b-9c76-2ea7caf3cad8\" (UID: \"e8ee374e-6e54-498b-9c76-2ea7caf3cad8\") " Mar 16 16:36:28 crc kubenswrapper[5120]: I0316 16:36:28.257463 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8ee374e-6e54-498b-9c76-2ea7caf3cad8-logs" (OuterVolumeSpecName: "logs") pod "e8ee374e-6e54-498b-9c76-2ea7caf3cad8" (UID: "e8ee374e-6e54-498b-9c76-2ea7caf3cad8"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:36:28 crc kubenswrapper[5120]: I0316 16:36:28.257588 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/e8ee374e-6e54-498b-9c76-2ea7caf3cad8-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "e8ee374e-6e54-498b-9c76-2ea7caf3cad8" (UID: "e8ee374e-6e54-498b-9c76-2ea7caf3cad8"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 16:36:28 crc kubenswrapper[5120]: I0316 16:36:28.258289 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e8ee374e-6e54-498b-9c76-2ea7caf3cad8-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:28 crc kubenswrapper[5120]: I0316 16:36:28.258311 5120 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/e8ee374e-6e54-498b-9c76-2ea7caf3cad8-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:28 crc kubenswrapper[5120]: I0316 16:36:28.258321 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qcjkz\" (UniqueName: \"kubernetes.io/projected/e8ee374e-6e54-498b-9c76-2ea7caf3cad8-kube-api-access-qcjkz\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:28 crc kubenswrapper[5120]: I0316 16:36:28.258332 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/e8ee374e-6e54-498b-9c76-2ea7caf3cad8-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:28 crc kubenswrapper[5120]: I0316 16:36:28.268105 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8ee374e-6e54-498b-9c76-2ea7caf3cad8-scripts" (OuterVolumeSpecName: "scripts") pod "e8ee374e-6e54-498b-9c76-2ea7caf3cad8" (UID: "e8ee374e-6e54-498b-9c76-2ea7caf3cad8"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:36:28 crc kubenswrapper[5120]: I0316 16:36:28.321607 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8ee374e-6e54-498b-9c76-2ea7caf3cad8-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "e8ee374e-6e54-498b-9c76-2ea7caf3cad8" (UID: "e8ee374e-6e54-498b-9c76-2ea7caf3cad8"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:36:28 crc kubenswrapper[5120]: I0316 16:36:28.332943 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8ee374e-6e54-498b-9c76-2ea7caf3cad8-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e8ee374e-6e54-498b-9c76-2ea7caf3cad8" (UID: "e8ee374e-6e54-498b-9c76-2ea7caf3cad8"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:36:28 crc kubenswrapper[5120]: I0316 16:36:28.351677 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8ee374e-6e54-498b-9c76-2ea7caf3cad8-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "e8ee374e-6e54-498b-9c76-2ea7caf3cad8" (UID: "e8ee374e-6e54-498b-9c76-2ea7caf3cad8"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:36:28 crc kubenswrapper[5120]: I0316 16:36:28.356356 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8ee374e-6e54-498b-9c76-2ea7caf3cad8-config-data" (OuterVolumeSpecName: "config-data") pod "e8ee374e-6e54-498b-9c76-2ea7caf3cad8" (UID: "e8ee374e-6e54-498b-9c76-2ea7caf3cad8"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:36:28 crc kubenswrapper[5120]: I0316 16:36:28.360941 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e8ee374e-6e54-498b-9c76-2ea7caf3cad8-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:28 crc kubenswrapper[5120]: I0316 16:36:28.360967 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e8ee374e-6e54-498b-9c76-2ea7caf3cad8-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:28 crc kubenswrapper[5120]: I0316 16:36:28.360978 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e8ee374e-6e54-498b-9c76-2ea7caf3cad8-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:28 crc kubenswrapper[5120]: I0316 16:36:28.360991 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e8ee374e-6e54-498b-9c76-2ea7caf3cad8-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:28 crc kubenswrapper[5120]: I0316 16:36:28.361000 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e8ee374e-6e54-498b-9c76-2ea7caf3cad8-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:28 crc kubenswrapper[5120]: I0316 16:36:28.853572 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:36:28 crc kubenswrapper[5120]: I0316 16:36:28.981137 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/48a68bcb-2d44-4992-b9a9-0409c2348fb1-logs\") pod \"48a68bcb-2d44-4992-b9a9-0409c2348fb1\" (UID: \"48a68bcb-2d44-4992-b9a9-0409c2348fb1\") " Mar 16 16:36:28 crc kubenswrapper[5120]: I0316 16:36:28.981525 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"48a68bcb-2d44-4992-b9a9-0409c2348fb1\" (UID: \"48a68bcb-2d44-4992-b9a9-0409c2348fb1\") " Mar 16 16:36:28 crc kubenswrapper[5120]: I0316 16:36:28.982103 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mgm2l\" (UniqueName: \"kubernetes.io/projected/48a68bcb-2d44-4992-b9a9-0409c2348fb1-kube-api-access-mgm2l\") pod \"48a68bcb-2d44-4992-b9a9-0409c2348fb1\" (UID: \"48a68bcb-2d44-4992-b9a9-0409c2348fb1\") " Mar 16 16:36:28 crc kubenswrapper[5120]: I0316 16:36:28.982289 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/48a68bcb-2d44-4992-b9a9-0409c2348fb1-combined-ca-bundle\") pod \"48a68bcb-2d44-4992-b9a9-0409c2348fb1\" (UID: \"48a68bcb-2d44-4992-b9a9-0409c2348fb1\") " Mar 16 16:36:28 crc kubenswrapper[5120]: I0316 16:36:28.982363 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/48a68bcb-2d44-4992-b9a9-0409c2348fb1-config-data\") pod \"48a68bcb-2d44-4992-b9a9-0409c2348fb1\" (UID: \"48a68bcb-2d44-4992-b9a9-0409c2348fb1\") " Mar 16 16:36:28 crc kubenswrapper[5120]: I0316 16:36:28.982552 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/48a68bcb-2d44-4992-b9a9-0409c2348fb1-public-tls-certs\") pod \"48a68bcb-2d44-4992-b9a9-0409c2348fb1\" (UID: \"48a68bcb-2d44-4992-b9a9-0409c2348fb1\") " Mar 16 16:36:28 crc kubenswrapper[5120]: I0316 16:36:28.982948 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/48a68bcb-2d44-4992-b9a9-0409c2348fb1-httpd-run\") pod \"48a68bcb-2d44-4992-b9a9-0409c2348fb1\" (UID: \"48a68bcb-2d44-4992-b9a9-0409c2348fb1\") " Mar 16 16:36:28 crc kubenswrapper[5120]: I0316 16:36:28.983045 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/48a68bcb-2d44-4992-b9a9-0409c2348fb1-scripts\") pod \"48a68bcb-2d44-4992-b9a9-0409c2348fb1\" (UID: \"48a68bcb-2d44-4992-b9a9-0409c2348fb1\") " Mar 16 16:36:28 crc kubenswrapper[5120]: I0316 16:36:28.981816 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48a68bcb-2d44-4992-b9a9-0409c2348fb1-logs" (OuterVolumeSpecName: "logs") pod "48a68bcb-2d44-4992-b9a9-0409c2348fb1" (UID: "48a68bcb-2d44-4992-b9a9-0409c2348fb1"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:36:28 crc kubenswrapper[5120]: I0316 16:36:28.985344 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48a68bcb-2d44-4992-b9a9-0409c2348fb1-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "48a68bcb-2d44-4992-b9a9-0409c2348fb1" (UID: "48a68bcb-2d44-4992-b9a9-0409c2348fb1"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:36:28 crc kubenswrapper[5120]: I0316 16:36:28.988446 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48a68bcb-2d44-4992-b9a9-0409c2348fb1-kube-api-access-mgm2l" (OuterVolumeSpecName: "kube-api-access-mgm2l") pod "48a68bcb-2d44-4992-b9a9-0409c2348fb1" (UID: "48a68bcb-2d44-4992-b9a9-0409c2348fb1"). InnerVolumeSpecName "kube-api-access-mgm2l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.001831 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage01-crc" (OuterVolumeSpecName: "glance") pod "48a68bcb-2d44-4992-b9a9-0409c2348fb1" (UID: "48a68bcb-2d44-4992-b9a9-0409c2348fb1"). InnerVolumeSpecName "local-storage01-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.002643 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48a68bcb-2d44-4992-b9a9-0409c2348fb1-scripts" (OuterVolumeSpecName: "scripts") pod "48a68bcb-2d44-4992-b9a9-0409c2348fb1" (UID: "48a68bcb-2d44-4992-b9a9-0409c2348fb1"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.068031 5120 generic.go:358] "Generic (PLEG): container finished" podID="48a68bcb-2d44-4992-b9a9-0409c2348fb1" containerID="bed66acd818bf9ec3122212cf7b4cdbe084eaee25adc4cc27a99522f61b452e7" exitCode=0 Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.068381 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"48a68bcb-2d44-4992-b9a9-0409c2348fb1","Type":"ContainerDied","Data":"bed66acd818bf9ec3122212cf7b4cdbe084eaee25adc4cc27a99522f61b452e7"} Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.068411 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"48a68bcb-2d44-4992-b9a9-0409c2348fb1","Type":"ContainerDied","Data":"c09ec5597d8f16a211335c9f0b9121095d157a7ed38959c90a7bfaf0ff54cb1b"} Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.068435 5120 scope.go:117] "RemoveContainer" containerID="bed66acd818bf9ec3122212cf7b4cdbe084eaee25adc4cc27a99522f61b452e7" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.068617 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.108314 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/48a68bcb-2d44-4992-b9a9-0409c2348fb1-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.108342 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/48a68bcb-2d44-4992-b9a9-0409c2348fb1-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.108358 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/48a68bcb-2d44-4992-b9a9-0409c2348fb1-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.108381 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") on node \"crc\" " Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.108398 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mgm2l\" (UniqueName: \"kubernetes.io/projected/48a68bcb-2d44-4992-b9a9-0409c2348fb1-kube-api-access-mgm2l\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.108476 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"e8ee374e-6e54-498b-9c76-2ea7caf3cad8","Type":"ContainerDied","Data":"6bf4212b75ebf8c42a813f69ea5158f87f44e6a264262eb9be3cce1af7c2a298"} Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.108640 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.113943 5120 generic.go:358] "Generic (PLEG): container finished" podID="eea6594f-2384-40f5-9061-e3925083e279" containerID="5093e2092031a93c0f43b9aa524141d4066c5a5b18cd23e768cf403e05b7da66" exitCode=0 Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.114020 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"eea6594f-2384-40f5-9061-e3925083e279","Type":"ContainerDied","Data":"5093e2092031a93c0f43b9aa524141d4066c5a5b18cd23e768cf403e05b7da66"} Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.114658 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48a68bcb-2d44-4992-b9a9-0409c2348fb1-config-data" (OuterVolumeSpecName: "config-data") pod "48a68bcb-2d44-4992-b9a9-0409c2348fb1" (UID: "48a68bcb-2d44-4992-b9a9-0409c2348fb1"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.114743 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48a68bcb-2d44-4992-b9a9-0409c2348fb1-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "48a68bcb-2d44-4992-b9a9-0409c2348fb1" (UID: "48a68bcb-2d44-4992-b9a9-0409c2348fb1"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.116519 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-426ss" event={"ID":"c951a6f5-568c-4da3-b6b3-e0310ca934bc","Type":"ContainerDied","Data":"ee1809e3d0fec16a77b3f05dc2b85697eba66eb29834160eec5cdd65cb2f6926"} Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.116482 5120 generic.go:358] "Generic (PLEG): container finished" podID="c951a6f5-568c-4da3-b6b3-e0310ca934bc" containerID="ee1809e3d0fec16a77b3f05dc2b85697eba66eb29834160eec5cdd65cb2f6926" exitCode=0 Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.122392 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"204ff621-b59e-44f0-84a5-c9e4eaaf86bf","Type":"ContainerStarted","Data":"d962a27ae73b49d661904f00b163e9adbf24cc2cced96780802051c61348e02b"} Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.122797 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.126654 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48a68bcb-2d44-4992-b9a9-0409c2348fb1-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "48a68bcb-2d44-4992-b9a9-0409c2348fb1" (UID: "48a68bcb-2d44-4992-b9a9-0409c2348fb1"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.157450 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage01-crc" (UniqueName: "kubernetes.io/local-volume/local-storage01-crc") on node "crc" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.172137 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.413771362 podStartE2EDuration="7.172116421s" podCreationTimestamp="2026-03-16 16:36:22 +0000 UTC" firstStartedPulling="2026-03-16 16:36:23.372028055 +0000 UTC m=+3885.525959712" lastFinishedPulling="2026-03-16 16:36:28.130373124 +0000 UTC m=+3890.284304771" observedRunningTime="2026-03-16 16:36:29.165987791 +0000 UTC m=+3891.319919448" watchObservedRunningTime="2026-03-16 16:36:29.172116421 +0000 UTC m=+3891.326048068" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.176136 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.209346 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/eea6594f-2384-40f5-9061-e3925083e279-httpd-run\") pod \"eea6594f-2384-40f5-9061-e3925083e279\" (UID: \"eea6594f-2384-40f5-9061-e3925083e279\") " Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.209490 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/eea6594f-2384-40f5-9061-e3925083e279-internal-tls-certs\") pod \"eea6594f-2384-40f5-9061-e3925083e279\" (UID: \"eea6594f-2384-40f5-9061-e3925083e279\") " Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.209724 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4cfbr\" (UniqueName: \"kubernetes.io/projected/eea6594f-2384-40f5-9061-e3925083e279-kube-api-access-4cfbr\") pod \"eea6594f-2384-40f5-9061-e3925083e279\" (UID: \"eea6594f-2384-40f5-9061-e3925083e279\") " Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.209797 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/eea6594f-2384-40f5-9061-e3925083e279-config-data\") pod \"eea6594f-2384-40f5-9061-e3925083e279\" (UID: \"eea6594f-2384-40f5-9061-e3925083e279\") " Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.209810 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eea6594f-2384-40f5-9061-e3925083e279-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "eea6594f-2384-40f5-9061-e3925083e279" (UID: "eea6594f-2384-40f5-9061-e3925083e279"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.209845 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/eea6594f-2384-40f5-9061-e3925083e279-logs\") pod \"eea6594f-2384-40f5-9061-e3925083e279\" (UID: \"eea6594f-2384-40f5-9061-e3925083e279\") " Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.209922 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eea6594f-2384-40f5-9061-e3925083e279-combined-ca-bundle\") pod \"eea6594f-2384-40f5-9061-e3925083e279\" (UID: \"eea6594f-2384-40f5-9061-e3925083e279\") " Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.210071 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/eea6594f-2384-40f5-9061-e3925083e279-scripts\") pod \"eea6594f-2384-40f5-9061-e3925083e279\" (UID: \"eea6594f-2384-40f5-9061-e3925083e279\") " Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.210112 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") pod \"eea6594f-2384-40f5-9061-e3925083e279\" (UID: \"eea6594f-2384-40f5-9061-e3925083e279\") " Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.210946 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/48a68bcb-2d44-4992-b9a9-0409c2348fb1-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.210989 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/48a68bcb-2d44-4992-b9a9-0409c2348fb1-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.211001 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/48a68bcb-2d44-4992-b9a9-0409c2348fb1-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.211014 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/eea6594f-2384-40f5-9061-e3925083e279-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.211025 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.212219 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eea6594f-2384-40f5-9061-e3925083e279-logs" (OuterVolumeSpecName: "logs") pod "eea6594f-2384-40f5-9061-e3925083e279" (UID: "eea6594f-2384-40f5-9061-e3925083e279"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.220192 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eea6594f-2384-40f5-9061-e3925083e279-kube-api-access-4cfbr" (OuterVolumeSpecName: "kube-api-access-4cfbr") pod "eea6594f-2384-40f5-9061-e3925083e279" (UID: "eea6594f-2384-40f5-9061-e3925083e279"). InnerVolumeSpecName "kube-api-access-4cfbr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.221172 5120 scope.go:117] "RemoveContainer" containerID="b535d5c7264d6875c6464d6d5e6b6d6d01fd828d88739e2ac33b940143614c43" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.221951 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.224911 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage19-crc" (OuterVolumeSpecName: "glance") pod "eea6594f-2384-40f5-9061-e3925083e279" (UID: "eea6594f-2384-40f5-9061-e3925083e279"). InnerVolumeSpecName "local-storage19-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.228358 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eea6594f-2384-40f5-9061-e3925083e279-scripts" (OuterVolumeSpecName: "scripts") pod "eea6594f-2384-40f5-9061-e3925083e279" (UID: "eea6594f-2384-40f5-9061-e3925083e279"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.233160 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.265799 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eea6594f-2384-40f5-9061-e3925083e279-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "eea6594f-2384-40f5-9061-e3925083e279" (UID: "eea6594f-2384-40f5-9061-e3925083e279"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.274078 5120 scope.go:117] "RemoveContainer" containerID="bed66acd818bf9ec3122212cf7b4cdbe084eaee25adc4cc27a99522f61b452e7" Mar 16 16:36:29 crc kubenswrapper[5120]: E0316 16:36:29.275284 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bed66acd818bf9ec3122212cf7b4cdbe084eaee25adc4cc27a99522f61b452e7\": container with ID starting with bed66acd818bf9ec3122212cf7b4cdbe084eaee25adc4cc27a99522f61b452e7 not found: ID does not exist" containerID="bed66acd818bf9ec3122212cf7b4cdbe084eaee25adc4cc27a99522f61b452e7" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.275384 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bed66acd818bf9ec3122212cf7b4cdbe084eaee25adc4cc27a99522f61b452e7"} err="failed to get container status \"bed66acd818bf9ec3122212cf7b4cdbe084eaee25adc4cc27a99522f61b452e7\": rpc error: code = NotFound desc = could not find container \"bed66acd818bf9ec3122212cf7b4cdbe084eaee25adc4cc27a99522f61b452e7\": container with ID starting with bed66acd818bf9ec3122212cf7b4cdbe084eaee25adc4cc27a99522f61b452e7 not found: ID does not exist" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.276432 5120 scope.go:117] "RemoveContainer" containerID="b535d5c7264d6875c6464d6d5e6b6d6d01fd828d88739e2ac33b940143614c43" Mar 16 16:36:29 crc kubenswrapper[5120]: E0316 16:36:29.284929 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b535d5c7264d6875c6464d6d5e6b6d6d01fd828d88739e2ac33b940143614c43\": container with ID starting with b535d5c7264d6875c6464d6d5e6b6d6d01fd828d88739e2ac33b940143614c43 not found: ID does not exist" containerID="b535d5c7264d6875c6464d6d5e6b6d6d01fd828d88739e2ac33b940143614c43" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.285189 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b535d5c7264d6875c6464d6d5e6b6d6d01fd828d88739e2ac33b940143614c43"} err="failed to get container status \"b535d5c7264d6875c6464d6d5e6b6d6d01fd828d88739e2ac33b940143614c43\": rpc error: code = NotFound desc = could not find container \"b535d5c7264d6875c6464d6d5e6b6d6d01fd828d88739e2ac33b940143614c43\": container with ID starting with b535d5c7264d6875c6464d6d5e6b6d6d01fd828d88739e2ac33b940143614c43 not found: ID does not exist" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.285303 5120 scope.go:117] "RemoveContainer" containerID="127258b57c230c7843d8cc012a76f9e30a721fab3cab2462fbdac98abf8f8ae9" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.304721 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.306139 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8ee374e-6e54-498b-9c76-2ea7caf3cad8" containerName="cinder-api-log" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.306165 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8ee374e-6e54-498b-9c76-2ea7caf3cad8" containerName="cinder-api-log" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.306182 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e6d012a-b39a-4bfa-ab56-77bc12e2902e" containerName="nova-cell1-conductor-db-sync" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.306192 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e6d012a-b39a-4bfa-ab56-77bc12e2902e" containerName="nova-cell1-conductor-db-sync" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.306213 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8ee374e-6e54-498b-9c76-2ea7caf3cad8" containerName="cinder-api" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.306219 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8ee374e-6e54-498b-9c76-2ea7caf3cad8" containerName="cinder-api" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.306237 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eea6594f-2384-40f5-9061-e3925083e279" containerName="glance-log" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.306244 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="eea6594f-2384-40f5-9061-e3925083e279" containerName="glance-log" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.306268 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4346558c-b16e-474a-b782-569ca0bbb7cd" containerName="nova-cell0-conductor-db-sync" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.306276 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="4346558c-b16e-474a-b782-569ca0bbb7cd" containerName="nova-cell0-conductor-db-sync" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.306304 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48a68bcb-2d44-4992-b9a9-0409c2348fb1" containerName="glance-log" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.306310 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="48a68bcb-2d44-4992-b9a9-0409c2348fb1" containerName="glance-log" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.306339 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48a68bcb-2d44-4992-b9a9-0409c2348fb1" containerName="glance-httpd" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.306347 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="48a68bcb-2d44-4992-b9a9-0409c2348fb1" containerName="glance-httpd" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.306367 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eea6594f-2384-40f5-9061-e3925083e279" containerName="glance-httpd" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.306374 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="eea6594f-2384-40f5-9061-e3925083e279" containerName="glance-httpd" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.306385 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91d6af93-90b1-4d80-86df-11a701664a68" containerName="glance-db-sync" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.306391 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="91d6af93-90b1-4d80-86df-11a701664a68" containerName="glance-db-sync" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.306580 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="48a68bcb-2d44-4992-b9a9-0409c2348fb1" containerName="glance-httpd" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.306596 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="eea6594f-2384-40f5-9061-e3925083e279" containerName="glance-log" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.306607 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="48a68bcb-2d44-4992-b9a9-0409c2348fb1" containerName="glance-log" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.306621 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="4346558c-b16e-474a-b782-569ca0bbb7cd" containerName="nova-cell0-conductor-db-sync" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.306630 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="91d6af93-90b1-4d80-86df-11a701664a68" containerName="glance-db-sync" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.306648 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e8ee374e-6e54-498b-9c76-2ea7caf3cad8" containerName="cinder-api" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.306663 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="eea6594f-2384-40f5-9061-e3925083e279" containerName="glance-httpd" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.306672 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="2e6d012a-b39a-4bfa-ab56-77bc12e2902e" containerName="nova-cell1-conductor-db-sync" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.306687 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e8ee374e-6e54-498b-9c76-2ea7caf3cad8" containerName="cinder-api-log" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.310428 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eea6594f-2384-40f5-9061-e3925083e279-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "eea6594f-2384-40f5-9061-e3925083e279" (UID: "eea6594f-2384-40f5-9061-e3925083e279"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.310841 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eea6594f-2384-40f5-9061-e3925083e279-config-data" (OuterVolumeSpecName: "config-data") pod "eea6594f-2384-40f5-9061-e3925083e279" (UID: "eea6594f-2384-40f5-9061-e3925083e279"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.314024 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/eea6594f-2384-40f5-9061-e3925083e279-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.314105 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4cfbr\" (UniqueName: \"kubernetes.io/projected/eea6594f-2384-40f5-9061-e3925083e279-kube-api-access-4cfbr\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.314120 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/eea6594f-2384-40f5-9061-e3925083e279-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.314130 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/eea6594f-2384-40f5-9061-e3925083e279-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.314138 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eea6594f-2384-40f5-9061-e3925083e279-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.314165 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/eea6594f-2384-40f5-9061-e3925083e279-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.314193 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage19-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") on node \"crc\" " Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.315569 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.318156 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-api-config-data\"" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.326901 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-cinder-public-svc\"" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.327253 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-cinder-internal-svc\"" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.351591 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.377570 5120 scope.go:117] "RemoveContainer" containerID="293a8c9b65d2dc593bd393e16d6b5dfe15f0954f1386ecb80ce43bc0943e1af4" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.385751 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage19-crc" (UniqueName: "kubernetes.io/local-volume/local-storage19-crc") on node "crc" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.419076 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7zz5\" (UniqueName: \"kubernetes.io/projected/2fbd9119-d73e-4c1e-99b9-8f078e2acdfb-kube-api-access-r7zz5\") pod \"cinder-api-0\" (UID: \"2fbd9119-d73e-4c1e-99b9-8f078e2acdfb\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.419125 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/2fbd9119-d73e-4c1e-99b9-8f078e2acdfb-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"2fbd9119-d73e-4c1e-99b9-8f078e2acdfb\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.419157 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/2fbd9119-d73e-4c1e-99b9-8f078e2acdfb-etc-machine-id\") pod \"cinder-api-0\" (UID: \"2fbd9119-d73e-4c1e-99b9-8f078e2acdfb\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.419176 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2fbd9119-d73e-4c1e-99b9-8f078e2acdfb-config-data\") pod \"cinder-api-0\" (UID: \"2fbd9119-d73e-4c1e-99b9-8f078e2acdfb\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.419255 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2fbd9119-d73e-4c1e-99b9-8f078e2acdfb-scripts\") pod \"cinder-api-0\" (UID: \"2fbd9119-d73e-4c1e-99b9-8f078e2acdfb\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.419295 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/2fbd9119-d73e-4c1e-99b9-8f078e2acdfb-public-tls-certs\") pod \"cinder-api-0\" (UID: \"2fbd9119-d73e-4c1e-99b9-8f078e2acdfb\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.419374 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/2fbd9119-d73e-4c1e-99b9-8f078e2acdfb-config-data-custom\") pod \"cinder-api-0\" (UID: \"2fbd9119-d73e-4c1e-99b9-8f078e2acdfb\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.419395 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2fbd9119-d73e-4c1e-99b9-8f078e2acdfb-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"2fbd9119-d73e-4c1e-99b9-8f078e2acdfb\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.419431 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2fbd9119-d73e-4c1e-99b9-8f078e2acdfb-logs\") pod \"cinder-api-0\" (UID: \"2fbd9119-d73e-4c1e-99b9-8f078e2acdfb\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.419488 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage19-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.461586 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.493616 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.520881 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/2fbd9119-d73e-4c1e-99b9-8f078e2acdfb-config-data-custom\") pod \"cinder-api-0\" (UID: \"2fbd9119-d73e-4c1e-99b9-8f078e2acdfb\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.520927 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2fbd9119-d73e-4c1e-99b9-8f078e2acdfb-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"2fbd9119-d73e-4c1e-99b9-8f078e2acdfb\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.520965 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2fbd9119-d73e-4c1e-99b9-8f078e2acdfb-logs\") pod \"cinder-api-0\" (UID: \"2fbd9119-d73e-4c1e-99b9-8f078e2acdfb\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.521063 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r7zz5\" (UniqueName: \"kubernetes.io/projected/2fbd9119-d73e-4c1e-99b9-8f078e2acdfb-kube-api-access-r7zz5\") pod \"cinder-api-0\" (UID: \"2fbd9119-d73e-4c1e-99b9-8f078e2acdfb\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.521095 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/2fbd9119-d73e-4c1e-99b9-8f078e2acdfb-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"2fbd9119-d73e-4c1e-99b9-8f078e2acdfb\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.521126 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/2fbd9119-d73e-4c1e-99b9-8f078e2acdfb-etc-machine-id\") pod \"cinder-api-0\" (UID: \"2fbd9119-d73e-4c1e-99b9-8f078e2acdfb\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.521148 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2fbd9119-d73e-4c1e-99b9-8f078e2acdfb-config-data\") pod \"cinder-api-0\" (UID: \"2fbd9119-d73e-4c1e-99b9-8f078e2acdfb\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.521256 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2fbd9119-d73e-4c1e-99b9-8f078e2acdfb-scripts\") pod \"cinder-api-0\" (UID: \"2fbd9119-d73e-4c1e-99b9-8f078e2acdfb\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.521323 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/2fbd9119-d73e-4c1e-99b9-8f078e2acdfb-public-tls-certs\") pod \"cinder-api-0\" (UID: \"2fbd9119-d73e-4c1e-99b9-8f078e2acdfb\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.527403 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/2fbd9119-d73e-4c1e-99b9-8f078e2acdfb-public-tls-certs\") pod \"cinder-api-0\" (UID: \"2fbd9119-d73e-4c1e-99b9-8f078e2acdfb\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.527708 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/2fbd9119-d73e-4c1e-99b9-8f078e2acdfb-etc-machine-id\") pod \"cinder-api-0\" (UID: \"2fbd9119-d73e-4c1e-99b9-8f078e2acdfb\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.529223 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2fbd9119-d73e-4c1e-99b9-8f078e2acdfb-logs\") pod \"cinder-api-0\" (UID: \"2fbd9119-d73e-4c1e-99b9-8f078e2acdfb\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.529287 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.532320 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/2fbd9119-d73e-4c1e-99b9-8f078e2acdfb-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"2fbd9119-d73e-4c1e-99b9-8f078e2acdfb\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.532714 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2fbd9119-d73e-4c1e-99b9-8f078e2acdfb-config-data\") pod \"cinder-api-0\" (UID: \"2fbd9119-d73e-4c1e-99b9-8f078e2acdfb\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.538284 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2fbd9119-d73e-4c1e-99b9-8f078e2acdfb-scripts\") pod \"cinder-api-0\" (UID: \"2fbd9119-d73e-4c1e-99b9-8f078e2acdfb\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.538494 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/2fbd9119-d73e-4c1e-99b9-8f078e2acdfb-config-data-custom\") pod \"cinder-api-0\" (UID: \"2fbd9119-d73e-4c1e-99b9-8f078e2acdfb\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.538969 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2fbd9119-d73e-4c1e-99b9-8f078e2acdfb-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"2fbd9119-d73e-4c1e-99b9-8f078e2acdfb\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.558054 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7zz5\" (UniqueName: \"kubernetes.io/projected/2fbd9119-d73e-4c1e-99b9-8f078e2acdfb-kube-api-access-r7zz5\") pod \"cinder-api-0\" (UID: \"2fbd9119-d73e-4c1e-99b9-8f078e2acdfb\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.564086 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.564239 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.571472 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-external-config-data\"" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.571673 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-public-svc\"" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.622605 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/06e4bc0a-e757-40b7-8ed8-693dd20c185a-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"06e4bc0a-e757-40b7-8ed8-693dd20c185a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.631987 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"glance-default-external-api-0\" (UID: \"06e4bc0a-e757-40b7-8ed8-693dd20c185a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.632176 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/06e4bc0a-e757-40b7-8ed8-693dd20c185a-logs\") pod \"glance-default-external-api-0\" (UID: \"06e4bc0a-e757-40b7-8ed8-693dd20c185a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.632286 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/06e4bc0a-e757-40b7-8ed8-693dd20c185a-config-data\") pod \"glance-default-external-api-0\" (UID: \"06e4bc0a-e757-40b7-8ed8-693dd20c185a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.632340 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6jvt\" (UniqueName: \"kubernetes.io/projected/06e4bc0a-e757-40b7-8ed8-693dd20c185a-kube-api-access-n6jvt\") pod \"glance-default-external-api-0\" (UID: \"06e4bc0a-e757-40b7-8ed8-693dd20c185a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.632396 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/06e4bc0a-e757-40b7-8ed8-693dd20c185a-scripts\") pod \"glance-default-external-api-0\" (UID: \"06e4bc0a-e757-40b7-8ed8-693dd20c185a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.632423 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/06e4bc0a-e757-40b7-8ed8-693dd20c185a-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"06e4bc0a-e757-40b7-8ed8-693dd20c185a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.632617 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/06e4bc0a-e757-40b7-8ed8-693dd20c185a-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"06e4bc0a-e757-40b7-8ed8-693dd20c185a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.651161 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.744623 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/06e4bc0a-e757-40b7-8ed8-693dd20c185a-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"06e4bc0a-e757-40b7-8ed8-693dd20c185a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.744729 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/06e4bc0a-e757-40b7-8ed8-693dd20c185a-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"06e4bc0a-e757-40b7-8ed8-693dd20c185a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.744902 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"glance-default-external-api-0\" (UID: \"06e4bc0a-e757-40b7-8ed8-693dd20c185a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.744984 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/06e4bc0a-e757-40b7-8ed8-693dd20c185a-logs\") pod \"glance-default-external-api-0\" (UID: \"06e4bc0a-e757-40b7-8ed8-693dd20c185a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.745073 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/06e4bc0a-e757-40b7-8ed8-693dd20c185a-config-data\") pod \"glance-default-external-api-0\" (UID: \"06e4bc0a-e757-40b7-8ed8-693dd20c185a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.745125 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n6jvt\" (UniqueName: \"kubernetes.io/projected/06e4bc0a-e757-40b7-8ed8-693dd20c185a-kube-api-access-n6jvt\") pod \"glance-default-external-api-0\" (UID: \"06e4bc0a-e757-40b7-8ed8-693dd20c185a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.745176 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/06e4bc0a-e757-40b7-8ed8-693dd20c185a-scripts\") pod \"glance-default-external-api-0\" (UID: \"06e4bc0a-e757-40b7-8ed8-693dd20c185a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.745202 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/06e4bc0a-e757-40b7-8ed8-693dd20c185a-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"06e4bc0a-e757-40b7-8ed8-693dd20c185a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.751633 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/06e4bc0a-e757-40b7-8ed8-693dd20c185a-logs\") pod \"glance-default-external-api-0\" (UID: \"06e4bc0a-e757-40b7-8ed8-693dd20c185a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.753049 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/06e4bc0a-e757-40b7-8ed8-693dd20c185a-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"06e4bc0a-e757-40b7-8ed8-693dd20c185a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.757681 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"glance-default-external-api-0\" (UID: \"06e4bc0a-e757-40b7-8ed8-693dd20c185a\") device mount path \"/mnt/openstack/pv01\"" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.758617 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/06e4bc0a-e757-40b7-8ed8-693dd20c185a-config-data\") pod \"glance-default-external-api-0\" (UID: \"06e4bc0a-e757-40b7-8ed8-693dd20c185a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.759565 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/06e4bc0a-e757-40b7-8ed8-693dd20c185a-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"06e4bc0a-e757-40b7-8ed8-693dd20c185a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.765710 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/06e4bc0a-e757-40b7-8ed8-693dd20c185a-scripts\") pod \"glance-default-external-api-0\" (UID: \"06e4bc0a-e757-40b7-8ed8-693dd20c185a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.772899 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/06e4bc0a-e757-40b7-8ed8-693dd20c185a-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"06e4bc0a-e757-40b7-8ed8-693dd20c185a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.789897 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6jvt\" (UniqueName: \"kubernetes.io/projected/06e4bc0a-e757-40b7-8ed8-693dd20c185a-kube-api-access-n6jvt\") pod \"glance-default-external-api-0\" (UID: \"06e4bc0a-e757-40b7-8ed8-693dd20c185a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.822593 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"glance-default-external-api-0\" (UID: \"06e4bc0a-e757-40b7-8ed8-693dd20c185a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.868116 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.878382 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-vqvr9" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.895950 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-bmfrv" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.898378 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.949245 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d9bb0c66-45a6-4915-8878-03f17055f4ab-combined-ca-bundle\") pod \"d9bb0c66-45a6-4915-8878-03f17055f4ab\" (UID: \"d9bb0c66-45a6-4915-8878-03f17055f4ab\") " Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.949660 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gzrbl\" (UniqueName: \"kubernetes.io/projected/84f67b87-419d-457b-a40c-b47e8406d39c-kube-api-access-gzrbl\") pod \"84f67b87-419d-457b-a40c-b47e8406d39c\" (UID: \"84f67b87-419d-457b-a40c-b47e8406d39c\") " Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.949693 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/84f67b87-419d-457b-a40c-b47e8406d39c-config-data\") pod \"84f67b87-419d-457b-a40c-b47e8406d39c\" (UID: \"84f67b87-419d-457b-a40c-b47e8406d39c\") " Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.949798 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t5xzj\" (UniqueName: \"kubernetes.io/projected/d9bb0c66-45a6-4915-8878-03f17055f4ab-kube-api-access-t5xzj\") pod \"d9bb0c66-45a6-4915-8878-03f17055f4ab\" (UID: \"d9bb0c66-45a6-4915-8878-03f17055f4ab\") " Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.949838 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d9bb0c66-45a6-4915-8878-03f17055f4ab-config-data\") pod \"d9bb0c66-45a6-4915-8878-03f17055f4ab\" (UID: \"d9bb0c66-45a6-4915-8878-03f17055f4ab\") " Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.949886 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d0d98630-1fca-41f0-ba40-03f42f303121-combined-ca-bundle\") pod \"d0d98630-1fca-41f0-ba40-03f42f303121\" (UID: \"d0d98630-1fca-41f0-ba40-03f42f303121\") " Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.949951 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d0d98630-1fca-41f0-ba40-03f42f303121-logs\") pod \"d0d98630-1fca-41f0-ba40-03f42f303121\" (UID: \"d0d98630-1fca-41f0-ba40-03f42f303121\") " Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.950031 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-87hzc\" (UniqueName: \"kubernetes.io/projected/d0d98630-1fca-41f0-ba40-03f42f303121-kube-api-access-87hzc\") pod \"d0d98630-1fca-41f0-ba40-03f42f303121\" (UID: \"d0d98630-1fca-41f0-ba40-03f42f303121\") " Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.950131 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d0d98630-1fca-41f0-ba40-03f42f303121-scripts\") pod \"d0d98630-1fca-41f0-ba40-03f42f303121\" (UID: \"d0d98630-1fca-41f0-ba40-03f42f303121\") " Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.950187 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d0d98630-1fca-41f0-ba40-03f42f303121-config-data\") pod \"d0d98630-1fca-41f0-ba40-03f42f303121\" (UID: \"d0d98630-1fca-41f0-ba40-03f42f303121\") " Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.950289 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/84f67b87-419d-457b-a40c-b47e8406d39c-combined-ca-bundle\") pod \"84f67b87-419d-457b-a40c-b47e8406d39c\" (UID: \"84f67b87-419d-457b-a40c-b47e8406d39c\") " Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.957380 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0d98630-1fca-41f0-ba40-03f42f303121-kube-api-access-87hzc" (OuterVolumeSpecName: "kube-api-access-87hzc") pod "d0d98630-1fca-41f0-ba40-03f42f303121" (UID: "d0d98630-1fca-41f0-ba40-03f42f303121"). InnerVolumeSpecName "kube-api-access-87hzc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.957748 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0d98630-1fca-41f0-ba40-03f42f303121-logs" (OuterVolumeSpecName: "logs") pod "d0d98630-1fca-41f0-ba40-03f42f303121" (UID: "d0d98630-1fca-41f0-ba40-03f42f303121"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.964063 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9bb0c66-45a6-4915-8878-03f17055f4ab-kube-api-access-t5xzj" (OuterVolumeSpecName: "kube-api-access-t5xzj") pod "d9bb0c66-45a6-4915-8878-03f17055f4ab" (UID: "d9bb0c66-45a6-4915-8878-03f17055f4ab"). InnerVolumeSpecName "kube-api-access-t5xzj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.981220 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0d98630-1fca-41f0-ba40-03f42f303121-scripts" (OuterVolumeSpecName: "scripts") pod "d0d98630-1fca-41f0-ba40-03f42f303121" (UID: "d0d98630-1fca-41f0-ba40-03f42f303121"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:36:29 crc kubenswrapper[5120]: I0316 16:36:29.981482 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84f67b87-419d-457b-a40c-b47e8406d39c-kube-api-access-gzrbl" (OuterVolumeSpecName: "kube-api-access-gzrbl") pod "84f67b87-419d-457b-a40c-b47e8406d39c" (UID: "84f67b87-419d-457b-a40c-b47e8406d39c"). InnerVolumeSpecName "kube-api-access-gzrbl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.009167 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/84f67b87-419d-457b-a40c-b47e8406d39c-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "84f67b87-419d-457b-a40c-b47e8406d39c" (UID: "84f67b87-419d-457b-a40c-b47e8406d39c"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.019945 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0d98630-1fca-41f0-ba40-03f42f303121-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "d0d98630-1fca-41f0-ba40-03f42f303121" (UID: "d0d98630-1fca-41f0-ba40-03f42f303121"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.041906 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/84f67b87-419d-457b-a40c-b47e8406d39c-config-data" (OuterVolumeSpecName: "config-data") pod "84f67b87-419d-457b-a40c-b47e8406d39c" (UID: "84f67b87-419d-457b-a40c-b47e8406d39c"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.046915 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d9bb0c66-45a6-4915-8878-03f17055f4ab-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "d9bb0c66-45a6-4915-8878-03f17055f4ab" (UID: "d9bb0c66-45a6-4915-8878-03f17055f4ab"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.055006 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d9bb0c66-45a6-4915-8878-03f17055f4ab-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.057666 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gzrbl\" (UniqueName: \"kubernetes.io/projected/84f67b87-419d-457b-a40c-b47e8406d39c-kube-api-access-gzrbl\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.057787 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/84f67b87-419d-457b-a40c-b47e8406d39c-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.057917 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t5xzj\" (UniqueName: \"kubernetes.io/projected/d9bb0c66-45a6-4915-8878-03f17055f4ab-kube-api-access-t5xzj\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.058086 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d0d98630-1fca-41f0-ba40-03f42f303121-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.058219 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d0d98630-1fca-41f0-ba40-03f42f303121-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.058329 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-87hzc\" (UniqueName: \"kubernetes.io/projected/d0d98630-1fca-41f0-ba40-03f42f303121-kube-api-access-87hzc\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.058434 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d0d98630-1fca-41f0-ba40-03f42f303121-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.058562 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/84f67b87-419d-457b-a40c-b47e8406d39c-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.084665 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0d98630-1fca-41f0-ba40-03f42f303121-config-data" (OuterVolumeSpecName: "config-data") pod "d0d98630-1fca-41f0-ba40-03f42f303121" (UID: "d0d98630-1fca-41f0-ba40-03f42f303121"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.106155 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d9bb0c66-45a6-4915-8878-03f17055f4ab-config-data" (OuterVolumeSpecName: "config-data") pod "d9bb0c66-45a6-4915-8878-03f17055f4ab" (UID: "d9bb0c66-45a6-4915-8878-03f17055f4ab"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.138345 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.151142 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"eea6594f-2384-40f5-9061-e3925083e279","Type":"ContainerDied","Data":"b98cb9933dd96e0dc2187ba1a89b78b4fca5cd424ce2c02f561b0a2519487dce"} Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.151192 5120 scope.go:117] "RemoveContainer" containerID="5093e2092031a93c0f43b9aa524141d4066c5a5b18cd23e768cf403e05b7da66" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.151312 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.163118 5120 generic.go:358] "Generic (PLEG): container finished" podID="e88b61c1-a3d0-4b23-820a-b117cf5b90c1" containerID="be1a1d5e32a89360e321dcc84bcfed9e4606efded0431d2d9b776329af9d0675" exitCode=0 Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.163430 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"e88b61c1-a3d0-4b23-820a-b117cf5b90c1","Type":"ContainerDied","Data":"be1a1d5e32a89360e321dcc84bcfed9e4606efded0431d2d9b776329af9d0675"} Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.163469 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"e88b61c1-a3d0-4b23-820a-b117cf5b90c1","Type":"ContainerDied","Data":"30bfec87cd6562510e1cea987111107cec023effe499c68e52895663e25cd257"} Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.163569 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.165160 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d9bb0c66-45a6-4915-8878-03f17055f4ab-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.165196 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d0d98630-1fca-41f0-ba40-03f42f303121-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.184036 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-vqvr9" event={"ID":"d9bb0c66-45a6-4915-8878-03f17055f4ab","Type":"ContainerDied","Data":"91a93df38fab37ac85ad3da31b55d82da93c031bdc678b706e7886bf0aaa6368"} Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.184069 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="91a93df38fab37ac85ad3da31b55d82da93c031bdc678b706e7886bf0aaa6368" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.184120 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-vqvr9" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.202064 5120 generic.go:358] "Generic (PLEG): container finished" podID="84f67b87-419d-457b-a40c-b47e8406d39c" containerID="20b14cb73912a1ea8aaef52cb856cecb710f82e72aeb94e10fec11a89f661054" exitCode=0 Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.202123 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"84f67b87-419d-457b-a40c-b47e8406d39c","Type":"ContainerDied","Data":"20b14cb73912a1ea8aaef52cb856cecb710f82e72aeb94e10fec11a89f661054"} Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.202146 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"84f67b87-419d-457b-a40c-b47e8406d39c","Type":"ContainerDied","Data":"177d6605320fd629c2fc0ed86661de02605dd521b4cfe567ea8ef6002666d57f"} Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.202212 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.211970 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-bmfrv" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.212015 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-bmfrv" event={"ID":"d0d98630-1fca-41f0-ba40-03f42f303121","Type":"ContainerDied","Data":"695f4e6057e254dadc80ee04deb7d1eeaa00dae619ca2a29d7fd7499f0447a7d"} Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.212036 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="695f4e6057e254dadc80ee04deb7d1eeaa00dae619ca2a29d7fd7499f0447a7d" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.233382 5120 scope.go:117] "RemoveContainer" containerID="a090be84f2bc4f63da6fe24ea6fd1308ca4da6645a70816deb3537d0041816e9" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.240401 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-747d4cf944-dk26n"] Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.241564 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9bb0c66-45a6-4915-8878-03f17055f4ab" containerName="keystone-db-sync" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.241733 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9bb0c66-45a6-4915-8878-03f17055f4ab" containerName="keystone-db-sync" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.241839 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e88b61c1-a3d0-4b23-820a-b117cf5b90c1" containerName="nova-cell1-conductor-conductor" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.241920 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e88b61c1-a3d0-4b23-820a-b117cf5b90c1" containerName="nova-cell1-conductor-conductor" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.241982 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84f67b87-419d-457b-a40c-b47e8406d39c" containerName="nova-cell0-conductor-conductor" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.242034 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="84f67b87-419d-457b-a40c-b47e8406d39c" containerName="nova-cell0-conductor-conductor" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.242099 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0d98630-1fca-41f0-ba40-03f42f303121" containerName="placement-db-sync" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.242164 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0d98630-1fca-41f0-ba40-03f42f303121" containerName="placement-db-sync" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.242380 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="84f67b87-419d-457b-a40c-b47e8406d39c" containerName="nova-cell0-conductor-conductor" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.242459 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="d9bb0c66-45a6-4915-8878-03f17055f4ab" containerName="keystone-db-sync" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.242529 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="d0d98630-1fca-41f0-ba40-03f42f303121" containerName="placement-db-sync" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.242594 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e88b61c1-a3d0-4b23-820a-b117cf5b90c1" containerName="nova-cell1-conductor-conductor" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.261400 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-747d4cf944-dk26n" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.262682 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-v6zxd"] Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.267564 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e88b61c1-a3d0-4b23-820a-b117cf5b90c1-config-data\") pod \"e88b61c1-a3d0-4b23-820a-b117cf5b90c1\" (UID: \"e88b61c1-a3d0-4b23-820a-b117cf5b90c1\") " Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.268640 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8xcvk\" (UniqueName: \"kubernetes.io/projected/e88b61c1-a3d0-4b23-820a-b117cf5b90c1-kube-api-access-8xcvk\") pod \"e88b61c1-a3d0-4b23-820a-b117cf5b90c1\" (UID: \"e88b61c1-a3d0-4b23-820a-b117cf5b90c1\") " Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.268974 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e88b61c1-a3d0-4b23-820a-b117cf5b90c1-combined-ca-bundle\") pod \"e88b61c1-a3d0-4b23-820a-b117cf5b90c1\" (UID: \"e88b61c1-a3d0-4b23-820a-b117cf5b90c1\") " Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.317809 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e88b61c1-a3d0-4b23-820a-b117cf5b90c1-kube-api-access-8xcvk" (OuterVolumeSpecName: "kube-api-access-8xcvk") pod "e88b61c1-a3d0-4b23-820a-b117cf5b90c1" (UID: "e88b61c1-a3d0-4b23-820a-b117cf5b90c1"). InnerVolumeSpecName "kube-api-access-8xcvk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.327932 5120 scope.go:117] "RemoveContainer" containerID="be1a1d5e32a89360e321dcc84bcfed9e4606efded0431d2d9b776329af9d0675" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.340116 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-v6zxd"] Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.340922 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e88b61c1-a3d0-4b23-820a-b117cf5b90c1-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e88b61c1-a3d0-4b23-820a-b117cf5b90c1" (UID: "e88b61c1-a3d0-4b23-820a-b117cf5b90c1"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.363928 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e88b61c1-a3d0-4b23-820a-b117cf5b90c1-config-data" (OuterVolumeSpecName: "config-data") pod "e88b61c1-a3d0-4b23-820a-b117cf5b90c1" (UID: "e88b61c1-a3d0-4b23-820a-b117cf5b90c1"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.373611 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wssj\" (UniqueName: \"kubernetes.io/projected/e3236580-0d7f-4a04-ae0f-5ae8b073d6b7-kube-api-access-5wssj\") pod \"placement-747d4cf944-dk26n\" (UID: \"e3236580-0d7f-4a04-ae0f-5ae8b073d6b7\") " pod="openstack-kuttl-tests/placement-747d4cf944-dk26n" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.373712 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e3236580-0d7f-4a04-ae0f-5ae8b073d6b7-internal-tls-certs\") pod \"placement-747d4cf944-dk26n\" (UID: \"e3236580-0d7f-4a04-ae0f-5ae8b073d6b7\") " pod="openstack-kuttl-tests/placement-747d4cf944-dk26n" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.373770 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e3236580-0d7f-4a04-ae0f-5ae8b073d6b7-logs\") pod \"placement-747d4cf944-dk26n\" (UID: \"e3236580-0d7f-4a04-ae0f-5ae8b073d6b7\") " pod="openstack-kuttl-tests/placement-747d4cf944-dk26n" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.373830 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e3236580-0d7f-4a04-ae0f-5ae8b073d6b7-config-data\") pod \"placement-747d4cf944-dk26n\" (UID: \"e3236580-0d7f-4a04-ae0f-5ae8b073d6b7\") " pod="openstack-kuttl-tests/placement-747d4cf944-dk26n" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.373875 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e3236580-0d7f-4a04-ae0f-5ae8b073d6b7-scripts\") pod \"placement-747d4cf944-dk26n\" (UID: \"e3236580-0d7f-4a04-ae0f-5ae8b073d6b7\") " pod="openstack-kuttl-tests/placement-747d4cf944-dk26n" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.373975 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e3236580-0d7f-4a04-ae0f-5ae8b073d6b7-combined-ca-bundle\") pod \"placement-747d4cf944-dk26n\" (UID: \"e3236580-0d7f-4a04-ae0f-5ae8b073d6b7\") " pod="openstack-kuttl-tests/placement-747d4cf944-dk26n" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.374031 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e3236580-0d7f-4a04-ae0f-5ae8b073d6b7-public-tls-certs\") pod \"placement-747d4cf944-dk26n\" (UID: \"e3236580-0d7f-4a04-ae0f-5ae8b073d6b7\") " pod="openstack-kuttl-tests/placement-747d4cf944-dk26n" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.374170 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8xcvk\" (UniqueName: \"kubernetes.io/projected/e88b61c1-a3d0-4b23-820a-b117cf5b90c1-kube-api-access-8xcvk\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.374185 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e88b61c1-a3d0-4b23-820a-b117cf5b90c1-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.374195 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e88b61c1-a3d0-4b23-820a-b117cf5b90c1-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.401125 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-747d4cf944-dk26n"] Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.408215 5120 scope.go:117] "RemoveContainer" containerID="be1a1d5e32a89360e321dcc84bcfed9e4606efded0431d2d9b776329af9d0675" Mar 16 16:36:30 crc kubenswrapper[5120]: E0316 16:36:30.410321 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"be1a1d5e32a89360e321dcc84bcfed9e4606efded0431d2d9b776329af9d0675\": container with ID starting with be1a1d5e32a89360e321dcc84bcfed9e4606efded0431d2d9b776329af9d0675 not found: ID does not exist" containerID="be1a1d5e32a89360e321dcc84bcfed9e4606efded0431d2d9b776329af9d0675" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.410500 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be1a1d5e32a89360e321dcc84bcfed9e4606efded0431d2d9b776329af9d0675"} err="failed to get container status \"be1a1d5e32a89360e321dcc84bcfed9e4606efded0431d2d9b776329af9d0675\": rpc error: code = NotFound desc = could not find container \"be1a1d5e32a89360e321dcc84bcfed9e4606efded0431d2d9b776329af9d0675\": container with ID starting with be1a1d5e32a89360e321dcc84bcfed9e4606efded0431d2d9b776329af9d0675 not found: ID does not exist" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.410740 5120 scope.go:117] "RemoveContainer" containerID="20b14cb73912a1ea8aaef52cb856cecb710f82e72aeb94e10fec11a89f661054" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.416783 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.447675 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.456018 5120 scope.go:117] "RemoveContainer" containerID="20b14cb73912a1ea8aaef52cb856cecb710f82e72aeb94e10fec11a89f661054" Mar 16 16:36:30 crc kubenswrapper[5120]: E0316 16:36:30.456421 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"20b14cb73912a1ea8aaef52cb856cecb710f82e72aeb94e10fec11a89f661054\": container with ID starting with 20b14cb73912a1ea8aaef52cb856cecb710f82e72aeb94e10fec11a89f661054 not found: ID does not exist" containerID="20b14cb73912a1ea8aaef52cb856cecb710f82e72aeb94e10fec11a89f661054" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.456468 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20b14cb73912a1ea8aaef52cb856cecb710f82e72aeb94e10fec11a89f661054"} err="failed to get container status \"20b14cb73912a1ea8aaef52cb856cecb710f82e72aeb94e10fec11a89f661054\": rpc error: code = NotFound desc = could not find container \"20b14cb73912a1ea8aaef52cb856cecb710f82e72aeb94e10fec11a89f661054\": container with ID starting with 20b14cb73912a1ea8aaef52cb856cecb710f82e72aeb94e10fec11a89f661054 not found: ID does not exist" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.466024 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.474738 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.475991 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e3236580-0d7f-4a04-ae0f-5ae8b073d6b7-public-tls-certs\") pod \"placement-747d4cf944-dk26n\" (UID: \"e3236580-0d7f-4a04-ae0f-5ae8b073d6b7\") " pod="openstack-kuttl-tests/placement-747d4cf944-dk26n" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.476156 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5wssj\" (UniqueName: \"kubernetes.io/projected/e3236580-0d7f-4a04-ae0f-5ae8b073d6b7-kube-api-access-5wssj\") pod \"placement-747d4cf944-dk26n\" (UID: \"e3236580-0d7f-4a04-ae0f-5ae8b073d6b7\") " pod="openstack-kuttl-tests/placement-747d4cf944-dk26n" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.476227 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e3236580-0d7f-4a04-ae0f-5ae8b073d6b7-internal-tls-certs\") pod \"placement-747d4cf944-dk26n\" (UID: \"e3236580-0d7f-4a04-ae0f-5ae8b073d6b7\") " pod="openstack-kuttl-tests/placement-747d4cf944-dk26n" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.476253 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e3236580-0d7f-4a04-ae0f-5ae8b073d6b7-logs\") pod \"placement-747d4cf944-dk26n\" (UID: \"e3236580-0d7f-4a04-ae0f-5ae8b073d6b7\") " pod="openstack-kuttl-tests/placement-747d4cf944-dk26n" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.476293 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e3236580-0d7f-4a04-ae0f-5ae8b073d6b7-config-data\") pod \"placement-747d4cf944-dk26n\" (UID: \"e3236580-0d7f-4a04-ae0f-5ae8b073d6b7\") " pod="openstack-kuttl-tests/placement-747d4cf944-dk26n" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.476321 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e3236580-0d7f-4a04-ae0f-5ae8b073d6b7-scripts\") pod \"placement-747d4cf944-dk26n\" (UID: \"e3236580-0d7f-4a04-ae0f-5ae8b073d6b7\") " pod="openstack-kuttl-tests/placement-747d4cf944-dk26n" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.476403 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e3236580-0d7f-4a04-ae0f-5ae8b073d6b7-combined-ca-bundle\") pod \"placement-747d4cf944-dk26n\" (UID: \"e3236580-0d7f-4a04-ae0f-5ae8b073d6b7\") " pod="openstack-kuttl-tests/placement-747d4cf944-dk26n" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.476735 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-internal-config-data\"" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.477113 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e3236580-0d7f-4a04-ae0f-5ae8b073d6b7-logs\") pod \"placement-747d4cf944-dk26n\" (UID: \"e3236580-0d7f-4a04-ae0f-5ae8b073d6b7\") " pod="openstack-kuttl-tests/placement-747d4cf944-dk26n" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.478187 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-internal-svc\"" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.481739 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.482400 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e3236580-0d7f-4a04-ae0f-5ae8b073d6b7-config-data\") pod \"placement-747d4cf944-dk26n\" (UID: \"e3236580-0d7f-4a04-ae0f-5ae8b073d6b7\") " pod="openstack-kuttl-tests/placement-747d4cf944-dk26n" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.482680 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e3236580-0d7f-4a04-ae0f-5ae8b073d6b7-public-tls-certs\") pod \"placement-747d4cf944-dk26n\" (UID: \"e3236580-0d7f-4a04-ae0f-5ae8b073d6b7\") " pod="openstack-kuttl-tests/placement-747d4cf944-dk26n" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.484468 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e3236580-0d7f-4a04-ae0f-5ae8b073d6b7-internal-tls-certs\") pod \"placement-747d4cf944-dk26n\" (UID: \"e3236580-0d7f-4a04-ae0f-5ae8b073d6b7\") " pod="openstack-kuttl-tests/placement-747d4cf944-dk26n" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.492438 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e3236580-0d7f-4a04-ae0f-5ae8b073d6b7-scripts\") pod \"placement-747d4cf944-dk26n\" (UID: \"e3236580-0d7f-4a04-ae0f-5ae8b073d6b7\") " pod="openstack-kuttl-tests/placement-747d4cf944-dk26n" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.493299 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e3236580-0d7f-4a04-ae0f-5ae8b073d6b7-combined-ca-bundle\") pod \"placement-747d4cf944-dk26n\" (UID: \"e3236580-0d7f-4a04-ae0f-5ae8b073d6b7\") " pod="openstack-kuttl-tests/placement-747d4cf944-dk26n" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.493584 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.500368 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wssj\" (UniqueName: \"kubernetes.io/projected/e3236580-0d7f-4a04-ae0f-5ae8b073d6b7-kube-api-access-5wssj\") pod \"placement-747d4cf944-dk26n\" (UID: \"e3236580-0d7f-4a04-ae0f-5ae8b073d6b7\") " pod="openstack-kuttl-tests/placement-747d4cf944-dk26n" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.522851 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.564794 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.572984 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.575908 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-conductor-config-data\"" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.581102 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6lw29\" (UniqueName: \"kubernetes.io/projected/be8b10ce-e42f-4650-bc2f-96fe51dc224c-kube-api-access-6lw29\") pod \"glance-default-internal-api-0\" (UID: \"be8b10ce-e42f-4650-bc2f-96fe51dc224c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.581180 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/be8b10ce-e42f-4650-bc2f-96fe51dc224c-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"be8b10ce-e42f-4650-bc2f-96fe51dc224c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.581246 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage19-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") pod \"glance-default-internal-api-0\" (UID: \"be8b10ce-e42f-4650-bc2f-96fe51dc224c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.581431 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/be8b10ce-e42f-4650-bc2f-96fe51dc224c-logs\") pod \"glance-default-internal-api-0\" (UID: \"be8b10ce-e42f-4650-bc2f-96fe51dc224c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.581477 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/be8b10ce-e42f-4650-bc2f-96fe51dc224c-config-data\") pod \"glance-default-internal-api-0\" (UID: \"be8b10ce-e42f-4650-bc2f-96fe51dc224c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.581578 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/be8b10ce-e42f-4650-bc2f-96fe51dc224c-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"be8b10ce-e42f-4650-bc2f-96fe51dc224c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.581726 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/be8b10ce-e42f-4650-bc2f-96fe51dc224c-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"be8b10ce-e42f-4650-bc2f-96fe51dc224c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.581747 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/be8b10ce-e42f-4650-bc2f-96fe51dc224c-scripts\") pod \"glance-default-internal-api-0\" (UID: \"be8b10ce-e42f-4650-bc2f-96fe51dc224c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.582173 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.610661 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-747d4cf944-dk26n" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.626433 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-xn726"] Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.635189 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-xn726" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.640022 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"osp-secret\"" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.644145 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-xn726"] Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.660958 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.684063 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="48a68bcb-2d44-4992-b9a9-0409c2348fb1" path="/var/lib/kubelet/pods/48a68bcb-2d44-4992-b9a9-0409c2348fb1/volumes" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.684360 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/fec060e6-11fd-4d16-8640-fd02366a7601-fernet-keys\") pod \"keystone-bootstrap-xn726\" (UID: \"fec060e6-11fd-4d16-8640-fd02366a7601\") " pod="openstack-kuttl-tests/keystone-bootstrap-xn726" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.684460 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/be8b10ce-e42f-4650-bc2f-96fe51dc224c-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"be8b10ce-e42f-4650-bc2f-96fe51dc224c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.684491 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage19-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") pod \"glance-default-internal-api-0\" (UID: \"be8b10ce-e42f-4650-bc2f-96fe51dc224c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.684510 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/fec060e6-11fd-4d16-8640-fd02366a7601-scripts\") pod \"keystone-bootstrap-xn726\" (UID: \"fec060e6-11fd-4d16-8640-fd02366a7601\") " pod="openstack-kuttl-tests/keystone-bootstrap-xn726" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.684570 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nk9pr\" (UniqueName: \"kubernetes.io/projected/fec060e6-11fd-4d16-8640-fd02366a7601-kube-api-access-nk9pr\") pod \"keystone-bootstrap-xn726\" (UID: \"fec060e6-11fd-4d16-8640-fd02366a7601\") " pod="openstack-kuttl-tests/keystone-bootstrap-xn726" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.684605 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/be8b10ce-e42f-4650-bc2f-96fe51dc224c-logs\") pod \"glance-default-internal-api-0\" (UID: \"be8b10ce-e42f-4650-bc2f-96fe51dc224c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.684640 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/be8b10ce-e42f-4650-bc2f-96fe51dc224c-config-data\") pod \"glance-default-internal-api-0\" (UID: \"be8b10ce-e42f-4650-bc2f-96fe51dc224c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.684699 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fec060e6-11fd-4d16-8640-fd02366a7601-combined-ca-bundle\") pod \"keystone-bootstrap-xn726\" (UID: \"fec060e6-11fd-4d16-8640-fd02366a7601\") " pod="openstack-kuttl-tests/keystone-bootstrap-xn726" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.684736 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/be8b10ce-e42f-4650-bc2f-96fe51dc224c-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"be8b10ce-e42f-4650-bc2f-96fe51dc224c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.684795 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fec060e6-11fd-4d16-8640-fd02366a7601-config-data\") pod \"keystone-bootstrap-xn726\" (UID: \"fec060e6-11fd-4d16-8640-fd02366a7601\") " pod="openstack-kuttl-tests/keystone-bootstrap-xn726" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.684849 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dc7435f2-f650-416c-b0db-53082105f13b-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"dc7435f2-f650-416c-b0db-53082105f13b\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.684872 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/be8b10ce-e42f-4650-bc2f-96fe51dc224c-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"be8b10ce-e42f-4650-bc2f-96fe51dc224c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.684893 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/be8b10ce-e42f-4650-bc2f-96fe51dc224c-scripts\") pod \"glance-default-internal-api-0\" (UID: \"be8b10ce-e42f-4650-bc2f-96fe51dc224c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.684947 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8qvq\" (UniqueName: \"kubernetes.io/projected/dc7435f2-f650-416c-b0db-53082105f13b-kube-api-access-l8qvq\") pod \"nova-cell0-conductor-0\" (UID: \"dc7435f2-f650-416c-b0db-53082105f13b\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.685202 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="84f67b87-419d-457b-a40c-b47e8406d39c" path="/var/lib/kubelet/pods/84f67b87-419d-457b-a40c-b47e8406d39c/volumes" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.687266 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage19-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") pod \"glance-default-internal-api-0\" (UID: \"be8b10ce-e42f-4650-bc2f-96fe51dc224c\") device mount path \"/mnt/openstack/pv19\"" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.687831 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/be8b10ce-e42f-4650-bc2f-96fe51dc224c-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"be8b10ce-e42f-4650-bc2f-96fe51dc224c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.688269 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/be8b10ce-e42f-4650-bc2f-96fe51dc224c-logs\") pod \"glance-default-internal-api-0\" (UID: \"be8b10ce-e42f-4650-bc2f-96fe51dc224c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.688283 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6lw29\" (UniqueName: \"kubernetes.io/projected/be8b10ce-e42f-4650-bc2f-96fe51dc224c-kube-api-access-6lw29\") pod \"glance-default-internal-api-0\" (UID: \"be8b10ce-e42f-4650-bc2f-96fe51dc224c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.688815 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/fec060e6-11fd-4d16-8640-fd02366a7601-credential-keys\") pod \"keystone-bootstrap-xn726\" (UID: \"fec060e6-11fd-4d16-8640-fd02366a7601\") " pod="openstack-kuttl-tests/keystone-bootstrap-xn726" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.688880 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dc7435f2-f650-416c-b0db-53082105f13b-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"dc7435f2-f650-416c-b0db-53082105f13b\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.691180 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc2bd316-2e78-455c-a6dd-42328212b951" path="/var/lib/kubelet/pods/cc2bd316-2e78-455c-a6dd-42328212b951/volumes" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.695440 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e8ee374e-6e54-498b-9c76-2ea7caf3cad8" path="/var/lib/kubelet/pods/e8ee374e-6e54-498b-9c76-2ea7caf3cad8/volumes" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.695647 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/be8b10ce-e42f-4650-bc2f-96fe51dc224c-scripts\") pod \"glance-default-internal-api-0\" (UID: \"be8b10ce-e42f-4650-bc2f-96fe51dc224c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.696302 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/be8b10ce-e42f-4650-bc2f-96fe51dc224c-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"be8b10ce-e42f-4650-bc2f-96fe51dc224c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.697140 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eea6594f-2384-40f5-9061-e3925083e279" path="/var/lib/kubelet/pods/eea6594f-2384-40f5-9061-e3925083e279/volumes" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.698044 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.698075 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.699347 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/be8b10ce-e42f-4650-bc2f-96fe51dc224c-config-data\") pod \"glance-default-internal-api-0\" (UID: \"be8b10ce-e42f-4650-bc2f-96fe51dc224c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.716989 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.718360 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/be8b10ce-e42f-4650-bc2f-96fe51dc224c-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"be8b10ce-e42f-4650-bc2f-96fe51dc224c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.719314 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6lw29\" (UniqueName: \"kubernetes.io/projected/be8b10ce-e42f-4650-bc2f-96fe51dc224c-kube-api-access-6lw29\") pod \"glance-default-internal-api-0\" (UID: \"be8b10ce-e42f-4650-bc2f-96fe51dc224c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.728144 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.740569 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.750494 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-conductor-config-data\"" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.764996 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage19-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") pod \"glance-default-internal-api-0\" (UID: \"be8b10ce-e42f-4650-bc2f-96fe51dc224c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.794335 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/fec060e6-11fd-4d16-8640-fd02366a7601-credential-keys\") pod \"keystone-bootstrap-xn726\" (UID: \"fec060e6-11fd-4d16-8640-fd02366a7601\") " pod="openstack-kuttl-tests/keystone-bootstrap-xn726" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.794403 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dc7435f2-f650-416c-b0db-53082105f13b-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"dc7435f2-f650-416c-b0db-53082105f13b\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.794464 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/fec060e6-11fd-4d16-8640-fd02366a7601-fernet-keys\") pod \"keystone-bootstrap-xn726\" (UID: \"fec060e6-11fd-4d16-8640-fd02366a7601\") " pod="openstack-kuttl-tests/keystone-bootstrap-xn726" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.794580 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/fec060e6-11fd-4d16-8640-fd02366a7601-scripts\") pod \"keystone-bootstrap-xn726\" (UID: \"fec060e6-11fd-4d16-8640-fd02366a7601\") " pod="openstack-kuttl-tests/keystone-bootstrap-xn726" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.794609 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e9337f85-3f26-46e9-bbf3-ea53f581eab6-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"e9337f85-3f26-46e9-bbf3-ea53f581eab6\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.794733 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nk9pr\" (UniqueName: \"kubernetes.io/projected/fec060e6-11fd-4d16-8640-fd02366a7601-kube-api-access-nk9pr\") pod \"keystone-bootstrap-xn726\" (UID: \"fec060e6-11fd-4d16-8640-fd02366a7601\") " pod="openstack-kuttl-tests/keystone-bootstrap-xn726" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.796364 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4jdf\" (UniqueName: \"kubernetes.io/projected/e9337f85-3f26-46e9-bbf3-ea53f581eab6-kube-api-access-w4jdf\") pod \"nova-cell1-conductor-0\" (UID: \"e9337f85-3f26-46e9-bbf3-ea53f581eab6\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.796486 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fec060e6-11fd-4d16-8640-fd02366a7601-combined-ca-bundle\") pod \"keystone-bootstrap-xn726\" (UID: \"fec060e6-11fd-4d16-8640-fd02366a7601\") " pod="openstack-kuttl-tests/keystone-bootstrap-xn726" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.796616 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fec060e6-11fd-4d16-8640-fd02366a7601-config-data\") pod \"keystone-bootstrap-xn726\" (UID: \"fec060e6-11fd-4d16-8640-fd02366a7601\") " pod="openstack-kuttl-tests/keystone-bootstrap-xn726" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.796692 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e9337f85-3f26-46e9-bbf3-ea53f581eab6-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"e9337f85-3f26-46e9-bbf3-ea53f581eab6\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.796778 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dc7435f2-f650-416c-b0db-53082105f13b-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"dc7435f2-f650-416c-b0db-53082105f13b\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.796876 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l8qvq\" (UniqueName: \"kubernetes.io/projected/dc7435f2-f650-416c-b0db-53082105f13b-kube-api-access-l8qvq\") pod \"nova-cell0-conductor-0\" (UID: \"dc7435f2-f650-416c-b0db-53082105f13b\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.804358 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.805011 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fec060e6-11fd-4d16-8640-fd02366a7601-config-data\") pod \"keystone-bootstrap-xn726\" (UID: \"fec060e6-11fd-4d16-8640-fd02366a7601\") " pod="openstack-kuttl-tests/keystone-bootstrap-xn726" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.807725 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dc7435f2-f650-416c-b0db-53082105f13b-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"dc7435f2-f650-416c-b0db-53082105f13b\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.808443 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dc7435f2-f650-416c-b0db-53082105f13b-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"dc7435f2-f650-416c-b0db-53082105f13b\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.809324 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/fec060e6-11fd-4d16-8640-fd02366a7601-scripts\") pod \"keystone-bootstrap-xn726\" (UID: \"fec060e6-11fd-4d16-8640-fd02366a7601\") " pod="openstack-kuttl-tests/keystone-bootstrap-xn726" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.809503 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/fec060e6-11fd-4d16-8640-fd02366a7601-fernet-keys\") pod \"keystone-bootstrap-xn726\" (UID: \"fec060e6-11fd-4d16-8640-fd02366a7601\") " pod="openstack-kuttl-tests/keystone-bootstrap-xn726" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.812492 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.813004 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/fec060e6-11fd-4d16-8640-fd02366a7601-credential-keys\") pod \"keystone-bootstrap-xn726\" (UID: \"fec060e6-11fd-4d16-8640-fd02366a7601\") " pod="openstack-kuttl-tests/keystone-bootstrap-xn726" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.815623 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fec060e6-11fd-4d16-8640-fd02366a7601-combined-ca-bundle\") pod \"keystone-bootstrap-xn726\" (UID: \"fec060e6-11fd-4d16-8640-fd02366a7601\") " pod="openstack-kuttl-tests/keystone-bootstrap-xn726" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.818918 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8qvq\" (UniqueName: \"kubernetes.io/projected/dc7435f2-f650-416c-b0db-53082105f13b-kube-api-access-l8qvq\") pod \"nova-cell0-conductor-0\" (UID: \"dc7435f2-f650-416c-b0db-53082105f13b\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.822152 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nk9pr\" (UniqueName: \"kubernetes.io/projected/fec060e6-11fd-4d16-8640-fd02366a7601-kube-api-access-nk9pr\") pod \"keystone-bootstrap-xn726\" (UID: \"fec060e6-11fd-4d16-8640-fd02366a7601\") " pod="openstack-kuttl-tests/keystone-bootstrap-xn726" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.899685 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w4jdf\" (UniqueName: \"kubernetes.io/projected/e9337f85-3f26-46e9-bbf3-ea53f581eab6-kube-api-access-w4jdf\") pod \"nova-cell1-conductor-0\" (UID: \"e9337f85-3f26-46e9-bbf3-ea53f581eab6\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.900188 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e9337f85-3f26-46e9-bbf3-ea53f581eab6-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"e9337f85-3f26-46e9-bbf3-ea53f581eab6\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.900559 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e9337f85-3f26-46e9-bbf3-ea53f581eab6-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"e9337f85-3f26-46e9-bbf3-ea53f581eab6\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.914963 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e9337f85-3f26-46e9-bbf3-ea53f581eab6-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"e9337f85-3f26-46e9-bbf3-ea53f581eab6\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.920793 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e9337f85-3f26-46e9-bbf3-ea53f581eab6-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"e9337f85-3f26-46e9-bbf3-ea53f581eab6\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.927011 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4jdf\" (UniqueName: \"kubernetes.io/projected/e9337f85-3f26-46e9-bbf3-ea53f581eab6-kube-api-access-w4jdf\") pod \"nova-cell1-conductor-0\" (UID: \"e9337f85-3f26-46e9-bbf3-ea53f581eab6\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.945033 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.964805 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-xn726" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.978583 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:36:30 crc kubenswrapper[5120]: I0316 16:36:30.999200 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-426ss" Mar 16 16:36:31 crc kubenswrapper[5120]: I0316 16:36:31.104065 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c951a6f5-568c-4da3-b6b3-e0310ca934bc-combined-ca-bundle\") pod \"c951a6f5-568c-4da3-b6b3-e0310ca934bc\" (UID: \"c951a6f5-568c-4da3-b6b3-e0310ca934bc\") " Mar 16 16:36:31 crc kubenswrapper[5120]: I0316 16:36:31.104587 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/c951a6f5-568c-4da3-b6b3-e0310ca934bc-db-sync-config-data\") pod \"c951a6f5-568c-4da3-b6b3-e0310ca934bc\" (UID: \"c951a6f5-568c-4da3-b6b3-e0310ca934bc\") " Mar 16 16:36:31 crc kubenswrapper[5120]: I0316 16:36:31.104682 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q5t8g\" (UniqueName: \"kubernetes.io/projected/c951a6f5-568c-4da3-b6b3-e0310ca934bc-kube-api-access-q5t8g\") pod \"c951a6f5-568c-4da3-b6b3-e0310ca934bc\" (UID: \"c951a6f5-568c-4da3-b6b3-e0310ca934bc\") " Mar 16 16:36:31 crc kubenswrapper[5120]: I0316 16:36:31.113924 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c951a6f5-568c-4da3-b6b3-e0310ca934bc-kube-api-access-q5t8g" (OuterVolumeSpecName: "kube-api-access-q5t8g") pod "c951a6f5-568c-4da3-b6b3-e0310ca934bc" (UID: "c951a6f5-568c-4da3-b6b3-e0310ca934bc"). InnerVolumeSpecName "kube-api-access-q5t8g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:36:31 crc kubenswrapper[5120]: I0316 16:36:31.126073 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c951a6f5-568c-4da3-b6b3-e0310ca934bc-db-sync-config-data" (OuterVolumeSpecName: "db-sync-config-data") pod "c951a6f5-568c-4da3-b6b3-e0310ca934bc" (UID: "c951a6f5-568c-4da3-b6b3-e0310ca934bc"). InnerVolumeSpecName "db-sync-config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:36:31 crc kubenswrapper[5120]: I0316 16:36:31.210101 5120 reconciler_common.go:299] "Volume detached for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/c951a6f5-568c-4da3-b6b3-e0310ca934bc-db-sync-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:31 crc kubenswrapper[5120]: I0316 16:36:31.210294 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q5t8g\" (UniqueName: \"kubernetes.io/projected/c951a6f5-568c-4da3-b6b3-e0310ca934bc-kube-api-access-q5t8g\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:31 crc kubenswrapper[5120]: I0316 16:36:31.248405 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-747d4cf944-dk26n"] Mar 16 16:36:31 crc kubenswrapper[5120]: W0316 16:36:31.317114 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode3236580_0d7f_4a04_ae0f_5ae8b073d6b7.slice/crio-1a33c6dce57e7ba0f923f41c17efb3a78e850d6115bcee7aabcd8c1479ddb417 WatchSource:0}: Error finding container 1a33c6dce57e7ba0f923f41c17efb3a78e850d6115bcee7aabcd8c1479ddb417: Status 404 returned error can't find the container with id 1a33c6dce57e7ba0f923f41c17efb3a78e850d6115bcee7aabcd8c1479ddb417 Mar 16 16:36:31 crc kubenswrapper[5120]: I0316 16:36:31.340089 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c951a6f5-568c-4da3-b6b3-e0310ca934bc-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "c951a6f5-568c-4da3-b6b3-e0310ca934bc" (UID: "c951a6f5-568c-4da3-b6b3-e0310ca934bc"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:36:31 crc kubenswrapper[5120]: I0316 16:36:31.345396 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-426ss" event={"ID":"c951a6f5-568c-4da3-b6b3-e0310ca934bc","Type":"ContainerDied","Data":"96bf78dcc6461fcc634f8815ca4cccb23ca7636159d8167fce7fa1164c84b12b"} Mar 16 16:36:31 crc kubenswrapper[5120]: I0316 16:36:31.345454 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="96bf78dcc6461fcc634f8815ca4cccb23ca7636159d8167fce7fa1164c84b12b" Mar 16 16:36:31 crc kubenswrapper[5120]: I0316 16:36:31.345550 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-426ss" Mar 16 16:36:31 crc kubenswrapper[5120]: I0316 16:36:31.385839 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-79c8b576d8-725k2"] Mar 16 16:36:31 crc kubenswrapper[5120]: I0316 16:36:31.387108 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c951a6f5-568c-4da3-b6b3-e0310ca934bc" containerName="barbican-db-sync" Mar 16 16:36:31 crc kubenswrapper[5120]: I0316 16:36:31.387146 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c951a6f5-568c-4da3-b6b3-e0310ca934bc" containerName="barbican-db-sync" Mar 16 16:36:31 crc kubenswrapper[5120]: I0316 16:36:31.387603 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c951a6f5-568c-4da3-b6b3-e0310ca934bc" containerName="barbican-db-sync" Mar 16 16:36:31 crc kubenswrapper[5120]: I0316 16:36:31.419701 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c951a6f5-568c-4da3-b6b3-e0310ca934bc-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:31 crc kubenswrapper[5120]: I0316 16:36:31.429452 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"06e4bc0a-e757-40b7-8ed8-693dd20c185a","Type":"ContainerStarted","Data":"e145594d2f7dace29ee7703bcbb6453deabc8c57a1c230e3e80fd2c2fe679c43"} Mar 16 16:36:31 crc kubenswrapper[5120]: I0316 16:36:31.429595 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-79c8b576d8-725k2" Mar 16 16:36:31 crc kubenswrapper[5120]: I0316 16:36:31.432621 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-79c8b576d8-725k2"] Mar 16 16:36:31 crc kubenswrapper[5120]: I0316 16:36:31.467448 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-worker-5977d9d985-wssl2"] Mar 16 16:36:31 crc kubenswrapper[5120]: I0316 16:36:31.475392 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"2fbd9119-d73e-4c1e-99b9-8f078e2acdfb","Type":"ContainerStarted","Data":"ffce6742df990c1b2ab8e272b5a6aada792d3fbcb65e7aa1b9e5757819aafd52"} Mar 16 16:36:31 crc kubenswrapper[5120]: I0316 16:36:31.475429 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-api-797c9dbf4-zdnm7"] Mar 16 16:36:31 crc kubenswrapper[5120]: I0316 16:36:31.476649 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-5977d9d985-wssl2" Mar 16 16:36:31 crc kubenswrapper[5120]: I0316 16:36:31.484645 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-5977d9d985-wssl2"] Mar 16 16:36:31 crc kubenswrapper[5120]: I0316 16:36:31.484772 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-797c9dbf4-zdnm7" Mar 16 16:36:31 crc kubenswrapper[5120]: I0316 16:36:31.492847 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-797c9dbf4-zdnm7"] Mar 16 16:36:31 crc kubenswrapper[5120]: I0316 16:36:31.522772 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tpfhq\" (UniqueName: \"kubernetes.io/projected/ba60a8bc-6bab-44a3-9e77-6720ea009a57-kube-api-access-tpfhq\") pod \"barbican-keystone-listener-79c8b576d8-725k2\" (UID: \"ba60a8bc-6bab-44a3-9e77-6720ea009a57\") " pod="openstack-kuttl-tests/barbican-keystone-listener-79c8b576d8-725k2" Mar 16 16:36:31 crc kubenswrapper[5120]: I0316 16:36:31.522881 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fb843f09-58b3-467f-8c61-f9cad54c7b55-config-data\") pod \"barbican-api-797c9dbf4-zdnm7\" (UID: \"fb843f09-58b3-467f-8c61-f9cad54c7b55\") " pod="openstack-kuttl-tests/barbican-api-797c9dbf4-zdnm7" Mar 16 16:36:31 crc kubenswrapper[5120]: I0316 16:36:31.526439 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/fb843f09-58b3-467f-8c61-f9cad54c7b55-logs\") pod \"barbican-api-797c9dbf4-zdnm7\" (UID: \"fb843f09-58b3-467f-8c61-f9cad54c7b55\") " pod="openstack-kuttl-tests/barbican-api-797c9dbf4-zdnm7" Mar 16 16:36:31 crc kubenswrapper[5120]: I0316 16:36:31.526480 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/fb843f09-58b3-467f-8c61-f9cad54c7b55-internal-tls-certs\") pod \"barbican-api-797c9dbf4-zdnm7\" (UID: \"fb843f09-58b3-467f-8c61-f9cad54c7b55\") " pod="openstack-kuttl-tests/barbican-api-797c9dbf4-zdnm7" Mar 16 16:36:31 crc kubenswrapper[5120]: I0316 16:36:31.526533 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/fb843f09-58b3-467f-8c61-f9cad54c7b55-config-data-custom\") pod \"barbican-api-797c9dbf4-zdnm7\" (UID: \"fb843f09-58b3-467f-8c61-f9cad54c7b55\") " pod="openstack-kuttl-tests/barbican-api-797c9dbf4-zdnm7" Mar 16 16:36:31 crc kubenswrapper[5120]: I0316 16:36:31.526558 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8822fee9-42fe-47d7-a898-22d38c991abd-config-data\") pod \"barbican-worker-5977d9d985-wssl2\" (UID: \"8822fee9-42fe-47d7-a898-22d38c991abd\") " pod="openstack-kuttl-tests/barbican-worker-5977d9d985-wssl2" Mar 16 16:36:31 crc kubenswrapper[5120]: I0316 16:36:31.526582 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t45k7\" (UniqueName: \"kubernetes.io/projected/8822fee9-42fe-47d7-a898-22d38c991abd-kube-api-access-t45k7\") pod \"barbican-worker-5977d9d985-wssl2\" (UID: \"8822fee9-42fe-47d7-a898-22d38c991abd\") " pod="openstack-kuttl-tests/barbican-worker-5977d9d985-wssl2" Mar 16 16:36:31 crc kubenswrapper[5120]: I0316 16:36:31.526612 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ba60a8bc-6bab-44a3-9e77-6720ea009a57-combined-ca-bundle\") pod \"barbican-keystone-listener-79c8b576d8-725k2\" (UID: \"ba60a8bc-6bab-44a3-9e77-6720ea009a57\") " pod="openstack-kuttl-tests/barbican-keystone-listener-79c8b576d8-725k2" Mar 16 16:36:31 crc kubenswrapper[5120]: I0316 16:36:31.526655 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/ba60a8bc-6bab-44a3-9e77-6720ea009a57-config-data-custom\") pod \"barbican-keystone-listener-79c8b576d8-725k2\" (UID: \"ba60a8bc-6bab-44a3-9e77-6720ea009a57\") " pod="openstack-kuttl-tests/barbican-keystone-listener-79c8b576d8-725k2" Mar 16 16:36:31 crc kubenswrapper[5120]: I0316 16:36:31.526706 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/fb843f09-58b3-467f-8c61-f9cad54c7b55-public-tls-certs\") pod \"barbican-api-797c9dbf4-zdnm7\" (UID: \"fb843f09-58b3-467f-8c61-f9cad54c7b55\") " pod="openstack-kuttl-tests/barbican-api-797c9dbf4-zdnm7" Mar 16 16:36:31 crc kubenswrapper[5120]: I0316 16:36:31.527292 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ba60a8bc-6bab-44a3-9e77-6720ea009a57-config-data\") pod \"barbican-keystone-listener-79c8b576d8-725k2\" (UID: \"ba60a8bc-6bab-44a3-9e77-6720ea009a57\") " pod="openstack-kuttl-tests/barbican-keystone-listener-79c8b576d8-725k2" Mar 16 16:36:31 crc kubenswrapper[5120]: I0316 16:36:31.527346 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fb843f09-58b3-467f-8c61-f9cad54c7b55-combined-ca-bundle\") pod \"barbican-api-797c9dbf4-zdnm7\" (UID: \"fb843f09-58b3-467f-8c61-f9cad54c7b55\") " pod="openstack-kuttl-tests/barbican-api-797c9dbf4-zdnm7" Mar 16 16:36:31 crc kubenswrapper[5120]: I0316 16:36:31.527425 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8822fee9-42fe-47d7-a898-22d38c991abd-combined-ca-bundle\") pod \"barbican-worker-5977d9d985-wssl2\" (UID: \"8822fee9-42fe-47d7-a898-22d38c991abd\") " pod="openstack-kuttl-tests/barbican-worker-5977d9d985-wssl2" Mar 16 16:36:31 crc kubenswrapper[5120]: I0316 16:36:31.527498 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ba60a8bc-6bab-44a3-9e77-6720ea009a57-logs\") pod \"barbican-keystone-listener-79c8b576d8-725k2\" (UID: \"ba60a8bc-6bab-44a3-9e77-6720ea009a57\") " pod="openstack-kuttl-tests/barbican-keystone-listener-79c8b576d8-725k2" Mar 16 16:36:31 crc kubenswrapper[5120]: I0316 16:36:31.527562 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8822fee9-42fe-47d7-a898-22d38c991abd-logs\") pod \"barbican-worker-5977d9d985-wssl2\" (UID: \"8822fee9-42fe-47d7-a898-22d38c991abd\") " pod="openstack-kuttl-tests/barbican-worker-5977d9d985-wssl2" Mar 16 16:36:31 crc kubenswrapper[5120]: I0316 16:36:31.527619 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/8822fee9-42fe-47d7-a898-22d38c991abd-config-data-custom\") pod \"barbican-worker-5977d9d985-wssl2\" (UID: \"8822fee9-42fe-47d7-a898-22d38c991abd\") " pod="openstack-kuttl-tests/barbican-worker-5977d9d985-wssl2" Mar 16 16:36:31 crc kubenswrapper[5120]: I0316 16:36:31.527664 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rv5zg\" (UniqueName: \"kubernetes.io/projected/fb843f09-58b3-467f-8c61-f9cad54c7b55-kube-api-access-rv5zg\") pod \"barbican-api-797c9dbf4-zdnm7\" (UID: \"fb843f09-58b3-467f-8c61-f9cad54c7b55\") " pod="openstack-kuttl-tests/barbican-api-797c9dbf4-zdnm7" Mar 16 16:36:31 crc kubenswrapper[5120]: I0316 16:36:31.665140 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ba60a8bc-6bab-44a3-9e77-6720ea009a57-config-data\") pod \"barbican-keystone-listener-79c8b576d8-725k2\" (UID: \"ba60a8bc-6bab-44a3-9e77-6720ea009a57\") " pod="openstack-kuttl-tests/barbican-keystone-listener-79c8b576d8-725k2" Mar 16 16:36:31 crc kubenswrapper[5120]: I0316 16:36:31.665186 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fb843f09-58b3-467f-8c61-f9cad54c7b55-combined-ca-bundle\") pod \"barbican-api-797c9dbf4-zdnm7\" (UID: \"fb843f09-58b3-467f-8c61-f9cad54c7b55\") " pod="openstack-kuttl-tests/barbican-api-797c9dbf4-zdnm7" Mar 16 16:36:31 crc kubenswrapper[5120]: I0316 16:36:31.665239 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8822fee9-42fe-47d7-a898-22d38c991abd-combined-ca-bundle\") pod \"barbican-worker-5977d9d985-wssl2\" (UID: \"8822fee9-42fe-47d7-a898-22d38c991abd\") " pod="openstack-kuttl-tests/barbican-worker-5977d9d985-wssl2" Mar 16 16:36:31 crc kubenswrapper[5120]: I0316 16:36:31.665286 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ba60a8bc-6bab-44a3-9e77-6720ea009a57-logs\") pod \"barbican-keystone-listener-79c8b576d8-725k2\" (UID: \"ba60a8bc-6bab-44a3-9e77-6720ea009a57\") " pod="openstack-kuttl-tests/barbican-keystone-listener-79c8b576d8-725k2" Mar 16 16:36:31 crc kubenswrapper[5120]: I0316 16:36:31.665328 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8822fee9-42fe-47d7-a898-22d38c991abd-logs\") pod \"barbican-worker-5977d9d985-wssl2\" (UID: \"8822fee9-42fe-47d7-a898-22d38c991abd\") " pod="openstack-kuttl-tests/barbican-worker-5977d9d985-wssl2" Mar 16 16:36:31 crc kubenswrapper[5120]: I0316 16:36:31.665363 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/8822fee9-42fe-47d7-a898-22d38c991abd-config-data-custom\") pod \"barbican-worker-5977d9d985-wssl2\" (UID: \"8822fee9-42fe-47d7-a898-22d38c991abd\") " pod="openstack-kuttl-tests/barbican-worker-5977d9d985-wssl2" Mar 16 16:36:31 crc kubenswrapper[5120]: I0316 16:36:31.665401 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rv5zg\" (UniqueName: \"kubernetes.io/projected/fb843f09-58b3-467f-8c61-f9cad54c7b55-kube-api-access-rv5zg\") pod \"barbican-api-797c9dbf4-zdnm7\" (UID: \"fb843f09-58b3-467f-8c61-f9cad54c7b55\") " pod="openstack-kuttl-tests/barbican-api-797c9dbf4-zdnm7" Mar 16 16:36:31 crc kubenswrapper[5120]: I0316 16:36:31.665475 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tpfhq\" (UniqueName: \"kubernetes.io/projected/ba60a8bc-6bab-44a3-9e77-6720ea009a57-kube-api-access-tpfhq\") pod \"barbican-keystone-listener-79c8b576d8-725k2\" (UID: \"ba60a8bc-6bab-44a3-9e77-6720ea009a57\") " pod="openstack-kuttl-tests/barbican-keystone-listener-79c8b576d8-725k2" Mar 16 16:36:31 crc kubenswrapper[5120]: I0316 16:36:31.665557 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fb843f09-58b3-467f-8c61-f9cad54c7b55-config-data\") pod \"barbican-api-797c9dbf4-zdnm7\" (UID: \"fb843f09-58b3-467f-8c61-f9cad54c7b55\") " pod="openstack-kuttl-tests/barbican-api-797c9dbf4-zdnm7" Mar 16 16:36:31 crc kubenswrapper[5120]: I0316 16:36:31.665630 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/fb843f09-58b3-467f-8c61-f9cad54c7b55-logs\") pod \"barbican-api-797c9dbf4-zdnm7\" (UID: \"fb843f09-58b3-467f-8c61-f9cad54c7b55\") " pod="openstack-kuttl-tests/barbican-api-797c9dbf4-zdnm7" Mar 16 16:36:31 crc kubenswrapper[5120]: I0316 16:36:31.665652 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/fb843f09-58b3-467f-8c61-f9cad54c7b55-internal-tls-certs\") pod \"barbican-api-797c9dbf4-zdnm7\" (UID: \"fb843f09-58b3-467f-8c61-f9cad54c7b55\") " pod="openstack-kuttl-tests/barbican-api-797c9dbf4-zdnm7" Mar 16 16:36:31 crc kubenswrapper[5120]: I0316 16:36:31.665701 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/fb843f09-58b3-467f-8c61-f9cad54c7b55-config-data-custom\") pod \"barbican-api-797c9dbf4-zdnm7\" (UID: \"fb843f09-58b3-467f-8c61-f9cad54c7b55\") " pod="openstack-kuttl-tests/barbican-api-797c9dbf4-zdnm7" Mar 16 16:36:31 crc kubenswrapper[5120]: I0316 16:36:31.665732 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8822fee9-42fe-47d7-a898-22d38c991abd-config-data\") pod \"barbican-worker-5977d9d985-wssl2\" (UID: \"8822fee9-42fe-47d7-a898-22d38c991abd\") " pod="openstack-kuttl-tests/barbican-worker-5977d9d985-wssl2" Mar 16 16:36:31 crc kubenswrapper[5120]: I0316 16:36:31.665778 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t45k7\" (UniqueName: \"kubernetes.io/projected/8822fee9-42fe-47d7-a898-22d38c991abd-kube-api-access-t45k7\") pod \"barbican-worker-5977d9d985-wssl2\" (UID: \"8822fee9-42fe-47d7-a898-22d38c991abd\") " pod="openstack-kuttl-tests/barbican-worker-5977d9d985-wssl2" Mar 16 16:36:31 crc kubenswrapper[5120]: I0316 16:36:31.665809 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ba60a8bc-6bab-44a3-9e77-6720ea009a57-combined-ca-bundle\") pod \"barbican-keystone-listener-79c8b576d8-725k2\" (UID: \"ba60a8bc-6bab-44a3-9e77-6720ea009a57\") " pod="openstack-kuttl-tests/barbican-keystone-listener-79c8b576d8-725k2" Mar 16 16:36:31 crc kubenswrapper[5120]: I0316 16:36:31.665863 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/ba60a8bc-6bab-44a3-9e77-6720ea009a57-config-data-custom\") pod \"barbican-keystone-listener-79c8b576d8-725k2\" (UID: \"ba60a8bc-6bab-44a3-9e77-6720ea009a57\") " pod="openstack-kuttl-tests/barbican-keystone-listener-79c8b576d8-725k2" Mar 16 16:36:31 crc kubenswrapper[5120]: I0316 16:36:31.665900 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/fb843f09-58b3-467f-8c61-f9cad54c7b55-public-tls-certs\") pod \"barbican-api-797c9dbf4-zdnm7\" (UID: \"fb843f09-58b3-467f-8c61-f9cad54c7b55\") " pod="openstack-kuttl-tests/barbican-api-797c9dbf4-zdnm7" Mar 16 16:36:31 crc kubenswrapper[5120]: I0316 16:36:31.677353 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ba60a8bc-6bab-44a3-9e77-6720ea009a57-logs\") pod \"barbican-keystone-listener-79c8b576d8-725k2\" (UID: \"ba60a8bc-6bab-44a3-9e77-6720ea009a57\") " pod="openstack-kuttl-tests/barbican-keystone-listener-79c8b576d8-725k2" Mar 16 16:36:31 crc kubenswrapper[5120]: I0316 16:36:31.699350 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8822fee9-42fe-47d7-a898-22d38c991abd-combined-ca-bundle\") pod \"barbican-worker-5977d9d985-wssl2\" (UID: \"8822fee9-42fe-47d7-a898-22d38c991abd\") " pod="openstack-kuttl-tests/barbican-worker-5977d9d985-wssl2" Mar 16 16:36:31 crc kubenswrapper[5120]: I0316 16:36:31.699606 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8822fee9-42fe-47d7-a898-22d38c991abd-logs\") pod \"barbican-worker-5977d9d985-wssl2\" (UID: \"8822fee9-42fe-47d7-a898-22d38c991abd\") " pod="openstack-kuttl-tests/barbican-worker-5977d9d985-wssl2" Mar 16 16:36:31 crc kubenswrapper[5120]: I0316 16:36:31.711924 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8822fee9-42fe-47d7-a898-22d38c991abd-config-data\") pod \"barbican-worker-5977d9d985-wssl2\" (UID: \"8822fee9-42fe-47d7-a898-22d38c991abd\") " pod="openstack-kuttl-tests/barbican-worker-5977d9d985-wssl2" Mar 16 16:36:31 crc kubenswrapper[5120]: I0316 16:36:31.735558 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/fb843f09-58b3-467f-8c61-f9cad54c7b55-config-data-custom\") pod \"barbican-api-797c9dbf4-zdnm7\" (UID: \"fb843f09-58b3-467f-8c61-f9cad54c7b55\") " pod="openstack-kuttl-tests/barbican-api-797c9dbf4-zdnm7" Mar 16 16:36:31 crc kubenswrapper[5120]: I0316 16:36:31.736366 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fb843f09-58b3-467f-8c61-f9cad54c7b55-combined-ca-bundle\") pod \"barbican-api-797c9dbf4-zdnm7\" (UID: \"fb843f09-58b3-467f-8c61-f9cad54c7b55\") " pod="openstack-kuttl-tests/barbican-api-797c9dbf4-zdnm7" Mar 16 16:36:31 crc kubenswrapper[5120]: I0316 16:36:31.736792 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/8822fee9-42fe-47d7-a898-22d38c991abd-config-data-custom\") pod \"barbican-worker-5977d9d985-wssl2\" (UID: \"8822fee9-42fe-47d7-a898-22d38c991abd\") " pod="openstack-kuttl-tests/barbican-worker-5977d9d985-wssl2" Mar 16 16:36:31 crc kubenswrapper[5120]: I0316 16:36:31.737779 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/fb843f09-58b3-467f-8c61-f9cad54c7b55-public-tls-certs\") pod \"barbican-api-797c9dbf4-zdnm7\" (UID: \"fb843f09-58b3-467f-8c61-f9cad54c7b55\") " pod="openstack-kuttl-tests/barbican-api-797c9dbf4-zdnm7" Mar 16 16:36:31 crc kubenswrapper[5120]: I0316 16:36:31.738166 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/fb843f09-58b3-467f-8c61-f9cad54c7b55-logs\") pod \"barbican-api-797c9dbf4-zdnm7\" (UID: \"fb843f09-58b3-467f-8c61-f9cad54c7b55\") " pod="openstack-kuttl-tests/barbican-api-797c9dbf4-zdnm7" Mar 16 16:36:31 crc kubenswrapper[5120]: I0316 16:36:31.753361 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ba60a8bc-6bab-44a3-9e77-6720ea009a57-config-data\") pod \"barbican-keystone-listener-79c8b576d8-725k2\" (UID: \"ba60a8bc-6bab-44a3-9e77-6720ea009a57\") " pod="openstack-kuttl-tests/barbican-keystone-listener-79c8b576d8-725k2" Mar 16 16:36:31 crc kubenswrapper[5120]: I0316 16:36:31.757899 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fb843f09-58b3-467f-8c61-f9cad54c7b55-config-data\") pod \"barbican-api-797c9dbf4-zdnm7\" (UID: \"fb843f09-58b3-467f-8c61-f9cad54c7b55\") " pod="openstack-kuttl-tests/barbican-api-797c9dbf4-zdnm7" Mar 16 16:36:31 crc kubenswrapper[5120]: I0316 16:36:31.758564 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rv5zg\" (UniqueName: \"kubernetes.io/projected/fb843f09-58b3-467f-8c61-f9cad54c7b55-kube-api-access-rv5zg\") pod \"barbican-api-797c9dbf4-zdnm7\" (UID: \"fb843f09-58b3-467f-8c61-f9cad54c7b55\") " pod="openstack-kuttl-tests/barbican-api-797c9dbf4-zdnm7" Mar 16 16:36:31 crc kubenswrapper[5120]: I0316 16:36:31.761430 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ba60a8bc-6bab-44a3-9e77-6720ea009a57-combined-ca-bundle\") pod \"barbican-keystone-listener-79c8b576d8-725k2\" (UID: \"ba60a8bc-6bab-44a3-9e77-6720ea009a57\") " pod="openstack-kuttl-tests/barbican-keystone-listener-79c8b576d8-725k2" Mar 16 16:36:31 crc kubenswrapper[5120]: I0316 16:36:31.761998 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tpfhq\" (UniqueName: \"kubernetes.io/projected/ba60a8bc-6bab-44a3-9e77-6720ea009a57-kube-api-access-tpfhq\") pod \"barbican-keystone-listener-79c8b576d8-725k2\" (UID: \"ba60a8bc-6bab-44a3-9e77-6720ea009a57\") " pod="openstack-kuttl-tests/barbican-keystone-listener-79c8b576d8-725k2" Mar 16 16:36:31 crc kubenswrapper[5120]: I0316 16:36:31.764630 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/fb843f09-58b3-467f-8c61-f9cad54c7b55-internal-tls-certs\") pod \"barbican-api-797c9dbf4-zdnm7\" (UID: \"fb843f09-58b3-467f-8c61-f9cad54c7b55\") " pod="openstack-kuttl-tests/barbican-api-797c9dbf4-zdnm7" Mar 16 16:36:31 crc kubenswrapper[5120]: I0316 16:36:31.804039 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t45k7\" (UniqueName: \"kubernetes.io/projected/8822fee9-42fe-47d7-a898-22d38c991abd-kube-api-access-t45k7\") pod \"barbican-worker-5977d9d985-wssl2\" (UID: \"8822fee9-42fe-47d7-a898-22d38c991abd\") " pod="openstack-kuttl-tests/barbican-worker-5977d9d985-wssl2" Mar 16 16:36:31 crc kubenswrapper[5120]: I0316 16:36:31.822049 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:36:31 crc kubenswrapper[5120]: I0316 16:36:31.823955 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/ba60a8bc-6bab-44a3-9e77-6720ea009a57-config-data-custom\") pod \"barbican-keystone-listener-79c8b576d8-725k2\" (UID: \"ba60a8bc-6bab-44a3-9e77-6720ea009a57\") " pod="openstack-kuttl-tests/barbican-keystone-listener-79c8b576d8-725k2" Mar 16 16:36:31 crc kubenswrapper[5120]: I0316 16:36:31.835172 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-5977d9d985-wssl2" Mar 16 16:36:31 crc kubenswrapper[5120]: I0316 16:36:31.853318 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-797c9dbf4-zdnm7" Mar 16 16:36:32 crc kubenswrapper[5120]: I0316 16:36:32.056208 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-79c8b576d8-725k2" Mar 16 16:36:32 crc kubenswrapper[5120]: I0316 16:36:32.057686 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:36:32 crc kubenswrapper[5120]: I0316 16:36:32.207890 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-xn726"] Mar 16 16:36:32 crc kubenswrapper[5120]: I0316 16:36:32.277087 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 16:36:32 crc kubenswrapper[5120]: W0316 16:36:32.321273 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode9337f85_3f26_46e9_bbf3_ea53f581eab6.slice/crio-218e18ffcab15951b1c30b84f3f9b438dee328f6318c931a6200d481a89a06e2 WatchSource:0}: Error finding container 218e18ffcab15951b1c30b84f3f9b438dee328f6318c931a6200d481a89a06e2: Status 404 returned error can't find the container with id 218e18ffcab15951b1c30b84f3f9b438dee328f6318c931a6200d481a89a06e2 Mar 16 16:36:32 crc kubenswrapper[5120]: I0316 16:36:32.547403 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-797c9dbf4-zdnm7"] Mar 16 16:36:32 crc kubenswrapper[5120]: I0316 16:36:32.554795 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-747d4cf944-dk26n" event={"ID":"e3236580-0d7f-4a04-ae0f-5ae8b073d6b7","Type":"ContainerStarted","Data":"79f4283e3961fe8587913a54a4c1b00035f76c81dbe46a09d7a17f5d45d1ffe7"} Mar 16 16:36:32 crc kubenswrapper[5120]: I0316 16:36:32.554849 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-747d4cf944-dk26n" event={"ID":"e3236580-0d7f-4a04-ae0f-5ae8b073d6b7","Type":"ContainerStarted","Data":"1a33c6dce57e7ba0f923f41c17efb3a78e850d6115bcee7aabcd8c1479ddb417"} Mar 16 16:36:32 crc kubenswrapper[5120]: I0316 16:36:32.557017 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-5977d9d985-wssl2"] Mar 16 16:36:32 crc kubenswrapper[5120]: I0316 16:36:32.557352 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-xn726" event={"ID":"fec060e6-11fd-4d16-8640-fd02366a7601","Type":"ContainerStarted","Data":"cf47aaebf63137acc7a77d17eb41eeb5f06bc1f346811dfa1f366d667ed8d6a4"} Mar 16 16:36:32 crc kubenswrapper[5120]: I0316 16:36:32.563118 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"dc7435f2-f650-416c-b0db-53082105f13b","Type":"ContainerStarted","Data":"c56d621e010bf063eecea599e04c60b98269bc230941962c087a8aaef38f01ef"} Mar 16 16:36:32 crc kubenswrapper[5120]: I0316 16:36:32.566323 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"2fbd9119-d73e-4c1e-99b9-8f078e2acdfb","Type":"ContainerStarted","Data":"795e30c34b62032be16391622f118baf7553199f7ee7e1d67d0c47f46f0d7158"} Mar 16 16:36:32 crc kubenswrapper[5120]: I0316 16:36:32.568287 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"e9337f85-3f26-46e9-bbf3-ea53f581eab6","Type":"ContainerStarted","Data":"218e18ffcab15951b1c30b84f3f9b438dee328f6318c931a6200d481a89a06e2"} Mar 16 16:36:32 crc kubenswrapper[5120]: I0316 16:36:32.585271 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"be8b10ce-e42f-4650-bc2f-96fe51dc224c","Type":"ContainerStarted","Data":"759b08f9d80d6be7016ee37b1749f4951ba70131e6b8c69cadcd8ad48cff7909"} Mar 16 16:36:32 crc kubenswrapper[5120]: I0316 16:36:32.677054 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e88b61c1-a3d0-4b23-820a-b117cf5b90c1" path="/var/lib/kubelet/pods/e88b61c1-a3d0-4b23-820a-b117cf5b90c1/volumes" Mar 16 16:36:32 crc kubenswrapper[5120]: I0316 16:36:32.828006 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-79c8b576d8-725k2"] Mar 16 16:36:33 crc kubenswrapper[5120]: I0316 16:36:33.009949 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/cinder-api-0" podUID="e8ee374e-6e54-498b-9c76-2ea7caf3cad8" containerName="cinder-api" probeResult="failure" output="Get \"https://10.217.0.162:8776/healthcheck\": context deadline exceeded" Mar 16 16:36:33 crc kubenswrapper[5120]: I0316 16:36:33.611269 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-79c8b576d8-725k2" event={"ID":"ba60a8bc-6bab-44a3-9e77-6720ea009a57","Type":"ContainerStarted","Data":"1604809a163c3a45d1f5089abbf755702fb43f108aed43a0f5fcc594471fc047"} Mar 16 16:36:33 crc kubenswrapper[5120]: I0316 16:36:33.611856 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-79c8b576d8-725k2" event={"ID":"ba60a8bc-6bab-44a3-9e77-6720ea009a57","Type":"ContainerStarted","Data":"638b55a0210ec14554ceefae7250d4967dbfce30abd507e29ac89b086c75c97a"} Mar 16 16:36:33 crc kubenswrapper[5120]: I0316 16:36:33.617517 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"dc7435f2-f650-416c-b0db-53082105f13b","Type":"ContainerStarted","Data":"cd1fe4c47b47574fb7349bbe6b90048d31bd50a842336360580a001e58e13b5c"} Mar 16 16:36:33 crc kubenswrapper[5120]: I0316 16:36:33.617592 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:36:33 crc kubenswrapper[5120]: I0316 16:36:33.625477 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-797c9dbf4-zdnm7" event={"ID":"fb843f09-58b3-467f-8c61-f9cad54c7b55","Type":"ContainerStarted","Data":"2306d3146bce8fb7711cda6f64816886e7c22d3b707e92faf4ccfb523dd60b48"} Mar 16 16:36:33 crc kubenswrapper[5120]: I0316 16:36:33.625519 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-797c9dbf4-zdnm7" event={"ID":"fb843f09-58b3-467f-8c61-f9cad54c7b55","Type":"ContainerStarted","Data":"24cb426aa340f06a7f453571564d2ec783367bbab6a6cf9d1f5fc686981c8c0f"} Mar 16 16:36:33 crc kubenswrapper[5120]: I0316 16:36:33.636645 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podStartSLOduration=3.636631474 podStartE2EDuration="3.636631474s" podCreationTimestamp="2026-03-16 16:36:30 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:36:33.635571756 +0000 UTC m=+3895.789503413" watchObservedRunningTime="2026-03-16 16:36:33.636631474 +0000 UTC m=+3895.790563131" Mar 16 16:36:33 crc kubenswrapper[5120]: I0316 16:36:33.661527 5120 generic.go:358] "Generic (PLEG): container finished" podID="68089cb0-f9b0-4b76-9778-e2edffaa4f55" containerID="080f8540395015e16b1273c588e9a186dfbd64eee3d6314236006160630adf34" exitCode=137 Mar 16 16:36:33 crc kubenswrapper[5120]: I0316 16:36:33.661730 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"68089cb0-f9b0-4b76-9778-e2edffaa4f55","Type":"ContainerDied","Data":"080f8540395015e16b1273c588e9a186dfbd64eee3d6314236006160630adf34"} Mar 16 16:36:33 crc kubenswrapper[5120]: I0316 16:36:33.663978 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"e9337f85-3f26-46e9-bbf3-ea53f581eab6","Type":"ContainerStarted","Data":"1502302cf5fdfbaedff9cdb3378e080511758ed3133fd93311514c3312d06191"} Mar 16 16:36:33 crc kubenswrapper[5120]: I0316 16:36:33.666754 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:36:33 crc kubenswrapper[5120]: I0316 16:36:33.675785 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-5977d9d985-wssl2" event={"ID":"8822fee9-42fe-47d7-a898-22d38c991abd","Type":"ContainerStarted","Data":"f0d16f15c665ac87c4f2bfdb75caedf4162b54c8ca025a4be8306c702849e280"} Mar 16 16:36:33 crc kubenswrapper[5120]: I0316 16:36:33.675823 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-5977d9d985-wssl2" event={"ID":"8822fee9-42fe-47d7-a898-22d38c991abd","Type":"ContainerStarted","Data":"c55c812ea206d9b0e8646e4f58d9e4151c51321b3c618434da1ec688a3814b93"} Mar 16 16:36:33 crc kubenswrapper[5120]: I0316 16:36:33.683627 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"be8b10ce-e42f-4650-bc2f-96fe51dc224c","Type":"ContainerStarted","Data":"678053afacd3e13cea1a0ce33b3fda6c71f1a6af75e6150d8d60f0c54803af1d"} Mar 16 16:36:33 crc kubenswrapper[5120]: I0316 16:36:33.685592 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podStartSLOduration=3.685576414 podStartE2EDuration="3.685576414s" podCreationTimestamp="2026-03-16 16:36:30 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:36:33.684491266 +0000 UTC m=+3895.838422923" watchObservedRunningTime="2026-03-16 16:36:33.685576414 +0000 UTC m=+3895.839508071" Mar 16 16:36:33 crc kubenswrapper[5120]: I0316 16:36:33.686324 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-747d4cf944-dk26n" event={"ID":"e3236580-0d7f-4a04-ae0f-5ae8b073d6b7","Type":"ContainerStarted","Data":"c571cf34fd0e3bd683dfb18e6a22a56da066ae6e0cf5b1a616392a29bff9e024"} Mar 16 16:36:33 crc kubenswrapper[5120]: I0316 16:36:33.687495 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-747d4cf944-dk26n" Mar 16 16:36:33 crc kubenswrapper[5120]: I0316 16:36:33.687518 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-747d4cf944-dk26n" Mar 16 16:36:33 crc kubenswrapper[5120]: I0316 16:36:33.696588 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"06e4bc0a-e757-40b7-8ed8-693dd20c185a","Type":"ContainerStarted","Data":"9a27d15912e1cc741e22cfb7a94085d53ffa142b31ec587a9a16aeb99cd22f72"} Mar 16 16:36:33 crc kubenswrapper[5120]: I0316 16:36:33.708300 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-xn726" event={"ID":"fec060e6-11fd-4d16-8640-fd02366a7601","Type":"ContainerStarted","Data":"79adda27973c1bfe253f64a2645483f9b18b3eee51fbf7b661c609dce336ef3f"} Mar 16 16:36:33 crc kubenswrapper[5120]: I0316 16:36:33.759076 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-747d4cf944-dk26n" podStartSLOduration=3.759053786 podStartE2EDuration="3.759053786s" podCreationTimestamp="2026-03-16 16:36:30 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:36:33.711822881 +0000 UTC m=+3895.865754548" watchObservedRunningTime="2026-03-16 16:36:33.759053786 +0000 UTC m=+3895.912985443" Mar 16 16:36:33 crc kubenswrapper[5120]: I0316 16:36:33.767858 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-bootstrap-xn726" podStartSLOduration=3.767837387 podStartE2EDuration="3.767837387s" podCreationTimestamp="2026-03-16 16:36:30 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:36:33.741647561 +0000 UTC m=+3895.895579378" watchObservedRunningTime="2026-03-16 16:36:33.767837387 +0000 UTC m=+3895.921769044" Mar 16 16:36:34 crc kubenswrapper[5120]: I0316 16:36:34.096422 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:36:34 crc kubenswrapper[5120]: I0316 16:36:34.191967 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/68089cb0-f9b0-4b76-9778-e2edffaa4f55-lock\") pod \"68089cb0-f9b0-4b76-9778-e2edffaa4f55\" (UID: \"68089cb0-f9b0-4b76-9778-e2edffaa4f55\") " Mar 16 16:36:34 crc kubenswrapper[5120]: I0316 16:36:34.192046 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/68089cb0-f9b0-4b76-9778-e2edffaa4f55-etc-swift\") pod \"68089cb0-f9b0-4b76-9778-e2edffaa4f55\" (UID: \"68089cb0-f9b0-4b76-9778-e2edffaa4f55\") " Mar 16 16:36:34 crc kubenswrapper[5120]: I0316 16:36:34.192062 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"swift\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"68089cb0-f9b0-4b76-9778-e2edffaa4f55\" (UID: \"68089cb0-f9b0-4b76-9778-e2edffaa4f55\") " Mar 16 16:36:34 crc kubenswrapper[5120]: I0316 16:36:34.192131 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/68089cb0-f9b0-4b76-9778-e2edffaa4f55-combined-ca-bundle\") pod \"68089cb0-f9b0-4b76-9778-e2edffaa4f55\" (UID: \"68089cb0-f9b0-4b76-9778-e2edffaa4f55\") " Mar 16 16:36:34 crc kubenswrapper[5120]: I0316 16:36:34.192239 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-czp6s\" (UniqueName: \"kubernetes.io/projected/68089cb0-f9b0-4b76-9778-e2edffaa4f55-kube-api-access-czp6s\") pod \"68089cb0-f9b0-4b76-9778-e2edffaa4f55\" (UID: \"68089cb0-f9b0-4b76-9778-e2edffaa4f55\") " Mar 16 16:36:34 crc kubenswrapper[5120]: I0316 16:36:34.192285 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/68089cb0-f9b0-4b76-9778-e2edffaa4f55-cache\") pod \"68089cb0-f9b0-4b76-9778-e2edffaa4f55\" (UID: \"68089cb0-f9b0-4b76-9778-e2edffaa4f55\") " Mar 16 16:36:34 crc kubenswrapper[5120]: I0316 16:36:34.193605 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68089cb0-f9b0-4b76-9778-e2edffaa4f55-cache" (OuterVolumeSpecName: "cache") pod "68089cb0-f9b0-4b76-9778-e2edffaa4f55" (UID: "68089cb0-f9b0-4b76-9778-e2edffaa4f55"). InnerVolumeSpecName "cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:36:34 crc kubenswrapper[5120]: I0316 16:36:34.194015 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68089cb0-f9b0-4b76-9778-e2edffaa4f55-lock" (OuterVolumeSpecName: "lock") pod "68089cb0-f9b0-4b76-9778-e2edffaa4f55" (UID: "68089cb0-f9b0-4b76-9778-e2edffaa4f55"). InnerVolumeSpecName "lock". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:36:34 crc kubenswrapper[5120]: I0316 16:36:34.201950 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage09-crc" (OuterVolumeSpecName: "swift") pod "68089cb0-f9b0-4b76-9778-e2edffaa4f55" (UID: "68089cb0-f9b0-4b76-9778-e2edffaa4f55"). InnerVolumeSpecName "local-storage09-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:36:34 crc kubenswrapper[5120]: I0316 16:36:34.208959 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68089cb0-f9b0-4b76-9778-e2edffaa4f55-etc-swift" (OuterVolumeSpecName: "etc-swift") pod "68089cb0-f9b0-4b76-9778-e2edffaa4f55" (UID: "68089cb0-f9b0-4b76-9778-e2edffaa4f55"). InnerVolumeSpecName "etc-swift". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:36:34 crc kubenswrapper[5120]: I0316 16:36:34.214923 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68089cb0-f9b0-4b76-9778-e2edffaa4f55-kube-api-access-czp6s" (OuterVolumeSpecName: "kube-api-access-czp6s") pod "68089cb0-f9b0-4b76-9778-e2edffaa4f55" (UID: "68089cb0-f9b0-4b76-9778-e2edffaa4f55"). InnerVolumeSpecName "kube-api-access-czp6s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:36:34 crc kubenswrapper[5120]: I0316 16:36:34.295815 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-czp6s\" (UniqueName: \"kubernetes.io/projected/68089cb0-f9b0-4b76-9778-e2edffaa4f55-kube-api-access-czp6s\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:34 crc kubenswrapper[5120]: I0316 16:36:34.295858 5120 reconciler_common.go:299] "Volume detached for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/68089cb0-f9b0-4b76-9778-e2edffaa4f55-cache\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:34 crc kubenswrapper[5120]: I0316 16:36:34.295872 5120 reconciler_common.go:299] "Volume detached for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/68089cb0-f9b0-4b76-9778-e2edffaa4f55-lock\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:34 crc kubenswrapper[5120]: I0316 16:36:34.295885 5120 reconciler_common.go:299] "Volume detached for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/68089cb0-f9b0-4b76-9778-e2edffaa4f55-etc-swift\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:34 crc kubenswrapper[5120]: I0316 16:36:34.295918 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") on node \"crc\" " Mar 16 16:36:34 crc kubenswrapper[5120]: I0316 16:36:34.342744 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage09-crc" (UniqueName: "kubernetes.io/local-volume/local-storage09-crc") on node "crc" Mar 16 16:36:34 crc kubenswrapper[5120]: I0316 16:36:34.407544 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:34 crc kubenswrapper[5120]: I0316 16:36:34.764610 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-5977d9d985-wssl2" event={"ID":"8822fee9-42fe-47d7-a898-22d38c991abd","Type":"ContainerStarted","Data":"d574b3982ee170745544121427c41d12f2d53fcc93af40baff6d3f7c253ab3ac"} Mar 16 16:36:34 crc kubenswrapper[5120]: I0316 16:36:34.764944 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-worker-5977d9d985-wssl2" podStartSLOduration=3.764925625 podStartE2EDuration="3.764925625s" podCreationTimestamp="2026-03-16 16:36:31 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:36:34.753154976 +0000 UTC m=+3896.907086643" watchObservedRunningTime="2026-03-16 16:36:34.764925625 +0000 UTC m=+3896.918857282" Mar 16 16:36:34 crc kubenswrapper[5120]: I0316 16:36:34.768105 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-79c8b576d8-725k2" event={"ID":"ba60a8bc-6bab-44a3-9e77-6720ea009a57","Type":"ContainerStarted","Data":"7bdd3c9904ff978a4ff90478697f43df053f05e42e235f1b924d00f8b65b050e"} Mar 16 16:36:34 crc kubenswrapper[5120]: I0316 16:36:34.811930 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-665c46bb4d-7xhgk"] Mar 16 16:36:34 crc kubenswrapper[5120]: I0316 16:36:34.817119 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-665c46bb4d-7xhgk" podUID="000bd178-fd75-4c35-985c-1e2dd60a7c5e" containerName="barbican-worker-log" containerID="cri-o://08a9e88c90cd9c79e7c4045a39c01661f3c530c9d9689f749173b311825c8645" gracePeriod=30 Mar 16 16:36:34 crc kubenswrapper[5120]: I0316 16:36:34.817756 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-665c46bb4d-7xhgk" podUID="000bd178-fd75-4c35-985c-1e2dd60a7c5e" containerName="barbican-worker" containerID="cri-o://991fab175bf58adabc385c61a11ffb100168afab5737d5474c6261641322a276" gracePeriod=30 Mar 16 16:36:34 crc kubenswrapper[5120]: I0316 16:36:34.838953 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-keystone-listener-79c8b576d8-725k2" podStartSLOduration=3.838918761 podStartE2EDuration="3.838918761s" podCreationTimestamp="2026-03-16 16:36:31 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:36:34.807142249 +0000 UTC m=+3896.961073906" watchObservedRunningTime="2026-03-16 16:36:34.838918761 +0000 UTC m=+3896.992850418" Mar 16 16:36:34 crc kubenswrapper[5120]: I0316 16:36:34.852994 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-797c9dbf4-zdnm7" event={"ID":"fb843f09-58b3-467f-8c61-f9cad54c7b55","Type":"ContainerStarted","Data":"44e7b6079cc86a3539158acba20d48d6ecfc28308601a631870b3eea6c5a0e3d"} Mar 16 16:36:34 crc kubenswrapper[5120]: I0316 16:36:34.853076 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-797c9dbf4-zdnm7" Mar 16 16:36:34 crc kubenswrapper[5120]: I0316 16:36:34.853105 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-797c9dbf4-zdnm7" Mar 16 16:36:34 crc kubenswrapper[5120]: I0316 16:36:34.870995 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-7d8dbd4879-pzj6v"] Mar 16 16:36:34 crc kubenswrapper[5120]: I0316 16:36:34.871432 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-7d8dbd4879-pzj6v" podUID="ebe474a7-759d-4e64-974d-fafd32020f70" containerName="barbican-keystone-listener-log" containerID="cri-o://eda27ff3b94a96a06a6622ff993e4e8c3cf41581cfe4ab3b447a062892589cb0" gracePeriod=30 Mar 16 16:36:34 crc kubenswrapper[5120]: I0316 16:36:34.871728 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-7d8dbd4879-pzj6v" podUID="ebe474a7-759d-4e64-974d-fafd32020f70" containerName="barbican-keystone-listener" containerID="cri-o://dd9eb8403f4030118d3b36ba746e82ca91a3cfe3c961ee54d747966b9a45d5b7" gracePeriod=30 Mar 16 16:36:34 crc kubenswrapper[5120]: I0316 16:36:34.895610 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"68089cb0-f9b0-4b76-9778-e2edffaa4f55","Type":"ContainerDied","Data":"9988bca8a5f464ca11f298198976984df87470781c2b00519eb5597597419683"} Mar 16 16:36:34 crc kubenswrapper[5120]: I0316 16:36:34.895663 5120 scope.go:117] "RemoveContainer" containerID="080f8540395015e16b1273c588e9a186dfbd64eee3d6314236006160630adf34" Mar 16 16:36:34 crc kubenswrapper[5120]: I0316 16:36:34.896911 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:36:34 crc kubenswrapper[5120]: I0316 16:36:34.919892 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"2fbd9119-d73e-4c1e-99b9-8f078e2acdfb","Type":"ContainerStarted","Data":"41f454bf946ac8b5e6eb01d2b76a6ba9b4a70c8ff253b18b28f9a9d124862394"} Mar 16 16:36:34 crc kubenswrapper[5120]: I0316 16:36:34.919982 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:36:34 crc kubenswrapper[5120]: I0316 16:36:34.939567 5120 scope.go:117] "RemoveContainer" containerID="2ac4108315559f612a567fff03f8ef9fecb013f02a2aade950e30e5def4a5997" Mar 16 16:36:34 crc kubenswrapper[5120]: I0316 16:36:34.950816 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-api-0" podStartSLOduration=5.950795707 podStartE2EDuration="5.950795707s" podCreationTimestamp="2026-03-16 16:36:29 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:36:34.943275111 +0000 UTC m=+3897.097206768" watchObservedRunningTime="2026-03-16 16:36:34.950795707 +0000 UTC m=+3897.104727364" Mar 16 16:36:34 crc kubenswrapper[5120]: I0316 16:36:34.952512 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-api-797c9dbf4-zdnm7" podStartSLOduration=3.952503823 podStartE2EDuration="3.952503823s" podCreationTimestamp="2026-03-16 16:36:31 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:36:34.885342776 +0000 UTC m=+3897.039274453" watchObservedRunningTime="2026-03-16 16:36:34.952503823 +0000 UTC m=+3897.106435480" Mar 16 16:36:35 crc kubenswrapper[5120]: I0316 16:36:35.031531 5120 pod_container_manager_linux.go:217] "Failed to delete cgroup paths" cgroupName=["kubepods","besteffort","pod364bfdcf-9673-41c8-b692-941d68257973"] err="unable to destroy cgroup paths for cgroup [kubepods besteffort pod364bfdcf-9673-41c8-b692-941d68257973] : Timed out while waiting for systemd to remove kubepods-besteffort-pod364bfdcf_9673_41c8_b692_941d68257973.slice" Mar 16 16:36:35 crc kubenswrapper[5120]: E0316 16:36:35.031588 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to delete cgroup paths for [kubepods besteffort pod364bfdcf-9673-41c8-b692-941d68257973] : unable to destroy cgroup paths for cgroup [kubepods besteffort pod364bfdcf-9673-41c8-b692-941d68257973] : Timed out while waiting for systemd to remove kubepods-besteffort-pod364bfdcf_9673_41c8_b692_941d68257973.slice" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podUID="364bfdcf-9673-41c8-b692-941d68257973" Mar 16 16:36:35 crc kubenswrapper[5120]: I0316 16:36:35.074105 5120 scope.go:117] "RemoveContainer" containerID="d8a01b8e047f292f7e2f4b25d537ee3665462d6fe0f49fa52dabe5c9f3858a7b" Mar 16 16:36:35 crc kubenswrapper[5120]: I0316 16:36:35.076669 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68089cb0-f9b0-4b76-9778-e2edffaa4f55-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "68089cb0-f9b0-4b76-9778-e2edffaa4f55" (UID: "68089cb0-f9b0-4b76-9778-e2edffaa4f55"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:36:35 crc kubenswrapper[5120]: I0316 16:36:35.109345 5120 scope.go:117] "RemoveContainer" containerID="cf6905d45807f576db3849ba958c470b3cd948bbfde79600771f3019e54489d0" Mar 16 16:36:35 crc kubenswrapper[5120]: I0316 16:36:35.131982 5120 scope.go:117] "RemoveContainer" containerID="afe5190e423949163505bc79590f2d599a6b431f474f2fcabb56da77844d8a11" Mar 16 16:36:35 crc kubenswrapper[5120]: I0316 16:36:35.138588 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/68089cb0-f9b0-4b76-9778-e2edffaa4f55-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:35 crc kubenswrapper[5120]: I0316 16:36:35.171881 5120 scope.go:117] "RemoveContainer" containerID="7f6e37c552b309e5dc614d49c37a3d12d02090ee33a7533af716ad9dd4eed3ad" Mar 16 16:36:35 crc kubenswrapper[5120]: I0316 16:36:35.216417 5120 scope.go:117] "RemoveContainer" containerID="a65e2e3da3516c3727074c62fc6b9251f1f45049075f88d761d5c9cecc497707" Mar 16 16:36:35 crc kubenswrapper[5120]: I0316 16:36:35.258805 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 16:36:35 crc kubenswrapper[5120]: I0316 16:36:35.266693 5120 scope.go:117] "RemoveContainer" containerID="ddfdaba140c32cd80e6973b4267f27a416f672ad90fd39e23b4abbdab58d45ac" Mar 16 16:36:35 crc kubenswrapper[5120]: I0316 16:36:35.270169 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 16:36:35 crc kubenswrapper[5120]: I0316 16:36:35.324209 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 16:36:35 crc kubenswrapper[5120]: I0316 16:36:35.325895 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68089cb0-f9b0-4b76-9778-e2edffaa4f55" containerName="container-updater" Mar 16 16:36:35 crc kubenswrapper[5120]: I0316 16:36:35.325924 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="68089cb0-f9b0-4b76-9778-e2edffaa4f55" containerName="container-updater" Mar 16 16:36:35 crc kubenswrapper[5120]: I0316 16:36:35.325941 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68089cb0-f9b0-4b76-9778-e2edffaa4f55" containerName="object-replicator" Mar 16 16:36:35 crc kubenswrapper[5120]: I0316 16:36:35.325951 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="68089cb0-f9b0-4b76-9778-e2edffaa4f55" containerName="object-replicator" Mar 16 16:36:35 crc kubenswrapper[5120]: I0316 16:36:35.325998 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68089cb0-f9b0-4b76-9778-e2edffaa4f55" containerName="container-server" Mar 16 16:36:35 crc kubenswrapper[5120]: I0316 16:36:35.326006 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="68089cb0-f9b0-4b76-9778-e2edffaa4f55" containerName="container-server" Mar 16 16:36:35 crc kubenswrapper[5120]: I0316 16:36:35.326021 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68089cb0-f9b0-4b76-9778-e2edffaa4f55" containerName="account-auditor" Mar 16 16:36:35 crc kubenswrapper[5120]: I0316 16:36:35.326028 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="68089cb0-f9b0-4b76-9778-e2edffaa4f55" containerName="account-auditor" Mar 16 16:36:35 crc kubenswrapper[5120]: I0316 16:36:35.326039 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68089cb0-f9b0-4b76-9778-e2edffaa4f55" containerName="object-expirer" Mar 16 16:36:35 crc kubenswrapper[5120]: I0316 16:36:35.326047 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="68089cb0-f9b0-4b76-9778-e2edffaa4f55" containerName="object-expirer" Mar 16 16:36:35 crc kubenswrapper[5120]: I0316 16:36:35.326060 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68089cb0-f9b0-4b76-9778-e2edffaa4f55" containerName="rsync" Mar 16 16:36:35 crc kubenswrapper[5120]: I0316 16:36:35.326069 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="68089cb0-f9b0-4b76-9778-e2edffaa4f55" containerName="rsync" Mar 16 16:36:35 crc kubenswrapper[5120]: I0316 16:36:35.326084 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68089cb0-f9b0-4b76-9778-e2edffaa4f55" containerName="object-server" Mar 16 16:36:35 crc kubenswrapper[5120]: I0316 16:36:35.326091 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="68089cb0-f9b0-4b76-9778-e2edffaa4f55" containerName="object-server" Mar 16 16:36:35 crc kubenswrapper[5120]: I0316 16:36:35.326103 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68089cb0-f9b0-4b76-9778-e2edffaa4f55" containerName="object-updater" Mar 16 16:36:35 crc kubenswrapper[5120]: I0316 16:36:35.326110 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="68089cb0-f9b0-4b76-9778-e2edffaa4f55" containerName="object-updater" Mar 16 16:36:35 crc kubenswrapper[5120]: I0316 16:36:35.326122 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68089cb0-f9b0-4b76-9778-e2edffaa4f55" containerName="account-reaper" Mar 16 16:36:35 crc kubenswrapper[5120]: I0316 16:36:35.326129 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="68089cb0-f9b0-4b76-9778-e2edffaa4f55" containerName="account-reaper" Mar 16 16:36:35 crc kubenswrapper[5120]: I0316 16:36:35.326144 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68089cb0-f9b0-4b76-9778-e2edffaa4f55" containerName="account-replicator" Mar 16 16:36:35 crc kubenswrapper[5120]: I0316 16:36:35.326152 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="68089cb0-f9b0-4b76-9778-e2edffaa4f55" containerName="account-replicator" Mar 16 16:36:35 crc kubenswrapper[5120]: I0316 16:36:35.326162 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68089cb0-f9b0-4b76-9778-e2edffaa4f55" containerName="container-auditor" Mar 16 16:36:35 crc kubenswrapper[5120]: I0316 16:36:35.326169 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="68089cb0-f9b0-4b76-9778-e2edffaa4f55" containerName="container-auditor" Mar 16 16:36:35 crc kubenswrapper[5120]: I0316 16:36:35.326183 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68089cb0-f9b0-4b76-9778-e2edffaa4f55" containerName="swift-recon-cron" Mar 16 16:36:35 crc kubenswrapper[5120]: I0316 16:36:35.326190 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="68089cb0-f9b0-4b76-9778-e2edffaa4f55" containerName="swift-recon-cron" Mar 16 16:36:35 crc kubenswrapper[5120]: I0316 16:36:35.326210 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68089cb0-f9b0-4b76-9778-e2edffaa4f55" containerName="object-auditor" Mar 16 16:36:35 crc kubenswrapper[5120]: I0316 16:36:35.326217 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="68089cb0-f9b0-4b76-9778-e2edffaa4f55" containerName="object-auditor" Mar 16 16:36:35 crc kubenswrapper[5120]: I0316 16:36:35.326226 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68089cb0-f9b0-4b76-9778-e2edffaa4f55" containerName="account-server" Mar 16 16:36:35 crc kubenswrapper[5120]: I0316 16:36:35.326235 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="68089cb0-f9b0-4b76-9778-e2edffaa4f55" containerName="account-server" Mar 16 16:36:35 crc kubenswrapper[5120]: I0316 16:36:35.326250 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68089cb0-f9b0-4b76-9778-e2edffaa4f55" containerName="container-replicator" Mar 16 16:36:35 crc kubenswrapper[5120]: I0316 16:36:35.326257 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="68089cb0-f9b0-4b76-9778-e2edffaa4f55" containerName="container-replicator" Mar 16 16:36:35 crc kubenswrapper[5120]: I0316 16:36:35.326486 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="68089cb0-f9b0-4b76-9778-e2edffaa4f55" containerName="account-reaper" Mar 16 16:36:35 crc kubenswrapper[5120]: I0316 16:36:35.326508 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="68089cb0-f9b0-4b76-9778-e2edffaa4f55" containerName="container-replicator" Mar 16 16:36:35 crc kubenswrapper[5120]: I0316 16:36:35.326521 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="68089cb0-f9b0-4b76-9778-e2edffaa4f55" containerName="container-server" Mar 16 16:36:35 crc kubenswrapper[5120]: I0316 16:36:35.326533 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="68089cb0-f9b0-4b76-9778-e2edffaa4f55" containerName="object-replicator" Mar 16 16:36:35 crc kubenswrapper[5120]: I0316 16:36:35.326547 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="68089cb0-f9b0-4b76-9778-e2edffaa4f55" containerName="object-auditor" Mar 16 16:36:35 crc kubenswrapper[5120]: I0316 16:36:35.326556 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="68089cb0-f9b0-4b76-9778-e2edffaa4f55" containerName="account-replicator" Mar 16 16:36:35 crc kubenswrapper[5120]: I0316 16:36:35.326569 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="68089cb0-f9b0-4b76-9778-e2edffaa4f55" containerName="account-auditor" Mar 16 16:36:35 crc kubenswrapper[5120]: I0316 16:36:35.326586 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="68089cb0-f9b0-4b76-9778-e2edffaa4f55" containerName="container-auditor" Mar 16 16:36:35 crc kubenswrapper[5120]: I0316 16:36:35.326595 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="68089cb0-f9b0-4b76-9778-e2edffaa4f55" containerName="container-updater" Mar 16 16:36:35 crc kubenswrapper[5120]: I0316 16:36:35.326606 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="68089cb0-f9b0-4b76-9778-e2edffaa4f55" containerName="object-server" Mar 16 16:36:35 crc kubenswrapper[5120]: I0316 16:36:35.326614 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="68089cb0-f9b0-4b76-9778-e2edffaa4f55" containerName="swift-recon-cron" Mar 16 16:36:35 crc kubenswrapper[5120]: I0316 16:36:35.326624 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="68089cb0-f9b0-4b76-9778-e2edffaa4f55" containerName="rsync" Mar 16 16:36:35 crc kubenswrapper[5120]: I0316 16:36:35.326636 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="68089cb0-f9b0-4b76-9778-e2edffaa4f55" containerName="object-expirer" Mar 16 16:36:35 crc kubenswrapper[5120]: I0316 16:36:35.326646 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="68089cb0-f9b0-4b76-9778-e2edffaa4f55" containerName="account-server" Mar 16 16:36:35 crc kubenswrapper[5120]: I0316 16:36:35.326659 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="68089cb0-f9b0-4b76-9778-e2edffaa4f55" containerName="object-updater" Mar 16 16:36:35 crc kubenswrapper[5120]: I0316 16:36:35.399084 5120 scope.go:117] "RemoveContainer" containerID="3045e329b7334cfdf59c5f7569d481ddcf6b9cef5a1d41651bdf7a09fe16cce6" Mar 16 16:36:35 crc kubenswrapper[5120]: I0316 16:36:35.404595 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 16:36:35 crc kubenswrapper[5120]: I0316 16:36:35.404841 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:36:35 crc kubenswrapper[5120]: I0316 16:36:35.409249 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"swift-storage-config-data\"" Mar 16 16:36:35 crc kubenswrapper[5120]: I0316 16:36:35.442241 5120 scope.go:117] "RemoveContainer" containerID="bc16f7898a0f29b9a468ef6b20c3e906bab78b7b5706cf556c27a2eca4e6d0d0" Mar 16 16:36:35 crc kubenswrapper[5120]: I0316 16:36:35.463203 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"swift-storage-0\" (UID: \"708cda1d-7af6-486c-ad5d-50f82a3e5eee\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:36:35 crc kubenswrapper[5120]: I0316 16:36:35.463504 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/708cda1d-7af6-486c-ad5d-50f82a3e5eee-combined-ca-bundle\") pod \"swift-storage-0\" (UID: \"708cda1d-7af6-486c-ad5d-50f82a3e5eee\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:36:35 crc kubenswrapper[5120]: I0316 16:36:35.463540 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/708cda1d-7af6-486c-ad5d-50f82a3e5eee-etc-swift\") pod \"swift-storage-0\" (UID: \"708cda1d-7af6-486c-ad5d-50f82a3e5eee\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:36:35 crc kubenswrapper[5120]: I0316 16:36:35.463574 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/708cda1d-7af6-486c-ad5d-50f82a3e5eee-cache\") pod \"swift-storage-0\" (UID: \"708cda1d-7af6-486c-ad5d-50f82a3e5eee\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:36:35 crc kubenswrapper[5120]: I0316 16:36:35.463704 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4pbz\" (UniqueName: \"kubernetes.io/projected/708cda1d-7af6-486c-ad5d-50f82a3e5eee-kube-api-access-g4pbz\") pod \"swift-storage-0\" (UID: \"708cda1d-7af6-486c-ad5d-50f82a3e5eee\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:36:35 crc kubenswrapper[5120]: I0316 16:36:35.463898 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/708cda1d-7af6-486c-ad5d-50f82a3e5eee-lock\") pod \"swift-storage-0\" (UID: \"708cda1d-7af6-486c-ad5d-50f82a3e5eee\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:36:35 crc kubenswrapper[5120]: I0316 16:36:35.487490 5120 scope.go:117] "RemoveContainer" containerID="6c2e9e23b6576fc2a9ba6d556319b9df1b2c25022fca788477700ea2cab3db1d" Mar 16 16:36:35 crc kubenswrapper[5120]: I0316 16:36:35.520494 5120 scope.go:117] "RemoveContainer" containerID="8f419d8d72ab94d7bb8b30064068f9e2053fe497727f9e55de513d7dd5786cb2" Mar 16 16:36:35 crc kubenswrapper[5120]: I0316 16:36:35.544849 5120 scope.go:117] "RemoveContainer" containerID="8af6bcb946bdfa26f8e4fdf72e4b7c90f7536fc40756b5c6dec1a3a61051ec9b" Mar 16 16:36:35 crc kubenswrapper[5120]: I0316 16:36:35.566307 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/708cda1d-7af6-486c-ad5d-50f82a3e5eee-lock\") pod \"swift-storage-0\" (UID: \"708cda1d-7af6-486c-ad5d-50f82a3e5eee\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:36:35 crc kubenswrapper[5120]: I0316 16:36:35.566374 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"swift-storage-0\" (UID: \"708cda1d-7af6-486c-ad5d-50f82a3e5eee\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:36:35 crc kubenswrapper[5120]: I0316 16:36:35.566553 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/708cda1d-7af6-486c-ad5d-50f82a3e5eee-combined-ca-bundle\") pod \"swift-storage-0\" (UID: \"708cda1d-7af6-486c-ad5d-50f82a3e5eee\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:36:35 crc kubenswrapper[5120]: I0316 16:36:35.566580 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/708cda1d-7af6-486c-ad5d-50f82a3e5eee-etc-swift\") pod \"swift-storage-0\" (UID: \"708cda1d-7af6-486c-ad5d-50f82a3e5eee\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:36:35 crc kubenswrapper[5120]: I0316 16:36:35.566606 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/708cda1d-7af6-486c-ad5d-50f82a3e5eee-cache\") pod \"swift-storage-0\" (UID: \"708cda1d-7af6-486c-ad5d-50f82a3e5eee\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:36:35 crc kubenswrapper[5120]: I0316 16:36:35.566701 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g4pbz\" (UniqueName: \"kubernetes.io/projected/708cda1d-7af6-486c-ad5d-50f82a3e5eee-kube-api-access-g4pbz\") pod \"swift-storage-0\" (UID: \"708cda1d-7af6-486c-ad5d-50f82a3e5eee\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:36:35 crc kubenswrapper[5120]: I0316 16:36:35.567990 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/708cda1d-7af6-486c-ad5d-50f82a3e5eee-lock\") pod \"swift-storage-0\" (UID: \"708cda1d-7af6-486c-ad5d-50f82a3e5eee\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:36:35 crc kubenswrapper[5120]: I0316 16:36:35.569277 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"swift-storage-0\" (UID: \"708cda1d-7af6-486c-ad5d-50f82a3e5eee\") device mount path \"/mnt/openstack/pv09\"" pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:36:35 crc kubenswrapper[5120]: I0316 16:36:35.570078 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/708cda1d-7af6-486c-ad5d-50f82a3e5eee-cache\") pod \"swift-storage-0\" (UID: \"708cda1d-7af6-486c-ad5d-50f82a3e5eee\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:36:35 crc kubenswrapper[5120]: I0316 16:36:35.572419 5120 scope.go:117] "RemoveContainer" containerID="5f7141dbd0cf79e47a2a0694e8bb1ee25f24e45613ac19c363191df3d5bd8962" Mar 16 16:36:35 crc kubenswrapper[5120]: I0316 16:36:35.574589 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/708cda1d-7af6-486c-ad5d-50f82a3e5eee-combined-ca-bundle\") pod \"swift-storage-0\" (UID: \"708cda1d-7af6-486c-ad5d-50f82a3e5eee\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:36:35 crc kubenswrapper[5120]: I0316 16:36:35.576284 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/708cda1d-7af6-486c-ad5d-50f82a3e5eee-etc-swift\") pod \"swift-storage-0\" (UID: \"708cda1d-7af6-486c-ad5d-50f82a3e5eee\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:36:35 crc kubenswrapper[5120]: I0316 16:36:35.591090 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4pbz\" (UniqueName: \"kubernetes.io/projected/708cda1d-7af6-486c-ad5d-50f82a3e5eee-kube-api-access-g4pbz\") pod \"swift-storage-0\" (UID: \"708cda1d-7af6-486c-ad5d-50f82a3e5eee\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:36:35 crc kubenswrapper[5120]: I0316 16:36:35.596710 5120 scope.go:117] "RemoveContainer" containerID="f6201cdf3cad8158121c3b8225a265abde1e721d5969401a866ae07675028dac" Mar 16 16:36:35 crc kubenswrapper[5120]: I0316 16:36:35.613630 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"swift-storage-0\" (UID: \"708cda1d-7af6-486c-ad5d-50f82a3e5eee\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:36:35 crc kubenswrapper[5120]: I0316 16:36:35.739381 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:36:35 crc kubenswrapper[5120]: I0316 16:36:35.948079 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"be8b10ce-e42f-4650-bc2f-96fe51dc224c","Type":"ContainerStarted","Data":"7e7209b2abecef7c5b6b8a3d982cdcbbdf7eef3a5a6dd06c0ebe7c5bba967530"} Mar 16 16:36:35 crc kubenswrapper[5120]: I0316 16:36:35.953436 5120 generic.go:358] "Generic (PLEG): container finished" podID="ebe474a7-759d-4e64-974d-fafd32020f70" containerID="eda27ff3b94a96a06a6622ff993e4e8c3cf41581cfe4ab3b447a062892589cb0" exitCode=143 Mar 16 16:36:35 crc kubenswrapper[5120]: I0316 16:36:35.953550 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-7d8dbd4879-pzj6v" event={"ID":"ebe474a7-759d-4e64-974d-fafd32020f70","Type":"ContainerDied","Data":"eda27ff3b94a96a06a6622ff993e4e8c3cf41581cfe4ab3b447a062892589cb0"} Mar 16 16:36:35 crc kubenswrapper[5120]: I0316 16:36:35.956780 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"06e4bc0a-e757-40b7-8ed8-693dd20c185a","Type":"ContainerStarted","Data":"4d07b305ba120824ff17a907693b1904828557196542b5e99cb497424819b28d"} Mar 16 16:36:35 crc kubenswrapper[5120]: I0316 16:36:35.961923 5120 generic.go:358] "Generic (PLEG): container finished" podID="000bd178-fd75-4c35-985c-1e2dd60a7c5e" containerID="08a9e88c90cd9c79e7c4045a39c01661f3c530c9d9689f749173b311825c8645" exitCode=143 Mar 16 16:36:35 crc kubenswrapper[5120]: I0316 16:36:35.962895 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-665c46bb4d-7xhgk" event={"ID":"000bd178-fd75-4c35-985c-1e2dd60a7c5e","Type":"ContainerDied","Data":"08a9e88c90cd9c79e7c4045a39c01661f3c530c9d9689f749173b311825c8645"} Mar 16 16:36:35 crc kubenswrapper[5120]: I0316 16:36:35.963594 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:36:35 crc kubenswrapper[5120]: I0316 16:36:35.984492 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-internal-api-0" podStartSLOduration=5.984469364 podStartE2EDuration="5.984469364s" podCreationTimestamp="2026-03-16 16:36:30 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:36:35.968715501 +0000 UTC m=+3898.122647178" watchObservedRunningTime="2026-03-16 16:36:35.984469364 +0000 UTC m=+3898.138401021" Mar 16 16:36:36 crc kubenswrapper[5120]: I0316 16:36:36.002287 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-external-api-0" podStartSLOduration=7.002265138 podStartE2EDuration="7.002265138s" podCreationTimestamp="2026-03-16 16:36:29 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:36:35.987660117 +0000 UTC m=+3898.141591784" watchObservedRunningTime="2026-03-16 16:36:36.002265138 +0000 UTC m=+3898.156196795" Mar 16 16:36:36 crc kubenswrapper[5120]: I0316 16:36:36.044604 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:36:36 crc kubenswrapper[5120]: I0316 16:36:36.062549 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:36:36 crc kubenswrapper[5120]: I0316 16:36:36.071181 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:36:36 crc kubenswrapper[5120]: I0316 16:36:36.079713 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:36:36 crc kubenswrapper[5120]: I0316 16:36:36.084146 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-novncproxy-config-data\"" Mar 16 16:36:36 crc kubenswrapper[5120]: I0316 16:36:36.088250 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-novncproxy-cell1-public-svc\"" Mar 16 16:36:36 crc kubenswrapper[5120]: I0316 16:36:36.088452 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-novncproxy-cell1-vencrypt\"" Mar 16 16:36:36 crc kubenswrapper[5120]: I0316 16:36:36.099190 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:36:36 crc kubenswrapper[5120]: I0316 16:36:36.189322 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/613be4ed-d055-4f50-a323-8b13e5c5fe1a-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"613be4ed-d055-4f50-a323-8b13e5c5fe1a\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:36:36 crc kubenswrapper[5120]: I0316 16:36:36.189456 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/613be4ed-d055-4f50-a323-8b13e5c5fe1a-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"613be4ed-d055-4f50-a323-8b13e5c5fe1a\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:36:36 crc kubenswrapper[5120]: I0316 16:36:36.189696 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/613be4ed-d055-4f50-a323-8b13e5c5fe1a-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"613be4ed-d055-4f50-a323-8b13e5c5fe1a\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:36:36 crc kubenswrapper[5120]: I0316 16:36:36.189870 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzxsf\" (UniqueName: \"kubernetes.io/projected/613be4ed-d055-4f50-a323-8b13e5c5fe1a-kube-api-access-dzxsf\") pod \"nova-cell1-novncproxy-0\" (UID: \"613be4ed-d055-4f50-a323-8b13e5c5fe1a\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:36:36 crc kubenswrapper[5120]: I0316 16:36:36.189933 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/613be4ed-d055-4f50-a323-8b13e5c5fe1a-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"613be4ed-d055-4f50-a323-8b13e5c5fe1a\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:36:36 crc kubenswrapper[5120]: W0316 16:36:36.258935 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod708cda1d_7af6_486c_ad5d_50f82a3e5eee.slice/crio-c0d28bce0673740701d04334d17ec89d42f81f34cdb94ee7919778119510d418 WatchSource:0}: Error finding container c0d28bce0673740701d04334d17ec89d42f81f34cdb94ee7919778119510d418: Status 404 returned error can't find the container with id c0d28bce0673740701d04334d17ec89d42f81f34cdb94ee7919778119510d418 Mar 16 16:36:36 crc kubenswrapper[5120]: I0316 16:36:36.259798 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 16:36:36 crc kubenswrapper[5120]: I0316 16:36:36.293360 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/613be4ed-d055-4f50-a323-8b13e5c5fe1a-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"613be4ed-d055-4f50-a323-8b13e5c5fe1a\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:36:36 crc kubenswrapper[5120]: I0316 16:36:36.293562 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/613be4ed-d055-4f50-a323-8b13e5c5fe1a-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"613be4ed-d055-4f50-a323-8b13e5c5fe1a\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:36:36 crc kubenswrapper[5120]: I0316 16:36:36.293645 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/613be4ed-d055-4f50-a323-8b13e5c5fe1a-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"613be4ed-d055-4f50-a323-8b13e5c5fe1a\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:36:36 crc kubenswrapper[5120]: I0316 16:36:36.293802 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/613be4ed-d055-4f50-a323-8b13e5c5fe1a-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"613be4ed-d055-4f50-a323-8b13e5c5fe1a\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:36:36 crc kubenswrapper[5120]: I0316 16:36:36.293912 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dzxsf\" (UniqueName: \"kubernetes.io/projected/613be4ed-d055-4f50-a323-8b13e5c5fe1a-kube-api-access-dzxsf\") pod \"nova-cell1-novncproxy-0\" (UID: \"613be4ed-d055-4f50-a323-8b13e5c5fe1a\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:36:36 crc kubenswrapper[5120]: I0316 16:36:36.297450 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/613be4ed-d055-4f50-a323-8b13e5c5fe1a-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"613be4ed-d055-4f50-a323-8b13e5c5fe1a\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:36:36 crc kubenswrapper[5120]: I0316 16:36:36.297925 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/613be4ed-d055-4f50-a323-8b13e5c5fe1a-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"613be4ed-d055-4f50-a323-8b13e5c5fe1a\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:36:36 crc kubenswrapper[5120]: I0316 16:36:36.298012 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/613be4ed-d055-4f50-a323-8b13e5c5fe1a-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"613be4ed-d055-4f50-a323-8b13e5c5fe1a\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:36:36 crc kubenswrapper[5120]: I0316 16:36:36.298914 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/613be4ed-d055-4f50-a323-8b13e5c5fe1a-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"613be4ed-d055-4f50-a323-8b13e5c5fe1a\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:36:36 crc kubenswrapper[5120]: I0316 16:36:36.312244 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzxsf\" (UniqueName: \"kubernetes.io/projected/613be4ed-d055-4f50-a323-8b13e5c5fe1a-kube-api-access-dzxsf\") pod \"nova-cell1-novncproxy-0\" (UID: \"613be4ed-d055-4f50-a323-8b13e5c5fe1a\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:36:36 crc kubenswrapper[5120]: I0316 16:36:36.413857 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:36:36 crc kubenswrapper[5120]: I0316 16:36:36.667611 5120 scope.go:117] "RemoveContainer" containerID="0a15d5caff30dc8885f782e59962af7d98d58b39ab76059e56e5827e10e7ab8b" Mar 16 16:36:36 crc kubenswrapper[5120]: E0316 16:36:36.668190 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:36:36 crc kubenswrapper[5120]: I0316 16:36:36.680514 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="364bfdcf-9673-41c8-b692-941d68257973" path="/var/lib/kubelet/pods/364bfdcf-9673-41c8-b692-941d68257973/volumes" Mar 16 16:36:36 crc kubenswrapper[5120]: I0316 16:36:36.681371 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="68089cb0-f9b0-4b76-9778-e2edffaa4f55" path="/var/lib/kubelet/pods/68089cb0-f9b0-4b76-9778-e2edffaa4f55/volumes" Mar 16 16:36:36 crc kubenswrapper[5120]: I0316 16:36:36.883126 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-665c46bb4d-7xhgk" Mar 16 16:36:36 crc kubenswrapper[5120]: I0316 16:36:36.970421 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:36:36 crc kubenswrapper[5120]: I0316 16:36:36.994790 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"708cda1d-7af6-486c-ad5d-50f82a3e5eee","Type":"ContainerStarted","Data":"c679ce3dd4a808c71f57d8f9829ff2391a97abc295485a606cdcadac0ee9033c"} Mar 16 16:36:36 crc kubenswrapper[5120]: I0316 16:36:36.994850 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"708cda1d-7af6-486c-ad5d-50f82a3e5eee","Type":"ContainerStarted","Data":"c0d28bce0673740701d04334d17ec89d42f81f34cdb94ee7919778119510d418"} Mar 16 16:36:37 crc kubenswrapper[5120]: I0316 16:36:37.003017 5120 generic.go:358] "Generic (PLEG): container finished" podID="fec060e6-11fd-4d16-8640-fd02366a7601" containerID="79adda27973c1bfe253f64a2645483f9b18b3eee51fbf7b661c609dce336ef3f" exitCode=0 Mar 16 16:36:37 crc kubenswrapper[5120]: I0316 16:36:37.003282 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-xn726" event={"ID":"fec060e6-11fd-4d16-8640-fd02366a7601","Type":"ContainerDied","Data":"79adda27973c1bfe253f64a2645483f9b18b3eee51fbf7b661c609dce336ef3f"} Mar 16 16:36:37 crc kubenswrapper[5120]: I0316 16:36:37.008432 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"613be4ed-d055-4f50-a323-8b13e5c5fe1a","Type":"ContainerStarted","Data":"01709478ab809cf613f8984467be91e2c416eb70a553ec8b0166a39bf5ce8c52"} Mar 16 16:36:37 crc kubenswrapper[5120]: I0316 16:36:37.016483 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/000bd178-fd75-4c35-985c-1e2dd60a7c5e-config-data\") pod \"000bd178-fd75-4c35-985c-1e2dd60a7c5e\" (UID: \"000bd178-fd75-4c35-985c-1e2dd60a7c5e\") " Mar 16 16:36:37 crc kubenswrapper[5120]: I0316 16:36:37.016564 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hpfsn\" (UniqueName: \"kubernetes.io/projected/000bd178-fd75-4c35-985c-1e2dd60a7c5e-kube-api-access-hpfsn\") pod \"000bd178-fd75-4c35-985c-1e2dd60a7c5e\" (UID: \"000bd178-fd75-4c35-985c-1e2dd60a7c5e\") " Mar 16 16:36:37 crc kubenswrapper[5120]: I0316 16:36:37.016658 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/000bd178-fd75-4c35-985c-1e2dd60a7c5e-config-data-custom\") pod \"000bd178-fd75-4c35-985c-1e2dd60a7c5e\" (UID: \"000bd178-fd75-4c35-985c-1e2dd60a7c5e\") " Mar 16 16:36:37 crc kubenswrapper[5120]: I0316 16:36:37.017216 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/000bd178-fd75-4c35-985c-1e2dd60a7c5e-combined-ca-bundle\") pod \"000bd178-fd75-4c35-985c-1e2dd60a7c5e\" (UID: \"000bd178-fd75-4c35-985c-1e2dd60a7c5e\") " Mar 16 16:36:37 crc kubenswrapper[5120]: I0316 16:36:37.017263 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/000bd178-fd75-4c35-985c-1e2dd60a7c5e-logs\") pod \"000bd178-fd75-4c35-985c-1e2dd60a7c5e\" (UID: \"000bd178-fd75-4c35-985c-1e2dd60a7c5e\") " Mar 16 16:36:37 crc kubenswrapper[5120]: I0316 16:36:37.017832 5120 generic.go:358] "Generic (PLEG): container finished" podID="000bd178-fd75-4c35-985c-1e2dd60a7c5e" containerID="991fab175bf58adabc385c61a11ffb100168afab5737d5474c6261641322a276" exitCode=0 Mar 16 16:36:37 crc kubenswrapper[5120]: I0316 16:36:37.018737 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-665c46bb4d-7xhgk" event={"ID":"000bd178-fd75-4c35-985c-1e2dd60a7c5e","Type":"ContainerDied","Data":"991fab175bf58adabc385c61a11ffb100168afab5737d5474c6261641322a276"} Mar 16 16:36:37 crc kubenswrapper[5120]: I0316 16:36:37.018841 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-665c46bb4d-7xhgk" event={"ID":"000bd178-fd75-4c35-985c-1e2dd60a7c5e","Type":"ContainerDied","Data":"14e5d34a134946386f8bc40e6a621d4576cb2696b4c3d201c16984b7bf0f2f66"} Mar 16 16:36:37 crc kubenswrapper[5120]: I0316 16:36:37.018867 5120 scope.go:117] "RemoveContainer" containerID="991fab175bf58adabc385c61a11ffb100168afab5737d5474c6261641322a276" Mar 16 16:36:37 crc kubenswrapper[5120]: I0316 16:36:37.019107 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-665c46bb4d-7xhgk" Mar 16 16:36:37 crc kubenswrapper[5120]: I0316 16:36:37.019386 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/000bd178-fd75-4c35-985c-1e2dd60a7c5e-logs" (OuterVolumeSpecName: "logs") pod "000bd178-fd75-4c35-985c-1e2dd60a7c5e" (UID: "000bd178-fd75-4c35-985c-1e2dd60a7c5e"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:36:37 crc kubenswrapper[5120]: I0316 16:36:37.027153 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/000bd178-fd75-4c35-985c-1e2dd60a7c5e-kube-api-access-hpfsn" (OuterVolumeSpecName: "kube-api-access-hpfsn") pod "000bd178-fd75-4c35-985c-1e2dd60a7c5e" (UID: "000bd178-fd75-4c35-985c-1e2dd60a7c5e"). InnerVolumeSpecName "kube-api-access-hpfsn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:36:37 crc kubenswrapper[5120]: I0316 16:36:37.031212 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/000bd178-fd75-4c35-985c-1e2dd60a7c5e-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "000bd178-fd75-4c35-985c-1e2dd60a7c5e" (UID: "000bd178-fd75-4c35-985c-1e2dd60a7c5e"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:36:37 crc kubenswrapper[5120]: I0316 16:36:37.064774 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/000bd178-fd75-4c35-985c-1e2dd60a7c5e-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "000bd178-fd75-4c35-985c-1e2dd60a7c5e" (UID: "000bd178-fd75-4c35-985c-1e2dd60a7c5e"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:36:37 crc kubenswrapper[5120]: I0316 16:36:37.082216 5120 scope.go:117] "RemoveContainer" containerID="08a9e88c90cd9c79e7c4045a39c01661f3c530c9d9689f749173b311825c8645" Mar 16 16:36:37 crc kubenswrapper[5120]: I0316 16:36:37.090495 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/000bd178-fd75-4c35-985c-1e2dd60a7c5e-config-data" (OuterVolumeSpecName: "config-data") pod "000bd178-fd75-4c35-985c-1e2dd60a7c5e" (UID: "000bd178-fd75-4c35-985c-1e2dd60a7c5e"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:36:37 crc kubenswrapper[5120]: I0316 16:36:37.111117 5120 scope.go:117] "RemoveContainer" containerID="991fab175bf58adabc385c61a11ffb100168afab5737d5474c6261641322a276" Mar 16 16:36:37 crc kubenswrapper[5120]: E0316 16:36:37.111594 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"991fab175bf58adabc385c61a11ffb100168afab5737d5474c6261641322a276\": container with ID starting with 991fab175bf58adabc385c61a11ffb100168afab5737d5474c6261641322a276 not found: ID does not exist" containerID="991fab175bf58adabc385c61a11ffb100168afab5737d5474c6261641322a276" Mar 16 16:36:37 crc kubenswrapper[5120]: I0316 16:36:37.111743 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"991fab175bf58adabc385c61a11ffb100168afab5737d5474c6261641322a276"} err="failed to get container status \"991fab175bf58adabc385c61a11ffb100168afab5737d5474c6261641322a276\": rpc error: code = NotFound desc = could not find container \"991fab175bf58adabc385c61a11ffb100168afab5737d5474c6261641322a276\": container with ID starting with 991fab175bf58adabc385c61a11ffb100168afab5737d5474c6261641322a276 not found: ID does not exist" Mar 16 16:36:37 crc kubenswrapper[5120]: I0316 16:36:37.111889 5120 scope.go:117] "RemoveContainer" containerID="08a9e88c90cd9c79e7c4045a39c01661f3c530c9d9689f749173b311825c8645" Mar 16 16:36:37 crc kubenswrapper[5120]: E0316 16:36:37.112253 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"08a9e88c90cd9c79e7c4045a39c01661f3c530c9d9689f749173b311825c8645\": container with ID starting with 08a9e88c90cd9c79e7c4045a39c01661f3c530c9d9689f749173b311825c8645 not found: ID does not exist" containerID="08a9e88c90cd9c79e7c4045a39c01661f3c530c9d9689f749173b311825c8645" Mar 16 16:36:37 crc kubenswrapper[5120]: I0316 16:36:37.112291 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08a9e88c90cd9c79e7c4045a39c01661f3c530c9d9689f749173b311825c8645"} err="failed to get container status \"08a9e88c90cd9c79e7c4045a39c01661f3c530c9d9689f749173b311825c8645\": rpc error: code = NotFound desc = could not find container \"08a9e88c90cd9c79e7c4045a39c01661f3c530c9d9689f749173b311825c8645\": container with ID starting with 08a9e88c90cd9c79e7c4045a39c01661f3c530c9d9689f749173b311825c8645 not found: ID does not exist" Mar 16 16:36:37 crc kubenswrapper[5120]: I0316 16:36:37.125533 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/000bd178-fd75-4c35-985c-1e2dd60a7c5e-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:37 crc kubenswrapper[5120]: I0316 16:36:37.125574 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/000bd178-fd75-4c35-985c-1e2dd60a7c5e-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:37 crc kubenswrapper[5120]: I0316 16:36:37.125588 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/000bd178-fd75-4c35-985c-1e2dd60a7c5e-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:37 crc kubenswrapper[5120]: I0316 16:36:37.125603 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hpfsn\" (UniqueName: \"kubernetes.io/projected/000bd178-fd75-4c35-985c-1e2dd60a7c5e-kube-api-access-hpfsn\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:37 crc kubenswrapper[5120]: I0316 16:36:37.125615 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/000bd178-fd75-4c35-985c-1e2dd60a7c5e-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:37 crc kubenswrapper[5120]: I0316 16:36:37.369278 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-665c46bb4d-7xhgk"] Mar 16 16:36:37 crc kubenswrapper[5120]: I0316 16:36:37.382120 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-worker-665c46bb4d-7xhgk"] Mar 16 16:36:38 crc kubenswrapper[5120]: I0316 16:36:38.060867 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"708cda1d-7af6-486c-ad5d-50f82a3e5eee","Type":"ContainerStarted","Data":"06fa89856071765dcf02b87f89cb5dafc8a1764000e8fa026e6ff3fba5435780"} Mar 16 16:36:38 crc kubenswrapper[5120]: I0316 16:36:38.061309 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"708cda1d-7af6-486c-ad5d-50f82a3e5eee","Type":"ContainerStarted","Data":"baa0c4a6d21177c2e1c933f890193bc3539da215fdf454524535cbb7290a3f94"} Mar 16 16:36:38 crc kubenswrapper[5120]: I0316 16:36:38.061341 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"708cda1d-7af6-486c-ad5d-50f82a3e5eee","Type":"ContainerStarted","Data":"10d720603adc56937a4b0048d6ae917e0e1cc6c9b0e270b374493b0f40d01f5b"} Mar 16 16:36:38 crc kubenswrapper[5120]: I0316 16:36:38.061355 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"708cda1d-7af6-486c-ad5d-50f82a3e5eee","Type":"ContainerStarted","Data":"d564e0e790fc7bc6f314de61c82fd0cb162da9171a21465233e947e34df0144d"} Mar 16 16:36:38 crc kubenswrapper[5120]: I0316 16:36:38.061369 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"708cda1d-7af6-486c-ad5d-50f82a3e5eee","Type":"ContainerStarted","Data":"1a366251ecfae1d36d2a256394ecbfa03feea52ce05848c7f59f88fc9e4f645d"} Mar 16 16:36:38 crc kubenswrapper[5120]: I0316 16:36:38.061380 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"708cda1d-7af6-486c-ad5d-50f82a3e5eee","Type":"ContainerStarted","Data":"0e3418c7558099ed9abc22efacb74638ba79a34cc2d57f8552a793c13d62a916"} Mar 16 16:36:38 crc kubenswrapper[5120]: I0316 16:36:38.070342 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"613be4ed-d055-4f50-a323-8b13e5c5fe1a","Type":"ContainerStarted","Data":"4e25db5c9a91ab6c5e9d9ea567f1afbd22b33692b261fb638331d9b211b125db"} Mar 16 16:36:38 crc kubenswrapper[5120]: I0316 16:36:38.139048 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podStartSLOduration=2.139027256 podStartE2EDuration="2.139027256s" podCreationTimestamp="2026-03-16 16:36:36 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:36:38.127988057 +0000 UTC m=+3900.281919704" watchObservedRunningTime="2026-03-16 16:36:38.139027256 +0000 UTC m=+3900.292958913" Mar 16 16:36:38 crc kubenswrapper[5120]: I0316 16:36:38.445560 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-xn726" Mar 16 16:36:38 crc kubenswrapper[5120]: I0316 16:36:38.525374 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fec060e6-11fd-4d16-8640-fd02366a7601-combined-ca-bundle\") pod \"fec060e6-11fd-4d16-8640-fd02366a7601\" (UID: \"fec060e6-11fd-4d16-8640-fd02366a7601\") " Mar 16 16:36:38 crc kubenswrapper[5120]: I0316 16:36:38.525618 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nk9pr\" (UniqueName: \"kubernetes.io/projected/fec060e6-11fd-4d16-8640-fd02366a7601-kube-api-access-nk9pr\") pod \"fec060e6-11fd-4d16-8640-fd02366a7601\" (UID: \"fec060e6-11fd-4d16-8640-fd02366a7601\") " Mar 16 16:36:38 crc kubenswrapper[5120]: I0316 16:36:38.526012 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/fec060e6-11fd-4d16-8640-fd02366a7601-credential-keys\") pod \"fec060e6-11fd-4d16-8640-fd02366a7601\" (UID: \"fec060e6-11fd-4d16-8640-fd02366a7601\") " Mar 16 16:36:38 crc kubenswrapper[5120]: I0316 16:36:38.526218 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/fec060e6-11fd-4d16-8640-fd02366a7601-fernet-keys\") pod \"fec060e6-11fd-4d16-8640-fd02366a7601\" (UID: \"fec060e6-11fd-4d16-8640-fd02366a7601\") " Mar 16 16:36:38 crc kubenswrapper[5120]: I0316 16:36:38.526297 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fec060e6-11fd-4d16-8640-fd02366a7601-config-data\") pod \"fec060e6-11fd-4d16-8640-fd02366a7601\" (UID: \"fec060e6-11fd-4d16-8640-fd02366a7601\") " Mar 16 16:36:38 crc kubenswrapper[5120]: I0316 16:36:38.526411 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/fec060e6-11fd-4d16-8640-fd02366a7601-scripts\") pod \"fec060e6-11fd-4d16-8640-fd02366a7601\" (UID: \"fec060e6-11fd-4d16-8640-fd02366a7601\") " Mar 16 16:36:38 crc kubenswrapper[5120]: I0316 16:36:38.529554 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fec060e6-11fd-4d16-8640-fd02366a7601-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "fec060e6-11fd-4d16-8640-fd02366a7601" (UID: "fec060e6-11fd-4d16-8640-fd02366a7601"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:36:38 crc kubenswrapper[5120]: I0316 16:36:38.530314 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fec060e6-11fd-4d16-8640-fd02366a7601-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "fec060e6-11fd-4d16-8640-fd02366a7601" (UID: "fec060e6-11fd-4d16-8640-fd02366a7601"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:36:38 crc kubenswrapper[5120]: I0316 16:36:38.531388 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fec060e6-11fd-4d16-8640-fd02366a7601-kube-api-access-nk9pr" (OuterVolumeSpecName: "kube-api-access-nk9pr") pod "fec060e6-11fd-4d16-8640-fd02366a7601" (UID: "fec060e6-11fd-4d16-8640-fd02366a7601"). InnerVolumeSpecName "kube-api-access-nk9pr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:36:38 crc kubenswrapper[5120]: I0316 16:36:38.534489 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fec060e6-11fd-4d16-8640-fd02366a7601-scripts" (OuterVolumeSpecName: "scripts") pod "fec060e6-11fd-4d16-8640-fd02366a7601" (UID: "fec060e6-11fd-4d16-8640-fd02366a7601"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:36:38 crc kubenswrapper[5120]: I0316 16:36:38.562258 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fec060e6-11fd-4d16-8640-fd02366a7601-config-data" (OuterVolumeSpecName: "config-data") pod "fec060e6-11fd-4d16-8640-fd02366a7601" (UID: "fec060e6-11fd-4d16-8640-fd02366a7601"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:36:38 crc kubenswrapper[5120]: I0316 16:36:38.562354 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fec060e6-11fd-4d16-8640-fd02366a7601-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "fec060e6-11fd-4d16-8640-fd02366a7601" (UID: "fec060e6-11fd-4d16-8640-fd02366a7601"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:36:38 crc kubenswrapper[5120]: I0316 16:36:38.629488 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nk9pr\" (UniqueName: \"kubernetes.io/projected/fec060e6-11fd-4d16-8640-fd02366a7601-kube-api-access-nk9pr\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:38 crc kubenswrapper[5120]: I0316 16:36:38.629541 5120 reconciler_common.go:299] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/fec060e6-11fd-4d16-8640-fd02366a7601-credential-keys\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:38 crc kubenswrapper[5120]: I0316 16:36:38.629555 5120 reconciler_common.go:299] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/fec060e6-11fd-4d16-8640-fd02366a7601-fernet-keys\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:38 crc kubenswrapper[5120]: I0316 16:36:38.629569 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fec060e6-11fd-4d16-8640-fd02366a7601-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:38 crc kubenswrapper[5120]: I0316 16:36:38.629580 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/fec060e6-11fd-4d16-8640-fd02366a7601-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:38 crc kubenswrapper[5120]: I0316 16:36:38.629591 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fec060e6-11fd-4d16-8640-fd02366a7601-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:38 crc kubenswrapper[5120]: I0316 16:36:38.687229 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="000bd178-fd75-4c35-985c-1e2dd60a7c5e" path="/var/lib/kubelet/pods/000bd178-fd75-4c35-985c-1e2dd60a7c5e/volumes" Mar 16 16:36:39 crc kubenswrapper[5120]: I0316 16:36:39.141680 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"708cda1d-7af6-486c-ad5d-50f82a3e5eee","Type":"ContainerStarted","Data":"bf2ddc46d62b71561f1fe4a22e4392ac4dd0e057752f19cd798973007180aae1"} Mar 16 16:36:39 crc kubenswrapper[5120]: I0316 16:36:39.146294 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"708cda1d-7af6-486c-ad5d-50f82a3e5eee","Type":"ContainerStarted","Data":"823234100a1705932c1298bfadc9095820a0f38e7d1438de637e080956108375"} Mar 16 16:36:39 crc kubenswrapper[5120]: I0316 16:36:39.146431 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"708cda1d-7af6-486c-ad5d-50f82a3e5eee","Type":"ContainerStarted","Data":"b3a0ff5f334911145baa06ed5e742c3115c5a82fb0be18d3a46674ff7bce8910"} Mar 16 16:36:39 crc kubenswrapper[5120]: I0316 16:36:39.146535 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"708cda1d-7af6-486c-ad5d-50f82a3e5eee","Type":"ContainerStarted","Data":"dd56dfa0b7f61c69b878b62814f7bd9a5e2e0a179c234413d454b0f170263cde"} Mar 16 16:36:39 crc kubenswrapper[5120]: I0316 16:36:39.146631 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-5769b4cdff-x2jfw"] Mar 16 16:36:39 crc kubenswrapper[5120]: I0316 16:36:39.153455 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="000bd178-fd75-4c35-985c-1e2dd60a7c5e" containerName="barbican-worker" Mar 16 16:36:39 crc kubenswrapper[5120]: I0316 16:36:39.153576 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="000bd178-fd75-4c35-985c-1e2dd60a7c5e" containerName="barbican-worker" Mar 16 16:36:39 crc kubenswrapper[5120]: I0316 16:36:39.153658 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="000bd178-fd75-4c35-985c-1e2dd60a7c5e" containerName="barbican-worker-log" Mar 16 16:36:39 crc kubenswrapper[5120]: I0316 16:36:39.153734 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="000bd178-fd75-4c35-985c-1e2dd60a7c5e" containerName="barbican-worker-log" Mar 16 16:36:39 crc kubenswrapper[5120]: I0316 16:36:39.153886 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fec060e6-11fd-4d16-8640-fd02366a7601" containerName="keystone-bootstrap" Mar 16 16:36:39 crc kubenswrapper[5120]: I0316 16:36:39.154814 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="fec060e6-11fd-4d16-8640-fd02366a7601" containerName="keystone-bootstrap" Mar 16 16:36:39 crc kubenswrapper[5120]: I0316 16:36:39.155350 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="000bd178-fd75-4c35-985c-1e2dd60a7c5e" containerName="barbican-worker" Mar 16 16:36:39 crc kubenswrapper[5120]: I0316 16:36:39.156243 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="fec060e6-11fd-4d16-8640-fd02366a7601" containerName="keystone-bootstrap" Mar 16 16:36:39 crc kubenswrapper[5120]: I0316 16:36:39.156353 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="000bd178-fd75-4c35-985c-1e2dd60a7c5e" containerName="barbican-worker-log" Mar 16 16:36:39 crc kubenswrapper[5120]: I0316 16:36:39.168105 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-xn726" Mar 16 16:36:39 crc kubenswrapper[5120]: I0316 16:36:39.193698 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-xn726" event={"ID":"fec060e6-11fd-4d16-8640-fd02366a7601","Type":"ContainerDied","Data":"cf47aaebf63137acc7a77d17eb41eeb5f06bc1f346811dfa1f366d667ed8d6a4"} Mar 16 16:36:39 crc kubenswrapper[5120]: I0316 16:36:39.193742 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cf47aaebf63137acc7a77d17eb41eeb5f06bc1f346811dfa1f366d667ed8d6a4" Mar 16 16:36:39 crc kubenswrapper[5120]: I0316 16:36:39.193856 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-5769b4cdff-x2jfw"] Mar 16 16:36:39 crc kubenswrapper[5120]: I0316 16:36:39.193931 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-5769b4cdff-x2jfw" Mar 16 16:36:39 crc kubenswrapper[5120]: I0316 16:36:39.246321 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7khf\" (UniqueName: \"kubernetes.io/projected/864a1551-0ebe-4575-afc8-964686953825-kube-api-access-s7khf\") pod \"keystone-5769b4cdff-x2jfw\" (UID: \"864a1551-0ebe-4575-afc8-964686953825\") " pod="openstack-kuttl-tests/keystone-5769b4cdff-x2jfw" Mar 16 16:36:39 crc kubenswrapper[5120]: I0316 16:36:39.246430 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/864a1551-0ebe-4575-afc8-964686953825-combined-ca-bundle\") pod \"keystone-5769b4cdff-x2jfw\" (UID: \"864a1551-0ebe-4575-afc8-964686953825\") " pod="openstack-kuttl-tests/keystone-5769b4cdff-x2jfw" Mar 16 16:36:39 crc kubenswrapper[5120]: I0316 16:36:39.246511 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/864a1551-0ebe-4575-afc8-964686953825-credential-keys\") pod \"keystone-5769b4cdff-x2jfw\" (UID: \"864a1551-0ebe-4575-afc8-964686953825\") " pod="openstack-kuttl-tests/keystone-5769b4cdff-x2jfw" Mar 16 16:36:39 crc kubenswrapper[5120]: I0316 16:36:39.246568 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/864a1551-0ebe-4575-afc8-964686953825-scripts\") pod \"keystone-5769b4cdff-x2jfw\" (UID: \"864a1551-0ebe-4575-afc8-964686953825\") " pod="openstack-kuttl-tests/keystone-5769b4cdff-x2jfw" Mar 16 16:36:39 crc kubenswrapper[5120]: I0316 16:36:39.246707 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/864a1551-0ebe-4575-afc8-964686953825-public-tls-certs\") pod \"keystone-5769b4cdff-x2jfw\" (UID: \"864a1551-0ebe-4575-afc8-964686953825\") " pod="openstack-kuttl-tests/keystone-5769b4cdff-x2jfw" Mar 16 16:36:39 crc kubenswrapper[5120]: I0316 16:36:39.246927 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/864a1551-0ebe-4575-afc8-964686953825-config-data\") pod \"keystone-5769b4cdff-x2jfw\" (UID: \"864a1551-0ebe-4575-afc8-964686953825\") " pod="openstack-kuttl-tests/keystone-5769b4cdff-x2jfw" Mar 16 16:36:39 crc kubenswrapper[5120]: I0316 16:36:39.247047 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/864a1551-0ebe-4575-afc8-964686953825-internal-tls-certs\") pod \"keystone-5769b4cdff-x2jfw\" (UID: \"864a1551-0ebe-4575-afc8-964686953825\") " pod="openstack-kuttl-tests/keystone-5769b4cdff-x2jfw" Mar 16 16:36:39 crc kubenswrapper[5120]: I0316 16:36:39.247158 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/864a1551-0ebe-4575-afc8-964686953825-fernet-keys\") pod \"keystone-5769b4cdff-x2jfw\" (UID: \"864a1551-0ebe-4575-afc8-964686953825\") " pod="openstack-kuttl-tests/keystone-5769b4cdff-x2jfw" Mar 16 16:36:39 crc kubenswrapper[5120]: I0316 16:36:39.350772 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s7khf\" (UniqueName: \"kubernetes.io/projected/864a1551-0ebe-4575-afc8-964686953825-kube-api-access-s7khf\") pod \"keystone-5769b4cdff-x2jfw\" (UID: \"864a1551-0ebe-4575-afc8-964686953825\") " pod="openstack-kuttl-tests/keystone-5769b4cdff-x2jfw" Mar 16 16:36:39 crc kubenswrapper[5120]: I0316 16:36:39.350865 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/864a1551-0ebe-4575-afc8-964686953825-combined-ca-bundle\") pod \"keystone-5769b4cdff-x2jfw\" (UID: \"864a1551-0ebe-4575-afc8-964686953825\") " pod="openstack-kuttl-tests/keystone-5769b4cdff-x2jfw" Mar 16 16:36:39 crc kubenswrapper[5120]: I0316 16:36:39.350941 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/864a1551-0ebe-4575-afc8-964686953825-credential-keys\") pod \"keystone-5769b4cdff-x2jfw\" (UID: \"864a1551-0ebe-4575-afc8-964686953825\") " pod="openstack-kuttl-tests/keystone-5769b4cdff-x2jfw" Mar 16 16:36:39 crc kubenswrapper[5120]: I0316 16:36:39.351006 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/864a1551-0ebe-4575-afc8-964686953825-scripts\") pod \"keystone-5769b4cdff-x2jfw\" (UID: \"864a1551-0ebe-4575-afc8-964686953825\") " pod="openstack-kuttl-tests/keystone-5769b4cdff-x2jfw" Mar 16 16:36:39 crc kubenswrapper[5120]: I0316 16:36:39.351100 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/864a1551-0ebe-4575-afc8-964686953825-public-tls-certs\") pod \"keystone-5769b4cdff-x2jfw\" (UID: \"864a1551-0ebe-4575-afc8-964686953825\") " pod="openstack-kuttl-tests/keystone-5769b4cdff-x2jfw" Mar 16 16:36:39 crc kubenswrapper[5120]: I0316 16:36:39.351137 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/864a1551-0ebe-4575-afc8-964686953825-config-data\") pod \"keystone-5769b4cdff-x2jfw\" (UID: \"864a1551-0ebe-4575-afc8-964686953825\") " pod="openstack-kuttl-tests/keystone-5769b4cdff-x2jfw" Mar 16 16:36:39 crc kubenswrapper[5120]: I0316 16:36:39.351221 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/864a1551-0ebe-4575-afc8-964686953825-internal-tls-certs\") pod \"keystone-5769b4cdff-x2jfw\" (UID: \"864a1551-0ebe-4575-afc8-964686953825\") " pod="openstack-kuttl-tests/keystone-5769b4cdff-x2jfw" Mar 16 16:36:39 crc kubenswrapper[5120]: I0316 16:36:39.351260 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/864a1551-0ebe-4575-afc8-964686953825-fernet-keys\") pod \"keystone-5769b4cdff-x2jfw\" (UID: \"864a1551-0ebe-4575-afc8-964686953825\") " pod="openstack-kuttl-tests/keystone-5769b4cdff-x2jfw" Mar 16 16:36:39 crc kubenswrapper[5120]: I0316 16:36:39.355458 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/864a1551-0ebe-4575-afc8-964686953825-credential-keys\") pod \"keystone-5769b4cdff-x2jfw\" (UID: \"864a1551-0ebe-4575-afc8-964686953825\") " pod="openstack-kuttl-tests/keystone-5769b4cdff-x2jfw" Mar 16 16:36:39 crc kubenswrapper[5120]: I0316 16:36:39.359054 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/864a1551-0ebe-4575-afc8-964686953825-fernet-keys\") pod \"keystone-5769b4cdff-x2jfw\" (UID: \"864a1551-0ebe-4575-afc8-964686953825\") " pod="openstack-kuttl-tests/keystone-5769b4cdff-x2jfw" Mar 16 16:36:39 crc kubenswrapper[5120]: I0316 16:36:39.359170 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/864a1551-0ebe-4575-afc8-964686953825-scripts\") pod \"keystone-5769b4cdff-x2jfw\" (UID: \"864a1551-0ebe-4575-afc8-964686953825\") " pod="openstack-kuttl-tests/keystone-5769b4cdff-x2jfw" Mar 16 16:36:39 crc kubenswrapper[5120]: I0316 16:36:39.360199 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/864a1551-0ebe-4575-afc8-964686953825-public-tls-certs\") pod \"keystone-5769b4cdff-x2jfw\" (UID: \"864a1551-0ebe-4575-afc8-964686953825\") " pod="openstack-kuttl-tests/keystone-5769b4cdff-x2jfw" Mar 16 16:36:39 crc kubenswrapper[5120]: I0316 16:36:39.360962 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/864a1551-0ebe-4575-afc8-964686953825-internal-tls-certs\") pod \"keystone-5769b4cdff-x2jfw\" (UID: \"864a1551-0ebe-4575-afc8-964686953825\") " pod="openstack-kuttl-tests/keystone-5769b4cdff-x2jfw" Mar 16 16:36:39 crc kubenswrapper[5120]: I0316 16:36:39.361844 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/864a1551-0ebe-4575-afc8-964686953825-config-data\") pod \"keystone-5769b4cdff-x2jfw\" (UID: \"864a1551-0ebe-4575-afc8-964686953825\") " pod="openstack-kuttl-tests/keystone-5769b4cdff-x2jfw" Mar 16 16:36:39 crc kubenswrapper[5120]: I0316 16:36:39.365386 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/864a1551-0ebe-4575-afc8-964686953825-combined-ca-bundle\") pod \"keystone-5769b4cdff-x2jfw\" (UID: \"864a1551-0ebe-4575-afc8-964686953825\") " pod="openstack-kuttl-tests/keystone-5769b4cdff-x2jfw" Mar 16 16:36:39 crc kubenswrapper[5120]: I0316 16:36:39.368489 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7khf\" (UniqueName: \"kubernetes.io/projected/864a1551-0ebe-4575-afc8-964686953825-kube-api-access-s7khf\") pod \"keystone-5769b4cdff-x2jfw\" (UID: \"864a1551-0ebe-4575-afc8-964686953825\") " pod="openstack-kuttl-tests/keystone-5769b4cdff-x2jfw" Mar 16 16:36:39 crc kubenswrapper[5120]: I0316 16:36:39.530496 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-7d8dbd4879-pzj6v" Mar 16 16:36:39 crc kubenswrapper[5120]: I0316 16:36:39.532086 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-5769b4cdff-x2jfw" Mar 16 16:36:39 crc kubenswrapper[5120]: I0316 16:36:39.559533 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ebe474a7-759d-4e64-974d-fafd32020f70-combined-ca-bundle\") pod \"ebe474a7-759d-4e64-974d-fafd32020f70\" (UID: \"ebe474a7-759d-4e64-974d-fafd32020f70\") " Mar 16 16:36:39 crc kubenswrapper[5120]: I0316 16:36:39.559927 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ebe474a7-759d-4e64-974d-fafd32020f70-config-data\") pod \"ebe474a7-759d-4e64-974d-fafd32020f70\" (UID: \"ebe474a7-759d-4e64-974d-fafd32020f70\") " Mar 16 16:36:39 crc kubenswrapper[5120]: I0316 16:36:39.560290 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ebe474a7-759d-4e64-974d-fafd32020f70-logs\") pod \"ebe474a7-759d-4e64-974d-fafd32020f70\" (UID: \"ebe474a7-759d-4e64-974d-fafd32020f70\") " Mar 16 16:36:39 crc kubenswrapper[5120]: I0316 16:36:39.560580 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/ebe474a7-759d-4e64-974d-fafd32020f70-config-data-custom\") pod \"ebe474a7-759d-4e64-974d-fafd32020f70\" (UID: \"ebe474a7-759d-4e64-974d-fafd32020f70\") " Mar 16 16:36:39 crc kubenswrapper[5120]: I0316 16:36:39.560968 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g4qsv\" (UniqueName: \"kubernetes.io/projected/ebe474a7-759d-4e64-974d-fafd32020f70-kube-api-access-g4qsv\") pod \"ebe474a7-759d-4e64-974d-fafd32020f70\" (UID: \"ebe474a7-759d-4e64-974d-fafd32020f70\") " Mar 16 16:36:39 crc kubenswrapper[5120]: I0316 16:36:39.562482 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ebe474a7-759d-4e64-974d-fafd32020f70-logs" (OuterVolumeSpecName: "logs") pod "ebe474a7-759d-4e64-974d-fafd32020f70" (UID: "ebe474a7-759d-4e64-974d-fafd32020f70"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:36:39 crc kubenswrapper[5120]: I0316 16:36:39.568665 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ebe474a7-759d-4e64-974d-fafd32020f70-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "ebe474a7-759d-4e64-974d-fafd32020f70" (UID: "ebe474a7-759d-4e64-974d-fafd32020f70"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:36:39 crc kubenswrapper[5120]: I0316 16:36:39.569945 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ebe474a7-759d-4e64-974d-fafd32020f70-kube-api-access-g4qsv" (OuterVolumeSpecName: "kube-api-access-g4qsv") pod "ebe474a7-759d-4e64-974d-fafd32020f70" (UID: "ebe474a7-759d-4e64-974d-fafd32020f70"). InnerVolumeSpecName "kube-api-access-g4qsv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:36:39 crc kubenswrapper[5120]: I0316 16:36:39.625198 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ebe474a7-759d-4e64-974d-fafd32020f70-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ebe474a7-759d-4e64-974d-fafd32020f70" (UID: "ebe474a7-759d-4e64-974d-fafd32020f70"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:36:39 crc kubenswrapper[5120]: I0316 16:36:39.637774 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ebe474a7-759d-4e64-974d-fafd32020f70-config-data" (OuterVolumeSpecName: "config-data") pod "ebe474a7-759d-4e64-974d-fafd32020f70" (UID: "ebe474a7-759d-4e64-974d-fafd32020f70"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:36:39 crc kubenswrapper[5120]: I0316 16:36:39.666797 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g4qsv\" (UniqueName: \"kubernetes.io/projected/ebe474a7-759d-4e64-974d-fafd32020f70-kube-api-access-g4qsv\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:39 crc kubenswrapper[5120]: I0316 16:36:39.666836 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ebe474a7-759d-4e64-974d-fafd32020f70-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:39 crc kubenswrapper[5120]: I0316 16:36:39.666849 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ebe474a7-759d-4e64-974d-fafd32020f70-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:39 crc kubenswrapper[5120]: I0316 16:36:39.666860 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ebe474a7-759d-4e64-974d-fafd32020f70-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:39 crc kubenswrapper[5120]: I0316 16:36:39.666871 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/ebe474a7-759d-4e64-974d-fafd32020f70-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:39 crc kubenswrapper[5120]: I0316 16:36:39.869077 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:36:39 crc kubenswrapper[5120]: I0316 16:36:39.869126 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:36:39 crc kubenswrapper[5120]: I0316 16:36:39.922505 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:36:39 crc kubenswrapper[5120]: I0316 16:36:39.944898 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:36:39 crc kubenswrapper[5120]: I0316 16:36:39.981388 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:36:40 crc kubenswrapper[5120]: I0316 16:36:40.073064 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-5769b4cdff-x2jfw"] Mar 16 16:36:40 crc kubenswrapper[5120]: I0316 16:36:40.185503 5120 generic.go:358] "Generic (PLEG): container finished" podID="ebe474a7-759d-4e64-974d-fafd32020f70" containerID="dd9eb8403f4030118d3b36ba746e82ca91a3cfe3c961ee54d747966b9a45d5b7" exitCode=0 Mar 16 16:36:40 crc kubenswrapper[5120]: I0316 16:36:40.185651 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-7d8dbd4879-pzj6v" event={"ID":"ebe474a7-759d-4e64-974d-fafd32020f70","Type":"ContainerDied","Data":"dd9eb8403f4030118d3b36ba746e82ca91a3cfe3c961ee54d747966b9a45d5b7"} Mar 16 16:36:40 crc kubenswrapper[5120]: I0316 16:36:40.185684 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-7d8dbd4879-pzj6v" event={"ID":"ebe474a7-759d-4e64-974d-fafd32020f70","Type":"ContainerDied","Data":"c6c99f8df7bd78406d442c23284e42edcd2bf8d87d5fd1aa43583cba6ce57b64"} Mar 16 16:36:40 crc kubenswrapper[5120]: I0316 16:36:40.185706 5120 scope.go:117] "RemoveContainer" containerID="dd9eb8403f4030118d3b36ba746e82ca91a3cfe3c961ee54d747966b9a45d5b7" Mar 16 16:36:40 crc kubenswrapper[5120]: I0316 16:36:40.185905 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-7d8dbd4879-pzj6v" Mar 16 16:36:40 crc kubenswrapper[5120]: I0316 16:36:40.208554 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"708cda1d-7af6-486c-ad5d-50f82a3e5eee","Type":"ContainerStarted","Data":"8828080fd1ea9870a7a4e1769ff36c954304ce0ce6f33354df80a5348daf83dc"} Mar 16 16:36:40 crc kubenswrapper[5120]: I0316 16:36:40.209269 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"708cda1d-7af6-486c-ad5d-50f82a3e5eee","Type":"ContainerStarted","Data":"016abc3c0178bcf5cd37131e0a1d710e253777ef9ec37790a656ac71970c5e94"} Mar 16 16:36:40 crc kubenswrapper[5120]: I0316 16:36:40.209313 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"708cda1d-7af6-486c-ad5d-50f82a3e5eee","Type":"ContainerStarted","Data":"e25c13b10bd0ae2661a7188a008d15ac091c37b50ae4a9dc6125ce1625e4c04f"} Mar 16 16:36:40 crc kubenswrapper[5120]: I0316 16:36:40.209341 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"708cda1d-7af6-486c-ad5d-50f82a3e5eee","Type":"ContainerStarted","Data":"2ce41f56d74fc06d0f22d6fa384ec2df8b05b4e93227cb38c7c8c9dcb83b3b32"} Mar 16 16:36:40 crc kubenswrapper[5120]: I0316 16:36:40.220540 5120 scope.go:117] "RemoveContainer" containerID="eda27ff3b94a96a06a6622ff993e4e8c3cf41581cfe4ab3b447a062892589cb0" Mar 16 16:36:40 crc kubenswrapper[5120]: I0316 16:36:40.231386 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-5769b4cdff-x2jfw" event={"ID":"864a1551-0ebe-4575-afc8-964686953825","Type":"ContainerStarted","Data":"10d02a8881ba929136e9ae12f971b0330b653e60650d573da815d1893aeb146b"} Mar 16 16:36:40 crc kubenswrapper[5120]: I0316 16:36:40.231449 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:36:40 crc kubenswrapper[5120]: I0316 16:36:40.260470 5120 scope.go:117] "RemoveContainer" containerID="dd9eb8403f4030118d3b36ba746e82ca91a3cfe3c961ee54d747966b9a45d5b7" Mar 16 16:36:40 crc kubenswrapper[5120]: I0316 16:36:40.260579 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-7d8dbd4879-pzj6v"] Mar 16 16:36:40 crc kubenswrapper[5120]: I0316 16:36:40.260617 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:36:40 crc kubenswrapper[5120]: E0316 16:36:40.262073 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd9eb8403f4030118d3b36ba746e82ca91a3cfe3c961ee54d747966b9a45d5b7\": container with ID starting with dd9eb8403f4030118d3b36ba746e82ca91a3cfe3c961ee54d747966b9a45d5b7 not found: ID does not exist" containerID="dd9eb8403f4030118d3b36ba746e82ca91a3cfe3c961ee54d747966b9a45d5b7" Mar 16 16:36:40 crc kubenswrapper[5120]: I0316 16:36:40.262115 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd9eb8403f4030118d3b36ba746e82ca91a3cfe3c961ee54d747966b9a45d5b7"} err="failed to get container status \"dd9eb8403f4030118d3b36ba746e82ca91a3cfe3c961ee54d747966b9a45d5b7\": rpc error: code = NotFound desc = could not find container \"dd9eb8403f4030118d3b36ba746e82ca91a3cfe3c961ee54d747966b9a45d5b7\": container with ID starting with dd9eb8403f4030118d3b36ba746e82ca91a3cfe3c961ee54d747966b9a45d5b7 not found: ID does not exist" Mar 16 16:36:40 crc kubenswrapper[5120]: I0316 16:36:40.262133 5120 scope.go:117] "RemoveContainer" containerID="eda27ff3b94a96a06a6622ff993e4e8c3cf41581cfe4ab3b447a062892589cb0" Mar 16 16:36:40 crc kubenswrapper[5120]: E0316 16:36:40.266086 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eda27ff3b94a96a06a6622ff993e4e8c3cf41581cfe4ab3b447a062892589cb0\": container with ID starting with eda27ff3b94a96a06a6622ff993e4e8c3cf41581cfe4ab3b447a062892589cb0 not found: ID does not exist" containerID="eda27ff3b94a96a06a6622ff993e4e8c3cf41581cfe4ab3b447a062892589cb0" Mar 16 16:36:40 crc kubenswrapper[5120]: I0316 16:36:40.266121 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eda27ff3b94a96a06a6622ff993e4e8c3cf41581cfe4ab3b447a062892589cb0"} err="failed to get container status \"eda27ff3b94a96a06a6622ff993e4e8c3cf41581cfe4ab3b447a062892589cb0\": rpc error: code = NotFound desc = could not find container \"eda27ff3b94a96a06a6622ff993e4e8c3cf41581cfe4ab3b447a062892589cb0\": container with ID starting with eda27ff3b94a96a06a6622ff993e4e8c3cf41581cfe4ab3b447a062892589cb0 not found: ID does not exist" Mar 16 16:36:40 crc kubenswrapper[5120]: I0316 16:36:40.272062 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-7d8dbd4879-pzj6v"] Mar 16 16:36:40 crc kubenswrapper[5120]: I0316 16:36:40.293208 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/swift-storage-0" podStartSLOduration=5.293184578 podStartE2EDuration="5.293184578s" podCreationTimestamp="2026-03-16 16:36:35 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:36:40.279001177 +0000 UTC m=+3902.432932854" watchObservedRunningTime="2026-03-16 16:36:40.293184578 +0000 UTC m=+3902.447116245" Mar 16 16:36:40 crc kubenswrapper[5120]: I0316 16:36:40.425246 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-fbf48b597-rkrhz"] Mar 16 16:36:40 crc kubenswrapper[5120]: I0316 16:36:40.426693 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ebe474a7-759d-4e64-974d-fafd32020f70" containerName="barbican-keystone-listener-log" Mar 16 16:36:40 crc kubenswrapper[5120]: I0316 16:36:40.426713 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ebe474a7-759d-4e64-974d-fafd32020f70" containerName="barbican-keystone-listener-log" Mar 16 16:36:40 crc kubenswrapper[5120]: I0316 16:36:40.426735 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ebe474a7-759d-4e64-974d-fafd32020f70" containerName="barbican-keystone-listener" Mar 16 16:36:40 crc kubenswrapper[5120]: I0316 16:36:40.426741 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ebe474a7-759d-4e64-974d-fafd32020f70" containerName="barbican-keystone-listener" Mar 16 16:36:40 crc kubenswrapper[5120]: I0316 16:36:40.426985 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ebe474a7-759d-4e64-974d-fafd32020f70" containerName="barbican-keystone-listener-log" Mar 16 16:36:40 crc kubenswrapper[5120]: I0316 16:36:40.427006 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ebe474a7-759d-4e64-974d-fafd32020f70" containerName="barbican-keystone-listener" Mar 16 16:36:40 crc kubenswrapper[5120]: I0316 16:36:40.433654 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-fbf48b597-rkrhz" Mar 16 16:36:40 crc kubenswrapper[5120]: I0316 16:36:40.452205 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-fbf48b597-rkrhz"] Mar 16 16:36:40 crc kubenswrapper[5120]: I0316 16:36:40.495069 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/8fc31cb4-4401-4dd5-bcca-713df899353d-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-fbf48b597-rkrhz\" (UID: \"8fc31cb4-4401-4dd5-bcca-713df899353d\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-fbf48b597-rkrhz" Mar 16 16:36:40 crc kubenswrapper[5120]: I0316 16:36:40.495180 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8fc31cb4-4401-4dd5-bcca-713df899353d-config\") pod \"dnsmasq-dnsmasq-fbf48b597-rkrhz\" (UID: \"8fc31cb4-4401-4dd5-bcca-713df899353d\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-fbf48b597-rkrhz" Mar 16 16:36:40 crc kubenswrapper[5120]: I0316 16:36:40.495359 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/8fc31cb4-4401-4dd5-bcca-713df899353d-dns-swift-storage-0\") pod \"dnsmasq-dnsmasq-fbf48b597-rkrhz\" (UID: \"8fc31cb4-4401-4dd5-bcca-713df899353d\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-fbf48b597-rkrhz" Mar 16 16:36:40 crc kubenswrapper[5120]: I0316 16:36:40.495379 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76mz2\" (UniqueName: \"kubernetes.io/projected/8fc31cb4-4401-4dd5-bcca-713df899353d-kube-api-access-76mz2\") pod \"dnsmasq-dnsmasq-fbf48b597-rkrhz\" (UID: \"8fc31cb4-4401-4dd5-bcca-713df899353d\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-fbf48b597-rkrhz" Mar 16 16:36:40 crc kubenswrapper[5120]: I0316 16:36:40.596875 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/8fc31cb4-4401-4dd5-bcca-713df899353d-dns-swift-storage-0\") pod \"dnsmasq-dnsmasq-fbf48b597-rkrhz\" (UID: \"8fc31cb4-4401-4dd5-bcca-713df899353d\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-fbf48b597-rkrhz" Mar 16 16:36:40 crc kubenswrapper[5120]: I0316 16:36:40.596923 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-76mz2\" (UniqueName: \"kubernetes.io/projected/8fc31cb4-4401-4dd5-bcca-713df899353d-kube-api-access-76mz2\") pod \"dnsmasq-dnsmasq-fbf48b597-rkrhz\" (UID: \"8fc31cb4-4401-4dd5-bcca-713df899353d\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-fbf48b597-rkrhz" Mar 16 16:36:40 crc kubenswrapper[5120]: I0316 16:36:40.597026 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/8fc31cb4-4401-4dd5-bcca-713df899353d-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-fbf48b597-rkrhz\" (UID: \"8fc31cb4-4401-4dd5-bcca-713df899353d\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-fbf48b597-rkrhz" Mar 16 16:36:40 crc kubenswrapper[5120]: I0316 16:36:40.597114 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8fc31cb4-4401-4dd5-bcca-713df899353d-config\") pod \"dnsmasq-dnsmasq-fbf48b597-rkrhz\" (UID: \"8fc31cb4-4401-4dd5-bcca-713df899353d\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-fbf48b597-rkrhz" Mar 16 16:36:40 crc kubenswrapper[5120]: I0316 16:36:40.597834 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/8fc31cb4-4401-4dd5-bcca-713df899353d-dns-swift-storage-0\") pod \"dnsmasq-dnsmasq-fbf48b597-rkrhz\" (UID: \"8fc31cb4-4401-4dd5-bcca-713df899353d\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-fbf48b597-rkrhz" Mar 16 16:36:40 crc kubenswrapper[5120]: I0316 16:36:40.600605 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/8fc31cb4-4401-4dd5-bcca-713df899353d-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-fbf48b597-rkrhz\" (UID: \"8fc31cb4-4401-4dd5-bcca-713df899353d\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-fbf48b597-rkrhz" Mar 16 16:36:40 crc kubenswrapper[5120]: I0316 16:36:40.601061 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8fc31cb4-4401-4dd5-bcca-713df899353d-config\") pod \"dnsmasq-dnsmasq-fbf48b597-rkrhz\" (UID: \"8fc31cb4-4401-4dd5-bcca-713df899353d\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-fbf48b597-rkrhz" Mar 16 16:36:40 crc kubenswrapper[5120]: I0316 16:36:40.622041 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-76mz2\" (UniqueName: \"kubernetes.io/projected/8fc31cb4-4401-4dd5-bcca-713df899353d-kube-api-access-76mz2\") pod \"dnsmasq-dnsmasq-fbf48b597-rkrhz\" (UID: \"8fc31cb4-4401-4dd5-bcca-713df899353d\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-fbf48b597-rkrhz" Mar 16 16:36:40 crc kubenswrapper[5120]: I0316 16:36:40.677560 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ebe474a7-759d-4e64-974d-fafd32020f70" path="/var/lib/kubelet/pods/ebe474a7-759d-4e64-974d-fafd32020f70/volumes" Mar 16 16:36:40 crc kubenswrapper[5120]: I0316 16:36:40.769102 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-fbf48b597-rkrhz" Mar 16 16:36:40 crc kubenswrapper[5120]: I0316 16:36:40.805508 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:36:40 crc kubenswrapper[5120]: I0316 16:36:40.805910 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:36:40 crc kubenswrapper[5120]: I0316 16:36:40.872261 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:36:40 crc kubenswrapper[5120]: I0316 16:36:40.889022 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:36:41 crc kubenswrapper[5120]: I0316 16:36:41.022987 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:36:41 crc kubenswrapper[5120]: E0316 16:36:41.129304 5120 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfec060e6_11fd_4d16_8640_fd02366a7601.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfec060e6_11fd_4d16_8640_fd02366a7601.slice/crio-cf47aaebf63137acc7a77d17eb41eeb5f06bc1f346811dfa1f366d667ed8d6a4\": RecentStats: unable to find data in memory cache]" Mar 16 16:36:41 crc kubenswrapper[5120]: I0316 16:36:41.256031 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-5769b4cdff-x2jfw" event={"ID":"864a1551-0ebe-4575-afc8-964686953825","Type":"ContainerStarted","Data":"ec7b51b54a8b71d545b522da56c31ac094ce43134f2779b01ffbc26bcfb07d05"} Mar 16 16:36:41 crc kubenswrapper[5120]: I0316 16:36:41.257341 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:36:41 crc kubenswrapper[5120]: I0316 16:36:41.257364 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/keystone-5769b4cdff-x2jfw" Mar 16 16:36:41 crc kubenswrapper[5120]: I0316 16:36:41.258307 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-fbf48b597-rkrhz"] Mar 16 16:36:41 crc kubenswrapper[5120]: I0316 16:36:41.258686 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:36:41 crc kubenswrapper[5120]: W0316 16:36:41.263635 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8fc31cb4_4401_4dd5_bcca_713df899353d.slice/crio-93438ad49eb43027f5e520f8b2bdd46981a9e771078fbceefeccfcc7d5b21724 WatchSource:0}: Error finding container 93438ad49eb43027f5e520f8b2bdd46981a9e771078fbceefeccfcc7d5b21724: Status 404 returned error can't find the container with id 93438ad49eb43027f5e520f8b2bdd46981a9e771078fbceefeccfcc7d5b21724 Mar 16 16:36:41 crc kubenswrapper[5120]: I0316 16:36:41.281405 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-5769b4cdff-x2jfw" podStartSLOduration=2.2813878340000002 podStartE2EDuration="2.281387834s" podCreationTimestamp="2026-03-16 16:36:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:36:41.271244419 +0000 UTC m=+3903.425176076" watchObservedRunningTime="2026-03-16 16:36:41.281387834 +0000 UTC m=+3903.435319491" Mar 16 16:36:41 crc kubenswrapper[5120]: I0316 16:36:41.414049 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:36:42 crc kubenswrapper[5120]: I0316 16:36:42.267083 5120 generic.go:358] "Generic (PLEG): container finished" podID="8fc31cb4-4401-4dd5-bcca-713df899353d" containerID="1c2947f4f46af5517245e9630072a3af08b1d698c016863b21b9b8f6d6b52012" exitCode=0 Mar 16 16:36:42 crc kubenswrapper[5120]: I0316 16:36:42.267590 5120 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Mar 16 16:36:42 crc kubenswrapper[5120]: I0316 16:36:42.267602 5120 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Mar 16 16:36:42 crc kubenswrapper[5120]: I0316 16:36:42.267216 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-fbf48b597-rkrhz" event={"ID":"8fc31cb4-4401-4dd5-bcca-713df899353d","Type":"ContainerDied","Data":"1c2947f4f46af5517245e9630072a3af08b1d698c016863b21b9b8f6d6b52012"} Mar 16 16:36:42 crc kubenswrapper[5120]: I0316 16:36:42.268576 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-fbf48b597-rkrhz" event={"ID":"8fc31cb4-4401-4dd5-bcca-713df899353d","Type":"ContainerStarted","Data":"93438ad49eb43027f5e520f8b2bdd46981a9e771078fbceefeccfcc7d5b21724"} Mar 16 16:36:42 crc kubenswrapper[5120]: I0316 16:36:42.576282 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:36:42 crc kubenswrapper[5120]: I0316 16:36:42.752898 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:36:43 crc kubenswrapper[5120]: I0316 16:36:43.328245 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-fbf48b597-rkrhz" event={"ID":"8fc31cb4-4401-4dd5-bcca-713df899353d","Type":"ContainerStarted","Data":"03ef71cd198931418c655764c94e7e7306e3853bfaf8e641701f379a41513ca3"} Mar 16 16:36:43 crc kubenswrapper[5120]: I0316 16:36:43.329723 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-fbf48b597-rkrhz" Mar 16 16:36:43 crc kubenswrapper[5120]: I0316 16:36:43.332024 5120 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Mar 16 16:36:43 crc kubenswrapper[5120]: I0316 16:36:43.332052 5120 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Mar 16 16:36:43 crc kubenswrapper[5120]: I0316 16:36:43.359609 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-fbf48b597-rkrhz" podStartSLOduration=3.359581979 podStartE2EDuration="3.359581979s" podCreationTimestamp="2026-03-16 16:36:40 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:36:43.349967787 +0000 UTC m=+3905.503899464" watchObservedRunningTime="2026-03-16 16:36:43.359581979 +0000 UTC m=+3905.513513636" Mar 16 16:36:43 crc kubenswrapper[5120]: I0316 16:36:43.699081 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:36:43 crc kubenswrapper[5120]: I0316 16:36:43.737653 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:36:43 crc kubenswrapper[5120]: I0316 16:36:43.826354 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:36:43 crc kubenswrapper[5120]: I0316 16:36:43.905682 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-797c9dbf4-zdnm7" Mar 16 16:36:44 crc kubenswrapper[5120]: I0316 16:36:44.139687 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-797c9dbf4-zdnm7" Mar 16 16:36:44 crc kubenswrapper[5120]: I0316 16:36:44.208854 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-7d985d96b7-jk8xr"] Mar 16 16:36:44 crc kubenswrapper[5120]: I0316 16:36:44.209294 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-7d985d96b7-jk8xr" podUID="a2be00a2-fcd5-4862-aadf-b2947d6d138b" containerName="barbican-api-log" containerID="cri-o://11f572bb3df0bc5e7708e98ac5a8d05753561c760e4a29bd7ced507de9fdbda2" gracePeriod=30 Mar 16 16:36:44 crc kubenswrapper[5120]: I0316 16:36:44.209359 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-7d985d96b7-jk8xr" podUID="a2be00a2-fcd5-4862-aadf-b2947d6d138b" containerName="barbican-api" containerID="cri-o://b2c6ac53e732bb240cf7102085bff535675ef1590ebcbfa604a497b748bdacb6" gracePeriod=30 Mar 16 16:36:44 crc kubenswrapper[5120]: I0316 16:36:44.365065 5120 generic.go:358] "Generic (PLEG): container finished" podID="a2be00a2-fcd5-4862-aadf-b2947d6d138b" containerID="11f572bb3df0bc5e7708e98ac5a8d05753561c760e4a29bd7ced507de9fdbda2" exitCode=143 Mar 16 16:36:44 crc kubenswrapper[5120]: I0316 16:36:44.366900 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-7d985d96b7-jk8xr" event={"ID":"a2be00a2-fcd5-4862-aadf-b2947d6d138b","Type":"ContainerDied","Data":"11f572bb3df0bc5e7708e98ac5a8d05753561c760e4a29bd7ced507de9fdbda2"} Mar 16 16:36:45 crc kubenswrapper[5120]: I0316 16:36:45.264949 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-v822j_ac55471d-4e42-475f-a082-50f611571482/kube-multus/0.log" Mar 16 16:36:45 crc kubenswrapper[5120]: I0316 16:36:45.264967 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-v822j_ac55471d-4e42-475f-a082-50f611571482/kube-multus/0.log" Mar 16 16:36:45 crc kubenswrapper[5120]: I0316 16:36:45.273976 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-crc_9f0bc7fcb0822a2c13eb2d22cd8c0641/kube-controller-manager/0.log" Mar 16 16:36:45 crc kubenswrapper[5120]: I0316 16:36:45.274218 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-crc_9f0bc7fcb0822a2c13eb2d22cd8c0641/kube-controller-manager/0.log" Mar 16 16:36:46 crc kubenswrapper[5120]: I0316 16:36:46.414602 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:36:46 crc kubenswrapper[5120]: I0316 16:36:46.435613 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:36:47 crc kubenswrapper[5120]: I0316 16:36:47.409619 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-7d985d96b7-jk8xr" podUID="a2be00a2-fcd5-4862-aadf-b2947d6d138b" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.0.160:9311/healthcheck\": read tcp 10.217.0.2:34454->10.217.0.160:9311: read: connection reset by peer" Mar 16 16:36:47 crc kubenswrapper[5120]: I0316 16:36:47.419860 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:36:47 crc kubenswrapper[5120]: I0316 16:36:47.836780 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-7d985d96b7-jk8xr" Mar 16 16:36:47 crc kubenswrapper[5120]: I0316 16:36:47.842768 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a2be00a2-fcd5-4862-aadf-b2947d6d138b-combined-ca-bundle\") pod \"a2be00a2-fcd5-4862-aadf-b2947d6d138b\" (UID: \"a2be00a2-fcd5-4862-aadf-b2947d6d138b\") " Mar 16 16:36:47 crc kubenswrapper[5120]: I0316 16:36:47.842823 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/a2be00a2-fcd5-4862-aadf-b2947d6d138b-config-data-custom\") pod \"a2be00a2-fcd5-4862-aadf-b2947d6d138b\" (UID: \"a2be00a2-fcd5-4862-aadf-b2947d6d138b\") " Mar 16 16:36:47 crc kubenswrapper[5120]: I0316 16:36:47.843186 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/a2be00a2-fcd5-4862-aadf-b2947d6d138b-public-tls-certs\") pod \"a2be00a2-fcd5-4862-aadf-b2947d6d138b\" (UID: \"a2be00a2-fcd5-4862-aadf-b2947d6d138b\") " Mar 16 16:36:47 crc kubenswrapper[5120]: I0316 16:36:47.843289 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a2be00a2-fcd5-4862-aadf-b2947d6d138b-logs\") pod \"a2be00a2-fcd5-4862-aadf-b2947d6d138b\" (UID: \"a2be00a2-fcd5-4862-aadf-b2947d6d138b\") " Mar 16 16:36:47 crc kubenswrapper[5120]: I0316 16:36:47.843402 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/a2be00a2-fcd5-4862-aadf-b2947d6d138b-internal-tls-certs\") pod \"a2be00a2-fcd5-4862-aadf-b2947d6d138b\" (UID: \"a2be00a2-fcd5-4862-aadf-b2947d6d138b\") " Mar 16 16:36:47 crc kubenswrapper[5120]: I0316 16:36:47.843522 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a2be00a2-fcd5-4862-aadf-b2947d6d138b-config-data\") pod \"a2be00a2-fcd5-4862-aadf-b2947d6d138b\" (UID: \"a2be00a2-fcd5-4862-aadf-b2947d6d138b\") " Mar 16 16:36:47 crc kubenswrapper[5120]: I0316 16:36:47.843641 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v2g64\" (UniqueName: \"kubernetes.io/projected/a2be00a2-fcd5-4862-aadf-b2947d6d138b-kube-api-access-v2g64\") pod \"a2be00a2-fcd5-4862-aadf-b2947d6d138b\" (UID: \"a2be00a2-fcd5-4862-aadf-b2947d6d138b\") " Mar 16 16:36:47 crc kubenswrapper[5120]: I0316 16:36:47.844075 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2be00a2-fcd5-4862-aadf-b2947d6d138b-logs" (OuterVolumeSpecName: "logs") pod "a2be00a2-fcd5-4862-aadf-b2947d6d138b" (UID: "a2be00a2-fcd5-4862-aadf-b2947d6d138b"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:36:47 crc kubenswrapper[5120]: I0316 16:36:47.844709 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a2be00a2-fcd5-4862-aadf-b2947d6d138b-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:47 crc kubenswrapper[5120]: I0316 16:36:47.848946 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a2be00a2-fcd5-4862-aadf-b2947d6d138b-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "a2be00a2-fcd5-4862-aadf-b2947d6d138b" (UID: "a2be00a2-fcd5-4862-aadf-b2947d6d138b"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:36:47 crc kubenswrapper[5120]: I0316 16:36:47.852083 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a2be00a2-fcd5-4862-aadf-b2947d6d138b-kube-api-access-v2g64" (OuterVolumeSpecName: "kube-api-access-v2g64") pod "a2be00a2-fcd5-4862-aadf-b2947d6d138b" (UID: "a2be00a2-fcd5-4862-aadf-b2947d6d138b"). InnerVolumeSpecName "kube-api-access-v2g64". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:36:47 crc kubenswrapper[5120]: I0316 16:36:47.894026 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a2be00a2-fcd5-4862-aadf-b2947d6d138b-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "a2be00a2-fcd5-4862-aadf-b2947d6d138b" (UID: "a2be00a2-fcd5-4862-aadf-b2947d6d138b"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:36:47 crc kubenswrapper[5120]: I0316 16:36:47.928161 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a2be00a2-fcd5-4862-aadf-b2947d6d138b-config-data" (OuterVolumeSpecName: "config-data") pod "a2be00a2-fcd5-4862-aadf-b2947d6d138b" (UID: "a2be00a2-fcd5-4862-aadf-b2947d6d138b"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:36:47 crc kubenswrapper[5120]: I0316 16:36:47.933962 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a2be00a2-fcd5-4862-aadf-b2947d6d138b-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "a2be00a2-fcd5-4862-aadf-b2947d6d138b" (UID: "a2be00a2-fcd5-4862-aadf-b2947d6d138b"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:36:47 crc kubenswrapper[5120]: I0316 16:36:47.939887 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a2be00a2-fcd5-4862-aadf-b2947d6d138b-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "a2be00a2-fcd5-4862-aadf-b2947d6d138b" (UID: "a2be00a2-fcd5-4862-aadf-b2947d6d138b"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:36:47 crc kubenswrapper[5120]: I0316 16:36:47.946415 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a2be00a2-fcd5-4862-aadf-b2947d6d138b-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:47 crc kubenswrapper[5120]: I0316 16:36:47.946440 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/a2be00a2-fcd5-4862-aadf-b2947d6d138b-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:47 crc kubenswrapper[5120]: I0316 16:36:47.946450 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/a2be00a2-fcd5-4862-aadf-b2947d6d138b-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:47 crc kubenswrapper[5120]: I0316 16:36:47.946461 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/a2be00a2-fcd5-4862-aadf-b2947d6d138b-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:47 crc kubenswrapper[5120]: I0316 16:36:47.946473 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a2be00a2-fcd5-4862-aadf-b2947d6d138b-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:47 crc kubenswrapper[5120]: I0316 16:36:47.946483 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v2g64\" (UniqueName: \"kubernetes.io/projected/a2be00a2-fcd5-4862-aadf-b2947d6d138b-kube-api-access-v2g64\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:48 crc kubenswrapper[5120]: I0316 16:36:48.407584 5120 generic.go:358] "Generic (PLEG): container finished" podID="a2be00a2-fcd5-4862-aadf-b2947d6d138b" containerID="b2c6ac53e732bb240cf7102085bff535675ef1590ebcbfa604a497b748bdacb6" exitCode=0 Mar 16 16:36:48 crc kubenswrapper[5120]: I0316 16:36:48.408661 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-7d985d96b7-jk8xr" Mar 16 16:36:48 crc kubenswrapper[5120]: I0316 16:36:48.408885 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-7d985d96b7-jk8xr" event={"ID":"a2be00a2-fcd5-4862-aadf-b2947d6d138b","Type":"ContainerDied","Data":"b2c6ac53e732bb240cf7102085bff535675ef1590ebcbfa604a497b748bdacb6"} Mar 16 16:36:48 crc kubenswrapper[5120]: I0316 16:36:48.408936 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-7d985d96b7-jk8xr" event={"ID":"a2be00a2-fcd5-4862-aadf-b2947d6d138b","Type":"ContainerDied","Data":"4bef52102966475fede0a43a9c81dab880961b4acd612f6d18e3d43adfcb9939"} Mar 16 16:36:48 crc kubenswrapper[5120]: I0316 16:36:48.408956 5120 scope.go:117] "RemoveContainer" containerID="b2c6ac53e732bb240cf7102085bff535675ef1590ebcbfa604a497b748bdacb6" Mar 16 16:36:48 crc kubenswrapper[5120]: I0316 16:36:48.435555 5120 scope.go:117] "RemoveContainer" containerID="11f572bb3df0bc5e7708e98ac5a8d05753561c760e4a29bd7ced507de9fdbda2" Mar 16 16:36:48 crc kubenswrapper[5120]: I0316 16:36:48.487093 5120 scope.go:117] "RemoveContainer" containerID="b2c6ac53e732bb240cf7102085bff535675ef1590ebcbfa604a497b748bdacb6" Mar 16 16:36:48 crc kubenswrapper[5120]: E0316 16:36:48.487598 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b2c6ac53e732bb240cf7102085bff535675ef1590ebcbfa604a497b748bdacb6\": container with ID starting with b2c6ac53e732bb240cf7102085bff535675ef1590ebcbfa604a497b748bdacb6 not found: ID does not exist" containerID="b2c6ac53e732bb240cf7102085bff535675ef1590ebcbfa604a497b748bdacb6" Mar 16 16:36:48 crc kubenswrapper[5120]: I0316 16:36:48.487652 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2c6ac53e732bb240cf7102085bff535675ef1590ebcbfa604a497b748bdacb6"} err="failed to get container status \"b2c6ac53e732bb240cf7102085bff535675ef1590ebcbfa604a497b748bdacb6\": rpc error: code = NotFound desc = could not find container \"b2c6ac53e732bb240cf7102085bff535675ef1590ebcbfa604a497b748bdacb6\": container with ID starting with b2c6ac53e732bb240cf7102085bff535675ef1590ebcbfa604a497b748bdacb6 not found: ID does not exist" Mar 16 16:36:48 crc kubenswrapper[5120]: I0316 16:36:48.487683 5120 scope.go:117] "RemoveContainer" containerID="11f572bb3df0bc5e7708e98ac5a8d05753561c760e4a29bd7ced507de9fdbda2" Mar 16 16:36:48 crc kubenswrapper[5120]: E0316 16:36:48.488188 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"11f572bb3df0bc5e7708e98ac5a8d05753561c760e4a29bd7ced507de9fdbda2\": container with ID starting with 11f572bb3df0bc5e7708e98ac5a8d05753561c760e4a29bd7ced507de9fdbda2 not found: ID does not exist" containerID="11f572bb3df0bc5e7708e98ac5a8d05753561c760e4a29bd7ced507de9fdbda2" Mar 16 16:36:48 crc kubenswrapper[5120]: I0316 16:36:48.488238 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11f572bb3df0bc5e7708e98ac5a8d05753561c760e4a29bd7ced507de9fdbda2"} err="failed to get container status \"11f572bb3df0bc5e7708e98ac5a8d05753561c760e4a29bd7ced507de9fdbda2\": rpc error: code = NotFound desc = could not find container \"11f572bb3df0bc5e7708e98ac5a8d05753561c760e4a29bd7ced507de9fdbda2\": container with ID starting with 11f572bb3df0bc5e7708e98ac5a8d05753561c760e4a29bd7ced507de9fdbda2 not found: ID does not exist" Mar 16 16:36:48 crc kubenswrapper[5120]: I0316 16:36:48.492075 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-7d985d96b7-jk8xr"] Mar 16 16:36:48 crc kubenswrapper[5120]: I0316 16:36:48.500307 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-api-7d985d96b7-jk8xr"] Mar 16 16:36:48 crc kubenswrapper[5120]: I0316 16:36:48.674706 5120 scope.go:117] "RemoveContainer" containerID="0a15d5caff30dc8885f782e59962af7d98d58b39ab76059e56e5827e10e7ab8b" Mar 16 16:36:48 crc kubenswrapper[5120]: I0316 16:36:48.675001 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a2be00a2-fcd5-4862-aadf-b2947d6d138b" path="/var/lib/kubelet/pods/a2be00a2-fcd5-4862-aadf-b2947d6d138b/volumes" Mar 16 16:36:48 crc kubenswrapper[5120]: E0316 16:36:48.675487 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:36:49 crc kubenswrapper[5120]: I0316 16:36:49.369545 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-fbf48b597-rkrhz" Mar 16 16:36:49 crc kubenswrapper[5120]: I0316 16:36:49.434878 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-bf486487c-4dtfb"] Mar 16 16:36:49 crc kubenswrapper[5120]: I0316 16:36:49.435160 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-bf486487c-4dtfb" podUID="4d2aa91c-6d54-4ca1-97c9-528d23d4335b" containerName="dnsmasq-dns" containerID="cri-o://477c0c902f0b62f18a9c7f78d09355012a71b86484ecfa9f255581d96dc56221" gracePeriod=10 Mar 16 16:36:49 crc kubenswrapper[5120]: I0316 16:36:49.447603 5120 generic.go:358] "Generic (PLEG): container finished" podID="a03095a2-0907-4be8-ac85-43befd648111" containerID="92fec9271b324df350d5b12d702dd5be44b1de1d7ed388b9fcff65b549278624" exitCode=0 Mar 16 16:36:49 crc kubenswrapper[5120]: I0316 16:36:49.447659 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"a03095a2-0907-4be8-ac85-43befd648111","Type":"ContainerDied","Data":"92fec9271b324df350d5b12d702dd5be44b1de1d7ed388b9fcff65b549278624"} Mar 16 16:36:49 crc kubenswrapper[5120]: I0316 16:36:49.960484 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-bf486487c-4dtfb" Mar 16 16:36:49 crc kubenswrapper[5120]: I0316 16:36:49.996951 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/4d2aa91c-6d54-4ca1-97c9-528d23d4335b-dnsmasq-svc\") pod \"4d2aa91c-6d54-4ca1-97c9-528d23d4335b\" (UID: \"4d2aa91c-6d54-4ca1-97c9-528d23d4335b\") " Mar 16 16:36:49 crc kubenswrapper[5120]: I0316 16:36:49.997200 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4d2aa91c-6d54-4ca1-97c9-528d23d4335b-config\") pod \"4d2aa91c-6d54-4ca1-97c9-528d23d4335b\" (UID: \"4d2aa91c-6d54-4ca1-97c9-528d23d4335b\") " Mar 16 16:36:49 crc kubenswrapper[5120]: I0316 16:36:49.997394 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/4d2aa91c-6d54-4ca1-97c9-528d23d4335b-dns-swift-storage-0\") pod \"4d2aa91c-6d54-4ca1-97c9-528d23d4335b\" (UID: \"4d2aa91c-6d54-4ca1-97c9-528d23d4335b\") " Mar 16 16:36:49 crc kubenswrapper[5120]: I0316 16:36:49.997793 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hg6jk\" (UniqueName: \"kubernetes.io/projected/4d2aa91c-6d54-4ca1-97c9-528d23d4335b-kube-api-access-hg6jk\") pod \"4d2aa91c-6d54-4ca1-97c9-528d23d4335b\" (UID: \"4d2aa91c-6d54-4ca1-97c9-528d23d4335b\") " Mar 16 16:36:50 crc kubenswrapper[5120]: I0316 16:36:50.020244 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d2aa91c-6d54-4ca1-97c9-528d23d4335b-kube-api-access-hg6jk" (OuterVolumeSpecName: "kube-api-access-hg6jk") pod "4d2aa91c-6d54-4ca1-97c9-528d23d4335b" (UID: "4d2aa91c-6d54-4ca1-97c9-528d23d4335b"). InnerVolumeSpecName "kube-api-access-hg6jk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:36:50 crc kubenswrapper[5120]: I0316 16:36:50.056622 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4d2aa91c-6d54-4ca1-97c9-528d23d4335b-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "4d2aa91c-6d54-4ca1-97c9-528d23d4335b" (UID: "4d2aa91c-6d54-4ca1-97c9-528d23d4335b"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:36:50 crc kubenswrapper[5120]: I0316 16:36:50.095436 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4d2aa91c-6d54-4ca1-97c9-528d23d4335b-config" (OuterVolumeSpecName: "config") pod "4d2aa91c-6d54-4ca1-97c9-528d23d4335b" (UID: "4d2aa91c-6d54-4ca1-97c9-528d23d4335b"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:36:50 crc kubenswrapper[5120]: I0316 16:36:50.099395 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4d2aa91c-6d54-4ca1-97c9-528d23d4335b-dns-swift-storage-0" (OuterVolumeSpecName: "dns-swift-storage-0") pod "4d2aa91c-6d54-4ca1-97c9-528d23d4335b" (UID: "4d2aa91c-6d54-4ca1-97c9-528d23d4335b"). InnerVolumeSpecName "dns-swift-storage-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:36:50 crc kubenswrapper[5120]: I0316 16:36:50.101105 5120 reconciler_common.go:299] "Volume detached for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/4d2aa91c-6d54-4ca1-97c9-528d23d4335b-dns-swift-storage-0\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:50 crc kubenswrapper[5120]: I0316 16:36:50.101146 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hg6jk\" (UniqueName: \"kubernetes.io/projected/4d2aa91c-6d54-4ca1-97c9-528d23d4335b-kube-api-access-hg6jk\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:50 crc kubenswrapper[5120]: I0316 16:36:50.101161 5120 reconciler_common.go:299] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/4d2aa91c-6d54-4ca1-97c9-528d23d4335b-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:50 crc kubenswrapper[5120]: I0316 16:36:50.101173 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4d2aa91c-6d54-4ca1-97c9-528d23d4335b-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:50 crc kubenswrapper[5120]: I0316 16:36:50.462114 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"a03095a2-0907-4be8-ac85-43befd648111","Type":"ContainerStarted","Data":"93f1e66b2d8a92540af9824e7c1323009a16554867a73716bc2e06eeaaea6d4a"} Mar 16 16:36:50 crc kubenswrapper[5120]: I0316 16:36:50.462363 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:36:50 crc kubenswrapper[5120]: I0316 16:36:50.464423 5120 generic.go:358] "Generic (PLEG): container finished" podID="4d2aa91c-6d54-4ca1-97c9-528d23d4335b" containerID="477c0c902f0b62f18a9c7f78d09355012a71b86484ecfa9f255581d96dc56221" exitCode=0 Mar 16 16:36:50 crc kubenswrapper[5120]: I0316 16:36:50.464456 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-bf486487c-4dtfb" Mar 16 16:36:50 crc kubenswrapper[5120]: I0316 16:36:50.464511 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-bf486487c-4dtfb" event={"ID":"4d2aa91c-6d54-4ca1-97c9-528d23d4335b","Type":"ContainerDied","Data":"477c0c902f0b62f18a9c7f78d09355012a71b86484ecfa9f255581d96dc56221"} Mar 16 16:36:50 crc kubenswrapper[5120]: I0316 16:36:50.464557 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-bf486487c-4dtfb" event={"ID":"4d2aa91c-6d54-4ca1-97c9-528d23d4335b","Type":"ContainerDied","Data":"1168be5402a4f1f4bf8654bb080a037de51c9981d5a2c22d98434ec6511af4e2"} Mar 16 16:36:50 crc kubenswrapper[5120]: I0316 16:36:50.464579 5120 scope.go:117] "RemoveContainer" containerID="477c0c902f0b62f18a9c7f78d09355012a71b86484ecfa9f255581d96dc56221" Mar 16 16:36:50 crc kubenswrapper[5120]: I0316 16:36:50.467039 5120 generic.go:358] "Generic (PLEG): container finished" podID="05e90410-2cfb-438d-95df-8b2a70319257" containerID="c81e95f5038d7d226294b881d501dd9e830cf87edf6aba2428d1ad4470cca082" exitCode=0 Mar 16 16:36:50 crc kubenswrapper[5120]: I0316 16:36:50.467132 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"05e90410-2cfb-438d-95df-8b2a70319257","Type":"ContainerDied","Data":"c81e95f5038d7d226294b881d501dd9e830cf87edf6aba2428d1ad4470cca082"} Mar 16 16:36:50 crc kubenswrapper[5120]: I0316 16:36:50.509019 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/rabbitmq-server-0" podStartSLOduration=36.508980849 podStartE2EDuration="36.508980849s" podCreationTimestamp="2026-03-16 16:36:14 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:36:50.493899955 +0000 UTC m=+3912.647831612" watchObservedRunningTime="2026-03-16 16:36:50.508980849 +0000 UTC m=+3912.662912506" Mar 16 16:36:50 crc kubenswrapper[5120]: I0316 16:36:50.517569 5120 scope.go:117] "RemoveContainer" containerID="7af84f8e395d6b609d5d679546e422a552f34f997d69d5ad8cf8e9ba8abfefc9" Mar 16 16:36:50 crc kubenswrapper[5120]: I0316 16:36:50.555663 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-bf486487c-4dtfb"] Mar 16 16:36:50 crc kubenswrapper[5120]: I0316 16:36:50.565573 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-bf486487c-4dtfb"] Mar 16 16:36:50 crc kubenswrapper[5120]: I0316 16:36:50.683226 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4d2aa91c-6d54-4ca1-97c9-528d23d4335b" path="/var/lib/kubelet/pods/4d2aa91c-6d54-4ca1-97c9-528d23d4335b/volumes" Mar 16 16:36:50 crc kubenswrapper[5120]: I0316 16:36:50.691813 5120 scope.go:117] "RemoveContainer" containerID="477c0c902f0b62f18a9c7f78d09355012a71b86484ecfa9f255581d96dc56221" Mar 16 16:36:50 crc kubenswrapper[5120]: E0316 16:36:50.692239 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"477c0c902f0b62f18a9c7f78d09355012a71b86484ecfa9f255581d96dc56221\": container with ID starting with 477c0c902f0b62f18a9c7f78d09355012a71b86484ecfa9f255581d96dc56221 not found: ID does not exist" containerID="477c0c902f0b62f18a9c7f78d09355012a71b86484ecfa9f255581d96dc56221" Mar 16 16:36:50 crc kubenswrapper[5120]: I0316 16:36:50.692266 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"477c0c902f0b62f18a9c7f78d09355012a71b86484ecfa9f255581d96dc56221"} err="failed to get container status \"477c0c902f0b62f18a9c7f78d09355012a71b86484ecfa9f255581d96dc56221\": rpc error: code = NotFound desc = could not find container \"477c0c902f0b62f18a9c7f78d09355012a71b86484ecfa9f255581d96dc56221\": container with ID starting with 477c0c902f0b62f18a9c7f78d09355012a71b86484ecfa9f255581d96dc56221 not found: ID does not exist" Mar 16 16:36:50 crc kubenswrapper[5120]: I0316 16:36:50.692284 5120 scope.go:117] "RemoveContainer" containerID="7af84f8e395d6b609d5d679546e422a552f34f997d69d5ad8cf8e9ba8abfefc9" Mar 16 16:36:50 crc kubenswrapper[5120]: E0316 16:36:50.692644 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7af84f8e395d6b609d5d679546e422a552f34f997d69d5ad8cf8e9ba8abfefc9\": container with ID starting with 7af84f8e395d6b609d5d679546e422a552f34f997d69d5ad8cf8e9ba8abfefc9 not found: ID does not exist" containerID="7af84f8e395d6b609d5d679546e422a552f34f997d69d5ad8cf8e9ba8abfefc9" Mar 16 16:36:50 crc kubenswrapper[5120]: I0316 16:36:50.692733 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7af84f8e395d6b609d5d679546e422a552f34f997d69d5ad8cf8e9ba8abfefc9"} err="failed to get container status \"7af84f8e395d6b609d5d679546e422a552f34f997d69d5ad8cf8e9ba8abfefc9\": rpc error: code = NotFound desc = could not find container \"7af84f8e395d6b609d5d679546e422a552f34f997d69d5ad8cf8e9ba8abfefc9\": container with ID starting with 7af84f8e395d6b609d5d679546e422a552f34f997d69d5ad8cf8e9ba8abfefc9 not found: ID does not exist" Mar 16 16:36:51 crc kubenswrapper[5120]: E0316 16:36:51.395964 5120 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfec060e6_11fd_4d16_8640_fd02366a7601.slice/crio-cf47aaebf63137acc7a77d17eb41eeb5f06bc1f346811dfa1f366d667ed8d6a4\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfec060e6_11fd_4d16_8640_fd02366a7601.slice\": RecentStats: unable to find data in memory cache]" Mar 16 16:36:51 crc kubenswrapper[5120]: I0316 16:36:51.480498 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"05e90410-2cfb-438d-95df-8b2a70319257","Type":"ContainerStarted","Data":"3f0d725b5803b997e34764d9eb46efc39619e2d518760dc404bedd35e77b5505"} Mar 16 16:36:51 crc kubenswrapper[5120]: I0316 16:36:51.480917 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:36:51 crc kubenswrapper[5120]: I0316 16:36:51.514883 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" podStartSLOduration=37.514856578 podStartE2EDuration="37.514856578s" podCreationTimestamp="2026-03-16 16:36:14 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:36:51.507068013 +0000 UTC m=+3913.660999690" watchObservedRunningTime="2026-03-16 16:36:51.514856578 +0000 UTC m=+3913.668788235" Mar 16 16:36:53 crc kubenswrapper[5120]: I0316 16:36:53.502185 5120 generic.go:358] "Generic (PLEG): container finished" podID="63d9a98c-175f-4caa-bd33-41eb82d6e06b" containerID="e33584a62e63e94b8ee772c464bae71158a771a227951bc7d1483783fd437d31" exitCode=137 Mar 16 16:36:53 crc kubenswrapper[5120]: I0316 16:36:53.502235 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"63d9a98c-175f-4caa-bd33-41eb82d6e06b","Type":"ContainerDied","Data":"e33584a62e63e94b8ee772c464bae71158a771a227951bc7d1483783fd437d31"} Mar 16 16:36:53 crc kubenswrapper[5120]: I0316 16:36:53.502605 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"63d9a98c-175f-4caa-bd33-41eb82d6e06b","Type":"ContainerDied","Data":"5f1b71df4cb307f83b9005e68b40676feb922878370c09aadaf4b20885a0264c"} Mar 16 16:36:53 crc kubenswrapper[5120]: I0316 16:36:53.502619 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5f1b71df4cb307f83b9005e68b40676feb922878370c09aadaf4b20885a0264c" Mar 16 16:36:53 crc kubenswrapper[5120]: I0316 16:36:53.502635 5120 scope.go:117] "RemoveContainer" containerID="3251b55607768a1c1602f007772fd47d988206a579b6573f7b1196b6855a2d19" Mar 16 16:36:53 crc kubenswrapper[5120]: I0316 16:36:53.545701 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:36:53 crc kubenswrapper[5120]: I0316 16:36:53.592153 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/63d9a98c-175f-4caa-bd33-41eb82d6e06b-scripts\") pod \"63d9a98c-175f-4caa-bd33-41eb82d6e06b\" (UID: \"63d9a98c-175f-4caa-bd33-41eb82d6e06b\") " Mar 16 16:36:53 crc kubenswrapper[5120]: I0316 16:36:53.592419 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/63d9a98c-175f-4caa-bd33-41eb82d6e06b-combined-ca-bundle\") pod \"63d9a98c-175f-4caa-bd33-41eb82d6e06b\" (UID: \"63d9a98c-175f-4caa-bd33-41eb82d6e06b\") " Mar 16 16:36:53 crc kubenswrapper[5120]: I0316 16:36:53.592534 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/63d9a98c-175f-4caa-bd33-41eb82d6e06b-etc-machine-id\") pod \"63d9a98c-175f-4caa-bd33-41eb82d6e06b\" (UID: \"63d9a98c-175f-4caa-bd33-41eb82d6e06b\") " Mar 16 16:36:53 crc kubenswrapper[5120]: I0316 16:36:53.592909 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xgzzx\" (UniqueName: \"kubernetes.io/projected/63d9a98c-175f-4caa-bd33-41eb82d6e06b-kube-api-access-xgzzx\") pod \"63d9a98c-175f-4caa-bd33-41eb82d6e06b\" (UID: \"63d9a98c-175f-4caa-bd33-41eb82d6e06b\") " Mar 16 16:36:53 crc kubenswrapper[5120]: I0316 16:36:53.592994 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/63d9a98c-175f-4caa-bd33-41eb82d6e06b-config-data-custom\") pod \"63d9a98c-175f-4caa-bd33-41eb82d6e06b\" (UID: \"63d9a98c-175f-4caa-bd33-41eb82d6e06b\") " Mar 16 16:36:53 crc kubenswrapper[5120]: I0316 16:36:53.593203 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/63d9a98c-175f-4caa-bd33-41eb82d6e06b-config-data\") pod \"63d9a98c-175f-4caa-bd33-41eb82d6e06b\" (UID: \"63d9a98c-175f-4caa-bd33-41eb82d6e06b\") " Mar 16 16:36:53 crc kubenswrapper[5120]: I0316 16:36:53.593971 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/63d9a98c-175f-4caa-bd33-41eb82d6e06b-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "63d9a98c-175f-4caa-bd33-41eb82d6e06b" (UID: "63d9a98c-175f-4caa-bd33-41eb82d6e06b"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 16:36:53 crc kubenswrapper[5120]: I0316 16:36:53.598720 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/63d9a98c-175f-4caa-bd33-41eb82d6e06b-scripts" (OuterVolumeSpecName: "scripts") pod "63d9a98c-175f-4caa-bd33-41eb82d6e06b" (UID: "63d9a98c-175f-4caa-bd33-41eb82d6e06b"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:36:53 crc kubenswrapper[5120]: I0316 16:36:53.603987 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63d9a98c-175f-4caa-bd33-41eb82d6e06b-kube-api-access-xgzzx" (OuterVolumeSpecName: "kube-api-access-xgzzx") pod "63d9a98c-175f-4caa-bd33-41eb82d6e06b" (UID: "63d9a98c-175f-4caa-bd33-41eb82d6e06b"). InnerVolumeSpecName "kube-api-access-xgzzx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:36:53 crc kubenswrapper[5120]: I0316 16:36:53.605302 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/63d9a98c-175f-4caa-bd33-41eb82d6e06b-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "63d9a98c-175f-4caa-bd33-41eb82d6e06b" (UID: "63d9a98c-175f-4caa-bd33-41eb82d6e06b"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:36:53 crc kubenswrapper[5120]: I0316 16:36:53.656843 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/63d9a98c-175f-4caa-bd33-41eb82d6e06b-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "63d9a98c-175f-4caa-bd33-41eb82d6e06b" (UID: "63d9a98c-175f-4caa-bd33-41eb82d6e06b"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:36:53 crc kubenswrapper[5120]: I0316 16:36:53.697015 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/63d9a98c-175f-4caa-bd33-41eb82d6e06b-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:53 crc kubenswrapper[5120]: I0316 16:36:53.697057 5120 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/63d9a98c-175f-4caa-bd33-41eb82d6e06b-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:53 crc kubenswrapper[5120]: I0316 16:36:53.697072 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xgzzx\" (UniqueName: \"kubernetes.io/projected/63d9a98c-175f-4caa-bd33-41eb82d6e06b-kube-api-access-xgzzx\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:53 crc kubenswrapper[5120]: I0316 16:36:53.697085 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/63d9a98c-175f-4caa-bd33-41eb82d6e06b-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:53 crc kubenswrapper[5120]: I0316 16:36:53.697096 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/63d9a98c-175f-4caa-bd33-41eb82d6e06b-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:53 crc kubenswrapper[5120]: I0316 16:36:53.719286 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/63d9a98c-175f-4caa-bd33-41eb82d6e06b-config-data" (OuterVolumeSpecName: "config-data") pod "63d9a98c-175f-4caa-bd33-41eb82d6e06b" (UID: "63d9a98c-175f-4caa-bd33-41eb82d6e06b"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:36:53 crc kubenswrapper[5120]: I0316 16:36:53.799351 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/63d9a98c-175f-4caa-bd33-41eb82d6e06b-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:36:54 crc kubenswrapper[5120]: I0316 16:36:54.514874 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:36:54 crc kubenswrapper[5120]: I0316 16:36:54.562936 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:36:54 crc kubenswrapper[5120]: I0316 16:36:54.575707 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:36:54 crc kubenswrapper[5120]: I0316 16:36:54.587692 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:36:54 crc kubenswrapper[5120]: I0316 16:36:54.589531 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2be00a2-fcd5-4862-aadf-b2947d6d138b" containerName="barbican-api" Mar 16 16:36:54 crc kubenswrapper[5120]: I0316 16:36:54.589563 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2be00a2-fcd5-4862-aadf-b2947d6d138b" containerName="barbican-api" Mar 16 16:36:54 crc kubenswrapper[5120]: I0316 16:36:54.589588 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d2aa91c-6d54-4ca1-97c9-528d23d4335b" containerName="dnsmasq-dns" Mar 16 16:36:54 crc kubenswrapper[5120]: I0316 16:36:54.589600 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d2aa91c-6d54-4ca1-97c9-528d23d4335b" containerName="dnsmasq-dns" Mar 16 16:36:54 crc kubenswrapper[5120]: I0316 16:36:54.589618 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2be00a2-fcd5-4862-aadf-b2947d6d138b" containerName="barbican-api-log" Mar 16 16:36:54 crc kubenswrapper[5120]: I0316 16:36:54.589630 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2be00a2-fcd5-4862-aadf-b2947d6d138b" containerName="barbican-api-log" Mar 16 16:36:54 crc kubenswrapper[5120]: I0316 16:36:54.589715 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63d9a98c-175f-4caa-bd33-41eb82d6e06b" containerName="probe" Mar 16 16:36:54 crc kubenswrapper[5120]: I0316 16:36:54.589726 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="63d9a98c-175f-4caa-bd33-41eb82d6e06b" containerName="probe" Mar 16 16:36:54 crc kubenswrapper[5120]: I0316 16:36:54.589741 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63d9a98c-175f-4caa-bd33-41eb82d6e06b" containerName="cinder-scheduler" Mar 16 16:36:54 crc kubenswrapper[5120]: I0316 16:36:54.589752 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="63d9a98c-175f-4caa-bd33-41eb82d6e06b" containerName="cinder-scheduler" Mar 16 16:36:54 crc kubenswrapper[5120]: I0316 16:36:54.589825 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d2aa91c-6d54-4ca1-97c9-528d23d4335b" containerName="init" Mar 16 16:36:54 crc kubenswrapper[5120]: I0316 16:36:54.589836 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d2aa91c-6d54-4ca1-97c9-528d23d4335b" containerName="init" Mar 16 16:36:54 crc kubenswrapper[5120]: I0316 16:36:54.590154 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="63d9a98c-175f-4caa-bd33-41eb82d6e06b" containerName="probe" Mar 16 16:36:54 crc kubenswrapper[5120]: I0316 16:36:54.590178 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="63d9a98c-175f-4caa-bd33-41eb82d6e06b" containerName="cinder-scheduler" Mar 16 16:36:54 crc kubenswrapper[5120]: I0316 16:36:54.590212 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="a2be00a2-fcd5-4862-aadf-b2947d6d138b" containerName="barbican-api" Mar 16 16:36:54 crc kubenswrapper[5120]: I0316 16:36:54.590243 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="a2be00a2-fcd5-4862-aadf-b2947d6d138b" containerName="barbican-api-log" Mar 16 16:36:54 crc kubenswrapper[5120]: I0316 16:36:54.590263 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="4d2aa91c-6d54-4ca1-97c9-528d23d4335b" containerName="dnsmasq-dns" Mar 16 16:36:54 crc kubenswrapper[5120]: I0316 16:36:54.590609 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63d9a98c-175f-4caa-bd33-41eb82d6e06b" containerName="cinder-scheduler" Mar 16 16:36:54 crc kubenswrapper[5120]: I0316 16:36:54.590623 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="63d9a98c-175f-4caa-bd33-41eb82d6e06b" containerName="cinder-scheduler" Mar 16 16:36:54 crc kubenswrapper[5120]: I0316 16:36:54.590981 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="63d9a98c-175f-4caa-bd33-41eb82d6e06b" containerName="cinder-scheduler" Mar 16 16:36:54 crc kubenswrapper[5120]: I0316 16:36:54.599303 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:36:54 crc kubenswrapper[5120]: I0316 16:36:54.599317 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:36:54 crc kubenswrapper[5120]: I0316 16:36:54.602163 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-scheduler-config-data\"" Mar 16 16:36:54 crc kubenswrapper[5120]: I0316 16:36:54.678003 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="63d9a98c-175f-4caa-bd33-41eb82d6e06b" path="/var/lib/kubelet/pods/63d9a98c-175f-4caa-bd33-41eb82d6e06b/volumes" Mar 16 16:36:54 crc kubenswrapper[5120]: I0316 16:36:54.722505 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fa6ffb82-b871-4dae-b7c1-7880c90110a2-config-data\") pod \"cinder-scheduler-0\" (UID: \"fa6ffb82-b871-4dae-b7c1-7880c90110a2\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:36:54 crc kubenswrapper[5120]: I0316 16:36:54.723003 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhbbm\" (UniqueName: \"kubernetes.io/projected/fa6ffb82-b871-4dae-b7c1-7880c90110a2-kube-api-access-dhbbm\") pod \"cinder-scheduler-0\" (UID: \"fa6ffb82-b871-4dae-b7c1-7880c90110a2\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:36:54 crc kubenswrapper[5120]: I0316 16:36:54.723140 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fa6ffb82-b871-4dae-b7c1-7880c90110a2-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"fa6ffb82-b871-4dae-b7c1-7880c90110a2\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:36:54 crc kubenswrapper[5120]: I0316 16:36:54.723344 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/fa6ffb82-b871-4dae-b7c1-7880c90110a2-scripts\") pod \"cinder-scheduler-0\" (UID: \"fa6ffb82-b871-4dae-b7c1-7880c90110a2\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:36:54 crc kubenswrapper[5120]: I0316 16:36:54.723565 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/fa6ffb82-b871-4dae-b7c1-7880c90110a2-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"fa6ffb82-b871-4dae-b7c1-7880c90110a2\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:36:54 crc kubenswrapper[5120]: I0316 16:36:54.724079 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/fa6ffb82-b871-4dae-b7c1-7880c90110a2-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"fa6ffb82-b871-4dae-b7c1-7880c90110a2\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:36:54 crc kubenswrapper[5120]: I0316 16:36:54.825919 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/fa6ffb82-b871-4dae-b7c1-7880c90110a2-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"fa6ffb82-b871-4dae-b7c1-7880c90110a2\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:36:54 crc kubenswrapper[5120]: I0316 16:36:54.826053 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/fa6ffb82-b871-4dae-b7c1-7880c90110a2-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"fa6ffb82-b871-4dae-b7c1-7880c90110a2\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:36:54 crc kubenswrapper[5120]: I0316 16:36:54.826172 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fa6ffb82-b871-4dae-b7c1-7880c90110a2-config-data\") pod \"cinder-scheduler-0\" (UID: \"fa6ffb82-b871-4dae-b7c1-7880c90110a2\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:36:54 crc kubenswrapper[5120]: I0316 16:36:54.826247 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dhbbm\" (UniqueName: \"kubernetes.io/projected/fa6ffb82-b871-4dae-b7c1-7880c90110a2-kube-api-access-dhbbm\") pod \"cinder-scheduler-0\" (UID: \"fa6ffb82-b871-4dae-b7c1-7880c90110a2\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:36:54 crc kubenswrapper[5120]: I0316 16:36:54.826267 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fa6ffb82-b871-4dae-b7c1-7880c90110a2-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"fa6ffb82-b871-4dae-b7c1-7880c90110a2\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:36:54 crc kubenswrapper[5120]: I0316 16:36:54.826337 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/fa6ffb82-b871-4dae-b7c1-7880c90110a2-scripts\") pod \"cinder-scheduler-0\" (UID: \"fa6ffb82-b871-4dae-b7c1-7880c90110a2\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:36:54 crc kubenswrapper[5120]: I0316 16:36:54.827361 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/fa6ffb82-b871-4dae-b7c1-7880c90110a2-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"fa6ffb82-b871-4dae-b7c1-7880c90110a2\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:36:54 crc kubenswrapper[5120]: I0316 16:36:54.831673 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/fa6ffb82-b871-4dae-b7c1-7880c90110a2-scripts\") pod \"cinder-scheduler-0\" (UID: \"fa6ffb82-b871-4dae-b7c1-7880c90110a2\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:36:54 crc kubenswrapper[5120]: I0316 16:36:54.832618 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fa6ffb82-b871-4dae-b7c1-7880c90110a2-config-data\") pod \"cinder-scheduler-0\" (UID: \"fa6ffb82-b871-4dae-b7c1-7880c90110a2\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:36:54 crc kubenswrapper[5120]: I0316 16:36:54.833922 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fa6ffb82-b871-4dae-b7c1-7880c90110a2-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"fa6ffb82-b871-4dae-b7c1-7880c90110a2\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:36:54 crc kubenswrapper[5120]: I0316 16:36:54.835953 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/fa6ffb82-b871-4dae-b7c1-7880c90110a2-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"fa6ffb82-b871-4dae-b7c1-7880c90110a2\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:36:54 crc kubenswrapper[5120]: I0316 16:36:54.849705 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhbbm\" (UniqueName: \"kubernetes.io/projected/fa6ffb82-b871-4dae-b7c1-7880c90110a2-kube-api-access-dhbbm\") pod \"cinder-scheduler-0\" (UID: \"fa6ffb82-b871-4dae-b7c1-7880c90110a2\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:36:54 crc kubenswrapper[5120]: I0316 16:36:54.932507 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:36:55 crc kubenswrapper[5120]: I0316 16:36:55.445272 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:36:55 crc kubenswrapper[5120]: I0316 16:36:55.529948 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"fa6ffb82-b871-4dae-b7c1-7880c90110a2","Type":"ContainerStarted","Data":"ae0058a78c9b1eb1357f6523e225a131dd01af973403134c53d949d4da03d485"} Mar 16 16:36:55 crc kubenswrapper[5120]: I0316 16:36:55.983639 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/neutron-8bf565768-57qhf" Mar 16 16:36:56 crc kubenswrapper[5120]: I0316 16:36:56.114317 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-5465fdbb4f-kmfhc"] Mar 16 16:36:56 crc kubenswrapper[5120]: I0316 16:36:56.114851 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-5465fdbb4f-kmfhc" podUID="5d856ccc-313e-4833-8548-c8e34d0852ba" containerName="neutron-api" containerID="cri-o://0c7a14a52c399c07522843c53d42edbfe74d08ad0b9dd13a8dc530c5065e6623" gracePeriod=30 Mar 16 16:36:56 crc kubenswrapper[5120]: I0316 16:36:56.116437 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-5465fdbb4f-kmfhc" podUID="5d856ccc-313e-4833-8548-c8e34d0852ba" containerName="neutron-httpd" containerID="cri-o://919fbcb5f5c708d3d71add68a29194c1b6ef9cd341c8a87d23bcd6654768a044" gracePeriod=30 Mar 16 16:36:56 crc kubenswrapper[5120]: I0316 16:36:56.552988 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"fa6ffb82-b871-4dae-b7c1-7880c90110a2","Type":"ContainerStarted","Data":"7b272a2c6ee74f384df1440a6b8dba3da112cef47111a781a3b1bb1cb0c90d7c"} Mar 16 16:36:56 crc kubenswrapper[5120]: I0316 16:36:56.564830 5120 generic.go:358] "Generic (PLEG): container finished" podID="5d856ccc-313e-4833-8548-c8e34d0852ba" containerID="919fbcb5f5c708d3d71add68a29194c1b6ef9cd341c8a87d23bcd6654768a044" exitCode=0 Mar 16 16:36:56 crc kubenswrapper[5120]: I0316 16:36:56.564935 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-5465fdbb4f-kmfhc" event={"ID":"5d856ccc-313e-4833-8548-c8e34d0852ba","Type":"ContainerDied","Data":"919fbcb5f5c708d3d71add68a29194c1b6ef9cd341c8a87d23bcd6654768a044"} Mar 16 16:36:57 crc kubenswrapper[5120]: I0316 16:36:57.580314 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"fa6ffb82-b871-4dae-b7c1-7880c90110a2","Type":"ContainerStarted","Data":"aef5b61853adbdead35cca539e19363cb4263f66d2d389dbe393593c6574a066"} Mar 16 16:36:57 crc kubenswrapper[5120]: I0316 16:36:57.601212 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-scheduler-0" podStartSLOduration=3.6011922629999997 podStartE2EDuration="3.601192263s" podCreationTimestamp="2026-03-16 16:36:54 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:36:57.598557424 +0000 UTC m=+3919.752489081" watchObservedRunningTime="2026-03-16 16:36:57.601192263 +0000 UTC m=+3919.755123910" Mar 16 16:36:59 crc kubenswrapper[5120]: I0316 16:36:59.933247 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:37:00 crc kubenswrapper[5120]: I0316 16:37:00.227510 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:37:00 crc kubenswrapper[5120]: I0316 16:37:00.664195 5120 scope.go:117] "RemoveContainer" containerID="0a15d5caff30dc8885f782e59962af7d98d58b39ab76059e56e5827e10e7ab8b" Mar 16 16:37:01 crc kubenswrapper[5120]: I0316 16:37:01.484039 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:37:01 crc kubenswrapper[5120]: I0316 16:37:01.688388 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" event={"ID":"e2275cb4-4905-4d66-a87e-8010120db2bd","Type":"ContainerStarted","Data":"27caa0d07f4f6a9da1d136e53e041b4b98a922634553e557b8adcb1ff1ab2b90"} Mar 16 16:37:01 crc kubenswrapper[5120]: I0316 16:37:01.730782 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-s56kl"] Mar 16 16:37:01 crc kubenswrapper[5120]: I0316 16:37:01.805034 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-s56kl"] Mar 16 16:37:01 crc kubenswrapper[5120]: E0316 16:37:01.805172 5120 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfec060e6_11fd_4d16_8640_fd02366a7601.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfec060e6_11fd_4d16_8640_fd02366a7601.slice/crio-cf47aaebf63137acc7a77d17eb41eeb5f06bc1f346811dfa1f366d667ed8d6a4\": RecentStats: unable to find data in memory cache]" Mar 16 16:37:01 crc kubenswrapper[5120]: I0316 16:37:01.830993 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:37:01 crc kubenswrapper[5120]: I0316 16:37:01.831950 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="b8725613-8c6b-4e92-9ff7-c9aeaff10f59" containerName="nova-api-log" containerID="cri-o://43ff2c8b27976e7f451cd3418a68822e68a6023ebdb30af40b8cdec7cec06b55" gracePeriod=30 Mar 16 16:37:01 crc kubenswrapper[5120]: I0316 16:37:01.832682 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="b8725613-8c6b-4e92-9ff7-c9aeaff10f59" containerName="nova-api-api" containerID="cri-o://a165c25cb76cda11d364c5b15d44fa2906e650d5ab895aacb333f78bb6096ffd" gracePeriod=30 Mar 16 16:37:01 crc kubenswrapper[5120]: I0316 16:37:01.881379 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:37:01 crc kubenswrapper[5120]: I0316 16:37:01.881590 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="7c9566ce-4767-48d0-b606-410f234e9cf2" containerName="nova-scheduler-scheduler" containerID="cri-o://c8679e06fbfeaddd2c356f909c632c829f8292eb82529143e243db09bd7464c4" gracePeriod=30 Mar 16 16:37:01 crc kubenswrapper[5120]: I0316 16:37:01.900235 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:37:01 crc kubenswrapper[5120]: I0316 16:37:01.900747 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="7c83e22b-e8f6-4228-95a3-9874368d9534" containerName="nova-metadata-log" containerID="cri-o://abde150290ce828331e2e06b6c3eda33f7634800c0fb62b8fb73b6774f0bbfd7" gracePeriod=30 Mar 16 16:37:01 crc kubenswrapper[5120]: I0316 16:37:01.901395 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="7c83e22b-e8f6-4228-95a3-9874368d9534" containerName="nova-metadata-metadata" containerID="cri-o://e163ad55192dbc5251d5fc25b1137a1e6ec11964a33c4a5ec18c748abe611356" gracePeriod=30 Mar 16 16:37:02 crc kubenswrapper[5120]: I0316 16:37:02.067313 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-82zhz"] Mar 16 16:37:02 crc kubenswrapper[5120]: I0316 16:37:02.076965 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-82zhz" Mar 16 16:37:02 crc kubenswrapper[5120]: I0316 16:37:02.080376 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-manage-scripts\"" Mar 16 16:37:02 crc kubenswrapper[5120]: I0316 16:37:02.080716 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-manage-config-data\"" Mar 16 16:37:02 crc kubenswrapper[5120]: I0316 16:37:02.099285 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-82zhz"] Mar 16 16:37:02 crc kubenswrapper[5120]: I0316 16:37:02.120980 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3b7052c0-d1a0-4e78-b88f-e820db4ee0f6-scripts\") pod \"nova-cell0-cell-mapping-82zhz\" (UID: \"3b7052c0-d1a0-4e78-b88f-e820db4ee0f6\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-82zhz" Mar 16 16:37:02 crc kubenswrapper[5120]: I0316 16:37:02.121327 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3b7052c0-d1a0-4e78-b88f-e820db4ee0f6-config-data\") pod \"nova-cell0-cell-mapping-82zhz\" (UID: \"3b7052c0-d1a0-4e78-b88f-e820db4ee0f6\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-82zhz" Mar 16 16:37:02 crc kubenswrapper[5120]: I0316 16:37:02.121568 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d894n\" (UniqueName: \"kubernetes.io/projected/3b7052c0-d1a0-4e78-b88f-e820db4ee0f6-kube-api-access-d894n\") pod \"nova-cell0-cell-mapping-82zhz\" (UID: \"3b7052c0-d1a0-4e78-b88f-e820db4ee0f6\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-82zhz" Mar 16 16:37:02 crc kubenswrapper[5120]: I0316 16:37:02.121846 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3b7052c0-d1a0-4e78-b88f-e820db4ee0f6-combined-ca-bundle\") pod \"nova-cell0-cell-mapping-82zhz\" (UID: \"3b7052c0-d1a0-4e78-b88f-e820db4ee0f6\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-82zhz" Mar 16 16:37:02 crc kubenswrapper[5120]: I0316 16:37:02.224669 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3b7052c0-d1a0-4e78-b88f-e820db4ee0f6-scripts\") pod \"nova-cell0-cell-mapping-82zhz\" (UID: \"3b7052c0-d1a0-4e78-b88f-e820db4ee0f6\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-82zhz" Mar 16 16:37:02 crc kubenswrapper[5120]: I0316 16:37:02.224928 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3b7052c0-d1a0-4e78-b88f-e820db4ee0f6-config-data\") pod \"nova-cell0-cell-mapping-82zhz\" (UID: \"3b7052c0-d1a0-4e78-b88f-e820db4ee0f6\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-82zhz" Mar 16 16:37:02 crc kubenswrapper[5120]: I0316 16:37:02.225173 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d894n\" (UniqueName: \"kubernetes.io/projected/3b7052c0-d1a0-4e78-b88f-e820db4ee0f6-kube-api-access-d894n\") pod \"nova-cell0-cell-mapping-82zhz\" (UID: \"3b7052c0-d1a0-4e78-b88f-e820db4ee0f6\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-82zhz" Mar 16 16:37:02 crc kubenswrapper[5120]: I0316 16:37:02.225451 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3b7052c0-d1a0-4e78-b88f-e820db4ee0f6-combined-ca-bundle\") pod \"nova-cell0-cell-mapping-82zhz\" (UID: \"3b7052c0-d1a0-4e78-b88f-e820db4ee0f6\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-82zhz" Mar 16 16:37:02 crc kubenswrapper[5120]: I0316 16:37:02.235628 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3b7052c0-d1a0-4e78-b88f-e820db4ee0f6-config-data\") pod \"nova-cell0-cell-mapping-82zhz\" (UID: \"3b7052c0-d1a0-4e78-b88f-e820db4ee0f6\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-82zhz" Mar 16 16:37:02 crc kubenswrapper[5120]: I0316 16:37:02.235841 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3b7052c0-d1a0-4e78-b88f-e820db4ee0f6-combined-ca-bundle\") pod \"nova-cell0-cell-mapping-82zhz\" (UID: \"3b7052c0-d1a0-4e78-b88f-e820db4ee0f6\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-82zhz" Mar 16 16:37:02 crc kubenswrapper[5120]: I0316 16:37:02.237933 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3b7052c0-d1a0-4e78-b88f-e820db4ee0f6-scripts\") pod \"nova-cell0-cell-mapping-82zhz\" (UID: \"3b7052c0-d1a0-4e78-b88f-e820db4ee0f6\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-82zhz" Mar 16 16:37:02 crc kubenswrapper[5120]: I0316 16:37:02.265199 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d894n\" (UniqueName: \"kubernetes.io/projected/3b7052c0-d1a0-4e78-b88f-e820db4ee0f6-kube-api-access-d894n\") pod \"nova-cell0-cell-mapping-82zhz\" (UID: \"3b7052c0-d1a0-4e78-b88f-e820db4ee0f6\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-82zhz" Mar 16 16:37:02 crc kubenswrapper[5120]: I0316 16:37:02.396336 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-82zhz" Mar 16 16:37:02 crc kubenswrapper[5120]: E0316 16:37:02.434599 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="c8679e06fbfeaddd2c356f909c632c829f8292eb82529143e243db09bd7464c4" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:37:02 crc kubenswrapper[5120]: E0316 16:37:02.439124 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="c8679e06fbfeaddd2c356f909c632c829f8292eb82529143e243db09bd7464c4" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:37:02 crc kubenswrapper[5120]: E0316 16:37:02.455360 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="c8679e06fbfeaddd2c356f909c632c829f8292eb82529143e243db09bd7464c4" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:37:02 crc kubenswrapper[5120]: E0316 16:37:02.455486 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="7c9566ce-4767-48d0-b606-410f234e9cf2" containerName="nova-scheduler-scheduler" probeResult="unknown" Mar 16 16:37:02 crc kubenswrapper[5120]: I0316 16:37:02.493093 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:37:02 crc kubenswrapper[5120]: I0316 16:37:02.679068 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="628685cb-eaf0-45f8-b678-c093de257dbc" path="/var/lib/kubelet/pods/628685cb-eaf0-45f8-b678-c093de257dbc/volumes" Mar 16 16:37:02 crc kubenswrapper[5120]: I0316 16:37:02.699802 5120 generic.go:358] "Generic (PLEG): container finished" podID="7c83e22b-e8f6-4228-95a3-9874368d9534" containerID="abde150290ce828331e2e06b6c3eda33f7634800c0fb62b8fb73b6774f0bbfd7" exitCode=143 Mar 16 16:37:02 crc kubenswrapper[5120]: I0316 16:37:02.699889 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"7c83e22b-e8f6-4228-95a3-9874368d9534","Type":"ContainerDied","Data":"abde150290ce828331e2e06b6c3eda33f7634800c0fb62b8fb73b6774f0bbfd7"} Mar 16 16:37:02 crc kubenswrapper[5120]: I0316 16:37:02.702266 5120 generic.go:358] "Generic (PLEG): container finished" podID="b8725613-8c6b-4e92-9ff7-c9aeaff10f59" containerID="43ff2c8b27976e7f451cd3418a68822e68a6023ebdb30af40b8cdec7cec06b55" exitCode=143 Mar 16 16:37:02 crc kubenswrapper[5120]: I0316 16:37:02.702348 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"b8725613-8c6b-4e92-9ff7-c9aeaff10f59","Type":"ContainerDied","Data":"43ff2c8b27976e7f451cd3418a68822e68a6023ebdb30af40b8cdec7cec06b55"} Mar 16 16:37:02 crc kubenswrapper[5120]: I0316 16:37:02.796928 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-4grts"] Mar 16 16:37:02 crc kubenswrapper[5120]: I0316 16:37:02.806367 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-4grts"] Mar 16 16:37:02 crc kubenswrapper[5120]: I0316 16:37:02.908553 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-skrj6"] Mar 16 16:37:02 crc kubenswrapper[5120]: I0316 16:37:02.943166 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-skrj6"] Mar 16 16:37:02 crc kubenswrapper[5120]: I0316 16:37:02.943322 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-skrj6" Mar 16 16:37:02 crc kubenswrapper[5120]: I0316 16:37:02.946930 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-manage-scripts\"" Mar 16 16:37:02 crc kubenswrapper[5120]: I0316 16:37:02.951404 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-manage-config-data\"" Mar 16 16:37:03 crc kubenswrapper[5120]: I0316 16:37:03.003997 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-82zhz"] Mar 16 16:37:03 crc kubenswrapper[5120]: I0316 16:37:03.047196 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzg6m\" (UniqueName: \"kubernetes.io/projected/493a54f8-9510-4307-a13e-c3c00dc840a1-kube-api-access-gzg6m\") pod \"nova-cell1-cell-mapping-skrj6\" (UID: \"493a54f8-9510-4307-a13e-c3c00dc840a1\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-skrj6" Mar 16 16:37:03 crc kubenswrapper[5120]: I0316 16:37:03.047288 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/493a54f8-9510-4307-a13e-c3c00dc840a1-scripts\") pod \"nova-cell1-cell-mapping-skrj6\" (UID: \"493a54f8-9510-4307-a13e-c3c00dc840a1\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-skrj6" Mar 16 16:37:03 crc kubenswrapper[5120]: I0316 16:37:03.047381 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/493a54f8-9510-4307-a13e-c3c00dc840a1-combined-ca-bundle\") pod \"nova-cell1-cell-mapping-skrj6\" (UID: \"493a54f8-9510-4307-a13e-c3c00dc840a1\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-skrj6" Mar 16 16:37:03 crc kubenswrapper[5120]: I0316 16:37:03.047548 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/493a54f8-9510-4307-a13e-c3c00dc840a1-config-data\") pod \"nova-cell1-cell-mapping-skrj6\" (UID: \"493a54f8-9510-4307-a13e-c3c00dc840a1\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-skrj6" Mar 16 16:37:03 crc kubenswrapper[5120]: I0316 16:37:03.115219 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/neutron-5465fdbb4f-kmfhc" podUID="5d856ccc-313e-4833-8548-c8e34d0852ba" containerName="neutron-httpd" probeResult="failure" output="Get \"https://10.217.0.164:9696/\": dial tcp 10.217.0.164:9696: connect: connection refused" Mar 16 16:37:03 crc kubenswrapper[5120]: I0316 16:37:03.149280 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/493a54f8-9510-4307-a13e-c3c00dc840a1-scripts\") pod \"nova-cell1-cell-mapping-skrj6\" (UID: \"493a54f8-9510-4307-a13e-c3c00dc840a1\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-skrj6" Mar 16 16:37:03 crc kubenswrapper[5120]: I0316 16:37:03.149400 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/493a54f8-9510-4307-a13e-c3c00dc840a1-combined-ca-bundle\") pod \"nova-cell1-cell-mapping-skrj6\" (UID: \"493a54f8-9510-4307-a13e-c3c00dc840a1\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-skrj6" Mar 16 16:37:03 crc kubenswrapper[5120]: I0316 16:37:03.149605 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/493a54f8-9510-4307-a13e-c3c00dc840a1-config-data\") pod \"nova-cell1-cell-mapping-skrj6\" (UID: \"493a54f8-9510-4307-a13e-c3c00dc840a1\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-skrj6" Mar 16 16:37:03 crc kubenswrapper[5120]: I0316 16:37:03.149677 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gzg6m\" (UniqueName: \"kubernetes.io/projected/493a54f8-9510-4307-a13e-c3c00dc840a1-kube-api-access-gzg6m\") pod \"nova-cell1-cell-mapping-skrj6\" (UID: \"493a54f8-9510-4307-a13e-c3c00dc840a1\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-skrj6" Mar 16 16:37:03 crc kubenswrapper[5120]: I0316 16:37:03.155459 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/493a54f8-9510-4307-a13e-c3c00dc840a1-combined-ca-bundle\") pod \"nova-cell1-cell-mapping-skrj6\" (UID: \"493a54f8-9510-4307-a13e-c3c00dc840a1\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-skrj6" Mar 16 16:37:03 crc kubenswrapper[5120]: I0316 16:37:03.156374 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/493a54f8-9510-4307-a13e-c3c00dc840a1-scripts\") pod \"nova-cell1-cell-mapping-skrj6\" (UID: \"493a54f8-9510-4307-a13e-c3c00dc840a1\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-skrj6" Mar 16 16:37:03 crc kubenswrapper[5120]: I0316 16:37:03.157536 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/493a54f8-9510-4307-a13e-c3c00dc840a1-config-data\") pod \"nova-cell1-cell-mapping-skrj6\" (UID: \"493a54f8-9510-4307-a13e-c3c00dc840a1\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-skrj6" Mar 16 16:37:03 crc kubenswrapper[5120]: I0316 16:37:03.170698 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzg6m\" (UniqueName: \"kubernetes.io/projected/493a54f8-9510-4307-a13e-c3c00dc840a1-kube-api-access-gzg6m\") pod \"nova-cell1-cell-mapping-skrj6\" (UID: \"493a54f8-9510-4307-a13e-c3c00dc840a1\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-skrj6" Mar 16 16:37:03 crc kubenswrapper[5120]: I0316 16:37:03.400405 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-skrj6" Mar 16 16:37:03 crc kubenswrapper[5120]: I0316 16:37:03.712573 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-82zhz" event={"ID":"3b7052c0-d1a0-4e78-b88f-e820db4ee0f6","Type":"ContainerStarted","Data":"286e1a162710f7d74c84bf4dca3a41749051657141bed19dabe7605fa5405a5c"} Mar 16 16:37:03 crc kubenswrapper[5120]: I0316 16:37:03.712966 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-82zhz" event={"ID":"3b7052c0-d1a0-4e78-b88f-e820db4ee0f6","Type":"ContainerStarted","Data":"e352e1453ba421e929d2369112058070cfd989ece3ca6c1330a2424bd038d011"} Mar 16 16:37:03 crc kubenswrapper[5120]: I0316 16:37:03.891318 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-82zhz" podStartSLOduration=1.8912995000000001 podStartE2EDuration="1.8912995s" podCreationTimestamp="2026-03-16 16:37:02 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:37:03.736301424 +0000 UTC m=+3925.890233081" watchObservedRunningTime="2026-03-16 16:37:03.8912995 +0000 UTC m=+3926.045231157" Mar 16 16:37:03 crc kubenswrapper[5120]: W0316 16:37:03.891712 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod493a54f8_9510_4307_a13e_c3c00dc840a1.slice/crio-202983962d28cc3b474cb85e6407e66b804152e9ad75156f320b89ab2e19437a WatchSource:0}: Error finding container 202983962d28cc3b474cb85e6407e66b804152e9ad75156f320b89ab2e19437a: Status 404 returned error can't find the container with id 202983962d28cc3b474cb85e6407e66b804152e9ad75156f320b89ab2e19437a Mar 16 16:37:03 crc kubenswrapper[5120]: I0316 16:37:03.892100 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-skrj6"] Mar 16 16:37:04 crc kubenswrapper[5120]: I0316 16:37:04.711107 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b9ea3d3a-7ea8-4e4f-a075-60297d8672b5" path="/var/lib/kubelet/pods/b9ea3d3a-7ea8-4e4f-a075-60297d8672b5/volumes" Mar 16 16:37:04 crc kubenswrapper[5120]: I0316 16:37:04.734778 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-skrj6" event={"ID":"493a54f8-9510-4307-a13e-c3c00dc840a1","Type":"ContainerStarted","Data":"90029a57cda1c82f1798fae3e7d3d6f5f4f44479371d17227cf43653ae68b672"} Mar 16 16:37:04 crc kubenswrapper[5120]: I0316 16:37:04.735445 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-skrj6" event={"ID":"493a54f8-9510-4307-a13e-c3c00dc840a1","Type":"ContainerStarted","Data":"202983962d28cc3b474cb85e6407e66b804152e9ad75156f320b89ab2e19437a"} Mar 16 16:37:04 crc kubenswrapper[5120]: I0316 16:37:04.741318 5120 generic.go:358] "Generic (PLEG): container finished" podID="5d856ccc-313e-4833-8548-c8e34d0852ba" containerID="0c7a14a52c399c07522843c53d42edbfe74d08ad0b9dd13a8dc530c5065e6623" exitCode=0 Mar 16 16:37:04 crc kubenswrapper[5120]: I0316 16:37:04.741494 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-5465fdbb4f-kmfhc" event={"ID":"5d856ccc-313e-4833-8548-c8e34d0852ba","Type":"ContainerDied","Data":"0c7a14a52c399c07522843c53d42edbfe74d08ad0b9dd13a8dc530c5065e6623"} Mar 16 16:37:04 crc kubenswrapper[5120]: I0316 16:37:04.764233 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-skrj6" podStartSLOduration=2.764165688 podStartE2EDuration="2.764165688s" podCreationTimestamp="2026-03-16 16:37:02 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:37:04.754504976 +0000 UTC m=+3926.908436633" watchObservedRunningTime="2026-03-16 16:37:04.764165688 +0000 UTC m=+3926.918097345" Mar 16 16:37:04 crc kubenswrapper[5120]: I0316 16:37:04.925233 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-5465fdbb4f-kmfhc" Mar 16 16:37:05 crc kubenswrapper[5120]: I0316 16:37:05.016784 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/5d856ccc-313e-4833-8548-c8e34d0852ba-httpd-config\") pod \"5d856ccc-313e-4833-8548-c8e34d0852ba\" (UID: \"5d856ccc-313e-4833-8548-c8e34d0852ba\") " Mar 16 16:37:05 crc kubenswrapper[5120]: I0316 16:37:05.016884 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/5d856ccc-313e-4833-8548-c8e34d0852ba-public-tls-certs\") pod \"5d856ccc-313e-4833-8548-c8e34d0852ba\" (UID: \"5d856ccc-313e-4833-8548-c8e34d0852ba\") " Mar 16 16:37:05 crc kubenswrapper[5120]: I0316 16:37:05.016901 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/5d856ccc-313e-4833-8548-c8e34d0852ba-ovndb-tls-certs\") pod \"5d856ccc-313e-4833-8548-c8e34d0852ba\" (UID: \"5d856ccc-313e-4833-8548-c8e34d0852ba\") " Mar 16 16:37:05 crc kubenswrapper[5120]: I0316 16:37:05.016977 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/5d856ccc-313e-4833-8548-c8e34d0852ba-internal-tls-certs\") pod \"5d856ccc-313e-4833-8548-c8e34d0852ba\" (UID: \"5d856ccc-313e-4833-8548-c8e34d0852ba\") " Mar 16 16:37:05 crc kubenswrapper[5120]: I0316 16:37:05.017192 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5d856ccc-313e-4833-8548-c8e34d0852ba-combined-ca-bundle\") pod \"5d856ccc-313e-4833-8548-c8e34d0852ba\" (UID: \"5d856ccc-313e-4833-8548-c8e34d0852ba\") " Mar 16 16:37:05 crc kubenswrapper[5120]: I0316 16:37:05.017315 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5d856ccc-313e-4833-8548-c8e34d0852ba-config\") pod \"5d856ccc-313e-4833-8548-c8e34d0852ba\" (UID: \"5d856ccc-313e-4833-8548-c8e34d0852ba\") " Mar 16 16:37:05 crc kubenswrapper[5120]: I0316 16:37:05.017353 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9g6wh\" (UniqueName: \"kubernetes.io/projected/5d856ccc-313e-4833-8548-c8e34d0852ba-kube-api-access-9g6wh\") pod \"5d856ccc-313e-4833-8548-c8e34d0852ba\" (UID: \"5d856ccc-313e-4833-8548-c8e34d0852ba\") " Mar 16 16:37:05 crc kubenswrapper[5120]: I0316 16:37:05.024924 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d856ccc-313e-4833-8548-c8e34d0852ba-kube-api-access-9g6wh" (OuterVolumeSpecName: "kube-api-access-9g6wh") pod "5d856ccc-313e-4833-8548-c8e34d0852ba" (UID: "5d856ccc-313e-4833-8548-c8e34d0852ba"). InnerVolumeSpecName "kube-api-access-9g6wh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:37:05 crc kubenswrapper[5120]: I0316 16:37:05.031108 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d856ccc-313e-4833-8548-c8e34d0852ba-httpd-config" (OuterVolumeSpecName: "httpd-config") pod "5d856ccc-313e-4833-8548-c8e34d0852ba" (UID: "5d856ccc-313e-4833-8548-c8e34d0852ba"). InnerVolumeSpecName "httpd-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:05 crc kubenswrapper[5120]: I0316 16:37:05.110273 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d856ccc-313e-4833-8548-c8e34d0852ba-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "5d856ccc-313e-4833-8548-c8e34d0852ba" (UID: "5d856ccc-313e-4833-8548-c8e34d0852ba"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:05 crc kubenswrapper[5120]: I0316 16:37:05.120057 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9g6wh\" (UniqueName: \"kubernetes.io/projected/5d856ccc-313e-4833-8548-c8e34d0852ba-kube-api-access-9g6wh\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:05 crc kubenswrapper[5120]: I0316 16:37:05.120088 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/5d856ccc-313e-4833-8548-c8e34d0852ba-httpd-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:05 crc kubenswrapper[5120]: I0316 16:37:05.120098 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/5d856ccc-313e-4833-8548-c8e34d0852ba-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:05 crc kubenswrapper[5120]: I0316 16:37:05.127628 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d856ccc-313e-4833-8548-c8e34d0852ba-config" (OuterVolumeSpecName: "config") pod "5d856ccc-313e-4833-8548-c8e34d0852ba" (UID: "5d856ccc-313e-4833-8548-c8e34d0852ba"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:05 crc kubenswrapper[5120]: I0316 16:37:05.158618 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d856ccc-313e-4833-8548-c8e34d0852ba-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "5d856ccc-313e-4833-8548-c8e34d0852ba" (UID: "5d856ccc-313e-4833-8548-c8e34d0852ba"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:05 crc kubenswrapper[5120]: I0316 16:37:05.158955 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d856ccc-313e-4833-8548-c8e34d0852ba-ovndb-tls-certs" (OuterVolumeSpecName: "ovndb-tls-certs") pod "5d856ccc-313e-4833-8548-c8e34d0852ba" (UID: "5d856ccc-313e-4833-8548-c8e34d0852ba"). InnerVolumeSpecName "ovndb-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:05 crc kubenswrapper[5120]: I0316 16:37:05.165377 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/nova-api-0" podUID="b8725613-8c6b-4e92-9ff7-c9aeaff10f59" containerName="nova-api-log" probeResult="failure" output="Get \"https://10.217.0.203:8774/\": read tcp 10.217.0.2:59678->10.217.0.203:8774: read: connection reset by peer" Mar 16 16:37:05 crc kubenswrapper[5120]: I0316 16:37:05.166023 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/nova-api-0" podUID="b8725613-8c6b-4e92-9ff7-c9aeaff10f59" containerName="nova-api-api" probeResult="failure" output="Get \"https://10.217.0.203:8774/\": read tcp 10.217.0.2:59662->10.217.0.203:8774: read: connection reset by peer" Mar 16 16:37:05 crc kubenswrapper[5120]: I0316 16:37:05.208920 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d856ccc-313e-4833-8548-c8e34d0852ba-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "5d856ccc-313e-4833-8548-c8e34d0852ba" (UID: "5d856ccc-313e-4833-8548-c8e34d0852ba"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:05 crc kubenswrapper[5120]: I0316 16:37:05.222948 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/5d856ccc-313e-4833-8548-c8e34d0852ba-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:05 crc kubenswrapper[5120]: I0316 16:37:05.222983 5120 reconciler_common.go:299] "Volume detached for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/5d856ccc-313e-4833-8548-c8e34d0852ba-ovndb-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:05 crc kubenswrapper[5120]: I0316 16:37:05.222991 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5d856ccc-313e-4833-8548-c8e34d0852ba-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:05 crc kubenswrapper[5120]: I0316 16:37:05.223001 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/5d856ccc-313e-4833-8548-c8e34d0852ba-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:05 crc kubenswrapper[5120]: I0316 16:37:05.224394 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:37:05 crc kubenswrapper[5120]: I0316 16:37:05.358156 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:37:05 crc kubenswrapper[5120]: I0316 16:37:05.426966 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-78whc\" (UniqueName: \"kubernetes.io/projected/7c9566ce-4767-48d0-b606-410f234e9cf2-kube-api-access-78whc\") pod \"7c9566ce-4767-48d0-b606-410f234e9cf2\" (UID: \"7c9566ce-4767-48d0-b606-410f234e9cf2\") " Mar 16 16:37:05 crc kubenswrapper[5120]: I0316 16:37:05.427302 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7c9566ce-4767-48d0-b606-410f234e9cf2-config-data\") pod \"7c9566ce-4767-48d0-b606-410f234e9cf2\" (UID: \"7c9566ce-4767-48d0-b606-410f234e9cf2\") " Mar 16 16:37:05 crc kubenswrapper[5120]: I0316 16:37:05.427487 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7c9566ce-4767-48d0-b606-410f234e9cf2-combined-ca-bundle\") pod \"7c9566ce-4767-48d0-b606-410f234e9cf2\" (UID: \"7c9566ce-4767-48d0-b606-410f234e9cf2\") " Mar 16 16:37:05 crc kubenswrapper[5120]: I0316 16:37:05.434738 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c9566ce-4767-48d0-b606-410f234e9cf2-kube-api-access-78whc" (OuterVolumeSpecName: "kube-api-access-78whc") pod "7c9566ce-4767-48d0-b606-410f234e9cf2" (UID: "7c9566ce-4767-48d0-b606-410f234e9cf2"). InnerVolumeSpecName "kube-api-access-78whc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:37:05 crc kubenswrapper[5120]: I0316 16:37:05.458907 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c9566ce-4767-48d0-b606-410f234e9cf2-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "7c9566ce-4767-48d0-b606-410f234e9cf2" (UID: "7c9566ce-4767-48d0-b606-410f234e9cf2"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:05 crc kubenswrapper[5120]: I0316 16:37:05.463095 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c9566ce-4767-48d0-b606-410f234e9cf2-config-data" (OuterVolumeSpecName: "config-data") pod "7c9566ce-4767-48d0-b606-410f234e9cf2" (UID: "7c9566ce-4767-48d0-b606-410f234e9cf2"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:05 crc kubenswrapper[5120]: I0316 16:37:05.531198 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7c9566ce-4767-48d0-b606-410f234e9cf2-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:05 crc kubenswrapper[5120]: I0316 16:37:05.531239 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-78whc\" (UniqueName: \"kubernetes.io/projected/7c9566ce-4767-48d0-b606-410f234e9cf2-kube-api-access-78whc\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:05 crc kubenswrapper[5120]: I0316 16:37:05.531255 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7c9566ce-4767-48d0-b606-410f234e9cf2-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:05 crc kubenswrapper[5120]: I0316 16:37:05.711279 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:37:05 crc kubenswrapper[5120]: I0316 16:37:05.793159 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-5465fdbb4f-kmfhc" event={"ID":"5d856ccc-313e-4833-8548-c8e34d0852ba","Type":"ContainerDied","Data":"943524f8530ee8c8b122880c51a1f6701ca93daebf74b3769cd36788492d564d"} Mar 16 16:37:05 crc kubenswrapper[5120]: I0316 16:37:05.793205 5120 scope.go:117] "RemoveContainer" containerID="919fbcb5f5c708d3d71add68a29194c1b6ef9cd341c8a87d23bcd6654768a044" Mar 16 16:37:05 crc kubenswrapper[5120]: I0316 16:37:05.793348 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-5465fdbb4f-kmfhc" Mar 16 16:37:05 crc kubenswrapper[5120]: I0316 16:37:05.807999 5120 generic.go:358] "Generic (PLEG): container finished" podID="7c9566ce-4767-48d0-b606-410f234e9cf2" containerID="c8679e06fbfeaddd2c356f909c632c829f8292eb82529143e243db09bd7464c4" exitCode=0 Mar 16 16:37:05 crc kubenswrapper[5120]: I0316 16:37:05.808263 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"7c9566ce-4767-48d0-b606-410f234e9cf2","Type":"ContainerDied","Data":"c8679e06fbfeaddd2c356f909c632c829f8292eb82529143e243db09bd7464c4"} Mar 16 16:37:05 crc kubenswrapper[5120]: I0316 16:37:05.808295 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"7c9566ce-4767-48d0-b606-410f234e9cf2","Type":"ContainerDied","Data":"0c257097cf1710fe8e76fd71e1a50ae1ef3386729944ea929385fe7c496743ba"} Mar 16 16:37:05 crc kubenswrapper[5120]: I0316 16:37:05.808368 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:37:05 crc kubenswrapper[5120]: I0316 16:37:05.826228 5120 generic.go:358] "Generic (PLEG): container finished" podID="7c83e22b-e8f6-4228-95a3-9874368d9534" containerID="e163ad55192dbc5251d5fc25b1137a1e6ec11964a33c4a5ec18c748abe611356" exitCode=0 Mar 16 16:37:05 crc kubenswrapper[5120]: I0316 16:37:05.826373 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"7c83e22b-e8f6-4228-95a3-9874368d9534","Type":"ContainerDied","Data":"e163ad55192dbc5251d5fc25b1137a1e6ec11964a33c4a5ec18c748abe611356"} Mar 16 16:37:05 crc kubenswrapper[5120]: I0316 16:37:05.829621 5120 generic.go:358] "Generic (PLEG): container finished" podID="b8725613-8c6b-4e92-9ff7-c9aeaff10f59" containerID="a165c25cb76cda11d364c5b15d44fa2906e650d5ab895aacb333f78bb6096ffd" exitCode=0 Mar 16 16:37:05 crc kubenswrapper[5120]: I0316 16:37:05.831071 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:37:05 crc kubenswrapper[5120]: I0316 16:37:05.831844 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"b8725613-8c6b-4e92-9ff7-c9aeaff10f59","Type":"ContainerDied","Data":"a165c25cb76cda11d364c5b15d44fa2906e650d5ab895aacb333f78bb6096ffd"} Mar 16 16:37:05 crc kubenswrapper[5120]: I0316 16:37:05.831894 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"b8725613-8c6b-4e92-9ff7-c9aeaff10f59","Type":"ContainerDied","Data":"58e739bc89d877dac70ed7b3bccba27ad38c34c8e98da1d1e25e48172e23f42a"} Mar 16 16:37:05 crc kubenswrapper[5120]: I0316 16:37:05.839845 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-5465fdbb4f-kmfhc"] Mar 16 16:37:05 crc kubenswrapper[5120]: I0316 16:37:05.842859 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mfdvh\" (UniqueName: \"kubernetes.io/projected/b8725613-8c6b-4e92-9ff7-c9aeaff10f59-kube-api-access-mfdvh\") pod \"b8725613-8c6b-4e92-9ff7-c9aeaff10f59\" (UID: \"b8725613-8c6b-4e92-9ff7-c9aeaff10f59\") " Mar 16 16:37:05 crc kubenswrapper[5120]: I0316 16:37:05.842948 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b8725613-8c6b-4e92-9ff7-c9aeaff10f59-combined-ca-bundle\") pod \"b8725613-8c6b-4e92-9ff7-c9aeaff10f59\" (UID: \"b8725613-8c6b-4e92-9ff7-c9aeaff10f59\") " Mar 16 16:37:05 crc kubenswrapper[5120]: I0316 16:37:05.843034 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b8725613-8c6b-4e92-9ff7-c9aeaff10f59-logs\") pod \"b8725613-8c6b-4e92-9ff7-c9aeaff10f59\" (UID: \"b8725613-8c6b-4e92-9ff7-c9aeaff10f59\") " Mar 16 16:37:05 crc kubenswrapper[5120]: I0316 16:37:05.843167 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b8725613-8c6b-4e92-9ff7-c9aeaff10f59-config-data\") pod \"b8725613-8c6b-4e92-9ff7-c9aeaff10f59\" (UID: \"b8725613-8c6b-4e92-9ff7-c9aeaff10f59\") " Mar 16 16:37:05 crc kubenswrapper[5120]: I0316 16:37:05.843194 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/b8725613-8c6b-4e92-9ff7-c9aeaff10f59-internal-tls-certs\") pod \"b8725613-8c6b-4e92-9ff7-c9aeaff10f59\" (UID: \"b8725613-8c6b-4e92-9ff7-c9aeaff10f59\") " Mar 16 16:37:05 crc kubenswrapper[5120]: I0316 16:37:05.843578 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/b8725613-8c6b-4e92-9ff7-c9aeaff10f59-public-tls-certs\") pod \"b8725613-8c6b-4e92-9ff7-c9aeaff10f59\" (UID: \"b8725613-8c6b-4e92-9ff7-c9aeaff10f59\") " Mar 16 16:37:05 crc kubenswrapper[5120]: I0316 16:37:05.845398 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8725613-8c6b-4e92-9ff7-c9aeaff10f59-logs" (OuterVolumeSpecName: "logs") pod "b8725613-8c6b-4e92-9ff7-c9aeaff10f59" (UID: "b8725613-8c6b-4e92-9ff7-c9aeaff10f59"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:37:05 crc kubenswrapper[5120]: I0316 16:37:05.849647 5120 scope.go:117] "RemoveContainer" containerID="0c7a14a52c399c07522843c53d42edbfe74d08ad0b9dd13a8dc530c5065e6623" Mar 16 16:37:05 crc kubenswrapper[5120]: I0316 16:37:05.855112 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-5465fdbb4f-kmfhc"] Mar 16 16:37:05 crc kubenswrapper[5120]: I0316 16:37:05.872157 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:37:05 crc kubenswrapper[5120]: I0316 16:37:05.877411 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8725613-8c6b-4e92-9ff7-c9aeaff10f59-kube-api-access-mfdvh" (OuterVolumeSpecName: "kube-api-access-mfdvh") pod "b8725613-8c6b-4e92-9ff7-c9aeaff10f59" (UID: "b8725613-8c6b-4e92-9ff7-c9aeaff10f59"). InnerVolumeSpecName "kube-api-access-mfdvh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:37:05 crc kubenswrapper[5120]: I0316 16:37:05.897339 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:37:05 crc kubenswrapper[5120]: I0316 16:37:05.909083 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b8725613-8c6b-4e92-9ff7-c9aeaff10f59-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "b8725613-8c6b-4e92-9ff7-c9aeaff10f59" (UID: "b8725613-8c6b-4e92-9ff7-c9aeaff10f59"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:05 crc kubenswrapper[5120]: I0316 16:37:05.910533 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:37:05 crc kubenswrapper[5120]: I0316 16:37:05.910881 5120 scope.go:117] "RemoveContainer" containerID="c8679e06fbfeaddd2c356f909c632c829f8292eb82529143e243db09bd7464c4" Mar 16 16:37:05 crc kubenswrapper[5120]: I0316 16:37:05.912066 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d856ccc-313e-4833-8548-c8e34d0852ba" containerName="neutron-api" Mar 16 16:37:05 crc kubenswrapper[5120]: I0316 16:37:05.912091 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d856ccc-313e-4833-8548-c8e34d0852ba" containerName="neutron-api" Mar 16 16:37:05 crc kubenswrapper[5120]: I0316 16:37:05.912134 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8725613-8c6b-4e92-9ff7-c9aeaff10f59" containerName="nova-api-log" Mar 16 16:37:05 crc kubenswrapper[5120]: I0316 16:37:05.912141 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8725613-8c6b-4e92-9ff7-c9aeaff10f59" containerName="nova-api-log" Mar 16 16:37:05 crc kubenswrapper[5120]: I0316 16:37:05.912217 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c9566ce-4767-48d0-b606-410f234e9cf2" containerName="nova-scheduler-scheduler" Mar 16 16:37:05 crc kubenswrapper[5120]: I0316 16:37:05.912225 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c9566ce-4767-48d0-b606-410f234e9cf2" containerName="nova-scheduler-scheduler" Mar 16 16:37:05 crc kubenswrapper[5120]: I0316 16:37:05.912235 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8725613-8c6b-4e92-9ff7-c9aeaff10f59" containerName="nova-api-api" Mar 16 16:37:05 crc kubenswrapper[5120]: I0316 16:37:05.912242 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8725613-8c6b-4e92-9ff7-c9aeaff10f59" containerName="nova-api-api" Mar 16 16:37:05 crc kubenswrapper[5120]: I0316 16:37:05.912253 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d856ccc-313e-4833-8548-c8e34d0852ba" containerName="neutron-httpd" Mar 16 16:37:05 crc kubenswrapper[5120]: I0316 16:37:05.912260 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d856ccc-313e-4833-8548-c8e34d0852ba" containerName="neutron-httpd" Mar 16 16:37:05 crc kubenswrapper[5120]: I0316 16:37:05.912484 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="5d856ccc-313e-4833-8548-c8e34d0852ba" containerName="neutron-api" Mar 16 16:37:05 crc kubenswrapper[5120]: I0316 16:37:05.912501 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7c9566ce-4767-48d0-b606-410f234e9cf2" containerName="nova-scheduler-scheduler" Mar 16 16:37:05 crc kubenswrapper[5120]: I0316 16:37:05.912521 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="5d856ccc-313e-4833-8548-c8e34d0852ba" containerName="neutron-httpd" Mar 16 16:37:05 crc kubenswrapper[5120]: I0316 16:37:05.912531 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="b8725613-8c6b-4e92-9ff7-c9aeaff10f59" containerName="nova-api-log" Mar 16 16:37:05 crc kubenswrapper[5120]: I0316 16:37:05.912546 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="b8725613-8c6b-4e92-9ff7-c9aeaff10f59" containerName="nova-api-api" Mar 16 16:37:05 crc kubenswrapper[5120]: I0316 16:37:05.928883 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:37:05 crc kubenswrapper[5120]: I0316 16:37:05.936950 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b8725613-8c6b-4e92-9ff7-c9aeaff10f59-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "b8725613-8c6b-4e92-9ff7-c9aeaff10f59" (UID: "b8725613-8c6b-4e92-9ff7-c9aeaff10f59"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:05 crc kubenswrapper[5120]: I0316 16:37:05.946204 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/b8725613-8c6b-4e92-9ff7-c9aeaff10f59-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:05 crc kubenswrapper[5120]: I0316 16:37:05.946235 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mfdvh\" (UniqueName: \"kubernetes.io/projected/b8725613-8c6b-4e92-9ff7-c9aeaff10f59-kube-api-access-mfdvh\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:05 crc kubenswrapper[5120]: I0316 16:37:05.946246 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b8725613-8c6b-4e92-9ff7-c9aeaff10f59-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:05 crc kubenswrapper[5120]: I0316 16:37:05.946258 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b8725613-8c6b-4e92-9ff7-c9aeaff10f59-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:05 crc kubenswrapper[5120]: I0316 16:37:05.952168 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:37:05 crc kubenswrapper[5120]: I0316 16:37:05.952331 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:37:05 crc kubenswrapper[5120]: I0316 16:37:05.956957 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b8725613-8c6b-4e92-9ff7-c9aeaff10f59-config-data" (OuterVolumeSpecName: "config-data") pod "b8725613-8c6b-4e92-9ff7-c9aeaff10f59" (UID: "b8725613-8c6b-4e92-9ff7-c9aeaff10f59"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:05 crc kubenswrapper[5120]: I0316 16:37:05.963140 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-scheduler-config-data\"" Mar 16 16:37:05 crc kubenswrapper[5120]: I0316 16:37:05.987295 5120 scope.go:117] "RemoveContainer" containerID="c8679e06fbfeaddd2c356f909c632c829f8292eb82529143e243db09bd7464c4" Mar 16 16:37:05 crc kubenswrapper[5120]: E0316 16:37:05.993052 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c8679e06fbfeaddd2c356f909c632c829f8292eb82529143e243db09bd7464c4\": container with ID starting with c8679e06fbfeaddd2c356f909c632c829f8292eb82529143e243db09bd7464c4 not found: ID does not exist" containerID="c8679e06fbfeaddd2c356f909c632c829f8292eb82529143e243db09bd7464c4" Mar 16 16:37:05 crc kubenswrapper[5120]: I0316 16:37:05.993101 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8679e06fbfeaddd2c356f909c632c829f8292eb82529143e243db09bd7464c4"} err="failed to get container status \"c8679e06fbfeaddd2c356f909c632c829f8292eb82529143e243db09bd7464c4\": rpc error: code = NotFound desc = could not find container \"c8679e06fbfeaddd2c356f909c632c829f8292eb82529143e243db09bd7464c4\": container with ID starting with c8679e06fbfeaddd2c356f909c632c829f8292eb82529143e243db09bd7464c4 not found: ID does not exist" Mar 16 16:37:05 crc kubenswrapper[5120]: I0316 16:37:05.993125 5120 scope.go:117] "RemoveContainer" containerID="a165c25cb76cda11d364c5b15d44fa2906e650d5ab895aacb333f78bb6096ffd" Mar 16 16:37:06 crc kubenswrapper[5120]: I0316 16:37:05.999685 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/placement-747d4cf944-dk26n" Mar 16 16:37:06 crc kubenswrapper[5120]: I0316 16:37:06.014012 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b8725613-8c6b-4e92-9ff7-c9aeaff10f59-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "b8725613-8c6b-4e92-9ff7-c9aeaff10f59" (UID: "b8725613-8c6b-4e92-9ff7-c9aeaff10f59"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:06 crc kubenswrapper[5120]: I0316 16:37:06.041209 5120 scope.go:117] "RemoveContainer" containerID="43ff2c8b27976e7f451cd3418a68822e68a6023ebdb30af40b8cdec7cec06b55" Mar 16 16:37:06 crc kubenswrapper[5120]: I0316 16:37:06.047240 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7c83e22b-e8f6-4228-95a3-9874368d9534-logs\") pod \"7c83e22b-e8f6-4228-95a3-9874368d9534\" (UID: \"7c83e22b-e8f6-4228-95a3-9874368d9534\") " Mar 16 16:37:06 crc kubenswrapper[5120]: I0316 16:37:06.047344 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7c83e22b-e8f6-4228-95a3-9874368d9534-config-data\") pod \"7c83e22b-e8f6-4228-95a3-9874368d9534\" (UID: \"7c83e22b-e8f6-4228-95a3-9874368d9534\") " Mar 16 16:37:06 crc kubenswrapper[5120]: I0316 16:37:06.047505 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/7c83e22b-e8f6-4228-95a3-9874368d9534-nova-metadata-tls-certs\") pod \"7c83e22b-e8f6-4228-95a3-9874368d9534\" (UID: \"7c83e22b-e8f6-4228-95a3-9874368d9534\") " Mar 16 16:37:06 crc kubenswrapper[5120]: I0316 16:37:06.047591 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mhwz9\" (UniqueName: \"kubernetes.io/projected/7c83e22b-e8f6-4228-95a3-9874368d9534-kube-api-access-mhwz9\") pod \"7c83e22b-e8f6-4228-95a3-9874368d9534\" (UID: \"7c83e22b-e8f6-4228-95a3-9874368d9534\") " Mar 16 16:37:06 crc kubenswrapper[5120]: I0316 16:37:06.047788 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7c83e22b-e8f6-4228-95a3-9874368d9534-combined-ca-bundle\") pod \"7c83e22b-e8f6-4228-95a3-9874368d9534\" (UID: \"7c83e22b-e8f6-4228-95a3-9874368d9534\") " Mar 16 16:37:06 crc kubenswrapper[5120]: I0316 16:37:06.048136 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zz5p7\" (UniqueName: \"kubernetes.io/projected/7593b082-fbd5-4f23-9b9b-8ee3d2a559d4-kube-api-access-zz5p7\") pod \"nova-scheduler-0\" (UID: \"7593b082-fbd5-4f23-9b9b-8ee3d2a559d4\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:37:06 crc kubenswrapper[5120]: I0316 16:37:06.048294 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7593b082-fbd5-4f23-9b9b-8ee3d2a559d4-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"7593b082-fbd5-4f23-9b9b-8ee3d2a559d4\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:37:06 crc kubenswrapper[5120]: I0316 16:37:06.048348 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7593b082-fbd5-4f23-9b9b-8ee3d2a559d4-config-data\") pod \"nova-scheduler-0\" (UID: \"7593b082-fbd5-4f23-9b9b-8ee3d2a559d4\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:37:06 crc kubenswrapper[5120]: I0316 16:37:06.048404 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b8725613-8c6b-4e92-9ff7-c9aeaff10f59-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:06 crc kubenswrapper[5120]: I0316 16:37:06.048417 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/b8725613-8c6b-4e92-9ff7-c9aeaff10f59-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:06 crc kubenswrapper[5120]: I0316 16:37:06.048786 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c83e22b-e8f6-4228-95a3-9874368d9534-logs" (OuterVolumeSpecName: "logs") pod "7c83e22b-e8f6-4228-95a3-9874368d9534" (UID: "7c83e22b-e8f6-4228-95a3-9874368d9534"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:37:06 crc kubenswrapper[5120]: I0316 16:37:06.054522 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c83e22b-e8f6-4228-95a3-9874368d9534-kube-api-access-mhwz9" (OuterVolumeSpecName: "kube-api-access-mhwz9") pod "7c83e22b-e8f6-4228-95a3-9874368d9534" (UID: "7c83e22b-e8f6-4228-95a3-9874368d9534"). InnerVolumeSpecName "kube-api-access-mhwz9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:37:06 crc kubenswrapper[5120]: I0316 16:37:06.078880 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c83e22b-e8f6-4228-95a3-9874368d9534-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "7c83e22b-e8f6-4228-95a3-9874368d9534" (UID: "7c83e22b-e8f6-4228-95a3-9874368d9534"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:06 crc kubenswrapper[5120]: I0316 16:37:06.107564 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c83e22b-e8f6-4228-95a3-9874368d9534-config-data" (OuterVolumeSpecName: "config-data") pod "7c83e22b-e8f6-4228-95a3-9874368d9534" (UID: "7c83e22b-e8f6-4228-95a3-9874368d9534"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:06 crc kubenswrapper[5120]: I0316 16:37:06.111885 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c83e22b-e8f6-4228-95a3-9874368d9534-nova-metadata-tls-certs" (OuterVolumeSpecName: "nova-metadata-tls-certs") pod "7c83e22b-e8f6-4228-95a3-9874368d9534" (UID: "7c83e22b-e8f6-4228-95a3-9874368d9534"). InnerVolumeSpecName "nova-metadata-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:06 crc kubenswrapper[5120]: I0316 16:37:06.150569 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7593b082-fbd5-4f23-9b9b-8ee3d2a559d4-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"7593b082-fbd5-4f23-9b9b-8ee3d2a559d4\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:37:06 crc kubenswrapper[5120]: I0316 16:37:06.150671 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7593b082-fbd5-4f23-9b9b-8ee3d2a559d4-config-data\") pod \"nova-scheduler-0\" (UID: \"7593b082-fbd5-4f23-9b9b-8ee3d2a559d4\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:37:06 crc kubenswrapper[5120]: I0316 16:37:06.151045 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zz5p7\" (UniqueName: \"kubernetes.io/projected/7593b082-fbd5-4f23-9b9b-8ee3d2a559d4-kube-api-access-zz5p7\") pod \"nova-scheduler-0\" (UID: \"7593b082-fbd5-4f23-9b9b-8ee3d2a559d4\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:37:06 crc kubenswrapper[5120]: I0316 16:37:06.151370 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7c83e22b-e8f6-4228-95a3-9874368d9534-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:06 crc kubenswrapper[5120]: I0316 16:37:06.151399 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7c83e22b-e8f6-4228-95a3-9874368d9534-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:06 crc kubenswrapper[5120]: I0316 16:37:06.151409 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7c83e22b-e8f6-4228-95a3-9874368d9534-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:06 crc kubenswrapper[5120]: I0316 16:37:06.151419 5120 reconciler_common.go:299] "Volume detached for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/7c83e22b-e8f6-4228-95a3-9874368d9534-nova-metadata-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:06 crc kubenswrapper[5120]: I0316 16:37:06.151431 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mhwz9\" (UniqueName: \"kubernetes.io/projected/7c83e22b-e8f6-4228-95a3-9874368d9534-kube-api-access-mhwz9\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:06 crc kubenswrapper[5120]: I0316 16:37:06.157691 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7593b082-fbd5-4f23-9b9b-8ee3d2a559d4-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"7593b082-fbd5-4f23-9b9b-8ee3d2a559d4\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:37:06 crc kubenswrapper[5120]: I0316 16:37:06.158132 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7593b082-fbd5-4f23-9b9b-8ee3d2a559d4-config-data\") pod \"nova-scheduler-0\" (UID: \"7593b082-fbd5-4f23-9b9b-8ee3d2a559d4\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:37:06 crc kubenswrapper[5120]: I0316 16:37:06.168469 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zz5p7\" (UniqueName: \"kubernetes.io/projected/7593b082-fbd5-4f23-9b9b-8ee3d2a559d4-kube-api-access-zz5p7\") pod \"nova-scheduler-0\" (UID: \"7593b082-fbd5-4f23-9b9b-8ee3d2a559d4\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:37:06 crc kubenswrapper[5120]: I0316 16:37:06.275478 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:37:06 crc kubenswrapper[5120]: I0316 16:37:06.281206 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:37:06 crc kubenswrapper[5120]: I0316 16:37:06.308914 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:37:06 crc kubenswrapper[5120]: I0316 16:37:06.310458 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c83e22b-e8f6-4228-95a3-9874368d9534" containerName="nova-metadata-metadata" Mar 16 16:37:06 crc kubenswrapper[5120]: I0316 16:37:06.310487 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c83e22b-e8f6-4228-95a3-9874368d9534" containerName="nova-metadata-metadata" Mar 16 16:37:06 crc kubenswrapper[5120]: I0316 16:37:06.310530 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c83e22b-e8f6-4228-95a3-9874368d9534" containerName="nova-metadata-log" Mar 16 16:37:06 crc kubenswrapper[5120]: I0316 16:37:06.310538 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c83e22b-e8f6-4228-95a3-9874368d9534" containerName="nova-metadata-log" Mar 16 16:37:06 crc kubenswrapper[5120]: I0316 16:37:06.310787 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7c83e22b-e8f6-4228-95a3-9874368d9534" containerName="nova-metadata-metadata" Mar 16 16:37:06 crc kubenswrapper[5120]: I0316 16:37:06.310824 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7c83e22b-e8f6-4228-95a3-9874368d9534" containerName="nova-metadata-log" Mar 16 16:37:06 crc kubenswrapper[5120]: I0316 16:37:06.398753 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:37:06 crc kubenswrapper[5120]: I0316 16:37:06.411521 5120 scope.go:117] "RemoveContainer" containerID="a165c25cb76cda11d364c5b15d44fa2906e650d5ab895aacb333f78bb6096ffd" Mar 16 16:37:06 crc kubenswrapper[5120]: E0316 16:37:06.412067 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a165c25cb76cda11d364c5b15d44fa2906e650d5ab895aacb333f78bb6096ffd\": container with ID starting with a165c25cb76cda11d364c5b15d44fa2906e650d5ab895aacb333f78bb6096ffd not found: ID does not exist" containerID="a165c25cb76cda11d364c5b15d44fa2906e650d5ab895aacb333f78bb6096ffd" Mar 16 16:37:06 crc kubenswrapper[5120]: I0316 16:37:06.412187 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a165c25cb76cda11d364c5b15d44fa2906e650d5ab895aacb333f78bb6096ffd"} err="failed to get container status \"a165c25cb76cda11d364c5b15d44fa2906e650d5ab895aacb333f78bb6096ffd\": rpc error: code = NotFound desc = could not find container \"a165c25cb76cda11d364c5b15d44fa2906e650d5ab895aacb333f78bb6096ffd\": container with ID starting with a165c25cb76cda11d364c5b15d44fa2906e650d5ab895aacb333f78bb6096ffd not found: ID does not exist" Mar 16 16:37:06 crc kubenswrapper[5120]: I0316 16:37:06.412299 5120 scope.go:117] "RemoveContainer" containerID="43ff2c8b27976e7f451cd3418a68822e68a6023ebdb30af40b8cdec7cec06b55" Mar 16 16:37:06 crc kubenswrapper[5120]: E0316 16:37:06.412952 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"43ff2c8b27976e7f451cd3418a68822e68a6023ebdb30af40b8cdec7cec06b55\": container with ID starting with 43ff2c8b27976e7f451cd3418a68822e68a6023ebdb30af40b8cdec7cec06b55 not found: ID does not exist" containerID="43ff2c8b27976e7f451cd3418a68822e68a6023ebdb30af40b8cdec7cec06b55" Mar 16 16:37:06 crc kubenswrapper[5120]: I0316 16:37:06.413090 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43ff2c8b27976e7f451cd3418a68822e68a6023ebdb30af40b8cdec7cec06b55"} err="failed to get container status \"43ff2c8b27976e7f451cd3418a68822e68a6023ebdb30af40b8cdec7cec06b55\": rpc error: code = NotFound desc = could not find container \"43ff2c8b27976e7f451cd3418a68822e68a6023ebdb30af40b8cdec7cec06b55\": container with ID starting with 43ff2c8b27976e7f451cd3418a68822e68a6023ebdb30af40b8cdec7cec06b55 not found: ID does not exist" Mar 16 16:37:06 crc kubenswrapper[5120]: I0316 16:37:06.427174 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:37:06 crc kubenswrapper[5120]: I0316 16:37:06.427376 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:37:06 crc kubenswrapper[5120]: I0316 16:37:06.434240 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-internal-svc\"" Mar 16 16:37:06 crc kubenswrapper[5120]: I0316 16:37:06.434469 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-public-svc\"" Mar 16 16:37:06 crc kubenswrapper[5120]: I0316 16:37:06.434571 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-config-data\"" Mar 16 16:37:06 crc kubenswrapper[5120]: I0316 16:37:06.503617 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e8b9ac0b-60ab-4b23-a6ab-766adba26d26-config-data\") pod \"nova-api-0\" (UID: \"e8b9ac0b-60ab-4b23-a6ab-766adba26d26\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:37:06 crc kubenswrapper[5120]: I0316 16:37:06.503778 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e8b9ac0b-60ab-4b23-a6ab-766adba26d26-logs\") pod \"nova-api-0\" (UID: \"e8b9ac0b-60ab-4b23-a6ab-766adba26d26\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:37:06 crc kubenswrapper[5120]: I0316 16:37:06.504091 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e8b9ac0b-60ab-4b23-a6ab-766adba26d26-internal-tls-certs\") pod \"nova-api-0\" (UID: \"e8b9ac0b-60ab-4b23-a6ab-766adba26d26\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:37:06 crc kubenswrapper[5120]: I0316 16:37:06.504245 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e8b9ac0b-60ab-4b23-a6ab-766adba26d26-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"e8b9ac0b-60ab-4b23-a6ab-766adba26d26\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:37:06 crc kubenswrapper[5120]: I0316 16:37:06.504399 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e8b9ac0b-60ab-4b23-a6ab-766adba26d26-public-tls-certs\") pod \"nova-api-0\" (UID: \"e8b9ac0b-60ab-4b23-a6ab-766adba26d26\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:37:06 crc kubenswrapper[5120]: I0316 16:37:06.504492 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcsgr\" (UniqueName: \"kubernetes.io/projected/e8b9ac0b-60ab-4b23-a6ab-766adba26d26-kube-api-access-xcsgr\") pod \"nova-api-0\" (UID: \"e8b9ac0b-60ab-4b23-a6ab-766adba26d26\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:37:06 crc kubenswrapper[5120]: I0316 16:37:06.606674 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e8b9ac0b-60ab-4b23-a6ab-766adba26d26-internal-tls-certs\") pod \"nova-api-0\" (UID: \"e8b9ac0b-60ab-4b23-a6ab-766adba26d26\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:37:06 crc kubenswrapper[5120]: I0316 16:37:06.606750 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e8b9ac0b-60ab-4b23-a6ab-766adba26d26-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"e8b9ac0b-60ab-4b23-a6ab-766adba26d26\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:37:06 crc kubenswrapper[5120]: I0316 16:37:06.606858 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e8b9ac0b-60ab-4b23-a6ab-766adba26d26-public-tls-certs\") pod \"nova-api-0\" (UID: \"e8b9ac0b-60ab-4b23-a6ab-766adba26d26\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:37:06 crc kubenswrapper[5120]: I0316 16:37:06.607916 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xcsgr\" (UniqueName: \"kubernetes.io/projected/e8b9ac0b-60ab-4b23-a6ab-766adba26d26-kube-api-access-xcsgr\") pod \"nova-api-0\" (UID: \"e8b9ac0b-60ab-4b23-a6ab-766adba26d26\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:37:06 crc kubenswrapper[5120]: I0316 16:37:06.608041 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e8b9ac0b-60ab-4b23-a6ab-766adba26d26-config-data\") pod \"nova-api-0\" (UID: \"e8b9ac0b-60ab-4b23-a6ab-766adba26d26\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:37:06 crc kubenswrapper[5120]: I0316 16:37:06.608174 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e8b9ac0b-60ab-4b23-a6ab-766adba26d26-logs\") pod \"nova-api-0\" (UID: \"e8b9ac0b-60ab-4b23-a6ab-766adba26d26\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:37:06 crc kubenswrapper[5120]: I0316 16:37:06.608560 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e8b9ac0b-60ab-4b23-a6ab-766adba26d26-logs\") pod \"nova-api-0\" (UID: \"e8b9ac0b-60ab-4b23-a6ab-766adba26d26\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:37:06 crc kubenswrapper[5120]: I0316 16:37:06.613620 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e8b9ac0b-60ab-4b23-a6ab-766adba26d26-config-data\") pod \"nova-api-0\" (UID: \"e8b9ac0b-60ab-4b23-a6ab-766adba26d26\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:37:06 crc kubenswrapper[5120]: I0316 16:37:06.624978 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e8b9ac0b-60ab-4b23-a6ab-766adba26d26-internal-tls-certs\") pod \"nova-api-0\" (UID: \"e8b9ac0b-60ab-4b23-a6ab-766adba26d26\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:37:06 crc kubenswrapper[5120]: I0316 16:37:06.625423 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e8b9ac0b-60ab-4b23-a6ab-766adba26d26-public-tls-certs\") pod \"nova-api-0\" (UID: \"e8b9ac0b-60ab-4b23-a6ab-766adba26d26\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:37:06 crc kubenswrapper[5120]: I0316 16:37:06.625996 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e8b9ac0b-60ab-4b23-a6ab-766adba26d26-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"e8b9ac0b-60ab-4b23-a6ab-766adba26d26\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:37:06 crc kubenswrapper[5120]: I0316 16:37:06.639421 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcsgr\" (UniqueName: \"kubernetes.io/projected/e8b9ac0b-60ab-4b23-a6ab-766adba26d26-kube-api-access-xcsgr\") pod \"nova-api-0\" (UID: \"e8b9ac0b-60ab-4b23-a6ab-766adba26d26\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:37:06 crc kubenswrapper[5120]: I0316 16:37:06.681774 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d856ccc-313e-4833-8548-c8e34d0852ba" path="/var/lib/kubelet/pods/5d856ccc-313e-4833-8548-c8e34d0852ba/volumes" Mar 16 16:37:06 crc kubenswrapper[5120]: I0316 16:37:06.682704 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c9566ce-4767-48d0-b606-410f234e9cf2" path="/var/lib/kubelet/pods/7c9566ce-4767-48d0-b606-410f234e9cf2/volumes" Mar 16 16:37:06 crc kubenswrapper[5120]: I0316 16:37:06.683255 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b8725613-8c6b-4e92-9ff7-c9aeaff10f59" path="/var/lib/kubelet/pods/b8725613-8c6b-4e92-9ff7-c9aeaff10f59/volumes" Mar 16 16:37:06 crc kubenswrapper[5120]: I0316 16:37:06.835299 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:37:06 crc kubenswrapper[5120]: I0316 16:37:06.858342 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"7c83e22b-e8f6-4228-95a3-9874368d9534","Type":"ContainerDied","Data":"1c6134df54d185a21d062fe534fe2a2028b396e9dbc9a309606244cd6d3350e4"} Mar 16 16:37:06 crc kubenswrapper[5120]: I0316 16:37:06.858408 5120 scope.go:117] "RemoveContainer" containerID="e163ad55192dbc5251d5fc25b1137a1e6ec11964a33c4a5ec18c748abe611356" Mar 16 16:37:06 crc kubenswrapper[5120]: I0316 16:37:06.858573 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:37:06 crc kubenswrapper[5120]: I0316 16:37:06.895087 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:37:06 crc kubenswrapper[5120]: I0316 16:37:06.913308 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:37:06 crc kubenswrapper[5120]: I0316 16:37:06.943328 5120 scope.go:117] "RemoveContainer" containerID="abde150290ce828331e2e06b6c3eda33f7634800c0fb62b8fb73b6774f0bbfd7" Mar 16 16:37:06 crc kubenswrapper[5120]: I0316 16:37:06.955642 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:37:06 crc kubenswrapper[5120]: W0316 16:37:06.958000 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7593b082_fbd5_4f23_9b9b_8ee3d2a559d4.slice/crio-5aacbdef993fdeac9897d5de5bfc9af940a3cf3007c93d689edb2aff8d80c7e6 WatchSource:0}: Error finding container 5aacbdef993fdeac9897d5de5bfc9af940a3cf3007c93d689edb2aff8d80c7e6: Status 404 returned error can't find the container with id 5aacbdef993fdeac9897d5de5bfc9af940a3cf3007c93d689edb2aff8d80c7e6 Mar 16 16:37:06 crc kubenswrapper[5120]: I0316 16:37:06.975156 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:37:07 crc kubenswrapper[5120]: I0316 16:37:07.042435 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:37:07 crc kubenswrapper[5120]: I0316 16:37:07.042662 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:37:07 crc kubenswrapper[5120]: I0316 16:37:07.048265 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-metadata-internal-svc\"" Mar 16 16:37:07 crc kubenswrapper[5120]: I0316 16:37:07.048274 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-metadata-config-data\"" Mar 16 16:37:07 crc kubenswrapper[5120]: I0316 16:37:07.120577 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/56ab5925-779b-43f4-89e6-27226d0363db-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"56ab5925-779b-43f4-89e6-27226d0363db\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:37:07 crc kubenswrapper[5120]: I0316 16:37:07.120990 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/56ab5925-779b-43f4-89e6-27226d0363db-logs\") pod \"nova-metadata-0\" (UID: \"56ab5925-779b-43f4-89e6-27226d0363db\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:37:07 crc kubenswrapper[5120]: I0316 16:37:07.121057 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kbzp\" (UniqueName: \"kubernetes.io/projected/56ab5925-779b-43f4-89e6-27226d0363db-kube-api-access-2kbzp\") pod \"nova-metadata-0\" (UID: \"56ab5925-779b-43f4-89e6-27226d0363db\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:37:07 crc kubenswrapper[5120]: I0316 16:37:07.121273 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/56ab5925-779b-43f4-89e6-27226d0363db-config-data\") pod \"nova-metadata-0\" (UID: \"56ab5925-779b-43f4-89e6-27226d0363db\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:37:07 crc kubenswrapper[5120]: I0316 16:37:07.121348 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/56ab5925-779b-43f4-89e6-27226d0363db-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"56ab5925-779b-43f4-89e6-27226d0363db\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:37:07 crc kubenswrapper[5120]: I0316 16:37:07.224097 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/56ab5925-779b-43f4-89e6-27226d0363db-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"56ab5925-779b-43f4-89e6-27226d0363db\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:37:07 crc kubenswrapper[5120]: I0316 16:37:07.224285 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/56ab5925-779b-43f4-89e6-27226d0363db-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"56ab5925-779b-43f4-89e6-27226d0363db\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:37:07 crc kubenswrapper[5120]: I0316 16:37:07.224474 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/56ab5925-779b-43f4-89e6-27226d0363db-logs\") pod \"nova-metadata-0\" (UID: \"56ab5925-779b-43f4-89e6-27226d0363db\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:37:07 crc kubenswrapper[5120]: I0316 16:37:07.224548 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2kbzp\" (UniqueName: \"kubernetes.io/projected/56ab5925-779b-43f4-89e6-27226d0363db-kube-api-access-2kbzp\") pod \"nova-metadata-0\" (UID: \"56ab5925-779b-43f4-89e6-27226d0363db\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:37:07 crc kubenswrapper[5120]: I0316 16:37:07.224655 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/56ab5925-779b-43f4-89e6-27226d0363db-config-data\") pod \"nova-metadata-0\" (UID: \"56ab5925-779b-43f4-89e6-27226d0363db\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:37:07 crc kubenswrapper[5120]: I0316 16:37:07.228636 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/56ab5925-779b-43f4-89e6-27226d0363db-logs\") pod \"nova-metadata-0\" (UID: \"56ab5925-779b-43f4-89e6-27226d0363db\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:37:07 crc kubenswrapper[5120]: I0316 16:37:07.238378 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/56ab5925-779b-43f4-89e6-27226d0363db-config-data\") pod \"nova-metadata-0\" (UID: \"56ab5925-779b-43f4-89e6-27226d0363db\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:37:07 crc kubenswrapper[5120]: I0316 16:37:07.239094 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/56ab5925-779b-43f4-89e6-27226d0363db-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"56ab5925-779b-43f4-89e6-27226d0363db\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:37:07 crc kubenswrapper[5120]: I0316 16:37:07.243309 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kbzp\" (UniqueName: \"kubernetes.io/projected/56ab5925-779b-43f4-89e6-27226d0363db-kube-api-access-2kbzp\") pod \"nova-metadata-0\" (UID: \"56ab5925-779b-43f4-89e6-27226d0363db\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:37:07 crc kubenswrapper[5120]: I0316 16:37:07.256202 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/56ab5925-779b-43f4-89e6-27226d0363db-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"56ab5925-779b-43f4-89e6-27226d0363db\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:37:07 crc kubenswrapper[5120]: I0316 16:37:07.298811 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/placement-747d4cf944-dk26n" Mar 16 16:37:07 crc kubenswrapper[5120]: I0316 16:37:07.376694 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-6bc576559-vg8zd"] Mar 16 16:37:07 crc kubenswrapper[5120]: I0316 16:37:07.377429 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-6bc576559-vg8zd" podUID="62429cf4-f6d6-4708-91b3-c81a2b9cb1b6" containerName="placement-log" containerID="cri-o://d4ad382e7c7b2ae921dda545fc65a411c0a7a592e6f1c788317a46bc2af5d081" gracePeriod=30 Mar 16 16:37:07 crc kubenswrapper[5120]: I0316 16:37:07.377570 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-6bc576559-vg8zd" podUID="62429cf4-f6d6-4708-91b3-c81a2b9cb1b6" containerName="placement-api" containerID="cri-o://6ded548d5be3fad9d15cf337acf6ace6ec026ccee3c3ad8e74f84c40ec38788c" gracePeriod=30 Mar 16 16:37:07 crc kubenswrapper[5120]: I0316 16:37:07.414421 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:37:07 crc kubenswrapper[5120]: I0316 16:37:07.455807 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:37:07 crc kubenswrapper[5120]: I0316 16:37:07.886871 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"7593b082-fbd5-4f23-9b9b-8ee3d2a559d4","Type":"ContainerStarted","Data":"68fff3c8380e1b5836874d33acb538e8c0c491806845c73325ad47d4c76c7df3"} Mar 16 16:37:07 crc kubenswrapper[5120]: I0316 16:37:07.887326 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"7593b082-fbd5-4f23-9b9b-8ee3d2a559d4","Type":"ContainerStarted","Data":"5aacbdef993fdeac9897d5de5bfc9af940a3cf3007c93d689edb2aff8d80c7e6"} Mar 16 16:37:07 crc kubenswrapper[5120]: I0316 16:37:07.891539 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"e8b9ac0b-60ab-4b23-a6ab-766adba26d26","Type":"ContainerStarted","Data":"32c1f86f935c82a9596daa5eb814e4d321043ff6dc0fc5a0fdf4067b1e92d88b"} Mar 16 16:37:07 crc kubenswrapper[5120]: I0316 16:37:07.891606 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"e8b9ac0b-60ab-4b23-a6ab-766adba26d26","Type":"ContainerStarted","Data":"3d78de8f66db9d8f402574f5bdcba76ef6d87b1637b7126ed7744e965736cde1"} Mar 16 16:37:07 crc kubenswrapper[5120]: I0316 16:37:07.894006 5120 generic.go:358] "Generic (PLEG): container finished" podID="62429cf4-f6d6-4708-91b3-c81a2b9cb1b6" containerID="d4ad382e7c7b2ae921dda545fc65a411c0a7a592e6f1c788317a46bc2af5d081" exitCode=143 Mar 16 16:37:07 crc kubenswrapper[5120]: I0316 16:37:07.894343 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-6bc576559-vg8zd" event={"ID":"62429cf4-f6d6-4708-91b3-c81a2b9cb1b6","Type":"ContainerDied","Data":"d4ad382e7c7b2ae921dda545fc65a411c0a7a592e6f1c788317a46bc2af5d081"} Mar 16 16:37:07 crc kubenswrapper[5120]: I0316 16:37:07.909042 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-scheduler-0" podStartSLOduration=2.90901826 podStartE2EDuration="2.90901826s" podCreationTimestamp="2026-03-16 16:37:05 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:37:07.906195336 +0000 UTC m=+3930.060127003" watchObservedRunningTime="2026-03-16 16:37:07.90901826 +0000 UTC m=+3930.062949917" Mar 16 16:37:07 crc kubenswrapper[5120]: I0316 16:37:07.995658 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:37:08 crc kubenswrapper[5120]: I0316 16:37:08.684394 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c83e22b-e8f6-4228-95a3-9874368d9534" path="/var/lib/kubelet/pods/7c83e22b-e8f6-4228-95a3-9874368d9534/volumes" Mar 16 16:37:08 crc kubenswrapper[5120]: I0316 16:37:08.906885 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"e8b9ac0b-60ab-4b23-a6ab-766adba26d26","Type":"ContainerStarted","Data":"a9db5555b245b207232a95c0ad90ea77d4f538c19cba6f2e98f1d5afcbcaf9ba"} Mar 16 16:37:08 crc kubenswrapper[5120]: I0316 16:37:08.910679 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"56ab5925-779b-43f4-89e6-27226d0363db","Type":"ContainerStarted","Data":"9b748bcc6896302dba293ef0fb02c88bcc285e8c055930e1a04255f30d9722b5"} Mar 16 16:37:08 crc kubenswrapper[5120]: I0316 16:37:08.910723 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"56ab5925-779b-43f4-89e6-27226d0363db","Type":"ContainerStarted","Data":"4cf329a353da59c095b4c3af04566c8f552c57cf5c5c7514072bee494ada2bbe"} Mar 16 16:37:08 crc kubenswrapper[5120]: I0316 16:37:08.910738 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"56ab5925-779b-43f4-89e6-27226d0363db","Type":"ContainerStarted","Data":"bbee4b431cde3fd53c314b1b26d23f40d05f2755218e36a8b6356e636fa09551"} Mar 16 16:37:08 crc kubenswrapper[5120]: I0316 16:37:08.941218 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=2.941191146 podStartE2EDuration="2.941191146s" podCreationTimestamp="2026-03-16 16:37:06 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:37:08.928170126 +0000 UTC m=+3931.082101803" watchObservedRunningTime="2026-03-16 16:37:08.941191146 +0000 UTC m=+3931.095122803" Mar 16 16:37:08 crc kubenswrapper[5120]: I0316 16:37:08.967110 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=2.9670871930000002 podStartE2EDuration="2.967087193s" podCreationTimestamp="2026-03-16 16:37:06 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:37:08.95699693 +0000 UTC m=+3931.110928607" watchObservedRunningTime="2026-03-16 16:37:08.967087193 +0000 UTC m=+3931.121018850" Mar 16 16:37:09 crc kubenswrapper[5120]: E0316 16:37:09.364500 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1907039 actualBytes=10240 Mar 16 16:37:09 crc kubenswrapper[5120]: I0316 16:37:09.922043 5120 generic.go:358] "Generic (PLEG): container finished" podID="3b7052c0-d1a0-4e78-b88f-e820db4ee0f6" containerID="286e1a162710f7d74c84bf4dca3a41749051657141bed19dabe7605fa5405a5c" exitCode=0 Mar 16 16:37:09 crc kubenswrapper[5120]: I0316 16:37:09.922141 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-82zhz" event={"ID":"3b7052c0-d1a0-4e78-b88f-e820db4ee0f6","Type":"ContainerDied","Data":"286e1a162710f7d74c84bf4dca3a41749051657141bed19dabe7605fa5405a5c"} Mar 16 16:37:10 crc kubenswrapper[5120]: I0316 16:37:10.941000 5120 generic.go:358] "Generic (PLEG): container finished" podID="493a54f8-9510-4307-a13e-c3c00dc840a1" containerID="90029a57cda1c82f1798fae3e7d3d6f5f4f44479371d17227cf43653ae68b672" exitCode=0 Mar 16 16:37:10 crc kubenswrapper[5120]: I0316 16:37:10.941386 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-skrj6" event={"ID":"493a54f8-9510-4307-a13e-c3c00dc840a1","Type":"ContainerDied","Data":"90029a57cda1c82f1798fae3e7d3d6f5f4f44479371d17227cf43653ae68b672"} Mar 16 16:37:10 crc kubenswrapper[5120]: I0316 16:37:10.954936 5120 generic.go:358] "Generic (PLEG): container finished" podID="62429cf4-f6d6-4708-91b3-c81a2b9cb1b6" containerID="6ded548d5be3fad9d15cf337acf6ace6ec026ccee3c3ad8e74f84c40ec38788c" exitCode=0 Mar 16 16:37:10 crc kubenswrapper[5120]: I0316 16:37:10.956674 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-6bc576559-vg8zd" event={"ID":"62429cf4-f6d6-4708-91b3-c81a2b9cb1b6","Type":"ContainerDied","Data":"6ded548d5be3fad9d15cf337acf6ace6ec026ccee3c3ad8e74f84c40ec38788c"} Mar 16 16:37:11 crc kubenswrapper[5120]: I0316 16:37:11.084978 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-6bc576559-vg8zd" Mar 16 16:37:11 crc kubenswrapper[5120]: I0316 16:37:11.134063 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/62429cf4-f6d6-4708-91b3-c81a2b9cb1b6-logs\") pod \"62429cf4-f6d6-4708-91b3-c81a2b9cb1b6\" (UID: \"62429cf4-f6d6-4708-91b3-c81a2b9cb1b6\") " Mar 16 16:37:11 crc kubenswrapper[5120]: I0316 16:37:11.134218 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/62429cf4-f6d6-4708-91b3-c81a2b9cb1b6-config-data\") pod \"62429cf4-f6d6-4708-91b3-c81a2b9cb1b6\" (UID: \"62429cf4-f6d6-4708-91b3-c81a2b9cb1b6\") " Mar 16 16:37:11 crc kubenswrapper[5120]: I0316 16:37:11.134292 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/62429cf4-f6d6-4708-91b3-c81a2b9cb1b6-scripts\") pod \"62429cf4-f6d6-4708-91b3-c81a2b9cb1b6\" (UID: \"62429cf4-f6d6-4708-91b3-c81a2b9cb1b6\") " Mar 16 16:37:11 crc kubenswrapper[5120]: I0316 16:37:11.134345 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7fgfq\" (UniqueName: \"kubernetes.io/projected/62429cf4-f6d6-4708-91b3-c81a2b9cb1b6-kube-api-access-7fgfq\") pod \"62429cf4-f6d6-4708-91b3-c81a2b9cb1b6\" (UID: \"62429cf4-f6d6-4708-91b3-c81a2b9cb1b6\") " Mar 16 16:37:11 crc kubenswrapper[5120]: I0316 16:37:11.134387 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/62429cf4-f6d6-4708-91b3-c81a2b9cb1b6-combined-ca-bundle\") pod \"62429cf4-f6d6-4708-91b3-c81a2b9cb1b6\" (UID: \"62429cf4-f6d6-4708-91b3-c81a2b9cb1b6\") " Mar 16 16:37:11 crc kubenswrapper[5120]: I0316 16:37:11.134412 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/62429cf4-f6d6-4708-91b3-c81a2b9cb1b6-internal-tls-certs\") pod \"62429cf4-f6d6-4708-91b3-c81a2b9cb1b6\" (UID: \"62429cf4-f6d6-4708-91b3-c81a2b9cb1b6\") " Mar 16 16:37:11 crc kubenswrapper[5120]: I0316 16:37:11.134438 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/62429cf4-f6d6-4708-91b3-c81a2b9cb1b6-public-tls-certs\") pod \"62429cf4-f6d6-4708-91b3-c81a2b9cb1b6\" (UID: \"62429cf4-f6d6-4708-91b3-c81a2b9cb1b6\") " Mar 16 16:37:11 crc kubenswrapper[5120]: I0316 16:37:11.137582 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62429cf4-f6d6-4708-91b3-c81a2b9cb1b6-logs" (OuterVolumeSpecName: "logs") pod "62429cf4-f6d6-4708-91b3-c81a2b9cb1b6" (UID: "62429cf4-f6d6-4708-91b3-c81a2b9cb1b6"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:37:11 crc kubenswrapper[5120]: I0316 16:37:11.201419 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62429cf4-f6d6-4708-91b3-c81a2b9cb1b6-kube-api-access-7fgfq" (OuterVolumeSpecName: "kube-api-access-7fgfq") pod "62429cf4-f6d6-4708-91b3-c81a2b9cb1b6" (UID: "62429cf4-f6d6-4708-91b3-c81a2b9cb1b6"). InnerVolumeSpecName "kube-api-access-7fgfq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:37:11 crc kubenswrapper[5120]: I0316 16:37:11.228238 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/62429cf4-f6d6-4708-91b3-c81a2b9cb1b6-scripts" (OuterVolumeSpecName: "scripts") pod "62429cf4-f6d6-4708-91b3-c81a2b9cb1b6" (UID: "62429cf4-f6d6-4708-91b3-c81a2b9cb1b6"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:11 crc kubenswrapper[5120]: I0316 16:37:11.237665 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/62429cf4-f6d6-4708-91b3-c81a2b9cb1b6-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:11 crc kubenswrapper[5120]: I0316 16:37:11.237693 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/62429cf4-f6d6-4708-91b3-c81a2b9cb1b6-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:11 crc kubenswrapper[5120]: I0316 16:37:11.237703 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7fgfq\" (UniqueName: \"kubernetes.io/projected/62429cf4-f6d6-4708-91b3-c81a2b9cb1b6-kube-api-access-7fgfq\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:11 crc kubenswrapper[5120]: I0316 16:37:11.265359 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/62429cf4-f6d6-4708-91b3-c81a2b9cb1b6-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "62429cf4-f6d6-4708-91b3-c81a2b9cb1b6" (UID: "62429cf4-f6d6-4708-91b3-c81a2b9cb1b6"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:11 crc kubenswrapper[5120]: I0316 16:37:11.298213 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/62429cf4-f6d6-4708-91b3-c81a2b9cb1b6-config-data" (OuterVolumeSpecName: "config-data") pod "62429cf4-f6d6-4708-91b3-c81a2b9cb1b6" (UID: "62429cf4-f6d6-4708-91b3-c81a2b9cb1b6"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:11 crc kubenswrapper[5120]: I0316 16:37:11.307797 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-82zhz" Mar 16 16:37:11 crc kubenswrapper[5120]: I0316 16:37:11.347061 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/62429cf4-f6d6-4708-91b3-c81a2b9cb1b6-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:11 crc kubenswrapper[5120]: I0316 16:37:11.349691 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/62429cf4-f6d6-4708-91b3-c81a2b9cb1b6-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:11 crc kubenswrapper[5120]: I0316 16:37:11.356556 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/62429cf4-f6d6-4708-91b3-c81a2b9cb1b6-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "62429cf4-f6d6-4708-91b3-c81a2b9cb1b6" (UID: "62429cf4-f6d6-4708-91b3-c81a2b9cb1b6"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:11 crc kubenswrapper[5120]: I0316 16:37:11.359243 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/62429cf4-f6d6-4708-91b3-c81a2b9cb1b6-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "62429cf4-f6d6-4708-91b3-c81a2b9cb1b6" (UID: "62429cf4-f6d6-4708-91b3-c81a2b9cb1b6"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:11 crc kubenswrapper[5120]: I0316 16:37:11.399451 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:37:11 crc kubenswrapper[5120]: I0316 16:37:11.450926 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3b7052c0-d1a0-4e78-b88f-e820db4ee0f6-scripts\") pod \"3b7052c0-d1a0-4e78-b88f-e820db4ee0f6\" (UID: \"3b7052c0-d1a0-4e78-b88f-e820db4ee0f6\") " Mar 16 16:37:11 crc kubenswrapper[5120]: I0316 16:37:11.451009 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3b7052c0-d1a0-4e78-b88f-e820db4ee0f6-config-data\") pod \"3b7052c0-d1a0-4e78-b88f-e820db4ee0f6\" (UID: \"3b7052c0-d1a0-4e78-b88f-e820db4ee0f6\") " Mar 16 16:37:11 crc kubenswrapper[5120]: I0316 16:37:11.451231 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d894n\" (UniqueName: \"kubernetes.io/projected/3b7052c0-d1a0-4e78-b88f-e820db4ee0f6-kube-api-access-d894n\") pod \"3b7052c0-d1a0-4e78-b88f-e820db4ee0f6\" (UID: \"3b7052c0-d1a0-4e78-b88f-e820db4ee0f6\") " Mar 16 16:37:11 crc kubenswrapper[5120]: I0316 16:37:11.451601 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3b7052c0-d1a0-4e78-b88f-e820db4ee0f6-combined-ca-bundle\") pod \"3b7052c0-d1a0-4e78-b88f-e820db4ee0f6\" (UID: \"3b7052c0-d1a0-4e78-b88f-e820db4ee0f6\") " Mar 16 16:37:11 crc kubenswrapper[5120]: I0316 16:37:11.452768 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/62429cf4-f6d6-4708-91b3-c81a2b9cb1b6-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:11 crc kubenswrapper[5120]: I0316 16:37:11.452791 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/62429cf4-f6d6-4708-91b3-c81a2b9cb1b6-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:11 crc kubenswrapper[5120]: I0316 16:37:11.454888 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b7052c0-d1a0-4e78-b88f-e820db4ee0f6-kube-api-access-d894n" (OuterVolumeSpecName: "kube-api-access-d894n") pod "3b7052c0-d1a0-4e78-b88f-e820db4ee0f6" (UID: "3b7052c0-d1a0-4e78-b88f-e820db4ee0f6"). InnerVolumeSpecName "kube-api-access-d894n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:37:11 crc kubenswrapper[5120]: I0316 16:37:11.457857 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b7052c0-d1a0-4e78-b88f-e820db4ee0f6-scripts" (OuterVolumeSpecName: "scripts") pod "3b7052c0-d1a0-4e78-b88f-e820db4ee0f6" (UID: "3b7052c0-d1a0-4e78-b88f-e820db4ee0f6"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:11 crc kubenswrapper[5120]: I0316 16:37:11.482397 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b7052c0-d1a0-4e78-b88f-e820db4ee0f6-config-data" (OuterVolumeSpecName: "config-data") pod "3b7052c0-d1a0-4e78-b88f-e820db4ee0f6" (UID: "3b7052c0-d1a0-4e78-b88f-e820db4ee0f6"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:11 crc kubenswrapper[5120]: I0316 16:37:11.485105 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b7052c0-d1a0-4e78-b88f-e820db4ee0f6-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "3b7052c0-d1a0-4e78-b88f-e820db4ee0f6" (UID: "3b7052c0-d1a0-4e78-b88f-e820db4ee0f6"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:11 crc kubenswrapper[5120]: I0316 16:37:11.555746 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d894n\" (UniqueName: \"kubernetes.io/projected/3b7052c0-d1a0-4e78-b88f-e820db4ee0f6-kube-api-access-d894n\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:11 crc kubenswrapper[5120]: I0316 16:37:11.555806 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3b7052c0-d1a0-4e78-b88f-e820db4ee0f6-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:11 crc kubenswrapper[5120]: I0316 16:37:11.555819 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3b7052c0-d1a0-4e78-b88f-e820db4ee0f6-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:11 crc kubenswrapper[5120]: I0316 16:37:11.555834 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3b7052c0-d1a0-4e78-b88f-e820db4ee0f6-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:11 crc kubenswrapper[5120]: I0316 16:37:11.970535 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-82zhz" Mar 16 16:37:11 crc kubenswrapper[5120]: I0316 16:37:11.970808 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-82zhz" event={"ID":"3b7052c0-d1a0-4e78-b88f-e820db4ee0f6","Type":"ContainerDied","Data":"e352e1453ba421e929d2369112058070cfd989ece3ca6c1330a2424bd038d011"} Mar 16 16:37:11 crc kubenswrapper[5120]: I0316 16:37:11.971289 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e352e1453ba421e929d2369112058070cfd989ece3ca6c1330a2424bd038d011" Mar 16 16:37:11 crc kubenswrapper[5120]: I0316 16:37:11.974696 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-6bc576559-vg8zd" Mar 16 16:37:11 crc kubenswrapper[5120]: I0316 16:37:11.974727 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-6bc576559-vg8zd" event={"ID":"62429cf4-f6d6-4708-91b3-c81a2b9cb1b6","Type":"ContainerDied","Data":"57da3037a658c494e50db04497610a578d09c96d960a3d33a1fda8e8e167de9f"} Mar 16 16:37:11 crc kubenswrapper[5120]: I0316 16:37:11.974798 5120 scope.go:117] "RemoveContainer" containerID="6ded548d5be3fad9d15cf337acf6ace6ec026ccee3c3ad8e74f84c40ec38788c" Mar 16 16:37:12 crc kubenswrapper[5120]: I0316 16:37:12.025623 5120 scope.go:117] "RemoveContainer" containerID="d4ad382e7c7b2ae921dda545fc65a411c0a7a592e6f1c788317a46bc2af5d081" Mar 16 16:37:12 crc kubenswrapper[5120]: I0316 16:37:12.034353 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-6bc576559-vg8zd"] Mar 16 16:37:12 crc kubenswrapper[5120]: I0316 16:37:12.042481 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-6bc576559-vg8zd"] Mar 16 16:37:12 crc kubenswrapper[5120]: E0316 16:37:12.057455 5120 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfec060e6_11fd_4d16_8640_fd02366a7601.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfec060e6_11fd_4d16_8640_fd02366a7601.slice/crio-cf47aaebf63137acc7a77d17eb41eeb5f06bc1f346811dfa1f366d667ed8d6a4\": RecentStats: unable to find data in memory cache]" Mar 16 16:37:12 crc kubenswrapper[5120]: I0316 16:37:12.150816 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:37:12 crc kubenswrapper[5120]: I0316 16:37:12.151095 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="7593b082-fbd5-4f23-9b9b-8ee3d2a559d4" containerName="nova-scheduler-scheduler" containerID="cri-o://68fff3c8380e1b5836874d33acb538e8c0c491806845c73325ad47d4c76c7df3" gracePeriod=30 Mar 16 16:37:12 crc kubenswrapper[5120]: I0316 16:37:12.167041 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:37:12 crc kubenswrapper[5120]: I0316 16:37:12.167329 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="e8b9ac0b-60ab-4b23-a6ab-766adba26d26" containerName="nova-api-log" containerID="cri-o://32c1f86f935c82a9596daa5eb814e4d321043ff6dc0fc5a0fdf4067b1e92d88b" gracePeriod=30 Mar 16 16:37:12 crc kubenswrapper[5120]: I0316 16:37:12.167910 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="e8b9ac0b-60ab-4b23-a6ab-766adba26d26" containerName="nova-api-api" containerID="cri-o://a9db5555b245b207232a95c0ad90ea77d4f538c19cba6f2e98f1d5afcbcaf9ba" gracePeriod=30 Mar 16 16:37:12 crc kubenswrapper[5120]: I0316 16:37:12.183048 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:37:12 crc kubenswrapper[5120]: I0316 16:37:12.183510 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="56ab5925-779b-43f4-89e6-27226d0363db" containerName="nova-metadata-log" containerID="cri-o://4cf329a353da59c095b4c3af04566c8f552c57cf5c5c7514072bee494ada2bbe" gracePeriod=30 Mar 16 16:37:12 crc kubenswrapper[5120]: I0316 16:37:12.183984 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="56ab5925-779b-43f4-89e6-27226d0363db" containerName="nova-metadata-metadata" containerID="cri-o://9b748bcc6896302dba293ef0fb02c88bcc285e8c055930e1a04255f30d9722b5" gracePeriod=30 Mar 16 16:37:12 crc kubenswrapper[5120]: I0316 16:37:12.620824 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-skrj6" Mar 16 16:37:12 crc kubenswrapper[5120]: I0316 16:37:12.684863 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="62429cf4-f6d6-4708-91b3-c81a2b9cb1b6" path="/var/lib/kubelet/pods/62429cf4-f6d6-4708-91b3-c81a2b9cb1b6/volumes" Mar 16 16:37:12 crc kubenswrapper[5120]: I0316 16:37:12.801789 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/493a54f8-9510-4307-a13e-c3c00dc840a1-combined-ca-bundle\") pod \"493a54f8-9510-4307-a13e-c3c00dc840a1\" (UID: \"493a54f8-9510-4307-a13e-c3c00dc840a1\") " Mar 16 16:37:12 crc kubenswrapper[5120]: I0316 16:37:12.801938 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/493a54f8-9510-4307-a13e-c3c00dc840a1-config-data\") pod \"493a54f8-9510-4307-a13e-c3c00dc840a1\" (UID: \"493a54f8-9510-4307-a13e-c3c00dc840a1\") " Mar 16 16:37:12 crc kubenswrapper[5120]: I0316 16:37:12.802255 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gzg6m\" (UniqueName: \"kubernetes.io/projected/493a54f8-9510-4307-a13e-c3c00dc840a1-kube-api-access-gzg6m\") pod \"493a54f8-9510-4307-a13e-c3c00dc840a1\" (UID: \"493a54f8-9510-4307-a13e-c3c00dc840a1\") " Mar 16 16:37:12 crc kubenswrapper[5120]: I0316 16:37:12.802300 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/493a54f8-9510-4307-a13e-c3c00dc840a1-scripts\") pod \"493a54f8-9510-4307-a13e-c3c00dc840a1\" (UID: \"493a54f8-9510-4307-a13e-c3c00dc840a1\") " Mar 16 16:37:12 crc kubenswrapper[5120]: I0316 16:37:12.811236 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/493a54f8-9510-4307-a13e-c3c00dc840a1-scripts" (OuterVolumeSpecName: "scripts") pod "493a54f8-9510-4307-a13e-c3c00dc840a1" (UID: "493a54f8-9510-4307-a13e-c3c00dc840a1"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:12 crc kubenswrapper[5120]: I0316 16:37:12.814425 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/493a54f8-9510-4307-a13e-c3c00dc840a1-kube-api-access-gzg6m" (OuterVolumeSpecName: "kube-api-access-gzg6m") pod "493a54f8-9510-4307-a13e-c3c00dc840a1" (UID: "493a54f8-9510-4307-a13e-c3c00dc840a1"). InnerVolumeSpecName "kube-api-access-gzg6m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:37:12 crc kubenswrapper[5120]: I0316 16:37:12.837173 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/493a54f8-9510-4307-a13e-c3c00dc840a1-config-data" (OuterVolumeSpecName: "config-data") pod "493a54f8-9510-4307-a13e-c3c00dc840a1" (UID: "493a54f8-9510-4307-a13e-c3c00dc840a1"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:12 crc kubenswrapper[5120]: I0316 16:37:12.842015 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/493a54f8-9510-4307-a13e-c3c00dc840a1-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "493a54f8-9510-4307-a13e-c3c00dc840a1" (UID: "493a54f8-9510-4307-a13e-c3c00dc840a1"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:12 crc kubenswrapper[5120]: I0316 16:37:12.905093 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gzg6m\" (UniqueName: \"kubernetes.io/projected/493a54f8-9510-4307-a13e-c3c00dc840a1-kube-api-access-gzg6m\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:12 crc kubenswrapper[5120]: I0316 16:37:12.905144 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/493a54f8-9510-4307-a13e-c3c00dc840a1-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:12 crc kubenswrapper[5120]: I0316 16:37:12.905154 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/493a54f8-9510-4307-a13e-c3c00dc840a1-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:12 crc kubenswrapper[5120]: I0316 16:37:12.905165 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/493a54f8-9510-4307-a13e-c3c00dc840a1-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:12 crc kubenswrapper[5120]: I0316 16:37:12.943076 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:37:12 crc kubenswrapper[5120]: I0316 16:37:12.951695 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.013972 5120 generic.go:358] "Generic (PLEG): container finished" podID="e8b9ac0b-60ab-4b23-a6ab-766adba26d26" containerID="a9db5555b245b207232a95c0ad90ea77d4f538c19cba6f2e98f1d5afcbcaf9ba" exitCode=0 Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.014252 5120 generic.go:358] "Generic (PLEG): container finished" podID="e8b9ac0b-60ab-4b23-a6ab-766adba26d26" containerID="32c1f86f935c82a9596daa5eb814e4d321043ff6dc0fc5a0fdf4067b1e92d88b" exitCode=143 Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.014327 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"e8b9ac0b-60ab-4b23-a6ab-766adba26d26","Type":"ContainerDied","Data":"a9db5555b245b207232a95c0ad90ea77d4f538c19cba6f2e98f1d5afcbcaf9ba"} Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.014352 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"e8b9ac0b-60ab-4b23-a6ab-766adba26d26","Type":"ContainerDied","Data":"32c1f86f935c82a9596daa5eb814e4d321043ff6dc0fc5a0fdf4067b1e92d88b"} Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.014363 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"e8b9ac0b-60ab-4b23-a6ab-766adba26d26","Type":"ContainerDied","Data":"3d78de8f66db9d8f402574f5bdcba76ef6d87b1637b7126ed7744e965736cde1"} Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.014378 5120 scope.go:117] "RemoveContainer" containerID="a9db5555b245b207232a95c0ad90ea77d4f538c19cba6f2e98f1d5afcbcaf9ba" Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.014488 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.026239 5120 generic.go:358] "Generic (PLEG): container finished" podID="56ab5925-779b-43f4-89e6-27226d0363db" containerID="9b748bcc6896302dba293ef0fb02c88bcc285e8c055930e1a04255f30d9722b5" exitCode=0 Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.026274 5120 generic.go:358] "Generic (PLEG): container finished" podID="56ab5925-779b-43f4-89e6-27226d0363db" containerID="4cf329a353da59c095b4c3af04566c8f552c57cf5c5c7514072bee494ada2bbe" exitCode=143 Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.026678 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"56ab5925-779b-43f4-89e6-27226d0363db","Type":"ContainerDied","Data":"9b748bcc6896302dba293ef0fb02c88bcc285e8c055930e1a04255f30d9722b5"} Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.026709 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"56ab5925-779b-43f4-89e6-27226d0363db","Type":"ContainerDied","Data":"4cf329a353da59c095b4c3af04566c8f552c57cf5c5c7514072bee494ada2bbe"} Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.026723 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"56ab5925-779b-43f4-89e6-27226d0363db","Type":"ContainerDied","Data":"bbee4b431cde3fd53c314b1b26d23f40d05f2755218e36a8b6356e636fa09551"} Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.026811 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.033373 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-skrj6" event={"ID":"493a54f8-9510-4307-a13e-c3c00dc840a1","Type":"ContainerDied","Data":"202983962d28cc3b474cb85e6407e66b804152e9ad75156f320b89ab2e19437a"} Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.033406 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="202983962d28cc3b474cb85e6407e66b804152e9ad75156f320b89ab2e19437a" Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.033486 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-skrj6" Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.049891 5120 scope.go:117] "RemoveContainer" containerID="32c1f86f935c82a9596daa5eb814e4d321043ff6dc0fc5a0fdf4067b1e92d88b" Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.089716 5120 scope.go:117] "RemoveContainer" containerID="a9db5555b245b207232a95c0ad90ea77d4f538c19cba6f2e98f1d5afcbcaf9ba" Mar 16 16:37:13 crc kubenswrapper[5120]: E0316 16:37:13.090253 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a9db5555b245b207232a95c0ad90ea77d4f538c19cba6f2e98f1d5afcbcaf9ba\": container with ID starting with a9db5555b245b207232a95c0ad90ea77d4f538c19cba6f2e98f1d5afcbcaf9ba not found: ID does not exist" containerID="a9db5555b245b207232a95c0ad90ea77d4f538c19cba6f2e98f1d5afcbcaf9ba" Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.090298 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9db5555b245b207232a95c0ad90ea77d4f538c19cba6f2e98f1d5afcbcaf9ba"} err="failed to get container status \"a9db5555b245b207232a95c0ad90ea77d4f538c19cba6f2e98f1d5afcbcaf9ba\": rpc error: code = NotFound desc = could not find container \"a9db5555b245b207232a95c0ad90ea77d4f538c19cba6f2e98f1d5afcbcaf9ba\": container with ID starting with a9db5555b245b207232a95c0ad90ea77d4f538c19cba6f2e98f1d5afcbcaf9ba not found: ID does not exist" Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.090324 5120 scope.go:117] "RemoveContainer" containerID="32c1f86f935c82a9596daa5eb814e4d321043ff6dc0fc5a0fdf4067b1e92d88b" Mar 16 16:37:13 crc kubenswrapper[5120]: E0316 16:37:13.090638 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"32c1f86f935c82a9596daa5eb814e4d321043ff6dc0fc5a0fdf4067b1e92d88b\": container with ID starting with 32c1f86f935c82a9596daa5eb814e4d321043ff6dc0fc5a0fdf4067b1e92d88b not found: ID does not exist" containerID="32c1f86f935c82a9596daa5eb814e4d321043ff6dc0fc5a0fdf4067b1e92d88b" Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.090701 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32c1f86f935c82a9596daa5eb814e4d321043ff6dc0fc5a0fdf4067b1e92d88b"} err="failed to get container status \"32c1f86f935c82a9596daa5eb814e4d321043ff6dc0fc5a0fdf4067b1e92d88b\": rpc error: code = NotFound desc = could not find container \"32c1f86f935c82a9596daa5eb814e4d321043ff6dc0fc5a0fdf4067b1e92d88b\": container with ID starting with 32c1f86f935c82a9596daa5eb814e4d321043ff6dc0fc5a0fdf4067b1e92d88b not found: ID does not exist" Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.090739 5120 scope.go:117] "RemoveContainer" containerID="a9db5555b245b207232a95c0ad90ea77d4f538c19cba6f2e98f1d5afcbcaf9ba" Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.091013 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9db5555b245b207232a95c0ad90ea77d4f538c19cba6f2e98f1d5afcbcaf9ba"} err="failed to get container status \"a9db5555b245b207232a95c0ad90ea77d4f538c19cba6f2e98f1d5afcbcaf9ba\": rpc error: code = NotFound desc = could not find container \"a9db5555b245b207232a95c0ad90ea77d4f538c19cba6f2e98f1d5afcbcaf9ba\": container with ID starting with a9db5555b245b207232a95c0ad90ea77d4f538c19cba6f2e98f1d5afcbcaf9ba not found: ID does not exist" Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.091039 5120 scope.go:117] "RemoveContainer" containerID="32c1f86f935c82a9596daa5eb814e4d321043ff6dc0fc5a0fdf4067b1e92d88b" Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.091403 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32c1f86f935c82a9596daa5eb814e4d321043ff6dc0fc5a0fdf4067b1e92d88b"} err="failed to get container status \"32c1f86f935c82a9596daa5eb814e4d321043ff6dc0fc5a0fdf4067b1e92d88b\": rpc error: code = NotFound desc = could not find container \"32c1f86f935c82a9596daa5eb814e4d321043ff6dc0fc5a0fdf4067b1e92d88b\": container with ID starting with 32c1f86f935c82a9596daa5eb814e4d321043ff6dc0fc5a0fdf4067b1e92d88b not found: ID does not exist" Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.091427 5120 scope.go:117] "RemoveContainer" containerID="9b748bcc6896302dba293ef0fb02c88bcc285e8c055930e1a04255f30d9722b5" Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.108692 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/56ab5925-779b-43f4-89e6-27226d0363db-nova-metadata-tls-certs\") pod \"56ab5925-779b-43f4-89e6-27226d0363db\" (UID: \"56ab5925-779b-43f4-89e6-27226d0363db\") " Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.108869 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xcsgr\" (UniqueName: \"kubernetes.io/projected/e8b9ac0b-60ab-4b23-a6ab-766adba26d26-kube-api-access-xcsgr\") pod \"e8b9ac0b-60ab-4b23-a6ab-766adba26d26\" (UID: \"e8b9ac0b-60ab-4b23-a6ab-766adba26d26\") " Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.108917 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/56ab5925-779b-43f4-89e6-27226d0363db-logs\") pod \"56ab5925-779b-43f4-89e6-27226d0363db\" (UID: \"56ab5925-779b-43f4-89e6-27226d0363db\") " Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.109011 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e8b9ac0b-60ab-4b23-a6ab-766adba26d26-internal-tls-certs\") pod \"e8b9ac0b-60ab-4b23-a6ab-766adba26d26\" (UID: \"e8b9ac0b-60ab-4b23-a6ab-766adba26d26\") " Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.109065 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e8b9ac0b-60ab-4b23-a6ab-766adba26d26-config-data\") pod \"e8b9ac0b-60ab-4b23-a6ab-766adba26d26\" (UID: \"e8b9ac0b-60ab-4b23-a6ab-766adba26d26\") " Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.109084 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e8b9ac0b-60ab-4b23-a6ab-766adba26d26-public-tls-certs\") pod \"e8b9ac0b-60ab-4b23-a6ab-766adba26d26\" (UID: \"e8b9ac0b-60ab-4b23-a6ab-766adba26d26\") " Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.109119 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/56ab5925-779b-43f4-89e6-27226d0363db-config-data\") pod \"56ab5925-779b-43f4-89e6-27226d0363db\" (UID: \"56ab5925-779b-43f4-89e6-27226d0363db\") " Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.109160 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e8b9ac0b-60ab-4b23-a6ab-766adba26d26-logs\") pod \"e8b9ac0b-60ab-4b23-a6ab-766adba26d26\" (UID: \"e8b9ac0b-60ab-4b23-a6ab-766adba26d26\") " Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.109281 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2kbzp\" (UniqueName: \"kubernetes.io/projected/56ab5925-779b-43f4-89e6-27226d0363db-kube-api-access-2kbzp\") pod \"56ab5925-779b-43f4-89e6-27226d0363db\" (UID: \"56ab5925-779b-43f4-89e6-27226d0363db\") " Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.109326 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/56ab5925-779b-43f4-89e6-27226d0363db-combined-ca-bundle\") pod \"56ab5925-779b-43f4-89e6-27226d0363db\" (UID: \"56ab5925-779b-43f4-89e6-27226d0363db\") " Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.109510 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e8b9ac0b-60ab-4b23-a6ab-766adba26d26-combined-ca-bundle\") pod \"e8b9ac0b-60ab-4b23-a6ab-766adba26d26\" (UID: \"e8b9ac0b-60ab-4b23-a6ab-766adba26d26\") " Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.118124 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56ab5925-779b-43f4-89e6-27226d0363db-logs" (OuterVolumeSpecName: "logs") pod "56ab5925-779b-43f4-89e6-27226d0363db" (UID: "56ab5925-779b-43f4-89e6-27226d0363db"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.118373 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8b9ac0b-60ab-4b23-a6ab-766adba26d26-logs" (OuterVolumeSpecName: "logs") pod "e8b9ac0b-60ab-4b23-a6ab-766adba26d26" (UID: "e8b9ac0b-60ab-4b23-a6ab-766adba26d26"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.133438 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8b9ac0b-60ab-4b23-a6ab-766adba26d26-kube-api-access-xcsgr" (OuterVolumeSpecName: "kube-api-access-xcsgr") pod "e8b9ac0b-60ab-4b23-a6ab-766adba26d26" (UID: "e8b9ac0b-60ab-4b23-a6ab-766adba26d26"). InnerVolumeSpecName "kube-api-access-xcsgr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.145970 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56ab5925-779b-43f4-89e6-27226d0363db-kube-api-access-2kbzp" (OuterVolumeSpecName: "kube-api-access-2kbzp") pod "56ab5925-779b-43f4-89e6-27226d0363db" (UID: "56ab5925-779b-43f4-89e6-27226d0363db"). InnerVolumeSpecName "kube-api-access-2kbzp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.148276 5120 scope.go:117] "RemoveContainer" containerID="4cf329a353da59c095b4c3af04566c8f552c57cf5c5c7514072bee494ada2bbe" Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.166887 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8b9ac0b-60ab-4b23-a6ab-766adba26d26-config-data" (OuterVolumeSpecName: "config-data") pod "e8b9ac0b-60ab-4b23-a6ab-766adba26d26" (UID: "e8b9ac0b-60ab-4b23-a6ab-766adba26d26"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.167708 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8b9ac0b-60ab-4b23-a6ab-766adba26d26-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e8b9ac0b-60ab-4b23-a6ab-766adba26d26" (UID: "e8b9ac0b-60ab-4b23-a6ab-766adba26d26"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.186135 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/56ab5925-779b-43f4-89e6-27226d0363db-config-data" (OuterVolumeSpecName: "config-data") pod "56ab5925-779b-43f4-89e6-27226d0363db" (UID: "56ab5925-779b-43f4-89e6-27226d0363db"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.187351 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/56ab5925-779b-43f4-89e6-27226d0363db-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "56ab5925-779b-43f4-89e6-27226d0363db" (UID: "56ab5925-779b-43f4-89e6-27226d0363db"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.204003 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8b9ac0b-60ab-4b23-a6ab-766adba26d26-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "e8b9ac0b-60ab-4b23-a6ab-766adba26d26" (UID: "e8b9ac0b-60ab-4b23-a6ab-766adba26d26"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.212854 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/56ab5925-779b-43f4-89e6-27226d0363db-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.212889 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e8b9ac0b-60ab-4b23-a6ab-766adba26d26-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.212899 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e8b9ac0b-60ab-4b23-a6ab-766adba26d26-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.212909 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/56ab5925-779b-43f4-89e6-27226d0363db-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.212917 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e8b9ac0b-60ab-4b23-a6ab-766adba26d26-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.212926 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2kbzp\" (UniqueName: \"kubernetes.io/projected/56ab5925-779b-43f4-89e6-27226d0363db-kube-api-access-2kbzp\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.212935 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/56ab5925-779b-43f4-89e6-27226d0363db-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.212944 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e8b9ac0b-60ab-4b23-a6ab-766adba26d26-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.212952 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xcsgr\" (UniqueName: \"kubernetes.io/projected/e8b9ac0b-60ab-4b23-a6ab-766adba26d26-kube-api-access-xcsgr\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.220742 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/56ab5925-779b-43f4-89e6-27226d0363db-nova-metadata-tls-certs" (OuterVolumeSpecName: "nova-metadata-tls-certs") pod "56ab5925-779b-43f4-89e6-27226d0363db" (UID: "56ab5925-779b-43f4-89e6-27226d0363db"). InnerVolumeSpecName "nova-metadata-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.223142 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8b9ac0b-60ab-4b23-a6ab-766adba26d26-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "e8b9ac0b-60ab-4b23-a6ab-766adba26d26" (UID: "e8b9ac0b-60ab-4b23-a6ab-766adba26d26"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.324382 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e8b9ac0b-60ab-4b23-a6ab-766adba26d26-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.324422 5120 reconciler_common.go:299] "Volume detached for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/56ab5925-779b-43f4-89e6-27226d0363db-nova-metadata-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.350642 5120 scope.go:117] "RemoveContainer" containerID="9b748bcc6896302dba293ef0fb02c88bcc285e8c055930e1a04255f30d9722b5" Mar 16 16:37:13 crc kubenswrapper[5120]: E0316 16:37:13.353265 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b748bcc6896302dba293ef0fb02c88bcc285e8c055930e1a04255f30d9722b5\": container with ID starting with 9b748bcc6896302dba293ef0fb02c88bcc285e8c055930e1a04255f30d9722b5 not found: ID does not exist" containerID="9b748bcc6896302dba293ef0fb02c88bcc285e8c055930e1a04255f30d9722b5" Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.353355 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b748bcc6896302dba293ef0fb02c88bcc285e8c055930e1a04255f30d9722b5"} err="failed to get container status \"9b748bcc6896302dba293ef0fb02c88bcc285e8c055930e1a04255f30d9722b5\": rpc error: code = NotFound desc = could not find container \"9b748bcc6896302dba293ef0fb02c88bcc285e8c055930e1a04255f30d9722b5\": container with ID starting with 9b748bcc6896302dba293ef0fb02c88bcc285e8c055930e1a04255f30d9722b5 not found: ID does not exist" Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.353377 5120 scope.go:117] "RemoveContainer" containerID="4cf329a353da59c095b4c3af04566c8f552c57cf5c5c7514072bee494ada2bbe" Mar 16 16:37:13 crc kubenswrapper[5120]: E0316 16:37:13.353639 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4cf329a353da59c095b4c3af04566c8f552c57cf5c5c7514072bee494ada2bbe\": container with ID starting with 4cf329a353da59c095b4c3af04566c8f552c57cf5c5c7514072bee494ada2bbe not found: ID does not exist" containerID="4cf329a353da59c095b4c3af04566c8f552c57cf5c5c7514072bee494ada2bbe" Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.353655 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4cf329a353da59c095b4c3af04566c8f552c57cf5c5c7514072bee494ada2bbe"} err="failed to get container status \"4cf329a353da59c095b4c3af04566c8f552c57cf5c5c7514072bee494ada2bbe\": rpc error: code = NotFound desc = could not find container \"4cf329a353da59c095b4c3af04566c8f552c57cf5c5c7514072bee494ada2bbe\": container with ID starting with 4cf329a353da59c095b4c3af04566c8f552c57cf5c5c7514072bee494ada2bbe not found: ID does not exist" Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.353666 5120 scope.go:117] "RemoveContainer" containerID="9b748bcc6896302dba293ef0fb02c88bcc285e8c055930e1a04255f30d9722b5" Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.353836 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b748bcc6896302dba293ef0fb02c88bcc285e8c055930e1a04255f30d9722b5"} err="failed to get container status \"9b748bcc6896302dba293ef0fb02c88bcc285e8c055930e1a04255f30d9722b5\": rpc error: code = NotFound desc = could not find container \"9b748bcc6896302dba293ef0fb02c88bcc285e8c055930e1a04255f30d9722b5\": container with ID starting with 9b748bcc6896302dba293ef0fb02c88bcc285e8c055930e1a04255f30d9722b5 not found: ID does not exist" Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.353850 5120 scope.go:117] "RemoveContainer" containerID="4cf329a353da59c095b4c3af04566c8f552c57cf5c5c7514072bee494ada2bbe" Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.355009 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4cf329a353da59c095b4c3af04566c8f552c57cf5c5c7514072bee494ada2bbe"} err="failed to get container status \"4cf329a353da59c095b4c3af04566c8f552c57cf5c5c7514072bee494ada2bbe\": rpc error: code = NotFound desc = could not find container \"4cf329a353da59c095b4c3af04566c8f552c57cf5c5c7514072bee494ada2bbe\": container with ID starting with 4cf329a353da59c095b4c3af04566c8f552c57cf5c5c7514072bee494ada2bbe not found: ID does not exist" Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.381625 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.394457 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.415289 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.429044 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.438443 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.439461 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8b9ac0b-60ab-4b23-a6ab-766adba26d26" containerName="nova-api-api" Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.439479 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8b9ac0b-60ab-4b23-a6ab-766adba26d26" containerName="nova-api-api" Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.439495 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56ab5925-779b-43f4-89e6-27226d0363db" containerName="nova-metadata-log" Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.439503 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="56ab5925-779b-43f4-89e6-27226d0363db" containerName="nova-metadata-log" Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.439513 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56ab5925-779b-43f4-89e6-27226d0363db" containerName="nova-metadata-metadata" Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.439521 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="56ab5925-779b-43f4-89e6-27226d0363db" containerName="nova-metadata-metadata" Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.439536 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62429cf4-f6d6-4708-91b3-c81a2b9cb1b6" containerName="placement-api" Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.439542 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="62429cf4-f6d6-4708-91b3-c81a2b9cb1b6" containerName="placement-api" Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.439557 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62429cf4-f6d6-4708-91b3-c81a2b9cb1b6" containerName="placement-log" Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.439562 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="62429cf4-f6d6-4708-91b3-c81a2b9cb1b6" containerName="placement-log" Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.439572 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b7052c0-d1a0-4e78-b88f-e820db4ee0f6" containerName="nova-manage" Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.439576 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b7052c0-d1a0-4e78-b88f-e820db4ee0f6" containerName="nova-manage" Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.439591 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="493a54f8-9510-4307-a13e-c3c00dc840a1" containerName="nova-manage" Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.439596 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="493a54f8-9510-4307-a13e-c3c00dc840a1" containerName="nova-manage" Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.439615 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8b9ac0b-60ab-4b23-a6ab-766adba26d26" containerName="nova-api-log" Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.439620 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8b9ac0b-60ab-4b23-a6ab-766adba26d26" containerName="nova-api-log" Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.439809 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="56ab5925-779b-43f4-89e6-27226d0363db" containerName="nova-metadata-log" Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.439820 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="62429cf4-f6d6-4708-91b3-c81a2b9cb1b6" containerName="placement-log" Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.439829 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="62429cf4-f6d6-4708-91b3-c81a2b9cb1b6" containerName="placement-api" Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.439838 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="3b7052c0-d1a0-4e78-b88f-e820db4ee0f6" containerName="nova-manage" Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.439850 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e8b9ac0b-60ab-4b23-a6ab-766adba26d26" containerName="nova-api-api" Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.439864 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e8b9ac0b-60ab-4b23-a6ab-766adba26d26" containerName="nova-api-log" Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.439872 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="56ab5925-779b-43f4-89e6-27226d0363db" containerName="nova-metadata-metadata" Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.439879 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="493a54f8-9510-4307-a13e-c3c00dc840a1" containerName="nova-manage" Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.453517 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.455722 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-metadata-config-data\"" Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.456267 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-metadata-internal-svc\"" Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.463505 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.480528 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.485347 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.492748 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-config-data\"" Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.493367 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-public-svc\"" Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.493929 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-internal-svc\"" Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.495185 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.633129 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7b14f5ca-cdd4-4caa-94de-f7d7882916e0-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"7b14f5ca-cdd4-4caa-94de-f7d7882916e0\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.633268 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8185e910-6b4a-4897-a27c-7f07b936beb8-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"8185e910-6b4a-4897-a27c-7f07b936beb8\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.633412 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/7b14f5ca-cdd4-4caa-94de-f7d7882916e0-internal-tls-certs\") pod \"nova-api-0\" (UID: \"7b14f5ca-cdd4-4caa-94de-f7d7882916e0\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.633584 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7b14f5ca-cdd4-4caa-94de-f7d7882916e0-logs\") pod \"nova-api-0\" (UID: \"7b14f5ca-cdd4-4caa-94de-f7d7882916e0\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.633648 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8185e910-6b4a-4897-a27c-7f07b936beb8-logs\") pod \"nova-metadata-0\" (UID: \"8185e910-6b4a-4897-a27c-7f07b936beb8\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.633749 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7b14f5ca-cdd4-4caa-94de-f7d7882916e0-config-data\") pod \"nova-api-0\" (UID: \"7b14f5ca-cdd4-4caa-94de-f7d7882916e0\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.633924 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfdnx\" (UniqueName: \"kubernetes.io/projected/8185e910-6b4a-4897-a27c-7f07b936beb8-kube-api-access-zfdnx\") pod \"nova-metadata-0\" (UID: \"8185e910-6b4a-4897-a27c-7f07b936beb8\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.634006 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8185e910-6b4a-4897-a27c-7f07b936beb8-config-data\") pod \"nova-metadata-0\" (UID: \"8185e910-6b4a-4897-a27c-7f07b936beb8\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.634051 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdftm\" (UniqueName: \"kubernetes.io/projected/7b14f5ca-cdd4-4caa-94de-f7d7882916e0-kube-api-access-wdftm\") pod \"nova-api-0\" (UID: \"7b14f5ca-cdd4-4caa-94de-f7d7882916e0\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.634078 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/8185e910-6b4a-4897-a27c-7f07b936beb8-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"8185e910-6b4a-4897-a27c-7f07b936beb8\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.634143 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/7b14f5ca-cdd4-4caa-94de-f7d7882916e0-public-tls-certs\") pod \"nova-api-0\" (UID: \"7b14f5ca-cdd4-4caa-94de-f7d7882916e0\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.653027 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.736994 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7b14f5ca-cdd4-4caa-94de-f7d7882916e0-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"7b14f5ca-cdd4-4caa-94de-f7d7882916e0\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.737200 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8185e910-6b4a-4897-a27c-7f07b936beb8-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"8185e910-6b4a-4897-a27c-7f07b936beb8\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.737249 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/7b14f5ca-cdd4-4caa-94de-f7d7882916e0-internal-tls-certs\") pod \"nova-api-0\" (UID: \"7b14f5ca-cdd4-4caa-94de-f7d7882916e0\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.737323 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7b14f5ca-cdd4-4caa-94de-f7d7882916e0-logs\") pod \"nova-api-0\" (UID: \"7b14f5ca-cdd4-4caa-94de-f7d7882916e0\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.737361 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8185e910-6b4a-4897-a27c-7f07b936beb8-logs\") pod \"nova-metadata-0\" (UID: \"8185e910-6b4a-4897-a27c-7f07b936beb8\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.737418 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7b14f5ca-cdd4-4caa-94de-f7d7882916e0-config-data\") pod \"nova-api-0\" (UID: \"7b14f5ca-cdd4-4caa-94de-f7d7882916e0\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.737524 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zfdnx\" (UniqueName: \"kubernetes.io/projected/8185e910-6b4a-4897-a27c-7f07b936beb8-kube-api-access-zfdnx\") pod \"nova-metadata-0\" (UID: \"8185e910-6b4a-4897-a27c-7f07b936beb8\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.737642 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8185e910-6b4a-4897-a27c-7f07b936beb8-config-data\") pod \"nova-metadata-0\" (UID: \"8185e910-6b4a-4897-a27c-7f07b936beb8\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.738025 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7b14f5ca-cdd4-4caa-94de-f7d7882916e0-logs\") pod \"nova-api-0\" (UID: \"7b14f5ca-cdd4-4caa-94de-f7d7882916e0\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.738275 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wdftm\" (UniqueName: \"kubernetes.io/projected/7b14f5ca-cdd4-4caa-94de-f7d7882916e0-kube-api-access-wdftm\") pod \"nova-api-0\" (UID: \"7b14f5ca-cdd4-4caa-94de-f7d7882916e0\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.738321 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/8185e910-6b4a-4897-a27c-7f07b936beb8-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"8185e910-6b4a-4897-a27c-7f07b936beb8\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.738935 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/7b14f5ca-cdd4-4caa-94de-f7d7882916e0-public-tls-certs\") pod \"nova-api-0\" (UID: \"7b14f5ca-cdd4-4caa-94de-f7d7882916e0\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.742627 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8185e910-6b4a-4897-a27c-7f07b936beb8-config-data\") pod \"nova-metadata-0\" (UID: \"8185e910-6b4a-4897-a27c-7f07b936beb8\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.742627 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8185e910-6b4a-4897-a27c-7f07b936beb8-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"8185e910-6b4a-4897-a27c-7f07b936beb8\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.742947 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7b14f5ca-cdd4-4caa-94de-f7d7882916e0-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"7b14f5ca-cdd4-4caa-94de-f7d7882916e0\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.743062 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/8185e910-6b4a-4897-a27c-7f07b936beb8-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"8185e910-6b4a-4897-a27c-7f07b936beb8\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.744835 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/7b14f5ca-cdd4-4caa-94de-f7d7882916e0-internal-tls-certs\") pod \"nova-api-0\" (UID: \"7b14f5ca-cdd4-4caa-94de-f7d7882916e0\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.745046 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8185e910-6b4a-4897-a27c-7f07b936beb8-logs\") pod \"nova-metadata-0\" (UID: \"8185e910-6b4a-4897-a27c-7f07b936beb8\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.747630 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7b14f5ca-cdd4-4caa-94de-f7d7882916e0-config-data\") pod \"nova-api-0\" (UID: \"7b14f5ca-cdd4-4caa-94de-f7d7882916e0\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.751313 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/7b14f5ca-cdd4-4caa-94de-f7d7882916e0-public-tls-certs\") pod \"nova-api-0\" (UID: \"7b14f5ca-cdd4-4caa-94de-f7d7882916e0\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.757927 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdftm\" (UniqueName: \"kubernetes.io/projected/7b14f5ca-cdd4-4caa-94de-f7d7882916e0-kube-api-access-wdftm\") pod \"nova-api-0\" (UID: \"7b14f5ca-cdd4-4caa-94de-f7d7882916e0\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.758092 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfdnx\" (UniqueName: \"kubernetes.io/projected/8185e910-6b4a-4897-a27c-7f07b936beb8-kube-api-access-zfdnx\") pod \"nova-metadata-0\" (UID: \"8185e910-6b4a-4897-a27c-7f07b936beb8\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.817900 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.829009 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.840752 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7593b082-fbd5-4f23-9b9b-8ee3d2a559d4-combined-ca-bundle\") pod \"7593b082-fbd5-4f23-9b9b-8ee3d2a559d4\" (UID: \"7593b082-fbd5-4f23-9b9b-8ee3d2a559d4\") " Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.840979 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zz5p7\" (UniqueName: \"kubernetes.io/projected/7593b082-fbd5-4f23-9b9b-8ee3d2a559d4-kube-api-access-zz5p7\") pod \"7593b082-fbd5-4f23-9b9b-8ee3d2a559d4\" (UID: \"7593b082-fbd5-4f23-9b9b-8ee3d2a559d4\") " Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.841158 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7593b082-fbd5-4f23-9b9b-8ee3d2a559d4-config-data\") pod \"7593b082-fbd5-4f23-9b9b-8ee3d2a559d4\" (UID: \"7593b082-fbd5-4f23-9b9b-8ee3d2a559d4\") " Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.845230 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7593b082-fbd5-4f23-9b9b-8ee3d2a559d4-kube-api-access-zz5p7" (OuterVolumeSpecName: "kube-api-access-zz5p7") pod "7593b082-fbd5-4f23-9b9b-8ee3d2a559d4" (UID: "7593b082-fbd5-4f23-9b9b-8ee3d2a559d4"). InnerVolumeSpecName "kube-api-access-zz5p7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.874477 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7593b082-fbd5-4f23-9b9b-8ee3d2a559d4-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "7593b082-fbd5-4f23-9b9b-8ee3d2a559d4" (UID: "7593b082-fbd5-4f23-9b9b-8ee3d2a559d4"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.875823 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7593b082-fbd5-4f23-9b9b-8ee3d2a559d4-config-data" (OuterVolumeSpecName: "config-data") pod "7593b082-fbd5-4f23-9b9b-8ee3d2a559d4" (UID: "7593b082-fbd5-4f23-9b9b-8ee3d2a559d4"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.948221 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7593b082-fbd5-4f23-9b9b-8ee3d2a559d4-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.948563 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zz5p7\" (UniqueName: \"kubernetes.io/projected/7593b082-fbd5-4f23-9b9b-8ee3d2a559d4-kube-api-access-zz5p7\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:13 crc kubenswrapper[5120]: I0316 16:37:13.948584 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7593b082-fbd5-4f23-9b9b-8ee3d2a559d4-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:14 crc kubenswrapper[5120]: I0316 16:37:14.061221 5120 generic.go:358] "Generic (PLEG): container finished" podID="7593b082-fbd5-4f23-9b9b-8ee3d2a559d4" containerID="68fff3c8380e1b5836874d33acb538e8c0c491806845c73325ad47d4c76c7df3" exitCode=0 Mar 16 16:37:14 crc kubenswrapper[5120]: I0316 16:37:14.061381 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:37:14 crc kubenswrapper[5120]: I0316 16:37:14.061567 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"7593b082-fbd5-4f23-9b9b-8ee3d2a559d4","Type":"ContainerDied","Data":"68fff3c8380e1b5836874d33acb538e8c0c491806845c73325ad47d4c76c7df3"} Mar 16 16:37:14 crc kubenswrapper[5120]: I0316 16:37:14.061604 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"7593b082-fbd5-4f23-9b9b-8ee3d2a559d4","Type":"ContainerDied","Data":"5aacbdef993fdeac9897d5de5bfc9af940a3cf3007c93d689edb2aff8d80c7e6"} Mar 16 16:37:14 crc kubenswrapper[5120]: I0316 16:37:14.061622 5120 scope.go:117] "RemoveContainer" containerID="68fff3c8380e1b5836874d33acb538e8c0c491806845c73325ad47d4c76c7df3" Mar 16 16:37:14 crc kubenswrapper[5120]: I0316 16:37:14.102321 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:37:14 crc kubenswrapper[5120]: I0316 16:37:14.121841 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:37:14 crc kubenswrapper[5120]: I0316 16:37:14.127936 5120 scope.go:117] "RemoveContainer" containerID="68fff3c8380e1b5836874d33acb538e8c0c491806845c73325ad47d4c76c7df3" Mar 16 16:37:14 crc kubenswrapper[5120]: E0316 16:37:14.128490 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"68fff3c8380e1b5836874d33acb538e8c0c491806845c73325ad47d4c76c7df3\": container with ID starting with 68fff3c8380e1b5836874d33acb538e8c0c491806845c73325ad47d4c76c7df3 not found: ID does not exist" containerID="68fff3c8380e1b5836874d33acb538e8c0c491806845c73325ad47d4c76c7df3" Mar 16 16:37:14 crc kubenswrapper[5120]: I0316 16:37:14.128516 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"68fff3c8380e1b5836874d33acb538e8c0c491806845c73325ad47d4c76c7df3"} err="failed to get container status \"68fff3c8380e1b5836874d33acb538e8c0c491806845c73325ad47d4c76c7df3\": rpc error: code = NotFound desc = could not find container \"68fff3c8380e1b5836874d33acb538e8c0c491806845c73325ad47d4c76c7df3\": container with ID starting with 68fff3c8380e1b5836874d33acb538e8c0c491806845c73325ad47d4c76c7df3 not found: ID does not exist" Mar 16 16:37:14 crc kubenswrapper[5120]: I0316 16:37:14.143001 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:37:14 crc kubenswrapper[5120]: I0316 16:37:14.144198 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7593b082-fbd5-4f23-9b9b-8ee3d2a559d4" containerName="nova-scheduler-scheduler" Mar 16 16:37:14 crc kubenswrapper[5120]: I0316 16:37:14.144216 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7593b082-fbd5-4f23-9b9b-8ee3d2a559d4" containerName="nova-scheduler-scheduler" Mar 16 16:37:14 crc kubenswrapper[5120]: I0316 16:37:14.144445 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7593b082-fbd5-4f23-9b9b-8ee3d2a559d4" containerName="nova-scheduler-scheduler" Mar 16 16:37:14 crc kubenswrapper[5120]: I0316 16:37:14.154614 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:37:14 crc kubenswrapper[5120]: I0316 16:37:14.157333 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-scheduler-config-data\"" Mar 16 16:37:14 crc kubenswrapper[5120]: I0316 16:37:14.157722 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:37:14 crc kubenswrapper[5120]: I0316 16:37:14.258072 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjf7s\" (UniqueName: \"kubernetes.io/projected/c1a2ba61-a67d-4937-9979-9f10c744a1a8-kube-api-access-sjf7s\") pod \"nova-scheduler-0\" (UID: \"c1a2ba61-a67d-4937-9979-9f10c744a1a8\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:37:14 crc kubenswrapper[5120]: I0316 16:37:14.258241 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c1a2ba61-a67d-4937-9979-9f10c744a1a8-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"c1a2ba61-a67d-4937-9979-9f10c744a1a8\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:37:14 crc kubenswrapper[5120]: I0316 16:37:14.258371 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c1a2ba61-a67d-4937-9979-9f10c744a1a8-config-data\") pod \"nova-scheduler-0\" (UID: \"c1a2ba61-a67d-4937-9979-9f10c744a1a8\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:37:14 crc kubenswrapper[5120]: I0316 16:37:14.328995 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:37:14 crc kubenswrapper[5120]: I0316 16:37:14.361235 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c1a2ba61-a67d-4937-9979-9f10c744a1a8-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"c1a2ba61-a67d-4937-9979-9f10c744a1a8\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:37:14 crc kubenswrapper[5120]: I0316 16:37:14.361374 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c1a2ba61-a67d-4937-9979-9f10c744a1a8-config-data\") pod \"nova-scheduler-0\" (UID: \"c1a2ba61-a67d-4937-9979-9f10c744a1a8\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:37:14 crc kubenswrapper[5120]: I0316 16:37:14.361608 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sjf7s\" (UniqueName: \"kubernetes.io/projected/c1a2ba61-a67d-4937-9979-9f10c744a1a8-kube-api-access-sjf7s\") pod \"nova-scheduler-0\" (UID: \"c1a2ba61-a67d-4937-9979-9f10c744a1a8\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:37:14 crc kubenswrapper[5120]: I0316 16:37:14.369530 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c1a2ba61-a67d-4937-9979-9f10c744a1a8-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"c1a2ba61-a67d-4937-9979-9f10c744a1a8\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:37:14 crc kubenswrapper[5120]: I0316 16:37:14.372374 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c1a2ba61-a67d-4937-9979-9f10c744a1a8-config-data\") pod \"nova-scheduler-0\" (UID: \"c1a2ba61-a67d-4937-9979-9f10c744a1a8\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:37:14 crc kubenswrapper[5120]: I0316 16:37:14.383545 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjf7s\" (UniqueName: \"kubernetes.io/projected/c1a2ba61-a67d-4937-9979-9f10c744a1a8-kube-api-access-sjf7s\") pod \"nova-scheduler-0\" (UID: \"c1a2ba61-a67d-4937-9979-9f10c744a1a8\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:37:14 crc kubenswrapper[5120]: W0316 16:37:14.458036 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8185e910_6b4a_4897_a27c_7f07b936beb8.slice/crio-b800e02dc61683c4a8ba799ff13c95b093d4d68409c2f9cfa2da8c0f122ebd3d WatchSource:0}: Error finding container b800e02dc61683c4a8ba799ff13c95b093d4d68409c2f9cfa2da8c0f122ebd3d: Status 404 returned error can't find the container with id b800e02dc61683c4a8ba799ff13c95b093d4d68409c2f9cfa2da8c0f122ebd3d Mar 16 16:37:14 crc kubenswrapper[5120]: I0316 16:37:14.460987 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:37:14 crc kubenswrapper[5120]: I0316 16:37:14.477882 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:37:14 crc kubenswrapper[5120]: I0316 16:37:14.697564 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="56ab5925-779b-43f4-89e6-27226d0363db" path="/var/lib/kubelet/pods/56ab5925-779b-43f4-89e6-27226d0363db/volumes" Mar 16 16:37:14 crc kubenswrapper[5120]: I0316 16:37:14.698397 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7593b082-fbd5-4f23-9b9b-8ee3d2a559d4" path="/var/lib/kubelet/pods/7593b082-fbd5-4f23-9b9b-8ee3d2a559d4/volumes" Mar 16 16:37:14 crc kubenswrapper[5120]: I0316 16:37:14.699033 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e8b9ac0b-60ab-4b23-a6ab-766adba26d26" path="/var/lib/kubelet/pods/e8b9ac0b-60ab-4b23-a6ab-766adba26d26/volumes" Mar 16 16:37:15 crc kubenswrapper[5120]: I0316 16:37:15.075618 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:37:15 crc kubenswrapper[5120]: I0316 16:37:15.088047 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"8185e910-6b4a-4897-a27c-7f07b936beb8","Type":"ContainerStarted","Data":"4b251df29f9b7181015a5b31f936df9e97b0207ef1ef63d303d6c87589a0f9a4"} Mar 16 16:37:15 crc kubenswrapper[5120]: I0316 16:37:15.088092 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"8185e910-6b4a-4897-a27c-7f07b936beb8","Type":"ContainerStarted","Data":"b800e02dc61683c4a8ba799ff13c95b093d4d68409c2f9cfa2da8c0f122ebd3d"} Mar 16 16:37:15 crc kubenswrapper[5120]: I0316 16:37:15.090949 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"7b14f5ca-cdd4-4caa-94de-f7d7882916e0","Type":"ContainerStarted","Data":"277a25664e86689ff38b712666321a5332eeca8fcc6856cf5361da4664ea4317"} Mar 16 16:37:15 crc kubenswrapper[5120]: I0316 16:37:15.090974 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"7b14f5ca-cdd4-4caa-94de-f7d7882916e0","Type":"ContainerStarted","Data":"eb666931cf209c1ad5486fab5456e86421aafc6e7a7a1277b31c6cd8e680225a"} Mar 16 16:37:15 crc kubenswrapper[5120]: W0316 16:37:15.091836 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc1a2ba61_a67d_4937_9979_9f10c744a1a8.slice/crio-b48e11f045227897d970f4750b2d8284cad910604b6b473513b7d08c7b57f424 WatchSource:0}: Error finding container b48e11f045227897d970f4750b2d8284cad910604b6b473513b7d08c7b57f424: Status 404 returned error can't find the container with id b48e11f045227897d970f4750b2d8284cad910604b6b473513b7d08c7b57f424 Mar 16 16:37:15 crc kubenswrapper[5120]: I0316 16:37:15.270144 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/keystone-5769b4cdff-x2jfw" Mar 16 16:37:15 crc kubenswrapper[5120]: I0316 16:37:15.346579 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-768f4979c4-gbb88"] Mar 16 16:37:15 crc kubenswrapper[5120]: I0316 16:37:15.352602 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/keystone-768f4979c4-gbb88" podUID="ccd55653-57a9-4f28-90b6-6882e92b937e" containerName="keystone-api" containerID="cri-o://7fa7e7af3841675a24bfbd9a2b6742b345635242bdc066da72bb7d0b19aa4765" gracePeriod=30 Mar 16 16:37:16 crc kubenswrapper[5120]: I0316 16:37:16.106115 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"c1a2ba61-a67d-4937-9979-9f10c744a1a8","Type":"ContainerStarted","Data":"cb21c359b23b03f5e91a52989546953e9e8fad15e126dc02107149d24a46a45b"} Mar 16 16:37:16 crc kubenswrapper[5120]: I0316 16:37:16.106182 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"c1a2ba61-a67d-4937-9979-9f10c744a1a8","Type":"ContainerStarted","Data":"b48e11f045227897d970f4750b2d8284cad910604b6b473513b7d08c7b57f424"} Mar 16 16:37:16 crc kubenswrapper[5120]: I0316 16:37:16.112689 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"8185e910-6b4a-4897-a27c-7f07b936beb8","Type":"ContainerStarted","Data":"23eeffc81ea64adda7d1ec2a8f840580914c6c9f5e5047584b49b36400d52bae"} Mar 16 16:37:16 crc kubenswrapper[5120]: I0316 16:37:16.116077 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"7b14f5ca-cdd4-4caa-94de-f7d7882916e0","Type":"ContainerStarted","Data":"c913385caec36960e81c6124367c10c09682f69742dea3477af9e50a7bfb90e7"} Mar 16 16:37:16 crc kubenswrapper[5120]: I0316 16:37:16.128818 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-scheduler-0" podStartSLOduration=2.128738254 podStartE2EDuration="2.128738254s" podCreationTimestamp="2026-03-16 16:37:14 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:37:16.123794755 +0000 UTC m=+3938.277726412" watchObservedRunningTime="2026-03-16 16:37:16.128738254 +0000 UTC m=+3938.282669921" Mar 16 16:37:16 crc kubenswrapper[5120]: I0316 16:37:16.155744 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=3.155723911 podStartE2EDuration="3.155723911s" podCreationTimestamp="2026-03-16 16:37:13 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:37:16.141954081 +0000 UTC m=+3938.295885768" watchObservedRunningTime="2026-03-16 16:37:16.155723911 +0000 UTC m=+3938.309655568" Mar 16 16:37:16 crc kubenswrapper[5120]: I0316 16:37:16.175004 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=3.174983994 podStartE2EDuration="3.174983994s" podCreationTimestamp="2026-03-16 16:37:13 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:37:16.16642294 +0000 UTC m=+3938.320354597" watchObservedRunningTime="2026-03-16 16:37:16.174983994 +0000 UTC m=+3938.328915651" Mar 16 16:37:16 crc kubenswrapper[5120]: I0316 16:37:16.248666 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 16:37:16 crc kubenswrapper[5120]: I0316 16:37:16.248920 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/openstackclient" podUID="a3c1d88e-f441-4b4d-97c8-111682a67174" containerName="openstackclient" containerID="cri-o://62cc59bc413d7a87f2df901178e58ae330c336829d397ee0126fb83e5086ce15" gracePeriod=2 Mar 16 16:37:16 crc kubenswrapper[5120]: I0316 16:37:16.253142 5120 status_manager.go:895] "Failed to get status for pod" podUID="a3c1d88e-f441-4b4d-97c8-111682a67174" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 16:37:16 crc kubenswrapper[5120]: I0316 16:37:16.258924 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 16:37:16 crc kubenswrapper[5120]: I0316 16:37:16.297417 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 16:37:16 crc kubenswrapper[5120]: I0316 16:37:16.300073 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3c1d88e-f441-4b4d-97c8-111682a67174" containerName="openstackclient" Mar 16 16:37:16 crc kubenswrapper[5120]: I0316 16:37:16.300257 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3c1d88e-f441-4b4d-97c8-111682a67174" containerName="openstackclient" Mar 16 16:37:16 crc kubenswrapper[5120]: I0316 16:37:16.301049 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="a3c1d88e-f441-4b4d-97c8-111682a67174" containerName="openstackclient" Mar 16 16:37:16 crc kubenswrapper[5120]: I0316 16:37:16.314250 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 16:37:16 crc kubenswrapper[5120]: I0316 16:37:16.314834 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Mar 16 16:37:16 crc kubenswrapper[5120]: I0316 16:37:16.317926 5120 status_manager.go:905] "Pod was deleted and then recreated, skipping status update" pod="openstack-kuttl-tests/openstackclient" oldPodUID="a3c1d88e-f441-4b4d-97c8-111682a67174" podUID="b71a657e-9182-423d-90a8-cded4f72f6a3" Mar 16 16:37:16 crc kubenswrapper[5120]: I0316 16:37:16.417470 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/b71a657e-9182-423d-90a8-cded4f72f6a3-openstack-config-secret\") pod \"openstackclient\" (UID: \"b71a657e-9182-423d-90a8-cded4f72f6a3\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:37:16 crc kubenswrapper[5120]: I0316 16:37:16.417511 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b71a657e-9182-423d-90a8-cded4f72f6a3-combined-ca-bundle\") pod \"openstackclient\" (UID: \"b71a657e-9182-423d-90a8-cded4f72f6a3\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:37:16 crc kubenswrapper[5120]: I0316 16:37:16.417547 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhjvx\" (UniqueName: \"kubernetes.io/projected/b71a657e-9182-423d-90a8-cded4f72f6a3-kube-api-access-hhjvx\") pod \"openstackclient\" (UID: \"b71a657e-9182-423d-90a8-cded4f72f6a3\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:37:16 crc kubenswrapper[5120]: I0316 16:37:16.417572 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/b71a657e-9182-423d-90a8-cded4f72f6a3-openstack-config\") pod \"openstackclient\" (UID: \"b71a657e-9182-423d-90a8-cded4f72f6a3\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:37:16 crc kubenswrapper[5120]: I0316 16:37:16.520788 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/b71a657e-9182-423d-90a8-cded4f72f6a3-openstack-config-secret\") pod \"openstackclient\" (UID: \"b71a657e-9182-423d-90a8-cded4f72f6a3\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:37:16 crc kubenswrapper[5120]: I0316 16:37:16.521137 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b71a657e-9182-423d-90a8-cded4f72f6a3-combined-ca-bundle\") pod \"openstackclient\" (UID: \"b71a657e-9182-423d-90a8-cded4f72f6a3\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:37:16 crc kubenswrapper[5120]: I0316 16:37:16.521275 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hhjvx\" (UniqueName: \"kubernetes.io/projected/b71a657e-9182-423d-90a8-cded4f72f6a3-kube-api-access-hhjvx\") pod \"openstackclient\" (UID: \"b71a657e-9182-423d-90a8-cded4f72f6a3\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:37:16 crc kubenswrapper[5120]: I0316 16:37:16.521414 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/b71a657e-9182-423d-90a8-cded4f72f6a3-openstack-config\") pod \"openstackclient\" (UID: \"b71a657e-9182-423d-90a8-cded4f72f6a3\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:37:16 crc kubenswrapper[5120]: I0316 16:37:16.522611 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/b71a657e-9182-423d-90a8-cded4f72f6a3-openstack-config\") pod \"openstackclient\" (UID: \"b71a657e-9182-423d-90a8-cded4f72f6a3\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:37:16 crc kubenswrapper[5120]: I0316 16:37:16.530785 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/b71a657e-9182-423d-90a8-cded4f72f6a3-openstack-config-secret\") pod \"openstackclient\" (UID: \"b71a657e-9182-423d-90a8-cded4f72f6a3\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:37:16 crc kubenswrapper[5120]: I0316 16:37:16.533479 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b71a657e-9182-423d-90a8-cded4f72f6a3-combined-ca-bundle\") pod \"openstackclient\" (UID: \"b71a657e-9182-423d-90a8-cded4f72f6a3\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:37:16 crc kubenswrapper[5120]: I0316 16:37:16.542539 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhjvx\" (UniqueName: \"kubernetes.io/projected/b71a657e-9182-423d-90a8-cded4f72f6a3-kube-api-access-hhjvx\") pod \"openstackclient\" (UID: \"b71a657e-9182-423d-90a8-cded4f72f6a3\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:37:16 crc kubenswrapper[5120]: I0316 16:37:16.638639 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Mar 16 16:37:17 crc kubenswrapper[5120]: I0316 16:37:17.154330 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 16:37:18 crc kubenswrapper[5120]: I0316 16:37:18.139255 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstackclient" event={"ID":"b71a657e-9182-423d-90a8-cded4f72f6a3","Type":"ContainerStarted","Data":"0ed7d00e82acd5aef2a9bbb3266fe2ba73ea73319c94729a44be280b82a4b1d9"} Mar 16 16:37:18 crc kubenswrapper[5120]: I0316 16:37:18.139713 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstackclient" event={"ID":"b71a657e-9182-423d-90a8-cded4f72f6a3","Type":"ContainerStarted","Data":"486ae1c739b8a68c6e55c4d57756df0b2f8a099353963e39add6ca1a8f383669"} Mar 16 16:37:18 crc kubenswrapper[5120]: I0316 16:37:18.170716 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstackclient" podStartSLOduration=2.170693962 podStartE2EDuration="2.170693962s" podCreationTimestamp="2026-03-16 16:37:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:37:18.158292917 +0000 UTC m=+3940.312224574" watchObservedRunningTime="2026-03-16 16:37:18.170693962 +0000 UTC m=+3940.324625609" Mar 16 16:37:18 crc kubenswrapper[5120]: I0316 16:37:18.724419 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Mar 16 16:37:18 crc kubenswrapper[5120]: I0316 16:37:18.727381 5120 status_manager.go:905] "Pod was deleted and then recreated, skipping status update" pod="openstack-kuttl-tests/openstackclient" oldPodUID="a3c1d88e-f441-4b4d-97c8-111682a67174" podUID="b71a657e-9182-423d-90a8-cded4f72f6a3" Mar 16 16:37:18 crc kubenswrapper[5120]: I0316 16:37:18.885826 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a3c1d88e-f441-4b4d-97c8-111682a67174-combined-ca-bundle\") pod \"a3c1d88e-f441-4b4d-97c8-111682a67174\" (UID: \"a3c1d88e-f441-4b4d-97c8-111682a67174\") " Mar 16 16:37:18 crc kubenswrapper[5120]: I0316 16:37:18.886955 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/a3c1d88e-f441-4b4d-97c8-111682a67174-openstack-config-secret\") pod \"a3c1d88e-f441-4b4d-97c8-111682a67174\" (UID: \"a3c1d88e-f441-4b4d-97c8-111682a67174\") " Mar 16 16:37:18 crc kubenswrapper[5120]: I0316 16:37:18.887522 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/a3c1d88e-f441-4b4d-97c8-111682a67174-openstack-config\") pod \"a3c1d88e-f441-4b4d-97c8-111682a67174\" (UID: \"a3c1d88e-f441-4b4d-97c8-111682a67174\") " Mar 16 16:37:18 crc kubenswrapper[5120]: I0316 16:37:18.887578 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jqs48\" (UniqueName: \"kubernetes.io/projected/a3c1d88e-f441-4b4d-97c8-111682a67174-kube-api-access-jqs48\") pod \"a3c1d88e-f441-4b4d-97c8-111682a67174\" (UID: \"a3c1d88e-f441-4b4d-97c8-111682a67174\") " Mar 16 16:37:18 crc kubenswrapper[5120]: I0316 16:37:18.899020 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3c1d88e-f441-4b4d-97c8-111682a67174-kube-api-access-jqs48" (OuterVolumeSpecName: "kube-api-access-jqs48") pod "a3c1d88e-f441-4b4d-97c8-111682a67174" (UID: "a3c1d88e-f441-4b4d-97c8-111682a67174"). InnerVolumeSpecName "kube-api-access-jqs48". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:37:18 crc kubenswrapper[5120]: I0316 16:37:18.918268 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a3c1d88e-f441-4b4d-97c8-111682a67174-openstack-config" (OuterVolumeSpecName: "openstack-config") pod "a3c1d88e-f441-4b4d-97c8-111682a67174" (UID: "a3c1d88e-f441-4b4d-97c8-111682a67174"). InnerVolumeSpecName "openstack-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:37:18 crc kubenswrapper[5120]: I0316 16:37:18.955556 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-768f4979c4-gbb88" Mar 16 16:37:18 crc kubenswrapper[5120]: I0316 16:37:18.956027 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a3c1d88e-f441-4b4d-97c8-111682a67174-openstack-config-secret" (OuterVolumeSpecName: "openstack-config-secret") pod "a3c1d88e-f441-4b4d-97c8-111682a67174" (UID: "a3c1d88e-f441-4b4d-97c8-111682a67174"). InnerVolumeSpecName "openstack-config-secret". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:18 crc kubenswrapper[5120]: I0316 16:37:18.958250 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a3c1d88e-f441-4b4d-97c8-111682a67174-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "a3c1d88e-f441-4b4d-97c8-111682a67174" (UID: "a3c1d88e-f441-4b4d-97c8-111682a67174"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:18 crc kubenswrapper[5120]: I0316 16:37:18.994715 5120 reconciler_common.go:299] "Volume detached for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/a3c1d88e-f441-4b4d-97c8-111682a67174-openstack-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:18 crc kubenswrapper[5120]: I0316 16:37:18.994747 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jqs48\" (UniqueName: \"kubernetes.io/projected/a3c1d88e-f441-4b4d-97c8-111682a67174-kube-api-access-jqs48\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:18 crc kubenswrapper[5120]: I0316 16:37:18.994774 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a3c1d88e-f441-4b4d-97c8-111682a67174-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:18 crc kubenswrapper[5120]: I0316 16:37:18.994785 5120 reconciler_common.go:299] "Volume detached for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/a3c1d88e-f441-4b4d-97c8-111682a67174-openstack-config-secret\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:19 crc kubenswrapper[5120]: I0316 16:37:19.095943 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/ccd55653-57a9-4f28-90b6-6882e92b937e-fernet-keys\") pod \"ccd55653-57a9-4f28-90b6-6882e92b937e\" (UID: \"ccd55653-57a9-4f28-90b6-6882e92b937e\") " Mar 16 16:37:19 crc kubenswrapper[5120]: I0316 16:37:19.096074 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/ccd55653-57a9-4f28-90b6-6882e92b937e-internal-tls-certs\") pod \"ccd55653-57a9-4f28-90b6-6882e92b937e\" (UID: \"ccd55653-57a9-4f28-90b6-6882e92b937e\") " Mar 16 16:37:19 crc kubenswrapper[5120]: I0316 16:37:19.096108 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ccd55653-57a9-4f28-90b6-6882e92b937e-combined-ca-bundle\") pod \"ccd55653-57a9-4f28-90b6-6882e92b937e\" (UID: \"ccd55653-57a9-4f28-90b6-6882e92b937e\") " Mar 16 16:37:19 crc kubenswrapper[5120]: I0316 16:37:19.096217 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ccd55653-57a9-4f28-90b6-6882e92b937e-config-data\") pod \"ccd55653-57a9-4f28-90b6-6882e92b937e\" (UID: \"ccd55653-57a9-4f28-90b6-6882e92b937e\") " Mar 16 16:37:19 crc kubenswrapper[5120]: I0316 16:37:19.096279 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ccd55653-57a9-4f28-90b6-6882e92b937e-public-tls-certs\") pod \"ccd55653-57a9-4f28-90b6-6882e92b937e\" (UID: \"ccd55653-57a9-4f28-90b6-6882e92b937e\") " Mar 16 16:37:19 crc kubenswrapper[5120]: I0316 16:37:19.096374 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/ccd55653-57a9-4f28-90b6-6882e92b937e-credential-keys\") pod \"ccd55653-57a9-4f28-90b6-6882e92b937e\" (UID: \"ccd55653-57a9-4f28-90b6-6882e92b937e\") " Mar 16 16:37:19 crc kubenswrapper[5120]: I0316 16:37:19.096595 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ccd55653-57a9-4f28-90b6-6882e92b937e-scripts\") pod \"ccd55653-57a9-4f28-90b6-6882e92b937e\" (UID: \"ccd55653-57a9-4f28-90b6-6882e92b937e\") " Mar 16 16:37:19 crc kubenswrapper[5120]: I0316 16:37:19.096847 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tv8s2\" (UniqueName: \"kubernetes.io/projected/ccd55653-57a9-4f28-90b6-6882e92b937e-kube-api-access-tv8s2\") pod \"ccd55653-57a9-4f28-90b6-6882e92b937e\" (UID: \"ccd55653-57a9-4f28-90b6-6882e92b937e\") " Mar 16 16:37:19 crc kubenswrapper[5120]: I0316 16:37:19.101501 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ccd55653-57a9-4f28-90b6-6882e92b937e-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "ccd55653-57a9-4f28-90b6-6882e92b937e" (UID: "ccd55653-57a9-4f28-90b6-6882e92b937e"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:19 crc kubenswrapper[5120]: I0316 16:37:19.104967 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ccd55653-57a9-4f28-90b6-6882e92b937e-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "ccd55653-57a9-4f28-90b6-6882e92b937e" (UID: "ccd55653-57a9-4f28-90b6-6882e92b937e"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:19 crc kubenswrapper[5120]: I0316 16:37:19.104973 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ccd55653-57a9-4f28-90b6-6882e92b937e-kube-api-access-tv8s2" (OuterVolumeSpecName: "kube-api-access-tv8s2") pod "ccd55653-57a9-4f28-90b6-6882e92b937e" (UID: "ccd55653-57a9-4f28-90b6-6882e92b937e"). InnerVolumeSpecName "kube-api-access-tv8s2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:37:19 crc kubenswrapper[5120]: I0316 16:37:19.105804 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ccd55653-57a9-4f28-90b6-6882e92b937e-scripts" (OuterVolumeSpecName: "scripts") pod "ccd55653-57a9-4f28-90b6-6882e92b937e" (UID: "ccd55653-57a9-4f28-90b6-6882e92b937e"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:19 crc kubenswrapper[5120]: I0316 16:37:19.127917 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ccd55653-57a9-4f28-90b6-6882e92b937e-config-data" (OuterVolumeSpecName: "config-data") pod "ccd55653-57a9-4f28-90b6-6882e92b937e" (UID: "ccd55653-57a9-4f28-90b6-6882e92b937e"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:19 crc kubenswrapper[5120]: I0316 16:37:19.136813 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ccd55653-57a9-4f28-90b6-6882e92b937e-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ccd55653-57a9-4f28-90b6-6882e92b937e" (UID: "ccd55653-57a9-4f28-90b6-6882e92b937e"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:19 crc kubenswrapper[5120]: I0316 16:37:19.155349 5120 generic.go:358] "Generic (PLEG): container finished" podID="ccd55653-57a9-4f28-90b6-6882e92b937e" containerID="7fa7e7af3841675a24bfbd9a2b6742b345635242bdc066da72bb7d0b19aa4765" exitCode=0 Mar 16 16:37:19 crc kubenswrapper[5120]: I0316 16:37:19.155486 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-768f4979c4-gbb88" event={"ID":"ccd55653-57a9-4f28-90b6-6882e92b937e","Type":"ContainerDied","Data":"7fa7e7af3841675a24bfbd9a2b6742b345635242bdc066da72bb7d0b19aa4765"} Mar 16 16:37:19 crc kubenswrapper[5120]: I0316 16:37:19.155515 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-768f4979c4-gbb88" event={"ID":"ccd55653-57a9-4f28-90b6-6882e92b937e","Type":"ContainerDied","Data":"a069ff3a8050fb417cb0e8f46c2dfe1402ebf891f59d8eaddd2693534794ebe3"} Mar 16 16:37:19 crc kubenswrapper[5120]: I0316 16:37:19.155530 5120 scope.go:117] "RemoveContainer" containerID="7fa7e7af3841675a24bfbd9a2b6742b345635242bdc066da72bb7d0b19aa4765" Mar 16 16:37:19 crc kubenswrapper[5120]: I0316 16:37:19.155665 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-768f4979c4-gbb88" Mar 16 16:37:19 crc kubenswrapper[5120]: I0316 16:37:19.160196 5120 generic.go:358] "Generic (PLEG): container finished" podID="a3c1d88e-f441-4b4d-97c8-111682a67174" containerID="62cc59bc413d7a87f2df901178e58ae330c336829d397ee0126fb83e5086ce15" exitCode=137 Mar 16 16:37:19 crc kubenswrapper[5120]: I0316 16:37:19.161285 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Mar 16 16:37:19 crc kubenswrapper[5120]: I0316 16:37:19.164588 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ccd55653-57a9-4f28-90b6-6882e92b937e-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "ccd55653-57a9-4f28-90b6-6882e92b937e" (UID: "ccd55653-57a9-4f28-90b6-6882e92b937e"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:19 crc kubenswrapper[5120]: I0316 16:37:19.164213 5120 status_manager.go:905] "Pod was deleted and then recreated, skipping status update" pod="openstack-kuttl-tests/openstackclient" oldPodUID="a3c1d88e-f441-4b4d-97c8-111682a67174" podUID="b71a657e-9182-423d-90a8-cded4f72f6a3" Mar 16 16:37:19 crc kubenswrapper[5120]: I0316 16:37:19.165083 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ccd55653-57a9-4f28-90b6-6882e92b937e-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "ccd55653-57a9-4f28-90b6-6882e92b937e" (UID: "ccd55653-57a9-4f28-90b6-6882e92b937e"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:19 crc kubenswrapper[5120]: I0316 16:37:19.178850 5120 status_manager.go:905] "Pod was deleted and then recreated, skipping status update" pod="openstack-kuttl-tests/openstackclient" oldPodUID="a3c1d88e-f441-4b4d-97c8-111682a67174" podUID="b71a657e-9182-423d-90a8-cded4f72f6a3" Mar 16 16:37:19 crc kubenswrapper[5120]: I0316 16:37:19.185100 5120 scope.go:117] "RemoveContainer" containerID="7fa7e7af3841675a24bfbd9a2b6742b345635242bdc066da72bb7d0b19aa4765" Mar 16 16:37:19 crc kubenswrapper[5120]: E0316 16:37:19.185480 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7fa7e7af3841675a24bfbd9a2b6742b345635242bdc066da72bb7d0b19aa4765\": container with ID starting with 7fa7e7af3841675a24bfbd9a2b6742b345635242bdc066da72bb7d0b19aa4765 not found: ID does not exist" containerID="7fa7e7af3841675a24bfbd9a2b6742b345635242bdc066da72bb7d0b19aa4765" Mar 16 16:37:19 crc kubenswrapper[5120]: I0316 16:37:19.185527 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7fa7e7af3841675a24bfbd9a2b6742b345635242bdc066da72bb7d0b19aa4765"} err="failed to get container status \"7fa7e7af3841675a24bfbd9a2b6742b345635242bdc066da72bb7d0b19aa4765\": rpc error: code = NotFound desc = could not find container \"7fa7e7af3841675a24bfbd9a2b6742b345635242bdc066da72bb7d0b19aa4765\": container with ID starting with 7fa7e7af3841675a24bfbd9a2b6742b345635242bdc066da72bb7d0b19aa4765 not found: ID does not exist" Mar 16 16:37:19 crc kubenswrapper[5120]: I0316 16:37:19.185555 5120 scope.go:117] "RemoveContainer" containerID="62cc59bc413d7a87f2df901178e58ae330c336829d397ee0126fb83e5086ce15" Mar 16 16:37:19 crc kubenswrapper[5120]: I0316 16:37:19.199990 5120 reconciler_common.go:299] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/ccd55653-57a9-4f28-90b6-6882e92b937e-fernet-keys\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:19 crc kubenswrapper[5120]: I0316 16:37:19.200029 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/ccd55653-57a9-4f28-90b6-6882e92b937e-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:19 crc kubenswrapper[5120]: I0316 16:37:19.200040 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ccd55653-57a9-4f28-90b6-6882e92b937e-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:19 crc kubenswrapper[5120]: I0316 16:37:19.200049 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ccd55653-57a9-4f28-90b6-6882e92b937e-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:19 crc kubenswrapper[5120]: I0316 16:37:19.200058 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ccd55653-57a9-4f28-90b6-6882e92b937e-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:19 crc kubenswrapper[5120]: I0316 16:37:19.200070 5120 reconciler_common.go:299] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/ccd55653-57a9-4f28-90b6-6882e92b937e-credential-keys\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:19 crc kubenswrapper[5120]: I0316 16:37:19.200079 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ccd55653-57a9-4f28-90b6-6882e92b937e-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:19 crc kubenswrapper[5120]: I0316 16:37:19.200087 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tv8s2\" (UniqueName: \"kubernetes.io/projected/ccd55653-57a9-4f28-90b6-6882e92b937e-kube-api-access-tv8s2\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:19 crc kubenswrapper[5120]: I0316 16:37:19.216565 5120 scope.go:117] "RemoveContainer" containerID="62cc59bc413d7a87f2df901178e58ae330c336829d397ee0126fb83e5086ce15" Mar 16 16:37:19 crc kubenswrapper[5120]: E0316 16:37:19.217142 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"62cc59bc413d7a87f2df901178e58ae330c336829d397ee0126fb83e5086ce15\": container with ID starting with 62cc59bc413d7a87f2df901178e58ae330c336829d397ee0126fb83e5086ce15 not found: ID does not exist" containerID="62cc59bc413d7a87f2df901178e58ae330c336829d397ee0126fb83e5086ce15" Mar 16 16:37:19 crc kubenswrapper[5120]: I0316 16:37:19.217189 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62cc59bc413d7a87f2df901178e58ae330c336829d397ee0126fb83e5086ce15"} err="failed to get container status \"62cc59bc413d7a87f2df901178e58ae330c336829d397ee0126fb83e5086ce15\": rpc error: code = NotFound desc = could not find container \"62cc59bc413d7a87f2df901178e58ae330c336829d397ee0126fb83e5086ce15\": container with ID starting with 62cc59bc413d7a87f2df901178e58ae330c336829d397ee0126fb83e5086ce15 not found: ID does not exist" Mar 16 16:37:19 crc kubenswrapper[5120]: I0316 16:37:19.479815 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:37:19 crc kubenswrapper[5120]: I0316 16:37:19.492734 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-768f4979c4-gbb88"] Mar 16 16:37:19 crc kubenswrapper[5120]: I0316 16:37:19.505136 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-768f4979c4-gbb88"] Mar 16 16:37:20 crc kubenswrapper[5120]: I0316 16:37:20.398911 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-db-create-zq6kk"] Mar 16 16:37:20 crc kubenswrapper[5120]: I0316 16:37:20.400705 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ccd55653-57a9-4f28-90b6-6882e92b937e" containerName="keystone-api" Mar 16 16:37:20 crc kubenswrapper[5120]: I0316 16:37:20.400729 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ccd55653-57a9-4f28-90b6-6882e92b937e" containerName="keystone-api" Mar 16 16:37:20 crc kubenswrapper[5120]: I0316 16:37:20.402268 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ccd55653-57a9-4f28-90b6-6882e92b937e" containerName="keystone-api" Mar 16 16:37:20 crc kubenswrapper[5120]: I0316 16:37:20.413183 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-create-zq6kk" Mar 16 16:37:20 crc kubenswrapper[5120]: I0316 16:37:20.429753 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 16:37:20 crc kubenswrapper[5120]: I0316 16:37:20.430026 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/openstackclient" podUID="b71a657e-9182-423d-90a8-cded4f72f6a3" containerName="openstackclient" containerID="cri-o://0ed7d00e82acd5aef2a9bbb3266fe2ba73ea73319c94729a44be280b82a4b1d9" gracePeriod=2 Mar 16 16:37:20 crc kubenswrapper[5120]: I0316 16:37:20.488374 5120 status_manager.go:895] "Failed to get status for pod" podUID="b71a657e-9182-423d-90a8-cded4f72f6a3" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 16:37:20 crc kubenswrapper[5120]: I0316 16:37:20.545676 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 16:37:20 crc kubenswrapper[5120]: I0316 16:37:20.562929 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c8e25f38-a6c2-4c21-8c86-27c91143ddb9-operator-scripts\") pod \"placement-db-create-zq6kk\" (UID: \"c8e25f38-a6c2-4c21-8c86-27c91143ddb9\") " pod="openstack-kuttl-tests/placement-db-create-zq6kk" Mar 16 16:37:20 crc kubenswrapper[5120]: I0316 16:37:20.563236 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hh4r\" (UniqueName: \"kubernetes.io/projected/c8e25f38-a6c2-4c21-8c86-27c91143ddb9-kube-api-access-4hh4r\") pod \"placement-db-create-zq6kk\" (UID: \"c8e25f38-a6c2-4c21-8c86-27c91143ddb9\") " pod="openstack-kuttl-tests/placement-db-create-zq6kk" Mar 16 16:37:20 crc kubenswrapper[5120]: I0316 16:37:20.641951 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-db-create-zq6kk"] Mar 16 16:37:20 crc kubenswrapper[5120]: I0316 16:37:20.665369 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4hh4r\" (UniqueName: \"kubernetes.io/projected/c8e25f38-a6c2-4c21-8c86-27c91143ddb9-kube-api-access-4hh4r\") pod \"placement-db-create-zq6kk\" (UID: \"c8e25f38-a6c2-4c21-8c86-27c91143ddb9\") " pod="openstack-kuttl-tests/placement-db-create-zq6kk" Mar 16 16:37:20 crc kubenswrapper[5120]: I0316 16:37:20.665665 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c8e25f38-a6c2-4c21-8c86-27c91143ddb9-operator-scripts\") pod \"placement-db-create-zq6kk\" (UID: \"c8e25f38-a6c2-4c21-8c86-27c91143ddb9\") " pod="openstack-kuttl-tests/placement-db-create-zq6kk" Mar 16 16:37:20 crc kubenswrapper[5120]: I0316 16:37:20.666577 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c8e25f38-a6c2-4c21-8c86-27c91143ddb9-operator-scripts\") pod \"placement-db-create-zq6kk\" (UID: \"c8e25f38-a6c2-4c21-8c86-27c91143ddb9\") " pod="openstack-kuttl-tests/placement-db-create-zq6kk" Mar 16 16:37:20 crc kubenswrapper[5120]: I0316 16:37:20.689726 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a3c1d88e-f441-4b4d-97c8-111682a67174" path="/var/lib/kubelet/pods/a3c1d88e-f441-4b4d-97c8-111682a67174/volumes" Mar 16 16:37:20 crc kubenswrapper[5120]: I0316 16:37:20.690518 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ccd55653-57a9-4f28-90b6-6882e92b937e" path="/var/lib/kubelet/pods/ccd55653-57a9-4f28-90b6-6882e92b937e/volumes" Mar 16 16:37:20 crc kubenswrapper[5120]: I0316 16:37:20.755847 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-db-create-ghhn6"] Mar 16 16:37:20 crc kubenswrapper[5120]: I0316 16:37:20.812717 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hh4r\" (UniqueName: \"kubernetes.io/projected/c8e25f38-a6c2-4c21-8c86-27c91143ddb9-kube-api-access-4hh4r\") pod \"placement-db-create-zq6kk\" (UID: \"c8e25f38-a6c2-4c21-8c86-27c91143ddb9\") " pod="openstack-kuttl-tests/placement-db-create-zq6kk" Mar 16 16:37:20 crc kubenswrapper[5120]: I0316 16:37:20.824679 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-e7be-account-create-update-996kw"] Mar 16 16:37:20 crc kubenswrapper[5120]: I0316 16:37:20.871679 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-db-create-ghhn6"] Mar 16 16:37:20 crc kubenswrapper[5120]: I0316 16:37:20.921045 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-e7be-account-create-update-996kw"] Mar 16 16:37:20 crc kubenswrapper[5120]: I0316 16:37:20.976923 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-zztjd"] Mar 16 16:37:21 crc kubenswrapper[5120]: I0316 16:37:21.019790 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-zztjd"] Mar 16 16:37:21 crc kubenswrapper[5120]: I0316 16:37:21.034247 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-create-zq6kk" Mar 16 16:37:21 crc kubenswrapper[5120]: I0316 16:37:21.066690 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 16:37:21 crc kubenswrapper[5120]: I0316 16:37:21.086816 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-e7be-account-create-update-962rm"] Mar 16 16:37:21 crc kubenswrapper[5120]: I0316 16:37:21.087945 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b71a657e-9182-423d-90a8-cded4f72f6a3" containerName="openstackclient" Mar 16 16:37:21 crc kubenswrapper[5120]: I0316 16:37:21.087965 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="b71a657e-9182-423d-90a8-cded4f72f6a3" containerName="openstackclient" Mar 16 16:37:21 crc kubenswrapper[5120]: I0316 16:37:21.088197 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="b71a657e-9182-423d-90a8-cded4f72f6a3" containerName="openstackclient" Mar 16 16:37:21 crc kubenswrapper[5120]: I0316 16:37:21.100662 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-e7be-account-create-update-962rm" Mar 16 16:37:21 crc kubenswrapper[5120]: I0316 16:37:21.122007 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-e7be-account-create-update-962rm"] Mar 16 16:37:21 crc kubenswrapper[5120]: I0316 16:37:21.134048 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-db-secret\"" Mar 16 16:37:21 crc kubenswrapper[5120]: I0316 16:37:21.140310 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 16:37:21 crc kubenswrapper[5120]: I0316 16:37:21.140583 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovn-northd-0" podUID="adeefc4f-7632-4673-ae4f-0104e9e65d1d" containerName="ovn-northd" containerID="cri-o://da5b7b3662dbec12f059c3403e92b3f66241a0648ce9cb26b0e022725a195476" gracePeriod=30 Mar 16 16:37:21 crc kubenswrapper[5120]: I0316 16:37:21.140722 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovn-northd-0" podUID="adeefc4f-7632-4673-ae4f-0104e9e65d1d" containerName="openstack-network-exporter" containerID="cri-o://e721f5e109c58db9c89bf8981961ec04fbce03cce2818b300c8d7256493e363b" gracePeriod=30 Mar 16 16:37:21 crc kubenswrapper[5120]: I0316 16:37:21.169853 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-5115-account-create-update-jvsp2"] Mar 16 16:37:21 crc kubenswrapper[5120]: E0316 16:37:21.195591 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Mar 16 16:37:21 crc kubenswrapper[5120]: E0316 16:37:21.195652 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/05e90410-2cfb-438d-95df-8b2a70319257-config-data podName:05e90410-2cfb-438d-95df-8b2a70319257 nodeName:}" failed. No retries permitted until 2026-03-16 16:37:21.695635387 +0000 UTC m=+3943.849567044 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/05e90410-2cfb-438d-95df-8b2a70319257-config-data") pod "rabbitmq-cell1-server-0" (UID: "05e90410-2cfb-438d-95df-8b2a70319257") : configmap "rabbitmq-cell1-config-data" not found Mar 16 16:37:21 crc kubenswrapper[5120]: I0316 16:37:21.199826 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-5115-account-create-update-jvsp2"] Mar 16 16:37:21 crc kubenswrapper[5120]: I0316 16:37:21.241546 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-db-create-zzpvz"] Mar 16 16:37:21 crc kubenswrapper[5120]: I0316 16:37:21.297655 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 16:37:21 crc kubenswrapper[5120]: I0316 16:37:21.298400 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podUID="58b4ac02-d549-4064-89d2-db3e507c0efc" containerName="openstack-network-exporter" containerID="cri-o://859edba2ba4875e9d0c09dd3f81a753ca7b238627f93916a8b819cad16f263ae" gracePeriod=300 Mar 16 16:37:21 crc kubenswrapper[5120]: I0316 16:37:21.304772 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tzh7\" (UniqueName: \"kubernetes.io/projected/b699bf06-329e-4b4c-801b-1348cffce1e4-kube-api-access-8tzh7\") pod \"placement-e7be-account-create-update-962rm\" (UID: \"b699bf06-329e-4b4c-801b-1348cffce1e4\") " pod="openstack-kuttl-tests/placement-e7be-account-create-update-962rm" Mar 16 16:37:21 crc kubenswrapper[5120]: I0316 16:37:21.304878 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b699bf06-329e-4b4c-801b-1348cffce1e4-operator-scripts\") pod \"placement-e7be-account-create-update-962rm\" (UID: \"b699bf06-329e-4b4c-801b-1348cffce1e4\") " pod="openstack-kuttl-tests/placement-e7be-account-create-update-962rm" Mar 16 16:37:21 crc kubenswrapper[5120]: I0316 16:37:21.322854 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-db-create-zzpvz"] Mar 16 16:37:21 crc kubenswrapper[5120]: I0316 16:37:21.348893 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/root-account-create-update-5zz68"] Mar 16 16:37:21 crc kubenswrapper[5120]: I0316 16:37:21.406251 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8tzh7\" (UniqueName: \"kubernetes.io/projected/b699bf06-329e-4b4c-801b-1348cffce1e4-kube-api-access-8tzh7\") pod \"placement-e7be-account-create-update-962rm\" (UID: \"b699bf06-329e-4b4c-801b-1348cffce1e4\") " pod="openstack-kuttl-tests/placement-e7be-account-create-update-962rm" Mar 16 16:37:21 crc kubenswrapper[5120]: I0316 16:37:21.406962 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b699bf06-329e-4b4c-801b-1348cffce1e4-operator-scripts\") pod \"placement-e7be-account-create-update-962rm\" (UID: \"b699bf06-329e-4b4c-801b-1348cffce1e4\") " pod="openstack-kuttl-tests/placement-e7be-account-create-update-962rm" Mar 16 16:37:21 crc kubenswrapper[5120]: I0316 16:37:21.407906 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b699bf06-329e-4b4c-801b-1348cffce1e4-operator-scripts\") pod \"placement-e7be-account-create-update-962rm\" (UID: \"b699bf06-329e-4b4c-801b-1348cffce1e4\") " pod="openstack-kuttl-tests/placement-e7be-account-create-update-962rm" Mar 16 16:37:21 crc kubenswrapper[5120]: I0316 16:37:21.451134 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8tzh7\" (UniqueName: \"kubernetes.io/projected/b699bf06-329e-4b4c-801b-1348cffce1e4-kube-api-access-8tzh7\") pod \"placement-e7be-account-create-update-962rm\" (UID: \"b699bf06-329e-4b4c-801b-1348cffce1e4\") " pod="openstack-kuttl-tests/placement-e7be-account-create-update-962rm" Mar 16 16:37:21 crc kubenswrapper[5120]: I0316 16:37:21.458558 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-bmfrv"] Mar 16 16:37:21 crc kubenswrapper[5120]: I0316 16:37:21.458605 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-bmfrv"] Mar 16 16:37:21 crc kubenswrapper[5120]: I0316 16:37:21.458632 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-5zz68"] Mar 16 16:37:21 crc kubenswrapper[5120]: I0316 16:37:21.458647 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-d42sq"] Mar 16 16:37:21 crc kubenswrapper[5120]: I0316 16:37:21.458659 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-db-create-vh69f"] Mar 16 16:37:21 crc kubenswrapper[5120]: I0316 16:37:21.458670 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-fe40-account-create-update-prnl2"] Mar 16 16:37:21 crc kubenswrapper[5120]: I0316 16:37:21.458683 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-53bd-account-create-update-54r7n"] Mar 16 16:37:21 crc kubenswrapper[5120]: I0316 16:37:21.458697 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-d42sq"] Mar 16 16:37:21 crc kubenswrapper[5120]: I0316 16:37:21.458886 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-5zz68" Mar 16 16:37:21 crc kubenswrapper[5120]: I0316 16:37:21.461094 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"openstack-cell1-mariadb-root-db-secret\"" Mar 16 16:37:21 crc kubenswrapper[5120]: I0316 16:37:21.505000 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podUID="58b4ac02-d549-4064-89d2-db3e507c0efc" containerName="ovsdbserver-sb" containerID="cri-o://03385e9ae67fcf4097376f7428334bec3cd413165e04d4d4cd67056a46fb256f" gracePeriod=300 Mar 16 16:37:21 crc kubenswrapper[5120]: I0316 16:37:21.509685 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwbjm\" (UniqueName: \"kubernetes.io/projected/70f75c98-8188-4143-a468-6f83825ca23c-kube-api-access-kwbjm\") pod \"root-account-create-update-5zz68\" (UID: \"70f75c98-8188-4143-a468-6f83825ca23c\") " pod="openstack-kuttl-tests/root-account-create-update-5zz68" Mar 16 16:37:21 crc kubenswrapper[5120]: I0316 16:37:21.509993 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/70f75c98-8188-4143-a468-6f83825ca23c-operator-scripts\") pod \"root-account-create-update-5zz68\" (UID: \"70f75c98-8188-4143-a468-6f83825ca23c\") " pod="openstack-kuttl-tests/root-account-create-update-5zz68" Mar 16 16:37:21 crc kubenswrapper[5120]: I0316 16:37:21.530675 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-db-create-vh69f"] Mar 16 16:37:21 crc kubenswrapper[5120]: I0316 16:37:21.554329 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-e7be-account-create-update-962rm" Mar 16 16:37:21 crc kubenswrapper[5120]: I0316 16:37:21.556029 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-db-create-xkmkh"] Mar 16 16:37:21 crc kubenswrapper[5120]: I0316 16:37:21.591864 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-fe40-account-create-update-prnl2"] Mar 16 16:37:21 crc kubenswrapper[5120]: I0316 16:37:21.620880 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/70f75c98-8188-4143-a468-6f83825ca23c-operator-scripts\") pod \"root-account-create-update-5zz68\" (UID: \"70f75c98-8188-4143-a468-6f83825ca23c\") " pod="openstack-kuttl-tests/root-account-create-update-5zz68" Mar 16 16:37:21 crc kubenswrapper[5120]: I0316 16:37:21.625088 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/70f75c98-8188-4143-a468-6f83825ca23c-operator-scripts\") pod \"root-account-create-update-5zz68\" (UID: \"70f75c98-8188-4143-a468-6f83825ca23c\") " pod="openstack-kuttl-tests/root-account-create-update-5zz68" Mar 16 16:37:21 crc kubenswrapper[5120]: I0316 16:37:21.626554 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kwbjm\" (UniqueName: \"kubernetes.io/projected/70f75c98-8188-4143-a468-6f83825ca23c-kube-api-access-kwbjm\") pod \"root-account-create-update-5zz68\" (UID: \"70f75c98-8188-4143-a468-6f83825ca23c\") " pod="openstack-kuttl-tests/root-account-create-update-5zz68" Mar 16 16:37:21 crc kubenswrapper[5120]: I0316 16:37:21.686657 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwbjm\" (UniqueName: \"kubernetes.io/projected/70f75c98-8188-4143-a468-6f83825ca23c-kube-api-access-kwbjm\") pod \"root-account-create-update-5zz68\" (UID: \"70f75c98-8188-4143-a468-6f83825ca23c\") " pod="openstack-kuttl-tests/root-account-create-update-5zz68" Mar 16 16:37:21 crc kubenswrapper[5120]: E0316 16:37:21.731546 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Mar 16 16:37:21 crc kubenswrapper[5120]: E0316 16:37:21.731621 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/05e90410-2cfb-438d-95df-8b2a70319257-config-data podName:05e90410-2cfb-438d-95df-8b2a70319257 nodeName:}" failed. No retries permitted until 2026-03-16 16:37:22.731603921 +0000 UTC m=+3944.885535578 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/05e90410-2cfb-438d-95df-8b2a70319257-config-data") pod "rabbitmq-cell1-server-0" (UID: "05e90410-2cfb-438d-95df-8b2a70319257") : configmap "rabbitmq-cell1-config-data" not found Mar 16 16:37:21 crc kubenswrapper[5120]: I0316 16:37:21.756081 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-53bd-account-create-update-54r7n"] Mar 16 16:37:21 crc kubenswrapper[5120]: I0316 16:37:21.778001 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-db-create-xkmkh"] Mar 16 16:37:21 crc kubenswrapper[5120]: I0316 16:37:21.789977 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 16:37:21 crc kubenswrapper[5120]: I0316 16:37:21.790817 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podUID="1fe0dc2f-7c59-4d24-9b66-47c888321f7d" containerName="openstack-network-exporter" containerID="cri-o://42526f0f9c3f55eac6d24c984410946cd8fd6b2fa6f059df3465b160546db980" gracePeriod=300 Mar 16 16:37:21 crc kubenswrapper[5120]: I0316 16:37:21.796642 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-5zz68" Mar 16 16:37:21 crc kubenswrapper[5120]: I0316 16:37:21.812869 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-a4c2-account-create-update-hlwsp"] Mar 16 16:37:21 crc kubenswrapper[5120]: I0316 16:37:21.856450 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-a4c2-account-create-update-hlwsp"] Mar 16 16:37:21 crc kubenswrapper[5120]: I0316 16:37:21.910263 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-r8627"] Mar 16 16:37:21 crc kubenswrapper[5120]: I0316 16:37:21.928401 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-747d4cf944-dk26n"] Mar 16 16:37:21 crc kubenswrapper[5120]: I0316 16:37:21.929959 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-747d4cf944-dk26n" podUID="e3236580-0d7f-4a04-ae0f-5ae8b073d6b7" containerName="placement-log" containerID="cri-o://79f4283e3961fe8587913a54a4c1b00035f76c81dbe46a09d7a17f5d45d1ffe7" gracePeriod=30 Mar 16 16:37:21 crc kubenswrapper[5120]: I0316 16:37:21.930481 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-747d4cf944-dk26n" podUID="e3236580-0d7f-4a04-ae0f-5ae8b073d6b7" containerName="placement-api" containerID="cri-o://c571cf34fd0e3bd683dfb18e6a22a56da066ae6e0cf5b1a616392a29bff9e024" gracePeriod=30 Mar 16 16:37:21 crc kubenswrapper[5120]: I0316 16:37:21.971083 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-r8627"] Mar 16 16:37:22 crc kubenswrapper[5120]: I0316 16:37:22.031373 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-db-create-j72fx"] Mar 16 16:37:22 crc kubenswrapper[5120]: I0316 16:37:22.115654 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-db-create-j72fx"] Mar 16 16:37:22 crc kubenswrapper[5120]: I0316 16:37:22.144144 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podUID="1fe0dc2f-7c59-4d24-9b66-47c888321f7d" containerName="ovsdbserver-nb" containerID="cri-o://2441426552b9c7ba899987c6de98919a6b1047e8cd66f27cd918a9ef6539609f" gracePeriod=300 Mar 16 16:37:22 crc kubenswrapper[5120]: I0316 16:37:22.165016 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-b5trh"] Mar 16 16:37:22 crc kubenswrapper[5120]: I0316 16:37:22.211740 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-b5trh"] Mar 16 16:37:22 crc kubenswrapper[5120]: I0316 16:37:22.259146 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 16:37:22 crc kubenswrapper[5120]: I0316 16:37:22.317767 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-426ss"] Mar 16 16:37:22 crc kubenswrapper[5120]: I0316 16:37:22.318582 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_1fe0dc2f-7c59-4d24-9b66-47c888321f7d/ovsdbserver-nb/0.log" Mar 16 16:37:22 crc kubenswrapper[5120]: I0316 16:37:22.318627 5120 generic.go:358] "Generic (PLEG): container finished" podID="1fe0dc2f-7c59-4d24-9b66-47c888321f7d" containerID="42526f0f9c3f55eac6d24c984410946cd8fd6b2fa6f059df3465b160546db980" exitCode=2 Mar 16 16:37:22 crc kubenswrapper[5120]: I0316 16:37:22.318868 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"1fe0dc2f-7c59-4d24-9b66-47c888321f7d","Type":"ContainerDied","Data":"42526f0f9c3f55eac6d24c984410946cd8fd6b2fa6f059df3465b160546db980"} Mar 16 16:37:22 crc kubenswrapper[5120]: E0316 16:37:22.325133 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-config-data: configmap "rabbitmq-config-data" not found Mar 16 16:37:22 crc kubenswrapper[5120]: E0316 16:37:22.325212 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a03095a2-0907-4be8-ac85-43befd648111-config-data podName:a03095a2-0907-4be8-ac85-43befd648111 nodeName:}" failed. No retries permitted until 2026-03-16 16:37:22.825194542 +0000 UTC m=+3944.979126199 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/a03095a2-0907-4be8-ac85-43befd648111-config-data") pod "rabbitmq-server-0" (UID: "a03095a2-0907-4be8-ac85-43befd648111") : configmap "rabbitmq-config-data" not found Mar 16 16:37:22 crc kubenswrapper[5120]: I0316 16:37:22.349495 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_58b4ac02-d549-4064-89d2-db3e507c0efc/ovsdbserver-sb/0.log" Mar 16 16:37:22 crc kubenswrapper[5120]: I0316 16:37:22.349552 5120 generic.go:358] "Generic (PLEG): container finished" podID="58b4ac02-d549-4064-89d2-db3e507c0efc" containerID="859edba2ba4875e9d0c09dd3f81a753ca7b238627f93916a8b819cad16f263ae" exitCode=2 Mar 16 16:37:22 crc kubenswrapper[5120]: I0316 16:37:22.349571 5120 generic.go:358] "Generic (PLEG): container finished" podID="58b4ac02-d549-4064-89d2-db3e507c0efc" containerID="03385e9ae67fcf4097376f7428334bec3cd413165e04d4d4cd67056a46fb256f" exitCode=143 Mar 16 16:37:22 crc kubenswrapper[5120]: I0316 16:37:22.349868 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"58b4ac02-d549-4064-89d2-db3e507c0efc","Type":"ContainerDied","Data":"859edba2ba4875e9d0c09dd3f81a753ca7b238627f93916a8b819cad16f263ae"} Mar 16 16:37:22 crc kubenswrapper[5120]: I0316 16:37:22.349913 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"58b4ac02-d549-4064-89d2-db3e507c0efc","Type":"ContainerDied","Data":"03385e9ae67fcf4097376f7428334bec3cd413165e04d4d4cd67056a46fb256f"} Mar 16 16:37:22 crc kubenswrapper[5120]: I0316 16:37:22.360496 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-426ss"] Mar 16 16:37:22 crc kubenswrapper[5120]: I0316 16:37:22.377125 5120 generic.go:358] "Generic (PLEG): container finished" podID="e3236580-0d7f-4a04-ae0f-5ae8b073d6b7" containerID="79f4283e3961fe8587913a54a4c1b00035f76c81dbe46a09d7a17f5d45d1ffe7" exitCode=143 Mar 16 16:37:22 crc kubenswrapper[5120]: I0316 16:37:22.377193 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-747d4cf944-dk26n" event={"ID":"e3236580-0d7f-4a04-ae0f-5ae8b073d6b7","Type":"ContainerDied","Data":"79f4283e3961fe8587913a54a4c1b00035f76c81dbe46a09d7a17f5d45d1ffe7"} Mar 16 16:37:22 crc kubenswrapper[5120]: I0316 16:37:22.388117 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-8bf565768-57qhf"] Mar 16 16:37:22 crc kubenswrapper[5120]: I0316 16:37:22.388373 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-8bf565768-57qhf" podUID="b21fb0d1-eae4-4ac7-b3fe-6b62df9f6453" containerName="neutron-api" containerID="cri-o://af00e50dfeb61c52a43b77c9704c742bf39ac86ed2a55361286ca4bd073e109a" gracePeriod=30 Mar 16 16:37:22 crc kubenswrapper[5120]: I0316 16:37:22.388707 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-8bf565768-57qhf" podUID="b21fb0d1-eae4-4ac7-b3fe-6b62df9f6453" containerName="neutron-httpd" containerID="cri-o://8c5e84274c475c693350d79928da2fd5c749fcd40da0a8b00a22b4228017d725" gracePeriod=30 Mar 16 16:37:22 crc kubenswrapper[5120]: I0316 16:37:22.410282 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:37:22 crc kubenswrapper[5120]: I0316 16:37:22.410535 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="fa6ffb82-b871-4dae-b7c1-7880c90110a2" containerName="cinder-scheduler" containerID="cri-o://7b272a2c6ee74f384df1440a6b8dba3da112cef47111a781a3b1bb1cb0c90d7c" gracePeriod=30 Mar 16 16:37:22 crc kubenswrapper[5120]: I0316 16:37:22.411036 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="fa6ffb82-b871-4dae-b7c1-7880c90110a2" containerName="probe" containerID="cri-o://aef5b61853adbdead35cca539e19363cb4263f66d2d389dbe393593c6574a066" gracePeriod=30 Mar 16 16:37:22 crc kubenswrapper[5120]: I0316 16:37:22.419268 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-p6mhd"] Mar 16 16:37:22 crc kubenswrapper[5120]: I0316 16:37:22.437070 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-p6mhd"] Mar 16 16:37:22 crc kubenswrapper[5120]: I0316 16:37:22.438813 5120 generic.go:358] "Generic (PLEG): container finished" podID="adeefc4f-7632-4673-ae4f-0104e9e65d1d" containerID="e721f5e109c58db9c89bf8981961ec04fbce03cce2818b300c8d7256493e363b" exitCode=2 Mar 16 16:37:22 crc kubenswrapper[5120]: I0316 16:37:22.439012 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"adeefc4f-7632-4673-ae4f-0104e9e65d1d","Type":"ContainerDied","Data":"e721f5e109c58db9c89bf8981961ec04fbce03cce2818b300c8d7256493e363b"} Mar 16 16:37:22 crc kubenswrapper[5120]: I0316 16:37:22.449612 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 16:37:22 crc kubenswrapper[5120]: I0316 16:37:22.450548 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="708cda1d-7af6-486c-ad5d-50f82a3e5eee" containerName="account-server" containerID="cri-o://c679ce3dd4a808c71f57d8f9829ff2391a97abc295485a606cdcadac0ee9033c" gracePeriod=30 Mar 16 16:37:22 crc kubenswrapper[5120]: I0316 16:37:22.451294 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="708cda1d-7af6-486c-ad5d-50f82a3e5eee" containerName="container-updater" containerID="cri-o://dd56dfa0b7f61c69b878b62814f7bd9a5e2e0a179c234413d454b0f170263cde" gracePeriod=30 Mar 16 16:37:22 crc kubenswrapper[5120]: I0316 16:37:22.451465 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="708cda1d-7af6-486c-ad5d-50f82a3e5eee" containerName="swift-recon-cron" containerID="cri-o://8828080fd1ea9870a7a4e1769ff36c954304ce0ce6f33354df80a5348daf83dc" gracePeriod=30 Mar 16 16:37:22 crc kubenswrapper[5120]: I0316 16:37:22.451531 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="708cda1d-7af6-486c-ad5d-50f82a3e5eee" containerName="rsync" containerID="cri-o://016abc3c0178bcf5cd37131e0a1d710e253777ef9ec37790a656ac71970c5e94" gracePeriod=30 Mar 16 16:37:22 crc kubenswrapper[5120]: I0316 16:37:22.451582 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="708cda1d-7af6-486c-ad5d-50f82a3e5eee" containerName="object-expirer" containerID="cri-o://e25c13b10bd0ae2661a7188a008d15ac091c37b50ae4a9dc6125ce1625e4c04f" gracePeriod=30 Mar 16 16:37:22 crc kubenswrapper[5120]: I0316 16:37:22.451634 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="708cda1d-7af6-486c-ad5d-50f82a3e5eee" containerName="object-updater" containerID="cri-o://2ce41f56d74fc06d0f22d6fa384ec2df8b05b4e93227cb38c7c8c9dcb83b3b32" gracePeriod=30 Mar 16 16:37:22 crc kubenswrapper[5120]: I0316 16:37:22.451682 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="708cda1d-7af6-486c-ad5d-50f82a3e5eee" containerName="object-auditor" containerID="cri-o://bf2ddc46d62b71561f1fe4a22e4392ac4dd0e057752f19cd798973007180aae1" gracePeriod=30 Mar 16 16:37:22 crc kubenswrapper[5120]: I0316 16:37:22.451735 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="708cda1d-7af6-486c-ad5d-50f82a3e5eee" containerName="object-replicator" containerID="cri-o://823234100a1705932c1298bfadc9095820a0f38e7d1438de637e080956108375" gracePeriod=30 Mar 16 16:37:22 crc kubenswrapper[5120]: I0316 16:37:22.451902 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="708cda1d-7af6-486c-ad5d-50f82a3e5eee" containerName="object-server" containerID="cri-o://b3a0ff5f334911145baa06ed5e742c3115c5a82fb0be18d3a46674ff7bce8910" gracePeriod=30 Mar 16 16:37:22 crc kubenswrapper[5120]: I0316 16:37:22.451989 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="708cda1d-7af6-486c-ad5d-50f82a3e5eee" containerName="account-reaper" containerID="cri-o://1a366251ecfae1d36d2a256394ecbfa03feea52ce05848c7f59f88fc9e4f645d" gracePeriod=30 Mar 16 16:37:22 crc kubenswrapper[5120]: I0316 16:37:22.452048 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="708cda1d-7af6-486c-ad5d-50f82a3e5eee" containerName="container-auditor" containerID="cri-o://baa0c4a6d21177c2e1c933f890193bc3539da215fdf454524535cbb7290a3f94" gracePeriod=30 Mar 16 16:37:22 crc kubenswrapper[5120]: I0316 16:37:22.452092 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="708cda1d-7af6-486c-ad5d-50f82a3e5eee" containerName="container-replicator" containerID="cri-o://10d720603adc56937a4b0048d6ae917e0e1cc6c9b0e270b374493b0f40d01f5b" gracePeriod=30 Mar 16 16:37:22 crc kubenswrapper[5120]: I0316 16:37:22.452137 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="708cda1d-7af6-486c-ad5d-50f82a3e5eee" containerName="container-server" containerID="cri-o://d564e0e790fc7bc6f314de61c82fd0cb162da9171a21465233e947e34df0144d" gracePeriod=30 Mar 16 16:37:22 crc kubenswrapper[5120]: I0316 16:37:22.452199 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="708cda1d-7af6-486c-ad5d-50f82a3e5eee" containerName="account-replicator" containerID="cri-o://06fa89856071765dcf02b87f89cb5dafc8a1764000e8fa026e6ff3fba5435780" gracePeriod=30 Mar 16 16:37:22 crc kubenswrapper[5120]: I0316 16:37:22.452253 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="708cda1d-7af6-486c-ad5d-50f82a3e5eee" containerName="account-auditor" containerID="cri-o://0e3418c7558099ed9abc22efacb74638ba79a34cc2d57f8552a793c13d62a916" gracePeriod=30 Mar 16 16:37:22 crc kubenswrapper[5120]: I0316 16:37:22.464452 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:37:22 crc kubenswrapper[5120]: I0316 16:37:22.464725 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="2fbd9119-d73e-4c1e-99b9-8f078e2acdfb" containerName="cinder-api-log" containerID="cri-o://795e30c34b62032be16391622f118baf7553199f7ee7e1d67d0c47f46f0d7158" gracePeriod=30 Mar 16 16:37:22 crc kubenswrapper[5120]: I0316 16:37:22.465251 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="2fbd9119-d73e-4c1e-99b9-8f078e2acdfb" containerName="cinder-api" containerID="cri-o://41f454bf946ac8b5e6eb01d2b76a6ba9b4a70c8ff253b18b28f9a9d124862394" gracePeriod=30 Mar 16 16:37:22 crc kubenswrapper[5120]: I0316 16:37:22.487280 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:37:22 crc kubenswrapper[5120]: I0316 16:37:22.487598 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="be8b10ce-e42f-4650-bc2f-96fe51dc224c" containerName="glance-log" containerID="cri-o://678053afacd3e13cea1a0ce33b3fda6c71f1a6af75e6150d8d60f0c54803af1d" gracePeriod=30 Mar 16 16:37:22 crc kubenswrapper[5120]: I0316 16:37:22.494304 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="be8b10ce-e42f-4650-bc2f-96fe51dc224c" containerName="glance-httpd" containerID="cri-o://7e7209b2abecef7c5b6b8a3d982cdcbbdf7eef3a5a6dd06c0ebe7c5bba967530" gracePeriod=30 Mar 16 16:37:22 crc kubenswrapper[5120]: I0316 16:37:22.528282 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-8t4vn"] Mar 16 16:37:22 crc kubenswrapper[5120]: I0316 16:37:22.545810 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-pnmcl"] Mar 16 16:37:22 crc kubenswrapper[5120]: I0316 16:37:22.546023 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-8t4vn" Mar 16 16:37:22 crc kubenswrapper[5120]: I0316 16:37:22.556395 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-nhhml"] Mar 16 16:37:22 crc kubenswrapper[5120]: I0316 16:37:22.568125 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-8t4vn"] Mar 16 16:37:22 crc kubenswrapper[5120]: I0316 16:37:22.578550 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-e7be-account-create-update-962rm"] Mar 16 16:37:22 crc kubenswrapper[5120]: I0316 16:37:22.613927 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-nhhml"] Mar 16 16:37:22 crc kubenswrapper[5120]: E0316 16:37:22.619458 5120 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1fe0dc2f_7c59_4d24_9b66_47c888321f7d.slice/crio-conmon-2441426552b9c7ba899987c6de98919a6b1047e8cd66f27cd918a9ef6539609f.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfec060e6_11fd_4d16_8640_fd02366a7601.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1fe0dc2f_7c59_4d24_9b66_47c888321f7d.slice/crio-2441426552b9c7ba899987c6de98919a6b1047e8cd66f27cd918a9ef6539609f.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfec060e6_11fd_4d16_8640_fd02366a7601.slice/crio-cf47aaebf63137acc7a77d17eb41eeb5f06bc1f346811dfa1f366d667ed8d6a4\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2fbd9119_d73e_4c1e_99b9_8f078e2acdfb.slice/crio-795e30c34b62032be16391622f118baf7553199f7ee7e1d67d0c47f46f0d7158.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod708cda1d_7af6_486c_ad5d_50f82a3e5eee.slice/crio-bf2ddc46d62b71561f1fe4a22e4392ac4dd0e057752f19cd798973007180aae1.scope\": RecentStats: unable to find data in memory cache]" Mar 16 16:37:22 crc kubenswrapper[5120]: I0316 16:37:22.644744 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgjlp\" (UniqueName: \"kubernetes.io/projected/e06e57b2-920d-463e-8607-2c1365c8c2e5-kube-api-access-bgjlp\") pod \"dnsmasq-dnsmasq-79dcd846c5-8t4vn\" (UID: \"e06e57b2-920d-463e-8607-2c1365c8c2e5\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-8t4vn" Mar 16 16:37:22 crc kubenswrapper[5120]: I0316 16:37:22.645399 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e06e57b2-920d-463e-8607-2c1365c8c2e5-config\") pod \"dnsmasq-dnsmasq-79dcd846c5-8t4vn\" (UID: \"e06e57b2-920d-463e-8607-2c1365c8c2e5\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-8t4vn" Mar 16 16:37:22 crc kubenswrapper[5120]: I0316 16:37:22.645620 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/e06e57b2-920d-463e-8607-2c1365c8c2e5-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-79dcd846c5-8t4vn\" (UID: \"e06e57b2-920d-463e-8607-2c1365c8c2e5\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-8t4vn" Mar 16 16:37:22 crc kubenswrapper[5120]: I0316 16:37:22.720584 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0687afe7-6d7e-432f-940f-340f727dbdc8" path="/var/lib/kubelet/pods/0687afe7-6d7e-432f-940f-340f727dbdc8/volumes" Mar 16 16:37:22 crc kubenswrapper[5120]: I0316 16:37:22.722176 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1b9d0a58-9639-4577-9b99-d34345657929" path="/var/lib/kubelet/pods/1b9d0a58-9639-4577-9b99-d34345657929/volumes" Mar 16 16:37:22 crc kubenswrapper[5120]: I0316 16:37:22.723106 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ccbf25a-f71f-4428-ac40-883041c2b302" path="/var/lib/kubelet/pods/1ccbf25a-f71f-4428-ac40-883041c2b302/volumes" Mar 16 16:37:22 crc kubenswrapper[5120]: I0316 16:37:22.723819 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1e360f6f-ac8a-4bab-a5de-5aa4658444b6" path="/var/lib/kubelet/pods/1e360f6f-ac8a-4bab-a5de-5aa4658444b6/volumes" Mar 16 16:37:22 crc kubenswrapper[5120]: I0316 16:37:22.728667 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="39db1e20-c1e5-4541-950b-fc86c04b5663" path="/var/lib/kubelet/pods/39db1e20-c1e5-4541-950b-fc86c04b5663/volumes" Mar 16 16:37:22 crc kubenswrapper[5120]: I0316 16:37:22.734796 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="416ad117-1241-46b5-8e7f-92967c3fa54b" path="/var/lib/kubelet/pods/416ad117-1241-46b5-8e7f-92967c3fa54b/volumes" Mar 16 16:37:22 crc kubenswrapper[5120]: I0316 16:37:22.735471 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="51f5578b-db33-480b-bced-d7472406f411" path="/var/lib/kubelet/pods/51f5578b-db33-480b-bced-d7472406f411/volumes" Mar 16 16:37:22 crc kubenswrapper[5120]: I0316 16:37:22.738395 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a4a6700-0b46-409f-9205-5e7660b99d89" path="/var/lib/kubelet/pods/5a4a6700-0b46-409f-9205-5e7660b99d89/volumes" Mar 16 16:37:22 crc kubenswrapper[5120]: I0316 16:37:22.740809 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="61133921-00f6-44cf-a641-de9817b67634" path="/var/lib/kubelet/pods/61133921-00f6-44cf-a641-de9817b67634/volumes" Mar 16 16:37:22 crc kubenswrapper[5120]: I0316 16:37:22.768176 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6752488d-f177-4cc7-a58b-08533527272d" path="/var/lib/kubelet/pods/6752488d-f177-4cc7-a58b-08533527272d/volumes" Mar 16 16:37:22 crc kubenswrapper[5120]: I0316 16:37:22.768943 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7ecbc5c7-9802-4143-bba3-6552d5b8e3ba" path="/var/lib/kubelet/pods/7ecbc5c7-9802-4143-bba3-6552d5b8e3ba/volumes" Mar 16 16:37:22 crc kubenswrapper[5120]: I0316 16:37:22.769859 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="91d6af93-90b1-4d80-86df-11a701664a68" path="/var/lib/kubelet/pods/91d6af93-90b1-4d80-86df-11a701664a68/volumes" Mar 16 16:37:22 crc kubenswrapper[5120]: I0316 16:37:22.776294 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bgjlp\" (UniqueName: \"kubernetes.io/projected/e06e57b2-920d-463e-8607-2c1365c8c2e5-kube-api-access-bgjlp\") pod \"dnsmasq-dnsmasq-79dcd846c5-8t4vn\" (UID: \"e06e57b2-920d-463e-8607-2c1365c8c2e5\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-8t4vn" Mar 16 16:37:22 crc kubenswrapper[5120]: E0316 16:37:22.777112 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="da5b7b3662dbec12f059c3403e92b3f66241a0648ce9cb26b0e022725a195476" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Mar 16 16:37:22 crc kubenswrapper[5120]: I0316 16:37:22.777222 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e06e57b2-920d-463e-8607-2c1365c8c2e5-config\") pod \"dnsmasq-dnsmasq-79dcd846c5-8t4vn\" (UID: \"e06e57b2-920d-463e-8607-2c1365c8c2e5\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-8t4vn" Mar 16 16:37:22 crc kubenswrapper[5120]: I0316 16:37:22.777533 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/e06e57b2-920d-463e-8607-2c1365c8c2e5-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-79dcd846c5-8t4vn\" (UID: \"e06e57b2-920d-463e-8607-2c1365c8c2e5\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-8t4vn" Mar 16 16:37:22 crc kubenswrapper[5120]: E0316 16:37:22.786188 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Mar 16 16:37:22 crc kubenswrapper[5120]: E0316 16:37:22.786313 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/05e90410-2cfb-438d-95df-8b2a70319257-config-data podName:05e90410-2cfb-438d-95df-8b2a70319257 nodeName:}" failed. No retries permitted until 2026-03-16 16:37:24.786273885 +0000 UTC m=+3946.940205542 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/05e90410-2cfb-438d-95df-8b2a70319257-config-data") pod "rabbitmq-cell1-server-0" (UID: "05e90410-2cfb-438d-95df-8b2a70319257") : configmap "rabbitmq-cell1-config-data" not found Mar 16 16:37:22 crc kubenswrapper[5120]: I0316 16:37:22.791113 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/e06e57b2-920d-463e-8607-2c1365c8c2e5-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-79dcd846c5-8t4vn\" (UID: \"e06e57b2-920d-463e-8607-2c1365c8c2e5\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-8t4vn" Mar 16 16:37:22 crc kubenswrapper[5120]: I0316 16:37:22.791799 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e06e57b2-920d-463e-8607-2c1365c8c2e5-config\") pod \"dnsmasq-dnsmasq-79dcd846c5-8t4vn\" (UID: \"e06e57b2-920d-463e-8607-2c1365c8c2e5\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-8t4vn" Mar 16 16:37:22 crc kubenswrapper[5120]: I0316 16:37:22.797693 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a6475f4b-6adc-469e-941b-ff0d57fcad5f" path="/var/lib/kubelet/pods/a6475f4b-6adc-469e-941b-ff0d57fcad5f/volumes" Mar 16 16:37:22 crc kubenswrapper[5120]: I0316 16:37:22.798339 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c951a6f5-568c-4da3-b6b3-e0310ca934bc" path="/var/lib/kubelet/pods/c951a6f5-568c-4da3-b6b3-e0310ca934bc/volumes" Mar 16 16:37:22 crc kubenswrapper[5120]: I0316 16:37:22.798895 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d08d9407-af61-432f-abcd-f0e65aa2a342" path="/var/lib/kubelet/pods/d08d9407-af61-432f-abcd-f0e65aa2a342/volumes" Mar 16 16:37:22 crc kubenswrapper[5120]: I0316 16:37:22.799959 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d0d98630-1fca-41f0-ba40-03f42f303121" path="/var/lib/kubelet/pods/d0d98630-1fca-41f0-ba40-03f42f303121/volumes" Mar 16 16:37:22 crc kubenswrapper[5120]: I0316 16:37:22.800505 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d5ec5258-dfa5-4bb1-b1e7-1af5fb826a9d" path="/var/lib/kubelet/pods/d5ec5258-dfa5-4bb1-b1e7-1af5fb826a9d/volumes" Mar 16 16:37:22 crc kubenswrapper[5120]: I0316 16:37:22.801074 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fa8543ca-1770-4c76-b0d0-ce3311515b72" path="/var/lib/kubelet/pods/fa8543ca-1770-4c76-b0d0-ce3311515b72/volumes" Mar 16 16:37:22 crc kubenswrapper[5120]: I0316 16:37:22.801675 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-pnmcl"] Mar 16 16:37:22 crc kubenswrapper[5120]: I0316 16:37:22.801714 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-8044-account-create-update-hd6hq"] Mar 16 16:37:22 crc kubenswrapper[5120]: I0316 16:37:22.801724 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-skrj6"] Mar 16 16:37:22 crc kubenswrapper[5120]: E0316 16:37:22.810483 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="da5b7b3662dbec12f059c3403e92b3f66241a0648ce9cb26b0e022725a195476" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Mar 16 16:37:22 crc kubenswrapper[5120]: E0316 16:37:22.813034 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="da5b7b3662dbec12f059c3403e92b3f66241a0648ce9cb26b0e022725a195476" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Mar 16 16:37:22 crc kubenswrapper[5120]: E0316 16:37:22.813070 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/ovn-northd-0" podUID="adeefc4f-7632-4673-ae4f-0104e9e65d1d" containerName="ovn-northd" probeResult="unknown" Mar 16 16:37:22 crc kubenswrapper[5120]: I0316 16:37:22.824902 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgjlp\" (UniqueName: \"kubernetes.io/projected/e06e57b2-920d-463e-8607-2c1365c8c2e5-kube-api-access-bgjlp\") pod \"dnsmasq-dnsmasq-79dcd846c5-8t4vn\" (UID: \"e06e57b2-920d-463e-8607-2c1365c8c2e5\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-8t4vn" Mar 16 16:37:22 crc kubenswrapper[5120]: I0316 16:37:22.885327 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-8044-account-create-update-hd6hq"] Mar 16 16:37:22 crc kubenswrapper[5120]: E0316 16:37:22.886501 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-config-data: configmap "rabbitmq-config-data" not found Mar 16 16:37:22 crc kubenswrapper[5120]: E0316 16:37:22.886590 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a03095a2-0907-4be8-ac85-43befd648111-config-data podName:a03095a2-0907-4be8-ac85-43befd648111 nodeName:}" failed. No retries permitted until 2026-03-16 16:37:23.88657042 +0000 UTC m=+3946.040502077 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/a03095a2-0907-4be8-ac85-43befd648111-config-data") pod "rabbitmq-server-0" (UID: "a03095a2-0907-4be8-ac85-43befd648111") : configmap "rabbitmq-config-data" not found Mar 16 16:37:22 crc kubenswrapper[5120]: I0316 16:37:22.918983 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-8t4vn" Mar 16 16:37:22 crc kubenswrapper[5120]: I0316 16:37:22.949461 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_58b4ac02-d549-4064-89d2-db3e507c0efc/ovsdbserver-sb/0.log" Mar 16 16:37:22 crc kubenswrapper[5120]: I0316 16:37:22.949569 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:37:22 crc kubenswrapper[5120]: I0316 16:37:22.986010 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-skrj6"] Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.003261 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-mddwp"] Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.014481 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-82zhz"] Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.022539 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-mddwp"] Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.036692 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-82zhz"] Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.055108 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.055357 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="06e4bc0a-e757-40b7-8ed8-693dd20c185a" containerName="glance-log" containerID="cri-o://9a27d15912e1cc741e22cfb7a94085d53ffa142b31ec587a9a16aeb99cd22f72" gracePeriod=30 Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.055832 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="06e4bc0a-e757-40b7-8ed8-693dd20c185a" containerName="glance-httpd" containerID="cri-o://4d07b305ba120824ff17a907693b1904828557196542b5e99cb497424819b28d" gracePeriod=30 Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.058311 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-db-create-zq6kk"] Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.074272 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.089990 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/58b4ac02-d549-4064-89d2-db3e507c0efc-ovsdb-rundir\") pod \"58b4ac02-d549-4064-89d2-db3e507c0efc\" (UID: \"58b4ac02-d549-4064-89d2-db3e507c0efc\") " Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.090064 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/58b4ac02-d549-4064-89d2-db3e507c0efc-scripts\") pod \"58b4ac02-d549-4064-89d2-db3e507c0efc\" (UID: \"58b4ac02-d549-4064-89d2-db3e507c0efc\") " Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.090188 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nz47s\" (UniqueName: \"kubernetes.io/projected/58b4ac02-d549-4064-89d2-db3e507c0efc-kube-api-access-nz47s\") pod \"58b4ac02-d549-4064-89d2-db3e507c0efc\" (UID: \"58b4ac02-d549-4064-89d2-db3e507c0efc\") " Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.090446 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/58b4ac02-d549-4064-89d2-db3e507c0efc-metrics-certs-tls-certs\") pod \"58b4ac02-d549-4064-89d2-db3e507c0efc\" (UID: \"58b4ac02-d549-4064-89d2-db3e507c0efc\") " Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.090495 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/58b4ac02-d549-4064-89d2-db3e507c0efc-ovsdbserver-sb-tls-certs\") pod \"58b4ac02-d549-4064-89d2-db3e507c0efc\" (UID: \"58b4ac02-d549-4064-89d2-db3e507c0efc\") " Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.090582 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/58b4ac02-d549-4064-89d2-db3e507c0efc-combined-ca-bundle\") pod \"58b4ac02-d549-4064-89d2-db3e507c0efc\" (UID: \"58b4ac02-d549-4064-89d2-db3e507c0efc\") " Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.090659 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovndbcluster-sb-etc-ovn\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"58b4ac02-d549-4064-89d2-db3e507c0efc\" (UID: \"58b4ac02-d549-4064-89d2-db3e507c0efc\") " Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.090826 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/58b4ac02-d549-4064-89d2-db3e507c0efc-config\") pod \"58b4ac02-d549-4064-89d2-db3e507c0efc\" (UID: \"58b4ac02-d549-4064-89d2-db3e507c0efc\") " Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.092358 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58b4ac02-d549-4064-89d2-db3e507c0efc-scripts" (OuterVolumeSpecName: "scripts") pod "58b4ac02-d549-4064-89d2-db3e507c0efc" (UID: "58b4ac02-d549-4064-89d2-db3e507c0efc"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.093273 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58b4ac02-d549-4064-89d2-db3e507c0efc-ovsdb-rundir" (OuterVolumeSpecName: "ovsdb-rundir") pod "58b4ac02-d549-4064-89d2-db3e507c0efc" (UID: "58b4ac02-d549-4064-89d2-db3e507c0efc"). InnerVolumeSpecName "ovsdb-rundir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.095369 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58b4ac02-d549-4064-89d2-db3e507c0efc-config" (OuterVolumeSpecName: "config") pod "58b4ac02-d549-4064-89d2-db3e507c0efc" (UID: "58b4ac02-d549-4064-89d2-db3e507c0efc"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.111077 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58b4ac02-d549-4064-89d2-db3e507c0efc-kube-api-access-nz47s" (OuterVolumeSpecName: "kube-api-access-nz47s") pod "58b4ac02-d549-4064-89d2-db3e507c0efc" (UID: "58b4ac02-d549-4064-89d2-db3e507c0efc"). InnerVolumeSpecName "kube-api-access-nz47s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.119996 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage04-crc" (OuterVolumeSpecName: "ovndbcluster-sb-etc-ovn") pod "58b4ac02-d549-4064-89d2-db3e507c0efc" (UID: "58b4ac02-d549-4064-89d2-db3e507c0efc"). InnerVolumeSpecName "local-storage04-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.131355 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58b4ac02-d549-4064-89d2-db3e507c0efc-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "58b4ac02-d549-4064-89d2-db3e507c0efc" (UID: "58b4ac02-d549-4064-89d2-db3e507c0efc"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.147898 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" podUID="05e90410-2cfb-438d-95df-8b2a70319257" containerName="rabbitmq" containerID="cri-o://3f0d725b5803b997e34764d9eb46efc39619e2d518760dc404bedd35e77b5505" gracePeriod=604800 Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.159689 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-db-create-zq6kk"] Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.178984 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.179335 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="8185e910-6b4a-4897-a27c-7f07b936beb8" containerName="nova-metadata-log" containerID="cri-o://4b251df29f9b7181015a5b31f936df9e97b0207ef1ef63d303d6c87589a0f9a4" gracePeriod=30 Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.179609 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="8185e910-6b4a-4897-a27c-7f07b936beb8" containerName="nova-metadata-metadata" containerID="cri-o://23eeffc81ea64adda7d1ec2a8f840580914c6c9f5e5047584b49b36400d52bae" gracePeriod=30 Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.191147 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58b4ac02-d549-4064-89d2-db3e507c0efc-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "58b4ac02-d549-4064-89d2-db3e507c0efc" (UID: "58b4ac02-d549-4064-89d2-db3e507c0efc"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.191814 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-207b-account-create-update-7vtdj"] Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.194636 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") on node \"crc\" " Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.194688 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/58b4ac02-d549-4064-89d2-db3e507c0efc-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.194702 5120 reconciler_common.go:299] "Volume detached for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/58b4ac02-d549-4064-89d2-db3e507c0efc-ovsdb-rundir\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.194717 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/58b4ac02-d549-4064-89d2-db3e507c0efc-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.194730 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nz47s\" (UniqueName: \"kubernetes.io/projected/58b4ac02-d549-4064-89d2-db3e507c0efc-kube-api-access-nz47s\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.194742 5120 reconciler_common.go:299] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/58b4ac02-d549-4064-89d2-db3e507c0efc-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.194753 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/58b4ac02-d549-4064-89d2-db3e507c0efc-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.202075 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-207b-account-create-update-7vtdj"] Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.217426 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.218222 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="7b14f5ca-cdd4-4caa-94de-f7d7882916e0" containerName="nova-api-log" containerID="cri-o://277a25664e86689ff38b712666321a5332eeca8fcc6856cf5361da4664ea4317" gracePeriod=30 Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.219132 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="7b14f5ca-cdd4-4caa-94de-f7d7882916e0" containerName="nova-api-api" containerID="cri-o://c913385caec36960e81c6124367c10c09682f69742dea3477af9e50a7bfb90e7" gracePeriod=30 Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.219747 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage04-crc" (UniqueName: "kubernetes.io/local-volume/local-storage04-crc") on node "crc" Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.235367 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-5977d9d985-wssl2"] Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.235695 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-5977d9d985-wssl2" podUID="8822fee9-42fe-47d7-a898-22d38c991abd" containerName="barbican-worker-log" containerID="cri-o://f0d16f15c665ac87c4f2bfdb75caedf4162b54c8ca025a4be8306c702849e280" gracePeriod=30 Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.236240 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-5977d9d985-wssl2" podUID="8822fee9-42fe-47d7-a898-22d38c991abd" containerName="barbican-worker" containerID="cri-o://d574b3982ee170745544121427c41d12f2d53fcc93af40baff6d3f7c253ab3ac" gracePeriod=30 Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.254645 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.263032 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58b4ac02-d549-4064-89d2-db3e507c0efc-ovsdbserver-sb-tls-certs" (OuterVolumeSpecName: "ovsdbserver-sb-tls-certs") pod "58b4ac02-d549-4064-89d2-db3e507c0efc" (UID: "58b4ac02-d549-4064-89d2-db3e507c0efc"). InnerVolumeSpecName "ovsdbserver-sb-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.274251 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.274473 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="c1a2ba61-a67d-4937-9979-9f10c744a1a8" containerName="nova-scheduler-scheduler" containerID="cri-o://cb21c359b23b03f5e91a52989546953e9e8fad15e126dc02107149d24a46a45b" gracePeriod=30 Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.303367 5120 reconciler_common.go:299] "Volume detached for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/58b4ac02-d549-4064-89d2-db3e507c0efc-ovsdbserver-sb-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.303402 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:23 crc kubenswrapper[5120]: E0316 16:37:23.309276 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 2441426552b9c7ba899987c6de98919a6b1047e8cd66f27cd918a9ef6539609f is running failed: container process not found" containerID="2441426552b9c7ba899987c6de98919a6b1047e8cd66f27cd918a9ef6539609f" cmd=["/usr/bin/pidof","ovsdb-server"] Mar 16 16:37:23 crc kubenswrapper[5120]: E0316 16:37:23.309838 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 2441426552b9c7ba899987c6de98919a6b1047e8cd66f27cd918a9ef6539609f is running failed: container process not found" containerID="2441426552b9c7ba899987c6de98919a6b1047e8cd66f27cd918a9ef6539609f" cmd=["/usr/bin/pidof","ovsdb-server"] Mar 16 16:37:23 crc kubenswrapper[5120]: E0316 16:37:23.311926 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 2441426552b9c7ba899987c6de98919a6b1047e8cd66f27cd918a9ef6539609f is running failed: container process not found" containerID="2441426552b9c7ba899987c6de98919a6b1047e8cd66f27cd918a9ef6539609f" cmd=["/usr/bin/pidof","ovsdb-server"] Mar 16 16:37:23 crc kubenswrapper[5120]: E0316 16:37:23.312009 5120 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 2441426552b9c7ba899987c6de98919a6b1047e8cd66f27cd918a9ef6539609f is running failed: container process not found" probeType="Readiness" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podUID="1fe0dc2f-7c59-4d24-9b66-47c888321f7d" containerName="ovsdbserver-nb" probeResult="unknown" Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.348820 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-a054-account-create-update-hfxct"] Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.405851 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-797c9dbf4-zdnm7"] Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.406163 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-797c9dbf4-zdnm7" podUID="fb843f09-58b3-467f-8c61-f9cad54c7b55" containerName="barbican-api-log" containerID="cri-o://2306d3146bce8fb7711cda6f64816886e7c22d3b707e92faf4ccfb523dd60b48" gracePeriod=30 Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.406298 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-797c9dbf4-zdnm7" podUID="fb843f09-58b3-467f-8c61-f9cad54c7b55" containerName="barbican-api" containerID="cri-o://44e7b6079cc86a3539158acba20d48d6ecfc28308601a631870b3eea6c5a0e3d" gracePeriod=30 Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.461100 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-a054-account-create-update-hfxct"] Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.486872 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-79c8b576d8-725k2"] Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.487315 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-79c8b576d8-725k2" podUID="ba60a8bc-6bab-44a3-9e77-6720ea009a57" containerName="barbican-keystone-listener-log" containerID="cri-o://1604809a163c3a45d1f5089abbf755702fb43f108aed43a0f5fcc594471fc047" gracePeriod=30 Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.488961 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-79c8b576d8-725k2" podUID="ba60a8bc-6bab-44a3-9e77-6720ea009a57" containerName="barbican-keystone-listener" containerID="cri-o://7bdd3c9904ff978a4ff90478697f43df053f05e42e235f1b924d00f8b65b050e" gracePeriod=30 Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.520386 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-9nksc"] Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.537802 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-9nksc"] Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.544033 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/openstack-cell1-galera-0" podUID="3a737f89-e391-4a23-b3d5-fa2e2cd8b768" containerName="galera" containerID="cri-o://650c8959379827c8edd34466a6aa9f4175cc2896a05564a554694bce366f363b" gracePeriod=30 Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.546417 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.546647 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="dc7435f2-f650-416c-b0db-53082105f13b" containerName="nova-cell0-conductor-conductor" containerID="cri-o://cd1fe4c47b47574fb7349bbe6b90048d31bd50a842336360580a001e58e13b5c" gracePeriod=30 Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.555989 5120 generic.go:358] "Generic (PLEG): container finished" podID="8822fee9-42fe-47d7-a898-22d38c991abd" containerID="f0d16f15c665ac87c4f2bfdb75caedf4162b54c8ca025a4be8306c702849e280" exitCode=143 Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.556150 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-5977d9d985-wssl2" event={"ID":"8822fee9-42fe-47d7-a898-22d38c991abd","Type":"ContainerDied","Data":"f0d16f15c665ac87c4f2bfdb75caedf4162b54c8ca025a4be8306c702849e280"} Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.578727 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-4ckj9"] Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.581429 5120 generic.go:358] "Generic (PLEG): container finished" podID="be8b10ce-e42f-4650-bc2f-96fe51dc224c" containerID="678053afacd3e13cea1a0ce33b3fda6c71f1a6af75e6150d8d60f0c54803af1d" exitCode=143 Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.581561 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"be8b10ce-e42f-4650-bc2f-96fe51dc224c","Type":"ContainerDied","Data":"678053afacd3e13cea1a0ce33b3fda6c71f1a6af75e6150d8d60f0c54803af1d"} Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.590664 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.590986 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="e9337f85-3f26-46e9-bbf3-ea53f581eab6" containerName="nova-cell1-conductor-conductor" containerID="cri-o://1502302cf5fdfbaedff9cdb3378e080511758ed3133fd93311514c3312d06191" gracePeriod=30 Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.603894 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-4ckj9"] Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.609607 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_58b4ac02-d549-4064-89d2-db3e507c0efc/ovsdbserver-sb/0.log" Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.609739 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.609752 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"58b4ac02-d549-4064-89d2-db3e507c0efc","Type":"ContainerDied","Data":"f96c9824e7fb564df3108df933aee644e19dbdc59f2b5b60d4cb376596a9d099"} Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.609813 5120 scope.go:117] "RemoveContainer" containerID="859edba2ba4875e9d0c09dd3f81a753ca7b238627f93916a8b819cad16f263ae" Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.616024 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.616258 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podUID="613be4ed-d055-4f50-a323-8b13e5c5fe1a" containerName="nova-cell1-novncproxy-novncproxy" containerID="cri-o://4e25db5c9a91ab6c5e9d9ea567f1afbd22b33692b261fb638331d9b211b125db" gracePeriod=30 Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.620387 5120 generic.go:358] "Generic (PLEG): container finished" podID="8185e910-6b4a-4897-a27c-7f07b936beb8" containerID="4b251df29f9b7181015a5b31f936df9e97b0207ef1ef63d303d6c87589a0f9a4" exitCode=143 Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.620523 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"8185e910-6b4a-4897-a27c-7f07b936beb8","Type":"ContainerDied","Data":"4b251df29f9b7181015a5b31f936df9e97b0207ef1ef63d303d6c87589a0f9a4"} Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.631331 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-5zz68"] Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.636678 5120 generic.go:358] "Generic (PLEG): container finished" podID="06e4bc0a-e757-40b7-8ed8-693dd20c185a" containerID="9a27d15912e1cc741e22cfb7a94085d53ffa142b31ec587a9a16aeb99cd22f72" exitCode=143 Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.636846 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"06e4bc0a-e757-40b7-8ed8-693dd20c185a","Type":"ContainerDied","Data":"9a27d15912e1cc741e22cfb7a94085d53ffa142b31ec587a9a16aeb99cd22f72"} Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.639623 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.655805 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-e7be-account-create-update-962rm"] Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.678694 5120 generic.go:358] "Generic (PLEG): container finished" podID="708cda1d-7af6-486c-ad5d-50f82a3e5eee" containerID="016abc3c0178bcf5cd37131e0a1d710e253777ef9ec37790a656ac71970c5e94" exitCode=0 Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.678874 5120 generic.go:358] "Generic (PLEG): container finished" podID="708cda1d-7af6-486c-ad5d-50f82a3e5eee" containerID="e25c13b10bd0ae2661a7188a008d15ac091c37b50ae4a9dc6125ce1625e4c04f" exitCode=0 Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.678970 5120 generic.go:358] "Generic (PLEG): container finished" podID="708cda1d-7af6-486c-ad5d-50f82a3e5eee" containerID="2ce41f56d74fc06d0f22d6fa384ec2df8b05b4e93227cb38c7c8c9dcb83b3b32" exitCode=0 Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.679051 5120 generic.go:358] "Generic (PLEG): container finished" podID="708cda1d-7af6-486c-ad5d-50f82a3e5eee" containerID="bf2ddc46d62b71561f1fe4a22e4392ac4dd0e057752f19cd798973007180aae1" exitCode=0 Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.679132 5120 generic.go:358] "Generic (PLEG): container finished" podID="708cda1d-7af6-486c-ad5d-50f82a3e5eee" containerID="823234100a1705932c1298bfadc9095820a0f38e7d1438de637e080956108375" exitCode=0 Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.679203 5120 generic.go:358] "Generic (PLEG): container finished" podID="708cda1d-7af6-486c-ad5d-50f82a3e5eee" containerID="b3a0ff5f334911145baa06ed5e742c3115c5a82fb0be18d3a46674ff7bce8910" exitCode=0 Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.679269 5120 generic.go:358] "Generic (PLEG): container finished" podID="708cda1d-7af6-486c-ad5d-50f82a3e5eee" containerID="dd56dfa0b7f61c69b878b62814f7bd9a5e2e0a179c234413d454b0f170263cde" exitCode=0 Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.679335 5120 generic.go:358] "Generic (PLEG): container finished" podID="708cda1d-7af6-486c-ad5d-50f82a3e5eee" containerID="baa0c4a6d21177c2e1c933f890193bc3539da215fdf454524535cbb7290a3f94" exitCode=0 Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.679416 5120 generic.go:358] "Generic (PLEG): container finished" podID="708cda1d-7af6-486c-ad5d-50f82a3e5eee" containerID="10d720603adc56937a4b0048d6ae917e0e1cc6c9b0e270b374493b0f40d01f5b" exitCode=0 Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.679491 5120 generic.go:358] "Generic (PLEG): container finished" podID="708cda1d-7af6-486c-ad5d-50f82a3e5eee" containerID="d564e0e790fc7bc6f314de61c82fd0cb162da9171a21465233e947e34df0144d" exitCode=0 Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.679556 5120 generic.go:358] "Generic (PLEG): container finished" podID="708cda1d-7af6-486c-ad5d-50f82a3e5eee" containerID="1a366251ecfae1d36d2a256394ecbfa03feea52ce05848c7f59f88fc9e4f645d" exitCode=0 Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.679627 5120 generic.go:358] "Generic (PLEG): container finished" podID="708cda1d-7af6-486c-ad5d-50f82a3e5eee" containerID="0e3418c7558099ed9abc22efacb74638ba79a34cc2d57f8552a793c13d62a916" exitCode=0 Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.679693 5120 generic.go:358] "Generic (PLEG): container finished" podID="708cda1d-7af6-486c-ad5d-50f82a3e5eee" containerID="06fa89856071765dcf02b87f89cb5dafc8a1764000e8fa026e6ff3fba5435780" exitCode=0 Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.679775 5120 generic.go:358] "Generic (PLEG): container finished" podID="708cda1d-7af6-486c-ad5d-50f82a3e5eee" containerID="c679ce3dd4a808c71f57d8f9829ff2391a97abc295485a606cdcadac0ee9033c" exitCode=0 Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.679971 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"708cda1d-7af6-486c-ad5d-50f82a3e5eee","Type":"ContainerDied","Data":"016abc3c0178bcf5cd37131e0a1d710e253777ef9ec37790a656ac71970c5e94"} Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.680082 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"708cda1d-7af6-486c-ad5d-50f82a3e5eee","Type":"ContainerDied","Data":"e25c13b10bd0ae2661a7188a008d15ac091c37b50ae4a9dc6125ce1625e4c04f"} Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.680169 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"708cda1d-7af6-486c-ad5d-50f82a3e5eee","Type":"ContainerDied","Data":"2ce41f56d74fc06d0f22d6fa384ec2df8b05b4e93227cb38c7c8c9dcb83b3b32"} Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.680251 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"708cda1d-7af6-486c-ad5d-50f82a3e5eee","Type":"ContainerDied","Data":"bf2ddc46d62b71561f1fe4a22e4392ac4dd0e057752f19cd798973007180aae1"} Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.680326 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"708cda1d-7af6-486c-ad5d-50f82a3e5eee","Type":"ContainerDied","Data":"823234100a1705932c1298bfadc9095820a0f38e7d1438de637e080956108375"} Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.680431 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"708cda1d-7af6-486c-ad5d-50f82a3e5eee","Type":"ContainerDied","Data":"b3a0ff5f334911145baa06ed5e742c3115c5a82fb0be18d3a46674ff7bce8910"} Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.680518 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"708cda1d-7af6-486c-ad5d-50f82a3e5eee","Type":"ContainerDied","Data":"dd56dfa0b7f61c69b878b62814f7bd9a5e2e0a179c234413d454b0f170263cde"} Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.680602 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"708cda1d-7af6-486c-ad5d-50f82a3e5eee","Type":"ContainerDied","Data":"baa0c4a6d21177c2e1c933f890193bc3539da215fdf454524535cbb7290a3f94"} Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.680733 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"708cda1d-7af6-486c-ad5d-50f82a3e5eee","Type":"ContainerDied","Data":"10d720603adc56937a4b0048d6ae917e0e1cc6c9b0e270b374493b0f40d01f5b"} Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.680826 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"708cda1d-7af6-486c-ad5d-50f82a3e5eee","Type":"ContainerDied","Data":"d564e0e790fc7bc6f314de61c82fd0cb162da9171a21465233e947e34df0144d"} Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.680916 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"708cda1d-7af6-486c-ad5d-50f82a3e5eee","Type":"ContainerDied","Data":"1a366251ecfae1d36d2a256394ecbfa03feea52ce05848c7f59f88fc9e4f645d"} Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.681002 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"708cda1d-7af6-486c-ad5d-50f82a3e5eee","Type":"ContainerDied","Data":"0e3418c7558099ed9abc22efacb74638ba79a34cc2d57f8552a793c13d62a916"} Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.681075 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"708cda1d-7af6-486c-ad5d-50f82a3e5eee","Type":"ContainerDied","Data":"06fa89856071765dcf02b87f89cb5dafc8a1764000e8fa026e6ff3fba5435780"} Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.681154 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"708cda1d-7af6-486c-ad5d-50f82a3e5eee","Type":"ContainerDied","Data":"c679ce3dd4a808c71f57d8f9829ff2391a97abc295485a606cdcadac0ee9033c"} Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.683477 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-5zz68"] Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.693649 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.695892 5120 generic.go:358] "Generic (PLEG): container finished" podID="b21fb0d1-eae4-4ac7-b3fe-6b62df9f6453" containerID="8c5e84274c475c693350d79928da2fd5c749fcd40da0a8b00a22b4228017d725" exitCode=0 Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.695982 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-8bf565768-57qhf" event={"ID":"b21fb0d1-eae4-4ac7-b3fe-6b62df9f6453","Type":"ContainerDied","Data":"8c5e84274c475c693350d79928da2fd5c749fcd40da0a8b00a22b4228017d725"} Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.702105 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.708543 5120 generic.go:358] "Generic (PLEG): container finished" podID="7b14f5ca-cdd4-4caa-94de-f7d7882916e0" containerID="277a25664e86689ff38b712666321a5332eeca8fcc6856cf5361da4664ea4317" exitCode=143 Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.708795 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"7b14f5ca-cdd4-4caa-94de-f7d7882916e0","Type":"ContainerDied","Data":"277a25664e86689ff38b712666321a5332eeca8fcc6856cf5361da4664ea4317"} Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.711505 5120 generic.go:358] "Generic (PLEG): container finished" podID="b71a657e-9182-423d-90a8-cded4f72f6a3" containerID="0ed7d00e82acd5aef2a9bbb3266fe2ba73ea73319c94729a44be280b82a4b1d9" exitCode=137 Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.715536 5120 generic.go:358] "Generic (PLEG): container finished" podID="2fbd9119-d73e-4c1e-99b9-8f078e2acdfb" containerID="795e30c34b62032be16391622f118baf7553199f7ee7e1d67d0c47f46f0d7158" exitCode=143 Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.715650 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"2fbd9119-d73e-4c1e-99b9-8f078e2acdfb","Type":"ContainerDied","Data":"795e30c34b62032be16391622f118baf7553199f7ee7e1d67d0c47f46f0d7158"} Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.730540 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_1fe0dc2f-7c59-4d24-9b66-47c888321f7d/ovsdbserver-nb/0.log" Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.730606 5120 generic.go:358] "Generic (PLEG): container finished" podID="1fe0dc2f-7c59-4d24-9b66-47c888321f7d" containerID="2441426552b9c7ba899987c6de98919a6b1047e8cd66f27cd918a9ef6539609f" exitCode=143 Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.730744 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"1fe0dc2f-7c59-4d24-9b66-47c888321f7d","Type":"ContainerDied","Data":"2441426552b9c7ba899987c6de98919a6b1047e8cd66f27cd918a9ef6539609f"} Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.740483 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-create-zq6kk" event={"ID":"c8e25f38-a6c2-4c21-8c86-27c91143ddb9","Type":"ContainerStarted","Data":"5f8cbc8fcaa87bad2e526ac9a76a9fcafe136c6ee88c8f400c8148284db80dba"} Mar 16 16:37:23 crc kubenswrapper[5120]: I0316 16:37:23.810308 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/rabbitmq-server-0" podUID="a03095a2-0907-4be8-ac85-43befd648111" containerName="rabbitmq" containerID="cri-o://93f1e66b2d8a92540af9824e7c1323009a16554867a73716bc2e06eeaaea6d4a" gracePeriod=604800 Mar 16 16:37:23 crc kubenswrapper[5120]: E0316 16:37:23.914225 5120 kuberuntime_manager.go:1358] "Unhandled Error" err=< Mar 16 16:37:23 crc kubenswrapper[5120]: container &Container{Name:mariadb-account-create-update,Image:quay.io/podified-antelope-centos9/openstack-mariadb@sha256:4caef2b55e01b9a7ee88a22bc69db1893521a91d95c7ad4c8e593f14f17a5f95,Command:[/bin/sh -c #!/bin/bash Mar 16 16:37:23 crc kubenswrapper[5120]: Mar 16 16:37:23 crc kubenswrapper[5120]: MYSQL_REMOTE_HOST="" source /var/lib/operator-scripts/mysql_root_auth.sh Mar 16 16:37:23 crc kubenswrapper[5120]: Mar 16 16:37:23 crc kubenswrapper[5120]: export DatabasePassword=${DatabasePassword:?"Please specify a DatabasePassword variable."} Mar 16 16:37:23 crc kubenswrapper[5120]: Mar 16 16:37:23 crc kubenswrapper[5120]: MYSQL_CMD="mysql -h -u root -P 3306" Mar 16 16:37:23 crc kubenswrapper[5120]: Mar 16 16:37:23 crc kubenswrapper[5120]: if [ -n "placement" ]; then Mar 16 16:37:23 crc kubenswrapper[5120]: GRANT_DATABASE="placement" Mar 16 16:37:23 crc kubenswrapper[5120]: else Mar 16 16:37:23 crc kubenswrapper[5120]: GRANT_DATABASE="*" Mar 16 16:37:23 crc kubenswrapper[5120]: fi Mar 16 16:37:23 crc kubenswrapper[5120]: Mar 16 16:37:23 crc kubenswrapper[5120]: # going for maximum compatibility here: Mar 16 16:37:23 crc kubenswrapper[5120]: # 1. MySQL 8 no longer allows implicit create user when GRANT is used Mar 16 16:37:23 crc kubenswrapper[5120]: # 2. MariaDB has "CREATE OR REPLACE", but MySQL does not Mar 16 16:37:23 crc kubenswrapper[5120]: # 3. create user with CREATE but then do all password and TLS with ALTER to Mar 16 16:37:23 crc kubenswrapper[5120]: # support updates Mar 16 16:37:23 crc kubenswrapper[5120]: Mar 16 16:37:23 crc kubenswrapper[5120]: $MYSQL_CMD < logger="UnhandledError" Mar 16 16:37:23 crc kubenswrapper[5120]: E0316 16:37:23.915684 5120 kuberuntime_manager.go:1358] "Unhandled Error" err=< Mar 16 16:37:23 crc kubenswrapper[5120]: container &Container{Name:mariadb-account-create-update,Image:quay.io/podified-antelope-centos9/openstack-mariadb@sha256:4caef2b55e01b9a7ee88a22bc69db1893521a91d95c7ad4c8e593f14f17a5f95,Command:[/bin/sh -c #!/bin/bash Mar 16 16:37:23 crc kubenswrapper[5120]: Mar 16 16:37:23 crc kubenswrapper[5120]: MYSQL_REMOTE_HOST="" source /var/lib/operator-scripts/mysql_root_auth.sh Mar 16 16:37:23 crc kubenswrapper[5120]: Mar 16 16:37:23 crc kubenswrapper[5120]: export DatabasePassword=${DatabasePassword:?"Please specify a DatabasePassword variable."} Mar 16 16:37:23 crc kubenswrapper[5120]: Mar 16 16:37:23 crc kubenswrapper[5120]: MYSQL_CMD="mysql -h -u root -P 3306" Mar 16 16:37:23 crc kubenswrapper[5120]: Mar 16 16:37:23 crc kubenswrapper[5120]: if [ -n "" ]; then Mar 16 16:37:23 crc kubenswrapper[5120]: GRANT_DATABASE="" Mar 16 16:37:23 crc kubenswrapper[5120]: else Mar 16 16:37:23 crc kubenswrapper[5120]: GRANT_DATABASE="*" Mar 16 16:37:23 crc kubenswrapper[5120]: fi Mar 16 16:37:23 crc kubenswrapper[5120]: Mar 16 16:37:23 crc kubenswrapper[5120]: # going for maximum compatibility here: Mar 16 16:37:23 crc kubenswrapper[5120]: # 1. MySQL 8 no longer allows implicit create user when GRANT is used Mar 16 16:37:23 crc kubenswrapper[5120]: # 2. MariaDB has "CREATE OR REPLACE", but MySQL does not Mar 16 16:37:23 crc kubenswrapper[5120]: # 3. create user with CREATE but then do all password and TLS with ALTER to Mar 16 16:37:23 crc kubenswrapper[5120]: # support updates Mar 16 16:37:23 crc kubenswrapper[5120]: Mar 16 16:37:23 crc kubenswrapper[5120]: $MYSQL_CMD < logger="UnhandledError" Mar 16 16:37:23 crc kubenswrapper[5120]: E0316 16:37:23.915842 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"mariadb-account-create-update\" with CreateContainerConfigError: \"secret \\\"placement-db-secret\\\" not found\"" pod="openstack-kuttl-tests/placement-e7be-account-create-update-962rm" podUID="b699bf06-329e-4b4c-801b-1348cffce1e4" Mar 16 16:37:23 crc kubenswrapper[5120]: E0316 16:37:23.916929 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"mariadb-account-create-update\" with CreateContainerConfigError: \"secret \\\"openstack-cell1-mariadb-root-db-secret\\\" not found\"" pod="openstack-kuttl-tests/root-account-create-update-5zz68" podUID="70f75c98-8188-4143-a468-6f83825ca23c" Mar 16 16:37:23 crc kubenswrapper[5120]: E0316 16:37:23.939084 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-config-data: configmap "rabbitmq-config-data" not found Mar 16 16:37:23 crc kubenswrapper[5120]: E0316 16:37:23.939172 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a03095a2-0907-4be8-ac85-43befd648111-config-data podName:a03095a2-0907-4be8-ac85-43befd648111 nodeName:}" failed. No retries permitted until 2026-03-16 16:37:25.93915206 +0000 UTC m=+3948.093083727 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/a03095a2-0907-4be8-ac85-43befd648111-config-data") pod "rabbitmq-server-0" (UID: "a03095a2-0907-4be8-ac85-43befd648111") : configmap "rabbitmq-config-data" not found Mar 16 16:37:24 crc kubenswrapper[5120]: I0316 16:37:24.076454 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_1fe0dc2f-7c59-4d24-9b66-47c888321f7d/ovsdbserver-nb/0.log" Mar 16 16:37:24 crc kubenswrapper[5120]: I0316 16:37:24.076525 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:37:24 crc kubenswrapper[5120]: I0316 16:37:24.084791 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Mar 16 16:37:24 crc kubenswrapper[5120]: I0316 16:37:24.147307 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/1fe0dc2f-7c59-4d24-9b66-47c888321f7d-scripts\") pod \"1fe0dc2f-7c59-4d24-9b66-47c888321f7d\" (UID: \"1fe0dc2f-7c59-4d24-9b66-47c888321f7d\") " Mar 16 16:37:24 crc kubenswrapper[5120]: I0316 16:37:24.147398 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/1fe0dc2f-7c59-4d24-9b66-47c888321f7d-metrics-certs-tls-certs\") pod \"1fe0dc2f-7c59-4d24-9b66-47c888321f7d\" (UID: \"1fe0dc2f-7c59-4d24-9b66-47c888321f7d\") " Mar 16 16:37:24 crc kubenswrapper[5120]: I0316 16:37:24.147445 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hkhjx\" (UniqueName: \"kubernetes.io/projected/1fe0dc2f-7c59-4d24-9b66-47c888321f7d-kube-api-access-hkhjx\") pod \"1fe0dc2f-7c59-4d24-9b66-47c888321f7d\" (UID: \"1fe0dc2f-7c59-4d24-9b66-47c888321f7d\") " Mar 16 16:37:24 crc kubenswrapper[5120]: I0316 16:37:24.147559 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1fe0dc2f-7c59-4d24-9b66-47c888321f7d-combined-ca-bundle\") pod \"1fe0dc2f-7c59-4d24-9b66-47c888321f7d\" (UID: \"1fe0dc2f-7c59-4d24-9b66-47c888321f7d\") " Mar 16 16:37:24 crc kubenswrapper[5120]: I0316 16:37:24.154790 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1fe0dc2f-7c59-4d24-9b66-47c888321f7d-scripts" (OuterVolumeSpecName: "scripts") pod "1fe0dc2f-7c59-4d24-9b66-47c888321f7d" (UID: "1fe0dc2f-7c59-4d24-9b66-47c888321f7d"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:37:24 crc kubenswrapper[5120]: I0316 16:37:24.176556 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 16:37:24 crc kubenswrapper[5120]: I0316 16:37:24.177084 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/kube-state-metrics-0" podUID="2c50d5a6-1160-4c1d-a0ee-6dff4d5e6b87" containerName="kube-state-metrics" containerID="cri-o://41961b7f6a4344f5d5acb2c636cf873512a3d165e3ee4ef16e249ba7fed1aec1" gracePeriod=30 Mar 16 16:37:24 crc kubenswrapper[5120]: I0316 16:37:24.236993 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1fe0dc2f-7c59-4d24-9b66-47c888321f7d-kube-api-access-hkhjx" (OuterVolumeSpecName: "kube-api-access-hkhjx") pod "1fe0dc2f-7c59-4d24-9b66-47c888321f7d" (UID: "1fe0dc2f-7c59-4d24-9b66-47c888321f7d"). InnerVolumeSpecName "kube-api-access-hkhjx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:37:24 crc kubenswrapper[5120]: I0316 16:37:24.255072 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hhjvx\" (UniqueName: \"kubernetes.io/projected/b71a657e-9182-423d-90a8-cded4f72f6a3-kube-api-access-hhjvx\") pod \"b71a657e-9182-423d-90a8-cded4f72f6a3\" (UID: \"b71a657e-9182-423d-90a8-cded4f72f6a3\") " Mar 16 16:37:24 crc kubenswrapper[5120]: I0316 16:37:24.255175 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/b71a657e-9182-423d-90a8-cded4f72f6a3-openstack-config\") pod \"b71a657e-9182-423d-90a8-cded4f72f6a3\" (UID: \"b71a657e-9182-423d-90a8-cded4f72f6a3\") " Mar 16 16:37:24 crc kubenswrapper[5120]: I0316 16:37:24.255302 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1fe0dc2f-7c59-4d24-9b66-47c888321f7d-config\") pod \"1fe0dc2f-7c59-4d24-9b66-47c888321f7d\" (UID: \"1fe0dc2f-7c59-4d24-9b66-47c888321f7d\") " Mar 16 16:37:24 crc kubenswrapper[5120]: I0316 16:37:24.255331 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/b71a657e-9182-423d-90a8-cded4f72f6a3-openstack-config-secret\") pod \"b71a657e-9182-423d-90a8-cded4f72f6a3\" (UID: \"b71a657e-9182-423d-90a8-cded4f72f6a3\") " Mar 16 16:37:24 crc kubenswrapper[5120]: I0316 16:37:24.255453 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/1fe0dc2f-7c59-4d24-9b66-47c888321f7d-ovsdbserver-nb-tls-certs\") pod \"1fe0dc2f-7c59-4d24-9b66-47c888321f7d\" (UID: \"1fe0dc2f-7c59-4d24-9b66-47c888321f7d\") " Mar 16 16:37:24 crc kubenswrapper[5120]: I0316 16:37:24.255519 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b71a657e-9182-423d-90a8-cded4f72f6a3-combined-ca-bundle\") pod \"b71a657e-9182-423d-90a8-cded4f72f6a3\" (UID: \"b71a657e-9182-423d-90a8-cded4f72f6a3\") " Mar 16 16:37:24 crc kubenswrapper[5120]: I0316 16:37:24.279956 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1fe0dc2f-7c59-4d24-9b66-47c888321f7d-config" (OuterVolumeSpecName: "config") pod "1fe0dc2f-7c59-4d24-9b66-47c888321f7d" (UID: "1fe0dc2f-7c59-4d24-9b66-47c888321f7d"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:37:24 crc kubenswrapper[5120]: I0316 16:37:24.255598 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/1fe0dc2f-7c59-4d24-9b66-47c888321f7d-ovsdb-rundir\") pod \"1fe0dc2f-7c59-4d24-9b66-47c888321f7d\" (UID: \"1fe0dc2f-7c59-4d24-9b66-47c888321f7d\") " Mar 16 16:37:24 crc kubenswrapper[5120]: I0316 16:37:24.280086 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovndbcluster-nb-etc-ovn\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"1fe0dc2f-7c59-4d24-9b66-47c888321f7d\" (UID: \"1fe0dc2f-7c59-4d24-9b66-47c888321f7d\") " Mar 16 16:37:24 crc kubenswrapper[5120]: I0316 16:37:24.281334 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/1fe0dc2f-7c59-4d24-9b66-47c888321f7d-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:24 crc kubenswrapper[5120]: I0316 16:37:24.281349 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hkhjx\" (UniqueName: \"kubernetes.io/projected/1fe0dc2f-7c59-4d24-9b66-47c888321f7d-kube-api-access-hkhjx\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:24 crc kubenswrapper[5120]: I0316 16:37:24.281357 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1fe0dc2f-7c59-4d24-9b66-47c888321f7d-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:24 crc kubenswrapper[5120]: I0316 16:37:24.285638 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1fe0dc2f-7c59-4d24-9b66-47c888321f7d-ovsdb-rundir" (OuterVolumeSpecName: "ovsdb-rundir") pod "1fe0dc2f-7c59-4d24-9b66-47c888321f7d" (UID: "1fe0dc2f-7c59-4d24-9b66-47c888321f7d"). InnerVolumeSpecName "ovsdb-rundir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:37:24 crc kubenswrapper[5120]: I0316 16:37:24.290016 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b71a657e-9182-423d-90a8-cded4f72f6a3-kube-api-access-hhjvx" (OuterVolumeSpecName: "kube-api-access-hhjvx") pod "b71a657e-9182-423d-90a8-cded4f72f6a3" (UID: "b71a657e-9182-423d-90a8-cded4f72f6a3"). InnerVolumeSpecName "kube-api-access-hhjvx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:37:24 crc kubenswrapper[5120]: I0316 16:37:24.315245 5120 scope.go:117] "RemoveContainer" containerID="03385e9ae67fcf4097376f7428334bec3cd413165e04d4d4cd67056a46fb256f" Mar 16 16:37:24 crc kubenswrapper[5120]: I0316 16:37:24.361476 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage12-crc" (OuterVolumeSpecName: "ovndbcluster-nb-etc-ovn") pod "1fe0dc2f-7c59-4d24-9b66-47c888321f7d" (UID: "1fe0dc2f-7c59-4d24-9b66-47c888321f7d"). InnerVolumeSpecName "local-storage12-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:37:24 crc kubenswrapper[5120]: I0316 16:37:24.366877 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:37:24 crc kubenswrapper[5120]: I0316 16:37:24.367237 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="204ff621-b59e-44f0-84a5-c9e4eaaf86bf" containerName="ceilometer-central-agent" containerID="cri-o://56d4baebbb806417e5fc468a17b33231ff7a0538573b3437ce67ad2bd53c1afa" gracePeriod=30 Mar 16 16:37:24 crc kubenswrapper[5120]: I0316 16:37:24.367813 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="204ff621-b59e-44f0-84a5-c9e4eaaf86bf" containerName="proxy-httpd" containerID="cri-o://d962a27ae73b49d661904f00b163e9adbf24cc2cced96780802051c61348e02b" gracePeriod=30 Mar 16 16:37:24 crc kubenswrapper[5120]: I0316 16:37:24.367890 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="204ff621-b59e-44f0-84a5-c9e4eaaf86bf" containerName="sg-core" containerID="cri-o://e711ed4c2337b57b3fae4b8721cc0ce19eb8f9e19cb8d9a26a1a2dd0974c03ef" gracePeriod=30 Mar 16 16:37:24 crc kubenswrapper[5120]: I0316 16:37:24.367936 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="204ff621-b59e-44f0-84a5-c9e4eaaf86bf" containerName="ceilometer-notification-agent" containerID="cri-o://36a38b9c8971280678407303957af16f6e151a9ccb5c0f41ffc3a4f90e4185cb" gracePeriod=30 Mar 16 16:37:24 crc kubenswrapper[5120]: I0316 16:37:24.383463 5120 reconciler_common.go:299] "Volume detached for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/1fe0dc2f-7c59-4d24-9b66-47c888321f7d-ovsdb-rundir\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:24 crc kubenswrapper[5120]: I0316 16:37:24.383500 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") on node \"crc\" " Mar 16 16:37:24 crc kubenswrapper[5120]: I0316 16:37:24.383510 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hhjvx\" (UniqueName: \"kubernetes.io/projected/b71a657e-9182-423d-90a8-cded4f72f6a3-kube-api-access-hhjvx\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:24 crc kubenswrapper[5120]: I0316 16:37:24.418920 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1fe0dc2f-7c59-4d24-9b66-47c888321f7d-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "1fe0dc2f-7c59-4d24-9b66-47c888321f7d" (UID: "1fe0dc2f-7c59-4d24-9b66-47c888321f7d"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:24 crc kubenswrapper[5120]: I0316 16:37:24.473641 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage12-crc" (UniqueName: "kubernetes.io/local-volume/local-storage12-crc") on node "crc" Mar 16 16:37:24 crc kubenswrapper[5120]: I0316 16:37:24.502526 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:24 crc kubenswrapper[5120]: I0316 16:37:24.502560 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1fe0dc2f-7c59-4d24-9b66-47c888321f7d-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:24 crc kubenswrapper[5120]: I0316 16:37:24.507460 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b71a657e-9182-423d-90a8-cded4f72f6a3-openstack-config" (OuterVolumeSpecName: "openstack-config") pod "b71a657e-9182-423d-90a8-cded4f72f6a3" (UID: "b71a657e-9182-423d-90a8-cded4f72f6a3"). InnerVolumeSpecName "openstack-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:37:24 crc kubenswrapper[5120]: I0316 16:37:24.605505 5120 reconciler_common.go:299] "Volume detached for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/b71a657e-9182-423d-90a8-cded4f72f6a3-openstack-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:24 crc kubenswrapper[5120]: I0316 16:37:24.605902 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b71a657e-9182-423d-90a8-cded4f72f6a3-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "b71a657e-9182-423d-90a8-cded4f72f6a3" (UID: "b71a657e-9182-423d-90a8-cded4f72f6a3"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:24 crc kubenswrapper[5120]: I0316 16:37:24.685742 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b71a657e-9182-423d-90a8-cded4f72f6a3-openstack-config-secret" (OuterVolumeSpecName: "openstack-config-secret") pod "b71a657e-9182-423d-90a8-cded4f72f6a3" (UID: "b71a657e-9182-423d-90a8-cded4f72f6a3"). InnerVolumeSpecName "openstack-config-secret". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:24 crc kubenswrapper[5120]: I0316 16:37:24.688131 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1fe0dc2f-7c59-4d24-9b66-47c888321f7d-ovsdbserver-nb-tls-certs" (OuterVolumeSpecName: "ovsdbserver-nb-tls-certs") pod "1fe0dc2f-7c59-4d24-9b66-47c888321f7d" (UID: "1fe0dc2f-7c59-4d24-9b66-47c888321f7d"). InnerVolumeSpecName "ovsdbserver-nb-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:24 crc kubenswrapper[5120]: I0316 16:37:24.697453 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e6d012a-b39a-4bfa-ab56-77bc12e2902e" path="/var/lib/kubelet/pods/2e6d012a-b39a-4bfa-ab56-77bc12e2902e/volumes" Mar 16 16:37:24 crc kubenswrapper[5120]: I0316 16:37:24.706091 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3b7052c0-d1a0-4e78-b88f-e820db4ee0f6" path="/var/lib/kubelet/pods/3b7052c0-d1a0-4e78-b88f-e820db4ee0f6/volumes" Mar 16 16:37:24 crc kubenswrapper[5120]: I0316 16:37:24.706782 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4346558c-b16e-474a-b782-569ca0bbb7cd" path="/var/lib/kubelet/pods/4346558c-b16e-474a-b782-569ca0bbb7cd/volumes" Mar 16 16:37:24 crc kubenswrapper[5120]: I0316 16:37:24.708073 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="493a54f8-9510-4307-a13e-c3c00dc840a1" path="/var/lib/kubelet/pods/493a54f8-9510-4307-a13e-c3c00dc840a1/volumes" Mar 16 16:37:24 crc kubenswrapper[5120]: I0316 16:37:24.708843 5120 reconciler_common.go:299] "Volume detached for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/b71a657e-9182-423d-90a8-cded4f72f6a3-openstack-config-secret\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:24 crc kubenswrapper[5120]: I0316 16:37:24.712151 5120 reconciler_common.go:299] "Volume detached for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/1fe0dc2f-7c59-4d24-9b66-47c888321f7d-ovsdbserver-nb-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:24 crc kubenswrapper[5120]: I0316 16:37:24.712188 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b71a657e-9182-423d-90a8-cded4f72f6a3-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:24 crc kubenswrapper[5120]: I0316 16:37:24.710734 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="58b4ac02-d549-4064-89d2-db3e507c0efc" path="/var/lib/kubelet/pods/58b4ac02-d549-4064-89d2-db3e507c0efc/volumes" Mar 16 16:37:24 crc kubenswrapper[5120]: I0316 16:37:24.716337 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a43b68af-dd50-4ff9-847a-45a6f48d7193" path="/var/lib/kubelet/pods/a43b68af-dd50-4ff9-847a-45a6f48d7193/volumes" Mar 16 16:37:24 crc kubenswrapper[5120]: I0316 16:37:24.717242 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ad1d93e8-5bf9-4703-b308-9fff8ba5aa04" path="/var/lib/kubelet/pods/ad1d93e8-5bf9-4703-b308-9fff8ba5aa04/volumes" Mar 16 16:37:24 crc kubenswrapper[5120]: I0316 16:37:24.722626 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b417595b-2cb6-4a24-960d-c1d717a3238d" path="/var/lib/kubelet/pods/b417595b-2cb6-4a24-960d-c1d717a3238d/volumes" Mar 16 16:37:24 crc kubenswrapper[5120]: I0316 16:37:24.723311 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b71a657e-9182-423d-90a8-cded4f72f6a3" path="/var/lib/kubelet/pods/b71a657e-9182-423d-90a8-cded4f72f6a3/volumes" Mar 16 16:37:24 crc kubenswrapper[5120]: I0316 16:37:24.723992 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d82588c0-32ac-4ba3-b73b-23395c68fc07" path="/var/lib/kubelet/pods/d82588c0-32ac-4ba3-b73b-23395c68fc07/volumes" Mar 16 16:37:24 crc kubenswrapper[5120]: I0316 16:37:24.725729 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e553ce53-4668-4c11-b0e1-65cc12d6f455" path="/var/lib/kubelet/pods/e553ce53-4668-4c11-b0e1-65cc12d6f455/volumes" Mar 16 16:37:24 crc kubenswrapper[5120]: I0316 16:37:24.740237 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1fe0dc2f-7c59-4d24-9b66-47c888321f7d-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "1fe0dc2f-7c59-4d24-9b66-47c888321f7d" (UID: "1fe0dc2f-7c59-4d24-9b66-47c888321f7d"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:24 crc kubenswrapper[5120]: I0316 16:37:24.787353 5120 generic.go:358] "Generic (PLEG): container finished" podID="fb843f09-58b3-467f-8c61-f9cad54c7b55" containerID="2306d3146bce8fb7711cda6f64816886e7c22d3b707e92faf4ccfb523dd60b48" exitCode=143 Mar 16 16:37:24 crc kubenswrapper[5120]: I0316 16:37:24.787417 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-797c9dbf4-zdnm7" event={"ID":"fb843f09-58b3-467f-8c61-f9cad54c7b55","Type":"ContainerDied","Data":"2306d3146bce8fb7711cda6f64816886e7c22d3b707e92faf4ccfb523dd60b48"} Mar 16 16:37:24 crc kubenswrapper[5120]: I0316 16:37:24.799586 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-e7be-account-create-update-962rm" event={"ID":"b699bf06-329e-4b4c-801b-1348cffce1e4","Type":"ContainerStarted","Data":"a6f2af4a8b3f532fb54afffa37ff18e3111f43da0fc0087ee4a3e7077a4b17b2"} Mar 16 16:37:24 crc kubenswrapper[5120]: I0316 16:37:24.814150 5120 reconciler_common.go:299] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/1fe0dc2f-7c59-4d24-9b66-47c888321f7d-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:24 crc kubenswrapper[5120]: E0316 16:37:24.814255 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Mar 16 16:37:24 crc kubenswrapper[5120]: E0316 16:37:24.814312 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/05e90410-2cfb-438d-95df-8b2a70319257-config-data podName:05e90410-2cfb-438d-95df-8b2a70319257 nodeName:}" failed. No retries permitted until 2026-03-16 16:37:28.814296548 +0000 UTC m=+3950.968228205 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/05e90410-2cfb-438d-95df-8b2a70319257-config-data") pod "rabbitmq-cell1-server-0" (UID: "05e90410-2cfb-438d-95df-8b2a70319257") : configmap "rabbitmq-cell1-config-data" not found Mar 16 16:37:24 crc kubenswrapper[5120]: I0316 16:37:24.840299 5120 generic.go:358] "Generic (PLEG): container finished" podID="2c50d5a6-1160-4c1d-a0ee-6dff4d5e6b87" containerID="41961b7f6a4344f5d5acb2c636cf873512a3d165e3ee4ef16e249ba7fed1aec1" exitCode=2 Mar 16 16:37:24 crc kubenswrapper[5120]: I0316 16:37:24.840452 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"2c50d5a6-1160-4c1d-a0ee-6dff4d5e6b87","Type":"ContainerDied","Data":"41961b7f6a4344f5d5acb2c636cf873512a3d165e3ee4ef16e249ba7fed1aec1"} Mar 16 16:37:24 crc kubenswrapper[5120]: I0316 16:37:24.874016 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_1fe0dc2f-7c59-4d24-9b66-47c888321f7d/ovsdbserver-nb/0.log" Mar 16 16:37:24 crc kubenswrapper[5120]: I0316 16:37:24.874199 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"1fe0dc2f-7c59-4d24-9b66-47c888321f7d","Type":"ContainerDied","Data":"9948d355415e06f8426d3919add60b0aaaba3e17fc094f9712f57d1a2b033233"} Mar 16 16:37:24 crc kubenswrapper[5120]: I0316 16:37:24.874248 5120 scope.go:117] "RemoveContainer" containerID="42526f0f9c3f55eac6d24c984410946cd8fd6b2fa6f059df3465b160546db980" Mar 16 16:37:24 crc kubenswrapper[5120]: I0316 16:37:24.874284 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:37:24 crc kubenswrapper[5120]: I0316 16:37:24.910088 5120 generic.go:358] "Generic (PLEG): container finished" podID="3a737f89-e391-4a23-b3d5-fa2e2cd8b768" containerID="650c8959379827c8edd34466a6aa9f4175cc2896a05564a554694bce366f363b" exitCode=0 Mar 16 16:37:24 crc kubenswrapper[5120]: I0316 16:37:24.910233 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"3a737f89-e391-4a23-b3d5-fa2e2cd8b768","Type":"ContainerDied","Data":"650c8959379827c8edd34466a6aa9f4175cc2896a05564a554694bce366f363b"} Mar 16 16:37:24 crc kubenswrapper[5120]: I0316 16:37:24.924654 5120 generic.go:358] "Generic (PLEG): container finished" podID="c8e25f38-a6c2-4c21-8c86-27c91143ddb9" containerID="176df7f234921791c54dee05804c280e7d31d3152fc27f8d8a89c8e3b608c155" exitCode=0 Mar 16 16:37:24 crc kubenswrapper[5120]: I0316 16:37:24.924967 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-create-zq6kk" event={"ID":"c8e25f38-a6c2-4c21-8c86-27c91143ddb9","Type":"ContainerDied","Data":"176df7f234921791c54dee05804c280e7d31d3152fc27f8d8a89c8e3b608c155"} Mar 16 16:37:24 crc kubenswrapper[5120]: E0316 16:37:24.963047 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="cd1fe4c47b47574fb7349bbe6b90048d31bd50a842336360580a001e58e13b5c" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:37:24 crc kubenswrapper[5120]: I0316 16:37:24.974711 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-proxy-598db64bc5-jp86s"] Mar 16 16:37:24 crc kubenswrapper[5120]: I0316 16:37:24.974989 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-proxy-598db64bc5-jp86s" podUID="46b6f5ef-ac2f-4add-8c6b-1157abccfbfe" containerName="proxy-httpd" containerID="cri-o://6239d9262ea4e6d804dc34e524958245dbc975aa665284c54c62b5dca2c72739" gracePeriod=30 Mar 16 16:37:24 crc kubenswrapper[5120]: I0316 16:37:24.975100 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-proxy-598db64bc5-jp86s" podUID="46b6f5ef-ac2f-4add-8c6b-1157abccfbfe" containerName="proxy-server" containerID="cri-o://58d160f133e7a544995711ab2da546c604a09aa66243ab21dcd76c000103b09f" gracePeriod=30 Mar 16 16:37:24 crc kubenswrapper[5120]: I0316 16:37:24.981347 5120 generic.go:358] "Generic (PLEG): container finished" podID="8185e910-6b4a-4897-a27c-7f07b936beb8" containerID="23eeffc81ea64adda7d1ec2a8f840580914c6c9f5e5047584b49b36400d52bae" exitCode=0 Mar 16 16:37:24 crc kubenswrapper[5120]: I0316 16:37:24.981491 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"8185e910-6b4a-4897-a27c-7f07b936beb8","Type":"ContainerDied","Data":"23eeffc81ea64adda7d1ec2a8f840580914c6c9f5e5047584b49b36400d52bae"} Mar 16 16:37:25 crc kubenswrapper[5120]: I0316 16:37:25.016146 5120 generic.go:358] "Generic (PLEG): container finished" podID="204ff621-b59e-44f0-84a5-c9e4eaaf86bf" containerID="e711ed4c2337b57b3fae4b8721cc0ce19eb8f9e19cb8d9a26a1a2dd0974c03ef" exitCode=2 Mar 16 16:37:25 crc kubenswrapper[5120]: I0316 16:37:25.018547 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"204ff621-b59e-44f0-84a5-c9e4eaaf86bf","Type":"ContainerDied","Data":"e711ed4c2337b57b3fae4b8721cc0ce19eb8f9e19cb8d9a26a1a2dd0974c03ef"} Mar 16 16:37:25 crc kubenswrapper[5120]: I0316 16:37:25.032243 5120 generic.go:358] "Generic (PLEG): container finished" podID="7b14f5ca-cdd4-4caa-94de-f7d7882916e0" containerID="c913385caec36960e81c6124367c10c09682f69742dea3477af9e50a7bfb90e7" exitCode=0 Mar 16 16:37:25 crc kubenswrapper[5120]: I0316 16:37:25.032321 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"7b14f5ca-cdd4-4caa-94de-f7d7882916e0","Type":"ContainerDied","Data":"c913385caec36960e81c6124367c10c09682f69742dea3477af9e50a7bfb90e7"} Mar 16 16:37:25 crc kubenswrapper[5120]: I0316 16:37:25.043663 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-5zz68" event={"ID":"70f75c98-8188-4143-a468-6f83825ca23c","Type":"ContainerStarted","Data":"cda6fdc0c8e92c0232a4e61ded28d3be195470c0465d8b461203232539ad091f"} Mar 16 16:37:25 crc kubenswrapper[5120]: I0316 16:37:25.044788 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 16:37:25 crc kubenswrapper[5120]: I0316 16:37:25.062174 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 16:37:25 crc kubenswrapper[5120]: E0316 16:37:25.096635 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="cd1fe4c47b47574fb7349bbe6b90048d31bd50a842336360580a001e58e13b5c" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:37:25 crc kubenswrapper[5120]: E0316 16:37:25.099265 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="cd1fe4c47b47574fb7349bbe6b90048d31bd50a842336360580a001e58e13b5c" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:37:25 crc kubenswrapper[5120]: E0316 16:37:25.099320 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="dc7435f2-f650-416c-b0db-53082105f13b" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 16:37:25 crc kubenswrapper[5120]: I0316 16:37:25.100316 5120 generic.go:358] "Generic (PLEG): container finished" podID="ba60a8bc-6bab-44a3-9e77-6720ea009a57" containerID="1604809a163c3a45d1f5089abbf755702fb43f108aed43a0f5fcc594471fc047" exitCode=143 Mar 16 16:37:25 crc kubenswrapper[5120]: I0316 16:37:25.100347 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-79c8b576d8-725k2" event={"ID":"ba60a8bc-6bab-44a3-9e77-6720ea009a57","Type":"ContainerDied","Data":"1604809a163c3a45d1f5089abbf755702fb43f108aed43a0f5fcc594471fc047"} Mar 16 16:37:25 crc kubenswrapper[5120]: I0316 16:37:25.104858 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:37:25 crc kubenswrapper[5120]: I0316 16:37:25.108250 5120 generic.go:358] "Generic (PLEG): container finished" podID="fa6ffb82-b871-4dae-b7c1-7880c90110a2" containerID="aef5b61853adbdead35cca539e19363cb4263f66d2d389dbe393593c6574a066" exitCode=0 Mar 16 16:37:25 crc kubenswrapper[5120]: I0316 16:37:25.108327 5120 scope.go:117] "RemoveContainer" containerID="2441426552b9c7ba899987c6de98919a6b1047e8cd66f27cd918a9ef6539609f" Mar 16 16:37:25 crc kubenswrapper[5120]: I0316 16:37:25.108375 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"fa6ffb82-b871-4dae-b7c1-7880c90110a2","Type":"ContainerDied","Data":"aef5b61853adbdead35cca539e19363cb4263f66d2d389dbe393593c6574a066"} Mar 16 16:37:25 crc kubenswrapper[5120]: I0316 16:37:25.119370 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zfdnx\" (UniqueName: \"kubernetes.io/projected/8185e910-6b4a-4897-a27c-7f07b936beb8-kube-api-access-zfdnx\") pod \"8185e910-6b4a-4897-a27c-7f07b936beb8\" (UID: \"8185e910-6b4a-4897-a27c-7f07b936beb8\") " Mar 16 16:37:25 crc kubenswrapper[5120]: I0316 16:37:25.119430 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8185e910-6b4a-4897-a27c-7f07b936beb8-combined-ca-bundle\") pod \"8185e910-6b4a-4897-a27c-7f07b936beb8\" (UID: \"8185e910-6b4a-4897-a27c-7f07b936beb8\") " Mar 16 16:37:25 crc kubenswrapper[5120]: I0316 16:37:25.119667 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8185e910-6b4a-4897-a27c-7f07b936beb8-logs\") pod \"8185e910-6b4a-4897-a27c-7f07b936beb8\" (UID: \"8185e910-6b4a-4897-a27c-7f07b936beb8\") " Mar 16 16:37:25 crc kubenswrapper[5120]: I0316 16:37:25.119750 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8185e910-6b4a-4897-a27c-7f07b936beb8-config-data\") pod \"8185e910-6b4a-4897-a27c-7f07b936beb8\" (UID: \"8185e910-6b4a-4897-a27c-7f07b936beb8\") " Mar 16 16:37:25 crc kubenswrapper[5120]: I0316 16:37:25.119924 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/8185e910-6b4a-4897-a27c-7f07b936beb8-nova-metadata-tls-certs\") pod \"8185e910-6b4a-4897-a27c-7f07b936beb8\" (UID: \"8185e910-6b4a-4897-a27c-7f07b936beb8\") " Mar 16 16:37:25 crc kubenswrapper[5120]: I0316 16:37:25.120283 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8185e910-6b4a-4897-a27c-7f07b936beb8-logs" (OuterVolumeSpecName: "logs") pod "8185e910-6b4a-4897-a27c-7f07b936beb8" (UID: "8185e910-6b4a-4897-a27c-7f07b936beb8"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:37:25 crc kubenswrapper[5120]: I0316 16:37:25.121238 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8185e910-6b4a-4897-a27c-7f07b936beb8-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:25 crc kubenswrapper[5120]: I0316 16:37:25.127969 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Mar 16 16:37:25 crc kubenswrapper[5120]: I0316 16:37:25.179339 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8185e910-6b4a-4897-a27c-7f07b936beb8-kube-api-access-zfdnx" (OuterVolumeSpecName: "kube-api-access-zfdnx") pod "8185e910-6b4a-4897-a27c-7f07b936beb8" (UID: "8185e910-6b4a-4897-a27c-7f07b936beb8"). InnerVolumeSpecName "kube-api-access-zfdnx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:37:25 crc kubenswrapper[5120]: I0316 16:37:25.199260 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8185e910-6b4a-4897-a27c-7f07b936beb8-config-data" (OuterVolumeSpecName: "config-data") pod "8185e910-6b4a-4897-a27c-7f07b936beb8" (UID: "8185e910-6b4a-4897-a27c-7f07b936beb8"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:25 crc kubenswrapper[5120]: I0316 16:37:25.226632 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8185e910-6b4a-4897-a27c-7f07b936beb8-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:25 crc kubenswrapper[5120]: I0316 16:37:25.226677 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zfdnx\" (UniqueName: \"kubernetes.io/projected/8185e910-6b4a-4897-a27c-7f07b936beb8-kube-api-access-zfdnx\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:25 crc kubenswrapper[5120]: I0316 16:37:25.227140 5120 scope.go:117] "RemoveContainer" containerID="0ed7d00e82acd5aef2a9bbb3266fe2ba73ea73319c94729a44be280b82a4b1d9" Mar 16 16:37:25 crc kubenswrapper[5120]: I0316 16:37:25.236212 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:37:25 crc kubenswrapper[5120]: I0316 16:37:25.242513 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8185e910-6b4a-4897-a27c-7f07b936beb8-nova-metadata-tls-certs" (OuterVolumeSpecName: "nova-metadata-tls-certs") pod "8185e910-6b4a-4897-a27c-7f07b936beb8" (UID: "8185e910-6b4a-4897-a27c-7f07b936beb8"). InnerVolumeSpecName "nova-metadata-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:25 crc kubenswrapper[5120]: I0316 16:37:25.251076 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:37:25 crc kubenswrapper[5120]: I0316 16:37:25.285777 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8185e910-6b4a-4897-a27c-7f07b936beb8-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "8185e910-6b4a-4897-a27c-7f07b936beb8" (UID: "8185e910-6b4a-4897-a27c-7f07b936beb8"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:25 crc kubenswrapper[5120]: I0316 16:37:25.327398 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/7b14f5ca-cdd4-4caa-94de-f7d7882916e0-internal-tls-certs\") pod \"7b14f5ca-cdd4-4caa-94de-f7d7882916e0\" (UID: \"7b14f5ca-cdd4-4caa-94de-f7d7882916e0\") " Mar 16 16:37:25 crc kubenswrapper[5120]: I0316 16:37:25.327569 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3a737f89-e391-4a23-b3d5-fa2e2cd8b768-combined-ca-bundle\") pod \"3a737f89-e391-4a23-b3d5-fa2e2cd8b768\" (UID: \"3a737f89-e391-4a23-b3d5-fa2e2cd8b768\") " Mar 16 16:37:25 crc kubenswrapper[5120]: I0316 16:37:25.327610 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6w6t4\" (UniqueName: \"kubernetes.io/projected/3a737f89-e391-4a23-b3d5-fa2e2cd8b768-kube-api-access-6w6t4\") pod \"3a737f89-e391-4a23-b3d5-fa2e2cd8b768\" (UID: \"3a737f89-e391-4a23-b3d5-fa2e2cd8b768\") " Mar 16 16:37:25 crc kubenswrapper[5120]: I0316 16:37:25.327704 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/3a737f89-e391-4a23-b3d5-fa2e2cd8b768-kolla-config\") pod \"3a737f89-e391-4a23-b3d5-fa2e2cd8b768\" (UID: \"3a737f89-e391-4a23-b3d5-fa2e2cd8b768\") " Mar 16 16:37:25 crc kubenswrapper[5120]: I0316 16:37:25.327735 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7b14f5ca-cdd4-4caa-94de-f7d7882916e0-config-data\") pod \"7b14f5ca-cdd4-4caa-94de-f7d7882916e0\" (UID: \"7b14f5ca-cdd4-4caa-94de-f7d7882916e0\") " Mar 16 16:37:25 crc kubenswrapper[5120]: I0316 16:37:25.328381 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3a737f89-e391-4a23-b3d5-fa2e2cd8b768-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "3a737f89-e391-4a23-b3d5-fa2e2cd8b768" (UID: "3a737f89-e391-4a23-b3d5-fa2e2cd8b768"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:37:25 crc kubenswrapper[5120]: I0316 16:37:25.328511 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7b14f5ca-cdd4-4caa-94de-f7d7882916e0-logs\") pod \"7b14f5ca-cdd4-4caa-94de-f7d7882916e0\" (UID: \"7b14f5ca-cdd4-4caa-94de-f7d7882916e0\") " Mar 16 16:37:25 crc kubenswrapper[5120]: I0316 16:37:25.328589 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/3a737f89-e391-4a23-b3d5-fa2e2cd8b768-config-data-generated\") pod \"3a737f89-e391-4a23-b3d5-fa2e2cd8b768\" (UID: \"3a737f89-e391-4a23-b3d5-fa2e2cd8b768\") " Mar 16 16:37:25 crc kubenswrapper[5120]: I0316 16:37:25.328856 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/3a737f89-e391-4a23-b3d5-fa2e2cd8b768-config-data-default\") pod \"3a737f89-e391-4a23-b3d5-fa2e2cd8b768\" (UID: \"3a737f89-e391-4a23-b3d5-fa2e2cd8b768\") " Mar 16 16:37:25 crc kubenswrapper[5120]: I0316 16:37:25.328901 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"mysql-db\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"3a737f89-e391-4a23-b3d5-fa2e2cd8b768\" (UID: \"3a737f89-e391-4a23-b3d5-fa2e2cd8b768\") " Mar 16 16:37:25 crc kubenswrapper[5120]: I0316 16:37:25.329120 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/3a737f89-e391-4a23-b3d5-fa2e2cd8b768-galera-tls-certs\") pod \"3a737f89-e391-4a23-b3d5-fa2e2cd8b768\" (UID: \"3a737f89-e391-4a23-b3d5-fa2e2cd8b768\") " Mar 16 16:37:25 crc kubenswrapper[5120]: I0316 16:37:25.329188 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7b14f5ca-cdd4-4caa-94de-f7d7882916e0-combined-ca-bundle\") pod \"7b14f5ca-cdd4-4caa-94de-f7d7882916e0\" (UID: \"7b14f5ca-cdd4-4caa-94de-f7d7882916e0\") " Mar 16 16:37:25 crc kubenswrapper[5120]: I0316 16:37:25.329280 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wdftm\" (UniqueName: \"kubernetes.io/projected/7b14f5ca-cdd4-4caa-94de-f7d7882916e0-kube-api-access-wdftm\") pod \"7b14f5ca-cdd4-4caa-94de-f7d7882916e0\" (UID: \"7b14f5ca-cdd4-4caa-94de-f7d7882916e0\") " Mar 16 16:37:25 crc kubenswrapper[5120]: I0316 16:37:25.329430 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/7b14f5ca-cdd4-4caa-94de-f7d7882916e0-public-tls-certs\") pod \"7b14f5ca-cdd4-4caa-94de-f7d7882916e0\" (UID: \"7b14f5ca-cdd4-4caa-94de-f7d7882916e0\") " Mar 16 16:37:25 crc kubenswrapper[5120]: I0316 16:37:25.329480 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3a737f89-e391-4a23-b3d5-fa2e2cd8b768-operator-scripts\") pod \"3a737f89-e391-4a23-b3d5-fa2e2cd8b768\" (UID: \"3a737f89-e391-4a23-b3d5-fa2e2cd8b768\") " Mar 16 16:37:25 crc kubenswrapper[5120]: I0316 16:37:25.330523 5120 reconciler_common.go:299] "Volume detached for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/8185e910-6b4a-4897-a27c-7f07b936beb8-nova-metadata-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:25 crc kubenswrapper[5120]: I0316 16:37:25.330551 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8185e910-6b4a-4897-a27c-7f07b936beb8-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:25 crc kubenswrapper[5120]: I0316 16:37:25.330564 5120 reconciler_common.go:299] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/3a737f89-e391-4a23-b3d5-fa2e2cd8b768-kolla-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:25 crc kubenswrapper[5120]: I0316 16:37:25.331683 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3a737f89-e391-4a23-b3d5-fa2e2cd8b768-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "3a737f89-e391-4a23-b3d5-fa2e2cd8b768" (UID: "3a737f89-e391-4a23-b3d5-fa2e2cd8b768"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:37:25 crc kubenswrapper[5120]: I0316 16:37:25.338564 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3a737f89-e391-4a23-b3d5-fa2e2cd8b768-config-data-default" (OuterVolumeSpecName: "config-data-default") pod "3a737f89-e391-4a23-b3d5-fa2e2cd8b768" (UID: "3a737f89-e391-4a23-b3d5-fa2e2cd8b768"). InnerVolumeSpecName "config-data-default". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:37:25 crc kubenswrapper[5120]: I0316 16:37:25.340785 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a737f89-e391-4a23-b3d5-fa2e2cd8b768-config-data-generated" (OuterVolumeSpecName: "config-data-generated") pod "3a737f89-e391-4a23-b3d5-fa2e2cd8b768" (UID: "3a737f89-e391-4a23-b3d5-fa2e2cd8b768"). InnerVolumeSpecName "config-data-generated". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:37:25 crc kubenswrapper[5120]: I0316 16:37:25.340897 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b14f5ca-cdd4-4caa-94de-f7d7882916e0-logs" (OuterVolumeSpecName: "logs") pod "7b14f5ca-cdd4-4caa-94de-f7d7882916e0" (UID: "7b14f5ca-cdd4-4caa-94de-f7d7882916e0"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:37:25 crc kubenswrapper[5120]: I0316 16:37:25.340995 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a737f89-e391-4a23-b3d5-fa2e2cd8b768-kube-api-access-6w6t4" (OuterVolumeSpecName: "kube-api-access-6w6t4") pod "3a737f89-e391-4a23-b3d5-fa2e2cd8b768" (UID: "3a737f89-e391-4a23-b3d5-fa2e2cd8b768"). InnerVolumeSpecName "kube-api-access-6w6t4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:37:25 crc kubenswrapper[5120]: I0316 16:37:25.351978 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b14f5ca-cdd4-4caa-94de-f7d7882916e0-kube-api-access-wdftm" (OuterVolumeSpecName: "kube-api-access-wdftm") pod "7b14f5ca-cdd4-4caa-94de-f7d7882916e0" (UID: "7b14f5ca-cdd4-4caa-94de-f7d7882916e0"). InnerVolumeSpecName "kube-api-access-wdftm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:37:25 crc kubenswrapper[5120]: I0316 16:37:25.365027 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3a737f89-e391-4a23-b3d5-fa2e2cd8b768-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "3a737f89-e391-4a23-b3d5-fa2e2cd8b768" (UID: "3a737f89-e391-4a23-b3d5-fa2e2cd8b768"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:25 crc kubenswrapper[5120]: I0316 16:37:25.369920 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b14f5ca-cdd4-4caa-94de-f7d7882916e0-config-data" (OuterVolumeSpecName: "config-data") pod "7b14f5ca-cdd4-4caa-94de-f7d7882916e0" (UID: "7b14f5ca-cdd4-4caa-94de-f7d7882916e0"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:25 crc kubenswrapper[5120]: I0316 16:37:25.382585 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage05-crc" (OuterVolumeSpecName: "mysql-db") pod "3a737f89-e391-4a23-b3d5-fa2e2cd8b768" (UID: "3a737f89-e391-4a23-b3d5-fa2e2cd8b768"). InnerVolumeSpecName "local-storage05-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:37:25 crc kubenswrapper[5120]: I0316 16:37:25.398833 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b14f5ca-cdd4-4caa-94de-f7d7882916e0-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "7b14f5ca-cdd4-4caa-94de-f7d7882916e0" (UID: "7b14f5ca-cdd4-4caa-94de-f7d7882916e0"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:25 crc kubenswrapper[5120]: I0316 16:37:25.422938 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3a737f89-e391-4a23-b3d5-fa2e2cd8b768-galera-tls-certs" (OuterVolumeSpecName: "galera-tls-certs") pod "3a737f89-e391-4a23-b3d5-fa2e2cd8b768" (UID: "3a737f89-e391-4a23-b3d5-fa2e2cd8b768"). InnerVolumeSpecName "galera-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:25 crc kubenswrapper[5120]: I0316 16:37:25.432819 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b14f5ca-cdd4-4caa-94de-f7d7882916e0-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "7b14f5ca-cdd4-4caa-94de-f7d7882916e0" (UID: "7b14f5ca-cdd4-4caa-94de-f7d7882916e0"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:25 crc kubenswrapper[5120]: I0316 16:37:25.434560 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3a737f89-e391-4a23-b3d5-fa2e2cd8b768-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:25 crc kubenswrapper[5120]: I0316 16:37:25.434602 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6w6t4\" (UniqueName: \"kubernetes.io/projected/3a737f89-e391-4a23-b3d5-fa2e2cd8b768-kube-api-access-6w6t4\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:25 crc kubenswrapper[5120]: I0316 16:37:25.434616 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7b14f5ca-cdd4-4caa-94de-f7d7882916e0-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:25 crc kubenswrapper[5120]: I0316 16:37:25.434627 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7b14f5ca-cdd4-4caa-94de-f7d7882916e0-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:25 crc kubenswrapper[5120]: I0316 16:37:25.434639 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/3a737f89-e391-4a23-b3d5-fa2e2cd8b768-config-data-generated\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:25 crc kubenswrapper[5120]: I0316 16:37:25.434650 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/3a737f89-e391-4a23-b3d5-fa2e2cd8b768-config-data-default\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:25 crc kubenswrapper[5120]: I0316 16:37:25.434765 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") on node \"crc\" " Mar 16 16:37:25 crc kubenswrapper[5120]: I0316 16:37:25.434782 5120 reconciler_common.go:299] "Volume detached for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/3a737f89-e391-4a23-b3d5-fa2e2cd8b768-galera-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:25 crc kubenswrapper[5120]: I0316 16:37:25.434793 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7b14f5ca-cdd4-4caa-94de-f7d7882916e0-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:25 crc kubenswrapper[5120]: I0316 16:37:25.434803 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wdftm\" (UniqueName: \"kubernetes.io/projected/7b14f5ca-cdd4-4caa-94de-f7d7882916e0-kube-api-access-wdftm\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:25 crc kubenswrapper[5120]: I0316 16:37:25.434812 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3a737f89-e391-4a23-b3d5-fa2e2cd8b768-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:25 crc kubenswrapper[5120]: I0316 16:37:25.434822 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/7b14f5ca-cdd4-4caa-94de-f7d7882916e0-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:25 crc kubenswrapper[5120]: I0316 16:37:25.467018 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage05-crc" (UniqueName: "kubernetes.io/local-volume/local-storage05-crc") on node "crc" Mar 16 16:37:25 crc kubenswrapper[5120]: I0316 16:37:25.536061 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b14f5ca-cdd4-4caa-94de-f7d7882916e0-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "7b14f5ca-cdd4-4caa-94de-f7d7882916e0" (UID: "7b14f5ca-cdd4-4caa-94de-f7d7882916e0"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:25 crc kubenswrapper[5120]: I0316 16:37:25.536439 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/7b14f5ca-cdd4-4caa-94de-f7d7882916e0-public-tls-certs\") pod \"7b14f5ca-cdd4-4caa-94de-f7d7882916e0\" (UID: \"7b14f5ca-cdd4-4caa-94de-f7d7882916e0\") " Mar 16 16:37:25 crc kubenswrapper[5120]: I0316 16:37:25.537265 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:25 crc kubenswrapper[5120]: W0316 16:37:25.537356 5120 empty_dir.go:511] Warning: Unmount skipped because path does not exist: /var/lib/kubelet/pods/7b14f5ca-cdd4-4caa-94de-f7d7882916e0/volumes/kubernetes.io~secret/public-tls-certs Mar 16 16:37:25 crc kubenswrapper[5120]: I0316 16:37:25.537372 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b14f5ca-cdd4-4caa-94de-f7d7882916e0-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "7b14f5ca-cdd4-4caa-94de-f7d7882916e0" (UID: "7b14f5ca-cdd4-4caa-94de-f7d7882916e0"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:25 crc kubenswrapper[5120]: I0316 16:37:25.640743 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/7b14f5ca-cdd4-4caa-94de-f7d7882916e0-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:25 crc kubenswrapper[5120]: I0316 16:37:25.728078 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-create-zq6kk" Mar 16 16:37:25 crc kubenswrapper[5120]: I0316 16:37:25.745300 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c8e25f38-a6c2-4c21-8c86-27c91143ddb9-operator-scripts\") pod \"c8e25f38-a6c2-4c21-8c86-27c91143ddb9\" (UID: \"c8e25f38-a6c2-4c21-8c86-27c91143ddb9\") " Mar 16 16:37:25 crc kubenswrapper[5120]: I0316 16:37:25.745830 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4hh4r\" (UniqueName: \"kubernetes.io/projected/c8e25f38-a6c2-4c21-8c86-27c91143ddb9-kube-api-access-4hh4r\") pod \"c8e25f38-a6c2-4c21-8c86-27c91143ddb9\" (UID: \"c8e25f38-a6c2-4c21-8c86-27c91143ddb9\") " Mar 16 16:37:25 crc kubenswrapper[5120]: I0316 16:37:25.747670 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c8e25f38-a6c2-4c21-8c86-27c91143ddb9-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "c8e25f38-a6c2-4c21-8c86-27c91143ddb9" (UID: "c8e25f38-a6c2-4c21-8c86-27c91143ddb9"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:37:25 crc kubenswrapper[5120]: I0316 16:37:25.757821 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8e25f38-a6c2-4c21-8c86-27c91143ddb9-kube-api-access-4hh4r" (OuterVolumeSpecName: "kube-api-access-4hh4r") pod "c8e25f38-a6c2-4c21-8c86-27c91143ddb9" (UID: "c8e25f38-a6c2-4c21-8c86-27c91143ddb9"). InnerVolumeSpecName "kube-api-access-4hh4r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:37:25 crc kubenswrapper[5120]: I0316 16:37:25.849938 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c8e25f38-a6c2-4c21-8c86-27c91143ddb9-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:25 crc kubenswrapper[5120]: I0316 16:37:25.849973 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4hh4r\" (UniqueName: \"kubernetes.io/projected/c8e25f38-a6c2-4c21-8c86-27c91143ddb9-kube-api-access-4hh4r\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:25 crc kubenswrapper[5120]: I0316 16:37:25.910279 5120 scope.go:117] "RemoveContainer" containerID="36ac89da2257ee0943c9591a98ca94e5b5d62e323bd4ab556d4334c4ea9a86cc" Mar 16 16:37:25 crc kubenswrapper[5120]: I0316 16:37:25.924512 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-e7be-account-create-update-962rm" Mar 16 16:37:25 crc kubenswrapper[5120]: I0316 16:37:25.967911 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8tzh7\" (UniqueName: \"kubernetes.io/projected/b699bf06-329e-4b4c-801b-1348cffce1e4-kube-api-access-8tzh7\") pod \"b699bf06-329e-4b4c-801b-1348cffce1e4\" (UID: \"b699bf06-329e-4b4c-801b-1348cffce1e4\") " Mar 16 16:37:25 crc kubenswrapper[5120]: I0316 16:37:25.968516 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b699bf06-329e-4b4c-801b-1348cffce1e4-operator-scripts\") pod \"b699bf06-329e-4b4c-801b-1348cffce1e4\" (UID: \"b699bf06-329e-4b4c-801b-1348cffce1e4\") " Mar 16 16:37:25 crc kubenswrapper[5120]: E0316 16:37:25.969300 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-config-data: configmap "rabbitmq-config-data" not found Mar 16 16:37:25 crc kubenswrapper[5120]: E0316 16:37:25.969369 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a03095a2-0907-4be8-ac85-43befd648111-config-data podName:a03095a2-0907-4be8-ac85-43befd648111 nodeName:}" failed. No retries permitted until 2026-03-16 16:37:29.969348159 +0000 UTC m=+3952.123279816 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/a03095a2-0907-4be8-ac85-43befd648111-config-data") pod "rabbitmq-server-0" (UID: "a03095a2-0907-4be8-ac85-43befd648111") : configmap "rabbitmq-config-data" not found Mar 16 16:37:25 crc kubenswrapper[5120]: I0316 16:37:25.973534 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b699bf06-329e-4b4c-801b-1348cffce1e4-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "b699bf06-329e-4b4c-801b-1348cffce1e4" (UID: "b699bf06-329e-4b4c-801b-1348cffce1e4"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:37:25 crc kubenswrapper[5120]: I0316 16:37:25.986713 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/neutron-8bf565768-57qhf" podUID="b21fb0d1-eae4-4ac7-b3fe-6b62df9f6453" containerName="neutron-httpd" probeResult="failure" output="Get \"https://10.217.0.226:9696/\": dial tcp 10.217.0.226:9696: connect: connection refused" Mar 16 16:37:25 crc kubenswrapper[5120]: I0316 16:37:25.988586 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b699bf06-329e-4b4c-801b-1348cffce1e4-kube-api-access-8tzh7" (OuterVolumeSpecName: "kube-api-access-8tzh7") pod "b699bf06-329e-4b4c-801b-1348cffce1e4" (UID: "b699bf06-329e-4b4c-801b-1348cffce1e4"). InnerVolumeSpecName "kube-api-access-8tzh7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:37:26 crc kubenswrapper[5120]: E0316 16:37:26.001376 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="1502302cf5fdfbaedff9cdb3378e080511758ed3133fd93311514c3312d06191" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:37:26 crc kubenswrapper[5120]: E0316 16:37:26.030984 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="1502302cf5fdfbaedff9cdb3378e080511758ed3133fd93311514c3312d06191" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.037535 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/root-account-create-update-5f8nh"] Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.038823 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a737f89-e391-4a23-b3d5-fa2e2cd8b768" containerName="mysql-bootstrap" Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.038846 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a737f89-e391-4a23-b3d5-fa2e2cd8b768" containerName="mysql-bootstrap" Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.038866 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8185e910-6b4a-4897-a27c-7f07b936beb8" containerName="nova-metadata-log" Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.038873 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8185e910-6b4a-4897-a27c-7f07b936beb8" containerName="nova-metadata-log" Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.038885 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58b4ac02-d549-4064-89d2-db3e507c0efc" containerName="ovsdbserver-sb" Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.038892 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="58b4ac02-d549-4064-89d2-db3e507c0efc" containerName="ovsdbserver-sb" Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.038905 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58b4ac02-d549-4064-89d2-db3e507c0efc" containerName="openstack-network-exporter" Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.038912 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="58b4ac02-d549-4064-89d2-db3e507c0efc" containerName="openstack-network-exporter" Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.038924 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a737f89-e391-4a23-b3d5-fa2e2cd8b768" containerName="galera" Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.038931 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a737f89-e391-4a23-b3d5-fa2e2cd8b768" containerName="galera" Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.039708 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1fe0dc2f-7c59-4d24-9b66-47c888321f7d" containerName="ovsdbserver-nb" Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.039722 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1fe0dc2f-7c59-4d24-9b66-47c888321f7d" containerName="ovsdbserver-nb" Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.039778 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8185e910-6b4a-4897-a27c-7f07b936beb8" containerName="nova-metadata-metadata" Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.039786 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8185e910-6b4a-4897-a27c-7f07b936beb8" containerName="nova-metadata-metadata" Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.039800 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1fe0dc2f-7c59-4d24-9b66-47c888321f7d" containerName="openstack-network-exporter" Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.039808 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1fe0dc2f-7c59-4d24-9b66-47c888321f7d" containerName="openstack-network-exporter" Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.039833 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8e25f38-a6c2-4c21-8c86-27c91143ddb9" containerName="mariadb-database-create" Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.039841 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8e25f38-a6c2-4c21-8c86-27c91143ddb9" containerName="mariadb-database-create" Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.039856 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b14f5ca-cdd4-4caa-94de-f7d7882916e0" containerName="nova-api-log" Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.039864 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b14f5ca-cdd4-4caa-94de-f7d7882916e0" containerName="nova-api-log" Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.039873 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b14f5ca-cdd4-4caa-94de-f7d7882916e0" containerName="nova-api-api" Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.039882 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b14f5ca-cdd4-4caa-94de-f7d7882916e0" containerName="nova-api-api" Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.040120 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="8185e910-6b4a-4897-a27c-7f07b936beb8" containerName="nova-metadata-metadata" Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.040132 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="58b4ac02-d549-4064-89d2-db3e507c0efc" containerName="openstack-network-exporter" Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.040143 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1fe0dc2f-7c59-4d24-9b66-47c888321f7d" containerName="openstack-network-exporter" Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.040159 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1fe0dc2f-7c59-4d24-9b66-47c888321f7d" containerName="ovsdbserver-nb" Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.040172 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="8185e910-6b4a-4897-a27c-7f07b936beb8" containerName="nova-metadata-log" Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.040183 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7b14f5ca-cdd4-4caa-94de-f7d7882916e0" containerName="nova-api-api" Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.040199 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7b14f5ca-cdd4-4caa-94de-f7d7882916e0" containerName="nova-api-log" Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.040210 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="58b4ac02-d549-4064-89d2-db3e507c0efc" containerName="ovsdbserver-sb" Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.040224 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="3a737f89-e391-4a23-b3d5-fa2e2cd8b768" containerName="galera" Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.040236 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c8e25f38-a6c2-4c21-8c86-27c91143ddb9" containerName="mariadb-database-create" Mar 16 16:37:26 crc kubenswrapper[5120]: E0316 16:37:26.059662 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="1502302cf5fdfbaedff9cdb3378e080511758ed3133fd93311514c3312d06191" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:37:26 crc kubenswrapper[5120]: E0316 16:37:26.059773 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="e9337f85-3f26-46e9-bbf3-ea53f581eab6" containerName="nova-cell1-conductor-conductor" probeResult="unknown" Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.072909 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-5f8nh"] Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.073100 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-5f8nh" Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.073588 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b699bf06-329e-4b4c-801b-1348cffce1e4-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.073626 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8tzh7\" (UniqueName: \"kubernetes.io/projected/b699bf06-329e-4b4c-801b-1348cffce1e4-kube-api-access-8tzh7\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.082509 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"openstack-mariadb-root-db-secret\"" Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.094356 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/cinder-api-0" podUID="2fbd9119-d73e-4c1e-99b9-8f078e2acdfb" containerName="cinder-api" probeResult="failure" output="Get \"https://10.217.0.227:8776/healthcheck\": read tcp 10.217.0.2:33316->10.217.0.227:8776: read: connection reset by peer" Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.180579 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/493341f2-da9f-4064-b028-e674200e264d-operator-scripts\") pod \"root-account-create-update-5f8nh\" (UID: \"493341f2-da9f-4064-b028-e674200e264d\") " pod="openstack-kuttl-tests/root-account-create-update-5f8nh" Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.183886 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkrvx\" (UniqueName: \"kubernetes.io/projected/493341f2-da9f-4064-b028-e674200e264d-kube-api-access-xkrvx\") pod \"root-account-create-update-5f8nh\" (UID: \"493341f2-da9f-4064-b028-e674200e264d\") " pod="openstack-kuttl-tests/root-account-create-update-5f8nh" Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.194243 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.194869 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"8185e910-6b4a-4897-a27c-7f07b936beb8","Type":"ContainerDied","Data":"b800e02dc61683c4a8ba799ff13c95b093d4d68409c2f9cfa2da8c0f122ebd3d"} Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.194941 5120 scope.go:117] "RemoveContainer" containerID="23eeffc81ea64adda7d1ec2a8f840580914c6c9f5e5047584b49b36400d52bae" Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.208455 5120 generic.go:358] "Generic (PLEG): container finished" podID="e3236580-0d7f-4a04-ae0f-5ae8b073d6b7" containerID="c571cf34fd0e3bd683dfb18e6a22a56da066ae6e0cf5b1a616392a29bff9e024" exitCode=0 Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.208551 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-747d4cf944-dk26n" event={"ID":"e3236580-0d7f-4a04-ae0f-5ae8b073d6b7","Type":"ContainerDied","Data":"c571cf34fd0e3bd683dfb18e6a22a56da066ae6e0cf5b1a616392a29bff9e024"} Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.230667 5120 generic.go:358] "Generic (PLEG): container finished" podID="204ff621-b59e-44f0-84a5-c9e4eaaf86bf" containerID="d962a27ae73b49d661904f00b163e9adbf24cc2cced96780802051c61348e02b" exitCode=0 Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.231105 5120 generic.go:358] "Generic (PLEG): container finished" podID="204ff621-b59e-44f0-84a5-c9e4eaaf86bf" containerID="56d4baebbb806417e5fc468a17b33231ff7a0538573b3437ce67ad2bd53c1afa" exitCode=0 Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.231308 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"204ff621-b59e-44f0-84a5-c9e4eaaf86bf","Type":"ContainerDied","Data":"d962a27ae73b49d661904f00b163e9adbf24cc2cced96780802051c61348e02b"} Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.231345 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"204ff621-b59e-44f0-84a5-c9e4eaaf86bf","Type":"ContainerDied","Data":"56d4baebbb806417e5fc468a17b33231ff7a0538573b3437ce67ad2bd53c1afa"} Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.234374 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.234380 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"7b14f5ca-cdd4-4caa-94de-f7d7882916e0","Type":"ContainerDied","Data":"eb666931cf209c1ad5486fab5456e86421aafc6e7a7a1277b31c6cd8e680225a"} Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.238649 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-e7be-account-create-update-962rm" event={"ID":"b699bf06-329e-4b4c-801b-1348cffce1e4","Type":"ContainerDied","Data":"a6f2af4a8b3f532fb54afffa37ff18e3111f43da0fc0087ee4a3e7077a4b17b2"} Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.238671 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-e7be-account-create-update-962rm" Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.243104 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"2c50d5a6-1160-4c1d-a0ee-6dff4d5e6b87","Type":"ContainerDied","Data":"f8e4b511b04673e09ae05973bfb5a1826b20d78b667290d933c5c35a7a3386fc"} Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.243152 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f8e4b511b04673e09ae05973bfb5a1826b20d78b667290d933c5c35a7a3386fc" Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.248172 5120 generic.go:358] "Generic (PLEG): container finished" podID="613be4ed-d055-4f50-a323-8b13e5c5fe1a" containerID="4e25db5c9a91ab6c5e9d9ea567f1afbd22b33692b261fb638331d9b211b125db" exitCode=0 Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.248220 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"613be4ed-d055-4f50-a323-8b13e5c5fe1a","Type":"ContainerDied","Data":"4e25db5c9a91ab6c5e9d9ea567f1afbd22b33692b261fb638331d9b211b125db"} Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.250056 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"3a737f89-e391-4a23-b3d5-fa2e2cd8b768","Type":"ContainerDied","Data":"78d9289c7102c80ea0265c052b718b078407d1a28800b146af53cab179c73c96"} Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.250151 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.254341 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-create-zq6kk" event={"ID":"c8e25f38-a6c2-4c21-8c86-27c91143ddb9","Type":"ContainerDied","Data":"5f8cbc8fcaa87bad2e526ac9a76a9fcafe136c6ee88c8f400c8148284db80dba"} Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.254511 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-create-zq6kk" Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.259250 5120 generic.go:358] "Generic (PLEG): container finished" podID="c1a2ba61-a67d-4937-9979-9f10c744a1a8" containerID="cb21c359b23b03f5e91a52989546953e9e8fad15e126dc02107149d24a46a45b" exitCode=0 Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.259310 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"c1a2ba61-a67d-4937-9979-9f10c744a1a8","Type":"ContainerDied","Data":"cb21c359b23b03f5e91a52989546953e9e8fad15e126dc02107149d24a46a45b"} Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.261282 5120 generic.go:358] "Generic (PLEG): container finished" podID="46b6f5ef-ac2f-4add-8c6b-1157abccfbfe" containerID="58d160f133e7a544995711ab2da546c604a09aa66243ab21dcd76c000103b09f" exitCode=0 Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.261301 5120 generic.go:358] "Generic (PLEG): container finished" podID="46b6f5ef-ac2f-4add-8c6b-1157abccfbfe" containerID="6239d9262ea4e6d804dc34e524958245dbc975aa665284c54c62b5dca2c72739" exitCode=0 Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.261321 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-598db64bc5-jp86s" event={"ID":"46b6f5ef-ac2f-4add-8c6b-1157abccfbfe","Type":"ContainerDied","Data":"58d160f133e7a544995711ab2da546c604a09aa66243ab21dcd76c000103b09f"} Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.261336 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-598db64bc5-jp86s" event={"ID":"46b6f5ef-ac2f-4add-8c6b-1157abccfbfe","Type":"ContainerDied","Data":"6239d9262ea4e6d804dc34e524958245dbc975aa665284c54c62b5dca2c72739"} Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.286158 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/493341f2-da9f-4064-b028-e674200e264d-operator-scripts\") pod \"root-account-create-update-5f8nh\" (UID: \"493341f2-da9f-4064-b028-e674200e264d\") " pod="openstack-kuttl-tests/root-account-create-update-5f8nh" Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.286298 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xkrvx\" (UniqueName: \"kubernetes.io/projected/493341f2-da9f-4064-b028-e674200e264d-kube-api-access-xkrvx\") pod \"root-account-create-update-5f8nh\" (UID: \"493341f2-da9f-4064-b028-e674200e264d\") " pod="openstack-kuttl-tests/root-account-create-update-5f8nh" Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.289052 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/493341f2-da9f-4064-b028-e674200e264d-operator-scripts\") pod \"root-account-create-update-5f8nh\" (UID: \"493341f2-da9f-4064-b028-e674200e264d\") " pod="openstack-kuttl-tests/root-account-create-update-5f8nh" Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.335103 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkrvx\" (UniqueName: \"kubernetes.io/projected/493341f2-da9f-4064-b028-e674200e264d-kube-api-access-xkrvx\") pod \"root-account-create-update-5f8nh\" (UID: \"493341f2-da9f-4064-b028-e674200e264d\") " pod="openstack-kuttl-tests/root-account-create-update-5f8nh" Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.370597 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.373973 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-5f8nh" Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.412102 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-5zz68" Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.416685 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-e7be-account-create-update-962rm"] Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.422510 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.427969 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-e7be-account-create-update-962rm"] Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.443830 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.455034 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.468317 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.476450 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.491245 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-db-create-zq6kk"] Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.493977 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/613be4ed-d055-4f50-a323-8b13e5c5fe1a-combined-ca-bundle\") pod \"613be4ed-d055-4f50-a323-8b13e5c5fe1a\" (UID: \"613be4ed-d055-4f50-a323-8b13e5c5fe1a\") " Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.494175 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/2c50d5a6-1160-4c1d-a0ee-6dff4d5e6b87-kube-state-metrics-tls-config\") pod \"2c50d5a6-1160-4c1d-a0ee-6dff4d5e6b87\" (UID: \"2c50d5a6-1160-4c1d-a0ee-6dff4d5e6b87\") " Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.494403 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kwbjm\" (UniqueName: \"kubernetes.io/projected/70f75c98-8188-4143-a468-6f83825ca23c-kube-api-access-kwbjm\") pod \"70f75c98-8188-4143-a468-6f83825ca23c\" (UID: \"70f75c98-8188-4143-a468-6f83825ca23c\") " Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.494596 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/613be4ed-d055-4f50-a323-8b13e5c5fe1a-vencrypt-tls-certs\") pod \"613be4ed-d055-4f50-a323-8b13e5c5fe1a\" (UID: \"613be4ed-d055-4f50-a323-8b13e5c5fe1a\") " Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.495648 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2c50d5a6-1160-4c1d-a0ee-6dff4d5e6b87-combined-ca-bundle\") pod \"2c50d5a6-1160-4c1d-a0ee-6dff4d5e6b87\" (UID: \"2c50d5a6-1160-4c1d-a0ee-6dff4d5e6b87\") " Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.495871 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/613be4ed-d055-4f50-a323-8b13e5c5fe1a-nova-novncproxy-tls-certs\") pod \"613be4ed-d055-4f50-a323-8b13e5c5fe1a\" (UID: \"613be4ed-d055-4f50-a323-8b13e5c5fe1a\") " Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.495990 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/613be4ed-d055-4f50-a323-8b13e5c5fe1a-config-data\") pod \"613be4ed-d055-4f50-a323-8b13e5c5fe1a\" (UID: \"613be4ed-d055-4f50-a323-8b13e5c5fe1a\") " Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.496214 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/2c50d5a6-1160-4c1d-a0ee-6dff4d5e6b87-kube-state-metrics-tls-certs\") pod \"2c50d5a6-1160-4c1d-a0ee-6dff4d5e6b87\" (UID: \"2c50d5a6-1160-4c1d-a0ee-6dff4d5e6b87\") " Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.496359 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/70f75c98-8188-4143-a468-6f83825ca23c-operator-scripts\") pod \"70f75c98-8188-4143-a468-6f83825ca23c\" (UID: \"70f75c98-8188-4143-a468-6f83825ca23c\") " Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.496456 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f7d8m\" (UniqueName: \"kubernetes.io/projected/2c50d5a6-1160-4c1d-a0ee-6dff4d5e6b87-kube-api-access-f7d8m\") pod \"2c50d5a6-1160-4c1d-a0ee-6dff4d5e6b87\" (UID: \"2c50d5a6-1160-4c1d-a0ee-6dff4d5e6b87\") " Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.496655 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dzxsf\" (UniqueName: \"kubernetes.io/projected/613be4ed-d055-4f50-a323-8b13e5c5fe1a-kube-api-access-dzxsf\") pod \"613be4ed-d055-4f50-a323-8b13e5c5fe1a\" (UID: \"613be4ed-d055-4f50-a323-8b13e5c5fe1a\") " Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.498918 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/70f75c98-8188-4143-a468-6f83825ca23c-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "70f75c98-8188-4143-a468-6f83825ca23c" (UID: "70f75c98-8188-4143-a468-6f83825ca23c"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.506982 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-db-create-zq6kk"] Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.517219 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.525413 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/613be4ed-d055-4f50-a323-8b13e5c5fe1a-kube-api-access-dzxsf" (OuterVolumeSpecName: "kube-api-access-dzxsf") pod "613be4ed-d055-4f50-a323-8b13e5c5fe1a" (UID: "613be4ed-d055-4f50-a323-8b13e5c5fe1a"). InnerVolumeSpecName "kube-api-access-dzxsf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.526286 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c50d5a6-1160-4c1d-a0ee-6dff4d5e6b87-kube-api-access-f7d8m" (OuterVolumeSpecName: "kube-api-access-f7d8m") pod "2c50d5a6-1160-4c1d-a0ee-6dff4d5e6b87" (UID: "2c50d5a6-1160-4c1d-a0ee-6dff4d5e6b87"). InnerVolumeSpecName "kube-api-access-f7d8m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.528262 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70f75c98-8188-4143-a468-6f83825ca23c-kube-api-access-kwbjm" (OuterVolumeSpecName: "kube-api-access-kwbjm") pod "70f75c98-8188-4143-a468-6f83825ca23c" (UID: "70f75c98-8188-4143-a468-6f83825ca23c"). InnerVolumeSpecName "kube-api-access-kwbjm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.557911 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.579680 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2c50d5a6-1160-4c1d-a0ee-6dff4d5e6b87-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "2c50d5a6-1160-4c1d-a0ee-6dff4d5e6b87" (UID: "2c50d5a6-1160-4c1d-a0ee-6dff4d5e6b87"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.588037 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2c50d5a6-1160-4c1d-a0ee-6dff4d5e6b87-kube-state-metrics-tls-config" (OuterVolumeSpecName: "kube-state-metrics-tls-config") pod "2c50d5a6-1160-4c1d-a0ee-6dff4d5e6b87" (UID: "2c50d5a6-1160-4c1d-a0ee-6dff4d5e6b87"). InnerVolumeSpecName "kube-state-metrics-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.598456 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/613be4ed-d055-4f50-a323-8b13e5c5fe1a-vencrypt-tls-certs" (OuterVolumeSpecName: "vencrypt-tls-certs") pod "613be4ed-d055-4f50-a323-8b13e5c5fe1a" (UID: "613be4ed-d055-4f50-a323-8b13e5c5fe1a"). InnerVolumeSpecName "vencrypt-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.601512 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/70f75c98-8188-4143-a468-6f83825ca23c-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.602640 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f7d8m\" (UniqueName: \"kubernetes.io/projected/2c50d5a6-1160-4c1d-a0ee-6dff4d5e6b87-kube-api-access-f7d8m\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.602666 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dzxsf\" (UniqueName: \"kubernetes.io/projected/613be4ed-d055-4f50-a323-8b13e5c5fe1a-kube-api-access-dzxsf\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.602675 5120 reconciler_common.go:299] "Volume detached for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/2c50d5a6-1160-4c1d-a0ee-6dff4d5e6b87-kube-state-metrics-tls-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.602686 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kwbjm\" (UniqueName: \"kubernetes.io/projected/70f75c98-8188-4143-a468-6f83825ca23c-kube-api-access-kwbjm\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.602699 5120 reconciler_common.go:299] "Volume detached for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/613be4ed-d055-4f50-a323-8b13e5c5fe1a-vencrypt-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.602708 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2c50d5a6-1160-4c1d-a0ee-6dff4d5e6b87-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.610891 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/613be4ed-d055-4f50-a323-8b13e5c5fe1a-config-data" (OuterVolumeSpecName: "config-data") pod "613be4ed-d055-4f50-a323-8b13e5c5fe1a" (UID: "613be4ed-d055-4f50-a323-8b13e5c5fe1a"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.614925 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/613be4ed-d055-4f50-a323-8b13e5c5fe1a-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "613be4ed-d055-4f50-a323-8b13e5c5fe1a" (UID: "613be4ed-d055-4f50-a323-8b13e5c5fe1a"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.628518 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/613be4ed-d055-4f50-a323-8b13e5c5fe1a-nova-novncproxy-tls-certs" (OuterVolumeSpecName: "nova-novncproxy-tls-certs") pod "613be4ed-d055-4f50-a323-8b13e5c5fe1a" (UID: "613be4ed-d055-4f50-a323-8b13e5c5fe1a"). InnerVolumeSpecName "nova-novncproxy-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.645207 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2c50d5a6-1160-4c1d-a0ee-6dff4d5e6b87-kube-state-metrics-tls-certs" (OuterVolumeSpecName: "kube-state-metrics-tls-certs") pod "2c50d5a6-1160-4c1d-a0ee-6dff4d5e6b87" (UID: "2c50d5a6-1160-4c1d-a0ee-6dff4d5e6b87"). InnerVolumeSpecName "kube-state-metrics-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.689754 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1fe0dc2f-7c59-4d24-9b66-47c888321f7d" path="/var/lib/kubelet/pods/1fe0dc2f-7c59-4d24-9b66-47c888321f7d/volumes" Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.690512 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3a737f89-e391-4a23-b3d5-fa2e2cd8b768" path="/var/lib/kubelet/pods/3a737f89-e391-4a23-b3d5-fa2e2cd8b768/volumes" Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.691775 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7b14f5ca-cdd4-4caa-94de-f7d7882916e0" path="/var/lib/kubelet/pods/7b14f5ca-cdd4-4caa-94de-f7d7882916e0/volumes" Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.692361 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8185e910-6b4a-4897-a27c-7f07b936beb8" path="/var/lib/kubelet/pods/8185e910-6b4a-4897-a27c-7f07b936beb8/volumes" Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.692954 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b699bf06-329e-4b4c-801b-1348cffce1e4" path="/var/lib/kubelet/pods/b699bf06-329e-4b4c-801b-1348cffce1e4/volumes" Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.693306 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c8e25f38-a6c2-4c21-8c86-27c91143ddb9" path="/var/lib/kubelet/pods/c8e25f38-a6c2-4c21-8c86-27c91143ddb9/volumes" Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.705570 5120 reconciler_common.go:299] "Volume detached for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/613be4ed-d055-4f50-a323-8b13e5c5fe1a-nova-novncproxy-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.705606 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/613be4ed-d055-4f50-a323-8b13e5c5fe1a-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.705625 5120 reconciler_common.go:299] "Volume detached for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/2c50d5a6-1160-4c1d-a0ee-6dff4d5e6b87-kube-state-metrics-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.705636 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/613be4ed-d055-4f50-a323-8b13e5c5fe1a-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.744793 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-598db64bc5-jp86s" Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.761534 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-747d4cf944-dk26n" Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.770668 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.817911 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/46b6f5ef-ac2f-4add-8c6b-1157abccfbfe-run-httpd\") pod \"46b6f5ef-ac2f-4add-8c6b-1157abccfbfe\" (UID: \"46b6f5ef-ac2f-4add-8c6b-1157abccfbfe\") " Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.818067 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e3236580-0d7f-4a04-ae0f-5ae8b073d6b7-combined-ca-bundle\") pod \"e3236580-0d7f-4a04-ae0f-5ae8b073d6b7\" (UID: \"e3236580-0d7f-4a04-ae0f-5ae8b073d6b7\") " Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.818157 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/46b6f5ef-ac2f-4add-8c6b-1157abccfbfe-config-data\") pod \"46b6f5ef-ac2f-4add-8c6b-1157abccfbfe\" (UID: \"46b6f5ef-ac2f-4add-8c6b-1157abccfbfe\") " Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.818209 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/46b6f5ef-ac2f-4add-8c6b-1157abccfbfe-log-httpd\") pod \"46b6f5ef-ac2f-4add-8c6b-1157abccfbfe\" (UID: \"46b6f5ef-ac2f-4add-8c6b-1157abccfbfe\") " Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.818324 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e3236580-0d7f-4a04-ae0f-5ae8b073d6b7-public-tls-certs\") pod \"e3236580-0d7f-4a04-ae0f-5ae8b073d6b7\" (UID: \"e3236580-0d7f-4a04-ae0f-5ae8b073d6b7\") " Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.818346 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e3236580-0d7f-4a04-ae0f-5ae8b073d6b7-logs\") pod \"e3236580-0d7f-4a04-ae0f-5ae8b073d6b7\" (UID: \"e3236580-0d7f-4a04-ae0f-5ae8b073d6b7\") " Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.818425 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e3236580-0d7f-4a04-ae0f-5ae8b073d6b7-scripts\") pod \"e3236580-0d7f-4a04-ae0f-5ae8b073d6b7\" (UID: \"e3236580-0d7f-4a04-ae0f-5ae8b073d6b7\") " Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.822073 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/46b6f5ef-ac2f-4add-8c6b-1157abccfbfe-public-tls-certs\") pod \"46b6f5ef-ac2f-4add-8c6b-1157abccfbfe\" (UID: \"46b6f5ef-ac2f-4add-8c6b-1157abccfbfe\") " Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.822115 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fb2gk\" (UniqueName: \"kubernetes.io/projected/46b6f5ef-ac2f-4add-8c6b-1157abccfbfe-kube-api-access-fb2gk\") pod \"46b6f5ef-ac2f-4add-8c6b-1157abccfbfe\" (UID: \"46b6f5ef-ac2f-4add-8c6b-1157abccfbfe\") " Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.822239 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e3236580-0d7f-4a04-ae0f-5ae8b073d6b7-config-data\") pod \"e3236580-0d7f-4a04-ae0f-5ae8b073d6b7\" (UID: \"e3236580-0d7f-4a04-ae0f-5ae8b073d6b7\") " Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.822272 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5wssj\" (UniqueName: \"kubernetes.io/projected/e3236580-0d7f-4a04-ae0f-5ae8b073d6b7-kube-api-access-5wssj\") pod \"e3236580-0d7f-4a04-ae0f-5ae8b073d6b7\" (UID: \"e3236580-0d7f-4a04-ae0f-5ae8b073d6b7\") " Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.822289 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/46b6f5ef-ac2f-4add-8c6b-1157abccfbfe-etc-swift\") pod \"46b6f5ef-ac2f-4add-8c6b-1157abccfbfe\" (UID: \"46b6f5ef-ac2f-4add-8c6b-1157abccfbfe\") " Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.822342 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/46b6f5ef-ac2f-4add-8c6b-1157abccfbfe-combined-ca-bundle\") pod \"46b6f5ef-ac2f-4add-8c6b-1157abccfbfe\" (UID: \"46b6f5ef-ac2f-4add-8c6b-1157abccfbfe\") " Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.822372 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e3236580-0d7f-4a04-ae0f-5ae8b073d6b7-internal-tls-certs\") pod \"e3236580-0d7f-4a04-ae0f-5ae8b073d6b7\" (UID: \"e3236580-0d7f-4a04-ae0f-5ae8b073d6b7\") " Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.822416 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/46b6f5ef-ac2f-4add-8c6b-1157abccfbfe-internal-tls-certs\") pod \"46b6f5ef-ac2f-4add-8c6b-1157abccfbfe\" (UID: \"46b6f5ef-ac2f-4add-8c6b-1157abccfbfe\") " Mar 16 16:37:26 crc kubenswrapper[5120]: E0316 16:37:26.829988 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-memcached-svc: secret "cert-memcached-svc" not found Mar 16 16:37:26 crc kubenswrapper[5120]: E0316 16:37:26.831108 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cc5c2d3-3da0-4d0c-9541-78f0bf375648-memcached-tls-certs podName:2cc5c2d3-3da0-4d0c-9541-78f0bf375648 nodeName:}" failed. No retries permitted until 2026-03-16 16:37:27.331091386 +0000 UTC m=+3949.485023043 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "memcached-tls-certs" (UniqueName: "kubernetes.io/secret/2cc5c2d3-3da0-4d0c-9541-78f0bf375648-memcached-tls-certs") pod "memcached-0" (UID: "2cc5c2d3-3da0-4d0c-9541-78f0bf375648") : secret "cert-memcached-svc" not found Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.837685 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e3236580-0d7f-4a04-ae0f-5ae8b073d6b7-logs" (OuterVolumeSpecName: "logs") pod "e3236580-0d7f-4a04-ae0f-5ae8b073d6b7" (UID: "e3236580-0d7f-4a04-ae0f-5ae8b073d6b7"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:37:26 crc kubenswrapper[5120]: E0316 16:37:26.841034 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 16:37:26 crc kubenswrapper[5120]: E0316 16:37:26.841104 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cc5c2d3-3da0-4d0c-9541-78f0bf375648-combined-ca-bundle podName:2cc5c2d3-3da0-4d0c-9541-78f0bf375648 nodeName:}" failed. No retries permitted until 2026-03-16 16:37:27.341087477 +0000 UTC m=+3949.495019134 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/2cc5c2d3-3da0-4d0c-9541-78f0bf375648-combined-ca-bundle") pod "memcached-0" (UID: "2cc5c2d3-3da0-4d0c-9541-78f0bf375648") : secret "combined-ca-bundle" not found Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.842003 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46b6f5ef-ac2f-4add-8c6b-1157abccfbfe-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "46b6f5ef-ac2f-4add-8c6b-1157abccfbfe" (UID: "46b6f5ef-ac2f-4add-8c6b-1157abccfbfe"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.851908 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46b6f5ef-ac2f-4add-8c6b-1157abccfbfe-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "46b6f5ef-ac2f-4add-8c6b-1157abccfbfe" (UID: "46b6f5ef-ac2f-4add-8c6b-1157abccfbfe"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.885956 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3236580-0d7f-4a04-ae0f-5ae8b073d6b7-kube-api-access-5wssj" (OuterVolumeSpecName: "kube-api-access-5wssj") pod "e3236580-0d7f-4a04-ae0f-5ae8b073d6b7" (UID: "e3236580-0d7f-4a04-ae0f-5ae8b073d6b7"). InnerVolumeSpecName "kube-api-access-5wssj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.888999 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46b6f5ef-ac2f-4add-8c6b-1157abccfbfe-kube-api-access-fb2gk" (OuterVolumeSpecName: "kube-api-access-fb2gk") pod "46b6f5ef-ac2f-4add-8c6b-1157abccfbfe" (UID: "46b6f5ef-ac2f-4add-8c6b-1157abccfbfe"). InnerVolumeSpecName "kube-api-access-fb2gk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.891678 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3236580-0d7f-4a04-ae0f-5ae8b073d6b7-scripts" (OuterVolumeSpecName: "scripts") pod "e3236580-0d7f-4a04-ae0f-5ae8b073d6b7" (UID: "e3236580-0d7f-4a04-ae0f-5ae8b073d6b7"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.898841 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-8t4vn"] Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.939009 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-797c9dbf4-zdnm7" podUID="fb843f09-58b3-467f-8c61-f9cad54c7b55" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.0.236:9311/healthcheck\": read tcp 10.217.0.2:42810->10.217.0.236:9311: read: connection reset by peer" Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.939251 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c1a2ba61-a67d-4937-9979-9f10c744a1a8-combined-ca-bundle\") pod \"c1a2ba61-a67d-4937-9979-9f10c744a1a8\" (UID: \"c1a2ba61-a67d-4937-9979-9f10c744a1a8\") " Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.939383 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sjf7s\" (UniqueName: \"kubernetes.io/projected/c1a2ba61-a67d-4937-9979-9f10c744a1a8-kube-api-access-sjf7s\") pod \"c1a2ba61-a67d-4937-9979-9f10c744a1a8\" (UID: \"c1a2ba61-a67d-4937-9979-9f10c744a1a8\") " Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.939048 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46b6f5ef-ac2f-4add-8c6b-1157abccfbfe-etc-swift" (OuterVolumeSpecName: "etc-swift") pod "46b6f5ef-ac2f-4add-8c6b-1157abccfbfe" (UID: "46b6f5ef-ac2f-4add-8c6b-1157abccfbfe"). InnerVolumeSpecName "etc-swift". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.972514 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/46b6f5ef-ac2f-4add-8c6b-1157abccfbfe-etc-swift\") pod \"46b6f5ef-ac2f-4add-8c6b-1157abccfbfe\" (UID: \"46b6f5ef-ac2f-4add-8c6b-1157abccfbfe\") " Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.972832 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c1a2ba61-a67d-4937-9979-9f10c744a1a8-config-data\") pod \"c1a2ba61-a67d-4937-9979-9f10c744a1a8\" (UID: \"c1a2ba61-a67d-4937-9979-9f10c744a1a8\") " Mar 16 16:37:26 crc kubenswrapper[5120]: W0316 16:37:26.972956 5120 empty_dir.go:511] Warning: Unmount skipped because path does not exist: /var/lib/kubelet/pods/46b6f5ef-ac2f-4add-8c6b-1157abccfbfe/volumes/kubernetes.io~projected/etc-swift Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.973040 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46b6f5ef-ac2f-4add-8c6b-1157abccfbfe-etc-swift" (OuterVolumeSpecName: "etc-swift") pod "46b6f5ef-ac2f-4add-8c6b-1157abccfbfe" (UID: "46b6f5ef-ac2f-4add-8c6b-1157abccfbfe"). InnerVolumeSpecName "etc-swift". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.973822 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5wssj\" (UniqueName: \"kubernetes.io/projected/e3236580-0d7f-4a04-ae0f-5ae8b073d6b7-kube-api-access-5wssj\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.973848 5120 reconciler_common.go:299] "Volume detached for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/46b6f5ef-ac2f-4add-8c6b-1157abccfbfe-etc-swift\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.973861 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/46b6f5ef-ac2f-4add-8c6b-1157abccfbfe-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.973872 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/46b6f5ef-ac2f-4add-8c6b-1157abccfbfe-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.973883 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e3236580-0d7f-4a04-ae0f-5ae8b073d6b7-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.973894 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e3236580-0d7f-4a04-ae0f-5ae8b073d6b7-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:26 crc kubenswrapper[5120]: I0316 16:37:26.973906 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fb2gk\" (UniqueName: \"kubernetes.io/projected/46b6f5ef-ac2f-4add-8c6b-1157abccfbfe-kube-api-access-fb2gk\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.001845 5120 scope.go:117] "RemoveContainer" containerID="4b251df29f9b7181015a5b31f936df9e97b0207ef1ef63d303d6c87589a0f9a4" Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.021227 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1a2ba61-a67d-4937-9979-9f10c744a1a8-kube-api-access-sjf7s" (OuterVolumeSpecName: "kube-api-access-sjf7s") pod "c1a2ba61-a67d-4937-9979-9f10c744a1a8" (UID: "c1a2ba61-a67d-4937-9979-9f10c744a1a8"). InnerVolumeSpecName "kube-api-access-sjf7s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.022240 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-797c9dbf4-zdnm7" podUID="fb843f09-58b3-467f-8c61-f9cad54c7b55" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.0.236:9311/healthcheck\": dial tcp 10.217.0.236:9311: connect: connection refused" Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.081845 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sjf7s\" (UniqueName: \"kubernetes.io/projected/c1a2ba61-a67d-4937-9979-9f10c744a1a8-kube-api-access-sjf7s\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.120429 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c1a2ba61-a67d-4937-9979-9f10c744a1a8-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "c1a2ba61-a67d-4937-9979-9f10c744a1a8" (UID: "c1a2ba61-a67d-4937-9979-9f10c744a1a8"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.195067 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c1a2ba61-a67d-4937-9979-9f10c744a1a8-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.207696 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/46b6f5ef-ac2f-4add-8c6b-1157abccfbfe-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "46b6f5ef-ac2f-4add-8c6b-1157abccfbfe" (UID: "46b6f5ef-ac2f-4add-8c6b-1157abccfbfe"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.268786 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c1a2ba61-a67d-4937-9979-9f10c744a1a8-config-data" (OuterVolumeSpecName: "config-data") pod "c1a2ba61-a67d-4937-9979-9f10c744a1a8" (UID: "c1a2ba61-a67d-4937-9979-9f10c744a1a8"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.324166 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/46b6f5ef-ac2f-4add-8c6b-1157abccfbfe-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.324207 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c1a2ba61-a67d-4937-9979-9f10c744a1a8-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.442122 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3236580-0d7f-4a04-ae0f-5ae8b073d6b7-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e3236580-0d7f-4a04-ae0f-5ae8b073d6b7" (UID: "e3236580-0d7f-4a04-ae0f-5ae8b073d6b7"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.447282 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e3236580-0d7f-4a04-ae0f-5ae8b073d6b7-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:27 crc kubenswrapper[5120]: E0316 16:37:27.447484 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-memcached-svc: secret "cert-memcached-svc" not found Mar 16 16:37:27 crc kubenswrapper[5120]: E0316 16:37:27.447581 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cc5c2d3-3da0-4d0c-9541-78f0bf375648-memcached-tls-certs podName:2cc5c2d3-3da0-4d0c-9541-78f0bf375648 nodeName:}" failed. No retries permitted until 2026-03-16 16:37:28.447563495 +0000 UTC m=+3950.601495152 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "memcached-tls-certs" (UniqueName: "kubernetes.io/secret/2cc5c2d3-3da0-4d0c-9541-78f0bf375648-memcached-tls-certs") pod "memcached-0" (UID: "2cc5c2d3-3da0-4d0c-9541-78f0bf375648") : secret "cert-memcached-svc" not found Mar 16 16:37:27 crc kubenswrapper[5120]: E0316 16:37:27.447666 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 16:37:27 crc kubenswrapper[5120]: E0316 16:37:27.447693 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cc5c2d3-3da0-4d0c-9541-78f0bf375648-combined-ca-bundle podName:2cc5c2d3-3da0-4d0c-9541-78f0bf375648 nodeName:}" failed. No retries permitted until 2026-03-16 16:37:28.447685598 +0000 UTC m=+3950.601617255 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/2cc5c2d3-3da0-4d0c-9541-78f0bf375648-combined-ca-bundle") pod "memcached-0" (UID: "2cc5c2d3-3da0-4d0c-9541-78f0bf375648") : secret "combined-ca-bundle" not found Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.467446 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/46b6f5ef-ac2f-4add-8c6b-1157abccfbfe-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "46b6f5ef-ac2f-4add-8c6b-1157abccfbfe" (UID: "46b6f5ef-ac2f-4add-8c6b-1157abccfbfe"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.469902 5120 generic.go:358] "Generic (PLEG): container finished" podID="2fbd9119-d73e-4c1e-99b9-8f078e2acdfb" containerID="41f454bf946ac8b5e6eb01d2b76a6ba9b4a70c8ff253b18b28f9a9d124862394" exitCode=0 Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.470047 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"2fbd9119-d73e-4c1e-99b9-8f078e2acdfb","Type":"ContainerDied","Data":"41f454bf946ac8b5e6eb01d2b76a6ba9b4a70c8ff253b18b28f9a9d124862394"} Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.475817 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.516906 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/46b6f5ef-ac2f-4add-8c6b-1157abccfbfe-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "46b6f5ef-ac2f-4add-8c6b-1157abccfbfe" (UID: "46b6f5ef-ac2f-4add-8c6b-1157abccfbfe"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.517571 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"613be4ed-d055-4f50-a323-8b13e5c5fe1a","Type":"ContainerDied","Data":"01709478ab809cf613f8984467be91e2c416eb70a553ec8b0166a39bf5ce8c52"} Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.517679 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.553312 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.559063 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"c1a2ba61-a67d-4937-9979-9f10c744a1a8","Type":"ContainerDied","Data":"b48e11f045227897d970f4750b2d8284cad910604b6b473513b7d08c7b57f424"} Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.559122 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-e1fd-account-create-update-bp9s5"] Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.566908 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/46b6f5ef-ac2f-4add-8c6b-1157abccfbfe-config-data" (OuterVolumeSpecName: "config-data") pod "46b6f5ef-ac2f-4add-8c6b-1157abccfbfe" (UID: "46b6f5ef-ac2f-4add-8c6b-1157abccfbfe"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.575432 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/46b6f5ef-ac2f-4add-8c6b-1157abccfbfe-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.575468 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/46b6f5ef-ac2f-4add-8c6b-1157abccfbfe-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.575479 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/46b6f5ef-ac2f-4add-8c6b-1157abccfbfe-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.576063 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-e1fd-account-create-update-bp9s5"] Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.582228 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.586468 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-e1fd-account-create-update-nmc4b"] Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.588103 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46b6f5ef-ac2f-4add-8c6b-1157abccfbfe" containerName="proxy-server" Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.588151 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="46b6f5ef-ac2f-4add-8c6b-1157abccfbfe" containerName="proxy-server" Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.588210 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46b6f5ef-ac2f-4add-8c6b-1157abccfbfe" containerName="proxy-httpd" Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.588221 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="46b6f5ef-ac2f-4add-8c6b-1157abccfbfe" containerName="proxy-httpd" Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.588240 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3236580-0d7f-4a04-ae0f-5ae8b073d6b7" containerName="placement-api" Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.588249 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3236580-0d7f-4a04-ae0f-5ae8b073d6b7" containerName="placement-api" Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.588268 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3236580-0d7f-4a04-ae0f-5ae8b073d6b7" containerName="placement-log" Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.588275 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3236580-0d7f-4a04-ae0f-5ae8b073d6b7" containerName="placement-log" Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.588291 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="613be4ed-d055-4f50-a323-8b13e5c5fe1a" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.588331 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="613be4ed-d055-4f50-a323-8b13e5c5fe1a" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.588345 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1a2ba61-a67d-4937-9979-9f10c744a1a8" containerName="nova-scheduler-scheduler" Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.588354 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1a2ba61-a67d-4937-9979-9f10c744a1a8" containerName="nova-scheduler-scheduler" Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.588392 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c50d5a6-1160-4c1d-a0ee-6dff4d5e6b87" containerName="kube-state-metrics" Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.588399 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c50d5a6-1160-4c1d-a0ee-6dff4d5e6b87" containerName="kube-state-metrics" Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.588420 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fbd9119-d73e-4c1e-99b9-8f078e2acdfb" containerName="cinder-api" Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.588427 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fbd9119-d73e-4c1e-99b9-8f078e2acdfb" containerName="cinder-api" Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.588475 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fbd9119-d73e-4c1e-99b9-8f078e2acdfb" containerName="cinder-api-log" Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.588483 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fbd9119-d73e-4c1e-99b9-8f078e2acdfb" containerName="cinder-api-log" Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.588698 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="613be4ed-d055-4f50-a323-8b13e5c5fe1a" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.588718 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="2fbd9119-d73e-4c1e-99b9-8f078e2acdfb" containerName="cinder-api-log" Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.588735 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e3236580-0d7f-4a04-ae0f-5ae8b073d6b7" containerName="placement-api" Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.588743 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="2fbd9119-d73e-4c1e-99b9-8f078e2acdfb" containerName="cinder-api" Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.588755 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="2c50d5a6-1160-4c1d-a0ee-6dff4d5e6b87" containerName="kube-state-metrics" Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.588783 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c1a2ba61-a67d-4937-9979-9f10c744a1a8" containerName="nova-scheduler-scheduler" Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.588793 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="46b6f5ef-ac2f-4add-8c6b-1157abccfbfe" containerName="proxy-httpd" Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.588805 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e3236580-0d7f-4a04-ae0f-5ae8b073d6b7" containerName="placement-log" Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.588816 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="46b6f5ef-ac2f-4add-8c6b-1157abccfbfe" containerName="proxy-server" Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.594919 5120 scope.go:117] "RemoveContainer" containerID="c913385caec36960e81c6124367c10c09682f69742dea3477af9e50a7bfb90e7" Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.613544 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-8t4vn" event={"ID":"e06e57b2-920d-463e-8607-2c1365c8c2e5","Type":"ContainerStarted","Data":"b8d289ad22cc2ddc35243ef0fb1f34084ea1cbfc17ca11393a6be88a50a8b736"} Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.615253 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-e1fd-account-create-update-nmc4b" Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.619874 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-db-secret\"" Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.641399 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-598db64bc5-jp86s" event={"ID":"46b6f5ef-ac2f-4add-8c6b-1157abccfbfe","Type":"ContainerDied","Data":"2cb1e8ce355f34e54850aadb2fc6be3bf01ec242c62e643f18e7610b869ff57a"} Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.641572 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-598db64bc5-jp86s" Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.655208 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3236580-0d7f-4a04-ae0f-5ae8b073d6b7-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "e3236580-0d7f-4a04-ae0f-5ae8b073d6b7" (UID: "e3236580-0d7f-4a04-ae0f-5ae8b073d6b7"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.655600 5120 generic.go:358] "Generic (PLEG): container finished" podID="be8b10ce-e42f-4650-bc2f-96fe51dc224c" containerID="7e7209b2abecef7c5b6b8a3d982cdcbbdf7eef3a5a6dd06c0ebe7c5bba967530" exitCode=0 Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.656055 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"be8b10ce-e42f-4650-bc2f-96fe51dc224c","Type":"ContainerDied","Data":"7e7209b2abecef7c5b6b8a3d982cdcbbdf7eef3a5a6dd06c0ebe7c5bba967530"} Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.656727 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-db-create-55rq8"] Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.670444 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-e1fd-account-create-update-nmc4b"] Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.677233 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2fbd9119-d73e-4c1e-99b9-8f078e2acdfb-combined-ca-bundle\") pod \"2fbd9119-d73e-4c1e-99b9-8f078e2acdfb\" (UID: \"2fbd9119-d73e-4c1e-99b9-8f078e2acdfb\") " Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.677307 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/2fbd9119-d73e-4c1e-99b9-8f078e2acdfb-config-data-custom\") pod \"2fbd9119-d73e-4c1e-99b9-8f078e2acdfb\" (UID: \"2fbd9119-d73e-4c1e-99b9-8f078e2acdfb\") " Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.677369 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r7zz5\" (UniqueName: \"kubernetes.io/projected/2fbd9119-d73e-4c1e-99b9-8f078e2acdfb-kube-api-access-r7zz5\") pod \"2fbd9119-d73e-4c1e-99b9-8f078e2acdfb\" (UID: \"2fbd9119-d73e-4c1e-99b9-8f078e2acdfb\") " Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.677405 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2fbd9119-d73e-4c1e-99b9-8f078e2acdfb-logs\") pod \"2fbd9119-d73e-4c1e-99b9-8f078e2acdfb\" (UID: \"2fbd9119-d73e-4c1e-99b9-8f078e2acdfb\") " Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.677469 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2fbd9119-d73e-4c1e-99b9-8f078e2acdfb-scripts\") pod \"2fbd9119-d73e-4c1e-99b9-8f078e2acdfb\" (UID: \"2fbd9119-d73e-4c1e-99b9-8f078e2acdfb\") " Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.677584 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/2fbd9119-d73e-4c1e-99b9-8f078e2acdfb-internal-tls-certs\") pod \"2fbd9119-d73e-4c1e-99b9-8f078e2acdfb\" (UID: \"2fbd9119-d73e-4c1e-99b9-8f078e2acdfb\") " Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.677818 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/2fbd9119-d73e-4c1e-99b9-8f078e2acdfb-etc-machine-id\") pod \"2fbd9119-d73e-4c1e-99b9-8f078e2acdfb\" (UID: \"2fbd9119-d73e-4c1e-99b9-8f078e2acdfb\") " Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.677924 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/2fbd9119-d73e-4c1e-99b9-8f078e2acdfb-public-tls-certs\") pod \"2fbd9119-d73e-4c1e-99b9-8f078e2acdfb\" (UID: \"2fbd9119-d73e-4c1e-99b9-8f078e2acdfb\") " Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.677962 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2fbd9119-d73e-4c1e-99b9-8f078e2acdfb-config-data\") pod \"2fbd9119-d73e-4c1e-99b9-8f078e2acdfb\" (UID: \"2fbd9119-d73e-4c1e-99b9-8f078e2acdfb\") " Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.678538 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2fbd9119-d73e-4c1e-99b9-8f078e2acdfb-logs" (OuterVolumeSpecName: "logs") pod "2fbd9119-d73e-4c1e-99b9-8f078e2acdfb" (UID: "2fbd9119-d73e-4c1e-99b9-8f078e2acdfb"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.678556 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tr5m\" (UniqueName: \"kubernetes.io/projected/96ed605f-5db1-41a5-a646-7b8ad1150a29-kube-api-access-8tr5m\") pod \"keystone-e1fd-account-create-update-nmc4b\" (UID: \"96ed605f-5db1-41a5-a646-7b8ad1150a29\") " pod="openstack-kuttl-tests/keystone-e1fd-account-create-update-nmc4b" Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.679188 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/96ed605f-5db1-41a5-a646-7b8ad1150a29-operator-scripts\") pod \"keystone-e1fd-account-create-update-nmc4b\" (UID: \"96ed605f-5db1-41a5-a646-7b8ad1150a29\") " pod="openstack-kuttl-tests/keystone-e1fd-account-create-update-nmc4b" Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.679480 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e3236580-0d7f-4a04-ae0f-5ae8b073d6b7-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.679500 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2fbd9119-d73e-4c1e-99b9-8f078e2acdfb-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.682209 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/2fbd9119-d73e-4c1e-99b9-8f078e2acdfb-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "2fbd9119-d73e-4c1e-99b9-8f078e2acdfb" (UID: "2fbd9119-d73e-4c1e-99b9-8f078e2acdfb"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.688475 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-db-create-55rq8"] Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.695065 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2fbd9119-d73e-4c1e-99b9-8f078e2acdfb-scripts" (OuterVolumeSpecName: "scripts") pod "2fbd9119-d73e-4c1e-99b9-8f078e2acdfb" (UID: "2fbd9119-d73e-4c1e-99b9-8f078e2acdfb"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.701319 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2fbd9119-d73e-4c1e-99b9-8f078e2acdfb-kube-api-access-r7zz5" (OuterVolumeSpecName: "kube-api-access-r7zz5") pod "2fbd9119-d73e-4c1e-99b9-8f078e2acdfb" (UID: "2fbd9119-d73e-4c1e-99b9-8f078e2acdfb"). InnerVolumeSpecName "kube-api-access-r7zz5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.701347 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-xn726"] Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.725328 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2fbd9119-d73e-4c1e-99b9-8f078e2acdfb-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "2fbd9119-d73e-4c1e-99b9-8f078e2acdfb" (UID: "2fbd9119-d73e-4c1e-99b9-8f078e2acdfb"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.727078 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3236580-0d7f-4a04-ae0f-5ae8b073d6b7-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "e3236580-0d7f-4a04-ae0f-5ae8b073d6b7" (UID: "e3236580-0d7f-4a04-ae0f-5ae8b073d6b7"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.736930 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2fbd9119-d73e-4c1e-99b9-8f078e2acdfb-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "2fbd9119-d73e-4c1e-99b9-8f078e2acdfb" (UID: "2fbd9119-d73e-4c1e-99b9-8f078e2acdfb"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.760921 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.767924 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3236580-0d7f-4a04-ae0f-5ae8b073d6b7-config-data" (OuterVolumeSpecName: "config-data") pod "e3236580-0d7f-4a04-ae0f-5ae8b073d6b7" (UID: "e3236580-0d7f-4a04-ae0f-5ae8b073d6b7"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.785088 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2fbd9119-d73e-4c1e-99b9-8f078e2acdfb-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "2fbd9119-d73e-4c1e-99b9-8f078e2acdfb" (UID: "2fbd9119-d73e-4c1e-99b9-8f078e2acdfb"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.826748 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-xn726"] Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.829252 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-747d4cf944-dk26n" event={"ID":"e3236580-0d7f-4a04-ae0f-5ae8b073d6b7","Type":"ContainerDied","Data":"1a33c6dce57e7ba0f923f41c17efb3a78e850d6115bcee7aabcd8c1479ddb417"} Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.829303 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-747d4cf944-dk26n" Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.846185 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/96ed605f-5db1-41a5-a646-7b8ad1150a29-operator-scripts\") pod \"keystone-e1fd-account-create-update-nmc4b\" (UID: \"96ed605f-5db1-41a5-a646-7b8ad1150a29\") " pod="openstack-kuttl-tests/keystone-e1fd-account-create-update-nmc4b" Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.846704 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8tr5m\" (UniqueName: \"kubernetes.io/projected/96ed605f-5db1-41a5-a646-7b8ad1150a29-kube-api-access-8tr5m\") pod \"keystone-e1fd-account-create-update-nmc4b\" (UID: \"96ed605f-5db1-41a5-a646-7b8ad1150a29\") " pod="openstack-kuttl-tests/keystone-e1fd-account-create-update-nmc4b" Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.847132 5120 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/2fbd9119-d73e-4c1e-99b9-8f078e2acdfb-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.847168 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/2fbd9119-d73e-4c1e-99b9-8f078e2acdfb-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.847184 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e3236580-0d7f-4a04-ae0f-5ae8b073d6b7-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.847196 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2fbd9119-d73e-4c1e-99b9-8f078e2acdfb-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.847207 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/2fbd9119-d73e-4c1e-99b9-8f078e2acdfb-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.847220 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r7zz5\" (UniqueName: \"kubernetes.io/projected/2fbd9119-d73e-4c1e-99b9-8f078e2acdfb-kube-api-access-r7zz5\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.847235 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2fbd9119-d73e-4c1e-99b9-8f078e2acdfb-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.847248 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e3236580-0d7f-4a04-ae0f-5ae8b073d6b7-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:27 crc kubenswrapper[5120]: E0316 16:37:27.848545 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Mar 16 16:37:27 crc kubenswrapper[5120]: E0316 16:37:27.848616 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/96ed605f-5db1-41a5-a646-7b8ad1150a29-operator-scripts podName:96ed605f-5db1-41a5-a646-7b8ad1150a29 nodeName:}" failed. No retries permitted until 2026-03-16 16:37:28.348596508 +0000 UTC m=+3950.502528175 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/96ed605f-5db1-41a5-a646-7b8ad1150a29-operator-scripts") pod "keystone-e1fd-account-create-update-nmc4b" (UID: "96ed605f-5db1-41a5-a646-7b8ad1150a29") : configmap "openstack-scripts" not found Mar 16 16:37:27 crc kubenswrapper[5120]: E0316 16:37:27.856480 5120 projected.go:194] Error preparing data for projected volume kube-api-access-8tr5m for pod openstack-kuttl-tests/keystone-e1fd-account-create-update-nmc4b: failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 16:37:27 crc kubenswrapper[5120]: E0316 16:37:27.856592 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/96ed605f-5db1-41a5-a646-7b8ad1150a29-kube-api-access-8tr5m podName:96ed605f-5db1-41a5-a646-7b8ad1150a29 nodeName:}" failed. No retries permitted until 2026-03-16 16:37:28.356568896 +0000 UTC m=+3950.510500553 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-8tr5m" (UniqueName: "kubernetes.io/projected/96ed605f-5db1-41a5-a646-7b8ad1150a29-kube-api-access-8tr5m") pod "keystone-e1fd-account-create-update-nmc4b" (UID: "96ed605f-5db1-41a5-a646-7b8ad1150a29") : failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.859371 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.883179 5120 scope.go:117] "RemoveContainer" containerID="277a25664e86689ff38b712666321a5332eeca8fcc6856cf5361da4664ea4317" Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.892914 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-vqvr9"] Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.911842 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-vqvr9"] Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.916060 5120 generic.go:358] "Generic (PLEG): container finished" podID="06e4bc0a-e757-40b7-8ed8-693dd20c185a" containerID="4d07b305ba120824ff17a907693b1904828557196542b5e99cb497424819b28d" exitCode=0 Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.916270 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"06e4bc0a-e757-40b7-8ed8-693dd20c185a","Type":"ContainerDied","Data":"4d07b305ba120824ff17a907693b1904828557196542b5e99cb497424819b28d"} Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.918816 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2fbd9119-d73e-4c1e-99b9-8f078e2acdfb-config-data" (OuterVolumeSpecName: "config-data") pod "2fbd9119-d73e-4c1e-99b9-8f078e2acdfb" (UID: "2fbd9119-d73e-4c1e-99b9-8f078e2acdfb"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.926919 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2fbd9119-d73e-4c1e-99b9-8f078e2acdfb-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "2fbd9119-d73e-4c1e-99b9-8f078e2acdfb" (UID: "2fbd9119-d73e-4c1e-99b9-8f078e2acdfb"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.927261 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-5zz68" event={"ID":"70f75c98-8188-4143-a468-6f83825ca23c","Type":"ContainerDied","Data":"cda6fdc0c8e92c0232a4e61ded28d3be195470c0465d8b461203232539ad091f"} Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.927375 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-5zz68" Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.934531 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-5769b4cdff-x2jfw"] Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.934849 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/keystone-5769b4cdff-x2jfw" podUID="864a1551-0ebe-4575-afc8-964686953825" containerName="keystone-api" containerID="cri-o://ec7b51b54a8b71d545b522da56c31ac094ce43134f2779b01ffbc26bcfb07d05" gracePeriod=30 Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.951461 5120 generic.go:358] "Generic (PLEG): container finished" podID="fb843f09-58b3-467f-8c61-f9cad54c7b55" containerID="44e7b6079cc86a3539158acba20d48d6ecfc28308601a631870b3eea6c5a0e3d" exitCode=0 Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.951648 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.952057 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/06e4bc0a-e757-40b7-8ed8-693dd20c185a-logs\") pod \"06e4bc0a-e757-40b7-8ed8-693dd20c185a\" (UID: \"06e4bc0a-e757-40b7-8ed8-693dd20c185a\") " Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.952101 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/06e4bc0a-e757-40b7-8ed8-693dd20c185a-public-tls-certs\") pod \"06e4bc0a-e757-40b7-8ed8-693dd20c185a\" (UID: \"06e4bc0a-e757-40b7-8ed8-693dd20c185a\") " Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.952180 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/be8b10ce-e42f-4650-bc2f-96fe51dc224c-httpd-run\") pod \"be8b10ce-e42f-4650-bc2f-96fe51dc224c\" (UID: \"be8b10ce-e42f-4650-bc2f-96fe51dc224c\") " Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.952210 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/06e4bc0a-e757-40b7-8ed8-693dd20c185a-combined-ca-bundle\") pod \"06e4bc0a-e757-40b7-8ed8-693dd20c185a\" (UID: \"06e4bc0a-e757-40b7-8ed8-693dd20c185a\") " Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.952235 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-797c9dbf4-zdnm7" event={"ID":"fb843f09-58b3-467f-8c61-f9cad54c7b55","Type":"ContainerDied","Data":"44e7b6079cc86a3539158acba20d48d6ecfc28308601a631870b3eea6c5a0e3d"} Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.952300 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/06e4bc0a-e757-40b7-8ed8-693dd20c185a-scripts\") pod \"06e4bc0a-e757-40b7-8ed8-693dd20c185a\" (UID: \"06e4bc0a-e757-40b7-8ed8-693dd20c185a\") " Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.952353 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/be8b10ce-e42f-4650-bc2f-96fe51dc224c-logs\") pod \"be8b10ce-e42f-4650-bc2f-96fe51dc224c\" (UID: \"be8b10ce-e42f-4650-bc2f-96fe51dc224c\") " Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.952407 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/memcached-0" podUID="2cc5c2d3-3da0-4d0c-9541-78f0bf375648" containerName="memcached" containerID="cri-o://6d1704088789e653abcbf79fddac9aafb1b85dd5351eeff9d35a0a4e7c2f3a76" gracePeriod=30 Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.952468 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/be8b10ce-e42f-4650-bc2f-96fe51dc224c-internal-tls-certs\") pod \"be8b10ce-e42f-4650-bc2f-96fe51dc224c\" (UID: \"be8b10ce-e42f-4650-bc2f-96fe51dc224c\") " Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.952650 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/06e4bc0a-e757-40b7-8ed8-693dd20c185a-config-data\") pod \"06e4bc0a-e757-40b7-8ed8-693dd20c185a\" (UID: \"06e4bc0a-e757-40b7-8ed8-693dd20c185a\") " Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.952728 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") pod \"be8b10ce-e42f-4650-bc2f-96fe51dc224c\" (UID: \"be8b10ce-e42f-4650-bc2f-96fe51dc224c\") " Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.952782 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n6jvt\" (UniqueName: \"kubernetes.io/projected/06e4bc0a-e757-40b7-8ed8-693dd20c185a-kube-api-access-n6jvt\") pod \"06e4bc0a-e757-40b7-8ed8-693dd20c185a\" (UID: \"06e4bc0a-e757-40b7-8ed8-693dd20c185a\") " Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.952811 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/be8b10ce-e42f-4650-bc2f-96fe51dc224c-combined-ca-bundle\") pod \"be8b10ce-e42f-4650-bc2f-96fe51dc224c\" (UID: \"be8b10ce-e42f-4650-bc2f-96fe51dc224c\") " Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.952867 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/be8b10ce-e42f-4650-bc2f-96fe51dc224c-config-data\") pod \"be8b10ce-e42f-4650-bc2f-96fe51dc224c\" (UID: \"be8b10ce-e42f-4650-bc2f-96fe51dc224c\") " Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.952943 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/06e4bc0a-e757-40b7-8ed8-693dd20c185a-httpd-run\") pod \"06e4bc0a-e757-40b7-8ed8-693dd20c185a\" (UID: \"06e4bc0a-e757-40b7-8ed8-693dd20c185a\") " Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.952987 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/be8b10ce-e42f-4650-bc2f-96fe51dc224c-scripts\") pod \"be8b10ce-e42f-4650-bc2f-96fe51dc224c\" (UID: \"be8b10ce-e42f-4650-bc2f-96fe51dc224c\") " Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.953039 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6lw29\" (UniqueName: \"kubernetes.io/projected/be8b10ce-e42f-4650-bc2f-96fe51dc224c-kube-api-access-6lw29\") pod \"be8b10ce-e42f-4650-bc2f-96fe51dc224c\" (UID: \"be8b10ce-e42f-4650-bc2f-96fe51dc224c\") " Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.953130 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"06e4bc0a-e757-40b7-8ed8-693dd20c185a\" (UID: \"06e4bc0a-e757-40b7-8ed8-693dd20c185a\") " Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.953920 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/2fbd9119-d73e-4c1e-99b9-8f078e2acdfb-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.953940 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2fbd9119-d73e-4c1e-99b9-8f078e2acdfb-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.957383 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be8b10ce-e42f-4650-bc2f-96fe51dc224c-logs" (OuterVolumeSpecName: "logs") pod "be8b10ce-e42f-4650-bc2f-96fe51dc224c" (UID: "be8b10ce-e42f-4650-bc2f-96fe51dc224c"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.961194 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06e4bc0a-e757-40b7-8ed8-693dd20c185a-logs" (OuterVolumeSpecName: "logs") pod "06e4bc0a-e757-40b7-8ed8-693dd20c185a" (UID: "06e4bc0a-e757-40b7-8ed8-693dd20c185a"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.962428 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage19-crc" (OuterVolumeSpecName: "glance") pod "be8b10ce-e42f-4650-bc2f-96fe51dc224c" (UID: "be8b10ce-e42f-4650-bc2f-96fe51dc224c"). InnerVolumeSpecName "local-storage19-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.963545 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06e4bc0a-e757-40b7-8ed8-693dd20c185a-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "06e4bc0a-e757-40b7-8ed8-693dd20c185a" (UID: "06e4bc0a-e757-40b7-8ed8-693dd20c185a"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.963935 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be8b10ce-e42f-4650-bc2f-96fe51dc224c-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "be8b10ce-e42f-4650-bc2f-96fe51dc224c" (UID: "be8b10ce-e42f-4650-bc2f-96fe51dc224c"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.967132 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06e4bc0a-e757-40b7-8ed8-693dd20c185a-kube-api-access-n6jvt" (OuterVolumeSpecName: "kube-api-access-n6jvt") pod "06e4bc0a-e757-40b7-8ed8-693dd20c185a" (UID: "06e4bc0a-e757-40b7-8ed8-693dd20c185a"). InnerVolumeSpecName "kube-api-access-n6jvt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.967230 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-db-create-xfd9w"] Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.967629 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage01-crc" (OuterVolumeSpecName: "glance") pod "06e4bc0a-e757-40b7-8ed8-693dd20c185a" (UID: "06e4bc0a-e757-40b7-8ed8-693dd20c185a"). InnerVolumeSpecName "local-storage01-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.968200 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be8b10ce-e42f-4650-bc2f-96fe51dc224c-kube-api-access-6lw29" (OuterVolumeSpecName: "kube-api-access-6lw29") pod "be8b10ce-e42f-4650-bc2f-96fe51dc224c" (UID: "be8b10ce-e42f-4650-bc2f-96fe51dc224c"). InnerVolumeSpecName "kube-api-access-6lw29". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.972157 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/be8b10ce-e42f-4650-bc2f-96fe51dc224c-scripts" (OuterVolumeSpecName: "scripts") pod "be8b10ce-e42f-4650-bc2f-96fe51dc224c" (UID: "be8b10ce-e42f-4650-bc2f-96fe51dc224c"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.974526 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06e4bc0a-e757-40b7-8ed8-693dd20c185a-scripts" (OuterVolumeSpecName: "scripts") pod "06e4bc0a-e757-40b7-8ed8-693dd20c185a" (UID: "06e4bc0a-e757-40b7-8ed8-693dd20c185a"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.979022 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be8b10ce-e42f-4650-bc2f-96fe51dc224c" containerName="glance-httpd" Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.979057 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="be8b10ce-e42f-4650-bc2f-96fe51dc224c" containerName="glance-httpd" Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.979083 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be8b10ce-e42f-4650-bc2f-96fe51dc224c" containerName="glance-log" Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.979090 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="be8b10ce-e42f-4650-bc2f-96fe51dc224c" containerName="glance-log" Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.979099 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06e4bc0a-e757-40b7-8ed8-693dd20c185a" containerName="glance-httpd" Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.979104 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="06e4bc0a-e757-40b7-8ed8-693dd20c185a" containerName="glance-httpd" Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.979131 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06e4bc0a-e757-40b7-8ed8-693dd20c185a" containerName="glance-log" Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.979136 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="06e4bc0a-e757-40b7-8ed8-693dd20c185a" containerName="glance-log" Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.979295 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="06e4bc0a-e757-40b7-8ed8-693dd20c185a" containerName="glance-log" Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.979305 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="be8b10ce-e42f-4650-bc2f-96fe51dc224c" containerName="glance-httpd" Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.979314 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="06e4bc0a-e757-40b7-8ed8-693dd20c185a" containerName="glance-httpd" Mar 16 16:37:27 crc kubenswrapper[5120]: I0316 16:37:27.979328 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="be8b10ce-e42f-4650-bc2f-96fe51dc224c" containerName="glance-log" Mar 16 16:37:28 crc kubenswrapper[5120]: I0316 16:37:28.006128 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-create-xfd9w" Mar 16 16:37:28 crc kubenswrapper[5120]: I0316 16:37:28.027344 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/be8b10ce-e42f-4650-bc2f-96fe51dc224c-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "be8b10ce-e42f-4650-bc2f-96fe51dc224c" (UID: "be8b10ce-e42f-4650-bc2f-96fe51dc224c"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:28 crc kubenswrapper[5120]: I0316 16:37:28.037689 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-db-create-xfd9w"] Mar 16 16:37:28 crc kubenswrapper[5120]: I0316 16:37:28.059209 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage19-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") on node \"crc\" " Mar 16 16:37:28 crc kubenswrapper[5120]: I0316 16:37:28.059261 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n6jvt\" (UniqueName: \"kubernetes.io/projected/06e4bc0a-e757-40b7-8ed8-693dd20c185a-kube-api-access-n6jvt\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:28 crc kubenswrapper[5120]: I0316 16:37:28.059276 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/be8b10ce-e42f-4650-bc2f-96fe51dc224c-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:28 crc kubenswrapper[5120]: I0316 16:37:28.059289 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/06e4bc0a-e757-40b7-8ed8-693dd20c185a-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:28 crc kubenswrapper[5120]: I0316 16:37:28.059300 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/be8b10ce-e42f-4650-bc2f-96fe51dc224c-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:28 crc kubenswrapper[5120]: I0316 16:37:28.059312 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6lw29\" (UniqueName: \"kubernetes.io/projected/be8b10ce-e42f-4650-bc2f-96fe51dc224c-kube-api-access-6lw29\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:28 crc kubenswrapper[5120]: I0316 16:37:28.059331 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") on node \"crc\" " Mar 16 16:37:28 crc kubenswrapper[5120]: I0316 16:37:28.059342 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/06e4bc0a-e757-40b7-8ed8-693dd20c185a-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:28 crc kubenswrapper[5120]: I0316 16:37:28.059354 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/be8b10ce-e42f-4650-bc2f-96fe51dc224c-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:28 crc kubenswrapper[5120]: I0316 16:37:28.059365 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/06e4bc0a-e757-40b7-8ed8-693dd20c185a-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:28 crc kubenswrapper[5120]: I0316 16:37:28.059383 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/be8b10ce-e42f-4650-bc2f-96fe51dc224c-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:28 crc kubenswrapper[5120]: I0316 16:37:28.060063 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06e4bc0a-e757-40b7-8ed8-693dd20c185a-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "06e4bc0a-e757-40b7-8ed8-693dd20c185a" (UID: "06e4bc0a-e757-40b7-8ed8-693dd20c185a"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:28 crc kubenswrapper[5120]: I0316 16:37:28.062177 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/be8b10ce-e42f-4650-bc2f-96fe51dc224c-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "be8b10ce-e42f-4650-bc2f-96fe51dc224c" (UID: "be8b10ce-e42f-4650-bc2f-96fe51dc224c"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:28 crc kubenswrapper[5120]: I0316 16:37:28.067565 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 16:37:28 crc kubenswrapper[5120]: I0316 16:37:28.067687 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06e4bc0a-e757-40b7-8ed8-693dd20c185a-config-data" (OuterVolumeSpecName: "config-data") pod "06e4bc0a-e757-40b7-8ed8-693dd20c185a" (UID: "06e4bc0a-e757-40b7-8ed8-693dd20c185a"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:28 crc kubenswrapper[5120]: I0316 16:37:28.097876 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage01-crc" (UniqueName: "kubernetes.io/local-volume/local-storage01-crc") on node "crc" Mar 16 16:37:28 crc kubenswrapper[5120]: I0316 16:37:28.104309 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/be8b10ce-e42f-4650-bc2f-96fe51dc224c-config-data" (OuterVolumeSpecName: "config-data") pod "be8b10ce-e42f-4650-bc2f-96fe51dc224c" (UID: "be8b10ce-e42f-4650-bc2f-96fe51dc224c"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:28 crc kubenswrapper[5120]: I0316 16:37:28.123486 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-e1fd-account-create-update-nmc4b"] Mar 16 16:37:28 crc kubenswrapper[5120]: E0316 16:37:28.124208 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-8tr5m operator-scripts], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openstack-kuttl-tests/keystone-e1fd-account-create-update-nmc4b" podUID="96ed605f-5db1-41a5-a646-7b8ad1150a29" Mar 16 16:37:28 crc kubenswrapper[5120]: I0316 16:37:28.130831 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage19-crc" (UniqueName: "kubernetes.io/local-volume/local-storage19-crc") on node "crc" Mar 16 16:37:28 crc kubenswrapper[5120]: I0316 16:37:28.161968 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46bx8\" (UniqueName: \"kubernetes.io/projected/0742a9c5-1c31-4847-83c8-4951106a326c-kube-api-access-46bx8\") pod \"keystone-db-create-xfd9w\" (UID: \"0742a9c5-1c31-4847-83c8-4951106a326c\") " pod="openstack-kuttl-tests/keystone-db-create-xfd9w" Mar 16 16:37:28 crc kubenswrapper[5120]: I0316 16:37:28.162209 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0742a9c5-1c31-4847-83c8-4951106a326c-operator-scripts\") pod \"keystone-db-create-xfd9w\" (UID: \"0742a9c5-1c31-4847-83c8-4951106a326c\") " pod="openstack-kuttl-tests/keystone-db-create-xfd9w" Mar 16 16:37:28 crc kubenswrapper[5120]: I0316 16:37:28.162327 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage19-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:28 crc kubenswrapper[5120]: I0316 16:37:28.162347 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/be8b10ce-e42f-4650-bc2f-96fe51dc224c-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:28 crc kubenswrapper[5120]: I0316 16:37:28.162359 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:28 crc kubenswrapper[5120]: I0316 16:37:28.162370 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/06e4bc0a-e757-40b7-8ed8-693dd20c185a-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:28 crc kubenswrapper[5120]: I0316 16:37:28.162384 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/be8b10ce-e42f-4650-bc2f-96fe51dc224c-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:28 crc kubenswrapper[5120]: I0316 16:37:28.162395 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/06e4bc0a-e757-40b7-8ed8-693dd20c185a-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:28 crc kubenswrapper[5120]: I0316 16:37:28.171244 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-db-create-xfd9w"] Mar 16 16:37:28 crc kubenswrapper[5120]: I0316 16:37:28.204937 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06e4bc0a-e757-40b7-8ed8-693dd20c185a-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "06e4bc0a-e757-40b7-8ed8-693dd20c185a" (UID: "06e4bc0a-e757-40b7-8ed8-693dd20c185a"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:28 crc kubenswrapper[5120]: I0316 16:37:28.207824 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:37:28 crc kubenswrapper[5120]: I0316 16:37:28.226815 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:37:28 crc kubenswrapper[5120]: I0316 16:37:28.256520 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-5f8nh"] Mar 16 16:37:28 crc kubenswrapper[5120]: I0316 16:37:28.276145 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0742a9c5-1c31-4847-83c8-4951106a326c-operator-scripts\") pod \"keystone-db-create-xfd9w\" (UID: \"0742a9c5-1c31-4847-83c8-4951106a326c\") " pod="openstack-kuttl-tests/keystone-db-create-xfd9w" Mar 16 16:37:28 crc kubenswrapper[5120]: E0316 16:37:28.276335 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Mar 16 16:37:28 crc kubenswrapper[5120]: E0316 16:37:28.276404 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0742a9c5-1c31-4847-83c8-4951106a326c-operator-scripts podName:0742a9c5-1c31-4847-83c8-4951106a326c nodeName:}" failed. No retries permitted until 2026-03-16 16:37:28.776386261 +0000 UTC m=+3950.930317918 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/0742a9c5-1c31-4847-83c8-4951106a326c-operator-scripts") pod "keystone-db-create-xfd9w" (UID: "0742a9c5-1c31-4847-83c8-4951106a326c") : configmap "openstack-scripts" not found Mar 16 16:37:28 crc kubenswrapper[5120]: I0316 16:37:28.276578 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-46bx8\" (UniqueName: \"kubernetes.io/projected/0742a9c5-1c31-4847-83c8-4951106a326c-kube-api-access-46bx8\") pod \"keystone-db-create-xfd9w\" (UID: \"0742a9c5-1c31-4847-83c8-4951106a326c\") " pod="openstack-kuttl-tests/keystone-db-create-xfd9w" Mar 16 16:37:28 crc kubenswrapper[5120]: I0316 16:37:28.276731 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/06e4bc0a-e757-40b7-8ed8-693dd20c185a-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:28 crc kubenswrapper[5120]: E0316 16:37:28.279850 5120 projected.go:194] Error preparing data for projected volume kube-api-access-46bx8 for pod openstack-kuttl-tests/keystone-db-create-xfd9w: failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 16:37:28 crc kubenswrapper[5120]: E0316 16:37:28.279913 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0742a9c5-1c31-4847-83c8-4951106a326c-kube-api-access-46bx8 podName:0742a9c5-1c31-4847-83c8-4951106a326c nodeName:}" failed. No retries permitted until 2026-03-16 16:37:28.779895293 +0000 UTC m=+3950.933826950 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-46bx8" (UniqueName: "kubernetes.io/projected/0742a9c5-1c31-4847-83c8-4951106a326c-kube-api-access-46bx8") pod "keystone-db-create-xfd9w" (UID: "0742a9c5-1c31-4847-83c8-4951106a326c") : failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 16:37:28 crc kubenswrapper[5120]: I0316 16:37:28.300952 5120 scope.go:117] "RemoveContainer" containerID="650c8959379827c8edd34466a6aa9f4175cc2896a05564a554694bce366f363b" Mar 16 16:37:28 crc kubenswrapper[5120]: I0316 16:37:28.310478 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:37:28 crc kubenswrapper[5120]: I0316 16:37:28.325934 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:37:28 crc kubenswrapper[5120]: I0316 16:37:28.336195 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-proxy-598db64bc5-jp86s"] Mar 16 16:37:28 crc kubenswrapper[5120]: I0316 16:37:28.342611 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/swift-proxy-598db64bc5-jp86s"] Mar 16 16:37:28 crc kubenswrapper[5120]: I0316 16:37:28.351198 5120 scope.go:117] "RemoveContainer" containerID="a5eb8dbb0ca15b32b6b02e507ce778d950835eb65ff811dc3ddac108e7cf01e9" Mar 16 16:37:28 crc kubenswrapper[5120]: E0316 16:37:28.352888 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-46bx8 operator-scripts], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openstack-kuttl-tests/keystone-db-create-xfd9w" podUID="0742a9c5-1c31-4847-83c8-4951106a326c" Mar 16 16:37:28 crc kubenswrapper[5120]: I0316 16:37:28.368559 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-79c8b576d8-725k2" Mar 16 16:37:28 crc kubenswrapper[5120]: I0316 16:37:28.377609 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ba60a8bc-6bab-44a3-9e77-6720ea009a57-config-data\") pod \"ba60a8bc-6bab-44a3-9e77-6720ea009a57\" (UID: \"ba60a8bc-6bab-44a3-9e77-6720ea009a57\") " Mar 16 16:37:28 crc kubenswrapper[5120]: I0316 16:37:28.377810 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ba60a8bc-6bab-44a3-9e77-6720ea009a57-logs\") pod \"ba60a8bc-6bab-44a3-9e77-6720ea009a57\" (UID: \"ba60a8bc-6bab-44a3-9e77-6720ea009a57\") " Mar 16 16:37:28 crc kubenswrapper[5120]: I0316 16:37:28.377958 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ba60a8bc-6bab-44a3-9e77-6720ea009a57-combined-ca-bundle\") pod \"ba60a8bc-6bab-44a3-9e77-6720ea009a57\" (UID: \"ba60a8bc-6bab-44a3-9e77-6720ea009a57\") " Mar 16 16:37:28 crc kubenswrapper[5120]: I0316 16:37:28.378020 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tpfhq\" (UniqueName: \"kubernetes.io/projected/ba60a8bc-6bab-44a3-9e77-6720ea009a57-kube-api-access-tpfhq\") pod \"ba60a8bc-6bab-44a3-9e77-6720ea009a57\" (UID: \"ba60a8bc-6bab-44a3-9e77-6720ea009a57\") " Mar 16 16:37:28 crc kubenswrapper[5120]: I0316 16:37:28.378116 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/ba60a8bc-6bab-44a3-9e77-6720ea009a57-config-data-custom\") pod \"ba60a8bc-6bab-44a3-9e77-6720ea009a57\" (UID: \"ba60a8bc-6bab-44a3-9e77-6720ea009a57\") " Mar 16 16:37:28 crc kubenswrapper[5120]: I0316 16:37:28.378485 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8tr5m\" (UniqueName: \"kubernetes.io/projected/96ed605f-5db1-41a5-a646-7b8ad1150a29-kube-api-access-8tr5m\") pod \"keystone-e1fd-account-create-update-nmc4b\" (UID: \"96ed605f-5db1-41a5-a646-7b8ad1150a29\") " pod="openstack-kuttl-tests/keystone-e1fd-account-create-update-nmc4b" Mar 16 16:37:28 crc kubenswrapper[5120]: I0316 16:37:28.384285 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba60a8bc-6bab-44a3-9e77-6720ea009a57-logs" (OuterVolumeSpecName: "logs") pod "ba60a8bc-6bab-44a3-9e77-6720ea009a57" (UID: "ba60a8bc-6bab-44a3-9e77-6720ea009a57"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:37:28 crc kubenswrapper[5120]: I0316 16:37:28.392009 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/96ed605f-5db1-41a5-a646-7b8ad1150a29-operator-scripts\") pod \"keystone-e1fd-account-create-update-nmc4b\" (UID: \"96ed605f-5db1-41a5-a646-7b8ad1150a29\") " pod="openstack-kuttl-tests/keystone-e1fd-account-create-update-nmc4b" Mar 16 16:37:28 crc kubenswrapper[5120]: E0316 16:37:28.392205 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Mar 16 16:37:28 crc kubenswrapper[5120]: E0316 16:37:28.392355 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/96ed605f-5db1-41a5-a646-7b8ad1150a29-operator-scripts podName:96ed605f-5db1-41a5-a646-7b8ad1150a29 nodeName:}" failed. No retries permitted until 2026-03-16 16:37:29.392305324 +0000 UTC m=+3951.546236981 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/96ed605f-5db1-41a5-a646-7b8ad1150a29-operator-scripts") pod "keystone-e1fd-account-create-update-nmc4b" (UID: "96ed605f-5db1-41a5-a646-7b8ad1150a29") : configmap "openstack-scripts" not found Mar 16 16:37:28 crc kubenswrapper[5120]: I0316 16:37:28.392622 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ba60a8bc-6bab-44a3-9e77-6720ea009a57-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:28 crc kubenswrapper[5120]: I0316 16:37:28.395029 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba60a8bc-6bab-44a3-9e77-6720ea009a57-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "ba60a8bc-6bab-44a3-9e77-6720ea009a57" (UID: "ba60a8bc-6bab-44a3-9e77-6720ea009a57"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:28 crc kubenswrapper[5120]: I0316 16:37:28.395078 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba60a8bc-6bab-44a3-9e77-6720ea009a57-kube-api-access-tpfhq" (OuterVolumeSpecName: "kube-api-access-tpfhq") pod "ba60a8bc-6bab-44a3-9e77-6720ea009a57" (UID: "ba60a8bc-6bab-44a3-9e77-6720ea009a57"). InnerVolumeSpecName "kube-api-access-tpfhq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:37:28 crc kubenswrapper[5120]: I0316 16:37:28.395089 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/openstack-galera-0" podUID="49fde0a2-0250-4ab2-92c6-e88c419aa313" containerName="galera" containerID="cri-o://79a3a517e19aaedf82517a946a3950f61bc6eb918aab15f9840833ae6e238d1d" gracePeriod=30 Mar 16 16:37:28 crc kubenswrapper[5120]: E0316 16:37:28.402931 5120 projected.go:194] Error preparing data for projected volume kube-api-access-8tr5m for pod openstack-kuttl-tests/keystone-e1fd-account-create-update-nmc4b: failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 16:37:28 crc kubenswrapper[5120]: E0316 16:37:28.403063 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/96ed605f-5db1-41a5-a646-7b8ad1150a29-kube-api-access-8tr5m podName:96ed605f-5db1-41a5-a646-7b8ad1150a29 nodeName:}" failed. No retries permitted until 2026-03-16 16:37:29.403036485 +0000 UTC m=+3951.556968142 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-8tr5m" (UniqueName: "kubernetes.io/projected/96ed605f-5db1-41a5-a646-7b8ad1150a29-kube-api-access-8tr5m") pod "keystone-e1fd-account-create-update-nmc4b" (UID: "96ed605f-5db1-41a5-a646-7b8ad1150a29") : failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 16:37:28 crc kubenswrapper[5120]: I0316 16:37:28.425038 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-5zz68"] Mar 16 16:37:28 crc kubenswrapper[5120]: I0316 16:37:28.438793 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-5zz68"] Mar 16 16:37:28 crc kubenswrapper[5120]: I0316 16:37:28.439199 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-797c9dbf4-zdnm7" Mar 16 16:37:28 crc kubenswrapper[5120]: I0316 16:37:28.449749 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 16:37:28 crc kubenswrapper[5120]: I0316 16:37:28.460696 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 16:37:28 crc kubenswrapper[5120]: I0316 16:37:28.467268 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-747d4cf944-dk26n"] Mar 16 16:37:28 crc kubenswrapper[5120]: I0316 16:37:28.478043 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba60a8bc-6bab-44a3-9e77-6720ea009a57-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ba60a8bc-6bab-44a3-9e77-6720ea009a57" (UID: "ba60a8bc-6bab-44a3-9e77-6720ea009a57"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:28 crc kubenswrapper[5120]: I0316 16:37:28.478008 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-747d4cf944-dk26n"] Mar 16 16:37:28 crc kubenswrapper[5120]: I0316 16:37:28.496946 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/fb843f09-58b3-467f-8c61-f9cad54c7b55-internal-tls-certs\") pod \"fb843f09-58b3-467f-8c61-f9cad54c7b55\" (UID: \"fb843f09-58b3-467f-8c61-f9cad54c7b55\") " Mar 16 16:37:28 crc kubenswrapper[5120]: I0316 16:37:28.497199 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rv5zg\" (UniqueName: \"kubernetes.io/projected/fb843f09-58b3-467f-8c61-f9cad54c7b55-kube-api-access-rv5zg\") pod \"fb843f09-58b3-467f-8c61-f9cad54c7b55\" (UID: \"fb843f09-58b3-467f-8c61-f9cad54c7b55\") " Mar 16 16:37:28 crc kubenswrapper[5120]: I0316 16:37:28.497375 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/fb843f09-58b3-467f-8c61-f9cad54c7b55-logs\") pod \"fb843f09-58b3-467f-8c61-f9cad54c7b55\" (UID: \"fb843f09-58b3-467f-8c61-f9cad54c7b55\") " Mar 16 16:37:28 crc kubenswrapper[5120]: I0316 16:37:28.497454 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fb843f09-58b3-467f-8c61-f9cad54c7b55-config-data\") pod \"fb843f09-58b3-467f-8c61-f9cad54c7b55\" (UID: \"fb843f09-58b3-467f-8c61-f9cad54c7b55\") " Mar 16 16:37:28 crc kubenswrapper[5120]: I0316 16:37:28.497535 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/fb843f09-58b3-467f-8c61-f9cad54c7b55-config-data-custom\") pod \"fb843f09-58b3-467f-8c61-f9cad54c7b55\" (UID: \"fb843f09-58b3-467f-8c61-f9cad54c7b55\") " Mar 16 16:37:28 crc kubenswrapper[5120]: I0316 16:37:28.497677 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fb843f09-58b3-467f-8c61-f9cad54c7b55-combined-ca-bundle\") pod \"fb843f09-58b3-467f-8c61-f9cad54c7b55\" (UID: \"fb843f09-58b3-467f-8c61-f9cad54c7b55\") " Mar 16 16:37:28 crc kubenswrapper[5120]: I0316 16:37:28.497698 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/fb843f09-58b3-467f-8c61-f9cad54c7b55-public-tls-certs\") pod \"fb843f09-58b3-467f-8c61-f9cad54c7b55\" (UID: \"fb843f09-58b3-467f-8c61-f9cad54c7b55\") " Mar 16 16:37:28 crc kubenswrapper[5120]: I0316 16:37:28.498360 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ba60a8bc-6bab-44a3-9e77-6720ea009a57-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:28 crc kubenswrapper[5120]: I0316 16:37:28.498387 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tpfhq\" (UniqueName: \"kubernetes.io/projected/ba60a8bc-6bab-44a3-9e77-6720ea009a57-kube-api-access-tpfhq\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:28 crc kubenswrapper[5120]: I0316 16:37:28.498397 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/ba60a8bc-6bab-44a3-9e77-6720ea009a57-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:28 crc kubenswrapper[5120]: E0316 16:37:28.498481 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-memcached-svc: secret "cert-memcached-svc" not found Mar 16 16:37:28 crc kubenswrapper[5120]: E0316 16:37:28.498538 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cc5c2d3-3da0-4d0c-9541-78f0bf375648-memcached-tls-certs podName:2cc5c2d3-3da0-4d0c-9541-78f0bf375648 nodeName:}" failed. No retries permitted until 2026-03-16 16:37:30.498520593 +0000 UTC m=+3952.652452250 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "memcached-tls-certs" (UniqueName: "kubernetes.io/secret/2cc5c2d3-3da0-4d0c-9541-78f0bf375648-memcached-tls-certs") pod "memcached-0" (UID: "2cc5c2d3-3da0-4d0c-9541-78f0bf375648") : secret "cert-memcached-svc" not found Mar 16 16:37:28 crc kubenswrapper[5120]: E0316 16:37:28.502851 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 16:37:28 crc kubenswrapper[5120]: E0316 16:37:28.502943 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cc5c2d3-3da0-4d0c-9541-78f0bf375648-combined-ca-bundle podName:2cc5c2d3-3da0-4d0c-9541-78f0bf375648 nodeName:}" failed. No retries permitted until 2026-03-16 16:37:30.502918668 +0000 UTC m=+3952.656850365 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/2cc5c2d3-3da0-4d0c-9541-78f0bf375648-combined-ca-bundle") pod "memcached-0" (UID: "2cc5c2d3-3da0-4d0c-9541-78f0bf375648") : secret "combined-ca-bundle" not found Mar 16 16:37:28 crc kubenswrapper[5120]: I0316 16:37:28.512417 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb843f09-58b3-467f-8c61-f9cad54c7b55-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "fb843f09-58b3-467f-8c61-f9cad54c7b55" (UID: "fb843f09-58b3-467f-8c61-f9cad54c7b55"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:28 crc kubenswrapper[5120]: I0316 16:37:28.522630 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb843f09-58b3-467f-8c61-f9cad54c7b55-logs" (OuterVolumeSpecName: "logs") pod "fb843f09-58b3-467f-8c61-f9cad54c7b55" (UID: "fb843f09-58b3-467f-8c61-f9cad54c7b55"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:37:28 crc kubenswrapper[5120]: I0316 16:37:28.524585 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba60a8bc-6bab-44a3-9e77-6720ea009a57-config-data" (OuterVolumeSpecName: "config-data") pod "ba60a8bc-6bab-44a3-9e77-6720ea009a57" (UID: "ba60a8bc-6bab-44a3-9e77-6720ea009a57"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:28 crc kubenswrapper[5120]: I0316 16:37:28.554714 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb843f09-58b3-467f-8c61-f9cad54c7b55-kube-api-access-rv5zg" (OuterVolumeSpecName: "kube-api-access-rv5zg") pod "fb843f09-58b3-467f-8c61-f9cad54c7b55" (UID: "fb843f09-58b3-467f-8c61-f9cad54c7b55"). InnerVolumeSpecName "kube-api-access-rv5zg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:37:28 crc kubenswrapper[5120]: I0316 16:37:28.562905 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb843f09-58b3-467f-8c61-f9cad54c7b55-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "fb843f09-58b3-467f-8c61-f9cad54c7b55" (UID: "fb843f09-58b3-467f-8c61-f9cad54c7b55"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:28 crc kubenswrapper[5120]: I0316 16:37:28.583300 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb843f09-58b3-467f-8c61-f9cad54c7b55-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "fb843f09-58b3-467f-8c61-f9cad54c7b55" (UID: "fb843f09-58b3-467f-8c61-f9cad54c7b55"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:28 crc kubenswrapper[5120]: I0316 16:37:28.603121 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rv5zg\" (UniqueName: \"kubernetes.io/projected/fb843f09-58b3-467f-8c61-f9cad54c7b55-kube-api-access-rv5zg\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:28 crc kubenswrapper[5120]: I0316 16:37:28.603156 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/fb843f09-58b3-467f-8c61-f9cad54c7b55-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:28 crc kubenswrapper[5120]: I0316 16:37:28.603166 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/fb843f09-58b3-467f-8c61-f9cad54c7b55-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:28 crc kubenswrapper[5120]: I0316 16:37:28.603175 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ba60a8bc-6bab-44a3-9e77-6720ea009a57-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:28 crc kubenswrapper[5120]: I0316 16:37:28.603186 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fb843f09-58b3-467f-8c61-f9cad54c7b55-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:28 crc kubenswrapper[5120]: I0316 16:37:28.603197 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/fb843f09-58b3-467f-8c61-f9cad54c7b55-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:28 crc kubenswrapper[5120]: I0316 16:37:28.631113 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb843f09-58b3-467f-8c61-f9cad54c7b55-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "fb843f09-58b3-467f-8c61-f9cad54c7b55" (UID: "fb843f09-58b3-467f-8c61-f9cad54c7b55"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:28 crc kubenswrapper[5120]: I0316 16:37:28.642986 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb843f09-58b3-467f-8c61-f9cad54c7b55-config-data" (OuterVolumeSpecName: "config-data") pod "fb843f09-58b3-467f-8c61-f9cad54c7b55" (UID: "fb843f09-58b3-467f-8c61-f9cad54c7b55"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:28 crc kubenswrapper[5120]: I0316 16:37:28.676350 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2c50d5a6-1160-4c1d-a0ee-6dff4d5e6b87" path="/var/lib/kubelet/pods/2c50d5a6-1160-4c1d-a0ee-6dff4d5e6b87/volumes" Mar 16 16:37:28 crc kubenswrapper[5120]: I0316 16:37:28.677696 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="46b6f5ef-ac2f-4add-8c6b-1157abccfbfe" path="/var/lib/kubelet/pods/46b6f5ef-ac2f-4add-8c6b-1157abccfbfe/volumes" Mar 16 16:37:28 crc kubenswrapper[5120]: I0316 16:37:28.678661 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="613be4ed-d055-4f50-a323-8b13e5c5fe1a" path="/var/lib/kubelet/pods/613be4ed-d055-4f50-a323-8b13e5c5fe1a/volumes" Mar 16 16:37:28 crc kubenswrapper[5120]: I0316 16:37:28.679973 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="70f75c98-8188-4143-a468-6f83825ca23c" path="/var/lib/kubelet/pods/70f75c98-8188-4143-a468-6f83825ca23c/volumes" Mar 16 16:37:28 crc kubenswrapper[5120]: I0316 16:37:28.680491 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c1a2ba61-a67d-4937-9979-9f10c744a1a8" path="/var/lib/kubelet/pods/c1a2ba61-a67d-4937-9979-9f10c744a1a8/volumes" Mar 16 16:37:28 crc kubenswrapper[5120]: I0316 16:37:28.681267 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cabe287f-9672-4e34-a32e-20211d186718" path="/var/lib/kubelet/pods/cabe287f-9672-4e34-a32e-20211d186718/volumes" Mar 16 16:37:28 crc kubenswrapper[5120]: I0316 16:37:28.683561 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d9bb0c66-45a6-4915-8878-03f17055f4ab" path="/var/lib/kubelet/pods/d9bb0c66-45a6-4915-8878-03f17055f4ab/volumes" Mar 16 16:37:28 crc kubenswrapper[5120]: I0316 16:37:28.684300 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e3236580-0d7f-4a04-ae0f-5ae8b073d6b7" path="/var/lib/kubelet/pods/e3236580-0d7f-4a04-ae0f-5ae8b073d6b7/volumes" Mar 16 16:37:28 crc kubenswrapper[5120]: I0316 16:37:28.688007 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ee35bceb-0e83-4ec9-8592-e6f6a3a630ac" path="/var/lib/kubelet/pods/ee35bceb-0e83-4ec9-8592-e6f6a3a630ac/volumes" Mar 16 16:37:28 crc kubenswrapper[5120]: I0316 16:37:28.688613 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fec060e6-11fd-4d16-8640-fd02366a7601" path="/var/lib/kubelet/pods/fec060e6-11fd-4d16-8640-fd02366a7601/volumes" Mar 16 16:37:28 crc kubenswrapper[5120]: I0316 16:37:28.717014 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fb843f09-58b3-467f-8c61-f9cad54c7b55-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:28 crc kubenswrapper[5120]: I0316 16:37:28.717043 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/fb843f09-58b3-467f-8c61-f9cad54c7b55-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:28 crc kubenswrapper[5120]: I0316 16:37:28.726217 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-5977d9d985-wssl2" Mar 16 16:37:28 crc kubenswrapper[5120]: E0316 16:37:28.770628 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="79a3a517e19aaedf82517a946a3950f61bc6eb918aab15f9840833ae6e238d1d" cmd=["/bin/bash","/var/lib/operator-scripts/mysql_probe.sh","readiness"] Mar 16 16:37:28 crc kubenswrapper[5120]: I0316 16:37:28.774394 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-5f8nh"] Mar 16 16:37:28 crc kubenswrapper[5120]: E0316 16:37:28.775239 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="79a3a517e19aaedf82517a946a3950f61bc6eb918aab15f9840833ae6e238d1d" cmd=["/bin/bash","/var/lib/operator-scripts/mysql_probe.sh","readiness"] Mar 16 16:37:28 crc kubenswrapper[5120]: E0316 16:37:28.779088 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="79a3a517e19aaedf82517a946a3950f61bc6eb918aab15f9840833ae6e238d1d" cmd=["/bin/bash","/var/lib/operator-scripts/mysql_probe.sh","readiness"] Mar 16 16:37:28 crc kubenswrapper[5120]: E0316 16:37:28.779127 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/openstack-galera-0" podUID="49fde0a2-0250-4ab2-92c6-e88c419aa313" containerName="galera" probeResult="unknown" Mar 16 16:37:28 crc kubenswrapper[5120]: I0316 16:37:28.782727 5120 scope.go:117] "RemoveContainer" containerID="176df7f234921791c54dee05804c280e7d31d3152fc27f8d8a89c8e3b608c155" Mar 16 16:37:28 crc kubenswrapper[5120]: I0316 16:37:28.817658 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8822fee9-42fe-47d7-a898-22d38c991abd-combined-ca-bundle\") pod \"8822fee9-42fe-47d7-a898-22d38c991abd\" (UID: \"8822fee9-42fe-47d7-a898-22d38c991abd\") " Mar 16 16:37:28 crc kubenswrapper[5120]: I0316 16:37:28.817896 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8822fee9-42fe-47d7-a898-22d38c991abd-logs\") pod \"8822fee9-42fe-47d7-a898-22d38c991abd\" (UID: \"8822fee9-42fe-47d7-a898-22d38c991abd\") " Mar 16 16:37:28 crc kubenswrapper[5120]: I0316 16:37:28.818027 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t45k7\" (UniqueName: \"kubernetes.io/projected/8822fee9-42fe-47d7-a898-22d38c991abd-kube-api-access-t45k7\") pod \"8822fee9-42fe-47d7-a898-22d38c991abd\" (UID: \"8822fee9-42fe-47d7-a898-22d38c991abd\") " Mar 16 16:37:28 crc kubenswrapper[5120]: I0316 16:37:28.818182 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/8822fee9-42fe-47d7-a898-22d38c991abd-config-data-custom\") pod \"8822fee9-42fe-47d7-a898-22d38c991abd\" (UID: \"8822fee9-42fe-47d7-a898-22d38c991abd\") " Mar 16 16:37:28 crc kubenswrapper[5120]: I0316 16:37:28.818317 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8822fee9-42fe-47d7-a898-22d38c991abd-config-data\") pod \"8822fee9-42fe-47d7-a898-22d38c991abd\" (UID: \"8822fee9-42fe-47d7-a898-22d38c991abd\") " Mar 16 16:37:28 crc kubenswrapper[5120]: I0316 16:37:28.818730 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-46bx8\" (UniqueName: \"kubernetes.io/projected/0742a9c5-1c31-4847-83c8-4951106a326c-kube-api-access-46bx8\") pod \"keystone-db-create-xfd9w\" (UID: \"0742a9c5-1c31-4847-83c8-4951106a326c\") " pod="openstack-kuttl-tests/keystone-db-create-xfd9w" Mar 16 16:37:28 crc kubenswrapper[5120]: I0316 16:37:28.821976 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0742a9c5-1c31-4847-83c8-4951106a326c-operator-scripts\") pod \"keystone-db-create-xfd9w\" (UID: \"0742a9c5-1c31-4847-83c8-4951106a326c\") " pod="openstack-kuttl-tests/keystone-db-create-xfd9w" Mar 16 16:37:28 crc kubenswrapper[5120]: E0316 16:37:28.822389 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Mar 16 16:37:28 crc kubenswrapper[5120]: E0316 16:37:28.822462 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/05e90410-2cfb-438d-95df-8b2a70319257-config-data podName:05e90410-2cfb-438d-95df-8b2a70319257 nodeName:}" failed. No retries permitted until 2026-03-16 16:37:36.822442018 +0000 UTC m=+3958.976373675 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/05e90410-2cfb-438d-95df-8b2a70319257-config-data") pod "rabbitmq-cell1-server-0" (UID: "05e90410-2cfb-438d-95df-8b2a70319257") : configmap "rabbitmq-cell1-config-data" not found Mar 16 16:37:28 crc kubenswrapper[5120]: E0316 16:37:28.822397 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Mar 16 16:37:28 crc kubenswrapper[5120]: E0316 16:37:28.822725 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0742a9c5-1c31-4847-83c8-4951106a326c-operator-scripts podName:0742a9c5-1c31-4847-83c8-4951106a326c nodeName:}" failed. No retries permitted until 2026-03-16 16:37:29.822714345 +0000 UTC m=+3951.976646002 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/0742a9c5-1c31-4847-83c8-4951106a326c-operator-scripts") pod "keystone-db-create-xfd9w" (UID: "0742a9c5-1c31-4847-83c8-4951106a326c") : configmap "openstack-scripts" not found Mar 16 16:37:28 crc kubenswrapper[5120]: I0316 16:37:28.823289 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8822fee9-42fe-47d7-a898-22d38c991abd-logs" (OuterVolumeSpecName: "logs") pod "8822fee9-42fe-47d7-a898-22d38c991abd" (UID: "8822fee9-42fe-47d7-a898-22d38c991abd"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:37:28 crc kubenswrapper[5120]: E0316 16:37:28.826292 5120 projected.go:194] Error preparing data for projected volume kube-api-access-46bx8 for pod openstack-kuttl-tests/keystone-db-create-xfd9w: failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 16:37:28 crc kubenswrapper[5120]: E0316 16:37:28.826343 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0742a9c5-1c31-4847-83c8-4951106a326c-kube-api-access-46bx8 podName:0742a9c5-1c31-4847-83c8-4951106a326c nodeName:}" failed. No retries permitted until 2026-03-16 16:37:29.82633161 +0000 UTC m=+3951.980263257 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-46bx8" (UniqueName: "kubernetes.io/projected/0742a9c5-1c31-4847-83c8-4951106a326c-kube-api-access-46bx8") pod "keystone-db-create-xfd9w" (UID: "0742a9c5-1c31-4847-83c8-4951106a326c") : failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 16:37:28 crc kubenswrapper[5120]: I0316 16:37:28.826338 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8822fee9-42fe-47d7-a898-22d38c991abd-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "8822fee9-42fe-47d7-a898-22d38c991abd" (UID: "8822fee9-42fe-47d7-a898-22d38c991abd"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:28 crc kubenswrapper[5120]: I0316 16:37:28.826726 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8822fee9-42fe-47d7-a898-22d38c991abd-kube-api-access-t45k7" (OuterVolumeSpecName: "kube-api-access-t45k7") pod "8822fee9-42fe-47d7-a898-22d38c991abd" (UID: "8822fee9-42fe-47d7-a898-22d38c991abd"). InnerVolumeSpecName "kube-api-access-t45k7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:37:28 crc kubenswrapper[5120]: I0316 16:37:28.856179 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8822fee9-42fe-47d7-a898-22d38c991abd-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "8822fee9-42fe-47d7-a898-22d38c991abd" (UID: "8822fee9-42fe-47d7-a898-22d38c991abd"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:28 crc kubenswrapper[5120]: W0316 16:37:28.857330 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod493341f2_da9f_4064_b028_e674200e264d.slice/crio-506df5f327647fe2cd140a647747dcb7c580f10569815256e21c35bf3c563462 WatchSource:0}: Error finding container 506df5f327647fe2cd140a647747dcb7c580f10569815256e21c35bf3c563462: Status 404 returned error can't find the container with id 506df5f327647fe2cd140a647747dcb7c580f10569815256e21c35bf3c563462 Mar 16 16:37:28 crc kubenswrapper[5120]: E0316 16:37:28.873586 5120 kuberuntime_manager.go:1358] "Unhandled Error" err=< Mar 16 16:37:28 crc kubenswrapper[5120]: container &Container{Name:mariadb-account-create-update,Image:quay.io/podified-antelope-centos9/openstack-mariadb@sha256:4caef2b55e01b9a7ee88a22bc69db1893521a91d95c7ad4c8e593f14f17a5f95,Command:[/bin/sh -c #!/bin/bash Mar 16 16:37:28 crc kubenswrapper[5120]: Mar 16 16:37:28 crc kubenswrapper[5120]: MYSQL_REMOTE_HOST="" source /var/lib/operator-scripts/mysql_root_auth.sh Mar 16 16:37:28 crc kubenswrapper[5120]: Mar 16 16:37:28 crc kubenswrapper[5120]: export DatabasePassword=${DatabasePassword:?"Please specify a DatabasePassword variable."} Mar 16 16:37:28 crc kubenswrapper[5120]: Mar 16 16:37:28 crc kubenswrapper[5120]: MYSQL_CMD="mysql -h -u root -P 3306" Mar 16 16:37:28 crc kubenswrapper[5120]: Mar 16 16:37:28 crc kubenswrapper[5120]: if [ -n "" ]; then Mar 16 16:37:28 crc kubenswrapper[5120]: GRANT_DATABASE="" Mar 16 16:37:28 crc kubenswrapper[5120]: else Mar 16 16:37:28 crc kubenswrapper[5120]: GRANT_DATABASE="*" Mar 16 16:37:28 crc kubenswrapper[5120]: fi Mar 16 16:37:28 crc kubenswrapper[5120]: Mar 16 16:37:28 crc kubenswrapper[5120]: # going for maximum compatibility here: Mar 16 16:37:28 crc kubenswrapper[5120]: # 1. MySQL 8 no longer allows implicit create user when GRANT is used Mar 16 16:37:28 crc kubenswrapper[5120]: # 2. MariaDB has "CREATE OR REPLACE", but MySQL does not Mar 16 16:37:28 crc kubenswrapper[5120]: # 3. create user with CREATE but then do all password and TLS with ALTER to Mar 16 16:37:28 crc kubenswrapper[5120]: # support updates Mar 16 16:37:28 crc kubenswrapper[5120]: Mar 16 16:37:28 crc kubenswrapper[5120]: $MYSQL_CMD < logger="UnhandledError" Mar 16 16:37:28 crc kubenswrapper[5120]: E0316 16:37:28.877298 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"mariadb-account-create-update\" with CreateContainerConfigError: \"secret \\\"openstack-mariadb-root-db-secret\\\" not found\"" pod="openstack-kuttl-tests/root-account-create-update-5f8nh" podUID="493341f2-da9f-4064-b028-e674200e264d" Mar 16 16:37:28 crc kubenswrapper[5120]: I0316 16:37:28.924713 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/8822fee9-42fe-47d7-a898-22d38c991abd-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:28 crc kubenswrapper[5120]: I0316 16:37:28.925170 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8822fee9-42fe-47d7-a898-22d38c991abd-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:28 crc kubenswrapper[5120]: I0316 16:37:28.925256 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8822fee9-42fe-47d7-a898-22d38c991abd-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:28 crc kubenswrapper[5120]: I0316 16:37:28.925325 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t45k7\" (UniqueName: \"kubernetes.io/projected/8822fee9-42fe-47d7-a898-22d38c991abd-kube-api-access-t45k7\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:28 crc kubenswrapper[5120]: I0316 16:37:28.958330 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8822fee9-42fe-47d7-a898-22d38c991abd-config-data" (OuterVolumeSpecName: "config-data") pod "8822fee9-42fe-47d7-a898-22d38c991abd" (UID: "8822fee9-42fe-47d7-a898-22d38c991abd"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.008202 5120 generic.go:358] "Generic (PLEG): container finished" podID="dc7435f2-f650-416c-b0db-53082105f13b" containerID="cd1fe4c47b47574fb7349bbe6b90048d31bd50a842336360580a001e58e13b5c" exitCode=0 Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.008396 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"dc7435f2-f650-416c-b0db-53082105f13b","Type":"ContainerDied","Data":"cd1fe4c47b47574fb7349bbe6b90048d31bd50a842336360580a001e58e13b5c"} Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.008432 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"dc7435f2-f650-416c-b0db-53082105f13b","Type":"ContainerDied","Data":"c56d621e010bf063eecea599e04c60b98269bc230941962c087a8aaef38f01ef"} Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.008449 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c56d621e010bf063eecea599e04c60b98269bc230941962c087a8aaef38f01ef" Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.012509 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-northd-0_adeefc4f-7632-4673-ae4f-0104e9e65d1d/ovn-northd/0.log" Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.012551 5120 generic.go:358] "Generic (PLEG): container finished" podID="adeefc4f-7632-4673-ae4f-0104e9e65d1d" containerID="da5b7b3662dbec12f059c3403e92b3f66241a0648ce9cb26b0e022725a195476" exitCode=139 Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.012669 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"adeefc4f-7632-4673-ae4f-0104e9e65d1d","Type":"ContainerDied","Data":"da5b7b3662dbec12f059c3403e92b3f66241a0648ce9cb26b0e022725a195476"} Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.016039 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-797c9dbf4-zdnm7" event={"ID":"fb843f09-58b3-467f-8c61-f9cad54c7b55","Type":"ContainerDied","Data":"24cb426aa340f06a7f453571564d2ec783367bbab6a6cf9d1f5fc686981c8c0f"} Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.016292 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-797c9dbf4-zdnm7" Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.032713 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8822fee9-42fe-47d7-a898-22d38c991abd-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.037663 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.037667 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"2fbd9119-d73e-4c1e-99b9-8f078e2acdfb","Type":"ContainerDied","Data":"ffce6742df990c1b2ab8e272b5a6aada792d3fbcb65e7aa1b9e5757819aafd52"} Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.054395 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-5f8nh" event={"ID":"493341f2-da9f-4064-b028-e674200e264d","Type":"ContainerStarted","Data":"506df5f327647fe2cd140a647747dcb7c580f10569815256e21c35bf3c563462"} Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.079226 5120 generic.go:358] "Generic (PLEG): container finished" podID="e06e57b2-920d-463e-8607-2c1365c8c2e5" containerID="eac3ce7db4688a2a4729b65bbd6b8d2b6e1e46040a71a118988c54b1e78fc10f" exitCode=0 Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.079416 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-8t4vn" event={"ID":"e06e57b2-920d-463e-8607-2c1365c8c2e5","Type":"ContainerDied","Data":"eac3ce7db4688a2a4729b65bbd6b8d2b6e1e46040a71a118988c54b1e78fc10f"} Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.091551 5120 generic.go:358] "Generic (PLEG): container finished" podID="8822fee9-42fe-47d7-a898-22d38c991abd" containerID="d574b3982ee170745544121427c41d12f2d53fcc93af40baff6d3f7c253ab3ac" exitCode=0 Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.091712 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-5977d9d985-wssl2" event={"ID":"8822fee9-42fe-47d7-a898-22d38c991abd","Type":"ContainerDied","Data":"d574b3982ee170745544121427c41d12f2d53fcc93af40baff6d3f7c253ab3ac"} Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.091834 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-5977d9d985-wssl2" event={"ID":"8822fee9-42fe-47d7-a898-22d38c991abd","Type":"ContainerDied","Data":"c55c812ea206d9b0e8646e4f58d9e4151c51321b3c618434da1ec688a3814b93"} Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.091985 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-5977d9d985-wssl2" Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.129027 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"be8b10ce-e42f-4650-bc2f-96fe51dc224c","Type":"ContainerDied","Data":"759b08f9d80d6be7016ee37b1749f4951ba70131e6b8c69cadcd8ad48cff7909"} Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.129192 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.171122 5120 generic.go:358] "Generic (PLEG): container finished" podID="204ff621-b59e-44f0-84a5-c9e4eaaf86bf" containerID="36a38b9c8971280678407303957af16f6e151a9ccb5c0f41ffc3a4f90e4185cb" exitCode=0 Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.171192 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"204ff621-b59e-44f0-84a5-c9e4eaaf86bf","Type":"ContainerDied","Data":"36a38b9c8971280678407303957af16f6e151a9ccb5c0f41ffc3a4f90e4185cb"} Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.171220 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"204ff621-b59e-44f0-84a5-c9e4eaaf86bf","Type":"ContainerDied","Data":"a4f0f47792c541bbdfdc4aa02957d9f5d001f8eb68aad9f21183153a7f7350eb"} Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.171231 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a4f0f47792c541bbdfdc4aa02957d9f5d001f8eb68aad9f21183153a7f7350eb" Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.178680 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"06e4bc0a-e757-40b7-8ed8-693dd20c185a","Type":"ContainerDied","Data":"e145594d2f7dace29ee7703bcbb6453deabc8c57a1c230e3e80fd2c2fe679c43"} Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.178825 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.185673 5120 generic.go:358] "Generic (PLEG): container finished" podID="ba60a8bc-6bab-44a3-9e77-6720ea009a57" containerID="7bdd3c9904ff978a4ff90478697f43df053f05e42e235f1b924d00f8b65b050e" exitCode=0 Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.185747 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-79c8b576d8-725k2" event={"ID":"ba60a8bc-6bab-44a3-9e77-6720ea009a57","Type":"ContainerDied","Data":"7bdd3c9904ff978a4ff90478697f43df053f05e42e235f1b924d00f8b65b050e"} Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.185863 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-79c8b576d8-725k2" event={"ID":"ba60a8bc-6bab-44a3-9e77-6720ea009a57","Type":"ContainerDied","Data":"638b55a0210ec14554ceefae7250d4967dbfce30abd507e29ac89b086c75c97a"} Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.185938 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-79c8b576d8-725k2" Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.221586 5120 generic.go:358] "Generic (PLEG): container finished" podID="fa6ffb82-b871-4dae-b7c1-7880c90110a2" containerID="7b272a2c6ee74f384df1440a6b8dba3da112cef47111a781a3b1bb1cb0c90d7c" exitCode=0 Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.221694 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-e1fd-account-create-update-nmc4b" Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.222175 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"fa6ffb82-b871-4dae-b7c1-7880c90110a2","Type":"ContainerDied","Data":"7b272a2c6ee74f384df1440a6b8dba3da112cef47111a781a3b1bb1cb0c90d7c"} Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.222228 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-create-xfd9w" Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.433355 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.446402 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.451467 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8tr5m\" (UniqueName: \"kubernetes.io/projected/96ed605f-5db1-41a5-a646-7b8ad1150a29-kube-api-access-8tr5m\") pod \"keystone-e1fd-account-create-update-nmc4b\" (UID: \"96ed605f-5db1-41a5-a646-7b8ad1150a29\") " pod="openstack-kuttl-tests/keystone-e1fd-account-create-update-nmc4b" Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.451780 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/96ed605f-5db1-41a5-a646-7b8ad1150a29-operator-scripts\") pod \"keystone-e1fd-account-create-update-nmc4b\" (UID: \"96ed605f-5db1-41a5-a646-7b8ad1150a29\") " pod="openstack-kuttl-tests/keystone-e1fd-account-create-update-nmc4b" Mar 16 16:37:29 crc kubenswrapper[5120]: E0316 16:37:29.451903 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Mar 16 16:37:29 crc kubenswrapper[5120]: E0316 16:37:29.451967 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/96ed605f-5db1-41a5-a646-7b8ad1150a29-operator-scripts podName:96ed605f-5db1-41a5-a646-7b8ad1150a29 nodeName:}" failed. No retries permitted until 2026-03-16 16:37:31.451947749 +0000 UTC m=+3953.605879406 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/96ed605f-5db1-41a5-a646-7b8ad1150a29-operator-scripts") pod "keystone-e1fd-account-create-update-nmc4b" (UID: "96ed605f-5db1-41a5-a646-7b8ad1150a29") : configmap "openstack-scripts" not found Mar 16 16:37:29 crc kubenswrapper[5120]: E0316 16:37:29.460641 5120 projected.go:194] Error preparing data for projected volume kube-api-access-8tr5m for pod openstack-kuttl-tests/keystone-e1fd-account-create-update-nmc4b: failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 16:37:29 crc kubenswrapper[5120]: E0316 16:37:29.460795 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/96ed605f-5db1-41a5-a646-7b8ad1150a29-kube-api-access-8tr5m podName:96ed605f-5db1-41a5-a646-7b8ad1150a29 nodeName:}" failed. No retries permitted until 2026-03-16 16:37:31.460732279 +0000 UTC m=+3953.614663946 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-8tr5m" (UniqueName: "kubernetes.io/projected/96ed605f-5db1-41a5-a646-7b8ad1150a29-kube-api-access-8tr5m") pod "keystone-e1fd-account-create-update-nmc4b" (UID: "96ed605f-5db1-41a5-a646-7b8ad1150a29") : failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.476971 5120 scope.go:117] "RemoveContainer" containerID="4e25db5c9a91ab6c5e9d9ea567f1afbd22b33692b261fb638331d9b211b125db" Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.489865 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.500275 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-e1fd-account-create-update-nmc4b" Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.535237 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-create-xfd9w" Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.541218 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-northd-0_adeefc4f-7632-4673-ae4f-0104e9e65d1d/ovn-northd/0.log" Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.541337 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.547180 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.553535 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4mkqs\" (UniqueName: \"kubernetes.io/projected/204ff621-b59e-44f0-84a5-c9e4eaaf86bf-kube-api-access-4mkqs\") pod \"204ff621-b59e-44f0-84a5-c9e4eaaf86bf\" (UID: \"204ff621-b59e-44f0-84a5-c9e4eaaf86bf\") " Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.553651 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/204ff621-b59e-44f0-84a5-c9e4eaaf86bf-config-data\") pod \"204ff621-b59e-44f0-84a5-c9e4eaaf86bf\" (UID: \"204ff621-b59e-44f0-84a5-c9e4eaaf86bf\") " Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.553739 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/204ff621-b59e-44f0-84a5-c9e4eaaf86bf-combined-ca-bundle\") pod \"204ff621-b59e-44f0-84a5-c9e4eaaf86bf\" (UID: \"204ff621-b59e-44f0-84a5-c9e4eaaf86bf\") " Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.553792 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dc7435f2-f650-416c-b0db-53082105f13b-config-data\") pod \"dc7435f2-f650-416c-b0db-53082105f13b\" (UID: \"dc7435f2-f650-416c-b0db-53082105f13b\") " Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.553965 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fa6ffb82-b871-4dae-b7c1-7880c90110a2-config-data\") pod \"fa6ffb82-b871-4dae-b7c1-7880c90110a2\" (UID: \"fa6ffb82-b871-4dae-b7c1-7880c90110a2\") " Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.554150 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/204ff621-b59e-44f0-84a5-c9e4eaaf86bf-run-httpd\") pod \"204ff621-b59e-44f0-84a5-c9e4eaaf86bf\" (UID: \"204ff621-b59e-44f0-84a5-c9e4eaaf86bf\") " Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.554699 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/fa6ffb82-b871-4dae-b7c1-7880c90110a2-config-data-custom\") pod \"fa6ffb82-b871-4dae-b7c1-7880c90110a2\" (UID: \"fa6ffb82-b871-4dae-b7c1-7880c90110a2\") " Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.554785 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l8qvq\" (UniqueName: \"kubernetes.io/projected/dc7435f2-f650-416c-b0db-53082105f13b-kube-api-access-l8qvq\") pod \"dc7435f2-f650-416c-b0db-53082105f13b\" (UID: \"dc7435f2-f650-416c-b0db-53082105f13b\") " Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.555043 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/fa6ffb82-b871-4dae-b7c1-7880c90110a2-scripts\") pod \"fa6ffb82-b871-4dae-b7c1-7880c90110a2\" (UID: \"fa6ffb82-b871-4dae-b7c1-7880c90110a2\") " Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.555370 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dhbbm\" (UniqueName: \"kubernetes.io/projected/fa6ffb82-b871-4dae-b7c1-7880c90110a2-kube-api-access-dhbbm\") pod \"fa6ffb82-b871-4dae-b7c1-7880c90110a2\" (UID: \"fa6ffb82-b871-4dae-b7c1-7880c90110a2\") " Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.555525 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/204ff621-b59e-44f0-84a5-c9e4eaaf86bf-scripts\") pod \"204ff621-b59e-44f0-84a5-c9e4eaaf86bf\" (UID: \"204ff621-b59e-44f0-84a5-c9e4eaaf86bf\") " Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.556254 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/204ff621-b59e-44f0-84a5-c9e4eaaf86bf-log-httpd\") pod \"204ff621-b59e-44f0-84a5-c9e4eaaf86bf\" (UID: \"204ff621-b59e-44f0-84a5-c9e4eaaf86bf\") " Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.556347 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/204ff621-b59e-44f0-84a5-c9e4eaaf86bf-ceilometer-tls-certs\") pod \"204ff621-b59e-44f0-84a5-c9e4eaaf86bf\" (UID: \"204ff621-b59e-44f0-84a5-c9e4eaaf86bf\") " Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.556369 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fa6ffb82-b871-4dae-b7c1-7880c90110a2-combined-ca-bundle\") pod \"fa6ffb82-b871-4dae-b7c1-7880c90110a2\" (UID: \"fa6ffb82-b871-4dae-b7c1-7880c90110a2\") " Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.558454 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dc7435f2-f650-416c-b0db-53082105f13b-combined-ca-bundle\") pod \"dc7435f2-f650-416c-b0db-53082105f13b\" (UID: \"dc7435f2-f650-416c-b0db-53082105f13b\") " Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.558749 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/204ff621-b59e-44f0-84a5-c9e4eaaf86bf-sg-core-conf-yaml\") pod \"204ff621-b59e-44f0-84a5-c9e4eaaf86bf\" (UID: \"204ff621-b59e-44f0-84a5-c9e4eaaf86bf\") " Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.558810 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/fa6ffb82-b871-4dae-b7c1-7880c90110a2-etc-machine-id\") pod \"fa6ffb82-b871-4dae-b7c1-7880c90110a2\" (UID: \"fa6ffb82-b871-4dae-b7c1-7880c90110a2\") " Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.563221 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/fa6ffb82-b871-4dae-b7c1-7880c90110a2-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "fa6ffb82-b871-4dae-b7c1-7880c90110a2" (UID: "fa6ffb82-b871-4dae-b7c1-7880c90110a2"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.568730 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.569224 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/204ff621-b59e-44f0-84a5-c9e4eaaf86bf-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "204ff621-b59e-44f0-84a5-c9e4eaaf86bf" (UID: "204ff621-b59e-44f0-84a5-c9e4eaaf86bf"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.570054 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/204ff621-b59e-44f0-84a5-c9e4eaaf86bf-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "204ff621-b59e-44f0-84a5-c9e4eaaf86bf" (UID: "204ff621-b59e-44f0-84a5-c9e4eaaf86bf"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.580096 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa6ffb82-b871-4dae-b7c1-7880c90110a2-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "fa6ffb82-b871-4dae-b7c1-7880c90110a2" (UID: "fa6ffb82-b871-4dae-b7c1-7880c90110a2"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.582897 5120 scope.go:117] "RemoveContainer" containerID="cb21c359b23b03f5e91a52989546953e9e8fad15e126dc02107149d24a46a45b" Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.583452 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc7435f2-f650-416c-b0db-53082105f13b-kube-api-access-l8qvq" (OuterVolumeSpecName: "kube-api-access-l8qvq") pod "dc7435f2-f650-416c-b0db-53082105f13b" (UID: "dc7435f2-f650-416c-b0db-53082105f13b"). InnerVolumeSpecName "kube-api-access-l8qvq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.592376 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-797c9dbf4-zdnm7"] Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.601122 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa6ffb82-b871-4dae-b7c1-7880c90110a2-scripts" (OuterVolumeSpecName: "scripts") pod "fa6ffb82-b871-4dae-b7c1-7880c90110a2" (UID: "fa6ffb82-b871-4dae-b7c1-7880c90110a2"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.606452 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/204ff621-b59e-44f0-84a5-c9e4eaaf86bf-kube-api-access-4mkqs" (OuterVolumeSpecName: "kube-api-access-4mkqs") pod "204ff621-b59e-44f0-84a5-c9e4eaaf86bf" (UID: "204ff621-b59e-44f0-84a5-c9e4eaaf86bf"). InnerVolumeSpecName "kube-api-access-4mkqs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.610147 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/204ff621-b59e-44f0-84a5-c9e4eaaf86bf-scripts" (OuterVolumeSpecName: "scripts") pod "204ff621-b59e-44f0-84a5-c9e4eaaf86bf" (UID: "204ff621-b59e-44f0-84a5-c9e4eaaf86bf"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.610676 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-api-797c9dbf4-zdnm7"] Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.627574 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa6ffb82-b871-4dae-b7c1-7880c90110a2-kube-api-access-dhbbm" (OuterVolumeSpecName: "kube-api-access-dhbbm") pod "fa6ffb82-b871-4dae-b7c1-7880c90110a2" (UID: "fa6ffb82-b871-4dae-b7c1-7880c90110a2"). InnerVolumeSpecName "kube-api-access-dhbbm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.634461 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-79c8b576d8-725k2"] Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.652392 5120 scope.go:117] "RemoveContainer" containerID="58d160f133e7a544995711ab2da546c604a09aa66243ab21dcd76c000103b09f" Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.652965 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-79c8b576d8-725k2"] Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.654218 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.660569 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.663795 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/adeefc4f-7632-4673-ae4f-0104e9e65d1d-combined-ca-bundle\") pod \"adeefc4f-7632-4673-ae4f-0104e9e65d1d\" (UID: \"adeefc4f-7632-4673-ae4f-0104e9e65d1d\") " Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.663928 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4c9nj\" (UniqueName: \"kubernetes.io/projected/adeefc4f-7632-4673-ae4f-0104e9e65d1d-kube-api-access-4c9nj\") pod \"adeefc4f-7632-4673-ae4f-0104e9e65d1d\" (UID: \"adeefc4f-7632-4673-ae4f-0104e9e65d1d\") " Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.664019 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/adeefc4f-7632-4673-ae4f-0104e9e65d1d-ovn-northd-tls-certs\") pod \"adeefc4f-7632-4673-ae4f-0104e9e65d1d\" (UID: \"adeefc4f-7632-4673-ae4f-0104e9e65d1d\") " Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.664075 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/adeefc4f-7632-4673-ae4f-0104e9e65d1d-config\") pod \"adeefc4f-7632-4673-ae4f-0104e9e65d1d\" (UID: \"adeefc4f-7632-4673-ae4f-0104e9e65d1d\") " Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.664105 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/adeefc4f-7632-4673-ae4f-0104e9e65d1d-metrics-certs-tls-certs\") pod \"adeefc4f-7632-4673-ae4f-0104e9e65d1d\" (UID: \"adeefc4f-7632-4673-ae4f-0104e9e65d1d\") " Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.664145 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/adeefc4f-7632-4673-ae4f-0104e9e65d1d-ovn-rundir\") pod \"adeefc4f-7632-4673-ae4f-0104e9e65d1d\" (UID: \"adeefc4f-7632-4673-ae4f-0104e9e65d1d\") " Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.664297 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/adeefc4f-7632-4673-ae4f-0104e9e65d1d-scripts\") pod \"adeefc4f-7632-4673-ae4f-0104e9e65d1d\" (UID: \"adeefc4f-7632-4673-ae4f-0104e9e65d1d\") " Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.666156 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-5977d9d985-wssl2"] Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.667311 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/adeefc4f-7632-4673-ae4f-0104e9e65d1d-scripts" (OuterVolumeSpecName: "scripts") pod "adeefc4f-7632-4673-ae4f-0104e9e65d1d" (UID: "adeefc4f-7632-4673-ae4f-0104e9e65d1d"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.667677 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/adeefc4f-7632-4673-ae4f-0104e9e65d1d-ovn-rundir" (OuterVolumeSpecName: "ovn-rundir") pod "adeefc4f-7632-4673-ae4f-0104e9e65d1d" (UID: "adeefc4f-7632-4673-ae4f-0104e9e65d1d"). InnerVolumeSpecName "ovn-rundir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.667724 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/adeefc4f-7632-4673-ae4f-0104e9e65d1d-config" (OuterVolumeSpecName: "config") pod "adeefc4f-7632-4673-ae4f-0104e9e65d1d" (UID: "adeefc4f-7632-4673-ae4f-0104e9e65d1d"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.670287 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-5f8nh" Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.672007 5120 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/fa6ffb82-b871-4dae-b7c1-7880c90110a2-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.672132 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4mkqs\" (UniqueName: \"kubernetes.io/projected/204ff621-b59e-44f0-84a5-c9e4eaaf86bf-kube-api-access-4mkqs\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.672497 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/204ff621-b59e-44f0-84a5-c9e4eaaf86bf-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.672512 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/fa6ffb82-b871-4dae-b7c1-7880c90110a2-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.672524 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l8qvq\" (UniqueName: \"kubernetes.io/projected/dc7435f2-f650-416c-b0db-53082105f13b-kube-api-access-l8qvq\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.672533 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/fa6ffb82-b871-4dae-b7c1-7880c90110a2-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.672542 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dhbbm\" (UniqueName: \"kubernetes.io/projected/fa6ffb82-b871-4dae-b7c1-7880c90110a2-kube-api-access-dhbbm\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.672550 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/204ff621-b59e-44f0-84a5-c9e4eaaf86bf-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.672558 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/204ff621-b59e-44f0-84a5-c9e4eaaf86bf-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.681813 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-worker-5977d9d985-wssl2"] Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.686016 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/adeefc4f-7632-4673-ae4f-0104e9e65d1d-kube-api-access-4c9nj" (OuterVolumeSpecName: "kube-api-access-4c9nj") pod "adeefc4f-7632-4673-ae4f-0104e9e65d1d" (UID: "adeefc4f-7632-4673-ae4f-0104e9e65d1d"). InnerVolumeSpecName "kube-api-access-4c9nj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.688971 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.695495 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.698130 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.710614 5120 scope.go:117] "RemoveContainer" containerID="6239d9262ea4e6d804dc34e524958245dbc975aa665284c54c62b5dca2c72739" Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.737976 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc7435f2-f650-416c-b0db-53082105f13b-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "dc7435f2-f650-416c-b0db-53082105f13b" (UID: "dc7435f2-f650-416c-b0db-53082105f13b"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.740081 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa6ffb82-b871-4dae-b7c1-7880c90110a2-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "fa6ffb82-b871-4dae-b7c1-7880c90110a2" (UID: "fa6ffb82-b871-4dae-b7c1-7880c90110a2"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.751061 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/adeefc4f-7632-4673-ae4f-0104e9e65d1d-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "adeefc4f-7632-4673-ae4f-0104e9e65d1d" (UID: "adeefc4f-7632-4673-ae4f-0104e9e65d1d"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.751545 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc7435f2-f650-416c-b0db-53082105f13b-config-data" (OuterVolumeSpecName: "config-data") pod "dc7435f2-f650-416c-b0db-53082105f13b" (UID: "dc7435f2-f650-416c-b0db-53082105f13b"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.771747 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.773325 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-54b2m\" (UniqueName: \"kubernetes.io/projected/2cc5c2d3-3da0-4d0c-9541-78f0bf375648-kube-api-access-54b2m\") pod \"2cc5c2d3-3da0-4d0c-9541-78f0bf375648\" (UID: \"2cc5c2d3-3da0-4d0c-9541-78f0bf375648\") " Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.773369 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2cc5c2d3-3da0-4d0c-9541-78f0bf375648-combined-ca-bundle\") pod \"2cc5c2d3-3da0-4d0c-9541-78f0bf375648\" (UID: \"2cc5c2d3-3da0-4d0c-9541-78f0bf375648\") " Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.773498 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/2cc5c2d3-3da0-4d0c-9541-78f0bf375648-memcached-tls-certs\") pod \"2cc5c2d3-3da0-4d0c-9541-78f0bf375648\" (UID: \"2cc5c2d3-3da0-4d0c-9541-78f0bf375648\") " Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.773595 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/493341f2-da9f-4064-b028-e674200e264d-operator-scripts\") pod \"493341f2-da9f-4064-b028-e674200e264d\" (UID: \"493341f2-da9f-4064-b028-e674200e264d\") " Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.773805 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/2cc5c2d3-3da0-4d0c-9541-78f0bf375648-config-data\") pod \"2cc5c2d3-3da0-4d0c-9541-78f0bf375648\" (UID: \"2cc5c2d3-3da0-4d0c-9541-78f0bf375648\") " Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.773955 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/2cc5c2d3-3da0-4d0c-9541-78f0bf375648-kolla-config\") pod \"2cc5c2d3-3da0-4d0c-9541-78f0bf375648\" (UID: \"2cc5c2d3-3da0-4d0c-9541-78f0bf375648\") " Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.774044 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xkrvx\" (UniqueName: \"kubernetes.io/projected/493341f2-da9f-4064-b028-e674200e264d-kube-api-access-xkrvx\") pod \"493341f2-da9f-4064-b028-e674200e264d\" (UID: \"493341f2-da9f-4064-b028-e674200e264d\") " Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.775914 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2cc5c2d3-3da0-4d0c-9541-78f0bf375648-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "2cc5c2d3-3da0-4d0c-9541-78f0bf375648" (UID: "2cc5c2d3-3da0-4d0c-9541-78f0bf375648"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.777679 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2cc5c2d3-3da0-4d0c-9541-78f0bf375648-kube-api-access-54b2m" (OuterVolumeSpecName: "kube-api-access-54b2m") pod "2cc5c2d3-3da0-4d0c-9541-78f0bf375648" (UID: "2cc5c2d3-3da0-4d0c-9541-78f0bf375648"). InnerVolumeSpecName "kube-api-access-54b2m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.780378 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2cc5c2d3-3da0-4d0c-9541-78f0bf375648-config-data" (OuterVolumeSpecName: "config-data") pod "2cc5c2d3-3da0-4d0c-9541-78f0bf375648" (UID: "2cc5c2d3-3da0-4d0c-9541-78f0bf375648"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.781053 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/adeefc4f-7632-4673-ae4f-0104e9e65d1d-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.781075 5120 reconciler_common.go:299] "Volume detached for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/adeefc4f-7632-4673-ae4f-0104e9e65d1d-ovn-rundir\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.781088 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fa6ffb82-b871-4dae-b7c1-7880c90110a2-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.781126 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dc7435f2-f650-416c-b0db-53082105f13b-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.781152 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/2cc5c2d3-3da0-4d0c-9541-78f0bf375648-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.781165 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/adeefc4f-7632-4673-ae4f-0104e9e65d1d-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.781176 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dc7435f2-f650-416c-b0db-53082105f13b-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.781187 5120 reconciler_common.go:299] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/2cc5c2d3-3da0-4d0c-9541-78f0bf375648-kolla-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.781196 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/adeefc4f-7632-4673-ae4f-0104e9e65d1d-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.781207 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-54b2m\" (UniqueName: \"kubernetes.io/projected/2cc5c2d3-3da0-4d0c-9541-78f0bf375648-kube-api-access-54b2m\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.781219 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4c9nj\" (UniqueName: \"kubernetes.io/projected/adeefc4f-7632-4673-ae4f-0104e9e65d1d-kube-api-access-4c9nj\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.790336 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/493341f2-da9f-4064-b028-e674200e264d-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "493341f2-da9f-4064-b028-e674200e264d" (UID: "493341f2-da9f-4064-b028-e674200e264d"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.797248 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/493341f2-da9f-4064-b028-e674200e264d-kube-api-access-xkrvx" (OuterVolumeSpecName: "kube-api-access-xkrvx") pod "493341f2-da9f-4064-b028-e674200e264d" (UID: "493341f2-da9f-4064-b028-e674200e264d"). InnerVolumeSpecName "kube-api-access-xkrvx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.797317 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/204ff621-b59e-44f0-84a5-c9e4eaaf86bf-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "204ff621-b59e-44f0-84a5-c9e4eaaf86bf" (UID: "204ff621-b59e-44f0-84a5-c9e4eaaf86bf"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.812212 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/adeefc4f-7632-4673-ae4f-0104e9e65d1d-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "adeefc4f-7632-4673-ae4f-0104e9e65d1d" (UID: "adeefc4f-7632-4673-ae4f-0104e9e65d1d"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.818044 5120 scope.go:117] "RemoveContainer" containerID="c571cf34fd0e3bd683dfb18e6a22a56da066ae6e0cf5b1a616392a29bff9e024" Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.829962 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2cc5c2d3-3da0-4d0c-9541-78f0bf375648-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "2cc5c2d3-3da0-4d0c-9541-78f0bf375648" (UID: "2cc5c2d3-3da0-4d0c-9541-78f0bf375648"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.837571 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/204ff621-b59e-44f0-84a5-c9e4eaaf86bf-ceilometer-tls-certs" (OuterVolumeSpecName: "ceilometer-tls-certs") pod "204ff621-b59e-44f0-84a5-c9e4eaaf86bf" (UID: "204ff621-b59e-44f0-84a5-c9e4eaaf86bf"). InnerVolumeSpecName "ceilometer-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.852638 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa6ffb82-b871-4dae-b7c1-7880c90110a2-config-data" (OuterVolumeSpecName: "config-data") pod "fa6ffb82-b871-4dae-b7c1-7880c90110a2" (UID: "fa6ffb82-b871-4dae-b7c1-7880c90110a2"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.882892 5120 scope.go:117] "RemoveContainer" containerID="79f4283e3961fe8587913a54a4c1b00035f76c81dbe46a09d7a17f5d45d1ffe7" Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.882921 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/49fde0a2-0250-4ab2-92c6-e88c419aa313-config-data-default\") pod \"49fde0a2-0250-4ab2-92c6-e88c419aa313\" (UID: \"49fde0a2-0250-4ab2-92c6-e88c419aa313\") " Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.882983 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/49fde0a2-0250-4ab2-92c6-e88c419aa313-combined-ca-bundle\") pod \"49fde0a2-0250-4ab2-92c6-e88c419aa313\" (UID: \"49fde0a2-0250-4ab2-92c6-e88c419aa313\") " Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.883115 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/204ff621-b59e-44f0-84a5-c9e4eaaf86bf-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "204ff621-b59e-44f0-84a5-c9e4eaaf86bf" (UID: "204ff621-b59e-44f0-84a5-c9e4eaaf86bf"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.883121 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bszrj\" (UniqueName: \"kubernetes.io/projected/49fde0a2-0250-4ab2-92c6-e88c419aa313-kube-api-access-bszrj\") pod \"49fde0a2-0250-4ab2-92c6-e88c419aa313\" (UID: \"49fde0a2-0250-4ab2-92c6-e88c419aa313\") " Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.883217 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/204ff621-b59e-44f0-84a5-c9e4eaaf86bf-combined-ca-bundle\") pod \"204ff621-b59e-44f0-84a5-c9e4eaaf86bf\" (UID: \"204ff621-b59e-44f0-84a5-c9e4eaaf86bf\") " Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.883258 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/49fde0a2-0250-4ab2-92c6-e88c419aa313-operator-scripts\") pod \"49fde0a2-0250-4ab2-92c6-e88c419aa313\" (UID: \"49fde0a2-0250-4ab2-92c6-e88c419aa313\") " Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.883446 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/49fde0a2-0250-4ab2-92c6-e88c419aa313-config-data-generated\") pod \"49fde0a2-0250-4ab2-92c6-e88c419aa313\" (UID: \"49fde0a2-0250-4ab2-92c6-e88c419aa313\") " Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.883741 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/49fde0a2-0250-4ab2-92c6-e88c419aa313-kolla-config\") pod \"49fde0a2-0250-4ab2-92c6-e88c419aa313\" (UID: \"49fde0a2-0250-4ab2-92c6-e88c419aa313\") " Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.883814 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"mysql-db\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"49fde0a2-0250-4ab2-92c6-e88c419aa313\" (UID: \"49fde0a2-0250-4ab2-92c6-e88c419aa313\") " Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.883862 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/49fde0a2-0250-4ab2-92c6-e88c419aa313-galera-tls-certs\") pod \"49fde0a2-0250-4ab2-92c6-e88c419aa313\" (UID: \"49fde0a2-0250-4ab2-92c6-e88c419aa313\") " Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.884277 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-46bx8\" (UniqueName: \"kubernetes.io/projected/0742a9c5-1c31-4847-83c8-4951106a326c-kube-api-access-46bx8\") pod \"keystone-db-create-xfd9w\" (UID: \"0742a9c5-1c31-4847-83c8-4951106a326c\") " pod="openstack-kuttl-tests/keystone-db-create-xfd9w" Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.884524 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0742a9c5-1c31-4847-83c8-4951106a326c-operator-scripts\") pod \"keystone-db-create-xfd9w\" (UID: \"0742a9c5-1c31-4847-83c8-4951106a326c\") " pod="openstack-kuttl-tests/keystone-db-create-xfd9w" Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.884602 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2cc5c2d3-3da0-4d0c-9541-78f0bf375648-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.884616 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/493341f2-da9f-4064-b028-e674200e264d-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.884627 5120 reconciler_common.go:299] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/adeefc4f-7632-4673-ae4f-0104e9e65d1d-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.884640 5120 reconciler_common.go:299] "Volume detached for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/204ff621-b59e-44f0-84a5-c9e4eaaf86bf-ceilometer-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.884651 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/204ff621-b59e-44f0-84a5-c9e4eaaf86bf-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.884663 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fa6ffb82-b871-4dae-b7c1-7880c90110a2-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.884675 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xkrvx\" (UniqueName: \"kubernetes.io/projected/493341f2-da9f-4064-b028-e674200e264d-kube-api-access-xkrvx\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:29 crc kubenswrapper[5120]: E0316 16:37:29.884729 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Mar 16 16:37:29 crc kubenswrapper[5120]: E0316 16:37:29.884861 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0742a9c5-1c31-4847-83c8-4951106a326c-operator-scripts podName:0742a9c5-1c31-4847-83c8-4951106a326c nodeName:}" failed. No retries permitted until 2026-03-16 16:37:31.884839725 +0000 UTC m=+3954.038771382 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/0742a9c5-1c31-4847-83c8-4951106a326c-operator-scripts") pod "keystone-db-create-xfd9w" (UID: "0742a9c5-1c31-4847-83c8-4951106a326c") : configmap "openstack-scripts" not found Mar 16 16:37:29 crc kubenswrapper[5120]: W0316 16:37:29.885274 5120 empty_dir.go:511] Warning: Unmount skipped because path does not exist: /var/lib/kubelet/pods/204ff621-b59e-44f0-84a5-c9e4eaaf86bf/volumes/kubernetes.io~secret/combined-ca-bundle Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.885293 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/204ff621-b59e-44f0-84a5-c9e4eaaf86bf-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "204ff621-b59e-44f0-84a5-c9e4eaaf86bf" (UID: "204ff621-b59e-44f0-84a5-c9e4eaaf86bf"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.886484 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/49fde0a2-0250-4ab2-92c6-e88c419aa313-config-data-default" (OuterVolumeSpecName: "config-data-default") pod "49fde0a2-0250-4ab2-92c6-e88c419aa313" (UID: "49fde0a2-0250-4ab2-92c6-e88c419aa313"). InnerVolumeSpecName "config-data-default". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.887311 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/49fde0a2-0250-4ab2-92c6-e88c419aa313-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "49fde0a2-0250-4ab2-92c6-e88c419aa313" (UID: "49fde0a2-0250-4ab2-92c6-e88c419aa313"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.887575 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49fde0a2-0250-4ab2-92c6-e88c419aa313-kube-api-access-bszrj" (OuterVolumeSpecName: "kube-api-access-bszrj") pod "49fde0a2-0250-4ab2-92c6-e88c419aa313" (UID: "49fde0a2-0250-4ab2-92c6-e88c419aa313"). InnerVolumeSpecName "kube-api-access-bszrj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.888246 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49fde0a2-0250-4ab2-92c6-e88c419aa313-config-data-generated" (OuterVolumeSpecName: "config-data-generated") pod "49fde0a2-0250-4ab2-92c6-e88c419aa313" (UID: "49fde0a2-0250-4ab2-92c6-e88c419aa313"). InnerVolumeSpecName "config-data-generated". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:37:29 crc kubenswrapper[5120]: E0316 16:37:29.892087 5120 projected.go:194] Error preparing data for projected volume kube-api-access-46bx8 for pod openstack-kuttl-tests/keystone-db-create-xfd9w: failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.892929 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/49fde0a2-0250-4ab2-92c6-e88c419aa313-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "49fde0a2-0250-4ab2-92c6-e88c419aa313" (UID: "49fde0a2-0250-4ab2-92c6-e88c419aa313"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:37:29 crc kubenswrapper[5120]: E0316 16:37:29.893590 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0742a9c5-1c31-4847-83c8-4951106a326c-kube-api-access-46bx8 podName:0742a9c5-1c31-4847-83c8-4951106a326c nodeName:}" failed. No retries permitted until 2026-03-16 16:37:31.892243789 +0000 UTC m=+3954.046175446 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-46bx8" (UniqueName: "kubernetes.io/projected/0742a9c5-1c31-4847-83c8-4951106a326c-kube-api-access-46bx8") pod "keystone-db-create-xfd9w" (UID: "0742a9c5-1c31-4847-83c8-4951106a326c") : failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.908012 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2cc5c2d3-3da0-4d0c-9541-78f0bf375648-memcached-tls-certs" (OuterVolumeSpecName: "memcached-tls-certs") pod "2cc5c2d3-3da0-4d0c-9541-78f0bf375648" (UID: "2cc5c2d3-3da0-4d0c-9541-78f0bf375648"). InnerVolumeSpecName "memcached-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.913307 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/adeefc4f-7632-4673-ae4f-0104e9e65d1d-ovn-northd-tls-certs" (OuterVolumeSpecName: "ovn-northd-tls-certs") pod "adeefc4f-7632-4673-ae4f-0104e9e65d1d" (UID: "adeefc4f-7632-4673-ae4f-0104e9e65d1d"). InnerVolumeSpecName "ovn-northd-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.915242 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage10-crc" (OuterVolumeSpecName: "mysql-db") pod "49fde0a2-0250-4ab2-92c6-e88c419aa313" (UID: "49fde0a2-0250-4ab2-92c6-e88c419aa313"). InnerVolumeSpecName "local-storage10-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.917984 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/204ff621-b59e-44f0-84a5-c9e4eaaf86bf-config-data" (OuterVolumeSpecName: "config-data") pod "204ff621-b59e-44f0-84a5-c9e4eaaf86bf" (UID: "204ff621-b59e-44f0-84a5-c9e4eaaf86bf"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.940016 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/49fde0a2-0250-4ab2-92c6-e88c419aa313-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "49fde0a2-0250-4ab2-92c6-e88c419aa313" (UID: "49fde0a2-0250-4ab2-92c6-e88c419aa313"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.941857 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/49fde0a2-0250-4ab2-92c6-e88c419aa313-galera-tls-certs" (OuterVolumeSpecName: "galera-tls-certs") pod "49fde0a2-0250-4ab2-92c6-e88c419aa313" (UID: "49fde0a2-0250-4ab2-92c6-e88c419aa313"). InnerVolumeSpecName "galera-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.986670 5120 reconciler_common.go:299] "Volume detached for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/2cc5c2d3-3da0-4d0c-9541-78f0bf375648-memcached-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.986711 5120 reconciler_common.go:299] "Volume detached for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/adeefc4f-7632-4673-ae4f-0104e9e65d1d-ovn-northd-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.986724 5120 reconciler_common.go:299] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/49fde0a2-0250-4ab2-92c6-e88c419aa313-kolla-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.986754 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") on node \"crc\" " Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.986787 5120 reconciler_common.go:299] "Volume detached for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/49fde0a2-0250-4ab2-92c6-e88c419aa313-galera-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.986801 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/49fde0a2-0250-4ab2-92c6-e88c419aa313-config-data-default\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.986813 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/49fde0a2-0250-4ab2-92c6-e88c419aa313-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.986825 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bszrj\" (UniqueName: \"kubernetes.io/projected/49fde0a2-0250-4ab2-92c6-e88c419aa313-kube-api-access-bszrj\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.986838 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/204ff621-b59e-44f0-84a5-c9e4eaaf86bf-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.986850 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/204ff621-b59e-44f0-84a5-c9e4eaaf86bf-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:29 crc kubenswrapper[5120]: E0316 16:37:29.986753 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-config-data: configmap "rabbitmq-config-data" not found Mar 16 16:37:29 crc kubenswrapper[5120]: E0316 16:37:29.986928 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a03095a2-0907-4be8-ac85-43befd648111-config-data podName:a03095a2-0907-4be8-ac85-43befd648111 nodeName:}" failed. No retries permitted until 2026-03-16 16:37:37.986910966 +0000 UTC m=+3960.140842623 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/a03095a2-0907-4be8-ac85-43befd648111-config-data") pod "rabbitmq-server-0" (UID: "a03095a2-0907-4be8-ac85-43befd648111") : configmap "rabbitmq-config-data" not found Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.986862 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/49fde0a2-0250-4ab2-92c6-e88c419aa313-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:29 crc kubenswrapper[5120]: I0316 16:37:29.986986 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/49fde0a2-0250-4ab2-92c6-e88c419aa313-config-data-generated\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.002450 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage10-crc" (UniqueName: "kubernetes.io/local-volume/local-storage10-crc") on node "crc" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.089491 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.157007 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.162848 5120 scope.go:117] "RemoveContainer" containerID="4d07b305ba120824ff17a907693b1904828557196542b5e99cb497424819b28d" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.224205 5120 scope.go:117] "RemoveContainer" containerID="9a27d15912e1cc741e22cfb7a94085d53ffa142b31ec587a9a16aeb99cd22f72" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.240261 5120 generic.go:358] "Generic (PLEG): container finished" podID="05e90410-2cfb-438d-95df-8b2a70319257" containerID="3f0d725b5803b997e34764d9eb46efc39619e2d518760dc404bedd35e77b5505" exitCode=0 Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.240296 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"05e90410-2cfb-438d-95df-8b2a70319257","Type":"ContainerDied","Data":"3f0d725b5803b997e34764d9eb46efc39619e2d518760dc404bedd35e77b5505"} Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.240367 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"05e90410-2cfb-438d-95df-8b2a70319257","Type":"ContainerDied","Data":"5386639494b23a12a89af0457eaa7079513fc27e60562f0c964be2194e198a87"} Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.240407 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.242515 5120 generic.go:358] "Generic (PLEG): container finished" podID="2cc5c2d3-3da0-4d0c-9541-78f0bf375648" containerID="6d1704088789e653abcbf79fddac9aafb1b85dd5351eeff9d35a0a4e7c2f3a76" exitCode=0 Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.242590 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.242667 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"2cc5c2d3-3da0-4d0c-9541-78f0bf375648","Type":"ContainerDied","Data":"6d1704088789e653abcbf79fddac9aafb1b85dd5351eeff9d35a0a4e7c2f3a76"} Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.242693 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"2cc5c2d3-3da0-4d0c-9541-78f0bf375648","Type":"ContainerDied","Data":"22a1b2bd8f23376d419b393135ec1f2f0655a30fa4c5781c022e10637b50ff05"} Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.247585 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-5f8nh" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.247611 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-5f8nh" event={"ID":"493341f2-da9f-4064-b028-e674200e264d","Type":"ContainerDied","Data":"506df5f327647fe2cd140a647747dcb7c580f10569815256e21c35bf3c563462"} Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.250323 5120 scope.go:117] "RemoveContainer" containerID="44e7b6079cc86a3539158acba20d48d6ecfc28308601a631870b3eea6c5a0e3d" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.256212 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-8t4vn" event={"ID":"e06e57b2-920d-463e-8607-2c1365c8c2e5","Type":"ContainerStarted","Data":"879bdb7a2180e55912537bf6753488771e521f58922f739dedb133892fb70585"} Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.256289 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-8t4vn" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.269374 5120 generic.go:358] "Generic (PLEG): container finished" podID="49fde0a2-0250-4ab2-92c6-e88c419aa313" containerID="79a3a517e19aaedf82517a946a3950f61bc6eb918aab15f9840833ae6e238d1d" exitCode=0 Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.269471 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.269487 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"49fde0a2-0250-4ab2-92c6-e88c419aa313","Type":"ContainerDied","Data":"79a3a517e19aaedf82517a946a3950f61bc6eb918aab15f9840833ae6e238d1d"} Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.269527 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"49fde0a2-0250-4ab2-92c6-e88c419aa313","Type":"ContainerDied","Data":"a4aeeb58592b7d7412d3f0a3387880a49b592d7141aa6011cf1b9eb71709944a"} Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.276283 5120 scope.go:117] "RemoveContainer" containerID="2306d3146bce8fb7711cda6f64816886e7c22d3b707e92faf4ccfb523dd60b48" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.278812 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-8t4vn" podStartSLOduration=9.278794233 podStartE2EDuration="9.278794233s" podCreationTimestamp="2026-03-16 16:37:21 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:37:30.274369187 +0000 UTC m=+3952.428300854" watchObservedRunningTime="2026-03-16 16:37:30.278794233 +0000 UTC m=+3952.432725890" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.294074 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/05e90410-2cfb-438d-95df-8b2a70319257-rabbitmq-tls\") pod \"05e90410-2cfb-438d-95df-8b2a70319257\" (UID: \"05e90410-2cfb-438d-95df-8b2a70319257\") " Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.294249 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/05e90410-2cfb-438d-95df-8b2a70319257-rabbitmq-erlang-cookie\") pod \"05e90410-2cfb-438d-95df-8b2a70319257\" (UID: \"05e90410-2cfb-438d-95df-8b2a70319257\") " Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.294296 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k8n8r\" (UniqueName: \"kubernetes.io/projected/05e90410-2cfb-438d-95df-8b2a70319257-kube-api-access-k8n8r\") pod \"05e90410-2cfb-438d-95df-8b2a70319257\" (UID: \"05e90410-2cfb-438d-95df-8b2a70319257\") " Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.294316 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/05e90410-2cfb-438d-95df-8b2a70319257-pod-info\") pod \"05e90410-2cfb-438d-95df-8b2a70319257\" (UID: \"05e90410-2cfb-438d-95df-8b2a70319257\") " Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.294406 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/05e90410-2cfb-438d-95df-8b2a70319257-config-data\") pod \"05e90410-2cfb-438d-95df-8b2a70319257\" (UID: \"05e90410-2cfb-438d-95df-8b2a70319257\") " Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.294448 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/05e90410-2cfb-438d-95df-8b2a70319257-rabbitmq-plugins\") pod \"05e90410-2cfb-438d-95df-8b2a70319257\" (UID: \"05e90410-2cfb-438d-95df-8b2a70319257\") " Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.294482 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"persistence\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"05e90410-2cfb-438d-95df-8b2a70319257\" (UID: \"05e90410-2cfb-438d-95df-8b2a70319257\") " Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.294561 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/05e90410-2cfb-438d-95df-8b2a70319257-plugins-conf\") pod \"05e90410-2cfb-438d-95df-8b2a70319257\" (UID: \"05e90410-2cfb-438d-95df-8b2a70319257\") " Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.294601 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/05e90410-2cfb-438d-95df-8b2a70319257-rabbitmq-confd\") pod \"05e90410-2cfb-438d-95df-8b2a70319257\" (UID: \"05e90410-2cfb-438d-95df-8b2a70319257\") " Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.294626 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/05e90410-2cfb-438d-95df-8b2a70319257-server-conf\") pod \"05e90410-2cfb-438d-95df-8b2a70319257\" (UID: \"05e90410-2cfb-438d-95df-8b2a70319257\") " Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.294676 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/05e90410-2cfb-438d-95df-8b2a70319257-erlang-cookie-secret\") pod \"05e90410-2cfb-438d-95df-8b2a70319257\" (UID: \"05e90410-2cfb-438d-95df-8b2a70319257\") " Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.295726 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05e90410-2cfb-438d-95df-8b2a70319257-rabbitmq-erlang-cookie" (OuterVolumeSpecName: "rabbitmq-erlang-cookie") pod "05e90410-2cfb-438d-95df-8b2a70319257" (UID: "05e90410-2cfb-438d-95df-8b2a70319257"). InnerVolumeSpecName "rabbitmq-erlang-cookie". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.302029 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05e90410-2cfb-438d-95df-8b2a70319257-rabbitmq-plugins" (OuterVolumeSpecName: "rabbitmq-plugins") pod "05e90410-2cfb-438d-95df-8b2a70319257" (UID: "05e90410-2cfb-438d-95df-8b2a70319257"). InnerVolumeSpecName "rabbitmq-plugins". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.302077 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/05e90410-2cfb-438d-95df-8b2a70319257-plugins-conf" (OuterVolumeSpecName: "plugins-conf") pod "05e90410-2cfb-438d-95df-8b2a70319257" (UID: "05e90410-2cfb-438d-95df-8b2a70319257"). InnerVolumeSpecName "plugins-conf". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.305604 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.305812 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"fa6ffb82-b871-4dae-b7c1-7880c90110a2","Type":"ContainerDied","Data":"ae0058a78c9b1eb1357f6523e225a131dd01af973403134c53d949d4da03d485"} Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.311612 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/05e90410-2cfb-438d-95df-8b2a70319257-erlang-cookie-secret" (OuterVolumeSpecName: "erlang-cookie-secret") pod "05e90410-2cfb-438d-95df-8b2a70319257" (UID: "05e90410-2cfb-438d-95df-8b2a70319257"). InnerVolumeSpecName "erlang-cookie-secret". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.314713 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.317555 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-northd-0_adeefc4f-7632-4673-ae4f-0104e9e65d1d/ovn-northd/0.log" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.317665 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"adeefc4f-7632-4673-ae4f-0104e9e65d1d","Type":"ContainerDied","Data":"764ff091d98b7b7ac9adc04b584728fb0aaecbdf34b6c11014ebdab665537c1d"} Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.317814 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.322882 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05e90410-2cfb-438d-95df-8b2a70319257-rabbitmq-tls" (OuterVolumeSpecName: "rabbitmq-tls") pod "05e90410-2cfb-438d-95df-8b2a70319257" (UID: "05e90410-2cfb-438d-95df-8b2a70319257"). InnerVolumeSpecName "rabbitmq-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.324423 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.334960 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05e90410-2cfb-438d-95df-8b2a70319257-kube-api-access-k8n8r" (OuterVolumeSpecName: "kube-api-access-k8n8r") pod "05e90410-2cfb-438d-95df-8b2a70319257" (UID: "05e90410-2cfb-438d-95df-8b2a70319257"). InnerVolumeSpecName "kube-api-access-k8n8r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.335026 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/05e90410-2cfb-438d-95df-8b2a70319257-pod-info" (OuterVolumeSpecName: "pod-info") pod "05e90410-2cfb-438d-95df-8b2a70319257" (UID: "05e90410-2cfb-438d-95df-8b2a70319257"). InnerVolumeSpecName "pod-info". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.335020 5120 generic.go:358] "Generic (PLEG): container finished" podID="a03095a2-0907-4be8-ac85-43befd648111" containerID="93f1e66b2d8a92540af9824e7c1323009a16554867a73716bc2e06eeaaea6d4a" exitCode=0 Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.335312 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.335326 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.335052 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"a03095a2-0907-4be8-ac85-43befd648111","Type":"ContainerDied","Data":"93f1e66b2d8a92540af9824e7c1323009a16554867a73716bc2e06eeaaea6d4a"} Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.336085 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-e1fd-account-create-update-nmc4b" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.345735 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-create-xfd9w" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.351523 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-5f8nh"] Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.356017 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage02-crc" (OuterVolumeSpecName: "persistence") pod "05e90410-2cfb-438d-95df-8b2a70319257" (UID: "05e90410-2cfb-438d-95df-8b2a70319257"). InnerVolumeSpecName "local-storage02-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.356827 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-5f8nh"] Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.365411 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.367537 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/05e90410-2cfb-438d-95df-8b2a70319257-config-data" (OuterVolumeSpecName: "config-data") pod "05e90410-2cfb-438d-95df-8b2a70319257" (UID: "05e90410-2cfb-438d-95df-8b2a70319257"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.395353 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.397029 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/05e90410-2cfb-438d-95df-8b2a70319257-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.397064 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/05e90410-2cfb-438d-95df-8b2a70319257-rabbitmq-plugins\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.397098 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") on node \"crc\" " Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.397121 5120 reconciler_common.go:299] "Volume detached for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/05e90410-2cfb-438d-95df-8b2a70319257-plugins-conf\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.397134 5120 reconciler_common.go:299] "Volume detached for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/05e90410-2cfb-438d-95df-8b2a70319257-erlang-cookie-secret\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.397146 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/05e90410-2cfb-438d-95df-8b2a70319257-rabbitmq-tls\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.397157 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/05e90410-2cfb-438d-95df-8b2a70319257-rabbitmq-erlang-cookie\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.397170 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k8n8r\" (UniqueName: \"kubernetes.io/projected/05e90410-2cfb-438d-95df-8b2a70319257-kube-api-access-k8n8r\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.397179 5120 reconciler_common.go:299] "Volume detached for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/05e90410-2cfb-438d-95df-8b2a70319257-pod-info\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.397401 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/05e90410-2cfb-438d-95df-8b2a70319257-server-conf" (OuterVolumeSpecName: "server-conf") pod "05e90410-2cfb-438d-95df-8b2a70319257" (UID: "05e90410-2cfb-438d-95df-8b2a70319257"). InnerVolumeSpecName "server-conf". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.419401 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage02-crc" (UniqueName: "kubernetes.io/local-volume/local-storage02-crc") on node "crc" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.443507 5120 scope.go:117] "RemoveContainer" containerID="41f454bf946ac8b5e6eb01d2b76a6ba9b4a70c8ff253b18b28f9a9d124862394" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.455692 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05e90410-2cfb-438d-95df-8b2a70319257-rabbitmq-confd" (OuterVolumeSpecName: "rabbitmq-confd") pod "05e90410-2cfb-438d-95df-8b2a70319257" (UID: "05e90410-2cfb-438d-95df-8b2a70319257"). InnerVolumeSpecName "rabbitmq-confd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.472996 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-e1fd-account-create-update-nmc4b"] Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.481960 5120 scope.go:117] "RemoveContainer" containerID="795e30c34b62032be16391622f118baf7553199f7ee7e1d67d0c47f46f0d7158" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.483553 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-e1fd-account-create-update-nmc4b"] Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.498954 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.498997 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/05e90410-2cfb-438d-95df-8b2a70319257-rabbitmq-confd\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.499011 5120 reconciler_common.go:299] "Volume detached for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/05e90410-2cfb-438d-95df-8b2a70319257-server-conf\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.498958 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.508859 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.519134 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.529464 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.538741 5120 scope.go:117] "RemoveContainer" containerID="d574b3982ee170745544121427c41d12f2d53fcc93af40baff6d3f7c253ab3ac" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.538866 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.547162 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.553650 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.560084 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.571219 5120 scope.go:117] "RemoveContainer" containerID="f0d16f15c665ac87c4f2bfdb75caedf4162b54c8ca025a4be8306c702849e280" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.571551 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.579116 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-db-create-xfd9w"] Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.585251 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-db-create-xfd9w"] Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.590405 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.602525 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8tr5m\" (UniqueName: \"kubernetes.io/projected/96ed605f-5db1-41a5-a646-7b8ad1150a29-kube-api-access-8tr5m\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.602572 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/96ed605f-5db1-41a5-a646-7b8ad1150a29-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.603935 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.604377 5120 scope.go:117] "RemoveContainer" containerID="d574b3982ee170745544121427c41d12f2d53fcc93af40baff6d3f7c253ab3ac" Mar 16 16:37:30 crc kubenswrapper[5120]: E0316 16:37:30.605461 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d574b3982ee170745544121427c41d12f2d53fcc93af40baff6d3f7c253ab3ac\": container with ID starting with d574b3982ee170745544121427c41d12f2d53fcc93af40baff6d3f7c253ab3ac not found: ID does not exist" containerID="d574b3982ee170745544121427c41d12f2d53fcc93af40baff6d3f7c253ab3ac" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.605544 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d574b3982ee170745544121427c41d12f2d53fcc93af40baff6d3f7c253ab3ac"} err="failed to get container status \"d574b3982ee170745544121427c41d12f2d53fcc93af40baff6d3f7c253ab3ac\": rpc error: code = NotFound desc = could not find container \"d574b3982ee170745544121427c41d12f2d53fcc93af40baff6d3f7c253ab3ac\": container with ID starting with d574b3982ee170745544121427c41d12f2d53fcc93af40baff6d3f7c253ab3ac not found: ID does not exist" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.605605 5120 scope.go:117] "RemoveContainer" containerID="f0d16f15c665ac87c4f2bfdb75caedf4162b54c8ca025a4be8306c702849e280" Mar 16 16:37:30 crc kubenswrapper[5120]: E0316 16:37:30.606236 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f0d16f15c665ac87c4f2bfdb75caedf4162b54c8ca025a4be8306c702849e280\": container with ID starting with f0d16f15c665ac87c4f2bfdb75caedf4162b54c8ca025a4be8306c702849e280 not found: ID does not exist" containerID="f0d16f15c665ac87c4f2bfdb75caedf4162b54c8ca025a4be8306c702849e280" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.606259 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0d16f15c665ac87c4f2bfdb75caedf4162b54c8ca025a4be8306c702849e280"} err="failed to get container status \"f0d16f15c665ac87c4f2bfdb75caedf4162b54c8ca025a4be8306c702849e280\": rpc error: code = NotFound desc = could not find container \"f0d16f15c665ac87c4f2bfdb75caedf4162b54c8ca025a4be8306c702849e280\": container with ID starting with f0d16f15c665ac87c4f2bfdb75caedf4162b54c8ca025a4be8306c702849e280 not found: ID does not exist" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.606278 5120 scope.go:117] "RemoveContainer" containerID="7e7209b2abecef7c5b6b8a3d982cdcbbdf7eef3a5a6dd06c0ebe7c5bba967530" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.637647 5120 scope.go:117] "RemoveContainer" containerID="678053afacd3e13cea1a0ce33b3fda6c71f1a6af75e6150d8d60f0c54803af1d" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.663901 5120 scope.go:117] "RemoveContainer" containerID="4d07b305ba120824ff17a907693b1904828557196542b5e99cb497424819b28d" Mar 16 16:37:30 crc kubenswrapper[5120]: E0316 16:37:30.664417 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d07b305ba120824ff17a907693b1904828557196542b5e99cb497424819b28d\": container with ID starting with 4d07b305ba120824ff17a907693b1904828557196542b5e99cb497424819b28d not found: ID does not exist" containerID="4d07b305ba120824ff17a907693b1904828557196542b5e99cb497424819b28d" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.664455 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d07b305ba120824ff17a907693b1904828557196542b5e99cb497424819b28d"} err="failed to get container status \"4d07b305ba120824ff17a907693b1904828557196542b5e99cb497424819b28d\": rpc error: code = NotFound desc = could not find container \"4d07b305ba120824ff17a907693b1904828557196542b5e99cb497424819b28d\": container with ID starting with 4d07b305ba120824ff17a907693b1904828557196542b5e99cb497424819b28d not found: ID does not exist" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.664481 5120 scope.go:117] "RemoveContainer" containerID="9a27d15912e1cc741e22cfb7a94085d53ffa142b31ec587a9a16aeb99cd22f72" Mar 16 16:37:30 crc kubenswrapper[5120]: E0316 16:37:30.664901 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a27d15912e1cc741e22cfb7a94085d53ffa142b31ec587a9a16aeb99cd22f72\": container with ID starting with 9a27d15912e1cc741e22cfb7a94085d53ffa142b31ec587a9a16aeb99cd22f72 not found: ID does not exist" containerID="9a27d15912e1cc741e22cfb7a94085d53ffa142b31ec587a9a16aeb99cd22f72" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.664923 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a27d15912e1cc741e22cfb7a94085d53ffa142b31ec587a9a16aeb99cd22f72"} err="failed to get container status \"9a27d15912e1cc741e22cfb7a94085d53ffa142b31ec587a9a16aeb99cd22f72\": rpc error: code = NotFound desc = could not find container \"9a27d15912e1cc741e22cfb7a94085d53ffa142b31ec587a9a16aeb99cd22f72\": container with ID starting with 9a27d15912e1cc741e22cfb7a94085d53ffa142b31ec587a9a16aeb99cd22f72 not found: ID does not exist" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.664940 5120 scope.go:117] "RemoveContainer" containerID="7bdd3c9904ff978a4ff90478697f43df053f05e42e235f1b924d00f8b65b050e" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.674809 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="05e90410-2cfb-438d-95df-8b2a70319257" path="/var/lib/kubelet/pods/05e90410-2cfb-438d-95df-8b2a70319257/volumes" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.675650 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="06e4bc0a-e757-40b7-8ed8-693dd20c185a" path="/var/lib/kubelet/pods/06e4bc0a-e757-40b7-8ed8-693dd20c185a/volumes" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.676486 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0742a9c5-1c31-4847-83c8-4951106a326c" path="/var/lib/kubelet/pods/0742a9c5-1c31-4847-83c8-4951106a326c/volumes" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.677333 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="204ff621-b59e-44f0-84a5-c9e4eaaf86bf" path="/var/lib/kubelet/pods/204ff621-b59e-44f0-84a5-c9e4eaaf86bf/volumes" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.678502 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2cc5c2d3-3da0-4d0c-9541-78f0bf375648" path="/var/lib/kubelet/pods/2cc5c2d3-3da0-4d0c-9541-78f0bf375648/volumes" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.679013 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2fbd9119-d73e-4c1e-99b9-8f078e2acdfb" path="/var/lib/kubelet/pods/2fbd9119-d73e-4c1e-99b9-8f078e2acdfb/volumes" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.680093 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="493341f2-da9f-4064-b028-e674200e264d" path="/var/lib/kubelet/pods/493341f2-da9f-4064-b028-e674200e264d/volumes" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.680614 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="49fde0a2-0250-4ab2-92c6-e88c419aa313" path="/var/lib/kubelet/pods/49fde0a2-0250-4ab2-92c6-e88c419aa313/volumes" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.681368 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8822fee9-42fe-47d7-a898-22d38c991abd" path="/var/lib/kubelet/pods/8822fee9-42fe-47d7-a898-22d38c991abd/volumes" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.682320 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="96ed605f-5db1-41a5-a646-7b8ad1150a29" path="/var/lib/kubelet/pods/96ed605f-5db1-41a5-a646-7b8ad1150a29/volumes" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.682725 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="adeefc4f-7632-4673-ae4f-0104e9e65d1d" path="/var/lib/kubelet/pods/adeefc4f-7632-4673-ae4f-0104e9e65d1d/volumes" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.683040 5120 scope.go:117] "RemoveContainer" containerID="1604809a163c3a45d1f5089abbf755702fb43f108aed43a0f5fcc594471fc047" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.683437 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba60a8bc-6bab-44a3-9e77-6720ea009a57" path="/var/lib/kubelet/pods/ba60a8bc-6bab-44a3-9e77-6720ea009a57/volumes" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.684742 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="be8b10ce-e42f-4650-bc2f-96fe51dc224c" path="/var/lib/kubelet/pods/be8b10ce-e42f-4650-bc2f-96fe51dc224c/volumes" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.685567 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc7435f2-f650-416c-b0db-53082105f13b" path="/var/lib/kubelet/pods/dc7435f2-f650-416c-b0db-53082105f13b/volumes" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.686034 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fa6ffb82-b871-4dae-b7c1-7880c90110a2" path="/var/lib/kubelet/pods/fa6ffb82-b871-4dae-b7c1-7880c90110a2/volumes" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.687613 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fb843f09-58b3-467f-8c61-f9cad54c7b55" path="/var/lib/kubelet/pods/fb843f09-58b3-467f-8c61-f9cad54c7b55/volumes" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.703253 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/a03095a2-0907-4be8-ac85-43befd648111-plugins-conf\") pod \"a03095a2-0907-4be8-ac85-43befd648111\" (UID: \"a03095a2-0907-4be8-ac85-43befd648111\") " Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.703299 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/a03095a2-0907-4be8-ac85-43befd648111-rabbitmq-confd\") pod \"a03095a2-0907-4be8-ac85-43befd648111\" (UID: \"a03095a2-0907-4be8-ac85-43befd648111\") " Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.703549 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/a03095a2-0907-4be8-ac85-43befd648111-rabbitmq-tls\") pod \"a03095a2-0907-4be8-ac85-43befd648111\" (UID: \"a03095a2-0907-4be8-ac85-43befd648111\") " Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.703584 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/a03095a2-0907-4be8-ac85-43befd648111-rabbitmq-erlang-cookie\") pod \"a03095a2-0907-4be8-ac85-43befd648111\" (UID: \"a03095a2-0907-4be8-ac85-43befd648111\") " Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.703640 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/a03095a2-0907-4be8-ac85-43befd648111-rabbitmq-plugins\") pod \"a03095a2-0907-4be8-ac85-43befd648111\" (UID: \"a03095a2-0907-4be8-ac85-43befd648111\") " Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.703675 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/a03095a2-0907-4be8-ac85-43befd648111-config-data\") pod \"a03095a2-0907-4be8-ac85-43befd648111\" (UID: \"a03095a2-0907-4be8-ac85-43befd648111\") " Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.703703 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a03095a2-0907-4be8-ac85-43befd648111-plugins-conf" (OuterVolumeSpecName: "plugins-conf") pod "a03095a2-0907-4be8-ac85-43befd648111" (UID: "a03095a2-0907-4be8-ac85-43befd648111"). InnerVolumeSpecName "plugins-conf". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.703903 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/a03095a2-0907-4be8-ac85-43befd648111-erlang-cookie-secret\") pod \"a03095a2-0907-4be8-ac85-43befd648111\" (UID: \"a03095a2-0907-4be8-ac85-43befd648111\") " Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.703956 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/a03095a2-0907-4be8-ac85-43befd648111-pod-info\") pod \"a03095a2-0907-4be8-ac85-43befd648111\" (UID: \"a03095a2-0907-4be8-ac85-43befd648111\") " Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.704141 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lgrsr\" (UniqueName: \"kubernetes.io/projected/a03095a2-0907-4be8-ac85-43befd648111-kube-api-access-lgrsr\") pod \"a03095a2-0907-4be8-ac85-43befd648111\" (UID: \"a03095a2-0907-4be8-ac85-43befd648111\") " Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.704236 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/a03095a2-0907-4be8-ac85-43befd648111-server-conf\") pod \"a03095a2-0907-4be8-ac85-43befd648111\" (UID: \"a03095a2-0907-4be8-ac85-43befd648111\") " Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.704234 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a03095a2-0907-4be8-ac85-43befd648111-rabbitmq-erlang-cookie" (OuterVolumeSpecName: "rabbitmq-erlang-cookie") pod "a03095a2-0907-4be8-ac85-43befd648111" (UID: "a03095a2-0907-4be8-ac85-43befd648111"). InnerVolumeSpecName "rabbitmq-erlang-cookie". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.704259 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"persistence\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"a03095a2-0907-4be8-ac85-43befd648111\" (UID: \"a03095a2-0907-4be8-ac85-43befd648111\") " Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.704358 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a03095a2-0907-4be8-ac85-43befd648111-rabbitmq-plugins" (OuterVolumeSpecName: "rabbitmq-plugins") pod "a03095a2-0907-4be8-ac85-43befd648111" (UID: "a03095a2-0907-4be8-ac85-43befd648111"). InnerVolumeSpecName "rabbitmq-plugins". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.704998 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-46bx8\" (UniqueName: \"kubernetes.io/projected/0742a9c5-1c31-4847-83c8-4951106a326c-kube-api-access-46bx8\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.705026 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/a03095a2-0907-4be8-ac85-43befd648111-rabbitmq-erlang-cookie\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.705039 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/a03095a2-0907-4be8-ac85-43befd648111-rabbitmq-plugins\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.705050 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0742a9c5-1c31-4847-83c8-4951106a326c-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.705061 5120 reconciler_common.go:299] "Volume detached for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/a03095a2-0907-4be8-ac85-43befd648111-plugins-conf\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.707713 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a03095a2-0907-4be8-ac85-43befd648111-erlang-cookie-secret" (OuterVolumeSpecName: "erlang-cookie-secret") pod "a03095a2-0907-4be8-ac85-43befd648111" (UID: "a03095a2-0907-4be8-ac85-43befd648111"). InnerVolumeSpecName "erlang-cookie-secret". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.708040 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a03095a2-0907-4be8-ac85-43befd648111-kube-api-access-lgrsr" (OuterVolumeSpecName: "kube-api-access-lgrsr") pod "a03095a2-0907-4be8-ac85-43befd648111" (UID: "a03095a2-0907-4be8-ac85-43befd648111"). InnerVolumeSpecName "kube-api-access-lgrsr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.708498 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a03095a2-0907-4be8-ac85-43befd648111-rabbitmq-tls" (OuterVolumeSpecName: "rabbitmq-tls") pod "a03095a2-0907-4be8-ac85-43befd648111" (UID: "a03095a2-0907-4be8-ac85-43befd648111"). InnerVolumeSpecName "rabbitmq-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.708850 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a03095a2-0907-4be8-ac85-43befd648111-pod-info" (OuterVolumeSpecName: "pod-info") pod "a03095a2-0907-4be8-ac85-43befd648111" (UID: "a03095a2-0907-4be8-ac85-43befd648111"). InnerVolumeSpecName "pod-info". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.709011 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage03-crc" (OuterVolumeSpecName: "persistence") pod "a03095a2-0907-4be8-ac85-43befd648111" (UID: "a03095a2-0907-4be8-ac85-43befd648111"). InnerVolumeSpecName "local-storage03-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.709537 5120 scope.go:117] "RemoveContainer" containerID="7bdd3c9904ff978a4ff90478697f43df053f05e42e235f1b924d00f8b65b050e" Mar 16 16:37:30 crc kubenswrapper[5120]: E0316 16:37:30.710155 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7bdd3c9904ff978a4ff90478697f43df053f05e42e235f1b924d00f8b65b050e\": container with ID starting with 7bdd3c9904ff978a4ff90478697f43df053f05e42e235f1b924d00f8b65b050e not found: ID does not exist" containerID="7bdd3c9904ff978a4ff90478697f43df053f05e42e235f1b924d00f8b65b050e" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.710188 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7bdd3c9904ff978a4ff90478697f43df053f05e42e235f1b924d00f8b65b050e"} err="failed to get container status \"7bdd3c9904ff978a4ff90478697f43df053f05e42e235f1b924d00f8b65b050e\": rpc error: code = NotFound desc = could not find container \"7bdd3c9904ff978a4ff90478697f43df053f05e42e235f1b924d00f8b65b050e\": container with ID starting with 7bdd3c9904ff978a4ff90478697f43df053f05e42e235f1b924d00f8b65b050e not found: ID does not exist" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.710209 5120 scope.go:117] "RemoveContainer" containerID="1604809a163c3a45d1f5089abbf755702fb43f108aed43a0f5fcc594471fc047" Mar 16 16:37:30 crc kubenswrapper[5120]: E0316 16:37:30.710443 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1604809a163c3a45d1f5089abbf755702fb43f108aed43a0f5fcc594471fc047\": container with ID starting with 1604809a163c3a45d1f5089abbf755702fb43f108aed43a0f5fcc594471fc047 not found: ID does not exist" containerID="1604809a163c3a45d1f5089abbf755702fb43f108aed43a0f5fcc594471fc047" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.710468 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1604809a163c3a45d1f5089abbf755702fb43f108aed43a0f5fcc594471fc047"} err="failed to get container status \"1604809a163c3a45d1f5089abbf755702fb43f108aed43a0f5fcc594471fc047\": rpc error: code = NotFound desc = could not find container \"1604809a163c3a45d1f5089abbf755702fb43f108aed43a0f5fcc594471fc047\": container with ID starting with 1604809a163c3a45d1f5089abbf755702fb43f108aed43a0f5fcc594471fc047 not found: ID does not exist" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.710480 5120 scope.go:117] "RemoveContainer" containerID="3f0d725b5803b997e34764d9eb46efc39619e2d518760dc404bedd35e77b5505" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.722705 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a03095a2-0907-4be8-ac85-43befd648111-config-data" (OuterVolumeSpecName: "config-data") pod "a03095a2-0907-4be8-ac85-43befd648111" (UID: "a03095a2-0907-4be8-ac85-43befd648111"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.733556 5120 scope.go:117] "RemoveContainer" containerID="c81e95f5038d7d226294b881d501dd9e830cf87edf6aba2428d1ad4470cca082" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.744849 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a03095a2-0907-4be8-ac85-43befd648111-server-conf" (OuterVolumeSpecName: "server-conf") pod "a03095a2-0907-4be8-ac85-43befd648111" (UID: "a03095a2-0907-4be8-ac85-43befd648111"). InnerVolumeSpecName "server-conf". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.754652 5120 scope.go:117] "RemoveContainer" containerID="3f0d725b5803b997e34764d9eb46efc39619e2d518760dc404bedd35e77b5505" Mar 16 16:37:30 crc kubenswrapper[5120]: E0316 16:37:30.755038 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f0d725b5803b997e34764d9eb46efc39619e2d518760dc404bedd35e77b5505\": container with ID starting with 3f0d725b5803b997e34764d9eb46efc39619e2d518760dc404bedd35e77b5505 not found: ID does not exist" containerID="3f0d725b5803b997e34764d9eb46efc39619e2d518760dc404bedd35e77b5505" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.755073 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f0d725b5803b997e34764d9eb46efc39619e2d518760dc404bedd35e77b5505"} err="failed to get container status \"3f0d725b5803b997e34764d9eb46efc39619e2d518760dc404bedd35e77b5505\": rpc error: code = NotFound desc = could not find container \"3f0d725b5803b997e34764d9eb46efc39619e2d518760dc404bedd35e77b5505\": container with ID starting with 3f0d725b5803b997e34764d9eb46efc39619e2d518760dc404bedd35e77b5505 not found: ID does not exist" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.755095 5120 scope.go:117] "RemoveContainer" containerID="c81e95f5038d7d226294b881d501dd9e830cf87edf6aba2428d1ad4470cca082" Mar 16 16:37:30 crc kubenswrapper[5120]: E0316 16:37:30.755469 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c81e95f5038d7d226294b881d501dd9e830cf87edf6aba2428d1ad4470cca082\": container with ID starting with c81e95f5038d7d226294b881d501dd9e830cf87edf6aba2428d1ad4470cca082 not found: ID does not exist" containerID="c81e95f5038d7d226294b881d501dd9e830cf87edf6aba2428d1ad4470cca082" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.755496 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c81e95f5038d7d226294b881d501dd9e830cf87edf6aba2428d1ad4470cca082"} err="failed to get container status \"c81e95f5038d7d226294b881d501dd9e830cf87edf6aba2428d1ad4470cca082\": rpc error: code = NotFound desc = could not find container \"c81e95f5038d7d226294b881d501dd9e830cf87edf6aba2428d1ad4470cca082\": container with ID starting with c81e95f5038d7d226294b881d501dd9e830cf87edf6aba2428d1ad4470cca082 not found: ID does not exist" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.755513 5120 scope.go:117] "RemoveContainer" containerID="6d1704088789e653abcbf79fddac9aafb1b85dd5351eeff9d35a0a4e7c2f3a76" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.778627 5120 scope.go:117] "RemoveContainer" containerID="6d1704088789e653abcbf79fddac9aafb1b85dd5351eeff9d35a0a4e7c2f3a76" Mar 16 16:37:30 crc kubenswrapper[5120]: E0316 16:37:30.779115 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d1704088789e653abcbf79fddac9aafb1b85dd5351eeff9d35a0a4e7c2f3a76\": container with ID starting with 6d1704088789e653abcbf79fddac9aafb1b85dd5351eeff9d35a0a4e7c2f3a76 not found: ID does not exist" containerID="6d1704088789e653abcbf79fddac9aafb1b85dd5351eeff9d35a0a4e7c2f3a76" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.779150 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d1704088789e653abcbf79fddac9aafb1b85dd5351eeff9d35a0a4e7c2f3a76"} err="failed to get container status \"6d1704088789e653abcbf79fddac9aafb1b85dd5351eeff9d35a0a4e7c2f3a76\": rpc error: code = NotFound desc = could not find container \"6d1704088789e653abcbf79fddac9aafb1b85dd5351eeff9d35a0a4e7c2f3a76\": container with ID starting with 6d1704088789e653abcbf79fddac9aafb1b85dd5351eeff9d35a0a4e7c2f3a76 not found: ID does not exist" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.779172 5120 scope.go:117] "RemoveContainer" containerID="79a3a517e19aaedf82517a946a3950f61bc6eb918aab15f9840833ae6e238d1d" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.783603 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a03095a2-0907-4be8-ac85-43befd648111-rabbitmq-confd" (OuterVolumeSpecName: "rabbitmq-confd") pod "a03095a2-0907-4be8-ac85-43befd648111" (UID: "a03095a2-0907-4be8-ac85-43befd648111"). InnerVolumeSpecName "rabbitmq-confd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.801461 5120 scope.go:117] "RemoveContainer" containerID="e2c2ea5d5676a4a91547a32d6859178f558c834eafca188cc3dfcb7c21ce8283" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.807144 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lgrsr\" (UniqueName: \"kubernetes.io/projected/a03095a2-0907-4be8-ac85-43befd648111-kube-api-access-lgrsr\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.807191 5120 reconciler_common.go:299] "Volume detached for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/a03095a2-0907-4be8-ac85-43befd648111-server-conf\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.807217 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") on node \"crc\" " Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.807231 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/a03095a2-0907-4be8-ac85-43befd648111-rabbitmq-confd\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.807241 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/a03095a2-0907-4be8-ac85-43befd648111-rabbitmq-tls\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.807252 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/a03095a2-0907-4be8-ac85-43befd648111-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.807283 5120 reconciler_common.go:299] "Volume detached for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/a03095a2-0907-4be8-ac85-43befd648111-erlang-cookie-secret\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.807294 5120 reconciler_common.go:299] "Volume detached for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/a03095a2-0907-4be8-ac85-43befd648111-pod-info\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.835899 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage03-crc" (UniqueName: "kubernetes.io/local-volume/local-storage03-crc") on node "crc" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.856424 5120 scope.go:117] "RemoveContainer" containerID="79a3a517e19aaedf82517a946a3950f61bc6eb918aab15f9840833ae6e238d1d" Mar 16 16:37:30 crc kubenswrapper[5120]: E0316 16:37:30.856856 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"79a3a517e19aaedf82517a946a3950f61bc6eb918aab15f9840833ae6e238d1d\": container with ID starting with 79a3a517e19aaedf82517a946a3950f61bc6eb918aab15f9840833ae6e238d1d not found: ID does not exist" containerID="79a3a517e19aaedf82517a946a3950f61bc6eb918aab15f9840833ae6e238d1d" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.856899 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79a3a517e19aaedf82517a946a3950f61bc6eb918aab15f9840833ae6e238d1d"} err="failed to get container status \"79a3a517e19aaedf82517a946a3950f61bc6eb918aab15f9840833ae6e238d1d\": rpc error: code = NotFound desc = could not find container \"79a3a517e19aaedf82517a946a3950f61bc6eb918aab15f9840833ae6e238d1d\": container with ID starting with 79a3a517e19aaedf82517a946a3950f61bc6eb918aab15f9840833ae6e238d1d not found: ID does not exist" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.856924 5120 scope.go:117] "RemoveContainer" containerID="e2c2ea5d5676a4a91547a32d6859178f558c834eafca188cc3dfcb7c21ce8283" Mar 16 16:37:30 crc kubenswrapper[5120]: E0316 16:37:30.857465 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e2c2ea5d5676a4a91547a32d6859178f558c834eafca188cc3dfcb7c21ce8283\": container with ID starting with e2c2ea5d5676a4a91547a32d6859178f558c834eafca188cc3dfcb7c21ce8283 not found: ID does not exist" containerID="e2c2ea5d5676a4a91547a32d6859178f558c834eafca188cc3dfcb7c21ce8283" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.857522 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e2c2ea5d5676a4a91547a32d6859178f558c834eafca188cc3dfcb7c21ce8283"} err="failed to get container status \"e2c2ea5d5676a4a91547a32d6859178f558c834eafca188cc3dfcb7c21ce8283\": rpc error: code = NotFound desc = could not find container \"e2c2ea5d5676a4a91547a32d6859178f558c834eafca188cc3dfcb7c21ce8283\": container with ID starting with e2c2ea5d5676a4a91547a32d6859178f558c834eafca188cc3dfcb7c21ce8283 not found: ID does not exist" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.857553 5120 scope.go:117] "RemoveContainer" containerID="aef5b61853adbdead35cca539e19363cb4263f66d2d389dbe393593c6574a066" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.909335 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.916518 5120 scope.go:117] "RemoveContainer" containerID="7b272a2c6ee74f384df1440a6b8dba3da112cef47111a781a3b1bb1cb0c90d7c" Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.947516 5120 scope.go:117] "RemoveContainer" containerID="e721f5e109c58db9c89bf8981961ec04fbce03cce2818b300c8d7256493e363b" Mar 16 16:37:30 crc kubenswrapper[5120]: E0316 16:37:30.969573 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="1502302cf5fdfbaedff9cdb3378e080511758ed3133fd93311514c3312d06191" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:37:30 crc kubenswrapper[5120]: E0316 16:37:30.971166 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="1502302cf5fdfbaedff9cdb3378e080511758ed3133fd93311514c3312d06191" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:37:30 crc kubenswrapper[5120]: I0316 16:37:30.972563 5120 scope.go:117] "RemoveContainer" containerID="da5b7b3662dbec12f059c3403e92b3f66241a0648ce9cb26b0e022725a195476" Mar 16 16:37:30 crc kubenswrapper[5120]: E0316 16:37:30.972702 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="1502302cf5fdfbaedff9cdb3378e080511758ed3133fd93311514c3312d06191" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:37:30 crc kubenswrapper[5120]: E0316 16:37:30.972798 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="e9337f85-3f26-46e9-bbf3-ea53f581eab6" containerName="nova-cell1-conductor-conductor" probeResult="unknown" Mar 16 16:37:31 crc kubenswrapper[5120]: I0316 16:37:31.352153 5120 generic.go:358] "Generic (PLEG): container finished" podID="864a1551-0ebe-4575-afc8-964686953825" containerID="ec7b51b54a8b71d545b522da56c31ac094ce43134f2779b01ffbc26bcfb07d05" exitCode=0 Mar 16 16:37:31 crc kubenswrapper[5120]: I0316 16:37:31.352218 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-5769b4cdff-x2jfw" event={"ID":"864a1551-0ebe-4575-afc8-964686953825","Type":"ContainerDied","Data":"ec7b51b54a8b71d545b522da56c31ac094ce43134f2779b01ffbc26bcfb07d05"} Mar 16 16:37:31 crc kubenswrapper[5120]: I0316 16:37:31.363670 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:37:31 crc kubenswrapper[5120]: I0316 16:37:31.363828 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"a03095a2-0907-4be8-ac85-43befd648111","Type":"ContainerDied","Data":"bbcd170cc2e9b97e08745dcc85e6d4dfcae3c911719f07221c51d0d7499b33d8"} Mar 16 16:37:31 crc kubenswrapper[5120]: I0316 16:37:31.363899 5120 scope.go:117] "RemoveContainer" containerID="93f1e66b2d8a92540af9824e7c1323009a16554867a73716bc2e06eeaaea6d4a" Mar 16 16:37:31 crc kubenswrapper[5120]: I0316 16:37:31.384088 5120 scope.go:117] "RemoveContainer" containerID="92fec9271b324df350d5b12d702dd5be44b1de1d7ed388b9fcff65b549278624" Mar 16 16:37:31 crc kubenswrapper[5120]: I0316 16:37:31.415372 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 16:37:31 crc kubenswrapper[5120]: I0316 16:37:31.423221 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 16:37:31 crc kubenswrapper[5120]: I0316 16:37:31.641747 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-5769b4cdff-x2jfw" Mar 16 16:37:31 crc kubenswrapper[5120]: I0316 16:37:31.831504 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/864a1551-0ebe-4575-afc8-964686953825-credential-keys\") pod \"864a1551-0ebe-4575-afc8-964686953825\" (UID: \"864a1551-0ebe-4575-afc8-964686953825\") " Mar 16 16:37:31 crc kubenswrapper[5120]: I0316 16:37:31.831624 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/864a1551-0ebe-4575-afc8-964686953825-public-tls-certs\") pod \"864a1551-0ebe-4575-afc8-964686953825\" (UID: \"864a1551-0ebe-4575-afc8-964686953825\") " Mar 16 16:37:31 crc kubenswrapper[5120]: I0316 16:37:31.831684 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/864a1551-0ebe-4575-afc8-964686953825-config-data\") pod \"864a1551-0ebe-4575-afc8-964686953825\" (UID: \"864a1551-0ebe-4575-afc8-964686953825\") " Mar 16 16:37:31 crc kubenswrapper[5120]: I0316 16:37:31.831789 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s7khf\" (UniqueName: \"kubernetes.io/projected/864a1551-0ebe-4575-afc8-964686953825-kube-api-access-s7khf\") pod \"864a1551-0ebe-4575-afc8-964686953825\" (UID: \"864a1551-0ebe-4575-afc8-964686953825\") " Mar 16 16:37:31 crc kubenswrapper[5120]: I0316 16:37:31.831869 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/864a1551-0ebe-4575-afc8-964686953825-internal-tls-certs\") pod \"864a1551-0ebe-4575-afc8-964686953825\" (UID: \"864a1551-0ebe-4575-afc8-964686953825\") " Mar 16 16:37:31 crc kubenswrapper[5120]: I0316 16:37:31.832109 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/864a1551-0ebe-4575-afc8-964686953825-fernet-keys\") pod \"864a1551-0ebe-4575-afc8-964686953825\" (UID: \"864a1551-0ebe-4575-afc8-964686953825\") " Mar 16 16:37:31 crc kubenswrapper[5120]: I0316 16:37:31.832181 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/864a1551-0ebe-4575-afc8-964686953825-scripts\") pod \"864a1551-0ebe-4575-afc8-964686953825\" (UID: \"864a1551-0ebe-4575-afc8-964686953825\") " Mar 16 16:37:31 crc kubenswrapper[5120]: I0316 16:37:31.832338 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/864a1551-0ebe-4575-afc8-964686953825-combined-ca-bundle\") pod \"864a1551-0ebe-4575-afc8-964686953825\" (UID: \"864a1551-0ebe-4575-afc8-964686953825\") " Mar 16 16:37:31 crc kubenswrapper[5120]: I0316 16:37:31.837630 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/864a1551-0ebe-4575-afc8-964686953825-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "864a1551-0ebe-4575-afc8-964686953825" (UID: "864a1551-0ebe-4575-afc8-964686953825"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:31 crc kubenswrapper[5120]: I0316 16:37:31.837648 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/864a1551-0ebe-4575-afc8-964686953825-scripts" (OuterVolumeSpecName: "scripts") pod "864a1551-0ebe-4575-afc8-964686953825" (UID: "864a1551-0ebe-4575-afc8-964686953825"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:31 crc kubenswrapper[5120]: I0316 16:37:31.837904 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/864a1551-0ebe-4575-afc8-964686953825-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "864a1551-0ebe-4575-afc8-964686953825" (UID: "864a1551-0ebe-4575-afc8-964686953825"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:31 crc kubenswrapper[5120]: I0316 16:37:31.847231 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/864a1551-0ebe-4575-afc8-964686953825-kube-api-access-s7khf" (OuterVolumeSpecName: "kube-api-access-s7khf") pod "864a1551-0ebe-4575-afc8-964686953825" (UID: "864a1551-0ebe-4575-afc8-964686953825"). InnerVolumeSpecName "kube-api-access-s7khf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:37:31 crc kubenswrapper[5120]: I0316 16:37:31.855548 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/864a1551-0ebe-4575-afc8-964686953825-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "864a1551-0ebe-4575-afc8-964686953825" (UID: "864a1551-0ebe-4575-afc8-964686953825"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:31 crc kubenswrapper[5120]: I0316 16:37:31.863446 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/864a1551-0ebe-4575-afc8-964686953825-config-data" (OuterVolumeSpecName: "config-data") pod "864a1551-0ebe-4575-afc8-964686953825" (UID: "864a1551-0ebe-4575-afc8-964686953825"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:31 crc kubenswrapper[5120]: I0316 16:37:31.874580 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/864a1551-0ebe-4575-afc8-964686953825-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "864a1551-0ebe-4575-afc8-964686953825" (UID: "864a1551-0ebe-4575-afc8-964686953825"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:31 crc kubenswrapper[5120]: I0316 16:37:31.878632 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/864a1551-0ebe-4575-afc8-964686953825-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "864a1551-0ebe-4575-afc8-964686953825" (UID: "864a1551-0ebe-4575-afc8-964686953825"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:31 crc kubenswrapper[5120]: I0316 16:37:31.935164 5120 reconciler_common.go:299] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/864a1551-0ebe-4575-afc8-964686953825-credential-keys\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:31 crc kubenswrapper[5120]: I0316 16:37:31.935226 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/864a1551-0ebe-4575-afc8-964686953825-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:31 crc kubenswrapper[5120]: I0316 16:37:31.935243 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/864a1551-0ebe-4575-afc8-964686953825-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:31 crc kubenswrapper[5120]: I0316 16:37:31.935258 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s7khf\" (UniqueName: \"kubernetes.io/projected/864a1551-0ebe-4575-afc8-964686953825-kube-api-access-s7khf\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:31 crc kubenswrapper[5120]: I0316 16:37:31.935274 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/864a1551-0ebe-4575-afc8-964686953825-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:31 crc kubenswrapper[5120]: I0316 16:37:31.935286 5120 reconciler_common.go:299] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/864a1551-0ebe-4575-afc8-964686953825-fernet-keys\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:31 crc kubenswrapper[5120]: I0316 16:37:31.935297 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/864a1551-0ebe-4575-afc8-964686953825-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:31 crc kubenswrapper[5120]: I0316 16:37:31.935310 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/864a1551-0ebe-4575-afc8-964686953825-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:32 crc kubenswrapper[5120]: I0316 16:37:32.423735 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-5769b4cdff-x2jfw" event={"ID":"864a1551-0ebe-4575-afc8-964686953825","Type":"ContainerDied","Data":"10d02a8881ba929136e9ae12f971b0330b653e60650d573da815d1893aeb146b"} Mar 16 16:37:32 crc kubenswrapper[5120]: I0316 16:37:32.424095 5120 scope.go:117] "RemoveContainer" containerID="ec7b51b54a8b71d545b522da56c31ac094ce43134f2779b01ffbc26bcfb07d05" Mar 16 16:37:32 crc kubenswrapper[5120]: I0316 16:37:32.423712 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-5769b4cdff-x2jfw" Mar 16 16:37:32 crc kubenswrapper[5120]: I0316 16:37:32.468122 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-5769b4cdff-x2jfw"] Mar 16 16:37:32 crc kubenswrapper[5120]: I0316 16:37:32.477826 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-5769b4cdff-x2jfw"] Mar 16 16:37:32 crc kubenswrapper[5120]: I0316 16:37:32.676059 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="864a1551-0ebe-4575-afc8-964686953825" path="/var/lib/kubelet/pods/864a1551-0ebe-4575-afc8-964686953825/volumes" Mar 16 16:37:32 crc kubenswrapper[5120]: I0316 16:37:32.677254 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a03095a2-0907-4be8-ac85-43befd648111" path="/var/lib/kubelet/pods/a03095a2-0907-4be8-ac85-43befd648111/volumes" Mar 16 16:37:32 crc kubenswrapper[5120]: E0316 16:37:32.967937 5120 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfec060e6_11fd_4d16_8640_fd02366a7601.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfec060e6_11fd_4d16_8640_fd02366a7601.slice/crio-cf47aaebf63137acc7a77d17eb41eeb5f06bc1f346811dfa1f366d667ed8d6a4\": RecentStats: unable to find data in memory cache]" Mar 16 16:37:35 crc kubenswrapper[5120]: E0316 16:37:35.970832 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="1502302cf5fdfbaedff9cdb3378e080511758ed3133fd93311514c3312d06191" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:37:35 crc kubenswrapper[5120]: E0316 16:37:35.973398 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="1502302cf5fdfbaedff9cdb3378e080511758ed3133fd93311514c3312d06191" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:37:35 crc kubenswrapper[5120]: E0316 16:37:35.975564 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="1502302cf5fdfbaedff9cdb3378e080511758ed3133fd93311514c3312d06191" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:37:35 crc kubenswrapper[5120]: E0316 16:37:35.975661 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="e9337f85-3f26-46e9-bbf3-ea53f581eab6" containerName="nova-cell1-conductor-conductor" probeResult="unknown" Mar 16 16:37:36 crc kubenswrapper[5120]: I0316 16:37:36.413703 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-8t4vn" Mar 16 16:37:36 crc kubenswrapper[5120]: I0316 16:37:36.476044 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-fbf48b597-rkrhz"] Mar 16 16:37:36 crc kubenswrapper[5120]: I0316 16:37:36.476330 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-fbf48b597-rkrhz" podUID="8fc31cb4-4401-4dd5-bcca-713df899353d" containerName="dnsmasq-dns" containerID="cri-o://03ef71cd198931418c655764c94e7e7306e3853bfaf8e641701f379a41513ca3" gracePeriod=10 Mar 16 16:37:37 crc kubenswrapper[5120]: I0316 16:37:37.021467 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-fbf48b597-rkrhz" Mar 16 16:37:37 crc kubenswrapper[5120]: I0316 16:37:37.138490 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/8fc31cb4-4401-4dd5-bcca-713df899353d-dns-swift-storage-0\") pod \"8fc31cb4-4401-4dd5-bcca-713df899353d\" (UID: \"8fc31cb4-4401-4dd5-bcca-713df899353d\") " Mar 16 16:37:37 crc kubenswrapper[5120]: I0316 16:37:37.138598 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/8fc31cb4-4401-4dd5-bcca-713df899353d-dnsmasq-svc\") pod \"8fc31cb4-4401-4dd5-bcca-713df899353d\" (UID: \"8fc31cb4-4401-4dd5-bcca-713df899353d\") " Mar 16 16:37:37 crc kubenswrapper[5120]: I0316 16:37:37.138972 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-76mz2\" (UniqueName: \"kubernetes.io/projected/8fc31cb4-4401-4dd5-bcca-713df899353d-kube-api-access-76mz2\") pod \"8fc31cb4-4401-4dd5-bcca-713df899353d\" (UID: \"8fc31cb4-4401-4dd5-bcca-713df899353d\") " Mar 16 16:37:37 crc kubenswrapper[5120]: I0316 16:37:37.139025 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8fc31cb4-4401-4dd5-bcca-713df899353d-config\") pod \"8fc31cb4-4401-4dd5-bcca-713df899353d\" (UID: \"8fc31cb4-4401-4dd5-bcca-713df899353d\") " Mar 16 16:37:37 crc kubenswrapper[5120]: I0316 16:37:37.145839 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8fc31cb4-4401-4dd5-bcca-713df899353d-kube-api-access-76mz2" (OuterVolumeSpecName: "kube-api-access-76mz2") pod "8fc31cb4-4401-4dd5-bcca-713df899353d" (UID: "8fc31cb4-4401-4dd5-bcca-713df899353d"). InnerVolumeSpecName "kube-api-access-76mz2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:37:37 crc kubenswrapper[5120]: I0316 16:37:37.179554 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8fc31cb4-4401-4dd5-bcca-713df899353d-config" (OuterVolumeSpecName: "config") pod "8fc31cb4-4401-4dd5-bcca-713df899353d" (UID: "8fc31cb4-4401-4dd5-bcca-713df899353d"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:37:37 crc kubenswrapper[5120]: I0316 16:37:37.181489 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8fc31cb4-4401-4dd5-bcca-713df899353d-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "8fc31cb4-4401-4dd5-bcca-713df899353d" (UID: "8fc31cb4-4401-4dd5-bcca-713df899353d"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:37:37 crc kubenswrapper[5120]: I0316 16:37:37.183147 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8fc31cb4-4401-4dd5-bcca-713df899353d-dns-swift-storage-0" (OuterVolumeSpecName: "dns-swift-storage-0") pod "8fc31cb4-4401-4dd5-bcca-713df899353d" (UID: "8fc31cb4-4401-4dd5-bcca-713df899353d"). InnerVolumeSpecName "dns-swift-storage-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:37:37 crc kubenswrapper[5120]: I0316 16:37:37.241715 5120 reconciler_common.go:299] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/8fc31cb4-4401-4dd5-bcca-713df899353d-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:37 crc kubenswrapper[5120]: I0316 16:37:37.241791 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-76mz2\" (UniqueName: \"kubernetes.io/projected/8fc31cb4-4401-4dd5-bcca-713df899353d-kube-api-access-76mz2\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:37 crc kubenswrapper[5120]: I0316 16:37:37.241807 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8fc31cb4-4401-4dd5-bcca-713df899353d-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:37 crc kubenswrapper[5120]: I0316 16:37:37.241819 5120 reconciler_common.go:299] "Volume detached for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/8fc31cb4-4401-4dd5-bcca-713df899353d-dns-swift-storage-0\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:37 crc kubenswrapper[5120]: I0316 16:37:37.481662 5120 generic.go:358] "Generic (PLEG): container finished" podID="8fc31cb4-4401-4dd5-bcca-713df899353d" containerID="03ef71cd198931418c655764c94e7e7306e3853bfaf8e641701f379a41513ca3" exitCode=0 Mar 16 16:37:37 crc kubenswrapper[5120]: I0316 16:37:37.481738 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-fbf48b597-rkrhz" Mar 16 16:37:37 crc kubenswrapper[5120]: I0316 16:37:37.481778 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-fbf48b597-rkrhz" event={"ID":"8fc31cb4-4401-4dd5-bcca-713df899353d","Type":"ContainerDied","Data":"03ef71cd198931418c655764c94e7e7306e3853bfaf8e641701f379a41513ca3"} Mar 16 16:37:37 crc kubenswrapper[5120]: I0316 16:37:37.481837 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-fbf48b597-rkrhz" event={"ID":"8fc31cb4-4401-4dd5-bcca-713df899353d","Type":"ContainerDied","Data":"93438ad49eb43027f5e520f8b2bdd46981a9e771078fbceefeccfcc7d5b21724"} Mar 16 16:37:37 crc kubenswrapper[5120]: I0316 16:37:37.481883 5120 scope.go:117] "RemoveContainer" containerID="03ef71cd198931418c655764c94e7e7306e3853bfaf8e641701f379a41513ca3" Mar 16 16:37:37 crc kubenswrapper[5120]: I0316 16:37:37.508812 5120 scope.go:117] "RemoveContainer" containerID="1c2947f4f46af5517245e9630072a3af08b1d698c016863b21b9b8f6d6b52012" Mar 16 16:37:37 crc kubenswrapper[5120]: I0316 16:37:37.516899 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-fbf48b597-rkrhz"] Mar 16 16:37:37 crc kubenswrapper[5120]: I0316 16:37:37.523479 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-fbf48b597-rkrhz"] Mar 16 16:37:37 crc kubenswrapper[5120]: I0316 16:37:37.548480 5120 scope.go:117] "RemoveContainer" containerID="03ef71cd198931418c655764c94e7e7306e3853bfaf8e641701f379a41513ca3" Mar 16 16:37:37 crc kubenswrapper[5120]: E0316 16:37:37.548931 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"03ef71cd198931418c655764c94e7e7306e3853bfaf8e641701f379a41513ca3\": container with ID starting with 03ef71cd198931418c655764c94e7e7306e3853bfaf8e641701f379a41513ca3 not found: ID does not exist" containerID="03ef71cd198931418c655764c94e7e7306e3853bfaf8e641701f379a41513ca3" Mar 16 16:37:37 crc kubenswrapper[5120]: I0316 16:37:37.548985 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03ef71cd198931418c655764c94e7e7306e3853bfaf8e641701f379a41513ca3"} err="failed to get container status \"03ef71cd198931418c655764c94e7e7306e3853bfaf8e641701f379a41513ca3\": rpc error: code = NotFound desc = could not find container \"03ef71cd198931418c655764c94e7e7306e3853bfaf8e641701f379a41513ca3\": container with ID starting with 03ef71cd198931418c655764c94e7e7306e3853bfaf8e641701f379a41513ca3 not found: ID does not exist" Mar 16 16:37:37 crc kubenswrapper[5120]: I0316 16:37:37.549226 5120 scope.go:117] "RemoveContainer" containerID="1c2947f4f46af5517245e9630072a3af08b1d698c016863b21b9b8f6d6b52012" Mar 16 16:37:37 crc kubenswrapper[5120]: E0316 16:37:37.550291 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c2947f4f46af5517245e9630072a3af08b1d698c016863b21b9b8f6d6b52012\": container with ID starting with 1c2947f4f46af5517245e9630072a3af08b1d698c016863b21b9b8f6d6b52012 not found: ID does not exist" containerID="1c2947f4f46af5517245e9630072a3af08b1d698c016863b21b9b8f6d6b52012" Mar 16 16:37:37 crc kubenswrapper[5120]: I0316 16:37:37.550323 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c2947f4f46af5517245e9630072a3af08b1d698c016863b21b9b8f6d6b52012"} err="failed to get container status \"1c2947f4f46af5517245e9630072a3af08b1d698c016863b21b9b8f6d6b52012\": rpc error: code = NotFound desc = could not find container \"1c2947f4f46af5517245e9630072a3af08b1d698c016863b21b9b8f6d6b52012\": container with ID starting with 1c2947f4f46af5517245e9630072a3af08b1d698c016863b21b9b8f6d6b52012 not found: ID does not exist" Mar 16 16:37:38 crc kubenswrapper[5120]: I0316 16:37:38.676804 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8fc31cb4-4401-4dd5-bcca-713df899353d" path="/var/lib/kubelet/pods/8fc31cb4-4401-4dd5-bcca-713df899353d/volumes" Mar 16 16:37:40 crc kubenswrapper[5120]: E0316 16:37:40.968460 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="1502302cf5fdfbaedff9cdb3378e080511758ed3133fd93311514c3312d06191" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:37:40 crc kubenswrapper[5120]: E0316 16:37:40.970435 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="1502302cf5fdfbaedff9cdb3378e080511758ed3133fd93311514c3312d06191" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:37:40 crc kubenswrapper[5120]: E0316 16:37:40.971910 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="1502302cf5fdfbaedff9cdb3378e080511758ed3133fd93311514c3312d06191" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:37:40 crc kubenswrapper[5120]: E0316 16:37:40.971961 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="e9337f85-3f26-46e9-bbf3-ea53f581eab6" containerName="nova-cell1-conductor-conductor" probeResult="unknown" Mar 16 16:37:45 crc kubenswrapper[5120]: I0316 16:37:45.565920 5120 generic.go:358] "Generic (PLEG): container finished" podID="b21fb0d1-eae4-4ac7-b3fe-6b62df9f6453" containerID="af00e50dfeb61c52a43b77c9704c742bf39ac86ed2a55361286ca4bd073e109a" exitCode=0 Mar 16 16:37:45 crc kubenswrapper[5120]: I0316 16:37:45.566096 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-8bf565768-57qhf" event={"ID":"b21fb0d1-eae4-4ac7-b3fe-6b62df9f6453","Type":"ContainerDied","Data":"af00e50dfeb61c52a43b77c9704c742bf39ac86ed2a55361286ca4bd073e109a"} Mar 16 16:37:45 crc kubenswrapper[5120]: I0316 16:37:45.643112 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-8bf565768-57qhf" Mar 16 16:37:45 crc kubenswrapper[5120]: I0316 16:37:45.709048 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b21fb0d1-eae4-4ac7-b3fe-6b62df9f6453-config\") pod \"b21fb0d1-eae4-4ac7-b3fe-6b62df9f6453\" (UID: \"b21fb0d1-eae4-4ac7-b3fe-6b62df9f6453\") " Mar 16 16:37:45 crc kubenswrapper[5120]: I0316 16:37:45.709139 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b21fb0d1-eae4-4ac7-b3fe-6b62df9f6453-combined-ca-bundle\") pod \"b21fb0d1-eae4-4ac7-b3fe-6b62df9f6453\" (UID: \"b21fb0d1-eae4-4ac7-b3fe-6b62df9f6453\") " Mar 16 16:37:45 crc kubenswrapper[5120]: I0316 16:37:45.709173 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/b21fb0d1-eae4-4ac7-b3fe-6b62df9f6453-httpd-config\") pod \"b21fb0d1-eae4-4ac7-b3fe-6b62df9f6453\" (UID: \"b21fb0d1-eae4-4ac7-b3fe-6b62df9f6453\") " Mar 16 16:37:45 crc kubenswrapper[5120]: I0316 16:37:45.709207 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/b21fb0d1-eae4-4ac7-b3fe-6b62df9f6453-ovndb-tls-certs\") pod \"b21fb0d1-eae4-4ac7-b3fe-6b62df9f6453\" (UID: \"b21fb0d1-eae4-4ac7-b3fe-6b62df9f6453\") " Mar 16 16:37:45 crc kubenswrapper[5120]: I0316 16:37:45.709419 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sq5s4\" (UniqueName: \"kubernetes.io/projected/b21fb0d1-eae4-4ac7-b3fe-6b62df9f6453-kube-api-access-sq5s4\") pod \"b21fb0d1-eae4-4ac7-b3fe-6b62df9f6453\" (UID: \"b21fb0d1-eae4-4ac7-b3fe-6b62df9f6453\") " Mar 16 16:37:45 crc kubenswrapper[5120]: I0316 16:37:45.709474 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/b21fb0d1-eae4-4ac7-b3fe-6b62df9f6453-internal-tls-certs\") pod \"b21fb0d1-eae4-4ac7-b3fe-6b62df9f6453\" (UID: \"b21fb0d1-eae4-4ac7-b3fe-6b62df9f6453\") " Mar 16 16:37:45 crc kubenswrapper[5120]: I0316 16:37:45.710796 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/b21fb0d1-eae4-4ac7-b3fe-6b62df9f6453-public-tls-certs\") pod \"b21fb0d1-eae4-4ac7-b3fe-6b62df9f6453\" (UID: \"b21fb0d1-eae4-4ac7-b3fe-6b62df9f6453\") " Mar 16 16:37:45 crc kubenswrapper[5120]: I0316 16:37:45.715258 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b21fb0d1-eae4-4ac7-b3fe-6b62df9f6453-httpd-config" (OuterVolumeSpecName: "httpd-config") pod "b21fb0d1-eae4-4ac7-b3fe-6b62df9f6453" (UID: "b21fb0d1-eae4-4ac7-b3fe-6b62df9f6453"). InnerVolumeSpecName "httpd-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:45 crc kubenswrapper[5120]: I0316 16:37:45.731563 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b21fb0d1-eae4-4ac7-b3fe-6b62df9f6453-kube-api-access-sq5s4" (OuterVolumeSpecName: "kube-api-access-sq5s4") pod "b21fb0d1-eae4-4ac7-b3fe-6b62df9f6453" (UID: "b21fb0d1-eae4-4ac7-b3fe-6b62df9f6453"). InnerVolumeSpecName "kube-api-access-sq5s4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:37:45 crc kubenswrapper[5120]: I0316 16:37:45.763489 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b21fb0d1-eae4-4ac7-b3fe-6b62df9f6453-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "b21fb0d1-eae4-4ac7-b3fe-6b62df9f6453" (UID: "b21fb0d1-eae4-4ac7-b3fe-6b62df9f6453"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:45 crc kubenswrapper[5120]: I0316 16:37:45.767484 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b21fb0d1-eae4-4ac7-b3fe-6b62df9f6453-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "b21fb0d1-eae4-4ac7-b3fe-6b62df9f6453" (UID: "b21fb0d1-eae4-4ac7-b3fe-6b62df9f6453"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:45 crc kubenswrapper[5120]: I0316 16:37:45.775587 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b21fb0d1-eae4-4ac7-b3fe-6b62df9f6453-config" (OuterVolumeSpecName: "config") pod "b21fb0d1-eae4-4ac7-b3fe-6b62df9f6453" (UID: "b21fb0d1-eae4-4ac7-b3fe-6b62df9f6453"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:45 crc kubenswrapper[5120]: I0316 16:37:45.777977 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b21fb0d1-eae4-4ac7-b3fe-6b62df9f6453-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "b21fb0d1-eae4-4ac7-b3fe-6b62df9f6453" (UID: "b21fb0d1-eae4-4ac7-b3fe-6b62df9f6453"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:45 crc kubenswrapper[5120]: I0316 16:37:45.798840 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b21fb0d1-eae4-4ac7-b3fe-6b62df9f6453-ovndb-tls-certs" (OuterVolumeSpecName: "ovndb-tls-certs") pod "b21fb0d1-eae4-4ac7-b3fe-6b62df9f6453" (UID: "b21fb0d1-eae4-4ac7-b3fe-6b62df9f6453"). InnerVolumeSpecName "ovndb-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:45 crc kubenswrapper[5120]: I0316 16:37:45.813172 5120 reconciler_common.go:299] "Volume detached for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/b21fb0d1-eae4-4ac7-b3fe-6b62df9f6453-ovndb-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:45 crc kubenswrapper[5120]: I0316 16:37:45.813218 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sq5s4\" (UniqueName: \"kubernetes.io/projected/b21fb0d1-eae4-4ac7-b3fe-6b62df9f6453-kube-api-access-sq5s4\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:45 crc kubenswrapper[5120]: I0316 16:37:45.813228 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/b21fb0d1-eae4-4ac7-b3fe-6b62df9f6453-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:45 crc kubenswrapper[5120]: I0316 16:37:45.813237 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/b21fb0d1-eae4-4ac7-b3fe-6b62df9f6453-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:45 crc kubenswrapper[5120]: I0316 16:37:45.813246 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/b21fb0d1-eae4-4ac7-b3fe-6b62df9f6453-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:45 crc kubenswrapper[5120]: I0316 16:37:45.813255 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b21fb0d1-eae4-4ac7-b3fe-6b62df9f6453-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:45 crc kubenswrapper[5120]: I0316 16:37:45.813267 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/b21fb0d1-eae4-4ac7-b3fe-6b62df9f6453-httpd-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:45 crc kubenswrapper[5120]: E0316 16:37:45.968915 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="1502302cf5fdfbaedff9cdb3378e080511758ed3133fd93311514c3312d06191" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:37:45 crc kubenswrapper[5120]: E0316 16:37:45.970848 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="1502302cf5fdfbaedff9cdb3378e080511758ed3133fd93311514c3312d06191" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:37:45 crc kubenswrapper[5120]: E0316 16:37:45.972523 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="1502302cf5fdfbaedff9cdb3378e080511758ed3133fd93311514c3312d06191" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:37:45 crc kubenswrapper[5120]: E0316 16:37:45.972596 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="e9337f85-3f26-46e9-bbf3-ea53f581eab6" containerName="nova-cell1-conductor-conductor" probeResult="unknown" Mar 16 16:37:46 crc kubenswrapper[5120]: I0316 16:37:46.579172 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-8bf565768-57qhf" event={"ID":"b21fb0d1-eae4-4ac7-b3fe-6b62df9f6453","Type":"ContainerDied","Data":"36801e42c338e66156d1bffccb4634e0c0f297738ff7b4a412ee37107cfd6cfe"} Mar 16 16:37:46 crc kubenswrapper[5120]: I0316 16:37:46.579514 5120 scope.go:117] "RemoveContainer" containerID="8c5e84274c475c693350d79928da2fd5c749fcd40da0a8b00a22b4228017d725" Mar 16 16:37:46 crc kubenswrapper[5120]: I0316 16:37:46.579438 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-8bf565768-57qhf" Mar 16 16:37:46 crc kubenswrapper[5120]: I0316 16:37:46.603099 5120 scope.go:117] "RemoveContainer" containerID="af00e50dfeb61c52a43b77c9704c742bf39ac86ed2a55361286ca4bd073e109a" Mar 16 16:37:46 crc kubenswrapper[5120]: I0316 16:37:46.622907 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-8bf565768-57qhf"] Mar 16 16:37:46 crc kubenswrapper[5120]: I0316 16:37:46.628128 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-8bf565768-57qhf"] Mar 16 16:37:46 crc kubenswrapper[5120]: I0316 16:37:46.674206 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b21fb0d1-eae4-4ac7-b3fe-6b62df9f6453" path="/var/lib/kubelet/pods/b21fb0d1-eae4-4ac7-b3fe-6b62df9f6453/volumes" Mar 16 16:37:50 crc kubenswrapper[5120]: E0316 16:37:50.968802 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="1502302cf5fdfbaedff9cdb3378e080511758ed3133fd93311514c3312d06191" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:37:50 crc kubenswrapper[5120]: E0316 16:37:50.970632 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="1502302cf5fdfbaedff9cdb3378e080511758ed3133fd93311514c3312d06191" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:37:50 crc kubenswrapper[5120]: E0316 16:37:50.972608 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="1502302cf5fdfbaedff9cdb3378e080511758ed3133fd93311514c3312d06191" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:37:50 crc kubenswrapper[5120]: E0316 16:37:50.972673 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="e9337f85-3f26-46e9-bbf3-ea53f581eab6" containerName="nova-cell1-conductor-conductor" probeResult="unknown" Mar 16 16:37:52 crc kubenswrapper[5120]: I0316 16:37:52.673791 5120 generic.go:358] "Generic (PLEG): container finished" podID="708cda1d-7af6-486c-ad5d-50f82a3e5eee" containerID="8828080fd1ea9870a7a4e1769ff36c954304ce0ce6f33354df80a5348daf83dc" exitCode=137 Mar 16 16:37:52 crc kubenswrapper[5120]: I0316 16:37:52.674543 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"708cda1d-7af6-486c-ad5d-50f82a3e5eee","Type":"ContainerDied","Data":"8828080fd1ea9870a7a4e1769ff36c954304ce0ce6f33354df80a5348daf83dc"} Mar 16 16:37:53 crc kubenswrapper[5120]: I0316 16:37:53.059368 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:37:53 crc kubenswrapper[5120]: I0316 16:37:53.152905 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/708cda1d-7af6-486c-ad5d-50f82a3e5eee-combined-ca-bundle\") pod \"708cda1d-7af6-486c-ad5d-50f82a3e5eee\" (UID: \"708cda1d-7af6-486c-ad5d-50f82a3e5eee\") " Mar 16 16:37:53 crc kubenswrapper[5120]: I0316 16:37:53.153006 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g4pbz\" (UniqueName: \"kubernetes.io/projected/708cda1d-7af6-486c-ad5d-50f82a3e5eee-kube-api-access-g4pbz\") pod \"708cda1d-7af6-486c-ad5d-50f82a3e5eee\" (UID: \"708cda1d-7af6-486c-ad5d-50f82a3e5eee\") " Mar 16 16:37:53 crc kubenswrapper[5120]: I0316 16:37:53.153052 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/708cda1d-7af6-486c-ad5d-50f82a3e5eee-etc-swift\") pod \"708cda1d-7af6-486c-ad5d-50f82a3e5eee\" (UID: \"708cda1d-7af6-486c-ad5d-50f82a3e5eee\") " Mar 16 16:37:53 crc kubenswrapper[5120]: I0316 16:37:53.153270 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/708cda1d-7af6-486c-ad5d-50f82a3e5eee-lock\") pod \"708cda1d-7af6-486c-ad5d-50f82a3e5eee\" (UID: \"708cda1d-7af6-486c-ad5d-50f82a3e5eee\") " Mar 16 16:37:53 crc kubenswrapper[5120]: I0316 16:37:53.153315 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"swift\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"708cda1d-7af6-486c-ad5d-50f82a3e5eee\" (UID: \"708cda1d-7af6-486c-ad5d-50f82a3e5eee\") " Mar 16 16:37:53 crc kubenswrapper[5120]: I0316 16:37:53.153398 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/708cda1d-7af6-486c-ad5d-50f82a3e5eee-cache\") pod \"708cda1d-7af6-486c-ad5d-50f82a3e5eee\" (UID: \"708cda1d-7af6-486c-ad5d-50f82a3e5eee\") " Mar 16 16:37:53 crc kubenswrapper[5120]: I0316 16:37:53.153824 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/708cda1d-7af6-486c-ad5d-50f82a3e5eee-lock" (OuterVolumeSpecName: "lock") pod "708cda1d-7af6-486c-ad5d-50f82a3e5eee" (UID: "708cda1d-7af6-486c-ad5d-50f82a3e5eee"). InnerVolumeSpecName "lock". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:37:53 crc kubenswrapper[5120]: I0316 16:37:53.154206 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/708cda1d-7af6-486c-ad5d-50f82a3e5eee-cache" (OuterVolumeSpecName: "cache") pod "708cda1d-7af6-486c-ad5d-50f82a3e5eee" (UID: "708cda1d-7af6-486c-ad5d-50f82a3e5eee"). InnerVolumeSpecName "cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:37:53 crc kubenswrapper[5120]: I0316 16:37:53.154568 5120 reconciler_common.go:299] "Volume detached for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/708cda1d-7af6-486c-ad5d-50f82a3e5eee-lock\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:53 crc kubenswrapper[5120]: I0316 16:37:53.154603 5120 reconciler_common.go:299] "Volume detached for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/708cda1d-7af6-486c-ad5d-50f82a3e5eee-cache\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:53 crc kubenswrapper[5120]: I0316 16:37:53.159253 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/708cda1d-7af6-486c-ad5d-50f82a3e5eee-kube-api-access-g4pbz" (OuterVolumeSpecName: "kube-api-access-g4pbz") pod "708cda1d-7af6-486c-ad5d-50f82a3e5eee" (UID: "708cda1d-7af6-486c-ad5d-50f82a3e5eee"). InnerVolumeSpecName "kube-api-access-g4pbz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:37:53 crc kubenswrapper[5120]: I0316 16:37:53.159808 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage09-crc" (OuterVolumeSpecName: "swift") pod "708cda1d-7af6-486c-ad5d-50f82a3e5eee" (UID: "708cda1d-7af6-486c-ad5d-50f82a3e5eee"). InnerVolumeSpecName "local-storage09-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:37:53 crc kubenswrapper[5120]: I0316 16:37:53.161003 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/708cda1d-7af6-486c-ad5d-50f82a3e5eee-etc-swift" (OuterVolumeSpecName: "etc-swift") pod "708cda1d-7af6-486c-ad5d-50f82a3e5eee" (UID: "708cda1d-7af6-486c-ad5d-50f82a3e5eee"). InnerVolumeSpecName "etc-swift". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:37:53 crc kubenswrapper[5120]: I0316 16:37:53.255925 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") on node \"crc\" " Mar 16 16:37:53 crc kubenswrapper[5120]: I0316 16:37:53.255960 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g4pbz\" (UniqueName: \"kubernetes.io/projected/708cda1d-7af6-486c-ad5d-50f82a3e5eee-kube-api-access-g4pbz\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:53 crc kubenswrapper[5120]: I0316 16:37:53.255969 5120 reconciler_common.go:299] "Volume detached for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/708cda1d-7af6-486c-ad5d-50f82a3e5eee-etc-swift\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:53 crc kubenswrapper[5120]: I0316 16:37:53.270983 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage09-crc" (UniqueName: "kubernetes.io/local-volume/local-storage09-crc") on node "crc" Mar 16 16:37:53 crc kubenswrapper[5120]: I0316 16:37:53.357279 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:53 crc kubenswrapper[5120]: I0316 16:37:53.453700 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/708cda1d-7af6-486c-ad5d-50f82a3e5eee-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "708cda1d-7af6-486c-ad5d-50f82a3e5eee" (UID: "708cda1d-7af6-486c-ad5d-50f82a3e5eee"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:53 crc kubenswrapper[5120]: I0316 16:37:53.458832 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/708cda1d-7af6-486c-ad5d-50f82a3e5eee-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:53 crc kubenswrapper[5120]: I0316 16:37:53.692153 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"708cda1d-7af6-486c-ad5d-50f82a3e5eee","Type":"ContainerDied","Data":"c0d28bce0673740701d04334d17ec89d42f81f34cdb94ee7919778119510d418"} Mar 16 16:37:53 crc kubenswrapper[5120]: I0316 16:37:53.692209 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:37:53 crc kubenswrapper[5120]: I0316 16:37:53.692452 5120 scope.go:117] "RemoveContainer" containerID="8828080fd1ea9870a7a4e1769ff36c954304ce0ce6f33354df80a5348daf83dc" Mar 16 16:37:53 crc kubenswrapper[5120]: I0316 16:37:53.852887 5120 scope.go:117] "RemoveContainer" containerID="016abc3c0178bcf5cd37131e0a1d710e253777ef9ec37790a656ac71970c5e94" Mar 16 16:37:53 crc kubenswrapper[5120]: I0316 16:37:53.861822 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 16:37:53 crc kubenswrapper[5120]: I0316 16:37:53.871415 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 16:37:53 crc kubenswrapper[5120]: I0316 16:37:53.883536 5120 scope.go:117] "RemoveContainer" containerID="e25c13b10bd0ae2661a7188a008d15ac091c37b50ae4a9dc6125ce1625e4c04f" Mar 16 16:37:53 crc kubenswrapper[5120]: I0316 16:37:53.919148 5120 scope.go:117] "RemoveContainer" containerID="2ce41f56d74fc06d0f22d6fa384ec2df8b05b4e93227cb38c7c8c9dcb83b3b32" Mar 16 16:37:53 crc kubenswrapper[5120]: I0316 16:37:53.949356 5120 scope.go:117] "RemoveContainer" containerID="bf2ddc46d62b71561f1fe4a22e4392ac4dd0e057752f19cd798973007180aae1" Mar 16 16:37:53 crc kubenswrapper[5120]: I0316 16:37:53.969277 5120 scope.go:117] "RemoveContainer" containerID="823234100a1705932c1298bfadc9095820a0f38e7d1438de637e080956108375" Mar 16 16:37:53 crc kubenswrapper[5120]: I0316 16:37:53.989573 5120 scope.go:117] "RemoveContainer" containerID="b3a0ff5f334911145baa06ed5e742c3115c5a82fb0be18d3a46674ff7bce8910" Mar 16 16:37:54 crc kubenswrapper[5120]: I0316 16:37:54.009585 5120 scope.go:117] "RemoveContainer" containerID="dd56dfa0b7f61c69b878b62814f7bd9a5e2e0a179c234413d454b0f170263cde" Mar 16 16:37:54 crc kubenswrapper[5120]: I0316 16:37:54.027653 5120 scope.go:117] "RemoveContainer" containerID="baa0c4a6d21177c2e1c933f890193bc3539da215fdf454524535cbb7290a3f94" Mar 16 16:37:54 crc kubenswrapper[5120]: I0316 16:37:54.044724 5120 scope.go:117] "RemoveContainer" containerID="10d720603adc56937a4b0048d6ae917e0e1cc6c9b0e270b374493b0f40d01f5b" Mar 16 16:37:54 crc kubenswrapper[5120]: I0316 16:37:54.064204 5120 scope.go:117] "RemoveContainer" containerID="d564e0e790fc7bc6f314de61c82fd0cb162da9171a21465233e947e34df0144d" Mar 16 16:37:54 crc kubenswrapper[5120]: I0316 16:37:54.083830 5120 scope.go:117] "RemoveContainer" containerID="1a366251ecfae1d36d2a256394ecbfa03feea52ce05848c7f59f88fc9e4f645d" Mar 16 16:37:54 crc kubenswrapper[5120]: I0316 16:37:54.105277 5120 scope.go:117] "RemoveContainer" containerID="0e3418c7558099ed9abc22efacb74638ba79a34cc2d57f8552a793c13d62a916" Mar 16 16:37:54 crc kubenswrapper[5120]: I0316 16:37:54.168074 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:37:54 crc kubenswrapper[5120]: I0316 16:37:54.177433 5120 scope.go:117] "RemoveContainer" containerID="06fa89856071765dcf02b87f89cb5dafc8a1764000e8fa026e6ff3fba5435780" Mar 16 16:37:54 crc kubenswrapper[5120]: I0316 16:37:54.217893 5120 scope.go:117] "RemoveContainer" containerID="c679ce3dd4a808c71f57d8f9829ff2391a97abc295485a606cdcadac0ee9033c" Mar 16 16:37:54 crc kubenswrapper[5120]: I0316 16:37:54.272579 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w4jdf\" (UniqueName: \"kubernetes.io/projected/e9337f85-3f26-46e9-bbf3-ea53f581eab6-kube-api-access-w4jdf\") pod \"e9337f85-3f26-46e9-bbf3-ea53f581eab6\" (UID: \"e9337f85-3f26-46e9-bbf3-ea53f581eab6\") " Mar 16 16:37:54 crc kubenswrapper[5120]: I0316 16:37:54.272641 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e9337f85-3f26-46e9-bbf3-ea53f581eab6-config-data\") pod \"e9337f85-3f26-46e9-bbf3-ea53f581eab6\" (UID: \"e9337f85-3f26-46e9-bbf3-ea53f581eab6\") " Mar 16 16:37:54 crc kubenswrapper[5120]: I0316 16:37:54.273003 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e9337f85-3f26-46e9-bbf3-ea53f581eab6-combined-ca-bundle\") pod \"e9337f85-3f26-46e9-bbf3-ea53f581eab6\" (UID: \"e9337f85-3f26-46e9-bbf3-ea53f581eab6\") " Mar 16 16:37:54 crc kubenswrapper[5120]: I0316 16:37:54.277808 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9337f85-3f26-46e9-bbf3-ea53f581eab6-kube-api-access-w4jdf" (OuterVolumeSpecName: "kube-api-access-w4jdf") pod "e9337f85-3f26-46e9-bbf3-ea53f581eab6" (UID: "e9337f85-3f26-46e9-bbf3-ea53f581eab6"). InnerVolumeSpecName "kube-api-access-w4jdf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:37:54 crc kubenswrapper[5120]: I0316 16:37:54.293139 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9337f85-3f26-46e9-bbf3-ea53f581eab6-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e9337f85-3f26-46e9-bbf3-ea53f581eab6" (UID: "e9337f85-3f26-46e9-bbf3-ea53f581eab6"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:54 crc kubenswrapper[5120]: I0316 16:37:54.294177 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9337f85-3f26-46e9-bbf3-ea53f581eab6-config-data" (OuterVolumeSpecName: "config-data") pod "e9337f85-3f26-46e9-bbf3-ea53f581eab6" (UID: "e9337f85-3f26-46e9-bbf3-ea53f581eab6"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:37:54 crc kubenswrapper[5120]: I0316 16:37:54.375067 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w4jdf\" (UniqueName: \"kubernetes.io/projected/e9337f85-3f26-46e9-bbf3-ea53f581eab6-kube-api-access-w4jdf\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:54 crc kubenswrapper[5120]: I0316 16:37:54.375117 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e9337f85-3f26-46e9-bbf3-ea53f581eab6-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:54 crc kubenswrapper[5120]: I0316 16:37:54.375130 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e9337f85-3f26-46e9-bbf3-ea53f581eab6-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:37:54 crc kubenswrapper[5120]: I0316 16:37:54.676918 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="708cda1d-7af6-486c-ad5d-50f82a3e5eee" path="/var/lib/kubelet/pods/708cda1d-7af6-486c-ad5d-50f82a3e5eee/volumes" Mar 16 16:37:54 crc kubenswrapper[5120]: I0316 16:37:54.704600 5120 generic.go:358] "Generic (PLEG): container finished" podID="e9337f85-3f26-46e9-bbf3-ea53f581eab6" containerID="1502302cf5fdfbaedff9cdb3378e080511758ed3133fd93311514c3312d06191" exitCode=137 Mar 16 16:37:54 crc kubenswrapper[5120]: I0316 16:37:54.704975 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"e9337f85-3f26-46e9-bbf3-ea53f581eab6","Type":"ContainerDied","Data":"1502302cf5fdfbaedff9cdb3378e080511758ed3133fd93311514c3312d06191"} Mar 16 16:37:54 crc kubenswrapper[5120]: I0316 16:37:54.705015 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"e9337f85-3f26-46e9-bbf3-ea53f581eab6","Type":"ContainerDied","Data":"218e18ffcab15951b1c30b84f3f9b438dee328f6318c931a6200d481a89a06e2"} Mar 16 16:37:54 crc kubenswrapper[5120]: I0316 16:37:54.705037 5120 scope.go:117] "RemoveContainer" containerID="1502302cf5fdfbaedff9cdb3378e080511758ed3133fd93311514c3312d06191" Mar 16 16:37:54 crc kubenswrapper[5120]: I0316 16:37:54.705050 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:37:54 crc kubenswrapper[5120]: I0316 16:37:54.731742 5120 scope.go:117] "RemoveContainer" containerID="1502302cf5fdfbaedff9cdb3378e080511758ed3133fd93311514c3312d06191" Mar 16 16:37:54 crc kubenswrapper[5120]: E0316 16:37:54.732947 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1502302cf5fdfbaedff9cdb3378e080511758ed3133fd93311514c3312d06191\": container with ID starting with 1502302cf5fdfbaedff9cdb3378e080511758ed3133fd93311514c3312d06191 not found: ID does not exist" containerID="1502302cf5fdfbaedff9cdb3378e080511758ed3133fd93311514c3312d06191" Mar 16 16:37:54 crc kubenswrapper[5120]: I0316 16:37:54.732992 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1502302cf5fdfbaedff9cdb3378e080511758ed3133fd93311514c3312d06191"} err="failed to get container status \"1502302cf5fdfbaedff9cdb3378e080511758ed3133fd93311514c3312d06191\": rpc error: code = NotFound desc = could not find container \"1502302cf5fdfbaedff9cdb3378e080511758ed3133fd93311514c3312d06191\": container with ID starting with 1502302cf5fdfbaedff9cdb3378e080511758ed3133fd93311514c3312d06191 not found: ID does not exist" Mar 16 16:37:54 crc kubenswrapper[5120]: I0316 16:37:54.736169 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 16:37:54 crc kubenswrapper[5120]: I0316 16:37:54.742652 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 16:37:56 crc kubenswrapper[5120]: I0316 16:37:56.676459 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e9337f85-3f26-46e9-bbf3-ea53f581eab6" path="/var/lib/kubelet/pods/e9337f85-3f26-46e9-bbf3-ea53f581eab6/volumes" Mar 16 16:37:59 crc kubenswrapper[5120]: I0316 16:37:59.418559 5120 pod_container_manager_linux.go:217] "Failed to delete cgroup paths" cgroupName=["kubepods","besteffort","podfb843f09-58b3-467f-8c61-f9cad54c7b55"] err="unable to destroy cgroup paths for cgroup [kubepods besteffort podfb843f09-58b3-467f-8c61-f9cad54c7b55] : Timed out while waiting for systemd to remove kubepods-besteffort-podfb843f09_58b3_467f_8c61_f9cad54c7b55.slice" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.161016 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-infra/auto-csr-approver-29561318-jbc9t"] Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.162173 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="708cda1d-7af6-486c-ad5d-50f82a3e5eee" containerName="account-auditor" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.162202 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="708cda1d-7af6-486c-ad5d-50f82a3e5eee" containerName="account-auditor" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.162221 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="708cda1d-7af6-486c-ad5d-50f82a3e5eee" containerName="account-server" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.162231 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="708cda1d-7af6-486c-ad5d-50f82a3e5eee" containerName="account-server" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.162241 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="708cda1d-7af6-486c-ad5d-50f82a3e5eee" containerName="swift-recon-cron" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.162249 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="708cda1d-7af6-486c-ad5d-50f82a3e5eee" containerName="swift-recon-cron" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.162264 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a03095a2-0907-4be8-ac85-43befd648111" containerName="rabbitmq" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.162273 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a03095a2-0907-4be8-ac85-43befd648111" containerName="rabbitmq" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.162287 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b21fb0d1-eae4-4ac7-b3fe-6b62df9f6453" containerName="neutron-api" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.162295 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="b21fb0d1-eae4-4ac7-b3fe-6b62df9f6453" containerName="neutron-api" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.162307 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49fde0a2-0250-4ab2-92c6-e88c419aa313" containerName="mysql-bootstrap" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.162314 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="49fde0a2-0250-4ab2-92c6-e88c419aa313" containerName="mysql-bootstrap" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.162324 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05e90410-2cfb-438d-95df-8b2a70319257" containerName="setup-container" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.162331 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="05e90410-2cfb-438d-95df-8b2a70319257" containerName="setup-container" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.162341 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="708cda1d-7af6-486c-ad5d-50f82a3e5eee" containerName="rsync" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.162349 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="708cda1d-7af6-486c-ad5d-50f82a3e5eee" containerName="rsync" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.162361 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="adeefc4f-7632-4673-ae4f-0104e9e65d1d" containerName="ovn-northd" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.162369 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="adeefc4f-7632-4673-ae4f-0104e9e65d1d" containerName="ovn-northd" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.162384 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="708cda1d-7af6-486c-ad5d-50f82a3e5eee" containerName="container-replicator" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.162395 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="708cda1d-7af6-486c-ad5d-50f82a3e5eee" containerName="container-replicator" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.162406 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="708cda1d-7af6-486c-ad5d-50f82a3e5eee" containerName="object-auditor" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.162413 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="708cda1d-7af6-486c-ad5d-50f82a3e5eee" containerName="object-auditor" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.162427 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa6ffb82-b871-4dae-b7c1-7880c90110a2" containerName="probe" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.162435 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa6ffb82-b871-4dae-b7c1-7880c90110a2" containerName="probe" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.162445 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb843f09-58b3-467f-8c61-f9cad54c7b55" containerName="barbican-api" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.162453 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb843f09-58b3-467f-8c61-f9cad54c7b55" containerName="barbican-api" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.162464 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="708cda1d-7af6-486c-ad5d-50f82a3e5eee" containerName="object-server" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.162472 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="708cda1d-7af6-486c-ad5d-50f82a3e5eee" containerName="object-server" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.162486 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="204ff621-b59e-44f0-84a5-c9e4eaaf86bf" containerName="ceilometer-central-agent" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.162493 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="204ff621-b59e-44f0-84a5-c9e4eaaf86bf" containerName="ceilometer-central-agent" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.162508 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b21fb0d1-eae4-4ac7-b3fe-6b62df9f6453" containerName="neutron-httpd" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.162516 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="b21fb0d1-eae4-4ac7-b3fe-6b62df9f6453" containerName="neutron-httpd" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.162523 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8822fee9-42fe-47d7-a898-22d38c991abd" containerName="barbican-worker-log" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.162530 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8822fee9-42fe-47d7-a898-22d38c991abd" containerName="barbican-worker-log" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.162542 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="708cda1d-7af6-486c-ad5d-50f82a3e5eee" containerName="container-auditor" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.162550 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="708cda1d-7af6-486c-ad5d-50f82a3e5eee" containerName="container-auditor" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.162563 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="204ff621-b59e-44f0-84a5-c9e4eaaf86bf" containerName="proxy-httpd" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.162570 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="204ff621-b59e-44f0-84a5-c9e4eaaf86bf" containerName="proxy-httpd" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.162584 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="864a1551-0ebe-4575-afc8-964686953825" containerName="keystone-api" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.162591 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="864a1551-0ebe-4575-afc8-964686953825" containerName="keystone-api" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.162601 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="204ff621-b59e-44f0-84a5-c9e4eaaf86bf" containerName="ceilometer-notification-agent" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.162609 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="204ff621-b59e-44f0-84a5-c9e4eaaf86bf" containerName="ceilometer-notification-agent" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.162620 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="204ff621-b59e-44f0-84a5-c9e4eaaf86bf" containerName="sg-core" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.162627 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="204ff621-b59e-44f0-84a5-c9e4eaaf86bf" containerName="sg-core" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.162640 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="adeefc4f-7632-4673-ae4f-0104e9e65d1d" containerName="openstack-network-exporter" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.162647 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="adeefc4f-7632-4673-ae4f-0104e9e65d1d" containerName="openstack-network-exporter" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.162659 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc7435f2-f650-416c-b0db-53082105f13b" containerName="nova-cell0-conductor-conductor" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.162667 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc7435f2-f650-416c-b0db-53082105f13b" containerName="nova-cell0-conductor-conductor" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.162677 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a03095a2-0907-4be8-ac85-43befd648111" containerName="setup-container" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.162685 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a03095a2-0907-4be8-ac85-43befd648111" containerName="setup-container" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.162696 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba60a8bc-6bab-44a3-9e77-6720ea009a57" containerName="barbican-keystone-listener-log" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.162703 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba60a8bc-6bab-44a3-9e77-6720ea009a57" containerName="barbican-keystone-listener-log" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.162711 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="708cda1d-7af6-486c-ad5d-50f82a3e5eee" containerName="object-updater" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.162719 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="708cda1d-7af6-486c-ad5d-50f82a3e5eee" containerName="object-updater" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.162729 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8822fee9-42fe-47d7-a898-22d38c991abd" containerName="barbican-worker" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.162737 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8822fee9-42fe-47d7-a898-22d38c991abd" containerName="barbican-worker" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.162747 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05e90410-2cfb-438d-95df-8b2a70319257" containerName="rabbitmq" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.162776 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="05e90410-2cfb-438d-95df-8b2a70319257" containerName="rabbitmq" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.162787 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa6ffb82-b871-4dae-b7c1-7880c90110a2" containerName="cinder-scheduler" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.162794 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa6ffb82-b871-4dae-b7c1-7880c90110a2" containerName="cinder-scheduler" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.162808 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2cc5c2d3-3da0-4d0c-9541-78f0bf375648" containerName="memcached" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.162814 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="2cc5c2d3-3da0-4d0c-9541-78f0bf375648" containerName="memcached" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.162827 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="708cda1d-7af6-486c-ad5d-50f82a3e5eee" containerName="account-reaper" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.162833 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="708cda1d-7af6-486c-ad5d-50f82a3e5eee" containerName="account-reaper" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.162843 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="708cda1d-7af6-486c-ad5d-50f82a3e5eee" containerName="object-replicator" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.162851 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="708cda1d-7af6-486c-ad5d-50f82a3e5eee" containerName="object-replicator" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.162862 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="708cda1d-7af6-486c-ad5d-50f82a3e5eee" containerName="container-updater" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.162869 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="708cda1d-7af6-486c-ad5d-50f82a3e5eee" containerName="container-updater" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.162877 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8fc31cb4-4401-4dd5-bcca-713df899353d" containerName="init" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.162884 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8fc31cb4-4401-4dd5-bcca-713df899353d" containerName="init" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.162895 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="708cda1d-7af6-486c-ad5d-50f82a3e5eee" containerName="object-expirer" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.162903 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="708cda1d-7af6-486c-ad5d-50f82a3e5eee" containerName="object-expirer" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.162913 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb843f09-58b3-467f-8c61-f9cad54c7b55" containerName="barbican-api-log" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.162922 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb843f09-58b3-467f-8c61-f9cad54c7b55" containerName="barbican-api-log" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.162933 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9337f85-3f26-46e9-bbf3-ea53f581eab6" containerName="nova-cell1-conductor-conductor" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.162941 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9337f85-3f26-46e9-bbf3-ea53f581eab6" containerName="nova-cell1-conductor-conductor" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.162950 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba60a8bc-6bab-44a3-9e77-6720ea009a57" containerName="barbican-keystone-listener" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.162956 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba60a8bc-6bab-44a3-9e77-6720ea009a57" containerName="barbican-keystone-listener" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.162967 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8fc31cb4-4401-4dd5-bcca-713df899353d" containerName="dnsmasq-dns" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.162975 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8fc31cb4-4401-4dd5-bcca-713df899353d" containerName="dnsmasq-dns" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.162988 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="708cda1d-7af6-486c-ad5d-50f82a3e5eee" containerName="account-replicator" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.162996 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="708cda1d-7af6-486c-ad5d-50f82a3e5eee" containerName="account-replicator" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.163007 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="708cda1d-7af6-486c-ad5d-50f82a3e5eee" containerName="container-server" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.163014 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="708cda1d-7af6-486c-ad5d-50f82a3e5eee" containerName="container-server" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.163025 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49fde0a2-0250-4ab2-92c6-e88c419aa313" containerName="galera" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.163031 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="49fde0a2-0250-4ab2-92c6-e88c419aa313" containerName="galera" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.163198 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="204ff621-b59e-44f0-84a5-c9e4eaaf86bf" containerName="ceilometer-notification-agent" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.163214 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="708cda1d-7af6-486c-ad5d-50f82a3e5eee" containerName="account-replicator" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.163228 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="8822fee9-42fe-47d7-a898-22d38c991abd" containerName="barbican-worker-log" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.163238 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="204ff621-b59e-44f0-84a5-c9e4eaaf86bf" containerName="sg-core" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.163251 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="708cda1d-7af6-486c-ad5d-50f82a3e5eee" containerName="object-expirer" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.163262 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="b21fb0d1-eae4-4ac7-b3fe-6b62df9f6453" containerName="neutron-httpd" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.163272 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="adeefc4f-7632-4673-ae4f-0104e9e65d1d" containerName="openstack-network-exporter" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.163282 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="708cda1d-7af6-486c-ad5d-50f82a3e5eee" containerName="object-replicator" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.163296 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ba60a8bc-6bab-44a3-9e77-6720ea009a57" containerName="barbican-keystone-listener" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.163302 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="708cda1d-7af6-486c-ad5d-50f82a3e5eee" containerName="rsync" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.163310 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="8822fee9-42fe-47d7-a898-22d38c991abd" containerName="barbican-worker" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.163317 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="708cda1d-7af6-486c-ad5d-50f82a3e5eee" containerName="account-server" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.163326 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="fb843f09-58b3-467f-8c61-f9cad54c7b55" containerName="barbican-api-log" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.163334 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="708cda1d-7af6-486c-ad5d-50f82a3e5eee" containerName="container-auditor" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.163342 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="2cc5c2d3-3da0-4d0c-9541-78f0bf375648" containerName="memcached" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.163351 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="708cda1d-7af6-486c-ad5d-50f82a3e5eee" containerName="account-reaper" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.163359 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="708cda1d-7af6-486c-ad5d-50f82a3e5eee" containerName="container-server" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.163367 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="fa6ffb82-b871-4dae-b7c1-7880c90110a2" containerName="probe" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.163376 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="708cda1d-7af6-486c-ad5d-50f82a3e5eee" containerName="object-auditor" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.163385 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="864a1551-0ebe-4575-afc8-964686953825" containerName="keystone-api" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.163393 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="8fc31cb4-4401-4dd5-bcca-713df899353d" containerName="dnsmasq-dns" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.163402 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="adeefc4f-7632-4673-ae4f-0104e9e65d1d" containerName="ovn-northd" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.163410 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="fa6ffb82-b871-4dae-b7c1-7880c90110a2" containerName="cinder-scheduler" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.163418 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="b21fb0d1-eae4-4ac7-b3fe-6b62df9f6453" containerName="neutron-api" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.163425 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="708cda1d-7af6-486c-ad5d-50f82a3e5eee" containerName="object-server" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.163433 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="204ff621-b59e-44f0-84a5-c9e4eaaf86bf" containerName="proxy-httpd" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.163439 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="dc7435f2-f650-416c-b0db-53082105f13b" containerName="nova-cell0-conductor-conductor" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.163451 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e9337f85-3f26-46e9-bbf3-ea53f581eab6" containerName="nova-cell1-conductor-conductor" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.163460 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="05e90410-2cfb-438d-95df-8b2a70319257" containerName="rabbitmq" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.163469 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="fb843f09-58b3-467f-8c61-f9cad54c7b55" containerName="barbican-api" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.163477 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="708cda1d-7af6-486c-ad5d-50f82a3e5eee" containerName="account-auditor" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.163488 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="708cda1d-7af6-486c-ad5d-50f82a3e5eee" containerName="container-replicator" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.163499 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="a03095a2-0907-4be8-ac85-43befd648111" containerName="rabbitmq" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.163507 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="204ff621-b59e-44f0-84a5-c9e4eaaf86bf" containerName="ceilometer-central-agent" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.163514 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="708cda1d-7af6-486c-ad5d-50f82a3e5eee" containerName="object-updater" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.163523 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="49fde0a2-0250-4ab2-92c6-e88c419aa313" containerName="galera" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.163529 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ba60a8bc-6bab-44a3-9e77-6720ea009a57" containerName="barbican-keystone-listener-log" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.163537 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="708cda1d-7af6-486c-ad5d-50f82a3e5eee" containerName="swift-recon-cron" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.163544 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="708cda1d-7af6-486c-ad5d-50f82a3e5eee" containerName="container-updater" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.180132 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561318-jbc9t"] Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.180273 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561318-jbc9t" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.182863 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"openshift-service-ca.crt\"" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.183529 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-infra\"/\"csr-approver-sa-dockercfg-x2nsz\"" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.183705 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"kube-root-ca.crt\"" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.304931 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4lfg\" (UniqueName: \"kubernetes.io/projected/e5305d3f-9994-4be8-8774-611da8c52266-kube-api-access-s4lfg\") pod \"auto-csr-approver-29561318-jbc9t\" (UID: \"e5305d3f-9994-4be8-8774-611da8c52266\") " pod="openshift-infra/auto-csr-approver-29561318-jbc9t" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.406651 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s4lfg\" (UniqueName: \"kubernetes.io/projected/e5305d3f-9994-4be8-8774-611da8c52266-kube-api-access-s4lfg\") pod \"auto-csr-approver-29561318-jbc9t\" (UID: \"e5305d3f-9994-4be8-8774-611da8c52266\") " pod="openshift-infra/auto-csr-approver-29561318-jbc9t" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.427746 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4lfg\" (UniqueName: \"kubernetes.io/projected/e5305d3f-9994-4be8-8774-611da8c52266-kube-api-access-s4lfg\") pod \"auto-csr-approver-29561318-jbc9t\" (UID: \"e5305d3f-9994-4be8-8774-611da8c52266\") " pod="openshift-infra/auto-csr-approver-29561318-jbc9t" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.505823 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561318-jbc9t" Mar 16 16:38:00 crc kubenswrapper[5120]: I0316 16:38:00.988031 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561318-jbc9t"] Mar 16 16:38:01 crc kubenswrapper[5120]: I0316 16:38:01.801957 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561318-jbc9t" event={"ID":"e5305d3f-9994-4be8-8774-611da8c52266","Type":"ContainerStarted","Data":"4450fd39cebec7105778e72c8888747d9e0127d4836e3cf1a902349457ec8931"} Mar 16 16:38:03 crc kubenswrapper[5120]: I0316 16:38:03.393927 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["crc-storage/crc-storage-crc-2sqkt"] Mar 16 16:38:03 crc kubenswrapper[5120]: I0316 16:38:03.401953 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["crc-storage/crc-storage-crc-2sqkt"] Mar 16 16:38:03 crc kubenswrapper[5120]: I0316 16:38:03.491178 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["crc-storage/crc-storage-crc-8wxvb"] Mar 16 16:38:03 crc kubenswrapper[5120]: I0316 16:38:03.496689 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-8wxvb" Mar 16 16:38:03 crc kubenswrapper[5120]: I0316 16:38:03.501589 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"openshift-service-ca.crt\"" Mar 16 16:38:03 crc kubenswrapper[5120]: I0316 16:38:03.501641 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-8wxvb"] Mar 16 16:38:03 crc kubenswrapper[5120]: I0316 16:38:03.501960 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"crc-storage\"/\"crc-storage-dockercfg-s2tht\"" Mar 16 16:38:03 crc kubenswrapper[5120]: I0316 16:38:03.502217 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"kube-root-ca.crt\"" Mar 16 16:38:03 crc kubenswrapper[5120]: I0316 16:38:03.502308 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"crc-storage\"" Mar 16 16:38:03 crc kubenswrapper[5120]: I0316 16:38:03.577843 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/13502645-2026-475b-8f23-f4824928b6c5-node-mnt\") pod \"crc-storage-crc-8wxvb\" (UID: \"13502645-2026-475b-8f23-f4824928b6c5\") " pod="crc-storage/crc-storage-crc-8wxvb" Mar 16 16:38:03 crc kubenswrapper[5120]: I0316 16:38:03.578116 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vdrm\" (UniqueName: \"kubernetes.io/projected/13502645-2026-475b-8f23-f4824928b6c5-kube-api-access-6vdrm\") pod \"crc-storage-crc-8wxvb\" (UID: \"13502645-2026-475b-8f23-f4824928b6c5\") " pod="crc-storage/crc-storage-crc-8wxvb" Mar 16 16:38:03 crc kubenswrapper[5120]: I0316 16:38:03.578230 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/13502645-2026-475b-8f23-f4824928b6c5-crc-storage\") pod \"crc-storage-crc-8wxvb\" (UID: \"13502645-2026-475b-8f23-f4824928b6c5\") " pod="crc-storage/crc-storage-crc-8wxvb" Mar 16 16:38:03 crc kubenswrapper[5120]: I0316 16:38:03.679812 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/13502645-2026-475b-8f23-f4824928b6c5-node-mnt\") pod \"crc-storage-crc-8wxvb\" (UID: \"13502645-2026-475b-8f23-f4824928b6c5\") " pod="crc-storage/crc-storage-crc-8wxvb" Mar 16 16:38:03 crc kubenswrapper[5120]: I0316 16:38:03.679999 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6vdrm\" (UniqueName: \"kubernetes.io/projected/13502645-2026-475b-8f23-f4824928b6c5-kube-api-access-6vdrm\") pod \"crc-storage-crc-8wxvb\" (UID: \"13502645-2026-475b-8f23-f4824928b6c5\") " pod="crc-storage/crc-storage-crc-8wxvb" Mar 16 16:38:03 crc kubenswrapper[5120]: I0316 16:38:03.680059 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/13502645-2026-475b-8f23-f4824928b6c5-crc-storage\") pod \"crc-storage-crc-8wxvb\" (UID: \"13502645-2026-475b-8f23-f4824928b6c5\") " pod="crc-storage/crc-storage-crc-8wxvb" Mar 16 16:38:03 crc kubenswrapper[5120]: I0316 16:38:03.680197 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/13502645-2026-475b-8f23-f4824928b6c5-node-mnt\") pod \"crc-storage-crc-8wxvb\" (UID: \"13502645-2026-475b-8f23-f4824928b6c5\") " pod="crc-storage/crc-storage-crc-8wxvb" Mar 16 16:38:03 crc kubenswrapper[5120]: I0316 16:38:03.680977 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/13502645-2026-475b-8f23-f4824928b6c5-crc-storage\") pod \"crc-storage-crc-8wxvb\" (UID: \"13502645-2026-475b-8f23-f4824928b6c5\") " pod="crc-storage/crc-storage-crc-8wxvb" Mar 16 16:38:03 crc kubenswrapper[5120]: I0316 16:38:03.710417 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vdrm\" (UniqueName: \"kubernetes.io/projected/13502645-2026-475b-8f23-f4824928b6c5-kube-api-access-6vdrm\") pod \"crc-storage-crc-8wxvb\" (UID: \"13502645-2026-475b-8f23-f4824928b6c5\") " pod="crc-storage/crc-storage-crc-8wxvb" Mar 16 16:38:03 crc kubenswrapper[5120]: I0316 16:38:03.831042 5120 generic.go:358] "Generic (PLEG): container finished" podID="e5305d3f-9994-4be8-8774-611da8c52266" containerID="9d490989178ba554fe0fee3bea0d5fad06b50ef9f39c2bf9bb5b95347f2d23e2" exitCode=0 Mar 16 16:38:03 crc kubenswrapper[5120]: I0316 16:38:03.831605 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561318-jbc9t" event={"ID":"e5305d3f-9994-4be8-8774-611da8c52266","Type":"ContainerDied","Data":"9d490989178ba554fe0fee3bea0d5fad06b50ef9f39c2bf9bb5b95347f2d23e2"} Mar 16 16:38:03 crc kubenswrapper[5120]: I0316 16:38:03.832570 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-8wxvb" Mar 16 16:38:04 crc kubenswrapper[5120]: I0316 16:38:04.284435 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-8wxvb"] Mar 16 16:38:04 crc kubenswrapper[5120]: I0316 16:38:04.671440 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce725cde-c352-4b82-ba40-eff46d6bcd87" path="/var/lib/kubelet/pods/ce725cde-c352-4b82-ba40-eff46d6bcd87/volumes" Mar 16 16:38:04 crc kubenswrapper[5120]: I0316 16:38:04.842110 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-8wxvb" event={"ID":"13502645-2026-475b-8f23-f4824928b6c5","Type":"ContainerStarted","Data":"b689119039eb3fb47d1f4ca87294aa0e8d3b806fc9d1f57603ad5549aeab17de"} Mar 16 16:38:05 crc kubenswrapper[5120]: I0316 16:38:05.206912 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561318-jbc9t" Mar 16 16:38:05 crc kubenswrapper[5120]: I0316 16:38:05.319044 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s4lfg\" (UniqueName: \"kubernetes.io/projected/e5305d3f-9994-4be8-8774-611da8c52266-kube-api-access-s4lfg\") pod \"e5305d3f-9994-4be8-8774-611da8c52266\" (UID: \"e5305d3f-9994-4be8-8774-611da8c52266\") " Mar 16 16:38:05 crc kubenswrapper[5120]: I0316 16:38:05.324526 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5305d3f-9994-4be8-8774-611da8c52266-kube-api-access-s4lfg" (OuterVolumeSpecName: "kube-api-access-s4lfg") pod "e5305d3f-9994-4be8-8774-611da8c52266" (UID: "e5305d3f-9994-4be8-8774-611da8c52266"). InnerVolumeSpecName "kube-api-access-s4lfg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:38:05 crc kubenswrapper[5120]: I0316 16:38:05.421915 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s4lfg\" (UniqueName: \"kubernetes.io/projected/e5305d3f-9994-4be8-8774-611da8c52266-kube-api-access-s4lfg\") on node \"crc\" DevicePath \"\"" Mar 16 16:38:05 crc kubenswrapper[5120]: I0316 16:38:05.852407 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561318-jbc9t" event={"ID":"e5305d3f-9994-4be8-8774-611da8c52266","Type":"ContainerDied","Data":"4450fd39cebec7105778e72c8888747d9e0127d4836e3cf1a902349457ec8931"} Mar 16 16:38:05 crc kubenswrapper[5120]: I0316 16:38:05.852448 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4450fd39cebec7105778e72c8888747d9e0127d4836e3cf1a902349457ec8931" Mar 16 16:38:05 crc kubenswrapper[5120]: I0316 16:38:05.852532 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561318-jbc9t" Mar 16 16:38:05 crc kubenswrapper[5120]: I0316 16:38:05.857623 5120 generic.go:358] "Generic (PLEG): container finished" podID="13502645-2026-475b-8f23-f4824928b6c5" containerID="30afdf2582392468bb3f197931e4831a94ce100d361468278ea614ac4bee9c6d" exitCode=0 Mar 16 16:38:05 crc kubenswrapper[5120]: I0316 16:38:05.857680 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-8wxvb" event={"ID":"13502645-2026-475b-8f23-f4824928b6c5","Type":"ContainerDied","Data":"30afdf2582392468bb3f197931e4831a94ce100d361468278ea614ac4bee9c6d"} Mar 16 16:38:06 crc kubenswrapper[5120]: I0316 16:38:06.455621 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-infra/auto-csr-approver-29561312-5lswt"] Mar 16 16:38:06 crc kubenswrapper[5120]: I0316 16:38:06.461099 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-infra/auto-csr-approver-29561312-5lswt"] Mar 16 16:38:06 crc kubenswrapper[5120]: I0316 16:38:06.673150 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3793e4e0-aa5c-4271-b10c-232e173f113f" path="/var/lib/kubelet/pods/3793e4e0-aa5c-4271-b10c-232e173f113f/volumes" Mar 16 16:38:07 crc kubenswrapper[5120]: I0316 16:38:07.181603 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-8wxvb" Mar 16 16:38:07 crc kubenswrapper[5120]: I0316 16:38:07.238700 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/13502645-2026-475b-8f23-f4824928b6c5-node-mnt\") pod \"13502645-2026-475b-8f23-f4824928b6c5\" (UID: \"13502645-2026-475b-8f23-f4824928b6c5\") " Mar 16 16:38:07 crc kubenswrapper[5120]: I0316 16:38:07.238830 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/13502645-2026-475b-8f23-f4824928b6c5-node-mnt" (OuterVolumeSpecName: "node-mnt") pod "13502645-2026-475b-8f23-f4824928b6c5" (UID: "13502645-2026-475b-8f23-f4824928b6c5"). InnerVolumeSpecName "node-mnt". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 16:38:07 crc kubenswrapper[5120]: I0316 16:38:07.238871 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6vdrm\" (UniqueName: \"kubernetes.io/projected/13502645-2026-475b-8f23-f4824928b6c5-kube-api-access-6vdrm\") pod \"13502645-2026-475b-8f23-f4824928b6c5\" (UID: \"13502645-2026-475b-8f23-f4824928b6c5\") " Mar 16 16:38:07 crc kubenswrapper[5120]: I0316 16:38:07.239071 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/13502645-2026-475b-8f23-f4824928b6c5-crc-storage\") pod \"13502645-2026-475b-8f23-f4824928b6c5\" (UID: \"13502645-2026-475b-8f23-f4824928b6c5\") " Mar 16 16:38:07 crc kubenswrapper[5120]: I0316 16:38:07.239445 5120 reconciler_common.go:299] "Volume detached for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/13502645-2026-475b-8f23-f4824928b6c5-node-mnt\") on node \"crc\" DevicePath \"\"" Mar 16 16:38:07 crc kubenswrapper[5120]: I0316 16:38:07.245079 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13502645-2026-475b-8f23-f4824928b6c5-kube-api-access-6vdrm" (OuterVolumeSpecName: "kube-api-access-6vdrm") pod "13502645-2026-475b-8f23-f4824928b6c5" (UID: "13502645-2026-475b-8f23-f4824928b6c5"). InnerVolumeSpecName "kube-api-access-6vdrm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:38:07 crc kubenswrapper[5120]: I0316 16:38:07.260855 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/13502645-2026-475b-8f23-f4824928b6c5-crc-storage" (OuterVolumeSpecName: "crc-storage") pod "13502645-2026-475b-8f23-f4824928b6c5" (UID: "13502645-2026-475b-8f23-f4824928b6c5"). InnerVolumeSpecName "crc-storage". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:38:07 crc kubenswrapper[5120]: I0316 16:38:07.341393 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6vdrm\" (UniqueName: \"kubernetes.io/projected/13502645-2026-475b-8f23-f4824928b6c5-kube-api-access-6vdrm\") on node \"crc\" DevicePath \"\"" Mar 16 16:38:07 crc kubenswrapper[5120]: I0316 16:38:07.341441 5120 reconciler_common.go:299] "Volume detached for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/13502645-2026-475b-8f23-f4824928b6c5-crc-storage\") on node \"crc\" DevicePath \"\"" Mar 16 16:38:07 crc kubenswrapper[5120]: E0316 16:38:07.710915 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1312647 actualBytes=10240 Mar 16 16:38:07 crc kubenswrapper[5120]: I0316 16:38:07.885269 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-8wxvb" event={"ID":"13502645-2026-475b-8f23-f4824928b6c5","Type":"ContainerDied","Data":"b689119039eb3fb47d1f4ca87294aa0e8d3b806fc9d1f57603ad5549aeab17de"} Mar 16 16:38:07 crc kubenswrapper[5120]: I0316 16:38:07.885317 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b689119039eb3fb47d1f4ca87294aa0e8d3b806fc9d1f57603ad5549aeab17de" Mar 16 16:38:07 crc kubenswrapper[5120]: I0316 16:38:07.885422 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-8wxvb" Mar 16 16:38:10 crc kubenswrapper[5120]: I0316 16:38:10.535705 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["crc-storage/crc-storage-crc-8wxvb"] Mar 16 16:38:10 crc kubenswrapper[5120]: I0316 16:38:10.542752 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["crc-storage/crc-storage-crc-8wxvb"] Mar 16 16:38:10 crc kubenswrapper[5120]: I0316 16:38:10.657497 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["crc-storage/crc-storage-crc-nb5rz"] Mar 16 16:38:10 crc kubenswrapper[5120]: I0316 16:38:10.658402 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13502645-2026-475b-8f23-f4824928b6c5" containerName="storage" Mar 16 16:38:10 crc kubenswrapper[5120]: I0316 16:38:10.658420 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="13502645-2026-475b-8f23-f4824928b6c5" containerName="storage" Mar 16 16:38:10 crc kubenswrapper[5120]: I0316 16:38:10.658447 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5305d3f-9994-4be8-8774-611da8c52266" containerName="oc" Mar 16 16:38:10 crc kubenswrapper[5120]: I0316 16:38:10.658452 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5305d3f-9994-4be8-8774-611da8c52266" containerName="oc" Mar 16 16:38:10 crc kubenswrapper[5120]: I0316 16:38:10.658579 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="13502645-2026-475b-8f23-f4824928b6c5" containerName="storage" Mar 16 16:38:10 crc kubenswrapper[5120]: I0316 16:38:10.658598 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e5305d3f-9994-4be8-8774-611da8c52266" containerName="oc" Mar 16 16:38:10 crc kubenswrapper[5120]: I0316 16:38:10.683725 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-nb5rz"] Mar 16 16:38:10 crc kubenswrapper[5120]: I0316 16:38:10.684019 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-nb5rz" Mar 16 16:38:10 crc kubenswrapper[5120]: I0316 16:38:10.686711 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"crc-storage\"/\"crc-storage-dockercfg-s2tht\"" Mar 16 16:38:10 crc kubenswrapper[5120]: I0316 16:38:10.687182 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"crc-storage\"" Mar 16 16:38:10 crc kubenswrapper[5120]: I0316 16:38:10.687433 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"kube-root-ca.crt\"" Mar 16 16:38:10 crc kubenswrapper[5120]: I0316 16:38:10.687608 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"openshift-service-ca.crt\"" Mar 16 16:38:10 crc kubenswrapper[5120]: I0316 16:38:10.701160 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="13502645-2026-475b-8f23-f4824928b6c5" path="/var/lib/kubelet/pods/13502645-2026-475b-8f23-f4824928b6c5/volumes" Mar 16 16:38:10 crc kubenswrapper[5120]: I0316 16:38:10.805038 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/4ab3d9c3-acea-4aca-a4cd-acabd3d17130-node-mnt\") pod \"crc-storage-crc-nb5rz\" (UID: \"4ab3d9c3-acea-4aca-a4cd-acabd3d17130\") " pod="crc-storage/crc-storage-crc-nb5rz" Mar 16 16:38:10 crc kubenswrapper[5120]: I0316 16:38:10.805081 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cprr2\" (UniqueName: \"kubernetes.io/projected/4ab3d9c3-acea-4aca-a4cd-acabd3d17130-kube-api-access-cprr2\") pod \"crc-storage-crc-nb5rz\" (UID: \"4ab3d9c3-acea-4aca-a4cd-acabd3d17130\") " pod="crc-storage/crc-storage-crc-nb5rz" Mar 16 16:38:10 crc kubenswrapper[5120]: I0316 16:38:10.805296 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/4ab3d9c3-acea-4aca-a4cd-acabd3d17130-crc-storage\") pod \"crc-storage-crc-nb5rz\" (UID: \"4ab3d9c3-acea-4aca-a4cd-acabd3d17130\") " pod="crc-storage/crc-storage-crc-nb5rz" Mar 16 16:38:10 crc kubenswrapper[5120]: I0316 16:38:10.906804 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/4ab3d9c3-acea-4aca-a4cd-acabd3d17130-node-mnt\") pod \"crc-storage-crc-nb5rz\" (UID: \"4ab3d9c3-acea-4aca-a4cd-acabd3d17130\") " pod="crc-storage/crc-storage-crc-nb5rz" Mar 16 16:38:10 crc kubenswrapper[5120]: I0316 16:38:10.906868 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cprr2\" (UniqueName: \"kubernetes.io/projected/4ab3d9c3-acea-4aca-a4cd-acabd3d17130-kube-api-access-cprr2\") pod \"crc-storage-crc-nb5rz\" (UID: \"4ab3d9c3-acea-4aca-a4cd-acabd3d17130\") " pod="crc-storage/crc-storage-crc-nb5rz" Mar 16 16:38:10 crc kubenswrapper[5120]: I0316 16:38:10.906965 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/4ab3d9c3-acea-4aca-a4cd-acabd3d17130-crc-storage\") pod \"crc-storage-crc-nb5rz\" (UID: \"4ab3d9c3-acea-4aca-a4cd-acabd3d17130\") " pod="crc-storage/crc-storage-crc-nb5rz" Mar 16 16:38:10 crc kubenswrapper[5120]: I0316 16:38:10.907166 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/4ab3d9c3-acea-4aca-a4cd-acabd3d17130-node-mnt\") pod \"crc-storage-crc-nb5rz\" (UID: \"4ab3d9c3-acea-4aca-a4cd-acabd3d17130\") " pod="crc-storage/crc-storage-crc-nb5rz" Mar 16 16:38:10 crc kubenswrapper[5120]: I0316 16:38:10.908414 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/4ab3d9c3-acea-4aca-a4cd-acabd3d17130-crc-storage\") pod \"crc-storage-crc-nb5rz\" (UID: \"4ab3d9c3-acea-4aca-a4cd-acabd3d17130\") " pod="crc-storage/crc-storage-crc-nb5rz" Mar 16 16:38:10 crc kubenswrapper[5120]: I0316 16:38:10.936238 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cprr2\" (UniqueName: \"kubernetes.io/projected/4ab3d9c3-acea-4aca-a4cd-acabd3d17130-kube-api-access-cprr2\") pod \"crc-storage-crc-nb5rz\" (UID: \"4ab3d9c3-acea-4aca-a4cd-acabd3d17130\") " pod="crc-storage/crc-storage-crc-nb5rz" Mar 16 16:38:11 crc kubenswrapper[5120]: I0316 16:38:11.010904 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-nb5rz" Mar 16 16:38:11 crc kubenswrapper[5120]: I0316 16:38:11.473030 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-nb5rz"] Mar 16 16:38:11 crc kubenswrapper[5120]: I0316 16:38:11.935200 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-nb5rz" event={"ID":"4ab3d9c3-acea-4aca-a4cd-acabd3d17130","Type":"ContainerStarted","Data":"01bd563093be8556c825112efbe937c74b818bb13fe5b1a24d0f138a60f9deef"} Mar 16 16:38:12 crc kubenswrapper[5120]: I0316 16:38:12.951607 5120 generic.go:358] "Generic (PLEG): container finished" podID="4ab3d9c3-acea-4aca-a4cd-acabd3d17130" containerID="20374014efa7cadfd8553df2e44fec4911491d578bbb16e3dcc04603a70e4ffb" exitCode=0 Mar 16 16:38:12 crc kubenswrapper[5120]: I0316 16:38:12.951657 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-nb5rz" event={"ID":"4ab3d9c3-acea-4aca-a4cd-acabd3d17130","Type":"ContainerDied","Data":"20374014efa7cadfd8553df2e44fec4911491d578bbb16e3dcc04603a70e4ffb"} Mar 16 16:38:14 crc kubenswrapper[5120]: I0316 16:38:14.361268 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-nb5rz" Mar 16 16:38:14 crc kubenswrapper[5120]: I0316 16:38:14.472784 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cprr2\" (UniqueName: \"kubernetes.io/projected/4ab3d9c3-acea-4aca-a4cd-acabd3d17130-kube-api-access-cprr2\") pod \"4ab3d9c3-acea-4aca-a4cd-acabd3d17130\" (UID: \"4ab3d9c3-acea-4aca-a4cd-acabd3d17130\") " Mar 16 16:38:14 crc kubenswrapper[5120]: I0316 16:38:14.472898 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/4ab3d9c3-acea-4aca-a4cd-acabd3d17130-node-mnt\") pod \"4ab3d9c3-acea-4aca-a4cd-acabd3d17130\" (UID: \"4ab3d9c3-acea-4aca-a4cd-acabd3d17130\") " Mar 16 16:38:14 crc kubenswrapper[5120]: I0316 16:38:14.473030 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/4ab3d9c3-acea-4aca-a4cd-acabd3d17130-node-mnt" (OuterVolumeSpecName: "node-mnt") pod "4ab3d9c3-acea-4aca-a4cd-acabd3d17130" (UID: "4ab3d9c3-acea-4aca-a4cd-acabd3d17130"). InnerVolumeSpecName "node-mnt". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 16:38:14 crc kubenswrapper[5120]: I0316 16:38:14.473085 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/4ab3d9c3-acea-4aca-a4cd-acabd3d17130-crc-storage\") pod \"4ab3d9c3-acea-4aca-a4cd-acabd3d17130\" (UID: \"4ab3d9c3-acea-4aca-a4cd-acabd3d17130\") " Mar 16 16:38:14 crc kubenswrapper[5120]: I0316 16:38:14.473709 5120 reconciler_common.go:299] "Volume detached for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/4ab3d9c3-acea-4aca-a4cd-acabd3d17130-node-mnt\") on node \"crc\" DevicePath \"\"" Mar 16 16:38:14 crc kubenswrapper[5120]: I0316 16:38:14.479286 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ab3d9c3-acea-4aca-a4cd-acabd3d17130-kube-api-access-cprr2" (OuterVolumeSpecName: "kube-api-access-cprr2") pod "4ab3d9c3-acea-4aca-a4cd-acabd3d17130" (UID: "4ab3d9c3-acea-4aca-a4cd-acabd3d17130"). InnerVolumeSpecName "kube-api-access-cprr2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:38:14 crc kubenswrapper[5120]: I0316 16:38:14.497557 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ab3d9c3-acea-4aca-a4cd-acabd3d17130-crc-storage" (OuterVolumeSpecName: "crc-storage") pod "4ab3d9c3-acea-4aca-a4cd-acabd3d17130" (UID: "4ab3d9c3-acea-4aca-a4cd-acabd3d17130"). InnerVolumeSpecName "crc-storage". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:38:14 crc kubenswrapper[5120]: I0316 16:38:14.576479 5120 reconciler_common.go:299] "Volume detached for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/4ab3d9c3-acea-4aca-a4cd-acabd3d17130-crc-storage\") on node \"crc\" DevicePath \"\"" Mar 16 16:38:14 crc kubenswrapper[5120]: I0316 16:38:14.576537 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cprr2\" (UniqueName: \"kubernetes.io/projected/4ab3d9c3-acea-4aca-a4cd-acabd3d17130-kube-api-access-cprr2\") on node \"crc\" DevicePath \"\"" Mar 16 16:38:14 crc kubenswrapper[5120]: I0316 16:38:14.986371 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-nb5rz" Mar 16 16:38:14 crc kubenswrapper[5120]: I0316 16:38:14.986886 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-nb5rz" event={"ID":"4ab3d9c3-acea-4aca-a4cd-acabd3d17130","Type":"ContainerDied","Data":"01bd563093be8556c825112efbe937c74b818bb13fe5b1a24d0f138a60f9deef"} Mar 16 16:38:14 crc kubenswrapper[5120]: I0316 16:38:14.987951 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="01bd563093be8556c825112efbe937c74b818bb13fe5b1a24d0f138a60f9deef" Mar 16 16:38:27 crc kubenswrapper[5120]: I0316 16:38:27.570726 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 16:38:27 crc kubenswrapper[5120]: I0316 16:38:27.572240 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ab3d9c3-acea-4aca-a4cd-acabd3d17130" containerName="storage" Mar 16 16:38:27 crc kubenswrapper[5120]: I0316 16:38:27.572257 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ab3d9c3-acea-4aca-a4cd-acabd3d17130" containerName="storage" Mar 16 16:38:27 crc kubenswrapper[5120]: I0316 16:38:27.572417 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="4ab3d9c3-acea-4aca-a4cd-acabd3d17130" containerName="storage" Mar 16 16:38:27 crc kubenswrapper[5120]: I0316 16:38:27.582887 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:38:27 crc kubenswrapper[5120]: I0316 16:38:27.585512 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-cell1-server-conf\"" Mar 16 16:38:27 crc kubenswrapper[5120]: I0316 16:38:27.591250 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-cell1-plugins-conf\"" Mar 16 16:38:27 crc kubenswrapper[5120]: I0316 16:38:27.591276 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-cell1-server-dockercfg-smtj8\"" Mar 16 16:38:27 crc kubenswrapper[5120]: I0316 16:38:27.591420 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-cell1-erlang-cookie\"" Mar 16 16:38:27 crc kubenswrapper[5120]: I0316 16:38:27.591508 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-cell1-config-data\"" Mar 16 16:38:27 crc kubenswrapper[5120]: I0316 16:38:27.591511 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-rabbitmq-cell1-svc\"" Mar 16 16:38:27 crc kubenswrapper[5120]: I0316 16:38:27.591638 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-cell1-default-user\"" Mar 16 16:38:27 crc kubenswrapper[5120]: I0316 16:38:27.593482 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 16:38:27 crc kubenswrapper[5120]: I0316 16:38:27.742984 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/c2f375f2-e474-4c66-ac4a-677606c3dd04-rabbitmq-plugins\") pod \"rabbitmq-cell1-server-0\" (UID: \"c2f375f2-e474-4c66-ac4a-677606c3dd04\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:38:27 crc kubenswrapper[5120]: I0316 16:38:27.743245 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/c2f375f2-e474-4c66-ac4a-677606c3dd04-server-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"c2f375f2-e474-4c66-ac4a-677606c3dd04\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:38:27 crc kubenswrapper[5120]: I0316 16:38:27.743304 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/c2f375f2-e474-4c66-ac4a-677606c3dd04-pod-info\") pod \"rabbitmq-cell1-server-0\" (UID: \"c2f375f2-e474-4c66-ac4a-677606c3dd04\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:38:27 crc kubenswrapper[5120]: I0316 16:38:27.743404 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"c2f375f2-e474-4c66-ac4a-677606c3dd04\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:38:27 crc kubenswrapper[5120]: I0316 16:38:27.743472 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/c2f375f2-e474-4c66-ac4a-677606c3dd04-plugins-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"c2f375f2-e474-4c66-ac4a-677606c3dd04\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:38:27 crc kubenswrapper[5120]: I0316 16:38:27.743552 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/c2f375f2-e474-4c66-ac4a-677606c3dd04-erlang-cookie-secret\") pod \"rabbitmq-cell1-server-0\" (UID: \"c2f375f2-e474-4c66-ac4a-677606c3dd04\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:38:27 crc kubenswrapper[5120]: I0316 16:38:27.743605 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/c2f375f2-e474-4c66-ac4a-677606c3dd04-config-data\") pod \"rabbitmq-cell1-server-0\" (UID: \"c2f375f2-e474-4c66-ac4a-677606c3dd04\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:38:27 crc kubenswrapper[5120]: I0316 16:38:27.743625 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/c2f375f2-e474-4c66-ac4a-677606c3dd04-rabbitmq-confd\") pod \"rabbitmq-cell1-server-0\" (UID: \"c2f375f2-e474-4c66-ac4a-677606c3dd04\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:38:27 crc kubenswrapper[5120]: I0316 16:38:27.743699 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/c2f375f2-e474-4c66-ac4a-677606c3dd04-rabbitmq-erlang-cookie\") pod \"rabbitmq-cell1-server-0\" (UID: \"c2f375f2-e474-4c66-ac4a-677606c3dd04\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:38:27 crc kubenswrapper[5120]: I0316 16:38:27.743743 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chl7j\" (UniqueName: \"kubernetes.io/projected/c2f375f2-e474-4c66-ac4a-677606c3dd04-kube-api-access-chl7j\") pod \"rabbitmq-cell1-server-0\" (UID: \"c2f375f2-e474-4c66-ac4a-677606c3dd04\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:38:27 crc kubenswrapper[5120]: I0316 16:38:27.743809 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/c2f375f2-e474-4c66-ac4a-677606c3dd04-rabbitmq-tls\") pod \"rabbitmq-cell1-server-0\" (UID: \"c2f375f2-e474-4c66-ac4a-677606c3dd04\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:38:27 crc kubenswrapper[5120]: I0316 16:38:27.845628 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"c2f375f2-e474-4c66-ac4a-677606c3dd04\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:38:27 crc kubenswrapper[5120]: I0316 16:38:27.845733 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/c2f375f2-e474-4c66-ac4a-677606c3dd04-plugins-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"c2f375f2-e474-4c66-ac4a-677606c3dd04\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:38:27 crc kubenswrapper[5120]: I0316 16:38:27.845918 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/c2f375f2-e474-4c66-ac4a-677606c3dd04-erlang-cookie-secret\") pod \"rabbitmq-cell1-server-0\" (UID: \"c2f375f2-e474-4c66-ac4a-677606c3dd04\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:38:27 crc kubenswrapper[5120]: I0316 16:38:27.846021 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/c2f375f2-e474-4c66-ac4a-677606c3dd04-config-data\") pod \"rabbitmq-cell1-server-0\" (UID: \"c2f375f2-e474-4c66-ac4a-677606c3dd04\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:38:27 crc kubenswrapper[5120]: I0316 16:38:27.846046 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/c2f375f2-e474-4c66-ac4a-677606c3dd04-rabbitmq-confd\") pod \"rabbitmq-cell1-server-0\" (UID: \"c2f375f2-e474-4c66-ac4a-677606c3dd04\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:38:27 crc kubenswrapper[5120]: I0316 16:38:27.846086 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/c2f375f2-e474-4c66-ac4a-677606c3dd04-rabbitmq-erlang-cookie\") pod \"rabbitmq-cell1-server-0\" (UID: \"c2f375f2-e474-4c66-ac4a-677606c3dd04\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:38:27 crc kubenswrapper[5120]: I0316 16:38:27.846117 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-chl7j\" (UniqueName: \"kubernetes.io/projected/c2f375f2-e474-4c66-ac4a-677606c3dd04-kube-api-access-chl7j\") pod \"rabbitmq-cell1-server-0\" (UID: \"c2f375f2-e474-4c66-ac4a-677606c3dd04\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:38:27 crc kubenswrapper[5120]: I0316 16:38:27.846120 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"c2f375f2-e474-4c66-ac4a-677606c3dd04\") device mount path \"/mnt/openstack/pv17\"" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:38:27 crc kubenswrapper[5120]: I0316 16:38:27.846752 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/c2f375f2-e474-4c66-ac4a-677606c3dd04-rabbitmq-tls\") pod \"rabbitmq-cell1-server-0\" (UID: \"c2f375f2-e474-4c66-ac4a-677606c3dd04\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:38:27 crc kubenswrapper[5120]: I0316 16:38:27.846834 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/c2f375f2-e474-4c66-ac4a-677606c3dd04-rabbitmq-plugins\") pod \"rabbitmq-cell1-server-0\" (UID: \"c2f375f2-e474-4c66-ac4a-677606c3dd04\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:38:27 crc kubenswrapper[5120]: I0316 16:38:27.848126 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/c2f375f2-e474-4c66-ac4a-677606c3dd04-config-data\") pod \"rabbitmq-cell1-server-0\" (UID: \"c2f375f2-e474-4c66-ac4a-677606c3dd04\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:38:27 crc kubenswrapper[5120]: I0316 16:38:27.848230 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/c2f375f2-e474-4c66-ac4a-677606c3dd04-server-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"c2f375f2-e474-4c66-ac4a-677606c3dd04\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:38:27 crc kubenswrapper[5120]: I0316 16:38:27.848278 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/c2f375f2-e474-4c66-ac4a-677606c3dd04-pod-info\") pod \"rabbitmq-cell1-server-0\" (UID: \"c2f375f2-e474-4c66-ac4a-677606c3dd04\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:38:27 crc kubenswrapper[5120]: I0316 16:38:27.848377 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/c2f375f2-e474-4c66-ac4a-677606c3dd04-plugins-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"c2f375f2-e474-4c66-ac4a-677606c3dd04\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:38:27 crc kubenswrapper[5120]: I0316 16:38:27.848466 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/c2f375f2-e474-4c66-ac4a-677606c3dd04-rabbitmq-plugins\") pod \"rabbitmq-cell1-server-0\" (UID: \"c2f375f2-e474-4c66-ac4a-677606c3dd04\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:38:27 crc kubenswrapper[5120]: I0316 16:38:27.848481 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/c2f375f2-e474-4c66-ac4a-677606c3dd04-rabbitmq-erlang-cookie\") pod \"rabbitmq-cell1-server-0\" (UID: \"c2f375f2-e474-4c66-ac4a-677606c3dd04\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:38:27 crc kubenswrapper[5120]: I0316 16:38:27.849927 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/c2f375f2-e474-4c66-ac4a-677606c3dd04-server-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"c2f375f2-e474-4c66-ac4a-677606c3dd04\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:38:27 crc kubenswrapper[5120]: I0316 16:38:27.853551 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/c2f375f2-e474-4c66-ac4a-677606c3dd04-rabbitmq-tls\") pod \"rabbitmq-cell1-server-0\" (UID: \"c2f375f2-e474-4c66-ac4a-677606c3dd04\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:38:27 crc kubenswrapper[5120]: I0316 16:38:27.854247 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/c2f375f2-e474-4c66-ac4a-677606c3dd04-rabbitmq-confd\") pod \"rabbitmq-cell1-server-0\" (UID: \"c2f375f2-e474-4c66-ac4a-677606c3dd04\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:38:27 crc kubenswrapper[5120]: I0316 16:38:27.854263 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/c2f375f2-e474-4c66-ac4a-677606c3dd04-pod-info\") pod \"rabbitmq-cell1-server-0\" (UID: \"c2f375f2-e474-4c66-ac4a-677606c3dd04\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:38:27 crc kubenswrapper[5120]: I0316 16:38:27.870282 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/c2f375f2-e474-4c66-ac4a-677606c3dd04-erlang-cookie-secret\") pod \"rabbitmq-cell1-server-0\" (UID: \"c2f375f2-e474-4c66-ac4a-677606c3dd04\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:38:27 crc kubenswrapper[5120]: I0316 16:38:27.874926 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-chl7j\" (UniqueName: \"kubernetes.io/projected/c2f375f2-e474-4c66-ac4a-677606c3dd04-kube-api-access-chl7j\") pod \"rabbitmq-cell1-server-0\" (UID: \"c2f375f2-e474-4c66-ac4a-677606c3dd04\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:38:27 crc kubenswrapper[5120]: I0316 16:38:27.876356 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"c2f375f2-e474-4c66-ac4a-677606c3dd04\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:38:27 crc kubenswrapper[5120]: I0316 16:38:27.929506 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:38:28 crc kubenswrapper[5120]: I0316 16:38:28.164014 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 16:38:28 crc kubenswrapper[5120]: I0316 16:38:28.171898 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:38:28 crc kubenswrapper[5120]: I0316 16:38:28.178624 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-default-user\"" Mar 16 16:38:28 crc kubenswrapper[5120]: I0316 16:38:28.179124 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-config-data\"" Mar 16 16:38:28 crc kubenswrapper[5120]: I0316 16:38:28.179252 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-server-conf\"" Mar 16 16:38:28 crc kubenswrapper[5120]: I0316 16:38:28.179292 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-plugins-conf\"" Mar 16 16:38:28 crc kubenswrapper[5120]: I0316 16:38:28.179135 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-server-dockercfg-6c8p8\"" Mar 16 16:38:28 crc kubenswrapper[5120]: I0316 16:38:28.179479 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-erlang-cookie\"" Mar 16 16:38:28 crc kubenswrapper[5120]: I0316 16:38:28.179745 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-rabbitmq-svc\"" Mar 16 16:38:28 crc kubenswrapper[5120]: I0316 16:38:28.198735 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 16:38:28 crc kubenswrapper[5120]: I0316 16:38:28.334789 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 16:38:28 crc kubenswrapper[5120]: W0316 16:38:28.335338 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2f375f2_e474_4c66_ac4a_677606c3dd04.slice/crio-4b0ae826e33a5c1301a171394c9fb50c548280bebaaf846ec5a8db76457cd0c9 WatchSource:0}: Error finding container 4b0ae826e33a5c1301a171394c9fb50c548280bebaaf846ec5a8db76457cd0c9: Status 404 returned error can't find the container with id 4b0ae826e33a5c1301a171394c9fb50c548280bebaaf846ec5a8db76457cd0c9 Mar 16 16:38:28 crc kubenswrapper[5120]: I0316 16:38:28.350032 5120 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Mar 16 16:38:28 crc kubenswrapper[5120]: I0316 16:38:28.359656 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxvrq\" (UniqueName: \"kubernetes.io/projected/55a201e2-20da-49c3-8216-77a042dd3b31-kube-api-access-kxvrq\") pod \"rabbitmq-server-0\" (UID: \"55a201e2-20da-49c3-8216-77a042dd3b31\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:38:28 crc kubenswrapper[5120]: I0316 16:38:28.359709 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/55a201e2-20da-49c3-8216-77a042dd3b31-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"55a201e2-20da-49c3-8216-77a042dd3b31\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:38:28 crc kubenswrapper[5120]: I0316 16:38:28.359743 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage18-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") pod \"rabbitmq-server-0\" (UID: \"55a201e2-20da-49c3-8216-77a042dd3b31\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:38:28 crc kubenswrapper[5120]: I0316 16:38:28.359816 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/55a201e2-20da-49c3-8216-77a042dd3b31-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"55a201e2-20da-49c3-8216-77a042dd3b31\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:38:28 crc kubenswrapper[5120]: I0316 16:38:28.359834 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/55a201e2-20da-49c3-8216-77a042dd3b31-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"55a201e2-20da-49c3-8216-77a042dd3b31\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:38:28 crc kubenswrapper[5120]: I0316 16:38:28.359851 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/55a201e2-20da-49c3-8216-77a042dd3b31-server-conf\") pod \"rabbitmq-server-0\" (UID: \"55a201e2-20da-49c3-8216-77a042dd3b31\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:38:28 crc kubenswrapper[5120]: I0316 16:38:28.359869 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/55a201e2-20da-49c3-8216-77a042dd3b31-pod-info\") pod \"rabbitmq-server-0\" (UID: \"55a201e2-20da-49c3-8216-77a042dd3b31\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:38:28 crc kubenswrapper[5120]: I0316 16:38:28.359927 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/55a201e2-20da-49c3-8216-77a042dd3b31-rabbitmq-tls\") pod \"rabbitmq-server-0\" (UID: \"55a201e2-20da-49c3-8216-77a042dd3b31\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:38:28 crc kubenswrapper[5120]: I0316 16:38:28.359950 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/55a201e2-20da-49c3-8216-77a042dd3b31-config-data\") pod \"rabbitmq-server-0\" (UID: \"55a201e2-20da-49c3-8216-77a042dd3b31\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:38:28 crc kubenswrapper[5120]: I0316 16:38:28.360118 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/55a201e2-20da-49c3-8216-77a042dd3b31-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"55a201e2-20da-49c3-8216-77a042dd3b31\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:38:28 crc kubenswrapper[5120]: I0316 16:38:28.360190 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/55a201e2-20da-49c3-8216-77a042dd3b31-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"55a201e2-20da-49c3-8216-77a042dd3b31\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:38:28 crc kubenswrapper[5120]: I0316 16:38:28.461642 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/55a201e2-20da-49c3-8216-77a042dd3b31-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"55a201e2-20da-49c3-8216-77a042dd3b31\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:38:28 crc kubenswrapper[5120]: I0316 16:38:28.461733 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kxvrq\" (UniqueName: \"kubernetes.io/projected/55a201e2-20da-49c3-8216-77a042dd3b31-kube-api-access-kxvrq\") pod \"rabbitmq-server-0\" (UID: \"55a201e2-20da-49c3-8216-77a042dd3b31\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:38:28 crc kubenswrapper[5120]: I0316 16:38:28.461781 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/55a201e2-20da-49c3-8216-77a042dd3b31-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"55a201e2-20da-49c3-8216-77a042dd3b31\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:38:28 crc kubenswrapper[5120]: I0316 16:38:28.461817 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage18-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") pod \"rabbitmq-server-0\" (UID: \"55a201e2-20da-49c3-8216-77a042dd3b31\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:38:28 crc kubenswrapper[5120]: I0316 16:38:28.461897 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/55a201e2-20da-49c3-8216-77a042dd3b31-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"55a201e2-20da-49c3-8216-77a042dd3b31\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:38:28 crc kubenswrapper[5120]: I0316 16:38:28.461917 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/55a201e2-20da-49c3-8216-77a042dd3b31-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"55a201e2-20da-49c3-8216-77a042dd3b31\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:38:28 crc kubenswrapper[5120]: I0316 16:38:28.461934 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/55a201e2-20da-49c3-8216-77a042dd3b31-server-conf\") pod \"rabbitmq-server-0\" (UID: \"55a201e2-20da-49c3-8216-77a042dd3b31\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:38:28 crc kubenswrapper[5120]: I0316 16:38:28.461953 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/55a201e2-20da-49c3-8216-77a042dd3b31-pod-info\") pod \"rabbitmq-server-0\" (UID: \"55a201e2-20da-49c3-8216-77a042dd3b31\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:38:28 crc kubenswrapper[5120]: I0316 16:38:28.462013 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/55a201e2-20da-49c3-8216-77a042dd3b31-rabbitmq-tls\") pod \"rabbitmq-server-0\" (UID: \"55a201e2-20da-49c3-8216-77a042dd3b31\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:38:28 crc kubenswrapper[5120]: I0316 16:38:28.462037 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/55a201e2-20da-49c3-8216-77a042dd3b31-config-data\") pod \"rabbitmq-server-0\" (UID: \"55a201e2-20da-49c3-8216-77a042dd3b31\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:38:28 crc kubenswrapper[5120]: I0316 16:38:28.462073 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/55a201e2-20da-49c3-8216-77a042dd3b31-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"55a201e2-20da-49c3-8216-77a042dd3b31\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:38:28 crc kubenswrapper[5120]: I0316 16:38:28.462586 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/55a201e2-20da-49c3-8216-77a042dd3b31-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"55a201e2-20da-49c3-8216-77a042dd3b31\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:38:28 crc kubenswrapper[5120]: I0316 16:38:28.469106 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/55a201e2-20da-49c3-8216-77a042dd3b31-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"55a201e2-20da-49c3-8216-77a042dd3b31\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:38:28 crc kubenswrapper[5120]: I0316 16:38:28.469419 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage18-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") pod \"rabbitmq-server-0\" (UID: \"55a201e2-20da-49c3-8216-77a042dd3b31\") device mount path \"/mnt/openstack/pv18\"" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:38:28 crc kubenswrapper[5120]: I0316 16:38:28.469976 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/55a201e2-20da-49c3-8216-77a042dd3b31-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"55a201e2-20da-49c3-8216-77a042dd3b31\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:38:28 crc kubenswrapper[5120]: I0316 16:38:28.471126 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/55a201e2-20da-49c3-8216-77a042dd3b31-server-conf\") pod \"rabbitmq-server-0\" (UID: \"55a201e2-20da-49c3-8216-77a042dd3b31\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:38:28 crc kubenswrapper[5120]: I0316 16:38:28.474788 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/55a201e2-20da-49c3-8216-77a042dd3b31-config-data\") pod \"rabbitmq-server-0\" (UID: \"55a201e2-20da-49c3-8216-77a042dd3b31\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:38:28 crc kubenswrapper[5120]: I0316 16:38:28.477381 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/55a201e2-20da-49c3-8216-77a042dd3b31-pod-info\") pod \"rabbitmq-server-0\" (UID: \"55a201e2-20da-49c3-8216-77a042dd3b31\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:38:28 crc kubenswrapper[5120]: I0316 16:38:28.477715 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/55a201e2-20da-49c3-8216-77a042dd3b31-rabbitmq-tls\") pod \"rabbitmq-server-0\" (UID: \"55a201e2-20da-49c3-8216-77a042dd3b31\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:38:28 crc kubenswrapper[5120]: I0316 16:38:28.477818 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/55a201e2-20da-49c3-8216-77a042dd3b31-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"55a201e2-20da-49c3-8216-77a042dd3b31\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:38:28 crc kubenswrapper[5120]: I0316 16:38:28.477977 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/55a201e2-20da-49c3-8216-77a042dd3b31-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"55a201e2-20da-49c3-8216-77a042dd3b31\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:38:28 crc kubenswrapper[5120]: I0316 16:38:28.506531 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxvrq\" (UniqueName: \"kubernetes.io/projected/55a201e2-20da-49c3-8216-77a042dd3b31-kube-api-access-kxvrq\") pod \"rabbitmq-server-0\" (UID: \"55a201e2-20da-49c3-8216-77a042dd3b31\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:38:28 crc kubenswrapper[5120]: I0316 16:38:28.507952 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage18-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") pod \"rabbitmq-server-0\" (UID: \"55a201e2-20da-49c3-8216-77a042dd3b31\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:38:28 crc kubenswrapper[5120]: I0316 16:38:28.520078 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:38:29 crc kubenswrapper[5120]: I0316 16:38:29.030224 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 16:38:29 crc kubenswrapper[5120]: I0316 16:38:29.152055 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"55a201e2-20da-49c3-8216-77a042dd3b31","Type":"ContainerStarted","Data":"c6733defad3c2b5be093185f2c05739fdc1a8bcf4967a78bc1800029d20bb9b1"} Mar 16 16:38:29 crc kubenswrapper[5120]: I0316 16:38:29.153776 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"c2f375f2-e474-4c66-ac4a-677606c3dd04","Type":"ContainerStarted","Data":"4b0ae826e33a5c1301a171394c9fb50c548280bebaaf846ec5a8db76457cd0c9"} Mar 16 16:38:29 crc kubenswrapper[5120]: I0316 16:38:29.189712 5120 scope.go:117] "RemoveContainer" containerID="ad0993b0521dbce57da1135798e270310c63a2a11641bcbaeda6a6634232fa0e" Mar 16 16:38:29 crc kubenswrapper[5120]: I0316 16:38:29.327290 5120 scope.go:117] "RemoveContainer" containerID="d5b7943a5a6c5f3b05232b8a073776524fa939ad41492fb3551282c557accfb7" Mar 16 16:38:29 crc kubenswrapper[5120]: I0316 16:38:29.359292 5120 scope.go:117] "RemoveContainer" containerID="192c3a9ab1613f3bb6ee17986151d5a0022fe60e91339fb2fc4a8768e7821c2d" Mar 16 16:38:29 crc kubenswrapper[5120]: I0316 16:38:29.451289 5120 scope.go:117] "RemoveContainer" containerID="484d0c35bfa0263f44925d453776161f308782a577e8f562fb88ffa30b99a4b4" Mar 16 16:38:29 crc kubenswrapper[5120]: I0316 16:38:29.722240 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 16:38:29 crc kubenswrapper[5120]: I0316 16:38:29.742616 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 16:38:29 crc kubenswrapper[5120]: I0316 16:38:29.742790 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:38:29 crc kubenswrapper[5120]: I0316 16:38:29.744612 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-galera-openstack-svc\"" Mar 16 16:38:29 crc kubenswrapper[5120]: I0316 16:38:29.745416 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"galera-openstack-dockercfg-mtn54\"" Mar 16 16:38:29 crc kubenswrapper[5120]: I0316 16:38:29.750947 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-config-data\"" Mar 16 16:38:29 crc kubenswrapper[5120]: I0316 16:38:29.751875 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-scripts\"" Mar 16 16:38:29 crc kubenswrapper[5120]: I0316 16:38:29.759059 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"combined-ca-bundle\"" Mar 16 16:38:29 crc kubenswrapper[5120]: I0316 16:38:29.814516 5120 scope.go:117] "RemoveContainer" containerID="8334b5ff1a5baea8e41bee8bf7f0f586033458052e22b079705db8c8eab4d1ea" Mar 16 16:38:29 crc kubenswrapper[5120]: I0316 16:38:29.834175 5120 scope.go:117] "RemoveContainer" containerID="ee24c81f31b37fc2f0bda0ce2b2c37f761ab08dcb89d6c5ba807ad6a7faa8718" Mar 16 16:38:29 crc kubenswrapper[5120]: I0316 16:38:29.858157 5120 scope.go:117] "RemoveContainer" containerID="a57da68ced84fcdae7a70112c8b318b169d3a3299c7e34a1d2c569b72f921d93" Mar 16 16:38:29 crc kubenswrapper[5120]: I0316 16:38:29.893182 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/8865ef1d-984f-4076-b151-fff5f7da9e62-config-data-generated\") pod \"openstack-galera-0\" (UID: \"8865ef1d-984f-4076-b151-fff5f7da9e62\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:38:29 crc kubenswrapper[5120]: I0316 16:38:29.893497 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/8865ef1d-984f-4076-b151-fff5f7da9e62-kolla-config\") pod \"openstack-galera-0\" (UID: \"8865ef1d-984f-4076-b151-fff5f7da9e62\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:38:29 crc kubenswrapper[5120]: I0316 16:38:29.893709 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2v7l\" (UniqueName: \"kubernetes.io/projected/8865ef1d-984f-4076-b151-fff5f7da9e62-kube-api-access-k2v7l\") pod \"openstack-galera-0\" (UID: \"8865ef1d-984f-4076-b151-fff5f7da9e62\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:38:29 crc kubenswrapper[5120]: I0316 16:38:29.893914 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"openstack-galera-0\" (UID: \"8865ef1d-984f-4076-b151-fff5f7da9e62\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:38:29 crc kubenswrapper[5120]: I0316 16:38:29.894040 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/8865ef1d-984f-4076-b151-fff5f7da9e62-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"8865ef1d-984f-4076-b151-fff5f7da9e62\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:38:29 crc kubenswrapper[5120]: I0316 16:38:29.894228 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/8865ef1d-984f-4076-b151-fff5f7da9e62-config-data-default\") pod \"openstack-galera-0\" (UID: \"8865ef1d-984f-4076-b151-fff5f7da9e62\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:38:29 crc kubenswrapper[5120]: I0316 16:38:29.894339 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8865ef1d-984f-4076-b151-fff5f7da9e62-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"8865ef1d-984f-4076-b151-fff5f7da9e62\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:38:29 crc kubenswrapper[5120]: I0316 16:38:29.894488 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8865ef1d-984f-4076-b151-fff5f7da9e62-operator-scripts\") pod \"openstack-galera-0\" (UID: \"8865ef1d-984f-4076-b151-fff5f7da9e62\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:38:29 crc kubenswrapper[5120]: I0316 16:38:29.943015 5120 scope.go:117] "RemoveContainer" containerID="2441f44bcdc714632e85ed0f78fd194b2ca1f178f2ae17390f61a0db203e3beb" Mar 16 16:38:29 crc kubenswrapper[5120]: I0316 16:38:29.977391 5120 scope.go:117] "RemoveContainer" containerID="e7552998c047982a5a2b1f7b36a0f809d754f53eeab0a3fc6dfb6b67a22e1482" Mar 16 16:38:29 crc kubenswrapper[5120]: I0316 16:38:29.995986 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/8865ef1d-984f-4076-b151-fff5f7da9e62-config-data-default\") pod \"openstack-galera-0\" (UID: \"8865ef1d-984f-4076-b151-fff5f7da9e62\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:38:29 crc kubenswrapper[5120]: I0316 16:38:29.996273 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8865ef1d-984f-4076-b151-fff5f7da9e62-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"8865ef1d-984f-4076-b151-fff5f7da9e62\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:38:29 crc kubenswrapper[5120]: I0316 16:38:29.997676 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8865ef1d-984f-4076-b151-fff5f7da9e62-operator-scripts\") pod \"openstack-galera-0\" (UID: \"8865ef1d-984f-4076-b151-fff5f7da9e62\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:38:29 crc kubenswrapper[5120]: I0316 16:38:29.997923 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/8865ef1d-984f-4076-b151-fff5f7da9e62-config-data-generated\") pod \"openstack-galera-0\" (UID: \"8865ef1d-984f-4076-b151-fff5f7da9e62\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:38:29 crc kubenswrapper[5120]: I0316 16:38:29.998162 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/8865ef1d-984f-4076-b151-fff5f7da9e62-kolla-config\") pod \"openstack-galera-0\" (UID: \"8865ef1d-984f-4076-b151-fff5f7da9e62\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:38:29 crc kubenswrapper[5120]: I0316 16:38:29.998452 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k2v7l\" (UniqueName: \"kubernetes.io/projected/8865ef1d-984f-4076-b151-fff5f7da9e62-kube-api-access-k2v7l\") pod \"openstack-galera-0\" (UID: \"8865ef1d-984f-4076-b151-fff5f7da9e62\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:38:29 crc kubenswrapper[5120]: I0316 16:38:29.998679 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"openstack-galera-0\" (UID: \"8865ef1d-984f-4076-b151-fff5f7da9e62\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:38:29 crc kubenswrapper[5120]: I0316 16:38:29.998924 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/8865ef1d-984f-4076-b151-fff5f7da9e62-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"8865ef1d-984f-4076-b151-fff5f7da9e62\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:38:29 crc kubenswrapper[5120]: I0316 16:38:29.997144 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/8865ef1d-984f-4076-b151-fff5f7da9e62-config-data-default\") pod \"openstack-galera-0\" (UID: \"8865ef1d-984f-4076-b151-fff5f7da9e62\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:38:29 crc kubenswrapper[5120]: I0316 16:38:29.999197 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/8865ef1d-984f-4076-b151-fff5f7da9e62-config-data-generated\") pod \"openstack-galera-0\" (UID: \"8865ef1d-984f-4076-b151-fff5f7da9e62\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:38:29 crc kubenswrapper[5120]: I0316 16:38:29.999314 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"openstack-galera-0\" (UID: \"8865ef1d-984f-4076-b151-fff5f7da9e62\") device mount path \"/mnt/openstack/pv16\"" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:38:29 crc kubenswrapper[5120]: I0316 16:38:29.999422 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/8865ef1d-984f-4076-b151-fff5f7da9e62-kolla-config\") pod \"openstack-galera-0\" (UID: \"8865ef1d-984f-4076-b151-fff5f7da9e62\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:38:29 crc kubenswrapper[5120]: I0316 16:38:29.999639 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8865ef1d-984f-4076-b151-fff5f7da9e62-operator-scripts\") pod \"openstack-galera-0\" (UID: \"8865ef1d-984f-4076-b151-fff5f7da9e62\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:38:30 crc kubenswrapper[5120]: I0316 16:38:30.002927 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8865ef1d-984f-4076-b151-fff5f7da9e62-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"8865ef1d-984f-4076-b151-fff5f7da9e62\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:38:30 crc kubenswrapper[5120]: I0316 16:38:30.002962 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/8865ef1d-984f-4076-b151-fff5f7da9e62-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"8865ef1d-984f-4076-b151-fff5f7da9e62\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:38:30 crc kubenswrapper[5120]: I0316 16:38:30.014263 5120 scope.go:117] "RemoveContainer" containerID="cc1d3e51cd8be12f68e684df22cbad5dece7d1e653cec629b214b67ec84784f3" Mar 16 16:38:30 crc kubenswrapper[5120]: I0316 16:38:30.021113 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2v7l\" (UniqueName: \"kubernetes.io/projected/8865ef1d-984f-4076-b151-fff5f7da9e62-kube-api-access-k2v7l\") pod \"openstack-galera-0\" (UID: \"8865ef1d-984f-4076-b151-fff5f7da9e62\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:38:30 crc kubenswrapper[5120]: I0316 16:38:30.026492 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"openstack-galera-0\" (UID: \"8865ef1d-984f-4076-b151-fff5f7da9e62\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:38:30 crc kubenswrapper[5120]: I0316 16:38:30.060148 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:38:30 crc kubenswrapper[5120]: I0316 16:38:30.065043 5120 scope.go:117] "RemoveContainer" containerID="a80b8f0291f5a2c0a566173d713a44f2c805f1838c96857e42d00d57a663cffd" Mar 16 16:38:30 crc kubenswrapper[5120]: I0316 16:38:30.091919 5120 scope.go:117] "RemoveContainer" containerID="db1f9c8dfa0a470e347e0af019f978f1af994f2b39341dcf82591bee56315ee5" Mar 16 16:38:30 crc kubenswrapper[5120]: I0316 16:38:30.125102 5120 scope.go:117] "RemoveContainer" containerID="01b5445a4207bf5953afa9c301ae2b0e57017967426bdfe340180d2669092cdb" Mar 16 16:38:30 crc kubenswrapper[5120]: I0316 16:38:30.167186 5120 scope.go:117] "RemoveContainer" containerID="ff75c817947243b5be26e301418ba335521570748023d806d32965c0968e802e" Mar 16 16:38:30 crc kubenswrapper[5120]: I0316 16:38:30.176382 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"c2f375f2-e474-4c66-ac4a-677606c3dd04","Type":"ContainerStarted","Data":"1a6633805f20ea052355fbcdd3c259a91fda0f13d270d62207216dd235e5324e"} Mar 16 16:38:30 crc kubenswrapper[5120]: I0316 16:38:30.335076 5120 scope.go:117] "RemoveContainer" containerID="ecb0c00da0ec7cf25bbd888d22a9adafe4995624efd529ba2c17a327e257bfcc" Mar 16 16:38:30 crc kubenswrapper[5120]: I0316 16:38:30.427747 5120 scope.go:117] "RemoveContainer" containerID="ea6d47f0ec571023b61526cc19a34ccf3c33a6f73b20dbf7b82d054f7e5df747" Mar 16 16:38:30 crc kubenswrapper[5120]: I0316 16:38:30.456773 5120 scope.go:117] "RemoveContainer" containerID="291d216b683443c84b2f1796e40c85982981e2c6f17c626efe4146dedb5aa69e" Mar 16 16:38:30 crc kubenswrapper[5120]: I0316 16:38:30.473844 5120 scope.go:117] "RemoveContainer" containerID="57687390448bcc2265e1a799e55b69e9d40e9eda293b3c9c3313d35a47e5da14" Mar 16 16:38:30 crc kubenswrapper[5120]: I0316 16:38:30.499039 5120 scope.go:117] "RemoveContainer" containerID="8adf58898f3d43249b3bfdbf4783a9eb7fb39167b029caf84c8efa99a098b342" Mar 16 16:38:30 crc kubenswrapper[5120]: I0316 16:38:30.525235 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 16:38:30 crc kubenswrapper[5120]: I0316 16:38:30.527619 5120 scope.go:117] "RemoveContainer" containerID="3b753731da61d8d35a3b195d773852ae4cdbbff0695d566a50656c167709938e" Mar 16 16:38:30 crc kubenswrapper[5120]: W0316 16:38:30.537526 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8865ef1d_984f_4076_b151_fff5f7da9e62.slice/crio-d7ae25b207b0c5891990785fefb0b4c7eecae395a53ad1681ec95728f14420df WatchSource:0}: Error finding container d7ae25b207b0c5891990785fefb0b4c7eecae395a53ad1681ec95728f14420df: Status 404 returned error can't find the container with id d7ae25b207b0c5891990785fefb0b4c7eecae395a53ad1681ec95728f14420df Mar 16 16:38:30 crc kubenswrapper[5120]: I0316 16:38:30.773390 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 16:38:30 crc kubenswrapper[5120]: I0316 16:38:30.780465 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:38:30 crc kubenswrapper[5120]: I0316 16:38:30.782587 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-cell1-config-data\"" Mar 16 16:38:30 crc kubenswrapper[5120]: I0316 16:38:30.783691 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-cell1-scripts\"" Mar 16 16:38:30 crc kubenswrapper[5120]: I0316 16:38:30.783929 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"galera-openstack-cell1-dockercfg-cd9ff\"" Mar 16 16:38:30 crc kubenswrapper[5120]: I0316 16:38:30.784743 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-galera-openstack-cell1-svc\"" Mar 16 16:38:30 crc kubenswrapper[5120]: I0316 16:38:30.786507 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 16:38:30 crc kubenswrapper[5120]: I0316 16:38:30.916151 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/45e134ad-472e-4c91-8c2e-08a8b698847e-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"45e134ad-472e-4c91-8c2e-08a8b698847e\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:38:30 crc kubenswrapper[5120]: I0316 16:38:30.916244 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2hwh\" (UniqueName: \"kubernetes.io/projected/45e134ad-472e-4c91-8c2e-08a8b698847e-kube-api-access-t2hwh\") pod \"openstack-cell1-galera-0\" (UID: \"45e134ad-472e-4c91-8c2e-08a8b698847e\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:38:30 crc kubenswrapper[5120]: I0316 16:38:30.916316 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/45e134ad-472e-4c91-8c2e-08a8b698847e-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"45e134ad-472e-4c91-8c2e-08a8b698847e\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:38:30 crc kubenswrapper[5120]: I0316 16:38:30.916365 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/45e134ad-472e-4c91-8c2e-08a8b698847e-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"45e134ad-472e-4c91-8c2e-08a8b698847e\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:38:30 crc kubenswrapper[5120]: I0316 16:38:30.916602 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/45e134ad-472e-4c91-8c2e-08a8b698847e-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"45e134ad-472e-4c91-8c2e-08a8b698847e\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:38:30 crc kubenswrapper[5120]: I0316 16:38:30.916706 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/45e134ad-472e-4c91-8c2e-08a8b698847e-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"45e134ad-472e-4c91-8c2e-08a8b698847e\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:38:30 crc kubenswrapper[5120]: I0316 16:38:30.916756 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"openstack-cell1-galera-0\" (UID: \"45e134ad-472e-4c91-8c2e-08a8b698847e\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:38:30 crc kubenswrapper[5120]: I0316 16:38:30.916921 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/45e134ad-472e-4c91-8c2e-08a8b698847e-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"45e134ad-472e-4c91-8c2e-08a8b698847e\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:38:31 crc kubenswrapper[5120]: I0316 16:38:31.018444 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/45e134ad-472e-4c91-8c2e-08a8b698847e-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"45e134ad-472e-4c91-8c2e-08a8b698847e\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:38:31 crc kubenswrapper[5120]: I0316 16:38:31.018599 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/45e134ad-472e-4c91-8c2e-08a8b698847e-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"45e134ad-472e-4c91-8c2e-08a8b698847e\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:38:31 crc kubenswrapper[5120]: I0316 16:38:31.018668 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/45e134ad-472e-4c91-8c2e-08a8b698847e-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"45e134ad-472e-4c91-8c2e-08a8b698847e\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:38:31 crc kubenswrapper[5120]: I0316 16:38:31.018702 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"openstack-cell1-galera-0\" (UID: \"45e134ad-472e-4c91-8c2e-08a8b698847e\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:38:31 crc kubenswrapper[5120]: I0316 16:38:31.018791 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/45e134ad-472e-4c91-8c2e-08a8b698847e-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"45e134ad-472e-4c91-8c2e-08a8b698847e\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:38:31 crc kubenswrapper[5120]: I0316 16:38:31.018822 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/45e134ad-472e-4c91-8c2e-08a8b698847e-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"45e134ad-472e-4c91-8c2e-08a8b698847e\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:38:31 crc kubenswrapper[5120]: I0316 16:38:31.018891 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t2hwh\" (UniqueName: \"kubernetes.io/projected/45e134ad-472e-4c91-8c2e-08a8b698847e-kube-api-access-t2hwh\") pod \"openstack-cell1-galera-0\" (UID: \"45e134ad-472e-4c91-8c2e-08a8b698847e\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:38:31 crc kubenswrapper[5120]: I0316 16:38:31.018968 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/45e134ad-472e-4c91-8c2e-08a8b698847e-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"45e134ad-472e-4c91-8c2e-08a8b698847e\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:38:31 crc kubenswrapper[5120]: I0316 16:38:31.019005 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"openstack-cell1-galera-0\" (UID: \"45e134ad-472e-4c91-8c2e-08a8b698847e\") device mount path \"/mnt/openstack/pv01\"" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:38:31 crc kubenswrapper[5120]: I0316 16:38:31.019146 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/45e134ad-472e-4c91-8c2e-08a8b698847e-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"45e134ad-472e-4c91-8c2e-08a8b698847e\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:38:31 crc kubenswrapper[5120]: I0316 16:38:31.019451 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/45e134ad-472e-4c91-8c2e-08a8b698847e-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"45e134ad-472e-4c91-8c2e-08a8b698847e\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:38:31 crc kubenswrapper[5120]: I0316 16:38:31.020017 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/45e134ad-472e-4c91-8c2e-08a8b698847e-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"45e134ad-472e-4c91-8c2e-08a8b698847e\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:38:31 crc kubenswrapper[5120]: I0316 16:38:31.020169 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/45e134ad-472e-4c91-8c2e-08a8b698847e-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"45e134ad-472e-4c91-8c2e-08a8b698847e\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:38:31 crc kubenswrapper[5120]: I0316 16:38:31.027701 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/45e134ad-472e-4c91-8c2e-08a8b698847e-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"45e134ad-472e-4c91-8c2e-08a8b698847e\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:38:31 crc kubenswrapper[5120]: I0316 16:38:31.044623 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/45e134ad-472e-4c91-8c2e-08a8b698847e-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"45e134ad-472e-4c91-8c2e-08a8b698847e\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:38:31 crc kubenswrapper[5120]: I0316 16:38:31.053269 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 16:38:31 crc kubenswrapper[5120]: I0316 16:38:31.061624 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2hwh\" (UniqueName: \"kubernetes.io/projected/45e134ad-472e-4c91-8c2e-08a8b698847e-kube-api-access-t2hwh\") pod \"openstack-cell1-galera-0\" (UID: \"45e134ad-472e-4c91-8c2e-08a8b698847e\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:38:31 crc kubenswrapper[5120]: I0316 16:38:31.069596 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 16:38:31 crc kubenswrapper[5120]: I0316 16:38:31.069691 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"openstack-cell1-galera-0\" (UID: \"45e134ad-472e-4c91-8c2e-08a8b698847e\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:38:31 crc kubenswrapper[5120]: I0316 16:38:31.069751 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Mar 16 16:38:31 crc kubenswrapper[5120]: I0316 16:38:31.076577 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"memcached-memcached-dockercfg-56wqj\"" Mar 16 16:38:31 crc kubenswrapper[5120]: I0316 16:38:31.076814 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-memcached-svc\"" Mar 16 16:38:31 crc kubenswrapper[5120]: I0316 16:38:31.076978 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"memcached-config-data\"" Mar 16 16:38:31 crc kubenswrapper[5120]: I0316 16:38:31.138576 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:38:31 crc kubenswrapper[5120]: I0316 16:38:31.222611 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4v7dp\" (UniqueName: \"kubernetes.io/projected/70745ff2-698e-465f-b638-2f88c5f0a8c1-kube-api-access-4v7dp\") pod \"memcached-0\" (UID: \"70745ff2-698e-465f-b638-2f88c5f0a8c1\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:38:31 crc kubenswrapper[5120]: I0316 16:38:31.223017 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/70745ff2-698e-465f-b638-2f88c5f0a8c1-memcached-tls-certs\") pod \"memcached-0\" (UID: \"70745ff2-698e-465f-b638-2f88c5f0a8c1\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:38:31 crc kubenswrapper[5120]: I0316 16:38:31.223092 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/70745ff2-698e-465f-b638-2f88c5f0a8c1-combined-ca-bundle\") pod \"memcached-0\" (UID: \"70745ff2-698e-465f-b638-2f88c5f0a8c1\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:38:31 crc kubenswrapper[5120]: I0316 16:38:31.223964 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/70745ff2-698e-465f-b638-2f88c5f0a8c1-config-data\") pod \"memcached-0\" (UID: \"70745ff2-698e-465f-b638-2f88c5f0a8c1\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:38:31 crc kubenswrapper[5120]: I0316 16:38:31.224132 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/70745ff2-698e-465f-b638-2f88c5f0a8c1-kolla-config\") pod \"memcached-0\" (UID: \"70745ff2-698e-465f-b638-2f88c5f0a8c1\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:38:31 crc kubenswrapper[5120]: I0316 16:38:31.226794 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"55a201e2-20da-49c3-8216-77a042dd3b31","Type":"ContainerStarted","Data":"c6fda375b35e16e4fb06b0cea8967b8c44645e1996207efeefd6730aecf30eca"} Mar 16 16:38:31 crc kubenswrapper[5120]: I0316 16:38:31.239425 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"8865ef1d-984f-4076-b151-fff5f7da9e62","Type":"ContainerStarted","Data":"a961aa781ef5a5eaaa105d97a529eea360561ab3e97cdb089a19e58e52d67159"} Mar 16 16:38:31 crc kubenswrapper[5120]: I0316 16:38:31.239472 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"8865ef1d-984f-4076-b151-fff5f7da9e62","Type":"ContainerStarted","Data":"d7ae25b207b0c5891990785fefb0b4c7eecae395a53ad1681ec95728f14420df"} Mar 16 16:38:31 crc kubenswrapper[5120]: I0316 16:38:31.327289 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/70745ff2-698e-465f-b638-2f88c5f0a8c1-config-data\") pod \"memcached-0\" (UID: \"70745ff2-698e-465f-b638-2f88c5f0a8c1\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:38:31 crc kubenswrapper[5120]: I0316 16:38:31.327671 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/70745ff2-698e-465f-b638-2f88c5f0a8c1-kolla-config\") pod \"memcached-0\" (UID: \"70745ff2-698e-465f-b638-2f88c5f0a8c1\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:38:31 crc kubenswrapper[5120]: I0316 16:38:31.327834 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4v7dp\" (UniqueName: \"kubernetes.io/projected/70745ff2-698e-465f-b638-2f88c5f0a8c1-kube-api-access-4v7dp\") pod \"memcached-0\" (UID: \"70745ff2-698e-465f-b638-2f88c5f0a8c1\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:38:31 crc kubenswrapper[5120]: I0316 16:38:31.327958 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/70745ff2-698e-465f-b638-2f88c5f0a8c1-memcached-tls-certs\") pod \"memcached-0\" (UID: \"70745ff2-698e-465f-b638-2f88c5f0a8c1\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:38:31 crc kubenswrapper[5120]: I0316 16:38:31.328523 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/70745ff2-698e-465f-b638-2f88c5f0a8c1-combined-ca-bundle\") pod \"memcached-0\" (UID: \"70745ff2-698e-465f-b638-2f88c5f0a8c1\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:38:31 crc kubenswrapper[5120]: I0316 16:38:31.328946 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/70745ff2-698e-465f-b638-2f88c5f0a8c1-config-data\") pod \"memcached-0\" (UID: \"70745ff2-698e-465f-b638-2f88c5f0a8c1\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:38:31 crc kubenswrapper[5120]: I0316 16:38:31.329628 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/70745ff2-698e-465f-b638-2f88c5f0a8c1-kolla-config\") pod \"memcached-0\" (UID: \"70745ff2-698e-465f-b638-2f88c5f0a8c1\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:38:31 crc kubenswrapper[5120]: I0316 16:38:31.334076 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/70745ff2-698e-465f-b638-2f88c5f0a8c1-memcached-tls-certs\") pod \"memcached-0\" (UID: \"70745ff2-698e-465f-b638-2f88c5f0a8c1\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:38:31 crc kubenswrapper[5120]: I0316 16:38:31.334545 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/70745ff2-698e-465f-b638-2f88c5f0a8c1-combined-ca-bundle\") pod \"memcached-0\" (UID: \"70745ff2-698e-465f-b638-2f88c5f0a8c1\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:38:31 crc kubenswrapper[5120]: I0316 16:38:31.346183 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4v7dp\" (UniqueName: \"kubernetes.io/projected/70745ff2-698e-465f-b638-2f88c5f0a8c1-kube-api-access-4v7dp\") pod \"memcached-0\" (UID: \"70745ff2-698e-465f-b638-2f88c5f0a8c1\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:38:31 crc kubenswrapper[5120]: I0316 16:38:31.425954 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Mar 16 16:38:31 crc kubenswrapper[5120]: I0316 16:38:31.660438 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 16:38:31 crc kubenswrapper[5120]: W0316 16:38:31.672268 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod45e134ad_472e_4c91_8c2e_08a8b698847e.slice/crio-9fe905adacf61a3b2cdf9e807a88fc25891a441bb973061e7c68305b38e98561 WatchSource:0}: Error finding container 9fe905adacf61a3b2cdf9e807a88fc25891a441bb973061e7c68305b38e98561: Status 404 returned error can't find the container with id 9fe905adacf61a3b2cdf9e807a88fc25891a441bb973061e7c68305b38e98561 Mar 16 16:38:31 crc kubenswrapper[5120]: I0316 16:38:31.844330 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 16:38:31 crc kubenswrapper[5120]: W0316 16:38:31.851815 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod70745ff2_698e_465f_b638_2f88c5f0a8c1.slice/crio-dda5704cda950a4d9b69c493d4f64fb8e8999c24a60a442d45ccf67b92461126 WatchSource:0}: Error finding container dda5704cda950a4d9b69c493d4f64fb8e8999c24a60a442d45ccf67b92461126: Status 404 returned error can't find the container with id dda5704cda950a4d9b69c493d4f64fb8e8999c24a60a442d45ccf67b92461126 Mar 16 16:38:32 crc kubenswrapper[5120]: I0316 16:38:32.248994 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"45e134ad-472e-4c91-8c2e-08a8b698847e","Type":"ContainerStarted","Data":"c2b641ed5eca0acc5244842068bc4f80b1a80bd57437f44d60aa301d0ab6ef37"} Mar 16 16:38:32 crc kubenswrapper[5120]: I0316 16:38:32.249312 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"45e134ad-472e-4c91-8c2e-08a8b698847e","Type":"ContainerStarted","Data":"9fe905adacf61a3b2cdf9e807a88fc25891a441bb973061e7c68305b38e98561"} Mar 16 16:38:32 crc kubenswrapper[5120]: I0316 16:38:32.251538 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"70745ff2-698e-465f-b638-2f88c5f0a8c1","Type":"ContainerStarted","Data":"277da739fad21f693bcceb96c5d27dab575e4421464263f28ff1d98df95a9af5"} Mar 16 16:38:32 crc kubenswrapper[5120]: I0316 16:38:32.251582 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"70745ff2-698e-465f-b638-2f88c5f0a8c1","Type":"ContainerStarted","Data":"dda5704cda950a4d9b69c493d4f64fb8e8999c24a60a442d45ccf67b92461126"} Mar 16 16:38:32 crc kubenswrapper[5120]: I0316 16:38:32.251974 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/memcached-0" Mar 16 16:38:34 crc kubenswrapper[5120]: I0316 16:38:34.270228 5120 generic.go:358] "Generic (PLEG): container finished" podID="8865ef1d-984f-4076-b151-fff5f7da9e62" containerID="a961aa781ef5a5eaaa105d97a529eea360561ab3e97cdb089a19e58e52d67159" exitCode=0 Mar 16 16:38:34 crc kubenswrapper[5120]: I0316 16:38:34.270284 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"8865ef1d-984f-4076-b151-fff5f7da9e62","Type":"ContainerDied","Data":"a961aa781ef5a5eaaa105d97a529eea360561ab3e97cdb089a19e58e52d67159"} Mar 16 16:38:34 crc kubenswrapper[5120]: I0316 16:38:34.297370 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/memcached-0" podStartSLOduration=3.297350928 podStartE2EDuration="3.297350928s" podCreationTimestamp="2026-03-16 16:38:31 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:38:32.293994721 +0000 UTC m=+4014.447926388" watchObservedRunningTime="2026-03-16 16:38:34.297350928 +0000 UTC m=+4016.451282585" Mar 16 16:38:35 crc kubenswrapper[5120]: I0316 16:38:35.286780 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"8865ef1d-984f-4076-b151-fff5f7da9e62","Type":"ContainerStarted","Data":"335ad75ad4c6e5c7aa60997975d2eea33d69f48a65c3ff6fe6f276f5e804978f"} Mar 16 16:38:35 crc kubenswrapper[5120]: I0316 16:38:35.290575 5120 generic.go:358] "Generic (PLEG): container finished" podID="45e134ad-472e-4c91-8c2e-08a8b698847e" containerID="c2b641ed5eca0acc5244842068bc4f80b1a80bd57437f44d60aa301d0ab6ef37" exitCode=0 Mar 16 16:38:35 crc kubenswrapper[5120]: I0316 16:38:35.290669 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"45e134ad-472e-4c91-8c2e-08a8b698847e","Type":"ContainerDied","Data":"c2b641ed5eca0acc5244842068bc4f80b1a80bd57437f44d60aa301d0ab6ef37"} Mar 16 16:38:35 crc kubenswrapper[5120]: I0316 16:38:35.353804 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstack-galera-0" podStartSLOduration=7.35377585 podStartE2EDuration="7.35377585s" podCreationTimestamp="2026-03-16 16:38:28 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:38:35.318349132 +0000 UTC m=+4017.472280819" watchObservedRunningTime="2026-03-16 16:38:35.35377585 +0000 UTC m=+4017.507707507" Mar 16 16:38:36 crc kubenswrapper[5120]: I0316 16:38:36.303101 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"45e134ad-472e-4c91-8c2e-08a8b698847e","Type":"ContainerStarted","Data":"f2177105ac4d9674a3c981a2ee15da79c7b65aa682d513987168644107f465a1"} Mar 16 16:38:36 crc kubenswrapper[5120]: I0316 16:38:36.337158 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstack-cell1-galera-0" podStartSLOduration=7.337134378 podStartE2EDuration="7.337134378s" podCreationTimestamp="2026-03-16 16:38:29 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:38:36.326214533 +0000 UTC m=+4018.480146200" watchObservedRunningTime="2026-03-16 16:38:36.337134378 +0000 UTC m=+4018.491066035" Mar 16 16:38:36 crc kubenswrapper[5120]: I0316 16:38:36.948951 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 16:38:36 crc kubenswrapper[5120]: I0316 16:38:36.958046 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:38:36 crc kubenswrapper[5120]: I0316 16:38:36.962437 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ovndbcluster-nb-ovndbs\"" Mar 16 16:38:36 crc kubenswrapper[5120]: I0316 16:38:36.962576 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ovn-metrics\"" Mar 16 16:38:36 crc kubenswrapper[5120]: I0316 16:38:36.962589 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovndbcluster-nb-scripts\"" Mar 16 16:38:36 crc kubenswrapper[5120]: I0316 16:38:36.962601 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ovncluster-ovndbcluster-nb-dockercfg-pssjl\"" Mar 16 16:38:36 crc kubenswrapper[5120]: I0316 16:38:36.964788 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovndbcluster-nb-config\"" Mar 16 16:38:36 crc kubenswrapper[5120]: I0316 16:38:36.971386 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 16:38:37 crc kubenswrapper[5120]: I0316 16:38:37.054997 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/9d23b8a0-3a5f-4bb9-84a7-f5602e4a98b0-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"9d23b8a0-3a5f-4bb9-84a7-f5602e4a98b0\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:38:37 crc kubenswrapper[5120]: I0316 16:38:37.055453 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/9d23b8a0-3a5f-4bb9-84a7-f5602e4a98b0-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"9d23b8a0-3a5f-4bb9-84a7-f5602e4a98b0\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:38:37 crc kubenswrapper[5120]: I0316 16:38:37.055510 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhvlg\" (UniqueName: \"kubernetes.io/projected/9d23b8a0-3a5f-4bb9-84a7-f5602e4a98b0-kube-api-access-qhvlg\") pod \"ovsdbserver-nb-0\" (UID: \"9d23b8a0-3a5f-4bb9-84a7-f5602e4a98b0\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:38:37 crc kubenswrapper[5120]: I0316 16:38:37.055617 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage19-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") pod \"ovsdbserver-nb-0\" (UID: \"9d23b8a0-3a5f-4bb9-84a7-f5602e4a98b0\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:38:37 crc kubenswrapper[5120]: I0316 16:38:37.055650 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9d23b8a0-3a5f-4bb9-84a7-f5602e4a98b0-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"9d23b8a0-3a5f-4bb9-84a7-f5602e4a98b0\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:38:37 crc kubenswrapper[5120]: I0316 16:38:37.055671 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/9d23b8a0-3a5f-4bb9-84a7-f5602e4a98b0-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"9d23b8a0-3a5f-4bb9-84a7-f5602e4a98b0\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:38:37 crc kubenswrapper[5120]: I0316 16:38:37.055752 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/9d23b8a0-3a5f-4bb9-84a7-f5602e4a98b0-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"9d23b8a0-3a5f-4bb9-84a7-f5602e4a98b0\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:38:37 crc kubenswrapper[5120]: I0316 16:38:37.055807 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9d23b8a0-3a5f-4bb9-84a7-f5602e4a98b0-config\") pod \"ovsdbserver-nb-0\" (UID: \"9d23b8a0-3a5f-4bb9-84a7-f5602e4a98b0\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:38:37 crc kubenswrapper[5120]: I0316 16:38:37.155521 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 16:38:37 crc kubenswrapper[5120]: I0316 16:38:37.157806 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qhvlg\" (UniqueName: \"kubernetes.io/projected/9d23b8a0-3a5f-4bb9-84a7-f5602e4a98b0-kube-api-access-qhvlg\") pod \"ovsdbserver-nb-0\" (UID: \"9d23b8a0-3a5f-4bb9-84a7-f5602e4a98b0\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:38:37 crc kubenswrapper[5120]: I0316 16:38:37.157980 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage19-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") pod \"ovsdbserver-nb-0\" (UID: \"9d23b8a0-3a5f-4bb9-84a7-f5602e4a98b0\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:38:37 crc kubenswrapper[5120]: I0316 16:38:37.158036 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9d23b8a0-3a5f-4bb9-84a7-f5602e4a98b0-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"9d23b8a0-3a5f-4bb9-84a7-f5602e4a98b0\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:38:37 crc kubenswrapper[5120]: I0316 16:38:37.158071 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/9d23b8a0-3a5f-4bb9-84a7-f5602e4a98b0-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"9d23b8a0-3a5f-4bb9-84a7-f5602e4a98b0\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:38:37 crc kubenswrapper[5120]: I0316 16:38:37.158172 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/9d23b8a0-3a5f-4bb9-84a7-f5602e4a98b0-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"9d23b8a0-3a5f-4bb9-84a7-f5602e4a98b0\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:38:37 crc kubenswrapper[5120]: I0316 16:38:37.158218 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9d23b8a0-3a5f-4bb9-84a7-f5602e4a98b0-config\") pod \"ovsdbserver-nb-0\" (UID: \"9d23b8a0-3a5f-4bb9-84a7-f5602e4a98b0\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:38:37 crc kubenswrapper[5120]: I0316 16:38:37.158277 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/9d23b8a0-3a5f-4bb9-84a7-f5602e4a98b0-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"9d23b8a0-3a5f-4bb9-84a7-f5602e4a98b0\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:38:37 crc kubenswrapper[5120]: I0316 16:38:37.158321 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/9d23b8a0-3a5f-4bb9-84a7-f5602e4a98b0-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"9d23b8a0-3a5f-4bb9-84a7-f5602e4a98b0\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:38:37 crc kubenswrapper[5120]: I0316 16:38:37.158517 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage19-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") pod \"ovsdbserver-nb-0\" (UID: \"9d23b8a0-3a5f-4bb9-84a7-f5602e4a98b0\") device mount path \"/mnt/openstack/pv19\"" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:38:37 crc kubenswrapper[5120]: I0316 16:38:37.159199 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/9d23b8a0-3a5f-4bb9-84a7-f5602e4a98b0-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"9d23b8a0-3a5f-4bb9-84a7-f5602e4a98b0\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:38:37 crc kubenswrapper[5120]: I0316 16:38:37.165076 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/9d23b8a0-3a5f-4bb9-84a7-f5602e4a98b0-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"9d23b8a0-3a5f-4bb9-84a7-f5602e4a98b0\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:38:37 crc kubenswrapper[5120]: I0316 16:38:37.165415 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9d23b8a0-3a5f-4bb9-84a7-f5602e4a98b0-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"9d23b8a0-3a5f-4bb9-84a7-f5602e4a98b0\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:38:37 crc kubenswrapper[5120]: I0316 16:38:37.165822 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:38:37 crc kubenswrapper[5120]: I0316 16:38:37.169740 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 16:38:37 crc kubenswrapper[5120]: I0316 16:38:37.170012 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ovncluster-ovndbcluster-sb-dockercfg-gcsxj\"" Mar 16 16:38:37 crc kubenswrapper[5120]: I0316 16:38:37.170044 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovndbcluster-sb-config\"" Mar 16 16:38:37 crc kubenswrapper[5120]: I0316 16:38:37.170083 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovndbcluster-sb-scripts\"" Mar 16 16:38:37 crc kubenswrapper[5120]: I0316 16:38:37.170800 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ovndbcluster-sb-ovndbs\"" Mar 16 16:38:37 crc kubenswrapper[5120]: I0316 16:38:37.163983 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9d23b8a0-3a5f-4bb9-84a7-f5602e4a98b0-config\") pod \"ovsdbserver-nb-0\" (UID: \"9d23b8a0-3a5f-4bb9-84a7-f5602e4a98b0\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:38:37 crc kubenswrapper[5120]: I0316 16:38:37.172529 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/9d23b8a0-3a5f-4bb9-84a7-f5602e4a98b0-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"9d23b8a0-3a5f-4bb9-84a7-f5602e4a98b0\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:38:37 crc kubenswrapper[5120]: I0316 16:38:37.180676 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/9d23b8a0-3a5f-4bb9-84a7-f5602e4a98b0-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"9d23b8a0-3a5f-4bb9-84a7-f5602e4a98b0\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:38:37 crc kubenswrapper[5120]: I0316 16:38:37.182706 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhvlg\" (UniqueName: \"kubernetes.io/projected/9d23b8a0-3a5f-4bb9-84a7-f5602e4a98b0-kube-api-access-qhvlg\") pod \"ovsdbserver-nb-0\" (UID: \"9d23b8a0-3a5f-4bb9-84a7-f5602e4a98b0\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:38:37 crc kubenswrapper[5120]: I0316 16:38:37.202980 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage19-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") pod \"ovsdbserver-nb-0\" (UID: \"9d23b8a0-3a5f-4bb9-84a7-f5602e4a98b0\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:38:37 crc kubenswrapper[5120]: I0316 16:38:37.259521 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/10cdd157-8ffd-4a86-9dba-ac570a45273b-config\") pod \"ovsdbserver-sb-0\" (UID: \"10cdd157-8ffd-4a86-9dba-ac570a45273b\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:38:37 crc kubenswrapper[5120]: I0316 16:38:37.259562 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/10cdd157-8ffd-4a86-9dba-ac570a45273b-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"10cdd157-8ffd-4a86-9dba-ac570a45273b\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:38:37 crc kubenswrapper[5120]: I0316 16:38:37.259589 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/10cdd157-8ffd-4a86-9dba-ac570a45273b-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"10cdd157-8ffd-4a86-9dba-ac570a45273b\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:38:37 crc kubenswrapper[5120]: I0316 16:38:37.259635 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/10cdd157-8ffd-4a86-9dba-ac570a45273b-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"10cdd157-8ffd-4a86-9dba-ac570a45273b\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:38:37 crc kubenswrapper[5120]: I0316 16:38:37.259672 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"ovsdbserver-sb-0\" (UID: \"10cdd157-8ffd-4a86-9dba-ac570a45273b\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:38:37 crc kubenswrapper[5120]: I0316 16:38:37.259717 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nl8pw\" (UniqueName: \"kubernetes.io/projected/10cdd157-8ffd-4a86-9dba-ac570a45273b-kube-api-access-nl8pw\") pod \"ovsdbserver-sb-0\" (UID: \"10cdd157-8ffd-4a86-9dba-ac570a45273b\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:38:37 crc kubenswrapper[5120]: I0316 16:38:37.259775 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/10cdd157-8ffd-4a86-9dba-ac570a45273b-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"10cdd157-8ffd-4a86-9dba-ac570a45273b\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:38:37 crc kubenswrapper[5120]: I0316 16:38:37.259898 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/10cdd157-8ffd-4a86-9dba-ac570a45273b-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"10cdd157-8ffd-4a86-9dba-ac570a45273b\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:38:37 crc kubenswrapper[5120]: I0316 16:38:37.280540 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:38:37 crc kubenswrapper[5120]: I0316 16:38:37.361596 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/10cdd157-8ffd-4a86-9dba-ac570a45273b-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"10cdd157-8ffd-4a86-9dba-ac570a45273b\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:38:37 crc kubenswrapper[5120]: I0316 16:38:37.362337 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"ovsdbserver-sb-0\" (UID: \"10cdd157-8ffd-4a86-9dba-ac570a45273b\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:38:37 crc kubenswrapper[5120]: I0316 16:38:37.362424 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nl8pw\" (UniqueName: \"kubernetes.io/projected/10cdd157-8ffd-4a86-9dba-ac570a45273b-kube-api-access-nl8pw\") pod \"ovsdbserver-sb-0\" (UID: \"10cdd157-8ffd-4a86-9dba-ac570a45273b\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:38:37 crc kubenswrapper[5120]: I0316 16:38:37.362501 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/10cdd157-8ffd-4a86-9dba-ac570a45273b-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"10cdd157-8ffd-4a86-9dba-ac570a45273b\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:38:37 crc kubenswrapper[5120]: I0316 16:38:37.362645 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/10cdd157-8ffd-4a86-9dba-ac570a45273b-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"10cdd157-8ffd-4a86-9dba-ac570a45273b\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:38:37 crc kubenswrapper[5120]: I0316 16:38:37.362787 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/10cdd157-8ffd-4a86-9dba-ac570a45273b-config\") pod \"ovsdbserver-sb-0\" (UID: \"10cdd157-8ffd-4a86-9dba-ac570a45273b\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:38:37 crc kubenswrapper[5120]: I0316 16:38:37.362816 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/10cdd157-8ffd-4a86-9dba-ac570a45273b-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"10cdd157-8ffd-4a86-9dba-ac570a45273b\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:38:37 crc kubenswrapper[5120]: I0316 16:38:37.362852 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/10cdd157-8ffd-4a86-9dba-ac570a45273b-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"10cdd157-8ffd-4a86-9dba-ac570a45273b\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:38:37 crc kubenswrapper[5120]: I0316 16:38:37.363406 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/10cdd157-8ffd-4a86-9dba-ac570a45273b-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"10cdd157-8ffd-4a86-9dba-ac570a45273b\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:38:37 crc kubenswrapper[5120]: I0316 16:38:37.364267 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/10cdd157-8ffd-4a86-9dba-ac570a45273b-config\") pod \"ovsdbserver-sb-0\" (UID: \"10cdd157-8ffd-4a86-9dba-ac570a45273b\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:38:37 crc kubenswrapper[5120]: I0316 16:38:37.365644 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"ovsdbserver-sb-0\" (UID: \"10cdd157-8ffd-4a86-9dba-ac570a45273b\") device mount path \"/mnt/openstack/pv12\"" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:38:37 crc kubenswrapper[5120]: I0316 16:38:37.366304 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/10cdd157-8ffd-4a86-9dba-ac570a45273b-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"10cdd157-8ffd-4a86-9dba-ac570a45273b\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:38:37 crc kubenswrapper[5120]: I0316 16:38:37.368607 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/10cdd157-8ffd-4a86-9dba-ac570a45273b-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"10cdd157-8ffd-4a86-9dba-ac570a45273b\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:38:37 crc kubenswrapper[5120]: I0316 16:38:37.368685 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/10cdd157-8ffd-4a86-9dba-ac570a45273b-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"10cdd157-8ffd-4a86-9dba-ac570a45273b\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:38:37 crc kubenswrapper[5120]: I0316 16:38:37.369876 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/10cdd157-8ffd-4a86-9dba-ac570a45273b-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"10cdd157-8ffd-4a86-9dba-ac570a45273b\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:38:37 crc kubenswrapper[5120]: I0316 16:38:37.386878 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nl8pw\" (UniqueName: \"kubernetes.io/projected/10cdd157-8ffd-4a86-9dba-ac570a45273b-kube-api-access-nl8pw\") pod \"ovsdbserver-sb-0\" (UID: \"10cdd157-8ffd-4a86-9dba-ac570a45273b\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:38:37 crc kubenswrapper[5120]: I0316 16:38:37.388779 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"ovsdbserver-sb-0\" (UID: \"10cdd157-8ffd-4a86-9dba-ac570a45273b\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:38:37 crc kubenswrapper[5120]: I0316 16:38:37.567283 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:38:37 crc kubenswrapper[5120]: I0316 16:38:37.786546 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 16:38:37 crc kubenswrapper[5120]: W0316 16:38:37.797772 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9d23b8a0_3a5f_4bb9_84a7_f5602e4a98b0.slice/crio-6e4fa18f315031b45aad276a76adebeb49f5a1524109f3acca7bfa3f68c0e00c WatchSource:0}: Error finding container 6e4fa18f315031b45aad276a76adebeb49f5a1524109f3acca7bfa3f68c0e00c: Status 404 returned error can't find the container with id 6e4fa18f315031b45aad276a76adebeb49f5a1524109f3acca7bfa3f68c0e00c Mar 16 16:38:37 crc kubenswrapper[5120]: I0316 16:38:37.815891 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 16:38:37 crc kubenswrapper[5120]: W0316 16:38:37.821596 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod10cdd157_8ffd_4a86_9dba_ac570a45273b.slice/crio-9539eacb6b208c3019aabeddb13fe94c6276ddf94e89e18504dd592ca8144f3f WatchSource:0}: Error finding container 9539eacb6b208c3019aabeddb13fe94c6276ddf94e89e18504dd592ca8144f3f: Status 404 returned error can't find the container with id 9539eacb6b208c3019aabeddb13fe94c6276ddf94e89e18504dd592ca8144f3f Mar 16 16:38:38 crc kubenswrapper[5120]: I0316 16:38:38.326062 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"10cdd157-8ffd-4a86-9dba-ac570a45273b","Type":"ContainerStarted","Data":"b5e1f012279bd50c0f6dd58081fae905fbd9dd2443094c84fcca48be455d262e"} Mar 16 16:38:38 crc kubenswrapper[5120]: I0316 16:38:38.326447 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"10cdd157-8ffd-4a86-9dba-ac570a45273b","Type":"ContainerStarted","Data":"91db5da9c2c16a0ddc0621d66df7fe0db6a0c98754c249f4f2ac5a8195fade13"} Mar 16 16:38:38 crc kubenswrapper[5120]: I0316 16:38:38.326464 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"10cdd157-8ffd-4a86-9dba-ac570a45273b","Type":"ContainerStarted","Data":"9539eacb6b208c3019aabeddb13fe94c6276ddf94e89e18504dd592ca8144f3f"} Mar 16 16:38:38 crc kubenswrapper[5120]: I0316 16:38:38.330502 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"9d23b8a0-3a5f-4bb9-84a7-f5602e4a98b0","Type":"ContainerStarted","Data":"7befb30786bb8581613c702d4f626d345db7f3e118cb4ff248d66ee187c3c334"} Mar 16 16:38:38 crc kubenswrapper[5120]: I0316 16:38:38.330550 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"9d23b8a0-3a5f-4bb9-84a7-f5602e4a98b0","Type":"ContainerStarted","Data":"d65c682ba8d5b9c2ab292d5eadb6afb5ebf5e5383178932398baa6bd606390df"} Mar 16 16:38:38 crc kubenswrapper[5120]: I0316 16:38:38.330565 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"9d23b8a0-3a5f-4bb9-84a7-f5602e4a98b0","Type":"ContainerStarted","Data":"6e4fa18f315031b45aad276a76adebeb49f5a1524109f3acca7bfa3f68c0e00c"} Mar 16 16:38:38 crc kubenswrapper[5120]: I0316 16:38:38.347246 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podStartSLOduration=2.347220922 podStartE2EDuration="2.347220922s" podCreationTimestamp="2026-03-16 16:38:36 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:38:38.342875968 +0000 UTC m=+4020.496807635" watchObservedRunningTime="2026-03-16 16:38:38.347220922 +0000 UTC m=+4020.501152579" Mar 16 16:38:38 crc kubenswrapper[5120]: I0316 16:38:38.372557 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podStartSLOduration=3.372532684 podStartE2EDuration="3.372532684s" podCreationTimestamp="2026-03-16 16:38:35 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:38:38.365735316 +0000 UTC m=+4020.519666973" watchObservedRunningTime="2026-03-16 16:38:38.372532684 +0000 UTC m=+4020.526464361" Mar 16 16:38:39 crc kubenswrapper[5120]: I0316 16:38:39.272607 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/memcached-0" Mar 16 16:38:40 crc kubenswrapper[5120]: I0316 16:38:40.061445 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:38:40 crc kubenswrapper[5120]: I0316 16:38:40.061530 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:38:40 crc kubenswrapper[5120]: I0316 16:38:40.280838 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:38:40 crc kubenswrapper[5120]: I0316 16:38:40.321354 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:38:40 crc kubenswrapper[5120]: I0316 16:38:40.362924 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:38:40 crc kubenswrapper[5120]: I0316 16:38:40.568430 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:38:40 crc kubenswrapper[5120]: I0316 16:38:40.607555 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:38:41 crc kubenswrapper[5120]: I0316 16:38:41.139632 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:38:41 crc kubenswrapper[5120]: I0316 16:38:41.140143 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:38:41 crc kubenswrapper[5120]: I0316 16:38:41.380985 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:38:42 crc kubenswrapper[5120]: I0316 16:38:42.369605 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:38:42 crc kubenswrapper[5120]: I0316 16:38:42.427854 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:38:42 crc kubenswrapper[5120]: I0316 16:38:42.483454 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:38:43 crc kubenswrapper[5120]: I0316 16:38:43.415544 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:38:43 crc kubenswrapper[5120]: I0316 16:38:43.500661 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:38:46 crc kubenswrapper[5120]: I0316 16:38:46.423422 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:38:46 crc kubenswrapper[5120]: I0316 16:38:46.546014 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 16:38:46 crc kubenswrapper[5120]: I0316 16:38:46.559890 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:38:46 crc kubenswrapper[5120]: I0316 16:38:46.562077 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ovnnorthd-ovnnorthd-dockercfg-wc6lb\"" Mar 16 16:38:46 crc kubenswrapper[5120]: I0316 16:38:46.562083 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovnnorthd-config\"" Mar 16 16:38:46 crc kubenswrapper[5120]: I0316 16:38:46.563031 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovnnorthd-scripts\"" Mar 16 16:38:46 crc kubenswrapper[5120]: I0316 16:38:46.565713 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ovnnorthd-ovndbs\"" Mar 16 16:38:46 crc kubenswrapper[5120]: I0316 16:38:46.581713 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 16:38:46 crc kubenswrapper[5120]: I0316 16:38:46.666529 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/29c96611-b802-4cfa-a407-7e3c1f341848-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"29c96611-b802-4cfa-a407-7e3c1f341848\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:38:46 crc kubenswrapper[5120]: I0316 16:38:46.666723 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/29c96611-b802-4cfa-a407-7e3c1f341848-config\") pod \"ovn-northd-0\" (UID: \"29c96611-b802-4cfa-a407-7e3c1f341848\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:38:46 crc kubenswrapper[5120]: I0316 16:38:46.666955 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mt8j\" (UniqueName: \"kubernetes.io/projected/29c96611-b802-4cfa-a407-7e3c1f341848-kube-api-access-7mt8j\") pod \"ovn-northd-0\" (UID: \"29c96611-b802-4cfa-a407-7e3c1f341848\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:38:46 crc kubenswrapper[5120]: I0316 16:38:46.667018 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/29c96611-b802-4cfa-a407-7e3c1f341848-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"29c96611-b802-4cfa-a407-7e3c1f341848\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:38:46 crc kubenswrapper[5120]: I0316 16:38:46.667202 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/29c96611-b802-4cfa-a407-7e3c1f341848-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"29c96611-b802-4cfa-a407-7e3c1f341848\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:38:46 crc kubenswrapper[5120]: I0316 16:38:46.667505 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/29c96611-b802-4cfa-a407-7e3c1f341848-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"29c96611-b802-4cfa-a407-7e3c1f341848\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:38:46 crc kubenswrapper[5120]: I0316 16:38:46.667616 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/29c96611-b802-4cfa-a407-7e3c1f341848-scripts\") pod \"ovn-northd-0\" (UID: \"29c96611-b802-4cfa-a407-7e3c1f341848\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:38:46 crc kubenswrapper[5120]: I0316 16:38:46.769173 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/29c96611-b802-4cfa-a407-7e3c1f341848-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"29c96611-b802-4cfa-a407-7e3c1f341848\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:38:46 crc kubenswrapper[5120]: I0316 16:38:46.769250 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/29c96611-b802-4cfa-a407-7e3c1f341848-config\") pod \"ovn-northd-0\" (UID: \"29c96611-b802-4cfa-a407-7e3c1f341848\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:38:46 crc kubenswrapper[5120]: I0316 16:38:46.769321 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7mt8j\" (UniqueName: \"kubernetes.io/projected/29c96611-b802-4cfa-a407-7e3c1f341848-kube-api-access-7mt8j\") pod \"ovn-northd-0\" (UID: \"29c96611-b802-4cfa-a407-7e3c1f341848\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:38:46 crc kubenswrapper[5120]: I0316 16:38:46.769350 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/29c96611-b802-4cfa-a407-7e3c1f341848-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"29c96611-b802-4cfa-a407-7e3c1f341848\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:38:46 crc kubenswrapper[5120]: I0316 16:38:46.770288 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/29c96611-b802-4cfa-a407-7e3c1f341848-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"29c96611-b802-4cfa-a407-7e3c1f341848\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:38:46 crc kubenswrapper[5120]: I0316 16:38:46.770457 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/29c96611-b802-4cfa-a407-7e3c1f341848-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"29c96611-b802-4cfa-a407-7e3c1f341848\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:38:46 crc kubenswrapper[5120]: I0316 16:38:46.770519 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/29c96611-b802-4cfa-a407-7e3c1f341848-scripts\") pod \"ovn-northd-0\" (UID: \"29c96611-b802-4cfa-a407-7e3c1f341848\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:38:46 crc kubenswrapper[5120]: I0316 16:38:46.770584 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/29c96611-b802-4cfa-a407-7e3c1f341848-config\") pod \"ovn-northd-0\" (UID: \"29c96611-b802-4cfa-a407-7e3c1f341848\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:38:46 crc kubenswrapper[5120]: I0316 16:38:46.770960 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/29c96611-b802-4cfa-a407-7e3c1f341848-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"29c96611-b802-4cfa-a407-7e3c1f341848\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:38:46 crc kubenswrapper[5120]: I0316 16:38:46.771673 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/29c96611-b802-4cfa-a407-7e3c1f341848-scripts\") pod \"ovn-northd-0\" (UID: \"29c96611-b802-4cfa-a407-7e3c1f341848\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:38:46 crc kubenswrapper[5120]: I0316 16:38:46.775497 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/29c96611-b802-4cfa-a407-7e3c1f341848-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"29c96611-b802-4cfa-a407-7e3c1f341848\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:38:46 crc kubenswrapper[5120]: I0316 16:38:46.775504 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/29c96611-b802-4cfa-a407-7e3c1f341848-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"29c96611-b802-4cfa-a407-7e3c1f341848\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:38:46 crc kubenswrapper[5120]: I0316 16:38:46.782486 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/29c96611-b802-4cfa-a407-7e3c1f341848-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"29c96611-b802-4cfa-a407-7e3c1f341848\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:38:46 crc kubenswrapper[5120]: I0316 16:38:46.786879 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mt8j\" (UniqueName: \"kubernetes.io/projected/29c96611-b802-4cfa-a407-7e3c1f341848-kube-api-access-7mt8j\") pod \"ovn-northd-0\" (UID: \"29c96611-b802-4cfa-a407-7e3c1f341848\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:38:46 crc kubenswrapper[5120]: I0316 16:38:46.882850 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:38:47 crc kubenswrapper[5120]: W0316 16:38:47.351067 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod29c96611_b802_4cfa_a407_7e3c1f341848.slice/crio-59f2debbe0e3d681b420230a19598a1e89458db27bca92b8e7a58a474525cb81 WatchSource:0}: Error finding container 59f2debbe0e3d681b420230a19598a1e89458db27bca92b8e7a58a474525cb81: Status 404 returned error can't find the container with id 59f2debbe0e3d681b420230a19598a1e89458db27bca92b8e7a58a474525cb81 Mar 16 16:38:47 crc kubenswrapper[5120]: I0316 16:38:47.352364 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 16:38:47 crc kubenswrapper[5120]: I0316 16:38:47.434452 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"29c96611-b802-4cfa-a407-7e3c1f341848","Type":"ContainerStarted","Data":"59f2debbe0e3d681b420230a19598a1e89458db27bca92b8e7a58a474525cb81"} Mar 16 16:38:48 crc kubenswrapper[5120]: I0316 16:38:48.446666 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"29c96611-b802-4cfa-a407-7e3c1f341848","Type":"ContainerStarted","Data":"f6f06b9ba370a060b54ec647220d7623fff9a52a71dc33409e4d941230f65d72"} Mar 16 16:38:48 crc kubenswrapper[5120]: I0316 16:38:48.447190 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:38:48 crc kubenswrapper[5120]: I0316 16:38:48.447226 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"29c96611-b802-4cfa-a407-7e3c1f341848","Type":"ContainerStarted","Data":"34d1842c49bbc63c0f0f4b2770fad4a83f430656dde3d2f187493191f00bdfe3"} Mar 16 16:38:48 crc kubenswrapper[5120]: I0316 16:38:48.475511 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovn-northd-0" podStartSLOduration=2.475483871 podStartE2EDuration="2.475483871s" podCreationTimestamp="2026-03-16 16:38:46 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:38:48.469367882 +0000 UTC m=+4030.623299619" watchObservedRunningTime="2026-03-16 16:38:48.475483871 +0000 UTC m=+4030.629415568" Mar 16 16:38:48 crc kubenswrapper[5120]: I0316 16:38:48.690978 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/root-account-create-update-ldg6b"] Mar 16 16:38:48 crc kubenswrapper[5120]: I0316 16:38:48.704661 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-ldg6b"] Mar 16 16:38:48 crc kubenswrapper[5120]: I0316 16:38:48.704979 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-ldg6b" Mar 16 16:38:48 crc kubenswrapper[5120]: I0316 16:38:48.707081 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"openstack-mariadb-root-db-secret\"" Mar 16 16:38:48 crc kubenswrapper[5120]: I0316 16:38:48.821577 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zx7p6\" (UniqueName: \"kubernetes.io/projected/a24750f0-bb79-4138-b07c-628798939f32-kube-api-access-zx7p6\") pod \"root-account-create-update-ldg6b\" (UID: \"a24750f0-bb79-4138-b07c-628798939f32\") " pod="openstack-kuttl-tests/root-account-create-update-ldg6b" Mar 16 16:38:48 crc kubenswrapper[5120]: I0316 16:38:48.821851 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a24750f0-bb79-4138-b07c-628798939f32-operator-scripts\") pod \"root-account-create-update-ldg6b\" (UID: \"a24750f0-bb79-4138-b07c-628798939f32\") " pod="openstack-kuttl-tests/root-account-create-update-ldg6b" Mar 16 16:38:48 crc kubenswrapper[5120]: I0316 16:38:48.925347 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zx7p6\" (UniqueName: \"kubernetes.io/projected/a24750f0-bb79-4138-b07c-628798939f32-kube-api-access-zx7p6\") pod \"root-account-create-update-ldg6b\" (UID: \"a24750f0-bb79-4138-b07c-628798939f32\") " pod="openstack-kuttl-tests/root-account-create-update-ldg6b" Mar 16 16:38:48 crc kubenswrapper[5120]: I0316 16:38:48.925522 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a24750f0-bb79-4138-b07c-628798939f32-operator-scripts\") pod \"root-account-create-update-ldg6b\" (UID: \"a24750f0-bb79-4138-b07c-628798939f32\") " pod="openstack-kuttl-tests/root-account-create-update-ldg6b" Mar 16 16:38:48 crc kubenswrapper[5120]: I0316 16:38:48.926625 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a24750f0-bb79-4138-b07c-628798939f32-operator-scripts\") pod \"root-account-create-update-ldg6b\" (UID: \"a24750f0-bb79-4138-b07c-628798939f32\") " pod="openstack-kuttl-tests/root-account-create-update-ldg6b" Mar 16 16:38:48 crc kubenswrapper[5120]: I0316 16:38:48.943627 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zx7p6\" (UniqueName: \"kubernetes.io/projected/a24750f0-bb79-4138-b07c-628798939f32-kube-api-access-zx7p6\") pod \"root-account-create-update-ldg6b\" (UID: \"a24750f0-bb79-4138-b07c-628798939f32\") " pod="openstack-kuttl-tests/root-account-create-update-ldg6b" Mar 16 16:38:49 crc kubenswrapper[5120]: I0316 16:38:49.021649 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-ldg6b" Mar 16 16:38:49 crc kubenswrapper[5120]: I0316 16:38:49.471239 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-ldg6b"] Mar 16 16:38:50 crc kubenswrapper[5120]: I0316 16:38:50.467043 5120 generic.go:358] "Generic (PLEG): container finished" podID="a24750f0-bb79-4138-b07c-628798939f32" containerID="9fafffe8e551ef6b479e3dc0200fa80bb8633e25a9651a938e66de976a4120f1" exitCode=0 Mar 16 16:38:50 crc kubenswrapper[5120]: I0316 16:38:50.467195 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-ldg6b" event={"ID":"a24750f0-bb79-4138-b07c-628798939f32","Type":"ContainerDied","Data":"9fafffe8e551ef6b479e3dc0200fa80bb8633e25a9651a938e66de976a4120f1"} Mar 16 16:38:50 crc kubenswrapper[5120]: I0316 16:38:50.467638 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-ldg6b" event={"ID":"a24750f0-bb79-4138-b07c-628798939f32","Type":"ContainerStarted","Data":"0724e5a691d252115533699d154e03e50aedcd211669dab37fb3168cf5f110a4"} Mar 16 16:38:51 crc kubenswrapper[5120]: I0316 16:38:51.900274 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-ldg6b" Mar 16 16:38:52 crc kubenswrapper[5120]: I0316 16:38:52.002335 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a24750f0-bb79-4138-b07c-628798939f32-operator-scripts\") pod \"a24750f0-bb79-4138-b07c-628798939f32\" (UID: \"a24750f0-bb79-4138-b07c-628798939f32\") " Mar 16 16:38:52 crc kubenswrapper[5120]: I0316 16:38:52.002568 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zx7p6\" (UniqueName: \"kubernetes.io/projected/a24750f0-bb79-4138-b07c-628798939f32-kube-api-access-zx7p6\") pod \"a24750f0-bb79-4138-b07c-628798939f32\" (UID: \"a24750f0-bb79-4138-b07c-628798939f32\") " Mar 16 16:38:52 crc kubenswrapper[5120]: I0316 16:38:52.003178 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a24750f0-bb79-4138-b07c-628798939f32-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "a24750f0-bb79-4138-b07c-628798939f32" (UID: "a24750f0-bb79-4138-b07c-628798939f32"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:38:52 crc kubenswrapper[5120]: I0316 16:38:52.012567 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a24750f0-bb79-4138-b07c-628798939f32-kube-api-access-zx7p6" (OuterVolumeSpecName: "kube-api-access-zx7p6") pod "a24750f0-bb79-4138-b07c-628798939f32" (UID: "a24750f0-bb79-4138-b07c-628798939f32"). InnerVolumeSpecName "kube-api-access-zx7p6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:38:52 crc kubenswrapper[5120]: I0316 16:38:52.105490 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a24750f0-bb79-4138-b07c-628798939f32-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:38:52 crc kubenswrapper[5120]: I0316 16:38:52.105542 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zx7p6\" (UniqueName: \"kubernetes.io/projected/a24750f0-bb79-4138-b07c-628798939f32-kube-api-access-zx7p6\") on node \"crc\" DevicePath \"\"" Mar 16 16:38:52 crc kubenswrapper[5120]: I0316 16:38:52.490132 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-ldg6b" Mar 16 16:38:52 crc kubenswrapper[5120]: I0316 16:38:52.490126 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-ldg6b" event={"ID":"a24750f0-bb79-4138-b07c-628798939f32","Type":"ContainerDied","Data":"0724e5a691d252115533699d154e03e50aedcd211669dab37fb3168cf5f110a4"} Mar 16 16:38:52 crc kubenswrapper[5120]: I0316 16:38:52.490214 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0724e5a691d252115533699d154e03e50aedcd211669dab37fb3168cf5f110a4" Mar 16 16:38:54 crc kubenswrapper[5120]: I0316 16:38:54.757422 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-ldg6b"] Mar 16 16:38:54 crc kubenswrapper[5120]: I0316 16:38:54.765876 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-ldg6b"] Mar 16 16:38:56 crc kubenswrapper[5120]: I0316 16:38:56.676149 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a24750f0-bb79-4138-b07c-628798939f32" path="/var/lib/kubelet/pods/a24750f0-bb79-4138-b07c-628798939f32/volumes" Mar 16 16:38:59 crc kubenswrapper[5120]: I0316 16:38:59.531707 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:38:59 crc kubenswrapper[5120]: I0316 16:38:59.757954 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/root-account-create-update-q2nv5"] Mar 16 16:38:59 crc kubenswrapper[5120]: I0316 16:38:59.759376 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a24750f0-bb79-4138-b07c-628798939f32" containerName="mariadb-account-create-update" Mar 16 16:38:59 crc kubenswrapper[5120]: I0316 16:38:59.759410 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a24750f0-bb79-4138-b07c-628798939f32" containerName="mariadb-account-create-update" Mar 16 16:38:59 crc kubenswrapper[5120]: I0316 16:38:59.759734 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="a24750f0-bb79-4138-b07c-628798939f32" containerName="mariadb-account-create-update" Mar 16 16:38:59 crc kubenswrapper[5120]: I0316 16:38:59.764494 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-q2nv5" Mar 16 16:38:59 crc kubenswrapper[5120]: I0316 16:38:59.766366 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"openstack-cell1-mariadb-root-db-secret\"" Mar 16 16:38:59 crc kubenswrapper[5120]: I0316 16:38:59.771566 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-q2nv5"] Mar 16 16:38:59 crc kubenswrapper[5120]: I0316 16:38:59.772495 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wd5wd\" (UniqueName: \"kubernetes.io/projected/408d0cb7-eebd-4e62-9e6c-553fb62f178e-kube-api-access-wd5wd\") pod \"root-account-create-update-q2nv5\" (UID: \"408d0cb7-eebd-4e62-9e6c-553fb62f178e\") " pod="openstack-kuttl-tests/root-account-create-update-q2nv5" Mar 16 16:38:59 crc kubenswrapper[5120]: I0316 16:38:59.772590 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/408d0cb7-eebd-4e62-9e6c-553fb62f178e-operator-scripts\") pod \"root-account-create-update-q2nv5\" (UID: \"408d0cb7-eebd-4e62-9e6c-553fb62f178e\") " pod="openstack-kuttl-tests/root-account-create-update-q2nv5" Mar 16 16:38:59 crc kubenswrapper[5120]: I0316 16:38:59.874835 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wd5wd\" (UniqueName: \"kubernetes.io/projected/408d0cb7-eebd-4e62-9e6c-553fb62f178e-kube-api-access-wd5wd\") pod \"root-account-create-update-q2nv5\" (UID: \"408d0cb7-eebd-4e62-9e6c-553fb62f178e\") " pod="openstack-kuttl-tests/root-account-create-update-q2nv5" Mar 16 16:38:59 crc kubenswrapper[5120]: I0316 16:38:59.874944 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/408d0cb7-eebd-4e62-9e6c-553fb62f178e-operator-scripts\") pod \"root-account-create-update-q2nv5\" (UID: \"408d0cb7-eebd-4e62-9e6c-553fb62f178e\") " pod="openstack-kuttl-tests/root-account-create-update-q2nv5" Mar 16 16:38:59 crc kubenswrapper[5120]: I0316 16:38:59.875691 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/408d0cb7-eebd-4e62-9e6c-553fb62f178e-operator-scripts\") pod \"root-account-create-update-q2nv5\" (UID: \"408d0cb7-eebd-4e62-9e6c-553fb62f178e\") " pod="openstack-kuttl-tests/root-account-create-update-q2nv5" Mar 16 16:38:59 crc kubenswrapper[5120]: I0316 16:38:59.895409 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wd5wd\" (UniqueName: \"kubernetes.io/projected/408d0cb7-eebd-4e62-9e6c-553fb62f178e-kube-api-access-wd5wd\") pod \"root-account-create-update-q2nv5\" (UID: \"408d0cb7-eebd-4e62-9e6c-553fb62f178e\") " pod="openstack-kuttl-tests/root-account-create-update-q2nv5" Mar 16 16:39:00 crc kubenswrapper[5120]: I0316 16:39:00.087220 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-q2nv5" Mar 16 16:39:00 crc kubenswrapper[5120]: I0316 16:39:00.540278 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-q2nv5"] Mar 16 16:39:00 crc kubenswrapper[5120]: I0316 16:39:00.587414 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-q2nv5" event={"ID":"408d0cb7-eebd-4e62-9e6c-553fb62f178e","Type":"ContainerStarted","Data":"ec89d35dc9a97cbd573d79f108371889aab6a7f2f5b90ecb40cde8026bc624fe"} Mar 16 16:39:01 crc kubenswrapper[5120]: I0316 16:39:01.598482 5120 generic.go:358] "Generic (PLEG): container finished" podID="408d0cb7-eebd-4e62-9e6c-553fb62f178e" containerID="1978d7f9e8f99221895ea11f152efe0727ab985422889237aaa63909eda39aa9" exitCode=0 Mar 16 16:39:01 crc kubenswrapper[5120]: I0316 16:39:01.598552 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-q2nv5" event={"ID":"408d0cb7-eebd-4e62-9e6c-553fb62f178e","Type":"ContainerDied","Data":"1978d7f9e8f99221895ea11f152efe0727ab985422889237aaa63909eda39aa9"} Mar 16 16:39:02 crc kubenswrapper[5120]: I0316 16:39:02.608755 5120 generic.go:358] "Generic (PLEG): container finished" podID="55a201e2-20da-49c3-8216-77a042dd3b31" containerID="c6fda375b35e16e4fb06b0cea8967b8c44645e1996207efeefd6730aecf30eca" exitCode=0 Mar 16 16:39:02 crc kubenswrapper[5120]: I0316 16:39:02.608898 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"55a201e2-20da-49c3-8216-77a042dd3b31","Type":"ContainerDied","Data":"c6fda375b35e16e4fb06b0cea8967b8c44645e1996207efeefd6730aecf30eca"} Mar 16 16:39:02 crc kubenswrapper[5120]: I0316 16:39:02.611085 5120 generic.go:358] "Generic (PLEG): container finished" podID="c2f375f2-e474-4c66-ac4a-677606c3dd04" containerID="1a6633805f20ea052355fbcdd3c259a91fda0f13d270d62207216dd235e5324e" exitCode=0 Mar 16 16:39:02 crc kubenswrapper[5120]: I0316 16:39:02.611133 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"c2f375f2-e474-4c66-ac4a-677606c3dd04","Type":"ContainerDied","Data":"1a6633805f20ea052355fbcdd3c259a91fda0f13d270d62207216dd235e5324e"} Mar 16 16:39:02 crc kubenswrapper[5120]: I0316 16:39:02.911112 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-q2nv5" Mar 16 16:39:02 crc kubenswrapper[5120]: I0316 16:39:02.965407 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wd5wd\" (UniqueName: \"kubernetes.io/projected/408d0cb7-eebd-4e62-9e6c-553fb62f178e-kube-api-access-wd5wd\") pod \"408d0cb7-eebd-4e62-9e6c-553fb62f178e\" (UID: \"408d0cb7-eebd-4e62-9e6c-553fb62f178e\") " Mar 16 16:39:02 crc kubenswrapper[5120]: I0316 16:39:02.965664 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/408d0cb7-eebd-4e62-9e6c-553fb62f178e-operator-scripts\") pod \"408d0cb7-eebd-4e62-9e6c-553fb62f178e\" (UID: \"408d0cb7-eebd-4e62-9e6c-553fb62f178e\") " Mar 16 16:39:02 crc kubenswrapper[5120]: I0316 16:39:02.966666 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/408d0cb7-eebd-4e62-9e6c-553fb62f178e-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "408d0cb7-eebd-4e62-9e6c-553fb62f178e" (UID: "408d0cb7-eebd-4e62-9e6c-553fb62f178e"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:39:02 crc kubenswrapper[5120]: I0316 16:39:02.971640 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/408d0cb7-eebd-4e62-9e6c-553fb62f178e-kube-api-access-wd5wd" (OuterVolumeSpecName: "kube-api-access-wd5wd") pod "408d0cb7-eebd-4e62-9e6c-553fb62f178e" (UID: "408d0cb7-eebd-4e62-9e6c-553fb62f178e"). InnerVolumeSpecName "kube-api-access-wd5wd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:39:03 crc kubenswrapper[5120]: I0316 16:39:03.068330 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wd5wd\" (UniqueName: \"kubernetes.io/projected/408d0cb7-eebd-4e62-9e6c-553fb62f178e-kube-api-access-wd5wd\") on node \"crc\" DevicePath \"\"" Mar 16 16:39:03 crc kubenswrapper[5120]: I0316 16:39:03.068373 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/408d0cb7-eebd-4e62-9e6c-553fb62f178e-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:39:03 crc kubenswrapper[5120]: I0316 16:39:03.622434 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-q2nv5" event={"ID":"408d0cb7-eebd-4e62-9e6c-553fb62f178e","Type":"ContainerDied","Data":"ec89d35dc9a97cbd573d79f108371889aab6a7f2f5b90ecb40cde8026bc624fe"} Mar 16 16:39:03 crc kubenswrapper[5120]: I0316 16:39:03.622476 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ec89d35dc9a97cbd573d79f108371889aab6a7f2f5b90ecb40cde8026bc624fe" Mar 16 16:39:03 crc kubenswrapper[5120]: I0316 16:39:03.622549 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-q2nv5" Mar 16 16:39:03 crc kubenswrapper[5120]: I0316 16:39:03.631270 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"55a201e2-20da-49c3-8216-77a042dd3b31","Type":"ContainerStarted","Data":"724c0b5146b4e94ddc111cbeb4d390d8b4e39776e5bfd86f681203d76b6919bb"} Mar 16 16:39:03 crc kubenswrapper[5120]: I0316 16:39:03.631503 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:39:03 crc kubenswrapper[5120]: I0316 16:39:03.633597 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"c2f375f2-e474-4c66-ac4a-677606c3dd04","Type":"ContainerStarted","Data":"2b48b529e5492ed4f7a9f901044b2e5f7de153b961f562c3842cb58602e8567f"} Mar 16 16:39:03 crc kubenswrapper[5120]: I0316 16:39:03.633842 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:39:03 crc kubenswrapper[5120]: I0316 16:39:03.662197 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/rabbitmq-server-0" podStartSLOduration=36.662174593 podStartE2EDuration="36.662174593s" podCreationTimestamp="2026-03-16 16:38:27 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:39:03.657310925 +0000 UTC m=+4045.811242592" watchObservedRunningTime="2026-03-16 16:39:03.662174593 +0000 UTC m=+4045.816106250" Mar 16 16:39:03 crc kubenswrapper[5120]: I0316 16:39:03.679939 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" podStartSLOduration=37.679921727 podStartE2EDuration="37.679921727s" podCreationTimestamp="2026-03-16 16:38:26 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:39:03.674237739 +0000 UTC m=+4045.828169406" watchObservedRunningTime="2026-03-16 16:39:03.679921727 +0000 UTC m=+4045.833853384" Mar 16 16:39:07 crc kubenswrapper[5120]: E0316 16:39:07.978690 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1423181 actualBytes=10240 Mar 16 16:39:14 crc kubenswrapper[5120]: I0316 16:39:14.645091 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:39:14 crc kubenswrapper[5120]: I0316 16:39:14.645733 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:39:18 crc kubenswrapper[5120]: I0316 16:39:18.397941 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-db-create-rv5rl"] Mar 16 16:39:18 crc kubenswrapper[5120]: I0316 16:39:18.399733 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="408d0cb7-eebd-4e62-9e6c-553fb62f178e" containerName="mariadb-account-create-update" Mar 16 16:39:18 crc kubenswrapper[5120]: I0316 16:39:18.399780 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="408d0cb7-eebd-4e62-9e6c-553fb62f178e" containerName="mariadb-account-create-update" Mar 16 16:39:18 crc kubenswrapper[5120]: I0316 16:39:18.399996 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="408d0cb7-eebd-4e62-9e6c-553fb62f178e" containerName="mariadb-account-create-update" Mar 16 16:39:18 crc kubenswrapper[5120]: I0316 16:39:18.421861 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-db-create-rv5rl"] Mar 16 16:39:18 crc kubenswrapper[5120]: I0316 16:39:18.422022 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-create-rv5rl" Mar 16 16:39:18 crc kubenswrapper[5120]: I0316 16:39:18.506801 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-454d-account-create-update-rqbdt"] Mar 16 16:39:18 crc kubenswrapper[5120]: I0316 16:39:18.513682 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-454d-account-create-update-rqbdt" Mar 16 16:39:18 crc kubenswrapper[5120]: I0316 16:39:18.515732 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-db-secret\"" Mar 16 16:39:18 crc kubenswrapper[5120]: I0316 16:39:18.518118 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-454d-account-create-update-rqbdt"] Mar 16 16:39:18 crc kubenswrapper[5120]: I0316 16:39:18.580905 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9jgz\" (UniqueName: \"kubernetes.io/projected/86673db2-3d2b-4864-ae11-c6895dc677d2-kube-api-access-g9jgz\") pod \"keystone-db-create-rv5rl\" (UID: \"86673db2-3d2b-4864-ae11-c6895dc677d2\") " pod="openstack-kuttl-tests/keystone-db-create-rv5rl" Mar 16 16:39:18 crc kubenswrapper[5120]: I0316 16:39:18.581218 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/86673db2-3d2b-4864-ae11-c6895dc677d2-operator-scripts\") pod \"keystone-db-create-rv5rl\" (UID: \"86673db2-3d2b-4864-ae11-c6895dc677d2\") " pod="openstack-kuttl-tests/keystone-db-create-rv5rl" Mar 16 16:39:18 crc kubenswrapper[5120]: I0316 16:39:18.683265 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2abd03fd-0270-463a-a9ca-95c22226e8ec-operator-scripts\") pod \"keystone-454d-account-create-update-rqbdt\" (UID: \"2abd03fd-0270-463a-a9ca-95c22226e8ec\") " pod="openstack-kuttl-tests/keystone-454d-account-create-update-rqbdt" Mar 16 16:39:18 crc kubenswrapper[5120]: I0316 16:39:18.683409 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g9jgz\" (UniqueName: \"kubernetes.io/projected/86673db2-3d2b-4864-ae11-c6895dc677d2-kube-api-access-g9jgz\") pod \"keystone-db-create-rv5rl\" (UID: \"86673db2-3d2b-4864-ae11-c6895dc677d2\") " pod="openstack-kuttl-tests/keystone-db-create-rv5rl" Mar 16 16:39:18 crc kubenswrapper[5120]: I0316 16:39:18.683558 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9j85b\" (UniqueName: \"kubernetes.io/projected/2abd03fd-0270-463a-a9ca-95c22226e8ec-kube-api-access-9j85b\") pod \"keystone-454d-account-create-update-rqbdt\" (UID: \"2abd03fd-0270-463a-a9ca-95c22226e8ec\") " pod="openstack-kuttl-tests/keystone-454d-account-create-update-rqbdt" Mar 16 16:39:18 crc kubenswrapper[5120]: I0316 16:39:18.683635 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/86673db2-3d2b-4864-ae11-c6895dc677d2-operator-scripts\") pod \"keystone-db-create-rv5rl\" (UID: \"86673db2-3d2b-4864-ae11-c6895dc677d2\") " pod="openstack-kuttl-tests/keystone-db-create-rv5rl" Mar 16 16:39:18 crc kubenswrapper[5120]: I0316 16:39:18.684694 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/86673db2-3d2b-4864-ae11-c6895dc677d2-operator-scripts\") pod \"keystone-db-create-rv5rl\" (UID: \"86673db2-3d2b-4864-ae11-c6895dc677d2\") " pod="openstack-kuttl-tests/keystone-db-create-rv5rl" Mar 16 16:39:18 crc kubenswrapper[5120]: I0316 16:39:18.706729 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-db-create-52jsz"] Mar 16 16:39:18 crc kubenswrapper[5120]: I0316 16:39:18.714253 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-create-52jsz" Mar 16 16:39:18 crc kubenswrapper[5120]: I0316 16:39:18.716030 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9jgz\" (UniqueName: \"kubernetes.io/projected/86673db2-3d2b-4864-ae11-c6895dc677d2-kube-api-access-g9jgz\") pod \"keystone-db-create-rv5rl\" (UID: \"86673db2-3d2b-4864-ae11-c6895dc677d2\") " pod="openstack-kuttl-tests/keystone-db-create-rv5rl" Mar 16 16:39:18 crc kubenswrapper[5120]: I0316 16:39:18.724377 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-db-create-52jsz"] Mar 16 16:39:18 crc kubenswrapper[5120]: I0316 16:39:18.733331 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-e32b-account-create-update-mlh9x"] Mar 16 16:39:18 crc kubenswrapper[5120]: I0316 16:39:18.738859 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-e32b-account-create-update-mlh9x" Mar 16 16:39:18 crc kubenswrapper[5120]: I0316 16:39:18.741225 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-db-secret\"" Mar 16 16:39:18 crc kubenswrapper[5120]: I0316 16:39:18.742522 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-create-rv5rl" Mar 16 16:39:18 crc kubenswrapper[5120]: I0316 16:39:18.766737 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-e32b-account-create-update-mlh9x"] Mar 16 16:39:18 crc kubenswrapper[5120]: I0316 16:39:18.789660 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2abd03fd-0270-463a-a9ca-95c22226e8ec-operator-scripts\") pod \"keystone-454d-account-create-update-rqbdt\" (UID: \"2abd03fd-0270-463a-a9ca-95c22226e8ec\") " pod="openstack-kuttl-tests/keystone-454d-account-create-update-rqbdt" Mar 16 16:39:18 crc kubenswrapper[5120]: I0316 16:39:18.790017 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9j85b\" (UniqueName: \"kubernetes.io/projected/2abd03fd-0270-463a-a9ca-95c22226e8ec-kube-api-access-9j85b\") pod \"keystone-454d-account-create-update-rqbdt\" (UID: \"2abd03fd-0270-463a-a9ca-95c22226e8ec\") " pod="openstack-kuttl-tests/keystone-454d-account-create-update-rqbdt" Mar 16 16:39:18 crc kubenswrapper[5120]: I0316 16:39:18.791612 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2abd03fd-0270-463a-a9ca-95c22226e8ec-operator-scripts\") pod \"keystone-454d-account-create-update-rqbdt\" (UID: \"2abd03fd-0270-463a-a9ca-95c22226e8ec\") " pod="openstack-kuttl-tests/keystone-454d-account-create-update-rqbdt" Mar 16 16:39:18 crc kubenswrapper[5120]: I0316 16:39:18.823319 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9j85b\" (UniqueName: \"kubernetes.io/projected/2abd03fd-0270-463a-a9ca-95c22226e8ec-kube-api-access-9j85b\") pod \"keystone-454d-account-create-update-rqbdt\" (UID: \"2abd03fd-0270-463a-a9ca-95c22226e8ec\") " pod="openstack-kuttl-tests/keystone-454d-account-create-update-rqbdt" Mar 16 16:39:18 crc kubenswrapper[5120]: I0316 16:39:18.835110 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-454d-account-create-update-rqbdt" Mar 16 16:39:18 crc kubenswrapper[5120]: I0316 16:39:18.895574 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmzt6\" (UniqueName: \"kubernetes.io/projected/93a2b4d2-8481-44a9-8d12-62db95189e45-kube-api-access-lmzt6\") pod \"placement-e32b-account-create-update-mlh9x\" (UID: \"93a2b4d2-8481-44a9-8d12-62db95189e45\") " pod="openstack-kuttl-tests/placement-e32b-account-create-update-mlh9x" Mar 16 16:39:18 crc kubenswrapper[5120]: I0316 16:39:18.896220 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/93a2b4d2-8481-44a9-8d12-62db95189e45-operator-scripts\") pod \"placement-e32b-account-create-update-mlh9x\" (UID: \"93a2b4d2-8481-44a9-8d12-62db95189e45\") " pod="openstack-kuttl-tests/placement-e32b-account-create-update-mlh9x" Mar 16 16:39:18 crc kubenswrapper[5120]: I0316 16:39:18.896714 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2lqj\" (UniqueName: \"kubernetes.io/projected/9aa6ed1b-b014-4ff6-97aa-387eceb58d13-kube-api-access-p2lqj\") pod \"placement-db-create-52jsz\" (UID: \"9aa6ed1b-b014-4ff6-97aa-387eceb58d13\") " pod="openstack-kuttl-tests/placement-db-create-52jsz" Mar 16 16:39:18 crc kubenswrapper[5120]: I0316 16:39:18.896973 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9aa6ed1b-b014-4ff6-97aa-387eceb58d13-operator-scripts\") pod \"placement-db-create-52jsz\" (UID: \"9aa6ed1b-b014-4ff6-97aa-387eceb58d13\") " pod="openstack-kuttl-tests/placement-db-create-52jsz" Mar 16 16:39:19 crc kubenswrapper[5120]: I0316 16:39:19.001865 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9aa6ed1b-b014-4ff6-97aa-387eceb58d13-operator-scripts\") pod \"placement-db-create-52jsz\" (UID: \"9aa6ed1b-b014-4ff6-97aa-387eceb58d13\") " pod="openstack-kuttl-tests/placement-db-create-52jsz" Mar 16 16:39:19 crc kubenswrapper[5120]: I0316 16:39:19.002056 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lmzt6\" (UniqueName: \"kubernetes.io/projected/93a2b4d2-8481-44a9-8d12-62db95189e45-kube-api-access-lmzt6\") pod \"placement-e32b-account-create-update-mlh9x\" (UID: \"93a2b4d2-8481-44a9-8d12-62db95189e45\") " pod="openstack-kuttl-tests/placement-e32b-account-create-update-mlh9x" Mar 16 16:39:19 crc kubenswrapper[5120]: I0316 16:39:19.002082 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/93a2b4d2-8481-44a9-8d12-62db95189e45-operator-scripts\") pod \"placement-e32b-account-create-update-mlh9x\" (UID: \"93a2b4d2-8481-44a9-8d12-62db95189e45\") " pod="openstack-kuttl-tests/placement-e32b-account-create-update-mlh9x" Mar 16 16:39:19 crc kubenswrapper[5120]: I0316 16:39:19.002147 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p2lqj\" (UniqueName: \"kubernetes.io/projected/9aa6ed1b-b014-4ff6-97aa-387eceb58d13-kube-api-access-p2lqj\") pod \"placement-db-create-52jsz\" (UID: \"9aa6ed1b-b014-4ff6-97aa-387eceb58d13\") " pod="openstack-kuttl-tests/placement-db-create-52jsz" Mar 16 16:39:19 crc kubenswrapper[5120]: I0316 16:39:19.003213 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9aa6ed1b-b014-4ff6-97aa-387eceb58d13-operator-scripts\") pod \"placement-db-create-52jsz\" (UID: \"9aa6ed1b-b014-4ff6-97aa-387eceb58d13\") " pod="openstack-kuttl-tests/placement-db-create-52jsz" Mar 16 16:39:19 crc kubenswrapper[5120]: I0316 16:39:19.003293 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/93a2b4d2-8481-44a9-8d12-62db95189e45-operator-scripts\") pod \"placement-e32b-account-create-update-mlh9x\" (UID: \"93a2b4d2-8481-44a9-8d12-62db95189e45\") " pod="openstack-kuttl-tests/placement-e32b-account-create-update-mlh9x" Mar 16 16:39:19 crc kubenswrapper[5120]: I0316 16:39:19.025237 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmzt6\" (UniqueName: \"kubernetes.io/projected/93a2b4d2-8481-44a9-8d12-62db95189e45-kube-api-access-lmzt6\") pod \"placement-e32b-account-create-update-mlh9x\" (UID: \"93a2b4d2-8481-44a9-8d12-62db95189e45\") " pod="openstack-kuttl-tests/placement-e32b-account-create-update-mlh9x" Mar 16 16:39:19 crc kubenswrapper[5120]: I0316 16:39:19.039129 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2lqj\" (UniqueName: \"kubernetes.io/projected/9aa6ed1b-b014-4ff6-97aa-387eceb58d13-kube-api-access-p2lqj\") pod \"placement-db-create-52jsz\" (UID: \"9aa6ed1b-b014-4ff6-97aa-387eceb58d13\") " pod="openstack-kuttl-tests/placement-db-create-52jsz" Mar 16 16:39:19 crc kubenswrapper[5120]: I0316 16:39:19.134819 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-db-create-rl5vf"] Mar 16 16:39:19 crc kubenswrapper[5120]: I0316 16:39:19.145283 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-create-rl5vf" Mar 16 16:39:19 crc kubenswrapper[5120]: I0316 16:39:19.154573 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-db-create-rl5vf"] Mar 16 16:39:19 crc kubenswrapper[5120]: I0316 16:39:19.172016 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-create-52jsz" Mar 16 16:39:19 crc kubenswrapper[5120]: I0316 16:39:19.188329 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-e32b-account-create-update-mlh9x" Mar 16 16:39:19 crc kubenswrapper[5120]: I0316 16:39:19.250945 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-be30-account-create-update-fq9th"] Mar 16 16:39:19 crc kubenswrapper[5120]: I0316 16:39:19.262675 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-be30-account-create-update-fq9th"] Mar 16 16:39:19 crc kubenswrapper[5120]: I0316 16:39:19.262819 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-be30-account-create-update-fq9th" Mar 16 16:39:19 crc kubenswrapper[5120]: I0316 16:39:19.265459 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-db-secret\"" Mar 16 16:39:19 crc kubenswrapper[5120]: I0316 16:39:19.309102 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ll8gw\" (UniqueName: \"kubernetes.io/projected/9ba55b11-2c75-4cfa-9cfc-be73cefc163c-kube-api-access-ll8gw\") pod \"glance-db-create-rl5vf\" (UID: \"9ba55b11-2c75-4cfa-9cfc-be73cefc163c\") " pod="openstack-kuttl-tests/glance-db-create-rl5vf" Mar 16 16:39:19 crc kubenswrapper[5120]: I0316 16:39:19.309300 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9ba55b11-2c75-4cfa-9cfc-be73cefc163c-operator-scripts\") pod \"glance-db-create-rl5vf\" (UID: \"9ba55b11-2c75-4cfa-9cfc-be73cefc163c\") " pod="openstack-kuttl-tests/glance-db-create-rl5vf" Mar 16 16:39:19 crc kubenswrapper[5120]: I0316 16:39:19.323954 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-db-create-rv5rl"] Mar 16 16:39:19 crc kubenswrapper[5120]: W0316 16:39:19.349476 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod86673db2_3d2b_4864_ae11_c6895dc677d2.slice/crio-5fa29f28419a25df9328d9a82365eef54951042c76d65f8320ac613abe4113db WatchSource:0}: Error finding container 5fa29f28419a25df9328d9a82365eef54951042c76d65f8320ac613abe4113db: Status 404 returned error can't find the container with id 5fa29f28419a25df9328d9a82365eef54951042c76d65f8320ac613abe4113db Mar 16 16:39:19 crc kubenswrapper[5120]: I0316 16:39:19.376917 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-db-create-xq46z"] Mar 16 16:39:19 crc kubenswrapper[5120]: I0316 16:39:19.386191 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-create-xq46z" Mar 16 16:39:19 crc kubenswrapper[5120]: I0316 16:39:19.403430 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 16:39:19 crc kubenswrapper[5120]: I0316 16:39:19.412560 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ll8gw\" (UniqueName: \"kubernetes.io/projected/9ba55b11-2c75-4cfa-9cfc-be73cefc163c-kube-api-access-ll8gw\") pod \"glance-db-create-rl5vf\" (UID: \"9ba55b11-2c75-4cfa-9cfc-be73cefc163c\") " pod="openstack-kuttl-tests/glance-db-create-rl5vf" Mar 16 16:39:19 crc kubenswrapper[5120]: I0316 16:39:19.412922 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzpf7\" (UniqueName: \"kubernetes.io/projected/3e7508b2-729a-4b53-a597-99cbabc7243a-kube-api-access-jzpf7\") pod \"glance-be30-account-create-update-fq9th\" (UID: \"3e7508b2-729a-4b53-a597-99cbabc7243a\") " pod="openstack-kuttl-tests/glance-be30-account-create-update-fq9th" Mar 16 16:39:19 crc kubenswrapper[5120]: I0316 16:39:19.412973 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3e7508b2-729a-4b53-a597-99cbabc7243a-operator-scripts\") pod \"glance-be30-account-create-update-fq9th\" (UID: \"3e7508b2-729a-4b53-a597-99cbabc7243a\") " pod="openstack-kuttl-tests/glance-be30-account-create-update-fq9th" Mar 16 16:39:19 crc kubenswrapper[5120]: I0316 16:39:19.412999 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9ba55b11-2c75-4cfa-9cfc-be73cefc163c-operator-scripts\") pod \"glance-db-create-rl5vf\" (UID: \"9ba55b11-2c75-4cfa-9cfc-be73cefc163c\") " pod="openstack-kuttl-tests/glance-db-create-rl5vf" Mar 16 16:39:19 crc kubenswrapper[5120]: I0316 16:39:19.413687 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9ba55b11-2c75-4cfa-9cfc-be73cefc163c-operator-scripts\") pod \"glance-db-create-rl5vf\" (UID: \"9ba55b11-2c75-4cfa-9cfc-be73cefc163c\") " pod="openstack-kuttl-tests/glance-db-create-rl5vf" Mar 16 16:39:19 crc kubenswrapper[5120]: I0316 16:39:19.423532 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:39:19 crc kubenswrapper[5120]: I0316 16:39:19.427975 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"telemetry-ceilometer-dockercfg-lhxk6\"" Mar 16 16:39:19 crc kubenswrapper[5120]: I0316 16:39:19.432861 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-db-create-xq46z"] Mar 16 16:39:19 crc kubenswrapper[5120]: I0316 16:39:19.471417 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ll8gw\" (UniqueName: \"kubernetes.io/projected/9ba55b11-2c75-4cfa-9cfc-be73cefc163c-kube-api-access-ll8gw\") pod \"glance-db-create-rl5vf\" (UID: \"9ba55b11-2c75-4cfa-9cfc-be73cefc163c\") " pod="openstack-kuttl-tests/glance-db-create-rl5vf" Mar 16 16:39:19 crc kubenswrapper[5120]: I0316 16:39:19.482825 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 16:39:19 crc kubenswrapper[5120]: I0316 16:39:19.511694 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-e7d9-account-create-update-fwr7k"] Mar 16 16:39:19 crc kubenswrapper[5120]: I0316 16:39:19.522469 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/614326a5-97a1-4126-bdaf-f6d6e5e9631f-operator-scripts\") pod \"cinder-db-create-xq46z\" (UID: \"614326a5-97a1-4126-bdaf-f6d6e5e9631f\") " pod="openstack-kuttl-tests/cinder-db-create-xq46z" Mar 16 16:39:19 crc kubenswrapper[5120]: I0316 16:39:19.522561 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jzpf7\" (UniqueName: \"kubernetes.io/projected/3e7508b2-729a-4b53-a597-99cbabc7243a-kube-api-access-jzpf7\") pod \"glance-be30-account-create-update-fq9th\" (UID: \"3e7508b2-729a-4b53-a597-99cbabc7243a\") " pod="openstack-kuttl-tests/glance-be30-account-create-update-fq9th" Mar 16 16:39:19 crc kubenswrapper[5120]: I0316 16:39:19.522641 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3e7508b2-729a-4b53-a597-99cbabc7243a-operator-scripts\") pod \"glance-be30-account-create-update-fq9th\" (UID: \"3e7508b2-729a-4b53-a597-99cbabc7243a\") " pod="openstack-kuttl-tests/glance-be30-account-create-update-fq9th" Mar 16 16:39:19 crc kubenswrapper[5120]: I0316 16:39:19.522687 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89r5p\" (UniqueName: \"kubernetes.io/projected/614326a5-97a1-4126-bdaf-f6d6e5e9631f-kube-api-access-89r5p\") pod \"cinder-db-create-xq46z\" (UID: \"614326a5-97a1-4126-bdaf-f6d6e5e9631f\") " pod="openstack-kuttl-tests/cinder-db-create-xq46z" Mar 16 16:39:19 crc kubenswrapper[5120]: I0316 16:39:19.523733 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3e7508b2-729a-4b53-a597-99cbabc7243a-operator-scripts\") pod \"glance-be30-account-create-update-fq9th\" (UID: \"3e7508b2-729a-4b53-a597-99cbabc7243a\") " pod="openstack-kuttl-tests/glance-be30-account-create-update-fq9th" Mar 16 16:39:19 crc kubenswrapper[5120]: I0316 16:39:19.565260 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzpf7\" (UniqueName: \"kubernetes.io/projected/3e7508b2-729a-4b53-a597-99cbabc7243a-kube-api-access-jzpf7\") pod \"glance-be30-account-create-update-fq9th\" (UID: \"3e7508b2-729a-4b53-a597-99cbabc7243a\") " pod="openstack-kuttl-tests/glance-be30-account-create-update-fq9th" Mar 16 16:39:19 crc kubenswrapper[5120]: W0316 16:39:19.565565 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2abd03fd_0270_463a_a9ca_95c22226e8ec.slice/crio-3f872df1cac016769d7494e7471b8faf9859fe1ea773e6b13ac64e0bda696bef WatchSource:0}: Error finding container 3f872df1cac016769d7494e7471b8faf9859fe1ea773e6b13ac64e0bda696bef: Status 404 returned error can't find the container with id 3f872df1cac016769d7494e7471b8faf9859fe1ea773e6b13ac64e0bda696bef Mar 16 16:39:19 crc kubenswrapper[5120]: I0316 16:39:19.568563 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-e7d9-account-create-update-fwr7k" Mar 16 16:39:19 crc kubenswrapper[5120]: I0316 16:39:19.569828 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-e7d9-account-create-update-fwr7k"] Mar 16 16:39:19 crc kubenswrapper[5120]: I0316 16:39:19.573136 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-db-secret\"" Mar 16 16:39:19 crc kubenswrapper[5120]: I0316 16:39:19.587313 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-454d-account-create-update-rqbdt"] Mar 16 16:39:19 crc kubenswrapper[5120]: I0316 16:39:19.590105 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-db-create-7ztbs"] Mar 16 16:39:19 crc kubenswrapper[5120]: I0316 16:39:19.610958 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-be30-account-create-update-fq9th" Mar 16 16:39:19 crc kubenswrapper[5120]: I0316 16:39:19.613496 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-create-7ztbs" Mar 16 16:39:19 crc kubenswrapper[5120]: I0316 16:39:19.619925 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-db-create-7ztbs"] Mar 16 16:39:19 crc kubenswrapper[5120]: I0316 16:39:19.626191 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/614326a5-97a1-4126-bdaf-f6d6e5e9631f-operator-scripts\") pod \"cinder-db-create-xq46z\" (UID: \"614326a5-97a1-4126-bdaf-f6d6e5e9631f\") " pod="openstack-kuttl-tests/cinder-db-create-xq46z" Mar 16 16:39:19 crc kubenswrapper[5120]: I0316 16:39:19.626533 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-89r5p\" (UniqueName: \"kubernetes.io/projected/614326a5-97a1-4126-bdaf-f6d6e5e9631f-kube-api-access-89r5p\") pod \"cinder-db-create-xq46z\" (UID: \"614326a5-97a1-4126-bdaf-f6d6e5e9631f\") " pod="openstack-kuttl-tests/cinder-db-create-xq46z" Mar 16 16:39:19 crc kubenswrapper[5120]: I0316 16:39:19.626833 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tf7cl\" (UniqueName: \"kubernetes.io/projected/ed3ee889-136c-4331-b526-e110819e0ea0-kube-api-access-tf7cl\") pod \"kube-state-metrics-0\" (UID: \"ed3ee889-136c-4331-b526-e110819e0ea0\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:39:19 crc kubenswrapper[5120]: I0316 16:39:19.627695 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/614326a5-97a1-4126-bdaf-f6d6e5e9631f-operator-scripts\") pod \"cinder-db-create-xq46z\" (UID: \"614326a5-97a1-4126-bdaf-f6d6e5e9631f\") " pod="openstack-kuttl-tests/cinder-db-create-xq46z" Mar 16 16:39:19 crc kubenswrapper[5120]: I0316 16:39:19.631561 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-87f5-account-create-update-76mr4"] Mar 16 16:39:19 crc kubenswrapper[5120]: I0316 16:39:19.643725 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-87f5-account-create-update-76mr4" Mar 16 16:39:19 crc kubenswrapper[5120]: I0316 16:39:19.647131 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-87f5-account-create-update-76mr4"] Mar 16 16:39:19 crc kubenswrapper[5120]: I0316 16:39:19.652346 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-db-secret\"" Mar 16 16:39:19 crc kubenswrapper[5120]: I0316 16:39:19.661179 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-89r5p\" (UniqueName: \"kubernetes.io/projected/614326a5-97a1-4126-bdaf-f6d6e5e9631f-kube-api-access-89r5p\") pod \"cinder-db-create-xq46z\" (UID: \"614326a5-97a1-4126-bdaf-f6d6e5e9631f\") " pod="openstack-kuttl-tests/cinder-db-create-xq46z" Mar 16 16:39:19 crc kubenswrapper[5120]: I0316 16:39:19.711636 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-create-xq46z" Mar 16 16:39:19 crc kubenswrapper[5120]: I0316 16:39:19.736189 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d94rg\" (UniqueName: \"kubernetes.io/projected/e988df9f-eee2-4103-9df2-1e999506d1ca-kube-api-access-d94rg\") pod \"cinder-e7d9-account-create-update-fwr7k\" (UID: \"e988df9f-eee2-4103-9df2-1e999506d1ca\") " pod="openstack-kuttl-tests/cinder-e7d9-account-create-update-fwr7k" Mar 16 16:39:19 crc kubenswrapper[5120]: I0316 16:39:19.736666 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4mlj\" (UniqueName: \"kubernetes.io/projected/bac9c78c-8043-4f94-9c2e-6bbbcac4d701-kube-api-access-g4mlj\") pod \"barbican-87f5-account-create-update-76mr4\" (UID: \"bac9c78c-8043-4f94-9c2e-6bbbcac4d701\") " pod="openstack-kuttl-tests/barbican-87f5-account-create-update-76mr4" Mar 16 16:39:19 crc kubenswrapper[5120]: I0316 16:39:19.736716 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/fa5c2ff2-6f51-49e1-bb96-be06788737c6-operator-scripts\") pod \"barbican-db-create-7ztbs\" (UID: \"fa5c2ff2-6f51-49e1-bb96-be06788737c6\") " pod="openstack-kuttl-tests/barbican-db-create-7ztbs" Mar 16 16:39:19 crc kubenswrapper[5120]: I0316 16:39:19.736846 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/bac9c78c-8043-4f94-9c2e-6bbbcac4d701-operator-scripts\") pod \"barbican-87f5-account-create-update-76mr4\" (UID: \"bac9c78c-8043-4f94-9c2e-6bbbcac4d701\") " pod="openstack-kuttl-tests/barbican-87f5-account-create-update-76mr4" Mar 16 16:39:19 crc kubenswrapper[5120]: I0316 16:39:19.737088 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tf7cl\" (UniqueName: \"kubernetes.io/projected/ed3ee889-136c-4331-b526-e110819e0ea0-kube-api-access-tf7cl\") pod \"kube-state-metrics-0\" (UID: \"ed3ee889-136c-4331-b526-e110819e0ea0\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:39:19 crc kubenswrapper[5120]: I0316 16:39:19.737378 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e988df9f-eee2-4103-9df2-1e999506d1ca-operator-scripts\") pod \"cinder-e7d9-account-create-update-fwr7k\" (UID: \"e988df9f-eee2-4103-9df2-1e999506d1ca\") " pod="openstack-kuttl-tests/cinder-e7d9-account-create-update-fwr7k" Mar 16 16:39:19 crc kubenswrapper[5120]: I0316 16:39:19.737537 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74mnj\" (UniqueName: \"kubernetes.io/projected/fa5c2ff2-6f51-49e1-bb96-be06788737c6-kube-api-access-74mnj\") pod \"barbican-db-create-7ztbs\" (UID: \"fa5c2ff2-6f51-49e1-bb96-be06788737c6\") " pod="openstack-kuttl-tests/barbican-db-create-7ztbs" Mar 16 16:39:19 crc kubenswrapper[5120]: I0316 16:39:19.766737 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-create-rl5vf" Mar 16 16:39:19 crc kubenswrapper[5120]: I0316 16:39:19.786932 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tf7cl\" (UniqueName: \"kubernetes.io/projected/ed3ee889-136c-4331-b526-e110819e0ea0-kube-api-access-tf7cl\") pod \"kube-state-metrics-0\" (UID: \"ed3ee889-136c-4331-b526-e110819e0ea0\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:39:19 crc kubenswrapper[5120]: I0316 16:39:19.840859 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-454d-account-create-update-rqbdt" event={"ID":"2abd03fd-0270-463a-a9ca-95c22226e8ec","Type":"ContainerStarted","Data":"3f872df1cac016769d7494e7471b8faf9859fe1ea773e6b13ac64e0bda696bef"} Mar 16 16:39:19 crc kubenswrapper[5120]: I0316 16:39:19.841903 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e988df9f-eee2-4103-9df2-1e999506d1ca-operator-scripts\") pod \"cinder-e7d9-account-create-update-fwr7k\" (UID: \"e988df9f-eee2-4103-9df2-1e999506d1ca\") " pod="openstack-kuttl-tests/cinder-e7d9-account-create-update-fwr7k" Mar 16 16:39:19 crc kubenswrapper[5120]: I0316 16:39:19.841983 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-74mnj\" (UniqueName: \"kubernetes.io/projected/fa5c2ff2-6f51-49e1-bb96-be06788737c6-kube-api-access-74mnj\") pod \"barbican-db-create-7ztbs\" (UID: \"fa5c2ff2-6f51-49e1-bb96-be06788737c6\") " pod="openstack-kuttl-tests/barbican-db-create-7ztbs" Mar 16 16:39:19 crc kubenswrapper[5120]: I0316 16:39:19.842058 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d94rg\" (UniqueName: \"kubernetes.io/projected/e988df9f-eee2-4103-9df2-1e999506d1ca-kube-api-access-d94rg\") pod \"cinder-e7d9-account-create-update-fwr7k\" (UID: \"e988df9f-eee2-4103-9df2-1e999506d1ca\") " pod="openstack-kuttl-tests/cinder-e7d9-account-create-update-fwr7k" Mar 16 16:39:19 crc kubenswrapper[5120]: I0316 16:39:19.842142 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g4mlj\" (UniqueName: \"kubernetes.io/projected/bac9c78c-8043-4f94-9c2e-6bbbcac4d701-kube-api-access-g4mlj\") pod \"barbican-87f5-account-create-update-76mr4\" (UID: \"bac9c78c-8043-4f94-9c2e-6bbbcac4d701\") " pod="openstack-kuttl-tests/barbican-87f5-account-create-update-76mr4" Mar 16 16:39:19 crc kubenswrapper[5120]: I0316 16:39:19.842181 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/fa5c2ff2-6f51-49e1-bb96-be06788737c6-operator-scripts\") pod \"barbican-db-create-7ztbs\" (UID: \"fa5c2ff2-6f51-49e1-bb96-be06788737c6\") " pod="openstack-kuttl-tests/barbican-db-create-7ztbs" Mar 16 16:39:19 crc kubenswrapper[5120]: I0316 16:39:19.842239 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/bac9c78c-8043-4f94-9c2e-6bbbcac4d701-operator-scripts\") pod \"barbican-87f5-account-create-update-76mr4\" (UID: \"bac9c78c-8043-4f94-9c2e-6bbbcac4d701\") " pod="openstack-kuttl-tests/barbican-87f5-account-create-update-76mr4" Mar 16 16:39:19 crc kubenswrapper[5120]: I0316 16:39:19.843358 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/bac9c78c-8043-4f94-9c2e-6bbbcac4d701-operator-scripts\") pod \"barbican-87f5-account-create-update-76mr4\" (UID: \"bac9c78c-8043-4f94-9c2e-6bbbcac4d701\") " pod="openstack-kuttl-tests/barbican-87f5-account-create-update-76mr4" Mar 16 16:39:19 crc kubenswrapper[5120]: I0316 16:39:19.844555 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/fa5c2ff2-6f51-49e1-bb96-be06788737c6-operator-scripts\") pod \"barbican-db-create-7ztbs\" (UID: \"fa5c2ff2-6f51-49e1-bb96-be06788737c6\") " pod="openstack-kuttl-tests/barbican-db-create-7ztbs" Mar 16 16:39:19 crc kubenswrapper[5120]: I0316 16:39:19.849522 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e988df9f-eee2-4103-9df2-1e999506d1ca-operator-scripts\") pod \"cinder-e7d9-account-create-update-fwr7k\" (UID: \"e988df9f-eee2-4103-9df2-1e999506d1ca\") " pod="openstack-kuttl-tests/cinder-e7d9-account-create-update-fwr7k" Mar 16 16:39:19 crc kubenswrapper[5120]: I0316 16:39:19.853711 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-create-rv5rl" event={"ID":"86673db2-3d2b-4864-ae11-c6895dc677d2","Type":"ContainerStarted","Data":"483d08a5279d4367a54d826fe3767bef54853fe8eaff4ffac1b2e2a616b3ae0a"} Mar 16 16:39:19 crc kubenswrapper[5120]: I0316 16:39:19.864464 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-create-rv5rl" event={"ID":"86673db2-3d2b-4864-ae11-c6895dc677d2","Type":"ContainerStarted","Data":"5fa29f28419a25df9328d9a82365eef54951042c76d65f8320ac613abe4113db"} Mar 16 16:39:19 crc kubenswrapper[5120]: I0316 16:39:19.877629 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d94rg\" (UniqueName: \"kubernetes.io/projected/e988df9f-eee2-4103-9df2-1e999506d1ca-kube-api-access-d94rg\") pod \"cinder-e7d9-account-create-update-fwr7k\" (UID: \"e988df9f-eee2-4103-9df2-1e999506d1ca\") " pod="openstack-kuttl-tests/cinder-e7d9-account-create-update-fwr7k" Mar 16 16:39:19 crc kubenswrapper[5120]: I0316 16:39:19.899821 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4mlj\" (UniqueName: \"kubernetes.io/projected/bac9c78c-8043-4f94-9c2e-6bbbcac4d701-kube-api-access-g4mlj\") pod \"barbican-87f5-account-create-update-76mr4\" (UID: \"bac9c78c-8043-4f94-9c2e-6bbbcac4d701\") " pod="openstack-kuttl-tests/barbican-87f5-account-create-update-76mr4" Mar 16 16:39:19 crc kubenswrapper[5120]: I0316 16:39:19.907411 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-74mnj\" (UniqueName: \"kubernetes.io/projected/fa5c2ff2-6f51-49e1-bb96-be06788737c6-kube-api-access-74mnj\") pod \"barbican-db-create-7ztbs\" (UID: \"fa5c2ff2-6f51-49e1-bb96-be06788737c6\") " pod="openstack-kuttl-tests/barbican-db-create-7ztbs" Mar 16 16:39:19 crc kubenswrapper[5120]: I0316 16:39:19.913105 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-db-create-rv5rl" podStartSLOduration=1.91308488 podStartE2EDuration="1.91308488s" podCreationTimestamp="2026-03-16 16:39:18 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:39:19.906194059 +0000 UTC m=+4062.060125736" watchObservedRunningTime="2026-03-16 16:39:19.91308488 +0000 UTC m=+4062.067016537" Mar 16 16:39:19 crc kubenswrapper[5120]: I0316 16:39:19.916388 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-e7d9-account-create-update-fwr7k" Mar 16 16:39:19 crc kubenswrapper[5120]: I0316 16:39:19.932028 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-create-7ztbs" Mar 16 16:39:20 crc kubenswrapper[5120]: I0316 16:39:20.000887 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-e32b-account-create-update-mlh9x"] Mar 16 16:39:20 crc kubenswrapper[5120]: I0316 16:39:20.011254 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-87f5-account-create-update-76mr4" Mar 16 16:39:20 crc kubenswrapper[5120]: I0316 16:39:20.037306 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-db-create-52jsz"] Mar 16 16:39:20 crc kubenswrapper[5120]: W0316 16:39:20.043983 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9aa6ed1b_b014_4ff6_97aa_387eceb58d13.slice/crio-ed08c648f75852d9cd0c372093b585ccf890911c70f8dbdbe3789e05833101ca WatchSource:0}: Error finding container ed08c648f75852d9cd0c372093b585ccf890911c70f8dbdbe3789e05833101ca: Status 404 returned error can't find the container with id ed08c648f75852d9cd0c372093b585ccf890911c70f8dbdbe3789e05833101ca Mar 16 16:39:20 crc kubenswrapper[5120]: I0316 16:39:20.063139 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:39:20 crc kubenswrapper[5120]: I0316 16:39:20.228816 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-db-create-xgxkv"] Mar 16 16:39:20 crc kubenswrapper[5120]: I0316 16:39:20.239116 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-create-xgxkv" Mar 16 16:39:20 crc kubenswrapper[5120]: I0316 16:39:20.242733 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-db-create-xgxkv"] Mar 16 16:39:20 crc kubenswrapper[5120]: I0316 16:39:20.264221 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/62168229-1b96-48fa-aaac-639639d37e7f-operator-scripts\") pod \"neutron-db-create-xgxkv\" (UID: \"62168229-1b96-48fa-aaac-639639d37e7f\") " pod="openstack-kuttl-tests/neutron-db-create-xgxkv" Mar 16 16:39:20 crc kubenswrapper[5120]: I0316 16:39:20.264278 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zf5st\" (UniqueName: \"kubernetes.io/projected/62168229-1b96-48fa-aaac-639639d37e7f-kube-api-access-zf5st\") pod \"neutron-db-create-xgxkv\" (UID: \"62168229-1b96-48fa-aaac-639639d37e7f\") " pod="openstack-kuttl-tests/neutron-db-create-xgxkv" Mar 16 16:39:20 crc kubenswrapper[5120]: W0316 16:39:20.310562 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3e7508b2_729a_4b53_a597_99cbabc7243a.slice/crio-3ef020f9e3d964d6125be8ffcb1949a0b1c2161db07f910cc9b6b1b9a9efacc8 WatchSource:0}: Error finding container 3ef020f9e3d964d6125be8ffcb1949a0b1c2161db07f910cc9b6b1b9a9efacc8: Status 404 returned error can't find the container with id 3ef020f9e3d964d6125be8ffcb1949a0b1c2161db07f910cc9b6b1b9a9efacc8 Mar 16 16:39:20 crc kubenswrapper[5120]: I0316 16:39:20.327019 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-be30-account-create-update-fq9th"] Mar 16 16:39:20 crc kubenswrapper[5120]: I0316 16:39:20.358172 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-8aa2-account-create-update-7rn9g"] Mar 16 16:39:20 crc kubenswrapper[5120]: I0316 16:39:20.363805 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-8aa2-account-create-update-7rn9g" Mar 16 16:39:20 crc kubenswrapper[5120]: I0316 16:39:20.369255 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/62168229-1b96-48fa-aaac-639639d37e7f-operator-scripts\") pod \"neutron-db-create-xgxkv\" (UID: \"62168229-1b96-48fa-aaac-639639d37e7f\") " pod="openstack-kuttl-tests/neutron-db-create-xgxkv" Mar 16 16:39:20 crc kubenswrapper[5120]: I0316 16:39:20.369302 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zf5st\" (UniqueName: \"kubernetes.io/projected/62168229-1b96-48fa-aaac-639639d37e7f-kube-api-access-zf5st\") pod \"neutron-db-create-xgxkv\" (UID: \"62168229-1b96-48fa-aaac-639639d37e7f\") " pod="openstack-kuttl-tests/neutron-db-create-xgxkv" Mar 16 16:39:20 crc kubenswrapper[5120]: I0316 16:39:20.370311 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/62168229-1b96-48fa-aaac-639639d37e7f-operator-scripts\") pod \"neutron-db-create-xgxkv\" (UID: \"62168229-1b96-48fa-aaac-639639d37e7f\") " pod="openstack-kuttl-tests/neutron-db-create-xgxkv" Mar 16 16:39:20 crc kubenswrapper[5120]: I0316 16:39:20.372853 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-db-secret\"" Mar 16 16:39:20 crc kubenswrapper[5120]: I0316 16:39:20.382304 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-8aa2-account-create-update-7rn9g"] Mar 16 16:39:20 crc kubenswrapper[5120]: I0316 16:39:20.389932 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zf5st\" (UniqueName: \"kubernetes.io/projected/62168229-1b96-48fa-aaac-639639d37e7f-kube-api-access-zf5st\") pod \"neutron-db-create-xgxkv\" (UID: \"62168229-1b96-48fa-aaac-639639d37e7f\") " pod="openstack-kuttl-tests/neutron-db-create-xgxkv" Mar 16 16:39:20 crc kubenswrapper[5120]: I0316 16:39:20.436872 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-db-create-xq46z"] Mar 16 16:39:20 crc kubenswrapper[5120]: I0316 16:39:20.472087 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hsx54\" (UniqueName: \"kubernetes.io/projected/0bdcb33b-f908-4545-91d5-caebf2853b00-kube-api-access-hsx54\") pod \"neutron-8aa2-account-create-update-7rn9g\" (UID: \"0bdcb33b-f908-4545-91d5-caebf2853b00\") " pod="openstack-kuttl-tests/neutron-8aa2-account-create-update-7rn9g" Mar 16 16:39:20 crc kubenswrapper[5120]: I0316 16:39:20.472183 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0bdcb33b-f908-4545-91d5-caebf2853b00-operator-scripts\") pod \"neutron-8aa2-account-create-update-7rn9g\" (UID: \"0bdcb33b-f908-4545-91d5-caebf2853b00\") " pod="openstack-kuttl-tests/neutron-8aa2-account-create-update-7rn9g" Mar 16 16:39:20 crc kubenswrapper[5120]: I0316 16:39:20.574455 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hsx54\" (UniqueName: \"kubernetes.io/projected/0bdcb33b-f908-4545-91d5-caebf2853b00-kube-api-access-hsx54\") pod \"neutron-8aa2-account-create-update-7rn9g\" (UID: \"0bdcb33b-f908-4545-91d5-caebf2853b00\") " pod="openstack-kuttl-tests/neutron-8aa2-account-create-update-7rn9g" Mar 16 16:39:20 crc kubenswrapper[5120]: I0316 16:39:20.574577 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0bdcb33b-f908-4545-91d5-caebf2853b00-operator-scripts\") pod \"neutron-8aa2-account-create-update-7rn9g\" (UID: \"0bdcb33b-f908-4545-91d5-caebf2853b00\") " pod="openstack-kuttl-tests/neutron-8aa2-account-create-update-7rn9g" Mar 16 16:39:20 crc kubenswrapper[5120]: I0316 16:39:20.575512 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0bdcb33b-f908-4545-91d5-caebf2853b00-operator-scripts\") pod \"neutron-8aa2-account-create-update-7rn9g\" (UID: \"0bdcb33b-f908-4545-91d5-caebf2853b00\") " pod="openstack-kuttl-tests/neutron-8aa2-account-create-update-7rn9g" Mar 16 16:39:20 crc kubenswrapper[5120]: I0316 16:39:20.582464 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-create-xgxkv" Mar 16 16:39:20 crc kubenswrapper[5120]: I0316 16:39:20.600317 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hsx54\" (UniqueName: \"kubernetes.io/projected/0bdcb33b-f908-4545-91d5-caebf2853b00-kube-api-access-hsx54\") pod \"neutron-8aa2-account-create-update-7rn9g\" (UID: \"0bdcb33b-f908-4545-91d5-caebf2853b00\") " pod="openstack-kuttl-tests/neutron-8aa2-account-create-update-7rn9g" Mar 16 16:39:20 crc kubenswrapper[5120]: I0316 16:39:20.658662 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-db-create-rl5vf"] Mar 16 16:39:20 crc kubenswrapper[5120]: I0316 16:39:20.690830 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-8aa2-account-create-update-7rn9g" Mar 16 16:39:20 crc kubenswrapper[5120]: I0316 16:39:20.702810 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-e7d9-account-create-update-fwr7k"] Mar 16 16:39:20 crc kubenswrapper[5120]: I0316 16:39:20.749411 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 16:39:20 crc kubenswrapper[5120]: I0316 16:39:20.761496 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 16:39:20 crc kubenswrapper[5120]: I0316 16:39:20.761677 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:39:20 crc kubenswrapper[5120]: I0316 16:39:20.768099 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"swift-conf\"" Mar 16 16:39:20 crc kubenswrapper[5120]: I0316 16:39:20.768457 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"swift-storage-config-data\"" Mar 16 16:39:20 crc kubenswrapper[5120]: I0316 16:39:20.768648 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"swift-ring-files\"" Mar 16 16:39:20 crc kubenswrapper[5120]: I0316 16:39:20.768865 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"swift-swift-dockercfg-8jdxp\"" Mar 16 16:39:20 crc kubenswrapper[5120]: I0316 16:39:20.828950 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-db-create-7ztbs"] Mar 16 16:39:20 crc kubenswrapper[5120]: I0316 16:39:20.869500 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 16:39:20 crc kubenswrapper[5120]: I0316 16:39:20.895331 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-create-xq46z" event={"ID":"614326a5-97a1-4126-bdaf-f6d6e5e9631f","Type":"ContainerStarted","Data":"5ea460f810b64999bc8fc233431ed646811feda5936c1adb68a0d2fac4932f26"} Mar 16 16:39:20 crc kubenswrapper[5120]: I0316 16:39:20.895381 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-create-xq46z" event={"ID":"614326a5-97a1-4126-bdaf-f6d6e5e9631f","Type":"ContainerStarted","Data":"1fca5356b0f4e9ff000b1bf5e1466c841856178a2bb7de13ee73f9fda3402b6b"} Mar 16 16:39:20 crc kubenswrapper[5120]: I0316 16:39:20.899870 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7f161303-6db3-42fc-8cca-089c09eabda5-combined-ca-bundle\") pod \"swift-storage-0\" (UID: \"7f161303-6db3-42fc-8cca-089c09eabda5\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:39:20 crc kubenswrapper[5120]: I0316 16:39:20.900045 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/7f161303-6db3-42fc-8cca-089c09eabda5-etc-swift\") pod \"swift-storage-0\" (UID: \"7f161303-6db3-42fc-8cca-089c09eabda5\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:39:20 crc kubenswrapper[5120]: I0316 16:39:20.900144 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/7f161303-6db3-42fc-8cca-089c09eabda5-lock\") pod \"swift-storage-0\" (UID: \"7f161303-6db3-42fc-8cca-089c09eabda5\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:39:20 crc kubenswrapper[5120]: I0316 16:39:20.900361 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") pod \"swift-storage-0\" (UID: \"7f161303-6db3-42fc-8cca-089c09eabda5\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:39:20 crc kubenswrapper[5120]: I0316 16:39:20.900429 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/7f161303-6db3-42fc-8cca-089c09eabda5-cache\") pod \"swift-storage-0\" (UID: \"7f161303-6db3-42fc-8cca-089c09eabda5\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:39:20 crc kubenswrapper[5120]: I0316 16:39:20.900799 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xwb5\" (UniqueName: \"kubernetes.io/projected/7f161303-6db3-42fc-8cca-089c09eabda5-kube-api-access-6xwb5\") pod \"swift-storage-0\" (UID: \"7f161303-6db3-42fc-8cca-089c09eabda5\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:39:20 crc kubenswrapper[5120]: I0316 16:39:20.903321 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-create-rl5vf" event={"ID":"9ba55b11-2c75-4cfa-9cfc-be73cefc163c","Type":"ContainerStarted","Data":"d5b62f4007fe48fcb0ef75f9ae3cd9a405a2034be82f757b9ad23d2cfb16f9ad"} Mar 16 16:39:20 crc kubenswrapper[5120]: I0316 16:39:20.911266 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-87f5-account-create-update-76mr4"] Mar 16 16:39:20 crc kubenswrapper[5120]: I0316 16:39:20.922810 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-454d-account-create-update-rqbdt" event={"ID":"2abd03fd-0270-463a-a9ca-95c22226e8ec","Type":"ContainerDied","Data":"ae25a6c587c5c5508fcd3541867071191504faa725bea4248513c9f83dbb4631"} Mar 16 16:39:20 crc kubenswrapper[5120]: I0316 16:39:20.925144 5120 generic.go:358] "Generic (PLEG): container finished" podID="2abd03fd-0270-463a-a9ca-95c22226e8ec" containerID="ae25a6c587c5c5508fcd3541867071191504faa725bea4248513c9f83dbb4631" exitCode=0 Mar 16 16:39:20 crc kubenswrapper[5120]: I0316 16:39:20.947219 5120 generic.go:358] "Generic (PLEG): container finished" podID="9aa6ed1b-b014-4ff6-97aa-387eceb58d13" containerID="c20aefa9bd92f7e1b99a18865a094ad259349bffc1eb8901a61f4cc1ed362b8f" exitCode=0 Mar 16 16:39:20 crc kubenswrapper[5120]: I0316 16:39:20.948054 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-create-52jsz" event={"ID":"9aa6ed1b-b014-4ff6-97aa-387eceb58d13","Type":"ContainerDied","Data":"c20aefa9bd92f7e1b99a18865a094ad259349bffc1eb8901a61f4cc1ed362b8f"} Mar 16 16:39:20 crc kubenswrapper[5120]: I0316 16:39:20.948086 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-create-52jsz" event={"ID":"9aa6ed1b-b014-4ff6-97aa-387eceb58d13","Type":"ContainerStarted","Data":"ed08c648f75852d9cd0c372093b585ccf890911c70f8dbdbe3789e05833101ca"} Mar 16 16:39:20 crc kubenswrapper[5120]: I0316 16:39:20.951251 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-db-create-xq46z" podStartSLOduration=1.951228452 podStartE2EDuration="1.951228452s" podCreationTimestamp="2026-03-16 16:39:19 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:39:20.918057483 +0000 UTC m=+4063.071989140" watchObservedRunningTime="2026-03-16 16:39:20.951228452 +0000 UTC m=+4063.105160129" Mar 16 16:39:20 crc kubenswrapper[5120]: I0316 16:39:20.957445 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-e7d9-account-create-update-fwr7k" event={"ID":"e988df9f-eee2-4103-9df2-1e999506d1ca","Type":"ContainerStarted","Data":"fd88f80cfd0b654dedc87297e9edce3be1e7db12ef6044609f2bc69b3c2caf5e"} Mar 16 16:39:20 crc kubenswrapper[5120]: I0316 16:39:20.971072 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-be30-account-create-update-fq9th" event={"ID":"3e7508b2-729a-4b53-a597-99cbabc7243a","Type":"ContainerStarted","Data":"ba7906458f732cf2c694eb801cb26f6b5d624ea022de95c9791781425a728ed6"} Mar 16 16:39:20 crc kubenswrapper[5120]: I0316 16:39:20.971124 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-be30-account-create-update-fq9th" event={"ID":"3e7508b2-729a-4b53-a597-99cbabc7243a","Type":"ContainerStarted","Data":"3ef020f9e3d964d6125be8ffcb1949a0b1c2161db07f910cc9b6b1b9a9efacc8"} Mar 16 16:39:20 crc kubenswrapper[5120]: I0316 16:39:20.979012 5120 generic.go:358] "Generic (PLEG): container finished" podID="93a2b4d2-8481-44a9-8d12-62db95189e45" containerID="69989ceb3c4bbe3d7a321c34ebc6a1f593eb691b0ecac9d51a6a59174a662a06" exitCode=0 Mar 16 16:39:20 crc kubenswrapper[5120]: I0316 16:39:20.979141 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-e32b-account-create-update-mlh9x" event={"ID":"93a2b4d2-8481-44a9-8d12-62db95189e45","Type":"ContainerDied","Data":"69989ceb3c4bbe3d7a321c34ebc6a1f593eb691b0ecac9d51a6a59174a662a06"} Mar 16 16:39:20 crc kubenswrapper[5120]: I0316 16:39:20.979168 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-e32b-account-create-update-mlh9x" event={"ID":"93a2b4d2-8481-44a9-8d12-62db95189e45","Type":"ContainerStarted","Data":"90aa784334a551f310e1e18c0dbdec63307d4a23f7fffcca1976653e44c27db5"} Mar 16 16:39:20 crc kubenswrapper[5120]: I0316 16:39:20.990134 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-create-7ztbs" event={"ID":"fa5c2ff2-6f51-49e1-bb96-be06788737c6","Type":"ContainerStarted","Data":"d6d071fdeb6bd31100eb75cfb5ad1ec6bf3d0ca342d8ce44fceffca2995e4412"} Mar 16 16:39:20 crc kubenswrapper[5120]: I0316 16:39:20.995423 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-be30-account-create-update-fq9th" podStartSLOduration=1.995402238 podStartE2EDuration="1.995402238s" podCreationTimestamp="2026-03-16 16:39:19 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:39:20.990384066 +0000 UTC m=+4063.144315723" watchObservedRunningTime="2026-03-16 16:39:20.995402238 +0000 UTC m=+4063.149333895" Mar 16 16:39:21 crc kubenswrapper[5120]: I0316 16:39:21.006222 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") pod \"swift-storage-0\" (UID: \"7f161303-6db3-42fc-8cca-089c09eabda5\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:39:21 crc kubenswrapper[5120]: I0316 16:39:21.006283 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/7f161303-6db3-42fc-8cca-089c09eabda5-cache\") pod \"swift-storage-0\" (UID: \"7f161303-6db3-42fc-8cca-089c09eabda5\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:39:21 crc kubenswrapper[5120]: I0316 16:39:21.006405 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6xwb5\" (UniqueName: \"kubernetes.io/projected/7f161303-6db3-42fc-8cca-089c09eabda5-kube-api-access-6xwb5\") pod \"swift-storage-0\" (UID: \"7f161303-6db3-42fc-8cca-089c09eabda5\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:39:21 crc kubenswrapper[5120]: I0316 16:39:21.006519 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7f161303-6db3-42fc-8cca-089c09eabda5-combined-ca-bundle\") pod \"swift-storage-0\" (UID: \"7f161303-6db3-42fc-8cca-089c09eabda5\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:39:21 crc kubenswrapper[5120]: I0316 16:39:21.006562 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/7f161303-6db3-42fc-8cca-089c09eabda5-etc-swift\") pod \"swift-storage-0\" (UID: \"7f161303-6db3-42fc-8cca-089c09eabda5\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:39:21 crc kubenswrapper[5120]: I0316 16:39:21.006592 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/7f161303-6db3-42fc-8cca-089c09eabda5-lock\") pod \"swift-storage-0\" (UID: \"7f161303-6db3-42fc-8cca-089c09eabda5\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:39:21 crc kubenswrapper[5120]: E0316 16:39:21.007573 5120 projected.go:289] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Mar 16 16:39:21 crc kubenswrapper[5120]: E0316 16:39:21.007605 5120 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Mar 16 16:39:21 crc kubenswrapper[5120]: E0316 16:39:21.007663 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7f161303-6db3-42fc-8cca-089c09eabda5-etc-swift podName:7f161303-6db3-42fc-8cca-089c09eabda5 nodeName:}" failed. No retries permitted until 2026-03-16 16:39:21.507644908 +0000 UTC m=+4063.661576565 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/7f161303-6db3-42fc-8cca-089c09eabda5-etc-swift") pod "swift-storage-0" (UID: "7f161303-6db3-42fc-8cca-089c09eabda5") : configmap "swift-ring-files" not found Mar 16 16:39:21 crc kubenswrapper[5120]: I0316 16:39:21.007944 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/7f161303-6db3-42fc-8cca-089c09eabda5-lock\") pod \"swift-storage-0\" (UID: \"7f161303-6db3-42fc-8cca-089c09eabda5\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:39:21 crc kubenswrapper[5120]: I0316 16:39:21.008212 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") pod \"swift-storage-0\" (UID: \"7f161303-6db3-42fc-8cca-089c09eabda5\") device mount path \"/mnt/openstack/pv14\"" pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:39:21 crc kubenswrapper[5120]: I0316 16:39:21.008390 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/7f161303-6db3-42fc-8cca-089c09eabda5-cache\") pod \"swift-storage-0\" (UID: \"7f161303-6db3-42fc-8cca-089c09eabda5\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:39:21 crc kubenswrapper[5120]: I0316 16:39:21.008904 5120 generic.go:358] "Generic (PLEG): container finished" podID="86673db2-3d2b-4864-ae11-c6895dc677d2" containerID="483d08a5279d4367a54d826fe3767bef54853fe8eaff4ffac1b2e2a616b3ae0a" exitCode=0 Mar 16 16:39:21 crc kubenswrapper[5120]: I0316 16:39:21.008988 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-create-rv5rl" event={"ID":"86673db2-3d2b-4864-ae11-c6895dc677d2","Type":"ContainerDied","Data":"483d08a5279d4367a54d826fe3767bef54853fe8eaff4ffac1b2e2a616b3ae0a"} Mar 16 16:39:21 crc kubenswrapper[5120]: I0316 16:39:21.020768 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7f161303-6db3-42fc-8cca-089c09eabda5-combined-ca-bundle\") pod \"swift-storage-0\" (UID: \"7f161303-6db3-42fc-8cca-089c09eabda5\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:39:21 crc kubenswrapper[5120]: I0316 16:39:21.027645 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xwb5\" (UniqueName: \"kubernetes.io/projected/7f161303-6db3-42fc-8cca-089c09eabda5-kube-api-access-6xwb5\") pod \"swift-storage-0\" (UID: \"7f161303-6db3-42fc-8cca-089c09eabda5\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:39:21 crc kubenswrapper[5120]: I0316 16:39:21.097019 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") pod \"swift-storage-0\" (UID: \"7f161303-6db3-42fc-8cca-089c09eabda5\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:39:21 crc kubenswrapper[5120]: I0316 16:39:21.126223 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-9hsz8"] Mar 16 16:39:21 crc kubenswrapper[5120]: I0316 16:39:21.133949 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-9hsz8" Mar 16 16:39:21 crc kubenswrapper[5120]: I0316 16:39:21.136510 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-9hsz8"] Mar 16 16:39:21 crc kubenswrapper[5120]: I0316 16:39:21.140905 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"swift-ring-scripts\"" Mar 16 16:39:21 crc kubenswrapper[5120]: I0316 16:39:21.141040 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"swift-ring-config-data\"" Mar 16 16:39:21 crc kubenswrapper[5120]: I0316 16:39:21.141126 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"swift-proxy-config-data\"" Mar 16 16:39:21 crc kubenswrapper[5120]: I0316 16:39:21.210169 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/26f0b4d3-a9a4-495b-a656-87bb6e9e77af-dispersionconf\") pod \"swift-ring-rebalance-9hsz8\" (UID: \"26f0b4d3-a9a4-495b-a656-87bb6e9e77af\") " pod="openstack-kuttl-tests/swift-ring-rebalance-9hsz8" Mar 16 16:39:21 crc kubenswrapper[5120]: I0316 16:39:21.210305 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/26f0b4d3-a9a4-495b-a656-87bb6e9e77af-swiftconf\") pod \"swift-ring-rebalance-9hsz8\" (UID: \"26f0b4d3-a9a4-495b-a656-87bb6e9e77af\") " pod="openstack-kuttl-tests/swift-ring-rebalance-9hsz8" Mar 16 16:39:21 crc kubenswrapper[5120]: I0316 16:39:21.210350 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/26f0b4d3-a9a4-495b-a656-87bb6e9e77af-combined-ca-bundle\") pod \"swift-ring-rebalance-9hsz8\" (UID: \"26f0b4d3-a9a4-495b-a656-87bb6e9e77af\") " pod="openstack-kuttl-tests/swift-ring-rebalance-9hsz8" Mar 16 16:39:21 crc kubenswrapper[5120]: I0316 16:39:21.210379 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/26f0b4d3-a9a4-495b-a656-87bb6e9e77af-ring-data-devices\") pod \"swift-ring-rebalance-9hsz8\" (UID: \"26f0b4d3-a9a4-495b-a656-87bb6e9e77af\") " pod="openstack-kuttl-tests/swift-ring-rebalance-9hsz8" Mar 16 16:39:21 crc kubenswrapper[5120]: I0316 16:39:21.210432 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvxp7\" (UniqueName: \"kubernetes.io/projected/26f0b4d3-a9a4-495b-a656-87bb6e9e77af-kube-api-access-kvxp7\") pod \"swift-ring-rebalance-9hsz8\" (UID: \"26f0b4d3-a9a4-495b-a656-87bb6e9e77af\") " pod="openstack-kuttl-tests/swift-ring-rebalance-9hsz8" Mar 16 16:39:21 crc kubenswrapper[5120]: I0316 16:39:21.210485 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/26f0b4d3-a9a4-495b-a656-87bb6e9e77af-scripts\") pod \"swift-ring-rebalance-9hsz8\" (UID: \"26f0b4d3-a9a4-495b-a656-87bb6e9e77af\") " pod="openstack-kuttl-tests/swift-ring-rebalance-9hsz8" Mar 16 16:39:21 crc kubenswrapper[5120]: I0316 16:39:21.210507 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/26f0b4d3-a9a4-495b-a656-87bb6e9e77af-etc-swift\") pod \"swift-ring-rebalance-9hsz8\" (UID: \"26f0b4d3-a9a4-495b-a656-87bb6e9e77af\") " pod="openstack-kuttl-tests/swift-ring-rebalance-9hsz8" Mar 16 16:39:21 crc kubenswrapper[5120]: I0316 16:39:21.265155 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-db-create-xgxkv"] Mar 16 16:39:21 crc kubenswrapper[5120]: W0316 16:39:21.278805 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod62168229_1b96_48fa_aaac_639639d37e7f.slice/crio-a72774baa636115dfaf03b302755e0bf707fe72a26becdab04261cc4ecc601d6 WatchSource:0}: Error finding container a72774baa636115dfaf03b302755e0bf707fe72a26becdab04261cc4ecc601d6: Status 404 returned error can't find the container with id a72774baa636115dfaf03b302755e0bf707fe72a26becdab04261cc4ecc601d6 Mar 16 16:39:21 crc kubenswrapper[5120]: I0316 16:39:21.313923 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/26f0b4d3-a9a4-495b-a656-87bb6e9e77af-dispersionconf\") pod \"swift-ring-rebalance-9hsz8\" (UID: \"26f0b4d3-a9a4-495b-a656-87bb6e9e77af\") " pod="openstack-kuttl-tests/swift-ring-rebalance-9hsz8" Mar 16 16:39:21 crc kubenswrapper[5120]: I0316 16:39:21.314055 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/26f0b4d3-a9a4-495b-a656-87bb6e9e77af-swiftconf\") pod \"swift-ring-rebalance-9hsz8\" (UID: \"26f0b4d3-a9a4-495b-a656-87bb6e9e77af\") " pod="openstack-kuttl-tests/swift-ring-rebalance-9hsz8" Mar 16 16:39:21 crc kubenswrapper[5120]: I0316 16:39:21.314096 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/26f0b4d3-a9a4-495b-a656-87bb6e9e77af-combined-ca-bundle\") pod \"swift-ring-rebalance-9hsz8\" (UID: \"26f0b4d3-a9a4-495b-a656-87bb6e9e77af\") " pod="openstack-kuttl-tests/swift-ring-rebalance-9hsz8" Mar 16 16:39:21 crc kubenswrapper[5120]: I0316 16:39:21.314121 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/26f0b4d3-a9a4-495b-a656-87bb6e9e77af-ring-data-devices\") pod \"swift-ring-rebalance-9hsz8\" (UID: \"26f0b4d3-a9a4-495b-a656-87bb6e9e77af\") " pod="openstack-kuttl-tests/swift-ring-rebalance-9hsz8" Mar 16 16:39:21 crc kubenswrapper[5120]: I0316 16:39:21.314169 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kvxp7\" (UniqueName: \"kubernetes.io/projected/26f0b4d3-a9a4-495b-a656-87bb6e9e77af-kube-api-access-kvxp7\") pod \"swift-ring-rebalance-9hsz8\" (UID: \"26f0b4d3-a9a4-495b-a656-87bb6e9e77af\") " pod="openstack-kuttl-tests/swift-ring-rebalance-9hsz8" Mar 16 16:39:21 crc kubenswrapper[5120]: I0316 16:39:21.314217 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/26f0b4d3-a9a4-495b-a656-87bb6e9e77af-scripts\") pod \"swift-ring-rebalance-9hsz8\" (UID: \"26f0b4d3-a9a4-495b-a656-87bb6e9e77af\") " pod="openstack-kuttl-tests/swift-ring-rebalance-9hsz8" Mar 16 16:39:21 crc kubenswrapper[5120]: I0316 16:39:21.314239 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/26f0b4d3-a9a4-495b-a656-87bb6e9e77af-etc-swift\") pod \"swift-ring-rebalance-9hsz8\" (UID: \"26f0b4d3-a9a4-495b-a656-87bb6e9e77af\") " pod="openstack-kuttl-tests/swift-ring-rebalance-9hsz8" Mar 16 16:39:21 crc kubenswrapper[5120]: I0316 16:39:21.314667 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/26f0b4d3-a9a4-495b-a656-87bb6e9e77af-etc-swift\") pod \"swift-ring-rebalance-9hsz8\" (UID: \"26f0b4d3-a9a4-495b-a656-87bb6e9e77af\") " pod="openstack-kuttl-tests/swift-ring-rebalance-9hsz8" Mar 16 16:39:21 crc kubenswrapper[5120]: I0316 16:39:21.316359 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/26f0b4d3-a9a4-495b-a656-87bb6e9e77af-ring-data-devices\") pod \"swift-ring-rebalance-9hsz8\" (UID: \"26f0b4d3-a9a4-495b-a656-87bb6e9e77af\") " pod="openstack-kuttl-tests/swift-ring-rebalance-9hsz8" Mar 16 16:39:21 crc kubenswrapper[5120]: I0316 16:39:21.320341 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/26f0b4d3-a9a4-495b-a656-87bb6e9e77af-scripts\") pod \"swift-ring-rebalance-9hsz8\" (UID: \"26f0b4d3-a9a4-495b-a656-87bb6e9e77af\") " pod="openstack-kuttl-tests/swift-ring-rebalance-9hsz8" Mar 16 16:39:21 crc kubenswrapper[5120]: I0316 16:39:21.324326 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/26f0b4d3-a9a4-495b-a656-87bb6e9e77af-dispersionconf\") pod \"swift-ring-rebalance-9hsz8\" (UID: \"26f0b4d3-a9a4-495b-a656-87bb6e9e77af\") " pod="openstack-kuttl-tests/swift-ring-rebalance-9hsz8" Mar 16 16:39:21 crc kubenswrapper[5120]: I0316 16:39:21.324537 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/26f0b4d3-a9a4-495b-a656-87bb6e9e77af-combined-ca-bundle\") pod \"swift-ring-rebalance-9hsz8\" (UID: \"26f0b4d3-a9a4-495b-a656-87bb6e9e77af\") " pod="openstack-kuttl-tests/swift-ring-rebalance-9hsz8" Mar 16 16:39:21 crc kubenswrapper[5120]: I0316 16:39:21.324980 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/26f0b4d3-a9a4-495b-a656-87bb6e9e77af-swiftconf\") pod \"swift-ring-rebalance-9hsz8\" (UID: \"26f0b4d3-a9a4-495b-a656-87bb6e9e77af\") " pod="openstack-kuttl-tests/swift-ring-rebalance-9hsz8" Mar 16 16:39:21 crc kubenswrapper[5120]: I0316 16:39:21.335774 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvxp7\" (UniqueName: \"kubernetes.io/projected/26f0b4d3-a9a4-495b-a656-87bb6e9e77af-kube-api-access-kvxp7\") pod \"swift-ring-rebalance-9hsz8\" (UID: \"26f0b4d3-a9a4-495b-a656-87bb6e9e77af\") " pod="openstack-kuttl-tests/swift-ring-rebalance-9hsz8" Mar 16 16:39:21 crc kubenswrapper[5120]: I0316 16:39:21.356101 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-8aa2-account-create-update-7rn9g"] Mar 16 16:39:21 crc kubenswrapper[5120]: W0316 16:39:21.420465 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0bdcb33b_f908_4545_91d5_caebf2853b00.slice/crio-e6a24cc80345667b16af812d902a3013ca048a1541410a1def98f036cbb9ef5c WatchSource:0}: Error finding container e6a24cc80345667b16af812d902a3013ca048a1541410a1def98f036cbb9ef5c: Status 404 returned error can't find the container with id e6a24cc80345667b16af812d902a3013ca048a1541410a1def98f036cbb9ef5c Mar 16 16:39:21 crc kubenswrapper[5120]: I0316 16:39:21.516933 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-9hsz8" Mar 16 16:39:21 crc kubenswrapper[5120]: I0316 16:39:21.519562 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/7f161303-6db3-42fc-8cca-089c09eabda5-etc-swift\") pod \"swift-storage-0\" (UID: \"7f161303-6db3-42fc-8cca-089c09eabda5\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:39:21 crc kubenswrapper[5120]: E0316 16:39:21.520006 5120 projected.go:289] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Mar 16 16:39:21 crc kubenswrapper[5120]: E0316 16:39:21.520026 5120 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Mar 16 16:39:21 crc kubenswrapper[5120]: E0316 16:39:21.520079 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7f161303-6db3-42fc-8cca-089c09eabda5-etc-swift podName:7f161303-6db3-42fc-8cca-089c09eabda5 nodeName:}" failed. No retries permitted until 2026-03-16 16:39:22.520060825 +0000 UTC m=+4064.673992482 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/7f161303-6db3-42fc-8cca-089c09eabda5-etc-swift") pod "swift-storage-0" (UID: "7f161303-6db3-42fc-8cca-089c09eabda5") : configmap "swift-ring-files" not found Mar 16 16:39:22 crc kubenswrapper[5120]: I0316 16:39:22.007609 5120 patch_prober.go:28] interesting pod/machine-config-daemon-7bf76 container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 16:39:22 crc kubenswrapper[5120]: I0316 16:39:22.007897 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 16:39:22 crc kubenswrapper[5120]: I0316 16:39:22.017352 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-9hsz8"] Mar 16 16:39:22 crc kubenswrapper[5120]: I0316 16:39:22.020054 5120 generic.go:358] "Generic (PLEG): container finished" podID="bac9c78c-8043-4f94-9c2e-6bbbcac4d701" containerID="838fae15b9db6ddab356245c05fa306279bee839c450edfe59d4de45363856e5" exitCode=0 Mar 16 16:39:22 crc kubenswrapper[5120]: I0316 16:39:22.020201 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-87f5-account-create-update-76mr4" event={"ID":"bac9c78c-8043-4f94-9c2e-6bbbcac4d701","Type":"ContainerDied","Data":"838fae15b9db6ddab356245c05fa306279bee839c450edfe59d4de45363856e5"} Mar 16 16:39:22 crc kubenswrapper[5120]: I0316 16:39:22.020234 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-87f5-account-create-update-76mr4" event={"ID":"bac9c78c-8043-4f94-9c2e-6bbbcac4d701","Type":"ContainerStarted","Data":"e8f2f72ee2c8e08644df4ee2faae97a16158bf2bb108f9a6dfd50fd31967dc6c"} Mar 16 16:39:22 crc kubenswrapper[5120]: I0316 16:39:22.022101 5120 generic.go:358] "Generic (PLEG): container finished" podID="614326a5-97a1-4126-bdaf-f6d6e5e9631f" containerID="5ea460f810b64999bc8fc233431ed646811feda5936c1adb68a0d2fac4932f26" exitCode=0 Mar 16 16:39:22 crc kubenswrapper[5120]: I0316 16:39:22.022140 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-create-xq46z" event={"ID":"614326a5-97a1-4126-bdaf-f6d6e5e9631f","Type":"ContainerDied","Data":"5ea460f810b64999bc8fc233431ed646811feda5936c1adb68a0d2fac4932f26"} Mar 16 16:39:22 crc kubenswrapper[5120]: I0316 16:39:22.024438 5120 generic.go:358] "Generic (PLEG): container finished" podID="9ba55b11-2c75-4cfa-9cfc-be73cefc163c" containerID="f2b4d561e1e561ce166fd8d0d7036db69799932e866a7a79308d75218affb790" exitCode=0 Mar 16 16:39:22 crc kubenswrapper[5120]: I0316 16:39:22.024471 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-create-rl5vf" event={"ID":"9ba55b11-2c75-4cfa-9cfc-be73cefc163c","Type":"ContainerDied","Data":"f2b4d561e1e561ce166fd8d0d7036db69799932e866a7a79308d75218affb790"} Mar 16 16:39:22 crc kubenswrapper[5120]: W0316 16:39:22.029134 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod26f0b4d3_a9a4_495b_a656_87bb6e9e77af.slice/crio-45b316be17525e9395415b2353aa55a436b0bcf912912dceb81cb75b7c9f9baa WatchSource:0}: Error finding container 45b316be17525e9395415b2353aa55a436b0bcf912912dceb81cb75b7c9f9baa: Status 404 returned error can't find the container with id 45b316be17525e9395415b2353aa55a436b0bcf912912dceb81cb75b7c9f9baa Mar 16 16:39:22 crc kubenswrapper[5120]: I0316 16:39:22.030035 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"ed3ee889-136c-4331-b526-e110819e0ea0","Type":"ContainerStarted","Data":"11cff8daf5d0c8de9ad18c145b3373f93ecace32d87193c69d31b81eba839c8a"} Mar 16 16:39:22 crc kubenswrapper[5120]: I0316 16:39:22.030143 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"ed3ee889-136c-4331-b526-e110819e0ea0","Type":"ContainerStarted","Data":"349e4be45e63d65ddaa05eae3e0283fd863ef54d8526da2c2f6ad91f02e1f66a"} Mar 16 16:39:22 crc kubenswrapper[5120]: I0316 16:39:22.030336 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:39:22 crc kubenswrapper[5120]: I0316 16:39:22.035088 5120 generic.go:358] "Generic (PLEG): container finished" podID="0bdcb33b-f908-4545-91d5-caebf2853b00" containerID="63cfde29ac69f24622db3a28187c689db5dd4bd7908171895f855b2c6e7263c8" exitCode=0 Mar 16 16:39:22 crc kubenswrapper[5120]: I0316 16:39:22.035126 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-8aa2-account-create-update-7rn9g" event={"ID":"0bdcb33b-f908-4545-91d5-caebf2853b00","Type":"ContainerDied","Data":"63cfde29ac69f24622db3a28187c689db5dd4bd7908171895f855b2c6e7263c8"} Mar 16 16:39:22 crc kubenswrapper[5120]: I0316 16:39:22.035160 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-8aa2-account-create-update-7rn9g" event={"ID":"0bdcb33b-f908-4545-91d5-caebf2853b00","Type":"ContainerStarted","Data":"e6a24cc80345667b16af812d902a3013ca048a1541410a1def98f036cbb9ef5c"} Mar 16 16:39:22 crc kubenswrapper[5120]: I0316 16:39:22.036935 5120 generic.go:358] "Generic (PLEG): container finished" podID="e988df9f-eee2-4103-9df2-1e999506d1ca" containerID="994c828c806bfdb142a901d77444445c3c3aa899b6dba52d3d97f46faaf0751b" exitCode=0 Mar 16 16:39:22 crc kubenswrapper[5120]: I0316 16:39:22.037033 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-e7d9-account-create-update-fwr7k" event={"ID":"e988df9f-eee2-4103-9df2-1e999506d1ca","Type":"ContainerDied","Data":"994c828c806bfdb142a901d77444445c3c3aa899b6dba52d3d97f46faaf0751b"} Mar 16 16:39:22 crc kubenswrapper[5120]: I0316 16:39:22.044434 5120 generic.go:358] "Generic (PLEG): container finished" podID="62168229-1b96-48fa-aaac-639639d37e7f" containerID="988e19eb0acc93d4a8a5ebc97f5bf497c0ec4b10a4992295c7e6466c2d786cf4" exitCode=0 Mar 16 16:39:22 crc kubenswrapper[5120]: I0316 16:39:22.045017 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-create-xgxkv" event={"ID":"62168229-1b96-48fa-aaac-639639d37e7f","Type":"ContainerDied","Data":"988e19eb0acc93d4a8a5ebc97f5bf497c0ec4b10a4992295c7e6466c2d786cf4"} Mar 16 16:39:22 crc kubenswrapper[5120]: I0316 16:39:22.045066 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-create-xgxkv" event={"ID":"62168229-1b96-48fa-aaac-639639d37e7f","Type":"ContainerStarted","Data":"a72774baa636115dfaf03b302755e0bf707fe72a26becdab04261cc4ecc601d6"} Mar 16 16:39:22 crc kubenswrapper[5120]: I0316 16:39:22.048571 5120 generic.go:358] "Generic (PLEG): container finished" podID="3e7508b2-729a-4b53-a597-99cbabc7243a" containerID="ba7906458f732cf2c694eb801cb26f6b5d624ea022de95c9791781425a728ed6" exitCode=0 Mar 16 16:39:22 crc kubenswrapper[5120]: I0316 16:39:22.048723 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-be30-account-create-update-fq9th" event={"ID":"3e7508b2-729a-4b53-a597-99cbabc7243a","Type":"ContainerDied","Data":"ba7906458f732cf2c694eb801cb26f6b5d624ea022de95c9791781425a728ed6"} Mar 16 16:39:22 crc kubenswrapper[5120]: I0316 16:39:22.051495 5120 generic.go:358] "Generic (PLEG): container finished" podID="fa5c2ff2-6f51-49e1-bb96-be06788737c6" containerID="bb36d9bd5a502a8c48a5d57ca30444cb0718354b3de8db27ed27b4e9bdee39cc" exitCode=0 Mar 16 16:39:22 crc kubenswrapper[5120]: I0316 16:39:22.051714 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-create-7ztbs" event={"ID":"fa5c2ff2-6f51-49e1-bb96-be06788737c6","Type":"ContainerDied","Data":"bb36d9bd5a502a8c48a5d57ca30444cb0718354b3de8db27ed27b4e9bdee39cc"} Mar 16 16:39:22 crc kubenswrapper[5120]: I0316 16:39:22.140231 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/kube-state-metrics-0" podStartSLOduration=2.625201077 podStartE2EDuration="3.1401751s" podCreationTimestamp="2026-03-16 16:39:19 +0000 UTC" firstStartedPulling="2026-03-16 16:39:20.938033467 +0000 UTC m=+4063.091965114" lastFinishedPulling="2026-03-16 16:39:21.45300748 +0000 UTC m=+4063.606939137" observedRunningTime="2026-03-16 16:39:22.119847948 +0000 UTC m=+4064.273779615" watchObservedRunningTime="2026-03-16 16:39:22.1401751 +0000 UTC m=+4064.294106767" Mar 16 16:39:22 crc kubenswrapper[5120]: I0316 16:39:22.517001 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-create-rv5rl" Mar 16 16:39:22 crc kubenswrapper[5120]: I0316 16:39:22.547419 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/86673db2-3d2b-4864-ae11-c6895dc677d2-operator-scripts\") pod \"86673db2-3d2b-4864-ae11-c6895dc677d2\" (UID: \"86673db2-3d2b-4864-ae11-c6895dc677d2\") " Mar 16 16:39:22 crc kubenswrapper[5120]: I0316 16:39:22.547562 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g9jgz\" (UniqueName: \"kubernetes.io/projected/86673db2-3d2b-4864-ae11-c6895dc677d2-kube-api-access-g9jgz\") pod \"86673db2-3d2b-4864-ae11-c6895dc677d2\" (UID: \"86673db2-3d2b-4864-ae11-c6895dc677d2\") " Mar 16 16:39:22 crc kubenswrapper[5120]: I0316 16:39:22.547942 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/7f161303-6db3-42fc-8cca-089c09eabda5-etc-swift\") pod \"swift-storage-0\" (UID: \"7f161303-6db3-42fc-8cca-089c09eabda5\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:39:22 crc kubenswrapper[5120]: I0316 16:39:22.548166 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/86673db2-3d2b-4864-ae11-c6895dc677d2-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "86673db2-3d2b-4864-ae11-c6895dc677d2" (UID: "86673db2-3d2b-4864-ae11-c6895dc677d2"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:39:22 crc kubenswrapper[5120]: E0316 16:39:22.548312 5120 projected.go:289] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Mar 16 16:39:22 crc kubenswrapper[5120]: E0316 16:39:22.548340 5120 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Mar 16 16:39:22 crc kubenswrapper[5120]: E0316 16:39:22.548401 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7f161303-6db3-42fc-8cca-089c09eabda5-etc-swift podName:7f161303-6db3-42fc-8cca-089c09eabda5 nodeName:}" failed. No retries permitted until 2026-03-16 16:39:24.548380361 +0000 UTC m=+4066.702312018 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/7f161303-6db3-42fc-8cca-089c09eabda5-etc-swift") pod "swift-storage-0" (UID: "7f161303-6db3-42fc-8cca-089c09eabda5") : configmap "swift-ring-files" not found Mar 16 16:39:22 crc kubenswrapper[5120]: I0316 16:39:22.548509 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/86673db2-3d2b-4864-ae11-c6895dc677d2-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:39:22 crc kubenswrapper[5120]: I0316 16:39:22.566456 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86673db2-3d2b-4864-ae11-c6895dc677d2-kube-api-access-g9jgz" (OuterVolumeSpecName: "kube-api-access-g9jgz") pod "86673db2-3d2b-4864-ae11-c6895dc677d2" (UID: "86673db2-3d2b-4864-ae11-c6895dc677d2"). InnerVolumeSpecName "kube-api-access-g9jgz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:39:22 crc kubenswrapper[5120]: I0316 16:39:22.650564 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g9jgz\" (UniqueName: \"kubernetes.io/projected/86673db2-3d2b-4864-ae11-c6895dc677d2-kube-api-access-g9jgz\") on node \"crc\" DevicePath \"\"" Mar 16 16:39:22 crc kubenswrapper[5120]: I0316 16:39:22.708319 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-454d-account-create-update-rqbdt" Mar 16 16:39:22 crc kubenswrapper[5120]: I0316 16:39:22.754410 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2abd03fd-0270-463a-a9ca-95c22226e8ec-operator-scripts\") pod \"2abd03fd-0270-463a-a9ca-95c22226e8ec\" (UID: \"2abd03fd-0270-463a-a9ca-95c22226e8ec\") " Mar 16 16:39:22 crc kubenswrapper[5120]: I0316 16:39:22.755071 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9j85b\" (UniqueName: \"kubernetes.io/projected/2abd03fd-0270-463a-a9ca-95c22226e8ec-kube-api-access-9j85b\") pod \"2abd03fd-0270-463a-a9ca-95c22226e8ec\" (UID: \"2abd03fd-0270-463a-a9ca-95c22226e8ec\") " Mar 16 16:39:22 crc kubenswrapper[5120]: I0316 16:39:22.756545 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2abd03fd-0270-463a-a9ca-95c22226e8ec-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "2abd03fd-0270-463a-a9ca-95c22226e8ec" (UID: "2abd03fd-0270-463a-a9ca-95c22226e8ec"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:39:22 crc kubenswrapper[5120]: I0316 16:39:22.763751 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2abd03fd-0270-463a-a9ca-95c22226e8ec-kube-api-access-9j85b" (OuterVolumeSpecName: "kube-api-access-9j85b") pod "2abd03fd-0270-463a-a9ca-95c22226e8ec" (UID: "2abd03fd-0270-463a-a9ca-95c22226e8ec"). InnerVolumeSpecName "kube-api-access-9j85b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:39:22 crc kubenswrapper[5120]: I0316 16:39:22.856161 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-create-52jsz" Mar 16 16:39:22 crc kubenswrapper[5120]: I0316 16:39:22.861705 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9j85b\" (UniqueName: \"kubernetes.io/projected/2abd03fd-0270-463a-a9ca-95c22226e8ec-kube-api-access-9j85b\") on node \"crc\" DevicePath \"\"" Mar 16 16:39:22 crc kubenswrapper[5120]: I0316 16:39:22.861740 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2abd03fd-0270-463a-a9ca-95c22226e8ec-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:39:22 crc kubenswrapper[5120]: I0316 16:39:22.869232 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-e32b-account-create-update-mlh9x" Mar 16 16:39:22 crc kubenswrapper[5120]: I0316 16:39:22.968231 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p2lqj\" (UniqueName: \"kubernetes.io/projected/9aa6ed1b-b014-4ff6-97aa-387eceb58d13-kube-api-access-p2lqj\") pod \"9aa6ed1b-b014-4ff6-97aa-387eceb58d13\" (UID: \"9aa6ed1b-b014-4ff6-97aa-387eceb58d13\") " Mar 16 16:39:22 crc kubenswrapper[5120]: I0316 16:39:22.968298 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9aa6ed1b-b014-4ff6-97aa-387eceb58d13-operator-scripts\") pod \"9aa6ed1b-b014-4ff6-97aa-387eceb58d13\" (UID: \"9aa6ed1b-b014-4ff6-97aa-387eceb58d13\") " Mar 16 16:39:22 crc kubenswrapper[5120]: I0316 16:39:22.968343 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lmzt6\" (UniqueName: \"kubernetes.io/projected/93a2b4d2-8481-44a9-8d12-62db95189e45-kube-api-access-lmzt6\") pod \"93a2b4d2-8481-44a9-8d12-62db95189e45\" (UID: \"93a2b4d2-8481-44a9-8d12-62db95189e45\") " Mar 16 16:39:22 crc kubenswrapper[5120]: I0316 16:39:22.968450 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/93a2b4d2-8481-44a9-8d12-62db95189e45-operator-scripts\") pod \"93a2b4d2-8481-44a9-8d12-62db95189e45\" (UID: \"93a2b4d2-8481-44a9-8d12-62db95189e45\") " Mar 16 16:39:22 crc kubenswrapper[5120]: I0316 16:39:22.969345 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/93a2b4d2-8481-44a9-8d12-62db95189e45-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "93a2b4d2-8481-44a9-8d12-62db95189e45" (UID: "93a2b4d2-8481-44a9-8d12-62db95189e45"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:39:22 crc kubenswrapper[5120]: I0316 16:39:22.970894 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9aa6ed1b-b014-4ff6-97aa-387eceb58d13-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "9aa6ed1b-b014-4ff6-97aa-387eceb58d13" (UID: "9aa6ed1b-b014-4ff6-97aa-387eceb58d13"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:39:22 crc kubenswrapper[5120]: I0316 16:39:22.971037 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9aa6ed1b-b014-4ff6-97aa-387eceb58d13-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:39:22 crc kubenswrapper[5120]: I0316 16:39:22.971072 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/93a2b4d2-8481-44a9-8d12-62db95189e45-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:39:22 crc kubenswrapper[5120]: I0316 16:39:22.974068 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9aa6ed1b-b014-4ff6-97aa-387eceb58d13-kube-api-access-p2lqj" (OuterVolumeSpecName: "kube-api-access-p2lqj") pod "9aa6ed1b-b014-4ff6-97aa-387eceb58d13" (UID: "9aa6ed1b-b014-4ff6-97aa-387eceb58d13"). InnerVolumeSpecName "kube-api-access-p2lqj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:39:22 crc kubenswrapper[5120]: I0316 16:39:22.974123 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93a2b4d2-8481-44a9-8d12-62db95189e45-kube-api-access-lmzt6" (OuterVolumeSpecName: "kube-api-access-lmzt6") pod "93a2b4d2-8481-44a9-8d12-62db95189e45" (UID: "93a2b4d2-8481-44a9-8d12-62db95189e45"). InnerVolumeSpecName "kube-api-access-lmzt6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:39:23 crc kubenswrapper[5120]: I0316 16:39:23.062709 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-9hsz8" event={"ID":"26f0b4d3-a9a4-495b-a656-87bb6e9e77af","Type":"ContainerStarted","Data":"671727f21c19391699a48ba467425210ed9412567d45a035a011960cf10b8083"} Mar 16 16:39:23 crc kubenswrapper[5120]: I0316 16:39:23.062780 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-9hsz8" event={"ID":"26f0b4d3-a9a4-495b-a656-87bb6e9e77af","Type":"ContainerStarted","Data":"45b316be17525e9395415b2353aa55a436b0bcf912912dceb81cb75b7c9f9baa"} Mar 16 16:39:23 crc kubenswrapper[5120]: I0316 16:39:23.075619 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p2lqj\" (UniqueName: \"kubernetes.io/projected/9aa6ed1b-b014-4ff6-97aa-387eceb58d13-kube-api-access-p2lqj\") on node \"crc\" DevicePath \"\"" Mar 16 16:39:23 crc kubenswrapper[5120]: I0316 16:39:23.075658 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lmzt6\" (UniqueName: \"kubernetes.io/projected/93a2b4d2-8481-44a9-8d12-62db95189e45-kube-api-access-lmzt6\") on node \"crc\" DevicePath \"\"" Mar 16 16:39:23 crc kubenswrapper[5120]: I0316 16:39:23.075699 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-create-rv5rl" Mar 16 16:39:23 crc kubenswrapper[5120]: I0316 16:39:23.075817 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-create-rv5rl" event={"ID":"86673db2-3d2b-4864-ae11-c6895dc677d2","Type":"ContainerDied","Data":"5fa29f28419a25df9328d9a82365eef54951042c76d65f8320ac613abe4113db"} Mar 16 16:39:23 crc kubenswrapper[5120]: I0316 16:39:23.075857 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5fa29f28419a25df9328d9a82365eef54951042c76d65f8320ac613abe4113db" Mar 16 16:39:23 crc kubenswrapper[5120]: I0316 16:39:23.078287 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-454d-account-create-update-rqbdt" event={"ID":"2abd03fd-0270-463a-a9ca-95c22226e8ec","Type":"ContainerDied","Data":"3f872df1cac016769d7494e7471b8faf9859fe1ea773e6b13ac64e0bda696bef"} Mar 16 16:39:23 crc kubenswrapper[5120]: I0316 16:39:23.078322 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3f872df1cac016769d7494e7471b8faf9859fe1ea773e6b13ac64e0bda696bef" Mar 16 16:39:23 crc kubenswrapper[5120]: I0316 16:39:23.078387 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-454d-account-create-update-rqbdt" Mar 16 16:39:23 crc kubenswrapper[5120]: I0316 16:39:23.082160 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-create-52jsz" Mar 16 16:39:23 crc kubenswrapper[5120]: I0316 16:39:23.082355 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-create-52jsz" event={"ID":"9aa6ed1b-b014-4ff6-97aa-387eceb58d13","Type":"ContainerDied","Data":"ed08c648f75852d9cd0c372093b585ccf890911c70f8dbdbe3789e05833101ca"} Mar 16 16:39:23 crc kubenswrapper[5120]: I0316 16:39:23.082392 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ed08c648f75852d9cd0c372093b585ccf890911c70f8dbdbe3789e05833101ca" Mar 16 16:39:23 crc kubenswrapper[5120]: I0316 16:39:23.085742 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-e32b-account-create-update-mlh9x" event={"ID":"93a2b4d2-8481-44a9-8d12-62db95189e45","Type":"ContainerDied","Data":"90aa784334a551f310e1e18c0dbdec63307d4a23f7fffcca1976653e44c27db5"} Mar 16 16:39:23 crc kubenswrapper[5120]: I0316 16:39:23.085802 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="90aa784334a551f310e1e18c0dbdec63307d4a23f7fffcca1976653e44c27db5" Mar 16 16:39:23 crc kubenswrapper[5120]: I0316 16:39:23.085956 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-e32b-account-create-update-mlh9x" Mar 16 16:39:23 crc kubenswrapper[5120]: I0316 16:39:23.104793 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/swift-ring-rebalance-9hsz8" podStartSLOduration=2.104358007 podStartE2EDuration="2.104358007s" podCreationTimestamp="2026-03-16 16:39:21 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:39:23.093681148 +0000 UTC m=+4065.247612815" watchObservedRunningTime="2026-03-16 16:39:23.104358007 +0000 UTC m=+4065.258289684" Mar 16 16:39:23 crc kubenswrapper[5120]: I0316 16:39:23.567062 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-be30-account-create-update-fq9th" Mar 16 16:39:23 crc kubenswrapper[5120]: I0316 16:39:23.689023 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-create-xgxkv" Mar 16 16:39:23 crc kubenswrapper[5120]: I0316 16:39:23.692616 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jzpf7\" (UniqueName: \"kubernetes.io/projected/3e7508b2-729a-4b53-a597-99cbabc7243a-kube-api-access-jzpf7\") pod \"3e7508b2-729a-4b53-a597-99cbabc7243a\" (UID: \"3e7508b2-729a-4b53-a597-99cbabc7243a\") " Mar 16 16:39:23 crc kubenswrapper[5120]: I0316 16:39:23.693094 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3e7508b2-729a-4b53-a597-99cbabc7243a-operator-scripts\") pod \"3e7508b2-729a-4b53-a597-99cbabc7243a\" (UID: \"3e7508b2-729a-4b53-a597-99cbabc7243a\") " Mar 16 16:39:23 crc kubenswrapper[5120]: I0316 16:39:23.693838 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3e7508b2-729a-4b53-a597-99cbabc7243a-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "3e7508b2-729a-4b53-a597-99cbabc7243a" (UID: "3e7508b2-729a-4b53-a597-99cbabc7243a"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:39:23 crc kubenswrapper[5120]: I0316 16:39:23.701929 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e7508b2-729a-4b53-a597-99cbabc7243a-kube-api-access-jzpf7" (OuterVolumeSpecName: "kube-api-access-jzpf7") pod "3e7508b2-729a-4b53-a597-99cbabc7243a" (UID: "3e7508b2-729a-4b53-a597-99cbabc7243a"). InnerVolumeSpecName "kube-api-access-jzpf7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:39:23 crc kubenswrapper[5120]: I0316 16:39:23.795341 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/62168229-1b96-48fa-aaac-639639d37e7f-operator-scripts\") pod \"62168229-1b96-48fa-aaac-639639d37e7f\" (UID: \"62168229-1b96-48fa-aaac-639639d37e7f\") " Mar 16 16:39:23 crc kubenswrapper[5120]: I0316 16:39:23.795754 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zf5st\" (UniqueName: \"kubernetes.io/projected/62168229-1b96-48fa-aaac-639639d37e7f-kube-api-access-zf5st\") pod \"62168229-1b96-48fa-aaac-639639d37e7f\" (UID: \"62168229-1b96-48fa-aaac-639639d37e7f\") " Mar 16 16:39:23 crc kubenswrapper[5120]: I0316 16:39:23.796749 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jzpf7\" (UniqueName: \"kubernetes.io/projected/3e7508b2-729a-4b53-a597-99cbabc7243a-kube-api-access-jzpf7\") on node \"crc\" DevicePath \"\"" Mar 16 16:39:23 crc kubenswrapper[5120]: I0316 16:39:23.796795 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3e7508b2-729a-4b53-a597-99cbabc7243a-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:39:23 crc kubenswrapper[5120]: I0316 16:39:23.798435 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/62168229-1b96-48fa-aaac-639639d37e7f-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "62168229-1b96-48fa-aaac-639639d37e7f" (UID: "62168229-1b96-48fa-aaac-639639d37e7f"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:39:23 crc kubenswrapper[5120]: I0316 16:39:23.800525 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62168229-1b96-48fa-aaac-639639d37e7f-kube-api-access-zf5st" (OuterVolumeSpecName: "kube-api-access-zf5st") pod "62168229-1b96-48fa-aaac-639639d37e7f" (UID: "62168229-1b96-48fa-aaac-639639d37e7f"). InnerVolumeSpecName "kube-api-access-zf5st". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:39:23 crc kubenswrapper[5120]: I0316 16:39:23.910135 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zf5st\" (UniqueName: \"kubernetes.io/projected/62168229-1b96-48fa-aaac-639639d37e7f-kube-api-access-zf5st\") on node \"crc\" DevicePath \"\"" Mar 16 16:39:23 crc kubenswrapper[5120]: I0316 16:39:23.911970 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/62168229-1b96-48fa-aaac-639639d37e7f-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:39:23 crc kubenswrapper[5120]: I0316 16:39:23.923472 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-create-xq46z" Mar 16 16:39:23 crc kubenswrapper[5120]: I0316 16:39:23.935707 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-87f5-account-create-update-76mr4" Mar 16 16:39:23 crc kubenswrapper[5120]: I0316 16:39:23.948230 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-create-rl5vf" Mar 16 16:39:23 crc kubenswrapper[5120]: I0316 16:39:23.963018 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-8aa2-account-create-update-7rn9g" Mar 16 16:39:23 crc kubenswrapper[5120]: I0316 16:39:23.986307 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-e7d9-account-create-update-fwr7k" Mar 16 16:39:23 crc kubenswrapper[5120]: I0316 16:39:23.997162 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-create-7ztbs" Mar 16 16:39:24 crc kubenswrapper[5120]: I0316 16:39:24.013353 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-89r5p\" (UniqueName: \"kubernetes.io/projected/614326a5-97a1-4126-bdaf-f6d6e5e9631f-kube-api-access-89r5p\") pod \"614326a5-97a1-4126-bdaf-f6d6e5e9631f\" (UID: \"614326a5-97a1-4126-bdaf-f6d6e5e9631f\") " Mar 16 16:39:24 crc kubenswrapper[5120]: I0316 16:39:24.015789 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g4mlj\" (UniqueName: \"kubernetes.io/projected/bac9c78c-8043-4f94-9c2e-6bbbcac4d701-kube-api-access-g4mlj\") pod \"bac9c78c-8043-4f94-9c2e-6bbbcac4d701\" (UID: \"bac9c78c-8043-4f94-9c2e-6bbbcac4d701\") " Mar 16 16:39:24 crc kubenswrapper[5120]: I0316 16:39:24.016060 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/614326a5-97a1-4126-bdaf-f6d6e5e9631f-operator-scripts\") pod \"614326a5-97a1-4126-bdaf-f6d6e5e9631f\" (UID: \"614326a5-97a1-4126-bdaf-f6d6e5e9631f\") " Mar 16 16:39:24 crc kubenswrapper[5120]: I0316 16:39:24.016209 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ll8gw\" (UniqueName: \"kubernetes.io/projected/9ba55b11-2c75-4cfa-9cfc-be73cefc163c-kube-api-access-ll8gw\") pod \"9ba55b11-2c75-4cfa-9cfc-be73cefc163c\" (UID: \"9ba55b11-2c75-4cfa-9cfc-be73cefc163c\") " Mar 16 16:39:24 crc kubenswrapper[5120]: I0316 16:39:24.016342 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/bac9c78c-8043-4f94-9c2e-6bbbcac4d701-operator-scripts\") pod \"bac9c78c-8043-4f94-9c2e-6bbbcac4d701\" (UID: \"bac9c78c-8043-4f94-9c2e-6bbbcac4d701\") " Mar 16 16:39:24 crc kubenswrapper[5120]: I0316 16:39:24.016550 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9ba55b11-2c75-4cfa-9cfc-be73cefc163c-operator-scripts\") pod \"9ba55b11-2c75-4cfa-9cfc-be73cefc163c\" (UID: \"9ba55b11-2c75-4cfa-9cfc-be73cefc163c\") " Mar 16 16:39:24 crc kubenswrapper[5120]: I0316 16:39:24.017823 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ba55b11-2c75-4cfa-9cfc-be73cefc163c-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "9ba55b11-2c75-4cfa-9cfc-be73cefc163c" (UID: "9ba55b11-2c75-4cfa-9cfc-be73cefc163c"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:39:24 crc kubenswrapper[5120]: I0316 16:39:24.018310 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bac9c78c-8043-4f94-9c2e-6bbbcac4d701-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "bac9c78c-8043-4f94-9c2e-6bbbcac4d701" (UID: "bac9c78c-8043-4f94-9c2e-6bbbcac4d701"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:39:24 crc kubenswrapper[5120]: I0316 16:39:24.019128 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/614326a5-97a1-4126-bdaf-f6d6e5e9631f-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "614326a5-97a1-4126-bdaf-f6d6e5e9631f" (UID: "614326a5-97a1-4126-bdaf-f6d6e5e9631f"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:39:24 crc kubenswrapper[5120]: I0316 16:39:24.024589 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/614326a5-97a1-4126-bdaf-f6d6e5e9631f-kube-api-access-89r5p" (OuterVolumeSpecName: "kube-api-access-89r5p") pod "614326a5-97a1-4126-bdaf-f6d6e5e9631f" (UID: "614326a5-97a1-4126-bdaf-f6d6e5e9631f"). InnerVolumeSpecName "kube-api-access-89r5p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:39:24 crc kubenswrapper[5120]: I0316 16:39:24.035658 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bac9c78c-8043-4f94-9c2e-6bbbcac4d701-kube-api-access-g4mlj" (OuterVolumeSpecName: "kube-api-access-g4mlj") pod "bac9c78c-8043-4f94-9c2e-6bbbcac4d701" (UID: "bac9c78c-8043-4f94-9c2e-6bbbcac4d701"). InnerVolumeSpecName "kube-api-access-g4mlj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:39:24 crc kubenswrapper[5120]: I0316 16:39:24.036555 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ba55b11-2c75-4cfa-9cfc-be73cefc163c-kube-api-access-ll8gw" (OuterVolumeSpecName: "kube-api-access-ll8gw") pod "9ba55b11-2c75-4cfa-9cfc-be73cefc163c" (UID: "9ba55b11-2c75-4cfa-9cfc-be73cefc163c"). InnerVolumeSpecName "kube-api-access-ll8gw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:39:24 crc kubenswrapper[5120]: I0316 16:39:24.100781 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-87f5-account-create-update-76mr4" event={"ID":"bac9c78c-8043-4f94-9c2e-6bbbcac4d701","Type":"ContainerDied","Data":"e8f2f72ee2c8e08644df4ee2faae97a16158bf2bb108f9a6dfd50fd31967dc6c"} Mar 16 16:39:24 crc kubenswrapper[5120]: I0316 16:39:24.100829 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e8f2f72ee2c8e08644df4ee2faae97a16158bf2bb108f9a6dfd50fd31967dc6c" Mar 16 16:39:24 crc kubenswrapper[5120]: I0316 16:39:24.100898 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-87f5-account-create-update-76mr4" Mar 16 16:39:24 crc kubenswrapper[5120]: I0316 16:39:24.107685 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-create-xq46z" event={"ID":"614326a5-97a1-4126-bdaf-f6d6e5e9631f","Type":"ContainerDied","Data":"1fca5356b0f4e9ff000b1bf5e1466c841856178a2bb7de13ee73f9fda3402b6b"} Mar 16 16:39:24 crc kubenswrapper[5120]: I0316 16:39:24.107722 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1fca5356b0f4e9ff000b1bf5e1466c841856178a2bb7de13ee73f9fda3402b6b" Mar 16 16:39:24 crc kubenswrapper[5120]: I0316 16:39:24.107806 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-create-xq46z" Mar 16 16:39:24 crc kubenswrapper[5120]: I0316 16:39:24.114290 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-create-rl5vf" Mar 16 16:39:24 crc kubenswrapper[5120]: I0316 16:39:24.114293 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-create-rl5vf" event={"ID":"9ba55b11-2c75-4cfa-9cfc-be73cefc163c","Type":"ContainerDied","Data":"d5b62f4007fe48fcb0ef75f9ae3cd9a405a2034be82f757b9ad23d2cfb16f9ad"} Mar 16 16:39:24 crc kubenswrapper[5120]: I0316 16:39:24.114439 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d5b62f4007fe48fcb0ef75f9ae3cd9a405a2034be82f757b9ad23d2cfb16f9ad" Mar 16 16:39:24 crc kubenswrapper[5120]: I0316 16:39:24.118036 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-74mnj\" (UniqueName: \"kubernetes.io/projected/fa5c2ff2-6f51-49e1-bb96-be06788737c6-kube-api-access-74mnj\") pod \"fa5c2ff2-6f51-49e1-bb96-be06788737c6\" (UID: \"fa5c2ff2-6f51-49e1-bb96-be06788737c6\") " Mar 16 16:39:24 crc kubenswrapper[5120]: I0316 16:39:24.118122 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hsx54\" (UniqueName: \"kubernetes.io/projected/0bdcb33b-f908-4545-91d5-caebf2853b00-kube-api-access-hsx54\") pod \"0bdcb33b-f908-4545-91d5-caebf2853b00\" (UID: \"0bdcb33b-f908-4545-91d5-caebf2853b00\") " Mar 16 16:39:24 crc kubenswrapper[5120]: I0316 16:39:24.118199 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d94rg\" (UniqueName: \"kubernetes.io/projected/e988df9f-eee2-4103-9df2-1e999506d1ca-kube-api-access-d94rg\") pod \"e988df9f-eee2-4103-9df2-1e999506d1ca\" (UID: \"e988df9f-eee2-4103-9df2-1e999506d1ca\") " Mar 16 16:39:24 crc kubenswrapper[5120]: I0316 16:39:24.118899 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0bdcb33b-f908-4545-91d5-caebf2853b00-operator-scripts\") pod \"0bdcb33b-f908-4545-91d5-caebf2853b00\" (UID: \"0bdcb33b-f908-4545-91d5-caebf2853b00\") " Mar 16 16:39:24 crc kubenswrapper[5120]: I0316 16:39:24.119045 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/fa5c2ff2-6f51-49e1-bb96-be06788737c6-operator-scripts\") pod \"fa5c2ff2-6f51-49e1-bb96-be06788737c6\" (UID: \"fa5c2ff2-6f51-49e1-bb96-be06788737c6\") " Mar 16 16:39:24 crc kubenswrapper[5120]: I0316 16:39:24.119146 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e988df9f-eee2-4103-9df2-1e999506d1ca-operator-scripts\") pod \"e988df9f-eee2-4103-9df2-1e999506d1ca\" (UID: \"e988df9f-eee2-4103-9df2-1e999506d1ca\") " Mar 16 16:39:24 crc kubenswrapper[5120]: I0316 16:39:24.119985 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/614326a5-97a1-4126-bdaf-f6d6e5e9631f-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:39:24 crc kubenswrapper[5120]: I0316 16:39:24.120003 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ll8gw\" (UniqueName: \"kubernetes.io/projected/9ba55b11-2c75-4cfa-9cfc-be73cefc163c-kube-api-access-ll8gw\") on node \"crc\" DevicePath \"\"" Mar 16 16:39:24 crc kubenswrapper[5120]: I0316 16:39:24.120014 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/bac9c78c-8043-4f94-9c2e-6bbbcac4d701-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:39:24 crc kubenswrapper[5120]: I0316 16:39:24.120023 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9ba55b11-2c75-4cfa-9cfc-be73cefc163c-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:39:24 crc kubenswrapper[5120]: I0316 16:39:24.120014 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0bdcb33b-f908-4545-91d5-caebf2853b00-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "0bdcb33b-f908-4545-91d5-caebf2853b00" (UID: "0bdcb33b-f908-4545-91d5-caebf2853b00"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:39:24 crc kubenswrapper[5120]: I0316 16:39:24.120032 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-89r5p\" (UniqueName: \"kubernetes.io/projected/614326a5-97a1-4126-bdaf-f6d6e5e9631f-kube-api-access-89r5p\") on node \"crc\" DevicePath \"\"" Mar 16 16:39:24 crc kubenswrapper[5120]: I0316 16:39:24.120088 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g4mlj\" (UniqueName: \"kubernetes.io/projected/bac9c78c-8043-4f94-9c2e-6bbbcac4d701-kube-api-access-g4mlj\") on node \"crc\" DevicePath \"\"" Mar 16 16:39:24 crc kubenswrapper[5120]: I0316 16:39:24.120098 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fa5c2ff2-6f51-49e1-bb96-be06788737c6-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "fa5c2ff2-6f51-49e1-bb96-be06788737c6" (UID: "fa5c2ff2-6f51-49e1-bb96-be06788737c6"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:39:24 crc kubenswrapper[5120]: I0316 16:39:24.120410 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e988df9f-eee2-4103-9df2-1e999506d1ca-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "e988df9f-eee2-4103-9df2-1e999506d1ca" (UID: "e988df9f-eee2-4103-9df2-1e999506d1ca"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:39:24 crc kubenswrapper[5120]: I0316 16:39:24.121712 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0bdcb33b-f908-4545-91d5-caebf2853b00-kube-api-access-hsx54" (OuterVolumeSpecName: "kube-api-access-hsx54") pod "0bdcb33b-f908-4545-91d5-caebf2853b00" (UID: "0bdcb33b-f908-4545-91d5-caebf2853b00"). InnerVolumeSpecName "kube-api-access-hsx54". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:39:24 crc kubenswrapper[5120]: I0316 16:39:24.124057 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-8aa2-account-create-update-7rn9g" Mar 16 16:39:24 crc kubenswrapper[5120]: I0316 16:39:24.124222 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa5c2ff2-6f51-49e1-bb96-be06788737c6-kube-api-access-74mnj" (OuterVolumeSpecName: "kube-api-access-74mnj") pod "fa5c2ff2-6f51-49e1-bb96-be06788737c6" (UID: "fa5c2ff2-6f51-49e1-bb96-be06788737c6"). InnerVolumeSpecName "kube-api-access-74mnj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:39:24 crc kubenswrapper[5120]: I0316 16:39:24.124078 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-8aa2-account-create-update-7rn9g" event={"ID":"0bdcb33b-f908-4545-91d5-caebf2853b00","Type":"ContainerDied","Data":"e6a24cc80345667b16af812d902a3013ca048a1541410a1def98f036cbb9ef5c"} Mar 16 16:39:24 crc kubenswrapper[5120]: I0316 16:39:24.124425 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e6a24cc80345667b16af812d902a3013ca048a1541410a1def98f036cbb9ef5c" Mar 16 16:39:24 crc kubenswrapper[5120]: I0316 16:39:24.125437 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e988df9f-eee2-4103-9df2-1e999506d1ca-kube-api-access-d94rg" (OuterVolumeSpecName: "kube-api-access-d94rg") pod "e988df9f-eee2-4103-9df2-1e999506d1ca" (UID: "e988df9f-eee2-4103-9df2-1e999506d1ca"). InnerVolumeSpecName "kube-api-access-d94rg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:39:24 crc kubenswrapper[5120]: I0316 16:39:24.129119 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-e7d9-account-create-update-fwr7k" Mar 16 16:39:24 crc kubenswrapper[5120]: I0316 16:39:24.129290 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-e7d9-account-create-update-fwr7k" event={"ID":"e988df9f-eee2-4103-9df2-1e999506d1ca","Type":"ContainerDied","Data":"fd88f80cfd0b654dedc87297e9edce3be1e7db12ef6044609f2bc69b3c2caf5e"} Mar 16 16:39:24 crc kubenswrapper[5120]: I0316 16:39:24.129409 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fd88f80cfd0b654dedc87297e9edce3be1e7db12ef6044609f2bc69b3c2caf5e" Mar 16 16:39:24 crc kubenswrapper[5120]: I0316 16:39:24.133478 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-create-xgxkv" event={"ID":"62168229-1b96-48fa-aaac-639639d37e7f","Type":"ContainerDied","Data":"a72774baa636115dfaf03b302755e0bf707fe72a26becdab04261cc4ecc601d6"} Mar 16 16:39:24 crc kubenswrapper[5120]: I0316 16:39:24.133517 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a72774baa636115dfaf03b302755e0bf707fe72a26becdab04261cc4ecc601d6" Mar 16 16:39:24 crc kubenswrapper[5120]: I0316 16:39:24.133634 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-create-xgxkv" Mar 16 16:39:24 crc kubenswrapper[5120]: I0316 16:39:24.136618 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-be30-account-create-update-fq9th" Mar 16 16:39:24 crc kubenswrapper[5120]: I0316 16:39:24.136625 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-be30-account-create-update-fq9th" event={"ID":"3e7508b2-729a-4b53-a597-99cbabc7243a","Type":"ContainerDied","Data":"3ef020f9e3d964d6125be8ffcb1949a0b1c2161db07f910cc9b6b1b9a9efacc8"} Mar 16 16:39:24 crc kubenswrapper[5120]: I0316 16:39:24.136914 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3ef020f9e3d964d6125be8ffcb1949a0b1c2161db07f910cc9b6b1b9a9efacc8" Mar 16 16:39:24 crc kubenswrapper[5120]: I0316 16:39:24.140247 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-create-7ztbs" Mar 16 16:39:24 crc kubenswrapper[5120]: I0316 16:39:24.140538 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-create-7ztbs" event={"ID":"fa5c2ff2-6f51-49e1-bb96-be06788737c6","Type":"ContainerDied","Data":"d6d071fdeb6bd31100eb75cfb5ad1ec6bf3d0ca342d8ce44fceffca2995e4412"} Mar 16 16:39:24 crc kubenswrapper[5120]: I0316 16:39:24.140575 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d6d071fdeb6bd31100eb75cfb5ad1ec6bf3d0ca342d8ce44fceffca2995e4412" Mar 16 16:39:24 crc kubenswrapper[5120]: I0316 16:39:24.223464 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-74mnj\" (UniqueName: \"kubernetes.io/projected/fa5c2ff2-6f51-49e1-bb96-be06788737c6-kube-api-access-74mnj\") on node \"crc\" DevicePath \"\"" Mar 16 16:39:24 crc kubenswrapper[5120]: I0316 16:39:24.223508 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hsx54\" (UniqueName: \"kubernetes.io/projected/0bdcb33b-f908-4545-91d5-caebf2853b00-kube-api-access-hsx54\") on node \"crc\" DevicePath \"\"" Mar 16 16:39:24 crc kubenswrapper[5120]: I0316 16:39:24.223550 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d94rg\" (UniqueName: \"kubernetes.io/projected/e988df9f-eee2-4103-9df2-1e999506d1ca-kube-api-access-d94rg\") on node \"crc\" DevicePath \"\"" Mar 16 16:39:24 crc kubenswrapper[5120]: I0316 16:39:24.223565 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0bdcb33b-f908-4545-91d5-caebf2853b00-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:39:24 crc kubenswrapper[5120]: I0316 16:39:24.223579 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/fa5c2ff2-6f51-49e1-bb96-be06788737c6-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:39:24 crc kubenswrapper[5120]: I0316 16:39:24.223591 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e988df9f-eee2-4103-9df2-1e999506d1ca-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:39:24 crc kubenswrapper[5120]: I0316 16:39:24.631399 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/7f161303-6db3-42fc-8cca-089c09eabda5-etc-swift\") pod \"swift-storage-0\" (UID: \"7f161303-6db3-42fc-8cca-089c09eabda5\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:39:24 crc kubenswrapper[5120]: E0316 16:39:24.631593 5120 projected.go:289] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Mar 16 16:39:24 crc kubenswrapper[5120]: E0316 16:39:24.631618 5120 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Mar 16 16:39:24 crc kubenswrapper[5120]: E0316 16:39:24.631682 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7f161303-6db3-42fc-8cca-089c09eabda5-etc-swift podName:7f161303-6db3-42fc-8cca-089c09eabda5 nodeName:}" failed. No retries permitted until 2026-03-16 16:39:28.631664319 +0000 UTC m=+4070.785595976 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/7f161303-6db3-42fc-8cca-089c09eabda5-etc-swift") pod "swift-storage-0" (UID: "7f161303-6db3-42fc-8cca-089c09eabda5") : configmap "swift-ring-files" not found Mar 16 16:39:28 crc kubenswrapper[5120]: I0316 16:39:28.719974 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/7f161303-6db3-42fc-8cca-089c09eabda5-etc-swift\") pod \"swift-storage-0\" (UID: \"7f161303-6db3-42fc-8cca-089c09eabda5\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:39:28 crc kubenswrapper[5120]: E0316 16:39:28.720330 5120 projected.go:289] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Mar 16 16:39:28 crc kubenswrapper[5120]: E0316 16:39:28.720345 5120 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Mar 16 16:39:28 crc kubenswrapper[5120]: E0316 16:39:28.720422 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7f161303-6db3-42fc-8cca-089c09eabda5-etc-swift podName:7f161303-6db3-42fc-8cca-089c09eabda5 nodeName:}" failed. No retries permitted until 2026-03-16 16:39:36.720399158 +0000 UTC m=+4078.874330815 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/7f161303-6db3-42fc-8cca-089c09eabda5-etc-swift") pod "swift-storage-0" (UID: "7f161303-6db3-42fc-8cca-089c09eabda5") : configmap "swift-ring-files" not found Mar 16 16:39:29 crc kubenswrapper[5120]: I0316 16:39:29.083300 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-2fk7p"] Mar 16 16:39:29 crc kubenswrapper[5120]: I0316 16:39:29.084241 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e988df9f-eee2-4103-9df2-1e999506d1ca" containerName="mariadb-account-create-update" Mar 16 16:39:29 crc kubenswrapper[5120]: I0316 16:39:29.084264 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e988df9f-eee2-4103-9df2-1e999506d1ca" containerName="mariadb-account-create-update" Mar 16 16:39:29 crc kubenswrapper[5120]: I0316 16:39:29.084276 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2abd03fd-0270-463a-a9ca-95c22226e8ec" containerName="mariadb-account-create-update" Mar 16 16:39:29 crc kubenswrapper[5120]: I0316 16:39:29.084285 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="2abd03fd-0270-463a-a9ca-95c22226e8ec" containerName="mariadb-account-create-update" Mar 16 16:39:29 crc kubenswrapper[5120]: I0316 16:39:29.084301 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e7508b2-729a-4b53-a597-99cbabc7243a" containerName="mariadb-account-create-update" Mar 16 16:39:29 crc kubenswrapper[5120]: I0316 16:39:29.084307 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e7508b2-729a-4b53-a597-99cbabc7243a" containerName="mariadb-account-create-update" Mar 16 16:39:29 crc kubenswrapper[5120]: I0316 16:39:29.084317 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93a2b4d2-8481-44a9-8d12-62db95189e45" containerName="mariadb-account-create-update" Mar 16 16:39:29 crc kubenswrapper[5120]: I0316 16:39:29.084322 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="93a2b4d2-8481-44a9-8d12-62db95189e45" containerName="mariadb-account-create-update" Mar 16 16:39:29 crc kubenswrapper[5120]: I0316 16:39:29.084335 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ba55b11-2c75-4cfa-9cfc-be73cefc163c" containerName="mariadb-database-create" Mar 16 16:39:29 crc kubenswrapper[5120]: I0316 16:39:29.084340 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ba55b11-2c75-4cfa-9cfc-be73cefc163c" containerName="mariadb-database-create" Mar 16 16:39:29 crc kubenswrapper[5120]: I0316 16:39:29.084359 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86673db2-3d2b-4864-ae11-c6895dc677d2" containerName="mariadb-database-create" Mar 16 16:39:29 crc kubenswrapper[5120]: I0316 16:39:29.084367 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="86673db2-3d2b-4864-ae11-c6895dc677d2" containerName="mariadb-database-create" Mar 16 16:39:29 crc kubenswrapper[5120]: I0316 16:39:29.084374 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bac9c78c-8043-4f94-9c2e-6bbbcac4d701" containerName="mariadb-account-create-update" Mar 16 16:39:29 crc kubenswrapper[5120]: I0316 16:39:29.084379 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="bac9c78c-8043-4f94-9c2e-6bbbcac4d701" containerName="mariadb-account-create-update" Mar 16 16:39:29 crc kubenswrapper[5120]: I0316 16:39:29.084395 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa5c2ff2-6f51-49e1-bb96-be06788737c6" containerName="mariadb-database-create" Mar 16 16:39:29 crc kubenswrapper[5120]: I0316 16:39:29.084403 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa5c2ff2-6f51-49e1-bb96-be06788737c6" containerName="mariadb-database-create" Mar 16 16:39:29 crc kubenswrapper[5120]: I0316 16:39:29.084411 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62168229-1b96-48fa-aaac-639639d37e7f" containerName="mariadb-database-create" Mar 16 16:39:29 crc kubenswrapper[5120]: I0316 16:39:29.084417 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="62168229-1b96-48fa-aaac-639639d37e7f" containerName="mariadb-database-create" Mar 16 16:39:29 crc kubenswrapper[5120]: I0316 16:39:29.084425 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0bdcb33b-f908-4545-91d5-caebf2853b00" containerName="mariadb-account-create-update" Mar 16 16:39:29 crc kubenswrapper[5120]: I0316 16:39:29.084431 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="0bdcb33b-f908-4545-91d5-caebf2853b00" containerName="mariadb-account-create-update" Mar 16 16:39:29 crc kubenswrapper[5120]: I0316 16:39:29.084438 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9aa6ed1b-b014-4ff6-97aa-387eceb58d13" containerName="mariadb-database-create" Mar 16 16:39:29 crc kubenswrapper[5120]: I0316 16:39:29.084443 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9aa6ed1b-b014-4ff6-97aa-387eceb58d13" containerName="mariadb-database-create" Mar 16 16:39:29 crc kubenswrapper[5120]: I0316 16:39:29.084450 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="614326a5-97a1-4126-bdaf-f6d6e5e9631f" containerName="mariadb-database-create" Mar 16 16:39:29 crc kubenswrapper[5120]: I0316 16:39:29.084454 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="614326a5-97a1-4126-bdaf-f6d6e5e9631f" containerName="mariadb-database-create" Mar 16 16:39:29 crc kubenswrapper[5120]: I0316 16:39:29.084603 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="bac9c78c-8043-4f94-9c2e-6bbbcac4d701" containerName="mariadb-account-create-update" Mar 16 16:39:29 crc kubenswrapper[5120]: I0316 16:39:29.084621 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="2abd03fd-0270-463a-a9ca-95c22226e8ec" containerName="mariadb-account-create-update" Mar 16 16:39:29 crc kubenswrapper[5120]: I0316 16:39:29.084631 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e988df9f-eee2-4103-9df2-1e999506d1ca" containerName="mariadb-account-create-update" Mar 16 16:39:29 crc kubenswrapper[5120]: I0316 16:39:29.084642 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="62168229-1b96-48fa-aaac-639639d37e7f" containerName="mariadb-database-create" Mar 16 16:39:29 crc kubenswrapper[5120]: I0316 16:39:29.084652 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="3e7508b2-729a-4b53-a597-99cbabc7243a" containerName="mariadb-account-create-update" Mar 16 16:39:29 crc kubenswrapper[5120]: I0316 16:39:29.084664 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="fa5c2ff2-6f51-49e1-bb96-be06788737c6" containerName="mariadb-database-create" Mar 16 16:39:29 crc kubenswrapper[5120]: I0316 16:39:29.084674 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="86673db2-3d2b-4864-ae11-c6895dc677d2" containerName="mariadb-database-create" Mar 16 16:39:29 crc kubenswrapper[5120]: I0316 16:39:29.084689 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="93a2b4d2-8481-44a9-8d12-62db95189e45" containerName="mariadb-account-create-update" Mar 16 16:39:29 crc kubenswrapper[5120]: I0316 16:39:29.084701 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="614326a5-97a1-4126-bdaf-f6d6e5e9631f" containerName="mariadb-database-create" Mar 16 16:39:29 crc kubenswrapper[5120]: I0316 16:39:29.084728 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="9ba55b11-2c75-4cfa-9cfc-be73cefc163c" containerName="mariadb-database-create" Mar 16 16:39:29 crc kubenswrapper[5120]: I0316 16:39:29.084738 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="0bdcb33b-f908-4545-91d5-caebf2853b00" containerName="mariadb-account-create-update" Mar 16 16:39:29 crc kubenswrapper[5120]: I0316 16:39:29.084749 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="9aa6ed1b-b014-4ff6-97aa-387eceb58d13" containerName="mariadb-database-create" Mar 16 16:39:29 crc kubenswrapper[5120]: I0316 16:39:29.090030 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-2fk7p" Mar 16 16:39:29 crc kubenswrapper[5120]: I0316 16:39:29.093636 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone\"" Mar 16 16:39:29 crc kubenswrapper[5120]: I0316 16:39:29.093922 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-keystone-dockercfg-mgwjt\"" Mar 16 16:39:29 crc kubenswrapper[5120]: I0316 16:39:29.094244 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-2fk7p"] Mar 16 16:39:29 crc kubenswrapper[5120]: I0316 16:39:29.094700 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-scripts\"" Mar 16 16:39:29 crc kubenswrapper[5120]: I0316 16:39:29.096153 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-config-data\"" Mar 16 16:39:29 crc kubenswrapper[5120]: I0316 16:39:29.128729 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d5e2313a-9600-4730-95b1-a47794ca9b4c-combined-ca-bundle\") pod \"keystone-db-sync-2fk7p\" (UID: \"d5e2313a-9600-4730-95b1-a47794ca9b4c\") " pod="openstack-kuttl-tests/keystone-db-sync-2fk7p" Mar 16 16:39:29 crc kubenswrapper[5120]: I0316 16:39:29.129384 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qlfxt\" (UniqueName: \"kubernetes.io/projected/d5e2313a-9600-4730-95b1-a47794ca9b4c-kube-api-access-qlfxt\") pod \"keystone-db-sync-2fk7p\" (UID: \"d5e2313a-9600-4730-95b1-a47794ca9b4c\") " pod="openstack-kuttl-tests/keystone-db-sync-2fk7p" Mar 16 16:39:29 crc kubenswrapper[5120]: I0316 16:39:29.129479 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d5e2313a-9600-4730-95b1-a47794ca9b4c-config-data\") pod \"keystone-db-sync-2fk7p\" (UID: \"d5e2313a-9600-4730-95b1-a47794ca9b4c\") " pod="openstack-kuttl-tests/keystone-db-sync-2fk7p" Mar 16 16:39:29 crc kubenswrapper[5120]: I0316 16:39:29.231931 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d5e2313a-9600-4730-95b1-a47794ca9b4c-combined-ca-bundle\") pod \"keystone-db-sync-2fk7p\" (UID: \"d5e2313a-9600-4730-95b1-a47794ca9b4c\") " pod="openstack-kuttl-tests/keystone-db-sync-2fk7p" Mar 16 16:39:29 crc kubenswrapper[5120]: I0316 16:39:29.232205 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qlfxt\" (UniqueName: \"kubernetes.io/projected/d5e2313a-9600-4730-95b1-a47794ca9b4c-kube-api-access-qlfxt\") pod \"keystone-db-sync-2fk7p\" (UID: \"d5e2313a-9600-4730-95b1-a47794ca9b4c\") " pod="openstack-kuttl-tests/keystone-db-sync-2fk7p" Mar 16 16:39:29 crc kubenswrapper[5120]: I0316 16:39:29.232258 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d5e2313a-9600-4730-95b1-a47794ca9b4c-config-data\") pod \"keystone-db-sync-2fk7p\" (UID: \"d5e2313a-9600-4730-95b1-a47794ca9b4c\") " pod="openstack-kuttl-tests/keystone-db-sync-2fk7p" Mar 16 16:39:29 crc kubenswrapper[5120]: I0316 16:39:29.237953 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d5e2313a-9600-4730-95b1-a47794ca9b4c-combined-ca-bundle\") pod \"keystone-db-sync-2fk7p\" (UID: \"d5e2313a-9600-4730-95b1-a47794ca9b4c\") " pod="openstack-kuttl-tests/keystone-db-sync-2fk7p" Mar 16 16:39:29 crc kubenswrapper[5120]: I0316 16:39:29.238463 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d5e2313a-9600-4730-95b1-a47794ca9b4c-config-data\") pod \"keystone-db-sync-2fk7p\" (UID: \"d5e2313a-9600-4730-95b1-a47794ca9b4c\") " pod="openstack-kuttl-tests/keystone-db-sync-2fk7p" Mar 16 16:39:29 crc kubenswrapper[5120]: I0316 16:39:29.255080 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qlfxt\" (UniqueName: \"kubernetes.io/projected/d5e2313a-9600-4730-95b1-a47794ca9b4c-kube-api-access-qlfxt\") pod \"keystone-db-sync-2fk7p\" (UID: \"d5e2313a-9600-4730-95b1-a47794ca9b4c\") " pod="openstack-kuttl-tests/keystone-db-sync-2fk7p" Mar 16 16:39:29 crc kubenswrapper[5120]: I0316 16:39:29.377247 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-db-sync-nwxnc"] Mar 16 16:39:29 crc kubenswrapper[5120]: I0316 16:39:29.383395 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-nwxnc" Mar 16 16:39:29 crc kubenswrapper[5120]: I0316 16:39:29.391153 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-glance-dockercfg-rstps\"" Mar 16 16:39:29 crc kubenswrapper[5120]: I0316 16:39:29.391371 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-config-data\"" Mar 16 16:39:29 crc kubenswrapper[5120]: I0316 16:39:29.395469 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-nwxnc"] Mar 16 16:39:29 crc kubenswrapper[5120]: I0316 16:39:29.417277 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-2fk7p" Mar 16 16:39:29 crc kubenswrapper[5120]: I0316 16:39:29.439387 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/334707cf-7ffa-4fe5-94c5-e9402769ca11-config-data\") pod \"glance-db-sync-nwxnc\" (UID: \"334707cf-7ffa-4fe5-94c5-e9402769ca11\") " pod="openstack-kuttl-tests/glance-db-sync-nwxnc" Mar 16 16:39:29 crc kubenswrapper[5120]: I0316 16:39:29.439532 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/334707cf-7ffa-4fe5-94c5-e9402769ca11-combined-ca-bundle\") pod \"glance-db-sync-nwxnc\" (UID: \"334707cf-7ffa-4fe5-94c5-e9402769ca11\") " pod="openstack-kuttl-tests/glance-db-sync-nwxnc" Mar 16 16:39:29 crc kubenswrapper[5120]: I0316 16:39:29.439689 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5c4p\" (UniqueName: \"kubernetes.io/projected/334707cf-7ffa-4fe5-94c5-e9402769ca11-kube-api-access-n5c4p\") pod \"glance-db-sync-nwxnc\" (UID: \"334707cf-7ffa-4fe5-94c5-e9402769ca11\") " pod="openstack-kuttl-tests/glance-db-sync-nwxnc" Mar 16 16:39:29 crc kubenswrapper[5120]: I0316 16:39:29.439887 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/334707cf-7ffa-4fe5-94c5-e9402769ca11-db-sync-config-data\") pod \"glance-db-sync-nwxnc\" (UID: \"334707cf-7ffa-4fe5-94c5-e9402769ca11\") " pod="openstack-kuttl-tests/glance-db-sync-nwxnc" Mar 16 16:39:29 crc kubenswrapper[5120]: I0316 16:39:29.543591 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/334707cf-7ffa-4fe5-94c5-e9402769ca11-combined-ca-bundle\") pod \"glance-db-sync-nwxnc\" (UID: \"334707cf-7ffa-4fe5-94c5-e9402769ca11\") " pod="openstack-kuttl-tests/glance-db-sync-nwxnc" Mar 16 16:39:29 crc kubenswrapper[5120]: I0316 16:39:29.544286 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n5c4p\" (UniqueName: \"kubernetes.io/projected/334707cf-7ffa-4fe5-94c5-e9402769ca11-kube-api-access-n5c4p\") pod \"glance-db-sync-nwxnc\" (UID: \"334707cf-7ffa-4fe5-94c5-e9402769ca11\") " pod="openstack-kuttl-tests/glance-db-sync-nwxnc" Mar 16 16:39:29 crc kubenswrapper[5120]: I0316 16:39:29.544462 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/334707cf-7ffa-4fe5-94c5-e9402769ca11-db-sync-config-data\") pod \"glance-db-sync-nwxnc\" (UID: \"334707cf-7ffa-4fe5-94c5-e9402769ca11\") " pod="openstack-kuttl-tests/glance-db-sync-nwxnc" Mar 16 16:39:29 crc kubenswrapper[5120]: I0316 16:39:29.544557 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/334707cf-7ffa-4fe5-94c5-e9402769ca11-config-data\") pod \"glance-db-sync-nwxnc\" (UID: \"334707cf-7ffa-4fe5-94c5-e9402769ca11\") " pod="openstack-kuttl-tests/glance-db-sync-nwxnc" Mar 16 16:39:29 crc kubenswrapper[5120]: I0316 16:39:29.549776 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/334707cf-7ffa-4fe5-94c5-e9402769ca11-combined-ca-bundle\") pod \"glance-db-sync-nwxnc\" (UID: \"334707cf-7ffa-4fe5-94c5-e9402769ca11\") " pod="openstack-kuttl-tests/glance-db-sync-nwxnc" Mar 16 16:39:29 crc kubenswrapper[5120]: I0316 16:39:29.550157 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/334707cf-7ffa-4fe5-94c5-e9402769ca11-db-sync-config-data\") pod \"glance-db-sync-nwxnc\" (UID: \"334707cf-7ffa-4fe5-94c5-e9402769ca11\") " pod="openstack-kuttl-tests/glance-db-sync-nwxnc" Mar 16 16:39:29 crc kubenswrapper[5120]: I0316 16:39:29.551414 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/334707cf-7ffa-4fe5-94c5-e9402769ca11-config-data\") pod \"glance-db-sync-nwxnc\" (UID: \"334707cf-7ffa-4fe5-94c5-e9402769ca11\") " pod="openstack-kuttl-tests/glance-db-sync-nwxnc" Mar 16 16:39:29 crc kubenswrapper[5120]: I0316 16:39:29.564450 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5c4p\" (UniqueName: \"kubernetes.io/projected/334707cf-7ffa-4fe5-94c5-e9402769ca11-kube-api-access-n5c4p\") pod \"glance-db-sync-nwxnc\" (UID: \"334707cf-7ffa-4fe5-94c5-e9402769ca11\") " pod="openstack-kuttl-tests/glance-db-sync-nwxnc" Mar 16 16:39:29 crc kubenswrapper[5120]: I0316 16:39:29.717382 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-nwxnc" Mar 16 16:39:29 crc kubenswrapper[5120]: I0316 16:39:29.860374 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-2fk7p"] Mar 16 16:39:29 crc kubenswrapper[5120]: W0316 16:39:29.864287 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd5e2313a_9600_4730_95b1_a47794ca9b4c.slice/crio-4760afe82428517dc175a370ec26d9e93412d9733440eb7932102801757b6bb1 WatchSource:0}: Error finding container 4760afe82428517dc175a370ec26d9e93412d9733440eb7932102801757b6bb1: Status 404 returned error can't find the container with id 4760afe82428517dc175a370ec26d9e93412d9733440eb7932102801757b6bb1 Mar 16 16:39:30 crc kubenswrapper[5120]: I0316 16:39:30.164566 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-nwxnc"] Mar 16 16:39:30 crc kubenswrapper[5120]: I0316 16:39:30.222907 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-2fk7p" event={"ID":"d5e2313a-9600-4730-95b1-a47794ca9b4c","Type":"ContainerStarted","Data":"78b77907c1d13b432373236bb4fd675e45a1ec106ff24df85b87cd78b07d68da"} Mar 16 16:39:30 crc kubenswrapper[5120]: I0316 16:39:30.222969 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-2fk7p" event={"ID":"d5e2313a-9600-4730-95b1-a47794ca9b4c","Type":"ContainerStarted","Data":"4760afe82428517dc175a370ec26d9e93412d9733440eb7932102801757b6bb1"} Mar 16 16:39:30 crc kubenswrapper[5120]: I0316 16:39:30.230908 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-nwxnc" event={"ID":"334707cf-7ffa-4fe5-94c5-e9402769ca11","Type":"ContainerStarted","Data":"3cda31add0d8d32f38e73582b05e9cf3cee29d365df202fb6e8617ddd7911dd3"} Mar 16 16:39:30 crc kubenswrapper[5120]: I0316 16:39:30.232095 5120 generic.go:358] "Generic (PLEG): container finished" podID="26f0b4d3-a9a4-495b-a656-87bb6e9e77af" containerID="671727f21c19391699a48ba467425210ed9412567d45a035a011960cf10b8083" exitCode=0 Mar 16 16:39:30 crc kubenswrapper[5120]: I0316 16:39:30.232208 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-9hsz8" event={"ID":"26f0b4d3-a9a4-495b-a656-87bb6e9e77af","Type":"ContainerDied","Data":"671727f21c19391699a48ba467425210ed9412567d45a035a011960cf10b8083"} Mar 16 16:39:30 crc kubenswrapper[5120]: I0316 16:39:30.246836 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-db-sync-2fk7p" podStartSLOduration=1.246820546 podStartE2EDuration="1.246820546s" podCreationTimestamp="2026-03-16 16:39:29 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:39:30.242730629 +0000 UTC m=+4072.396662286" watchObservedRunningTime="2026-03-16 16:39:30.246820546 +0000 UTC m=+4072.400752193" Mar 16 16:39:31 crc kubenswrapper[5120]: I0316 16:39:31.243483 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-nwxnc" event={"ID":"334707cf-7ffa-4fe5-94c5-e9402769ca11","Type":"ContainerStarted","Data":"0e197c8883c5a4c52de582c21153015258d0c3f6e9781165ce6fbd7a3ba4237d"} Mar 16 16:39:31 crc kubenswrapper[5120]: I0316 16:39:31.269583 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-db-sync-nwxnc" podStartSLOduration=2.269555216 podStartE2EDuration="2.269555216s" podCreationTimestamp="2026-03-16 16:39:29 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:39:31.259352708 +0000 UTC m=+4073.413284365" watchObservedRunningTime="2026-03-16 16:39:31.269555216 +0000 UTC m=+4073.423486873" Mar 16 16:39:31 crc kubenswrapper[5120]: I0316 16:39:31.440683 5120 scope.go:117] "RemoveContainer" containerID="597efc0dd871c2e1f82f46bb284d3a25d9d02fb8817ac7c029ec870416fbaef4" Mar 16 16:39:31 crc kubenswrapper[5120]: I0316 16:39:31.464888 5120 scope.go:117] "RemoveContainer" containerID="cf0ade454712d54bbd6566c19455cca6ef17295f8323872af8aec43cc9f70c86" Mar 16 16:39:31 crc kubenswrapper[5120]: I0316 16:39:31.647437 5120 scope.go:117] "RemoveContainer" containerID="b5f73bc2fcc71694ac4ec71e57ce1500caeee856064147ad378ad48a3951a8d1" Mar 16 16:39:31 crc kubenswrapper[5120]: I0316 16:39:31.733932 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-9hsz8" Mar 16 16:39:31 crc kubenswrapper[5120]: I0316 16:39:31.744977 5120 scope.go:117] "RemoveContainer" containerID="f219d9d7fd258e4a5b604f8b479078504b8ca4ef1f05e09bb3c47fef2b35364c" Mar 16 16:39:31 crc kubenswrapper[5120]: I0316 16:39:31.769008 5120 scope.go:117] "RemoveContainer" containerID="5e086b84acb9eb1dded1cd232e9ece3bd6c8f4f2b1365e0ecd334ec230fd3a55" Mar 16 16:39:31 crc kubenswrapper[5120]: I0316 16:39:31.796350 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kvxp7\" (UniqueName: \"kubernetes.io/projected/26f0b4d3-a9a4-495b-a656-87bb6e9e77af-kube-api-access-kvxp7\") pod \"26f0b4d3-a9a4-495b-a656-87bb6e9e77af\" (UID: \"26f0b4d3-a9a4-495b-a656-87bb6e9e77af\") " Mar 16 16:39:31 crc kubenswrapper[5120]: I0316 16:39:31.796469 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/26f0b4d3-a9a4-495b-a656-87bb6e9e77af-combined-ca-bundle\") pod \"26f0b4d3-a9a4-495b-a656-87bb6e9e77af\" (UID: \"26f0b4d3-a9a4-495b-a656-87bb6e9e77af\") " Mar 16 16:39:31 crc kubenswrapper[5120]: I0316 16:39:31.796657 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/26f0b4d3-a9a4-495b-a656-87bb6e9e77af-dispersionconf\") pod \"26f0b4d3-a9a4-495b-a656-87bb6e9e77af\" (UID: \"26f0b4d3-a9a4-495b-a656-87bb6e9e77af\") " Mar 16 16:39:31 crc kubenswrapper[5120]: I0316 16:39:31.796865 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/26f0b4d3-a9a4-495b-a656-87bb6e9e77af-scripts\") pod \"26f0b4d3-a9a4-495b-a656-87bb6e9e77af\" (UID: \"26f0b4d3-a9a4-495b-a656-87bb6e9e77af\") " Mar 16 16:39:31 crc kubenswrapper[5120]: I0316 16:39:31.797001 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/26f0b4d3-a9a4-495b-a656-87bb6e9e77af-swiftconf\") pod \"26f0b4d3-a9a4-495b-a656-87bb6e9e77af\" (UID: \"26f0b4d3-a9a4-495b-a656-87bb6e9e77af\") " Mar 16 16:39:31 crc kubenswrapper[5120]: I0316 16:39:31.797222 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/26f0b4d3-a9a4-495b-a656-87bb6e9e77af-etc-swift\") pod \"26f0b4d3-a9a4-495b-a656-87bb6e9e77af\" (UID: \"26f0b4d3-a9a4-495b-a656-87bb6e9e77af\") " Mar 16 16:39:31 crc kubenswrapper[5120]: I0316 16:39:31.797427 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/26f0b4d3-a9a4-495b-a656-87bb6e9e77af-ring-data-devices\") pod \"26f0b4d3-a9a4-495b-a656-87bb6e9e77af\" (UID: \"26f0b4d3-a9a4-495b-a656-87bb6e9e77af\") " Mar 16 16:39:31 crc kubenswrapper[5120]: I0316 16:39:31.798370 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26f0b4d3-a9a4-495b-a656-87bb6e9e77af-etc-swift" (OuterVolumeSpecName: "etc-swift") pod "26f0b4d3-a9a4-495b-a656-87bb6e9e77af" (UID: "26f0b4d3-a9a4-495b-a656-87bb6e9e77af"). InnerVolumeSpecName "etc-swift". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:39:31 crc kubenswrapper[5120]: I0316 16:39:31.798425 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/26f0b4d3-a9a4-495b-a656-87bb6e9e77af-ring-data-devices" (OuterVolumeSpecName: "ring-data-devices") pod "26f0b4d3-a9a4-495b-a656-87bb6e9e77af" (UID: "26f0b4d3-a9a4-495b-a656-87bb6e9e77af"). InnerVolumeSpecName "ring-data-devices". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:39:31 crc kubenswrapper[5120]: I0316 16:39:31.803478 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26f0b4d3-a9a4-495b-a656-87bb6e9e77af-kube-api-access-kvxp7" (OuterVolumeSpecName: "kube-api-access-kvxp7") pod "26f0b4d3-a9a4-495b-a656-87bb6e9e77af" (UID: "26f0b4d3-a9a4-495b-a656-87bb6e9e77af"). InnerVolumeSpecName "kube-api-access-kvxp7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:39:31 crc kubenswrapper[5120]: I0316 16:39:31.812026 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/26f0b4d3-a9a4-495b-a656-87bb6e9e77af-dispersionconf" (OuterVolumeSpecName: "dispersionconf") pod "26f0b4d3-a9a4-495b-a656-87bb6e9e77af" (UID: "26f0b4d3-a9a4-495b-a656-87bb6e9e77af"). InnerVolumeSpecName "dispersionconf". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:39:31 crc kubenswrapper[5120]: E0316 16:39:31.830925 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/26f0b4d3-a9a4-495b-a656-87bb6e9e77af-scripts podName:26f0b4d3-a9a4-495b-a656-87bb6e9e77af nodeName:}" failed. No retries permitted until 2026-03-16 16:39:32.330887662 +0000 UTC m=+4074.484819319 (durationBeforeRetry 500ms). Error: error cleaning subPath mounts for volume "scripts" (UniqueName: "kubernetes.io/configmap/26f0b4d3-a9a4-495b-a656-87bb6e9e77af-scripts") pod "26f0b4d3-a9a4-495b-a656-87bb6e9e77af" (UID: "26f0b4d3-a9a4-495b-a656-87bb6e9e77af") : error deleting /var/lib/kubelet/pods/26f0b4d3-a9a4-495b-a656-87bb6e9e77af/volume-subpaths: remove /var/lib/kubelet/pods/26f0b4d3-a9a4-495b-a656-87bb6e9e77af/volume-subpaths: no such file or directory Mar 16 16:39:31 crc kubenswrapper[5120]: I0316 16:39:31.831367 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/26f0b4d3-a9a4-495b-a656-87bb6e9e77af-swiftconf" (OuterVolumeSpecName: "swiftconf") pod "26f0b4d3-a9a4-495b-a656-87bb6e9e77af" (UID: "26f0b4d3-a9a4-495b-a656-87bb6e9e77af"). InnerVolumeSpecName "swiftconf". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:39:31 crc kubenswrapper[5120]: I0316 16:39:31.833282 5120 scope.go:117] "RemoveContainer" containerID="26030c8756e65169fb649caea1f3b28f100ef19f6ffef14b023b74d2c5089d06" Mar 16 16:39:31 crc kubenswrapper[5120]: I0316 16:39:31.835004 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/26f0b4d3-a9a4-495b-a656-87bb6e9e77af-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "26f0b4d3-a9a4-495b-a656-87bb6e9e77af" (UID: "26f0b4d3-a9a4-495b-a656-87bb6e9e77af"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:39:31 crc kubenswrapper[5120]: I0316 16:39:31.874741 5120 scope.go:117] "RemoveContainer" containerID="1ef00ba08ecceb8b41ac0c3ea5c6198a46e197013b171930c1ab10d5b8fac58a" Mar 16 16:39:31 crc kubenswrapper[5120]: I0316 16:39:31.898919 5120 scope.go:117] "RemoveContainer" containerID="dcf9fa8b1116cc44c55ea4dea19a89a3dc344ff083773e2ae76a8f51807827f7" Mar 16 16:39:31 crc kubenswrapper[5120]: I0316 16:39:31.900609 5120 reconciler_common.go:299] "Volume detached for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/26f0b4d3-a9a4-495b-a656-87bb6e9e77af-etc-swift\") on node \"crc\" DevicePath \"\"" Mar 16 16:39:31 crc kubenswrapper[5120]: I0316 16:39:31.900636 5120 reconciler_common.go:299] "Volume detached for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/26f0b4d3-a9a4-495b-a656-87bb6e9e77af-ring-data-devices\") on node \"crc\" DevicePath \"\"" Mar 16 16:39:31 crc kubenswrapper[5120]: I0316 16:39:31.900649 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kvxp7\" (UniqueName: \"kubernetes.io/projected/26f0b4d3-a9a4-495b-a656-87bb6e9e77af-kube-api-access-kvxp7\") on node \"crc\" DevicePath \"\"" Mar 16 16:39:31 crc kubenswrapper[5120]: I0316 16:39:31.900989 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/26f0b4d3-a9a4-495b-a656-87bb6e9e77af-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:39:31 crc kubenswrapper[5120]: I0316 16:39:31.901001 5120 reconciler_common.go:299] "Volume detached for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/26f0b4d3-a9a4-495b-a656-87bb6e9e77af-dispersionconf\") on node \"crc\" DevicePath \"\"" Mar 16 16:39:31 crc kubenswrapper[5120]: I0316 16:39:31.901009 5120 reconciler_common.go:299] "Volume detached for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/26f0b4d3-a9a4-495b-a656-87bb6e9e77af-swiftconf\") on node \"crc\" DevicePath \"\"" Mar 16 16:39:31 crc kubenswrapper[5120]: I0316 16:39:31.940569 5120 scope.go:117] "RemoveContainer" containerID="1669972057cc8dbbfa6dc0e00026f2df8e5c1f76fed58fb6972e3087284a4a2d" Mar 16 16:39:32 crc kubenswrapper[5120]: I0316 16:39:32.254256 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-9hsz8" Mar 16 16:39:32 crc kubenswrapper[5120]: I0316 16:39:32.254325 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-9hsz8" event={"ID":"26f0b4d3-a9a4-495b-a656-87bb6e9e77af","Type":"ContainerDied","Data":"45b316be17525e9395415b2353aa55a436b0bcf912912dceb81cb75b7c9f9baa"} Mar 16 16:39:32 crc kubenswrapper[5120]: I0316 16:39:32.254359 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="45b316be17525e9395415b2353aa55a436b0bcf912912dceb81cb75b7c9f9baa" Mar 16 16:39:32 crc kubenswrapper[5120]: I0316 16:39:32.410099 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/26f0b4d3-a9a4-495b-a656-87bb6e9e77af-scripts\") pod \"26f0b4d3-a9a4-495b-a656-87bb6e9e77af\" (UID: \"26f0b4d3-a9a4-495b-a656-87bb6e9e77af\") " Mar 16 16:39:32 crc kubenswrapper[5120]: I0316 16:39:32.410811 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/26f0b4d3-a9a4-495b-a656-87bb6e9e77af-scripts" (OuterVolumeSpecName: "scripts") pod "26f0b4d3-a9a4-495b-a656-87bb6e9e77af" (UID: "26f0b4d3-a9a4-495b-a656-87bb6e9e77af"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:39:32 crc kubenswrapper[5120]: I0316 16:39:32.412365 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/26f0b4d3-a9a4-495b-a656-87bb6e9e77af-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:39:33 crc kubenswrapper[5120]: I0316 16:39:33.090893 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:39:34 crc kubenswrapper[5120]: I0316 16:39:34.276734 5120 generic.go:358] "Generic (PLEG): container finished" podID="d5e2313a-9600-4730-95b1-a47794ca9b4c" containerID="78b77907c1d13b432373236bb4fd675e45a1ec106ff24df85b87cd78b07d68da" exitCode=0 Mar 16 16:39:34 crc kubenswrapper[5120]: I0316 16:39:34.276902 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-2fk7p" event={"ID":"d5e2313a-9600-4730-95b1-a47794ca9b4c","Type":"ContainerDied","Data":"78b77907c1d13b432373236bb4fd675e45a1ec106ff24df85b87cd78b07d68da"} Mar 16 16:39:35 crc kubenswrapper[5120]: I0316 16:39:35.690221 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-2fk7p" Mar 16 16:39:35 crc kubenswrapper[5120]: I0316 16:39:35.787858 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d5e2313a-9600-4730-95b1-a47794ca9b4c-config-data\") pod \"d5e2313a-9600-4730-95b1-a47794ca9b4c\" (UID: \"d5e2313a-9600-4730-95b1-a47794ca9b4c\") " Mar 16 16:39:35 crc kubenswrapper[5120]: I0316 16:39:35.788070 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qlfxt\" (UniqueName: \"kubernetes.io/projected/d5e2313a-9600-4730-95b1-a47794ca9b4c-kube-api-access-qlfxt\") pod \"d5e2313a-9600-4730-95b1-a47794ca9b4c\" (UID: \"d5e2313a-9600-4730-95b1-a47794ca9b4c\") " Mar 16 16:39:35 crc kubenswrapper[5120]: I0316 16:39:35.788222 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d5e2313a-9600-4730-95b1-a47794ca9b4c-combined-ca-bundle\") pod \"d5e2313a-9600-4730-95b1-a47794ca9b4c\" (UID: \"d5e2313a-9600-4730-95b1-a47794ca9b4c\") " Mar 16 16:39:35 crc kubenswrapper[5120]: I0316 16:39:35.793625 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5e2313a-9600-4730-95b1-a47794ca9b4c-kube-api-access-qlfxt" (OuterVolumeSpecName: "kube-api-access-qlfxt") pod "d5e2313a-9600-4730-95b1-a47794ca9b4c" (UID: "d5e2313a-9600-4730-95b1-a47794ca9b4c"). InnerVolumeSpecName "kube-api-access-qlfxt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:39:35 crc kubenswrapper[5120]: I0316 16:39:35.813367 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5e2313a-9600-4730-95b1-a47794ca9b4c-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "d5e2313a-9600-4730-95b1-a47794ca9b4c" (UID: "d5e2313a-9600-4730-95b1-a47794ca9b4c"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:39:35 crc kubenswrapper[5120]: I0316 16:39:35.830426 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5e2313a-9600-4730-95b1-a47794ca9b4c-config-data" (OuterVolumeSpecName: "config-data") pod "d5e2313a-9600-4730-95b1-a47794ca9b4c" (UID: "d5e2313a-9600-4730-95b1-a47794ca9b4c"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:39:35 crc kubenswrapper[5120]: I0316 16:39:35.891991 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d5e2313a-9600-4730-95b1-a47794ca9b4c-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:39:35 crc kubenswrapper[5120]: I0316 16:39:35.892317 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qlfxt\" (UniqueName: \"kubernetes.io/projected/d5e2313a-9600-4730-95b1-a47794ca9b4c-kube-api-access-qlfxt\") on node \"crc\" DevicePath \"\"" Mar 16 16:39:35 crc kubenswrapper[5120]: I0316 16:39:35.892420 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d5e2313a-9600-4730-95b1-a47794ca9b4c-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:39:36 crc kubenswrapper[5120]: I0316 16:39:36.321789 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-2fk7p" Mar 16 16:39:36 crc kubenswrapper[5120]: I0316 16:39:36.321792 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-2fk7p" event={"ID":"d5e2313a-9600-4730-95b1-a47794ca9b4c","Type":"ContainerDied","Data":"4760afe82428517dc175a370ec26d9e93412d9733440eb7932102801757b6bb1"} Mar 16 16:39:36 crc kubenswrapper[5120]: I0316 16:39:36.321943 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4760afe82428517dc175a370ec26d9e93412d9733440eb7932102801757b6bb1" Mar 16 16:39:36 crc kubenswrapper[5120]: I0316 16:39:36.476353 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-tplqm"] Mar 16 16:39:36 crc kubenswrapper[5120]: I0316 16:39:36.477698 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5e2313a-9600-4730-95b1-a47794ca9b4c" containerName="keystone-db-sync" Mar 16 16:39:36 crc kubenswrapper[5120]: I0316 16:39:36.477716 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5e2313a-9600-4730-95b1-a47794ca9b4c" containerName="keystone-db-sync" Mar 16 16:39:36 crc kubenswrapper[5120]: I0316 16:39:36.477741 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26f0b4d3-a9a4-495b-a656-87bb6e9e77af" containerName="swift-ring-rebalance" Mar 16 16:39:36 crc kubenswrapper[5120]: I0316 16:39:36.477751 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="26f0b4d3-a9a4-495b-a656-87bb6e9e77af" containerName="swift-ring-rebalance" Mar 16 16:39:36 crc kubenswrapper[5120]: I0316 16:39:36.477964 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="d5e2313a-9600-4730-95b1-a47794ca9b4c" containerName="keystone-db-sync" Mar 16 16:39:36 crc kubenswrapper[5120]: I0316 16:39:36.477984 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="26f0b4d3-a9a4-495b-a656-87bb6e9e77af" containerName="swift-ring-rebalance" Mar 16 16:39:36 crc kubenswrapper[5120]: I0316 16:39:36.519424 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-tplqm"] Mar 16 16:39:36 crc kubenswrapper[5120]: I0316 16:39:36.519605 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-tplqm" Mar 16 16:39:36 crc kubenswrapper[5120]: I0316 16:39:36.523640 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-keystone-dockercfg-mgwjt\"" Mar 16 16:39:36 crc kubenswrapper[5120]: I0316 16:39:36.523978 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone\"" Mar 16 16:39:36 crc kubenswrapper[5120]: I0316 16:39:36.524169 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"osp-secret\"" Mar 16 16:39:36 crc kubenswrapper[5120]: I0316 16:39:36.527315 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-config-data\"" Mar 16 16:39:36 crc kubenswrapper[5120]: I0316 16:39:36.529092 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-scripts\"" Mar 16 16:39:36 crc kubenswrapper[5120]: I0316 16:39:36.607618 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/621997b8-90a2-44ff-b1bf-ababd800c8ad-config-data\") pod \"keystone-bootstrap-tplqm\" (UID: \"621997b8-90a2-44ff-b1bf-ababd800c8ad\") " pod="openstack-kuttl-tests/keystone-bootstrap-tplqm" Mar 16 16:39:36 crc kubenswrapper[5120]: I0316 16:39:36.608031 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/621997b8-90a2-44ff-b1bf-ababd800c8ad-credential-keys\") pod \"keystone-bootstrap-tplqm\" (UID: \"621997b8-90a2-44ff-b1bf-ababd800c8ad\") " pod="openstack-kuttl-tests/keystone-bootstrap-tplqm" Mar 16 16:39:36 crc kubenswrapper[5120]: I0316 16:39:36.608065 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/621997b8-90a2-44ff-b1bf-ababd800c8ad-scripts\") pod \"keystone-bootstrap-tplqm\" (UID: \"621997b8-90a2-44ff-b1bf-ababd800c8ad\") " pod="openstack-kuttl-tests/keystone-bootstrap-tplqm" Mar 16 16:39:36 crc kubenswrapper[5120]: I0316 16:39:36.608088 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pngs5\" (UniqueName: \"kubernetes.io/projected/621997b8-90a2-44ff-b1bf-ababd800c8ad-kube-api-access-pngs5\") pod \"keystone-bootstrap-tplqm\" (UID: \"621997b8-90a2-44ff-b1bf-ababd800c8ad\") " pod="openstack-kuttl-tests/keystone-bootstrap-tplqm" Mar 16 16:39:36 crc kubenswrapper[5120]: I0316 16:39:36.608122 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/621997b8-90a2-44ff-b1bf-ababd800c8ad-fernet-keys\") pod \"keystone-bootstrap-tplqm\" (UID: \"621997b8-90a2-44ff-b1bf-ababd800c8ad\") " pod="openstack-kuttl-tests/keystone-bootstrap-tplqm" Mar 16 16:39:36 crc kubenswrapper[5120]: I0316 16:39:36.608161 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/621997b8-90a2-44ff-b1bf-ababd800c8ad-combined-ca-bundle\") pod \"keystone-bootstrap-tplqm\" (UID: \"621997b8-90a2-44ff-b1bf-ababd800c8ad\") " pod="openstack-kuttl-tests/keystone-bootstrap-tplqm" Mar 16 16:39:36 crc kubenswrapper[5120]: I0316 16:39:36.644222 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:39:36 crc kubenswrapper[5120]: I0316 16:39:36.709711 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/621997b8-90a2-44ff-b1bf-ababd800c8ad-config-data\") pod \"keystone-bootstrap-tplqm\" (UID: \"621997b8-90a2-44ff-b1bf-ababd800c8ad\") " pod="openstack-kuttl-tests/keystone-bootstrap-tplqm" Mar 16 16:39:36 crc kubenswrapper[5120]: I0316 16:39:36.709798 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/621997b8-90a2-44ff-b1bf-ababd800c8ad-credential-keys\") pod \"keystone-bootstrap-tplqm\" (UID: \"621997b8-90a2-44ff-b1bf-ababd800c8ad\") " pod="openstack-kuttl-tests/keystone-bootstrap-tplqm" Mar 16 16:39:36 crc kubenswrapper[5120]: I0316 16:39:36.709821 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/621997b8-90a2-44ff-b1bf-ababd800c8ad-scripts\") pod \"keystone-bootstrap-tplqm\" (UID: \"621997b8-90a2-44ff-b1bf-ababd800c8ad\") " pod="openstack-kuttl-tests/keystone-bootstrap-tplqm" Mar 16 16:39:36 crc kubenswrapper[5120]: I0316 16:39:36.709837 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pngs5\" (UniqueName: \"kubernetes.io/projected/621997b8-90a2-44ff-b1bf-ababd800c8ad-kube-api-access-pngs5\") pod \"keystone-bootstrap-tplqm\" (UID: \"621997b8-90a2-44ff-b1bf-ababd800c8ad\") " pod="openstack-kuttl-tests/keystone-bootstrap-tplqm" Mar 16 16:39:36 crc kubenswrapper[5120]: I0316 16:39:36.709858 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/621997b8-90a2-44ff-b1bf-ababd800c8ad-fernet-keys\") pod \"keystone-bootstrap-tplqm\" (UID: \"621997b8-90a2-44ff-b1bf-ababd800c8ad\") " pod="openstack-kuttl-tests/keystone-bootstrap-tplqm" Mar 16 16:39:36 crc kubenswrapper[5120]: I0316 16:39:36.709879 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/621997b8-90a2-44ff-b1bf-ababd800c8ad-combined-ca-bundle\") pod \"keystone-bootstrap-tplqm\" (UID: \"621997b8-90a2-44ff-b1bf-ababd800c8ad\") " pod="openstack-kuttl-tests/keystone-bootstrap-tplqm" Mar 16 16:39:36 crc kubenswrapper[5120]: I0316 16:39:36.713809 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:39:36 crc kubenswrapper[5120]: I0316 16:39:36.713847 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-jpgn5"] Mar 16 16:39:36 crc kubenswrapper[5120]: I0316 16:39:36.715737 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:39:36 crc kubenswrapper[5120]: I0316 16:39:36.724917 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/621997b8-90a2-44ff-b1bf-ababd800c8ad-config-data\") pod \"keystone-bootstrap-tplqm\" (UID: \"621997b8-90a2-44ff-b1bf-ababd800c8ad\") " pod="openstack-kuttl-tests/keystone-bootstrap-tplqm" Mar 16 16:39:36 crc kubenswrapper[5120]: I0316 16:39:36.730580 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/621997b8-90a2-44ff-b1bf-ababd800c8ad-fernet-keys\") pod \"keystone-bootstrap-tplqm\" (UID: \"621997b8-90a2-44ff-b1bf-ababd800c8ad\") " pod="openstack-kuttl-tests/keystone-bootstrap-tplqm" Mar 16 16:39:36 crc kubenswrapper[5120]: I0316 16:39:36.731153 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 16:39:36 crc kubenswrapper[5120]: I0316 16:39:36.731387 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 16:39:36 crc kubenswrapper[5120]: I0316 16:39:36.731162 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/621997b8-90a2-44ff-b1bf-ababd800c8ad-combined-ca-bundle\") pod \"keystone-bootstrap-tplqm\" (UID: \"621997b8-90a2-44ff-b1bf-ababd800c8ad\") " pod="openstack-kuttl-tests/keystone-bootstrap-tplqm" Mar 16 16:39:36 crc kubenswrapper[5120]: I0316 16:39:36.732330 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/621997b8-90a2-44ff-b1bf-ababd800c8ad-credential-keys\") pod \"keystone-bootstrap-tplqm\" (UID: \"621997b8-90a2-44ff-b1bf-ababd800c8ad\") " pod="openstack-kuttl-tests/keystone-bootstrap-tplqm" Mar 16 16:39:36 crc kubenswrapper[5120]: I0316 16:39:36.733922 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/621997b8-90a2-44ff-b1bf-ababd800c8ad-scripts\") pod \"keystone-bootstrap-tplqm\" (UID: \"621997b8-90a2-44ff-b1bf-ababd800c8ad\") " pod="openstack-kuttl-tests/keystone-bootstrap-tplqm" Mar 16 16:39:36 crc kubenswrapper[5120]: I0316 16:39:36.740107 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pngs5\" (UniqueName: \"kubernetes.io/projected/621997b8-90a2-44ff-b1bf-ababd800c8ad-kube-api-access-pngs5\") pod \"keystone-bootstrap-tplqm\" (UID: \"621997b8-90a2-44ff-b1bf-ababd800c8ad\") " pod="openstack-kuttl-tests/keystone-bootstrap-tplqm" Mar 16 16:39:36 crc kubenswrapper[5120]: I0316 16:39:36.777837 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-268nj"] Mar 16 16:39:36 crc kubenswrapper[5120]: I0316 16:39:36.778565 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-jpgn5" Mar 16 16:39:36 crc kubenswrapper[5120]: I0316 16:39:36.780268 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-neutron-dockercfg-9xldd\"" Mar 16 16:39:36 crc kubenswrapper[5120]: I0316 16:39:36.781751 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-httpd-config\"" Mar 16 16:39:36 crc kubenswrapper[5120]: I0316 16:39:36.787358 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-config\"" Mar 16 16:39:36 crc kubenswrapper[5120]: I0316 16:39:36.809491 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-jpgn5"] Mar 16 16:39:36 crc kubenswrapper[5120]: I0316 16:39:36.809524 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-db-sync-txkbm"] Mar 16 16:39:36 crc kubenswrapper[5120]: I0316 16:39:36.810265 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-268nj" Mar 16 16:39:36 crc kubenswrapper[5120]: I0316 16:39:36.810918 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9pmz\" (UniqueName: \"kubernetes.io/projected/745bf98f-c08e-46c9-a315-18ee1ff7ca20-kube-api-access-z9pmz\") pod \"neutron-db-sync-jpgn5\" (UID: \"745bf98f-c08e-46c9-a315-18ee1ff7ca20\") " pod="openstack-kuttl-tests/neutron-db-sync-jpgn5" Mar 16 16:39:36 crc kubenswrapper[5120]: I0316 16:39:36.810993 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c6cd3a57-412a-4098-b987-6d1d5c8bd0a0-run-httpd\") pod \"ceilometer-0\" (UID: \"c6cd3a57-412a-4098-b987-6d1d5c8bd0a0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:39:36 crc kubenswrapper[5120]: I0316 16:39:36.811050 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c6cd3a57-412a-4098-b987-6d1d5c8bd0a0-config-data\") pod \"ceilometer-0\" (UID: \"c6cd3a57-412a-4098-b987-6d1d5c8bd0a0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:39:36 crc kubenswrapper[5120]: I0316 16:39:36.811122 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c6cd3a57-412a-4098-b987-6d1d5c8bd0a0-scripts\") pod \"ceilometer-0\" (UID: \"c6cd3a57-412a-4098-b987-6d1d5c8bd0a0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:39:36 crc kubenswrapper[5120]: I0316 16:39:36.811148 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c6cd3a57-412a-4098-b987-6d1d5c8bd0a0-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"c6cd3a57-412a-4098-b987-6d1d5c8bd0a0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:39:36 crc kubenswrapper[5120]: I0316 16:39:36.811239 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/7f161303-6db3-42fc-8cca-089c09eabda5-etc-swift\") pod \"swift-storage-0\" (UID: \"7f161303-6db3-42fc-8cca-089c09eabda5\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:39:36 crc kubenswrapper[5120]: I0316 16:39:36.811361 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c6cd3a57-412a-4098-b987-6d1d5c8bd0a0-log-httpd\") pod \"ceilometer-0\" (UID: \"c6cd3a57-412a-4098-b987-6d1d5c8bd0a0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:39:36 crc kubenswrapper[5120]: I0316 16:39:36.811455 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/c6cd3a57-412a-4098-b987-6d1d5c8bd0a0-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"c6cd3a57-412a-4098-b987-6d1d5c8bd0a0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:39:36 crc kubenswrapper[5120]: I0316 16:39:36.811486 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6tzxk\" (UniqueName: \"kubernetes.io/projected/c6cd3a57-412a-4098-b987-6d1d5c8bd0a0-kube-api-access-6tzxk\") pod \"ceilometer-0\" (UID: \"c6cd3a57-412a-4098-b987-6d1d5c8bd0a0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:39:36 crc kubenswrapper[5120]: I0316 16:39:36.811563 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/745bf98f-c08e-46c9-a315-18ee1ff7ca20-config\") pod \"neutron-db-sync-jpgn5\" (UID: \"745bf98f-c08e-46c9-a315-18ee1ff7ca20\") " pod="openstack-kuttl-tests/neutron-db-sync-jpgn5" Mar 16 16:39:36 crc kubenswrapper[5120]: I0316 16:39:36.811719 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/745bf98f-c08e-46c9-a315-18ee1ff7ca20-combined-ca-bundle\") pod \"neutron-db-sync-jpgn5\" (UID: \"745bf98f-c08e-46c9-a315-18ee1ff7ca20\") " pod="openstack-kuttl-tests/neutron-db-sync-jpgn5" Mar 16 16:39:36 crc kubenswrapper[5120]: I0316 16:39:36.815865 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-config-data\"" Mar 16 16:39:36 crc kubenswrapper[5120]: I0316 16:39:36.816143 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-scripts\"" Mar 16 16:39:36 crc kubenswrapper[5120]: I0316 16:39:36.816259 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-cinder-dockercfg-n8q78\"" Mar 16 16:39:36 crc kubenswrapper[5120]: I0316 16:39:36.837878 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/7f161303-6db3-42fc-8cca-089c09eabda5-etc-swift\") pod \"swift-storage-0\" (UID: \"7f161303-6db3-42fc-8cca-089c09eabda5\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:39:36 crc kubenswrapper[5120]: I0316 16:39:36.859720 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:39:36 crc kubenswrapper[5120]: I0316 16:39:36.859801 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-tplqm" Mar 16 16:39:36 crc kubenswrapper[5120]: I0316 16:39:36.867071 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-txkbm"] Mar 16 16:39:36 crc kubenswrapper[5120]: I0316 16:39:36.867103 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-268nj"] Mar 16 16:39:36 crc kubenswrapper[5120]: I0316 16:39:36.867811 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-txkbm" Mar 16 16:39:36 crc kubenswrapper[5120]: I0316 16:39:36.873484 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-config-data\"" Mar 16 16:39:36 crc kubenswrapper[5120]: I0316 16:39:36.873828 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-scripts\"" Mar 16 16:39:36 crc kubenswrapper[5120]: I0316 16:39:36.874049 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-placement-dockercfg-nmhck\"" Mar 16 16:39:36 crc kubenswrapper[5120]: I0316 16:39:36.883798 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-pz6fg"] Mar 16 16:39:36 crc kubenswrapper[5120]: I0316 16:39:36.913672 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d63482e7-41aa-4a92-a5d5-3d238ef52b54-logs\") pod \"placement-db-sync-txkbm\" (UID: \"d63482e7-41aa-4a92-a5d5-3d238ef52b54\") " pod="openstack-kuttl-tests/placement-db-sync-txkbm" Mar 16 16:39:36 crc kubenswrapper[5120]: I0316 16:39:36.913749 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5twsd\" (UniqueName: \"kubernetes.io/projected/d63482e7-41aa-4a92-a5d5-3d238ef52b54-kube-api-access-5twsd\") pod \"placement-db-sync-txkbm\" (UID: \"d63482e7-41aa-4a92-a5d5-3d238ef52b54\") " pod="openstack-kuttl-tests/placement-db-sync-txkbm" Mar 16 16:39:36 crc kubenswrapper[5120]: I0316 16:39:36.913837 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b055003e-69db-43e3-b335-278f9687fcc7-combined-ca-bundle\") pod \"cinder-db-sync-268nj\" (UID: \"b055003e-69db-43e3-b335-278f9687fcc7\") " pod="openstack-kuttl-tests/cinder-db-sync-268nj" Mar 16 16:39:36 crc kubenswrapper[5120]: I0316 16:39:36.914012 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c6cd3a57-412a-4098-b987-6d1d5c8bd0a0-run-httpd\") pod \"ceilometer-0\" (UID: \"c6cd3a57-412a-4098-b987-6d1d5c8bd0a0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:39:36 crc kubenswrapper[5120]: I0316 16:39:36.914107 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/b055003e-69db-43e3-b335-278f9687fcc7-etc-machine-id\") pod \"cinder-db-sync-268nj\" (UID: \"b055003e-69db-43e3-b335-278f9687fcc7\") " pod="openstack-kuttl-tests/cinder-db-sync-268nj" Mar 16 16:39:36 crc kubenswrapper[5120]: I0316 16:39:36.914163 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c6cd3a57-412a-4098-b987-6d1d5c8bd0a0-config-data\") pod \"ceilometer-0\" (UID: \"c6cd3a57-412a-4098-b987-6d1d5c8bd0a0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:39:36 crc kubenswrapper[5120]: I0316 16:39:36.914221 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b055003e-69db-43e3-b335-278f9687fcc7-scripts\") pod \"cinder-db-sync-268nj\" (UID: \"b055003e-69db-43e3-b335-278f9687fcc7\") " pod="openstack-kuttl-tests/cinder-db-sync-268nj" Mar 16 16:39:36 crc kubenswrapper[5120]: I0316 16:39:36.914289 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d63482e7-41aa-4a92-a5d5-3d238ef52b54-combined-ca-bundle\") pod \"placement-db-sync-txkbm\" (UID: \"d63482e7-41aa-4a92-a5d5-3d238ef52b54\") " pod="openstack-kuttl-tests/placement-db-sync-txkbm" Mar 16 16:39:36 crc kubenswrapper[5120]: I0316 16:39:36.914350 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c6cd3a57-412a-4098-b987-6d1d5c8bd0a0-scripts\") pod \"ceilometer-0\" (UID: \"c6cd3a57-412a-4098-b987-6d1d5c8bd0a0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:39:36 crc kubenswrapper[5120]: I0316 16:39:36.914376 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c6cd3a57-412a-4098-b987-6d1d5c8bd0a0-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"c6cd3a57-412a-4098-b987-6d1d5c8bd0a0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:39:36 crc kubenswrapper[5120]: I0316 16:39:36.914409 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/b055003e-69db-43e3-b335-278f9687fcc7-db-sync-config-data\") pod \"cinder-db-sync-268nj\" (UID: \"b055003e-69db-43e3-b335-278f9687fcc7\") " pod="openstack-kuttl-tests/cinder-db-sync-268nj" Mar 16 16:39:36 crc kubenswrapper[5120]: I0316 16:39:36.914466 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b055003e-69db-43e3-b335-278f9687fcc7-config-data\") pod \"cinder-db-sync-268nj\" (UID: \"b055003e-69db-43e3-b335-278f9687fcc7\") " pod="openstack-kuttl-tests/cinder-db-sync-268nj" Mar 16 16:39:36 crc kubenswrapper[5120]: I0316 16:39:36.914503 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fn4j\" (UniqueName: \"kubernetes.io/projected/b055003e-69db-43e3-b335-278f9687fcc7-kube-api-access-4fn4j\") pod \"cinder-db-sync-268nj\" (UID: \"b055003e-69db-43e3-b335-278f9687fcc7\") " pod="openstack-kuttl-tests/cinder-db-sync-268nj" Mar 16 16:39:36 crc kubenswrapper[5120]: I0316 16:39:36.914578 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d63482e7-41aa-4a92-a5d5-3d238ef52b54-scripts\") pod \"placement-db-sync-txkbm\" (UID: \"d63482e7-41aa-4a92-a5d5-3d238ef52b54\") " pod="openstack-kuttl-tests/placement-db-sync-txkbm" Mar 16 16:39:36 crc kubenswrapper[5120]: I0316 16:39:36.914614 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c6cd3a57-412a-4098-b987-6d1d5c8bd0a0-log-httpd\") pod \"ceilometer-0\" (UID: \"c6cd3a57-412a-4098-b987-6d1d5c8bd0a0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:39:36 crc kubenswrapper[5120]: I0316 16:39:36.914670 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d63482e7-41aa-4a92-a5d5-3d238ef52b54-config-data\") pod \"placement-db-sync-txkbm\" (UID: \"d63482e7-41aa-4a92-a5d5-3d238ef52b54\") " pod="openstack-kuttl-tests/placement-db-sync-txkbm" Mar 16 16:39:36 crc kubenswrapper[5120]: I0316 16:39:36.914703 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c6cd3a57-412a-4098-b987-6d1d5c8bd0a0-run-httpd\") pod \"ceilometer-0\" (UID: \"c6cd3a57-412a-4098-b987-6d1d5c8bd0a0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:39:36 crc kubenswrapper[5120]: I0316 16:39:36.914733 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/c6cd3a57-412a-4098-b987-6d1d5c8bd0a0-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"c6cd3a57-412a-4098-b987-6d1d5c8bd0a0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:39:36 crc kubenswrapper[5120]: I0316 16:39:36.914786 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6tzxk\" (UniqueName: \"kubernetes.io/projected/c6cd3a57-412a-4098-b987-6d1d5c8bd0a0-kube-api-access-6tzxk\") pod \"ceilometer-0\" (UID: \"c6cd3a57-412a-4098-b987-6d1d5c8bd0a0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:39:36 crc kubenswrapper[5120]: I0316 16:39:36.914867 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/745bf98f-c08e-46c9-a315-18ee1ff7ca20-config\") pod \"neutron-db-sync-jpgn5\" (UID: \"745bf98f-c08e-46c9-a315-18ee1ff7ca20\") " pod="openstack-kuttl-tests/neutron-db-sync-jpgn5" Mar 16 16:39:36 crc kubenswrapper[5120]: I0316 16:39:36.915019 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/745bf98f-c08e-46c9-a315-18ee1ff7ca20-combined-ca-bundle\") pod \"neutron-db-sync-jpgn5\" (UID: \"745bf98f-c08e-46c9-a315-18ee1ff7ca20\") " pod="openstack-kuttl-tests/neutron-db-sync-jpgn5" Mar 16 16:39:36 crc kubenswrapper[5120]: I0316 16:39:36.915144 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z9pmz\" (UniqueName: \"kubernetes.io/projected/745bf98f-c08e-46c9-a315-18ee1ff7ca20-kube-api-access-z9pmz\") pod \"neutron-db-sync-jpgn5\" (UID: \"745bf98f-c08e-46c9-a315-18ee1ff7ca20\") " pod="openstack-kuttl-tests/neutron-db-sync-jpgn5" Mar 16 16:39:36 crc kubenswrapper[5120]: I0316 16:39:36.915470 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c6cd3a57-412a-4098-b987-6d1d5c8bd0a0-log-httpd\") pod \"ceilometer-0\" (UID: \"c6cd3a57-412a-4098-b987-6d1d5c8bd0a0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:39:36 crc kubenswrapper[5120]: I0316 16:39:36.919100 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/c6cd3a57-412a-4098-b987-6d1d5c8bd0a0-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"c6cd3a57-412a-4098-b987-6d1d5c8bd0a0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:39:36 crc kubenswrapper[5120]: I0316 16:39:36.919979 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c6cd3a57-412a-4098-b987-6d1d5c8bd0a0-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"c6cd3a57-412a-4098-b987-6d1d5c8bd0a0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:39:36 crc kubenswrapper[5120]: I0316 16:39:36.921552 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c6cd3a57-412a-4098-b987-6d1d5c8bd0a0-config-data\") pod \"ceilometer-0\" (UID: \"c6cd3a57-412a-4098-b987-6d1d5c8bd0a0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:39:36 crc kubenswrapper[5120]: I0316 16:39:36.922268 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/745bf98f-c08e-46c9-a315-18ee1ff7ca20-combined-ca-bundle\") pod \"neutron-db-sync-jpgn5\" (UID: \"745bf98f-c08e-46c9-a315-18ee1ff7ca20\") " pod="openstack-kuttl-tests/neutron-db-sync-jpgn5" Mar 16 16:39:36 crc kubenswrapper[5120]: I0316 16:39:36.927242 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c6cd3a57-412a-4098-b987-6d1d5c8bd0a0-scripts\") pod \"ceilometer-0\" (UID: \"c6cd3a57-412a-4098-b987-6d1d5c8bd0a0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:39:36 crc kubenswrapper[5120]: I0316 16:39:36.933096 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6tzxk\" (UniqueName: \"kubernetes.io/projected/c6cd3a57-412a-4098-b987-6d1d5c8bd0a0-kube-api-access-6tzxk\") pod \"ceilometer-0\" (UID: \"c6cd3a57-412a-4098-b987-6d1d5c8bd0a0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:39:36 crc kubenswrapper[5120]: I0316 16:39:36.944590 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/745bf98f-c08e-46c9-a315-18ee1ff7ca20-config\") pod \"neutron-db-sync-jpgn5\" (UID: \"745bf98f-c08e-46c9-a315-18ee1ff7ca20\") " pod="openstack-kuttl-tests/neutron-db-sync-jpgn5" Mar 16 16:39:36 crc kubenswrapper[5120]: I0316 16:39:36.955869 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9pmz\" (UniqueName: \"kubernetes.io/projected/745bf98f-c08e-46c9-a315-18ee1ff7ca20-kube-api-access-z9pmz\") pod \"neutron-db-sync-jpgn5\" (UID: \"745bf98f-c08e-46c9-a315-18ee1ff7ca20\") " pod="openstack-kuttl-tests/neutron-db-sync-jpgn5" Mar 16 16:39:36 crc kubenswrapper[5120]: I0316 16:39:36.988261 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-jpgn5" Mar 16 16:39:37 crc kubenswrapper[5120]: I0316 16:39:37.012329 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-pz6fg"] Mar 16 16:39:37 crc kubenswrapper[5120]: I0316 16:39:37.012750 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-pz6fg" Mar 16 16:39:37 crc kubenswrapper[5120]: I0316 16:39:37.020096 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-config-data\"" Mar 16 16:39:37 crc kubenswrapper[5120]: I0316 16:39:37.020290 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-barbican-dockercfg-7b5vz\"" Mar 16 16:39:37 crc kubenswrapper[5120]: I0316 16:39:37.020353 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d63482e7-41aa-4a92-a5d5-3d238ef52b54-logs\") pod \"placement-db-sync-txkbm\" (UID: \"d63482e7-41aa-4a92-a5d5-3d238ef52b54\") " pod="openstack-kuttl-tests/placement-db-sync-txkbm" Mar 16 16:39:37 crc kubenswrapper[5120]: I0316 16:39:37.020393 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5twsd\" (UniqueName: \"kubernetes.io/projected/d63482e7-41aa-4a92-a5d5-3d238ef52b54-kube-api-access-5twsd\") pod \"placement-db-sync-txkbm\" (UID: \"d63482e7-41aa-4a92-a5d5-3d238ef52b54\") " pod="openstack-kuttl-tests/placement-db-sync-txkbm" Mar 16 16:39:37 crc kubenswrapper[5120]: I0316 16:39:37.020427 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b055003e-69db-43e3-b335-278f9687fcc7-combined-ca-bundle\") pod \"cinder-db-sync-268nj\" (UID: \"b055003e-69db-43e3-b335-278f9687fcc7\") " pod="openstack-kuttl-tests/cinder-db-sync-268nj" Mar 16 16:39:37 crc kubenswrapper[5120]: I0316 16:39:37.020482 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/b055003e-69db-43e3-b335-278f9687fcc7-etc-machine-id\") pod \"cinder-db-sync-268nj\" (UID: \"b055003e-69db-43e3-b335-278f9687fcc7\") " pod="openstack-kuttl-tests/cinder-db-sync-268nj" Mar 16 16:39:37 crc kubenswrapper[5120]: I0316 16:39:37.020521 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b055003e-69db-43e3-b335-278f9687fcc7-scripts\") pod \"cinder-db-sync-268nj\" (UID: \"b055003e-69db-43e3-b335-278f9687fcc7\") " pod="openstack-kuttl-tests/cinder-db-sync-268nj" Mar 16 16:39:37 crc kubenswrapper[5120]: I0316 16:39:37.020556 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d63482e7-41aa-4a92-a5d5-3d238ef52b54-combined-ca-bundle\") pod \"placement-db-sync-txkbm\" (UID: \"d63482e7-41aa-4a92-a5d5-3d238ef52b54\") " pod="openstack-kuttl-tests/placement-db-sync-txkbm" Mar 16 16:39:37 crc kubenswrapper[5120]: I0316 16:39:37.020593 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/b055003e-69db-43e3-b335-278f9687fcc7-db-sync-config-data\") pod \"cinder-db-sync-268nj\" (UID: \"b055003e-69db-43e3-b335-278f9687fcc7\") " pod="openstack-kuttl-tests/cinder-db-sync-268nj" Mar 16 16:39:37 crc kubenswrapper[5120]: I0316 16:39:37.020621 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b055003e-69db-43e3-b335-278f9687fcc7-config-data\") pod \"cinder-db-sync-268nj\" (UID: \"b055003e-69db-43e3-b335-278f9687fcc7\") " pod="openstack-kuttl-tests/cinder-db-sync-268nj" Mar 16 16:39:37 crc kubenswrapper[5120]: I0316 16:39:37.020645 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4fn4j\" (UniqueName: \"kubernetes.io/projected/b055003e-69db-43e3-b335-278f9687fcc7-kube-api-access-4fn4j\") pod \"cinder-db-sync-268nj\" (UID: \"b055003e-69db-43e3-b335-278f9687fcc7\") " pod="openstack-kuttl-tests/cinder-db-sync-268nj" Mar 16 16:39:37 crc kubenswrapper[5120]: I0316 16:39:37.020697 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d63482e7-41aa-4a92-a5d5-3d238ef52b54-scripts\") pod \"placement-db-sync-txkbm\" (UID: \"d63482e7-41aa-4a92-a5d5-3d238ef52b54\") " pod="openstack-kuttl-tests/placement-db-sync-txkbm" Mar 16 16:39:37 crc kubenswrapper[5120]: I0316 16:39:37.020737 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d63482e7-41aa-4a92-a5d5-3d238ef52b54-config-data\") pod \"placement-db-sync-txkbm\" (UID: \"d63482e7-41aa-4a92-a5d5-3d238ef52b54\") " pod="openstack-kuttl-tests/placement-db-sync-txkbm" Mar 16 16:39:37 crc kubenswrapper[5120]: I0316 16:39:37.021158 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/b055003e-69db-43e3-b335-278f9687fcc7-etc-machine-id\") pod \"cinder-db-sync-268nj\" (UID: \"b055003e-69db-43e3-b335-278f9687fcc7\") " pod="openstack-kuttl-tests/cinder-db-sync-268nj" Mar 16 16:39:37 crc kubenswrapper[5120]: I0316 16:39:37.028106 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d63482e7-41aa-4a92-a5d5-3d238ef52b54-logs\") pod \"placement-db-sync-txkbm\" (UID: \"d63482e7-41aa-4a92-a5d5-3d238ef52b54\") " pod="openstack-kuttl-tests/placement-db-sync-txkbm" Mar 16 16:39:37 crc kubenswrapper[5120]: I0316 16:39:37.031919 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d63482e7-41aa-4a92-a5d5-3d238ef52b54-combined-ca-bundle\") pod \"placement-db-sync-txkbm\" (UID: \"d63482e7-41aa-4a92-a5d5-3d238ef52b54\") " pod="openstack-kuttl-tests/placement-db-sync-txkbm" Mar 16 16:39:37 crc kubenswrapper[5120]: I0316 16:39:37.037315 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d63482e7-41aa-4a92-a5d5-3d238ef52b54-scripts\") pod \"placement-db-sync-txkbm\" (UID: \"d63482e7-41aa-4a92-a5d5-3d238ef52b54\") " pod="openstack-kuttl-tests/placement-db-sync-txkbm" Mar 16 16:39:37 crc kubenswrapper[5120]: I0316 16:39:37.041172 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/b055003e-69db-43e3-b335-278f9687fcc7-db-sync-config-data\") pod \"cinder-db-sync-268nj\" (UID: \"b055003e-69db-43e3-b335-278f9687fcc7\") " pod="openstack-kuttl-tests/cinder-db-sync-268nj" Mar 16 16:39:37 crc kubenswrapper[5120]: I0316 16:39:37.044742 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d63482e7-41aa-4a92-a5d5-3d238ef52b54-config-data\") pod \"placement-db-sync-txkbm\" (UID: \"d63482e7-41aa-4a92-a5d5-3d238ef52b54\") " pod="openstack-kuttl-tests/placement-db-sync-txkbm" Mar 16 16:39:37 crc kubenswrapper[5120]: I0316 16:39:37.045406 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b055003e-69db-43e3-b335-278f9687fcc7-scripts\") pod \"cinder-db-sync-268nj\" (UID: \"b055003e-69db-43e3-b335-278f9687fcc7\") " pod="openstack-kuttl-tests/cinder-db-sync-268nj" Mar 16 16:39:37 crc kubenswrapper[5120]: I0316 16:39:37.047901 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b055003e-69db-43e3-b335-278f9687fcc7-combined-ca-bundle\") pod \"cinder-db-sync-268nj\" (UID: \"b055003e-69db-43e3-b335-278f9687fcc7\") " pod="openstack-kuttl-tests/cinder-db-sync-268nj" Mar 16 16:39:37 crc kubenswrapper[5120]: I0316 16:39:37.048020 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b055003e-69db-43e3-b335-278f9687fcc7-config-data\") pod \"cinder-db-sync-268nj\" (UID: \"b055003e-69db-43e3-b335-278f9687fcc7\") " pod="openstack-kuttl-tests/cinder-db-sync-268nj" Mar 16 16:39:37 crc kubenswrapper[5120]: I0316 16:39:37.059720 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5twsd\" (UniqueName: \"kubernetes.io/projected/d63482e7-41aa-4a92-a5d5-3d238ef52b54-kube-api-access-5twsd\") pod \"placement-db-sync-txkbm\" (UID: \"d63482e7-41aa-4a92-a5d5-3d238ef52b54\") " pod="openstack-kuttl-tests/placement-db-sync-txkbm" Mar 16 16:39:37 crc kubenswrapper[5120]: I0316 16:39:37.063146 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fn4j\" (UniqueName: \"kubernetes.io/projected/b055003e-69db-43e3-b335-278f9687fcc7-kube-api-access-4fn4j\") pod \"cinder-db-sync-268nj\" (UID: \"b055003e-69db-43e3-b335-278f9687fcc7\") " pod="openstack-kuttl-tests/cinder-db-sync-268nj" Mar 16 16:39:37 crc kubenswrapper[5120]: I0316 16:39:37.129164 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hd66s\" (UniqueName: \"kubernetes.io/projected/09b33b66-f54d-4afc-90f8-da4637e37095-kube-api-access-hd66s\") pod \"barbican-db-sync-pz6fg\" (UID: \"09b33b66-f54d-4afc-90f8-da4637e37095\") " pod="openstack-kuttl-tests/barbican-db-sync-pz6fg" Mar 16 16:39:37 crc kubenswrapper[5120]: I0316 16:39:37.129259 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/09b33b66-f54d-4afc-90f8-da4637e37095-db-sync-config-data\") pod \"barbican-db-sync-pz6fg\" (UID: \"09b33b66-f54d-4afc-90f8-da4637e37095\") " pod="openstack-kuttl-tests/barbican-db-sync-pz6fg" Mar 16 16:39:37 crc kubenswrapper[5120]: I0316 16:39:37.129338 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/09b33b66-f54d-4afc-90f8-da4637e37095-combined-ca-bundle\") pod \"barbican-db-sync-pz6fg\" (UID: \"09b33b66-f54d-4afc-90f8-da4637e37095\") " pod="openstack-kuttl-tests/barbican-db-sync-pz6fg" Mar 16 16:39:37 crc kubenswrapper[5120]: I0316 16:39:37.177503 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:39:37 crc kubenswrapper[5120]: I0316 16:39:37.233292 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/09b33b66-f54d-4afc-90f8-da4637e37095-combined-ca-bundle\") pod \"barbican-db-sync-pz6fg\" (UID: \"09b33b66-f54d-4afc-90f8-da4637e37095\") " pod="openstack-kuttl-tests/barbican-db-sync-pz6fg" Mar 16 16:39:37 crc kubenswrapper[5120]: I0316 16:39:37.234055 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hd66s\" (UniqueName: \"kubernetes.io/projected/09b33b66-f54d-4afc-90f8-da4637e37095-kube-api-access-hd66s\") pod \"barbican-db-sync-pz6fg\" (UID: \"09b33b66-f54d-4afc-90f8-da4637e37095\") " pod="openstack-kuttl-tests/barbican-db-sync-pz6fg" Mar 16 16:39:37 crc kubenswrapper[5120]: I0316 16:39:37.234138 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/09b33b66-f54d-4afc-90f8-da4637e37095-db-sync-config-data\") pod \"barbican-db-sync-pz6fg\" (UID: \"09b33b66-f54d-4afc-90f8-da4637e37095\") " pod="openstack-kuttl-tests/barbican-db-sync-pz6fg" Mar 16 16:39:37 crc kubenswrapper[5120]: I0316 16:39:37.239353 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/09b33b66-f54d-4afc-90f8-da4637e37095-db-sync-config-data\") pod \"barbican-db-sync-pz6fg\" (UID: \"09b33b66-f54d-4afc-90f8-da4637e37095\") " pod="openstack-kuttl-tests/barbican-db-sync-pz6fg" Mar 16 16:39:37 crc kubenswrapper[5120]: I0316 16:39:37.246695 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/09b33b66-f54d-4afc-90f8-da4637e37095-combined-ca-bundle\") pod \"barbican-db-sync-pz6fg\" (UID: \"09b33b66-f54d-4afc-90f8-da4637e37095\") " pod="openstack-kuttl-tests/barbican-db-sync-pz6fg" Mar 16 16:39:37 crc kubenswrapper[5120]: I0316 16:39:37.260306 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hd66s\" (UniqueName: \"kubernetes.io/projected/09b33b66-f54d-4afc-90f8-da4637e37095-kube-api-access-hd66s\") pod \"barbican-db-sync-pz6fg\" (UID: \"09b33b66-f54d-4afc-90f8-da4637e37095\") " pod="openstack-kuttl-tests/barbican-db-sync-pz6fg" Mar 16 16:39:37 crc kubenswrapper[5120]: I0316 16:39:37.310109 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-268nj" Mar 16 16:39:37 crc kubenswrapper[5120]: I0316 16:39:37.342299 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-txkbm" Mar 16 16:39:37 crc kubenswrapper[5120]: I0316 16:39:37.369769 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-pz6fg" Mar 16 16:39:37 crc kubenswrapper[5120]: I0316 16:39:37.404070 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 16:39:37 crc kubenswrapper[5120]: W0316 16:39:37.412029 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7f161303_6db3_42fc_8cca_089c09eabda5.slice/crio-503aa2133d72f25f3a82a7c043cad5fec7063c7c7879e921d55e0c4add22b8c8 WatchSource:0}: Error finding container 503aa2133d72f25f3a82a7c043cad5fec7063c7c7879e921d55e0c4add22b8c8: Status 404 returned error can't find the container with id 503aa2133d72f25f3a82a7c043cad5fec7063c7c7879e921d55e0c4add22b8c8 Mar 16 16:39:37 crc kubenswrapper[5120]: I0316 16:39:37.476709 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-tplqm"] Mar 16 16:39:37 crc kubenswrapper[5120]: I0316 16:39:37.586597 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-jpgn5"] Mar 16 16:39:37 crc kubenswrapper[5120]: W0316 16:39:37.606125 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod745bf98f_c08e_46c9_a315_18ee1ff7ca20.slice/crio-e92b1b0f9d39daae42bdef9ff0687764a137d91135096df2cb2ad174c34b2b95 WatchSource:0}: Error finding container e92b1b0f9d39daae42bdef9ff0687764a137d91135096df2cb2ad174c34b2b95: Status 404 returned error can't find the container with id e92b1b0f9d39daae42bdef9ff0687764a137d91135096df2cb2ad174c34b2b95 Mar 16 16:39:37 crc kubenswrapper[5120]: I0316 16:39:37.810184 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:39:37 crc kubenswrapper[5120]: W0316 16:39:37.814011 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc6cd3a57_412a_4098_b987_6d1d5c8bd0a0.slice/crio-47972dcb6d60209c376029e85bf7a25307dc8c70bc3e83c5158f4b15ed989b97 WatchSource:0}: Error finding container 47972dcb6d60209c376029e85bf7a25307dc8c70bc3e83c5158f4b15ed989b97: Status 404 returned error can't find the container with id 47972dcb6d60209c376029e85bf7a25307dc8c70bc3e83c5158f4b15ed989b97 Mar 16 16:39:38 crc kubenswrapper[5120]: I0316 16:39:38.029593 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-txkbm"] Mar 16 16:39:38 crc kubenswrapper[5120]: I0316 16:39:38.040426 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-268nj"] Mar 16 16:39:38 crc kubenswrapper[5120]: I0316 16:39:38.186191 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-pz6fg"] Mar 16 16:39:38 crc kubenswrapper[5120]: I0316 16:39:38.358197 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-pz6fg" event={"ID":"09b33b66-f54d-4afc-90f8-da4637e37095","Type":"ContainerStarted","Data":"43aef09210434c32b625d67245dafd322315572a1afa5bfb88b78697692af22c"} Mar 16 16:39:38 crc kubenswrapper[5120]: I0316 16:39:38.364293 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-txkbm" event={"ID":"d63482e7-41aa-4a92-a5d5-3d238ef52b54","Type":"ContainerStarted","Data":"6a8fb6c7fa32b5e970a9e5b8c4bf1ffa40bcb1f031a1599e0aa7c5d18052e40c"} Mar 16 16:39:38 crc kubenswrapper[5120]: I0316 16:39:38.366204 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"c6cd3a57-412a-4098-b987-6d1d5c8bd0a0","Type":"ContainerStarted","Data":"47972dcb6d60209c376029e85bf7a25307dc8c70bc3e83c5158f4b15ed989b97"} Mar 16 16:39:38 crc kubenswrapper[5120]: I0316 16:39:38.367485 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-268nj" event={"ID":"b055003e-69db-43e3-b335-278f9687fcc7","Type":"ContainerStarted","Data":"888d3223f9c1230b2bd832098b3ba81a0d5454a43a51f1156080d53e4f45673b"} Mar 16 16:39:38 crc kubenswrapper[5120]: I0316 16:39:38.369530 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-jpgn5" event={"ID":"745bf98f-c08e-46c9-a315-18ee1ff7ca20","Type":"ContainerStarted","Data":"ab2aac04dcebfe12e4c30a3b88a8433a48f2665d7865b4724dcb80b22c847fab"} Mar 16 16:39:38 crc kubenswrapper[5120]: I0316 16:39:38.369557 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-jpgn5" event={"ID":"745bf98f-c08e-46c9-a315-18ee1ff7ca20","Type":"ContainerStarted","Data":"e92b1b0f9d39daae42bdef9ff0687764a137d91135096df2cb2ad174c34b2b95"} Mar 16 16:39:38 crc kubenswrapper[5120]: I0316 16:39:38.375703 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7f161303-6db3-42fc-8cca-089c09eabda5","Type":"ContainerStarted","Data":"0dd9bc3530759ea0393d12b620c6656b9900476393827384cefdec7f3b8a3955"} Mar 16 16:39:38 crc kubenswrapper[5120]: I0316 16:39:38.375808 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7f161303-6db3-42fc-8cca-089c09eabda5","Type":"ContainerStarted","Data":"393ca2c1ba80ec2d0992f37df8ef733396f1e566797d1d4d0e97ee936b2dd556"} Mar 16 16:39:38 crc kubenswrapper[5120]: I0316 16:39:38.375820 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7f161303-6db3-42fc-8cca-089c09eabda5","Type":"ContainerStarted","Data":"503aa2133d72f25f3a82a7c043cad5fec7063c7c7879e921d55e0c4add22b8c8"} Mar 16 16:39:38 crc kubenswrapper[5120]: I0316 16:39:38.378958 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-tplqm" event={"ID":"621997b8-90a2-44ff-b1bf-ababd800c8ad","Type":"ContainerStarted","Data":"53dec2e731a16b8c8d0ddcbd5b18223642ebf861238f5bfe2eedc21cbfa05f36"} Mar 16 16:39:38 crc kubenswrapper[5120]: I0316 16:39:38.379005 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-tplqm" event={"ID":"621997b8-90a2-44ff-b1bf-ababd800c8ad","Type":"ContainerStarted","Data":"8007aef37d1a86fa73bbe91a4a5c55450bee6da3827415c076a91382ff063c53"} Mar 16 16:39:38 crc kubenswrapper[5120]: I0316 16:39:38.391355 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-db-sync-jpgn5" podStartSLOduration=2.391327607 podStartE2EDuration="2.391327607s" podCreationTimestamp="2026-03-16 16:39:36 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:39:38.38703744 +0000 UTC m=+4080.540969097" watchObservedRunningTime="2026-03-16 16:39:38.391327607 +0000 UTC m=+4080.545259254" Mar 16 16:39:38 crc kubenswrapper[5120]: I0316 16:39:38.410874 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-bootstrap-tplqm" podStartSLOduration=2.410856157 podStartE2EDuration="2.410856157s" podCreationTimestamp="2026-03-16 16:39:36 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:39:38.405956503 +0000 UTC m=+4080.559888160" watchObservedRunningTime="2026-03-16 16:39:38.410856157 +0000 UTC m=+4080.564787804" Mar 16 16:39:39 crc kubenswrapper[5120]: I0316 16:39:39.056861 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:39:39 crc kubenswrapper[5120]: I0316 16:39:39.424386 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7f161303-6db3-42fc-8cca-089c09eabda5","Type":"ContainerStarted","Data":"639eb84e58ef1695b15c612c5e0ef5adc5f87e7687551d830e9e1103b5d73e84"} Mar 16 16:39:39 crc kubenswrapper[5120]: I0316 16:39:39.424775 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7f161303-6db3-42fc-8cca-089c09eabda5","Type":"ContainerStarted","Data":"50d21a1eb1dee64601b5ac5d957233a5b9c12af3c1f70e2ba64fc3fa232a426c"} Mar 16 16:39:39 crc kubenswrapper[5120]: I0316 16:39:39.424797 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7f161303-6db3-42fc-8cca-089c09eabda5","Type":"ContainerStarted","Data":"ae6a8c449bb16b6545d66ae19692d865fa5ca0fbbd29063f0dcab3878ee4f6d9"} Mar 16 16:39:39 crc kubenswrapper[5120]: I0316 16:39:39.427427 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-pz6fg" event={"ID":"09b33b66-f54d-4afc-90f8-da4637e37095","Type":"ContainerStarted","Data":"aadc12739b009e1a848bf4915d0375cc6b1442f11f47066a9eec1aa733161216"} Mar 16 16:39:39 crc kubenswrapper[5120]: I0316 16:39:39.454195 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-db-sync-pz6fg" podStartSLOduration=3.454178633 podStartE2EDuration="3.454178633s" podCreationTimestamp="2026-03-16 16:39:36 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:39:39.452458416 +0000 UTC m=+4081.606390093" watchObservedRunningTime="2026-03-16 16:39:39.454178633 +0000 UTC m=+4081.608110290" Mar 16 16:39:39 crc kubenswrapper[5120]: I0316 16:39:39.473025 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-txkbm" event={"ID":"d63482e7-41aa-4a92-a5d5-3d238ef52b54","Type":"ContainerStarted","Data":"1ea409ae64b201ef508d30db2aa0c4c11a4740db227c558e18bd2fa6b2daf45e"} Mar 16 16:39:39 crc kubenswrapper[5120]: I0316 16:39:39.489537 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"c6cd3a57-412a-4098-b987-6d1d5c8bd0a0","Type":"ContainerStarted","Data":"fdbca843ec08a7c3da6be1ada773833e099b1fac50391c563336b6c7a740d6f3"} Mar 16 16:39:39 crc kubenswrapper[5120]: I0316 16:39:39.500865 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-db-sync-txkbm" podStartSLOduration=3.500842809 podStartE2EDuration="3.500842809s" podCreationTimestamp="2026-03-16 16:39:36 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:39:39.497115549 +0000 UTC m=+4081.651047226" watchObservedRunningTime="2026-03-16 16:39:39.500842809 +0000 UTC m=+4081.654774466" Mar 16 16:39:40 crc kubenswrapper[5120]: I0316 16:39:40.507793 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"c6cd3a57-412a-4098-b987-6d1d5c8bd0a0","Type":"ContainerStarted","Data":"f827e2e8e8063bfacaed31323b5420a7a9aa3f243429a90a6cf2920786ac434c"} Mar 16 16:39:40 crc kubenswrapper[5120]: I0316 16:39:40.510614 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-268nj" event={"ID":"b055003e-69db-43e3-b335-278f9687fcc7","Type":"ContainerStarted","Data":"349678580bf491d57538e484f9dd1d67a9b8ab9a5d78de41e2d1b85ff9f12a0f"} Mar 16 16:39:40 crc kubenswrapper[5120]: I0316 16:39:40.520788 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7f161303-6db3-42fc-8cca-089c09eabda5","Type":"ContainerStarted","Data":"41bf99c5b4ac98ecadd81e8cdce4cfcf28dacdb72cf8eb33999efeac56f08c40"} Mar 16 16:39:40 crc kubenswrapper[5120]: I0316 16:39:40.520838 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7f161303-6db3-42fc-8cca-089c09eabda5","Type":"ContainerStarted","Data":"9da44b1906810fa56c015f549e5d082a124aad433f4666dd020ee73c3746d9bd"} Mar 16 16:39:40 crc kubenswrapper[5120]: I0316 16:39:40.520851 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7f161303-6db3-42fc-8cca-089c09eabda5","Type":"ContainerStarted","Data":"fc984a4dad798acc485f3583ca06562c9e78166d32047287908fccc38d13a52c"} Mar 16 16:39:40 crc kubenswrapper[5120]: I0316 16:39:40.559570 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-db-sync-268nj" podStartSLOduration=4.559554174 podStartE2EDuration="4.559554174s" podCreationTimestamp="2026-03-16 16:39:36 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:39:40.550330243 +0000 UTC m=+4082.704261900" watchObservedRunningTime="2026-03-16 16:39:40.559554174 +0000 UTC m=+4082.713485831" Mar 16 16:39:41 crc kubenswrapper[5120]: I0316 16:39:41.534256 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"c6cd3a57-412a-4098-b987-6d1d5c8bd0a0","Type":"ContainerStarted","Data":"02e927e66ac3d55d9aaf5281740c27272cef59f088799220cfe41f2f5bd98526"} Mar 16 16:39:41 crc kubenswrapper[5120]: I0316 16:39:41.543094 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7f161303-6db3-42fc-8cca-089c09eabda5","Type":"ContainerStarted","Data":"6eb2da0f9d23498832f20c9907eb27be212445bdc8591a5d329c515457fec159"} Mar 16 16:39:41 crc kubenswrapper[5120]: I0316 16:39:41.543406 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7f161303-6db3-42fc-8cca-089c09eabda5","Type":"ContainerStarted","Data":"701430e9b417ed89663c5d841e28695f639a5ce24a937584b3e91e1668f567a9"} Mar 16 16:39:41 crc kubenswrapper[5120]: I0316 16:39:41.543426 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7f161303-6db3-42fc-8cca-089c09eabda5","Type":"ContainerStarted","Data":"45d417324d3b1fd816cb84ece88a62414ef3cde2344cbac2b40f9cd9bb15195b"} Mar 16 16:39:41 crc kubenswrapper[5120]: I0316 16:39:41.543523 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7f161303-6db3-42fc-8cca-089c09eabda5","Type":"ContainerStarted","Data":"eda7739ccb0bef92fc25f7b29815a187360fa6bc837dbfdcb2b947bbd2a51f25"} Mar 16 16:39:41 crc kubenswrapper[5120]: I0316 16:39:41.543534 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7f161303-6db3-42fc-8cca-089c09eabda5","Type":"ContainerStarted","Data":"878127ce868e772a907a2ec7f0247432f773e62eb60e0862523ea4e92c9cfb2c"} Mar 16 16:39:42 crc kubenswrapper[5120]: I0316 16:39:42.554681 5120 generic.go:358] "Generic (PLEG): container finished" podID="d63482e7-41aa-4a92-a5d5-3d238ef52b54" containerID="1ea409ae64b201ef508d30db2aa0c4c11a4740db227c558e18bd2fa6b2daf45e" exitCode=0 Mar 16 16:39:42 crc kubenswrapper[5120]: I0316 16:39:42.554792 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-txkbm" event={"ID":"d63482e7-41aa-4a92-a5d5-3d238ef52b54","Type":"ContainerDied","Data":"1ea409ae64b201ef508d30db2aa0c4c11a4740db227c558e18bd2fa6b2daf45e"} Mar 16 16:39:42 crc kubenswrapper[5120]: I0316 16:39:42.560576 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7f161303-6db3-42fc-8cca-089c09eabda5","Type":"ContainerStarted","Data":"75af2c5427cb378d8c7fc864d06681c8a85a02d921ffdac841d96d8c10ac4a44"} Mar 16 16:39:42 crc kubenswrapper[5120]: I0316 16:39:42.560613 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7f161303-6db3-42fc-8cca-089c09eabda5","Type":"ContainerStarted","Data":"832bc34866fa4463f5bace762c43ae81c0bb3c37a033c02d4a2f823022e660b8"} Mar 16 16:39:42 crc kubenswrapper[5120]: I0316 16:39:42.661396 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/swift-storage-0" podStartSLOduration=23.661376348 podStartE2EDuration="23.661376348s" podCreationTimestamp="2026-03-16 16:39:19 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:39:42.652782855 +0000 UTC m=+4084.806714522" watchObservedRunningTime="2026-03-16 16:39:42.661376348 +0000 UTC m=+4084.815308005" Mar 16 16:39:42 crc kubenswrapper[5120]: I0316 16:39:42.841119 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-75564c7f5c-29qz4"] Mar 16 16:39:42 crc kubenswrapper[5120]: I0316 16:39:42.847585 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-75564c7f5c-29qz4" Mar 16 16:39:42 crc kubenswrapper[5120]: I0316 16:39:42.857048 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-75564c7f5c-29qz4"] Mar 16 16:39:42 crc kubenswrapper[5120]: I0316 16:39:42.859756 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"dns-swift-storage-0\"" Mar 16 16:39:42 crc kubenswrapper[5120]: I0316 16:39:42.990374 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/232eb98c-2900-4d2b-adfb-5db5139e3934-dns-swift-storage-0\") pod \"dnsmasq-dnsmasq-75564c7f5c-29qz4\" (UID: \"232eb98c-2900-4d2b-adfb-5db5139e3934\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-75564c7f5c-29qz4" Mar 16 16:39:42 crc kubenswrapper[5120]: I0316 16:39:42.990482 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/232eb98c-2900-4d2b-adfb-5db5139e3934-config\") pod \"dnsmasq-dnsmasq-75564c7f5c-29qz4\" (UID: \"232eb98c-2900-4d2b-adfb-5db5139e3934\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-75564c7f5c-29qz4" Mar 16 16:39:42 crc kubenswrapper[5120]: I0316 16:39:42.990736 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/232eb98c-2900-4d2b-adfb-5db5139e3934-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-75564c7f5c-29qz4\" (UID: \"232eb98c-2900-4d2b-adfb-5db5139e3934\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-75564c7f5c-29qz4" Mar 16 16:39:42 crc kubenswrapper[5120]: I0316 16:39:42.990954 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6zpl\" (UniqueName: \"kubernetes.io/projected/232eb98c-2900-4d2b-adfb-5db5139e3934-kube-api-access-g6zpl\") pod \"dnsmasq-dnsmasq-75564c7f5c-29qz4\" (UID: \"232eb98c-2900-4d2b-adfb-5db5139e3934\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-75564c7f5c-29qz4" Mar 16 16:39:43 crc kubenswrapper[5120]: I0316 16:39:43.092559 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/232eb98c-2900-4d2b-adfb-5db5139e3934-dns-swift-storage-0\") pod \"dnsmasq-dnsmasq-75564c7f5c-29qz4\" (UID: \"232eb98c-2900-4d2b-adfb-5db5139e3934\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-75564c7f5c-29qz4" Mar 16 16:39:43 crc kubenswrapper[5120]: I0316 16:39:43.092639 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/232eb98c-2900-4d2b-adfb-5db5139e3934-config\") pod \"dnsmasq-dnsmasq-75564c7f5c-29qz4\" (UID: \"232eb98c-2900-4d2b-adfb-5db5139e3934\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-75564c7f5c-29qz4" Mar 16 16:39:43 crc kubenswrapper[5120]: I0316 16:39:43.092717 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/232eb98c-2900-4d2b-adfb-5db5139e3934-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-75564c7f5c-29qz4\" (UID: \"232eb98c-2900-4d2b-adfb-5db5139e3934\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-75564c7f5c-29qz4" Mar 16 16:39:43 crc kubenswrapper[5120]: I0316 16:39:43.092836 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g6zpl\" (UniqueName: \"kubernetes.io/projected/232eb98c-2900-4d2b-adfb-5db5139e3934-kube-api-access-g6zpl\") pod \"dnsmasq-dnsmasq-75564c7f5c-29qz4\" (UID: \"232eb98c-2900-4d2b-adfb-5db5139e3934\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-75564c7f5c-29qz4" Mar 16 16:39:43 crc kubenswrapper[5120]: I0316 16:39:43.094037 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/232eb98c-2900-4d2b-adfb-5db5139e3934-dns-swift-storage-0\") pod \"dnsmasq-dnsmasq-75564c7f5c-29qz4\" (UID: \"232eb98c-2900-4d2b-adfb-5db5139e3934\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-75564c7f5c-29qz4" Mar 16 16:39:43 crc kubenswrapper[5120]: I0316 16:39:43.094571 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/232eb98c-2900-4d2b-adfb-5db5139e3934-config\") pod \"dnsmasq-dnsmasq-75564c7f5c-29qz4\" (UID: \"232eb98c-2900-4d2b-adfb-5db5139e3934\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-75564c7f5c-29qz4" Mar 16 16:39:43 crc kubenswrapper[5120]: I0316 16:39:43.095090 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/232eb98c-2900-4d2b-adfb-5db5139e3934-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-75564c7f5c-29qz4\" (UID: \"232eb98c-2900-4d2b-adfb-5db5139e3934\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-75564c7f5c-29qz4" Mar 16 16:39:43 crc kubenswrapper[5120]: I0316 16:39:43.110040 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6zpl\" (UniqueName: \"kubernetes.io/projected/232eb98c-2900-4d2b-adfb-5db5139e3934-kube-api-access-g6zpl\") pod \"dnsmasq-dnsmasq-75564c7f5c-29qz4\" (UID: \"232eb98c-2900-4d2b-adfb-5db5139e3934\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-75564c7f5c-29qz4" Mar 16 16:39:43 crc kubenswrapper[5120]: I0316 16:39:43.173235 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-75564c7f5c-29qz4" Mar 16 16:39:43 crc kubenswrapper[5120]: I0316 16:39:43.571672 5120 generic.go:358] "Generic (PLEG): container finished" podID="09b33b66-f54d-4afc-90f8-da4637e37095" containerID="aadc12739b009e1a848bf4915d0375cc6b1442f11f47066a9eec1aa733161216" exitCode=0 Mar 16 16:39:43 crc kubenswrapper[5120]: I0316 16:39:43.571963 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-pz6fg" event={"ID":"09b33b66-f54d-4afc-90f8-da4637e37095","Type":"ContainerDied","Data":"aadc12739b009e1a848bf4915d0375cc6b1442f11f47066a9eec1aa733161216"} Mar 16 16:39:43 crc kubenswrapper[5120]: I0316 16:39:43.580315 5120 generic.go:358] "Generic (PLEG): container finished" podID="621997b8-90a2-44ff-b1bf-ababd800c8ad" containerID="53dec2e731a16b8c8d0ddcbd5b18223642ebf861238f5bfe2eedc21cbfa05f36" exitCode=0 Mar 16 16:39:43 crc kubenswrapper[5120]: I0316 16:39:43.580423 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-tplqm" event={"ID":"621997b8-90a2-44ff-b1bf-ababd800c8ad","Type":"ContainerDied","Data":"53dec2e731a16b8c8d0ddcbd5b18223642ebf861238f5bfe2eedc21cbfa05f36"} Mar 16 16:39:43 crc kubenswrapper[5120]: I0316 16:39:43.638558 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-75564c7f5c-29qz4"] Mar 16 16:39:43 crc kubenswrapper[5120]: I0316 16:39:43.925043 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-txkbm" Mar 16 16:39:44 crc kubenswrapper[5120]: I0316 16:39:44.012927 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d63482e7-41aa-4a92-a5d5-3d238ef52b54-logs\") pod \"d63482e7-41aa-4a92-a5d5-3d238ef52b54\" (UID: \"d63482e7-41aa-4a92-a5d5-3d238ef52b54\") " Mar 16 16:39:44 crc kubenswrapper[5120]: I0316 16:39:44.013201 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5twsd\" (UniqueName: \"kubernetes.io/projected/d63482e7-41aa-4a92-a5d5-3d238ef52b54-kube-api-access-5twsd\") pod \"d63482e7-41aa-4a92-a5d5-3d238ef52b54\" (UID: \"d63482e7-41aa-4a92-a5d5-3d238ef52b54\") " Mar 16 16:39:44 crc kubenswrapper[5120]: I0316 16:39:44.013365 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d63482e7-41aa-4a92-a5d5-3d238ef52b54-combined-ca-bundle\") pod \"d63482e7-41aa-4a92-a5d5-3d238ef52b54\" (UID: \"d63482e7-41aa-4a92-a5d5-3d238ef52b54\") " Mar 16 16:39:44 crc kubenswrapper[5120]: I0316 16:39:44.013411 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d63482e7-41aa-4a92-a5d5-3d238ef52b54-scripts\") pod \"d63482e7-41aa-4a92-a5d5-3d238ef52b54\" (UID: \"d63482e7-41aa-4a92-a5d5-3d238ef52b54\") " Mar 16 16:39:44 crc kubenswrapper[5120]: I0316 16:39:44.013531 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d63482e7-41aa-4a92-a5d5-3d238ef52b54-config-data\") pod \"d63482e7-41aa-4a92-a5d5-3d238ef52b54\" (UID: \"d63482e7-41aa-4a92-a5d5-3d238ef52b54\") " Mar 16 16:39:44 crc kubenswrapper[5120]: I0316 16:39:44.014284 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d63482e7-41aa-4a92-a5d5-3d238ef52b54-logs" (OuterVolumeSpecName: "logs") pod "d63482e7-41aa-4a92-a5d5-3d238ef52b54" (UID: "d63482e7-41aa-4a92-a5d5-3d238ef52b54"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:39:44 crc kubenswrapper[5120]: I0316 16:39:44.021617 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d63482e7-41aa-4a92-a5d5-3d238ef52b54-scripts" (OuterVolumeSpecName: "scripts") pod "d63482e7-41aa-4a92-a5d5-3d238ef52b54" (UID: "d63482e7-41aa-4a92-a5d5-3d238ef52b54"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:39:44 crc kubenswrapper[5120]: I0316 16:39:44.021654 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d63482e7-41aa-4a92-a5d5-3d238ef52b54-kube-api-access-5twsd" (OuterVolumeSpecName: "kube-api-access-5twsd") pod "d63482e7-41aa-4a92-a5d5-3d238ef52b54" (UID: "d63482e7-41aa-4a92-a5d5-3d238ef52b54"). InnerVolumeSpecName "kube-api-access-5twsd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:39:44 crc kubenswrapper[5120]: E0316 16:39:44.039151 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d63482e7-41aa-4a92-a5d5-3d238ef52b54-combined-ca-bundle podName:d63482e7-41aa-4a92-a5d5-3d238ef52b54 nodeName:}" failed. No retries permitted until 2026-03-16 16:39:44.539120911 +0000 UTC m=+4086.693052568 (durationBeforeRetry 500ms). Error: error cleaning subPath mounts for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/d63482e7-41aa-4a92-a5d5-3d238ef52b54-combined-ca-bundle") pod "d63482e7-41aa-4a92-a5d5-3d238ef52b54" (UID: "d63482e7-41aa-4a92-a5d5-3d238ef52b54") : error deleting /var/lib/kubelet/pods/d63482e7-41aa-4a92-a5d5-3d238ef52b54/volume-subpaths: remove /var/lib/kubelet/pods/d63482e7-41aa-4a92-a5d5-3d238ef52b54/volume-subpaths: no such file or directory Mar 16 16:39:44 crc kubenswrapper[5120]: I0316 16:39:44.042605 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d63482e7-41aa-4a92-a5d5-3d238ef52b54-config-data" (OuterVolumeSpecName: "config-data") pod "d63482e7-41aa-4a92-a5d5-3d238ef52b54" (UID: "d63482e7-41aa-4a92-a5d5-3d238ef52b54"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:39:44 crc kubenswrapper[5120]: I0316 16:39:44.115539 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d63482e7-41aa-4a92-a5d5-3d238ef52b54-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:39:44 crc kubenswrapper[5120]: I0316 16:39:44.115576 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d63482e7-41aa-4a92-a5d5-3d238ef52b54-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:39:44 crc kubenswrapper[5120]: I0316 16:39:44.115586 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d63482e7-41aa-4a92-a5d5-3d238ef52b54-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:39:44 crc kubenswrapper[5120]: I0316 16:39:44.115594 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5twsd\" (UniqueName: \"kubernetes.io/projected/d63482e7-41aa-4a92-a5d5-3d238ef52b54-kube-api-access-5twsd\") on node \"crc\" DevicePath \"\"" Mar 16 16:39:44 crc kubenswrapper[5120]: I0316 16:39:44.593022 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-txkbm" event={"ID":"d63482e7-41aa-4a92-a5d5-3d238ef52b54","Type":"ContainerDied","Data":"6a8fb6c7fa32b5e970a9e5b8c4bf1ffa40bcb1f031a1599e0aa7c5d18052e40c"} Mar 16 16:39:44 crc kubenswrapper[5120]: I0316 16:39:44.593344 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6a8fb6c7fa32b5e970a9e5b8c4bf1ffa40bcb1f031a1599e0aa7c5d18052e40c" Mar 16 16:39:44 crc kubenswrapper[5120]: I0316 16:39:44.593085 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-txkbm" Mar 16 16:39:44 crc kubenswrapper[5120]: I0316 16:39:44.596252 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"c6cd3a57-412a-4098-b987-6d1d5c8bd0a0","Type":"ContainerStarted","Data":"a019ac2a4b5ecef59c8ba7ba409d49a5917cfdf8278712315998d42a4f62fb76"} Mar 16 16:39:44 crc kubenswrapper[5120]: I0316 16:39:44.596429 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="c6cd3a57-412a-4098-b987-6d1d5c8bd0a0" containerName="ceilometer-central-agent" containerID="cri-o://fdbca843ec08a7c3da6be1ada773833e099b1fac50391c563336b6c7a740d6f3" gracePeriod=30 Mar 16 16:39:44 crc kubenswrapper[5120]: I0316 16:39:44.596507 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="c6cd3a57-412a-4098-b987-6d1d5c8bd0a0" containerName="sg-core" containerID="cri-o://02e927e66ac3d55d9aaf5281740c27272cef59f088799220cfe41f2f5bd98526" gracePeriod=30 Mar 16 16:39:44 crc kubenswrapper[5120]: I0316 16:39:44.596622 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="c6cd3a57-412a-4098-b987-6d1d5c8bd0a0" containerName="proxy-httpd" containerID="cri-o://a019ac2a4b5ecef59c8ba7ba409d49a5917cfdf8278712315998d42a4f62fb76" gracePeriod=30 Mar 16 16:39:44 crc kubenswrapper[5120]: I0316 16:39:44.596805 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="c6cd3a57-412a-4098-b987-6d1d5c8bd0a0" containerName="ceilometer-notification-agent" containerID="cri-o://f827e2e8e8063bfacaed31323b5420a7a9aa3f243429a90a6cf2920786ac434c" gracePeriod=30 Mar 16 16:39:44 crc kubenswrapper[5120]: I0316 16:39:44.596996 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:39:44 crc kubenswrapper[5120]: I0316 16:39:44.611559 5120 generic.go:358] "Generic (PLEG): container finished" podID="232eb98c-2900-4d2b-adfb-5db5139e3934" containerID="583e9411f6d300aa92e685a93da9c9f55a5ef0816030227ec0344cd847fcea7e" exitCode=0 Mar 16 16:39:44 crc kubenswrapper[5120]: I0316 16:39:44.611629 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-75564c7f5c-29qz4" event={"ID":"232eb98c-2900-4d2b-adfb-5db5139e3934","Type":"ContainerDied","Data":"583e9411f6d300aa92e685a93da9c9f55a5ef0816030227ec0344cd847fcea7e"} Mar 16 16:39:44 crc kubenswrapper[5120]: I0316 16:39:44.612028 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-75564c7f5c-29qz4" event={"ID":"232eb98c-2900-4d2b-adfb-5db5139e3934","Type":"ContainerStarted","Data":"c45faf1065073ee65f091e08f093724738e44d42e8121f7c898de06aed4d72ac"} Mar 16 16:39:44 crc kubenswrapper[5120]: I0316 16:39:44.625850 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d63482e7-41aa-4a92-a5d5-3d238ef52b54-combined-ca-bundle\") pod \"d63482e7-41aa-4a92-a5d5-3d238ef52b54\" (UID: \"d63482e7-41aa-4a92-a5d5-3d238ef52b54\") " Mar 16 16:39:44 crc kubenswrapper[5120]: I0316 16:39:44.637314 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=3.066015318 podStartE2EDuration="8.637295405s" podCreationTimestamp="2026-03-16 16:39:36 +0000 UTC" firstStartedPulling="2026-03-16 16:39:37.817813731 +0000 UTC m=+4079.971745388" lastFinishedPulling="2026-03-16 16:39:43.389093818 +0000 UTC m=+4085.543025475" observedRunningTime="2026-03-16 16:39:44.632377411 +0000 UTC m=+4086.786309098" watchObservedRunningTime="2026-03-16 16:39:44.637295405 +0000 UTC m=+4086.791227062" Mar 16 16:39:44 crc kubenswrapper[5120]: I0316 16:39:44.642480 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d63482e7-41aa-4a92-a5d5-3d238ef52b54-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "d63482e7-41aa-4a92-a5d5-3d238ef52b54" (UID: "d63482e7-41aa-4a92-a5d5-3d238ef52b54"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:39:44 crc kubenswrapper[5120]: I0316 16:39:44.723990 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-5c5dddf6d4-cftmc"] Mar 16 16:39:44 crc kubenswrapper[5120]: I0316 16:39:44.725195 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d63482e7-41aa-4a92-a5d5-3d238ef52b54" containerName="placement-db-sync" Mar 16 16:39:44 crc kubenswrapper[5120]: I0316 16:39:44.725297 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="d63482e7-41aa-4a92-a5d5-3d238ef52b54" containerName="placement-db-sync" Mar 16 16:39:44 crc kubenswrapper[5120]: I0316 16:39:44.725529 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="d63482e7-41aa-4a92-a5d5-3d238ef52b54" containerName="placement-db-sync" Mar 16 16:39:44 crc kubenswrapper[5120]: I0316 16:39:44.728199 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d63482e7-41aa-4a92-a5d5-3d238ef52b54-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:39:44 crc kubenswrapper[5120]: I0316 16:39:44.734878 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-5c5dddf6d4-cftmc" Mar 16 16:39:44 crc kubenswrapper[5120]: I0316 16:39:44.740210 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-placement-public-svc\"" Mar 16 16:39:44 crc kubenswrapper[5120]: I0316 16:39:44.765742 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-placement-internal-svc\"" Mar 16 16:39:44 crc kubenswrapper[5120]: I0316 16:39:44.817112 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-5c5dddf6d4-cftmc"] Mar 16 16:39:44 crc kubenswrapper[5120]: I0316 16:39:44.830136 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jl462\" (UniqueName: \"kubernetes.io/projected/f262f286-8308-4657-b286-dfc2eb7e25d3-kube-api-access-jl462\") pod \"placement-5c5dddf6d4-cftmc\" (UID: \"f262f286-8308-4657-b286-dfc2eb7e25d3\") " pod="openstack-kuttl-tests/placement-5c5dddf6d4-cftmc" Mar 16 16:39:44 crc kubenswrapper[5120]: I0316 16:39:44.830217 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f262f286-8308-4657-b286-dfc2eb7e25d3-internal-tls-certs\") pod \"placement-5c5dddf6d4-cftmc\" (UID: \"f262f286-8308-4657-b286-dfc2eb7e25d3\") " pod="openstack-kuttl-tests/placement-5c5dddf6d4-cftmc" Mar 16 16:39:44 crc kubenswrapper[5120]: I0316 16:39:44.830274 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f262f286-8308-4657-b286-dfc2eb7e25d3-combined-ca-bundle\") pod \"placement-5c5dddf6d4-cftmc\" (UID: \"f262f286-8308-4657-b286-dfc2eb7e25d3\") " pod="openstack-kuttl-tests/placement-5c5dddf6d4-cftmc" Mar 16 16:39:44 crc kubenswrapper[5120]: I0316 16:39:44.830300 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f262f286-8308-4657-b286-dfc2eb7e25d3-scripts\") pod \"placement-5c5dddf6d4-cftmc\" (UID: \"f262f286-8308-4657-b286-dfc2eb7e25d3\") " pod="openstack-kuttl-tests/placement-5c5dddf6d4-cftmc" Mar 16 16:39:44 crc kubenswrapper[5120]: I0316 16:39:44.830381 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f262f286-8308-4657-b286-dfc2eb7e25d3-logs\") pod \"placement-5c5dddf6d4-cftmc\" (UID: \"f262f286-8308-4657-b286-dfc2eb7e25d3\") " pod="openstack-kuttl-tests/placement-5c5dddf6d4-cftmc" Mar 16 16:39:44 crc kubenswrapper[5120]: I0316 16:39:44.831538 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f262f286-8308-4657-b286-dfc2eb7e25d3-public-tls-certs\") pod \"placement-5c5dddf6d4-cftmc\" (UID: \"f262f286-8308-4657-b286-dfc2eb7e25d3\") " pod="openstack-kuttl-tests/placement-5c5dddf6d4-cftmc" Mar 16 16:39:44 crc kubenswrapper[5120]: I0316 16:39:44.832793 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f262f286-8308-4657-b286-dfc2eb7e25d3-config-data\") pod \"placement-5c5dddf6d4-cftmc\" (UID: \"f262f286-8308-4657-b286-dfc2eb7e25d3\") " pod="openstack-kuttl-tests/placement-5c5dddf6d4-cftmc" Mar 16 16:39:44 crc kubenswrapper[5120]: I0316 16:39:44.936131 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jl462\" (UniqueName: \"kubernetes.io/projected/f262f286-8308-4657-b286-dfc2eb7e25d3-kube-api-access-jl462\") pod \"placement-5c5dddf6d4-cftmc\" (UID: \"f262f286-8308-4657-b286-dfc2eb7e25d3\") " pod="openstack-kuttl-tests/placement-5c5dddf6d4-cftmc" Mar 16 16:39:44 crc kubenswrapper[5120]: I0316 16:39:44.936188 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f262f286-8308-4657-b286-dfc2eb7e25d3-internal-tls-certs\") pod \"placement-5c5dddf6d4-cftmc\" (UID: \"f262f286-8308-4657-b286-dfc2eb7e25d3\") " pod="openstack-kuttl-tests/placement-5c5dddf6d4-cftmc" Mar 16 16:39:44 crc kubenswrapper[5120]: I0316 16:39:44.936228 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f262f286-8308-4657-b286-dfc2eb7e25d3-combined-ca-bundle\") pod \"placement-5c5dddf6d4-cftmc\" (UID: \"f262f286-8308-4657-b286-dfc2eb7e25d3\") " pod="openstack-kuttl-tests/placement-5c5dddf6d4-cftmc" Mar 16 16:39:44 crc kubenswrapper[5120]: I0316 16:39:44.936246 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f262f286-8308-4657-b286-dfc2eb7e25d3-scripts\") pod \"placement-5c5dddf6d4-cftmc\" (UID: \"f262f286-8308-4657-b286-dfc2eb7e25d3\") " pod="openstack-kuttl-tests/placement-5c5dddf6d4-cftmc" Mar 16 16:39:44 crc kubenswrapper[5120]: I0316 16:39:44.936304 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f262f286-8308-4657-b286-dfc2eb7e25d3-logs\") pod \"placement-5c5dddf6d4-cftmc\" (UID: \"f262f286-8308-4657-b286-dfc2eb7e25d3\") " pod="openstack-kuttl-tests/placement-5c5dddf6d4-cftmc" Mar 16 16:39:44 crc kubenswrapper[5120]: I0316 16:39:44.936332 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f262f286-8308-4657-b286-dfc2eb7e25d3-public-tls-certs\") pod \"placement-5c5dddf6d4-cftmc\" (UID: \"f262f286-8308-4657-b286-dfc2eb7e25d3\") " pod="openstack-kuttl-tests/placement-5c5dddf6d4-cftmc" Mar 16 16:39:44 crc kubenswrapper[5120]: I0316 16:39:44.936428 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f262f286-8308-4657-b286-dfc2eb7e25d3-config-data\") pod \"placement-5c5dddf6d4-cftmc\" (UID: \"f262f286-8308-4657-b286-dfc2eb7e25d3\") " pod="openstack-kuttl-tests/placement-5c5dddf6d4-cftmc" Mar 16 16:39:44 crc kubenswrapper[5120]: I0316 16:39:44.939669 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f262f286-8308-4657-b286-dfc2eb7e25d3-logs\") pod \"placement-5c5dddf6d4-cftmc\" (UID: \"f262f286-8308-4657-b286-dfc2eb7e25d3\") " pod="openstack-kuttl-tests/placement-5c5dddf6d4-cftmc" Mar 16 16:39:44 crc kubenswrapper[5120]: I0316 16:39:44.944447 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f262f286-8308-4657-b286-dfc2eb7e25d3-config-data\") pod \"placement-5c5dddf6d4-cftmc\" (UID: \"f262f286-8308-4657-b286-dfc2eb7e25d3\") " pod="openstack-kuttl-tests/placement-5c5dddf6d4-cftmc" Mar 16 16:39:44 crc kubenswrapper[5120]: I0316 16:39:44.944628 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f262f286-8308-4657-b286-dfc2eb7e25d3-scripts\") pod \"placement-5c5dddf6d4-cftmc\" (UID: \"f262f286-8308-4657-b286-dfc2eb7e25d3\") " pod="openstack-kuttl-tests/placement-5c5dddf6d4-cftmc" Mar 16 16:39:44 crc kubenswrapper[5120]: I0316 16:39:44.946317 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f262f286-8308-4657-b286-dfc2eb7e25d3-combined-ca-bundle\") pod \"placement-5c5dddf6d4-cftmc\" (UID: \"f262f286-8308-4657-b286-dfc2eb7e25d3\") " pod="openstack-kuttl-tests/placement-5c5dddf6d4-cftmc" Mar 16 16:39:44 crc kubenswrapper[5120]: I0316 16:39:44.950348 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f262f286-8308-4657-b286-dfc2eb7e25d3-public-tls-certs\") pod \"placement-5c5dddf6d4-cftmc\" (UID: \"f262f286-8308-4657-b286-dfc2eb7e25d3\") " pod="openstack-kuttl-tests/placement-5c5dddf6d4-cftmc" Mar 16 16:39:44 crc kubenswrapper[5120]: I0316 16:39:44.951498 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f262f286-8308-4657-b286-dfc2eb7e25d3-internal-tls-certs\") pod \"placement-5c5dddf6d4-cftmc\" (UID: \"f262f286-8308-4657-b286-dfc2eb7e25d3\") " pod="openstack-kuttl-tests/placement-5c5dddf6d4-cftmc" Mar 16 16:39:44 crc kubenswrapper[5120]: I0316 16:39:44.957532 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jl462\" (UniqueName: \"kubernetes.io/projected/f262f286-8308-4657-b286-dfc2eb7e25d3-kube-api-access-jl462\") pod \"placement-5c5dddf6d4-cftmc\" (UID: \"f262f286-8308-4657-b286-dfc2eb7e25d3\") " pod="openstack-kuttl-tests/placement-5c5dddf6d4-cftmc" Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.182395 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-5c5dddf6d4-cftmc" Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.303132 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-pz6fg" Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.343442 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/09b33b66-f54d-4afc-90f8-da4637e37095-db-sync-config-data\") pod \"09b33b66-f54d-4afc-90f8-da4637e37095\" (UID: \"09b33b66-f54d-4afc-90f8-da4637e37095\") " Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.343584 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hd66s\" (UniqueName: \"kubernetes.io/projected/09b33b66-f54d-4afc-90f8-da4637e37095-kube-api-access-hd66s\") pod \"09b33b66-f54d-4afc-90f8-da4637e37095\" (UID: \"09b33b66-f54d-4afc-90f8-da4637e37095\") " Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.344778 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/09b33b66-f54d-4afc-90f8-da4637e37095-combined-ca-bundle\") pod \"09b33b66-f54d-4afc-90f8-da4637e37095\" (UID: \"09b33b66-f54d-4afc-90f8-da4637e37095\") " Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.345032 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-tplqm" Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.366742 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09b33b66-f54d-4afc-90f8-da4637e37095-kube-api-access-hd66s" (OuterVolumeSpecName: "kube-api-access-hd66s") pod "09b33b66-f54d-4afc-90f8-da4637e37095" (UID: "09b33b66-f54d-4afc-90f8-da4637e37095"). InnerVolumeSpecName "kube-api-access-hd66s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.376404 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/09b33b66-f54d-4afc-90f8-da4637e37095-db-sync-config-data" (OuterVolumeSpecName: "db-sync-config-data") pod "09b33b66-f54d-4afc-90f8-da4637e37095" (UID: "09b33b66-f54d-4afc-90f8-da4637e37095"). InnerVolumeSpecName "db-sync-config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.379653 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/09b33b66-f54d-4afc-90f8-da4637e37095-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "09b33b66-f54d-4afc-90f8-da4637e37095" (UID: "09b33b66-f54d-4afc-90f8-da4637e37095"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.447201 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/621997b8-90a2-44ff-b1bf-ababd800c8ad-fernet-keys\") pod \"621997b8-90a2-44ff-b1bf-ababd800c8ad\" (UID: \"621997b8-90a2-44ff-b1bf-ababd800c8ad\") " Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.447361 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/621997b8-90a2-44ff-b1bf-ababd800c8ad-combined-ca-bundle\") pod \"621997b8-90a2-44ff-b1bf-ababd800c8ad\" (UID: \"621997b8-90a2-44ff-b1bf-ababd800c8ad\") " Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.447597 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/621997b8-90a2-44ff-b1bf-ababd800c8ad-credential-keys\") pod \"621997b8-90a2-44ff-b1bf-ababd800c8ad\" (UID: \"621997b8-90a2-44ff-b1bf-ababd800c8ad\") " Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.447626 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/621997b8-90a2-44ff-b1bf-ababd800c8ad-config-data\") pod \"621997b8-90a2-44ff-b1bf-ababd800c8ad\" (UID: \"621997b8-90a2-44ff-b1bf-ababd800c8ad\") " Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.447700 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/621997b8-90a2-44ff-b1bf-ababd800c8ad-scripts\") pod \"621997b8-90a2-44ff-b1bf-ababd800c8ad\" (UID: \"621997b8-90a2-44ff-b1bf-ababd800c8ad\") " Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.447820 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pngs5\" (UniqueName: \"kubernetes.io/projected/621997b8-90a2-44ff-b1bf-ababd800c8ad-kube-api-access-pngs5\") pod \"621997b8-90a2-44ff-b1bf-ababd800c8ad\" (UID: \"621997b8-90a2-44ff-b1bf-ababd800c8ad\") " Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.448518 5120 reconciler_common.go:299] "Volume detached for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/09b33b66-f54d-4afc-90f8-da4637e37095-db-sync-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.448534 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hd66s\" (UniqueName: \"kubernetes.io/projected/09b33b66-f54d-4afc-90f8-da4637e37095-kube-api-access-hd66s\") on node \"crc\" DevicePath \"\"" Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.448547 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/09b33b66-f54d-4afc-90f8-da4637e37095-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.453437 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/621997b8-90a2-44ff-b1bf-ababd800c8ad-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "621997b8-90a2-44ff-b1bf-ababd800c8ad" (UID: "621997b8-90a2-44ff-b1bf-ababd800c8ad"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.456672 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/621997b8-90a2-44ff-b1bf-ababd800c8ad-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "621997b8-90a2-44ff-b1bf-ababd800c8ad" (UID: "621997b8-90a2-44ff-b1bf-ababd800c8ad"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.457172 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/621997b8-90a2-44ff-b1bf-ababd800c8ad-kube-api-access-pngs5" (OuterVolumeSpecName: "kube-api-access-pngs5") pod "621997b8-90a2-44ff-b1bf-ababd800c8ad" (UID: "621997b8-90a2-44ff-b1bf-ababd800c8ad"). InnerVolumeSpecName "kube-api-access-pngs5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.471081 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/621997b8-90a2-44ff-b1bf-ababd800c8ad-scripts" (OuterVolumeSpecName: "scripts") pod "621997b8-90a2-44ff-b1bf-ababd800c8ad" (UID: "621997b8-90a2-44ff-b1bf-ababd800c8ad"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.495672 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/621997b8-90a2-44ff-b1bf-ababd800c8ad-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "621997b8-90a2-44ff-b1bf-ababd800c8ad" (UID: "621997b8-90a2-44ff-b1bf-ababd800c8ad"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.507627 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/621997b8-90a2-44ff-b1bf-ababd800c8ad-config-data" (OuterVolumeSpecName: "config-data") pod "621997b8-90a2-44ff-b1bf-ababd800c8ad" (UID: "621997b8-90a2-44ff-b1bf-ababd800c8ad"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.508579 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.550244 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c6cd3a57-412a-4098-b987-6d1d5c8bd0a0-config-data\") pod \"c6cd3a57-412a-4098-b987-6d1d5c8bd0a0\" (UID: \"c6cd3a57-412a-4098-b987-6d1d5c8bd0a0\") " Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.550314 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c6cd3a57-412a-4098-b987-6d1d5c8bd0a0-run-httpd\") pod \"c6cd3a57-412a-4098-b987-6d1d5c8bd0a0\" (UID: \"c6cd3a57-412a-4098-b987-6d1d5c8bd0a0\") " Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.550343 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c6cd3a57-412a-4098-b987-6d1d5c8bd0a0-log-httpd\") pod \"c6cd3a57-412a-4098-b987-6d1d5c8bd0a0\" (UID: \"c6cd3a57-412a-4098-b987-6d1d5c8bd0a0\") " Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.550469 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6tzxk\" (UniqueName: \"kubernetes.io/projected/c6cd3a57-412a-4098-b987-6d1d5c8bd0a0-kube-api-access-6tzxk\") pod \"c6cd3a57-412a-4098-b987-6d1d5c8bd0a0\" (UID: \"c6cd3a57-412a-4098-b987-6d1d5c8bd0a0\") " Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.550520 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/c6cd3a57-412a-4098-b987-6d1d5c8bd0a0-sg-core-conf-yaml\") pod \"c6cd3a57-412a-4098-b987-6d1d5c8bd0a0\" (UID: \"c6cd3a57-412a-4098-b987-6d1d5c8bd0a0\") " Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.550652 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6cd3a57-412a-4098-b987-6d1d5c8bd0a0-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "c6cd3a57-412a-4098-b987-6d1d5c8bd0a0" (UID: "c6cd3a57-412a-4098-b987-6d1d5c8bd0a0"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.550698 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c6cd3a57-412a-4098-b987-6d1d5c8bd0a0-combined-ca-bundle\") pod \"c6cd3a57-412a-4098-b987-6d1d5c8bd0a0\" (UID: \"c6cd3a57-412a-4098-b987-6d1d5c8bd0a0\") " Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.550774 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c6cd3a57-412a-4098-b987-6d1d5c8bd0a0-scripts\") pod \"c6cd3a57-412a-4098-b987-6d1d5c8bd0a0\" (UID: \"c6cd3a57-412a-4098-b987-6d1d5c8bd0a0\") " Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.551287 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6cd3a57-412a-4098-b987-6d1d5c8bd0a0-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "c6cd3a57-412a-4098-b987-6d1d5c8bd0a0" (UID: "c6cd3a57-412a-4098-b987-6d1d5c8bd0a0"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.552135 5120 reconciler_common.go:299] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/621997b8-90a2-44ff-b1bf-ababd800c8ad-fernet-keys\") on node \"crc\" DevicePath \"\"" Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.552164 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/621997b8-90a2-44ff-b1bf-ababd800c8ad-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.552180 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c6cd3a57-412a-4098-b987-6d1d5c8bd0a0-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.552192 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c6cd3a57-412a-4098-b987-6d1d5c8bd0a0-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.552202 5120 reconciler_common.go:299] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/621997b8-90a2-44ff-b1bf-ababd800c8ad-credential-keys\") on node \"crc\" DevicePath \"\"" Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.552212 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/621997b8-90a2-44ff-b1bf-ababd800c8ad-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.552223 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/621997b8-90a2-44ff-b1bf-ababd800c8ad-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.552233 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pngs5\" (UniqueName: \"kubernetes.io/projected/621997b8-90a2-44ff-b1bf-ababd800c8ad-kube-api-access-pngs5\") on node \"crc\" DevicePath \"\"" Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.556152 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c6cd3a57-412a-4098-b987-6d1d5c8bd0a0-scripts" (OuterVolumeSpecName: "scripts") pod "c6cd3a57-412a-4098-b987-6d1d5c8bd0a0" (UID: "c6cd3a57-412a-4098-b987-6d1d5c8bd0a0"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.556306 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6cd3a57-412a-4098-b987-6d1d5c8bd0a0-kube-api-access-6tzxk" (OuterVolumeSpecName: "kube-api-access-6tzxk") pod "c6cd3a57-412a-4098-b987-6d1d5c8bd0a0" (UID: "c6cd3a57-412a-4098-b987-6d1d5c8bd0a0"). InnerVolumeSpecName "kube-api-access-6tzxk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.589840 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c6cd3a57-412a-4098-b987-6d1d5c8bd0a0-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "c6cd3a57-412a-4098-b987-6d1d5c8bd0a0" (UID: "c6cd3a57-412a-4098-b987-6d1d5c8bd0a0"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.630110 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-pz6fg" Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.630145 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-pz6fg" event={"ID":"09b33b66-f54d-4afc-90f8-da4637e37095","Type":"ContainerDied","Data":"43aef09210434c32b625d67245dafd322315572a1afa5bfb88b78697692af22c"} Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.630617 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="43aef09210434c32b625d67245dafd322315572a1afa5bfb88b78697692af22c" Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.639610 5120 generic.go:358] "Generic (PLEG): container finished" podID="c6cd3a57-412a-4098-b987-6d1d5c8bd0a0" containerID="a019ac2a4b5ecef59c8ba7ba409d49a5917cfdf8278712315998d42a4f62fb76" exitCode=0 Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.639645 5120 generic.go:358] "Generic (PLEG): container finished" podID="c6cd3a57-412a-4098-b987-6d1d5c8bd0a0" containerID="02e927e66ac3d55d9aaf5281740c27272cef59f088799220cfe41f2f5bd98526" exitCode=2 Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.639654 5120 generic.go:358] "Generic (PLEG): container finished" podID="c6cd3a57-412a-4098-b987-6d1d5c8bd0a0" containerID="f827e2e8e8063bfacaed31323b5420a7a9aa3f243429a90a6cf2920786ac434c" exitCode=0 Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.639661 5120 generic.go:358] "Generic (PLEG): container finished" podID="c6cd3a57-412a-4098-b987-6d1d5c8bd0a0" containerID="fdbca843ec08a7c3da6be1ada773833e099b1fac50391c563336b6c7a740d6f3" exitCode=0 Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.640035 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.640126 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"c6cd3a57-412a-4098-b987-6d1d5c8bd0a0","Type":"ContainerDied","Data":"a019ac2a4b5ecef59c8ba7ba409d49a5917cfdf8278712315998d42a4f62fb76"} Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.640190 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"c6cd3a57-412a-4098-b987-6d1d5c8bd0a0","Type":"ContainerDied","Data":"02e927e66ac3d55d9aaf5281740c27272cef59f088799220cfe41f2f5bd98526"} Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.640205 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"c6cd3a57-412a-4098-b987-6d1d5c8bd0a0","Type":"ContainerDied","Data":"f827e2e8e8063bfacaed31323b5420a7a9aa3f243429a90a6cf2920786ac434c"} Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.640218 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"c6cd3a57-412a-4098-b987-6d1d5c8bd0a0","Type":"ContainerDied","Data":"fdbca843ec08a7c3da6be1ada773833e099b1fac50391c563336b6c7a740d6f3"} Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.640231 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"c6cd3a57-412a-4098-b987-6d1d5c8bd0a0","Type":"ContainerDied","Data":"47972dcb6d60209c376029e85bf7a25307dc8c70bc3e83c5158f4b15ed989b97"} Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.640358 5120 scope.go:117] "RemoveContainer" containerID="a019ac2a4b5ecef59c8ba7ba409d49a5917cfdf8278712315998d42a4f62fb76" Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.652691 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-75564c7f5c-29qz4" event={"ID":"232eb98c-2900-4d2b-adfb-5db5139e3934","Type":"ContainerStarted","Data":"5dcb2c18ac15a4b8ab8552c5b0df4836c142f045424681bc2e391592fb369d82"} Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.653120 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-75564c7f5c-29qz4" Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.654182 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c6cd3a57-412a-4098-b987-6d1d5c8bd0a0-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "c6cd3a57-412a-4098-b987-6d1d5c8bd0a0" (UID: "c6cd3a57-412a-4098-b987-6d1d5c8bd0a0"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.654923 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6tzxk\" (UniqueName: \"kubernetes.io/projected/c6cd3a57-412a-4098-b987-6d1d5c8bd0a0-kube-api-access-6tzxk\") on node \"crc\" DevicePath \"\"" Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.671983 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/c6cd3a57-412a-4098-b987-6d1d5c8bd0a0-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.672031 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c6cd3a57-412a-4098-b987-6d1d5c8bd0a0-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.672050 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c6cd3a57-412a-4098-b987-6d1d5c8bd0a0-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.679285 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-tplqm" event={"ID":"621997b8-90a2-44ff-b1bf-ababd800c8ad","Type":"ContainerDied","Data":"8007aef37d1a86fa73bbe91a4a5c55450bee6da3827415c076a91382ff063c53"} Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.679331 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8007aef37d1a86fa73bbe91a4a5c55450bee6da3827415c076a91382ff063c53" Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.679348 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-tplqm" Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.688036 5120 scope.go:117] "RemoveContainer" containerID="02e927e66ac3d55d9aaf5281740c27272cef59f088799220cfe41f2f5bd98526" Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.696310 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-75564c7f5c-29qz4" podStartSLOduration=3.6962243040000002 podStartE2EDuration="3.696224304s" podCreationTimestamp="2026-03-16 16:39:42 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:39:45.679361387 +0000 UTC m=+4087.833293044" watchObservedRunningTime="2026-03-16 16:39:45.696224304 +0000 UTC m=+4087.850155961" Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.705991 5120 status_manager.go:895] "Failed to get status for pod" podUID="621997b8-90a2-44ff-b1bf-ababd800c8ad" pod="openstack-kuttl-tests/keystone-bootstrap-tplqm" err="pods \"keystone-bootstrap-tplqm\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.706683 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c6cd3a57-412a-4098-b987-6d1d5c8bd0a0-config-data" (OuterVolumeSpecName: "config-data") pod "c6cd3a57-412a-4098-b987-6d1d5c8bd0a0" (UID: "c6cd3a57-412a-4098-b987-6d1d5c8bd0a0"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.741632 5120 scope.go:117] "RemoveContainer" containerID="f827e2e8e8063bfacaed31323b5420a7a9aa3f243429a90a6cf2920786ac434c" Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.780608 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c6cd3a57-412a-4098-b987-6d1d5c8bd0a0-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:39:45 crc kubenswrapper[5120]: E0316 16:39:45.795106 5120 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod621997b8_90a2_44ff_b1bf_ababd800c8ad.slice/crio-8007aef37d1a86fa73bbe91a4a5c55450bee6da3827415c076a91382ff063c53\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod09b33b66_f54d_4afc_90f8_da4637e37095.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod09b33b66_f54d_4afc_90f8_da4637e37095.slice/crio-43aef09210434c32b625d67245dafd322315572a1afa5bfb88b78697692af22c\": RecentStats: unable to find data in memory cache]" Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.827824 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-5c5dddf6d4-cftmc"] Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.835800 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-tplqm"] Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.845237 5120 scope.go:117] "RemoveContainer" containerID="fdbca843ec08a7c3da6be1ada773833e099b1fac50391c563336b6c7a740d6f3" Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.873618 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-tplqm"] Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.897752 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-worker-584b4f85f9-ttk4d"] Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.898826 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6cd3a57-412a-4098-b987-6d1d5c8bd0a0" containerName="proxy-httpd" Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.898844 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6cd3a57-412a-4098-b987-6d1d5c8bd0a0" containerName="proxy-httpd" Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.898865 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6cd3a57-412a-4098-b987-6d1d5c8bd0a0" containerName="ceilometer-central-agent" Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.898871 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6cd3a57-412a-4098-b987-6d1d5c8bd0a0" containerName="ceilometer-central-agent" Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.898895 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09b33b66-f54d-4afc-90f8-da4637e37095" containerName="barbican-db-sync" Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.898901 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="09b33b66-f54d-4afc-90f8-da4637e37095" containerName="barbican-db-sync" Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.898929 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6cd3a57-412a-4098-b987-6d1d5c8bd0a0" containerName="ceilometer-notification-agent" Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.898935 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6cd3a57-412a-4098-b987-6d1d5c8bd0a0" containerName="ceilometer-notification-agent" Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.898944 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="621997b8-90a2-44ff-b1bf-ababd800c8ad" containerName="keystone-bootstrap" Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.898949 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="621997b8-90a2-44ff-b1bf-ababd800c8ad" containerName="keystone-bootstrap" Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.898964 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6cd3a57-412a-4098-b987-6d1d5c8bd0a0" containerName="sg-core" Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.898969 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6cd3a57-412a-4098-b987-6d1d5c8bd0a0" containerName="sg-core" Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.899123 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="09b33b66-f54d-4afc-90f8-da4637e37095" containerName="barbican-db-sync" Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.899134 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="621997b8-90a2-44ff-b1bf-ababd800c8ad" containerName="keystone-bootstrap" Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.899142 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c6cd3a57-412a-4098-b987-6d1d5c8bd0a0" containerName="ceilometer-central-agent" Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.899158 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c6cd3a57-412a-4098-b987-6d1d5c8bd0a0" containerName="ceilometer-notification-agent" Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.899168 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c6cd3a57-412a-4098-b987-6d1d5c8bd0a0" containerName="proxy-httpd" Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.899178 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c6cd3a57-412a-4098-b987-6d1d5c8bd0a0" containerName="sg-core" Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.907951 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-584b4f85f9-ttk4d" Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.913089 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-584b4f85f9-ttk4d"] Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.922379 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-barbican-dockercfg-7b5vz\"" Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.922618 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-worker-config-data\"" Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.922981 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-config-data\"" Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.923427 5120 scope.go:117] "RemoveContainer" containerID="a019ac2a4b5ecef59c8ba7ba409d49a5917cfdf8278712315998d42a4f62fb76" Mar 16 16:39:45 crc kubenswrapper[5120]: E0316 16:39:45.924648 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a019ac2a4b5ecef59c8ba7ba409d49a5917cfdf8278712315998d42a4f62fb76\": container with ID starting with a019ac2a4b5ecef59c8ba7ba409d49a5917cfdf8278712315998d42a4f62fb76 not found: ID does not exist" containerID="a019ac2a4b5ecef59c8ba7ba409d49a5917cfdf8278712315998d42a4f62fb76" Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.924683 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a019ac2a4b5ecef59c8ba7ba409d49a5917cfdf8278712315998d42a4f62fb76"} err="failed to get container status \"a019ac2a4b5ecef59c8ba7ba409d49a5917cfdf8278712315998d42a4f62fb76\": rpc error: code = NotFound desc = could not find container \"a019ac2a4b5ecef59c8ba7ba409d49a5917cfdf8278712315998d42a4f62fb76\": container with ID starting with a019ac2a4b5ecef59c8ba7ba409d49a5917cfdf8278712315998d42a4f62fb76 not found: ID does not exist" Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.924707 5120 scope.go:117] "RemoveContainer" containerID="02e927e66ac3d55d9aaf5281740c27272cef59f088799220cfe41f2f5bd98526" Mar 16 16:39:45 crc kubenswrapper[5120]: E0316 16:39:45.925001 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"02e927e66ac3d55d9aaf5281740c27272cef59f088799220cfe41f2f5bd98526\": container with ID starting with 02e927e66ac3d55d9aaf5281740c27272cef59f088799220cfe41f2f5bd98526 not found: ID does not exist" containerID="02e927e66ac3d55d9aaf5281740c27272cef59f088799220cfe41f2f5bd98526" Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.925021 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02e927e66ac3d55d9aaf5281740c27272cef59f088799220cfe41f2f5bd98526"} err="failed to get container status \"02e927e66ac3d55d9aaf5281740c27272cef59f088799220cfe41f2f5bd98526\": rpc error: code = NotFound desc = could not find container \"02e927e66ac3d55d9aaf5281740c27272cef59f088799220cfe41f2f5bd98526\": container with ID starting with 02e927e66ac3d55d9aaf5281740c27272cef59f088799220cfe41f2f5bd98526 not found: ID does not exist" Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.925035 5120 scope.go:117] "RemoveContainer" containerID="f827e2e8e8063bfacaed31323b5420a7a9aa3f243429a90a6cf2920786ac434c" Mar 16 16:39:45 crc kubenswrapper[5120]: E0316 16:39:45.927473 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f827e2e8e8063bfacaed31323b5420a7a9aa3f243429a90a6cf2920786ac434c\": container with ID starting with f827e2e8e8063bfacaed31323b5420a7a9aa3f243429a90a6cf2920786ac434c not found: ID does not exist" containerID="f827e2e8e8063bfacaed31323b5420a7a9aa3f243429a90a6cf2920786ac434c" Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.927500 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f827e2e8e8063bfacaed31323b5420a7a9aa3f243429a90a6cf2920786ac434c"} err="failed to get container status \"f827e2e8e8063bfacaed31323b5420a7a9aa3f243429a90a6cf2920786ac434c\": rpc error: code = NotFound desc = could not find container \"f827e2e8e8063bfacaed31323b5420a7a9aa3f243429a90a6cf2920786ac434c\": container with ID starting with f827e2e8e8063bfacaed31323b5420a7a9aa3f243429a90a6cf2920786ac434c not found: ID does not exist" Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.927516 5120 scope.go:117] "RemoveContainer" containerID="fdbca843ec08a7c3da6be1ada773833e099b1fac50391c563336b6c7a740d6f3" Mar 16 16:39:45 crc kubenswrapper[5120]: E0316 16:39:45.927951 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fdbca843ec08a7c3da6be1ada773833e099b1fac50391c563336b6c7a740d6f3\": container with ID starting with fdbca843ec08a7c3da6be1ada773833e099b1fac50391c563336b6c7a740d6f3 not found: ID does not exist" containerID="fdbca843ec08a7c3da6be1ada773833e099b1fac50391c563336b6c7a740d6f3" Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.927979 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fdbca843ec08a7c3da6be1ada773833e099b1fac50391c563336b6c7a740d6f3"} err="failed to get container status \"fdbca843ec08a7c3da6be1ada773833e099b1fac50391c563336b6c7a740d6f3\": rpc error: code = NotFound desc = could not find container \"fdbca843ec08a7c3da6be1ada773833e099b1fac50391c563336b6c7a740d6f3\": container with ID starting with fdbca843ec08a7c3da6be1ada773833e099b1fac50391c563336b6c7a740d6f3 not found: ID does not exist" Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.927992 5120 scope.go:117] "RemoveContainer" containerID="a019ac2a4b5ecef59c8ba7ba409d49a5917cfdf8278712315998d42a4f62fb76" Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.938039 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a019ac2a4b5ecef59c8ba7ba409d49a5917cfdf8278712315998d42a4f62fb76"} err="failed to get container status \"a019ac2a4b5ecef59c8ba7ba409d49a5917cfdf8278712315998d42a4f62fb76\": rpc error: code = NotFound desc = could not find container \"a019ac2a4b5ecef59c8ba7ba409d49a5917cfdf8278712315998d42a4f62fb76\": container with ID starting with a019ac2a4b5ecef59c8ba7ba409d49a5917cfdf8278712315998d42a4f62fb76 not found: ID does not exist" Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.938094 5120 scope.go:117] "RemoveContainer" containerID="02e927e66ac3d55d9aaf5281740c27272cef59f088799220cfe41f2f5bd98526" Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.939329 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02e927e66ac3d55d9aaf5281740c27272cef59f088799220cfe41f2f5bd98526"} err="failed to get container status \"02e927e66ac3d55d9aaf5281740c27272cef59f088799220cfe41f2f5bd98526\": rpc error: code = NotFound desc = could not find container \"02e927e66ac3d55d9aaf5281740c27272cef59f088799220cfe41f2f5bd98526\": container with ID starting with 02e927e66ac3d55d9aaf5281740c27272cef59f088799220cfe41f2f5bd98526 not found: ID does not exist" Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.939349 5120 scope.go:117] "RemoveContainer" containerID="f827e2e8e8063bfacaed31323b5420a7a9aa3f243429a90a6cf2920786ac434c" Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.939601 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f827e2e8e8063bfacaed31323b5420a7a9aa3f243429a90a6cf2920786ac434c"} err="failed to get container status \"f827e2e8e8063bfacaed31323b5420a7a9aa3f243429a90a6cf2920786ac434c\": rpc error: code = NotFound desc = could not find container \"f827e2e8e8063bfacaed31323b5420a7a9aa3f243429a90a6cf2920786ac434c\": container with ID starting with f827e2e8e8063bfacaed31323b5420a7a9aa3f243429a90a6cf2920786ac434c not found: ID does not exist" Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.939616 5120 scope.go:117] "RemoveContainer" containerID="fdbca843ec08a7c3da6be1ada773833e099b1fac50391c563336b6c7a740d6f3" Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.940216 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fdbca843ec08a7c3da6be1ada773833e099b1fac50391c563336b6c7a740d6f3"} err="failed to get container status \"fdbca843ec08a7c3da6be1ada773833e099b1fac50391c563336b6c7a740d6f3\": rpc error: code = NotFound desc = could not find container \"fdbca843ec08a7c3da6be1ada773833e099b1fac50391c563336b6c7a740d6f3\": container with ID starting with fdbca843ec08a7c3da6be1ada773833e099b1fac50391c563336b6c7a740d6f3 not found: ID does not exist" Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.940252 5120 scope.go:117] "RemoveContainer" containerID="a019ac2a4b5ecef59c8ba7ba409d49a5917cfdf8278712315998d42a4f62fb76" Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.940877 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a019ac2a4b5ecef59c8ba7ba409d49a5917cfdf8278712315998d42a4f62fb76"} err="failed to get container status \"a019ac2a4b5ecef59c8ba7ba409d49a5917cfdf8278712315998d42a4f62fb76\": rpc error: code = NotFound desc = could not find container \"a019ac2a4b5ecef59c8ba7ba409d49a5917cfdf8278712315998d42a4f62fb76\": container with ID starting with a019ac2a4b5ecef59c8ba7ba409d49a5917cfdf8278712315998d42a4f62fb76 not found: ID does not exist" Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.941033 5120 scope.go:117] "RemoveContainer" containerID="02e927e66ac3d55d9aaf5281740c27272cef59f088799220cfe41f2f5bd98526" Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.944471 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02e927e66ac3d55d9aaf5281740c27272cef59f088799220cfe41f2f5bd98526"} err="failed to get container status \"02e927e66ac3d55d9aaf5281740c27272cef59f088799220cfe41f2f5bd98526\": rpc error: code = NotFound desc = could not find container \"02e927e66ac3d55d9aaf5281740c27272cef59f088799220cfe41f2f5bd98526\": container with ID starting with 02e927e66ac3d55d9aaf5281740c27272cef59f088799220cfe41f2f5bd98526 not found: ID does not exist" Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.944528 5120 scope.go:117] "RemoveContainer" containerID="f827e2e8e8063bfacaed31323b5420a7a9aa3f243429a90a6cf2920786ac434c" Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.944633 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-5b488dd8b-2htz9"] Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.945093 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f827e2e8e8063bfacaed31323b5420a7a9aa3f243429a90a6cf2920786ac434c"} err="failed to get container status \"f827e2e8e8063bfacaed31323b5420a7a9aa3f243429a90a6cf2920786ac434c\": rpc error: code = NotFound desc = could not find container \"f827e2e8e8063bfacaed31323b5420a7a9aa3f243429a90a6cf2920786ac434c\": container with ID starting with f827e2e8e8063bfacaed31323b5420a7a9aa3f243429a90a6cf2920786ac434c not found: ID does not exist" Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.945208 5120 scope.go:117] "RemoveContainer" containerID="fdbca843ec08a7c3da6be1ada773833e099b1fac50391c563336b6c7a740d6f3" Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.945612 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fdbca843ec08a7c3da6be1ada773833e099b1fac50391c563336b6c7a740d6f3"} err="failed to get container status \"fdbca843ec08a7c3da6be1ada773833e099b1fac50391c563336b6c7a740d6f3\": rpc error: code = NotFound desc = could not find container \"fdbca843ec08a7c3da6be1ada773833e099b1fac50391c563336b6c7a740d6f3\": container with ID starting with fdbca843ec08a7c3da6be1ada773833e099b1fac50391c563336b6c7a740d6f3 not found: ID does not exist" Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.945732 5120 scope.go:117] "RemoveContainer" containerID="a019ac2a4b5ecef59c8ba7ba409d49a5917cfdf8278712315998d42a4f62fb76" Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.946393 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a019ac2a4b5ecef59c8ba7ba409d49a5917cfdf8278712315998d42a4f62fb76"} err="failed to get container status \"a019ac2a4b5ecef59c8ba7ba409d49a5917cfdf8278712315998d42a4f62fb76\": rpc error: code = NotFound desc = could not find container \"a019ac2a4b5ecef59c8ba7ba409d49a5917cfdf8278712315998d42a4f62fb76\": container with ID starting with a019ac2a4b5ecef59c8ba7ba409d49a5917cfdf8278712315998d42a4f62fb76 not found: ID does not exist" Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.946443 5120 scope.go:117] "RemoveContainer" containerID="02e927e66ac3d55d9aaf5281740c27272cef59f088799220cfe41f2f5bd98526" Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.946735 5120 status_manager.go:895] "Failed to get status for pod" podUID="621997b8-90a2-44ff-b1bf-ababd800c8ad" pod="openstack-kuttl-tests/keystone-bootstrap-tplqm" err="pods \"keystone-bootstrap-tplqm\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.946836 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02e927e66ac3d55d9aaf5281740c27272cef59f088799220cfe41f2f5bd98526"} err="failed to get container status \"02e927e66ac3d55d9aaf5281740c27272cef59f088799220cfe41f2f5bd98526\": rpc error: code = NotFound desc = could not find container \"02e927e66ac3d55d9aaf5281740c27272cef59f088799220cfe41f2f5bd98526\": container with ID starting with 02e927e66ac3d55d9aaf5281740c27272cef59f088799220cfe41f2f5bd98526 not found: ID does not exist" Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.946857 5120 scope.go:117] "RemoveContainer" containerID="f827e2e8e8063bfacaed31323b5420a7a9aa3f243429a90a6cf2920786ac434c" Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.951026 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f827e2e8e8063bfacaed31323b5420a7a9aa3f243429a90a6cf2920786ac434c"} err="failed to get container status \"f827e2e8e8063bfacaed31323b5420a7a9aa3f243429a90a6cf2920786ac434c\": rpc error: code = NotFound desc = could not find container \"f827e2e8e8063bfacaed31323b5420a7a9aa3f243429a90a6cf2920786ac434c\": container with ID starting with f827e2e8e8063bfacaed31323b5420a7a9aa3f243429a90a6cf2920786ac434c not found: ID does not exist" Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.951079 5120 scope.go:117] "RemoveContainer" containerID="fdbca843ec08a7c3da6be1ada773833e099b1fac50391c563336b6c7a740d6f3" Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.956416 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fdbca843ec08a7c3da6be1ada773833e099b1fac50391c563336b6c7a740d6f3"} err="failed to get container status \"fdbca843ec08a7c3da6be1ada773833e099b1fac50391c563336b6c7a740d6f3\": rpc error: code = NotFound desc = could not find container \"fdbca843ec08a7c3da6be1ada773833e099b1fac50391c563336b6c7a740d6f3\": container with ID starting with fdbca843ec08a7c3da6be1ada773833e099b1fac50391c563336b6c7a740d6f3 not found: ID does not exist" Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.958089 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-5b488dd8b-2htz9" Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.960294 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-keystone-listener-config-data\"" Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.972595 5120 status_manager.go:895] "Failed to get status for pod" podUID="621997b8-90a2-44ff-b1bf-ababd800c8ad" pod="openstack-kuttl-tests/keystone-bootstrap-tplqm" err="pods \"keystone-bootstrap-tplqm\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.978485 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-p2zn5"] Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.984341 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-p2zn5" Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.987585 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone\"" Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.988131 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-keystone-dockercfg-mgwjt\"" Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.988255 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"osp-secret\"" Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.988546 5120 status_manager.go:895] "Failed to get status for pod" podUID="621997b8-90a2-44ff-b1bf-ababd800c8ad" pod="openstack-kuttl-tests/keystone-bootstrap-tplqm" err="pods \"keystone-bootstrap-tplqm\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.988680 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-config-data\"" Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.988816 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-scripts\"" Mar 16 16:39:45 crc kubenswrapper[5120]: I0316 16:39:45.993947 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-5b488dd8b-2htz9"] Mar 16 16:39:46 crc kubenswrapper[5120]: I0316 16:39:46.011068 5120 status_manager.go:895] "Failed to get status for pod" podUID="621997b8-90a2-44ff-b1bf-ababd800c8ad" pod="openstack-kuttl-tests/keystone-bootstrap-tplqm" err="pods \"keystone-bootstrap-tplqm\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 16:39:46 crc kubenswrapper[5120]: I0316 16:39:46.012518 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/84416c7c-79e8-4adb-803f-39ac90a5d695-config-data-custom\") pod \"barbican-worker-584b4f85f9-ttk4d\" (UID: \"84416c7c-79e8-4adb-803f-39ac90a5d695\") " pod="openstack-kuttl-tests/barbican-worker-584b4f85f9-ttk4d" Mar 16 16:39:46 crc kubenswrapper[5120]: I0316 16:39:46.012980 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/84416c7c-79e8-4adb-803f-39ac90a5d695-config-data\") pod \"barbican-worker-584b4f85f9-ttk4d\" (UID: \"84416c7c-79e8-4adb-803f-39ac90a5d695\") " pod="openstack-kuttl-tests/barbican-worker-584b4f85f9-ttk4d" Mar 16 16:39:46 crc kubenswrapper[5120]: I0316 16:39:46.013044 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/84416c7c-79e8-4adb-803f-39ac90a5d695-combined-ca-bundle\") pod \"barbican-worker-584b4f85f9-ttk4d\" (UID: \"84416c7c-79e8-4adb-803f-39ac90a5d695\") " pod="openstack-kuttl-tests/barbican-worker-584b4f85f9-ttk4d" Mar 16 16:39:46 crc kubenswrapper[5120]: I0316 16:39:46.013133 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-456rg\" (UniqueName: \"kubernetes.io/projected/84416c7c-79e8-4adb-803f-39ac90a5d695-kube-api-access-456rg\") pod \"barbican-worker-584b4f85f9-ttk4d\" (UID: \"84416c7c-79e8-4adb-803f-39ac90a5d695\") " pod="openstack-kuttl-tests/barbican-worker-584b4f85f9-ttk4d" Mar 16 16:39:46 crc kubenswrapper[5120]: I0316 16:39:46.013171 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/84416c7c-79e8-4adb-803f-39ac90a5d695-logs\") pod \"barbican-worker-584b4f85f9-ttk4d\" (UID: \"84416c7c-79e8-4adb-803f-39ac90a5d695\") " pod="openstack-kuttl-tests/barbican-worker-584b4f85f9-ttk4d" Mar 16 16:39:46 crc kubenswrapper[5120]: I0316 16:39:46.019043 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-p2zn5"] Mar 16 16:39:46 crc kubenswrapper[5120]: I0316 16:39:46.034119 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-api-5fbdc8fdc6-mzpw2"] Mar 16 16:39:46 crc kubenswrapper[5120]: I0316 16:39:46.053289 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-5fbdc8fdc6-mzpw2"] Mar 16 16:39:46 crc kubenswrapper[5120]: I0316 16:39:46.054054 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-5fbdc8fdc6-mzpw2" Mar 16 16:39:46 crc kubenswrapper[5120]: I0316 16:39:46.056049 5120 status_manager.go:895] "Failed to get status for pod" podUID="621997b8-90a2-44ff-b1bf-ababd800c8ad" pod="openstack-kuttl-tests/keystone-bootstrap-tplqm" err="pods \"keystone-bootstrap-tplqm\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 16:39:46 crc kubenswrapper[5120]: I0316 16:39:46.067036 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-api-config-data\"" Mar 16 16:39:46 crc kubenswrapper[5120]: I0316 16:39:46.098561 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:39:46 crc kubenswrapper[5120]: I0316 16:39:46.107187 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:39:46 crc kubenswrapper[5120]: I0316 16:39:46.115471 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/84416c7c-79e8-4adb-803f-39ac90a5d695-config-data-custom\") pod \"barbican-worker-584b4f85f9-ttk4d\" (UID: \"84416c7c-79e8-4adb-803f-39ac90a5d695\") " pod="openstack-kuttl-tests/barbican-worker-584b4f85f9-ttk4d" Mar 16 16:39:46 crc kubenswrapper[5120]: I0316 16:39:46.115520 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/99e73376-04fb-4c3c-932a-115a4dd47186-config-data\") pod \"keystone-bootstrap-p2zn5\" (UID: \"99e73376-04fb-4c3c-932a-115a4dd47186\") " pod="openstack-kuttl-tests/keystone-bootstrap-p2zn5" Mar 16 16:39:46 crc kubenswrapper[5120]: I0316 16:39:46.115556 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/fafcfc0e-412f-4c5b-bba6-87910b9f4282-logs\") pod \"barbican-keystone-listener-5b488dd8b-2htz9\" (UID: \"fafcfc0e-412f-4c5b-bba6-87910b9f4282\") " pod="openstack-kuttl-tests/barbican-keystone-listener-5b488dd8b-2htz9" Mar 16 16:39:46 crc kubenswrapper[5120]: I0316 16:39:46.115573 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fafcfc0e-412f-4c5b-bba6-87910b9f4282-combined-ca-bundle\") pod \"barbican-keystone-listener-5b488dd8b-2htz9\" (UID: \"fafcfc0e-412f-4c5b-bba6-87910b9f4282\") " pod="openstack-kuttl-tests/barbican-keystone-listener-5b488dd8b-2htz9" Mar 16 16:39:46 crc kubenswrapper[5120]: I0316 16:39:46.115611 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/fafcfc0e-412f-4c5b-bba6-87910b9f4282-config-data-custom\") pod \"barbican-keystone-listener-5b488dd8b-2htz9\" (UID: \"fafcfc0e-412f-4c5b-bba6-87910b9f4282\") " pod="openstack-kuttl-tests/barbican-keystone-listener-5b488dd8b-2htz9" Mar 16 16:39:46 crc kubenswrapper[5120]: I0316 16:39:46.115656 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/3d3aa68e-3e71-4a4c-98b3-a270eafdb9b4-config-data-custom\") pod \"barbican-api-5fbdc8fdc6-mzpw2\" (UID: \"3d3aa68e-3e71-4a4c-98b3-a270eafdb9b4\") " pod="openstack-kuttl-tests/barbican-api-5fbdc8fdc6-mzpw2" Mar 16 16:39:46 crc kubenswrapper[5120]: I0316 16:39:46.115688 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/99e73376-04fb-4c3c-932a-115a4dd47186-combined-ca-bundle\") pod \"keystone-bootstrap-p2zn5\" (UID: \"99e73376-04fb-4c3c-932a-115a4dd47186\") " pod="openstack-kuttl-tests/keystone-bootstrap-p2zn5" Mar 16 16:39:46 crc kubenswrapper[5120]: I0316 16:39:46.115712 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3d3aa68e-3e71-4a4c-98b3-a270eafdb9b4-config-data\") pod \"barbican-api-5fbdc8fdc6-mzpw2\" (UID: \"3d3aa68e-3e71-4a4c-98b3-a270eafdb9b4\") " pod="openstack-kuttl-tests/barbican-api-5fbdc8fdc6-mzpw2" Mar 16 16:39:46 crc kubenswrapper[5120]: I0316 16:39:46.115733 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/99e73376-04fb-4c3c-932a-115a4dd47186-fernet-keys\") pod \"keystone-bootstrap-p2zn5\" (UID: \"99e73376-04fb-4c3c-932a-115a4dd47186\") " pod="openstack-kuttl-tests/keystone-bootstrap-p2zn5" Mar 16 16:39:46 crc kubenswrapper[5120]: I0316 16:39:46.115849 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/99e73376-04fb-4c3c-932a-115a4dd47186-scripts\") pod \"keystone-bootstrap-p2zn5\" (UID: \"99e73376-04fb-4c3c-932a-115a4dd47186\") " pod="openstack-kuttl-tests/keystone-bootstrap-p2zn5" Mar 16 16:39:46 crc kubenswrapper[5120]: I0316 16:39:46.115923 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r89ps\" (UniqueName: \"kubernetes.io/projected/fafcfc0e-412f-4c5b-bba6-87910b9f4282-kube-api-access-r89ps\") pod \"barbican-keystone-listener-5b488dd8b-2htz9\" (UID: \"fafcfc0e-412f-4c5b-bba6-87910b9f4282\") " pod="openstack-kuttl-tests/barbican-keystone-listener-5b488dd8b-2htz9" Mar 16 16:39:46 crc kubenswrapper[5120]: I0316 16:39:46.115946 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/99e73376-04fb-4c3c-932a-115a4dd47186-credential-keys\") pod \"keystone-bootstrap-p2zn5\" (UID: \"99e73376-04fb-4c3c-932a-115a4dd47186\") " pod="openstack-kuttl-tests/keystone-bootstrap-p2zn5" Mar 16 16:39:46 crc kubenswrapper[5120]: I0316 16:39:46.115974 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3d3aa68e-3e71-4a4c-98b3-a270eafdb9b4-logs\") pod \"barbican-api-5fbdc8fdc6-mzpw2\" (UID: \"3d3aa68e-3e71-4a4c-98b3-a270eafdb9b4\") " pod="openstack-kuttl-tests/barbican-api-5fbdc8fdc6-mzpw2" Mar 16 16:39:46 crc kubenswrapper[5120]: I0316 16:39:46.116016 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3d3aa68e-3e71-4a4c-98b3-a270eafdb9b4-combined-ca-bundle\") pod \"barbican-api-5fbdc8fdc6-mzpw2\" (UID: \"3d3aa68e-3e71-4a4c-98b3-a270eafdb9b4\") " pod="openstack-kuttl-tests/barbican-api-5fbdc8fdc6-mzpw2" Mar 16 16:39:46 crc kubenswrapper[5120]: I0316 16:39:46.116063 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/84416c7c-79e8-4adb-803f-39ac90a5d695-config-data\") pod \"barbican-worker-584b4f85f9-ttk4d\" (UID: \"84416c7c-79e8-4adb-803f-39ac90a5d695\") " pod="openstack-kuttl-tests/barbican-worker-584b4f85f9-ttk4d" Mar 16 16:39:46 crc kubenswrapper[5120]: I0316 16:39:46.116100 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/84416c7c-79e8-4adb-803f-39ac90a5d695-combined-ca-bundle\") pod \"barbican-worker-584b4f85f9-ttk4d\" (UID: \"84416c7c-79e8-4adb-803f-39ac90a5d695\") " pod="openstack-kuttl-tests/barbican-worker-584b4f85f9-ttk4d" Mar 16 16:39:46 crc kubenswrapper[5120]: I0316 16:39:46.116169 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-456rg\" (UniqueName: \"kubernetes.io/projected/84416c7c-79e8-4adb-803f-39ac90a5d695-kube-api-access-456rg\") pod \"barbican-worker-584b4f85f9-ttk4d\" (UID: \"84416c7c-79e8-4adb-803f-39ac90a5d695\") " pod="openstack-kuttl-tests/barbican-worker-584b4f85f9-ttk4d" Mar 16 16:39:46 crc kubenswrapper[5120]: I0316 16:39:46.116210 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/84416c7c-79e8-4adb-803f-39ac90a5d695-logs\") pod \"barbican-worker-584b4f85f9-ttk4d\" (UID: \"84416c7c-79e8-4adb-803f-39ac90a5d695\") " pod="openstack-kuttl-tests/barbican-worker-584b4f85f9-ttk4d" Mar 16 16:39:46 crc kubenswrapper[5120]: I0316 16:39:46.116236 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fafcfc0e-412f-4c5b-bba6-87910b9f4282-config-data\") pod \"barbican-keystone-listener-5b488dd8b-2htz9\" (UID: \"fafcfc0e-412f-4c5b-bba6-87910b9f4282\") " pod="openstack-kuttl-tests/barbican-keystone-listener-5b488dd8b-2htz9" Mar 16 16:39:46 crc kubenswrapper[5120]: I0316 16:39:46.116292 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrzt8\" (UniqueName: \"kubernetes.io/projected/99e73376-04fb-4c3c-932a-115a4dd47186-kube-api-access-rrzt8\") pod \"keystone-bootstrap-p2zn5\" (UID: \"99e73376-04fb-4c3c-932a-115a4dd47186\") " pod="openstack-kuttl-tests/keystone-bootstrap-p2zn5" Mar 16 16:39:46 crc kubenswrapper[5120]: I0316 16:39:46.116351 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4sgpq\" (UniqueName: \"kubernetes.io/projected/3d3aa68e-3e71-4a4c-98b3-a270eafdb9b4-kube-api-access-4sgpq\") pod \"barbican-api-5fbdc8fdc6-mzpw2\" (UID: \"3d3aa68e-3e71-4a4c-98b3-a270eafdb9b4\") " pod="openstack-kuttl-tests/barbican-api-5fbdc8fdc6-mzpw2" Mar 16 16:39:46 crc kubenswrapper[5120]: I0316 16:39:46.119527 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:39:46 crc kubenswrapper[5120]: I0316 16:39:46.119605 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/84416c7c-79e8-4adb-803f-39ac90a5d695-logs\") pod \"barbican-worker-584b4f85f9-ttk4d\" (UID: \"84416c7c-79e8-4adb-803f-39ac90a5d695\") " pod="openstack-kuttl-tests/barbican-worker-584b4f85f9-ttk4d" Mar 16 16:39:46 crc kubenswrapper[5120]: I0316 16:39:46.120889 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/84416c7c-79e8-4adb-803f-39ac90a5d695-config-data-custom\") pod \"barbican-worker-584b4f85f9-ttk4d\" (UID: \"84416c7c-79e8-4adb-803f-39ac90a5d695\") " pod="openstack-kuttl-tests/barbican-worker-584b4f85f9-ttk4d" Mar 16 16:39:46 crc kubenswrapper[5120]: I0316 16:39:46.122980 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/84416c7c-79e8-4adb-803f-39ac90a5d695-combined-ca-bundle\") pod \"barbican-worker-584b4f85f9-ttk4d\" (UID: \"84416c7c-79e8-4adb-803f-39ac90a5d695\") " pod="openstack-kuttl-tests/barbican-worker-584b4f85f9-ttk4d" Mar 16 16:39:46 crc kubenswrapper[5120]: I0316 16:39:46.125432 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:39:46 crc kubenswrapper[5120]: I0316 16:39:46.127708 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 16:39:46 crc kubenswrapper[5120]: I0316 16:39:46.128924 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 16:39:46 crc kubenswrapper[5120]: I0316 16:39:46.131041 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/84416c7c-79e8-4adb-803f-39ac90a5d695-config-data\") pod \"barbican-worker-584b4f85f9-ttk4d\" (UID: \"84416c7c-79e8-4adb-803f-39ac90a5d695\") " pod="openstack-kuttl-tests/barbican-worker-584b4f85f9-ttk4d" Mar 16 16:39:46 crc kubenswrapper[5120]: I0316 16:39:46.138169 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-456rg\" (UniqueName: \"kubernetes.io/projected/84416c7c-79e8-4adb-803f-39ac90a5d695-kube-api-access-456rg\") pod \"barbican-worker-584b4f85f9-ttk4d\" (UID: \"84416c7c-79e8-4adb-803f-39ac90a5d695\") " pod="openstack-kuttl-tests/barbican-worker-584b4f85f9-ttk4d" Mar 16 16:39:46 crc kubenswrapper[5120]: I0316 16:39:46.150548 5120 status_manager.go:895] "Failed to get status for pod" podUID="621997b8-90a2-44ff-b1bf-ababd800c8ad" pod="openstack-kuttl-tests/keystone-bootstrap-tplqm" err="pods \"keystone-bootstrap-tplqm\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 16:39:46 crc kubenswrapper[5120]: I0316 16:39:46.169845 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:39:46 crc kubenswrapper[5120]: I0316 16:39:46.217966 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dbe84e5b-abdf-4300-a41e-26507a638f6e-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"dbe84e5b-abdf-4300-a41e-26507a638f6e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:39:46 crc kubenswrapper[5120]: I0316 16:39:46.218144 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/dbe84e5b-abdf-4300-a41e-26507a638f6e-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"dbe84e5b-abdf-4300-a41e-26507a638f6e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:39:46 crc kubenswrapper[5120]: I0316 16:39:46.218563 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rrzt8\" (UniqueName: \"kubernetes.io/projected/99e73376-04fb-4c3c-932a-115a4dd47186-kube-api-access-rrzt8\") pod \"keystone-bootstrap-p2zn5\" (UID: \"99e73376-04fb-4c3c-932a-115a4dd47186\") " pod="openstack-kuttl-tests/keystone-bootstrap-p2zn5" Mar 16 16:39:46 crc kubenswrapper[5120]: I0316 16:39:46.218736 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4sgpq\" (UniqueName: \"kubernetes.io/projected/3d3aa68e-3e71-4a4c-98b3-a270eafdb9b4-kube-api-access-4sgpq\") pod \"barbican-api-5fbdc8fdc6-mzpw2\" (UID: \"3d3aa68e-3e71-4a4c-98b3-a270eafdb9b4\") " pod="openstack-kuttl-tests/barbican-api-5fbdc8fdc6-mzpw2" Mar 16 16:39:46 crc kubenswrapper[5120]: I0316 16:39:46.218941 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/99e73376-04fb-4c3c-932a-115a4dd47186-config-data\") pod \"keystone-bootstrap-p2zn5\" (UID: \"99e73376-04fb-4c3c-932a-115a4dd47186\") " pod="openstack-kuttl-tests/keystone-bootstrap-p2zn5" Mar 16 16:39:46 crc kubenswrapper[5120]: I0316 16:39:46.219089 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/fafcfc0e-412f-4c5b-bba6-87910b9f4282-logs\") pod \"barbican-keystone-listener-5b488dd8b-2htz9\" (UID: \"fafcfc0e-412f-4c5b-bba6-87910b9f4282\") " pod="openstack-kuttl-tests/barbican-keystone-listener-5b488dd8b-2htz9" Mar 16 16:39:46 crc kubenswrapper[5120]: I0316 16:39:46.219186 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fafcfc0e-412f-4c5b-bba6-87910b9f4282-combined-ca-bundle\") pod \"barbican-keystone-listener-5b488dd8b-2htz9\" (UID: \"fafcfc0e-412f-4c5b-bba6-87910b9f4282\") " pod="openstack-kuttl-tests/barbican-keystone-listener-5b488dd8b-2htz9" Mar 16 16:39:46 crc kubenswrapper[5120]: I0316 16:39:46.219293 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/fafcfc0e-412f-4c5b-bba6-87910b9f4282-config-data-custom\") pod \"barbican-keystone-listener-5b488dd8b-2htz9\" (UID: \"fafcfc0e-412f-4c5b-bba6-87910b9f4282\") " pod="openstack-kuttl-tests/barbican-keystone-listener-5b488dd8b-2htz9" Mar 16 16:39:46 crc kubenswrapper[5120]: I0316 16:39:46.219411 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/3d3aa68e-3e71-4a4c-98b3-a270eafdb9b4-config-data-custom\") pod \"barbican-api-5fbdc8fdc6-mzpw2\" (UID: \"3d3aa68e-3e71-4a4c-98b3-a270eafdb9b4\") " pod="openstack-kuttl-tests/barbican-api-5fbdc8fdc6-mzpw2" Mar 16 16:39:46 crc kubenswrapper[5120]: I0316 16:39:46.219592 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/99e73376-04fb-4c3c-932a-115a4dd47186-combined-ca-bundle\") pod \"keystone-bootstrap-p2zn5\" (UID: \"99e73376-04fb-4c3c-932a-115a4dd47186\") " pod="openstack-kuttl-tests/keystone-bootstrap-p2zn5" Mar 16 16:39:46 crc kubenswrapper[5120]: I0316 16:39:46.220741 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3d3aa68e-3e71-4a4c-98b3-a270eafdb9b4-config-data\") pod \"barbican-api-5fbdc8fdc6-mzpw2\" (UID: \"3d3aa68e-3e71-4a4c-98b3-a270eafdb9b4\") " pod="openstack-kuttl-tests/barbican-api-5fbdc8fdc6-mzpw2" Mar 16 16:39:46 crc kubenswrapper[5120]: I0316 16:39:46.220903 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/99e73376-04fb-4c3c-932a-115a4dd47186-fernet-keys\") pod \"keystone-bootstrap-p2zn5\" (UID: \"99e73376-04fb-4c3c-932a-115a4dd47186\") " pod="openstack-kuttl-tests/keystone-bootstrap-p2zn5" Mar 16 16:39:46 crc kubenswrapper[5120]: I0316 16:39:46.221043 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/99e73376-04fb-4c3c-932a-115a4dd47186-scripts\") pod \"keystone-bootstrap-p2zn5\" (UID: \"99e73376-04fb-4c3c-932a-115a4dd47186\") " pod="openstack-kuttl-tests/keystone-bootstrap-p2zn5" Mar 16 16:39:46 crc kubenswrapper[5120]: I0316 16:39:46.221202 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/dbe84e5b-abdf-4300-a41e-26507a638f6e-run-httpd\") pod \"ceilometer-0\" (UID: \"dbe84e5b-abdf-4300-a41e-26507a638f6e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:39:46 crc kubenswrapper[5120]: I0316 16:39:46.221321 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/dbe84e5b-abdf-4300-a41e-26507a638f6e-scripts\") pod \"ceilometer-0\" (UID: \"dbe84e5b-abdf-4300-a41e-26507a638f6e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:39:46 crc kubenswrapper[5120]: I0316 16:39:46.219696 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/fafcfc0e-412f-4c5b-bba6-87910b9f4282-logs\") pod \"barbican-keystone-listener-5b488dd8b-2htz9\" (UID: \"fafcfc0e-412f-4c5b-bba6-87910b9f4282\") " pod="openstack-kuttl-tests/barbican-keystone-listener-5b488dd8b-2htz9" Mar 16 16:39:46 crc kubenswrapper[5120]: I0316 16:39:46.222295 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r89ps\" (UniqueName: \"kubernetes.io/projected/fafcfc0e-412f-4c5b-bba6-87910b9f4282-kube-api-access-r89ps\") pod \"barbican-keystone-listener-5b488dd8b-2htz9\" (UID: \"fafcfc0e-412f-4c5b-bba6-87910b9f4282\") " pod="openstack-kuttl-tests/barbican-keystone-listener-5b488dd8b-2htz9" Mar 16 16:39:46 crc kubenswrapper[5120]: I0316 16:39:46.222427 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/99e73376-04fb-4c3c-932a-115a4dd47186-credential-keys\") pod \"keystone-bootstrap-p2zn5\" (UID: \"99e73376-04fb-4c3c-932a-115a4dd47186\") " pod="openstack-kuttl-tests/keystone-bootstrap-p2zn5" Mar 16 16:39:46 crc kubenswrapper[5120]: I0316 16:39:46.222547 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dbe84e5b-abdf-4300-a41e-26507a638f6e-config-data\") pod \"ceilometer-0\" (UID: \"dbe84e5b-abdf-4300-a41e-26507a638f6e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:39:46 crc kubenswrapper[5120]: I0316 16:39:46.222780 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3d3aa68e-3e71-4a4c-98b3-a270eafdb9b4-logs\") pod \"barbican-api-5fbdc8fdc6-mzpw2\" (UID: \"3d3aa68e-3e71-4a4c-98b3-a270eafdb9b4\") " pod="openstack-kuttl-tests/barbican-api-5fbdc8fdc6-mzpw2" Mar 16 16:39:46 crc kubenswrapper[5120]: I0316 16:39:46.222917 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3d3aa68e-3e71-4a4c-98b3-a270eafdb9b4-combined-ca-bundle\") pod \"barbican-api-5fbdc8fdc6-mzpw2\" (UID: \"3d3aa68e-3e71-4a4c-98b3-a270eafdb9b4\") " pod="openstack-kuttl-tests/barbican-api-5fbdc8fdc6-mzpw2" Mar 16 16:39:46 crc kubenswrapper[5120]: I0316 16:39:46.223101 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/dbe84e5b-abdf-4300-a41e-26507a638f6e-log-httpd\") pod \"ceilometer-0\" (UID: \"dbe84e5b-abdf-4300-a41e-26507a638f6e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:39:46 crc kubenswrapper[5120]: I0316 16:39:46.223251 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fafcfc0e-412f-4c5b-bba6-87910b9f4282-config-data\") pod \"barbican-keystone-listener-5b488dd8b-2htz9\" (UID: \"fafcfc0e-412f-4c5b-bba6-87910b9f4282\") " pod="openstack-kuttl-tests/barbican-keystone-listener-5b488dd8b-2htz9" Mar 16 16:39:46 crc kubenswrapper[5120]: I0316 16:39:46.226712 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k94gv\" (UniqueName: \"kubernetes.io/projected/dbe84e5b-abdf-4300-a41e-26507a638f6e-kube-api-access-k94gv\") pod \"ceilometer-0\" (UID: \"dbe84e5b-abdf-4300-a41e-26507a638f6e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:39:46 crc kubenswrapper[5120]: I0316 16:39:46.222689 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fafcfc0e-412f-4c5b-bba6-87910b9f4282-combined-ca-bundle\") pod \"barbican-keystone-listener-5b488dd8b-2htz9\" (UID: \"fafcfc0e-412f-4c5b-bba6-87910b9f4282\") " pod="openstack-kuttl-tests/barbican-keystone-listener-5b488dd8b-2htz9" Mar 16 16:39:46 crc kubenswrapper[5120]: I0316 16:39:46.225277 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/99e73376-04fb-4c3c-932a-115a4dd47186-combined-ca-bundle\") pod \"keystone-bootstrap-p2zn5\" (UID: \"99e73376-04fb-4c3c-932a-115a4dd47186\") " pod="openstack-kuttl-tests/keystone-bootstrap-p2zn5" Mar 16 16:39:46 crc kubenswrapper[5120]: I0316 16:39:46.223559 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3d3aa68e-3e71-4a4c-98b3-a270eafdb9b4-logs\") pod \"barbican-api-5fbdc8fdc6-mzpw2\" (UID: \"3d3aa68e-3e71-4a4c-98b3-a270eafdb9b4\") " pod="openstack-kuttl-tests/barbican-api-5fbdc8fdc6-mzpw2" Mar 16 16:39:46 crc kubenswrapper[5120]: I0316 16:39:46.228453 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/99e73376-04fb-4c3c-932a-115a4dd47186-config-data\") pod \"keystone-bootstrap-p2zn5\" (UID: \"99e73376-04fb-4c3c-932a-115a4dd47186\") " pod="openstack-kuttl-tests/keystone-bootstrap-p2zn5" Mar 16 16:39:46 crc kubenswrapper[5120]: I0316 16:39:46.229319 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fafcfc0e-412f-4c5b-bba6-87910b9f4282-config-data\") pod \"barbican-keystone-listener-5b488dd8b-2htz9\" (UID: \"fafcfc0e-412f-4c5b-bba6-87910b9f4282\") " pod="openstack-kuttl-tests/barbican-keystone-listener-5b488dd8b-2htz9" Mar 16 16:39:46 crc kubenswrapper[5120]: I0316 16:39:46.233123 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/3d3aa68e-3e71-4a4c-98b3-a270eafdb9b4-config-data-custom\") pod \"barbican-api-5fbdc8fdc6-mzpw2\" (UID: \"3d3aa68e-3e71-4a4c-98b3-a270eafdb9b4\") " pod="openstack-kuttl-tests/barbican-api-5fbdc8fdc6-mzpw2" Mar 16 16:39:46 crc kubenswrapper[5120]: I0316 16:39:46.234113 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/99e73376-04fb-4c3c-932a-115a4dd47186-scripts\") pod \"keystone-bootstrap-p2zn5\" (UID: \"99e73376-04fb-4c3c-932a-115a4dd47186\") " pod="openstack-kuttl-tests/keystone-bootstrap-p2zn5" Mar 16 16:39:46 crc kubenswrapper[5120]: I0316 16:39:46.234183 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/99e73376-04fb-4c3c-932a-115a4dd47186-credential-keys\") pod \"keystone-bootstrap-p2zn5\" (UID: \"99e73376-04fb-4c3c-932a-115a4dd47186\") " pod="openstack-kuttl-tests/keystone-bootstrap-p2zn5" Mar 16 16:39:46 crc kubenswrapper[5120]: I0316 16:39:46.234585 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/99e73376-04fb-4c3c-932a-115a4dd47186-fernet-keys\") pod \"keystone-bootstrap-p2zn5\" (UID: \"99e73376-04fb-4c3c-932a-115a4dd47186\") " pod="openstack-kuttl-tests/keystone-bootstrap-p2zn5" Mar 16 16:39:46 crc kubenswrapper[5120]: I0316 16:39:46.234732 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/fafcfc0e-412f-4c5b-bba6-87910b9f4282-config-data-custom\") pod \"barbican-keystone-listener-5b488dd8b-2htz9\" (UID: \"fafcfc0e-412f-4c5b-bba6-87910b9f4282\") " pod="openstack-kuttl-tests/barbican-keystone-listener-5b488dd8b-2htz9" Mar 16 16:39:46 crc kubenswrapper[5120]: I0316 16:39:46.235130 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3d3aa68e-3e71-4a4c-98b3-a270eafdb9b4-config-data\") pod \"barbican-api-5fbdc8fdc6-mzpw2\" (UID: \"3d3aa68e-3e71-4a4c-98b3-a270eafdb9b4\") " pod="openstack-kuttl-tests/barbican-api-5fbdc8fdc6-mzpw2" Mar 16 16:39:46 crc kubenswrapper[5120]: I0316 16:39:46.236152 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrzt8\" (UniqueName: \"kubernetes.io/projected/99e73376-04fb-4c3c-932a-115a4dd47186-kube-api-access-rrzt8\") pod \"keystone-bootstrap-p2zn5\" (UID: \"99e73376-04fb-4c3c-932a-115a4dd47186\") " pod="openstack-kuttl-tests/keystone-bootstrap-p2zn5" Mar 16 16:39:46 crc kubenswrapper[5120]: I0316 16:39:46.237888 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3d3aa68e-3e71-4a4c-98b3-a270eafdb9b4-combined-ca-bundle\") pod \"barbican-api-5fbdc8fdc6-mzpw2\" (UID: \"3d3aa68e-3e71-4a4c-98b3-a270eafdb9b4\") " pod="openstack-kuttl-tests/barbican-api-5fbdc8fdc6-mzpw2" Mar 16 16:39:46 crc kubenswrapper[5120]: I0316 16:39:46.240347 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4sgpq\" (UniqueName: \"kubernetes.io/projected/3d3aa68e-3e71-4a4c-98b3-a270eafdb9b4-kube-api-access-4sgpq\") pod \"barbican-api-5fbdc8fdc6-mzpw2\" (UID: \"3d3aa68e-3e71-4a4c-98b3-a270eafdb9b4\") " pod="openstack-kuttl-tests/barbican-api-5fbdc8fdc6-mzpw2" Mar 16 16:39:46 crc kubenswrapper[5120]: I0316 16:39:46.241833 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r89ps\" (UniqueName: \"kubernetes.io/projected/fafcfc0e-412f-4c5b-bba6-87910b9f4282-kube-api-access-r89ps\") pod \"barbican-keystone-listener-5b488dd8b-2htz9\" (UID: \"fafcfc0e-412f-4c5b-bba6-87910b9f4282\") " pod="openstack-kuttl-tests/barbican-keystone-listener-5b488dd8b-2htz9" Mar 16 16:39:46 crc kubenswrapper[5120]: I0316 16:39:46.244841 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-584b4f85f9-ttk4d" Mar 16 16:39:46 crc kubenswrapper[5120]: I0316 16:39:46.307282 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-5b488dd8b-2htz9" Mar 16 16:39:46 crc kubenswrapper[5120]: I0316 16:39:46.329309 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/dbe84e5b-abdf-4300-a41e-26507a638f6e-log-httpd\") pod \"ceilometer-0\" (UID: \"dbe84e5b-abdf-4300-a41e-26507a638f6e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:39:46 crc kubenswrapper[5120]: I0316 16:39:46.329409 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k94gv\" (UniqueName: \"kubernetes.io/projected/dbe84e5b-abdf-4300-a41e-26507a638f6e-kube-api-access-k94gv\") pod \"ceilometer-0\" (UID: \"dbe84e5b-abdf-4300-a41e-26507a638f6e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:39:46 crc kubenswrapper[5120]: I0316 16:39:46.329462 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dbe84e5b-abdf-4300-a41e-26507a638f6e-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"dbe84e5b-abdf-4300-a41e-26507a638f6e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:39:46 crc kubenswrapper[5120]: I0316 16:39:46.329486 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/dbe84e5b-abdf-4300-a41e-26507a638f6e-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"dbe84e5b-abdf-4300-a41e-26507a638f6e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:39:46 crc kubenswrapper[5120]: I0316 16:39:46.329722 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/dbe84e5b-abdf-4300-a41e-26507a638f6e-run-httpd\") pod \"ceilometer-0\" (UID: \"dbe84e5b-abdf-4300-a41e-26507a638f6e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:39:46 crc kubenswrapper[5120]: I0316 16:39:46.329773 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/dbe84e5b-abdf-4300-a41e-26507a638f6e-scripts\") pod \"ceilometer-0\" (UID: \"dbe84e5b-abdf-4300-a41e-26507a638f6e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:39:46 crc kubenswrapper[5120]: I0316 16:39:46.329822 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dbe84e5b-abdf-4300-a41e-26507a638f6e-config-data\") pod \"ceilometer-0\" (UID: \"dbe84e5b-abdf-4300-a41e-26507a638f6e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:39:46 crc kubenswrapper[5120]: I0316 16:39:46.330351 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/dbe84e5b-abdf-4300-a41e-26507a638f6e-log-httpd\") pod \"ceilometer-0\" (UID: \"dbe84e5b-abdf-4300-a41e-26507a638f6e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:39:46 crc kubenswrapper[5120]: I0316 16:39:46.331391 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/dbe84e5b-abdf-4300-a41e-26507a638f6e-run-httpd\") pod \"ceilometer-0\" (UID: \"dbe84e5b-abdf-4300-a41e-26507a638f6e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:39:46 crc kubenswrapper[5120]: I0316 16:39:46.338125 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dbe84e5b-abdf-4300-a41e-26507a638f6e-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"dbe84e5b-abdf-4300-a41e-26507a638f6e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:39:46 crc kubenswrapper[5120]: I0316 16:39:46.338526 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-p2zn5" Mar 16 16:39:46 crc kubenswrapper[5120]: I0316 16:39:46.345489 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/dbe84e5b-abdf-4300-a41e-26507a638f6e-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"dbe84e5b-abdf-4300-a41e-26507a638f6e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:39:46 crc kubenswrapper[5120]: I0316 16:39:46.345974 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/dbe84e5b-abdf-4300-a41e-26507a638f6e-scripts\") pod \"ceilometer-0\" (UID: \"dbe84e5b-abdf-4300-a41e-26507a638f6e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:39:46 crc kubenswrapper[5120]: I0316 16:39:46.354276 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k94gv\" (UniqueName: \"kubernetes.io/projected/dbe84e5b-abdf-4300-a41e-26507a638f6e-kube-api-access-k94gv\") pod \"ceilometer-0\" (UID: \"dbe84e5b-abdf-4300-a41e-26507a638f6e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:39:46 crc kubenswrapper[5120]: I0316 16:39:46.358417 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dbe84e5b-abdf-4300-a41e-26507a638f6e-config-data\") pod \"ceilometer-0\" (UID: \"dbe84e5b-abdf-4300-a41e-26507a638f6e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:39:46 crc kubenswrapper[5120]: I0316 16:39:46.390931 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-5fbdc8fdc6-mzpw2" Mar 16 16:39:46 crc kubenswrapper[5120]: I0316 16:39:46.396049 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:39:46 crc kubenswrapper[5120]: I0316 16:39:46.688235 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="621997b8-90a2-44ff-b1bf-ababd800c8ad" path="/var/lib/kubelet/pods/621997b8-90a2-44ff-b1bf-ababd800c8ad/volumes" Mar 16 16:39:46 crc kubenswrapper[5120]: I0316 16:39:46.688939 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c6cd3a57-412a-4098-b987-6d1d5c8bd0a0" path="/var/lib/kubelet/pods/c6cd3a57-412a-4098-b987-6d1d5c8bd0a0/volumes" Mar 16 16:39:46 crc kubenswrapper[5120]: I0316 16:39:46.699150 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-5c5dddf6d4-cftmc" event={"ID":"f262f286-8308-4657-b286-dfc2eb7e25d3","Type":"ContainerStarted","Data":"c5a0f6e83168a0cf60dfaf111cba5ee22fc2309d89188a9a25410953091e05f8"} Mar 16 16:39:46 crc kubenswrapper[5120]: I0316 16:39:46.699197 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-5c5dddf6d4-cftmc" event={"ID":"f262f286-8308-4657-b286-dfc2eb7e25d3","Type":"ContainerStarted","Data":"2d80e0fe86de1cd949bc03c2684a8c30d1857ef84c67578f22d71e3815f58c9c"} Mar 16 16:39:46 crc kubenswrapper[5120]: I0316 16:39:46.699209 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-5c5dddf6d4-cftmc" event={"ID":"f262f286-8308-4657-b286-dfc2eb7e25d3","Type":"ContainerStarted","Data":"5d7ef6c0ecb6f0e64835d5364b6fff320ef81c003a24c6fd80f96da12da5b8b5"} Mar 16 16:39:46 crc kubenswrapper[5120]: I0316 16:39:46.699325 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-5c5dddf6d4-cftmc" Mar 16 16:39:46 crc kubenswrapper[5120]: I0316 16:39:46.699378 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-5c5dddf6d4-cftmc" Mar 16 16:39:46 crc kubenswrapper[5120]: I0316 16:39:46.752882 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-5c5dddf6d4-cftmc" podStartSLOduration=2.752857182 podStartE2EDuration="2.752857182s" podCreationTimestamp="2026-03-16 16:39:44 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:39:46.736416135 +0000 UTC m=+4088.890347792" watchObservedRunningTime="2026-03-16 16:39:46.752857182 +0000 UTC m=+4088.906788839" Mar 16 16:39:46 crc kubenswrapper[5120]: I0316 16:39:46.754388 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-584b4f85f9-ttk4d"] Mar 16 16:39:46 crc kubenswrapper[5120]: W0316 16:39:46.778168 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod84416c7c_79e8_4adb_803f_39ac90a5d695.slice/crio-8a25d748bdd930aef3122c056dd4b8cbcb25007cfb3a908a5dcf4cf9ef5c827e WatchSource:0}: Error finding container 8a25d748bdd930aef3122c056dd4b8cbcb25007cfb3a908a5dcf4cf9ef5c827e: Status 404 returned error can't find the container with id 8a25d748bdd930aef3122c056dd4b8cbcb25007cfb3a908a5dcf4cf9ef5c827e Mar 16 16:39:46 crc kubenswrapper[5120]: I0316 16:39:46.925275 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-5b488dd8b-2htz9"] Mar 16 16:39:47 crc kubenswrapper[5120]: I0316 16:39:47.032846 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-5fbdc8fdc6-mzpw2"] Mar 16 16:39:47 crc kubenswrapper[5120]: W0316 16:39:47.048518 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3d3aa68e_3e71_4a4c_98b3_a270eafdb9b4.slice/crio-ffbc006586c89ae9d9c73e18d690b4037846cacca35cf6e85d2589eadd0a3053 WatchSource:0}: Error finding container ffbc006586c89ae9d9c73e18d690b4037846cacca35cf6e85d2589eadd0a3053: Status 404 returned error can't find the container with id ffbc006586c89ae9d9c73e18d690b4037846cacca35cf6e85d2589eadd0a3053 Mar 16 16:39:47 crc kubenswrapper[5120]: I0316 16:39:47.125122 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-p2zn5"] Mar 16 16:39:47 crc kubenswrapper[5120]: W0316 16:39:47.127733 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddbe84e5b_abdf_4300_a41e_26507a638f6e.slice/crio-17a9dc6bdc0770ba75daac61eecb285e30919bf19046da9946edefc08eec74af WatchSource:0}: Error finding container 17a9dc6bdc0770ba75daac61eecb285e30919bf19046da9946edefc08eec74af: Status 404 returned error can't find the container with id 17a9dc6bdc0770ba75daac61eecb285e30919bf19046da9946edefc08eec74af Mar 16 16:39:47 crc kubenswrapper[5120]: I0316 16:39:47.135614 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:39:47 crc kubenswrapper[5120]: W0316 16:39:47.138604 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod99e73376_04fb_4c3c_932a_115a4dd47186.slice/crio-d7af69560047bc9873ee0ce78465377454bf3f2756d26f7801dc3155410cd0c0 WatchSource:0}: Error finding container d7af69560047bc9873ee0ce78465377454bf3f2756d26f7801dc3155410cd0c0: Status 404 returned error can't find the container with id d7af69560047bc9873ee0ce78465377454bf3f2756d26f7801dc3155410cd0c0 Mar 16 16:39:47 crc kubenswrapper[5120]: I0316 16:39:47.716445 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-5b488dd8b-2htz9" event={"ID":"fafcfc0e-412f-4c5b-bba6-87910b9f4282","Type":"ContainerStarted","Data":"2425e735f31a188999c501c7955b02da9ba373d89435ae78fca0f0d98ec36d4e"} Mar 16 16:39:47 crc kubenswrapper[5120]: I0316 16:39:47.717019 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-5b488dd8b-2htz9" event={"ID":"fafcfc0e-412f-4c5b-bba6-87910b9f4282","Type":"ContainerStarted","Data":"950599d20a2d4d472cf2109d9f0d4952f2ac71820ee216fe18daabc06cff10e2"} Mar 16 16:39:47 crc kubenswrapper[5120]: I0316 16:39:47.717035 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-5b488dd8b-2htz9" event={"ID":"fafcfc0e-412f-4c5b-bba6-87910b9f4282","Type":"ContainerStarted","Data":"b9ec6af194403776f99f922457dd444c550c1508efb170349988e3561536022d"} Mar 16 16:39:47 crc kubenswrapper[5120]: I0316 16:39:47.718934 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"dbe84e5b-abdf-4300-a41e-26507a638f6e","Type":"ContainerStarted","Data":"319369720a667a7bb1a0c88fafefc7dfc242dc278d328913f43f46f2c6de973d"} Mar 16 16:39:47 crc kubenswrapper[5120]: I0316 16:39:47.718970 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"dbe84e5b-abdf-4300-a41e-26507a638f6e","Type":"ContainerStarted","Data":"17a9dc6bdc0770ba75daac61eecb285e30919bf19046da9946edefc08eec74af"} Mar 16 16:39:47 crc kubenswrapper[5120]: I0316 16:39:47.721503 5120 generic.go:358] "Generic (PLEG): container finished" podID="b055003e-69db-43e3-b335-278f9687fcc7" containerID="349678580bf491d57538e484f9dd1d67a9b8ab9a5d78de41e2d1b85ff9f12a0f" exitCode=0 Mar 16 16:39:47 crc kubenswrapper[5120]: I0316 16:39:47.721598 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-268nj" event={"ID":"b055003e-69db-43e3-b335-278f9687fcc7","Type":"ContainerDied","Data":"349678580bf491d57538e484f9dd1d67a9b8ab9a5d78de41e2d1b85ff9f12a0f"} Mar 16 16:39:47 crc kubenswrapper[5120]: I0316 16:39:47.724789 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-5fbdc8fdc6-mzpw2" event={"ID":"3d3aa68e-3e71-4a4c-98b3-a270eafdb9b4","Type":"ContainerStarted","Data":"64ac4d8ce46c83aa0ec5e780400e98040ee5dc986c894b80bb0d270e3f86fcd8"} Mar 16 16:39:47 crc kubenswrapper[5120]: I0316 16:39:47.724830 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-5fbdc8fdc6-mzpw2" event={"ID":"3d3aa68e-3e71-4a4c-98b3-a270eafdb9b4","Type":"ContainerStarted","Data":"6bb9f248c55dbeab9d6ccf5cc13d6f101718ac0b7f11d52d095a2ef4117f5b38"} Mar 16 16:39:47 crc kubenswrapper[5120]: I0316 16:39:47.724843 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-5fbdc8fdc6-mzpw2" event={"ID":"3d3aa68e-3e71-4a4c-98b3-a270eafdb9b4","Type":"ContainerStarted","Data":"ffbc006586c89ae9d9c73e18d690b4037846cacca35cf6e85d2589eadd0a3053"} Mar 16 16:39:47 crc kubenswrapper[5120]: I0316 16:39:47.725002 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-5fbdc8fdc6-mzpw2" Mar 16 16:39:47 crc kubenswrapper[5120]: I0316 16:39:47.725019 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-5fbdc8fdc6-mzpw2" Mar 16 16:39:47 crc kubenswrapper[5120]: I0316 16:39:47.728871 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-p2zn5" event={"ID":"99e73376-04fb-4c3c-932a-115a4dd47186","Type":"ContainerStarted","Data":"3bcec915e7223bdb07f6613dbdea33acad9483e93a74956f3fd570255480cc93"} Mar 16 16:39:47 crc kubenswrapper[5120]: I0316 16:39:47.728927 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-p2zn5" event={"ID":"99e73376-04fb-4c3c-932a-115a4dd47186","Type":"ContainerStarted","Data":"d7af69560047bc9873ee0ce78465377454bf3f2756d26f7801dc3155410cd0c0"} Mar 16 16:39:47 crc kubenswrapper[5120]: I0316 16:39:47.735431 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-584b4f85f9-ttk4d" event={"ID":"84416c7c-79e8-4adb-803f-39ac90a5d695","Type":"ContainerStarted","Data":"321e2cd5e6d548a888ac8f869db76f129d02473220b6c36160a9ee61376a500f"} Mar 16 16:39:47 crc kubenswrapper[5120]: I0316 16:39:47.735475 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-584b4f85f9-ttk4d" event={"ID":"84416c7c-79e8-4adb-803f-39ac90a5d695","Type":"ContainerStarted","Data":"d1df920df6411dbd85fe8c77a5ec77498fb1f6bc2070a950c7f9164b76f3ed2f"} Mar 16 16:39:47 crc kubenswrapper[5120]: I0316 16:39:47.735487 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-584b4f85f9-ttk4d" event={"ID":"84416c7c-79e8-4adb-803f-39ac90a5d695","Type":"ContainerStarted","Data":"8a25d748bdd930aef3122c056dd4b8cbcb25007cfb3a908a5dcf4cf9ef5c827e"} Mar 16 16:39:47 crc kubenswrapper[5120]: I0316 16:39:47.750242 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-keystone-listener-5b488dd8b-2htz9" podStartSLOduration=2.75021578 podStartE2EDuration="2.75021578s" podCreationTimestamp="2026-03-16 16:39:45 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:39:47.737006302 +0000 UTC m=+4089.890937959" watchObservedRunningTime="2026-03-16 16:39:47.75021578 +0000 UTC m=+4089.904147437" Mar 16 16:39:47 crc kubenswrapper[5120]: I0316 16:39:47.759032 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-bootstrap-p2zn5" podStartSLOduration=2.7589913470000003 podStartE2EDuration="2.758991347s" podCreationTimestamp="2026-03-16 16:39:45 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:39:47.756530491 +0000 UTC m=+4089.910462158" watchObservedRunningTime="2026-03-16 16:39:47.758991347 +0000 UTC m=+4089.912923004" Mar 16 16:39:47 crc kubenswrapper[5120]: I0316 16:39:47.806816 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-api-5fbdc8fdc6-mzpw2" podStartSLOduration=2.806794316 podStartE2EDuration="2.806794316s" podCreationTimestamp="2026-03-16 16:39:45 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:39:47.801017468 +0000 UTC m=+4089.954949135" watchObservedRunningTime="2026-03-16 16:39:47.806794316 +0000 UTC m=+4089.960725973" Mar 16 16:39:47 crc kubenswrapper[5120]: I0316 16:39:47.848543 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-worker-584b4f85f9-ttk4d" podStartSLOduration=2.848524347 podStartE2EDuration="2.848524347s" podCreationTimestamp="2026-03-16 16:39:45 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:39:47.827774585 +0000 UTC m=+4089.981706242" watchObservedRunningTime="2026-03-16 16:39:47.848524347 +0000 UTC m=+4090.002456004" Mar 16 16:39:49 crc kubenswrapper[5120]: I0316 16:39:49.174805 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-268nj" Mar 16 16:39:49 crc kubenswrapper[5120]: I0316 16:39:49.303640 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b055003e-69db-43e3-b335-278f9687fcc7-scripts\") pod \"b055003e-69db-43e3-b335-278f9687fcc7\" (UID: \"b055003e-69db-43e3-b335-278f9687fcc7\") " Mar 16 16:39:49 crc kubenswrapper[5120]: I0316 16:39:49.304094 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b055003e-69db-43e3-b335-278f9687fcc7-combined-ca-bundle\") pod \"b055003e-69db-43e3-b335-278f9687fcc7\" (UID: \"b055003e-69db-43e3-b335-278f9687fcc7\") " Mar 16 16:39:49 crc kubenswrapper[5120]: I0316 16:39:49.304280 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/b055003e-69db-43e3-b335-278f9687fcc7-etc-machine-id\") pod \"b055003e-69db-43e3-b335-278f9687fcc7\" (UID: \"b055003e-69db-43e3-b335-278f9687fcc7\") " Mar 16 16:39:49 crc kubenswrapper[5120]: I0316 16:39:49.304437 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b055003e-69db-43e3-b335-278f9687fcc7-config-data\") pod \"b055003e-69db-43e3-b335-278f9687fcc7\" (UID: \"b055003e-69db-43e3-b335-278f9687fcc7\") " Mar 16 16:39:49 crc kubenswrapper[5120]: I0316 16:39:49.304650 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4fn4j\" (UniqueName: \"kubernetes.io/projected/b055003e-69db-43e3-b335-278f9687fcc7-kube-api-access-4fn4j\") pod \"b055003e-69db-43e3-b335-278f9687fcc7\" (UID: \"b055003e-69db-43e3-b335-278f9687fcc7\") " Mar 16 16:39:49 crc kubenswrapper[5120]: I0316 16:39:49.304732 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/b055003e-69db-43e3-b335-278f9687fcc7-db-sync-config-data\") pod \"b055003e-69db-43e3-b335-278f9687fcc7\" (UID: \"b055003e-69db-43e3-b335-278f9687fcc7\") " Mar 16 16:39:49 crc kubenswrapper[5120]: I0316 16:39:49.305885 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/b055003e-69db-43e3-b335-278f9687fcc7-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "b055003e-69db-43e3-b335-278f9687fcc7" (UID: "b055003e-69db-43e3-b335-278f9687fcc7"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 16:39:49 crc kubenswrapper[5120]: I0316 16:39:49.319342 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b055003e-69db-43e3-b335-278f9687fcc7-db-sync-config-data" (OuterVolumeSpecName: "db-sync-config-data") pod "b055003e-69db-43e3-b335-278f9687fcc7" (UID: "b055003e-69db-43e3-b335-278f9687fcc7"). InnerVolumeSpecName "db-sync-config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:39:49 crc kubenswrapper[5120]: I0316 16:39:49.323930 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b055003e-69db-43e3-b335-278f9687fcc7-scripts" (OuterVolumeSpecName: "scripts") pod "b055003e-69db-43e3-b335-278f9687fcc7" (UID: "b055003e-69db-43e3-b335-278f9687fcc7"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:39:49 crc kubenswrapper[5120]: I0316 16:39:49.363479 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b055003e-69db-43e3-b335-278f9687fcc7-kube-api-access-4fn4j" (OuterVolumeSpecName: "kube-api-access-4fn4j") pod "b055003e-69db-43e3-b335-278f9687fcc7" (UID: "b055003e-69db-43e3-b335-278f9687fcc7"). InnerVolumeSpecName "kube-api-access-4fn4j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:39:49 crc kubenswrapper[5120]: I0316 16:39:49.394848 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-api-599744884-vf6rr"] Mar 16 16:39:49 crc kubenswrapper[5120]: I0316 16:39:49.397294 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b055003e-69db-43e3-b335-278f9687fcc7" containerName="cinder-db-sync" Mar 16 16:39:49 crc kubenswrapper[5120]: I0316 16:39:49.397420 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="b055003e-69db-43e3-b335-278f9687fcc7" containerName="cinder-db-sync" Mar 16 16:39:49 crc kubenswrapper[5120]: I0316 16:39:49.397828 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="b055003e-69db-43e3-b335-278f9687fcc7" containerName="cinder-db-sync" Mar 16 16:39:49 crc kubenswrapper[5120]: I0316 16:39:49.410981 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-599744884-vf6rr" Mar 16 16:39:49 crc kubenswrapper[5120]: I0316 16:39:49.414597 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-barbican-public-svc\"" Mar 16 16:39:49 crc kubenswrapper[5120]: I0316 16:39:49.420382 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b055003e-69db-43e3-b335-278f9687fcc7-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:39:49 crc kubenswrapper[5120]: I0316 16:39:49.420409 5120 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/b055003e-69db-43e3-b335-278f9687fcc7-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 16:39:49 crc kubenswrapper[5120]: I0316 16:39:49.420420 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4fn4j\" (UniqueName: \"kubernetes.io/projected/b055003e-69db-43e3-b335-278f9687fcc7-kube-api-access-4fn4j\") on node \"crc\" DevicePath \"\"" Mar 16 16:39:49 crc kubenswrapper[5120]: I0316 16:39:49.420437 5120 reconciler_common.go:299] "Volume detached for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/b055003e-69db-43e3-b335-278f9687fcc7-db-sync-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:39:49 crc kubenswrapper[5120]: I0316 16:39:49.434176 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-barbican-internal-svc\"" Mar 16 16:39:49 crc kubenswrapper[5120]: I0316 16:39:49.453955 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b055003e-69db-43e3-b335-278f9687fcc7-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "b055003e-69db-43e3-b335-278f9687fcc7" (UID: "b055003e-69db-43e3-b335-278f9687fcc7"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:39:49 crc kubenswrapper[5120]: I0316 16:39:49.456637 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-599744884-vf6rr"] Mar 16 16:39:49 crc kubenswrapper[5120]: I0316 16:39:49.473989 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b055003e-69db-43e3-b335-278f9687fcc7-config-data" (OuterVolumeSpecName: "config-data") pod "b055003e-69db-43e3-b335-278f9687fcc7" (UID: "b055003e-69db-43e3-b335-278f9687fcc7"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:39:49 crc kubenswrapper[5120]: I0316 16:39:49.522333 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e0ca2d31-e27b-42b5-8801-469ad47142a5-config-data\") pod \"barbican-api-599744884-vf6rr\" (UID: \"e0ca2d31-e27b-42b5-8801-469ad47142a5\") " pod="openstack-kuttl-tests/barbican-api-599744884-vf6rr" Mar 16 16:39:49 crc kubenswrapper[5120]: I0316 16:39:49.522697 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e0ca2d31-e27b-42b5-8801-469ad47142a5-public-tls-certs\") pod \"barbican-api-599744884-vf6rr\" (UID: \"e0ca2d31-e27b-42b5-8801-469ad47142a5\") " pod="openstack-kuttl-tests/barbican-api-599744884-vf6rr" Mar 16 16:39:49 crc kubenswrapper[5120]: I0316 16:39:49.522917 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e0ca2d31-e27b-42b5-8801-469ad47142a5-internal-tls-certs\") pod \"barbican-api-599744884-vf6rr\" (UID: \"e0ca2d31-e27b-42b5-8801-469ad47142a5\") " pod="openstack-kuttl-tests/barbican-api-599744884-vf6rr" Mar 16 16:39:49 crc kubenswrapper[5120]: I0316 16:39:49.522956 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e0ca2d31-e27b-42b5-8801-469ad47142a5-logs\") pod \"barbican-api-599744884-vf6rr\" (UID: \"e0ca2d31-e27b-42b5-8801-469ad47142a5\") " pod="openstack-kuttl-tests/barbican-api-599744884-vf6rr" Mar 16 16:39:49 crc kubenswrapper[5120]: I0316 16:39:49.522987 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/e0ca2d31-e27b-42b5-8801-469ad47142a5-config-data-custom\") pod \"barbican-api-599744884-vf6rr\" (UID: \"e0ca2d31-e27b-42b5-8801-469ad47142a5\") " pod="openstack-kuttl-tests/barbican-api-599744884-vf6rr" Mar 16 16:39:49 crc kubenswrapper[5120]: I0316 16:39:49.523034 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwsv2\" (UniqueName: \"kubernetes.io/projected/e0ca2d31-e27b-42b5-8801-469ad47142a5-kube-api-access-kwsv2\") pod \"barbican-api-599744884-vf6rr\" (UID: \"e0ca2d31-e27b-42b5-8801-469ad47142a5\") " pod="openstack-kuttl-tests/barbican-api-599744884-vf6rr" Mar 16 16:39:49 crc kubenswrapper[5120]: I0316 16:39:49.523106 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e0ca2d31-e27b-42b5-8801-469ad47142a5-combined-ca-bundle\") pod \"barbican-api-599744884-vf6rr\" (UID: \"e0ca2d31-e27b-42b5-8801-469ad47142a5\") " pod="openstack-kuttl-tests/barbican-api-599744884-vf6rr" Mar 16 16:39:49 crc kubenswrapper[5120]: I0316 16:39:49.523255 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b055003e-69db-43e3-b335-278f9687fcc7-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:39:49 crc kubenswrapper[5120]: I0316 16:39:49.523274 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b055003e-69db-43e3-b335-278f9687fcc7-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:39:49 crc kubenswrapper[5120]: I0316 16:39:49.625404 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e0ca2d31-e27b-42b5-8801-469ad47142a5-config-data\") pod \"barbican-api-599744884-vf6rr\" (UID: \"e0ca2d31-e27b-42b5-8801-469ad47142a5\") " pod="openstack-kuttl-tests/barbican-api-599744884-vf6rr" Mar 16 16:39:49 crc kubenswrapper[5120]: I0316 16:39:49.625480 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e0ca2d31-e27b-42b5-8801-469ad47142a5-public-tls-certs\") pod \"barbican-api-599744884-vf6rr\" (UID: \"e0ca2d31-e27b-42b5-8801-469ad47142a5\") " pod="openstack-kuttl-tests/barbican-api-599744884-vf6rr" Mar 16 16:39:49 crc kubenswrapper[5120]: I0316 16:39:49.625563 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e0ca2d31-e27b-42b5-8801-469ad47142a5-internal-tls-certs\") pod \"barbican-api-599744884-vf6rr\" (UID: \"e0ca2d31-e27b-42b5-8801-469ad47142a5\") " pod="openstack-kuttl-tests/barbican-api-599744884-vf6rr" Mar 16 16:39:49 crc kubenswrapper[5120]: I0316 16:39:49.625583 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e0ca2d31-e27b-42b5-8801-469ad47142a5-logs\") pod \"barbican-api-599744884-vf6rr\" (UID: \"e0ca2d31-e27b-42b5-8801-469ad47142a5\") " pod="openstack-kuttl-tests/barbican-api-599744884-vf6rr" Mar 16 16:39:49 crc kubenswrapper[5120]: I0316 16:39:49.625612 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/e0ca2d31-e27b-42b5-8801-469ad47142a5-config-data-custom\") pod \"barbican-api-599744884-vf6rr\" (UID: \"e0ca2d31-e27b-42b5-8801-469ad47142a5\") " pod="openstack-kuttl-tests/barbican-api-599744884-vf6rr" Mar 16 16:39:49 crc kubenswrapper[5120]: I0316 16:39:49.625654 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kwsv2\" (UniqueName: \"kubernetes.io/projected/e0ca2d31-e27b-42b5-8801-469ad47142a5-kube-api-access-kwsv2\") pod \"barbican-api-599744884-vf6rr\" (UID: \"e0ca2d31-e27b-42b5-8801-469ad47142a5\") " pod="openstack-kuttl-tests/barbican-api-599744884-vf6rr" Mar 16 16:39:49 crc kubenswrapper[5120]: I0316 16:39:49.625720 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e0ca2d31-e27b-42b5-8801-469ad47142a5-combined-ca-bundle\") pod \"barbican-api-599744884-vf6rr\" (UID: \"e0ca2d31-e27b-42b5-8801-469ad47142a5\") " pod="openstack-kuttl-tests/barbican-api-599744884-vf6rr" Mar 16 16:39:49 crc kubenswrapper[5120]: I0316 16:39:49.626890 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e0ca2d31-e27b-42b5-8801-469ad47142a5-logs\") pod \"barbican-api-599744884-vf6rr\" (UID: \"e0ca2d31-e27b-42b5-8801-469ad47142a5\") " pod="openstack-kuttl-tests/barbican-api-599744884-vf6rr" Mar 16 16:39:49 crc kubenswrapper[5120]: I0316 16:39:49.632196 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e0ca2d31-e27b-42b5-8801-469ad47142a5-public-tls-certs\") pod \"barbican-api-599744884-vf6rr\" (UID: \"e0ca2d31-e27b-42b5-8801-469ad47142a5\") " pod="openstack-kuttl-tests/barbican-api-599744884-vf6rr" Mar 16 16:39:49 crc kubenswrapper[5120]: I0316 16:39:49.632890 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e0ca2d31-e27b-42b5-8801-469ad47142a5-config-data\") pod \"barbican-api-599744884-vf6rr\" (UID: \"e0ca2d31-e27b-42b5-8801-469ad47142a5\") " pod="openstack-kuttl-tests/barbican-api-599744884-vf6rr" Mar 16 16:39:49 crc kubenswrapper[5120]: I0316 16:39:49.632905 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/e0ca2d31-e27b-42b5-8801-469ad47142a5-config-data-custom\") pod \"barbican-api-599744884-vf6rr\" (UID: \"e0ca2d31-e27b-42b5-8801-469ad47142a5\") " pod="openstack-kuttl-tests/barbican-api-599744884-vf6rr" Mar 16 16:39:49 crc kubenswrapper[5120]: I0316 16:39:49.633287 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e0ca2d31-e27b-42b5-8801-469ad47142a5-combined-ca-bundle\") pod \"barbican-api-599744884-vf6rr\" (UID: \"e0ca2d31-e27b-42b5-8801-469ad47142a5\") " pod="openstack-kuttl-tests/barbican-api-599744884-vf6rr" Mar 16 16:39:49 crc kubenswrapper[5120]: I0316 16:39:49.633807 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e0ca2d31-e27b-42b5-8801-469ad47142a5-internal-tls-certs\") pod \"barbican-api-599744884-vf6rr\" (UID: \"e0ca2d31-e27b-42b5-8801-469ad47142a5\") " pod="openstack-kuttl-tests/barbican-api-599744884-vf6rr" Mar 16 16:39:49 crc kubenswrapper[5120]: I0316 16:39:49.645012 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwsv2\" (UniqueName: \"kubernetes.io/projected/e0ca2d31-e27b-42b5-8801-469ad47142a5-kube-api-access-kwsv2\") pod \"barbican-api-599744884-vf6rr\" (UID: \"e0ca2d31-e27b-42b5-8801-469ad47142a5\") " pod="openstack-kuttl-tests/barbican-api-599744884-vf6rr" Mar 16 16:39:49 crc kubenswrapper[5120]: I0316 16:39:49.753723 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"dbe84e5b-abdf-4300-a41e-26507a638f6e","Type":"ContainerStarted","Data":"340ea5b4a4b6b79e8eec7809aa702596df745abcc22f8a28a465f4260dc1fd9d"} Mar 16 16:39:49 crc kubenswrapper[5120]: I0316 16:39:49.755550 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-268nj" event={"ID":"b055003e-69db-43e3-b335-278f9687fcc7","Type":"ContainerDied","Data":"888d3223f9c1230b2bd832098b3ba81a0d5454a43a51f1156080d53e4f45673b"} Mar 16 16:39:49 crc kubenswrapper[5120]: I0316 16:39:49.755598 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="888d3223f9c1230b2bd832098b3ba81a0d5454a43a51f1156080d53e4f45673b" Mar 16 16:39:49 crc kubenswrapper[5120]: I0316 16:39:49.755610 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-268nj" Mar 16 16:39:49 crc kubenswrapper[5120]: I0316 16:39:49.758219 5120 generic.go:358] "Generic (PLEG): container finished" podID="334707cf-7ffa-4fe5-94c5-e9402769ca11" containerID="0e197c8883c5a4c52de582c21153015258d0c3f6e9781165ce6fbd7a3ba4237d" exitCode=0 Mar 16 16:39:49 crc kubenswrapper[5120]: I0316 16:39:49.758314 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-nwxnc" event={"ID":"334707cf-7ffa-4fe5-94c5-e9402769ca11","Type":"ContainerDied","Data":"0e197c8883c5a4c52de582c21153015258d0c3f6e9781165ce6fbd7a3ba4237d"} Mar 16 16:39:49 crc kubenswrapper[5120]: I0316 16:39:49.764678 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-599744884-vf6rr" Mar 16 16:39:50 crc kubenswrapper[5120]: I0316 16:39:50.076255 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:39:50 crc kubenswrapper[5120]: I0316 16:39:50.101386 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:39:50 crc kubenswrapper[5120]: I0316 16:39:50.101564 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:39:50 crc kubenswrapper[5120]: I0316 16:39:50.111376 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-scripts\"" Mar 16 16:39:50 crc kubenswrapper[5120]: I0316 16:39:50.111595 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-config-data\"" Mar 16 16:39:50 crc kubenswrapper[5120]: I0316 16:39:50.111706 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-cinder-dockercfg-n8q78\"" Mar 16 16:39:50 crc kubenswrapper[5120]: I0316 16:39:50.111881 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-scheduler-config-data\"" Mar 16 16:39:50 crc kubenswrapper[5120]: I0316 16:39:50.146166 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/41971ebe-e2c3-4815-97c5-011ff54825b7-config-data\") pod \"cinder-scheduler-0\" (UID: \"41971ebe-e2c3-4815-97c5-011ff54825b7\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:39:50 crc kubenswrapper[5120]: I0316 16:39:50.146221 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/41971ebe-e2c3-4815-97c5-011ff54825b7-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"41971ebe-e2c3-4815-97c5-011ff54825b7\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:39:50 crc kubenswrapper[5120]: I0316 16:39:50.146286 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/41971ebe-e2c3-4815-97c5-011ff54825b7-scripts\") pod \"cinder-scheduler-0\" (UID: \"41971ebe-e2c3-4815-97c5-011ff54825b7\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:39:50 crc kubenswrapper[5120]: I0316 16:39:50.146325 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/41971ebe-e2c3-4815-97c5-011ff54825b7-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"41971ebe-e2c3-4815-97c5-011ff54825b7\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:39:50 crc kubenswrapper[5120]: I0316 16:39:50.146521 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/41971ebe-e2c3-4815-97c5-011ff54825b7-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"41971ebe-e2c3-4815-97c5-011ff54825b7\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:39:50 crc kubenswrapper[5120]: I0316 16:39:50.146594 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9z7fc\" (UniqueName: \"kubernetes.io/projected/41971ebe-e2c3-4815-97c5-011ff54825b7-kube-api-access-9z7fc\") pod \"cinder-scheduler-0\" (UID: \"41971ebe-e2c3-4815-97c5-011ff54825b7\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:39:50 crc kubenswrapper[5120]: I0316 16:39:50.249064 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/41971ebe-e2c3-4815-97c5-011ff54825b7-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"41971ebe-e2c3-4815-97c5-011ff54825b7\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:39:50 crc kubenswrapper[5120]: I0316 16:39:50.249466 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9z7fc\" (UniqueName: \"kubernetes.io/projected/41971ebe-e2c3-4815-97c5-011ff54825b7-kube-api-access-9z7fc\") pod \"cinder-scheduler-0\" (UID: \"41971ebe-e2c3-4815-97c5-011ff54825b7\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:39:50 crc kubenswrapper[5120]: I0316 16:39:50.249554 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/41971ebe-e2c3-4815-97c5-011ff54825b7-config-data\") pod \"cinder-scheduler-0\" (UID: \"41971ebe-e2c3-4815-97c5-011ff54825b7\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:39:50 crc kubenswrapper[5120]: I0316 16:39:50.249593 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/41971ebe-e2c3-4815-97c5-011ff54825b7-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"41971ebe-e2c3-4815-97c5-011ff54825b7\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:39:50 crc kubenswrapper[5120]: I0316 16:39:50.249654 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/41971ebe-e2c3-4815-97c5-011ff54825b7-scripts\") pod \"cinder-scheduler-0\" (UID: \"41971ebe-e2c3-4815-97c5-011ff54825b7\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:39:50 crc kubenswrapper[5120]: I0316 16:39:50.249706 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/41971ebe-e2c3-4815-97c5-011ff54825b7-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"41971ebe-e2c3-4815-97c5-011ff54825b7\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:39:50 crc kubenswrapper[5120]: I0316 16:39:50.249923 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/41971ebe-e2c3-4815-97c5-011ff54825b7-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"41971ebe-e2c3-4815-97c5-011ff54825b7\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:39:50 crc kubenswrapper[5120]: I0316 16:39:50.260151 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-599744884-vf6rr"] Mar 16 16:39:50 crc kubenswrapper[5120]: I0316 16:39:50.261954 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/41971ebe-e2c3-4815-97c5-011ff54825b7-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"41971ebe-e2c3-4815-97c5-011ff54825b7\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:39:50 crc kubenswrapper[5120]: I0316 16:39:50.263294 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/41971ebe-e2c3-4815-97c5-011ff54825b7-scripts\") pod \"cinder-scheduler-0\" (UID: \"41971ebe-e2c3-4815-97c5-011ff54825b7\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:39:50 crc kubenswrapper[5120]: I0316 16:39:50.267677 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/41971ebe-e2c3-4815-97c5-011ff54825b7-config-data\") pod \"cinder-scheduler-0\" (UID: \"41971ebe-e2c3-4815-97c5-011ff54825b7\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:39:50 crc kubenswrapper[5120]: I0316 16:39:50.278939 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:39:50 crc kubenswrapper[5120]: I0316 16:39:50.284021 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9z7fc\" (UniqueName: \"kubernetes.io/projected/41971ebe-e2c3-4815-97c5-011ff54825b7-kube-api-access-9z7fc\") pod \"cinder-scheduler-0\" (UID: \"41971ebe-e2c3-4815-97c5-011ff54825b7\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:39:50 crc kubenswrapper[5120]: I0316 16:39:50.285581 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:39:50 crc kubenswrapper[5120]: I0316 16:39:50.286298 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/41971ebe-e2c3-4815-97c5-011ff54825b7-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"41971ebe-e2c3-4815-97c5-011ff54825b7\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:39:50 crc kubenswrapper[5120]: I0316 16:39:50.287793 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-api-config-data\"" Mar 16 16:39:50 crc kubenswrapper[5120]: I0316 16:39:50.288701 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:39:50 crc kubenswrapper[5120]: I0316 16:39:50.352787 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8aa3ff5c-e848-4140-8c6b-074365d7c3b9-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"8aa3ff5c-e848-4140-8c6b-074365d7c3b9\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:39:50 crc kubenswrapper[5120]: I0316 16:39:50.352858 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8aa3ff5c-e848-4140-8c6b-074365d7c3b9-config-data\") pod \"cinder-api-0\" (UID: \"8aa3ff5c-e848-4140-8c6b-074365d7c3b9\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:39:50 crc kubenswrapper[5120]: I0316 16:39:50.352907 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8aa3ff5c-e848-4140-8c6b-074365d7c3b9-scripts\") pod \"cinder-api-0\" (UID: \"8aa3ff5c-e848-4140-8c6b-074365d7c3b9\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:39:50 crc kubenswrapper[5120]: I0316 16:39:50.353023 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8aa3ff5c-e848-4140-8c6b-074365d7c3b9-logs\") pod \"cinder-api-0\" (UID: \"8aa3ff5c-e848-4140-8c6b-074365d7c3b9\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:39:50 crc kubenswrapper[5120]: I0316 16:39:50.353065 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/8aa3ff5c-e848-4140-8c6b-074365d7c3b9-config-data-custom\") pod \"cinder-api-0\" (UID: \"8aa3ff5c-e848-4140-8c6b-074365d7c3b9\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:39:50 crc kubenswrapper[5120]: I0316 16:39:50.353192 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbnrv\" (UniqueName: \"kubernetes.io/projected/8aa3ff5c-e848-4140-8c6b-074365d7c3b9-kube-api-access-xbnrv\") pod \"cinder-api-0\" (UID: \"8aa3ff5c-e848-4140-8c6b-074365d7c3b9\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:39:50 crc kubenswrapper[5120]: I0316 16:39:50.353366 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/8aa3ff5c-e848-4140-8c6b-074365d7c3b9-etc-machine-id\") pod \"cinder-api-0\" (UID: \"8aa3ff5c-e848-4140-8c6b-074365d7c3b9\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:39:50 crc kubenswrapper[5120]: I0316 16:39:50.454583 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xbnrv\" (UniqueName: \"kubernetes.io/projected/8aa3ff5c-e848-4140-8c6b-074365d7c3b9-kube-api-access-xbnrv\") pod \"cinder-api-0\" (UID: \"8aa3ff5c-e848-4140-8c6b-074365d7c3b9\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:39:50 crc kubenswrapper[5120]: I0316 16:39:50.455069 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/8aa3ff5c-e848-4140-8c6b-074365d7c3b9-etc-machine-id\") pod \"cinder-api-0\" (UID: \"8aa3ff5c-e848-4140-8c6b-074365d7c3b9\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:39:50 crc kubenswrapper[5120]: I0316 16:39:50.455219 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/8aa3ff5c-e848-4140-8c6b-074365d7c3b9-etc-machine-id\") pod \"cinder-api-0\" (UID: \"8aa3ff5c-e848-4140-8c6b-074365d7c3b9\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:39:50 crc kubenswrapper[5120]: I0316 16:39:50.455305 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8aa3ff5c-e848-4140-8c6b-074365d7c3b9-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"8aa3ff5c-e848-4140-8c6b-074365d7c3b9\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:39:50 crc kubenswrapper[5120]: I0316 16:39:50.455354 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8aa3ff5c-e848-4140-8c6b-074365d7c3b9-config-data\") pod \"cinder-api-0\" (UID: \"8aa3ff5c-e848-4140-8c6b-074365d7c3b9\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:39:50 crc kubenswrapper[5120]: I0316 16:39:50.455386 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8aa3ff5c-e848-4140-8c6b-074365d7c3b9-scripts\") pod \"cinder-api-0\" (UID: \"8aa3ff5c-e848-4140-8c6b-074365d7c3b9\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:39:50 crc kubenswrapper[5120]: I0316 16:39:50.456289 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8aa3ff5c-e848-4140-8c6b-074365d7c3b9-logs\") pod \"cinder-api-0\" (UID: \"8aa3ff5c-e848-4140-8c6b-074365d7c3b9\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:39:50 crc kubenswrapper[5120]: I0316 16:39:50.456347 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/8aa3ff5c-e848-4140-8c6b-074365d7c3b9-config-data-custom\") pod \"cinder-api-0\" (UID: \"8aa3ff5c-e848-4140-8c6b-074365d7c3b9\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:39:50 crc kubenswrapper[5120]: I0316 16:39:50.457047 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8aa3ff5c-e848-4140-8c6b-074365d7c3b9-logs\") pod \"cinder-api-0\" (UID: \"8aa3ff5c-e848-4140-8c6b-074365d7c3b9\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:39:50 crc kubenswrapper[5120]: I0316 16:39:50.461720 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8aa3ff5c-e848-4140-8c6b-074365d7c3b9-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"8aa3ff5c-e848-4140-8c6b-074365d7c3b9\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:39:50 crc kubenswrapper[5120]: I0316 16:39:50.462031 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/8aa3ff5c-e848-4140-8c6b-074365d7c3b9-config-data-custom\") pod \"cinder-api-0\" (UID: \"8aa3ff5c-e848-4140-8c6b-074365d7c3b9\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:39:50 crc kubenswrapper[5120]: I0316 16:39:50.462729 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8aa3ff5c-e848-4140-8c6b-074365d7c3b9-config-data\") pod \"cinder-api-0\" (UID: \"8aa3ff5c-e848-4140-8c6b-074365d7c3b9\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:39:50 crc kubenswrapper[5120]: I0316 16:39:50.462730 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8aa3ff5c-e848-4140-8c6b-074365d7c3b9-scripts\") pod \"cinder-api-0\" (UID: \"8aa3ff5c-e848-4140-8c6b-074365d7c3b9\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:39:50 crc kubenswrapper[5120]: I0316 16:39:50.481858 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbnrv\" (UniqueName: \"kubernetes.io/projected/8aa3ff5c-e848-4140-8c6b-074365d7c3b9-kube-api-access-xbnrv\") pod \"cinder-api-0\" (UID: \"8aa3ff5c-e848-4140-8c6b-074365d7c3b9\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:39:50 crc kubenswrapper[5120]: I0316 16:39:50.522728 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:39:50 crc kubenswrapper[5120]: I0316 16:39:50.714912 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:39:50 crc kubenswrapper[5120]: I0316 16:39:50.781098 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-599744884-vf6rr" event={"ID":"e0ca2d31-e27b-42b5-8801-469ad47142a5","Type":"ContainerStarted","Data":"2ff684768d9ed08487e6b8399da59d9625b5c9923f0fb5fa6e48a258dc77abdb"} Mar 16 16:39:50 crc kubenswrapper[5120]: I0316 16:39:50.781154 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-599744884-vf6rr" event={"ID":"e0ca2d31-e27b-42b5-8801-469ad47142a5","Type":"ContainerStarted","Data":"243c659fc1ca1c82fb6ccdaca3e8c6850dd2269e1798d8f2e1b78d3c0ac70a82"} Mar 16 16:39:50 crc kubenswrapper[5120]: I0316 16:39:50.791623 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"dbe84e5b-abdf-4300-a41e-26507a638f6e","Type":"ContainerStarted","Data":"9fc2e8df4084347acd634ad812a7cc67034d64eca198e49d1e200757d740e6dc"} Mar 16 16:39:51 crc kubenswrapper[5120]: I0316 16:39:51.000923 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:39:51 crc kubenswrapper[5120]: I0316 16:39:51.340429 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-nwxnc" Mar 16 16:39:51 crc kubenswrapper[5120]: I0316 16:39:51.367221 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:39:51 crc kubenswrapper[5120]: I0316 16:39:51.384449 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/334707cf-7ffa-4fe5-94c5-e9402769ca11-combined-ca-bundle\") pod \"334707cf-7ffa-4fe5-94c5-e9402769ca11\" (UID: \"334707cf-7ffa-4fe5-94c5-e9402769ca11\") " Mar 16 16:39:51 crc kubenswrapper[5120]: I0316 16:39:51.384573 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/334707cf-7ffa-4fe5-94c5-e9402769ca11-db-sync-config-data\") pod \"334707cf-7ffa-4fe5-94c5-e9402769ca11\" (UID: \"334707cf-7ffa-4fe5-94c5-e9402769ca11\") " Mar 16 16:39:51 crc kubenswrapper[5120]: I0316 16:39:51.384903 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n5c4p\" (UniqueName: \"kubernetes.io/projected/334707cf-7ffa-4fe5-94c5-e9402769ca11-kube-api-access-n5c4p\") pod \"334707cf-7ffa-4fe5-94c5-e9402769ca11\" (UID: \"334707cf-7ffa-4fe5-94c5-e9402769ca11\") " Mar 16 16:39:51 crc kubenswrapper[5120]: I0316 16:39:51.388026 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/334707cf-7ffa-4fe5-94c5-e9402769ca11-config-data\") pod \"334707cf-7ffa-4fe5-94c5-e9402769ca11\" (UID: \"334707cf-7ffa-4fe5-94c5-e9402769ca11\") " Mar 16 16:39:51 crc kubenswrapper[5120]: I0316 16:39:51.391667 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/334707cf-7ffa-4fe5-94c5-e9402769ca11-db-sync-config-data" (OuterVolumeSpecName: "db-sync-config-data") pod "334707cf-7ffa-4fe5-94c5-e9402769ca11" (UID: "334707cf-7ffa-4fe5-94c5-e9402769ca11"). InnerVolumeSpecName "db-sync-config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:39:51 crc kubenswrapper[5120]: I0316 16:39:51.396182 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/334707cf-7ffa-4fe5-94c5-e9402769ca11-kube-api-access-n5c4p" (OuterVolumeSpecName: "kube-api-access-n5c4p") pod "334707cf-7ffa-4fe5-94c5-e9402769ca11" (UID: "334707cf-7ffa-4fe5-94c5-e9402769ca11"). InnerVolumeSpecName "kube-api-access-n5c4p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:39:51 crc kubenswrapper[5120]: I0316 16:39:51.468200 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/334707cf-7ffa-4fe5-94c5-e9402769ca11-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "334707cf-7ffa-4fe5-94c5-e9402769ca11" (UID: "334707cf-7ffa-4fe5-94c5-e9402769ca11"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:39:51 crc kubenswrapper[5120]: I0316 16:39:51.475287 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/334707cf-7ffa-4fe5-94c5-e9402769ca11-config-data" (OuterVolumeSpecName: "config-data") pod "334707cf-7ffa-4fe5-94c5-e9402769ca11" (UID: "334707cf-7ffa-4fe5-94c5-e9402769ca11"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:39:51 crc kubenswrapper[5120]: I0316 16:39:51.496237 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n5c4p\" (UniqueName: \"kubernetes.io/projected/334707cf-7ffa-4fe5-94c5-e9402769ca11-kube-api-access-n5c4p\") on node \"crc\" DevicePath \"\"" Mar 16 16:39:51 crc kubenswrapper[5120]: I0316 16:39:51.496280 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/334707cf-7ffa-4fe5-94c5-e9402769ca11-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:39:51 crc kubenswrapper[5120]: I0316 16:39:51.496294 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/334707cf-7ffa-4fe5-94c5-e9402769ca11-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:39:51 crc kubenswrapper[5120]: I0316 16:39:51.496307 5120 reconciler_common.go:299] "Volume detached for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/334707cf-7ffa-4fe5-94c5-e9402769ca11-db-sync-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:39:51 crc kubenswrapper[5120]: I0316 16:39:51.707899 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-75564c7f5c-29qz4" Mar 16 16:39:51 crc kubenswrapper[5120]: I0316 16:39:51.787139 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-8t4vn"] Mar 16 16:39:51 crc kubenswrapper[5120]: I0316 16:39:51.787413 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-8t4vn" podUID="e06e57b2-920d-463e-8607-2c1365c8c2e5" containerName="dnsmasq-dns" containerID="cri-o://879bdb7a2180e55912537bf6753488771e521f58922f739dedb133892fb70585" gracePeriod=10 Mar 16 16:39:51 crc kubenswrapper[5120]: I0316 16:39:51.847564 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-nwxnc" Mar 16 16:39:51 crc kubenswrapper[5120]: I0316 16:39:51.850358 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-nwxnc" event={"ID":"334707cf-7ffa-4fe5-94c5-e9402769ca11","Type":"ContainerDied","Data":"3cda31add0d8d32f38e73582b05e9cf3cee29d365df202fb6e8617ddd7911dd3"} Mar 16 16:39:51 crc kubenswrapper[5120]: I0316 16:39:51.850401 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3cda31add0d8d32f38e73582b05e9cf3cee29d365df202fb6e8617ddd7911dd3" Mar 16 16:39:51 crc kubenswrapper[5120]: I0316 16:39:51.868000 5120 generic.go:358] "Generic (PLEG): container finished" podID="99e73376-04fb-4c3c-932a-115a4dd47186" containerID="3bcec915e7223bdb07f6613dbdea33acad9483e93a74956f3fd570255480cc93" exitCode=0 Mar 16 16:39:51 crc kubenswrapper[5120]: I0316 16:39:51.868174 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-p2zn5" event={"ID":"99e73376-04fb-4c3c-932a-115a4dd47186","Type":"ContainerDied","Data":"3bcec915e7223bdb07f6613dbdea33acad9483e93a74956f3fd570255480cc93"} Mar 16 16:39:51 crc kubenswrapper[5120]: I0316 16:39:51.899707 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"41971ebe-e2c3-4815-97c5-011ff54825b7","Type":"ContainerStarted","Data":"b6c1bfe5958df13fc96791fb28ae60539bb87edbd379061eea62e277946038f5"} Mar 16 16:39:51 crc kubenswrapper[5120]: I0316 16:39:51.912308 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-599744884-vf6rr" event={"ID":"e0ca2d31-e27b-42b5-8801-469ad47142a5","Type":"ContainerStarted","Data":"31e5df1a5b7f2d0c1b5204f81e9f04d53b8362b2e8378a6ef768b2867ed3ef1c"} Mar 16 16:39:51 crc kubenswrapper[5120]: I0316 16:39:51.924150 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"8aa3ff5c-e848-4140-8c6b-074365d7c3b9","Type":"ContainerStarted","Data":"ac213584aa62aca96e1df2884fb68edb9ed8507924d24504bd0d24bfe0781b92"} Mar 16 16:39:51 crc kubenswrapper[5120]: I0316 16:39:51.960307 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-api-599744884-vf6rr" podStartSLOduration=2.960282673 podStartE2EDuration="2.960282673s" podCreationTimestamp="2026-03-16 16:39:49 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:39:51.939528729 +0000 UTC m=+4094.093460386" watchObservedRunningTime="2026-03-16 16:39:51.960282673 +0000 UTC m=+4094.114214330" Mar 16 16:39:52 crc kubenswrapper[5120]: I0316 16:39:52.008709 5120 patch_prober.go:28] interesting pod/machine-config-daemon-7bf76 container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 16:39:52 crc kubenswrapper[5120]: I0316 16:39:52.008800 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 16:39:52 crc kubenswrapper[5120]: I0316 16:39:52.551304 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-8t4vn" Mar 16 16:39:52 crc kubenswrapper[5120]: I0316 16:39:52.643897 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/e06e57b2-920d-463e-8607-2c1365c8c2e5-dnsmasq-svc\") pod \"e06e57b2-920d-463e-8607-2c1365c8c2e5\" (UID: \"e06e57b2-920d-463e-8607-2c1365c8c2e5\") " Mar 16 16:39:52 crc kubenswrapper[5120]: I0316 16:39:52.644000 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bgjlp\" (UniqueName: \"kubernetes.io/projected/e06e57b2-920d-463e-8607-2c1365c8c2e5-kube-api-access-bgjlp\") pod \"e06e57b2-920d-463e-8607-2c1365c8c2e5\" (UID: \"e06e57b2-920d-463e-8607-2c1365c8c2e5\") " Mar 16 16:39:52 crc kubenswrapper[5120]: I0316 16:39:52.644180 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e06e57b2-920d-463e-8607-2c1365c8c2e5-config\") pod \"e06e57b2-920d-463e-8607-2c1365c8c2e5\" (UID: \"e06e57b2-920d-463e-8607-2c1365c8c2e5\") " Mar 16 16:39:52 crc kubenswrapper[5120]: I0316 16:39:52.652411 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e06e57b2-920d-463e-8607-2c1365c8c2e5-kube-api-access-bgjlp" (OuterVolumeSpecName: "kube-api-access-bgjlp") pod "e06e57b2-920d-463e-8607-2c1365c8c2e5" (UID: "e06e57b2-920d-463e-8607-2c1365c8c2e5"). InnerVolumeSpecName "kube-api-access-bgjlp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:39:52 crc kubenswrapper[5120]: I0316 16:39:52.752371 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bgjlp\" (UniqueName: \"kubernetes.io/projected/e06e57b2-920d-463e-8607-2c1365c8c2e5-kube-api-access-bgjlp\") on node \"crc\" DevicePath \"\"" Mar 16 16:39:52 crc kubenswrapper[5120]: I0316 16:39:52.831221 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e06e57b2-920d-463e-8607-2c1365c8c2e5-config" (OuterVolumeSpecName: "config") pod "e06e57b2-920d-463e-8607-2c1365c8c2e5" (UID: "e06e57b2-920d-463e-8607-2c1365c8c2e5"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:39:52 crc kubenswrapper[5120]: I0316 16:39:52.849168 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e06e57b2-920d-463e-8607-2c1365c8c2e5-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "e06e57b2-920d-463e-8607-2c1365c8c2e5" (UID: "e06e57b2-920d-463e-8607-2c1365c8c2e5"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:39:52 crc kubenswrapper[5120]: I0316 16:39:52.857112 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e06e57b2-920d-463e-8607-2c1365c8c2e5-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:39:52 crc kubenswrapper[5120]: I0316 16:39:52.857155 5120 reconciler_common.go:299] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/e06e57b2-920d-463e-8607-2c1365c8c2e5-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Mar 16 16:39:52 crc kubenswrapper[5120]: I0316 16:39:52.961527 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"8aa3ff5c-e848-4140-8c6b-074365d7c3b9","Type":"ContainerStarted","Data":"24c0894ef06547be1566571e8f254f810b1f00c096afa16b4bc459151c30738c"} Mar 16 16:39:52 crc kubenswrapper[5120]: I0316 16:39:52.978379 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"dbe84e5b-abdf-4300-a41e-26507a638f6e","Type":"ContainerStarted","Data":"aaaa3047ea6ddfa53e4fffe26abb9aeab7722630d030f2c35817080bdd772765"} Mar 16 16:39:52 crc kubenswrapper[5120]: I0316 16:39:52.979532 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:39:52 crc kubenswrapper[5120]: I0316 16:39:52.991100 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"41971ebe-e2c3-4815-97c5-011ff54825b7","Type":"ContainerStarted","Data":"4aebcca63f9230179437a529e538e201de4a66f03150428a0ea3f54787a28284"} Mar 16 16:39:53 crc kubenswrapper[5120]: I0316 16:39:53.004012 5120 generic.go:358] "Generic (PLEG): container finished" podID="e06e57b2-920d-463e-8607-2c1365c8c2e5" containerID="879bdb7a2180e55912537bf6753488771e521f58922f739dedb133892fb70585" exitCode=0 Mar 16 16:39:53 crc kubenswrapper[5120]: I0316 16:39:53.004408 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-8t4vn" event={"ID":"e06e57b2-920d-463e-8607-2c1365c8c2e5","Type":"ContainerDied","Data":"879bdb7a2180e55912537bf6753488771e521f58922f739dedb133892fb70585"} Mar 16 16:39:53 crc kubenswrapper[5120]: I0316 16:39:53.004490 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-8t4vn" event={"ID":"e06e57b2-920d-463e-8607-2c1365c8c2e5","Type":"ContainerDied","Data":"b8d289ad22cc2ddc35243ef0fb1f34084ea1cbfc17ca11393a6be88a50a8b736"} Mar 16 16:39:53 crc kubenswrapper[5120]: I0316 16:39:53.004515 5120 scope.go:117] "RemoveContainer" containerID="879bdb7a2180e55912537bf6753488771e521f58922f739dedb133892fb70585" Mar 16 16:39:53 crc kubenswrapper[5120]: I0316 16:39:53.004816 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-8t4vn" Mar 16 16:39:53 crc kubenswrapper[5120]: I0316 16:39:53.004982 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-599744884-vf6rr" Mar 16 16:39:53 crc kubenswrapper[5120]: I0316 16:39:53.005209 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-599744884-vf6rr" Mar 16 16:39:53 crc kubenswrapper[5120]: I0316 16:39:53.012751 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=1.889174681 podStartE2EDuration="7.012734387s" podCreationTimestamp="2026-03-16 16:39:46 +0000 UTC" firstStartedPulling="2026-03-16 16:39:47.131659332 +0000 UTC m=+4089.285590989" lastFinishedPulling="2026-03-16 16:39:52.255219038 +0000 UTC m=+4094.409150695" observedRunningTime="2026-03-16 16:39:53.012058339 +0000 UTC m=+4095.165989986" watchObservedRunningTime="2026-03-16 16:39:53.012734387 +0000 UTC m=+4095.166666044" Mar 16 16:39:53 crc kubenswrapper[5120]: I0316 16:39:53.080598 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-8t4vn"] Mar 16 16:39:53 crc kubenswrapper[5120]: I0316 16:39:53.090571 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-8t4vn"] Mar 16 16:39:53 crc kubenswrapper[5120]: I0316 16:39:53.109369 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:39:53 crc kubenswrapper[5120]: I0316 16:39:53.110703 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e06e57b2-920d-463e-8607-2c1365c8c2e5" containerName="dnsmasq-dns" Mar 16 16:39:53 crc kubenswrapper[5120]: I0316 16:39:53.110721 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e06e57b2-920d-463e-8607-2c1365c8c2e5" containerName="dnsmasq-dns" Mar 16 16:39:53 crc kubenswrapper[5120]: I0316 16:39:53.110733 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e06e57b2-920d-463e-8607-2c1365c8c2e5" containerName="init" Mar 16 16:39:53 crc kubenswrapper[5120]: I0316 16:39:53.110739 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e06e57b2-920d-463e-8607-2c1365c8c2e5" containerName="init" Mar 16 16:39:53 crc kubenswrapper[5120]: I0316 16:39:53.110756 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="334707cf-7ffa-4fe5-94c5-e9402769ca11" containerName="glance-db-sync" Mar 16 16:39:53 crc kubenswrapper[5120]: I0316 16:39:53.110784 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="334707cf-7ffa-4fe5-94c5-e9402769ca11" containerName="glance-db-sync" Mar 16 16:39:53 crc kubenswrapper[5120]: I0316 16:39:53.110941 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="334707cf-7ffa-4fe5-94c5-e9402769ca11" containerName="glance-db-sync" Mar 16 16:39:53 crc kubenswrapper[5120]: I0316 16:39:53.110954 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e06e57b2-920d-463e-8607-2c1365c8c2e5" containerName="dnsmasq-dns" Mar 16 16:39:53 crc kubenswrapper[5120]: I0316 16:39:53.118090 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:39:53 crc kubenswrapper[5120]: I0316 16:39:53.125298 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:39:53 crc kubenswrapper[5120]: I0316 16:39:53.135500 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-scripts\"" Mar 16 16:39:53 crc kubenswrapper[5120]: I0316 16:39:53.135708 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-glance-dockercfg-rstps\"" Mar 16 16:39:53 crc kubenswrapper[5120]: I0316 16:39:53.139200 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-external-config-data\"" Mar 16 16:39:53 crc kubenswrapper[5120]: I0316 16:39:53.187440 5120 scope.go:117] "RemoveContainer" containerID="eac3ce7db4688a2a4729b65bbd6b8d2b6e1e46040a71a118988c54b1e78fc10f" Mar 16 16:39:53 crc kubenswrapper[5120]: I0316 16:39:53.223663 5120 scope.go:117] "RemoveContainer" containerID="879bdb7a2180e55912537bf6753488771e521f58922f739dedb133892fb70585" Mar 16 16:39:53 crc kubenswrapper[5120]: E0316 16:39:53.224319 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"879bdb7a2180e55912537bf6753488771e521f58922f739dedb133892fb70585\": container with ID starting with 879bdb7a2180e55912537bf6753488771e521f58922f739dedb133892fb70585 not found: ID does not exist" containerID="879bdb7a2180e55912537bf6753488771e521f58922f739dedb133892fb70585" Mar 16 16:39:53 crc kubenswrapper[5120]: I0316 16:39:53.224350 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"879bdb7a2180e55912537bf6753488771e521f58922f739dedb133892fb70585"} err="failed to get container status \"879bdb7a2180e55912537bf6753488771e521f58922f739dedb133892fb70585\": rpc error: code = NotFound desc = could not find container \"879bdb7a2180e55912537bf6753488771e521f58922f739dedb133892fb70585\": container with ID starting with 879bdb7a2180e55912537bf6753488771e521f58922f739dedb133892fb70585 not found: ID does not exist" Mar 16 16:39:53 crc kubenswrapper[5120]: I0316 16:39:53.224369 5120 scope.go:117] "RemoveContainer" containerID="eac3ce7db4688a2a4729b65bbd6b8d2b6e1e46040a71a118988c54b1e78fc10f" Mar 16 16:39:53 crc kubenswrapper[5120]: E0316 16:39:53.224966 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eac3ce7db4688a2a4729b65bbd6b8d2b6e1e46040a71a118988c54b1e78fc10f\": container with ID starting with eac3ce7db4688a2a4729b65bbd6b8d2b6e1e46040a71a118988c54b1e78fc10f not found: ID does not exist" containerID="eac3ce7db4688a2a4729b65bbd6b8d2b6e1e46040a71a118988c54b1e78fc10f" Mar 16 16:39:53 crc kubenswrapper[5120]: I0316 16:39:53.224994 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eac3ce7db4688a2a4729b65bbd6b8d2b6e1e46040a71a118988c54b1e78fc10f"} err="failed to get container status \"eac3ce7db4688a2a4729b65bbd6b8d2b6e1e46040a71a118988c54b1e78fc10f\": rpc error: code = NotFound desc = could not find container \"eac3ce7db4688a2a4729b65bbd6b8d2b6e1e46040a71a118988c54b1e78fc10f\": container with ID starting with eac3ce7db4688a2a4729b65bbd6b8d2b6e1e46040a71a118988c54b1e78fc10f not found: ID does not exist" Mar 16 16:39:53 crc kubenswrapper[5120]: I0316 16:39:53.248388 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:39:53 crc kubenswrapper[5120]: I0316 16:39:53.257792 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:39:53 crc kubenswrapper[5120]: I0316 16:39:53.259528 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-internal-config-data\"" Mar 16 16:39:53 crc kubenswrapper[5120]: I0316 16:39:53.259634 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:39:53 crc kubenswrapper[5120]: I0316 16:39:53.291500 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"glance-default-external-api-0\" (UID: \"35dc0e58-ff4f-41f0-9dff-caacb6ec7d24\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:39:53 crc kubenswrapper[5120]: I0316 16:39:53.291631 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/35dc0e58-ff4f-41f0-9dff-caacb6ec7d24-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"35dc0e58-ff4f-41f0-9dff-caacb6ec7d24\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:39:53 crc kubenswrapper[5120]: I0316 16:39:53.291689 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/35dc0e58-ff4f-41f0-9dff-caacb6ec7d24-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"35dc0e58-ff4f-41f0-9dff-caacb6ec7d24\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:39:53 crc kubenswrapper[5120]: I0316 16:39:53.291778 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tt852\" (UniqueName: \"kubernetes.io/projected/35dc0e58-ff4f-41f0-9dff-caacb6ec7d24-kube-api-access-tt852\") pod \"glance-default-external-api-0\" (UID: \"35dc0e58-ff4f-41f0-9dff-caacb6ec7d24\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:39:53 crc kubenswrapper[5120]: I0316 16:39:53.291891 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/35dc0e58-ff4f-41f0-9dff-caacb6ec7d24-scripts\") pod \"glance-default-external-api-0\" (UID: \"35dc0e58-ff4f-41f0-9dff-caacb6ec7d24\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:39:53 crc kubenswrapper[5120]: I0316 16:39:53.292062 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/35dc0e58-ff4f-41f0-9dff-caacb6ec7d24-logs\") pod \"glance-default-external-api-0\" (UID: \"35dc0e58-ff4f-41f0-9dff-caacb6ec7d24\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:39:53 crc kubenswrapper[5120]: I0316 16:39:53.292331 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/35dc0e58-ff4f-41f0-9dff-caacb6ec7d24-config-data\") pod \"glance-default-external-api-0\" (UID: \"35dc0e58-ff4f-41f0-9dff-caacb6ec7d24\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:39:53 crc kubenswrapper[5120]: I0316 16:39:53.414976 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tt852\" (UniqueName: \"kubernetes.io/projected/35dc0e58-ff4f-41f0-9dff-caacb6ec7d24-kube-api-access-tt852\") pod \"glance-default-external-api-0\" (UID: \"35dc0e58-ff4f-41f0-9dff-caacb6ec7d24\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:39:53 crc kubenswrapper[5120]: I0316 16:39:53.425033 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/35dc0e58-ff4f-41f0-9dff-caacb6ec7d24-scripts\") pod \"glance-default-external-api-0\" (UID: \"35dc0e58-ff4f-41f0-9dff-caacb6ec7d24\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:39:53 crc kubenswrapper[5120]: I0316 16:39:53.425346 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/35dc0e58-ff4f-41f0-9dff-caacb6ec7d24-logs\") pod \"glance-default-external-api-0\" (UID: \"35dc0e58-ff4f-41f0-9dff-caacb6ec7d24\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:39:53 crc kubenswrapper[5120]: I0316 16:39:53.425460 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/35dc0e58-ff4f-41f0-9dff-caacb6ec7d24-config-data\") pod \"glance-default-external-api-0\" (UID: \"35dc0e58-ff4f-41f0-9dff-caacb6ec7d24\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:39:53 crc kubenswrapper[5120]: I0316 16:39:53.425586 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"glance-default-external-api-0\" (UID: \"35dc0e58-ff4f-41f0-9dff-caacb6ec7d24\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:39:53 crc kubenswrapper[5120]: I0316 16:39:53.425698 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/35dc0e58-ff4f-41f0-9dff-caacb6ec7d24-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"35dc0e58-ff4f-41f0-9dff-caacb6ec7d24\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:39:53 crc kubenswrapper[5120]: I0316 16:39:53.425800 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/35dc0e58-ff4f-41f0-9dff-caacb6ec7d24-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"35dc0e58-ff4f-41f0-9dff-caacb6ec7d24\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:39:53 crc kubenswrapper[5120]: I0316 16:39:53.426403 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/35dc0e58-ff4f-41f0-9dff-caacb6ec7d24-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"35dc0e58-ff4f-41f0-9dff-caacb6ec7d24\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:39:53 crc kubenswrapper[5120]: I0316 16:39:53.427515 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"glance-default-external-api-0\" (UID: \"35dc0e58-ff4f-41f0-9dff-caacb6ec7d24\") device mount path \"/mnt/openstack/pv20\"" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:39:53 crc kubenswrapper[5120]: I0316 16:39:53.451998 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/35dc0e58-ff4f-41f0-9dff-caacb6ec7d24-logs\") pod \"glance-default-external-api-0\" (UID: \"35dc0e58-ff4f-41f0-9dff-caacb6ec7d24\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:39:53 crc kubenswrapper[5120]: I0316 16:39:53.459892 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tt852\" (UniqueName: \"kubernetes.io/projected/35dc0e58-ff4f-41f0-9dff-caacb6ec7d24-kube-api-access-tt852\") pod \"glance-default-external-api-0\" (UID: \"35dc0e58-ff4f-41f0-9dff-caacb6ec7d24\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:39:53 crc kubenswrapper[5120]: I0316 16:39:53.480822 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/35dc0e58-ff4f-41f0-9dff-caacb6ec7d24-config-data\") pod \"glance-default-external-api-0\" (UID: \"35dc0e58-ff4f-41f0-9dff-caacb6ec7d24\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:39:53 crc kubenswrapper[5120]: I0316 16:39:53.503666 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/35dc0e58-ff4f-41f0-9dff-caacb6ec7d24-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"35dc0e58-ff4f-41f0-9dff-caacb6ec7d24\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:39:53 crc kubenswrapper[5120]: I0316 16:39:53.504146 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"glance-default-external-api-0\" (UID: \"35dc0e58-ff4f-41f0-9dff-caacb6ec7d24\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:39:53 crc kubenswrapper[5120]: I0316 16:39:53.504794 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/35dc0e58-ff4f-41f0-9dff-caacb6ec7d24-scripts\") pod \"glance-default-external-api-0\" (UID: \"35dc0e58-ff4f-41f0-9dff-caacb6ec7d24\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:39:53 crc kubenswrapper[5120]: I0316 16:39:53.527242 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1a484747-d317-490a-a502-2c0be9bbcf55-config-data\") pod \"glance-default-internal-api-0\" (UID: \"1a484747-d317-490a-a502-2c0be9bbcf55\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:39:53 crc kubenswrapper[5120]: I0316 16:39:53.527304 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1a484747-d317-490a-a502-2c0be9bbcf55-scripts\") pod \"glance-default-internal-api-0\" (UID: \"1a484747-d317-490a-a502-2c0be9bbcf55\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:39:53 crc kubenswrapper[5120]: I0316 16:39:53.527352 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"glance-default-internal-api-0\" (UID: \"1a484747-d317-490a-a502-2c0be9bbcf55\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:39:53 crc kubenswrapper[5120]: I0316 16:39:53.527418 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/1a484747-d317-490a-a502-2c0be9bbcf55-logs\") pod \"glance-default-internal-api-0\" (UID: \"1a484747-d317-490a-a502-2c0be9bbcf55\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:39:53 crc kubenswrapper[5120]: I0316 16:39:53.527446 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1a484747-d317-490a-a502-2c0be9bbcf55-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"1a484747-d317-490a-a502-2c0be9bbcf55\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:39:53 crc kubenswrapper[5120]: I0316 16:39:53.527566 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/1a484747-d317-490a-a502-2c0be9bbcf55-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"1a484747-d317-490a-a502-2c0be9bbcf55\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:39:53 crc kubenswrapper[5120]: I0316 16:39:53.527639 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chkpg\" (UniqueName: \"kubernetes.io/projected/1a484747-d317-490a-a502-2c0be9bbcf55-kube-api-access-chkpg\") pod \"glance-default-internal-api-0\" (UID: \"1a484747-d317-490a-a502-2c0be9bbcf55\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:39:53 crc kubenswrapper[5120]: I0316 16:39:53.572215 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:39:53 crc kubenswrapper[5120]: I0316 16:39:53.630605 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"glance-default-internal-api-0\" (UID: \"1a484747-d317-490a-a502-2c0be9bbcf55\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:39:53 crc kubenswrapper[5120]: I0316 16:39:53.630710 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/1a484747-d317-490a-a502-2c0be9bbcf55-logs\") pod \"glance-default-internal-api-0\" (UID: \"1a484747-d317-490a-a502-2c0be9bbcf55\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:39:53 crc kubenswrapper[5120]: I0316 16:39:53.630731 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1a484747-d317-490a-a502-2c0be9bbcf55-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"1a484747-d317-490a-a502-2c0be9bbcf55\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:39:53 crc kubenswrapper[5120]: I0316 16:39:53.631230 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/1a484747-d317-490a-a502-2c0be9bbcf55-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"1a484747-d317-490a-a502-2c0be9bbcf55\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:39:53 crc kubenswrapper[5120]: I0316 16:39:53.631334 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-chkpg\" (UniqueName: \"kubernetes.io/projected/1a484747-d317-490a-a502-2c0be9bbcf55-kube-api-access-chkpg\") pod \"glance-default-internal-api-0\" (UID: \"1a484747-d317-490a-a502-2c0be9bbcf55\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:39:53 crc kubenswrapper[5120]: I0316 16:39:53.631510 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1a484747-d317-490a-a502-2c0be9bbcf55-config-data\") pod \"glance-default-internal-api-0\" (UID: \"1a484747-d317-490a-a502-2c0be9bbcf55\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:39:53 crc kubenswrapper[5120]: I0316 16:39:53.631554 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1a484747-d317-490a-a502-2c0be9bbcf55-scripts\") pod \"glance-default-internal-api-0\" (UID: \"1a484747-d317-490a-a502-2c0be9bbcf55\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:39:53 crc kubenswrapper[5120]: I0316 16:39:53.636302 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"glance-default-internal-api-0\" (UID: \"1a484747-d317-490a-a502-2c0be9bbcf55\") device mount path \"/mnt/openstack/pv06\"" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:39:53 crc kubenswrapper[5120]: I0316 16:39:53.636421 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/1a484747-d317-490a-a502-2c0be9bbcf55-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"1a484747-d317-490a-a502-2c0be9bbcf55\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:39:53 crc kubenswrapper[5120]: I0316 16:39:53.636650 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/1a484747-d317-490a-a502-2c0be9bbcf55-logs\") pod \"glance-default-internal-api-0\" (UID: \"1a484747-d317-490a-a502-2c0be9bbcf55\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:39:53 crc kubenswrapper[5120]: I0316 16:39:53.641252 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-p2zn5" Mar 16 16:39:53 crc kubenswrapper[5120]: I0316 16:39:53.655556 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1a484747-d317-490a-a502-2c0be9bbcf55-scripts\") pod \"glance-default-internal-api-0\" (UID: \"1a484747-d317-490a-a502-2c0be9bbcf55\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:39:53 crc kubenswrapper[5120]: I0316 16:39:53.657115 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1a484747-d317-490a-a502-2c0be9bbcf55-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"1a484747-d317-490a-a502-2c0be9bbcf55\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:39:53 crc kubenswrapper[5120]: I0316 16:39:53.657046 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1a484747-d317-490a-a502-2c0be9bbcf55-config-data\") pod \"glance-default-internal-api-0\" (UID: \"1a484747-d317-490a-a502-2c0be9bbcf55\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:39:53 crc kubenswrapper[5120]: I0316 16:39:53.690089 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-chkpg\" (UniqueName: \"kubernetes.io/projected/1a484747-d317-490a-a502-2c0be9bbcf55-kube-api-access-chkpg\") pod \"glance-default-internal-api-0\" (UID: \"1a484747-d317-490a-a502-2c0be9bbcf55\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:39:53 crc kubenswrapper[5120]: I0316 16:39:53.705989 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"glance-default-internal-api-0\" (UID: \"1a484747-d317-490a-a502-2c0be9bbcf55\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:39:53 crc kubenswrapper[5120]: I0316 16:39:53.732911 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/99e73376-04fb-4c3c-932a-115a4dd47186-scripts\") pod \"99e73376-04fb-4c3c-932a-115a4dd47186\" (UID: \"99e73376-04fb-4c3c-932a-115a4dd47186\") " Mar 16 16:39:53 crc kubenswrapper[5120]: I0316 16:39:53.734348 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/99e73376-04fb-4c3c-932a-115a4dd47186-config-data\") pod \"99e73376-04fb-4c3c-932a-115a4dd47186\" (UID: \"99e73376-04fb-4c3c-932a-115a4dd47186\") " Mar 16 16:39:53 crc kubenswrapper[5120]: I0316 16:39:53.734566 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rrzt8\" (UniqueName: \"kubernetes.io/projected/99e73376-04fb-4c3c-932a-115a4dd47186-kube-api-access-rrzt8\") pod \"99e73376-04fb-4c3c-932a-115a4dd47186\" (UID: \"99e73376-04fb-4c3c-932a-115a4dd47186\") " Mar 16 16:39:53 crc kubenswrapper[5120]: I0316 16:39:53.734958 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/99e73376-04fb-4c3c-932a-115a4dd47186-combined-ca-bundle\") pod \"99e73376-04fb-4c3c-932a-115a4dd47186\" (UID: \"99e73376-04fb-4c3c-932a-115a4dd47186\") " Mar 16 16:39:53 crc kubenswrapper[5120]: I0316 16:39:53.734991 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/99e73376-04fb-4c3c-932a-115a4dd47186-fernet-keys\") pod \"99e73376-04fb-4c3c-932a-115a4dd47186\" (UID: \"99e73376-04fb-4c3c-932a-115a4dd47186\") " Mar 16 16:39:53 crc kubenswrapper[5120]: I0316 16:39:53.735043 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/99e73376-04fb-4c3c-932a-115a4dd47186-credential-keys\") pod \"99e73376-04fb-4c3c-932a-115a4dd47186\" (UID: \"99e73376-04fb-4c3c-932a-115a4dd47186\") " Mar 16 16:39:53 crc kubenswrapper[5120]: I0316 16:39:53.747827 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/99e73376-04fb-4c3c-932a-115a4dd47186-kube-api-access-rrzt8" (OuterVolumeSpecName: "kube-api-access-rrzt8") pod "99e73376-04fb-4c3c-932a-115a4dd47186" (UID: "99e73376-04fb-4c3c-932a-115a4dd47186"). InnerVolumeSpecName "kube-api-access-rrzt8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:39:53 crc kubenswrapper[5120]: I0316 16:39:53.753931 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/99e73376-04fb-4c3c-932a-115a4dd47186-scripts" (OuterVolumeSpecName: "scripts") pod "99e73376-04fb-4c3c-932a-115a4dd47186" (UID: "99e73376-04fb-4c3c-932a-115a4dd47186"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:39:53 crc kubenswrapper[5120]: I0316 16:39:53.795901 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/99e73376-04fb-4c3c-932a-115a4dd47186-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "99e73376-04fb-4c3c-932a-115a4dd47186" (UID: "99e73376-04fb-4c3c-932a-115a4dd47186"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:39:53 crc kubenswrapper[5120]: I0316 16:39:53.811187 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/99e73376-04fb-4c3c-932a-115a4dd47186-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "99e73376-04fb-4c3c-932a-115a4dd47186" (UID: "99e73376-04fb-4c3c-932a-115a4dd47186"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:39:53 crc kubenswrapper[5120]: I0316 16:39:53.835403 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/99e73376-04fb-4c3c-932a-115a4dd47186-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "99e73376-04fb-4c3c-932a-115a4dd47186" (UID: "99e73376-04fb-4c3c-932a-115a4dd47186"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:39:53 crc kubenswrapper[5120]: I0316 16:39:53.843286 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/99e73376-04fb-4c3c-932a-115a4dd47186-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:39:53 crc kubenswrapper[5120]: I0316 16:39:53.843322 5120 reconciler_common.go:299] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/99e73376-04fb-4c3c-932a-115a4dd47186-fernet-keys\") on node \"crc\" DevicePath \"\"" Mar 16 16:39:53 crc kubenswrapper[5120]: I0316 16:39:53.843331 5120 reconciler_common.go:299] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/99e73376-04fb-4c3c-932a-115a4dd47186-credential-keys\") on node \"crc\" DevicePath \"\"" Mar 16 16:39:53 crc kubenswrapper[5120]: I0316 16:39:53.843339 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/99e73376-04fb-4c3c-932a-115a4dd47186-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:39:53 crc kubenswrapper[5120]: I0316 16:39:53.843350 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rrzt8\" (UniqueName: \"kubernetes.io/projected/99e73376-04fb-4c3c-932a-115a4dd47186-kube-api-access-rrzt8\") on node \"crc\" DevicePath \"\"" Mar 16 16:39:53 crc kubenswrapper[5120]: I0316 16:39:53.846617 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/99e73376-04fb-4c3c-932a-115a4dd47186-config-data" (OuterVolumeSpecName: "config-data") pod "99e73376-04fb-4c3c-932a-115a4dd47186" (UID: "99e73376-04fb-4c3c-932a-115a4dd47186"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:39:53 crc kubenswrapper[5120]: I0316 16:39:53.897249 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:39:53 crc kubenswrapper[5120]: I0316 16:39:53.948203 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/99e73376-04fb-4c3c-932a-115a4dd47186-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:39:54 crc kubenswrapper[5120]: I0316 16:39:54.065845 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-74449f99d8-kxw96"] Mar 16 16:39:54 crc kubenswrapper[5120]: I0316 16:39:54.067068 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99e73376-04fb-4c3c-932a-115a4dd47186" containerName="keystone-bootstrap" Mar 16 16:39:54 crc kubenswrapper[5120]: I0316 16:39:54.067088 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="99e73376-04fb-4c3c-932a-115a4dd47186" containerName="keystone-bootstrap" Mar 16 16:39:54 crc kubenswrapper[5120]: I0316 16:39:54.067419 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="99e73376-04fb-4c3c-932a-115a4dd47186" containerName="keystone-bootstrap" Mar 16 16:39:54 crc kubenswrapper[5120]: I0316 16:39:54.077062 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-74449f99d8-kxw96" Mar 16 16:39:54 crc kubenswrapper[5120]: I0316 16:39:54.083543 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-keystone-public-svc\"" Mar 16 16:39:54 crc kubenswrapper[5120]: I0316 16:39:54.086971 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-keystone-internal-svc\"" Mar 16 16:39:54 crc kubenswrapper[5120]: I0316 16:39:54.087933 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-74449f99d8-kxw96"] Mar 16 16:39:54 crc kubenswrapper[5120]: I0316 16:39:54.106052 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-p2zn5" Mar 16 16:39:54 crc kubenswrapper[5120]: I0316 16:39:54.106049 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-p2zn5" event={"ID":"99e73376-04fb-4c3c-932a-115a4dd47186","Type":"ContainerDied","Data":"d7af69560047bc9873ee0ce78465377454bf3f2756d26f7801dc3155410cd0c0"} Mar 16 16:39:54 crc kubenswrapper[5120]: I0316 16:39:54.109115 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d7af69560047bc9873ee0ce78465377454bf3f2756d26f7801dc3155410cd0c0" Mar 16 16:39:54 crc kubenswrapper[5120]: I0316 16:39:54.160566 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/c5223e38-12b9-4877-9a14-585ddcd5f699-credential-keys\") pod \"keystone-74449f99d8-kxw96\" (UID: \"c5223e38-12b9-4877-9a14-585ddcd5f699\") " pod="openstack-kuttl-tests/keystone-74449f99d8-kxw96" Mar 16 16:39:54 crc kubenswrapper[5120]: I0316 16:39:54.168190 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/c5223e38-12b9-4877-9a14-585ddcd5f699-internal-tls-certs\") pod \"keystone-74449f99d8-kxw96\" (UID: \"c5223e38-12b9-4877-9a14-585ddcd5f699\") " pod="openstack-kuttl-tests/keystone-74449f99d8-kxw96" Mar 16 16:39:54 crc kubenswrapper[5120]: I0316 16:39:54.168967 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/c5223e38-12b9-4877-9a14-585ddcd5f699-fernet-keys\") pod \"keystone-74449f99d8-kxw96\" (UID: \"c5223e38-12b9-4877-9a14-585ddcd5f699\") " pod="openstack-kuttl-tests/keystone-74449f99d8-kxw96" Mar 16 16:39:54 crc kubenswrapper[5120]: I0316 16:39:54.169217 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c5223e38-12b9-4877-9a14-585ddcd5f699-combined-ca-bundle\") pod \"keystone-74449f99d8-kxw96\" (UID: \"c5223e38-12b9-4877-9a14-585ddcd5f699\") " pod="openstack-kuttl-tests/keystone-74449f99d8-kxw96" Mar 16 16:39:54 crc kubenswrapper[5120]: I0316 16:39:54.169454 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c5223e38-12b9-4877-9a14-585ddcd5f699-scripts\") pod \"keystone-74449f99d8-kxw96\" (UID: \"c5223e38-12b9-4877-9a14-585ddcd5f699\") " pod="openstack-kuttl-tests/keystone-74449f99d8-kxw96" Mar 16 16:39:54 crc kubenswrapper[5120]: I0316 16:39:54.169691 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hld5m\" (UniqueName: \"kubernetes.io/projected/c5223e38-12b9-4877-9a14-585ddcd5f699-kube-api-access-hld5m\") pod \"keystone-74449f99d8-kxw96\" (UID: \"c5223e38-12b9-4877-9a14-585ddcd5f699\") " pod="openstack-kuttl-tests/keystone-74449f99d8-kxw96" Mar 16 16:39:54 crc kubenswrapper[5120]: I0316 16:39:54.175937 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/c5223e38-12b9-4877-9a14-585ddcd5f699-public-tls-certs\") pod \"keystone-74449f99d8-kxw96\" (UID: \"c5223e38-12b9-4877-9a14-585ddcd5f699\") " pod="openstack-kuttl-tests/keystone-74449f99d8-kxw96" Mar 16 16:39:54 crc kubenswrapper[5120]: I0316 16:39:54.176421 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c5223e38-12b9-4877-9a14-585ddcd5f699-config-data\") pod \"keystone-74449f99d8-kxw96\" (UID: \"c5223e38-12b9-4877-9a14-585ddcd5f699\") " pod="openstack-kuttl-tests/keystone-74449f99d8-kxw96" Mar 16 16:39:54 crc kubenswrapper[5120]: I0316 16:39:54.200340 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"41971ebe-e2c3-4815-97c5-011ff54825b7","Type":"ContainerStarted","Data":"4e67e989637bb99ce5515061a489eda8b16c3352162f462f48c338278482e963"} Mar 16 16:39:54 crc kubenswrapper[5120]: I0316 16:39:54.281082 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-scheduler-0" podStartSLOduration=4.281057421 podStartE2EDuration="4.281057421s" podCreationTimestamp="2026-03-16 16:39:50 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:39:54.235131324 +0000 UTC m=+4096.389062991" watchObservedRunningTime="2026-03-16 16:39:54.281057421 +0000 UTC m=+4096.434989078" Mar 16 16:39:54 crc kubenswrapper[5120]: I0316 16:39:54.285777 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/c5223e38-12b9-4877-9a14-585ddcd5f699-internal-tls-certs\") pod \"keystone-74449f99d8-kxw96\" (UID: \"c5223e38-12b9-4877-9a14-585ddcd5f699\") " pod="openstack-kuttl-tests/keystone-74449f99d8-kxw96" Mar 16 16:39:54 crc kubenswrapper[5120]: I0316 16:39:54.285892 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/c5223e38-12b9-4877-9a14-585ddcd5f699-fernet-keys\") pod \"keystone-74449f99d8-kxw96\" (UID: \"c5223e38-12b9-4877-9a14-585ddcd5f699\") " pod="openstack-kuttl-tests/keystone-74449f99d8-kxw96" Mar 16 16:39:54 crc kubenswrapper[5120]: I0316 16:39:54.285965 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c5223e38-12b9-4877-9a14-585ddcd5f699-combined-ca-bundle\") pod \"keystone-74449f99d8-kxw96\" (UID: \"c5223e38-12b9-4877-9a14-585ddcd5f699\") " pod="openstack-kuttl-tests/keystone-74449f99d8-kxw96" Mar 16 16:39:54 crc kubenswrapper[5120]: I0316 16:39:54.286001 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c5223e38-12b9-4877-9a14-585ddcd5f699-scripts\") pod \"keystone-74449f99d8-kxw96\" (UID: \"c5223e38-12b9-4877-9a14-585ddcd5f699\") " pod="openstack-kuttl-tests/keystone-74449f99d8-kxw96" Mar 16 16:39:54 crc kubenswrapper[5120]: I0316 16:39:54.286110 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hld5m\" (UniqueName: \"kubernetes.io/projected/c5223e38-12b9-4877-9a14-585ddcd5f699-kube-api-access-hld5m\") pod \"keystone-74449f99d8-kxw96\" (UID: \"c5223e38-12b9-4877-9a14-585ddcd5f699\") " pod="openstack-kuttl-tests/keystone-74449f99d8-kxw96" Mar 16 16:39:54 crc kubenswrapper[5120]: I0316 16:39:54.286135 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/c5223e38-12b9-4877-9a14-585ddcd5f699-public-tls-certs\") pod \"keystone-74449f99d8-kxw96\" (UID: \"c5223e38-12b9-4877-9a14-585ddcd5f699\") " pod="openstack-kuttl-tests/keystone-74449f99d8-kxw96" Mar 16 16:39:54 crc kubenswrapper[5120]: I0316 16:39:54.288074 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c5223e38-12b9-4877-9a14-585ddcd5f699-config-data\") pod \"keystone-74449f99d8-kxw96\" (UID: \"c5223e38-12b9-4877-9a14-585ddcd5f699\") " pod="openstack-kuttl-tests/keystone-74449f99d8-kxw96" Mar 16 16:39:54 crc kubenswrapper[5120]: I0316 16:39:54.288609 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/c5223e38-12b9-4877-9a14-585ddcd5f699-credential-keys\") pod \"keystone-74449f99d8-kxw96\" (UID: \"c5223e38-12b9-4877-9a14-585ddcd5f699\") " pod="openstack-kuttl-tests/keystone-74449f99d8-kxw96" Mar 16 16:39:54 crc kubenswrapper[5120]: I0316 16:39:54.308291 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/c5223e38-12b9-4877-9a14-585ddcd5f699-fernet-keys\") pod \"keystone-74449f99d8-kxw96\" (UID: \"c5223e38-12b9-4877-9a14-585ddcd5f699\") " pod="openstack-kuttl-tests/keystone-74449f99d8-kxw96" Mar 16 16:39:54 crc kubenswrapper[5120]: I0316 16:39:54.309362 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c5223e38-12b9-4877-9a14-585ddcd5f699-combined-ca-bundle\") pod \"keystone-74449f99d8-kxw96\" (UID: \"c5223e38-12b9-4877-9a14-585ddcd5f699\") " pod="openstack-kuttl-tests/keystone-74449f99d8-kxw96" Mar 16 16:39:54 crc kubenswrapper[5120]: I0316 16:39:54.311072 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c5223e38-12b9-4877-9a14-585ddcd5f699-scripts\") pod \"keystone-74449f99d8-kxw96\" (UID: \"c5223e38-12b9-4877-9a14-585ddcd5f699\") " pod="openstack-kuttl-tests/keystone-74449f99d8-kxw96" Mar 16 16:39:54 crc kubenswrapper[5120]: I0316 16:39:54.313774 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c5223e38-12b9-4877-9a14-585ddcd5f699-config-data\") pod \"keystone-74449f99d8-kxw96\" (UID: \"c5223e38-12b9-4877-9a14-585ddcd5f699\") " pod="openstack-kuttl-tests/keystone-74449f99d8-kxw96" Mar 16 16:39:54 crc kubenswrapper[5120]: I0316 16:39:54.324611 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/c5223e38-12b9-4877-9a14-585ddcd5f699-public-tls-certs\") pod \"keystone-74449f99d8-kxw96\" (UID: \"c5223e38-12b9-4877-9a14-585ddcd5f699\") " pod="openstack-kuttl-tests/keystone-74449f99d8-kxw96" Mar 16 16:39:54 crc kubenswrapper[5120]: I0316 16:39:54.325324 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/c5223e38-12b9-4877-9a14-585ddcd5f699-internal-tls-certs\") pod \"keystone-74449f99d8-kxw96\" (UID: \"c5223e38-12b9-4877-9a14-585ddcd5f699\") " pod="openstack-kuttl-tests/keystone-74449f99d8-kxw96" Mar 16 16:39:54 crc kubenswrapper[5120]: I0316 16:39:54.327157 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/c5223e38-12b9-4877-9a14-585ddcd5f699-credential-keys\") pod \"keystone-74449f99d8-kxw96\" (UID: \"c5223e38-12b9-4877-9a14-585ddcd5f699\") " pod="openstack-kuttl-tests/keystone-74449f99d8-kxw96" Mar 16 16:39:54 crc kubenswrapper[5120]: I0316 16:39:54.347289 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hld5m\" (UniqueName: \"kubernetes.io/projected/c5223e38-12b9-4877-9a14-585ddcd5f699-kube-api-access-hld5m\") pod \"keystone-74449f99d8-kxw96\" (UID: \"c5223e38-12b9-4877-9a14-585ddcd5f699\") " pod="openstack-kuttl-tests/keystone-74449f99d8-kxw96" Mar 16 16:39:54 crc kubenswrapper[5120]: I0316 16:39:54.374097 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:39:54 crc kubenswrapper[5120]: I0316 16:39:54.441489 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:39:54 crc kubenswrapper[5120]: I0316 16:39:54.506850 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-74449f99d8-kxw96" Mar 16 16:39:54 crc kubenswrapper[5120]: I0316 16:39:54.794731 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e06e57b2-920d-463e-8607-2c1365c8c2e5" path="/var/lib/kubelet/pods/e06e57b2-920d-463e-8607-2c1365c8c2e5/volumes" Mar 16 16:39:54 crc kubenswrapper[5120]: I0316 16:39:54.807365 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:39:54 crc kubenswrapper[5120]: I0316 16:39:54.810721 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:39:55 crc kubenswrapper[5120]: I0316 16:39:55.284206 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-74449f99d8-kxw96"] Mar 16 16:39:55 crc kubenswrapper[5120]: I0316 16:39:55.294524 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"35dc0e58-ff4f-41f0-9dff-caacb6ec7d24","Type":"ContainerStarted","Data":"93c21e0f84e19c12e64ab1651cfcf81b95f35477e761a0cfda3317fb2ae18b94"} Mar 16 16:39:55 crc kubenswrapper[5120]: I0316 16:39:55.295920 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"1a484747-d317-490a-a502-2c0be9bbcf55","Type":"ContainerStarted","Data":"d635bb369248d3b7c9519e5a4c31b338866da15d332f109766d48ba1328c0c09"} Mar 16 16:39:55 crc kubenswrapper[5120]: I0316 16:39:55.318837 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"8aa3ff5c-e848-4140-8c6b-074365d7c3b9","Type":"ContainerStarted","Data":"a32b23379e3e7651c463fe9b9d87a6fc6447c6d7899450ce5b79ce6e0e350fc2"} Mar 16 16:39:55 crc kubenswrapper[5120]: I0316 16:39:55.319084 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="8aa3ff5c-e848-4140-8c6b-074365d7c3b9" containerName="cinder-api-log" containerID="cri-o://24c0894ef06547be1566571e8f254f810b1f00c096afa16b4bc459151c30738c" gracePeriod=30 Mar 16 16:39:55 crc kubenswrapper[5120]: I0316 16:39:55.319920 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="8aa3ff5c-e848-4140-8c6b-074365d7c3b9" containerName="cinder-api" containerID="cri-o://a32b23379e3e7651c463fe9b9d87a6fc6447c6d7899450ce5b79ce6e0e350fc2" gracePeriod=30 Mar 16 16:39:55 crc kubenswrapper[5120]: I0316 16:39:55.320142 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:39:55 crc kubenswrapper[5120]: I0316 16:39:55.373153 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-api-0" podStartSLOduration=5.37313491 podStartE2EDuration="5.37313491s" podCreationTimestamp="2026-03-16 16:39:50 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:39:55.361661258 +0000 UTC m=+4097.515592925" watchObservedRunningTime="2026-03-16 16:39:55.37313491 +0000 UTC m=+4097.527066567" Mar 16 16:39:55 crc kubenswrapper[5120]: I0316 16:39:55.524574 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:39:56 crc kubenswrapper[5120]: I0316 16:39:56.430203 5120 generic.go:358] "Generic (PLEG): container finished" podID="8aa3ff5c-e848-4140-8c6b-074365d7c3b9" containerID="a32b23379e3e7651c463fe9b9d87a6fc6447c6d7899450ce5b79ce6e0e350fc2" exitCode=0 Mar 16 16:39:56 crc kubenswrapper[5120]: I0316 16:39:56.430984 5120 generic.go:358] "Generic (PLEG): container finished" podID="8aa3ff5c-e848-4140-8c6b-074365d7c3b9" containerID="24c0894ef06547be1566571e8f254f810b1f00c096afa16b4bc459151c30738c" exitCode=143 Mar 16 16:39:56 crc kubenswrapper[5120]: I0316 16:39:56.430515 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"8aa3ff5c-e848-4140-8c6b-074365d7c3b9","Type":"ContainerDied","Data":"a32b23379e3e7651c463fe9b9d87a6fc6447c6d7899450ce5b79ce6e0e350fc2"} Mar 16 16:39:56 crc kubenswrapper[5120]: I0316 16:39:56.431403 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"8aa3ff5c-e848-4140-8c6b-074365d7c3b9","Type":"ContainerDied","Data":"24c0894ef06547be1566571e8f254f810b1f00c096afa16b4bc459151c30738c"} Mar 16 16:39:56 crc kubenswrapper[5120]: I0316 16:39:56.440559 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-74449f99d8-kxw96" event={"ID":"c5223e38-12b9-4877-9a14-585ddcd5f699","Type":"ContainerStarted","Data":"3ec9aba3ae79918c6e60be3630e85df012ed6fef4d636eb07f2448c2e855ba01"} Mar 16 16:39:56 crc kubenswrapper[5120]: I0316 16:39:56.466559 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"35dc0e58-ff4f-41f0-9dff-caacb6ec7d24","Type":"ContainerStarted","Data":"aa3d3e7acca98156d0335a1fcc0243e60d7a15b8aeaaed1554aaef4ca2cb666e"} Mar 16 16:39:56 crc kubenswrapper[5120]: I0316 16:39:56.493420 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="dbe84e5b-abdf-4300-a41e-26507a638f6e" containerName="ceilometer-central-agent" containerID="cri-o://319369720a667a7bb1a0c88fafefc7dfc242dc278d328913f43f46f2c6de973d" gracePeriod=30 Mar 16 16:39:56 crc kubenswrapper[5120]: I0316 16:39:56.493733 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"1a484747-d317-490a-a502-2c0be9bbcf55","Type":"ContainerStarted","Data":"4ebc0070cc17ebb78966102b1793a77f503873a5fb66aa631672b9d947d4cea4"} Mar 16 16:39:56 crc kubenswrapper[5120]: I0316 16:39:56.497310 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="dbe84e5b-abdf-4300-a41e-26507a638f6e" containerName="sg-core" containerID="cri-o://9fc2e8df4084347acd634ad812a7cc67034d64eca198e49d1e200757d740e6dc" gracePeriod=30 Mar 16 16:39:56 crc kubenswrapper[5120]: I0316 16:39:56.497451 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="dbe84e5b-abdf-4300-a41e-26507a638f6e" containerName="proxy-httpd" containerID="cri-o://aaaa3047ea6ddfa53e4fffe26abb9aeab7722630d030f2c35817080bdd772765" gracePeriod=30 Mar 16 16:39:56 crc kubenswrapper[5120]: I0316 16:39:56.497718 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="dbe84e5b-abdf-4300-a41e-26507a638f6e" containerName="ceilometer-notification-agent" containerID="cri-o://340ea5b4a4b6b79e8eec7809aa702596df745abcc22f8a28a465f4260dc1fd9d" gracePeriod=30 Mar 16 16:39:56 crc kubenswrapper[5120]: I0316 16:39:56.577937 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:39:56 crc kubenswrapper[5120]: I0316 16:39:56.716283 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/8aa3ff5c-e848-4140-8c6b-074365d7c3b9-config-data-custom\") pod \"8aa3ff5c-e848-4140-8c6b-074365d7c3b9\" (UID: \"8aa3ff5c-e848-4140-8c6b-074365d7c3b9\") " Mar 16 16:39:56 crc kubenswrapper[5120]: I0316 16:39:56.716329 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8aa3ff5c-e848-4140-8c6b-074365d7c3b9-combined-ca-bundle\") pod \"8aa3ff5c-e848-4140-8c6b-074365d7c3b9\" (UID: \"8aa3ff5c-e848-4140-8c6b-074365d7c3b9\") " Mar 16 16:39:56 crc kubenswrapper[5120]: I0316 16:39:56.716357 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8aa3ff5c-e848-4140-8c6b-074365d7c3b9-logs\") pod \"8aa3ff5c-e848-4140-8c6b-074365d7c3b9\" (UID: \"8aa3ff5c-e848-4140-8c6b-074365d7c3b9\") " Mar 16 16:39:56 crc kubenswrapper[5120]: I0316 16:39:56.716468 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/8aa3ff5c-e848-4140-8c6b-074365d7c3b9-etc-machine-id\") pod \"8aa3ff5c-e848-4140-8c6b-074365d7c3b9\" (UID: \"8aa3ff5c-e848-4140-8c6b-074365d7c3b9\") " Mar 16 16:39:56 crc kubenswrapper[5120]: I0316 16:39:56.716635 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8aa3ff5c-e848-4140-8c6b-074365d7c3b9-scripts\") pod \"8aa3ff5c-e848-4140-8c6b-074365d7c3b9\" (UID: \"8aa3ff5c-e848-4140-8c6b-074365d7c3b9\") " Mar 16 16:39:56 crc kubenswrapper[5120]: I0316 16:39:56.716725 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8aa3ff5c-e848-4140-8c6b-074365d7c3b9-config-data\") pod \"8aa3ff5c-e848-4140-8c6b-074365d7c3b9\" (UID: \"8aa3ff5c-e848-4140-8c6b-074365d7c3b9\") " Mar 16 16:39:56 crc kubenswrapper[5120]: I0316 16:39:56.717037 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/8aa3ff5c-e848-4140-8c6b-074365d7c3b9-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "8aa3ff5c-e848-4140-8c6b-074365d7c3b9" (UID: "8aa3ff5c-e848-4140-8c6b-074365d7c3b9"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 16:39:56 crc kubenswrapper[5120]: I0316 16:39:56.717456 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8aa3ff5c-e848-4140-8c6b-074365d7c3b9-logs" (OuterVolumeSpecName: "logs") pod "8aa3ff5c-e848-4140-8c6b-074365d7c3b9" (UID: "8aa3ff5c-e848-4140-8c6b-074365d7c3b9"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:39:56 crc kubenswrapper[5120]: I0316 16:39:56.717666 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xbnrv\" (UniqueName: \"kubernetes.io/projected/8aa3ff5c-e848-4140-8c6b-074365d7c3b9-kube-api-access-xbnrv\") pod \"8aa3ff5c-e848-4140-8c6b-074365d7c3b9\" (UID: \"8aa3ff5c-e848-4140-8c6b-074365d7c3b9\") " Mar 16 16:39:56 crc kubenswrapper[5120]: I0316 16:39:56.718162 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8aa3ff5c-e848-4140-8c6b-074365d7c3b9-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:39:56 crc kubenswrapper[5120]: I0316 16:39:56.718185 5120 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/8aa3ff5c-e848-4140-8c6b-074365d7c3b9-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 16:39:56 crc kubenswrapper[5120]: I0316 16:39:56.724997 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8aa3ff5c-e848-4140-8c6b-074365d7c3b9-kube-api-access-xbnrv" (OuterVolumeSpecName: "kube-api-access-xbnrv") pod "8aa3ff5c-e848-4140-8c6b-074365d7c3b9" (UID: "8aa3ff5c-e848-4140-8c6b-074365d7c3b9"). InnerVolumeSpecName "kube-api-access-xbnrv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:39:56 crc kubenswrapper[5120]: I0316 16:39:56.728992 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8aa3ff5c-e848-4140-8c6b-074365d7c3b9-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "8aa3ff5c-e848-4140-8c6b-074365d7c3b9" (UID: "8aa3ff5c-e848-4140-8c6b-074365d7c3b9"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:39:56 crc kubenswrapper[5120]: I0316 16:39:56.729054 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8aa3ff5c-e848-4140-8c6b-074365d7c3b9-scripts" (OuterVolumeSpecName: "scripts") pod "8aa3ff5c-e848-4140-8c6b-074365d7c3b9" (UID: "8aa3ff5c-e848-4140-8c6b-074365d7c3b9"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:39:56 crc kubenswrapper[5120]: I0316 16:39:56.801958 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8aa3ff5c-e848-4140-8c6b-074365d7c3b9-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "8aa3ff5c-e848-4140-8c6b-074365d7c3b9" (UID: "8aa3ff5c-e848-4140-8c6b-074365d7c3b9"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:39:56 crc kubenswrapper[5120]: I0316 16:39:56.812572 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8aa3ff5c-e848-4140-8c6b-074365d7c3b9-config-data" (OuterVolumeSpecName: "config-data") pod "8aa3ff5c-e848-4140-8c6b-074365d7c3b9" (UID: "8aa3ff5c-e848-4140-8c6b-074365d7c3b9"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:39:56 crc kubenswrapper[5120]: I0316 16:39:56.823218 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/8aa3ff5c-e848-4140-8c6b-074365d7c3b9-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:39:56 crc kubenswrapper[5120]: I0316 16:39:56.823256 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8aa3ff5c-e848-4140-8c6b-074365d7c3b9-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:39:56 crc kubenswrapper[5120]: I0316 16:39:56.823269 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8aa3ff5c-e848-4140-8c6b-074365d7c3b9-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:39:56 crc kubenswrapper[5120]: I0316 16:39:56.823279 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8aa3ff5c-e848-4140-8c6b-074365d7c3b9-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:39:56 crc kubenswrapper[5120]: I0316 16:39:56.823289 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xbnrv\" (UniqueName: \"kubernetes.io/projected/8aa3ff5c-e848-4140-8c6b-074365d7c3b9-kube-api-access-xbnrv\") on node \"crc\" DevicePath \"\"" Mar 16 16:39:56 crc kubenswrapper[5120]: I0316 16:39:56.935364 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-5fbdc8fdc6-mzpw2" Mar 16 16:39:56 crc kubenswrapper[5120]: I0316 16:39:56.938529 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-5fbdc8fdc6-mzpw2" Mar 16 16:39:57 crc kubenswrapper[5120]: I0316 16:39:57.214706 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:39:57 crc kubenswrapper[5120]: I0316 16:39:57.279849 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-765d49ff54-tqw2c"] Mar 16 16:39:57 crc kubenswrapper[5120]: I0316 16:39:57.280943 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8aa3ff5c-e848-4140-8c6b-074365d7c3b9" containerName="cinder-api" Mar 16 16:39:57 crc kubenswrapper[5120]: I0316 16:39:57.280961 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8aa3ff5c-e848-4140-8c6b-074365d7c3b9" containerName="cinder-api" Mar 16 16:39:57 crc kubenswrapper[5120]: I0316 16:39:57.280977 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8aa3ff5c-e848-4140-8c6b-074365d7c3b9" containerName="cinder-api-log" Mar 16 16:39:57 crc kubenswrapper[5120]: I0316 16:39:57.280983 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8aa3ff5c-e848-4140-8c6b-074365d7c3b9" containerName="cinder-api-log" Mar 16 16:39:57 crc kubenswrapper[5120]: I0316 16:39:57.281174 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="8aa3ff5c-e848-4140-8c6b-074365d7c3b9" containerName="cinder-api" Mar 16 16:39:57 crc kubenswrapper[5120]: I0316 16:39:57.281203 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="8aa3ff5c-e848-4140-8c6b-074365d7c3b9" containerName="cinder-api-log" Mar 16 16:39:57 crc kubenswrapper[5120]: I0316 16:39:57.301354 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-765d49ff54-tqw2c" Mar 16 16:39:57 crc kubenswrapper[5120]: I0316 16:39:57.306929 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-765d49ff54-tqw2c"] Mar 16 16:39:57 crc kubenswrapper[5120]: I0316 16:39:57.361749 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-worker-c56d9997c-vh2kg"] Mar 16 16:39:57 crc kubenswrapper[5120]: I0316 16:39:57.386409 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-c56d9997c-vh2kg" Mar 16 16:39:57 crc kubenswrapper[5120]: I0316 16:39:57.403856 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-c56d9997c-vh2kg"] Mar 16 16:39:57 crc kubenswrapper[5120]: I0316 16:39:57.424075 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:39:57 crc kubenswrapper[5120]: I0316 16:39:57.437154 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3c2042b3-62bc-476f-b032-91e9f77da74a-config-data\") pod \"barbican-worker-c56d9997c-vh2kg\" (UID: \"3c2042b3-62bc-476f-b032-91e9f77da74a\") " pod="openstack-kuttl-tests/barbican-worker-c56d9997c-vh2kg" Mar 16 16:39:57 crc kubenswrapper[5120]: I0316 16:39:57.438347 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4a708d1c-43d9-400d-a30e-49891c1fc39d-combined-ca-bundle\") pod \"barbican-keystone-listener-765d49ff54-tqw2c\" (UID: \"4a708d1c-43d9-400d-a30e-49891c1fc39d\") " pod="openstack-kuttl-tests/barbican-keystone-listener-765d49ff54-tqw2c" Mar 16 16:39:57 crc kubenswrapper[5120]: I0316 16:39:57.438486 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3c2042b3-62bc-476f-b032-91e9f77da74a-combined-ca-bundle\") pod \"barbican-worker-c56d9997c-vh2kg\" (UID: \"3c2042b3-62bc-476f-b032-91e9f77da74a\") " pod="openstack-kuttl-tests/barbican-worker-c56d9997c-vh2kg" Mar 16 16:39:57 crc kubenswrapper[5120]: I0316 16:39:57.438591 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3c2042b3-62bc-476f-b032-91e9f77da74a-logs\") pod \"barbican-worker-c56d9997c-vh2kg\" (UID: \"3c2042b3-62bc-476f-b032-91e9f77da74a\") " pod="openstack-kuttl-tests/barbican-worker-c56d9997c-vh2kg" Mar 16 16:39:57 crc kubenswrapper[5120]: I0316 16:39:57.438686 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4a708d1c-43d9-400d-a30e-49891c1fc39d-config-data\") pod \"barbican-keystone-listener-765d49ff54-tqw2c\" (UID: \"4a708d1c-43d9-400d-a30e-49891c1fc39d\") " pod="openstack-kuttl-tests/barbican-keystone-listener-765d49ff54-tqw2c" Mar 16 16:39:57 crc kubenswrapper[5120]: I0316 16:39:57.444245 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sth64\" (UniqueName: \"kubernetes.io/projected/4a708d1c-43d9-400d-a30e-49891c1fc39d-kube-api-access-sth64\") pod \"barbican-keystone-listener-765d49ff54-tqw2c\" (UID: \"4a708d1c-43d9-400d-a30e-49891c1fc39d\") " pod="openstack-kuttl-tests/barbican-keystone-listener-765d49ff54-tqw2c" Mar 16 16:39:57 crc kubenswrapper[5120]: I0316 16:39:57.444544 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/4a708d1c-43d9-400d-a30e-49891c1fc39d-config-data-custom\") pod \"barbican-keystone-listener-765d49ff54-tqw2c\" (UID: \"4a708d1c-43d9-400d-a30e-49891c1fc39d\") " pod="openstack-kuttl-tests/barbican-keystone-listener-765d49ff54-tqw2c" Mar 16 16:39:57 crc kubenswrapper[5120]: I0316 16:39:57.444672 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4a708d1c-43d9-400d-a30e-49891c1fc39d-logs\") pod \"barbican-keystone-listener-765d49ff54-tqw2c\" (UID: \"4a708d1c-43d9-400d-a30e-49891c1fc39d\") " pod="openstack-kuttl-tests/barbican-keystone-listener-765d49ff54-tqw2c" Mar 16 16:39:57 crc kubenswrapper[5120]: I0316 16:39:57.444838 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ht2d\" (UniqueName: \"kubernetes.io/projected/3c2042b3-62bc-476f-b032-91e9f77da74a-kube-api-access-9ht2d\") pod \"barbican-worker-c56d9997c-vh2kg\" (UID: \"3c2042b3-62bc-476f-b032-91e9f77da74a\") " pod="openstack-kuttl-tests/barbican-worker-c56d9997c-vh2kg" Mar 16 16:39:57 crc kubenswrapper[5120]: I0316 16:39:57.444991 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/3c2042b3-62bc-476f-b032-91e9f77da74a-config-data-custom\") pod \"barbican-worker-c56d9997c-vh2kg\" (UID: \"3c2042b3-62bc-476f-b032-91e9f77da74a\") " pod="openstack-kuttl-tests/barbican-worker-c56d9997c-vh2kg" Mar 16 16:39:57 crc kubenswrapper[5120]: I0316 16:39:57.498201 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-599744884-vf6rr"] Mar 16 16:39:57 crc kubenswrapper[5120]: I0316 16:39:57.498665 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-599744884-vf6rr" podUID="e0ca2d31-e27b-42b5-8801-469ad47142a5" containerName="barbican-api-log" containerID="cri-o://2ff684768d9ed08487e6b8399da59d9625b5c9923f0fb5fa6e48a258dc77abdb" gracePeriod=30 Mar 16 16:39:57 crc kubenswrapper[5120]: I0316 16:39:57.499202 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-599744884-vf6rr" podUID="e0ca2d31-e27b-42b5-8801-469ad47142a5" containerName="barbican-api" containerID="cri-o://31e5df1a5b7f2d0c1b5204f81e9f04d53b8362b2e8378a6ef768b2867ed3ef1c" gracePeriod=30 Mar 16 16:39:57 crc kubenswrapper[5120]: I0316 16:39:57.506323 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-api-6647785db4-lmftm"] Mar 16 16:39:57 crc kubenswrapper[5120]: I0316 16:39:57.529947 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-6647785db4-lmftm"] Mar 16 16:39:57 crc kubenswrapper[5120]: I0316 16:39:57.530113 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-6647785db4-lmftm" Mar 16 16:39:57 crc kubenswrapper[5120]: I0316 16:39:57.550860 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/3c2042b3-62bc-476f-b032-91e9f77da74a-config-data-custom\") pod \"barbican-worker-c56d9997c-vh2kg\" (UID: \"3c2042b3-62bc-476f-b032-91e9f77da74a\") " pod="openstack-kuttl-tests/barbican-worker-c56d9997c-vh2kg" Mar 16 16:39:57 crc kubenswrapper[5120]: I0316 16:39:57.551252 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3c2042b3-62bc-476f-b032-91e9f77da74a-config-data\") pod \"barbican-worker-c56d9997c-vh2kg\" (UID: \"3c2042b3-62bc-476f-b032-91e9f77da74a\") " pod="openstack-kuttl-tests/barbican-worker-c56d9997c-vh2kg" Mar 16 16:39:57 crc kubenswrapper[5120]: I0316 16:39:57.551433 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4a708d1c-43d9-400d-a30e-49891c1fc39d-combined-ca-bundle\") pod \"barbican-keystone-listener-765d49ff54-tqw2c\" (UID: \"4a708d1c-43d9-400d-a30e-49891c1fc39d\") " pod="openstack-kuttl-tests/barbican-keystone-listener-765d49ff54-tqw2c" Mar 16 16:39:57 crc kubenswrapper[5120]: I0316 16:39:57.551531 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3c2042b3-62bc-476f-b032-91e9f77da74a-combined-ca-bundle\") pod \"barbican-worker-c56d9997c-vh2kg\" (UID: \"3c2042b3-62bc-476f-b032-91e9f77da74a\") " pod="openstack-kuttl-tests/barbican-worker-c56d9997c-vh2kg" Mar 16 16:39:57 crc kubenswrapper[5120]: I0316 16:39:57.551625 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3c2042b3-62bc-476f-b032-91e9f77da74a-logs\") pod \"barbican-worker-c56d9997c-vh2kg\" (UID: \"3c2042b3-62bc-476f-b032-91e9f77da74a\") " pod="openstack-kuttl-tests/barbican-worker-c56d9997c-vh2kg" Mar 16 16:39:57 crc kubenswrapper[5120]: I0316 16:39:57.551697 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4a708d1c-43d9-400d-a30e-49891c1fc39d-config-data\") pod \"barbican-keystone-listener-765d49ff54-tqw2c\" (UID: \"4a708d1c-43d9-400d-a30e-49891c1fc39d\") " pod="openstack-kuttl-tests/barbican-keystone-listener-765d49ff54-tqw2c" Mar 16 16:39:57 crc kubenswrapper[5120]: I0316 16:39:57.551908 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sth64\" (UniqueName: \"kubernetes.io/projected/4a708d1c-43d9-400d-a30e-49891c1fc39d-kube-api-access-sth64\") pod \"barbican-keystone-listener-765d49ff54-tqw2c\" (UID: \"4a708d1c-43d9-400d-a30e-49891c1fc39d\") " pod="openstack-kuttl-tests/barbican-keystone-listener-765d49ff54-tqw2c" Mar 16 16:39:57 crc kubenswrapper[5120]: I0316 16:39:57.552239 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/4a708d1c-43d9-400d-a30e-49891c1fc39d-config-data-custom\") pod \"barbican-keystone-listener-765d49ff54-tqw2c\" (UID: \"4a708d1c-43d9-400d-a30e-49891c1fc39d\") " pod="openstack-kuttl-tests/barbican-keystone-listener-765d49ff54-tqw2c" Mar 16 16:39:57 crc kubenswrapper[5120]: I0316 16:39:57.552355 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4a708d1c-43d9-400d-a30e-49891c1fc39d-logs\") pod \"barbican-keystone-listener-765d49ff54-tqw2c\" (UID: \"4a708d1c-43d9-400d-a30e-49891c1fc39d\") " pod="openstack-kuttl-tests/barbican-keystone-listener-765d49ff54-tqw2c" Mar 16 16:39:57 crc kubenswrapper[5120]: I0316 16:39:57.552473 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9ht2d\" (UniqueName: \"kubernetes.io/projected/3c2042b3-62bc-476f-b032-91e9f77da74a-kube-api-access-9ht2d\") pod \"barbican-worker-c56d9997c-vh2kg\" (UID: \"3c2042b3-62bc-476f-b032-91e9f77da74a\") " pod="openstack-kuttl-tests/barbican-worker-c56d9997c-vh2kg" Mar 16 16:39:57 crc kubenswrapper[5120]: I0316 16:39:57.552505 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openstack-kuttl-tests/barbican-api-599744884-vf6rr" podUID="e0ca2d31-e27b-42b5-8801-469ad47142a5" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.1.50:9311/healthcheck\": EOF" Mar 16 16:39:57 crc kubenswrapper[5120]: I0316 16:39:57.552848 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3c2042b3-62bc-476f-b032-91e9f77da74a-logs\") pod \"barbican-worker-c56d9997c-vh2kg\" (UID: \"3c2042b3-62bc-476f-b032-91e9f77da74a\") " pod="openstack-kuttl-tests/barbican-worker-c56d9997c-vh2kg" Mar 16 16:39:57 crc kubenswrapper[5120]: I0316 16:39:57.556071 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-599744884-vf6rr" podUID="e0ca2d31-e27b-42b5-8801-469ad47142a5" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.1.50:9311/healthcheck\": EOF" Mar 16 16:39:57 crc kubenswrapper[5120]: I0316 16:39:57.556220 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-599744884-vf6rr" podUID="e0ca2d31-e27b-42b5-8801-469ad47142a5" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.1.50:9311/healthcheck\": EOF" Mar 16 16:39:57 crc kubenswrapper[5120]: I0316 16:39:57.552392 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openstack-kuttl-tests/barbican-api-599744884-vf6rr" podUID="e0ca2d31-e27b-42b5-8801-469ad47142a5" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.1.50:9311/healthcheck\": EOF" Mar 16 16:39:57 crc kubenswrapper[5120]: I0316 16:39:57.638564 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4a708d1c-43d9-400d-a30e-49891c1fc39d-logs\") pod \"barbican-keystone-listener-765d49ff54-tqw2c\" (UID: \"4a708d1c-43d9-400d-a30e-49891c1fc39d\") " pod="openstack-kuttl-tests/barbican-keystone-listener-765d49ff54-tqw2c" Mar 16 16:39:57 crc kubenswrapper[5120]: I0316 16:39:57.642131 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sth64\" (UniqueName: \"kubernetes.io/projected/4a708d1c-43d9-400d-a30e-49891c1fc39d-kube-api-access-sth64\") pod \"barbican-keystone-listener-765d49ff54-tqw2c\" (UID: \"4a708d1c-43d9-400d-a30e-49891c1fc39d\") " pod="openstack-kuttl-tests/barbican-keystone-listener-765d49ff54-tqw2c" Mar 16 16:39:57 crc kubenswrapper[5120]: I0316 16:39:57.646535 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3c2042b3-62bc-476f-b032-91e9f77da74a-combined-ca-bundle\") pod \"barbican-worker-c56d9997c-vh2kg\" (UID: \"3c2042b3-62bc-476f-b032-91e9f77da74a\") " pod="openstack-kuttl-tests/barbican-worker-c56d9997c-vh2kg" Mar 16 16:39:57 crc kubenswrapper[5120]: I0316 16:39:57.655094 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3c2042b3-62bc-476f-b032-91e9f77da74a-config-data\") pod \"barbican-worker-c56d9997c-vh2kg\" (UID: \"3c2042b3-62bc-476f-b032-91e9f77da74a\") " pod="openstack-kuttl-tests/barbican-worker-c56d9997c-vh2kg" Mar 16 16:39:57 crc kubenswrapper[5120]: I0316 16:39:57.657651 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/1518bfb1-3665-455c-84df-7c6eba7b93cf-internal-tls-certs\") pod \"barbican-api-6647785db4-lmftm\" (UID: \"1518bfb1-3665-455c-84df-7c6eba7b93cf\") " pod="openstack-kuttl-tests/barbican-api-6647785db4-lmftm" Mar 16 16:39:57 crc kubenswrapper[5120]: I0316 16:39:57.657737 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1518bfb1-3665-455c-84df-7c6eba7b93cf-config-data\") pod \"barbican-api-6647785db4-lmftm\" (UID: \"1518bfb1-3665-455c-84df-7c6eba7b93cf\") " pod="openstack-kuttl-tests/barbican-api-6647785db4-lmftm" Mar 16 16:39:57 crc kubenswrapper[5120]: I0316 16:39:57.658087 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/1518bfb1-3665-455c-84df-7c6eba7b93cf-config-data-custom\") pod \"barbican-api-6647785db4-lmftm\" (UID: \"1518bfb1-3665-455c-84df-7c6eba7b93cf\") " pod="openstack-kuttl-tests/barbican-api-6647785db4-lmftm" Mar 16 16:39:57 crc kubenswrapper[5120]: I0316 16:39:57.658145 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xm4jb\" (UniqueName: \"kubernetes.io/projected/1518bfb1-3665-455c-84df-7c6eba7b93cf-kube-api-access-xm4jb\") pod \"barbican-api-6647785db4-lmftm\" (UID: \"1518bfb1-3665-455c-84df-7c6eba7b93cf\") " pod="openstack-kuttl-tests/barbican-api-6647785db4-lmftm" Mar 16 16:39:57 crc kubenswrapper[5120]: I0316 16:39:57.658248 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/1518bfb1-3665-455c-84df-7c6eba7b93cf-logs\") pod \"barbican-api-6647785db4-lmftm\" (UID: \"1518bfb1-3665-455c-84df-7c6eba7b93cf\") " pod="openstack-kuttl-tests/barbican-api-6647785db4-lmftm" Mar 16 16:39:57 crc kubenswrapper[5120]: I0316 16:39:57.658306 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/1518bfb1-3665-455c-84df-7c6eba7b93cf-public-tls-certs\") pod \"barbican-api-6647785db4-lmftm\" (UID: \"1518bfb1-3665-455c-84df-7c6eba7b93cf\") " pod="openstack-kuttl-tests/barbican-api-6647785db4-lmftm" Mar 16 16:39:57 crc kubenswrapper[5120]: I0316 16:39:57.658456 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1518bfb1-3665-455c-84df-7c6eba7b93cf-combined-ca-bundle\") pod \"barbican-api-6647785db4-lmftm\" (UID: \"1518bfb1-3665-455c-84df-7c6eba7b93cf\") " pod="openstack-kuttl-tests/barbican-api-6647785db4-lmftm" Mar 16 16:39:57 crc kubenswrapper[5120]: I0316 16:39:57.659935 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/4a708d1c-43d9-400d-a30e-49891c1fc39d-config-data-custom\") pod \"barbican-keystone-listener-765d49ff54-tqw2c\" (UID: \"4a708d1c-43d9-400d-a30e-49891c1fc39d\") " pod="openstack-kuttl-tests/barbican-keystone-listener-765d49ff54-tqw2c" Mar 16 16:39:57 crc kubenswrapper[5120]: I0316 16:39:57.661470 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/3c2042b3-62bc-476f-b032-91e9f77da74a-config-data-custom\") pod \"barbican-worker-c56d9997c-vh2kg\" (UID: \"3c2042b3-62bc-476f-b032-91e9f77da74a\") " pod="openstack-kuttl-tests/barbican-worker-c56d9997c-vh2kg" Mar 16 16:39:57 crc kubenswrapper[5120]: I0316 16:39:57.675870 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4a708d1c-43d9-400d-a30e-49891c1fc39d-combined-ca-bundle\") pod \"barbican-keystone-listener-765d49ff54-tqw2c\" (UID: \"4a708d1c-43d9-400d-a30e-49891c1fc39d\") " pod="openstack-kuttl-tests/barbican-keystone-listener-765d49ff54-tqw2c" Mar 16 16:39:57 crc kubenswrapper[5120]: I0316 16:39:57.676267 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"8aa3ff5c-e848-4140-8c6b-074365d7c3b9","Type":"ContainerDied","Data":"ac213584aa62aca96e1df2884fb68edb9ed8507924d24504bd0d24bfe0781b92"} Mar 16 16:39:57 crc kubenswrapper[5120]: I0316 16:39:57.676296 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:39:57 crc kubenswrapper[5120]: I0316 16:39:57.676329 5120 scope.go:117] "RemoveContainer" containerID="a32b23379e3e7651c463fe9b9d87a6fc6447c6d7899450ce5b79ce6e0e350fc2" Mar 16 16:39:57 crc kubenswrapper[5120]: I0316 16:39:57.714290 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ht2d\" (UniqueName: \"kubernetes.io/projected/3c2042b3-62bc-476f-b032-91e9f77da74a-kube-api-access-9ht2d\") pod \"barbican-worker-c56d9997c-vh2kg\" (UID: \"3c2042b3-62bc-476f-b032-91e9f77da74a\") " pod="openstack-kuttl-tests/barbican-worker-c56d9997c-vh2kg" Mar 16 16:39:57 crc kubenswrapper[5120]: I0316 16:39:57.737528 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-c56d9997c-vh2kg" Mar 16 16:39:57 crc kubenswrapper[5120]: I0316 16:39:57.764810 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/1518bfb1-3665-455c-84df-7c6eba7b93cf-public-tls-certs\") pod \"barbican-api-6647785db4-lmftm\" (UID: \"1518bfb1-3665-455c-84df-7c6eba7b93cf\") " pod="openstack-kuttl-tests/barbican-api-6647785db4-lmftm" Mar 16 16:39:57 crc kubenswrapper[5120]: I0316 16:39:57.766294 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1518bfb1-3665-455c-84df-7c6eba7b93cf-combined-ca-bundle\") pod \"barbican-api-6647785db4-lmftm\" (UID: \"1518bfb1-3665-455c-84df-7c6eba7b93cf\") " pod="openstack-kuttl-tests/barbican-api-6647785db4-lmftm" Mar 16 16:39:57 crc kubenswrapper[5120]: I0316 16:39:57.766673 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/1518bfb1-3665-455c-84df-7c6eba7b93cf-internal-tls-certs\") pod \"barbican-api-6647785db4-lmftm\" (UID: \"1518bfb1-3665-455c-84df-7c6eba7b93cf\") " pod="openstack-kuttl-tests/barbican-api-6647785db4-lmftm" Mar 16 16:39:57 crc kubenswrapper[5120]: I0316 16:39:57.766747 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1518bfb1-3665-455c-84df-7c6eba7b93cf-config-data\") pod \"barbican-api-6647785db4-lmftm\" (UID: \"1518bfb1-3665-455c-84df-7c6eba7b93cf\") " pod="openstack-kuttl-tests/barbican-api-6647785db4-lmftm" Mar 16 16:39:57 crc kubenswrapper[5120]: I0316 16:39:57.766914 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/1518bfb1-3665-455c-84df-7c6eba7b93cf-config-data-custom\") pod \"barbican-api-6647785db4-lmftm\" (UID: \"1518bfb1-3665-455c-84df-7c6eba7b93cf\") " pod="openstack-kuttl-tests/barbican-api-6647785db4-lmftm" Mar 16 16:39:57 crc kubenswrapper[5120]: I0316 16:39:57.766958 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xm4jb\" (UniqueName: \"kubernetes.io/projected/1518bfb1-3665-455c-84df-7c6eba7b93cf-kube-api-access-xm4jb\") pod \"barbican-api-6647785db4-lmftm\" (UID: \"1518bfb1-3665-455c-84df-7c6eba7b93cf\") " pod="openstack-kuttl-tests/barbican-api-6647785db4-lmftm" Mar 16 16:39:57 crc kubenswrapper[5120]: I0316 16:39:57.768659 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/1518bfb1-3665-455c-84df-7c6eba7b93cf-logs\") pod \"barbican-api-6647785db4-lmftm\" (UID: \"1518bfb1-3665-455c-84df-7c6eba7b93cf\") " pod="openstack-kuttl-tests/barbican-api-6647785db4-lmftm" Mar 16 16:39:57 crc kubenswrapper[5120]: I0316 16:39:57.770589 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4a708d1c-43d9-400d-a30e-49891c1fc39d-config-data\") pod \"barbican-keystone-listener-765d49ff54-tqw2c\" (UID: \"4a708d1c-43d9-400d-a30e-49891c1fc39d\") " pod="openstack-kuttl-tests/barbican-keystone-listener-765d49ff54-tqw2c" Mar 16 16:39:57 crc kubenswrapper[5120]: I0316 16:39:57.771317 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/1518bfb1-3665-455c-84df-7c6eba7b93cf-logs\") pod \"barbican-api-6647785db4-lmftm\" (UID: \"1518bfb1-3665-455c-84df-7c6eba7b93cf\") " pod="openstack-kuttl-tests/barbican-api-6647785db4-lmftm" Mar 16 16:39:57 crc kubenswrapper[5120]: I0316 16:39:57.771713 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/1518bfb1-3665-455c-84df-7c6eba7b93cf-public-tls-certs\") pod \"barbican-api-6647785db4-lmftm\" (UID: \"1518bfb1-3665-455c-84df-7c6eba7b93cf\") " pod="openstack-kuttl-tests/barbican-api-6647785db4-lmftm" Mar 16 16:39:57 crc kubenswrapper[5120]: I0316 16:39:57.772487 5120 generic.go:358] "Generic (PLEG): container finished" podID="dbe84e5b-abdf-4300-a41e-26507a638f6e" containerID="aaaa3047ea6ddfa53e4fffe26abb9aeab7722630d030f2c35817080bdd772765" exitCode=0 Mar 16 16:39:57 crc kubenswrapper[5120]: I0316 16:39:57.772523 5120 generic.go:358] "Generic (PLEG): container finished" podID="dbe84e5b-abdf-4300-a41e-26507a638f6e" containerID="9fc2e8df4084347acd634ad812a7cc67034d64eca198e49d1e200757d740e6dc" exitCode=2 Mar 16 16:39:57 crc kubenswrapper[5120]: I0316 16:39:57.772530 5120 generic.go:358] "Generic (PLEG): container finished" podID="dbe84e5b-abdf-4300-a41e-26507a638f6e" containerID="340ea5b4a4b6b79e8eec7809aa702596df745abcc22f8a28a465f4260dc1fd9d" exitCode=0 Mar 16 16:39:57 crc kubenswrapper[5120]: I0316 16:39:57.772537 5120 generic.go:358] "Generic (PLEG): container finished" podID="dbe84e5b-abdf-4300-a41e-26507a638f6e" containerID="319369720a667a7bb1a0c88fafefc7dfc242dc278d328913f43f46f2c6de973d" exitCode=0 Mar 16 16:39:57 crc kubenswrapper[5120]: I0316 16:39:57.772576 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"dbe84e5b-abdf-4300-a41e-26507a638f6e","Type":"ContainerDied","Data":"aaaa3047ea6ddfa53e4fffe26abb9aeab7722630d030f2c35817080bdd772765"} Mar 16 16:39:57 crc kubenswrapper[5120]: I0316 16:39:57.772604 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"dbe84e5b-abdf-4300-a41e-26507a638f6e","Type":"ContainerDied","Data":"9fc2e8df4084347acd634ad812a7cc67034d64eca198e49d1e200757d740e6dc"} Mar 16 16:39:57 crc kubenswrapper[5120]: I0316 16:39:57.772615 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"dbe84e5b-abdf-4300-a41e-26507a638f6e","Type":"ContainerDied","Data":"340ea5b4a4b6b79e8eec7809aa702596df745abcc22f8a28a465f4260dc1fd9d"} Mar 16 16:39:57 crc kubenswrapper[5120]: I0316 16:39:57.772626 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"dbe84e5b-abdf-4300-a41e-26507a638f6e","Type":"ContainerDied","Data":"319369720a667a7bb1a0c88fafefc7dfc242dc278d328913f43f46f2c6de973d"} Mar 16 16:39:57 crc kubenswrapper[5120]: I0316 16:39:57.774024 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1518bfb1-3665-455c-84df-7c6eba7b93cf-combined-ca-bundle\") pod \"barbican-api-6647785db4-lmftm\" (UID: \"1518bfb1-3665-455c-84df-7c6eba7b93cf\") " pod="openstack-kuttl-tests/barbican-api-6647785db4-lmftm" Mar 16 16:39:57 crc kubenswrapper[5120]: I0316 16:39:57.776508 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-74449f99d8-kxw96" event={"ID":"c5223e38-12b9-4877-9a14-585ddcd5f699","Type":"ContainerStarted","Data":"55c1a4c9a3f03915d38301396988693dd2d55bb4144258171015d74cd76e83e2"} Mar 16 16:39:57 crc kubenswrapper[5120]: I0316 16:39:57.777705 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/keystone-74449f99d8-kxw96" Mar 16 16:39:57 crc kubenswrapper[5120]: I0316 16:39:57.781084 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="35dc0e58-ff4f-41f0-9dff-caacb6ec7d24" containerName="glance-log" containerID="cri-o://aa3d3e7acca98156d0335a1fcc0243e60d7a15b8aeaaed1554aaef4ca2cb666e" gracePeriod=30 Mar 16 16:39:57 crc kubenswrapper[5120]: I0316 16:39:57.781338 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="35dc0e58-ff4f-41f0-9dff-caacb6ec7d24" containerName="glance-httpd" containerID="cri-o://53fcd3274507e87c40debf472b785a2e198862cba17e5eee71a2d2e2fd8fce3a" gracePeriod=30 Mar 16 16:39:57 crc kubenswrapper[5120]: I0316 16:39:57.788082 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/1518bfb1-3665-455c-84df-7c6eba7b93cf-config-data-custom\") pod \"barbican-api-6647785db4-lmftm\" (UID: \"1518bfb1-3665-455c-84df-7c6eba7b93cf\") " pod="openstack-kuttl-tests/barbican-api-6647785db4-lmftm" Mar 16 16:39:57 crc kubenswrapper[5120]: I0316 16:39:57.791317 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/1518bfb1-3665-455c-84df-7c6eba7b93cf-internal-tls-certs\") pod \"barbican-api-6647785db4-lmftm\" (UID: \"1518bfb1-3665-455c-84df-7c6eba7b93cf\") " pod="openstack-kuttl-tests/barbican-api-6647785db4-lmftm" Mar 16 16:39:57 crc kubenswrapper[5120]: I0316 16:39:57.791887 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xm4jb\" (UniqueName: \"kubernetes.io/projected/1518bfb1-3665-455c-84df-7c6eba7b93cf-kube-api-access-xm4jb\") pod \"barbican-api-6647785db4-lmftm\" (UID: \"1518bfb1-3665-455c-84df-7c6eba7b93cf\") " pod="openstack-kuttl-tests/barbican-api-6647785db4-lmftm" Mar 16 16:39:57 crc kubenswrapper[5120]: I0316 16:39:57.792050 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1518bfb1-3665-455c-84df-7c6eba7b93cf-config-data\") pod \"barbican-api-6647785db4-lmftm\" (UID: \"1518bfb1-3665-455c-84df-7c6eba7b93cf\") " pod="openstack-kuttl-tests/barbican-api-6647785db4-lmftm" Mar 16 16:39:57 crc kubenswrapper[5120]: I0316 16:39:57.805774 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-74449f99d8-kxw96" podStartSLOduration=3.805731992 podStartE2EDuration="3.805731992s" podCreationTimestamp="2026-03-16 16:39:54 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:39:57.794045835 +0000 UTC m=+4099.947977492" watchObservedRunningTime="2026-03-16 16:39:57.805731992 +0000 UTC m=+4099.959663639" Mar 16 16:39:57 crc kubenswrapper[5120]: I0316 16:39:57.830390 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-external-api-0" podStartSLOduration=5.830370091 podStartE2EDuration="5.830370091s" podCreationTimestamp="2026-03-16 16:39:52 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:39:57.817038528 +0000 UTC m=+4099.970970195" watchObservedRunningTime="2026-03-16 16:39:57.830370091 +0000 UTC m=+4099.984301748" Mar 16 16:39:57 crc kubenswrapper[5120]: I0316 16:39:57.882084 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-6647785db4-lmftm" Mar 16 16:39:57 crc kubenswrapper[5120]: I0316 16:39:57.954364 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:39:57 crc kubenswrapper[5120]: I0316 16:39:57.954468 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:39:57 crc kubenswrapper[5120]: I0316 16:39:57.977879 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-765d49ff54-tqw2c" Mar 16 16:39:57 crc kubenswrapper[5120]: I0316 16:39:57.989876 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:39:58 crc kubenswrapper[5120]: I0316 16:39:58.011724 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:39:58 crc kubenswrapper[5120]: I0316 16:39:58.012900 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbe84e5b-abdf-4300-a41e-26507a638f6e" containerName="proxy-httpd" Mar 16 16:39:58 crc kubenswrapper[5120]: I0316 16:39:58.012927 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbe84e5b-abdf-4300-a41e-26507a638f6e" containerName="proxy-httpd" Mar 16 16:39:58 crc kubenswrapper[5120]: I0316 16:39:58.012944 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbe84e5b-abdf-4300-a41e-26507a638f6e" containerName="ceilometer-central-agent" Mar 16 16:39:58 crc kubenswrapper[5120]: I0316 16:39:58.012952 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbe84e5b-abdf-4300-a41e-26507a638f6e" containerName="ceilometer-central-agent" Mar 16 16:39:58 crc kubenswrapper[5120]: I0316 16:39:58.012970 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbe84e5b-abdf-4300-a41e-26507a638f6e" containerName="ceilometer-notification-agent" Mar 16 16:39:58 crc kubenswrapper[5120]: I0316 16:39:58.012979 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbe84e5b-abdf-4300-a41e-26507a638f6e" containerName="ceilometer-notification-agent" Mar 16 16:39:58 crc kubenswrapper[5120]: I0316 16:39:58.012992 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbe84e5b-abdf-4300-a41e-26507a638f6e" containerName="sg-core" Mar 16 16:39:58 crc kubenswrapper[5120]: I0316 16:39:58.012999 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbe84e5b-abdf-4300-a41e-26507a638f6e" containerName="sg-core" Mar 16 16:39:58 crc kubenswrapper[5120]: I0316 16:39:58.013214 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="dbe84e5b-abdf-4300-a41e-26507a638f6e" containerName="ceilometer-notification-agent" Mar 16 16:39:58 crc kubenswrapper[5120]: I0316 16:39:58.013242 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="dbe84e5b-abdf-4300-a41e-26507a638f6e" containerName="ceilometer-central-agent" Mar 16 16:39:58 crc kubenswrapper[5120]: I0316 16:39:58.013256 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="dbe84e5b-abdf-4300-a41e-26507a638f6e" containerName="sg-core" Mar 16 16:39:58 crc kubenswrapper[5120]: I0316 16:39:58.013268 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="dbe84e5b-abdf-4300-a41e-26507a638f6e" containerName="proxy-httpd" Mar 16 16:39:58 crc kubenswrapper[5120]: I0316 16:39:58.039222 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:39:58 crc kubenswrapper[5120]: I0316 16:39:58.042839 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-cinder-internal-svc\"" Mar 16 16:39:58 crc kubenswrapper[5120]: I0316 16:39:58.043110 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-cinder-public-svc\"" Mar 16 16:39:58 crc kubenswrapper[5120]: I0316 16:39:58.045083 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-api-config-data\"" Mar 16 16:39:58 crc kubenswrapper[5120]: I0316 16:39:58.059032 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:39:58 crc kubenswrapper[5120]: I0316 16:39:58.081821 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/dbe84e5b-abdf-4300-a41e-26507a638f6e-log-httpd\") pod \"dbe84e5b-abdf-4300-a41e-26507a638f6e\" (UID: \"dbe84e5b-abdf-4300-a41e-26507a638f6e\") " Mar 16 16:39:58 crc kubenswrapper[5120]: I0316 16:39:58.081933 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dbe84e5b-abdf-4300-a41e-26507a638f6e-config-data\") pod \"dbe84e5b-abdf-4300-a41e-26507a638f6e\" (UID: \"dbe84e5b-abdf-4300-a41e-26507a638f6e\") " Mar 16 16:39:58 crc kubenswrapper[5120]: I0316 16:39:58.082034 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/dbe84e5b-abdf-4300-a41e-26507a638f6e-sg-core-conf-yaml\") pod \"dbe84e5b-abdf-4300-a41e-26507a638f6e\" (UID: \"dbe84e5b-abdf-4300-a41e-26507a638f6e\") " Mar 16 16:39:58 crc kubenswrapper[5120]: I0316 16:39:58.082197 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/dbe84e5b-abdf-4300-a41e-26507a638f6e-scripts\") pod \"dbe84e5b-abdf-4300-a41e-26507a638f6e\" (UID: \"dbe84e5b-abdf-4300-a41e-26507a638f6e\") " Mar 16 16:39:58 crc kubenswrapper[5120]: I0316 16:39:58.082261 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k94gv\" (UniqueName: \"kubernetes.io/projected/dbe84e5b-abdf-4300-a41e-26507a638f6e-kube-api-access-k94gv\") pod \"dbe84e5b-abdf-4300-a41e-26507a638f6e\" (UID: \"dbe84e5b-abdf-4300-a41e-26507a638f6e\") " Mar 16 16:39:58 crc kubenswrapper[5120]: I0316 16:39:58.082290 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/dbe84e5b-abdf-4300-a41e-26507a638f6e-run-httpd\") pod \"dbe84e5b-abdf-4300-a41e-26507a638f6e\" (UID: \"dbe84e5b-abdf-4300-a41e-26507a638f6e\") " Mar 16 16:39:58 crc kubenswrapper[5120]: I0316 16:39:58.082310 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dbe84e5b-abdf-4300-a41e-26507a638f6e-combined-ca-bundle\") pod \"dbe84e5b-abdf-4300-a41e-26507a638f6e\" (UID: \"dbe84e5b-abdf-4300-a41e-26507a638f6e\") " Mar 16 16:39:58 crc kubenswrapper[5120]: I0316 16:39:58.082564 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:39:58 crc kubenswrapper[5120]: I0316 16:39:58.082589 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e-logs\") pod \"cinder-api-0\" (UID: \"08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:39:58 crc kubenswrapper[5120]: I0316 16:39:58.082609 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e-public-tls-certs\") pod \"cinder-api-0\" (UID: \"08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:39:58 crc kubenswrapper[5120]: I0316 16:39:58.082657 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e-config-data-custom\") pod \"cinder-api-0\" (UID: \"08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:39:58 crc kubenswrapper[5120]: I0316 16:39:58.082700 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xz29q\" (UniqueName: \"kubernetes.io/projected/08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e-kube-api-access-xz29q\") pod \"cinder-api-0\" (UID: \"08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:39:58 crc kubenswrapper[5120]: I0316 16:39:58.082708 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbe84e5b-abdf-4300-a41e-26507a638f6e-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "dbe84e5b-abdf-4300-a41e-26507a638f6e" (UID: "dbe84e5b-abdf-4300-a41e-26507a638f6e"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:39:58 crc kubenswrapper[5120]: I0316 16:39:58.083006 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:39:58 crc kubenswrapper[5120]: I0316 16:39:58.083070 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e-etc-machine-id\") pod \"cinder-api-0\" (UID: \"08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:39:58 crc kubenswrapper[5120]: I0316 16:39:58.083287 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e-config-data\") pod \"cinder-api-0\" (UID: \"08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:39:58 crc kubenswrapper[5120]: I0316 16:39:58.083323 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e-scripts\") pod \"cinder-api-0\" (UID: \"08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:39:58 crc kubenswrapper[5120]: I0316 16:39:58.083644 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/dbe84e5b-abdf-4300-a41e-26507a638f6e-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:39:58 crc kubenswrapper[5120]: I0316 16:39:58.087150 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbe84e5b-abdf-4300-a41e-26507a638f6e-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "dbe84e5b-abdf-4300-a41e-26507a638f6e" (UID: "dbe84e5b-abdf-4300-a41e-26507a638f6e"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:39:58 crc kubenswrapper[5120]: I0316 16:39:58.097704 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dbe84e5b-abdf-4300-a41e-26507a638f6e-kube-api-access-k94gv" (OuterVolumeSpecName: "kube-api-access-k94gv") pod "dbe84e5b-abdf-4300-a41e-26507a638f6e" (UID: "dbe84e5b-abdf-4300-a41e-26507a638f6e"). InnerVolumeSpecName "kube-api-access-k94gv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:39:58 crc kubenswrapper[5120]: I0316 16:39:58.106906 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dbe84e5b-abdf-4300-a41e-26507a638f6e-scripts" (OuterVolumeSpecName: "scripts") pod "dbe84e5b-abdf-4300-a41e-26507a638f6e" (UID: "dbe84e5b-abdf-4300-a41e-26507a638f6e"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:39:58 crc kubenswrapper[5120]: I0316 16:39:58.117002 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dbe84e5b-abdf-4300-a41e-26507a638f6e-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "dbe84e5b-abdf-4300-a41e-26507a638f6e" (UID: "dbe84e5b-abdf-4300-a41e-26507a638f6e"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:39:58 crc kubenswrapper[5120]: I0316 16:39:58.204287 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:39:58 crc kubenswrapper[5120]: I0316 16:39:58.204336 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e-etc-machine-id\") pod \"cinder-api-0\" (UID: \"08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:39:58 crc kubenswrapper[5120]: I0316 16:39:58.204422 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e-config-data\") pod \"cinder-api-0\" (UID: \"08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:39:58 crc kubenswrapper[5120]: I0316 16:39:58.204447 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e-scripts\") pod \"cinder-api-0\" (UID: \"08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:39:58 crc kubenswrapper[5120]: I0316 16:39:58.204627 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:39:58 crc kubenswrapper[5120]: I0316 16:39:58.204649 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e-logs\") pod \"cinder-api-0\" (UID: \"08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:39:58 crc kubenswrapper[5120]: I0316 16:39:58.204671 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e-public-tls-certs\") pod \"cinder-api-0\" (UID: \"08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:39:58 crc kubenswrapper[5120]: I0316 16:39:58.204743 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e-config-data-custom\") pod \"cinder-api-0\" (UID: \"08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:39:58 crc kubenswrapper[5120]: I0316 16:39:58.204830 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xz29q\" (UniqueName: \"kubernetes.io/projected/08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e-kube-api-access-xz29q\") pod \"cinder-api-0\" (UID: \"08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:39:58 crc kubenswrapper[5120]: I0316 16:39:58.206072 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e-etc-machine-id\") pod \"cinder-api-0\" (UID: \"08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:39:58 crc kubenswrapper[5120]: I0316 16:39:58.212066 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e-scripts\") pod \"cinder-api-0\" (UID: \"08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:39:58 crc kubenswrapper[5120]: I0316 16:39:58.214788 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e-logs\") pod \"cinder-api-0\" (UID: \"08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:39:58 crc kubenswrapper[5120]: I0316 16:39:58.215042 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/dbe84e5b-abdf-4300-a41e-26507a638f6e-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 16:39:58 crc kubenswrapper[5120]: I0316 16:39:58.215059 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/dbe84e5b-abdf-4300-a41e-26507a638f6e-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:39:58 crc kubenswrapper[5120]: I0316 16:39:58.215070 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k94gv\" (UniqueName: \"kubernetes.io/projected/dbe84e5b-abdf-4300-a41e-26507a638f6e-kube-api-access-k94gv\") on node \"crc\" DevicePath \"\"" Mar 16 16:39:58 crc kubenswrapper[5120]: I0316 16:39:58.215081 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/dbe84e5b-abdf-4300-a41e-26507a638f6e-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:39:58 crc kubenswrapper[5120]: I0316 16:39:58.217108 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:39:58 crc kubenswrapper[5120]: I0316 16:39:58.225663 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e-public-tls-certs\") pod \"cinder-api-0\" (UID: \"08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:39:58 crc kubenswrapper[5120]: I0316 16:39:58.226293 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e-config-data\") pod \"cinder-api-0\" (UID: \"08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:39:58 crc kubenswrapper[5120]: I0316 16:39:58.227043 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dbe84e5b-abdf-4300-a41e-26507a638f6e-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "dbe84e5b-abdf-4300-a41e-26507a638f6e" (UID: "dbe84e5b-abdf-4300-a41e-26507a638f6e"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:39:58 crc kubenswrapper[5120]: I0316 16:39:58.228146 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e-config-data-custom\") pod \"cinder-api-0\" (UID: \"08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:39:58 crc kubenswrapper[5120]: I0316 16:39:58.233231 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:39:58 crc kubenswrapper[5120]: I0316 16:39:58.242437 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xz29q\" (UniqueName: \"kubernetes.io/projected/08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e-kube-api-access-xz29q\") pod \"cinder-api-0\" (UID: \"08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:39:58 crc kubenswrapper[5120]: I0316 16:39:58.246890 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dbe84e5b-abdf-4300-a41e-26507a638f6e-config-data" (OuterVolumeSpecName: "config-data") pod "dbe84e5b-abdf-4300-a41e-26507a638f6e" (UID: "dbe84e5b-abdf-4300-a41e-26507a638f6e"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:39:58 crc kubenswrapper[5120]: I0316 16:39:58.303981 5120 scope.go:117] "RemoveContainer" containerID="24c0894ef06547be1566571e8f254f810b1f00c096afa16b4bc459151c30738c" Mar 16 16:39:58 crc kubenswrapper[5120]: I0316 16:39:58.321667 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dbe84e5b-abdf-4300-a41e-26507a638f6e-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:39:58 crc kubenswrapper[5120]: I0316 16:39:58.321711 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dbe84e5b-abdf-4300-a41e-26507a638f6e-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:39:58 crc kubenswrapper[5120]: I0316 16:39:58.345862 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-c56d9997c-vh2kg"] Mar 16 16:39:58 crc kubenswrapper[5120]: I0316 16:39:58.374368 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:39:58 crc kubenswrapper[5120]: I0316 16:39:58.709354 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8aa3ff5c-e848-4140-8c6b-074365d7c3b9" path="/var/lib/kubelet/pods/8aa3ff5c-e848-4140-8c6b-074365d7c3b9/volumes" Mar 16 16:39:58 crc kubenswrapper[5120]: I0316 16:39:58.780191 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:39:58 crc kubenswrapper[5120]: I0316 16:39:58.821558 5120 generic.go:358] "Generic (PLEG): container finished" podID="35dc0e58-ff4f-41f0-9dff-caacb6ec7d24" containerID="53fcd3274507e87c40debf472b785a2e198862cba17e5eee71a2d2e2fd8fce3a" exitCode=143 Mar 16 16:39:58 crc kubenswrapper[5120]: I0316 16:39:58.821594 5120 generic.go:358] "Generic (PLEG): container finished" podID="35dc0e58-ff4f-41f0-9dff-caacb6ec7d24" containerID="aa3d3e7acca98156d0335a1fcc0243e60d7a15b8aeaaed1554aaef4ca2cb666e" exitCode=143 Mar 16 16:39:58 crc kubenswrapper[5120]: I0316 16:39:58.821822 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"35dc0e58-ff4f-41f0-9dff-caacb6ec7d24","Type":"ContainerDied","Data":"53fcd3274507e87c40debf472b785a2e198862cba17e5eee71a2d2e2fd8fce3a"} Mar 16 16:39:58 crc kubenswrapper[5120]: I0316 16:39:58.821860 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"35dc0e58-ff4f-41f0-9dff-caacb6ec7d24","Type":"ContainerDied","Data":"aa3d3e7acca98156d0335a1fcc0243e60d7a15b8aeaaed1554aaef4ca2cb666e"} Mar 16 16:39:58 crc kubenswrapper[5120]: I0316 16:39:58.821886 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"35dc0e58-ff4f-41f0-9dff-caacb6ec7d24","Type":"ContainerDied","Data":"93c21e0f84e19c12e64ab1651cfcf81b95f35477e761a0cfda3317fb2ae18b94"} Mar 16 16:39:58 crc kubenswrapper[5120]: I0316 16:39:58.821906 5120 scope.go:117] "RemoveContainer" containerID="53fcd3274507e87c40debf472b785a2e198862cba17e5eee71a2d2e2fd8fce3a" Mar 16 16:39:58 crc kubenswrapper[5120]: I0316 16:39:58.824690 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:39:58 crc kubenswrapper[5120]: I0316 16:39:58.828630 5120 generic.go:358] "Generic (PLEG): container finished" podID="e0ca2d31-e27b-42b5-8801-469ad47142a5" containerID="2ff684768d9ed08487e6b8399da59d9625b5c9923f0fb5fa6e48a258dc77abdb" exitCode=143 Mar 16 16:39:58 crc kubenswrapper[5120]: I0316 16:39:58.828882 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-599744884-vf6rr" event={"ID":"e0ca2d31-e27b-42b5-8801-469ad47142a5","Type":"ContainerDied","Data":"2ff684768d9ed08487e6b8399da59d9625b5c9923f0fb5fa6e48a258dc77abdb"} Mar 16 16:39:58 crc kubenswrapper[5120]: I0316 16:39:58.837416 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/35dc0e58-ff4f-41f0-9dff-caacb6ec7d24-config-data\") pod \"35dc0e58-ff4f-41f0-9dff-caacb6ec7d24\" (UID: \"35dc0e58-ff4f-41f0-9dff-caacb6ec7d24\") " Mar 16 16:39:58 crc kubenswrapper[5120]: I0316 16:39:58.839248 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-c56d9997c-vh2kg" event={"ID":"3c2042b3-62bc-476f-b032-91e9f77da74a","Type":"ContainerStarted","Data":"8758aab696f8e16a21039b2ad2fa60ce136ffc8c8ef68d51ec645a3466e74a97"} Mar 16 16:39:58 crc kubenswrapper[5120]: I0316 16:39:58.844278 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-c56d9997c-vh2kg" event={"ID":"3c2042b3-62bc-476f-b032-91e9f77da74a","Type":"ContainerStarted","Data":"be94cdca1770fe3a56fe5f7f6fb1c2b0dab54f21545d1deec9fa322622764aa1"} Mar 16 16:39:58 crc kubenswrapper[5120]: I0316 16:39:58.844458 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"1a484747-d317-490a-a502-2c0be9bbcf55","Type":"ContainerStarted","Data":"832a299861e241a080c471f6b6649d2db46b1fbf35b22b4cf0a7dcc57e537d68"} Mar 16 16:39:58 crc kubenswrapper[5120]: I0316 16:39:58.842720 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="1a484747-d317-490a-a502-2c0be9bbcf55" containerName="glance-log" containerID="cri-o://4ebc0070cc17ebb78966102b1793a77f503873a5fb66aa631672b9d947d4cea4" gracePeriod=30 Mar 16 16:39:58 crc kubenswrapper[5120]: I0316 16:39:58.843512 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="1a484747-d317-490a-a502-2c0be9bbcf55" containerName="glance-httpd" containerID="cri-o://832a299861e241a080c471f6b6649d2db46b1fbf35b22b4cf0a7dcc57e537d68" gracePeriod=30 Mar 16 16:39:58 crc kubenswrapper[5120]: I0316 16:39:58.846433 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/35dc0e58-ff4f-41f0-9dff-caacb6ec7d24-combined-ca-bundle\") pod \"35dc0e58-ff4f-41f0-9dff-caacb6ec7d24\" (UID: \"35dc0e58-ff4f-41f0-9dff-caacb6ec7d24\") " Mar 16 16:39:58 crc kubenswrapper[5120]: I0316 16:39:58.846660 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tt852\" (UniqueName: \"kubernetes.io/projected/35dc0e58-ff4f-41f0-9dff-caacb6ec7d24-kube-api-access-tt852\") pod \"35dc0e58-ff4f-41f0-9dff-caacb6ec7d24\" (UID: \"35dc0e58-ff4f-41f0-9dff-caacb6ec7d24\") " Mar 16 16:39:58 crc kubenswrapper[5120]: I0316 16:39:58.848582 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/35dc0e58-ff4f-41f0-9dff-caacb6ec7d24-scripts\") pod \"35dc0e58-ff4f-41f0-9dff-caacb6ec7d24\" (UID: \"35dc0e58-ff4f-41f0-9dff-caacb6ec7d24\") " Mar 16 16:39:58 crc kubenswrapper[5120]: I0316 16:39:58.848825 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"35dc0e58-ff4f-41f0-9dff-caacb6ec7d24\" (UID: \"35dc0e58-ff4f-41f0-9dff-caacb6ec7d24\") " Mar 16 16:39:58 crc kubenswrapper[5120]: I0316 16:39:58.849133 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/35dc0e58-ff4f-41f0-9dff-caacb6ec7d24-logs\") pod \"35dc0e58-ff4f-41f0-9dff-caacb6ec7d24\" (UID: \"35dc0e58-ff4f-41f0-9dff-caacb6ec7d24\") " Mar 16 16:39:58 crc kubenswrapper[5120]: I0316 16:39:58.849365 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/35dc0e58-ff4f-41f0-9dff-caacb6ec7d24-httpd-run\") pod \"35dc0e58-ff4f-41f0-9dff-caacb6ec7d24\" (UID: \"35dc0e58-ff4f-41f0-9dff-caacb6ec7d24\") " Mar 16 16:39:58 crc kubenswrapper[5120]: I0316 16:39:58.851208 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35dc0e58-ff4f-41f0-9dff-caacb6ec7d24-logs" (OuterVolumeSpecName: "logs") pod "35dc0e58-ff4f-41f0-9dff-caacb6ec7d24" (UID: "35dc0e58-ff4f-41f0-9dff-caacb6ec7d24"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:39:58 crc kubenswrapper[5120]: I0316 16:39:58.857655 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35dc0e58-ff4f-41f0-9dff-caacb6ec7d24-kube-api-access-tt852" (OuterVolumeSpecName: "kube-api-access-tt852") pod "35dc0e58-ff4f-41f0-9dff-caacb6ec7d24" (UID: "35dc0e58-ff4f-41f0-9dff-caacb6ec7d24"). InnerVolumeSpecName "kube-api-access-tt852". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:39:58 crc kubenswrapper[5120]: I0316 16:39:58.858004 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35dc0e58-ff4f-41f0-9dff-caacb6ec7d24-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "35dc0e58-ff4f-41f0-9dff-caacb6ec7d24" (UID: "35dc0e58-ff4f-41f0-9dff-caacb6ec7d24"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:39:58 crc kubenswrapper[5120]: I0316 16:39:58.861155 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage20-crc" (OuterVolumeSpecName: "glance") pod "35dc0e58-ff4f-41f0-9dff-caacb6ec7d24" (UID: "35dc0e58-ff4f-41f0-9dff-caacb6ec7d24"). InnerVolumeSpecName "local-storage20-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:39:58 crc kubenswrapper[5120]: I0316 16:39:58.866135 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/35dc0e58-ff4f-41f0-9dff-caacb6ec7d24-scripts" (OuterVolumeSpecName: "scripts") pod "35dc0e58-ff4f-41f0-9dff-caacb6ec7d24" (UID: "35dc0e58-ff4f-41f0-9dff-caacb6ec7d24"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:39:58 crc kubenswrapper[5120]: I0316 16:39:58.869479 5120 scope.go:117] "RemoveContainer" containerID="aa3d3e7acca98156d0335a1fcc0243e60d7a15b8aeaaed1554aaef4ca2cb666e" Mar 16 16:39:58 crc kubenswrapper[5120]: I0316 16:39:58.881608 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:39:58 crc kubenswrapper[5120]: I0316 16:39:58.881918 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"dbe84e5b-abdf-4300-a41e-26507a638f6e","Type":"ContainerDied","Data":"17a9dc6bdc0770ba75daac61eecb285e30919bf19046da9946edefc08eec74af"} Mar 16 16:39:58 crc kubenswrapper[5120]: I0316 16:39:58.935928 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/35dc0e58-ff4f-41f0-9dff-caacb6ec7d24-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "35dc0e58-ff4f-41f0-9dff-caacb6ec7d24" (UID: "35dc0e58-ff4f-41f0-9dff-caacb6ec7d24"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:39:58 crc kubenswrapper[5120]: I0316 16:39:58.936045 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/35dc0e58-ff4f-41f0-9dff-caacb6ec7d24-config-data" (OuterVolumeSpecName: "config-data") pod "35dc0e58-ff4f-41f0-9dff-caacb6ec7d24" (UID: "35dc0e58-ff4f-41f0-9dff-caacb6ec7d24"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:39:58 crc kubenswrapper[5120]: I0316 16:39:58.938844 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-6647785db4-lmftm"] Mar 16 16:39:58 crc kubenswrapper[5120]: I0316 16:39:58.957465 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/35dc0e58-ff4f-41f0-9dff-caacb6ec7d24-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:39:58 crc kubenswrapper[5120]: I0316 16:39:58.957500 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/35dc0e58-ff4f-41f0-9dff-caacb6ec7d24-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:39:58 crc kubenswrapper[5120]: I0316 16:39:58.957510 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tt852\" (UniqueName: \"kubernetes.io/projected/35dc0e58-ff4f-41f0-9dff-caacb6ec7d24-kube-api-access-tt852\") on node \"crc\" DevicePath \"\"" Mar 16 16:39:58 crc kubenswrapper[5120]: I0316 16:39:58.957519 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/35dc0e58-ff4f-41f0-9dff-caacb6ec7d24-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:39:58 crc kubenswrapper[5120]: I0316 16:39:58.957545 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") on node \"crc\" " Mar 16 16:39:58 crc kubenswrapper[5120]: I0316 16:39:58.957557 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/35dc0e58-ff4f-41f0-9dff-caacb6ec7d24-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:39:58 crc kubenswrapper[5120]: I0316 16:39:58.957568 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/35dc0e58-ff4f-41f0-9dff-caacb6ec7d24-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 16:39:58 crc kubenswrapper[5120]: I0316 16:39:58.972775 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-internal-api-0" podStartSLOduration=6.972732234 podStartE2EDuration="6.972732234s" podCreationTimestamp="2026-03-16 16:39:52 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:39:58.874129618 +0000 UTC m=+4101.028061285" watchObservedRunningTime="2026-03-16 16:39:58.972732234 +0000 UTC m=+4101.126663891" Mar 16 16:39:58 crc kubenswrapper[5120]: I0316 16:39:58.984094 5120 scope.go:117] "RemoveContainer" containerID="53fcd3274507e87c40debf472b785a2e198862cba17e5eee71a2d2e2fd8fce3a" Mar 16 16:39:58 crc kubenswrapper[5120]: E0316 16:39:58.984921 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"53fcd3274507e87c40debf472b785a2e198862cba17e5eee71a2d2e2fd8fce3a\": container with ID starting with 53fcd3274507e87c40debf472b785a2e198862cba17e5eee71a2d2e2fd8fce3a not found: ID does not exist" containerID="53fcd3274507e87c40debf472b785a2e198862cba17e5eee71a2d2e2fd8fce3a" Mar 16 16:39:58 crc kubenswrapper[5120]: I0316 16:39:58.984950 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53fcd3274507e87c40debf472b785a2e198862cba17e5eee71a2d2e2fd8fce3a"} err="failed to get container status \"53fcd3274507e87c40debf472b785a2e198862cba17e5eee71a2d2e2fd8fce3a\": rpc error: code = NotFound desc = could not find container \"53fcd3274507e87c40debf472b785a2e198862cba17e5eee71a2d2e2fd8fce3a\": container with ID starting with 53fcd3274507e87c40debf472b785a2e198862cba17e5eee71a2d2e2fd8fce3a not found: ID does not exist" Mar 16 16:39:58 crc kubenswrapper[5120]: I0316 16:39:58.984973 5120 scope.go:117] "RemoveContainer" containerID="aa3d3e7acca98156d0335a1fcc0243e60d7a15b8aeaaed1554aaef4ca2cb666e" Mar 16 16:39:58 crc kubenswrapper[5120]: E0316 16:39:58.985502 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa3d3e7acca98156d0335a1fcc0243e60d7a15b8aeaaed1554aaef4ca2cb666e\": container with ID starting with aa3d3e7acca98156d0335a1fcc0243e60d7a15b8aeaaed1554aaef4ca2cb666e not found: ID does not exist" containerID="aa3d3e7acca98156d0335a1fcc0243e60d7a15b8aeaaed1554aaef4ca2cb666e" Mar 16 16:39:58 crc kubenswrapper[5120]: I0316 16:39:58.985520 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa3d3e7acca98156d0335a1fcc0243e60d7a15b8aeaaed1554aaef4ca2cb666e"} err="failed to get container status \"aa3d3e7acca98156d0335a1fcc0243e60d7a15b8aeaaed1554aaef4ca2cb666e\": rpc error: code = NotFound desc = could not find container \"aa3d3e7acca98156d0335a1fcc0243e60d7a15b8aeaaed1554aaef4ca2cb666e\": container with ID starting with aa3d3e7acca98156d0335a1fcc0243e60d7a15b8aeaaed1554aaef4ca2cb666e not found: ID does not exist" Mar 16 16:39:58 crc kubenswrapper[5120]: I0316 16:39:58.985533 5120 scope.go:117] "RemoveContainer" containerID="53fcd3274507e87c40debf472b785a2e198862cba17e5eee71a2d2e2fd8fce3a" Mar 16 16:39:58 crc kubenswrapper[5120]: I0316 16:39:58.986047 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53fcd3274507e87c40debf472b785a2e198862cba17e5eee71a2d2e2fd8fce3a"} err="failed to get container status \"53fcd3274507e87c40debf472b785a2e198862cba17e5eee71a2d2e2fd8fce3a\": rpc error: code = NotFound desc = could not find container \"53fcd3274507e87c40debf472b785a2e198862cba17e5eee71a2d2e2fd8fce3a\": container with ID starting with 53fcd3274507e87c40debf472b785a2e198862cba17e5eee71a2d2e2fd8fce3a not found: ID does not exist" Mar 16 16:39:58 crc kubenswrapper[5120]: I0316 16:39:58.986064 5120 scope.go:117] "RemoveContainer" containerID="aa3d3e7acca98156d0335a1fcc0243e60d7a15b8aeaaed1554aaef4ca2cb666e" Mar 16 16:39:58 crc kubenswrapper[5120]: I0316 16:39:58.989388 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa3d3e7acca98156d0335a1fcc0243e60d7a15b8aeaaed1554aaef4ca2cb666e"} err="failed to get container status \"aa3d3e7acca98156d0335a1fcc0243e60d7a15b8aeaaed1554aaef4ca2cb666e\": rpc error: code = NotFound desc = could not find container \"aa3d3e7acca98156d0335a1fcc0243e60d7a15b8aeaaed1554aaef4ca2cb666e\": container with ID starting with aa3d3e7acca98156d0335a1fcc0243e60d7a15b8aeaaed1554aaef4ca2cb666e not found: ID does not exist" Mar 16 16:39:58 crc kubenswrapper[5120]: I0316 16:39:58.989411 5120 scope.go:117] "RemoveContainer" containerID="aaaa3047ea6ddfa53e4fffe26abb9aeab7722630d030f2c35817080bdd772765" Mar 16 16:39:59 crc kubenswrapper[5120]: I0316 16:39:59.006703 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:39:59 crc kubenswrapper[5120]: I0316 16:39:59.017539 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:39:59 crc kubenswrapper[5120]: I0316 16:39:59.028973 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage20-crc" (UniqueName: "kubernetes.io/local-volume/local-storage20-crc") on node "crc" Mar 16 16:39:59 crc kubenswrapper[5120]: I0316 16:39:59.043985 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:39:59 crc kubenswrapper[5120]: I0316 16:39:59.048539 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35dc0e58-ff4f-41f0-9dff-caacb6ec7d24" containerName="glance-log" Mar 16 16:39:59 crc kubenswrapper[5120]: I0316 16:39:59.048570 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="35dc0e58-ff4f-41f0-9dff-caacb6ec7d24" containerName="glance-log" Mar 16 16:39:59 crc kubenswrapper[5120]: I0316 16:39:59.048627 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35dc0e58-ff4f-41f0-9dff-caacb6ec7d24" containerName="glance-httpd" Mar 16 16:39:59 crc kubenswrapper[5120]: I0316 16:39:59.048634 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="35dc0e58-ff4f-41f0-9dff-caacb6ec7d24" containerName="glance-httpd" Mar 16 16:39:59 crc kubenswrapper[5120]: I0316 16:39:59.048848 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="35dc0e58-ff4f-41f0-9dff-caacb6ec7d24" containerName="glance-log" Mar 16 16:39:59 crc kubenswrapper[5120]: I0316 16:39:59.048862 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="35dc0e58-ff4f-41f0-9dff-caacb6ec7d24" containerName="glance-httpd" Mar 16 16:39:59 crc kubenswrapper[5120]: I0316 16:39:59.056004 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:39:59 crc kubenswrapper[5120]: I0316 16:39:59.059684 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:39:59 crc kubenswrapper[5120]: I0316 16:39:59.061988 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 16:39:59 crc kubenswrapper[5120]: I0316 16:39:59.062341 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 16:39:59 crc kubenswrapper[5120]: I0316 16:39:59.073588 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:39:59 crc kubenswrapper[5120]: I0316 16:39:59.085958 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-765d49ff54-tqw2c"] Mar 16 16:39:59 crc kubenswrapper[5120]: I0316 16:39:59.167261 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/da8c9ee6-9520-4597-a4cb-d06ea1d0772c-scripts\") pod \"ceilometer-0\" (UID: \"da8c9ee6-9520-4597-a4cb-d06ea1d0772c\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:39:59 crc kubenswrapper[5120]: I0316 16:39:59.167312 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/da8c9ee6-9520-4597-a4cb-d06ea1d0772c-run-httpd\") pod \"ceilometer-0\" (UID: \"da8c9ee6-9520-4597-a4cb-d06ea1d0772c\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:39:59 crc kubenswrapper[5120]: I0316 16:39:59.167368 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/da8c9ee6-9520-4597-a4cb-d06ea1d0772c-log-httpd\") pod \"ceilometer-0\" (UID: \"da8c9ee6-9520-4597-a4cb-d06ea1d0772c\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:39:59 crc kubenswrapper[5120]: I0316 16:39:59.167498 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/da8c9ee6-9520-4597-a4cb-d06ea1d0772c-config-data\") pod \"ceilometer-0\" (UID: \"da8c9ee6-9520-4597-a4cb-d06ea1d0772c\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:39:59 crc kubenswrapper[5120]: I0316 16:39:59.167543 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d5n4c\" (UniqueName: \"kubernetes.io/projected/da8c9ee6-9520-4597-a4cb-d06ea1d0772c-kube-api-access-d5n4c\") pod \"ceilometer-0\" (UID: \"da8c9ee6-9520-4597-a4cb-d06ea1d0772c\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:39:59 crc kubenswrapper[5120]: I0316 16:39:59.167612 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/da8c9ee6-9520-4597-a4cb-d06ea1d0772c-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"da8c9ee6-9520-4597-a4cb-d06ea1d0772c\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:39:59 crc kubenswrapper[5120]: I0316 16:39:59.167657 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/da8c9ee6-9520-4597-a4cb-d06ea1d0772c-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"da8c9ee6-9520-4597-a4cb-d06ea1d0772c\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:39:59 crc kubenswrapper[5120]: I0316 16:39:59.204701 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:39:59 crc kubenswrapper[5120]: I0316 16:39:59.276491 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/da8c9ee6-9520-4597-a4cb-d06ea1d0772c-scripts\") pod \"ceilometer-0\" (UID: \"da8c9ee6-9520-4597-a4cb-d06ea1d0772c\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:39:59 crc kubenswrapper[5120]: I0316 16:39:59.276807 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/da8c9ee6-9520-4597-a4cb-d06ea1d0772c-run-httpd\") pod \"ceilometer-0\" (UID: \"da8c9ee6-9520-4597-a4cb-d06ea1d0772c\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:39:59 crc kubenswrapper[5120]: I0316 16:39:59.276903 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/da8c9ee6-9520-4597-a4cb-d06ea1d0772c-log-httpd\") pod \"ceilometer-0\" (UID: \"da8c9ee6-9520-4597-a4cb-d06ea1d0772c\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:39:59 crc kubenswrapper[5120]: I0316 16:39:59.277128 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/da8c9ee6-9520-4597-a4cb-d06ea1d0772c-config-data\") pod \"ceilometer-0\" (UID: \"da8c9ee6-9520-4597-a4cb-d06ea1d0772c\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:39:59 crc kubenswrapper[5120]: I0316 16:39:59.277185 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d5n4c\" (UniqueName: \"kubernetes.io/projected/da8c9ee6-9520-4597-a4cb-d06ea1d0772c-kube-api-access-d5n4c\") pod \"ceilometer-0\" (UID: \"da8c9ee6-9520-4597-a4cb-d06ea1d0772c\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:39:59 crc kubenswrapper[5120]: I0316 16:39:59.277285 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/da8c9ee6-9520-4597-a4cb-d06ea1d0772c-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"da8c9ee6-9520-4597-a4cb-d06ea1d0772c\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:39:59 crc kubenswrapper[5120]: I0316 16:39:59.277352 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/da8c9ee6-9520-4597-a4cb-d06ea1d0772c-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"da8c9ee6-9520-4597-a4cb-d06ea1d0772c\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:39:59 crc kubenswrapper[5120]: I0316 16:39:59.281134 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/da8c9ee6-9520-4597-a4cb-d06ea1d0772c-run-httpd\") pod \"ceilometer-0\" (UID: \"da8c9ee6-9520-4597-a4cb-d06ea1d0772c\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:39:59 crc kubenswrapper[5120]: I0316 16:39:59.281486 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/da8c9ee6-9520-4597-a4cb-d06ea1d0772c-log-httpd\") pod \"ceilometer-0\" (UID: \"da8c9ee6-9520-4597-a4cb-d06ea1d0772c\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:39:59 crc kubenswrapper[5120]: I0316 16:39:59.285383 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/da8c9ee6-9520-4597-a4cb-d06ea1d0772c-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"da8c9ee6-9520-4597-a4cb-d06ea1d0772c\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:39:59 crc kubenswrapper[5120]: I0316 16:39:59.285821 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/da8c9ee6-9520-4597-a4cb-d06ea1d0772c-scripts\") pod \"ceilometer-0\" (UID: \"da8c9ee6-9520-4597-a4cb-d06ea1d0772c\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:39:59 crc kubenswrapper[5120]: I0316 16:39:59.288912 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:39:59 crc kubenswrapper[5120]: I0316 16:39:59.290302 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/da8c9ee6-9520-4597-a4cb-d06ea1d0772c-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"da8c9ee6-9520-4597-a4cb-d06ea1d0772c\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:39:59 crc kubenswrapper[5120]: I0316 16:39:59.291408 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/da8c9ee6-9520-4597-a4cb-d06ea1d0772c-config-data\") pod \"ceilometer-0\" (UID: \"da8c9ee6-9520-4597-a4cb-d06ea1d0772c\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:39:59 crc kubenswrapper[5120]: I0316 16:39:59.301399 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:39:59 crc kubenswrapper[5120]: I0316 16:39:59.340214 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:39:59 crc kubenswrapper[5120]: I0316 16:39:59.366829 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5n4c\" (UniqueName: \"kubernetes.io/projected/da8c9ee6-9520-4597-a4cb-d06ea1d0772c-kube-api-access-d5n4c\") pod \"ceilometer-0\" (UID: \"da8c9ee6-9520-4597-a4cb-d06ea1d0772c\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:39:59 crc kubenswrapper[5120]: I0316 16:39:59.451537 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:39:59 crc kubenswrapper[5120]: I0316 16:39:59.515753 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:39:59 crc kubenswrapper[5120]: I0316 16:39:59.516246 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:39:59 crc kubenswrapper[5120]: I0316 16:39:59.522249 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-public-svc\"" Mar 16 16:39:59 crc kubenswrapper[5120]: I0316 16:39:59.523556 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-external-config-data\"" Mar 16 16:39:59 crc kubenswrapper[5120]: I0316 16:39:59.602168 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/43ae87ab-7a99-41df-b39a-930c7a5a232d-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"43ae87ab-7a99-41df-b39a-930c7a5a232d\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:39:59 crc kubenswrapper[5120]: I0316 16:39:59.602436 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85wg5\" (UniqueName: \"kubernetes.io/projected/43ae87ab-7a99-41df-b39a-930c7a5a232d-kube-api-access-85wg5\") pod \"glance-default-external-api-0\" (UID: \"43ae87ab-7a99-41df-b39a-930c7a5a232d\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:39:59 crc kubenswrapper[5120]: I0316 16:39:59.602466 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"glance-default-external-api-0\" (UID: \"43ae87ab-7a99-41df-b39a-930c7a5a232d\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:39:59 crc kubenswrapper[5120]: I0316 16:39:59.602490 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/43ae87ab-7a99-41df-b39a-930c7a5a232d-scripts\") pod \"glance-default-external-api-0\" (UID: \"43ae87ab-7a99-41df-b39a-930c7a5a232d\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:39:59 crc kubenswrapper[5120]: I0316 16:39:59.602513 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/43ae87ab-7a99-41df-b39a-930c7a5a232d-logs\") pod \"glance-default-external-api-0\" (UID: \"43ae87ab-7a99-41df-b39a-930c7a5a232d\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:39:59 crc kubenswrapper[5120]: I0316 16:39:59.602546 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/43ae87ab-7a99-41df-b39a-930c7a5a232d-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"43ae87ab-7a99-41df-b39a-930c7a5a232d\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:39:59 crc kubenswrapper[5120]: I0316 16:39:59.602618 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/43ae87ab-7a99-41df-b39a-930c7a5a232d-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"43ae87ab-7a99-41df-b39a-930c7a5a232d\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:39:59 crc kubenswrapper[5120]: I0316 16:39:59.602638 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/43ae87ab-7a99-41df-b39a-930c7a5a232d-config-data\") pod \"glance-default-external-api-0\" (UID: \"43ae87ab-7a99-41df-b39a-930c7a5a232d\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:39:59 crc kubenswrapper[5120]: I0316 16:39:59.622568 5120 scope.go:117] "RemoveContainer" containerID="9fc2e8df4084347acd634ad812a7cc67034d64eca198e49d1e200757d740e6dc" Mar 16 16:39:59 crc kubenswrapper[5120]: I0316 16:39:59.704625 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/43ae87ab-7a99-41df-b39a-930c7a5a232d-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"43ae87ab-7a99-41df-b39a-930c7a5a232d\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:39:59 crc kubenswrapper[5120]: I0316 16:39:59.704799 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/43ae87ab-7a99-41df-b39a-930c7a5a232d-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"43ae87ab-7a99-41df-b39a-930c7a5a232d\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:39:59 crc kubenswrapper[5120]: I0316 16:39:59.704829 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/43ae87ab-7a99-41df-b39a-930c7a5a232d-config-data\") pod \"glance-default-external-api-0\" (UID: \"43ae87ab-7a99-41df-b39a-930c7a5a232d\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:39:59 crc kubenswrapper[5120]: I0316 16:39:59.704940 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/43ae87ab-7a99-41df-b39a-930c7a5a232d-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"43ae87ab-7a99-41df-b39a-930c7a5a232d\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:39:59 crc kubenswrapper[5120]: I0316 16:39:59.705219 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-85wg5\" (UniqueName: \"kubernetes.io/projected/43ae87ab-7a99-41df-b39a-930c7a5a232d-kube-api-access-85wg5\") pod \"glance-default-external-api-0\" (UID: \"43ae87ab-7a99-41df-b39a-930c7a5a232d\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:39:59 crc kubenswrapper[5120]: I0316 16:39:59.705269 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"glance-default-external-api-0\" (UID: \"43ae87ab-7a99-41df-b39a-930c7a5a232d\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:39:59 crc kubenswrapper[5120]: I0316 16:39:59.705308 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/43ae87ab-7a99-41df-b39a-930c7a5a232d-scripts\") pod \"glance-default-external-api-0\" (UID: \"43ae87ab-7a99-41df-b39a-930c7a5a232d\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:39:59 crc kubenswrapper[5120]: I0316 16:39:59.705343 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/43ae87ab-7a99-41df-b39a-930c7a5a232d-logs\") pod \"glance-default-external-api-0\" (UID: \"43ae87ab-7a99-41df-b39a-930c7a5a232d\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:39:59 crc kubenswrapper[5120]: I0316 16:39:59.705922 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/43ae87ab-7a99-41df-b39a-930c7a5a232d-logs\") pod \"glance-default-external-api-0\" (UID: \"43ae87ab-7a99-41df-b39a-930c7a5a232d\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:39:59 crc kubenswrapper[5120]: I0316 16:39:59.708250 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/43ae87ab-7a99-41df-b39a-930c7a5a232d-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"43ae87ab-7a99-41df-b39a-930c7a5a232d\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:39:59 crc kubenswrapper[5120]: I0316 16:39:59.708442 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"glance-default-external-api-0\" (UID: \"43ae87ab-7a99-41df-b39a-930c7a5a232d\") device mount path \"/mnt/openstack/pv20\"" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:39:59 crc kubenswrapper[5120]: I0316 16:39:59.718662 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/43ae87ab-7a99-41df-b39a-930c7a5a232d-config-data\") pod \"glance-default-external-api-0\" (UID: \"43ae87ab-7a99-41df-b39a-930c7a5a232d\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:39:59 crc kubenswrapper[5120]: I0316 16:39:59.722444 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/43ae87ab-7a99-41df-b39a-930c7a5a232d-scripts\") pod \"glance-default-external-api-0\" (UID: \"43ae87ab-7a99-41df-b39a-930c7a5a232d\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:39:59 crc kubenswrapper[5120]: I0316 16:39:59.722539 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/43ae87ab-7a99-41df-b39a-930c7a5a232d-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"43ae87ab-7a99-41df-b39a-930c7a5a232d\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:39:59 crc kubenswrapper[5120]: I0316 16:39:59.724451 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/43ae87ab-7a99-41df-b39a-930c7a5a232d-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"43ae87ab-7a99-41df-b39a-930c7a5a232d\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:39:59 crc kubenswrapper[5120]: I0316 16:39:59.730076 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-85wg5\" (UniqueName: \"kubernetes.io/projected/43ae87ab-7a99-41df-b39a-930c7a5a232d-kube-api-access-85wg5\") pod \"glance-default-external-api-0\" (UID: \"43ae87ab-7a99-41df-b39a-930c7a5a232d\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:39:59 crc kubenswrapper[5120]: I0316 16:39:59.748958 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"glance-default-external-api-0\" (UID: \"43ae87ab-7a99-41df-b39a-930c7a5a232d\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:39:59 crc kubenswrapper[5120]: I0316 16:39:59.772156 5120 scope.go:117] "RemoveContainer" containerID="340ea5b4a4b6b79e8eec7809aa702596df745abcc22f8a28a465f4260dc1fd9d" Mar 16 16:39:59 crc kubenswrapper[5120]: I0316 16:39:59.820978 5120 scope.go:117] "RemoveContainer" containerID="319369720a667a7bb1a0c88fafefc7dfc242dc278d328913f43f46f2c6de973d" Mar 16 16:39:59 crc kubenswrapper[5120]: I0316 16:39:59.852974 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:39:59 crc kubenswrapper[5120]: I0316 16:39:59.900366 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e","Type":"ContainerStarted","Data":"091f130b89538ea4686698ff9c4a3368a1cedee64b16ed1969a99d3820d28b2f"} Mar 16 16:39:59 crc kubenswrapper[5120]: I0316 16:39:59.902792 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-765d49ff54-tqw2c" event={"ID":"4a708d1c-43d9-400d-a30e-49891c1fc39d","Type":"ContainerStarted","Data":"91e1d114437a9a095ceef9b65070addb3b4be7d39f0aa82278b39e2e2451e97c"} Mar 16 16:39:59 crc kubenswrapper[5120]: I0316 16:39:59.904062 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-6647785db4-lmftm" event={"ID":"1518bfb1-3665-455c-84df-7c6eba7b93cf","Type":"ContainerStarted","Data":"16f8cef67b0a9ea7deae75c8617d1f1fdfe1e13d809bd91cbd883543e8d04df8"} Mar 16 16:39:59 crc kubenswrapper[5120]: I0316 16:39:59.911096 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-c56d9997c-vh2kg" event={"ID":"3c2042b3-62bc-476f-b032-91e9f77da74a","Type":"ContainerStarted","Data":"949e4f70bb7999ef9b809a2b382188ebf770f0042c3c7a32632aa1a421a1c410"} Mar 16 16:39:59 crc kubenswrapper[5120]: I0316 16:39:59.961106 5120 generic.go:358] "Generic (PLEG): container finished" podID="1a484747-d317-490a-a502-2c0be9bbcf55" containerID="832a299861e241a080c471f6b6649d2db46b1fbf35b22b4cf0a7dcc57e537d68" exitCode=0 Mar 16 16:39:59 crc kubenswrapper[5120]: I0316 16:39:59.961142 5120 generic.go:358] "Generic (PLEG): container finished" podID="1a484747-d317-490a-a502-2c0be9bbcf55" containerID="4ebc0070cc17ebb78966102b1793a77f503873a5fb66aa631672b9d947d4cea4" exitCode=143 Mar 16 16:39:59 crc kubenswrapper[5120]: I0316 16:39:59.961341 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"1a484747-d317-490a-a502-2c0be9bbcf55","Type":"ContainerDied","Data":"832a299861e241a080c471f6b6649d2db46b1fbf35b22b4cf0a7dcc57e537d68"} Mar 16 16:39:59 crc kubenswrapper[5120]: I0316 16:39:59.961368 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"1a484747-d317-490a-a502-2c0be9bbcf55","Type":"ContainerDied","Data":"4ebc0070cc17ebb78966102b1793a77f503873a5fb66aa631672b9d947d4cea4"} Mar 16 16:39:59 crc kubenswrapper[5120]: I0316 16:39:59.995876 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-worker-c56d9997c-vh2kg" podStartSLOduration=2.995853623 podStartE2EDuration="2.995853623s" podCreationTimestamp="2026-03-16 16:39:57 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:39:59.945217388 +0000 UTC m=+4102.099149055" watchObservedRunningTime="2026-03-16 16:39:59.995853623 +0000 UTC m=+4102.149785280" Mar 16 16:39:59 crc kubenswrapper[5120]: I0316 16:39:59.996441 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-584b4f85f9-ttk4d"] Mar 16 16:39:59 crc kubenswrapper[5120]: I0316 16:39:59.996702 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-584b4f85f9-ttk4d" podUID="84416c7c-79e8-4adb-803f-39ac90a5d695" containerName="barbican-worker-log" containerID="cri-o://d1df920df6411dbd85fe8c77a5ec77498fb1f6bc2070a950c7f9164b76f3ed2f" gracePeriod=30 Mar 16 16:39:59 crc kubenswrapper[5120]: I0316 16:39:59.997438 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-584b4f85f9-ttk4d" podUID="84416c7c-79e8-4adb-803f-39ac90a5d695" containerName="barbican-worker" containerID="cri-o://321e2cd5e6d548a888ac8f869db76f129d02473220b6c36160a9ee61376a500f" gracePeriod=30 Mar 16 16:40:00 crc kubenswrapper[5120]: I0316 16:40:00.065429 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:40:00 crc kubenswrapper[5120]: I0316 16:40:00.171837 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-infra/auto-csr-approver-29561320-krs6p"] Mar 16 16:40:00 crc kubenswrapper[5120]: I0316 16:40:00.178534 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a484747-d317-490a-a502-2c0be9bbcf55" containerName="glance-log" Mar 16 16:40:00 crc kubenswrapper[5120]: I0316 16:40:00.178561 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a484747-d317-490a-a502-2c0be9bbcf55" containerName="glance-log" Mar 16 16:40:00 crc kubenswrapper[5120]: I0316 16:40:00.178587 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a484747-d317-490a-a502-2c0be9bbcf55" containerName="glance-httpd" Mar 16 16:40:00 crc kubenswrapper[5120]: I0316 16:40:00.178595 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a484747-d317-490a-a502-2c0be9bbcf55" containerName="glance-httpd" Mar 16 16:40:00 crc kubenswrapper[5120]: I0316 16:40:00.178814 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1a484747-d317-490a-a502-2c0be9bbcf55" containerName="glance-httpd" Mar 16 16:40:00 crc kubenswrapper[5120]: I0316 16:40:00.178845 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1a484747-d317-490a-a502-2c0be9bbcf55" containerName="glance-log" Mar 16 16:40:00 crc kubenswrapper[5120]: I0316 16:40:00.209917 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561320-krs6p"] Mar 16 16:40:00 crc kubenswrapper[5120]: I0316 16:40:00.210277 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561320-krs6p" Mar 16 16:40:00 crc kubenswrapper[5120]: I0316 16:40:00.214000 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"kube-root-ca.crt\"" Mar 16 16:40:00 crc kubenswrapper[5120]: I0316 16:40:00.214358 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"openshift-service-ca.crt\"" Mar 16 16:40:00 crc kubenswrapper[5120]: I0316 16:40:00.216311 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-infra\"/\"csr-approver-sa-dockercfg-x2nsz\"" Mar 16 16:40:00 crc kubenswrapper[5120]: I0316 16:40:00.230025 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-chkpg\" (UniqueName: \"kubernetes.io/projected/1a484747-d317-490a-a502-2c0be9bbcf55-kube-api-access-chkpg\") pod \"1a484747-d317-490a-a502-2c0be9bbcf55\" (UID: \"1a484747-d317-490a-a502-2c0be9bbcf55\") " Mar 16 16:40:00 crc kubenswrapper[5120]: I0316 16:40:00.230174 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1a484747-d317-490a-a502-2c0be9bbcf55-combined-ca-bundle\") pod \"1a484747-d317-490a-a502-2c0be9bbcf55\" (UID: \"1a484747-d317-490a-a502-2c0be9bbcf55\") " Mar 16 16:40:00 crc kubenswrapper[5120]: I0316 16:40:00.230192 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"1a484747-d317-490a-a502-2c0be9bbcf55\" (UID: \"1a484747-d317-490a-a502-2c0be9bbcf55\") " Mar 16 16:40:00 crc kubenswrapper[5120]: I0316 16:40:00.230257 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1a484747-d317-490a-a502-2c0be9bbcf55-config-data\") pod \"1a484747-d317-490a-a502-2c0be9bbcf55\" (UID: \"1a484747-d317-490a-a502-2c0be9bbcf55\") " Mar 16 16:40:00 crc kubenswrapper[5120]: I0316 16:40:00.230280 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1a484747-d317-490a-a502-2c0be9bbcf55-scripts\") pod \"1a484747-d317-490a-a502-2c0be9bbcf55\" (UID: \"1a484747-d317-490a-a502-2c0be9bbcf55\") " Mar 16 16:40:00 crc kubenswrapper[5120]: I0316 16:40:00.230589 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/1a484747-d317-490a-a502-2c0be9bbcf55-logs\") pod \"1a484747-d317-490a-a502-2c0be9bbcf55\" (UID: \"1a484747-d317-490a-a502-2c0be9bbcf55\") " Mar 16 16:40:00 crc kubenswrapper[5120]: I0316 16:40:00.230651 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/1a484747-d317-490a-a502-2c0be9bbcf55-httpd-run\") pod \"1a484747-d317-490a-a502-2c0be9bbcf55\" (UID: \"1a484747-d317-490a-a502-2c0be9bbcf55\") " Mar 16 16:40:00 crc kubenswrapper[5120]: I0316 16:40:00.231964 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a484747-d317-490a-a502-2c0be9bbcf55-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "1a484747-d317-490a-a502-2c0be9bbcf55" (UID: "1a484747-d317-490a-a502-2c0be9bbcf55"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:40:00 crc kubenswrapper[5120]: I0316 16:40:00.249485 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a484747-d317-490a-a502-2c0be9bbcf55-logs" (OuterVolumeSpecName: "logs") pod "1a484747-d317-490a-a502-2c0be9bbcf55" (UID: "1a484747-d317-490a-a502-2c0be9bbcf55"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:40:00 crc kubenswrapper[5120]: I0316 16:40:00.257443 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1a484747-d317-490a-a502-2c0be9bbcf55-scripts" (OuterVolumeSpecName: "scripts") pod "1a484747-d317-490a-a502-2c0be9bbcf55" (UID: "1a484747-d317-490a-a502-2c0be9bbcf55"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:40:00 crc kubenswrapper[5120]: I0316 16:40:00.266592 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a484747-d317-490a-a502-2c0be9bbcf55-kube-api-access-chkpg" (OuterVolumeSpecName: "kube-api-access-chkpg") pod "1a484747-d317-490a-a502-2c0be9bbcf55" (UID: "1a484747-d317-490a-a502-2c0be9bbcf55"). InnerVolumeSpecName "kube-api-access-chkpg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:40:00 crc kubenswrapper[5120]: I0316 16:40:00.285284 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage06-crc" (OuterVolumeSpecName: "glance") pod "1a484747-d317-490a-a502-2c0be9bbcf55" (UID: "1a484747-d317-490a-a502-2c0be9bbcf55"). InnerVolumeSpecName "local-storage06-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:40:00 crc kubenswrapper[5120]: I0316 16:40:00.298733 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1a484747-d317-490a-a502-2c0be9bbcf55-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "1a484747-d317-490a-a502-2c0be9bbcf55" (UID: "1a484747-d317-490a-a502-2c0be9bbcf55"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:40:00 crc kubenswrapper[5120]: I0316 16:40:00.314151 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:40:00 crc kubenswrapper[5120]: I0316 16:40:00.333272 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4b9cj\" (UniqueName: \"kubernetes.io/projected/923b199c-e73a-49ce-b4b7-cf219cc0fc76-kube-api-access-4b9cj\") pod \"auto-csr-approver-29561320-krs6p\" (UID: \"923b199c-e73a-49ce-b4b7-cf219cc0fc76\") " pod="openshift-infra/auto-csr-approver-29561320-krs6p" Mar 16 16:40:00 crc kubenswrapper[5120]: I0316 16:40:00.333394 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/1a484747-d317-490a-a502-2c0be9bbcf55-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:40:00 crc kubenswrapper[5120]: I0316 16:40:00.333408 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/1a484747-d317-490a-a502-2c0be9bbcf55-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 16:40:00 crc kubenswrapper[5120]: I0316 16:40:00.333418 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-chkpg\" (UniqueName: \"kubernetes.io/projected/1a484747-d317-490a-a502-2c0be9bbcf55-kube-api-access-chkpg\") on node \"crc\" DevicePath \"\"" Mar 16 16:40:00 crc kubenswrapper[5120]: I0316 16:40:00.333428 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1a484747-d317-490a-a502-2c0be9bbcf55-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:40:00 crc kubenswrapper[5120]: I0316 16:40:00.333452 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") on node \"crc\" " Mar 16 16:40:00 crc kubenswrapper[5120]: I0316 16:40:00.333460 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1a484747-d317-490a-a502-2c0be9bbcf55-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:40:00 crc kubenswrapper[5120]: I0316 16:40:00.355809 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1a484747-d317-490a-a502-2c0be9bbcf55-config-data" (OuterVolumeSpecName: "config-data") pod "1a484747-d317-490a-a502-2c0be9bbcf55" (UID: "1a484747-d317-490a-a502-2c0be9bbcf55"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:40:00 crc kubenswrapper[5120]: I0316 16:40:00.365132 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage06-crc" (UniqueName: "kubernetes.io/local-volume/local-storage06-crc") on node "crc" Mar 16 16:40:00 crc kubenswrapper[5120]: W0316 16:40:00.427702 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podda8c9ee6_9520_4597_a4cb_d06ea1d0772c.slice/crio-82b1f6a8defd07de43914b235b6db4ae0a71147bc4dde5120a143ef84c89d97b WatchSource:0}: Error finding container 82b1f6a8defd07de43914b235b6db4ae0a71147bc4dde5120a143ef84c89d97b: Status 404 returned error can't find the container with id 82b1f6a8defd07de43914b235b6db4ae0a71147bc4dde5120a143ef84c89d97b Mar 16 16:40:00 crc kubenswrapper[5120]: I0316 16:40:00.438797 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4b9cj\" (UniqueName: \"kubernetes.io/projected/923b199c-e73a-49ce-b4b7-cf219cc0fc76-kube-api-access-4b9cj\") pod \"auto-csr-approver-29561320-krs6p\" (UID: \"923b199c-e73a-49ce-b4b7-cf219cc0fc76\") " pod="openshift-infra/auto-csr-approver-29561320-krs6p" Mar 16 16:40:00 crc kubenswrapper[5120]: I0316 16:40:00.440478 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:40:00 crc kubenswrapper[5120]: I0316 16:40:00.440499 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1a484747-d317-490a-a502-2c0be9bbcf55-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:40:00 crc kubenswrapper[5120]: I0316 16:40:00.460026 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4b9cj\" (UniqueName: \"kubernetes.io/projected/923b199c-e73a-49ce-b4b7-cf219cc0fc76-kube-api-access-4b9cj\") pod \"auto-csr-approver-29561320-krs6p\" (UID: \"923b199c-e73a-49ce-b4b7-cf219cc0fc76\") " pod="openshift-infra/auto-csr-approver-29561320-krs6p" Mar 16 16:40:00 crc kubenswrapper[5120]: I0316 16:40:00.566271 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:40:00 crc kubenswrapper[5120]: W0316 16:40:00.576490 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod43ae87ab_7a99_41df_b39a_930c7a5a232d.slice/crio-aea72b20d7604693db290e5cec4502522c62eca44b8a7c5fe71adb8801efb0c6 WatchSource:0}: Error finding container aea72b20d7604693db290e5cec4502522c62eca44b8a7c5fe71adb8801efb0c6: Status 404 returned error can't find the container with id aea72b20d7604693db290e5cec4502522c62eca44b8a7c5fe71adb8801efb0c6 Mar 16 16:40:00 crc kubenswrapper[5120]: I0316 16:40:00.692155 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="35dc0e58-ff4f-41f0-9dff-caacb6ec7d24" path="/var/lib/kubelet/pods/35dc0e58-ff4f-41f0-9dff-caacb6ec7d24/volumes" Mar 16 16:40:00 crc kubenswrapper[5120]: I0316 16:40:00.693306 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dbe84e5b-abdf-4300-a41e-26507a638f6e" path="/var/lib/kubelet/pods/dbe84e5b-abdf-4300-a41e-26507a638f6e/volumes" Mar 16 16:40:00 crc kubenswrapper[5120]: I0316 16:40:00.722725 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561320-krs6p" Mar 16 16:40:00 crc kubenswrapper[5120]: I0316 16:40:00.818857 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:40:00 crc kubenswrapper[5120]: I0316 16:40:00.885227 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:40:01 crc kubenswrapper[5120]: I0316 16:40:01.068254 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-765d49ff54-tqw2c" event={"ID":"4a708d1c-43d9-400d-a30e-49891c1fc39d","Type":"ContainerStarted","Data":"fd6cc5b58b834ed8099c46e4fff55a73b512c1ee55040e9d9dc4c8fc1f7a5b90"} Mar 16 16:40:01 crc kubenswrapper[5120]: I0316 16:40:01.068287 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-765d49ff54-tqw2c" event={"ID":"4a708d1c-43d9-400d-a30e-49891c1fc39d","Type":"ContainerStarted","Data":"e250e191466949db84d88142ed546c60f83649e54cf2f42de0deda2997829841"} Mar 16 16:40:01 crc kubenswrapper[5120]: I0316 16:40:01.074828 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-6647785db4-lmftm" event={"ID":"1518bfb1-3665-455c-84df-7c6eba7b93cf","Type":"ContainerStarted","Data":"a36426906a84d8ea72c76bb969e2d2ccd78889b5a575462d932c61eff0792b6b"} Mar 16 16:40:01 crc kubenswrapper[5120]: I0316 16:40:01.074874 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-6647785db4-lmftm" event={"ID":"1518bfb1-3665-455c-84df-7c6eba7b93cf","Type":"ContainerStarted","Data":"d33f8e22773224907ed12c1e59701d7399b4bdc1d2d9ae0cdce97abf4ee82542"} Mar 16 16:40:01 crc kubenswrapper[5120]: I0316 16:40:01.075109 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-6647785db4-lmftm" Mar 16 16:40:01 crc kubenswrapper[5120]: I0316 16:40:01.075206 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-6647785db4-lmftm" Mar 16 16:40:01 crc kubenswrapper[5120]: I0316 16:40:01.078921 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"1a484747-d317-490a-a502-2c0be9bbcf55","Type":"ContainerDied","Data":"d635bb369248d3b7c9519e5a4c31b338866da15d332f109766d48ba1328c0c09"} Mar 16 16:40:01 crc kubenswrapper[5120]: I0316 16:40:01.078977 5120 scope.go:117] "RemoveContainer" containerID="832a299861e241a080c471f6b6649d2db46b1fbf35b22b4cf0a7dcc57e537d68" Mar 16 16:40:01 crc kubenswrapper[5120]: I0316 16:40:01.079130 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:40:01 crc kubenswrapper[5120]: I0316 16:40:01.090447 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-keystone-listener-765d49ff54-tqw2c" podStartSLOduration=4.09042806 podStartE2EDuration="4.09042806s" podCreationTimestamp="2026-03-16 16:39:57 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:40:01.088747395 +0000 UTC m=+4103.242679062" watchObservedRunningTime="2026-03-16 16:40:01.09042806 +0000 UTC m=+4103.244359707" Mar 16 16:40:01 crc kubenswrapper[5120]: I0316 16:40:01.091663 5120 generic.go:358] "Generic (PLEG): container finished" podID="745bf98f-c08e-46c9-a315-18ee1ff7ca20" containerID="ab2aac04dcebfe12e4c30a3b88a8433a48f2665d7865b4724dcb80b22c847fab" exitCode=0 Mar 16 16:40:01 crc kubenswrapper[5120]: I0316 16:40:01.091796 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-jpgn5" event={"ID":"745bf98f-c08e-46c9-a315-18ee1ff7ca20","Type":"ContainerDied","Data":"ab2aac04dcebfe12e4c30a3b88a8433a48f2665d7865b4724dcb80b22c847fab"} Mar 16 16:40:01 crc kubenswrapper[5120]: I0316 16:40:01.102856 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"43ae87ab-7a99-41df-b39a-930c7a5a232d","Type":"ContainerStarted","Data":"aea72b20d7604693db290e5cec4502522c62eca44b8a7c5fe71adb8801efb0c6"} Mar 16 16:40:01 crc kubenswrapper[5120]: I0316 16:40:01.110619 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"da8c9ee6-9520-4597-a4cb-d06ea1d0772c","Type":"ContainerStarted","Data":"82b1f6a8defd07de43914b235b6db4ae0a71147bc4dde5120a143ef84c89d97b"} Mar 16 16:40:01 crc kubenswrapper[5120]: I0316 16:40:01.155163 5120 generic.go:358] "Generic (PLEG): container finished" podID="84416c7c-79e8-4adb-803f-39ac90a5d695" containerID="d1df920df6411dbd85fe8c77a5ec77498fb1f6bc2070a950c7f9164b76f3ed2f" exitCode=143 Mar 16 16:40:01 crc kubenswrapper[5120]: I0316 16:40:01.156207 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-584b4f85f9-ttk4d" event={"ID":"84416c7c-79e8-4adb-803f-39ac90a5d695","Type":"ContainerDied","Data":"d1df920df6411dbd85fe8c77a5ec77498fb1f6bc2070a950c7f9164b76f3ed2f"} Mar 16 16:40:01 crc kubenswrapper[5120]: I0316 16:40:01.156399 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="41971ebe-e2c3-4815-97c5-011ff54825b7" containerName="cinder-scheduler" containerID="cri-o://4aebcca63f9230179437a529e538e201de4a66f03150428a0ea3f54787a28284" gracePeriod=30 Mar 16 16:40:01 crc kubenswrapper[5120]: I0316 16:40:01.156754 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="41971ebe-e2c3-4815-97c5-011ff54825b7" containerName="probe" containerID="cri-o://4e67e989637bb99ce5515061a489eda8b16c3352162f462f48c338278482e963" gracePeriod=30 Mar 16 16:40:01 crc kubenswrapper[5120]: I0316 16:40:01.181127 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-5b488dd8b-2htz9"] Mar 16 16:40:01 crc kubenswrapper[5120]: I0316 16:40:01.181685 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-api-6647785db4-lmftm" podStartSLOduration=4.181666716 podStartE2EDuration="4.181666716s" podCreationTimestamp="2026-03-16 16:39:57 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:40:01.111322557 +0000 UTC m=+4103.265254234" watchObservedRunningTime="2026-03-16 16:40:01.181666716 +0000 UTC m=+4103.335598373" Mar 16 16:40:01 crc kubenswrapper[5120]: I0316 16:40:01.185457 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-5b488dd8b-2htz9" podUID="fafcfc0e-412f-4c5b-bba6-87910b9f4282" containerName="barbican-keystone-listener-log" containerID="cri-o://950599d20a2d4d472cf2109d9f0d4952f2ac71820ee216fe18daabc06cff10e2" gracePeriod=30 Mar 16 16:40:01 crc kubenswrapper[5120]: I0316 16:40:01.186086 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-5b488dd8b-2htz9" podUID="fafcfc0e-412f-4c5b-bba6-87910b9f4282" containerName="barbican-keystone-listener" containerID="cri-o://2425e735f31a188999c501c7955b02da9ba373d89435ae78fca0f0d98ec36d4e" gracePeriod=30 Mar 16 16:40:01 crc kubenswrapper[5120]: I0316 16:40:01.228501 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:40:01 crc kubenswrapper[5120]: I0316 16:40:01.257437 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:40:01 crc kubenswrapper[5120]: I0316 16:40:01.259144 5120 scope.go:117] "RemoveContainer" containerID="4ebc0070cc17ebb78966102b1793a77f503873a5fb66aa631672b9d947d4cea4" Mar 16 16:40:01 crc kubenswrapper[5120]: I0316 16:40:01.282563 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:40:01 crc kubenswrapper[5120]: I0316 16:40:01.295748 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:40:01 crc kubenswrapper[5120]: I0316 16:40:01.298819 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-internal-config-data\"" Mar 16 16:40:01 crc kubenswrapper[5120]: I0316 16:40:01.307512 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-internal-svc\"" Mar 16 16:40:01 crc kubenswrapper[5120]: I0316 16:40:01.322480 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:40:01 crc kubenswrapper[5120]: I0316 16:40:01.346051 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561320-krs6p"] Mar 16 16:40:01 crc kubenswrapper[5120]: W0316 16:40:01.390120 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod923b199c_e73a_49ce_b4b7_cf219cc0fc76.slice/crio-8bdb324cf8511218e439df160dd97cbc2d5fd688d33096a57f3b0f3d008170bf WatchSource:0}: Error finding container 8bdb324cf8511218e439df160dd97cbc2d5fd688d33096a57f3b0f3d008170bf: Status 404 returned error can't find the container with id 8bdb324cf8511218e439df160dd97cbc2d5fd688d33096a57f3b0f3d008170bf Mar 16 16:40:01 crc kubenswrapper[5120]: I0316 16:40:01.472183 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f4685058-90ec-421d-b95e-ca68dc1d4dcd-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"f4685058-90ec-421d-b95e-ca68dc1d4dcd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:40:01 crc kubenswrapper[5120]: I0316 16:40:01.472513 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlnzz\" (UniqueName: \"kubernetes.io/projected/f4685058-90ec-421d-b95e-ca68dc1d4dcd-kube-api-access-jlnzz\") pod \"glance-default-internal-api-0\" (UID: \"f4685058-90ec-421d-b95e-ca68dc1d4dcd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:40:01 crc kubenswrapper[5120]: I0316 16:40:01.472579 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f4685058-90ec-421d-b95e-ca68dc1d4dcd-scripts\") pod \"glance-default-internal-api-0\" (UID: \"f4685058-90ec-421d-b95e-ca68dc1d4dcd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:40:01 crc kubenswrapper[5120]: I0316 16:40:01.472640 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f4685058-90ec-421d-b95e-ca68dc1d4dcd-logs\") pod \"glance-default-internal-api-0\" (UID: \"f4685058-90ec-421d-b95e-ca68dc1d4dcd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:40:01 crc kubenswrapper[5120]: I0316 16:40:01.472668 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f4685058-90ec-421d-b95e-ca68dc1d4dcd-config-data\") pod \"glance-default-internal-api-0\" (UID: \"f4685058-90ec-421d-b95e-ca68dc1d4dcd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:40:01 crc kubenswrapper[5120]: I0316 16:40:01.472736 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/f4685058-90ec-421d-b95e-ca68dc1d4dcd-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"f4685058-90ec-421d-b95e-ca68dc1d4dcd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:40:01 crc kubenswrapper[5120]: I0316 16:40:01.472830 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f4685058-90ec-421d-b95e-ca68dc1d4dcd-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"f4685058-90ec-421d-b95e-ca68dc1d4dcd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:40:01 crc kubenswrapper[5120]: I0316 16:40:01.472935 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"glance-default-internal-api-0\" (UID: \"f4685058-90ec-421d-b95e-ca68dc1d4dcd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:40:01 crc kubenswrapper[5120]: I0316 16:40:01.575623 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f4685058-90ec-421d-b95e-ca68dc1d4dcd-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"f4685058-90ec-421d-b95e-ca68dc1d4dcd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:40:01 crc kubenswrapper[5120]: I0316 16:40:01.575689 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jlnzz\" (UniqueName: \"kubernetes.io/projected/f4685058-90ec-421d-b95e-ca68dc1d4dcd-kube-api-access-jlnzz\") pod \"glance-default-internal-api-0\" (UID: \"f4685058-90ec-421d-b95e-ca68dc1d4dcd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:40:01 crc kubenswrapper[5120]: I0316 16:40:01.575783 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f4685058-90ec-421d-b95e-ca68dc1d4dcd-scripts\") pod \"glance-default-internal-api-0\" (UID: \"f4685058-90ec-421d-b95e-ca68dc1d4dcd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:40:01 crc kubenswrapper[5120]: I0316 16:40:01.575882 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f4685058-90ec-421d-b95e-ca68dc1d4dcd-logs\") pod \"glance-default-internal-api-0\" (UID: \"f4685058-90ec-421d-b95e-ca68dc1d4dcd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:40:01 crc kubenswrapper[5120]: I0316 16:40:01.575934 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f4685058-90ec-421d-b95e-ca68dc1d4dcd-config-data\") pod \"glance-default-internal-api-0\" (UID: \"f4685058-90ec-421d-b95e-ca68dc1d4dcd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:40:01 crc kubenswrapper[5120]: I0316 16:40:01.576011 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/f4685058-90ec-421d-b95e-ca68dc1d4dcd-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"f4685058-90ec-421d-b95e-ca68dc1d4dcd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:40:01 crc kubenswrapper[5120]: I0316 16:40:01.576104 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f4685058-90ec-421d-b95e-ca68dc1d4dcd-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"f4685058-90ec-421d-b95e-ca68dc1d4dcd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:40:01 crc kubenswrapper[5120]: I0316 16:40:01.576183 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"glance-default-internal-api-0\" (UID: \"f4685058-90ec-421d-b95e-ca68dc1d4dcd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:40:01 crc kubenswrapper[5120]: I0316 16:40:01.576641 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"glance-default-internal-api-0\" (UID: \"f4685058-90ec-421d-b95e-ca68dc1d4dcd\") device mount path \"/mnt/openstack/pv06\"" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:40:01 crc kubenswrapper[5120]: I0316 16:40:01.576873 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f4685058-90ec-421d-b95e-ca68dc1d4dcd-logs\") pod \"glance-default-internal-api-0\" (UID: \"f4685058-90ec-421d-b95e-ca68dc1d4dcd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:40:01 crc kubenswrapper[5120]: I0316 16:40:01.578483 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/f4685058-90ec-421d-b95e-ca68dc1d4dcd-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"f4685058-90ec-421d-b95e-ca68dc1d4dcd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:40:01 crc kubenswrapper[5120]: I0316 16:40:01.581339 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f4685058-90ec-421d-b95e-ca68dc1d4dcd-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"f4685058-90ec-421d-b95e-ca68dc1d4dcd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:40:01 crc kubenswrapper[5120]: I0316 16:40:01.582042 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f4685058-90ec-421d-b95e-ca68dc1d4dcd-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"f4685058-90ec-421d-b95e-ca68dc1d4dcd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:40:01 crc kubenswrapper[5120]: I0316 16:40:01.582393 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f4685058-90ec-421d-b95e-ca68dc1d4dcd-config-data\") pod \"glance-default-internal-api-0\" (UID: \"f4685058-90ec-421d-b95e-ca68dc1d4dcd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:40:01 crc kubenswrapper[5120]: I0316 16:40:01.590579 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f4685058-90ec-421d-b95e-ca68dc1d4dcd-scripts\") pod \"glance-default-internal-api-0\" (UID: \"f4685058-90ec-421d-b95e-ca68dc1d4dcd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:40:01 crc kubenswrapper[5120]: I0316 16:40:01.598538 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlnzz\" (UniqueName: \"kubernetes.io/projected/f4685058-90ec-421d-b95e-ca68dc1d4dcd-kube-api-access-jlnzz\") pod \"glance-default-internal-api-0\" (UID: \"f4685058-90ec-421d-b95e-ca68dc1d4dcd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:40:01 crc kubenswrapper[5120]: I0316 16:40:01.604381 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"glance-default-internal-api-0\" (UID: \"f4685058-90ec-421d-b95e-ca68dc1d4dcd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:40:01 crc kubenswrapper[5120]: I0316 16:40:01.622677 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:40:02 crc kubenswrapper[5120]: I0316 16:40:02.117154 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:40:02 crc kubenswrapper[5120]: W0316 16:40:02.132207 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf4685058_90ec_421d_b95e_ca68dc1d4dcd.slice/crio-f56303067383114ae9da630eca7e6676094b124662cfce47fa78b0420a2102eb WatchSource:0}: Error finding container f56303067383114ae9da630eca7e6676094b124662cfce47fa78b0420a2102eb: Status 404 returned error can't find the container with id f56303067383114ae9da630eca7e6676094b124662cfce47fa78b0420a2102eb Mar 16 16:40:02 crc kubenswrapper[5120]: I0316 16:40:02.171687 5120 generic.go:358] "Generic (PLEG): container finished" podID="fafcfc0e-412f-4c5b-bba6-87910b9f4282" containerID="950599d20a2d4d472cf2109d9f0d4952f2ac71820ee216fe18daabc06cff10e2" exitCode=143 Mar 16 16:40:02 crc kubenswrapper[5120]: I0316 16:40:02.172038 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-5b488dd8b-2htz9" event={"ID":"fafcfc0e-412f-4c5b-bba6-87910b9f4282","Type":"ContainerDied","Data":"950599d20a2d4d472cf2109d9f0d4952f2ac71820ee216fe18daabc06cff10e2"} Mar 16 16:40:02 crc kubenswrapper[5120]: I0316 16:40:02.179483 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"f4685058-90ec-421d-b95e-ca68dc1d4dcd","Type":"ContainerStarted","Data":"f56303067383114ae9da630eca7e6676094b124662cfce47fa78b0420a2102eb"} Mar 16 16:40:02 crc kubenswrapper[5120]: I0316 16:40:02.188936 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561320-krs6p" event={"ID":"923b199c-e73a-49ce-b4b7-cf219cc0fc76","Type":"ContainerStarted","Data":"8bdb324cf8511218e439df160dd97cbc2d5fd688d33096a57f3b0f3d008170bf"} Mar 16 16:40:02 crc kubenswrapper[5120]: I0316 16:40:02.192377 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"43ae87ab-7a99-41df-b39a-930c7a5a232d","Type":"ContainerStarted","Data":"d0c6819deb917d9e91985bf1d131648bddd7748dcdbdf7c7ca71e50fc7381c7c"} Mar 16 16:40:02 crc kubenswrapper[5120]: I0316 16:40:02.197698 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e","Type":"ContainerStarted","Data":"66f3f06a9c5991c76392f548443ba31ee8e82819f11e5f67929aa6ee25bd68c6"} Mar 16 16:40:02 crc kubenswrapper[5120]: I0316 16:40:02.202286 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"da8c9ee6-9520-4597-a4cb-d06ea1d0772c","Type":"ContainerStarted","Data":"b4b4cc9a667d73f04554e4fc969d14f8329c6ff61c1a4e019385ab1dcb69a8be"} Mar 16 16:40:02 crc kubenswrapper[5120]: I0316 16:40:02.212828 5120 generic.go:358] "Generic (PLEG): container finished" podID="41971ebe-e2c3-4815-97c5-011ff54825b7" containerID="4e67e989637bb99ce5515061a489eda8b16c3352162f462f48c338278482e963" exitCode=0 Mar 16 16:40:02 crc kubenswrapper[5120]: I0316 16:40:02.212875 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"41971ebe-e2c3-4815-97c5-011ff54825b7","Type":"ContainerDied","Data":"4e67e989637bb99ce5515061a489eda8b16c3352162f462f48c338278482e963"} Mar 16 16:40:02 crc kubenswrapper[5120]: I0316 16:40:02.556487 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-599744884-vf6rr" podUID="e0ca2d31-e27b-42b5-8801-469ad47142a5" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.1.50:9311/healthcheck\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 16:40:02 crc kubenswrapper[5120]: I0316 16:40:02.556662 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-599744884-vf6rr" podUID="e0ca2d31-e27b-42b5-8801-469ad47142a5" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.1.50:9311/healthcheck\": context deadline exceeded" Mar 16 16:40:02 crc kubenswrapper[5120]: I0316 16:40:02.681953 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1a484747-d317-490a-a502-2c0be9bbcf55" path="/var/lib/kubelet/pods/1a484747-d317-490a-a502-2c0be9bbcf55/volumes" Mar 16 16:40:02 crc kubenswrapper[5120]: I0316 16:40:02.747253 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-jpgn5" Mar 16 16:40:02 crc kubenswrapper[5120]: I0316 16:40:02.911898 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z9pmz\" (UniqueName: \"kubernetes.io/projected/745bf98f-c08e-46c9-a315-18ee1ff7ca20-kube-api-access-z9pmz\") pod \"745bf98f-c08e-46c9-a315-18ee1ff7ca20\" (UID: \"745bf98f-c08e-46c9-a315-18ee1ff7ca20\") " Mar 16 16:40:02 crc kubenswrapper[5120]: I0316 16:40:02.912564 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/745bf98f-c08e-46c9-a315-18ee1ff7ca20-combined-ca-bundle\") pod \"745bf98f-c08e-46c9-a315-18ee1ff7ca20\" (UID: \"745bf98f-c08e-46c9-a315-18ee1ff7ca20\") " Mar 16 16:40:02 crc kubenswrapper[5120]: I0316 16:40:02.912632 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/745bf98f-c08e-46c9-a315-18ee1ff7ca20-config\") pod \"745bf98f-c08e-46c9-a315-18ee1ff7ca20\" (UID: \"745bf98f-c08e-46c9-a315-18ee1ff7ca20\") " Mar 16 16:40:02 crc kubenswrapper[5120]: I0316 16:40:02.925930 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/745bf98f-c08e-46c9-a315-18ee1ff7ca20-kube-api-access-z9pmz" (OuterVolumeSpecName: "kube-api-access-z9pmz") pod "745bf98f-c08e-46c9-a315-18ee1ff7ca20" (UID: "745bf98f-c08e-46c9-a315-18ee1ff7ca20"). InnerVolumeSpecName "kube-api-access-z9pmz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:40:02 crc kubenswrapper[5120]: I0316 16:40:02.954233 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/745bf98f-c08e-46c9-a315-18ee1ff7ca20-config" (OuterVolumeSpecName: "config") pod "745bf98f-c08e-46c9-a315-18ee1ff7ca20" (UID: "745bf98f-c08e-46c9-a315-18ee1ff7ca20"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:40:02 crc kubenswrapper[5120]: I0316 16:40:02.973339 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-599744884-vf6rr" podUID="e0ca2d31-e27b-42b5-8801-469ad47142a5" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.1.50:9311/healthcheck\": read tcp 10.217.0.2:52416->10.217.1.50:9311: read: connection reset by peer" Mar 16 16:40:02 crc kubenswrapper[5120]: I0316 16:40:02.973407 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-599744884-vf6rr" podUID="e0ca2d31-e27b-42b5-8801-469ad47142a5" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.1.50:9311/healthcheck\": read tcp 10.217.0.2:52408->10.217.1.50:9311: read: connection reset by peer" Mar 16 16:40:02 crc kubenswrapper[5120]: I0316 16:40:02.973992 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/745bf98f-c08e-46c9-a315-18ee1ff7ca20-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "745bf98f-c08e-46c9-a315-18ee1ff7ca20" (UID: "745bf98f-c08e-46c9-a315-18ee1ff7ca20"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:40:03 crc kubenswrapper[5120]: I0316 16:40:03.015392 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/745bf98f-c08e-46c9-a315-18ee1ff7ca20-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:40:03 crc kubenswrapper[5120]: I0316 16:40:03.015419 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/745bf98f-c08e-46c9-a315-18ee1ff7ca20-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:40:03 crc kubenswrapper[5120]: I0316 16:40:03.015429 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z9pmz\" (UniqueName: \"kubernetes.io/projected/745bf98f-c08e-46c9-a315-18ee1ff7ca20-kube-api-access-z9pmz\") on node \"crc\" DevicePath \"\"" Mar 16 16:40:03 crc kubenswrapper[5120]: I0316 16:40:03.083429 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-584b4f85f9-ttk4d" Mar 16 16:40:03 crc kubenswrapper[5120]: I0316 16:40:03.219646 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/84416c7c-79e8-4adb-803f-39ac90a5d695-config-data-custom\") pod \"84416c7c-79e8-4adb-803f-39ac90a5d695\" (UID: \"84416c7c-79e8-4adb-803f-39ac90a5d695\") " Mar 16 16:40:03 crc kubenswrapper[5120]: I0316 16:40:03.220201 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/84416c7c-79e8-4adb-803f-39ac90a5d695-logs\") pod \"84416c7c-79e8-4adb-803f-39ac90a5d695\" (UID: \"84416c7c-79e8-4adb-803f-39ac90a5d695\") " Mar 16 16:40:03 crc kubenswrapper[5120]: I0316 16:40:03.220317 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/84416c7c-79e8-4adb-803f-39ac90a5d695-combined-ca-bundle\") pod \"84416c7c-79e8-4adb-803f-39ac90a5d695\" (UID: \"84416c7c-79e8-4adb-803f-39ac90a5d695\") " Mar 16 16:40:03 crc kubenswrapper[5120]: I0316 16:40:03.220352 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/84416c7c-79e8-4adb-803f-39ac90a5d695-config-data\") pod \"84416c7c-79e8-4adb-803f-39ac90a5d695\" (UID: \"84416c7c-79e8-4adb-803f-39ac90a5d695\") " Mar 16 16:40:03 crc kubenswrapper[5120]: I0316 16:40:03.220394 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-456rg\" (UniqueName: \"kubernetes.io/projected/84416c7c-79e8-4adb-803f-39ac90a5d695-kube-api-access-456rg\") pod \"84416c7c-79e8-4adb-803f-39ac90a5d695\" (UID: \"84416c7c-79e8-4adb-803f-39ac90a5d695\") " Mar 16 16:40:03 crc kubenswrapper[5120]: I0316 16:40:03.220802 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84416c7c-79e8-4adb-803f-39ac90a5d695-logs" (OuterVolumeSpecName: "logs") pod "84416c7c-79e8-4adb-803f-39ac90a5d695" (UID: "84416c7c-79e8-4adb-803f-39ac90a5d695"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:40:03 crc kubenswrapper[5120]: I0316 16:40:03.223441 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/84416c7c-79e8-4adb-803f-39ac90a5d695-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:40:03 crc kubenswrapper[5120]: I0316 16:40:03.224944 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/84416c7c-79e8-4adb-803f-39ac90a5d695-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "84416c7c-79e8-4adb-803f-39ac90a5d695" (UID: "84416c7c-79e8-4adb-803f-39ac90a5d695"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:40:03 crc kubenswrapper[5120]: I0316 16:40:03.231357 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84416c7c-79e8-4adb-803f-39ac90a5d695-kube-api-access-456rg" (OuterVolumeSpecName: "kube-api-access-456rg") pod "84416c7c-79e8-4adb-803f-39ac90a5d695" (UID: "84416c7c-79e8-4adb-803f-39ac90a5d695"). InnerVolumeSpecName "kube-api-access-456rg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:40:03 crc kubenswrapper[5120]: I0316 16:40:03.250577 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/84416c7c-79e8-4adb-803f-39ac90a5d695-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "84416c7c-79e8-4adb-803f-39ac90a5d695" (UID: "84416c7c-79e8-4adb-803f-39ac90a5d695"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:40:03 crc kubenswrapper[5120]: I0316 16:40:03.256103 5120 generic.go:358] "Generic (PLEG): container finished" podID="e0ca2d31-e27b-42b5-8801-469ad47142a5" containerID="31e5df1a5b7f2d0c1b5204f81e9f04d53b8362b2e8378a6ef768b2867ed3ef1c" exitCode=0 Mar 16 16:40:03 crc kubenswrapper[5120]: I0316 16:40:03.256190 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-599744884-vf6rr" event={"ID":"e0ca2d31-e27b-42b5-8801-469ad47142a5","Type":"ContainerDied","Data":"31e5df1a5b7f2d0c1b5204f81e9f04d53b8362b2e8378a6ef768b2867ed3ef1c"} Mar 16 16:40:03 crc kubenswrapper[5120]: I0316 16:40:03.259274 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"f4685058-90ec-421d-b95e-ca68dc1d4dcd","Type":"ContainerStarted","Data":"3ae6cb990e461484ce43a5123f5b9883d35e8186a0e537eaaee70bc093a3f8b2"} Mar 16 16:40:03 crc kubenswrapper[5120]: I0316 16:40:03.265001 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-jpgn5" Mar 16 16:40:03 crc kubenswrapper[5120]: I0316 16:40:03.265062 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-jpgn5" event={"ID":"745bf98f-c08e-46c9-a315-18ee1ff7ca20","Type":"ContainerDied","Data":"e92b1b0f9d39daae42bdef9ff0687764a137d91135096df2cb2ad174c34b2b95"} Mar 16 16:40:03 crc kubenswrapper[5120]: I0316 16:40:03.265091 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e92b1b0f9d39daae42bdef9ff0687764a137d91135096df2cb2ad174c34b2b95" Mar 16 16:40:03 crc kubenswrapper[5120]: I0316 16:40:03.273611 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"43ae87ab-7a99-41df-b39a-930c7a5a232d","Type":"ContainerStarted","Data":"50956264ae2e609fe5c7b13617c8592d52746a64d7f4828722e5fd9abf9f90ff"} Mar 16 16:40:03 crc kubenswrapper[5120]: I0316 16:40:03.278884 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e","Type":"ContainerStarted","Data":"261821a3adde73a3dc23cb22faac9f49d193b2649fe06010aa01954b846e70d4"} Mar 16 16:40:03 crc kubenswrapper[5120]: I0316 16:40:03.279206 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:40:03 crc kubenswrapper[5120]: I0316 16:40:03.281353 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"da8c9ee6-9520-4597-a4cb-d06ea1d0772c","Type":"ContainerStarted","Data":"38d72b73341317e1cd4e4a5501014a3bd1db89eb530efd6c0e87d6c1a90cb693"} Mar 16 16:40:03 crc kubenswrapper[5120]: I0316 16:40:03.284193 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-infra/auto-csr-approver-29561320-krs6p" podStartSLOduration=2.081343004 podStartE2EDuration="3.28417592s" podCreationTimestamp="2026-03-16 16:40:00 +0000 UTC" firstStartedPulling="2026-03-16 16:40:01.403196378 +0000 UTC m=+4103.557128035" lastFinishedPulling="2026-03-16 16:40:02.606029294 +0000 UTC m=+4104.759960951" observedRunningTime="2026-03-16 16:40:03.276621374 +0000 UTC m=+4105.430553031" watchObservedRunningTime="2026-03-16 16:40:03.28417592 +0000 UTC m=+4105.438107577" Mar 16 16:40:03 crc kubenswrapper[5120]: I0316 16:40:03.287105 5120 generic.go:358] "Generic (PLEG): container finished" podID="84416c7c-79e8-4adb-803f-39ac90a5d695" containerID="321e2cd5e6d548a888ac8f869db76f129d02473220b6c36160a9ee61376a500f" exitCode=0 Mar 16 16:40:03 crc kubenswrapper[5120]: I0316 16:40:03.287287 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-584b4f85f9-ttk4d" Mar 16 16:40:03 crc kubenswrapper[5120]: I0316 16:40:03.287289 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-584b4f85f9-ttk4d" event={"ID":"84416c7c-79e8-4adb-803f-39ac90a5d695","Type":"ContainerDied","Data":"321e2cd5e6d548a888ac8f869db76f129d02473220b6c36160a9ee61376a500f"} Mar 16 16:40:03 crc kubenswrapper[5120]: I0316 16:40:03.287471 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-584b4f85f9-ttk4d" event={"ID":"84416c7c-79e8-4adb-803f-39ac90a5d695","Type":"ContainerDied","Data":"8a25d748bdd930aef3122c056dd4b8cbcb25007cfb3a908a5dcf4cf9ef5c827e"} Mar 16 16:40:03 crc kubenswrapper[5120]: I0316 16:40:03.287526 5120 scope.go:117] "RemoveContainer" containerID="321e2cd5e6d548a888ac8f869db76f129d02473220b6c36160a9ee61376a500f" Mar 16 16:40:03 crc kubenswrapper[5120]: I0316 16:40:03.327142 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/84416c7c-79e8-4adb-803f-39ac90a5d695-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:40:03 crc kubenswrapper[5120]: I0316 16:40:03.327170 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/84416c7c-79e8-4adb-803f-39ac90a5d695-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:40:03 crc kubenswrapper[5120]: I0316 16:40:03.327179 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-456rg\" (UniqueName: \"kubernetes.io/projected/84416c7c-79e8-4adb-803f-39ac90a5d695-kube-api-access-456rg\") on node \"crc\" DevicePath \"\"" Mar 16 16:40:03 crc kubenswrapper[5120]: I0316 16:40:03.362217 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-external-api-0" podStartSLOduration=4.362194236 podStartE2EDuration="4.362194236s" podCreationTimestamp="2026-03-16 16:39:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:40:03.295133337 +0000 UTC m=+4105.449064984" watchObservedRunningTime="2026-03-16 16:40:03.362194236 +0000 UTC m=+4105.516125903" Mar 16 16:40:03 crc kubenswrapper[5120]: I0316 16:40:03.401949 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/84416c7c-79e8-4adb-803f-39ac90a5d695-config-data" (OuterVolumeSpecName: "config-data") pod "84416c7c-79e8-4adb-803f-39ac90a5d695" (UID: "84416c7c-79e8-4adb-803f-39ac90a5d695"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:40:03 crc kubenswrapper[5120]: I0316 16:40:03.410712 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-api-0" podStartSLOduration=6.410687043 podStartE2EDuration="6.410687043s" podCreationTimestamp="2026-03-16 16:39:57 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:40:03.366834413 +0000 UTC m=+4105.520766070" watchObservedRunningTime="2026-03-16 16:40:03.410687043 +0000 UTC m=+4105.564618700" Mar 16 16:40:03 crc kubenswrapper[5120]: I0316 16:40:03.435291 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/84416c7c-79e8-4adb-803f-39ac90a5d695-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:40:03 crc kubenswrapper[5120]: I0316 16:40:03.487434 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-59869bff69-qcf89"] Mar 16 16:40:03 crc kubenswrapper[5120]: I0316 16:40:03.488673 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84416c7c-79e8-4adb-803f-39ac90a5d695" containerName="barbican-worker" Mar 16 16:40:03 crc kubenswrapper[5120]: I0316 16:40:03.488693 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="84416c7c-79e8-4adb-803f-39ac90a5d695" containerName="barbican-worker" Mar 16 16:40:03 crc kubenswrapper[5120]: I0316 16:40:03.488726 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="745bf98f-c08e-46c9-a315-18ee1ff7ca20" containerName="neutron-db-sync" Mar 16 16:40:03 crc kubenswrapper[5120]: I0316 16:40:03.488733 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="745bf98f-c08e-46c9-a315-18ee1ff7ca20" containerName="neutron-db-sync" Mar 16 16:40:03 crc kubenswrapper[5120]: I0316 16:40:03.488746 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84416c7c-79e8-4adb-803f-39ac90a5d695" containerName="barbican-worker-log" Mar 16 16:40:03 crc kubenswrapper[5120]: I0316 16:40:03.488772 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="84416c7c-79e8-4adb-803f-39ac90a5d695" containerName="barbican-worker-log" Mar 16 16:40:03 crc kubenswrapper[5120]: I0316 16:40:03.488989 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="84416c7c-79e8-4adb-803f-39ac90a5d695" containerName="barbican-worker-log" Mar 16 16:40:03 crc kubenswrapper[5120]: I0316 16:40:03.489006 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="84416c7c-79e8-4adb-803f-39ac90a5d695" containerName="barbican-worker" Mar 16 16:40:03 crc kubenswrapper[5120]: I0316 16:40:03.489015 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="745bf98f-c08e-46c9-a315-18ee1ff7ca20" containerName="neutron-db-sync" Mar 16 16:40:03 crc kubenswrapper[5120]: I0316 16:40:03.490667 5120 scope.go:117] "RemoveContainer" containerID="d1df920df6411dbd85fe8c77a5ec77498fb1f6bc2070a950c7f9164b76f3ed2f" Mar 16 16:40:03 crc kubenswrapper[5120]: I0316 16:40:03.607128 5120 scope.go:117] "RemoveContainer" containerID="321e2cd5e6d548a888ac8f869db76f129d02473220b6c36160a9ee61376a500f" Mar 16 16:40:03 crc kubenswrapper[5120]: I0316 16:40:03.622255 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-59869bff69-qcf89"] Mar 16 16:40:03 crc kubenswrapper[5120]: I0316 16:40:03.622413 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-59869bff69-qcf89" Mar 16 16:40:03 crc kubenswrapper[5120]: E0316 16:40:03.623827 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"321e2cd5e6d548a888ac8f869db76f129d02473220b6c36160a9ee61376a500f\": container with ID starting with 321e2cd5e6d548a888ac8f869db76f129d02473220b6c36160a9ee61376a500f not found: ID does not exist" containerID="321e2cd5e6d548a888ac8f869db76f129d02473220b6c36160a9ee61376a500f" Mar 16 16:40:03 crc kubenswrapper[5120]: I0316 16:40:03.623923 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"321e2cd5e6d548a888ac8f869db76f129d02473220b6c36160a9ee61376a500f"} err="failed to get container status \"321e2cd5e6d548a888ac8f869db76f129d02473220b6c36160a9ee61376a500f\": rpc error: code = NotFound desc = could not find container \"321e2cd5e6d548a888ac8f869db76f129d02473220b6c36160a9ee61376a500f\": container with ID starting with 321e2cd5e6d548a888ac8f869db76f129d02473220b6c36160a9ee61376a500f not found: ID does not exist" Mar 16 16:40:03 crc kubenswrapper[5120]: I0316 16:40:03.623959 5120 scope.go:117] "RemoveContainer" containerID="d1df920df6411dbd85fe8c77a5ec77498fb1f6bc2070a950c7f9164b76f3ed2f" Mar 16 16:40:03 crc kubenswrapper[5120]: E0316 16:40:03.626966 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d1df920df6411dbd85fe8c77a5ec77498fb1f6bc2070a950c7f9164b76f3ed2f\": container with ID starting with d1df920df6411dbd85fe8c77a5ec77498fb1f6bc2070a950c7f9164b76f3ed2f not found: ID does not exist" containerID="d1df920df6411dbd85fe8c77a5ec77498fb1f6bc2070a950c7f9164b76f3ed2f" Mar 16 16:40:03 crc kubenswrapper[5120]: I0316 16:40:03.627012 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1df920df6411dbd85fe8c77a5ec77498fb1f6bc2070a950c7f9164b76f3ed2f"} err="failed to get container status \"d1df920df6411dbd85fe8c77a5ec77498fb1f6bc2070a950c7f9164b76f3ed2f\": rpc error: code = NotFound desc = could not find container \"d1df920df6411dbd85fe8c77a5ec77498fb1f6bc2070a950c7f9164b76f3ed2f\": container with ID starting with d1df920df6411dbd85fe8c77a5ec77498fb1f6bc2070a950c7f9164b76f3ed2f not found: ID does not exist" Mar 16 16:40:03 crc kubenswrapper[5120]: I0316 16:40:03.627319 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-neutron-ovndbs\"" Mar 16 16:40:03 crc kubenswrapper[5120]: I0316 16:40:03.627491 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-neutron-dockercfg-9xldd\"" Mar 16 16:40:03 crc kubenswrapper[5120]: I0316 16:40:03.627622 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-config\"" Mar 16 16:40:03 crc kubenswrapper[5120]: I0316 16:40:03.627857 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-httpd-config\"" Mar 16 16:40:03 crc kubenswrapper[5120]: I0316 16:40:03.692827 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-599744884-vf6rr" Mar 16 16:40:03 crc kubenswrapper[5120]: I0316 16:40:03.701713 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-584b4f85f9-ttk4d"] Mar 16 16:40:03 crc kubenswrapper[5120]: I0316 16:40:03.737844 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-worker-584b4f85f9-ttk4d"] Mar 16 16:40:03 crc kubenswrapper[5120]: I0316 16:40:03.754335 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98cdm\" (UniqueName: \"kubernetes.io/projected/3b25da8f-df4b-4367-884e-abd3b1d6527e-kube-api-access-98cdm\") pod \"neutron-59869bff69-qcf89\" (UID: \"3b25da8f-df4b-4367-884e-abd3b1d6527e\") " pod="openstack-kuttl-tests/neutron-59869bff69-qcf89" Mar 16 16:40:03 crc kubenswrapper[5120]: I0316 16:40:03.754475 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3b25da8f-df4b-4367-884e-abd3b1d6527e-config\") pod \"neutron-59869bff69-qcf89\" (UID: \"3b25da8f-df4b-4367-884e-abd3b1d6527e\") " pod="openstack-kuttl-tests/neutron-59869bff69-qcf89" Mar 16 16:40:03 crc kubenswrapper[5120]: I0316 16:40:03.754609 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/3b25da8f-df4b-4367-884e-abd3b1d6527e-ovndb-tls-certs\") pod \"neutron-59869bff69-qcf89\" (UID: \"3b25da8f-df4b-4367-884e-abd3b1d6527e\") " pod="openstack-kuttl-tests/neutron-59869bff69-qcf89" Mar 16 16:40:03 crc kubenswrapper[5120]: I0316 16:40:03.754879 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/3b25da8f-df4b-4367-884e-abd3b1d6527e-httpd-config\") pod \"neutron-59869bff69-qcf89\" (UID: \"3b25da8f-df4b-4367-884e-abd3b1d6527e\") " pod="openstack-kuttl-tests/neutron-59869bff69-qcf89" Mar 16 16:40:03 crc kubenswrapper[5120]: I0316 16:40:03.755048 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3b25da8f-df4b-4367-884e-abd3b1d6527e-combined-ca-bundle\") pod \"neutron-59869bff69-qcf89\" (UID: \"3b25da8f-df4b-4367-884e-abd3b1d6527e\") " pod="openstack-kuttl-tests/neutron-59869bff69-qcf89" Mar 16 16:40:03 crc kubenswrapper[5120]: I0316 16:40:03.856682 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/e0ca2d31-e27b-42b5-8801-469ad47142a5-config-data-custom\") pod \"e0ca2d31-e27b-42b5-8801-469ad47142a5\" (UID: \"e0ca2d31-e27b-42b5-8801-469ad47142a5\") " Mar 16 16:40:03 crc kubenswrapper[5120]: I0316 16:40:03.856871 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e0ca2d31-e27b-42b5-8801-469ad47142a5-config-data\") pod \"e0ca2d31-e27b-42b5-8801-469ad47142a5\" (UID: \"e0ca2d31-e27b-42b5-8801-469ad47142a5\") " Mar 16 16:40:03 crc kubenswrapper[5120]: I0316 16:40:03.856919 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e0ca2d31-e27b-42b5-8801-469ad47142a5-combined-ca-bundle\") pod \"e0ca2d31-e27b-42b5-8801-469ad47142a5\" (UID: \"e0ca2d31-e27b-42b5-8801-469ad47142a5\") " Mar 16 16:40:03 crc kubenswrapper[5120]: I0316 16:40:03.857097 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e0ca2d31-e27b-42b5-8801-469ad47142a5-logs\") pod \"e0ca2d31-e27b-42b5-8801-469ad47142a5\" (UID: \"e0ca2d31-e27b-42b5-8801-469ad47142a5\") " Mar 16 16:40:03 crc kubenswrapper[5120]: I0316 16:40:03.857143 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e0ca2d31-e27b-42b5-8801-469ad47142a5-public-tls-certs\") pod \"e0ca2d31-e27b-42b5-8801-469ad47142a5\" (UID: \"e0ca2d31-e27b-42b5-8801-469ad47142a5\") " Mar 16 16:40:03 crc kubenswrapper[5120]: I0316 16:40:03.857246 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e0ca2d31-e27b-42b5-8801-469ad47142a5-internal-tls-certs\") pod \"e0ca2d31-e27b-42b5-8801-469ad47142a5\" (UID: \"e0ca2d31-e27b-42b5-8801-469ad47142a5\") " Mar 16 16:40:03 crc kubenswrapper[5120]: I0316 16:40:03.857361 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kwsv2\" (UniqueName: \"kubernetes.io/projected/e0ca2d31-e27b-42b5-8801-469ad47142a5-kube-api-access-kwsv2\") pod \"e0ca2d31-e27b-42b5-8801-469ad47142a5\" (UID: \"e0ca2d31-e27b-42b5-8801-469ad47142a5\") " Mar 16 16:40:03 crc kubenswrapper[5120]: I0316 16:40:03.857632 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0ca2d31-e27b-42b5-8801-469ad47142a5-logs" (OuterVolumeSpecName: "logs") pod "e0ca2d31-e27b-42b5-8801-469ad47142a5" (UID: "e0ca2d31-e27b-42b5-8801-469ad47142a5"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:40:03 crc kubenswrapper[5120]: I0316 16:40:03.857897 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-98cdm\" (UniqueName: \"kubernetes.io/projected/3b25da8f-df4b-4367-884e-abd3b1d6527e-kube-api-access-98cdm\") pod \"neutron-59869bff69-qcf89\" (UID: \"3b25da8f-df4b-4367-884e-abd3b1d6527e\") " pod="openstack-kuttl-tests/neutron-59869bff69-qcf89" Mar 16 16:40:03 crc kubenswrapper[5120]: I0316 16:40:03.858074 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3b25da8f-df4b-4367-884e-abd3b1d6527e-config\") pod \"neutron-59869bff69-qcf89\" (UID: \"3b25da8f-df4b-4367-884e-abd3b1d6527e\") " pod="openstack-kuttl-tests/neutron-59869bff69-qcf89" Mar 16 16:40:03 crc kubenswrapper[5120]: I0316 16:40:03.858152 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/3b25da8f-df4b-4367-884e-abd3b1d6527e-ovndb-tls-certs\") pod \"neutron-59869bff69-qcf89\" (UID: \"3b25da8f-df4b-4367-884e-abd3b1d6527e\") " pod="openstack-kuttl-tests/neutron-59869bff69-qcf89" Mar 16 16:40:03 crc kubenswrapper[5120]: I0316 16:40:03.858358 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/3b25da8f-df4b-4367-884e-abd3b1d6527e-httpd-config\") pod \"neutron-59869bff69-qcf89\" (UID: \"3b25da8f-df4b-4367-884e-abd3b1d6527e\") " pod="openstack-kuttl-tests/neutron-59869bff69-qcf89" Mar 16 16:40:03 crc kubenswrapper[5120]: I0316 16:40:03.858507 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3b25da8f-df4b-4367-884e-abd3b1d6527e-combined-ca-bundle\") pod \"neutron-59869bff69-qcf89\" (UID: \"3b25da8f-df4b-4367-884e-abd3b1d6527e\") " pod="openstack-kuttl-tests/neutron-59869bff69-qcf89" Mar 16 16:40:03 crc kubenswrapper[5120]: I0316 16:40:03.859328 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e0ca2d31-e27b-42b5-8801-469ad47142a5-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:40:03 crc kubenswrapper[5120]: I0316 16:40:03.865974 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0ca2d31-e27b-42b5-8801-469ad47142a5-kube-api-access-kwsv2" (OuterVolumeSpecName: "kube-api-access-kwsv2") pod "e0ca2d31-e27b-42b5-8801-469ad47142a5" (UID: "e0ca2d31-e27b-42b5-8801-469ad47142a5"). InnerVolumeSpecName "kube-api-access-kwsv2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:40:03 crc kubenswrapper[5120]: I0316 16:40:03.865969 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0ca2d31-e27b-42b5-8801-469ad47142a5-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "e0ca2d31-e27b-42b5-8801-469ad47142a5" (UID: "e0ca2d31-e27b-42b5-8801-469ad47142a5"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:40:03 crc kubenswrapper[5120]: I0316 16:40:03.867366 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/3b25da8f-df4b-4367-884e-abd3b1d6527e-config\") pod \"neutron-59869bff69-qcf89\" (UID: \"3b25da8f-df4b-4367-884e-abd3b1d6527e\") " pod="openstack-kuttl-tests/neutron-59869bff69-qcf89" Mar 16 16:40:03 crc kubenswrapper[5120]: I0316 16:40:03.868281 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/3b25da8f-df4b-4367-884e-abd3b1d6527e-httpd-config\") pod \"neutron-59869bff69-qcf89\" (UID: \"3b25da8f-df4b-4367-884e-abd3b1d6527e\") " pod="openstack-kuttl-tests/neutron-59869bff69-qcf89" Mar 16 16:40:03 crc kubenswrapper[5120]: I0316 16:40:03.868620 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3b25da8f-df4b-4367-884e-abd3b1d6527e-combined-ca-bundle\") pod \"neutron-59869bff69-qcf89\" (UID: \"3b25da8f-df4b-4367-884e-abd3b1d6527e\") " pod="openstack-kuttl-tests/neutron-59869bff69-qcf89" Mar 16 16:40:03 crc kubenswrapper[5120]: I0316 16:40:03.884675 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/3b25da8f-df4b-4367-884e-abd3b1d6527e-ovndb-tls-certs\") pod \"neutron-59869bff69-qcf89\" (UID: \"3b25da8f-df4b-4367-884e-abd3b1d6527e\") " pod="openstack-kuttl-tests/neutron-59869bff69-qcf89" Mar 16 16:40:03 crc kubenswrapper[5120]: I0316 16:40:03.886448 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-98cdm\" (UniqueName: \"kubernetes.io/projected/3b25da8f-df4b-4367-884e-abd3b1d6527e-kube-api-access-98cdm\") pod \"neutron-59869bff69-qcf89\" (UID: \"3b25da8f-df4b-4367-884e-abd3b1d6527e\") " pod="openstack-kuttl-tests/neutron-59869bff69-qcf89" Mar 16 16:40:03 crc kubenswrapper[5120]: I0316 16:40:03.900694 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0ca2d31-e27b-42b5-8801-469ad47142a5-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e0ca2d31-e27b-42b5-8801-469ad47142a5" (UID: "e0ca2d31-e27b-42b5-8801-469ad47142a5"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:40:03 crc kubenswrapper[5120]: I0316 16:40:03.958373 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0ca2d31-e27b-42b5-8801-469ad47142a5-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "e0ca2d31-e27b-42b5-8801-469ad47142a5" (UID: "e0ca2d31-e27b-42b5-8801-469ad47142a5"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:40:03 crc kubenswrapper[5120]: I0316 16:40:03.959969 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0ca2d31-e27b-42b5-8801-469ad47142a5-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "e0ca2d31-e27b-42b5-8801-469ad47142a5" (UID: "e0ca2d31-e27b-42b5-8801-469ad47142a5"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:40:03 crc kubenswrapper[5120]: I0316 16:40:03.961127 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e0ca2d31-e27b-42b5-8801-469ad47142a5-internal-tls-certs\") pod \"e0ca2d31-e27b-42b5-8801-469ad47142a5\" (UID: \"e0ca2d31-e27b-42b5-8801-469ad47142a5\") " Mar 16 16:40:03 crc kubenswrapper[5120]: I0316 16:40:03.961635 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kwsv2\" (UniqueName: \"kubernetes.io/projected/e0ca2d31-e27b-42b5-8801-469ad47142a5-kube-api-access-kwsv2\") on node \"crc\" DevicePath \"\"" Mar 16 16:40:03 crc kubenswrapper[5120]: I0316 16:40:03.961654 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/e0ca2d31-e27b-42b5-8801-469ad47142a5-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:40:03 crc kubenswrapper[5120]: I0316 16:40:03.961663 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e0ca2d31-e27b-42b5-8801-469ad47142a5-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:40:03 crc kubenswrapper[5120]: I0316 16:40:03.961671 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e0ca2d31-e27b-42b5-8801-469ad47142a5-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:40:03 crc kubenswrapper[5120]: W0316 16:40:03.961751 5120 empty_dir.go:511] Warning: Unmount skipped because path does not exist: /var/lib/kubelet/pods/e0ca2d31-e27b-42b5-8801-469ad47142a5/volumes/kubernetes.io~secret/internal-tls-certs Mar 16 16:40:03 crc kubenswrapper[5120]: I0316 16:40:03.961769 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0ca2d31-e27b-42b5-8801-469ad47142a5-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "e0ca2d31-e27b-42b5-8801-469ad47142a5" (UID: "e0ca2d31-e27b-42b5-8801-469ad47142a5"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:40:03 crc kubenswrapper[5120]: I0316 16:40:03.966160 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-59869bff69-qcf89" Mar 16 16:40:03 crc kubenswrapper[5120]: I0316 16:40:03.972900 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0ca2d31-e27b-42b5-8801-469ad47142a5-config-data" (OuterVolumeSpecName: "config-data") pod "e0ca2d31-e27b-42b5-8801-469ad47142a5" (UID: "e0ca2d31-e27b-42b5-8801-469ad47142a5"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:40:04 crc kubenswrapper[5120]: I0316 16:40:04.063830 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e0ca2d31-e27b-42b5-8801-469ad47142a5-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:40:04 crc kubenswrapper[5120]: I0316 16:40:04.063863 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e0ca2d31-e27b-42b5-8801-469ad47142a5-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:40:04 crc kubenswrapper[5120]: I0316 16:40:04.315470 5120 generic.go:358] "Generic (PLEG): container finished" podID="923b199c-e73a-49ce-b4b7-cf219cc0fc76" containerID="72701fdf1cf1cec7e9fae9d3f4b6fff794c32859c8aaa391b361a4000e46a79b" exitCode=0 Mar 16 16:40:04 crc kubenswrapper[5120]: I0316 16:40:04.315576 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561320-krs6p" event={"ID":"923b199c-e73a-49ce-b4b7-cf219cc0fc76","Type":"ContainerDied","Data":"72701fdf1cf1cec7e9fae9d3f4b6fff794c32859c8aaa391b361a4000e46a79b"} Mar 16 16:40:04 crc kubenswrapper[5120]: I0316 16:40:04.321956 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"da8c9ee6-9520-4597-a4cb-d06ea1d0772c","Type":"ContainerStarted","Data":"0c24a2cf831a56044129b5e00c3ffa6d2a4f5feaefdbc0c7745f5bdd47797bd6"} Mar 16 16:40:04 crc kubenswrapper[5120]: I0316 16:40:04.327359 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-599744884-vf6rr" Mar 16 16:40:04 crc kubenswrapper[5120]: I0316 16:40:04.329160 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-599744884-vf6rr" event={"ID":"e0ca2d31-e27b-42b5-8801-469ad47142a5","Type":"ContainerDied","Data":"243c659fc1ca1c82fb6ccdaca3e8c6850dd2269e1798d8f2e1b78d3c0ac70a82"} Mar 16 16:40:04 crc kubenswrapper[5120]: I0316 16:40:04.329323 5120 scope.go:117] "RemoveContainer" containerID="31e5df1a5b7f2d0c1b5204f81e9f04d53b8362b2e8378a6ef768b2867ed3ef1c" Mar 16 16:40:04 crc kubenswrapper[5120]: I0316 16:40:04.334195 5120 generic.go:358] "Generic (PLEG): container finished" podID="fafcfc0e-412f-4c5b-bba6-87910b9f4282" containerID="2425e735f31a188999c501c7955b02da9ba373d89435ae78fca0f0d98ec36d4e" exitCode=0 Mar 16 16:40:04 crc kubenswrapper[5120]: I0316 16:40:04.334335 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-5b488dd8b-2htz9" event={"ID":"fafcfc0e-412f-4c5b-bba6-87910b9f4282","Type":"ContainerDied","Data":"2425e735f31a188999c501c7955b02da9ba373d89435ae78fca0f0d98ec36d4e"} Mar 16 16:40:04 crc kubenswrapper[5120]: I0316 16:40:04.344569 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"f4685058-90ec-421d-b95e-ca68dc1d4dcd","Type":"ContainerStarted","Data":"ca0ae3a8b4b307a12c44d686843908626a380c9becf90b91194b05d243c4f28b"} Mar 16 16:40:04 crc kubenswrapper[5120]: I0316 16:40:04.379187 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-internal-api-0" podStartSLOduration=3.379164548 podStartE2EDuration="3.379164548s" podCreationTimestamp="2026-03-16 16:40:01 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:40:04.363502743 +0000 UTC m=+4106.517434400" watchObservedRunningTime="2026-03-16 16:40:04.379164548 +0000 UTC m=+4106.533096205" Mar 16 16:40:04 crc kubenswrapper[5120]: I0316 16:40:04.387603 5120 scope.go:117] "RemoveContainer" containerID="2ff684768d9ed08487e6b8399da59d9625b5c9923f0fb5fa6e48a258dc77abdb" Mar 16 16:40:04 crc kubenswrapper[5120]: I0316 16:40:04.394448 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-599744884-vf6rr"] Mar 16 16:40:04 crc kubenswrapper[5120]: I0316 16:40:04.409834 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-api-599744884-vf6rr"] Mar 16 16:40:04 crc kubenswrapper[5120]: I0316 16:40:04.436457 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-59869bff69-qcf89"] Mar 16 16:40:04 crc kubenswrapper[5120]: W0316 16:40:04.443674 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3b25da8f_df4b_4367_884e_abd3b1d6527e.slice/crio-a38252cd22f33781de1b633bbc23f24ed4c43ff7a4b65cce1daf25202492cd0f WatchSource:0}: Error finding container a38252cd22f33781de1b633bbc23f24ed4c43ff7a4b65cce1daf25202492cd0f: Status 404 returned error can't find the container with id a38252cd22f33781de1b633bbc23f24ed4c43ff7a4b65cce1daf25202492cd0f Mar 16 16:40:04 crc kubenswrapper[5120]: I0316 16:40:04.678935 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="84416c7c-79e8-4adb-803f-39ac90a5d695" path="/var/lib/kubelet/pods/84416c7c-79e8-4adb-803f-39ac90a5d695/volumes" Mar 16 16:40:04 crc kubenswrapper[5120]: I0316 16:40:04.681715 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e0ca2d31-e27b-42b5-8801-469ad47142a5" path="/var/lib/kubelet/pods/e0ca2d31-e27b-42b5-8801-469ad47142a5/volumes" Mar 16 16:40:05 crc kubenswrapper[5120]: I0316 16:40:05.050211 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-5b488dd8b-2htz9" Mar 16 16:40:05 crc kubenswrapper[5120]: I0316 16:40:05.206023 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fafcfc0e-412f-4c5b-bba6-87910b9f4282-combined-ca-bundle\") pod \"fafcfc0e-412f-4c5b-bba6-87910b9f4282\" (UID: \"fafcfc0e-412f-4c5b-bba6-87910b9f4282\") " Mar 16 16:40:05 crc kubenswrapper[5120]: I0316 16:40:05.206123 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/fafcfc0e-412f-4c5b-bba6-87910b9f4282-config-data-custom\") pod \"fafcfc0e-412f-4c5b-bba6-87910b9f4282\" (UID: \"fafcfc0e-412f-4c5b-bba6-87910b9f4282\") " Mar 16 16:40:05 crc kubenswrapper[5120]: I0316 16:40:05.206194 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/fafcfc0e-412f-4c5b-bba6-87910b9f4282-logs\") pod \"fafcfc0e-412f-4c5b-bba6-87910b9f4282\" (UID: \"fafcfc0e-412f-4c5b-bba6-87910b9f4282\") " Mar 16 16:40:05 crc kubenswrapper[5120]: I0316 16:40:05.206319 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fafcfc0e-412f-4c5b-bba6-87910b9f4282-config-data\") pod \"fafcfc0e-412f-4c5b-bba6-87910b9f4282\" (UID: \"fafcfc0e-412f-4c5b-bba6-87910b9f4282\") " Mar 16 16:40:05 crc kubenswrapper[5120]: I0316 16:40:05.206409 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r89ps\" (UniqueName: \"kubernetes.io/projected/fafcfc0e-412f-4c5b-bba6-87910b9f4282-kube-api-access-r89ps\") pod \"fafcfc0e-412f-4c5b-bba6-87910b9f4282\" (UID: \"fafcfc0e-412f-4c5b-bba6-87910b9f4282\") " Mar 16 16:40:05 crc kubenswrapper[5120]: I0316 16:40:05.208088 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fafcfc0e-412f-4c5b-bba6-87910b9f4282-logs" (OuterVolumeSpecName: "logs") pod "fafcfc0e-412f-4c5b-bba6-87910b9f4282" (UID: "fafcfc0e-412f-4c5b-bba6-87910b9f4282"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:40:05 crc kubenswrapper[5120]: I0316 16:40:05.218406 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fafcfc0e-412f-4c5b-bba6-87910b9f4282-kube-api-access-r89ps" (OuterVolumeSpecName: "kube-api-access-r89ps") pod "fafcfc0e-412f-4c5b-bba6-87910b9f4282" (UID: "fafcfc0e-412f-4c5b-bba6-87910b9f4282"). InnerVolumeSpecName "kube-api-access-r89ps". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:40:05 crc kubenswrapper[5120]: I0316 16:40:05.248020 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fafcfc0e-412f-4c5b-bba6-87910b9f4282-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "fafcfc0e-412f-4c5b-bba6-87910b9f4282" (UID: "fafcfc0e-412f-4c5b-bba6-87910b9f4282"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:40:05 crc kubenswrapper[5120]: I0316 16:40:05.285820 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fafcfc0e-412f-4c5b-bba6-87910b9f4282-config-data" (OuterVolumeSpecName: "config-data") pod "fafcfc0e-412f-4c5b-bba6-87910b9f4282" (UID: "fafcfc0e-412f-4c5b-bba6-87910b9f4282"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:40:05 crc kubenswrapper[5120]: I0316 16:40:05.311405 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/fafcfc0e-412f-4c5b-bba6-87910b9f4282-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:40:05 crc kubenswrapper[5120]: I0316 16:40:05.311445 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fafcfc0e-412f-4c5b-bba6-87910b9f4282-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:40:05 crc kubenswrapper[5120]: I0316 16:40:05.311464 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r89ps\" (UniqueName: \"kubernetes.io/projected/fafcfc0e-412f-4c5b-bba6-87910b9f4282-kube-api-access-r89ps\") on node \"crc\" DevicePath \"\"" Mar 16 16:40:05 crc kubenswrapper[5120]: I0316 16:40:05.311477 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/fafcfc0e-412f-4c5b-bba6-87910b9f4282-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:40:05 crc kubenswrapper[5120]: I0316 16:40:05.313019 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fafcfc0e-412f-4c5b-bba6-87910b9f4282-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "fafcfc0e-412f-4c5b-bba6-87910b9f4282" (UID: "fafcfc0e-412f-4c5b-bba6-87910b9f4282"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:40:05 crc kubenswrapper[5120]: I0316 16:40:05.371240 5120 generic.go:358] "Generic (PLEG): container finished" podID="41971ebe-e2c3-4815-97c5-011ff54825b7" containerID="4aebcca63f9230179437a529e538e201de4a66f03150428a0ea3f54787a28284" exitCode=0 Mar 16 16:40:05 crc kubenswrapper[5120]: I0316 16:40:05.371320 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"41971ebe-e2c3-4815-97c5-011ff54825b7","Type":"ContainerDied","Data":"4aebcca63f9230179437a529e538e201de4a66f03150428a0ea3f54787a28284"} Mar 16 16:40:05 crc kubenswrapper[5120]: I0316 16:40:05.379279 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-5b488dd8b-2htz9" event={"ID":"fafcfc0e-412f-4c5b-bba6-87910b9f4282","Type":"ContainerDied","Data":"b9ec6af194403776f99f922457dd444c550c1508efb170349988e3561536022d"} Mar 16 16:40:05 crc kubenswrapper[5120]: I0316 16:40:05.379326 5120 scope.go:117] "RemoveContainer" containerID="2425e735f31a188999c501c7955b02da9ba373d89435ae78fca0f0d98ec36d4e" Mar 16 16:40:05 crc kubenswrapper[5120]: I0316 16:40:05.379435 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-5b488dd8b-2htz9" Mar 16 16:40:05 crc kubenswrapper[5120]: I0316 16:40:05.389530 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-59869bff69-qcf89" event={"ID":"3b25da8f-df4b-4367-884e-abd3b1d6527e","Type":"ContainerStarted","Data":"8366512f8d2ec85fe213332aee553881ed2d4ea0d3fb8d28ef0e2ebdf3d9863d"} Mar 16 16:40:05 crc kubenswrapper[5120]: I0316 16:40:05.390257 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/neutron-59869bff69-qcf89" Mar 16 16:40:05 crc kubenswrapper[5120]: I0316 16:40:05.390270 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-59869bff69-qcf89" event={"ID":"3b25da8f-df4b-4367-884e-abd3b1d6527e","Type":"ContainerStarted","Data":"f1ab4c0f8022fb9de6575ab45267b97aab998eaf187857960ccdb6e8bc399b34"} Mar 16 16:40:05 crc kubenswrapper[5120]: I0316 16:40:05.390280 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-59869bff69-qcf89" event={"ID":"3b25da8f-df4b-4367-884e-abd3b1d6527e","Type":"ContainerStarted","Data":"a38252cd22f33781de1b633bbc23f24ed4c43ff7a4b65cce1daf25202492cd0f"} Mar 16 16:40:05 crc kubenswrapper[5120]: I0316 16:40:05.416682 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fafcfc0e-412f-4c5b-bba6-87910b9f4282-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:40:05 crc kubenswrapper[5120]: I0316 16:40:05.427432 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-59869bff69-qcf89" podStartSLOduration=2.427413848 podStartE2EDuration="2.427413848s" podCreationTimestamp="2026-03-16 16:40:03 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:40:05.423129571 +0000 UTC m=+4107.577061228" watchObservedRunningTime="2026-03-16 16:40:05.427413848 +0000 UTC m=+4107.581345505" Mar 16 16:40:05 crc kubenswrapper[5120]: I0316 16:40:05.457827 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-5b488dd8b-2htz9"] Mar 16 16:40:05 crc kubenswrapper[5120]: I0316 16:40:05.460371 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:40:05 crc kubenswrapper[5120]: I0316 16:40:05.466349 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-5b488dd8b-2htz9"] Mar 16 16:40:05 crc kubenswrapper[5120]: I0316 16:40:05.466935 5120 scope.go:117] "RemoveContainer" containerID="950599d20a2d4d472cf2109d9f0d4952f2ac71820ee216fe18daabc06cff10e2" Mar 16 16:40:05 crc kubenswrapper[5120]: I0316 16:40:05.621733 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/41971ebe-e2c3-4815-97c5-011ff54825b7-scripts\") pod \"41971ebe-e2c3-4815-97c5-011ff54825b7\" (UID: \"41971ebe-e2c3-4815-97c5-011ff54825b7\") " Mar 16 16:40:05 crc kubenswrapper[5120]: I0316 16:40:05.621885 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/41971ebe-e2c3-4815-97c5-011ff54825b7-etc-machine-id\") pod \"41971ebe-e2c3-4815-97c5-011ff54825b7\" (UID: \"41971ebe-e2c3-4815-97c5-011ff54825b7\") " Mar 16 16:40:05 crc kubenswrapper[5120]: I0316 16:40:05.622017 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9z7fc\" (UniqueName: \"kubernetes.io/projected/41971ebe-e2c3-4815-97c5-011ff54825b7-kube-api-access-9z7fc\") pod \"41971ebe-e2c3-4815-97c5-011ff54825b7\" (UID: \"41971ebe-e2c3-4815-97c5-011ff54825b7\") " Mar 16 16:40:05 crc kubenswrapper[5120]: I0316 16:40:05.622175 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/41971ebe-e2c3-4815-97c5-011ff54825b7-config-data-custom\") pod \"41971ebe-e2c3-4815-97c5-011ff54825b7\" (UID: \"41971ebe-e2c3-4815-97c5-011ff54825b7\") " Mar 16 16:40:05 crc kubenswrapper[5120]: I0316 16:40:05.622258 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/41971ebe-e2c3-4815-97c5-011ff54825b7-combined-ca-bundle\") pod \"41971ebe-e2c3-4815-97c5-011ff54825b7\" (UID: \"41971ebe-e2c3-4815-97c5-011ff54825b7\") " Mar 16 16:40:05 crc kubenswrapper[5120]: I0316 16:40:05.622337 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/41971ebe-e2c3-4815-97c5-011ff54825b7-config-data\") pod \"41971ebe-e2c3-4815-97c5-011ff54825b7\" (UID: \"41971ebe-e2c3-4815-97c5-011ff54825b7\") " Mar 16 16:40:05 crc kubenswrapper[5120]: I0316 16:40:05.623396 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/41971ebe-e2c3-4815-97c5-011ff54825b7-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "41971ebe-e2c3-4815-97c5-011ff54825b7" (UID: "41971ebe-e2c3-4815-97c5-011ff54825b7"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 16:40:05 crc kubenswrapper[5120]: I0316 16:40:05.636971 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/41971ebe-e2c3-4815-97c5-011ff54825b7-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "41971ebe-e2c3-4815-97c5-011ff54825b7" (UID: "41971ebe-e2c3-4815-97c5-011ff54825b7"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:40:05 crc kubenswrapper[5120]: I0316 16:40:05.637045 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/41971ebe-e2c3-4815-97c5-011ff54825b7-scripts" (OuterVolumeSpecName: "scripts") pod "41971ebe-e2c3-4815-97c5-011ff54825b7" (UID: "41971ebe-e2c3-4815-97c5-011ff54825b7"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:40:05 crc kubenswrapper[5120]: I0316 16:40:05.637506 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41971ebe-e2c3-4815-97c5-011ff54825b7-kube-api-access-9z7fc" (OuterVolumeSpecName: "kube-api-access-9z7fc") pod "41971ebe-e2c3-4815-97c5-011ff54825b7" (UID: "41971ebe-e2c3-4815-97c5-011ff54825b7"). InnerVolumeSpecName "kube-api-access-9z7fc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:40:05 crc kubenswrapper[5120]: I0316 16:40:05.696462 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/41971ebe-e2c3-4815-97c5-011ff54825b7-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "41971ebe-e2c3-4815-97c5-011ff54825b7" (UID: "41971ebe-e2c3-4815-97c5-011ff54825b7"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:40:05 crc kubenswrapper[5120]: I0316 16:40:05.729206 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/41971ebe-e2c3-4815-97c5-011ff54825b7-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:40:05 crc kubenswrapper[5120]: I0316 16:40:05.729243 5120 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/41971ebe-e2c3-4815-97c5-011ff54825b7-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 16:40:05 crc kubenswrapper[5120]: I0316 16:40:05.729256 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9z7fc\" (UniqueName: \"kubernetes.io/projected/41971ebe-e2c3-4815-97c5-011ff54825b7-kube-api-access-9z7fc\") on node \"crc\" DevicePath \"\"" Mar 16 16:40:05 crc kubenswrapper[5120]: I0316 16:40:05.729264 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/41971ebe-e2c3-4815-97c5-011ff54825b7-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:40:05 crc kubenswrapper[5120]: I0316 16:40:05.729272 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/41971ebe-e2c3-4815-97c5-011ff54825b7-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:40:05 crc kubenswrapper[5120]: I0316 16:40:05.757550 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561320-krs6p" Mar 16 16:40:05 crc kubenswrapper[5120]: I0316 16:40:05.760254 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/41971ebe-e2c3-4815-97c5-011ff54825b7-config-data" (OuterVolumeSpecName: "config-data") pod "41971ebe-e2c3-4815-97c5-011ff54825b7" (UID: "41971ebe-e2c3-4815-97c5-011ff54825b7"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:40:05 crc kubenswrapper[5120]: I0316 16:40:05.830252 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4b9cj\" (UniqueName: \"kubernetes.io/projected/923b199c-e73a-49ce-b4b7-cf219cc0fc76-kube-api-access-4b9cj\") pod \"923b199c-e73a-49ce-b4b7-cf219cc0fc76\" (UID: \"923b199c-e73a-49ce-b4b7-cf219cc0fc76\") " Mar 16 16:40:05 crc kubenswrapper[5120]: I0316 16:40:05.831387 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/41971ebe-e2c3-4815-97c5-011ff54825b7-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:40:05 crc kubenswrapper[5120]: I0316 16:40:05.835420 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/923b199c-e73a-49ce-b4b7-cf219cc0fc76-kube-api-access-4b9cj" (OuterVolumeSpecName: "kube-api-access-4b9cj") pod "923b199c-e73a-49ce-b4b7-cf219cc0fc76" (UID: "923b199c-e73a-49ce-b4b7-cf219cc0fc76"). InnerVolumeSpecName "kube-api-access-4b9cj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:40:05 crc kubenswrapper[5120]: I0316 16:40:05.934479 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4b9cj\" (UniqueName: \"kubernetes.io/projected/923b199c-e73a-49ce-b4b7-cf219cc0fc76-kube-api-access-4b9cj\") on node \"crc\" DevicePath \"\"" Mar 16 16:40:05 crc kubenswrapper[5120]: I0316 16:40:05.991516 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-76647d7b7d-c7dsx"] Mar 16 16:40:05 crc kubenswrapper[5120]: I0316 16:40:05.997543 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fafcfc0e-412f-4c5b-bba6-87910b9f4282" containerName="barbican-keystone-listener" Mar 16 16:40:05 crc kubenswrapper[5120]: I0316 16:40:05.998118 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="fafcfc0e-412f-4c5b-bba6-87910b9f4282" containerName="barbican-keystone-listener" Mar 16 16:40:05 crc kubenswrapper[5120]: I0316 16:40:05.998238 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="923b199c-e73a-49ce-b4b7-cf219cc0fc76" containerName="oc" Mar 16 16:40:05 crc kubenswrapper[5120]: I0316 16:40:05.998731 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="923b199c-e73a-49ce-b4b7-cf219cc0fc76" containerName="oc" Mar 16 16:40:05 crc kubenswrapper[5120]: I0316 16:40:05.998888 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0ca2d31-e27b-42b5-8801-469ad47142a5" containerName="barbican-api" Mar 16 16:40:05 crc kubenswrapper[5120]: I0316 16:40:05.999065 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0ca2d31-e27b-42b5-8801-469ad47142a5" containerName="barbican-api" Mar 16 16:40:05 crc kubenswrapper[5120]: I0316 16:40:05.999202 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0ca2d31-e27b-42b5-8801-469ad47142a5" containerName="barbican-api-log" Mar 16 16:40:05 crc kubenswrapper[5120]: I0316 16:40:05.999292 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0ca2d31-e27b-42b5-8801-469ad47142a5" containerName="barbican-api-log" Mar 16 16:40:05 crc kubenswrapper[5120]: I0316 16:40:05.999389 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41971ebe-e2c3-4815-97c5-011ff54825b7" containerName="cinder-scheduler" Mar 16 16:40:05 crc kubenswrapper[5120]: I0316 16:40:05.999474 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="41971ebe-e2c3-4815-97c5-011ff54825b7" containerName="cinder-scheduler" Mar 16 16:40:05 crc kubenswrapper[5120]: I0316 16:40:05.999590 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fafcfc0e-412f-4c5b-bba6-87910b9f4282" containerName="barbican-keystone-listener-log" Mar 16 16:40:05 crc kubenswrapper[5120]: I0316 16:40:05.999683 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="fafcfc0e-412f-4c5b-bba6-87910b9f4282" containerName="barbican-keystone-listener-log" Mar 16 16:40:05 crc kubenswrapper[5120]: I0316 16:40:05.999797 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41971ebe-e2c3-4815-97c5-011ff54825b7" containerName="probe" Mar 16 16:40:05 crc kubenswrapper[5120]: I0316 16:40:05.999891 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="41971ebe-e2c3-4815-97c5-011ff54825b7" containerName="probe" Mar 16 16:40:06 crc kubenswrapper[5120]: I0316 16:40:06.000195 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="fafcfc0e-412f-4c5b-bba6-87910b9f4282" containerName="barbican-keystone-listener-log" Mar 16 16:40:06 crc kubenswrapper[5120]: I0316 16:40:06.000273 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="fafcfc0e-412f-4c5b-bba6-87910b9f4282" containerName="barbican-keystone-listener" Mar 16 16:40:06 crc kubenswrapper[5120]: I0316 16:40:06.000445 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e0ca2d31-e27b-42b5-8801-469ad47142a5" containerName="barbican-api" Mar 16 16:40:06 crc kubenswrapper[5120]: I0316 16:40:06.000558 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e0ca2d31-e27b-42b5-8801-469ad47142a5" containerName="barbican-api-log" Mar 16 16:40:06 crc kubenswrapper[5120]: I0316 16:40:06.000648 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="41971ebe-e2c3-4815-97c5-011ff54825b7" containerName="probe" Mar 16 16:40:06 crc kubenswrapper[5120]: I0316 16:40:06.000712 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="41971ebe-e2c3-4815-97c5-011ff54825b7" containerName="cinder-scheduler" Mar 16 16:40:06 crc kubenswrapper[5120]: I0316 16:40:06.000790 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="923b199c-e73a-49ce-b4b7-cf219cc0fc76" containerName="oc" Mar 16 16:40:06 crc kubenswrapper[5120]: I0316 16:40:06.005774 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-76647d7b7d-c7dsx" Mar 16 16:40:06 crc kubenswrapper[5120]: I0316 16:40:06.007868 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-neutron-internal-svc\"" Mar 16 16:40:06 crc kubenswrapper[5120]: I0316 16:40:06.008160 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-neutron-public-svc\"" Mar 16 16:40:06 crc kubenswrapper[5120]: I0316 16:40:06.012581 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-76647d7b7d-c7dsx"] Mar 16 16:40:06 crc kubenswrapper[5120]: I0316 16:40:06.036238 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/6cef508e-ad21-4c82-ba79-4862f0e98691-ovndb-tls-certs\") pod \"neutron-76647d7b7d-c7dsx\" (UID: \"6cef508e-ad21-4c82-ba79-4862f0e98691\") " pod="openstack-kuttl-tests/neutron-76647d7b7d-c7dsx" Mar 16 16:40:06 crc kubenswrapper[5120]: I0316 16:40:06.036356 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6cef508e-ad21-4c82-ba79-4862f0e98691-internal-tls-certs\") pod \"neutron-76647d7b7d-c7dsx\" (UID: \"6cef508e-ad21-4c82-ba79-4862f0e98691\") " pod="openstack-kuttl-tests/neutron-76647d7b7d-c7dsx" Mar 16 16:40:06 crc kubenswrapper[5120]: I0316 16:40:06.036564 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6cef508e-ad21-4c82-ba79-4862f0e98691-public-tls-certs\") pod \"neutron-76647d7b7d-c7dsx\" (UID: \"6cef508e-ad21-4c82-ba79-4862f0e98691\") " pod="openstack-kuttl-tests/neutron-76647d7b7d-c7dsx" Mar 16 16:40:06 crc kubenswrapper[5120]: I0316 16:40:06.036706 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/6cef508e-ad21-4c82-ba79-4862f0e98691-httpd-config\") pod \"neutron-76647d7b7d-c7dsx\" (UID: \"6cef508e-ad21-4c82-ba79-4862f0e98691\") " pod="openstack-kuttl-tests/neutron-76647d7b7d-c7dsx" Mar 16 16:40:06 crc kubenswrapper[5120]: I0316 16:40:06.036747 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6cef508e-ad21-4c82-ba79-4862f0e98691-config\") pod \"neutron-76647d7b7d-c7dsx\" (UID: \"6cef508e-ad21-4c82-ba79-4862f0e98691\") " pod="openstack-kuttl-tests/neutron-76647d7b7d-c7dsx" Mar 16 16:40:06 crc kubenswrapper[5120]: I0316 16:40:06.036804 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9pzm\" (UniqueName: \"kubernetes.io/projected/6cef508e-ad21-4c82-ba79-4862f0e98691-kube-api-access-l9pzm\") pod \"neutron-76647d7b7d-c7dsx\" (UID: \"6cef508e-ad21-4c82-ba79-4862f0e98691\") " pod="openstack-kuttl-tests/neutron-76647d7b7d-c7dsx" Mar 16 16:40:06 crc kubenswrapper[5120]: I0316 16:40:06.036844 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6cef508e-ad21-4c82-ba79-4862f0e98691-combined-ca-bundle\") pod \"neutron-76647d7b7d-c7dsx\" (UID: \"6cef508e-ad21-4c82-ba79-4862f0e98691\") " pod="openstack-kuttl-tests/neutron-76647d7b7d-c7dsx" Mar 16 16:40:06 crc kubenswrapper[5120]: I0316 16:40:06.137930 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6cef508e-ad21-4c82-ba79-4862f0e98691-public-tls-certs\") pod \"neutron-76647d7b7d-c7dsx\" (UID: \"6cef508e-ad21-4c82-ba79-4862f0e98691\") " pod="openstack-kuttl-tests/neutron-76647d7b7d-c7dsx" Mar 16 16:40:06 crc kubenswrapper[5120]: I0316 16:40:06.138365 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/6cef508e-ad21-4c82-ba79-4862f0e98691-httpd-config\") pod \"neutron-76647d7b7d-c7dsx\" (UID: \"6cef508e-ad21-4c82-ba79-4862f0e98691\") " pod="openstack-kuttl-tests/neutron-76647d7b7d-c7dsx" Mar 16 16:40:06 crc kubenswrapper[5120]: I0316 16:40:06.138409 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6cef508e-ad21-4c82-ba79-4862f0e98691-config\") pod \"neutron-76647d7b7d-c7dsx\" (UID: \"6cef508e-ad21-4c82-ba79-4862f0e98691\") " pod="openstack-kuttl-tests/neutron-76647d7b7d-c7dsx" Mar 16 16:40:06 crc kubenswrapper[5120]: I0316 16:40:06.138446 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l9pzm\" (UniqueName: \"kubernetes.io/projected/6cef508e-ad21-4c82-ba79-4862f0e98691-kube-api-access-l9pzm\") pod \"neutron-76647d7b7d-c7dsx\" (UID: \"6cef508e-ad21-4c82-ba79-4862f0e98691\") " pod="openstack-kuttl-tests/neutron-76647d7b7d-c7dsx" Mar 16 16:40:06 crc kubenswrapper[5120]: I0316 16:40:06.138474 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6cef508e-ad21-4c82-ba79-4862f0e98691-combined-ca-bundle\") pod \"neutron-76647d7b7d-c7dsx\" (UID: \"6cef508e-ad21-4c82-ba79-4862f0e98691\") " pod="openstack-kuttl-tests/neutron-76647d7b7d-c7dsx" Mar 16 16:40:06 crc kubenswrapper[5120]: I0316 16:40:06.138561 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/6cef508e-ad21-4c82-ba79-4862f0e98691-ovndb-tls-certs\") pod \"neutron-76647d7b7d-c7dsx\" (UID: \"6cef508e-ad21-4c82-ba79-4862f0e98691\") " pod="openstack-kuttl-tests/neutron-76647d7b7d-c7dsx" Mar 16 16:40:06 crc kubenswrapper[5120]: I0316 16:40:06.138624 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6cef508e-ad21-4c82-ba79-4862f0e98691-internal-tls-certs\") pod \"neutron-76647d7b7d-c7dsx\" (UID: \"6cef508e-ad21-4c82-ba79-4862f0e98691\") " pod="openstack-kuttl-tests/neutron-76647d7b7d-c7dsx" Mar 16 16:40:06 crc kubenswrapper[5120]: I0316 16:40:06.151902 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6cef508e-ad21-4c82-ba79-4862f0e98691-public-tls-certs\") pod \"neutron-76647d7b7d-c7dsx\" (UID: \"6cef508e-ad21-4c82-ba79-4862f0e98691\") " pod="openstack-kuttl-tests/neutron-76647d7b7d-c7dsx" Mar 16 16:40:06 crc kubenswrapper[5120]: I0316 16:40:06.151960 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/6cef508e-ad21-4c82-ba79-4862f0e98691-httpd-config\") pod \"neutron-76647d7b7d-c7dsx\" (UID: \"6cef508e-ad21-4c82-ba79-4862f0e98691\") " pod="openstack-kuttl-tests/neutron-76647d7b7d-c7dsx" Mar 16 16:40:06 crc kubenswrapper[5120]: I0316 16:40:06.151960 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6cef508e-ad21-4c82-ba79-4862f0e98691-combined-ca-bundle\") pod \"neutron-76647d7b7d-c7dsx\" (UID: \"6cef508e-ad21-4c82-ba79-4862f0e98691\") " pod="openstack-kuttl-tests/neutron-76647d7b7d-c7dsx" Mar 16 16:40:06 crc kubenswrapper[5120]: I0316 16:40:06.152431 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/6cef508e-ad21-4c82-ba79-4862f0e98691-ovndb-tls-certs\") pod \"neutron-76647d7b7d-c7dsx\" (UID: \"6cef508e-ad21-4c82-ba79-4862f0e98691\") " pod="openstack-kuttl-tests/neutron-76647d7b7d-c7dsx" Mar 16 16:40:06 crc kubenswrapper[5120]: I0316 16:40:06.152634 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/6cef508e-ad21-4c82-ba79-4862f0e98691-config\") pod \"neutron-76647d7b7d-c7dsx\" (UID: \"6cef508e-ad21-4c82-ba79-4862f0e98691\") " pod="openstack-kuttl-tests/neutron-76647d7b7d-c7dsx" Mar 16 16:40:06 crc kubenswrapper[5120]: I0316 16:40:06.152705 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6cef508e-ad21-4c82-ba79-4862f0e98691-internal-tls-certs\") pod \"neutron-76647d7b7d-c7dsx\" (UID: \"6cef508e-ad21-4c82-ba79-4862f0e98691\") " pod="openstack-kuttl-tests/neutron-76647d7b7d-c7dsx" Mar 16 16:40:06 crc kubenswrapper[5120]: I0316 16:40:06.156703 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9pzm\" (UniqueName: \"kubernetes.io/projected/6cef508e-ad21-4c82-ba79-4862f0e98691-kube-api-access-l9pzm\") pod \"neutron-76647d7b7d-c7dsx\" (UID: \"6cef508e-ad21-4c82-ba79-4862f0e98691\") " pod="openstack-kuttl-tests/neutron-76647d7b7d-c7dsx" Mar 16 16:40:06 crc kubenswrapper[5120]: I0316 16:40:06.335844 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-76647d7b7d-c7dsx" Mar 16 16:40:06 crc kubenswrapper[5120]: I0316 16:40:06.469842 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-infra/auto-csr-approver-29561314-s8vrr"] Mar 16 16:40:06 crc kubenswrapper[5120]: I0316 16:40:06.501776 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-infra/auto-csr-approver-29561314-s8vrr"] Mar 16 16:40:06 crc kubenswrapper[5120]: I0316 16:40:06.512704 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"da8c9ee6-9520-4597-a4cb-d06ea1d0772c","Type":"ContainerStarted","Data":"18117d315c2cfe422e993c1304b517b8faf736bf44afe60a74b05e1897dff94b"} Mar 16 16:40:06 crc kubenswrapper[5120]: I0316 16:40:06.514998 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:40:06 crc kubenswrapper[5120]: I0316 16:40:06.567471 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:40:06 crc kubenswrapper[5120]: I0316 16:40:06.568402 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"41971ebe-e2c3-4815-97c5-011ff54825b7","Type":"ContainerDied","Data":"b6c1bfe5958df13fc96791fb28ae60539bb87edbd379061eea62e277946038f5"} Mar 16 16:40:06 crc kubenswrapper[5120]: I0316 16:40:06.568483 5120 scope.go:117] "RemoveContainer" containerID="4e67e989637bb99ce5515061a489eda8b16c3352162f462f48c338278482e963" Mar 16 16:40:06 crc kubenswrapper[5120]: I0316 16:40:06.571766 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=3.047628398 podStartE2EDuration="8.571737406s" podCreationTimestamp="2026-03-16 16:39:58 +0000 UTC" firstStartedPulling="2026-03-16 16:40:00.437026226 +0000 UTC m=+4102.590957883" lastFinishedPulling="2026-03-16 16:40:05.961135224 +0000 UTC m=+4108.115066891" observedRunningTime="2026-03-16 16:40:06.556270876 +0000 UTC m=+4108.710202533" watchObservedRunningTime="2026-03-16 16:40:06.571737406 +0000 UTC m=+4108.725669063" Mar 16 16:40:06 crc kubenswrapper[5120]: I0316 16:40:06.602360 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561320-krs6p" Mar 16 16:40:06 crc kubenswrapper[5120]: I0316 16:40:06.603312 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561320-krs6p" event={"ID":"923b199c-e73a-49ce-b4b7-cf219cc0fc76","Type":"ContainerDied","Data":"8bdb324cf8511218e439df160dd97cbc2d5fd688d33096a57f3b0f3d008170bf"} Mar 16 16:40:06 crc kubenswrapper[5120]: I0316 16:40:06.603381 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8bdb324cf8511218e439df160dd97cbc2d5fd688d33096a57f3b0f3d008170bf" Mar 16 16:40:06 crc kubenswrapper[5120]: I0316 16:40:06.617355 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:40:06 crc kubenswrapper[5120]: I0316 16:40:06.622295 5120 scope.go:117] "RemoveContainer" containerID="4aebcca63f9230179437a529e538e201de4a66f03150428a0ea3f54787a28284" Mar 16 16:40:06 crc kubenswrapper[5120]: I0316 16:40:06.634780 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:40:06 crc kubenswrapper[5120]: I0316 16:40:06.695632 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="41971ebe-e2c3-4815-97c5-011ff54825b7" path="/var/lib/kubelet/pods/41971ebe-e2c3-4815-97c5-011ff54825b7/volumes" Mar 16 16:40:06 crc kubenswrapper[5120]: I0316 16:40:06.696537 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="564c9119-4d4c-4ff2-b7ae-7c066f8bdf57" path="/var/lib/kubelet/pods/564c9119-4d4c-4ff2-b7ae-7c066f8bdf57/volumes" Mar 16 16:40:06 crc kubenswrapper[5120]: I0316 16:40:06.697424 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fafcfc0e-412f-4c5b-bba6-87910b9f4282" path="/var/lib/kubelet/pods/fafcfc0e-412f-4c5b-bba6-87910b9f4282/volumes" Mar 16 16:40:06 crc kubenswrapper[5120]: I0316 16:40:06.699231 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:40:07 crc kubenswrapper[5120]: I0316 16:40:07.119847 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:40:07 crc kubenswrapper[5120]: I0316 16:40:07.119984 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:40:07 crc kubenswrapper[5120]: I0316 16:40:07.130715 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-scheduler-config-data\"" Mar 16 16:40:07 crc kubenswrapper[5120]: W0316 16:40:07.157076 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6cef508e_ad21_4c82_ba79_4862f0e98691.slice/crio-f26045aee66f5350319db9a00cd9a5b1c6750c3cf7b41b6c3cc150bf4ba15d5b WatchSource:0}: Error finding container f26045aee66f5350319db9a00cd9a5b1c6750c3cf7b41b6c3cc150bf4ba15d5b: Status 404 returned error can't find the container with id f26045aee66f5350319db9a00cd9a5b1c6750c3cf7b41b6c3cc150bf4ba15d5b Mar 16 16:40:07 crc kubenswrapper[5120]: I0316 16:40:07.177895 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/4c03814f-fda1-4a54-b9ca-89705d683547-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"4c03814f-fda1-4a54-b9ca-89705d683547\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:40:07 crc kubenswrapper[5120]: I0316 16:40:07.178038 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4c03814f-fda1-4a54-b9ca-89705d683547-scripts\") pod \"cinder-scheduler-0\" (UID: \"4c03814f-fda1-4a54-b9ca-89705d683547\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:40:07 crc kubenswrapper[5120]: I0316 16:40:07.178278 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/4c03814f-fda1-4a54-b9ca-89705d683547-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"4c03814f-fda1-4a54-b9ca-89705d683547\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:40:07 crc kubenswrapper[5120]: I0316 16:40:07.178327 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4c03814f-fda1-4a54-b9ca-89705d683547-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"4c03814f-fda1-4a54-b9ca-89705d683547\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:40:07 crc kubenswrapper[5120]: I0316 16:40:07.178365 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4c03814f-fda1-4a54-b9ca-89705d683547-config-data\") pod \"cinder-scheduler-0\" (UID: \"4c03814f-fda1-4a54-b9ca-89705d683547\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:40:07 crc kubenswrapper[5120]: I0316 16:40:07.178472 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grxvr\" (UniqueName: \"kubernetes.io/projected/4c03814f-fda1-4a54-b9ca-89705d683547-kube-api-access-grxvr\") pod \"cinder-scheduler-0\" (UID: \"4c03814f-fda1-4a54-b9ca-89705d683547\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:40:07 crc kubenswrapper[5120]: I0316 16:40:07.183786 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-76647d7b7d-c7dsx"] Mar 16 16:40:07 crc kubenswrapper[5120]: I0316 16:40:07.280047 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/4c03814f-fda1-4a54-b9ca-89705d683547-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"4c03814f-fda1-4a54-b9ca-89705d683547\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:40:07 crc kubenswrapper[5120]: I0316 16:40:07.281003 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4c03814f-fda1-4a54-b9ca-89705d683547-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"4c03814f-fda1-4a54-b9ca-89705d683547\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:40:07 crc kubenswrapper[5120]: I0316 16:40:07.281034 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4c03814f-fda1-4a54-b9ca-89705d683547-config-data\") pod \"cinder-scheduler-0\" (UID: \"4c03814f-fda1-4a54-b9ca-89705d683547\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:40:07 crc kubenswrapper[5120]: I0316 16:40:07.281096 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-grxvr\" (UniqueName: \"kubernetes.io/projected/4c03814f-fda1-4a54-b9ca-89705d683547-kube-api-access-grxvr\") pod \"cinder-scheduler-0\" (UID: \"4c03814f-fda1-4a54-b9ca-89705d683547\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:40:07 crc kubenswrapper[5120]: I0316 16:40:07.281237 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/4c03814f-fda1-4a54-b9ca-89705d683547-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"4c03814f-fda1-4a54-b9ca-89705d683547\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:40:07 crc kubenswrapper[5120]: I0316 16:40:07.281313 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4c03814f-fda1-4a54-b9ca-89705d683547-scripts\") pod \"cinder-scheduler-0\" (UID: \"4c03814f-fda1-4a54-b9ca-89705d683547\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:40:07 crc kubenswrapper[5120]: I0316 16:40:07.282618 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/4c03814f-fda1-4a54-b9ca-89705d683547-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"4c03814f-fda1-4a54-b9ca-89705d683547\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:40:07 crc kubenswrapper[5120]: I0316 16:40:07.287595 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/4c03814f-fda1-4a54-b9ca-89705d683547-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"4c03814f-fda1-4a54-b9ca-89705d683547\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:40:07 crc kubenswrapper[5120]: I0316 16:40:07.297696 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4c03814f-fda1-4a54-b9ca-89705d683547-config-data\") pod \"cinder-scheduler-0\" (UID: \"4c03814f-fda1-4a54-b9ca-89705d683547\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:40:07 crc kubenswrapper[5120]: I0316 16:40:07.298545 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4c03814f-fda1-4a54-b9ca-89705d683547-scripts\") pod \"cinder-scheduler-0\" (UID: \"4c03814f-fda1-4a54-b9ca-89705d683547\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:40:07 crc kubenswrapper[5120]: I0316 16:40:07.299165 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4c03814f-fda1-4a54-b9ca-89705d683547-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"4c03814f-fda1-4a54-b9ca-89705d683547\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:40:07 crc kubenswrapper[5120]: I0316 16:40:07.306313 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-grxvr\" (UniqueName: \"kubernetes.io/projected/4c03814f-fda1-4a54-b9ca-89705d683547-kube-api-access-grxvr\") pod \"cinder-scheduler-0\" (UID: \"4c03814f-fda1-4a54-b9ca-89705d683547\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:40:07 crc kubenswrapper[5120]: I0316 16:40:07.439485 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:40:07 crc kubenswrapper[5120]: I0316 16:40:07.654081 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-76647d7b7d-c7dsx" event={"ID":"6cef508e-ad21-4c82-ba79-4862f0e98691","Type":"ContainerStarted","Data":"5fa655026894dd4d7dc9e13c705fa23e382e4cc5698aa88f2ef873831fbc3214"} Mar 16 16:40:07 crc kubenswrapper[5120]: I0316 16:40:07.656083 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-76647d7b7d-c7dsx" event={"ID":"6cef508e-ad21-4c82-ba79-4862f0e98691","Type":"ContainerStarted","Data":"f26045aee66f5350319db9a00cd9a5b1c6750c3cf7b41b6c3cc150bf4ba15d5b"} Mar 16 16:40:08 crc kubenswrapper[5120]: I0316 16:40:08.000846 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:40:08 crc kubenswrapper[5120]: W0316 16:40:08.013936 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4c03814f_fda1_4a54_b9ca_89705d683547.slice/crio-ba9bc22cd601a5e536c5dbc29862f9309dd08823ec7d0999bfee33d707b1d1bf WatchSource:0}: Error finding container ba9bc22cd601a5e536c5dbc29862f9309dd08823ec7d0999bfee33d707b1d1bf: Status 404 returned error can't find the container with id ba9bc22cd601a5e536c5dbc29862f9309dd08823ec7d0999bfee33d707b1d1bf Mar 16 16:40:08 crc kubenswrapper[5120]: I0316 16:40:08.753988 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"4c03814f-fda1-4a54-b9ca-89705d683547","Type":"ContainerStarted","Data":"ba9bc22cd601a5e536c5dbc29862f9309dd08823ec7d0999bfee33d707b1d1bf"} Mar 16 16:40:08 crc kubenswrapper[5120]: I0316 16:40:08.763921 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-76647d7b7d-c7dsx" event={"ID":"6cef508e-ad21-4c82-ba79-4862f0e98691","Type":"ContainerStarted","Data":"7d2c0bf776d2a574d61880604ebe7da62ff91dedc2f8b4c2a6103dff037b543c"} Mar 16 16:40:08 crc kubenswrapper[5120]: I0316 16:40:08.764010 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/neutron-76647d7b7d-c7dsx" Mar 16 16:40:08 crc kubenswrapper[5120]: I0316 16:40:08.801160 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-76647d7b7d-c7dsx" podStartSLOduration=3.801134892 podStartE2EDuration="3.801134892s" podCreationTimestamp="2026-03-16 16:40:05 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:40:08.790323259 +0000 UTC m=+4110.944254926" watchObservedRunningTime="2026-03-16 16:40:08.801134892 +0000 UTC m=+4110.955066549" Mar 16 16:40:09 crc kubenswrapper[5120]: E0316 16:40:09.166780 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1746765 actualBytes=10240 Mar 16 16:40:09 crc kubenswrapper[5120]: I0316 16:40:09.308215 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-6647785db4-lmftm" Mar 16 16:40:09 crc kubenswrapper[5120]: I0316 16:40:09.333124 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-6647785db4-lmftm" Mar 16 16:40:09 crc kubenswrapper[5120]: I0316 16:40:09.422891 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-5fbdc8fdc6-mzpw2"] Mar 16 16:40:09 crc kubenswrapper[5120]: I0316 16:40:09.423974 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-5fbdc8fdc6-mzpw2" podUID="3d3aa68e-3e71-4a4c-98b3-a270eafdb9b4" containerName="barbican-api-log" containerID="cri-o://6bb9f248c55dbeab9d6ccf5cc13d6f101718ac0b7f11d52d095a2ef4117f5b38" gracePeriod=30 Mar 16 16:40:09 crc kubenswrapper[5120]: I0316 16:40:09.424608 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-5fbdc8fdc6-mzpw2" podUID="3d3aa68e-3e71-4a4c-98b3-a270eafdb9b4" containerName="barbican-api" containerID="cri-o://64ac4d8ce46c83aa0ec5e780400e98040ee5dc986c894b80bb0d270e3f86fcd8" gracePeriod=30 Mar 16 16:40:09 crc kubenswrapper[5120]: I0316 16:40:09.780442 5120 generic.go:358] "Generic (PLEG): container finished" podID="3d3aa68e-3e71-4a4c-98b3-a270eafdb9b4" containerID="6bb9f248c55dbeab9d6ccf5cc13d6f101718ac0b7f11d52d095a2ef4117f5b38" exitCode=143 Mar 16 16:40:09 crc kubenswrapper[5120]: I0316 16:40:09.780604 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-5fbdc8fdc6-mzpw2" event={"ID":"3d3aa68e-3e71-4a4c-98b3-a270eafdb9b4","Type":"ContainerDied","Data":"6bb9f248c55dbeab9d6ccf5cc13d6f101718ac0b7f11d52d095a2ef4117f5b38"} Mar 16 16:40:09 crc kubenswrapper[5120]: I0316 16:40:09.784437 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"4c03814f-fda1-4a54-b9ca-89705d683547","Type":"ContainerStarted","Data":"9f2e17d1583f9443ae42dcdc1cbb9549f47015028e0072b4ca4caeed85ae311a"} Mar 16 16:40:09 crc kubenswrapper[5120]: I0316 16:40:09.854092 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:40:09 crc kubenswrapper[5120]: I0316 16:40:09.854325 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:40:11 crc kubenswrapper[5120]: I0316 16:40:11.064538 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:40:11 crc kubenswrapper[5120]: I0316 16:40:11.066664 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:40:11 crc kubenswrapper[5120]: I0316 16:40:11.157646 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:40:11 crc kubenswrapper[5120]: I0316 16:40:11.623297 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:40:11 crc kubenswrapper[5120]: I0316 16:40:11.623360 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:40:11 crc kubenswrapper[5120]: I0316 16:40:11.661953 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:40:11 crc kubenswrapper[5120]: I0316 16:40:11.705859 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:40:12 crc kubenswrapper[5120]: I0316 16:40:12.068132 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"4c03814f-fda1-4a54-b9ca-89705d683547","Type":"ContainerStarted","Data":"3119e5ce532c5e339071de9ff3c4fe23636cf19a24818b601368555dfb49f204"} Mar 16 16:40:12 crc kubenswrapper[5120]: I0316 16:40:12.069197 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:40:12 crc kubenswrapper[5120]: I0316 16:40:12.069406 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:40:12 crc kubenswrapper[5120]: I0316 16:40:12.069577 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:40:12 crc kubenswrapper[5120]: I0316 16:40:12.096317 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-scheduler-0" podStartSLOduration=6.096296244 podStartE2EDuration="6.096296244s" podCreationTimestamp="2026-03-16 16:40:06 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:40:12.094175317 +0000 UTC m=+4114.248106974" watchObservedRunningTime="2026-03-16 16:40:12.096296244 +0000 UTC m=+4114.250227891" Mar 16 16:40:12 crc kubenswrapper[5120]: I0316 16:40:12.440684 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:40:12 crc kubenswrapper[5120]: I0316 16:40:12.469666 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:40:13 crc kubenswrapper[5120]: I0316 16:40:13.078650 5120 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Mar 16 16:40:13 crc kubenswrapper[5120]: I0316 16:40:13.302368 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-5fbdc8fdc6-mzpw2" podUID="3d3aa68e-3e71-4a4c-98b3-a270eafdb9b4" containerName="barbican-api-log" probeResult="failure" output="Get \"http://10.217.1.48:9311/healthcheck\": read tcp 10.217.0.2:58854->10.217.1.48:9311: read: connection reset by peer" Mar 16 16:40:13 crc kubenswrapper[5120]: I0316 16:40:13.484400 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:40:13 crc kubenswrapper[5120]: I0316 16:40:13.786574 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-5fbdc8fdc6-mzpw2" Mar 16 16:40:13 crc kubenswrapper[5120]: I0316 16:40:13.889127 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3d3aa68e-3e71-4a4c-98b3-a270eafdb9b4-logs\") pod \"3d3aa68e-3e71-4a4c-98b3-a270eafdb9b4\" (UID: \"3d3aa68e-3e71-4a4c-98b3-a270eafdb9b4\") " Mar 16 16:40:13 crc kubenswrapper[5120]: I0316 16:40:13.889200 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3d3aa68e-3e71-4a4c-98b3-a270eafdb9b4-config-data\") pod \"3d3aa68e-3e71-4a4c-98b3-a270eafdb9b4\" (UID: \"3d3aa68e-3e71-4a4c-98b3-a270eafdb9b4\") " Mar 16 16:40:13 crc kubenswrapper[5120]: I0316 16:40:13.889506 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/3d3aa68e-3e71-4a4c-98b3-a270eafdb9b4-config-data-custom\") pod \"3d3aa68e-3e71-4a4c-98b3-a270eafdb9b4\" (UID: \"3d3aa68e-3e71-4a4c-98b3-a270eafdb9b4\") " Mar 16 16:40:13 crc kubenswrapper[5120]: I0316 16:40:13.890113 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d3aa68e-3e71-4a4c-98b3-a270eafdb9b4-logs" (OuterVolumeSpecName: "logs") pod "3d3aa68e-3e71-4a4c-98b3-a270eafdb9b4" (UID: "3d3aa68e-3e71-4a4c-98b3-a270eafdb9b4"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:40:13 crc kubenswrapper[5120]: I0316 16:40:13.889748 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3d3aa68e-3e71-4a4c-98b3-a270eafdb9b4-combined-ca-bundle\") pod \"3d3aa68e-3e71-4a4c-98b3-a270eafdb9b4\" (UID: \"3d3aa68e-3e71-4a4c-98b3-a270eafdb9b4\") " Mar 16 16:40:13 crc kubenswrapper[5120]: I0316 16:40:13.890507 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4sgpq\" (UniqueName: \"kubernetes.io/projected/3d3aa68e-3e71-4a4c-98b3-a270eafdb9b4-kube-api-access-4sgpq\") pod \"3d3aa68e-3e71-4a4c-98b3-a270eafdb9b4\" (UID: \"3d3aa68e-3e71-4a4c-98b3-a270eafdb9b4\") " Mar 16 16:40:13 crc kubenswrapper[5120]: I0316 16:40:13.891633 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3d3aa68e-3e71-4a4c-98b3-a270eafdb9b4-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:40:13 crc kubenswrapper[5120]: I0316 16:40:13.896919 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d3aa68e-3e71-4a4c-98b3-a270eafdb9b4-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "3d3aa68e-3e71-4a4c-98b3-a270eafdb9b4" (UID: "3d3aa68e-3e71-4a4c-98b3-a270eafdb9b4"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:40:13 crc kubenswrapper[5120]: I0316 16:40:13.904137 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d3aa68e-3e71-4a4c-98b3-a270eafdb9b4-kube-api-access-4sgpq" (OuterVolumeSpecName: "kube-api-access-4sgpq") pod "3d3aa68e-3e71-4a4c-98b3-a270eafdb9b4" (UID: "3d3aa68e-3e71-4a4c-98b3-a270eafdb9b4"). InnerVolumeSpecName "kube-api-access-4sgpq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:40:13 crc kubenswrapper[5120]: I0316 16:40:13.916051 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d3aa68e-3e71-4a4c-98b3-a270eafdb9b4-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "3d3aa68e-3e71-4a4c-98b3-a270eafdb9b4" (UID: "3d3aa68e-3e71-4a4c-98b3-a270eafdb9b4"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:40:13 crc kubenswrapper[5120]: I0316 16:40:13.937988 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d3aa68e-3e71-4a4c-98b3-a270eafdb9b4-config-data" (OuterVolumeSpecName: "config-data") pod "3d3aa68e-3e71-4a4c-98b3-a270eafdb9b4" (UID: "3d3aa68e-3e71-4a4c-98b3-a270eafdb9b4"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:40:13 crc kubenswrapper[5120]: I0316 16:40:13.993838 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3d3aa68e-3e71-4a4c-98b3-a270eafdb9b4-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:40:13 crc kubenswrapper[5120]: I0316 16:40:13.993882 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4sgpq\" (UniqueName: \"kubernetes.io/projected/3d3aa68e-3e71-4a4c-98b3-a270eafdb9b4-kube-api-access-4sgpq\") on node \"crc\" DevicePath \"\"" Mar 16 16:40:13 crc kubenswrapper[5120]: I0316 16:40:13.993893 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3d3aa68e-3e71-4a4c-98b3-a270eafdb9b4-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:40:13 crc kubenswrapper[5120]: I0316 16:40:13.993902 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/3d3aa68e-3e71-4a4c-98b3-a270eafdb9b4-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:40:14 crc kubenswrapper[5120]: I0316 16:40:14.090133 5120 generic.go:358] "Generic (PLEG): container finished" podID="3d3aa68e-3e71-4a4c-98b3-a270eafdb9b4" containerID="64ac4d8ce46c83aa0ec5e780400e98040ee5dc986c894b80bb0d270e3f86fcd8" exitCode=0 Mar 16 16:40:14 crc kubenswrapper[5120]: I0316 16:40:14.090191 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-5fbdc8fdc6-mzpw2" event={"ID":"3d3aa68e-3e71-4a4c-98b3-a270eafdb9b4","Type":"ContainerDied","Data":"64ac4d8ce46c83aa0ec5e780400e98040ee5dc986c894b80bb0d270e3f86fcd8"} Mar 16 16:40:14 crc kubenswrapper[5120]: I0316 16:40:14.090237 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-5fbdc8fdc6-mzpw2" Mar 16 16:40:14 crc kubenswrapper[5120]: I0316 16:40:14.090265 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-5fbdc8fdc6-mzpw2" event={"ID":"3d3aa68e-3e71-4a4c-98b3-a270eafdb9b4","Type":"ContainerDied","Data":"ffbc006586c89ae9d9c73e18d690b4037846cacca35cf6e85d2589eadd0a3053"} Mar 16 16:40:14 crc kubenswrapper[5120]: I0316 16:40:14.090296 5120 scope.go:117] "RemoveContainer" containerID="64ac4d8ce46c83aa0ec5e780400e98040ee5dc986c894b80bb0d270e3f86fcd8" Mar 16 16:40:14 crc kubenswrapper[5120]: I0316 16:40:14.091051 5120 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Mar 16 16:40:14 crc kubenswrapper[5120]: I0316 16:40:14.091074 5120 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Mar 16 16:40:14 crc kubenswrapper[5120]: I0316 16:40:14.091239 5120 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Mar 16 16:40:14 crc kubenswrapper[5120]: I0316 16:40:14.123423 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-5fbdc8fdc6-mzpw2"] Mar 16 16:40:14 crc kubenswrapper[5120]: I0316 16:40:14.129747 5120 scope.go:117] "RemoveContainer" containerID="6bb9f248c55dbeab9d6ccf5cc13d6f101718ac0b7f11d52d095a2ef4117f5b38" Mar 16 16:40:14 crc kubenswrapper[5120]: I0316 16:40:14.131589 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-api-5fbdc8fdc6-mzpw2"] Mar 16 16:40:14 crc kubenswrapper[5120]: I0316 16:40:14.149691 5120 scope.go:117] "RemoveContainer" containerID="64ac4d8ce46c83aa0ec5e780400e98040ee5dc986c894b80bb0d270e3f86fcd8" Mar 16 16:40:14 crc kubenswrapper[5120]: E0316 16:40:14.150185 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"64ac4d8ce46c83aa0ec5e780400e98040ee5dc986c894b80bb0d270e3f86fcd8\": container with ID starting with 64ac4d8ce46c83aa0ec5e780400e98040ee5dc986c894b80bb0d270e3f86fcd8 not found: ID does not exist" containerID="64ac4d8ce46c83aa0ec5e780400e98040ee5dc986c894b80bb0d270e3f86fcd8" Mar 16 16:40:14 crc kubenswrapper[5120]: I0316 16:40:14.150308 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64ac4d8ce46c83aa0ec5e780400e98040ee5dc986c894b80bb0d270e3f86fcd8"} err="failed to get container status \"64ac4d8ce46c83aa0ec5e780400e98040ee5dc986c894b80bb0d270e3f86fcd8\": rpc error: code = NotFound desc = could not find container \"64ac4d8ce46c83aa0ec5e780400e98040ee5dc986c894b80bb0d270e3f86fcd8\": container with ID starting with 64ac4d8ce46c83aa0ec5e780400e98040ee5dc986c894b80bb0d270e3f86fcd8 not found: ID does not exist" Mar 16 16:40:14 crc kubenswrapper[5120]: I0316 16:40:14.150414 5120 scope.go:117] "RemoveContainer" containerID="6bb9f248c55dbeab9d6ccf5cc13d6f101718ac0b7f11d52d095a2ef4117f5b38" Mar 16 16:40:14 crc kubenswrapper[5120]: E0316 16:40:14.150876 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6bb9f248c55dbeab9d6ccf5cc13d6f101718ac0b7f11d52d095a2ef4117f5b38\": container with ID starting with 6bb9f248c55dbeab9d6ccf5cc13d6f101718ac0b7f11d52d095a2ef4117f5b38 not found: ID does not exist" containerID="6bb9f248c55dbeab9d6ccf5cc13d6f101718ac0b7f11d52d095a2ef4117f5b38" Mar 16 16:40:14 crc kubenswrapper[5120]: I0316 16:40:14.150903 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6bb9f248c55dbeab9d6ccf5cc13d6f101718ac0b7f11d52d095a2ef4117f5b38"} err="failed to get container status \"6bb9f248c55dbeab9d6ccf5cc13d6f101718ac0b7f11d52d095a2ef4117f5b38\": rpc error: code = NotFound desc = could not find container \"6bb9f248c55dbeab9d6ccf5cc13d6f101718ac0b7f11d52d095a2ef4117f5b38\": container with ID starting with 6bb9f248c55dbeab9d6ccf5cc13d6f101718ac0b7f11d52d095a2ef4117f5b38 not found: ID does not exist" Mar 16 16:40:14 crc kubenswrapper[5120]: I0316 16:40:14.193389 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:40:14 crc kubenswrapper[5120]: I0316 16:40:14.195164 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:40:14 crc kubenswrapper[5120]: I0316 16:40:14.291241 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:40:14 crc kubenswrapper[5120]: I0316 16:40:14.690570 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d3aa68e-3e71-4a4c-98b3-a270eafdb9b4" path="/var/lib/kubelet/pods/3d3aa68e-3e71-4a4c-98b3-a270eafdb9b4/volumes" Mar 16 16:40:17 crc kubenswrapper[5120]: I0316 16:40:17.633479 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:40:17 crc kubenswrapper[5120]: I0316 16:40:17.743402 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/placement-5c5dddf6d4-cftmc" Mar 16 16:40:18 crc kubenswrapper[5120]: I0316 16:40:18.678953 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/placement-5c5dddf6d4-cftmc" Mar 16 16:40:18 crc kubenswrapper[5120]: I0316 16:40:18.745491 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-5fbdc8fdc6-mzpw2" podUID="3d3aa68e-3e71-4a4c-98b3-a270eafdb9b4" containerName="barbican-api" probeResult="failure" output="Get \"http://10.217.1.48:9311/healthcheck\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 16:40:18 crc kubenswrapper[5120]: I0316 16:40:18.887873 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-6d66dbd7f8-6ld6p"] Mar 16 16:40:18 crc kubenswrapper[5120]: I0316 16:40:18.889165 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d3aa68e-3e71-4a4c-98b3-a270eafdb9b4" containerName="barbican-api" Mar 16 16:40:18 crc kubenswrapper[5120]: I0316 16:40:18.889195 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d3aa68e-3e71-4a4c-98b3-a270eafdb9b4" containerName="barbican-api" Mar 16 16:40:18 crc kubenswrapper[5120]: I0316 16:40:18.889213 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d3aa68e-3e71-4a4c-98b3-a270eafdb9b4" containerName="barbican-api-log" Mar 16 16:40:18 crc kubenswrapper[5120]: I0316 16:40:18.889222 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d3aa68e-3e71-4a4c-98b3-a270eafdb9b4" containerName="barbican-api-log" Mar 16 16:40:18 crc kubenswrapper[5120]: I0316 16:40:18.889426 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="3d3aa68e-3e71-4a4c-98b3-a270eafdb9b4" containerName="barbican-api-log" Mar 16 16:40:18 crc kubenswrapper[5120]: I0316 16:40:18.889446 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="3d3aa68e-3e71-4a4c-98b3-a270eafdb9b4" containerName="barbican-api" Mar 16 16:40:18 crc kubenswrapper[5120]: I0316 16:40:18.895357 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-6d66dbd7f8-6ld6p" Mar 16 16:40:18 crc kubenswrapper[5120]: I0316 16:40:18.897942 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-6d66dbd7f8-6ld6p"] Mar 16 16:40:19 crc kubenswrapper[5120]: I0316 16:40:19.016946 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/285f9896-1a25-4942-96e7-06cff0c87338-public-tls-certs\") pod \"placement-6d66dbd7f8-6ld6p\" (UID: \"285f9896-1a25-4942-96e7-06cff0c87338\") " pod="openstack-kuttl-tests/placement-6d66dbd7f8-6ld6p" Mar 16 16:40:19 crc kubenswrapper[5120]: I0316 16:40:19.017287 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/285f9896-1a25-4942-96e7-06cff0c87338-internal-tls-certs\") pod \"placement-6d66dbd7f8-6ld6p\" (UID: \"285f9896-1a25-4942-96e7-06cff0c87338\") " pod="openstack-kuttl-tests/placement-6d66dbd7f8-6ld6p" Mar 16 16:40:19 crc kubenswrapper[5120]: I0316 16:40:19.017313 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/285f9896-1a25-4942-96e7-06cff0c87338-config-data\") pod \"placement-6d66dbd7f8-6ld6p\" (UID: \"285f9896-1a25-4942-96e7-06cff0c87338\") " pod="openstack-kuttl-tests/placement-6d66dbd7f8-6ld6p" Mar 16 16:40:19 crc kubenswrapper[5120]: I0316 16:40:19.017568 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/285f9896-1a25-4942-96e7-06cff0c87338-logs\") pod \"placement-6d66dbd7f8-6ld6p\" (UID: \"285f9896-1a25-4942-96e7-06cff0c87338\") " pod="openstack-kuttl-tests/placement-6d66dbd7f8-6ld6p" Mar 16 16:40:19 crc kubenswrapper[5120]: I0316 16:40:19.017656 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/285f9896-1a25-4942-96e7-06cff0c87338-combined-ca-bundle\") pod \"placement-6d66dbd7f8-6ld6p\" (UID: \"285f9896-1a25-4942-96e7-06cff0c87338\") " pod="openstack-kuttl-tests/placement-6d66dbd7f8-6ld6p" Mar 16 16:40:19 crc kubenswrapper[5120]: I0316 16:40:19.017739 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qr9cv\" (UniqueName: \"kubernetes.io/projected/285f9896-1a25-4942-96e7-06cff0c87338-kube-api-access-qr9cv\") pod \"placement-6d66dbd7f8-6ld6p\" (UID: \"285f9896-1a25-4942-96e7-06cff0c87338\") " pod="openstack-kuttl-tests/placement-6d66dbd7f8-6ld6p" Mar 16 16:40:19 crc kubenswrapper[5120]: I0316 16:40:19.017868 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/285f9896-1a25-4942-96e7-06cff0c87338-scripts\") pod \"placement-6d66dbd7f8-6ld6p\" (UID: \"285f9896-1a25-4942-96e7-06cff0c87338\") " pod="openstack-kuttl-tests/placement-6d66dbd7f8-6ld6p" Mar 16 16:40:19 crc kubenswrapper[5120]: I0316 16:40:19.120638 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qr9cv\" (UniqueName: \"kubernetes.io/projected/285f9896-1a25-4942-96e7-06cff0c87338-kube-api-access-qr9cv\") pod \"placement-6d66dbd7f8-6ld6p\" (UID: \"285f9896-1a25-4942-96e7-06cff0c87338\") " pod="openstack-kuttl-tests/placement-6d66dbd7f8-6ld6p" Mar 16 16:40:19 crc kubenswrapper[5120]: I0316 16:40:19.120690 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/285f9896-1a25-4942-96e7-06cff0c87338-scripts\") pod \"placement-6d66dbd7f8-6ld6p\" (UID: \"285f9896-1a25-4942-96e7-06cff0c87338\") " pod="openstack-kuttl-tests/placement-6d66dbd7f8-6ld6p" Mar 16 16:40:19 crc kubenswrapper[5120]: I0316 16:40:19.120920 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/285f9896-1a25-4942-96e7-06cff0c87338-public-tls-certs\") pod \"placement-6d66dbd7f8-6ld6p\" (UID: \"285f9896-1a25-4942-96e7-06cff0c87338\") " pod="openstack-kuttl-tests/placement-6d66dbd7f8-6ld6p" Mar 16 16:40:19 crc kubenswrapper[5120]: I0316 16:40:19.120959 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/285f9896-1a25-4942-96e7-06cff0c87338-internal-tls-certs\") pod \"placement-6d66dbd7f8-6ld6p\" (UID: \"285f9896-1a25-4942-96e7-06cff0c87338\") " pod="openstack-kuttl-tests/placement-6d66dbd7f8-6ld6p" Mar 16 16:40:19 crc kubenswrapper[5120]: I0316 16:40:19.120978 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/285f9896-1a25-4942-96e7-06cff0c87338-config-data\") pod \"placement-6d66dbd7f8-6ld6p\" (UID: \"285f9896-1a25-4942-96e7-06cff0c87338\") " pod="openstack-kuttl-tests/placement-6d66dbd7f8-6ld6p" Mar 16 16:40:19 crc kubenswrapper[5120]: I0316 16:40:19.121045 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/285f9896-1a25-4942-96e7-06cff0c87338-logs\") pod \"placement-6d66dbd7f8-6ld6p\" (UID: \"285f9896-1a25-4942-96e7-06cff0c87338\") " pod="openstack-kuttl-tests/placement-6d66dbd7f8-6ld6p" Mar 16 16:40:19 crc kubenswrapper[5120]: I0316 16:40:19.121067 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/285f9896-1a25-4942-96e7-06cff0c87338-combined-ca-bundle\") pod \"placement-6d66dbd7f8-6ld6p\" (UID: \"285f9896-1a25-4942-96e7-06cff0c87338\") " pod="openstack-kuttl-tests/placement-6d66dbd7f8-6ld6p" Mar 16 16:40:19 crc kubenswrapper[5120]: I0316 16:40:19.121627 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/285f9896-1a25-4942-96e7-06cff0c87338-logs\") pod \"placement-6d66dbd7f8-6ld6p\" (UID: \"285f9896-1a25-4942-96e7-06cff0c87338\") " pod="openstack-kuttl-tests/placement-6d66dbd7f8-6ld6p" Mar 16 16:40:19 crc kubenswrapper[5120]: I0316 16:40:19.126892 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/285f9896-1a25-4942-96e7-06cff0c87338-scripts\") pod \"placement-6d66dbd7f8-6ld6p\" (UID: \"285f9896-1a25-4942-96e7-06cff0c87338\") " pod="openstack-kuttl-tests/placement-6d66dbd7f8-6ld6p" Mar 16 16:40:19 crc kubenswrapper[5120]: I0316 16:40:19.127014 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/285f9896-1a25-4942-96e7-06cff0c87338-internal-tls-certs\") pod \"placement-6d66dbd7f8-6ld6p\" (UID: \"285f9896-1a25-4942-96e7-06cff0c87338\") " pod="openstack-kuttl-tests/placement-6d66dbd7f8-6ld6p" Mar 16 16:40:19 crc kubenswrapper[5120]: I0316 16:40:19.127120 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/285f9896-1a25-4942-96e7-06cff0c87338-combined-ca-bundle\") pod \"placement-6d66dbd7f8-6ld6p\" (UID: \"285f9896-1a25-4942-96e7-06cff0c87338\") " pod="openstack-kuttl-tests/placement-6d66dbd7f8-6ld6p" Mar 16 16:40:19 crc kubenswrapper[5120]: I0316 16:40:19.127790 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/285f9896-1a25-4942-96e7-06cff0c87338-public-tls-certs\") pod \"placement-6d66dbd7f8-6ld6p\" (UID: \"285f9896-1a25-4942-96e7-06cff0c87338\") " pod="openstack-kuttl-tests/placement-6d66dbd7f8-6ld6p" Mar 16 16:40:19 crc kubenswrapper[5120]: I0316 16:40:19.128543 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/285f9896-1a25-4942-96e7-06cff0c87338-config-data\") pod \"placement-6d66dbd7f8-6ld6p\" (UID: \"285f9896-1a25-4942-96e7-06cff0c87338\") " pod="openstack-kuttl-tests/placement-6d66dbd7f8-6ld6p" Mar 16 16:40:19 crc kubenswrapper[5120]: I0316 16:40:19.139258 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qr9cv\" (UniqueName: \"kubernetes.io/projected/285f9896-1a25-4942-96e7-06cff0c87338-kube-api-access-qr9cv\") pod \"placement-6d66dbd7f8-6ld6p\" (UID: \"285f9896-1a25-4942-96e7-06cff0c87338\") " pod="openstack-kuttl-tests/placement-6d66dbd7f8-6ld6p" Mar 16 16:40:19 crc kubenswrapper[5120]: I0316 16:40:19.217979 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-6d66dbd7f8-6ld6p" Mar 16 16:40:19 crc kubenswrapper[5120]: I0316 16:40:19.645151 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-6d66dbd7f8-6ld6p"] Mar 16 16:40:19 crc kubenswrapper[5120]: W0316 16:40:19.646017 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod285f9896_1a25_4942_96e7_06cff0c87338.slice/crio-0dc0ba911242ec02d0bb2b1e2e2e21f4985eb31a1a9503efaed2b57e8a56d6bf WatchSource:0}: Error finding container 0dc0ba911242ec02d0bb2b1e2e2e21f4985eb31a1a9503efaed2b57e8a56d6bf: Status 404 returned error can't find the container with id 0dc0ba911242ec02d0bb2b1e2e2e21f4985eb31a1a9503efaed2b57e8a56d6bf Mar 16 16:40:20 crc kubenswrapper[5120]: I0316 16:40:20.168657 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-6d66dbd7f8-6ld6p" event={"ID":"285f9896-1a25-4942-96e7-06cff0c87338","Type":"ContainerStarted","Data":"ff35fcc66f01f4079bcdb316040d0ddf3ee4fd594afc5a2f5a31c4a635ef5041"} Mar 16 16:40:20 crc kubenswrapper[5120]: I0316 16:40:20.169109 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-6d66dbd7f8-6ld6p" event={"ID":"285f9896-1a25-4942-96e7-06cff0c87338","Type":"ContainerStarted","Data":"960b621eb32725f87cd9d272b4591b8833ab3d8756e9e76af56acecb09e4b1e4"} Mar 16 16:40:20 crc kubenswrapper[5120]: I0316 16:40:20.169126 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-6d66dbd7f8-6ld6p" event={"ID":"285f9896-1a25-4942-96e7-06cff0c87338","Type":"ContainerStarted","Data":"0dc0ba911242ec02d0bb2b1e2e2e21f4985eb31a1a9503efaed2b57e8a56d6bf"} Mar 16 16:40:20 crc kubenswrapper[5120]: I0316 16:40:20.169989 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-6d66dbd7f8-6ld6p" Mar 16 16:40:20 crc kubenswrapper[5120]: I0316 16:40:20.170040 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-6d66dbd7f8-6ld6p" Mar 16 16:40:20 crc kubenswrapper[5120]: I0316 16:40:20.191207 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-6d66dbd7f8-6ld6p" podStartSLOduration=2.191191185 podStartE2EDuration="2.191191185s" podCreationTimestamp="2026-03-16 16:40:18 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:40:20.190985269 +0000 UTC m=+4122.344916946" watchObservedRunningTime="2026-03-16 16:40:20.191191185 +0000 UTC m=+4122.345122842" Mar 16 16:40:22 crc kubenswrapper[5120]: I0316 16:40:22.008257 5120 patch_prober.go:28] interesting pod/machine-config-daemon-7bf76 container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 16:40:22 crc kubenswrapper[5120]: I0316 16:40:22.008685 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 16:40:22 crc kubenswrapper[5120]: I0316 16:40:22.008793 5120 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" Mar 16 16:40:22 crc kubenswrapper[5120]: I0316 16:40:22.009622 5120 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="machine-config-daemon" containerStatusID={"Type":"cri-o","ID":"27caa0d07f4f6a9da1d136e53e041b4b98a922634553e557b8adcb1ff1ab2b90"} pod="openshift-machine-config-operator/machine-config-daemon-7bf76" containerMessage="Container machine-config-daemon failed liveness probe, will be restarted" Mar 16 16:40:22 crc kubenswrapper[5120]: I0316 16:40:22.009730 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" containerID="cri-o://27caa0d07f4f6a9da1d136e53e041b4b98a922634553e557b8adcb1ff1ab2b90" gracePeriod=600 Mar 16 16:40:22 crc kubenswrapper[5120]: I0316 16:40:22.197935 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" event={"ID":"e2275cb4-4905-4d66-a87e-8010120db2bd","Type":"ContainerDied","Data":"27caa0d07f4f6a9da1d136e53e041b4b98a922634553e557b8adcb1ff1ab2b90"} Mar 16 16:40:22 crc kubenswrapper[5120]: I0316 16:40:22.196334 5120 generic.go:358] "Generic (PLEG): container finished" podID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerID="27caa0d07f4f6a9da1d136e53e041b4b98a922634553e557b8adcb1ff1ab2b90" exitCode=0 Mar 16 16:40:22 crc kubenswrapper[5120]: I0316 16:40:22.198270 5120 scope.go:117] "RemoveContainer" containerID="0a15d5caff30dc8885f782e59962af7d98d58b39ab76059e56e5827e10e7ab8b" Mar 16 16:40:23 crc kubenswrapper[5120]: I0316 16:40:23.210047 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" event={"ID":"e2275cb4-4905-4d66-a87e-8010120db2bd","Type":"ContainerStarted","Data":"35a7dd6e19084cee69ca16203bca6378ea0cdf6a685ca2093ab847e5904eb9e6"} Mar 16 16:40:25 crc kubenswrapper[5120]: I0316 16:40:25.018081 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-operators-hsqcg"] Mar 16 16:40:25 crc kubenswrapper[5120]: I0316 16:40:25.037694 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-hsqcg"] Mar 16 16:40:25 crc kubenswrapper[5120]: I0316 16:40:25.037878 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-hsqcg" Mar 16 16:40:25 crc kubenswrapper[5120]: I0316 16:40:25.162785 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/af070f63-f3d9-44e0-b864-95e2f297f2e1-catalog-content\") pod \"redhat-operators-hsqcg\" (UID: \"af070f63-f3d9-44e0-b864-95e2f297f2e1\") " pod="openshift-marketplace/redhat-operators-hsqcg" Mar 16 16:40:25 crc kubenswrapper[5120]: I0316 16:40:25.162942 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/af070f63-f3d9-44e0-b864-95e2f297f2e1-utilities\") pod \"redhat-operators-hsqcg\" (UID: \"af070f63-f3d9-44e0-b864-95e2f297f2e1\") " pod="openshift-marketplace/redhat-operators-hsqcg" Mar 16 16:40:25 crc kubenswrapper[5120]: I0316 16:40:25.162969 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwfgp\" (UniqueName: \"kubernetes.io/projected/af070f63-f3d9-44e0-b864-95e2f297f2e1-kube-api-access-rwfgp\") pod \"redhat-operators-hsqcg\" (UID: \"af070f63-f3d9-44e0-b864-95e2f297f2e1\") " pod="openshift-marketplace/redhat-operators-hsqcg" Mar 16 16:40:25 crc kubenswrapper[5120]: I0316 16:40:25.265084 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/af070f63-f3d9-44e0-b864-95e2f297f2e1-catalog-content\") pod \"redhat-operators-hsqcg\" (UID: \"af070f63-f3d9-44e0-b864-95e2f297f2e1\") " pod="openshift-marketplace/redhat-operators-hsqcg" Mar 16 16:40:25 crc kubenswrapper[5120]: I0316 16:40:25.265459 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/af070f63-f3d9-44e0-b864-95e2f297f2e1-utilities\") pod \"redhat-operators-hsqcg\" (UID: \"af070f63-f3d9-44e0-b864-95e2f297f2e1\") " pod="openshift-marketplace/redhat-operators-hsqcg" Mar 16 16:40:25 crc kubenswrapper[5120]: I0316 16:40:25.265553 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rwfgp\" (UniqueName: \"kubernetes.io/projected/af070f63-f3d9-44e0-b864-95e2f297f2e1-kube-api-access-rwfgp\") pod \"redhat-operators-hsqcg\" (UID: \"af070f63-f3d9-44e0-b864-95e2f297f2e1\") " pod="openshift-marketplace/redhat-operators-hsqcg" Mar 16 16:40:25 crc kubenswrapper[5120]: I0316 16:40:25.266562 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/af070f63-f3d9-44e0-b864-95e2f297f2e1-catalog-content\") pod \"redhat-operators-hsqcg\" (UID: \"af070f63-f3d9-44e0-b864-95e2f297f2e1\") " pod="openshift-marketplace/redhat-operators-hsqcg" Mar 16 16:40:25 crc kubenswrapper[5120]: I0316 16:40:25.266916 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/af070f63-f3d9-44e0-b864-95e2f297f2e1-utilities\") pod \"redhat-operators-hsqcg\" (UID: \"af070f63-f3d9-44e0-b864-95e2f297f2e1\") " pod="openshift-marketplace/redhat-operators-hsqcg" Mar 16 16:40:25 crc kubenswrapper[5120]: I0316 16:40:25.297681 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwfgp\" (UniqueName: \"kubernetes.io/projected/af070f63-f3d9-44e0-b864-95e2f297f2e1-kube-api-access-rwfgp\") pod \"redhat-operators-hsqcg\" (UID: \"af070f63-f3d9-44e0-b864-95e2f297f2e1\") " pod="openshift-marketplace/redhat-operators-hsqcg" Mar 16 16:40:25 crc kubenswrapper[5120]: I0316 16:40:25.364639 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-hsqcg" Mar 16 16:40:25 crc kubenswrapper[5120]: I0316 16:40:25.919532 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-hsqcg"] Mar 16 16:40:25 crc kubenswrapper[5120]: W0316 16:40:25.929326 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf070f63_f3d9_44e0_b864_95e2f297f2e1.slice/crio-f627677a0279699cb3f08ef619ebd2c849f608ae0e90d93d7120fbdbf2c16362 WatchSource:0}: Error finding container f627677a0279699cb3f08ef619ebd2c849f608ae0e90d93d7120fbdbf2c16362: Status 404 returned error can't find the container with id f627677a0279699cb3f08ef619ebd2c849f608ae0e90d93d7120fbdbf2c16362 Mar 16 16:40:26 crc kubenswrapper[5120]: I0316 16:40:26.251290 5120 generic.go:358] "Generic (PLEG): container finished" podID="af070f63-f3d9-44e0-b864-95e2f297f2e1" containerID="86fe4dd73610561935351879c90d5c77c9a40a062fcaed8e497d50b49c45e3aa" exitCode=0 Mar 16 16:40:26 crc kubenswrapper[5120]: I0316 16:40:26.251347 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-hsqcg" event={"ID":"af070f63-f3d9-44e0-b864-95e2f297f2e1","Type":"ContainerDied","Data":"86fe4dd73610561935351879c90d5c77c9a40a062fcaed8e497d50b49c45e3aa"} Mar 16 16:40:26 crc kubenswrapper[5120]: I0316 16:40:26.251796 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-hsqcg" event={"ID":"af070f63-f3d9-44e0-b864-95e2f297f2e1","Type":"ContainerStarted","Data":"f627677a0279699cb3f08ef619ebd2c849f608ae0e90d93d7120fbdbf2c16362"} Mar 16 16:40:30 crc kubenswrapper[5120]: I0316 16:40:30.314268 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/keystone-74449f99d8-kxw96" Mar 16 16:40:32 crc kubenswrapper[5120]: I0316 16:40:32.076400 5120 scope.go:117] "RemoveContainer" containerID="fa416404210ba9884e92dd1be2f328de4273ed8f8cdcad1414a712c0b73c392c" Mar 16 16:40:33 crc kubenswrapper[5120]: I0316 16:40:33.803596 5120 scope.go:117] "RemoveContainer" containerID="edcee23b482215175c93820ecb4ceeb31c4a6de19a3a1b412e998ea3b9523cfe" Mar 16 16:40:33 crc kubenswrapper[5120]: I0316 16:40:33.860216 5120 scope.go:117] "RemoveContainer" containerID="476e79bc976be0e2457fee61d3ac73832939cb61a6a76b093c5e115b93b5ce56" Mar 16 16:40:33 crc kubenswrapper[5120]: I0316 16:40:33.903049 5120 scope.go:117] "RemoveContainer" containerID="9dabeafb0b740b3ad03a7b9cfcd7fe649e2992960a96553a85c939a2509080c4" Mar 16 16:40:33 crc kubenswrapper[5120]: I0316 16:40:33.920683 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 16:40:33 crc kubenswrapper[5120]: I0316 16:40:33.925738 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Mar 16 16:40:33 crc kubenswrapper[5120]: I0316 16:40:33.928080 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"openstack-config-secret\"" Mar 16 16:40:33 crc kubenswrapper[5120]: I0316 16:40:33.928351 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-config\"" Mar 16 16:40:33 crc kubenswrapper[5120]: I0316 16:40:33.928574 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"openstackclient-openstackclient-dockercfg-ppvrd\"" Mar 16 16:40:33 crc kubenswrapper[5120]: I0316 16:40:33.935603 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 16:40:33 crc kubenswrapper[5120]: I0316 16:40:33.954587 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 16:40:33 crc kubenswrapper[5120]: I0316 16:40:33.961054 5120 status_manager.go:919] "Failed to update status for pod" pod="openstack-kuttl-tests/openstackclient" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"16d7f0d7-658d-4ce1-aa75-2892b078d91c\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T16:40:33Z\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T16:40:33Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T16:40:33Z\\\",\\\"message\\\":\\\"containers with unready status: [openstackclient]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T16:40:33Z\\\",\\\"message\\\":\\\"containers with unready status: [openstackclient]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/podified-antelope-centos9/openstack-openstackclient@sha256:d765b589a5f7bc8573b3b192ed265654699012e6342cc4829bd8ea65a7b239a5\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"openstackclient\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/home/cloud-admin/.config/openstack/clouds.yaml\\\",\\\"name\\\":\\\"openstack-config\\\"},{\\\"mountPath\\\":\\\"/home/cloud-admin/.config/openstack/secure.yaml\\\",\\\"name\\\":\\\"openstack-config-secret\\\"},{\\\"mountPath\\\":\\\"/home/cloud-admin/cloudrc\\\",\\\"name\\\":\\\"openstack-config-secret\\\"},{\\\"mountPath\\\":\\\"/etc/pki/ca-trust/extracted/pem/tls-ca-bundle.pem\\\",\\\"name\\\":\\\"combined-ca-bundle\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-w8b8b\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T16:40:33Z\\\"}}\" for pod \"openstack-kuttl-tests\"/\"openstackclient\": pods \"openstackclient\" is forbidden: node \"crc\" can only update pod status for pods with spec.nodeName set to itself" Mar 16 16:40:33 crc kubenswrapper[5120]: I0316 16:40:33.968568 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 16:40:33 crc kubenswrapper[5120]: I0316 16:40:33.991825 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 16:40:34 crc kubenswrapper[5120]: I0316 16:40:34.006629 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Mar 16 16:40:34 crc kubenswrapper[5120]: I0316 16:40:34.025948 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/16d7f0d7-658d-4ce1-aa75-2892b078d91c-openstack-config-secret\") pod \"openstackclient\" (UID: \"16d7f0d7-658d-4ce1-aa75-2892b078d91c\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:40:34 crc kubenswrapper[5120]: I0316 16:40:34.026287 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/16d7f0d7-658d-4ce1-aa75-2892b078d91c-combined-ca-bundle\") pod \"openstackclient\" (UID: \"16d7f0d7-658d-4ce1-aa75-2892b078d91c\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:40:34 crc kubenswrapper[5120]: I0316 16:40:34.026354 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/16d7f0d7-658d-4ce1-aa75-2892b078d91c-openstack-config\") pod \"openstackclient\" (UID: \"16d7f0d7-658d-4ce1-aa75-2892b078d91c\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:40:34 crc kubenswrapper[5120]: I0316 16:40:34.026400 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8b8b\" (UniqueName: \"kubernetes.io/projected/16d7f0d7-658d-4ce1-aa75-2892b078d91c-kube-api-access-w8b8b\") pod \"openstackclient\" (UID: \"16d7f0d7-658d-4ce1-aa75-2892b078d91c\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:40:34 crc kubenswrapper[5120]: I0316 16:40:34.028686 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 16:40:34 crc kubenswrapper[5120]: I0316 16:40:34.033023 5120 scope.go:117] "RemoveContainer" containerID="ad8e2ec5b87993e63a39edc2e193772a2f831e952f623a27fc9e87d4868bf786" Mar 16 16:40:34 crc kubenswrapper[5120]: I0316 16:40:34.037031 5120 status_manager.go:905] "Pod was deleted and then recreated, skipping status update" pod="openstack-kuttl-tests/openstackclient" oldPodUID="16d7f0d7-658d-4ce1-aa75-2892b078d91c" podUID="591ce862-489c-49f7-8dbd-500414032fd9" Mar 16 16:40:34 crc kubenswrapper[5120]: E0316 16:40:34.052104 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[combined-ca-bundle kube-api-access-w8b8b openstack-config openstack-config-secret], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openstack-kuttl-tests/openstackclient" podUID="16d7f0d7-658d-4ce1-aa75-2892b078d91c" Mar 16 16:40:34 crc kubenswrapper[5120]: I0316 16:40:34.082702 5120 scope.go:117] "RemoveContainer" containerID="361a6a3387bc4a7f0bcb0d924b9b6fc999732a9610b1f04bc2fbec9b3b0e159d" Mar 16 16:40:34 crc kubenswrapper[5120]: I0316 16:40:34.105087 5120 scope.go:117] "RemoveContainer" containerID="8a49af4de18f552f63e6bb5d67e800d9991f5bb6b5b27ea2181fbe7a25888ea1" Mar 16 16:40:34 crc kubenswrapper[5120]: I0316 16:40:34.128627 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/16d7f0d7-658d-4ce1-aa75-2892b078d91c-combined-ca-bundle\") pod \"openstackclient\" (UID: \"16d7f0d7-658d-4ce1-aa75-2892b078d91c\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:40:34 crc kubenswrapper[5120]: I0316 16:40:34.128698 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/16d7f0d7-658d-4ce1-aa75-2892b078d91c-openstack-config\") pod \"openstackclient\" (UID: \"16d7f0d7-658d-4ce1-aa75-2892b078d91c\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:40:34 crc kubenswrapper[5120]: I0316 16:40:34.128753 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/591ce862-489c-49f7-8dbd-500414032fd9-combined-ca-bundle\") pod \"openstackclient\" (UID: \"591ce862-489c-49f7-8dbd-500414032fd9\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:40:34 crc kubenswrapper[5120]: I0316 16:40:34.128800 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w8b8b\" (UniqueName: \"kubernetes.io/projected/16d7f0d7-658d-4ce1-aa75-2892b078d91c-kube-api-access-w8b8b\") pod \"openstackclient\" (UID: \"16d7f0d7-658d-4ce1-aa75-2892b078d91c\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:40:34 crc kubenswrapper[5120]: I0316 16:40:34.128871 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4kwn\" (UniqueName: \"kubernetes.io/projected/591ce862-489c-49f7-8dbd-500414032fd9-kube-api-access-f4kwn\") pod \"openstackclient\" (UID: \"591ce862-489c-49f7-8dbd-500414032fd9\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:40:34 crc kubenswrapper[5120]: I0316 16:40:34.128901 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/591ce862-489c-49f7-8dbd-500414032fd9-openstack-config-secret\") pod \"openstackclient\" (UID: \"591ce862-489c-49f7-8dbd-500414032fd9\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:40:34 crc kubenswrapper[5120]: I0316 16:40:34.129006 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/16d7f0d7-658d-4ce1-aa75-2892b078d91c-openstack-config-secret\") pod \"openstackclient\" (UID: \"16d7f0d7-658d-4ce1-aa75-2892b078d91c\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:40:34 crc kubenswrapper[5120]: I0316 16:40:34.129100 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/591ce862-489c-49f7-8dbd-500414032fd9-openstack-config\") pod \"openstackclient\" (UID: \"591ce862-489c-49f7-8dbd-500414032fd9\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:40:34 crc kubenswrapper[5120]: I0316 16:40:34.130320 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/16d7f0d7-658d-4ce1-aa75-2892b078d91c-openstack-config\") pod \"openstackclient\" (UID: \"16d7f0d7-658d-4ce1-aa75-2892b078d91c\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:40:34 crc kubenswrapper[5120]: E0316 16:40:34.131736 5120 projected.go:194] Error preparing data for projected volume kube-api-access-w8b8b for pod openstack-kuttl-tests/openstackclient: failed to fetch token: serviceaccounts "openstackclient-openstackclient" is forbidden: the UID in the bound object reference (16d7f0d7-658d-4ce1-aa75-2892b078d91c) does not match the UID in record. The object might have been deleted and then recreated Mar 16 16:40:34 crc kubenswrapper[5120]: E0316 16:40:34.131813 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/16d7f0d7-658d-4ce1-aa75-2892b078d91c-kube-api-access-w8b8b podName:16d7f0d7-658d-4ce1-aa75-2892b078d91c nodeName:}" failed. No retries permitted until 2026-03-16 16:40:34.631796548 +0000 UTC m=+4136.785728205 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-w8b8b" (UniqueName: "kubernetes.io/projected/16d7f0d7-658d-4ce1-aa75-2892b078d91c-kube-api-access-w8b8b") pod "openstackclient" (UID: "16d7f0d7-658d-4ce1-aa75-2892b078d91c") : failed to fetch token: serviceaccounts "openstackclient-openstackclient" is forbidden: the UID in the bound object reference (16d7f0d7-658d-4ce1-aa75-2892b078d91c) does not match the UID in record. The object might have been deleted and then recreated Mar 16 16:40:34 crc kubenswrapper[5120]: I0316 16:40:34.134987 5120 scope.go:117] "RemoveContainer" containerID="352145ddc81c9667c8c20eb76dca8937936777645b2daca8321845282269bd64" Mar 16 16:40:34 crc kubenswrapper[5120]: I0316 16:40:34.139199 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/16d7f0d7-658d-4ce1-aa75-2892b078d91c-openstack-config-secret\") pod \"openstackclient\" (UID: \"16d7f0d7-658d-4ce1-aa75-2892b078d91c\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:40:34 crc kubenswrapper[5120]: I0316 16:40:34.139356 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/16d7f0d7-658d-4ce1-aa75-2892b078d91c-combined-ca-bundle\") pod \"openstackclient\" (UID: \"16d7f0d7-658d-4ce1-aa75-2892b078d91c\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:40:34 crc kubenswrapper[5120]: I0316 16:40:34.166670 5120 scope.go:117] "RemoveContainer" containerID="580ba5e6ec51e7055a14fa3afa5c3881995cac61570ad545bbe7467fac11d8df" Mar 16 16:40:34 crc kubenswrapper[5120]: I0316 16:40:34.231165 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/591ce862-489c-49f7-8dbd-500414032fd9-combined-ca-bundle\") pod \"openstackclient\" (UID: \"591ce862-489c-49f7-8dbd-500414032fd9\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:40:34 crc kubenswrapper[5120]: I0316 16:40:34.231521 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f4kwn\" (UniqueName: \"kubernetes.io/projected/591ce862-489c-49f7-8dbd-500414032fd9-kube-api-access-f4kwn\") pod \"openstackclient\" (UID: \"591ce862-489c-49f7-8dbd-500414032fd9\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:40:34 crc kubenswrapper[5120]: I0316 16:40:34.231549 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/591ce862-489c-49f7-8dbd-500414032fd9-openstack-config-secret\") pod \"openstackclient\" (UID: \"591ce862-489c-49f7-8dbd-500414032fd9\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:40:34 crc kubenswrapper[5120]: I0316 16:40:34.231648 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/591ce862-489c-49f7-8dbd-500414032fd9-openstack-config\") pod \"openstackclient\" (UID: \"591ce862-489c-49f7-8dbd-500414032fd9\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:40:34 crc kubenswrapper[5120]: I0316 16:40:34.232406 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/591ce862-489c-49f7-8dbd-500414032fd9-openstack-config\") pod \"openstackclient\" (UID: \"591ce862-489c-49f7-8dbd-500414032fd9\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:40:34 crc kubenswrapper[5120]: I0316 16:40:34.236294 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/591ce862-489c-49f7-8dbd-500414032fd9-openstack-config-secret\") pod \"openstackclient\" (UID: \"591ce862-489c-49f7-8dbd-500414032fd9\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:40:34 crc kubenswrapper[5120]: I0316 16:40:34.238312 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/591ce862-489c-49f7-8dbd-500414032fd9-combined-ca-bundle\") pod \"openstackclient\" (UID: \"591ce862-489c-49f7-8dbd-500414032fd9\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:40:34 crc kubenswrapper[5120]: I0316 16:40:34.250365 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4kwn\" (UniqueName: \"kubernetes.io/projected/591ce862-489c-49f7-8dbd-500414032fd9-kube-api-access-f4kwn\") pod \"openstackclient\" (UID: \"591ce862-489c-49f7-8dbd-500414032fd9\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:40:34 crc kubenswrapper[5120]: I0316 16:40:34.260578 5120 scope.go:117] "RemoveContainer" containerID="2f0197921197297f3b4a375ee9279f84519da583a740b60f6bf4262e900e44be" Mar 16 16:40:34 crc kubenswrapper[5120]: I0316 16:40:34.282633 5120 scope.go:117] "RemoveContainer" containerID="a892fc7bbd72e1b6b01130437df347bf98d1ecea87ce341b1e3fe9e9257246a9" Mar 16 16:40:34 crc kubenswrapper[5120]: I0316 16:40:34.306541 5120 scope.go:117] "RemoveContainer" containerID="46ccaf02befecb80356a3298d07b3fe888196e2a5b4f748f7f46d129cc9dc198" Mar 16 16:40:34 crc kubenswrapper[5120]: I0316 16:40:34.365325 5120 scope.go:117] "RemoveContainer" containerID="1d054768b62c314b704f4287a575c43e550c03ae01ecc0e24f377fdbbace0e63" Mar 16 16:40:34 crc kubenswrapper[5120]: I0316 16:40:34.372486 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-hsqcg" event={"ID":"af070f63-f3d9-44e0-b864-95e2f297f2e1","Type":"ContainerStarted","Data":"b0c9836b468fc3d612095cc86b493da62c47d8317532633ef9ee519e0ca2cfba"} Mar 16 16:40:34 crc kubenswrapper[5120]: I0316 16:40:34.379707 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Mar 16 16:40:34 crc kubenswrapper[5120]: I0316 16:40:34.386780 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Mar 16 16:40:34 crc kubenswrapper[5120]: I0316 16:40:34.395535 5120 status_manager.go:905] "Pod was deleted and then recreated, skipping status update" pod="openstack-kuttl-tests/openstackclient" oldPodUID="16d7f0d7-658d-4ce1-aa75-2892b078d91c" podUID="591ce862-489c-49f7-8dbd-500414032fd9" Mar 16 16:40:34 crc kubenswrapper[5120]: I0316 16:40:34.401042 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Mar 16 16:40:34 crc kubenswrapper[5120]: I0316 16:40:34.403663 5120 status_manager.go:905] "Pod was deleted and then recreated, skipping status update" pod="openstack-kuttl-tests/openstackclient" oldPodUID="16d7f0d7-658d-4ce1-aa75-2892b078d91c" podUID="591ce862-489c-49f7-8dbd-500414032fd9" Mar 16 16:40:34 crc kubenswrapper[5120]: I0316 16:40:34.542217 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/16d7f0d7-658d-4ce1-aa75-2892b078d91c-combined-ca-bundle\") pod \"16d7f0d7-658d-4ce1-aa75-2892b078d91c\" (UID: \"16d7f0d7-658d-4ce1-aa75-2892b078d91c\") " Mar 16 16:40:34 crc kubenswrapper[5120]: I0316 16:40:34.542307 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/16d7f0d7-658d-4ce1-aa75-2892b078d91c-openstack-config\") pod \"16d7f0d7-658d-4ce1-aa75-2892b078d91c\" (UID: \"16d7f0d7-658d-4ce1-aa75-2892b078d91c\") " Mar 16 16:40:34 crc kubenswrapper[5120]: I0316 16:40:34.542525 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/16d7f0d7-658d-4ce1-aa75-2892b078d91c-openstack-config-secret\") pod \"16d7f0d7-658d-4ce1-aa75-2892b078d91c\" (UID: \"16d7f0d7-658d-4ce1-aa75-2892b078d91c\") " Mar 16 16:40:34 crc kubenswrapper[5120]: I0316 16:40:34.543368 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w8b8b\" (UniqueName: \"kubernetes.io/projected/16d7f0d7-658d-4ce1-aa75-2892b078d91c-kube-api-access-w8b8b\") on node \"crc\" DevicePath \"\"" Mar 16 16:40:34 crc kubenswrapper[5120]: I0316 16:40:34.547346 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/16d7f0d7-658d-4ce1-aa75-2892b078d91c-openstack-config" (OuterVolumeSpecName: "openstack-config") pod "16d7f0d7-658d-4ce1-aa75-2892b078d91c" (UID: "16d7f0d7-658d-4ce1-aa75-2892b078d91c"). InnerVolumeSpecName "openstack-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:40:34 crc kubenswrapper[5120]: I0316 16:40:34.552748 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/16d7f0d7-658d-4ce1-aa75-2892b078d91c-openstack-config-secret" (OuterVolumeSpecName: "openstack-config-secret") pod "16d7f0d7-658d-4ce1-aa75-2892b078d91c" (UID: "16d7f0d7-658d-4ce1-aa75-2892b078d91c"). InnerVolumeSpecName "openstack-config-secret". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:40:34 crc kubenswrapper[5120]: I0316 16:40:34.556561 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/16d7f0d7-658d-4ce1-aa75-2892b078d91c-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "16d7f0d7-658d-4ce1-aa75-2892b078d91c" (UID: "16d7f0d7-658d-4ce1-aa75-2892b078d91c"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:40:34 crc kubenswrapper[5120]: I0316 16:40:34.645402 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/16d7f0d7-658d-4ce1-aa75-2892b078d91c-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:40:34 crc kubenswrapper[5120]: I0316 16:40:34.645428 5120 reconciler_common.go:299] "Volume detached for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/16d7f0d7-658d-4ce1-aa75-2892b078d91c-openstack-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:40:34 crc kubenswrapper[5120]: I0316 16:40:34.645438 5120 reconciler_common.go:299] "Volume detached for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/16d7f0d7-658d-4ce1-aa75-2892b078d91c-openstack-config-secret\") on node \"crc\" DevicePath \"\"" Mar 16 16:40:34 crc kubenswrapper[5120]: I0316 16:40:34.677710 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="16d7f0d7-658d-4ce1-aa75-2892b078d91c" path="/var/lib/kubelet/pods/16d7f0d7-658d-4ce1-aa75-2892b078d91c/volumes" Mar 16 16:40:34 crc kubenswrapper[5120]: I0316 16:40:34.897720 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 16:40:34 crc kubenswrapper[5120]: W0316 16:40:34.939483 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod591ce862_489c_49f7_8dbd_500414032fd9.slice/crio-92745b065ba3ca10209204a58d88aadb1fd1796fed232cde941f01aa1d2c17a3 WatchSource:0}: Error finding container 92745b065ba3ca10209204a58d88aadb1fd1796fed232cde941f01aa1d2c17a3: Status 404 returned error can't find the container with id 92745b065ba3ca10209204a58d88aadb1fd1796fed232cde941f01aa1d2c17a3 Mar 16 16:40:35 crc kubenswrapper[5120]: I0316 16:40:35.391883 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstackclient" event={"ID":"591ce862-489c-49f7-8dbd-500414032fd9","Type":"ContainerStarted","Data":"92745b065ba3ca10209204a58d88aadb1fd1796fed232cde941f01aa1d2c17a3"} Mar 16 16:40:35 crc kubenswrapper[5120]: I0316 16:40:35.392577 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Mar 16 16:40:35 crc kubenswrapper[5120]: I0316 16:40:35.394921 5120 status_manager.go:905] "Pod was deleted and then recreated, skipping status update" pod="openstack-kuttl-tests/openstackclient" oldPodUID="16d7f0d7-658d-4ce1-aa75-2892b078d91c" podUID="591ce862-489c-49f7-8dbd-500414032fd9" Mar 16 16:40:35 crc kubenswrapper[5120]: I0316 16:40:35.401051 5120 status_manager.go:905] "Pod was deleted and then recreated, skipping status update" pod="openstack-kuttl-tests/openstackclient" oldPodUID="16d7f0d7-658d-4ce1-aa75-2892b078d91c" podUID="591ce862-489c-49f7-8dbd-500414032fd9" Mar 16 16:40:36 crc kubenswrapper[5120]: I0316 16:40:36.407067 5120 generic.go:358] "Generic (PLEG): container finished" podID="af070f63-f3d9-44e0-b864-95e2f297f2e1" containerID="b0c9836b468fc3d612095cc86b493da62c47d8317532633ef9ee519e0ca2cfba" exitCode=0 Mar 16 16:40:36 crc kubenswrapper[5120]: I0316 16:40:36.407358 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-hsqcg" event={"ID":"af070f63-f3d9-44e0-b864-95e2f297f2e1","Type":"ContainerDied","Data":"b0c9836b468fc3d612095cc86b493da62c47d8317532633ef9ee519e0ca2cfba"} Mar 16 16:40:36 crc kubenswrapper[5120]: I0316 16:40:36.413527 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstackclient" event={"ID":"591ce862-489c-49f7-8dbd-500414032fd9","Type":"ContainerStarted","Data":"9419bd0a11a06fc46b0997e1cd23e133bfc77036683ad12a18f8a766d86ab63e"} Mar 16 16:40:36 crc kubenswrapper[5120]: I0316 16:40:36.506940 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstackclient" podStartSLOduration=3.506918651 podStartE2EDuration="3.506918651s" podCreationTimestamp="2026-03-16 16:40:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:40:36.503328943 +0000 UTC m=+4138.657260600" watchObservedRunningTime="2026-03-16 16:40:36.506918651 +0000 UTC m=+4138.660850338" Mar 16 16:40:36 crc kubenswrapper[5120]: I0316 16:40:36.611373 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/neutron-59869bff69-qcf89" Mar 16 16:40:37 crc kubenswrapper[5120]: I0316 16:40:37.428932 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-hsqcg" event={"ID":"af070f63-f3d9-44e0-b864-95e2f297f2e1","Type":"ContainerStarted","Data":"108f464545c555f40b9e9f0ca47ba66b1306399a8b4283b3327e52f10bc4683f"} Mar 16 16:40:37 crc kubenswrapper[5120]: I0316 16:40:37.451742 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/redhat-operators-hsqcg" podStartSLOduration=5.795780768 podStartE2EDuration="13.451725244s" podCreationTimestamp="2026-03-16 16:40:24 +0000 UTC" firstStartedPulling="2026-03-16 16:40:26.252512411 +0000 UTC m=+4128.406444068" lastFinishedPulling="2026-03-16 16:40:33.908456887 +0000 UTC m=+4136.062388544" observedRunningTime="2026-03-16 16:40:37.447186 +0000 UTC m=+4139.601117667" watchObservedRunningTime="2026-03-16 16:40:37.451725244 +0000 UTC m=+4139.605656901" Mar 16 16:40:38 crc kubenswrapper[5120]: I0316 16:40:38.769394 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:40:39 crc kubenswrapper[5120]: I0316 16:40:39.341556 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/swift-proxy-85dfc87f54-wb22t"] Mar 16 16:40:39 crc kubenswrapper[5120]: I0316 16:40:39.351088 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-85dfc87f54-wb22t" Mar 16 16:40:39 crc kubenswrapper[5120]: I0316 16:40:39.357170 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"swift-proxy-config-data\"" Mar 16 16:40:39 crc kubenswrapper[5120]: I0316 16:40:39.357384 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-swift-public-svc\"" Mar 16 16:40:39 crc kubenswrapper[5120]: I0316 16:40:39.357572 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-swift-internal-svc\"" Mar 16 16:40:39 crc kubenswrapper[5120]: I0316 16:40:39.365380 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-proxy-85dfc87f54-wb22t"] Mar 16 16:40:39 crc kubenswrapper[5120]: I0316 16:40:39.475386 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8b100760-cd10-47f9-a43a-5ec03d37d1f0-combined-ca-bundle\") pod \"swift-proxy-85dfc87f54-wb22t\" (UID: \"8b100760-cd10-47f9-a43a-5ec03d37d1f0\") " pod="openstack-kuttl-tests/swift-proxy-85dfc87f54-wb22t" Mar 16 16:40:39 crc kubenswrapper[5120]: I0316 16:40:39.475431 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m26xx\" (UniqueName: \"kubernetes.io/projected/8b100760-cd10-47f9-a43a-5ec03d37d1f0-kube-api-access-m26xx\") pod \"swift-proxy-85dfc87f54-wb22t\" (UID: \"8b100760-cd10-47f9-a43a-5ec03d37d1f0\") " pod="openstack-kuttl-tests/swift-proxy-85dfc87f54-wb22t" Mar 16 16:40:39 crc kubenswrapper[5120]: I0316 16:40:39.475519 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8b100760-cd10-47f9-a43a-5ec03d37d1f0-config-data\") pod \"swift-proxy-85dfc87f54-wb22t\" (UID: \"8b100760-cd10-47f9-a43a-5ec03d37d1f0\") " pod="openstack-kuttl-tests/swift-proxy-85dfc87f54-wb22t" Mar 16 16:40:39 crc kubenswrapper[5120]: I0316 16:40:39.475567 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/8b100760-cd10-47f9-a43a-5ec03d37d1f0-public-tls-certs\") pod \"swift-proxy-85dfc87f54-wb22t\" (UID: \"8b100760-cd10-47f9-a43a-5ec03d37d1f0\") " pod="openstack-kuttl-tests/swift-proxy-85dfc87f54-wb22t" Mar 16 16:40:39 crc kubenswrapper[5120]: I0316 16:40:39.475583 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/8b100760-cd10-47f9-a43a-5ec03d37d1f0-internal-tls-certs\") pod \"swift-proxy-85dfc87f54-wb22t\" (UID: \"8b100760-cd10-47f9-a43a-5ec03d37d1f0\") " pod="openstack-kuttl-tests/swift-proxy-85dfc87f54-wb22t" Mar 16 16:40:39 crc kubenswrapper[5120]: I0316 16:40:39.475601 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/8b100760-cd10-47f9-a43a-5ec03d37d1f0-etc-swift\") pod \"swift-proxy-85dfc87f54-wb22t\" (UID: \"8b100760-cd10-47f9-a43a-5ec03d37d1f0\") " pod="openstack-kuttl-tests/swift-proxy-85dfc87f54-wb22t" Mar 16 16:40:39 crc kubenswrapper[5120]: I0316 16:40:39.475619 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/8b100760-cd10-47f9-a43a-5ec03d37d1f0-log-httpd\") pod \"swift-proxy-85dfc87f54-wb22t\" (UID: \"8b100760-cd10-47f9-a43a-5ec03d37d1f0\") " pod="openstack-kuttl-tests/swift-proxy-85dfc87f54-wb22t" Mar 16 16:40:39 crc kubenswrapper[5120]: I0316 16:40:39.475710 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/8b100760-cd10-47f9-a43a-5ec03d37d1f0-run-httpd\") pod \"swift-proxy-85dfc87f54-wb22t\" (UID: \"8b100760-cd10-47f9-a43a-5ec03d37d1f0\") " pod="openstack-kuttl-tests/swift-proxy-85dfc87f54-wb22t" Mar 16 16:40:39 crc kubenswrapper[5120]: I0316 16:40:39.577342 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/8b100760-cd10-47f9-a43a-5ec03d37d1f0-run-httpd\") pod \"swift-proxy-85dfc87f54-wb22t\" (UID: \"8b100760-cd10-47f9-a43a-5ec03d37d1f0\") " pod="openstack-kuttl-tests/swift-proxy-85dfc87f54-wb22t" Mar 16 16:40:39 crc kubenswrapper[5120]: I0316 16:40:39.577512 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8b100760-cd10-47f9-a43a-5ec03d37d1f0-combined-ca-bundle\") pod \"swift-proxy-85dfc87f54-wb22t\" (UID: \"8b100760-cd10-47f9-a43a-5ec03d37d1f0\") " pod="openstack-kuttl-tests/swift-proxy-85dfc87f54-wb22t" Mar 16 16:40:39 crc kubenswrapper[5120]: I0316 16:40:39.577539 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m26xx\" (UniqueName: \"kubernetes.io/projected/8b100760-cd10-47f9-a43a-5ec03d37d1f0-kube-api-access-m26xx\") pod \"swift-proxy-85dfc87f54-wb22t\" (UID: \"8b100760-cd10-47f9-a43a-5ec03d37d1f0\") " pod="openstack-kuttl-tests/swift-proxy-85dfc87f54-wb22t" Mar 16 16:40:39 crc kubenswrapper[5120]: I0316 16:40:39.577620 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8b100760-cd10-47f9-a43a-5ec03d37d1f0-config-data\") pod \"swift-proxy-85dfc87f54-wb22t\" (UID: \"8b100760-cd10-47f9-a43a-5ec03d37d1f0\") " pod="openstack-kuttl-tests/swift-proxy-85dfc87f54-wb22t" Mar 16 16:40:39 crc kubenswrapper[5120]: I0316 16:40:39.577683 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/8b100760-cd10-47f9-a43a-5ec03d37d1f0-public-tls-certs\") pod \"swift-proxy-85dfc87f54-wb22t\" (UID: \"8b100760-cd10-47f9-a43a-5ec03d37d1f0\") " pod="openstack-kuttl-tests/swift-proxy-85dfc87f54-wb22t" Mar 16 16:40:39 crc kubenswrapper[5120]: I0316 16:40:39.577706 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/8b100760-cd10-47f9-a43a-5ec03d37d1f0-internal-tls-certs\") pod \"swift-proxy-85dfc87f54-wb22t\" (UID: \"8b100760-cd10-47f9-a43a-5ec03d37d1f0\") " pod="openstack-kuttl-tests/swift-proxy-85dfc87f54-wb22t" Mar 16 16:40:39 crc kubenswrapper[5120]: I0316 16:40:39.577728 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/8b100760-cd10-47f9-a43a-5ec03d37d1f0-etc-swift\") pod \"swift-proxy-85dfc87f54-wb22t\" (UID: \"8b100760-cd10-47f9-a43a-5ec03d37d1f0\") " pod="openstack-kuttl-tests/swift-proxy-85dfc87f54-wb22t" Mar 16 16:40:39 crc kubenswrapper[5120]: I0316 16:40:39.577866 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/8b100760-cd10-47f9-a43a-5ec03d37d1f0-run-httpd\") pod \"swift-proxy-85dfc87f54-wb22t\" (UID: \"8b100760-cd10-47f9-a43a-5ec03d37d1f0\") " pod="openstack-kuttl-tests/swift-proxy-85dfc87f54-wb22t" Mar 16 16:40:39 crc kubenswrapper[5120]: I0316 16:40:39.577974 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/8b100760-cd10-47f9-a43a-5ec03d37d1f0-log-httpd\") pod \"swift-proxy-85dfc87f54-wb22t\" (UID: \"8b100760-cd10-47f9-a43a-5ec03d37d1f0\") " pod="openstack-kuttl-tests/swift-proxy-85dfc87f54-wb22t" Mar 16 16:40:39 crc kubenswrapper[5120]: I0316 16:40:39.578463 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/8b100760-cd10-47f9-a43a-5ec03d37d1f0-log-httpd\") pod \"swift-proxy-85dfc87f54-wb22t\" (UID: \"8b100760-cd10-47f9-a43a-5ec03d37d1f0\") " pod="openstack-kuttl-tests/swift-proxy-85dfc87f54-wb22t" Mar 16 16:40:39 crc kubenswrapper[5120]: I0316 16:40:39.583869 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8b100760-cd10-47f9-a43a-5ec03d37d1f0-combined-ca-bundle\") pod \"swift-proxy-85dfc87f54-wb22t\" (UID: \"8b100760-cd10-47f9-a43a-5ec03d37d1f0\") " pod="openstack-kuttl-tests/swift-proxy-85dfc87f54-wb22t" Mar 16 16:40:39 crc kubenswrapper[5120]: I0316 16:40:39.585079 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/8b100760-cd10-47f9-a43a-5ec03d37d1f0-internal-tls-certs\") pod \"swift-proxy-85dfc87f54-wb22t\" (UID: \"8b100760-cd10-47f9-a43a-5ec03d37d1f0\") " pod="openstack-kuttl-tests/swift-proxy-85dfc87f54-wb22t" Mar 16 16:40:39 crc kubenswrapper[5120]: I0316 16:40:39.585236 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/8b100760-cd10-47f9-a43a-5ec03d37d1f0-public-tls-certs\") pod \"swift-proxy-85dfc87f54-wb22t\" (UID: \"8b100760-cd10-47f9-a43a-5ec03d37d1f0\") " pod="openstack-kuttl-tests/swift-proxy-85dfc87f54-wb22t" Mar 16 16:40:39 crc kubenswrapper[5120]: I0316 16:40:39.592498 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/8b100760-cd10-47f9-a43a-5ec03d37d1f0-etc-swift\") pod \"swift-proxy-85dfc87f54-wb22t\" (UID: \"8b100760-cd10-47f9-a43a-5ec03d37d1f0\") " pod="openstack-kuttl-tests/swift-proxy-85dfc87f54-wb22t" Mar 16 16:40:39 crc kubenswrapper[5120]: I0316 16:40:39.594379 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8b100760-cd10-47f9-a43a-5ec03d37d1f0-config-data\") pod \"swift-proxy-85dfc87f54-wb22t\" (UID: \"8b100760-cd10-47f9-a43a-5ec03d37d1f0\") " pod="openstack-kuttl-tests/swift-proxy-85dfc87f54-wb22t" Mar 16 16:40:39 crc kubenswrapper[5120]: I0316 16:40:39.594929 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m26xx\" (UniqueName: \"kubernetes.io/projected/8b100760-cd10-47f9-a43a-5ec03d37d1f0-kube-api-access-m26xx\") pod \"swift-proxy-85dfc87f54-wb22t\" (UID: \"8b100760-cd10-47f9-a43a-5ec03d37d1f0\") " pod="openstack-kuttl-tests/swift-proxy-85dfc87f54-wb22t" Mar 16 16:40:39 crc kubenswrapper[5120]: I0316 16:40:39.684686 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-85dfc87f54-wb22t" Mar 16 16:40:39 crc kubenswrapper[5120]: I0316 16:40:39.776879 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:40:39 crc kubenswrapper[5120]: I0316 16:40:39.777147 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="da8c9ee6-9520-4597-a4cb-d06ea1d0772c" containerName="ceilometer-central-agent" containerID="cri-o://b4b4cc9a667d73f04554e4fc969d14f8329c6ff61c1a4e019385ab1dcb69a8be" gracePeriod=30 Mar 16 16:40:39 crc kubenswrapper[5120]: I0316 16:40:39.777227 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="da8c9ee6-9520-4597-a4cb-d06ea1d0772c" containerName="proxy-httpd" containerID="cri-o://18117d315c2cfe422e993c1304b517b8faf736bf44afe60a74b05e1897dff94b" gracePeriod=30 Mar 16 16:40:39 crc kubenswrapper[5120]: I0316 16:40:39.777253 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="da8c9ee6-9520-4597-a4cb-d06ea1d0772c" containerName="sg-core" containerID="cri-o://0c24a2cf831a56044129b5e00c3ffa6d2a4f5feaefdbc0c7745f5bdd47797bd6" gracePeriod=30 Mar 16 16:40:39 crc kubenswrapper[5120]: I0316 16:40:39.777300 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="da8c9ee6-9520-4597-a4cb-d06ea1d0772c" containerName="ceilometer-notification-agent" containerID="cri-o://38d72b73341317e1cd4e4a5501014a3bd1db89eb530efd6c0e87d6c1a90cb693" gracePeriod=30 Mar 16 16:40:39 crc kubenswrapper[5120]: I0316 16:40:39.798333 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/neutron-76647d7b7d-c7dsx" Mar 16 16:40:39 crc kubenswrapper[5120]: I0316 16:40:39.870776 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-59869bff69-qcf89"] Mar 16 16:40:39 crc kubenswrapper[5120]: I0316 16:40:39.871047 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-59869bff69-qcf89" podUID="3b25da8f-df4b-4367-884e-abd3b1d6527e" containerName="neutron-api" containerID="cri-o://f1ab4c0f8022fb9de6575ab45267b97aab998eaf187857960ccdb6e8bc399b34" gracePeriod=30 Mar 16 16:40:39 crc kubenswrapper[5120]: I0316 16:40:39.871466 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-59869bff69-qcf89" podUID="3b25da8f-df4b-4367-884e-abd3b1d6527e" containerName="neutron-httpd" containerID="cri-o://8366512f8d2ec85fe213332aee553881ed2d4ea0d3fb8d28ef0e2ebdf3d9863d" gracePeriod=30 Mar 16 16:40:40 crc kubenswrapper[5120]: I0316 16:40:40.240643 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-proxy-85dfc87f54-wb22t"] Mar 16 16:40:40 crc kubenswrapper[5120]: W0316 16:40:40.247465 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8b100760_cd10_47f9_a43a_5ec03d37d1f0.slice/crio-f0a30b36b3e2d65cc2aabd08dcd653261520ae7e42fabe02d636711e1772151f WatchSource:0}: Error finding container f0a30b36b3e2d65cc2aabd08dcd653261520ae7e42fabe02d636711e1772151f: Status 404 returned error can't find the container with id f0a30b36b3e2d65cc2aabd08dcd653261520ae7e42fabe02d636711e1772151f Mar 16 16:40:40 crc kubenswrapper[5120]: I0316 16:40:40.460582 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-85dfc87f54-wb22t" event={"ID":"8b100760-cd10-47f9-a43a-5ec03d37d1f0","Type":"ContainerStarted","Data":"f0a30b36b3e2d65cc2aabd08dcd653261520ae7e42fabe02d636711e1772151f"} Mar 16 16:40:40 crc kubenswrapper[5120]: I0316 16:40:40.467225 5120 generic.go:358] "Generic (PLEG): container finished" podID="3b25da8f-df4b-4367-884e-abd3b1d6527e" containerID="8366512f8d2ec85fe213332aee553881ed2d4ea0d3fb8d28ef0e2ebdf3d9863d" exitCode=0 Mar 16 16:40:40 crc kubenswrapper[5120]: I0316 16:40:40.467578 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-59869bff69-qcf89" event={"ID":"3b25da8f-df4b-4367-884e-abd3b1d6527e","Type":"ContainerDied","Data":"8366512f8d2ec85fe213332aee553881ed2d4ea0d3fb8d28ef0e2ebdf3d9863d"} Mar 16 16:40:40 crc kubenswrapper[5120]: I0316 16:40:40.470975 5120 generic.go:358] "Generic (PLEG): container finished" podID="da8c9ee6-9520-4597-a4cb-d06ea1d0772c" containerID="18117d315c2cfe422e993c1304b517b8faf736bf44afe60a74b05e1897dff94b" exitCode=0 Mar 16 16:40:40 crc kubenswrapper[5120]: I0316 16:40:40.471007 5120 generic.go:358] "Generic (PLEG): container finished" podID="da8c9ee6-9520-4597-a4cb-d06ea1d0772c" containerID="0c24a2cf831a56044129b5e00c3ffa6d2a4f5feaefdbc0c7745f5bdd47797bd6" exitCode=2 Mar 16 16:40:40 crc kubenswrapper[5120]: I0316 16:40:40.471109 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"da8c9ee6-9520-4597-a4cb-d06ea1d0772c","Type":"ContainerDied","Data":"18117d315c2cfe422e993c1304b517b8faf736bf44afe60a74b05e1897dff94b"} Mar 16 16:40:40 crc kubenswrapper[5120]: I0316 16:40:40.471127 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"da8c9ee6-9520-4597-a4cb-d06ea1d0772c","Type":"ContainerDied","Data":"0c24a2cf831a56044129b5e00c3ffa6d2a4f5feaefdbc0c7745f5bdd47797bd6"} Mar 16 16:40:41 crc kubenswrapper[5120]: I0316 16:40:41.271492 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:40:41 crc kubenswrapper[5120]: I0316 16:40:41.436498 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/da8c9ee6-9520-4597-a4cb-d06ea1d0772c-run-httpd\") pod \"da8c9ee6-9520-4597-a4cb-d06ea1d0772c\" (UID: \"da8c9ee6-9520-4597-a4cb-d06ea1d0772c\") " Mar 16 16:40:41 crc kubenswrapper[5120]: I0316 16:40:41.436788 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/da8c9ee6-9520-4597-a4cb-d06ea1d0772c-log-httpd\") pod \"da8c9ee6-9520-4597-a4cb-d06ea1d0772c\" (UID: \"da8c9ee6-9520-4597-a4cb-d06ea1d0772c\") " Mar 16 16:40:41 crc kubenswrapper[5120]: I0316 16:40:41.436867 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d5n4c\" (UniqueName: \"kubernetes.io/projected/da8c9ee6-9520-4597-a4cb-d06ea1d0772c-kube-api-access-d5n4c\") pod \"da8c9ee6-9520-4597-a4cb-d06ea1d0772c\" (UID: \"da8c9ee6-9520-4597-a4cb-d06ea1d0772c\") " Mar 16 16:40:41 crc kubenswrapper[5120]: I0316 16:40:41.436905 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/da8c9ee6-9520-4597-a4cb-d06ea1d0772c-scripts\") pod \"da8c9ee6-9520-4597-a4cb-d06ea1d0772c\" (UID: \"da8c9ee6-9520-4597-a4cb-d06ea1d0772c\") " Mar 16 16:40:41 crc kubenswrapper[5120]: I0316 16:40:41.436998 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da8c9ee6-9520-4597-a4cb-d06ea1d0772c-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "da8c9ee6-9520-4597-a4cb-d06ea1d0772c" (UID: "da8c9ee6-9520-4597-a4cb-d06ea1d0772c"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:40:41 crc kubenswrapper[5120]: I0316 16:40:41.437209 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/da8c9ee6-9520-4597-a4cb-d06ea1d0772c-combined-ca-bundle\") pod \"da8c9ee6-9520-4597-a4cb-d06ea1d0772c\" (UID: \"da8c9ee6-9520-4597-a4cb-d06ea1d0772c\") " Mar 16 16:40:41 crc kubenswrapper[5120]: I0316 16:40:41.437302 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/da8c9ee6-9520-4597-a4cb-d06ea1d0772c-sg-core-conf-yaml\") pod \"da8c9ee6-9520-4597-a4cb-d06ea1d0772c\" (UID: \"da8c9ee6-9520-4597-a4cb-d06ea1d0772c\") " Mar 16 16:40:41 crc kubenswrapper[5120]: I0316 16:40:41.437414 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/da8c9ee6-9520-4597-a4cb-d06ea1d0772c-config-data\") pod \"da8c9ee6-9520-4597-a4cb-d06ea1d0772c\" (UID: \"da8c9ee6-9520-4597-a4cb-d06ea1d0772c\") " Mar 16 16:40:41 crc kubenswrapper[5120]: I0316 16:40:41.437467 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da8c9ee6-9520-4597-a4cb-d06ea1d0772c-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "da8c9ee6-9520-4597-a4cb-d06ea1d0772c" (UID: "da8c9ee6-9520-4597-a4cb-d06ea1d0772c"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:40:41 crc kubenswrapper[5120]: I0316 16:40:41.438613 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/da8c9ee6-9520-4597-a4cb-d06ea1d0772c-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:40:41 crc kubenswrapper[5120]: I0316 16:40:41.438646 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/da8c9ee6-9520-4597-a4cb-d06ea1d0772c-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:40:41 crc kubenswrapper[5120]: I0316 16:40:41.442673 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da8c9ee6-9520-4597-a4cb-d06ea1d0772c-scripts" (OuterVolumeSpecName: "scripts") pod "da8c9ee6-9520-4597-a4cb-d06ea1d0772c" (UID: "da8c9ee6-9520-4597-a4cb-d06ea1d0772c"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:40:41 crc kubenswrapper[5120]: I0316 16:40:41.443078 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da8c9ee6-9520-4597-a4cb-d06ea1d0772c-kube-api-access-d5n4c" (OuterVolumeSpecName: "kube-api-access-d5n4c") pod "da8c9ee6-9520-4597-a4cb-d06ea1d0772c" (UID: "da8c9ee6-9520-4597-a4cb-d06ea1d0772c"). InnerVolumeSpecName "kube-api-access-d5n4c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:40:41 crc kubenswrapper[5120]: I0316 16:40:41.466474 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da8c9ee6-9520-4597-a4cb-d06ea1d0772c-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "da8c9ee6-9520-4597-a4cb-d06ea1d0772c" (UID: "da8c9ee6-9520-4597-a4cb-d06ea1d0772c"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:40:41 crc kubenswrapper[5120]: I0316 16:40:41.485085 5120 generic.go:358] "Generic (PLEG): container finished" podID="da8c9ee6-9520-4597-a4cb-d06ea1d0772c" containerID="38d72b73341317e1cd4e4a5501014a3bd1db89eb530efd6c0e87d6c1a90cb693" exitCode=0 Mar 16 16:40:41 crc kubenswrapper[5120]: I0316 16:40:41.485116 5120 generic.go:358] "Generic (PLEG): container finished" podID="da8c9ee6-9520-4597-a4cb-d06ea1d0772c" containerID="b4b4cc9a667d73f04554e4fc969d14f8329c6ff61c1a4e019385ab1dcb69a8be" exitCode=0 Mar 16 16:40:41 crc kubenswrapper[5120]: I0316 16:40:41.485255 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"da8c9ee6-9520-4597-a4cb-d06ea1d0772c","Type":"ContainerDied","Data":"38d72b73341317e1cd4e4a5501014a3bd1db89eb530efd6c0e87d6c1a90cb693"} Mar 16 16:40:41 crc kubenswrapper[5120]: I0316 16:40:41.485280 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"da8c9ee6-9520-4597-a4cb-d06ea1d0772c","Type":"ContainerDied","Data":"b4b4cc9a667d73f04554e4fc969d14f8329c6ff61c1a4e019385ab1dcb69a8be"} Mar 16 16:40:41 crc kubenswrapper[5120]: I0316 16:40:41.485290 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"da8c9ee6-9520-4597-a4cb-d06ea1d0772c","Type":"ContainerDied","Data":"82b1f6a8defd07de43914b235b6db4ae0a71147bc4dde5120a143ef84c89d97b"} Mar 16 16:40:41 crc kubenswrapper[5120]: I0316 16:40:41.485304 5120 scope.go:117] "RemoveContainer" containerID="18117d315c2cfe422e993c1304b517b8faf736bf44afe60a74b05e1897dff94b" Mar 16 16:40:41 crc kubenswrapper[5120]: I0316 16:40:41.485438 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:40:41 crc kubenswrapper[5120]: I0316 16:40:41.497165 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-85dfc87f54-wb22t" event={"ID":"8b100760-cd10-47f9-a43a-5ec03d37d1f0","Type":"ContainerStarted","Data":"282f23ab5ef97d358995d576d4ee6905b00545215df4cf40077d61084f39584a"} Mar 16 16:40:41 crc kubenswrapper[5120]: I0316 16:40:41.497206 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-85dfc87f54-wb22t" event={"ID":"8b100760-cd10-47f9-a43a-5ec03d37d1f0","Type":"ContainerStarted","Data":"edb00ca08ced509f776a6894383f6a1f894be3511cfd7b8aa96b49bebe445287"} Mar 16 16:40:41 crc kubenswrapper[5120]: I0316 16:40:41.497390 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/swift-proxy-85dfc87f54-wb22t" Mar 16 16:40:41 crc kubenswrapper[5120]: I0316 16:40:41.497437 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/swift-proxy-85dfc87f54-wb22t" Mar 16 16:40:41 crc kubenswrapper[5120]: I0316 16:40:41.532630 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/swift-proxy-85dfc87f54-wb22t" podStartSLOduration=2.53260703 podStartE2EDuration="2.53260703s" podCreationTimestamp="2026-03-16 16:40:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:40:41.520218264 +0000 UTC m=+4143.674149921" watchObservedRunningTime="2026-03-16 16:40:41.53260703 +0000 UTC m=+4143.686538727" Mar 16 16:40:41 crc kubenswrapper[5120]: I0316 16:40:41.540486 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/da8c9ee6-9520-4597-a4cb-d06ea1d0772c-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 16:40:41 crc kubenswrapper[5120]: I0316 16:40:41.540513 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d5n4c\" (UniqueName: \"kubernetes.io/projected/da8c9ee6-9520-4597-a4cb-d06ea1d0772c-kube-api-access-d5n4c\") on node \"crc\" DevicePath \"\"" Mar 16 16:40:41 crc kubenswrapper[5120]: I0316 16:40:41.540524 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/da8c9ee6-9520-4597-a4cb-d06ea1d0772c-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:40:41 crc kubenswrapper[5120]: I0316 16:40:41.542057 5120 scope.go:117] "RemoveContainer" containerID="0c24a2cf831a56044129b5e00c3ffa6d2a4f5feaefdbc0c7745f5bdd47797bd6" Mar 16 16:40:41 crc kubenswrapper[5120]: I0316 16:40:41.549402 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da8c9ee6-9520-4597-a4cb-d06ea1d0772c-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "da8c9ee6-9520-4597-a4cb-d06ea1d0772c" (UID: "da8c9ee6-9520-4597-a4cb-d06ea1d0772c"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:40:41 crc kubenswrapper[5120]: I0316 16:40:41.573605 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da8c9ee6-9520-4597-a4cb-d06ea1d0772c-config-data" (OuterVolumeSpecName: "config-data") pod "da8c9ee6-9520-4597-a4cb-d06ea1d0772c" (UID: "da8c9ee6-9520-4597-a4cb-d06ea1d0772c"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:40:41 crc kubenswrapper[5120]: I0316 16:40:41.579727 5120 scope.go:117] "RemoveContainer" containerID="38d72b73341317e1cd4e4a5501014a3bd1db89eb530efd6c0e87d6c1a90cb693" Mar 16 16:40:41 crc kubenswrapper[5120]: I0316 16:40:41.642339 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/da8c9ee6-9520-4597-a4cb-d06ea1d0772c-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:40:41 crc kubenswrapper[5120]: I0316 16:40:41.642367 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/da8c9ee6-9520-4597-a4cb-d06ea1d0772c-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:40:41 crc kubenswrapper[5120]: I0316 16:40:41.673043 5120 scope.go:117] "RemoveContainer" containerID="b4b4cc9a667d73f04554e4fc969d14f8329c6ff61c1a4e019385ab1dcb69a8be" Mar 16 16:40:41 crc kubenswrapper[5120]: I0316 16:40:41.694618 5120 scope.go:117] "RemoveContainer" containerID="18117d315c2cfe422e993c1304b517b8faf736bf44afe60a74b05e1897dff94b" Mar 16 16:40:41 crc kubenswrapper[5120]: E0316 16:40:41.695086 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"18117d315c2cfe422e993c1304b517b8faf736bf44afe60a74b05e1897dff94b\": container with ID starting with 18117d315c2cfe422e993c1304b517b8faf736bf44afe60a74b05e1897dff94b not found: ID does not exist" containerID="18117d315c2cfe422e993c1304b517b8faf736bf44afe60a74b05e1897dff94b" Mar 16 16:40:41 crc kubenswrapper[5120]: I0316 16:40:41.695131 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18117d315c2cfe422e993c1304b517b8faf736bf44afe60a74b05e1897dff94b"} err="failed to get container status \"18117d315c2cfe422e993c1304b517b8faf736bf44afe60a74b05e1897dff94b\": rpc error: code = NotFound desc = could not find container \"18117d315c2cfe422e993c1304b517b8faf736bf44afe60a74b05e1897dff94b\": container with ID starting with 18117d315c2cfe422e993c1304b517b8faf736bf44afe60a74b05e1897dff94b not found: ID does not exist" Mar 16 16:40:41 crc kubenswrapper[5120]: I0316 16:40:41.695159 5120 scope.go:117] "RemoveContainer" containerID="0c24a2cf831a56044129b5e00c3ffa6d2a4f5feaefdbc0c7745f5bdd47797bd6" Mar 16 16:40:41 crc kubenswrapper[5120]: E0316 16:40:41.695553 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c24a2cf831a56044129b5e00c3ffa6d2a4f5feaefdbc0c7745f5bdd47797bd6\": container with ID starting with 0c24a2cf831a56044129b5e00c3ffa6d2a4f5feaefdbc0c7745f5bdd47797bd6 not found: ID does not exist" containerID="0c24a2cf831a56044129b5e00c3ffa6d2a4f5feaefdbc0c7745f5bdd47797bd6" Mar 16 16:40:41 crc kubenswrapper[5120]: I0316 16:40:41.695592 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c24a2cf831a56044129b5e00c3ffa6d2a4f5feaefdbc0c7745f5bdd47797bd6"} err="failed to get container status \"0c24a2cf831a56044129b5e00c3ffa6d2a4f5feaefdbc0c7745f5bdd47797bd6\": rpc error: code = NotFound desc = could not find container \"0c24a2cf831a56044129b5e00c3ffa6d2a4f5feaefdbc0c7745f5bdd47797bd6\": container with ID starting with 0c24a2cf831a56044129b5e00c3ffa6d2a4f5feaefdbc0c7745f5bdd47797bd6 not found: ID does not exist" Mar 16 16:40:41 crc kubenswrapper[5120]: I0316 16:40:41.695616 5120 scope.go:117] "RemoveContainer" containerID="38d72b73341317e1cd4e4a5501014a3bd1db89eb530efd6c0e87d6c1a90cb693" Mar 16 16:40:41 crc kubenswrapper[5120]: E0316 16:40:41.695830 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"38d72b73341317e1cd4e4a5501014a3bd1db89eb530efd6c0e87d6c1a90cb693\": container with ID starting with 38d72b73341317e1cd4e4a5501014a3bd1db89eb530efd6c0e87d6c1a90cb693 not found: ID does not exist" containerID="38d72b73341317e1cd4e4a5501014a3bd1db89eb530efd6c0e87d6c1a90cb693" Mar 16 16:40:41 crc kubenswrapper[5120]: I0316 16:40:41.695846 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38d72b73341317e1cd4e4a5501014a3bd1db89eb530efd6c0e87d6c1a90cb693"} err="failed to get container status \"38d72b73341317e1cd4e4a5501014a3bd1db89eb530efd6c0e87d6c1a90cb693\": rpc error: code = NotFound desc = could not find container \"38d72b73341317e1cd4e4a5501014a3bd1db89eb530efd6c0e87d6c1a90cb693\": container with ID starting with 38d72b73341317e1cd4e4a5501014a3bd1db89eb530efd6c0e87d6c1a90cb693 not found: ID does not exist" Mar 16 16:40:41 crc kubenswrapper[5120]: I0316 16:40:41.695858 5120 scope.go:117] "RemoveContainer" containerID="b4b4cc9a667d73f04554e4fc969d14f8329c6ff61c1a4e019385ab1dcb69a8be" Mar 16 16:40:41 crc kubenswrapper[5120]: E0316 16:40:41.696146 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b4b4cc9a667d73f04554e4fc969d14f8329c6ff61c1a4e019385ab1dcb69a8be\": container with ID starting with b4b4cc9a667d73f04554e4fc969d14f8329c6ff61c1a4e019385ab1dcb69a8be not found: ID does not exist" containerID="b4b4cc9a667d73f04554e4fc969d14f8329c6ff61c1a4e019385ab1dcb69a8be" Mar 16 16:40:41 crc kubenswrapper[5120]: I0316 16:40:41.696167 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4b4cc9a667d73f04554e4fc969d14f8329c6ff61c1a4e019385ab1dcb69a8be"} err="failed to get container status \"b4b4cc9a667d73f04554e4fc969d14f8329c6ff61c1a4e019385ab1dcb69a8be\": rpc error: code = NotFound desc = could not find container \"b4b4cc9a667d73f04554e4fc969d14f8329c6ff61c1a4e019385ab1dcb69a8be\": container with ID starting with b4b4cc9a667d73f04554e4fc969d14f8329c6ff61c1a4e019385ab1dcb69a8be not found: ID does not exist" Mar 16 16:40:41 crc kubenswrapper[5120]: I0316 16:40:41.696180 5120 scope.go:117] "RemoveContainer" containerID="18117d315c2cfe422e993c1304b517b8faf736bf44afe60a74b05e1897dff94b" Mar 16 16:40:41 crc kubenswrapper[5120]: I0316 16:40:41.696406 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18117d315c2cfe422e993c1304b517b8faf736bf44afe60a74b05e1897dff94b"} err="failed to get container status \"18117d315c2cfe422e993c1304b517b8faf736bf44afe60a74b05e1897dff94b\": rpc error: code = NotFound desc = could not find container \"18117d315c2cfe422e993c1304b517b8faf736bf44afe60a74b05e1897dff94b\": container with ID starting with 18117d315c2cfe422e993c1304b517b8faf736bf44afe60a74b05e1897dff94b not found: ID does not exist" Mar 16 16:40:41 crc kubenswrapper[5120]: I0316 16:40:41.696428 5120 scope.go:117] "RemoveContainer" containerID="0c24a2cf831a56044129b5e00c3ffa6d2a4f5feaefdbc0c7745f5bdd47797bd6" Mar 16 16:40:41 crc kubenswrapper[5120]: I0316 16:40:41.696751 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c24a2cf831a56044129b5e00c3ffa6d2a4f5feaefdbc0c7745f5bdd47797bd6"} err="failed to get container status \"0c24a2cf831a56044129b5e00c3ffa6d2a4f5feaefdbc0c7745f5bdd47797bd6\": rpc error: code = NotFound desc = could not find container \"0c24a2cf831a56044129b5e00c3ffa6d2a4f5feaefdbc0c7745f5bdd47797bd6\": container with ID starting with 0c24a2cf831a56044129b5e00c3ffa6d2a4f5feaefdbc0c7745f5bdd47797bd6 not found: ID does not exist" Mar 16 16:40:41 crc kubenswrapper[5120]: I0316 16:40:41.696808 5120 scope.go:117] "RemoveContainer" containerID="38d72b73341317e1cd4e4a5501014a3bd1db89eb530efd6c0e87d6c1a90cb693" Mar 16 16:40:41 crc kubenswrapper[5120]: I0316 16:40:41.697037 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38d72b73341317e1cd4e4a5501014a3bd1db89eb530efd6c0e87d6c1a90cb693"} err="failed to get container status \"38d72b73341317e1cd4e4a5501014a3bd1db89eb530efd6c0e87d6c1a90cb693\": rpc error: code = NotFound desc = could not find container \"38d72b73341317e1cd4e4a5501014a3bd1db89eb530efd6c0e87d6c1a90cb693\": container with ID starting with 38d72b73341317e1cd4e4a5501014a3bd1db89eb530efd6c0e87d6c1a90cb693 not found: ID does not exist" Mar 16 16:40:41 crc kubenswrapper[5120]: I0316 16:40:41.697071 5120 scope.go:117] "RemoveContainer" containerID="b4b4cc9a667d73f04554e4fc969d14f8329c6ff61c1a4e019385ab1dcb69a8be" Mar 16 16:40:41 crc kubenswrapper[5120]: I0316 16:40:41.698699 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4b4cc9a667d73f04554e4fc969d14f8329c6ff61c1a4e019385ab1dcb69a8be"} err="failed to get container status \"b4b4cc9a667d73f04554e4fc969d14f8329c6ff61c1a4e019385ab1dcb69a8be\": rpc error: code = NotFound desc = could not find container \"b4b4cc9a667d73f04554e4fc969d14f8329c6ff61c1a4e019385ab1dcb69a8be\": container with ID starting with b4b4cc9a667d73f04554e4fc969d14f8329c6ff61c1a4e019385ab1dcb69a8be not found: ID does not exist" Mar 16 16:40:41 crc kubenswrapper[5120]: I0316 16:40:41.817344 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:40:41 crc kubenswrapper[5120]: I0316 16:40:41.824425 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:40:41 crc kubenswrapper[5120]: I0316 16:40:41.847885 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:40:41 crc kubenswrapper[5120]: I0316 16:40:41.848945 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da8c9ee6-9520-4597-a4cb-d06ea1d0772c" containerName="ceilometer-central-agent" Mar 16 16:40:41 crc kubenswrapper[5120]: I0316 16:40:41.848968 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="da8c9ee6-9520-4597-a4cb-d06ea1d0772c" containerName="ceilometer-central-agent" Mar 16 16:40:41 crc kubenswrapper[5120]: I0316 16:40:41.848998 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da8c9ee6-9520-4597-a4cb-d06ea1d0772c" containerName="proxy-httpd" Mar 16 16:40:41 crc kubenswrapper[5120]: I0316 16:40:41.849008 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="da8c9ee6-9520-4597-a4cb-d06ea1d0772c" containerName="proxy-httpd" Mar 16 16:40:41 crc kubenswrapper[5120]: I0316 16:40:41.849033 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da8c9ee6-9520-4597-a4cb-d06ea1d0772c" containerName="sg-core" Mar 16 16:40:41 crc kubenswrapper[5120]: I0316 16:40:41.849041 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="da8c9ee6-9520-4597-a4cb-d06ea1d0772c" containerName="sg-core" Mar 16 16:40:41 crc kubenswrapper[5120]: I0316 16:40:41.849077 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da8c9ee6-9520-4597-a4cb-d06ea1d0772c" containerName="ceilometer-notification-agent" Mar 16 16:40:41 crc kubenswrapper[5120]: I0316 16:40:41.849085 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="da8c9ee6-9520-4597-a4cb-d06ea1d0772c" containerName="ceilometer-notification-agent" Mar 16 16:40:41 crc kubenswrapper[5120]: I0316 16:40:41.849246 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="da8c9ee6-9520-4597-a4cb-d06ea1d0772c" containerName="sg-core" Mar 16 16:40:41 crc kubenswrapper[5120]: I0316 16:40:41.849266 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="da8c9ee6-9520-4597-a4cb-d06ea1d0772c" containerName="ceilometer-notification-agent" Mar 16 16:40:41 crc kubenswrapper[5120]: I0316 16:40:41.849281 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="da8c9ee6-9520-4597-a4cb-d06ea1d0772c" containerName="ceilometer-central-agent" Mar 16 16:40:41 crc kubenswrapper[5120]: I0316 16:40:41.849290 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="da8c9ee6-9520-4597-a4cb-d06ea1d0772c" containerName="proxy-httpd" Mar 16 16:40:41 crc kubenswrapper[5120]: I0316 16:40:41.865025 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:40:41 crc kubenswrapper[5120]: I0316 16:40:41.864750 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:40:41 crc kubenswrapper[5120]: I0316 16:40:41.875829 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 16:40:41 crc kubenswrapper[5120]: I0316 16:40:41.875896 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 16:40:41 crc kubenswrapper[5120]: I0316 16:40:41.952170 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pls4w\" (UniqueName: \"kubernetes.io/projected/276b4092-4c66-46ec-bce3-0574e8071267-kube-api-access-pls4w\") pod \"ceilometer-0\" (UID: \"276b4092-4c66-46ec-bce3-0574e8071267\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:40:41 crc kubenswrapper[5120]: I0316 16:40:41.952223 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/276b4092-4c66-46ec-bce3-0574e8071267-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"276b4092-4c66-46ec-bce3-0574e8071267\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:40:41 crc kubenswrapper[5120]: I0316 16:40:41.952274 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/276b4092-4c66-46ec-bce3-0574e8071267-config-data\") pod \"ceilometer-0\" (UID: \"276b4092-4c66-46ec-bce3-0574e8071267\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:40:41 crc kubenswrapper[5120]: I0316 16:40:41.952493 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/276b4092-4c66-46ec-bce3-0574e8071267-run-httpd\") pod \"ceilometer-0\" (UID: \"276b4092-4c66-46ec-bce3-0574e8071267\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:40:41 crc kubenswrapper[5120]: I0316 16:40:41.952672 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/276b4092-4c66-46ec-bce3-0574e8071267-scripts\") pod \"ceilometer-0\" (UID: \"276b4092-4c66-46ec-bce3-0574e8071267\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:40:41 crc kubenswrapper[5120]: I0316 16:40:41.953007 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/276b4092-4c66-46ec-bce3-0574e8071267-log-httpd\") pod \"ceilometer-0\" (UID: \"276b4092-4c66-46ec-bce3-0574e8071267\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:40:41 crc kubenswrapper[5120]: I0316 16:40:41.953119 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/276b4092-4c66-46ec-bce3-0574e8071267-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"276b4092-4c66-46ec-bce3-0574e8071267\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:40:42 crc kubenswrapper[5120]: I0316 16:40:42.056253 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pls4w\" (UniqueName: \"kubernetes.io/projected/276b4092-4c66-46ec-bce3-0574e8071267-kube-api-access-pls4w\") pod \"ceilometer-0\" (UID: \"276b4092-4c66-46ec-bce3-0574e8071267\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:40:42 crc kubenswrapper[5120]: I0316 16:40:42.056568 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/276b4092-4c66-46ec-bce3-0574e8071267-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"276b4092-4c66-46ec-bce3-0574e8071267\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:40:42 crc kubenswrapper[5120]: I0316 16:40:42.056606 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/276b4092-4c66-46ec-bce3-0574e8071267-config-data\") pod \"ceilometer-0\" (UID: \"276b4092-4c66-46ec-bce3-0574e8071267\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:40:42 crc kubenswrapper[5120]: I0316 16:40:42.056633 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/276b4092-4c66-46ec-bce3-0574e8071267-run-httpd\") pod \"ceilometer-0\" (UID: \"276b4092-4c66-46ec-bce3-0574e8071267\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:40:42 crc kubenswrapper[5120]: I0316 16:40:42.056686 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/276b4092-4c66-46ec-bce3-0574e8071267-scripts\") pod \"ceilometer-0\" (UID: \"276b4092-4c66-46ec-bce3-0574e8071267\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:40:42 crc kubenswrapper[5120]: I0316 16:40:42.056747 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/276b4092-4c66-46ec-bce3-0574e8071267-log-httpd\") pod \"ceilometer-0\" (UID: \"276b4092-4c66-46ec-bce3-0574e8071267\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:40:42 crc kubenswrapper[5120]: I0316 16:40:42.056798 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/276b4092-4c66-46ec-bce3-0574e8071267-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"276b4092-4c66-46ec-bce3-0574e8071267\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:40:42 crc kubenswrapper[5120]: I0316 16:40:42.059613 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/276b4092-4c66-46ec-bce3-0574e8071267-run-httpd\") pod \"ceilometer-0\" (UID: \"276b4092-4c66-46ec-bce3-0574e8071267\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:40:42 crc kubenswrapper[5120]: I0316 16:40:42.060047 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/276b4092-4c66-46ec-bce3-0574e8071267-log-httpd\") pod \"ceilometer-0\" (UID: \"276b4092-4c66-46ec-bce3-0574e8071267\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:40:42 crc kubenswrapper[5120]: I0316 16:40:42.062595 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/276b4092-4c66-46ec-bce3-0574e8071267-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"276b4092-4c66-46ec-bce3-0574e8071267\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:40:42 crc kubenswrapper[5120]: I0316 16:40:42.064973 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/276b4092-4c66-46ec-bce3-0574e8071267-scripts\") pod \"ceilometer-0\" (UID: \"276b4092-4c66-46ec-bce3-0574e8071267\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:40:42 crc kubenswrapper[5120]: I0316 16:40:42.067405 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/276b4092-4c66-46ec-bce3-0574e8071267-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"276b4092-4c66-46ec-bce3-0574e8071267\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:40:42 crc kubenswrapper[5120]: I0316 16:40:42.074530 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pls4w\" (UniqueName: \"kubernetes.io/projected/276b4092-4c66-46ec-bce3-0574e8071267-kube-api-access-pls4w\") pod \"ceilometer-0\" (UID: \"276b4092-4c66-46ec-bce3-0574e8071267\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:40:42 crc kubenswrapper[5120]: I0316 16:40:42.081271 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/276b4092-4c66-46ec-bce3-0574e8071267-config-data\") pod \"ceilometer-0\" (UID: \"276b4092-4c66-46ec-bce3-0574e8071267\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:40:42 crc kubenswrapper[5120]: I0316 16:40:42.208996 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-59869bff69-qcf89" Mar 16 16:40:42 crc kubenswrapper[5120]: I0316 16:40:42.270460 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:40:42 crc kubenswrapper[5120]: I0316 16:40:42.364475 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/3b25da8f-df4b-4367-884e-abd3b1d6527e-ovndb-tls-certs\") pod \"3b25da8f-df4b-4367-884e-abd3b1d6527e\" (UID: \"3b25da8f-df4b-4367-884e-abd3b1d6527e\") " Mar 16 16:40:42 crc kubenswrapper[5120]: I0316 16:40:42.365001 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3b25da8f-df4b-4367-884e-abd3b1d6527e-config\") pod \"3b25da8f-df4b-4367-884e-abd3b1d6527e\" (UID: \"3b25da8f-df4b-4367-884e-abd3b1d6527e\") " Mar 16 16:40:42 crc kubenswrapper[5120]: I0316 16:40:42.365156 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/3b25da8f-df4b-4367-884e-abd3b1d6527e-httpd-config\") pod \"3b25da8f-df4b-4367-884e-abd3b1d6527e\" (UID: \"3b25da8f-df4b-4367-884e-abd3b1d6527e\") " Mar 16 16:40:42 crc kubenswrapper[5120]: I0316 16:40:42.365346 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-98cdm\" (UniqueName: \"kubernetes.io/projected/3b25da8f-df4b-4367-884e-abd3b1d6527e-kube-api-access-98cdm\") pod \"3b25da8f-df4b-4367-884e-abd3b1d6527e\" (UID: \"3b25da8f-df4b-4367-884e-abd3b1d6527e\") " Mar 16 16:40:42 crc kubenswrapper[5120]: I0316 16:40:42.365404 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3b25da8f-df4b-4367-884e-abd3b1d6527e-combined-ca-bundle\") pod \"3b25da8f-df4b-4367-884e-abd3b1d6527e\" (UID: \"3b25da8f-df4b-4367-884e-abd3b1d6527e\") " Mar 16 16:40:42 crc kubenswrapper[5120]: I0316 16:40:42.369860 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b25da8f-df4b-4367-884e-abd3b1d6527e-httpd-config" (OuterVolumeSpecName: "httpd-config") pod "3b25da8f-df4b-4367-884e-abd3b1d6527e" (UID: "3b25da8f-df4b-4367-884e-abd3b1d6527e"). InnerVolumeSpecName "httpd-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:40:42 crc kubenswrapper[5120]: I0316 16:40:42.370262 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b25da8f-df4b-4367-884e-abd3b1d6527e-kube-api-access-98cdm" (OuterVolumeSpecName: "kube-api-access-98cdm") pod "3b25da8f-df4b-4367-884e-abd3b1d6527e" (UID: "3b25da8f-df4b-4367-884e-abd3b1d6527e"). InnerVolumeSpecName "kube-api-access-98cdm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:40:42 crc kubenswrapper[5120]: I0316 16:40:42.436444 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b25da8f-df4b-4367-884e-abd3b1d6527e-config" (OuterVolumeSpecName: "config") pod "3b25da8f-df4b-4367-884e-abd3b1d6527e" (UID: "3b25da8f-df4b-4367-884e-abd3b1d6527e"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:40:42 crc kubenswrapper[5120]: I0316 16:40:42.452490 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b25da8f-df4b-4367-884e-abd3b1d6527e-ovndb-tls-certs" (OuterVolumeSpecName: "ovndb-tls-certs") pod "3b25da8f-df4b-4367-884e-abd3b1d6527e" (UID: "3b25da8f-df4b-4367-884e-abd3b1d6527e"). InnerVolumeSpecName "ovndb-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:40:42 crc kubenswrapper[5120]: I0316 16:40:42.453913 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b25da8f-df4b-4367-884e-abd3b1d6527e-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "3b25da8f-df4b-4367-884e-abd3b1d6527e" (UID: "3b25da8f-df4b-4367-884e-abd3b1d6527e"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:40:42 crc kubenswrapper[5120]: I0316 16:40:42.470654 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-98cdm\" (UniqueName: \"kubernetes.io/projected/3b25da8f-df4b-4367-884e-abd3b1d6527e-kube-api-access-98cdm\") on node \"crc\" DevicePath \"\"" Mar 16 16:40:42 crc kubenswrapper[5120]: I0316 16:40:42.470688 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3b25da8f-df4b-4367-884e-abd3b1d6527e-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:40:42 crc kubenswrapper[5120]: I0316 16:40:42.470697 5120 reconciler_common.go:299] "Volume detached for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/3b25da8f-df4b-4367-884e-abd3b1d6527e-ovndb-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:40:42 crc kubenswrapper[5120]: I0316 16:40:42.470707 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/3b25da8f-df4b-4367-884e-abd3b1d6527e-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:40:42 crc kubenswrapper[5120]: I0316 16:40:42.470716 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/3b25da8f-df4b-4367-884e-abd3b1d6527e-httpd-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:40:42 crc kubenswrapper[5120]: I0316 16:40:42.560724 5120 generic.go:358] "Generic (PLEG): container finished" podID="3b25da8f-df4b-4367-884e-abd3b1d6527e" containerID="f1ab4c0f8022fb9de6575ab45267b97aab998eaf187857960ccdb6e8bc399b34" exitCode=0 Mar 16 16:40:42 crc kubenswrapper[5120]: I0316 16:40:42.561848 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-59869bff69-qcf89" Mar 16 16:40:42 crc kubenswrapper[5120]: I0316 16:40:42.561936 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-59869bff69-qcf89" event={"ID":"3b25da8f-df4b-4367-884e-abd3b1d6527e","Type":"ContainerDied","Data":"f1ab4c0f8022fb9de6575ab45267b97aab998eaf187857960ccdb6e8bc399b34"} Mar 16 16:40:42 crc kubenswrapper[5120]: I0316 16:40:42.561963 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-59869bff69-qcf89" event={"ID":"3b25da8f-df4b-4367-884e-abd3b1d6527e","Type":"ContainerDied","Data":"a38252cd22f33781de1b633bbc23f24ed4c43ff7a4b65cce1daf25202492cd0f"} Mar 16 16:40:42 crc kubenswrapper[5120]: I0316 16:40:42.561981 5120 scope.go:117] "RemoveContainer" containerID="8366512f8d2ec85fe213332aee553881ed2d4ea0d3fb8d28ef0e2ebdf3d9863d" Mar 16 16:40:42 crc kubenswrapper[5120]: I0316 16:40:42.609447 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-59869bff69-qcf89"] Mar 16 16:40:42 crc kubenswrapper[5120]: I0316 16:40:42.642170 5120 scope.go:117] "RemoveContainer" containerID="f1ab4c0f8022fb9de6575ab45267b97aab998eaf187857960ccdb6e8bc399b34" Mar 16 16:40:42 crc kubenswrapper[5120]: I0316 16:40:42.645259 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-59869bff69-qcf89"] Mar 16 16:40:42 crc kubenswrapper[5120]: I0316 16:40:42.678092 5120 scope.go:117] "RemoveContainer" containerID="8366512f8d2ec85fe213332aee553881ed2d4ea0d3fb8d28ef0e2ebdf3d9863d" Mar 16 16:40:42 crc kubenswrapper[5120]: E0316 16:40:42.684220 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8366512f8d2ec85fe213332aee553881ed2d4ea0d3fb8d28ef0e2ebdf3d9863d\": container with ID starting with 8366512f8d2ec85fe213332aee553881ed2d4ea0d3fb8d28ef0e2ebdf3d9863d not found: ID does not exist" containerID="8366512f8d2ec85fe213332aee553881ed2d4ea0d3fb8d28ef0e2ebdf3d9863d" Mar 16 16:40:42 crc kubenswrapper[5120]: I0316 16:40:42.684270 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8366512f8d2ec85fe213332aee553881ed2d4ea0d3fb8d28ef0e2ebdf3d9863d"} err="failed to get container status \"8366512f8d2ec85fe213332aee553881ed2d4ea0d3fb8d28ef0e2ebdf3d9863d\": rpc error: code = NotFound desc = could not find container \"8366512f8d2ec85fe213332aee553881ed2d4ea0d3fb8d28ef0e2ebdf3d9863d\": container with ID starting with 8366512f8d2ec85fe213332aee553881ed2d4ea0d3fb8d28ef0e2ebdf3d9863d not found: ID does not exist" Mar 16 16:40:42 crc kubenswrapper[5120]: I0316 16:40:42.684294 5120 scope.go:117] "RemoveContainer" containerID="f1ab4c0f8022fb9de6575ab45267b97aab998eaf187857960ccdb6e8bc399b34" Mar 16 16:40:42 crc kubenswrapper[5120]: I0316 16:40:42.686419 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3b25da8f-df4b-4367-884e-abd3b1d6527e" path="/var/lib/kubelet/pods/3b25da8f-df4b-4367-884e-abd3b1d6527e/volumes" Mar 16 16:40:42 crc kubenswrapper[5120]: I0316 16:40:42.687048 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="da8c9ee6-9520-4597-a4cb-d06ea1d0772c" path="/var/lib/kubelet/pods/da8c9ee6-9520-4597-a4cb-d06ea1d0772c/volumes" Mar 16 16:40:42 crc kubenswrapper[5120]: E0316 16:40:42.690786 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f1ab4c0f8022fb9de6575ab45267b97aab998eaf187857960ccdb6e8bc399b34\": container with ID starting with f1ab4c0f8022fb9de6575ab45267b97aab998eaf187857960ccdb6e8bc399b34 not found: ID does not exist" containerID="f1ab4c0f8022fb9de6575ab45267b97aab998eaf187857960ccdb6e8bc399b34" Mar 16 16:40:42 crc kubenswrapper[5120]: I0316 16:40:42.690834 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1ab4c0f8022fb9de6575ab45267b97aab998eaf187857960ccdb6e8bc399b34"} err="failed to get container status \"f1ab4c0f8022fb9de6575ab45267b97aab998eaf187857960ccdb6e8bc399b34\": rpc error: code = NotFound desc = could not find container \"f1ab4c0f8022fb9de6575ab45267b97aab998eaf187857960ccdb6e8bc399b34\": container with ID starting with f1ab4c0f8022fb9de6575ab45267b97aab998eaf187857960ccdb6e8bc399b34 not found: ID does not exist" Mar 16 16:40:42 crc kubenswrapper[5120]: I0316 16:40:42.722121 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:40:42 crc kubenswrapper[5120]: I0316 16:40:42.912635 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 16:40:42 crc kubenswrapper[5120]: I0316 16:40:42.912918 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/kube-state-metrics-0" podUID="ed3ee889-136c-4331-b526-e110819e0ea0" containerName="kube-state-metrics" containerID="cri-o://11cff8daf5d0c8de9ad18c145b3373f93ecace32d87193c69d31b81eba839c8a" gracePeriod=30 Mar 16 16:40:43 crc kubenswrapper[5120]: I0316 16:40:43.088008 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/kube-state-metrics-0" podUID="ed3ee889-136c-4331-b526-e110819e0ea0" containerName="kube-state-metrics" probeResult="failure" output="Get \"http://10.217.1.22:8081/readyz\": dial tcp 10.217.1.22:8081: connect: connection refused" Mar 16 16:40:43 crc kubenswrapper[5120]: I0316 16:40:43.343290 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:40:43 crc kubenswrapper[5120]: I0316 16:40:43.502390 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tf7cl\" (UniqueName: \"kubernetes.io/projected/ed3ee889-136c-4331-b526-e110819e0ea0-kube-api-access-tf7cl\") pod \"ed3ee889-136c-4331-b526-e110819e0ea0\" (UID: \"ed3ee889-136c-4331-b526-e110819e0ea0\") " Mar 16 16:40:43 crc kubenswrapper[5120]: I0316 16:40:43.509203 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed3ee889-136c-4331-b526-e110819e0ea0-kube-api-access-tf7cl" (OuterVolumeSpecName: "kube-api-access-tf7cl") pod "ed3ee889-136c-4331-b526-e110819e0ea0" (UID: "ed3ee889-136c-4331-b526-e110819e0ea0"). InnerVolumeSpecName "kube-api-access-tf7cl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:40:43 crc kubenswrapper[5120]: I0316 16:40:43.571307 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"276b4092-4c66-46ec-bce3-0574e8071267","Type":"ContainerStarted","Data":"35fb6bfdcd424e6ff0a095c9fd691a87de447de74b0da74bfad2db6244cb4252"} Mar 16 16:40:43 crc kubenswrapper[5120]: I0316 16:40:43.571353 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"276b4092-4c66-46ec-bce3-0574e8071267","Type":"ContainerStarted","Data":"14bb9ecc5eb5b1b747dc9a20969746c3c7420d9b58dcdc397611183f21ca93db"} Mar 16 16:40:43 crc kubenswrapper[5120]: I0316 16:40:43.582419 5120 generic.go:358] "Generic (PLEG): container finished" podID="ed3ee889-136c-4331-b526-e110819e0ea0" containerID="11cff8daf5d0c8de9ad18c145b3373f93ecace32d87193c69d31b81eba839c8a" exitCode=2 Mar 16 16:40:43 crc kubenswrapper[5120]: I0316 16:40:43.582486 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"ed3ee889-136c-4331-b526-e110819e0ea0","Type":"ContainerDied","Data":"11cff8daf5d0c8de9ad18c145b3373f93ecace32d87193c69d31b81eba839c8a"} Mar 16 16:40:43 crc kubenswrapper[5120]: I0316 16:40:43.582505 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:40:43 crc kubenswrapper[5120]: I0316 16:40:43.582529 5120 scope.go:117] "RemoveContainer" containerID="11cff8daf5d0c8de9ad18c145b3373f93ecace32d87193c69d31b81eba839c8a" Mar 16 16:40:43 crc kubenswrapper[5120]: I0316 16:40:43.582518 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"ed3ee889-136c-4331-b526-e110819e0ea0","Type":"ContainerDied","Data":"349e4be45e63d65ddaa05eae3e0283fd863ef54d8526da2c2f6ad91f02e1f66a"} Mar 16 16:40:43 crc kubenswrapper[5120]: I0316 16:40:43.605417 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tf7cl\" (UniqueName: \"kubernetes.io/projected/ed3ee889-136c-4331-b526-e110819e0ea0-kube-api-access-tf7cl\") on node \"crc\" DevicePath \"\"" Mar 16 16:40:43 crc kubenswrapper[5120]: I0316 16:40:43.649742 5120 scope.go:117] "RemoveContainer" containerID="11cff8daf5d0c8de9ad18c145b3373f93ecace32d87193c69d31b81eba839c8a" Mar 16 16:40:43 crc kubenswrapper[5120]: E0316 16:40:43.650229 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"11cff8daf5d0c8de9ad18c145b3373f93ecace32d87193c69d31b81eba839c8a\": container with ID starting with 11cff8daf5d0c8de9ad18c145b3373f93ecace32d87193c69d31b81eba839c8a not found: ID does not exist" containerID="11cff8daf5d0c8de9ad18c145b3373f93ecace32d87193c69d31b81eba839c8a" Mar 16 16:40:43 crc kubenswrapper[5120]: I0316 16:40:43.650273 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11cff8daf5d0c8de9ad18c145b3373f93ecace32d87193c69d31b81eba839c8a"} err="failed to get container status \"11cff8daf5d0c8de9ad18c145b3373f93ecace32d87193c69d31b81eba839c8a\": rpc error: code = NotFound desc = could not find container \"11cff8daf5d0c8de9ad18c145b3373f93ecace32d87193c69d31b81eba839c8a\": container with ID starting with 11cff8daf5d0c8de9ad18c145b3373f93ecace32d87193c69d31b81eba839c8a not found: ID does not exist" Mar 16 16:40:43 crc kubenswrapper[5120]: I0316 16:40:43.668467 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 16:40:43 crc kubenswrapper[5120]: I0316 16:40:43.678232 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 16:40:43 crc kubenswrapper[5120]: I0316 16:40:43.687915 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 16:40:43 crc kubenswrapper[5120]: I0316 16:40:43.688839 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed3ee889-136c-4331-b526-e110819e0ea0" containerName="kube-state-metrics" Mar 16 16:40:43 crc kubenswrapper[5120]: I0316 16:40:43.688855 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed3ee889-136c-4331-b526-e110819e0ea0" containerName="kube-state-metrics" Mar 16 16:40:43 crc kubenswrapper[5120]: I0316 16:40:43.688898 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b25da8f-df4b-4367-884e-abd3b1d6527e" containerName="neutron-api" Mar 16 16:40:43 crc kubenswrapper[5120]: I0316 16:40:43.688904 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b25da8f-df4b-4367-884e-abd3b1d6527e" containerName="neutron-api" Mar 16 16:40:43 crc kubenswrapper[5120]: I0316 16:40:43.688926 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b25da8f-df4b-4367-884e-abd3b1d6527e" containerName="neutron-httpd" Mar 16 16:40:43 crc kubenswrapper[5120]: I0316 16:40:43.688932 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b25da8f-df4b-4367-884e-abd3b1d6527e" containerName="neutron-httpd" Mar 16 16:40:43 crc kubenswrapper[5120]: I0316 16:40:43.689131 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="3b25da8f-df4b-4367-884e-abd3b1d6527e" containerName="neutron-api" Mar 16 16:40:43 crc kubenswrapper[5120]: I0316 16:40:43.689146 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ed3ee889-136c-4331-b526-e110819e0ea0" containerName="kube-state-metrics" Mar 16 16:40:43 crc kubenswrapper[5120]: I0316 16:40:43.689163 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="3b25da8f-df4b-4367-884e-abd3b1d6527e" containerName="neutron-httpd" Mar 16 16:40:43 crc kubenswrapper[5120]: I0316 16:40:43.694301 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:40:43 crc kubenswrapper[5120]: I0316 16:40:43.696733 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"kube-state-metrics-tls-config\"" Mar 16 16:40:43 crc kubenswrapper[5120]: I0316 16:40:43.698238 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 16:40:43 crc kubenswrapper[5120]: I0316 16:40:43.705899 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-kube-state-metrics-svc\"" Mar 16 16:40:43 crc kubenswrapper[5120]: I0316 16:40:43.812387 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/c0f2211e-5c26-4865-b7dd-8799e5229862-kube-state-metrics-tls-certs\") pod \"kube-state-metrics-0\" (UID: \"c0f2211e-5c26-4865-b7dd-8799e5229862\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:40:43 crc kubenswrapper[5120]: I0316 16:40:43.813342 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/c0f2211e-5c26-4865-b7dd-8799e5229862-kube-state-metrics-tls-config\") pod \"kube-state-metrics-0\" (UID: \"c0f2211e-5c26-4865-b7dd-8799e5229862\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:40:43 crc kubenswrapper[5120]: I0316 16:40:43.813514 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c0f2211e-5c26-4865-b7dd-8799e5229862-combined-ca-bundle\") pod \"kube-state-metrics-0\" (UID: \"c0f2211e-5c26-4865-b7dd-8799e5229862\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:40:43 crc kubenswrapper[5120]: I0316 16:40:43.813890 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fn9ql\" (UniqueName: \"kubernetes.io/projected/c0f2211e-5c26-4865-b7dd-8799e5229862-kube-api-access-fn9ql\") pod \"kube-state-metrics-0\" (UID: \"c0f2211e-5c26-4865-b7dd-8799e5229862\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:40:43 crc kubenswrapper[5120]: I0316 16:40:43.917042 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/c0f2211e-5c26-4865-b7dd-8799e5229862-kube-state-metrics-tls-certs\") pod \"kube-state-metrics-0\" (UID: \"c0f2211e-5c26-4865-b7dd-8799e5229862\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:40:43 crc kubenswrapper[5120]: I0316 16:40:43.917286 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/c0f2211e-5c26-4865-b7dd-8799e5229862-kube-state-metrics-tls-config\") pod \"kube-state-metrics-0\" (UID: \"c0f2211e-5c26-4865-b7dd-8799e5229862\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:40:43 crc kubenswrapper[5120]: I0316 16:40:43.917446 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c0f2211e-5c26-4865-b7dd-8799e5229862-combined-ca-bundle\") pod \"kube-state-metrics-0\" (UID: \"c0f2211e-5c26-4865-b7dd-8799e5229862\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:40:43 crc kubenswrapper[5120]: I0316 16:40:43.917602 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fn9ql\" (UniqueName: \"kubernetes.io/projected/c0f2211e-5c26-4865-b7dd-8799e5229862-kube-api-access-fn9ql\") pod \"kube-state-metrics-0\" (UID: \"c0f2211e-5c26-4865-b7dd-8799e5229862\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:40:43 crc kubenswrapper[5120]: I0316 16:40:43.921536 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/c0f2211e-5c26-4865-b7dd-8799e5229862-kube-state-metrics-tls-config\") pod \"kube-state-metrics-0\" (UID: \"c0f2211e-5c26-4865-b7dd-8799e5229862\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:40:43 crc kubenswrapper[5120]: I0316 16:40:43.925543 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c0f2211e-5c26-4865-b7dd-8799e5229862-combined-ca-bundle\") pod \"kube-state-metrics-0\" (UID: \"c0f2211e-5c26-4865-b7dd-8799e5229862\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:40:43 crc kubenswrapper[5120]: I0316 16:40:43.927206 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/c0f2211e-5c26-4865-b7dd-8799e5229862-kube-state-metrics-tls-certs\") pod \"kube-state-metrics-0\" (UID: \"c0f2211e-5c26-4865-b7dd-8799e5229862\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:40:43 crc kubenswrapper[5120]: I0316 16:40:43.935797 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fn9ql\" (UniqueName: \"kubernetes.io/projected/c0f2211e-5c26-4865-b7dd-8799e5229862-kube-api-access-fn9ql\") pod \"kube-state-metrics-0\" (UID: \"c0f2211e-5c26-4865-b7dd-8799e5229862\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:40:44 crc kubenswrapper[5120]: I0316 16:40:44.017595 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:40:44 crc kubenswrapper[5120]: W0316 16:40:44.540785 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc0f2211e_5c26_4865_b7dd_8799e5229862.slice/crio-fb495cfd769176967ca4deca8c746f862cabd631d540073e258c7513d8938113 WatchSource:0}: Error finding container fb495cfd769176967ca4deca8c746f862cabd631d540073e258c7513d8938113: Status 404 returned error can't find the container with id fb495cfd769176967ca4deca8c746f862cabd631d540073e258c7513d8938113 Mar 16 16:40:44 crc kubenswrapper[5120]: I0316 16:40:44.544230 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 16:40:44 crc kubenswrapper[5120]: I0316 16:40:44.591602 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"c0f2211e-5c26-4865-b7dd-8799e5229862","Type":"ContainerStarted","Data":"fb495cfd769176967ca4deca8c746f862cabd631d540073e258c7513d8938113"} Mar 16 16:40:44 crc kubenswrapper[5120]: I0316 16:40:44.594952 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"276b4092-4c66-46ec-bce3-0574e8071267","Type":"ContainerStarted","Data":"a982ca372d85d549ac659914d8caa75f250eef13b6818adf1277a941a1e6937f"} Mar 16 16:40:44 crc kubenswrapper[5120]: I0316 16:40:44.677177 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed3ee889-136c-4331-b526-e110819e0ea0" path="/var/lib/kubelet/pods/ed3ee889-136c-4331-b526-e110819e0ea0/volumes" Mar 16 16:40:44 crc kubenswrapper[5120]: I0316 16:40:44.915549 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:40:45 crc kubenswrapper[5120]: I0316 16:40:45.385168 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-operators-hsqcg" Mar 16 16:40:45 crc kubenswrapper[5120]: I0316 16:40:45.385221 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-marketplace/redhat-operators-hsqcg" Mar 16 16:40:45 crc kubenswrapper[5120]: I0316 16:40:45.443828 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-operators-hsqcg" Mar 16 16:40:45 crc kubenswrapper[5120]: I0316 16:40:45.609329 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"c0f2211e-5c26-4865-b7dd-8799e5229862","Type":"ContainerStarted","Data":"6d480457ad64d0c74019dff9f3a62a4f5e3a431f4e1b0160808649591b0d97b9"} Mar 16 16:40:45 crc kubenswrapper[5120]: I0316 16:40:45.609432 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:40:45 crc kubenswrapper[5120]: I0316 16:40:45.617409 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"276b4092-4c66-46ec-bce3-0574e8071267","Type":"ContainerStarted","Data":"a8072b314fff2b1c990ed73b3acd9752415d424d2482dd6d5c912f553f4e9b34"} Mar 16 16:40:45 crc kubenswrapper[5120]: I0316 16:40:45.668535 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-operators-hsqcg" Mar 16 16:40:45 crc kubenswrapper[5120]: I0316 16:40:45.692018 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/kube-state-metrics-0" podStartSLOduration=2.345363981 podStartE2EDuration="2.691995049s" podCreationTimestamp="2026-03-16 16:40:43 +0000 UTC" firstStartedPulling="2026-03-16 16:40:44.543084776 +0000 UTC m=+4146.697016443" lastFinishedPulling="2026-03-16 16:40:44.889715854 +0000 UTC m=+4147.043647511" observedRunningTime="2026-03-16 16:40:45.643136573 +0000 UTC m=+4147.797068230" watchObservedRunningTime="2026-03-16 16:40:45.691995049 +0000 UTC m=+4147.845926706" Mar 16 16:40:47 crc kubenswrapper[5120]: I0316 16:40:47.567971 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/swift-proxy-85dfc87f54-wb22t" Mar 16 16:40:47 crc kubenswrapper[5120]: I0316 16:40:47.572459 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/swift-proxy-85dfc87f54-wb22t" Mar 16 16:40:47 crc kubenswrapper[5120]: I0316 16:40:47.646500 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="276b4092-4c66-46ec-bce3-0574e8071267" containerName="ceilometer-central-agent" containerID="cri-o://35fb6bfdcd424e6ff0a095c9fd691a87de447de74b0da74bfad2db6244cb4252" gracePeriod=30 Mar 16 16:40:47 crc kubenswrapper[5120]: I0316 16:40:47.646599 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"276b4092-4c66-46ec-bce3-0574e8071267","Type":"ContainerStarted","Data":"cbf60b8ba258c7b95b676c12fee23585f4e6b1e1efabeec5fd7d2a06cc8d6cbb"} Mar 16 16:40:47 crc kubenswrapper[5120]: I0316 16:40:47.646647 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:40:47 crc kubenswrapper[5120]: I0316 16:40:47.647101 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="276b4092-4c66-46ec-bce3-0574e8071267" containerName="proxy-httpd" containerID="cri-o://cbf60b8ba258c7b95b676c12fee23585f4e6b1e1efabeec5fd7d2a06cc8d6cbb" gracePeriod=30 Mar 16 16:40:47 crc kubenswrapper[5120]: I0316 16:40:47.647168 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="276b4092-4c66-46ec-bce3-0574e8071267" containerName="sg-core" containerID="cri-o://a8072b314fff2b1c990ed73b3acd9752415d424d2482dd6d5c912f553f4e9b34" gracePeriod=30 Mar 16 16:40:47 crc kubenswrapper[5120]: I0316 16:40:47.647255 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="276b4092-4c66-46ec-bce3-0574e8071267" containerName="ceilometer-notification-agent" containerID="cri-o://a982ca372d85d549ac659914d8caa75f250eef13b6818adf1277a941a1e6937f" gracePeriod=30 Mar 16 16:40:47 crc kubenswrapper[5120]: I0316 16:40:47.685703 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.5224184149999997 podStartE2EDuration="6.685683688s" podCreationTimestamp="2026-03-16 16:40:41 +0000 UTC" firstStartedPulling="2026-03-16 16:40:42.731384506 +0000 UTC m=+4144.885316163" lastFinishedPulling="2026-03-16 16:40:46.894649779 +0000 UTC m=+4149.048581436" observedRunningTime="2026-03-16 16:40:47.678903724 +0000 UTC m=+4149.832835381" watchObservedRunningTime="2026-03-16 16:40:47.685683688 +0000 UTC m=+4149.839615345" Mar 16 16:40:48 crc kubenswrapper[5120]: I0316 16:40:48.423561 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-hsqcg"] Mar 16 16:40:48 crc kubenswrapper[5120]: I0316 16:40:48.660225 5120 generic.go:358] "Generic (PLEG): container finished" podID="276b4092-4c66-46ec-bce3-0574e8071267" containerID="cbf60b8ba258c7b95b676c12fee23585f4e6b1e1efabeec5fd7d2a06cc8d6cbb" exitCode=0 Mar 16 16:40:48 crc kubenswrapper[5120]: I0316 16:40:48.660257 5120 generic.go:358] "Generic (PLEG): container finished" podID="276b4092-4c66-46ec-bce3-0574e8071267" containerID="a8072b314fff2b1c990ed73b3acd9752415d424d2482dd6d5c912f553f4e9b34" exitCode=2 Mar 16 16:40:48 crc kubenswrapper[5120]: I0316 16:40:48.660264 5120 generic.go:358] "Generic (PLEG): container finished" podID="276b4092-4c66-46ec-bce3-0574e8071267" containerID="a982ca372d85d549ac659914d8caa75f250eef13b6818adf1277a941a1e6937f" exitCode=0 Mar 16 16:40:48 crc kubenswrapper[5120]: I0316 16:40:48.660532 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"276b4092-4c66-46ec-bce3-0574e8071267","Type":"ContainerDied","Data":"cbf60b8ba258c7b95b676c12fee23585f4e6b1e1efabeec5fd7d2a06cc8d6cbb"} Mar 16 16:40:48 crc kubenswrapper[5120]: I0316 16:40:48.660561 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"276b4092-4c66-46ec-bce3-0574e8071267","Type":"ContainerDied","Data":"a8072b314fff2b1c990ed73b3acd9752415d424d2482dd6d5c912f553f4e9b34"} Mar 16 16:40:48 crc kubenswrapper[5120]: I0316 16:40:48.660570 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"276b4092-4c66-46ec-bce3-0574e8071267","Type":"ContainerDied","Data":"a982ca372d85d549ac659914d8caa75f250eef13b6818adf1277a941a1e6937f"} Mar 16 16:40:49 crc kubenswrapper[5120]: I0316 16:40:49.009098 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-operators-q69b9"] Mar 16 16:40:49 crc kubenswrapper[5120]: I0316 16:40:49.009454 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-marketplace/redhat-operators-q69b9" podUID="05676c54-5e12-4b89-a0ad-a5f56b167117" containerName="registry-server" containerID="cri-o://18a6306e072fb085431be9118d7ce43e2d6beecf875dd19faf963c322d3251ef" gracePeriod=2 Mar 16 16:40:49 crc kubenswrapper[5120]: I0316 16:40:49.427422 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:40:49 crc kubenswrapper[5120]: I0316 16:40:49.456870 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/276b4092-4c66-46ec-bce3-0574e8071267-sg-core-conf-yaml\") pod \"276b4092-4c66-46ec-bce3-0574e8071267\" (UID: \"276b4092-4c66-46ec-bce3-0574e8071267\") " Mar 16 16:40:49 crc kubenswrapper[5120]: I0316 16:40:49.456974 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/276b4092-4c66-46ec-bce3-0574e8071267-run-httpd\") pod \"276b4092-4c66-46ec-bce3-0574e8071267\" (UID: \"276b4092-4c66-46ec-bce3-0574e8071267\") " Mar 16 16:40:49 crc kubenswrapper[5120]: I0316 16:40:49.457021 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pls4w\" (UniqueName: \"kubernetes.io/projected/276b4092-4c66-46ec-bce3-0574e8071267-kube-api-access-pls4w\") pod \"276b4092-4c66-46ec-bce3-0574e8071267\" (UID: \"276b4092-4c66-46ec-bce3-0574e8071267\") " Mar 16 16:40:49 crc kubenswrapper[5120]: I0316 16:40:49.457175 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/276b4092-4c66-46ec-bce3-0574e8071267-combined-ca-bundle\") pod \"276b4092-4c66-46ec-bce3-0574e8071267\" (UID: \"276b4092-4c66-46ec-bce3-0574e8071267\") " Mar 16 16:40:49 crc kubenswrapper[5120]: I0316 16:40:49.457310 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/276b4092-4c66-46ec-bce3-0574e8071267-log-httpd\") pod \"276b4092-4c66-46ec-bce3-0574e8071267\" (UID: \"276b4092-4c66-46ec-bce3-0574e8071267\") " Mar 16 16:40:49 crc kubenswrapper[5120]: I0316 16:40:49.457346 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/276b4092-4c66-46ec-bce3-0574e8071267-scripts\") pod \"276b4092-4c66-46ec-bce3-0574e8071267\" (UID: \"276b4092-4c66-46ec-bce3-0574e8071267\") " Mar 16 16:40:49 crc kubenswrapper[5120]: I0316 16:40:49.457574 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/276b4092-4c66-46ec-bce3-0574e8071267-config-data\") pod \"276b4092-4c66-46ec-bce3-0574e8071267\" (UID: \"276b4092-4c66-46ec-bce3-0574e8071267\") " Mar 16 16:40:49 crc kubenswrapper[5120]: I0316 16:40:49.461265 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/276b4092-4c66-46ec-bce3-0574e8071267-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "276b4092-4c66-46ec-bce3-0574e8071267" (UID: "276b4092-4c66-46ec-bce3-0574e8071267"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:40:49 crc kubenswrapper[5120]: I0316 16:40:49.462005 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/276b4092-4c66-46ec-bce3-0574e8071267-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "276b4092-4c66-46ec-bce3-0574e8071267" (UID: "276b4092-4c66-46ec-bce3-0574e8071267"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:40:49 crc kubenswrapper[5120]: I0316 16:40:49.465977 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/276b4092-4c66-46ec-bce3-0574e8071267-kube-api-access-pls4w" (OuterVolumeSpecName: "kube-api-access-pls4w") pod "276b4092-4c66-46ec-bce3-0574e8071267" (UID: "276b4092-4c66-46ec-bce3-0574e8071267"). InnerVolumeSpecName "kube-api-access-pls4w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:40:49 crc kubenswrapper[5120]: I0316 16:40:49.496731 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/276b4092-4c66-46ec-bce3-0574e8071267-scripts" (OuterVolumeSpecName: "scripts") pod "276b4092-4c66-46ec-bce3-0574e8071267" (UID: "276b4092-4c66-46ec-bce3-0574e8071267"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:40:49 crc kubenswrapper[5120]: I0316 16:40:49.530049 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/276b4092-4c66-46ec-bce3-0574e8071267-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "276b4092-4c66-46ec-bce3-0574e8071267" (UID: "276b4092-4c66-46ec-bce3-0574e8071267"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:40:49 crc kubenswrapper[5120]: I0316 16:40:49.543776 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-q69b9" Mar 16 16:40:49 crc kubenswrapper[5120]: I0316 16:40:49.560823 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/276b4092-4c66-46ec-bce3-0574e8071267-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 16:40:49 crc kubenswrapper[5120]: I0316 16:40:49.560854 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/276b4092-4c66-46ec-bce3-0574e8071267-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:40:49 crc kubenswrapper[5120]: I0316 16:40:49.560867 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pls4w\" (UniqueName: \"kubernetes.io/projected/276b4092-4c66-46ec-bce3-0574e8071267-kube-api-access-pls4w\") on node \"crc\" DevicePath \"\"" Mar 16 16:40:49 crc kubenswrapper[5120]: I0316 16:40:49.560877 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/276b4092-4c66-46ec-bce3-0574e8071267-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:40:49 crc kubenswrapper[5120]: I0316 16:40:49.560887 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/276b4092-4c66-46ec-bce3-0574e8071267-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:40:49 crc kubenswrapper[5120]: I0316 16:40:49.590627 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/276b4092-4c66-46ec-bce3-0574e8071267-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "276b4092-4c66-46ec-bce3-0574e8071267" (UID: "276b4092-4c66-46ec-bce3-0574e8071267"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:40:49 crc kubenswrapper[5120]: I0316 16:40:49.658937 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/276b4092-4c66-46ec-bce3-0574e8071267-config-data" (OuterVolumeSpecName: "config-data") pod "276b4092-4c66-46ec-bce3-0574e8071267" (UID: "276b4092-4c66-46ec-bce3-0574e8071267"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:40:49 crc kubenswrapper[5120]: I0316 16:40:49.662372 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/05676c54-5e12-4b89-a0ad-a5f56b167117-catalog-content\") pod \"05676c54-5e12-4b89-a0ad-a5f56b167117\" (UID: \"05676c54-5e12-4b89-a0ad-a5f56b167117\") " Mar 16 16:40:49 crc kubenswrapper[5120]: I0316 16:40:49.662524 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mff9m\" (UniqueName: \"kubernetes.io/projected/05676c54-5e12-4b89-a0ad-a5f56b167117-kube-api-access-mff9m\") pod \"05676c54-5e12-4b89-a0ad-a5f56b167117\" (UID: \"05676c54-5e12-4b89-a0ad-a5f56b167117\") " Mar 16 16:40:49 crc kubenswrapper[5120]: I0316 16:40:49.663457 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/05676c54-5e12-4b89-a0ad-a5f56b167117-utilities\") pod \"05676c54-5e12-4b89-a0ad-a5f56b167117\" (UID: \"05676c54-5e12-4b89-a0ad-a5f56b167117\") " Mar 16 16:40:49 crc kubenswrapper[5120]: I0316 16:40:49.663873 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05676c54-5e12-4b89-a0ad-a5f56b167117-utilities" (OuterVolumeSpecName: "utilities") pod "05676c54-5e12-4b89-a0ad-a5f56b167117" (UID: "05676c54-5e12-4b89-a0ad-a5f56b167117"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:40:49 crc kubenswrapper[5120]: I0316 16:40:49.664294 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/276b4092-4c66-46ec-bce3-0574e8071267-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:40:49 crc kubenswrapper[5120]: I0316 16:40:49.664321 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/276b4092-4c66-46ec-bce3-0574e8071267-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:40:49 crc kubenswrapper[5120]: I0316 16:40:49.664329 5120 reconciler_common.go:299] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/05676c54-5e12-4b89-a0ad-a5f56b167117-utilities\") on node \"crc\" DevicePath \"\"" Mar 16 16:40:49 crc kubenswrapper[5120]: I0316 16:40:49.670553 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05676c54-5e12-4b89-a0ad-a5f56b167117-kube-api-access-mff9m" (OuterVolumeSpecName: "kube-api-access-mff9m") pod "05676c54-5e12-4b89-a0ad-a5f56b167117" (UID: "05676c54-5e12-4b89-a0ad-a5f56b167117"). InnerVolumeSpecName "kube-api-access-mff9m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:40:49 crc kubenswrapper[5120]: I0316 16:40:49.682290 5120 generic.go:358] "Generic (PLEG): container finished" podID="276b4092-4c66-46ec-bce3-0574e8071267" containerID="35fb6bfdcd424e6ff0a095c9fd691a87de447de74b0da74bfad2db6244cb4252" exitCode=0 Mar 16 16:40:49 crc kubenswrapper[5120]: I0316 16:40:49.682710 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"276b4092-4c66-46ec-bce3-0574e8071267","Type":"ContainerDied","Data":"35fb6bfdcd424e6ff0a095c9fd691a87de447de74b0da74bfad2db6244cb4252"} Mar 16 16:40:49 crc kubenswrapper[5120]: I0316 16:40:49.682741 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"276b4092-4c66-46ec-bce3-0574e8071267","Type":"ContainerDied","Data":"14bb9ecc5eb5b1b747dc9a20969746c3c7420d9b58dcdc397611183f21ca93db"} Mar 16 16:40:49 crc kubenswrapper[5120]: I0316 16:40:49.682774 5120 scope.go:117] "RemoveContainer" containerID="cbf60b8ba258c7b95b676c12fee23585f4e6b1e1efabeec5fd7d2a06cc8d6cbb" Mar 16 16:40:49 crc kubenswrapper[5120]: I0316 16:40:49.682914 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:40:49 crc kubenswrapper[5120]: I0316 16:40:49.693676 5120 generic.go:358] "Generic (PLEG): container finished" podID="05676c54-5e12-4b89-a0ad-a5f56b167117" containerID="18a6306e072fb085431be9118d7ce43e2d6beecf875dd19faf963c322d3251ef" exitCode=0 Mar 16 16:40:49 crc kubenswrapper[5120]: I0316 16:40:49.693745 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-q69b9" event={"ID":"05676c54-5e12-4b89-a0ad-a5f56b167117","Type":"ContainerDied","Data":"18a6306e072fb085431be9118d7ce43e2d6beecf875dd19faf963c322d3251ef"} Mar 16 16:40:49 crc kubenswrapper[5120]: I0316 16:40:49.693887 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-q69b9" event={"ID":"05676c54-5e12-4b89-a0ad-a5f56b167117","Type":"ContainerDied","Data":"8968ade259fbabd51d3ef11c659bcce3ec81888bb0df75b5583bb8cbe5d061d7"} Mar 16 16:40:49 crc kubenswrapper[5120]: I0316 16:40:49.693928 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-q69b9" Mar 16 16:40:49 crc kubenswrapper[5120]: I0316 16:40:49.718944 5120 scope.go:117] "RemoveContainer" containerID="a8072b314fff2b1c990ed73b3acd9752415d424d2482dd6d5c912f553f4e9b34" Mar 16 16:40:49 crc kubenswrapper[5120]: I0316 16:40:49.726629 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:40:49 crc kubenswrapper[5120]: I0316 16:40:49.735870 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:40:49 crc kubenswrapper[5120]: I0316 16:40:49.749876 5120 scope.go:117] "RemoveContainer" containerID="a982ca372d85d549ac659914d8caa75f250eef13b6818adf1277a941a1e6937f" Mar 16 16:40:49 crc kubenswrapper[5120]: I0316 16:40:49.757541 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:40:49 crc kubenswrapper[5120]: I0316 16:40:49.767523 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="276b4092-4c66-46ec-bce3-0574e8071267" containerName="proxy-httpd" Mar 16 16:40:49 crc kubenswrapper[5120]: I0316 16:40:49.767559 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="276b4092-4c66-46ec-bce3-0574e8071267" containerName="proxy-httpd" Mar 16 16:40:49 crc kubenswrapper[5120]: I0316 16:40:49.767587 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="276b4092-4c66-46ec-bce3-0574e8071267" containerName="sg-core" Mar 16 16:40:49 crc kubenswrapper[5120]: I0316 16:40:49.767594 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="276b4092-4c66-46ec-bce3-0574e8071267" containerName="sg-core" Mar 16 16:40:49 crc kubenswrapper[5120]: I0316 16:40:49.767636 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="276b4092-4c66-46ec-bce3-0574e8071267" containerName="ceilometer-central-agent" Mar 16 16:40:49 crc kubenswrapper[5120]: I0316 16:40:49.767645 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="276b4092-4c66-46ec-bce3-0574e8071267" containerName="ceilometer-central-agent" Mar 16 16:40:49 crc kubenswrapper[5120]: I0316 16:40:49.767665 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05676c54-5e12-4b89-a0ad-a5f56b167117" containerName="extract-content" Mar 16 16:40:49 crc kubenswrapper[5120]: I0316 16:40:49.767671 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="05676c54-5e12-4b89-a0ad-a5f56b167117" containerName="extract-content" Mar 16 16:40:49 crc kubenswrapper[5120]: I0316 16:40:49.767683 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="276b4092-4c66-46ec-bce3-0574e8071267" containerName="ceilometer-notification-agent" Mar 16 16:40:49 crc kubenswrapper[5120]: I0316 16:40:49.767690 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="276b4092-4c66-46ec-bce3-0574e8071267" containerName="ceilometer-notification-agent" Mar 16 16:40:49 crc kubenswrapper[5120]: I0316 16:40:49.767780 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05676c54-5e12-4b89-a0ad-a5f56b167117" containerName="registry-server" Mar 16 16:40:49 crc kubenswrapper[5120]: I0316 16:40:49.767789 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="05676c54-5e12-4b89-a0ad-a5f56b167117" containerName="registry-server" Mar 16 16:40:49 crc kubenswrapper[5120]: I0316 16:40:49.767801 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05676c54-5e12-4b89-a0ad-a5f56b167117" containerName="extract-utilities" Mar 16 16:40:49 crc kubenswrapper[5120]: I0316 16:40:49.767808 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="05676c54-5e12-4b89-a0ad-a5f56b167117" containerName="extract-utilities" Mar 16 16:40:49 crc kubenswrapper[5120]: I0316 16:40:49.768110 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="276b4092-4c66-46ec-bce3-0574e8071267" containerName="sg-core" Mar 16 16:40:49 crc kubenswrapper[5120]: I0316 16:40:49.768128 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="05676c54-5e12-4b89-a0ad-a5f56b167117" containerName="registry-server" Mar 16 16:40:49 crc kubenswrapper[5120]: I0316 16:40:49.768145 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="276b4092-4c66-46ec-bce3-0574e8071267" containerName="proxy-httpd" Mar 16 16:40:49 crc kubenswrapper[5120]: I0316 16:40:49.768156 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="276b4092-4c66-46ec-bce3-0574e8071267" containerName="ceilometer-notification-agent" Mar 16 16:40:49 crc kubenswrapper[5120]: I0316 16:40:49.768165 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="276b4092-4c66-46ec-bce3-0574e8071267" containerName="ceilometer-central-agent" Mar 16 16:40:49 crc kubenswrapper[5120]: I0316 16:40:49.768483 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mff9m\" (UniqueName: \"kubernetes.io/projected/05676c54-5e12-4b89-a0ad-a5f56b167117-kube-api-access-mff9m\") on node \"crc\" DevicePath \"\"" Mar 16 16:40:49 crc kubenswrapper[5120]: I0316 16:40:49.786090 5120 scope.go:117] "RemoveContainer" containerID="35fb6bfdcd424e6ff0a095c9fd691a87de447de74b0da74bfad2db6244cb4252" Mar 16 16:40:49 crc kubenswrapper[5120]: I0316 16:40:49.828016 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:40:49 crc kubenswrapper[5120]: I0316 16:40:49.828252 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:40:49 crc kubenswrapper[5120]: I0316 16:40:49.834662 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 16:40:49 crc kubenswrapper[5120]: I0316 16:40:49.836379 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 16:40:49 crc kubenswrapper[5120]: I0316 16:40:49.836547 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ceilometer-internal-svc\"" Mar 16 16:40:49 crc kubenswrapper[5120]: I0316 16:40:49.843395 5120 scope.go:117] "RemoveContainer" containerID="cbf60b8ba258c7b95b676c12fee23585f4e6b1e1efabeec5fd7d2a06cc8d6cbb" Mar 16 16:40:49 crc kubenswrapper[5120]: I0316 16:40:49.843618 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05676c54-5e12-4b89-a0ad-a5f56b167117-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "05676c54-5e12-4b89-a0ad-a5f56b167117" (UID: "05676c54-5e12-4b89-a0ad-a5f56b167117"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:40:49 crc kubenswrapper[5120]: E0316 16:40:49.843868 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cbf60b8ba258c7b95b676c12fee23585f4e6b1e1efabeec5fd7d2a06cc8d6cbb\": container with ID starting with cbf60b8ba258c7b95b676c12fee23585f4e6b1e1efabeec5fd7d2a06cc8d6cbb not found: ID does not exist" containerID="cbf60b8ba258c7b95b676c12fee23585f4e6b1e1efabeec5fd7d2a06cc8d6cbb" Mar 16 16:40:49 crc kubenswrapper[5120]: I0316 16:40:49.843923 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cbf60b8ba258c7b95b676c12fee23585f4e6b1e1efabeec5fd7d2a06cc8d6cbb"} err="failed to get container status \"cbf60b8ba258c7b95b676c12fee23585f4e6b1e1efabeec5fd7d2a06cc8d6cbb\": rpc error: code = NotFound desc = could not find container \"cbf60b8ba258c7b95b676c12fee23585f4e6b1e1efabeec5fd7d2a06cc8d6cbb\": container with ID starting with cbf60b8ba258c7b95b676c12fee23585f4e6b1e1efabeec5fd7d2a06cc8d6cbb not found: ID does not exist" Mar 16 16:40:49 crc kubenswrapper[5120]: I0316 16:40:49.843949 5120 scope.go:117] "RemoveContainer" containerID="a8072b314fff2b1c990ed73b3acd9752415d424d2482dd6d5c912f553f4e9b34" Mar 16 16:40:49 crc kubenswrapper[5120]: E0316 16:40:49.846174 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a8072b314fff2b1c990ed73b3acd9752415d424d2482dd6d5c912f553f4e9b34\": container with ID starting with a8072b314fff2b1c990ed73b3acd9752415d424d2482dd6d5c912f553f4e9b34 not found: ID does not exist" containerID="a8072b314fff2b1c990ed73b3acd9752415d424d2482dd6d5c912f553f4e9b34" Mar 16 16:40:49 crc kubenswrapper[5120]: I0316 16:40:49.846309 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8072b314fff2b1c990ed73b3acd9752415d424d2482dd6d5c912f553f4e9b34"} err="failed to get container status \"a8072b314fff2b1c990ed73b3acd9752415d424d2482dd6d5c912f553f4e9b34\": rpc error: code = NotFound desc = could not find container \"a8072b314fff2b1c990ed73b3acd9752415d424d2482dd6d5c912f553f4e9b34\": container with ID starting with a8072b314fff2b1c990ed73b3acd9752415d424d2482dd6d5c912f553f4e9b34 not found: ID does not exist" Mar 16 16:40:49 crc kubenswrapper[5120]: I0316 16:40:49.846405 5120 scope.go:117] "RemoveContainer" containerID="a982ca372d85d549ac659914d8caa75f250eef13b6818adf1277a941a1e6937f" Mar 16 16:40:49 crc kubenswrapper[5120]: E0316 16:40:49.848385 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a982ca372d85d549ac659914d8caa75f250eef13b6818adf1277a941a1e6937f\": container with ID starting with a982ca372d85d549ac659914d8caa75f250eef13b6818adf1277a941a1e6937f not found: ID does not exist" containerID="a982ca372d85d549ac659914d8caa75f250eef13b6818adf1277a941a1e6937f" Mar 16 16:40:49 crc kubenswrapper[5120]: I0316 16:40:49.848422 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a982ca372d85d549ac659914d8caa75f250eef13b6818adf1277a941a1e6937f"} err="failed to get container status \"a982ca372d85d549ac659914d8caa75f250eef13b6818adf1277a941a1e6937f\": rpc error: code = NotFound desc = could not find container \"a982ca372d85d549ac659914d8caa75f250eef13b6818adf1277a941a1e6937f\": container with ID starting with a982ca372d85d549ac659914d8caa75f250eef13b6818adf1277a941a1e6937f not found: ID does not exist" Mar 16 16:40:49 crc kubenswrapper[5120]: I0316 16:40:49.848443 5120 scope.go:117] "RemoveContainer" containerID="35fb6bfdcd424e6ff0a095c9fd691a87de447de74b0da74bfad2db6244cb4252" Mar 16 16:40:49 crc kubenswrapper[5120]: E0316 16:40:49.857908 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"35fb6bfdcd424e6ff0a095c9fd691a87de447de74b0da74bfad2db6244cb4252\": container with ID starting with 35fb6bfdcd424e6ff0a095c9fd691a87de447de74b0da74bfad2db6244cb4252 not found: ID does not exist" containerID="35fb6bfdcd424e6ff0a095c9fd691a87de447de74b0da74bfad2db6244cb4252" Mar 16 16:40:49 crc kubenswrapper[5120]: I0316 16:40:49.857951 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35fb6bfdcd424e6ff0a095c9fd691a87de447de74b0da74bfad2db6244cb4252"} err="failed to get container status \"35fb6bfdcd424e6ff0a095c9fd691a87de447de74b0da74bfad2db6244cb4252\": rpc error: code = NotFound desc = could not find container \"35fb6bfdcd424e6ff0a095c9fd691a87de447de74b0da74bfad2db6244cb4252\": container with ID starting with 35fb6bfdcd424e6ff0a095c9fd691a87de447de74b0da74bfad2db6244cb4252 not found: ID does not exist" Mar 16 16:40:49 crc kubenswrapper[5120]: I0316 16:40:49.857977 5120 scope.go:117] "RemoveContainer" containerID="18a6306e072fb085431be9118d7ce43e2d6beecf875dd19faf963c322d3251ef" Mar 16 16:40:49 crc kubenswrapper[5120]: I0316 16:40:49.872363 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f8ee0802-bc93-4415-9fbe-49bd4af907f6-run-httpd\") pod \"ceilometer-0\" (UID: \"f8ee0802-bc93-4415-9fbe-49bd4af907f6\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:40:49 crc kubenswrapper[5120]: I0316 16:40:49.873439 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/f8ee0802-bc93-4415-9fbe-49bd4af907f6-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"f8ee0802-bc93-4415-9fbe-49bd4af907f6\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:40:49 crc kubenswrapper[5120]: I0316 16:40:49.873510 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krk77\" (UniqueName: \"kubernetes.io/projected/f8ee0802-bc93-4415-9fbe-49bd4af907f6-kube-api-access-krk77\") pod \"ceilometer-0\" (UID: \"f8ee0802-bc93-4415-9fbe-49bd4af907f6\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:40:49 crc kubenswrapper[5120]: I0316 16:40:49.873545 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f8ee0802-bc93-4415-9fbe-49bd4af907f6-scripts\") pod \"ceilometer-0\" (UID: \"f8ee0802-bc93-4415-9fbe-49bd4af907f6\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:40:49 crc kubenswrapper[5120]: I0316 16:40:49.873563 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/f8ee0802-bc93-4415-9fbe-49bd4af907f6-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"f8ee0802-bc93-4415-9fbe-49bd4af907f6\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:40:49 crc kubenswrapper[5120]: I0316 16:40:49.873614 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f8ee0802-bc93-4415-9fbe-49bd4af907f6-config-data\") pod \"ceilometer-0\" (UID: \"f8ee0802-bc93-4415-9fbe-49bd4af907f6\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:40:49 crc kubenswrapper[5120]: I0316 16:40:49.873654 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f8ee0802-bc93-4415-9fbe-49bd4af907f6-log-httpd\") pod \"ceilometer-0\" (UID: \"f8ee0802-bc93-4415-9fbe-49bd4af907f6\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:40:49 crc kubenswrapper[5120]: I0316 16:40:49.873669 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f8ee0802-bc93-4415-9fbe-49bd4af907f6-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"f8ee0802-bc93-4415-9fbe-49bd4af907f6\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:40:49 crc kubenswrapper[5120]: I0316 16:40:49.873843 5120 reconciler_common.go:299] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/05676c54-5e12-4b89-a0ad-a5f56b167117-catalog-content\") on node \"crc\" DevicePath \"\"" Mar 16 16:40:49 crc kubenswrapper[5120]: I0316 16:40:49.886448 5120 scope.go:117] "RemoveContainer" containerID="396f8088f26c32a035e0b5f429875248aca7ee99e349748ff90ec15c0bb43694" Mar 16 16:40:49 crc kubenswrapper[5120]: I0316 16:40:49.931140 5120 scope.go:117] "RemoveContainer" containerID="c4baf15dd6211764d7443a703b7f0254a95f62093e3e7815c468dc1ffac80337" Mar 16 16:40:49 crc kubenswrapper[5120]: I0316 16:40:49.971513 5120 scope.go:117] "RemoveContainer" containerID="18a6306e072fb085431be9118d7ce43e2d6beecf875dd19faf963c322d3251ef" Mar 16 16:40:49 crc kubenswrapper[5120]: E0316 16:40:49.972085 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"18a6306e072fb085431be9118d7ce43e2d6beecf875dd19faf963c322d3251ef\": container with ID starting with 18a6306e072fb085431be9118d7ce43e2d6beecf875dd19faf963c322d3251ef not found: ID does not exist" containerID="18a6306e072fb085431be9118d7ce43e2d6beecf875dd19faf963c322d3251ef" Mar 16 16:40:49 crc kubenswrapper[5120]: I0316 16:40:49.972120 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18a6306e072fb085431be9118d7ce43e2d6beecf875dd19faf963c322d3251ef"} err="failed to get container status \"18a6306e072fb085431be9118d7ce43e2d6beecf875dd19faf963c322d3251ef\": rpc error: code = NotFound desc = could not find container \"18a6306e072fb085431be9118d7ce43e2d6beecf875dd19faf963c322d3251ef\": container with ID starting with 18a6306e072fb085431be9118d7ce43e2d6beecf875dd19faf963c322d3251ef not found: ID does not exist" Mar 16 16:40:49 crc kubenswrapper[5120]: I0316 16:40:49.972140 5120 scope.go:117] "RemoveContainer" containerID="396f8088f26c32a035e0b5f429875248aca7ee99e349748ff90ec15c0bb43694" Mar 16 16:40:49 crc kubenswrapper[5120]: E0316 16:40:49.972547 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"396f8088f26c32a035e0b5f429875248aca7ee99e349748ff90ec15c0bb43694\": container with ID starting with 396f8088f26c32a035e0b5f429875248aca7ee99e349748ff90ec15c0bb43694 not found: ID does not exist" containerID="396f8088f26c32a035e0b5f429875248aca7ee99e349748ff90ec15c0bb43694" Mar 16 16:40:49 crc kubenswrapper[5120]: I0316 16:40:49.972567 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"396f8088f26c32a035e0b5f429875248aca7ee99e349748ff90ec15c0bb43694"} err="failed to get container status \"396f8088f26c32a035e0b5f429875248aca7ee99e349748ff90ec15c0bb43694\": rpc error: code = NotFound desc = could not find container \"396f8088f26c32a035e0b5f429875248aca7ee99e349748ff90ec15c0bb43694\": container with ID starting with 396f8088f26c32a035e0b5f429875248aca7ee99e349748ff90ec15c0bb43694 not found: ID does not exist" Mar 16 16:40:49 crc kubenswrapper[5120]: I0316 16:40:49.972581 5120 scope.go:117] "RemoveContainer" containerID="c4baf15dd6211764d7443a703b7f0254a95f62093e3e7815c468dc1ffac80337" Mar 16 16:40:49 crc kubenswrapper[5120]: E0316 16:40:49.972995 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c4baf15dd6211764d7443a703b7f0254a95f62093e3e7815c468dc1ffac80337\": container with ID starting with c4baf15dd6211764d7443a703b7f0254a95f62093e3e7815c468dc1ffac80337 not found: ID does not exist" containerID="c4baf15dd6211764d7443a703b7f0254a95f62093e3e7815c468dc1ffac80337" Mar 16 16:40:49 crc kubenswrapper[5120]: I0316 16:40:49.973038 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4baf15dd6211764d7443a703b7f0254a95f62093e3e7815c468dc1ffac80337"} err="failed to get container status \"c4baf15dd6211764d7443a703b7f0254a95f62093e3e7815c468dc1ffac80337\": rpc error: code = NotFound desc = could not find container \"c4baf15dd6211764d7443a703b7f0254a95f62093e3e7815c468dc1ffac80337\": container with ID starting with c4baf15dd6211764d7443a703b7f0254a95f62093e3e7815c468dc1ffac80337 not found: ID does not exist" Mar 16 16:40:49 crc kubenswrapper[5120]: I0316 16:40:49.975839 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f8ee0802-bc93-4415-9fbe-49bd4af907f6-scripts\") pod \"ceilometer-0\" (UID: \"f8ee0802-bc93-4415-9fbe-49bd4af907f6\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:40:49 crc kubenswrapper[5120]: I0316 16:40:49.975888 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/f8ee0802-bc93-4415-9fbe-49bd4af907f6-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"f8ee0802-bc93-4415-9fbe-49bd4af907f6\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:40:49 crc kubenswrapper[5120]: I0316 16:40:49.975932 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f8ee0802-bc93-4415-9fbe-49bd4af907f6-config-data\") pod \"ceilometer-0\" (UID: \"f8ee0802-bc93-4415-9fbe-49bd4af907f6\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:40:49 crc kubenswrapper[5120]: I0316 16:40:49.975963 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f8ee0802-bc93-4415-9fbe-49bd4af907f6-log-httpd\") pod \"ceilometer-0\" (UID: \"f8ee0802-bc93-4415-9fbe-49bd4af907f6\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:40:49 crc kubenswrapper[5120]: I0316 16:40:49.975978 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f8ee0802-bc93-4415-9fbe-49bd4af907f6-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"f8ee0802-bc93-4415-9fbe-49bd4af907f6\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:40:49 crc kubenswrapper[5120]: I0316 16:40:49.976110 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f8ee0802-bc93-4415-9fbe-49bd4af907f6-run-httpd\") pod \"ceilometer-0\" (UID: \"f8ee0802-bc93-4415-9fbe-49bd4af907f6\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:40:49 crc kubenswrapper[5120]: I0316 16:40:49.976281 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/f8ee0802-bc93-4415-9fbe-49bd4af907f6-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"f8ee0802-bc93-4415-9fbe-49bd4af907f6\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:40:49 crc kubenswrapper[5120]: I0316 16:40:49.976329 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-krk77\" (UniqueName: \"kubernetes.io/projected/f8ee0802-bc93-4415-9fbe-49bd4af907f6-kube-api-access-krk77\") pod \"ceilometer-0\" (UID: \"f8ee0802-bc93-4415-9fbe-49bd4af907f6\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:40:49 crc kubenswrapper[5120]: I0316 16:40:49.976779 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f8ee0802-bc93-4415-9fbe-49bd4af907f6-log-httpd\") pod \"ceilometer-0\" (UID: \"f8ee0802-bc93-4415-9fbe-49bd4af907f6\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:40:49 crc kubenswrapper[5120]: I0316 16:40:49.976892 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f8ee0802-bc93-4415-9fbe-49bd4af907f6-run-httpd\") pod \"ceilometer-0\" (UID: \"f8ee0802-bc93-4415-9fbe-49bd4af907f6\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:40:49 crc kubenswrapper[5120]: I0316 16:40:49.981706 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f8ee0802-bc93-4415-9fbe-49bd4af907f6-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"f8ee0802-bc93-4415-9fbe-49bd4af907f6\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:40:49 crc kubenswrapper[5120]: I0316 16:40:49.983980 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f8ee0802-bc93-4415-9fbe-49bd4af907f6-config-data\") pod \"ceilometer-0\" (UID: \"f8ee0802-bc93-4415-9fbe-49bd4af907f6\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:40:49 crc kubenswrapper[5120]: I0316 16:40:49.984699 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/f8ee0802-bc93-4415-9fbe-49bd4af907f6-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"f8ee0802-bc93-4415-9fbe-49bd4af907f6\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:40:49 crc kubenswrapper[5120]: I0316 16:40:49.984699 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/f8ee0802-bc93-4415-9fbe-49bd4af907f6-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"f8ee0802-bc93-4415-9fbe-49bd4af907f6\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:40:49 crc kubenswrapper[5120]: I0316 16:40:49.986674 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f8ee0802-bc93-4415-9fbe-49bd4af907f6-scripts\") pod \"ceilometer-0\" (UID: \"f8ee0802-bc93-4415-9fbe-49bd4af907f6\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:40:49 crc kubenswrapper[5120]: I0316 16:40:49.994882 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-krk77\" (UniqueName: \"kubernetes.io/projected/f8ee0802-bc93-4415-9fbe-49bd4af907f6-kube-api-access-krk77\") pod \"ceilometer-0\" (UID: \"f8ee0802-bc93-4415-9fbe-49bd4af907f6\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:40:50 crc kubenswrapper[5120]: I0316 16:40:50.035403 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-operators-q69b9"] Mar 16 16:40:50 crc kubenswrapper[5120]: I0316 16:40:50.060461 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/redhat-operators-q69b9"] Mar 16 16:40:50 crc kubenswrapper[5120]: I0316 16:40:50.148302 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:40:50 crc kubenswrapper[5120]: I0316 16:40:50.654680 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:40:50 crc kubenswrapper[5120]: W0316 16:40:50.664209 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf8ee0802_bc93_4415_9fbe_49bd4af907f6.slice/crio-bbdb9d8934a5d37ea30befaa0c9c2112769036f1720618d976eea7730dfcc025 WatchSource:0}: Error finding container bbdb9d8934a5d37ea30befaa0c9c2112769036f1720618d976eea7730dfcc025: Status 404 returned error can't find the container with id bbdb9d8934a5d37ea30befaa0c9c2112769036f1720618d976eea7730dfcc025 Mar 16 16:40:50 crc kubenswrapper[5120]: I0316 16:40:50.678532 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="05676c54-5e12-4b89-a0ad-a5f56b167117" path="/var/lib/kubelet/pods/05676c54-5e12-4b89-a0ad-a5f56b167117/volumes" Mar 16 16:40:50 crc kubenswrapper[5120]: I0316 16:40:50.679429 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="276b4092-4c66-46ec-bce3-0574e8071267" path="/var/lib/kubelet/pods/276b4092-4c66-46ec-bce3-0574e8071267/volumes" Mar 16 16:40:50 crc kubenswrapper[5120]: I0316 16:40:50.706129 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"f8ee0802-bc93-4415-9fbe-49bd4af907f6","Type":"ContainerStarted","Data":"bbdb9d8934a5d37ea30befaa0c9c2112769036f1720618d976eea7730dfcc025"} Mar 16 16:40:51 crc kubenswrapper[5120]: I0316 16:40:51.105075 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:40:51 crc kubenswrapper[5120]: I0316 16:40:51.189771 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/placement-6d66dbd7f8-6ld6p" Mar 16 16:40:51 crc kubenswrapper[5120]: I0316 16:40:51.718915 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"f8ee0802-bc93-4415-9fbe-49bd4af907f6","Type":"ContainerStarted","Data":"b0980d714155eb5a7897d81ad5297a9aa18e39335c54577f4e617fcc4246df50"} Mar 16 16:40:52 crc kubenswrapper[5120]: I0316 16:40:52.513790 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/placement-6d66dbd7f8-6ld6p" Mar 16 16:40:52 crc kubenswrapper[5120]: I0316 16:40:52.606299 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-5c5dddf6d4-cftmc"] Mar 16 16:40:52 crc kubenswrapper[5120]: I0316 16:40:52.606826 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-5c5dddf6d4-cftmc" podUID="f262f286-8308-4657-b286-dfc2eb7e25d3" containerName="placement-api" containerID="cri-o://c5a0f6e83168a0cf60dfaf111cba5ee22fc2309d89188a9a25410953091e05f8" gracePeriod=30 Mar 16 16:40:52 crc kubenswrapper[5120]: I0316 16:40:52.607323 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-5c5dddf6d4-cftmc" podUID="f262f286-8308-4657-b286-dfc2eb7e25d3" containerName="placement-log" containerID="cri-o://2d80e0fe86de1cd949bc03c2684a8c30d1857ef84c67578f22d71e3815f58c9c" gracePeriod=30 Mar 16 16:40:52 crc kubenswrapper[5120]: I0316 16:40:52.734617 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"f8ee0802-bc93-4415-9fbe-49bd4af907f6","Type":"ContainerStarted","Data":"1c5c85a1bfc14651488cb34d01a9fa071f5ad844d3d0bb16512e09fe46b156b1"} Mar 16 16:40:53 crc kubenswrapper[5120]: I0316 16:40:53.756992 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"f8ee0802-bc93-4415-9fbe-49bd4af907f6","Type":"ContainerStarted","Data":"87a80b3fc7765e53891894a57a05d9793aaa6d211e0ca0bb23827687b5d47bfa"} Mar 16 16:40:53 crc kubenswrapper[5120]: I0316 16:40:53.759611 5120 generic.go:358] "Generic (PLEG): container finished" podID="f262f286-8308-4657-b286-dfc2eb7e25d3" containerID="2d80e0fe86de1cd949bc03c2684a8c30d1857ef84c67578f22d71e3815f58c9c" exitCode=143 Mar 16 16:40:53 crc kubenswrapper[5120]: I0316 16:40:53.759945 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-5c5dddf6d4-cftmc" event={"ID":"f262f286-8308-4657-b286-dfc2eb7e25d3","Type":"ContainerDied","Data":"2d80e0fe86de1cd949bc03c2684a8c30d1857ef84c67578f22d71e3815f58c9c"} Mar 16 16:40:55 crc kubenswrapper[5120]: I0316 16:40:55.630614 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:40:55 crc kubenswrapper[5120]: I0316 16:40:55.632077 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="43ae87ab-7a99-41df-b39a-930c7a5a232d" containerName="glance-log" containerID="cri-o://d0c6819deb917d9e91985bf1d131648bddd7748dcdbdf7c7ca71e50fc7381c7c" gracePeriod=30 Mar 16 16:40:55 crc kubenswrapper[5120]: I0316 16:40:55.632209 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="43ae87ab-7a99-41df-b39a-930c7a5a232d" containerName="glance-httpd" containerID="cri-o://50956264ae2e609fe5c7b13617c8592d52746a64d7f4828722e5fd9abf9f90ff" gracePeriod=30 Mar 16 16:40:55 crc kubenswrapper[5120]: I0316 16:40:55.784359 5120 generic.go:358] "Generic (PLEG): container finished" podID="43ae87ab-7a99-41df-b39a-930c7a5a232d" containerID="d0c6819deb917d9e91985bf1d131648bddd7748dcdbdf7c7ca71e50fc7381c7c" exitCode=143 Mar 16 16:40:55 crc kubenswrapper[5120]: I0316 16:40:55.784437 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"43ae87ab-7a99-41df-b39a-930c7a5a232d","Type":"ContainerDied","Data":"d0c6819deb917d9e91985bf1d131648bddd7748dcdbdf7c7ca71e50fc7381c7c"} Mar 16 16:40:55 crc kubenswrapper[5120]: I0316 16:40:55.799574 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"f8ee0802-bc93-4415-9fbe-49bd4af907f6","Type":"ContainerStarted","Data":"229b97259bb83e63ce7e70d315343d0dfcc17c75ea30cebfc648e04eccb4d24e"} Mar 16 16:40:55 crc kubenswrapper[5120]: I0316 16:40:55.799652 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:40:55 crc kubenswrapper[5120]: I0316 16:40:55.799647 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="f8ee0802-bc93-4415-9fbe-49bd4af907f6" containerName="ceilometer-central-agent" containerID="cri-o://b0980d714155eb5a7897d81ad5297a9aa18e39335c54577f4e617fcc4246df50" gracePeriod=30 Mar 16 16:40:55 crc kubenswrapper[5120]: I0316 16:40:55.799787 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="f8ee0802-bc93-4415-9fbe-49bd4af907f6" containerName="proxy-httpd" containerID="cri-o://229b97259bb83e63ce7e70d315343d0dfcc17c75ea30cebfc648e04eccb4d24e" gracePeriod=30 Mar 16 16:40:55 crc kubenswrapper[5120]: I0316 16:40:55.799804 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="f8ee0802-bc93-4415-9fbe-49bd4af907f6" containerName="sg-core" containerID="cri-o://87a80b3fc7765e53891894a57a05d9793aaa6d211e0ca0bb23827687b5d47bfa" gracePeriod=30 Mar 16 16:40:55 crc kubenswrapper[5120]: I0316 16:40:55.799846 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="f8ee0802-bc93-4415-9fbe-49bd4af907f6" containerName="ceilometer-notification-agent" containerID="cri-o://1c5c85a1bfc14651488cb34d01a9fa071f5ad844d3d0bb16512e09fe46b156b1" gracePeriod=30 Mar 16 16:40:55 crc kubenswrapper[5120]: I0316 16:40:55.826040 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.081928164 podStartE2EDuration="6.826019971s" podCreationTimestamp="2026-03-16 16:40:49 +0000 UTC" firstStartedPulling="2026-03-16 16:40:50.665701267 +0000 UTC m=+4152.819632924" lastFinishedPulling="2026-03-16 16:40:55.409793074 +0000 UTC m=+4157.563724731" observedRunningTime="2026-03-16 16:40:55.816098302 +0000 UTC m=+4157.970029959" watchObservedRunningTime="2026-03-16 16:40:55.826019971 +0000 UTC m=+4157.979951628" Mar 16 16:40:56 crc kubenswrapper[5120]: I0316 16:40:56.264289 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-5c5dddf6d4-cftmc" Mar 16 16:40:56 crc kubenswrapper[5120]: I0316 16:40:56.332015 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f262f286-8308-4657-b286-dfc2eb7e25d3-logs\") pod \"f262f286-8308-4657-b286-dfc2eb7e25d3\" (UID: \"f262f286-8308-4657-b286-dfc2eb7e25d3\") " Mar 16 16:40:56 crc kubenswrapper[5120]: I0316 16:40:56.332181 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f262f286-8308-4657-b286-dfc2eb7e25d3-combined-ca-bundle\") pod \"f262f286-8308-4657-b286-dfc2eb7e25d3\" (UID: \"f262f286-8308-4657-b286-dfc2eb7e25d3\") " Mar 16 16:40:56 crc kubenswrapper[5120]: I0316 16:40:56.332217 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f262f286-8308-4657-b286-dfc2eb7e25d3-config-data\") pod \"f262f286-8308-4657-b286-dfc2eb7e25d3\" (UID: \"f262f286-8308-4657-b286-dfc2eb7e25d3\") " Mar 16 16:40:56 crc kubenswrapper[5120]: I0316 16:40:56.332399 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jl462\" (UniqueName: \"kubernetes.io/projected/f262f286-8308-4657-b286-dfc2eb7e25d3-kube-api-access-jl462\") pod \"f262f286-8308-4657-b286-dfc2eb7e25d3\" (UID: \"f262f286-8308-4657-b286-dfc2eb7e25d3\") " Mar 16 16:40:56 crc kubenswrapper[5120]: I0316 16:40:56.332458 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f262f286-8308-4657-b286-dfc2eb7e25d3-public-tls-certs\") pod \"f262f286-8308-4657-b286-dfc2eb7e25d3\" (UID: \"f262f286-8308-4657-b286-dfc2eb7e25d3\") " Mar 16 16:40:56 crc kubenswrapper[5120]: I0316 16:40:56.332517 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f262f286-8308-4657-b286-dfc2eb7e25d3-internal-tls-certs\") pod \"f262f286-8308-4657-b286-dfc2eb7e25d3\" (UID: \"f262f286-8308-4657-b286-dfc2eb7e25d3\") " Mar 16 16:40:56 crc kubenswrapper[5120]: I0316 16:40:56.332571 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f262f286-8308-4657-b286-dfc2eb7e25d3-scripts\") pod \"f262f286-8308-4657-b286-dfc2eb7e25d3\" (UID: \"f262f286-8308-4657-b286-dfc2eb7e25d3\") " Mar 16 16:40:56 crc kubenswrapper[5120]: I0316 16:40:56.332461 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f262f286-8308-4657-b286-dfc2eb7e25d3-logs" (OuterVolumeSpecName: "logs") pod "f262f286-8308-4657-b286-dfc2eb7e25d3" (UID: "f262f286-8308-4657-b286-dfc2eb7e25d3"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:40:56 crc kubenswrapper[5120]: I0316 16:40:56.333967 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f262f286-8308-4657-b286-dfc2eb7e25d3-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:40:56 crc kubenswrapper[5120]: I0316 16:40:56.337911 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f262f286-8308-4657-b286-dfc2eb7e25d3-kube-api-access-jl462" (OuterVolumeSpecName: "kube-api-access-jl462") pod "f262f286-8308-4657-b286-dfc2eb7e25d3" (UID: "f262f286-8308-4657-b286-dfc2eb7e25d3"). InnerVolumeSpecName "kube-api-access-jl462". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:40:56 crc kubenswrapper[5120]: I0316 16:40:56.338422 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f262f286-8308-4657-b286-dfc2eb7e25d3-scripts" (OuterVolumeSpecName: "scripts") pod "f262f286-8308-4657-b286-dfc2eb7e25d3" (UID: "f262f286-8308-4657-b286-dfc2eb7e25d3"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:40:56 crc kubenswrapper[5120]: I0316 16:40:56.394147 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f262f286-8308-4657-b286-dfc2eb7e25d3-config-data" (OuterVolumeSpecName: "config-data") pod "f262f286-8308-4657-b286-dfc2eb7e25d3" (UID: "f262f286-8308-4657-b286-dfc2eb7e25d3"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:40:56 crc kubenswrapper[5120]: I0316 16:40:56.408508 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f262f286-8308-4657-b286-dfc2eb7e25d3-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f262f286-8308-4657-b286-dfc2eb7e25d3" (UID: "f262f286-8308-4657-b286-dfc2eb7e25d3"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:40:56 crc kubenswrapper[5120]: I0316 16:40:56.436773 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f262f286-8308-4657-b286-dfc2eb7e25d3-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:40:56 crc kubenswrapper[5120]: I0316 16:40:56.436814 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f262f286-8308-4657-b286-dfc2eb7e25d3-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:40:56 crc kubenswrapper[5120]: I0316 16:40:56.436830 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jl462\" (UniqueName: \"kubernetes.io/projected/f262f286-8308-4657-b286-dfc2eb7e25d3-kube-api-access-jl462\") on node \"crc\" DevicePath \"\"" Mar 16 16:40:56 crc kubenswrapper[5120]: I0316 16:40:56.436848 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f262f286-8308-4657-b286-dfc2eb7e25d3-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:40:56 crc kubenswrapper[5120]: I0316 16:40:56.445275 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f262f286-8308-4657-b286-dfc2eb7e25d3-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "f262f286-8308-4657-b286-dfc2eb7e25d3" (UID: "f262f286-8308-4657-b286-dfc2eb7e25d3"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:40:56 crc kubenswrapper[5120]: I0316 16:40:56.457885 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f262f286-8308-4657-b286-dfc2eb7e25d3-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "f262f286-8308-4657-b286-dfc2eb7e25d3" (UID: "f262f286-8308-4657-b286-dfc2eb7e25d3"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:40:56 crc kubenswrapper[5120]: I0316 16:40:56.539215 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f262f286-8308-4657-b286-dfc2eb7e25d3-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:40:56 crc kubenswrapper[5120]: I0316 16:40:56.539246 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f262f286-8308-4657-b286-dfc2eb7e25d3-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:40:56 crc kubenswrapper[5120]: I0316 16:40:56.548086 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:40:56 crc kubenswrapper[5120]: I0316 16:40:56.548333 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="f4685058-90ec-421d-b95e-ca68dc1d4dcd" containerName="glance-log" containerID="cri-o://3ae6cb990e461484ce43a5123f5b9883d35e8186a0e537eaaee70bc093a3f8b2" gracePeriod=30 Mar 16 16:40:56 crc kubenswrapper[5120]: I0316 16:40:56.548472 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="f4685058-90ec-421d-b95e-ca68dc1d4dcd" containerName="glance-httpd" containerID="cri-o://ca0ae3a8b4b307a12c44d686843908626a380c9becf90b91194b05d243c4f28b" gracePeriod=30 Mar 16 16:40:56 crc kubenswrapper[5120]: I0316 16:40:56.638384 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:40:56 crc kubenswrapper[5120]: I0316 16:40:56.824423 5120 generic.go:358] "Generic (PLEG): container finished" podID="f8ee0802-bc93-4415-9fbe-49bd4af907f6" containerID="229b97259bb83e63ce7e70d315343d0dfcc17c75ea30cebfc648e04eccb4d24e" exitCode=0 Mar 16 16:40:56 crc kubenswrapper[5120]: I0316 16:40:56.824456 5120 generic.go:358] "Generic (PLEG): container finished" podID="f8ee0802-bc93-4415-9fbe-49bd4af907f6" containerID="87a80b3fc7765e53891894a57a05d9793aaa6d211e0ca0bb23827687b5d47bfa" exitCode=2 Mar 16 16:40:56 crc kubenswrapper[5120]: I0316 16:40:56.824463 5120 generic.go:358] "Generic (PLEG): container finished" podID="f8ee0802-bc93-4415-9fbe-49bd4af907f6" containerID="1c5c85a1bfc14651488cb34d01a9fa071f5ad844d3d0bb16512e09fe46b156b1" exitCode=0 Mar 16 16:40:56 crc kubenswrapper[5120]: I0316 16:40:56.824606 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"f8ee0802-bc93-4415-9fbe-49bd4af907f6","Type":"ContainerDied","Data":"229b97259bb83e63ce7e70d315343d0dfcc17c75ea30cebfc648e04eccb4d24e"} Mar 16 16:40:56 crc kubenswrapper[5120]: I0316 16:40:56.824634 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"f8ee0802-bc93-4415-9fbe-49bd4af907f6","Type":"ContainerDied","Data":"87a80b3fc7765e53891894a57a05d9793aaa6d211e0ca0bb23827687b5d47bfa"} Mar 16 16:40:56 crc kubenswrapper[5120]: I0316 16:40:56.824645 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"f8ee0802-bc93-4415-9fbe-49bd4af907f6","Type":"ContainerDied","Data":"1c5c85a1bfc14651488cb34d01a9fa071f5ad844d3d0bb16512e09fe46b156b1"} Mar 16 16:40:56 crc kubenswrapper[5120]: I0316 16:40:56.827186 5120 generic.go:358] "Generic (PLEG): container finished" podID="f262f286-8308-4657-b286-dfc2eb7e25d3" containerID="c5a0f6e83168a0cf60dfaf111cba5ee22fc2309d89188a9a25410953091e05f8" exitCode=0 Mar 16 16:40:56 crc kubenswrapper[5120]: I0316 16:40:56.827252 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-5c5dddf6d4-cftmc" Mar 16 16:40:56 crc kubenswrapper[5120]: I0316 16:40:56.827331 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-5c5dddf6d4-cftmc" event={"ID":"f262f286-8308-4657-b286-dfc2eb7e25d3","Type":"ContainerDied","Data":"c5a0f6e83168a0cf60dfaf111cba5ee22fc2309d89188a9a25410953091e05f8"} Mar 16 16:40:56 crc kubenswrapper[5120]: I0316 16:40:56.827392 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-5c5dddf6d4-cftmc" event={"ID":"f262f286-8308-4657-b286-dfc2eb7e25d3","Type":"ContainerDied","Data":"5d7ef6c0ecb6f0e64835d5364b6fff320ef81c003a24c6fd80f96da12da5b8b5"} Mar 16 16:40:56 crc kubenswrapper[5120]: I0316 16:40:56.827414 5120 scope.go:117] "RemoveContainer" containerID="c5a0f6e83168a0cf60dfaf111cba5ee22fc2309d89188a9a25410953091e05f8" Mar 16 16:40:56 crc kubenswrapper[5120]: I0316 16:40:56.837391 5120 generic.go:358] "Generic (PLEG): container finished" podID="f4685058-90ec-421d-b95e-ca68dc1d4dcd" containerID="3ae6cb990e461484ce43a5123f5b9883d35e8186a0e537eaaee70bc093a3f8b2" exitCode=143 Mar 16 16:40:56 crc kubenswrapper[5120]: I0316 16:40:56.837661 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"f4685058-90ec-421d-b95e-ca68dc1d4dcd","Type":"ContainerDied","Data":"3ae6cb990e461484ce43a5123f5b9883d35e8186a0e537eaaee70bc093a3f8b2"} Mar 16 16:40:56 crc kubenswrapper[5120]: I0316 16:40:56.858116 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-5c5dddf6d4-cftmc"] Mar 16 16:40:56 crc kubenswrapper[5120]: I0316 16:40:56.860261 5120 scope.go:117] "RemoveContainer" containerID="2d80e0fe86de1cd949bc03c2684a8c30d1857ef84c67578f22d71e3815f58c9c" Mar 16 16:40:56 crc kubenswrapper[5120]: I0316 16:40:56.866896 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-5c5dddf6d4-cftmc"] Mar 16 16:40:56 crc kubenswrapper[5120]: I0316 16:40:56.888319 5120 scope.go:117] "RemoveContainer" containerID="c5a0f6e83168a0cf60dfaf111cba5ee22fc2309d89188a9a25410953091e05f8" Mar 16 16:40:56 crc kubenswrapper[5120]: E0316 16:40:56.888867 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5a0f6e83168a0cf60dfaf111cba5ee22fc2309d89188a9a25410953091e05f8\": container with ID starting with c5a0f6e83168a0cf60dfaf111cba5ee22fc2309d89188a9a25410953091e05f8 not found: ID does not exist" containerID="c5a0f6e83168a0cf60dfaf111cba5ee22fc2309d89188a9a25410953091e05f8" Mar 16 16:40:56 crc kubenswrapper[5120]: I0316 16:40:56.888910 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5a0f6e83168a0cf60dfaf111cba5ee22fc2309d89188a9a25410953091e05f8"} err="failed to get container status \"c5a0f6e83168a0cf60dfaf111cba5ee22fc2309d89188a9a25410953091e05f8\": rpc error: code = NotFound desc = could not find container \"c5a0f6e83168a0cf60dfaf111cba5ee22fc2309d89188a9a25410953091e05f8\": container with ID starting with c5a0f6e83168a0cf60dfaf111cba5ee22fc2309d89188a9a25410953091e05f8 not found: ID does not exist" Mar 16 16:40:56 crc kubenswrapper[5120]: I0316 16:40:56.888939 5120 scope.go:117] "RemoveContainer" containerID="2d80e0fe86de1cd949bc03c2684a8c30d1857ef84c67578f22d71e3815f58c9c" Mar 16 16:40:56 crc kubenswrapper[5120]: E0316 16:40:56.889491 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d80e0fe86de1cd949bc03c2684a8c30d1857ef84c67578f22d71e3815f58c9c\": container with ID starting with 2d80e0fe86de1cd949bc03c2684a8c30d1857ef84c67578f22d71e3815f58c9c not found: ID does not exist" containerID="2d80e0fe86de1cd949bc03c2684a8c30d1857ef84c67578f22d71e3815f58c9c" Mar 16 16:40:56 crc kubenswrapper[5120]: I0316 16:40:56.889534 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d80e0fe86de1cd949bc03c2684a8c30d1857ef84c67578f22d71e3815f58c9c"} err="failed to get container status \"2d80e0fe86de1cd949bc03c2684a8c30d1857ef84c67578f22d71e3815f58c9c\": rpc error: code = NotFound desc = could not find container \"2d80e0fe86de1cd949bc03c2684a8c30d1857ef84c67578f22d71e3815f58c9c\": container with ID starting with 2d80e0fe86de1cd949bc03c2684a8c30d1857ef84c67578f22d71e3815f58c9c not found: ID does not exist" Mar 16 16:40:58 crc kubenswrapper[5120]: I0316 16:40:58.396725 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:40:58 crc kubenswrapper[5120]: I0316 16:40:58.483873 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f8ee0802-bc93-4415-9fbe-49bd4af907f6-run-httpd\") pod \"f8ee0802-bc93-4415-9fbe-49bd4af907f6\" (UID: \"f8ee0802-bc93-4415-9fbe-49bd4af907f6\") " Mar 16 16:40:58 crc kubenswrapper[5120]: I0316 16:40:58.483977 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f8ee0802-bc93-4415-9fbe-49bd4af907f6-scripts\") pod \"f8ee0802-bc93-4415-9fbe-49bd4af907f6\" (UID: \"f8ee0802-bc93-4415-9fbe-49bd4af907f6\") " Mar 16 16:40:58 crc kubenswrapper[5120]: I0316 16:40:58.484043 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f8ee0802-bc93-4415-9fbe-49bd4af907f6-config-data\") pod \"f8ee0802-bc93-4415-9fbe-49bd4af907f6\" (UID: \"f8ee0802-bc93-4415-9fbe-49bd4af907f6\") " Mar 16 16:40:58 crc kubenswrapper[5120]: I0316 16:40:58.484296 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-krk77\" (UniqueName: \"kubernetes.io/projected/f8ee0802-bc93-4415-9fbe-49bd4af907f6-kube-api-access-krk77\") pod \"f8ee0802-bc93-4415-9fbe-49bd4af907f6\" (UID: \"f8ee0802-bc93-4415-9fbe-49bd4af907f6\") " Mar 16 16:40:58 crc kubenswrapper[5120]: I0316 16:40:58.484382 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/f8ee0802-bc93-4415-9fbe-49bd4af907f6-sg-core-conf-yaml\") pod \"f8ee0802-bc93-4415-9fbe-49bd4af907f6\" (UID: \"f8ee0802-bc93-4415-9fbe-49bd4af907f6\") " Mar 16 16:40:58 crc kubenswrapper[5120]: I0316 16:40:58.484586 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f8ee0802-bc93-4415-9fbe-49bd4af907f6-combined-ca-bundle\") pod \"f8ee0802-bc93-4415-9fbe-49bd4af907f6\" (UID: \"f8ee0802-bc93-4415-9fbe-49bd4af907f6\") " Mar 16 16:40:58 crc kubenswrapper[5120]: I0316 16:40:58.484679 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f8ee0802-bc93-4415-9fbe-49bd4af907f6-log-httpd\") pod \"f8ee0802-bc93-4415-9fbe-49bd4af907f6\" (UID: \"f8ee0802-bc93-4415-9fbe-49bd4af907f6\") " Mar 16 16:40:58 crc kubenswrapper[5120]: I0316 16:40:58.484832 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/f8ee0802-bc93-4415-9fbe-49bd4af907f6-ceilometer-tls-certs\") pod \"f8ee0802-bc93-4415-9fbe-49bd4af907f6\" (UID: \"f8ee0802-bc93-4415-9fbe-49bd4af907f6\") " Mar 16 16:40:58 crc kubenswrapper[5120]: I0316 16:40:58.485316 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8ee0802-bc93-4415-9fbe-49bd4af907f6-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "f8ee0802-bc93-4415-9fbe-49bd4af907f6" (UID: "f8ee0802-bc93-4415-9fbe-49bd4af907f6"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:40:58 crc kubenswrapper[5120]: I0316 16:40:58.485382 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8ee0802-bc93-4415-9fbe-49bd4af907f6-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "f8ee0802-bc93-4415-9fbe-49bd4af907f6" (UID: "f8ee0802-bc93-4415-9fbe-49bd4af907f6"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:40:58 crc kubenswrapper[5120]: I0316 16:40:58.490950 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f8ee0802-bc93-4415-9fbe-49bd4af907f6-scripts" (OuterVolumeSpecName: "scripts") pod "f8ee0802-bc93-4415-9fbe-49bd4af907f6" (UID: "f8ee0802-bc93-4415-9fbe-49bd4af907f6"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:40:58 crc kubenswrapper[5120]: I0316 16:40:58.491349 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8ee0802-bc93-4415-9fbe-49bd4af907f6-kube-api-access-krk77" (OuterVolumeSpecName: "kube-api-access-krk77") pod "f8ee0802-bc93-4415-9fbe-49bd4af907f6" (UID: "f8ee0802-bc93-4415-9fbe-49bd4af907f6"). InnerVolumeSpecName "kube-api-access-krk77". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:40:58 crc kubenswrapper[5120]: I0316 16:40:58.515408 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f8ee0802-bc93-4415-9fbe-49bd4af907f6-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "f8ee0802-bc93-4415-9fbe-49bd4af907f6" (UID: "f8ee0802-bc93-4415-9fbe-49bd4af907f6"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:40:58 crc kubenswrapper[5120]: I0316 16:40:58.537971 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f8ee0802-bc93-4415-9fbe-49bd4af907f6-ceilometer-tls-certs" (OuterVolumeSpecName: "ceilometer-tls-certs") pod "f8ee0802-bc93-4415-9fbe-49bd4af907f6" (UID: "f8ee0802-bc93-4415-9fbe-49bd4af907f6"). InnerVolumeSpecName "ceilometer-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:40:58 crc kubenswrapper[5120]: I0316 16:40:58.568365 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f8ee0802-bc93-4415-9fbe-49bd4af907f6-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f8ee0802-bc93-4415-9fbe-49bd4af907f6" (UID: "f8ee0802-bc93-4415-9fbe-49bd4af907f6"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:40:58 crc kubenswrapper[5120]: I0316 16:40:58.587385 5120 reconciler_common.go:299] "Volume detached for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/f8ee0802-bc93-4415-9fbe-49bd4af907f6-ceilometer-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:40:58 crc kubenswrapper[5120]: I0316 16:40:58.587436 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f8ee0802-bc93-4415-9fbe-49bd4af907f6-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:40:58 crc kubenswrapper[5120]: I0316 16:40:58.587446 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f8ee0802-bc93-4415-9fbe-49bd4af907f6-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:40:58 crc kubenswrapper[5120]: I0316 16:40:58.587455 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-krk77\" (UniqueName: \"kubernetes.io/projected/f8ee0802-bc93-4415-9fbe-49bd4af907f6-kube-api-access-krk77\") on node \"crc\" DevicePath \"\"" Mar 16 16:40:58 crc kubenswrapper[5120]: I0316 16:40:58.587464 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/f8ee0802-bc93-4415-9fbe-49bd4af907f6-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 16:40:58 crc kubenswrapper[5120]: I0316 16:40:58.587492 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f8ee0802-bc93-4415-9fbe-49bd4af907f6-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:40:58 crc kubenswrapper[5120]: I0316 16:40:58.587501 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f8ee0802-bc93-4415-9fbe-49bd4af907f6-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:40:58 crc kubenswrapper[5120]: I0316 16:40:58.608172 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f8ee0802-bc93-4415-9fbe-49bd4af907f6-config-data" (OuterVolumeSpecName: "config-data") pod "f8ee0802-bc93-4415-9fbe-49bd4af907f6" (UID: "f8ee0802-bc93-4415-9fbe-49bd4af907f6"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:40:58 crc kubenswrapper[5120]: I0316 16:40:58.674615 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f262f286-8308-4657-b286-dfc2eb7e25d3" path="/var/lib/kubelet/pods/f262f286-8308-4657-b286-dfc2eb7e25d3/volumes" Mar 16 16:40:58 crc kubenswrapper[5120]: I0316 16:40:58.689300 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f8ee0802-bc93-4415-9fbe-49bd4af907f6-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:40:58 crc kubenswrapper[5120]: I0316 16:40:58.859666 5120 generic.go:358] "Generic (PLEG): container finished" podID="f8ee0802-bc93-4415-9fbe-49bd4af907f6" containerID="b0980d714155eb5a7897d81ad5297a9aa18e39335c54577f4e617fcc4246df50" exitCode=0 Mar 16 16:40:58 crc kubenswrapper[5120]: I0316 16:40:58.859703 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"f8ee0802-bc93-4415-9fbe-49bd4af907f6","Type":"ContainerDied","Data":"b0980d714155eb5a7897d81ad5297a9aa18e39335c54577f4e617fcc4246df50"} Mar 16 16:40:58 crc kubenswrapper[5120]: I0316 16:40:58.859748 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"f8ee0802-bc93-4415-9fbe-49bd4af907f6","Type":"ContainerDied","Data":"bbdb9d8934a5d37ea30befaa0c9c2112769036f1720618d976eea7730dfcc025"} Mar 16 16:40:58 crc kubenswrapper[5120]: I0316 16:40:58.859750 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:40:58 crc kubenswrapper[5120]: I0316 16:40:58.859782 5120 scope.go:117] "RemoveContainer" containerID="229b97259bb83e63ce7e70d315343d0dfcc17c75ea30cebfc648e04eccb4d24e" Mar 16 16:40:58 crc kubenswrapper[5120]: I0316 16:40:58.903826 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:40:58 crc kubenswrapper[5120]: I0316 16:40:58.915947 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:40:58 crc kubenswrapper[5120]: I0316 16:40:58.932372 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:40:58 crc kubenswrapper[5120]: I0316 16:40:58.933388 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f262f286-8308-4657-b286-dfc2eb7e25d3" containerName="placement-log" Mar 16 16:40:58 crc kubenswrapper[5120]: I0316 16:40:58.933407 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f262f286-8308-4657-b286-dfc2eb7e25d3" containerName="placement-log" Mar 16 16:40:58 crc kubenswrapper[5120]: I0316 16:40:58.933427 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8ee0802-bc93-4415-9fbe-49bd4af907f6" containerName="ceilometer-central-agent" Mar 16 16:40:58 crc kubenswrapper[5120]: I0316 16:40:58.933433 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8ee0802-bc93-4415-9fbe-49bd4af907f6" containerName="ceilometer-central-agent" Mar 16 16:40:58 crc kubenswrapper[5120]: I0316 16:40:58.933451 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f262f286-8308-4657-b286-dfc2eb7e25d3" containerName="placement-api" Mar 16 16:40:58 crc kubenswrapper[5120]: I0316 16:40:58.933456 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f262f286-8308-4657-b286-dfc2eb7e25d3" containerName="placement-api" Mar 16 16:40:58 crc kubenswrapper[5120]: I0316 16:40:58.933469 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8ee0802-bc93-4415-9fbe-49bd4af907f6" containerName="ceilometer-notification-agent" Mar 16 16:40:58 crc kubenswrapper[5120]: I0316 16:40:58.933475 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8ee0802-bc93-4415-9fbe-49bd4af907f6" containerName="ceilometer-notification-agent" Mar 16 16:40:58 crc kubenswrapper[5120]: I0316 16:40:58.933490 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8ee0802-bc93-4415-9fbe-49bd4af907f6" containerName="proxy-httpd" Mar 16 16:40:58 crc kubenswrapper[5120]: I0316 16:40:58.933495 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8ee0802-bc93-4415-9fbe-49bd4af907f6" containerName="proxy-httpd" Mar 16 16:40:58 crc kubenswrapper[5120]: I0316 16:40:58.933506 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8ee0802-bc93-4415-9fbe-49bd4af907f6" containerName="sg-core" Mar 16 16:40:58 crc kubenswrapper[5120]: I0316 16:40:58.933511 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8ee0802-bc93-4415-9fbe-49bd4af907f6" containerName="sg-core" Mar 16 16:40:58 crc kubenswrapper[5120]: I0316 16:40:58.933705 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f8ee0802-bc93-4415-9fbe-49bd4af907f6" containerName="sg-core" Mar 16 16:40:58 crc kubenswrapper[5120]: I0316 16:40:58.933717 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f8ee0802-bc93-4415-9fbe-49bd4af907f6" containerName="ceilometer-notification-agent" Mar 16 16:40:58 crc kubenswrapper[5120]: I0316 16:40:58.933727 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f262f286-8308-4657-b286-dfc2eb7e25d3" containerName="placement-log" Mar 16 16:40:58 crc kubenswrapper[5120]: I0316 16:40:58.933734 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f8ee0802-bc93-4415-9fbe-49bd4af907f6" containerName="proxy-httpd" Mar 16 16:40:58 crc kubenswrapper[5120]: I0316 16:40:58.933742 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f8ee0802-bc93-4415-9fbe-49bd4af907f6" containerName="ceilometer-central-agent" Mar 16 16:40:58 crc kubenswrapper[5120]: I0316 16:40:58.933754 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f262f286-8308-4657-b286-dfc2eb7e25d3" containerName="placement-api" Mar 16 16:40:58 crc kubenswrapper[5120]: I0316 16:40:58.961540 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:40:58 crc kubenswrapper[5120]: I0316 16:40:58.961689 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:40:58 crc kubenswrapper[5120]: I0316 16:40:58.972676 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 16:40:58 crc kubenswrapper[5120]: I0316 16:40:58.972901 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 16:40:58 crc kubenswrapper[5120]: I0316 16:40:58.973832 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ceilometer-internal-svc\"" Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.072120 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-pjkj4"] Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.079293 5120 scope.go:117] "RemoveContainer" containerID="87a80b3fc7765e53891894a57a05d9793aaa6d211e0ca0bb23827687b5d47bfa" Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.081722 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-db-create-pjkj4" Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.095636 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-pjkj4"] Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.113964 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/514e99fe-d081-465e-9afb-fc169395f13b-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"514e99fe-d081-465e-9afb-fc169395f13b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.114042 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pghdp\" (UniqueName: \"kubernetes.io/projected/514e99fe-d081-465e-9afb-fc169395f13b-kube-api-access-pghdp\") pod \"ceilometer-0\" (UID: \"514e99fe-d081-465e-9afb-fc169395f13b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.114134 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/514e99fe-d081-465e-9afb-fc169395f13b-scripts\") pod \"ceilometer-0\" (UID: \"514e99fe-d081-465e-9afb-fc169395f13b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.114201 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/514e99fe-d081-465e-9afb-fc169395f13b-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"514e99fe-d081-465e-9afb-fc169395f13b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.114265 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/514e99fe-d081-465e-9afb-fc169395f13b-config-data\") pod \"ceilometer-0\" (UID: \"514e99fe-d081-465e-9afb-fc169395f13b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.114401 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/514e99fe-d081-465e-9afb-fc169395f13b-run-httpd\") pod \"ceilometer-0\" (UID: \"514e99fe-d081-465e-9afb-fc169395f13b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.114502 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/514e99fe-d081-465e-9afb-fc169395f13b-log-httpd\") pod \"ceilometer-0\" (UID: \"514e99fe-d081-465e-9afb-fc169395f13b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.114522 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/514e99fe-d081-465e-9afb-fc169395f13b-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"514e99fe-d081-465e-9afb-fc169395f13b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.148270 5120 scope.go:117] "RemoveContainer" containerID="1c5c85a1bfc14651488cb34d01a9fa071f5ad844d3d0bb16512e09fe46b156b1" Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.173697 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-nn2pp"] Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.184282 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-db-create-nn2pp" Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.206631 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-nn2pp"] Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.219630 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/514e99fe-d081-465e-9afb-fc169395f13b-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"514e99fe-d081-465e-9afb-fc169395f13b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.221427 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/6d750838-2144-4d02-9e1f-a3a3f0a3ba9d-operator-scripts\") pod \"nova-api-db-create-pjkj4\" (UID: \"6d750838-2144-4d02-9e1f-a3a3f0a3ba9d\") " pod="openstack-kuttl-tests/nova-api-db-create-pjkj4" Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.221481 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/514e99fe-d081-465e-9afb-fc169395f13b-config-data\") pod \"ceilometer-0\" (UID: \"514e99fe-d081-465e-9afb-fc169395f13b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.221595 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/514e99fe-d081-465e-9afb-fc169395f13b-run-httpd\") pod \"ceilometer-0\" (UID: \"514e99fe-d081-465e-9afb-fc169395f13b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.221702 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/514e99fe-d081-465e-9afb-fc169395f13b-log-httpd\") pod \"ceilometer-0\" (UID: \"514e99fe-d081-465e-9afb-fc169395f13b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.221723 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/514e99fe-d081-465e-9afb-fc169395f13b-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"514e99fe-d081-465e-9afb-fc169395f13b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.221831 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/514e99fe-d081-465e-9afb-fc169395f13b-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"514e99fe-d081-465e-9afb-fc169395f13b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.221892 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pghdp\" (UniqueName: \"kubernetes.io/projected/514e99fe-d081-465e-9afb-fc169395f13b-kube-api-access-pghdp\") pod \"ceilometer-0\" (UID: \"514e99fe-d081-465e-9afb-fc169395f13b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.222009 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/514e99fe-d081-465e-9afb-fc169395f13b-scripts\") pod \"ceilometer-0\" (UID: \"514e99fe-d081-465e-9afb-fc169395f13b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.222027 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6l6mw\" (UniqueName: \"kubernetes.io/projected/6d750838-2144-4d02-9e1f-a3a3f0a3ba9d-kube-api-access-6l6mw\") pod \"nova-api-db-create-pjkj4\" (UID: \"6d750838-2144-4d02-9e1f-a3a3f0a3ba9d\") " pod="openstack-kuttl-tests/nova-api-db-create-pjkj4" Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.222363 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/514e99fe-d081-465e-9afb-fc169395f13b-run-httpd\") pod \"ceilometer-0\" (UID: \"514e99fe-d081-465e-9afb-fc169395f13b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.223536 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/514e99fe-d081-465e-9afb-fc169395f13b-log-httpd\") pod \"ceilometer-0\" (UID: \"514e99fe-d081-465e-9afb-fc169395f13b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.225066 5120 scope.go:117] "RemoveContainer" containerID="b0980d714155eb5a7897d81ad5297a9aa18e39335c54577f4e617fcc4246df50" Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.239947 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/514e99fe-d081-465e-9afb-fc169395f13b-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"514e99fe-d081-465e-9afb-fc169395f13b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.243730 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/514e99fe-d081-465e-9afb-fc169395f13b-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"514e99fe-d081-465e-9afb-fc169395f13b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.259846 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/514e99fe-d081-465e-9afb-fc169395f13b-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"514e99fe-d081-465e-9afb-fc169395f13b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.260392 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/514e99fe-d081-465e-9afb-fc169395f13b-scripts\") pod \"ceilometer-0\" (UID: \"514e99fe-d081-465e-9afb-fc169395f13b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.286419 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/514e99fe-d081-465e-9afb-fc169395f13b-config-data\") pod \"ceilometer-0\" (UID: \"514e99fe-d081-465e-9afb-fc169395f13b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.299587 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pghdp\" (UniqueName: \"kubernetes.io/projected/514e99fe-d081-465e-9afb-fc169395f13b-kube-api-access-pghdp\") pod \"ceilometer-0\" (UID: \"514e99fe-d081-465e-9afb-fc169395f13b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.306750 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.324855 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-a3c5-account-create-update-5w5q7"] Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.337849 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6l6mw\" (UniqueName: \"kubernetes.io/projected/6d750838-2144-4d02-9e1f-a3a3f0a3ba9d-kube-api-access-6l6mw\") pod \"nova-api-db-create-pjkj4\" (UID: \"6d750838-2144-4d02-9e1f-a3a3f0a3ba9d\") " pod="openstack-kuttl-tests/nova-api-db-create-pjkj4" Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.337977 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/6d750838-2144-4d02-9e1f-a3a3f0a3ba9d-operator-scripts\") pod \"nova-api-db-create-pjkj4\" (UID: \"6d750838-2144-4d02-9e1f-a3a3f0a3ba9d\") " pod="openstack-kuttl-tests/nova-api-db-create-pjkj4" Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.338117 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bq28p\" (UniqueName: \"kubernetes.io/projected/020c675a-4f3f-44d2-9094-31d85ee582e6-kube-api-access-bq28p\") pod \"nova-cell0-db-create-nn2pp\" (UID: \"020c675a-4f3f-44d2-9094-31d85ee582e6\") " pod="openstack-kuttl-tests/nova-cell0-db-create-nn2pp" Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.338245 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/020c675a-4f3f-44d2-9094-31d85ee582e6-operator-scripts\") pod \"nova-cell0-db-create-nn2pp\" (UID: \"020c675a-4f3f-44d2-9094-31d85ee582e6\") " pod="openstack-kuttl-tests/nova-cell0-db-create-nn2pp" Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.348653 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/6d750838-2144-4d02-9e1f-a3a3f0a3ba9d-operator-scripts\") pod \"nova-api-db-create-pjkj4\" (UID: \"6d750838-2144-4d02-9e1f-a3a3f0a3ba9d\") " pod="openstack-kuttl-tests/nova-api-db-create-pjkj4" Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.372977 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-a3c5-account-create-update-5w5q7"] Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.373108 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-a3c5-account-create-update-5w5q7" Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.378575 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-db-secret\"" Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.409019 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-qwzzm"] Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.410469 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6l6mw\" (UniqueName: \"kubernetes.io/projected/6d750838-2144-4d02-9e1f-a3a3f0a3ba9d-kube-api-access-6l6mw\") pod \"nova-api-db-create-pjkj4\" (UID: \"6d750838-2144-4d02-9e1f-a3a3f0a3ba9d\") " pod="openstack-kuttl-tests/nova-api-db-create-pjkj4" Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.417953 5120 scope.go:117] "RemoveContainer" containerID="229b97259bb83e63ce7e70d315343d0dfcc17c75ea30cebfc648e04eccb4d24e" Mar 16 16:40:59 crc kubenswrapper[5120]: E0316 16:40:59.418749 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"229b97259bb83e63ce7e70d315343d0dfcc17c75ea30cebfc648e04eccb4d24e\": container with ID starting with 229b97259bb83e63ce7e70d315343d0dfcc17c75ea30cebfc648e04eccb4d24e not found: ID does not exist" containerID="229b97259bb83e63ce7e70d315343d0dfcc17c75ea30cebfc648e04eccb4d24e" Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.418795 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"229b97259bb83e63ce7e70d315343d0dfcc17c75ea30cebfc648e04eccb4d24e"} err="failed to get container status \"229b97259bb83e63ce7e70d315343d0dfcc17c75ea30cebfc648e04eccb4d24e\": rpc error: code = NotFound desc = could not find container \"229b97259bb83e63ce7e70d315343d0dfcc17c75ea30cebfc648e04eccb4d24e\": container with ID starting with 229b97259bb83e63ce7e70d315343d0dfcc17c75ea30cebfc648e04eccb4d24e not found: ID does not exist" Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.418814 5120 scope.go:117] "RemoveContainer" containerID="87a80b3fc7765e53891894a57a05d9793aaa6d211e0ca0bb23827687b5d47bfa" Mar 16 16:40:59 crc kubenswrapper[5120]: E0316 16:40:59.419926 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"87a80b3fc7765e53891894a57a05d9793aaa6d211e0ca0bb23827687b5d47bfa\": container with ID starting with 87a80b3fc7765e53891894a57a05d9793aaa6d211e0ca0bb23827687b5d47bfa not found: ID does not exist" containerID="87a80b3fc7765e53891894a57a05d9793aaa6d211e0ca0bb23827687b5d47bfa" Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.419948 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87a80b3fc7765e53891894a57a05d9793aaa6d211e0ca0bb23827687b5d47bfa"} err="failed to get container status \"87a80b3fc7765e53891894a57a05d9793aaa6d211e0ca0bb23827687b5d47bfa\": rpc error: code = NotFound desc = could not find container \"87a80b3fc7765e53891894a57a05d9793aaa6d211e0ca0bb23827687b5d47bfa\": container with ID starting with 87a80b3fc7765e53891894a57a05d9793aaa6d211e0ca0bb23827687b5d47bfa not found: ID does not exist" Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.419960 5120 scope.go:117] "RemoveContainer" containerID="1c5c85a1bfc14651488cb34d01a9fa071f5ad844d3d0bb16512e09fe46b156b1" Mar 16 16:40:59 crc kubenswrapper[5120]: E0316 16:40:59.420236 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c5c85a1bfc14651488cb34d01a9fa071f5ad844d3d0bb16512e09fe46b156b1\": container with ID starting with 1c5c85a1bfc14651488cb34d01a9fa071f5ad844d3d0bb16512e09fe46b156b1 not found: ID does not exist" containerID="1c5c85a1bfc14651488cb34d01a9fa071f5ad844d3d0bb16512e09fe46b156b1" Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.420256 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c5c85a1bfc14651488cb34d01a9fa071f5ad844d3d0bb16512e09fe46b156b1"} err="failed to get container status \"1c5c85a1bfc14651488cb34d01a9fa071f5ad844d3d0bb16512e09fe46b156b1\": rpc error: code = NotFound desc = could not find container \"1c5c85a1bfc14651488cb34d01a9fa071f5ad844d3d0bb16512e09fe46b156b1\": container with ID starting with 1c5c85a1bfc14651488cb34d01a9fa071f5ad844d3d0bb16512e09fe46b156b1 not found: ID does not exist" Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.420269 5120 scope.go:117] "RemoveContainer" containerID="b0980d714155eb5a7897d81ad5297a9aa18e39335c54577f4e617fcc4246df50" Mar 16 16:40:59 crc kubenswrapper[5120]: E0316 16:40:59.420463 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b0980d714155eb5a7897d81ad5297a9aa18e39335c54577f4e617fcc4246df50\": container with ID starting with b0980d714155eb5a7897d81ad5297a9aa18e39335c54577f4e617fcc4246df50 not found: ID does not exist" containerID="b0980d714155eb5a7897d81ad5297a9aa18e39335c54577f4e617fcc4246df50" Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.420483 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b0980d714155eb5a7897d81ad5297a9aa18e39335c54577f4e617fcc4246df50"} err="failed to get container status \"b0980d714155eb5a7897d81ad5297a9aa18e39335c54577f4e617fcc4246df50\": rpc error: code = NotFound desc = could not find container \"b0980d714155eb5a7897d81ad5297a9aa18e39335c54577f4e617fcc4246df50\": container with ID starting with b0980d714155eb5a7897d81ad5297a9aa18e39335c54577f4e617fcc4246df50 not found: ID does not exist" Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.425768 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-db-create-pjkj4" Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.429870 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-db-create-qwzzm" Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.439144 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-qwzzm"] Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.440218 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bq28p\" (UniqueName: \"kubernetes.io/projected/020c675a-4f3f-44d2-9094-31d85ee582e6-kube-api-access-bq28p\") pod \"nova-cell0-db-create-nn2pp\" (UID: \"020c675a-4f3f-44d2-9094-31d85ee582e6\") " pod="openstack-kuttl-tests/nova-cell0-db-create-nn2pp" Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.440309 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/cffcdd38-4c41-4e0b-9198-0b8ebea0302e-operator-scripts\") pod \"nova-cell1-db-create-qwzzm\" (UID: \"cffcdd38-4c41-4e0b-9198-0b8ebea0302e\") " pod="openstack-kuttl-tests/nova-cell1-db-create-qwzzm" Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.440345 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/020c675a-4f3f-44d2-9094-31d85ee582e6-operator-scripts\") pod \"nova-cell0-db-create-nn2pp\" (UID: \"020c675a-4f3f-44d2-9094-31d85ee582e6\") " pod="openstack-kuttl-tests/nova-cell0-db-create-nn2pp" Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.440403 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4r9bm\" (UniqueName: \"kubernetes.io/projected/cffcdd38-4c41-4e0b-9198-0b8ebea0302e-kube-api-access-4r9bm\") pod \"nova-cell1-db-create-qwzzm\" (UID: \"cffcdd38-4c41-4e0b-9198-0b8ebea0302e\") " pod="openstack-kuttl-tests/nova-cell1-db-create-qwzzm" Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.440605 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/462452f5-5fb2-44a0-b52d-a3660a4346f7-operator-scripts\") pod \"nova-api-a3c5-account-create-update-5w5q7\" (UID: \"462452f5-5fb2-44a0-b52d-a3660a4346f7\") " pod="openstack-kuttl-tests/nova-api-a3c5-account-create-update-5w5q7" Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.440640 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdrvw\" (UniqueName: \"kubernetes.io/projected/462452f5-5fb2-44a0-b52d-a3660a4346f7-kube-api-access-gdrvw\") pod \"nova-api-a3c5-account-create-update-5w5q7\" (UID: \"462452f5-5fb2-44a0-b52d-a3660a4346f7\") " pod="openstack-kuttl-tests/nova-api-a3c5-account-create-update-5w5q7" Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.443601 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/020c675a-4f3f-44d2-9094-31d85ee582e6-operator-scripts\") pod \"nova-cell0-db-create-nn2pp\" (UID: \"020c675a-4f3f-44d2-9094-31d85ee582e6\") " pod="openstack-kuttl-tests/nova-cell0-db-create-nn2pp" Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.472286 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bq28p\" (UniqueName: \"kubernetes.io/projected/020c675a-4f3f-44d2-9094-31d85ee582e6-kube-api-access-bq28p\") pod \"nova-cell0-db-create-nn2pp\" (UID: \"020c675a-4f3f-44d2-9094-31d85ee582e6\") " pod="openstack-kuttl-tests/nova-cell0-db-create-nn2pp" Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.475801 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-f4eb-account-create-update-krgcs"] Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.521842 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-db-create-nn2pp" Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.523285 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-f4eb-account-create-update-krgcs" Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.525572 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-db-secret\"" Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.547990 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/462452f5-5fb2-44a0-b52d-a3660a4346f7-operator-scripts\") pod \"nova-api-a3c5-account-create-update-5w5q7\" (UID: \"462452f5-5fb2-44a0-b52d-a3660a4346f7\") " pod="openstack-kuttl-tests/nova-api-a3c5-account-create-update-5w5q7" Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.548055 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gdrvw\" (UniqueName: \"kubernetes.io/projected/462452f5-5fb2-44a0-b52d-a3660a4346f7-kube-api-access-gdrvw\") pod \"nova-api-a3c5-account-create-update-5w5q7\" (UID: \"462452f5-5fb2-44a0-b52d-a3660a4346f7\") " pod="openstack-kuttl-tests/nova-api-a3c5-account-create-update-5w5q7" Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.548232 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/1a920725-764e-48f9-bb7f-9718e4b64091-operator-scripts\") pod \"nova-cell0-f4eb-account-create-update-krgcs\" (UID: \"1a920725-764e-48f9-bb7f-9718e4b64091\") " pod="openstack-kuttl-tests/nova-cell0-f4eb-account-create-update-krgcs" Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.548270 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/cffcdd38-4c41-4e0b-9198-0b8ebea0302e-operator-scripts\") pod \"nova-cell1-db-create-qwzzm\" (UID: \"cffcdd38-4c41-4e0b-9198-0b8ebea0302e\") " pod="openstack-kuttl-tests/nova-cell1-db-create-qwzzm" Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.548315 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vpm5m\" (UniqueName: \"kubernetes.io/projected/1a920725-764e-48f9-bb7f-9718e4b64091-kube-api-access-vpm5m\") pod \"nova-cell0-f4eb-account-create-update-krgcs\" (UID: \"1a920725-764e-48f9-bb7f-9718e4b64091\") " pod="openstack-kuttl-tests/nova-cell0-f4eb-account-create-update-krgcs" Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.548383 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4r9bm\" (UniqueName: \"kubernetes.io/projected/cffcdd38-4c41-4e0b-9198-0b8ebea0302e-kube-api-access-4r9bm\") pod \"nova-cell1-db-create-qwzzm\" (UID: \"cffcdd38-4c41-4e0b-9198-0b8ebea0302e\") " pod="openstack-kuttl-tests/nova-cell1-db-create-qwzzm" Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.549643 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/462452f5-5fb2-44a0-b52d-a3660a4346f7-operator-scripts\") pod \"nova-api-a3c5-account-create-update-5w5q7\" (UID: \"462452f5-5fb2-44a0-b52d-a3660a4346f7\") " pod="openstack-kuttl-tests/nova-api-a3c5-account-create-update-5w5q7" Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.550494 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/cffcdd38-4c41-4e0b-9198-0b8ebea0302e-operator-scripts\") pod \"nova-cell1-db-create-qwzzm\" (UID: \"cffcdd38-4c41-4e0b-9198-0b8ebea0302e\") " pod="openstack-kuttl-tests/nova-cell1-db-create-qwzzm" Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.589548 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4r9bm\" (UniqueName: \"kubernetes.io/projected/cffcdd38-4c41-4e0b-9198-0b8ebea0302e-kube-api-access-4r9bm\") pod \"nova-cell1-db-create-qwzzm\" (UID: \"cffcdd38-4c41-4e0b-9198-0b8ebea0302e\") " pod="openstack-kuttl-tests/nova-cell1-db-create-qwzzm" Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.590062 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-db-create-qwzzm" Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.593648 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-f4eb-account-create-update-krgcs"] Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.599536 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdrvw\" (UniqueName: \"kubernetes.io/projected/462452f5-5fb2-44a0-b52d-a3660a4346f7-kube-api-access-gdrvw\") pod \"nova-api-a3c5-account-create-update-5w5q7\" (UID: \"462452f5-5fb2-44a0-b52d-a3660a4346f7\") " pod="openstack-kuttl-tests/nova-api-a3c5-account-create-update-5w5q7" Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.651542 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/1a920725-764e-48f9-bb7f-9718e4b64091-operator-scripts\") pod \"nova-cell0-f4eb-account-create-update-krgcs\" (UID: \"1a920725-764e-48f9-bb7f-9718e4b64091\") " pod="openstack-kuttl-tests/nova-cell0-f4eb-account-create-update-krgcs" Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.651607 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vpm5m\" (UniqueName: \"kubernetes.io/projected/1a920725-764e-48f9-bb7f-9718e4b64091-kube-api-access-vpm5m\") pod \"nova-cell0-f4eb-account-create-update-krgcs\" (UID: \"1a920725-764e-48f9-bb7f-9718e4b64091\") " pod="openstack-kuttl-tests/nova-cell0-f4eb-account-create-update-krgcs" Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.652550 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/1a920725-764e-48f9-bb7f-9718e4b64091-operator-scripts\") pod \"nova-cell0-f4eb-account-create-update-krgcs\" (UID: \"1a920725-764e-48f9-bb7f-9718e4b64091\") " pod="openstack-kuttl-tests/nova-cell0-f4eb-account-create-update-krgcs" Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.660323 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-d38a-account-create-update-zwjc7"] Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.669404 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-d38a-account-create-update-zwjc7" Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.672326 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-db-secret\"" Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.676137 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-d38a-account-create-update-zwjc7"] Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.679113 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vpm5m\" (UniqueName: \"kubernetes.io/projected/1a920725-764e-48f9-bb7f-9718e4b64091-kube-api-access-vpm5m\") pod \"nova-cell0-f4eb-account-create-update-krgcs\" (UID: \"1a920725-764e-48f9-bb7f-9718e4b64091\") " pod="openstack-kuttl-tests/nova-cell0-f4eb-account-create-update-krgcs" Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.724966 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.846729 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-a3c5-account-create-update-5w5q7" Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.856825 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-85wg5\" (UniqueName: \"kubernetes.io/projected/43ae87ab-7a99-41df-b39a-930c7a5a232d-kube-api-access-85wg5\") pod \"43ae87ab-7a99-41df-b39a-930c7a5a232d\" (UID: \"43ae87ab-7a99-41df-b39a-930c7a5a232d\") " Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.857023 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/43ae87ab-7a99-41df-b39a-930c7a5a232d-logs\") pod \"43ae87ab-7a99-41df-b39a-930c7a5a232d\" (UID: \"43ae87ab-7a99-41df-b39a-930c7a5a232d\") " Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.857047 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/43ae87ab-7a99-41df-b39a-930c7a5a232d-scripts\") pod \"43ae87ab-7a99-41df-b39a-930c7a5a232d\" (UID: \"43ae87ab-7a99-41df-b39a-930c7a5a232d\") " Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.857159 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/43ae87ab-7a99-41df-b39a-930c7a5a232d-public-tls-certs\") pod \"43ae87ab-7a99-41df-b39a-930c7a5a232d\" (UID: \"43ae87ab-7a99-41df-b39a-930c7a5a232d\") " Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.857389 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/43ae87ab-7a99-41df-b39a-930c7a5a232d-config-data\") pod \"43ae87ab-7a99-41df-b39a-930c7a5a232d\" (UID: \"43ae87ab-7a99-41df-b39a-930c7a5a232d\") " Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.857445 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/43ae87ab-7a99-41df-b39a-930c7a5a232d-httpd-run\") pod \"43ae87ab-7a99-41df-b39a-930c7a5a232d\" (UID: \"43ae87ab-7a99-41df-b39a-930c7a5a232d\") " Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.857476 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"43ae87ab-7a99-41df-b39a-930c7a5a232d\" (UID: \"43ae87ab-7a99-41df-b39a-930c7a5a232d\") " Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.857583 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/43ae87ab-7a99-41df-b39a-930c7a5a232d-combined-ca-bundle\") pod \"43ae87ab-7a99-41df-b39a-930c7a5a232d\" (UID: \"43ae87ab-7a99-41df-b39a-930c7a5a232d\") " Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.857993 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bkzgn\" (UniqueName: \"kubernetes.io/projected/28c1bf81-d31b-4bbc-93e5-a93447e1b730-kube-api-access-bkzgn\") pod \"nova-cell1-d38a-account-create-update-zwjc7\" (UID: \"28c1bf81-d31b-4bbc-93e5-a93447e1b730\") " pod="openstack-kuttl-tests/nova-cell1-d38a-account-create-update-zwjc7" Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.858280 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/28c1bf81-d31b-4bbc-93e5-a93447e1b730-operator-scripts\") pod \"nova-cell1-d38a-account-create-update-zwjc7\" (UID: \"28c1bf81-d31b-4bbc-93e5-a93447e1b730\") " pod="openstack-kuttl-tests/nova-cell1-d38a-account-create-update-zwjc7" Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.858516 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43ae87ab-7a99-41df-b39a-930c7a5a232d-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "43ae87ab-7a99-41df-b39a-930c7a5a232d" (UID: "43ae87ab-7a99-41df-b39a-930c7a5a232d"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.858531 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43ae87ab-7a99-41df-b39a-930c7a5a232d-logs" (OuterVolumeSpecName: "logs") pod "43ae87ab-7a99-41df-b39a-930c7a5a232d" (UID: "43ae87ab-7a99-41df-b39a-930c7a5a232d"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.859936 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/43ae87ab-7a99-41df-b39a-930c7a5a232d-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.860586 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/43ae87ab-7a99-41df-b39a-930c7a5a232d-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.864898 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage20-crc" (OuterVolumeSpecName: "glance") pod "43ae87ab-7a99-41df-b39a-930c7a5a232d" (UID: "43ae87ab-7a99-41df-b39a-930c7a5a232d"). InnerVolumeSpecName "local-storage20-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.864998 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/43ae87ab-7a99-41df-b39a-930c7a5a232d-kube-api-access-85wg5" (OuterVolumeSpecName: "kube-api-access-85wg5") pod "43ae87ab-7a99-41df-b39a-930c7a5a232d" (UID: "43ae87ab-7a99-41df-b39a-930c7a5a232d"). InnerVolumeSpecName "kube-api-access-85wg5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.876656 5120 generic.go:358] "Generic (PLEG): container finished" podID="f4685058-90ec-421d-b95e-ca68dc1d4dcd" containerID="ca0ae3a8b4b307a12c44d686843908626a380c9becf90b91194b05d243c4f28b" exitCode=0 Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.877275 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"f4685058-90ec-421d-b95e-ca68dc1d4dcd","Type":"ContainerDied","Data":"ca0ae3a8b4b307a12c44d686843908626a380c9becf90b91194b05d243c4f28b"} Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.881294 5120 generic.go:358] "Generic (PLEG): container finished" podID="43ae87ab-7a99-41df-b39a-930c7a5a232d" containerID="50956264ae2e609fe5c7b13617c8592d52746a64d7f4828722e5fd9abf9f90ff" exitCode=0 Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.881392 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"43ae87ab-7a99-41df-b39a-930c7a5a232d","Type":"ContainerDied","Data":"50956264ae2e609fe5c7b13617c8592d52746a64d7f4828722e5fd9abf9f90ff"} Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.881417 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"43ae87ab-7a99-41df-b39a-930c7a5a232d","Type":"ContainerDied","Data":"aea72b20d7604693db290e5cec4502522c62eca44b8a7c5fe71adb8801efb0c6"} Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.881451 5120 scope.go:117] "RemoveContainer" containerID="50956264ae2e609fe5c7b13617c8592d52746a64d7f4828722e5fd9abf9f90ff" Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.881639 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.889779 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/43ae87ab-7a99-41df-b39a-930c7a5a232d-scripts" (OuterVolumeSpecName: "scripts") pod "43ae87ab-7a99-41df-b39a-930c7a5a232d" (UID: "43ae87ab-7a99-41df-b39a-930c7a5a232d"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.894232 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-f4eb-account-create-update-krgcs" Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.895191 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/43ae87ab-7a99-41df-b39a-930c7a5a232d-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "43ae87ab-7a99-41df-b39a-930c7a5a232d" (UID: "43ae87ab-7a99-41df-b39a-930c7a5a232d"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.936405 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/43ae87ab-7a99-41df-b39a-930c7a5a232d-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "43ae87ab-7a99-41df-b39a-930c7a5a232d" (UID: "43ae87ab-7a99-41df-b39a-930c7a5a232d"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.949155 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/43ae87ab-7a99-41df-b39a-930c7a5a232d-config-data" (OuterVolumeSpecName: "config-data") pod "43ae87ab-7a99-41df-b39a-930c7a5a232d" (UID: "43ae87ab-7a99-41df-b39a-930c7a5a232d"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.960102 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.962060 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bkzgn\" (UniqueName: \"kubernetes.io/projected/28c1bf81-d31b-4bbc-93e5-a93447e1b730-kube-api-access-bkzgn\") pod \"nova-cell1-d38a-account-create-update-zwjc7\" (UID: \"28c1bf81-d31b-4bbc-93e5-a93447e1b730\") " pod="openstack-kuttl-tests/nova-cell1-d38a-account-create-update-zwjc7" Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.962195 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/28c1bf81-d31b-4bbc-93e5-a93447e1b730-operator-scripts\") pod \"nova-cell1-d38a-account-create-update-zwjc7\" (UID: \"28c1bf81-d31b-4bbc-93e5-a93447e1b730\") " pod="openstack-kuttl-tests/nova-cell1-d38a-account-create-update-zwjc7" Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.962249 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/43ae87ab-7a99-41df-b39a-930c7a5a232d-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.962264 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/43ae87ab-7a99-41df-b39a-930c7a5a232d-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.962275 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/43ae87ab-7a99-41df-b39a-930c7a5a232d-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.962293 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") on node \"crc\" " Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.962302 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/43ae87ab-7a99-41df-b39a-930c7a5a232d-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.962310 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-85wg5\" (UniqueName: \"kubernetes.io/projected/43ae87ab-7a99-41df-b39a-930c7a5a232d-kube-api-access-85wg5\") on node \"crc\" DevicePath \"\"" Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.962893 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/28c1bf81-d31b-4bbc-93e5-a93447e1b730-operator-scripts\") pod \"nova-cell1-d38a-account-create-update-zwjc7\" (UID: \"28c1bf81-d31b-4bbc-93e5-a93447e1b730\") " pod="openstack-kuttl-tests/nova-cell1-d38a-account-create-update-zwjc7" Mar 16 16:40:59 crc kubenswrapper[5120]: W0316 16:40:59.963943 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod514e99fe_d081_465e_9afb_fc169395f13b.slice/crio-ff3b9fce6c87b6639381aa923baed05df2122ca2aa7d76041d9c3f97d8ffb5aa WatchSource:0}: Error finding container ff3b9fce6c87b6639381aa923baed05df2122ca2aa7d76041d9c3f97d8ffb5aa: Status 404 returned error can't find the container with id ff3b9fce6c87b6639381aa923baed05df2122ca2aa7d76041d9c3f97d8ffb5aa Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.981253 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bkzgn\" (UniqueName: \"kubernetes.io/projected/28c1bf81-d31b-4bbc-93e5-a93447e1b730-kube-api-access-bkzgn\") pod \"nova-cell1-d38a-account-create-update-zwjc7\" (UID: \"28c1bf81-d31b-4bbc-93e5-a93447e1b730\") " pod="openstack-kuttl-tests/nova-cell1-d38a-account-create-update-zwjc7" Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.991952 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage20-crc" (UniqueName: "kubernetes.io/local-volume/local-storage20-crc") on node "crc" Mar 16 16:40:59 crc kubenswrapper[5120]: I0316 16:40:59.997548 5120 scope.go:117] "RemoveContainer" containerID="d0c6819deb917d9e91985bf1d131648bddd7748dcdbdf7c7ca71e50fc7381c7c" Mar 16 16:41:00 crc kubenswrapper[5120]: I0316 16:41:00.014108 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-d38a-account-create-update-zwjc7" Mar 16 16:41:00 crc kubenswrapper[5120]: I0316 16:41:00.065872 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:41:00 crc kubenswrapper[5120]: I0316 16:41:00.080061 5120 scope.go:117] "RemoveContainer" containerID="50956264ae2e609fe5c7b13617c8592d52746a64d7f4828722e5fd9abf9f90ff" Mar 16 16:41:00 crc kubenswrapper[5120]: I0316 16:41:00.107754 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-pjkj4"] Mar 16 16:41:00 crc kubenswrapper[5120]: E0316 16:41:00.115802 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"50956264ae2e609fe5c7b13617c8592d52746a64d7f4828722e5fd9abf9f90ff\": container with ID starting with 50956264ae2e609fe5c7b13617c8592d52746a64d7f4828722e5fd9abf9f90ff not found: ID does not exist" containerID="50956264ae2e609fe5c7b13617c8592d52746a64d7f4828722e5fd9abf9f90ff" Mar 16 16:41:00 crc kubenswrapper[5120]: I0316 16:41:00.115848 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50956264ae2e609fe5c7b13617c8592d52746a64d7f4828722e5fd9abf9f90ff"} err="failed to get container status \"50956264ae2e609fe5c7b13617c8592d52746a64d7f4828722e5fd9abf9f90ff\": rpc error: code = NotFound desc = could not find container \"50956264ae2e609fe5c7b13617c8592d52746a64d7f4828722e5fd9abf9f90ff\": container with ID starting with 50956264ae2e609fe5c7b13617c8592d52746a64d7f4828722e5fd9abf9f90ff not found: ID does not exist" Mar 16 16:41:00 crc kubenswrapper[5120]: I0316 16:41:00.115873 5120 scope.go:117] "RemoveContainer" containerID="d0c6819deb917d9e91985bf1d131648bddd7748dcdbdf7c7ca71e50fc7381c7c" Mar 16 16:41:00 crc kubenswrapper[5120]: E0316 16:41:00.119298 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d0c6819deb917d9e91985bf1d131648bddd7748dcdbdf7c7ca71e50fc7381c7c\": container with ID starting with d0c6819deb917d9e91985bf1d131648bddd7748dcdbdf7c7ca71e50fc7381c7c not found: ID does not exist" containerID="d0c6819deb917d9e91985bf1d131648bddd7748dcdbdf7c7ca71e50fc7381c7c" Mar 16 16:41:00 crc kubenswrapper[5120]: I0316 16:41:00.119355 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0c6819deb917d9e91985bf1d131648bddd7748dcdbdf7c7ca71e50fc7381c7c"} err="failed to get container status \"d0c6819deb917d9e91985bf1d131648bddd7748dcdbdf7c7ca71e50fc7381c7c\": rpc error: code = NotFound desc = could not find container \"d0c6819deb917d9e91985bf1d131648bddd7748dcdbdf7c7ca71e50fc7381c7c\": container with ID starting with d0c6819deb917d9e91985bf1d131648bddd7748dcdbdf7c7ca71e50fc7381c7c not found: ID does not exist" Mar 16 16:41:00 crc kubenswrapper[5120]: I0316 16:41:00.241960 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-nn2pp"] Mar 16 16:41:00 crc kubenswrapper[5120]: I0316 16:41:00.287016 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-qwzzm"] Mar 16 16:41:00 crc kubenswrapper[5120]: I0316 16:41:00.339049 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:41:00 crc kubenswrapper[5120]: I0316 16:41:00.370293 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:41:00 crc kubenswrapper[5120]: I0316 16:41:00.400267 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:41:00 crc kubenswrapper[5120]: I0316 16:41:00.402253 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43ae87ab-7a99-41df-b39a-930c7a5a232d" containerName="glance-log" Mar 16 16:41:00 crc kubenswrapper[5120]: I0316 16:41:00.402279 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="43ae87ab-7a99-41df-b39a-930c7a5a232d" containerName="glance-log" Mar 16 16:41:00 crc kubenswrapper[5120]: I0316 16:41:00.402323 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43ae87ab-7a99-41df-b39a-930c7a5a232d" containerName="glance-httpd" Mar 16 16:41:00 crc kubenswrapper[5120]: I0316 16:41:00.402332 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="43ae87ab-7a99-41df-b39a-930c7a5a232d" containerName="glance-httpd" Mar 16 16:41:00 crc kubenswrapper[5120]: I0316 16:41:00.402646 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="43ae87ab-7a99-41df-b39a-930c7a5a232d" containerName="glance-log" Mar 16 16:41:00 crc kubenswrapper[5120]: I0316 16:41:00.402673 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="43ae87ab-7a99-41df-b39a-930c7a5a232d" containerName="glance-httpd" Mar 16 16:41:00 crc kubenswrapper[5120]: I0316 16:41:00.413094 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:41:00 crc kubenswrapper[5120]: I0316 16:41:00.418944 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:41:00 crc kubenswrapper[5120]: I0316 16:41:00.421356 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-public-svc\"" Mar 16 16:41:00 crc kubenswrapper[5120]: I0316 16:41:00.421647 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-external-config-data\"" Mar 16 16:41:00 crc kubenswrapper[5120]: I0316 16:41:00.436930 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:41:00 crc kubenswrapper[5120]: I0316 16:41:00.479136 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f4685058-90ec-421d-b95e-ca68dc1d4dcd-config-data\") pod \"f4685058-90ec-421d-b95e-ca68dc1d4dcd\" (UID: \"f4685058-90ec-421d-b95e-ca68dc1d4dcd\") " Mar 16 16:41:00 crc kubenswrapper[5120]: I0316 16:41:00.479229 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jlnzz\" (UniqueName: \"kubernetes.io/projected/f4685058-90ec-421d-b95e-ca68dc1d4dcd-kube-api-access-jlnzz\") pod \"f4685058-90ec-421d-b95e-ca68dc1d4dcd\" (UID: \"f4685058-90ec-421d-b95e-ca68dc1d4dcd\") " Mar 16 16:41:00 crc kubenswrapper[5120]: I0316 16:41:00.479266 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f4685058-90ec-421d-b95e-ca68dc1d4dcd-logs\") pod \"f4685058-90ec-421d-b95e-ca68dc1d4dcd\" (UID: \"f4685058-90ec-421d-b95e-ca68dc1d4dcd\") " Mar 16 16:41:00 crc kubenswrapper[5120]: I0316 16:41:00.479336 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f4685058-90ec-421d-b95e-ca68dc1d4dcd-combined-ca-bundle\") pod \"f4685058-90ec-421d-b95e-ca68dc1d4dcd\" (UID: \"f4685058-90ec-421d-b95e-ca68dc1d4dcd\") " Mar 16 16:41:00 crc kubenswrapper[5120]: I0316 16:41:00.479495 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f4685058-90ec-421d-b95e-ca68dc1d4dcd-internal-tls-certs\") pod \"f4685058-90ec-421d-b95e-ca68dc1d4dcd\" (UID: \"f4685058-90ec-421d-b95e-ca68dc1d4dcd\") " Mar 16 16:41:00 crc kubenswrapper[5120]: I0316 16:41:00.479623 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"f4685058-90ec-421d-b95e-ca68dc1d4dcd\" (UID: \"f4685058-90ec-421d-b95e-ca68dc1d4dcd\") " Mar 16 16:41:00 crc kubenswrapper[5120]: I0316 16:41:00.479645 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/f4685058-90ec-421d-b95e-ca68dc1d4dcd-httpd-run\") pod \"f4685058-90ec-421d-b95e-ca68dc1d4dcd\" (UID: \"f4685058-90ec-421d-b95e-ca68dc1d4dcd\") " Mar 16 16:41:00 crc kubenswrapper[5120]: I0316 16:41:00.479684 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f4685058-90ec-421d-b95e-ca68dc1d4dcd-scripts\") pod \"f4685058-90ec-421d-b95e-ca68dc1d4dcd\" (UID: \"f4685058-90ec-421d-b95e-ca68dc1d4dcd\") " Mar 16 16:41:00 crc kubenswrapper[5120]: I0316 16:41:00.479877 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ffbcbd91-454c-4998-9b12-69ed7f853328-logs\") pod \"glance-default-external-api-0\" (UID: \"ffbcbd91-454c-4998-9b12-69ed7f853328\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:41:00 crc kubenswrapper[5120]: I0316 16:41:00.479967 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"glance-default-external-api-0\" (UID: \"ffbcbd91-454c-4998-9b12-69ed7f853328\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:41:00 crc kubenswrapper[5120]: I0316 16:41:00.480062 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ffbcbd91-454c-4998-9b12-69ed7f853328-config-data\") pod \"glance-default-external-api-0\" (UID: \"ffbcbd91-454c-4998-9b12-69ed7f853328\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:41:00 crc kubenswrapper[5120]: I0316 16:41:00.480094 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ffbcbd91-454c-4998-9b12-69ed7f853328-scripts\") pod \"glance-default-external-api-0\" (UID: \"ffbcbd91-454c-4998-9b12-69ed7f853328\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:41:00 crc kubenswrapper[5120]: I0316 16:41:00.480120 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ffbcbd91-454c-4998-9b12-69ed7f853328-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"ffbcbd91-454c-4998-9b12-69ed7f853328\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:41:00 crc kubenswrapper[5120]: I0316 16:41:00.480164 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ffbcbd91-454c-4998-9b12-69ed7f853328-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"ffbcbd91-454c-4998-9b12-69ed7f853328\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:41:00 crc kubenswrapper[5120]: I0316 16:41:00.480183 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6hxw\" (UniqueName: \"kubernetes.io/projected/ffbcbd91-454c-4998-9b12-69ed7f853328-kube-api-access-v6hxw\") pod \"glance-default-external-api-0\" (UID: \"ffbcbd91-454c-4998-9b12-69ed7f853328\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:41:00 crc kubenswrapper[5120]: I0316 16:41:00.480262 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/ffbcbd91-454c-4998-9b12-69ed7f853328-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"ffbcbd91-454c-4998-9b12-69ed7f853328\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:41:00 crc kubenswrapper[5120]: I0316 16:41:00.483007 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4685058-90ec-421d-b95e-ca68dc1d4dcd-logs" (OuterVolumeSpecName: "logs") pod "f4685058-90ec-421d-b95e-ca68dc1d4dcd" (UID: "f4685058-90ec-421d-b95e-ca68dc1d4dcd"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:41:00 crc kubenswrapper[5120]: I0316 16:41:00.486399 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4685058-90ec-421d-b95e-ca68dc1d4dcd-kube-api-access-jlnzz" (OuterVolumeSpecName: "kube-api-access-jlnzz") pod "f4685058-90ec-421d-b95e-ca68dc1d4dcd" (UID: "f4685058-90ec-421d-b95e-ca68dc1d4dcd"). InnerVolumeSpecName "kube-api-access-jlnzz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:41:00 crc kubenswrapper[5120]: I0316 16:41:00.488964 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4685058-90ec-421d-b95e-ca68dc1d4dcd-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "f4685058-90ec-421d-b95e-ca68dc1d4dcd" (UID: "f4685058-90ec-421d-b95e-ca68dc1d4dcd"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:41:00 crc kubenswrapper[5120]: I0316 16:41:00.490527 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage06-crc" (OuterVolumeSpecName: "glance") pod "f4685058-90ec-421d-b95e-ca68dc1d4dcd" (UID: "f4685058-90ec-421d-b95e-ca68dc1d4dcd"). InnerVolumeSpecName "local-storage06-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:41:00 crc kubenswrapper[5120]: I0316 16:41:00.522803 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f4685058-90ec-421d-b95e-ca68dc1d4dcd-scripts" (OuterVolumeSpecName: "scripts") pod "f4685058-90ec-421d-b95e-ca68dc1d4dcd" (UID: "f4685058-90ec-421d-b95e-ca68dc1d4dcd"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:41:00 crc kubenswrapper[5120]: I0316 16:41:00.587616 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ffbcbd91-454c-4998-9b12-69ed7f853328-config-data\") pod \"glance-default-external-api-0\" (UID: \"ffbcbd91-454c-4998-9b12-69ed7f853328\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:41:00 crc kubenswrapper[5120]: I0316 16:41:00.588197 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ffbcbd91-454c-4998-9b12-69ed7f853328-scripts\") pod \"glance-default-external-api-0\" (UID: \"ffbcbd91-454c-4998-9b12-69ed7f853328\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:41:00 crc kubenswrapper[5120]: I0316 16:41:00.588234 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ffbcbd91-454c-4998-9b12-69ed7f853328-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"ffbcbd91-454c-4998-9b12-69ed7f853328\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:41:00 crc kubenswrapper[5120]: I0316 16:41:00.588287 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ffbcbd91-454c-4998-9b12-69ed7f853328-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"ffbcbd91-454c-4998-9b12-69ed7f853328\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:41:00 crc kubenswrapper[5120]: I0316 16:41:00.588343 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v6hxw\" (UniqueName: \"kubernetes.io/projected/ffbcbd91-454c-4998-9b12-69ed7f853328-kube-api-access-v6hxw\") pod \"glance-default-external-api-0\" (UID: \"ffbcbd91-454c-4998-9b12-69ed7f853328\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:41:00 crc kubenswrapper[5120]: I0316 16:41:00.588426 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/ffbcbd91-454c-4998-9b12-69ed7f853328-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"ffbcbd91-454c-4998-9b12-69ed7f853328\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:41:00 crc kubenswrapper[5120]: I0316 16:41:00.588518 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ffbcbd91-454c-4998-9b12-69ed7f853328-logs\") pod \"glance-default-external-api-0\" (UID: \"ffbcbd91-454c-4998-9b12-69ed7f853328\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:41:00 crc kubenswrapper[5120]: I0316 16:41:00.588619 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"glance-default-external-api-0\" (UID: \"ffbcbd91-454c-4998-9b12-69ed7f853328\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:41:00 crc kubenswrapper[5120]: I0316 16:41:00.588697 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") on node \"crc\" " Mar 16 16:41:00 crc kubenswrapper[5120]: I0316 16:41:00.588717 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/f4685058-90ec-421d-b95e-ca68dc1d4dcd-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 16:41:00 crc kubenswrapper[5120]: I0316 16:41:00.588726 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f4685058-90ec-421d-b95e-ca68dc1d4dcd-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:41:00 crc kubenswrapper[5120]: I0316 16:41:00.588735 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jlnzz\" (UniqueName: \"kubernetes.io/projected/f4685058-90ec-421d-b95e-ca68dc1d4dcd-kube-api-access-jlnzz\") on node \"crc\" DevicePath \"\"" Mar 16 16:41:00 crc kubenswrapper[5120]: I0316 16:41:00.588744 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f4685058-90ec-421d-b95e-ca68dc1d4dcd-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:41:00 crc kubenswrapper[5120]: I0316 16:41:00.594149 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/ffbcbd91-454c-4998-9b12-69ed7f853328-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"ffbcbd91-454c-4998-9b12-69ed7f853328\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:41:00 crc kubenswrapper[5120]: I0316 16:41:00.594375 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ffbcbd91-454c-4998-9b12-69ed7f853328-logs\") pod \"glance-default-external-api-0\" (UID: \"ffbcbd91-454c-4998-9b12-69ed7f853328\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:41:00 crc kubenswrapper[5120]: I0316 16:41:00.594608 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"glance-default-external-api-0\" (UID: \"ffbcbd91-454c-4998-9b12-69ed7f853328\") device mount path \"/mnt/openstack/pv20\"" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:41:00 crc kubenswrapper[5120]: I0316 16:41:00.611749 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ffbcbd91-454c-4998-9b12-69ed7f853328-scripts\") pod \"glance-default-external-api-0\" (UID: \"ffbcbd91-454c-4998-9b12-69ed7f853328\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:41:00 crc kubenswrapper[5120]: I0316 16:41:00.615375 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ffbcbd91-454c-4998-9b12-69ed7f853328-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"ffbcbd91-454c-4998-9b12-69ed7f853328\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:41:00 crc kubenswrapper[5120]: I0316 16:41:00.619816 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ffbcbd91-454c-4998-9b12-69ed7f853328-config-data\") pod \"glance-default-external-api-0\" (UID: \"ffbcbd91-454c-4998-9b12-69ed7f853328\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:41:00 crc kubenswrapper[5120]: I0316 16:41:00.622882 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ffbcbd91-454c-4998-9b12-69ed7f853328-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"ffbcbd91-454c-4998-9b12-69ed7f853328\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:41:00 crc kubenswrapper[5120]: I0316 16:41:00.642599 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-a3c5-account-create-update-5w5q7"] Mar 16 16:41:00 crc kubenswrapper[5120]: I0316 16:41:00.646856 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f4685058-90ec-421d-b95e-ca68dc1d4dcd-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f4685058-90ec-421d-b95e-ca68dc1d4dcd" (UID: "f4685058-90ec-421d-b95e-ca68dc1d4dcd"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:41:00 crc kubenswrapper[5120]: I0316 16:41:00.647453 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6hxw\" (UniqueName: \"kubernetes.io/projected/ffbcbd91-454c-4998-9b12-69ed7f853328-kube-api-access-v6hxw\") pod \"glance-default-external-api-0\" (UID: \"ffbcbd91-454c-4998-9b12-69ed7f853328\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:41:00 crc kubenswrapper[5120]: W0316 16:41:00.650834 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod462452f5_5fb2_44a0_b52d_a3660a4346f7.slice/crio-2e6a76cf001c02d2887ad7cc8ec6cf1e30d904132ecc75e73d8fe48e2de77d02 WatchSource:0}: Error finding container 2e6a76cf001c02d2887ad7cc8ec6cf1e30d904132ecc75e73d8fe48e2de77d02: Status 404 returned error can't find the container with id 2e6a76cf001c02d2887ad7cc8ec6cf1e30d904132ecc75e73d8fe48e2de77d02 Mar 16 16:41:00 crc kubenswrapper[5120]: I0316 16:41:00.684243 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="43ae87ab-7a99-41df-b39a-930c7a5a232d" path="/var/lib/kubelet/pods/43ae87ab-7a99-41df-b39a-930c7a5a232d/volumes" Mar 16 16:41:00 crc kubenswrapper[5120]: I0316 16:41:00.687285 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f8ee0802-bc93-4415-9fbe-49bd4af907f6" path="/var/lib/kubelet/pods/f8ee0802-bc93-4415-9fbe-49bd4af907f6/volumes" Mar 16 16:41:00 crc kubenswrapper[5120]: I0316 16:41:00.690131 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f4685058-90ec-421d-b95e-ca68dc1d4dcd-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "f4685058-90ec-421d-b95e-ca68dc1d4dcd" (UID: "f4685058-90ec-421d-b95e-ca68dc1d4dcd"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:41:00 crc kubenswrapper[5120]: I0316 16:41:00.691131 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f4685058-90ec-421d-b95e-ca68dc1d4dcd-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:41:00 crc kubenswrapper[5120]: I0316 16:41:00.691170 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f4685058-90ec-421d-b95e-ca68dc1d4dcd-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:41:00 crc kubenswrapper[5120]: I0316 16:41:00.695609 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"glance-default-external-api-0\" (UID: \"ffbcbd91-454c-4998-9b12-69ed7f853328\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:41:00 crc kubenswrapper[5120]: I0316 16:41:00.699432 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f4685058-90ec-421d-b95e-ca68dc1d4dcd-config-data" (OuterVolumeSpecName: "config-data") pod "f4685058-90ec-421d-b95e-ca68dc1d4dcd" (UID: "f4685058-90ec-421d-b95e-ca68dc1d4dcd"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:41:00 crc kubenswrapper[5120]: I0316 16:41:00.711524 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage06-crc" (UniqueName: "kubernetes.io/local-volume/local-storage06-crc") on node "crc" Mar 16 16:41:00 crc kubenswrapper[5120]: I0316 16:41:00.768113 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:41:00 crc kubenswrapper[5120]: I0316 16:41:00.778490 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-d38a-account-create-update-zwjc7"] Mar 16 16:41:00 crc kubenswrapper[5120]: I0316 16:41:00.788344 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-f4eb-account-create-update-krgcs"] Mar 16 16:41:00 crc kubenswrapper[5120]: I0316 16:41:00.793750 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:41:00 crc kubenswrapper[5120]: I0316 16:41:00.793886 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f4685058-90ec-421d-b95e-ca68dc1d4dcd-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:41:00 crc kubenswrapper[5120]: I0316 16:41:00.948229 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-f4eb-account-create-update-krgcs" event={"ID":"1a920725-764e-48f9-bb7f-9718e4b64091","Type":"ContainerStarted","Data":"1306f2ee6cb43d3241b148d182c102398230019df601d13dcfb6980b5cd4bafd"} Mar 16 16:41:00 crc kubenswrapper[5120]: I0316 16:41:00.950601 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:41:00 crc kubenswrapper[5120]: I0316 16:41:00.950605 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"f4685058-90ec-421d-b95e-ca68dc1d4dcd","Type":"ContainerDied","Data":"f56303067383114ae9da630eca7e6676094b124662cfce47fa78b0420a2102eb"} Mar 16 16:41:00 crc kubenswrapper[5120]: I0316 16:41:00.950679 5120 scope.go:117] "RemoveContainer" containerID="ca0ae3a8b4b307a12c44d686843908626a380c9becf90b91194b05d243c4f28b" Mar 16 16:41:00 crc kubenswrapper[5120]: I0316 16:41:00.953068 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-a3c5-account-create-update-5w5q7" event={"ID":"462452f5-5fb2-44a0-b52d-a3660a4346f7","Type":"ContainerStarted","Data":"12d08efec8a746d4f7be40b469e8dce666fcd5acfa2921f815dab63846d95a88"} Mar 16 16:41:00 crc kubenswrapper[5120]: I0316 16:41:00.953112 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-a3c5-account-create-update-5w5q7" event={"ID":"462452f5-5fb2-44a0-b52d-a3660a4346f7","Type":"ContainerStarted","Data":"2e6a76cf001c02d2887ad7cc8ec6cf1e30d904132ecc75e73d8fe48e2de77d02"} Mar 16 16:41:00 crc kubenswrapper[5120]: I0316 16:41:00.956173 5120 generic.go:358] "Generic (PLEG): container finished" podID="020c675a-4f3f-44d2-9094-31d85ee582e6" containerID="b4d629c90a77b40b3994b6e3ddb2a08d2727fc55e70e1c041f6c46ca86939a90" exitCode=0 Mar 16 16:41:00 crc kubenswrapper[5120]: I0316 16:41:00.956345 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-db-create-nn2pp" event={"ID":"020c675a-4f3f-44d2-9094-31d85ee582e6","Type":"ContainerDied","Data":"b4d629c90a77b40b3994b6e3ddb2a08d2727fc55e70e1c041f6c46ca86939a90"} Mar 16 16:41:00 crc kubenswrapper[5120]: I0316 16:41:00.956377 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-db-create-nn2pp" event={"ID":"020c675a-4f3f-44d2-9094-31d85ee582e6","Type":"ContainerStarted","Data":"12ae09942847fd11fef2dde432693fc083981d8a76ee94af2b25d9fa8e69c446"} Mar 16 16:41:00 crc kubenswrapper[5120]: I0316 16:41:00.959169 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-d38a-account-create-update-zwjc7" event={"ID":"28c1bf81-d31b-4bbc-93e5-a93447e1b730","Type":"ContainerStarted","Data":"60f2cc7798a7704f34df14cf27df8ea7482e6603399a12d80f9c951fa59ce163"} Mar 16 16:41:00 crc kubenswrapper[5120]: I0316 16:41:00.961211 5120 generic.go:358] "Generic (PLEG): container finished" podID="6d750838-2144-4d02-9e1f-a3a3f0a3ba9d" containerID="9a4a8fd4f39a6b85b0ff44030c92f4491969f088a2ccfda2072a7d8c4937c89a" exitCode=0 Mar 16 16:41:00 crc kubenswrapper[5120]: I0316 16:41:00.961308 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-db-create-pjkj4" event={"ID":"6d750838-2144-4d02-9e1f-a3a3f0a3ba9d","Type":"ContainerDied","Data":"9a4a8fd4f39a6b85b0ff44030c92f4491969f088a2ccfda2072a7d8c4937c89a"} Mar 16 16:41:00 crc kubenswrapper[5120]: I0316 16:41:00.961328 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-db-create-pjkj4" event={"ID":"6d750838-2144-4d02-9e1f-a3a3f0a3ba9d","Type":"ContainerStarted","Data":"7ebbfaef39541f4f1fad711b00e0d9e9ed6e9da7a309cafd87214acce8bafd83"} Mar 16 16:41:00 crc kubenswrapper[5120]: I0316 16:41:00.963114 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"514e99fe-d081-465e-9afb-fc169395f13b","Type":"ContainerStarted","Data":"ff3b9fce6c87b6639381aa923baed05df2122ca2aa7d76041d9c3f97d8ffb5aa"} Mar 16 16:41:00 crc kubenswrapper[5120]: I0316 16:41:00.966169 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-db-create-qwzzm" event={"ID":"cffcdd38-4c41-4e0b-9198-0b8ebea0302e","Type":"ContainerStarted","Data":"bb27e3403a0599425fb7f61691a53c6f295064572efb98c7cf63b85c8dd7a556"} Mar 16 16:41:00 crc kubenswrapper[5120]: I0316 16:41:00.966213 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-db-create-qwzzm" event={"ID":"cffcdd38-4c41-4e0b-9198-0b8ebea0302e","Type":"ContainerStarted","Data":"dc76a84c724f291aca73a78f25a3562bbec38499006c0b93e660846944fe00da"} Mar 16 16:41:00 crc kubenswrapper[5120]: I0316 16:41:00.971060 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-a3c5-account-create-update-5w5q7" podStartSLOduration=1.971046549 podStartE2EDuration="1.971046549s" podCreationTimestamp="2026-03-16 16:40:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:41:00.966149416 +0000 UTC m=+4163.120081073" watchObservedRunningTime="2026-03-16 16:41:00.971046549 +0000 UTC m=+4163.124978206" Mar 16 16:41:01 crc kubenswrapper[5120]: I0316 16:41:01.049969 5120 scope.go:117] "RemoveContainer" containerID="3ae6cb990e461484ce43a5123f5b9883d35e8186a0e537eaaee70bc093a3f8b2" Mar 16 16:41:01 crc kubenswrapper[5120]: I0316 16:41:01.129876 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:41:01 crc kubenswrapper[5120]: I0316 16:41:01.149869 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:41:01 crc kubenswrapper[5120]: I0316 16:41:01.163005 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:41:01 crc kubenswrapper[5120]: I0316 16:41:01.164179 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4685058-90ec-421d-b95e-ca68dc1d4dcd" containerName="glance-log" Mar 16 16:41:01 crc kubenswrapper[5120]: I0316 16:41:01.164200 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4685058-90ec-421d-b95e-ca68dc1d4dcd" containerName="glance-log" Mar 16 16:41:01 crc kubenswrapper[5120]: I0316 16:41:01.164224 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4685058-90ec-421d-b95e-ca68dc1d4dcd" containerName="glance-httpd" Mar 16 16:41:01 crc kubenswrapper[5120]: I0316 16:41:01.164230 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4685058-90ec-421d-b95e-ca68dc1d4dcd" containerName="glance-httpd" Mar 16 16:41:01 crc kubenswrapper[5120]: I0316 16:41:01.164405 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f4685058-90ec-421d-b95e-ca68dc1d4dcd" containerName="glance-httpd" Mar 16 16:41:01 crc kubenswrapper[5120]: I0316 16:41:01.164424 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f4685058-90ec-421d-b95e-ca68dc1d4dcd" containerName="glance-log" Mar 16 16:41:01 crc kubenswrapper[5120]: I0316 16:41:01.169411 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:41:01 crc kubenswrapper[5120]: I0316 16:41:01.173096 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:41:01 crc kubenswrapper[5120]: I0316 16:41:01.179056 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-internal-svc\"" Mar 16 16:41:01 crc kubenswrapper[5120]: I0316 16:41:01.179355 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-internal-config-data\"" Mar 16 16:41:01 crc kubenswrapper[5120]: I0316 16:41:01.246280 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/be094b3e-494e-420d-b458-0e32770cd540-config-data\") pod \"glance-default-internal-api-0\" (UID: \"be094b3e-494e-420d-b458-0e32770cd540\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:41:01 crc kubenswrapper[5120]: I0316 16:41:01.246333 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/be094b3e-494e-420d-b458-0e32770cd540-scripts\") pod \"glance-default-internal-api-0\" (UID: \"be094b3e-494e-420d-b458-0e32770cd540\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:41:01 crc kubenswrapper[5120]: I0316 16:41:01.246360 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"glance-default-internal-api-0\" (UID: \"be094b3e-494e-420d-b458-0e32770cd540\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:41:01 crc kubenswrapper[5120]: I0316 16:41:01.246513 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/be094b3e-494e-420d-b458-0e32770cd540-logs\") pod \"glance-default-internal-api-0\" (UID: \"be094b3e-494e-420d-b458-0e32770cd540\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:41:01 crc kubenswrapper[5120]: I0316 16:41:01.246563 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/be094b3e-494e-420d-b458-0e32770cd540-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"be094b3e-494e-420d-b458-0e32770cd540\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:41:01 crc kubenswrapper[5120]: I0316 16:41:01.246745 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/be094b3e-494e-420d-b458-0e32770cd540-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"be094b3e-494e-420d-b458-0e32770cd540\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:41:01 crc kubenswrapper[5120]: I0316 16:41:01.246919 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxfmf\" (UniqueName: \"kubernetes.io/projected/be094b3e-494e-420d-b458-0e32770cd540-kube-api-access-vxfmf\") pod \"glance-default-internal-api-0\" (UID: \"be094b3e-494e-420d-b458-0e32770cd540\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:41:01 crc kubenswrapper[5120]: I0316 16:41:01.246959 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/be094b3e-494e-420d-b458-0e32770cd540-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"be094b3e-494e-420d-b458-0e32770cd540\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:41:01 crc kubenswrapper[5120]: I0316 16:41:01.348875 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vxfmf\" (UniqueName: \"kubernetes.io/projected/be094b3e-494e-420d-b458-0e32770cd540-kube-api-access-vxfmf\") pod \"glance-default-internal-api-0\" (UID: \"be094b3e-494e-420d-b458-0e32770cd540\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:41:01 crc kubenswrapper[5120]: I0316 16:41:01.348957 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/be094b3e-494e-420d-b458-0e32770cd540-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"be094b3e-494e-420d-b458-0e32770cd540\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:41:01 crc kubenswrapper[5120]: I0316 16:41:01.349150 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/be094b3e-494e-420d-b458-0e32770cd540-config-data\") pod \"glance-default-internal-api-0\" (UID: \"be094b3e-494e-420d-b458-0e32770cd540\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:41:01 crc kubenswrapper[5120]: I0316 16:41:01.349193 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/be094b3e-494e-420d-b458-0e32770cd540-scripts\") pod \"glance-default-internal-api-0\" (UID: \"be094b3e-494e-420d-b458-0e32770cd540\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:41:01 crc kubenswrapper[5120]: I0316 16:41:01.349228 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"glance-default-internal-api-0\" (UID: \"be094b3e-494e-420d-b458-0e32770cd540\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:41:01 crc kubenswrapper[5120]: I0316 16:41:01.349303 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/be094b3e-494e-420d-b458-0e32770cd540-logs\") pod \"glance-default-internal-api-0\" (UID: \"be094b3e-494e-420d-b458-0e32770cd540\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:41:01 crc kubenswrapper[5120]: I0316 16:41:01.349448 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/be094b3e-494e-420d-b458-0e32770cd540-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"be094b3e-494e-420d-b458-0e32770cd540\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:41:01 crc kubenswrapper[5120]: I0316 16:41:01.349673 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/be094b3e-494e-420d-b458-0e32770cd540-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"be094b3e-494e-420d-b458-0e32770cd540\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:41:01 crc kubenswrapper[5120]: I0316 16:41:01.349793 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"glance-default-internal-api-0\" (UID: \"be094b3e-494e-420d-b458-0e32770cd540\") device mount path \"/mnt/openstack/pv06\"" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:41:01 crc kubenswrapper[5120]: I0316 16:41:01.349956 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/be094b3e-494e-420d-b458-0e32770cd540-logs\") pod \"glance-default-internal-api-0\" (UID: \"be094b3e-494e-420d-b458-0e32770cd540\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:41:01 crc kubenswrapper[5120]: I0316 16:41:01.350378 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/be094b3e-494e-420d-b458-0e32770cd540-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"be094b3e-494e-420d-b458-0e32770cd540\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:41:01 crc kubenswrapper[5120]: I0316 16:41:01.359742 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/be094b3e-494e-420d-b458-0e32770cd540-scripts\") pod \"glance-default-internal-api-0\" (UID: \"be094b3e-494e-420d-b458-0e32770cd540\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:41:01 crc kubenswrapper[5120]: I0316 16:41:01.359819 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/be094b3e-494e-420d-b458-0e32770cd540-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"be094b3e-494e-420d-b458-0e32770cd540\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:41:01 crc kubenswrapper[5120]: I0316 16:41:01.360276 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/be094b3e-494e-420d-b458-0e32770cd540-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"be094b3e-494e-420d-b458-0e32770cd540\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:41:01 crc kubenswrapper[5120]: I0316 16:41:01.362685 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/be094b3e-494e-420d-b458-0e32770cd540-config-data\") pod \"glance-default-internal-api-0\" (UID: \"be094b3e-494e-420d-b458-0e32770cd540\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:41:01 crc kubenswrapper[5120]: I0316 16:41:01.378079 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:41:01 crc kubenswrapper[5120]: I0316 16:41:01.380473 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxfmf\" (UniqueName: \"kubernetes.io/projected/be094b3e-494e-420d-b458-0e32770cd540-kube-api-access-vxfmf\") pod \"glance-default-internal-api-0\" (UID: \"be094b3e-494e-420d-b458-0e32770cd540\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:41:01 crc kubenswrapper[5120]: I0316 16:41:01.419076 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"glance-default-internal-api-0\" (UID: \"be094b3e-494e-420d-b458-0e32770cd540\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:41:01 crc kubenswrapper[5120]: I0316 16:41:01.498490 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:41:01 crc kubenswrapper[5120]: I0316 16:41:01.992752 5120 generic.go:358] "Generic (PLEG): container finished" podID="1a920725-764e-48f9-bb7f-9718e4b64091" containerID="55f9dbd289925ebb596ea54b408e443def1aead1817f034dd6ea070167e77aca" exitCode=0 Mar 16 16:41:01 crc kubenswrapper[5120]: I0316 16:41:01.992815 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-f4eb-account-create-update-krgcs" event={"ID":"1a920725-764e-48f9-bb7f-9718e4b64091","Type":"ContainerDied","Data":"55f9dbd289925ebb596ea54b408e443def1aead1817f034dd6ea070167e77aca"} Mar 16 16:41:01 crc kubenswrapper[5120]: I0316 16:41:01.997553 5120 generic.go:358] "Generic (PLEG): container finished" podID="462452f5-5fb2-44a0-b52d-a3660a4346f7" containerID="12d08efec8a746d4f7be40b469e8dce666fcd5acfa2921f815dab63846d95a88" exitCode=0 Mar 16 16:41:01 crc kubenswrapper[5120]: I0316 16:41:01.997738 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-a3c5-account-create-update-5w5q7" event={"ID":"462452f5-5fb2-44a0-b52d-a3660a4346f7","Type":"ContainerDied","Data":"12d08efec8a746d4f7be40b469e8dce666fcd5acfa2921f815dab63846d95a88"} Mar 16 16:41:02 crc kubenswrapper[5120]: I0316 16:41:01.999981 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"ffbcbd91-454c-4998-9b12-69ed7f853328","Type":"ContainerStarted","Data":"7c5481a83197b7434c5e26b760a294666558448b22619645987cee5c91840bc9"} Mar 16 16:41:02 crc kubenswrapper[5120]: I0316 16:41:02.006181 5120 generic.go:358] "Generic (PLEG): container finished" podID="28c1bf81-d31b-4bbc-93e5-a93447e1b730" containerID="a290e42d33aa4dd54212c995dd819c044c219b591caf4d3bcff2b1ba5beb03c6" exitCode=0 Mar 16 16:41:02 crc kubenswrapper[5120]: I0316 16:41:02.006326 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-d38a-account-create-update-zwjc7" event={"ID":"28c1bf81-d31b-4bbc-93e5-a93447e1b730","Type":"ContainerDied","Data":"a290e42d33aa4dd54212c995dd819c044c219b591caf4d3bcff2b1ba5beb03c6"} Mar 16 16:41:02 crc kubenswrapper[5120]: I0316 16:41:02.025173 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"514e99fe-d081-465e-9afb-fc169395f13b","Type":"ContainerStarted","Data":"f3a5f80a8738661bceb47444249f7d99bf47956dcfcebe139a529f21557b66e9"} Mar 16 16:41:02 crc kubenswrapper[5120]: I0316 16:41:02.027674 5120 generic.go:358] "Generic (PLEG): container finished" podID="cffcdd38-4c41-4e0b-9198-0b8ebea0302e" containerID="bb27e3403a0599425fb7f61691a53c6f295064572efb98c7cf63b85c8dd7a556" exitCode=0 Mar 16 16:41:02 crc kubenswrapper[5120]: I0316 16:41:02.028132 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-db-create-qwzzm" event={"ID":"cffcdd38-4c41-4e0b-9198-0b8ebea0302e","Type":"ContainerDied","Data":"bb27e3403a0599425fb7f61691a53c6f295064572efb98c7cf63b85c8dd7a556"} Mar 16 16:41:02 crc kubenswrapper[5120]: I0316 16:41:02.093893 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:41:02 crc kubenswrapper[5120]: W0316 16:41:02.108080 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbe094b3e_494e_420d_b458_0e32770cd540.slice/crio-70792f68bfba6e0ce19f3b988988aa941c3d3136a5e23e736a0fc08dea0e131e WatchSource:0}: Error finding container 70792f68bfba6e0ce19f3b988988aa941c3d3136a5e23e736a0fc08dea0e131e: Status 404 returned error can't find the container with id 70792f68bfba6e0ce19f3b988988aa941c3d3136a5e23e736a0fc08dea0e131e Mar 16 16:41:02 crc kubenswrapper[5120]: I0316 16:41:02.481544 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-db-create-qwzzm" Mar 16 16:41:02 crc kubenswrapper[5120]: I0316 16:41:02.566121 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-db-create-pjkj4" Mar 16 16:41:02 crc kubenswrapper[5120]: I0316 16:41:02.587363 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/cffcdd38-4c41-4e0b-9198-0b8ebea0302e-operator-scripts\") pod \"cffcdd38-4c41-4e0b-9198-0b8ebea0302e\" (UID: \"cffcdd38-4c41-4e0b-9198-0b8ebea0302e\") " Mar 16 16:41:02 crc kubenswrapper[5120]: I0316 16:41:02.587411 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/6d750838-2144-4d02-9e1f-a3a3f0a3ba9d-operator-scripts\") pod \"6d750838-2144-4d02-9e1f-a3a3f0a3ba9d\" (UID: \"6d750838-2144-4d02-9e1f-a3a3f0a3ba9d\") " Mar 16 16:41:02 crc kubenswrapper[5120]: I0316 16:41:02.587778 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4r9bm\" (UniqueName: \"kubernetes.io/projected/cffcdd38-4c41-4e0b-9198-0b8ebea0302e-kube-api-access-4r9bm\") pod \"cffcdd38-4c41-4e0b-9198-0b8ebea0302e\" (UID: \"cffcdd38-4c41-4e0b-9198-0b8ebea0302e\") " Mar 16 16:41:02 crc kubenswrapper[5120]: I0316 16:41:02.587911 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6l6mw\" (UniqueName: \"kubernetes.io/projected/6d750838-2144-4d02-9e1f-a3a3f0a3ba9d-kube-api-access-6l6mw\") pod \"6d750838-2144-4d02-9e1f-a3a3f0a3ba9d\" (UID: \"6d750838-2144-4d02-9e1f-a3a3f0a3ba9d\") " Mar 16 16:41:02 crc kubenswrapper[5120]: I0316 16:41:02.590355 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cffcdd38-4c41-4e0b-9198-0b8ebea0302e-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "cffcdd38-4c41-4e0b-9198-0b8ebea0302e" (UID: "cffcdd38-4c41-4e0b-9198-0b8ebea0302e"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:41:02 crc kubenswrapper[5120]: I0316 16:41:02.590374 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6d750838-2144-4d02-9e1f-a3a3f0a3ba9d-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "6d750838-2144-4d02-9e1f-a3a3f0a3ba9d" (UID: "6d750838-2144-4d02-9e1f-a3a3f0a3ba9d"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:41:02 crc kubenswrapper[5120]: I0316 16:41:02.594517 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d750838-2144-4d02-9e1f-a3a3f0a3ba9d-kube-api-access-6l6mw" (OuterVolumeSpecName: "kube-api-access-6l6mw") pod "6d750838-2144-4d02-9e1f-a3a3f0a3ba9d" (UID: "6d750838-2144-4d02-9e1f-a3a3f0a3ba9d"). InnerVolumeSpecName "kube-api-access-6l6mw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:41:02 crc kubenswrapper[5120]: I0316 16:41:02.597001 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cffcdd38-4c41-4e0b-9198-0b8ebea0302e-kube-api-access-4r9bm" (OuterVolumeSpecName: "kube-api-access-4r9bm") pod "cffcdd38-4c41-4e0b-9198-0b8ebea0302e" (UID: "cffcdd38-4c41-4e0b-9198-0b8ebea0302e"). InnerVolumeSpecName "kube-api-access-4r9bm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:41:02 crc kubenswrapper[5120]: I0316 16:41:02.673688 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-db-create-nn2pp" Mar 16 16:41:02 crc kubenswrapper[5120]: I0316 16:41:02.677171 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f4685058-90ec-421d-b95e-ca68dc1d4dcd" path="/var/lib/kubelet/pods/f4685058-90ec-421d-b95e-ca68dc1d4dcd/volumes" Mar 16 16:41:02 crc kubenswrapper[5120]: I0316 16:41:02.692658 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/020c675a-4f3f-44d2-9094-31d85ee582e6-operator-scripts\") pod \"020c675a-4f3f-44d2-9094-31d85ee582e6\" (UID: \"020c675a-4f3f-44d2-9094-31d85ee582e6\") " Mar 16 16:41:02 crc kubenswrapper[5120]: I0316 16:41:02.693152 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bq28p\" (UniqueName: \"kubernetes.io/projected/020c675a-4f3f-44d2-9094-31d85ee582e6-kube-api-access-bq28p\") pod \"020c675a-4f3f-44d2-9094-31d85ee582e6\" (UID: \"020c675a-4f3f-44d2-9094-31d85ee582e6\") " Mar 16 16:41:02 crc kubenswrapper[5120]: I0316 16:41:02.693193 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/020c675a-4f3f-44d2-9094-31d85ee582e6-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "020c675a-4f3f-44d2-9094-31d85ee582e6" (UID: "020c675a-4f3f-44d2-9094-31d85ee582e6"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:41:02 crc kubenswrapper[5120]: I0316 16:41:02.693928 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/cffcdd38-4c41-4e0b-9198-0b8ebea0302e-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:41:02 crc kubenswrapper[5120]: I0316 16:41:02.693954 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/6d750838-2144-4d02-9e1f-a3a3f0a3ba9d-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:41:02 crc kubenswrapper[5120]: I0316 16:41:02.693967 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4r9bm\" (UniqueName: \"kubernetes.io/projected/cffcdd38-4c41-4e0b-9198-0b8ebea0302e-kube-api-access-4r9bm\") on node \"crc\" DevicePath \"\"" Mar 16 16:41:02 crc kubenswrapper[5120]: I0316 16:41:02.694002 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6l6mw\" (UniqueName: \"kubernetes.io/projected/6d750838-2144-4d02-9e1f-a3a3f0a3ba9d-kube-api-access-6l6mw\") on node \"crc\" DevicePath \"\"" Mar 16 16:41:02 crc kubenswrapper[5120]: I0316 16:41:02.694015 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/020c675a-4f3f-44d2-9094-31d85ee582e6-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:41:02 crc kubenswrapper[5120]: I0316 16:41:02.707202 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/020c675a-4f3f-44d2-9094-31d85ee582e6-kube-api-access-bq28p" (OuterVolumeSpecName: "kube-api-access-bq28p") pod "020c675a-4f3f-44d2-9094-31d85ee582e6" (UID: "020c675a-4f3f-44d2-9094-31d85ee582e6"). InnerVolumeSpecName "kube-api-access-bq28p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:41:02 crc kubenswrapper[5120]: I0316 16:41:02.795953 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bq28p\" (UniqueName: \"kubernetes.io/projected/020c675a-4f3f-44d2-9094-31d85ee582e6-kube-api-access-bq28p\") on node \"crc\" DevicePath \"\"" Mar 16 16:41:03 crc kubenswrapper[5120]: I0316 16:41:03.048778 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"ffbcbd91-454c-4998-9b12-69ed7f853328","Type":"ContainerStarted","Data":"100e2f81fc414c81803e72da0cb77145f68c5dcb7c9f13cb7d2de6c84a6a43f5"} Mar 16 16:41:03 crc kubenswrapper[5120]: I0316 16:41:03.052390 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-db-create-nn2pp" event={"ID":"020c675a-4f3f-44d2-9094-31d85ee582e6","Type":"ContainerDied","Data":"12ae09942847fd11fef2dde432693fc083981d8a76ee94af2b25d9fa8e69c446"} Mar 16 16:41:03 crc kubenswrapper[5120]: I0316 16:41:03.052419 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="12ae09942847fd11fef2dde432693fc083981d8a76ee94af2b25d9fa8e69c446" Mar 16 16:41:03 crc kubenswrapper[5120]: I0316 16:41:03.052456 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-db-create-nn2pp" Mar 16 16:41:03 crc kubenswrapper[5120]: I0316 16:41:03.058656 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-db-create-pjkj4" event={"ID":"6d750838-2144-4d02-9e1f-a3a3f0a3ba9d","Type":"ContainerDied","Data":"7ebbfaef39541f4f1fad711b00e0d9e9ed6e9da7a309cafd87214acce8bafd83"} Mar 16 16:41:03 crc kubenswrapper[5120]: I0316 16:41:03.058706 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7ebbfaef39541f4f1fad711b00e0d9e9ed6e9da7a309cafd87214acce8bafd83" Mar 16 16:41:03 crc kubenswrapper[5120]: I0316 16:41:03.060023 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-db-create-pjkj4" Mar 16 16:41:03 crc kubenswrapper[5120]: I0316 16:41:03.096089 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"514e99fe-d081-465e-9afb-fc169395f13b","Type":"ContainerStarted","Data":"fa7765f58b937f65468d3e98592096c1e051feeb2381c87a0e1f3d60ced06f53"} Mar 16 16:41:03 crc kubenswrapper[5120]: I0316 16:41:03.103611 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"be094b3e-494e-420d-b458-0e32770cd540","Type":"ContainerStarted","Data":"1de4d27ef85234281dc29611eaac2860bbedc2f6d3859afdac09f43a62514da8"} Mar 16 16:41:03 crc kubenswrapper[5120]: I0316 16:41:03.103674 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"be094b3e-494e-420d-b458-0e32770cd540","Type":"ContainerStarted","Data":"70792f68bfba6e0ce19f3b988988aa941c3d3136a5e23e736a0fc08dea0e131e"} Mar 16 16:41:03 crc kubenswrapper[5120]: I0316 16:41:03.107439 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-db-create-qwzzm" Mar 16 16:41:03 crc kubenswrapper[5120]: I0316 16:41:03.108114 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-db-create-qwzzm" event={"ID":"cffcdd38-4c41-4e0b-9198-0b8ebea0302e","Type":"ContainerDied","Data":"dc76a84c724f291aca73a78f25a3562bbec38499006c0b93e660846944fe00da"} Mar 16 16:41:03 crc kubenswrapper[5120]: I0316 16:41:03.108141 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dc76a84c724f291aca73a78f25a3562bbec38499006c0b93e660846944fe00da" Mar 16 16:41:03 crc kubenswrapper[5120]: I0316 16:41:03.185668 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:41:03 crc kubenswrapper[5120]: I0316 16:41:03.615401 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-d38a-account-create-update-zwjc7" Mar 16 16:41:03 crc kubenswrapper[5120]: I0316 16:41:03.669329 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-f4eb-account-create-update-krgcs" Mar 16 16:41:03 crc kubenswrapper[5120]: I0316 16:41:03.711201 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-a3c5-account-create-update-5w5q7" Mar 16 16:41:03 crc kubenswrapper[5120]: I0316 16:41:03.719787 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bkzgn\" (UniqueName: \"kubernetes.io/projected/28c1bf81-d31b-4bbc-93e5-a93447e1b730-kube-api-access-bkzgn\") pod \"28c1bf81-d31b-4bbc-93e5-a93447e1b730\" (UID: \"28c1bf81-d31b-4bbc-93e5-a93447e1b730\") " Mar 16 16:41:03 crc kubenswrapper[5120]: I0316 16:41:03.720060 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vpm5m\" (UniqueName: \"kubernetes.io/projected/1a920725-764e-48f9-bb7f-9718e4b64091-kube-api-access-vpm5m\") pod \"1a920725-764e-48f9-bb7f-9718e4b64091\" (UID: \"1a920725-764e-48f9-bb7f-9718e4b64091\") " Mar 16 16:41:03 crc kubenswrapper[5120]: I0316 16:41:03.720154 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/1a920725-764e-48f9-bb7f-9718e4b64091-operator-scripts\") pod \"1a920725-764e-48f9-bb7f-9718e4b64091\" (UID: \"1a920725-764e-48f9-bb7f-9718e4b64091\") " Mar 16 16:41:03 crc kubenswrapper[5120]: I0316 16:41:03.720189 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/28c1bf81-d31b-4bbc-93e5-a93447e1b730-operator-scripts\") pod \"28c1bf81-d31b-4bbc-93e5-a93447e1b730\" (UID: \"28c1bf81-d31b-4bbc-93e5-a93447e1b730\") " Mar 16 16:41:03 crc kubenswrapper[5120]: I0316 16:41:03.729950 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a920725-764e-48f9-bb7f-9718e4b64091-kube-api-access-vpm5m" (OuterVolumeSpecName: "kube-api-access-vpm5m") pod "1a920725-764e-48f9-bb7f-9718e4b64091" (UID: "1a920725-764e-48f9-bb7f-9718e4b64091"). InnerVolumeSpecName "kube-api-access-vpm5m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:41:03 crc kubenswrapper[5120]: I0316 16:41:03.730423 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1a920725-764e-48f9-bb7f-9718e4b64091-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "1a920725-764e-48f9-bb7f-9718e4b64091" (UID: "1a920725-764e-48f9-bb7f-9718e4b64091"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:41:03 crc kubenswrapper[5120]: I0316 16:41:03.730734 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/28c1bf81-d31b-4bbc-93e5-a93447e1b730-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "28c1bf81-d31b-4bbc-93e5-a93447e1b730" (UID: "28c1bf81-d31b-4bbc-93e5-a93447e1b730"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:41:03 crc kubenswrapper[5120]: I0316 16:41:03.731572 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28c1bf81-d31b-4bbc-93e5-a93447e1b730-kube-api-access-bkzgn" (OuterVolumeSpecName: "kube-api-access-bkzgn") pod "28c1bf81-d31b-4bbc-93e5-a93447e1b730" (UID: "28c1bf81-d31b-4bbc-93e5-a93447e1b730"). InnerVolumeSpecName "kube-api-access-bkzgn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:41:03 crc kubenswrapper[5120]: I0316 16:41:03.822364 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gdrvw\" (UniqueName: \"kubernetes.io/projected/462452f5-5fb2-44a0-b52d-a3660a4346f7-kube-api-access-gdrvw\") pod \"462452f5-5fb2-44a0-b52d-a3660a4346f7\" (UID: \"462452f5-5fb2-44a0-b52d-a3660a4346f7\") " Mar 16 16:41:03 crc kubenswrapper[5120]: I0316 16:41:03.822484 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/462452f5-5fb2-44a0-b52d-a3660a4346f7-operator-scripts\") pod \"462452f5-5fb2-44a0-b52d-a3660a4346f7\" (UID: \"462452f5-5fb2-44a0-b52d-a3660a4346f7\") " Mar 16 16:41:03 crc kubenswrapper[5120]: I0316 16:41:03.823165 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/462452f5-5fb2-44a0-b52d-a3660a4346f7-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "462452f5-5fb2-44a0-b52d-a3660a4346f7" (UID: "462452f5-5fb2-44a0-b52d-a3660a4346f7"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:41:03 crc kubenswrapper[5120]: I0316 16:41:03.823904 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bkzgn\" (UniqueName: \"kubernetes.io/projected/28c1bf81-d31b-4bbc-93e5-a93447e1b730-kube-api-access-bkzgn\") on node \"crc\" DevicePath \"\"" Mar 16 16:41:03 crc kubenswrapper[5120]: I0316 16:41:03.823922 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/462452f5-5fb2-44a0-b52d-a3660a4346f7-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:41:03 crc kubenswrapper[5120]: I0316 16:41:03.823934 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vpm5m\" (UniqueName: \"kubernetes.io/projected/1a920725-764e-48f9-bb7f-9718e4b64091-kube-api-access-vpm5m\") on node \"crc\" DevicePath \"\"" Mar 16 16:41:03 crc kubenswrapper[5120]: I0316 16:41:03.823943 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/1a920725-764e-48f9-bb7f-9718e4b64091-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:41:03 crc kubenswrapper[5120]: I0316 16:41:03.823951 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/28c1bf81-d31b-4bbc-93e5-a93447e1b730-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:41:03 crc kubenswrapper[5120]: I0316 16:41:03.826927 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/462452f5-5fb2-44a0-b52d-a3660a4346f7-kube-api-access-gdrvw" (OuterVolumeSpecName: "kube-api-access-gdrvw") pod "462452f5-5fb2-44a0-b52d-a3660a4346f7" (UID: "462452f5-5fb2-44a0-b52d-a3660a4346f7"). InnerVolumeSpecName "kube-api-access-gdrvw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:41:03 crc kubenswrapper[5120]: I0316 16:41:03.927156 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gdrvw\" (UniqueName: \"kubernetes.io/projected/462452f5-5fb2-44a0-b52d-a3660a4346f7-kube-api-access-gdrvw\") on node \"crc\" DevicePath \"\"" Mar 16 16:41:04 crc kubenswrapper[5120]: I0316 16:41:04.120574 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-a3c5-account-create-update-5w5q7" event={"ID":"462452f5-5fb2-44a0-b52d-a3660a4346f7","Type":"ContainerDied","Data":"2e6a76cf001c02d2887ad7cc8ec6cf1e30d904132ecc75e73d8fe48e2de77d02"} Mar 16 16:41:04 crc kubenswrapper[5120]: I0316 16:41:04.120620 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2e6a76cf001c02d2887ad7cc8ec6cf1e30d904132ecc75e73d8fe48e2de77d02" Mar 16 16:41:04 crc kubenswrapper[5120]: I0316 16:41:04.120621 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-a3c5-account-create-update-5w5q7" Mar 16 16:41:04 crc kubenswrapper[5120]: I0316 16:41:04.122643 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"ffbcbd91-454c-4998-9b12-69ed7f853328","Type":"ContainerStarted","Data":"6639e315af61023162c1fff62d7078f952718cb1641545fd6b502793501a8f4b"} Mar 16 16:41:04 crc kubenswrapper[5120]: I0316 16:41:04.127635 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-d38a-account-create-update-zwjc7" event={"ID":"28c1bf81-d31b-4bbc-93e5-a93447e1b730","Type":"ContainerDied","Data":"60f2cc7798a7704f34df14cf27df8ea7482e6603399a12d80f9c951fa59ce163"} Mar 16 16:41:04 crc kubenswrapper[5120]: I0316 16:41:04.127671 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="60f2cc7798a7704f34df14cf27df8ea7482e6603399a12d80f9c951fa59ce163" Mar 16 16:41:04 crc kubenswrapper[5120]: I0316 16:41:04.127739 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-d38a-account-create-update-zwjc7" Mar 16 16:41:04 crc kubenswrapper[5120]: I0316 16:41:04.138144 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"514e99fe-d081-465e-9afb-fc169395f13b","Type":"ContainerStarted","Data":"77615f2d63c5f858411dfcb0a5aa997f937231fe0abea5fdd32003d5a0b5d2b7"} Mar 16 16:41:04 crc kubenswrapper[5120]: I0316 16:41:04.149912 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-external-api-0" podStartSLOduration=4.149895495 podStartE2EDuration="4.149895495s" podCreationTimestamp="2026-03-16 16:41:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:41:04.142543945 +0000 UTC m=+4166.296475622" watchObservedRunningTime="2026-03-16 16:41:04.149895495 +0000 UTC m=+4166.303827152" Mar 16 16:41:04 crc kubenswrapper[5120]: I0316 16:41:04.151319 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"be094b3e-494e-420d-b458-0e32770cd540","Type":"ContainerStarted","Data":"503b90090ae8a47de41498d2d43c08c9f18dfaaa22a4ca2e49962c58dcc9ae34"} Mar 16 16:41:04 crc kubenswrapper[5120]: I0316 16:41:04.155717 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-f4eb-account-create-update-krgcs" Mar 16 16:41:04 crc kubenswrapper[5120]: I0316 16:41:04.156204 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-f4eb-account-create-update-krgcs" event={"ID":"1a920725-764e-48f9-bb7f-9718e4b64091","Type":"ContainerDied","Data":"1306f2ee6cb43d3241b148d182c102398230019df601d13dcfb6980b5cd4bafd"} Mar 16 16:41:04 crc kubenswrapper[5120]: I0316 16:41:04.156259 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1306f2ee6cb43d3241b148d182c102398230019df601d13dcfb6980b5cd4bafd" Mar 16 16:41:04 crc kubenswrapper[5120]: I0316 16:41:04.181727 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-internal-api-0" podStartSLOduration=3.181709977 podStartE2EDuration="3.181709977s" podCreationTimestamp="2026-03-16 16:41:01 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:41:04.171587793 +0000 UTC m=+4166.325519450" watchObservedRunningTime="2026-03-16 16:41:04.181709977 +0000 UTC m=+4166.335641634" Mar 16 16:41:06 crc kubenswrapper[5120]: I0316 16:41:06.180788 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"514e99fe-d081-465e-9afb-fc169395f13b","Type":"ContainerStarted","Data":"4faf83d1b9b0c7056a0b2b719a72c73224a55ec32b5b08402986dae0d559f91e"} Mar 16 16:41:06 crc kubenswrapper[5120]: I0316 16:41:06.181425 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:41:06 crc kubenswrapper[5120]: I0316 16:41:06.180956 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="514e99fe-d081-465e-9afb-fc169395f13b" containerName="sg-core" containerID="cri-o://77615f2d63c5f858411dfcb0a5aa997f937231fe0abea5fdd32003d5a0b5d2b7" gracePeriod=30 Mar 16 16:41:06 crc kubenswrapper[5120]: I0316 16:41:06.180910 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="514e99fe-d081-465e-9afb-fc169395f13b" containerName="proxy-httpd" containerID="cri-o://4faf83d1b9b0c7056a0b2b719a72c73224a55ec32b5b08402986dae0d559f91e" gracePeriod=30 Mar 16 16:41:06 crc kubenswrapper[5120]: I0316 16:41:06.181145 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="514e99fe-d081-465e-9afb-fc169395f13b" containerName="ceilometer-central-agent" containerID="cri-o://f3a5f80a8738661bceb47444249f7d99bf47956dcfcebe139a529f21557b66e9" gracePeriod=30 Mar 16 16:41:06 crc kubenswrapper[5120]: I0316 16:41:06.181026 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="514e99fe-d081-465e-9afb-fc169395f13b" containerName="ceilometer-notification-agent" containerID="cri-o://fa7765f58b937f65468d3e98592096c1e051feeb2381c87a0e1f3d60ced06f53" gracePeriod=30 Mar 16 16:41:06 crc kubenswrapper[5120]: I0316 16:41:06.212465 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.820055461 podStartE2EDuration="8.212449653s" podCreationTimestamp="2026-03-16 16:40:58 +0000 UTC" firstStartedPulling="2026-03-16 16:40:59.967326548 +0000 UTC m=+4162.121258205" lastFinishedPulling="2026-03-16 16:41:05.35972073 +0000 UTC m=+4167.513652397" observedRunningTime="2026-03-16 16:41:06.205225118 +0000 UTC m=+4168.359156775" watchObservedRunningTime="2026-03-16 16:41:06.212449653 +0000 UTC m=+4168.366381310" Mar 16 16:41:07 crc kubenswrapper[5120]: I0316 16:41:07.193625 5120 generic.go:358] "Generic (PLEG): container finished" podID="514e99fe-d081-465e-9afb-fc169395f13b" containerID="4faf83d1b9b0c7056a0b2b719a72c73224a55ec32b5b08402986dae0d559f91e" exitCode=0 Mar 16 16:41:07 crc kubenswrapper[5120]: I0316 16:41:07.193965 5120 generic.go:358] "Generic (PLEG): container finished" podID="514e99fe-d081-465e-9afb-fc169395f13b" containerID="77615f2d63c5f858411dfcb0a5aa997f937231fe0abea5fdd32003d5a0b5d2b7" exitCode=2 Mar 16 16:41:07 crc kubenswrapper[5120]: I0316 16:41:07.193976 5120 generic.go:358] "Generic (PLEG): container finished" podID="514e99fe-d081-465e-9afb-fc169395f13b" containerID="fa7765f58b937f65468d3e98592096c1e051feeb2381c87a0e1f3d60ced06f53" exitCode=0 Mar 16 16:41:07 crc kubenswrapper[5120]: I0316 16:41:07.194020 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"514e99fe-d081-465e-9afb-fc169395f13b","Type":"ContainerDied","Data":"4faf83d1b9b0c7056a0b2b719a72c73224a55ec32b5b08402986dae0d559f91e"} Mar 16 16:41:07 crc kubenswrapper[5120]: I0316 16:41:07.194049 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"514e99fe-d081-465e-9afb-fc169395f13b","Type":"ContainerDied","Data":"77615f2d63c5f858411dfcb0a5aa997f937231fe0abea5fdd32003d5a0b5d2b7"} Mar 16 16:41:07 crc kubenswrapper[5120]: I0316 16:41:07.194061 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"514e99fe-d081-465e-9afb-fc169395f13b","Type":"ContainerDied","Data":"fa7765f58b937f65468d3e98592096c1e051feeb2381c87a0e1f3d60ced06f53"} Mar 16 16:41:08 crc kubenswrapper[5120]: E0316 16:41:08.700021 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1756111 actualBytes=10240 Mar 16 16:41:09 crc kubenswrapper[5120]: I0316 16:41:09.743422 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-2dbbn"] Mar 16 16:41:09 crc kubenswrapper[5120]: I0316 16:41:09.744724 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="462452f5-5fb2-44a0-b52d-a3660a4346f7" containerName="mariadb-account-create-update" Mar 16 16:41:09 crc kubenswrapper[5120]: I0316 16:41:09.744745 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="462452f5-5fb2-44a0-b52d-a3660a4346f7" containerName="mariadb-account-create-update" Mar 16 16:41:09 crc kubenswrapper[5120]: I0316 16:41:09.744795 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a920725-764e-48f9-bb7f-9718e4b64091" containerName="mariadb-account-create-update" Mar 16 16:41:09 crc kubenswrapper[5120]: I0316 16:41:09.744806 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a920725-764e-48f9-bb7f-9718e4b64091" containerName="mariadb-account-create-update" Mar 16 16:41:09 crc kubenswrapper[5120]: I0316 16:41:09.744834 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28c1bf81-d31b-4bbc-93e5-a93447e1b730" containerName="mariadb-account-create-update" Mar 16 16:41:09 crc kubenswrapper[5120]: I0316 16:41:09.744840 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="28c1bf81-d31b-4bbc-93e5-a93447e1b730" containerName="mariadb-account-create-update" Mar 16 16:41:09 crc kubenswrapper[5120]: I0316 16:41:09.744851 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d750838-2144-4d02-9e1f-a3a3f0a3ba9d" containerName="mariadb-database-create" Mar 16 16:41:09 crc kubenswrapper[5120]: I0316 16:41:09.744857 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d750838-2144-4d02-9e1f-a3a3f0a3ba9d" containerName="mariadb-database-create" Mar 16 16:41:09 crc kubenswrapper[5120]: I0316 16:41:09.744868 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="020c675a-4f3f-44d2-9094-31d85ee582e6" containerName="mariadb-database-create" Mar 16 16:41:09 crc kubenswrapper[5120]: I0316 16:41:09.744874 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="020c675a-4f3f-44d2-9094-31d85ee582e6" containerName="mariadb-database-create" Mar 16 16:41:09 crc kubenswrapper[5120]: I0316 16:41:09.744891 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cffcdd38-4c41-4e0b-9198-0b8ebea0302e" containerName="mariadb-database-create" Mar 16 16:41:09 crc kubenswrapper[5120]: I0316 16:41:09.744899 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="cffcdd38-4c41-4e0b-9198-0b8ebea0302e" containerName="mariadb-database-create" Mar 16 16:41:09 crc kubenswrapper[5120]: I0316 16:41:09.745086 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="cffcdd38-4c41-4e0b-9198-0b8ebea0302e" containerName="mariadb-database-create" Mar 16 16:41:09 crc kubenswrapper[5120]: I0316 16:41:09.745100 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="6d750838-2144-4d02-9e1f-a3a3f0a3ba9d" containerName="mariadb-database-create" Mar 16 16:41:09 crc kubenswrapper[5120]: I0316 16:41:09.745110 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="020c675a-4f3f-44d2-9094-31d85ee582e6" containerName="mariadb-database-create" Mar 16 16:41:09 crc kubenswrapper[5120]: I0316 16:41:09.745120 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1a920725-764e-48f9-bb7f-9718e4b64091" containerName="mariadb-account-create-update" Mar 16 16:41:09 crc kubenswrapper[5120]: I0316 16:41:09.745126 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="28c1bf81-d31b-4bbc-93e5-a93447e1b730" containerName="mariadb-account-create-update" Mar 16 16:41:09 crc kubenswrapper[5120]: I0316 16:41:09.745134 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="462452f5-5fb2-44a0-b52d-a3660a4346f7" containerName="mariadb-account-create-update" Mar 16 16:41:09 crc kubenswrapper[5120]: I0316 16:41:09.753156 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-2dbbn" Mar 16 16:41:09 crc kubenswrapper[5120]: I0316 16:41:09.755866 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-conductor-config-data\"" Mar 16 16:41:09 crc kubenswrapper[5120]: I0316 16:41:09.755926 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-conductor-scripts\"" Mar 16 16:41:09 crc kubenswrapper[5120]: I0316 16:41:09.756033 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-nova-dockercfg-nxlgh\"" Mar 16 16:41:09 crc kubenswrapper[5120]: I0316 16:41:09.766086 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-2dbbn"] Mar 16 16:41:09 crc kubenswrapper[5120]: I0316 16:41:09.900401 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/52537c6c-c75e-4d04-8cb0-40e7ed0e33d9-config-data\") pod \"nova-cell0-conductor-db-sync-2dbbn\" (UID: \"52537c6c-c75e-4d04-8cb0-40e7ed0e33d9\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-2dbbn" Mar 16 16:41:09 crc kubenswrapper[5120]: I0316 16:41:09.900567 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/52537c6c-c75e-4d04-8cb0-40e7ed0e33d9-scripts\") pod \"nova-cell0-conductor-db-sync-2dbbn\" (UID: \"52537c6c-c75e-4d04-8cb0-40e7ed0e33d9\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-2dbbn" Mar 16 16:41:09 crc kubenswrapper[5120]: I0316 16:41:09.900711 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fd2js\" (UniqueName: \"kubernetes.io/projected/52537c6c-c75e-4d04-8cb0-40e7ed0e33d9-kube-api-access-fd2js\") pod \"nova-cell0-conductor-db-sync-2dbbn\" (UID: \"52537c6c-c75e-4d04-8cb0-40e7ed0e33d9\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-2dbbn" Mar 16 16:41:09 crc kubenswrapper[5120]: I0316 16:41:09.900870 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/52537c6c-c75e-4d04-8cb0-40e7ed0e33d9-combined-ca-bundle\") pod \"nova-cell0-conductor-db-sync-2dbbn\" (UID: \"52537c6c-c75e-4d04-8cb0-40e7ed0e33d9\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-2dbbn" Mar 16 16:41:10 crc kubenswrapper[5120]: I0316 16:41:10.003112 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/52537c6c-c75e-4d04-8cb0-40e7ed0e33d9-config-data\") pod \"nova-cell0-conductor-db-sync-2dbbn\" (UID: \"52537c6c-c75e-4d04-8cb0-40e7ed0e33d9\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-2dbbn" Mar 16 16:41:10 crc kubenswrapper[5120]: I0316 16:41:10.003211 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/52537c6c-c75e-4d04-8cb0-40e7ed0e33d9-scripts\") pod \"nova-cell0-conductor-db-sync-2dbbn\" (UID: \"52537c6c-c75e-4d04-8cb0-40e7ed0e33d9\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-2dbbn" Mar 16 16:41:10 crc kubenswrapper[5120]: I0316 16:41:10.003254 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fd2js\" (UniqueName: \"kubernetes.io/projected/52537c6c-c75e-4d04-8cb0-40e7ed0e33d9-kube-api-access-fd2js\") pod \"nova-cell0-conductor-db-sync-2dbbn\" (UID: \"52537c6c-c75e-4d04-8cb0-40e7ed0e33d9\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-2dbbn" Mar 16 16:41:10 crc kubenswrapper[5120]: I0316 16:41:10.003305 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/52537c6c-c75e-4d04-8cb0-40e7ed0e33d9-combined-ca-bundle\") pod \"nova-cell0-conductor-db-sync-2dbbn\" (UID: \"52537c6c-c75e-4d04-8cb0-40e7ed0e33d9\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-2dbbn" Mar 16 16:41:10 crc kubenswrapper[5120]: I0316 16:41:10.009011 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/52537c6c-c75e-4d04-8cb0-40e7ed0e33d9-scripts\") pod \"nova-cell0-conductor-db-sync-2dbbn\" (UID: \"52537c6c-c75e-4d04-8cb0-40e7ed0e33d9\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-2dbbn" Mar 16 16:41:10 crc kubenswrapper[5120]: I0316 16:41:10.009999 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/52537c6c-c75e-4d04-8cb0-40e7ed0e33d9-config-data\") pod \"nova-cell0-conductor-db-sync-2dbbn\" (UID: \"52537c6c-c75e-4d04-8cb0-40e7ed0e33d9\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-2dbbn" Mar 16 16:41:10 crc kubenswrapper[5120]: I0316 16:41:10.011325 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/52537c6c-c75e-4d04-8cb0-40e7ed0e33d9-combined-ca-bundle\") pod \"nova-cell0-conductor-db-sync-2dbbn\" (UID: \"52537c6c-c75e-4d04-8cb0-40e7ed0e33d9\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-2dbbn" Mar 16 16:41:10 crc kubenswrapper[5120]: I0316 16:41:10.026941 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fd2js\" (UniqueName: \"kubernetes.io/projected/52537c6c-c75e-4d04-8cb0-40e7ed0e33d9-kube-api-access-fd2js\") pod \"nova-cell0-conductor-db-sync-2dbbn\" (UID: \"52537c6c-c75e-4d04-8cb0-40e7ed0e33d9\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-2dbbn" Mar 16 16:41:10 crc kubenswrapper[5120]: I0316 16:41:10.084985 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-2dbbn" Mar 16 16:41:10 crc kubenswrapper[5120]: I0316 16:41:10.255325 5120 generic.go:358] "Generic (PLEG): container finished" podID="514e99fe-d081-465e-9afb-fc169395f13b" containerID="f3a5f80a8738661bceb47444249f7d99bf47956dcfcebe139a529f21557b66e9" exitCode=0 Mar 16 16:41:10 crc kubenswrapper[5120]: I0316 16:41:10.256381 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"514e99fe-d081-465e-9afb-fc169395f13b","Type":"ContainerDied","Data":"f3a5f80a8738661bceb47444249f7d99bf47956dcfcebe139a529f21557b66e9"} Mar 16 16:41:10 crc kubenswrapper[5120]: I0316 16:41:10.345151 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:41:10 crc kubenswrapper[5120]: I0316 16:41:10.412493 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/514e99fe-d081-465e-9afb-fc169395f13b-ceilometer-tls-certs\") pod \"514e99fe-d081-465e-9afb-fc169395f13b\" (UID: \"514e99fe-d081-465e-9afb-fc169395f13b\") " Mar 16 16:41:10 crc kubenswrapper[5120]: I0316 16:41:10.412645 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/514e99fe-d081-465e-9afb-fc169395f13b-log-httpd\") pod \"514e99fe-d081-465e-9afb-fc169395f13b\" (UID: \"514e99fe-d081-465e-9afb-fc169395f13b\") " Mar 16 16:41:10 crc kubenswrapper[5120]: I0316 16:41:10.412727 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/514e99fe-d081-465e-9afb-fc169395f13b-combined-ca-bundle\") pod \"514e99fe-d081-465e-9afb-fc169395f13b\" (UID: \"514e99fe-d081-465e-9afb-fc169395f13b\") " Mar 16 16:41:10 crc kubenswrapper[5120]: I0316 16:41:10.412857 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/514e99fe-d081-465e-9afb-fc169395f13b-run-httpd\") pod \"514e99fe-d081-465e-9afb-fc169395f13b\" (UID: \"514e99fe-d081-465e-9afb-fc169395f13b\") " Mar 16 16:41:10 crc kubenswrapper[5120]: I0316 16:41:10.412890 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pghdp\" (UniqueName: \"kubernetes.io/projected/514e99fe-d081-465e-9afb-fc169395f13b-kube-api-access-pghdp\") pod \"514e99fe-d081-465e-9afb-fc169395f13b\" (UID: \"514e99fe-d081-465e-9afb-fc169395f13b\") " Mar 16 16:41:10 crc kubenswrapper[5120]: I0316 16:41:10.413078 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/514e99fe-d081-465e-9afb-fc169395f13b-config-data\") pod \"514e99fe-d081-465e-9afb-fc169395f13b\" (UID: \"514e99fe-d081-465e-9afb-fc169395f13b\") " Mar 16 16:41:10 crc kubenswrapper[5120]: I0316 16:41:10.413117 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/514e99fe-d081-465e-9afb-fc169395f13b-scripts\") pod \"514e99fe-d081-465e-9afb-fc169395f13b\" (UID: \"514e99fe-d081-465e-9afb-fc169395f13b\") " Mar 16 16:41:10 crc kubenswrapper[5120]: I0316 16:41:10.413221 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/514e99fe-d081-465e-9afb-fc169395f13b-sg-core-conf-yaml\") pod \"514e99fe-d081-465e-9afb-fc169395f13b\" (UID: \"514e99fe-d081-465e-9afb-fc169395f13b\") " Mar 16 16:41:10 crc kubenswrapper[5120]: I0316 16:41:10.420495 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/514e99fe-d081-465e-9afb-fc169395f13b-kube-api-access-pghdp" (OuterVolumeSpecName: "kube-api-access-pghdp") pod "514e99fe-d081-465e-9afb-fc169395f13b" (UID: "514e99fe-d081-465e-9afb-fc169395f13b"). InnerVolumeSpecName "kube-api-access-pghdp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:41:10 crc kubenswrapper[5120]: I0316 16:41:10.422482 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/514e99fe-d081-465e-9afb-fc169395f13b-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "514e99fe-d081-465e-9afb-fc169395f13b" (UID: "514e99fe-d081-465e-9afb-fc169395f13b"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:41:10 crc kubenswrapper[5120]: I0316 16:41:10.423119 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/514e99fe-d081-465e-9afb-fc169395f13b-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "514e99fe-d081-465e-9afb-fc169395f13b" (UID: "514e99fe-d081-465e-9afb-fc169395f13b"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:41:10 crc kubenswrapper[5120]: I0316 16:41:10.431709 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/514e99fe-d081-465e-9afb-fc169395f13b-scripts" (OuterVolumeSpecName: "scripts") pod "514e99fe-d081-465e-9afb-fc169395f13b" (UID: "514e99fe-d081-465e-9afb-fc169395f13b"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:41:10 crc kubenswrapper[5120]: I0316 16:41:10.458541 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/514e99fe-d081-465e-9afb-fc169395f13b-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "514e99fe-d081-465e-9afb-fc169395f13b" (UID: "514e99fe-d081-465e-9afb-fc169395f13b"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:41:10 crc kubenswrapper[5120]: I0316 16:41:10.487210 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/514e99fe-d081-465e-9afb-fc169395f13b-ceilometer-tls-certs" (OuterVolumeSpecName: "ceilometer-tls-certs") pod "514e99fe-d081-465e-9afb-fc169395f13b" (UID: "514e99fe-d081-465e-9afb-fc169395f13b"). InnerVolumeSpecName "ceilometer-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:41:10 crc kubenswrapper[5120]: I0316 16:41:10.508383 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/514e99fe-d081-465e-9afb-fc169395f13b-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "514e99fe-d081-465e-9afb-fc169395f13b" (UID: "514e99fe-d081-465e-9afb-fc169395f13b"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:41:10 crc kubenswrapper[5120]: I0316 16:41:10.521939 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/514e99fe-d081-465e-9afb-fc169395f13b-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:41:10 crc kubenswrapper[5120]: I0316 16:41:10.522176 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/514e99fe-d081-465e-9afb-fc169395f13b-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:41:10 crc kubenswrapper[5120]: I0316 16:41:10.522253 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pghdp\" (UniqueName: \"kubernetes.io/projected/514e99fe-d081-465e-9afb-fc169395f13b-kube-api-access-pghdp\") on node \"crc\" DevicePath \"\"" Mar 16 16:41:10 crc kubenswrapper[5120]: I0316 16:41:10.522325 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/514e99fe-d081-465e-9afb-fc169395f13b-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:41:10 crc kubenswrapper[5120]: I0316 16:41:10.522399 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/514e99fe-d081-465e-9afb-fc169395f13b-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 16:41:10 crc kubenswrapper[5120]: I0316 16:41:10.522466 5120 reconciler_common.go:299] "Volume detached for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/514e99fe-d081-465e-9afb-fc169395f13b-ceilometer-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:41:10 crc kubenswrapper[5120]: I0316 16:41:10.522532 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/514e99fe-d081-465e-9afb-fc169395f13b-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:41:10 crc kubenswrapper[5120]: I0316 16:41:10.538449 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/514e99fe-d081-465e-9afb-fc169395f13b-config-data" (OuterVolumeSpecName: "config-data") pod "514e99fe-d081-465e-9afb-fc169395f13b" (UID: "514e99fe-d081-465e-9afb-fc169395f13b"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:41:10 crc kubenswrapper[5120]: I0316 16:41:10.624613 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/514e99fe-d081-465e-9afb-fc169395f13b-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:41:10 crc kubenswrapper[5120]: I0316 16:41:10.626488 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-2dbbn"] Mar 16 16:41:10 crc kubenswrapper[5120]: I0316 16:41:10.769821 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:41:10 crc kubenswrapper[5120]: I0316 16:41:10.769866 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:41:10 crc kubenswrapper[5120]: I0316 16:41:10.802752 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:41:10 crc kubenswrapper[5120]: I0316 16:41:10.833551 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:41:11 crc kubenswrapper[5120]: I0316 16:41:11.267228 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-2dbbn" event={"ID":"52537c6c-c75e-4d04-8cb0-40e7ed0e33d9","Type":"ContainerStarted","Data":"fbb614ab9d99809725c904658acafddfbc9f74f0dc462732da0498f6f5eba626"} Mar 16 16:41:11 crc kubenswrapper[5120]: I0316 16:41:11.267276 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-2dbbn" event={"ID":"52537c6c-c75e-4d04-8cb0-40e7ed0e33d9","Type":"ContainerStarted","Data":"2903bb8ad1f1642ae448afcc86dc99ba8f14665674502a3193063dea58aa20e8"} Mar 16 16:41:11 crc kubenswrapper[5120]: I0316 16:41:11.271458 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:41:11 crc kubenswrapper[5120]: I0316 16:41:11.271484 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"514e99fe-d081-465e-9afb-fc169395f13b","Type":"ContainerDied","Data":"ff3b9fce6c87b6639381aa923baed05df2122ca2aa7d76041d9c3f97d8ffb5aa"} Mar 16 16:41:11 crc kubenswrapper[5120]: I0316 16:41:11.271675 5120 scope.go:117] "RemoveContainer" containerID="4faf83d1b9b0c7056a0b2b719a72c73224a55ec32b5b08402986dae0d559f91e" Mar 16 16:41:11 crc kubenswrapper[5120]: I0316 16:41:11.272206 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:41:11 crc kubenswrapper[5120]: I0316 16:41:11.272238 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:41:11 crc kubenswrapper[5120]: I0316 16:41:11.293863 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-2dbbn" podStartSLOduration=2.293839345 podStartE2EDuration="2.293839345s" podCreationTimestamp="2026-03-16 16:41:09 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:41:11.28445705 +0000 UTC m=+4173.438388707" watchObservedRunningTime="2026-03-16 16:41:11.293839345 +0000 UTC m=+4173.447771002" Mar 16 16:41:11 crc kubenswrapper[5120]: I0316 16:41:11.296587 5120 scope.go:117] "RemoveContainer" containerID="77615f2d63c5f858411dfcb0a5aa997f937231fe0abea5fdd32003d5a0b5d2b7" Mar 16 16:41:11 crc kubenswrapper[5120]: I0316 16:41:11.308390 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:41:11 crc kubenswrapper[5120]: I0316 16:41:11.325692 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:41:11 crc kubenswrapper[5120]: I0316 16:41:11.331473 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:41:11 crc kubenswrapper[5120]: I0316 16:41:11.333182 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="514e99fe-d081-465e-9afb-fc169395f13b" containerName="ceilometer-notification-agent" Mar 16 16:41:11 crc kubenswrapper[5120]: I0316 16:41:11.333208 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="514e99fe-d081-465e-9afb-fc169395f13b" containerName="ceilometer-notification-agent" Mar 16 16:41:11 crc kubenswrapper[5120]: I0316 16:41:11.333242 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="514e99fe-d081-465e-9afb-fc169395f13b" containerName="sg-core" Mar 16 16:41:11 crc kubenswrapper[5120]: I0316 16:41:11.333251 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="514e99fe-d081-465e-9afb-fc169395f13b" containerName="sg-core" Mar 16 16:41:11 crc kubenswrapper[5120]: I0316 16:41:11.333286 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="514e99fe-d081-465e-9afb-fc169395f13b" containerName="proxy-httpd" Mar 16 16:41:11 crc kubenswrapper[5120]: I0316 16:41:11.333294 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="514e99fe-d081-465e-9afb-fc169395f13b" containerName="proxy-httpd" Mar 16 16:41:11 crc kubenswrapper[5120]: I0316 16:41:11.333320 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="514e99fe-d081-465e-9afb-fc169395f13b" containerName="ceilometer-central-agent" Mar 16 16:41:11 crc kubenswrapper[5120]: I0316 16:41:11.333328 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="514e99fe-d081-465e-9afb-fc169395f13b" containerName="ceilometer-central-agent" Mar 16 16:41:11 crc kubenswrapper[5120]: I0316 16:41:11.333570 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="514e99fe-d081-465e-9afb-fc169395f13b" containerName="sg-core" Mar 16 16:41:11 crc kubenswrapper[5120]: I0316 16:41:11.333653 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="514e99fe-d081-465e-9afb-fc169395f13b" containerName="ceilometer-notification-agent" Mar 16 16:41:11 crc kubenswrapper[5120]: I0316 16:41:11.333681 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="514e99fe-d081-465e-9afb-fc169395f13b" containerName="ceilometer-central-agent" Mar 16 16:41:11 crc kubenswrapper[5120]: I0316 16:41:11.333710 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="514e99fe-d081-465e-9afb-fc169395f13b" containerName="proxy-httpd" Mar 16 16:41:11 crc kubenswrapper[5120]: I0316 16:41:11.334035 5120 scope.go:117] "RemoveContainer" containerID="fa7765f58b937f65468d3e98592096c1e051feeb2381c87a0e1f3d60ced06f53" Mar 16 16:41:11 crc kubenswrapper[5120]: I0316 16:41:11.343385 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:41:11 crc kubenswrapper[5120]: I0316 16:41:11.345777 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 16:41:11 crc kubenswrapper[5120]: I0316 16:41:11.350118 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 16:41:11 crc kubenswrapper[5120]: I0316 16:41:11.350604 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:41:11 crc kubenswrapper[5120]: I0316 16:41:11.351478 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ceilometer-internal-svc\"" Mar 16 16:41:11 crc kubenswrapper[5120]: I0316 16:41:11.358333 5120 scope.go:117] "RemoveContainer" containerID="f3a5f80a8738661bceb47444249f7d99bf47956dcfcebe139a529f21557b66e9" Mar 16 16:41:11 crc kubenswrapper[5120]: I0316 16:41:11.447174 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/a95d8c72-85c3-4c4a-a965-f4e6fd841cd5-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"a95d8c72-85c3-4c4a-a965-f4e6fd841cd5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:41:11 crc kubenswrapper[5120]: I0316 16:41:11.447522 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/a95d8c72-85c3-4c4a-a965-f4e6fd841cd5-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"a95d8c72-85c3-4c4a-a965-f4e6fd841cd5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:41:11 crc kubenswrapper[5120]: I0316 16:41:11.447815 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a95d8c72-85c3-4c4a-a965-f4e6fd841cd5-config-data\") pod \"ceilometer-0\" (UID: \"a95d8c72-85c3-4c4a-a965-f4e6fd841cd5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:41:11 crc kubenswrapper[5120]: I0316 16:41:11.447921 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llrd5\" (UniqueName: \"kubernetes.io/projected/a95d8c72-85c3-4c4a-a965-f4e6fd841cd5-kube-api-access-llrd5\") pod \"ceilometer-0\" (UID: \"a95d8c72-85c3-4c4a-a965-f4e6fd841cd5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:41:11 crc kubenswrapper[5120]: I0316 16:41:11.448098 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a95d8c72-85c3-4c4a-a965-f4e6fd841cd5-log-httpd\") pod \"ceilometer-0\" (UID: \"a95d8c72-85c3-4c4a-a965-f4e6fd841cd5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:41:11 crc kubenswrapper[5120]: I0316 16:41:11.448315 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a95d8c72-85c3-4c4a-a965-f4e6fd841cd5-scripts\") pod \"ceilometer-0\" (UID: \"a95d8c72-85c3-4c4a-a965-f4e6fd841cd5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:41:11 crc kubenswrapper[5120]: I0316 16:41:11.448348 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a95d8c72-85c3-4c4a-a965-f4e6fd841cd5-run-httpd\") pod \"ceilometer-0\" (UID: \"a95d8c72-85c3-4c4a-a965-f4e6fd841cd5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:41:11 crc kubenswrapper[5120]: I0316 16:41:11.448364 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a95d8c72-85c3-4c4a-a965-f4e6fd841cd5-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"a95d8c72-85c3-4c4a-a965-f4e6fd841cd5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:41:11 crc kubenswrapper[5120]: I0316 16:41:11.498822 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:41:11 crc kubenswrapper[5120]: I0316 16:41:11.499205 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:41:11 crc kubenswrapper[5120]: I0316 16:41:11.535719 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:41:11 crc kubenswrapper[5120]: I0316 16:41:11.549848 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a95d8c72-85c3-4c4a-a965-f4e6fd841cd5-config-data\") pod \"ceilometer-0\" (UID: \"a95d8c72-85c3-4c4a-a965-f4e6fd841cd5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:41:11 crc kubenswrapper[5120]: I0316 16:41:11.549899 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-llrd5\" (UniqueName: \"kubernetes.io/projected/a95d8c72-85c3-4c4a-a965-f4e6fd841cd5-kube-api-access-llrd5\") pod \"ceilometer-0\" (UID: \"a95d8c72-85c3-4c4a-a965-f4e6fd841cd5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:41:11 crc kubenswrapper[5120]: I0316 16:41:11.549936 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a95d8c72-85c3-4c4a-a965-f4e6fd841cd5-log-httpd\") pod \"ceilometer-0\" (UID: \"a95d8c72-85c3-4c4a-a965-f4e6fd841cd5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:41:11 crc kubenswrapper[5120]: I0316 16:41:11.550023 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a95d8c72-85c3-4c4a-a965-f4e6fd841cd5-scripts\") pod \"ceilometer-0\" (UID: \"a95d8c72-85c3-4c4a-a965-f4e6fd841cd5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:41:11 crc kubenswrapper[5120]: I0316 16:41:11.550042 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a95d8c72-85c3-4c4a-a965-f4e6fd841cd5-run-httpd\") pod \"ceilometer-0\" (UID: \"a95d8c72-85c3-4c4a-a965-f4e6fd841cd5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:41:11 crc kubenswrapper[5120]: I0316 16:41:11.550057 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a95d8c72-85c3-4c4a-a965-f4e6fd841cd5-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"a95d8c72-85c3-4c4a-a965-f4e6fd841cd5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:41:11 crc kubenswrapper[5120]: I0316 16:41:11.550123 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/a95d8c72-85c3-4c4a-a965-f4e6fd841cd5-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"a95d8c72-85c3-4c4a-a965-f4e6fd841cd5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:41:11 crc kubenswrapper[5120]: I0316 16:41:11.550284 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/a95d8c72-85c3-4c4a-a965-f4e6fd841cd5-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"a95d8c72-85c3-4c4a-a965-f4e6fd841cd5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:41:11 crc kubenswrapper[5120]: I0316 16:41:11.550849 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a95d8c72-85c3-4c4a-a965-f4e6fd841cd5-run-httpd\") pod \"ceilometer-0\" (UID: \"a95d8c72-85c3-4c4a-a965-f4e6fd841cd5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:41:11 crc kubenswrapper[5120]: I0316 16:41:11.550921 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a95d8c72-85c3-4c4a-a965-f4e6fd841cd5-log-httpd\") pod \"ceilometer-0\" (UID: \"a95d8c72-85c3-4c4a-a965-f4e6fd841cd5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:41:11 crc kubenswrapper[5120]: I0316 16:41:11.555267 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:41:11 crc kubenswrapper[5120]: I0316 16:41:11.572258 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a95d8c72-85c3-4c4a-a965-f4e6fd841cd5-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"a95d8c72-85c3-4c4a-a965-f4e6fd841cd5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:41:11 crc kubenswrapper[5120]: I0316 16:41:11.573934 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a95d8c72-85c3-4c4a-a965-f4e6fd841cd5-config-data\") pod \"ceilometer-0\" (UID: \"a95d8c72-85c3-4c4a-a965-f4e6fd841cd5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:41:11 crc kubenswrapper[5120]: I0316 16:41:11.575185 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a95d8c72-85c3-4c4a-a965-f4e6fd841cd5-scripts\") pod \"ceilometer-0\" (UID: \"a95d8c72-85c3-4c4a-a965-f4e6fd841cd5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:41:11 crc kubenswrapper[5120]: I0316 16:41:11.575207 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/a95d8c72-85c3-4c4a-a965-f4e6fd841cd5-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"a95d8c72-85c3-4c4a-a965-f4e6fd841cd5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:41:11 crc kubenswrapper[5120]: I0316 16:41:11.575692 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/a95d8c72-85c3-4c4a-a965-f4e6fd841cd5-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"a95d8c72-85c3-4c4a-a965-f4e6fd841cd5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:41:11 crc kubenswrapper[5120]: I0316 16:41:11.579921 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-llrd5\" (UniqueName: \"kubernetes.io/projected/a95d8c72-85c3-4c4a-a965-f4e6fd841cd5-kube-api-access-llrd5\") pod \"ceilometer-0\" (UID: \"a95d8c72-85c3-4c4a-a965-f4e6fd841cd5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:41:11 crc kubenswrapper[5120]: I0316 16:41:11.670947 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:41:12 crc kubenswrapper[5120]: I0316 16:41:12.113999 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:41:12 crc kubenswrapper[5120]: I0316 16:41:12.282504 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a95d8c72-85c3-4c4a-a965-f4e6fd841cd5","Type":"ContainerStarted","Data":"75e1e05a0985252af7a5beada5c1084f9b3a177fbd770ae9be696cc64bcdee0d"} Mar 16 16:41:12 crc kubenswrapper[5120]: I0316 16:41:12.285037 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:41:12 crc kubenswrapper[5120]: I0316 16:41:12.285286 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:41:12 crc kubenswrapper[5120]: I0316 16:41:12.632345 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:41:12 crc kubenswrapper[5120]: I0316 16:41:12.677312 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="514e99fe-d081-465e-9afb-fc169395f13b" path="/var/lib/kubelet/pods/514e99fe-d081-465e-9afb-fc169395f13b/volumes" Mar 16 16:41:13 crc kubenswrapper[5120]: I0316 16:41:13.321187 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a95d8c72-85c3-4c4a-a965-f4e6fd841cd5","Type":"ContainerStarted","Data":"9e1ff79180c97a23a6b5f24fd614151f8ef812d0b2957675d76e8ed8f7506cbc"} Mar 16 16:41:13 crc kubenswrapper[5120]: I0316 16:41:13.505930 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:41:13 crc kubenswrapper[5120]: I0316 16:41:13.506215 5120 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Mar 16 16:41:13 crc kubenswrapper[5120]: I0316 16:41:13.559176 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:41:14 crc kubenswrapper[5120]: I0316 16:41:14.332040 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a95d8c72-85c3-4c4a-a965-f4e6fd841cd5","Type":"ContainerStarted","Data":"d0afd69bcb36066d95f9651f8f688ea1a57b5e911f84f357e39030116c95863c"} Mar 16 16:41:14 crc kubenswrapper[5120]: I0316 16:41:14.332406 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a95d8c72-85c3-4c4a-a965-f4e6fd841cd5","Type":"ContainerStarted","Data":"7f920cb75298cc2b7167665f15c6ad223e697cfd6419efafabc7e8816e9b15d3"} Mar 16 16:41:14 crc kubenswrapper[5120]: I0316 16:41:14.339721 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:41:14 crc kubenswrapper[5120]: I0316 16:41:14.339960 5120 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Mar 16 16:41:14 crc kubenswrapper[5120]: I0316 16:41:14.427851 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:41:16 crc kubenswrapper[5120]: I0316 16:41:16.354438 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a95d8c72-85c3-4c4a-a965-f4e6fd841cd5","Type":"ContainerStarted","Data":"b5334349a58ba4f50717e5f132b50375086194010cf0e1722830f63c31c7c109"} Mar 16 16:41:16 crc kubenswrapper[5120]: I0316 16:41:16.354540 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="a95d8c72-85c3-4c4a-a965-f4e6fd841cd5" containerName="ceilometer-central-agent" containerID="cri-o://9e1ff79180c97a23a6b5f24fd614151f8ef812d0b2957675d76e8ed8f7506cbc" gracePeriod=30 Mar 16 16:41:16 crc kubenswrapper[5120]: I0316 16:41:16.354572 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="a95d8c72-85c3-4c4a-a965-f4e6fd841cd5" containerName="sg-core" containerID="cri-o://d0afd69bcb36066d95f9651f8f688ea1a57b5e911f84f357e39030116c95863c" gracePeriod=30 Mar 16 16:41:16 crc kubenswrapper[5120]: I0316 16:41:16.354601 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="a95d8c72-85c3-4c4a-a965-f4e6fd841cd5" containerName="ceilometer-notification-agent" containerID="cri-o://7f920cb75298cc2b7167665f15c6ad223e697cfd6419efafabc7e8816e9b15d3" gracePeriod=30 Mar 16 16:41:16 crc kubenswrapper[5120]: I0316 16:41:16.354598 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="a95d8c72-85c3-4c4a-a965-f4e6fd841cd5" containerName="proxy-httpd" containerID="cri-o://b5334349a58ba4f50717e5f132b50375086194010cf0e1722830f63c31c7c109" gracePeriod=30 Mar 16 16:41:16 crc kubenswrapper[5120]: I0316 16:41:16.355577 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:41:16 crc kubenswrapper[5120]: I0316 16:41:16.401656 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=1.434457211 podStartE2EDuration="5.401632383s" podCreationTimestamp="2026-03-16 16:41:11 +0000 UTC" firstStartedPulling="2026-03-16 16:41:12.130015269 +0000 UTC m=+4174.283946926" lastFinishedPulling="2026-03-16 16:41:16.097190441 +0000 UTC m=+4178.251122098" observedRunningTime="2026-03-16 16:41:16.394827738 +0000 UTC m=+4178.548759425" watchObservedRunningTime="2026-03-16 16:41:16.401632383 +0000 UTC m=+4178.555564040" Mar 16 16:41:17 crc kubenswrapper[5120]: I0316 16:41:17.366799 5120 generic.go:358] "Generic (PLEG): container finished" podID="a95d8c72-85c3-4c4a-a965-f4e6fd841cd5" containerID="d0afd69bcb36066d95f9651f8f688ea1a57b5e911f84f357e39030116c95863c" exitCode=2 Mar 16 16:41:17 crc kubenswrapper[5120]: I0316 16:41:17.366839 5120 generic.go:358] "Generic (PLEG): container finished" podID="a95d8c72-85c3-4c4a-a965-f4e6fd841cd5" containerID="7f920cb75298cc2b7167665f15c6ad223e697cfd6419efafabc7e8816e9b15d3" exitCode=0 Mar 16 16:41:17 crc kubenswrapper[5120]: I0316 16:41:17.366877 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a95d8c72-85c3-4c4a-a965-f4e6fd841cd5","Type":"ContainerDied","Data":"d0afd69bcb36066d95f9651f8f688ea1a57b5e911f84f357e39030116c95863c"} Mar 16 16:41:17 crc kubenswrapper[5120]: I0316 16:41:17.366921 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a95d8c72-85c3-4c4a-a965-f4e6fd841cd5","Type":"ContainerDied","Data":"7f920cb75298cc2b7167665f15c6ad223e697cfd6419efafabc7e8816e9b15d3"} Mar 16 16:41:21 crc kubenswrapper[5120]: I0316 16:41:21.405231 5120 generic.go:358] "Generic (PLEG): container finished" podID="52537c6c-c75e-4d04-8cb0-40e7ed0e33d9" containerID="fbb614ab9d99809725c904658acafddfbc9f74f0dc462732da0498f6f5eba626" exitCode=0 Mar 16 16:41:21 crc kubenswrapper[5120]: I0316 16:41:21.405388 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-2dbbn" event={"ID":"52537c6c-c75e-4d04-8cb0-40e7ed0e33d9","Type":"ContainerDied","Data":"fbb614ab9d99809725c904658acafddfbc9f74f0dc462732da0498f6f5eba626"} Mar 16 16:41:22 crc kubenswrapper[5120]: I0316 16:41:22.424075 5120 generic.go:358] "Generic (PLEG): container finished" podID="a95d8c72-85c3-4c4a-a965-f4e6fd841cd5" containerID="9e1ff79180c97a23a6b5f24fd614151f8ef812d0b2957675d76e8ed8f7506cbc" exitCode=0 Mar 16 16:41:22 crc kubenswrapper[5120]: I0316 16:41:22.424451 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a95d8c72-85c3-4c4a-a965-f4e6fd841cd5","Type":"ContainerDied","Data":"9e1ff79180c97a23a6b5f24fd614151f8ef812d0b2957675d76e8ed8f7506cbc"} Mar 16 16:41:22 crc kubenswrapper[5120]: I0316 16:41:22.777704 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-2dbbn" Mar 16 16:41:22 crc kubenswrapper[5120]: I0316 16:41:22.850064 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fd2js\" (UniqueName: \"kubernetes.io/projected/52537c6c-c75e-4d04-8cb0-40e7ed0e33d9-kube-api-access-fd2js\") pod \"52537c6c-c75e-4d04-8cb0-40e7ed0e33d9\" (UID: \"52537c6c-c75e-4d04-8cb0-40e7ed0e33d9\") " Mar 16 16:41:22 crc kubenswrapper[5120]: I0316 16:41:22.850250 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/52537c6c-c75e-4d04-8cb0-40e7ed0e33d9-combined-ca-bundle\") pod \"52537c6c-c75e-4d04-8cb0-40e7ed0e33d9\" (UID: \"52537c6c-c75e-4d04-8cb0-40e7ed0e33d9\") " Mar 16 16:41:22 crc kubenswrapper[5120]: I0316 16:41:22.850553 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/52537c6c-c75e-4d04-8cb0-40e7ed0e33d9-scripts\") pod \"52537c6c-c75e-4d04-8cb0-40e7ed0e33d9\" (UID: \"52537c6c-c75e-4d04-8cb0-40e7ed0e33d9\") " Mar 16 16:41:22 crc kubenswrapper[5120]: I0316 16:41:22.850718 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/52537c6c-c75e-4d04-8cb0-40e7ed0e33d9-config-data\") pod \"52537c6c-c75e-4d04-8cb0-40e7ed0e33d9\" (UID: \"52537c6c-c75e-4d04-8cb0-40e7ed0e33d9\") " Mar 16 16:41:22 crc kubenswrapper[5120]: I0316 16:41:22.856532 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/52537c6c-c75e-4d04-8cb0-40e7ed0e33d9-kube-api-access-fd2js" (OuterVolumeSpecName: "kube-api-access-fd2js") pod "52537c6c-c75e-4d04-8cb0-40e7ed0e33d9" (UID: "52537c6c-c75e-4d04-8cb0-40e7ed0e33d9"). InnerVolumeSpecName "kube-api-access-fd2js". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:41:22 crc kubenswrapper[5120]: I0316 16:41:22.857346 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/52537c6c-c75e-4d04-8cb0-40e7ed0e33d9-scripts" (OuterVolumeSpecName: "scripts") pod "52537c6c-c75e-4d04-8cb0-40e7ed0e33d9" (UID: "52537c6c-c75e-4d04-8cb0-40e7ed0e33d9"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:41:22 crc kubenswrapper[5120]: E0316 16:41:22.874148 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52537c6c-c75e-4d04-8cb0-40e7ed0e33d9-combined-ca-bundle podName:52537c6c-c75e-4d04-8cb0-40e7ed0e33d9 nodeName:}" failed. No retries permitted until 2026-03-16 16:41:23.37411731 +0000 UTC m=+4185.528048967 (durationBeforeRetry 500ms). Error: error cleaning subPath mounts for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/52537c6c-c75e-4d04-8cb0-40e7ed0e33d9-combined-ca-bundle") pod "52537c6c-c75e-4d04-8cb0-40e7ed0e33d9" (UID: "52537c6c-c75e-4d04-8cb0-40e7ed0e33d9") : error deleting /var/lib/kubelet/pods/52537c6c-c75e-4d04-8cb0-40e7ed0e33d9/volume-subpaths: remove /var/lib/kubelet/pods/52537c6c-c75e-4d04-8cb0-40e7ed0e33d9/volume-subpaths: no such file or directory Mar 16 16:41:22 crc kubenswrapper[5120]: I0316 16:41:22.876994 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/52537c6c-c75e-4d04-8cb0-40e7ed0e33d9-config-data" (OuterVolumeSpecName: "config-data") pod "52537c6c-c75e-4d04-8cb0-40e7ed0e33d9" (UID: "52537c6c-c75e-4d04-8cb0-40e7ed0e33d9"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:41:22 crc kubenswrapper[5120]: I0316 16:41:22.954387 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/52537c6c-c75e-4d04-8cb0-40e7ed0e33d9-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:41:22 crc kubenswrapper[5120]: I0316 16:41:22.954609 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/52537c6c-c75e-4d04-8cb0-40e7ed0e33d9-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:41:22 crc kubenswrapper[5120]: I0316 16:41:22.954684 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fd2js\" (UniqueName: \"kubernetes.io/projected/52537c6c-c75e-4d04-8cb0-40e7ed0e33d9-kube-api-access-fd2js\") on node \"crc\" DevicePath \"\"" Mar 16 16:41:23 crc kubenswrapper[5120]: I0316 16:41:23.442123 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-2dbbn" Mar 16 16:41:23 crc kubenswrapper[5120]: I0316 16:41:23.444406 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-2dbbn" event={"ID":"52537c6c-c75e-4d04-8cb0-40e7ed0e33d9","Type":"ContainerDied","Data":"2903bb8ad1f1642ae448afcc86dc99ba8f14665674502a3193063dea58aa20e8"} Mar 16 16:41:23 crc kubenswrapper[5120]: I0316 16:41:23.444456 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2903bb8ad1f1642ae448afcc86dc99ba8f14665674502a3193063dea58aa20e8" Mar 16 16:41:23 crc kubenswrapper[5120]: I0316 16:41:23.465453 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/52537c6c-c75e-4d04-8cb0-40e7ed0e33d9-combined-ca-bundle\") pod \"52537c6c-c75e-4d04-8cb0-40e7ed0e33d9\" (UID: \"52537c6c-c75e-4d04-8cb0-40e7ed0e33d9\") " Mar 16 16:41:23 crc kubenswrapper[5120]: I0316 16:41:23.485676 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/52537c6c-c75e-4d04-8cb0-40e7ed0e33d9-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "52537c6c-c75e-4d04-8cb0-40e7ed0e33d9" (UID: "52537c6c-c75e-4d04-8cb0-40e7ed0e33d9"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:41:23 crc kubenswrapper[5120]: I0316 16:41:23.495707 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:41:23 crc kubenswrapper[5120]: I0316 16:41:23.496873 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52537c6c-c75e-4d04-8cb0-40e7ed0e33d9" containerName="nova-cell0-conductor-db-sync" Mar 16 16:41:23 crc kubenswrapper[5120]: I0316 16:41:23.496898 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="52537c6c-c75e-4d04-8cb0-40e7ed0e33d9" containerName="nova-cell0-conductor-db-sync" Mar 16 16:41:23 crc kubenswrapper[5120]: I0316 16:41:23.497170 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="52537c6c-c75e-4d04-8cb0-40e7ed0e33d9" containerName="nova-cell0-conductor-db-sync" Mar 16 16:41:23 crc kubenswrapper[5120]: I0316 16:41:23.509593 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:41:23 crc kubenswrapper[5120]: I0316 16:41:23.509744 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:41:23 crc kubenswrapper[5120]: I0316 16:41:23.568665 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75z22\" (UniqueName: \"kubernetes.io/projected/636be6fd-cf1a-4f31-aa2b-6be52788333d-kube-api-access-75z22\") pod \"nova-cell0-conductor-0\" (UID: \"636be6fd-cf1a-4f31-aa2b-6be52788333d\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:41:23 crc kubenswrapper[5120]: I0316 16:41:23.568848 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/636be6fd-cf1a-4f31-aa2b-6be52788333d-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"636be6fd-cf1a-4f31-aa2b-6be52788333d\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:41:23 crc kubenswrapper[5120]: I0316 16:41:23.568988 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/636be6fd-cf1a-4f31-aa2b-6be52788333d-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"636be6fd-cf1a-4f31-aa2b-6be52788333d\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:41:23 crc kubenswrapper[5120]: I0316 16:41:23.569228 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/52537c6c-c75e-4d04-8cb0-40e7ed0e33d9-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:41:23 crc kubenswrapper[5120]: I0316 16:41:23.671151 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/636be6fd-cf1a-4f31-aa2b-6be52788333d-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"636be6fd-cf1a-4f31-aa2b-6be52788333d\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:41:23 crc kubenswrapper[5120]: I0316 16:41:23.671416 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-75z22\" (UniqueName: \"kubernetes.io/projected/636be6fd-cf1a-4f31-aa2b-6be52788333d-kube-api-access-75z22\") pod \"nova-cell0-conductor-0\" (UID: \"636be6fd-cf1a-4f31-aa2b-6be52788333d\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:41:23 crc kubenswrapper[5120]: I0316 16:41:23.671548 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/636be6fd-cf1a-4f31-aa2b-6be52788333d-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"636be6fd-cf1a-4f31-aa2b-6be52788333d\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:41:23 crc kubenswrapper[5120]: I0316 16:41:23.675540 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/636be6fd-cf1a-4f31-aa2b-6be52788333d-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"636be6fd-cf1a-4f31-aa2b-6be52788333d\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:41:23 crc kubenswrapper[5120]: I0316 16:41:23.675559 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/636be6fd-cf1a-4f31-aa2b-6be52788333d-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"636be6fd-cf1a-4f31-aa2b-6be52788333d\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:41:23 crc kubenswrapper[5120]: I0316 16:41:23.687099 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-75z22\" (UniqueName: \"kubernetes.io/projected/636be6fd-cf1a-4f31-aa2b-6be52788333d-kube-api-access-75z22\") pod \"nova-cell0-conductor-0\" (UID: \"636be6fd-cf1a-4f31-aa2b-6be52788333d\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:41:23 crc kubenswrapper[5120]: I0316 16:41:23.847100 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:41:24 crc kubenswrapper[5120]: I0316 16:41:24.319021 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:41:24 crc kubenswrapper[5120]: W0316 16:41:24.319123 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod636be6fd_cf1a_4f31_aa2b_6be52788333d.slice/crio-69d36e33f5e24b64a1b99d42ba55b277a2bce27087314fd837822f0448579590 WatchSource:0}: Error finding container 69d36e33f5e24b64a1b99d42ba55b277a2bce27087314fd837822f0448579590: Status 404 returned error can't find the container with id 69d36e33f5e24b64a1b99d42ba55b277a2bce27087314fd837822f0448579590 Mar 16 16:41:24 crc kubenswrapper[5120]: I0316 16:41:24.454306 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"636be6fd-cf1a-4f31-aa2b-6be52788333d","Type":"ContainerStarted","Data":"69d36e33f5e24b64a1b99d42ba55b277a2bce27087314fd837822f0448579590"} Mar 16 16:41:25 crc kubenswrapper[5120]: I0316 16:41:25.468160 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"636be6fd-cf1a-4f31-aa2b-6be52788333d","Type":"ContainerStarted","Data":"10a7e33721d5da23369bc4422d4cbb9b2fa2d5c64f2fff4f94c6d681301c74ff"} Mar 16 16:41:25 crc kubenswrapper[5120]: I0316 16:41:25.468598 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:41:25 crc kubenswrapper[5120]: I0316 16:41:25.499569 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podStartSLOduration=2.499546905 podStartE2EDuration="2.499546905s" podCreationTimestamp="2026-03-16 16:41:23 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:41:25.491401144 +0000 UTC m=+4187.645332801" watchObservedRunningTime="2026-03-16 16:41:25.499546905 +0000 UTC m=+4187.653478592" Mar 16 16:41:31 crc kubenswrapper[5120]: I0316 16:41:31.509777 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:41:31 crc kubenswrapper[5120]: I0316 16:41:31.955933 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-tfss2"] Mar 16 16:41:31 crc kubenswrapper[5120]: I0316 16:41:31.962486 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-tfss2" Mar 16 16:41:31 crc kubenswrapper[5120]: I0316 16:41:31.964924 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-manage-scripts\"" Mar 16 16:41:31 crc kubenswrapper[5120]: I0316 16:41:31.964600 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-manage-config-data\"" Mar 16 16:41:31 crc kubenswrapper[5120]: I0316 16:41:31.972864 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-tfss2"] Mar 16 16:41:32 crc kubenswrapper[5120]: I0316 16:41:32.086371 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f57fccaf-9698-44a5-8d74-f65beb76b3d5-config-data\") pod \"nova-cell0-cell-mapping-tfss2\" (UID: \"f57fccaf-9698-44a5-8d74-f65beb76b3d5\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-tfss2" Mar 16 16:41:32 crc kubenswrapper[5120]: I0316 16:41:32.086804 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f57fccaf-9698-44a5-8d74-f65beb76b3d5-scripts\") pod \"nova-cell0-cell-mapping-tfss2\" (UID: \"f57fccaf-9698-44a5-8d74-f65beb76b3d5\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-tfss2" Mar 16 16:41:32 crc kubenswrapper[5120]: I0316 16:41:32.086939 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhvph\" (UniqueName: \"kubernetes.io/projected/f57fccaf-9698-44a5-8d74-f65beb76b3d5-kube-api-access-rhvph\") pod \"nova-cell0-cell-mapping-tfss2\" (UID: \"f57fccaf-9698-44a5-8d74-f65beb76b3d5\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-tfss2" Mar 16 16:41:32 crc kubenswrapper[5120]: I0316 16:41:32.087275 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f57fccaf-9698-44a5-8d74-f65beb76b3d5-combined-ca-bundle\") pod \"nova-cell0-cell-mapping-tfss2\" (UID: \"f57fccaf-9698-44a5-8d74-f65beb76b3d5\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-tfss2" Mar 16 16:41:32 crc kubenswrapper[5120]: I0316 16:41:32.090157 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:41:32 crc kubenswrapper[5120]: I0316 16:41:32.102170 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:41:32 crc kubenswrapper[5120]: I0316 16:41:32.105636 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-config-data\"" Mar 16 16:41:32 crc kubenswrapper[5120]: I0316 16:41:32.110863 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:41:32 crc kubenswrapper[5120]: I0316 16:41:32.182477 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:41:32 crc kubenswrapper[5120]: I0316 16:41:32.189100 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f57fccaf-9698-44a5-8d74-f65beb76b3d5-combined-ca-bundle\") pod \"nova-cell0-cell-mapping-tfss2\" (UID: \"f57fccaf-9698-44a5-8d74-f65beb76b3d5\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-tfss2" Mar 16 16:41:32 crc kubenswrapper[5120]: I0316 16:41:32.189218 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f57fccaf-9698-44a5-8d74-f65beb76b3d5-config-data\") pod \"nova-cell0-cell-mapping-tfss2\" (UID: \"f57fccaf-9698-44a5-8d74-f65beb76b3d5\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-tfss2" Mar 16 16:41:32 crc kubenswrapper[5120]: I0316 16:41:32.189247 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-764dv\" (UniqueName: \"kubernetes.io/projected/f69f1ee9-e36c-4f59-a486-7d31a34c31a0-kube-api-access-764dv\") pod \"nova-api-0\" (UID: \"f69f1ee9-e36c-4f59-a486-7d31a34c31a0\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:41:32 crc kubenswrapper[5120]: I0316 16:41:32.189316 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f69f1ee9-e36c-4f59-a486-7d31a34c31a0-config-data\") pod \"nova-api-0\" (UID: \"f69f1ee9-e36c-4f59-a486-7d31a34c31a0\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:41:32 crc kubenswrapper[5120]: I0316 16:41:32.189342 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f57fccaf-9698-44a5-8d74-f65beb76b3d5-scripts\") pod \"nova-cell0-cell-mapping-tfss2\" (UID: \"f57fccaf-9698-44a5-8d74-f65beb76b3d5\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-tfss2" Mar 16 16:41:32 crc kubenswrapper[5120]: I0316 16:41:32.189379 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f69f1ee9-e36c-4f59-a486-7d31a34c31a0-logs\") pod \"nova-api-0\" (UID: \"f69f1ee9-e36c-4f59-a486-7d31a34c31a0\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:41:32 crc kubenswrapper[5120]: I0316 16:41:32.189447 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f69f1ee9-e36c-4f59-a486-7d31a34c31a0-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"f69f1ee9-e36c-4f59-a486-7d31a34c31a0\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:41:32 crc kubenswrapper[5120]: I0316 16:41:32.189505 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rhvph\" (UniqueName: \"kubernetes.io/projected/f57fccaf-9698-44a5-8d74-f65beb76b3d5-kube-api-access-rhvph\") pod \"nova-cell0-cell-mapping-tfss2\" (UID: \"f57fccaf-9698-44a5-8d74-f65beb76b3d5\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-tfss2" Mar 16 16:41:32 crc kubenswrapper[5120]: I0316 16:41:32.192435 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:41:32 crc kubenswrapper[5120]: I0316 16:41:32.198163 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-scheduler-config-data\"" Mar 16 16:41:32 crc kubenswrapper[5120]: I0316 16:41:32.199429 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f57fccaf-9698-44a5-8d74-f65beb76b3d5-combined-ca-bundle\") pod \"nova-cell0-cell-mapping-tfss2\" (UID: \"f57fccaf-9698-44a5-8d74-f65beb76b3d5\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-tfss2" Mar 16 16:41:32 crc kubenswrapper[5120]: I0316 16:41:32.213692 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f57fccaf-9698-44a5-8d74-f65beb76b3d5-scripts\") pod \"nova-cell0-cell-mapping-tfss2\" (UID: \"f57fccaf-9698-44a5-8d74-f65beb76b3d5\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-tfss2" Mar 16 16:41:32 crc kubenswrapper[5120]: I0316 16:41:32.215345 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f57fccaf-9698-44a5-8d74-f65beb76b3d5-config-data\") pod \"nova-cell0-cell-mapping-tfss2\" (UID: \"f57fccaf-9698-44a5-8d74-f65beb76b3d5\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-tfss2" Mar 16 16:41:32 crc kubenswrapper[5120]: I0316 16:41:32.231444 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhvph\" (UniqueName: \"kubernetes.io/projected/f57fccaf-9698-44a5-8d74-f65beb76b3d5-kube-api-access-rhvph\") pod \"nova-cell0-cell-mapping-tfss2\" (UID: \"f57fccaf-9698-44a5-8d74-f65beb76b3d5\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-tfss2" Mar 16 16:41:32 crc kubenswrapper[5120]: I0316 16:41:32.237353 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:41:32 crc kubenswrapper[5120]: I0316 16:41:32.254557 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:41:32 crc kubenswrapper[5120]: I0316 16:41:32.259611 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-metadata-config-data\"" Mar 16 16:41:32 crc kubenswrapper[5120]: I0316 16:41:32.270816 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:41:32 crc kubenswrapper[5120]: I0316 16:41:32.293297 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-764dv\" (UniqueName: \"kubernetes.io/projected/f69f1ee9-e36c-4f59-a486-7d31a34c31a0-kube-api-access-764dv\") pod \"nova-api-0\" (UID: \"f69f1ee9-e36c-4f59-a486-7d31a34c31a0\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:41:32 crc kubenswrapper[5120]: I0316 16:41:32.293351 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/15f1d0a1-892a-4460-914e-54cbd7a1b281-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"15f1d0a1-892a-4460-914e-54cbd7a1b281\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:41:32 crc kubenswrapper[5120]: I0316 16:41:32.293394 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/15f1d0a1-892a-4460-914e-54cbd7a1b281-config-data\") pod \"nova-scheduler-0\" (UID: \"15f1d0a1-892a-4460-914e-54cbd7a1b281\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:41:32 crc kubenswrapper[5120]: I0316 16:41:32.293461 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f69f1ee9-e36c-4f59-a486-7d31a34c31a0-config-data\") pod \"nova-api-0\" (UID: \"f69f1ee9-e36c-4f59-a486-7d31a34c31a0\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:41:32 crc kubenswrapper[5120]: I0316 16:41:32.293497 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2nrtr\" (UniqueName: \"kubernetes.io/projected/15f1d0a1-892a-4460-914e-54cbd7a1b281-kube-api-access-2nrtr\") pod \"nova-scheduler-0\" (UID: \"15f1d0a1-892a-4460-914e-54cbd7a1b281\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:41:32 crc kubenswrapper[5120]: I0316 16:41:32.293522 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f69f1ee9-e36c-4f59-a486-7d31a34c31a0-logs\") pod \"nova-api-0\" (UID: \"f69f1ee9-e36c-4f59-a486-7d31a34c31a0\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:41:32 crc kubenswrapper[5120]: I0316 16:41:32.293595 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f69f1ee9-e36c-4f59-a486-7d31a34c31a0-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"f69f1ee9-e36c-4f59-a486-7d31a34c31a0\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:41:32 crc kubenswrapper[5120]: I0316 16:41:32.297658 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f69f1ee9-e36c-4f59-a486-7d31a34c31a0-logs\") pod \"nova-api-0\" (UID: \"f69f1ee9-e36c-4f59-a486-7d31a34c31a0\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:41:32 crc kubenswrapper[5120]: I0316 16:41:32.304580 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-tfss2" Mar 16 16:41:32 crc kubenswrapper[5120]: I0316 16:41:32.306417 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f69f1ee9-e36c-4f59-a486-7d31a34c31a0-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"f69f1ee9-e36c-4f59-a486-7d31a34c31a0\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:41:32 crc kubenswrapper[5120]: I0316 16:41:32.306863 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f69f1ee9-e36c-4f59-a486-7d31a34c31a0-config-data\") pod \"nova-api-0\" (UID: \"f69f1ee9-e36c-4f59-a486-7d31a34c31a0\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:41:32 crc kubenswrapper[5120]: I0316 16:41:32.321276 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:41:32 crc kubenswrapper[5120]: I0316 16:41:32.323341 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-764dv\" (UniqueName: \"kubernetes.io/projected/f69f1ee9-e36c-4f59-a486-7d31a34c31a0-kube-api-access-764dv\") pod \"nova-api-0\" (UID: \"f69f1ee9-e36c-4f59-a486-7d31a34c31a0\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:41:32 crc kubenswrapper[5120]: I0316 16:41:32.366810 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:41:32 crc kubenswrapper[5120]: I0316 16:41:32.372986 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:41:32 crc kubenswrapper[5120]: I0316 16:41:32.380147 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-novncproxy-config-data\"" Mar 16 16:41:32 crc kubenswrapper[5120]: I0316 16:41:32.383659 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:41:32 crc kubenswrapper[5120]: I0316 16:41:32.397680 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-db8kb\" (UniqueName: \"kubernetes.io/projected/026cd6ec-c60a-49b4-873f-3a6bb169e666-kube-api-access-db8kb\") pod \"nova-metadata-0\" (UID: \"026cd6ec-c60a-49b4-873f-3a6bb169e666\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:41:32 crc kubenswrapper[5120]: I0316 16:41:32.397821 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/15f1d0a1-892a-4460-914e-54cbd7a1b281-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"15f1d0a1-892a-4460-914e-54cbd7a1b281\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:41:32 crc kubenswrapper[5120]: I0316 16:41:32.397852 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/15f1d0a1-892a-4460-914e-54cbd7a1b281-config-data\") pod \"nova-scheduler-0\" (UID: \"15f1d0a1-892a-4460-914e-54cbd7a1b281\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:41:32 crc kubenswrapper[5120]: I0316 16:41:32.397941 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2nrtr\" (UniqueName: \"kubernetes.io/projected/15f1d0a1-892a-4460-914e-54cbd7a1b281-kube-api-access-2nrtr\") pod \"nova-scheduler-0\" (UID: \"15f1d0a1-892a-4460-914e-54cbd7a1b281\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:41:32 crc kubenswrapper[5120]: I0316 16:41:32.397977 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/026cd6ec-c60a-49b4-873f-3a6bb169e666-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"026cd6ec-c60a-49b4-873f-3a6bb169e666\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:41:32 crc kubenswrapper[5120]: I0316 16:41:32.398082 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/026cd6ec-c60a-49b4-873f-3a6bb169e666-logs\") pod \"nova-metadata-0\" (UID: \"026cd6ec-c60a-49b4-873f-3a6bb169e666\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:41:32 crc kubenswrapper[5120]: I0316 16:41:32.398125 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/026cd6ec-c60a-49b4-873f-3a6bb169e666-config-data\") pod \"nova-metadata-0\" (UID: \"026cd6ec-c60a-49b4-873f-3a6bb169e666\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:41:32 crc kubenswrapper[5120]: I0316 16:41:32.405474 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/15f1d0a1-892a-4460-914e-54cbd7a1b281-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"15f1d0a1-892a-4460-914e-54cbd7a1b281\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:41:32 crc kubenswrapper[5120]: I0316 16:41:32.405526 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/15f1d0a1-892a-4460-914e-54cbd7a1b281-config-data\") pod \"nova-scheduler-0\" (UID: \"15f1d0a1-892a-4460-914e-54cbd7a1b281\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:41:32 crc kubenswrapper[5120]: I0316 16:41:32.418269 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2nrtr\" (UniqueName: \"kubernetes.io/projected/15f1d0a1-892a-4460-914e-54cbd7a1b281-kube-api-access-2nrtr\") pod \"nova-scheduler-0\" (UID: \"15f1d0a1-892a-4460-914e-54cbd7a1b281\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:41:32 crc kubenswrapper[5120]: I0316 16:41:32.419246 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:41:32 crc kubenswrapper[5120]: I0316 16:41:32.464640 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:41:32 crc kubenswrapper[5120]: I0316 16:41:32.499974 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zlt4l\" (UniqueName: \"kubernetes.io/projected/14d5433c-463c-4e0e-9fc6-841212b46bf4-kube-api-access-zlt4l\") pod \"nova-cell1-novncproxy-0\" (UID: \"14d5433c-463c-4e0e-9fc6-841212b46bf4\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:41:32 crc kubenswrapper[5120]: I0316 16:41:32.500080 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-db8kb\" (UniqueName: \"kubernetes.io/projected/026cd6ec-c60a-49b4-873f-3a6bb169e666-kube-api-access-db8kb\") pod \"nova-metadata-0\" (UID: \"026cd6ec-c60a-49b4-873f-3a6bb169e666\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:41:32 crc kubenswrapper[5120]: I0316 16:41:32.500176 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/14d5433c-463c-4e0e-9fc6-841212b46bf4-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"14d5433c-463c-4e0e-9fc6-841212b46bf4\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:41:32 crc kubenswrapper[5120]: I0316 16:41:32.500362 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/026cd6ec-c60a-49b4-873f-3a6bb169e666-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"026cd6ec-c60a-49b4-873f-3a6bb169e666\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:41:32 crc kubenswrapper[5120]: I0316 16:41:32.500417 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/14d5433c-463c-4e0e-9fc6-841212b46bf4-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"14d5433c-463c-4e0e-9fc6-841212b46bf4\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:41:32 crc kubenswrapper[5120]: I0316 16:41:32.500540 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/026cd6ec-c60a-49b4-873f-3a6bb169e666-logs\") pod \"nova-metadata-0\" (UID: \"026cd6ec-c60a-49b4-873f-3a6bb169e666\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:41:32 crc kubenswrapper[5120]: I0316 16:41:32.500594 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/026cd6ec-c60a-49b4-873f-3a6bb169e666-config-data\") pod \"nova-metadata-0\" (UID: \"026cd6ec-c60a-49b4-873f-3a6bb169e666\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:41:32 crc kubenswrapper[5120]: I0316 16:41:32.502161 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/026cd6ec-c60a-49b4-873f-3a6bb169e666-logs\") pod \"nova-metadata-0\" (UID: \"026cd6ec-c60a-49b4-873f-3a6bb169e666\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:41:32 crc kubenswrapper[5120]: I0316 16:41:32.506600 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/026cd6ec-c60a-49b4-873f-3a6bb169e666-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"026cd6ec-c60a-49b4-873f-3a6bb169e666\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:41:32 crc kubenswrapper[5120]: I0316 16:41:32.511471 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/026cd6ec-c60a-49b4-873f-3a6bb169e666-config-data\") pod \"nova-metadata-0\" (UID: \"026cd6ec-c60a-49b4-873f-3a6bb169e666\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:41:32 crc kubenswrapper[5120]: I0316 16:41:32.524838 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-db8kb\" (UniqueName: \"kubernetes.io/projected/026cd6ec-c60a-49b4-873f-3a6bb169e666-kube-api-access-db8kb\") pod \"nova-metadata-0\" (UID: \"026cd6ec-c60a-49b4-873f-3a6bb169e666\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:41:32 crc kubenswrapper[5120]: I0316 16:41:32.602414 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/14d5433c-463c-4e0e-9fc6-841212b46bf4-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"14d5433c-463c-4e0e-9fc6-841212b46bf4\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:41:32 crc kubenswrapper[5120]: I0316 16:41:32.602870 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zlt4l\" (UniqueName: \"kubernetes.io/projected/14d5433c-463c-4e0e-9fc6-841212b46bf4-kube-api-access-zlt4l\") pod \"nova-cell1-novncproxy-0\" (UID: \"14d5433c-463c-4e0e-9fc6-841212b46bf4\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:41:32 crc kubenswrapper[5120]: I0316 16:41:32.603133 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/14d5433c-463c-4e0e-9fc6-841212b46bf4-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"14d5433c-463c-4e0e-9fc6-841212b46bf4\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:41:32 crc kubenswrapper[5120]: I0316 16:41:32.606424 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/14d5433c-463c-4e0e-9fc6-841212b46bf4-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"14d5433c-463c-4e0e-9fc6-841212b46bf4\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:41:32 crc kubenswrapper[5120]: I0316 16:41:32.610999 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/14d5433c-463c-4e0e-9fc6-841212b46bf4-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"14d5433c-463c-4e0e-9fc6-841212b46bf4\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:41:32 crc kubenswrapper[5120]: I0316 16:41:32.620740 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zlt4l\" (UniqueName: \"kubernetes.io/projected/14d5433c-463c-4e0e-9fc6-841212b46bf4-kube-api-access-zlt4l\") pod \"nova-cell1-novncproxy-0\" (UID: \"14d5433c-463c-4e0e-9fc6-841212b46bf4\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:41:32 crc kubenswrapper[5120]: I0316 16:41:32.791986 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:41:32 crc kubenswrapper[5120]: I0316 16:41:32.819699 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:41:32 crc kubenswrapper[5120]: I0316 16:41:32.944353 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-tfss2"] Mar 16 16:41:33 crc kubenswrapper[5120]: I0316 16:41:33.067502 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:41:33 crc kubenswrapper[5120]: I0316 16:41:33.118685 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-dc4rn"] Mar 16 16:41:33 crc kubenswrapper[5120]: I0316 16:41:33.142700 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-dc4rn"] Mar 16 16:41:33 crc kubenswrapper[5120]: I0316 16:41:33.142866 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-dc4rn" Mar 16 16:41:33 crc kubenswrapper[5120]: I0316 16:41:33.147796 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:41:33 crc kubenswrapper[5120]: I0316 16:41:33.148527 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-conductor-config-data\"" Mar 16 16:41:33 crc kubenswrapper[5120]: I0316 16:41:33.148777 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-conductor-scripts\"" Mar 16 16:41:33 crc kubenswrapper[5120]: I0316 16:41:33.221266 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ad9c5c4c-36fb-402b-a4dd-b628ba4b002d-combined-ca-bundle\") pod \"nova-cell1-conductor-db-sync-dc4rn\" (UID: \"ad9c5c4c-36fb-402b-a4dd-b628ba4b002d\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-dc4rn" Mar 16 16:41:33 crc kubenswrapper[5120]: I0316 16:41:33.221499 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ad9c5c4c-36fb-402b-a4dd-b628ba4b002d-scripts\") pod \"nova-cell1-conductor-db-sync-dc4rn\" (UID: \"ad9c5c4c-36fb-402b-a4dd-b628ba4b002d\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-dc4rn" Mar 16 16:41:33 crc kubenswrapper[5120]: I0316 16:41:33.221653 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rws4g\" (UniqueName: \"kubernetes.io/projected/ad9c5c4c-36fb-402b-a4dd-b628ba4b002d-kube-api-access-rws4g\") pod \"nova-cell1-conductor-db-sync-dc4rn\" (UID: \"ad9c5c4c-36fb-402b-a4dd-b628ba4b002d\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-dc4rn" Mar 16 16:41:33 crc kubenswrapper[5120]: I0316 16:41:33.221817 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ad9c5c4c-36fb-402b-a4dd-b628ba4b002d-config-data\") pod \"nova-cell1-conductor-db-sync-dc4rn\" (UID: \"ad9c5c4c-36fb-402b-a4dd-b628ba4b002d\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-dc4rn" Mar 16 16:41:33 crc kubenswrapper[5120]: I0316 16:41:33.270363 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:41:33 crc kubenswrapper[5120]: W0316 16:41:33.272328 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod026cd6ec_c60a_49b4_873f_3a6bb169e666.slice/crio-3c0be7c712574167621d5807714790f3f7da055aaad486620917992637c6791d WatchSource:0}: Error finding container 3c0be7c712574167621d5807714790f3f7da055aaad486620917992637c6791d: Status 404 returned error can't find the container with id 3c0be7c712574167621d5807714790f3f7da055aaad486620917992637c6791d Mar 16 16:41:33 crc kubenswrapper[5120]: I0316 16:41:33.324673 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ad9c5c4c-36fb-402b-a4dd-b628ba4b002d-combined-ca-bundle\") pod \"nova-cell1-conductor-db-sync-dc4rn\" (UID: \"ad9c5c4c-36fb-402b-a4dd-b628ba4b002d\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-dc4rn" Mar 16 16:41:33 crc kubenswrapper[5120]: I0316 16:41:33.326030 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ad9c5c4c-36fb-402b-a4dd-b628ba4b002d-scripts\") pod \"nova-cell1-conductor-db-sync-dc4rn\" (UID: \"ad9c5c4c-36fb-402b-a4dd-b628ba4b002d\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-dc4rn" Mar 16 16:41:33 crc kubenswrapper[5120]: I0316 16:41:33.326269 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rws4g\" (UniqueName: \"kubernetes.io/projected/ad9c5c4c-36fb-402b-a4dd-b628ba4b002d-kube-api-access-rws4g\") pod \"nova-cell1-conductor-db-sync-dc4rn\" (UID: \"ad9c5c4c-36fb-402b-a4dd-b628ba4b002d\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-dc4rn" Mar 16 16:41:33 crc kubenswrapper[5120]: I0316 16:41:33.326439 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ad9c5c4c-36fb-402b-a4dd-b628ba4b002d-config-data\") pod \"nova-cell1-conductor-db-sync-dc4rn\" (UID: \"ad9c5c4c-36fb-402b-a4dd-b628ba4b002d\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-dc4rn" Mar 16 16:41:33 crc kubenswrapper[5120]: I0316 16:41:33.331574 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ad9c5c4c-36fb-402b-a4dd-b628ba4b002d-scripts\") pod \"nova-cell1-conductor-db-sync-dc4rn\" (UID: \"ad9c5c4c-36fb-402b-a4dd-b628ba4b002d\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-dc4rn" Mar 16 16:41:33 crc kubenswrapper[5120]: I0316 16:41:33.331831 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ad9c5c4c-36fb-402b-a4dd-b628ba4b002d-combined-ca-bundle\") pod \"nova-cell1-conductor-db-sync-dc4rn\" (UID: \"ad9c5c4c-36fb-402b-a4dd-b628ba4b002d\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-dc4rn" Mar 16 16:41:33 crc kubenswrapper[5120]: I0316 16:41:33.333014 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ad9c5c4c-36fb-402b-a4dd-b628ba4b002d-config-data\") pod \"nova-cell1-conductor-db-sync-dc4rn\" (UID: \"ad9c5c4c-36fb-402b-a4dd-b628ba4b002d\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-dc4rn" Mar 16 16:41:33 crc kubenswrapper[5120]: I0316 16:41:33.351451 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rws4g\" (UniqueName: \"kubernetes.io/projected/ad9c5c4c-36fb-402b-a4dd-b628ba4b002d-kube-api-access-rws4g\") pod \"nova-cell1-conductor-db-sync-dc4rn\" (UID: \"ad9c5c4c-36fb-402b-a4dd-b628ba4b002d\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-dc4rn" Mar 16 16:41:33 crc kubenswrapper[5120]: I0316 16:41:33.380237 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:41:33 crc kubenswrapper[5120]: W0316 16:41:33.381926 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod14d5433c_463c_4e0e_9fc6_841212b46bf4.slice/crio-d1686003d241e205ba9357c1c0fcc62aea5fcbd4e6de8d9a9a614c47226baa94 WatchSource:0}: Error finding container d1686003d241e205ba9357c1c0fcc62aea5fcbd4e6de8d9a9a614c47226baa94: Status 404 returned error can't find the container with id d1686003d241e205ba9357c1c0fcc62aea5fcbd4e6de8d9a9a614c47226baa94 Mar 16 16:41:33 crc kubenswrapper[5120]: I0316 16:41:33.515026 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-dc4rn" Mar 16 16:41:33 crc kubenswrapper[5120]: I0316 16:41:33.558044 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"026cd6ec-c60a-49b4-873f-3a6bb169e666","Type":"ContainerStarted","Data":"3c0be7c712574167621d5807714790f3f7da055aaad486620917992637c6791d"} Mar 16 16:41:33 crc kubenswrapper[5120]: I0316 16:41:33.559677 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"14d5433c-463c-4e0e-9fc6-841212b46bf4","Type":"ContainerStarted","Data":"d1686003d241e205ba9357c1c0fcc62aea5fcbd4e6de8d9a9a614c47226baa94"} Mar 16 16:41:33 crc kubenswrapper[5120]: I0316 16:41:33.575728 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"f69f1ee9-e36c-4f59-a486-7d31a34c31a0","Type":"ContainerStarted","Data":"caf724eec3585b590568a7b3ab1119a8a3be912ed3c012768f42338879e0b7c3"} Mar 16 16:41:33 crc kubenswrapper[5120]: I0316 16:41:33.580943 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"15f1d0a1-892a-4460-914e-54cbd7a1b281","Type":"ContainerStarted","Data":"9d93b1656f99dd70a4e84eaadd51b8ee31c76c3b4ad4dc44e5063ab50b4340fe"} Mar 16 16:41:33 crc kubenswrapper[5120]: I0316 16:41:33.582870 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-tfss2" event={"ID":"f57fccaf-9698-44a5-8d74-f65beb76b3d5","Type":"ContainerStarted","Data":"e699dad28a078d5602aa6823cc59d4574bbd811da8667f237d328f7dc43599e4"} Mar 16 16:41:33 crc kubenswrapper[5120]: I0316 16:41:33.990658 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-dc4rn"] Mar 16 16:41:33 crc kubenswrapper[5120]: W0316 16:41:33.991640 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podad9c5c4c_36fb_402b_a4dd_b628ba4b002d.slice/crio-11ae2dd6f63e4d17993d4b5251c5bfdb123c50053cc6773c9430b03e9cf9dd2d WatchSource:0}: Error finding container 11ae2dd6f63e4d17993d4b5251c5bfdb123c50053cc6773c9430b03e9cf9dd2d: Status 404 returned error can't find the container with id 11ae2dd6f63e4d17993d4b5251c5bfdb123c50053cc6773c9430b03e9cf9dd2d Mar 16 16:41:34 crc kubenswrapper[5120]: I0316 16:41:34.595899 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"026cd6ec-c60a-49b4-873f-3a6bb169e666","Type":"ContainerStarted","Data":"51da8198df753421d73e7682ef1514753bb37585f31d56abe882a0aa8fadb132"} Mar 16 16:41:34 crc kubenswrapper[5120]: I0316 16:41:34.595943 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"026cd6ec-c60a-49b4-873f-3a6bb169e666","Type":"ContainerStarted","Data":"eaa8a0ba94c1e11efaef66bfed8650e21f306d6a24bfae82862137966dda5d27"} Mar 16 16:41:34 crc kubenswrapper[5120]: I0316 16:41:34.603853 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"14d5433c-463c-4e0e-9fc6-841212b46bf4","Type":"ContainerStarted","Data":"bf7254f0cd3af759c94c03004a2056fd9e3310eb1763cb7093dac101f46a11fd"} Mar 16 16:41:34 crc kubenswrapper[5120]: I0316 16:41:34.611374 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"f69f1ee9-e36c-4f59-a486-7d31a34c31a0","Type":"ContainerStarted","Data":"6cbb8df6c682edd2048ecc623a0c4785b3406a7d9b03be5805040f4d5fa8a2ad"} Mar 16 16:41:34 crc kubenswrapper[5120]: I0316 16:41:34.611421 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"f69f1ee9-e36c-4f59-a486-7d31a34c31a0","Type":"ContainerStarted","Data":"2762735f81a4b62d73b9c323c3eeb3a1725606775c95f72d01cc050f2003cb76"} Mar 16 16:41:34 crc kubenswrapper[5120]: I0316 16:41:34.617981 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=2.617962823 podStartE2EDuration="2.617962823s" podCreationTimestamp="2026-03-16 16:41:32 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:41:34.614426588 +0000 UTC m=+4196.768358275" watchObservedRunningTime="2026-03-16 16:41:34.617962823 +0000 UTC m=+4196.771894480" Mar 16 16:41:34 crc kubenswrapper[5120]: I0316 16:41:34.629207 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-dc4rn" event={"ID":"ad9c5c4c-36fb-402b-a4dd-b628ba4b002d","Type":"ContainerStarted","Data":"937fa6da786caa9dcb484ba184476895b4b12d7842037a069491ecd2fd930ae0"} Mar 16 16:41:34 crc kubenswrapper[5120]: I0316 16:41:34.629260 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-dc4rn" event={"ID":"ad9c5c4c-36fb-402b-a4dd-b628ba4b002d","Type":"ContainerStarted","Data":"11ae2dd6f63e4d17993d4b5251c5bfdb123c50053cc6773c9430b03e9cf9dd2d"} Mar 16 16:41:34 crc kubenswrapper[5120]: I0316 16:41:34.631825 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"15f1d0a1-892a-4460-914e-54cbd7a1b281","Type":"ContainerStarted","Data":"d22e1935a9e94b643e14e9ab75abdc6b4f49c7756c01c666fd1aecf6748cb781"} Mar 16 16:41:34 crc kubenswrapper[5120]: I0316 16:41:34.643152 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-tfss2" event={"ID":"f57fccaf-9698-44a5-8d74-f65beb76b3d5","Type":"ContainerStarted","Data":"882f88cce34c8ad0be4f79d5d1b957d5dc1916e0debeb5c24a920fdb99b85c10"} Mar 16 16:41:34 crc kubenswrapper[5120]: I0316 16:41:34.647872 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=2.647852925 podStartE2EDuration="2.647852925s" podCreationTimestamp="2026-03-16 16:41:32 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:41:34.642640263 +0000 UTC m=+4196.796571970" watchObservedRunningTime="2026-03-16 16:41:34.647852925 +0000 UTC m=+4196.801784572" Mar 16 16:41:34 crc kubenswrapper[5120]: I0316 16:41:34.662080 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podStartSLOduration=2.662063641 podStartE2EDuration="2.662063641s" podCreationTimestamp="2026-03-16 16:41:32 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:41:34.658422582 +0000 UTC m=+4196.812354249" watchObservedRunningTime="2026-03-16 16:41:34.662063641 +0000 UTC m=+4196.815995298" Mar 16 16:41:34 crc kubenswrapper[5120]: I0316 16:41:34.690366 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-scheduler-0" podStartSLOduration=2.690347388 podStartE2EDuration="2.690347388s" podCreationTimestamp="2026-03-16 16:41:32 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:41:34.6793623 +0000 UTC m=+4196.833293957" watchObservedRunningTime="2026-03-16 16:41:34.690347388 +0000 UTC m=+4196.844279045" Mar 16 16:41:34 crc kubenswrapper[5120]: I0316 16:41:34.698284 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-tfss2" podStartSLOduration=3.698266933 podStartE2EDuration="3.698266933s" podCreationTimestamp="2026-03-16 16:41:31 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:41:34.693751841 +0000 UTC m=+4196.847683498" watchObservedRunningTime="2026-03-16 16:41:34.698266933 +0000 UTC m=+4196.852198590" Mar 16 16:41:34 crc kubenswrapper[5120]: I0316 16:41:34.714692 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-dc4rn" podStartSLOduration=1.714671698 podStartE2EDuration="1.714671698s" podCreationTimestamp="2026-03-16 16:41:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:41:34.711230255 +0000 UTC m=+4196.865161912" watchObservedRunningTime="2026-03-16 16:41:34.714671698 +0000 UTC m=+4196.868603355" Mar 16 16:41:34 crc kubenswrapper[5120]: I0316 16:41:34.996437 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:41:35 crc kubenswrapper[5120]: I0316 16:41:35.019290 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:41:35 crc kubenswrapper[5120]: I0316 16:41:35.122577 5120 scope.go:117] "RemoveContainer" containerID="f4bef8ba5d70241c574c293edb9fc02039cb7eb72be0c9938e5b281718f7d77e" Mar 16 16:41:36 crc kubenswrapper[5120]: I0316 16:41:36.663213 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podUID="14d5433c-463c-4e0e-9fc6-841212b46bf4" containerName="nova-cell1-novncproxy-novncproxy" containerID="cri-o://bf7254f0cd3af759c94c03004a2056fd9e3310eb1763cb7093dac101f46a11fd" gracePeriod=30 Mar 16 16:41:36 crc kubenswrapper[5120]: I0316 16:41:36.663505 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="026cd6ec-c60a-49b4-873f-3a6bb169e666" containerName="nova-metadata-log" containerID="cri-o://eaa8a0ba94c1e11efaef66bfed8650e21f306d6a24bfae82862137966dda5d27" gracePeriod=30 Mar 16 16:41:36 crc kubenswrapper[5120]: I0316 16:41:36.663600 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="026cd6ec-c60a-49b4-873f-3a6bb169e666" containerName="nova-metadata-metadata" containerID="cri-o://51da8198df753421d73e7682ef1514753bb37585f31d56abe882a0aa8fadb132" gracePeriod=30 Mar 16 16:41:37 crc kubenswrapper[5120]: I0316 16:41:37.249834 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:41:37 crc kubenswrapper[5120]: I0316 16:41:37.336222 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:41:37 crc kubenswrapper[5120]: I0316 16:41:37.363800 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/026cd6ec-c60a-49b4-873f-3a6bb169e666-logs\") pod \"026cd6ec-c60a-49b4-873f-3a6bb169e666\" (UID: \"026cd6ec-c60a-49b4-873f-3a6bb169e666\") " Mar 16 16:41:37 crc kubenswrapper[5120]: I0316 16:41:37.363921 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-db8kb\" (UniqueName: \"kubernetes.io/projected/026cd6ec-c60a-49b4-873f-3a6bb169e666-kube-api-access-db8kb\") pod \"026cd6ec-c60a-49b4-873f-3a6bb169e666\" (UID: \"026cd6ec-c60a-49b4-873f-3a6bb169e666\") " Mar 16 16:41:37 crc kubenswrapper[5120]: I0316 16:41:37.364538 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/026cd6ec-c60a-49b4-873f-3a6bb169e666-config-data\") pod \"026cd6ec-c60a-49b4-873f-3a6bb169e666\" (UID: \"026cd6ec-c60a-49b4-873f-3a6bb169e666\") " Mar 16 16:41:37 crc kubenswrapper[5120]: I0316 16:41:37.364612 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/026cd6ec-c60a-49b4-873f-3a6bb169e666-combined-ca-bundle\") pod \"026cd6ec-c60a-49b4-873f-3a6bb169e666\" (UID: \"026cd6ec-c60a-49b4-873f-3a6bb169e666\") " Mar 16 16:41:37 crc kubenswrapper[5120]: I0316 16:41:37.364685 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/026cd6ec-c60a-49b4-873f-3a6bb169e666-logs" (OuterVolumeSpecName: "logs") pod "026cd6ec-c60a-49b4-873f-3a6bb169e666" (UID: "026cd6ec-c60a-49b4-873f-3a6bb169e666"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:41:37 crc kubenswrapper[5120]: I0316 16:41:37.365603 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/026cd6ec-c60a-49b4-873f-3a6bb169e666-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:41:37 crc kubenswrapper[5120]: I0316 16:41:37.370780 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/026cd6ec-c60a-49b4-873f-3a6bb169e666-kube-api-access-db8kb" (OuterVolumeSpecName: "kube-api-access-db8kb") pod "026cd6ec-c60a-49b4-873f-3a6bb169e666" (UID: "026cd6ec-c60a-49b4-873f-3a6bb169e666"). InnerVolumeSpecName "kube-api-access-db8kb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:41:37 crc kubenswrapper[5120]: I0316 16:41:37.393850 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/026cd6ec-c60a-49b4-873f-3a6bb169e666-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "026cd6ec-c60a-49b4-873f-3a6bb169e666" (UID: "026cd6ec-c60a-49b4-873f-3a6bb169e666"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:41:37 crc kubenswrapper[5120]: I0316 16:41:37.410978 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/026cd6ec-c60a-49b4-873f-3a6bb169e666-config-data" (OuterVolumeSpecName: "config-data") pod "026cd6ec-c60a-49b4-873f-3a6bb169e666" (UID: "026cd6ec-c60a-49b4-873f-3a6bb169e666"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:41:37 crc kubenswrapper[5120]: I0316 16:41:37.465222 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:41:37 crc kubenswrapper[5120]: I0316 16:41:37.466897 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zlt4l\" (UniqueName: \"kubernetes.io/projected/14d5433c-463c-4e0e-9fc6-841212b46bf4-kube-api-access-zlt4l\") pod \"14d5433c-463c-4e0e-9fc6-841212b46bf4\" (UID: \"14d5433c-463c-4e0e-9fc6-841212b46bf4\") " Mar 16 16:41:37 crc kubenswrapper[5120]: I0316 16:41:37.467638 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/14d5433c-463c-4e0e-9fc6-841212b46bf4-combined-ca-bundle\") pod \"14d5433c-463c-4e0e-9fc6-841212b46bf4\" (UID: \"14d5433c-463c-4e0e-9fc6-841212b46bf4\") " Mar 16 16:41:37 crc kubenswrapper[5120]: I0316 16:41:37.467816 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/14d5433c-463c-4e0e-9fc6-841212b46bf4-config-data\") pod \"14d5433c-463c-4e0e-9fc6-841212b46bf4\" (UID: \"14d5433c-463c-4e0e-9fc6-841212b46bf4\") " Mar 16 16:41:37 crc kubenswrapper[5120]: I0316 16:41:37.468553 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-db8kb\" (UniqueName: \"kubernetes.io/projected/026cd6ec-c60a-49b4-873f-3a6bb169e666-kube-api-access-db8kb\") on node \"crc\" DevicePath \"\"" Mar 16 16:41:37 crc kubenswrapper[5120]: I0316 16:41:37.468575 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/026cd6ec-c60a-49b4-873f-3a6bb169e666-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:41:37 crc kubenswrapper[5120]: I0316 16:41:37.468586 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/026cd6ec-c60a-49b4-873f-3a6bb169e666-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:41:37 crc kubenswrapper[5120]: I0316 16:41:37.470586 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14d5433c-463c-4e0e-9fc6-841212b46bf4-kube-api-access-zlt4l" (OuterVolumeSpecName: "kube-api-access-zlt4l") pod "14d5433c-463c-4e0e-9fc6-841212b46bf4" (UID: "14d5433c-463c-4e0e-9fc6-841212b46bf4"). InnerVolumeSpecName "kube-api-access-zlt4l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:41:37 crc kubenswrapper[5120]: I0316 16:41:37.492351 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/14d5433c-463c-4e0e-9fc6-841212b46bf4-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "14d5433c-463c-4e0e-9fc6-841212b46bf4" (UID: "14d5433c-463c-4e0e-9fc6-841212b46bf4"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:41:37 crc kubenswrapper[5120]: I0316 16:41:37.499446 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/14d5433c-463c-4e0e-9fc6-841212b46bf4-config-data" (OuterVolumeSpecName: "config-data") pod "14d5433c-463c-4e0e-9fc6-841212b46bf4" (UID: "14d5433c-463c-4e0e-9fc6-841212b46bf4"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:41:37 crc kubenswrapper[5120]: I0316 16:41:37.570250 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/14d5433c-463c-4e0e-9fc6-841212b46bf4-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:41:37 crc kubenswrapper[5120]: I0316 16:41:37.570287 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/14d5433c-463c-4e0e-9fc6-841212b46bf4-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:41:37 crc kubenswrapper[5120]: I0316 16:41:37.570296 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zlt4l\" (UniqueName: \"kubernetes.io/projected/14d5433c-463c-4e0e-9fc6-841212b46bf4-kube-api-access-zlt4l\") on node \"crc\" DevicePath \"\"" Mar 16 16:41:37 crc kubenswrapper[5120]: I0316 16:41:37.674378 5120 generic.go:358] "Generic (PLEG): container finished" podID="026cd6ec-c60a-49b4-873f-3a6bb169e666" containerID="51da8198df753421d73e7682ef1514753bb37585f31d56abe882a0aa8fadb132" exitCode=0 Mar 16 16:41:37 crc kubenswrapper[5120]: I0316 16:41:37.674639 5120 generic.go:358] "Generic (PLEG): container finished" podID="026cd6ec-c60a-49b4-873f-3a6bb169e666" containerID="eaa8a0ba94c1e11efaef66bfed8650e21f306d6a24bfae82862137966dda5d27" exitCode=143 Mar 16 16:41:37 crc kubenswrapper[5120]: I0316 16:41:37.674438 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"026cd6ec-c60a-49b4-873f-3a6bb169e666","Type":"ContainerDied","Data":"51da8198df753421d73e7682ef1514753bb37585f31d56abe882a0aa8fadb132"} Mar 16 16:41:37 crc kubenswrapper[5120]: I0316 16:41:37.674694 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"026cd6ec-c60a-49b4-873f-3a6bb169e666","Type":"ContainerDied","Data":"eaa8a0ba94c1e11efaef66bfed8650e21f306d6a24bfae82862137966dda5d27"} Mar 16 16:41:37 crc kubenswrapper[5120]: I0316 16:41:37.674716 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"026cd6ec-c60a-49b4-873f-3a6bb169e666","Type":"ContainerDied","Data":"3c0be7c712574167621d5807714790f3f7da055aaad486620917992637c6791d"} Mar 16 16:41:37 crc kubenswrapper[5120]: I0316 16:41:37.674738 5120 scope.go:117] "RemoveContainer" containerID="51da8198df753421d73e7682ef1514753bb37585f31d56abe882a0aa8fadb132" Mar 16 16:41:37 crc kubenswrapper[5120]: I0316 16:41:37.674451 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:41:37 crc kubenswrapper[5120]: I0316 16:41:37.679251 5120 generic.go:358] "Generic (PLEG): container finished" podID="14d5433c-463c-4e0e-9fc6-841212b46bf4" containerID="bf7254f0cd3af759c94c03004a2056fd9e3310eb1763cb7093dac101f46a11fd" exitCode=0 Mar 16 16:41:37 crc kubenswrapper[5120]: I0316 16:41:37.679297 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"14d5433c-463c-4e0e-9fc6-841212b46bf4","Type":"ContainerDied","Data":"bf7254f0cd3af759c94c03004a2056fd9e3310eb1763cb7093dac101f46a11fd"} Mar 16 16:41:37 crc kubenswrapper[5120]: I0316 16:41:37.679327 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:41:37 crc kubenswrapper[5120]: I0316 16:41:37.679342 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"14d5433c-463c-4e0e-9fc6-841212b46bf4","Type":"ContainerDied","Data":"d1686003d241e205ba9357c1c0fcc62aea5fcbd4e6de8d9a9a614c47226baa94"} Mar 16 16:41:37 crc kubenswrapper[5120]: I0316 16:41:37.722717 5120 scope.go:117] "RemoveContainer" containerID="eaa8a0ba94c1e11efaef66bfed8650e21f306d6a24bfae82862137966dda5d27" Mar 16 16:41:37 crc kubenswrapper[5120]: I0316 16:41:37.767126 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:41:37 crc kubenswrapper[5120]: I0316 16:41:37.775526 5120 scope.go:117] "RemoveContainer" containerID="51da8198df753421d73e7682ef1514753bb37585f31d56abe882a0aa8fadb132" Mar 16 16:41:37 crc kubenswrapper[5120]: E0316 16:41:37.776127 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"51da8198df753421d73e7682ef1514753bb37585f31d56abe882a0aa8fadb132\": container with ID starting with 51da8198df753421d73e7682ef1514753bb37585f31d56abe882a0aa8fadb132 not found: ID does not exist" containerID="51da8198df753421d73e7682ef1514753bb37585f31d56abe882a0aa8fadb132" Mar 16 16:41:37 crc kubenswrapper[5120]: I0316 16:41:37.776173 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51da8198df753421d73e7682ef1514753bb37585f31d56abe882a0aa8fadb132"} err="failed to get container status \"51da8198df753421d73e7682ef1514753bb37585f31d56abe882a0aa8fadb132\": rpc error: code = NotFound desc = could not find container \"51da8198df753421d73e7682ef1514753bb37585f31d56abe882a0aa8fadb132\": container with ID starting with 51da8198df753421d73e7682ef1514753bb37585f31d56abe882a0aa8fadb132 not found: ID does not exist" Mar 16 16:41:37 crc kubenswrapper[5120]: I0316 16:41:37.776207 5120 scope.go:117] "RemoveContainer" containerID="eaa8a0ba94c1e11efaef66bfed8650e21f306d6a24bfae82862137966dda5d27" Mar 16 16:41:37 crc kubenswrapper[5120]: E0316 16:41:37.776531 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eaa8a0ba94c1e11efaef66bfed8650e21f306d6a24bfae82862137966dda5d27\": container with ID starting with eaa8a0ba94c1e11efaef66bfed8650e21f306d6a24bfae82862137966dda5d27 not found: ID does not exist" containerID="eaa8a0ba94c1e11efaef66bfed8650e21f306d6a24bfae82862137966dda5d27" Mar 16 16:41:37 crc kubenswrapper[5120]: I0316 16:41:37.776551 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eaa8a0ba94c1e11efaef66bfed8650e21f306d6a24bfae82862137966dda5d27"} err="failed to get container status \"eaa8a0ba94c1e11efaef66bfed8650e21f306d6a24bfae82862137966dda5d27\": rpc error: code = NotFound desc = could not find container \"eaa8a0ba94c1e11efaef66bfed8650e21f306d6a24bfae82862137966dda5d27\": container with ID starting with eaa8a0ba94c1e11efaef66bfed8650e21f306d6a24bfae82862137966dda5d27 not found: ID does not exist" Mar 16 16:41:37 crc kubenswrapper[5120]: I0316 16:41:37.776562 5120 scope.go:117] "RemoveContainer" containerID="51da8198df753421d73e7682ef1514753bb37585f31d56abe882a0aa8fadb132" Mar 16 16:41:37 crc kubenswrapper[5120]: I0316 16:41:37.776918 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51da8198df753421d73e7682ef1514753bb37585f31d56abe882a0aa8fadb132"} err="failed to get container status \"51da8198df753421d73e7682ef1514753bb37585f31d56abe882a0aa8fadb132\": rpc error: code = NotFound desc = could not find container \"51da8198df753421d73e7682ef1514753bb37585f31d56abe882a0aa8fadb132\": container with ID starting with 51da8198df753421d73e7682ef1514753bb37585f31d56abe882a0aa8fadb132 not found: ID does not exist" Mar 16 16:41:37 crc kubenswrapper[5120]: I0316 16:41:37.776966 5120 scope.go:117] "RemoveContainer" containerID="eaa8a0ba94c1e11efaef66bfed8650e21f306d6a24bfae82862137966dda5d27" Mar 16 16:41:37 crc kubenswrapper[5120]: I0316 16:41:37.777377 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eaa8a0ba94c1e11efaef66bfed8650e21f306d6a24bfae82862137966dda5d27"} err="failed to get container status \"eaa8a0ba94c1e11efaef66bfed8650e21f306d6a24bfae82862137966dda5d27\": rpc error: code = NotFound desc = could not find container \"eaa8a0ba94c1e11efaef66bfed8650e21f306d6a24bfae82862137966dda5d27\": container with ID starting with eaa8a0ba94c1e11efaef66bfed8650e21f306d6a24bfae82862137966dda5d27 not found: ID does not exist" Mar 16 16:41:37 crc kubenswrapper[5120]: I0316 16:41:37.777395 5120 scope.go:117] "RemoveContainer" containerID="bf7254f0cd3af759c94c03004a2056fd9e3310eb1763cb7093dac101f46a11fd" Mar 16 16:41:37 crc kubenswrapper[5120]: I0316 16:41:37.780911 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:41:37 crc kubenswrapper[5120]: I0316 16:41:37.789536 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:41:37 crc kubenswrapper[5120]: I0316 16:41:37.801247 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:41:37 crc kubenswrapper[5120]: I0316 16:41:37.808634 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:41:37 crc kubenswrapper[5120]: I0316 16:41:37.809975 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="026cd6ec-c60a-49b4-873f-3a6bb169e666" containerName="nova-metadata-metadata" Mar 16 16:41:37 crc kubenswrapper[5120]: I0316 16:41:37.810002 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="026cd6ec-c60a-49b4-873f-3a6bb169e666" containerName="nova-metadata-metadata" Mar 16 16:41:37 crc kubenswrapper[5120]: I0316 16:41:37.810025 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="026cd6ec-c60a-49b4-873f-3a6bb169e666" containerName="nova-metadata-log" Mar 16 16:41:37 crc kubenswrapper[5120]: I0316 16:41:37.810036 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="026cd6ec-c60a-49b4-873f-3a6bb169e666" containerName="nova-metadata-log" Mar 16 16:41:37 crc kubenswrapper[5120]: I0316 16:41:37.810060 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14d5433c-463c-4e0e-9fc6-841212b46bf4" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 16:41:37 crc kubenswrapper[5120]: I0316 16:41:37.810068 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="14d5433c-463c-4e0e-9fc6-841212b46bf4" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 16:41:37 crc kubenswrapper[5120]: I0316 16:41:37.810264 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="026cd6ec-c60a-49b4-873f-3a6bb169e666" containerName="nova-metadata-metadata" Mar 16 16:41:37 crc kubenswrapper[5120]: I0316 16:41:37.810289 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="14d5433c-463c-4e0e-9fc6-841212b46bf4" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 16:41:37 crc kubenswrapper[5120]: I0316 16:41:37.810314 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="026cd6ec-c60a-49b4-873f-3a6bb169e666" containerName="nova-metadata-log" Mar 16 16:41:37 crc kubenswrapper[5120]: I0316 16:41:37.822643 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:41:37 crc kubenswrapper[5120]: I0316 16:41:37.822823 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:41:37 crc kubenswrapper[5120]: I0316 16:41:37.829229 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:41:37 crc kubenswrapper[5120]: I0316 16:41:37.834714 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-metadata-config-data\"" Mar 16 16:41:37 crc kubenswrapper[5120]: I0316 16:41:37.835210 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-metadata-internal-svc\"" Mar 16 16:41:37 crc kubenswrapper[5120]: I0316 16:41:37.835451 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:41:37 crc kubenswrapper[5120]: I0316 16:41:37.837522 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:41:37 crc kubenswrapper[5120]: I0316 16:41:37.842380 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-novncproxy-cell1-vencrypt\"" Mar 16 16:41:37 crc kubenswrapper[5120]: I0316 16:41:37.842701 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-novncproxy-config-data\"" Mar 16 16:41:37 crc kubenswrapper[5120]: I0316 16:41:37.842903 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-novncproxy-cell1-public-svc\"" Mar 16 16:41:37 crc kubenswrapper[5120]: I0316 16:41:37.866417 5120 scope.go:117] "RemoveContainer" containerID="bf7254f0cd3af759c94c03004a2056fd9e3310eb1763cb7093dac101f46a11fd" Mar 16 16:41:37 crc kubenswrapper[5120]: E0316 16:41:37.867296 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf7254f0cd3af759c94c03004a2056fd9e3310eb1763cb7093dac101f46a11fd\": container with ID starting with bf7254f0cd3af759c94c03004a2056fd9e3310eb1763cb7093dac101f46a11fd not found: ID does not exist" containerID="bf7254f0cd3af759c94c03004a2056fd9e3310eb1763cb7093dac101f46a11fd" Mar 16 16:41:37 crc kubenswrapper[5120]: I0316 16:41:37.867336 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf7254f0cd3af759c94c03004a2056fd9e3310eb1763cb7093dac101f46a11fd"} err="failed to get container status \"bf7254f0cd3af759c94c03004a2056fd9e3310eb1763cb7093dac101f46a11fd\": rpc error: code = NotFound desc = could not find container \"bf7254f0cd3af759c94c03004a2056fd9e3310eb1763cb7093dac101f46a11fd\": container with ID starting with bf7254f0cd3af759c94c03004a2056fd9e3310eb1763cb7093dac101f46a11fd not found: ID does not exist" Mar 16 16:41:37 crc kubenswrapper[5120]: I0316 16:41:37.983695 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9c7beefa-6c26-4bbe-887f-0b519648e943-config-data\") pod \"nova-metadata-0\" (UID: \"9c7beefa-6c26-4bbe-887f-0b519648e943\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:41:37 crc kubenswrapper[5120]: I0316 16:41:37.983770 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9c7beefa-6c26-4bbe-887f-0b519648e943-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"9c7beefa-6c26-4bbe-887f-0b519648e943\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:41:37 crc kubenswrapper[5120]: I0316 16:41:37.983825 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jznf4\" (UniqueName: \"kubernetes.io/projected/9c7beefa-6c26-4bbe-887f-0b519648e943-kube-api-access-jznf4\") pod \"nova-metadata-0\" (UID: \"9c7beefa-6c26-4bbe-887f-0b519648e943\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:41:37 crc kubenswrapper[5120]: I0316 16:41:37.983969 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/e8e5a741-9d1e-496c-85e7-3f2966cf0e68-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"e8e5a741-9d1e-496c-85e7-3f2966cf0e68\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:41:37 crc kubenswrapper[5120]: I0316 16:41:37.984034 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpkzx\" (UniqueName: \"kubernetes.io/projected/e8e5a741-9d1e-496c-85e7-3f2966cf0e68-kube-api-access-kpkzx\") pod \"nova-cell1-novncproxy-0\" (UID: \"e8e5a741-9d1e-496c-85e7-3f2966cf0e68\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:41:37 crc kubenswrapper[5120]: I0316 16:41:37.984239 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e8e5a741-9d1e-496c-85e7-3f2966cf0e68-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"e8e5a741-9d1e-496c-85e7-3f2966cf0e68\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:41:37 crc kubenswrapper[5120]: I0316 16:41:37.984782 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9c7beefa-6c26-4bbe-887f-0b519648e943-logs\") pod \"nova-metadata-0\" (UID: \"9c7beefa-6c26-4bbe-887f-0b519648e943\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:41:37 crc kubenswrapper[5120]: I0316 16:41:37.984897 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e8e5a741-9d1e-496c-85e7-3f2966cf0e68-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"e8e5a741-9d1e-496c-85e7-3f2966cf0e68\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:41:37 crc kubenswrapper[5120]: I0316 16:41:37.985027 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/e8e5a741-9d1e-496c-85e7-3f2966cf0e68-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"e8e5a741-9d1e-496c-85e7-3f2966cf0e68\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:41:37 crc kubenswrapper[5120]: I0316 16:41:37.985221 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/9c7beefa-6c26-4bbe-887f-0b519648e943-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"9c7beefa-6c26-4bbe-887f-0b519648e943\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:41:38 crc kubenswrapper[5120]: I0316 16:41:38.098663 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9c7beefa-6c26-4bbe-887f-0b519648e943-logs\") pod \"nova-metadata-0\" (UID: \"9c7beefa-6c26-4bbe-887f-0b519648e943\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:41:38 crc kubenswrapper[5120]: I0316 16:41:38.098741 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e8e5a741-9d1e-496c-85e7-3f2966cf0e68-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"e8e5a741-9d1e-496c-85e7-3f2966cf0e68\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:41:38 crc kubenswrapper[5120]: I0316 16:41:38.098826 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/e8e5a741-9d1e-496c-85e7-3f2966cf0e68-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"e8e5a741-9d1e-496c-85e7-3f2966cf0e68\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:41:38 crc kubenswrapper[5120]: I0316 16:41:38.098932 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/9c7beefa-6c26-4bbe-887f-0b519648e943-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"9c7beefa-6c26-4bbe-887f-0b519648e943\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:41:38 crc kubenswrapper[5120]: I0316 16:41:38.099105 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9c7beefa-6c26-4bbe-887f-0b519648e943-config-data\") pod \"nova-metadata-0\" (UID: \"9c7beefa-6c26-4bbe-887f-0b519648e943\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:41:38 crc kubenswrapper[5120]: I0316 16:41:38.099136 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9c7beefa-6c26-4bbe-887f-0b519648e943-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"9c7beefa-6c26-4bbe-887f-0b519648e943\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:41:38 crc kubenswrapper[5120]: I0316 16:41:38.099177 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jznf4\" (UniqueName: \"kubernetes.io/projected/9c7beefa-6c26-4bbe-887f-0b519648e943-kube-api-access-jznf4\") pod \"nova-metadata-0\" (UID: \"9c7beefa-6c26-4bbe-887f-0b519648e943\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:41:38 crc kubenswrapper[5120]: I0316 16:41:38.099175 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9c7beefa-6c26-4bbe-887f-0b519648e943-logs\") pod \"nova-metadata-0\" (UID: \"9c7beefa-6c26-4bbe-887f-0b519648e943\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:41:38 crc kubenswrapper[5120]: I0316 16:41:38.099429 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/e8e5a741-9d1e-496c-85e7-3f2966cf0e68-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"e8e5a741-9d1e-496c-85e7-3f2966cf0e68\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:41:38 crc kubenswrapper[5120]: I0316 16:41:38.099463 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kpkzx\" (UniqueName: \"kubernetes.io/projected/e8e5a741-9d1e-496c-85e7-3f2966cf0e68-kube-api-access-kpkzx\") pod \"nova-cell1-novncproxy-0\" (UID: \"e8e5a741-9d1e-496c-85e7-3f2966cf0e68\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:41:38 crc kubenswrapper[5120]: I0316 16:41:38.099614 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e8e5a741-9d1e-496c-85e7-3f2966cf0e68-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"e8e5a741-9d1e-496c-85e7-3f2966cf0e68\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:41:38 crc kubenswrapper[5120]: I0316 16:41:38.105557 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/e8e5a741-9d1e-496c-85e7-3f2966cf0e68-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"e8e5a741-9d1e-496c-85e7-3f2966cf0e68\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:41:38 crc kubenswrapper[5120]: I0316 16:41:38.127599 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e8e5a741-9d1e-496c-85e7-3f2966cf0e68-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"e8e5a741-9d1e-496c-85e7-3f2966cf0e68\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:41:38 crc kubenswrapper[5120]: I0316 16:41:38.128599 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9c7beefa-6c26-4bbe-887f-0b519648e943-config-data\") pod \"nova-metadata-0\" (UID: \"9c7beefa-6c26-4bbe-887f-0b519648e943\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:41:38 crc kubenswrapper[5120]: I0316 16:41:38.160462 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/e8e5a741-9d1e-496c-85e7-3f2966cf0e68-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"e8e5a741-9d1e-496c-85e7-3f2966cf0e68\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:41:38 crc kubenswrapper[5120]: I0316 16:41:38.167561 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jznf4\" (UniqueName: \"kubernetes.io/projected/9c7beefa-6c26-4bbe-887f-0b519648e943-kube-api-access-jznf4\") pod \"nova-metadata-0\" (UID: \"9c7beefa-6c26-4bbe-887f-0b519648e943\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:41:38 crc kubenswrapper[5120]: I0316 16:41:38.170316 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpkzx\" (UniqueName: \"kubernetes.io/projected/e8e5a741-9d1e-496c-85e7-3f2966cf0e68-kube-api-access-kpkzx\") pod \"nova-cell1-novncproxy-0\" (UID: \"e8e5a741-9d1e-496c-85e7-3f2966cf0e68\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:41:38 crc kubenswrapper[5120]: I0316 16:41:38.171117 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e8e5a741-9d1e-496c-85e7-3f2966cf0e68-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"e8e5a741-9d1e-496c-85e7-3f2966cf0e68\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:41:38 crc kubenswrapper[5120]: I0316 16:41:38.180022 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:41:38 crc kubenswrapper[5120]: I0316 16:41:38.181457 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/9c7beefa-6c26-4bbe-887f-0b519648e943-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"9c7beefa-6c26-4bbe-887f-0b519648e943\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:41:38 crc kubenswrapper[5120]: I0316 16:41:38.185458 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9c7beefa-6c26-4bbe-887f-0b519648e943-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"9c7beefa-6c26-4bbe-887f-0b519648e943\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:41:38 crc kubenswrapper[5120]: I0316 16:41:38.472653 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:41:38 crc kubenswrapper[5120]: I0316 16:41:38.686671 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="026cd6ec-c60a-49b4-873f-3a6bb169e666" path="/var/lib/kubelet/pods/026cd6ec-c60a-49b4-873f-3a6bb169e666/volumes" Mar 16 16:41:38 crc kubenswrapper[5120]: I0316 16:41:38.687692 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="14d5433c-463c-4e0e-9fc6-841212b46bf4" path="/var/lib/kubelet/pods/14d5433c-463c-4e0e-9fc6-841212b46bf4/volumes" Mar 16 16:41:38 crc kubenswrapper[5120]: I0316 16:41:38.730952 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:41:38 crc kubenswrapper[5120]: I0316 16:41:38.893726 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:41:38 crc kubenswrapper[5120]: W0316 16:41:38.896172 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9c7beefa_6c26_4bbe_887f_0b519648e943.slice/crio-03266151c1af9bdb361e4dbe2dde6c956d6053bfbd4fc2e7edc550ac5ac40684 WatchSource:0}: Error finding container 03266151c1af9bdb361e4dbe2dde6c956d6053bfbd4fc2e7edc550ac5ac40684: Status 404 returned error can't find the container with id 03266151c1af9bdb361e4dbe2dde6c956d6053bfbd4fc2e7edc550ac5ac40684 Mar 16 16:41:39 crc kubenswrapper[5120]: I0316 16:41:39.707364 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"e8e5a741-9d1e-496c-85e7-3f2966cf0e68","Type":"ContainerStarted","Data":"2f0e2ea2afbd1d991add597e9e7e1845007742c0328e4bd20ed56b6b54be47ee"} Mar 16 16:41:39 crc kubenswrapper[5120]: I0316 16:41:39.707415 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"e8e5a741-9d1e-496c-85e7-3f2966cf0e68","Type":"ContainerStarted","Data":"5dffe7cd9311bbe46631f9727b23a6b976c55ee99d2a2e490e76bb96c25c762b"} Mar 16 16:41:39 crc kubenswrapper[5120]: I0316 16:41:39.712238 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"9c7beefa-6c26-4bbe-887f-0b519648e943","Type":"ContainerStarted","Data":"78ab63780a4774254ee9851f1bc25c2e1e2ba602c3e0ba650417d531d7e6eaed"} Mar 16 16:41:39 crc kubenswrapper[5120]: I0316 16:41:39.712264 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"9c7beefa-6c26-4bbe-887f-0b519648e943","Type":"ContainerStarted","Data":"166f2e6f12dbcee0806a15218a41ba77bf1ae4087083f1ab4758e15d1fda8bd2"} Mar 16 16:41:39 crc kubenswrapper[5120]: I0316 16:41:39.712273 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"9c7beefa-6c26-4bbe-887f-0b519648e943","Type":"ContainerStarted","Data":"03266151c1af9bdb361e4dbe2dde6c956d6053bfbd4fc2e7edc550ac5ac40684"} Mar 16 16:41:39 crc kubenswrapper[5120]: I0316 16:41:39.736670 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podStartSLOduration=2.736649646 podStartE2EDuration="2.736649646s" podCreationTimestamp="2026-03-16 16:41:37 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:41:39.728025202 +0000 UTC m=+4201.881956879" watchObservedRunningTime="2026-03-16 16:41:39.736649646 +0000 UTC m=+4201.890581303" Mar 16 16:41:39 crc kubenswrapper[5120]: I0316 16:41:39.753428 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=2.753406301 podStartE2EDuration="2.753406301s" podCreationTimestamp="2026-03-16 16:41:37 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:41:39.751682164 +0000 UTC m=+4201.905613831" watchObservedRunningTime="2026-03-16 16:41:39.753406301 +0000 UTC m=+4201.907337958" Mar 16 16:41:40 crc kubenswrapper[5120]: I0316 16:41:40.724727 5120 generic.go:358] "Generic (PLEG): container finished" podID="ad9c5c4c-36fb-402b-a4dd-b628ba4b002d" containerID="937fa6da786caa9dcb484ba184476895b4b12d7842037a069491ecd2fd930ae0" exitCode=0 Mar 16 16:41:40 crc kubenswrapper[5120]: I0316 16:41:40.724831 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-dc4rn" event={"ID":"ad9c5c4c-36fb-402b-a4dd-b628ba4b002d","Type":"ContainerDied","Data":"937fa6da786caa9dcb484ba184476895b4b12d7842037a069491ecd2fd930ae0"} Mar 16 16:41:41 crc kubenswrapper[5120]: I0316 16:41:41.737247 5120 generic.go:358] "Generic (PLEG): container finished" podID="f57fccaf-9698-44a5-8d74-f65beb76b3d5" containerID="882f88cce34c8ad0be4f79d5d1b957d5dc1916e0debeb5c24a920fdb99b85c10" exitCode=0 Mar 16 16:41:41 crc kubenswrapper[5120]: I0316 16:41:41.737340 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-tfss2" event={"ID":"f57fccaf-9698-44a5-8d74-f65beb76b3d5","Type":"ContainerDied","Data":"882f88cce34c8ad0be4f79d5d1b957d5dc1916e0debeb5c24a920fdb99b85c10"} Mar 16 16:41:42 crc kubenswrapper[5120]: I0316 16:41:42.163643 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-dc4rn" Mar 16 16:41:42 crc kubenswrapper[5120]: I0316 16:41:42.214987 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ad9c5c4c-36fb-402b-a4dd-b628ba4b002d-combined-ca-bundle\") pod \"ad9c5c4c-36fb-402b-a4dd-b628ba4b002d\" (UID: \"ad9c5c4c-36fb-402b-a4dd-b628ba4b002d\") " Mar 16 16:41:42 crc kubenswrapper[5120]: I0316 16:41:42.215147 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ad9c5c4c-36fb-402b-a4dd-b628ba4b002d-scripts\") pod \"ad9c5c4c-36fb-402b-a4dd-b628ba4b002d\" (UID: \"ad9c5c4c-36fb-402b-a4dd-b628ba4b002d\") " Mar 16 16:41:42 crc kubenswrapper[5120]: I0316 16:41:42.215262 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rws4g\" (UniqueName: \"kubernetes.io/projected/ad9c5c4c-36fb-402b-a4dd-b628ba4b002d-kube-api-access-rws4g\") pod \"ad9c5c4c-36fb-402b-a4dd-b628ba4b002d\" (UID: \"ad9c5c4c-36fb-402b-a4dd-b628ba4b002d\") " Mar 16 16:41:42 crc kubenswrapper[5120]: I0316 16:41:42.215594 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ad9c5c4c-36fb-402b-a4dd-b628ba4b002d-config-data\") pod \"ad9c5c4c-36fb-402b-a4dd-b628ba4b002d\" (UID: \"ad9c5c4c-36fb-402b-a4dd-b628ba4b002d\") " Mar 16 16:41:42 crc kubenswrapper[5120]: I0316 16:41:42.232591 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad9c5c4c-36fb-402b-a4dd-b628ba4b002d-kube-api-access-rws4g" (OuterVolumeSpecName: "kube-api-access-rws4g") pod "ad9c5c4c-36fb-402b-a4dd-b628ba4b002d" (UID: "ad9c5c4c-36fb-402b-a4dd-b628ba4b002d"). InnerVolumeSpecName "kube-api-access-rws4g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:41:42 crc kubenswrapper[5120]: I0316 16:41:42.232633 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad9c5c4c-36fb-402b-a4dd-b628ba4b002d-scripts" (OuterVolumeSpecName: "scripts") pod "ad9c5c4c-36fb-402b-a4dd-b628ba4b002d" (UID: "ad9c5c4c-36fb-402b-a4dd-b628ba4b002d"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:41:42 crc kubenswrapper[5120]: I0316 16:41:42.247963 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad9c5c4c-36fb-402b-a4dd-b628ba4b002d-config-data" (OuterVolumeSpecName: "config-data") pod "ad9c5c4c-36fb-402b-a4dd-b628ba4b002d" (UID: "ad9c5c4c-36fb-402b-a4dd-b628ba4b002d"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:41:42 crc kubenswrapper[5120]: I0316 16:41:42.256044 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad9c5c4c-36fb-402b-a4dd-b628ba4b002d-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ad9c5c4c-36fb-402b-a4dd-b628ba4b002d" (UID: "ad9c5c4c-36fb-402b-a4dd-b628ba4b002d"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:41:42 crc kubenswrapper[5120]: I0316 16:41:42.318789 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ad9c5c4c-36fb-402b-a4dd-b628ba4b002d-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:41:42 crc kubenswrapper[5120]: I0316 16:41:42.318822 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ad9c5c4c-36fb-402b-a4dd-b628ba4b002d-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:41:42 crc kubenswrapper[5120]: I0316 16:41:42.318832 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rws4g\" (UniqueName: \"kubernetes.io/projected/ad9c5c4c-36fb-402b-a4dd-b628ba4b002d-kube-api-access-rws4g\") on node \"crc\" DevicePath \"\"" Mar 16 16:41:42 crc kubenswrapper[5120]: I0316 16:41:42.318842 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ad9c5c4c-36fb-402b-a4dd-b628ba4b002d-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:41:42 crc kubenswrapper[5120]: I0316 16:41:42.420975 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:41:42 crc kubenswrapper[5120]: I0316 16:41:42.421059 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:41:42 crc kubenswrapper[5120]: I0316 16:41:42.465540 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:41:42 crc kubenswrapper[5120]: I0316 16:41:42.500221 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:41:42 crc kubenswrapper[5120]: I0316 16:41:42.750147 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-dc4rn" Mar 16 16:41:42 crc kubenswrapper[5120]: I0316 16:41:42.750171 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-dc4rn" event={"ID":"ad9c5c4c-36fb-402b-a4dd-b628ba4b002d","Type":"ContainerDied","Data":"11ae2dd6f63e4d17993d4b5251c5bfdb123c50053cc6773c9430b03e9cf9dd2d"} Mar 16 16:41:42 crc kubenswrapper[5120]: I0316 16:41:42.750210 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="11ae2dd6f63e4d17993d4b5251c5bfdb123c50053cc6773c9430b03e9cf9dd2d" Mar 16 16:41:42 crc kubenswrapper[5120]: I0316 16:41:42.806515 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:41:42 crc kubenswrapper[5120]: I0316 16:41:42.847286 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 16:41:42 crc kubenswrapper[5120]: I0316 16:41:42.851431 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad9c5c4c-36fb-402b-a4dd-b628ba4b002d" containerName="nova-cell1-conductor-db-sync" Mar 16 16:41:42 crc kubenswrapper[5120]: I0316 16:41:42.851474 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad9c5c4c-36fb-402b-a4dd-b628ba4b002d" containerName="nova-cell1-conductor-db-sync" Mar 16 16:41:42 crc kubenswrapper[5120]: I0316 16:41:42.851919 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ad9c5c4c-36fb-402b-a4dd-b628ba4b002d" containerName="nova-cell1-conductor-db-sync" Mar 16 16:41:42 crc kubenswrapper[5120]: I0316 16:41:42.909180 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 16:41:42 crc kubenswrapper[5120]: I0316 16:41:42.910048 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:41:42 crc kubenswrapper[5120]: I0316 16:41:42.913016 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-conductor-config-data\"" Mar 16 16:41:43 crc kubenswrapper[5120]: I0316 16:41:43.035089 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtqq5\" (UniqueName: \"kubernetes.io/projected/a7128a81-4e4e-4635-b66c-f992c4b30d2a-kube-api-access-mtqq5\") pod \"nova-cell1-conductor-0\" (UID: \"a7128a81-4e4e-4635-b66c-f992c4b30d2a\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:41:43 crc kubenswrapper[5120]: I0316 16:41:43.035191 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a7128a81-4e4e-4635-b66c-f992c4b30d2a-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"a7128a81-4e4e-4635-b66c-f992c4b30d2a\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:41:43 crc kubenswrapper[5120]: I0316 16:41:43.035317 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a7128a81-4e4e-4635-b66c-f992c4b30d2a-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"a7128a81-4e4e-4635-b66c-f992c4b30d2a\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:41:43 crc kubenswrapper[5120]: I0316 16:41:43.141133 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a7128a81-4e4e-4635-b66c-f992c4b30d2a-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"a7128a81-4e4e-4635-b66c-f992c4b30d2a\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:41:43 crc kubenswrapper[5120]: I0316 16:41:43.141742 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mtqq5\" (UniqueName: \"kubernetes.io/projected/a7128a81-4e4e-4635-b66c-f992c4b30d2a-kube-api-access-mtqq5\") pod \"nova-cell1-conductor-0\" (UID: \"a7128a81-4e4e-4635-b66c-f992c4b30d2a\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:41:43 crc kubenswrapper[5120]: I0316 16:41:43.141829 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a7128a81-4e4e-4635-b66c-f992c4b30d2a-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"a7128a81-4e4e-4635-b66c-f992c4b30d2a\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:41:43 crc kubenswrapper[5120]: I0316 16:41:43.150521 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a7128a81-4e4e-4635-b66c-f992c4b30d2a-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"a7128a81-4e4e-4635-b66c-f992c4b30d2a\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:41:43 crc kubenswrapper[5120]: I0316 16:41:43.151150 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a7128a81-4e4e-4635-b66c-f992c4b30d2a-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"a7128a81-4e4e-4635-b66c-f992c4b30d2a\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:41:43 crc kubenswrapper[5120]: I0316 16:41:43.158294 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtqq5\" (UniqueName: \"kubernetes.io/projected/a7128a81-4e4e-4635-b66c-f992c4b30d2a-kube-api-access-mtqq5\") pod \"nova-cell1-conductor-0\" (UID: \"a7128a81-4e4e-4635-b66c-f992c4b30d2a\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:41:43 crc kubenswrapper[5120]: I0316 16:41:43.180838 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:41:43 crc kubenswrapper[5120]: I0316 16:41:43.213178 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-tfss2" Mar 16 16:41:43 crc kubenswrapper[5120]: I0316 16:41:43.232133 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:41:43 crc kubenswrapper[5120]: I0316 16:41:43.345838 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f57fccaf-9698-44a5-8d74-f65beb76b3d5-combined-ca-bundle\") pod \"f57fccaf-9698-44a5-8d74-f65beb76b3d5\" (UID: \"f57fccaf-9698-44a5-8d74-f65beb76b3d5\") " Mar 16 16:41:43 crc kubenswrapper[5120]: I0316 16:41:43.345893 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rhvph\" (UniqueName: \"kubernetes.io/projected/f57fccaf-9698-44a5-8d74-f65beb76b3d5-kube-api-access-rhvph\") pod \"f57fccaf-9698-44a5-8d74-f65beb76b3d5\" (UID: \"f57fccaf-9698-44a5-8d74-f65beb76b3d5\") " Mar 16 16:41:43 crc kubenswrapper[5120]: I0316 16:41:43.346040 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f57fccaf-9698-44a5-8d74-f65beb76b3d5-scripts\") pod \"f57fccaf-9698-44a5-8d74-f65beb76b3d5\" (UID: \"f57fccaf-9698-44a5-8d74-f65beb76b3d5\") " Mar 16 16:41:43 crc kubenswrapper[5120]: I0316 16:41:43.346510 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f57fccaf-9698-44a5-8d74-f65beb76b3d5-config-data\") pod \"f57fccaf-9698-44a5-8d74-f65beb76b3d5\" (UID: \"f57fccaf-9698-44a5-8d74-f65beb76b3d5\") " Mar 16 16:41:43 crc kubenswrapper[5120]: I0316 16:41:43.350390 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f57fccaf-9698-44a5-8d74-f65beb76b3d5-kube-api-access-rhvph" (OuterVolumeSpecName: "kube-api-access-rhvph") pod "f57fccaf-9698-44a5-8d74-f65beb76b3d5" (UID: "f57fccaf-9698-44a5-8d74-f65beb76b3d5"). InnerVolumeSpecName "kube-api-access-rhvph". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:41:43 crc kubenswrapper[5120]: I0316 16:41:43.351880 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f57fccaf-9698-44a5-8d74-f65beb76b3d5-scripts" (OuterVolumeSpecName: "scripts") pod "f57fccaf-9698-44a5-8d74-f65beb76b3d5" (UID: "f57fccaf-9698-44a5-8d74-f65beb76b3d5"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:41:43 crc kubenswrapper[5120]: I0316 16:41:43.379930 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f57fccaf-9698-44a5-8d74-f65beb76b3d5-config-data" (OuterVolumeSpecName: "config-data") pod "f57fccaf-9698-44a5-8d74-f65beb76b3d5" (UID: "f57fccaf-9698-44a5-8d74-f65beb76b3d5"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:41:43 crc kubenswrapper[5120]: I0316 16:41:43.414297 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f57fccaf-9698-44a5-8d74-f65beb76b3d5-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f57fccaf-9698-44a5-8d74-f65beb76b3d5" (UID: "f57fccaf-9698-44a5-8d74-f65beb76b3d5"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:41:43 crc kubenswrapper[5120]: I0316 16:41:43.457715 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f57fccaf-9698-44a5-8d74-f65beb76b3d5-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:41:43 crc kubenswrapper[5120]: I0316 16:41:43.457770 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f57fccaf-9698-44a5-8d74-f65beb76b3d5-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:41:43 crc kubenswrapper[5120]: I0316 16:41:43.457781 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rhvph\" (UniqueName: \"kubernetes.io/projected/f57fccaf-9698-44a5-8d74-f65beb76b3d5-kube-api-access-rhvph\") on node \"crc\" DevicePath \"\"" Mar 16 16:41:43 crc kubenswrapper[5120]: I0316 16:41:43.457789 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f57fccaf-9698-44a5-8d74-f65beb76b3d5-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:41:43 crc kubenswrapper[5120]: I0316 16:41:43.463286 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="f69f1ee9-e36c-4f59-a486-7d31a34c31a0" containerName="nova-api-api" probeResult="failure" output="Get \"http://10.217.1.88:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 16:41:43 crc kubenswrapper[5120]: I0316 16:41:43.464586 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="f69f1ee9-e36c-4f59-a486-7d31a34c31a0" containerName="nova-api-log" probeResult="failure" output="Get \"http://10.217.1.88:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 16:41:43 crc kubenswrapper[5120]: I0316 16:41:43.751885 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 16:41:43 crc kubenswrapper[5120]: W0316 16:41:43.752456 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda7128a81_4e4e_4635_b66c_f992c4b30d2a.slice/crio-e8ec7d985494e41386bd58f14a3c7f6bb5c3e70e44df8a11b90275ac6b1df56b WatchSource:0}: Error finding container e8ec7d985494e41386bd58f14a3c7f6bb5c3e70e44df8a11b90275ac6b1df56b: Status 404 returned error can't find the container with id e8ec7d985494e41386bd58f14a3c7f6bb5c3e70e44df8a11b90275ac6b1df56b Mar 16 16:41:43 crc kubenswrapper[5120]: I0316 16:41:43.784098 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-tfss2" Mar 16 16:41:43 crc kubenswrapper[5120]: I0316 16:41:43.784269 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-tfss2" event={"ID":"f57fccaf-9698-44a5-8d74-f65beb76b3d5","Type":"ContainerDied","Data":"e699dad28a078d5602aa6823cc59d4574bbd811da8667f237d328f7dc43599e4"} Mar 16 16:41:43 crc kubenswrapper[5120]: I0316 16:41:43.785565 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e699dad28a078d5602aa6823cc59d4574bbd811da8667f237d328f7dc43599e4" Mar 16 16:41:43 crc kubenswrapper[5120]: I0316 16:41:43.789066 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"a7128a81-4e4e-4635-b66c-f992c4b30d2a","Type":"ContainerStarted","Data":"e8ec7d985494e41386bd58f14a3c7f6bb5c3e70e44df8a11b90275ac6b1df56b"} Mar 16 16:41:43 crc kubenswrapper[5120]: I0316 16:41:43.934049 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:41:43 crc kubenswrapper[5120]: I0316 16:41:43.934541 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="f69f1ee9-e36c-4f59-a486-7d31a34c31a0" containerName="nova-api-log" containerID="cri-o://2762735f81a4b62d73b9c323c3eeb3a1725606775c95f72d01cc050f2003cb76" gracePeriod=30 Mar 16 16:41:43 crc kubenswrapper[5120]: I0316 16:41:43.935430 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="f69f1ee9-e36c-4f59-a486-7d31a34c31a0" containerName="nova-api-api" containerID="cri-o://6cbb8df6c682edd2048ecc623a0c4785b3406a7d9b03be5805040f4d5fa8a2ad" gracePeriod=30 Mar 16 16:41:43 crc kubenswrapper[5120]: I0316 16:41:43.956441 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:41:43 crc kubenswrapper[5120]: I0316 16:41:43.965594 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:41:43 crc kubenswrapper[5120]: I0316 16:41:43.966006 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="9c7beefa-6c26-4bbe-887f-0b519648e943" containerName="nova-metadata-metadata" containerID="cri-o://78ab63780a4774254ee9851f1bc25c2e1e2ba602c3e0ba650417d531d7e6eaed" gracePeriod=30 Mar 16 16:41:43 crc kubenswrapper[5120]: I0316 16:41:43.965900 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="9c7beefa-6c26-4bbe-887f-0b519648e943" containerName="nova-metadata-log" containerID="cri-o://166f2e6f12dbcee0806a15218a41ba77bf1ae4087083f1ab4758e15d1fda8bd2" gracePeriod=30 Mar 16 16:41:44 crc kubenswrapper[5120]: I0316 16:41:44.621450 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:41:44 crc kubenswrapper[5120]: I0316 16:41:44.716167 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jznf4\" (UniqueName: \"kubernetes.io/projected/9c7beefa-6c26-4bbe-887f-0b519648e943-kube-api-access-jznf4\") pod \"9c7beefa-6c26-4bbe-887f-0b519648e943\" (UID: \"9c7beefa-6c26-4bbe-887f-0b519648e943\") " Mar 16 16:41:44 crc kubenswrapper[5120]: I0316 16:41:44.716252 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9c7beefa-6c26-4bbe-887f-0b519648e943-logs\") pod \"9c7beefa-6c26-4bbe-887f-0b519648e943\" (UID: \"9c7beefa-6c26-4bbe-887f-0b519648e943\") " Mar 16 16:41:44 crc kubenswrapper[5120]: I0316 16:41:44.716313 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/9c7beefa-6c26-4bbe-887f-0b519648e943-nova-metadata-tls-certs\") pod \"9c7beefa-6c26-4bbe-887f-0b519648e943\" (UID: \"9c7beefa-6c26-4bbe-887f-0b519648e943\") " Mar 16 16:41:44 crc kubenswrapper[5120]: I0316 16:41:44.716917 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9c7beefa-6c26-4bbe-887f-0b519648e943-config-data\") pod \"9c7beefa-6c26-4bbe-887f-0b519648e943\" (UID: \"9c7beefa-6c26-4bbe-887f-0b519648e943\") " Mar 16 16:41:44 crc kubenswrapper[5120]: I0316 16:41:44.716963 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9c7beefa-6c26-4bbe-887f-0b519648e943-combined-ca-bundle\") pod \"9c7beefa-6c26-4bbe-887f-0b519648e943\" (UID: \"9c7beefa-6c26-4bbe-887f-0b519648e943\") " Mar 16 16:41:44 crc kubenswrapper[5120]: I0316 16:41:44.717364 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c7beefa-6c26-4bbe-887f-0b519648e943-logs" (OuterVolumeSpecName: "logs") pod "9c7beefa-6c26-4bbe-887f-0b519648e943" (UID: "9c7beefa-6c26-4bbe-887f-0b519648e943"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:41:44 crc kubenswrapper[5120]: I0316 16:41:44.718007 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9c7beefa-6c26-4bbe-887f-0b519648e943-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:41:44 crc kubenswrapper[5120]: I0316 16:41:44.726219 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c7beefa-6c26-4bbe-887f-0b519648e943-kube-api-access-jznf4" (OuterVolumeSpecName: "kube-api-access-jznf4") pod "9c7beefa-6c26-4bbe-887f-0b519648e943" (UID: "9c7beefa-6c26-4bbe-887f-0b519648e943"). InnerVolumeSpecName "kube-api-access-jznf4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:41:44 crc kubenswrapper[5120]: I0316 16:41:44.767734 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9c7beefa-6c26-4bbe-887f-0b519648e943-config-data" (OuterVolumeSpecName: "config-data") pod "9c7beefa-6c26-4bbe-887f-0b519648e943" (UID: "9c7beefa-6c26-4bbe-887f-0b519648e943"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:41:44 crc kubenswrapper[5120]: I0316 16:41:44.802877 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9c7beefa-6c26-4bbe-887f-0b519648e943-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "9c7beefa-6c26-4bbe-887f-0b519648e943" (UID: "9c7beefa-6c26-4bbe-887f-0b519648e943"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:41:44 crc kubenswrapper[5120]: I0316 16:41:44.802896 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9c7beefa-6c26-4bbe-887f-0b519648e943-nova-metadata-tls-certs" (OuterVolumeSpecName: "nova-metadata-tls-certs") pod "9c7beefa-6c26-4bbe-887f-0b519648e943" (UID: "9c7beefa-6c26-4bbe-887f-0b519648e943"). InnerVolumeSpecName "nova-metadata-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:41:44 crc kubenswrapper[5120]: I0316 16:41:44.809676 5120 generic.go:358] "Generic (PLEG): container finished" podID="9c7beefa-6c26-4bbe-887f-0b519648e943" containerID="78ab63780a4774254ee9851f1bc25c2e1e2ba602c3e0ba650417d531d7e6eaed" exitCode=0 Mar 16 16:41:44 crc kubenswrapper[5120]: I0316 16:41:44.809905 5120 generic.go:358] "Generic (PLEG): container finished" podID="9c7beefa-6c26-4bbe-887f-0b519648e943" containerID="166f2e6f12dbcee0806a15218a41ba77bf1ae4087083f1ab4758e15d1fda8bd2" exitCode=143 Mar 16 16:41:44 crc kubenswrapper[5120]: I0316 16:41:44.810133 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"9c7beefa-6c26-4bbe-887f-0b519648e943","Type":"ContainerDied","Data":"78ab63780a4774254ee9851f1bc25c2e1e2ba602c3e0ba650417d531d7e6eaed"} Mar 16 16:41:44 crc kubenswrapper[5120]: I0316 16:41:44.810232 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"9c7beefa-6c26-4bbe-887f-0b519648e943","Type":"ContainerDied","Data":"166f2e6f12dbcee0806a15218a41ba77bf1ae4087083f1ab4758e15d1fda8bd2"} Mar 16 16:41:44 crc kubenswrapper[5120]: I0316 16:41:44.810307 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"9c7beefa-6c26-4bbe-887f-0b519648e943","Type":"ContainerDied","Data":"03266151c1af9bdb361e4dbe2dde6c956d6053bfbd4fc2e7edc550ac5ac40684"} Mar 16 16:41:44 crc kubenswrapper[5120]: I0316 16:41:44.810390 5120 scope.go:117] "RemoveContainer" containerID="78ab63780a4774254ee9851f1bc25c2e1e2ba602c3e0ba650417d531d7e6eaed" Mar 16 16:41:44 crc kubenswrapper[5120]: I0316 16:41:44.810603 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:41:44 crc kubenswrapper[5120]: I0316 16:41:44.813590 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"a7128a81-4e4e-4635-b66c-f992c4b30d2a","Type":"ContainerStarted","Data":"39b19d47df4280da111038dcf617135fe59f13c47f76f5f5da32391a2bd60988"} Mar 16 16:41:44 crc kubenswrapper[5120]: I0316 16:41:44.814441 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:41:44 crc kubenswrapper[5120]: I0316 16:41:44.820489 5120 reconciler_common.go:299] "Volume detached for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/9c7beefa-6c26-4bbe-887f-0b519648e943-nova-metadata-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:41:44 crc kubenswrapper[5120]: I0316 16:41:44.820530 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9c7beefa-6c26-4bbe-887f-0b519648e943-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:41:44 crc kubenswrapper[5120]: I0316 16:41:44.820547 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9c7beefa-6c26-4bbe-887f-0b519648e943-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:41:44 crc kubenswrapper[5120]: I0316 16:41:44.820559 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jznf4\" (UniqueName: \"kubernetes.io/projected/9c7beefa-6c26-4bbe-887f-0b519648e943-kube-api-access-jznf4\") on node \"crc\" DevicePath \"\"" Mar 16 16:41:44 crc kubenswrapper[5120]: I0316 16:41:44.821235 5120 generic.go:358] "Generic (PLEG): container finished" podID="f69f1ee9-e36c-4f59-a486-7d31a34c31a0" containerID="2762735f81a4b62d73b9c323c3eeb3a1725606775c95f72d01cc050f2003cb76" exitCode=143 Mar 16 16:41:44 crc kubenswrapper[5120]: I0316 16:41:44.821839 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"f69f1ee9-e36c-4f59-a486-7d31a34c31a0","Type":"ContainerDied","Data":"2762735f81a4b62d73b9c323c3eeb3a1725606775c95f72d01cc050f2003cb76"} Mar 16 16:41:44 crc kubenswrapper[5120]: I0316 16:41:44.824009 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="15f1d0a1-892a-4460-914e-54cbd7a1b281" containerName="nova-scheduler-scheduler" containerID="cri-o://d22e1935a9e94b643e14e9ab75abdc6b4f49c7756c01c666fd1aecf6748cb781" gracePeriod=30 Mar 16 16:41:44 crc kubenswrapper[5120]: I0316 16:41:44.838948 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podStartSLOduration=2.838931524 podStartE2EDuration="2.838931524s" podCreationTimestamp="2026-03-16 16:41:42 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:41:44.82992687 +0000 UTC m=+4206.983858547" watchObservedRunningTime="2026-03-16 16:41:44.838931524 +0000 UTC m=+4206.992863181" Mar 16 16:41:44 crc kubenswrapper[5120]: I0316 16:41:44.847916 5120 scope.go:117] "RemoveContainer" containerID="166f2e6f12dbcee0806a15218a41ba77bf1ae4087083f1ab4758e15d1fda8bd2" Mar 16 16:41:44 crc kubenswrapper[5120]: I0316 16:41:44.862886 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:41:44 crc kubenswrapper[5120]: I0316 16:41:44.883957 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:41:44 crc kubenswrapper[5120]: I0316 16:41:44.891952 5120 scope.go:117] "RemoveContainer" containerID="78ab63780a4774254ee9851f1bc25c2e1e2ba602c3e0ba650417d531d7e6eaed" Mar 16 16:41:44 crc kubenswrapper[5120]: E0316 16:41:44.895934 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"78ab63780a4774254ee9851f1bc25c2e1e2ba602c3e0ba650417d531d7e6eaed\": container with ID starting with 78ab63780a4774254ee9851f1bc25c2e1e2ba602c3e0ba650417d531d7e6eaed not found: ID does not exist" containerID="78ab63780a4774254ee9851f1bc25c2e1e2ba602c3e0ba650417d531d7e6eaed" Mar 16 16:41:44 crc kubenswrapper[5120]: I0316 16:41:44.895991 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78ab63780a4774254ee9851f1bc25c2e1e2ba602c3e0ba650417d531d7e6eaed"} err="failed to get container status \"78ab63780a4774254ee9851f1bc25c2e1e2ba602c3e0ba650417d531d7e6eaed\": rpc error: code = NotFound desc = could not find container \"78ab63780a4774254ee9851f1bc25c2e1e2ba602c3e0ba650417d531d7e6eaed\": container with ID starting with 78ab63780a4774254ee9851f1bc25c2e1e2ba602c3e0ba650417d531d7e6eaed not found: ID does not exist" Mar 16 16:41:44 crc kubenswrapper[5120]: I0316 16:41:44.896024 5120 scope.go:117] "RemoveContainer" containerID="166f2e6f12dbcee0806a15218a41ba77bf1ae4087083f1ab4758e15d1fda8bd2" Mar 16 16:41:44 crc kubenswrapper[5120]: I0316 16:41:44.896885 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:41:44 crc kubenswrapper[5120]: E0316 16:41:44.896933 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"166f2e6f12dbcee0806a15218a41ba77bf1ae4087083f1ab4758e15d1fda8bd2\": container with ID starting with 166f2e6f12dbcee0806a15218a41ba77bf1ae4087083f1ab4758e15d1fda8bd2 not found: ID does not exist" containerID="166f2e6f12dbcee0806a15218a41ba77bf1ae4087083f1ab4758e15d1fda8bd2" Mar 16 16:41:44 crc kubenswrapper[5120]: I0316 16:41:44.896962 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"166f2e6f12dbcee0806a15218a41ba77bf1ae4087083f1ab4758e15d1fda8bd2"} err="failed to get container status \"166f2e6f12dbcee0806a15218a41ba77bf1ae4087083f1ab4758e15d1fda8bd2\": rpc error: code = NotFound desc = could not find container \"166f2e6f12dbcee0806a15218a41ba77bf1ae4087083f1ab4758e15d1fda8bd2\": container with ID starting with 166f2e6f12dbcee0806a15218a41ba77bf1ae4087083f1ab4758e15d1fda8bd2 not found: ID does not exist" Mar 16 16:41:44 crc kubenswrapper[5120]: I0316 16:41:44.896978 5120 scope.go:117] "RemoveContainer" containerID="78ab63780a4774254ee9851f1bc25c2e1e2ba602c3e0ba650417d531d7e6eaed" Mar 16 16:41:44 crc kubenswrapper[5120]: I0316 16:41:44.898066 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f57fccaf-9698-44a5-8d74-f65beb76b3d5" containerName="nova-manage" Mar 16 16:41:44 crc kubenswrapper[5120]: I0316 16:41:44.898090 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f57fccaf-9698-44a5-8d74-f65beb76b3d5" containerName="nova-manage" Mar 16 16:41:44 crc kubenswrapper[5120]: I0316 16:41:44.898131 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c7beefa-6c26-4bbe-887f-0b519648e943" containerName="nova-metadata-log" Mar 16 16:41:44 crc kubenswrapper[5120]: I0316 16:41:44.898138 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c7beefa-6c26-4bbe-887f-0b519648e943" containerName="nova-metadata-log" Mar 16 16:41:44 crc kubenswrapper[5120]: I0316 16:41:44.898155 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c7beefa-6c26-4bbe-887f-0b519648e943" containerName="nova-metadata-metadata" Mar 16 16:41:44 crc kubenswrapper[5120]: I0316 16:41:44.898161 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c7beefa-6c26-4bbe-887f-0b519648e943" containerName="nova-metadata-metadata" Mar 16 16:41:44 crc kubenswrapper[5120]: I0316 16:41:44.898367 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="9c7beefa-6c26-4bbe-887f-0b519648e943" containerName="nova-metadata-log" Mar 16 16:41:44 crc kubenswrapper[5120]: I0316 16:41:44.898398 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="9c7beefa-6c26-4bbe-887f-0b519648e943" containerName="nova-metadata-metadata" Mar 16 16:41:44 crc kubenswrapper[5120]: I0316 16:41:44.898411 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f57fccaf-9698-44a5-8d74-f65beb76b3d5" containerName="nova-manage" Mar 16 16:41:44 crc kubenswrapper[5120]: I0316 16:41:44.900942 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78ab63780a4774254ee9851f1bc25c2e1e2ba602c3e0ba650417d531d7e6eaed"} err="failed to get container status \"78ab63780a4774254ee9851f1bc25c2e1e2ba602c3e0ba650417d531d7e6eaed\": rpc error: code = NotFound desc = could not find container \"78ab63780a4774254ee9851f1bc25c2e1e2ba602c3e0ba650417d531d7e6eaed\": container with ID starting with 78ab63780a4774254ee9851f1bc25c2e1e2ba602c3e0ba650417d531d7e6eaed not found: ID does not exist" Mar 16 16:41:44 crc kubenswrapper[5120]: I0316 16:41:44.900991 5120 scope.go:117] "RemoveContainer" containerID="166f2e6f12dbcee0806a15218a41ba77bf1ae4087083f1ab4758e15d1fda8bd2" Mar 16 16:41:44 crc kubenswrapper[5120]: I0316 16:41:44.903073 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"166f2e6f12dbcee0806a15218a41ba77bf1ae4087083f1ab4758e15d1fda8bd2"} err="failed to get container status \"166f2e6f12dbcee0806a15218a41ba77bf1ae4087083f1ab4758e15d1fda8bd2\": rpc error: code = NotFound desc = could not find container \"166f2e6f12dbcee0806a15218a41ba77bf1ae4087083f1ab4758e15d1fda8bd2\": container with ID starting with 166f2e6f12dbcee0806a15218a41ba77bf1ae4087083f1ab4758e15d1fda8bd2 not found: ID does not exist" Mar 16 16:41:44 crc kubenswrapper[5120]: I0316 16:41:44.915138 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:41:44 crc kubenswrapper[5120]: I0316 16:41:44.915314 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:41:44 crc kubenswrapper[5120]: I0316 16:41:44.921273 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-metadata-internal-svc\"" Mar 16 16:41:44 crc kubenswrapper[5120]: I0316 16:41:44.921310 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-metadata-config-data\"" Mar 16 16:41:45 crc kubenswrapper[5120]: I0316 16:41:45.025812 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f5e0b05c-87b8-4e48-af1b-c1b085931771-config-data\") pod \"nova-metadata-0\" (UID: \"f5e0b05c-87b8-4e48-af1b-c1b085931771\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:41:45 crc kubenswrapper[5120]: I0316 16:41:45.025867 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfpb7\" (UniqueName: \"kubernetes.io/projected/f5e0b05c-87b8-4e48-af1b-c1b085931771-kube-api-access-sfpb7\") pod \"nova-metadata-0\" (UID: \"f5e0b05c-87b8-4e48-af1b-c1b085931771\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:41:45 crc kubenswrapper[5120]: I0316 16:41:45.026350 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f5e0b05c-87b8-4e48-af1b-c1b085931771-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"f5e0b05c-87b8-4e48-af1b-c1b085931771\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:41:45 crc kubenswrapper[5120]: I0316 16:41:45.026412 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/f5e0b05c-87b8-4e48-af1b-c1b085931771-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"f5e0b05c-87b8-4e48-af1b-c1b085931771\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:41:45 crc kubenswrapper[5120]: I0316 16:41:45.026441 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f5e0b05c-87b8-4e48-af1b-c1b085931771-logs\") pod \"nova-metadata-0\" (UID: \"f5e0b05c-87b8-4e48-af1b-c1b085931771\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:41:45 crc kubenswrapper[5120]: I0316 16:41:45.128096 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f5e0b05c-87b8-4e48-af1b-c1b085931771-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"f5e0b05c-87b8-4e48-af1b-c1b085931771\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:41:45 crc kubenswrapper[5120]: I0316 16:41:45.128173 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/f5e0b05c-87b8-4e48-af1b-c1b085931771-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"f5e0b05c-87b8-4e48-af1b-c1b085931771\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:41:45 crc kubenswrapper[5120]: I0316 16:41:45.128196 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f5e0b05c-87b8-4e48-af1b-c1b085931771-logs\") pod \"nova-metadata-0\" (UID: \"f5e0b05c-87b8-4e48-af1b-c1b085931771\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:41:45 crc kubenswrapper[5120]: I0316 16:41:45.128338 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f5e0b05c-87b8-4e48-af1b-c1b085931771-config-data\") pod \"nova-metadata-0\" (UID: \"f5e0b05c-87b8-4e48-af1b-c1b085931771\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:41:45 crc kubenswrapper[5120]: I0316 16:41:45.128366 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sfpb7\" (UniqueName: \"kubernetes.io/projected/f5e0b05c-87b8-4e48-af1b-c1b085931771-kube-api-access-sfpb7\") pod \"nova-metadata-0\" (UID: \"f5e0b05c-87b8-4e48-af1b-c1b085931771\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:41:45 crc kubenswrapper[5120]: I0316 16:41:45.129812 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f5e0b05c-87b8-4e48-af1b-c1b085931771-logs\") pod \"nova-metadata-0\" (UID: \"f5e0b05c-87b8-4e48-af1b-c1b085931771\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:41:45 crc kubenswrapper[5120]: I0316 16:41:45.135470 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f5e0b05c-87b8-4e48-af1b-c1b085931771-config-data\") pod \"nova-metadata-0\" (UID: \"f5e0b05c-87b8-4e48-af1b-c1b085931771\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:41:45 crc kubenswrapper[5120]: I0316 16:41:45.135565 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f5e0b05c-87b8-4e48-af1b-c1b085931771-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"f5e0b05c-87b8-4e48-af1b-c1b085931771\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:41:45 crc kubenswrapper[5120]: I0316 16:41:45.135998 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/f5e0b05c-87b8-4e48-af1b-c1b085931771-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"f5e0b05c-87b8-4e48-af1b-c1b085931771\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:41:45 crc kubenswrapper[5120]: I0316 16:41:45.146122 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfpb7\" (UniqueName: \"kubernetes.io/projected/f5e0b05c-87b8-4e48-af1b-c1b085931771-kube-api-access-sfpb7\") pod \"nova-metadata-0\" (UID: \"f5e0b05c-87b8-4e48-af1b-c1b085931771\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:41:45 crc kubenswrapper[5120]: I0316 16:41:45.244270 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:41:45 crc kubenswrapper[5120]: I0316 16:41:45.538875 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-v822j_ac55471d-4e42-475f-a082-50f611571482/kube-multus/0.log" Mar 16 16:41:45 crc kubenswrapper[5120]: I0316 16:41:45.539032 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-v822j_ac55471d-4e42-475f-a082-50f611571482/kube-multus/0.log" Mar 16 16:41:45 crc kubenswrapper[5120]: I0316 16:41:45.543805 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-crc_9f0bc7fcb0822a2c13eb2d22cd8c0641/kube-controller-manager/0.log" Mar 16 16:41:45 crc kubenswrapper[5120]: I0316 16:41:45.543984 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-crc_9f0bc7fcb0822a2c13eb2d22cd8c0641/kube-controller-manager/0.log" Mar 16 16:41:45 crc kubenswrapper[5120]: I0316 16:41:45.747292 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:41:45 crc kubenswrapper[5120]: I0316 16:41:45.833830 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"f5e0b05c-87b8-4e48-af1b-c1b085931771","Type":"ContainerStarted","Data":"eab7ca774b5e2bec35c8112c82a2184e5710b9aa26b914e041fa8f8b14a09db6"} Mar 16 16:41:46 crc kubenswrapper[5120]: I0316 16:41:46.366835 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/ceilometer-0" podUID="a95d8c72-85c3-4c4a-a965-f4e6fd841cd5" containerName="proxy-httpd" probeResult="failure" output="HTTP probe failed with statuscode: 503" Mar 16 16:41:46 crc kubenswrapper[5120]: I0316 16:41:46.675871 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c7beefa-6c26-4bbe-887f-0b519648e943" path="/var/lib/kubelet/pods/9c7beefa-6c26-4bbe-887f-0b519648e943/volumes" Mar 16 16:41:46 crc kubenswrapper[5120]: I0316 16:41:46.827671 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:41:46 crc kubenswrapper[5120]: I0316 16:41:46.849021 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"f5e0b05c-87b8-4e48-af1b-c1b085931771","Type":"ContainerStarted","Data":"c517d17a66c9546d5c9e055c8b08325792648b855e10d41b87355dfe311dc1bf"} Mar 16 16:41:46 crc kubenswrapper[5120]: I0316 16:41:46.849084 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"f5e0b05c-87b8-4e48-af1b-c1b085931771","Type":"ContainerStarted","Data":"cfda5070bc4948a60c92b604836cf8650938989c14a6d7828f0266ba58464074"} Mar 16 16:41:46 crc kubenswrapper[5120]: I0316 16:41:46.852421 5120 generic.go:358] "Generic (PLEG): container finished" podID="a95d8c72-85c3-4c4a-a965-f4e6fd841cd5" containerID="b5334349a58ba4f50717e5f132b50375086194010cf0e1722830f63c31c7c109" exitCode=137 Mar 16 16:41:46 crc kubenswrapper[5120]: I0316 16:41:46.852515 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a95d8c72-85c3-4c4a-a965-f4e6fd841cd5","Type":"ContainerDied","Data":"b5334349a58ba4f50717e5f132b50375086194010cf0e1722830f63c31c7c109"} Mar 16 16:41:46 crc kubenswrapper[5120]: I0316 16:41:46.852563 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a95d8c72-85c3-4c4a-a965-f4e6fd841cd5","Type":"ContainerDied","Data":"75e1e05a0985252af7a5beada5c1084f9b3a177fbd770ae9be696cc64bcdee0d"} Mar 16 16:41:46 crc kubenswrapper[5120]: I0316 16:41:46.852580 5120 scope.go:117] "RemoveContainer" containerID="b5334349a58ba4f50717e5f132b50375086194010cf0e1722830f63c31c7c109" Mar 16 16:41:46 crc kubenswrapper[5120]: I0316 16:41:46.852533 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:41:46 crc kubenswrapper[5120]: I0316 16:41:46.875196 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a95d8c72-85c3-4c4a-a965-f4e6fd841cd5-combined-ca-bundle\") pod \"a95d8c72-85c3-4c4a-a965-f4e6fd841cd5\" (UID: \"a95d8c72-85c3-4c4a-a965-f4e6fd841cd5\") " Mar 16 16:41:46 crc kubenswrapper[5120]: I0316 16:41:46.875344 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/a95d8c72-85c3-4c4a-a965-f4e6fd841cd5-ceilometer-tls-certs\") pod \"a95d8c72-85c3-4c4a-a965-f4e6fd841cd5\" (UID: \"a95d8c72-85c3-4c4a-a965-f4e6fd841cd5\") " Mar 16 16:41:46 crc kubenswrapper[5120]: I0316 16:41:46.875475 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/a95d8c72-85c3-4c4a-a965-f4e6fd841cd5-sg-core-conf-yaml\") pod \"a95d8c72-85c3-4c4a-a965-f4e6fd841cd5\" (UID: \"a95d8c72-85c3-4c4a-a965-f4e6fd841cd5\") " Mar 16 16:41:46 crc kubenswrapper[5120]: I0316 16:41:46.875625 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-llrd5\" (UniqueName: \"kubernetes.io/projected/a95d8c72-85c3-4c4a-a965-f4e6fd841cd5-kube-api-access-llrd5\") pod \"a95d8c72-85c3-4c4a-a965-f4e6fd841cd5\" (UID: \"a95d8c72-85c3-4c4a-a965-f4e6fd841cd5\") " Mar 16 16:41:46 crc kubenswrapper[5120]: I0316 16:41:46.875740 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a95d8c72-85c3-4c4a-a965-f4e6fd841cd5-scripts\") pod \"a95d8c72-85c3-4c4a-a965-f4e6fd841cd5\" (UID: \"a95d8c72-85c3-4c4a-a965-f4e6fd841cd5\") " Mar 16 16:41:46 crc kubenswrapper[5120]: I0316 16:41:46.875851 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a95d8c72-85c3-4c4a-a965-f4e6fd841cd5-run-httpd\") pod \"a95d8c72-85c3-4c4a-a965-f4e6fd841cd5\" (UID: \"a95d8c72-85c3-4c4a-a965-f4e6fd841cd5\") " Mar 16 16:41:46 crc kubenswrapper[5120]: I0316 16:41:46.875886 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a95d8c72-85c3-4c4a-a965-f4e6fd841cd5-log-httpd\") pod \"a95d8c72-85c3-4c4a-a965-f4e6fd841cd5\" (UID: \"a95d8c72-85c3-4c4a-a965-f4e6fd841cd5\") " Mar 16 16:41:46 crc kubenswrapper[5120]: I0316 16:41:46.875995 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a95d8c72-85c3-4c4a-a965-f4e6fd841cd5-config-data\") pod \"a95d8c72-85c3-4c4a-a965-f4e6fd841cd5\" (UID: \"a95d8c72-85c3-4c4a-a965-f4e6fd841cd5\") " Mar 16 16:41:46 crc kubenswrapper[5120]: I0316 16:41:46.878675 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a95d8c72-85c3-4c4a-a965-f4e6fd841cd5-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "a95d8c72-85c3-4c4a-a965-f4e6fd841cd5" (UID: "a95d8c72-85c3-4c4a-a965-f4e6fd841cd5"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:41:46 crc kubenswrapper[5120]: I0316 16:41:46.880220 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a95d8c72-85c3-4c4a-a965-f4e6fd841cd5-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "a95d8c72-85c3-4c4a-a965-f4e6fd841cd5" (UID: "a95d8c72-85c3-4c4a-a965-f4e6fd841cd5"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:41:46 crc kubenswrapper[5120]: I0316 16:41:46.882413 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=2.882388556 podStartE2EDuration="2.882388556s" podCreationTimestamp="2026-03-16 16:41:44 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:41:46.874588913 +0000 UTC m=+4209.028520570" watchObservedRunningTime="2026-03-16 16:41:46.882388556 +0000 UTC m=+4209.036320213" Mar 16 16:41:46 crc kubenswrapper[5120]: I0316 16:41:46.883071 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a95d8c72-85c3-4c4a-a965-f4e6fd841cd5-scripts" (OuterVolumeSpecName: "scripts") pod "a95d8c72-85c3-4c4a-a965-f4e6fd841cd5" (UID: "a95d8c72-85c3-4c4a-a965-f4e6fd841cd5"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:41:46 crc kubenswrapper[5120]: I0316 16:41:46.886219 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a95d8c72-85c3-4c4a-a965-f4e6fd841cd5-kube-api-access-llrd5" (OuterVolumeSpecName: "kube-api-access-llrd5") pod "a95d8c72-85c3-4c4a-a965-f4e6fd841cd5" (UID: "a95d8c72-85c3-4c4a-a965-f4e6fd841cd5"). InnerVolumeSpecName "kube-api-access-llrd5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:41:46 crc kubenswrapper[5120]: I0316 16:41:46.911942 5120 scope.go:117] "RemoveContainer" containerID="d0afd69bcb36066d95f9651f8f688ea1a57b5e911f84f357e39030116c95863c" Mar 16 16:41:46 crc kubenswrapper[5120]: I0316 16:41:46.945424 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a95d8c72-85c3-4c4a-a965-f4e6fd841cd5-ceilometer-tls-certs" (OuterVolumeSpecName: "ceilometer-tls-certs") pod "a95d8c72-85c3-4c4a-a965-f4e6fd841cd5" (UID: "a95d8c72-85c3-4c4a-a965-f4e6fd841cd5"). InnerVolumeSpecName "ceilometer-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:41:46 crc kubenswrapper[5120]: I0316 16:41:46.946238 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a95d8c72-85c3-4c4a-a965-f4e6fd841cd5-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "a95d8c72-85c3-4c4a-a965-f4e6fd841cd5" (UID: "a95d8c72-85c3-4c4a-a965-f4e6fd841cd5"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:41:46 crc kubenswrapper[5120]: I0316 16:41:46.956050 5120 scope.go:117] "RemoveContainer" containerID="7f920cb75298cc2b7167665f15c6ad223e697cfd6419efafabc7e8816e9b15d3" Mar 16 16:41:46 crc kubenswrapper[5120]: I0316 16:41:46.979201 5120 reconciler_common.go:299] "Volume detached for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/a95d8c72-85c3-4c4a-a965-f4e6fd841cd5-ceilometer-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:41:46 crc kubenswrapper[5120]: I0316 16:41:46.979236 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/a95d8c72-85c3-4c4a-a965-f4e6fd841cd5-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 16:41:46 crc kubenswrapper[5120]: I0316 16:41:46.979246 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-llrd5\" (UniqueName: \"kubernetes.io/projected/a95d8c72-85c3-4c4a-a965-f4e6fd841cd5-kube-api-access-llrd5\") on node \"crc\" DevicePath \"\"" Mar 16 16:41:46 crc kubenswrapper[5120]: I0316 16:41:46.979255 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a95d8c72-85c3-4c4a-a965-f4e6fd841cd5-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:41:46 crc kubenswrapper[5120]: I0316 16:41:46.979302 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a95d8c72-85c3-4c4a-a965-f4e6fd841cd5-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:41:46 crc kubenswrapper[5120]: I0316 16:41:46.979311 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a95d8c72-85c3-4c4a-a965-f4e6fd841cd5-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:41:46 crc kubenswrapper[5120]: I0316 16:41:46.981192 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a95d8c72-85c3-4c4a-a965-f4e6fd841cd5-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "a95d8c72-85c3-4c4a-a965-f4e6fd841cd5" (UID: "a95d8c72-85c3-4c4a-a965-f4e6fd841cd5"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:41:46 crc kubenswrapper[5120]: I0316 16:41:46.982058 5120 scope.go:117] "RemoveContainer" containerID="9e1ff79180c97a23a6b5f24fd614151f8ef812d0b2957675d76e8ed8f7506cbc" Mar 16 16:41:47 crc kubenswrapper[5120]: I0316 16:41:47.003773 5120 scope.go:117] "RemoveContainer" containerID="b5334349a58ba4f50717e5f132b50375086194010cf0e1722830f63c31c7c109" Mar 16 16:41:47 crc kubenswrapper[5120]: I0316 16:41:47.003995 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a95d8c72-85c3-4c4a-a965-f4e6fd841cd5-config-data" (OuterVolumeSpecName: "config-data") pod "a95d8c72-85c3-4c4a-a965-f4e6fd841cd5" (UID: "a95d8c72-85c3-4c4a-a965-f4e6fd841cd5"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:41:47 crc kubenswrapper[5120]: E0316 16:41:47.004149 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b5334349a58ba4f50717e5f132b50375086194010cf0e1722830f63c31c7c109\": container with ID starting with b5334349a58ba4f50717e5f132b50375086194010cf0e1722830f63c31c7c109 not found: ID does not exist" containerID="b5334349a58ba4f50717e5f132b50375086194010cf0e1722830f63c31c7c109" Mar 16 16:41:47 crc kubenswrapper[5120]: I0316 16:41:47.004204 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5334349a58ba4f50717e5f132b50375086194010cf0e1722830f63c31c7c109"} err="failed to get container status \"b5334349a58ba4f50717e5f132b50375086194010cf0e1722830f63c31c7c109\": rpc error: code = NotFound desc = could not find container \"b5334349a58ba4f50717e5f132b50375086194010cf0e1722830f63c31c7c109\": container with ID starting with b5334349a58ba4f50717e5f132b50375086194010cf0e1722830f63c31c7c109 not found: ID does not exist" Mar 16 16:41:47 crc kubenswrapper[5120]: I0316 16:41:47.004235 5120 scope.go:117] "RemoveContainer" containerID="d0afd69bcb36066d95f9651f8f688ea1a57b5e911f84f357e39030116c95863c" Mar 16 16:41:47 crc kubenswrapper[5120]: E0316 16:41:47.004521 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d0afd69bcb36066d95f9651f8f688ea1a57b5e911f84f357e39030116c95863c\": container with ID starting with d0afd69bcb36066d95f9651f8f688ea1a57b5e911f84f357e39030116c95863c not found: ID does not exist" containerID="d0afd69bcb36066d95f9651f8f688ea1a57b5e911f84f357e39030116c95863c" Mar 16 16:41:47 crc kubenswrapper[5120]: I0316 16:41:47.004567 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0afd69bcb36066d95f9651f8f688ea1a57b5e911f84f357e39030116c95863c"} err="failed to get container status \"d0afd69bcb36066d95f9651f8f688ea1a57b5e911f84f357e39030116c95863c\": rpc error: code = NotFound desc = could not find container \"d0afd69bcb36066d95f9651f8f688ea1a57b5e911f84f357e39030116c95863c\": container with ID starting with d0afd69bcb36066d95f9651f8f688ea1a57b5e911f84f357e39030116c95863c not found: ID does not exist" Mar 16 16:41:47 crc kubenswrapper[5120]: I0316 16:41:47.004591 5120 scope.go:117] "RemoveContainer" containerID="7f920cb75298cc2b7167665f15c6ad223e697cfd6419efafabc7e8816e9b15d3" Mar 16 16:41:47 crc kubenswrapper[5120]: E0316 16:41:47.004922 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f920cb75298cc2b7167665f15c6ad223e697cfd6419efafabc7e8816e9b15d3\": container with ID starting with 7f920cb75298cc2b7167665f15c6ad223e697cfd6419efafabc7e8816e9b15d3 not found: ID does not exist" containerID="7f920cb75298cc2b7167665f15c6ad223e697cfd6419efafabc7e8816e9b15d3" Mar 16 16:41:47 crc kubenswrapper[5120]: I0316 16:41:47.004955 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f920cb75298cc2b7167665f15c6ad223e697cfd6419efafabc7e8816e9b15d3"} err="failed to get container status \"7f920cb75298cc2b7167665f15c6ad223e697cfd6419efafabc7e8816e9b15d3\": rpc error: code = NotFound desc = could not find container \"7f920cb75298cc2b7167665f15c6ad223e697cfd6419efafabc7e8816e9b15d3\": container with ID starting with 7f920cb75298cc2b7167665f15c6ad223e697cfd6419efafabc7e8816e9b15d3 not found: ID does not exist" Mar 16 16:41:47 crc kubenswrapper[5120]: I0316 16:41:47.004976 5120 scope.go:117] "RemoveContainer" containerID="9e1ff79180c97a23a6b5f24fd614151f8ef812d0b2957675d76e8ed8f7506cbc" Mar 16 16:41:47 crc kubenswrapper[5120]: E0316 16:41:47.005244 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9e1ff79180c97a23a6b5f24fd614151f8ef812d0b2957675d76e8ed8f7506cbc\": container with ID starting with 9e1ff79180c97a23a6b5f24fd614151f8ef812d0b2957675d76e8ed8f7506cbc not found: ID does not exist" containerID="9e1ff79180c97a23a6b5f24fd614151f8ef812d0b2957675d76e8ed8f7506cbc" Mar 16 16:41:47 crc kubenswrapper[5120]: I0316 16:41:47.005388 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e1ff79180c97a23a6b5f24fd614151f8ef812d0b2957675d76e8ed8f7506cbc"} err="failed to get container status \"9e1ff79180c97a23a6b5f24fd614151f8ef812d0b2957675d76e8ed8f7506cbc\": rpc error: code = NotFound desc = could not find container \"9e1ff79180c97a23a6b5f24fd614151f8ef812d0b2957675d76e8ed8f7506cbc\": container with ID starting with 9e1ff79180c97a23a6b5f24fd614151f8ef812d0b2957675d76e8ed8f7506cbc not found: ID does not exist" Mar 16 16:41:47 crc kubenswrapper[5120]: I0316 16:41:47.082086 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a95d8c72-85c3-4c4a-a965-f4e6fd841cd5-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:41:47 crc kubenswrapper[5120]: I0316 16:41:47.082331 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a95d8c72-85c3-4c4a-a965-f4e6fd841cd5-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:41:47 crc kubenswrapper[5120]: I0316 16:41:47.206892 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:41:47 crc kubenswrapper[5120]: I0316 16:41:47.221959 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:41:47 crc kubenswrapper[5120]: I0316 16:41:47.239453 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:41:47 crc kubenswrapper[5120]: I0316 16:41:47.240496 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a95d8c72-85c3-4c4a-a965-f4e6fd841cd5" containerName="proxy-httpd" Mar 16 16:41:47 crc kubenswrapper[5120]: I0316 16:41:47.240517 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a95d8c72-85c3-4c4a-a965-f4e6fd841cd5" containerName="proxy-httpd" Mar 16 16:41:47 crc kubenswrapper[5120]: I0316 16:41:47.240563 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a95d8c72-85c3-4c4a-a965-f4e6fd841cd5" containerName="ceilometer-central-agent" Mar 16 16:41:47 crc kubenswrapper[5120]: I0316 16:41:47.240570 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a95d8c72-85c3-4c4a-a965-f4e6fd841cd5" containerName="ceilometer-central-agent" Mar 16 16:41:47 crc kubenswrapper[5120]: I0316 16:41:47.240583 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a95d8c72-85c3-4c4a-a965-f4e6fd841cd5" containerName="ceilometer-notification-agent" Mar 16 16:41:47 crc kubenswrapper[5120]: I0316 16:41:47.240589 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a95d8c72-85c3-4c4a-a965-f4e6fd841cd5" containerName="ceilometer-notification-agent" Mar 16 16:41:47 crc kubenswrapper[5120]: I0316 16:41:47.240611 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a95d8c72-85c3-4c4a-a965-f4e6fd841cd5" containerName="sg-core" Mar 16 16:41:47 crc kubenswrapper[5120]: I0316 16:41:47.240616 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a95d8c72-85c3-4c4a-a965-f4e6fd841cd5" containerName="sg-core" Mar 16 16:41:47 crc kubenswrapper[5120]: I0316 16:41:47.240810 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="a95d8c72-85c3-4c4a-a965-f4e6fd841cd5" containerName="proxy-httpd" Mar 16 16:41:47 crc kubenswrapper[5120]: I0316 16:41:47.240827 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="a95d8c72-85c3-4c4a-a965-f4e6fd841cd5" containerName="ceilometer-notification-agent" Mar 16 16:41:47 crc kubenswrapper[5120]: I0316 16:41:47.240837 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="a95d8c72-85c3-4c4a-a965-f4e6fd841cd5" containerName="sg-core" Mar 16 16:41:47 crc kubenswrapper[5120]: I0316 16:41:47.240853 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="a95d8c72-85c3-4c4a-a965-f4e6fd841cd5" containerName="ceilometer-central-agent" Mar 16 16:41:47 crc kubenswrapper[5120]: I0316 16:41:47.248270 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:41:47 crc kubenswrapper[5120]: I0316 16:41:47.251083 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:41:47 crc kubenswrapper[5120]: I0316 16:41:47.254550 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 16:41:47 crc kubenswrapper[5120]: I0316 16:41:47.254713 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 16:41:47 crc kubenswrapper[5120]: I0316 16:41:47.255433 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ceilometer-internal-svc\"" Mar 16 16:41:47 crc kubenswrapper[5120]: I0316 16:41:47.389631 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-np5r5\" (UniqueName: \"kubernetes.io/projected/2062cbff-20d9-4bdb-b60f-881144c1f24f-kube-api-access-np5r5\") pod \"ceilometer-0\" (UID: \"2062cbff-20d9-4bdb-b60f-881144c1f24f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:41:47 crc kubenswrapper[5120]: I0316 16:41:47.389690 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2062cbff-20d9-4bdb-b60f-881144c1f24f-config-data\") pod \"ceilometer-0\" (UID: \"2062cbff-20d9-4bdb-b60f-881144c1f24f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:41:47 crc kubenswrapper[5120]: I0316 16:41:47.390106 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2062cbff-20d9-4bdb-b60f-881144c1f24f-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"2062cbff-20d9-4bdb-b60f-881144c1f24f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:41:47 crc kubenswrapper[5120]: I0316 16:41:47.390181 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2062cbff-20d9-4bdb-b60f-881144c1f24f-run-httpd\") pod \"ceilometer-0\" (UID: \"2062cbff-20d9-4bdb-b60f-881144c1f24f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:41:47 crc kubenswrapper[5120]: I0316 16:41:47.390301 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/2062cbff-20d9-4bdb-b60f-881144c1f24f-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"2062cbff-20d9-4bdb-b60f-881144c1f24f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:41:47 crc kubenswrapper[5120]: I0316 16:41:47.390351 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2062cbff-20d9-4bdb-b60f-881144c1f24f-scripts\") pod \"ceilometer-0\" (UID: \"2062cbff-20d9-4bdb-b60f-881144c1f24f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:41:47 crc kubenswrapper[5120]: I0316 16:41:47.390399 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/2062cbff-20d9-4bdb-b60f-881144c1f24f-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"2062cbff-20d9-4bdb-b60f-881144c1f24f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:41:47 crc kubenswrapper[5120]: I0316 16:41:47.390459 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2062cbff-20d9-4bdb-b60f-881144c1f24f-log-httpd\") pod \"ceilometer-0\" (UID: \"2062cbff-20d9-4bdb-b60f-881144c1f24f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:41:47 crc kubenswrapper[5120]: I0316 16:41:47.492058 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2062cbff-20d9-4bdb-b60f-881144c1f24f-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"2062cbff-20d9-4bdb-b60f-881144c1f24f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:41:47 crc kubenswrapper[5120]: I0316 16:41:47.492115 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2062cbff-20d9-4bdb-b60f-881144c1f24f-run-httpd\") pod \"ceilometer-0\" (UID: \"2062cbff-20d9-4bdb-b60f-881144c1f24f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:41:47 crc kubenswrapper[5120]: I0316 16:41:47.492185 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/2062cbff-20d9-4bdb-b60f-881144c1f24f-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"2062cbff-20d9-4bdb-b60f-881144c1f24f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:41:47 crc kubenswrapper[5120]: I0316 16:41:47.492585 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2062cbff-20d9-4bdb-b60f-881144c1f24f-run-httpd\") pod \"ceilometer-0\" (UID: \"2062cbff-20d9-4bdb-b60f-881144c1f24f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:41:47 crc kubenswrapper[5120]: I0316 16:41:47.492644 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2062cbff-20d9-4bdb-b60f-881144c1f24f-scripts\") pod \"ceilometer-0\" (UID: \"2062cbff-20d9-4bdb-b60f-881144c1f24f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:41:47 crc kubenswrapper[5120]: I0316 16:41:47.493031 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/2062cbff-20d9-4bdb-b60f-881144c1f24f-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"2062cbff-20d9-4bdb-b60f-881144c1f24f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:41:47 crc kubenswrapper[5120]: I0316 16:41:47.493109 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2062cbff-20d9-4bdb-b60f-881144c1f24f-log-httpd\") pod \"ceilometer-0\" (UID: \"2062cbff-20d9-4bdb-b60f-881144c1f24f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:41:47 crc kubenswrapper[5120]: I0316 16:41:47.493371 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2062cbff-20d9-4bdb-b60f-881144c1f24f-log-httpd\") pod \"ceilometer-0\" (UID: \"2062cbff-20d9-4bdb-b60f-881144c1f24f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:41:47 crc kubenswrapper[5120]: I0316 16:41:47.494128 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-np5r5\" (UniqueName: \"kubernetes.io/projected/2062cbff-20d9-4bdb-b60f-881144c1f24f-kube-api-access-np5r5\") pod \"ceilometer-0\" (UID: \"2062cbff-20d9-4bdb-b60f-881144c1f24f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:41:47 crc kubenswrapper[5120]: I0316 16:41:47.494167 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2062cbff-20d9-4bdb-b60f-881144c1f24f-config-data\") pod \"ceilometer-0\" (UID: \"2062cbff-20d9-4bdb-b60f-881144c1f24f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:41:47 crc kubenswrapper[5120]: I0316 16:41:47.499474 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2062cbff-20d9-4bdb-b60f-881144c1f24f-config-data\") pod \"ceilometer-0\" (UID: \"2062cbff-20d9-4bdb-b60f-881144c1f24f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:41:47 crc kubenswrapper[5120]: I0316 16:41:47.499888 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/2062cbff-20d9-4bdb-b60f-881144c1f24f-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"2062cbff-20d9-4bdb-b60f-881144c1f24f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:41:47 crc kubenswrapper[5120]: I0316 16:41:47.500380 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2062cbff-20d9-4bdb-b60f-881144c1f24f-scripts\") pod \"ceilometer-0\" (UID: \"2062cbff-20d9-4bdb-b60f-881144c1f24f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:41:47 crc kubenswrapper[5120]: I0316 16:41:47.506977 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2062cbff-20d9-4bdb-b60f-881144c1f24f-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"2062cbff-20d9-4bdb-b60f-881144c1f24f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:41:47 crc kubenswrapper[5120]: I0316 16:41:47.511299 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/2062cbff-20d9-4bdb-b60f-881144c1f24f-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"2062cbff-20d9-4bdb-b60f-881144c1f24f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:41:47 crc kubenswrapper[5120]: I0316 16:41:47.521113 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-np5r5\" (UniqueName: \"kubernetes.io/projected/2062cbff-20d9-4bdb-b60f-881144c1f24f-kube-api-access-np5r5\") pod \"ceilometer-0\" (UID: \"2062cbff-20d9-4bdb-b60f-881144c1f24f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:41:47 crc kubenswrapper[5120]: I0316 16:41:47.577164 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:41:47 crc kubenswrapper[5120]: E0316 16:41:47.762168 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="d22e1935a9e94b643e14e9ab75abdc6b4f49c7756c01c666fd1aecf6748cb781" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:41:47 crc kubenswrapper[5120]: E0316 16:41:47.763869 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="d22e1935a9e94b643e14e9ab75abdc6b4f49c7756c01c666fd1aecf6748cb781" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:41:47 crc kubenswrapper[5120]: E0316 16:41:47.765284 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="d22e1935a9e94b643e14e9ab75abdc6b4f49c7756c01c666fd1aecf6748cb781" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:41:47 crc kubenswrapper[5120]: E0316 16:41:47.765317 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="15f1d0a1-892a-4460-914e-54cbd7a1b281" containerName="nova-scheduler-scheduler" probeResult="unknown" Mar 16 16:41:48 crc kubenswrapper[5120]: W0316 16:41:48.014316 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2062cbff_20d9_4bdb_b60f_881144c1f24f.slice/crio-4e6c0b459e2b047a5077279157b35fe67d81e13ca2d6322bd5005bee90f68d6f WatchSource:0}: Error finding container 4e6c0b459e2b047a5077279157b35fe67d81e13ca2d6322bd5005bee90f68d6f: Status 404 returned error can't find the container with id 4e6c0b459e2b047a5077279157b35fe67d81e13ca2d6322bd5005bee90f68d6f Mar 16 16:41:48 crc kubenswrapper[5120]: I0316 16:41:48.016292 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:41:48 crc kubenswrapper[5120]: I0316 16:41:48.181518 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:41:48 crc kubenswrapper[5120]: I0316 16:41:48.198909 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:41:48 crc kubenswrapper[5120]: I0316 16:41:48.699641 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a95d8c72-85c3-4c4a-a965-f4e6fd841cd5" path="/var/lib/kubelet/pods/a95d8c72-85c3-4c4a-a965-f4e6fd841cd5/volumes" Mar 16 16:41:48 crc kubenswrapper[5120]: I0316 16:41:48.795104 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:41:48 crc kubenswrapper[5120]: I0316 16:41:48.876401 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"2062cbff-20d9-4bdb-b60f-881144c1f24f","Type":"ContainerStarted","Data":"5cb27040906683b297a4a42ef5af0a9e3aab330c2e0ee757e45576b0b978c3cc"} Mar 16 16:41:48 crc kubenswrapper[5120]: I0316 16:41:48.876444 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"2062cbff-20d9-4bdb-b60f-881144c1f24f","Type":"ContainerStarted","Data":"4e6c0b459e2b047a5077279157b35fe67d81e13ca2d6322bd5005bee90f68d6f"} Mar 16 16:41:48 crc kubenswrapper[5120]: I0316 16:41:48.879945 5120 generic.go:358] "Generic (PLEG): container finished" podID="f69f1ee9-e36c-4f59-a486-7d31a34c31a0" containerID="6cbb8df6c682edd2048ecc623a0c4785b3406a7d9b03be5805040f4d5fa8a2ad" exitCode=0 Mar 16 16:41:48 crc kubenswrapper[5120]: I0316 16:41:48.880000 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:41:48 crc kubenswrapper[5120]: I0316 16:41:48.880056 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"f69f1ee9-e36c-4f59-a486-7d31a34c31a0","Type":"ContainerDied","Data":"6cbb8df6c682edd2048ecc623a0c4785b3406a7d9b03be5805040f4d5fa8a2ad"} Mar 16 16:41:48 crc kubenswrapper[5120]: I0316 16:41:48.880092 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"f69f1ee9-e36c-4f59-a486-7d31a34c31a0","Type":"ContainerDied","Data":"caf724eec3585b590568a7b3ab1119a8a3be912ed3c012768f42338879e0b7c3"} Mar 16 16:41:48 crc kubenswrapper[5120]: I0316 16:41:48.880117 5120 scope.go:117] "RemoveContainer" containerID="6cbb8df6c682edd2048ecc623a0c4785b3406a7d9b03be5805040f4d5fa8a2ad" Mar 16 16:41:48 crc kubenswrapper[5120]: I0316 16:41:48.901671 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:41:48 crc kubenswrapper[5120]: I0316 16:41:48.910915 5120 scope.go:117] "RemoveContainer" containerID="2762735f81a4b62d73b9c323c3eeb3a1725606775c95f72d01cc050f2003cb76" Mar 16 16:41:48 crc kubenswrapper[5120]: I0316 16:41:48.953261 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f69f1ee9-e36c-4f59-a486-7d31a34c31a0-config-data\") pod \"f69f1ee9-e36c-4f59-a486-7d31a34c31a0\" (UID: \"f69f1ee9-e36c-4f59-a486-7d31a34c31a0\") " Mar 16 16:41:48 crc kubenswrapper[5120]: I0316 16:41:48.953420 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-764dv\" (UniqueName: \"kubernetes.io/projected/f69f1ee9-e36c-4f59-a486-7d31a34c31a0-kube-api-access-764dv\") pod \"f69f1ee9-e36c-4f59-a486-7d31a34c31a0\" (UID: \"f69f1ee9-e36c-4f59-a486-7d31a34c31a0\") " Mar 16 16:41:48 crc kubenswrapper[5120]: I0316 16:41:48.953845 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f69f1ee9-e36c-4f59-a486-7d31a34c31a0-logs\") pod \"f69f1ee9-e36c-4f59-a486-7d31a34c31a0\" (UID: \"f69f1ee9-e36c-4f59-a486-7d31a34c31a0\") " Mar 16 16:41:48 crc kubenswrapper[5120]: I0316 16:41:48.953880 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f69f1ee9-e36c-4f59-a486-7d31a34c31a0-combined-ca-bundle\") pod \"f69f1ee9-e36c-4f59-a486-7d31a34c31a0\" (UID: \"f69f1ee9-e36c-4f59-a486-7d31a34c31a0\") " Mar 16 16:41:48 crc kubenswrapper[5120]: I0316 16:41:48.958090 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f69f1ee9-e36c-4f59-a486-7d31a34c31a0-logs" (OuterVolumeSpecName: "logs") pod "f69f1ee9-e36c-4f59-a486-7d31a34c31a0" (UID: "f69f1ee9-e36c-4f59-a486-7d31a34c31a0"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:41:48 crc kubenswrapper[5120]: I0316 16:41:48.966943 5120 scope.go:117] "RemoveContainer" containerID="6cbb8df6c682edd2048ecc623a0c4785b3406a7d9b03be5805040f4d5fa8a2ad" Mar 16 16:41:48 crc kubenswrapper[5120]: I0316 16:41:48.967021 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f69f1ee9-e36c-4f59-a486-7d31a34c31a0-kube-api-access-764dv" (OuterVolumeSpecName: "kube-api-access-764dv") pod "f69f1ee9-e36c-4f59-a486-7d31a34c31a0" (UID: "f69f1ee9-e36c-4f59-a486-7d31a34c31a0"). InnerVolumeSpecName "kube-api-access-764dv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:41:48 crc kubenswrapper[5120]: E0316 16:41:48.971155 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6cbb8df6c682edd2048ecc623a0c4785b3406a7d9b03be5805040f4d5fa8a2ad\": container with ID starting with 6cbb8df6c682edd2048ecc623a0c4785b3406a7d9b03be5805040f4d5fa8a2ad not found: ID does not exist" containerID="6cbb8df6c682edd2048ecc623a0c4785b3406a7d9b03be5805040f4d5fa8a2ad" Mar 16 16:41:48 crc kubenswrapper[5120]: I0316 16:41:48.971206 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6cbb8df6c682edd2048ecc623a0c4785b3406a7d9b03be5805040f4d5fa8a2ad"} err="failed to get container status \"6cbb8df6c682edd2048ecc623a0c4785b3406a7d9b03be5805040f4d5fa8a2ad\": rpc error: code = NotFound desc = could not find container \"6cbb8df6c682edd2048ecc623a0c4785b3406a7d9b03be5805040f4d5fa8a2ad\": container with ID starting with 6cbb8df6c682edd2048ecc623a0c4785b3406a7d9b03be5805040f4d5fa8a2ad not found: ID does not exist" Mar 16 16:41:48 crc kubenswrapper[5120]: I0316 16:41:48.971233 5120 scope.go:117] "RemoveContainer" containerID="2762735f81a4b62d73b9c323c3eeb3a1725606775c95f72d01cc050f2003cb76" Mar 16 16:41:48 crc kubenswrapper[5120]: E0316 16:41:48.972394 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2762735f81a4b62d73b9c323c3eeb3a1725606775c95f72d01cc050f2003cb76\": container with ID starting with 2762735f81a4b62d73b9c323c3eeb3a1725606775c95f72d01cc050f2003cb76 not found: ID does not exist" containerID="2762735f81a4b62d73b9c323c3eeb3a1725606775c95f72d01cc050f2003cb76" Mar 16 16:41:48 crc kubenswrapper[5120]: I0316 16:41:48.972426 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2762735f81a4b62d73b9c323c3eeb3a1725606775c95f72d01cc050f2003cb76"} err="failed to get container status \"2762735f81a4b62d73b9c323c3eeb3a1725606775c95f72d01cc050f2003cb76\": rpc error: code = NotFound desc = could not find container \"2762735f81a4b62d73b9c323c3eeb3a1725606775c95f72d01cc050f2003cb76\": container with ID starting with 2762735f81a4b62d73b9c323c3eeb3a1725606775c95f72d01cc050f2003cb76 not found: ID does not exist" Mar 16 16:41:49 crc kubenswrapper[5120]: I0316 16:41:49.015355 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f69f1ee9-e36c-4f59-a486-7d31a34c31a0-config-data" (OuterVolumeSpecName: "config-data") pod "f69f1ee9-e36c-4f59-a486-7d31a34c31a0" (UID: "f69f1ee9-e36c-4f59-a486-7d31a34c31a0"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:41:49 crc kubenswrapper[5120]: I0316 16:41:49.036237 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f69f1ee9-e36c-4f59-a486-7d31a34c31a0-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f69f1ee9-e36c-4f59-a486-7d31a34c31a0" (UID: "f69f1ee9-e36c-4f59-a486-7d31a34c31a0"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:41:49 crc kubenswrapper[5120]: I0316 16:41:49.057067 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f69f1ee9-e36c-4f59-a486-7d31a34c31a0-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:41:49 crc kubenswrapper[5120]: I0316 16:41:49.057116 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f69f1ee9-e36c-4f59-a486-7d31a34c31a0-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:41:49 crc kubenswrapper[5120]: I0316 16:41:49.057130 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f69f1ee9-e36c-4f59-a486-7d31a34c31a0-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:41:49 crc kubenswrapper[5120]: I0316 16:41:49.057141 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-764dv\" (UniqueName: \"kubernetes.io/projected/f69f1ee9-e36c-4f59-a486-7d31a34c31a0-kube-api-access-764dv\") on node \"crc\" DevicePath \"\"" Mar 16 16:41:49 crc kubenswrapper[5120]: I0316 16:41:49.224957 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:41:49 crc kubenswrapper[5120]: I0316 16:41:49.239522 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:41:49 crc kubenswrapper[5120]: I0316 16:41:49.255117 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:41:49 crc kubenswrapper[5120]: I0316 16:41:49.256539 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f69f1ee9-e36c-4f59-a486-7d31a34c31a0" containerName="nova-api-api" Mar 16 16:41:49 crc kubenswrapper[5120]: I0316 16:41:49.256563 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f69f1ee9-e36c-4f59-a486-7d31a34c31a0" containerName="nova-api-api" Mar 16 16:41:49 crc kubenswrapper[5120]: I0316 16:41:49.256599 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f69f1ee9-e36c-4f59-a486-7d31a34c31a0" containerName="nova-api-log" Mar 16 16:41:49 crc kubenswrapper[5120]: I0316 16:41:49.256606 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f69f1ee9-e36c-4f59-a486-7d31a34c31a0" containerName="nova-api-log" Mar 16 16:41:49 crc kubenswrapper[5120]: I0316 16:41:49.256843 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f69f1ee9-e36c-4f59-a486-7d31a34c31a0" containerName="nova-api-log" Mar 16 16:41:49 crc kubenswrapper[5120]: I0316 16:41:49.256871 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f69f1ee9-e36c-4f59-a486-7d31a34c31a0" containerName="nova-api-api" Mar 16 16:41:49 crc kubenswrapper[5120]: I0316 16:41:49.267289 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:41:49 crc kubenswrapper[5120]: I0316 16:41:49.267470 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:41:49 crc kubenswrapper[5120]: I0316 16:41:49.270550 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-config-data\"" Mar 16 16:41:49 crc kubenswrapper[5120]: I0316 16:41:49.363166 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/32a29aa8-e796-4ad7-a221-a37189688d4c-logs\") pod \"nova-api-0\" (UID: \"32a29aa8-e796-4ad7-a221-a37189688d4c\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:41:49 crc kubenswrapper[5120]: I0316 16:41:49.363295 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/32a29aa8-e796-4ad7-a221-a37189688d4c-config-data\") pod \"nova-api-0\" (UID: \"32a29aa8-e796-4ad7-a221-a37189688d4c\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:41:49 crc kubenswrapper[5120]: I0316 16:41:49.363477 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxbjb\" (UniqueName: \"kubernetes.io/projected/32a29aa8-e796-4ad7-a221-a37189688d4c-kube-api-access-gxbjb\") pod \"nova-api-0\" (UID: \"32a29aa8-e796-4ad7-a221-a37189688d4c\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:41:49 crc kubenswrapper[5120]: I0316 16:41:49.364022 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/32a29aa8-e796-4ad7-a221-a37189688d4c-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"32a29aa8-e796-4ad7-a221-a37189688d4c\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:41:49 crc kubenswrapper[5120]: I0316 16:41:49.465884 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/32a29aa8-e796-4ad7-a221-a37189688d4c-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"32a29aa8-e796-4ad7-a221-a37189688d4c\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:41:49 crc kubenswrapper[5120]: I0316 16:41:49.465978 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/32a29aa8-e796-4ad7-a221-a37189688d4c-logs\") pod \"nova-api-0\" (UID: \"32a29aa8-e796-4ad7-a221-a37189688d4c\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:41:49 crc kubenswrapper[5120]: I0316 16:41:49.466018 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/32a29aa8-e796-4ad7-a221-a37189688d4c-config-data\") pod \"nova-api-0\" (UID: \"32a29aa8-e796-4ad7-a221-a37189688d4c\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:41:49 crc kubenswrapper[5120]: I0316 16:41:49.466063 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gxbjb\" (UniqueName: \"kubernetes.io/projected/32a29aa8-e796-4ad7-a221-a37189688d4c-kube-api-access-gxbjb\") pod \"nova-api-0\" (UID: \"32a29aa8-e796-4ad7-a221-a37189688d4c\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:41:49 crc kubenswrapper[5120]: I0316 16:41:49.467101 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/32a29aa8-e796-4ad7-a221-a37189688d4c-logs\") pod \"nova-api-0\" (UID: \"32a29aa8-e796-4ad7-a221-a37189688d4c\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:41:49 crc kubenswrapper[5120]: I0316 16:41:49.470400 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/32a29aa8-e796-4ad7-a221-a37189688d4c-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"32a29aa8-e796-4ad7-a221-a37189688d4c\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:41:49 crc kubenswrapper[5120]: I0316 16:41:49.470647 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/32a29aa8-e796-4ad7-a221-a37189688d4c-config-data\") pod \"nova-api-0\" (UID: \"32a29aa8-e796-4ad7-a221-a37189688d4c\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:41:49 crc kubenswrapper[5120]: I0316 16:41:49.483458 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxbjb\" (UniqueName: \"kubernetes.io/projected/32a29aa8-e796-4ad7-a221-a37189688d4c-kube-api-access-gxbjb\") pod \"nova-api-0\" (UID: \"32a29aa8-e796-4ad7-a221-a37189688d4c\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:41:49 crc kubenswrapper[5120]: I0316 16:41:49.595175 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:41:49 crc kubenswrapper[5120]: I0316 16:41:49.894249 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"2062cbff-20d9-4bdb-b60f-881144c1f24f","Type":"ContainerStarted","Data":"2d6a0c0239ca2781ec00d865e62c06c06f6aa0cd564398071e7f165ea6faafe0"} Mar 16 16:41:50 crc kubenswrapper[5120]: I0316 16:41:50.068781 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:41:50 crc kubenswrapper[5120]: I0316 16:41:50.545554 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:41:50 crc kubenswrapper[5120]: I0316 16:41:50.674482 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f69f1ee9-e36c-4f59-a486-7d31a34c31a0" path="/var/lib/kubelet/pods/f69f1ee9-e36c-4f59-a486-7d31a34c31a0/volumes" Mar 16 16:41:50 crc kubenswrapper[5120]: I0316 16:41:50.695658 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/15f1d0a1-892a-4460-914e-54cbd7a1b281-combined-ca-bundle\") pod \"15f1d0a1-892a-4460-914e-54cbd7a1b281\" (UID: \"15f1d0a1-892a-4460-914e-54cbd7a1b281\") " Mar 16 16:41:50 crc kubenswrapper[5120]: I0316 16:41:50.695740 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2nrtr\" (UniqueName: \"kubernetes.io/projected/15f1d0a1-892a-4460-914e-54cbd7a1b281-kube-api-access-2nrtr\") pod \"15f1d0a1-892a-4460-914e-54cbd7a1b281\" (UID: \"15f1d0a1-892a-4460-914e-54cbd7a1b281\") " Mar 16 16:41:50 crc kubenswrapper[5120]: I0316 16:41:50.695980 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/15f1d0a1-892a-4460-914e-54cbd7a1b281-config-data\") pod \"15f1d0a1-892a-4460-914e-54cbd7a1b281\" (UID: \"15f1d0a1-892a-4460-914e-54cbd7a1b281\") " Mar 16 16:41:50 crc kubenswrapper[5120]: I0316 16:41:50.701968 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15f1d0a1-892a-4460-914e-54cbd7a1b281-kube-api-access-2nrtr" (OuterVolumeSpecName: "kube-api-access-2nrtr") pod "15f1d0a1-892a-4460-914e-54cbd7a1b281" (UID: "15f1d0a1-892a-4460-914e-54cbd7a1b281"). InnerVolumeSpecName "kube-api-access-2nrtr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:41:50 crc kubenswrapper[5120]: I0316 16:41:50.731157 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/15f1d0a1-892a-4460-914e-54cbd7a1b281-config-data" (OuterVolumeSpecName: "config-data") pod "15f1d0a1-892a-4460-914e-54cbd7a1b281" (UID: "15f1d0a1-892a-4460-914e-54cbd7a1b281"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:41:50 crc kubenswrapper[5120]: I0316 16:41:50.731532 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/15f1d0a1-892a-4460-914e-54cbd7a1b281-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "15f1d0a1-892a-4460-914e-54cbd7a1b281" (UID: "15f1d0a1-892a-4460-914e-54cbd7a1b281"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:41:50 crc kubenswrapper[5120]: I0316 16:41:50.798128 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/15f1d0a1-892a-4460-914e-54cbd7a1b281-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:41:50 crc kubenswrapper[5120]: I0316 16:41:50.798165 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2nrtr\" (UniqueName: \"kubernetes.io/projected/15f1d0a1-892a-4460-914e-54cbd7a1b281-kube-api-access-2nrtr\") on node \"crc\" DevicePath \"\"" Mar 16 16:41:50 crc kubenswrapper[5120]: I0316 16:41:50.798176 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/15f1d0a1-892a-4460-914e-54cbd7a1b281-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:41:50 crc kubenswrapper[5120]: I0316 16:41:50.908061 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"2062cbff-20d9-4bdb-b60f-881144c1f24f","Type":"ContainerStarted","Data":"7c5e3f0e727250bf3f2a31f72787be3de45282f97b742fc57f9c89dbfbe8db24"} Mar 16 16:41:50 crc kubenswrapper[5120]: I0316 16:41:50.910502 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"32a29aa8-e796-4ad7-a221-a37189688d4c","Type":"ContainerStarted","Data":"63c355c033ad99c34f2d2fe02087f6b89a0d866723906ced0372192e6203809c"} Mar 16 16:41:50 crc kubenswrapper[5120]: I0316 16:41:50.910532 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"32a29aa8-e796-4ad7-a221-a37189688d4c","Type":"ContainerStarted","Data":"740ae4a73687633159c740d53e1fdc38ab4701f07ab235a9396b7ba617820c9d"} Mar 16 16:41:50 crc kubenswrapper[5120]: I0316 16:41:50.910540 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"32a29aa8-e796-4ad7-a221-a37189688d4c","Type":"ContainerStarted","Data":"dd57a1beed880d50baaf3fe703ebbf00b408ae4805039500796a4e8b547d52f5"} Mar 16 16:41:50 crc kubenswrapper[5120]: I0316 16:41:50.920448 5120 generic.go:358] "Generic (PLEG): container finished" podID="15f1d0a1-892a-4460-914e-54cbd7a1b281" containerID="d22e1935a9e94b643e14e9ab75abdc6b4f49c7756c01c666fd1aecf6748cb781" exitCode=0 Mar 16 16:41:50 crc kubenswrapper[5120]: I0316 16:41:50.920514 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"15f1d0a1-892a-4460-914e-54cbd7a1b281","Type":"ContainerDied","Data":"d22e1935a9e94b643e14e9ab75abdc6b4f49c7756c01c666fd1aecf6748cb781"} Mar 16 16:41:50 crc kubenswrapper[5120]: I0316 16:41:50.920534 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:41:50 crc kubenswrapper[5120]: I0316 16:41:50.920560 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"15f1d0a1-892a-4460-914e-54cbd7a1b281","Type":"ContainerDied","Data":"9d93b1656f99dd70a4e84eaadd51b8ee31c76c3b4ad4dc44e5063ab50b4340fe"} Mar 16 16:41:50 crc kubenswrapper[5120]: I0316 16:41:50.920598 5120 scope.go:117] "RemoveContainer" containerID="d22e1935a9e94b643e14e9ab75abdc6b4f49c7756c01c666fd1aecf6748cb781" Mar 16 16:41:50 crc kubenswrapper[5120]: I0316 16:41:50.958141 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=1.958118373 podStartE2EDuration="1.958118373s" podCreationTimestamp="2026-03-16 16:41:49 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:41:50.939721224 +0000 UTC m=+4213.093652881" watchObservedRunningTime="2026-03-16 16:41:50.958118373 +0000 UTC m=+4213.112050020" Mar 16 16:41:50 crc kubenswrapper[5120]: I0316 16:41:50.967245 5120 scope.go:117] "RemoveContainer" containerID="d22e1935a9e94b643e14e9ab75abdc6b4f49c7756c01c666fd1aecf6748cb781" Mar 16 16:41:50 crc kubenswrapper[5120]: E0316 16:41:50.970239 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d22e1935a9e94b643e14e9ab75abdc6b4f49c7756c01c666fd1aecf6748cb781\": container with ID starting with d22e1935a9e94b643e14e9ab75abdc6b4f49c7756c01c666fd1aecf6748cb781 not found: ID does not exist" containerID="d22e1935a9e94b643e14e9ab75abdc6b4f49c7756c01c666fd1aecf6748cb781" Mar 16 16:41:50 crc kubenswrapper[5120]: I0316 16:41:50.970684 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d22e1935a9e94b643e14e9ab75abdc6b4f49c7756c01c666fd1aecf6748cb781"} err="failed to get container status \"d22e1935a9e94b643e14e9ab75abdc6b4f49c7756c01c666fd1aecf6748cb781\": rpc error: code = NotFound desc = could not find container \"d22e1935a9e94b643e14e9ab75abdc6b4f49c7756c01c666fd1aecf6748cb781\": container with ID starting with d22e1935a9e94b643e14e9ab75abdc6b4f49c7756c01c666fd1aecf6748cb781 not found: ID does not exist" Mar 16 16:41:50 crc kubenswrapper[5120]: I0316 16:41:50.982302 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:41:50 crc kubenswrapper[5120]: I0316 16:41:50.992061 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:41:51 crc kubenswrapper[5120]: I0316 16:41:51.005278 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:41:51 crc kubenswrapper[5120]: I0316 16:41:51.007451 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15f1d0a1-892a-4460-914e-54cbd7a1b281" containerName="nova-scheduler-scheduler" Mar 16 16:41:51 crc kubenswrapper[5120]: I0316 16:41:51.007620 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="15f1d0a1-892a-4460-914e-54cbd7a1b281" containerName="nova-scheduler-scheduler" Mar 16 16:41:51 crc kubenswrapper[5120]: I0316 16:41:51.008150 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="15f1d0a1-892a-4460-914e-54cbd7a1b281" containerName="nova-scheduler-scheduler" Mar 16 16:41:51 crc kubenswrapper[5120]: I0316 16:41:51.039144 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:41:51 crc kubenswrapper[5120]: I0316 16:41:51.039380 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:41:51 crc kubenswrapper[5120]: I0316 16:41:51.041818 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-scheduler-config-data\"" Mar 16 16:41:51 crc kubenswrapper[5120]: I0316 16:41:51.104877 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqc2x\" (UniqueName: \"kubernetes.io/projected/93e6aa9d-1093-474c-821e-784d8070a6e6-kube-api-access-mqc2x\") pod \"nova-scheduler-0\" (UID: \"93e6aa9d-1093-474c-821e-784d8070a6e6\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:41:51 crc kubenswrapper[5120]: I0316 16:41:51.105072 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/93e6aa9d-1093-474c-821e-784d8070a6e6-config-data\") pod \"nova-scheduler-0\" (UID: \"93e6aa9d-1093-474c-821e-784d8070a6e6\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:41:51 crc kubenswrapper[5120]: I0316 16:41:51.105941 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/93e6aa9d-1093-474c-821e-784d8070a6e6-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"93e6aa9d-1093-474c-821e-784d8070a6e6\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:41:51 crc kubenswrapper[5120]: I0316 16:41:51.208726 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/93e6aa9d-1093-474c-821e-784d8070a6e6-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"93e6aa9d-1093-474c-821e-784d8070a6e6\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:41:51 crc kubenswrapper[5120]: I0316 16:41:51.208926 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mqc2x\" (UniqueName: \"kubernetes.io/projected/93e6aa9d-1093-474c-821e-784d8070a6e6-kube-api-access-mqc2x\") pod \"nova-scheduler-0\" (UID: \"93e6aa9d-1093-474c-821e-784d8070a6e6\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:41:51 crc kubenswrapper[5120]: I0316 16:41:51.209079 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/93e6aa9d-1093-474c-821e-784d8070a6e6-config-data\") pod \"nova-scheduler-0\" (UID: \"93e6aa9d-1093-474c-821e-784d8070a6e6\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:41:51 crc kubenswrapper[5120]: I0316 16:41:51.213434 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/93e6aa9d-1093-474c-821e-784d8070a6e6-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"93e6aa9d-1093-474c-821e-784d8070a6e6\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:41:51 crc kubenswrapper[5120]: I0316 16:41:51.213804 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/93e6aa9d-1093-474c-821e-784d8070a6e6-config-data\") pod \"nova-scheduler-0\" (UID: \"93e6aa9d-1093-474c-821e-784d8070a6e6\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:41:51 crc kubenswrapper[5120]: I0316 16:41:51.239372 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqc2x\" (UniqueName: \"kubernetes.io/projected/93e6aa9d-1093-474c-821e-784d8070a6e6-kube-api-access-mqc2x\") pod \"nova-scheduler-0\" (UID: \"93e6aa9d-1093-474c-821e-784d8070a6e6\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:41:51 crc kubenswrapper[5120]: I0316 16:41:51.362330 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:41:51 crc kubenswrapper[5120]: I0316 16:41:51.805535 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:41:51 crc kubenswrapper[5120]: W0316 16:41:51.809535 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod93e6aa9d_1093_474c_821e_784d8070a6e6.slice/crio-917fc10e01a300dbbf283a836bb856cfe6b1bf29aeb7cce10f8798012f252499 WatchSource:0}: Error finding container 917fc10e01a300dbbf283a836bb856cfe6b1bf29aeb7cce10f8798012f252499: Status 404 returned error can't find the container with id 917fc10e01a300dbbf283a836bb856cfe6b1bf29aeb7cce10f8798012f252499 Mar 16 16:41:51 crc kubenswrapper[5120]: I0316 16:41:51.886496 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:41:51 crc kubenswrapper[5120]: I0316 16:41:51.937065 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"93e6aa9d-1093-474c-821e-784d8070a6e6","Type":"ContainerStarted","Data":"917fc10e01a300dbbf283a836bb856cfe6b1bf29aeb7cce10f8798012f252499"} Mar 16 16:41:52 crc kubenswrapper[5120]: I0316 16:41:52.352478 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-4s92w"] Mar 16 16:41:52 crc kubenswrapper[5120]: I0316 16:41:52.359457 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-4s92w" Mar 16 16:41:52 crc kubenswrapper[5120]: I0316 16:41:52.363214 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-manage-config-data\"" Mar 16 16:41:52 crc kubenswrapper[5120]: I0316 16:41:52.363511 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-manage-scripts\"" Mar 16 16:41:52 crc kubenswrapper[5120]: I0316 16:41:52.382137 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-4s92w"] Mar 16 16:41:52 crc kubenswrapper[5120]: I0316 16:41:52.447186 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c231058d-1e1b-4d40-bd38-09673df33add-combined-ca-bundle\") pod \"nova-cell1-cell-mapping-4s92w\" (UID: \"c231058d-1e1b-4d40-bd38-09673df33add\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-4s92w" Mar 16 16:41:52 crc kubenswrapper[5120]: I0316 16:41:52.447342 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6lnd2\" (UniqueName: \"kubernetes.io/projected/c231058d-1e1b-4d40-bd38-09673df33add-kube-api-access-6lnd2\") pod \"nova-cell1-cell-mapping-4s92w\" (UID: \"c231058d-1e1b-4d40-bd38-09673df33add\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-4s92w" Mar 16 16:41:52 crc kubenswrapper[5120]: I0316 16:41:52.447391 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c231058d-1e1b-4d40-bd38-09673df33add-config-data\") pod \"nova-cell1-cell-mapping-4s92w\" (UID: \"c231058d-1e1b-4d40-bd38-09673df33add\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-4s92w" Mar 16 16:41:52 crc kubenswrapper[5120]: I0316 16:41:52.447458 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c231058d-1e1b-4d40-bd38-09673df33add-scripts\") pod \"nova-cell1-cell-mapping-4s92w\" (UID: \"c231058d-1e1b-4d40-bd38-09673df33add\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-4s92w" Mar 16 16:41:52 crc kubenswrapper[5120]: I0316 16:41:52.549051 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c231058d-1e1b-4d40-bd38-09673df33add-scripts\") pod \"nova-cell1-cell-mapping-4s92w\" (UID: \"c231058d-1e1b-4d40-bd38-09673df33add\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-4s92w" Mar 16 16:41:52 crc kubenswrapper[5120]: I0316 16:41:52.549556 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c231058d-1e1b-4d40-bd38-09673df33add-combined-ca-bundle\") pod \"nova-cell1-cell-mapping-4s92w\" (UID: \"c231058d-1e1b-4d40-bd38-09673df33add\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-4s92w" Mar 16 16:41:52 crc kubenswrapper[5120]: I0316 16:41:52.549706 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6lnd2\" (UniqueName: \"kubernetes.io/projected/c231058d-1e1b-4d40-bd38-09673df33add-kube-api-access-6lnd2\") pod \"nova-cell1-cell-mapping-4s92w\" (UID: \"c231058d-1e1b-4d40-bd38-09673df33add\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-4s92w" Mar 16 16:41:52 crc kubenswrapper[5120]: I0316 16:41:52.549771 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c231058d-1e1b-4d40-bd38-09673df33add-config-data\") pod \"nova-cell1-cell-mapping-4s92w\" (UID: \"c231058d-1e1b-4d40-bd38-09673df33add\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-4s92w" Mar 16 16:41:52 crc kubenswrapper[5120]: I0316 16:41:52.555443 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c231058d-1e1b-4d40-bd38-09673df33add-combined-ca-bundle\") pod \"nova-cell1-cell-mapping-4s92w\" (UID: \"c231058d-1e1b-4d40-bd38-09673df33add\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-4s92w" Mar 16 16:41:52 crc kubenswrapper[5120]: I0316 16:41:52.556945 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c231058d-1e1b-4d40-bd38-09673df33add-scripts\") pod \"nova-cell1-cell-mapping-4s92w\" (UID: \"c231058d-1e1b-4d40-bd38-09673df33add\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-4s92w" Mar 16 16:41:52 crc kubenswrapper[5120]: I0316 16:41:52.556992 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c231058d-1e1b-4d40-bd38-09673df33add-config-data\") pod \"nova-cell1-cell-mapping-4s92w\" (UID: \"c231058d-1e1b-4d40-bd38-09673df33add\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-4s92w" Mar 16 16:41:52 crc kubenswrapper[5120]: I0316 16:41:52.572782 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6lnd2\" (UniqueName: \"kubernetes.io/projected/c231058d-1e1b-4d40-bd38-09673df33add-kube-api-access-6lnd2\") pod \"nova-cell1-cell-mapping-4s92w\" (UID: \"c231058d-1e1b-4d40-bd38-09673df33add\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-4s92w" Mar 16 16:41:52 crc kubenswrapper[5120]: I0316 16:41:52.673999 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="15f1d0a1-892a-4460-914e-54cbd7a1b281" path="/var/lib/kubelet/pods/15f1d0a1-892a-4460-914e-54cbd7a1b281/volumes" Mar 16 16:41:52 crc kubenswrapper[5120]: I0316 16:41:52.677379 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-4s92w" Mar 16 16:41:52 crc kubenswrapper[5120]: I0316 16:41:52.946782 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"93e6aa9d-1093-474c-821e-784d8070a6e6","Type":"ContainerStarted","Data":"2d7fe4ac86346596af07aa312205432665e5e205ca20a46b6950d9afd4787a3c"} Mar 16 16:41:52 crc kubenswrapper[5120]: I0316 16:41:52.949864 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"2062cbff-20d9-4bdb-b60f-881144c1f24f","Type":"ContainerStarted","Data":"bbe208005febe64ceddc97996dbe752bb70fa2569e8ff1eae306370be0543432"} Mar 16 16:41:52 crc kubenswrapper[5120]: I0316 16:41:52.950009 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:41:52 crc kubenswrapper[5120]: I0316 16:41:52.995657 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-scheduler-0" podStartSLOduration=2.995635352 podStartE2EDuration="2.995635352s" podCreationTimestamp="2026-03-16 16:41:50 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:41:52.964543218 +0000 UTC m=+4215.118474875" watchObservedRunningTime="2026-03-16 16:41:52.995635352 +0000 UTC m=+4215.149567009" Mar 16 16:41:53 crc kubenswrapper[5120]: I0316 16:41:52.999831 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=1.9617085090000002 podStartE2EDuration="5.999746904s" podCreationTimestamp="2026-03-16 16:41:47 +0000 UTC" firstStartedPulling="2026-03-16 16:41:48.016597218 +0000 UTC m=+4210.170528875" lastFinishedPulling="2026-03-16 16:41:52.054635613 +0000 UTC m=+4214.208567270" observedRunningTime="2026-03-16 16:41:52.983187494 +0000 UTC m=+4215.137119151" watchObservedRunningTime="2026-03-16 16:41:52.999746904 +0000 UTC m=+4215.153678551" Mar 16 16:41:53 crc kubenswrapper[5120]: I0316 16:41:53.124619 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-4s92w"] Mar 16 16:41:53 crc kubenswrapper[5120]: W0316 16:41:53.135296 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc231058d_1e1b_4d40_bd38_09673df33add.slice/crio-6b0d85cd9cb5885c264cf179fbdb3bb6aec9ef0317edf7af40d39b4e23c056e2 WatchSource:0}: Error finding container 6b0d85cd9cb5885c264cf179fbdb3bb6aec9ef0317edf7af40d39b4e23c056e2: Status 404 returned error can't find the container with id 6b0d85cd9cb5885c264cf179fbdb3bb6aec9ef0317edf7af40d39b4e23c056e2 Mar 16 16:41:53 crc kubenswrapper[5120]: I0316 16:41:53.962527 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-4s92w" event={"ID":"c231058d-1e1b-4d40-bd38-09673df33add","Type":"ContainerStarted","Data":"5b2c10361ce32e62cbc26f25779afcb963c9d2c3b460f958122b9cbe6ba8e51a"} Mar 16 16:41:53 crc kubenswrapper[5120]: I0316 16:41:53.962938 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-4s92w" event={"ID":"c231058d-1e1b-4d40-bd38-09673df33add","Type":"ContainerStarted","Data":"6b0d85cd9cb5885c264cf179fbdb3bb6aec9ef0317edf7af40d39b4e23c056e2"} Mar 16 16:41:53 crc kubenswrapper[5120]: I0316 16:41:53.982325 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-4s92w" podStartSLOduration=1.982310181 podStartE2EDuration="1.982310181s" podCreationTimestamp="2026-03-16 16:41:52 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:41:53.979564287 +0000 UTC m=+4216.133495944" watchObservedRunningTime="2026-03-16 16:41:53.982310181 +0000 UTC m=+4216.136241838" Mar 16 16:41:55 crc kubenswrapper[5120]: I0316 16:41:55.245711 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:41:55 crc kubenswrapper[5120]: I0316 16:41:55.246032 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:41:56 crc kubenswrapper[5120]: I0316 16:41:56.252996 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="f5e0b05c-87b8-4e48-af1b-c1b085931771" containerName="nova-metadata-log" probeResult="failure" output="Get \"https://10.217.1.96:8775/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Mar 16 16:41:56 crc kubenswrapper[5120]: I0316 16:41:56.253004 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="f5e0b05c-87b8-4e48-af1b-c1b085931771" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"https://10.217.1.96:8775/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 16:41:56 crc kubenswrapper[5120]: I0316 16:41:56.363669 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:41:59 crc kubenswrapper[5120]: I0316 16:41:59.038363 5120 generic.go:358] "Generic (PLEG): container finished" podID="c231058d-1e1b-4d40-bd38-09673df33add" containerID="5b2c10361ce32e62cbc26f25779afcb963c9d2c3b460f958122b9cbe6ba8e51a" exitCode=0 Mar 16 16:41:59 crc kubenswrapper[5120]: I0316 16:41:59.039135 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-4s92w" event={"ID":"c231058d-1e1b-4d40-bd38-09673df33add","Type":"ContainerDied","Data":"5b2c10361ce32e62cbc26f25779afcb963c9d2c3b460f958122b9cbe6ba8e51a"} Mar 16 16:41:59 crc kubenswrapper[5120]: I0316 16:41:59.596169 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:41:59 crc kubenswrapper[5120]: I0316 16:41:59.596609 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:42:00 crc kubenswrapper[5120]: I0316 16:42:00.142792 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-infra/auto-csr-approver-29561322-5qbc2"] Mar 16 16:42:00 crc kubenswrapper[5120]: I0316 16:42:00.148110 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561322-5qbc2" Mar 16 16:42:00 crc kubenswrapper[5120]: I0316 16:42:00.150587 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-infra\"/\"csr-approver-sa-dockercfg-x2nsz\"" Mar 16 16:42:00 crc kubenswrapper[5120]: I0316 16:42:00.150668 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"openshift-service-ca.crt\"" Mar 16 16:42:00 crc kubenswrapper[5120]: I0316 16:42:00.150841 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"kube-root-ca.crt\"" Mar 16 16:42:00 crc kubenswrapper[5120]: I0316 16:42:00.154077 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561322-5qbc2"] Mar 16 16:42:00 crc kubenswrapper[5120]: I0316 16:42:00.280246 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kfzkz\" (UniqueName: \"kubernetes.io/projected/a1a93363-54ba-4785-bd0a-b4ff5dd043b6-kube-api-access-kfzkz\") pod \"auto-csr-approver-29561322-5qbc2\" (UID: \"a1a93363-54ba-4785-bd0a-b4ff5dd043b6\") " pod="openshift-infra/auto-csr-approver-29561322-5qbc2" Mar 16 16:42:00 crc kubenswrapper[5120]: I0316 16:42:00.382834 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kfzkz\" (UniqueName: \"kubernetes.io/projected/a1a93363-54ba-4785-bd0a-b4ff5dd043b6-kube-api-access-kfzkz\") pod \"auto-csr-approver-29561322-5qbc2\" (UID: \"a1a93363-54ba-4785-bd0a-b4ff5dd043b6\") " pod="openshift-infra/auto-csr-approver-29561322-5qbc2" Mar 16 16:42:00 crc kubenswrapper[5120]: I0316 16:42:00.403440 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kfzkz\" (UniqueName: \"kubernetes.io/projected/a1a93363-54ba-4785-bd0a-b4ff5dd043b6-kube-api-access-kfzkz\") pod \"auto-csr-approver-29561322-5qbc2\" (UID: \"a1a93363-54ba-4785-bd0a-b4ff5dd043b6\") " pod="openshift-infra/auto-csr-approver-29561322-5qbc2" Mar 16 16:42:00 crc kubenswrapper[5120]: I0316 16:42:00.470650 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-4s92w" Mar 16 16:42:00 crc kubenswrapper[5120]: I0316 16:42:00.485258 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561322-5qbc2" Mar 16 16:42:00 crc kubenswrapper[5120]: I0316 16:42:00.588526 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c231058d-1e1b-4d40-bd38-09673df33add-config-data\") pod \"c231058d-1e1b-4d40-bd38-09673df33add\" (UID: \"c231058d-1e1b-4d40-bd38-09673df33add\") " Mar 16 16:42:00 crc kubenswrapper[5120]: I0316 16:42:00.588928 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c231058d-1e1b-4d40-bd38-09673df33add-combined-ca-bundle\") pod \"c231058d-1e1b-4d40-bd38-09673df33add\" (UID: \"c231058d-1e1b-4d40-bd38-09673df33add\") " Mar 16 16:42:00 crc kubenswrapper[5120]: I0316 16:42:00.589044 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c231058d-1e1b-4d40-bd38-09673df33add-scripts\") pod \"c231058d-1e1b-4d40-bd38-09673df33add\" (UID: \"c231058d-1e1b-4d40-bd38-09673df33add\") " Mar 16 16:42:00 crc kubenswrapper[5120]: I0316 16:42:00.589345 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6lnd2\" (UniqueName: \"kubernetes.io/projected/c231058d-1e1b-4d40-bd38-09673df33add-kube-api-access-6lnd2\") pod \"c231058d-1e1b-4d40-bd38-09673df33add\" (UID: \"c231058d-1e1b-4d40-bd38-09673df33add\") " Mar 16 16:42:00 crc kubenswrapper[5120]: I0316 16:42:00.596907 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c231058d-1e1b-4d40-bd38-09673df33add-scripts" (OuterVolumeSpecName: "scripts") pod "c231058d-1e1b-4d40-bd38-09673df33add" (UID: "c231058d-1e1b-4d40-bd38-09673df33add"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:42:00 crc kubenswrapper[5120]: I0316 16:42:00.608985 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c231058d-1e1b-4d40-bd38-09673df33add-kube-api-access-6lnd2" (OuterVolumeSpecName: "kube-api-access-6lnd2") pod "c231058d-1e1b-4d40-bd38-09673df33add" (UID: "c231058d-1e1b-4d40-bd38-09673df33add"). InnerVolumeSpecName "kube-api-access-6lnd2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:42:00 crc kubenswrapper[5120]: I0316 16:42:00.636955 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="32a29aa8-e796-4ad7-a221-a37189688d4c" containerName="nova-api-api" probeResult="failure" output="Get \"http://10.217.1.98:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 16:42:00 crc kubenswrapper[5120]: I0316 16:42:00.639060 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="32a29aa8-e796-4ad7-a221-a37189688d4c" containerName="nova-api-log" probeResult="failure" output="Get \"http://10.217.1.98:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 16:42:00 crc kubenswrapper[5120]: I0316 16:42:00.645902 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c231058d-1e1b-4d40-bd38-09673df33add-config-data" (OuterVolumeSpecName: "config-data") pod "c231058d-1e1b-4d40-bd38-09673df33add" (UID: "c231058d-1e1b-4d40-bd38-09673df33add"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:42:00 crc kubenswrapper[5120]: I0316 16:42:00.651742 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c231058d-1e1b-4d40-bd38-09673df33add-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "c231058d-1e1b-4d40-bd38-09673df33add" (UID: "c231058d-1e1b-4d40-bd38-09673df33add"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:42:00 crc kubenswrapper[5120]: I0316 16:42:00.692419 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c231058d-1e1b-4d40-bd38-09673df33add-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:42:00 crc kubenswrapper[5120]: I0316 16:42:00.692454 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c231058d-1e1b-4d40-bd38-09673df33add-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:42:00 crc kubenswrapper[5120]: I0316 16:42:00.692464 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6lnd2\" (UniqueName: \"kubernetes.io/projected/c231058d-1e1b-4d40-bd38-09673df33add-kube-api-access-6lnd2\") on node \"crc\" DevicePath \"\"" Mar 16 16:42:00 crc kubenswrapper[5120]: I0316 16:42:00.692475 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c231058d-1e1b-4d40-bd38-09673df33add-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:42:00 crc kubenswrapper[5120]: I0316 16:42:00.943214 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561322-5qbc2"] Mar 16 16:42:00 crc kubenswrapper[5120]: W0316 16:42:00.948046 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda1a93363_54ba_4785_bd0a_b4ff5dd043b6.slice/crio-8badfdfea743f2a911b800bc3a7cb547d92c9549dc615d7ef13f015f878dbed4 WatchSource:0}: Error finding container 8badfdfea743f2a911b800bc3a7cb547d92c9549dc615d7ef13f015f878dbed4: Status 404 returned error can't find the container with id 8badfdfea743f2a911b800bc3a7cb547d92c9549dc615d7ef13f015f878dbed4 Mar 16 16:42:01 crc kubenswrapper[5120]: I0316 16:42:01.069547 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561322-5qbc2" event={"ID":"a1a93363-54ba-4785-bd0a-b4ff5dd043b6","Type":"ContainerStarted","Data":"8badfdfea743f2a911b800bc3a7cb547d92c9549dc615d7ef13f015f878dbed4"} Mar 16 16:42:01 crc kubenswrapper[5120]: I0316 16:42:01.073461 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-4s92w" event={"ID":"c231058d-1e1b-4d40-bd38-09673df33add","Type":"ContainerDied","Data":"6b0d85cd9cb5885c264cf179fbdb3bb6aec9ef0317edf7af40d39b4e23c056e2"} Mar 16 16:42:01 crc kubenswrapper[5120]: I0316 16:42:01.073512 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6b0d85cd9cb5885c264cf179fbdb3bb6aec9ef0317edf7af40d39b4e23c056e2" Mar 16 16:42:01 crc kubenswrapper[5120]: I0316 16:42:01.073615 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-4s92w" Mar 16 16:42:01 crc kubenswrapper[5120]: I0316 16:42:01.262613 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:42:01 crc kubenswrapper[5120]: I0316 16:42:01.262850 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="32a29aa8-e796-4ad7-a221-a37189688d4c" containerName="nova-api-log" containerID="cri-o://740ae4a73687633159c740d53e1fdc38ab4701f07ab235a9396b7ba617820c9d" gracePeriod=30 Mar 16 16:42:01 crc kubenswrapper[5120]: I0316 16:42:01.263278 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="32a29aa8-e796-4ad7-a221-a37189688d4c" containerName="nova-api-api" containerID="cri-o://63c355c033ad99c34f2d2fe02087f6b89a0d866723906ced0372192e6203809c" gracePeriod=30 Mar 16 16:42:01 crc kubenswrapper[5120]: I0316 16:42:01.276587 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:42:01 crc kubenswrapper[5120]: I0316 16:42:01.276817 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="93e6aa9d-1093-474c-821e-784d8070a6e6" containerName="nova-scheduler-scheduler" containerID="cri-o://2d7fe4ac86346596af07aa312205432665e5e205ca20a46b6950d9afd4787a3c" gracePeriod=30 Mar 16 16:42:01 crc kubenswrapper[5120]: I0316 16:42:01.350983 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:42:01 crc kubenswrapper[5120]: I0316 16:42:01.351466 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="f5e0b05c-87b8-4e48-af1b-c1b085931771" containerName="nova-metadata-log" containerID="cri-o://cfda5070bc4948a60c92b604836cf8650938989c14a6d7828f0266ba58464074" gracePeriod=30 Mar 16 16:42:01 crc kubenswrapper[5120]: I0316 16:42:01.351556 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="f5e0b05c-87b8-4e48-af1b-c1b085931771" containerName="nova-metadata-metadata" containerID="cri-o://c517d17a66c9546d5c9e055c8b08325792648b855e10d41b87355dfe311dc1bf" gracePeriod=30 Mar 16 16:42:02 crc kubenswrapper[5120]: I0316 16:42:02.085024 5120 generic.go:358] "Generic (PLEG): container finished" podID="32a29aa8-e796-4ad7-a221-a37189688d4c" containerID="740ae4a73687633159c740d53e1fdc38ab4701f07ab235a9396b7ba617820c9d" exitCode=143 Mar 16 16:42:02 crc kubenswrapper[5120]: I0316 16:42:02.085618 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"32a29aa8-e796-4ad7-a221-a37189688d4c","Type":"ContainerDied","Data":"740ae4a73687633159c740d53e1fdc38ab4701f07ab235a9396b7ba617820c9d"} Mar 16 16:42:02 crc kubenswrapper[5120]: I0316 16:42:02.086948 5120 generic.go:358] "Generic (PLEG): container finished" podID="f5e0b05c-87b8-4e48-af1b-c1b085931771" containerID="cfda5070bc4948a60c92b604836cf8650938989c14a6d7828f0266ba58464074" exitCode=143 Mar 16 16:42:02 crc kubenswrapper[5120]: I0316 16:42:02.087010 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"f5e0b05c-87b8-4e48-af1b-c1b085931771","Type":"ContainerDied","Data":"cfda5070bc4948a60c92b604836cf8650938989c14a6d7828f0266ba58464074"} Mar 16 16:42:03 crc kubenswrapper[5120]: I0316 16:42:03.244966 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:42:03 crc kubenswrapper[5120]: I0316 16:42:03.246452 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:42:03 crc kubenswrapper[5120]: I0316 16:42:03.569050 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:42:03 crc kubenswrapper[5120]: I0316 16:42:03.663004 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/93e6aa9d-1093-474c-821e-784d8070a6e6-config-data\") pod \"93e6aa9d-1093-474c-821e-784d8070a6e6\" (UID: \"93e6aa9d-1093-474c-821e-784d8070a6e6\") " Mar 16 16:42:03 crc kubenswrapper[5120]: I0316 16:42:03.663273 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/93e6aa9d-1093-474c-821e-784d8070a6e6-combined-ca-bundle\") pod \"93e6aa9d-1093-474c-821e-784d8070a6e6\" (UID: \"93e6aa9d-1093-474c-821e-784d8070a6e6\") " Mar 16 16:42:03 crc kubenswrapper[5120]: I0316 16:42:03.663808 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mqc2x\" (UniqueName: \"kubernetes.io/projected/93e6aa9d-1093-474c-821e-784d8070a6e6-kube-api-access-mqc2x\") pod \"93e6aa9d-1093-474c-821e-784d8070a6e6\" (UID: \"93e6aa9d-1093-474c-821e-784d8070a6e6\") " Mar 16 16:42:03 crc kubenswrapper[5120]: I0316 16:42:03.669328 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93e6aa9d-1093-474c-821e-784d8070a6e6-kube-api-access-mqc2x" (OuterVolumeSpecName: "kube-api-access-mqc2x") pod "93e6aa9d-1093-474c-821e-784d8070a6e6" (UID: "93e6aa9d-1093-474c-821e-784d8070a6e6"). InnerVolumeSpecName "kube-api-access-mqc2x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:42:03 crc kubenswrapper[5120]: I0316 16:42:03.692925 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93e6aa9d-1093-474c-821e-784d8070a6e6-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "93e6aa9d-1093-474c-821e-784d8070a6e6" (UID: "93e6aa9d-1093-474c-821e-784d8070a6e6"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:42:03 crc kubenswrapper[5120]: I0316 16:42:03.697404 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93e6aa9d-1093-474c-821e-784d8070a6e6-config-data" (OuterVolumeSpecName: "config-data") pod "93e6aa9d-1093-474c-821e-784d8070a6e6" (UID: "93e6aa9d-1093-474c-821e-784d8070a6e6"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:42:03 crc kubenswrapper[5120]: I0316 16:42:03.766680 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mqc2x\" (UniqueName: \"kubernetes.io/projected/93e6aa9d-1093-474c-821e-784d8070a6e6-kube-api-access-mqc2x\") on node \"crc\" DevicePath \"\"" Mar 16 16:42:03 crc kubenswrapper[5120]: I0316 16:42:03.766715 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/93e6aa9d-1093-474c-821e-784d8070a6e6-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:42:03 crc kubenswrapper[5120]: I0316 16:42:03.766726 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/93e6aa9d-1093-474c-821e-784d8070a6e6-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:42:04 crc kubenswrapper[5120]: I0316 16:42:04.112653 5120 generic.go:358] "Generic (PLEG): container finished" podID="93e6aa9d-1093-474c-821e-784d8070a6e6" containerID="2d7fe4ac86346596af07aa312205432665e5e205ca20a46b6950d9afd4787a3c" exitCode=0 Mar 16 16:42:04 crc kubenswrapper[5120]: I0316 16:42:04.112742 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:42:04 crc kubenswrapper[5120]: I0316 16:42:04.112869 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"93e6aa9d-1093-474c-821e-784d8070a6e6","Type":"ContainerDied","Data":"2d7fe4ac86346596af07aa312205432665e5e205ca20a46b6950d9afd4787a3c"} Mar 16 16:42:04 crc kubenswrapper[5120]: I0316 16:42:04.112903 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"93e6aa9d-1093-474c-821e-784d8070a6e6","Type":"ContainerDied","Data":"917fc10e01a300dbbf283a836bb856cfe6b1bf29aeb7cce10f8798012f252499"} Mar 16 16:42:04 crc kubenswrapper[5120]: I0316 16:42:04.112924 5120 scope.go:117] "RemoveContainer" containerID="2d7fe4ac86346596af07aa312205432665e5e205ca20a46b6950d9afd4787a3c" Mar 16 16:42:04 crc kubenswrapper[5120]: I0316 16:42:04.116224 5120 generic.go:358] "Generic (PLEG): container finished" podID="a1a93363-54ba-4785-bd0a-b4ff5dd043b6" containerID="3b41ba48fc5e4fef65e0512c491ade0925ab29f2fc97fe6fdf0ec45d6bdc38ce" exitCode=0 Mar 16 16:42:04 crc kubenswrapper[5120]: I0316 16:42:04.116460 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561322-5qbc2" event={"ID":"a1a93363-54ba-4785-bd0a-b4ff5dd043b6","Type":"ContainerDied","Data":"3b41ba48fc5e4fef65e0512c491ade0925ab29f2fc97fe6fdf0ec45d6bdc38ce"} Mar 16 16:42:04 crc kubenswrapper[5120]: I0316 16:42:04.142709 5120 scope.go:117] "RemoveContainer" containerID="2d7fe4ac86346596af07aa312205432665e5e205ca20a46b6950d9afd4787a3c" Mar 16 16:42:04 crc kubenswrapper[5120]: E0316 16:42:04.143158 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d7fe4ac86346596af07aa312205432665e5e205ca20a46b6950d9afd4787a3c\": container with ID starting with 2d7fe4ac86346596af07aa312205432665e5e205ca20a46b6950d9afd4787a3c not found: ID does not exist" containerID="2d7fe4ac86346596af07aa312205432665e5e205ca20a46b6950d9afd4787a3c" Mar 16 16:42:04 crc kubenswrapper[5120]: I0316 16:42:04.143193 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d7fe4ac86346596af07aa312205432665e5e205ca20a46b6950d9afd4787a3c"} err="failed to get container status \"2d7fe4ac86346596af07aa312205432665e5e205ca20a46b6950d9afd4787a3c\": rpc error: code = NotFound desc = could not find container \"2d7fe4ac86346596af07aa312205432665e5e205ca20a46b6950d9afd4787a3c\": container with ID starting with 2d7fe4ac86346596af07aa312205432665e5e205ca20a46b6950d9afd4787a3c not found: ID does not exist" Mar 16 16:42:04 crc kubenswrapper[5120]: I0316 16:42:04.157532 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:42:04 crc kubenswrapper[5120]: I0316 16:42:04.165718 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:42:04 crc kubenswrapper[5120]: I0316 16:42:04.191849 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:42:04 crc kubenswrapper[5120]: I0316 16:42:04.193037 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93e6aa9d-1093-474c-821e-784d8070a6e6" containerName="nova-scheduler-scheduler" Mar 16 16:42:04 crc kubenswrapper[5120]: I0316 16:42:04.193058 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="93e6aa9d-1093-474c-821e-784d8070a6e6" containerName="nova-scheduler-scheduler" Mar 16 16:42:04 crc kubenswrapper[5120]: I0316 16:42:04.193104 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c231058d-1e1b-4d40-bd38-09673df33add" containerName="nova-manage" Mar 16 16:42:04 crc kubenswrapper[5120]: I0316 16:42:04.193112 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c231058d-1e1b-4d40-bd38-09673df33add" containerName="nova-manage" Mar 16 16:42:04 crc kubenswrapper[5120]: I0316 16:42:04.193287 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="93e6aa9d-1093-474c-821e-784d8070a6e6" containerName="nova-scheduler-scheduler" Mar 16 16:42:04 crc kubenswrapper[5120]: I0316 16:42:04.193305 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c231058d-1e1b-4d40-bd38-09673df33add" containerName="nova-manage" Mar 16 16:42:04 crc kubenswrapper[5120]: I0316 16:42:04.198926 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:42:04 crc kubenswrapper[5120]: I0316 16:42:04.203877 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:42:04 crc kubenswrapper[5120]: I0316 16:42:04.204053 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-scheduler-config-data\"" Mar 16 16:42:04 crc kubenswrapper[5120]: I0316 16:42:04.279377 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/93b8115e-671f-4dff-96ec-a78e9ad5b022-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"93b8115e-671f-4dff-96ec-a78e9ad5b022\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:42:04 crc kubenswrapper[5120]: I0316 16:42:04.279749 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmt8f\" (UniqueName: \"kubernetes.io/projected/93b8115e-671f-4dff-96ec-a78e9ad5b022-kube-api-access-pmt8f\") pod \"nova-scheduler-0\" (UID: \"93b8115e-671f-4dff-96ec-a78e9ad5b022\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:42:04 crc kubenswrapper[5120]: I0316 16:42:04.280077 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/93b8115e-671f-4dff-96ec-a78e9ad5b022-config-data\") pod \"nova-scheduler-0\" (UID: \"93b8115e-671f-4dff-96ec-a78e9ad5b022\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:42:04 crc kubenswrapper[5120]: I0316 16:42:04.383007 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/93b8115e-671f-4dff-96ec-a78e9ad5b022-config-data\") pod \"nova-scheduler-0\" (UID: \"93b8115e-671f-4dff-96ec-a78e9ad5b022\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:42:04 crc kubenswrapper[5120]: I0316 16:42:04.383503 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/93b8115e-671f-4dff-96ec-a78e9ad5b022-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"93b8115e-671f-4dff-96ec-a78e9ad5b022\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:42:04 crc kubenswrapper[5120]: I0316 16:42:04.383610 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pmt8f\" (UniqueName: \"kubernetes.io/projected/93b8115e-671f-4dff-96ec-a78e9ad5b022-kube-api-access-pmt8f\") pod \"nova-scheduler-0\" (UID: \"93b8115e-671f-4dff-96ec-a78e9ad5b022\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:42:04 crc kubenswrapper[5120]: I0316 16:42:04.388122 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/93b8115e-671f-4dff-96ec-a78e9ad5b022-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"93b8115e-671f-4dff-96ec-a78e9ad5b022\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:42:04 crc kubenswrapper[5120]: I0316 16:42:04.397441 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/93b8115e-671f-4dff-96ec-a78e9ad5b022-config-data\") pod \"nova-scheduler-0\" (UID: \"93b8115e-671f-4dff-96ec-a78e9ad5b022\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:42:04 crc kubenswrapper[5120]: I0316 16:42:04.399644 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmt8f\" (UniqueName: \"kubernetes.io/projected/93b8115e-671f-4dff-96ec-a78e9ad5b022-kube-api-access-pmt8f\") pod \"nova-scheduler-0\" (UID: \"93b8115e-671f-4dff-96ec-a78e9ad5b022\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:42:04 crc kubenswrapper[5120]: I0316 16:42:04.526243 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:42:04 crc kubenswrapper[5120]: I0316 16:42:04.676926 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93e6aa9d-1093-474c-821e-784d8070a6e6" path="/var/lib/kubelet/pods/93e6aa9d-1093-474c-821e-784d8070a6e6/volumes" Mar 16 16:42:04 crc kubenswrapper[5120]: I0316 16:42:04.985867 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:42:05 crc kubenswrapper[5120]: W0316 16:42:05.034710 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod93b8115e_671f_4dff_96ec_a78e9ad5b022.slice/crio-f2c70a59c142937501e150a9d0c4a0983e2d5eb59de2a59bf389e35d8f43fe16 WatchSource:0}: Error finding container f2c70a59c142937501e150a9d0c4a0983e2d5eb59de2a59bf389e35d8f43fe16: Status 404 returned error can't find the container with id f2c70a59c142937501e150a9d0c4a0983e2d5eb59de2a59bf389e35d8f43fe16 Mar 16 16:42:05 crc kubenswrapper[5120]: I0316 16:42:05.041260 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:42:05 crc kubenswrapper[5120]: I0316 16:42:05.103499 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/f5e0b05c-87b8-4e48-af1b-c1b085931771-nova-metadata-tls-certs\") pod \"f5e0b05c-87b8-4e48-af1b-c1b085931771\" (UID: \"f5e0b05c-87b8-4e48-af1b-c1b085931771\") " Mar 16 16:42:05 crc kubenswrapper[5120]: I0316 16:42:05.103673 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f5e0b05c-87b8-4e48-af1b-c1b085931771-combined-ca-bundle\") pod \"f5e0b05c-87b8-4e48-af1b-c1b085931771\" (UID: \"f5e0b05c-87b8-4e48-af1b-c1b085931771\") " Mar 16 16:42:05 crc kubenswrapper[5120]: I0316 16:42:05.103722 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f5e0b05c-87b8-4e48-af1b-c1b085931771-config-data\") pod \"f5e0b05c-87b8-4e48-af1b-c1b085931771\" (UID: \"f5e0b05c-87b8-4e48-af1b-c1b085931771\") " Mar 16 16:42:05 crc kubenswrapper[5120]: I0316 16:42:05.103778 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sfpb7\" (UniqueName: \"kubernetes.io/projected/f5e0b05c-87b8-4e48-af1b-c1b085931771-kube-api-access-sfpb7\") pod \"f5e0b05c-87b8-4e48-af1b-c1b085931771\" (UID: \"f5e0b05c-87b8-4e48-af1b-c1b085931771\") " Mar 16 16:42:05 crc kubenswrapper[5120]: I0316 16:42:05.104141 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f5e0b05c-87b8-4e48-af1b-c1b085931771-logs\") pod \"f5e0b05c-87b8-4e48-af1b-c1b085931771\" (UID: \"f5e0b05c-87b8-4e48-af1b-c1b085931771\") " Mar 16 16:42:05 crc kubenswrapper[5120]: I0316 16:42:05.104533 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5e0b05c-87b8-4e48-af1b-c1b085931771-logs" (OuterVolumeSpecName: "logs") pod "f5e0b05c-87b8-4e48-af1b-c1b085931771" (UID: "f5e0b05c-87b8-4e48-af1b-c1b085931771"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:42:05 crc kubenswrapper[5120]: I0316 16:42:05.105048 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f5e0b05c-87b8-4e48-af1b-c1b085931771-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:42:05 crc kubenswrapper[5120]: I0316 16:42:05.107991 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5e0b05c-87b8-4e48-af1b-c1b085931771-kube-api-access-sfpb7" (OuterVolumeSpecName: "kube-api-access-sfpb7") pod "f5e0b05c-87b8-4e48-af1b-c1b085931771" (UID: "f5e0b05c-87b8-4e48-af1b-c1b085931771"). InnerVolumeSpecName "kube-api-access-sfpb7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:42:05 crc kubenswrapper[5120]: I0316 16:42:05.127570 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f5e0b05c-87b8-4e48-af1b-c1b085931771-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f5e0b05c-87b8-4e48-af1b-c1b085931771" (UID: "f5e0b05c-87b8-4e48-af1b-c1b085931771"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:42:05 crc kubenswrapper[5120]: I0316 16:42:05.132090 5120 generic.go:358] "Generic (PLEG): container finished" podID="f5e0b05c-87b8-4e48-af1b-c1b085931771" containerID="c517d17a66c9546d5c9e055c8b08325792648b855e10d41b87355dfe311dc1bf" exitCode=0 Mar 16 16:42:05 crc kubenswrapper[5120]: I0316 16:42:05.132220 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"f5e0b05c-87b8-4e48-af1b-c1b085931771","Type":"ContainerDied","Data":"c517d17a66c9546d5c9e055c8b08325792648b855e10d41b87355dfe311dc1bf"} Mar 16 16:42:05 crc kubenswrapper[5120]: I0316 16:42:05.132255 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:42:05 crc kubenswrapper[5120]: I0316 16:42:05.132269 5120 scope.go:117] "RemoveContainer" containerID="c517d17a66c9546d5c9e055c8b08325792648b855e10d41b87355dfe311dc1bf" Mar 16 16:42:05 crc kubenswrapper[5120]: I0316 16:42:05.132257 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"f5e0b05c-87b8-4e48-af1b-c1b085931771","Type":"ContainerDied","Data":"eab7ca774b5e2bec35c8112c82a2184e5710b9aa26b914e041fa8f8b14a09db6"} Mar 16 16:42:05 crc kubenswrapper[5120]: I0316 16:42:05.133168 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f5e0b05c-87b8-4e48-af1b-c1b085931771-config-data" (OuterVolumeSpecName: "config-data") pod "f5e0b05c-87b8-4e48-af1b-c1b085931771" (UID: "f5e0b05c-87b8-4e48-af1b-c1b085931771"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:42:05 crc kubenswrapper[5120]: I0316 16:42:05.134180 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"93b8115e-671f-4dff-96ec-a78e9ad5b022","Type":"ContainerStarted","Data":"f2c70a59c142937501e150a9d0c4a0983e2d5eb59de2a59bf389e35d8f43fe16"} Mar 16 16:42:05 crc kubenswrapper[5120]: I0316 16:42:05.161783 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f5e0b05c-87b8-4e48-af1b-c1b085931771-nova-metadata-tls-certs" (OuterVolumeSpecName: "nova-metadata-tls-certs") pod "f5e0b05c-87b8-4e48-af1b-c1b085931771" (UID: "f5e0b05c-87b8-4e48-af1b-c1b085931771"). InnerVolumeSpecName "nova-metadata-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:42:05 crc kubenswrapper[5120]: I0316 16:42:05.207537 5120 reconciler_common.go:299] "Volume detached for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/f5e0b05c-87b8-4e48-af1b-c1b085931771-nova-metadata-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:42:05 crc kubenswrapper[5120]: I0316 16:42:05.207578 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f5e0b05c-87b8-4e48-af1b-c1b085931771-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:42:05 crc kubenswrapper[5120]: I0316 16:42:05.207588 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f5e0b05c-87b8-4e48-af1b-c1b085931771-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:42:05 crc kubenswrapper[5120]: I0316 16:42:05.207598 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sfpb7\" (UniqueName: \"kubernetes.io/projected/f5e0b05c-87b8-4e48-af1b-c1b085931771-kube-api-access-sfpb7\") on node \"crc\" DevicePath \"\"" Mar 16 16:42:05 crc kubenswrapper[5120]: I0316 16:42:05.254818 5120 scope.go:117] "RemoveContainer" containerID="cfda5070bc4948a60c92b604836cf8650938989c14a6d7828f0266ba58464074" Mar 16 16:42:05 crc kubenswrapper[5120]: I0316 16:42:05.300568 5120 scope.go:117] "RemoveContainer" containerID="c517d17a66c9546d5c9e055c8b08325792648b855e10d41b87355dfe311dc1bf" Mar 16 16:42:05 crc kubenswrapper[5120]: E0316 16:42:05.301095 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c517d17a66c9546d5c9e055c8b08325792648b855e10d41b87355dfe311dc1bf\": container with ID starting with c517d17a66c9546d5c9e055c8b08325792648b855e10d41b87355dfe311dc1bf not found: ID does not exist" containerID="c517d17a66c9546d5c9e055c8b08325792648b855e10d41b87355dfe311dc1bf" Mar 16 16:42:05 crc kubenswrapper[5120]: I0316 16:42:05.301137 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c517d17a66c9546d5c9e055c8b08325792648b855e10d41b87355dfe311dc1bf"} err="failed to get container status \"c517d17a66c9546d5c9e055c8b08325792648b855e10d41b87355dfe311dc1bf\": rpc error: code = NotFound desc = could not find container \"c517d17a66c9546d5c9e055c8b08325792648b855e10d41b87355dfe311dc1bf\": container with ID starting with c517d17a66c9546d5c9e055c8b08325792648b855e10d41b87355dfe311dc1bf not found: ID does not exist" Mar 16 16:42:05 crc kubenswrapper[5120]: I0316 16:42:05.301161 5120 scope.go:117] "RemoveContainer" containerID="cfda5070bc4948a60c92b604836cf8650938989c14a6d7828f0266ba58464074" Mar 16 16:42:05 crc kubenswrapper[5120]: E0316 16:42:05.301666 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cfda5070bc4948a60c92b604836cf8650938989c14a6d7828f0266ba58464074\": container with ID starting with cfda5070bc4948a60c92b604836cf8650938989c14a6d7828f0266ba58464074 not found: ID does not exist" containerID="cfda5070bc4948a60c92b604836cf8650938989c14a6d7828f0266ba58464074" Mar 16 16:42:05 crc kubenswrapper[5120]: I0316 16:42:05.301689 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfda5070bc4948a60c92b604836cf8650938989c14a6d7828f0266ba58464074"} err="failed to get container status \"cfda5070bc4948a60c92b604836cf8650938989c14a6d7828f0266ba58464074\": rpc error: code = NotFound desc = could not find container \"cfda5070bc4948a60c92b604836cf8650938989c14a6d7828f0266ba58464074\": container with ID starting with cfda5070bc4948a60c92b604836cf8650938989c14a6d7828f0266ba58464074 not found: ID does not exist" Mar 16 16:42:05 crc kubenswrapper[5120]: I0316 16:42:05.404501 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561322-5qbc2" Mar 16 16:42:05 crc kubenswrapper[5120]: I0316 16:42:05.475043 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:42:05 crc kubenswrapper[5120]: I0316 16:42:05.500518 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:42:05 crc kubenswrapper[5120]: I0316 16:42:05.513564 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:42:05 crc kubenswrapper[5120]: I0316 16:42:05.515076 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1a93363-54ba-4785-bd0a-b4ff5dd043b6" containerName="oc" Mar 16 16:42:05 crc kubenswrapper[5120]: I0316 16:42:05.515104 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1a93363-54ba-4785-bd0a-b4ff5dd043b6" containerName="oc" Mar 16 16:42:05 crc kubenswrapper[5120]: I0316 16:42:05.515149 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5e0b05c-87b8-4e48-af1b-c1b085931771" containerName="nova-metadata-metadata" Mar 16 16:42:05 crc kubenswrapper[5120]: I0316 16:42:05.515158 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5e0b05c-87b8-4e48-af1b-c1b085931771" containerName="nova-metadata-metadata" Mar 16 16:42:05 crc kubenswrapper[5120]: I0316 16:42:05.515211 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5e0b05c-87b8-4e48-af1b-c1b085931771" containerName="nova-metadata-log" Mar 16 16:42:05 crc kubenswrapper[5120]: I0316 16:42:05.515219 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5e0b05c-87b8-4e48-af1b-c1b085931771" containerName="nova-metadata-log" Mar 16 16:42:05 crc kubenswrapper[5120]: I0316 16:42:05.515437 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f5e0b05c-87b8-4e48-af1b-c1b085931771" containerName="nova-metadata-log" Mar 16 16:42:05 crc kubenswrapper[5120]: I0316 16:42:05.515460 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f5e0b05c-87b8-4e48-af1b-c1b085931771" containerName="nova-metadata-metadata" Mar 16 16:42:05 crc kubenswrapper[5120]: I0316 16:42:05.515472 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="a1a93363-54ba-4785-bd0a-b4ff5dd043b6" containerName="oc" Mar 16 16:42:05 crc kubenswrapper[5120]: I0316 16:42:05.518017 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kfzkz\" (UniqueName: \"kubernetes.io/projected/a1a93363-54ba-4785-bd0a-b4ff5dd043b6-kube-api-access-kfzkz\") pod \"a1a93363-54ba-4785-bd0a-b4ff5dd043b6\" (UID: \"a1a93363-54ba-4785-bd0a-b4ff5dd043b6\") " Mar 16 16:42:05 crc kubenswrapper[5120]: I0316 16:42:05.521092 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:42:05 crc kubenswrapper[5120]: I0316 16:42:05.523263 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:42:05 crc kubenswrapper[5120]: I0316 16:42:05.525025 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1a93363-54ba-4785-bd0a-b4ff5dd043b6-kube-api-access-kfzkz" (OuterVolumeSpecName: "kube-api-access-kfzkz") pod "a1a93363-54ba-4785-bd0a-b4ff5dd043b6" (UID: "a1a93363-54ba-4785-bd0a-b4ff5dd043b6"). InnerVolumeSpecName "kube-api-access-kfzkz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:42:05 crc kubenswrapper[5120]: I0316 16:42:05.525075 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-metadata-config-data\"" Mar 16 16:42:05 crc kubenswrapper[5120]: I0316 16:42:05.525077 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-metadata-internal-svc\"" Mar 16 16:42:05 crc kubenswrapper[5120]: I0316 16:42:05.620832 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e9e86e40-d30c-4208-852b-5d6737ba05ce-logs\") pod \"nova-metadata-0\" (UID: \"e9e86e40-d30c-4208-852b-5d6737ba05ce\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:42:05 crc kubenswrapper[5120]: I0316 16:42:05.621093 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqmvz\" (UniqueName: \"kubernetes.io/projected/e9e86e40-d30c-4208-852b-5d6737ba05ce-kube-api-access-zqmvz\") pod \"nova-metadata-0\" (UID: \"e9e86e40-d30c-4208-852b-5d6737ba05ce\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:42:05 crc kubenswrapper[5120]: I0316 16:42:05.621150 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e9e86e40-d30c-4208-852b-5d6737ba05ce-config-data\") pod \"nova-metadata-0\" (UID: \"e9e86e40-d30c-4208-852b-5d6737ba05ce\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:42:05 crc kubenswrapper[5120]: I0316 16:42:05.621258 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e9e86e40-d30c-4208-852b-5d6737ba05ce-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"e9e86e40-d30c-4208-852b-5d6737ba05ce\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:42:05 crc kubenswrapper[5120]: I0316 16:42:05.621396 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/e9e86e40-d30c-4208-852b-5d6737ba05ce-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"e9e86e40-d30c-4208-852b-5d6737ba05ce\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:42:05 crc kubenswrapper[5120]: I0316 16:42:05.621460 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kfzkz\" (UniqueName: \"kubernetes.io/projected/a1a93363-54ba-4785-bd0a-b4ff5dd043b6-kube-api-access-kfzkz\") on node \"crc\" DevicePath \"\"" Mar 16 16:42:05 crc kubenswrapper[5120]: I0316 16:42:05.723681 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zqmvz\" (UniqueName: \"kubernetes.io/projected/e9e86e40-d30c-4208-852b-5d6737ba05ce-kube-api-access-zqmvz\") pod \"nova-metadata-0\" (UID: \"e9e86e40-d30c-4208-852b-5d6737ba05ce\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:42:05 crc kubenswrapper[5120]: I0316 16:42:05.724347 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e9e86e40-d30c-4208-852b-5d6737ba05ce-config-data\") pod \"nova-metadata-0\" (UID: \"e9e86e40-d30c-4208-852b-5d6737ba05ce\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:42:05 crc kubenswrapper[5120]: I0316 16:42:05.724500 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e9e86e40-d30c-4208-852b-5d6737ba05ce-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"e9e86e40-d30c-4208-852b-5d6737ba05ce\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:42:05 crc kubenswrapper[5120]: I0316 16:42:05.724707 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/e9e86e40-d30c-4208-852b-5d6737ba05ce-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"e9e86e40-d30c-4208-852b-5d6737ba05ce\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:42:05 crc kubenswrapper[5120]: I0316 16:42:05.724992 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e9e86e40-d30c-4208-852b-5d6737ba05ce-logs\") pod \"nova-metadata-0\" (UID: \"e9e86e40-d30c-4208-852b-5d6737ba05ce\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:42:05 crc kubenswrapper[5120]: I0316 16:42:05.725397 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e9e86e40-d30c-4208-852b-5d6737ba05ce-logs\") pod \"nova-metadata-0\" (UID: \"e9e86e40-d30c-4208-852b-5d6737ba05ce\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:42:05 crc kubenswrapper[5120]: I0316 16:42:05.728326 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e9e86e40-d30c-4208-852b-5d6737ba05ce-config-data\") pod \"nova-metadata-0\" (UID: \"e9e86e40-d30c-4208-852b-5d6737ba05ce\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:42:05 crc kubenswrapper[5120]: I0316 16:42:05.729173 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/e9e86e40-d30c-4208-852b-5d6737ba05ce-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"e9e86e40-d30c-4208-852b-5d6737ba05ce\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:42:05 crc kubenswrapper[5120]: I0316 16:42:05.730013 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e9e86e40-d30c-4208-852b-5d6737ba05ce-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"e9e86e40-d30c-4208-852b-5d6737ba05ce\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:42:05 crc kubenswrapper[5120]: I0316 16:42:05.742901 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqmvz\" (UniqueName: \"kubernetes.io/projected/e9e86e40-d30c-4208-852b-5d6737ba05ce-kube-api-access-zqmvz\") pod \"nova-metadata-0\" (UID: \"e9e86e40-d30c-4208-852b-5d6737ba05ce\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:42:05 crc kubenswrapper[5120]: I0316 16:42:05.840986 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:42:05 crc kubenswrapper[5120]: I0316 16:42:05.943473 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:42:06 crc kubenswrapper[5120]: I0316 16:42:06.031344 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/32a29aa8-e796-4ad7-a221-a37189688d4c-logs\") pod \"32a29aa8-e796-4ad7-a221-a37189688d4c\" (UID: \"32a29aa8-e796-4ad7-a221-a37189688d4c\") " Mar 16 16:42:06 crc kubenswrapper[5120]: I0316 16:42:06.031952 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/32a29aa8-e796-4ad7-a221-a37189688d4c-combined-ca-bundle\") pod \"32a29aa8-e796-4ad7-a221-a37189688d4c\" (UID: \"32a29aa8-e796-4ad7-a221-a37189688d4c\") " Mar 16 16:42:06 crc kubenswrapper[5120]: I0316 16:42:06.032039 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32a29aa8-e796-4ad7-a221-a37189688d4c-logs" (OuterVolumeSpecName: "logs") pod "32a29aa8-e796-4ad7-a221-a37189688d4c" (UID: "32a29aa8-e796-4ad7-a221-a37189688d4c"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:42:06 crc kubenswrapper[5120]: I0316 16:42:06.035157 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/32a29aa8-e796-4ad7-a221-a37189688d4c-config-data\") pod \"32a29aa8-e796-4ad7-a221-a37189688d4c\" (UID: \"32a29aa8-e796-4ad7-a221-a37189688d4c\") " Mar 16 16:42:06 crc kubenswrapper[5120]: I0316 16:42:06.035627 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gxbjb\" (UniqueName: \"kubernetes.io/projected/32a29aa8-e796-4ad7-a221-a37189688d4c-kube-api-access-gxbjb\") pod \"32a29aa8-e796-4ad7-a221-a37189688d4c\" (UID: \"32a29aa8-e796-4ad7-a221-a37189688d4c\") " Mar 16 16:42:06 crc kubenswrapper[5120]: I0316 16:42:06.037904 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/32a29aa8-e796-4ad7-a221-a37189688d4c-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:42:06 crc kubenswrapper[5120]: I0316 16:42:06.044100 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32a29aa8-e796-4ad7-a221-a37189688d4c-kube-api-access-gxbjb" (OuterVolumeSpecName: "kube-api-access-gxbjb") pod "32a29aa8-e796-4ad7-a221-a37189688d4c" (UID: "32a29aa8-e796-4ad7-a221-a37189688d4c"). InnerVolumeSpecName "kube-api-access-gxbjb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:42:06 crc kubenswrapper[5120]: I0316 16:42:06.061540 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/32a29aa8-e796-4ad7-a221-a37189688d4c-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "32a29aa8-e796-4ad7-a221-a37189688d4c" (UID: "32a29aa8-e796-4ad7-a221-a37189688d4c"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:42:06 crc kubenswrapper[5120]: I0316 16:42:06.075544 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/32a29aa8-e796-4ad7-a221-a37189688d4c-config-data" (OuterVolumeSpecName: "config-data") pod "32a29aa8-e796-4ad7-a221-a37189688d4c" (UID: "32a29aa8-e796-4ad7-a221-a37189688d4c"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:42:06 crc kubenswrapper[5120]: I0316 16:42:06.146569 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/32a29aa8-e796-4ad7-a221-a37189688d4c-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:42:06 crc kubenswrapper[5120]: I0316 16:42:06.146618 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/32a29aa8-e796-4ad7-a221-a37189688d4c-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:42:06 crc kubenswrapper[5120]: I0316 16:42:06.146635 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gxbjb\" (UniqueName: \"kubernetes.io/projected/32a29aa8-e796-4ad7-a221-a37189688d4c-kube-api-access-gxbjb\") on node \"crc\" DevicePath \"\"" Mar 16 16:42:06 crc kubenswrapper[5120]: I0316 16:42:06.149186 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561322-5qbc2" event={"ID":"a1a93363-54ba-4785-bd0a-b4ff5dd043b6","Type":"ContainerDied","Data":"8badfdfea743f2a911b800bc3a7cb547d92c9549dc615d7ef13f015f878dbed4"} Mar 16 16:42:06 crc kubenswrapper[5120]: I0316 16:42:06.149221 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8badfdfea743f2a911b800bc3a7cb547d92c9549dc615d7ef13f015f878dbed4" Mar 16 16:42:06 crc kubenswrapper[5120]: I0316 16:42:06.149245 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561322-5qbc2" Mar 16 16:42:06 crc kubenswrapper[5120]: I0316 16:42:06.151328 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"93b8115e-671f-4dff-96ec-a78e9ad5b022","Type":"ContainerStarted","Data":"3d14626b44ab5c3bc55202348681585545fb5d1a830cebe64d74628a5af82166"} Mar 16 16:42:06 crc kubenswrapper[5120]: I0316 16:42:06.153886 5120 generic.go:358] "Generic (PLEG): container finished" podID="32a29aa8-e796-4ad7-a221-a37189688d4c" containerID="63c355c033ad99c34f2d2fe02087f6b89a0d866723906ced0372192e6203809c" exitCode=0 Mar 16 16:42:06 crc kubenswrapper[5120]: I0316 16:42:06.153970 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:42:06 crc kubenswrapper[5120]: I0316 16:42:06.153977 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"32a29aa8-e796-4ad7-a221-a37189688d4c","Type":"ContainerDied","Data":"63c355c033ad99c34f2d2fe02087f6b89a0d866723906ced0372192e6203809c"} Mar 16 16:42:06 crc kubenswrapper[5120]: I0316 16:42:06.154021 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"32a29aa8-e796-4ad7-a221-a37189688d4c","Type":"ContainerDied","Data":"dd57a1beed880d50baaf3fe703ebbf00b408ae4805039500796a4e8b547d52f5"} Mar 16 16:42:06 crc kubenswrapper[5120]: I0316 16:42:06.154059 5120 scope.go:117] "RemoveContainer" containerID="63c355c033ad99c34f2d2fe02087f6b89a0d866723906ced0372192e6203809c" Mar 16 16:42:06 crc kubenswrapper[5120]: I0316 16:42:06.176458 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-scheduler-0" podStartSLOduration=2.176435946 podStartE2EDuration="2.176435946s" podCreationTimestamp="2026-03-16 16:42:04 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:42:06.166749063 +0000 UTC m=+4228.320680720" watchObservedRunningTime="2026-03-16 16:42:06.176435946 +0000 UTC m=+4228.330367603" Mar 16 16:42:06 crc kubenswrapper[5120]: I0316 16:42:06.184015 5120 scope.go:117] "RemoveContainer" containerID="740ae4a73687633159c740d53e1fdc38ab4701f07ab235a9396b7ba617820c9d" Mar 16 16:42:06 crc kubenswrapper[5120]: I0316 16:42:06.210104 5120 scope.go:117] "RemoveContainer" containerID="63c355c033ad99c34f2d2fe02087f6b89a0d866723906ced0372192e6203809c" Mar 16 16:42:06 crc kubenswrapper[5120]: E0316 16:42:06.210624 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"63c355c033ad99c34f2d2fe02087f6b89a0d866723906ced0372192e6203809c\": container with ID starting with 63c355c033ad99c34f2d2fe02087f6b89a0d866723906ced0372192e6203809c not found: ID does not exist" containerID="63c355c033ad99c34f2d2fe02087f6b89a0d866723906ced0372192e6203809c" Mar 16 16:42:06 crc kubenswrapper[5120]: I0316 16:42:06.210682 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63c355c033ad99c34f2d2fe02087f6b89a0d866723906ced0372192e6203809c"} err="failed to get container status \"63c355c033ad99c34f2d2fe02087f6b89a0d866723906ced0372192e6203809c\": rpc error: code = NotFound desc = could not find container \"63c355c033ad99c34f2d2fe02087f6b89a0d866723906ced0372192e6203809c\": container with ID starting with 63c355c033ad99c34f2d2fe02087f6b89a0d866723906ced0372192e6203809c not found: ID does not exist" Mar 16 16:42:06 crc kubenswrapper[5120]: I0316 16:42:06.210706 5120 scope.go:117] "RemoveContainer" containerID="740ae4a73687633159c740d53e1fdc38ab4701f07ab235a9396b7ba617820c9d" Mar 16 16:42:06 crc kubenswrapper[5120]: I0316 16:42:06.210719 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:42:06 crc kubenswrapper[5120]: E0316 16:42:06.211215 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"740ae4a73687633159c740d53e1fdc38ab4701f07ab235a9396b7ba617820c9d\": container with ID starting with 740ae4a73687633159c740d53e1fdc38ab4701f07ab235a9396b7ba617820c9d not found: ID does not exist" containerID="740ae4a73687633159c740d53e1fdc38ab4701f07ab235a9396b7ba617820c9d" Mar 16 16:42:06 crc kubenswrapper[5120]: I0316 16:42:06.211245 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"740ae4a73687633159c740d53e1fdc38ab4701f07ab235a9396b7ba617820c9d"} err="failed to get container status \"740ae4a73687633159c740d53e1fdc38ab4701f07ab235a9396b7ba617820c9d\": rpc error: code = NotFound desc = could not find container \"740ae4a73687633159c740d53e1fdc38ab4701f07ab235a9396b7ba617820c9d\": container with ID starting with 740ae4a73687633159c740d53e1fdc38ab4701f07ab235a9396b7ba617820c9d not found: ID does not exist" Mar 16 16:42:06 crc kubenswrapper[5120]: I0316 16:42:06.225070 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:42:06 crc kubenswrapper[5120]: I0316 16:42:06.235076 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:42:06 crc kubenswrapper[5120]: I0316 16:42:06.237289 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32a29aa8-e796-4ad7-a221-a37189688d4c" containerName="nova-api-api" Mar 16 16:42:06 crc kubenswrapper[5120]: I0316 16:42:06.237312 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="32a29aa8-e796-4ad7-a221-a37189688d4c" containerName="nova-api-api" Mar 16 16:42:06 crc kubenswrapper[5120]: I0316 16:42:06.237371 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32a29aa8-e796-4ad7-a221-a37189688d4c" containerName="nova-api-log" Mar 16 16:42:06 crc kubenswrapper[5120]: I0316 16:42:06.237377 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="32a29aa8-e796-4ad7-a221-a37189688d4c" containerName="nova-api-log" Mar 16 16:42:06 crc kubenswrapper[5120]: I0316 16:42:06.237529 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="32a29aa8-e796-4ad7-a221-a37189688d4c" containerName="nova-api-api" Mar 16 16:42:06 crc kubenswrapper[5120]: I0316 16:42:06.237552 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="32a29aa8-e796-4ad7-a221-a37189688d4c" containerName="nova-api-log" Mar 16 16:42:06 crc kubenswrapper[5120]: I0316 16:42:06.246028 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:42:06 crc kubenswrapper[5120]: I0316 16:42:06.246237 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:42:06 crc kubenswrapper[5120]: I0316 16:42:06.251688 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-config-data\"" Mar 16 16:42:06 crc kubenswrapper[5120]: W0316 16:42:06.301799 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode9e86e40_d30c_4208_852b_5d6737ba05ce.slice/crio-4a75631155f7390685f76dfd8a06f3b39009a58624bc535bd87bf3af735ea68d WatchSource:0}: Error finding container 4a75631155f7390685f76dfd8a06f3b39009a58624bc535bd87bf3af735ea68d: Status 404 returned error can't find the container with id 4a75631155f7390685f76dfd8a06f3b39009a58624bc535bd87bf3af735ea68d Mar 16 16:42:06 crc kubenswrapper[5120]: I0316 16:42:06.308981 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:42:06 crc kubenswrapper[5120]: I0316 16:42:06.357262 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7bd0c2eb-f112-4c50-bf17-5e89da8bfa75-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"7bd0c2eb-f112-4c50-bf17-5e89da8bfa75\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:42:06 crc kubenswrapper[5120]: I0316 16:42:06.357568 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7bd0c2eb-f112-4c50-bf17-5e89da8bfa75-logs\") pod \"nova-api-0\" (UID: \"7bd0c2eb-f112-4c50-bf17-5e89da8bfa75\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:42:06 crc kubenswrapper[5120]: I0316 16:42:06.357862 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7bd0c2eb-f112-4c50-bf17-5e89da8bfa75-config-data\") pod \"nova-api-0\" (UID: \"7bd0c2eb-f112-4c50-bf17-5e89da8bfa75\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:42:06 crc kubenswrapper[5120]: I0316 16:42:06.357907 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwmfx\" (UniqueName: \"kubernetes.io/projected/7bd0c2eb-f112-4c50-bf17-5e89da8bfa75-kube-api-access-vwmfx\") pod \"nova-api-0\" (UID: \"7bd0c2eb-f112-4c50-bf17-5e89da8bfa75\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:42:06 crc kubenswrapper[5120]: I0316 16:42:06.459541 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7bd0c2eb-f112-4c50-bf17-5e89da8bfa75-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"7bd0c2eb-f112-4c50-bf17-5e89da8bfa75\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:42:06 crc kubenswrapper[5120]: I0316 16:42:06.459668 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7bd0c2eb-f112-4c50-bf17-5e89da8bfa75-logs\") pod \"nova-api-0\" (UID: \"7bd0c2eb-f112-4c50-bf17-5e89da8bfa75\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:42:06 crc kubenswrapper[5120]: I0316 16:42:06.459798 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7bd0c2eb-f112-4c50-bf17-5e89da8bfa75-config-data\") pod \"nova-api-0\" (UID: \"7bd0c2eb-f112-4c50-bf17-5e89da8bfa75\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:42:06 crc kubenswrapper[5120]: I0316 16:42:06.459824 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vwmfx\" (UniqueName: \"kubernetes.io/projected/7bd0c2eb-f112-4c50-bf17-5e89da8bfa75-kube-api-access-vwmfx\") pod \"nova-api-0\" (UID: \"7bd0c2eb-f112-4c50-bf17-5e89da8bfa75\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:42:06 crc kubenswrapper[5120]: I0316 16:42:06.462999 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7bd0c2eb-f112-4c50-bf17-5e89da8bfa75-logs\") pod \"nova-api-0\" (UID: \"7bd0c2eb-f112-4c50-bf17-5e89da8bfa75\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:42:06 crc kubenswrapper[5120]: I0316 16:42:06.467155 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7bd0c2eb-f112-4c50-bf17-5e89da8bfa75-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"7bd0c2eb-f112-4c50-bf17-5e89da8bfa75\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:42:06 crc kubenswrapper[5120]: I0316 16:42:06.467456 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7bd0c2eb-f112-4c50-bf17-5e89da8bfa75-config-data\") pod \"nova-api-0\" (UID: \"7bd0c2eb-f112-4c50-bf17-5e89da8bfa75\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:42:06 crc kubenswrapper[5120]: I0316 16:42:06.474457 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-infra/auto-csr-approver-29561316-m6nsl"] Mar 16 16:42:06 crc kubenswrapper[5120]: I0316 16:42:06.480900 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwmfx\" (UniqueName: \"kubernetes.io/projected/7bd0c2eb-f112-4c50-bf17-5e89da8bfa75-kube-api-access-vwmfx\") pod \"nova-api-0\" (UID: \"7bd0c2eb-f112-4c50-bf17-5e89da8bfa75\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:42:06 crc kubenswrapper[5120]: I0316 16:42:06.483173 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-infra/auto-csr-approver-29561316-m6nsl"] Mar 16 16:42:06 crc kubenswrapper[5120]: I0316 16:42:06.567337 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:42:06 crc kubenswrapper[5120]: I0316 16:42:06.680667 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="32a29aa8-e796-4ad7-a221-a37189688d4c" path="/var/lib/kubelet/pods/32a29aa8-e796-4ad7-a221-a37189688d4c/volumes" Mar 16 16:42:06 crc kubenswrapper[5120]: I0316 16:42:06.681355 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cab9c74d-69a9-44ee-965f-bd31954a1976" path="/var/lib/kubelet/pods/cab9c74d-69a9-44ee-965f-bd31954a1976/volumes" Mar 16 16:42:06 crc kubenswrapper[5120]: I0316 16:42:06.682270 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f5e0b05c-87b8-4e48-af1b-c1b085931771" path="/var/lib/kubelet/pods/f5e0b05c-87b8-4e48-af1b-c1b085931771/volumes" Mar 16 16:42:07 crc kubenswrapper[5120]: I0316 16:42:07.006257 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:42:07 crc kubenswrapper[5120]: I0316 16:42:07.163648 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"7bd0c2eb-f112-4c50-bf17-5e89da8bfa75","Type":"ContainerStarted","Data":"93411b00bf6ff54a2a08728db655397c30ccecfee77de3977eda0887cefc57f6"} Mar 16 16:42:07 crc kubenswrapper[5120]: I0316 16:42:07.166277 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"e9e86e40-d30c-4208-852b-5d6737ba05ce","Type":"ContainerStarted","Data":"90f7776ae4d6e0446a5d45a429255d7b79feb97a72344584de1b162bd35dd26e"} Mar 16 16:42:07 crc kubenswrapper[5120]: I0316 16:42:07.166302 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"e9e86e40-d30c-4208-852b-5d6737ba05ce","Type":"ContainerStarted","Data":"9ea9db94f867aa536c9a5bdcc6cf83c48c8a9bcef57187ed927a4383f38d4b5b"} Mar 16 16:42:07 crc kubenswrapper[5120]: I0316 16:42:07.166310 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"e9e86e40-d30c-4208-852b-5d6737ba05ce","Type":"ContainerStarted","Data":"4a75631155f7390685f76dfd8a06f3b39009a58624bc535bd87bf3af735ea68d"} Mar 16 16:42:07 crc kubenswrapper[5120]: I0316 16:42:07.188068 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=2.188051541 podStartE2EDuration="2.188051541s" podCreationTimestamp="2026-03-16 16:42:05 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:42:07.182551022 +0000 UTC m=+4229.336482699" watchObservedRunningTime="2026-03-16 16:42:07.188051541 +0000 UTC m=+4229.341983198" Mar 16 16:42:08 crc kubenswrapper[5120]: E0316 16:42:08.155132 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1868309 actualBytes=10240 Mar 16 16:42:08 crc kubenswrapper[5120]: I0316 16:42:08.182703 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"7bd0c2eb-f112-4c50-bf17-5e89da8bfa75","Type":"ContainerStarted","Data":"7adc639a086d6e651d315f10c579ad16f93b4757771eba07433864bd701481fa"} Mar 16 16:42:08 crc kubenswrapper[5120]: I0316 16:42:08.182742 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"7bd0c2eb-f112-4c50-bf17-5e89da8bfa75","Type":"ContainerStarted","Data":"045ba43a0733937687db24db6e21066980a4a874bcaa85bcc17c5d8cfd448ee5"} Mar 16 16:42:08 crc kubenswrapper[5120]: I0316 16:42:08.209883 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=2.209861044 podStartE2EDuration="2.209861044s" podCreationTimestamp="2026-03-16 16:42:06 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:42:08.200158711 +0000 UTC m=+4230.354090378" watchObservedRunningTime="2026-03-16 16:42:08.209861044 +0000 UTC m=+4230.363792701" Mar 16 16:42:09 crc kubenswrapper[5120]: I0316 16:42:09.526385 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:42:14 crc kubenswrapper[5120]: I0316 16:42:14.527456 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:42:14 crc kubenswrapper[5120]: I0316 16:42:14.558794 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:42:15 crc kubenswrapper[5120]: I0316 16:42:15.294804 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:42:15 crc kubenswrapper[5120]: I0316 16:42:15.842127 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:42:15 crc kubenswrapper[5120]: I0316 16:42:15.842176 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:42:16 crc kubenswrapper[5120]: I0316 16:42:16.578042 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:42:16 crc kubenswrapper[5120]: I0316 16:42:16.578083 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:42:16 crc kubenswrapper[5120]: I0316 16:42:16.848997 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="e9e86e40-d30c-4208-852b-5d6737ba05ce" containerName="nova-metadata-log" probeResult="failure" output="Get \"https://10.217.1.103:8775/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Mar 16 16:42:16 crc kubenswrapper[5120]: I0316 16:42:16.849020 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="e9e86e40-d30c-4208-852b-5d6737ba05ce" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"https://10.217.1.103:8775/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 16:42:17 crc kubenswrapper[5120]: I0316 16:42:17.619231 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="7bd0c2eb-f112-4c50-bf17-5e89da8bfa75" containerName="nova-api-api" probeResult="failure" output="Get \"http://10.217.1.104:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 16:42:17 crc kubenswrapper[5120]: I0316 16:42:17.619268 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="7bd0c2eb-f112-4c50-bf17-5e89da8bfa75" containerName="nova-api-log" probeResult="failure" output="Get \"http://10.217.1.104:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 16:42:18 crc kubenswrapper[5120]: I0316 16:42:18.310164 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-marketplace-wh5hj"] Mar 16 16:42:18 crc kubenswrapper[5120]: I0316 16:42:18.325912 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-wh5hj"] Mar 16 16:42:18 crc kubenswrapper[5120]: I0316 16:42:18.326164 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-wh5hj" Mar 16 16:42:18 crc kubenswrapper[5120]: I0316 16:42:18.390636 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m94lx\" (UniqueName: \"kubernetes.io/projected/858759f8-3490-4061-b79a-26281f9f3186-kube-api-access-m94lx\") pod \"redhat-marketplace-wh5hj\" (UID: \"858759f8-3490-4061-b79a-26281f9f3186\") " pod="openshift-marketplace/redhat-marketplace-wh5hj" Mar 16 16:42:18 crc kubenswrapper[5120]: I0316 16:42:18.390790 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/858759f8-3490-4061-b79a-26281f9f3186-catalog-content\") pod \"redhat-marketplace-wh5hj\" (UID: \"858759f8-3490-4061-b79a-26281f9f3186\") " pod="openshift-marketplace/redhat-marketplace-wh5hj" Mar 16 16:42:18 crc kubenswrapper[5120]: I0316 16:42:18.391010 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/858759f8-3490-4061-b79a-26281f9f3186-utilities\") pod \"redhat-marketplace-wh5hj\" (UID: \"858759f8-3490-4061-b79a-26281f9f3186\") " pod="openshift-marketplace/redhat-marketplace-wh5hj" Mar 16 16:42:18 crc kubenswrapper[5120]: I0316 16:42:18.493482 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/858759f8-3490-4061-b79a-26281f9f3186-utilities\") pod \"redhat-marketplace-wh5hj\" (UID: \"858759f8-3490-4061-b79a-26281f9f3186\") " pod="openshift-marketplace/redhat-marketplace-wh5hj" Mar 16 16:42:18 crc kubenswrapper[5120]: I0316 16:42:18.493804 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m94lx\" (UniqueName: \"kubernetes.io/projected/858759f8-3490-4061-b79a-26281f9f3186-kube-api-access-m94lx\") pod \"redhat-marketplace-wh5hj\" (UID: \"858759f8-3490-4061-b79a-26281f9f3186\") " pod="openshift-marketplace/redhat-marketplace-wh5hj" Mar 16 16:42:18 crc kubenswrapper[5120]: I0316 16:42:18.494061 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/858759f8-3490-4061-b79a-26281f9f3186-catalog-content\") pod \"redhat-marketplace-wh5hj\" (UID: \"858759f8-3490-4061-b79a-26281f9f3186\") " pod="openshift-marketplace/redhat-marketplace-wh5hj" Mar 16 16:42:18 crc kubenswrapper[5120]: I0316 16:42:18.494389 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/858759f8-3490-4061-b79a-26281f9f3186-utilities\") pod \"redhat-marketplace-wh5hj\" (UID: \"858759f8-3490-4061-b79a-26281f9f3186\") " pod="openshift-marketplace/redhat-marketplace-wh5hj" Mar 16 16:42:18 crc kubenswrapper[5120]: I0316 16:42:18.494729 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/858759f8-3490-4061-b79a-26281f9f3186-catalog-content\") pod \"redhat-marketplace-wh5hj\" (UID: \"858759f8-3490-4061-b79a-26281f9f3186\") " pod="openshift-marketplace/redhat-marketplace-wh5hj" Mar 16 16:42:18 crc kubenswrapper[5120]: I0316 16:42:18.519141 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m94lx\" (UniqueName: \"kubernetes.io/projected/858759f8-3490-4061-b79a-26281f9f3186-kube-api-access-m94lx\") pod \"redhat-marketplace-wh5hj\" (UID: \"858759f8-3490-4061-b79a-26281f9f3186\") " pod="openshift-marketplace/redhat-marketplace-wh5hj" Mar 16 16:42:18 crc kubenswrapper[5120]: I0316 16:42:18.653755 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-wh5hj" Mar 16 16:42:19 crc kubenswrapper[5120]: I0316 16:42:19.083812 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-wh5hj"] Mar 16 16:42:19 crc kubenswrapper[5120]: W0316 16:42:19.086044 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod858759f8_3490_4061_b79a_26281f9f3186.slice/crio-0184dff5ca81fc8d3e36df54da0b0fd39583325cf7dc43de58afb017a7cffe54 WatchSource:0}: Error finding container 0184dff5ca81fc8d3e36df54da0b0fd39583325cf7dc43de58afb017a7cffe54: Status 404 returned error can't find the container with id 0184dff5ca81fc8d3e36df54da0b0fd39583325cf7dc43de58afb017a7cffe54 Mar 16 16:42:19 crc kubenswrapper[5120]: I0316 16:42:19.336957 5120 generic.go:358] "Generic (PLEG): container finished" podID="858759f8-3490-4061-b79a-26281f9f3186" containerID="2e789975ec1d7ca2b6242b2444748635f52d4638709749792a3b69280485c609" exitCode=0 Mar 16 16:42:19 crc kubenswrapper[5120]: I0316 16:42:19.337441 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-wh5hj" event={"ID":"858759f8-3490-4061-b79a-26281f9f3186","Type":"ContainerDied","Data":"2e789975ec1d7ca2b6242b2444748635f52d4638709749792a3b69280485c609"} Mar 16 16:42:19 crc kubenswrapper[5120]: I0316 16:42:19.337472 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-wh5hj" event={"ID":"858759f8-3490-4061-b79a-26281f9f3186","Type":"ContainerStarted","Data":"0184dff5ca81fc8d3e36df54da0b0fd39583325cf7dc43de58afb017a7cffe54"} Mar 16 16:42:20 crc kubenswrapper[5120]: I0316 16:42:20.351540 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-wh5hj" event={"ID":"858759f8-3490-4061-b79a-26281f9f3186","Type":"ContainerStarted","Data":"0c1ab179274af48521cb21f9c6a6b6ae2ef0e7800bb9d109dff41c8f4cf3a529"} Mar 16 16:42:21 crc kubenswrapper[5120]: I0316 16:42:21.367098 5120 generic.go:358] "Generic (PLEG): container finished" podID="858759f8-3490-4061-b79a-26281f9f3186" containerID="0c1ab179274af48521cb21f9c6a6b6ae2ef0e7800bb9d109dff41c8f4cf3a529" exitCode=0 Mar 16 16:42:21 crc kubenswrapper[5120]: I0316 16:42:21.367216 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-wh5hj" event={"ID":"858759f8-3490-4061-b79a-26281f9f3186","Type":"ContainerDied","Data":"0c1ab179274af48521cb21f9c6a6b6ae2ef0e7800bb9d109dff41c8f4cf3a529"} Mar 16 16:42:22 crc kubenswrapper[5120]: I0316 16:42:22.008033 5120 patch_prober.go:28] interesting pod/machine-config-daemon-7bf76 container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 16:42:22 crc kubenswrapper[5120]: I0316 16:42:22.008464 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 16:42:22 crc kubenswrapper[5120]: I0316 16:42:22.400079 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-wh5hj" event={"ID":"858759f8-3490-4061-b79a-26281f9f3186","Type":"ContainerStarted","Data":"58c2ca57de944ecb928a9c5715f6d46b8c643fcad182fe327ea68e62e452237a"} Mar 16 16:42:22 crc kubenswrapper[5120]: I0316 16:42:22.428087 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/redhat-marketplace-wh5hj" podStartSLOduration=3.781269618 podStartE2EDuration="4.428069063s" podCreationTimestamp="2026-03-16 16:42:18 +0000 UTC" firstStartedPulling="2026-03-16 16:42:19.338791038 +0000 UTC m=+4241.492722705" lastFinishedPulling="2026-03-16 16:42:19.985590483 +0000 UTC m=+4242.139522150" observedRunningTime="2026-03-16 16:42:22.417154976 +0000 UTC m=+4244.571086643" watchObservedRunningTime="2026-03-16 16:42:22.428069063 +0000 UTC m=+4244.582000720" Mar 16 16:42:23 crc kubenswrapper[5120]: I0316 16:42:23.842156 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:42:23 crc kubenswrapper[5120]: I0316 16:42:23.842487 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:42:23 crc kubenswrapper[5120]: I0316 16:42:23.971426 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:42:24 crc kubenswrapper[5120]: I0316 16:42:24.568701 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:42:24 crc kubenswrapper[5120]: I0316 16:42:24.568772 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:42:25 crc kubenswrapper[5120]: I0316 16:42:25.848405 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:42:25 crc kubenswrapper[5120]: I0316 16:42:25.855585 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:42:25 crc kubenswrapper[5120]: I0316 16:42:25.863728 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:42:26 crc kubenswrapper[5120]: I0316 16:42:26.454920 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:42:26 crc kubenswrapper[5120]: I0316 16:42:26.571488 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:42:26 crc kubenswrapper[5120]: I0316 16:42:26.574742 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:42:26 crc kubenswrapper[5120]: I0316 16:42:26.575337 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:42:27 crc kubenswrapper[5120]: I0316 16:42:27.460665 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:42:28 crc kubenswrapper[5120]: I0316 16:42:28.654830 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-marketplace/redhat-marketplace-wh5hj" Mar 16 16:42:28 crc kubenswrapper[5120]: I0316 16:42:28.655220 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-marketplace-wh5hj" Mar 16 16:42:28 crc kubenswrapper[5120]: I0316 16:42:28.720175 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-marketplace-wh5hj" Mar 16 16:42:29 crc kubenswrapper[5120]: I0316 16:42:29.410476 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:42:29 crc kubenswrapper[5120]: I0316 16:42:29.411048 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="2062cbff-20d9-4bdb-b60f-881144c1f24f" containerName="ceilometer-central-agent" containerID="cri-o://5cb27040906683b297a4a42ef5af0a9e3aab330c2e0ee757e45576b0b978c3cc" gracePeriod=30 Mar 16 16:42:29 crc kubenswrapper[5120]: I0316 16:42:29.411080 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="2062cbff-20d9-4bdb-b60f-881144c1f24f" containerName="sg-core" containerID="cri-o://7c5e3f0e727250bf3f2a31f72787be3de45282f97b742fc57f9c89dbfbe8db24" gracePeriod=30 Mar 16 16:42:29 crc kubenswrapper[5120]: I0316 16:42:29.411100 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="2062cbff-20d9-4bdb-b60f-881144c1f24f" containerName="proxy-httpd" containerID="cri-o://bbe208005febe64ceddc97996dbe752bb70fa2569e8ff1eae306370be0543432" gracePeriod=30 Mar 16 16:42:29 crc kubenswrapper[5120]: I0316 16:42:29.411222 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="2062cbff-20d9-4bdb-b60f-881144c1f24f" containerName="ceilometer-notification-agent" containerID="cri-o://2d6a0c0239ca2781ec00d865e62c06c06f6aa0cd564398071e7f165ea6faafe0" gracePeriod=30 Mar 16 16:42:29 crc kubenswrapper[5120]: I0316 16:42:29.522334 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-marketplace-wh5hj" Mar 16 16:42:29 crc kubenswrapper[5120]: I0316 16:42:29.572728 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-marketplace-wh5hj"] Mar 16 16:42:29 crc kubenswrapper[5120]: E0316 16:42:29.965256 5120 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2062cbff_20d9_4bdb_b60f_881144c1f24f.slice/crio-conmon-5cb27040906683b297a4a42ef5af0a9e3aab330c2e0ee757e45576b0b978c3cc.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2062cbff_20d9_4bdb_b60f_881144c1f24f.slice/crio-5cb27040906683b297a4a42ef5af0a9e3aab330c2e0ee757e45576b0b978c3cc.scope\": RecentStats: unable to find data in memory cache]" Mar 16 16:42:30 crc kubenswrapper[5120]: I0316 16:42:30.355254 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:42:30 crc kubenswrapper[5120]: I0316 16:42:30.454023 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:42:30 crc kubenswrapper[5120]: I0316 16:42:30.494229 5120 generic.go:358] "Generic (PLEG): container finished" podID="2062cbff-20d9-4bdb-b60f-881144c1f24f" containerID="bbe208005febe64ceddc97996dbe752bb70fa2569e8ff1eae306370be0543432" exitCode=0 Mar 16 16:42:30 crc kubenswrapper[5120]: I0316 16:42:30.494265 5120 generic.go:358] "Generic (PLEG): container finished" podID="2062cbff-20d9-4bdb-b60f-881144c1f24f" containerID="7c5e3f0e727250bf3f2a31f72787be3de45282f97b742fc57f9c89dbfbe8db24" exitCode=2 Mar 16 16:42:30 crc kubenswrapper[5120]: I0316 16:42:30.494274 5120 generic.go:358] "Generic (PLEG): container finished" podID="2062cbff-20d9-4bdb-b60f-881144c1f24f" containerID="2d6a0c0239ca2781ec00d865e62c06c06f6aa0cd564398071e7f165ea6faafe0" exitCode=0 Mar 16 16:42:30 crc kubenswrapper[5120]: I0316 16:42:30.494282 5120 generic.go:358] "Generic (PLEG): container finished" podID="2062cbff-20d9-4bdb-b60f-881144c1f24f" containerID="5cb27040906683b297a4a42ef5af0a9e3aab330c2e0ee757e45576b0b978c3cc" exitCode=0 Mar 16 16:42:30 crc kubenswrapper[5120]: I0316 16:42:30.494374 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"2062cbff-20d9-4bdb-b60f-881144c1f24f","Type":"ContainerDied","Data":"bbe208005febe64ceddc97996dbe752bb70fa2569e8ff1eae306370be0543432"} Mar 16 16:42:30 crc kubenswrapper[5120]: I0316 16:42:30.494433 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"2062cbff-20d9-4bdb-b60f-881144c1f24f","Type":"ContainerDied","Data":"7c5e3f0e727250bf3f2a31f72787be3de45282f97b742fc57f9c89dbfbe8db24"} Mar 16 16:42:30 crc kubenswrapper[5120]: I0316 16:42:30.494451 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"2062cbff-20d9-4bdb-b60f-881144c1f24f","Type":"ContainerDied","Data":"2d6a0c0239ca2781ec00d865e62c06c06f6aa0cd564398071e7f165ea6faafe0"} Mar 16 16:42:30 crc kubenswrapper[5120]: I0316 16:42:30.494462 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"2062cbff-20d9-4bdb-b60f-881144c1f24f","Type":"ContainerDied","Data":"5cb27040906683b297a4a42ef5af0a9e3aab330c2e0ee757e45576b0b978c3cc"} Mar 16 16:42:30 crc kubenswrapper[5120]: I0316 16:42:30.494474 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"2062cbff-20d9-4bdb-b60f-881144c1f24f","Type":"ContainerDied","Data":"4e6c0b459e2b047a5077279157b35fe67d81e13ca2d6322bd5005bee90f68d6f"} Mar 16 16:42:30 crc kubenswrapper[5120]: I0316 16:42:30.494495 5120 scope.go:117] "RemoveContainer" containerID="bbe208005febe64ceddc97996dbe752bb70fa2569e8ff1eae306370be0543432" Mar 16 16:42:30 crc kubenswrapper[5120]: I0316 16:42:30.494645 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:42:30 crc kubenswrapper[5120]: I0316 16:42:30.498354 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="7bd0c2eb-f112-4c50-bf17-5e89da8bfa75" containerName="nova-api-log" containerID="cri-o://045ba43a0733937687db24db6e21066980a4a874bcaa85bcc17c5d8cfd448ee5" gracePeriod=30 Mar 16 16:42:30 crc kubenswrapper[5120]: I0316 16:42:30.498464 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="7bd0c2eb-f112-4c50-bf17-5e89da8bfa75" containerName="nova-api-api" containerID="cri-o://7adc639a086d6e651d315f10c579ad16f93b4757771eba07433864bd701481fa" gracePeriod=30 Mar 16 16:42:30 crc kubenswrapper[5120]: I0316 16:42:30.529111 5120 scope.go:117] "RemoveContainer" containerID="7c5e3f0e727250bf3f2a31f72787be3de45282f97b742fc57f9c89dbfbe8db24" Mar 16 16:42:30 crc kubenswrapper[5120]: I0316 16:42:30.592014 5120 scope.go:117] "RemoveContainer" containerID="2d6a0c0239ca2781ec00d865e62c06c06f6aa0cd564398071e7f165ea6faafe0" Mar 16 16:42:30 crc kubenswrapper[5120]: I0316 16:42:30.613447 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2062cbff-20d9-4bdb-b60f-881144c1f24f-combined-ca-bundle\") pod \"2062cbff-20d9-4bdb-b60f-881144c1f24f\" (UID: \"2062cbff-20d9-4bdb-b60f-881144c1f24f\") " Mar 16 16:42:30 crc kubenswrapper[5120]: I0316 16:42:30.613555 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/2062cbff-20d9-4bdb-b60f-881144c1f24f-ceilometer-tls-certs\") pod \"2062cbff-20d9-4bdb-b60f-881144c1f24f\" (UID: \"2062cbff-20d9-4bdb-b60f-881144c1f24f\") " Mar 16 16:42:30 crc kubenswrapper[5120]: I0316 16:42:30.613683 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2062cbff-20d9-4bdb-b60f-881144c1f24f-run-httpd\") pod \"2062cbff-20d9-4bdb-b60f-881144c1f24f\" (UID: \"2062cbff-20d9-4bdb-b60f-881144c1f24f\") " Mar 16 16:42:30 crc kubenswrapper[5120]: I0316 16:42:30.613827 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-np5r5\" (UniqueName: \"kubernetes.io/projected/2062cbff-20d9-4bdb-b60f-881144c1f24f-kube-api-access-np5r5\") pod \"2062cbff-20d9-4bdb-b60f-881144c1f24f\" (UID: \"2062cbff-20d9-4bdb-b60f-881144c1f24f\") " Mar 16 16:42:30 crc kubenswrapper[5120]: I0316 16:42:30.613983 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2062cbff-20d9-4bdb-b60f-881144c1f24f-config-data\") pod \"2062cbff-20d9-4bdb-b60f-881144c1f24f\" (UID: \"2062cbff-20d9-4bdb-b60f-881144c1f24f\") " Mar 16 16:42:30 crc kubenswrapper[5120]: I0316 16:42:30.614353 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/2062cbff-20d9-4bdb-b60f-881144c1f24f-sg-core-conf-yaml\") pod \"2062cbff-20d9-4bdb-b60f-881144c1f24f\" (UID: \"2062cbff-20d9-4bdb-b60f-881144c1f24f\") " Mar 16 16:42:30 crc kubenswrapper[5120]: I0316 16:42:30.614442 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2062cbff-20d9-4bdb-b60f-881144c1f24f-scripts\") pod \"2062cbff-20d9-4bdb-b60f-881144c1f24f\" (UID: \"2062cbff-20d9-4bdb-b60f-881144c1f24f\") " Mar 16 16:42:30 crc kubenswrapper[5120]: I0316 16:42:30.614666 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2062cbff-20d9-4bdb-b60f-881144c1f24f-log-httpd\") pod \"2062cbff-20d9-4bdb-b60f-881144c1f24f\" (UID: \"2062cbff-20d9-4bdb-b60f-881144c1f24f\") " Mar 16 16:42:30 crc kubenswrapper[5120]: I0316 16:42:30.619088 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2062cbff-20d9-4bdb-b60f-881144c1f24f-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "2062cbff-20d9-4bdb-b60f-881144c1f24f" (UID: "2062cbff-20d9-4bdb-b60f-881144c1f24f"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:42:30 crc kubenswrapper[5120]: I0316 16:42:30.621239 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2062cbff-20d9-4bdb-b60f-881144c1f24f-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "2062cbff-20d9-4bdb-b60f-881144c1f24f" (UID: "2062cbff-20d9-4bdb-b60f-881144c1f24f"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:42:30 crc kubenswrapper[5120]: I0316 16:42:30.622866 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2062cbff-20d9-4bdb-b60f-881144c1f24f-scripts" (OuterVolumeSpecName: "scripts") pod "2062cbff-20d9-4bdb-b60f-881144c1f24f" (UID: "2062cbff-20d9-4bdb-b60f-881144c1f24f"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:42:30 crc kubenswrapper[5120]: I0316 16:42:30.622910 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2062cbff-20d9-4bdb-b60f-881144c1f24f-kube-api-access-np5r5" (OuterVolumeSpecName: "kube-api-access-np5r5") pod "2062cbff-20d9-4bdb-b60f-881144c1f24f" (UID: "2062cbff-20d9-4bdb-b60f-881144c1f24f"). InnerVolumeSpecName "kube-api-access-np5r5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:42:30 crc kubenswrapper[5120]: I0316 16:42:30.623621 5120 scope.go:117] "RemoveContainer" containerID="5cb27040906683b297a4a42ef5af0a9e3aab330c2e0ee757e45576b0b978c3cc" Mar 16 16:42:30 crc kubenswrapper[5120]: I0316 16:42:30.649846 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2062cbff-20d9-4bdb-b60f-881144c1f24f-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "2062cbff-20d9-4bdb-b60f-881144c1f24f" (UID: "2062cbff-20d9-4bdb-b60f-881144c1f24f"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:42:30 crc kubenswrapper[5120]: I0316 16:42:30.675933 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2062cbff-20d9-4bdb-b60f-881144c1f24f-ceilometer-tls-certs" (OuterVolumeSpecName: "ceilometer-tls-certs") pod "2062cbff-20d9-4bdb-b60f-881144c1f24f" (UID: "2062cbff-20d9-4bdb-b60f-881144c1f24f"). InnerVolumeSpecName "ceilometer-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:42:30 crc kubenswrapper[5120]: I0316 16:42:30.709128 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2062cbff-20d9-4bdb-b60f-881144c1f24f-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "2062cbff-20d9-4bdb-b60f-881144c1f24f" (UID: "2062cbff-20d9-4bdb-b60f-881144c1f24f"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:42:30 crc kubenswrapper[5120]: I0316 16:42:30.718310 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2062cbff-20d9-4bdb-b60f-881144c1f24f-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:42:30 crc kubenswrapper[5120]: I0316 16:42:30.718349 5120 reconciler_common.go:299] "Volume detached for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/2062cbff-20d9-4bdb-b60f-881144c1f24f-ceilometer-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:42:30 crc kubenswrapper[5120]: I0316 16:42:30.718364 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2062cbff-20d9-4bdb-b60f-881144c1f24f-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:42:30 crc kubenswrapper[5120]: I0316 16:42:30.718375 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-np5r5\" (UniqueName: \"kubernetes.io/projected/2062cbff-20d9-4bdb-b60f-881144c1f24f-kube-api-access-np5r5\") on node \"crc\" DevicePath \"\"" Mar 16 16:42:30 crc kubenswrapper[5120]: I0316 16:42:30.718388 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/2062cbff-20d9-4bdb-b60f-881144c1f24f-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 16:42:30 crc kubenswrapper[5120]: I0316 16:42:30.718396 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2062cbff-20d9-4bdb-b60f-881144c1f24f-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:42:30 crc kubenswrapper[5120]: I0316 16:42:30.718406 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2062cbff-20d9-4bdb-b60f-881144c1f24f-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:42:30 crc kubenswrapper[5120]: I0316 16:42:30.742488 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2062cbff-20d9-4bdb-b60f-881144c1f24f-config-data" (OuterVolumeSpecName: "config-data") pod "2062cbff-20d9-4bdb-b60f-881144c1f24f" (UID: "2062cbff-20d9-4bdb-b60f-881144c1f24f"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:42:30 crc kubenswrapper[5120]: I0316 16:42:30.820490 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2062cbff-20d9-4bdb-b60f-881144c1f24f-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:42:30 crc kubenswrapper[5120]: I0316 16:42:30.834109 5120 scope.go:117] "RemoveContainer" containerID="bbe208005febe64ceddc97996dbe752bb70fa2569e8ff1eae306370be0543432" Mar 16 16:42:30 crc kubenswrapper[5120]: E0316 16:42:30.834647 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bbe208005febe64ceddc97996dbe752bb70fa2569e8ff1eae306370be0543432\": container with ID starting with bbe208005febe64ceddc97996dbe752bb70fa2569e8ff1eae306370be0543432 not found: ID does not exist" containerID="bbe208005febe64ceddc97996dbe752bb70fa2569e8ff1eae306370be0543432" Mar 16 16:42:30 crc kubenswrapper[5120]: I0316 16:42:30.834684 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bbe208005febe64ceddc97996dbe752bb70fa2569e8ff1eae306370be0543432"} err="failed to get container status \"bbe208005febe64ceddc97996dbe752bb70fa2569e8ff1eae306370be0543432\": rpc error: code = NotFound desc = could not find container \"bbe208005febe64ceddc97996dbe752bb70fa2569e8ff1eae306370be0543432\": container with ID starting with bbe208005febe64ceddc97996dbe752bb70fa2569e8ff1eae306370be0543432 not found: ID does not exist" Mar 16 16:42:30 crc kubenswrapper[5120]: I0316 16:42:30.834708 5120 scope.go:117] "RemoveContainer" containerID="7c5e3f0e727250bf3f2a31f72787be3de45282f97b742fc57f9c89dbfbe8db24" Mar 16 16:42:30 crc kubenswrapper[5120]: E0316 16:42:30.835238 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c5e3f0e727250bf3f2a31f72787be3de45282f97b742fc57f9c89dbfbe8db24\": container with ID starting with 7c5e3f0e727250bf3f2a31f72787be3de45282f97b742fc57f9c89dbfbe8db24 not found: ID does not exist" containerID="7c5e3f0e727250bf3f2a31f72787be3de45282f97b742fc57f9c89dbfbe8db24" Mar 16 16:42:30 crc kubenswrapper[5120]: I0316 16:42:30.835275 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c5e3f0e727250bf3f2a31f72787be3de45282f97b742fc57f9c89dbfbe8db24"} err="failed to get container status \"7c5e3f0e727250bf3f2a31f72787be3de45282f97b742fc57f9c89dbfbe8db24\": rpc error: code = NotFound desc = could not find container \"7c5e3f0e727250bf3f2a31f72787be3de45282f97b742fc57f9c89dbfbe8db24\": container with ID starting with 7c5e3f0e727250bf3f2a31f72787be3de45282f97b742fc57f9c89dbfbe8db24 not found: ID does not exist" Mar 16 16:42:30 crc kubenswrapper[5120]: I0316 16:42:30.835297 5120 scope.go:117] "RemoveContainer" containerID="2d6a0c0239ca2781ec00d865e62c06c06f6aa0cd564398071e7f165ea6faafe0" Mar 16 16:42:30 crc kubenswrapper[5120]: E0316 16:42:30.835596 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d6a0c0239ca2781ec00d865e62c06c06f6aa0cd564398071e7f165ea6faafe0\": container with ID starting with 2d6a0c0239ca2781ec00d865e62c06c06f6aa0cd564398071e7f165ea6faafe0 not found: ID does not exist" containerID="2d6a0c0239ca2781ec00d865e62c06c06f6aa0cd564398071e7f165ea6faafe0" Mar 16 16:42:30 crc kubenswrapper[5120]: I0316 16:42:30.835648 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d6a0c0239ca2781ec00d865e62c06c06f6aa0cd564398071e7f165ea6faafe0"} err="failed to get container status \"2d6a0c0239ca2781ec00d865e62c06c06f6aa0cd564398071e7f165ea6faafe0\": rpc error: code = NotFound desc = could not find container \"2d6a0c0239ca2781ec00d865e62c06c06f6aa0cd564398071e7f165ea6faafe0\": container with ID starting with 2d6a0c0239ca2781ec00d865e62c06c06f6aa0cd564398071e7f165ea6faafe0 not found: ID does not exist" Mar 16 16:42:30 crc kubenswrapper[5120]: I0316 16:42:30.835682 5120 scope.go:117] "RemoveContainer" containerID="5cb27040906683b297a4a42ef5af0a9e3aab330c2e0ee757e45576b0b978c3cc" Mar 16 16:42:30 crc kubenswrapper[5120]: E0316 16:42:30.836087 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5cb27040906683b297a4a42ef5af0a9e3aab330c2e0ee757e45576b0b978c3cc\": container with ID starting with 5cb27040906683b297a4a42ef5af0a9e3aab330c2e0ee757e45576b0b978c3cc not found: ID does not exist" containerID="5cb27040906683b297a4a42ef5af0a9e3aab330c2e0ee757e45576b0b978c3cc" Mar 16 16:42:30 crc kubenswrapper[5120]: I0316 16:42:30.836118 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5cb27040906683b297a4a42ef5af0a9e3aab330c2e0ee757e45576b0b978c3cc"} err="failed to get container status \"5cb27040906683b297a4a42ef5af0a9e3aab330c2e0ee757e45576b0b978c3cc\": rpc error: code = NotFound desc = could not find container \"5cb27040906683b297a4a42ef5af0a9e3aab330c2e0ee757e45576b0b978c3cc\": container with ID starting with 5cb27040906683b297a4a42ef5af0a9e3aab330c2e0ee757e45576b0b978c3cc not found: ID does not exist" Mar 16 16:42:30 crc kubenswrapper[5120]: I0316 16:42:30.836138 5120 scope.go:117] "RemoveContainer" containerID="bbe208005febe64ceddc97996dbe752bb70fa2569e8ff1eae306370be0543432" Mar 16 16:42:30 crc kubenswrapper[5120]: I0316 16:42:30.836350 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bbe208005febe64ceddc97996dbe752bb70fa2569e8ff1eae306370be0543432"} err="failed to get container status \"bbe208005febe64ceddc97996dbe752bb70fa2569e8ff1eae306370be0543432\": rpc error: code = NotFound desc = could not find container \"bbe208005febe64ceddc97996dbe752bb70fa2569e8ff1eae306370be0543432\": container with ID starting with bbe208005febe64ceddc97996dbe752bb70fa2569e8ff1eae306370be0543432 not found: ID does not exist" Mar 16 16:42:30 crc kubenswrapper[5120]: I0316 16:42:30.836375 5120 scope.go:117] "RemoveContainer" containerID="7c5e3f0e727250bf3f2a31f72787be3de45282f97b742fc57f9c89dbfbe8db24" Mar 16 16:42:30 crc kubenswrapper[5120]: I0316 16:42:30.836555 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c5e3f0e727250bf3f2a31f72787be3de45282f97b742fc57f9c89dbfbe8db24"} err="failed to get container status \"7c5e3f0e727250bf3f2a31f72787be3de45282f97b742fc57f9c89dbfbe8db24\": rpc error: code = NotFound desc = could not find container \"7c5e3f0e727250bf3f2a31f72787be3de45282f97b742fc57f9c89dbfbe8db24\": container with ID starting with 7c5e3f0e727250bf3f2a31f72787be3de45282f97b742fc57f9c89dbfbe8db24 not found: ID does not exist" Mar 16 16:42:30 crc kubenswrapper[5120]: I0316 16:42:30.836579 5120 scope.go:117] "RemoveContainer" containerID="2d6a0c0239ca2781ec00d865e62c06c06f6aa0cd564398071e7f165ea6faafe0" Mar 16 16:42:30 crc kubenswrapper[5120]: I0316 16:42:30.836750 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d6a0c0239ca2781ec00d865e62c06c06f6aa0cd564398071e7f165ea6faafe0"} err="failed to get container status \"2d6a0c0239ca2781ec00d865e62c06c06f6aa0cd564398071e7f165ea6faafe0\": rpc error: code = NotFound desc = could not find container \"2d6a0c0239ca2781ec00d865e62c06c06f6aa0cd564398071e7f165ea6faafe0\": container with ID starting with 2d6a0c0239ca2781ec00d865e62c06c06f6aa0cd564398071e7f165ea6faafe0 not found: ID does not exist" Mar 16 16:42:30 crc kubenswrapper[5120]: I0316 16:42:30.836796 5120 scope.go:117] "RemoveContainer" containerID="5cb27040906683b297a4a42ef5af0a9e3aab330c2e0ee757e45576b0b978c3cc" Mar 16 16:42:30 crc kubenswrapper[5120]: I0316 16:42:30.836991 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5cb27040906683b297a4a42ef5af0a9e3aab330c2e0ee757e45576b0b978c3cc"} err="failed to get container status \"5cb27040906683b297a4a42ef5af0a9e3aab330c2e0ee757e45576b0b978c3cc\": rpc error: code = NotFound desc = could not find container \"5cb27040906683b297a4a42ef5af0a9e3aab330c2e0ee757e45576b0b978c3cc\": container with ID starting with 5cb27040906683b297a4a42ef5af0a9e3aab330c2e0ee757e45576b0b978c3cc not found: ID does not exist" Mar 16 16:42:30 crc kubenswrapper[5120]: I0316 16:42:30.837020 5120 scope.go:117] "RemoveContainer" containerID="bbe208005febe64ceddc97996dbe752bb70fa2569e8ff1eae306370be0543432" Mar 16 16:42:30 crc kubenswrapper[5120]: I0316 16:42:30.837322 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bbe208005febe64ceddc97996dbe752bb70fa2569e8ff1eae306370be0543432"} err="failed to get container status \"bbe208005febe64ceddc97996dbe752bb70fa2569e8ff1eae306370be0543432\": rpc error: code = NotFound desc = could not find container \"bbe208005febe64ceddc97996dbe752bb70fa2569e8ff1eae306370be0543432\": container with ID starting with bbe208005febe64ceddc97996dbe752bb70fa2569e8ff1eae306370be0543432 not found: ID does not exist" Mar 16 16:42:30 crc kubenswrapper[5120]: I0316 16:42:30.837349 5120 scope.go:117] "RemoveContainer" containerID="7c5e3f0e727250bf3f2a31f72787be3de45282f97b742fc57f9c89dbfbe8db24" Mar 16 16:42:30 crc kubenswrapper[5120]: I0316 16:42:30.837599 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c5e3f0e727250bf3f2a31f72787be3de45282f97b742fc57f9c89dbfbe8db24"} err="failed to get container status \"7c5e3f0e727250bf3f2a31f72787be3de45282f97b742fc57f9c89dbfbe8db24\": rpc error: code = NotFound desc = could not find container \"7c5e3f0e727250bf3f2a31f72787be3de45282f97b742fc57f9c89dbfbe8db24\": container with ID starting with 7c5e3f0e727250bf3f2a31f72787be3de45282f97b742fc57f9c89dbfbe8db24 not found: ID does not exist" Mar 16 16:42:30 crc kubenswrapper[5120]: I0316 16:42:30.837627 5120 scope.go:117] "RemoveContainer" containerID="2d6a0c0239ca2781ec00d865e62c06c06f6aa0cd564398071e7f165ea6faafe0" Mar 16 16:42:30 crc kubenswrapper[5120]: I0316 16:42:30.837831 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d6a0c0239ca2781ec00d865e62c06c06f6aa0cd564398071e7f165ea6faafe0"} err="failed to get container status \"2d6a0c0239ca2781ec00d865e62c06c06f6aa0cd564398071e7f165ea6faafe0\": rpc error: code = NotFound desc = could not find container \"2d6a0c0239ca2781ec00d865e62c06c06f6aa0cd564398071e7f165ea6faafe0\": container with ID starting with 2d6a0c0239ca2781ec00d865e62c06c06f6aa0cd564398071e7f165ea6faafe0 not found: ID does not exist" Mar 16 16:42:30 crc kubenswrapper[5120]: I0316 16:42:30.837854 5120 scope.go:117] "RemoveContainer" containerID="5cb27040906683b297a4a42ef5af0a9e3aab330c2e0ee757e45576b0b978c3cc" Mar 16 16:42:30 crc kubenswrapper[5120]: I0316 16:42:30.838058 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5cb27040906683b297a4a42ef5af0a9e3aab330c2e0ee757e45576b0b978c3cc"} err="failed to get container status \"5cb27040906683b297a4a42ef5af0a9e3aab330c2e0ee757e45576b0b978c3cc\": rpc error: code = NotFound desc = could not find container \"5cb27040906683b297a4a42ef5af0a9e3aab330c2e0ee757e45576b0b978c3cc\": container with ID starting with 5cb27040906683b297a4a42ef5af0a9e3aab330c2e0ee757e45576b0b978c3cc not found: ID does not exist" Mar 16 16:42:30 crc kubenswrapper[5120]: I0316 16:42:30.838084 5120 scope.go:117] "RemoveContainer" containerID="bbe208005febe64ceddc97996dbe752bb70fa2569e8ff1eae306370be0543432" Mar 16 16:42:30 crc kubenswrapper[5120]: I0316 16:42:30.838268 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bbe208005febe64ceddc97996dbe752bb70fa2569e8ff1eae306370be0543432"} err="failed to get container status \"bbe208005febe64ceddc97996dbe752bb70fa2569e8ff1eae306370be0543432\": rpc error: code = NotFound desc = could not find container \"bbe208005febe64ceddc97996dbe752bb70fa2569e8ff1eae306370be0543432\": container with ID starting with bbe208005febe64ceddc97996dbe752bb70fa2569e8ff1eae306370be0543432 not found: ID does not exist" Mar 16 16:42:30 crc kubenswrapper[5120]: I0316 16:42:30.838287 5120 scope.go:117] "RemoveContainer" containerID="7c5e3f0e727250bf3f2a31f72787be3de45282f97b742fc57f9c89dbfbe8db24" Mar 16 16:42:30 crc kubenswrapper[5120]: I0316 16:42:30.838608 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c5e3f0e727250bf3f2a31f72787be3de45282f97b742fc57f9c89dbfbe8db24"} err="failed to get container status \"7c5e3f0e727250bf3f2a31f72787be3de45282f97b742fc57f9c89dbfbe8db24\": rpc error: code = NotFound desc = could not find container \"7c5e3f0e727250bf3f2a31f72787be3de45282f97b742fc57f9c89dbfbe8db24\": container with ID starting with 7c5e3f0e727250bf3f2a31f72787be3de45282f97b742fc57f9c89dbfbe8db24 not found: ID does not exist" Mar 16 16:42:30 crc kubenswrapper[5120]: I0316 16:42:30.838632 5120 scope.go:117] "RemoveContainer" containerID="2d6a0c0239ca2781ec00d865e62c06c06f6aa0cd564398071e7f165ea6faafe0" Mar 16 16:42:30 crc kubenswrapper[5120]: I0316 16:42:30.838869 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d6a0c0239ca2781ec00d865e62c06c06f6aa0cd564398071e7f165ea6faafe0"} err="failed to get container status \"2d6a0c0239ca2781ec00d865e62c06c06f6aa0cd564398071e7f165ea6faafe0\": rpc error: code = NotFound desc = could not find container \"2d6a0c0239ca2781ec00d865e62c06c06f6aa0cd564398071e7f165ea6faafe0\": container with ID starting with 2d6a0c0239ca2781ec00d865e62c06c06f6aa0cd564398071e7f165ea6faafe0 not found: ID does not exist" Mar 16 16:42:30 crc kubenswrapper[5120]: I0316 16:42:30.838895 5120 scope.go:117] "RemoveContainer" containerID="5cb27040906683b297a4a42ef5af0a9e3aab330c2e0ee757e45576b0b978c3cc" Mar 16 16:42:30 crc kubenswrapper[5120]: I0316 16:42:30.839088 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5cb27040906683b297a4a42ef5af0a9e3aab330c2e0ee757e45576b0b978c3cc"} err="failed to get container status \"5cb27040906683b297a4a42ef5af0a9e3aab330c2e0ee757e45576b0b978c3cc\": rpc error: code = NotFound desc = could not find container \"5cb27040906683b297a4a42ef5af0a9e3aab330c2e0ee757e45576b0b978c3cc\": container with ID starting with 5cb27040906683b297a4a42ef5af0a9e3aab330c2e0ee757e45576b0b978c3cc not found: ID does not exist" Mar 16 16:42:30 crc kubenswrapper[5120]: I0316 16:42:30.843663 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:42:30 crc kubenswrapper[5120]: I0316 16:42:30.861459 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:42:30 crc kubenswrapper[5120]: I0316 16:42:30.874203 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:42:30 crc kubenswrapper[5120]: I0316 16:42:30.875338 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2062cbff-20d9-4bdb-b60f-881144c1f24f" containerName="sg-core" Mar 16 16:42:30 crc kubenswrapper[5120]: I0316 16:42:30.875361 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="2062cbff-20d9-4bdb-b60f-881144c1f24f" containerName="sg-core" Mar 16 16:42:30 crc kubenswrapper[5120]: I0316 16:42:30.875384 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2062cbff-20d9-4bdb-b60f-881144c1f24f" containerName="proxy-httpd" Mar 16 16:42:30 crc kubenswrapper[5120]: I0316 16:42:30.875391 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="2062cbff-20d9-4bdb-b60f-881144c1f24f" containerName="proxy-httpd" Mar 16 16:42:30 crc kubenswrapper[5120]: I0316 16:42:30.875405 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2062cbff-20d9-4bdb-b60f-881144c1f24f" containerName="ceilometer-notification-agent" Mar 16 16:42:30 crc kubenswrapper[5120]: I0316 16:42:30.875412 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="2062cbff-20d9-4bdb-b60f-881144c1f24f" containerName="ceilometer-notification-agent" Mar 16 16:42:30 crc kubenswrapper[5120]: I0316 16:42:30.875423 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2062cbff-20d9-4bdb-b60f-881144c1f24f" containerName="ceilometer-central-agent" Mar 16 16:42:30 crc kubenswrapper[5120]: I0316 16:42:30.875429 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="2062cbff-20d9-4bdb-b60f-881144c1f24f" containerName="ceilometer-central-agent" Mar 16 16:42:30 crc kubenswrapper[5120]: I0316 16:42:30.875615 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="2062cbff-20d9-4bdb-b60f-881144c1f24f" containerName="proxy-httpd" Mar 16 16:42:30 crc kubenswrapper[5120]: I0316 16:42:30.875626 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="2062cbff-20d9-4bdb-b60f-881144c1f24f" containerName="ceilometer-central-agent" Mar 16 16:42:30 crc kubenswrapper[5120]: I0316 16:42:30.875635 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="2062cbff-20d9-4bdb-b60f-881144c1f24f" containerName="sg-core" Mar 16 16:42:30 crc kubenswrapper[5120]: I0316 16:42:30.875649 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="2062cbff-20d9-4bdb-b60f-881144c1f24f" containerName="ceilometer-notification-agent" Mar 16 16:42:30 crc kubenswrapper[5120]: I0316 16:42:30.883432 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:42:30 crc kubenswrapper[5120]: I0316 16:42:30.886844 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ceilometer-internal-svc\"" Mar 16 16:42:30 crc kubenswrapper[5120]: I0316 16:42:30.887100 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 16:42:30 crc kubenswrapper[5120]: I0316 16:42:30.887616 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:42:30 crc kubenswrapper[5120]: I0316 16:42:30.891353 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 16:42:31 crc kubenswrapper[5120]: I0316 16:42:31.024898 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/6b2c2356-2ac5-4ead-9992-644cb991d6b6-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"6b2c2356-2ac5-4ead-9992-644cb991d6b6\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:42:31 crc kubenswrapper[5120]: I0316 16:42:31.025026 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6b2c2356-2ac5-4ead-9992-644cb991d6b6-scripts\") pod \"ceilometer-0\" (UID: \"6b2c2356-2ac5-4ead-9992-644cb991d6b6\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:42:31 crc kubenswrapper[5120]: I0316 16:42:31.025260 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6b2c2356-2ac5-4ead-9992-644cb991d6b6-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"6b2c2356-2ac5-4ead-9992-644cb991d6b6\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:42:31 crc kubenswrapper[5120]: I0316 16:42:31.025302 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/6b2c2356-2ac5-4ead-9992-644cb991d6b6-log-httpd\") pod \"ceilometer-0\" (UID: \"6b2c2356-2ac5-4ead-9992-644cb991d6b6\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:42:31 crc kubenswrapper[5120]: I0316 16:42:31.025341 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6b2c2356-2ac5-4ead-9992-644cb991d6b6-config-data\") pod \"ceilometer-0\" (UID: \"6b2c2356-2ac5-4ead-9992-644cb991d6b6\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:42:31 crc kubenswrapper[5120]: I0316 16:42:31.025381 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/6b2c2356-2ac5-4ead-9992-644cb991d6b6-run-httpd\") pod \"ceilometer-0\" (UID: \"6b2c2356-2ac5-4ead-9992-644cb991d6b6\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:42:31 crc kubenswrapper[5120]: I0316 16:42:31.025827 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/6b2c2356-2ac5-4ead-9992-644cb991d6b6-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"6b2c2356-2ac5-4ead-9992-644cb991d6b6\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:42:31 crc kubenswrapper[5120]: I0316 16:42:31.025951 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tjhf\" (UniqueName: \"kubernetes.io/projected/6b2c2356-2ac5-4ead-9992-644cb991d6b6-kube-api-access-9tjhf\") pod \"ceilometer-0\" (UID: \"6b2c2356-2ac5-4ead-9992-644cb991d6b6\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:42:31 crc kubenswrapper[5120]: I0316 16:42:31.128528 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9tjhf\" (UniqueName: \"kubernetes.io/projected/6b2c2356-2ac5-4ead-9992-644cb991d6b6-kube-api-access-9tjhf\") pod \"ceilometer-0\" (UID: \"6b2c2356-2ac5-4ead-9992-644cb991d6b6\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:42:31 crc kubenswrapper[5120]: I0316 16:42:31.128659 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/6b2c2356-2ac5-4ead-9992-644cb991d6b6-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"6b2c2356-2ac5-4ead-9992-644cb991d6b6\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:42:31 crc kubenswrapper[5120]: I0316 16:42:31.128793 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6b2c2356-2ac5-4ead-9992-644cb991d6b6-scripts\") pod \"ceilometer-0\" (UID: \"6b2c2356-2ac5-4ead-9992-644cb991d6b6\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:42:31 crc kubenswrapper[5120]: I0316 16:42:31.128949 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6b2c2356-2ac5-4ead-9992-644cb991d6b6-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"6b2c2356-2ac5-4ead-9992-644cb991d6b6\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:42:31 crc kubenswrapper[5120]: I0316 16:42:31.128985 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/6b2c2356-2ac5-4ead-9992-644cb991d6b6-log-httpd\") pod \"ceilometer-0\" (UID: \"6b2c2356-2ac5-4ead-9992-644cb991d6b6\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:42:31 crc kubenswrapper[5120]: I0316 16:42:31.129012 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6b2c2356-2ac5-4ead-9992-644cb991d6b6-config-data\") pod \"ceilometer-0\" (UID: \"6b2c2356-2ac5-4ead-9992-644cb991d6b6\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:42:31 crc kubenswrapper[5120]: I0316 16:42:31.129035 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/6b2c2356-2ac5-4ead-9992-644cb991d6b6-run-httpd\") pod \"ceilometer-0\" (UID: \"6b2c2356-2ac5-4ead-9992-644cb991d6b6\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:42:31 crc kubenswrapper[5120]: I0316 16:42:31.129288 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/6b2c2356-2ac5-4ead-9992-644cb991d6b6-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"6b2c2356-2ac5-4ead-9992-644cb991d6b6\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:42:31 crc kubenswrapper[5120]: I0316 16:42:31.129733 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/6b2c2356-2ac5-4ead-9992-644cb991d6b6-run-httpd\") pod \"ceilometer-0\" (UID: \"6b2c2356-2ac5-4ead-9992-644cb991d6b6\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:42:31 crc kubenswrapper[5120]: I0316 16:42:31.130059 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/6b2c2356-2ac5-4ead-9992-644cb991d6b6-log-httpd\") pod \"ceilometer-0\" (UID: \"6b2c2356-2ac5-4ead-9992-644cb991d6b6\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:42:31 crc kubenswrapper[5120]: I0316 16:42:31.133202 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/6b2c2356-2ac5-4ead-9992-644cb991d6b6-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"6b2c2356-2ac5-4ead-9992-644cb991d6b6\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:42:31 crc kubenswrapper[5120]: I0316 16:42:31.133319 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6b2c2356-2ac5-4ead-9992-644cb991d6b6-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"6b2c2356-2ac5-4ead-9992-644cb991d6b6\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:42:31 crc kubenswrapper[5120]: I0316 16:42:31.133430 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6b2c2356-2ac5-4ead-9992-644cb991d6b6-config-data\") pod \"ceilometer-0\" (UID: \"6b2c2356-2ac5-4ead-9992-644cb991d6b6\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:42:31 crc kubenswrapper[5120]: I0316 16:42:31.133599 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6b2c2356-2ac5-4ead-9992-644cb991d6b6-scripts\") pod \"ceilometer-0\" (UID: \"6b2c2356-2ac5-4ead-9992-644cb991d6b6\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:42:31 crc kubenswrapper[5120]: I0316 16:42:31.133914 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/6b2c2356-2ac5-4ead-9992-644cb991d6b6-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"6b2c2356-2ac5-4ead-9992-644cb991d6b6\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:42:31 crc kubenswrapper[5120]: I0316 16:42:31.150140 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tjhf\" (UniqueName: \"kubernetes.io/projected/6b2c2356-2ac5-4ead-9992-644cb991d6b6-kube-api-access-9tjhf\") pod \"ceilometer-0\" (UID: \"6b2c2356-2ac5-4ead-9992-644cb991d6b6\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:42:31 crc kubenswrapper[5120]: I0316 16:42:31.209734 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:42:31 crc kubenswrapper[5120]: I0316 16:42:31.437132 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:42:31 crc kubenswrapper[5120]: I0316 16:42:31.518911 5120 generic.go:358] "Generic (PLEG): container finished" podID="7bd0c2eb-f112-4c50-bf17-5e89da8bfa75" containerID="045ba43a0733937687db24db6e21066980a4a874bcaa85bcc17c5d8cfd448ee5" exitCode=143 Mar 16 16:42:31 crc kubenswrapper[5120]: I0316 16:42:31.519326 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-marketplace/redhat-marketplace-wh5hj" podUID="858759f8-3490-4061-b79a-26281f9f3186" containerName="registry-server" containerID="cri-o://58c2ca57de944ecb928a9c5715f6d46b8c643fcad182fe327ea68e62e452237a" gracePeriod=2 Mar 16 16:42:31 crc kubenswrapper[5120]: I0316 16:42:31.519416 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"7bd0c2eb-f112-4c50-bf17-5e89da8bfa75","Type":"ContainerDied","Data":"045ba43a0733937687db24db6e21066980a4a874bcaa85bcc17c5d8cfd448ee5"} Mar 16 16:42:31 crc kubenswrapper[5120]: I0316 16:42:31.704655 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:42:31 crc kubenswrapper[5120]: I0316 16:42:31.966983 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-wh5hj" Mar 16 16:42:32 crc kubenswrapper[5120]: I0316 16:42:32.072323 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m94lx\" (UniqueName: \"kubernetes.io/projected/858759f8-3490-4061-b79a-26281f9f3186-kube-api-access-m94lx\") pod \"858759f8-3490-4061-b79a-26281f9f3186\" (UID: \"858759f8-3490-4061-b79a-26281f9f3186\") " Mar 16 16:42:32 crc kubenswrapper[5120]: I0316 16:42:32.072376 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/858759f8-3490-4061-b79a-26281f9f3186-catalog-content\") pod \"858759f8-3490-4061-b79a-26281f9f3186\" (UID: \"858759f8-3490-4061-b79a-26281f9f3186\") " Mar 16 16:42:32 crc kubenswrapper[5120]: I0316 16:42:32.086014 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/858759f8-3490-4061-b79a-26281f9f3186-utilities\") pod \"858759f8-3490-4061-b79a-26281f9f3186\" (UID: \"858759f8-3490-4061-b79a-26281f9f3186\") " Mar 16 16:42:32 crc kubenswrapper[5120]: I0316 16:42:32.086780 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/858759f8-3490-4061-b79a-26281f9f3186-utilities" (OuterVolumeSpecName: "utilities") pod "858759f8-3490-4061-b79a-26281f9f3186" (UID: "858759f8-3490-4061-b79a-26281f9f3186"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:42:32 crc kubenswrapper[5120]: I0316 16:42:32.087674 5120 reconciler_common.go:299] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/858759f8-3490-4061-b79a-26281f9f3186-utilities\") on node \"crc\" DevicePath \"\"" Mar 16 16:42:32 crc kubenswrapper[5120]: I0316 16:42:32.091382 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/858759f8-3490-4061-b79a-26281f9f3186-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "858759f8-3490-4061-b79a-26281f9f3186" (UID: "858759f8-3490-4061-b79a-26281f9f3186"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:42:32 crc kubenswrapper[5120]: I0316 16:42:32.091674 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/858759f8-3490-4061-b79a-26281f9f3186-kube-api-access-m94lx" (OuterVolumeSpecName: "kube-api-access-m94lx") pod "858759f8-3490-4061-b79a-26281f9f3186" (UID: "858759f8-3490-4061-b79a-26281f9f3186"). InnerVolumeSpecName "kube-api-access-m94lx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:42:32 crc kubenswrapper[5120]: I0316 16:42:32.190545 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m94lx\" (UniqueName: \"kubernetes.io/projected/858759f8-3490-4061-b79a-26281f9f3186-kube-api-access-m94lx\") on node \"crc\" DevicePath \"\"" Mar 16 16:42:32 crc kubenswrapper[5120]: I0316 16:42:32.190580 5120 reconciler_common.go:299] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/858759f8-3490-4061-b79a-26281f9f3186-catalog-content\") on node \"crc\" DevicePath \"\"" Mar 16 16:42:32 crc kubenswrapper[5120]: I0316 16:42:32.530538 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"6b2c2356-2ac5-4ead-9992-644cb991d6b6","Type":"ContainerStarted","Data":"78c3e9ff0eacd13ba62ea912deb58141a5b8851f0a924ff16e7870ef823db395"} Mar 16 16:42:32 crc kubenswrapper[5120]: I0316 16:42:32.534528 5120 generic.go:358] "Generic (PLEG): container finished" podID="858759f8-3490-4061-b79a-26281f9f3186" containerID="58c2ca57de944ecb928a9c5715f6d46b8c643fcad182fe327ea68e62e452237a" exitCode=0 Mar 16 16:42:32 crc kubenswrapper[5120]: I0316 16:42:32.534610 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-wh5hj" Mar 16 16:42:32 crc kubenswrapper[5120]: I0316 16:42:32.534639 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-wh5hj" event={"ID":"858759f8-3490-4061-b79a-26281f9f3186","Type":"ContainerDied","Data":"58c2ca57de944ecb928a9c5715f6d46b8c643fcad182fe327ea68e62e452237a"} Mar 16 16:42:32 crc kubenswrapper[5120]: I0316 16:42:32.534689 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-wh5hj" event={"ID":"858759f8-3490-4061-b79a-26281f9f3186","Type":"ContainerDied","Data":"0184dff5ca81fc8d3e36df54da0b0fd39583325cf7dc43de58afb017a7cffe54"} Mar 16 16:42:32 crc kubenswrapper[5120]: I0316 16:42:32.534711 5120 scope.go:117] "RemoveContainer" containerID="58c2ca57de944ecb928a9c5715f6d46b8c643fcad182fe327ea68e62e452237a" Mar 16 16:42:32 crc kubenswrapper[5120]: I0316 16:42:32.590313 5120 scope.go:117] "RemoveContainer" containerID="0c1ab179274af48521cb21f9c6a6b6ae2ef0e7800bb9d109dff41c8f4cf3a529" Mar 16 16:42:32 crc kubenswrapper[5120]: I0316 16:42:32.591547 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-marketplace-wh5hj"] Mar 16 16:42:32 crc kubenswrapper[5120]: I0316 16:42:32.611042 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/redhat-marketplace-wh5hj"] Mar 16 16:42:32 crc kubenswrapper[5120]: I0316 16:42:32.624542 5120 scope.go:117] "RemoveContainer" containerID="2e789975ec1d7ca2b6242b2444748635f52d4638709749792a3b69280485c609" Mar 16 16:42:32 crc kubenswrapper[5120]: I0316 16:42:32.657334 5120 scope.go:117] "RemoveContainer" containerID="58c2ca57de944ecb928a9c5715f6d46b8c643fcad182fe327ea68e62e452237a" Mar 16 16:42:32 crc kubenswrapper[5120]: E0316 16:42:32.657871 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"58c2ca57de944ecb928a9c5715f6d46b8c643fcad182fe327ea68e62e452237a\": container with ID starting with 58c2ca57de944ecb928a9c5715f6d46b8c643fcad182fe327ea68e62e452237a not found: ID does not exist" containerID="58c2ca57de944ecb928a9c5715f6d46b8c643fcad182fe327ea68e62e452237a" Mar 16 16:42:32 crc kubenswrapper[5120]: I0316 16:42:32.657916 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58c2ca57de944ecb928a9c5715f6d46b8c643fcad182fe327ea68e62e452237a"} err="failed to get container status \"58c2ca57de944ecb928a9c5715f6d46b8c643fcad182fe327ea68e62e452237a\": rpc error: code = NotFound desc = could not find container \"58c2ca57de944ecb928a9c5715f6d46b8c643fcad182fe327ea68e62e452237a\": container with ID starting with 58c2ca57de944ecb928a9c5715f6d46b8c643fcad182fe327ea68e62e452237a not found: ID does not exist" Mar 16 16:42:32 crc kubenswrapper[5120]: I0316 16:42:32.657942 5120 scope.go:117] "RemoveContainer" containerID="0c1ab179274af48521cb21f9c6a6b6ae2ef0e7800bb9d109dff41c8f4cf3a529" Mar 16 16:42:32 crc kubenswrapper[5120]: E0316 16:42:32.658365 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c1ab179274af48521cb21f9c6a6b6ae2ef0e7800bb9d109dff41c8f4cf3a529\": container with ID starting with 0c1ab179274af48521cb21f9c6a6b6ae2ef0e7800bb9d109dff41c8f4cf3a529 not found: ID does not exist" containerID="0c1ab179274af48521cb21f9c6a6b6ae2ef0e7800bb9d109dff41c8f4cf3a529" Mar 16 16:42:32 crc kubenswrapper[5120]: I0316 16:42:32.658399 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c1ab179274af48521cb21f9c6a6b6ae2ef0e7800bb9d109dff41c8f4cf3a529"} err="failed to get container status \"0c1ab179274af48521cb21f9c6a6b6ae2ef0e7800bb9d109dff41c8f4cf3a529\": rpc error: code = NotFound desc = could not find container \"0c1ab179274af48521cb21f9c6a6b6ae2ef0e7800bb9d109dff41c8f4cf3a529\": container with ID starting with 0c1ab179274af48521cb21f9c6a6b6ae2ef0e7800bb9d109dff41c8f4cf3a529 not found: ID does not exist" Mar 16 16:42:32 crc kubenswrapper[5120]: I0316 16:42:32.658419 5120 scope.go:117] "RemoveContainer" containerID="2e789975ec1d7ca2b6242b2444748635f52d4638709749792a3b69280485c609" Mar 16 16:42:32 crc kubenswrapper[5120]: E0316 16:42:32.658744 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2e789975ec1d7ca2b6242b2444748635f52d4638709749792a3b69280485c609\": container with ID starting with 2e789975ec1d7ca2b6242b2444748635f52d4638709749792a3b69280485c609 not found: ID does not exist" containerID="2e789975ec1d7ca2b6242b2444748635f52d4638709749792a3b69280485c609" Mar 16 16:42:32 crc kubenswrapper[5120]: I0316 16:42:32.658798 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e789975ec1d7ca2b6242b2444748635f52d4638709749792a3b69280485c609"} err="failed to get container status \"2e789975ec1d7ca2b6242b2444748635f52d4638709749792a3b69280485c609\": rpc error: code = NotFound desc = could not find container \"2e789975ec1d7ca2b6242b2444748635f52d4638709749792a3b69280485c609\": container with ID starting with 2e789975ec1d7ca2b6242b2444748635f52d4638709749792a3b69280485c609 not found: ID does not exist" Mar 16 16:42:32 crc kubenswrapper[5120]: I0316 16:42:32.676634 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2062cbff-20d9-4bdb-b60f-881144c1f24f" path="/var/lib/kubelet/pods/2062cbff-20d9-4bdb-b60f-881144c1f24f/volumes" Mar 16 16:42:32 crc kubenswrapper[5120]: I0316 16:42:32.678029 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="858759f8-3490-4061-b79a-26281f9f3186" path="/var/lib/kubelet/pods/858759f8-3490-4061-b79a-26281f9f3186/volumes" Mar 16 16:42:33 crc kubenswrapper[5120]: I0316 16:42:33.549043 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"6b2c2356-2ac5-4ead-9992-644cb991d6b6","Type":"ContainerStarted","Data":"d39adc826bc96041ba32212001cbe6f3c3eefa8e24e9d9bf8506e6b589d8518e"} Mar 16 16:42:34 crc kubenswrapper[5120]: I0316 16:42:34.074731 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:42:34 crc kubenswrapper[5120]: I0316 16:42:34.135048 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7bd0c2eb-f112-4c50-bf17-5e89da8bfa75-config-data\") pod \"7bd0c2eb-f112-4c50-bf17-5e89da8bfa75\" (UID: \"7bd0c2eb-f112-4c50-bf17-5e89da8bfa75\") " Mar 16 16:42:34 crc kubenswrapper[5120]: I0316 16:42:34.136466 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7bd0c2eb-f112-4c50-bf17-5e89da8bfa75-logs\") pod \"7bd0c2eb-f112-4c50-bf17-5e89da8bfa75\" (UID: \"7bd0c2eb-f112-4c50-bf17-5e89da8bfa75\") " Mar 16 16:42:34 crc kubenswrapper[5120]: I0316 16:42:34.136528 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7bd0c2eb-f112-4c50-bf17-5e89da8bfa75-combined-ca-bundle\") pod \"7bd0c2eb-f112-4c50-bf17-5e89da8bfa75\" (UID: \"7bd0c2eb-f112-4c50-bf17-5e89da8bfa75\") " Mar 16 16:42:34 crc kubenswrapper[5120]: I0316 16:42:34.136822 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vwmfx\" (UniqueName: \"kubernetes.io/projected/7bd0c2eb-f112-4c50-bf17-5e89da8bfa75-kube-api-access-vwmfx\") pod \"7bd0c2eb-f112-4c50-bf17-5e89da8bfa75\" (UID: \"7bd0c2eb-f112-4c50-bf17-5e89da8bfa75\") " Mar 16 16:42:34 crc kubenswrapper[5120]: I0316 16:42:34.137403 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7bd0c2eb-f112-4c50-bf17-5e89da8bfa75-logs" (OuterVolumeSpecName: "logs") pod "7bd0c2eb-f112-4c50-bf17-5e89da8bfa75" (UID: "7bd0c2eb-f112-4c50-bf17-5e89da8bfa75"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:42:34 crc kubenswrapper[5120]: I0316 16:42:34.138909 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7bd0c2eb-f112-4c50-bf17-5e89da8bfa75-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:42:34 crc kubenswrapper[5120]: I0316 16:42:34.145082 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7bd0c2eb-f112-4c50-bf17-5e89da8bfa75-kube-api-access-vwmfx" (OuterVolumeSpecName: "kube-api-access-vwmfx") pod "7bd0c2eb-f112-4c50-bf17-5e89da8bfa75" (UID: "7bd0c2eb-f112-4c50-bf17-5e89da8bfa75"). InnerVolumeSpecName "kube-api-access-vwmfx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:42:34 crc kubenswrapper[5120]: I0316 16:42:34.167231 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7bd0c2eb-f112-4c50-bf17-5e89da8bfa75-config-data" (OuterVolumeSpecName: "config-data") pod "7bd0c2eb-f112-4c50-bf17-5e89da8bfa75" (UID: "7bd0c2eb-f112-4c50-bf17-5e89da8bfa75"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:42:34 crc kubenswrapper[5120]: I0316 16:42:34.185709 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7bd0c2eb-f112-4c50-bf17-5e89da8bfa75-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "7bd0c2eb-f112-4c50-bf17-5e89da8bfa75" (UID: "7bd0c2eb-f112-4c50-bf17-5e89da8bfa75"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:42:34 crc kubenswrapper[5120]: I0316 16:42:34.242467 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vwmfx\" (UniqueName: \"kubernetes.io/projected/7bd0c2eb-f112-4c50-bf17-5e89da8bfa75-kube-api-access-vwmfx\") on node \"crc\" DevicePath \"\"" Mar 16 16:42:34 crc kubenswrapper[5120]: I0316 16:42:34.242505 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7bd0c2eb-f112-4c50-bf17-5e89da8bfa75-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:42:34 crc kubenswrapper[5120]: I0316 16:42:34.242515 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7bd0c2eb-f112-4c50-bf17-5e89da8bfa75-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:42:34 crc kubenswrapper[5120]: I0316 16:42:34.574536 5120 generic.go:358] "Generic (PLEG): container finished" podID="7bd0c2eb-f112-4c50-bf17-5e89da8bfa75" containerID="7adc639a086d6e651d315f10c579ad16f93b4757771eba07433864bd701481fa" exitCode=0 Mar 16 16:42:34 crc kubenswrapper[5120]: I0316 16:42:34.574602 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:42:34 crc kubenswrapper[5120]: I0316 16:42:34.574614 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"7bd0c2eb-f112-4c50-bf17-5e89da8bfa75","Type":"ContainerDied","Data":"7adc639a086d6e651d315f10c579ad16f93b4757771eba07433864bd701481fa"} Mar 16 16:42:34 crc kubenswrapper[5120]: I0316 16:42:34.576103 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"7bd0c2eb-f112-4c50-bf17-5e89da8bfa75","Type":"ContainerDied","Data":"93411b00bf6ff54a2a08728db655397c30ccecfee77de3977eda0887cefc57f6"} Mar 16 16:42:34 crc kubenswrapper[5120]: I0316 16:42:34.576142 5120 scope.go:117] "RemoveContainer" containerID="7adc639a086d6e651d315f10c579ad16f93b4757771eba07433864bd701481fa" Mar 16 16:42:34 crc kubenswrapper[5120]: I0316 16:42:34.583868 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"6b2c2356-2ac5-4ead-9992-644cb991d6b6","Type":"ContainerStarted","Data":"b36016de3f15aab96850c14f53e26379a59562be4a76c63c30c9e9b76c401878"} Mar 16 16:42:34 crc kubenswrapper[5120]: I0316 16:42:34.618998 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:42:34 crc kubenswrapper[5120]: I0316 16:42:34.621592 5120 scope.go:117] "RemoveContainer" containerID="045ba43a0733937687db24db6e21066980a4a874bcaa85bcc17c5d8cfd448ee5" Mar 16 16:42:34 crc kubenswrapper[5120]: I0316 16:42:34.630748 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:42:34 crc kubenswrapper[5120]: I0316 16:42:34.647061 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:42:34 crc kubenswrapper[5120]: I0316 16:42:34.648256 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7bd0c2eb-f112-4c50-bf17-5e89da8bfa75" containerName="nova-api-api" Mar 16 16:42:34 crc kubenswrapper[5120]: I0316 16:42:34.648281 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bd0c2eb-f112-4c50-bf17-5e89da8bfa75" containerName="nova-api-api" Mar 16 16:42:34 crc kubenswrapper[5120]: I0316 16:42:34.648308 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="858759f8-3490-4061-b79a-26281f9f3186" containerName="extract-content" Mar 16 16:42:34 crc kubenswrapper[5120]: I0316 16:42:34.648316 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="858759f8-3490-4061-b79a-26281f9f3186" containerName="extract-content" Mar 16 16:42:34 crc kubenswrapper[5120]: I0316 16:42:34.648340 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="858759f8-3490-4061-b79a-26281f9f3186" containerName="extract-utilities" Mar 16 16:42:34 crc kubenswrapper[5120]: I0316 16:42:34.648346 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="858759f8-3490-4061-b79a-26281f9f3186" containerName="extract-utilities" Mar 16 16:42:34 crc kubenswrapper[5120]: I0316 16:42:34.648359 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7bd0c2eb-f112-4c50-bf17-5e89da8bfa75" containerName="nova-api-log" Mar 16 16:42:34 crc kubenswrapper[5120]: I0316 16:42:34.648365 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bd0c2eb-f112-4c50-bf17-5e89da8bfa75" containerName="nova-api-log" Mar 16 16:42:34 crc kubenswrapper[5120]: I0316 16:42:34.648374 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="858759f8-3490-4061-b79a-26281f9f3186" containerName="registry-server" Mar 16 16:42:34 crc kubenswrapper[5120]: I0316 16:42:34.648379 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="858759f8-3490-4061-b79a-26281f9f3186" containerName="registry-server" Mar 16 16:42:34 crc kubenswrapper[5120]: I0316 16:42:34.648548 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="858759f8-3490-4061-b79a-26281f9f3186" containerName="registry-server" Mar 16 16:42:34 crc kubenswrapper[5120]: I0316 16:42:34.648558 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7bd0c2eb-f112-4c50-bf17-5e89da8bfa75" containerName="nova-api-api" Mar 16 16:42:34 crc kubenswrapper[5120]: I0316 16:42:34.648569 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7bd0c2eb-f112-4c50-bf17-5e89da8bfa75" containerName="nova-api-log" Mar 16 16:42:34 crc kubenswrapper[5120]: I0316 16:42:34.668225 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:42:34 crc kubenswrapper[5120]: I0316 16:42:34.668417 5120 scope.go:117] "RemoveContainer" containerID="7adc639a086d6e651d315f10c579ad16f93b4757771eba07433864bd701481fa" Mar 16 16:42:34 crc kubenswrapper[5120]: E0316 16:42:34.669132 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7adc639a086d6e651d315f10c579ad16f93b4757771eba07433864bd701481fa\": container with ID starting with 7adc639a086d6e651d315f10c579ad16f93b4757771eba07433864bd701481fa not found: ID does not exist" containerID="7adc639a086d6e651d315f10c579ad16f93b4757771eba07433864bd701481fa" Mar 16 16:42:34 crc kubenswrapper[5120]: I0316 16:42:34.669187 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7adc639a086d6e651d315f10c579ad16f93b4757771eba07433864bd701481fa"} err="failed to get container status \"7adc639a086d6e651d315f10c579ad16f93b4757771eba07433864bd701481fa\": rpc error: code = NotFound desc = could not find container \"7adc639a086d6e651d315f10c579ad16f93b4757771eba07433864bd701481fa\": container with ID starting with 7adc639a086d6e651d315f10c579ad16f93b4757771eba07433864bd701481fa not found: ID does not exist" Mar 16 16:42:34 crc kubenswrapper[5120]: I0316 16:42:34.669756 5120 scope.go:117] "RemoveContainer" containerID="045ba43a0733937687db24db6e21066980a4a874bcaa85bcc17c5d8cfd448ee5" Mar 16 16:42:34 crc kubenswrapper[5120]: I0316 16:42:34.671653 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-internal-svc\"" Mar 16 16:42:34 crc kubenswrapper[5120]: I0316 16:42:34.671728 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-config-data\"" Mar 16 16:42:34 crc kubenswrapper[5120]: I0316 16:42:34.671826 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-public-svc\"" Mar 16 16:42:34 crc kubenswrapper[5120]: E0316 16:42:34.672048 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"045ba43a0733937687db24db6e21066980a4a874bcaa85bcc17c5d8cfd448ee5\": container with ID starting with 045ba43a0733937687db24db6e21066980a4a874bcaa85bcc17c5d8cfd448ee5 not found: ID does not exist" containerID="045ba43a0733937687db24db6e21066980a4a874bcaa85bcc17c5d8cfd448ee5" Mar 16 16:42:34 crc kubenswrapper[5120]: I0316 16:42:34.672108 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"045ba43a0733937687db24db6e21066980a4a874bcaa85bcc17c5d8cfd448ee5"} err="failed to get container status \"045ba43a0733937687db24db6e21066980a4a874bcaa85bcc17c5d8cfd448ee5\": rpc error: code = NotFound desc = could not find container \"045ba43a0733937687db24db6e21066980a4a874bcaa85bcc17c5d8cfd448ee5\": container with ID starting with 045ba43a0733937687db24db6e21066980a4a874bcaa85bcc17c5d8cfd448ee5 not found: ID does not exist" Mar 16 16:42:34 crc kubenswrapper[5120]: I0316 16:42:34.689410 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7bd0c2eb-f112-4c50-bf17-5e89da8bfa75" path="/var/lib/kubelet/pods/7bd0c2eb-f112-4c50-bf17-5e89da8bfa75/volumes" Mar 16 16:42:34 crc kubenswrapper[5120]: I0316 16:42:34.690080 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:42:34 crc kubenswrapper[5120]: I0316 16:42:34.753267 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/935a7850-d7f8-438f-a787-6a78e33db090-internal-tls-certs\") pod \"nova-api-0\" (UID: \"935a7850-d7f8-438f-a787-6a78e33db090\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:42:34 crc kubenswrapper[5120]: I0316 16:42:34.753586 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8brvm\" (UniqueName: \"kubernetes.io/projected/935a7850-d7f8-438f-a787-6a78e33db090-kube-api-access-8brvm\") pod \"nova-api-0\" (UID: \"935a7850-d7f8-438f-a787-6a78e33db090\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:42:34 crc kubenswrapper[5120]: I0316 16:42:34.753885 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/935a7850-d7f8-438f-a787-6a78e33db090-logs\") pod \"nova-api-0\" (UID: \"935a7850-d7f8-438f-a787-6a78e33db090\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:42:34 crc kubenswrapper[5120]: I0316 16:42:34.754092 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/935a7850-d7f8-438f-a787-6a78e33db090-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"935a7850-d7f8-438f-a787-6a78e33db090\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:42:34 crc kubenswrapper[5120]: I0316 16:42:34.754204 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/935a7850-d7f8-438f-a787-6a78e33db090-config-data\") pod \"nova-api-0\" (UID: \"935a7850-d7f8-438f-a787-6a78e33db090\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:42:34 crc kubenswrapper[5120]: I0316 16:42:34.754501 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/935a7850-d7f8-438f-a787-6a78e33db090-public-tls-certs\") pod \"nova-api-0\" (UID: \"935a7850-d7f8-438f-a787-6a78e33db090\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:42:34 crc kubenswrapper[5120]: I0316 16:42:34.857658 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/935a7850-d7f8-438f-a787-6a78e33db090-config-data\") pod \"nova-api-0\" (UID: \"935a7850-d7f8-438f-a787-6a78e33db090\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:42:34 crc kubenswrapper[5120]: I0316 16:42:34.857838 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/935a7850-d7f8-438f-a787-6a78e33db090-public-tls-certs\") pod \"nova-api-0\" (UID: \"935a7850-d7f8-438f-a787-6a78e33db090\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:42:34 crc kubenswrapper[5120]: I0316 16:42:34.858084 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/935a7850-d7f8-438f-a787-6a78e33db090-internal-tls-certs\") pod \"nova-api-0\" (UID: \"935a7850-d7f8-438f-a787-6a78e33db090\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:42:34 crc kubenswrapper[5120]: I0316 16:42:34.858142 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8brvm\" (UniqueName: \"kubernetes.io/projected/935a7850-d7f8-438f-a787-6a78e33db090-kube-api-access-8brvm\") pod \"nova-api-0\" (UID: \"935a7850-d7f8-438f-a787-6a78e33db090\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:42:34 crc kubenswrapper[5120]: I0316 16:42:34.858269 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/935a7850-d7f8-438f-a787-6a78e33db090-logs\") pod \"nova-api-0\" (UID: \"935a7850-d7f8-438f-a787-6a78e33db090\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:42:34 crc kubenswrapper[5120]: I0316 16:42:34.858334 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/935a7850-d7f8-438f-a787-6a78e33db090-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"935a7850-d7f8-438f-a787-6a78e33db090\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:42:34 crc kubenswrapper[5120]: I0316 16:42:34.858793 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/935a7850-d7f8-438f-a787-6a78e33db090-logs\") pod \"nova-api-0\" (UID: \"935a7850-d7f8-438f-a787-6a78e33db090\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:42:34 crc kubenswrapper[5120]: I0316 16:42:34.863212 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/935a7850-d7f8-438f-a787-6a78e33db090-public-tls-certs\") pod \"nova-api-0\" (UID: \"935a7850-d7f8-438f-a787-6a78e33db090\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:42:34 crc kubenswrapper[5120]: I0316 16:42:34.864018 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/935a7850-d7f8-438f-a787-6a78e33db090-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"935a7850-d7f8-438f-a787-6a78e33db090\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:42:34 crc kubenswrapper[5120]: I0316 16:42:34.864014 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/935a7850-d7f8-438f-a787-6a78e33db090-config-data\") pod \"nova-api-0\" (UID: \"935a7850-d7f8-438f-a787-6a78e33db090\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:42:34 crc kubenswrapper[5120]: I0316 16:42:34.865313 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/935a7850-d7f8-438f-a787-6a78e33db090-internal-tls-certs\") pod \"nova-api-0\" (UID: \"935a7850-d7f8-438f-a787-6a78e33db090\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:42:34 crc kubenswrapper[5120]: I0316 16:42:34.877036 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8brvm\" (UniqueName: \"kubernetes.io/projected/935a7850-d7f8-438f-a787-6a78e33db090-kube-api-access-8brvm\") pod \"nova-api-0\" (UID: \"935a7850-d7f8-438f-a787-6a78e33db090\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:42:34 crc kubenswrapper[5120]: I0316 16:42:34.990377 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:42:35 crc kubenswrapper[5120]: I0316 16:42:35.391529 5120 scope.go:117] "RemoveContainer" containerID="ac561281d49b95085f75deca1a2fae047fa2827f32f42ca0477b0454b5fc81ad" Mar 16 16:42:35 crc kubenswrapper[5120]: I0316 16:42:35.417210 5120 scope.go:117] "RemoveContainer" containerID="36a38b9c8971280678407303957af16f6e151a9ccb5c0f41ffc3a4f90e4185cb" Mar 16 16:42:35 crc kubenswrapper[5120]: I0316 16:42:35.442713 5120 scope.go:117] "RemoveContainer" containerID="5af2f8d5f4776cb0a460db5c1757b19b33071548ffa7ba0bd64ab52782aba9d5" Mar 16 16:42:35 crc kubenswrapper[5120]: I0316 16:42:35.462273 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:42:35 crc kubenswrapper[5120]: W0316 16:42:35.479232 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod935a7850_d7f8_438f_a787_6a78e33db090.slice/crio-25f054c3fd24d189351d7069e00b7756613e13cfe2ac6017bd68ab6c07560e7b WatchSource:0}: Error finding container 25f054c3fd24d189351d7069e00b7756613e13cfe2ac6017bd68ab6c07560e7b: Status 404 returned error can't find the container with id 25f054c3fd24d189351d7069e00b7756613e13cfe2ac6017bd68ab6c07560e7b Mar 16 16:42:35 crc kubenswrapper[5120]: I0316 16:42:35.483998 5120 scope.go:117] "RemoveContainer" containerID="05afde781643fd53002b9bc00aafac856fb24fc4f74ae53ee06b3dee10f01576" Mar 16 16:42:35 crc kubenswrapper[5120]: I0316 16:42:35.611439 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"6b2c2356-2ac5-4ead-9992-644cb991d6b6","Type":"ContainerStarted","Data":"73ed2586feb010249ebbdcafd447ad03d4a760835776787349b630d11e9ae23c"} Mar 16 16:42:35 crc kubenswrapper[5120]: I0316 16:42:35.614786 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"935a7850-d7f8-438f-a787-6a78e33db090","Type":"ContainerStarted","Data":"25f054c3fd24d189351d7069e00b7756613e13cfe2ac6017bd68ab6c07560e7b"} Mar 16 16:42:35 crc kubenswrapper[5120]: I0316 16:42:35.664422 5120 scope.go:117] "RemoveContainer" containerID="51a9e72749469a4f7a85f36e4d05b97332822e031201c75e32f8aeca6440579f" Mar 16 16:42:35 crc kubenswrapper[5120]: I0316 16:42:35.824786 5120 scope.go:117] "RemoveContainer" containerID="e711ed4c2337b57b3fae4b8721cc0ce19eb8f9e19cb8d9a26a1a2dd0974c03ef" Mar 16 16:42:35 crc kubenswrapper[5120]: I0316 16:42:35.867263 5120 scope.go:117] "RemoveContainer" containerID="41961b7f6a4344f5d5acb2c636cf873512a3d165e3ee4ef16e249ba7fed1aec1" Mar 16 16:42:35 crc kubenswrapper[5120]: I0316 16:42:35.901410 5120 scope.go:117] "RemoveContainer" containerID="313b3b5a843c78582407f033efb01a381513dcfd6dee421e1f746fb551f6bebd" Mar 16 16:42:35 crc kubenswrapper[5120]: I0316 16:42:35.938405 5120 scope.go:117] "RemoveContainer" containerID="72f9451d2179670d44ae1425f3b91ca6ef1324b3c61d90d387f96872979dfe18" Mar 16 16:42:35 crc kubenswrapper[5120]: I0316 16:42:35.998511 5120 scope.go:117] "RemoveContainer" containerID="cd1fe4c47b47574fb7349bbe6b90048d31bd50a842336360580a001e58e13b5c" Mar 16 16:42:36 crc kubenswrapper[5120]: I0316 16:42:36.036184 5120 scope.go:117] "RemoveContainer" containerID="d962a27ae73b49d661904f00b163e9adbf24cc2cced96780802051c61348e02b" Mar 16 16:42:36 crc kubenswrapper[5120]: I0316 16:42:36.075289 5120 scope.go:117] "RemoveContainer" containerID="56d4baebbb806417e5fc468a17b33231ff7a0538573b3437ce67ad2bd53c1afa" Mar 16 16:42:36 crc kubenswrapper[5120]: I0316 16:42:36.113279 5120 scope.go:117] "RemoveContainer" containerID="ed955fa3ce6cceff64977964b5f2652d3ce0b800a55c3c28002b4af4567e87e1" Mar 16 16:42:36 crc kubenswrapper[5120]: I0316 16:42:36.199706 5120 scope.go:117] "RemoveContainer" containerID="ee1809e3d0fec16a77b3f05dc2b85697eba66eb29834160eec5cdd65cb2f6926" Mar 16 16:42:36 crc kubenswrapper[5120]: I0316 16:42:36.229797 5120 scope.go:117] "RemoveContainer" containerID="ac5a80648ecd4f9c2670c944aefcdce68c3e2f73aa9abcc6d8834733b6b1b99e" Mar 16 16:42:36 crc kubenswrapper[5120]: I0316 16:42:36.272654 5120 scope.go:117] "RemoveContainer" containerID="79adda27973c1bfe253f64a2645483f9b18b3eee51fbf7b661c609dce336ef3f" Mar 16 16:42:36 crc kubenswrapper[5120]: I0316 16:42:36.309989 5120 scope.go:117] "RemoveContainer" containerID="0b5fa35e8908630cc7fea95fb76a8e5a82208855c38e6f33e82c2cfae6e4da96" Mar 16 16:42:36 crc kubenswrapper[5120]: I0316 16:42:36.362961 5120 scope.go:117] "RemoveContainer" containerID="e33584a62e63e94b8ee772c464bae71158a771a227951bc7d1483783fd437d31" Mar 16 16:42:36 crc kubenswrapper[5120]: I0316 16:42:36.632470 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"935a7850-d7f8-438f-a787-6a78e33db090","Type":"ContainerStarted","Data":"d778c8d3201f505aa08f8b8a1774d98fe321c408ea4394e5597de23b72abb24d"} Mar 16 16:42:36 crc kubenswrapper[5120]: I0316 16:42:36.632515 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"935a7850-d7f8-438f-a787-6a78e33db090","Type":"ContainerStarted","Data":"d7dd32e7de0c2fd93e29bcaac1474b1c8ebaed9d509efbae0d367991ba1a58da"} Mar 16 16:42:36 crc kubenswrapper[5120]: I0316 16:42:36.650713 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=2.650692432 podStartE2EDuration="2.650692432s" podCreationTimestamp="2026-03-16 16:42:34 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:42:36.647417454 +0000 UTC m=+4258.801349121" watchObservedRunningTime="2026-03-16 16:42:36.650692432 +0000 UTC m=+4258.804624089" Mar 16 16:42:37 crc kubenswrapper[5120]: I0316 16:42:37.647101 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="6b2c2356-2ac5-4ead-9992-644cb991d6b6" containerName="ceilometer-central-agent" containerID="cri-o://d39adc826bc96041ba32212001cbe6f3c3eefa8e24e9d9bf8506e6b589d8518e" gracePeriod=30 Mar 16 16:42:37 crc kubenswrapper[5120]: I0316 16:42:37.647102 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"6b2c2356-2ac5-4ead-9992-644cb991d6b6","Type":"ContainerStarted","Data":"d5f226cde0a0e9aa39a230ca4f2becefc0c53605c189c61492513fbfaaca6564"} Mar 16 16:42:37 crc kubenswrapper[5120]: I0316 16:42:37.647705 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:42:37 crc kubenswrapper[5120]: I0316 16:42:37.647156 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="6b2c2356-2ac5-4ead-9992-644cb991d6b6" containerName="proxy-httpd" containerID="cri-o://d5f226cde0a0e9aa39a230ca4f2becefc0c53605c189c61492513fbfaaca6564" gracePeriod=30 Mar 16 16:42:37 crc kubenswrapper[5120]: I0316 16:42:37.647175 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="6b2c2356-2ac5-4ead-9992-644cb991d6b6" containerName="sg-core" containerID="cri-o://73ed2586feb010249ebbdcafd447ad03d4a760835776787349b630d11e9ae23c" gracePeriod=30 Mar 16 16:42:37 crc kubenswrapper[5120]: I0316 16:42:37.647191 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="6b2c2356-2ac5-4ead-9992-644cb991d6b6" containerName="ceilometer-notification-agent" containerID="cri-o://b36016de3f15aab96850c14f53e26379a59562be4a76c63c30c9e9b76c401878" gracePeriod=30 Mar 16 16:42:37 crc kubenswrapper[5120]: I0316 16:42:37.687340 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.463388227 podStartE2EDuration="7.687317857s" podCreationTimestamp="2026-03-16 16:42:30 +0000 UTC" firstStartedPulling="2026-03-16 16:42:31.710704759 +0000 UTC m=+4253.864636416" lastFinishedPulling="2026-03-16 16:42:36.934634379 +0000 UTC m=+4259.088566046" observedRunningTime="2026-03-16 16:42:37.677371017 +0000 UTC m=+4259.831302684" watchObservedRunningTime="2026-03-16 16:42:37.687317857 +0000 UTC m=+4259.841249524" Mar 16 16:42:38 crc kubenswrapper[5120]: I0316 16:42:38.661856 5120 generic.go:358] "Generic (PLEG): container finished" podID="6b2c2356-2ac5-4ead-9992-644cb991d6b6" containerID="d5f226cde0a0e9aa39a230ca4f2becefc0c53605c189c61492513fbfaaca6564" exitCode=0 Mar 16 16:42:38 crc kubenswrapper[5120]: I0316 16:42:38.662373 5120 generic.go:358] "Generic (PLEG): container finished" podID="6b2c2356-2ac5-4ead-9992-644cb991d6b6" containerID="73ed2586feb010249ebbdcafd447ad03d4a760835776787349b630d11e9ae23c" exitCode=2 Mar 16 16:42:38 crc kubenswrapper[5120]: I0316 16:42:38.662388 5120 generic.go:358] "Generic (PLEG): container finished" podID="6b2c2356-2ac5-4ead-9992-644cb991d6b6" containerID="b36016de3f15aab96850c14f53e26379a59562be4a76c63c30c9e9b76c401878" exitCode=0 Mar 16 16:42:38 crc kubenswrapper[5120]: I0316 16:42:38.662399 5120 generic.go:358] "Generic (PLEG): container finished" podID="6b2c2356-2ac5-4ead-9992-644cb991d6b6" containerID="d39adc826bc96041ba32212001cbe6f3c3eefa8e24e9d9bf8506e6b589d8518e" exitCode=0 Mar 16 16:42:38 crc kubenswrapper[5120]: I0316 16:42:38.662084 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"6b2c2356-2ac5-4ead-9992-644cb991d6b6","Type":"ContainerDied","Data":"d5f226cde0a0e9aa39a230ca4f2becefc0c53605c189c61492513fbfaaca6564"} Mar 16 16:42:38 crc kubenswrapper[5120]: I0316 16:42:38.663184 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"6b2c2356-2ac5-4ead-9992-644cb991d6b6","Type":"ContainerDied","Data":"73ed2586feb010249ebbdcafd447ad03d4a760835776787349b630d11e9ae23c"} Mar 16 16:42:38 crc kubenswrapper[5120]: I0316 16:42:38.663201 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"6b2c2356-2ac5-4ead-9992-644cb991d6b6","Type":"ContainerDied","Data":"b36016de3f15aab96850c14f53e26379a59562be4a76c63c30c9e9b76c401878"} Mar 16 16:42:38 crc kubenswrapper[5120]: I0316 16:42:38.663216 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"6b2c2356-2ac5-4ead-9992-644cb991d6b6","Type":"ContainerDied","Data":"d39adc826bc96041ba32212001cbe6f3c3eefa8e24e9d9bf8506e6b589d8518e"} Mar 16 16:42:38 crc kubenswrapper[5120]: I0316 16:42:38.936009 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:42:39 crc kubenswrapper[5120]: I0316 16:42:39.054451 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9tjhf\" (UniqueName: \"kubernetes.io/projected/6b2c2356-2ac5-4ead-9992-644cb991d6b6-kube-api-access-9tjhf\") pod \"6b2c2356-2ac5-4ead-9992-644cb991d6b6\" (UID: \"6b2c2356-2ac5-4ead-9992-644cb991d6b6\") " Mar 16 16:42:39 crc kubenswrapper[5120]: I0316 16:42:39.054674 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6b2c2356-2ac5-4ead-9992-644cb991d6b6-scripts\") pod \"6b2c2356-2ac5-4ead-9992-644cb991d6b6\" (UID: \"6b2c2356-2ac5-4ead-9992-644cb991d6b6\") " Mar 16 16:42:39 crc kubenswrapper[5120]: I0316 16:42:39.054908 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/6b2c2356-2ac5-4ead-9992-644cb991d6b6-ceilometer-tls-certs\") pod \"6b2c2356-2ac5-4ead-9992-644cb991d6b6\" (UID: \"6b2c2356-2ac5-4ead-9992-644cb991d6b6\") " Mar 16 16:42:39 crc kubenswrapper[5120]: I0316 16:42:39.055064 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/6b2c2356-2ac5-4ead-9992-644cb991d6b6-run-httpd\") pod \"6b2c2356-2ac5-4ead-9992-644cb991d6b6\" (UID: \"6b2c2356-2ac5-4ead-9992-644cb991d6b6\") " Mar 16 16:42:39 crc kubenswrapper[5120]: I0316 16:42:39.055143 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6b2c2356-2ac5-4ead-9992-644cb991d6b6-combined-ca-bundle\") pod \"6b2c2356-2ac5-4ead-9992-644cb991d6b6\" (UID: \"6b2c2356-2ac5-4ead-9992-644cb991d6b6\") " Mar 16 16:42:39 crc kubenswrapper[5120]: I0316 16:42:39.055454 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b2c2356-2ac5-4ead-9992-644cb991d6b6-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "6b2c2356-2ac5-4ead-9992-644cb991d6b6" (UID: "6b2c2356-2ac5-4ead-9992-644cb991d6b6"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:42:39 crc kubenswrapper[5120]: I0316 16:42:39.055522 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/6b2c2356-2ac5-4ead-9992-644cb991d6b6-sg-core-conf-yaml\") pod \"6b2c2356-2ac5-4ead-9992-644cb991d6b6\" (UID: \"6b2c2356-2ac5-4ead-9992-644cb991d6b6\") " Mar 16 16:42:39 crc kubenswrapper[5120]: I0316 16:42:39.055608 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/6b2c2356-2ac5-4ead-9992-644cb991d6b6-log-httpd\") pod \"6b2c2356-2ac5-4ead-9992-644cb991d6b6\" (UID: \"6b2c2356-2ac5-4ead-9992-644cb991d6b6\") " Mar 16 16:42:39 crc kubenswrapper[5120]: I0316 16:42:39.055947 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6b2c2356-2ac5-4ead-9992-644cb991d6b6-config-data\") pod \"6b2c2356-2ac5-4ead-9992-644cb991d6b6\" (UID: \"6b2c2356-2ac5-4ead-9992-644cb991d6b6\") " Mar 16 16:42:39 crc kubenswrapper[5120]: I0316 16:42:39.056080 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b2c2356-2ac5-4ead-9992-644cb991d6b6-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "6b2c2356-2ac5-4ead-9992-644cb991d6b6" (UID: "6b2c2356-2ac5-4ead-9992-644cb991d6b6"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:42:39 crc kubenswrapper[5120]: I0316 16:42:39.056568 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/6b2c2356-2ac5-4ead-9992-644cb991d6b6-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:42:39 crc kubenswrapper[5120]: I0316 16:42:39.056590 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/6b2c2356-2ac5-4ead-9992-644cb991d6b6-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:42:39 crc kubenswrapper[5120]: I0316 16:42:39.061483 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b2c2356-2ac5-4ead-9992-644cb991d6b6-scripts" (OuterVolumeSpecName: "scripts") pod "6b2c2356-2ac5-4ead-9992-644cb991d6b6" (UID: "6b2c2356-2ac5-4ead-9992-644cb991d6b6"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:42:39 crc kubenswrapper[5120]: I0316 16:42:39.068222 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b2c2356-2ac5-4ead-9992-644cb991d6b6-kube-api-access-9tjhf" (OuterVolumeSpecName: "kube-api-access-9tjhf") pod "6b2c2356-2ac5-4ead-9992-644cb991d6b6" (UID: "6b2c2356-2ac5-4ead-9992-644cb991d6b6"). InnerVolumeSpecName "kube-api-access-9tjhf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:42:39 crc kubenswrapper[5120]: I0316 16:42:39.087879 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b2c2356-2ac5-4ead-9992-644cb991d6b6-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "6b2c2356-2ac5-4ead-9992-644cb991d6b6" (UID: "6b2c2356-2ac5-4ead-9992-644cb991d6b6"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:42:39 crc kubenswrapper[5120]: I0316 16:42:39.112541 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b2c2356-2ac5-4ead-9992-644cb991d6b6-ceilometer-tls-certs" (OuterVolumeSpecName: "ceilometer-tls-certs") pod "6b2c2356-2ac5-4ead-9992-644cb991d6b6" (UID: "6b2c2356-2ac5-4ead-9992-644cb991d6b6"). InnerVolumeSpecName "ceilometer-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:42:39 crc kubenswrapper[5120]: I0316 16:42:39.158273 5120 reconciler_common.go:299] "Volume detached for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/6b2c2356-2ac5-4ead-9992-644cb991d6b6-ceilometer-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:42:39 crc kubenswrapper[5120]: I0316 16:42:39.158305 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/6b2c2356-2ac5-4ead-9992-644cb991d6b6-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 16:42:39 crc kubenswrapper[5120]: I0316 16:42:39.158317 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9tjhf\" (UniqueName: \"kubernetes.io/projected/6b2c2356-2ac5-4ead-9992-644cb991d6b6-kube-api-access-9tjhf\") on node \"crc\" DevicePath \"\"" Mar 16 16:42:39 crc kubenswrapper[5120]: I0316 16:42:39.158325 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6b2c2356-2ac5-4ead-9992-644cb991d6b6-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:42:39 crc kubenswrapper[5120]: I0316 16:42:39.159136 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b2c2356-2ac5-4ead-9992-644cb991d6b6-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "6b2c2356-2ac5-4ead-9992-644cb991d6b6" (UID: "6b2c2356-2ac5-4ead-9992-644cb991d6b6"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:42:39 crc kubenswrapper[5120]: I0316 16:42:39.163637 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b2c2356-2ac5-4ead-9992-644cb991d6b6-config-data" (OuterVolumeSpecName: "config-data") pod "6b2c2356-2ac5-4ead-9992-644cb991d6b6" (UID: "6b2c2356-2ac5-4ead-9992-644cb991d6b6"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:42:39 crc kubenswrapper[5120]: I0316 16:42:39.261292 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6b2c2356-2ac5-4ead-9992-644cb991d6b6-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:42:39 crc kubenswrapper[5120]: I0316 16:42:39.261624 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6b2c2356-2ac5-4ead-9992-644cb991d6b6-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:42:39 crc kubenswrapper[5120]: I0316 16:42:39.677138 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:42:39 crc kubenswrapper[5120]: I0316 16:42:39.677149 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"6b2c2356-2ac5-4ead-9992-644cb991d6b6","Type":"ContainerDied","Data":"78c3e9ff0eacd13ba62ea912deb58141a5b8851f0a924ff16e7870ef823db395"} Mar 16 16:42:39 crc kubenswrapper[5120]: I0316 16:42:39.678146 5120 scope.go:117] "RemoveContainer" containerID="d5f226cde0a0e9aa39a230ca4f2becefc0c53605c189c61492513fbfaaca6564" Mar 16 16:42:39 crc kubenswrapper[5120]: I0316 16:42:39.712809 5120 scope.go:117] "RemoveContainer" containerID="73ed2586feb010249ebbdcafd447ad03d4a760835776787349b630d11e9ae23c" Mar 16 16:42:39 crc kubenswrapper[5120]: I0316 16:42:39.726052 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:42:39 crc kubenswrapper[5120]: I0316 16:42:39.740845 5120 scope.go:117] "RemoveContainer" containerID="b36016de3f15aab96850c14f53e26379a59562be4a76c63c30c9e9b76c401878" Mar 16 16:42:39 crc kubenswrapper[5120]: I0316 16:42:39.740988 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:42:39 crc kubenswrapper[5120]: I0316 16:42:39.749371 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:42:39 crc kubenswrapper[5120]: I0316 16:42:39.750715 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b2c2356-2ac5-4ead-9992-644cb991d6b6" containerName="ceilometer-central-agent" Mar 16 16:42:39 crc kubenswrapper[5120]: I0316 16:42:39.750738 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b2c2356-2ac5-4ead-9992-644cb991d6b6" containerName="ceilometer-central-agent" Mar 16 16:42:39 crc kubenswrapper[5120]: I0316 16:42:39.750781 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b2c2356-2ac5-4ead-9992-644cb991d6b6" containerName="ceilometer-notification-agent" Mar 16 16:42:39 crc kubenswrapper[5120]: I0316 16:42:39.750791 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b2c2356-2ac5-4ead-9992-644cb991d6b6" containerName="ceilometer-notification-agent" Mar 16 16:42:39 crc kubenswrapper[5120]: I0316 16:42:39.750814 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b2c2356-2ac5-4ead-9992-644cb991d6b6" containerName="sg-core" Mar 16 16:42:39 crc kubenswrapper[5120]: I0316 16:42:39.750822 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b2c2356-2ac5-4ead-9992-644cb991d6b6" containerName="sg-core" Mar 16 16:42:39 crc kubenswrapper[5120]: I0316 16:42:39.750832 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b2c2356-2ac5-4ead-9992-644cb991d6b6" containerName="proxy-httpd" Mar 16 16:42:39 crc kubenswrapper[5120]: I0316 16:42:39.750839 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b2c2356-2ac5-4ead-9992-644cb991d6b6" containerName="proxy-httpd" Mar 16 16:42:39 crc kubenswrapper[5120]: I0316 16:42:39.751073 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="6b2c2356-2ac5-4ead-9992-644cb991d6b6" containerName="proxy-httpd" Mar 16 16:42:39 crc kubenswrapper[5120]: I0316 16:42:39.751096 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="6b2c2356-2ac5-4ead-9992-644cb991d6b6" containerName="sg-core" Mar 16 16:42:39 crc kubenswrapper[5120]: I0316 16:42:39.751109 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="6b2c2356-2ac5-4ead-9992-644cb991d6b6" containerName="ceilometer-central-agent" Mar 16 16:42:39 crc kubenswrapper[5120]: I0316 16:42:39.751127 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="6b2c2356-2ac5-4ead-9992-644cb991d6b6" containerName="ceilometer-notification-agent" Mar 16 16:42:39 crc kubenswrapper[5120]: I0316 16:42:39.761437 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:42:39 crc kubenswrapper[5120]: I0316 16:42:39.761566 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:42:39 crc kubenswrapper[5120]: I0316 16:42:39.765485 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 16:42:39 crc kubenswrapper[5120]: I0316 16:42:39.765837 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ceilometer-internal-svc\"" Mar 16 16:42:39 crc kubenswrapper[5120]: I0316 16:42:39.766108 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 16:42:39 crc kubenswrapper[5120]: I0316 16:42:39.770490 5120 scope.go:117] "RemoveContainer" containerID="d39adc826bc96041ba32212001cbe6f3c3eefa8e24e9d9bf8506e6b589d8518e" Mar 16 16:42:39 crc kubenswrapper[5120]: I0316 16:42:39.784710 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/208d2d80-c39f-4984-bd83-13868306b946-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"208d2d80-c39f-4984-bd83-13868306b946\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:42:39 crc kubenswrapper[5120]: I0316 16:42:39.785839 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/208d2d80-c39f-4984-bd83-13868306b946-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"208d2d80-c39f-4984-bd83-13868306b946\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:42:39 crc kubenswrapper[5120]: I0316 16:42:39.785886 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/208d2d80-c39f-4984-bd83-13868306b946-config-data\") pod \"ceilometer-0\" (UID: \"208d2d80-c39f-4984-bd83-13868306b946\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:42:39 crc kubenswrapper[5120]: I0316 16:42:39.785912 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pcsbl\" (UniqueName: \"kubernetes.io/projected/208d2d80-c39f-4984-bd83-13868306b946-kube-api-access-pcsbl\") pod \"ceilometer-0\" (UID: \"208d2d80-c39f-4984-bd83-13868306b946\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:42:39 crc kubenswrapper[5120]: I0316 16:42:39.786023 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/208d2d80-c39f-4984-bd83-13868306b946-scripts\") pod \"ceilometer-0\" (UID: \"208d2d80-c39f-4984-bd83-13868306b946\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:42:39 crc kubenswrapper[5120]: I0316 16:42:39.786099 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/208d2d80-c39f-4984-bd83-13868306b946-log-httpd\") pod \"ceilometer-0\" (UID: \"208d2d80-c39f-4984-bd83-13868306b946\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:42:39 crc kubenswrapper[5120]: I0316 16:42:39.786144 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/208d2d80-c39f-4984-bd83-13868306b946-run-httpd\") pod \"ceilometer-0\" (UID: \"208d2d80-c39f-4984-bd83-13868306b946\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:42:39 crc kubenswrapper[5120]: I0316 16:42:39.786172 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/208d2d80-c39f-4984-bd83-13868306b946-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"208d2d80-c39f-4984-bd83-13868306b946\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:42:39 crc kubenswrapper[5120]: I0316 16:42:39.887932 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/208d2d80-c39f-4984-bd83-13868306b946-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"208d2d80-c39f-4984-bd83-13868306b946\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:42:39 crc kubenswrapper[5120]: I0316 16:42:39.887979 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/208d2d80-c39f-4984-bd83-13868306b946-config-data\") pod \"ceilometer-0\" (UID: \"208d2d80-c39f-4984-bd83-13868306b946\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:42:39 crc kubenswrapper[5120]: I0316 16:42:39.888000 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pcsbl\" (UniqueName: \"kubernetes.io/projected/208d2d80-c39f-4984-bd83-13868306b946-kube-api-access-pcsbl\") pod \"ceilometer-0\" (UID: \"208d2d80-c39f-4984-bd83-13868306b946\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:42:39 crc kubenswrapper[5120]: I0316 16:42:39.888037 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/208d2d80-c39f-4984-bd83-13868306b946-scripts\") pod \"ceilometer-0\" (UID: \"208d2d80-c39f-4984-bd83-13868306b946\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:42:39 crc kubenswrapper[5120]: I0316 16:42:39.888068 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/208d2d80-c39f-4984-bd83-13868306b946-log-httpd\") pod \"ceilometer-0\" (UID: \"208d2d80-c39f-4984-bd83-13868306b946\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:42:39 crc kubenswrapper[5120]: I0316 16:42:39.888093 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/208d2d80-c39f-4984-bd83-13868306b946-run-httpd\") pod \"ceilometer-0\" (UID: \"208d2d80-c39f-4984-bd83-13868306b946\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:42:39 crc kubenswrapper[5120]: I0316 16:42:39.888111 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/208d2d80-c39f-4984-bd83-13868306b946-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"208d2d80-c39f-4984-bd83-13868306b946\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:42:39 crc kubenswrapper[5120]: I0316 16:42:39.888325 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/208d2d80-c39f-4984-bd83-13868306b946-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"208d2d80-c39f-4984-bd83-13868306b946\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:42:39 crc kubenswrapper[5120]: I0316 16:42:39.888665 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/208d2d80-c39f-4984-bd83-13868306b946-log-httpd\") pod \"ceilometer-0\" (UID: \"208d2d80-c39f-4984-bd83-13868306b946\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:42:39 crc kubenswrapper[5120]: I0316 16:42:39.888723 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/208d2d80-c39f-4984-bd83-13868306b946-run-httpd\") pod \"ceilometer-0\" (UID: \"208d2d80-c39f-4984-bd83-13868306b946\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:42:39 crc kubenswrapper[5120]: I0316 16:42:39.893303 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/208d2d80-c39f-4984-bd83-13868306b946-scripts\") pod \"ceilometer-0\" (UID: \"208d2d80-c39f-4984-bd83-13868306b946\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:42:39 crc kubenswrapper[5120]: I0316 16:42:39.893480 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/208d2d80-c39f-4984-bd83-13868306b946-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"208d2d80-c39f-4984-bd83-13868306b946\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:42:39 crc kubenswrapper[5120]: I0316 16:42:39.893899 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/208d2d80-c39f-4984-bd83-13868306b946-config-data\") pod \"ceilometer-0\" (UID: \"208d2d80-c39f-4984-bd83-13868306b946\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:42:39 crc kubenswrapper[5120]: I0316 16:42:39.901196 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/208d2d80-c39f-4984-bd83-13868306b946-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"208d2d80-c39f-4984-bd83-13868306b946\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:42:39 crc kubenswrapper[5120]: I0316 16:42:39.901976 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/208d2d80-c39f-4984-bd83-13868306b946-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"208d2d80-c39f-4984-bd83-13868306b946\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:42:39 crc kubenswrapper[5120]: I0316 16:42:39.907047 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pcsbl\" (UniqueName: \"kubernetes.io/projected/208d2d80-c39f-4984-bd83-13868306b946-kube-api-access-pcsbl\") pod \"ceilometer-0\" (UID: \"208d2d80-c39f-4984-bd83-13868306b946\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:42:40 crc kubenswrapper[5120]: I0316 16:42:40.100805 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:42:40 crc kubenswrapper[5120]: I0316 16:42:40.422362 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/certified-operators-mtfkq"] Mar 16 16:42:40 crc kubenswrapper[5120]: I0316 16:42:40.434504 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-mtfkq" Mar 16 16:42:40 crc kubenswrapper[5120]: I0316 16:42:40.436552 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/certified-operators-mtfkq"] Mar 16 16:42:40 crc kubenswrapper[5120]: I0316 16:42:40.501732 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwq7s\" (UniqueName: \"kubernetes.io/projected/f7ae6107-3e5b-42b2-9458-3322694ead18-kube-api-access-xwq7s\") pod \"certified-operators-mtfkq\" (UID: \"f7ae6107-3e5b-42b2-9458-3322694ead18\") " pod="openshift-marketplace/certified-operators-mtfkq" Mar 16 16:42:40 crc kubenswrapper[5120]: I0316 16:42:40.504025 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/f7ae6107-3e5b-42b2-9458-3322694ead18-utilities\") pod \"certified-operators-mtfkq\" (UID: \"f7ae6107-3e5b-42b2-9458-3322694ead18\") " pod="openshift-marketplace/certified-operators-mtfkq" Mar 16 16:42:40 crc kubenswrapper[5120]: I0316 16:42:40.504516 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/f7ae6107-3e5b-42b2-9458-3322694ead18-catalog-content\") pod \"certified-operators-mtfkq\" (UID: \"f7ae6107-3e5b-42b2-9458-3322694ead18\") " pod="openshift-marketplace/certified-operators-mtfkq" Mar 16 16:42:40 crc kubenswrapper[5120]: I0316 16:42:40.580237 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:42:40 crc kubenswrapper[5120]: W0316 16:42:40.593169 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod208d2d80_c39f_4984_bd83_13868306b946.slice/crio-057a5121ce7171db0a37ea4c6e12888dbe711a59741cc8493090d5be420ae492 WatchSource:0}: Error finding container 057a5121ce7171db0a37ea4c6e12888dbe711a59741cc8493090d5be420ae492: Status 404 returned error can't find the container with id 057a5121ce7171db0a37ea4c6e12888dbe711a59741cc8493090d5be420ae492 Mar 16 16:42:40 crc kubenswrapper[5120]: I0316 16:42:40.606685 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/f7ae6107-3e5b-42b2-9458-3322694ead18-utilities\") pod \"certified-operators-mtfkq\" (UID: \"f7ae6107-3e5b-42b2-9458-3322694ead18\") " pod="openshift-marketplace/certified-operators-mtfkq" Mar 16 16:42:40 crc kubenswrapper[5120]: I0316 16:42:40.606928 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/f7ae6107-3e5b-42b2-9458-3322694ead18-catalog-content\") pod \"certified-operators-mtfkq\" (UID: \"f7ae6107-3e5b-42b2-9458-3322694ead18\") " pod="openshift-marketplace/certified-operators-mtfkq" Mar 16 16:42:40 crc kubenswrapper[5120]: I0316 16:42:40.607008 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xwq7s\" (UniqueName: \"kubernetes.io/projected/f7ae6107-3e5b-42b2-9458-3322694ead18-kube-api-access-xwq7s\") pod \"certified-operators-mtfkq\" (UID: \"f7ae6107-3e5b-42b2-9458-3322694ead18\") " pod="openshift-marketplace/certified-operators-mtfkq" Mar 16 16:42:40 crc kubenswrapper[5120]: I0316 16:42:40.607403 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/f7ae6107-3e5b-42b2-9458-3322694ead18-utilities\") pod \"certified-operators-mtfkq\" (UID: \"f7ae6107-3e5b-42b2-9458-3322694ead18\") " pod="openshift-marketplace/certified-operators-mtfkq" Mar 16 16:42:40 crc kubenswrapper[5120]: I0316 16:42:40.607624 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/f7ae6107-3e5b-42b2-9458-3322694ead18-catalog-content\") pod \"certified-operators-mtfkq\" (UID: \"f7ae6107-3e5b-42b2-9458-3322694ead18\") " pod="openshift-marketplace/certified-operators-mtfkq" Mar 16 16:42:40 crc kubenswrapper[5120]: I0316 16:42:40.632562 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwq7s\" (UniqueName: \"kubernetes.io/projected/f7ae6107-3e5b-42b2-9458-3322694ead18-kube-api-access-xwq7s\") pod \"certified-operators-mtfkq\" (UID: \"f7ae6107-3e5b-42b2-9458-3322694ead18\") " pod="openshift-marketplace/certified-operators-mtfkq" Mar 16 16:42:40 crc kubenswrapper[5120]: I0316 16:42:40.673627 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b2c2356-2ac5-4ead-9992-644cb991d6b6" path="/var/lib/kubelet/pods/6b2c2356-2ac5-4ead-9992-644cb991d6b6/volumes" Mar 16 16:42:40 crc kubenswrapper[5120]: I0316 16:42:40.689566 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"208d2d80-c39f-4984-bd83-13868306b946","Type":"ContainerStarted","Data":"057a5121ce7171db0a37ea4c6e12888dbe711a59741cc8493090d5be420ae492"} Mar 16 16:42:40 crc kubenswrapper[5120]: I0316 16:42:40.754817 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-mtfkq" Mar 16 16:42:41 crc kubenswrapper[5120]: I0316 16:42:41.220589 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/certified-operators-mtfkq"] Mar 16 16:42:41 crc kubenswrapper[5120]: W0316 16:42:41.228104 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7ae6107_3e5b_42b2_9458_3322694ead18.slice/crio-12c94bd4e03fb8db2063d207f86fbc88db0c87baf967fb9adf2c47cd3a3e34fe WatchSource:0}: Error finding container 12c94bd4e03fb8db2063d207f86fbc88db0c87baf967fb9adf2c47cd3a3e34fe: Status 404 returned error can't find the container with id 12c94bd4e03fb8db2063d207f86fbc88db0c87baf967fb9adf2c47cd3a3e34fe Mar 16 16:42:41 crc kubenswrapper[5120]: I0316 16:42:41.700979 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"208d2d80-c39f-4984-bd83-13868306b946","Type":"ContainerStarted","Data":"c58ce299fe1cdb3dcbe143284d5e0efe2c90efc37550b5f03322b2bea2cf9a71"} Mar 16 16:42:41 crc kubenswrapper[5120]: I0316 16:42:41.702862 5120 generic.go:358] "Generic (PLEG): container finished" podID="f7ae6107-3e5b-42b2-9458-3322694ead18" containerID="572805802d06d0eec8d20538e64fd6c7d6e191ba1ce2842d13df07204c10366c" exitCode=0 Mar 16 16:42:41 crc kubenswrapper[5120]: I0316 16:42:41.702923 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-mtfkq" event={"ID":"f7ae6107-3e5b-42b2-9458-3322694ead18","Type":"ContainerDied","Data":"572805802d06d0eec8d20538e64fd6c7d6e191ba1ce2842d13df07204c10366c"} Mar 16 16:42:41 crc kubenswrapper[5120]: I0316 16:42:41.702957 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-mtfkq" event={"ID":"f7ae6107-3e5b-42b2-9458-3322694ead18","Type":"ContainerStarted","Data":"12c94bd4e03fb8db2063d207f86fbc88db0c87baf967fb9adf2c47cd3a3e34fe"} Mar 16 16:42:42 crc kubenswrapper[5120]: I0316 16:42:42.714610 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"208d2d80-c39f-4984-bd83-13868306b946","Type":"ContainerStarted","Data":"10e209dfe1f9708e3d21b9b100a91d59bd982ee2a4aa40b2c08c2b1ccd44b1c0"} Mar 16 16:42:42 crc kubenswrapper[5120]: I0316 16:42:42.715237 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"208d2d80-c39f-4984-bd83-13868306b946","Type":"ContainerStarted","Data":"c58db8625c8fa139b58596a9b64d009fd72fbf9ea6ce1858fb7fd48fe833e794"} Mar 16 16:42:42 crc kubenswrapper[5120]: I0316 16:42:42.719506 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-mtfkq" event={"ID":"f7ae6107-3e5b-42b2-9458-3322694ead18","Type":"ContainerStarted","Data":"3aceabce0f5ed71833c55c9b258d36c02d2660e0e4319f3f9e05415fd3ab8ae4"} Mar 16 16:42:43 crc kubenswrapper[5120]: I0316 16:42:43.735359 5120 generic.go:358] "Generic (PLEG): container finished" podID="f7ae6107-3e5b-42b2-9458-3322694ead18" containerID="3aceabce0f5ed71833c55c9b258d36c02d2660e0e4319f3f9e05415fd3ab8ae4" exitCode=0 Mar 16 16:42:43 crc kubenswrapper[5120]: I0316 16:42:43.735435 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-mtfkq" event={"ID":"f7ae6107-3e5b-42b2-9458-3322694ead18","Type":"ContainerDied","Data":"3aceabce0f5ed71833c55c9b258d36c02d2660e0e4319f3f9e05415fd3ab8ae4"} Mar 16 16:42:44 crc kubenswrapper[5120]: I0316 16:42:44.752935 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-mtfkq" event={"ID":"f7ae6107-3e5b-42b2-9458-3322694ead18","Type":"ContainerStarted","Data":"04e214577445afbc95baf6f97ae4c46de44a6cf419ff870c009d827e11ed61c8"} Mar 16 16:42:44 crc kubenswrapper[5120]: I0316 16:42:44.757030 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"208d2d80-c39f-4984-bd83-13868306b946","Type":"ContainerStarted","Data":"73cb5da1aa4e0db6fc05d7ab18a073503756b66a6de287a0621f708490718f69"} Mar 16 16:42:44 crc kubenswrapper[5120]: I0316 16:42:44.757241 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:42:44 crc kubenswrapper[5120]: I0316 16:42:44.784055 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/certified-operators-mtfkq" podStartSLOduration=4.18767794 podStartE2EDuration="4.784029586s" podCreationTimestamp="2026-03-16 16:42:40 +0000 UTC" firstStartedPulling="2026-03-16 16:42:41.703839757 +0000 UTC m=+4263.857771414" lastFinishedPulling="2026-03-16 16:42:42.300191393 +0000 UTC m=+4264.454123060" observedRunningTime="2026-03-16 16:42:44.77168558 +0000 UTC m=+4266.925617247" watchObservedRunningTime="2026-03-16 16:42:44.784029586 +0000 UTC m=+4266.937961253" Mar 16 16:42:44 crc kubenswrapper[5120]: I0316 16:42:44.797013 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.335300035 podStartE2EDuration="5.796995577s" podCreationTimestamp="2026-03-16 16:42:39 +0000 UTC" firstStartedPulling="2026-03-16 16:42:40.595710973 +0000 UTC m=+4262.749642630" lastFinishedPulling="2026-03-16 16:42:44.057406515 +0000 UTC m=+4266.211338172" observedRunningTime="2026-03-16 16:42:44.794780428 +0000 UTC m=+4266.948712085" watchObservedRunningTime="2026-03-16 16:42:44.796995577 +0000 UTC m=+4266.950927234" Mar 16 16:42:44 crc kubenswrapper[5120]: I0316 16:42:44.990953 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:42:44 crc kubenswrapper[5120]: I0316 16:42:44.991013 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:42:45 crc kubenswrapper[5120]: I0316 16:42:45.997013 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="935a7850-d7f8-438f-a787-6a78e33db090" containerName="nova-api-log" probeResult="failure" output="Get \"https://10.217.1.107:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 16:42:45 crc kubenswrapper[5120]: I0316 16:42:45.997926 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="935a7850-d7f8-438f-a787-6a78e33db090" containerName="nova-api-api" probeResult="failure" output="Get \"https://10.217.1.107:8774/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Mar 16 16:42:50 crc kubenswrapper[5120]: I0316 16:42:50.755121 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/certified-operators-mtfkq" Mar 16 16:42:50 crc kubenswrapper[5120]: I0316 16:42:50.756566 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-marketplace/certified-operators-mtfkq" Mar 16 16:42:50 crc kubenswrapper[5120]: I0316 16:42:50.814560 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/certified-operators-mtfkq" Mar 16 16:42:50 crc kubenswrapper[5120]: I0316 16:42:50.886625 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/certified-operators-mtfkq" Mar 16 16:42:51 crc kubenswrapper[5120]: I0316 16:42:51.196271 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/certified-operators-mtfkq"] Mar 16 16:42:52 crc kubenswrapper[5120]: I0316 16:42:52.008665 5120 patch_prober.go:28] interesting pod/machine-config-daemon-7bf76 container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 16:42:52 crc kubenswrapper[5120]: I0316 16:42:52.010145 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 16:42:52 crc kubenswrapper[5120]: I0316 16:42:52.837460 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-marketplace/certified-operators-mtfkq" podUID="f7ae6107-3e5b-42b2-9458-3322694ead18" containerName="registry-server" containerID="cri-o://04e214577445afbc95baf6f97ae4c46de44a6cf419ff870c009d827e11ed61c8" gracePeriod=2 Mar 16 16:42:52 crc kubenswrapper[5120]: I0316 16:42:52.991359 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:42:52 crc kubenswrapper[5120]: I0316 16:42:52.991647 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:42:53 crc kubenswrapper[5120]: I0316 16:42:53.301957 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-mtfkq" Mar 16 16:42:53 crc kubenswrapper[5120]: I0316 16:42:53.461028 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/f7ae6107-3e5b-42b2-9458-3322694ead18-utilities\") pod \"f7ae6107-3e5b-42b2-9458-3322694ead18\" (UID: \"f7ae6107-3e5b-42b2-9458-3322694ead18\") " Mar 16 16:42:53 crc kubenswrapper[5120]: I0316 16:42:53.461497 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xwq7s\" (UniqueName: \"kubernetes.io/projected/f7ae6107-3e5b-42b2-9458-3322694ead18-kube-api-access-xwq7s\") pod \"f7ae6107-3e5b-42b2-9458-3322694ead18\" (UID: \"f7ae6107-3e5b-42b2-9458-3322694ead18\") " Mar 16 16:42:53 crc kubenswrapper[5120]: I0316 16:42:53.461532 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/f7ae6107-3e5b-42b2-9458-3322694ead18-catalog-content\") pod \"f7ae6107-3e5b-42b2-9458-3322694ead18\" (UID: \"f7ae6107-3e5b-42b2-9458-3322694ead18\") " Mar 16 16:42:53 crc kubenswrapper[5120]: I0316 16:42:53.463083 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7ae6107-3e5b-42b2-9458-3322694ead18-utilities" (OuterVolumeSpecName: "utilities") pod "f7ae6107-3e5b-42b2-9458-3322694ead18" (UID: "f7ae6107-3e5b-42b2-9458-3322694ead18"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:42:53 crc kubenswrapper[5120]: I0316 16:42:53.472181 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7ae6107-3e5b-42b2-9458-3322694ead18-kube-api-access-xwq7s" (OuterVolumeSpecName: "kube-api-access-xwq7s") pod "f7ae6107-3e5b-42b2-9458-3322694ead18" (UID: "f7ae6107-3e5b-42b2-9458-3322694ead18"). InnerVolumeSpecName "kube-api-access-xwq7s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:42:53 crc kubenswrapper[5120]: I0316 16:42:53.525860 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7ae6107-3e5b-42b2-9458-3322694ead18-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "f7ae6107-3e5b-42b2-9458-3322694ead18" (UID: "f7ae6107-3e5b-42b2-9458-3322694ead18"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:42:53 crc kubenswrapper[5120]: I0316 16:42:53.564549 5120 reconciler_common.go:299] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/f7ae6107-3e5b-42b2-9458-3322694ead18-utilities\") on node \"crc\" DevicePath \"\"" Mar 16 16:42:53 crc kubenswrapper[5120]: I0316 16:42:53.564584 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xwq7s\" (UniqueName: \"kubernetes.io/projected/f7ae6107-3e5b-42b2-9458-3322694ead18-kube-api-access-xwq7s\") on node \"crc\" DevicePath \"\"" Mar 16 16:42:53 crc kubenswrapper[5120]: I0316 16:42:53.564594 5120 reconciler_common.go:299] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/f7ae6107-3e5b-42b2-9458-3322694ead18-catalog-content\") on node \"crc\" DevicePath \"\"" Mar 16 16:42:53 crc kubenswrapper[5120]: I0316 16:42:53.856492 5120 generic.go:358] "Generic (PLEG): container finished" podID="f7ae6107-3e5b-42b2-9458-3322694ead18" containerID="04e214577445afbc95baf6f97ae4c46de44a6cf419ff870c009d827e11ed61c8" exitCode=0 Mar 16 16:42:53 crc kubenswrapper[5120]: I0316 16:42:53.856918 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-mtfkq" event={"ID":"f7ae6107-3e5b-42b2-9458-3322694ead18","Type":"ContainerDied","Data":"04e214577445afbc95baf6f97ae4c46de44a6cf419ff870c009d827e11ed61c8"} Mar 16 16:42:53 crc kubenswrapper[5120]: I0316 16:42:53.856960 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-mtfkq" event={"ID":"f7ae6107-3e5b-42b2-9458-3322694ead18","Type":"ContainerDied","Data":"12c94bd4e03fb8db2063d207f86fbc88db0c87baf967fb9adf2c47cd3a3e34fe"} Mar 16 16:42:53 crc kubenswrapper[5120]: I0316 16:42:53.856989 5120 scope.go:117] "RemoveContainer" containerID="04e214577445afbc95baf6f97ae4c46de44a6cf419ff870c009d827e11ed61c8" Mar 16 16:42:53 crc kubenswrapper[5120]: I0316 16:42:53.857251 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-mtfkq" Mar 16 16:42:53 crc kubenswrapper[5120]: I0316 16:42:53.919461 5120 scope.go:117] "RemoveContainer" containerID="3aceabce0f5ed71833c55c9b258d36c02d2660e0e4319f3f9e05415fd3ab8ae4" Mar 16 16:42:53 crc kubenswrapper[5120]: I0316 16:42:53.930306 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/certified-operators-mtfkq"] Mar 16 16:42:53 crc kubenswrapper[5120]: I0316 16:42:53.945333 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/certified-operators-mtfkq"] Mar 16 16:42:53 crc kubenswrapper[5120]: I0316 16:42:53.950597 5120 scope.go:117] "RemoveContainer" containerID="572805802d06d0eec8d20538e64fd6c7d6e191ba1ce2842d13df07204c10366c" Mar 16 16:42:54 crc kubenswrapper[5120]: I0316 16:42:54.000108 5120 scope.go:117] "RemoveContainer" containerID="04e214577445afbc95baf6f97ae4c46de44a6cf419ff870c009d827e11ed61c8" Mar 16 16:42:54 crc kubenswrapper[5120]: E0316 16:42:54.000716 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"04e214577445afbc95baf6f97ae4c46de44a6cf419ff870c009d827e11ed61c8\": container with ID starting with 04e214577445afbc95baf6f97ae4c46de44a6cf419ff870c009d827e11ed61c8 not found: ID does not exist" containerID="04e214577445afbc95baf6f97ae4c46de44a6cf419ff870c009d827e11ed61c8" Mar 16 16:42:54 crc kubenswrapper[5120]: I0316 16:42:54.001069 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04e214577445afbc95baf6f97ae4c46de44a6cf419ff870c009d827e11ed61c8"} err="failed to get container status \"04e214577445afbc95baf6f97ae4c46de44a6cf419ff870c009d827e11ed61c8\": rpc error: code = NotFound desc = could not find container \"04e214577445afbc95baf6f97ae4c46de44a6cf419ff870c009d827e11ed61c8\": container with ID starting with 04e214577445afbc95baf6f97ae4c46de44a6cf419ff870c009d827e11ed61c8 not found: ID does not exist" Mar 16 16:42:54 crc kubenswrapper[5120]: I0316 16:42:54.001091 5120 scope.go:117] "RemoveContainer" containerID="3aceabce0f5ed71833c55c9b258d36c02d2660e0e4319f3f9e05415fd3ab8ae4" Mar 16 16:42:54 crc kubenswrapper[5120]: E0316 16:42:54.001439 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3aceabce0f5ed71833c55c9b258d36c02d2660e0e4319f3f9e05415fd3ab8ae4\": container with ID starting with 3aceabce0f5ed71833c55c9b258d36c02d2660e0e4319f3f9e05415fd3ab8ae4 not found: ID does not exist" containerID="3aceabce0f5ed71833c55c9b258d36c02d2660e0e4319f3f9e05415fd3ab8ae4" Mar 16 16:42:54 crc kubenswrapper[5120]: I0316 16:42:54.001461 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3aceabce0f5ed71833c55c9b258d36c02d2660e0e4319f3f9e05415fd3ab8ae4"} err="failed to get container status \"3aceabce0f5ed71833c55c9b258d36c02d2660e0e4319f3f9e05415fd3ab8ae4\": rpc error: code = NotFound desc = could not find container \"3aceabce0f5ed71833c55c9b258d36c02d2660e0e4319f3f9e05415fd3ab8ae4\": container with ID starting with 3aceabce0f5ed71833c55c9b258d36c02d2660e0e4319f3f9e05415fd3ab8ae4 not found: ID does not exist" Mar 16 16:42:54 crc kubenswrapper[5120]: I0316 16:42:54.001475 5120 scope.go:117] "RemoveContainer" containerID="572805802d06d0eec8d20538e64fd6c7d6e191ba1ce2842d13df07204c10366c" Mar 16 16:42:54 crc kubenswrapper[5120]: E0316 16:42:54.003225 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"572805802d06d0eec8d20538e64fd6c7d6e191ba1ce2842d13df07204c10366c\": container with ID starting with 572805802d06d0eec8d20538e64fd6c7d6e191ba1ce2842d13df07204c10366c not found: ID does not exist" containerID="572805802d06d0eec8d20538e64fd6c7d6e191ba1ce2842d13df07204c10366c" Mar 16 16:42:54 crc kubenswrapper[5120]: I0316 16:42:54.003249 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"572805802d06d0eec8d20538e64fd6c7d6e191ba1ce2842d13df07204c10366c"} err="failed to get container status \"572805802d06d0eec8d20538e64fd6c7d6e191ba1ce2842d13df07204c10366c\": rpc error: code = NotFound desc = could not find container \"572805802d06d0eec8d20538e64fd6c7d6e191ba1ce2842d13df07204c10366c\": container with ID starting with 572805802d06d0eec8d20538e64fd6c7d6e191ba1ce2842d13df07204c10366c not found: ID does not exist" Mar 16 16:42:54 crc kubenswrapper[5120]: I0316 16:42:54.680130 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f7ae6107-3e5b-42b2-9458-3322694ead18" path="/var/lib/kubelet/pods/f7ae6107-3e5b-42b2-9458-3322694ead18/volumes" Mar 16 16:42:55 crc kubenswrapper[5120]: I0316 16:42:55.001091 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:42:55 crc kubenswrapper[5120]: I0316 16:42:55.010292 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:42:55 crc kubenswrapper[5120]: I0316 16:42:55.012632 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:42:55 crc kubenswrapper[5120]: I0316 16:42:55.885779 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:43:08 crc kubenswrapper[5120]: E0316 16:43:08.082121 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1873546 actualBytes=10240 Mar 16 16:43:15 crc kubenswrapper[5120]: I0316 16:43:15.783253 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:43:19 crc kubenswrapper[5120]: I0316 16:43:19.412711 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 16:43:19 crc kubenswrapper[5120]: I0316 16:43:19.456718 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 16:43:19 crc kubenswrapper[5120]: I0316 16:43:19.456963 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/openstackclient" podUID="591ce862-489c-49f7-8dbd-500414032fd9" containerName="openstackclient" containerID="cri-o://9419bd0a11a06fc46b0997e1cd23e133bfc77036683ad12a18f8a766d86ab63e" gracePeriod=2 Mar 16 16:43:19 crc kubenswrapper[5120]: I0316 16:43:19.471693 5120 status_manager.go:895] "Failed to get status for pod" podUID="591ce862-489c-49f7-8dbd-500414032fd9" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 16:43:19 crc kubenswrapper[5120]: I0316 16:43:19.495333 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 16:43:19 crc kubenswrapper[5120]: I0316 16:43:19.523984 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-q2nv5"] Mar 16 16:43:19 crc kubenswrapper[5120]: I0316 16:43:19.567964 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-q2nv5"] Mar 16 16:43:19 crc kubenswrapper[5120]: I0316 16:43:19.580850 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/root-account-create-update-cgjmv"] Mar 16 16:43:19 crc kubenswrapper[5120]: I0316 16:43:19.582391 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7ae6107-3e5b-42b2-9458-3322694ead18" containerName="extract-content" Mar 16 16:43:19 crc kubenswrapper[5120]: I0316 16:43:19.582510 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7ae6107-3e5b-42b2-9458-3322694ead18" containerName="extract-content" Mar 16 16:43:19 crc kubenswrapper[5120]: I0316 16:43:19.582680 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7ae6107-3e5b-42b2-9458-3322694ead18" containerName="registry-server" Mar 16 16:43:19 crc kubenswrapper[5120]: I0316 16:43:19.584895 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7ae6107-3e5b-42b2-9458-3322694ead18" containerName="registry-server" Mar 16 16:43:19 crc kubenswrapper[5120]: I0316 16:43:19.585004 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7ae6107-3e5b-42b2-9458-3322694ead18" containerName="extract-utilities" Mar 16 16:43:19 crc kubenswrapper[5120]: I0316 16:43:19.585087 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7ae6107-3e5b-42b2-9458-3322694ead18" containerName="extract-utilities" Mar 16 16:43:19 crc kubenswrapper[5120]: I0316 16:43:19.585196 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="591ce862-489c-49f7-8dbd-500414032fd9" containerName="openstackclient" Mar 16 16:43:19 crc kubenswrapper[5120]: I0316 16:43:19.585265 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="591ce862-489c-49f7-8dbd-500414032fd9" containerName="openstackclient" Mar 16 16:43:19 crc kubenswrapper[5120]: I0316 16:43:19.585709 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="591ce862-489c-49f7-8dbd-500414032fd9" containerName="openstackclient" Mar 16 16:43:19 crc kubenswrapper[5120]: I0316 16:43:19.592164 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f7ae6107-3e5b-42b2-9458-3322694ead18" containerName="registry-server" Mar 16 16:43:19 crc kubenswrapper[5120]: I0316 16:43:19.608354 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-cgjmv" Mar 16 16:43:19 crc kubenswrapper[5120]: I0316 16:43:19.612682 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-cgjmv"] Mar 16 16:43:19 crc kubenswrapper[5120]: I0316 16:43:19.613148 5120 status_manager.go:895] "Failed to get status for pod" podUID="591ce862-489c-49f7-8dbd-500414032fd9" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 16:43:19 crc kubenswrapper[5120]: I0316 16:43:19.613441 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"openstack-cell1-mariadb-root-db-secret\"" Mar 16 16:43:19 crc kubenswrapper[5120]: I0316 16:43:19.628993 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-e32b-account-create-update-xn2hk"] Mar 16 16:43:19 crc kubenswrapper[5120]: I0316 16:43:19.637363 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-e32b-account-create-update-xn2hk" Mar 16 16:43:19 crc kubenswrapper[5120]: I0316 16:43:19.642784 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-db-secret\"" Mar 16 16:43:19 crc kubenswrapper[5120]: I0316 16:43:19.672319 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-e32b-account-create-update-mlh9x"] Mar 16 16:43:19 crc kubenswrapper[5120]: I0316 16:43:19.711325 5120 status_manager.go:895] "Failed to get status for pod" podUID="591ce862-489c-49f7-8dbd-500414032fd9" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 16:43:19 crc kubenswrapper[5120]: I0316 16:43:19.714053 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ad545a3f-12c8-4905-a7fe-2bc4cbfbf09e-operator-scripts\") pod \"root-account-create-update-cgjmv\" (UID: \"ad545a3f-12c8-4905-a7fe-2bc4cbfbf09e\") " pod="openstack-kuttl-tests/root-account-create-update-cgjmv" Mar 16 16:43:19 crc kubenswrapper[5120]: I0316 16:43:19.714179 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzl26\" (UniqueName: \"kubernetes.io/projected/ad545a3f-12c8-4905-a7fe-2bc4cbfbf09e-kube-api-access-xzl26\") pod \"root-account-create-update-cgjmv\" (UID: \"ad545a3f-12c8-4905-a7fe-2bc4cbfbf09e\") " pod="openstack-kuttl-tests/root-account-create-update-cgjmv" Mar 16 16:43:19 crc kubenswrapper[5120]: I0316 16:43:19.714228 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/908660b0-e07b-45ab-92c8-1e466ddc0906-operator-scripts\") pod \"placement-e32b-account-create-update-xn2hk\" (UID: \"908660b0-e07b-45ab-92c8-1e466ddc0906\") " pod="openstack-kuttl-tests/placement-e32b-account-create-update-xn2hk" Mar 16 16:43:19 crc kubenswrapper[5120]: I0316 16:43:19.714353 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7ljr\" (UniqueName: \"kubernetes.io/projected/908660b0-e07b-45ab-92c8-1e466ddc0906-kube-api-access-t7ljr\") pod \"placement-e32b-account-create-update-xn2hk\" (UID: \"908660b0-e07b-45ab-92c8-1e466ddc0906\") " pod="openstack-kuttl-tests/placement-e32b-account-create-update-xn2hk" Mar 16 16:43:19 crc kubenswrapper[5120]: I0316 16:43:19.720793 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-e32b-account-create-update-xn2hk"] Mar 16 16:43:19 crc kubenswrapper[5120]: I0316 16:43:19.748726 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-e32b-account-create-update-mlh9x"] Mar 16 16:43:19 crc kubenswrapper[5120]: I0316 16:43:19.806832 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-e7d9-account-create-update-fwr7k"] Mar 16 16:43:19 crc kubenswrapper[5120]: I0316 16:43:19.816313 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ad545a3f-12c8-4905-a7fe-2bc4cbfbf09e-operator-scripts\") pod \"root-account-create-update-cgjmv\" (UID: \"ad545a3f-12c8-4905-a7fe-2bc4cbfbf09e\") " pod="openstack-kuttl-tests/root-account-create-update-cgjmv" Mar 16 16:43:19 crc kubenswrapper[5120]: I0316 16:43:19.816446 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xzl26\" (UniqueName: \"kubernetes.io/projected/ad545a3f-12c8-4905-a7fe-2bc4cbfbf09e-kube-api-access-xzl26\") pod \"root-account-create-update-cgjmv\" (UID: \"ad545a3f-12c8-4905-a7fe-2bc4cbfbf09e\") " pod="openstack-kuttl-tests/root-account-create-update-cgjmv" Mar 16 16:43:19 crc kubenswrapper[5120]: I0316 16:43:19.816490 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/908660b0-e07b-45ab-92c8-1e466ddc0906-operator-scripts\") pod \"placement-e32b-account-create-update-xn2hk\" (UID: \"908660b0-e07b-45ab-92c8-1e466ddc0906\") " pod="openstack-kuttl-tests/placement-e32b-account-create-update-xn2hk" Mar 16 16:43:19 crc kubenswrapper[5120]: I0316 16:43:19.816632 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t7ljr\" (UniqueName: \"kubernetes.io/projected/908660b0-e07b-45ab-92c8-1e466ddc0906-kube-api-access-t7ljr\") pod \"placement-e32b-account-create-update-xn2hk\" (UID: \"908660b0-e07b-45ab-92c8-1e466ddc0906\") " pod="openstack-kuttl-tests/placement-e32b-account-create-update-xn2hk" Mar 16 16:43:19 crc kubenswrapper[5120]: I0316 16:43:19.817696 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ad545a3f-12c8-4905-a7fe-2bc4cbfbf09e-operator-scripts\") pod \"root-account-create-update-cgjmv\" (UID: \"ad545a3f-12c8-4905-a7fe-2bc4cbfbf09e\") " pod="openstack-kuttl-tests/root-account-create-update-cgjmv" Mar 16 16:43:19 crc kubenswrapper[5120]: I0316 16:43:19.817943 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-e7d9-account-create-update-fwr7k"] Mar 16 16:43:19 crc kubenswrapper[5120]: I0316 16:43:19.818389 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/908660b0-e07b-45ab-92c8-1e466ddc0906-operator-scripts\") pod \"placement-e32b-account-create-update-xn2hk\" (UID: \"908660b0-e07b-45ab-92c8-1e466ddc0906\") " pod="openstack-kuttl-tests/placement-e32b-account-create-update-xn2hk" Mar 16 16:43:19 crc kubenswrapper[5120]: I0316 16:43:19.829519 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 16:43:19 crc kubenswrapper[5120]: I0316 16:43:19.830669 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podUID="9d23b8a0-3a5f-4bb9-84a7-f5602e4a98b0" containerName="openstack-network-exporter" containerID="cri-o://7befb30786bb8581613c702d4f626d345db7f3e118cb4ff248d66ee187c3c334" gracePeriod=300 Mar 16 16:43:19 crc kubenswrapper[5120]: I0316 16:43:19.847074 5120 status_manager.go:895] "Failed to get status for pod" podUID="591ce862-489c-49f7-8dbd-500414032fd9" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 16:43:19 crc kubenswrapper[5120]: I0316 16:43:19.848011 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-a3c5-account-create-update-ndpvq"] Mar 16 16:43:19 crc kubenswrapper[5120]: I0316 16:43:19.866651 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7ljr\" (UniqueName: \"kubernetes.io/projected/908660b0-e07b-45ab-92c8-1e466ddc0906-kube-api-access-t7ljr\") pod \"placement-e32b-account-create-update-xn2hk\" (UID: \"908660b0-e07b-45ab-92c8-1e466ddc0906\") " pod="openstack-kuttl-tests/placement-e32b-account-create-update-xn2hk" Mar 16 16:43:19 crc kubenswrapper[5120]: I0316 16:43:19.875096 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-a3c5-account-create-update-ndpvq" Mar 16 16:43:19 crc kubenswrapper[5120]: I0316 16:43:19.882065 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-nwxnc"] Mar 16 16:43:19 crc kubenswrapper[5120]: I0316 16:43:19.883617 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzl26\" (UniqueName: \"kubernetes.io/projected/ad545a3f-12c8-4905-a7fe-2bc4cbfbf09e-kube-api-access-xzl26\") pod \"root-account-create-update-cgjmv\" (UID: \"ad545a3f-12c8-4905-a7fe-2bc4cbfbf09e\") " pod="openstack-kuttl-tests/root-account-create-update-cgjmv" Mar 16 16:43:19 crc kubenswrapper[5120]: I0316 16:43:19.887026 5120 status_manager.go:895] "Failed to get status for pod" podUID="591ce862-489c-49f7-8dbd-500414032fd9" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 16:43:19 crc kubenswrapper[5120]: I0316 16:43:19.887480 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-db-secret\"" Mar 16 16:43:19 crc kubenswrapper[5120]: I0316 16:43:19.919828 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-a3c5-account-create-update-ndpvq"] Mar 16 16:43:19 crc kubenswrapper[5120]: I0316 16:43:19.920207 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/37490319-0529-4ab4-a97a-3dc9486aa867-operator-scripts\") pod \"nova-api-a3c5-account-create-update-ndpvq\" (UID: \"37490319-0529-4ab4-a97a-3dc9486aa867\") " pod="openstack-kuttl-tests/nova-api-a3c5-account-create-update-ndpvq" Mar 16 16:43:19 crc kubenswrapper[5120]: I0316 16:43:19.920412 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fcmgb\" (UniqueName: \"kubernetes.io/projected/37490319-0529-4ab4-a97a-3dc9486aa867-kube-api-access-fcmgb\") pod \"nova-api-a3c5-account-create-update-ndpvq\" (UID: \"37490319-0529-4ab4-a97a-3dc9486aa867\") " pod="openstack-kuttl-tests/nova-api-a3c5-account-create-update-ndpvq" Mar 16 16:43:19 crc kubenswrapper[5120]: I0316 16:43:19.943085 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-nwxnc"] Mar 16 16:43:19 crc kubenswrapper[5120]: I0316 16:43:19.965815 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-a3c5-account-create-update-5w5q7"] Mar 16 16:43:19 crc kubenswrapper[5120]: I0316 16:43:19.975819 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 16:43:19 crc kubenswrapper[5120]: I0316 16:43:19.986196 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-cgjmv" Mar 16 16:43:19 crc kubenswrapper[5120]: I0316 16:43:19.987040 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podUID="10cdd157-8ffd-4a86-9dba-ac570a45273b" containerName="openstack-network-exporter" containerID="cri-o://b5e1f012279bd50c0f6dd58081fae905fbd9dd2443094c84fcca48be455d262e" gracePeriod=300 Mar 16 16:43:19 crc kubenswrapper[5120]: I0316 16:43:19.987580 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-e32b-account-create-update-xn2hk" Mar 16 16:43:20 crc kubenswrapper[5120]: I0316 16:43:20.027569 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-a3c5-account-create-update-5w5q7"] Mar 16 16:43:20 crc kubenswrapper[5120]: I0316 16:43:20.050369 5120 status_manager.go:895] "Failed to get status for pod" podUID="591ce862-489c-49f7-8dbd-500414032fd9" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 16:43:20 crc kubenswrapper[5120]: I0316 16:43:20.063572 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/37490319-0529-4ab4-a97a-3dc9486aa867-operator-scripts\") pod \"nova-api-a3c5-account-create-update-ndpvq\" (UID: \"37490319-0529-4ab4-a97a-3dc9486aa867\") " pod="openstack-kuttl-tests/nova-api-a3c5-account-create-update-ndpvq" Mar 16 16:43:20 crc kubenswrapper[5120]: I0316 16:43:20.064459 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fcmgb\" (UniqueName: \"kubernetes.io/projected/37490319-0529-4ab4-a97a-3dc9486aa867-kube-api-access-fcmgb\") pod \"nova-api-a3c5-account-create-update-ndpvq\" (UID: \"37490319-0529-4ab4-a97a-3dc9486aa867\") " pod="openstack-kuttl-tests/nova-api-a3c5-account-create-update-ndpvq" Mar 16 16:43:20 crc kubenswrapper[5120]: I0316 16:43:20.064661 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/37490319-0529-4ab4-a97a-3dc9486aa867-operator-scripts\") pod \"nova-api-a3c5-account-create-update-ndpvq\" (UID: \"37490319-0529-4ab4-a97a-3dc9486aa867\") " pod="openstack-kuttl-tests/nova-api-a3c5-account-create-update-ndpvq" Mar 16 16:43:20 crc kubenswrapper[5120]: I0316 16:43:20.085873 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 16:43:20 crc kubenswrapper[5120]: I0316 16:43:20.086772 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovn-northd-0" podUID="29c96611-b802-4cfa-a407-7e3c1f341848" containerName="ovn-northd" containerID="cri-o://34d1842c49bbc63c0f0f4b2770fad4a83f430656dde3d2f187493191f00bdfe3" gracePeriod=30 Mar 16 16:43:20 crc kubenswrapper[5120]: I0316 16:43:20.087210 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovn-northd-0" podUID="29c96611-b802-4cfa-a407-7e3c1f341848" containerName="openstack-network-exporter" containerID="cri-o://f6f06b9ba370a060b54ec647220d7623fff9a52a71dc33409e4d941230f65d72" gracePeriod=30 Mar 16 16:43:20 crc kubenswrapper[5120]: I0316 16:43:20.096644 5120 status_manager.go:895] "Failed to get status for pod" podUID="591ce862-489c-49f7-8dbd-500414032fd9" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 16:43:20 crc kubenswrapper[5120]: I0316 16:43:20.119954 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fcmgb\" (UniqueName: \"kubernetes.io/projected/37490319-0529-4ab4-a97a-3dc9486aa867-kube-api-access-fcmgb\") pod \"nova-api-a3c5-account-create-update-ndpvq\" (UID: \"37490319-0529-4ab4-a97a-3dc9486aa867\") " pod="openstack-kuttl-tests/nova-api-a3c5-account-create-update-ndpvq" Mar 16 16:43:20 crc kubenswrapper[5120]: I0316 16:43:20.122419 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-f4eb-account-create-update-4wnlc"] Mar 16 16:43:20 crc kubenswrapper[5120]: I0316 16:43:20.146019 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podUID="9d23b8a0-3a5f-4bb9-84a7-f5602e4a98b0" containerName="ovsdbserver-nb" containerID="cri-o://d65c682ba8d5b9c2ab292d5eadb6afb5ebf5e5383178932398baa6bd606390df" gracePeriod=300 Mar 16 16:43:20 crc kubenswrapper[5120]: I0316 16:43:20.165292 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-f4eb-account-create-update-4wnlc" Mar 16 16:43:20 crc kubenswrapper[5120]: I0316 16:43:20.167423 5120 status_manager.go:895] "Failed to get status for pod" podUID="591ce862-489c-49f7-8dbd-500414032fd9" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 16:43:20 crc kubenswrapper[5120]: I0316 16:43:20.169743 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-db-secret\"" Mar 16 16:43:20 crc kubenswrapper[5120]: I0316 16:43:20.180362 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-f4eb-account-create-update-krgcs"] Mar 16 16:43:20 crc kubenswrapper[5120]: I0316 16:43:20.213832 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-f4eb-account-create-update-krgcs"] Mar 16 16:43:20 crc kubenswrapper[5120]: I0316 16:43:20.229131 5120 generic.go:358] "Generic (PLEG): container finished" podID="9d23b8a0-3a5f-4bb9-84a7-f5602e4a98b0" containerID="7befb30786bb8581613c702d4f626d345db7f3e118cb4ff248d66ee187c3c334" exitCode=2 Mar 16 16:43:20 crc kubenswrapper[5120]: I0316 16:43:20.229562 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"9d23b8a0-3a5f-4bb9-84a7-f5602e4a98b0","Type":"ContainerDied","Data":"7befb30786bb8581613c702d4f626d345db7f3e118cb4ff248d66ee187c3c334"} Mar 16 16:43:20 crc kubenswrapper[5120]: I0316 16:43:20.248202 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-f4eb-account-create-update-4wnlc"] Mar 16 16:43:20 crc kubenswrapper[5120]: I0316 16:43:20.269410 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/69586194-14da-4bd2-ab2d-5b464625a1a5-operator-scripts\") pod \"nova-cell0-f4eb-account-create-update-4wnlc\" (UID: \"69586194-14da-4bd2-ab2d-5b464625a1a5\") " pod="openstack-kuttl-tests/nova-cell0-f4eb-account-create-update-4wnlc" Mar 16 16:43:20 crc kubenswrapper[5120]: I0316 16:43:20.269455 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxxgl\" (UniqueName: \"kubernetes.io/projected/69586194-14da-4bd2-ab2d-5b464625a1a5-kube-api-access-pxxgl\") pod \"nova-cell0-f4eb-account-create-update-4wnlc\" (UID: \"69586194-14da-4bd2-ab2d-5b464625a1a5\") " pod="openstack-kuttl-tests/nova-cell0-f4eb-account-create-update-4wnlc" Mar 16 16:43:20 crc kubenswrapper[5120]: I0316 16:43:20.278352 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-d38a-account-create-update-6jhs9"] Mar 16 16:43:20 crc kubenswrapper[5120]: I0316 16:43:20.290866 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-d38a-account-create-update-6jhs9" Mar 16 16:43:20 crc kubenswrapper[5120]: I0316 16:43:20.297029 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-db-secret\"" Mar 16 16:43:20 crc kubenswrapper[5120]: I0316 16:43:20.308462 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-d38a-account-create-update-6jhs9"] Mar 16 16:43:20 crc kubenswrapper[5120]: I0316 16:43:20.314073 5120 status_manager.go:895] "Failed to get status for pod" podUID="591ce862-489c-49f7-8dbd-500414032fd9" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 16:43:20 crc kubenswrapper[5120]: I0316 16:43:20.337884 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-268nj"] Mar 16 16:43:20 crc kubenswrapper[5120]: I0316 16:43:20.354987 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-jpgn5"] Mar 16 16:43:20 crc kubenswrapper[5120]: I0316 16:43:20.370533 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-268nj"] Mar 16 16:43:20 crc kubenswrapper[5120]: I0316 16:43:20.372233 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/93c4c8f7-726e-4f00-b007-7411cfba1a4c-operator-scripts\") pod \"nova-cell1-d38a-account-create-update-6jhs9\" (UID: \"93c4c8f7-726e-4f00-b007-7411cfba1a4c\") " pod="openstack-kuttl-tests/nova-cell1-d38a-account-create-update-6jhs9" Mar 16 16:43:20 crc kubenswrapper[5120]: I0316 16:43:20.372414 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/69586194-14da-4bd2-ab2d-5b464625a1a5-operator-scripts\") pod \"nova-cell0-f4eb-account-create-update-4wnlc\" (UID: \"69586194-14da-4bd2-ab2d-5b464625a1a5\") " pod="openstack-kuttl-tests/nova-cell0-f4eb-account-create-update-4wnlc" Mar 16 16:43:20 crc kubenswrapper[5120]: I0316 16:43:20.372437 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6pgbx\" (UniqueName: \"kubernetes.io/projected/93c4c8f7-726e-4f00-b007-7411cfba1a4c-kube-api-access-6pgbx\") pod \"nova-cell1-d38a-account-create-update-6jhs9\" (UID: \"93c4c8f7-726e-4f00-b007-7411cfba1a4c\") " pod="openstack-kuttl-tests/nova-cell1-d38a-account-create-update-6jhs9" Mar 16 16:43:20 crc kubenswrapper[5120]: I0316 16:43:20.372463 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pxxgl\" (UniqueName: \"kubernetes.io/projected/69586194-14da-4bd2-ab2d-5b464625a1a5-kube-api-access-pxxgl\") pod \"nova-cell0-f4eb-account-create-update-4wnlc\" (UID: \"69586194-14da-4bd2-ab2d-5b464625a1a5\") " pod="openstack-kuttl-tests/nova-cell0-f4eb-account-create-update-4wnlc" Mar 16 16:43:20 crc kubenswrapper[5120]: I0316 16:43:20.373634 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/69586194-14da-4bd2-ab2d-5b464625a1a5-operator-scripts\") pod \"nova-cell0-f4eb-account-create-update-4wnlc\" (UID: \"69586194-14da-4bd2-ab2d-5b464625a1a5\") " pod="openstack-kuttl-tests/nova-cell0-f4eb-account-create-update-4wnlc" Mar 16 16:43:20 crc kubenswrapper[5120]: I0316 16:43:20.380626 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-jpgn5"] Mar 16 16:43:20 crc kubenswrapper[5120]: I0316 16:43:20.419630 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxxgl\" (UniqueName: \"kubernetes.io/projected/69586194-14da-4bd2-ab2d-5b464625a1a5-kube-api-access-pxxgl\") pod \"nova-cell0-f4eb-account-create-update-4wnlc\" (UID: \"69586194-14da-4bd2-ab2d-5b464625a1a5\") " pod="openstack-kuttl-tests/nova-cell0-f4eb-account-create-update-4wnlc" Mar 16 16:43:20 crc kubenswrapper[5120]: I0316 16:43:20.423269 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-pz6fg"] Mar 16 16:43:20 crc kubenswrapper[5120]: I0316 16:43:20.466112 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-pz6fg"] Mar 16 16:43:20 crc kubenswrapper[5120]: I0316 16:43:20.474261 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/93c4c8f7-726e-4f00-b007-7411cfba1a4c-operator-scripts\") pod \"nova-cell1-d38a-account-create-update-6jhs9\" (UID: \"93c4c8f7-726e-4f00-b007-7411cfba1a4c\") " pod="openstack-kuttl-tests/nova-cell1-d38a-account-create-update-6jhs9" Mar 16 16:43:20 crc kubenswrapper[5120]: I0316 16:43:20.474431 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6pgbx\" (UniqueName: \"kubernetes.io/projected/93c4c8f7-726e-4f00-b007-7411cfba1a4c-kube-api-access-6pgbx\") pod \"nova-cell1-d38a-account-create-update-6jhs9\" (UID: \"93c4c8f7-726e-4f00-b007-7411cfba1a4c\") " pod="openstack-kuttl-tests/nova-cell1-d38a-account-create-update-6jhs9" Mar 16 16:43:20 crc kubenswrapper[5120]: I0316 16:43:20.475295 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/93c4c8f7-726e-4f00-b007-7411cfba1a4c-operator-scripts\") pod \"nova-cell1-d38a-account-create-update-6jhs9\" (UID: \"93c4c8f7-726e-4f00-b007-7411cfba1a4c\") " pod="openstack-kuttl-tests/nova-cell1-d38a-account-create-update-6jhs9" Mar 16 16:43:20 crc kubenswrapper[5120]: I0316 16:43:20.498372 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6pgbx\" (UniqueName: \"kubernetes.io/projected/93c4c8f7-726e-4f00-b007-7411cfba1a4c-kube-api-access-6pgbx\") pod \"nova-cell1-d38a-account-create-update-6jhs9\" (UID: \"93c4c8f7-726e-4f00-b007-7411cfba1a4c\") " pod="openstack-kuttl-tests/nova-cell1-d38a-account-create-update-6jhs9" Mar 16 16:43:20 crc kubenswrapper[5120]: I0316 16:43:20.502868 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-txkbm"] Mar 16 16:43:20 crc kubenswrapper[5120]: I0316 16:43:20.523862 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-txkbm"] Mar 16 16:43:20 crc kubenswrapper[5120]: I0316 16:43:20.581886 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-d38a-account-create-update-zwjc7"] Mar 16 16:43:20 crc kubenswrapper[5120]: I0316 16:43:20.631322 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-d38a-account-create-update-zwjc7"] Mar 16 16:43:20 crc kubenswrapper[5120]: I0316 16:43:20.645097 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-9hsz8"] Mar 16 16:43:20 crc kubenswrapper[5120]: I0316 16:43:20.687443 5120 kubelet_pods.go:1019] "Unable to retrieve pull secret, the image pull may not succeed." pod="openstack-kuttl-tests/placement-6d66dbd7f8-6ld6p" secret="" err="secret \"placement-placement-dockercfg-nmhck\" not found" Mar 16 16:43:20 crc kubenswrapper[5120]: I0316 16:43:20.696012 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="09b33b66-f54d-4afc-90f8-da4637e37095" path="/var/lib/kubelet/pods/09b33b66-f54d-4afc-90f8-da4637e37095/volumes" Mar 16 16:43:20 crc kubenswrapper[5120]: I0316 16:43:20.696701 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1a920725-764e-48f9-bb7f-9718e4b64091" path="/var/lib/kubelet/pods/1a920725-764e-48f9-bb7f-9718e4b64091/volumes" Mar 16 16:43:20 crc kubenswrapper[5120]: I0316 16:43:20.700098 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="28c1bf81-d31b-4bbc-93e5-a93447e1b730" path="/var/lib/kubelet/pods/28c1bf81-d31b-4bbc-93e5-a93447e1b730/volumes" Mar 16 16:43:20 crc kubenswrapper[5120]: I0316 16:43:20.700587 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="334707cf-7ffa-4fe5-94c5-e9402769ca11" path="/var/lib/kubelet/pods/334707cf-7ffa-4fe5-94c5-e9402769ca11/volumes" Mar 16 16:43:20 crc kubenswrapper[5120]: I0316 16:43:20.701541 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="408d0cb7-eebd-4e62-9e6c-553fb62f178e" path="/var/lib/kubelet/pods/408d0cb7-eebd-4e62-9e6c-553fb62f178e/volumes" Mar 16 16:43:20 crc kubenswrapper[5120]: I0316 16:43:20.702473 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="462452f5-5fb2-44a0-b52d-a3660a4346f7" path="/var/lib/kubelet/pods/462452f5-5fb2-44a0-b52d-a3660a4346f7/volumes" Mar 16 16:43:20 crc kubenswrapper[5120]: I0316 16:43:20.702967 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="745bf98f-c08e-46c9-a315-18ee1ff7ca20" path="/var/lib/kubelet/pods/745bf98f-c08e-46c9-a315-18ee1ff7ca20/volumes" Mar 16 16:43:20 crc kubenswrapper[5120]: I0316 16:43:20.703439 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93a2b4d2-8481-44a9-8d12-62db95189e45" path="/var/lib/kubelet/pods/93a2b4d2-8481-44a9-8d12-62db95189e45/volumes" Mar 16 16:43:20 crc kubenswrapper[5120]: I0316 16:43:20.704985 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b055003e-69db-43e3-b335-278f9687fcc7" path="/var/lib/kubelet/pods/b055003e-69db-43e3-b335-278f9687fcc7/volumes" Mar 16 16:43:20 crc kubenswrapper[5120]: I0316 16:43:20.707386 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d63482e7-41aa-4a92-a5d5-3d238ef52b54" path="/var/lib/kubelet/pods/d63482e7-41aa-4a92-a5d5-3d238ef52b54/volumes" Mar 16 16:43:20 crc kubenswrapper[5120]: I0316 16:43:20.707978 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e988df9f-eee2-4103-9df2-1e999506d1ca" path="/var/lib/kubelet/pods/e988df9f-eee2-4103-9df2-1e999506d1ca/volumes" Mar 16 16:43:20 crc kubenswrapper[5120]: I0316 16:43:20.709466 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-9hsz8"] Mar 16 16:43:20 crc kubenswrapper[5120]: I0316 16:43:20.724577 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podUID="10cdd157-8ffd-4a86-9dba-ac570a45273b" containerName="ovsdbserver-sb" containerID="cri-o://91db5da9c2c16a0ddc0621d66df7fe0db6a0c98754c249f4f2ac5a8195fade13" gracePeriod=300 Mar 16 16:43:20 crc kubenswrapper[5120]: I0316 16:43:20.726742 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 16:43:20 crc kubenswrapper[5120]: I0316 16:43:20.727341 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="7f161303-6db3-42fc-8cca-089c09eabda5" containerName="account-server" containerID="cri-o://393ca2c1ba80ec2d0992f37df8ef733396f1e566797d1d4d0e97ee936b2dd556" gracePeriod=30 Mar 16 16:43:20 crc kubenswrapper[5120]: I0316 16:43:20.727873 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="7f161303-6db3-42fc-8cca-089c09eabda5" containerName="swift-recon-cron" containerID="cri-o://75af2c5427cb378d8c7fc864d06681c8a85a02d921ffdac841d96d8c10ac4a44" gracePeriod=30 Mar 16 16:43:20 crc kubenswrapper[5120]: I0316 16:43:20.727925 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="7f161303-6db3-42fc-8cca-089c09eabda5" containerName="rsync" containerID="cri-o://832bc34866fa4463f5bace762c43ae81c0bb3c37a033c02d4a2f823022e660b8" gracePeriod=30 Mar 16 16:43:20 crc kubenswrapper[5120]: I0316 16:43:20.727963 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="7f161303-6db3-42fc-8cca-089c09eabda5" containerName="object-expirer" containerID="cri-o://6eb2da0f9d23498832f20c9907eb27be212445bdc8591a5d329c515457fec159" gracePeriod=30 Mar 16 16:43:20 crc kubenswrapper[5120]: I0316 16:43:20.727993 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="7f161303-6db3-42fc-8cca-089c09eabda5" containerName="object-updater" containerID="cri-o://701430e9b417ed89663c5d841e28695f639a5ce24a937584b3e91e1668f567a9" gracePeriod=30 Mar 16 16:43:20 crc kubenswrapper[5120]: I0316 16:43:20.728023 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="7f161303-6db3-42fc-8cca-089c09eabda5" containerName="object-auditor" containerID="cri-o://45d417324d3b1fd816cb84ece88a62414ef3cde2344cbac2b40f9cd9bb15195b" gracePeriod=30 Mar 16 16:43:20 crc kubenswrapper[5120]: I0316 16:43:20.728058 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="7f161303-6db3-42fc-8cca-089c09eabda5" containerName="object-replicator" containerID="cri-o://eda7739ccb0bef92fc25f7b29815a187360fa6bc837dbfdcb2b947bbd2a51f25" gracePeriod=30 Mar 16 16:43:20 crc kubenswrapper[5120]: I0316 16:43:20.728095 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="7f161303-6db3-42fc-8cca-089c09eabda5" containerName="account-reaper" containerID="cri-o://50d21a1eb1dee64601b5ac5d957233a5b9c12af3c1f70e2ba64fc3fa232a426c" gracePeriod=30 Mar 16 16:43:20 crc kubenswrapper[5120]: I0316 16:43:20.728128 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="7f161303-6db3-42fc-8cca-089c09eabda5" containerName="account-auditor" containerID="cri-o://ae6a8c449bb16b6545d66ae19692d865fa5ca0fbbd29063f0dcab3878ee4f6d9" gracePeriod=30 Mar 16 16:43:20 crc kubenswrapper[5120]: I0316 16:43:20.728161 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="7f161303-6db3-42fc-8cca-089c09eabda5" containerName="object-server" containerID="cri-o://878127ce868e772a907a2ec7f0247432f773e62eb60e0862523ea4e92c9cfb2c" gracePeriod=30 Mar 16 16:43:20 crc kubenswrapper[5120]: I0316 16:43:20.728175 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="7f161303-6db3-42fc-8cca-089c09eabda5" containerName="account-replicator" containerID="cri-o://0dd9bc3530759ea0393d12b620c6656b9900476393827384cefdec7f3b8a3955" gracePeriod=30 Mar 16 16:43:20 crc kubenswrapper[5120]: I0316 16:43:20.728293 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="7f161303-6db3-42fc-8cca-089c09eabda5" containerName="container-updater" containerID="cri-o://41bf99c5b4ac98ecadd81e8cdce4cfcf28dacdb72cf8eb33999efeac56f08c40" gracePeriod=30 Mar 16 16:43:20 crc kubenswrapper[5120]: I0316 16:43:20.728354 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="7f161303-6db3-42fc-8cca-089c09eabda5" containerName="container-auditor" containerID="cri-o://9da44b1906810fa56c015f549e5d082a124aad433f4666dd020ee73c3746d9bd" gracePeriod=30 Mar 16 16:43:20 crc kubenswrapper[5120]: I0316 16:43:20.728388 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="7f161303-6db3-42fc-8cca-089c09eabda5" containerName="container-replicator" containerID="cri-o://fc984a4dad798acc485f3583ca06562c9e78166d32047287908fccc38d13a52c" gracePeriod=30 Mar 16 16:43:20 crc kubenswrapper[5120]: I0316 16:43:20.728133 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="7f161303-6db3-42fc-8cca-089c09eabda5" containerName="container-server" containerID="cri-o://639eb84e58ef1695b15c612c5e0ef5adc5f87e7687551d830e9e1103b5d73e84" gracePeriod=30 Mar 16 16:43:20 crc kubenswrapper[5120]: I0316 16:43:20.765817 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-htctf"] Mar 16 16:43:20 crc kubenswrapper[5120]: I0316 16:43:20.787754 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-a3c5-account-create-update-ndpvq" Mar 16 16:43:20 crc kubenswrapper[5120]: I0316 16:43:20.787755 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-htctf" Mar 16 16:43:20 crc kubenswrapper[5120]: I0316 16:43:20.790657 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-htctf"] Mar 16 16:43:20 crc kubenswrapper[5120]: E0316 16:43:20.792220 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/placement-scripts: secret "placement-scripts" not found Mar 16 16:43:20 crc kubenswrapper[5120]: E0316 16:43:20.793443 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/285f9896-1a25-4942-96e7-06cff0c87338-scripts podName:285f9896-1a25-4942-96e7-06cff0c87338 nodeName:}" failed. No retries permitted until 2026-03-16 16:43:21.292616375 +0000 UTC m=+4303.446548032 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "scripts" (UniqueName: "kubernetes.io/secret/285f9896-1a25-4942-96e7-06cff0c87338-scripts") pod "placement-6d66dbd7f8-6ld6p" (UID: "285f9896-1a25-4942-96e7-06cff0c87338") : secret "placement-scripts" not found Mar 16 16:43:20 crc kubenswrapper[5120]: E0316 16:43:20.793886 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-placement-public-svc: secret "cert-placement-public-svc" not found Mar 16 16:43:20 crc kubenswrapper[5120]: E0316 16:43:20.793917 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-placement-internal-svc: secret "cert-placement-internal-svc" not found Mar 16 16:43:20 crc kubenswrapper[5120]: E0316 16:43:20.793961 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/285f9896-1a25-4942-96e7-06cff0c87338-public-tls-certs podName:285f9896-1a25-4942-96e7-06cff0c87338 nodeName:}" failed. No retries permitted until 2026-03-16 16:43:21.293940191 +0000 UTC m=+4303.447871848 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/285f9896-1a25-4942-96e7-06cff0c87338-public-tls-certs") pod "placement-6d66dbd7f8-6ld6p" (UID: "285f9896-1a25-4942-96e7-06cff0c87338") : secret "cert-placement-public-svc" not found Mar 16 16:43:20 crc kubenswrapper[5120]: E0316 16:43:20.793977 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/285f9896-1a25-4942-96e7-06cff0c87338-internal-tls-certs podName:285f9896-1a25-4942-96e7-06cff0c87338 nodeName:}" failed. No retries permitted until 2026-03-16 16:43:21.293971012 +0000 UTC m=+4303.447902669 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/285f9896-1a25-4942-96e7-06cff0c87338-internal-tls-certs") pod "placement-6d66dbd7f8-6ld6p" (UID: "285f9896-1a25-4942-96e7-06cff0c87338") : secret "cert-placement-internal-svc" not found Mar 16 16:43:20 crc kubenswrapper[5120]: E0316 16:43:20.794111 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/placement-config-data: secret "placement-config-data" not found Mar 16 16:43:20 crc kubenswrapper[5120]: E0316 16:43:20.794136 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/285f9896-1a25-4942-96e7-06cff0c87338-config-data podName:285f9896-1a25-4942-96e7-06cff0c87338 nodeName:}" failed. No retries permitted until 2026-03-16 16:43:21.294127366 +0000 UTC m=+4303.448059023 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/secret/285f9896-1a25-4942-96e7-06cff0c87338-config-data") pod "placement-6d66dbd7f8-6ld6p" (UID: "285f9896-1a25-4942-96e7-06cff0c87338") : secret "placement-config-data" not found Mar 16 16:43:20 crc kubenswrapper[5120]: E0316 16:43:20.795861 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 16:43:20 crc kubenswrapper[5120]: E0316 16:43:20.796850 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/285f9896-1a25-4942-96e7-06cff0c87338-combined-ca-bundle podName:285f9896-1a25-4942-96e7-06cff0c87338 nodeName:}" failed. No retries permitted until 2026-03-16 16:43:21.296835169 +0000 UTC m=+4303.450766836 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/285f9896-1a25-4942-96e7-06cff0c87338-combined-ca-bundle") pod "placement-6d66dbd7f8-6ld6p" (UID: "285f9896-1a25-4942-96e7-06cff0c87338") : secret "combined-ca-bundle" not found Mar 16 16:43:20 crc kubenswrapper[5120]: I0316 16:43:20.810612 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-4s92w"] Mar 16 16:43:20 crc kubenswrapper[5120]: I0316 16:43:20.817830 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-f4eb-account-create-update-4wnlc" Mar 16 16:43:20 crc kubenswrapper[5120]: I0316 16:43:20.835252 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-d38a-account-create-update-6jhs9" Mar 16 16:43:20 crc kubenswrapper[5120]: I0316 16:43:20.863644 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-4s92w"] Mar 16 16:43:20 crc kubenswrapper[5120]: I0316 16:43:20.886753 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-tfss2"] Mar 16 16:43:20 crc kubenswrapper[5120]: E0316 16:43:20.900884 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-cell1-scripts: configmap "openstack-cell1-scripts" not found Mar 16 16:43:20 crc kubenswrapper[5120]: E0316 16:43:20.900981 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/93c4c8f7-726e-4f00-b007-7411cfba1a4c-operator-scripts podName:93c4c8f7-726e-4f00-b007-7411cfba1a4c nodeName:}" failed. No retries permitted until 2026-03-16 16:43:21.400961225 +0000 UTC m=+4303.554892882 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/93c4c8f7-726e-4f00-b007-7411cfba1a4c-operator-scripts") pod "nova-cell1-d38a-account-create-update-6jhs9" (UID: "93c4c8f7-726e-4f00-b007-7411cfba1a4c") : configmap "openstack-cell1-scripts" not found Mar 16 16:43:20 crc kubenswrapper[5120]: I0316 16:43:20.899354 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/f734a4b4-4089-4b1e-9e09-3ebb426667bf-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-79dcd846c5-htctf\" (UID: \"f734a4b4-4089-4b1e-9e09-3ebb426667bf\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-htctf" Mar 16 16:43:20 crc kubenswrapper[5120]: I0316 16:43:20.902129 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f734a4b4-4089-4b1e-9e09-3ebb426667bf-config\") pod \"dnsmasq-dnsmasq-79dcd846c5-htctf\" (UID: \"f734a4b4-4089-4b1e-9e09-3ebb426667bf\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-htctf" Mar 16 16:43:20 crc kubenswrapper[5120]: I0316 16:43:20.902216 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4chw\" (UniqueName: \"kubernetes.io/projected/f734a4b4-4089-4b1e-9e09-3ebb426667bf-kube-api-access-w4chw\") pod \"dnsmasq-dnsmasq-79dcd846c5-htctf\" (UID: \"f734a4b4-4089-4b1e-9e09-3ebb426667bf\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-htctf" Mar 16 16:43:20 crc kubenswrapper[5120]: I0316 16:43:20.916655 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-tfss2"] Mar 16 16:43:20 crc kubenswrapper[5120]: I0316 16:43:20.967233 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:43:20 crc kubenswrapper[5120]: I0316 16:43:20.974012 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="ffbcbd91-454c-4998-9b12-69ed7f853328" containerName="glance-log" containerID="cri-o://100e2f81fc414c81803e72da0cb77145f68c5dcb7c9f13cb7d2de6c84a6a43f5" gracePeriod=30 Mar 16 16:43:20 crc kubenswrapper[5120]: I0316 16:43:20.974918 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="ffbcbd91-454c-4998-9b12-69ed7f853328" containerName="glance-httpd" containerID="cri-o://6639e315af61023162c1fff62d7078f952718cb1641545fd6b502793501a8f4b" gracePeriod=30 Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:20.998877 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-76647d7b7d-c7dsx"] Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:20.999109 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-76647d7b7d-c7dsx" podUID="6cef508e-ad21-4c82-ba79-4862f0e98691" containerName="neutron-api" containerID="cri-o://5fa655026894dd4d7dc9e13c705fa23e382e4cc5698aa88f2ef873831fbc3214" gracePeriod=30 Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:20.999541 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-76647d7b7d-c7dsx" podUID="6cef508e-ad21-4c82-ba79-4862f0e98691" containerName="neutron-httpd" containerID="cri-o://7d2c0bf776d2a574d61880604ebe7da62ff91dedc2f8b4c2a6103dff037b543c" gracePeriod=30 Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.005559 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/f734a4b4-4089-4b1e-9e09-3ebb426667bf-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-79dcd846c5-htctf\" (UID: \"f734a4b4-4089-4b1e-9e09-3ebb426667bf\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-htctf" Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.005654 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f734a4b4-4089-4b1e-9e09-3ebb426667bf-config\") pod \"dnsmasq-dnsmasq-79dcd846c5-htctf\" (UID: \"f734a4b4-4089-4b1e-9e09-3ebb426667bf\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-htctf" Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.005722 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w4chw\" (UniqueName: \"kubernetes.io/projected/f734a4b4-4089-4b1e-9e09-3ebb426667bf-kube-api-access-w4chw\") pod \"dnsmasq-dnsmasq-79dcd846c5-htctf\" (UID: \"f734a4b4-4089-4b1e-9e09-3ebb426667bf\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-htctf" Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.006985 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/f734a4b4-4089-4b1e-9e09-3ebb426667bf-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-79dcd846c5-htctf\" (UID: \"f734a4b4-4089-4b1e-9e09-3ebb426667bf\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-htctf" Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.007574 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f734a4b4-4089-4b1e-9e09-3ebb426667bf-config\") pod \"dnsmasq-dnsmasq-79dcd846c5-htctf\" (UID: \"f734a4b4-4089-4b1e-9e09-3ebb426667bf\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-htctf" Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.063637 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4chw\" (UniqueName: \"kubernetes.io/projected/f734a4b4-4089-4b1e-9e09-3ebb426667bf-kube-api-access-w4chw\") pod \"dnsmasq-dnsmasq-79dcd846c5-htctf\" (UID: \"f734a4b4-4089-4b1e-9e09-3ebb426667bf\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-htctf" Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.129882 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.130132 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="4c03814f-fda1-4a54-b9ca-89705d683547" containerName="cinder-scheduler" containerID="cri-o://9f2e17d1583f9443ae42dcdc1cbb9549f47015028e0072b4ca4caeed85ae311a" gracePeriod=30 Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.130559 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="4c03814f-fda1-4a54-b9ca-89705d683547" containerName="probe" containerID="cri-o://3119e5ce532c5e339071de9ff3c4fe23636cf19a24818b601368555dfb49f204" gracePeriod=30 Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.256341 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-db-create-xq46z"] Mar 16 16:43:21 crc kubenswrapper[5120]: E0316 16:43:21.338618 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/placement-config-data: secret "placement-config-data" not found Mar 16 16:43:21 crc kubenswrapper[5120]: E0316 16:43:21.338719 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/285f9896-1a25-4942-96e7-06cff0c87338-config-data podName:285f9896-1a25-4942-96e7-06cff0c87338 nodeName:}" failed. No retries permitted until 2026-03-16 16:43:22.338692826 +0000 UTC m=+4304.492624483 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/secret/285f9896-1a25-4942-96e7-06cff0c87338-config-data") pod "placement-6d66dbd7f8-6ld6p" (UID: "285f9896-1a25-4942-96e7-06cff0c87338") : secret "placement-config-data" not found Mar 16 16:43:21 crc kubenswrapper[5120]: E0316 16:43:21.339517 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 16:43:21 crc kubenswrapper[5120]: E0316 16:43:21.339668 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/285f9896-1a25-4942-96e7-06cff0c87338-combined-ca-bundle podName:285f9896-1a25-4942-96e7-06cff0c87338 nodeName:}" failed. No retries permitted until 2026-03-16 16:43:22.339647061 +0000 UTC m=+4304.493578718 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/285f9896-1a25-4942-96e7-06cff0c87338-combined-ca-bundle") pod "placement-6d66dbd7f8-6ld6p" (UID: "285f9896-1a25-4942-96e7-06cff0c87338") : secret "combined-ca-bundle" not found Mar 16 16:43:21 crc kubenswrapper[5120]: E0316 16:43:21.339786 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/placement-scripts: secret "placement-scripts" not found Mar 16 16:43:21 crc kubenswrapper[5120]: E0316 16:43:21.339733 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-placement-public-svc: secret "cert-placement-public-svc" not found Mar 16 16:43:21 crc kubenswrapper[5120]: E0316 16:43:21.339970 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-placement-internal-svc: secret "cert-placement-internal-svc" not found Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.366848 5120 generic.go:358] "Generic (PLEG): container finished" podID="7f161303-6db3-42fc-8cca-089c09eabda5" containerID="6eb2da0f9d23498832f20c9907eb27be212445bdc8591a5d329c515457fec159" exitCode=0 Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.366879 5120 generic.go:358] "Generic (PLEG): container finished" podID="7f161303-6db3-42fc-8cca-089c09eabda5" containerID="701430e9b417ed89663c5d841e28695f639a5ce24a937584b3e91e1668f567a9" exitCode=0 Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.366886 5120 generic.go:358] "Generic (PLEG): container finished" podID="7f161303-6db3-42fc-8cca-089c09eabda5" containerID="45d417324d3b1fd816cb84ece88a62414ef3cde2344cbac2b40f9cd9bb15195b" exitCode=0 Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.366898 5120 generic.go:358] "Generic (PLEG): container finished" podID="7f161303-6db3-42fc-8cca-089c09eabda5" containerID="eda7739ccb0bef92fc25f7b29815a187360fa6bc837dbfdcb2b947bbd2a51f25" exitCode=0 Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.366905 5120 generic.go:358] "Generic (PLEG): container finished" podID="7f161303-6db3-42fc-8cca-089c09eabda5" containerID="41bf99c5b4ac98ecadd81e8cdce4cfcf28dacdb72cf8eb33999efeac56f08c40" exitCode=0 Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.366911 5120 generic.go:358] "Generic (PLEG): container finished" podID="7f161303-6db3-42fc-8cca-089c09eabda5" containerID="9da44b1906810fa56c015f549e5d082a124aad433f4666dd020ee73c3746d9bd" exitCode=0 Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.366917 5120 generic.go:358] "Generic (PLEG): container finished" podID="7f161303-6db3-42fc-8cca-089c09eabda5" containerID="fc984a4dad798acc485f3583ca06562c9e78166d32047287908fccc38d13a52c" exitCode=0 Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.366924 5120 generic.go:358] "Generic (PLEG): container finished" podID="7f161303-6db3-42fc-8cca-089c09eabda5" containerID="50d21a1eb1dee64601b5ac5d957233a5b9c12af3c1f70e2ba64fc3fa232a426c" exitCode=0 Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.366930 5120 generic.go:358] "Generic (PLEG): container finished" podID="7f161303-6db3-42fc-8cca-089c09eabda5" containerID="ae6a8c449bb16b6545d66ae19692d865fa5ca0fbbd29063f0dcab3878ee4f6d9" exitCode=0 Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.366935 5120 generic.go:358] "Generic (PLEG): container finished" podID="7f161303-6db3-42fc-8cca-089c09eabda5" containerID="0dd9bc3530759ea0393d12b620c6656b9900476393827384cefdec7f3b8a3955" exitCode=0 Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.367136 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7f161303-6db3-42fc-8cca-089c09eabda5","Type":"ContainerDied","Data":"6eb2da0f9d23498832f20c9907eb27be212445bdc8591a5d329c515457fec159"} Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.367163 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7f161303-6db3-42fc-8cca-089c09eabda5","Type":"ContainerDied","Data":"701430e9b417ed89663c5d841e28695f639a5ce24a937584b3e91e1668f567a9"} Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.367173 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7f161303-6db3-42fc-8cca-089c09eabda5","Type":"ContainerDied","Data":"45d417324d3b1fd816cb84ece88a62414ef3cde2344cbac2b40f9cd9bb15195b"} Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.367183 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7f161303-6db3-42fc-8cca-089c09eabda5","Type":"ContainerDied","Data":"eda7739ccb0bef92fc25f7b29815a187360fa6bc837dbfdcb2b947bbd2a51f25"} Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.367192 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7f161303-6db3-42fc-8cca-089c09eabda5","Type":"ContainerDied","Data":"41bf99c5b4ac98ecadd81e8cdce4cfcf28dacdb72cf8eb33999efeac56f08c40"} Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.367201 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7f161303-6db3-42fc-8cca-089c09eabda5","Type":"ContainerDied","Data":"9da44b1906810fa56c015f549e5d082a124aad433f4666dd020ee73c3746d9bd"} Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.367221 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7f161303-6db3-42fc-8cca-089c09eabda5","Type":"ContainerDied","Data":"fc984a4dad798acc485f3583ca06562c9e78166d32047287908fccc38d13a52c"} Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.367230 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7f161303-6db3-42fc-8cca-089c09eabda5","Type":"ContainerDied","Data":"50d21a1eb1dee64601b5ac5d957233a5b9c12af3c1f70e2ba64fc3fa232a426c"} Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.367240 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7f161303-6db3-42fc-8cca-089c09eabda5","Type":"ContainerDied","Data":"ae6a8c449bb16b6545d66ae19692d865fa5ca0fbbd29063f0dcab3878ee4f6d9"} Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.367249 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7f161303-6db3-42fc-8cca-089c09eabda5","Type":"ContainerDied","Data":"0dd9bc3530759ea0393d12b620c6656b9900476393827384cefdec7f3b8a3955"} Mar 16 16:43:21 crc kubenswrapper[5120]: E0316 16:43:21.392456 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of d65c682ba8d5b9c2ab292d5eadb6afb5ebf5e5383178932398baa6bd606390df is running failed: container process not found" containerID="d65c682ba8d5b9c2ab292d5eadb6afb5ebf5e5383178932398baa6bd606390df" cmd=["/usr/bin/pidof","ovsdb-server"] Mar 16 16:43:21 crc kubenswrapper[5120]: E0316 16:43:21.397821 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/285f9896-1a25-4942-96e7-06cff0c87338-scripts podName:285f9896-1a25-4942-96e7-06cff0c87338 nodeName:}" failed. No retries permitted until 2026-03-16 16:43:22.39779881 +0000 UTC m=+4304.551730467 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "scripts" (UniqueName: "kubernetes.io/secret/285f9896-1a25-4942-96e7-06cff0c87338-scripts") pod "placement-6d66dbd7f8-6ld6p" (UID: "285f9896-1a25-4942-96e7-06cff0c87338") : secret "placement-scripts" not found Mar 16 16:43:21 crc kubenswrapper[5120]: E0316 16:43:21.397851 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/285f9896-1a25-4942-96e7-06cff0c87338-public-tls-certs podName:285f9896-1a25-4942-96e7-06cff0c87338 nodeName:}" failed. No retries permitted until 2026-03-16 16:43:22.397838121 +0000 UTC m=+4304.551769778 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/285f9896-1a25-4942-96e7-06cff0c87338-public-tls-certs") pod "placement-6d66dbd7f8-6ld6p" (UID: "285f9896-1a25-4942-96e7-06cff0c87338") : secret "cert-placement-public-svc" not found Mar 16 16:43:21 crc kubenswrapper[5120]: E0316 16:43:21.397863 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/285f9896-1a25-4942-96e7-06cff0c87338-internal-tls-certs podName:285f9896-1a25-4942-96e7-06cff0c87338 nodeName:}" failed. No retries permitted until 2026-03-16 16:43:22.397857871 +0000 UTC m=+4304.551789518 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/285f9896-1a25-4942-96e7-06cff0c87338-internal-tls-certs") pod "placement-6d66dbd7f8-6ld6p" (UID: "285f9896-1a25-4942-96e7-06cff0c87338") : secret "cert-placement-internal-svc" not found Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.400287 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-htctf" Mar 16 16:43:21 crc kubenswrapper[5120]: E0316 16:43:21.397227 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of d65c682ba8d5b9c2ab292d5eadb6afb5ebf5e5383178932398baa6bd606390df is running failed: container process not found" containerID="d65c682ba8d5b9c2ab292d5eadb6afb5ebf5e5383178932398baa6bd606390df" cmd=["/usr/bin/pidof","ovsdb-server"] Mar 16 16:43:21 crc kubenswrapper[5120]: E0316 16:43:21.418637 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of d65c682ba8d5b9c2ab292d5eadb6afb5ebf5e5383178932398baa6bd606390df is running failed: container process not found" containerID="d65c682ba8d5b9c2ab292d5eadb6afb5ebf5e5383178932398baa6bd606390df" cmd=["/usr/bin/pidof","ovsdb-server"] Mar 16 16:43:21 crc kubenswrapper[5120]: E0316 16:43:21.418744 5120 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of d65c682ba8d5b9c2ab292d5eadb6afb5ebf5e5383178932398baa6bd606390df is running failed: container process not found" probeType="Readiness" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podUID="9d23b8a0-3a5f-4bb9-84a7-f5602e4a98b0" containerName="ovsdbserver-nb" probeResult="unknown" Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.419197 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_9d23b8a0-3a5f-4bb9-84a7-f5602e4a98b0/ovsdbserver-nb/0.log" Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.419272 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.425105 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-db-create-xq46z"] Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.445118 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_9d23b8a0-3a5f-4bb9-84a7-f5602e4a98b0/ovsdbserver-nb/0.log" Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.445176 5120 generic.go:358] "Generic (PLEG): container finished" podID="9d23b8a0-3a5f-4bb9-84a7-f5602e4a98b0" containerID="d65c682ba8d5b9c2ab292d5eadb6afb5ebf5e5383178932398baa6bd606390df" exitCode=143 Mar 16 16:43:21 crc kubenswrapper[5120]: E0316 16:43:21.445203 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-cell1-scripts: configmap "openstack-cell1-scripts" not found Mar 16 16:43:21 crc kubenswrapper[5120]: E0316 16:43:21.445281 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/93c4c8f7-726e-4f00-b007-7411cfba1a4c-operator-scripts podName:93c4c8f7-726e-4f00-b007-7411cfba1a4c nodeName:}" failed. No retries permitted until 2026-03-16 16:43:22.445262288 +0000 UTC m=+4304.599193945 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/93c4c8f7-726e-4f00-b007-7411cfba1a4c-operator-scripts") pod "nova-cell1-d38a-account-create-update-6jhs9" (UID: "93c4c8f7-726e-4f00-b007-7411cfba1a4c") : configmap "openstack-cell1-scripts" not found Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.445375 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"9d23b8a0-3a5f-4bb9-84a7-f5602e4a98b0","Type":"ContainerDied","Data":"d65c682ba8d5b9c2ab292d5eadb6afb5ebf5e5383178932398baa6bd606390df"} Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.445416 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"9d23b8a0-3a5f-4bb9-84a7-f5602e4a98b0","Type":"ContainerDied","Data":"6e4fa18f315031b45aad276a76adebeb49f5a1524109f3acca7bfa3f68c0e00c"} Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.445447 5120 scope.go:117] "RemoveContainer" containerID="7befb30786bb8581613c702d4f626d345db7f3e118cb4ff248d66ee187c3c334" Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.464682 5120 generic.go:358] "Generic (PLEG): container finished" podID="29c96611-b802-4cfa-a407-7e3c1f341848" containerID="f6f06b9ba370a060b54ec647220d7623fff9a52a71dc33409e4d941230f65d72" exitCode=2 Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.464813 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"29c96611-b802-4cfa-a407-7e3c1f341848","Type":"ContainerDied","Data":"f6f06b9ba370a060b54ec647220d7623fff9a52a71dc33409e4d941230f65d72"} Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.471017 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_10cdd157-8ffd-4a86-9dba-ac570a45273b/ovsdbserver-sb/0.log" Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.471086 5120 generic.go:358] "Generic (PLEG): container finished" podID="10cdd157-8ffd-4a86-9dba-ac570a45273b" containerID="b5e1f012279bd50c0f6dd58081fae905fbd9dd2443094c84fcca48be455d262e" exitCode=2 Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.471100 5120 generic.go:358] "Generic (PLEG): container finished" podID="10cdd157-8ffd-4a86-9dba-ac570a45273b" containerID="91db5da9c2c16a0ddc0621d66df7fe0db6a0c98754c249f4f2ac5a8195fade13" exitCode=143 Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.471209 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"10cdd157-8ffd-4a86-9dba-ac570a45273b","Type":"ContainerDied","Data":"b5e1f012279bd50c0f6dd58081fae905fbd9dd2443094c84fcca48be455d262e"} Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.471237 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"10cdd157-8ffd-4a86-9dba-ac570a45273b","Type":"ContainerDied","Data":"91db5da9c2c16a0ddc0621d66df7fe0db6a0c98754c249f4f2ac5a8195fade13"} Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.471696 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-6d66dbd7f8-6ld6p"] Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.501086 5120 generic.go:358] "Generic (PLEG): container finished" podID="ffbcbd91-454c-4998-9b12-69ed7f853328" containerID="100e2f81fc414c81803e72da0cb77145f68c5dcb7c9f13cb7d2de6c84a6a43f5" exitCode=143 Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.501453 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-6d66dbd7f8-6ld6p" podUID="285f9896-1a25-4942-96e7-06cff0c87338" containerName="placement-log" containerID="cri-o://960b621eb32725f87cd9d272b4591b8833ab3d8756e9e76af56acecb09e4b1e4" gracePeriod=30 Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.501739 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"ffbcbd91-454c-4998-9b12-69ed7f853328","Type":"ContainerDied","Data":"100e2f81fc414c81803e72da0cb77145f68c5dcb7c9f13cb7d2de6c84a6a43f5"} Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.502036 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-6d66dbd7f8-6ld6p" podUID="285f9896-1a25-4942-96e7-06cff0c87338" containerName="placement-api" containerID="cri-o://ff35fcc66f01f4079bcdb316040d0ddf3ee4fd594afc5a2f5a31c4a635ef5041" gracePeriod=30 Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.505681 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.505941 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="be094b3e-494e-420d-b458-0e32770cd540" containerName="glance-log" containerID="cri-o://1de4d27ef85234281dc29611eaac2860bbedc2f6d3859afdac09f43a62514da8" gracePeriod=30 Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.506079 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="be094b3e-494e-420d-b458-0e32770cd540" containerName="glance-httpd" containerID="cri-o://503b90090ae8a47de41498d2d43c08c9f18dfaaa22a4ca2e49962c58dcc9ae34" gracePeriod=30 Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.518162 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.518416 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e" containerName="cinder-api-log" containerID="cri-o://66f3f06a9c5991c76392f548443ba31ee8e82819f11e5f67929aa6ee25bd68c6" gracePeriod=30 Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.518830 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e" containerName="cinder-api" containerID="cri-o://261821a3adde73a3dc23cb22faac9f49d193b2649fe06010aa01954b846e70d4" gracePeriod=30 Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.537378 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-e32b-account-create-update-xn2hk"] Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.548782 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/9d23b8a0-3a5f-4bb9-84a7-f5602e4a98b0-scripts\") pod \"9d23b8a0-3a5f-4bb9-84a7-f5602e4a98b0\" (UID: \"9d23b8a0-3a5f-4bb9-84a7-f5602e4a98b0\") " Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.548963 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/9d23b8a0-3a5f-4bb9-84a7-f5602e4a98b0-ovsdb-rundir\") pod \"9d23b8a0-3a5f-4bb9-84a7-f5602e4a98b0\" (UID: \"9d23b8a0-3a5f-4bb9-84a7-f5602e4a98b0\") " Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.549050 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/9d23b8a0-3a5f-4bb9-84a7-f5602e4a98b0-metrics-certs-tls-certs\") pod \"9d23b8a0-3a5f-4bb9-84a7-f5602e4a98b0\" (UID: \"9d23b8a0-3a5f-4bb9-84a7-f5602e4a98b0\") " Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.549133 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/9d23b8a0-3a5f-4bb9-84a7-f5602e4a98b0-ovsdbserver-nb-tls-certs\") pod \"9d23b8a0-3a5f-4bb9-84a7-f5602e4a98b0\" (UID: \"9d23b8a0-3a5f-4bb9-84a7-f5602e4a98b0\") " Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.549506 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qhvlg\" (UniqueName: \"kubernetes.io/projected/9d23b8a0-3a5f-4bb9-84a7-f5602e4a98b0-kube-api-access-qhvlg\") pod \"9d23b8a0-3a5f-4bb9-84a7-f5602e4a98b0\" (UID: \"9d23b8a0-3a5f-4bb9-84a7-f5602e4a98b0\") " Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.549589 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9d23b8a0-3a5f-4bb9-84a7-f5602e4a98b0-combined-ca-bundle\") pod \"9d23b8a0-3a5f-4bb9-84a7-f5602e4a98b0\" (UID: \"9d23b8a0-3a5f-4bb9-84a7-f5602e4a98b0\") " Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.549879 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9d23b8a0-3a5f-4bb9-84a7-f5602e4a98b0-config\") pod \"9d23b8a0-3a5f-4bb9-84a7-f5602e4a98b0\" (UID: \"9d23b8a0-3a5f-4bb9-84a7-f5602e4a98b0\") " Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.549902 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovndbcluster-nb-etc-ovn\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") pod \"9d23b8a0-3a5f-4bb9-84a7-f5602e4a98b0\" (UID: \"9d23b8a0-3a5f-4bb9-84a7-f5602e4a98b0\") " Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.550351 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d23b8a0-3a5f-4bb9-84a7-f5602e4a98b0-ovsdb-rundir" (OuterVolumeSpecName: "ovsdb-rundir") pod "9d23b8a0-3a5f-4bb9-84a7-f5602e4a98b0" (UID: "9d23b8a0-3a5f-4bb9-84a7-f5602e4a98b0"). InnerVolumeSpecName "ovsdb-rundir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.550565 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d23b8a0-3a5f-4bb9-84a7-f5602e4a98b0-scripts" (OuterVolumeSpecName: "scripts") pod "9d23b8a0-3a5f-4bb9-84a7-f5602e4a98b0" (UID: "9d23b8a0-3a5f-4bb9-84a7-f5602e4a98b0"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.551373 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d23b8a0-3a5f-4bb9-84a7-f5602e4a98b0-config" (OuterVolumeSpecName: "config") pod "9d23b8a0-3a5f-4bb9-84a7-f5602e4a98b0" (UID: "9d23b8a0-3a5f-4bb9-84a7-f5602e4a98b0"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.553569 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9d23b8a0-3a5f-4bb9-84a7-f5602e4a98b0-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.553593 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/9d23b8a0-3a5f-4bb9-84a7-f5602e4a98b0-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.553601 5120 reconciler_common.go:299] "Volume detached for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/9d23b8a0-3a5f-4bb9-84a7-f5602e4a98b0-ovsdb-rundir\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.560107 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage19-crc" (OuterVolumeSpecName: "ovndbcluster-nb-etc-ovn") pod "9d23b8a0-3a5f-4bb9-84a7-f5602e4a98b0" (UID: "9d23b8a0-3a5f-4bb9-84a7-f5602e4a98b0"). InnerVolumeSpecName "local-storage19-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.573113 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d23b8a0-3a5f-4bb9-84a7-f5602e4a98b0-kube-api-access-qhvlg" (OuterVolumeSpecName: "kube-api-access-qhvlg") pod "9d23b8a0-3a5f-4bb9-84a7-f5602e4a98b0" (UID: "9d23b8a0-3a5f-4bb9-84a7-f5602e4a98b0"). InnerVolumeSpecName "kube-api-access-qhvlg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:43:21 crc kubenswrapper[5120]: W0316 16:43:21.582643 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podad545a3f_12c8_4905_a7fe_2bc4cbfbf09e.slice/crio-b802907934b7f76c4538d4f6ee66e366ce514c23f2d63b2abce328705d7db459 WatchSource:0}: Error finding container b802907934b7f76c4538d4f6ee66e366ce514c23f2d63b2abce328705d7db459: Status 404 returned error can't find the container with id b802907934b7f76c4538d4f6ee66e366ce514c23f2d63b2abce328705d7db459 Mar 16 16:43:21 crc kubenswrapper[5120]: E0316 16:43:21.596497 5120 kuberuntime_manager.go:1358] "Unhandled Error" err=< Mar 16 16:43:21 crc kubenswrapper[5120]: container &Container{Name:mariadb-account-create-update,Image:quay.io/podified-antelope-centos9/openstack-mariadb@sha256:4caef2b55e01b9a7ee88a22bc69db1893521a91d95c7ad4c8e593f14f17a5f95,Command:[/bin/sh -c #!/bin/bash Mar 16 16:43:21 crc kubenswrapper[5120]: Mar 16 16:43:21 crc kubenswrapper[5120]: MYSQL_REMOTE_HOST="" source /var/lib/operator-scripts/mysql_root_auth.sh Mar 16 16:43:21 crc kubenswrapper[5120]: Mar 16 16:43:21 crc kubenswrapper[5120]: export DatabasePassword=${DatabasePassword:?"Please specify a DatabasePassword variable."} Mar 16 16:43:21 crc kubenswrapper[5120]: Mar 16 16:43:21 crc kubenswrapper[5120]: MYSQL_CMD="mysql -h -u root -P 3306" Mar 16 16:43:21 crc kubenswrapper[5120]: Mar 16 16:43:21 crc kubenswrapper[5120]: if [ -n "placement" ]; then Mar 16 16:43:21 crc kubenswrapper[5120]: GRANT_DATABASE="placement" Mar 16 16:43:21 crc kubenswrapper[5120]: else Mar 16 16:43:21 crc kubenswrapper[5120]: GRANT_DATABASE="*" Mar 16 16:43:21 crc kubenswrapper[5120]: fi Mar 16 16:43:21 crc kubenswrapper[5120]: Mar 16 16:43:21 crc kubenswrapper[5120]: # going for maximum compatibility here: Mar 16 16:43:21 crc kubenswrapper[5120]: # 1. MySQL 8 no longer allows implicit create user when GRANT is used Mar 16 16:43:21 crc kubenswrapper[5120]: # 2. MariaDB has "CREATE OR REPLACE", but MySQL does not Mar 16 16:43:21 crc kubenswrapper[5120]: # 3. create user with CREATE but then do all password and TLS with ALTER to Mar 16 16:43:21 crc kubenswrapper[5120]: # support updates Mar 16 16:43:21 crc kubenswrapper[5120]: Mar 16 16:43:21 crc kubenswrapper[5120]: $MYSQL_CMD < logger="UnhandledError" Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.597214 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-db-create-rl5vf"] Mar 16 16:43:21 crc kubenswrapper[5120]: E0316 16:43:21.597892 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"mariadb-account-create-update\" with CreateContainerConfigError: \"secret \\\"placement-db-secret\\\" not found\"" pod="openstack-kuttl-tests/placement-e32b-account-create-update-xn2hk" podUID="908660b0-e07b-45ab-92c8-1e466ddc0906" Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.602907 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9d23b8a0-3a5f-4bb9-84a7-f5602e4a98b0-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "9d23b8a0-3a5f-4bb9-84a7-f5602e4a98b0" (UID: "9d23b8a0-3a5f-4bb9-84a7-f5602e4a98b0"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:43:21 crc kubenswrapper[5120]: E0316 16:43:21.606110 5120 kuberuntime_manager.go:1358] "Unhandled Error" err=< Mar 16 16:43:21 crc kubenswrapper[5120]: container &Container{Name:mariadb-account-create-update,Image:quay.io/podified-antelope-centos9/openstack-mariadb@sha256:4caef2b55e01b9a7ee88a22bc69db1893521a91d95c7ad4c8e593f14f17a5f95,Command:[/bin/sh -c #!/bin/bash Mar 16 16:43:21 crc kubenswrapper[5120]: Mar 16 16:43:21 crc kubenswrapper[5120]: MYSQL_REMOTE_HOST="" source /var/lib/operator-scripts/mysql_root_auth.sh Mar 16 16:43:21 crc kubenswrapper[5120]: Mar 16 16:43:21 crc kubenswrapper[5120]: export DatabasePassword=${DatabasePassword:?"Please specify a DatabasePassword variable."} Mar 16 16:43:21 crc kubenswrapper[5120]: Mar 16 16:43:21 crc kubenswrapper[5120]: MYSQL_CMD="mysql -h -u root -P 3306" Mar 16 16:43:21 crc kubenswrapper[5120]: Mar 16 16:43:21 crc kubenswrapper[5120]: if [ -n "" ]; then Mar 16 16:43:21 crc kubenswrapper[5120]: GRANT_DATABASE="" Mar 16 16:43:21 crc kubenswrapper[5120]: else Mar 16 16:43:21 crc kubenswrapper[5120]: GRANT_DATABASE="*" Mar 16 16:43:21 crc kubenswrapper[5120]: fi Mar 16 16:43:21 crc kubenswrapper[5120]: Mar 16 16:43:21 crc kubenswrapper[5120]: # going for maximum compatibility here: Mar 16 16:43:21 crc kubenswrapper[5120]: # 1. MySQL 8 no longer allows implicit create user when GRANT is used Mar 16 16:43:21 crc kubenswrapper[5120]: # 2. MariaDB has "CREATE OR REPLACE", but MySQL does not Mar 16 16:43:21 crc kubenswrapper[5120]: # 3. create user with CREATE but then do all password and TLS with ALTER to Mar 16 16:43:21 crc kubenswrapper[5120]: # support updates Mar 16 16:43:21 crc kubenswrapper[5120]: Mar 16 16:43:21 crc kubenswrapper[5120]: $MYSQL_CMD < logger="UnhandledError" Mar 16 16:43:21 crc kubenswrapper[5120]: E0316 16:43:21.607242 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"mariadb-account-create-update\" with CreateContainerConfigError: \"secret \\\"openstack-cell1-mariadb-root-db-secret\\\" not found\"" pod="openstack-kuttl-tests/root-account-create-update-cgjmv" podUID="ad545a3f-12c8-4905-a7fe-2bc4cbfbf09e" Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.617942 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-db-create-rl5vf"] Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.640202 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-be30-account-create-update-fq9th"] Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.655454 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qhvlg\" (UniqueName: \"kubernetes.io/projected/9d23b8a0-3a5f-4bb9-84a7-f5602e4a98b0-kube-api-access-qhvlg\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.655497 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9d23b8a0-3a5f-4bb9-84a7-f5602e4a98b0-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.655531 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage19-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") on node \"crc\" " Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.658077 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-be30-account-create-update-fq9th"] Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.695379 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-8aa2-account-create-update-7rn9g"] Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.715014 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-db-create-xgxkv"] Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.718866 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9d23b8a0-3a5f-4bb9-84a7-f5602e4a98b0-ovsdbserver-nb-tls-certs" (OuterVolumeSpecName: "ovsdbserver-nb-tls-certs") pod "9d23b8a0-3a5f-4bb9-84a7-f5602e4a98b0" (UID: "9d23b8a0-3a5f-4bb9-84a7-f5602e4a98b0"). InnerVolumeSpecName "ovsdbserver-nb-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.731199 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage19-crc" (UniqueName: "kubernetes.io/local-volume/local-storage19-crc") on node "crc" Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.731247 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-proxy-85dfc87f54-wb22t"] Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.731451 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-proxy-85dfc87f54-wb22t" podUID="8b100760-cd10-47f9-a43a-5ec03d37d1f0" containerName="proxy-httpd" containerID="cri-o://edb00ca08ced509f776a6894383f6a1f894be3511cfd7b8aa96b49bebe445287" gracePeriod=30 Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.731911 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-proxy-85dfc87f54-wb22t" podUID="8b100760-cd10-47f9-a43a-5ec03d37d1f0" containerName="proxy-server" containerID="cri-o://282f23ab5ef97d358995d576d4ee6905b00545215df4cf40077d61084f39584a" gracePeriod=30 Mar 16 16:43:21 crc kubenswrapper[5120]: E0316 16:43:21.742276 5120 kuberuntime_manager.go:1358] "Unhandled Error" err=< Mar 16 16:43:21 crc kubenswrapper[5120]: container &Container{Name:mariadb-account-create-update,Image:quay.io/podified-antelope-centos9/openstack-mariadb@sha256:4caef2b55e01b9a7ee88a22bc69db1893521a91d95c7ad4c8e593f14f17a5f95,Command:[/bin/sh -c #!/bin/bash Mar 16 16:43:21 crc kubenswrapper[5120]: Mar 16 16:43:21 crc kubenswrapper[5120]: MYSQL_REMOTE_HOST="" source /var/lib/operator-scripts/mysql_root_auth.sh Mar 16 16:43:21 crc kubenswrapper[5120]: Mar 16 16:43:21 crc kubenswrapper[5120]: export DatabasePassword=${DatabasePassword:?"Please specify a DatabasePassword variable."} Mar 16 16:43:21 crc kubenswrapper[5120]: Mar 16 16:43:21 crc kubenswrapper[5120]: MYSQL_CMD="mysql -h -u root -P 3306" Mar 16 16:43:21 crc kubenswrapper[5120]: Mar 16 16:43:21 crc kubenswrapper[5120]: if [ -n "nova_api" ]; then Mar 16 16:43:21 crc kubenswrapper[5120]: GRANT_DATABASE="nova_api" Mar 16 16:43:21 crc kubenswrapper[5120]: else Mar 16 16:43:21 crc kubenswrapper[5120]: GRANT_DATABASE="*" Mar 16 16:43:21 crc kubenswrapper[5120]: fi Mar 16 16:43:21 crc kubenswrapper[5120]: Mar 16 16:43:21 crc kubenswrapper[5120]: # going for maximum compatibility here: Mar 16 16:43:21 crc kubenswrapper[5120]: # 1. MySQL 8 no longer allows implicit create user when GRANT is used Mar 16 16:43:21 crc kubenswrapper[5120]: # 2. MariaDB has "CREATE OR REPLACE", but MySQL does not Mar 16 16:43:21 crc kubenswrapper[5120]: # 3. create user with CREATE but then do all password and TLS with ALTER to Mar 16 16:43:21 crc kubenswrapper[5120]: # support updates Mar 16 16:43:21 crc kubenswrapper[5120]: Mar 16 16:43:21 crc kubenswrapper[5120]: $MYSQL_CMD < logger="UnhandledError" Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.745332 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9d23b8a0-3a5f-4bb9-84a7-f5602e4a98b0-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "9d23b8a0-3a5f-4bb9-84a7-f5602e4a98b0" (UID: "9d23b8a0-3a5f-4bb9-84a7-f5602e4a98b0"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:43:21 crc kubenswrapper[5120]: E0316 16:43:21.753351 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"mariadb-account-create-update\" with CreateContainerConfigError: \"secret \\\"nova-api-db-secret\\\" not found\"" pod="openstack-kuttl-tests/nova-api-a3c5-account-create-update-ndpvq" podUID="37490319-0529-4ab4-a97a-3dc9486aa867" Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.761849 5120 reconciler_common.go:299] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/9d23b8a0-3a5f-4bb9-84a7-f5602e4a98b0-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.761874 5120 reconciler_common.go:299] "Volume detached for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/9d23b8a0-3a5f-4bb9-84a7-f5602e4a98b0-ovsdbserver-nb-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.761885 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage19-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:21 crc kubenswrapper[5120]: E0316 16:43:21.770567 5120 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7f161303_6db3_42fc_8cca_089c09eabda5.slice/crio-conmon-393ca2c1ba80ec2d0992f37df8ef733396f1e566797d1d4d0e97ee936b2dd556.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7f161303_6db3_42fc_8cca_089c09eabda5.slice/crio-conmon-639eb84e58ef1695b15c612c5e0ef5adc5f87e7687551d830e9e1103b5d73e84.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7f161303_6db3_42fc_8cca_089c09eabda5.slice/crio-41bf99c5b4ac98ecadd81e8cdce4cfcf28dacdb72cf8eb33999efeac56f08c40.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7f161303_6db3_42fc_8cca_089c09eabda5.slice/crio-conmon-6eb2da0f9d23498832f20c9907eb27be212445bdc8591a5d329c515457fec159.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7f161303_6db3_42fc_8cca_089c09eabda5.slice/crio-conmon-832bc34866fa4463f5bace762c43ae81c0bb3c37a033c02d4a2f823022e660b8.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7f161303_6db3_42fc_8cca_089c09eabda5.slice/crio-50d21a1eb1dee64601b5ac5d957233a5b9c12af3c1f70e2ba64fc3fa232a426c.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7f161303_6db3_42fc_8cca_089c09eabda5.slice/crio-6eb2da0f9d23498832f20c9907eb27be212445bdc8591a5d329c515457fec159.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7f161303_6db3_42fc_8cca_089c09eabda5.slice/crio-832bc34866fa4463f5bace762c43ae81c0bb3c37a033c02d4a2f823022e660b8.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7f161303_6db3_42fc_8cca_089c09eabda5.slice/crio-conmon-0dd9bc3530759ea0393d12b620c6656b9900476393827384cefdec7f3b8a3955.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podffbcbd91_454c_4998_9b12_69ed7f853328.slice/crio-conmon-100e2f81fc414c81803e72da0cb77145f68c5dcb7c9f13cb7d2de6c84a6a43f5.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7f161303_6db3_42fc_8cca_089c09eabda5.slice/crio-conmon-50d21a1eb1dee64601b5ac5d957233a5b9c12af3c1f70e2ba64fc3fa232a426c.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7f161303_6db3_42fc_8cca_089c09eabda5.slice/crio-639eb84e58ef1695b15c612c5e0ef5adc5f87e7687551d830e9e1103b5d73e84.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6cef508e_ad21_4c82_ba79_4862f0e98691.slice/crio-7d2c0bf776d2a574d61880604ebe7da62ff91dedc2f8b4c2a6103dff037b543c.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7f161303_6db3_42fc_8cca_089c09eabda5.slice/crio-conmon-ae6a8c449bb16b6545d66ae19692d865fa5ca0fbbd29063f0dcab3878ee4f6d9.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7f161303_6db3_42fc_8cca_089c09eabda5.slice/crio-conmon-701430e9b417ed89663c5d841e28695f639a5ce24a937584b3e91e1668f567a9.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podffbcbd91_454c_4998_9b12_69ed7f853328.slice/crio-100e2f81fc414c81803e72da0cb77145f68c5dcb7c9f13cb7d2de6c84a6a43f5.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7f161303_6db3_42fc_8cca_089c09eabda5.slice/crio-conmon-45d417324d3b1fd816cb84ece88a62414ef3cde2344cbac2b40f9cd9bb15195b.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7f161303_6db3_42fc_8cca_089c09eabda5.slice/crio-701430e9b417ed89663c5d841e28695f639a5ce24a937584b3e91e1668f567a9.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod10cdd157_8ffd_4a86_9dba_ac570a45273b.slice/crio-91db5da9c2c16a0ddc0621d66df7fe0db6a0c98754c249f4f2ac5a8195fade13.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7f161303_6db3_42fc_8cca_089c09eabda5.slice/crio-conmon-878127ce868e772a907a2ec7f0247432f773e62eb60e0862523ea4e92c9cfb2c.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod591ce862_489c_49f7_8dbd_500414032fd9.slice/crio-9419bd0a11a06fc46b0997e1cd23e133bfc77036683ad12a18f8a766d86ab63e.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod08a8a8ac_6b7a_4a61_a88c_a98fd07aa47e.slice/crio-66f3f06a9c5991c76392f548443ba31ee8e82819f11e5f67929aa6ee25bd68c6.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7f161303_6db3_42fc_8cca_089c09eabda5.slice/crio-eda7739ccb0bef92fc25f7b29815a187360fa6bc837dbfdcb2b947bbd2a51f25.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6cef508e_ad21_4c82_ba79_4862f0e98691.slice/crio-conmon-7d2c0bf776d2a574d61880604ebe7da62ff91dedc2f8b4c2a6103dff037b543c.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7f161303_6db3_42fc_8cca_089c09eabda5.slice/crio-conmon-eda7739ccb0bef92fc25f7b29815a187360fa6bc837dbfdcb2b947bbd2a51f25.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod10cdd157_8ffd_4a86_9dba_ac570a45273b.slice/crio-conmon-91db5da9c2c16a0ddc0621d66df7fe0db6a0c98754c249f4f2ac5a8195fade13.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbe094b3e_494e_420d_b458_0e32770cd540.slice/crio-1de4d27ef85234281dc29611eaac2860bbedc2f6d3859afdac09f43a62514da8.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7f161303_6db3_42fc_8cca_089c09eabda5.slice/crio-conmon-9da44b1906810fa56c015f549e5d082a124aad433f4666dd020ee73c3746d9bd.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7f161303_6db3_42fc_8cca_089c09eabda5.slice/crio-ae6a8c449bb16b6545d66ae19692d865fa5ca0fbbd29063f0dcab3878ee4f6d9.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7f161303_6db3_42fc_8cca_089c09eabda5.slice/crio-conmon-41bf99c5b4ac98ecadd81e8cdce4cfcf28dacdb72cf8eb33999efeac56f08c40.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7f161303_6db3_42fc_8cca_089c09eabda5.slice/crio-878127ce868e772a907a2ec7f0247432f773e62eb60e0862523ea4e92c9cfb2c.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod285f9896_1a25_4942_96e7_06cff0c87338.slice/crio-conmon-960b621eb32725f87cd9d272b4591b8833ab3d8756e9e76af56acecb09e4b1e4.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7f161303_6db3_42fc_8cca_089c09eabda5.slice/crio-45d417324d3b1fd816cb84ece88a62414ef3cde2344cbac2b40f9cd9bb15195b.scope\": RecentStats: unable to find data in memory cache]" Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.798188 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-db-create-xgxkv"] Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.806274 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_10cdd157-8ffd-4a86-9dba-ac570a45273b/ovsdbserver-sb/0.log" Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.806347 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.812691 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-8aa2-account-create-update-7rn9g"] Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.822321 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.834594 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.837005 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="e9e86e40-d30c-4208-852b-5d6737ba05ce" containerName="nova-metadata-log" containerID="cri-o://9ea9db94f867aa536c9a5bdcc6cf83c48c8a9bcef57187ed927a4383f38d4b5b" gracePeriod=30 Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.837251 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="e9e86e40-d30c-4208-852b-5d6737ba05ce" containerName="nova-metadata-metadata" containerID="cri-o://90f7776ae4d6e0446a5d45a429255d7b79feb97a72344584de1b162bd35dd26e" gracePeriod=30 Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.853045 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-db-create-52jsz"] Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.865289 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.865536 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="935a7850-d7f8-438f-a787-6a78e33db090" containerName="nova-api-log" containerID="cri-o://d7dd32e7de0c2fd93e29bcaac1474b1c8ebaed9d509efbae0d367991ba1a58da" gracePeriod=30 Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.866036 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-cgjmv"] Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.866053 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="935a7850-d7f8-438f-a787-6a78e33db090" containerName="nova-api-api" containerID="cri-o://d778c8d3201f505aa08f8b8a1774d98fe321c408ea4394e5597de23b72abb24d" gracePeriod=30 Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.878257 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-db-create-52jsz"] Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.888141 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-87f5-account-create-update-76mr4"] Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.895176 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-e32b-account-create-update-xn2hk"] Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.921550 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-87f5-account-create-update-76mr4"] Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.973254 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/10cdd157-8ffd-4a86-9dba-ac570a45273b-metrics-certs-tls-certs\") pod \"10cdd157-8ffd-4a86-9dba-ac570a45273b\" (UID: \"10cdd157-8ffd-4a86-9dba-ac570a45273b\") " Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.973443 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/10cdd157-8ffd-4a86-9dba-ac570a45273b-ovsdbserver-sb-tls-certs\") pod \"10cdd157-8ffd-4a86-9dba-ac570a45273b\" (UID: \"10cdd157-8ffd-4a86-9dba-ac570a45273b\") " Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.973597 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/10cdd157-8ffd-4a86-9dba-ac570a45273b-ovsdb-rundir\") pod \"10cdd157-8ffd-4a86-9dba-ac570a45273b\" (UID: \"10cdd157-8ffd-4a86-9dba-ac570a45273b\") " Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.973723 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovndbcluster-sb-etc-ovn\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"10cdd157-8ffd-4a86-9dba-ac570a45273b\" (UID: \"10cdd157-8ffd-4a86-9dba-ac570a45273b\") " Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.973898 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nl8pw\" (UniqueName: \"kubernetes.io/projected/10cdd157-8ffd-4a86-9dba-ac570a45273b-kube-api-access-nl8pw\") pod \"10cdd157-8ffd-4a86-9dba-ac570a45273b\" (UID: \"10cdd157-8ffd-4a86-9dba-ac570a45273b\") " Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.974127 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/10cdd157-8ffd-4a86-9dba-ac570a45273b-config\") pod \"10cdd157-8ffd-4a86-9dba-ac570a45273b\" (UID: \"10cdd157-8ffd-4a86-9dba-ac570a45273b\") " Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.974469 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/10cdd157-8ffd-4a86-9dba-ac570a45273b-scripts\") pod \"10cdd157-8ffd-4a86-9dba-ac570a45273b\" (UID: \"10cdd157-8ffd-4a86-9dba-ac570a45273b\") " Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.974560 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/10cdd157-8ffd-4a86-9dba-ac570a45273b-combined-ca-bundle\") pod \"10cdd157-8ffd-4a86-9dba-ac570a45273b\" (UID: \"10cdd157-8ffd-4a86-9dba-ac570a45273b\") " Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.978378 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/10cdd157-8ffd-4a86-9dba-ac570a45273b-config" (OuterVolumeSpecName: "config") pod "10cdd157-8ffd-4a86-9dba-ac570a45273b" (UID: "10cdd157-8ffd-4a86-9dba-ac570a45273b"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.983524 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10cdd157-8ffd-4a86-9dba-ac570a45273b-kube-api-access-nl8pw" (OuterVolumeSpecName: "kube-api-access-nl8pw") pod "10cdd157-8ffd-4a86-9dba-ac570a45273b" (UID: "10cdd157-8ffd-4a86-9dba-ac570a45273b"). InnerVolumeSpecName "kube-api-access-nl8pw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.984468 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10cdd157-8ffd-4a86-9dba-ac570a45273b-ovsdb-rundir" (OuterVolumeSpecName: "ovsdb-rundir") pod "10cdd157-8ffd-4a86-9dba-ac570a45273b" (UID: "10cdd157-8ffd-4a86-9dba-ac570a45273b"). InnerVolumeSpecName "ovsdb-rundir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.984519 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-nn2pp"] Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.989627 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/10cdd157-8ffd-4a86-9dba-ac570a45273b-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.989663 5120 reconciler_common.go:299] "Volume detached for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/10cdd157-8ffd-4a86-9dba-ac570a45273b-ovsdb-rundir\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:21 crc kubenswrapper[5120]: I0316 16:43:21.989676 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nl8pw\" (UniqueName: \"kubernetes.io/projected/10cdd157-8ffd-4a86-9dba-ac570a45273b-kube-api-access-nl8pw\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.007091 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/10cdd157-8ffd-4a86-9dba-ac570a45273b-scripts" (OuterVolumeSpecName: "scripts") pod "10cdd157-8ffd-4a86-9dba-ac570a45273b" (UID: "10cdd157-8ffd-4a86-9dba-ac570a45273b"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.013089 5120 patch_prober.go:28] interesting pod/machine-config-daemon-7bf76 container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.013143 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.013182 5120 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.013822 5120 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="machine-config-daemon" containerStatusID={"Type":"cri-o","ID":"35a7dd6e19084cee69ca16203bca6378ea0cdf6a685ca2093ab847e5904eb9e6"} pod="openshift-machine-config-operator/machine-config-daemon-7bf76" containerMessage="Container machine-config-daemon failed liveness probe, will be restarted" Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.013867 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" containerID="cri-o://35a7dd6e19084cee69ca16203bca6378ea0cdf6a685ca2093ab847e5904eb9e6" gracePeriod=600 Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.033997 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage12-crc" (OuterVolumeSpecName: "ovndbcluster-sb-etc-ovn") pod "10cdd157-8ffd-4a86-9dba-ac570a45273b" (UID: "10cdd157-8ffd-4a86-9dba-ac570a45273b"). InnerVolumeSpecName "local-storage12-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.054400 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-db-create-7ztbs"] Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.102516 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") on node \"crc\" " Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.102551 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/10cdd157-8ffd-4a86-9dba-ac570a45273b-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.113735 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-db-create-7ztbs"] Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.122218 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage12-crc" (UniqueName: "kubernetes.io/local-volume/local-storage12-crc") on node "crc" Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.137014 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-nn2pp"] Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.151444 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-qwzzm"] Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.151779 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/10cdd157-8ffd-4a86-9dba-ac570a45273b-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "10cdd157-8ffd-4a86-9dba-ac570a45273b" (UID: "10cdd157-8ffd-4a86-9dba-ac570a45273b"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.171825 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-f4eb-account-create-update-4wnlc"] Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.189680 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/10cdd157-8ffd-4a86-9dba-ac570a45273b-ovsdbserver-sb-tls-certs" (OuterVolumeSpecName: "ovsdbserver-sb-tls-certs") pod "10cdd157-8ffd-4a86-9dba-ac570a45273b" (UID: "10cdd157-8ffd-4a86-9dba-ac570a45273b"). InnerVolumeSpecName "ovsdbserver-sb-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.218730 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/10cdd157-8ffd-4a86-9dba-ac570a45273b-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "10cdd157-8ffd-4a86-9dba-ac570a45273b" (UID: "10cdd157-8ffd-4a86-9dba-ac570a45273b"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.219006 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-d38a-account-create-update-6jhs9"] Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.223592 5120 reconciler_common.go:299] "Volume detached for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/10cdd157-8ffd-4a86-9dba-ac570a45273b-ovsdbserver-sb-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.223641 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.223653 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/10cdd157-8ffd-4a86-9dba-ac570a45273b-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.230980 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-qwzzm"] Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.240205 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-pjkj4"] Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.248407 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-pjkj4"] Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.256308 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-a3c5-account-create-update-ndpvq"] Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.265840 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-6647785db4-lmftm"] Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.266144 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-6647785db4-lmftm" podUID="1518bfb1-3665-455c-84df-7c6eba7b93cf" containerName="barbican-api-log" containerID="cri-o://d33f8e22773224907ed12c1e59701d7399b4bdc1d2d9ae0cdce97abf4ee82542" gracePeriod=30 Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.266596 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-6647785db4-lmftm" podUID="1518bfb1-3665-455c-84df-7c6eba7b93cf" containerName="barbican-api" containerID="cri-o://a36426906a84d8ea72c76bb969e2d2ccd78889b5a575462d932c61eff0792b6b" gracePeriod=30 Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.284179 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/openstack-cell1-galera-0" podUID="45e134ad-472e-4c91-8c2e-08a8b698847e" containerName="galera" containerID="cri-o://f2177105ac4d9674a3c981a2ee15da79c7b65aa682d513987168644107f465a1" gracePeriod=30 Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.285608 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-765d49ff54-tqw2c"] Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.318862 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-c56d9997c-vh2kg"] Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.319131 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-c56d9997c-vh2kg" podUID="3c2042b3-62bc-476f-b032-91e9f77da74a" containerName="barbican-worker-log" containerID="cri-o://8758aab696f8e16a21039b2ad2fa60ce136ffc8c8ef68d51ec645a3466e74a97" gracePeriod=30 Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.319342 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-765d49ff54-tqw2c" podUID="4a708d1c-43d9-400d-a30e-49891c1fc39d" containerName="barbican-keystone-listener-log" containerID="cri-o://e250e191466949db84d88142ed546c60f83649e54cf2f42de0deda2997829841" gracePeriod=30 Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.319861 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-765d49ff54-tqw2c" podUID="4a708d1c-43d9-400d-a30e-49891c1fc39d" containerName="barbican-keystone-listener" containerID="cri-o://fd6cc5b58b834ed8099c46e4fff55a73b512c1ee55040e9d9dc4c8fc1f7a5b90" gracePeriod=30 Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.320081 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-c56d9997c-vh2kg" podUID="3c2042b3-62bc-476f-b032-91e9f77da74a" containerName="barbican-worker" containerID="cri-o://949e4f70bb7999ef9b809a2b382188ebf770f0042c3c7a32632aa1a421a1c410" gracePeriod=30 Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.328320 5120 reconciler_common.go:299] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/10cdd157-8ffd-4a86-9dba-ac570a45273b-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.342492 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-cgjmv"] Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.346485 5120 scope.go:117] "RemoveContainer" containerID="d65c682ba8d5b9c2ab292d5eadb6afb5ebf5e5383178932398baa6bd606390df" Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.361551 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.362002 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podUID="e8e5a741-9d1e-496c-85e7-3f2966cf0e68" containerName="nova-cell1-novncproxy-novncproxy" containerID="cri-o://2f0e2ea2afbd1d991add597e9e7e1845007742c0328e4bd20ed56b6b54be47ee" gracePeriod=30 Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.371065 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-dc4rn"] Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.381041 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-dc4rn"] Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.389057 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.389377 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="a7128a81-4e4e-4635-b66c-f992c4b30d2a" containerName="nova-cell1-conductor-conductor" containerID="cri-o://39b19d47df4280da111038dcf617135fe59f13c47f76f5f5da32391a2bd60988" gracePeriod=30 Mar 16 16:43:22 crc kubenswrapper[5120]: E0316 16:43:22.395936 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.419392 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.420726 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-2dbbn"] Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.448505 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-2dbbn"] Mar 16 16:43:22 crc kubenswrapper[5120]: E0316 16:43:22.459322 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-placement-internal-svc: secret "cert-placement-internal-svc" not found Mar 16 16:43:22 crc kubenswrapper[5120]: E0316 16:43:22.459402 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/285f9896-1a25-4942-96e7-06cff0c87338-internal-tls-certs podName:285f9896-1a25-4942-96e7-06cff0c87338 nodeName:}" failed. No retries permitted until 2026-03-16 16:43:24.459382461 +0000 UTC m=+4306.613314118 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/285f9896-1a25-4942-96e7-06cff0c87338-internal-tls-certs") pod "placement-6d66dbd7f8-6ld6p" (UID: "285f9896-1a25-4942-96e7-06cff0c87338") : secret "cert-placement-internal-svc" not found Mar 16 16:43:22 crc kubenswrapper[5120]: E0316 16:43:22.462046 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/placement-config-data: secret "placement-config-data" not found Mar 16 16:43:22 crc kubenswrapper[5120]: E0316 16:43:22.462130 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/285f9896-1a25-4942-96e7-06cff0c87338-config-data podName:285f9896-1a25-4942-96e7-06cff0c87338 nodeName:}" failed. No retries permitted until 2026-03-16 16:43:24.462111145 +0000 UTC m=+4306.616042802 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/secret/285f9896-1a25-4942-96e7-06cff0c87338-config-data") pod "placement-6d66dbd7f8-6ld6p" (UID: "285f9896-1a25-4942-96e7-06cff0c87338") : secret "placement-config-data" not found Mar 16 16:43:22 crc kubenswrapper[5120]: E0316 16:43:22.462172 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-placement-public-svc: secret "cert-placement-public-svc" not found Mar 16 16:43:22 crc kubenswrapper[5120]: E0316 16:43:22.462196 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/285f9896-1a25-4942-96e7-06cff0c87338-public-tls-certs podName:285f9896-1a25-4942-96e7-06cff0c87338 nodeName:}" failed. No retries permitted until 2026-03-16 16:43:24.462189827 +0000 UTC m=+4306.616121484 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/285f9896-1a25-4942-96e7-06cff0c87338-public-tls-certs") pod "placement-6d66dbd7f8-6ld6p" (UID: "285f9896-1a25-4942-96e7-06cff0c87338") : secret "cert-placement-public-svc" not found Mar 16 16:43:22 crc kubenswrapper[5120]: E0316 16:43:22.463853 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 16:43:22 crc kubenswrapper[5120]: E0316 16:43:22.463935 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/285f9896-1a25-4942-96e7-06cff0c87338-combined-ca-bundle podName:285f9896-1a25-4942-96e7-06cff0c87338 nodeName:}" failed. No retries permitted until 2026-03-16 16:43:24.463914664 +0000 UTC m=+4306.617846321 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/285f9896-1a25-4942-96e7-06cff0c87338-combined-ca-bundle") pod "placement-6d66dbd7f8-6ld6p" (UID: "285f9896-1a25-4942-96e7-06cff0c87338") : secret "combined-ca-bundle" not found Mar 16 16:43:22 crc kubenswrapper[5120]: E0316 16:43:22.466339 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-cell1-scripts: configmap "openstack-cell1-scripts" not found Mar 16 16:43:22 crc kubenswrapper[5120]: E0316 16:43:22.466407 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/93c4c8f7-726e-4f00-b007-7411cfba1a4c-operator-scripts podName:93c4c8f7-726e-4f00-b007-7411cfba1a4c nodeName:}" failed. No retries permitted until 2026-03-16 16:43:24.466391972 +0000 UTC m=+4306.620323629 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/93c4c8f7-726e-4f00-b007-7411cfba1a4c-operator-scripts") pod "nova-cell1-d38a-account-create-update-6jhs9" (UID: "93c4c8f7-726e-4f00-b007-7411cfba1a4c") : configmap "openstack-cell1-scripts" not found Mar 16 16:43:22 crc kubenswrapper[5120]: E0316 16:43:22.467916 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/placement-scripts: secret "placement-scripts" not found Mar 16 16:43:22 crc kubenswrapper[5120]: E0316 16:43:22.467962 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/285f9896-1a25-4942-96e7-06cff0c87338-scripts podName:285f9896-1a25-4942-96e7-06cff0c87338 nodeName:}" failed. No retries permitted until 2026-03-16 16:43:24.467951874 +0000 UTC m=+4306.621883531 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "scripts" (UniqueName: "kubernetes.io/secret/285f9896-1a25-4942-96e7-06cff0c87338-scripts") pod "placement-6d66dbd7f8-6ld6p" (UID: "285f9896-1a25-4942-96e7-06cff0c87338") : secret "placement-scripts" not found Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.486255 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.486496 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="93b8115e-671f-4dff-96ec-a78e9ad5b022" containerName="nova-scheduler-scheduler" containerID="cri-o://3d14626b44ab5c3bc55202348681585545fb5d1a830cebe64d74628a5af82166" gracePeriod=30 Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.508690 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.508965 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="636be6fd-cf1a-4f31-aa2b-6be52788333d" containerName="nova-cell0-conductor-conductor" containerID="cri-o://10a7e33721d5da23369bc4422d4cbb9b2fa2d5c64f2fff4f94c6d681301c74ff" gracePeriod=30 Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.533087 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-a3c5-account-create-update-ndpvq"] Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.558218 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-f4eb-account-create-update-4wnlc"] Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.564335 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/swift-proxy-85dfc87f54-wb22t" podUID="8b100760-cd10-47f9-a43a-5ec03d37d1f0" containerName="proxy-httpd" probeResult="failure" output="Get \"https://10.217.1.71:8080/healthcheck\": dial tcp 10.217.1.71:8080: connect: connection refused" Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.568579 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f4kwn\" (UniqueName: \"kubernetes.io/projected/591ce862-489c-49f7-8dbd-500414032fd9-kube-api-access-f4kwn\") pod \"591ce862-489c-49f7-8dbd-500414032fd9\" (UID: \"591ce862-489c-49f7-8dbd-500414032fd9\") " Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.568638 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/591ce862-489c-49f7-8dbd-500414032fd9-combined-ca-bundle\") pod \"591ce862-489c-49f7-8dbd-500414032fd9\" (UID: \"591ce862-489c-49f7-8dbd-500414032fd9\") " Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.568836 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/591ce862-489c-49f7-8dbd-500414032fd9-openstack-config\") pod \"591ce862-489c-49f7-8dbd-500414032fd9\" (UID: \"591ce862-489c-49f7-8dbd-500414032fd9\") " Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.569077 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/591ce862-489c-49f7-8dbd-500414032fd9-openstack-config-secret\") pod \"591ce862-489c-49f7-8dbd-500414032fd9\" (UID: \"591ce862-489c-49f7-8dbd-500414032fd9\") " Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.575732 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/swift-proxy-85dfc87f54-wb22t" podUID="8b100760-cd10-47f9-a43a-5ec03d37d1f0" containerName="proxy-server" probeResult="failure" output="Get \"https://10.217.1.71:8080/healthcheck\": dial tcp 10.217.1.71:8080: connect: connection refused" Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.601344 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.601690 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="208d2d80-c39f-4984-bd83-13868306b946" containerName="ceilometer-central-agent" containerID="cri-o://c58ce299fe1cdb3dcbe143284d5e0efe2c90efc37550b5f03322b2bea2cf9a71" gracePeriod=30 Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.602164 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="208d2d80-c39f-4984-bd83-13868306b946" containerName="proxy-httpd" containerID="cri-o://73cb5da1aa4e0db6fc05d7ab18a073503756b66a6de287a0621f708490718f69" gracePeriod=30 Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.602214 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="208d2d80-c39f-4984-bd83-13868306b946" containerName="sg-core" containerID="cri-o://10e209dfe1f9708e3d21b9b100a91d59bd982ee2a4aa40b2c08c2b1ccd44b1c0" gracePeriod=30 Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.602345 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="208d2d80-c39f-4984-bd83-13868306b946" containerName="ceilometer-notification-agent" containerID="cri-o://c58db8625c8fa139b58596a9b64d009fd72fbf9ea6ce1858fb7fd48fe833e794" gracePeriod=30 Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.618454 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/591ce862-489c-49f7-8dbd-500414032fd9-kube-api-access-f4kwn" (OuterVolumeSpecName: "kube-api-access-f4kwn") pod "591ce862-489c-49f7-8dbd-500414032fd9" (UID: "591ce862-489c-49f7-8dbd-500414032fd9"). InnerVolumeSpecName "kube-api-access-f4kwn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.621269 5120 generic.go:358] "Generic (PLEG): container finished" podID="7f161303-6db3-42fc-8cca-089c09eabda5" containerID="832bc34866fa4463f5bace762c43ae81c0bb3c37a033c02d4a2f823022e660b8" exitCode=0 Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.621297 5120 generic.go:358] "Generic (PLEG): container finished" podID="7f161303-6db3-42fc-8cca-089c09eabda5" containerID="878127ce868e772a907a2ec7f0247432f773e62eb60e0862523ea4e92c9cfb2c" exitCode=0 Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.621304 5120 generic.go:358] "Generic (PLEG): container finished" podID="7f161303-6db3-42fc-8cca-089c09eabda5" containerID="639eb84e58ef1695b15c612c5e0ef5adc5f87e7687551d830e9e1103b5d73e84" exitCode=0 Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.621310 5120 generic.go:358] "Generic (PLEG): container finished" podID="7f161303-6db3-42fc-8cca-089c09eabda5" containerID="393ca2c1ba80ec2d0992f37df8ef733396f1e566797d1d4d0e97ee936b2dd556" exitCode=0 Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.621374 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7f161303-6db3-42fc-8cca-089c09eabda5","Type":"ContainerDied","Data":"832bc34866fa4463f5bace762c43ae81c0bb3c37a033c02d4a2f823022e660b8"} Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.621400 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7f161303-6db3-42fc-8cca-089c09eabda5","Type":"ContainerDied","Data":"878127ce868e772a907a2ec7f0247432f773e62eb60e0862523ea4e92c9cfb2c"} Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.621409 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7f161303-6db3-42fc-8cca-089c09eabda5","Type":"ContainerDied","Data":"639eb84e58ef1695b15c612c5e0ef5adc5f87e7687551d830e9e1103b5d73e84"} Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.621417 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7f161303-6db3-42fc-8cca-089c09eabda5","Type":"ContainerDied","Data":"393ca2c1ba80ec2d0992f37df8ef733396f1e566797d1d4d0e97ee936b2dd556"} Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.625575 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.625821 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/kube-state-metrics-0" podUID="c0f2211e-5c26-4865-b7dd-8799e5229862" containerName="kube-state-metrics" containerID="cri-o://6d480457ad64d0c74019dff9f3a62a4f5e3a431f4e1b0160808649591b0d97b9" gracePeriod=30 Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.635314 5120 generic.go:358] "Generic (PLEG): container finished" podID="08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e" containerID="66f3f06a9c5991c76392f548443ba31ee8e82819f11e5f67929aa6ee25bd68c6" exitCode=143 Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.635461 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e","Type":"ContainerDied","Data":"66f3f06a9c5991c76392f548443ba31ee8e82819f11e5f67929aa6ee25bd68c6"} Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.647336 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/591ce862-489c-49f7-8dbd-500414032fd9-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "591ce862-489c-49f7-8dbd-500414032fd9" (UID: "591ce862-489c-49f7-8dbd-500414032fd9"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.652369 5120 generic.go:358] "Generic (PLEG): container finished" podID="591ce862-489c-49f7-8dbd-500414032fd9" containerID="9419bd0a11a06fc46b0997e1cd23e133bfc77036683ad12a18f8a766d86ab63e" exitCode=137 Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.652525 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.653428 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-d38a-account-create-update-6jhs9"] Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.655098 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-e32b-account-create-update-xn2hk" event={"ID":"908660b0-e07b-45ab-92c8-1e466ddc0906","Type":"ContainerStarted","Data":"21635e924967b6837eae4dee171b1c59159bd0113b4099d817f9f49e62f9dfd1"} Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.659161 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-a3c5-account-create-update-ndpvq" event={"ID":"37490319-0529-4ab4-a97a-3dc9486aa867","Type":"ContainerStarted","Data":"73b95aacc0fb94af36e4a8f4ed741b9010f26cffd0848f09630fbe55ae89862f"} Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.662298 5120 generic.go:358] "Generic (PLEG): container finished" podID="6cef508e-ad21-4c82-ba79-4862f0e98691" containerID="7d2c0bf776d2a574d61880604ebe7da62ff91dedc2f8b4c2a6103dff037b543c" exitCode=0 Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.662362 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-76647d7b7d-c7dsx" event={"ID":"6cef508e-ad21-4c82-ba79-4862f0e98691","Type":"ContainerDied","Data":"7d2c0bf776d2a574d61880604ebe7da62ff91dedc2f8b4c2a6103dff037b543c"} Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.681965 5120 generic.go:358] "Generic (PLEG): container finished" podID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerID="35a7dd6e19084cee69ca16203bca6378ea0cdf6a685ca2093ab847e5904eb9e6" exitCode=0 Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.684246 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/591ce862-489c-49f7-8dbd-500414032fd9-openstack-config" (OuterVolumeSpecName: "openstack-config") pod "591ce862-489c-49f7-8dbd-500414032fd9" (UID: "591ce862-489c-49f7-8dbd-500414032fd9"). InnerVolumeSpecName "openstack-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.684806 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f4kwn\" (UniqueName: \"kubernetes.io/projected/591ce862-489c-49f7-8dbd-500414032fd9-kube-api-access-f4kwn\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.684827 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/591ce862-489c-49f7-8dbd-500414032fd9-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.687409 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.693332 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/591ce862-489c-49f7-8dbd-500414032fd9-openstack-config-secret" (OuterVolumeSpecName: "openstack-config-secret") pod "591ce862-489c-49f7-8dbd-500414032fd9" (UID: "591ce862-489c-49f7-8dbd-500414032fd9"). InnerVolumeSpecName "openstack-config-secret". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.695521 5120 generic.go:358] "Generic (PLEG): container finished" podID="4a708d1c-43d9-400d-a30e-49891c1fc39d" containerID="e250e191466949db84d88142ed546c60f83649e54cf2f42de0deda2997829841" exitCode=143 Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.705677 5120 generic.go:358] "Generic (PLEG): container finished" podID="1518bfb1-3665-455c-84df-7c6eba7b93cf" containerID="d33f8e22773224907ed12c1e59701d7399b4bdc1d2d9ae0cdce97abf4ee82542" exitCode=143 Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.718099 5120 generic.go:358] "Generic (PLEG): container finished" podID="3c2042b3-62bc-476f-b032-91e9f77da74a" containerID="8758aab696f8e16a21039b2ad2fa60ce136ffc8c8ef68d51ec645a3466e74a97" exitCode=143 Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.721696 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="020c675a-4f3f-44d2-9094-31d85ee582e6" path="/var/lib/kubelet/pods/020c675a-4f3f-44d2-9094-31d85ee582e6/volumes" Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.722371 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0bdcb33b-f908-4545-91d5-caebf2853b00" path="/var/lib/kubelet/pods/0bdcb33b-f908-4545-91d5-caebf2853b00/volumes" Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.723303 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="26f0b4d3-a9a4-495b-a656-87bb6e9e77af" path="/var/lib/kubelet/pods/26f0b4d3-a9a4-495b-a656-87bb6e9e77af/volumes" Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.724798 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3e7508b2-729a-4b53-a597-99cbabc7243a" path="/var/lib/kubelet/pods/3e7508b2-729a-4b53-a597-99cbabc7243a/volumes" Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.725406 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="52537c6c-c75e-4d04-8cb0-40e7ed0e33d9" path="/var/lib/kubelet/pods/52537c6c-c75e-4d04-8cb0-40e7ed0e33d9/volumes" Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.727208 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="591ce862-489c-49f7-8dbd-500414032fd9" path="/var/lib/kubelet/pods/591ce862-489c-49f7-8dbd-500414032fd9/volumes" Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.727888 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="614326a5-97a1-4126-bdaf-f6d6e5e9631f" path="/var/lib/kubelet/pods/614326a5-97a1-4126-bdaf-f6d6e5e9631f/volumes" Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.730474 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="62168229-1b96-48fa-aaac-639639d37e7f" path="/var/lib/kubelet/pods/62168229-1b96-48fa-aaac-639639d37e7f/volumes" Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.730820 5120 generic.go:358] "Generic (PLEG): container finished" podID="8b100760-cd10-47f9-a43a-5ec03d37d1f0" containerID="282f23ab5ef97d358995d576d4ee6905b00545215df4cf40077d61084f39584a" exitCode=0 Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.730852 5120 generic.go:358] "Generic (PLEG): container finished" podID="8b100760-cd10-47f9-a43a-5ec03d37d1f0" containerID="edb00ca08ced509f776a6894383f6a1f894be3511cfd7b8aa96b49bebe445287" exitCode=0 Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.731143 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6d750838-2144-4d02-9e1f-a3a3f0a3ba9d" path="/var/lib/kubelet/pods/6d750838-2144-4d02-9e1f-a3a3f0a3ba9d/volumes" Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.731683 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9aa6ed1b-b014-4ff6-97aa-387eceb58d13" path="/var/lib/kubelet/pods/9aa6ed1b-b014-4ff6-97aa-387eceb58d13/volumes" Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.735639 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ba55b11-2c75-4cfa-9cfc-be73cefc163c" path="/var/lib/kubelet/pods/9ba55b11-2c75-4cfa-9cfc-be73cefc163c/volumes" Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.736216 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ad9c5c4c-36fb-402b-a4dd-b628ba4b002d" path="/var/lib/kubelet/pods/ad9c5c4c-36fb-402b-a4dd-b628ba4b002d/volumes" Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.736446 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_10cdd157-8ffd-4a86-9dba-ac570a45273b/ovsdbserver-sb/0.log" Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.736645 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.737030 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bac9c78c-8043-4f94-9c2e-6bbbcac4d701" path="/var/lib/kubelet/pods/bac9c78c-8043-4f94-9c2e-6bbbcac4d701/volumes" Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.738048 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c231058d-1e1b-4d40-bd38-09673df33add" path="/var/lib/kubelet/pods/c231058d-1e1b-4d40-bd38-09673df33add/volumes" Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.739005 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cffcdd38-4c41-4e0b-9198-0b8ebea0302e" path="/var/lib/kubelet/pods/cffcdd38-4c41-4e0b-9198-0b8ebea0302e/volumes" Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.739529 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f57fccaf-9698-44a5-8d74-f65beb76b3d5" path="/var/lib/kubelet/pods/f57fccaf-9698-44a5-8d74-f65beb76b3d5/volumes" Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.740364 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fa5c2ff2-6f51-49e1-bb96-be06788737c6" path="/var/lib/kubelet/pods/fa5c2ff2-6f51-49e1-bb96-be06788737c6/volumes" Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.740807 5120 kubelet_pods.go:1019] "Unable to retrieve pull secret, the image pull may not succeed." pod="openstack-kuttl-tests/root-account-create-update-cgjmv" secret="" err="secret \"galera-openstack-cell1-dockercfg-cd9ff\" not found" Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.741950 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.741976 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" event={"ID":"e2275cb4-4905-4d66-a87e-8010120db2bd","Type":"ContainerDied","Data":"35a7dd6e19084cee69ca16203bca6378ea0cdf6a685ca2093ab847e5904eb9e6"} Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.741997 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-765d49ff54-tqw2c" event={"ID":"4a708d1c-43d9-400d-a30e-49891c1fc39d","Type":"ContainerDied","Data":"e250e191466949db84d88142ed546c60f83649e54cf2f42de0deda2997829841"} Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.742010 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-6647785db4-lmftm" event={"ID":"1518bfb1-3665-455c-84df-7c6eba7b93cf","Type":"ContainerDied","Data":"d33f8e22773224907ed12c1e59701d7399b4bdc1d2d9ae0cdce97abf4ee82542"} Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.742022 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-f4eb-account-create-update-4wnlc" event={"ID":"69586194-14da-4bd2-ab2d-5b464625a1a5","Type":"ContainerStarted","Data":"ad214f332fdaa6a66baa3d6a86a9877488cfb968d038c63ccc3a6caf99279dee"} Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.742032 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-c56d9997c-vh2kg" event={"ID":"3c2042b3-62bc-476f-b032-91e9f77da74a","Type":"ContainerDied","Data":"8758aab696f8e16a21039b2ad2fa60ce136ffc8c8ef68d51ec645a3466e74a97"} Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.742043 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-85dfc87f54-wb22t" event={"ID":"8b100760-cd10-47f9-a43a-5ec03d37d1f0","Type":"ContainerDied","Data":"282f23ab5ef97d358995d576d4ee6905b00545215df4cf40077d61084f39584a"} Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.742053 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-85dfc87f54-wb22t" event={"ID":"8b100760-cd10-47f9-a43a-5ec03d37d1f0","Type":"ContainerDied","Data":"edb00ca08ced509f776a6894383f6a1f894be3511cfd7b8aa96b49bebe445287"} Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.742061 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"10cdd157-8ffd-4a86-9dba-ac570a45273b","Type":"ContainerDied","Data":"9539eacb6b208c3019aabeddb13fe94c6276ddf94e89e18504dd592ca8144f3f"} Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.742072 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-cgjmv" event={"ID":"ad545a3f-12c8-4905-a7fe-2bc4cbfbf09e","Type":"ContainerStarted","Data":"b802907934b7f76c4538d4f6ee66e366ce514c23f2d63b2abce328705d7db459"} Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.742574 5120 scope.go:117] "RemoveContainer" containerID="35a7dd6e19084cee69ca16203bca6378ea0cdf6a685ca2093ab847e5904eb9e6" Mar 16 16:43:22 crc kubenswrapper[5120]: E0316 16:43:22.743322 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:43:22 crc kubenswrapper[5120]: E0316 16:43:22.753786 5120 kuberuntime_manager.go:1358] "Unhandled Error" err=< Mar 16 16:43:22 crc kubenswrapper[5120]: container &Container{Name:mariadb-account-create-update,Image:quay.io/podified-antelope-centos9/openstack-mariadb@sha256:4caef2b55e01b9a7ee88a22bc69db1893521a91d95c7ad4c8e593f14f17a5f95,Command:[/bin/sh -c #!/bin/bash Mar 16 16:43:22 crc kubenswrapper[5120]: Mar 16 16:43:22 crc kubenswrapper[5120]: MYSQL_REMOTE_HOST="" source /var/lib/operator-scripts/mysql_root_auth.sh Mar 16 16:43:22 crc kubenswrapper[5120]: Mar 16 16:43:22 crc kubenswrapper[5120]: export DatabasePassword=${DatabasePassword:?"Please specify a DatabasePassword variable."} Mar 16 16:43:22 crc kubenswrapper[5120]: Mar 16 16:43:22 crc kubenswrapper[5120]: MYSQL_CMD="mysql -h -u root -P 3306" Mar 16 16:43:22 crc kubenswrapper[5120]: Mar 16 16:43:22 crc kubenswrapper[5120]: if [ -n "placement" ]; then Mar 16 16:43:22 crc kubenswrapper[5120]: GRANT_DATABASE="placement" Mar 16 16:43:22 crc kubenswrapper[5120]: else Mar 16 16:43:22 crc kubenswrapper[5120]: GRANT_DATABASE="*" Mar 16 16:43:22 crc kubenswrapper[5120]: fi Mar 16 16:43:22 crc kubenswrapper[5120]: Mar 16 16:43:22 crc kubenswrapper[5120]: # going for maximum compatibility here: Mar 16 16:43:22 crc kubenswrapper[5120]: # 1. MySQL 8 no longer allows implicit create user when GRANT is used Mar 16 16:43:22 crc kubenswrapper[5120]: # 2. MariaDB has "CREATE OR REPLACE", but MySQL does not Mar 16 16:43:22 crc kubenswrapper[5120]: # 3. create user with CREATE but then do all password and TLS with ALTER to Mar 16 16:43:22 crc kubenswrapper[5120]: # support updates Mar 16 16:43:22 crc kubenswrapper[5120]: Mar 16 16:43:22 crc kubenswrapper[5120]: $MYSQL_CMD < logger="UnhandledError" Mar 16 16:43:22 crc kubenswrapper[5120]: E0316 16:43:22.754521 5120 kuberuntime_manager.go:1358] "Unhandled Error" err=< Mar 16 16:43:22 crc kubenswrapper[5120]: container &Container{Name:mariadb-account-create-update,Image:quay.io/podified-antelope-centos9/openstack-mariadb@sha256:4caef2b55e01b9a7ee88a22bc69db1893521a91d95c7ad4c8e593f14f17a5f95,Command:[/bin/sh -c #!/bin/bash Mar 16 16:43:22 crc kubenswrapper[5120]: Mar 16 16:43:22 crc kubenswrapper[5120]: MYSQL_REMOTE_HOST="" source /var/lib/operator-scripts/mysql_root_auth.sh Mar 16 16:43:22 crc kubenswrapper[5120]: Mar 16 16:43:22 crc kubenswrapper[5120]: export DatabasePassword=${DatabasePassword:?"Please specify a DatabasePassword variable."} Mar 16 16:43:22 crc kubenswrapper[5120]: Mar 16 16:43:22 crc kubenswrapper[5120]: MYSQL_CMD="mysql -h -u root -P 3306" Mar 16 16:43:22 crc kubenswrapper[5120]: Mar 16 16:43:22 crc kubenswrapper[5120]: if [ -n "nova_cell1" ]; then Mar 16 16:43:22 crc kubenswrapper[5120]: GRANT_DATABASE="nova_cell1" Mar 16 16:43:22 crc kubenswrapper[5120]: else Mar 16 16:43:22 crc kubenswrapper[5120]: GRANT_DATABASE="*" Mar 16 16:43:22 crc kubenswrapper[5120]: fi Mar 16 16:43:22 crc kubenswrapper[5120]: Mar 16 16:43:22 crc kubenswrapper[5120]: # going for maximum compatibility here: Mar 16 16:43:22 crc kubenswrapper[5120]: # 1. MySQL 8 no longer allows implicit create user when GRANT is used Mar 16 16:43:22 crc kubenswrapper[5120]: # 2. MariaDB has "CREATE OR REPLACE", but MySQL does not Mar 16 16:43:22 crc kubenswrapper[5120]: # 3. create user with CREATE but then do all password and TLS with ALTER to Mar 16 16:43:22 crc kubenswrapper[5120]: # support updates Mar 16 16:43:22 crc kubenswrapper[5120]: Mar 16 16:43:22 crc kubenswrapper[5120]: $MYSQL_CMD < logger="UnhandledError" Mar 16 16:43:22 crc kubenswrapper[5120]: E0316 16:43:22.754826 5120 kuberuntime_manager.go:1358] "Unhandled Error" err=< Mar 16 16:43:22 crc kubenswrapper[5120]: container &Container{Name:mariadb-account-create-update,Image:quay.io/podified-antelope-centos9/openstack-mariadb@sha256:4caef2b55e01b9a7ee88a22bc69db1893521a91d95c7ad4c8e593f14f17a5f95,Command:[/bin/sh -c #!/bin/bash Mar 16 16:43:22 crc kubenswrapper[5120]: Mar 16 16:43:22 crc kubenswrapper[5120]: MYSQL_REMOTE_HOST="" source /var/lib/operator-scripts/mysql_root_auth.sh Mar 16 16:43:22 crc kubenswrapper[5120]: Mar 16 16:43:22 crc kubenswrapper[5120]: export DatabasePassword=${DatabasePassword:?"Please specify a DatabasePassword variable."} Mar 16 16:43:22 crc kubenswrapper[5120]: Mar 16 16:43:22 crc kubenswrapper[5120]: MYSQL_CMD="mysql -h -u root -P 3306" Mar 16 16:43:22 crc kubenswrapper[5120]: Mar 16 16:43:22 crc kubenswrapper[5120]: if [ -n "" ]; then Mar 16 16:43:22 crc kubenswrapper[5120]: GRANT_DATABASE="" Mar 16 16:43:22 crc kubenswrapper[5120]: else Mar 16 16:43:22 crc kubenswrapper[5120]: GRANT_DATABASE="*" Mar 16 16:43:22 crc kubenswrapper[5120]: fi Mar 16 16:43:22 crc kubenswrapper[5120]: Mar 16 16:43:22 crc kubenswrapper[5120]: # going for maximum compatibility here: Mar 16 16:43:22 crc kubenswrapper[5120]: # 1. MySQL 8 no longer allows implicit create user when GRANT is used Mar 16 16:43:22 crc kubenswrapper[5120]: # 2. MariaDB has "CREATE OR REPLACE", but MySQL does not Mar 16 16:43:22 crc kubenswrapper[5120]: # 3. create user with CREATE but then do all password and TLS with ALTER to Mar 16 16:43:22 crc kubenswrapper[5120]: # support updates Mar 16 16:43:22 crc kubenswrapper[5120]: Mar 16 16:43:22 crc kubenswrapper[5120]: $MYSQL_CMD < logger="UnhandledError" Mar 16 16:43:22 crc kubenswrapper[5120]: E0316 16:43:22.755345 5120 kuberuntime_manager.go:1358] "Unhandled Error" err=< Mar 16 16:43:22 crc kubenswrapper[5120]: container &Container{Name:mariadb-account-create-update,Image:quay.io/podified-antelope-centos9/openstack-mariadb@sha256:4caef2b55e01b9a7ee88a22bc69db1893521a91d95c7ad4c8e593f14f17a5f95,Command:[/bin/sh -c #!/bin/bash Mar 16 16:43:22 crc kubenswrapper[5120]: Mar 16 16:43:22 crc kubenswrapper[5120]: MYSQL_REMOTE_HOST="" source /var/lib/operator-scripts/mysql_root_auth.sh Mar 16 16:43:22 crc kubenswrapper[5120]: Mar 16 16:43:22 crc kubenswrapper[5120]: export DatabasePassword=${DatabasePassword:?"Please specify a DatabasePassword variable."} Mar 16 16:43:22 crc kubenswrapper[5120]: Mar 16 16:43:22 crc kubenswrapper[5120]: MYSQL_CMD="mysql -h -u root -P 3306" Mar 16 16:43:22 crc kubenswrapper[5120]: Mar 16 16:43:22 crc kubenswrapper[5120]: if [ -n "nova_api" ]; then Mar 16 16:43:22 crc kubenswrapper[5120]: GRANT_DATABASE="nova_api" Mar 16 16:43:22 crc kubenswrapper[5120]: else Mar 16 16:43:22 crc kubenswrapper[5120]: GRANT_DATABASE="*" Mar 16 16:43:22 crc kubenswrapper[5120]: fi Mar 16 16:43:22 crc kubenswrapper[5120]: Mar 16 16:43:22 crc kubenswrapper[5120]: # going for maximum compatibility here: Mar 16 16:43:22 crc kubenswrapper[5120]: # 1. MySQL 8 no longer allows implicit create user when GRANT is used Mar 16 16:43:22 crc kubenswrapper[5120]: # 2. MariaDB has "CREATE OR REPLACE", but MySQL does not Mar 16 16:43:22 crc kubenswrapper[5120]: # 3. create user with CREATE but then do all password and TLS with ALTER to Mar 16 16:43:22 crc kubenswrapper[5120]: # support updates Mar 16 16:43:22 crc kubenswrapper[5120]: Mar 16 16:43:22 crc kubenswrapper[5120]: $MYSQL_CMD < logger="UnhandledError" Mar 16 16:43:22 crc kubenswrapper[5120]: E0316 16:43:22.756073 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"mariadb-account-create-update\" with CreateContainerConfigError: \"secret \\\"openstack-cell1-mariadb-root-db-secret\\\" not found\"" pod="openstack-kuttl-tests/root-account-create-update-cgjmv" podUID="ad545a3f-12c8-4905-a7fe-2bc4cbfbf09e" Mar 16 16:43:22 crc kubenswrapper[5120]: E0316 16:43:22.756200 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"mariadb-account-create-update\" with CreateContainerConfigError: \"secret \\\"nova-cell1-db-secret\\\" not found\"" pod="openstack-kuttl-tests/nova-cell1-d38a-account-create-update-6jhs9" podUID="93c4c8f7-726e-4f00-b007-7411cfba1a4c" Mar 16 16:43:22 crc kubenswrapper[5120]: E0316 16:43:22.756393 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"mariadb-account-create-update\" with CreateContainerConfigError: \"secret \\\"nova-api-db-secret\\\" not found\"" pod="openstack-kuttl-tests/nova-api-a3c5-account-create-update-ndpvq" podUID="37490319-0529-4ab4-a97a-3dc9486aa867" Mar 16 16:43:22 crc kubenswrapper[5120]: E0316 16:43:22.757174 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"mariadb-account-create-update\" with CreateContainerConfigError: \"secret \\\"placement-db-secret\\\" not found\"" pod="openstack-kuttl-tests/placement-e32b-account-create-update-xn2hk" podUID="908660b0-e07b-45ab-92c8-1e466ddc0906" Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.757299 5120 generic.go:358] "Generic (PLEG): container finished" podID="e9e86e40-d30c-4208-852b-5d6737ba05ce" containerID="9ea9db94f867aa536c9a5bdcc6cf83c48c8a9bcef57187ed927a4383f38d4b5b" exitCode=143 Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.757395 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"e9e86e40-d30c-4208-852b-5d6737ba05ce","Type":"ContainerDied","Data":"9ea9db94f867aa536c9a5bdcc6cf83c48c8a9bcef57187ed927a4383f38d4b5b"} Mar 16 16:43:22 crc kubenswrapper[5120]: E0316 16:43:22.761037 5120 kuberuntime_manager.go:1358] "Unhandled Error" err=< Mar 16 16:43:22 crc kubenswrapper[5120]: container &Container{Name:mariadb-account-create-update,Image:quay.io/podified-antelope-centos9/openstack-mariadb@sha256:4caef2b55e01b9a7ee88a22bc69db1893521a91d95c7ad4c8e593f14f17a5f95,Command:[/bin/sh -c #!/bin/bash Mar 16 16:43:22 crc kubenswrapper[5120]: Mar 16 16:43:22 crc kubenswrapper[5120]: MYSQL_REMOTE_HOST="" source /var/lib/operator-scripts/mysql_root_auth.sh Mar 16 16:43:22 crc kubenswrapper[5120]: Mar 16 16:43:22 crc kubenswrapper[5120]: export DatabasePassword=${DatabasePassword:?"Please specify a DatabasePassword variable."} Mar 16 16:43:22 crc kubenswrapper[5120]: Mar 16 16:43:22 crc kubenswrapper[5120]: MYSQL_CMD="mysql -h -u root -P 3306" Mar 16 16:43:22 crc kubenswrapper[5120]: Mar 16 16:43:22 crc kubenswrapper[5120]: if [ -n "nova_cell0" ]; then Mar 16 16:43:22 crc kubenswrapper[5120]: GRANT_DATABASE="nova_cell0" Mar 16 16:43:22 crc kubenswrapper[5120]: else Mar 16 16:43:22 crc kubenswrapper[5120]: GRANT_DATABASE="*" Mar 16 16:43:22 crc kubenswrapper[5120]: fi Mar 16 16:43:22 crc kubenswrapper[5120]: Mar 16 16:43:22 crc kubenswrapper[5120]: # going for maximum compatibility here: Mar 16 16:43:22 crc kubenswrapper[5120]: # 1. MySQL 8 no longer allows implicit create user when GRANT is used Mar 16 16:43:22 crc kubenswrapper[5120]: # 2. MariaDB has "CREATE OR REPLACE", but MySQL does not Mar 16 16:43:22 crc kubenswrapper[5120]: # 3. create user with CREATE but then do all password and TLS with ALTER to Mar 16 16:43:22 crc kubenswrapper[5120]: # support updates Mar 16 16:43:22 crc kubenswrapper[5120]: Mar 16 16:43:22 crc kubenswrapper[5120]: $MYSQL_CMD < logger="UnhandledError" Mar 16 16:43:22 crc kubenswrapper[5120]: E0316 16:43:22.762178 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"mariadb-account-create-update\" with CreateContainerConfigError: \"secret \\\"nova-cell0-db-secret\\\" not found\"" pod="openstack-kuttl-tests/nova-cell0-f4eb-account-create-update-4wnlc" podUID="69586194-14da-4bd2-ab2d-5b464625a1a5" Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.784974 5120 generic.go:358] "Generic (PLEG): container finished" podID="285f9896-1a25-4942-96e7-06cff0c87338" containerID="960b621eb32725f87cd9d272b4591b8833ab3d8756e9e76af56acecb09e4b1e4" exitCode=143 Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.785086 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-6d66dbd7f8-6ld6p" event={"ID":"285f9896-1a25-4942-96e7-06cff0c87338","Type":"ContainerDied","Data":"960b621eb32725f87cd9d272b4591b8833ab3d8756e9e76af56acecb09e4b1e4"} Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.786996 5120 reconciler_common.go:299] "Volume detached for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/591ce862-489c-49f7-8dbd-500414032fd9-openstack-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.787040 5120 reconciler_common.go:299] "Volume detached for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/591ce862-489c-49f7-8dbd-500414032fd9-openstack-config-secret\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.807780 5120 generic.go:358] "Generic (PLEG): container finished" podID="935a7850-d7f8-438f-a787-6a78e33db090" containerID="d7dd32e7de0c2fd93e29bcaac1474b1c8ebaed9d509efbae0d367991ba1a58da" exitCode=143 Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.808104 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"935a7850-d7f8-438f-a787-6a78e33db090","Type":"ContainerDied","Data":"d7dd32e7de0c2fd93e29bcaac1474b1c8ebaed9d509efbae0d367991ba1a58da"} Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.834281 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.841796 5120 generic.go:358] "Generic (PLEG): container finished" podID="4c03814f-fda1-4a54-b9ca-89705d683547" containerID="3119e5ce532c5e339071de9ff3c4fe23636cf19a24818b601368555dfb49f204" exitCode=0 Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.841937 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"4c03814f-fda1-4a54-b9ca-89705d683547","Type":"ContainerDied","Data":"3119e5ce532c5e339071de9ff3c4fe23636cf19a24818b601368555dfb49f204"} Mar 16 16:43:22 crc kubenswrapper[5120]: E0316 16:43:22.889284 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-cell1-scripts: configmap "openstack-cell1-scripts" not found Mar 16 16:43:22 crc kubenswrapper[5120]: E0316 16:43:22.889495 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ad545a3f-12c8-4905-a7fe-2bc4cbfbf09e-operator-scripts podName:ad545a3f-12c8-4905-a7fe-2bc4cbfbf09e nodeName:}" failed. No retries permitted until 2026-03-16 16:43:23.389477944 +0000 UTC m=+4305.543409601 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/ad545a3f-12c8-4905-a7fe-2bc4cbfbf09e-operator-scripts") pod "root-account-create-update-cgjmv" (UID: "ad545a3f-12c8-4905-a7fe-2bc4cbfbf09e") : configmap "openstack-cell1-scripts" not found Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.890326 5120 generic.go:358] "Generic (PLEG): container finished" podID="be094b3e-494e-420d-b458-0e32770cd540" containerID="1de4d27ef85234281dc29611eaac2860bbedc2f6d3859afdac09f43a62514da8" exitCode=143 Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.890367 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"be094b3e-494e-420d-b458-0e32770cd540","Type":"ContainerDied","Data":"1de4d27ef85234281dc29611eaac2860bbedc2f6d3859afdac09f43a62514da8"} Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.918320 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.925401 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.933256 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.940802 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-htctf"] Mar 16 16:43:22 crc kubenswrapper[5120]: I0316 16:43:22.946397 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 16:43:22 crc kubenswrapper[5120]: E0316 16:43:22.994066 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-config-data: configmap "rabbitmq-config-data" not found Mar 16 16:43:22 crc kubenswrapper[5120]: E0316 16:43:22.994139 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/55a201e2-20da-49c3-8216-77a042dd3b31-config-data podName:55a201e2-20da-49c3-8216-77a042dd3b31 nodeName:}" failed. No retries permitted until 2026-03-16 16:43:23.494105474 +0000 UTC m=+4305.648037131 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/55a201e2-20da-49c3-8216-77a042dd3b31-config-data") pod "rabbitmq-server-0" (UID: "55a201e2-20da-49c3-8216-77a042dd3b31") : configmap "rabbitmq-config-data" not found Mar 16 16:43:23 crc kubenswrapper[5120]: I0316 16:43:23.008681 5120 scope.go:117] "RemoveContainer" containerID="7befb30786bb8581613c702d4f626d345db7f3e118cb4ff248d66ee187c3c334" Mar 16 16:43:23 crc kubenswrapper[5120]: E0316 16:43:23.011446 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7befb30786bb8581613c702d4f626d345db7f3e118cb4ff248d66ee187c3c334\": container with ID starting with 7befb30786bb8581613c702d4f626d345db7f3e118cb4ff248d66ee187c3c334 not found: ID does not exist" containerID="7befb30786bb8581613c702d4f626d345db7f3e118cb4ff248d66ee187c3c334" Mar 16 16:43:23 crc kubenswrapper[5120]: I0316 16:43:23.011515 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7befb30786bb8581613c702d4f626d345db7f3e118cb4ff248d66ee187c3c334"} err="failed to get container status \"7befb30786bb8581613c702d4f626d345db7f3e118cb4ff248d66ee187c3c334\": rpc error: code = NotFound desc = could not find container \"7befb30786bb8581613c702d4f626d345db7f3e118cb4ff248d66ee187c3c334\": container with ID starting with 7befb30786bb8581613c702d4f626d345db7f3e118cb4ff248d66ee187c3c334 not found: ID does not exist" Mar 16 16:43:23 crc kubenswrapper[5120]: I0316 16:43:23.011538 5120 scope.go:117] "RemoveContainer" containerID="d65c682ba8d5b9c2ab292d5eadb6afb5ebf5e5383178932398baa6bd606390df" Mar 16 16:43:23 crc kubenswrapper[5120]: E0316 16:43:23.012146 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d65c682ba8d5b9c2ab292d5eadb6afb5ebf5e5383178932398baa6bd606390df\": container with ID starting with d65c682ba8d5b9c2ab292d5eadb6afb5ebf5e5383178932398baa6bd606390df not found: ID does not exist" containerID="d65c682ba8d5b9c2ab292d5eadb6afb5ebf5e5383178932398baa6bd606390df" Mar 16 16:43:23 crc kubenswrapper[5120]: I0316 16:43:23.012199 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d65c682ba8d5b9c2ab292d5eadb6afb5ebf5e5383178932398baa6bd606390df"} err="failed to get container status \"d65c682ba8d5b9c2ab292d5eadb6afb5ebf5e5383178932398baa6bd606390df\": rpc error: code = NotFound desc = could not find container \"d65c682ba8d5b9c2ab292d5eadb6afb5ebf5e5383178932398baa6bd606390df\": container with ID starting with d65c682ba8d5b9c2ab292d5eadb6afb5ebf5e5383178932398baa6bd606390df not found: ID does not exist" Mar 16 16:43:23 crc kubenswrapper[5120]: I0316 16:43:23.012214 5120 scope.go:117] "RemoveContainer" containerID="9419bd0a11a06fc46b0997e1cd23e133bfc77036683ad12a18f8a766d86ab63e" Mar 16 16:43:23 crc kubenswrapper[5120]: I0316 16:43:23.309431 5120 scope.go:117] "RemoveContainer" containerID="9419bd0a11a06fc46b0997e1cd23e133bfc77036683ad12a18f8a766d86ab63e" Mar 16 16:43:23 crc kubenswrapper[5120]: E0316 16:43:23.314198 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9419bd0a11a06fc46b0997e1cd23e133bfc77036683ad12a18f8a766d86ab63e\": container with ID starting with 9419bd0a11a06fc46b0997e1cd23e133bfc77036683ad12a18f8a766d86ab63e not found: ID does not exist" containerID="9419bd0a11a06fc46b0997e1cd23e133bfc77036683ad12a18f8a766d86ab63e" Mar 16 16:43:23 crc kubenswrapper[5120]: I0316 16:43:23.314246 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9419bd0a11a06fc46b0997e1cd23e133bfc77036683ad12a18f8a766d86ab63e"} err="failed to get container status \"9419bd0a11a06fc46b0997e1cd23e133bfc77036683ad12a18f8a766d86ab63e\": rpc error: code = NotFound desc = could not find container \"9419bd0a11a06fc46b0997e1cd23e133bfc77036683ad12a18f8a766d86ab63e\": container with ID starting with 9419bd0a11a06fc46b0997e1cd23e133bfc77036683ad12a18f8a766d86ab63e not found: ID does not exist" Mar 16 16:43:23 crc kubenswrapper[5120]: I0316 16:43:23.314290 5120 scope.go:117] "RemoveContainer" containerID="27caa0d07f4f6a9da1d136e53e041b4b98a922634553e557b8adcb1ff1ab2b90" Mar 16 16:43:23 crc kubenswrapper[5120]: I0316 16:43:23.314612 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-85dfc87f54-wb22t" Mar 16 16:43:23 crc kubenswrapper[5120]: I0316 16:43:23.385963 5120 scope.go:117] "RemoveContainer" containerID="b5e1f012279bd50c0f6dd58081fae905fbd9dd2443094c84fcca48be455d262e" Mar 16 16:43:23 crc kubenswrapper[5120]: I0316 16:43:23.410138 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 16:43:23 crc kubenswrapper[5120]: I0316 16:43:23.418155 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/8b100760-cd10-47f9-a43a-5ec03d37d1f0-log-httpd\") pod \"8b100760-cd10-47f9-a43a-5ec03d37d1f0\" (UID: \"8b100760-cd10-47f9-a43a-5ec03d37d1f0\") " Mar 16 16:43:23 crc kubenswrapper[5120]: I0316 16:43:23.418204 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/8b100760-cd10-47f9-a43a-5ec03d37d1f0-run-httpd\") pod \"8b100760-cd10-47f9-a43a-5ec03d37d1f0\" (UID: \"8b100760-cd10-47f9-a43a-5ec03d37d1f0\") " Mar 16 16:43:23 crc kubenswrapper[5120]: I0316 16:43:23.418409 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/8b100760-cd10-47f9-a43a-5ec03d37d1f0-internal-tls-certs\") pod \"8b100760-cd10-47f9-a43a-5ec03d37d1f0\" (UID: \"8b100760-cd10-47f9-a43a-5ec03d37d1f0\") " Mar 16 16:43:23 crc kubenswrapper[5120]: I0316 16:43:23.418437 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8b100760-cd10-47f9-a43a-5ec03d37d1f0-config-data\") pod \"8b100760-cd10-47f9-a43a-5ec03d37d1f0\" (UID: \"8b100760-cd10-47f9-a43a-5ec03d37d1f0\") " Mar 16 16:43:23 crc kubenswrapper[5120]: I0316 16:43:23.418652 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/8b100760-cd10-47f9-a43a-5ec03d37d1f0-public-tls-certs\") pod \"8b100760-cd10-47f9-a43a-5ec03d37d1f0\" (UID: \"8b100760-cd10-47f9-a43a-5ec03d37d1f0\") " Mar 16 16:43:23 crc kubenswrapper[5120]: I0316 16:43:23.418771 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m26xx\" (UniqueName: \"kubernetes.io/projected/8b100760-cd10-47f9-a43a-5ec03d37d1f0-kube-api-access-m26xx\") pod \"8b100760-cd10-47f9-a43a-5ec03d37d1f0\" (UID: \"8b100760-cd10-47f9-a43a-5ec03d37d1f0\") " Mar 16 16:43:23 crc kubenswrapper[5120]: I0316 16:43:23.418898 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/8b100760-cd10-47f9-a43a-5ec03d37d1f0-etc-swift\") pod \"8b100760-cd10-47f9-a43a-5ec03d37d1f0\" (UID: \"8b100760-cd10-47f9-a43a-5ec03d37d1f0\") " Mar 16 16:43:23 crc kubenswrapper[5120]: I0316 16:43:23.419020 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8b100760-cd10-47f9-a43a-5ec03d37d1f0-combined-ca-bundle\") pod \"8b100760-cd10-47f9-a43a-5ec03d37d1f0\" (UID: \"8b100760-cd10-47f9-a43a-5ec03d37d1f0\") " Mar 16 16:43:23 crc kubenswrapper[5120]: I0316 16:43:23.419133 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b100760-cd10-47f9-a43a-5ec03d37d1f0-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "8b100760-cd10-47f9-a43a-5ec03d37d1f0" (UID: "8b100760-cd10-47f9-a43a-5ec03d37d1f0"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:43:23 crc kubenswrapper[5120]: I0316 16:43:23.419146 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b100760-cd10-47f9-a43a-5ec03d37d1f0-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "8b100760-cd10-47f9-a43a-5ec03d37d1f0" (UID: "8b100760-cd10-47f9-a43a-5ec03d37d1f0"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:43:23 crc kubenswrapper[5120]: E0316 16:43:23.419215 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-cell1-scripts: configmap "openstack-cell1-scripts" not found Mar 16 16:43:23 crc kubenswrapper[5120]: E0316 16:43:23.419271 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ad545a3f-12c8-4905-a7fe-2bc4cbfbf09e-operator-scripts podName:ad545a3f-12c8-4905-a7fe-2bc4cbfbf09e nodeName:}" failed. No retries permitted until 2026-03-16 16:43:24.419254813 +0000 UTC m=+4306.573186470 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/ad545a3f-12c8-4905-a7fe-2bc4cbfbf09e-operator-scripts") pod "root-account-create-update-cgjmv" (UID: "ad545a3f-12c8-4905-a7fe-2bc4cbfbf09e") : configmap "openstack-cell1-scripts" not found Mar 16 16:43:23 crc kubenswrapper[5120]: I0316 16:43:23.420381 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/8b100760-cd10-47f9-a43a-5ec03d37d1f0-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:23 crc kubenswrapper[5120]: I0316 16:43:23.420399 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/8b100760-cd10-47f9-a43a-5ec03d37d1f0-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:23 crc kubenswrapper[5120]: E0316 16:43:23.423616 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of f2177105ac4d9674a3c981a2ee15da79c7b65aa682d513987168644107f465a1 is running failed: container process not found" containerID="f2177105ac4d9674a3c981a2ee15da79c7b65aa682d513987168644107f465a1" cmd=["/bin/bash","/var/lib/operator-scripts/mysql_probe.sh","readiness"] Mar 16 16:43:23 crc kubenswrapper[5120]: E0316 16:43:23.425065 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of f2177105ac4d9674a3c981a2ee15da79c7b65aa682d513987168644107f465a1 is running failed: container process not found" containerID="f2177105ac4d9674a3c981a2ee15da79c7b65aa682d513987168644107f465a1" cmd=["/bin/bash","/var/lib/operator-scripts/mysql_probe.sh","readiness"] Mar 16 16:43:23 crc kubenswrapper[5120]: E0316 16:43:23.425497 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of f2177105ac4d9674a3c981a2ee15da79c7b65aa682d513987168644107f465a1 is running failed: container process not found" containerID="f2177105ac4d9674a3c981a2ee15da79c7b65aa682d513987168644107f465a1" cmd=["/bin/bash","/var/lib/operator-scripts/mysql_probe.sh","readiness"] Mar 16 16:43:23 crc kubenswrapper[5120]: E0316 16:43:23.425559 5120 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of f2177105ac4d9674a3c981a2ee15da79c7b65aa682d513987168644107f465a1 is running failed: container process not found" probeType="Readiness" pod="openstack-kuttl-tests/openstack-cell1-galera-0" podUID="45e134ad-472e-4c91-8c2e-08a8b698847e" containerName="galera" probeResult="unknown" Mar 16 16:43:23 crc kubenswrapper[5120]: I0316 16:43:23.427288 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b100760-cd10-47f9-a43a-5ec03d37d1f0-etc-swift" (OuterVolumeSpecName: "etc-swift") pod "8b100760-cd10-47f9-a43a-5ec03d37d1f0" (UID: "8b100760-cd10-47f9-a43a-5ec03d37d1f0"). InnerVolumeSpecName "etc-swift". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:43:23 crc kubenswrapper[5120]: I0316 16:43:23.432895 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b100760-cd10-47f9-a43a-5ec03d37d1f0-kube-api-access-m26xx" (OuterVolumeSpecName: "kube-api-access-m26xx") pod "8b100760-cd10-47f9-a43a-5ec03d37d1f0" (UID: "8b100760-cd10-47f9-a43a-5ec03d37d1f0"). InnerVolumeSpecName "kube-api-access-m26xx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:43:23 crc kubenswrapper[5120]: I0316 16:43:23.443151 5120 scope.go:117] "RemoveContainer" containerID="91db5da9c2c16a0ddc0621d66df7fe0db6a0c98754c249f4f2ac5a8195fade13" Mar 16 16:43:23 crc kubenswrapper[5120]: I0316 16:43:23.502018 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8b100760-cd10-47f9-a43a-5ec03d37d1f0-config-data" (OuterVolumeSpecName: "config-data") pod "8b100760-cd10-47f9-a43a-5ec03d37d1f0" (UID: "8b100760-cd10-47f9-a43a-5ec03d37d1f0"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:43:23 crc kubenswrapper[5120]: I0316 16:43:23.526018 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8b100760-cd10-47f9-a43a-5ec03d37d1f0-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "8b100760-cd10-47f9-a43a-5ec03d37d1f0" (UID: "8b100760-cd10-47f9-a43a-5ec03d37d1f0"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:43:23 crc kubenswrapper[5120]: I0316 16:43:23.528115 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8b100760-cd10-47f9-a43a-5ec03d37d1f0-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:23 crc kubenswrapper[5120]: I0316 16:43:23.528146 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8b100760-cd10-47f9-a43a-5ec03d37d1f0-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:23 crc kubenswrapper[5120]: I0316 16:43:23.528155 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m26xx\" (UniqueName: \"kubernetes.io/projected/8b100760-cd10-47f9-a43a-5ec03d37d1f0-kube-api-access-m26xx\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:23 crc kubenswrapper[5120]: I0316 16:43:23.528164 5120 reconciler_common.go:299] "Volume detached for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/8b100760-cd10-47f9-a43a-5ec03d37d1f0-etc-swift\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:23 crc kubenswrapper[5120]: E0316 16:43:23.528227 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-config-data: configmap "rabbitmq-config-data" not found Mar 16 16:43:23 crc kubenswrapper[5120]: E0316 16:43:23.528277 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/55a201e2-20da-49c3-8216-77a042dd3b31-config-data podName:55a201e2-20da-49c3-8216-77a042dd3b31 nodeName:}" failed. No retries permitted until 2026-03-16 16:43:24.528261511 +0000 UTC m=+4306.682193168 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/55a201e2-20da-49c3-8216-77a042dd3b31-config-data") pod "rabbitmq-server-0" (UID: "55a201e2-20da-49c3-8216-77a042dd3b31") : configmap "rabbitmq-config-data" not found Mar 16 16:43:23 crc kubenswrapper[5120]: I0316 16:43:23.568569 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:43:23 crc kubenswrapper[5120]: I0316 16:43:23.607301 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8b100760-cd10-47f9-a43a-5ec03d37d1f0-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "8b100760-cd10-47f9-a43a-5ec03d37d1f0" (UID: "8b100760-cd10-47f9-a43a-5ec03d37d1f0"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:43:23 crc kubenswrapper[5120]: I0316 16:43:23.610943 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8b100760-cd10-47f9-a43a-5ec03d37d1f0-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "8b100760-cd10-47f9-a43a-5ec03d37d1f0" (UID: "8b100760-cd10-47f9-a43a-5ec03d37d1f0"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:43:23 crc kubenswrapper[5120]: I0316 16:43:23.629210 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/c0f2211e-5c26-4865-b7dd-8799e5229862-kube-state-metrics-tls-config\") pod \"c0f2211e-5c26-4865-b7dd-8799e5229862\" (UID: \"c0f2211e-5c26-4865-b7dd-8799e5229862\") " Mar 16 16:43:23 crc kubenswrapper[5120]: I0316 16:43:23.629625 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/c0f2211e-5c26-4865-b7dd-8799e5229862-kube-state-metrics-tls-certs\") pod \"c0f2211e-5c26-4865-b7dd-8799e5229862\" (UID: \"c0f2211e-5c26-4865-b7dd-8799e5229862\") " Mar 16 16:43:23 crc kubenswrapper[5120]: I0316 16:43:23.629672 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c0f2211e-5c26-4865-b7dd-8799e5229862-combined-ca-bundle\") pod \"c0f2211e-5c26-4865-b7dd-8799e5229862\" (UID: \"c0f2211e-5c26-4865-b7dd-8799e5229862\") " Mar 16 16:43:23 crc kubenswrapper[5120]: I0316 16:43:23.629897 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fn9ql\" (UniqueName: \"kubernetes.io/projected/c0f2211e-5c26-4865-b7dd-8799e5229862-kube-api-access-fn9ql\") pod \"c0f2211e-5c26-4865-b7dd-8799e5229862\" (UID: \"c0f2211e-5c26-4865-b7dd-8799e5229862\") " Mar 16 16:43:23 crc kubenswrapper[5120]: I0316 16:43:23.630716 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/8b100760-cd10-47f9-a43a-5ec03d37d1f0-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:23 crc kubenswrapper[5120]: I0316 16:43:23.630735 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/8b100760-cd10-47f9-a43a-5ec03d37d1f0-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:23 crc kubenswrapper[5120]: I0316 16:43:23.633978 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0f2211e-5c26-4865-b7dd-8799e5229862-kube-api-access-fn9ql" (OuterVolumeSpecName: "kube-api-access-fn9ql") pod "c0f2211e-5c26-4865-b7dd-8799e5229862" (UID: "c0f2211e-5c26-4865-b7dd-8799e5229862"). InnerVolumeSpecName "kube-api-access-fn9ql". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:43:23 crc kubenswrapper[5120]: I0316 16:43:23.651197 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:43:23 crc kubenswrapper[5120]: I0316 16:43:23.653674 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:43:23 crc kubenswrapper[5120]: I0316 16:43:23.680672 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c0f2211e-5c26-4865-b7dd-8799e5229862-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "c0f2211e-5c26-4865-b7dd-8799e5229862" (UID: "c0f2211e-5c26-4865-b7dd-8799e5229862"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:43:23 crc kubenswrapper[5120]: I0316 16:43:23.691259 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c0f2211e-5c26-4865-b7dd-8799e5229862-kube-state-metrics-tls-config" (OuterVolumeSpecName: "kube-state-metrics-tls-config") pod "c0f2211e-5c26-4865-b7dd-8799e5229862" (UID: "c0f2211e-5c26-4865-b7dd-8799e5229862"). InnerVolumeSpecName "kube-state-metrics-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:43:23 crc kubenswrapper[5120]: I0316 16:43:23.714861 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:43:23 crc kubenswrapper[5120]: I0316 16:43:23.719579 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c0f2211e-5c26-4865-b7dd-8799e5229862-kube-state-metrics-tls-certs" (OuterVolumeSpecName: "kube-state-metrics-tls-certs") pod "c0f2211e-5c26-4865-b7dd-8799e5229862" (UID: "c0f2211e-5c26-4865-b7dd-8799e5229862"). InnerVolumeSpecName "kube-state-metrics-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:43:23 crc kubenswrapper[5120]: I0316 16:43:23.731791 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/e8e5a741-9d1e-496c-85e7-3f2966cf0e68-vencrypt-tls-certs\") pod \"e8e5a741-9d1e-496c-85e7-3f2966cf0e68\" (UID: \"e8e5a741-9d1e-496c-85e7-3f2966cf0e68\") " Mar 16 16:43:23 crc kubenswrapper[5120]: I0316 16:43:23.731905 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/45e134ad-472e-4c91-8c2e-08a8b698847e-config-data-generated\") pod \"45e134ad-472e-4c91-8c2e-08a8b698847e\" (UID: \"45e134ad-472e-4c91-8c2e-08a8b698847e\") " Mar 16 16:43:23 crc kubenswrapper[5120]: I0316 16:43:23.731986 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e8e5a741-9d1e-496c-85e7-3f2966cf0e68-combined-ca-bundle\") pod \"e8e5a741-9d1e-496c-85e7-3f2966cf0e68\" (UID: \"e8e5a741-9d1e-496c-85e7-3f2966cf0e68\") " Mar 16 16:43:23 crc kubenswrapper[5120]: I0316 16:43:23.732028 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4c03814f-fda1-4a54-b9ca-89705d683547-combined-ca-bundle\") pod \"4c03814f-fda1-4a54-b9ca-89705d683547\" (UID: \"4c03814f-fda1-4a54-b9ca-89705d683547\") " Mar 16 16:43:23 crc kubenswrapper[5120]: I0316 16:43:23.732118 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4c03814f-fda1-4a54-b9ca-89705d683547-config-data\") pod \"4c03814f-fda1-4a54-b9ca-89705d683547\" (UID: \"4c03814f-fda1-4a54-b9ca-89705d683547\") " Mar 16 16:43:23 crc kubenswrapper[5120]: I0316 16:43:23.732136 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-grxvr\" (UniqueName: \"kubernetes.io/projected/4c03814f-fda1-4a54-b9ca-89705d683547-kube-api-access-grxvr\") pod \"4c03814f-fda1-4a54-b9ca-89705d683547\" (UID: \"4c03814f-fda1-4a54-b9ca-89705d683547\") " Mar 16 16:43:23 crc kubenswrapper[5120]: I0316 16:43:23.732263 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/4c03814f-fda1-4a54-b9ca-89705d683547-config-data-custom\") pod \"4c03814f-fda1-4a54-b9ca-89705d683547\" (UID: \"4c03814f-fda1-4a54-b9ca-89705d683547\") " Mar 16 16:43:23 crc kubenswrapper[5120]: I0316 16:43:23.732380 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/45e134ad-472e-4c91-8c2e-08a8b698847e-operator-scripts\") pod \"45e134ad-472e-4c91-8c2e-08a8b698847e\" (UID: \"45e134ad-472e-4c91-8c2e-08a8b698847e\") " Mar 16 16:43:23 crc kubenswrapper[5120]: I0316 16:43:23.732400 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/4c03814f-fda1-4a54-b9ca-89705d683547-etc-machine-id\") pod \"4c03814f-fda1-4a54-b9ca-89705d683547\" (UID: \"4c03814f-fda1-4a54-b9ca-89705d683547\") " Mar 16 16:43:23 crc kubenswrapper[5120]: I0316 16:43:23.732454 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4c03814f-fda1-4a54-b9ca-89705d683547-scripts\") pod \"4c03814f-fda1-4a54-b9ca-89705d683547\" (UID: \"4c03814f-fda1-4a54-b9ca-89705d683547\") " Mar 16 16:43:23 crc kubenswrapper[5120]: I0316 16:43:23.733203 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45e134ad-472e-4c91-8c2e-08a8b698847e-config-data-generated" (OuterVolumeSpecName: "config-data-generated") pod "45e134ad-472e-4c91-8c2e-08a8b698847e" (UID: "45e134ad-472e-4c91-8c2e-08a8b698847e"). InnerVolumeSpecName "config-data-generated". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:43:23 crc kubenswrapper[5120]: I0316 16:43:23.734899 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/e8e5a741-9d1e-496c-85e7-3f2966cf0e68-nova-novncproxy-tls-certs\") pod \"e8e5a741-9d1e-496c-85e7-3f2966cf0e68\" (UID: \"e8e5a741-9d1e-496c-85e7-3f2966cf0e68\") " Mar 16 16:43:23 crc kubenswrapper[5120]: I0316 16:43:23.734993 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/45e134ad-472e-4c91-8c2e-08a8b698847e-combined-ca-bundle\") pod \"45e134ad-472e-4c91-8c2e-08a8b698847e\" (UID: \"45e134ad-472e-4c91-8c2e-08a8b698847e\") " Mar 16 16:43:23 crc kubenswrapper[5120]: I0316 16:43:23.735053 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"mysql-db\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"45e134ad-472e-4c91-8c2e-08a8b698847e\" (UID: \"45e134ad-472e-4c91-8c2e-08a8b698847e\") " Mar 16 16:43:23 crc kubenswrapper[5120]: I0316 16:43:23.735162 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t2hwh\" (UniqueName: \"kubernetes.io/projected/45e134ad-472e-4c91-8c2e-08a8b698847e-kube-api-access-t2hwh\") pod \"45e134ad-472e-4c91-8c2e-08a8b698847e\" (UID: \"45e134ad-472e-4c91-8c2e-08a8b698847e\") " Mar 16 16:43:23 crc kubenswrapper[5120]: I0316 16:43:23.735415 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kpkzx\" (UniqueName: \"kubernetes.io/projected/e8e5a741-9d1e-496c-85e7-3f2966cf0e68-kube-api-access-kpkzx\") pod \"e8e5a741-9d1e-496c-85e7-3f2966cf0e68\" (UID: \"e8e5a741-9d1e-496c-85e7-3f2966cf0e68\") " Mar 16 16:43:23 crc kubenswrapper[5120]: I0316 16:43:23.735503 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/45e134ad-472e-4c91-8c2e-08a8b698847e-galera-tls-certs\") pod \"45e134ad-472e-4c91-8c2e-08a8b698847e\" (UID: \"45e134ad-472e-4c91-8c2e-08a8b698847e\") " Mar 16 16:43:23 crc kubenswrapper[5120]: I0316 16:43:23.735634 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e8e5a741-9d1e-496c-85e7-3f2966cf0e68-config-data\") pod \"e8e5a741-9d1e-496c-85e7-3f2966cf0e68\" (UID: \"e8e5a741-9d1e-496c-85e7-3f2966cf0e68\") " Mar 16 16:43:23 crc kubenswrapper[5120]: I0316 16:43:23.735658 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/45e134ad-472e-4c91-8c2e-08a8b698847e-kolla-config\") pod \"45e134ad-472e-4c91-8c2e-08a8b698847e\" (UID: \"45e134ad-472e-4c91-8c2e-08a8b698847e\") " Mar 16 16:43:23 crc kubenswrapper[5120]: I0316 16:43:23.735741 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/45e134ad-472e-4c91-8c2e-08a8b698847e-config-data-default\") pod \"45e134ad-472e-4c91-8c2e-08a8b698847e\" (UID: \"45e134ad-472e-4c91-8c2e-08a8b698847e\") " Mar 16 16:43:23 crc kubenswrapper[5120]: I0316 16:43:23.738667 5120 reconciler_common.go:299] "Volume detached for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/c0f2211e-5c26-4865-b7dd-8799e5229862-kube-state-metrics-tls-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:23 crc kubenswrapper[5120]: I0316 16:43:23.738695 5120 reconciler_common.go:299] "Volume detached for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/c0f2211e-5c26-4865-b7dd-8799e5229862-kube-state-metrics-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:23 crc kubenswrapper[5120]: I0316 16:43:23.738707 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c0f2211e-5c26-4865-b7dd-8799e5229862-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:23 crc kubenswrapper[5120]: I0316 16:43:23.738716 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/45e134ad-472e-4c91-8c2e-08a8b698847e-config-data-generated\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:23 crc kubenswrapper[5120]: I0316 16:43:23.738726 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fn9ql\" (UniqueName: \"kubernetes.io/projected/c0f2211e-5c26-4865-b7dd-8799e5229862-kube-api-access-fn9ql\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:23 crc kubenswrapper[5120]: I0316 16:43:23.740533 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/4c03814f-fda1-4a54-b9ca-89705d683547-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "4c03814f-fda1-4a54-b9ca-89705d683547" (UID: "4c03814f-fda1-4a54-b9ca-89705d683547"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 16:43:23 crc kubenswrapper[5120]: I0316 16:43:23.741684 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/45e134ad-472e-4c91-8c2e-08a8b698847e-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "45e134ad-472e-4c91-8c2e-08a8b698847e" (UID: "45e134ad-472e-4c91-8c2e-08a8b698847e"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:43:23 crc kubenswrapper[5120]: I0316 16:43:23.742699 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/45e134ad-472e-4c91-8c2e-08a8b698847e-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "45e134ad-472e-4c91-8c2e-08a8b698847e" (UID: "45e134ad-472e-4c91-8c2e-08a8b698847e"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:43:23 crc kubenswrapper[5120]: I0316 16:43:23.743732 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/45e134ad-472e-4c91-8c2e-08a8b698847e-config-data-default" (OuterVolumeSpecName: "config-data-default") pod "45e134ad-472e-4c91-8c2e-08a8b698847e" (UID: "45e134ad-472e-4c91-8c2e-08a8b698847e"). InnerVolumeSpecName "config-data-default". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:43:23 crc kubenswrapper[5120]: I0316 16:43:23.748473 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c03814f-fda1-4a54-b9ca-89705d683547-kube-api-access-grxvr" (OuterVolumeSpecName: "kube-api-access-grxvr") pod "4c03814f-fda1-4a54-b9ca-89705d683547" (UID: "4c03814f-fda1-4a54-b9ca-89705d683547"). InnerVolumeSpecName "kube-api-access-grxvr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:43:23 crc kubenswrapper[5120]: I0316 16:43:23.753844 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c03814f-fda1-4a54-b9ca-89705d683547-scripts" (OuterVolumeSpecName: "scripts") pod "4c03814f-fda1-4a54-b9ca-89705d683547" (UID: "4c03814f-fda1-4a54-b9ca-89705d683547"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:43:23 crc kubenswrapper[5120]: I0316 16:43:23.753946 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c03814f-fda1-4a54-b9ca-89705d683547-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "4c03814f-fda1-4a54-b9ca-89705d683547" (UID: "4c03814f-fda1-4a54-b9ca-89705d683547"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:43:23 crc kubenswrapper[5120]: I0316 16:43:23.759426 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45e134ad-472e-4c91-8c2e-08a8b698847e-kube-api-access-t2hwh" (OuterVolumeSpecName: "kube-api-access-t2hwh") pod "45e134ad-472e-4c91-8c2e-08a8b698847e" (UID: "45e134ad-472e-4c91-8c2e-08a8b698847e"). InnerVolumeSpecName "kube-api-access-t2hwh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:43:23 crc kubenswrapper[5120]: I0316 16:43:23.759859 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8e5a741-9d1e-496c-85e7-3f2966cf0e68-kube-api-access-kpkzx" (OuterVolumeSpecName: "kube-api-access-kpkzx") pod "e8e5a741-9d1e-496c-85e7-3f2966cf0e68" (UID: "e8e5a741-9d1e-496c-85e7-3f2966cf0e68"). InnerVolumeSpecName "kube-api-access-kpkzx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:43:23 crc kubenswrapper[5120]: I0316 16:43:23.767595 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage01-crc" (OuterVolumeSpecName: "mysql-db") pod "45e134ad-472e-4c91-8c2e-08a8b698847e" (UID: "45e134ad-472e-4c91-8c2e-08a8b698847e"). InnerVolumeSpecName "local-storage01-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:43:23 crc kubenswrapper[5120]: I0316 16:43:23.778597 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8e5a741-9d1e-496c-85e7-3f2966cf0e68-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e8e5a741-9d1e-496c-85e7-3f2966cf0e68" (UID: "e8e5a741-9d1e-496c-85e7-3f2966cf0e68"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:43:23 crc kubenswrapper[5120]: I0316 16:43:23.805375 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45e134ad-472e-4c91-8c2e-08a8b698847e-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "45e134ad-472e-4c91-8c2e-08a8b698847e" (UID: "45e134ad-472e-4c91-8c2e-08a8b698847e"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:43:23 crc kubenswrapper[5120]: I0316 16:43:23.847156 5120 reconciler_common.go:299] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/45e134ad-472e-4c91-8c2e-08a8b698847e-kolla-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:23 crc kubenswrapper[5120]: I0316 16:43:23.847190 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/45e134ad-472e-4c91-8c2e-08a8b698847e-config-data-default\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:23 crc kubenswrapper[5120]: I0316 16:43:23.847205 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e8e5a741-9d1e-496c-85e7-3f2966cf0e68-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:23 crc kubenswrapper[5120]: I0316 16:43:23.847215 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-grxvr\" (UniqueName: \"kubernetes.io/projected/4c03814f-fda1-4a54-b9ca-89705d683547-kube-api-access-grxvr\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:23 crc kubenswrapper[5120]: I0316 16:43:23.847226 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/4c03814f-fda1-4a54-b9ca-89705d683547-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:23 crc kubenswrapper[5120]: I0316 16:43:23.847239 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/45e134ad-472e-4c91-8c2e-08a8b698847e-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:23 crc kubenswrapper[5120]: I0316 16:43:23.847251 5120 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/4c03814f-fda1-4a54-b9ca-89705d683547-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:23 crc kubenswrapper[5120]: I0316 16:43:23.847260 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4c03814f-fda1-4a54-b9ca-89705d683547-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:23 crc kubenswrapper[5120]: I0316 16:43:23.847268 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/45e134ad-472e-4c91-8c2e-08a8b698847e-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:23 crc kubenswrapper[5120]: I0316 16:43:23.847294 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") on node \"crc\" " Mar 16 16:43:23 crc kubenswrapper[5120]: I0316 16:43:23.847303 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t2hwh\" (UniqueName: \"kubernetes.io/projected/45e134ad-472e-4c91-8c2e-08a8b698847e-kube-api-access-t2hwh\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:23 crc kubenswrapper[5120]: I0316 16:43:23.847313 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kpkzx\" (UniqueName: \"kubernetes.io/projected/e8e5a741-9d1e-496c-85e7-3f2966cf0e68-kube-api-access-kpkzx\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:23 crc kubenswrapper[5120]: I0316 16:43:23.856313 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8e5a741-9d1e-496c-85e7-3f2966cf0e68-nova-novncproxy-tls-certs" (OuterVolumeSpecName: "nova-novncproxy-tls-certs") pod "e8e5a741-9d1e-496c-85e7-3f2966cf0e68" (UID: "e8e5a741-9d1e-496c-85e7-3f2966cf0e68"). InnerVolumeSpecName "nova-novncproxy-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:43:23 crc kubenswrapper[5120]: I0316 16:43:23.857609 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8e5a741-9d1e-496c-85e7-3f2966cf0e68-vencrypt-tls-certs" (OuterVolumeSpecName: "vencrypt-tls-certs") pod "e8e5a741-9d1e-496c-85e7-3f2966cf0e68" (UID: "e8e5a741-9d1e-496c-85e7-3f2966cf0e68"). InnerVolumeSpecName "vencrypt-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:43:23 crc kubenswrapper[5120]: I0316 16:43:23.859306 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45e134ad-472e-4c91-8c2e-08a8b698847e-galera-tls-certs" (OuterVolumeSpecName: "galera-tls-certs") pod "45e134ad-472e-4c91-8c2e-08a8b698847e" (UID: "45e134ad-472e-4c91-8c2e-08a8b698847e"). InnerVolumeSpecName "galera-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:43:23 crc kubenswrapper[5120]: I0316 16:43:23.865608 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8e5a741-9d1e-496c-85e7-3f2966cf0e68-config-data" (OuterVolumeSpecName: "config-data") pod "e8e5a741-9d1e-496c-85e7-3f2966cf0e68" (UID: "e8e5a741-9d1e-496c-85e7-3f2966cf0e68"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:43:23 crc kubenswrapper[5120]: I0316 16:43:23.882967 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c03814f-fda1-4a54-b9ca-89705d683547-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "4c03814f-fda1-4a54-b9ca-89705d683547" (UID: "4c03814f-fda1-4a54-b9ca-89705d683547"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:43:23 crc kubenswrapper[5120]: I0316 16:43:23.914942 5120 generic.go:358] "Generic (PLEG): container finished" podID="e8e5a741-9d1e-496c-85e7-3f2966cf0e68" containerID="2f0e2ea2afbd1d991add597e9e7e1845007742c0328e4bd20ed56b6b54be47ee" exitCode=0 Mar 16 16:43:23 crc kubenswrapper[5120]: I0316 16:43:23.915106 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"e8e5a741-9d1e-496c-85e7-3f2966cf0e68","Type":"ContainerDied","Data":"2f0e2ea2afbd1d991add597e9e7e1845007742c0328e4bd20ed56b6b54be47ee"} Mar 16 16:43:23 crc kubenswrapper[5120]: I0316 16:43:23.915175 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"e8e5a741-9d1e-496c-85e7-3f2966cf0e68","Type":"ContainerDied","Data":"5dffe7cd9311bbe46631f9727b23a6b976c55ee99d2a2e490e76bb96c25c762b"} Mar 16 16:43:23 crc kubenswrapper[5120]: I0316 16:43:23.915200 5120 scope.go:117] "RemoveContainer" containerID="2f0e2ea2afbd1d991add597e9e7e1845007742c0328e4bd20ed56b6b54be47ee" Mar 16 16:43:23 crc kubenswrapper[5120]: I0316 16:43:23.915212 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:43:23 crc kubenswrapper[5120]: I0316 16:43:23.917144 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-d38a-account-create-update-6jhs9" event={"ID":"93c4c8f7-726e-4f00-b007-7411cfba1a4c","Type":"ContainerStarted","Data":"8de422ee40add0a282226977e16ca56d32d11c8f82803b1079ef348dd75c69fe"} Mar 16 16:43:23 crc kubenswrapper[5120]: I0316 16:43:23.943608 5120 generic.go:358] "Generic (PLEG): container finished" podID="f734a4b4-4089-4b1e-9e09-3ebb426667bf" containerID="dcb341c888f7b3dd9705067eb687f5c5806a7664527b1fe8fa5b589077f4752b" exitCode=0 Mar 16 16:43:23 crc kubenswrapper[5120]: I0316 16:43:23.943682 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-htctf" event={"ID":"f734a4b4-4089-4b1e-9e09-3ebb426667bf","Type":"ContainerDied","Data":"dcb341c888f7b3dd9705067eb687f5c5806a7664527b1fe8fa5b589077f4752b"} Mar 16 16:43:23 crc kubenswrapper[5120]: I0316 16:43:23.943709 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-htctf" event={"ID":"f734a4b4-4089-4b1e-9e09-3ebb426667bf","Type":"ContainerStarted","Data":"51e82a5073663053e612240ca93a4f2a606afcf34f40585afa9f003eeae866b0"} Mar 16 16:43:23 crc kubenswrapper[5120]: I0316 16:43:23.949095 5120 reconciler_common.go:299] "Volume detached for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/e8e5a741-9d1e-496c-85e7-3f2966cf0e68-nova-novncproxy-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:23 crc kubenswrapper[5120]: I0316 16:43:23.949130 5120 reconciler_common.go:299] "Volume detached for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/45e134ad-472e-4c91-8c2e-08a8b698847e-galera-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:23 crc kubenswrapper[5120]: I0316 16:43:23.949139 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e8e5a741-9d1e-496c-85e7-3f2966cf0e68-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:23 crc kubenswrapper[5120]: I0316 16:43:23.949151 5120 reconciler_common.go:299] "Volume detached for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/e8e5a741-9d1e-496c-85e7-3f2966cf0e68-vencrypt-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:23 crc kubenswrapper[5120]: I0316 16:43:23.949161 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4c03814f-fda1-4a54-b9ca-89705d683547-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:23 crc kubenswrapper[5120]: I0316 16:43:23.952660 5120 generic.go:358] "Generic (PLEG): container finished" podID="c0f2211e-5c26-4865-b7dd-8799e5229862" containerID="6d480457ad64d0c74019dff9f3a62a4f5e3a431f4e1b0160808649591b0d97b9" exitCode=2 Mar 16 16:43:23 crc kubenswrapper[5120]: I0316 16:43:23.952824 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"c0f2211e-5c26-4865-b7dd-8799e5229862","Type":"ContainerDied","Data":"6d480457ad64d0c74019dff9f3a62a4f5e3a431f4e1b0160808649591b0d97b9"} Mar 16 16:43:23 crc kubenswrapper[5120]: I0316 16:43:23.953008 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"c0f2211e-5c26-4865-b7dd-8799e5229862","Type":"ContainerDied","Data":"fb495cfd769176967ca4deca8c746f862cabd631d540073e258c7513d8938113"} Mar 16 16:43:23 crc kubenswrapper[5120]: I0316 16:43:23.952866 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:43:23 crc kubenswrapper[5120]: I0316 16:43:23.977084 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c03814f-fda1-4a54-b9ca-89705d683547-config-data" (OuterVolumeSpecName: "config-data") pod "4c03814f-fda1-4a54-b9ca-89705d683547" (UID: "4c03814f-fda1-4a54-b9ca-89705d683547"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:43:23 crc kubenswrapper[5120]: I0316 16:43:23.978841 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage01-crc" (UniqueName: "kubernetes.io/local-volume/local-storage01-crc") on node "crc" Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.004979 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-85dfc87f54-wb22t" event={"ID":"8b100760-cd10-47f9-a43a-5ec03d37d1f0","Type":"ContainerDied","Data":"f0a30b36b3e2d65cc2aabd08dcd653261520ae7e42fabe02d636711e1772151f"} Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.005091 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-85dfc87f54-wb22t" Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.019749 5120 generic.go:358] "Generic (PLEG): container finished" podID="45e134ad-472e-4c91-8c2e-08a8b698847e" containerID="f2177105ac4d9674a3c981a2ee15da79c7b65aa682d513987168644107f465a1" exitCode=0 Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.020519 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"45e134ad-472e-4c91-8c2e-08a8b698847e","Type":"ContainerDied","Data":"f2177105ac4d9674a3c981a2ee15da79c7b65aa682d513987168644107f465a1"} Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.020547 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"45e134ad-472e-4c91-8c2e-08a8b698847e","Type":"ContainerDied","Data":"9fe905adacf61a3b2cdf9e807a88fc25891a441bb973061e7c68305b38e98561"} Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.020634 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.039515 5120 generic.go:358] "Generic (PLEG): container finished" podID="93b8115e-671f-4dff-96ec-a78e9ad5b022" containerID="3d14626b44ab5c3bc55202348681585545fb5d1a830cebe64d74628a5af82166" exitCode=0 Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.039818 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"93b8115e-671f-4dff-96ec-a78e9ad5b022","Type":"ContainerDied","Data":"3d14626b44ab5c3bc55202348681585545fb5d1a830cebe64d74628a5af82166"} Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.048014 5120 generic.go:358] "Generic (PLEG): container finished" podID="208d2d80-c39f-4984-bd83-13868306b946" containerID="73cb5da1aa4e0db6fc05d7ab18a073503756b66a6de287a0621f708490718f69" exitCode=0 Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.048062 5120 generic.go:358] "Generic (PLEG): container finished" podID="208d2d80-c39f-4984-bd83-13868306b946" containerID="10e209dfe1f9708e3d21b9b100a91d59bd982ee2a4aa40b2c08c2b1ccd44b1c0" exitCode=2 Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.048069 5120 generic.go:358] "Generic (PLEG): container finished" podID="208d2d80-c39f-4984-bd83-13868306b946" containerID="c58ce299fe1cdb3dcbe143284d5e0efe2c90efc37550b5f03322b2bea2cf9a71" exitCode=0 Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.048118 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"208d2d80-c39f-4984-bd83-13868306b946","Type":"ContainerDied","Data":"73cb5da1aa4e0db6fc05d7ab18a073503756b66a6de287a0621f708490718f69"} Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.048178 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"208d2d80-c39f-4984-bd83-13868306b946","Type":"ContainerDied","Data":"10e209dfe1f9708e3d21b9b100a91d59bd982ee2a4aa40b2c08c2b1ccd44b1c0"} Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.048191 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"208d2d80-c39f-4984-bd83-13868306b946","Type":"ContainerDied","Data":"c58ce299fe1cdb3dcbe143284d5e0efe2c90efc37550b5f03322b2bea2cf9a71"} Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.052750 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4c03814f-fda1-4a54-b9ca-89705d683547-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.052946 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.059112 5120 generic.go:358] "Generic (PLEG): container finished" podID="4c03814f-fda1-4a54-b9ca-89705d683547" containerID="9f2e17d1583f9443ae42dcdc1cbb9549f47015028e0072b4ca4caeed85ae311a" exitCode=0 Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.059269 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.059155 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"4c03814f-fda1-4a54-b9ca-89705d683547","Type":"ContainerDied","Data":"9f2e17d1583f9443ae42dcdc1cbb9549f47015028e0072b4ca4caeed85ae311a"} Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.060028 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"4c03814f-fda1-4a54-b9ca-89705d683547","Type":"ContainerDied","Data":"ba9bc22cd601a5e536c5dbc29862f9309dd08823ec7d0999bfee33d707b1d1bf"} Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.132212 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/rabbitmq-server-0" podUID="55a201e2-20da-49c3-8216-77a042dd3b31" containerName="rabbitmq" containerID="cri-o://724c0b5146b4e94ddc111cbeb4d390d8b4e39776e5bfd86f681203d76b6919bb" gracePeriod=604800 Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.177860 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.204791 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-proxy-85dfc87f54-wb22t"] Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.230724 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/swift-proxy-85dfc87f54-wb22t"] Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.232756 5120 scope.go:117] "RemoveContainer" containerID="2f0e2ea2afbd1d991add597e9e7e1845007742c0328e4bd20ed56b6b54be47ee" Mar 16 16:43:24 crc kubenswrapper[5120]: E0316 16:43:24.233370 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2f0e2ea2afbd1d991add597e9e7e1845007742c0328e4bd20ed56b6b54be47ee\": container with ID starting with 2f0e2ea2afbd1d991add597e9e7e1845007742c0328e4bd20ed56b6b54be47ee not found: ID does not exist" containerID="2f0e2ea2afbd1d991add597e9e7e1845007742c0328e4bd20ed56b6b54be47ee" Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.233402 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f0e2ea2afbd1d991add597e9e7e1845007742c0328e4bd20ed56b6b54be47ee"} err="failed to get container status \"2f0e2ea2afbd1d991add597e9e7e1845007742c0328e4bd20ed56b6b54be47ee\": rpc error: code = NotFound desc = could not find container \"2f0e2ea2afbd1d991add597e9e7e1845007742c0328e4bd20ed56b6b54be47ee\": container with ID starting with 2f0e2ea2afbd1d991add597e9e7e1845007742c0328e4bd20ed56b6b54be47ee not found: ID does not exist" Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.233431 5120 scope.go:117] "RemoveContainer" containerID="6d480457ad64d0c74019dff9f3a62a4f5e3a431f4e1b0160808649591b0d97b9" Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.257271 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.257502 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/93b8115e-671f-4dff-96ec-a78e9ad5b022-config-data\") pod \"93b8115e-671f-4dff-96ec-a78e9ad5b022\" (UID: \"93b8115e-671f-4dff-96ec-a78e9ad5b022\") " Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.257699 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/93b8115e-671f-4dff-96ec-a78e9ad5b022-combined-ca-bundle\") pod \"93b8115e-671f-4dff-96ec-a78e9ad5b022\" (UID: \"93b8115e-671f-4dff-96ec-a78e9ad5b022\") " Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.257963 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pmt8f\" (UniqueName: \"kubernetes.io/projected/93b8115e-671f-4dff-96ec-a78e9ad5b022-kube-api-access-pmt8f\") pod \"93b8115e-671f-4dff-96ec-a78e9ad5b022\" (UID: \"93b8115e-671f-4dff-96ec-a78e9ad5b022\") " Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.267422 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93b8115e-671f-4dff-96ec-a78e9ad5b022-kube-api-access-pmt8f" (OuterVolumeSpecName: "kube-api-access-pmt8f") pod "93b8115e-671f-4dff-96ec-a78e9ad5b022" (UID: "93b8115e-671f-4dff-96ec-a78e9ad5b022"). InnerVolumeSpecName "kube-api-access-pmt8f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.293349 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93b8115e-671f-4dff-96ec-a78e9ad5b022-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "93b8115e-671f-4dff-96ec-a78e9ad5b022" (UID: "93b8115e-671f-4dff-96ec-a78e9ad5b022"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.298464 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.322206 5120 scope.go:117] "RemoveContainer" containerID="6d480457ad64d0c74019dff9f3a62a4f5e3a431f4e1b0160808649591b0d97b9" Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.322973 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 16:43:24 crc kubenswrapper[5120]: E0316 16:43:24.323102 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d480457ad64d0c74019dff9f3a62a4f5e3a431f4e1b0160808649591b0d97b9\": container with ID starting with 6d480457ad64d0c74019dff9f3a62a4f5e3a431f4e1b0160808649591b0d97b9 not found: ID does not exist" containerID="6d480457ad64d0c74019dff9f3a62a4f5e3a431f4e1b0160808649591b0d97b9" Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.323134 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d480457ad64d0c74019dff9f3a62a4f5e3a431f4e1b0160808649591b0d97b9"} err="failed to get container status \"6d480457ad64d0c74019dff9f3a62a4f5e3a431f4e1b0160808649591b0d97b9\": rpc error: code = NotFound desc = could not find container \"6d480457ad64d0c74019dff9f3a62a4f5e3a431f4e1b0160808649591b0d97b9\": container with ID starting with 6d480457ad64d0c74019dff9f3a62a4f5e3a431f4e1b0160808649591b0d97b9 not found: ID does not exist" Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.323151 5120 scope.go:117] "RemoveContainer" containerID="282f23ab5ef97d358995d576d4ee6905b00545215df4cf40077d61084f39584a" Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.331413 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93b8115e-671f-4dff-96ec-a78e9ad5b022-config-data" (OuterVolumeSpecName: "config-data") pod "93b8115e-671f-4dff-96ec-a78e9ad5b022" (UID: "93b8115e-671f-4dff-96ec-a78e9ad5b022"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.339755 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.353596 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.361818 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/93b8115e-671f-4dff-96ec-a78e9ad5b022-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.361857 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/93b8115e-671f-4dff-96ec-a78e9ad5b022-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.361869 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pmt8f\" (UniqueName: \"kubernetes.io/projected/93b8115e-671f-4dff-96ec-a78e9ad5b022-kube-api-access-pmt8f\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.384972 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-d38a-account-create-update-6jhs9" Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.391052 5120 scope.go:117] "RemoveContainer" containerID="edb00ca08ced509f776a6894383f6a1f894be3511cfd7b8aa96b49bebe445287" Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.408195 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.415058 5120 scope.go:117] "RemoveContainer" containerID="f2177105ac4d9674a3c981a2ee15da79c7b65aa682d513987168644107f465a1" Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.444336 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.463020 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6pgbx\" (UniqueName: \"kubernetes.io/projected/93c4c8f7-726e-4f00-b007-7411cfba1a4c-kube-api-access-6pgbx\") pod \"93c4c8f7-726e-4f00-b007-7411cfba1a4c\" (UID: \"93c4c8f7-726e-4f00-b007-7411cfba1a4c\") " Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.463145 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/93c4c8f7-726e-4f00-b007-7411cfba1a4c-operator-scripts\") pod \"93c4c8f7-726e-4f00-b007-7411cfba1a4c\" (UID: \"93c4c8f7-726e-4f00-b007-7411cfba1a4c\") " Mar 16 16:43:24 crc kubenswrapper[5120]: E0316 16:43:24.464391 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 16:43:24 crc kubenswrapper[5120]: E0316 16:43:24.464528 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/285f9896-1a25-4942-96e7-06cff0c87338-combined-ca-bundle podName:285f9896-1a25-4942-96e7-06cff0c87338 nodeName:}" failed. No retries permitted until 2026-03-16 16:43:28.464508791 +0000 UTC m=+4310.618440448 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/285f9896-1a25-4942-96e7-06cff0c87338-combined-ca-bundle") pod "placement-6d66dbd7f8-6ld6p" (UID: "285f9896-1a25-4942-96e7-06cff0c87338") : secret "combined-ca-bundle" not found Mar 16 16:43:24 crc kubenswrapper[5120]: E0316 16:43:24.465443 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-placement-public-svc: secret "cert-placement-public-svc" not found Mar 16 16:43:24 crc kubenswrapper[5120]: E0316 16:43:24.465519 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/285f9896-1a25-4942-96e7-06cff0c87338-public-tls-certs podName:285f9896-1a25-4942-96e7-06cff0c87338 nodeName:}" failed. No retries permitted until 2026-03-16 16:43:28.465500278 +0000 UTC m=+4310.619431925 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/285f9896-1a25-4942-96e7-06cff0c87338-public-tls-certs") pod "placement-6d66dbd7f8-6ld6p" (UID: "285f9896-1a25-4942-96e7-06cff0c87338") : secret "cert-placement-public-svc" not found Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.465921 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/93c4c8f7-726e-4f00-b007-7411cfba1a4c-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "93c4c8f7-726e-4f00-b007-7411cfba1a4c" (UID: "93c4c8f7-726e-4f00-b007-7411cfba1a4c"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:43:24 crc kubenswrapper[5120]: E0316 16:43:24.465977 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-cell1-scripts: configmap "openstack-cell1-scripts" not found Mar 16 16:43:24 crc kubenswrapper[5120]: E0316 16:43:24.466004 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ad545a3f-12c8-4905-a7fe-2bc4cbfbf09e-operator-scripts podName:ad545a3f-12c8-4905-a7fe-2bc4cbfbf09e nodeName:}" failed. No retries permitted until 2026-03-16 16:43:26.465996662 +0000 UTC m=+4308.619928419 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/ad545a3f-12c8-4905-a7fe-2bc4cbfbf09e-operator-scripts") pod "root-account-create-update-cgjmv" (UID: "ad545a3f-12c8-4905-a7fe-2bc4cbfbf09e") : configmap "openstack-cell1-scripts" not found Mar 16 16:43:24 crc kubenswrapper[5120]: E0316 16:43:24.466054 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/placement-config-data: secret "placement-config-data" not found Mar 16 16:43:24 crc kubenswrapper[5120]: E0316 16:43:24.466076 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/285f9896-1a25-4942-96e7-06cff0c87338-config-data podName:285f9896-1a25-4942-96e7-06cff0c87338 nodeName:}" failed. No retries permitted until 2026-03-16 16:43:28.466069083 +0000 UTC m=+4310.620000740 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/secret/285f9896-1a25-4942-96e7-06cff0c87338-config-data") pod "placement-6d66dbd7f8-6ld6p" (UID: "285f9896-1a25-4942-96e7-06cff0c87338") : secret "placement-config-data" not found Mar 16 16:43:24 crc kubenswrapper[5120]: E0316 16:43:24.466107 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-placement-internal-svc: secret "cert-placement-internal-svc" not found Mar 16 16:43:24 crc kubenswrapper[5120]: E0316 16:43:24.466135 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/285f9896-1a25-4942-96e7-06cff0c87338-internal-tls-certs podName:285f9896-1a25-4942-96e7-06cff0c87338 nodeName:}" failed. No retries permitted until 2026-03-16 16:43:28.466129045 +0000 UTC m=+4310.620060702 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/285f9896-1a25-4942-96e7-06cff0c87338-internal-tls-certs") pod "placement-6d66dbd7f8-6ld6p" (UID: "285f9896-1a25-4942-96e7-06cff0c87338") : secret "cert-placement-internal-svc" not found Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.471120 5120 scope.go:117] "RemoveContainer" containerID="c2b641ed5eca0acc5244842068bc4f80b1a80bd57437f44d60aa301d0ab6ef37" Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.471620 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93c4c8f7-726e-4f00-b007-7411cfba1a4c-kube-api-access-6pgbx" (OuterVolumeSpecName: "kube-api-access-6pgbx") pod "93c4c8f7-726e-4f00-b007-7411cfba1a4c" (UID: "93c4c8f7-726e-4f00-b007-7411cfba1a4c"). InnerVolumeSpecName "kube-api-access-6pgbx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.471717 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.546611 5120 scope.go:117] "RemoveContainer" containerID="f2177105ac4d9674a3c981a2ee15da79c7b65aa682d513987168644107f465a1" Mar 16 16:43:24 crc kubenswrapper[5120]: E0316 16:43:24.551389 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f2177105ac4d9674a3c981a2ee15da79c7b65aa682d513987168644107f465a1\": container with ID starting with f2177105ac4d9674a3c981a2ee15da79c7b65aa682d513987168644107f465a1 not found: ID does not exist" containerID="f2177105ac4d9674a3c981a2ee15da79c7b65aa682d513987168644107f465a1" Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.551437 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2177105ac4d9674a3c981a2ee15da79c7b65aa682d513987168644107f465a1"} err="failed to get container status \"f2177105ac4d9674a3c981a2ee15da79c7b65aa682d513987168644107f465a1\": rpc error: code = NotFound desc = could not find container \"f2177105ac4d9674a3c981a2ee15da79c7b65aa682d513987168644107f465a1\": container with ID starting with f2177105ac4d9674a3c981a2ee15da79c7b65aa682d513987168644107f465a1 not found: ID does not exist" Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.551463 5120 scope.go:117] "RemoveContainer" containerID="c2b641ed5eca0acc5244842068bc4f80b1a80bd57437f44d60aa301d0ab6ef37" Mar 16 16:43:24 crc kubenswrapper[5120]: E0316 16:43:24.553431 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c2b641ed5eca0acc5244842068bc4f80b1a80bd57437f44d60aa301d0ab6ef37\": container with ID starting with c2b641ed5eca0acc5244842068bc4f80b1a80bd57437f44d60aa301d0ab6ef37 not found: ID does not exist" containerID="c2b641ed5eca0acc5244842068bc4f80b1a80bd57437f44d60aa301d0ab6ef37" Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.553467 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2b641ed5eca0acc5244842068bc4f80b1a80bd57437f44d60aa301d0ab6ef37"} err="failed to get container status \"c2b641ed5eca0acc5244842068bc4f80b1a80bd57437f44d60aa301d0ab6ef37\": rpc error: code = NotFound desc = could not find container \"c2b641ed5eca0acc5244842068bc4f80b1a80bd57437f44d60aa301d0ab6ef37\": container with ID starting with c2b641ed5eca0acc5244842068bc4f80b1a80bd57437f44d60aa301d0ab6ef37 not found: ID does not exist" Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.553483 5120 scope.go:117] "RemoveContainer" containerID="3119e5ce532c5e339071de9ff3c4fe23636cf19a24818b601368555dfb49f204" Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.555189 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.555405 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/memcached-0" podUID="70745ff2-698e-465f-b638-2f88c5f0a8c1" containerName="memcached" containerID="cri-o://277da739fad21f693bcceb96c5d27dab575e4421464263f28ff1d98df95a9af5" gracePeriod=30 Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.567797 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6pgbx\" (UniqueName: \"kubernetes.io/projected/93c4c8f7-726e-4f00-b007-7411cfba1a4c-kube-api-access-6pgbx\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.567827 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/93c4c8f7-726e-4f00-b007-7411cfba1a4c-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:24 crc kubenswrapper[5120]: E0316 16:43:24.567898 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-config-data: configmap "rabbitmq-config-data" not found Mar 16 16:43:24 crc kubenswrapper[5120]: E0316 16:43:24.567947 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/55a201e2-20da-49c3-8216-77a042dd3b31-config-data podName:55a201e2-20da-49c3-8216-77a042dd3b31 nodeName:}" failed. No retries permitted until 2026-03-16 16:43:26.567934158 +0000 UTC m=+4308.721865815 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/55a201e2-20da-49c3-8216-77a042dd3b31-config-data") pod "rabbitmq-server-0" (UID: "55a201e2-20da-49c3-8216-77a042dd3b31") : configmap "rabbitmq-config-data" not found Mar 16 16:43:24 crc kubenswrapper[5120]: E0316 16:43:24.568227 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/placement-scripts: secret "placement-scripts" not found Mar 16 16:43:24 crc kubenswrapper[5120]: E0316 16:43:24.568254 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/285f9896-1a25-4942-96e7-06cff0c87338-scripts podName:285f9896-1a25-4942-96e7-06cff0c87338 nodeName:}" failed. No retries permitted until 2026-03-16 16:43:28.568247327 +0000 UTC m=+4310.722178984 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "scripts" (UniqueName: "kubernetes.io/secret/285f9896-1a25-4942-96e7-06cff0c87338-scripts") pod "placement-6d66dbd7f8-6ld6p" (UID: "285f9896-1a25-4942-96e7-06cff0c87338") : secret "placement-scripts" not found Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.575352 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-454d-account-create-update-rqbdt"] Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.593590 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-454d-account-create-update-rqbdt"] Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.617376 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/root-account-create-update-6zc78"] Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.618928 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c03814f-fda1-4a54-b9ca-89705d683547" containerName="cinder-scheduler" Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.618951 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c03814f-fda1-4a54-b9ca-89705d683547" containerName="cinder-scheduler" Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.618964 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10cdd157-8ffd-4a86-9dba-ac570a45273b" containerName="ovsdbserver-sb" Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.618970 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="10cdd157-8ffd-4a86-9dba-ac570a45273b" containerName="ovsdbserver-sb" Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.618982 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45e134ad-472e-4c91-8c2e-08a8b698847e" containerName="galera" Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.618987 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="45e134ad-472e-4c91-8c2e-08a8b698847e" containerName="galera" Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.618997 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d23b8a0-3a5f-4bb9-84a7-f5602e4a98b0" containerName="openstack-network-exporter" Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.619002 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d23b8a0-3a5f-4bb9-84a7-f5602e4a98b0" containerName="openstack-network-exporter" Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.619011 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d23b8a0-3a5f-4bb9-84a7-f5602e4a98b0" containerName="ovsdbserver-nb" Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.619017 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d23b8a0-3a5f-4bb9-84a7-f5602e4a98b0" containerName="ovsdbserver-nb" Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.619047 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c03814f-fda1-4a54-b9ca-89705d683547" containerName="probe" Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.619054 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c03814f-fda1-4a54-b9ca-89705d683547" containerName="probe" Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.619064 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b100760-cd10-47f9-a43a-5ec03d37d1f0" containerName="proxy-httpd" Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.619071 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b100760-cd10-47f9-a43a-5ec03d37d1f0" containerName="proxy-httpd" Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.619092 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b100760-cd10-47f9-a43a-5ec03d37d1f0" containerName="proxy-server" Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.619100 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b100760-cd10-47f9-a43a-5ec03d37d1f0" containerName="proxy-server" Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.619112 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8e5a741-9d1e-496c-85e7-3f2966cf0e68" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.619119 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8e5a741-9d1e-496c-85e7-3f2966cf0e68" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.619149 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10cdd157-8ffd-4a86-9dba-ac570a45273b" containerName="openstack-network-exporter" Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.619157 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="10cdd157-8ffd-4a86-9dba-ac570a45273b" containerName="openstack-network-exporter" Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.619169 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0f2211e-5c26-4865-b7dd-8799e5229862" containerName="kube-state-metrics" Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.619175 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0f2211e-5c26-4865-b7dd-8799e5229862" containerName="kube-state-metrics" Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.619186 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93b8115e-671f-4dff-96ec-a78e9ad5b022" containerName="nova-scheduler-scheduler" Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.619194 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="93b8115e-671f-4dff-96ec-a78e9ad5b022" containerName="nova-scheduler-scheduler" Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.619211 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45e134ad-472e-4c91-8c2e-08a8b698847e" containerName="mysql-bootstrap" Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.619218 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="45e134ad-472e-4c91-8c2e-08a8b698847e" containerName="mysql-bootstrap" Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.619404 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="9d23b8a0-3a5f-4bb9-84a7-f5602e4a98b0" containerName="ovsdbserver-nb" Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.619424 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="93b8115e-671f-4dff-96ec-a78e9ad5b022" containerName="nova-scheduler-scheduler" Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.619438 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="8b100760-cd10-47f9-a43a-5ec03d37d1f0" containerName="proxy-server" Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.619447 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e8e5a741-9d1e-496c-85e7-3f2966cf0e68" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.619459 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="8b100760-cd10-47f9-a43a-5ec03d37d1f0" containerName="proxy-httpd" Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.619470 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="9d23b8a0-3a5f-4bb9-84a7-f5602e4a98b0" containerName="openstack-network-exporter" Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.619484 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="45e134ad-472e-4c91-8c2e-08a8b698847e" containerName="galera" Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.619500 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="4c03814f-fda1-4a54-b9ca-89705d683547" containerName="probe" Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.619512 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="10cdd157-8ffd-4a86-9dba-ac570a45273b" containerName="ovsdbserver-sb" Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.627811 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="4c03814f-fda1-4a54-b9ca-89705d683547" containerName="cinder-scheduler" Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.627863 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="10cdd157-8ffd-4a86-9dba-ac570a45273b" containerName="openstack-network-exporter" Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.627888 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c0f2211e-5c26-4865-b7dd-8799e5229862" containerName="kube-state-metrics" Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.642827 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-6zc78" Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.648119 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-6zc78"] Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.651095 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/rabbitmq-server-0" podUID="55a201e2-20da-49c3-8216-77a042dd3b31" containerName="rabbitmq" probeResult="failure" output="dial tcp 10.217.1.6:5671: connect: connection refused" Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.651840 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"openstack-mariadb-root-db-secret\"" Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.684984 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9d1b0d93-485c-4d8a-aff8-21f87e9fb078-operator-scripts\") pod \"root-account-create-update-6zc78\" (UID: \"9d1b0d93-485c-4d8a-aff8-21f87e9fb078\") " pod="openstack-kuttl-tests/root-account-create-update-6zc78" Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.685434 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f95nn\" (UniqueName: \"kubernetes.io/projected/9d1b0d93-485c-4d8a-aff8-21f87e9fb078-kube-api-access-f95nn\") pod \"root-account-create-update-6zc78\" (UID: \"9d1b0d93-485c-4d8a-aff8-21f87e9fb078\") " pod="openstack-kuttl-tests/root-account-create-update-6zc78" Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.732948 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="10cdd157-8ffd-4a86-9dba-ac570a45273b" path="/var/lib/kubelet/pods/10cdd157-8ffd-4a86-9dba-ac570a45273b/volumes" Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.739941 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2abd03fd-0270-463a-a9ca-95c22226e8ec" path="/var/lib/kubelet/pods/2abd03fd-0270-463a-a9ca-95c22226e8ec/volumes" Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.742843 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="45e134ad-472e-4c91-8c2e-08a8b698847e" path="/var/lib/kubelet/pods/45e134ad-472e-4c91-8c2e-08a8b698847e/volumes" Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.746831 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c03814f-fda1-4a54-b9ca-89705d683547" path="/var/lib/kubelet/pods/4c03814f-fda1-4a54-b9ca-89705d683547/volumes" Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.747461 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8b100760-cd10-47f9-a43a-5ec03d37d1f0" path="/var/lib/kubelet/pods/8b100760-cd10-47f9-a43a-5ec03d37d1f0/volumes" Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.748964 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9d23b8a0-3a5f-4bb9-84a7-f5602e4a98b0" path="/var/lib/kubelet/pods/9d23b8a0-3a5f-4bb9-84a7-f5602e4a98b0/volumes" Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.749552 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c0f2211e-5c26-4865-b7dd-8799e5229862" path="/var/lib/kubelet/pods/c0f2211e-5c26-4865-b7dd-8799e5229862/volumes" Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.750096 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e8e5a741-9d1e-496c-85e7-3f2966cf0e68" path="/var/lib/kubelet/pods/e8e5a741-9d1e-496c-85e7-3f2966cf0e68/volumes" Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.758978 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-454d-account-create-update-l7szq"] Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.769892 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-454d-account-create-update-l7szq"] Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.769922 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-2fk7p"] Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.769934 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-2fk7p"] Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.769951 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-p2zn5"] Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.769961 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-p2zn5"] Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.770068 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-454d-account-create-update-l7szq" Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.775418 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-db-secret\"" Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.777245 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/placement-6d66dbd7f8-6ld6p" podUID="285f9896-1a25-4942-96e7-06cff0c87338" containerName="placement-api" probeResult="failure" output="Get \"https://10.217.1.67:8778/\": read tcp 10.217.0.2:52110->10.217.1.67:8778: read: connection reset by peer" Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.777904 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-74449f99d8-kxw96"] Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.778167 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/keystone-74449f99d8-kxw96" podUID="c5223e38-12b9-4877-9a14-585ddcd5f699" containerName="keystone-api" containerID="cri-o://55c1a4c9a3f03915d38301396988693dd2d55bb4144258171015d74cd76e83e2" gracePeriod=30 Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.787939 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9d1b0d93-485c-4d8a-aff8-21f87e9fb078-operator-scripts\") pod \"root-account-create-update-6zc78\" (UID: \"9d1b0d93-485c-4d8a-aff8-21f87e9fb078\") " pod="openstack-kuttl-tests/root-account-create-update-6zc78" Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.788166 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f95nn\" (UniqueName: \"kubernetes.io/projected/9d1b0d93-485c-4d8a-aff8-21f87e9fb078-kube-api-access-f95nn\") pod \"root-account-create-update-6zc78\" (UID: \"9d1b0d93-485c-4d8a-aff8-21f87e9fb078\") " pod="openstack-kuttl-tests/root-account-create-update-6zc78" Mar 16 16:43:24 crc kubenswrapper[5120]: E0316 16:43:24.788902 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Mar 16 16:43:24 crc kubenswrapper[5120]: E0316 16:43:24.788952 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9d1b0d93-485c-4d8a-aff8-21f87e9fb078-operator-scripts podName:9d1b0d93-485c-4d8a-aff8-21f87e9fb078 nodeName:}" failed. No retries permitted until 2026-03-16 16:43:25.288937097 +0000 UTC m=+4307.442868754 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/9d1b0d93-485c-4d8a-aff8-21f87e9fb078-operator-scripts") pod "root-account-create-update-6zc78" (UID: "9d1b0d93-485c-4d8a-aff8-21f87e9fb078") : configmap "openstack-scripts" not found Mar 16 16:43:24 crc kubenswrapper[5120]: E0316 16:43:24.805142 5120 projected.go:194] Error preparing data for projected volume kube-api-access-f95nn for pod openstack-kuttl-tests/root-account-create-update-6zc78: failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 16:43:24 crc kubenswrapper[5120]: E0316 16:43:24.805229 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9d1b0d93-485c-4d8a-aff8-21f87e9fb078-kube-api-access-f95nn podName:9d1b0d93-485c-4d8a-aff8-21f87e9fb078 nodeName:}" failed. No retries permitted until 2026-03-16 16:43:25.305193977 +0000 UTC m=+4307.459125634 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-f95nn" (UniqueName: "kubernetes.io/projected/9d1b0d93-485c-4d8a-aff8-21f87e9fb078-kube-api-access-f95nn") pod "root-account-create-update-6zc78" (UID: "9d1b0d93-485c-4d8a-aff8-21f87e9fb078") : failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.814881 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.845979 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-db-create-rv5rl"] Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.848493 5120 scope.go:117] "RemoveContainer" containerID="9f2e17d1583f9443ae42dcdc1cbb9549f47015028e0072b4ca4caeed85ae311a" Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.849071 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-db-create-rv5rl"] Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.892592 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sl7w4\" (UniqueName: \"kubernetes.io/projected/86555a03-238a-4f27-a960-f86bd355bb5c-kube-api-access-sl7w4\") pod \"keystone-454d-account-create-update-l7szq\" (UID: \"86555a03-238a-4f27-a960-f86bd355bb5c\") " pod="openstack-kuttl-tests/keystone-454d-account-create-update-l7szq" Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.892686 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/86555a03-238a-4f27-a960-f86bd355bb5c-operator-scripts\") pod \"keystone-454d-account-create-update-l7szq\" (UID: \"86555a03-238a-4f27-a960-f86bd355bb5c\") " pod="openstack-kuttl-tests/keystone-454d-account-create-update-l7szq" Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.966956 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-454d-account-create-update-l7szq"] Mar 16 16:43:24 crc kubenswrapper[5120]: E0316 16:43:24.993633 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-sl7w4 operator-scripts], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openstack-kuttl-tests/keystone-454d-account-create-update-l7szq" podUID="86555a03-238a-4f27-a960-f86bd355bb5c" Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.995065 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sl7w4\" (UniqueName: \"kubernetes.io/projected/86555a03-238a-4f27-a960-f86bd355bb5c-kube-api-access-sl7w4\") pod \"keystone-454d-account-create-update-l7szq\" (UID: \"86555a03-238a-4f27-a960-f86bd355bb5c\") " pod="openstack-kuttl-tests/keystone-454d-account-create-update-l7szq" Mar 16 16:43:24 crc kubenswrapper[5120]: I0316 16:43:24.995150 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/86555a03-238a-4f27-a960-f86bd355bb5c-operator-scripts\") pod \"keystone-454d-account-create-update-l7szq\" (UID: \"86555a03-238a-4f27-a960-f86bd355bb5c\") " pod="openstack-kuttl-tests/keystone-454d-account-create-update-l7szq" Mar 16 16:43:24 crc kubenswrapper[5120]: E0316 16:43:24.996446 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Mar 16 16:43:24 crc kubenswrapper[5120]: E0316 16:43:24.996557 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/86555a03-238a-4f27-a960-f86bd355bb5c-operator-scripts podName:86555a03-238a-4f27-a960-f86bd355bb5c nodeName:}" failed. No retries permitted until 2026-03-16 16:43:25.496532061 +0000 UTC m=+4307.650463718 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/86555a03-238a-4f27-a960-f86bd355bb5c-operator-scripts") pod "keystone-454d-account-create-update-l7szq" (UID: "86555a03-238a-4f27-a960-f86bd355bb5c") : configmap "openstack-scripts" not found Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.002127 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/cinder-api-0" podUID="08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e" containerName="cinder-api" probeResult="failure" output="Get \"https://10.217.1.59:8776/healthcheck\": read tcp 10.217.0.2:57646->10.217.1.59:8776: read: connection reset by peer" Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.002194 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-f4eb-account-create-update-4wnlc" Mar 16 16:43:25 crc kubenswrapper[5120]: E0316 16:43:25.002324 5120 projected.go:194] Error preparing data for projected volume kube-api-access-sl7w4 for pod openstack-kuttl-tests/keystone-454d-account-create-update-l7szq: failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 16:43:25 crc kubenswrapper[5120]: E0316 16:43:25.002406 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/86555a03-238a-4f27-a960-f86bd355bb5c-kube-api-access-sl7w4 podName:86555a03-238a-4f27-a960-f86bd355bb5c nodeName:}" failed. No retries permitted until 2026-03-16 16:43:25.502385139 +0000 UTC m=+4307.656316796 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-sl7w4" (UniqueName: "kubernetes.io/projected/86555a03-238a-4f27-a960-f86bd355bb5c-kube-api-access-sl7w4") pod "keystone-454d-account-create-update-l7szq" (UID: "86555a03-238a-4f27-a960-f86bd355bb5c") : failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.021002 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-6zc78"] Mar 16 16:43:25 crc kubenswrapper[5120]: E0316 16:43:25.021894 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-f95nn operator-scripts], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openstack-kuttl-tests/root-account-create-update-6zc78" podUID="9d1b0d93-485c-4d8a-aff8-21f87e9fb078" Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.022960 5120 scope.go:117] "RemoveContainer" containerID="3119e5ce532c5e339071de9ff3c4fe23636cf19a24818b601368555dfb49f204" Mar 16 16:43:25 crc kubenswrapper[5120]: E0316 16:43:25.023381 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3119e5ce532c5e339071de9ff3c4fe23636cf19a24818b601368555dfb49f204\": container with ID starting with 3119e5ce532c5e339071de9ff3c4fe23636cf19a24818b601368555dfb49f204 not found: ID does not exist" containerID="3119e5ce532c5e339071de9ff3c4fe23636cf19a24818b601368555dfb49f204" Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.023436 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3119e5ce532c5e339071de9ff3c4fe23636cf19a24818b601368555dfb49f204"} err="failed to get container status \"3119e5ce532c5e339071de9ff3c4fe23636cf19a24818b601368555dfb49f204\": rpc error: code = NotFound desc = could not find container \"3119e5ce532c5e339071de9ff3c4fe23636cf19a24818b601368555dfb49f204\": container with ID starting with 3119e5ce532c5e339071de9ff3c4fe23636cf19a24818b601368555dfb49f204 not found: ID does not exist" Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.023471 5120 scope.go:117] "RemoveContainer" containerID="9f2e17d1583f9443ae42dcdc1cbb9549f47015028e0072b4ca4caeed85ae311a" Mar 16 16:43:25 crc kubenswrapper[5120]: E0316 16:43:25.023822 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f2e17d1583f9443ae42dcdc1cbb9549f47015028e0072b4ca4caeed85ae311a\": container with ID starting with 9f2e17d1583f9443ae42dcdc1cbb9549f47015028e0072b4ca4caeed85ae311a not found: ID does not exist" containerID="9f2e17d1583f9443ae42dcdc1cbb9549f47015028e0072b4ca4caeed85ae311a" Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.023855 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f2e17d1583f9443ae42dcdc1cbb9549f47015028e0072b4ca4caeed85ae311a"} err="failed to get container status \"9f2e17d1583f9443ae42dcdc1cbb9549f47015028e0072b4ca4caeed85ae311a\": rpc error: code = NotFound desc = could not find container \"9f2e17d1583f9443ae42dcdc1cbb9549f47015028e0072b4ca4caeed85ae311a\": container with ID starting with 9f2e17d1583f9443ae42dcdc1cbb9549f47015028e0072b4ca4caeed85ae311a not found: ID does not exist" Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.064576 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/openstack-galera-0" podUID="8865ef1d-984f-4076-b151-fff5f7da9e62" containerName="galera" containerID="cri-o://335ad75ad4c6e5c7aa60997975d2eea33d69f48a65c3ff6fe6f276f5e804978f" gracePeriod=30 Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.069658 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-e32b-account-create-update-xn2hk" event={"ID":"908660b0-e07b-45ab-92c8-1e466ddc0906","Type":"ContainerDied","Data":"21635e924967b6837eae4dee171b1c59159bd0113b4099d817f9f49e62f9dfd1"} Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.069702 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="21635e924967b6837eae4dee171b1c59159bd0113b4099d817f9f49e62f9dfd1" Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.070627 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-a3c5-account-create-update-ndpvq" event={"ID":"37490319-0529-4ab4-a97a-3dc9486aa867","Type":"ContainerDied","Data":"73b95aacc0fb94af36e4a8f4ed741b9010f26cffd0848f09630fbe55ae89862f"} Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.070654 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="73b95aacc0fb94af36e4a8f4ed741b9010f26cffd0848f09630fbe55ae89862f" Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.075808 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-htctf" event={"ID":"f734a4b4-4089-4b1e-9e09-3ebb426667bf","Type":"ContainerStarted","Data":"aeea82b0bb6261dbfad8929e406fae0c2aa02bacb16dd00a79c767d5fd26bc74"} Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.077283 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-htctf" Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.082016 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-f4eb-account-create-update-4wnlc" event={"ID":"69586194-14da-4bd2-ab2d-5b464625a1a5","Type":"ContainerDied","Data":"ad214f332fdaa6a66baa3d6a86a9877488cfb968d038c63ccc3a6caf99279dee"} Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.082111 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-f4eb-account-create-update-4wnlc" Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.091979 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-cgjmv" event={"ID":"ad545a3f-12c8-4905-a7fe-2bc4cbfbf09e","Type":"ContainerDied","Data":"b802907934b7f76c4538d4f6ee66e366ce514c23f2d63b2abce328705d7db459"} Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.092048 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b802907934b7f76c4538d4f6ee66e366ce514c23f2d63b2abce328705d7db459" Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.100308 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/69586194-14da-4bd2-ab2d-5b464625a1a5-operator-scripts\") pod \"69586194-14da-4bd2-ab2d-5b464625a1a5\" (UID: \"69586194-14da-4bd2-ab2d-5b464625a1a5\") " Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.100491 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pxxgl\" (UniqueName: \"kubernetes.io/projected/69586194-14da-4bd2-ab2d-5b464625a1a5-kube-api-access-pxxgl\") pod \"69586194-14da-4bd2-ab2d-5b464625a1a5\" (UID: \"69586194-14da-4bd2-ab2d-5b464625a1a5\") " Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.103055 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69586194-14da-4bd2-ab2d-5b464625a1a5-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "69586194-14da-4bd2-ab2d-5b464625a1a5" (UID: "69586194-14da-4bd2-ab2d-5b464625a1a5"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.106034 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-htctf" podStartSLOduration=5.106019252 podStartE2EDuration="5.106019252s" podCreationTimestamp="2026-03-16 16:43:20 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:43:25.096956106 +0000 UTC m=+4307.250887783" watchObservedRunningTime="2026-03-16 16:43:25.106019252 +0000 UTC m=+4307.259950909" Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.106804 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"93b8115e-671f-4dff-96ec-a78e9ad5b022","Type":"ContainerDied","Data":"f2c70a59c142937501e150a9d0c4a0983e2d5eb59de2a59bf389e35d8f43fe16"} Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.106867 5120 scope.go:117] "RemoveContainer" containerID="3d14626b44ab5c3bc55202348681585545fb5d1a830cebe64d74628a5af82166" Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.107023 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.117024 5120 generic.go:358] "Generic (PLEG): container finished" podID="285f9896-1a25-4942-96e7-06cff0c87338" containerID="ff35fcc66f01f4079bcdb316040d0ddf3ee4fd594afc5a2f5a31c4a635ef5041" exitCode=0 Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.117146 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-6d66dbd7f8-6ld6p" event={"ID":"285f9896-1a25-4942-96e7-06cff0c87338","Type":"ContainerDied","Data":"ff35fcc66f01f4079bcdb316040d0ddf3ee4fd594afc5a2f5a31c4a635ef5041"} Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.122483 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69586194-14da-4bd2-ab2d-5b464625a1a5-kube-api-access-pxxgl" (OuterVolumeSpecName: "kube-api-access-pxxgl") pod "69586194-14da-4bd2-ab2d-5b464625a1a5" (UID: "69586194-14da-4bd2-ab2d-5b464625a1a5"). InnerVolumeSpecName "kube-api-access-pxxgl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.123214 5120 generic.go:358] "Generic (PLEG): container finished" podID="ffbcbd91-454c-4998-9b12-69ed7f853328" containerID="6639e315af61023162c1fff62d7078f952718cb1641545fd6b502793501a8f4b" exitCode=0 Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.123418 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"ffbcbd91-454c-4998-9b12-69ed7f853328","Type":"ContainerDied","Data":"6639e315af61023162c1fff62d7078f952718cb1641545fd6b502793501a8f4b"} Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.141451 5120 generic.go:358] "Generic (PLEG): container finished" podID="be094b3e-494e-420d-b458-0e32770cd540" containerID="503b90090ae8a47de41498d2d43c08c9f18dfaaa22a4ca2e49962c58dcc9ae34" exitCode=0 Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.141614 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"be094b3e-494e-420d-b458-0e32770cd540","Type":"ContainerDied","Data":"503b90090ae8a47de41498d2d43c08c9f18dfaaa22a4ca2e49962c58dcc9ae34"} Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.181154 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-d38a-account-create-update-6jhs9" event={"ID":"93c4c8f7-726e-4f00-b007-7411cfba1a4c","Type":"ContainerDied","Data":"8de422ee40add0a282226977e16ca56d32d11c8f82803b1079ef348dd75c69fe"} Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.181275 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-d38a-account-create-update-6jhs9" Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.204517 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pxxgl\" (UniqueName: \"kubernetes.io/projected/69586194-14da-4bd2-ab2d-5b464625a1a5-kube-api-access-pxxgl\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.204544 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/69586194-14da-4bd2-ab2d-5b464625a1a5-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.220036 5120 generic.go:358] "Generic (PLEG): container finished" podID="08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e" containerID="261821a3adde73a3dc23cb22faac9f49d193b2649fe06010aa01954b846e70d4" exitCode=0 Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.220147 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-454d-account-create-update-l7szq" Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.220442 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e","Type":"ContainerDied","Data":"261821a3adde73a3dc23cb22faac9f49d193b2649fe06010aa01954b846e70d4"} Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.220561 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-6zc78" Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.260576 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-a3c5-account-create-update-ndpvq" Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.274032 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.287020 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.291075 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-cgjmv" Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.306371 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fcmgb\" (UniqueName: \"kubernetes.io/projected/37490319-0529-4ab4-a97a-3dc9486aa867-kube-api-access-fcmgb\") pod \"37490319-0529-4ab4-a97a-3dc9486aa867\" (UID: \"37490319-0529-4ab4-a97a-3dc9486aa867\") " Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.306747 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/37490319-0529-4ab4-a97a-3dc9486aa867-operator-scripts\") pod \"37490319-0529-4ab4-a97a-3dc9486aa867\" (UID: \"37490319-0529-4ab4-a97a-3dc9486aa867\") " Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.306952 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f95nn\" (UniqueName: \"kubernetes.io/projected/9d1b0d93-485c-4d8a-aff8-21f87e9fb078-kube-api-access-f95nn\") pod \"root-account-create-update-6zc78\" (UID: \"9d1b0d93-485c-4d8a-aff8-21f87e9fb078\") " pod="openstack-kuttl-tests/root-account-create-update-6zc78" Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.307213 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9d1b0d93-485c-4d8a-aff8-21f87e9fb078-operator-scripts\") pod \"root-account-create-update-6zc78\" (UID: \"9d1b0d93-485c-4d8a-aff8-21f87e9fb078\") " pod="openstack-kuttl-tests/root-account-create-update-6zc78" Mar 16 16:43:25 crc kubenswrapper[5120]: E0316 16:43:25.307423 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Mar 16 16:43:25 crc kubenswrapper[5120]: E0316 16:43:25.307475 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9d1b0d93-485c-4d8a-aff8-21f87e9fb078-operator-scripts podName:9d1b0d93-485c-4d8a-aff8-21f87e9fb078 nodeName:}" failed. No retries permitted until 2026-03-16 16:43:26.307460239 +0000 UTC m=+4308.461391896 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/9d1b0d93-485c-4d8a-aff8-21f87e9fb078-operator-scripts") pod "root-account-create-update-6zc78" (UID: "9d1b0d93-485c-4d8a-aff8-21f87e9fb078") : configmap "openstack-scripts" not found Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.308077 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37490319-0529-4ab4-a97a-3dc9486aa867-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "37490319-0529-4ab4-a97a-3dc9486aa867" (UID: "37490319-0529-4ab4-a97a-3dc9486aa867"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.308297 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-d38a-account-create-update-6jhs9"] Mar 16 16:43:25 crc kubenswrapper[5120]: E0316 16:43:25.311006 5120 projected.go:194] Error preparing data for projected volume kube-api-access-f95nn for pod openstack-kuttl-tests/root-account-create-update-6zc78: failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 16:43:25 crc kubenswrapper[5120]: E0316 16:43:25.311056 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9d1b0d93-485c-4d8a-aff8-21f87e9fb078-kube-api-access-f95nn podName:9d1b0d93-485c-4d8a-aff8-21f87e9fb078 nodeName:}" failed. No retries permitted until 2026-03-16 16:43:26.311045537 +0000 UTC m=+4308.464977184 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-f95nn" (UniqueName: "kubernetes.io/projected/9d1b0d93-485c-4d8a-aff8-21f87e9fb078-kube-api-access-f95nn") pod "root-account-create-update-6zc78" (UID: "9d1b0d93-485c-4d8a-aff8-21f87e9fb078") : failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.311938 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-d38a-account-create-update-6jhs9"] Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.328559 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37490319-0529-4ab4-a97a-3dc9486aa867-kube-api-access-fcmgb" (OuterVolumeSpecName: "kube-api-access-fcmgb") pod "37490319-0529-4ab4-a97a-3dc9486aa867" (UID: "37490319-0529-4ab4-a97a-3dc9486aa867"). InnerVolumeSpecName "kube-api-access-fcmgb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.411090 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xzl26\" (UniqueName: \"kubernetes.io/projected/ad545a3f-12c8-4905-a7fe-2bc4cbfbf09e-kube-api-access-xzl26\") pod \"ad545a3f-12c8-4905-a7fe-2bc4cbfbf09e\" (UID: \"ad545a3f-12c8-4905-a7fe-2bc4cbfbf09e\") " Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.411392 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ad545a3f-12c8-4905-a7fe-2bc4cbfbf09e-operator-scripts\") pod \"ad545a3f-12c8-4905-a7fe-2bc4cbfbf09e\" (UID: \"ad545a3f-12c8-4905-a7fe-2bc4cbfbf09e\") " Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.412707 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/37490319-0529-4ab4-a97a-3dc9486aa867-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.412740 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fcmgb\" (UniqueName: \"kubernetes.io/projected/37490319-0529-4ab4-a97a-3dc9486aa867-kube-api-access-fcmgb\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.413272 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ad545a3f-12c8-4905-a7fe-2bc4cbfbf09e-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "ad545a3f-12c8-4905-a7fe-2bc4cbfbf09e" (UID: "ad545a3f-12c8-4905-a7fe-2bc4cbfbf09e"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.423274 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad545a3f-12c8-4905-a7fe-2bc4cbfbf09e-kube-api-access-xzl26" (OuterVolumeSpecName: "kube-api-access-xzl26") pod "ad545a3f-12c8-4905-a7fe-2bc4cbfbf09e" (UID: "ad545a3f-12c8-4905-a7fe-2bc4cbfbf09e"). InnerVolumeSpecName "kube-api-access-xzl26". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.470475 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-6647785db4-lmftm" podUID="1518bfb1-3665-455c-84df-7c6eba7b93cf" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.1.58:9311/healthcheck\": read tcp 10.217.0.2:51582->10.217.1.58:9311: read: connection reset by peer" Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.515327 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sl7w4\" (UniqueName: \"kubernetes.io/projected/86555a03-238a-4f27-a960-f86bd355bb5c-kube-api-access-sl7w4\") pod \"keystone-454d-account-create-update-l7szq\" (UID: \"86555a03-238a-4f27-a960-f86bd355bb5c\") " pod="openstack-kuttl-tests/keystone-454d-account-create-update-l7szq" Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.515610 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/86555a03-238a-4f27-a960-f86bd355bb5c-operator-scripts\") pod \"keystone-454d-account-create-update-l7szq\" (UID: \"86555a03-238a-4f27-a960-f86bd355bb5c\") " pod="openstack-kuttl-tests/keystone-454d-account-create-update-l7szq" Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.515732 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ad545a3f-12c8-4905-a7fe-2bc4cbfbf09e-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.515748 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xzl26\" (UniqueName: \"kubernetes.io/projected/ad545a3f-12c8-4905-a7fe-2bc4cbfbf09e-kube-api-access-xzl26\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:25 crc kubenswrapper[5120]: E0316 16:43:25.515828 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Mar 16 16:43:25 crc kubenswrapper[5120]: E0316 16:43:25.515880 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/86555a03-238a-4f27-a960-f86bd355bb5c-operator-scripts podName:86555a03-238a-4f27-a960-f86bd355bb5c nodeName:}" failed. No retries permitted until 2026-03-16 16:43:26.515866336 +0000 UTC m=+4308.669797993 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/86555a03-238a-4f27-a960-f86bd355bb5c-operator-scripts") pod "keystone-454d-account-create-update-l7szq" (UID: "86555a03-238a-4f27-a960-f86bd355bb5c") : configmap "openstack-scripts" not found Mar 16 16:43:25 crc kubenswrapper[5120]: E0316 16:43:25.519111 5120 projected.go:194] Error preparing data for projected volume kube-api-access-sl7w4 for pod openstack-kuttl-tests/keystone-454d-account-create-update-l7szq: failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 16:43:25 crc kubenswrapper[5120]: E0316 16:43:25.519206 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/86555a03-238a-4f27-a960-f86bd355bb5c-kube-api-access-sl7w4 podName:86555a03-238a-4f27-a960-f86bd355bb5c nodeName:}" failed. No retries permitted until 2026-03-16 16:43:26.519184675 +0000 UTC m=+4308.673116442 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-sl7w4" (UniqueName: "kubernetes.io/projected/86555a03-238a-4f27-a960-f86bd355bb5c-kube-api-access-sl7w4") pod "keystone-454d-account-create-update-l7szq" (UID: "86555a03-238a-4f27-a960-f86bd355bb5c") : failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.547074 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-e32b-account-create-update-xn2hk" Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.551946 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-454d-account-create-update-l7szq" Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.567775 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-6zc78" Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.595718 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-f4eb-account-create-update-4wnlc"] Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.599459 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-6d66dbd7f8-6ld6p" Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.607367 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.608384 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-f4eb-account-create-update-4wnlc"] Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.617142 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/908660b0-e07b-45ab-92c8-1e466ddc0906-operator-scripts\") pod \"908660b0-e07b-45ab-92c8-1e466ddc0906\" (UID: \"908660b0-e07b-45ab-92c8-1e466ddc0906\") " Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.617487 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t7ljr\" (UniqueName: \"kubernetes.io/projected/908660b0-e07b-45ab-92c8-1e466ddc0906-kube-api-access-t7ljr\") pod \"908660b0-e07b-45ab-92c8-1e466ddc0906\" (UID: \"908660b0-e07b-45ab-92c8-1e466ddc0906\") " Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.620078 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/908660b0-e07b-45ab-92c8-1e466ddc0906-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "908660b0-e07b-45ab-92c8-1e466ddc0906" (UID: "908660b0-e07b-45ab-92c8-1e466ddc0906"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.627022 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.628171 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/908660b0-e07b-45ab-92c8-1e466ddc0906-kube-api-access-t7ljr" (OuterVolumeSpecName: "kube-api-access-t7ljr") pod "908660b0-e07b-45ab-92c8-1e466ddc0906" (UID: "908660b0-e07b-45ab-92c8-1e466ddc0906"). InnerVolumeSpecName "kube-api-access-t7ljr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.720525 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/be094b3e-494e-420d-b458-0e32770cd540-scripts\") pod \"be094b3e-494e-420d-b458-0e32770cd540\" (UID: \"be094b3e-494e-420d-b458-0e32770cd540\") " Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.720690 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/285f9896-1a25-4942-96e7-06cff0c87338-combined-ca-bundle\") pod \"285f9896-1a25-4942-96e7-06cff0c87338\" (UID: \"285f9896-1a25-4942-96e7-06cff0c87338\") " Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.720732 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/be094b3e-494e-420d-b458-0e32770cd540-logs\") pod \"be094b3e-494e-420d-b458-0e32770cd540\" (UID: \"be094b3e-494e-420d-b458-0e32770cd540\") " Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.720799 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/ffbcbd91-454c-4998-9b12-69ed7f853328-httpd-run\") pod \"ffbcbd91-454c-4998-9b12-69ed7f853328\" (UID: \"ffbcbd91-454c-4998-9b12-69ed7f853328\") " Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.720823 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ffbcbd91-454c-4998-9b12-69ed7f853328-config-data\") pod \"ffbcbd91-454c-4998-9b12-69ed7f853328\" (UID: \"ffbcbd91-454c-4998-9b12-69ed7f853328\") " Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.720862 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/be094b3e-494e-420d-b458-0e32770cd540-combined-ca-bundle\") pod \"be094b3e-494e-420d-b458-0e32770cd540\" (UID: \"be094b3e-494e-420d-b458-0e32770cd540\") " Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.720971 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/285f9896-1a25-4942-96e7-06cff0c87338-scripts\") pod \"285f9896-1a25-4942-96e7-06cff0c87338\" (UID: \"285f9896-1a25-4942-96e7-06cff0c87338\") " Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.721019 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vxfmf\" (UniqueName: \"kubernetes.io/projected/be094b3e-494e-420d-b458-0e32770cd540-kube-api-access-vxfmf\") pod \"be094b3e-494e-420d-b458-0e32770cd540\" (UID: \"be094b3e-494e-420d-b458-0e32770cd540\") " Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.721572 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ffbcbd91-454c-4998-9b12-69ed7f853328-logs\") pod \"ffbcbd91-454c-4998-9b12-69ed7f853328\" (UID: \"ffbcbd91-454c-4998-9b12-69ed7f853328\") " Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.721717 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"ffbcbd91-454c-4998-9b12-69ed7f853328\" (UID: \"ffbcbd91-454c-4998-9b12-69ed7f853328\") " Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.721747 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/285f9896-1a25-4942-96e7-06cff0c87338-internal-tls-certs\") pod \"285f9896-1a25-4942-96e7-06cff0c87338\" (UID: \"285f9896-1a25-4942-96e7-06cff0c87338\") " Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.721811 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/be094b3e-494e-420d-b458-0e32770cd540-config-data\") pod \"be094b3e-494e-420d-b458-0e32770cd540\" (UID: \"be094b3e-494e-420d-b458-0e32770cd540\") " Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.721864 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ffbcbd91-454c-4998-9b12-69ed7f853328-combined-ca-bundle\") pod \"ffbcbd91-454c-4998-9b12-69ed7f853328\" (UID: \"ffbcbd91-454c-4998-9b12-69ed7f853328\") " Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.721903 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/285f9896-1a25-4942-96e7-06cff0c87338-logs\") pod \"285f9896-1a25-4942-96e7-06cff0c87338\" (UID: \"285f9896-1a25-4942-96e7-06cff0c87338\") " Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.721959 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/be094b3e-494e-420d-b458-0e32770cd540-internal-tls-certs\") pod \"be094b3e-494e-420d-b458-0e32770cd540\" (UID: \"be094b3e-494e-420d-b458-0e32770cd540\") " Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.721992 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ffbcbd91-454c-4998-9b12-69ed7f853328-public-tls-certs\") pod \"ffbcbd91-454c-4998-9b12-69ed7f853328\" (UID: \"ffbcbd91-454c-4998-9b12-69ed7f853328\") " Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.722017 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/be094b3e-494e-420d-b458-0e32770cd540-httpd-run\") pod \"be094b3e-494e-420d-b458-0e32770cd540\" (UID: \"be094b3e-494e-420d-b458-0e32770cd540\") " Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.722235 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qr9cv\" (UniqueName: \"kubernetes.io/projected/285f9896-1a25-4942-96e7-06cff0c87338-kube-api-access-qr9cv\") pod \"285f9896-1a25-4942-96e7-06cff0c87338\" (UID: \"285f9896-1a25-4942-96e7-06cff0c87338\") " Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.722335 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/285f9896-1a25-4942-96e7-06cff0c87338-config-data\") pod \"285f9896-1a25-4942-96e7-06cff0c87338\" (UID: \"285f9896-1a25-4942-96e7-06cff0c87338\") " Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.722376 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ffbcbd91-454c-4998-9b12-69ed7f853328-scripts\") pod \"ffbcbd91-454c-4998-9b12-69ed7f853328\" (UID: \"ffbcbd91-454c-4998-9b12-69ed7f853328\") " Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.722880 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v6hxw\" (UniqueName: \"kubernetes.io/projected/ffbcbd91-454c-4998-9b12-69ed7f853328-kube-api-access-v6hxw\") pod \"ffbcbd91-454c-4998-9b12-69ed7f853328\" (UID: \"ffbcbd91-454c-4998-9b12-69ed7f853328\") " Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.722943 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/285f9896-1a25-4942-96e7-06cff0c87338-public-tls-certs\") pod \"285f9896-1a25-4942-96e7-06cff0c87338\" (UID: \"285f9896-1a25-4942-96e7-06cff0c87338\") " Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.723012 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"be094b3e-494e-420d-b458-0e32770cd540\" (UID: \"be094b3e-494e-420d-b458-0e32770cd540\") " Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.724166 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/908660b0-e07b-45ab-92c8-1e466ddc0906-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.724197 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t7ljr\" (UniqueName: \"kubernetes.io/projected/908660b0-e07b-45ab-92c8-1e466ddc0906-kube-api-access-t7ljr\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.724738 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be094b3e-494e-420d-b458-0e32770cd540-logs" (OuterVolumeSpecName: "logs") pod "be094b3e-494e-420d-b458-0e32770cd540" (UID: "be094b3e-494e-420d-b458-0e32770cd540"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.725364 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ffbcbd91-454c-4998-9b12-69ed7f853328-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "ffbcbd91-454c-4998-9b12-69ed7f853328" (UID: "ffbcbd91-454c-4998-9b12-69ed7f853328"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.726683 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be094b3e-494e-420d-b458-0e32770cd540-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "be094b3e-494e-420d-b458-0e32770cd540" (UID: "be094b3e-494e-420d-b458-0e32770cd540"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.730915 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage06-crc" (OuterVolumeSpecName: "glance") pod "be094b3e-494e-420d-b458-0e32770cd540" (UID: "be094b3e-494e-420d-b458-0e32770cd540"). InnerVolumeSpecName "local-storage06-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.731187 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/be094b3e-494e-420d-b458-0e32770cd540-scripts" (OuterVolumeSpecName: "scripts") pod "be094b3e-494e-420d-b458-0e32770cd540" (UID: "be094b3e-494e-420d-b458-0e32770cd540"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.731296 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ffbcbd91-454c-4998-9b12-69ed7f853328-logs" (OuterVolumeSpecName: "logs") pod "ffbcbd91-454c-4998-9b12-69ed7f853328" (UID: "ffbcbd91-454c-4998-9b12-69ed7f853328"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.731485 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/285f9896-1a25-4942-96e7-06cff0c87338-logs" (OuterVolumeSpecName: "logs") pod "285f9896-1a25-4942-96e7-06cff0c87338" (UID: "285f9896-1a25-4942-96e7-06cff0c87338"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.739884 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/285f9896-1a25-4942-96e7-06cff0c87338-scripts" (OuterVolumeSpecName: "scripts") pod "285f9896-1a25-4942-96e7-06cff0c87338" (UID: "285f9896-1a25-4942-96e7-06cff0c87338"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.742016 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ffbcbd91-454c-4998-9b12-69ed7f853328-kube-api-access-v6hxw" (OuterVolumeSpecName: "kube-api-access-v6hxw") pod "ffbcbd91-454c-4998-9b12-69ed7f853328" (UID: "ffbcbd91-454c-4998-9b12-69ed7f853328"). InnerVolumeSpecName "kube-api-access-v6hxw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.747075 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be094b3e-494e-420d-b458-0e32770cd540-kube-api-access-vxfmf" (OuterVolumeSpecName: "kube-api-access-vxfmf") pod "be094b3e-494e-420d-b458-0e32770cd540" (UID: "be094b3e-494e-420d-b458-0e32770cd540"). InnerVolumeSpecName "kube-api-access-vxfmf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.747360 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/285f9896-1a25-4942-96e7-06cff0c87338-kube-api-access-qr9cv" (OuterVolumeSpecName: "kube-api-access-qr9cv") pod "285f9896-1a25-4942-96e7-06cff0c87338" (UID: "285f9896-1a25-4942-96e7-06cff0c87338"). InnerVolumeSpecName "kube-api-access-qr9cv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.747474 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage20-crc" (OuterVolumeSpecName: "glance") pod "ffbcbd91-454c-4998-9b12-69ed7f853328" (UID: "ffbcbd91-454c-4998-9b12-69ed7f853328"). InnerVolumeSpecName "local-storage20-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.755866 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ffbcbd91-454c-4998-9b12-69ed7f853328-scripts" (OuterVolumeSpecName: "scripts") pod "ffbcbd91-454c-4998-9b12-69ed7f853328" (UID: "ffbcbd91-454c-4998-9b12-69ed7f853328"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.806915 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ffbcbd91-454c-4998-9b12-69ed7f853328-config-data" (OuterVolumeSpecName: "config-data") pod "ffbcbd91-454c-4998-9b12-69ed7f853328" (UID: "ffbcbd91-454c-4998-9b12-69ed7f853328"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.817001 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/be094b3e-494e-420d-b458-0e32770cd540-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "be094b3e-494e-420d-b458-0e32770cd540" (UID: "be094b3e-494e-420d-b458-0e32770cd540"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.817051 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ffbcbd91-454c-4998-9b12-69ed7f853328-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ffbcbd91-454c-4998-9b12-69ed7f853328" (UID: "ffbcbd91-454c-4998-9b12-69ed7f853328"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.817099 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/be094b3e-494e-420d-b458-0e32770cd540-config-data" (OuterVolumeSpecName: "config-data") pod "be094b3e-494e-420d-b458-0e32770cd540" (UID: "be094b3e-494e-420d-b458-0e32770cd540"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.821999 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/285f9896-1a25-4942-96e7-06cff0c87338-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "285f9896-1a25-4942-96e7-06cff0c87338" (UID: "285f9896-1a25-4942-96e7-06cff0c87338"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.826660 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/be094b3e-494e-420d-b458-0e32770cd540-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.826696 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/285f9896-1a25-4942-96e7-06cff0c87338-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.826708 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/be094b3e-494e-420d-b458-0e32770cd540-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.826716 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/ffbcbd91-454c-4998-9b12-69ed7f853328-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.826726 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ffbcbd91-454c-4998-9b12-69ed7f853328-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.826734 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/be094b3e-494e-420d-b458-0e32770cd540-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.826744 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/285f9896-1a25-4942-96e7-06cff0c87338-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.826753 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vxfmf\" (UniqueName: \"kubernetes.io/projected/be094b3e-494e-420d-b458-0e32770cd540-kube-api-access-vxfmf\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.826777 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ffbcbd91-454c-4998-9b12-69ed7f853328-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.826817 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") on node \"crc\" " Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.826827 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/be094b3e-494e-420d-b458-0e32770cd540-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.826839 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ffbcbd91-454c-4998-9b12-69ed7f853328-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.826847 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/285f9896-1a25-4942-96e7-06cff0c87338-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.826855 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/be094b3e-494e-420d-b458-0e32770cd540-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.826865 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qr9cv\" (UniqueName: \"kubernetes.io/projected/285f9896-1a25-4942-96e7-06cff0c87338-kube-api-access-qr9cv\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.826875 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ffbcbd91-454c-4998-9b12-69ed7f853328-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.826883 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v6hxw\" (UniqueName: \"kubernetes.io/projected/ffbcbd91-454c-4998-9b12-69ed7f853328-kube-api-access-v6hxw\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.826895 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") on node \"crc\" " Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.837224 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/be094b3e-494e-420d-b458-0e32770cd540-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "be094b3e-494e-420d-b458-0e32770cd540" (UID: "be094b3e-494e-420d-b458-0e32770cd540"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.843291 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ffbcbd91-454c-4998-9b12-69ed7f853328-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "ffbcbd91-454c-4998-9b12-69ed7f853328" (UID: "ffbcbd91-454c-4998-9b12-69ed7f853328"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.855076 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage06-crc" (UniqueName: "kubernetes.io/local-volume/local-storage06-crc") on node "crc" Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.865747 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.866486 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage20-crc" (UniqueName: "kubernetes.io/local-volume/local-storage20-crc") on node "crc" Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.874584 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.876733 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.880205 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/285f9896-1a25-4942-96e7-06cff0c87338-config-data" (OuterVolumeSpecName: "config-data") pod "285f9896-1a25-4942-96e7-06cff0c87338" (UID: "285f9896-1a25-4942-96e7-06cff0c87338"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.927612 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e9e86e40-d30c-4208-852b-5d6737ba05ce-logs\") pod \"e9e86e40-d30c-4208-852b-5d6737ba05ce\" (UID: \"e9e86e40-d30c-4208-852b-5d6737ba05ce\") " Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.927666 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e-public-tls-certs\") pod \"08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e\" (UID: \"08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e\") " Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.927781 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e9e86e40-d30c-4208-852b-5d6737ba05ce-config-data\") pod \"e9e86e40-d30c-4208-852b-5d6737ba05ce\" (UID: \"e9e86e40-d30c-4208-852b-5d6737ba05ce\") " Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.927944 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/e9e86e40-d30c-4208-852b-5d6737ba05ce-nova-metadata-tls-certs\") pod \"e9e86e40-d30c-4208-852b-5d6737ba05ce\" (UID: \"e9e86e40-d30c-4208-852b-5d6737ba05ce\") " Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.929609 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e-internal-tls-certs\") pod \"08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e\" (UID: \"08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e\") " Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.929695 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e-combined-ca-bundle\") pod \"08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e\" (UID: \"08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e\") " Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.929739 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zqmvz\" (UniqueName: \"kubernetes.io/projected/e9e86e40-d30c-4208-852b-5d6737ba05ce-kube-api-access-zqmvz\") pod \"e9e86e40-d30c-4208-852b-5d6737ba05ce\" (UID: \"e9e86e40-d30c-4208-852b-5d6737ba05ce\") " Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.929840 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e-config-data\") pod \"08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e\" (UID: \"08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e\") " Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.929937 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xz29q\" (UniqueName: \"kubernetes.io/projected/08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e-kube-api-access-xz29q\") pod \"08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e\" (UID: \"08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e\") " Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.929968 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/70745ff2-698e-465f-b638-2f88c5f0a8c1-config-data\") pod \"70745ff2-698e-465f-b638-2f88c5f0a8c1\" (UID: \"70745ff2-698e-465f-b638-2f88c5f0a8c1\") " Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.929995 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/70745ff2-698e-465f-b638-2f88c5f0a8c1-memcached-tls-certs\") pod \"70745ff2-698e-465f-b638-2f88c5f0a8c1\" (UID: \"70745ff2-698e-465f-b638-2f88c5f0a8c1\") " Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.930196 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e-config-data-custom\") pod \"08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e\" (UID: \"08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e\") " Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.930290 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e9e86e40-d30c-4208-852b-5d6737ba05ce-combined-ca-bundle\") pod \"e9e86e40-d30c-4208-852b-5d6737ba05ce\" (UID: \"e9e86e40-d30c-4208-852b-5d6737ba05ce\") " Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.930375 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/70745ff2-698e-465f-b638-2f88c5f0a8c1-combined-ca-bundle\") pod \"70745ff2-698e-465f-b638-2f88c5f0a8c1\" (UID: \"70745ff2-698e-465f-b638-2f88c5f0a8c1\") " Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.930524 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e-etc-machine-id\") pod \"08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e\" (UID: \"08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e\") " Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.930584 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4v7dp\" (UniqueName: \"kubernetes.io/projected/70745ff2-698e-465f-b638-2f88c5f0a8c1-kube-api-access-4v7dp\") pod \"70745ff2-698e-465f-b638-2f88c5f0a8c1\" (UID: \"70745ff2-698e-465f-b638-2f88c5f0a8c1\") " Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.930611 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/70745ff2-698e-465f-b638-2f88c5f0a8c1-kolla-config\") pod \"70745ff2-698e-465f-b638-2f88c5f0a8c1\" (UID: \"70745ff2-698e-465f-b638-2f88c5f0a8c1\") " Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.930654 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e-scripts\") pod \"08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e\" (UID: \"08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e\") " Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.930797 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e-logs\") pod \"08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e\" (UID: \"08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e\") " Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.931425 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e" (UID: "08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.933442 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/70745ff2-698e-465f-b638-2f88c5f0a8c1-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "70745ff2-698e-465f-b638-2f88c5f0a8c1" (UID: "70745ff2-698e-465f-b638-2f88c5f0a8c1"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.934842 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9e86e40-d30c-4208-852b-5d6737ba05ce-logs" (OuterVolumeSpecName: "logs") pod "e9e86e40-d30c-4208-852b-5d6737ba05ce" (UID: "e9e86e40-d30c-4208-852b-5d6737ba05ce"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.936508 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e-logs" (OuterVolumeSpecName: "logs") pod "08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e" (UID: "08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.939342 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/70745ff2-698e-465f-b638-2f88c5f0a8c1-config-data" (OuterVolumeSpecName: "config-data") pod "70745ff2-698e-465f-b638-2f88c5f0a8c1" (UID: "70745ff2-698e-465f-b638-2f88c5f0a8c1"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.944723 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.944790 5120 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.944801 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/be094b3e-494e-420d-b458-0e32770cd540-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.944811 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ffbcbd91-454c-4998-9b12-69ed7f853328-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.944819 5120 reconciler_common.go:299] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/70745ff2-698e-465f-b638-2f88c5f0a8c1-kolla-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.944849 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.944859 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e9e86e40-d30c-4208-852b-5d6737ba05ce-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.944868 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/285f9896-1a25-4942-96e7-06cff0c87338-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.944879 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.944912 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/70745ff2-698e-465f-b638-2f88c5f0a8c1-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.946307 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e" (UID: "08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.960546 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e-kube-api-access-xz29q" (OuterVolumeSpecName: "kube-api-access-xz29q") pod "08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e" (UID: "08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e"). InnerVolumeSpecName "kube-api-access-xz29q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.970258 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70745ff2-698e-465f-b638-2f88c5f0a8c1-kube-api-access-4v7dp" (OuterVolumeSpecName: "kube-api-access-4v7dp") pod "70745ff2-698e-465f-b638-2f88c5f0a8c1" (UID: "70745ff2-698e-465f-b638-2f88c5f0a8c1"). InnerVolumeSpecName "kube-api-access-4v7dp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.970518 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e-scripts" (OuterVolumeSpecName: "scripts") pod "08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e" (UID: "08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:43:25 crc kubenswrapper[5120]: I0316 16:43:25.975010 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9e86e40-d30c-4208-852b-5d6737ba05ce-kube-api-access-zqmvz" (OuterVolumeSpecName: "kube-api-access-zqmvz") pod "e9e86e40-d30c-4208-852b-5d6737ba05ce" (UID: "e9e86e40-d30c-4208-852b-5d6737ba05ce"). InnerVolumeSpecName "kube-api-access-zqmvz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.027024 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/285f9896-1a25-4942-96e7-06cff0c87338-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "285f9896-1a25-4942-96e7-06cff0c87338" (UID: "285f9896-1a25-4942-96e7-06cff0c87338"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.030016 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e" (UID: "08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.032374 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9e86e40-d30c-4208-852b-5d6737ba05ce-config-data" (OuterVolumeSpecName: "config-data") pod "e9e86e40-d30c-4208-852b-5d6737ba05ce" (UID: "e9e86e40-d30c-4208-852b-5d6737ba05ce"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.041410 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/70745ff2-698e-465f-b638-2f88c5f0a8c1-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "70745ff2-698e-465f-b638-2f88c5f0a8c1" (UID: "70745ff2-698e-465f-b638-2f88c5f0a8c1"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.047187 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zqmvz\" (UniqueName: \"kubernetes.io/projected/e9e86e40-d30c-4208-852b-5d6737ba05ce-kube-api-access-zqmvz\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.047231 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xz29q\" (UniqueName: \"kubernetes.io/projected/08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e-kube-api-access-xz29q\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.047245 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.047256 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/70745ff2-698e-465f-b638-2f88c5f0a8c1-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.047268 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4v7dp\" (UniqueName: \"kubernetes.io/projected/70745ff2-698e-465f-b638-2f88c5f0a8c1-kube-api-access-4v7dp\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.047279 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.047292 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e9e86e40-d30c-4208-852b-5d6737ba05ce-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.047304 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/285f9896-1a25-4942-96e7-06cff0c87338-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.047315 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.063608 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e-config-data" (OuterVolumeSpecName: "config-data") pod "08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e" (UID: "08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.072490 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/285f9896-1a25-4942-96e7-06cff0c87338-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "285f9896-1a25-4942-96e7-06cff0c87338" (UID: "285f9896-1a25-4942-96e7-06cff0c87338"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.089865 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e" (UID: "08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.107950 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9e86e40-d30c-4208-852b-5d6737ba05ce-nova-metadata-tls-certs" (OuterVolumeSpecName: "nova-metadata-tls-certs") pod "e9e86e40-d30c-4208-852b-5d6737ba05ce" (UID: "e9e86e40-d30c-4208-852b-5d6737ba05ce"). InnerVolumeSpecName "nova-metadata-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.119138 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/70745ff2-698e-465f-b638-2f88c5f0a8c1-memcached-tls-certs" (OuterVolumeSpecName: "memcached-tls-certs") pod "70745ff2-698e-465f-b638-2f88c5f0a8c1" (UID: "70745ff2-698e-465f-b638-2f88c5f0a8c1"). InnerVolumeSpecName "memcached-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.122838 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e" (UID: "08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.138537 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9e86e40-d30c-4208-852b-5d6737ba05ce-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e9e86e40-d30c-4208-852b-5d6737ba05ce" (UID: "e9e86e40-d30c-4208-852b-5d6737ba05ce"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.149153 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.149190 5120 reconciler_common.go:299] "Volume detached for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/e9e86e40-d30c-4208-852b-5d6737ba05ce-nova-metadata-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.149201 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.149211 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.149222 5120 reconciler_common.go:299] "Volume detached for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/70745ff2-698e-465f-b638-2f88c5f0a8c1-memcached-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.149230 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e9e86e40-d30c-4208-852b-5d6737ba05ce-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.149239 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/285f9896-1a25-4942-96e7-06cff0c87338-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.204115 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.211100 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-6647785db4-lmftm" Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.248713 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"be094b3e-494e-420d-b458-0e32770cd540","Type":"ContainerDied","Data":"70792f68bfba6e0ce19f3b988988aa941c3d3136a5e23e736a0fc08dea0e131e"} Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.248844 5120 scope.go:117] "RemoveContainer" containerID="503b90090ae8a47de41498d2d43c08c9f18dfaaa22a4ca2e49962c58dcc9ae34" Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.249080 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.250223 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xm4jb\" (UniqueName: \"kubernetes.io/projected/1518bfb1-3665-455c-84df-7c6eba7b93cf-kube-api-access-xm4jb\") pod \"1518bfb1-3665-455c-84df-7c6eba7b93cf\" (UID: \"1518bfb1-3665-455c-84df-7c6eba7b93cf\") " Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.250321 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1518bfb1-3665-455c-84df-7c6eba7b93cf-config-data\") pod \"1518bfb1-3665-455c-84df-7c6eba7b93cf\" (UID: \"1518bfb1-3665-455c-84df-7c6eba7b93cf\") " Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.250352 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/935a7850-d7f8-438f-a787-6a78e33db090-public-tls-certs\") pod \"935a7850-d7f8-438f-a787-6a78e33db090\" (UID: \"935a7850-d7f8-438f-a787-6a78e33db090\") " Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.250746 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/1518bfb1-3665-455c-84df-7c6eba7b93cf-config-data-custom\") pod \"1518bfb1-3665-455c-84df-7c6eba7b93cf\" (UID: \"1518bfb1-3665-455c-84df-7c6eba7b93cf\") " Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.250948 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/1518bfb1-3665-455c-84df-7c6eba7b93cf-internal-tls-certs\") pod \"1518bfb1-3665-455c-84df-7c6eba7b93cf\" (UID: \"1518bfb1-3665-455c-84df-7c6eba7b93cf\") " Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.251791 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/935a7850-d7f8-438f-a787-6a78e33db090-logs\") pod \"935a7850-d7f8-438f-a787-6a78e33db090\" (UID: \"935a7850-d7f8-438f-a787-6a78e33db090\") " Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.252010 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/935a7850-d7f8-438f-a787-6a78e33db090-config-data\") pod \"935a7850-d7f8-438f-a787-6a78e33db090\" (UID: \"935a7850-d7f8-438f-a787-6a78e33db090\") " Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.252061 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/935a7850-d7f8-438f-a787-6a78e33db090-combined-ca-bundle\") pod \"935a7850-d7f8-438f-a787-6a78e33db090\" (UID: \"935a7850-d7f8-438f-a787-6a78e33db090\") " Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.252203 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1518bfb1-3665-455c-84df-7c6eba7b93cf-combined-ca-bundle\") pod \"1518bfb1-3665-455c-84df-7c6eba7b93cf\" (UID: \"1518bfb1-3665-455c-84df-7c6eba7b93cf\") " Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.252233 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8brvm\" (UniqueName: \"kubernetes.io/projected/935a7850-d7f8-438f-a787-6a78e33db090-kube-api-access-8brvm\") pod \"935a7850-d7f8-438f-a787-6a78e33db090\" (UID: \"935a7850-d7f8-438f-a787-6a78e33db090\") " Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.252424 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/935a7850-d7f8-438f-a787-6a78e33db090-logs" (OuterVolumeSpecName: "logs") pod "935a7850-d7f8-438f-a787-6a78e33db090" (UID: "935a7850-d7f8-438f-a787-6a78e33db090"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.252427 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/1518bfb1-3665-455c-84df-7c6eba7b93cf-public-tls-certs\") pod \"1518bfb1-3665-455c-84df-7c6eba7b93cf\" (UID: \"1518bfb1-3665-455c-84df-7c6eba7b93cf\") " Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.252703 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/935a7850-d7f8-438f-a787-6a78e33db090-internal-tls-certs\") pod \"935a7850-d7f8-438f-a787-6a78e33db090\" (UID: \"935a7850-d7f8-438f-a787-6a78e33db090\") " Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.252751 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/1518bfb1-3665-455c-84df-7c6eba7b93cf-logs\") pod \"1518bfb1-3665-455c-84df-7c6eba7b93cf\" (UID: \"1518bfb1-3665-455c-84df-7c6eba7b93cf\") " Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.253644 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/935a7850-d7f8-438f-a787-6a78e33db090-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.254360 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1518bfb1-3665-455c-84df-7c6eba7b93cf-logs" (OuterVolumeSpecName: "logs") pod "1518bfb1-3665-455c-84df-7c6eba7b93cf" (UID: "1518bfb1-3665-455c-84df-7c6eba7b93cf"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.259547 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1518bfb1-3665-455c-84df-7c6eba7b93cf-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "1518bfb1-3665-455c-84df-7c6eba7b93cf" (UID: "1518bfb1-3665-455c-84df-7c6eba7b93cf"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.260416 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1518bfb1-3665-455c-84df-7c6eba7b93cf-kube-api-access-xm4jb" (OuterVolumeSpecName: "kube-api-access-xm4jb") pod "1518bfb1-3665-455c-84df-7c6eba7b93cf" (UID: "1518bfb1-3665-455c-84df-7c6eba7b93cf"). InnerVolumeSpecName "kube-api-access-xm4jb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.263215 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/935a7850-d7f8-438f-a787-6a78e33db090-kube-api-access-8brvm" (OuterVolumeSpecName: "kube-api-access-8brvm") pod "935a7850-d7f8-438f-a787-6a78e33db090" (UID: "935a7850-d7f8-438f-a787-6a78e33db090"). InnerVolumeSpecName "kube-api-access-8brvm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.264064 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e","Type":"ContainerDied","Data":"091f130b89538ea4686698ff9c4a3368a1cedee64b16ed1969a99d3820d28b2f"} Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.264930 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.270309 5120 generic.go:358] "Generic (PLEG): container finished" podID="1518bfb1-3665-455c-84df-7c6eba7b93cf" containerID="a36426906a84d8ea72c76bb969e2d2ccd78889b5a575462d932c61eff0792b6b" exitCode=0 Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.270518 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-6647785db4-lmftm" event={"ID":"1518bfb1-3665-455c-84df-7c6eba7b93cf","Type":"ContainerDied","Data":"a36426906a84d8ea72c76bb969e2d2ccd78889b5a575462d932c61eff0792b6b"} Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.270553 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-6647785db4-lmftm" event={"ID":"1518bfb1-3665-455c-84df-7c6eba7b93cf","Type":"ContainerDied","Data":"16f8cef67b0a9ea7deae75c8617d1f1fdfe1e13d809bd91cbd883543e8d04df8"} Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.270632 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-6647785db4-lmftm" Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.273862 5120 generic.go:358] "Generic (PLEG): container finished" podID="e9e86e40-d30c-4208-852b-5d6737ba05ce" containerID="90f7776ae4d6e0446a5d45a429255d7b79feb97a72344584de1b162bd35dd26e" exitCode=0 Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.273981 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"e9e86e40-d30c-4208-852b-5d6737ba05ce","Type":"ContainerDied","Data":"90f7776ae4d6e0446a5d45a429255d7b79feb97a72344584de1b162bd35dd26e"} Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.274010 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"e9e86e40-d30c-4208-852b-5d6737ba05ce","Type":"ContainerDied","Data":"4a75631155f7390685f76dfd8a06f3b39009a58624bc535bd87bf3af735ea68d"} Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.274077 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.281337 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-6d66dbd7f8-6ld6p" event={"ID":"285f9896-1a25-4942-96e7-06cff0c87338","Type":"ContainerDied","Data":"0dc0ba911242ec02d0bb2b1e2e2e21f4985eb31a1a9503efaed2b57e8a56d6bf"} Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.281428 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-6d66dbd7f8-6ld6p" Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.290032 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/935a7850-d7f8-438f-a787-6a78e33db090-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "935a7850-d7f8-438f-a787-6a78e33db090" (UID: "935a7850-d7f8-438f-a787-6a78e33db090"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.302887 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1518bfb1-3665-455c-84df-7c6eba7b93cf-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "1518bfb1-3665-455c-84df-7c6eba7b93cf" (UID: "1518bfb1-3665-455c-84df-7c6eba7b93cf"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.303999 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"ffbcbd91-454c-4998-9b12-69ed7f853328","Type":"ContainerDied","Data":"7c5481a83197b7434c5e26b760a294666558448b22619645987cee5c91840bc9"} Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.304110 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.309527 5120 scope.go:117] "RemoveContainer" containerID="1de4d27ef85234281dc29611eaac2860bbedc2f6d3859afdac09f43a62514da8" Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.309787 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"935a7850-d7f8-438f-a787-6a78e33db090","Type":"ContainerDied","Data":"d778c8d3201f505aa08f8b8a1774d98fe321c408ea4394e5597de23b72abb24d"} Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.310097 5120 generic.go:358] "Generic (PLEG): container finished" podID="935a7850-d7f8-438f-a787-6a78e33db090" containerID="d778c8d3201f505aa08f8b8a1774d98fe321c408ea4394e5597de23b72abb24d" exitCode=0 Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.310206 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"935a7850-d7f8-438f-a787-6a78e33db090","Type":"ContainerDied","Data":"25f054c3fd24d189351d7069e00b7756613e13cfe2ac6017bd68ab6c07560e7b"} Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.311002 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/935a7850-d7f8-438f-a787-6a78e33db090-config-data" (OuterVolumeSpecName: "config-data") pod "935a7850-d7f8-438f-a787-6a78e33db090" (UID: "935a7850-d7f8-438f-a787-6a78e33db090"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.311146 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.312832 5120 generic.go:358] "Generic (PLEG): container finished" podID="70745ff2-698e-465f-b638-2f88c5f0a8c1" containerID="277da739fad21f693bcceb96c5d27dab575e4421464263f28ff1d98df95a9af5" exitCode=0 Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.313244 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-cgjmv" Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.313797 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"70745ff2-698e-465f-b638-2f88c5f0a8c1","Type":"ContainerDied","Data":"277da739fad21f693bcceb96c5d27dab575e4421464263f28ff1d98df95a9af5"} Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.313833 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"70745ff2-698e-465f-b638-2f88c5f0a8c1","Type":"ContainerDied","Data":"dda5704cda950a4d9b69c493d4f64fb8e8999c24a60a442d45ccf67b92461126"} Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.313934 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.314203 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-6zc78" Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.314843 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-e32b-account-create-update-xn2hk" Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.315824 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-a3c5-account-create-update-ndpvq" Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.316703 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-454d-account-create-update-l7szq" Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.340735 5120 scope.go:117] "RemoveContainer" containerID="261821a3adde73a3dc23cb22faac9f49d193b2649fe06010aa01954b846e70d4" Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.348824 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.356419 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9d1b0d93-485c-4d8a-aff8-21f87e9fb078-operator-scripts\") pod \"root-account-create-update-6zc78\" (UID: \"9d1b0d93-485c-4d8a-aff8-21f87e9fb078\") " pod="openstack-kuttl-tests/root-account-create-update-6zc78" Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.356714 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f95nn\" (UniqueName: \"kubernetes.io/projected/9d1b0d93-485c-4d8a-aff8-21f87e9fb078-kube-api-access-f95nn\") pod \"root-account-create-update-6zc78\" (UID: \"9d1b0d93-485c-4d8a-aff8-21f87e9fb078\") " pod="openstack-kuttl-tests/root-account-create-update-6zc78" Mar 16 16:43:26 crc kubenswrapper[5120]: E0316 16:43:26.357057 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Mar 16 16:43:26 crc kubenswrapper[5120]: E0316 16:43:26.358630 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9d1b0d93-485c-4d8a-aff8-21f87e9fb078-operator-scripts podName:9d1b0d93-485c-4d8a-aff8-21f87e9fb078 nodeName:}" failed. No retries permitted until 2026-03-16 16:43:28.358606758 +0000 UTC m=+4310.512538415 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/9d1b0d93-485c-4d8a-aff8-21f87e9fb078-operator-scripts") pod "root-account-create-update-6zc78" (UID: "9d1b0d93-485c-4d8a-aff8-21f87e9fb078") : configmap "openstack-scripts" not found Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.358852 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xm4jb\" (UniqueName: \"kubernetes.io/projected/1518bfb1-3665-455c-84df-7c6eba7b93cf-kube-api-access-xm4jb\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.358869 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/1518bfb1-3665-455c-84df-7c6eba7b93cf-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.358882 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/935a7850-d7f8-438f-a787-6a78e33db090-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.358894 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/935a7850-d7f8-438f-a787-6a78e33db090-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.358906 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1518bfb1-3665-455c-84df-7c6eba7b93cf-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.358918 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8brvm\" (UniqueName: \"kubernetes.io/projected/935a7850-d7f8-438f-a787-6a78e33db090-kube-api-access-8brvm\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.358930 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/1518bfb1-3665-455c-84df-7c6eba7b93cf-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:26 crc kubenswrapper[5120]: E0316 16:43:26.361948 5120 projected.go:194] Error preparing data for projected volume kube-api-access-f95nn for pod openstack-kuttl-tests/root-account-create-update-6zc78: failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.378321 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/935a7850-d7f8-438f-a787-6a78e33db090-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "935a7850-d7f8-438f-a787-6a78e33db090" (UID: "935a7850-d7f8-438f-a787-6a78e33db090"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:43:26 crc kubenswrapper[5120]: E0316 16:43:26.378586 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9d1b0d93-485c-4d8a-aff8-21f87e9fb078-kube-api-access-f95nn podName:9d1b0d93-485c-4d8a-aff8-21f87e9fb078 nodeName:}" failed. No retries permitted until 2026-03-16 16:43:28.378552109 +0000 UTC m=+4310.532483776 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-f95nn" (UniqueName: "kubernetes.io/projected/9d1b0d93-485c-4d8a-aff8-21f87e9fb078-kube-api-access-f95nn") pod "root-account-create-update-6zc78" (UID: "9d1b0d93-485c-4d8a-aff8-21f87e9fb078") : failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.378830 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1518bfb1-3665-455c-84df-7c6eba7b93cf-config-data" (OuterVolumeSpecName: "config-data") pod "1518bfb1-3665-455c-84df-7c6eba7b93cf" (UID: "1518bfb1-3665-455c-84df-7c6eba7b93cf"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.379945 5120 scope.go:117] "RemoveContainer" containerID="66f3f06a9c5991c76392f548443ba31ee8e82819f11e5f67929aa6ee25bd68c6" Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.387112 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/935a7850-d7f8-438f-a787-6a78e33db090-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "935a7850-d7f8-438f-a787-6a78e33db090" (UID: "935a7850-d7f8-438f-a787-6a78e33db090"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.401715 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.426516 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1518bfb1-3665-455c-84df-7c6eba7b93cf-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "1518bfb1-3665-455c-84df-7c6eba7b93cf" (UID: "1518bfb1-3665-455c-84df-7c6eba7b93cf"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.427001 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.452863 5120 scope.go:117] "RemoveContainer" containerID="a36426906a84d8ea72c76bb969e2d2ccd78889b5a575462d932c61eff0792b6b" Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.458440 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.458841 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1518bfb1-3665-455c-84df-7c6eba7b93cf-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "1518bfb1-3665-455c-84df-7c6eba7b93cf" (UID: "1518bfb1-3665-455c-84df-7c6eba7b93cf"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.460745 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/1518bfb1-3665-455c-84df-7c6eba7b93cf-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.460787 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/1518bfb1-3665-455c-84df-7c6eba7b93cf-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.460798 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/935a7850-d7f8-438f-a787-6a78e33db090-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.460807 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1518bfb1-3665-455c-84df-7c6eba7b93cf-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.460815 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/935a7850-d7f8-438f-a787-6a78e33db090-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.485359 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-6zc78"] Mar 16 16:43:26 crc kubenswrapper[5120]: E0316 16:43:26.490480 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="10a7e33721d5da23369bc4422d4cbb9b2fa2d5c64f2fff4f94c6d681301c74ff" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:43:26 crc kubenswrapper[5120]: E0316 16:43:26.493298 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="10a7e33721d5da23369bc4422d4cbb9b2fa2d5c64f2fff4f94c6d681301c74ff" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:43:26 crc kubenswrapper[5120]: E0316 16:43:26.494620 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="10a7e33721d5da23369bc4422d4cbb9b2fa2d5c64f2fff4f94c6d681301c74ff" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:43:26 crc kubenswrapper[5120]: E0316 16:43:26.494686 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="636be6fd-cf1a-4f31-aa2b-6be52788333d" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.499134 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-6zc78"] Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.510346 5120 scope.go:117] "RemoveContainer" containerID="d33f8e22773224907ed12c1e59701d7399b4bdc1d2d9ae0cdce97abf4ee82542" Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.517015 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-454d-account-create-update-l7szq"] Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.530289 5120 scope.go:117] "RemoveContainer" containerID="a36426906a84d8ea72c76bb969e2d2ccd78889b5a575462d932c61eff0792b6b" Mar 16 16:43:26 crc kubenswrapper[5120]: E0316 16:43:26.530670 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a36426906a84d8ea72c76bb969e2d2ccd78889b5a575462d932c61eff0792b6b\": container with ID starting with a36426906a84d8ea72c76bb969e2d2ccd78889b5a575462d932c61eff0792b6b not found: ID does not exist" containerID="a36426906a84d8ea72c76bb969e2d2ccd78889b5a575462d932c61eff0792b6b" Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.530697 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a36426906a84d8ea72c76bb969e2d2ccd78889b5a575462d932c61eff0792b6b"} err="failed to get container status \"a36426906a84d8ea72c76bb969e2d2ccd78889b5a575462d932c61eff0792b6b\": rpc error: code = NotFound desc = could not find container \"a36426906a84d8ea72c76bb969e2d2ccd78889b5a575462d932c61eff0792b6b\": container with ID starting with a36426906a84d8ea72c76bb969e2d2ccd78889b5a575462d932c61eff0792b6b not found: ID does not exist" Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.530716 5120 scope.go:117] "RemoveContainer" containerID="d33f8e22773224907ed12c1e59701d7399b4bdc1d2d9ae0cdce97abf4ee82542" Mar 16 16:43:26 crc kubenswrapper[5120]: E0316 16:43:26.531261 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d33f8e22773224907ed12c1e59701d7399b4bdc1d2d9ae0cdce97abf4ee82542\": container with ID starting with d33f8e22773224907ed12c1e59701d7399b4bdc1d2d9ae0cdce97abf4ee82542 not found: ID does not exist" containerID="d33f8e22773224907ed12c1e59701d7399b4bdc1d2d9ae0cdce97abf4ee82542" Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.531413 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d33f8e22773224907ed12c1e59701d7399b4bdc1d2d9ae0cdce97abf4ee82542"} err="failed to get container status \"d33f8e22773224907ed12c1e59701d7399b4bdc1d2d9ae0cdce97abf4ee82542\": rpc error: code = NotFound desc = could not find container \"d33f8e22773224907ed12c1e59701d7399b4bdc1d2d9ae0cdce97abf4ee82542\": container with ID starting with d33f8e22773224907ed12c1e59701d7399b4bdc1d2d9ae0cdce97abf4ee82542 not found: ID does not exist" Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.531439 5120 scope.go:117] "RemoveContainer" containerID="90f7776ae4d6e0446a5d45a429255d7b79feb97a72344584de1b162bd35dd26e" Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.537805 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-454d-account-create-update-l7szq"] Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.567175 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-6d66dbd7f8-6ld6p"] Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.567805 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sl7w4\" (UniqueName: \"kubernetes.io/projected/86555a03-238a-4f27-a960-f86bd355bb5c-kube-api-access-sl7w4\") pod \"keystone-454d-account-create-update-l7szq\" (UID: \"86555a03-238a-4f27-a960-f86bd355bb5c\") " pod="openstack-kuttl-tests/keystone-454d-account-create-update-l7szq" Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.568221 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/86555a03-238a-4f27-a960-f86bd355bb5c-operator-scripts\") pod \"keystone-454d-account-create-update-l7szq\" (UID: \"86555a03-238a-4f27-a960-f86bd355bb5c\") " pod="openstack-kuttl-tests/keystone-454d-account-create-update-l7szq" Mar 16 16:43:26 crc kubenswrapper[5120]: E0316 16:43:26.568284 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Mar 16 16:43:26 crc kubenswrapper[5120]: E0316 16:43:26.568432 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/86555a03-238a-4f27-a960-f86bd355bb5c-operator-scripts podName:86555a03-238a-4f27-a960-f86bd355bb5c nodeName:}" failed. No retries permitted until 2026-03-16 16:43:28.568415263 +0000 UTC m=+4310.722346920 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/86555a03-238a-4f27-a960-f86bd355bb5c-operator-scripts") pod "keystone-454d-account-create-update-l7szq" (UID: "86555a03-238a-4f27-a960-f86bd355bb5c") : configmap "openstack-scripts" not found Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.568559 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f95nn\" (UniqueName: \"kubernetes.io/projected/9d1b0d93-485c-4d8a-aff8-21f87e9fb078-kube-api-access-f95nn\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.568573 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9d1b0d93-485c-4d8a-aff8-21f87e9fb078-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:26 crc kubenswrapper[5120]: E0316 16:43:26.569505 5120 projected.go:194] Error preparing data for projected volume kube-api-access-sl7w4 for pod openstack-kuttl-tests/keystone-454d-account-create-update-l7szq: failed to fetch token: pod "keystone-454d-account-create-update-l7szq" not found Mar 16 16:43:26 crc kubenswrapper[5120]: E0316 16:43:26.569556 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/86555a03-238a-4f27-a960-f86bd355bb5c-kube-api-access-sl7w4 podName:86555a03-238a-4f27-a960-f86bd355bb5c nodeName:}" failed. No retries permitted until 2026-03-16 16:43:28.569545854 +0000 UTC m=+4310.723477511 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-sl7w4" (UniqueName: "kubernetes.io/projected/86555a03-238a-4f27-a960-f86bd355bb5c-kube-api-access-sl7w4") pod "keystone-454d-account-create-update-l7szq" (UID: "86555a03-238a-4f27-a960-f86bd355bb5c") : failed to fetch token: pod "keystone-454d-account-create-update-l7szq" not found Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.576015 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-6d66dbd7f8-6ld6p"] Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.579601 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.585967 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.586257 5120 scope.go:117] "RemoveContainer" containerID="9ea9db94f867aa536c9a5bdcc6cf83c48c8a9bcef57187ed927a4383f38d4b5b" Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.607400 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-e32b-account-create-update-xn2hk"] Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.613171 5120 scope.go:117] "RemoveContainer" containerID="90f7776ae4d6e0446a5d45a429255d7b79feb97a72344584de1b162bd35dd26e" Mar 16 16:43:26 crc kubenswrapper[5120]: E0316 16:43:26.613567 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"90f7776ae4d6e0446a5d45a429255d7b79feb97a72344584de1b162bd35dd26e\": container with ID starting with 90f7776ae4d6e0446a5d45a429255d7b79feb97a72344584de1b162bd35dd26e not found: ID does not exist" containerID="90f7776ae4d6e0446a5d45a429255d7b79feb97a72344584de1b162bd35dd26e" Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.613595 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90f7776ae4d6e0446a5d45a429255d7b79feb97a72344584de1b162bd35dd26e"} err="failed to get container status \"90f7776ae4d6e0446a5d45a429255d7b79feb97a72344584de1b162bd35dd26e\": rpc error: code = NotFound desc = could not find container \"90f7776ae4d6e0446a5d45a429255d7b79feb97a72344584de1b162bd35dd26e\": container with ID starting with 90f7776ae4d6e0446a5d45a429255d7b79feb97a72344584de1b162bd35dd26e not found: ID does not exist" Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.613614 5120 scope.go:117] "RemoveContainer" containerID="9ea9db94f867aa536c9a5bdcc6cf83c48c8a9bcef57187ed927a4383f38d4b5b" Mar 16 16:43:26 crc kubenswrapper[5120]: E0316 16:43:26.613777 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9ea9db94f867aa536c9a5bdcc6cf83c48c8a9bcef57187ed927a4383f38d4b5b\": container with ID starting with 9ea9db94f867aa536c9a5bdcc6cf83c48c8a9bcef57187ed927a4383f38d4b5b not found: ID does not exist" containerID="9ea9db94f867aa536c9a5bdcc6cf83c48c8a9bcef57187ed927a4383f38d4b5b" Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.613799 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ea9db94f867aa536c9a5bdcc6cf83c48c8a9bcef57187ed927a4383f38d4b5b"} err="failed to get container status \"9ea9db94f867aa536c9a5bdcc6cf83c48c8a9bcef57187ed927a4383f38d4b5b\": rpc error: code = NotFound desc = could not find container \"9ea9db94f867aa536c9a5bdcc6cf83c48c8a9bcef57187ed927a4383f38d4b5b\": container with ID starting with 9ea9db94f867aa536c9a5bdcc6cf83c48c8a9bcef57187ed927a4383f38d4b5b not found: ID does not exist" Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.613811 5120 scope.go:117] "RemoveContainer" containerID="ff35fcc66f01f4079bcdb316040d0ddf3ee4fd594afc5a2f5a31c4a635ef5041" Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.614414 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-e32b-account-create-update-xn2hk"] Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.622006 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.629375 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.641933 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-cgjmv"] Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.650618 5120 scope.go:117] "RemoveContainer" containerID="960b621eb32725f87cd9d272b4591b8833ab3d8756e9e76af56acecb09e4b1e4" Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.656306 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-cgjmv"] Mar 16 16:43:26 crc kubenswrapper[5120]: E0316 16:43:26.669958 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-config-data: configmap "rabbitmq-config-data" not found Mar 16 16:43:26 crc kubenswrapper[5120]: E0316 16:43:26.670045 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/55a201e2-20da-49c3-8216-77a042dd3b31-config-data podName:55a201e2-20da-49c3-8216-77a042dd3b31 nodeName:}" failed. No retries permitted until 2026-03-16 16:43:30.67002362 +0000 UTC m=+4312.823955277 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/55a201e2-20da-49c3-8216-77a042dd3b31-config-data") pod "rabbitmq-server-0" (UID: "55a201e2-20da-49c3-8216-77a042dd3b31") : configmap "rabbitmq-config-data" not found Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.670243 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sl7w4\" (UniqueName: \"kubernetes.io/projected/86555a03-238a-4f27-a960-f86bd355bb5c-kube-api-access-sl7w4\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.670263 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/86555a03-238a-4f27-a960-f86bd355bb5c-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.680524 5120 scope.go:117] "RemoveContainer" containerID="6639e315af61023162c1fff62d7078f952718cb1641545fd6b502793501a8f4b" Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.680938 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e" path="/var/lib/kubelet/pods/08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e/volumes" Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.681564 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="285f9896-1a25-4942-96e7-06cff0c87338" path="/var/lib/kubelet/pods/285f9896-1a25-4942-96e7-06cff0c87338/volumes" Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.682443 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="69586194-14da-4bd2-ab2d-5b464625a1a5" path="/var/lib/kubelet/pods/69586194-14da-4bd2-ab2d-5b464625a1a5/volumes" Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.683603 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="70745ff2-698e-465f-b638-2f88c5f0a8c1" path="/var/lib/kubelet/pods/70745ff2-698e-465f-b638-2f88c5f0a8c1/volumes" Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.684181 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="86555a03-238a-4f27-a960-f86bd355bb5c" path="/var/lib/kubelet/pods/86555a03-238a-4f27-a960-f86bd355bb5c/volumes" Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.684533 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="86673db2-3d2b-4864-ae11-c6895dc677d2" path="/var/lib/kubelet/pods/86673db2-3d2b-4864-ae11-c6895dc677d2/volumes" Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.685031 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="908660b0-e07b-45ab-92c8-1e466ddc0906" path="/var/lib/kubelet/pods/908660b0-e07b-45ab-92c8-1e466ddc0906/volumes" Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.685377 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93b8115e-671f-4dff-96ec-a78e9ad5b022" path="/var/lib/kubelet/pods/93b8115e-671f-4dff-96ec-a78e9ad5b022/volumes" Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.687625 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93c4c8f7-726e-4f00-b007-7411cfba1a4c" path="/var/lib/kubelet/pods/93c4c8f7-726e-4f00-b007-7411cfba1a4c/volumes" Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.688021 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="99e73376-04fb-4c3c-932a-115a4dd47186" path="/var/lib/kubelet/pods/99e73376-04fb-4c3c-932a-115a4dd47186/volumes" Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.688409 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9d1b0d93-485c-4d8a-aff8-21f87e9fb078" path="/var/lib/kubelet/pods/9d1b0d93-485c-4d8a-aff8-21f87e9fb078/volumes" Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.688718 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ad545a3f-12c8-4905-a7fe-2bc4cbfbf09e" path="/var/lib/kubelet/pods/ad545a3f-12c8-4905-a7fe-2bc4cbfbf09e/volumes" Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.689130 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d5e2313a-9600-4730-95b1-a47794ca9b4c" path="/var/lib/kubelet/pods/d5e2313a-9600-4730-95b1-a47794ca9b4c/volumes" Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.690075 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e9e86e40-d30c-4208-852b-5d6737ba05ce" path="/var/lib/kubelet/pods/e9e86e40-d30c-4208-852b-5d6737ba05ce/volumes" Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.690945 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ffbcbd91-454c-4998-9b12-69ed7f853328" path="/var/lib/kubelet/pods/ffbcbd91-454c-4998-9b12-69ed7f853328/volumes" Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.691632 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-a3c5-account-create-update-ndpvq"] Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.691657 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-a3c5-account-create-update-ndpvq"] Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.691798 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.693393 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.699893 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-6647785db4-lmftm"] Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.704025 5120 scope.go:117] "RemoveContainer" containerID="100e2f81fc414c81803e72da0cb77145f68c5dcb7c9f13cb7d2de6c84a6a43f5" Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.706750 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-api-6647785db4-lmftm"] Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.713076 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.719442 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.735566 5120 scope.go:117] "RemoveContainer" containerID="d778c8d3201f505aa08f8b8a1774d98fe321c408ea4394e5597de23b72abb24d" Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.759052 5120 scope.go:117] "RemoveContainer" containerID="d7dd32e7de0c2fd93e29bcaac1474b1c8ebaed9d509efbae0d367991ba1a58da" Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.854950 5120 scope.go:117] "RemoveContainer" containerID="d778c8d3201f505aa08f8b8a1774d98fe321c408ea4394e5597de23b72abb24d" Mar 16 16:43:26 crc kubenswrapper[5120]: E0316 16:43:26.855976 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d778c8d3201f505aa08f8b8a1774d98fe321c408ea4394e5597de23b72abb24d\": container with ID starting with d778c8d3201f505aa08f8b8a1774d98fe321c408ea4394e5597de23b72abb24d not found: ID does not exist" containerID="d778c8d3201f505aa08f8b8a1774d98fe321c408ea4394e5597de23b72abb24d" Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.856008 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d778c8d3201f505aa08f8b8a1774d98fe321c408ea4394e5597de23b72abb24d"} err="failed to get container status \"d778c8d3201f505aa08f8b8a1774d98fe321c408ea4394e5597de23b72abb24d\": rpc error: code = NotFound desc = could not find container \"d778c8d3201f505aa08f8b8a1774d98fe321c408ea4394e5597de23b72abb24d\": container with ID starting with d778c8d3201f505aa08f8b8a1774d98fe321c408ea4394e5597de23b72abb24d not found: ID does not exist" Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.856029 5120 scope.go:117] "RemoveContainer" containerID="d7dd32e7de0c2fd93e29bcaac1474b1c8ebaed9d509efbae0d367991ba1a58da" Mar 16 16:43:26 crc kubenswrapper[5120]: E0316 16:43:26.856647 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d7dd32e7de0c2fd93e29bcaac1474b1c8ebaed9d509efbae0d367991ba1a58da\": container with ID starting with d7dd32e7de0c2fd93e29bcaac1474b1c8ebaed9d509efbae0d367991ba1a58da not found: ID does not exist" containerID="d7dd32e7de0c2fd93e29bcaac1474b1c8ebaed9d509efbae0d367991ba1a58da" Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.856672 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7dd32e7de0c2fd93e29bcaac1474b1c8ebaed9d509efbae0d367991ba1a58da"} err="failed to get container status \"d7dd32e7de0c2fd93e29bcaac1474b1c8ebaed9d509efbae0d367991ba1a58da\": rpc error: code = NotFound desc = could not find container \"d7dd32e7de0c2fd93e29bcaac1474b1c8ebaed9d509efbae0d367991ba1a58da\": container with ID starting with d7dd32e7de0c2fd93e29bcaac1474b1c8ebaed9d509efbae0d367991ba1a58da not found: ID does not exist" Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.856686 5120 scope.go:117] "RemoveContainer" containerID="277da739fad21f693bcceb96c5d27dab575e4421464263f28ff1d98df95a9af5" Mar 16 16:43:26 crc kubenswrapper[5120]: E0316 16:43:26.857826 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="39b19d47df4280da111038dcf617135fe59f13c47f76f5f5da32391a2bd60988" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:43:26 crc kubenswrapper[5120]: E0316 16:43:26.864612 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="39b19d47df4280da111038dcf617135fe59f13c47f76f5f5da32391a2bd60988" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:43:26 crc kubenswrapper[5120]: E0316 16:43:26.866344 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="39b19d47df4280da111038dcf617135fe59f13c47f76f5f5da32391a2bd60988" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:43:26 crc kubenswrapper[5120]: E0316 16:43:26.866399 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="a7128a81-4e4e-4635-b66c-f992c4b30d2a" containerName="nova-cell1-conductor-conductor" probeResult="unknown" Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.917174 5120 scope.go:117] "RemoveContainer" containerID="277da739fad21f693bcceb96c5d27dab575e4421464263f28ff1d98df95a9af5" Mar 16 16:43:26 crc kubenswrapper[5120]: E0316 16:43:26.917664 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"277da739fad21f693bcceb96c5d27dab575e4421464263f28ff1d98df95a9af5\": container with ID starting with 277da739fad21f693bcceb96c5d27dab575e4421464263f28ff1d98df95a9af5 not found: ID does not exist" containerID="277da739fad21f693bcceb96c5d27dab575e4421464263f28ff1d98df95a9af5" Mar 16 16:43:26 crc kubenswrapper[5120]: I0316 16:43:26.917698 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"277da739fad21f693bcceb96c5d27dab575e4421464263f28ff1d98df95a9af5"} err="failed to get container status \"277da739fad21f693bcceb96c5d27dab575e4421464263f28ff1d98df95a9af5\": rpc error: code = NotFound desc = could not find container \"277da739fad21f693bcceb96c5d27dab575e4421464263f28ff1d98df95a9af5\": container with ID starting with 277da739fad21f693bcceb96c5d27dab575e4421464263f28ff1d98df95a9af5 not found: ID does not exist" Mar 16 16:43:27 crc kubenswrapper[5120]: I0316 16:43:27.140912 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:43:27 crc kubenswrapper[5120]: I0316 16:43:27.151455 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-northd-0_29c96611-b802-4cfa-a407-7e3c1f341848/ovn-northd/0.log" Mar 16 16:43:27 crc kubenswrapper[5120]: I0316 16:43:27.151541 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:43:27 crc kubenswrapper[5120]: I0316 16:43:27.294343 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-c56d9997c-vh2kg" Mar 16 16:43:27 crc kubenswrapper[5120]: I0316 16:43:27.331346 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/8865ef1d-984f-4076-b151-fff5f7da9e62-config-data-generated\") pod \"8865ef1d-984f-4076-b151-fff5f7da9e62\" (UID: \"8865ef1d-984f-4076-b151-fff5f7da9e62\") " Mar 16 16:43:27 crc kubenswrapper[5120]: I0316 16:43:27.334161 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8865ef1d-984f-4076-b151-fff5f7da9e62-config-data-generated" (OuterVolumeSpecName: "config-data-generated") pod "8865ef1d-984f-4076-b151-fff5f7da9e62" (UID: "8865ef1d-984f-4076-b151-fff5f7da9e62"). InnerVolumeSpecName "config-data-generated". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:43:27 crc kubenswrapper[5120]: I0316 16:43:27.334227 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/29c96611-b802-4cfa-a407-7e3c1f341848-metrics-certs-tls-certs\") pod \"29c96611-b802-4cfa-a407-7e3c1f341848\" (UID: \"29c96611-b802-4cfa-a407-7e3c1f341848\") " Mar 16 16:43:27 crc kubenswrapper[5120]: I0316 16:43:27.336062 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3c2042b3-62bc-476f-b032-91e9f77da74a-logs\") pod \"3c2042b3-62bc-476f-b032-91e9f77da74a\" (UID: \"3c2042b3-62bc-476f-b032-91e9f77da74a\") " Mar 16 16:43:27 crc kubenswrapper[5120]: I0316 16:43:27.336161 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/8865ef1d-984f-4076-b151-fff5f7da9e62-config-data-default\") pod \"8865ef1d-984f-4076-b151-fff5f7da9e62\" (UID: \"8865ef1d-984f-4076-b151-fff5f7da9e62\") " Mar 16 16:43:27 crc kubenswrapper[5120]: I0316 16:43:27.336228 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3c2042b3-62bc-476f-b032-91e9f77da74a-config-data\") pod \"3c2042b3-62bc-476f-b032-91e9f77da74a\" (UID: \"3c2042b3-62bc-476f-b032-91e9f77da74a\") " Mar 16 16:43:27 crc kubenswrapper[5120]: I0316 16:43:27.336320 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/8865ef1d-984f-4076-b151-fff5f7da9e62-kolla-config\") pod \"8865ef1d-984f-4076-b151-fff5f7da9e62\" (UID: \"8865ef1d-984f-4076-b151-fff5f7da9e62\") " Mar 16 16:43:27 crc kubenswrapper[5120]: I0316 16:43:27.336482 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k2v7l\" (UniqueName: \"kubernetes.io/projected/8865ef1d-984f-4076-b151-fff5f7da9e62-kube-api-access-k2v7l\") pod \"8865ef1d-984f-4076-b151-fff5f7da9e62\" (UID: \"8865ef1d-984f-4076-b151-fff5f7da9e62\") " Mar 16 16:43:27 crc kubenswrapper[5120]: I0316 16:43:27.336547 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9ht2d\" (UniqueName: \"kubernetes.io/projected/3c2042b3-62bc-476f-b032-91e9f77da74a-kube-api-access-9ht2d\") pod \"3c2042b3-62bc-476f-b032-91e9f77da74a\" (UID: \"3c2042b3-62bc-476f-b032-91e9f77da74a\") " Mar 16 16:43:27 crc kubenswrapper[5120]: I0316 16:43:27.336743 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3c2042b3-62bc-476f-b032-91e9f77da74a-combined-ca-bundle\") pod \"3c2042b3-62bc-476f-b032-91e9f77da74a\" (UID: \"3c2042b3-62bc-476f-b032-91e9f77da74a\") " Mar 16 16:43:27 crc kubenswrapper[5120]: I0316 16:43:27.336792 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7mt8j\" (UniqueName: \"kubernetes.io/projected/29c96611-b802-4cfa-a407-7e3c1f341848-kube-api-access-7mt8j\") pod \"29c96611-b802-4cfa-a407-7e3c1f341848\" (UID: \"29c96611-b802-4cfa-a407-7e3c1f341848\") " Mar 16 16:43:27 crc kubenswrapper[5120]: I0316 16:43:27.336815 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"mysql-db\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"8865ef1d-984f-4076-b151-fff5f7da9e62\" (UID: \"8865ef1d-984f-4076-b151-fff5f7da9e62\") " Mar 16 16:43:27 crc kubenswrapper[5120]: I0316 16:43:27.336821 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c2042b3-62bc-476f-b032-91e9f77da74a-logs" (OuterVolumeSpecName: "logs") pod "3c2042b3-62bc-476f-b032-91e9f77da74a" (UID: "3c2042b3-62bc-476f-b032-91e9f77da74a"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:43:27 crc kubenswrapper[5120]: I0316 16:43:27.336856 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8865ef1d-984f-4076-b151-fff5f7da9e62-combined-ca-bundle\") pod \"8865ef1d-984f-4076-b151-fff5f7da9e62\" (UID: \"8865ef1d-984f-4076-b151-fff5f7da9e62\") " Mar 16 16:43:27 crc kubenswrapper[5120]: I0316 16:43:27.338419 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8865ef1d-984f-4076-b151-fff5f7da9e62-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "8865ef1d-984f-4076-b151-fff5f7da9e62" (UID: "8865ef1d-984f-4076-b151-fff5f7da9e62"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:43:27 crc kubenswrapper[5120]: I0316 16:43:27.338937 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8865ef1d-984f-4076-b151-fff5f7da9e62-config-data-default" (OuterVolumeSpecName: "config-data-default") pod "8865ef1d-984f-4076-b151-fff5f7da9e62" (UID: "8865ef1d-984f-4076-b151-fff5f7da9e62"). InnerVolumeSpecName "config-data-default". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:43:27 crc kubenswrapper[5120]: I0316 16:43:27.339007 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/29c96611-b802-4cfa-a407-7e3c1f341848-config\") pod \"29c96611-b802-4cfa-a407-7e3c1f341848\" (UID: \"29c96611-b802-4cfa-a407-7e3c1f341848\") " Mar 16 16:43:27 crc kubenswrapper[5120]: I0316 16:43:27.341647 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/29c96611-b802-4cfa-a407-7e3c1f341848-config" (OuterVolumeSpecName: "config") pod "29c96611-b802-4cfa-a407-7e3c1f341848" (UID: "29c96611-b802-4cfa-a407-7e3c1f341848"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:43:27 crc kubenswrapper[5120]: I0316 16:43:27.343027 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8865ef1d-984f-4076-b151-fff5f7da9e62-kube-api-access-k2v7l" (OuterVolumeSpecName: "kube-api-access-k2v7l") pod "8865ef1d-984f-4076-b151-fff5f7da9e62" (UID: "8865ef1d-984f-4076-b151-fff5f7da9e62"). InnerVolumeSpecName "kube-api-access-k2v7l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:43:27 crc kubenswrapper[5120]: I0316 16:43:27.345555 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29c96611-b802-4cfa-a407-7e3c1f341848-kube-api-access-7mt8j" (OuterVolumeSpecName: "kube-api-access-7mt8j") pod "29c96611-b802-4cfa-a407-7e3c1f341848" (UID: "29c96611-b802-4cfa-a407-7e3c1f341848"). InnerVolumeSpecName "kube-api-access-7mt8j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:43:27 crc kubenswrapper[5120]: I0316 16:43:27.346950 5120 generic.go:358] "Generic (PLEG): container finished" podID="8865ef1d-984f-4076-b151-fff5f7da9e62" containerID="335ad75ad4c6e5c7aa60997975d2eea33d69f48a65c3ff6fe6f276f5e804978f" exitCode=0 Mar 16 16:43:27 crc kubenswrapper[5120]: I0316 16:43:27.347484 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:43:27 crc kubenswrapper[5120]: I0316 16:43:27.347986 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"8865ef1d-984f-4076-b151-fff5f7da9e62","Type":"ContainerDied","Data":"335ad75ad4c6e5c7aa60997975d2eea33d69f48a65c3ff6fe6f276f5e804978f"} Mar 16 16:43:27 crc kubenswrapper[5120]: I0316 16:43:27.348018 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"8865ef1d-984f-4076-b151-fff5f7da9e62","Type":"ContainerDied","Data":"d7ae25b207b0c5891990785fefb0b4c7eecae395a53ad1681ec95728f14420df"} Mar 16 16:43:27 crc kubenswrapper[5120]: I0316 16:43:27.348033 5120 scope.go:117] "RemoveContainer" containerID="335ad75ad4c6e5c7aa60997975d2eea33d69f48a65c3ff6fe6f276f5e804978f" Mar 16 16:43:27 crc kubenswrapper[5120]: I0316 16:43:27.350495 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/29c96611-b802-4cfa-a407-7e3c1f341848-scripts" (OuterVolumeSpecName: "scripts") pod "29c96611-b802-4cfa-a407-7e3c1f341848" (UID: "29c96611-b802-4cfa-a407-7e3c1f341848"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:43:27 crc kubenswrapper[5120]: I0316 16:43:27.345951 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/29c96611-b802-4cfa-a407-7e3c1f341848-scripts\") pod \"29c96611-b802-4cfa-a407-7e3c1f341848\" (UID: \"29c96611-b802-4cfa-a407-7e3c1f341848\") " Mar 16 16:43:27 crc kubenswrapper[5120]: I0316 16:43:27.350719 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/29c96611-b802-4cfa-a407-7e3c1f341848-combined-ca-bundle\") pod \"29c96611-b802-4cfa-a407-7e3c1f341848\" (UID: \"29c96611-b802-4cfa-a407-7e3c1f341848\") " Mar 16 16:43:27 crc kubenswrapper[5120]: I0316 16:43:27.353634 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c2042b3-62bc-476f-b032-91e9f77da74a-kube-api-access-9ht2d" (OuterVolumeSpecName: "kube-api-access-9ht2d") pod "3c2042b3-62bc-476f-b032-91e9f77da74a" (UID: "3c2042b3-62bc-476f-b032-91e9f77da74a"). InnerVolumeSpecName "kube-api-access-9ht2d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:43:27 crc kubenswrapper[5120]: I0316 16:43:27.356048 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/8865ef1d-984f-4076-b151-fff5f7da9e62-galera-tls-certs\") pod \"8865ef1d-984f-4076-b151-fff5f7da9e62\" (UID: \"8865ef1d-984f-4076-b151-fff5f7da9e62\") " Mar 16 16:43:27 crc kubenswrapper[5120]: I0316 16:43:27.358150 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-northd-0_29c96611-b802-4cfa-a407-7e3c1f341848/ovn-northd/0.log" Mar 16 16:43:27 crc kubenswrapper[5120]: I0316 16:43:27.357167 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage16-crc" (OuterVolumeSpecName: "mysql-db") pod "8865ef1d-984f-4076-b151-fff5f7da9e62" (UID: "8865ef1d-984f-4076-b151-fff5f7da9e62"). InnerVolumeSpecName "local-storage16-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:43:27 crc kubenswrapper[5120]: I0316 16:43:27.358188 5120 generic.go:358] "Generic (PLEG): container finished" podID="29c96611-b802-4cfa-a407-7e3c1f341848" containerID="34d1842c49bbc63c0f0f4b2770fad4a83f430656dde3d2f187493191f00bdfe3" exitCode=139 Mar 16 16:43:27 crc kubenswrapper[5120]: I0316 16:43:27.358308 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"29c96611-b802-4cfa-a407-7e3c1f341848","Type":"ContainerDied","Data":"34d1842c49bbc63c0f0f4b2770fad4a83f430656dde3d2f187493191f00bdfe3"} Mar 16 16:43:27 crc kubenswrapper[5120]: I0316 16:43:27.358328 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:43:27 crc kubenswrapper[5120]: I0316 16:43:27.358341 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"29c96611-b802-4cfa-a407-7e3c1f341848","Type":"ContainerDied","Data":"59f2debbe0e3d681b420230a19598a1e89458db27bca92b8e7a58a474525cb81"} Mar 16 16:43:27 crc kubenswrapper[5120]: I0316 16:43:27.359464 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/29c96611-b802-4cfa-a407-7e3c1f341848-ovn-northd-tls-certs\") pod \"29c96611-b802-4cfa-a407-7e3c1f341848\" (UID: \"29c96611-b802-4cfa-a407-7e3c1f341848\") " Mar 16 16:43:27 crc kubenswrapper[5120]: I0316 16:43:27.359594 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8865ef1d-984f-4076-b151-fff5f7da9e62-operator-scripts\") pod \"8865ef1d-984f-4076-b151-fff5f7da9e62\" (UID: \"8865ef1d-984f-4076-b151-fff5f7da9e62\") " Mar 16 16:43:27 crc kubenswrapper[5120]: I0316 16:43:27.359892 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/29c96611-b802-4cfa-a407-7e3c1f341848-ovn-rundir\") pod \"29c96611-b802-4cfa-a407-7e3c1f341848\" (UID: \"29c96611-b802-4cfa-a407-7e3c1f341848\") " Mar 16 16:43:27 crc kubenswrapper[5120]: I0316 16:43:27.360853 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/8865ef1d-984f-4076-b151-fff5f7da9e62-config-data-generated\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:27 crc kubenswrapper[5120]: I0316 16:43:27.360876 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3c2042b3-62bc-476f-b032-91e9f77da74a-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:27 crc kubenswrapper[5120]: I0316 16:43:27.360888 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/8865ef1d-984f-4076-b151-fff5f7da9e62-config-data-default\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:27 crc kubenswrapper[5120]: I0316 16:43:27.360899 5120 reconciler_common.go:299] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/8865ef1d-984f-4076-b151-fff5f7da9e62-kolla-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:27 crc kubenswrapper[5120]: I0316 16:43:27.360912 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k2v7l\" (UniqueName: \"kubernetes.io/projected/8865ef1d-984f-4076-b151-fff5f7da9e62-kube-api-access-k2v7l\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:27 crc kubenswrapper[5120]: I0316 16:43:27.360926 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9ht2d\" (UniqueName: \"kubernetes.io/projected/3c2042b3-62bc-476f-b032-91e9f77da74a-kube-api-access-9ht2d\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:27 crc kubenswrapper[5120]: I0316 16:43:27.360937 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7mt8j\" (UniqueName: \"kubernetes.io/projected/29c96611-b802-4cfa-a407-7e3c1f341848-kube-api-access-7mt8j\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:27 crc kubenswrapper[5120]: I0316 16:43:27.360960 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") on node \"crc\" " Mar 16 16:43:27 crc kubenswrapper[5120]: I0316 16:43:27.360975 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/29c96611-b802-4cfa-a407-7e3c1f341848-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:27 crc kubenswrapper[5120]: I0316 16:43:27.360986 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/29c96611-b802-4cfa-a407-7e3c1f341848-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:27 crc kubenswrapper[5120]: I0316 16:43:27.361995 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29c96611-b802-4cfa-a407-7e3c1f341848-ovn-rundir" (OuterVolumeSpecName: "ovn-rundir") pod "29c96611-b802-4cfa-a407-7e3c1f341848" (UID: "29c96611-b802-4cfa-a407-7e3c1f341848"). InnerVolumeSpecName "ovn-rundir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:43:27 crc kubenswrapper[5120]: I0316 16:43:27.362432 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8865ef1d-984f-4076-b151-fff5f7da9e62-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "8865ef1d-984f-4076-b151-fff5f7da9e62" (UID: "8865ef1d-984f-4076-b151-fff5f7da9e62"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:43:27 crc kubenswrapper[5120]: I0316 16:43:27.363527 5120 generic.go:358] "Generic (PLEG): container finished" podID="3c2042b3-62bc-476f-b032-91e9f77da74a" containerID="949e4f70bb7999ef9b809a2b382188ebf770f0042c3c7a32632aa1a421a1c410" exitCode=0 Mar 16 16:43:27 crc kubenswrapper[5120]: I0316 16:43:27.363589 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-c56d9997c-vh2kg" event={"ID":"3c2042b3-62bc-476f-b032-91e9f77da74a","Type":"ContainerDied","Data":"949e4f70bb7999ef9b809a2b382188ebf770f0042c3c7a32632aa1a421a1c410"} Mar 16 16:43:27 crc kubenswrapper[5120]: I0316 16:43:27.363638 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-c56d9997c-vh2kg" event={"ID":"3c2042b3-62bc-476f-b032-91e9f77da74a","Type":"ContainerDied","Data":"be94cdca1770fe3a56fe5f7f6fb1c2b0dab54f21545d1deec9fa322622764aa1"} Mar 16 16:43:27 crc kubenswrapper[5120]: I0316 16:43:27.367671 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-c56d9997c-vh2kg" Mar 16 16:43:27 crc kubenswrapper[5120]: I0316 16:43:27.384240 5120 scope.go:117] "RemoveContainer" containerID="a961aa781ef5a5eaaa105d97a529eea360561ab3e97cdb089a19e58e52d67159" Mar 16 16:43:27 crc kubenswrapper[5120]: I0316 16:43:27.385533 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8865ef1d-984f-4076-b151-fff5f7da9e62-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "8865ef1d-984f-4076-b151-fff5f7da9e62" (UID: "8865ef1d-984f-4076-b151-fff5f7da9e62"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:43:27 crc kubenswrapper[5120]: I0316 16:43:27.390967 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/29c96611-b802-4cfa-a407-7e3c1f341848-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "29c96611-b802-4cfa-a407-7e3c1f341848" (UID: "29c96611-b802-4cfa-a407-7e3c1f341848"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:43:27 crc kubenswrapper[5120]: I0316 16:43:27.398398 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c2042b3-62bc-476f-b032-91e9f77da74a-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "3c2042b3-62bc-476f-b032-91e9f77da74a" (UID: "3c2042b3-62bc-476f-b032-91e9f77da74a"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:43:27 crc kubenswrapper[5120]: I0316 16:43:27.401322 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage16-crc" (UniqueName: "kubernetes.io/local-volume/local-storage16-crc") on node "crc" Mar 16 16:43:27 crc kubenswrapper[5120]: I0316 16:43:27.407951 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c2042b3-62bc-476f-b032-91e9f77da74a-config-data" (OuterVolumeSpecName: "config-data") pod "3c2042b3-62bc-476f-b032-91e9f77da74a" (UID: "3c2042b3-62bc-476f-b032-91e9f77da74a"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:43:27 crc kubenswrapper[5120]: I0316 16:43:27.417956 5120 scope.go:117] "RemoveContainer" containerID="335ad75ad4c6e5c7aa60997975d2eea33d69f48a65c3ff6fe6f276f5e804978f" Mar 16 16:43:27 crc kubenswrapper[5120]: E0316 16:43:27.418992 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"335ad75ad4c6e5c7aa60997975d2eea33d69f48a65c3ff6fe6f276f5e804978f\": container with ID starting with 335ad75ad4c6e5c7aa60997975d2eea33d69f48a65c3ff6fe6f276f5e804978f not found: ID does not exist" containerID="335ad75ad4c6e5c7aa60997975d2eea33d69f48a65c3ff6fe6f276f5e804978f" Mar 16 16:43:27 crc kubenswrapper[5120]: I0316 16:43:27.419661 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8865ef1d-984f-4076-b151-fff5f7da9e62-galera-tls-certs" (OuterVolumeSpecName: "galera-tls-certs") pod "8865ef1d-984f-4076-b151-fff5f7da9e62" (UID: "8865ef1d-984f-4076-b151-fff5f7da9e62"). InnerVolumeSpecName "galera-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:43:27 crc kubenswrapper[5120]: I0316 16:43:27.419510 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"335ad75ad4c6e5c7aa60997975d2eea33d69f48a65c3ff6fe6f276f5e804978f"} err="failed to get container status \"335ad75ad4c6e5c7aa60997975d2eea33d69f48a65c3ff6fe6f276f5e804978f\": rpc error: code = NotFound desc = could not find container \"335ad75ad4c6e5c7aa60997975d2eea33d69f48a65c3ff6fe6f276f5e804978f\": container with ID starting with 335ad75ad4c6e5c7aa60997975d2eea33d69f48a65c3ff6fe6f276f5e804978f not found: ID does not exist" Mar 16 16:43:27 crc kubenswrapper[5120]: I0316 16:43:27.420114 5120 scope.go:117] "RemoveContainer" containerID="a961aa781ef5a5eaaa105d97a529eea360561ab3e97cdb089a19e58e52d67159" Mar 16 16:43:27 crc kubenswrapper[5120]: E0316 16:43:27.422971 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a961aa781ef5a5eaaa105d97a529eea360561ab3e97cdb089a19e58e52d67159\": container with ID starting with a961aa781ef5a5eaaa105d97a529eea360561ab3e97cdb089a19e58e52d67159 not found: ID does not exist" containerID="a961aa781ef5a5eaaa105d97a529eea360561ab3e97cdb089a19e58e52d67159" Mar 16 16:43:27 crc kubenswrapper[5120]: I0316 16:43:27.423011 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a961aa781ef5a5eaaa105d97a529eea360561ab3e97cdb089a19e58e52d67159"} err="failed to get container status \"a961aa781ef5a5eaaa105d97a529eea360561ab3e97cdb089a19e58e52d67159\": rpc error: code = NotFound desc = could not find container \"a961aa781ef5a5eaaa105d97a529eea360561ab3e97cdb089a19e58e52d67159\": container with ID starting with a961aa781ef5a5eaaa105d97a529eea360561ab3e97cdb089a19e58e52d67159 not found: ID does not exist" Mar 16 16:43:27 crc kubenswrapper[5120]: I0316 16:43:27.423351 5120 scope.go:117] "RemoveContainer" containerID="f6f06b9ba370a060b54ec647220d7623fff9a52a71dc33409e4d941230f65d72" Mar 16 16:43:27 crc kubenswrapper[5120]: I0316 16:43:27.428878 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/29c96611-b802-4cfa-a407-7e3c1f341848-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "29c96611-b802-4cfa-a407-7e3c1f341848" (UID: "29c96611-b802-4cfa-a407-7e3c1f341848"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:43:27 crc kubenswrapper[5120]: I0316 16:43:27.451848 5120 scope.go:117] "RemoveContainer" containerID="34d1842c49bbc63c0f0f4b2770fad4a83f430656dde3d2f187493191f00bdfe3" Mar 16 16:43:27 crc kubenswrapper[5120]: I0316 16:43:27.458084 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/29c96611-b802-4cfa-a407-7e3c1f341848-ovn-northd-tls-certs" (OuterVolumeSpecName: "ovn-northd-tls-certs") pod "29c96611-b802-4cfa-a407-7e3c1f341848" (UID: "29c96611-b802-4cfa-a407-7e3c1f341848"). InnerVolumeSpecName "ovn-northd-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:43:27 crc kubenswrapper[5120]: I0316 16:43:27.463130 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/3c2042b3-62bc-476f-b032-91e9f77da74a-config-data-custom\") pod \"3c2042b3-62bc-476f-b032-91e9f77da74a\" (UID: \"3c2042b3-62bc-476f-b032-91e9f77da74a\") " Mar 16 16:43:27 crc kubenswrapper[5120]: I0316 16:43:27.463951 5120 reconciler_common.go:299] "Volume detached for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/8865ef1d-984f-4076-b151-fff5f7da9e62-galera-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:27 crc kubenswrapper[5120]: I0316 16:43:27.463971 5120 reconciler_common.go:299] "Volume detached for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/29c96611-b802-4cfa-a407-7e3c1f341848-ovn-northd-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:27 crc kubenswrapper[5120]: I0316 16:43:27.463981 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8865ef1d-984f-4076-b151-fff5f7da9e62-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:27 crc kubenswrapper[5120]: I0316 16:43:27.463991 5120 reconciler_common.go:299] "Volume detached for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/29c96611-b802-4cfa-a407-7e3c1f341848-ovn-rundir\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:27 crc kubenswrapper[5120]: I0316 16:43:27.463999 5120 reconciler_common.go:299] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/29c96611-b802-4cfa-a407-7e3c1f341848-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:27 crc kubenswrapper[5120]: I0316 16:43:27.464009 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3c2042b3-62bc-476f-b032-91e9f77da74a-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:27 crc kubenswrapper[5120]: I0316 16:43:27.464018 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3c2042b3-62bc-476f-b032-91e9f77da74a-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:27 crc kubenswrapper[5120]: I0316 16:43:27.464027 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:27 crc kubenswrapper[5120]: I0316 16:43:27.464036 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8865ef1d-984f-4076-b151-fff5f7da9e62-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:27 crc kubenswrapper[5120]: I0316 16:43:27.464046 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/29c96611-b802-4cfa-a407-7e3c1f341848-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:27 crc kubenswrapper[5120]: I0316 16:43:27.478241 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c2042b3-62bc-476f-b032-91e9f77da74a-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "3c2042b3-62bc-476f-b032-91e9f77da74a" (UID: "3c2042b3-62bc-476f-b032-91e9f77da74a"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:43:27 crc kubenswrapper[5120]: I0316 16:43:27.524635 5120 scope.go:117] "RemoveContainer" containerID="f6f06b9ba370a060b54ec647220d7623fff9a52a71dc33409e4d941230f65d72" Mar 16 16:43:27 crc kubenswrapper[5120]: E0316 16:43:27.525173 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f6f06b9ba370a060b54ec647220d7623fff9a52a71dc33409e4d941230f65d72\": container with ID starting with f6f06b9ba370a060b54ec647220d7623fff9a52a71dc33409e4d941230f65d72 not found: ID does not exist" containerID="f6f06b9ba370a060b54ec647220d7623fff9a52a71dc33409e4d941230f65d72" Mar 16 16:43:27 crc kubenswrapper[5120]: I0316 16:43:27.525329 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6f06b9ba370a060b54ec647220d7623fff9a52a71dc33409e4d941230f65d72"} err="failed to get container status \"f6f06b9ba370a060b54ec647220d7623fff9a52a71dc33409e4d941230f65d72\": rpc error: code = NotFound desc = could not find container \"f6f06b9ba370a060b54ec647220d7623fff9a52a71dc33409e4d941230f65d72\": container with ID starting with f6f06b9ba370a060b54ec647220d7623fff9a52a71dc33409e4d941230f65d72 not found: ID does not exist" Mar 16 16:43:27 crc kubenswrapper[5120]: I0316 16:43:27.525470 5120 scope.go:117] "RemoveContainer" containerID="34d1842c49bbc63c0f0f4b2770fad4a83f430656dde3d2f187493191f00bdfe3" Mar 16 16:43:27 crc kubenswrapper[5120]: E0316 16:43:27.525989 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"34d1842c49bbc63c0f0f4b2770fad4a83f430656dde3d2f187493191f00bdfe3\": container with ID starting with 34d1842c49bbc63c0f0f4b2770fad4a83f430656dde3d2f187493191f00bdfe3 not found: ID does not exist" containerID="34d1842c49bbc63c0f0f4b2770fad4a83f430656dde3d2f187493191f00bdfe3" Mar 16 16:43:27 crc kubenswrapper[5120]: I0316 16:43:27.526027 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34d1842c49bbc63c0f0f4b2770fad4a83f430656dde3d2f187493191f00bdfe3"} err="failed to get container status \"34d1842c49bbc63c0f0f4b2770fad4a83f430656dde3d2f187493191f00bdfe3\": rpc error: code = NotFound desc = could not find container \"34d1842c49bbc63c0f0f4b2770fad4a83f430656dde3d2f187493191f00bdfe3\": container with ID starting with 34d1842c49bbc63c0f0f4b2770fad4a83f430656dde3d2f187493191f00bdfe3 not found: ID does not exist" Mar 16 16:43:27 crc kubenswrapper[5120]: I0316 16:43:27.526050 5120 scope.go:117] "RemoveContainer" containerID="949e4f70bb7999ef9b809a2b382188ebf770f0042c3c7a32632aa1a421a1c410" Mar 16 16:43:27 crc kubenswrapper[5120]: I0316 16:43:27.553228 5120 scope.go:117] "RemoveContainer" containerID="8758aab696f8e16a21039b2ad2fa60ce136ffc8c8ef68d51ec645a3466e74a97" Mar 16 16:43:27 crc kubenswrapper[5120]: I0316 16:43:27.565989 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/3c2042b3-62bc-476f-b032-91e9f77da74a-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:27 crc kubenswrapper[5120]: I0316 16:43:27.573597 5120 scope.go:117] "RemoveContainer" containerID="949e4f70bb7999ef9b809a2b382188ebf770f0042c3c7a32632aa1a421a1c410" Mar 16 16:43:27 crc kubenswrapper[5120]: E0316 16:43:27.574021 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"949e4f70bb7999ef9b809a2b382188ebf770f0042c3c7a32632aa1a421a1c410\": container with ID starting with 949e4f70bb7999ef9b809a2b382188ebf770f0042c3c7a32632aa1a421a1c410 not found: ID does not exist" containerID="949e4f70bb7999ef9b809a2b382188ebf770f0042c3c7a32632aa1a421a1c410" Mar 16 16:43:27 crc kubenswrapper[5120]: I0316 16:43:27.574055 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"949e4f70bb7999ef9b809a2b382188ebf770f0042c3c7a32632aa1a421a1c410"} err="failed to get container status \"949e4f70bb7999ef9b809a2b382188ebf770f0042c3c7a32632aa1a421a1c410\": rpc error: code = NotFound desc = could not find container \"949e4f70bb7999ef9b809a2b382188ebf770f0042c3c7a32632aa1a421a1c410\": container with ID starting with 949e4f70bb7999ef9b809a2b382188ebf770f0042c3c7a32632aa1a421a1c410 not found: ID does not exist" Mar 16 16:43:27 crc kubenswrapper[5120]: I0316 16:43:27.574083 5120 scope.go:117] "RemoveContainer" containerID="8758aab696f8e16a21039b2ad2fa60ce136ffc8c8ef68d51ec645a3466e74a97" Mar 16 16:43:27 crc kubenswrapper[5120]: E0316 16:43:27.574661 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8758aab696f8e16a21039b2ad2fa60ce136ffc8c8ef68d51ec645a3466e74a97\": container with ID starting with 8758aab696f8e16a21039b2ad2fa60ce136ffc8c8ef68d51ec645a3466e74a97 not found: ID does not exist" containerID="8758aab696f8e16a21039b2ad2fa60ce136ffc8c8ef68d51ec645a3466e74a97" Mar 16 16:43:27 crc kubenswrapper[5120]: I0316 16:43:27.574698 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8758aab696f8e16a21039b2ad2fa60ce136ffc8c8ef68d51ec645a3466e74a97"} err="failed to get container status \"8758aab696f8e16a21039b2ad2fa60ce136ffc8c8ef68d51ec645a3466e74a97\": rpc error: code = NotFound desc = could not find container \"8758aab696f8e16a21039b2ad2fa60ce136ffc8c8ef68d51ec645a3466e74a97\": container with ID starting with 8758aab696f8e16a21039b2ad2fa60ce136ffc8c8ef68d51ec645a3466e74a97 not found: ID does not exist" Mar 16 16:43:27 crc kubenswrapper[5120]: I0316 16:43:27.683455 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 16:43:27 crc kubenswrapper[5120]: I0316 16:43:27.690636 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 16:43:27 crc kubenswrapper[5120]: I0316 16:43:27.716253 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 16:43:27 crc kubenswrapper[5120]: I0316 16:43:27.727047 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 16:43:27 crc kubenswrapper[5120]: I0316 16:43:27.735756 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-c56d9997c-vh2kg"] Mar 16 16:43:27 crc kubenswrapper[5120]: I0316 16:43:27.744555 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-worker-c56d9997c-vh2kg"] Mar 16 16:43:27 crc kubenswrapper[5120]: I0316 16:43:27.839881 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-765d49ff54-tqw2c" Mar 16 16:43:27 crc kubenswrapper[5120]: I0316 16:43:27.873683 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4a708d1c-43d9-400d-a30e-49891c1fc39d-combined-ca-bundle\") pod \"4a708d1c-43d9-400d-a30e-49891c1fc39d\" (UID: \"4a708d1c-43d9-400d-a30e-49891c1fc39d\") " Mar 16 16:43:27 crc kubenswrapper[5120]: I0316 16:43:27.873819 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4a708d1c-43d9-400d-a30e-49891c1fc39d-logs\") pod \"4a708d1c-43d9-400d-a30e-49891c1fc39d\" (UID: \"4a708d1c-43d9-400d-a30e-49891c1fc39d\") " Mar 16 16:43:27 crc kubenswrapper[5120]: I0316 16:43:27.874042 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sth64\" (UniqueName: \"kubernetes.io/projected/4a708d1c-43d9-400d-a30e-49891c1fc39d-kube-api-access-sth64\") pod \"4a708d1c-43d9-400d-a30e-49891c1fc39d\" (UID: \"4a708d1c-43d9-400d-a30e-49891c1fc39d\") " Mar 16 16:43:27 crc kubenswrapper[5120]: I0316 16:43:27.874368 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/4a708d1c-43d9-400d-a30e-49891c1fc39d-config-data-custom\") pod \"4a708d1c-43d9-400d-a30e-49891c1fc39d\" (UID: \"4a708d1c-43d9-400d-a30e-49891c1fc39d\") " Mar 16 16:43:27 crc kubenswrapper[5120]: I0316 16:43:27.874398 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a708d1c-43d9-400d-a30e-49891c1fc39d-logs" (OuterVolumeSpecName: "logs") pod "4a708d1c-43d9-400d-a30e-49891c1fc39d" (UID: "4a708d1c-43d9-400d-a30e-49891c1fc39d"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:43:27 crc kubenswrapper[5120]: I0316 16:43:27.874429 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4a708d1c-43d9-400d-a30e-49891c1fc39d-config-data\") pod \"4a708d1c-43d9-400d-a30e-49891c1fc39d\" (UID: \"4a708d1c-43d9-400d-a30e-49891c1fc39d\") " Mar 16 16:43:27 crc kubenswrapper[5120]: I0316 16:43:27.874877 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4a708d1c-43d9-400d-a30e-49891c1fc39d-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:27 crc kubenswrapper[5120]: I0316 16:43:27.877582 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a708d1c-43d9-400d-a30e-49891c1fc39d-kube-api-access-sth64" (OuterVolumeSpecName: "kube-api-access-sth64") pod "4a708d1c-43d9-400d-a30e-49891c1fc39d" (UID: "4a708d1c-43d9-400d-a30e-49891c1fc39d"). InnerVolumeSpecName "kube-api-access-sth64". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:43:27 crc kubenswrapper[5120]: I0316 16:43:27.878693 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4a708d1c-43d9-400d-a30e-49891c1fc39d-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "4a708d1c-43d9-400d-a30e-49891c1fc39d" (UID: "4a708d1c-43d9-400d-a30e-49891c1fc39d"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:43:27 crc kubenswrapper[5120]: I0316 16:43:27.916881 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4a708d1c-43d9-400d-a30e-49891c1fc39d-config-data" (OuterVolumeSpecName: "config-data") pod "4a708d1c-43d9-400d-a30e-49891c1fc39d" (UID: "4a708d1c-43d9-400d-a30e-49891c1fc39d"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:43:27 crc kubenswrapper[5120]: I0316 16:43:27.925419 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4a708d1c-43d9-400d-a30e-49891c1fc39d-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "4a708d1c-43d9-400d-a30e-49891c1fc39d" (UID: "4a708d1c-43d9-400d-a30e-49891c1fc39d"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:43:27 crc kubenswrapper[5120]: I0316 16:43:27.976939 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sth64\" (UniqueName: \"kubernetes.io/projected/4a708d1c-43d9-400d-a30e-49891c1fc39d-kube-api-access-sth64\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:27 crc kubenswrapper[5120]: I0316 16:43:27.976984 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/4a708d1c-43d9-400d-a30e-49891c1fc39d-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:27 crc kubenswrapper[5120]: I0316 16:43:27.976997 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4a708d1c-43d9-400d-a30e-49891c1fc39d-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:27 crc kubenswrapper[5120]: I0316 16:43:27.977010 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4a708d1c-43d9-400d-a30e-49891c1fc39d-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:28 crc kubenswrapper[5120]: I0316 16:43:28.363606 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-74449f99d8-kxw96" Mar 16 16:43:28 crc kubenswrapper[5120]: I0316 16:43:28.385154 5120 generic.go:358] "Generic (PLEG): container finished" podID="c5223e38-12b9-4877-9a14-585ddcd5f699" containerID="55c1a4c9a3f03915d38301396988693dd2d55bb4144258171015d74cd76e83e2" exitCode=0 Mar 16 16:43:28 crc kubenswrapper[5120]: I0316 16:43:28.385304 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-74449f99d8-kxw96" event={"ID":"c5223e38-12b9-4877-9a14-585ddcd5f699","Type":"ContainerDied","Data":"55c1a4c9a3f03915d38301396988693dd2d55bb4144258171015d74cd76e83e2"} Mar 16 16:43:28 crc kubenswrapper[5120]: I0316 16:43:28.385328 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-74449f99d8-kxw96" event={"ID":"c5223e38-12b9-4877-9a14-585ddcd5f699","Type":"ContainerDied","Data":"3ec9aba3ae79918c6e60be3630e85df012ed6fef4d636eb07f2448c2e855ba01"} Mar 16 16:43:28 crc kubenswrapper[5120]: I0316 16:43:28.385347 5120 scope.go:117] "RemoveContainer" containerID="55c1a4c9a3f03915d38301396988693dd2d55bb4144258171015d74cd76e83e2" Mar 16 16:43:28 crc kubenswrapper[5120]: I0316 16:43:28.385499 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-74449f99d8-kxw96" Mar 16 16:43:28 crc kubenswrapper[5120]: I0316 16:43:28.389640 5120 generic.go:358] "Generic (PLEG): container finished" podID="4a708d1c-43d9-400d-a30e-49891c1fc39d" containerID="fd6cc5b58b834ed8099c46e4fff55a73b512c1ee55040e9d9dc4c8fc1f7a5b90" exitCode=0 Mar 16 16:43:28 crc kubenswrapper[5120]: I0316 16:43:28.389690 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-765d49ff54-tqw2c" event={"ID":"4a708d1c-43d9-400d-a30e-49891c1fc39d","Type":"ContainerDied","Data":"fd6cc5b58b834ed8099c46e4fff55a73b512c1ee55040e9d9dc4c8fc1f7a5b90"} Mar 16 16:43:28 crc kubenswrapper[5120]: I0316 16:43:28.389709 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-765d49ff54-tqw2c" event={"ID":"4a708d1c-43d9-400d-a30e-49891c1fc39d","Type":"ContainerDied","Data":"91e1d114437a9a095ceef9b65070addb3b4be7d39f0aa82278b39e2e2451e97c"} Mar 16 16:43:28 crc kubenswrapper[5120]: I0316 16:43:28.390188 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-765d49ff54-tqw2c" Mar 16 16:43:28 crc kubenswrapper[5120]: I0316 16:43:28.439714 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-765d49ff54-tqw2c"] Mar 16 16:43:28 crc kubenswrapper[5120]: I0316 16:43:28.440871 5120 scope.go:117] "RemoveContainer" containerID="55c1a4c9a3f03915d38301396988693dd2d55bb4144258171015d74cd76e83e2" Mar 16 16:43:28 crc kubenswrapper[5120]: E0316 16:43:28.442325 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"55c1a4c9a3f03915d38301396988693dd2d55bb4144258171015d74cd76e83e2\": container with ID starting with 55c1a4c9a3f03915d38301396988693dd2d55bb4144258171015d74cd76e83e2 not found: ID does not exist" containerID="55c1a4c9a3f03915d38301396988693dd2d55bb4144258171015d74cd76e83e2" Mar 16 16:43:28 crc kubenswrapper[5120]: I0316 16:43:28.442370 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55c1a4c9a3f03915d38301396988693dd2d55bb4144258171015d74cd76e83e2"} err="failed to get container status \"55c1a4c9a3f03915d38301396988693dd2d55bb4144258171015d74cd76e83e2\": rpc error: code = NotFound desc = could not find container \"55c1a4c9a3f03915d38301396988693dd2d55bb4144258171015d74cd76e83e2\": container with ID starting with 55c1a4c9a3f03915d38301396988693dd2d55bb4144258171015d74cd76e83e2 not found: ID does not exist" Mar 16 16:43:28 crc kubenswrapper[5120]: I0316 16:43:28.442400 5120 scope.go:117] "RemoveContainer" containerID="fd6cc5b58b834ed8099c46e4fff55a73b512c1ee55040e9d9dc4c8fc1f7a5b90" Mar 16 16:43:28 crc kubenswrapper[5120]: I0316 16:43:28.447473 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-765d49ff54-tqw2c"] Mar 16 16:43:28 crc kubenswrapper[5120]: I0316 16:43:28.466346 5120 scope.go:117] "RemoveContainer" containerID="e250e191466949db84d88142ed546c60f83649e54cf2f42de0deda2997829841" Mar 16 16:43:28 crc kubenswrapper[5120]: I0316 16:43:28.484001 5120 scope.go:117] "RemoveContainer" containerID="fd6cc5b58b834ed8099c46e4fff55a73b512c1ee55040e9d9dc4c8fc1f7a5b90" Mar 16 16:43:28 crc kubenswrapper[5120]: E0316 16:43:28.484398 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fd6cc5b58b834ed8099c46e4fff55a73b512c1ee55040e9d9dc4c8fc1f7a5b90\": container with ID starting with fd6cc5b58b834ed8099c46e4fff55a73b512c1ee55040e9d9dc4c8fc1f7a5b90 not found: ID does not exist" containerID="fd6cc5b58b834ed8099c46e4fff55a73b512c1ee55040e9d9dc4c8fc1f7a5b90" Mar 16 16:43:28 crc kubenswrapper[5120]: I0316 16:43:28.484437 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd6cc5b58b834ed8099c46e4fff55a73b512c1ee55040e9d9dc4c8fc1f7a5b90"} err="failed to get container status \"fd6cc5b58b834ed8099c46e4fff55a73b512c1ee55040e9d9dc4c8fc1f7a5b90\": rpc error: code = NotFound desc = could not find container \"fd6cc5b58b834ed8099c46e4fff55a73b512c1ee55040e9d9dc4c8fc1f7a5b90\": container with ID starting with fd6cc5b58b834ed8099c46e4fff55a73b512c1ee55040e9d9dc4c8fc1f7a5b90 not found: ID does not exist" Mar 16 16:43:28 crc kubenswrapper[5120]: I0316 16:43:28.484465 5120 scope.go:117] "RemoveContainer" containerID="e250e191466949db84d88142ed546c60f83649e54cf2f42de0deda2997829841" Mar 16 16:43:28 crc kubenswrapper[5120]: E0316 16:43:28.484850 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e250e191466949db84d88142ed546c60f83649e54cf2f42de0deda2997829841\": container with ID starting with e250e191466949db84d88142ed546c60f83649e54cf2f42de0deda2997829841 not found: ID does not exist" containerID="e250e191466949db84d88142ed546c60f83649e54cf2f42de0deda2997829841" Mar 16 16:43:28 crc kubenswrapper[5120]: I0316 16:43:28.484874 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e250e191466949db84d88142ed546c60f83649e54cf2f42de0deda2997829841"} err="failed to get container status \"e250e191466949db84d88142ed546c60f83649e54cf2f42de0deda2997829841\": rpc error: code = NotFound desc = could not find container \"e250e191466949db84d88142ed546c60f83649e54cf2f42de0deda2997829841\": container with ID starting with e250e191466949db84d88142ed546c60f83649e54cf2f42de0deda2997829841 not found: ID does not exist" Mar 16 16:43:28 crc kubenswrapper[5120]: I0316 16:43:28.497711 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hld5m\" (UniqueName: \"kubernetes.io/projected/c5223e38-12b9-4877-9a14-585ddcd5f699-kube-api-access-hld5m\") pod \"c5223e38-12b9-4877-9a14-585ddcd5f699\" (UID: \"c5223e38-12b9-4877-9a14-585ddcd5f699\") " Mar 16 16:43:28 crc kubenswrapper[5120]: I0316 16:43:28.497806 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/c5223e38-12b9-4877-9a14-585ddcd5f699-credential-keys\") pod \"c5223e38-12b9-4877-9a14-585ddcd5f699\" (UID: \"c5223e38-12b9-4877-9a14-585ddcd5f699\") " Mar 16 16:43:28 crc kubenswrapper[5120]: I0316 16:43:28.497990 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/c5223e38-12b9-4877-9a14-585ddcd5f699-internal-tls-certs\") pod \"c5223e38-12b9-4877-9a14-585ddcd5f699\" (UID: \"c5223e38-12b9-4877-9a14-585ddcd5f699\") " Mar 16 16:43:28 crc kubenswrapper[5120]: I0316 16:43:28.498100 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c5223e38-12b9-4877-9a14-585ddcd5f699-config-data\") pod \"c5223e38-12b9-4877-9a14-585ddcd5f699\" (UID: \"c5223e38-12b9-4877-9a14-585ddcd5f699\") " Mar 16 16:43:28 crc kubenswrapper[5120]: I0316 16:43:28.498206 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/c5223e38-12b9-4877-9a14-585ddcd5f699-public-tls-certs\") pod \"c5223e38-12b9-4877-9a14-585ddcd5f699\" (UID: \"c5223e38-12b9-4877-9a14-585ddcd5f699\") " Mar 16 16:43:28 crc kubenswrapper[5120]: I0316 16:43:28.498449 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c5223e38-12b9-4877-9a14-585ddcd5f699-combined-ca-bundle\") pod \"c5223e38-12b9-4877-9a14-585ddcd5f699\" (UID: \"c5223e38-12b9-4877-9a14-585ddcd5f699\") " Mar 16 16:43:28 crc kubenswrapper[5120]: I0316 16:43:28.498503 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c5223e38-12b9-4877-9a14-585ddcd5f699-scripts\") pod \"c5223e38-12b9-4877-9a14-585ddcd5f699\" (UID: \"c5223e38-12b9-4877-9a14-585ddcd5f699\") " Mar 16 16:43:28 crc kubenswrapper[5120]: I0316 16:43:28.498624 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/c5223e38-12b9-4877-9a14-585ddcd5f699-fernet-keys\") pod \"c5223e38-12b9-4877-9a14-585ddcd5f699\" (UID: \"c5223e38-12b9-4877-9a14-585ddcd5f699\") " Mar 16 16:43:28 crc kubenswrapper[5120]: I0316 16:43:28.503918 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c5223e38-12b9-4877-9a14-585ddcd5f699-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "c5223e38-12b9-4877-9a14-585ddcd5f699" (UID: "c5223e38-12b9-4877-9a14-585ddcd5f699"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:43:28 crc kubenswrapper[5120]: I0316 16:43:28.504026 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5223e38-12b9-4877-9a14-585ddcd5f699-kube-api-access-hld5m" (OuterVolumeSpecName: "kube-api-access-hld5m") pod "c5223e38-12b9-4877-9a14-585ddcd5f699" (UID: "c5223e38-12b9-4877-9a14-585ddcd5f699"). InnerVolumeSpecName "kube-api-access-hld5m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:43:28 crc kubenswrapper[5120]: I0316 16:43:28.505571 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c5223e38-12b9-4877-9a14-585ddcd5f699-scripts" (OuterVolumeSpecName: "scripts") pod "c5223e38-12b9-4877-9a14-585ddcd5f699" (UID: "c5223e38-12b9-4877-9a14-585ddcd5f699"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:43:28 crc kubenswrapper[5120]: I0316 16:43:28.507674 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c5223e38-12b9-4877-9a14-585ddcd5f699-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "c5223e38-12b9-4877-9a14-585ddcd5f699" (UID: "c5223e38-12b9-4877-9a14-585ddcd5f699"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:43:28 crc kubenswrapper[5120]: I0316 16:43:28.531276 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c5223e38-12b9-4877-9a14-585ddcd5f699-config-data" (OuterVolumeSpecName: "config-data") pod "c5223e38-12b9-4877-9a14-585ddcd5f699" (UID: "c5223e38-12b9-4877-9a14-585ddcd5f699"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:43:28 crc kubenswrapper[5120]: I0316 16:43:28.533225 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c5223e38-12b9-4877-9a14-585ddcd5f699-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "c5223e38-12b9-4877-9a14-585ddcd5f699" (UID: "c5223e38-12b9-4877-9a14-585ddcd5f699"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:43:28 crc kubenswrapper[5120]: I0316 16:43:28.538145 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c5223e38-12b9-4877-9a14-585ddcd5f699-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "c5223e38-12b9-4877-9a14-585ddcd5f699" (UID: "c5223e38-12b9-4877-9a14-585ddcd5f699"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:43:28 crc kubenswrapper[5120]: I0316 16:43:28.539642 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c5223e38-12b9-4877-9a14-585ddcd5f699-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "c5223e38-12b9-4877-9a14-585ddcd5f699" (UID: "c5223e38-12b9-4877-9a14-585ddcd5f699"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:43:28 crc kubenswrapper[5120]: I0316 16:43:28.602924 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c5223e38-12b9-4877-9a14-585ddcd5f699-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:28 crc kubenswrapper[5120]: I0316 16:43:28.602972 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c5223e38-12b9-4877-9a14-585ddcd5f699-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:28 crc kubenswrapper[5120]: I0316 16:43:28.602986 5120 reconciler_common.go:299] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/c5223e38-12b9-4877-9a14-585ddcd5f699-fernet-keys\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:28 crc kubenswrapper[5120]: I0316 16:43:28.602999 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hld5m\" (UniqueName: \"kubernetes.io/projected/c5223e38-12b9-4877-9a14-585ddcd5f699-kube-api-access-hld5m\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:28 crc kubenswrapper[5120]: I0316 16:43:28.603013 5120 reconciler_common.go:299] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/c5223e38-12b9-4877-9a14-585ddcd5f699-credential-keys\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:28 crc kubenswrapper[5120]: I0316 16:43:28.603028 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/c5223e38-12b9-4877-9a14-585ddcd5f699-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:28 crc kubenswrapper[5120]: I0316 16:43:28.603042 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c5223e38-12b9-4877-9a14-585ddcd5f699-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:28 crc kubenswrapper[5120]: I0316 16:43:28.603054 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/c5223e38-12b9-4877-9a14-585ddcd5f699-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:28 crc kubenswrapper[5120]: I0316 16:43:28.674672 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1518bfb1-3665-455c-84df-7c6eba7b93cf" path="/var/lib/kubelet/pods/1518bfb1-3665-455c-84df-7c6eba7b93cf/volumes" Mar 16 16:43:28 crc kubenswrapper[5120]: I0316 16:43:28.676217 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="29c96611-b802-4cfa-a407-7e3c1f341848" path="/var/lib/kubelet/pods/29c96611-b802-4cfa-a407-7e3c1f341848/volumes" Mar 16 16:43:28 crc kubenswrapper[5120]: I0316 16:43:28.677405 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="37490319-0529-4ab4-a97a-3dc9486aa867" path="/var/lib/kubelet/pods/37490319-0529-4ab4-a97a-3dc9486aa867/volumes" Mar 16 16:43:28 crc kubenswrapper[5120]: I0316 16:43:28.678699 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c2042b3-62bc-476f-b032-91e9f77da74a" path="/var/lib/kubelet/pods/3c2042b3-62bc-476f-b032-91e9f77da74a/volumes" Mar 16 16:43:28 crc kubenswrapper[5120]: I0316 16:43:28.679806 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4a708d1c-43d9-400d-a30e-49891c1fc39d" path="/var/lib/kubelet/pods/4a708d1c-43d9-400d-a30e-49891c1fc39d/volumes" Mar 16 16:43:28 crc kubenswrapper[5120]: I0316 16:43:28.680455 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8865ef1d-984f-4076-b151-fff5f7da9e62" path="/var/lib/kubelet/pods/8865ef1d-984f-4076-b151-fff5f7da9e62/volumes" Mar 16 16:43:28 crc kubenswrapper[5120]: I0316 16:43:28.682684 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="935a7850-d7f8-438f-a787-6a78e33db090" path="/var/lib/kubelet/pods/935a7850-d7f8-438f-a787-6a78e33db090/volumes" Mar 16 16:43:28 crc kubenswrapper[5120]: I0316 16:43:28.683871 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="be094b3e-494e-420d-b458-0e32770cd540" path="/var/lib/kubelet/pods/be094b3e-494e-420d-b458-0e32770cd540/volumes" Mar 16 16:43:28 crc kubenswrapper[5120]: I0316 16:43:28.718412 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-74449f99d8-kxw96"] Mar 16 16:43:28 crc kubenswrapper[5120]: I0316 16:43:28.724495 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-74449f99d8-kxw96"] Mar 16 16:43:30 crc kubenswrapper[5120]: I0316 16:43:30.427475 5120 generic.go:358] "Generic (PLEG): container finished" podID="55a201e2-20da-49c3-8216-77a042dd3b31" containerID="724c0b5146b4e94ddc111cbeb4d390d8b4e39776e5bfd86f681203d76b6919bb" exitCode=0 Mar 16 16:43:30 crc kubenswrapper[5120]: I0316 16:43:30.427563 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"55a201e2-20da-49c3-8216-77a042dd3b31","Type":"ContainerDied","Data":"724c0b5146b4e94ddc111cbeb4d390d8b4e39776e5bfd86f681203d76b6919bb"} Mar 16 16:43:30 crc kubenswrapper[5120]: I0316 16:43:30.674682 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c5223e38-12b9-4877-9a14-585ddcd5f699" path="/var/lib/kubelet/pods/c5223e38-12b9-4877-9a14-585ddcd5f699/volumes" Mar 16 16:43:30 crc kubenswrapper[5120]: E0316 16:43:30.750538 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-config-data: configmap "rabbitmq-config-data" not found Mar 16 16:43:30 crc kubenswrapper[5120]: E0316 16:43:30.750692 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/55a201e2-20da-49c3-8216-77a042dd3b31-config-data podName:55a201e2-20da-49c3-8216-77a042dd3b31 nodeName:}" failed. No retries permitted until 2026-03-16 16:43:38.750674721 +0000 UTC m=+4320.904606378 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/55a201e2-20da-49c3-8216-77a042dd3b31-config-data") pod "rabbitmq-server-0" (UID: "55a201e2-20da-49c3-8216-77a042dd3b31") : configmap "rabbitmq-config-data" not found Mar 16 16:43:30 crc kubenswrapper[5120]: I0316 16:43:30.779037 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:43:30 crc kubenswrapper[5120]: I0316 16:43:30.851847 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/55a201e2-20da-49c3-8216-77a042dd3b31-rabbitmq-plugins\") pod \"55a201e2-20da-49c3-8216-77a042dd3b31\" (UID: \"55a201e2-20da-49c3-8216-77a042dd3b31\") " Mar 16 16:43:30 crc kubenswrapper[5120]: I0316 16:43:30.851912 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/55a201e2-20da-49c3-8216-77a042dd3b31-config-data\") pod \"55a201e2-20da-49c3-8216-77a042dd3b31\" (UID: \"55a201e2-20da-49c3-8216-77a042dd3b31\") " Mar 16 16:43:30 crc kubenswrapper[5120]: I0316 16:43:30.851937 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/55a201e2-20da-49c3-8216-77a042dd3b31-rabbitmq-erlang-cookie\") pod \"55a201e2-20da-49c3-8216-77a042dd3b31\" (UID: \"55a201e2-20da-49c3-8216-77a042dd3b31\") " Mar 16 16:43:30 crc kubenswrapper[5120]: I0316 16:43:30.851974 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kxvrq\" (UniqueName: \"kubernetes.io/projected/55a201e2-20da-49c3-8216-77a042dd3b31-kube-api-access-kxvrq\") pod \"55a201e2-20da-49c3-8216-77a042dd3b31\" (UID: \"55a201e2-20da-49c3-8216-77a042dd3b31\") " Mar 16 16:43:30 crc kubenswrapper[5120]: I0316 16:43:30.852057 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/55a201e2-20da-49c3-8216-77a042dd3b31-plugins-conf\") pod \"55a201e2-20da-49c3-8216-77a042dd3b31\" (UID: \"55a201e2-20da-49c3-8216-77a042dd3b31\") " Mar 16 16:43:30 crc kubenswrapper[5120]: I0316 16:43:30.852115 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/55a201e2-20da-49c3-8216-77a042dd3b31-rabbitmq-tls\") pod \"55a201e2-20da-49c3-8216-77a042dd3b31\" (UID: \"55a201e2-20da-49c3-8216-77a042dd3b31\") " Mar 16 16:43:30 crc kubenswrapper[5120]: I0316 16:43:30.852199 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"persistence\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") pod \"55a201e2-20da-49c3-8216-77a042dd3b31\" (UID: \"55a201e2-20da-49c3-8216-77a042dd3b31\") " Mar 16 16:43:30 crc kubenswrapper[5120]: I0316 16:43:30.852304 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/55a201e2-20da-49c3-8216-77a042dd3b31-rabbitmq-confd\") pod \"55a201e2-20da-49c3-8216-77a042dd3b31\" (UID: \"55a201e2-20da-49c3-8216-77a042dd3b31\") " Mar 16 16:43:30 crc kubenswrapper[5120]: I0316 16:43:30.852497 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/55a201e2-20da-49c3-8216-77a042dd3b31-server-conf\") pod \"55a201e2-20da-49c3-8216-77a042dd3b31\" (UID: \"55a201e2-20da-49c3-8216-77a042dd3b31\") " Mar 16 16:43:30 crc kubenswrapper[5120]: I0316 16:43:30.852599 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/55a201e2-20da-49c3-8216-77a042dd3b31-erlang-cookie-secret\") pod \"55a201e2-20da-49c3-8216-77a042dd3b31\" (UID: \"55a201e2-20da-49c3-8216-77a042dd3b31\") " Mar 16 16:43:30 crc kubenswrapper[5120]: I0316 16:43:30.852649 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/55a201e2-20da-49c3-8216-77a042dd3b31-pod-info\") pod \"55a201e2-20da-49c3-8216-77a042dd3b31\" (UID: \"55a201e2-20da-49c3-8216-77a042dd3b31\") " Mar 16 16:43:30 crc kubenswrapper[5120]: I0316 16:43:30.852699 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55a201e2-20da-49c3-8216-77a042dd3b31-rabbitmq-plugins" (OuterVolumeSpecName: "rabbitmq-plugins") pod "55a201e2-20da-49c3-8216-77a042dd3b31" (UID: "55a201e2-20da-49c3-8216-77a042dd3b31"). InnerVolumeSpecName "rabbitmq-plugins". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:43:30 crc kubenswrapper[5120]: I0316 16:43:30.852924 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/55a201e2-20da-49c3-8216-77a042dd3b31-plugins-conf" (OuterVolumeSpecName: "plugins-conf") pod "55a201e2-20da-49c3-8216-77a042dd3b31" (UID: "55a201e2-20da-49c3-8216-77a042dd3b31"). InnerVolumeSpecName "plugins-conf". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:43:30 crc kubenswrapper[5120]: I0316 16:43:30.853327 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55a201e2-20da-49c3-8216-77a042dd3b31-rabbitmq-erlang-cookie" (OuterVolumeSpecName: "rabbitmq-erlang-cookie") pod "55a201e2-20da-49c3-8216-77a042dd3b31" (UID: "55a201e2-20da-49c3-8216-77a042dd3b31"). InnerVolumeSpecName "rabbitmq-erlang-cookie". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:43:30 crc kubenswrapper[5120]: I0316 16:43:30.854217 5120 reconciler_common.go:299] "Volume detached for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/55a201e2-20da-49c3-8216-77a042dd3b31-plugins-conf\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:30 crc kubenswrapper[5120]: I0316 16:43:30.854237 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/55a201e2-20da-49c3-8216-77a042dd3b31-rabbitmq-plugins\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:30 crc kubenswrapper[5120]: I0316 16:43:30.857848 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/55a201e2-20da-49c3-8216-77a042dd3b31-pod-info" (OuterVolumeSpecName: "pod-info") pod "55a201e2-20da-49c3-8216-77a042dd3b31" (UID: "55a201e2-20da-49c3-8216-77a042dd3b31"). InnerVolumeSpecName "pod-info". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Mar 16 16:43:30 crc kubenswrapper[5120]: I0316 16:43:30.858118 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/55a201e2-20da-49c3-8216-77a042dd3b31-rabbitmq-tls" (OuterVolumeSpecName: "rabbitmq-tls") pod "55a201e2-20da-49c3-8216-77a042dd3b31" (UID: "55a201e2-20da-49c3-8216-77a042dd3b31"). InnerVolumeSpecName "rabbitmq-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:43:30 crc kubenswrapper[5120]: I0316 16:43:30.858262 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/55a201e2-20da-49c3-8216-77a042dd3b31-erlang-cookie-secret" (OuterVolumeSpecName: "erlang-cookie-secret") pod "55a201e2-20da-49c3-8216-77a042dd3b31" (UID: "55a201e2-20da-49c3-8216-77a042dd3b31"). InnerVolumeSpecName "erlang-cookie-secret". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:43:30 crc kubenswrapper[5120]: I0316 16:43:30.860210 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/55a201e2-20da-49c3-8216-77a042dd3b31-kube-api-access-kxvrq" (OuterVolumeSpecName: "kube-api-access-kxvrq") pod "55a201e2-20da-49c3-8216-77a042dd3b31" (UID: "55a201e2-20da-49c3-8216-77a042dd3b31"). InnerVolumeSpecName "kube-api-access-kxvrq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:43:30 crc kubenswrapper[5120]: I0316 16:43:30.861874 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage18-crc" (OuterVolumeSpecName: "persistence") pod "55a201e2-20da-49c3-8216-77a042dd3b31" (UID: "55a201e2-20da-49c3-8216-77a042dd3b31"). InnerVolumeSpecName "local-storage18-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:43:30 crc kubenswrapper[5120]: I0316 16:43:30.876429 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/55a201e2-20da-49c3-8216-77a042dd3b31-config-data" (OuterVolumeSpecName: "config-data") pod "55a201e2-20da-49c3-8216-77a042dd3b31" (UID: "55a201e2-20da-49c3-8216-77a042dd3b31"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:43:30 crc kubenswrapper[5120]: I0316 16:43:30.907349 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/55a201e2-20da-49c3-8216-77a042dd3b31-server-conf" (OuterVolumeSpecName: "server-conf") pod "55a201e2-20da-49c3-8216-77a042dd3b31" (UID: "55a201e2-20da-49c3-8216-77a042dd3b31"). InnerVolumeSpecName "server-conf". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:43:30 crc kubenswrapper[5120]: I0316 16:43:30.945901 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/55a201e2-20da-49c3-8216-77a042dd3b31-rabbitmq-confd" (OuterVolumeSpecName: "rabbitmq-confd") pod "55a201e2-20da-49c3-8216-77a042dd3b31" (UID: "55a201e2-20da-49c3-8216-77a042dd3b31"). InnerVolumeSpecName "rabbitmq-confd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:43:30 crc kubenswrapper[5120]: I0316 16:43:30.959142 5120 reconciler_common.go:299] "Volume detached for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/55a201e2-20da-49c3-8216-77a042dd3b31-erlang-cookie-secret\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:30 crc kubenswrapper[5120]: I0316 16:43:30.959208 5120 reconciler_common.go:299] "Volume detached for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/55a201e2-20da-49c3-8216-77a042dd3b31-pod-info\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:30 crc kubenswrapper[5120]: I0316 16:43:30.959222 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/55a201e2-20da-49c3-8216-77a042dd3b31-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:30 crc kubenswrapper[5120]: I0316 16:43:30.959238 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/55a201e2-20da-49c3-8216-77a042dd3b31-rabbitmq-erlang-cookie\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:30 crc kubenswrapper[5120]: I0316 16:43:30.959256 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kxvrq\" (UniqueName: \"kubernetes.io/projected/55a201e2-20da-49c3-8216-77a042dd3b31-kube-api-access-kxvrq\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:30 crc kubenswrapper[5120]: I0316 16:43:30.959269 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/55a201e2-20da-49c3-8216-77a042dd3b31-rabbitmq-tls\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:30 crc kubenswrapper[5120]: I0316 16:43:30.959315 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage18-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") on node \"crc\" " Mar 16 16:43:30 crc kubenswrapper[5120]: I0316 16:43:30.959327 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/55a201e2-20da-49c3-8216-77a042dd3b31-rabbitmq-confd\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:30 crc kubenswrapper[5120]: I0316 16:43:30.959342 5120 reconciler_common.go:299] "Volume detached for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/55a201e2-20da-49c3-8216-77a042dd3b31-server-conf\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:30 crc kubenswrapper[5120]: I0316 16:43:30.984889 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage18-crc" (UniqueName: "kubernetes.io/local-volume/local-storage18-crc") on node "crc" Mar 16 16:43:31 crc kubenswrapper[5120]: I0316 16:43:31.061252 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage18-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:31 crc kubenswrapper[5120]: I0316 16:43:31.439092 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:43:31 crc kubenswrapper[5120]: I0316 16:43:31.439085 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"55a201e2-20da-49c3-8216-77a042dd3b31","Type":"ContainerDied","Data":"c6733defad3c2b5be093185f2c05739fdc1a8bcf4967a78bc1800029d20bb9b1"} Mar 16 16:43:31 crc kubenswrapper[5120]: I0316 16:43:31.439219 5120 scope.go:117] "RemoveContainer" containerID="724c0b5146b4e94ddc111cbeb4d390d8b4e39776e5bfd86f681203d76b6919bb" Mar 16 16:43:31 crc kubenswrapper[5120]: I0316 16:43:31.473295 5120 scope.go:117] "RemoveContainer" containerID="c6fda375b35e16e4fb06b0cea8967b8c44645e1996207efeefd6730aecf30eca" Mar 16 16:43:31 crc kubenswrapper[5120]: I0316 16:43:31.476785 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 16:43:31 crc kubenswrapper[5120]: E0316 16:43:31.478820 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="10a7e33721d5da23369bc4422d4cbb9b2fa2d5c64f2fff4f94c6d681301c74ff" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:43:31 crc kubenswrapper[5120]: E0316 16:43:31.480265 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="10a7e33721d5da23369bc4422d4cbb9b2fa2d5c64f2fff4f94c6d681301c74ff" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:43:31 crc kubenswrapper[5120]: I0316 16:43:31.480586 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 16:43:31 crc kubenswrapper[5120]: E0316 16:43:31.481724 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="10a7e33721d5da23369bc4422d4cbb9b2fa2d5c64f2fff4f94c6d681301c74ff" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:43:31 crc kubenswrapper[5120]: E0316 16:43:31.481874 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="636be6fd-cf1a-4f31-aa2b-6be52788333d" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 16:43:31 crc kubenswrapper[5120]: E0316 16:43:31.855051 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="39b19d47df4280da111038dcf617135fe59f13c47f76f5f5da32391a2bd60988" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:43:31 crc kubenswrapper[5120]: E0316 16:43:31.857827 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="39b19d47df4280da111038dcf617135fe59f13c47f76f5f5da32391a2bd60988" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:43:31 crc kubenswrapper[5120]: E0316 16:43:31.859818 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="39b19d47df4280da111038dcf617135fe59f13c47f76f5f5da32391a2bd60988" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:43:31 crc kubenswrapper[5120]: E0316 16:43:31.859875 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="a7128a81-4e4e-4635-b66c-f992c4b30d2a" containerName="nova-cell1-conductor-conductor" probeResult="unknown" Mar 16 16:43:32 crc kubenswrapper[5120]: I0316 16:43:32.366925 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-htctf" Mar 16 16:43:32 crc kubenswrapper[5120]: I0316 16:43:32.438152 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-75564c7f5c-29qz4"] Mar 16 16:43:32 crc kubenswrapper[5120]: I0316 16:43:32.438564 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-75564c7f5c-29qz4" podUID="232eb98c-2900-4d2b-adfb-5db5139e3934" containerName="dnsmasq-dns" containerID="cri-o://5dcb2c18ac15a4b8ab8552c5b0df4836c142f045424681bc2e391592fb369d82" gracePeriod=10 Mar 16 16:43:32 crc kubenswrapper[5120]: I0316 16:43:32.678299 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="55a201e2-20da-49c3-8216-77a042dd3b31" path="/var/lib/kubelet/pods/55a201e2-20da-49c3-8216-77a042dd3b31/volumes" Mar 16 16:43:32 crc kubenswrapper[5120]: I0316 16:43:32.929451 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-75564c7f5c-29qz4" Mar 16 16:43:33 crc kubenswrapper[5120]: I0316 16:43:33.021643 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/232eb98c-2900-4d2b-adfb-5db5139e3934-dns-swift-storage-0\") pod \"232eb98c-2900-4d2b-adfb-5db5139e3934\" (UID: \"232eb98c-2900-4d2b-adfb-5db5139e3934\") " Mar 16 16:43:33 crc kubenswrapper[5120]: I0316 16:43:33.021709 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/232eb98c-2900-4d2b-adfb-5db5139e3934-dnsmasq-svc\") pod \"232eb98c-2900-4d2b-adfb-5db5139e3934\" (UID: \"232eb98c-2900-4d2b-adfb-5db5139e3934\") " Mar 16 16:43:33 crc kubenswrapper[5120]: I0316 16:43:33.022890 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/232eb98c-2900-4d2b-adfb-5db5139e3934-config\") pod \"232eb98c-2900-4d2b-adfb-5db5139e3934\" (UID: \"232eb98c-2900-4d2b-adfb-5db5139e3934\") " Mar 16 16:43:33 crc kubenswrapper[5120]: I0316 16:43:33.022965 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g6zpl\" (UniqueName: \"kubernetes.io/projected/232eb98c-2900-4d2b-adfb-5db5139e3934-kube-api-access-g6zpl\") pod \"232eb98c-2900-4d2b-adfb-5db5139e3934\" (UID: \"232eb98c-2900-4d2b-adfb-5db5139e3934\") " Mar 16 16:43:33 crc kubenswrapper[5120]: I0316 16:43:33.027448 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/232eb98c-2900-4d2b-adfb-5db5139e3934-kube-api-access-g6zpl" (OuterVolumeSpecName: "kube-api-access-g6zpl") pod "232eb98c-2900-4d2b-adfb-5db5139e3934" (UID: "232eb98c-2900-4d2b-adfb-5db5139e3934"). InnerVolumeSpecName "kube-api-access-g6zpl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:43:33 crc kubenswrapper[5120]: I0316 16:43:33.057631 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/232eb98c-2900-4d2b-adfb-5db5139e3934-dns-swift-storage-0" (OuterVolumeSpecName: "dns-swift-storage-0") pod "232eb98c-2900-4d2b-adfb-5db5139e3934" (UID: "232eb98c-2900-4d2b-adfb-5db5139e3934"). InnerVolumeSpecName "dns-swift-storage-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:43:33 crc kubenswrapper[5120]: I0316 16:43:33.058289 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/232eb98c-2900-4d2b-adfb-5db5139e3934-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "232eb98c-2900-4d2b-adfb-5db5139e3934" (UID: "232eb98c-2900-4d2b-adfb-5db5139e3934"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:43:33 crc kubenswrapper[5120]: I0316 16:43:33.072080 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/232eb98c-2900-4d2b-adfb-5db5139e3934-config" (OuterVolumeSpecName: "config") pod "232eb98c-2900-4d2b-adfb-5db5139e3934" (UID: "232eb98c-2900-4d2b-adfb-5db5139e3934"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:43:33 crc kubenswrapper[5120]: I0316 16:43:33.126064 5120 reconciler_common.go:299] "Volume detached for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/232eb98c-2900-4d2b-adfb-5db5139e3934-dns-swift-storage-0\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:33 crc kubenswrapper[5120]: I0316 16:43:33.126120 5120 reconciler_common.go:299] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/232eb98c-2900-4d2b-adfb-5db5139e3934-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:33 crc kubenswrapper[5120]: I0316 16:43:33.126133 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/232eb98c-2900-4d2b-adfb-5db5139e3934-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:33 crc kubenswrapper[5120]: I0316 16:43:33.126146 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g6zpl\" (UniqueName: \"kubernetes.io/projected/232eb98c-2900-4d2b-adfb-5db5139e3934-kube-api-access-g6zpl\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:33 crc kubenswrapper[5120]: I0316 16:43:33.468817 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-75564c7f5c-29qz4" event={"ID":"232eb98c-2900-4d2b-adfb-5db5139e3934","Type":"ContainerDied","Data":"5dcb2c18ac15a4b8ab8552c5b0df4836c142f045424681bc2e391592fb369d82"} Mar 16 16:43:33 crc kubenswrapper[5120]: I0316 16:43:33.468889 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-75564c7f5c-29qz4" Mar 16 16:43:33 crc kubenswrapper[5120]: I0316 16:43:33.468725 5120 generic.go:358] "Generic (PLEG): container finished" podID="232eb98c-2900-4d2b-adfb-5db5139e3934" containerID="5dcb2c18ac15a4b8ab8552c5b0df4836c142f045424681bc2e391592fb369d82" exitCode=0 Mar 16 16:43:33 crc kubenswrapper[5120]: I0316 16:43:33.469245 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-75564c7f5c-29qz4" event={"ID":"232eb98c-2900-4d2b-adfb-5db5139e3934","Type":"ContainerDied","Data":"c45faf1065073ee65f091e08f093724738e44d42e8121f7c898de06aed4d72ac"} Mar 16 16:43:33 crc kubenswrapper[5120]: I0316 16:43:33.469190 5120 scope.go:117] "RemoveContainer" containerID="5dcb2c18ac15a4b8ab8552c5b0df4836c142f045424681bc2e391592fb369d82" Mar 16 16:43:33 crc kubenswrapper[5120]: I0316 16:43:33.495165 5120 scope.go:117] "RemoveContainer" containerID="583e9411f6d300aa92e685a93da9c9f55a5ef0816030227ec0344cd847fcea7e" Mar 16 16:43:33 crc kubenswrapper[5120]: I0316 16:43:33.520836 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-75564c7f5c-29qz4"] Mar 16 16:43:33 crc kubenswrapper[5120]: I0316 16:43:33.525213 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-75564c7f5c-29qz4"] Mar 16 16:43:33 crc kubenswrapper[5120]: I0316 16:43:33.525530 5120 scope.go:117] "RemoveContainer" containerID="5dcb2c18ac15a4b8ab8552c5b0df4836c142f045424681bc2e391592fb369d82" Mar 16 16:43:33 crc kubenswrapper[5120]: E0316 16:43:33.526165 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5dcb2c18ac15a4b8ab8552c5b0df4836c142f045424681bc2e391592fb369d82\": container with ID starting with 5dcb2c18ac15a4b8ab8552c5b0df4836c142f045424681bc2e391592fb369d82 not found: ID does not exist" containerID="5dcb2c18ac15a4b8ab8552c5b0df4836c142f045424681bc2e391592fb369d82" Mar 16 16:43:33 crc kubenswrapper[5120]: I0316 16:43:33.526218 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5dcb2c18ac15a4b8ab8552c5b0df4836c142f045424681bc2e391592fb369d82"} err="failed to get container status \"5dcb2c18ac15a4b8ab8552c5b0df4836c142f045424681bc2e391592fb369d82\": rpc error: code = NotFound desc = could not find container \"5dcb2c18ac15a4b8ab8552c5b0df4836c142f045424681bc2e391592fb369d82\": container with ID starting with 5dcb2c18ac15a4b8ab8552c5b0df4836c142f045424681bc2e391592fb369d82 not found: ID does not exist" Mar 16 16:43:33 crc kubenswrapper[5120]: I0316 16:43:33.526241 5120 scope.go:117] "RemoveContainer" containerID="583e9411f6d300aa92e685a93da9c9f55a5ef0816030227ec0344cd847fcea7e" Mar 16 16:43:33 crc kubenswrapper[5120]: E0316 16:43:33.526517 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"583e9411f6d300aa92e685a93da9c9f55a5ef0816030227ec0344cd847fcea7e\": container with ID starting with 583e9411f6d300aa92e685a93da9c9f55a5ef0816030227ec0344cd847fcea7e not found: ID does not exist" containerID="583e9411f6d300aa92e685a93da9c9f55a5ef0816030227ec0344cd847fcea7e" Mar 16 16:43:33 crc kubenswrapper[5120]: I0316 16:43:33.526542 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"583e9411f6d300aa92e685a93da9c9f55a5ef0816030227ec0344cd847fcea7e"} err="failed to get container status \"583e9411f6d300aa92e685a93da9c9f55a5ef0816030227ec0344cd847fcea7e\": rpc error: code = NotFound desc = could not find container \"583e9411f6d300aa92e685a93da9c9f55a5ef0816030227ec0344cd847fcea7e\": container with ID starting with 583e9411f6d300aa92e685a93da9c9f55a5ef0816030227ec0344cd847fcea7e not found: ID does not exist" Mar 16 16:43:34 crc kubenswrapper[5120]: I0316 16:43:34.673906 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="232eb98c-2900-4d2b-adfb-5db5139e3934" path="/var/lib/kubelet/pods/232eb98c-2900-4d2b-adfb-5db5139e3934/volumes" Mar 16 16:43:36 crc kubenswrapper[5120]: E0316 16:43:36.480453 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="10a7e33721d5da23369bc4422d4cbb9b2fa2d5c64f2fff4f94c6d681301c74ff" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:43:36 crc kubenswrapper[5120]: E0316 16:43:36.482397 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="10a7e33721d5da23369bc4422d4cbb9b2fa2d5c64f2fff4f94c6d681301c74ff" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:43:36 crc kubenswrapper[5120]: E0316 16:43:36.484148 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="10a7e33721d5da23369bc4422d4cbb9b2fa2d5c64f2fff4f94c6d681301c74ff" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:43:36 crc kubenswrapper[5120]: E0316 16:43:36.484190 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="636be6fd-cf1a-4f31-aa2b-6be52788333d" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 16:43:36 crc kubenswrapper[5120]: I0316 16:43:36.663960 5120 scope.go:117] "RemoveContainer" containerID="35a7dd6e19084cee69ca16203bca6378ea0cdf6a685ca2093ab847e5904eb9e6" Mar 16 16:43:36 crc kubenswrapper[5120]: E0316 16:43:36.664319 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:43:36 crc kubenswrapper[5120]: I0316 16:43:36.821324 5120 scope.go:117] "RemoveContainer" containerID="286e1a162710f7d74c84bf4dca3a41749051657141bed19dabe7605fa5405a5c" Mar 16 16:43:36 crc kubenswrapper[5120]: E0316 16:43:36.855957 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="39b19d47df4280da111038dcf617135fe59f13c47f76f5f5da32391a2bd60988" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:43:36 crc kubenswrapper[5120]: E0316 16:43:36.857877 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="39b19d47df4280da111038dcf617135fe59f13c47f76f5f5da32391a2bd60988" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:43:36 crc kubenswrapper[5120]: E0316 16:43:36.859111 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="39b19d47df4280da111038dcf617135fe59f13c47f76f5f5da32391a2bd60988" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:43:36 crc kubenswrapper[5120]: E0316 16:43:36.859155 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="a7128a81-4e4e-4635-b66c-f992c4b30d2a" containerName="nova-cell1-conductor-conductor" probeResult="unknown" Mar 16 16:43:36 crc kubenswrapper[5120]: I0316 16:43:36.907824 5120 scope.go:117] "RemoveContainer" containerID="90029a57cda1c82f1798fae3e7d3d6f5f4f44479371d17227cf43653ae68b672" Mar 16 16:43:39 crc kubenswrapper[5120]: I0316 16:43:39.787907 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/neutron-76647d7b7d-c7dsx" podUID="6cef508e-ad21-4c82-ba79-4862f0e98691" containerName="neutron-httpd" probeResult="failure" output="Get \"https://10.217.1.65:9696/\": dial tcp 10.217.1.65:9696: connect: connection refused" Mar 16 16:43:41 crc kubenswrapper[5120]: E0316 16:43:41.480053 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="10a7e33721d5da23369bc4422d4cbb9b2fa2d5c64f2fff4f94c6d681301c74ff" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:43:41 crc kubenswrapper[5120]: E0316 16:43:41.481658 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="10a7e33721d5da23369bc4422d4cbb9b2fa2d5c64f2fff4f94c6d681301c74ff" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:43:41 crc kubenswrapper[5120]: E0316 16:43:41.483207 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="10a7e33721d5da23369bc4422d4cbb9b2fa2d5c64f2fff4f94c6d681301c74ff" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:43:41 crc kubenswrapper[5120]: E0316 16:43:41.483298 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="636be6fd-cf1a-4f31-aa2b-6be52788333d" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 16:43:41 crc kubenswrapper[5120]: E0316 16:43:41.856425 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="39b19d47df4280da111038dcf617135fe59f13c47f76f5f5da32391a2bd60988" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:43:41 crc kubenswrapper[5120]: E0316 16:43:41.858031 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="39b19d47df4280da111038dcf617135fe59f13c47f76f5f5da32391a2bd60988" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:43:41 crc kubenswrapper[5120]: E0316 16:43:41.859572 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="39b19d47df4280da111038dcf617135fe59f13c47f76f5f5da32391a2bd60988" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:43:41 crc kubenswrapper[5120]: E0316 16:43:41.859611 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="a7128a81-4e4e-4635-b66c-f992c4b30d2a" containerName="nova-cell1-conductor-conductor" probeResult="unknown" Mar 16 16:43:45 crc kubenswrapper[5120]: I0316 16:43:45.770312 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/ceilometer-0" podUID="208d2d80-c39f-4984-bd83-13868306b946" containerName="proxy-httpd" probeResult="failure" output="Get \"https://10.217.1.108:3000/\": dial tcp 10.217.1.108:3000: connect: connection refused" Mar 16 16:43:46 crc kubenswrapper[5120]: E0316 16:43:46.480097 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="10a7e33721d5da23369bc4422d4cbb9b2fa2d5c64f2fff4f94c6d681301c74ff" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:43:46 crc kubenswrapper[5120]: E0316 16:43:46.481632 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="10a7e33721d5da23369bc4422d4cbb9b2fa2d5c64f2fff4f94c6d681301c74ff" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:43:46 crc kubenswrapper[5120]: E0316 16:43:46.483172 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="10a7e33721d5da23369bc4422d4cbb9b2fa2d5c64f2fff4f94c6d681301c74ff" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:43:46 crc kubenswrapper[5120]: E0316 16:43:46.483227 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="636be6fd-cf1a-4f31-aa2b-6be52788333d" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 16:43:46 crc kubenswrapper[5120]: E0316 16:43:46.856238 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="39b19d47df4280da111038dcf617135fe59f13c47f76f5f5da32391a2bd60988" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:43:46 crc kubenswrapper[5120]: E0316 16:43:46.858265 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="39b19d47df4280da111038dcf617135fe59f13c47f76f5f5da32391a2bd60988" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:43:46 crc kubenswrapper[5120]: E0316 16:43:46.859464 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="39b19d47df4280da111038dcf617135fe59f13c47f76f5f5da32391a2bd60988" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:43:46 crc kubenswrapper[5120]: E0316 16:43:46.859639 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="a7128a81-4e4e-4635-b66c-f992c4b30d2a" containerName="nova-cell1-conductor-conductor" probeResult="unknown" Mar 16 16:43:49 crc kubenswrapper[5120]: I0316 16:43:49.664699 5120 scope.go:117] "RemoveContainer" containerID="35a7dd6e19084cee69ca16203bca6378ea0cdf6a685ca2093ab847e5904eb9e6" Mar 16 16:43:49 crc kubenswrapper[5120]: E0316 16:43:49.665500 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:43:50 crc kubenswrapper[5120]: I0316 16:43:50.987128 5120 generic.go:358] "Generic (PLEG): container finished" podID="7f161303-6db3-42fc-8cca-089c09eabda5" containerID="75af2c5427cb378d8c7fc864d06681c8a85a02d921ffdac841d96d8c10ac4a44" exitCode=137 Mar 16 16:43:50 crc kubenswrapper[5120]: I0316 16:43:50.987339 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7f161303-6db3-42fc-8cca-089c09eabda5","Type":"ContainerDied","Data":"75af2c5427cb378d8c7fc864d06681c8a85a02d921ffdac841d96d8c10ac4a44"} Mar 16 16:43:51 crc kubenswrapper[5120]: I0316 16:43:51.183695 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:43:51 crc kubenswrapper[5120]: I0316 16:43:51.246460 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6xwb5\" (UniqueName: \"kubernetes.io/projected/7f161303-6db3-42fc-8cca-089c09eabda5-kube-api-access-6xwb5\") pod \"7f161303-6db3-42fc-8cca-089c09eabda5\" (UID: \"7f161303-6db3-42fc-8cca-089c09eabda5\") " Mar 16 16:43:51 crc kubenswrapper[5120]: I0316 16:43:51.246597 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/7f161303-6db3-42fc-8cca-089c09eabda5-cache\") pod \"7f161303-6db3-42fc-8cca-089c09eabda5\" (UID: \"7f161303-6db3-42fc-8cca-089c09eabda5\") " Mar 16 16:43:51 crc kubenswrapper[5120]: I0316 16:43:51.246718 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/7f161303-6db3-42fc-8cca-089c09eabda5-lock\") pod \"7f161303-6db3-42fc-8cca-089c09eabda5\" (UID: \"7f161303-6db3-42fc-8cca-089c09eabda5\") " Mar 16 16:43:51 crc kubenswrapper[5120]: I0316 16:43:51.246744 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7f161303-6db3-42fc-8cca-089c09eabda5-combined-ca-bundle\") pod \"7f161303-6db3-42fc-8cca-089c09eabda5\" (UID: \"7f161303-6db3-42fc-8cca-089c09eabda5\") " Mar 16 16:43:51 crc kubenswrapper[5120]: I0316 16:43:51.246938 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"swift\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") pod \"7f161303-6db3-42fc-8cca-089c09eabda5\" (UID: \"7f161303-6db3-42fc-8cca-089c09eabda5\") " Mar 16 16:43:51 crc kubenswrapper[5120]: I0316 16:43:51.246999 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/7f161303-6db3-42fc-8cca-089c09eabda5-etc-swift\") pod \"7f161303-6db3-42fc-8cca-089c09eabda5\" (UID: \"7f161303-6db3-42fc-8cca-089c09eabda5\") " Mar 16 16:43:51 crc kubenswrapper[5120]: I0316 16:43:51.248078 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f161303-6db3-42fc-8cca-089c09eabda5-cache" (OuterVolumeSpecName: "cache") pod "7f161303-6db3-42fc-8cca-089c09eabda5" (UID: "7f161303-6db3-42fc-8cca-089c09eabda5"). InnerVolumeSpecName "cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:43:51 crc kubenswrapper[5120]: I0316 16:43:51.248108 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f161303-6db3-42fc-8cca-089c09eabda5-lock" (OuterVolumeSpecName: "lock") pod "7f161303-6db3-42fc-8cca-089c09eabda5" (UID: "7f161303-6db3-42fc-8cca-089c09eabda5"). InnerVolumeSpecName "lock". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:43:51 crc kubenswrapper[5120]: I0316 16:43:51.254187 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f161303-6db3-42fc-8cca-089c09eabda5-kube-api-access-6xwb5" (OuterVolumeSpecName: "kube-api-access-6xwb5") pod "7f161303-6db3-42fc-8cca-089c09eabda5" (UID: "7f161303-6db3-42fc-8cca-089c09eabda5"). InnerVolumeSpecName "kube-api-access-6xwb5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:43:51 crc kubenswrapper[5120]: I0316 16:43:51.254197 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage14-crc" (OuterVolumeSpecName: "swift") pod "7f161303-6db3-42fc-8cca-089c09eabda5" (UID: "7f161303-6db3-42fc-8cca-089c09eabda5"). InnerVolumeSpecName "local-storage14-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:43:51 crc kubenswrapper[5120]: I0316 16:43:51.266236 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f161303-6db3-42fc-8cca-089c09eabda5-etc-swift" (OuterVolumeSpecName: "etc-swift") pod "7f161303-6db3-42fc-8cca-089c09eabda5" (UID: "7f161303-6db3-42fc-8cca-089c09eabda5"). InnerVolumeSpecName "etc-swift". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:43:51 crc kubenswrapper[5120]: I0316 16:43:51.350234 5120 reconciler_common.go:299] "Volume detached for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/7f161303-6db3-42fc-8cca-089c09eabda5-lock\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:51 crc kubenswrapper[5120]: I0316 16:43:51.350663 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") on node \"crc\" " Mar 16 16:43:51 crc kubenswrapper[5120]: I0316 16:43:51.350707 5120 reconciler_common.go:299] "Volume detached for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/7f161303-6db3-42fc-8cca-089c09eabda5-etc-swift\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:51 crc kubenswrapper[5120]: I0316 16:43:51.350721 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6xwb5\" (UniqueName: \"kubernetes.io/projected/7f161303-6db3-42fc-8cca-089c09eabda5-kube-api-access-6xwb5\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:51 crc kubenswrapper[5120]: I0316 16:43:51.350734 5120 reconciler_common.go:299] "Volume detached for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/7f161303-6db3-42fc-8cca-089c09eabda5-cache\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:51 crc kubenswrapper[5120]: I0316 16:43:51.365591 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage14-crc" (UniqueName: "kubernetes.io/local-volume/local-storage14-crc") on node "crc" Mar 16 16:43:51 crc kubenswrapper[5120]: I0316 16:43:51.412664 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-76647d7b7d-c7dsx_6cef508e-ad21-4c82-ba79-4862f0e98691/neutron-api/0.log" Mar 16 16:43:51 crc kubenswrapper[5120]: I0316 16:43:51.412815 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-76647d7b7d-c7dsx" Mar 16 16:43:51 crc kubenswrapper[5120]: I0316 16:43:51.452171 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l9pzm\" (UniqueName: \"kubernetes.io/projected/6cef508e-ad21-4c82-ba79-4862f0e98691-kube-api-access-l9pzm\") pod \"6cef508e-ad21-4c82-ba79-4862f0e98691\" (UID: \"6cef508e-ad21-4c82-ba79-4862f0e98691\") " Mar 16 16:43:51 crc kubenswrapper[5120]: I0316 16:43:51.452444 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6cef508e-ad21-4c82-ba79-4862f0e98691-internal-tls-certs\") pod \"6cef508e-ad21-4c82-ba79-4862f0e98691\" (UID: \"6cef508e-ad21-4c82-ba79-4862f0e98691\") " Mar 16 16:43:51 crc kubenswrapper[5120]: I0316 16:43:51.452660 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6cef508e-ad21-4c82-ba79-4862f0e98691-public-tls-certs\") pod \"6cef508e-ad21-4c82-ba79-4862f0e98691\" (UID: \"6cef508e-ad21-4c82-ba79-4862f0e98691\") " Mar 16 16:43:51 crc kubenswrapper[5120]: I0316 16:43:51.452730 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/6cef508e-ad21-4c82-ba79-4862f0e98691-ovndb-tls-certs\") pod \"6cef508e-ad21-4c82-ba79-4862f0e98691\" (UID: \"6cef508e-ad21-4c82-ba79-4862f0e98691\") " Mar 16 16:43:51 crc kubenswrapper[5120]: I0316 16:43:51.452816 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6cef508e-ad21-4c82-ba79-4862f0e98691-config\") pod \"6cef508e-ad21-4c82-ba79-4862f0e98691\" (UID: \"6cef508e-ad21-4c82-ba79-4862f0e98691\") " Mar 16 16:43:51 crc kubenswrapper[5120]: I0316 16:43:51.452958 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6cef508e-ad21-4c82-ba79-4862f0e98691-combined-ca-bundle\") pod \"6cef508e-ad21-4c82-ba79-4862f0e98691\" (UID: \"6cef508e-ad21-4c82-ba79-4862f0e98691\") " Mar 16 16:43:51 crc kubenswrapper[5120]: I0316 16:43:51.453018 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/6cef508e-ad21-4c82-ba79-4862f0e98691-httpd-config\") pod \"6cef508e-ad21-4c82-ba79-4862f0e98691\" (UID: \"6cef508e-ad21-4c82-ba79-4862f0e98691\") " Mar 16 16:43:51 crc kubenswrapper[5120]: I0316 16:43:51.454063 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:51 crc kubenswrapper[5120]: I0316 16:43:51.455471 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6cef508e-ad21-4c82-ba79-4862f0e98691-kube-api-access-l9pzm" (OuterVolumeSpecName: "kube-api-access-l9pzm") pod "6cef508e-ad21-4c82-ba79-4862f0e98691" (UID: "6cef508e-ad21-4c82-ba79-4862f0e98691"). InnerVolumeSpecName "kube-api-access-l9pzm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:43:51 crc kubenswrapper[5120]: I0316 16:43:51.457480 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6cef508e-ad21-4c82-ba79-4862f0e98691-httpd-config" (OuterVolumeSpecName: "httpd-config") pod "6cef508e-ad21-4c82-ba79-4862f0e98691" (UID: "6cef508e-ad21-4c82-ba79-4862f0e98691"). InnerVolumeSpecName "httpd-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:43:51 crc kubenswrapper[5120]: E0316 16:43:51.479558 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="10a7e33721d5da23369bc4422d4cbb9b2fa2d5c64f2fff4f94c6d681301c74ff" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:43:51 crc kubenswrapper[5120]: E0316 16:43:51.481106 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="10a7e33721d5da23369bc4422d4cbb9b2fa2d5c64f2fff4f94c6d681301c74ff" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:43:51 crc kubenswrapper[5120]: E0316 16:43:51.483813 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="10a7e33721d5da23369bc4422d4cbb9b2fa2d5c64f2fff4f94c6d681301c74ff" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:43:51 crc kubenswrapper[5120]: E0316 16:43:51.483891 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="636be6fd-cf1a-4f31-aa2b-6be52788333d" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 16:43:51 crc kubenswrapper[5120]: I0316 16:43:51.487816 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6cef508e-ad21-4c82-ba79-4862f0e98691-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "6cef508e-ad21-4c82-ba79-4862f0e98691" (UID: "6cef508e-ad21-4c82-ba79-4862f0e98691"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:43:51 crc kubenswrapper[5120]: I0316 16:43:51.492472 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6cef508e-ad21-4c82-ba79-4862f0e98691-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "6cef508e-ad21-4c82-ba79-4862f0e98691" (UID: "6cef508e-ad21-4c82-ba79-4862f0e98691"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:43:51 crc kubenswrapper[5120]: I0316 16:43:51.492537 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6cef508e-ad21-4c82-ba79-4862f0e98691-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "6cef508e-ad21-4c82-ba79-4862f0e98691" (UID: "6cef508e-ad21-4c82-ba79-4862f0e98691"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:43:51 crc kubenswrapper[5120]: I0316 16:43:51.494589 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6cef508e-ad21-4c82-ba79-4862f0e98691-config" (OuterVolumeSpecName: "config") pod "6cef508e-ad21-4c82-ba79-4862f0e98691" (UID: "6cef508e-ad21-4c82-ba79-4862f0e98691"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:43:51 crc kubenswrapper[5120]: I0316 16:43:51.509297 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6cef508e-ad21-4c82-ba79-4862f0e98691-ovndb-tls-certs" (OuterVolumeSpecName: "ovndb-tls-certs") pod "6cef508e-ad21-4c82-ba79-4862f0e98691" (UID: "6cef508e-ad21-4c82-ba79-4862f0e98691"). InnerVolumeSpecName "ovndb-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:43:51 crc kubenswrapper[5120]: I0316 16:43:51.532577 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7f161303-6db3-42fc-8cca-089c09eabda5-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "7f161303-6db3-42fc-8cca-089c09eabda5" (UID: "7f161303-6db3-42fc-8cca-089c09eabda5"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:43:51 crc kubenswrapper[5120]: I0316 16:43:51.555840 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6cef508e-ad21-4c82-ba79-4862f0e98691-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:51 crc kubenswrapper[5120]: I0316 16:43:51.555870 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6cef508e-ad21-4c82-ba79-4862f0e98691-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:51 crc kubenswrapper[5120]: I0316 16:43:51.555879 5120 reconciler_common.go:299] "Volume detached for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/6cef508e-ad21-4c82-ba79-4862f0e98691-ovndb-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:51 crc kubenswrapper[5120]: I0316 16:43:51.555889 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/6cef508e-ad21-4c82-ba79-4862f0e98691-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:51 crc kubenswrapper[5120]: I0316 16:43:51.555898 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6cef508e-ad21-4c82-ba79-4862f0e98691-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:51 crc kubenswrapper[5120]: I0316 16:43:51.555905 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/6cef508e-ad21-4c82-ba79-4862f0e98691-httpd-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:51 crc kubenswrapper[5120]: I0316 16:43:51.555916 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l9pzm\" (UniqueName: \"kubernetes.io/projected/6cef508e-ad21-4c82-ba79-4862f0e98691-kube-api-access-l9pzm\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:51 crc kubenswrapper[5120]: I0316 16:43:51.555926 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7f161303-6db3-42fc-8cca-089c09eabda5-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:51 crc kubenswrapper[5120]: E0316 16:43:51.855634 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="39b19d47df4280da111038dcf617135fe59f13c47f76f5f5da32391a2bd60988" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:43:51 crc kubenswrapper[5120]: E0316 16:43:51.857134 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="39b19d47df4280da111038dcf617135fe59f13c47f76f5f5da32391a2bd60988" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:43:51 crc kubenswrapper[5120]: E0316 16:43:51.858558 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="39b19d47df4280da111038dcf617135fe59f13c47f76f5f5da32391a2bd60988" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:43:51 crc kubenswrapper[5120]: E0316 16:43:51.858647 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="a7128a81-4e4e-4635-b66c-f992c4b30d2a" containerName="nova-cell1-conductor-conductor" probeResult="unknown" Mar 16 16:43:51 crc kubenswrapper[5120]: I0316 16:43:51.998704 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-76647d7b7d-c7dsx_6cef508e-ad21-4c82-ba79-4862f0e98691/neutron-api/0.log" Mar 16 16:43:51 crc kubenswrapper[5120]: I0316 16:43:51.998792 5120 generic.go:358] "Generic (PLEG): container finished" podID="6cef508e-ad21-4c82-ba79-4862f0e98691" containerID="5fa655026894dd4d7dc9e13c705fa23e382e4cc5698aa88f2ef873831fbc3214" exitCode=137 Mar 16 16:43:51 crc kubenswrapper[5120]: I0316 16:43:51.998925 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-76647d7b7d-c7dsx" Mar 16 16:43:51 crc kubenswrapper[5120]: I0316 16:43:51.998942 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-76647d7b7d-c7dsx" event={"ID":"6cef508e-ad21-4c82-ba79-4862f0e98691","Type":"ContainerDied","Data":"5fa655026894dd4d7dc9e13c705fa23e382e4cc5698aa88f2ef873831fbc3214"} Mar 16 16:43:51 crc kubenswrapper[5120]: I0316 16:43:51.998998 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-76647d7b7d-c7dsx" event={"ID":"6cef508e-ad21-4c82-ba79-4862f0e98691","Type":"ContainerDied","Data":"f26045aee66f5350319db9a00cd9a5b1c6750c3cf7b41b6c3cc150bf4ba15d5b"} Mar 16 16:43:51 crc kubenswrapper[5120]: I0316 16:43:51.999017 5120 scope.go:117] "RemoveContainer" containerID="7d2c0bf776d2a574d61880604ebe7da62ff91dedc2f8b4c2a6103dff037b543c" Mar 16 16:43:52 crc kubenswrapper[5120]: I0316 16:43:52.011620 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7f161303-6db3-42fc-8cca-089c09eabda5","Type":"ContainerDied","Data":"503aa2133d72f25f3a82a7c043cad5fec7063c7c7879e921d55e0c4add22b8c8"} Mar 16 16:43:52 crc kubenswrapper[5120]: I0316 16:43:52.011718 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:43:52 crc kubenswrapper[5120]: I0316 16:43:52.020812 5120 scope.go:117] "RemoveContainer" containerID="5fa655026894dd4d7dc9e13c705fa23e382e4cc5698aa88f2ef873831fbc3214" Mar 16 16:43:52 crc kubenswrapper[5120]: I0316 16:43:52.041895 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-76647d7b7d-c7dsx"] Mar 16 16:43:52 crc kubenswrapper[5120]: I0316 16:43:52.049288 5120 scope.go:117] "RemoveContainer" containerID="7d2c0bf776d2a574d61880604ebe7da62ff91dedc2f8b4c2a6103dff037b543c" Mar 16 16:43:52 crc kubenswrapper[5120]: E0316 16:43:52.050031 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d2c0bf776d2a574d61880604ebe7da62ff91dedc2f8b4c2a6103dff037b543c\": container with ID starting with 7d2c0bf776d2a574d61880604ebe7da62ff91dedc2f8b4c2a6103dff037b543c not found: ID does not exist" containerID="7d2c0bf776d2a574d61880604ebe7da62ff91dedc2f8b4c2a6103dff037b543c" Mar 16 16:43:52 crc kubenswrapper[5120]: I0316 16:43:52.050064 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d2c0bf776d2a574d61880604ebe7da62ff91dedc2f8b4c2a6103dff037b543c"} err="failed to get container status \"7d2c0bf776d2a574d61880604ebe7da62ff91dedc2f8b4c2a6103dff037b543c\": rpc error: code = NotFound desc = could not find container \"7d2c0bf776d2a574d61880604ebe7da62ff91dedc2f8b4c2a6103dff037b543c\": container with ID starting with 7d2c0bf776d2a574d61880604ebe7da62ff91dedc2f8b4c2a6103dff037b543c not found: ID does not exist" Mar 16 16:43:52 crc kubenswrapper[5120]: I0316 16:43:52.050085 5120 scope.go:117] "RemoveContainer" containerID="5fa655026894dd4d7dc9e13c705fa23e382e4cc5698aa88f2ef873831fbc3214" Mar 16 16:43:52 crc kubenswrapper[5120]: E0316 16:43:52.052919 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5fa655026894dd4d7dc9e13c705fa23e382e4cc5698aa88f2ef873831fbc3214\": container with ID starting with 5fa655026894dd4d7dc9e13c705fa23e382e4cc5698aa88f2ef873831fbc3214 not found: ID does not exist" containerID="5fa655026894dd4d7dc9e13c705fa23e382e4cc5698aa88f2ef873831fbc3214" Mar 16 16:43:52 crc kubenswrapper[5120]: I0316 16:43:52.053026 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5fa655026894dd4d7dc9e13c705fa23e382e4cc5698aa88f2ef873831fbc3214"} err="failed to get container status \"5fa655026894dd4d7dc9e13c705fa23e382e4cc5698aa88f2ef873831fbc3214\": rpc error: code = NotFound desc = could not find container \"5fa655026894dd4d7dc9e13c705fa23e382e4cc5698aa88f2ef873831fbc3214\": container with ID starting with 5fa655026894dd4d7dc9e13c705fa23e382e4cc5698aa88f2ef873831fbc3214 not found: ID does not exist" Mar 16 16:43:52 crc kubenswrapper[5120]: I0316 16:43:52.053056 5120 scope.go:117] "RemoveContainer" containerID="75af2c5427cb378d8c7fc864d06681c8a85a02d921ffdac841d96d8c10ac4a44" Mar 16 16:43:52 crc kubenswrapper[5120]: I0316 16:43:52.054831 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-76647d7b7d-c7dsx"] Mar 16 16:43:52 crc kubenswrapper[5120]: I0316 16:43:52.060860 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 16:43:52 crc kubenswrapper[5120]: I0316 16:43:52.069410 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 16:43:52 crc kubenswrapper[5120]: I0316 16:43:52.074023 5120 scope.go:117] "RemoveContainer" containerID="832bc34866fa4463f5bace762c43ae81c0bb3c37a033c02d4a2f823022e660b8" Mar 16 16:43:52 crc kubenswrapper[5120]: I0316 16:43:52.098685 5120 scope.go:117] "RemoveContainer" containerID="6eb2da0f9d23498832f20c9907eb27be212445bdc8591a5d329c515457fec159" Mar 16 16:43:52 crc kubenswrapper[5120]: I0316 16:43:52.117456 5120 scope.go:117] "RemoveContainer" containerID="701430e9b417ed89663c5d841e28695f639a5ce24a937584b3e91e1668f567a9" Mar 16 16:43:52 crc kubenswrapper[5120]: I0316 16:43:52.136576 5120 scope.go:117] "RemoveContainer" containerID="45d417324d3b1fd816cb84ece88a62414ef3cde2344cbac2b40f9cd9bb15195b" Mar 16 16:43:52 crc kubenswrapper[5120]: I0316 16:43:52.153615 5120 scope.go:117] "RemoveContainer" containerID="eda7739ccb0bef92fc25f7b29815a187360fa6bc837dbfdcb2b947bbd2a51f25" Mar 16 16:43:52 crc kubenswrapper[5120]: I0316 16:43:52.172536 5120 scope.go:117] "RemoveContainer" containerID="878127ce868e772a907a2ec7f0247432f773e62eb60e0862523ea4e92c9cfb2c" Mar 16 16:43:52 crc kubenswrapper[5120]: I0316 16:43:52.190545 5120 scope.go:117] "RemoveContainer" containerID="41bf99c5b4ac98ecadd81e8cdce4cfcf28dacdb72cf8eb33999efeac56f08c40" Mar 16 16:43:52 crc kubenswrapper[5120]: I0316 16:43:52.207831 5120 scope.go:117] "RemoveContainer" containerID="9da44b1906810fa56c015f549e5d082a124aad433f4666dd020ee73c3746d9bd" Mar 16 16:43:52 crc kubenswrapper[5120]: I0316 16:43:52.229042 5120 scope.go:117] "RemoveContainer" containerID="fc984a4dad798acc485f3583ca06562c9e78166d32047287908fccc38d13a52c" Mar 16 16:43:52 crc kubenswrapper[5120]: I0316 16:43:52.248794 5120 scope.go:117] "RemoveContainer" containerID="639eb84e58ef1695b15c612c5e0ef5adc5f87e7687551d830e9e1103b5d73e84" Mar 16 16:43:52 crc kubenswrapper[5120]: I0316 16:43:52.265667 5120 scope.go:117] "RemoveContainer" containerID="50d21a1eb1dee64601b5ac5d957233a5b9c12af3c1f70e2ba64fc3fa232a426c" Mar 16 16:43:52 crc kubenswrapper[5120]: I0316 16:43:52.283964 5120 scope.go:117] "RemoveContainer" containerID="ae6a8c449bb16b6545d66ae19692d865fa5ca0fbbd29063f0dcab3878ee4f6d9" Mar 16 16:43:52 crc kubenswrapper[5120]: I0316 16:43:52.304028 5120 scope.go:117] "RemoveContainer" containerID="0dd9bc3530759ea0393d12b620c6656b9900476393827384cefdec7f3b8a3955" Mar 16 16:43:52 crc kubenswrapper[5120]: I0316 16:43:52.334140 5120 scope.go:117] "RemoveContainer" containerID="393ca2c1ba80ec2d0992f37df8ef733396f1e566797d1d4d0e97ee936b2dd556" Mar 16 16:43:52 crc kubenswrapper[5120]: I0316 16:43:52.680238 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6cef508e-ad21-4c82-ba79-4862f0e98691" path="/var/lib/kubelet/pods/6cef508e-ad21-4c82-ba79-4862f0e98691/volumes" Mar 16 16:43:52 crc kubenswrapper[5120]: I0316 16:43:52.681614 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7f161303-6db3-42fc-8cca-089c09eabda5" path="/var/lib/kubelet/pods/7f161303-6db3-42fc-8cca-089c09eabda5/volumes" Mar 16 16:43:52 crc kubenswrapper[5120]: I0316 16:43:52.827770 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:43:52 crc kubenswrapper[5120]: I0316 16:43:52.882155 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a7128a81-4e4e-4635-b66c-f992c4b30d2a-combined-ca-bundle\") pod \"a7128a81-4e4e-4635-b66c-f992c4b30d2a\" (UID: \"a7128a81-4e4e-4635-b66c-f992c4b30d2a\") " Mar 16 16:43:52 crc kubenswrapper[5120]: I0316 16:43:52.882248 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a7128a81-4e4e-4635-b66c-f992c4b30d2a-config-data\") pod \"a7128a81-4e4e-4635-b66c-f992c4b30d2a\" (UID: \"a7128a81-4e4e-4635-b66c-f992c4b30d2a\") " Mar 16 16:43:52 crc kubenswrapper[5120]: I0316 16:43:52.882458 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mtqq5\" (UniqueName: \"kubernetes.io/projected/a7128a81-4e4e-4635-b66c-f992c4b30d2a-kube-api-access-mtqq5\") pod \"a7128a81-4e4e-4635-b66c-f992c4b30d2a\" (UID: \"a7128a81-4e4e-4635-b66c-f992c4b30d2a\") " Mar 16 16:43:52 crc kubenswrapper[5120]: I0316 16:43:52.890315 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7128a81-4e4e-4635-b66c-f992c4b30d2a-kube-api-access-mtqq5" (OuterVolumeSpecName: "kube-api-access-mtqq5") pod "a7128a81-4e4e-4635-b66c-f992c4b30d2a" (UID: "a7128a81-4e4e-4635-b66c-f992c4b30d2a"). InnerVolumeSpecName "kube-api-access-mtqq5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:43:52 crc kubenswrapper[5120]: I0316 16:43:52.914040 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7128a81-4e4e-4635-b66c-f992c4b30d2a-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "a7128a81-4e4e-4635-b66c-f992c4b30d2a" (UID: "a7128a81-4e4e-4635-b66c-f992c4b30d2a"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:43:52 crc kubenswrapper[5120]: I0316 16:43:52.920335 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7128a81-4e4e-4635-b66c-f992c4b30d2a-config-data" (OuterVolumeSpecName: "config-data") pod "a7128a81-4e4e-4635-b66c-f992c4b30d2a" (UID: "a7128a81-4e4e-4635-b66c-f992c4b30d2a"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:43:52 crc kubenswrapper[5120]: I0316 16:43:52.970973 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:43:52 crc kubenswrapper[5120]: I0316 16:43:52.988077 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a7128a81-4e4e-4635-b66c-f992c4b30d2a-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:52 crc kubenswrapper[5120]: I0316 16:43:52.988111 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a7128a81-4e4e-4635-b66c-f992c4b30d2a-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:52 crc kubenswrapper[5120]: I0316 16:43:52.988124 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mtqq5\" (UniqueName: \"kubernetes.io/projected/a7128a81-4e4e-4635-b66c-f992c4b30d2a-kube-api-access-mtqq5\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:53 crc kubenswrapper[5120]: I0316 16:43:53.023396 5120 generic.go:358] "Generic (PLEG): container finished" podID="a7128a81-4e4e-4635-b66c-f992c4b30d2a" containerID="39b19d47df4280da111038dcf617135fe59f13c47f76f5f5da32391a2bd60988" exitCode=137 Mar 16 16:43:53 crc kubenswrapper[5120]: I0316 16:43:53.023448 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"a7128a81-4e4e-4635-b66c-f992c4b30d2a","Type":"ContainerDied","Data":"39b19d47df4280da111038dcf617135fe59f13c47f76f5f5da32391a2bd60988"} Mar 16 16:43:53 crc kubenswrapper[5120]: I0316 16:43:53.023491 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:43:53 crc kubenswrapper[5120]: I0316 16:43:53.023496 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"a7128a81-4e4e-4635-b66c-f992c4b30d2a","Type":"ContainerDied","Data":"e8ec7d985494e41386bd58f14a3c7f6bb5c3e70e44df8a11b90275ac6b1df56b"} Mar 16 16:43:53 crc kubenswrapper[5120]: I0316 16:43:53.023510 5120 scope.go:117] "RemoveContainer" containerID="39b19d47df4280da111038dcf617135fe59f13c47f76f5f5da32391a2bd60988" Mar 16 16:43:53 crc kubenswrapper[5120]: I0316 16:43:53.030621 5120 generic.go:358] "Generic (PLEG): container finished" podID="208d2d80-c39f-4984-bd83-13868306b946" containerID="c58db8625c8fa139b58596a9b64d009fd72fbf9ea6ce1858fb7fd48fe833e794" exitCode=137 Mar 16 16:43:53 crc kubenswrapper[5120]: I0316 16:43:53.030696 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"208d2d80-c39f-4984-bd83-13868306b946","Type":"ContainerDied","Data":"c58db8625c8fa139b58596a9b64d009fd72fbf9ea6ce1858fb7fd48fe833e794"} Mar 16 16:43:53 crc kubenswrapper[5120]: I0316 16:43:53.030740 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"208d2d80-c39f-4984-bd83-13868306b946","Type":"ContainerDied","Data":"057a5121ce7171db0a37ea4c6e12888dbe711a59741cc8493090d5be420ae492"} Mar 16 16:43:53 crc kubenswrapper[5120]: I0316 16:43:53.030791 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="057a5121ce7171db0a37ea4c6e12888dbe711a59741cc8493090d5be420ae492" Mar 16 16:43:53 crc kubenswrapper[5120]: I0316 16:43:53.043809 5120 generic.go:358] "Generic (PLEG): container finished" podID="636be6fd-cf1a-4f31-aa2b-6be52788333d" containerID="10a7e33721d5da23369bc4422d4cbb9b2fa2d5c64f2fff4f94c6d681301c74ff" exitCode=137 Mar 16 16:43:53 crc kubenswrapper[5120]: I0316 16:43:53.043915 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:43:53 crc kubenswrapper[5120]: I0316 16:43:53.043960 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"636be6fd-cf1a-4f31-aa2b-6be52788333d","Type":"ContainerDied","Data":"10a7e33721d5da23369bc4422d4cbb9b2fa2d5c64f2fff4f94c6d681301c74ff"} Mar 16 16:43:53 crc kubenswrapper[5120]: I0316 16:43:53.044004 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"636be6fd-cf1a-4f31-aa2b-6be52788333d","Type":"ContainerDied","Data":"69d36e33f5e24b64a1b99d42ba55b277a2bce27087314fd837822f0448579590"} Mar 16 16:43:53 crc kubenswrapper[5120]: I0316 16:43:53.061646 5120 scope.go:117] "RemoveContainer" containerID="39b19d47df4280da111038dcf617135fe59f13c47f76f5f5da32391a2bd60988" Mar 16 16:43:53 crc kubenswrapper[5120]: I0316 16:43:53.061817 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:43:53 crc kubenswrapper[5120]: E0316 16:43:53.062034 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"39b19d47df4280da111038dcf617135fe59f13c47f76f5f5da32391a2bd60988\": container with ID starting with 39b19d47df4280da111038dcf617135fe59f13c47f76f5f5da32391a2bd60988 not found: ID does not exist" containerID="39b19d47df4280da111038dcf617135fe59f13c47f76f5f5da32391a2bd60988" Mar 16 16:43:53 crc kubenswrapper[5120]: I0316 16:43:53.062142 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39b19d47df4280da111038dcf617135fe59f13c47f76f5f5da32391a2bd60988"} err="failed to get container status \"39b19d47df4280da111038dcf617135fe59f13c47f76f5f5da32391a2bd60988\": rpc error: code = NotFound desc = could not find container \"39b19d47df4280da111038dcf617135fe59f13c47f76f5f5da32391a2bd60988\": container with ID starting with 39b19d47df4280da111038dcf617135fe59f13c47f76f5f5da32391a2bd60988 not found: ID does not exist" Mar 16 16:43:53 crc kubenswrapper[5120]: I0316 16:43:53.062231 5120 scope.go:117] "RemoveContainer" containerID="10a7e33721d5da23369bc4422d4cbb9b2fa2d5c64f2fff4f94c6d681301c74ff" Mar 16 16:43:53 crc kubenswrapper[5120]: I0316 16:43:53.077698 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 16:43:53 crc kubenswrapper[5120]: I0316 16:43:53.084616 5120 scope.go:117] "RemoveContainer" containerID="10a7e33721d5da23369bc4422d4cbb9b2fa2d5c64f2fff4f94c6d681301c74ff" Mar 16 16:43:53 crc kubenswrapper[5120]: E0316 16:43:53.085084 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"10a7e33721d5da23369bc4422d4cbb9b2fa2d5c64f2fff4f94c6d681301c74ff\": container with ID starting with 10a7e33721d5da23369bc4422d4cbb9b2fa2d5c64f2fff4f94c6d681301c74ff not found: ID does not exist" containerID="10a7e33721d5da23369bc4422d4cbb9b2fa2d5c64f2fff4f94c6d681301c74ff" Mar 16 16:43:53 crc kubenswrapper[5120]: I0316 16:43:53.085115 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10a7e33721d5da23369bc4422d4cbb9b2fa2d5c64f2fff4f94c6d681301c74ff"} err="failed to get container status \"10a7e33721d5da23369bc4422d4cbb9b2fa2d5c64f2fff4f94c6d681301c74ff\": rpc error: code = NotFound desc = could not find container \"10a7e33721d5da23369bc4422d4cbb9b2fa2d5c64f2fff4f94c6d681301c74ff\": container with ID starting with 10a7e33721d5da23369bc4422d4cbb9b2fa2d5c64f2fff4f94c6d681301c74ff not found: ID does not exist" Mar 16 16:43:53 crc kubenswrapper[5120]: I0316 16:43:53.086328 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 16:43:53 crc kubenswrapper[5120]: I0316 16:43:53.089180 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/208d2d80-c39f-4984-bd83-13868306b946-sg-core-conf-yaml\") pod \"208d2d80-c39f-4984-bd83-13868306b946\" (UID: \"208d2d80-c39f-4984-bd83-13868306b946\") " Mar 16 16:43:53 crc kubenswrapper[5120]: I0316 16:43:53.089251 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/208d2d80-c39f-4984-bd83-13868306b946-config-data\") pod \"208d2d80-c39f-4984-bd83-13868306b946\" (UID: \"208d2d80-c39f-4984-bd83-13868306b946\") " Mar 16 16:43:53 crc kubenswrapper[5120]: I0316 16:43:53.089462 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/208d2d80-c39f-4984-bd83-13868306b946-log-httpd\") pod \"208d2d80-c39f-4984-bd83-13868306b946\" (UID: \"208d2d80-c39f-4984-bd83-13868306b946\") " Mar 16 16:43:53 crc kubenswrapper[5120]: I0316 16:43:53.089495 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/208d2d80-c39f-4984-bd83-13868306b946-combined-ca-bundle\") pod \"208d2d80-c39f-4984-bd83-13868306b946\" (UID: \"208d2d80-c39f-4984-bd83-13868306b946\") " Mar 16 16:43:53 crc kubenswrapper[5120]: I0316 16:43:53.089530 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/208d2d80-c39f-4984-bd83-13868306b946-run-httpd\") pod \"208d2d80-c39f-4984-bd83-13868306b946\" (UID: \"208d2d80-c39f-4984-bd83-13868306b946\") " Mar 16 16:43:53 crc kubenswrapper[5120]: I0316 16:43:53.089568 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/208d2d80-c39f-4984-bd83-13868306b946-ceilometer-tls-certs\") pod \"208d2d80-c39f-4984-bd83-13868306b946\" (UID: \"208d2d80-c39f-4984-bd83-13868306b946\") " Mar 16 16:43:53 crc kubenswrapper[5120]: I0316 16:43:53.089614 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/208d2d80-c39f-4984-bd83-13868306b946-scripts\") pod \"208d2d80-c39f-4984-bd83-13868306b946\" (UID: \"208d2d80-c39f-4984-bd83-13868306b946\") " Mar 16 16:43:53 crc kubenswrapper[5120]: I0316 16:43:53.089644 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/636be6fd-cf1a-4f31-aa2b-6be52788333d-config-data\") pod \"636be6fd-cf1a-4f31-aa2b-6be52788333d\" (UID: \"636be6fd-cf1a-4f31-aa2b-6be52788333d\") " Mar 16 16:43:53 crc kubenswrapper[5120]: I0316 16:43:53.089690 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-75z22\" (UniqueName: \"kubernetes.io/projected/636be6fd-cf1a-4f31-aa2b-6be52788333d-kube-api-access-75z22\") pod \"636be6fd-cf1a-4f31-aa2b-6be52788333d\" (UID: \"636be6fd-cf1a-4f31-aa2b-6be52788333d\") " Mar 16 16:43:53 crc kubenswrapper[5120]: I0316 16:43:53.090009 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/208d2d80-c39f-4984-bd83-13868306b946-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "208d2d80-c39f-4984-bd83-13868306b946" (UID: "208d2d80-c39f-4984-bd83-13868306b946"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:43:53 crc kubenswrapper[5120]: I0316 16:43:53.090316 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pcsbl\" (UniqueName: \"kubernetes.io/projected/208d2d80-c39f-4984-bd83-13868306b946-kube-api-access-pcsbl\") pod \"208d2d80-c39f-4984-bd83-13868306b946\" (UID: \"208d2d80-c39f-4984-bd83-13868306b946\") " Mar 16 16:43:53 crc kubenswrapper[5120]: I0316 16:43:53.090433 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/636be6fd-cf1a-4f31-aa2b-6be52788333d-combined-ca-bundle\") pod \"636be6fd-cf1a-4f31-aa2b-6be52788333d\" (UID: \"636be6fd-cf1a-4f31-aa2b-6be52788333d\") " Mar 16 16:43:53 crc kubenswrapper[5120]: I0316 16:43:53.091043 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/208d2d80-c39f-4984-bd83-13868306b946-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "208d2d80-c39f-4984-bd83-13868306b946" (UID: "208d2d80-c39f-4984-bd83-13868306b946"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:43:53 crc kubenswrapper[5120]: I0316 16:43:53.091211 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/208d2d80-c39f-4984-bd83-13868306b946-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:53 crc kubenswrapper[5120]: I0316 16:43:53.091236 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/208d2d80-c39f-4984-bd83-13868306b946-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:53 crc kubenswrapper[5120]: I0316 16:43:53.094467 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/208d2d80-c39f-4984-bd83-13868306b946-scripts" (OuterVolumeSpecName: "scripts") pod "208d2d80-c39f-4984-bd83-13868306b946" (UID: "208d2d80-c39f-4984-bd83-13868306b946"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:43:53 crc kubenswrapper[5120]: I0316 16:43:53.094557 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/636be6fd-cf1a-4f31-aa2b-6be52788333d-kube-api-access-75z22" (OuterVolumeSpecName: "kube-api-access-75z22") pod "636be6fd-cf1a-4f31-aa2b-6be52788333d" (UID: "636be6fd-cf1a-4f31-aa2b-6be52788333d"). InnerVolumeSpecName "kube-api-access-75z22". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:43:53 crc kubenswrapper[5120]: I0316 16:43:53.095507 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/208d2d80-c39f-4984-bd83-13868306b946-kube-api-access-pcsbl" (OuterVolumeSpecName: "kube-api-access-pcsbl") pod "208d2d80-c39f-4984-bd83-13868306b946" (UID: "208d2d80-c39f-4984-bd83-13868306b946"). InnerVolumeSpecName "kube-api-access-pcsbl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:43:53 crc kubenswrapper[5120]: I0316 16:43:53.111109 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/636be6fd-cf1a-4f31-aa2b-6be52788333d-config-data" (OuterVolumeSpecName: "config-data") pod "636be6fd-cf1a-4f31-aa2b-6be52788333d" (UID: "636be6fd-cf1a-4f31-aa2b-6be52788333d"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:43:53 crc kubenswrapper[5120]: I0316 16:43:53.111876 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/636be6fd-cf1a-4f31-aa2b-6be52788333d-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "636be6fd-cf1a-4f31-aa2b-6be52788333d" (UID: "636be6fd-cf1a-4f31-aa2b-6be52788333d"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:43:53 crc kubenswrapper[5120]: I0316 16:43:53.113441 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/208d2d80-c39f-4984-bd83-13868306b946-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "208d2d80-c39f-4984-bd83-13868306b946" (UID: "208d2d80-c39f-4984-bd83-13868306b946"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:43:53 crc kubenswrapper[5120]: I0316 16:43:53.133611 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/208d2d80-c39f-4984-bd83-13868306b946-ceilometer-tls-certs" (OuterVolumeSpecName: "ceilometer-tls-certs") pod "208d2d80-c39f-4984-bd83-13868306b946" (UID: "208d2d80-c39f-4984-bd83-13868306b946"). InnerVolumeSpecName "ceilometer-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:43:53 crc kubenswrapper[5120]: I0316 16:43:53.141505 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/208d2d80-c39f-4984-bd83-13868306b946-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "208d2d80-c39f-4984-bd83-13868306b946" (UID: "208d2d80-c39f-4984-bd83-13868306b946"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:43:53 crc kubenswrapper[5120]: I0316 16:43:53.169414 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/208d2d80-c39f-4984-bd83-13868306b946-config-data" (OuterVolumeSpecName: "config-data") pod "208d2d80-c39f-4984-bd83-13868306b946" (UID: "208d2d80-c39f-4984-bd83-13868306b946"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:43:53 crc kubenswrapper[5120]: I0316 16:43:53.193519 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/208d2d80-c39f-4984-bd83-13868306b946-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:53 crc kubenswrapper[5120]: I0316 16:43:53.193574 5120 reconciler_common.go:299] "Volume detached for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/208d2d80-c39f-4984-bd83-13868306b946-ceilometer-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:53 crc kubenswrapper[5120]: I0316 16:43:53.193595 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/208d2d80-c39f-4984-bd83-13868306b946-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:53 crc kubenswrapper[5120]: I0316 16:43:53.193606 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/636be6fd-cf1a-4f31-aa2b-6be52788333d-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:53 crc kubenswrapper[5120]: I0316 16:43:53.193616 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-75z22\" (UniqueName: \"kubernetes.io/projected/636be6fd-cf1a-4f31-aa2b-6be52788333d-kube-api-access-75z22\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:53 crc kubenswrapper[5120]: I0316 16:43:53.193626 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pcsbl\" (UniqueName: \"kubernetes.io/projected/208d2d80-c39f-4984-bd83-13868306b946-kube-api-access-pcsbl\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:53 crc kubenswrapper[5120]: I0316 16:43:53.193634 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/636be6fd-cf1a-4f31-aa2b-6be52788333d-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:53 crc kubenswrapper[5120]: I0316 16:43:53.193643 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/208d2d80-c39f-4984-bd83-13868306b946-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:53 crc kubenswrapper[5120]: I0316 16:43:53.193651 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/208d2d80-c39f-4984-bd83-13868306b946-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:43:53 crc kubenswrapper[5120]: I0316 16:43:53.383678 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:43:53 crc kubenswrapper[5120]: I0316 16:43:53.394645 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:43:54 crc kubenswrapper[5120]: I0316 16:43:54.068999 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:43:54 crc kubenswrapper[5120]: I0316 16:43:54.106154 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:43:54 crc kubenswrapper[5120]: I0316 16:43:54.113807 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:43:54 crc kubenswrapper[5120]: I0316 16:43:54.673348 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="208d2d80-c39f-4984-bd83-13868306b946" path="/var/lib/kubelet/pods/208d2d80-c39f-4984-bd83-13868306b946/volumes" Mar 16 16:43:54 crc kubenswrapper[5120]: I0316 16:43:54.674194 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="636be6fd-cf1a-4f31-aa2b-6be52788333d" path="/var/lib/kubelet/pods/636be6fd-cf1a-4f31-aa2b-6be52788333d/volumes" Mar 16 16:43:54 crc kubenswrapper[5120]: I0316 16:43:54.674631 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a7128a81-4e4e-4635-b66c-f992c4b30d2a" path="/var/lib/kubelet/pods/a7128a81-4e4e-4635-b66c-f992c4b30d2a/volumes" Mar 16 16:43:54 crc kubenswrapper[5120]: I0316 16:43:54.827647 5120 pod_container_manager_linux.go:217] "Failed to delete cgroup paths" cgroupName=["kubepods","besteffort","pod93b8115e-671f-4dff-96ec-a78e9ad5b022"] err="unable to destroy cgroup paths for cgroup [kubepods besteffort pod93b8115e-671f-4dff-96ec-a78e9ad5b022] : Timed out while waiting for systemd to remove kubepods-besteffort-pod93b8115e_671f_4dff_96ec_a78e9ad5b022.slice" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.150902 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-infra/auto-csr-approver-29561324-js8wp"] Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.152795 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9e86e40-d30c-4208-852b-5d6737ba05ce" containerName="nova-metadata-metadata" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.152815 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9e86e40-d30c-4208-852b-5d6737ba05ce" containerName="nova-metadata-metadata" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.152828 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f161303-6db3-42fc-8cca-089c09eabda5" containerName="object-expirer" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.152834 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f161303-6db3-42fc-8cca-089c09eabda5" containerName="object-expirer" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.152845 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1518bfb1-3665-455c-84df-7c6eba7b93cf" containerName="barbican-api-log" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.152852 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1518bfb1-3665-455c-84df-7c6eba7b93cf" containerName="barbican-api-log" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.152865 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="285f9896-1a25-4942-96e7-06cff0c87338" containerName="placement-log" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.152871 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="285f9896-1a25-4942-96e7-06cff0c87338" containerName="placement-log" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.152878 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be094b3e-494e-420d-b458-0e32770cd540" containerName="glance-httpd" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.152883 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="be094b3e-494e-420d-b458-0e32770cd540" containerName="glance-httpd" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.152891 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="935a7850-d7f8-438f-a787-6a78e33db090" containerName="nova-api-api" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.152897 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="935a7850-d7f8-438f-a787-6a78e33db090" containerName="nova-api-api" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.152907 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70745ff2-698e-465f-b638-2f88c5f0a8c1" containerName="memcached" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.152912 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="70745ff2-698e-465f-b638-2f88c5f0a8c1" containerName="memcached" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.152919 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e" containerName="cinder-api-log" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.152924 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e" containerName="cinder-api-log" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.152940 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5223e38-12b9-4877-9a14-585ddcd5f699" containerName="keystone-api" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.152946 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5223e38-12b9-4877-9a14-585ddcd5f699" containerName="keystone-api" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.152954 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6cef508e-ad21-4c82-ba79-4862f0e98691" containerName="neutron-httpd" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.152959 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="6cef508e-ad21-4c82-ba79-4862f0e98691" containerName="neutron-httpd" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.152967 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="208d2d80-c39f-4984-bd83-13868306b946" containerName="ceilometer-notification-agent" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.152974 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="208d2d80-c39f-4984-bd83-13868306b946" containerName="ceilometer-notification-agent" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.152982 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f161303-6db3-42fc-8cca-089c09eabda5" containerName="object-replicator" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.152987 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f161303-6db3-42fc-8cca-089c09eabda5" containerName="object-replicator" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.153001 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="232eb98c-2900-4d2b-adfb-5db5139e3934" containerName="init" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.153007 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="232eb98c-2900-4d2b-adfb-5db5139e3934" containerName="init" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.153017 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c2042b3-62bc-476f-b032-91e9f77da74a" containerName="barbican-worker-log" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.153022 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c2042b3-62bc-476f-b032-91e9f77da74a" containerName="barbican-worker-log" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.153032 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55a201e2-20da-49c3-8216-77a042dd3b31" containerName="setup-container" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.153038 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="55a201e2-20da-49c3-8216-77a042dd3b31" containerName="setup-container" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.153046 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f161303-6db3-42fc-8cca-089c09eabda5" containerName="container-replicator" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.153052 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f161303-6db3-42fc-8cca-089c09eabda5" containerName="container-replicator" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.153060 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f161303-6db3-42fc-8cca-089c09eabda5" containerName="object-server" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.153066 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f161303-6db3-42fc-8cca-089c09eabda5" containerName="object-server" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.153075 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="208d2d80-c39f-4984-bd83-13868306b946" containerName="sg-core" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.153081 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="208d2d80-c39f-4984-bd83-13868306b946" containerName="sg-core" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.153091 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f161303-6db3-42fc-8cca-089c09eabda5" containerName="container-updater" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.153096 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f161303-6db3-42fc-8cca-089c09eabda5" containerName="container-updater" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.153104 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="285f9896-1a25-4942-96e7-06cff0c87338" containerName="placement-api" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.153109 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="285f9896-1a25-4942-96e7-06cff0c87338" containerName="placement-api" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.153116 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29c96611-b802-4cfa-a407-7e3c1f341848" containerName="ovn-northd" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.153122 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="29c96611-b802-4cfa-a407-7e3c1f341848" containerName="ovn-northd" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.153156 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ffbcbd91-454c-4998-9b12-69ed7f853328" containerName="glance-httpd" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.153163 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ffbcbd91-454c-4998-9b12-69ed7f853328" containerName="glance-httpd" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.153168 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55a201e2-20da-49c3-8216-77a042dd3b31" containerName="rabbitmq" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.153174 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="55a201e2-20da-49c3-8216-77a042dd3b31" containerName="rabbitmq" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.153189 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29c96611-b802-4cfa-a407-7e3c1f341848" containerName="openstack-network-exporter" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.153194 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="29c96611-b802-4cfa-a407-7e3c1f341848" containerName="openstack-network-exporter" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.153202 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6cef508e-ad21-4c82-ba79-4862f0e98691" containerName="neutron-api" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.153207 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="6cef508e-ad21-4c82-ba79-4862f0e98691" containerName="neutron-api" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.153214 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1518bfb1-3665-455c-84df-7c6eba7b93cf" containerName="barbican-api" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.153219 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1518bfb1-3665-455c-84df-7c6eba7b93cf" containerName="barbican-api" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.153228 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8865ef1d-984f-4076-b151-fff5f7da9e62" containerName="galera" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.153233 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8865ef1d-984f-4076-b151-fff5f7da9e62" containerName="galera" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.153239 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f161303-6db3-42fc-8cca-089c09eabda5" containerName="object-auditor" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.153244 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f161303-6db3-42fc-8cca-089c09eabda5" containerName="object-auditor" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.153251 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e" containerName="cinder-api" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.153257 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e" containerName="cinder-api" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.153262 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be094b3e-494e-420d-b458-0e32770cd540" containerName="glance-log" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.153267 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="be094b3e-494e-420d-b458-0e32770cd540" containerName="glance-log" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.153276 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="208d2d80-c39f-4984-bd83-13868306b946" containerName="ceilometer-central-agent" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.153282 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="208d2d80-c39f-4984-bd83-13868306b946" containerName="ceilometer-central-agent" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.153290 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f161303-6db3-42fc-8cca-089c09eabda5" containerName="account-reaper" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.153295 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f161303-6db3-42fc-8cca-089c09eabda5" containerName="account-reaper" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.153306 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7128a81-4e4e-4635-b66c-f992c4b30d2a" containerName="nova-cell1-conductor-conductor" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.153312 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7128a81-4e4e-4635-b66c-f992c4b30d2a" containerName="nova-cell1-conductor-conductor" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.153321 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a708d1c-43d9-400d-a30e-49891c1fc39d" containerName="barbican-keystone-listener-log" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.153326 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a708d1c-43d9-400d-a30e-49891c1fc39d" containerName="barbican-keystone-listener-log" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.153336 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ffbcbd91-454c-4998-9b12-69ed7f853328" containerName="glance-log" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.153341 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ffbcbd91-454c-4998-9b12-69ed7f853328" containerName="glance-log" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.153349 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f161303-6db3-42fc-8cca-089c09eabda5" containerName="container-server" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.153354 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f161303-6db3-42fc-8cca-089c09eabda5" containerName="container-server" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.153362 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f161303-6db3-42fc-8cca-089c09eabda5" containerName="container-auditor" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.153367 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f161303-6db3-42fc-8cca-089c09eabda5" containerName="container-auditor" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.153377 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a708d1c-43d9-400d-a30e-49891c1fc39d" containerName="barbican-keystone-listener" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.153384 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a708d1c-43d9-400d-a30e-49891c1fc39d" containerName="barbican-keystone-listener" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.153391 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9e86e40-d30c-4208-852b-5d6737ba05ce" containerName="nova-metadata-log" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.153397 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9e86e40-d30c-4208-852b-5d6737ba05ce" containerName="nova-metadata-log" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.153408 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f161303-6db3-42fc-8cca-089c09eabda5" containerName="account-auditor" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.153413 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f161303-6db3-42fc-8cca-089c09eabda5" containerName="account-auditor" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.153423 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8865ef1d-984f-4076-b151-fff5f7da9e62" containerName="mysql-bootstrap" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.153429 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8865ef1d-984f-4076-b151-fff5f7da9e62" containerName="mysql-bootstrap" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.153439 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f161303-6db3-42fc-8cca-089c09eabda5" containerName="rsync" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.153446 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f161303-6db3-42fc-8cca-089c09eabda5" containerName="rsync" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.153459 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="935a7850-d7f8-438f-a787-6a78e33db090" containerName="nova-api-log" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.153465 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="935a7850-d7f8-438f-a787-6a78e33db090" containerName="nova-api-log" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.153472 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f161303-6db3-42fc-8cca-089c09eabda5" containerName="account-replicator" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.153489 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f161303-6db3-42fc-8cca-089c09eabda5" containerName="account-replicator" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.153501 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="232eb98c-2900-4d2b-adfb-5db5139e3934" containerName="dnsmasq-dns" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.153507 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="232eb98c-2900-4d2b-adfb-5db5139e3934" containerName="dnsmasq-dns" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.153516 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f161303-6db3-42fc-8cca-089c09eabda5" containerName="swift-recon-cron" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.153524 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f161303-6db3-42fc-8cca-089c09eabda5" containerName="swift-recon-cron" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.153536 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="636be6fd-cf1a-4f31-aa2b-6be52788333d" containerName="nova-cell0-conductor-conductor" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.153543 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="636be6fd-cf1a-4f31-aa2b-6be52788333d" containerName="nova-cell0-conductor-conductor" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.153554 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f161303-6db3-42fc-8cca-089c09eabda5" containerName="account-server" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.153560 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f161303-6db3-42fc-8cca-089c09eabda5" containerName="account-server" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.153570 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c2042b3-62bc-476f-b032-91e9f77da74a" containerName="barbican-worker" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.153575 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c2042b3-62bc-476f-b032-91e9f77da74a" containerName="barbican-worker" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.153583 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="208d2d80-c39f-4984-bd83-13868306b946" containerName="proxy-httpd" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.153588 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="208d2d80-c39f-4984-bd83-13868306b946" containerName="proxy-httpd" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.153597 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f161303-6db3-42fc-8cca-089c09eabda5" containerName="object-updater" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.153602 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f161303-6db3-42fc-8cca-089c09eabda5" containerName="object-updater" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.153734 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="935a7850-d7f8-438f-a787-6a78e33db090" containerName="nova-api-api" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.153752 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="935a7850-d7f8-438f-a787-6a78e33db090" containerName="nova-api-log" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.153779 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e" containerName="cinder-api-log" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.153791 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7f161303-6db3-42fc-8cca-089c09eabda5" containerName="account-auditor" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.153801 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="4a708d1c-43d9-400d-a30e-49891c1fc39d" containerName="barbican-keystone-listener-log" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.153811 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="4a708d1c-43d9-400d-a30e-49891c1fc39d" containerName="barbican-keystone-listener" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.153820 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e9e86e40-d30c-4208-852b-5d6737ba05ce" containerName="nova-metadata-metadata" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.153835 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7f161303-6db3-42fc-8cca-089c09eabda5" containerName="container-auditor" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.153847 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="29c96611-b802-4cfa-a407-7e3c1f341848" containerName="openstack-network-exporter" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.153855 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7f161303-6db3-42fc-8cca-089c09eabda5" containerName="object-server" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.153865 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="be094b3e-494e-420d-b458-0e32770cd540" containerName="glance-log" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.153874 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="232eb98c-2900-4d2b-adfb-5db5139e3934" containerName="dnsmasq-dns" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.153882 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="29c96611-b802-4cfa-a407-7e3c1f341848" containerName="ovn-northd" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.153892 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7f161303-6db3-42fc-8cca-089c09eabda5" containerName="account-reaper" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.153900 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7f161303-6db3-42fc-8cca-089c09eabda5" containerName="object-expirer" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.153915 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7f161303-6db3-42fc-8cca-089c09eabda5" containerName="account-server" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.153925 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7f161303-6db3-42fc-8cca-089c09eabda5" containerName="account-replicator" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.153932 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7f161303-6db3-42fc-8cca-089c09eabda5" containerName="swift-recon-cron" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.153940 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c5223e38-12b9-4877-9a14-585ddcd5f699" containerName="keystone-api" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.153947 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="285f9896-1a25-4942-96e7-06cff0c87338" containerName="placement-log" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.153955 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="208d2d80-c39f-4984-bd83-13868306b946" containerName="proxy-httpd" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.153965 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="208d2d80-c39f-4984-bd83-13868306b946" containerName="ceilometer-notification-agent" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.153973 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7f161303-6db3-42fc-8cca-089c09eabda5" containerName="container-replicator" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.153981 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="6cef508e-ad21-4c82-ba79-4862f0e98691" containerName="neutron-api" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.153990 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="8865ef1d-984f-4076-b151-fff5f7da9e62" containerName="galera" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.153997 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1518bfb1-3665-455c-84df-7c6eba7b93cf" containerName="barbican-api-log" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.154005 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="55a201e2-20da-49c3-8216-77a042dd3b31" containerName="rabbitmq" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.154013 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ffbcbd91-454c-4998-9b12-69ed7f853328" containerName="glance-httpd" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.154023 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="3c2042b3-62bc-476f-b032-91e9f77da74a" containerName="barbican-worker-log" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.154030 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e9e86e40-d30c-4208-852b-5d6737ba05ce" containerName="nova-metadata-log" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.154040 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="636be6fd-cf1a-4f31-aa2b-6be52788333d" containerName="nova-cell0-conductor-conductor" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.154055 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7f161303-6db3-42fc-8cca-089c09eabda5" containerName="object-updater" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.154067 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="6cef508e-ad21-4c82-ba79-4862f0e98691" containerName="neutron-httpd" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.154078 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="208d2d80-c39f-4984-bd83-13868306b946" containerName="sg-core" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.154087 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="208d2d80-c39f-4984-bd83-13868306b946" containerName="ceilometer-central-agent" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.154096 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="be094b3e-494e-420d-b458-0e32770cd540" containerName="glance-httpd" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.154105 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ffbcbd91-454c-4998-9b12-69ed7f853328" containerName="glance-log" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.154115 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1518bfb1-3665-455c-84df-7c6eba7b93cf" containerName="barbican-api" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.154123 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7f161303-6db3-42fc-8cca-089c09eabda5" containerName="container-server" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.154135 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7f161303-6db3-42fc-8cca-089c09eabda5" containerName="rsync" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.154144 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7f161303-6db3-42fc-8cca-089c09eabda5" containerName="container-updater" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.154156 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="3c2042b3-62bc-476f-b032-91e9f77da74a" containerName="barbican-worker" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.154166 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="08a8a8ac-6b7a-4a61-a88c-a98fd07aa47e" containerName="cinder-api" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.154175 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="a7128a81-4e4e-4635-b66c-f992c4b30d2a" containerName="nova-cell1-conductor-conductor" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.154185 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7f161303-6db3-42fc-8cca-089c09eabda5" containerName="object-replicator" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.154193 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="285f9896-1a25-4942-96e7-06cff0c87338" containerName="placement-api" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.154203 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7f161303-6db3-42fc-8cca-089c09eabda5" containerName="object-auditor" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.154213 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="70745ff2-698e-465f-b638-2f88c5f0a8c1" containerName="memcached" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.164346 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561324-js8wp"] Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.164510 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561324-js8wp" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.166611 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"kube-root-ca.crt\"" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.166912 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"openshift-service-ca.crt\"" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.172342 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-infra\"/\"csr-approver-sa-dockercfg-x2nsz\"" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.348020 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22kcj\" (UniqueName: \"kubernetes.io/projected/b584daf0-61f5-4d60-9bbf-9e25b455058e-kube-api-access-22kcj\") pod \"auto-csr-approver-29561324-js8wp\" (UID: \"b584daf0-61f5-4d60-9bbf-9e25b455058e\") " pod="openshift-infra/auto-csr-approver-29561324-js8wp" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.451824 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-22kcj\" (UniqueName: \"kubernetes.io/projected/b584daf0-61f5-4d60-9bbf-9e25b455058e-kube-api-access-22kcj\") pod \"auto-csr-approver-29561324-js8wp\" (UID: \"b584daf0-61f5-4d60-9bbf-9e25b455058e\") " pod="openshift-infra/auto-csr-approver-29561324-js8wp" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.472517 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-22kcj\" (UniqueName: \"kubernetes.io/projected/b584daf0-61f5-4d60-9bbf-9e25b455058e-kube-api-access-22kcj\") pod \"auto-csr-approver-29561324-js8wp\" (UID: \"b584daf0-61f5-4d60-9bbf-9e25b455058e\") " pod="openshift-infra/auto-csr-approver-29561324-js8wp" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.494136 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561324-js8wp" Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.974038 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561324-js8wp"] Mar 16 16:44:00 crc kubenswrapper[5120]: I0316 16:44:00.980656 5120 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Mar 16 16:44:01 crc kubenswrapper[5120]: I0316 16:44:01.149963 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561324-js8wp" event={"ID":"b584daf0-61f5-4d60-9bbf-9e25b455058e","Type":"ContainerStarted","Data":"6caf38c3cc917bbfd2699d3609c52c67c8864639821f02c80f9fd469759f9b48"} Mar 16 16:44:03 crc kubenswrapper[5120]: I0316 16:44:03.166601 5120 generic.go:358] "Generic (PLEG): container finished" podID="b584daf0-61f5-4d60-9bbf-9e25b455058e" containerID="b18f58ad72df1394f60852743cec1405ff4ce5968d7a0bc69501221e5ebaf3dd" exitCode=0 Mar 16 16:44:03 crc kubenswrapper[5120]: I0316 16:44:03.166667 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561324-js8wp" event={"ID":"b584daf0-61f5-4d60-9bbf-9e25b455058e","Type":"ContainerDied","Data":"b18f58ad72df1394f60852743cec1405ff4ce5968d7a0bc69501221e5ebaf3dd"} Mar 16 16:44:04 crc kubenswrapper[5120]: I0316 16:44:04.483975 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561324-js8wp" Mar 16 16:44:04 crc kubenswrapper[5120]: I0316 16:44:04.527928 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-22kcj\" (UniqueName: \"kubernetes.io/projected/b584daf0-61f5-4d60-9bbf-9e25b455058e-kube-api-access-22kcj\") pod \"b584daf0-61f5-4d60-9bbf-9e25b455058e\" (UID: \"b584daf0-61f5-4d60-9bbf-9e25b455058e\") " Mar 16 16:44:04 crc kubenswrapper[5120]: I0316 16:44:04.536125 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b584daf0-61f5-4d60-9bbf-9e25b455058e-kube-api-access-22kcj" (OuterVolumeSpecName: "kube-api-access-22kcj") pod "b584daf0-61f5-4d60-9bbf-9e25b455058e" (UID: "b584daf0-61f5-4d60-9bbf-9e25b455058e"). InnerVolumeSpecName "kube-api-access-22kcj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:44:04 crc kubenswrapper[5120]: I0316 16:44:04.630126 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-22kcj\" (UniqueName: \"kubernetes.io/projected/b584daf0-61f5-4d60-9bbf-9e25b455058e-kube-api-access-22kcj\") on node \"crc\" DevicePath \"\"" Mar 16 16:44:04 crc kubenswrapper[5120]: I0316 16:44:04.664283 5120 scope.go:117] "RemoveContainer" containerID="35a7dd6e19084cee69ca16203bca6378ea0cdf6a685ca2093ab847e5904eb9e6" Mar 16 16:44:04 crc kubenswrapper[5120]: E0316 16:44:04.664751 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:44:05 crc kubenswrapper[5120]: I0316 16:44:05.200928 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561324-js8wp" event={"ID":"b584daf0-61f5-4d60-9bbf-9e25b455058e","Type":"ContainerDied","Data":"6caf38c3cc917bbfd2699d3609c52c67c8864639821f02c80f9fd469759f9b48"} Mar 16 16:44:05 crc kubenswrapper[5120]: I0316 16:44:05.200970 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6caf38c3cc917bbfd2699d3609c52c67c8864639821f02c80f9fd469759f9b48" Mar 16 16:44:05 crc kubenswrapper[5120]: I0316 16:44:05.200967 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561324-js8wp" Mar 16 16:44:05 crc kubenswrapper[5120]: I0316 16:44:05.545441 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-infra/auto-csr-approver-29561318-jbc9t"] Mar 16 16:44:05 crc kubenswrapper[5120]: I0316 16:44:05.550903 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-infra/auto-csr-approver-29561318-jbc9t"] Mar 16 16:44:06 crc kubenswrapper[5120]: I0316 16:44:06.675365 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e5305d3f-9994-4be8-8774-611da8c52266" path="/var/lib/kubelet/pods/e5305d3f-9994-4be8-8774-611da8c52266/volumes" Mar 16 16:44:07 crc kubenswrapper[5120]: E0316 16:44:07.929233 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1314224 actualBytes=10240 Mar 16 16:44:17 crc kubenswrapper[5120]: I0316 16:44:17.663870 5120 scope.go:117] "RemoveContainer" containerID="35a7dd6e19084cee69ca16203bca6378ea0cdf6a685ca2093ab847e5904eb9e6" Mar 16 16:44:17 crc kubenswrapper[5120]: E0316 16:44:17.664680 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:44:24 crc kubenswrapper[5120]: E0316 16:44:24.691847 5120 handlers.go:80] "Exec lifecycle hook for Container in Pod failed" err=< Mar 16 16:44:24 crc kubenswrapper[5120]: command '/bin/bash -c if [ ! -z "$(cat /etc/pod-info/skipPreStopChecks)" ]; then exit 0; fi; rabbitmq-upgrade await_online_quorum_plus_one -t 604800 && rabbitmq-upgrade await_online_synchronized_mirror -t 604800 || true && rabbitmq-upgrade drain -t 604800' exited with 69: Error: unable to perform an operation on node 'rabbit@rabbitmq-cell1-server-0.rabbitmq-cell1-nodes.openstack-kuttl-tests'. Please see diagnostics information and suggestions below. Mar 16 16:44:24 crc kubenswrapper[5120]: Mar 16 16:44:24 crc kubenswrapper[5120]: Most common reasons for this are: Mar 16 16:44:24 crc kubenswrapper[5120]: Mar 16 16:44:24 crc kubenswrapper[5120]: * Target node is unreachable (e.g. due to hostname resolution, TCP connection or firewall issues) Mar 16 16:44:24 crc kubenswrapper[5120]: * CLI tool fails to authenticate with the server (e.g. due to CLI tool's Erlang cookie not matching that of the server) Mar 16 16:44:24 crc kubenswrapper[5120]: * Target node is not running Mar 16 16:44:24 crc kubenswrapper[5120]: Mar 16 16:44:24 crc kubenswrapper[5120]: In addition to the diagnostics info below: Mar 16 16:44:24 crc kubenswrapper[5120]: Mar 16 16:44:24 crc kubenswrapper[5120]: * See the CLI, clustering and networking guides on https://rabbitmq.com/documentation.html to learn more Mar 16 16:44:24 crc kubenswrapper[5120]: * Consult server logs on node rabbit@rabbitmq-cell1-server-0.rabbitmq-cell1-nodes.openstack-kuttl-tests Mar 16 16:44:24 crc kubenswrapper[5120]: * If target node is configured to use long node names, don't forget to use --longnames with CLI tools Mar 16 16:44:24 crc kubenswrapper[5120]: Mar 16 16:44:24 crc kubenswrapper[5120]: DIAGNOSTICS Mar 16 16:44:24 crc kubenswrapper[5120]: =========== Mar 16 16:44:24 crc kubenswrapper[5120]: Mar 16 16:44:24 crc kubenswrapper[5120]: attempted to contact: ['rabbit@rabbitmq-cell1-server-0.rabbitmq-cell1-nodes.openstack-kuttl-tests'] Mar 16 16:44:24 crc kubenswrapper[5120]: Mar 16 16:44:24 crc kubenswrapper[5120]: rabbit@rabbitmq-cell1-server-0.rabbitmq-cell1-nodes.openstack-kuttl-tests: Mar 16 16:44:24 crc kubenswrapper[5120]: * unable to connect to epmd (port 4369) on rabbitmq-cell1-server-0.rabbitmq-cell1-nodes.openstack-kuttl-tests: nxdomain (non-existing domain) Mar 16 16:44:24 crc kubenswrapper[5120]: Mar 16 16:44:24 crc kubenswrapper[5120]: Mar 16 16:44:24 crc kubenswrapper[5120]: Current node details: Mar 16 16:44:24 crc kubenswrapper[5120]: * node name: 'rabbitmqcli-975-rabbit@rabbitmq-cell1-server-0.rabbitmq-cell1-nodes.openstack-kuttl-tests' Mar 16 16:44:24 crc kubenswrapper[5120]: * effective user's home directory: /var/lib/rabbitmq Mar 16 16:44:24 crc kubenswrapper[5120]: * Erlang cookie hash: rJB+eeImOk3SzlTg4Dhkig== Mar 16 16:44:24 crc kubenswrapper[5120]: Mar 16 16:44:24 crc kubenswrapper[5120]: Error: unable to perform an operation on node 'rabbit@rabbitmq-cell1-server-0.rabbitmq-cell1-nodes.openstack-kuttl-tests'. Please see diagnostics information and suggestions below. Mar 16 16:44:24 crc kubenswrapper[5120]: Mar 16 16:44:24 crc kubenswrapper[5120]: Most common reasons for this are: Mar 16 16:44:24 crc kubenswrapper[5120]: Mar 16 16:44:24 crc kubenswrapper[5120]: * Target node is unreachable (e.g. due to hostname resolution, TCP connection or firewall issues) Mar 16 16:44:24 crc kubenswrapper[5120]: * CLI tool fails to authenticate with the server (e.g. due to CLI tool's Erlang cookie not matching that of the server) Mar 16 16:44:24 crc kubenswrapper[5120]: * Target node is not running Mar 16 16:44:24 crc kubenswrapper[5120]: Mar 16 16:44:24 crc kubenswrapper[5120]: In addition to the diagnostics info below: Mar 16 16:44:24 crc kubenswrapper[5120]: Mar 16 16:44:24 crc kubenswrapper[5120]: * See the CLI, clustering and networking guides on https://rabbitmq.com/documentation.html to learn more Mar 16 16:44:24 crc kubenswrapper[5120]: * Consult server logs on node rabbit@rabbitmq-cell1-server-0.rabbitmq-cell1-nodes.openstack-kuttl-tests Mar 16 16:44:24 crc kubenswrapper[5120]: * If target node is configured to use long node names, don't forget to use --longnames with CLI tools Mar 16 16:44:24 crc kubenswrapper[5120]: Mar 16 16:44:24 crc kubenswrapper[5120]: DIAGNOSTICS Mar 16 16:44:24 crc kubenswrapper[5120]: =========== Mar 16 16:44:24 crc kubenswrapper[5120]: Mar 16 16:44:24 crc kubenswrapper[5120]: attempted to contact: ['rabbit@rabbitmq-cell1-server-0.rabbitmq-cell1-nodes.openstack-kuttl-tests'] Mar 16 16:44:24 crc kubenswrapper[5120]: Mar 16 16:44:24 crc kubenswrapper[5120]: rabbit@rabbitmq-cell1-server-0.rabbitmq-cell1-nodes.openstack-kuttl-tests: Mar 16 16:44:24 crc kubenswrapper[5120]: * unable to connect to epmd (port 4369) on rabbitmq-cell1-server-0.rabbitmq-cell1-nodes.openstack-kuttl-tests: nxdomain (non-existing domain) Mar 16 16:44:24 crc kubenswrapper[5120]: Mar 16 16:44:24 crc kubenswrapper[5120]: Mar 16 16:44:24 crc kubenswrapper[5120]: Current node details: Mar 16 16:44:24 crc kubenswrapper[5120]: * node name: 'rabbitmqcli-91-rabbit@rabbitmq-cell1-server-0.rabbitmq-cell1-nodes.openstack-kuttl-tests' Mar 16 16:44:24 crc kubenswrapper[5120]: * effective user's home directory: /var/lib/rabbitmq Mar 16 16:44:24 crc kubenswrapper[5120]: * Erlang cookie hash: rJB+eeImOk3SzlTg4Dhkig== Mar 16 16:44:24 crc kubenswrapper[5120]: Mar 16 16:44:24 crc kubenswrapper[5120]: > execCommand=["/bin/bash","-c","if [ ! -z \"$(cat /etc/pod-info/skipPreStopChecks)\" ]; then exit 0; fi; rabbitmq-upgrade await_online_quorum_plus_one -t 604800 \u0026\u0026 rabbitmq-upgrade await_online_synchronized_mirror -t 604800 || true \u0026\u0026 rabbitmq-upgrade drain -t 604800"] containerName="rabbitmq" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" message=< Mar 16 16:44:24 crc kubenswrapper[5120]: Will put node rabbit@rabbitmq-cell1-server-0.rabbitmq-cell1-nodes.openstack-kuttl-tests into maintenance mode. The node will no longer serve any client traffic! Mar 16 16:44:24 crc kubenswrapper[5120]: Error: unable to perform an operation on node 'rabbit@rabbitmq-cell1-server-0.rabbitmq-cell1-nodes.openstack-kuttl-tests'. Please see diagnostics information and suggestions below. Mar 16 16:44:24 crc kubenswrapper[5120]: Mar 16 16:44:24 crc kubenswrapper[5120]: Most common reasons for this are: Mar 16 16:44:24 crc kubenswrapper[5120]: Mar 16 16:44:24 crc kubenswrapper[5120]: * Target node is unreachable (e.g. due to hostname resolution, TCP connection or firewall issues) Mar 16 16:44:24 crc kubenswrapper[5120]: * CLI tool fails to authenticate with the server (e.g. due to CLI tool's Erlang cookie not matching that of the server) Mar 16 16:44:24 crc kubenswrapper[5120]: * Target node is not running Mar 16 16:44:24 crc kubenswrapper[5120]: Mar 16 16:44:24 crc kubenswrapper[5120]: In addition to the diagnostics info below: Mar 16 16:44:24 crc kubenswrapper[5120]: Mar 16 16:44:24 crc kubenswrapper[5120]: * See the CLI, clustering and networking guides on https://rabbitmq.com/documentation.html to learn more Mar 16 16:44:24 crc kubenswrapper[5120]: * Consult server logs on node rabbit@rabbitmq-cell1-server-0.rabbitmq-cell1-nodes.openstack-kuttl-tests Mar 16 16:44:24 crc kubenswrapper[5120]: * If target node is configured to use long node names, don't forget to use --longnames with CLI tools Mar 16 16:44:24 crc kubenswrapper[5120]: Mar 16 16:44:24 crc kubenswrapper[5120]: DIAGNOSTICS Mar 16 16:44:24 crc kubenswrapper[5120]: =========== Mar 16 16:44:24 crc kubenswrapper[5120]: Mar 16 16:44:24 crc kubenswrapper[5120]: attempted to contact: ['rabbit@rabbitmq-cell1-server-0.rabbitmq-cell1-nodes.openstack-kuttl-tests'] Mar 16 16:44:24 crc kubenswrapper[5120]: Mar 16 16:44:24 crc kubenswrapper[5120]: rabbit@rabbitmq-cell1-server-0.rabbitmq-cell1-nodes.openstack-kuttl-tests: Mar 16 16:44:24 crc kubenswrapper[5120]: * unable to connect to epmd (port 4369) on rabbitmq-cell1-server-0.rabbitmq-cell1-nodes.openstack-kuttl-tests: nxdomain (non-existing domain) Mar 16 16:44:24 crc kubenswrapper[5120]: Mar 16 16:44:24 crc kubenswrapper[5120]: Mar 16 16:44:24 crc kubenswrapper[5120]: Current node details: Mar 16 16:44:24 crc kubenswrapper[5120]: * node name: 'rabbitmqcli-975-rabbit@rabbitmq-cell1-server-0.rabbitmq-cell1-nodes.openstack-kuttl-tests' Mar 16 16:44:24 crc kubenswrapper[5120]: * effective user's home directory: /var/lib/rabbitmq Mar 16 16:44:24 crc kubenswrapper[5120]: * Erlang cookie hash: rJB+eeImOk3SzlTg4Dhkig== Mar 16 16:44:24 crc kubenswrapper[5120]: Mar 16 16:44:24 crc kubenswrapper[5120]: Error: unable to perform an operation on node 'rabbit@rabbitmq-cell1-server-0.rabbitmq-cell1-nodes.openstack-kuttl-tests'. Please see diagnostics information and suggestions below. Mar 16 16:44:24 crc kubenswrapper[5120]: Mar 16 16:44:24 crc kubenswrapper[5120]: Most common reasons for this are: Mar 16 16:44:24 crc kubenswrapper[5120]: Mar 16 16:44:24 crc kubenswrapper[5120]: * Target node is unreachable (e.g. due to hostname resolution, TCP connection or firewall issues) Mar 16 16:44:24 crc kubenswrapper[5120]: * CLI tool fails to authenticate with the server (e.g. due to CLI tool's Erlang cookie not matching that of the server) Mar 16 16:44:24 crc kubenswrapper[5120]: * Target node is not running Mar 16 16:44:24 crc kubenswrapper[5120]: Mar 16 16:44:24 crc kubenswrapper[5120]: In addition to the diagnostics info below: Mar 16 16:44:24 crc kubenswrapper[5120]: Mar 16 16:44:24 crc kubenswrapper[5120]: * See the CLI, clustering and networking guides on https://rabbitmq.com/documentation.html to learn more Mar 16 16:44:24 crc kubenswrapper[5120]: * Consult server logs on node rabbit@rabbitmq-cell1-server-0.rabbitmq-cell1-nodes.openstack-kuttl-tests Mar 16 16:44:24 crc kubenswrapper[5120]: * If target node is configured to use long node names, don't forget to use --longnames with CLI tools Mar 16 16:44:24 crc kubenswrapper[5120]: Mar 16 16:44:24 crc kubenswrapper[5120]: DIAGNOSTICS Mar 16 16:44:24 crc kubenswrapper[5120]: =========== Mar 16 16:44:24 crc kubenswrapper[5120]: Mar 16 16:44:24 crc kubenswrapper[5120]: attempted to contact: ['rabbit@rabbitmq-cell1-server-0.rabbitmq-cell1-nodes.openstack-kuttl-tests'] Mar 16 16:44:24 crc kubenswrapper[5120]: Mar 16 16:44:24 crc kubenswrapper[5120]: rabbit@rabbitmq-cell1-server-0.rabbitmq-cell1-nodes.openstack-kuttl-tests: Mar 16 16:44:24 crc kubenswrapper[5120]: * unable to connect to epmd (port 4369) on rabbitmq-cell1-server-0.rabbitmq-cell1-nodes.openstack-kuttl-tests: nxdomain (non-existing domain) Mar 16 16:44:24 crc kubenswrapper[5120]: Mar 16 16:44:24 crc kubenswrapper[5120]: Mar 16 16:44:24 crc kubenswrapper[5120]: Current node details: Mar 16 16:44:24 crc kubenswrapper[5120]: * node name: 'rabbitmqcli-91-rabbit@rabbitmq-cell1-server-0.rabbitmq-cell1-nodes.openstack-kuttl-tests' Mar 16 16:44:24 crc kubenswrapper[5120]: * effective user's home directory: /var/lib/rabbitmq Mar 16 16:44:24 crc kubenswrapper[5120]: * Erlang cookie hash: rJB+eeImOk3SzlTg4Dhkig== Mar 16 16:44:24 crc kubenswrapper[5120]: Mar 16 16:44:24 crc kubenswrapper[5120]: > Mar 16 16:44:24 crc kubenswrapper[5120]: E0316 16:44:24.692373 5120 kuberuntime_container.go:741] "PreStop hook failed" err=< Mar 16 16:44:24 crc kubenswrapper[5120]: command '/bin/bash -c if [ ! -z "$(cat /etc/pod-info/skipPreStopChecks)" ]; then exit 0; fi; rabbitmq-upgrade await_online_quorum_plus_one -t 604800 && rabbitmq-upgrade await_online_synchronized_mirror -t 604800 || true && rabbitmq-upgrade drain -t 604800' exited with 69: Error: unable to perform an operation on node 'rabbit@rabbitmq-cell1-server-0.rabbitmq-cell1-nodes.openstack-kuttl-tests'. Please see diagnostics information and suggestions below. Mar 16 16:44:24 crc kubenswrapper[5120]: Mar 16 16:44:24 crc kubenswrapper[5120]: Most common reasons for this are: Mar 16 16:44:24 crc kubenswrapper[5120]: Mar 16 16:44:24 crc kubenswrapper[5120]: * Target node is unreachable (e.g. due to hostname resolution, TCP connection or firewall issues) Mar 16 16:44:24 crc kubenswrapper[5120]: * CLI tool fails to authenticate with the server (e.g. due to CLI tool's Erlang cookie not matching that of the server) Mar 16 16:44:24 crc kubenswrapper[5120]: * Target node is not running Mar 16 16:44:24 crc kubenswrapper[5120]: Mar 16 16:44:24 crc kubenswrapper[5120]: In addition to the diagnostics info below: Mar 16 16:44:24 crc kubenswrapper[5120]: Mar 16 16:44:24 crc kubenswrapper[5120]: * See the CLI, clustering and networking guides on https://rabbitmq.com/documentation.html to learn more Mar 16 16:44:24 crc kubenswrapper[5120]: * Consult server logs on node rabbit@rabbitmq-cell1-server-0.rabbitmq-cell1-nodes.openstack-kuttl-tests Mar 16 16:44:24 crc kubenswrapper[5120]: * If target node is configured to use long node names, don't forget to use --longnames with CLI tools Mar 16 16:44:24 crc kubenswrapper[5120]: Mar 16 16:44:24 crc kubenswrapper[5120]: DIAGNOSTICS Mar 16 16:44:24 crc kubenswrapper[5120]: =========== Mar 16 16:44:24 crc kubenswrapper[5120]: Mar 16 16:44:24 crc kubenswrapper[5120]: attempted to contact: ['rabbit@rabbitmq-cell1-server-0.rabbitmq-cell1-nodes.openstack-kuttl-tests'] Mar 16 16:44:24 crc kubenswrapper[5120]: Mar 16 16:44:24 crc kubenswrapper[5120]: rabbit@rabbitmq-cell1-server-0.rabbitmq-cell1-nodes.openstack-kuttl-tests: Mar 16 16:44:24 crc kubenswrapper[5120]: * unable to connect to epmd (port 4369) on rabbitmq-cell1-server-0.rabbitmq-cell1-nodes.openstack-kuttl-tests: nxdomain (non-existing domain) Mar 16 16:44:24 crc kubenswrapper[5120]: Mar 16 16:44:24 crc kubenswrapper[5120]: Mar 16 16:44:24 crc kubenswrapper[5120]: Current node details: Mar 16 16:44:24 crc kubenswrapper[5120]: * node name: 'rabbitmqcli-975-rabbit@rabbitmq-cell1-server-0.rabbitmq-cell1-nodes.openstack-kuttl-tests' Mar 16 16:44:24 crc kubenswrapper[5120]: * effective user's home directory: /var/lib/rabbitmq Mar 16 16:44:24 crc kubenswrapper[5120]: * Erlang cookie hash: rJB+eeImOk3SzlTg4Dhkig== Mar 16 16:44:24 crc kubenswrapper[5120]: Mar 16 16:44:24 crc kubenswrapper[5120]: Error: unable to perform an operation on node 'rabbit@rabbitmq-cell1-server-0.rabbitmq-cell1-nodes.openstack-kuttl-tests'. Please see diagnostics information and suggestions below. Mar 16 16:44:24 crc kubenswrapper[5120]: Mar 16 16:44:24 crc kubenswrapper[5120]: Most common reasons for this are: Mar 16 16:44:24 crc kubenswrapper[5120]: Mar 16 16:44:24 crc kubenswrapper[5120]: * Target node is unreachable (e.g. due to hostname resolution, TCP connection or firewall issues) Mar 16 16:44:24 crc kubenswrapper[5120]: * CLI tool fails to authenticate with the server (e.g. due to CLI tool's Erlang cookie not matching that of the server) Mar 16 16:44:24 crc kubenswrapper[5120]: * Target node is not running Mar 16 16:44:24 crc kubenswrapper[5120]: Mar 16 16:44:24 crc kubenswrapper[5120]: In addition to the diagnostics info below: Mar 16 16:44:24 crc kubenswrapper[5120]: Mar 16 16:44:24 crc kubenswrapper[5120]: * See the CLI, clustering and networking guides on https://rabbitmq.com/documentation.html to learn more Mar 16 16:44:24 crc kubenswrapper[5120]: * Consult server logs on node rabbit@rabbitmq-cell1-server-0.rabbitmq-cell1-nodes.openstack-kuttl-tests Mar 16 16:44:24 crc kubenswrapper[5120]: * If target node is configured to use long node names, don't forget to use --longnames with CLI tools Mar 16 16:44:24 crc kubenswrapper[5120]: Mar 16 16:44:24 crc kubenswrapper[5120]: DIAGNOSTICS Mar 16 16:44:24 crc kubenswrapper[5120]: =========== Mar 16 16:44:24 crc kubenswrapper[5120]: Mar 16 16:44:24 crc kubenswrapper[5120]: attempted to contact: ['rabbit@rabbitmq-cell1-server-0.rabbitmq-cell1-nodes.openstack-kuttl-tests'] Mar 16 16:44:24 crc kubenswrapper[5120]: Mar 16 16:44:24 crc kubenswrapper[5120]: rabbit@rabbitmq-cell1-server-0.rabbitmq-cell1-nodes.openstack-kuttl-tests: Mar 16 16:44:24 crc kubenswrapper[5120]: * unable to connect to epmd (port 4369) on rabbitmq-cell1-server-0.rabbitmq-cell1-nodes.openstack-kuttl-tests: nxdomain (non-existing domain) Mar 16 16:44:24 crc kubenswrapper[5120]: Mar 16 16:44:24 crc kubenswrapper[5120]: Mar 16 16:44:24 crc kubenswrapper[5120]: Current node details: Mar 16 16:44:24 crc kubenswrapper[5120]: * node name: 'rabbitmqcli-91-rabbit@rabbitmq-cell1-server-0.rabbitmq-cell1-nodes.openstack-kuttl-tests' Mar 16 16:44:24 crc kubenswrapper[5120]: * effective user's home directory: /var/lib/rabbitmq Mar 16 16:44:24 crc kubenswrapper[5120]: * Erlang cookie hash: rJB+eeImOk3SzlTg4Dhkig== Mar 16 16:44:24 crc kubenswrapper[5120]: Mar 16 16:44:24 crc kubenswrapper[5120]: > pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" podUID="c2f375f2-e474-4c66-ac4a-677606c3dd04" containerName="rabbitmq" containerID="cri-o://2b48b529e5492ed4f7a9f901044b2e5f7de153b961f562c3842cb58602e8567f" Mar 16 16:44:24 crc kubenswrapper[5120]: I0316 16:44:24.692431 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" podUID="c2f375f2-e474-4c66-ac4a-677606c3dd04" containerName="rabbitmq" containerID="cri-o://2b48b529e5492ed4f7a9f901044b2e5f7de153b961f562c3842cb58602e8567f" gracePeriod=604739 Mar 16 16:44:31 crc kubenswrapper[5120]: I0316 16:44:31.259371 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:44:31 crc kubenswrapper[5120]: I0316 16:44:31.354181 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"persistence\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") pod \"c2f375f2-e474-4c66-ac4a-677606c3dd04\" (UID: \"c2f375f2-e474-4c66-ac4a-677606c3dd04\") " Mar 16 16:44:31 crc kubenswrapper[5120]: I0316 16:44:31.354284 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/c2f375f2-e474-4c66-ac4a-677606c3dd04-plugins-conf\") pod \"c2f375f2-e474-4c66-ac4a-677606c3dd04\" (UID: \"c2f375f2-e474-4c66-ac4a-677606c3dd04\") " Mar 16 16:44:31 crc kubenswrapper[5120]: I0316 16:44:31.354359 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/c2f375f2-e474-4c66-ac4a-677606c3dd04-rabbitmq-confd\") pod \"c2f375f2-e474-4c66-ac4a-677606c3dd04\" (UID: \"c2f375f2-e474-4c66-ac4a-677606c3dd04\") " Mar 16 16:44:31 crc kubenswrapper[5120]: I0316 16:44:31.354427 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/c2f375f2-e474-4c66-ac4a-677606c3dd04-erlang-cookie-secret\") pod \"c2f375f2-e474-4c66-ac4a-677606c3dd04\" (UID: \"c2f375f2-e474-4c66-ac4a-677606c3dd04\") " Mar 16 16:44:31 crc kubenswrapper[5120]: I0316 16:44:31.354556 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/c2f375f2-e474-4c66-ac4a-677606c3dd04-rabbitmq-tls\") pod \"c2f375f2-e474-4c66-ac4a-677606c3dd04\" (UID: \"c2f375f2-e474-4c66-ac4a-677606c3dd04\") " Mar 16 16:44:31 crc kubenswrapper[5120]: I0316 16:44:31.354674 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/c2f375f2-e474-4c66-ac4a-677606c3dd04-rabbitmq-erlang-cookie\") pod \"c2f375f2-e474-4c66-ac4a-677606c3dd04\" (UID: \"c2f375f2-e474-4c66-ac4a-677606c3dd04\") " Mar 16 16:44:31 crc kubenswrapper[5120]: I0316 16:44:31.354874 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/c2f375f2-e474-4c66-ac4a-677606c3dd04-server-conf\") pod \"c2f375f2-e474-4c66-ac4a-677606c3dd04\" (UID: \"c2f375f2-e474-4c66-ac4a-677606c3dd04\") " Mar 16 16:44:31 crc kubenswrapper[5120]: I0316 16:44:31.355453 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c2f375f2-e474-4c66-ac4a-677606c3dd04-plugins-conf" (OuterVolumeSpecName: "plugins-conf") pod "c2f375f2-e474-4c66-ac4a-677606c3dd04" (UID: "c2f375f2-e474-4c66-ac4a-677606c3dd04"). InnerVolumeSpecName "plugins-conf". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:44:31 crc kubenswrapper[5120]: I0316 16:44:31.355524 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2f375f2-e474-4c66-ac4a-677606c3dd04-rabbitmq-erlang-cookie" (OuterVolumeSpecName: "rabbitmq-erlang-cookie") pod "c2f375f2-e474-4c66-ac4a-677606c3dd04" (UID: "c2f375f2-e474-4c66-ac4a-677606c3dd04"). InnerVolumeSpecName "rabbitmq-erlang-cookie". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:44:31 crc kubenswrapper[5120]: I0316 16:44:31.355612 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/c2f375f2-e474-4c66-ac4a-677606c3dd04-rabbitmq-plugins\") pod \"c2f375f2-e474-4c66-ac4a-677606c3dd04\" (UID: \"c2f375f2-e474-4c66-ac4a-677606c3dd04\") " Mar 16 16:44:31 crc kubenswrapper[5120]: I0316 16:44:31.355645 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/c2f375f2-e474-4c66-ac4a-677606c3dd04-config-data\") pod \"c2f375f2-e474-4c66-ac4a-677606c3dd04\" (UID: \"c2f375f2-e474-4c66-ac4a-677606c3dd04\") " Mar 16 16:44:31 crc kubenswrapper[5120]: I0316 16:44:31.355682 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-chl7j\" (UniqueName: \"kubernetes.io/projected/c2f375f2-e474-4c66-ac4a-677606c3dd04-kube-api-access-chl7j\") pod \"c2f375f2-e474-4c66-ac4a-677606c3dd04\" (UID: \"c2f375f2-e474-4c66-ac4a-677606c3dd04\") " Mar 16 16:44:31 crc kubenswrapper[5120]: I0316 16:44:31.355971 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/c2f375f2-e474-4c66-ac4a-677606c3dd04-pod-info\") pod \"c2f375f2-e474-4c66-ac4a-677606c3dd04\" (UID: \"c2f375f2-e474-4c66-ac4a-677606c3dd04\") " Mar 16 16:44:31 crc kubenswrapper[5120]: I0316 16:44:31.356112 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2f375f2-e474-4c66-ac4a-677606c3dd04-rabbitmq-plugins" (OuterVolumeSpecName: "rabbitmq-plugins") pod "c2f375f2-e474-4c66-ac4a-677606c3dd04" (UID: "c2f375f2-e474-4c66-ac4a-677606c3dd04"). InnerVolumeSpecName "rabbitmq-plugins". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:44:31 crc kubenswrapper[5120]: I0316 16:44:31.357208 5120 reconciler_common.go:299] "Volume detached for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/c2f375f2-e474-4c66-ac4a-677606c3dd04-plugins-conf\") on node \"crc\" DevicePath \"\"" Mar 16 16:44:31 crc kubenswrapper[5120]: I0316 16:44:31.357238 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/c2f375f2-e474-4c66-ac4a-677606c3dd04-rabbitmq-erlang-cookie\") on node \"crc\" DevicePath \"\"" Mar 16 16:44:31 crc kubenswrapper[5120]: I0316 16:44:31.357252 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/c2f375f2-e474-4c66-ac4a-677606c3dd04-rabbitmq-plugins\") on node \"crc\" DevicePath \"\"" Mar 16 16:44:31 crc kubenswrapper[5120]: I0316 16:44:31.361029 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c2f375f2-e474-4c66-ac4a-677606c3dd04-erlang-cookie-secret" (OuterVolumeSpecName: "erlang-cookie-secret") pod "c2f375f2-e474-4c66-ac4a-677606c3dd04" (UID: "c2f375f2-e474-4c66-ac4a-677606c3dd04"). InnerVolumeSpecName "erlang-cookie-secret". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:44:31 crc kubenswrapper[5120]: I0316 16:44:31.361042 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2f375f2-e474-4c66-ac4a-677606c3dd04-kube-api-access-chl7j" (OuterVolumeSpecName: "kube-api-access-chl7j") pod "c2f375f2-e474-4c66-ac4a-677606c3dd04" (UID: "c2f375f2-e474-4c66-ac4a-677606c3dd04"). InnerVolumeSpecName "kube-api-access-chl7j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:44:31 crc kubenswrapper[5120]: I0316 16:44:31.361335 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage17-crc" (OuterVolumeSpecName: "persistence") pod "c2f375f2-e474-4c66-ac4a-677606c3dd04" (UID: "c2f375f2-e474-4c66-ac4a-677606c3dd04"). InnerVolumeSpecName "local-storage17-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:44:31 crc kubenswrapper[5120]: I0316 16:44:31.361810 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c2f375f2-e474-4c66-ac4a-677606c3dd04-pod-info" (OuterVolumeSpecName: "pod-info") pod "c2f375f2-e474-4c66-ac4a-677606c3dd04" (UID: "c2f375f2-e474-4c66-ac4a-677606c3dd04"). InnerVolumeSpecName "pod-info". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Mar 16 16:44:31 crc kubenswrapper[5120]: I0316 16:44:31.363588 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2f375f2-e474-4c66-ac4a-677606c3dd04-rabbitmq-tls" (OuterVolumeSpecName: "rabbitmq-tls") pod "c2f375f2-e474-4c66-ac4a-677606c3dd04" (UID: "c2f375f2-e474-4c66-ac4a-677606c3dd04"). InnerVolumeSpecName "rabbitmq-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:44:31 crc kubenswrapper[5120]: I0316 16:44:31.382753 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c2f375f2-e474-4c66-ac4a-677606c3dd04-config-data" (OuterVolumeSpecName: "config-data") pod "c2f375f2-e474-4c66-ac4a-677606c3dd04" (UID: "c2f375f2-e474-4c66-ac4a-677606c3dd04"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:44:31 crc kubenswrapper[5120]: I0316 16:44:31.402528 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c2f375f2-e474-4c66-ac4a-677606c3dd04-server-conf" (OuterVolumeSpecName: "server-conf") pod "c2f375f2-e474-4c66-ac4a-677606c3dd04" (UID: "c2f375f2-e474-4c66-ac4a-677606c3dd04"). InnerVolumeSpecName "server-conf". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:44:31 crc kubenswrapper[5120]: I0316 16:44:31.450921 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2f375f2-e474-4c66-ac4a-677606c3dd04-rabbitmq-confd" (OuterVolumeSpecName: "rabbitmq-confd") pod "c2f375f2-e474-4c66-ac4a-677606c3dd04" (UID: "c2f375f2-e474-4c66-ac4a-677606c3dd04"). InnerVolumeSpecName "rabbitmq-confd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:44:31 crc kubenswrapper[5120]: I0316 16:44:31.459175 5120 reconciler_common.go:299] "Volume detached for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/c2f375f2-e474-4c66-ac4a-677606c3dd04-server-conf\") on node \"crc\" DevicePath \"\"" Mar 16 16:44:31 crc kubenswrapper[5120]: I0316 16:44:31.459222 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/c2f375f2-e474-4c66-ac4a-677606c3dd04-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:44:31 crc kubenswrapper[5120]: I0316 16:44:31.459233 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-chl7j\" (UniqueName: \"kubernetes.io/projected/c2f375f2-e474-4c66-ac4a-677606c3dd04-kube-api-access-chl7j\") on node \"crc\" DevicePath \"\"" Mar 16 16:44:31 crc kubenswrapper[5120]: I0316 16:44:31.459245 5120 reconciler_common.go:299] "Volume detached for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/c2f375f2-e474-4c66-ac4a-677606c3dd04-pod-info\") on node \"crc\" DevicePath \"\"" Mar 16 16:44:31 crc kubenswrapper[5120]: I0316 16:44:31.459279 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") on node \"crc\" " Mar 16 16:44:31 crc kubenswrapper[5120]: I0316 16:44:31.459290 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/c2f375f2-e474-4c66-ac4a-677606c3dd04-rabbitmq-confd\") on node \"crc\" DevicePath \"\"" Mar 16 16:44:31 crc kubenswrapper[5120]: I0316 16:44:31.459300 5120 reconciler_common.go:299] "Volume detached for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/c2f375f2-e474-4c66-ac4a-677606c3dd04-erlang-cookie-secret\") on node \"crc\" DevicePath \"\"" Mar 16 16:44:31 crc kubenswrapper[5120]: I0316 16:44:31.459309 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/c2f375f2-e474-4c66-ac4a-677606c3dd04-rabbitmq-tls\") on node \"crc\" DevicePath \"\"" Mar 16 16:44:31 crc kubenswrapper[5120]: I0316 16:44:31.473977 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage17-crc" (UniqueName: "kubernetes.io/local-volume/local-storage17-crc") on node "crc" Mar 16 16:44:31 crc kubenswrapper[5120]: I0316 16:44:31.475971 5120 generic.go:358] "Generic (PLEG): container finished" podID="c2f375f2-e474-4c66-ac4a-677606c3dd04" containerID="2b48b529e5492ed4f7a9f901044b2e5f7de153b961f562c3842cb58602e8567f" exitCode=0 Mar 16 16:44:31 crc kubenswrapper[5120]: I0316 16:44:31.476281 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"c2f375f2-e474-4c66-ac4a-677606c3dd04","Type":"ContainerDied","Data":"2b48b529e5492ed4f7a9f901044b2e5f7de153b961f562c3842cb58602e8567f"} Mar 16 16:44:31 crc kubenswrapper[5120]: I0316 16:44:31.476321 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"c2f375f2-e474-4c66-ac4a-677606c3dd04","Type":"ContainerDied","Data":"4b0ae826e33a5c1301a171394c9fb50c548280bebaaf846ec5a8db76457cd0c9"} Mar 16 16:44:31 crc kubenswrapper[5120]: I0316 16:44:31.476340 5120 scope.go:117] "RemoveContainer" containerID="2b48b529e5492ed4f7a9f901044b2e5f7de153b961f562c3842cb58602e8567f" Mar 16 16:44:31 crc kubenswrapper[5120]: I0316 16:44:31.476519 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:44:31 crc kubenswrapper[5120]: I0316 16:44:31.511740 5120 scope.go:117] "RemoveContainer" containerID="1a6633805f20ea052355fbcdd3c259a91fda0f13d270d62207216dd235e5324e" Mar 16 16:44:31 crc kubenswrapper[5120]: I0316 16:44:31.525653 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 16:44:31 crc kubenswrapper[5120]: I0316 16:44:31.532564 5120 scope.go:117] "RemoveContainer" containerID="2b48b529e5492ed4f7a9f901044b2e5f7de153b961f562c3842cb58602e8567f" Mar 16 16:44:31 crc kubenswrapper[5120]: E0316 16:44:31.533222 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b48b529e5492ed4f7a9f901044b2e5f7de153b961f562c3842cb58602e8567f\": container with ID starting with 2b48b529e5492ed4f7a9f901044b2e5f7de153b961f562c3842cb58602e8567f not found: ID does not exist" containerID="2b48b529e5492ed4f7a9f901044b2e5f7de153b961f562c3842cb58602e8567f" Mar 16 16:44:31 crc kubenswrapper[5120]: I0316 16:44:31.533251 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b48b529e5492ed4f7a9f901044b2e5f7de153b961f562c3842cb58602e8567f"} err="failed to get container status \"2b48b529e5492ed4f7a9f901044b2e5f7de153b961f562c3842cb58602e8567f\": rpc error: code = NotFound desc = could not find container \"2b48b529e5492ed4f7a9f901044b2e5f7de153b961f562c3842cb58602e8567f\": container with ID starting with 2b48b529e5492ed4f7a9f901044b2e5f7de153b961f562c3842cb58602e8567f not found: ID does not exist" Mar 16 16:44:31 crc kubenswrapper[5120]: I0316 16:44:31.533270 5120 scope.go:117] "RemoveContainer" containerID="1a6633805f20ea052355fbcdd3c259a91fda0f13d270d62207216dd235e5324e" Mar 16 16:44:31 crc kubenswrapper[5120]: E0316 16:44:31.533739 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a6633805f20ea052355fbcdd3c259a91fda0f13d270d62207216dd235e5324e\": container with ID starting with 1a6633805f20ea052355fbcdd3c259a91fda0f13d270d62207216dd235e5324e not found: ID does not exist" containerID="1a6633805f20ea052355fbcdd3c259a91fda0f13d270d62207216dd235e5324e" Mar 16 16:44:31 crc kubenswrapper[5120]: I0316 16:44:31.533894 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a6633805f20ea052355fbcdd3c259a91fda0f13d270d62207216dd235e5324e"} err="failed to get container status \"1a6633805f20ea052355fbcdd3c259a91fda0f13d270d62207216dd235e5324e\": rpc error: code = NotFound desc = could not find container \"1a6633805f20ea052355fbcdd3c259a91fda0f13d270d62207216dd235e5324e\": container with ID starting with 1a6633805f20ea052355fbcdd3c259a91fda0f13d270d62207216dd235e5324e not found: ID does not exist" Mar 16 16:44:31 crc kubenswrapper[5120]: I0316 16:44:31.534049 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 16:44:31 crc kubenswrapper[5120]: I0316 16:44:31.561148 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:44:32 crc kubenswrapper[5120]: I0316 16:44:32.665651 5120 scope.go:117] "RemoveContainer" containerID="35a7dd6e19084cee69ca16203bca6378ea0cdf6a685ca2093ab847e5904eb9e6" Mar 16 16:44:32 crc kubenswrapper[5120]: E0316 16:44:32.666959 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:44:32 crc kubenswrapper[5120]: I0316 16:44:32.674607 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c2f375f2-e474-4c66-ac4a-677606c3dd04" path="/var/lib/kubelet/pods/c2f375f2-e474-4c66-ac4a-677606c3dd04/volumes" Mar 16 16:44:37 crc kubenswrapper[5120]: I0316 16:44:37.476962 5120 scope.go:117] "RemoveContainer" containerID="9d490989178ba554fe0fee3bea0d5fad06b50ef9f39c2bf9bb5b95347f2d23e2" Mar 16 16:44:37 crc kubenswrapper[5120]: I0316 16:44:37.584669 5120 scope.go:117] "RemoveContainer" containerID="30afdf2582392468bb3f197931e4831a94ce100d361468278ea614ac4bee9c6d" Mar 16 16:44:38 crc kubenswrapper[5120]: I0316 16:44:38.095707 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["crc-storage/crc-storage-crc-nb5rz"] Mar 16 16:44:38 crc kubenswrapper[5120]: I0316 16:44:38.100897 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["crc-storage/crc-storage-crc-nb5rz"] Mar 16 16:44:38 crc kubenswrapper[5120]: I0316 16:44:38.207737 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["crc-storage/crc-storage-crc-p8c89"] Mar 16 16:44:38 crc kubenswrapper[5120]: I0316 16:44:38.217752 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2f375f2-e474-4c66-ac4a-677606c3dd04" containerName="setup-container" Mar 16 16:44:38 crc kubenswrapper[5120]: I0316 16:44:38.217826 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2f375f2-e474-4c66-ac4a-677606c3dd04" containerName="setup-container" Mar 16 16:44:38 crc kubenswrapper[5120]: I0316 16:44:38.217890 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2f375f2-e474-4c66-ac4a-677606c3dd04" containerName="rabbitmq" Mar 16 16:44:38 crc kubenswrapper[5120]: I0316 16:44:38.217903 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2f375f2-e474-4c66-ac4a-677606c3dd04" containerName="rabbitmq" Mar 16 16:44:38 crc kubenswrapper[5120]: I0316 16:44:38.217923 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b584daf0-61f5-4d60-9bbf-9e25b455058e" containerName="oc" Mar 16 16:44:38 crc kubenswrapper[5120]: I0316 16:44:38.217936 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="b584daf0-61f5-4d60-9bbf-9e25b455058e" containerName="oc" Mar 16 16:44:38 crc kubenswrapper[5120]: I0316 16:44:38.218200 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c2f375f2-e474-4c66-ac4a-677606c3dd04" containerName="rabbitmq" Mar 16 16:44:38 crc kubenswrapper[5120]: I0316 16:44:38.218227 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="b584daf0-61f5-4d60-9bbf-9e25b455058e" containerName="oc" Mar 16 16:44:38 crc kubenswrapper[5120]: I0316 16:44:38.239973 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-p8c89"] Mar 16 16:44:38 crc kubenswrapper[5120]: I0316 16:44:38.240117 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-p8c89" Mar 16 16:44:38 crc kubenswrapper[5120]: I0316 16:44:38.245067 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"openshift-service-ca.crt\"" Mar 16 16:44:38 crc kubenswrapper[5120]: I0316 16:44:38.245136 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"crc-storage\"" Mar 16 16:44:38 crc kubenswrapper[5120]: I0316 16:44:38.245180 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"kube-root-ca.crt\"" Mar 16 16:44:38 crc kubenswrapper[5120]: I0316 16:44:38.248365 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"crc-storage\"/\"crc-storage-dockercfg-s2tht\"" Mar 16 16:44:38 crc kubenswrapper[5120]: I0316 16:44:38.306005 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/e3847568-de2e-4979-aeed-eb5f70559559-crc-storage\") pod \"crc-storage-crc-p8c89\" (UID: \"e3847568-de2e-4979-aeed-eb5f70559559\") " pod="crc-storage/crc-storage-crc-p8c89" Mar 16 16:44:38 crc kubenswrapper[5120]: I0316 16:44:38.306328 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/e3847568-de2e-4979-aeed-eb5f70559559-node-mnt\") pod \"crc-storage-crc-p8c89\" (UID: \"e3847568-de2e-4979-aeed-eb5f70559559\") " pod="crc-storage/crc-storage-crc-p8c89" Mar 16 16:44:38 crc kubenswrapper[5120]: I0316 16:44:38.306552 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwd4f\" (UniqueName: \"kubernetes.io/projected/e3847568-de2e-4979-aeed-eb5f70559559-kube-api-access-vwd4f\") pod \"crc-storage-crc-p8c89\" (UID: \"e3847568-de2e-4979-aeed-eb5f70559559\") " pod="crc-storage/crc-storage-crc-p8c89" Mar 16 16:44:38 crc kubenswrapper[5120]: I0316 16:44:38.409428 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/e3847568-de2e-4979-aeed-eb5f70559559-crc-storage\") pod \"crc-storage-crc-p8c89\" (UID: \"e3847568-de2e-4979-aeed-eb5f70559559\") " pod="crc-storage/crc-storage-crc-p8c89" Mar 16 16:44:38 crc kubenswrapper[5120]: I0316 16:44:38.409710 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/e3847568-de2e-4979-aeed-eb5f70559559-node-mnt\") pod \"crc-storage-crc-p8c89\" (UID: \"e3847568-de2e-4979-aeed-eb5f70559559\") " pod="crc-storage/crc-storage-crc-p8c89" Mar 16 16:44:38 crc kubenswrapper[5120]: I0316 16:44:38.409913 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vwd4f\" (UniqueName: \"kubernetes.io/projected/e3847568-de2e-4979-aeed-eb5f70559559-kube-api-access-vwd4f\") pod \"crc-storage-crc-p8c89\" (UID: \"e3847568-de2e-4979-aeed-eb5f70559559\") " pod="crc-storage/crc-storage-crc-p8c89" Mar 16 16:44:38 crc kubenswrapper[5120]: I0316 16:44:38.410035 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/e3847568-de2e-4979-aeed-eb5f70559559-crc-storage\") pod \"crc-storage-crc-p8c89\" (UID: \"e3847568-de2e-4979-aeed-eb5f70559559\") " pod="crc-storage/crc-storage-crc-p8c89" Mar 16 16:44:38 crc kubenswrapper[5120]: I0316 16:44:38.410081 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/e3847568-de2e-4979-aeed-eb5f70559559-node-mnt\") pod \"crc-storage-crc-p8c89\" (UID: \"e3847568-de2e-4979-aeed-eb5f70559559\") " pod="crc-storage/crc-storage-crc-p8c89" Mar 16 16:44:38 crc kubenswrapper[5120]: I0316 16:44:38.429368 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwd4f\" (UniqueName: \"kubernetes.io/projected/e3847568-de2e-4979-aeed-eb5f70559559-kube-api-access-vwd4f\") pod \"crc-storage-crc-p8c89\" (UID: \"e3847568-de2e-4979-aeed-eb5f70559559\") " pod="crc-storage/crc-storage-crc-p8c89" Mar 16 16:44:38 crc kubenswrapper[5120]: I0316 16:44:38.562292 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-p8c89" Mar 16 16:44:38 crc kubenswrapper[5120]: I0316 16:44:38.685947 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4ab3d9c3-acea-4aca-a4cd-acabd3d17130" path="/var/lib/kubelet/pods/4ab3d9c3-acea-4aca-a4cd-acabd3d17130/volumes" Mar 16 16:44:39 crc kubenswrapper[5120]: I0316 16:44:39.038997 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-p8c89"] Mar 16 16:44:39 crc kubenswrapper[5120]: I0316 16:44:39.605486 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-p8c89" event={"ID":"e3847568-de2e-4979-aeed-eb5f70559559","Type":"ContainerStarted","Data":"8f3dd821939c584330555c5b781911d71834cb111ce86697a6e8d9c9e03c9515"} Mar 16 16:44:40 crc kubenswrapper[5120]: I0316 16:44:40.615332 5120 generic.go:358] "Generic (PLEG): container finished" podID="e3847568-de2e-4979-aeed-eb5f70559559" containerID="98b2374030d93b00ce1ee54fb9150860666bb11c6341068f7353f783167c3c70" exitCode=0 Mar 16 16:44:40 crc kubenswrapper[5120]: I0316 16:44:40.615403 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-p8c89" event={"ID":"e3847568-de2e-4979-aeed-eb5f70559559","Type":"ContainerDied","Data":"98b2374030d93b00ce1ee54fb9150860666bb11c6341068f7353f783167c3c70"} Mar 16 16:44:41 crc kubenswrapper[5120]: I0316 16:44:41.932708 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-p8c89" Mar 16 16:44:42 crc kubenswrapper[5120]: I0316 16:44:42.078147 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/e3847568-de2e-4979-aeed-eb5f70559559-node-mnt\") pod \"e3847568-de2e-4979-aeed-eb5f70559559\" (UID: \"e3847568-de2e-4979-aeed-eb5f70559559\") " Mar 16 16:44:42 crc kubenswrapper[5120]: I0316 16:44:42.078286 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/e3847568-de2e-4979-aeed-eb5f70559559-node-mnt" (OuterVolumeSpecName: "node-mnt") pod "e3847568-de2e-4979-aeed-eb5f70559559" (UID: "e3847568-de2e-4979-aeed-eb5f70559559"). InnerVolumeSpecName "node-mnt". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 16:44:42 crc kubenswrapper[5120]: I0316 16:44:42.078486 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/e3847568-de2e-4979-aeed-eb5f70559559-crc-storage\") pod \"e3847568-de2e-4979-aeed-eb5f70559559\" (UID: \"e3847568-de2e-4979-aeed-eb5f70559559\") " Mar 16 16:44:42 crc kubenswrapper[5120]: I0316 16:44:42.078735 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vwd4f\" (UniqueName: \"kubernetes.io/projected/e3847568-de2e-4979-aeed-eb5f70559559-kube-api-access-vwd4f\") pod \"e3847568-de2e-4979-aeed-eb5f70559559\" (UID: \"e3847568-de2e-4979-aeed-eb5f70559559\") " Mar 16 16:44:42 crc kubenswrapper[5120]: I0316 16:44:42.079517 5120 reconciler_common.go:299] "Volume detached for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/e3847568-de2e-4979-aeed-eb5f70559559-node-mnt\") on node \"crc\" DevicePath \"\"" Mar 16 16:44:42 crc kubenswrapper[5120]: I0316 16:44:42.087519 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3847568-de2e-4979-aeed-eb5f70559559-kube-api-access-vwd4f" (OuterVolumeSpecName: "kube-api-access-vwd4f") pod "e3847568-de2e-4979-aeed-eb5f70559559" (UID: "e3847568-de2e-4979-aeed-eb5f70559559"). InnerVolumeSpecName "kube-api-access-vwd4f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:44:42 crc kubenswrapper[5120]: I0316 16:44:42.112651 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e3847568-de2e-4979-aeed-eb5f70559559-crc-storage" (OuterVolumeSpecName: "crc-storage") pod "e3847568-de2e-4979-aeed-eb5f70559559" (UID: "e3847568-de2e-4979-aeed-eb5f70559559"). InnerVolumeSpecName "crc-storage". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:44:42 crc kubenswrapper[5120]: I0316 16:44:42.180694 5120 reconciler_common.go:299] "Volume detached for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/e3847568-de2e-4979-aeed-eb5f70559559-crc-storage\") on node \"crc\" DevicePath \"\"" Mar 16 16:44:42 crc kubenswrapper[5120]: I0316 16:44:42.180727 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vwd4f\" (UniqueName: \"kubernetes.io/projected/e3847568-de2e-4979-aeed-eb5f70559559-kube-api-access-vwd4f\") on node \"crc\" DevicePath \"\"" Mar 16 16:44:42 crc kubenswrapper[5120]: I0316 16:44:42.635885 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-p8c89" event={"ID":"e3847568-de2e-4979-aeed-eb5f70559559","Type":"ContainerDied","Data":"8f3dd821939c584330555c5b781911d71834cb111ce86697a6e8d9c9e03c9515"} Mar 16 16:44:42 crc kubenswrapper[5120]: I0316 16:44:42.635938 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8f3dd821939c584330555c5b781911d71834cb111ce86697a6e8d9c9e03c9515" Mar 16 16:44:42 crc kubenswrapper[5120]: I0316 16:44:42.635839 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-p8c89" Mar 16 16:44:45 crc kubenswrapper[5120]: I0316 16:44:45.386743 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["crc-storage/crc-storage-crc-p8c89"] Mar 16 16:44:45 crc kubenswrapper[5120]: I0316 16:44:45.393869 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["crc-storage/crc-storage-crc-p8c89"] Mar 16 16:44:45 crc kubenswrapper[5120]: I0316 16:44:45.550343 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["crc-storage/crc-storage-crc-fkjzn"] Mar 16 16:44:45 crc kubenswrapper[5120]: I0316 16:44:45.551446 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3847568-de2e-4979-aeed-eb5f70559559" containerName="storage" Mar 16 16:44:45 crc kubenswrapper[5120]: I0316 16:44:45.551534 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3847568-de2e-4979-aeed-eb5f70559559" containerName="storage" Mar 16 16:44:45 crc kubenswrapper[5120]: I0316 16:44:45.551719 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e3847568-de2e-4979-aeed-eb5f70559559" containerName="storage" Mar 16 16:44:45 crc kubenswrapper[5120]: I0316 16:44:45.559493 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-fkjzn" Mar 16 16:44:45 crc kubenswrapper[5120]: I0316 16:44:45.562301 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"openshift-service-ca.crt\"" Mar 16 16:44:45 crc kubenswrapper[5120]: I0316 16:44:45.562422 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"crc-storage\"" Mar 16 16:44:45 crc kubenswrapper[5120]: I0316 16:44:45.562838 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"kube-root-ca.crt\"" Mar 16 16:44:45 crc kubenswrapper[5120]: I0316 16:44:45.563172 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"crc-storage\"/\"crc-storage-dockercfg-s2tht\"" Mar 16 16:44:45 crc kubenswrapper[5120]: I0316 16:44:45.563390 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-fkjzn"] Mar 16 16:44:45 crc kubenswrapper[5120]: I0316 16:44:45.664000 5120 scope.go:117] "RemoveContainer" containerID="35a7dd6e19084cee69ca16203bca6378ea0cdf6a685ca2093ab847e5904eb9e6" Mar 16 16:44:45 crc kubenswrapper[5120]: E0316 16:44:45.664566 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:44:45 crc kubenswrapper[5120]: I0316 16:44:45.746170 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mj2fx\" (UniqueName: \"kubernetes.io/projected/bf798994-fe12-4c49-a38f-dc353c7432eb-kube-api-access-mj2fx\") pod \"crc-storage-crc-fkjzn\" (UID: \"bf798994-fe12-4c49-a38f-dc353c7432eb\") " pod="crc-storage/crc-storage-crc-fkjzn" Mar 16 16:44:45 crc kubenswrapper[5120]: I0316 16:44:45.746501 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/bf798994-fe12-4c49-a38f-dc353c7432eb-node-mnt\") pod \"crc-storage-crc-fkjzn\" (UID: \"bf798994-fe12-4c49-a38f-dc353c7432eb\") " pod="crc-storage/crc-storage-crc-fkjzn" Mar 16 16:44:45 crc kubenswrapper[5120]: I0316 16:44:45.746683 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/bf798994-fe12-4c49-a38f-dc353c7432eb-crc-storage\") pod \"crc-storage-crc-fkjzn\" (UID: \"bf798994-fe12-4c49-a38f-dc353c7432eb\") " pod="crc-storage/crc-storage-crc-fkjzn" Mar 16 16:44:45 crc kubenswrapper[5120]: I0316 16:44:45.850026 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mj2fx\" (UniqueName: \"kubernetes.io/projected/bf798994-fe12-4c49-a38f-dc353c7432eb-kube-api-access-mj2fx\") pod \"crc-storage-crc-fkjzn\" (UID: \"bf798994-fe12-4c49-a38f-dc353c7432eb\") " pod="crc-storage/crc-storage-crc-fkjzn" Mar 16 16:44:45 crc kubenswrapper[5120]: I0316 16:44:45.850191 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/bf798994-fe12-4c49-a38f-dc353c7432eb-node-mnt\") pod \"crc-storage-crc-fkjzn\" (UID: \"bf798994-fe12-4c49-a38f-dc353c7432eb\") " pod="crc-storage/crc-storage-crc-fkjzn" Mar 16 16:44:45 crc kubenswrapper[5120]: I0316 16:44:45.850280 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/bf798994-fe12-4c49-a38f-dc353c7432eb-crc-storage\") pod \"crc-storage-crc-fkjzn\" (UID: \"bf798994-fe12-4c49-a38f-dc353c7432eb\") " pod="crc-storage/crc-storage-crc-fkjzn" Mar 16 16:44:45 crc kubenswrapper[5120]: I0316 16:44:45.852438 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/bf798994-fe12-4c49-a38f-dc353c7432eb-node-mnt\") pod \"crc-storage-crc-fkjzn\" (UID: \"bf798994-fe12-4c49-a38f-dc353c7432eb\") " pod="crc-storage/crc-storage-crc-fkjzn" Mar 16 16:44:45 crc kubenswrapper[5120]: I0316 16:44:45.853350 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/bf798994-fe12-4c49-a38f-dc353c7432eb-crc-storage\") pod \"crc-storage-crc-fkjzn\" (UID: \"bf798994-fe12-4c49-a38f-dc353c7432eb\") " pod="crc-storage/crc-storage-crc-fkjzn" Mar 16 16:44:45 crc kubenswrapper[5120]: I0316 16:44:45.876540 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mj2fx\" (UniqueName: \"kubernetes.io/projected/bf798994-fe12-4c49-a38f-dc353c7432eb-kube-api-access-mj2fx\") pod \"crc-storage-crc-fkjzn\" (UID: \"bf798994-fe12-4c49-a38f-dc353c7432eb\") " pod="crc-storage/crc-storage-crc-fkjzn" Mar 16 16:44:45 crc kubenswrapper[5120]: I0316 16:44:45.887293 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-fkjzn" Mar 16 16:44:46 crc kubenswrapper[5120]: I0316 16:44:46.354355 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-fkjzn"] Mar 16 16:44:46 crc kubenswrapper[5120]: I0316 16:44:46.676221 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e3847568-de2e-4979-aeed-eb5f70559559" path="/var/lib/kubelet/pods/e3847568-de2e-4979-aeed-eb5f70559559/volumes" Mar 16 16:44:46 crc kubenswrapper[5120]: I0316 16:44:46.676669 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-fkjzn" event={"ID":"bf798994-fe12-4c49-a38f-dc353c7432eb","Type":"ContainerStarted","Data":"73592ae0c7f5d51d698464c633dffdf48cd7498f8e25bb6e0688952dfaaa7fc5"} Mar 16 16:44:47 crc kubenswrapper[5120]: I0316 16:44:47.681259 5120 generic.go:358] "Generic (PLEG): container finished" podID="bf798994-fe12-4c49-a38f-dc353c7432eb" containerID="ec32cc84b26792cf3f462f2ecea3511e822e6d2b6a22dd05e66d641afe8dfac1" exitCode=0 Mar 16 16:44:47 crc kubenswrapper[5120]: I0316 16:44:47.681350 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-fkjzn" event={"ID":"bf798994-fe12-4c49-a38f-dc353c7432eb","Type":"ContainerDied","Data":"ec32cc84b26792cf3f462f2ecea3511e822e6d2b6a22dd05e66d641afe8dfac1"} Mar 16 16:44:48 crc kubenswrapper[5120]: I0316 16:44:48.960705 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-fkjzn" Mar 16 16:44:49 crc kubenswrapper[5120]: I0316 16:44:49.013212 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mj2fx\" (UniqueName: \"kubernetes.io/projected/bf798994-fe12-4c49-a38f-dc353c7432eb-kube-api-access-mj2fx\") pod \"bf798994-fe12-4c49-a38f-dc353c7432eb\" (UID: \"bf798994-fe12-4c49-a38f-dc353c7432eb\") " Mar 16 16:44:49 crc kubenswrapper[5120]: I0316 16:44:49.013568 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/bf798994-fe12-4c49-a38f-dc353c7432eb-node-mnt\") pod \"bf798994-fe12-4c49-a38f-dc353c7432eb\" (UID: \"bf798994-fe12-4c49-a38f-dc353c7432eb\") " Mar 16 16:44:49 crc kubenswrapper[5120]: I0316 16:44:49.013635 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/bf798994-fe12-4c49-a38f-dc353c7432eb-node-mnt" (OuterVolumeSpecName: "node-mnt") pod "bf798994-fe12-4c49-a38f-dc353c7432eb" (UID: "bf798994-fe12-4c49-a38f-dc353c7432eb"). InnerVolumeSpecName "node-mnt". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 16:44:49 crc kubenswrapper[5120]: I0316 16:44:49.014015 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/bf798994-fe12-4c49-a38f-dc353c7432eb-crc-storage\") pod \"bf798994-fe12-4c49-a38f-dc353c7432eb\" (UID: \"bf798994-fe12-4c49-a38f-dc353c7432eb\") " Mar 16 16:44:49 crc kubenswrapper[5120]: I0316 16:44:49.014800 5120 reconciler_common.go:299] "Volume detached for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/bf798994-fe12-4c49-a38f-dc353c7432eb-node-mnt\") on node \"crc\" DevicePath \"\"" Mar 16 16:44:49 crc kubenswrapper[5120]: I0316 16:44:49.019896 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf798994-fe12-4c49-a38f-dc353c7432eb-kube-api-access-mj2fx" (OuterVolumeSpecName: "kube-api-access-mj2fx") pod "bf798994-fe12-4c49-a38f-dc353c7432eb" (UID: "bf798994-fe12-4c49-a38f-dc353c7432eb"). InnerVolumeSpecName "kube-api-access-mj2fx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:44:49 crc kubenswrapper[5120]: I0316 16:44:49.048121 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bf798994-fe12-4c49-a38f-dc353c7432eb-crc-storage" (OuterVolumeSpecName: "crc-storage") pod "bf798994-fe12-4c49-a38f-dc353c7432eb" (UID: "bf798994-fe12-4c49-a38f-dc353c7432eb"). InnerVolumeSpecName "crc-storage". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:44:49 crc kubenswrapper[5120]: I0316 16:44:49.116915 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mj2fx\" (UniqueName: \"kubernetes.io/projected/bf798994-fe12-4c49-a38f-dc353c7432eb-kube-api-access-mj2fx\") on node \"crc\" DevicePath \"\"" Mar 16 16:44:49 crc kubenswrapper[5120]: I0316 16:44:49.116972 5120 reconciler_common.go:299] "Volume detached for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/bf798994-fe12-4c49-a38f-dc353c7432eb-crc-storage\") on node \"crc\" DevicePath \"\"" Mar 16 16:44:49 crc kubenswrapper[5120]: I0316 16:44:49.700174 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-fkjzn" Mar 16 16:44:49 crc kubenswrapper[5120]: I0316 16:44:49.700248 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-fkjzn" event={"ID":"bf798994-fe12-4c49-a38f-dc353c7432eb","Type":"ContainerDied","Data":"73592ae0c7f5d51d698464c633dffdf48cd7498f8e25bb6e0688952dfaaa7fc5"} Mar 16 16:44:49 crc kubenswrapper[5120]: I0316 16:44:49.700326 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="73592ae0c7f5d51d698464c633dffdf48cd7498f8e25bb6e0688952dfaaa7fc5" Mar 16 16:45:00 crc kubenswrapper[5120]: I0316 16:45:00.129854 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29561325-6tc9k"] Mar 16 16:45:00 crc kubenswrapper[5120]: I0316 16:45:00.131201 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf798994-fe12-4c49-a38f-dc353c7432eb" containerName="storage" Mar 16 16:45:00 crc kubenswrapper[5120]: I0316 16:45:00.131213 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf798994-fe12-4c49-a38f-dc353c7432eb" containerName="storage" Mar 16 16:45:00 crc kubenswrapper[5120]: I0316 16:45:00.131330 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="bf798994-fe12-4c49-a38f-dc353c7432eb" containerName="storage" Mar 16 16:45:00 crc kubenswrapper[5120]: I0316 16:45:00.142584 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29561325-6tc9k"] Mar 16 16:45:00 crc kubenswrapper[5120]: I0316 16:45:00.142715 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29561325-6tc9k" Mar 16 16:45:00 crc kubenswrapper[5120]: I0316 16:45:00.144991 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operator-lifecycle-manager\"/\"collect-profiles-config\"" Mar 16 16:45:00 crc kubenswrapper[5120]: I0316 16:45:00.145352 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operator-lifecycle-manager\"/\"collect-profiles-dockercfg-vfqp6\"" Mar 16 16:45:00 crc kubenswrapper[5120]: I0316 16:45:00.241542 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/fe7dbce5-1133-445b-8a9c-05ced8fb138e-secret-volume\") pod \"collect-profiles-29561325-6tc9k\" (UID: \"fe7dbce5-1133-445b-8a9c-05ced8fb138e\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561325-6tc9k" Mar 16 16:45:00 crc kubenswrapper[5120]: I0316 16:45:00.241907 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tcdn\" (UniqueName: \"kubernetes.io/projected/fe7dbce5-1133-445b-8a9c-05ced8fb138e-kube-api-access-7tcdn\") pod \"collect-profiles-29561325-6tc9k\" (UID: \"fe7dbce5-1133-445b-8a9c-05ced8fb138e\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561325-6tc9k" Mar 16 16:45:00 crc kubenswrapper[5120]: I0316 16:45:00.242084 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fe7dbce5-1133-445b-8a9c-05ced8fb138e-config-volume\") pod \"collect-profiles-29561325-6tc9k\" (UID: \"fe7dbce5-1133-445b-8a9c-05ced8fb138e\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561325-6tc9k" Mar 16 16:45:00 crc kubenswrapper[5120]: I0316 16:45:00.343300 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/fe7dbce5-1133-445b-8a9c-05ced8fb138e-secret-volume\") pod \"collect-profiles-29561325-6tc9k\" (UID: \"fe7dbce5-1133-445b-8a9c-05ced8fb138e\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561325-6tc9k" Mar 16 16:45:00 crc kubenswrapper[5120]: I0316 16:45:00.343477 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7tcdn\" (UniqueName: \"kubernetes.io/projected/fe7dbce5-1133-445b-8a9c-05ced8fb138e-kube-api-access-7tcdn\") pod \"collect-profiles-29561325-6tc9k\" (UID: \"fe7dbce5-1133-445b-8a9c-05ced8fb138e\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561325-6tc9k" Mar 16 16:45:00 crc kubenswrapper[5120]: I0316 16:45:00.343535 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fe7dbce5-1133-445b-8a9c-05ced8fb138e-config-volume\") pod \"collect-profiles-29561325-6tc9k\" (UID: \"fe7dbce5-1133-445b-8a9c-05ced8fb138e\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561325-6tc9k" Mar 16 16:45:00 crc kubenswrapper[5120]: I0316 16:45:00.344808 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fe7dbce5-1133-445b-8a9c-05ced8fb138e-config-volume\") pod \"collect-profiles-29561325-6tc9k\" (UID: \"fe7dbce5-1133-445b-8a9c-05ced8fb138e\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561325-6tc9k" Mar 16 16:45:00 crc kubenswrapper[5120]: I0316 16:45:00.349688 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/fe7dbce5-1133-445b-8a9c-05ced8fb138e-secret-volume\") pod \"collect-profiles-29561325-6tc9k\" (UID: \"fe7dbce5-1133-445b-8a9c-05ced8fb138e\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561325-6tc9k" Mar 16 16:45:00 crc kubenswrapper[5120]: I0316 16:45:00.362269 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tcdn\" (UniqueName: \"kubernetes.io/projected/fe7dbce5-1133-445b-8a9c-05ced8fb138e-kube-api-access-7tcdn\") pod \"collect-profiles-29561325-6tc9k\" (UID: \"fe7dbce5-1133-445b-8a9c-05ced8fb138e\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561325-6tc9k" Mar 16 16:45:00 crc kubenswrapper[5120]: I0316 16:45:00.463227 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29561325-6tc9k" Mar 16 16:45:00 crc kubenswrapper[5120]: I0316 16:45:00.663674 5120 scope.go:117] "RemoveContainer" containerID="35a7dd6e19084cee69ca16203bca6378ea0cdf6a685ca2093ab847e5904eb9e6" Mar 16 16:45:00 crc kubenswrapper[5120]: E0316 16:45:00.664433 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:45:00 crc kubenswrapper[5120]: I0316 16:45:00.676933 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 16:45:00 crc kubenswrapper[5120]: I0316 16:45:00.682275 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:45:00 crc kubenswrapper[5120]: I0316 16:45:00.684106 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 16:45:00 crc kubenswrapper[5120]: I0316 16:45:00.684251 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-cell1-erlang-cookie\"" Mar 16 16:45:00 crc kubenswrapper[5120]: I0316 16:45:00.685152 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-cell1-plugins-conf\"" Mar 16 16:45:00 crc kubenswrapper[5120]: I0316 16:45:00.687023 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-cell1-default-user\"" Mar 16 16:45:00 crc kubenswrapper[5120]: I0316 16:45:00.687265 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-cell1-server-conf\"" Mar 16 16:45:00 crc kubenswrapper[5120]: I0316 16:45:00.687585 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-cell1-server-dockercfg-vghkd\"" Mar 16 16:45:00 crc kubenswrapper[5120]: I0316 16:45:00.751450 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8frxv\" (UniqueName: \"kubernetes.io/projected/aa12529b-b6fe-4512-88ec-fd6250636e6b-kube-api-access-8frxv\") pod \"rabbitmq-cell1-server-0\" (UID: \"aa12529b-b6fe-4512-88ec-fd6250636e6b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:45:00 crc kubenswrapper[5120]: I0316 16:45:00.751591 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/aa12529b-b6fe-4512-88ec-fd6250636e6b-rabbitmq-erlang-cookie\") pod \"rabbitmq-cell1-server-0\" (UID: \"aa12529b-b6fe-4512-88ec-fd6250636e6b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:45:00 crc kubenswrapper[5120]: I0316 16:45:00.751648 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/aa12529b-b6fe-4512-88ec-fd6250636e6b-server-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"aa12529b-b6fe-4512-88ec-fd6250636e6b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:45:00 crc kubenswrapper[5120]: I0316 16:45:00.752673 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/aa12529b-b6fe-4512-88ec-fd6250636e6b-erlang-cookie-secret\") pod \"rabbitmq-cell1-server-0\" (UID: \"aa12529b-b6fe-4512-88ec-fd6250636e6b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:45:00 crc kubenswrapper[5120]: I0316 16:45:00.752726 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/aa12529b-b6fe-4512-88ec-fd6250636e6b-rabbitmq-confd\") pod \"rabbitmq-cell1-server-0\" (UID: \"aa12529b-b6fe-4512-88ec-fd6250636e6b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:45:00 crc kubenswrapper[5120]: I0316 16:45:00.752749 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/aa12529b-b6fe-4512-88ec-fd6250636e6b-plugins-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"aa12529b-b6fe-4512-88ec-fd6250636e6b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:45:00 crc kubenswrapper[5120]: I0316 16:45:00.752852 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/aa12529b-b6fe-4512-88ec-fd6250636e6b-pod-info\") pod \"rabbitmq-cell1-server-0\" (UID: \"aa12529b-b6fe-4512-88ec-fd6250636e6b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:45:00 crc kubenswrapper[5120]: I0316 16:45:00.752873 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"aa12529b-b6fe-4512-88ec-fd6250636e6b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:45:00 crc kubenswrapper[5120]: I0316 16:45:00.752889 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/aa12529b-b6fe-4512-88ec-fd6250636e6b-rabbitmq-plugins\") pod \"rabbitmq-cell1-server-0\" (UID: \"aa12529b-b6fe-4512-88ec-fd6250636e6b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:45:00 crc kubenswrapper[5120]: I0316 16:45:00.854779 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/aa12529b-b6fe-4512-88ec-fd6250636e6b-pod-info\") pod \"rabbitmq-cell1-server-0\" (UID: \"aa12529b-b6fe-4512-88ec-fd6250636e6b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:45:00 crc kubenswrapper[5120]: I0316 16:45:00.854822 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"aa12529b-b6fe-4512-88ec-fd6250636e6b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:45:00 crc kubenswrapper[5120]: I0316 16:45:00.854840 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/aa12529b-b6fe-4512-88ec-fd6250636e6b-rabbitmq-plugins\") pod \"rabbitmq-cell1-server-0\" (UID: \"aa12529b-b6fe-4512-88ec-fd6250636e6b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:45:00 crc kubenswrapper[5120]: I0316 16:45:00.854918 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8frxv\" (UniqueName: \"kubernetes.io/projected/aa12529b-b6fe-4512-88ec-fd6250636e6b-kube-api-access-8frxv\") pod \"rabbitmq-cell1-server-0\" (UID: \"aa12529b-b6fe-4512-88ec-fd6250636e6b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:45:00 crc kubenswrapper[5120]: I0316 16:45:00.854960 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/aa12529b-b6fe-4512-88ec-fd6250636e6b-rabbitmq-erlang-cookie\") pod \"rabbitmq-cell1-server-0\" (UID: \"aa12529b-b6fe-4512-88ec-fd6250636e6b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:45:00 crc kubenswrapper[5120]: I0316 16:45:00.855004 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/aa12529b-b6fe-4512-88ec-fd6250636e6b-server-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"aa12529b-b6fe-4512-88ec-fd6250636e6b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:45:00 crc kubenswrapper[5120]: I0316 16:45:00.855072 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/aa12529b-b6fe-4512-88ec-fd6250636e6b-erlang-cookie-secret\") pod \"rabbitmq-cell1-server-0\" (UID: \"aa12529b-b6fe-4512-88ec-fd6250636e6b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:45:00 crc kubenswrapper[5120]: I0316 16:45:00.855105 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/aa12529b-b6fe-4512-88ec-fd6250636e6b-rabbitmq-confd\") pod \"rabbitmq-cell1-server-0\" (UID: \"aa12529b-b6fe-4512-88ec-fd6250636e6b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:45:00 crc kubenswrapper[5120]: I0316 16:45:00.855128 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/aa12529b-b6fe-4512-88ec-fd6250636e6b-plugins-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"aa12529b-b6fe-4512-88ec-fd6250636e6b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:45:00 crc kubenswrapper[5120]: I0316 16:45:00.855980 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/aa12529b-b6fe-4512-88ec-fd6250636e6b-plugins-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"aa12529b-b6fe-4512-88ec-fd6250636e6b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:45:00 crc kubenswrapper[5120]: I0316 16:45:00.856390 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/aa12529b-b6fe-4512-88ec-fd6250636e6b-rabbitmq-erlang-cookie\") pod \"rabbitmq-cell1-server-0\" (UID: \"aa12529b-b6fe-4512-88ec-fd6250636e6b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:45:00 crc kubenswrapper[5120]: I0316 16:45:00.857046 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"aa12529b-b6fe-4512-88ec-fd6250636e6b\") device mount path \"/mnt/openstack/pv12\"" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:45:00 crc kubenswrapper[5120]: I0316 16:45:00.857126 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/aa12529b-b6fe-4512-88ec-fd6250636e6b-rabbitmq-plugins\") pod \"rabbitmq-cell1-server-0\" (UID: \"aa12529b-b6fe-4512-88ec-fd6250636e6b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:45:00 crc kubenswrapper[5120]: I0316 16:45:00.859178 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/aa12529b-b6fe-4512-88ec-fd6250636e6b-server-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"aa12529b-b6fe-4512-88ec-fd6250636e6b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:45:00 crc kubenswrapper[5120]: I0316 16:45:00.861360 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/aa12529b-b6fe-4512-88ec-fd6250636e6b-pod-info\") pod \"rabbitmq-cell1-server-0\" (UID: \"aa12529b-b6fe-4512-88ec-fd6250636e6b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:45:00 crc kubenswrapper[5120]: I0316 16:45:00.862112 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/aa12529b-b6fe-4512-88ec-fd6250636e6b-rabbitmq-confd\") pod \"rabbitmq-cell1-server-0\" (UID: \"aa12529b-b6fe-4512-88ec-fd6250636e6b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:45:00 crc kubenswrapper[5120]: I0316 16:45:00.862287 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/aa12529b-b6fe-4512-88ec-fd6250636e6b-erlang-cookie-secret\") pod \"rabbitmq-cell1-server-0\" (UID: \"aa12529b-b6fe-4512-88ec-fd6250636e6b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:45:00 crc kubenswrapper[5120]: I0316 16:45:00.892497 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29561325-6tc9k"] Mar 16 16:45:00 crc kubenswrapper[5120]: I0316 16:45:00.900909 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8frxv\" (UniqueName: \"kubernetes.io/projected/aa12529b-b6fe-4512-88ec-fd6250636e6b-kube-api-access-8frxv\") pod \"rabbitmq-cell1-server-0\" (UID: \"aa12529b-b6fe-4512-88ec-fd6250636e6b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:45:00 crc kubenswrapper[5120]: I0316 16:45:00.907437 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"aa12529b-b6fe-4512-88ec-fd6250636e6b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:45:00 crc kubenswrapper[5120]: I0316 16:45:00.918724 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 16:45:00 crc kubenswrapper[5120]: I0316 16:45:00.926633 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:45:00 crc kubenswrapper[5120]: I0316 16:45:00.929713 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-server-conf\"" Mar 16 16:45:00 crc kubenswrapper[5120]: I0316 16:45:00.929755 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-plugins-conf\"" Mar 16 16:45:00 crc kubenswrapper[5120]: I0316 16:45:00.930508 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-default-user\"" Mar 16 16:45:00 crc kubenswrapper[5120]: I0316 16:45:00.930659 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-erlang-cookie\"" Mar 16 16:45:00 crc kubenswrapper[5120]: I0316 16:45:00.930786 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-server-dockercfg-fd7mp\"" Mar 16 16:45:00 crc kubenswrapper[5120]: I0316 16:45:00.931319 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 16:45:00 crc kubenswrapper[5120]: I0316 16:45:00.958076 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/07aa860b-bb17-4a36-bc23-549bfd1bdb5c-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"07aa860b-bb17-4a36-bc23-549bfd1bdb5c\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:45:00 crc kubenswrapper[5120]: I0316 16:45:00.958164 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage18-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") pod \"rabbitmq-server-0\" (UID: \"07aa860b-bb17-4a36-bc23-549bfd1bdb5c\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:45:00 crc kubenswrapper[5120]: I0316 16:45:00.958203 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/07aa860b-bb17-4a36-bc23-549bfd1bdb5c-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"07aa860b-bb17-4a36-bc23-549bfd1bdb5c\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:45:00 crc kubenswrapper[5120]: I0316 16:45:00.958232 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4ldd\" (UniqueName: \"kubernetes.io/projected/07aa860b-bb17-4a36-bc23-549bfd1bdb5c-kube-api-access-l4ldd\") pod \"rabbitmq-server-0\" (UID: \"07aa860b-bb17-4a36-bc23-549bfd1bdb5c\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:45:00 crc kubenswrapper[5120]: I0316 16:45:00.958289 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/07aa860b-bb17-4a36-bc23-549bfd1bdb5c-pod-info\") pod \"rabbitmq-server-0\" (UID: \"07aa860b-bb17-4a36-bc23-549bfd1bdb5c\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:45:00 crc kubenswrapper[5120]: I0316 16:45:00.958321 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/07aa860b-bb17-4a36-bc23-549bfd1bdb5c-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"07aa860b-bb17-4a36-bc23-549bfd1bdb5c\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:45:00 crc kubenswrapper[5120]: I0316 16:45:00.958387 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/07aa860b-bb17-4a36-bc23-549bfd1bdb5c-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"07aa860b-bb17-4a36-bc23-549bfd1bdb5c\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:45:00 crc kubenswrapper[5120]: I0316 16:45:00.958433 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/07aa860b-bb17-4a36-bc23-549bfd1bdb5c-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"07aa860b-bb17-4a36-bc23-549bfd1bdb5c\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:45:00 crc kubenswrapper[5120]: I0316 16:45:00.958477 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/07aa860b-bb17-4a36-bc23-549bfd1bdb5c-server-conf\") pod \"rabbitmq-server-0\" (UID: \"07aa860b-bb17-4a36-bc23-549bfd1bdb5c\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:45:01 crc kubenswrapper[5120]: I0316 16:45:01.005251 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:45:01 crc kubenswrapper[5120]: I0316 16:45:01.060149 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/07aa860b-bb17-4a36-bc23-549bfd1bdb5c-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"07aa860b-bb17-4a36-bc23-549bfd1bdb5c\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:45:01 crc kubenswrapper[5120]: I0316 16:45:01.060209 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/07aa860b-bb17-4a36-bc23-549bfd1bdb5c-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"07aa860b-bb17-4a36-bc23-549bfd1bdb5c\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:45:01 crc kubenswrapper[5120]: I0316 16:45:01.060247 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/07aa860b-bb17-4a36-bc23-549bfd1bdb5c-server-conf\") pod \"rabbitmq-server-0\" (UID: \"07aa860b-bb17-4a36-bc23-549bfd1bdb5c\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:45:01 crc kubenswrapper[5120]: I0316 16:45:01.060344 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/07aa860b-bb17-4a36-bc23-549bfd1bdb5c-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"07aa860b-bb17-4a36-bc23-549bfd1bdb5c\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:45:01 crc kubenswrapper[5120]: I0316 16:45:01.060390 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage18-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") pod \"rabbitmq-server-0\" (UID: \"07aa860b-bb17-4a36-bc23-549bfd1bdb5c\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:45:01 crc kubenswrapper[5120]: I0316 16:45:01.060417 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/07aa860b-bb17-4a36-bc23-549bfd1bdb5c-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"07aa860b-bb17-4a36-bc23-549bfd1bdb5c\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:45:01 crc kubenswrapper[5120]: I0316 16:45:01.060438 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l4ldd\" (UniqueName: \"kubernetes.io/projected/07aa860b-bb17-4a36-bc23-549bfd1bdb5c-kube-api-access-l4ldd\") pod \"rabbitmq-server-0\" (UID: \"07aa860b-bb17-4a36-bc23-549bfd1bdb5c\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:45:01 crc kubenswrapper[5120]: I0316 16:45:01.060479 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/07aa860b-bb17-4a36-bc23-549bfd1bdb5c-pod-info\") pod \"rabbitmq-server-0\" (UID: \"07aa860b-bb17-4a36-bc23-549bfd1bdb5c\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:45:01 crc kubenswrapper[5120]: I0316 16:45:01.060529 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/07aa860b-bb17-4a36-bc23-549bfd1bdb5c-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"07aa860b-bb17-4a36-bc23-549bfd1bdb5c\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:45:01 crc kubenswrapper[5120]: I0316 16:45:01.061170 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage18-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") pod \"rabbitmq-server-0\" (UID: \"07aa860b-bb17-4a36-bc23-549bfd1bdb5c\") device mount path \"/mnt/openstack/pv18\"" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:45:01 crc kubenswrapper[5120]: I0316 16:45:01.061263 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/07aa860b-bb17-4a36-bc23-549bfd1bdb5c-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"07aa860b-bb17-4a36-bc23-549bfd1bdb5c\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:45:01 crc kubenswrapper[5120]: I0316 16:45:01.061505 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/07aa860b-bb17-4a36-bc23-549bfd1bdb5c-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"07aa860b-bb17-4a36-bc23-549bfd1bdb5c\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:45:01 crc kubenswrapper[5120]: I0316 16:45:01.061841 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/07aa860b-bb17-4a36-bc23-549bfd1bdb5c-server-conf\") pod \"rabbitmq-server-0\" (UID: \"07aa860b-bb17-4a36-bc23-549bfd1bdb5c\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:45:01 crc kubenswrapper[5120]: I0316 16:45:01.062216 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/07aa860b-bb17-4a36-bc23-549bfd1bdb5c-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"07aa860b-bb17-4a36-bc23-549bfd1bdb5c\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:45:01 crc kubenswrapper[5120]: I0316 16:45:01.066058 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/07aa860b-bb17-4a36-bc23-549bfd1bdb5c-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"07aa860b-bb17-4a36-bc23-549bfd1bdb5c\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:45:01 crc kubenswrapper[5120]: I0316 16:45:01.066346 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/07aa860b-bb17-4a36-bc23-549bfd1bdb5c-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"07aa860b-bb17-4a36-bc23-549bfd1bdb5c\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:45:01 crc kubenswrapper[5120]: I0316 16:45:01.076402 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/07aa860b-bb17-4a36-bc23-549bfd1bdb5c-pod-info\") pod \"rabbitmq-server-0\" (UID: \"07aa860b-bb17-4a36-bc23-549bfd1bdb5c\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:45:01 crc kubenswrapper[5120]: I0316 16:45:01.080435 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4ldd\" (UniqueName: \"kubernetes.io/projected/07aa860b-bb17-4a36-bc23-549bfd1bdb5c-kube-api-access-l4ldd\") pod \"rabbitmq-server-0\" (UID: \"07aa860b-bb17-4a36-bc23-549bfd1bdb5c\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:45:01 crc kubenswrapper[5120]: I0316 16:45:01.109331 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage18-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") pod \"rabbitmq-server-0\" (UID: \"07aa860b-bb17-4a36-bc23-549bfd1bdb5c\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:45:01 crc kubenswrapper[5120]: I0316 16:45:01.118165 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 16:45:01 crc kubenswrapper[5120]: I0316 16:45:01.129484 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 16:45:01 crc kubenswrapper[5120]: I0316 16:45:01.129618 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:45:01 crc kubenswrapper[5120]: I0316 16:45:01.133870 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"galera-openstack-dockercfg-8xncx\"" Mar 16 16:45:01 crc kubenswrapper[5120]: I0316 16:45:01.134087 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-config-data\"" Mar 16 16:45:01 crc kubenswrapper[5120]: I0316 16:45:01.135448 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-galera-openstack-svc\"" Mar 16 16:45:01 crc kubenswrapper[5120]: I0316 16:45:01.137878 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-scripts\"" Mar 16 16:45:01 crc kubenswrapper[5120]: I0316 16:45:01.143595 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"combined-ca-bundle\"" Mar 16 16:45:01 crc kubenswrapper[5120]: I0316 16:45:01.162899 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/359ce032-c698-43d8-a7eb-011091fe9a3d-kolla-config\") pod \"openstack-galera-0\" (UID: \"359ce032-c698-43d8-a7eb-011091fe9a3d\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:45:01 crc kubenswrapper[5120]: I0316 16:45:01.162959 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/359ce032-c698-43d8-a7eb-011091fe9a3d-config-data-generated\") pod \"openstack-galera-0\" (UID: \"359ce032-c698-43d8-a7eb-011091fe9a3d\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:45:01 crc kubenswrapper[5120]: I0316 16:45:01.162986 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"openstack-galera-0\" (UID: \"359ce032-c698-43d8-a7eb-011091fe9a3d\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:45:01 crc kubenswrapper[5120]: I0316 16:45:01.163030 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/359ce032-c698-43d8-a7eb-011091fe9a3d-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"359ce032-c698-43d8-a7eb-011091fe9a3d\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:45:01 crc kubenswrapper[5120]: I0316 16:45:01.163183 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/359ce032-c698-43d8-a7eb-011091fe9a3d-operator-scripts\") pod \"openstack-galera-0\" (UID: \"359ce032-c698-43d8-a7eb-011091fe9a3d\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:45:01 crc kubenswrapper[5120]: I0316 16:45:01.163204 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tbjl\" (UniqueName: \"kubernetes.io/projected/359ce032-c698-43d8-a7eb-011091fe9a3d-kube-api-access-5tbjl\") pod \"openstack-galera-0\" (UID: \"359ce032-c698-43d8-a7eb-011091fe9a3d\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:45:01 crc kubenswrapper[5120]: I0316 16:45:01.163273 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/359ce032-c698-43d8-a7eb-011091fe9a3d-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"359ce032-c698-43d8-a7eb-011091fe9a3d\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:45:01 crc kubenswrapper[5120]: I0316 16:45:01.163298 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/359ce032-c698-43d8-a7eb-011091fe9a3d-config-data-default\") pod \"openstack-galera-0\" (UID: \"359ce032-c698-43d8-a7eb-011091fe9a3d\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:45:01 crc kubenswrapper[5120]: I0316 16:45:01.257161 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:45:01 crc kubenswrapper[5120]: I0316 16:45:01.265019 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/359ce032-c698-43d8-a7eb-011091fe9a3d-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"359ce032-c698-43d8-a7eb-011091fe9a3d\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:45:01 crc kubenswrapper[5120]: I0316 16:45:01.265090 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/359ce032-c698-43d8-a7eb-011091fe9a3d-config-data-default\") pod \"openstack-galera-0\" (UID: \"359ce032-c698-43d8-a7eb-011091fe9a3d\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:45:01 crc kubenswrapper[5120]: I0316 16:45:01.265118 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/359ce032-c698-43d8-a7eb-011091fe9a3d-kolla-config\") pod \"openstack-galera-0\" (UID: \"359ce032-c698-43d8-a7eb-011091fe9a3d\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:45:01 crc kubenswrapper[5120]: I0316 16:45:01.265179 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/359ce032-c698-43d8-a7eb-011091fe9a3d-config-data-generated\") pod \"openstack-galera-0\" (UID: \"359ce032-c698-43d8-a7eb-011091fe9a3d\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:45:01 crc kubenswrapper[5120]: I0316 16:45:01.265209 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"openstack-galera-0\" (UID: \"359ce032-c698-43d8-a7eb-011091fe9a3d\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:45:01 crc kubenswrapper[5120]: I0316 16:45:01.265268 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/359ce032-c698-43d8-a7eb-011091fe9a3d-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"359ce032-c698-43d8-a7eb-011091fe9a3d\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:45:01 crc kubenswrapper[5120]: I0316 16:45:01.265490 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/359ce032-c698-43d8-a7eb-011091fe9a3d-operator-scripts\") pod \"openstack-galera-0\" (UID: \"359ce032-c698-43d8-a7eb-011091fe9a3d\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:45:01 crc kubenswrapper[5120]: I0316 16:45:01.265527 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5tbjl\" (UniqueName: \"kubernetes.io/projected/359ce032-c698-43d8-a7eb-011091fe9a3d-kube-api-access-5tbjl\") pod \"openstack-galera-0\" (UID: \"359ce032-c698-43d8-a7eb-011091fe9a3d\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:45:01 crc kubenswrapper[5120]: I0316 16:45:01.267707 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/359ce032-c698-43d8-a7eb-011091fe9a3d-config-data-generated\") pod \"openstack-galera-0\" (UID: \"359ce032-c698-43d8-a7eb-011091fe9a3d\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:45:01 crc kubenswrapper[5120]: I0316 16:45:01.268259 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/359ce032-c698-43d8-a7eb-011091fe9a3d-config-data-default\") pod \"openstack-galera-0\" (UID: \"359ce032-c698-43d8-a7eb-011091fe9a3d\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:45:01 crc kubenswrapper[5120]: I0316 16:45:01.268382 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/359ce032-c698-43d8-a7eb-011091fe9a3d-kolla-config\") pod \"openstack-galera-0\" (UID: \"359ce032-c698-43d8-a7eb-011091fe9a3d\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:45:01 crc kubenswrapper[5120]: I0316 16:45:01.269675 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/359ce032-c698-43d8-a7eb-011091fe9a3d-operator-scripts\") pod \"openstack-galera-0\" (UID: \"359ce032-c698-43d8-a7eb-011091fe9a3d\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:45:01 crc kubenswrapper[5120]: I0316 16:45:01.269855 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"openstack-galera-0\" (UID: \"359ce032-c698-43d8-a7eb-011091fe9a3d\") device mount path \"/mnt/openstack/pv16\"" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:45:01 crc kubenswrapper[5120]: I0316 16:45:01.271515 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/359ce032-c698-43d8-a7eb-011091fe9a3d-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"359ce032-c698-43d8-a7eb-011091fe9a3d\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:45:01 crc kubenswrapper[5120]: I0316 16:45:01.272126 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/359ce032-c698-43d8-a7eb-011091fe9a3d-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"359ce032-c698-43d8-a7eb-011091fe9a3d\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:45:01 crc kubenswrapper[5120]: I0316 16:45:01.296846 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tbjl\" (UniqueName: \"kubernetes.io/projected/359ce032-c698-43d8-a7eb-011091fe9a3d-kube-api-access-5tbjl\") pod \"openstack-galera-0\" (UID: \"359ce032-c698-43d8-a7eb-011091fe9a3d\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:45:01 crc kubenswrapper[5120]: I0316 16:45:01.316718 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"openstack-galera-0\" (UID: \"359ce032-c698-43d8-a7eb-011091fe9a3d\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:45:01 crc kubenswrapper[5120]: I0316 16:45:01.463205 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:45:01 crc kubenswrapper[5120]: I0316 16:45:01.497482 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 16:45:01 crc kubenswrapper[5120]: I0316 16:45:01.652697 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 16:45:01 crc kubenswrapper[5120]: W0316 16:45:01.714821 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07aa860b_bb17_4a36_bc23_549bfd1bdb5c.slice/crio-1840f15ea1580195538d5cef1caa915da98c1920e62725427692611e9d581023 WatchSource:0}: Error finding container 1840f15ea1580195538d5cef1caa915da98c1920e62725427692611e9d581023: Status 404 returned error can't find the container with id 1840f15ea1580195538d5cef1caa915da98c1920e62725427692611e9d581023 Mar 16 16:45:01 crc kubenswrapper[5120]: I0316 16:45:01.851288 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"07aa860b-bb17-4a36-bc23-549bfd1bdb5c","Type":"ContainerStarted","Data":"1840f15ea1580195538d5cef1caa915da98c1920e62725427692611e9d581023"} Mar 16 16:45:01 crc kubenswrapper[5120]: I0316 16:45:01.862692 5120 generic.go:358] "Generic (PLEG): container finished" podID="fe7dbce5-1133-445b-8a9c-05ced8fb138e" containerID="7a1ff61c9342026e5b18084603bf6ce8710f944e3384b7971d5e89baecc59904" exitCode=0 Mar 16 16:45:01 crc kubenswrapper[5120]: I0316 16:45:01.862848 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/collect-profiles-29561325-6tc9k" event={"ID":"fe7dbce5-1133-445b-8a9c-05ced8fb138e","Type":"ContainerDied","Data":"7a1ff61c9342026e5b18084603bf6ce8710f944e3384b7971d5e89baecc59904"} Mar 16 16:45:01 crc kubenswrapper[5120]: I0316 16:45:01.862874 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/collect-profiles-29561325-6tc9k" event={"ID":"fe7dbce5-1133-445b-8a9c-05ced8fb138e","Type":"ContainerStarted","Data":"1ee43c0d5afe79c48f45d39347f1eebe571e9cc8bd17d0e4656b3b1f0768f475"} Mar 16 16:45:01 crc kubenswrapper[5120]: I0316 16:45:01.867253 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"aa12529b-b6fe-4512-88ec-fd6250636e6b","Type":"ContainerStarted","Data":"5db48ac99e4cd426cb85d822a777dca0f601cfb0be745e2cc1641e57f65425b3"} Mar 16 16:45:01 crc kubenswrapper[5120]: I0316 16:45:01.951105 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 16:45:01 crc kubenswrapper[5120]: I0316 16:45:01.964428 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Mar 16 16:45:01 crc kubenswrapper[5120]: I0316 16:45:01.974429 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"memcached-memcached-dockercfg-njnwg\"" Mar 16 16:45:01 crc kubenswrapper[5120]: I0316 16:45:01.974693 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"memcached-config-data\"" Mar 16 16:45:01 crc kubenswrapper[5120]: I0316 16:45:01.989214 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4lnld\" (UniqueName: \"kubernetes.io/projected/02bf1e48-defb-443a-98b5-9eed2dc9947c-kube-api-access-4lnld\") pod \"memcached-0\" (UID: \"02bf1e48-defb-443a-98b5-9eed2dc9947c\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:45:01 crc kubenswrapper[5120]: I0316 16:45:01.989353 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/02bf1e48-defb-443a-98b5-9eed2dc9947c-config-data\") pod \"memcached-0\" (UID: \"02bf1e48-defb-443a-98b5-9eed2dc9947c\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:45:01 crc kubenswrapper[5120]: I0316 16:45:01.989479 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/02bf1e48-defb-443a-98b5-9eed2dc9947c-kolla-config\") pod \"memcached-0\" (UID: \"02bf1e48-defb-443a-98b5-9eed2dc9947c\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:45:02 crc kubenswrapper[5120]: I0316 16:45:02.023615 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 16:45:02 crc kubenswrapper[5120]: I0316 16:45:02.089103 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 16:45:02 crc kubenswrapper[5120]: I0316 16:45:02.090380 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/02bf1e48-defb-443a-98b5-9eed2dc9947c-config-data\") pod \"memcached-0\" (UID: \"02bf1e48-defb-443a-98b5-9eed2dc9947c\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:45:02 crc kubenswrapper[5120]: I0316 16:45:02.090536 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/02bf1e48-defb-443a-98b5-9eed2dc9947c-kolla-config\") pod \"memcached-0\" (UID: \"02bf1e48-defb-443a-98b5-9eed2dc9947c\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:45:02 crc kubenswrapper[5120]: I0316 16:45:02.090576 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4lnld\" (UniqueName: \"kubernetes.io/projected/02bf1e48-defb-443a-98b5-9eed2dc9947c-kube-api-access-4lnld\") pod \"memcached-0\" (UID: \"02bf1e48-defb-443a-98b5-9eed2dc9947c\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:45:02 crc kubenswrapper[5120]: I0316 16:45:02.091706 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/02bf1e48-defb-443a-98b5-9eed2dc9947c-config-data\") pod \"memcached-0\" (UID: \"02bf1e48-defb-443a-98b5-9eed2dc9947c\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:45:02 crc kubenswrapper[5120]: I0316 16:45:02.092335 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/02bf1e48-defb-443a-98b5-9eed2dc9947c-kolla-config\") pod \"memcached-0\" (UID: \"02bf1e48-defb-443a-98b5-9eed2dc9947c\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:45:02 crc kubenswrapper[5120]: I0316 16:45:02.113650 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4lnld\" (UniqueName: \"kubernetes.io/projected/02bf1e48-defb-443a-98b5-9eed2dc9947c-kube-api-access-4lnld\") pod \"memcached-0\" (UID: \"02bf1e48-defb-443a-98b5-9eed2dc9947c\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:45:02 crc kubenswrapper[5120]: I0316 16:45:02.348133 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Mar 16 16:45:02 crc kubenswrapper[5120]: I0316 16:45:02.499699 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 16:45:02 crc kubenswrapper[5120]: I0316 16:45:02.521099 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:45:02 crc kubenswrapper[5120]: I0316 16:45:02.523011 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 16:45:02 crc kubenswrapper[5120]: I0316 16:45:02.526504 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"telemetry-ceilometer-dockercfg-vsj9b\"" Mar 16 16:45:02 crc kubenswrapper[5120]: I0316 16:45:02.601197 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9hgn\" (UniqueName: \"kubernetes.io/projected/42e40835-5700-459b-9305-620ef2e878bd-kube-api-access-p9hgn\") pod \"kube-state-metrics-0\" (UID: \"42e40835-5700-459b-9305-620ef2e878bd\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:45:02 crc kubenswrapper[5120]: I0316 16:45:02.703416 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p9hgn\" (UniqueName: \"kubernetes.io/projected/42e40835-5700-459b-9305-620ef2e878bd-kube-api-access-p9hgn\") pod \"kube-state-metrics-0\" (UID: \"42e40835-5700-459b-9305-620ef2e878bd\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:45:02 crc kubenswrapper[5120]: I0316 16:45:02.716188 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 16:45:02 crc kubenswrapper[5120]: I0316 16:45:02.725470 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:45:02 crc kubenswrapper[5120]: I0316 16:45:02.727886 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovndbcluster-nb-config\"" Mar 16 16:45:02 crc kubenswrapper[5120]: I0316 16:45:02.727994 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovndbcluster-nb-scripts\"" Mar 16 16:45:02 crc kubenswrapper[5120]: I0316 16:45:02.732796 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ovncluster-ovndbcluster-nb-dockercfg-6n6ct\"" Mar 16 16:45:02 crc kubenswrapper[5120]: I0316 16:45:02.734299 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 16:45:02 crc kubenswrapper[5120]: I0316 16:45:02.799230 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9hgn\" (UniqueName: \"kubernetes.io/projected/42e40835-5700-459b-9305-620ef2e878bd-kube-api-access-p9hgn\") pod \"kube-state-metrics-0\" (UID: \"42e40835-5700-459b-9305-620ef2e878bd\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:45:02 crc kubenswrapper[5120]: I0316 16:45:02.805273 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") pod \"ovsdbserver-nb-0\" (UID: \"1ea30b51-1d30-4a53-834a-264069b9566e\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:45:02 crc kubenswrapper[5120]: I0316 16:45:02.805316 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1ea30b51-1d30-4a53-834a-264069b9566e-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"1ea30b51-1d30-4a53-834a-264069b9566e\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:45:02 crc kubenswrapper[5120]: I0316 16:45:02.805367 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1ea30b51-1d30-4a53-834a-264069b9566e-config\") pod \"ovsdbserver-nb-0\" (UID: \"1ea30b51-1d30-4a53-834a-264069b9566e\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:45:02 crc kubenswrapper[5120]: I0316 16:45:02.805388 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/1ea30b51-1d30-4a53-834a-264069b9566e-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"1ea30b51-1d30-4a53-834a-264069b9566e\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:45:02 crc kubenswrapper[5120]: I0316 16:45:02.805648 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/1ea30b51-1d30-4a53-834a-264069b9566e-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"1ea30b51-1d30-4a53-834a-264069b9566e\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:45:02 crc kubenswrapper[5120]: I0316 16:45:02.805853 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpr8m\" (UniqueName: \"kubernetes.io/projected/1ea30b51-1d30-4a53-834a-264069b9566e-kube-api-access-wpr8m\") pod \"ovsdbserver-nb-0\" (UID: \"1ea30b51-1d30-4a53-834a-264069b9566e\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:45:02 crc kubenswrapper[5120]: I0316 16:45:02.827867 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 16:45:02 crc kubenswrapper[5120]: I0316 16:45:02.837834 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:45:02 crc kubenswrapper[5120]: I0316 16:45:02.840790 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 16:45:02 crc kubenswrapper[5120]: I0316 16:45:02.841205 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"galera-openstack-cell1-dockercfg-hwhs2\"" Mar 16 16:45:02 crc kubenswrapper[5120]: I0316 16:45:02.841648 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-cell1-config-data\"" Mar 16 16:45:02 crc kubenswrapper[5120]: I0316 16:45:02.841856 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-cell1-scripts\"" Mar 16 16:45:02 crc kubenswrapper[5120]: I0316 16:45:02.844421 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-galera-openstack-cell1-svc\"" Mar 16 16:45:02 crc kubenswrapper[5120]: W0316 16:45:02.849530 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod02bf1e48_defb_443a_98b5_9eed2dc9947c.slice/crio-64fd0e6048b16f89edb0f228c40532f4d93cf948d7c852bec53795e3affc6b31 WatchSource:0}: Error finding container 64fd0e6048b16f89edb0f228c40532f4d93cf948d7c852bec53795e3affc6b31: Status 404 returned error can't find the container with id 64fd0e6048b16f89edb0f228c40532f4d93cf948d7c852bec53795e3affc6b31 Mar 16 16:45:02 crc kubenswrapper[5120]: I0316 16:45:02.849865 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 16:45:02 crc kubenswrapper[5120]: I0316 16:45:02.897024 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"02bf1e48-defb-443a-98b5-9eed2dc9947c","Type":"ContainerStarted","Data":"64fd0e6048b16f89edb0f228c40532f4d93cf948d7c852bec53795e3affc6b31"} Mar 16 16:45:02 crc kubenswrapper[5120]: I0316 16:45:02.902257 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"359ce032-c698-43d8-a7eb-011091fe9a3d","Type":"ContainerStarted","Data":"60d6fa98b9b4949ed2cd960e5c015662986f8113964a21aacc5d89bd38f32581"} Mar 16 16:45:02 crc kubenswrapper[5120]: I0316 16:45:02.902307 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"359ce032-c698-43d8-a7eb-011091fe9a3d","Type":"ContainerStarted","Data":"c66bb1ea3aba4a291cd32d3b92ff9acae01761acb99e048a15a16d9f61b236ce"} Mar 16 16:45:02 crc kubenswrapper[5120]: I0316 16:45:02.908122 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") pod \"ovsdbserver-nb-0\" (UID: \"1ea30b51-1d30-4a53-834a-264069b9566e\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:45:02 crc kubenswrapper[5120]: I0316 16:45:02.908587 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1ea30b51-1d30-4a53-834a-264069b9566e-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"1ea30b51-1d30-4a53-834a-264069b9566e\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:45:02 crc kubenswrapper[5120]: I0316 16:45:02.908678 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1ea30b51-1d30-4a53-834a-264069b9566e-config\") pod \"ovsdbserver-nb-0\" (UID: \"1ea30b51-1d30-4a53-834a-264069b9566e\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:45:02 crc kubenswrapper[5120]: I0316 16:45:02.908718 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/1ea30b51-1d30-4a53-834a-264069b9566e-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"1ea30b51-1d30-4a53-834a-264069b9566e\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:45:02 crc kubenswrapper[5120]: I0316 16:45:02.908954 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/1ea30b51-1d30-4a53-834a-264069b9566e-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"1ea30b51-1d30-4a53-834a-264069b9566e\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:45:02 crc kubenswrapper[5120]: I0316 16:45:02.909121 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wpr8m\" (UniqueName: \"kubernetes.io/projected/1ea30b51-1d30-4a53-834a-264069b9566e-kube-api-access-wpr8m\") pod \"ovsdbserver-nb-0\" (UID: \"1ea30b51-1d30-4a53-834a-264069b9566e\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:45:02 crc kubenswrapper[5120]: I0316 16:45:02.909960 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") pod \"ovsdbserver-nb-0\" (UID: \"1ea30b51-1d30-4a53-834a-264069b9566e\") device mount path \"/mnt/openstack/pv17\"" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:45:02 crc kubenswrapper[5120]: I0316 16:45:02.919130 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/1ea30b51-1d30-4a53-834a-264069b9566e-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"1ea30b51-1d30-4a53-834a-264069b9566e\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:45:02 crc kubenswrapper[5120]: I0316 16:45:02.920708 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1ea30b51-1d30-4a53-834a-264069b9566e-config\") pod \"ovsdbserver-nb-0\" (UID: \"1ea30b51-1d30-4a53-834a-264069b9566e\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:45:02 crc kubenswrapper[5120]: I0316 16:45:02.920932 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/1ea30b51-1d30-4a53-834a-264069b9566e-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"1ea30b51-1d30-4a53-834a-264069b9566e\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:45:02 crc kubenswrapper[5120]: I0316 16:45:02.930284 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpr8m\" (UniqueName: \"kubernetes.io/projected/1ea30b51-1d30-4a53-834a-264069b9566e-kube-api-access-wpr8m\") pod \"ovsdbserver-nb-0\" (UID: \"1ea30b51-1d30-4a53-834a-264069b9566e\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:45:02 crc kubenswrapper[5120]: I0316 16:45:02.935982 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:45:03 crc kubenswrapper[5120]: I0316 16:45:03.006366 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1ea30b51-1d30-4a53-834a-264069b9566e-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"1ea30b51-1d30-4a53-834a-264069b9566e\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:45:03 crc kubenswrapper[5120]: I0316 16:45:03.012615 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/30517467-b630-4ca2-815c-460999b6539a-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"30517467-b630-4ca2-815c-460999b6539a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:45:03 crc kubenswrapper[5120]: I0316 16:45:03.012713 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/30517467-b630-4ca2-815c-460999b6539a-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"30517467-b630-4ca2-815c-460999b6539a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:45:03 crc kubenswrapper[5120]: I0316 16:45:03.012798 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/30517467-b630-4ca2-815c-460999b6539a-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"30517467-b630-4ca2-815c-460999b6539a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:45:03 crc kubenswrapper[5120]: I0316 16:45:03.012847 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/30517467-b630-4ca2-815c-460999b6539a-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"30517467-b630-4ca2-815c-460999b6539a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:45:03 crc kubenswrapper[5120]: I0316 16:45:03.012973 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") pod \"openstack-cell1-galera-0\" (UID: \"30517467-b630-4ca2-815c-460999b6539a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:45:03 crc kubenswrapper[5120]: I0316 16:45:03.015222 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/30517467-b630-4ca2-815c-460999b6539a-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"30517467-b630-4ca2-815c-460999b6539a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:45:03 crc kubenswrapper[5120]: I0316 16:45:03.015499 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzvzn\" (UniqueName: \"kubernetes.io/projected/30517467-b630-4ca2-815c-460999b6539a-kube-api-access-tzvzn\") pod \"openstack-cell1-galera-0\" (UID: \"30517467-b630-4ca2-815c-460999b6539a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:45:03 crc kubenswrapper[5120]: I0316 16:45:03.015587 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/30517467-b630-4ca2-815c-460999b6539a-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"30517467-b630-4ca2-815c-460999b6539a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:45:03 crc kubenswrapper[5120]: I0316 16:45:03.044030 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") pod \"ovsdbserver-nb-0\" (UID: \"1ea30b51-1d30-4a53-834a-264069b9566e\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:45:03 crc kubenswrapper[5120]: I0316 16:45:03.051103 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:45:03 crc kubenswrapper[5120]: I0316 16:45:03.125988 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/30517467-b630-4ca2-815c-460999b6539a-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"30517467-b630-4ca2-815c-460999b6539a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:45:03 crc kubenswrapper[5120]: I0316 16:45:03.126045 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/30517467-b630-4ca2-815c-460999b6539a-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"30517467-b630-4ca2-815c-460999b6539a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:45:03 crc kubenswrapper[5120]: I0316 16:45:03.126072 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/30517467-b630-4ca2-815c-460999b6539a-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"30517467-b630-4ca2-815c-460999b6539a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:45:03 crc kubenswrapper[5120]: I0316 16:45:03.126099 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/30517467-b630-4ca2-815c-460999b6539a-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"30517467-b630-4ca2-815c-460999b6539a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:45:03 crc kubenswrapper[5120]: I0316 16:45:03.126164 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") pod \"openstack-cell1-galera-0\" (UID: \"30517467-b630-4ca2-815c-460999b6539a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:45:03 crc kubenswrapper[5120]: I0316 16:45:03.126272 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/30517467-b630-4ca2-815c-460999b6539a-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"30517467-b630-4ca2-815c-460999b6539a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:45:03 crc kubenswrapper[5120]: I0316 16:45:03.126329 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tzvzn\" (UniqueName: \"kubernetes.io/projected/30517467-b630-4ca2-815c-460999b6539a-kube-api-access-tzvzn\") pod \"openstack-cell1-galera-0\" (UID: \"30517467-b630-4ca2-815c-460999b6539a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:45:03 crc kubenswrapper[5120]: I0316 16:45:03.126372 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/30517467-b630-4ca2-815c-460999b6539a-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"30517467-b630-4ca2-815c-460999b6539a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:45:03 crc kubenswrapper[5120]: I0316 16:45:03.129309 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/30517467-b630-4ca2-815c-460999b6539a-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"30517467-b630-4ca2-815c-460999b6539a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:45:03 crc kubenswrapper[5120]: I0316 16:45:03.129561 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") pod \"openstack-cell1-galera-0\" (UID: \"30517467-b630-4ca2-815c-460999b6539a\") device mount path \"/mnt/openstack/pv14\"" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:45:03 crc kubenswrapper[5120]: I0316 16:45:03.131194 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/30517467-b630-4ca2-815c-460999b6539a-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"30517467-b630-4ca2-815c-460999b6539a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:45:03 crc kubenswrapper[5120]: I0316 16:45:03.133156 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/30517467-b630-4ca2-815c-460999b6539a-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"30517467-b630-4ca2-815c-460999b6539a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:45:03 crc kubenswrapper[5120]: I0316 16:45:03.133454 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/30517467-b630-4ca2-815c-460999b6539a-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"30517467-b630-4ca2-815c-460999b6539a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:45:03 crc kubenswrapper[5120]: I0316 16:45:03.133566 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/30517467-b630-4ca2-815c-460999b6539a-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"30517467-b630-4ca2-815c-460999b6539a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:45:03 crc kubenswrapper[5120]: I0316 16:45:03.135084 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/30517467-b630-4ca2-815c-460999b6539a-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"30517467-b630-4ca2-815c-460999b6539a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:45:03 crc kubenswrapper[5120]: I0316 16:45:03.159776 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzvzn\" (UniqueName: \"kubernetes.io/projected/30517467-b630-4ca2-815c-460999b6539a-kube-api-access-tzvzn\") pod \"openstack-cell1-galera-0\" (UID: \"30517467-b630-4ca2-815c-460999b6539a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:45:03 crc kubenswrapper[5120]: I0316 16:45:03.187132 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") pod \"openstack-cell1-galera-0\" (UID: \"30517467-b630-4ca2-815c-460999b6539a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:45:03 crc kubenswrapper[5120]: I0316 16:45:03.191306 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29561325-6tc9k" Mar 16 16:45:03 crc kubenswrapper[5120]: I0316 16:45:03.309038 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 16:45:03 crc kubenswrapper[5120]: I0316 16:45:03.317827 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe7dbce5-1133-445b-8a9c-05ced8fb138e" containerName="collect-profiles" Mar 16 16:45:03 crc kubenswrapper[5120]: I0316 16:45:03.317859 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe7dbce5-1133-445b-8a9c-05ced8fb138e" containerName="collect-profiles" Mar 16 16:45:03 crc kubenswrapper[5120]: I0316 16:45:03.318217 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="fe7dbce5-1133-445b-8a9c-05ced8fb138e" containerName="collect-profiles" Mar 16 16:45:03 crc kubenswrapper[5120]: I0316 16:45:03.325947 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:45:03 crc kubenswrapper[5120]: I0316 16:45:03.327289 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 16:45:03 crc kubenswrapper[5120]: I0316 16:45:03.329039 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovndbcluster-sb-config\"" Mar 16 16:45:03 crc kubenswrapper[5120]: I0316 16:45:03.329295 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovndbcluster-sb-scripts\"" Mar 16 16:45:03 crc kubenswrapper[5120]: I0316 16:45:03.329430 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ovncluster-ovndbcluster-sb-dockercfg-w4q4s\"" Mar 16 16:45:03 crc kubenswrapper[5120]: I0316 16:45:03.331750 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fe7dbce5-1133-445b-8a9c-05ced8fb138e-config-volume\") pod \"fe7dbce5-1133-445b-8a9c-05ced8fb138e\" (UID: \"fe7dbce5-1133-445b-8a9c-05ced8fb138e\") " Mar 16 16:45:03 crc kubenswrapper[5120]: I0316 16:45:03.331970 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/fe7dbce5-1133-445b-8a9c-05ced8fb138e-secret-volume\") pod \"fe7dbce5-1133-445b-8a9c-05ced8fb138e\" (UID: \"fe7dbce5-1133-445b-8a9c-05ced8fb138e\") " Mar 16 16:45:03 crc kubenswrapper[5120]: I0316 16:45:03.332912 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe7dbce5-1133-445b-8a9c-05ced8fb138e-config-volume" (OuterVolumeSpecName: "config-volume") pod "fe7dbce5-1133-445b-8a9c-05ced8fb138e" (UID: "fe7dbce5-1133-445b-8a9c-05ced8fb138e"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:45:03 crc kubenswrapper[5120]: I0316 16:45:03.333024 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7tcdn\" (UniqueName: \"kubernetes.io/projected/fe7dbce5-1133-445b-8a9c-05ced8fb138e-kube-api-access-7tcdn\") pod \"fe7dbce5-1133-445b-8a9c-05ced8fb138e\" (UID: \"fe7dbce5-1133-445b-8a9c-05ced8fb138e\") " Mar 16 16:45:03 crc kubenswrapper[5120]: I0316 16:45:03.334363 5120 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fe7dbce5-1133-445b-8a9c-05ced8fb138e-config-volume\") on node \"crc\" DevicePath \"\"" Mar 16 16:45:03 crc kubenswrapper[5120]: I0316 16:45:03.339752 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe7dbce5-1133-445b-8a9c-05ced8fb138e-kube-api-access-7tcdn" (OuterVolumeSpecName: "kube-api-access-7tcdn") pod "fe7dbce5-1133-445b-8a9c-05ced8fb138e" (UID: "fe7dbce5-1133-445b-8a9c-05ced8fb138e"). InnerVolumeSpecName "kube-api-access-7tcdn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:45:03 crc kubenswrapper[5120]: I0316 16:45:03.340542 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe7dbce5-1133-445b-8a9c-05ced8fb138e-secret-volume" (OuterVolumeSpecName: "secret-volume") pod "fe7dbce5-1133-445b-8a9c-05ced8fb138e" (UID: "fe7dbce5-1133-445b-8a9c-05ced8fb138e"). InnerVolumeSpecName "secret-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:45:03 crc kubenswrapper[5120]: I0316 16:45:03.407672 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:45:03 crc kubenswrapper[5120]: I0316 16:45:03.436345 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/d6803c98-d09b-4fbe-9fd6-b8b91ac81c77-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"d6803c98-d09b-4fbe-9fd6-b8b91ac81c77\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:45:03 crc kubenswrapper[5120]: I0316 16:45:03.436516 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/d6803c98-d09b-4fbe-9fd6-b8b91ac81c77-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"d6803c98-d09b-4fbe-9fd6-b8b91ac81c77\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:45:03 crc kubenswrapper[5120]: I0316 16:45:03.436592 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d6803c98-d09b-4fbe-9fd6-b8b91ac81c77-config\") pod \"ovsdbserver-sb-0\" (UID: \"d6803c98-d09b-4fbe-9fd6-b8b91ac81c77\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:45:03 crc kubenswrapper[5120]: I0316 16:45:03.436637 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d6803c98-d09b-4fbe-9fd6-b8b91ac81c77-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"d6803c98-d09b-4fbe-9fd6-b8b91ac81c77\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:45:03 crc kubenswrapper[5120]: I0316 16:45:03.436713 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbrpd\" (UniqueName: \"kubernetes.io/projected/d6803c98-d09b-4fbe-9fd6-b8b91ac81c77-kube-api-access-nbrpd\") pod \"ovsdbserver-sb-0\" (UID: \"d6803c98-d09b-4fbe-9fd6-b8b91ac81c77\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:45:03 crc kubenswrapper[5120]: I0316 16:45:03.436810 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"ovsdbserver-sb-0\" (UID: \"d6803c98-d09b-4fbe-9fd6-b8b91ac81c77\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:45:03 crc kubenswrapper[5120]: I0316 16:45:03.437043 5120 reconciler_common.go:299] "Volume detached for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/fe7dbce5-1133-445b-8a9c-05ced8fb138e-secret-volume\") on node \"crc\" DevicePath \"\"" Mar 16 16:45:03 crc kubenswrapper[5120]: I0316 16:45:03.437064 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7tcdn\" (UniqueName: \"kubernetes.io/projected/fe7dbce5-1133-445b-8a9c-05ced8fb138e-kube-api-access-7tcdn\") on node \"crc\" DevicePath \"\"" Mar 16 16:45:03 crc kubenswrapper[5120]: W0316 16:45:03.536869 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod42e40835_5700_459b_9305_620ef2e878bd.slice/crio-f731517b1564d31a06e54530141db771fe71f314638f0fffff9e3351f576c74a WatchSource:0}: Error finding container f731517b1564d31a06e54530141db771fe71f314638f0fffff9e3351f576c74a: Status 404 returned error can't find the container with id f731517b1564d31a06e54530141db771fe71f314638f0fffff9e3351f576c74a Mar 16 16:45:03 crc kubenswrapper[5120]: I0316 16:45:03.539216 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/d6803c98-d09b-4fbe-9fd6-b8b91ac81c77-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"d6803c98-d09b-4fbe-9fd6-b8b91ac81c77\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:45:03 crc kubenswrapper[5120]: I0316 16:45:03.539625 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/d6803c98-d09b-4fbe-9fd6-b8b91ac81c77-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"d6803c98-d09b-4fbe-9fd6-b8b91ac81c77\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:45:03 crc kubenswrapper[5120]: I0316 16:45:03.541050 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/d6803c98-d09b-4fbe-9fd6-b8b91ac81c77-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"d6803c98-d09b-4fbe-9fd6-b8b91ac81c77\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:45:03 crc kubenswrapper[5120]: I0316 16:45:03.541460 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d6803c98-d09b-4fbe-9fd6-b8b91ac81c77-config\") pod \"ovsdbserver-sb-0\" (UID: \"d6803c98-d09b-4fbe-9fd6-b8b91ac81c77\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:45:03 crc kubenswrapper[5120]: I0316 16:45:03.543053 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/d6803c98-d09b-4fbe-9fd6-b8b91ac81c77-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"d6803c98-d09b-4fbe-9fd6-b8b91ac81c77\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:45:03 crc kubenswrapper[5120]: I0316 16:45:03.544676 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d6803c98-d09b-4fbe-9fd6-b8b91ac81c77-config\") pod \"ovsdbserver-sb-0\" (UID: \"d6803c98-d09b-4fbe-9fd6-b8b91ac81c77\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:45:03 crc kubenswrapper[5120]: I0316 16:45:03.544879 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d6803c98-d09b-4fbe-9fd6-b8b91ac81c77-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"d6803c98-d09b-4fbe-9fd6-b8b91ac81c77\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:45:03 crc kubenswrapper[5120]: I0316 16:45:03.545159 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nbrpd\" (UniqueName: \"kubernetes.io/projected/d6803c98-d09b-4fbe-9fd6-b8b91ac81c77-kube-api-access-nbrpd\") pod \"ovsdbserver-sb-0\" (UID: \"d6803c98-d09b-4fbe-9fd6-b8b91ac81c77\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:45:03 crc kubenswrapper[5120]: I0316 16:45:03.545441 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"ovsdbserver-sb-0\" (UID: \"d6803c98-d09b-4fbe-9fd6-b8b91ac81c77\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:45:03 crc kubenswrapper[5120]: I0316 16:45:03.545978 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"ovsdbserver-sb-0\" (UID: \"d6803c98-d09b-4fbe-9fd6-b8b91ac81c77\") device mount path \"/mnt/openstack/pv06\"" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:45:03 crc kubenswrapper[5120]: I0316 16:45:03.551141 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 16:45:03 crc kubenswrapper[5120]: I0316 16:45:03.552399 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d6803c98-d09b-4fbe-9fd6-b8b91ac81c77-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"d6803c98-d09b-4fbe-9fd6-b8b91ac81c77\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:45:03 crc kubenswrapper[5120]: I0316 16:45:03.575062 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbrpd\" (UniqueName: \"kubernetes.io/projected/d6803c98-d09b-4fbe-9fd6-b8b91ac81c77-kube-api-access-nbrpd\") pod \"ovsdbserver-sb-0\" (UID: \"d6803c98-d09b-4fbe-9fd6-b8b91ac81c77\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:45:03 crc kubenswrapper[5120]: I0316 16:45:03.596949 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"ovsdbserver-sb-0\" (UID: \"d6803c98-d09b-4fbe-9fd6-b8b91ac81c77\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:45:03 crc kubenswrapper[5120]: I0316 16:45:03.649484 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 16:45:03 crc kubenswrapper[5120]: W0316 16:45:03.654875 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1ea30b51_1d30_4a53_834a_264069b9566e.slice/crio-8fa146db3a765f475db4c7b9e3096ed0b042379bd533be682b32263a2f81b4a7 WatchSource:0}: Error finding container 8fa146db3a765f475db4c7b9e3096ed0b042379bd533be682b32263a2f81b4a7: Status 404 returned error can't find the container with id 8fa146db3a765f475db4c7b9e3096ed0b042379bd533be682b32263a2f81b4a7 Mar 16 16:45:03 crc kubenswrapper[5120]: I0316 16:45:03.705264 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:45:03 crc kubenswrapper[5120]: I0316 16:45:03.879671 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 16:45:03 crc kubenswrapper[5120]: W0316 16:45:03.882622 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod30517467_b630_4ca2_815c_460999b6539a.slice/crio-74f7ea172491c5603192601f3d166c2f197e7d43c2489499ef3a5dd8f75b91c2 WatchSource:0}: Error finding container 74f7ea172491c5603192601f3d166c2f197e7d43c2489499ef3a5dd8f75b91c2: Status 404 returned error can't find the container with id 74f7ea172491c5603192601f3d166c2f197e7d43c2489499ef3a5dd8f75b91c2 Mar 16 16:45:03 crc kubenswrapper[5120]: I0316 16:45:03.912998 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"42e40835-5700-459b-9305-620ef2e878bd","Type":"ContainerStarted","Data":"f731517b1564d31a06e54530141db771fe71f314638f0fffff9e3351f576c74a"} Mar 16 16:45:03 crc kubenswrapper[5120]: I0316 16:45:03.926007 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"aa12529b-b6fe-4512-88ec-fd6250636e6b","Type":"ContainerStarted","Data":"f182e6699482e456fa658eb8a49ef764c4fb838a5601db8f345f511d180cfe9d"} Mar 16 16:45:03 crc kubenswrapper[5120]: I0316 16:45:03.928860 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"02bf1e48-defb-443a-98b5-9eed2dc9947c","Type":"ContainerStarted","Data":"f692602c06cc74dc1226e987b63623cea4c756357514c56d959b07b5301a0298"} Mar 16 16:45:03 crc kubenswrapper[5120]: I0316 16:45:03.928938 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/memcached-0" Mar 16 16:45:03 crc kubenswrapper[5120]: I0316 16:45:03.930916 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"30517467-b630-4ca2-815c-460999b6539a","Type":"ContainerStarted","Data":"74f7ea172491c5603192601f3d166c2f197e7d43c2489499ef3a5dd8f75b91c2"} Mar 16 16:45:03 crc kubenswrapper[5120]: I0316 16:45:03.933004 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"1ea30b51-1d30-4a53-834a-264069b9566e","Type":"ContainerStarted","Data":"988cc78cd1a034b04ef4fe1c6b8c6446a3f4b4f920c30017e4f07d239fd47cf9"} Mar 16 16:45:03 crc kubenswrapper[5120]: I0316 16:45:03.933050 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"1ea30b51-1d30-4a53-834a-264069b9566e","Type":"ContainerStarted","Data":"8fa146db3a765f475db4c7b9e3096ed0b042379bd533be682b32263a2f81b4a7"} Mar 16 16:45:03 crc kubenswrapper[5120]: I0316 16:45:03.938281 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"07aa860b-bb17-4a36-bc23-549bfd1bdb5c","Type":"ContainerStarted","Data":"c884d9c9de37e1f61b04f7eb0e974e6a6a3ec2080b77e6a8aa54d6abdc051364"} Mar 16 16:45:03 crc kubenswrapper[5120]: I0316 16:45:03.941244 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29561325-6tc9k" Mar 16 16:45:03 crc kubenswrapper[5120]: I0316 16:45:03.941832 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/collect-profiles-29561325-6tc9k" event={"ID":"fe7dbce5-1133-445b-8a9c-05ced8fb138e","Type":"ContainerDied","Data":"1ee43c0d5afe79c48f45d39347f1eebe571e9cc8bd17d0e4656b3b1f0768f475"} Mar 16 16:45:03 crc kubenswrapper[5120]: I0316 16:45:03.941870 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1ee43c0d5afe79c48f45d39347f1eebe571e9cc8bd17d0e4656b3b1f0768f475" Mar 16 16:45:04 crc kubenswrapper[5120]: I0316 16:45:04.002788 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/memcached-0" podStartSLOduration=3.002741778 podStartE2EDuration="3.002741778s" podCreationTimestamp="2026-03-16 16:45:01 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:45:03.992215121 +0000 UTC m=+4406.146146778" watchObservedRunningTime="2026-03-16 16:45:04.002741778 +0000 UTC m=+4406.156673435" Mar 16 16:45:04 crc kubenswrapper[5120]: W0316 16:45:04.135446 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd6803c98_d09b_4fbe_9fd6_b8b91ac81c77.slice/crio-14e2177cfb5814ed4f0442e9a44b345c2cc01352225c1d8fa18b46f8a8f33ff7 WatchSource:0}: Error finding container 14e2177cfb5814ed4f0442e9a44b345c2cc01352225c1d8fa18b46f8a8f33ff7: Status 404 returned error can't find the container with id 14e2177cfb5814ed4f0442e9a44b345c2cc01352225c1d8fa18b46f8a8f33ff7 Mar 16 16:45:04 crc kubenswrapper[5120]: I0316 16:45:04.139005 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 16:45:04 crc kubenswrapper[5120]: I0316 16:45:04.279059 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29561280-pdw98"] Mar 16 16:45:04 crc kubenswrapper[5120]: I0316 16:45:04.285269 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29561280-pdw98"] Mar 16 16:45:04 crc kubenswrapper[5120]: I0316 16:45:04.811374 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="552c5ec7-fe70-4bc3-bd6f-b06e529244e8" path="/var/lib/kubelet/pods/552c5ec7-fe70-4bc3-bd6f-b06e529244e8/volumes" Mar 16 16:45:04 crc kubenswrapper[5120]: I0316 16:45:04.949533 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"d6803c98-d09b-4fbe-9fd6-b8b91ac81c77","Type":"ContainerStarted","Data":"f2a9e2812d2124684265fddf41aa8bbd158c31d431c3c4f1f41c3d41428a1d03"} Mar 16 16:45:04 crc kubenswrapper[5120]: I0316 16:45:04.949579 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"d6803c98-d09b-4fbe-9fd6-b8b91ac81c77","Type":"ContainerStarted","Data":"9e4c6ac619f9d44e6512347976721eb7f2ded5db301b59c7afe2d9148feca5f9"} Mar 16 16:45:04 crc kubenswrapper[5120]: I0316 16:45:04.949590 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"d6803c98-d09b-4fbe-9fd6-b8b91ac81c77","Type":"ContainerStarted","Data":"14e2177cfb5814ed4f0442e9a44b345c2cc01352225c1d8fa18b46f8a8f33ff7"} Mar 16 16:45:04 crc kubenswrapper[5120]: I0316 16:45:04.951158 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"30517467-b630-4ca2-815c-460999b6539a","Type":"ContainerStarted","Data":"11c1aefb15e5a5a9d7d8ce7e51a73870631244b296d1ab3b3a8e2cb53983324c"} Mar 16 16:45:04 crc kubenswrapper[5120]: I0316 16:45:04.953560 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"1ea30b51-1d30-4a53-834a-264069b9566e","Type":"ContainerStarted","Data":"003073661eb6e19b10f6cf567edeb936c2c742ac60be9015f1217bdf877de6c2"} Mar 16 16:45:04 crc kubenswrapper[5120]: I0316 16:45:04.970367 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podStartSLOduration=2.970348399 podStartE2EDuration="2.970348399s" podCreationTimestamp="2026-03-16 16:45:02 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:45:04.964448648 +0000 UTC m=+4407.118380305" watchObservedRunningTime="2026-03-16 16:45:04.970348399 +0000 UTC m=+4407.124280056" Mar 16 16:45:05 crc kubenswrapper[5120]: I0316 16:45:05.009451 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podStartSLOduration=4.009430693 podStartE2EDuration="4.009430693s" podCreationTimestamp="2026-03-16 16:45:01 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:45:05.001199759 +0000 UTC m=+4407.155131426" watchObservedRunningTime="2026-03-16 16:45:05.009430693 +0000 UTC m=+4407.163362350" Mar 16 16:45:05 crc kubenswrapper[5120]: I0316 16:45:05.971697 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"42e40835-5700-459b-9305-620ef2e878bd","Type":"ContainerStarted","Data":"698c9b4f317d85a2377119c53ce2796dc7e12e87855669823ca2d9866a9442f2"} Mar 16 16:45:05 crc kubenswrapper[5120]: I0316 16:45:05.972658 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:45:05 crc kubenswrapper[5120]: I0316 16:45:05.995494 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/kube-state-metrics-0" podStartSLOduration=2.550448787 podStartE2EDuration="3.995475466s" podCreationTimestamp="2026-03-16 16:45:02 +0000 UTC" firstStartedPulling="2026-03-16 16:45:03.538081907 +0000 UTC m=+4405.692013564" lastFinishedPulling="2026-03-16 16:45:04.983108576 +0000 UTC m=+4407.137040243" observedRunningTime="2026-03-16 16:45:05.994106709 +0000 UTC m=+4408.148038386" watchObservedRunningTime="2026-03-16 16:45:05.995475466 +0000 UTC m=+4408.149407123" Mar 16 16:45:06 crc kubenswrapper[5120]: I0316 16:45:06.051805 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:45:06 crc kubenswrapper[5120]: I0316 16:45:06.097525 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:45:06 crc kubenswrapper[5120]: I0316 16:45:06.705395 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:45:06 crc kubenswrapper[5120]: I0316 16:45:06.983397 5120 generic.go:358] "Generic (PLEG): container finished" podID="359ce032-c698-43d8-a7eb-011091fe9a3d" containerID="60d6fa98b9b4949ed2cd960e5c015662986f8113964a21aacc5d89bd38f32581" exitCode=0 Mar 16 16:45:06 crc kubenswrapper[5120]: I0316 16:45:06.983498 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"359ce032-c698-43d8-a7eb-011091fe9a3d","Type":"ContainerDied","Data":"60d6fa98b9b4949ed2cd960e5c015662986f8113964a21aacc5d89bd38f32581"} Mar 16 16:45:06 crc kubenswrapper[5120]: I0316 16:45:06.984063 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:45:07 crc kubenswrapper[5120]: E0316 16:45:07.774884 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1424538 actualBytes=10240 Mar 16 16:45:07 crc kubenswrapper[5120]: I0316 16:45:07.994212 5120 generic.go:358] "Generic (PLEG): container finished" podID="30517467-b630-4ca2-815c-460999b6539a" containerID="11c1aefb15e5a5a9d7d8ce7e51a73870631244b296d1ab3b3a8e2cb53983324c" exitCode=0 Mar 16 16:45:07 crc kubenswrapper[5120]: I0316 16:45:07.994288 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"30517467-b630-4ca2-815c-460999b6539a","Type":"ContainerDied","Data":"11c1aefb15e5a5a9d7d8ce7e51a73870631244b296d1ab3b3a8e2cb53983324c"} Mar 16 16:45:07 crc kubenswrapper[5120]: I0316 16:45:07.997803 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"359ce032-c698-43d8-a7eb-011091fe9a3d","Type":"ContainerStarted","Data":"a5caf3e8fdf3dd93a4bfbfe575eaae670bb5bbd6689dcc4b186bc986e9be8a55"} Mar 16 16:45:08 crc kubenswrapper[5120]: I0316 16:45:08.055594 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstack-galera-0" podStartSLOduration=8.055165696 podStartE2EDuration="8.055165696s" podCreationTimestamp="2026-03-16 16:45:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:45:08.048053443 +0000 UTC m=+4410.201985110" watchObservedRunningTime="2026-03-16 16:45:08.055165696 +0000 UTC m=+4410.209097353" Mar 16 16:45:08 crc kubenswrapper[5120]: I0316 16:45:08.706063 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:45:09 crc kubenswrapper[5120]: I0316 16:45:09.008070 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"30517467-b630-4ca2-815c-460999b6539a","Type":"ContainerStarted","Data":"b20277c633e0b78465cbdd8b3094afe9e4fc50b2aa342ab3382ce2a06551927f"} Mar 16 16:45:09 crc kubenswrapper[5120]: I0316 16:45:09.034895 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstack-cell1-galera-0" podStartSLOduration=8.034874838 podStartE2EDuration="8.034874838s" podCreationTimestamp="2026-03-16 16:45:01 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:45:09.026474189 +0000 UTC m=+4411.180405866" watchObservedRunningTime="2026-03-16 16:45:09.034874838 +0000 UTC m=+4411.188806495" Mar 16 16:45:09 crc kubenswrapper[5120]: E0316 16:45:09.262169 5120 upgradeaware.go:441] Error proxying data from backend to client: writeto tcp 38.102.83.119:52730->38.102.83.119:44311: read tcp 38.102.83.119:52730->38.102.83.119:44311: read: connection reset by peer Mar 16 16:45:09 crc kubenswrapper[5120]: I0316 16:45:09.740819 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:45:09 crc kubenswrapper[5120]: I0316 16:45:09.778406 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:45:09 crc kubenswrapper[5120]: I0316 16:45:09.958325 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/memcached-0" Mar 16 16:45:11 crc kubenswrapper[5120]: I0316 16:45:11.464626 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:45:11 crc kubenswrapper[5120]: I0316 16:45:11.464704 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:45:11 crc kubenswrapper[5120]: I0316 16:45:11.755286 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:45:12 crc kubenswrapper[5120]: I0316 16:45:12.110306 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:45:13 crc kubenswrapper[5120]: I0316 16:45:13.039669 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:45:13 crc kubenswrapper[5120]: I0316 16:45:13.164446 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 16:45:13 crc kubenswrapper[5120]: I0316 16:45:13.170660 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:45:13 crc kubenswrapper[5120]: I0316 16:45:13.173629 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovnnorthd-config\"" Mar 16 16:45:13 crc kubenswrapper[5120]: I0316 16:45:13.174066 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ovnnorthd-ovnnorthd-dockercfg-gxfx7\"" Mar 16 16:45:13 crc kubenswrapper[5120]: I0316 16:45:13.177901 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovnnorthd-scripts\"" Mar 16 16:45:13 crc kubenswrapper[5120]: I0316 16:45:13.208531 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 16:45:13 crc kubenswrapper[5120]: I0316 16:45:13.276624 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/9d4a3a13-20de-450c-b14b-9f148b93bdcc-scripts\") pod \"ovn-northd-0\" (UID: \"9d4a3a13-20de-450c-b14b-9f148b93bdcc\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:45:13 crc kubenswrapper[5120]: I0316 16:45:13.276826 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9d4a3a13-20de-450c-b14b-9f148b93bdcc-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"9d4a3a13-20de-450c-b14b-9f148b93bdcc\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:45:13 crc kubenswrapper[5120]: I0316 16:45:13.277006 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9d4a3a13-20de-450c-b14b-9f148b93bdcc-config\") pod \"ovn-northd-0\" (UID: \"9d4a3a13-20de-450c-b14b-9f148b93bdcc\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:45:13 crc kubenswrapper[5120]: I0316 16:45:13.277048 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czwcw\" (UniqueName: \"kubernetes.io/projected/9d4a3a13-20de-450c-b14b-9f148b93bdcc-kube-api-access-czwcw\") pod \"ovn-northd-0\" (UID: \"9d4a3a13-20de-450c-b14b-9f148b93bdcc\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:45:13 crc kubenswrapper[5120]: I0316 16:45:13.277157 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/9d4a3a13-20de-450c-b14b-9f148b93bdcc-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"9d4a3a13-20de-450c-b14b-9f148b93bdcc\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:45:13 crc kubenswrapper[5120]: I0316 16:45:13.378620 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/9d4a3a13-20de-450c-b14b-9f148b93bdcc-scripts\") pod \"ovn-northd-0\" (UID: \"9d4a3a13-20de-450c-b14b-9f148b93bdcc\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:45:13 crc kubenswrapper[5120]: I0316 16:45:13.379339 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9d4a3a13-20de-450c-b14b-9f148b93bdcc-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"9d4a3a13-20de-450c-b14b-9f148b93bdcc\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:45:13 crc kubenswrapper[5120]: I0316 16:45:13.379444 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9d4a3a13-20de-450c-b14b-9f148b93bdcc-config\") pod \"ovn-northd-0\" (UID: \"9d4a3a13-20de-450c-b14b-9f148b93bdcc\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:45:13 crc kubenswrapper[5120]: I0316 16:45:13.379469 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-czwcw\" (UniqueName: \"kubernetes.io/projected/9d4a3a13-20de-450c-b14b-9f148b93bdcc-kube-api-access-czwcw\") pod \"ovn-northd-0\" (UID: \"9d4a3a13-20de-450c-b14b-9f148b93bdcc\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:45:13 crc kubenswrapper[5120]: I0316 16:45:13.379527 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/9d4a3a13-20de-450c-b14b-9f148b93bdcc-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"9d4a3a13-20de-450c-b14b-9f148b93bdcc\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:45:13 crc kubenswrapper[5120]: I0316 16:45:13.380123 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/9d4a3a13-20de-450c-b14b-9f148b93bdcc-scripts\") pod \"ovn-northd-0\" (UID: \"9d4a3a13-20de-450c-b14b-9f148b93bdcc\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:45:13 crc kubenswrapper[5120]: I0316 16:45:13.380217 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9d4a3a13-20de-450c-b14b-9f148b93bdcc-config\") pod \"ovn-northd-0\" (UID: \"9d4a3a13-20de-450c-b14b-9f148b93bdcc\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:45:13 crc kubenswrapper[5120]: I0316 16:45:13.380317 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/9d4a3a13-20de-450c-b14b-9f148b93bdcc-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"9d4a3a13-20de-450c-b14b-9f148b93bdcc\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:45:13 crc kubenswrapper[5120]: I0316 16:45:13.391580 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9d4a3a13-20de-450c-b14b-9f148b93bdcc-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"9d4a3a13-20de-450c-b14b-9f148b93bdcc\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:45:13 crc kubenswrapper[5120]: I0316 16:45:13.400222 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-czwcw\" (UniqueName: \"kubernetes.io/projected/9d4a3a13-20de-450c-b14b-9f148b93bdcc-kube-api-access-czwcw\") pod \"ovn-northd-0\" (UID: \"9d4a3a13-20de-450c-b14b-9f148b93bdcc\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:45:13 crc kubenswrapper[5120]: I0316 16:45:13.408398 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:45:13 crc kubenswrapper[5120]: I0316 16:45:13.408437 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:45:13 crc kubenswrapper[5120]: I0316 16:45:13.490172 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:45:13 crc kubenswrapper[5120]: I0316 16:45:13.498736 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:45:13 crc kubenswrapper[5120]: I0316 16:45:13.777431 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 16:45:13 crc kubenswrapper[5120]: I0316 16:45:13.800843 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:45:13 crc kubenswrapper[5120]: I0316 16:45:13.811314 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"swift-ring-files\"" Mar 16 16:45:13 crc kubenswrapper[5120]: I0316 16:45:13.811322 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"swift-swift-dockercfg-fdsnl\"" Mar 16 16:45:13 crc kubenswrapper[5120]: I0316 16:45:13.811433 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"swift-storage-config-data\"" Mar 16 16:45:13 crc kubenswrapper[5120]: I0316 16:45:13.811583 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"swift-conf\"" Mar 16 16:45:13 crc kubenswrapper[5120]: I0316 16:45:13.821848 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 16:45:13 crc kubenswrapper[5120]: I0316 16:45:13.891726 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/c3654d56-932f-4a2c-ae7d-c5aa896a3335-etc-swift\") pod \"swift-storage-0\" (UID: \"c3654d56-932f-4a2c-ae7d-c5aa896a3335\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:45:13 crc kubenswrapper[5120]: I0316 16:45:13.891829 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9pfq2\" (UniqueName: \"kubernetes.io/projected/c3654d56-932f-4a2c-ae7d-c5aa896a3335-kube-api-access-9pfq2\") pod \"swift-storage-0\" (UID: \"c3654d56-932f-4a2c-ae7d-c5aa896a3335\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:45:13 crc kubenswrapper[5120]: I0316 16:45:13.891852 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c3654d56-932f-4a2c-ae7d-c5aa896a3335-combined-ca-bundle\") pod \"swift-storage-0\" (UID: \"c3654d56-932f-4a2c-ae7d-c5aa896a3335\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:45:13 crc kubenswrapper[5120]: I0316 16:45:13.891898 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/c3654d56-932f-4a2c-ae7d-c5aa896a3335-cache\") pod \"swift-storage-0\" (UID: \"c3654d56-932f-4a2c-ae7d-c5aa896a3335\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:45:13 crc kubenswrapper[5120]: I0316 16:45:13.892121 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/c3654d56-932f-4a2c-ae7d-c5aa896a3335-lock\") pod \"swift-storage-0\" (UID: \"c3654d56-932f-4a2c-ae7d-c5aa896a3335\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:45:13 crc kubenswrapper[5120]: I0316 16:45:13.892208 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"swift-storage-0\" (UID: \"c3654d56-932f-4a2c-ae7d-c5aa896a3335\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:45:13 crc kubenswrapper[5120]: I0316 16:45:13.994220 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/c3654d56-932f-4a2c-ae7d-c5aa896a3335-etc-swift\") pod \"swift-storage-0\" (UID: \"c3654d56-932f-4a2c-ae7d-c5aa896a3335\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:45:13 crc kubenswrapper[5120]: I0316 16:45:13.994320 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9pfq2\" (UniqueName: \"kubernetes.io/projected/c3654d56-932f-4a2c-ae7d-c5aa896a3335-kube-api-access-9pfq2\") pod \"swift-storage-0\" (UID: \"c3654d56-932f-4a2c-ae7d-c5aa896a3335\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:45:13 crc kubenswrapper[5120]: I0316 16:45:13.994592 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c3654d56-932f-4a2c-ae7d-c5aa896a3335-combined-ca-bundle\") pod \"swift-storage-0\" (UID: \"c3654d56-932f-4a2c-ae7d-c5aa896a3335\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:45:13 crc kubenswrapper[5120]: I0316 16:45:13.994710 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/c3654d56-932f-4a2c-ae7d-c5aa896a3335-cache\") pod \"swift-storage-0\" (UID: \"c3654d56-932f-4a2c-ae7d-c5aa896a3335\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:45:13 crc kubenswrapper[5120]: I0316 16:45:13.994914 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/c3654d56-932f-4a2c-ae7d-c5aa896a3335-lock\") pod \"swift-storage-0\" (UID: \"c3654d56-932f-4a2c-ae7d-c5aa896a3335\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:45:13 crc kubenswrapper[5120]: I0316 16:45:13.994996 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"swift-storage-0\" (UID: \"c3654d56-932f-4a2c-ae7d-c5aa896a3335\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:45:13 crc kubenswrapper[5120]: I0316 16:45:13.995475 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/c3654d56-932f-4a2c-ae7d-c5aa896a3335-cache\") pod \"swift-storage-0\" (UID: \"c3654d56-932f-4a2c-ae7d-c5aa896a3335\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:45:13 crc kubenswrapper[5120]: E0316 16:45:13.994604 5120 projected.go:289] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Mar 16 16:45:13 crc kubenswrapper[5120]: E0316 16:45:13.995540 5120 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Mar 16 16:45:13 crc kubenswrapper[5120]: E0316 16:45:13.995602 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3654d56-932f-4a2c-ae7d-c5aa896a3335-etc-swift podName:c3654d56-932f-4a2c-ae7d-c5aa896a3335 nodeName:}" failed. No retries permitted until 2026-03-16 16:45:14.495580005 +0000 UTC m=+4416.649511662 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/c3654d56-932f-4a2c-ae7d-c5aa896a3335-etc-swift") pod "swift-storage-0" (UID: "c3654d56-932f-4a2c-ae7d-c5aa896a3335") : configmap "swift-ring-files" not found Mar 16 16:45:13 crc kubenswrapper[5120]: I0316 16:45:13.995627 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"swift-storage-0\" (UID: \"c3654d56-932f-4a2c-ae7d-c5aa896a3335\") device mount path \"/mnt/openstack/pv05\"" pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:45:13 crc kubenswrapper[5120]: I0316 16:45:13.996113 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/c3654d56-932f-4a2c-ae7d-c5aa896a3335-lock\") pod \"swift-storage-0\" (UID: \"c3654d56-932f-4a2c-ae7d-c5aa896a3335\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:45:14 crc kubenswrapper[5120]: I0316 16:45:14.001089 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 16:45:14 crc kubenswrapper[5120]: I0316 16:45:14.002654 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c3654d56-932f-4a2c-ae7d-c5aa896a3335-combined-ca-bundle\") pod \"swift-storage-0\" (UID: \"c3654d56-932f-4a2c-ae7d-c5aa896a3335\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:45:14 crc kubenswrapper[5120]: I0316 16:45:14.017251 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9pfq2\" (UniqueName: \"kubernetes.io/projected/c3654d56-932f-4a2c-ae7d-c5aa896a3335-kube-api-access-9pfq2\") pod \"swift-storage-0\" (UID: \"c3654d56-932f-4a2c-ae7d-c5aa896a3335\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:45:14 crc kubenswrapper[5120]: I0316 16:45:14.027048 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"swift-storage-0\" (UID: \"c3654d56-932f-4a2c-ae7d-c5aa896a3335\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:45:14 crc kubenswrapper[5120]: I0316 16:45:14.056861 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"9d4a3a13-20de-450c-b14b-9f148b93bdcc","Type":"ContainerStarted","Data":"0079f1a97399b68a8304112359e1c20a0d09ec511f566f90048b9075c44a2301"} Mar 16 16:45:14 crc kubenswrapper[5120]: I0316 16:45:14.162749 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:45:14 crc kubenswrapper[5120]: I0316 16:45:14.512970 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/c3654d56-932f-4a2c-ae7d-c5aa896a3335-etc-swift\") pod \"swift-storage-0\" (UID: \"c3654d56-932f-4a2c-ae7d-c5aa896a3335\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:45:14 crc kubenswrapper[5120]: E0316 16:45:14.513141 5120 projected.go:289] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Mar 16 16:45:14 crc kubenswrapper[5120]: E0316 16:45:14.513175 5120 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Mar 16 16:45:14 crc kubenswrapper[5120]: E0316 16:45:14.513250 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3654d56-932f-4a2c-ae7d-c5aa896a3335-etc-swift podName:c3654d56-932f-4a2c-ae7d-c5aa896a3335 nodeName:}" failed. No retries permitted until 2026-03-16 16:45:15.513229456 +0000 UTC m=+4417.667161113 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/c3654d56-932f-4a2c-ae7d-c5aa896a3335-etc-swift") pod "swift-storage-0" (UID: "c3654d56-932f-4a2c-ae7d-c5aa896a3335") : configmap "swift-ring-files" not found Mar 16 16:45:15 crc kubenswrapper[5120]: I0316 16:45:15.069741 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"9d4a3a13-20de-450c-b14b-9f148b93bdcc","Type":"ContainerStarted","Data":"7a82fe03a967791396cd15b59558158cfdbef68e46a52b16df2605a21ba6fbe2"} Mar 16 16:45:15 crc kubenswrapper[5120]: I0316 16:45:15.069819 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"9d4a3a13-20de-450c-b14b-9f148b93bdcc","Type":"ContainerStarted","Data":"e4568b8c4c24477e088010519cc3fe4c88c7800a42f8be6e09c85136ea3ec934"} Mar 16 16:45:15 crc kubenswrapper[5120]: I0316 16:45:15.093419 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovn-northd-0" podStartSLOduration=2.093399109 podStartE2EDuration="2.093399109s" podCreationTimestamp="2026-03-16 16:45:13 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:45:15.0908566 +0000 UTC m=+4417.244788257" watchObservedRunningTime="2026-03-16 16:45:15.093399109 +0000 UTC m=+4417.247330766" Mar 16 16:45:15 crc kubenswrapper[5120]: I0316 16:45:15.532804 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/c3654d56-932f-4a2c-ae7d-c5aa896a3335-etc-swift\") pod \"swift-storage-0\" (UID: \"c3654d56-932f-4a2c-ae7d-c5aa896a3335\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:45:15 crc kubenswrapper[5120]: E0316 16:45:15.533060 5120 projected.go:289] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Mar 16 16:45:15 crc kubenswrapper[5120]: E0316 16:45:15.533089 5120 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Mar 16 16:45:15 crc kubenswrapper[5120]: E0316 16:45:15.533154 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3654d56-932f-4a2c-ae7d-c5aa896a3335-etc-swift podName:c3654d56-932f-4a2c-ae7d-c5aa896a3335 nodeName:}" failed. No retries permitted until 2026-03-16 16:45:17.533135891 +0000 UTC m=+4419.687067548 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/c3654d56-932f-4a2c-ae7d-c5aa896a3335-etc-swift") pod "swift-storage-0" (UID: "c3654d56-932f-4a2c-ae7d-c5aa896a3335") : configmap "swift-ring-files" not found Mar 16 16:45:15 crc kubenswrapper[5120]: I0316 16:45:15.663899 5120 scope.go:117] "RemoveContainer" containerID="35a7dd6e19084cee69ca16203bca6378ea0cdf6a685ca2093ab847e5904eb9e6" Mar 16 16:45:15 crc kubenswrapper[5120]: E0316 16:45:15.664229 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:45:16 crc kubenswrapper[5120]: I0316 16:45:16.077687 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:45:17 crc kubenswrapper[5120]: I0316 16:45:17.576996 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/c3654d56-932f-4a2c-ae7d-c5aa896a3335-etc-swift\") pod \"swift-storage-0\" (UID: \"c3654d56-932f-4a2c-ae7d-c5aa896a3335\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:45:17 crc kubenswrapper[5120]: E0316 16:45:17.577422 5120 projected.go:289] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Mar 16 16:45:17 crc kubenswrapper[5120]: E0316 16:45:17.577486 5120 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Mar 16 16:45:17 crc kubenswrapper[5120]: E0316 16:45:17.577632 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3654d56-932f-4a2c-ae7d-c5aa896a3335-etc-swift podName:c3654d56-932f-4a2c-ae7d-c5aa896a3335 nodeName:}" failed. No retries permitted until 2026-03-16 16:45:21.577590957 +0000 UTC m=+4423.731522644 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/c3654d56-932f-4a2c-ae7d-c5aa896a3335-etc-swift") pod "swift-storage-0" (UID: "c3654d56-932f-4a2c-ae7d-c5aa896a3335") : configmap "swift-ring-files" not found Mar 16 16:45:17 crc kubenswrapper[5120]: I0316 16:45:17.641729 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-brpdk"] Mar 16 16:45:17 crc kubenswrapper[5120]: I0316 16:45:17.652712 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-brpdk" Mar 16 16:45:17 crc kubenswrapper[5120]: I0316 16:45:17.655027 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"swift-ring-scripts\"" Mar 16 16:45:17 crc kubenswrapper[5120]: I0316 16:45:17.655802 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"swift-proxy-config-data\"" Mar 16 16:45:17 crc kubenswrapper[5120]: I0316 16:45:17.656087 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"swift-ring-config-data\"" Mar 16 16:45:17 crc kubenswrapper[5120]: I0316 16:45:17.659992 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-brpdk"] Mar 16 16:45:17 crc kubenswrapper[5120]: I0316 16:45:17.781771 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/4dc7fcb1-fcdc-40ec-9654-8cdc46e13e63-swiftconf\") pod \"swift-ring-rebalance-brpdk\" (UID: \"4dc7fcb1-fcdc-40ec-9654-8cdc46e13e63\") " pod="openstack-kuttl-tests/swift-ring-rebalance-brpdk" Mar 16 16:45:17 crc kubenswrapper[5120]: I0316 16:45:17.781853 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knmhb\" (UniqueName: \"kubernetes.io/projected/4dc7fcb1-fcdc-40ec-9654-8cdc46e13e63-kube-api-access-knmhb\") pod \"swift-ring-rebalance-brpdk\" (UID: \"4dc7fcb1-fcdc-40ec-9654-8cdc46e13e63\") " pod="openstack-kuttl-tests/swift-ring-rebalance-brpdk" Mar 16 16:45:17 crc kubenswrapper[5120]: I0316 16:45:17.781927 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/4dc7fcb1-fcdc-40ec-9654-8cdc46e13e63-dispersionconf\") pod \"swift-ring-rebalance-brpdk\" (UID: \"4dc7fcb1-fcdc-40ec-9654-8cdc46e13e63\") " pod="openstack-kuttl-tests/swift-ring-rebalance-brpdk" Mar 16 16:45:17 crc kubenswrapper[5120]: I0316 16:45:17.782307 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/4dc7fcb1-fcdc-40ec-9654-8cdc46e13e63-etc-swift\") pod \"swift-ring-rebalance-brpdk\" (UID: \"4dc7fcb1-fcdc-40ec-9654-8cdc46e13e63\") " pod="openstack-kuttl-tests/swift-ring-rebalance-brpdk" Mar 16 16:45:17 crc kubenswrapper[5120]: I0316 16:45:17.782534 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/4dc7fcb1-fcdc-40ec-9654-8cdc46e13e63-scripts\") pod \"swift-ring-rebalance-brpdk\" (UID: \"4dc7fcb1-fcdc-40ec-9654-8cdc46e13e63\") " pod="openstack-kuttl-tests/swift-ring-rebalance-brpdk" Mar 16 16:45:17 crc kubenswrapper[5120]: I0316 16:45:17.782672 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4dc7fcb1-fcdc-40ec-9654-8cdc46e13e63-combined-ca-bundle\") pod \"swift-ring-rebalance-brpdk\" (UID: \"4dc7fcb1-fcdc-40ec-9654-8cdc46e13e63\") " pod="openstack-kuttl-tests/swift-ring-rebalance-brpdk" Mar 16 16:45:17 crc kubenswrapper[5120]: I0316 16:45:17.782962 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/4dc7fcb1-fcdc-40ec-9654-8cdc46e13e63-ring-data-devices\") pod \"swift-ring-rebalance-brpdk\" (UID: \"4dc7fcb1-fcdc-40ec-9654-8cdc46e13e63\") " pod="openstack-kuttl-tests/swift-ring-rebalance-brpdk" Mar 16 16:45:17 crc kubenswrapper[5120]: I0316 16:45:17.884893 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/4dc7fcb1-fcdc-40ec-9654-8cdc46e13e63-etc-swift\") pod \"swift-ring-rebalance-brpdk\" (UID: \"4dc7fcb1-fcdc-40ec-9654-8cdc46e13e63\") " pod="openstack-kuttl-tests/swift-ring-rebalance-brpdk" Mar 16 16:45:17 crc kubenswrapper[5120]: I0316 16:45:17.885011 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/4dc7fcb1-fcdc-40ec-9654-8cdc46e13e63-scripts\") pod \"swift-ring-rebalance-brpdk\" (UID: \"4dc7fcb1-fcdc-40ec-9654-8cdc46e13e63\") " pod="openstack-kuttl-tests/swift-ring-rebalance-brpdk" Mar 16 16:45:17 crc kubenswrapper[5120]: I0316 16:45:17.885080 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4dc7fcb1-fcdc-40ec-9654-8cdc46e13e63-combined-ca-bundle\") pod \"swift-ring-rebalance-brpdk\" (UID: \"4dc7fcb1-fcdc-40ec-9654-8cdc46e13e63\") " pod="openstack-kuttl-tests/swift-ring-rebalance-brpdk" Mar 16 16:45:17 crc kubenswrapper[5120]: I0316 16:45:17.885165 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/4dc7fcb1-fcdc-40ec-9654-8cdc46e13e63-ring-data-devices\") pod \"swift-ring-rebalance-brpdk\" (UID: \"4dc7fcb1-fcdc-40ec-9654-8cdc46e13e63\") " pod="openstack-kuttl-tests/swift-ring-rebalance-brpdk" Mar 16 16:45:17 crc kubenswrapper[5120]: I0316 16:45:17.885212 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/4dc7fcb1-fcdc-40ec-9654-8cdc46e13e63-swiftconf\") pod \"swift-ring-rebalance-brpdk\" (UID: \"4dc7fcb1-fcdc-40ec-9654-8cdc46e13e63\") " pod="openstack-kuttl-tests/swift-ring-rebalance-brpdk" Mar 16 16:45:17 crc kubenswrapper[5120]: I0316 16:45:17.885311 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-knmhb\" (UniqueName: \"kubernetes.io/projected/4dc7fcb1-fcdc-40ec-9654-8cdc46e13e63-kube-api-access-knmhb\") pod \"swift-ring-rebalance-brpdk\" (UID: \"4dc7fcb1-fcdc-40ec-9654-8cdc46e13e63\") " pod="openstack-kuttl-tests/swift-ring-rebalance-brpdk" Mar 16 16:45:17 crc kubenswrapper[5120]: I0316 16:45:17.885480 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/4dc7fcb1-fcdc-40ec-9654-8cdc46e13e63-etc-swift\") pod \"swift-ring-rebalance-brpdk\" (UID: \"4dc7fcb1-fcdc-40ec-9654-8cdc46e13e63\") " pod="openstack-kuttl-tests/swift-ring-rebalance-brpdk" Mar 16 16:45:17 crc kubenswrapper[5120]: I0316 16:45:17.885813 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/4dc7fcb1-fcdc-40ec-9654-8cdc46e13e63-scripts\") pod \"swift-ring-rebalance-brpdk\" (UID: \"4dc7fcb1-fcdc-40ec-9654-8cdc46e13e63\") " pod="openstack-kuttl-tests/swift-ring-rebalance-brpdk" Mar 16 16:45:17 crc kubenswrapper[5120]: I0316 16:45:17.885876 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/4dc7fcb1-fcdc-40ec-9654-8cdc46e13e63-ring-data-devices\") pod \"swift-ring-rebalance-brpdk\" (UID: \"4dc7fcb1-fcdc-40ec-9654-8cdc46e13e63\") " pod="openstack-kuttl-tests/swift-ring-rebalance-brpdk" Mar 16 16:45:17 crc kubenswrapper[5120]: I0316 16:45:17.886483 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/4dc7fcb1-fcdc-40ec-9654-8cdc46e13e63-dispersionconf\") pod \"swift-ring-rebalance-brpdk\" (UID: \"4dc7fcb1-fcdc-40ec-9654-8cdc46e13e63\") " pod="openstack-kuttl-tests/swift-ring-rebalance-brpdk" Mar 16 16:45:17 crc kubenswrapper[5120]: I0316 16:45:17.891694 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/4dc7fcb1-fcdc-40ec-9654-8cdc46e13e63-swiftconf\") pod \"swift-ring-rebalance-brpdk\" (UID: \"4dc7fcb1-fcdc-40ec-9654-8cdc46e13e63\") " pod="openstack-kuttl-tests/swift-ring-rebalance-brpdk" Mar 16 16:45:17 crc kubenswrapper[5120]: I0316 16:45:17.893169 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/4dc7fcb1-fcdc-40ec-9654-8cdc46e13e63-dispersionconf\") pod \"swift-ring-rebalance-brpdk\" (UID: \"4dc7fcb1-fcdc-40ec-9654-8cdc46e13e63\") " pod="openstack-kuttl-tests/swift-ring-rebalance-brpdk" Mar 16 16:45:17 crc kubenswrapper[5120]: I0316 16:45:17.893644 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4dc7fcb1-fcdc-40ec-9654-8cdc46e13e63-combined-ca-bundle\") pod \"swift-ring-rebalance-brpdk\" (UID: \"4dc7fcb1-fcdc-40ec-9654-8cdc46e13e63\") " pod="openstack-kuttl-tests/swift-ring-rebalance-brpdk" Mar 16 16:45:17 crc kubenswrapper[5120]: I0316 16:45:17.904240 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-knmhb\" (UniqueName: \"kubernetes.io/projected/4dc7fcb1-fcdc-40ec-9654-8cdc46e13e63-kube-api-access-knmhb\") pod \"swift-ring-rebalance-brpdk\" (UID: \"4dc7fcb1-fcdc-40ec-9654-8cdc46e13e63\") " pod="openstack-kuttl-tests/swift-ring-rebalance-brpdk" Mar 16 16:45:17 crc kubenswrapper[5120]: I0316 16:45:17.980380 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-brpdk" Mar 16 16:45:18 crc kubenswrapper[5120]: I0316 16:45:18.001740 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:45:18 crc kubenswrapper[5120]: I0316 16:45:18.460535 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-brpdk"] Mar 16 16:45:19 crc kubenswrapper[5120]: I0316 16:45:19.109064 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-brpdk" event={"ID":"4dc7fcb1-fcdc-40ec-9654-8cdc46e13e63","Type":"ContainerStarted","Data":"81527ce47d56655c208352a5bd34dcd551faa271463f7acafa5ae8865ad6812f"} Mar 16 16:45:19 crc kubenswrapper[5120]: I0316 16:45:19.109403 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-brpdk" event={"ID":"4dc7fcb1-fcdc-40ec-9654-8cdc46e13e63","Type":"ContainerStarted","Data":"d18f37c5361633a4267f306a04c4d277d916afc12bfec151f8e8a72b8472d7c9"} Mar 16 16:45:19 crc kubenswrapper[5120]: I0316 16:45:19.128416 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/swift-ring-rebalance-brpdk" podStartSLOduration=2.128392983 podStartE2EDuration="2.128392983s" podCreationTimestamp="2026-03-16 16:45:17 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:45:19.122138434 +0000 UTC m=+4421.276070091" watchObservedRunningTime="2026-03-16 16:45:19.128392983 +0000 UTC m=+4421.282324640" Mar 16 16:45:20 crc kubenswrapper[5120]: I0316 16:45:20.069100 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/root-account-create-update-cxcdx"] Mar 16 16:45:20 crc kubenswrapper[5120]: I0316 16:45:20.078287 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-cxcdx" Mar 16 16:45:20 crc kubenswrapper[5120]: I0316 16:45:20.079001 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-cxcdx"] Mar 16 16:45:20 crc kubenswrapper[5120]: I0316 16:45:20.080839 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"openstack-mariadb-root-db-secret\"" Mar 16 16:45:20 crc kubenswrapper[5120]: I0316 16:45:20.160675 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/community-operators-fzs4g"] Mar 16 16:45:20 crc kubenswrapper[5120]: I0316 16:45:20.167661 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-db-create-r8jd4"] Mar 16 16:45:20 crc kubenswrapper[5120]: I0316 16:45:20.168023 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-fzs4g" Mar 16 16:45:20 crc kubenswrapper[5120]: I0316 16:45:20.174010 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9f918385-0755-4179-ab66-342d9bbbadd0-operator-scripts\") pod \"root-account-create-update-cxcdx\" (UID: \"9f918385-0755-4179-ab66-342d9bbbadd0\") " pod="openstack-kuttl-tests/root-account-create-update-cxcdx" Mar 16 16:45:20 crc kubenswrapper[5120]: I0316 16:45:20.174303 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vkfs\" (UniqueName: \"kubernetes.io/projected/9f918385-0755-4179-ab66-342d9bbbadd0-kube-api-access-8vkfs\") pod \"root-account-create-update-cxcdx\" (UID: \"9f918385-0755-4179-ab66-342d9bbbadd0\") " pod="openstack-kuttl-tests/root-account-create-update-cxcdx" Mar 16 16:45:20 crc kubenswrapper[5120]: I0316 16:45:20.174487 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-create-r8jd4" Mar 16 16:45:20 crc kubenswrapper[5120]: I0316 16:45:20.175108 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/community-operators-fzs4g"] Mar 16 16:45:20 crc kubenswrapper[5120]: I0316 16:45:20.185250 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-db-create-r8jd4"] Mar 16 16:45:20 crc kubenswrapper[5120]: I0316 16:45:20.264179 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-2845-account-create-update-9n4l2"] Mar 16 16:45:20 crc kubenswrapper[5120]: I0316 16:45:20.272032 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-2845-account-create-update-9n4l2" Mar 16 16:45:20 crc kubenswrapper[5120]: I0316 16:45:20.273646 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-2845-account-create-update-9n4l2"] Mar 16 16:45:20 crc kubenswrapper[5120]: I0316 16:45:20.286101 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/652479c2-1cd4-4b7a-99d1-63e3538b2aeb-utilities\") pod \"community-operators-fzs4g\" (UID: \"652479c2-1cd4-4b7a-99d1-63e3538b2aeb\") " pod="openshift-marketplace/community-operators-fzs4g" Mar 16 16:45:20 crc kubenswrapper[5120]: I0316 16:45:20.286123 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-db-secret\"" Mar 16 16:45:20 crc kubenswrapper[5120]: I0316 16:45:20.286141 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/652479c2-1cd4-4b7a-99d1-63e3538b2aeb-catalog-content\") pod \"community-operators-fzs4g\" (UID: \"652479c2-1cd4-4b7a-99d1-63e3538b2aeb\") " pod="openshift-marketplace/community-operators-fzs4g" Mar 16 16:45:20 crc kubenswrapper[5120]: I0316 16:45:20.286204 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9b5d4194-8ea2-4088-b693-7417cdd004fb-operator-scripts\") pod \"glance-db-create-r8jd4\" (UID: \"9b5d4194-8ea2-4088-b693-7417cdd004fb\") " pod="openstack-kuttl-tests/glance-db-create-r8jd4" Mar 16 16:45:20 crc kubenswrapper[5120]: I0316 16:45:20.286337 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knbh8\" (UniqueName: \"kubernetes.io/projected/9b5d4194-8ea2-4088-b693-7417cdd004fb-kube-api-access-knbh8\") pod \"glance-db-create-r8jd4\" (UID: \"9b5d4194-8ea2-4088-b693-7417cdd004fb\") " pod="openstack-kuttl-tests/glance-db-create-r8jd4" Mar 16 16:45:20 crc kubenswrapper[5120]: I0316 16:45:20.286495 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8vkfs\" (UniqueName: \"kubernetes.io/projected/9f918385-0755-4179-ab66-342d9bbbadd0-kube-api-access-8vkfs\") pod \"root-account-create-update-cxcdx\" (UID: \"9f918385-0755-4179-ab66-342d9bbbadd0\") " pod="openstack-kuttl-tests/root-account-create-update-cxcdx" Mar 16 16:45:20 crc kubenswrapper[5120]: I0316 16:45:20.286731 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9f918385-0755-4179-ab66-342d9bbbadd0-operator-scripts\") pod \"root-account-create-update-cxcdx\" (UID: \"9f918385-0755-4179-ab66-342d9bbbadd0\") " pod="openstack-kuttl-tests/root-account-create-update-cxcdx" Mar 16 16:45:20 crc kubenswrapper[5120]: I0316 16:45:20.286931 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97dhm\" (UniqueName: \"kubernetes.io/projected/652479c2-1cd4-4b7a-99d1-63e3538b2aeb-kube-api-access-97dhm\") pod \"community-operators-fzs4g\" (UID: \"652479c2-1cd4-4b7a-99d1-63e3538b2aeb\") " pod="openshift-marketplace/community-operators-fzs4g" Mar 16 16:45:20 crc kubenswrapper[5120]: I0316 16:45:20.287387 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9f918385-0755-4179-ab66-342d9bbbadd0-operator-scripts\") pod \"root-account-create-update-cxcdx\" (UID: \"9f918385-0755-4179-ab66-342d9bbbadd0\") " pod="openstack-kuttl-tests/root-account-create-update-cxcdx" Mar 16 16:45:20 crc kubenswrapper[5120]: I0316 16:45:20.310722 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vkfs\" (UniqueName: \"kubernetes.io/projected/9f918385-0755-4179-ab66-342d9bbbadd0-kube-api-access-8vkfs\") pod \"root-account-create-update-cxcdx\" (UID: \"9f918385-0755-4179-ab66-342d9bbbadd0\") " pod="openstack-kuttl-tests/root-account-create-update-cxcdx" Mar 16 16:45:20 crc kubenswrapper[5120]: I0316 16:45:20.388388 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-knbh8\" (UniqueName: \"kubernetes.io/projected/9b5d4194-8ea2-4088-b693-7417cdd004fb-kube-api-access-knbh8\") pod \"glance-db-create-r8jd4\" (UID: \"9b5d4194-8ea2-4088-b693-7417cdd004fb\") " pod="openstack-kuttl-tests/glance-db-create-r8jd4" Mar 16 16:45:20 crc kubenswrapper[5120]: I0316 16:45:20.388537 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2cdd13b1-c1ed-48c4-8be5-c4689765fafb-operator-scripts\") pod \"glance-2845-account-create-update-9n4l2\" (UID: \"2cdd13b1-c1ed-48c4-8be5-c4689765fafb\") " pod="openstack-kuttl-tests/glance-2845-account-create-update-9n4l2" Mar 16 16:45:20 crc kubenswrapper[5120]: I0316 16:45:20.388605 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4lkmh\" (UniqueName: \"kubernetes.io/projected/2cdd13b1-c1ed-48c4-8be5-c4689765fafb-kube-api-access-4lkmh\") pod \"glance-2845-account-create-update-9n4l2\" (UID: \"2cdd13b1-c1ed-48c4-8be5-c4689765fafb\") " pod="openstack-kuttl-tests/glance-2845-account-create-update-9n4l2" Mar 16 16:45:20 crc kubenswrapper[5120]: I0316 16:45:20.388650 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-97dhm\" (UniqueName: \"kubernetes.io/projected/652479c2-1cd4-4b7a-99d1-63e3538b2aeb-kube-api-access-97dhm\") pod \"community-operators-fzs4g\" (UID: \"652479c2-1cd4-4b7a-99d1-63e3538b2aeb\") " pod="openshift-marketplace/community-operators-fzs4g" Mar 16 16:45:20 crc kubenswrapper[5120]: I0316 16:45:20.388711 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/652479c2-1cd4-4b7a-99d1-63e3538b2aeb-utilities\") pod \"community-operators-fzs4g\" (UID: \"652479c2-1cd4-4b7a-99d1-63e3538b2aeb\") " pod="openshift-marketplace/community-operators-fzs4g" Mar 16 16:45:20 crc kubenswrapper[5120]: I0316 16:45:20.388725 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/652479c2-1cd4-4b7a-99d1-63e3538b2aeb-catalog-content\") pod \"community-operators-fzs4g\" (UID: \"652479c2-1cd4-4b7a-99d1-63e3538b2aeb\") " pod="openshift-marketplace/community-operators-fzs4g" Mar 16 16:45:20 crc kubenswrapper[5120]: I0316 16:45:20.388767 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9b5d4194-8ea2-4088-b693-7417cdd004fb-operator-scripts\") pod \"glance-db-create-r8jd4\" (UID: \"9b5d4194-8ea2-4088-b693-7417cdd004fb\") " pod="openstack-kuttl-tests/glance-db-create-r8jd4" Mar 16 16:45:20 crc kubenswrapper[5120]: I0316 16:45:20.389468 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9b5d4194-8ea2-4088-b693-7417cdd004fb-operator-scripts\") pod \"glance-db-create-r8jd4\" (UID: \"9b5d4194-8ea2-4088-b693-7417cdd004fb\") " pod="openstack-kuttl-tests/glance-db-create-r8jd4" Mar 16 16:45:20 crc kubenswrapper[5120]: I0316 16:45:20.390236 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/652479c2-1cd4-4b7a-99d1-63e3538b2aeb-utilities\") pod \"community-operators-fzs4g\" (UID: \"652479c2-1cd4-4b7a-99d1-63e3538b2aeb\") " pod="openshift-marketplace/community-operators-fzs4g" Mar 16 16:45:20 crc kubenswrapper[5120]: I0316 16:45:20.390449 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/652479c2-1cd4-4b7a-99d1-63e3538b2aeb-catalog-content\") pod \"community-operators-fzs4g\" (UID: \"652479c2-1cd4-4b7a-99d1-63e3538b2aeb\") " pod="openshift-marketplace/community-operators-fzs4g" Mar 16 16:45:20 crc kubenswrapper[5120]: I0316 16:45:20.404374 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-cxcdx" Mar 16 16:45:20 crc kubenswrapper[5120]: I0316 16:45:20.411405 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-knbh8\" (UniqueName: \"kubernetes.io/projected/9b5d4194-8ea2-4088-b693-7417cdd004fb-kube-api-access-knbh8\") pod \"glance-db-create-r8jd4\" (UID: \"9b5d4194-8ea2-4088-b693-7417cdd004fb\") " pod="openstack-kuttl-tests/glance-db-create-r8jd4" Mar 16 16:45:20 crc kubenswrapper[5120]: I0316 16:45:20.411736 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-97dhm\" (UniqueName: \"kubernetes.io/projected/652479c2-1cd4-4b7a-99d1-63e3538b2aeb-kube-api-access-97dhm\") pod \"community-operators-fzs4g\" (UID: \"652479c2-1cd4-4b7a-99d1-63e3538b2aeb\") " pod="openshift-marketplace/community-operators-fzs4g" Mar 16 16:45:20 crc kubenswrapper[5120]: I0316 16:45:20.491100 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2cdd13b1-c1ed-48c4-8be5-c4689765fafb-operator-scripts\") pod \"glance-2845-account-create-update-9n4l2\" (UID: \"2cdd13b1-c1ed-48c4-8be5-c4689765fafb\") " pod="openstack-kuttl-tests/glance-2845-account-create-update-9n4l2" Mar 16 16:45:20 crc kubenswrapper[5120]: I0316 16:45:20.491346 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4lkmh\" (UniqueName: \"kubernetes.io/projected/2cdd13b1-c1ed-48c4-8be5-c4689765fafb-kube-api-access-4lkmh\") pod \"glance-2845-account-create-update-9n4l2\" (UID: \"2cdd13b1-c1ed-48c4-8be5-c4689765fafb\") " pod="openstack-kuttl-tests/glance-2845-account-create-update-9n4l2" Mar 16 16:45:20 crc kubenswrapper[5120]: I0316 16:45:20.491968 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2cdd13b1-c1ed-48c4-8be5-c4689765fafb-operator-scripts\") pod \"glance-2845-account-create-update-9n4l2\" (UID: \"2cdd13b1-c1ed-48c4-8be5-c4689765fafb\") " pod="openstack-kuttl-tests/glance-2845-account-create-update-9n4l2" Mar 16 16:45:20 crc kubenswrapper[5120]: I0316 16:45:20.495182 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-fzs4g" Mar 16 16:45:20 crc kubenswrapper[5120]: I0316 16:45:20.506565 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-create-r8jd4" Mar 16 16:45:20 crc kubenswrapper[5120]: I0316 16:45:20.529357 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4lkmh\" (UniqueName: \"kubernetes.io/projected/2cdd13b1-c1ed-48c4-8be5-c4689765fafb-kube-api-access-4lkmh\") pod \"glance-2845-account-create-update-9n4l2\" (UID: \"2cdd13b1-c1ed-48c4-8be5-c4689765fafb\") " pod="openstack-kuttl-tests/glance-2845-account-create-update-9n4l2" Mar 16 16:45:20 crc kubenswrapper[5120]: I0316 16:45:20.593051 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-2845-account-create-update-9n4l2" Mar 16 16:45:20 crc kubenswrapper[5120]: I0316 16:45:20.926870 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-cxcdx"] Mar 16 16:45:20 crc kubenswrapper[5120]: W0316 16:45:20.937619 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9f918385_0755_4179_ab66_342d9bbbadd0.slice/crio-4bb27f7fefcf838019ca4ed30020ebb41b12c3e80de99e6a3523f8da9170d9ef WatchSource:0}: Error finding container 4bb27f7fefcf838019ca4ed30020ebb41b12c3e80de99e6a3523f8da9170d9ef: Status 404 returned error can't find the container with id 4bb27f7fefcf838019ca4ed30020ebb41b12c3e80de99e6a3523f8da9170d9ef Mar 16 16:45:21 crc kubenswrapper[5120]: I0316 16:45:21.082587 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/community-operators-fzs4g"] Mar 16 16:45:21 crc kubenswrapper[5120]: W0316 16:45:21.085472 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod652479c2_1cd4_4b7a_99d1_63e3538b2aeb.slice/crio-f384ad93bc853f8b429ad07539c73de152caf603e28e4eeae4129d4e326f190d WatchSource:0}: Error finding container f384ad93bc853f8b429ad07539c73de152caf603e28e4eeae4129d4e326f190d: Status 404 returned error can't find the container with id f384ad93bc853f8b429ad07539c73de152caf603e28e4eeae4129d4e326f190d Mar 16 16:45:21 crc kubenswrapper[5120]: I0316 16:45:21.130983 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-fzs4g" event={"ID":"652479c2-1cd4-4b7a-99d1-63e3538b2aeb","Type":"ContainerStarted","Data":"f384ad93bc853f8b429ad07539c73de152caf603e28e4eeae4129d4e326f190d"} Mar 16 16:45:21 crc kubenswrapper[5120]: I0316 16:45:21.133247 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-cxcdx" event={"ID":"9f918385-0755-4179-ab66-342d9bbbadd0","Type":"ContainerStarted","Data":"1d73b9c9d778512c90fbbba6af4110c146eab5899bbf4e3cd6133df1fe84e7ca"} Mar 16 16:45:21 crc kubenswrapper[5120]: I0316 16:45:21.133295 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-cxcdx" event={"ID":"9f918385-0755-4179-ab66-342d9bbbadd0","Type":"ContainerStarted","Data":"4bb27f7fefcf838019ca4ed30020ebb41b12c3e80de99e6a3523f8da9170d9ef"} Mar 16 16:45:21 crc kubenswrapper[5120]: I0316 16:45:21.150996 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/root-account-create-update-cxcdx" podStartSLOduration=1.150981755 podStartE2EDuration="1.150981755s" podCreationTimestamp="2026-03-16 16:45:20 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:45:21.146265587 +0000 UTC m=+4423.300197244" watchObservedRunningTime="2026-03-16 16:45:21.150981755 +0000 UTC m=+4423.304913412" Mar 16 16:45:21 crc kubenswrapper[5120]: I0316 16:45:21.182744 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-db-create-r8jd4"] Mar 16 16:45:21 crc kubenswrapper[5120]: I0316 16:45:21.249992 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-2845-account-create-update-9n4l2"] Mar 16 16:45:21 crc kubenswrapper[5120]: W0316 16:45:21.250237 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2cdd13b1_c1ed_48c4_8be5_c4689765fafb.slice/crio-69c137b04472127f99ed01cc9dfae9a513c9b50f0367f0d4d2395d6f1ce37d51 WatchSource:0}: Error finding container 69c137b04472127f99ed01cc9dfae9a513c9b50f0367f0d4d2395d6f1ce37d51: Status 404 returned error can't find the container with id 69c137b04472127f99ed01cc9dfae9a513c9b50f0367f0d4d2395d6f1ce37d51 Mar 16 16:45:21 crc kubenswrapper[5120]: I0316 16:45:21.332033 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-db-create-jhvhm"] Mar 16 16:45:21 crc kubenswrapper[5120]: I0316 16:45:21.336749 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-create-jhvhm" Mar 16 16:45:21 crc kubenswrapper[5120]: I0316 16:45:21.359691 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-db-create-jhvhm"] Mar 16 16:45:21 crc kubenswrapper[5120]: I0316 16:45:21.418663 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9c3d1548-b3b4-4e52-9d2e-3e2939d2604d-operator-scripts\") pod \"keystone-db-create-jhvhm\" (UID: \"9c3d1548-b3b4-4e52-9d2e-3e2939d2604d\") " pod="openstack-kuttl-tests/keystone-db-create-jhvhm" Mar 16 16:45:21 crc kubenswrapper[5120]: I0316 16:45:21.418859 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9cpql\" (UniqueName: \"kubernetes.io/projected/9c3d1548-b3b4-4e52-9d2e-3e2939d2604d-kube-api-access-9cpql\") pod \"keystone-db-create-jhvhm\" (UID: \"9c3d1548-b3b4-4e52-9d2e-3e2939d2604d\") " pod="openstack-kuttl-tests/keystone-db-create-jhvhm" Mar 16 16:45:21 crc kubenswrapper[5120]: I0316 16:45:21.443377 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-ce7f-account-create-update-t2tvv"] Mar 16 16:45:21 crc kubenswrapper[5120]: I0316 16:45:21.448541 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-ce7f-account-create-update-t2tvv" Mar 16 16:45:21 crc kubenswrapper[5120]: I0316 16:45:21.450533 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-db-secret\"" Mar 16 16:45:21 crc kubenswrapper[5120]: I0316 16:45:21.450702 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-ce7f-account-create-update-t2tvv"] Mar 16 16:45:21 crc kubenswrapper[5120]: I0316 16:45:21.521481 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9cpql\" (UniqueName: \"kubernetes.io/projected/9c3d1548-b3b4-4e52-9d2e-3e2939d2604d-kube-api-access-9cpql\") pod \"keystone-db-create-jhvhm\" (UID: \"9c3d1548-b3b4-4e52-9d2e-3e2939d2604d\") " pod="openstack-kuttl-tests/keystone-db-create-jhvhm" Mar 16 16:45:21 crc kubenswrapper[5120]: I0316 16:45:21.521673 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pqql\" (UniqueName: \"kubernetes.io/projected/44595829-86f7-4eb9-b15d-a51f416a2b40-kube-api-access-5pqql\") pod \"keystone-ce7f-account-create-update-t2tvv\" (UID: \"44595829-86f7-4eb9-b15d-a51f416a2b40\") " pod="openstack-kuttl-tests/keystone-ce7f-account-create-update-t2tvv" Mar 16 16:45:21 crc kubenswrapper[5120]: I0316 16:45:21.521741 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/44595829-86f7-4eb9-b15d-a51f416a2b40-operator-scripts\") pod \"keystone-ce7f-account-create-update-t2tvv\" (UID: \"44595829-86f7-4eb9-b15d-a51f416a2b40\") " pod="openstack-kuttl-tests/keystone-ce7f-account-create-update-t2tvv" Mar 16 16:45:21 crc kubenswrapper[5120]: I0316 16:45:21.522124 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9c3d1548-b3b4-4e52-9d2e-3e2939d2604d-operator-scripts\") pod \"keystone-db-create-jhvhm\" (UID: \"9c3d1548-b3b4-4e52-9d2e-3e2939d2604d\") " pod="openstack-kuttl-tests/keystone-db-create-jhvhm" Mar 16 16:45:21 crc kubenswrapper[5120]: I0316 16:45:21.523027 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9c3d1548-b3b4-4e52-9d2e-3e2939d2604d-operator-scripts\") pod \"keystone-db-create-jhvhm\" (UID: \"9c3d1548-b3b4-4e52-9d2e-3e2939d2604d\") " pod="openstack-kuttl-tests/keystone-db-create-jhvhm" Mar 16 16:45:21 crc kubenswrapper[5120]: I0316 16:45:21.546782 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9cpql\" (UniqueName: \"kubernetes.io/projected/9c3d1548-b3b4-4e52-9d2e-3e2939d2604d-kube-api-access-9cpql\") pod \"keystone-db-create-jhvhm\" (UID: \"9c3d1548-b3b4-4e52-9d2e-3e2939d2604d\") " pod="openstack-kuttl-tests/keystone-db-create-jhvhm" Mar 16 16:45:21 crc kubenswrapper[5120]: I0316 16:45:21.623845 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/c3654d56-932f-4a2c-ae7d-c5aa896a3335-etc-swift\") pod \"swift-storage-0\" (UID: \"c3654d56-932f-4a2c-ae7d-c5aa896a3335\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:45:21 crc kubenswrapper[5120]: I0316 16:45:21.623986 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5pqql\" (UniqueName: \"kubernetes.io/projected/44595829-86f7-4eb9-b15d-a51f416a2b40-kube-api-access-5pqql\") pod \"keystone-ce7f-account-create-update-t2tvv\" (UID: \"44595829-86f7-4eb9-b15d-a51f416a2b40\") " pod="openstack-kuttl-tests/keystone-ce7f-account-create-update-t2tvv" Mar 16 16:45:21 crc kubenswrapper[5120]: I0316 16:45:21.624048 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/44595829-86f7-4eb9-b15d-a51f416a2b40-operator-scripts\") pod \"keystone-ce7f-account-create-update-t2tvv\" (UID: \"44595829-86f7-4eb9-b15d-a51f416a2b40\") " pod="openstack-kuttl-tests/keystone-ce7f-account-create-update-t2tvv" Mar 16 16:45:21 crc kubenswrapper[5120]: E0316 16:45:21.624577 5120 projected.go:289] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Mar 16 16:45:21 crc kubenswrapper[5120]: E0316 16:45:21.624597 5120 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Mar 16 16:45:21 crc kubenswrapper[5120]: E0316 16:45:21.624636 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3654d56-932f-4a2c-ae7d-c5aa896a3335-etc-swift podName:c3654d56-932f-4a2c-ae7d-c5aa896a3335 nodeName:}" failed. No retries permitted until 2026-03-16 16:45:29.624622929 +0000 UTC m=+4431.778554586 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/c3654d56-932f-4a2c-ae7d-c5aa896a3335-etc-swift") pod "swift-storage-0" (UID: "c3654d56-932f-4a2c-ae7d-c5aa896a3335") : configmap "swift-ring-files" not found Mar 16 16:45:21 crc kubenswrapper[5120]: I0316 16:45:21.625543 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/44595829-86f7-4eb9-b15d-a51f416a2b40-operator-scripts\") pod \"keystone-ce7f-account-create-update-t2tvv\" (UID: \"44595829-86f7-4eb9-b15d-a51f416a2b40\") " pod="openstack-kuttl-tests/keystone-ce7f-account-create-update-t2tvv" Mar 16 16:45:21 crc kubenswrapper[5120]: I0316 16:45:21.646481 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pqql\" (UniqueName: \"kubernetes.io/projected/44595829-86f7-4eb9-b15d-a51f416a2b40-kube-api-access-5pqql\") pod \"keystone-ce7f-account-create-update-t2tvv\" (UID: \"44595829-86f7-4eb9-b15d-a51f416a2b40\") " pod="openstack-kuttl-tests/keystone-ce7f-account-create-update-t2tvv" Mar 16 16:45:21 crc kubenswrapper[5120]: I0316 16:45:21.747581 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-db-create-fh7p4"] Mar 16 16:45:21 crc kubenswrapper[5120]: I0316 16:45:21.762636 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-create-fh7p4" Mar 16 16:45:21 crc kubenswrapper[5120]: I0316 16:45:21.763172 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-db-create-fh7p4"] Mar 16 16:45:21 crc kubenswrapper[5120]: I0316 16:45:21.774728 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-create-jhvhm" Mar 16 16:45:21 crc kubenswrapper[5120]: I0316 16:45:21.795523 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-ce7f-account-create-update-t2tvv" Mar 16 16:45:21 crc kubenswrapper[5120]: I0316 16:45:21.828509 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9gdf\" (UniqueName: \"kubernetes.io/projected/b40d62ac-8314-46a4-b602-531125454d07-kube-api-access-j9gdf\") pod \"placement-db-create-fh7p4\" (UID: \"b40d62ac-8314-46a4-b602-531125454d07\") " pod="openstack-kuttl-tests/placement-db-create-fh7p4" Mar 16 16:45:21 crc kubenswrapper[5120]: I0316 16:45:21.829439 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b40d62ac-8314-46a4-b602-531125454d07-operator-scripts\") pod \"placement-db-create-fh7p4\" (UID: \"b40d62ac-8314-46a4-b602-531125454d07\") " pod="openstack-kuttl-tests/placement-db-create-fh7p4" Mar 16 16:45:21 crc kubenswrapper[5120]: I0316 16:45:21.932366 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b40d62ac-8314-46a4-b602-531125454d07-operator-scripts\") pod \"placement-db-create-fh7p4\" (UID: \"b40d62ac-8314-46a4-b602-531125454d07\") " pod="openstack-kuttl-tests/placement-db-create-fh7p4" Mar 16 16:45:21 crc kubenswrapper[5120]: I0316 16:45:21.932816 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j9gdf\" (UniqueName: \"kubernetes.io/projected/b40d62ac-8314-46a4-b602-531125454d07-kube-api-access-j9gdf\") pod \"placement-db-create-fh7p4\" (UID: \"b40d62ac-8314-46a4-b602-531125454d07\") " pod="openstack-kuttl-tests/placement-db-create-fh7p4" Mar 16 16:45:21 crc kubenswrapper[5120]: I0316 16:45:21.934480 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b40d62ac-8314-46a4-b602-531125454d07-operator-scripts\") pod \"placement-db-create-fh7p4\" (UID: \"b40d62ac-8314-46a4-b602-531125454d07\") " pod="openstack-kuttl-tests/placement-db-create-fh7p4" Mar 16 16:45:21 crc kubenswrapper[5120]: I0316 16:45:21.960821 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9gdf\" (UniqueName: \"kubernetes.io/projected/b40d62ac-8314-46a4-b602-531125454d07-kube-api-access-j9gdf\") pod \"placement-db-create-fh7p4\" (UID: \"b40d62ac-8314-46a4-b602-531125454d07\") " pod="openstack-kuttl-tests/placement-db-create-fh7p4" Mar 16 16:45:21 crc kubenswrapper[5120]: I0316 16:45:21.980740 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-0ea4-account-create-update-gq8gc"] Mar 16 16:45:21 crc kubenswrapper[5120]: I0316 16:45:21.990379 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-0ea4-account-create-update-gq8gc"] Mar 16 16:45:21 crc kubenswrapper[5120]: I0316 16:45:21.990528 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-0ea4-account-create-update-gq8gc" Mar 16 16:45:21 crc kubenswrapper[5120]: I0316 16:45:21.996468 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-db-secret\"" Mar 16 16:45:22 crc kubenswrapper[5120]: I0316 16:45:22.136615 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xctt7\" (UniqueName: \"kubernetes.io/projected/0ce2c5c2-e87f-4292-b355-6946ee7dbe58-kube-api-access-xctt7\") pod \"placement-0ea4-account-create-update-gq8gc\" (UID: \"0ce2c5c2-e87f-4292-b355-6946ee7dbe58\") " pod="openstack-kuttl-tests/placement-0ea4-account-create-update-gq8gc" Mar 16 16:45:22 crc kubenswrapper[5120]: I0316 16:45:22.136821 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0ce2c5c2-e87f-4292-b355-6946ee7dbe58-operator-scripts\") pod \"placement-0ea4-account-create-update-gq8gc\" (UID: \"0ce2c5c2-e87f-4292-b355-6946ee7dbe58\") " pod="openstack-kuttl-tests/placement-0ea4-account-create-update-gq8gc" Mar 16 16:45:22 crc kubenswrapper[5120]: I0316 16:45:22.143619 5120 generic.go:358] "Generic (PLEG): container finished" podID="652479c2-1cd4-4b7a-99d1-63e3538b2aeb" containerID="26aac9012b9a66dfd5b1b7364f9c3985b1b9405f95d2cd6ed10d03c076a11aa4" exitCode=0 Mar 16 16:45:22 crc kubenswrapper[5120]: I0316 16:45:22.143705 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-fzs4g" event={"ID":"652479c2-1cd4-4b7a-99d1-63e3538b2aeb","Type":"ContainerDied","Data":"26aac9012b9a66dfd5b1b7364f9c3985b1b9405f95d2cd6ed10d03c076a11aa4"} Mar 16 16:45:22 crc kubenswrapper[5120]: I0316 16:45:22.147637 5120 generic.go:358] "Generic (PLEG): container finished" podID="9b5d4194-8ea2-4088-b693-7417cdd004fb" containerID="c3a9838bfe4533a414f719c7b53e4921a42f7f481b365a0f877b79263e932018" exitCode=0 Mar 16 16:45:22 crc kubenswrapper[5120]: I0316 16:45:22.147834 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-create-r8jd4" event={"ID":"9b5d4194-8ea2-4088-b693-7417cdd004fb","Type":"ContainerDied","Data":"c3a9838bfe4533a414f719c7b53e4921a42f7f481b365a0f877b79263e932018"} Mar 16 16:45:22 crc kubenswrapper[5120]: I0316 16:45:22.147864 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-create-r8jd4" event={"ID":"9b5d4194-8ea2-4088-b693-7417cdd004fb","Type":"ContainerStarted","Data":"ea470bb24cac4eda0d05947d5c10ad4e1ad89956e5be41b4a54db53ff5d26d98"} Mar 16 16:45:22 crc kubenswrapper[5120]: I0316 16:45:22.159929 5120 generic.go:358] "Generic (PLEG): container finished" podID="2cdd13b1-c1ed-48c4-8be5-c4689765fafb" containerID="e0178eee63ecdd93c95b03663f9f5ef05132c3b00ea101b8726d6886daac3925" exitCode=0 Mar 16 16:45:22 crc kubenswrapper[5120]: I0316 16:45:22.160141 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-2845-account-create-update-9n4l2" event={"ID":"2cdd13b1-c1ed-48c4-8be5-c4689765fafb","Type":"ContainerDied","Data":"e0178eee63ecdd93c95b03663f9f5ef05132c3b00ea101b8726d6886daac3925"} Mar 16 16:45:22 crc kubenswrapper[5120]: I0316 16:45:22.160167 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-2845-account-create-update-9n4l2" event={"ID":"2cdd13b1-c1ed-48c4-8be5-c4689765fafb","Type":"ContainerStarted","Data":"69c137b04472127f99ed01cc9dfae9a513c9b50f0367f0d4d2395d6f1ce37d51"} Mar 16 16:45:22 crc kubenswrapper[5120]: I0316 16:45:22.162229 5120 generic.go:358] "Generic (PLEG): container finished" podID="9f918385-0755-4179-ab66-342d9bbbadd0" containerID="1d73b9c9d778512c90fbbba6af4110c146eab5899bbf4e3cd6133df1fe84e7ca" exitCode=0 Mar 16 16:45:22 crc kubenswrapper[5120]: I0316 16:45:22.162427 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-cxcdx" event={"ID":"9f918385-0755-4179-ab66-342d9bbbadd0","Type":"ContainerDied","Data":"1d73b9c9d778512c90fbbba6af4110c146eab5899bbf4e3cd6133df1fe84e7ca"} Mar 16 16:45:22 crc kubenswrapper[5120]: I0316 16:45:22.239783 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xctt7\" (UniqueName: \"kubernetes.io/projected/0ce2c5c2-e87f-4292-b355-6946ee7dbe58-kube-api-access-xctt7\") pod \"placement-0ea4-account-create-update-gq8gc\" (UID: \"0ce2c5c2-e87f-4292-b355-6946ee7dbe58\") " pod="openstack-kuttl-tests/placement-0ea4-account-create-update-gq8gc" Mar 16 16:45:22 crc kubenswrapper[5120]: I0316 16:45:22.240364 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0ce2c5c2-e87f-4292-b355-6946ee7dbe58-operator-scripts\") pod \"placement-0ea4-account-create-update-gq8gc\" (UID: \"0ce2c5c2-e87f-4292-b355-6946ee7dbe58\") " pod="openstack-kuttl-tests/placement-0ea4-account-create-update-gq8gc" Mar 16 16:45:22 crc kubenswrapper[5120]: I0316 16:45:22.242346 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0ce2c5c2-e87f-4292-b355-6946ee7dbe58-operator-scripts\") pod \"placement-0ea4-account-create-update-gq8gc\" (UID: \"0ce2c5c2-e87f-4292-b355-6946ee7dbe58\") " pod="openstack-kuttl-tests/placement-0ea4-account-create-update-gq8gc" Mar 16 16:45:22 crc kubenswrapper[5120]: I0316 16:45:22.258446 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xctt7\" (UniqueName: \"kubernetes.io/projected/0ce2c5c2-e87f-4292-b355-6946ee7dbe58-kube-api-access-xctt7\") pod \"placement-0ea4-account-create-update-gq8gc\" (UID: \"0ce2c5c2-e87f-4292-b355-6946ee7dbe58\") " pod="openstack-kuttl-tests/placement-0ea4-account-create-update-gq8gc" Mar 16 16:45:22 crc kubenswrapper[5120]: I0316 16:45:22.259049 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-create-fh7p4" Mar 16 16:45:22 crc kubenswrapper[5120]: I0316 16:45:22.287064 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-db-create-jhvhm"] Mar 16 16:45:22 crc kubenswrapper[5120]: I0316 16:45:22.315152 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-0ea4-account-create-update-gq8gc" Mar 16 16:45:22 crc kubenswrapper[5120]: I0316 16:45:22.403672 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-ce7f-account-create-update-t2tvv"] Mar 16 16:45:22 crc kubenswrapper[5120]: I0316 16:45:22.748453 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-db-create-fh7p4"] Mar 16 16:45:22 crc kubenswrapper[5120]: W0316 16:45:22.764109 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb40d62ac_8314_46a4_b602_531125454d07.slice/crio-cfacd29faa688a781a4993fd24096ed913afc93b2b260c9eb9a9f7b0a3b1da32 WatchSource:0}: Error finding container cfacd29faa688a781a4993fd24096ed913afc93b2b260c9eb9a9f7b0a3b1da32: Status 404 returned error can't find the container with id cfacd29faa688a781a4993fd24096ed913afc93b2b260c9eb9a9f7b0a3b1da32 Mar 16 16:45:22 crc kubenswrapper[5120]: I0316 16:45:22.820271 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-0ea4-account-create-update-gq8gc"] Mar 16 16:45:23 crc kubenswrapper[5120]: I0316 16:45:23.172378 5120 generic.go:358] "Generic (PLEG): container finished" podID="9c3d1548-b3b4-4e52-9d2e-3e2939d2604d" containerID="d17cf45d44fd0f7109ecc7964d349d5aabdbd98c2cf6e83625584ad4f70ee890" exitCode=0 Mar 16 16:45:23 crc kubenswrapper[5120]: I0316 16:45:23.172729 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-create-jhvhm" event={"ID":"9c3d1548-b3b4-4e52-9d2e-3e2939d2604d","Type":"ContainerDied","Data":"d17cf45d44fd0f7109ecc7964d349d5aabdbd98c2cf6e83625584ad4f70ee890"} Mar 16 16:45:23 crc kubenswrapper[5120]: I0316 16:45:23.172778 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-create-jhvhm" event={"ID":"9c3d1548-b3b4-4e52-9d2e-3e2939d2604d","Type":"ContainerStarted","Data":"c5c866529b30ae42ee82bc6a18f6c38da7a9cf8db1d0140a666b0b47cb1f3292"} Mar 16 16:45:23 crc kubenswrapper[5120]: I0316 16:45:23.176981 5120 generic.go:358] "Generic (PLEG): container finished" podID="44595829-86f7-4eb9-b15d-a51f416a2b40" containerID="fbef3263cab9fddad0669adf17acaca7c922ac91b4f2b66f8eb1173ea6b04bf3" exitCode=0 Mar 16 16:45:23 crc kubenswrapper[5120]: I0316 16:45:23.177232 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-ce7f-account-create-update-t2tvv" event={"ID":"44595829-86f7-4eb9-b15d-a51f416a2b40","Type":"ContainerDied","Data":"fbef3263cab9fddad0669adf17acaca7c922ac91b4f2b66f8eb1173ea6b04bf3"} Mar 16 16:45:23 crc kubenswrapper[5120]: I0316 16:45:23.177318 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-ce7f-account-create-update-t2tvv" event={"ID":"44595829-86f7-4eb9-b15d-a51f416a2b40","Type":"ContainerStarted","Data":"b262c02ed7e96e100f1dc56da32807119e5ff04f6a4d7af1031ec4435a7a5d4b"} Mar 16 16:45:23 crc kubenswrapper[5120]: I0316 16:45:23.183410 5120 generic.go:358] "Generic (PLEG): container finished" podID="b40d62ac-8314-46a4-b602-531125454d07" containerID="762c5b88c62dde33564710bf074b979a14758a820e0cf7d361b4d935db707a79" exitCode=0 Mar 16 16:45:23 crc kubenswrapper[5120]: I0316 16:45:23.183508 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-create-fh7p4" event={"ID":"b40d62ac-8314-46a4-b602-531125454d07","Type":"ContainerDied","Data":"762c5b88c62dde33564710bf074b979a14758a820e0cf7d361b4d935db707a79"} Mar 16 16:45:23 crc kubenswrapper[5120]: I0316 16:45:23.183526 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-create-fh7p4" event={"ID":"b40d62ac-8314-46a4-b602-531125454d07","Type":"ContainerStarted","Data":"cfacd29faa688a781a4993fd24096ed913afc93b2b260c9eb9a9f7b0a3b1da32"} Mar 16 16:45:23 crc kubenswrapper[5120]: I0316 16:45:23.187475 5120 generic.go:358] "Generic (PLEG): container finished" podID="0ce2c5c2-e87f-4292-b355-6946ee7dbe58" containerID="11335ab8141c3248a219fa01fb20182d45cfb2b3308ae2564459e0e802361bf5" exitCode=0 Mar 16 16:45:23 crc kubenswrapper[5120]: I0316 16:45:23.187710 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-0ea4-account-create-update-gq8gc" event={"ID":"0ce2c5c2-e87f-4292-b355-6946ee7dbe58","Type":"ContainerDied","Data":"11335ab8141c3248a219fa01fb20182d45cfb2b3308ae2564459e0e802361bf5"} Mar 16 16:45:23 crc kubenswrapper[5120]: I0316 16:45:23.187732 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-0ea4-account-create-update-gq8gc" event={"ID":"0ce2c5c2-e87f-4292-b355-6946ee7dbe58","Type":"ContainerStarted","Data":"0551c70b45e4209397b9f92ef311b29e8fb3ac100826c0800e2607ee3e0cf4ed"} Mar 16 16:45:23 crc kubenswrapper[5120]: I0316 16:45:23.607967 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-cxcdx" Mar 16 16:45:23 crc kubenswrapper[5120]: I0316 16:45:23.738290 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-2845-account-create-update-9n4l2" Mar 16 16:45:23 crc kubenswrapper[5120]: I0316 16:45:23.742433 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-create-r8jd4" Mar 16 16:45:23 crc kubenswrapper[5120]: I0316 16:45:23.776667 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8vkfs\" (UniqueName: \"kubernetes.io/projected/9f918385-0755-4179-ab66-342d9bbbadd0-kube-api-access-8vkfs\") pod \"9f918385-0755-4179-ab66-342d9bbbadd0\" (UID: \"9f918385-0755-4179-ab66-342d9bbbadd0\") " Mar 16 16:45:23 crc kubenswrapper[5120]: I0316 16:45:23.776904 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9f918385-0755-4179-ab66-342d9bbbadd0-operator-scripts\") pod \"9f918385-0755-4179-ab66-342d9bbbadd0\" (UID: \"9f918385-0755-4179-ab66-342d9bbbadd0\") " Mar 16 16:45:23 crc kubenswrapper[5120]: I0316 16:45:23.777654 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f918385-0755-4179-ab66-342d9bbbadd0-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "9f918385-0755-4179-ab66-342d9bbbadd0" (UID: "9f918385-0755-4179-ab66-342d9bbbadd0"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:45:23 crc kubenswrapper[5120]: I0316 16:45:23.783927 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f918385-0755-4179-ab66-342d9bbbadd0-kube-api-access-8vkfs" (OuterVolumeSpecName: "kube-api-access-8vkfs") pod "9f918385-0755-4179-ab66-342d9bbbadd0" (UID: "9f918385-0755-4179-ab66-342d9bbbadd0"). InnerVolumeSpecName "kube-api-access-8vkfs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:45:23 crc kubenswrapper[5120]: I0316 16:45:23.878543 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-knbh8\" (UniqueName: \"kubernetes.io/projected/9b5d4194-8ea2-4088-b693-7417cdd004fb-kube-api-access-knbh8\") pod \"9b5d4194-8ea2-4088-b693-7417cdd004fb\" (UID: \"9b5d4194-8ea2-4088-b693-7417cdd004fb\") " Mar 16 16:45:23 crc kubenswrapper[5120]: I0316 16:45:23.879190 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9b5d4194-8ea2-4088-b693-7417cdd004fb-operator-scripts\") pod \"9b5d4194-8ea2-4088-b693-7417cdd004fb\" (UID: \"9b5d4194-8ea2-4088-b693-7417cdd004fb\") " Mar 16 16:45:23 crc kubenswrapper[5120]: I0316 16:45:23.879443 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4lkmh\" (UniqueName: \"kubernetes.io/projected/2cdd13b1-c1ed-48c4-8be5-c4689765fafb-kube-api-access-4lkmh\") pod \"2cdd13b1-c1ed-48c4-8be5-c4689765fafb\" (UID: \"2cdd13b1-c1ed-48c4-8be5-c4689765fafb\") " Mar 16 16:45:23 crc kubenswrapper[5120]: I0316 16:45:23.879564 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2cdd13b1-c1ed-48c4-8be5-c4689765fafb-operator-scripts\") pod \"2cdd13b1-c1ed-48c4-8be5-c4689765fafb\" (UID: \"2cdd13b1-c1ed-48c4-8be5-c4689765fafb\") " Mar 16 16:45:23 crc kubenswrapper[5120]: I0316 16:45:23.880147 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8vkfs\" (UniqueName: \"kubernetes.io/projected/9f918385-0755-4179-ab66-342d9bbbadd0-kube-api-access-8vkfs\") on node \"crc\" DevicePath \"\"" Mar 16 16:45:23 crc kubenswrapper[5120]: I0316 16:45:23.880171 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9f918385-0755-4179-ab66-342d9bbbadd0-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:45:23 crc kubenswrapper[5120]: I0316 16:45:23.880700 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2cdd13b1-c1ed-48c4-8be5-c4689765fafb-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "2cdd13b1-c1ed-48c4-8be5-c4689765fafb" (UID: "2cdd13b1-c1ed-48c4-8be5-c4689765fafb"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:45:23 crc kubenswrapper[5120]: I0316 16:45:23.881256 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9b5d4194-8ea2-4088-b693-7417cdd004fb-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "9b5d4194-8ea2-4088-b693-7417cdd004fb" (UID: "9b5d4194-8ea2-4088-b693-7417cdd004fb"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:45:23 crc kubenswrapper[5120]: I0316 16:45:23.881678 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b5d4194-8ea2-4088-b693-7417cdd004fb-kube-api-access-knbh8" (OuterVolumeSpecName: "kube-api-access-knbh8") pod "9b5d4194-8ea2-4088-b693-7417cdd004fb" (UID: "9b5d4194-8ea2-4088-b693-7417cdd004fb"). InnerVolumeSpecName "kube-api-access-knbh8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:45:23 crc kubenswrapper[5120]: I0316 16:45:23.883786 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2cdd13b1-c1ed-48c4-8be5-c4689765fafb-kube-api-access-4lkmh" (OuterVolumeSpecName: "kube-api-access-4lkmh") pod "2cdd13b1-c1ed-48c4-8be5-c4689765fafb" (UID: "2cdd13b1-c1ed-48c4-8be5-c4689765fafb"). InnerVolumeSpecName "kube-api-access-4lkmh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:45:23 crc kubenswrapper[5120]: I0316 16:45:23.986653 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4lkmh\" (UniqueName: \"kubernetes.io/projected/2cdd13b1-c1ed-48c4-8be5-c4689765fafb-kube-api-access-4lkmh\") on node \"crc\" DevicePath \"\"" Mar 16 16:45:23 crc kubenswrapper[5120]: I0316 16:45:23.986698 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2cdd13b1-c1ed-48c4-8be5-c4689765fafb-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:45:23 crc kubenswrapper[5120]: I0316 16:45:23.986714 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-knbh8\" (UniqueName: \"kubernetes.io/projected/9b5d4194-8ea2-4088-b693-7417cdd004fb-kube-api-access-knbh8\") on node \"crc\" DevicePath \"\"" Mar 16 16:45:23 crc kubenswrapper[5120]: I0316 16:45:23.986726 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9b5d4194-8ea2-4088-b693-7417cdd004fb-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:45:24 crc kubenswrapper[5120]: I0316 16:45:24.198339 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-fzs4g" event={"ID":"652479c2-1cd4-4b7a-99d1-63e3538b2aeb","Type":"ContainerStarted","Data":"db5773329f8d6f67c82e5cb9ebda278a4b8d2c06f4fb07dd501c49605ad5c9cb"} Mar 16 16:45:24 crc kubenswrapper[5120]: I0316 16:45:24.202000 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-create-r8jd4" event={"ID":"9b5d4194-8ea2-4088-b693-7417cdd004fb","Type":"ContainerDied","Data":"ea470bb24cac4eda0d05947d5c10ad4e1ad89956e5be41b4a54db53ff5d26d98"} Mar 16 16:45:24 crc kubenswrapper[5120]: I0316 16:45:24.202033 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ea470bb24cac4eda0d05947d5c10ad4e1ad89956e5be41b4a54db53ff5d26d98" Mar 16 16:45:24 crc kubenswrapper[5120]: I0316 16:45:24.202074 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-create-r8jd4" Mar 16 16:45:24 crc kubenswrapper[5120]: I0316 16:45:24.206629 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-2845-account-create-update-9n4l2" event={"ID":"2cdd13b1-c1ed-48c4-8be5-c4689765fafb","Type":"ContainerDied","Data":"69c137b04472127f99ed01cc9dfae9a513c9b50f0367f0d4d2395d6f1ce37d51"} Mar 16 16:45:24 crc kubenswrapper[5120]: I0316 16:45:24.206662 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="69c137b04472127f99ed01cc9dfae9a513c9b50f0367f0d4d2395d6f1ce37d51" Mar 16 16:45:24 crc kubenswrapper[5120]: I0316 16:45:24.206713 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-2845-account-create-update-9n4l2" Mar 16 16:45:24 crc kubenswrapper[5120]: I0316 16:45:24.213847 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-cxcdx" event={"ID":"9f918385-0755-4179-ab66-342d9bbbadd0","Type":"ContainerDied","Data":"4bb27f7fefcf838019ca4ed30020ebb41b12c3e80de99e6a3523f8da9170d9ef"} Mar 16 16:45:24 crc kubenswrapper[5120]: I0316 16:45:24.213896 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4bb27f7fefcf838019ca4ed30020ebb41b12c3e80de99e6a3523f8da9170d9ef" Mar 16 16:45:24 crc kubenswrapper[5120]: I0316 16:45:24.214022 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-cxcdx" Mar 16 16:45:24 crc kubenswrapper[5120]: I0316 16:45:24.602745 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-ce7f-account-create-update-t2tvv" Mar 16 16:45:24 crc kubenswrapper[5120]: I0316 16:45:24.701045 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5pqql\" (UniqueName: \"kubernetes.io/projected/44595829-86f7-4eb9-b15d-a51f416a2b40-kube-api-access-5pqql\") pod \"44595829-86f7-4eb9-b15d-a51f416a2b40\" (UID: \"44595829-86f7-4eb9-b15d-a51f416a2b40\") " Mar 16 16:45:24 crc kubenswrapper[5120]: I0316 16:45:24.701381 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/44595829-86f7-4eb9-b15d-a51f416a2b40-operator-scripts\") pod \"44595829-86f7-4eb9-b15d-a51f416a2b40\" (UID: \"44595829-86f7-4eb9-b15d-a51f416a2b40\") " Mar 16 16:45:24 crc kubenswrapper[5120]: I0316 16:45:24.702414 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/44595829-86f7-4eb9-b15d-a51f416a2b40-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "44595829-86f7-4eb9-b15d-a51f416a2b40" (UID: "44595829-86f7-4eb9-b15d-a51f416a2b40"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:45:24 crc kubenswrapper[5120]: I0316 16:45:24.707533 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44595829-86f7-4eb9-b15d-a51f416a2b40-kube-api-access-5pqql" (OuterVolumeSpecName: "kube-api-access-5pqql") pod "44595829-86f7-4eb9-b15d-a51f416a2b40" (UID: "44595829-86f7-4eb9-b15d-a51f416a2b40"). InnerVolumeSpecName "kube-api-access-5pqql". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:45:24 crc kubenswrapper[5120]: I0316 16:45:24.725304 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-0ea4-account-create-update-gq8gc" Mar 16 16:45:24 crc kubenswrapper[5120]: I0316 16:45:24.732907 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-create-fh7p4" Mar 16 16:45:24 crc kubenswrapper[5120]: I0316 16:45:24.761062 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-create-jhvhm" Mar 16 16:45:24 crc kubenswrapper[5120]: I0316 16:45:24.803589 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/44595829-86f7-4eb9-b15d-a51f416a2b40-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:45:24 crc kubenswrapper[5120]: I0316 16:45:24.803617 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5pqql\" (UniqueName: \"kubernetes.io/projected/44595829-86f7-4eb9-b15d-a51f416a2b40-kube-api-access-5pqql\") on node \"crc\" DevicePath \"\"" Mar 16 16:45:24 crc kubenswrapper[5120]: I0316 16:45:24.904790 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j9gdf\" (UniqueName: \"kubernetes.io/projected/b40d62ac-8314-46a4-b602-531125454d07-kube-api-access-j9gdf\") pod \"b40d62ac-8314-46a4-b602-531125454d07\" (UID: \"b40d62ac-8314-46a4-b602-531125454d07\") " Mar 16 16:45:24 crc kubenswrapper[5120]: I0316 16:45:24.905184 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9cpql\" (UniqueName: \"kubernetes.io/projected/9c3d1548-b3b4-4e52-9d2e-3e2939d2604d-kube-api-access-9cpql\") pod \"9c3d1548-b3b4-4e52-9d2e-3e2939d2604d\" (UID: \"9c3d1548-b3b4-4e52-9d2e-3e2939d2604d\") " Mar 16 16:45:24 crc kubenswrapper[5120]: I0316 16:45:24.905307 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b40d62ac-8314-46a4-b602-531125454d07-operator-scripts\") pod \"b40d62ac-8314-46a4-b602-531125454d07\" (UID: \"b40d62ac-8314-46a4-b602-531125454d07\") " Mar 16 16:45:24 crc kubenswrapper[5120]: I0316 16:45:24.905552 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xctt7\" (UniqueName: \"kubernetes.io/projected/0ce2c5c2-e87f-4292-b355-6946ee7dbe58-kube-api-access-xctt7\") pod \"0ce2c5c2-e87f-4292-b355-6946ee7dbe58\" (UID: \"0ce2c5c2-e87f-4292-b355-6946ee7dbe58\") " Mar 16 16:45:24 crc kubenswrapper[5120]: I0316 16:45:24.905674 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0ce2c5c2-e87f-4292-b355-6946ee7dbe58-operator-scripts\") pod \"0ce2c5c2-e87f-4292-b355-6946ee7dbe58\" (UID: \"0ce2c5c2-e87f-4292-b355-6946ee7dbe58\") " Mar 16 16:45:24 crc kubenswrapper[5120]: I0316 16:45:24.905845 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9c3d1548-b3b4-4e52-9d2e-3e2939d2604d-operator-scripts\") pod \"9c3d1548-b3b4-4e52-9d2e-3e2939d2604d\" (UID: \"9c3d1548-b3b4-4e52-9d2e-3e2939d2604d\") " Mar 16 16:45:24 crc kubenswrapper[5120]: I0316 16:45:24.906003 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ce2c5c2-e87f-4292-b355-6946ee7dbe58-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "0ce2c5c2-e87f-4292-b355-6946ee7dbe58" (UID: "0ce2c5c2-e87f-4292-b355-6946ee7dbe58"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:45:24 crc kubenswrapper[5120]: I0316 16:45:24.906194 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b40d62ac-8314-46a4-b602-531125454d07-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "b40d62ac-8314-46a4-b602-531125454d07" (UID: "b40d62ac-8314-46a4-b602-531125454d07"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:45:24 crc kubenswrapper[5120]: I0316 16:45:24.906477 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9c3d1548-b3b4-4e52-9d2e-3e2939d2604d-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "9c3d1548-b3b4-4e52-9d2e-3e2939d2604d" (UID: "9c3d1548-b3b4-4e52-9d2e-3e2939d2604d"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:45:24 crc kubenswrapper[5120]: I0316 16:45:24.906808 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9c3d1548-b3b4-4e52-9d2e-3e2939d2604d-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:45:24 crc kubenswrapper[5120]: I0316 16:45:24.906891 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b40d62ac-8314-46a4-b602-531125454d07-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:45:24 crc kubenswrapper[5120]: I0316 16:45:24.906952 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0ce2c5c2-e87f-4292-b355-6946ee7dbe58-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:45:24 crc kubenswrapper[5120]: I0316 16:45:24.908174 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b40d62ac-8314-46a4-b602-531125454d07-kube-api-access-j9gdf" (OuterVolumeSpecName: "kube-api-access-j9gdf") pod "b40d62ac-8314-46a4-b602-531125454d07" (UID: "b40d62ac-8314-46a4-b602-531125454d07"). InnerVolumeSpecName "kube-api-access-j9gdf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:45:24 crc kubenswrapper[5120]: I0316 16:45:24.908609 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c3d1548-b3b4-4e52-9d2e-3e2939d2604d-kube-api-access-9cpql" (OuterVolumeSpecName: "kube-api-access-9cpql") pod "9c3d1548-b3b4-4e52-9d2e-3e2939d2604d" (UID: "9c3d1548-b3b4-4e52-9d2e-3e2939d2604d"). InnerVolumeSpecName "kube-api-access-9cpql". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:45:24 crc kubenswrapper[5120]: I0316 16:45:24.908628 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ce2c5c2-e87f-4292-b355-6946ee7dbe58-kube-api-access-xctt7" (OuterVolumeSpecName: "kube-api-access-xctt7") pod "0ce2c5c2-e87f-4292-b355-6946ee7dbe58" (UID: "0ce2c5c2-e87f-4292-b355-6946ee7dbe58"). InnerVolumeSpecName "kube-api-access-xctt7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:45:25 crc kubenswrapper[5120]: I0316 16:45:25.009130 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j9gdf\" (UniqueName: \"kubernetes.io/projected/b40d62ac-8314-46a4-b602-531125454d07-kube-api-access-j9gdf\") on node \"crc\" DevicePath \"\"" Mar 16 16:45:25 crc kubenswrapper[5120]: I0316 16:45:25.009159 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9cpql\" (UniqueName: \"kubernetes.io/projected/9c3d1548-b3b4-4e52-9d2e-3e2939d2604d-kube-api-access-9cpql\") on node \"crc\" DevicePath \"\"" Mar 16 16:45:25 crc kubenswrapper[5120]: I0316 16:45:25.009168 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xctt7\" (UniqueName: \"kubernetes.io/projected/0ce2c5c2-e87f-4292-b355-6946ee7dbe58-kube-api-access-xctt7\") on node \"crc\" DevicePath \"\"" Mar 16 16:45:25 crc kubenswrapper[5120]: I0316 16:45:25.226373 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-ce7f-account-create-update-t2tvv" event={"ID":"44595829-86f7-4eb9-b15d-a51f416a2b40","Type":"ContainerDied","Data":"b262c02ed7e96e100f1dc56da32807119e5ff04f6a4d7af1031ec4435a7a5d4b"} Mar 16 16:45:25 crc kubenswrapper[5120]: I0316 16:45:25.226825 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b262c02ed7e96e100f1dc56da32807119e5ff04f6a4d7af1031ec4435a7a5d4b" Mar 16 16:45:25 crc kubenswrapper[5120]: I0316 16:45:25.227001 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-ce7f-account-create-update-t2tvv" Mar 16 16:45:25 crc kubenswrapper[5120]: I0316 16:45:25.237210 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-create-fh7p4" Mar 16 16:45:25 crc kubenswrapper[5120]: I0316 16:45:25.237218 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-create-fh7p4" event={"ID":"b40d62ac-8314-46a4-b602-531125454d07","Type":"ContainerDied","Data":"cfacd29faa688a781a4993fd24096ed913afc93b2b260c9eb9a9f7b0a3b1da32"} Mar 16 16:45:25 crc kubenswrapper[5120]: I0316 16:45:25.237556 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cfacd29faa688a781a4993fd24096ed913afc93b2b260c9eb9a9f7b0a3b1da32" Mar 16 16:45:25 crc kubenswrapper[5120]: I0316 16:45:25.239353 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-0ea4-account-create-update-gq8gc" event={"ID":"0ce2c5c2-e87f-4292-b355-6946ee7dbe58","Type":"ContainerDied","Data":"0551c70b45e4209397b9f92ef311b29e8fb3ac100826c0800e2607ee3e0cf4ed"} Mar 16 16:45:25 crc kubenswrapper[5120]: I0316 16:45:25.239378 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0551c70b45e4209397b9f92ef311b29e8fb3ac100826c0800e2607ee3e0cf4ed" Mar 16 16:45:25 crc kubenswrapper[5120]: I0316 16:45:25.239440 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-0ea4-account-create-update-gq8gc" Mar 16 16:45:25 crc kubenswrapper[5120]: I0316 16:45:25.245005 5120 generic.go:358] "Generic (PLEG): container finished" podID="652479c2-1cd4-4b7a-99d1-63e3538b2aeb" containerID="db5773329f8d6f67c82e5cb9ebda278a4b8d2c06f4fb07dd501c49605ad5c9cb" exitCode=0 Mar 16 16:45:25 crc kubenswrapper[5120]: I0316 16:45:25.245187 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-fzs4g" event={"ID":"652479c2-1cd4-4b7a-99d1-63e3538b2aeb","Type":"ContainerDied","Data":"db5773329f8d6f67c82e5cb9ebda278a4b8d2c06f4fb07dd501c49605ad5c9cb"} Mar 16 16:45:25 crc kubenswrapper[5120]: I0316 16:45:25.249459 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-create-jhvhm" Mar 16 16:45:25 crc kubenswrapper[5120]: I0316 16:45:25.249507 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-create-jhvhm" event={"ID":"9c3d1548-b3b4-4e52-9d2e-3e2939d2604d","Type":"ContainerDied","Data":"c5c866529b30ae42ee82bc6a18f6c38da7a9cf8db1d0140a666b0b47cb1f3292"} Mar 16 16:45:25 crc kubenswrapper[5120]: I0316 16:45:25.249534 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c5c866529b30ae42ee82bc6a18f6c38da7a9cf8db1d0140a666b0b47cb1f3292" Mar 16 16:45:25 crc kubenswrapper[5120]: I0316 16:45:25.431255 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-db-sync-sc9c8"] Mar 16 16:45:25 crc kubenswrapper[5120]: I0316 16:45:25.432180 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c3d1548-b3b4-4e52-9d2e-3e2939d2604d" containerName="mariadb-database-create" Mar 16 16:45:25 crc kubenswrapper[5120]: I0316 16:45:25.432223 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c3d1548-b3b4-4e52-9d2e-3e2939d2604d" containerName="mariadb-database-create" Mar 16 16:45:25 crc kubenswrapper[5120]: I0316 16:45:25.432234 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44595829-86f7-4eb9-b15d-a51f416a2b40" containerName="mariadb-account-create-update" Mar 16 16:45:25 crc kubenswrapper[5120]: I0316 16:45:25.432241 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="44595829-86f7-4eb9-b15d-a51f416a2b40" containerName="mariadb-account-create-update" Mar 16 16:45:25 crc kubenswrapper[5120]: I0316 16:45:25.432273 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ce2c5c2-e87f-4292-b355-6946ee7dbe58" containerName="mariadb-account-create-update" Mar 16 16:45:25 crc kubenswrapper[5120]: I0316 16:45:25.432280 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ce2c5c2-e87f-4292-b355-6946ee7dbe58" containerName="mariadb-account-create-update" Mar 16 16:45:25 crc kubenswrapper[5120]: I0316 16:45:25.432298 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f918385-0755-4179-ab66-342d9bbbadd0" containerName="mariadb-account-create-update" Mar 16 16:45:25 crc kubenswrapper[5120]: I0316 16:45:25.432304 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f918385-0755-4179-ab66-342d9bbbadd0" containerName="mariadb-account-create-update" Mar 16 16:45:25 crc kubenswrapper[5120]: I0316 16:45:25.432317 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b5d4194-8ea2-4088-b693-7417cdd004fb" containerName="mariadb-database-create" Mar 16 16:45:25 crc kubenswrapper[5120]: I0316 16:45:25.432322 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b5d4194-8ea2-4088-b693-7417cdd004fb" containerName="mariadb-database-create" Mar 16 16:45:25 crc kubenswrapper[5120]: I0316 16:45:25.432338 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b40d62ac-8314-46a4-b602-531125454d07" containerName="mariadb-database-create" Mar 16 16:45:25 crc kubenswrapper[5120]: I0316 16:45:25.432343 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="b40d62ac-8314-46a4-b602-531125454d07" containerName="mariadb-database-create" Mar 16 16:45:25 crc kubenswrapper[5120]: I0316 16:45:25.432360 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2cdd13b1-c1ed-48c4-8be5-c4689765fafb" containerName="mariadb-account-create-update" Mar 16 16:45:25 crc kubenswrapper[5120]: I0316 16:45:25.432365 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="2cdd13b1-c1ed-48c4-8be5-c4689765fafb" containerName="mariadb-account-create-update" Mar 16 16:45:25 crc kubenswrapper[5120]: I0316 16:45:25.432497 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="9b5d4194-8ea2-4088-b693-7417cdd004fb" containerName="mariadb-database-create" Mar 16 16:45:25 crc kubenswrapper[5120]: I0316 16:45:25.432510 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="0ce2c5c2-e87f-4292-b355-6946ee7dbe58" containerName="mariadb-account-create-update" Mar 16 16:45:25 crc kubenswrapper[5120]: I0316 16:45:25.432522 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="9c3d1548-b3b4-4e52-9d2e-3e2939d2604d" containerName="mariadb-database-create" Mar 16 16:45:25 crc kubenswrapper[5120]: I0316 16:45:25.432531 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="2cdd13b1-c1ed-48c4-8be5-c4689765fafb" containerName="mariadb-account-create-update" Mar 16 16:45:25 crc kubenswrapper[5120]: I0316 16:45:25.432540 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="9f918385-0755-4179-ab66-342d9bbbadd0" containerName="mariadb-account-create-update" Mar 16 16:45:25 crc kubenswrapper[5120]: I0316 16:45:25.432555 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="44595829-86f7-4eb9-b15d-a51f416a2b40" containerName="mariadb-account-create-update" Mar 16 16:45:25 crc kubenswrapper[5120]: I0316 16:45:25.432567 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="b40d62ac-8314-46a4-b602-531125454d07" containerName="mariadb-database-create" Mar 16 16:45:25 crc kubenswrapper[5120]: I0316 16:45:25.453121 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-sc9c8"] Mar 16 16:45:25 crc kubenswrapper[5120]: I0316 16:45:25.453245 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-sc9c8" Mar 16 16:45:25 crc kubenswrapper[5120]: I0316 16:45:25.455842 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-config-data\"" Mar 16 16:45:25 crc kubenswrapper[5120]: I0316 16:45:25.456043 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-glance-dockercfg-6m2c9\"" Mar 16 16:45:25 crc kubenswrapper[5120]: I0316 16:45:25.620898 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/18453fce-c82b-4afc-9968-e956f84798b4-combined-ca-bundle\") pod \"glance-db-sync-sc9c8\" (UID: \"18453fce-c82b-4afc-9968-e956f84798b4\") " pod="openstack-kuttl-tests/glance-db-sync-sc9c8" Mar 16 16:45:25 crc kubenswrapper[5120]: I0316 16:45:25.620947 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/18453fce-c82b-4afc-9968-e956f84798b4-db-sync-config-data\") pod \"glance-db-sync-sc9c8\" (UID: \"18453fce-c82b-4afc-9968-e956f84798b4\") " pod="openstack-kuttl-tests/glance-db-sync-sc9c8" Mar 16 16:45:25 crc kubenswrapper[5120]: I0316 16:45:25.621275 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzxf4\" (UniqueName: \"kubernetes.io/projected/18453fce-c82b-4afc-9968-e956f84798b4-kube-api-access-pzxf4\") pod \"glance-db-sync-sc9c8\" (UID: \"18453fce-c82b-4afc-9968-e956f84798b4\") " pod="openstack-kuttl-tests/glance-db-sync-sc9c8" Mar 16 16:45:25 crc kubenswrapper[5120]: I0316 16:45:25.621325 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/18453fce-c82b-4afc-9968-e956f84798b4-config-data\") pod \"glance-db-sync-sc9c8\" (UID: \"18453fce-c82b-4afc-9968-e956f84798b4\") " pod="openstack-kuttl-tests/glance-db-sync-sc9c8" Mar 16 16:45:25 crc kubenswrapper[5120]: I0316 16:45:25.723748 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pzxf4\" (UniqueName: \"kubernetes.io/projected/18453fce-c82b-4afc-9968-e956f84798b4-kube-api-access-pzxf4\") pod \"glance-db-sync-sc9c8\" (UID: \"18453fce-c82b-4afc-9968-e956f84798b4\") " pod="openstack-kuttl-tests/glance-db-sync-sc9c8" Mar 16 16:45:25 crc kubenswrapper[5120]: I0316 16:45:25.723822 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/18453fce-c82b-4afc-9968-e956f84798b4-config-data\") pod \"glance-db-sync-sc9c8\" (UID: \"18453fce-c82b-4afc-9968-e956f84798b4\") " pod="openstack-kuttl-tests/glance-db-sync-sc9c8" Mar 16 16:45:25 crc kubenswrapper[5120]: I0316 16:45:25.724014 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/18453fce-c82b-4afc-9968-e956f84798b4-combined-ca-bundle\") pod \"glance-db-sync-sc9c8\" (UID: \"18453fce-c82b-4afc-9968-e956f84798b4\") " pod="openstack-kuttl-tests/glance-db-sync-sc9c8" Mar 16 16:45:25 crc kubenswrapper[5120]: I0316 16:45:25.724073 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/18453fce-c82b-4afc-9968-e956f84798b4-db-sync-config-data\") pod \"glance-db-sync-sc9c8\" (UID: \"18453fce-c82b-4afc-9968-e956f84798b4\") " pod="openstack-kuttl-tests/glance-db-sync-sc9c8" Mar 16 16:45:25 crc kubenswrapper[5120]: I0316 16:45:25.733115 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/18453fce-c82b-4afc-9968-e956f84798b4-combined-ca-bundle\") pod \"glance-db-sync-sc9c8\" (UID: \"18453fce-c82b-4afc-9968-e956f84798b4\") " pod="openstack-kuttl-tests/glance-db-sync-sc9c8" Mar 16 16:45:25 crc kubenswrapper[5120]: I0316 16:45:25.734174 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/18453fce-c82b-4afc-9968-e956f84798b4-db-sync-config-data\") pod \"glance-db-sync-sc9c8\" (UID: \"18453fce-c82b-4afc-9968-e956f84798b4\") " pod="openstack-kuttl-tests/glance-db-sync-sc9c8" Mar 16 16:45:25 crc kubenswrapper[5120]: I0316 16:45:25.736696 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/18453fce-c82b-4afc-9968-e956f84798b4-config-data\") pod \"glance-db-sync-sc9c8\" (UID: \"18453fce-c82b-4afc-9968-e956f84798b4\") " pod="openstack-kuttl-tests/glance-db-sync-sc9c8" Mar 16 16:45:25 crc kubenswrapper[5120]: I0316 16:45:25.784369 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzxf4\" (UniqueName: \"kubernetes.io/projected/18453fce-c82b-4afc-9968-e956f84798b4-kube-api-access-pzxf4\") pod \"glance-db-sync-sc9c8\" (UID: \"18453fce-c82b-4afc-9968-e956f84798b4\") " pod="openstack-kuttl-tests/glance-db-sync-sc9c8" Mar 16 16:45:26 crc kubenswrapper[5120]: I0316 16:45:26.072875 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-sc9c8" Mar 16 16:45:26 crc kubenswrapper[5120]: I0316 16:45:26.261175 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-fzs4g" event={"ID":"652479c2-1cd4-4b7a-99d1-63e3538b2aeb","Type":"ContainerStarted","Data":"60984be1fa47594dd1b5617e9e0ce48d462dde8e5654d8d0c93e2a732c571ef2"} Mar 16 16:45:26 crc kubenswrapper[5120]: I0316 16:45:26.269310 5120 generic.go:358] "Generic (PLEG): container finished" podID="4dc7fcb1-fcdc-40ec-9654-8cdc46e13e63" containerID="81527ce47d56655c208352a5bd34dcd551faa271463f7acafa5ae8865ad6812f" exitCode=0 Mar 16 16:45:26 crc kubenswrapper[5120]: I0316 16:45:26.269405 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-brpdk" event={"ID":"4dc7fcb1-fcdc-40ec-9654-8cdc46e13e63","Type":"ContainerDied","Data":"81527ce47d56655c208352a5bd34dcd551faa271463f7acafa5ae8865ad6812f"} Mar 16 16:45:26 crc kubenswrapper[5120]: I0316 16:45:26.281013 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/community-operators-fzs4g" podStartSLOduration=5.362471481 podStartE2EDuration="6.280983327s" podCreationTimestamp="2026-03-16 16:45:20 +0000 UTC" firstStartedPulling="2026-03-16 16:45:22.144543313 +0000 UTC m=+4424.298474970" lastFinishedPulling="2026-03-16 16:45:23.063055159 +0000 UTC m=+4425.216986816" observedRunningTime="2026-03-16 16:45:26.27519466 +0000 UTC m=+4428.429126317" watchObservedRunningTime="2026-03-16 16:45:26.280983327 +0000 UTC m=+4428.434914984" Mar 16 16:45:26 crc kubenswrapper[5120]: I0316 16:45:26.574035 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-sc9c8"] Mar 16 16:45:26 crc kubenswrapper[5120]: I0316 16:45:26.681162 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-cxcdx"] Mar 16 16:45:26 crc kubenswrapper[5120]: I0316 16:45:26.681211 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-cxcdx"] Mar 16 16:45:27 crc kubenswrapper[5120]: I0316 16:45:27.175056 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:45:27 crc kubenswrapper[5120]: I0316 16:45:27.280721 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-sc9c8" event={"ID":"18453fce-c82b-4afc-9968-e956f84798b4","Type":"ContainerStarted","Data":"cd5ef61388c2e24d085fe1734d4a14ad2b13fbe029e9b8fa9d1cf7bf87e7dea4"} Mar 16 16:45:27 crc kubenswrapper[5120]: I0316 16:45:27.280790 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-sc9c8" event={"ID":"18453fce-c82b-4afc-9968-e956f84798b4","Type":"ContainerStarted","Data":"6e2fc347f04d91802dae73ecbeb6e0d2491b4dd98e2ec9b0ae1ede850588c9b8"} Mar 16 16:45:27 crc kubenswrapper[5120]: I0316 16:45:27.309255 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-db-sync-sc9c8" podStartSLOduration=2.309233759 podStartE2EDuration="2.309233759s" podCreationTimestamp="2026-03-16 16:45:25 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:45:27.296167933 +0000 UTC m=+4429.450099620" watchObservedRunningTime="2026-03-16 16:45:27.309233759 +0000 UTC m=+4429.463165416" Mar 16 16:45:27 crc kubenswrapper[5120]: I0316 16:45:27.649743 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-brpdk" Mar 16 16:45:27 crc kubenswrapper[5120]: I0316 16:45:27.778606 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/4dc7fcb1-fcdc-40ec-9654-8cdc46e13e63-swiftconf\") pod \"4dc7fcb1-fcdc-40ec-9654-8cdc46e13e63\" (UID: \"4dc7fcb1-fcdc-40ec-9654-8cdc46e13e63\") " Mar 16 16:45:27 crc kubenswrapper[5120]: I0316 16:45:27.778813 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/4dc7fcb1-fcdc-40ec-9654-8cdc46e13e63-dispersionconf\") pod \"4dc7fcb1-fcdc-40ec-9654-8cdc46e13e63\" (UID: \"4dc7fcb1-fcdc-40ec-9654-8cdc46e13e63\") " Mar 16 16:45:27 crc kubenswrapper[5120]: I0316 16:45:27.778842 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/4dc7fcb1-fcdc-40ec-9654-8cdc46e13e63-etc-swift\") pod \"4dc7fcb1-fcdc-40ec-9654-8cdc46e13e63\" (UID: \"4dc7fcb1-fcdc-40ec-9654-8cdc46e13e63\") " Mar 16 16:45:27 crc kubenswrapper[5120]: I0316 16:45:27.779106 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/4dc7fcb1-fcdc-40ec-9654-8cdc46e13e63-scripts\") pod \"4dc7fcb1-fcdc-40ec-9654-8cdc46e13e63\" (UID: \"4dc7fcb1-fcdc-40ec-9654-8cdc46e13e63\") " Mar 16 16:45:27 crc kubenswrapper[5120]: I0316 16:45:27.779162 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-knmhb\" (UniqueName: \"kubernetes.io/projected/4dc7fcb1-fcdc-40ec-9654-8cdc46e13e63-kube-api-access-knmhb\") pod \"4dc7fcb1-fcdc-40ec-9654-8cdc46e13e63\" (UID: \"4dc7fcb1-fcdc-40ec-9654-8cdc46e13e63\") " Mar 16 16:45:27 crc kubenswrapper[5120]: I0316 16:45:27.779269 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/4dc7fcb1-fcdc-40ec-9654-8cdc46e13e63-ring-data-devices\") pod \"4dc7fcb1-fcdc-40ec-9654-8cdc46e13e63\" (UID: \"4dc7fcb1-fcdc-40ec-9654-8cdc46e13e63\") " Mar 16 16:45:27 crc kubenswrapper[5120]: I0316 16:45:27.779324 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4dc7fcb1-fcdc-40ec-9654-8cdc46e13e63-combined-ca-bundle\") pod \"4dc7fcb1-fcdc-40ec-9654-8cdc46e13e63\" (UID: \"4dc7fcb1-fcdc-40ec-9654-8cdc46e13e63\") " Mar 16 16:45:27 crc kubenswrapper[5120]: I0316 16:45:27.779858 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4dc7fcb1-fcdc-40ec-9654-8cdc46e13e63-etc-swift" (OuterVolumeSpecName: "etc-swift") pod "4dc7fcb1-fcdc-40ec-9654-8cdc46e13e63" (UID: "4dc7fcb1-fcdc-40ec-9654-8cdc46e13e63"). InnerVolumeSpecName "etc-swift". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:45:27 crc kubenswrapper[5120]: I0316 16:45:27.780971 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4dc7fcb1-fcdc-40ec-9654-8cdc46e13e63-ring-data-devices" (OuterVolumeSpecName: "ring-data-devices") pod "4dc7fcb1-fcdc-40ec-9654-8cdc46e13e63" (UID: "4dc7fcb1-fcdc-40ec-9654-8cdc46e13e63"). InnerVolumeSpecName "ring-data-devices". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:45:27 crc kubenswrapper[5120]: I0316 16:45:27.783956 5120 reconciler_common.go:299] "Volume detached for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/4dc7fcb1-fcdc-40ec-9654-8cdc46e13e63-ring-data-devices\") on node \"crc\" DevicePath \"\"" Mar 16 16:45:27 crc kubenswrapper[5120]: I0316 16:45:27.783988 5120 reconciler_common.go:299] "Volume detached for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/4dc7fcb1-fcdc-40ec-9654-8cdc46e13e63-etc-swift\") on node \"crc\" DevicePath \"\"" Mar 16 16:45:27 crc kubenswrapper[5120]: I0316 16:45:27.790386 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4dc7fcb1-fcdc-40ec-9654-8cdc46e13e63-dispersionconf" (OuterVolumeSpecName: "dispersionconf") pod "4dc7fcb1-fcdc-40ec-9654-8cdc46e13e63" (UID: "4dc7fcb1-fcdc-40ec-9654-8cdc46e13e63"). InnerVolumeSpecName "dispersionconf". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:45:27 crc kubenswrapper[5120]: I0316 16:45:27.795950 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4dc7fcb1-fcdc-40ec-9654-8cdc46e13e63-kube-api-access-knmhb" (OuterVolumeSpecName: "kube-api-access-knmhb") pod "4dc7fcb1-fcdc-40ec-9654-8cdc46e13e63" (UID: "4dc7fcb1-fcdc-40ec-9654-8cdc46e13e63"). InnerVolumeSpecName "kube-api-access-knmhb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:45:27 crc kubenswrapper[5120]: I0316 16:45:27.804802 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4dc7fcb1-fcdc-40ec-9654-8cdc46e13e63-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "4dc7fcb1-fcdc-40ec-9654-8cdc46e13e63" (UID: "4dc7fcb1-fcdc-40ec-9654-8cdc46e13e63"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:45:27 crc kubenswrapper[5120]: I0316 16:45:27.807860 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4dc7fcb1-fcdc-40ec-9654-8cdc46e13e63-swiftconf" (OuterVolumeSpecName: "swiftconf") pod "4dc7fcb1-fcdc-40ec-9654-8cdc46e13e63" (UID: "4dc7fcb1-fcdc-40ec-9654-8cdc46e13e63"). InnerVolumeSpecName "swiftconf". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:45:27 crc kubenswrapper[5120]: I0316 16:45:27.819388 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4dc7fcb1-fcdc-40ec-9654-8cdc46e13e63-scripts" (OuterVolumeSpecName: "scripts") pod "4dc7fcb1-fcdc-40ec-9654-8cdc46e13e63" (UID: "4dc7fcb1-fcdc-40ec-9654-8cdc46e13e63"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:45:27 crc kubenswrapper[5120]: I0316 16:45:27.885687 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-knmhb\" (UniqueName: \"kubernetes.io/projected/4dc7fcb1-fcdc-40ec-9654-8cdc46e13e63-kube-api-access-knmhb\") on node \"crc\" DevicePath \"\"" Mar 16 16:45:27 crc kubenswrapper[5120]: I0316 16:45:27.885726 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4dc7fcb1-fcdc-40ec-9654-8cdc46e13e63-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:45:27 crc kubenswrapper[5120]: I0316 16:45:27.885740 5120 reconciler_common.go:299] "Volume detached for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/4dc7fcb1-fcdc-40ec-9654-8cdc46e13e63-swiftconf\") on node \"crc\" DevicePath \"\"" Mar 16 16:45:27 crc kubenswrapper[5120]: I0316 16:45:27.885749 5120 reconciler_common.go:299] "Volume detached for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/4dc7fcb1-fcdc-40ec-9654-8cdc46e13e63-dispersionconf\") on node \"crc\" DevicePath \"\"" Mar 16 16:45:27 crc kubenswrapper[5120]: I0316 16:45:27.885783 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/4dc7fcb1-fcdc-40ec-9654-8cdc46e13e63-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:45:28 crc kubenswrapper[5120]: I0316 16:45:28.316561 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-brpdk" Mar 16 16:45:28 crc kubenswrapper[5120]: I0316 16:45:28.317531 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-brpdk" event={"ID":"4dc7fcb1-fcdc-40ec-9654-8cdc46e13e63","Type":"ContainerDied","Data":"d18f37c5361633a4267f306a04c4d277d916afc12bfec151f8e8a72b8472d7c9"} Mar 16 16:45:28 crc kubenswrapper[5120]: I0316 16:45:28.317597 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d18f37c5361633a4267f306a04c4d277d916afc12bfec151f8e8a72b8472d7c9" Mar 16 16:45:28 crc kubenswrapper[5120]: I0316 16:45:28.674514 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f918385-0755-4179-ab66-342d9bbbadd0" path="/var/lib/kubelet/pods/9f918385-0755-4179-ab66-342d9bbbadd0/volumes" Mar 16 16:45:29 crc kubenswrapper[5120]: I0316 16:45:29.629592 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/c3654d56-932f-4a2c-ae7d-c5aa896a3335-etc-swift\") pod \"swift-storage-0\" (UID: \"c3654d56-932f-4a2c-ae7d-c5aa896a3335\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:45:29 crc kubenswrapper[5120]: I0316 16:45:29.640493 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/c3654d56-932f-4a2c-ae7d-c5aa896a3335-etc-swift\") pod \"swift-storage-0\" (UID: \"c3654d56-932f-4a2c-ae7d-c5aa896a3335\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:45:29 crc kubenswrapper[5120]: I0316 16:45:29.664521 5120 scope.go:117] "RemoveContainer" containerID="35a7dd6e19084cee69ca16203bca6378ea0cdf6a685ca2093ab847e5904eb9e6" Mar 16 16:45:29 crc kubenswrapper[5120]: E0316 16:45:29.665053 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:45:29 crc kubenswrapper[5120]: I0316 16:45:29.731002 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:45:30 crc kubenswrapper[5120]: I0316 16:45:30.037601 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 16:45:30 crc kubenswrapper[5120]: I0316 16:45:30.334531 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"c3654d56-932f-4a2c-ae7d-c5aa896a3335","Type":"ContainerStarted","Data":"c7597b14c46effc0b5e75329c58fef2db86348b4ca6946ae9f6477dc35893a0e"} Mar 16 16:45:30 crc kubenswrapper[5120]: I0316 16:45:30.334899 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"c3654d56-932f-4a2c-ae7d-c5aa896a3335","Type":"ContainerStarted","Data":"2f5387837996a61ccd0f76a9a21b770c51ae72fd005a8ede0b79b657a746b128"} Mar 16 16:45:30 crc kubenswrapper[5120]: I0316 16:45:30.497083 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/community-operators-fzs4g" Mar 16 16:45:30 crc kubenswrapper[5120]: I0316 16:45:30.497149 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-marketplace/community-operators-fzs4g" Mar 16 16:45:30 crc kubenswrapper[5120]: I0316 16:45:30.563143 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/community-operators-fzs4g" Mar 16 16:45:31 crc kubenswrapper[5120]: I0316 16:45:31.361973 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"c3654d56-932f-4a2c-ae7d-c5aa896a3335","Type":"ContainerStarted","Data":"200b8316513df356c73810c0a9920beb8581c557012243461773380bc64ba067"} Mar 16 16:45:31 crc kubenswrapper[5120]: I0316 16:45:31.362572 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"c3654d56-932f-4a2c-ae7d-c5aa896a3335","Type":"ContainerStarted","Data":"e1f833adb929804d26e1c407c05f87e3c0f32afbfc09f6a35b8e8f77cf17c662"} Mar 16 16:45:31 crc kubenswrapper[5120]: I0316 16:45:31.362593 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"c3654d56-932f-4a2c-ae7d-c5aa896a3335","Type":"ContainerStarted","Data":"493264b8a5de6551d9d5bfbb72f85a7cccffbde4a4ad31f5a93c687e619bd8f3"} Mar 16 16:45:31 crc kubenswrapper[5120]: I0316 16:45:31.362603 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"c3654d56-932f-4a2c-ae7d-c5aa896a3335","Type":"ContainerStarted","Data":"a0580816327b0eb8461ef400bb4f56c4a674f2735ad70d7f9fccfeceb50b4ce0"} Mar 16 16:45:31 crc kubenswrapper[5120]: I0316 16:45:31.362616 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"c3654d56-932f-4a2c-ae7d-c5aa896a3335","Type":"ContainerStarted","Data":"0b105e090b93d50bd77aae540a71b896fad1b6b84d9968e0904aa102fa6be83c"} Mar 16 16:45:31 crc kubenswrapper[5120]: I0316 16:45:31.362627 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"c3654d56-932f-4a2c-ae7d-c5aa896a3335","Type":"ContainerStarted","Data":"ae08a40e5389e61f869b34a0c0c20a08d3c7ebdd649af11eaaeed4303c931780"} Mar 16 16:45:31 crc kubenswrapper[5120]: I0316 16:45:31.408933 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/community-operators-fzs4g" Mar 16 16:45:31 crc kubenswrapper[5120]: I0316 16:45:31.482323 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/community-operators-fzs4g"] Mar 16 16:45:31 crc kubenswrapper[5120]: I0316 16:45:31.685774 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/root-account-create-update-q5h5l"] Mar 16 16:45:31 crc kubenswrapper[5120]: I0316 16:45:31.687009 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4dc7fcb1-fcdc-40ec-9654-8cdc46e13e63" containerName="swift-ring-rebalance" Mar 16 16:45:31 crc kubenswrapper[5120]: I0316 16:45:31.687032 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="4dc7fcb1-fcdc-40ec-9654-8cdc46e13e63" containerName="swift-ring-rebalance" Mar 16 16:45:31 crc kubenswrapper[5120]: I0316 16:45:31.688168 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="4dc7fcb1-fcdc-40ec-9654-8cdc46e13e63" containerName="swift-ring-rebalance" Mar 16 16:45:31 crc kubenswrapper[5120]: I0316 16:45:31.704998 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-q5h5l"] Mar 16 16:45:31 crc kubenswrapper[5120]: I0316 16:45:31.705150 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-q5h5l" Mar 16 16:45:31 crc kubenswrapper[5120]: I0316 16:45:31.707520 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"openstack-cell1-mariadb-root-db-secret\"" Mar 16 16:45:31 crc kubenswrapper[5120]: I0316 16:45:31.783531 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/7c5fb2bc-3128-4de7-acbe-430ae8cdafa7-operator-scripts\") pod \"root-account-create-update-q5h5l\" (UID: \"7c5fb2bc-3128-4de7-acbe-430ae8cdafa7\") " pod="openstack-kuttl-tests/root-account-create-update-q5h5l" Mar 16 16:45:31 crc kubenswrapper[5120]: I0316 16:45:31.783877 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5tjm\" (UniqueName: \"kubernetes.io/projected/7c5fb2bc-3128-4de7-acbe-430ae8cdafa7-kube-api-access-r5tjm\") pod \"root-account-create-update-q5h5l\" (UID: \"7c5fb2bc-3128-4de7-acbe-430ae8cdafa7\") " pod="openstack-kuttl-tests/root-account-create-update-q5h5l" Mar 16 16:45:31 crc kubenswrapper[5120]: I0316 16:45:31.886138 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r5tjm\" (UniqueName: \"kubernetes.io/projected/7c5fb2bc-3128-4de7-acbe-430ae8cdafa7-kube-api-access-r5tjm\") pod \"root-account-create-update-q5h5l\" (UID: \"7c5fb2bc-3128-4de7-acbe-430ae8cdafa7\") " pod="openstack-kuttl-tests/root-account-create-update-q5h5l" Mar 16 16:45:31 crc kubenswrapper[5120]: I0316 16:45:31.886294 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/7c5fb2bc-3128-4de7-acbe-430ae8cdafa7-operator-scripts\") pod \"root-account-create-update-q5h5l\" (UID: \"7c5fb2bc-3128-4de7-acbe-430ae8cdafa7\") " pod="openstack-kuttl-tests/root-account-create-update-q5h5l" Mar 16 16:45:31 crc kubenswrapper[5120]: I0316 16:45:31.887733 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/7c5fb2bc-3128-4de7-acbe-430ae8cdafa7-operator-scripts\") pod \"root-account-create-update-q5h5l\" (UID: \"7c5fb2bc-3128-4de7-acbe-430ae8cdafa7\") " pod="openstack-kuttl-tests/root-account-create-update-q5h5l" Mar 16 16:45:31 crc kubenswrapper[5120]: I0316 16:45:31.902681 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5tjm\" (UniqueName: \"kubernetes.io/projected/7c5fb2bc-3128-4de7-acbe-430ae8cdafa7-kube-api-access-r5tjm\") pod \"root-account-create-update-q5h5l\" (UID: \"7c5fb2bc-3128-4de7-acbe-430ae8cdafa7\") " pod="openstack-kuttl-tests/root-account-create-update-q5h5l" Mar 16 16:45:32 crc kubenswrapper[5120]: I0316 16:45:32.079956 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-q5h5l" Mar 16 16:45:32 crc kubenswrapper[5120]: I0316 16:45:32.379566 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"c3654d56-932f-4a2c-ae7d-c5aa896a3335","Type":"ContainerStarted","Data":"7ac9c4c926a37d322994f6cad0d9392748087406803d3c491f27f39850ff7533"} Mar 16 16:45:32 crc kubenswrapper[5120]: I0316 16:45:32.380866 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"c3654d56-932f-4a2c-ae7d-c5aa896a3335","Type":"ContainerStarted","Data":"dd8a27afa3228552faad0faf477c17d3d1dbb200e35fbfca68c54c20c3200dfb"} Mar 16 16:45:32 crc kubenswrapper[5120]: I0316 16:45:32.380922 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"c3654d56-932f-4a2c-ae7d-c5aa896a3335","Type":"ContainerStarted","Data":"69b2a39b40f82d61bff95e3155bd323f14189e904e82d1bf527e593f9184d026"} Mar 16 16:45:32 crc kubenswrapper[5120]: I0316 16:45:32.380935 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"c3654d56-932f-4a2c-ae7d-c5aa896a3335","Type":"ContainerStarted","Data":"787835b144ba391e7ea878ac319488125e890928c0bbbe44d53383ad86f552c7"} Mar 16 16:45:32 crc kubenswrapper[5120]: I0316 16:45:32.380948 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"c3654d56-932f-4a2c-ae7d-c5aa896a3335","Type":"ContainerStarted","Data":"93059601596c57dd4cb0821f6b812899443bad5a5184ea352f0349395bd32703"} Mar 16 16:45:32 crc kubenswrapper[5120]: I0316 16:45:32.532149 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-q5h5l"] Mar 16 16:45:32 crc kubenswrapper[5120]: W0316 16:45:32.534750 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7c5fb2bc_3128_4de7_acbe_430ae8cdafa7.slice/crio-b62825ccae3c06ac000180825a8d6c030b284d216d1a8f61375883490b19872f WatchSource:0}: Error finding container b62825ccae3c06ac000180825a8d6c030b284d216d1a8f61375883490b19872f: Status 404 returned error can't find the container with id b62825ccae3c06ac000180825a8d6c030b284d216d1a8f61375883490b19872f Mar 16 16:45:33 crc kubenswrapper[5120]: I0316 16:45:33.392028 5120 generic.go:358] "Generic (PLEG): container finished" podID="7c5fb2bc-3128-4de7-acbe-430ae8cdafa7" containerID="b83e6960608ec3a74807b3518f907e9c9af22e76f08fe8a879983eb26ec16ce1" exitCode=0 Mar 16 16:45:33 crc kubenswrapper[5120]: I0316 16:45:33.392189 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-q5h5l" event={"ID":"7c5fb2bc-3128-4de7-acbe-430ae8cdafa7","Type":"ContainerDied","Data":"b83e6960608ec3a74807b3518f907e9c9af22e76f08fe8a879983eb26ec16ce1"} Mar 16 16:45:33 crc kubenswrapper[5120]: I0316 16:45:33.392512 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-q5h5l" event={"ID":"7c5fb2bc-3128-4de7-acbe-430ae8cdafa7","Type":"ContainerStarted","Data":"b62825ccae3c06ac000180825a8d6c030b284d216d1a8f61375883490b19872f"} Mar 16 16:45:33 crc kubenswrapper[5120]: I0316 16:45:33.398098 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"c3654d56-932f-4a2c-ae7d-c5aa896a3335","Type":"ContainerStarted","Data":"b4ea9da196622b7914ca097753c95ef95b0450f814aa7eb8b3ee9bde9a4bb236"} Mar 16 16:45:33 crc kubenswrapper[5120]: I0316 16:45:33.398136 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"c3654d56-932f-4a2c-ae7d-c5aa896a3335","Type":"ContainerStarted","Data":"840e8d5d339442d19ad82f931a88f23400d38e38958d9210156aba093a24fe32"} Mar 16 16:45:33 crc kubenswrapper[5120]: I0316 16:45:33.398149 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"c3654d56-932f-4a2c-ae7d-c5aa896a3335","Type":"ContainerStarted","Data":"bbfdb8cd78e965981b9507e7d59cc5686daa0ae97c6392812a75eafdabac1d0d"} Mar 16 16:45:33 crc kubenswrapper[5120]: I0316 16:45:33.402284 5120 generic.go:358] "Generic (PLEG): container finished" podID="18453fce-c82b-4afc-9968-e956f84798b4" containerID="cd5ef61388c2e24d085fe1734d4a14ad2b13fbe029e9b8fa9d1cf7bf87e7dea4" exitCode=0 Mar 16 16:45:33 crc kubenswrapper[5120]: I0316 16:45:33.402818 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-marketplace/community-operators-fzs4g" podUID="652479c2-1cd4-4b7a-99d1-63e3538b2aeb" containerName="registry-server" containerID="cri-o://60984be1fa47594dd1b5617e9e0ce48d462dde8e5654d8d0c93e2a732c571ef2" gracePeriod=2 Mar 16 16:45:33 crc kubenswrapper[5120]: I0316 16:45:33.403116 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-sc9c8" event={"ID":"18453fce-c82b-4afc-9968-e956f84798b4","Type":"ContainerDied","Data":"cd5ef61388c2e24d085fe1734d4a14ad2b13fbe029e9b8fa9d1cf7bf87e7dea4"} Mar 16 16:45:33 crc kubenswrapper[5120]: I0316 16:45:33.451815 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/swift-storage-0" podStartSLOduration=21.451791616 podStartE2EDuration="21.451791616s" podCreationTimestamp="2026-03-16 16:45:12 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:45:33.440850459 +0000 UTC m=+4435.594782116" watchObservedRunningTime="2026-03-16 16:45:33.451791616 +0000 UTC m=+4435.605723273" Mar 16 16:45:33 crc kubenswrapper[5120]: I0316 16:45:33.598849 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-74cc5969f7-kfk8k"] Mar 16 16:45:33 crc kubenswrapper[5120]: I0316 16:45:33.606412 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-74cc5969f7-kfk8k" Mar 16 16:45:33 crc kubenswrapper[5120]: I0316 16:45:33.609032 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"dns-swift-storage-0\"" Mar 16 16:45:33 crc kubenswrapper[5120]: I0316 16:45:33.610927 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-74cc5969f7-kfk8k"] Mar 16 16:45:33 crc kubenswrapper[5120]: I0316 16:45:33.736965 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vpqr9\" (UniqueName: \"kubernetes.io/projected/7f52f9e0-b276-4df9-8e45-dbffbd69c651-kube-api-access-vpqr9\") pod \"dnsmasq-dnsmasq-74cc5969f7-kfk8k\" (UID: \"7f52f9e0-b276-4df9-8e45-dbffbd69c651\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-74cc5969f7-kfk8k" Mar 16 16:45:33 crc kubenswrapper[5120]: I0316 16:45:33.737320 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/7f52f9e0-b276-4df9-8e45-dbffbd69c651-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-74cc5969f7-kfk8k\" (UID: \"7f52f9e0-b276-4df9-8e45-dbffbd69c651\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-74cc5969f7-kfk8k" Mar 16 16:45:33 crc kubenswrapper[5120]: I0316 16:45:33.737355 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7f52f9e0-b276-4df9-8e45-dbffbd69c651-config\") pod \"dnsmasq-dnsmasq-74cc5969f7-kfk8k\" (UID: \"7f52f9e0-b276-4df9-8e45-dbffbd69c651\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-74cc5969f7-kfk8k" Mar 16 16:45:33 crc kubenswrapper[5120]: I0316 16:45:33.737424 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/7f52f9e0-b276-4df9-8e45-dbffbd69c651-dns-swift-storage-0\") pod \"dnsmasq-dnsmasq-74cc5969f7-kfk8k\" (UID: \"7f52f9e0-b276-4df9-8e45-dbffbd69c651\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-74cc5969f7-kfk8k" Mar 16 16:45:33 crc kubenswrapper[5120]: I0316 16:45:33.841153 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vpqr9\" (UniqueName: \"kubernetes.io/projected/7f52f9e0-b276-4df9-8e45-dbffbd69c651-kube-api-access-vpqr9\") pod \"dnsmasq-dnsmasq-74cc5969f7-kfk8k\" (UID: \"7f52f9e0-b276-4df9-8e45-dbffbd69c651\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-74cc5969f7-kfk8k" Mar 16 16:45:33 crc kubenswrapper[5120]: I0316 16:45:33.841242 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/7f52f9e0-b276-4df9-8e45-dbffbd69c651-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-74cc5969f7-kfk8k\" (UID: \"7f52f9e0-b276-4df9-8e45-dbffbd69c651\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-74cc5969f7-kfk8k" Mar 16 16:45:33 crc kubenswrapper[5120]: I0316 16:45:33.841288 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7f52f9e0-b276-4df9-8e45-dbffbd69c651-config\") pod \"dnsmasq-dnsmasq-74cc5969f7-kfk8k\" (UID: \"7f52f9e0-b276-4df9-8e45-dbffbd69c651\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-74cc5969f7-kfk8k" Mar 16 16:45:33 crc kubenswrapper[5120]: I0316 16:45:33.841379 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/7f52f9e0-b276-4df9-8e45-dbffbd69c651-dns-swift-storage-0\") pod \"dnsmasq-dnsmasq-74cc5969f7-kfk8k\" (UID: \"7f52f9e0-b276-4df9-8e45-dbffbd69c651\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-74cc5969f7-kfk8k" Mar 16 16:45:33 crc kubenswrapper[5120]: I0316 16:45:33.842644 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/7f52f9e0-b276-4df9-8e45-dbffbd69c651-dns-swift-storage-0\") pod \"dnsmasq-dnsmasq-74cc5969f7-kfk8k\" (UID: \"7f52f9e0-b276-4df9-8e45-dbffbd69c651\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-74cc5969f7-kfk8k" Mar 16 16:45:33 crc kubenswrapper[5120]: I0316 16:45:33.843532 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7f52f9e0-b276-4df9-8e45-dbffbd69c651-config\") pod \"dnsmasq-dnsmasq-74cc5969f7-kfk8k\" (UID: \"7f52f9e0-b276-4df9-8e45-dbffbd69c651\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-74cc5969f7-kfk8k" Mar 16 16:45:33 crc kubenswrapper[5120]: I0316 16:45:33.843569 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/7f52f9e0-b276-4df9-8e45-dbffbd69c651-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-74cc5969f7-kfk8k\" (UID: \"7f52f9e0-b276-4df9-8e45-dbffbd69c651\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-74cc5969f7-kfk8k" Mar 16 16:45:33 crc kubenswrapper[5120]: I0316 16:45:33.866171 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vpqr9\" (UniqueName: \"kubernetes.io/projected/7f52f9e0-b276-4df9-8e45-dbffbd69c651-kube-api-access-vpqr9\") pod \"dnsmasq-dnsmasq-74cc5969f7-kfk8k\" (UID: \"7f52f9e0-b276-4df9-8e45-dbffbd69c651\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-74cc5969f7-kfk8k" Mar 16 16:45:33 crc kubenswrapper[5120]: I0316 16:45:33.913090 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-fzs4g" Mar 16 16:45:33 crc kubenswrapper[5120]: I0316 16:45:33.934160 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-74cc5969f7-kfk8k" Mar 16 16:45:34 crc kubenswrapper[5120]: I0316 16:45:34.072721 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/652479c2-1cd4-4b7a-99d1-63e3538b2aeb-utilities\") pod \"652479c2-1cd4-4b7a-99d1-63e3538b2aeb\" (UID: \"652479c2-1cd4-4b7a-99d1-63e3538b2aeb\") " Mar 16 16:45:34 crc kubenswrapper[5120]: I0316 16:45:34.073011 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/652479c2-1cd4-4b7a-99d1-63e3538b2aeb-catalog-content\") pod \"652479c2-1cd4-4b7a-99d1-63e3538b2aeb\" (UID: \"652479c2-1cd4-4b7a-99d1-63e3538b2aeb\") " Mar 16 16:45:34 crc kubenswrapper[5120]: I0316 16:45:34.073141 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-97dhm\" (UniqueName: \"kubernetes.io/projected/652479c2-1cd4-4b7a-99d1-63e3538b2aeb-kube-api-access-97dhm\") pod \"652479c2-1cd4-4b7a-99d1-63e3538b2aeb\" (UID: \"652479c2-1cd4-4b7a-99d1-63e3538b2aeb\") " Mar 16 16:45:34 crc kubenswrapper[5120]: I0316 16:45:34.076334 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/652479c2-1cd4-4b7a-99d1-63e3538b2aeb-utilities" (OuterVolumeSpecName: "utilities") pod "652479c2-1cd4-4b7a-99d1-63e3538b2aeb" (UID: "652479c2-1cd4-4b7a-99d1-63e3538b2aeb"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:45:34 crc kubenswrapper[5120]: I0316 16:45:34.081628 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/652479c2-1cd4-4b7a-99d1-63e3538b2aeb-kube-api-access-97dhm" (OuterVolumeSpecName: "kube-api-access-97dhm") pod "652479c2-1cd4-4b7a-99d1-63e3538b2aeb" (UID: "652479c2-1cd4-4b7a-99d1-63e3538b2aeb"). InnerVolumeSpecName "kube-api-access-97dhm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:45:34 crc kubenswrapper[5120]: I0316 16:45:34.138747 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/652479c2-1cd4-4b7a-99d1-63e3538b2aeb-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "652479c2-1cd4-4b7a-99d1-63e3538b2aeb" (UID: "652479c2-1cd4-4b7a-99d1-63e3538b2aeb"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:45:34 crc kubenswrapper[5120]: I0316 16:45:34.177129 5120 reconciler_common.go:299] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/652479c2-1cd4-4b7a-99d1-63e3538b2aeb-utilities\") on node \"crc\" DevicePath \"\"" Mar 16 16:45:34 crc kubenswrapper[5120]: I0316 16:45:34.177219 5120 reconciler_common.go:299] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/652479c2-1cd4-4b7a-99d1-63e3538b2aeb-catalog-content\") on node \"crc\" DevicePath \"\"" Mar 16 16:45:34 crc kubenswrapper[5120]: I0316 16:45:34.177237 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-97dhm\" (UniqueName: \"kubernetes.io/projected/652479c2-1cd4-4b7a-99d1-63e3538b2aeb-kube-api-access-97dhm\") on node \"crc\" DevicePath \"\"" Mar 16 16:45:34 crc kubenswrapper[5120]: I0316 16:45:34.413040 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-74cc5969f7-kfk8k"] Mar 16 16:45:34 crc kubenswrapper[5120]: I0316 16:45:34.413545 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-fzs4g" Mar 16 16:45:34 crc kubenswrapper[5120]: I0316 16:45:34.413453 5120 generic.go:358] "Generic (PLEG): container finished" podID="652479c2-1cd4-4b7a-99d1-63e3538b2aeb" containerID="60984be1fa47594dd1b5617e9e0ce48d462dde8e5654d8d0c93e2a732c571ef2" exitCode=0 Mar 16 16:45:34 crc kubenswrapper[5120]: I0316 16:45:34.413689 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-fzs4g" event={"ID":"652479c2-1cd4-4b7a-99d1-63e3538b2aeb","Type":"ContainerDied","Data":"60984be1fa47594dd1b5617e9e0ce48d462dde8e5654d8d0c93e2a732c571ef2"} Mar 16 16:45:34 crc kubenswrapper[5120]: I0316 16:45:34.413918 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-fzs4g" event={"ID":"652479c2-1cd4-4b7a-99d1-63e3538b2aeb","Type":"ContainerDied","Data":"f384ad93bc853f8b429ad07539c73de152caf603e28e4eeae4129d4e326f190d"} Mar 16 16:45:34 crc kubenswrapper[5120]: I0316 16:45:34.413961 5120 scope.go:117] "RemoveContainer" containerID="60984be1fa47594dd1b5617e9e0ce48d462dde8e5654d8d0c93e2a732c571ef2" Mar 16 16:45:34 crc kubenswrapper[5120]: W0316 16:45:34.416439 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7f52f9e0_b276_4df9_8e45_dbffbd69c651.slice/crio-eb1eab63a35164cc3a60c41943d0aac6261c365e196af60eb6f311fcd4633786 WatchSource:0}: Error finding container eb1eab63a35164cc3a60c41943d0aac6261c365e196af60eb6f311fcd4633786: Status 404 returned error can't find the container with id eb1eab63a35164cc3a60c41943d0aac6261c365e196af60eb6f311fcd4633786 Mar 16 16:45:34 crc kubenswrapper[5120]: I0316 16:45:34.444824 5120 scope.go:117] "RemoveContainer" containerID="db5773329f8d6f67c82e5cb9ebda278a4b8d2c06f4fb07dd501c49605ad5c9cb" Mar 16 16:45:34 crc kubenswrapper[5120]: I0316 16:45:34.447392 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/community-operators-fzs4g"] Mar 16 16:45:34 crc kubenswrapper[5120]: I0316 16:45:34.454962 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/community-operators-fzs4g"] Mar 16 16:45:34 crc kubenswrapper[5120]: I0316 16:45:34.482349 5120 scope.go:117] "RemoveContainer" containerID="26aac9012b9a66dfd5b1b7364f9c3985b1b9405f95d2cd6ed10d03c076a11aa4" Mar 16 16:45:34 crc kubenswrapper[5120]: I0316 16:45:34.526040 5120 scope.go:117] "RemoveContainer" containerID="60984be1fa47594dd1b5617e9e0ce48d462dde8e5654d8d0c93e2a732c571ef2" Mar 16 16:45:34 crc kubenswrapper[5120]: E0316 16:45:34.526846 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"60984be1fa47594dd1b5617e9e0ce48d462dde8e5654d8d0c93e2a732c571ef2\": container with ID starting with 60984be1fa47594dd1b5617e9e0ce48d462dde8e5654d8d0c93e2a732c571ef2 not found: ID does not exist" containerID="60984be1fa47594dd1b5617e9e0ce48d462dde8e5654d8d0c93e2a732c571ef2" Mar 16 16:45:34 crc kubenswrapper[5120]: I0316 16:45:34.526879 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60984be1fa47594dd1b5617e9e0ce48d462dde8e5654d8d0c93e2a732c571ef2"} err="failed to get container status \"60984be1fa47594dd1b5617e9e0ce48d462dde8e5654d8d0c93e2a732c571ef2\": rpc error: code = NotFound desc = could not find container \"60984be1fa47594dd1b5617e9e0ce48d462dde8e5654d8d0c93e2a732c571ef2\": container with ID starting with 60984be1fa47594dd1b5617e9e0ce48d462dde8e5654d8d0c93e2a732c571ef2 not found: ID does not exist" Mar 16 16:45:34 crc kubenswrapper[5120]: I0316 16:45:34.526907 5120 scope.go:117] "RemoveContainer" containerID="db5773329f8d6f67c82e5cb9ebda278a4b8d2c06f4fb07dd501c49605ad5c9cb" Mar 16 16:45:34 crc kubenswrapper[5120]: E0316 16:45:34.527176 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db5773329f8d6f67c82e5cb9ebda278a4b8d2c06f4fb07dd501c49605ad5c9cb\": container with ID starting with db5773329f8d6f67c82e5cb9ebda278a4b8d2c06f4fb07dd501c49605ad5c9cb not found: ID does not exist" containerID="db5773329f8d6f67c82e5cb9ebda278a4b8d2c06f4fb07dd501c49605ad5c9cb" Mar 16 16:45:34 crc kubenswrapper[5120]: I0316 16:45:34.527298 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db5773329f8d6f67c82e5cb9ebda278a4b8d2c06f4fb07dd501c49605ad5c9cb"} err="failed to get container status \"db5773329f8d6f67c82e5cb9ebda278a4b8d2c06f4fb07dd501c49605ad5c9cb\": rpc error: code = NotFound desc = could not find container \"db5773329f8d6f67c82e5cb9ebda278a4b8d2c06f4fb07dd501c49605ad5c9cb\": container with ID starting with db5773329f8d6f67c82e5cb9ebda278a4b8d2c06f4fb07dd501c49605ad5c9cb not found: ID does not exist" Mar 16 16:45:34 crc kubenswrapper[5120]: I0316 16:45:34.527399 5120 scope.go:117] "RemoveContainer" containerID="26aac9012b9a66dfd5b1b7364f9c3985b1b9405f95d2cd6ed10d03c076a11aa4" Mar 16 16:45:34 crc kubenswrapper[5120]: E0316 16:45:34.527780 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"26aac9012b9a66dfd5b1b7364f9c3985b1b9405f95d2cd6ed10d03c076a11aa4\": container with ID starting with 26aac9012b9a66dfd5b1b7364f9c3985b1b9405f95d2cd6ed10d03c076a11aa4 not found: ID does not exist" containerID="26aac9012b9a66dfd5b1b7364f9c3985b1b9405f95d2cd6ed10d03c076a11aa4" Mar 16 16:45:34 crc kubenswrapper[5120]: I0316 16:45:34.527823 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26aac9012b9a66dfd5b1b7364f9c3985b1b9405f95d2cd6ed10d03c076a11aa4"} err="failed to get container status \"26aac9012b9a66dfd5b1b7364f9c3985b1b9405f95d2cd6ed10d03c076a11aa4\": rpc error: code = NotFound desc = could not find container \"26aac9012b9a66dfd5b1b7364f9c3985b1b9405f95d2cd6ed10d03c076a11aa4\": container with ID starting with 26aac9012b9a66dfd5b1b7364f9c3985b1b9405f95d2cd6ed10d03c076a11aa4 not found: ID does not exist" Mar 16 16:45:34 crc kubenswrapper[5120]: I0316 16:45:34.679481 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="652479c2-1cd4-4b7a-99d1-63e3538b2aeb" path="/var/lib/kubelet/pods/652479c2-1cd4-4b7a-99d1-63e3538b2aeb/volumes" Mar 16 16:45:34 crc kubenswrapper[5120]: I0316 16:45:34.766398 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-sc9c8" Mar 16 16:45:34 crc kubenswrapper[5120]: I0316 16:45:34.771954 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-q5h5l" Mar 16 16:45:34 crc kubenswrapper[5120]: I0316 16:45:34.790080 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/18453fce-c82b-4afc-9968-e956f84798b4-db-sync-config-data\") pod \"18453fce-c82b-4afc-9968-e956f84798b4\" (UID: \"18453fce-c82b-4afc-9968-e956f84798b4\") " Mar 16 16:45:34 crc kubenswrapper[5120]: I0316 16:45:34.790415 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/18453fce-c82b-4afc-9968-e956f84798b4-combined-ca-bundle\") pod \"18453fce-c82b-4afc-9968-e956f84798b4\" (UID: \"18453fce-c82b-4afc-9968-e956f84798b4\") " Mar 16 16:45:34 crc kubenswrapper[5120]: I0316 16:45:34.790507 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/7c5fb2bc-3128-4de7-acbe-430ae8cdafa7-operator-scripts\") pod \"7c5fb2bc-3128-4de7-acbe-430ae8cdafa7\" (UID: \"7c5fb2bc-3128-4de7-acbe-430ae8cdafa7\") " Mar 16 16:45:34 crc kubenswrapper[5120]: I0316 16:45:34.790539 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pzxf4\" (UniqueName: \"kubernetes.io/projected/18453fce-c82b-4afc-9968-e956f84798b4-kube-api-access-pzxf4\") pod \"18453fce-c82b-4afc-9968-e956f84798b4\" (UID: \"18453fce-c82b-4afc-9968-e956f84798b4\") " Mar 16 16:45:34 crc kubenswrapper[5120]: I0316 16:45:34.790563 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r5tjm\" (UniqueName: \"kubernetes.io/projected/7c5fb2bc-3128-4de7-acbe-430ae8cdafa7-kube-api-access-r5tjm\") pod \"7c5fb2bc-3128-4de7-acbe-430ae8cdafa7\" (UID: \"7c5fb2bc-3128-4de7-acbe-430ae8cdafa7\") " Mar 16 16:45:34 crc kubenswrapper[5120]: I0316 16:45:34.790702 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/18453fce-c82b-4afc-9968-e956f84798b4-config-data\") pod \"18453fce-c82b-4afc-9968-e956f84798b4\" (UID: \"18453fce-c82b-4afc-9968-e956f84798b4\") " Mar 16 16:45:34 crc kubenswrapper[5120]: I0316 16:45:34.791130 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c5fb2bc-3128-4de7-acbe-430ae8cdafa7-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "7c5fb2bc-3128-4de7-acbe-430ae8cdafa7" (UID: "7c5fb2bc-3128-4de7-acbe-430ae8cdafa7"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:45:34 crc kubenswrapper[5120]: I0316 16:45:34.800614 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18453fce-c82b-4afc-9968-e956f84798b4-db-sync-config-data" (OuterVolumeSpecName: "db-sync-config-data") pod "18453fce-c82b-4afc-9968-e956f84798b4" (UID: "18453fce-c82b-4afc-9968-e956f84798b4"). InnerVolumeSpecName "db-sync-config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:45:34 crc kubenswrapper[5120]: I0316 16:45:34.800931 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c5fb2bc-3128-4de7-acbe-430ae8cdafa7-kube-api-access-r5tjm" (OuterVolumeSpecName: "kube-api-access-r5tjm") pod "7c5fb2bc-3128-4de7-acbe-430ae8cdafa7" (UID: "7c5fb2bc-3128-4de7-acbe-430ae8cdafa7"). InnerVolumeSpecName "kube-api-access-r5tjm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:45:34 crc kubenswrapper[5120]: I0316 16:45:34.804366 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18453fce-c82b-4afc-9968-e956f84798b4-kube-api-access-pzxf4" (OuterVolumeSpecName: "kube-api-access-pzxf4") pod "18453fce-c82b-4afc-9968-e956f84798b4" (UID: "18453fce-c82b-4afc-9968-e956f84798b4"). InnerVolumeSpecName "kube-api-access-pzxf4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:45:34 crc kubenswrapper[5120]: I0316 16:45:34.820910 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18453fce-c82b-4afc-9968-e956f84798b4-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "18453fce-c82b-4afc-9968-e956f84798b4" (UID: "18453fce-c82b-4afc-9968-e956f84798b4"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:45:34 crc kubenswrapper[5120]: I0316 16:45:34.842268 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18453fce-c82b-4afc-9968-e956f84798b4-config-data" (OuterVolumeSpecName: "config-data") pod "18453fce-c82b-4afc-9968-e956f84798b4" (UID: "18453fce-c82b-4afc-9968-e956f84798b4"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:45:34 crc kubenswrapper[5120]: I0316 16:45:34.892514 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/18453fce-c82b-4afc-9968-e956f84798b4-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:45:34 crc kubenswrapper[5120]: I0316 16:45:34.892553 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/7c5fb2bc-3128-4de7-acbe-430ae8cdafa7-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:45:34 crc kubenswrapper[5120]: I0316 16:45:34.892567 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pzxf4\" (UniqueName: \"kubernetes.io/projected/18453fce-c82b-4afc-9968-e956f84798b4-kube-api-access-pzxf4\") on node \"crc\" DevicePath \"\"" Mar 16 16:45:34 crc kubenswrapper[5120]: I0316 16:45:34.892579 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r5tjm\" (UniqueName: \"kubernetes.io/projected/7c5fb2bc-3128-4de7-acbe-430ae8cdafa7-kube-api-access-r5tjm\") on node \"crc\" DevicePath \"\"" Mar 16 16:45:34 crc kubenswrapper[5120]: I0316 16:45:34.892589 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/18453fce-c82b-4afc-9968-e956f84798b4-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:45:34 crc kubenswrapper[5120]: I0316 16:45:34.892598 5120 reconciler_common.go:299] "Volume detached for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/18453fce-c82b-4afc-9968-e956f84798b4-db-sync-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:45:35 crc kubenswrapper[5120]: I0316 16:45:35.426223 5120 generic.go:358] "Generic (PLEG): container finished" podID="7f52f9e0-b276-4df9-8e45-dbffbd69c651" containerID="fb65141ffc8c1d8df6608fedbcd6dd675c38fe59ae0d9365982202b46f7ab811" exitCode=0 Mar 16 16:45:35 crc kubenswrapper[5120]: I0316 16:45:35.426669 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-74cc5969f7-kfk8k" event={"ID":"7f52f9e0-b276-4df9-8e45-dbffbd69c651","Type":"ContainerDied","Data":"fb65141ffc8c1d8df6608fedbcd6dd675c38fe59ae0d9365982202b46f7ab811"} Mar 16 16:45:35 crc kubenswrapper[5120]: I0316 16:45:35.426708 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-74cc5969f7-kfk8k" event={"ID":"7f52f9e0-b276-4df9-8e45-dbffbd69c651","Type":"ContainerStarted","Data":"eb1eab63a35164cc3a60c41943d0aac6261c365e196af60eb6f311fcd4633786"} Mar 16 16:45:35 crc kubenswrapper[5120]: I0316 16:45:35.433804 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-q5h5l" Mar 16 16:45:35 crc kubenswrapper[5120]: I0316 16:45:35.433871 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-q5h5l" event={"ID":"7c5fb2bc-3128-4de7-acbe-430ae8cdafa7","Type":"ContainerDied","Data":"b62825ccae3c06ac000180825a8d6c030b284d216d1a8f61375883490b19872f"} Mar 16 16:45:35 crc kubenswrapper[5120]: I0316 16:45:35.433907 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b62825ccae3c06ac000180825a8d6c030b284d216d1a8f61375883490b19872f" Mar 16 16:45:35 crc kubenswrapper[5120]: I0316 16:45:35.436197 5120 generic.go:358] "Generic (PLEG): container finished" podID="07aa860b-bb17-4a36-bc23-549bfd1bdb5c" containerID="c884d9c9de37e1f61b04f7eb0e974e6a6a3ec2080b77e6a8aa54d6abdc051364" exitCode=0 Mar 16 16:45:35 crc kubenswrapper[5120]: I0316 16:45:35.436271 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"07aa860b-bb17-4a36-bc23-549bfd1bdb5c","Type":"ContainerDied","Data":"c884d9c9de37e1f61b04f7eb0e974e6a6a3ec2080b77e6a8aa54d6abdc051364"} Mar 16 16:45:35 crc kubenswrapper[5120]: I0316 16:45:35.461071 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-sc9c8" Mar 16 16:45:35 crc kubenswrapper[5120]: I0316 16:45:35.461099 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-sc9c8" event={"ID":"18453fce-c82b-4afc-9968-e956f84798b4","Type":"ContainerDied","Data":"6e2fc347f04d91802dae73ecbeb6e0d2491b4dd98e2ec9b0ae1ede850588c9b8"} Mar 16 16:45:35 crc kubenswrapper[5120]: I0316 16:45:35.463771 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6e2fc347f04d91802dae73ecbeb6e0d2491b4dd98e2ec9b0ae1ede850588c9b8" Mar 16 16:45:35 crc kubenswrapper[5120]: I0316 16:45:35.472559 5120 generic.go:358] "Generic (PLEG): container finished" podID="aa12529b-b6fe-4512-88ec-fd6250636e6b" containerID="f182e6699482e456fa658eb8a49ef764c4fb838a5601db8f345f511d180cfe9d" exitCode=0 Mar 16 16:45:35 crc kubenswrapper[5120]: I0316 16:45:35.472725 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"aa12529b-b6fe-4512-88ec-fd6250636e6b","Type":"ContainerDied","Data":"f182e6699482e456fa658eb8a49ef764c4fb838a5601db8f345f511d180cfe9d"} Mar 16 16:45:36 crc kubenswrapper[5120]: I0316 16:45:36.486592 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-74cc5969f7-kfk8k" event={"ID":"7f52f9e0-b276-4df9-8e45-dbffbd69c651","Type":"ContainerStarted","Data":"fa1db73021ede1a006e697bc3f0126bb6863797006fe50ecdfc444501b2254e4"} Mar 16 16:45:36 crc kubenswrapper[5120]: I0316 16:45:36.488652 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-74cc5969f7-kfk8k" Mar 16 16:45:36 crc kubenswrapper[5120]: I0316 16:45:36.493117 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"07aa860b-bb17-4a36-bc23-549bfd1bdb5c","Type":"ContainerStarted","Data":"45cb557a01c4d5f3fcaf3f1ae59379de4a157caa00add93b62710010548ac944"} Mar 16 16:45:36 crc kubenswrapper[5120]: I0316 16:45:36.494229 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:45:36 crc kubenswrapper[5120]: I0316 16:45:36.499110 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"aa12529b-b6fe-4512-88ec-fd6250636e6b","Type":"ContainerStarted","Data":"c850be05d5aca34a4b506a8d1a6a6816d3a77902224755fcceb07ca0e744a3d9"} Mar 16 16:45:36 crc kubenswrapper[5120]: I0316 16:45:36.499448 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:45:36 crc kubenswrapper[5120]: I0316 16:45:36.509325 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-74cc5969f7-kfk8k" podStartSLOduration=3.509308441 podStartE2EDuration="3.509308441s" podCreationTimestamp="2026-03-16 16:45:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:45:36.505300082 +0000 UTC m=+4438.659231739" watchObservedRunningTime="2026-03-16 16:45:36.509308441 +0000 UTC m=+4438.663240098" Mar 16 16:45:36 crc kubenswrapper[5120]: I0316 16:45:36.536964 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/rabbitmq-server-0" podStartSLOduration=37.536945203 podStartE2EDuration="37.536945203s" podCreationTimestamp="2026-03-16 16:44:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:45:36.530532438 +0000 UTC m=+4438.684464095" watchObservedRunningTime="2026-03-16 16:45:36.536945203 +0000 UTC m=+4438.690876860" Mar 16 16:45:36 crc kubenswrapper[5120]: I0316 16:45:36.555662 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" podStartSLOduration=37.555646251 podStartE2EDuration="37.555646251s" podCreationTimestamp="2026-03-16 16:44:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:45:36.550345677 +0000 UTC m=+4438.704277344" watchObservedRunningTime="2026-03-16 16:45:36.555646251 +0000 UTC m=+4438.709577908" Mar 16 16:45:37 crc kubenswrapper[5120]: I0316 16:45:37.757656 5120 scope.go:117] "RemoveContainer" containerID="63cfde29ac69f24622db3a28187c689db5dd4bd7908171895f855b2c6e7263c8" Mar 16 16:45:37 crc kubenswrapper[5120]: I0316 16:45:37.800837 5120 scope.go:117] "RemoveContainer" containerID="483d08a5279d4367a54d826fe3767bef54853fe8eaff4ffac1b2e2a616b3ae0a" Mar 16 16:45:37 crc kubenswrapper[5120]: I0316 16:45:37.842747 5120 scope.go:117] "RemoveContainer" containerID="ae25a6c587c5c5508fcd3541867071191504faa725bea4248513c9f83dbb4631" Mar 16 16:45:37 crc kubenswrapper[5120]: I0316 16:45:37.876077 5120 scope.go:117] "RemoveContainer" containerID="53dec2e731a16b8c8d0ddcbd5b18223642ebf861238f5bfe2eedc21cbfa05f36" Mar 16 16:45:37 crc kubenswrapper[5120]: I0316 16:45:37.941800 5120 scope.go:117] "RemoveContainer" containerID="0e197c8883c5a4c52de582c21153015258d0c3f6e9781165ce6fbd7a3ba4237d" Mar 16 16:45:38 crc kubenswrapper[5120]: I0316 16:45:38.077386 5120 scope.go:117] "RemoveContainer" containerID="78b77907c1d13b432373236bb4fd675e45a1ec106ff24df85b87cd78b07d68da" Mar 16 16:45:38 crc kubenswrapper[5120]: I0316 16:45:38.107943 5120 scope.go:117] "RemoveContainer" containerID="671727f21c19391699a48ba467425210ed9412567d45a035a011960cf10b8083" Mar 16 16:45:38 crc kubenswrapper[5120]: I0316 16:45:38.130100 5120 scope.go:117] "RemoveContainer" containerID="ab2aac04dcebfe12e4c30a3b88a8433a48f2665d7865b4724dcb80b22c847fab" Mar 16 16:45:38 crc kubenswrapper[5120]: I0316 16:45:38.177051 5120 scope.go:117] "RemoveContainer" containerID="838fae15b9db6ddab356245c05fa306279bee839c450edfe59d4de45363856e5" Mar 16 16:45:38 crc kubenswrapper[5120]: I0316 16:45:38.197441 5120 scope.go:117] "RemoveContainer" containerID="1978d7f9e8f99221895ea11f152efe0727ab985422889237aaa63909eda39aa9" Mar 16 16:45:38 crc kubenswrapper[5120]: I0316 16:45:38.223170 5120 scope.go:117] "RemoveContainer" containerID="4fe6d4906da166d68c4b5d6b41135d9cd612eaaa1bc55ea677529e11ccda2135" Mar 16 16:45:38 crc kubenswrapper[5120]: I0316 16:45:38.251913 5120 scope.go:117] "RemoveContainer" containerID="bb36d9bd5a502a8c48a5d57ca30444cb0718354b3de8db27ed27b4e9bdee39cc" Mar 16 16:45:38 crc kubenswrapper[5120]: I0316 16:45:38.272585 5120 scope.go:117] "RemoveContainer" containerID="994c828c806bfdb142a901d77444445c3c3aa899b6dba52d3d97f46faaf0751b" Mar 16 16:45:38 crc kubenswrapper[5120]: I0316 16:45:38.294169 5120 scope.go:117] "RemoveContainer" containerID="9fafffe8e551ef6b479e3dc0200fa80bb8633e25a9651a938e66de976a4120f1" Mar 16 16:45:38 crc kubenswrapper[5120]: I0316 16:45:38.317726 5120 scope.go:117] "RemoveContainer" containerID="f2b4d561e1e561ce166fd8d0d7036db69799932e866a7a79308d75218affb790" Mar 16 16:45:38 crc kubenswrapper[5120]: I0316 16:45:38.338543 5120 scope.go:117] "RemoveContainer" containerID="988e19eb0acc93d4a8a5ebc97f5bf497c0ec4b10a4992295c7e6466c2d786cf4" Mar 16 16:45:38 crc kubenswrapper[5120]: I0316 16:45:38.362052 5120 scope.go:117] "RemoveContainer" containerID="5ea460f810b64999bc8fc233431ed646811feda5936c1adb68a0d2fac4932f26" Mar 16 16:45:38 crc kubenswrapper[5120]: I0316 16:45:38.390828 5120 scope.go:117] "RemoveContainer" containerID="ba7906458f732cf2c694eb801cb26f6b5d624ea022de95c9791781425a728ed6" Mar 16 16:45:38 crc kubenswrapper[5120]: I0316 16:45:38.409289 5120 scope.go:117] "RemoveContainer" containerID="c20aefa9bd92f7e1b99a18865a094ad259349bffc1eb8901a61f4cc1ed362b8f" Mar 16 16:45:38 crc kubenswrapper[5120]: I0316 16:45:38.426897 5120 scope.go:117] "RemoveContainer" containerID="20374014efa7cadfd8553df2e44fec4911491d578bbb16e3dcc04603a70e4ffb" Mar 16 16:45:38 crc kubenswrapper[5120]: I0316 16:45:38.448419 5120 scope.go:117] "RemoveContainer" containerID="69989ceb3c4bbe3d7a321c34ebc6a1f593eb691b0ecac9d51a6a59174a662a06" Mar 16 16:45:43 crc kubenswrapper[5120]: I0316 16:45:43.554971 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-74cc5969f7-kfk8k" Mar 16 16:45:43 crc kubenswrapper[5120]: I0316 16:45:43.630130 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-htctf"] Mar 16 16:45:43 crc kubenswrapper[5120]: I0316 16:45:43.631023 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-htctf" podUID="f734a4b4-4089-4b1e-9e09-3ebb426667bf" containerName="dnsmasq-dns" containerID="cri-o://aeea82b0bb6261dbfad8929e406fae0c2aa02bacb16dd00a79c767d5fd26bc74" gracePeriod=10 Mar 16 16:45:43 crc kubenswrapper[5120]: I0316 16:45:43.665686 5120 scope.go:117] "RemoveContainer" containerID="35a7dd6e19084cee69ca16203bca6378ea0cdf6a685ca2093ab847e5904eb9e6" Mar 16 16:45:43 crc kubenswrapper[5120]: E0316 16:45:43.666128 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:45:44 crc kubenswrapper[5120]: I0316 16:45:44.135196 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-htctf" Mar 16 16:45:44 crc kubenswrapper[5120]: I0316 16:45:44.222592 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/f734a4b4-4089-4b1e-9e09-3ebb426667bf-dnsmasq-svc\") pod \"f734a4b4-4089-4b1e-9e09-3ebb426667bf\" (UID: \"f734a4b4-4089-4b1e-9e09-3ebb426667bf\") " Mar 16 16:45:44 crc kubenswrapper[5120]: I0316 16:45:44.222681 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w4chw\" (UniqueName: \"kubernetes.io/projected/f734a4b4-4089-4b1e-9e09-3ebb426667bf-kube-api-access-w4chw\") pod \"f734a4b4-4089-4b1e-9e09-3ebb426667bf\" (UID: \"f734a4b4-4089-4b1e-9e09-3ebb426667bf\") " Mar 16 16:45:44 crc kubenswrapper[5120]: I0316 16:45:44.222903 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f734a4b4-4089-4b1e-9e09-3ebb426667bf-config\") pod \"f734a4b4-4089-4b1e-9e09-3ebb426667bf\" (UID: \"f734a4b4-4089-4b1e-9e09-3ebb426667bf\") " Mar 16 16:45:44 crc kubenswrapper[5120]: I0316 16:45:44.231785 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f734a4b4-4089-4b1e-9e09-3ebb426667bf-kube-api-access-w4chw" (OuterVolumeSpecName: "kube-api-access-w4chw") pod "f734a4b4-4089-4b1e-9e09-3ebb426667bf" (UID: "f734a4b4-4089-4b1e-9e09-3ebb426667bf"). InnerVolumeSpecName "kube-api-access-w4chw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:45:44 crc kubenswrapper[5120]: I0316 16:45:44.275909 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f734a4b4-4089-4b1e-9e09-3ebb426667bf-config" (OuterVolumeSpecName: "config") pod "f734a4b4-4089-4b1e-9e09-3ebb426667bf" (UID: "f734a4b4-4089-4b1e-9e09-3ebb426667bf"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:45:44 crc kubenswrapper[5120]: I0316 16:45:44.277196 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f734a4b4-4089-4b1e-9e09-3ebb426667bf-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "f734a4b4-4089-4b1e-9e09-3ebb426667bf" (UID: "f734a4b4-4089-4b1e-9e09-3ebb426667bf"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:45:44 crc kubenswrapper[5120]: I0316 16:45:44.325311 5120 reconciler_common.go:299] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/f734a4b4-4089-4b1e-9e09-3ebb426667bf-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Mar 16 16:45:44 crc kubenswrapper[5120]: I0316 16:45:44.325390 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w4chw\" (UniqueName: \"kubernetes.io/projected/f734a4b4-4089-4b1e-9e09-3ebb426667bf-kube-api-access-w4chw\") on node \"crc\" DevicePath \"\"" Mar 16 16:45:44 crc kubenswrapper[5120]: I0316 16:45:44.325404 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f734a4b4-4089-4b1e-9e09-3ebb426667bf-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:45:44 crc kubenswrapper[5120]: I0316 16:45:44.624997 5120 generic.go:358] "Generic (PLEG): container finished" podID="f734a4b4-4089-4b1e-9e09-3ebb426667bf" containerID="aeea82b0bb6261dbfad8929e406fae0c2aa02bacb16dd00a79c767d5fd26bc74" exitCode=0 Mar 16 16:45:44 crc kubenswrapper[5120]: I0316 16:45:44.625220 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-htctf" Mar 16 16:45:44 crc kubenswrapper[5120]: I0316 16:45:44.625192 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-htctf" event={"ID":"f734a4b4-4089-4b1e-9e09-3ebb426667bf","Type":"ContainerDied","Data":"aeea82b0bb6261dbfad8929e406fae0c2aa02bacb16dd00a79c767d5fd26bc74"} Mar 16 16:45:44 crc kubenswrapper[5120]: I0316 16:45:44.625608 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-htctf" event={"ID":"f734a4b4-4089-4b1e-9e09-3ebb426667bf","Type":"ContainerDied","Data":"51e82a5073663053e612240ca93a4f2a606afcf34f40585afa9f003eeae866b0"} Mar 16 16:45:44 crc kubenswrapper[5120]: I0316 16:45:44.625648 5120 scope.go:117] "RemoveContainer" containerID="aeea82b0bb6261dbfad8929e406fae0c2aa02bacb16dd00a79c767d5fd26bc74" Mar 16 16:45:44 crc kubenswrapper[5120]: I0316 16:45:44.678989 5120 scope.go:117] "RemoveContainer" containerID="dcb341c888f7b3dd9705067eb687f5c5806a7664527b1fe8fa5b589077f4752b" Mar 16 16:45:44 crc kubenswrapper[5120]: I0316 16:45:44.682622 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-htctf"] Mar 16 16:45:44 crc kubenswrapper[5120]: I0316 16:45:44.693125 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-htctf"] Mar 16 16:45:44 crc kubenswrapper[5120]: I0316 16:45:44.713660 5120 scope.go:117] "RemoveContainer" containerID="aeea82b0bb6261dbfad8929e406fae0c2aa02bacb16dd00a79c767d5fd26bc74" Mar 16 16:45:44 crc kubenswrapper[5120]: E0316 16:45:44.714188 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aeea82b0bb6261dbfad8929e406fae0c2aa02bacb16dd00a79c767d5fd26bc74\": container with ID starting with aeea82b0bb6261dbfad8929e406fae0c2aa02bacb16dd00a79c767d5fd26bc74 not found: ID does not exist" containerID="aeea82b0bb6261dbfad8929e406fae0c2aa02bacb16dd00a79c767d5fd26bc74" Mar 16 16:45:44 crc kubenswrapper[5120]: I0316 16:45:44.714237 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aeea82b0bb6261dbfad8929e406fae0c2aa02bacb16dd00a79c767d5fd26bc74"} err="failed to get container status \"aeea82b0bb6261dbfad8929e406fae0c2aa02bacb16dd00a79c767d5fd26bc74\": rpc error: code = NotFound desc = could not find container \"aeea82b0bb6261dbfad8929e406fae0c2aa02bacb16dd00a79c767d5fd26bc74\": container with ID starting with aeea82b0bb6261dbfad8929e406fae0c2aa02bacb16dd00a79c767d5fd26bc74 not found: ID does not exist" Mar 16 16:45:44 crc kubenswrapper[5120]: I0316 16:45:44.714263 5120 scope.go:117] "RemoveContainer" containerID="dcb341c888f7b3dd9705067eb687f5c5806a7664527b1fe8fa5b589077f4752b" Mar 16 16:45:44 crc kubenswrapper[5120]: E0316 16:45:44.714531 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dcb341c888f7b3dd9705067eb687f5c5806a7664527b1fe8fa5b589077f4752b\": container with ID starting with dcb341c888f7b3dd9705067eb687f5c5806a7664527b1fe8fa5b589077f4752b not found: ID does not exist" containerID="dcb341c888f7b3dd9705067eb687f5c5806a7664527b1fe8fa5b589077f4752b" Mar 16 16:45:44 crc kubenswrapper[5120]: I0316 16:45:44.714556 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dcb341c888f7b3dd9705067eb687f5c5806a7664527b1fe8fa5b589077f4752b"} err="failed to get container status \"dcb341c888f7b3dd9705067eb687f5c5806a7664527b1fe8fa5b589077f4752b\": rpc error: code = NotFound desc = could not find container \"dcb341c888f7b3dd9705067eb687f5c5806a7664527b1fe8fa5b589077f4752b\": container with ID starting with dcb341c888f7b3dd9705067eb687f5c5806a7664527b1fe8fa5b589077f4752b not found: ID does not exist" Mar 16 16:45:46 crc kubenswrapper[5120]: I0316 16:45:46.676961 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f734a4b4-4089-4b1e-9e09-3ebb426667bf" path="/var/lib/kubelet/pods/f734a4b4-4089-4b1e-9e09-3ebb426667bf/volumes" Mar 16 16:45:47 crc kubenswrapper[5120]: I0316 16:45:47.513157 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:45:47 crc kubenswrapper[5120]: I0316 16:45:47.517113 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:45:47 crc kubenswrapper[5120]: I0316 16:45:47.819170 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-db-create-6rvwm"] Mar 16 16:45:47 crc kubenswrapper[5120]: I0316 16:45:47.820081 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f734a4b4-4089-4b1e-9e09-3ebb426667bf" containerName="init" Mar 16 16:45:47 crc kubenswrapper[5120]: I0316 16:45:47.820097 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f734a4b4-4089-4b1e-9e09-3ebb426667bf" containerName="init" Mar 16 16:45:47 crc kubenswrapper[5120]: I0316 16:45:47.820125 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18453fce-c82b-4afc-9968-e956f84798b4" containerName="glance-db-sync" Mar 16 16:45:47 crc kubenswrapper[5120]: I0316 16:45:47.820131 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="18453fce-c82b-4afc-9968-e956f84798b4" containerName="glance-db-sync" Mar 16 16:45:47 crc kubenswrapper[5120]: I0316 16:45:47.820144 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="652479c2-1cd4-4b7a-99d1-63e3538b2aeb" containerName="registry-server" Mar 16 16:45:47 crc kubenswrapper[5120]: I0316 16:45:47.820149 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="652479c2-1cd4-4b7a-99d1-63e3538b2aeb" containerName="registry-server" Mar 16 16:45:47 crc kubenswrapper[5120]: I0316 16:45:47.820182 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="652479c2-1cd4-4b7a-99d1-63e3538b2aeb" containerName="extract-content" Mar 16 16:45:47 crc kubenswrapper[5120]: I0316 16:45:47.820187 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="652479c2-1cd4-4b7a-99d1-63e3538b2aeb" containerName="extract-content" Mar 16 16:45:47 crc kubenswrapper[5120]: I0316 16:45:47.820199 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="652479c2-1cd4-4b7a-99d1-63e3538b2aeb" containerName="extract-utilities" Mar 16 16:45:47 crc kubenswrapper[5120]: I0316 16:45:47.820206 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="652479c2-1cd4-4b7a-99d1-63e3538b2aeb" containerName="extract-utilities" Mar 16 16:45:47 crc kubenswrapper[5120]: I0316 16:45:47.820212 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c5fb2bc-3128-4de7-acbe-430ae8cdafa7" containerName="mariadb-account-create-update" Mar 16 16:45:47 crc kubenswrapper[5120]: I0316 16:45:47.820218 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c5fb2bc-3128-4de7-acbe-430ae8cdafa7" containerName="mariadb-account-create-update" Mar 16 16:45:47 crc kubenswrapper[5120]: I0316 16:45:47.820226 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f734a4b4-4089-4b1e-9e09-3ebb426667bf" containerName="dnsmasq-dns" Mar 16 16:45:47 crc kubenswrapper[5120]: I0316 16:45:47.820232 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f734a4b4-4089-4b1e-9e09-3ebb426667bf" containerName="dnsmasq-dns" Mar 16 16:45:47 crc kubenswrapper[5120]: I0316 16:45:47.820353 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="18453fce-c82b-4afc-9968-e956f84798b4" containerName="glance-db-sync" Mar 16 16:45:47 crc kubenswrapper[5120]: I0316 16:45:47.820364 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7c5fb2bc-3128-4de7-acbe-430ae8cdafa7" containerName="mariadb-account-create-update" Mar 16 16:45:47 crc kubenswrapper[5120]: I0316 16:45:47.820376 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="652479c2-1cd4-4b7a-99d1-63e3538b2aeb" containerName="registry-server" Mar 16 16:45:47 crc kubenswrapper[5120]: I0316 16:45:47.820385 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f734a4b4-4089-4b1e-9e09-3ebb426667bf" containerName="dnsmasq-dns" Mar 16 16:45:47 crc kubenswrapper[5120]: I0316 16:45:47.829701 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-create-6rvwm" Mar 16 16:45:47 crc kubenswrapper[5120]: I0316 16:45:47.838168 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-db-create-6rvwm"] Mar 16 16:45:47 crc kubenswrapper[5120]: I0316 16:45:47.906144 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9lc4r\" (UniqueName: \"kubernetes.io/projected/8727c588-240e-4721-917b-80b50e413963-kube-api-access-9lc4r\") pod \"cinder-db-create-6rvwm\" (UID: \"8727c588-240e-4721-917b-80b50e413963\") " pod="openstack-kuttl-tests/cinder-db-create-6rvwm" Mar 16 16:45:47 crc kubenswrapper[5120]: I0316 16:45:47.906445 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8727c588-240e-4721-917b-80b50e413963-operator-scripts\") pod \"cinder-db-create-6rvwm\" (UID: \"8727c588-240e-4721-917b-80b50e413963\") " pod="openstack-kuttl-tests/cinder-db-create-6rvwm" Mar 16 16:45:47 crc kubenswrapper[5120]: I0316 16:45:47.932206 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-b06a-account-create-update-ngkgs"] Mar 16 16:45:47 crc kubenswrapper[5120]: I0316 16:45:47.938829 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-b06a-account-create-update-ngkgs" Mar 16 16:45:47 crc kubenswrapper[5120]: I0316 16:45:47.940879 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-b06a-account-create-update-ngkgs"] Mar 16 16:45:47 crc kubenswrapper[5120]: I0316 16:45:47.941162 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-db-secret\"" Mar 16 16:45:48 crc kubenswrapper[5120]: I0316 16:45:48.008543 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8727c588-240e-4721-917b-80b50e413963-operator-scripts\") pod \"cinder-db-create-6rvwm\" (UID: \"8727c588-240e-4721-917b-80b50e413963\") " pod="openstack-kuttl-tests/cinder-db-create-6rvwm" Mar 16 16:45:48 crc kubenswrapper[5120]: I0316 16:45:48.008742 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9lc4r\" (UniqueName: \"kubernetes.io/projected/8727c588-240e-4721-917b-80b50e413963-kube-api-access-9lc4r\") pod \"cinder-db-create-6rvwm\" (UID: \"8727c588-240e-4721-917b-80b50e413963\") " pod="openstack-kuttl-tests/cinder-db-create-6rvwm" Mar 16 16:45:48 crc kubenswrapper[5120]: I0316 16:45:48.009254 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8727c588-240e-4721-917b-80b50e413963-operator-scripts\") pod \"cinder-db-create-6rvwm\" (UID: \"8727c588-240e-4721-917b-80b50e413963\") " pod="openstack-kuttl-tests/cinder-db-create-6rvwm" Mar 16 16:45:48 crc kubenswrapper[5120]: I0316 16:45:48.023043 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-db-create-qtpxl"] Mar 16 16:45:48 crc kubenswrapper[5120]: I0316 16:45:48.033261 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-create-qtpxl" Mar 16 16:45:48 crc kubenswrapper[5120]: I0316 16:45:48.034332 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9lc4r\" (UniqueName: \"kubernetes.io/projected/8727c588-240e-4721-917b-80b50e413963-kube-api-access-9lc4r\") pod \"cinder-db-create-6rvwm\" (UID: \"8727c588-240e-4721-917b-80b50e413963\") " pod="openstack-kuttl-tests/cinder-db-create-6rvwm" Mar 16 16:45:48 crc kubenswrapper[5120]: I0316 16:45:48.046436 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-0869-account-create-update-vch67"] Mar 16 16:45:48 crc kubenswrapper[5120]: I0316 16:45:48.054252 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-0869-account-create-update-vch67" Mar 16 16:45:48 crc kubenswrapper[5120]: I0316 16:45:48.057068 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-db-secret\"" Mar 16 16:45:48 crc kubenswrapper[5120]: I0316 16:45:48.075390 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-0869-account-create-update-vch67"] Mar 16 16:45:48 crc kubenswrapper[5120]: I0316 16:45:48.110394 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-db-create-qtpxl"] Mar 16 16:45:48 crc kubenswrapper[5120]: I0316 16:45:48.111857 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/51ee86c6-3b72-4d15-81c7-48f44dfa71e1-operator-scripts\") pod \"neutron-b06a-account-create-update-ngkgs\" (UID: \"51ee86c6-3b72-4d15-81c7-48f44dfa71e1\") " pod="openstack-kuttl-tests/neutron-b06a-account-create-update-ngkgs" Mar 16 16:45:48 crc kubenswrapper[5120]: I0316 16:45:48.111996 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxf6f\" (UniqueName: \"kubernetes.io/projected/3e708073-b72b-4b18-bac4-ead3cc84ad4d-kube-api-access-zxf6f\") pod \"neutron-db-create-qtpxl\" (UID: \"3e708073-b72b-4b18-bac4-ead3cc84ad4d\") " pod="openstack-kuttl-tests/neutron-db-create-qtpxl" Mar 16 16:45:48 crc kubenswrapper[5120]: I0316 16:45:48.112254 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbsb5\" (UniqueName: \"kubernetes.io/projected/51ee86c6-3b72-4d15-81c7-48f44dfa71e1-kube-api-access-wbsb5\") pod \"neutron-b06a-account-create-update-ngkgs\" (UID: \"51ee86c6-3b72-4d15-81c7-48f44dfa71e1\") " pod="openstack-kuttl-tests/neutron-b06a-account-create-update-ngkgs" Mar 16 16:45:48 crc kubenswrapper[5120]: I0316 16:45:48.112360 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3e708073-b72b-4b18-bac4-ead3cc84ad4d-operator-scripts\") pod \"neutron-db-create-qtpxl\" (UID: \"3e708073-b72b-4b18-bac4-ead3cc84ad4d\") " pod="openstack-kuttl-tests/neutron-db-create-qtpxl" Mar 16 16:45:48 crc kubenswrapper[5120]: I0316 16:45:48.118413 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-db-create-s475x"] Mar 16 16:45:48 crc kubenswrapper[5120]: I0316 16:45:48.127288 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-create-s475x" Mar 16 16:45:48 crc kubenswrapper[5120]: I0316 16:45:48.129870 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-db-create-s475x"] Mar 16 16:45:48 crc kubenswrapper[5120]: I0316 16:45:48.146727 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-create-6rvwm" Mar 16 16:45:48 crc kubenswrapper[5120]: I0316 16:45:48.182616 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-5pmhr"] Mar 16 16:45:48 crc kubenswrapper[5120]: I0316 16:45:48.189866 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-5pmhr" Mar 16 16:45:48 crc kubenswrapper[5120]: I0316 16:45:48.197962 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-config-data\"" Mar 16 16:45:48 crc kubenswrapper[5120]: I0316 16:45:48.198080 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone\"" Mar 16 16:45:48 crc kubenswrapper[5120]: I0316 16:45:48.197977 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-keystone-dockercfg-xfb6m\"" Mar 16 16:45:48 crc kubenswrapper[5120]: I0316 16:45:48.198423 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-scripts\"" Mar 16 16:45:48 crc kubenswrapper[5120]: I0316 16:45:48.213817 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3e708073-b72b-4b18-bac4-ead3cc84ad4d-operator-scripts\") pod \"neutron-db-create-qtpxl\" (UID: \"3e708073-b72b-4b18-bac4-ead3cc84ad4d\") " pod="openstack-kuttl-tests/neutron-db-create-qtpxl" Mar 16 16:45:48 crc kubenswrapper[5120]: I0316 16:45:48.213962 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/51ee86c6-3b72-4d15-81c7-48f44dfa71e1-operator-scripts\") pod \"neutron-b06a-account-create-update-ngkgs\" (UID: \"51ee86c6-3b72-4d15-81c7-48f44dfa71e1\") " pod="openstack-kuttl-tests/neutron-b06a-account-create-update-ngkgs" Mar 16 16:45:48 crc kubenswrapper[5120]: I0316 16:45:48.213992 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vx84\" (UniqueName: \"kubernetes.io/projected/0a7be161-7ccc-4927-9e5e-33da903689e3-kube-api-access-6vx84\") pod \"barbican-db-create-s475x\" (UID: \"0a7be161-7ccc-4927-9e5e-33da903689e3\") " pod="openstack-kuttl-tests/barbican-db-create-s475x" Mar 16 16:45:48 crc kubenswrapper[5120]: I0316 16:45:48.214011 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/60b0467f-dafd-4422-8a0c-fa3dd9ea3eb9-operator-scripts\") pod \"cinder-0869-account-create-update-vch67\" (UID: \"60b0467f-dafd-4422-8a0c-fa3dd9ea3eb9\") " pod="openstack-kuttl-tests/cinder-0869-account-create-update-vch67" Mar 16 16:45:48 crc kubenswrapper[5120]: I0316 16:45:48.214061 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zxf6f\" (UniqueName: \"kubernetes.io/projected/3e708073-b72b-4b18-bac4-ead3cc84ad4d-kube-api-access-zxf6f\") pod \"neutron-db-create-qtpxl\" (UID: \"3e708073-b72b-4b18-bac4-ead3cc84ad4d\") " pod="openstack-kuttl-tests/neutron-db-create-qtpxl" Mar 16 16:45:48 crc kubenswrapper[5120]: I0316 16:45:48.214159 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4x8x\" (UniqueName: \"kubernetes.io/projected/60b0467f-dafd-4422-8a0c-fa3dd9ea3eb9-kube-api-access-j4x8x\") pod \"cinder-0869-account-create-update-vch67\" (UID: \"60b0467f-dafd-4422-8a0c-fa3dd9ea3eb9\") " pod="openstack-kuttl-tests/cinder-0869-account-create-update-vch67" Mar 16 16:45:48 crc kubenswrapper[5120]: I0316 16:45:48.214200 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wbsb5\" (UniqueName: \"kubernetes.io/projected/51ee86c6-3b72-4d15-81c7-48f44dfa71e1-kube-api-access-wbsb5\") pod \"neutron-b06a-account-create-update-ngkgs\" (UID: \"51ee86c6-3b72-4d15-81c7-48f44dfa71e1\") " pod="openstack-kuttl-tests/neutron-b06a-account-create-update-ngkgs" Mar 16 16:45:48 crc kubenswrapper[5120]: I0316 16:45:48.214239 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0a7be161-7ccc-4927-9e5e-33da903689e3-operator-scripts\") pod \"barbican-db-create-s475x\" (UID: \"0a7be161-7ccc-4927-9e5e-33da903689e3\") " pod="openstack-kuttl-tests/barbican-db-create-s475x" Mar 16 16:45:48 crc kubenswrapper[5120]: I0316 16:45:48.216634 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3e708073-b72b-4b18-bac4-ead3cc84ad4d-operator-scripts\") pod \"neutron-db-create-qtpxl\" (UID: \"3e708073-b72b-4b18-bac4-ead3cc84ad4d\") " pod="openstack-kuttl-tests/neutron-db-create-qtpxl" Mar 16 16:45:48 crc kubenswrapper[5120]: I0316 16:45:48.217163 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/51ee86c6-3b72-4d15-81c7-48f44dfa71e1-operator-scripts\") pod \"neutron-b06a-account-create-update-ngkgs\" (UID: \"51ee86c6-3b72-4d15-81c7-48f44dfa71e1\") " pod="openstack-kuttl-tests/neutron-b06a-account-create-update-ngkgs" Mar 16 16:45:48 crc kubenswrapper[5120]: I0316 16:45:48.224688 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-5pmhr"] Mar 16 16:45:48 crc kubenswrapper[5120]: I0316 16:45:48.238499 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxf6f\" (UniqueName: \"kubernetes.io/projected/3e708073-b72b-4b18-bac4-ead3cc84ad4d-kube-api-access-zxf6f\") pod \"neutron-db-create-qtpxl\" (UID: \"3e708073-b72b-4b18-bac4-ead3cc84ad4d\") " pod="openstack-kuttl-tests/neutron-db-create-qtpxl" Mar 16 16:45:48 crc kubenswrapper[5120]: I0316 16:45:48.249684 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbsb5\" (UniqueName: \"kubernetes.io/projected/51ee86c6-3b72-4d15-81c7-48f44dfa71e1-kube-api-access-wbsb5\") pod \"neutron-b06a-account-create-update-ngkgs\" (UID: \"51ee86c6-3b72-4d15-81c7-48f44dfa71e1\") " pod="openstack-kuttl-tests/neutron-b06a-account-create-update-ngkgs" Mar 16 16:45:48 crc kubenswrapper[5120]: I0316 16:45:48.264665 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-b06a-account-create-update-ngkgs" Mar 16 16:45:48 crc kubenswrapper[5120]: I0316 16:45:48.320843 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j4x8x\" (UniqueName: \"kubernetes.io/projected/60b0467f-dafd-4422-8a0c-fa3dd9ea3eb9-kube-api-access-j4x8x\") pod \"cinder-0869-account-create-update-vch67\" (UID: \"60b0467f-dafd-4422-8a0c-fa3dd9ea3eb9\") " pod="openstack-kuttl-tests/cinder-0869-account-create-update-vch67" Mar 16 16:45:48 crc kubenswrapper[5120]: I0316 16:45:48.320931 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0a7be161-7ccc-4927-9e5e-33da903689e3-operator-scripts\") pod \"barbican-db-create-s475x\" (UID: \"0a7be161-7ccc-4927-9e5e-33da903689e3\") " pod="openstack-kuttl-tests/barbican-db-create-s475x" Mar 16 16:45:48 crc kubenswrapper[5120]: I0316 16:45:48.320980 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sq65q\" (UniqueName: \"kubernetes.io/projected/48bd8a90-61bd-414f-99b7-532428fa5ff4-kube-api-access-sq65q\") pod \"keystone-db-sync-5pmhr\" (UID: \"48bd8a90-61bd-414f-99b7-532428fa5ff4\") " pod="openstack-kuttl-tests/keystone-db-sync-5pmhr" Mar 16 16:45:48 crc kubenswrapper[5120]: I0316 16:45:48.321082 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/48bd8a90-61bd-414f-99b7-532428fa5ff4-combined-ca-bundle\") pod \"keystone-db-sync-5pmhr\" (UID: \"48bd8a90-61bd-414f-99b7-532428fa5ff4\") " pod="openstack-kuttl-tests/keystone-db-sync-5pmhr" Mar 16 16:45:48 crc kubenswrapper[5120]: I0316 16:45:48.321107 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6vx84\" (UniqueName: \"kubernetes.io/projected/0a7be161-7ccc-4927-9e5e-33da903689e3-kube-api-access-6vx84\") pod \"barbican-db-create-s475x\" (UID: \"0a7be161-7ccc-4927-9e5e-33da903689e3\") " pod="openstack-kuttl-tests/barbican-db-create-s475x" Mar 16 16:45:48 crc kubenswrapper[5120]: I0316 16:45:48.321123 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/60b0467f-dafd-4422-8a0c-fa3dd9ea3eb9-operator-scripts\") pod \"cinder-0869-account-create-update-vch67\" (UID: \"60b0467f-dafd-4422-8a0c-fa3dd9ea3eb9\") " pod="openstack-kuttl-tests/cinder-0869-account-create-update-vch67" Mar 16 16:45:48 crc kubenswrapper[5120]: I0316 16:45:48.321187 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/48bd8a90-61bd-414f-99b7-532428fa5ff4-config-data\") pod \"keystone-db-sync-5pmhr\" (UID: \"48bd8a90-61bd-414f-99b7-532428fa5ff4\") " pod="openstack-kuttl-tests/keystone-db-sync-5pmhr" Mar 16 16:45:48 crc kubenswrapper[5120]: I0316 16:45:48.322295 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0a7be161-7ccc-4927-9e5e-33da903689e3-operator-scripts\") pod \"barbican-db-create-s475x\" (UID: \"0a7be161-7ccc-4927-9e5e-33da903689e3\") " pod="openstack-kuttl-tests/barbican-db-create-s475x" Mar 16 16:45:48 crc kubenswrapper[5120]: I0316 16:45:48.322938 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/60b0467f-dafd-4422-8a0c-fa3dd9ea3eb9-operator-scripts\") pod \"cinder-0869-account-create-update-vch67\" (UID: \"60b0467f-dafd-4422-8a0c-fa3dd9ea3eb9\") " pod="openstack-kuttl-tests/cinder-0869-account-create-update-vch67" Mar 16 16:45:48 crc kubenswrapper[5120]: I0316 16:45:48.345585 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-1de0-account-create-update-p66v4"] Mar 16 16:45:48 crc kubenswrapper[5120]: I0316 16:45:48.346271 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vx84\" (UniqueName: \"kubernetes.io/projected/0a7be161-7ccc-4927-9e5e-33da903689e3-kube-api-access-6vx84\") pod \"barbican-db-create-s475x\" (UID: \"0a7be161-7ccc-4927-9e5e-33da903689e3\") " pod="openstack-kuttl-tests/barbican-db-create-s475x" Mar 16 16:45:48 crc kubenswrapper[5120]: I0316 16:45:48.354578 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4x8x\" (UniqueName: \"kubernetes.io/projected/60b0467f-dafd-4422-8a0c-fa3dd9ea3eb9-kube-api-access-j4x8x\") pod \"cinder-0869-account-create-update-vch67\" (UID: \"60b0467f-dafd-4422-8a0c-fa3dd9ea3eb9\") " pod="openstack-kuttl-tests/cinder-0869-account-create-update-vch67" Mar 16 16:45:48 crc kubenswrapper[5120]: I0316 16:45:48.376535 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-1de0-account-create-update-p66v4"] Mar 16 16:45:48 crc kubenswrapper[5120]: I0316 16:45:48.376680 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-1de0-account-create-update-p66v4" Mar 16 16:45:48 crc kubenswrapper[5120]: I0316 16:45:48.382010 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-db-secret\"" Mar 16 16:45:48 crc kubenswrapper[5120]: I0316 16:45:48.383189 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-create-qtpxl" Mar 16 16:45:48 crc kubenswrapper[5120]: I0316 16:45:48.401378 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-0869-account-create-update-vch67" Mar 16 16:45:48 crc kubenswrapper[5120]: I0316 16:45:48.422718 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/48bd8a90-61bd-414f-99b7-532428fa5ff4-config-data\") pod \"keystone-db-sync-5pmhr\" (UID: \"48bd8a90-61bd-414f-99b7-532428fa5ff4\") " pod="openstack-kuttl-tests/keystone-db-sync-5pmhr" Mar 16 16:45:48 crc kubenswrapper[5120]: I0316 16:45:48.422915 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sq65q\" (UniqueName: \"kubernetes.io/projected/48bd8a90-61bd-414f-99b7-532428fa5ff4-kube-api-access-sq65q\") pod \"keystone-db-sync-5pmhr\" (UID: \"48bd8a90-61bd-414f-99b7-532428fa5ff4\") " pod="openstack-kuttl-tests/keystone-db-sync-5pmhr" Mar 16 16:45:48 crc kubenswrapper[5120]: I0316 16:45:48.423038 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/48bd8a90-61bd-414f-99b7-532428fa5ff4-combined-ca-bundle\") pod \"keystone-db-sync-5pmhr\" (UID: \"48bd8a90-61bd-414f-99b7-532428fa5ff4\") " pod="openstack-kuttl-tests/keystone-db-sync-5pmhr" Mar 16 16:45:48 crc kubenswrapper[5120]: I0316 16:45:48.426432 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/48bd8a90-61bd-414f-99b7-532428fa5ff4-config-data\") pod \"keystone-db-sync-5pmhr\" (UID: \"48bd8a90-61bd-414f-99b7-532428fa5ff4\") " pod="openstack-kuttl-tests/keystone-db-sync-5pmhr" Mar 16 16:45:48 crc kubenswrapper[5120]: I0316 16:45:48.428825 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/48bd8a90-61bd-414f-99b7-532428fa5ff4-combined-ca-bundle\") pod \"keystone-db-sync-5pmhr\" (UID: \"48bd8a90-61bd-414f-99b7-532428fa5ff4\") " pod="openstack-kuttl-tests/keystone-db-sync-5pmhr" Mar 16 16:45:48 crc kubenswrapper[5120]: I0316 16:45:48.440950 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-create-s475x" Mar 16 16:45:48 crc kubenswrapper[5120]: I0316 16:45:48.443879 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sq65q\" (UniqueName: \"kubernetes.io/projected/48bd8a90-61bd-414f-99b7-532428fa5ff4-kube-api-access-sq65q\") pod \"keystone-db-sync-5pmhr\" (UID: \"48bd8a90-61bd-414f-99b7-532428fa5ff4\") " pod="openstack-kuttl-tests/keystone-db-sync-5pmhr" Mar 16 16:45:48 crc kubenswrapper[5120]: I0316 16:45:48.527050 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8cxg4\" (UniqueName: \"kubernetes.io/projected/35e78e32-efae-42ac-b210-17cc868c1713-kube-api-access-8cxg4\") pod \"barbican-1de0-account-create-update-p66v4\" (UID: \"35e78e32-efae-42ac-b210-17cc868c1713\") " pod="openstack-kuttl-tests/barbican-1de0-account-create-update-p66v4" Mar 16 16:45:48 crc kubenswrapper[5120]: I0316 16:45:48.527505 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/35e78e32-efae-42ac-b210-17cc868c1713-operator-scripts\") pod \"barbican-1de0-account-create-update-p66v4\" (UID: \"35e78e32-efae-42ac-b210-17cc868c1713\") " pod="openstack-kuttl-tests/barbican-1de0-account-create-update-p66v4" Mar 16 16:45:48 crc kubenswrapper[5120]: I0316 16:45:48.629135 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/35e78e32-efae-42ac-b210-17cc868c1713-operator-scripts\") pod \"barbican-1de0-account-create-update-p66v4\" (UID: \"35e78e32-efae-42ac-b210-17cc868c1713\") " pod="openstack-kuttl-tests/barbican-1de0-account-create-update-p66v4" Mar 16 16:45:48 crc kubenswrapper[5120]: I0316 16:45:48.629367 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8cxg4\" (UniqueName: \"kubernetes.io/projected/35e78e32-efae-42ac-b210-17cc868c1713-kube-api-access-8cxg4\") pod \"barbican-1de0-account-create-update-p66v4\" (UID: \"35e78e32-efae-42ac-b210-17cc868c1713\") " pod="openstack-kuttl-tests/barbican-1de0-account-create-update-p66v4" Mar 16 16:45:48 crc kubenswrapper[5120]: I0316 16:45:48.630555 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/35e78e32-efae-42ac-b210-17cc868c1713-operator-scripts\") pod \"barbican-1de0-account-create-update-p66v4\" (UID: \"35e78e32-efae-42ac-b210-17cc868c1713\") " pod="openstack-kuttl-tests/barbican-1de0-account-create-update-p66v4" Mar 16 16:45:48 crc kubenswrapper[5120]: I0316 16:45:48.658648 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-5pmhr" Mar 16 16:45:48 crc kubenswrapper[5120]: I0316 16:45:48.666844 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8cxg4\" (UniqueName: \"kubernetes.io/projected/35e78e32-efae-42ac-b210-17cc868c1713-kube-api-access-8cxg4\") pod \"barbican-1de0-account-create-update-p66v4\" (UID: \"35e78e32-efae-42ac-b210-17cc868c1713\") " pod="openstack-kuttl-tests/barbican-1de0-account-create-update-p66v4" Mar 16 16:45:48 crc kubenswrapper[5120]: I0316 16:45:48.711227 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-1de0-account-create-update-p66v4" Mar 16 16:45:48 crc kubenswrapper[5120]: I0316 16:45:48.743443 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-db-create-6rvwm"] Mar 16 16:45:48 crc kubenswrapper[5120]: I0316 16:45:48.781977 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-b06a-account-create-update-ngkgs"] Mar 16 16:45:48 crc kubenswrapper[5120]: I0316 16:45:48.994984 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-db-create-qtpxl"] Mar 16 16:45:49 crc kubenswrapper[5120]: I0316 16:45:49.093541 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-0869-account-create-update-vch67"] Mar 16 16:45:49 crc kubenswrapper[5120]: W0316 16:45:49.104574 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod60b0467f_dafd_4422_8a0c_fa3dd9ea3eb9.slice/crio-dcdf5639cb9b48724ac0bb6a0b60d7abf69865081126ead717fb253cd89e6bc9 WatchSource:0}: Error finding container dcdf5639cb9b48724ac0bb6a0b60d7abf69865081126ead717fb253cd89e6bc9: Status 404 returned error can't find the container with id dcdf5639cb9b48724ac0bb6a0b60d7abf69865081126ead717fb253cd89e6bc9 Mar 16 16:45:49 crc kubenswrapper[5120]: I0316 16:45:49.171436 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-db-create-s475x"] Mar 16 16:45:49 crc kubenswrapper[5120]: I0316 16:45:49.244646 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-5pmhr"] Mar 16 16:45:49 crc kubenswrapper[5120]: I0316 16:45:49.368598 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-1de0-account-create-update-p66v4"] Mar 16 16:45:49 crc kubenswrapper[5120]: W0316 16:45:49.369065 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod35e78e32_efae_42ac_b210_17cc868c1713.slice/crio-155fec1e554ab89b1bbde779277f91c1a8569428fe2b500407f4978347618a67 WatchSource:0}: Error finding container 155fec1e554ab89b1bbde779277f91c1a8569428fe2b500407f4978347618a67: Status 404 returned error can't find the container with id 155fec1e554ab89b1bbde779277f91c1a8569428fe2b500407f4978347618a67 Mar 16 16:45:49 crc kubenswrapper[5120]: I0316 16:45:49.671073 5120 generic.go:358] "Generic (PLEG): container finished" podID="51ee86c6-3b72-4d15-81c7-48f44dfa71e1" containerID="b3af81ac38c305699d6393872a740e0f8879c3c011320542e001b9c18d88e2d6" exitCode=0 Mar 16 16:45:49 crc kubenswrapper[5120]: I0316 16:45:49.671180 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-b06a-account-create-update-ngkgs" event={"ID":"51ee86c6-3b72-4d15-81c7-48f44dfa71e1","Type":"ContainerDied","Data":"b3af81ac38c305699d6393872a740e0f8879c3c011320542e001b9c18d88e2d6"} Mar 16 16:45:49 crc kubenswrapper[5120]: I0316 16:45:49.671240 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-b06a-account-create-update-ngkgs" event={"ID":"51ee86c6-3b72-4d15-81c7-48f44dfa71e1","Type":"ContainerStarted","Data":"a3ce25e173a7bf861983698c8119c8705cf1e1b443f6638802ebe364ac43534a"} Mar 16 16:45:49 crc kubenswrapper[5120]: I0316 16:45:49.673355 5120 generic.go:358] "Generic (PLEG): container finished" podID="3e708073-b72b-4b18-bac4-ead3cc84ad4d" containerID="11ff6b164b7790c582fa06c50b6f9af90dcba54a31ca96543288b5f9c2f7a9a4" exitCode=0 Mar 16 16:45:49 crc kubenswrapper[5120]: I0316 16:45:49.673509 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-create-qtpxl" event={"ID":"3e708073-b72b-4b18-bac4-ead3cc84ad4d","Type":"ContainerDied","Data":"11ff6b164b7790c582fa06c50b6f9af90dcba54a31ca96543288b5f9c2f7a9a4"} Mar 16 16:45:49 crc kubenswrapper[5120]: I0316 16:45:49.673539 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-create-qtpxl" event={"ID":"3e708073-b72b-4b18-bac4-ead3cc84ad4d","Type":"ContainerStarted","Data":"ddf23449bff3492a8a86930a48640d8f4042043d12f3dafdff5472169c642103"} Mar 16 16:45:49 crc kubenswrapper[5120]: I0316 16:45:49.677616 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-5pmhr" event={"ID":"48bd8a90-61bd-414f-99b7-532428fa5ff4","Type":"ContainerStarted","Data":"8a0aa6771ff67781c6bea0b6706cc83f48802783eabac82a07c3459709fb9563"} Mar 16 16:45:49 crc kubenswrapper[5120]: I0316 16:45:49.677658 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-5pmhr" event={"ID":"48bd8a90-61bd-414f-99b7-532428fa5ff4","Type":"ContainerStarted","Data":"13ed1d30e0e51551503043177d6666cf000048e9f49f7604338ed849f23f8569"} Mar 16 16:45:49 crc kubenswrapper[5120]: I0316 16:45:49.680505 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-0869-account-create-update-vch67" event={"ID":"60b0467f-dafd-4422-8a0c-fa3dd9ea3eb9","Type":"ContainerStarted","Data":"063b1966e4dba8c302e52881e24f4aff432340c0be948bd52137842ad7554c94"} Mar 16 16:45:49 crc kubenswrapper[5120]: I0316 16:45:49.680537 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-0869-account-create-update-vch67" event={"ID":"60b0467f-dafd-4422-8a0c-fa3dd9ea3eb9","Type":"ContainerStarted","Data":"dcdf5639cb9b48724ac0bb6a0b60d7abf69865081126ead717fb253cd89e6bc9"} Mar 16 16:45:49 crc kubenswrapper[5120]: I0316 16:45:49.683439 5120 generic.go:358] "Generic (PLEG): container finished" podID="8727c588-240e-4721-917b-80b50e413963" containerID="40f557084e3a2ecf12fdf7c3b4721912bfc34ca2bde7e8746a886d139da7e9c3" exitCode=0 Mar 16 16:45:49 crc kubenswrapper[5120]: I0316 16:45:49.683631 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-create-6rvwm" event={"ID":"8727c588-240e-4721-917b-80b50e413963","Type":"ContainerDied","Data":"40f557084e3a2ecf12fdf7c3b4721912bfc34ca2bde7e8746a886d139da7e9c3"} Mar 16 16:45:49 crc kubenswrapper[5120]: I0316 16:45:49.683658 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-create-6rvwm" event={"ID":"8727c588-240e-4721-917b-80b50e413963","Type":"ContainerStarted","Data":"09466e0c2ddf58ff1de14855c7a11b6adf0e9f95abd08a88fd024f854cbaff2a"} Mar 16 16:45:49 crc kubenswrapper[5120]: I0316 16:45:49.686155 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-create-s475x" event={"ID":"0a7be161-7ccc-4927-9e5e-33da903689e3","Type":"ContainerStarted","Data":"8545e866e6324656e644369b883757a78552dd6dc832000c5479316762a3c706"} Mar 16 16:45:49 crc kubenswrapper[5120]: I0316 16:45:49.686186 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-create-s475x" event={"ID":"0a7be161-7ccc-4927-9e5e-33da903689e3","Type":"ContainerStarted","Data":"f9f138ef5bdaf46cceac4711b1c9dd678fe913bf46e0b31e46e35a72463f4586"} Mar 16 16:45:49 crc kubenswrapper[5120]: I0316 16:45:49.692306 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-1de0-account-create-update-p66v4" event={"ID":"35e78e32-efae-42ac-b210-17cc868c1713","Type":"ContainerStarted","Data":"4920281ee670b327c53844dc3011a1263a41a89d76b77f9b9e465904154b74af"} Mar 16 16:45:49 crc kubenswrapper[5120]: I0316 16:45:49.692354 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-1de0-account-create-update-p66v4" event={"ID":"35e78e32-efae-42ac-b210-17cc868c1713","Type":"ContainerStarted","Data":"155fec1e554ab89b1bbde779277f91c1a8569428fe2b500407f4978347618a67"} Mar 16 16:45:49 crc kubenswrapper[5120]: I0316 16:45:49.707232 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-db-sync-5pmhr" podStartSLOduration=1.707194076 podStartE2EDuration="1.707194076s" podCreationTimestamp="2026-03-16 16:45:48 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:45:49.701149712 +0000 UTC m=+4451.855081369" watchObservedRunningTime="2026-03-16 16:45:49.707194076 +0000 UTC m=+4451.861125753" Mar 16 16:45:49 crc kubenswrapper[5120]: I0316 16:45:49.731975 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-0869-account-create-update-vch67" podStartSLOduration=1.731951149 podStartE2EDuration="1.731951149s" podCreationTimestamp="2026-03-16 16:45:48 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:45:49.726730677 +0000 UTC m=+4451.880662334" watchObservedRunningTime="2026-03-16 16:45:49.731951149 +0000 UTC m=+4451.885882806" Mar 16 16:45:49 crc kubenswrapper[5120]: I0316 16:45:49.768840 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-1de0-account-create-update-p66v4" podStartSLOduration=1.7688210020000001 podStartE2EDuration="1.768821002s" podCreationTimestamp="2026-03-16 16:45:48 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:45:49.766611943 +0000 UTC m=+4451.920543600" watchObservedRunningTime="2026-03-16 16:45:49.768821002 +0000 UTC m=+4451.922752659" Mar 16 16:45:50 crc kubenswrapper[5120]: I0316 16:45:50.701629 5120 generic.go:358] "Generic (PLEG): container finished" podID="0a7be161-7ccc-4927-9e5e-33da903689e3" containerID="8545e866e6324656e644369b883757a78552dd6dc832000c5479316762a3c706" exitCode=0 Mar 16 16:45:50 crc kubenswrapper[5120]: I0316 16:45:50.701979 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-create-s475x" event={"ID":"0a7be161-7ccc-4927-9e5e-33da903689e3","Type":"ContainerDied","Data":"8545e866e6324656e644369b883757a78552dd6dc832000c5479316762a3c706"} Mar 16 16:45:50 crc kubenswrapper[5120]: I0316 16:45:50.708313 5120 generic.go:358] "Generic (PLEG): container finished" podID="35e78e32-efae-42ac-b210-17cc868c1713" containerID="4920281ee670b327c53844dc3011a1263a41a89d76b77f9b9e465904154b74af" exitCode=0 Mar 16 16:45:50 crc kubenswrapper[5120]: I0316 16:45:50.708700 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-1de0-account-create-update-p66v4" event={"ID":"35e78e32-efae-42ac-b210-17cc868c1713","Type":"ContainerDied","Data":"4920281ee670b327c53844dc3011a1263a41a89d76b77f9b9e465904154b74af"} Mar 16 16:45:50 crc kubenswrapper[5120]: I0316 16:45:50.710683 5120 generic.go:358] "Generic (PLEG): container finished" podID="60b0467f-dafd-4422-8a0c-fa3dd9ea3eb9" containerID="063b1966e4dba8c302e52881e24f4aff432340c0be948bd52137842ad7554c94" exitCode=0 Mar 16 16:45:50 crc kubenswrapper[5120]: I0316 16:45:50.711080 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-0869-account-create-update-vch67" event={"ID":"60b0467f-dafd-4422-8a0c-fa3dd9ea3eb9","Type":"ContainerDied","Data":"063b1966e4dba8c302e52881e24f4aff432340c0be948bd52137842ad7554c94"} Mar 16 16:45:51 crc kubenswrapper[5120]: I0316 16:45:51.143951 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-create-s475x" Mar 16 16:45:51 crc kubenswrapper[5120]: I0316 16:45:51.189002 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6vx84\" (UniqueName: \"kubernetes.io/projected/0a7be161-7ccc-4927-9e5e-33da903689e3-kube-api-access-6vx84\") pod \"0a7be161-7ccc-4927-9e5e-33da903689e3\" (UID: \"0a7be161-7ccc-4927-9e5e-33da903689e3\") " Mar 16 16:45:51 crc kubenswrapper[5120]: I0316 16:45:51.190033 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0a7be161-7ccc-4927-9e5e-33da903689e3-operator-scripts\") pod \"0a7be161-7ccc-4927-9e5e-33da903689e3\" (UID: \"0a7be161-7ccc-4927-9e5e-33da903689e3\") " Mar 16 16:45:51 crc kubenswrapper[5120]: I0316 16:45:51.190527 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0a7be161-7ccc-4927-9e5e-33da903689e3-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "0a7be161-7ccc-4927-9e5e-33da903689e3" (UID: "0a7be161-7ccc-4927-9e5e-33da903689e3"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:45:51 crc kubenswrapper[5120]: I0316 16:45:51.191558 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0a7be161-7ccc-4927-9e5e-33da903689e3-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:45:51 crc kubenswrapper[5120]: I0316 16:45:51.214969 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a7be161-7ccc-4927-9e5e-33da903689e3-kube-api-access-6vx84" (OuterVolumeSpecName: "kube-api-access-6vx84") pod "0a7be161-7ccc-4927-9e5e-33da903689e3" (UID: "0a7be161-7ccc-4927-9e5e-33da903689e3"). InnerVolumeSpecName "kube-api-access-6vx84". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:45:51 crc kubenswrapper[5120]: I0316 16:45:51.293033 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6vx84\" (UniqueName: \"kubernetes.io/projected/0a7be161-7ccc-4927-9e5e-33da903689e3-kube-api-access-6vx84\") on node \"crc\" DevicePath \"\"" Mar 16 16:45:51 crc kubenswrapper[5120]: I0316 16:45:51.367166 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-create-qtpxl" Mar 16 16:45:51 crc kubenswrapper[5120]: I0316 16:45:51.373628 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-b06a-account-create-update-ngkgs" Mar 16 16:45:51 crc kubenswrapper[5120]: I0316 16:45:51.379885 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-create-6rvwm" Mar 16 16:45:51 crc kubenswrapper[5120]: I0316 16:45:51.394281 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wbsb5\" (UniqueName: \"kubernetes.io/projected/51ee86c6-3b72-4d15-81c7-48f44dfa71e1-kube-api-access-wbsb5\") pod \"51ee86c6-3b72-4d15-81c7-48f44dfa71e1\" (UID: \"51ee86c6-3b72-4d15-81c7-48f44dfa71e1\") " Mar 16 16:45:51 crc kubenswrapper[5120]: I0316 16:45:51.394353 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zxf6f\" (UniqueName: \"kubernetes.io/projected/3e708073-b72b-4b18-bac4-ead3cc84ad4d-kube-api-access-zxf6f\") pod \"3e708073-b72b-4b18-bac4-ead3cc84ad4d\" (UID: \"3e708073-b72b-4b18-bac4-ead3cc84ad4d\") " Mar 16 16:45:51 crc kubenswrapper[5120]: I0316 16:45:51.394426 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/51ee86c6-3b72-4d15-81c7-48f44dfa71e1-operator-scripts\") pod \"51ee86c6-3b72-4d15-81c7-48f44dfa71e1\" (UID: \"51ee86c6-3b72-4d15-81c7-48f44dfa71e1\") " Mar 16 16:45:51 crc kubenswrapper[5120]: I0316 16:45:51.394532 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3e708073-b72b-4b18-bac4-ead3cc84ad4d-operator-scripts\") pod \"3e708073-b72b-4b18-bac4-ead3cc84ad4d\" (UID: \"3e708073-b72b-4b18-bac4-ead3cc84ad4d\") " Mar 16 16:45:51 crc kubenswrapper[5120]: I0316 16:45:51.395006 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/51ee86c6-3b72-4d15-81c7-48f44dfa71e1-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "51ee86c6-3b72-4d15-81c7-48f44dfa71e1" (UID: "51ee86c6-3b72-4d15-81c7-48f44dfa71e1"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:45:51 crc kubenswrapper[5120]: I0316 16:45:51.395107 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3e708073-b72b-4b18-bac4-ead3cc84ad4d-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "3e708073-b72b-4b18-bac4-ead3cc84ad4d" (UID: "3e708073-b72b-4b18-bac4-ead3cc84ad4d"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:45:51 crc kubenswrapper[5120]: I0316 16:45:51.395641 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/51ee86c6-3b72-4d15-81c7-48f44dfa71e1-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:45:51 crc kubenswrapper[5120]: I0316 16:45:51.395660 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3e708073-b72b-4b18-bac4-ead3cc84ad4d-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:45:51 crc kubenswrapper[5120]: I0316 16:45:51.404803 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51ee86c6-3b72-4d15-81c7-48f44dfa71e1-kube-api-access-wbsb5" (OuterVolumeSpecName: "kube-api-access-wbsb5") pod "51ee86c6-3b72-4d15-81c7-48f44dfa71e1" (UID: "51ee86c6-3b72-4d15-81c7-48f44dfa71e1"). InnerVolumeSpecName "kube-api-access-wbsb5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:45:51 crc kubenswrapper[5120]: I0316 16:45:51.415056 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e708073-b72b-4b18-bac4-ead3cc84ad4d-kube-api-access-zxf6f" (OuterVolumeSpecName: "kube-api-access-zxf6f") pod "3e708073-b72b-4b18-bac4-ead3cc84ad4d" (UID: "3e708073-b72b-4b18-bac4-ead3cc84ad4d"). InnerVolumeSpecName "kube-api-access-zxf6f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:45:51 crc kubenswrapper[5120]: I0316 16:45:51.498566 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8727c588-240e-4721-917b-80b50e413963-operator-scripts\") pod \"8727c588-240e-4721-917b-80b50e413963\" (UID: \"8727c588-240e-4721-917b-80b50e413963\") " Mar 16 16:45:51 crc kubenswrapper[5120]: I0316 16:45:51.498780 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9lc4r\" (UniqueName: \"kubernetes.io/projected/8727c588-240e-4721-917b-80b50e413963-kube-api-access-9lc4r\") pod \"8727c588-240e-4721-917b-80b50e413963\" (UID: \"8727c588-240e-4721-917b-80b50e413963\") " Mar 16 16:45:51 crc kubenswrapper[5120]: I0316 16:45:51.499244 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wbsb5\" (UniqueName: \"kubernetes.io/projected/51ee86c6-3b72-4d15-81c7-48f44dfa71e1-kube-api-access-wbsb5\") on node \"crc\" DevicePath \"\"" Mar 16 16:45:51 crc kubenswrapper[5120]: I0316 16:45:51.499260 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zxf6f\" (UniqueName: \"kubernetes.io/projected/3e708073-b72b-4b18-bac4-ead3cc84ad4d-kube-api-access-zxf6f\") on node \"crc\" DevicePath \"\"" Mar 16 16:45:51 crc kubenswrapper[5120]: I0316 16:45:51.499962 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8727c588-240e-4721-917b-80b50e413963-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "8727c588-240e-4721-917b-80b50e413963" (UID: "8727c588-240e-4721-917b-80b50e413963"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:45:51 crc kubenswrapper[5120]: I0316 16:45:51.503163 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8727c588-240e-4721-917b-80b50e413963-kube-api-access-9lc4r" (OuterVolumeSpecName: "kube-api-access-9lc4r") pod "8727c588-240e-4721-917b-80b50e413963" (UID: "8727c588-240e-4721-917b-80b50e413963"). InnerVolumeSpecName "kube-api-access-9lc4r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:45:51 crc kubenswrapper[5120]: I0316 16:45:51.604116 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8727c588-240e-4721-917b-80b50e413963-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:45:51 crc kubenswrapper[5120]: I0316 16:45:51.604156 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9lc4r\" (UniqueName: \"kubernetes.io/projected/8727c588-240e-4721-917b-80b50e413963-kube-api-access-9lc4r\") on node \"crc\" DevicePath \"\"" Mar 16 16:45:51 crc kubenswrapper[5120]: I0316 16:45:51.727564 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-create-s475x" event={"ID":"0a7be161-7ccc-4927-9e5e-33da903689e3","Type":"ContainerDied","Data":"f9f138ef5bdaf46cceac4711b1c9dd678fe913bf46e0b31e46e35a72463f4586"} Mar 16 16:45:51 crc kubenswrapper[5120]: I0316 16:45:51.727603 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f9f138ef5bdaf46cceac4711b1c9dd678fe913bf46e0b31e46e35a72463f4586" Mar 16 16:45:51 crc kubenswrapper[5120]: I0316 16:45:51.727671 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-create-s475x" Mar 16 16:45:51 crc kubenswrapper[5120]: I0316 16:45:51.740215 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-b06a-account-create-update-ngkgs" event={"ID":"51ee86c6-3b72-4d15-81c7-48f44dfa71e1","Type":"ContainerDied","Data":"a3ce25e173a7bf861983698c8119c8705cf1e1b443f6638802ebe364ac43534a"} Mar 16 16:45:51 crc kubenswrapper[5120]: I0316 16:45:51.740256 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a3ce25e173a7bf861983698c8119c8705cf1e1b443f6638802ebe364ac43534a" Mar 16 16:45:51 crc kubenswrapper[5120]: I0316 16:45:51.740331 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-b06a-account-create-update-ngkgs" Mar 16 16:45:51 crc kubenswrapper[5120]: I0316 16:45:51.756143 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-create-qtpxl" event={"ID":"3e708073-b72b-4b18-bac4-ead3cc84ad4d","Type":"ContainerDied","Data":"ddf23449bff3492a8a86930a48640d8f4042043d12f3dafdff5472169c642103"} Mar 16 16:45:51 crc kubenswrapper[5120]: I0316 16:45:51.756181 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ddf23449bff3492a8a86930a48640d8f4042043d12f3dafdff5472169c642103" Mar 16 16:45:51 crc kubenswrapper[5120]: I0316 16:45:51.756302 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-create-qtpxl" Mar 16 16:45:51 crc kubenswrapper[5120]: I0316 16:45:51.762009 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-create-6rvwm" Mar 16 16:45:51 crc kubenswrapper[5120]: I0316 16:45:51.764018 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-create-6rvwm" event={"ID":"8727c588-240e-4721-917b-80b50e413963","Type":"ContainerDied","Data":"09466e0c2ddf58ff1de14855c7a11b6adf0e9f95abd08a88fd024f854cbaff2a"} Mar 16 16:45:51 crc kubenswrapper[5120]: I0316 16:45:51.764065 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="09466e0c2ddf58ff1de14855c7a11b6adf0e9f95abd08a88fd024f854cbaff2a" Mar 16 16:45:52 crc kubenswrapper[5120]: I0316 16:45:52.557484 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-0869-account-create-update-vch67" Mar 16 16:45:52 crc kubenswrapper[5120]: I0316 16:45:52.564900 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-1de0-account-create-update-p66v4" Mar 16 16:45:52 crc kubenswrapper[5120]: I0316 16:45:52.637257 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j4x8x\" (UniqueName: \"kubernetes.io/projected/60b0467f-dafd-4422-8a0c-fa3dd9ea3eb9-kube-api-access-j4x8x\") pod \"60b0467f-dafd-4422-8a0c-fa3dd9ea3eb9\" (UID: \"60b0467f-dafd-4422-8a0c-fa3dd9ea3eb9\") " Mar 16 16:45:52 crc kubenswrapper[5120]: I0316 16:45:52.637304 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/35e78e32-efae-42ac-b210-17cc868c1713-operator-scripts\") pod \"35e78e32-efae-42ac-b210-17cc868c1713\" (UID: \"35e78e32-efae-42ac-b210-17cc868c1713\") " Mar 16 16:45:52 crc kubenswrapper[5120]: I0316 16:45:52.637501 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8cxg4\" (UniqueName: \"kubernetes.io/projected/35e78e32-efae-42ac-b210-17cc868c1713-kube-api-access-8cxg4\") pod \"35e78e32-efae-42ac-b210-17cc868c1713\" (UID: \"35e78e32-efae-42ac-b210-17cc868c1713\") " Mar 16 16:45:52 crc kubenswrapper[5120]: I0316 16:45:52.637608 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/60b0467f-dafd-4422-8a0c-fa3dd9ea3eb9-operator-scripts\") pod \"60b0467f-dafd-4422-8a0c-fa3dd9ea3eb9\" (UID: \"60b0467f-dafd-4422-8a0c-fa3dd9ea3eb9\") " Mar 16 16:45:52 crc kubenswrapper[5120]: I0316 16:45:52.637949 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/35e78e32-efae-42ac-b210-17cc868c1713-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "35e78e32-efae-42ac-b210-17cc868c1713" (UID: "35e78e32-efae-42ac-b210-17cc868c1713"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:45:52 crc kubenswrapper[5120]: I0316 16:45:52.638046 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/60b0467f-dafd-4422-8a0c-fa3dd9ea3eb9-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "60b0467f-dafd-4422-8a0c-fa3dd9ea3eb9" (UID: "60b0467f-dafd-4422-8a0c-fa3dd9ea3eb9"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:45:52 crc kubenswrapper[5120]: I0316 16:45:52.638567 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/35e78e32-efae-42ac-b210-17cc868c1713-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:45:52 crc kubenswrapper[5120]: I0316 16:45:52.638588 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/60b0467f-dafd-4422-8a0c-fa3dd9ea3eb9-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:45:52 crc kubenswrapper[5120]: I0316 16:45:52.646034 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60b0467f-dafd-4422-8a0c-fa3dd9ea3eb9-kube-api-access-j4x8x" (OuterVolumeSpecName: "kube-api-access-j4x8x") pod "60b0467f-dafd-4422-8a0c-fa3dd9ea3eb9" (UID: "60b0467f-dafd-4422-8a0c-fa3dd9ea3eb9"). InnerVolumeSpecName "kube-api-access-j4x8x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:45:52 crc kubenswrapper[5120]: I0316 16:45:52.647106 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35e78e32-efae-42ac-b210-17cc868c1713-kube-api-access-8cxg4" (OuterVolumeSpecName: "kube-api-access-8cxg4") pod "35e78e32-efae-42ac-b210-17cc868c1713" (UID: "35e78e32-efae-42ac-b210-17cc868c1713"). InnerVolumeSpecName "kube-api-access-8cxg4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:45:52 crc kubenswrapper[5120]: I0316 16:45:52.740498 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8cxg4\" (UniqueName: \"kubernetes.io/projected/35e78e32-efae-42ac-b210-17cc868c1713-kube-api-access-8cxg4\") on node \"crc\" DevicePath \"\"" Mar 16 16:45:52 crc kubenswrapper[5120]: I0316 16:45:52.740541 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j4x8x\" (UniqueName: \"kubernetes.io/projected/60b0467f-dafd-4422-8a0c-fa3dd9ea3eb9-kube-api-access-j4x8x\") on node \"crc\" DevicePath \"\"" Mar 16 16:45:52 crc kubenswrapper[5120]: I0316 16:45:52.773148 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-1de0-account-create-update-p66v4" event={"ID":"35e78e32-efae-42ac-b210-17cc868c1713","Type":"ContainerDied","Data":"155fec1e554ab89b1bbde779277f91c1a8569428fe2b500407f4978347618a67"} Mar 16 16:45:52 crc kubenswrapper[5120]: I0316 16:45:52.773184 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="155fec1e554ab89b1bbde779277f91c1a8569428fe2b500407f4978347618a67" Mar 16 16:45:52 crc kubenswrapper[5120]: I0316 16:45:52.773247 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-1de0-account-create-update-p66v4" Mar 16 16:45:52 crc kubenswrapper[5120]: I0316 16:45:52.775721 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-0869-account-create-update-vch67" event={"ID":"60b0467f-dafd-4422-8a0c-fa3dd9ea3eb9","Type":"ContainerDied","Data":"dcdf5639cb9b48724ac0bb6a0b60d7abf69865081126ead717fb253cd89e6bc9"} Mar 16 16:45:52 crc kubenswrapper[5120]: I0316 16:45:52.775752 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dcdf5639cb9b48724ac0bb6a0b60d7abf69865081126ead717fb253cd89e6bc9" Mar 16 16:45:52 crc kubenswrapper[5120]: I0316 16:45:52.775815 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-0869-account-create-update-vch67" Mar 16 16:45:53 crc kubenswrapper[5120]: I0316 16:45:53.785698 5120 generic.go:358] "Generic (PLEG): container finished" podID="48bd8a90-61bd-414f-99b7-532428fa5ff4" containerID="8a0aa6771ff67781c6bea0b6706cc83f48802783eabac82a07c3459709fb9563" exitCode=0 Mar 16 16:45:53 crc kubenswrapper[5120]: I0316 16:45:53.785794 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-5pmhr" event={"ID":"48bd8a90-61bd-414f-99b7-532428fa5ff4","Type":"ContainerDied","Data":"8a0aa6771ff67781c6bea0b6706cc83f48802783eabac82a07c3459709fb9563"} Mar 16 16:45:55 crc kubenswrapper[5120]: I0316 16:45:55.142751 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-5pmhr" Mar 16 16:45:55 crc kubenswrapper[5120]: I0316 16:45:55.287237 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sq65q\" (UniqueName: \"kubernetes.io/projected/48bd8a90-61bd-414f-99b7-532428fa5ff4-kube-api-access-sq65q\") pod \"48bd8a90-61bd-414f-99b7-532428fa5ff4\" (UID: \"48bd8a90-61bd-414f-99b7-532428fa5ff4\") " Mar 16 16:45:55 crc kubenswrapper[5120]: I0316 16:45:55.287535 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/48bd8a90-61bd-414f-99b7-532428fa5ff4-config-data\") pod \"48bd8a90-61bd-414f-99b7-532428fa5ff4\" (UID: \"48bd8a90-61bd-414f-99b7-532428fa5ff4\") " Mar 16 16:45:55 crc kubenswrapper[5120]: I0316 16:45:55.288526 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/48bd8a90-61bd-414f-99b7-532428fa5ff4-combined-ca-bundle\") pod \"48bd8a90-61bd-414f-99b7-532428fa5ff4\" (UID: \"48bd8a90-61bd-414f-99b7-532428fa5ff4\") " Mar 16 16:45:55 crc kubenswrapper[5120]: I0316 16:45:55.294248 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48bd8a90-61bd-414f-99b7-532428fa5ff4-kube-api-access-sq65q" (OuterVolumeSpecName: "kube-api-access-sq65q") pod "48bd8a90-61bd-414f-99b7-532428fa5ff4" (UID: "48bd8a90-61bd-414f-99b7-532428fa5ff4"). InnerVolumeSpecName "kube-api-access-sq65q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:45:55 crc kubenswrapper[5120]: I0316 16:45:55.338873 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48bd8a90-61bd-414f-99b7-532428fa5ff4-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "48bd8a90-61bd-414f-99b7-532428fa5ff4" (UID: "48bd8a90-61bd-414f-99b7-532428fa5ff4"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:45:55 crc kubenswrapper[5120]: I0316 16:45:55.345218 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48bd8a90-61bd-414f-99b7-532428fa5ff4-config-data" (OuterVolumeSpecName: "config-data") pod "48bd8a90-61bd-414f-99b7-532428fa5ff4" (UID: "48bd8a90-61bd-414f-99b7-532428fa5ff4"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:45:55 crc kubenswrapper[5120]: I0316 16:45:55.392616 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/48bd8a90-61bd-414f-99b7-532428fa5ff4-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:45:55 crc kubenswrapper[5120]: I0316 16:45:55.392928 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/48bd8a90-61bd-414f-99b7-532428fa5ff4-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:45:55 crc kubenswrapper[5120]: I0316 16:45:55.393083 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sq65q\" (UniqueName: \"kubernetes.io/projected/48bd8a90-61bd-414f-99b7-532428fa5ff4-kube-api-access-sq65q\") on node \"crc\" DevicePath \"\"" Mar 16 16:45:55 crc kubenswrapper[5120]: I0316 16:45:55.805309 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-5pmhr" event={"ID":"48bd8a90-61bd-414f-99b7-532428fa5ff4","Type":"ContainerDied","Data":"13ed1d30e0e51551503043177d6666cf000048e9f49f7604338ed849f23f8569"} Mar 16 16:45:55 crc kubenswrapper[5120]: I0316 16:45:55.805347 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-5pmhr" Mar 16 16:45:55 crc kubenswrapper[5120]: I0316 16:45:55.805355 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="13ed1d30e0e51551503043177d6666cf000048e9f49f7604338ed849f23f8569" Mar 16 16:45:55 crc kubenswrapper[5120]: I0316 16:45:55.988083 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-tkzkl"] Mar 16 16:45:55 crc kubenswrapper[5120]: I0316 16:45:55.989617 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35e78e32-efae-42ac-b210-17cc868c1713" containerName="mariadb-account-create-update" Mar 16 16:45:55 crc kubenswrapper[5120]: I0316 16:45:55.989651 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="35e78e32-efae-42ac-b210-17cc868c1713" containerName="mariadb-account-create-update" Mar 16 16:45:55 crc kubenswrapper[5120]: I0316 16:45:55.989680 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e708073-b72b-4b18-bac4-ead3cc84ad4d" containerName="mariadb-database-create" Mar 16 16:45:55 crc kubenswrapper[5120]: I0316 16:45:55.989687 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e708073-b72b-4b18-bac4-ead3cc84ad4d" containerName="mariadb-database-create" Mar 16 16:45:55 crc kubenswrapper[5120]: I0316 16:45:55.989707 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51ee86c6-3b72-4d15-81c7-48f44dfa71e1" containerName="mariadb-account-create-update" Mar 16 16:45:55 crc kubenswrapper[5120]: I0316 16:45:55.989716 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="51ee86c6-3b72-4d15-81c7-48f44dfa71e1" containerName="mariadb-account-create-update" Mar 16 16:45:55 crc kubenswrapper[5120]: I0316 16:45:55.989797 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60b0467f-dafd-4422-8a0c-fa3dd9ea3eb9" containerName="mariadb-account-create-update" Mar 16 16:45:55 crc kubenswrapper[5120]: I0316 16:45:55.989808 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="60b0467f-dafd-4422-8a0c-fa3dd9ea3eb9" containerName="mariadb-account-create-update" Mar 16 16:45:55 crc kubenswrapper[5120]: I0316 16:45:55.989825 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48bd8a90-61bd-414f-99b7-532428fa5ff4" containerName="keystone-db-sync" Mar 16 16:45:55 crc kubenswrapper[5120]: I0316 16:45:55.989832 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="48bd8a90-61bd-414f-99b7-532428fa5ff4" containerName="keystone-db-sync" Mar 16 16:45:55 crc kubenswrapper[5120]: I0316 16:45:55.989848 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a7be161-7ccc-4927-9e5e-33da903689e3" containerName="mariadb-database-create" Mar 16 16:45:55 crc kubenswrapper[5120]: I0316 16:45:55.989855 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a7be161-7ccc-4927-9e5e-33da903689e3" containerName="mariadb-database-create" Mar 16 16:45:55 crc kubenswrapper[5120]: I0316 16:45:55.989880 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8727c588-240e-4721-917b-80b50e413963" containerName="mariadb-database-create" Mar 16 16:45:55 crc kubenswrapper[5120]: I0316 16:45:55.989887 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8727c588-240e-4721-917b-80b50e413963" containerName="mariadb-database-create" Mar 16 16:45:55 crc kubenswrapper[5120]: I0316 16:45:55.990077 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="35e78e32-efae-42ac-b210-17cc868c1713" containerName="mariadb-account-create-update" Mar 16 16:45:55 crc kubenswrapper[5120]: I0316 16:45:55.990093 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="51ee86c6-3b72-4d15-81c7-48f44dfa71e1" containerName="mariadb-account-create-update" Mar 16 16:45:55 crc kubenswrapper[5120]: I0316 16:45:55.990105 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="0a7be161-7ccc-4927-9e5e-33da903689e3" containerName="mariadb-database-create" Mar 16 16:45:55 crc kubenswrapper[5120]: I0316 16:45:55.990114 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="8727c588-240e-4721-917b-80b50e413963" containerName="mariadb-database-create" Mar 16 16:45:55 crc kubenswrapper[5120]: I0316 16:45:55.990136 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="60b0467f-dafd-4422-8a0c-fa3dd9ea3eb9" containerName="mariadb-account-create-update" Mar 16 16:45:55 crc kubenswrapper[5120]: I0316 16:45:55.990148 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="48bd8a90-61bd-414f-99b7-532428fa5ff4" containerName="keystone-db-sync" Mar 16 16:45:55 crc kubenswrapper[5120]: I0316 16:45:55.990163 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="3e708073-b72b-4b18-bac4-ead3cc84ad4d" containerName="mariadb-database-create" Mar 16 16:45:56 crc kubenswrapper[5120]: I0316 16:45:55.998020 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-tkzkl" Mar 16 16:45:56 crc kubenswrapper[5120]: I0316 16:45:56.006379 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-scripts\"" Mar 16 16:45:56 crc kubenswrapper[5120]: I0316 16:45:56.007790 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"osp-secret\"" Mar 16 16:45:56 crc kubenswrapper[5120]: I0316 16:45:56.008022 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-keystone-dockercfg-xfb6m\"" Mar 16 16:45:56 crc kubenswrapper[5120]: I0316 16:45:56.008189 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-config-data\"" Mar 16 16:45:56 crc kubenswrapper[5120]: I0316 16:45:56.008315 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone\"" Mar 16 16:45:56 crc kubenswrapper[5120]: I0316 16:45:56.053339 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-tkzkl"] Mar 16 16:45:56 crc kubenswrapper[5120]: I0316 16:45:56.107976 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dd9bf080-af81-4ff8-a892-50552f0c6be1-config-data\") pod \"keystone-bootstrap-tkzkl\" (UID: \"dd9bf080-af81-4ff8-a892-50552f0c6be1\") " pod="openstack-kuttl-tests/keystone-bootstrap-tkzkl" Mar 16 16:45:56 crc kubenswrapper[5120]: I0316 16:45:56.108042 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dd9bf080-af81-4ff8-a892-50552f0c6be1-combined-ca-bundle\") pod \"keystone-bootstrap-tkzkl\" (UID: \"dd9bf080-af81-4ff8-a892-50552f0c6be1\") " pod="openstack-kuttl-tests/keystone-bootstrap-tkzkl" Mar 16 16:45:56 crc kubenswrapper[5120]: I0316 16:45:56.108082 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wr58s\" (UniqueName: \"kubernetes.io/projected/dd9bf080-af81-4ff8-a892-50552f0c6be1-kube-api-access-wr58s\") pod \"keystone-bootstrap-tkzkl\" (UID: \"dd9bf080-af81-4ff8-a892-50552f0c6be1\") " pod="openstack-kuttl-tests/keystone-bootstrap-tkzkl" Mar 16 16:45:56 crc kubenswrapper[5120]: I0316 16:45:56.108099 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/dd9bf080-af81-4ff8-a892-50552f0c6be1-credential-keys\") pod \"keystone-bootstrap-tkzkl\" (UID: \"dd9bf080-af81-4ff8-a892-50552f0c6be1\") " pod="openstack-kuttl-tests/keystone-bootstrap-tkzkl" Mar 16 16:45:56 crc kubenswrapper[5120]: I0316 16:45:56.108271 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/dd9bf080-af81-4ff8-a892-50552f0c6be1-fernet-keys\") pod \"keystone-bootstrap-tkzkl\" (UID: \"dd9bf080-af81-4ff8-a892-50552f0c6be1\") " pod="openstack-kuttl-tests/keystone-bootstrap-tkzkl" Mar 16 16:45:56 crc kubenswrapper[5120]: I0316 16:45:56.108295 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/dd9bf080-af81-4ff8-a892-50552f0c6be1-scripts\") pod \"keystone-bootstrap-tkzkl\" (UID: \"dd9bf080-af81-4ff8-a892-50552f0c6be1\") " pod="openstack-kuttl-tests/keystone-bootstrap-tkzkl" Mar 16 16:45:56 crc kubenswrapper[5120]: I0316 16:45:56.170955 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-lmn5g"] Mar 16 16:45:56 crc kubenswrapper[5120]: I0316 16:45:56.176555 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-lmn5g" Mar 16 16:45:56 crc kubenswrapper[5120]: I0316 16:45:56.181603 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-neutron-dockercfg-49ghd\"" Mar 16 16:45:56 crc kubenswrapper[5120]: I0316 16:45:56.182802 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-httpd-config\"" Mar 16 16:45:56 crc kubenswrapper[5120]: I0316 16:45:56.183812 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-lmn5g"] Mar 16 16:45:56 crc kubenswrapper[5120]: I0316 16:45:56.184746 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-config\"" Mar 16 16:45:56 crc kubenswrapper[5120]: I0316 16:45:56.209877 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dd9bf080-af81-4ff8-a892-50552f0c6be1-config-data\") pod \"keystone-bootstrap-tkzkl\" (UID: \"dd9bf080-af81-4ff8-a892-50552f0c6be1\") " pod="openstack-kuttl-tests/keystone-bootstrap-tkzkl" Mar 16 16:45:56 crc kubenswrapper[5120]: I0316 16:45:56.210162 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dd9bf080-af81-4ff8-a892-50552f0c6be1-combined-ca-bundle\") pod \"keystone-bootstrap-tkzkl\" (UID: \"dd9bf080-af81-4ff8-a892-50552f0c6be1\") " pod="openstack-kuttl-tests/keystone-bootstrap-tkzkl" Mar 16 16:45:56 crc kubenswrapper[5120]: I0316 16:45:56.210267 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wr58s\" (UniqueName: \"kubernetes.io/projected/dd9bf080-af81-4ff8-a892-50552f0c6be1-kube-api-access-wr58s\") pod \"keystone-bootstrap-tkzkl\" (UID: \"dd9bf080-af81-4ff8-a892-50552f0c6be1\") " pod="openstack-kuttl-tests/keystone-bootstrap-tkzkl" Mar 16 16:45:56 crc kubenswrapper[5120]: I0316 16:45:56.210363 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/dd9bf080-af81-4ff8-a892-50552f0c6be1-credential-keys\") pod \"keystone-bootstrap-tkzkl\" (UID: \"dd9bf080-af81-4ff8-a892-50552f0c6be1\") " pod="openstack-kuttl-tests/keystone-bootstrap-tkzkl" Mar 16 16:45:56 crc kubenswrapper[5120]: I0316 16:45:56.210561 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/dd9bf080-af81-4ff8-a892-50552f0c6be1-fernet-keys\") pod \"keystone-bootstrap-tkzkl\" (UID: \"dd9bf080-af81-4ff8-a892-50552f0c6be1\") " pod="openstack-kuttl-tests/keystone-bootstrap-tkzkl" Mar 16 16:45:56 crc kubenswrapper[5120]: I0316 16:45:56.210656 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/dd9bf080-af81-4ff8-a892-50552f0c6be1-scripts\") pod \"keystone-bootstrap-tkzkl\" (UID: \"dd9bf080-af81-4ff8-a892-50552f0c6be1\") " pod="openstack-kuttl-tests/keystone-bootstrap-tkzkl" Mar 16 16:45:56 crc kubenswrapper[5120]: I0316 16:45:56.215814 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/dd9bf080-af81-4ff8-a892-50552f0c6be1-scripts\") pod \"keystone-bootstrap-tkzkl\" (UID: \"dd9bf080-af81-4ff8-a892-50552f0c6be1\") " pod="openstack-kuttl-tests/keystone-bootstrap-tkzkl" Mar 16 16:45:56 crc kubenswrapper[5120]: I0316 16:45:56.216116 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/dd9bf080-af81-4ff8-a892-50552f0c6be1-credential-keys\") pod \"keystone-bootstrap-tkzkl\" (UID: \"dd9bf080-af81-4ff8-a892-50552f0c6be1\") " pod="openstack-kuttl-tests/keystone-bootstrap-tkzkl" Mar 16 16:45:56 crc kubenswrapper[5120]: I0316 16:45:56.223503 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dd9bf080-af81-4ff8-a892-50552f0c6be1-combined-ca-bundle\") pod \"keystone-bootstrap-tkzkl\" (UID: \"dd9bf080-af81-4ff8-a892-50552f0c6be1\") " pod="openstack-kuttl-tests/keystone-bootstrap-tkzkl" Mar 16 16:45:56 crc kubenswrapper[5120]: I0316 16:45:56.223716 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/dd9bf080-af81-4ff8-a892-50552f0c6be1-fernet-keys\") pod \"keystone-bootstrap-tkzkl\" (UID: \"dd9bf080-af81-4ff8-a892-50552f0c6be1\") " pod="openstack-kuttl-tests/keystone-bootstrap-tkzkl" Mar 16 16:45:56 crc kubenswrapper[5120]: I0316 16:45:56.231528 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dd9bf080-af81-4ff8-a892-50552f0c6be1-config-data\") pod \"keystone-bootstrap-tkzkl\" (UID: \"dd9bf080-af81-4ff8-a892-50552f0c6be1\") " pod="openstack-kuttl-tests/keystone-bootstrap-tkzkl" Mar 16 16:45:56 crc kubenswrapper[5120]: I0316 16:45:56.232037 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:45:56 crc kubenswrapper[5120]: I0316 16:45:56.247236 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wr58s\" (UniqueName: \"kubernetes.io/projected/dd9bf080-af81-4ff8-a892-50552f0c6be1-kube-api-access-wr58s\") pod \"keystone-bootstrap-tkzkl\" (UID: \"dd9bf080-af81-4ff8-a892-50552f0c6be1\") " pod="openstack-kuttl-tests/keystone-bootstrap-tkzkl" Mar 16 16:45:56 crc kubenswrapper[5120]: I0316 16:45:56.249046 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:45:56 crc kubenswrapper[5120]: I0316 16:45:56.252489 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:45:56 crc kubenswrapper[5120]: I0316 16:45:56.252514 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 16:45:56 crc kubenswrapper[5120]: I0316 16:45:56.252645 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 16:45:56 crc kubenswrapper[5120]: I0316 16:45:56.312591 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/35cf2836-2898-4b13-944c-e61b5b4c005b-config\") pod \"neutron-db-sync-lmn5g\" (UID: \"35cf2836-2898-4b13-944c-e61b5b4c005b\") " pod="openstack-kuttl-tests/neutron-db-sync-lmn5g" Mar 16 16:45:56 crc kubenswrapper[5120]: I0316 16:45:56.312636 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/35cf2836-2898-4b13-944c-e61b5b4c005b-combined-ca-bundle\") pod \"neutron-db-sync-lmn5g\" (UID: \"35cf2836-2898-4b13-944c-e61b5b4c005b\") " pod="openstack-kuttl-tests/neutron-db-sync-lmn5g" Mar 16 16:45:56 crc kubenswrapper[5120]: I0316 16:45:56.312828 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8x84n\" (UniqueName: \"kubernetes.io/projected/35cf2836-2898-4b13-944c-e61b5b4c005b-kube-api-access-8x84n\") pod \"neutron-db-sync-lmn5g\" (UID: \"35cf2836-2898-4b13-944c-e61b5b4c005b\") " pod="openstack-kuttl-tests/neutron-db-sync-lmn5g" Mar 16 16:45:56 crc kubenswrapper[5120]: I0316 16:45:56.329599 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-db-sync-hvllz"] Mar 16 16:45:56 crc kubenswrapper[5120]: I0316 16:45:56.344499 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-hvllz"] Mar 16 16:45:56 crc kubenswrapper[5120]: I0316 16:45:56.344636 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-hvllz" Mar 16 16:45:56 crc kubenswrapper[5120]: I0316 16:45:56.350391 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-placement-dockercfg-rb5jt\"" Mar 16 16:45:56 crc kubenswrapper[5120]: I0316 16:45:56.350808 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-config-data\"" Mar 16 16:45:56 crc kubenswrapper[5120]: I0316 16:45:56.350938 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-scripts\"" Mar 16 16:45:56 crc kubenswrapper[5120]: I0316 16:45:56.354272 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-tkzkl" Mar 16 16:45:56 crc kubenswrapper[5120]: I0316 16:45:56.417031 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rb4dt\" (UniqueName: \"kubernetes.io/projected/9259fe9e-b8ac-4419-a121-b51b0b3916e4-kube-api-access-rb4dt\") pod \"ceilometer-0\" (UID: \"9259fe9e-b8ac-4419-a121-b51b0b3916e4\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:45:56 crc kubenswrapper[5120]: I0316 16:45:56.417130 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9259fe9e-b8ac-4419-a121-b51b0b3916e4-config-data\") pod \"ceilometer-0\" (UID: \"9259fe9e-b8ac-4419-a121-b51b0b3916e4\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:45:56 crc kubenswrapper[5120]: I0316 16:45:56.417172 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8x84n\" (UniqueName: \"kubernetes.io/projected/35cf2836-2898-4b13-944c-e61b5b4c005b-kube-api-access-8x84n\") pod \"neutron-db-sync-lmn5g\" (UID: \"35cf2836-2898-4b13-944c-e61b5b4c005b\") " pod="openstack-kuttl-tests/neutron-db-sync-lmn5g" Mar 16 16:45:56 crc kubenswrapper[5120]: I0316 16:45:56.417226 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/9259fe9e-b8ac-4419-a121-b51b0b3916e4-log-httpd\") pod \"ceilometer-0\" (UID: \"9259fe9e-b8ac-4419-a121-b51b0b3916e4\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:45:56 crc kubenswrapper[5120]: I0316 16:45:56.417257 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/9259fe9e-b8ac-4419-a121-b51b0b3916e4-run-httpd\") pod \"ceilometer-0\" (UID: \"9259fe9e-b8ac-4419-a121-b51b0b3916e4\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:45:56 crc kubenswrapper[5120]: I0316 16:45:56.417296 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9259fe9e-b8ac-4419-a121-b51b0b3916e4-scripts\") pod \"ceilometer-0\" (UID: \"9259fe9e-b8ac-4419-a121-b51b0b3916e4\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:45:56 crc kubenswrapper[5120]: I0316 16:45:56.417324 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9259fe9e-b8ac-4419-a121-b51b0b3916e4-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"9259fe9e-b8ac-4419-a121-b51b0b3916e4\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:45:56 crc kubenswrapper[5120]: I0316 16:45:56.417357 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/9259fe9e-b8ac-4419-a121-b51b0b3916e4-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"9259fe9e-b8ac-4419-a121-b51b0b3916e4\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:45:56 crc kubenswrapper[5120]: I0316 16:45:56.417426 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/35cf2836-2898-4b13-944c-e61b5b4c005b-config\") pod \"neutron-db-sync-lmn5g\" (UID: \"35cf2836-2898-4b13-944c-e61b5b4c005b\") " pod="openstack-kuttl-tests/neutron-db-sync-lmn5g" Mar 16 16:45:56 crc kubenswrapper[5120]: I0316 16:45:56.417447 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/35cf2836-2898-4b13-944c-e61b5b4c005b-combined-ca-bundle\") pod \"neutron-db-sync-lmn5g\" (UID: \"35cf2836-2898-4b13-944c-e61b5b4c005b\") " pod="openstack-kuttl-tests/neutron-db-sync-lmn5g" Mar 16 16:45:56 crc kubenswrapper[5120]: I0316 16:45:56.426895 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/35cf2836-2898-4b13-944c-e61b5b4c005b-combined-ca-bundle\") pod \"neutron-db-sync-lmn5g\" (UID: \"35cf2836-2898-4b13-944c-e61b5b4c005b\") " pod="openstack-kuttl-tests/neutron-db-sync-lmn5g" Mar 16 16:45:56 crc kubenswrapper[5120]: I0316 16:45:56.426968 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/35cf2836-2898-4b13-944c-e61b5b4c005b-config\") pod \"neutron-db-sync-lmn5g\" (UID: \"35cf2836-2898-4b13-944c-e61b5b4c005b\") " pod="openstack-kuttl-tests/neutron-db-sync-lmn5g" Mar 16 16:45:56 crc kubenswrapper[5120]: I0316 16:45:56.444039 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8x84n\" (UniqueName: \"kubernetes.io/projected/35cf2836-2898-4b13-944c-e61b5b4c005b-kube-api-access-8x84n\") pod \"neutron-db-sync-lmn5g\" (UID: \"35cf2836-2898-4b13-944c-e61b5b4c005b\") " pod="openstack-kuttl-tests/neutron-db-sync-lmn5g" Mar 16 16:45:56 crc kubenswrapper[5120]: I0316 16:45:56.506014 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-lmn5g" Mar 16 16:45:56 crc kubenswrapper[5120]: I0316 16:45:56.518492 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/9259fe9e-b8ac-4419-a121-b51b0b3916e4-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"9259fe9e-b8ac-4419-a121-b51b0b3916e4\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:45:56 crc kubenswrapper[5120]: I0316 16:45:56.518550 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-965zx\" (UniqueName: \"kubernetes.io/projected/8b2bc00f-2d60-481e-803d-b4dbd39cdc4e-kube-api-access-965zx\") pod \"placement-db-sync-hvllz\" (UID: \"8b2bc00f-2d60-481e-803d-b4dbd39cdc4e\") " pod="openstack-kuttl-tests/placement-db-sync-hvllz" Mar 16 16:45:56 crc kubenswrapper[5120]: I0316 16:45:56.518637 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8b2bc00f-2d60-481e-803d-b4dbd39cdc4e-combined-ca-bundle\") pod \"placement-db-sync-hvllz\" (UID: \"8b2bc00f-2d60-481e-803d-b4dbd39cdc4e\") " pod="openstack-kuttl-tests/placement-db-sync-hvllz" Mar 16 16:45:56 crc kubenswrapper[5120]: I0316 16:45:56.518715 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rb4dt\" (UniqueName: \"kubernetes.io/projected/9259fe9e-b8ac-4419-a121-b51b0b3916e4-kube-api-access-rb4dt\") pod \"ceilometer-0\" (UID: \"9259fe9e-b8ac-4419-a121-b51b0b3916e4\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:45:56 crc kubenswrapper[5120]: I0316 16:45:56.518772 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8b2bc00f-2d60-481e-803d-b4dbd39cdc4e-scripts\") pod \"placement-db-sync-hvllz\" (UID: \"8b2bc00f-2d60-481e-803d-b4dbd39cdc4e\") " pod="openstack-kuttl-tests/placement-db-sync-hvllz" Mar 16 16:45:56 crc kubenswrapper[5120]: I0316 16:45:56.518792 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8b2bc00f-2d60-481e-803d-b4dbd39cdc4e-logs\") pod \"placement-db-sync-hvllz\" (UID: \"8b2bc00f-2d60-481e-803d-b4dbd39cdc4e\") " pod="openstack-kuttl-tests/placement-db-sync-hvllz" Mar 16 16:45:56 crc kubenswrapper[5120]: I0316 16:45:56.518820 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8b2bc00f-2d60-481e-803d-b4dbd39cdc4e-config-data\") pod \"placement-db-sync-hvllz\" (UID: \"8b2bc00f-2d60-481e-803d-b4dbd39cdc4e\") " pod="openstack-kuttl-tests/placement-db-sync-hvllz" Mar 16 16:45:56 crc kubenswrapper[5120]: I0316 16:45:56.518884 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9259fe9e-b8ac-4419-a121-b51b0b3916e4-config-data\") pod \"ceilometer-0\" (UID: \"9259fe9e-b8ac-4419-a121-b51b0b3916e4\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:45:56 crc kubenswrapper[5120]: I0316 16:45:56.518972 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/9259fe9e-b8ac-4419-a121-b51b0b3916e4-log-httpd\") pod \"ceilometer-0\" (UID: \"9259fe9e-b8ac-4419-a121-b51b0b3916e4\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:45:56 crc kubenswrapper[5120]: I0316 16:45:56.519016 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/9259fe9e-b8ac-4419-a121-b51b0b3916e4-run-httpd\") pod \"ceilometer-0\" (UID: \"9259fe9e-b8ac-4419-a121-b51b0b3916e4\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:45:56 crc kubenswrapper[5120]: I0316 16:45:56.519066 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9259fe9e-b8ac-4419-a121-b51b0b3916e4-scripts\") pod \"ceilometer-0\" (UID: \"9259fe9e-b8ac-4419-a121-b51b0b3916e4\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:45:56 crc kubenswrapper[5120]: I0316 16:45:56.519107 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9259fe9e-b8ac-4419-a121-b51b0b3916e4-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"9259fe9e-b8ac-4419-a121-b51b0b3916e4\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:45:56 crc kubenswrapper[5120]: I0316 16:45:56.527848 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/9259fe9e-b8ac-4419-a121-b51b0b3916e4-log-httpd\") pod \"ceilometer-0\" (UID: \"9259fe9e-b8ac-4419-a121-b51b0b3916e4\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:45:56 crc kubenswrapper[5120]: I0316 16:45:56.528793 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/9259fe9e-b8ac-4419-a121-b51b0b3916e4-run-httpd\") pod \"ceilometer-0\" (UID: \"9259fe9e-b8ac-4419-a121-b51b0b3916e4\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:45:56 crc kubenswrapper[5120]: I0316 16:45:56.541161 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9259fe9e-b8ac-4419-a121-b51b0b3916e4-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"9259fe9e-b8ac-4419-a121-b51b0b3916e4\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:45:56 crc kubenswrapper[5120]: I0316 16:45:56.552036 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9259fe9e-b8ac-4419-a121-b51b0b3916e4-config-data\") pod \"ceilometer-0\" (UID: \"9259fe9e-b8ac-4419-a121-b51b0b3916e4\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:45:56 crc kubenswrapper[5120]: I0316 16:45:56.552732 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9259fe9e-b8ac-4419-a121-b51b0b3916e4-scripts\") pod \"ceilometer-0\" (UID: \"9259fe9e-b8ac-4419-a121-b51b0b3916e4\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:45:56 crc kubenswrapper[5120]: I0316 16:45:56.564412 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rb4dt\" (UniqueName: \"kubernetes.io/projected/9259fe9e-b8ac-4419-a121-b51b0b3916e4-kube-api-access-rb4dt\") pod \"ceilometer-0\" (UID: \"9259fe9e-b8ac-4419-a121-b51b0b3916e4\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:45:56 crc kubenswrapper[5120]: I0316 16:45:56.569445 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/9259fe9e-b8ac-4419-a121-b51b0b3916e4-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"9259fe9e-b8ac-4419-a121-b51b0b3916e4\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:45:56 crc kubenswrapper[5120]: I0316 16:45:56.622030 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-965zx\" (UniqueName: \"kubernetes.io/projected/8b2bc00f-2d60-481e-803d-b4dbd39cdc4e-kube-api-access-965zx\") pod \"placement-db-sync-hvllz\" (UID: \"8b2bc00f-2d60-481e-803d-b4dbd39cdc4e\") " pod="openstack-kuttl-tests/placement-db-sync-hvllz" Mar 16 16:45:56 crc kubenswrapper[5120]: I0316 16:45:56.622134 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8b2bc00f-2d60-481e-803d-b4dbd39cdc4e-combined-ca-bundle\") pod \"placement-db-sync-hvllz\" (UID: \"8b2bc00f-2d60-481e-803d-b4dbd39cdc4e\") " pod="openstack-kuttl-tests/placement-db-sync-hvllz" Mar 16 16:45:56 crc kubenswrapper[5120]: I0316 16:45:56.622215 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8b2bc00f-2d60-481e-803d-b4dbd39cdc4e-scripts\") pod \"placement-db-sync-hvllz\" (UID: \"8b2bc00f-2d60-481e-803d-b4dbd39cdc4e\") " pod="openstack-kuttl-tests/placement-db-sync-hvllz" Mar 16 16:45:56 crc kubenswrapper[5120]: I0316 16:45:56.622231 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8b2bc00f-2d60-481e-803d-b4dbd39cdc4e-logs\") pod \"placement-db-sync-hvllz\" (UID: \"8b2bc00f-2d60-481e-803d-b4dbd39cdc4e\") " pod="openstack-kuttl-tests/placement-db-sync-hvllz" Mar 16 16:45:56 crc kubenswrapper[5120]: I0316 16:45:56.622255 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8b2bc00f-2d60-481e-803d-b4dbd39cdc4e-config-data\") pod \"placement-db-sync-hvllz\" (UID: \"8b2bc00f-2d60-481e-803d-b4dbd39cdc4e\") " pod="openstack-kuttl-tests/placement-db-sync-hvllz" Mar 16 16:45:56 crc kubenswrapper[5120]: I0316 16:45:56.623285 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8b2bc00f-2d60-481e-803d-b4dbd39cdc4e-logs\") pod \"placement-db-sync-hvllz\" (UID: \"8b2bc00f-2d60-481e-803d-b4dbd39cdc4e\") " pod="openstack-kuttl-tests/placement-db-sync-hvllz" Mar 16 16:45:56 crc kubenswrapper[5120]: I0316 16:45:56.626562 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8b2bc00f-2d60-481e-803d-b4dbd39cdc4e-scripts\") pod \"placement-db-sync-hvllz\" (UID: \"8b2bc00f-2d60-481e-803d-b4dbd39cdc4e\") " pod="openstack-kuttl-tests/placement-db-sync-hvllz" Mar 16 16:45:56 crc kubenswrapper[5120]: I0316 16:45:56.628408 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8b2bc00f-2d60-481e-803d-b4dbd39cdc4e-combined-ca-bundle\") pod \"placement-db-sync-hvllz\" (UID: \"8b2bc00f-2d60-481e-803d-b4dbd39cdc4e\") " pod="openstack-kuttl-tests/placement-db-sync-hvllz" Mar 16 16:45:56 crc kubenswrapper[5120]: I0316 16:45:56.628624 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8b2bc00f-2d60-481e-803d-b4dbd39cdc4e-config-data\") pod \"placement-db-sync-hvllz\" (UID: \"8b2bc00f-2d60-481e-803d-b4dbd39cdc4e\") " pod="openstack-kuttl-tests/placement-db-sync-hvllz" Mar 16 16:45:56 crc kubenswrapper[5120]: I0316 16:45:56.641462 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-965zx\" (UniqueName: \"kubernetes.io/projected/8b2bc00f-2d60-481e-803d-b4dbd39cdc4e-kube-api-access-965zx\") pod \"placement-db-sync-hvllz\" (UID: \"8b2bc00f-2d60-481e-803d-b4dbd39cdc4e\") " pod="openstack-kuttl-tests/placement-db-sync-hvllz" Mar 16 16:45:56 crc kubenswrapper[5120]: I0316 16:45:56.644427 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:45:56 crc kubenswrapper[5120]: I0316 16:45:56.664845 5120 scope.go:117] "RemoveContainer" containerID="35a7dd6e19084cee69ca16203bca6378ea0cdf6a685ca2093ab847e5904eb9e6" Mar 16 16:45:56 crc kubenswrapper[5120]: E0316 16:45:56.665152 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:45:56 crc kubenswrapper[5120]: I0316 16:45:56.686462 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-hvllz" Mar 16 16:45:56 crc kubenswrapper[5120]: I0316 16:45:56.799375 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:45:56 crc kubenswrapper[5120]: I0316 16:45:56.826066 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:45:56 crc kubenswrapper[5120]: I0316 16:45:56.834441 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:45:56 crc kubenswrapper[5120]: I0316 16:45:56.846105 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-external-config-data\"" Mar 16 16:45:56 crc kubenswrapper[5120]: I0316 16:45:56.846268 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-glance-dockercfg-6m2c9\"" Mar 16 16:45:56 crc kubenswrapper[5120]: I0316 16:45:56.846277 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-scripts\"" Mar 16 16:45:56 crc kubenswrapper[5120]: I0316 16:45:56.859182 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-lmn5g"] Mar 16 16:45:56 crc kubenswrapper[5120]: I0316 16:45:56.882808 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-tkzkl"] Mar 16 16:45:56 crc kubenswrapper[5120]: I0316 16:45:56.929936 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/dcac8fc1-81ec-4845-b0d0-30e6a05bbb1f-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"dcac8fc1-81ec-4845-b0d0-30e6a05bbb1f\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:45:56 crc kubenswrapper[5120]: I0316 16:45:56.930052 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/dcac8fc1-81ec-4845-b0d0-30e6a05bbb1f-scripts\") pod \"glance-default-external-api-0\" (UID: \"dcac8fc1-81ec-4845-b0d0-30e6a05bbb1f\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:45:56 crc kubenswrapper[5120]: I0316 16:45:56.930079 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4x4g6\" (UniqueName: \"kubernetes.io/projected/dcac8fc1-81ec-4845-b0d0-30e6a05bbb1f-kube-api-access-4x4g6\") pod \"glance-default-external-api-0\" (UID: \"dcac8fc1-81ec-4845-b0d0-30e6a05bbb1f\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:45:56 crc kubenswrapper[5120]: I0316 16:45:56.930187 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dcac8fc1-81ec-4845-b0d0-30e6a05bbb1f-config-data\") pod \"glance-default-external-api-0\" (UID: \"dcac8fc1-81ec-4845-b0d0-30e6a05bbb1f\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:45:56 crc kubenswrapper[5120]: I0316 16:45:56.930210 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dcac8fc1-81ec-4845-b0d0-30e6a05bbb1f-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"dcac8fc1-81ec-4845-b0d0-30e6a05bbb1f\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:45:56 crc kubenswrapper[5120]: I0316 16:45:56.930279 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"glance-default-external-api-0\" (UID: \"dcac8fc1-81ec-4845-b0d0-30e6a05bbb1f\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:45:56 crc kubenswrapper[5120]: I0316 16:45:56.930309 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/dcac8fc1-81ec-4845-b0d0-30e6a05bbb1f-logs\") pod \"glance-default-external-api-0\" (UID: \"dcac8fc1-81ec-4845-b0d0-30e6a05bbb1f\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:45:56 crc kubenswrapper[5120]: I0316 16:45:56.959625 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:45:56 crc kubenswrapper[5120]: I0316 16:45:56.970058 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:45:56 crc kubenswrapper[5120]: I0316 16:45:56.973400 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-internal-config-data\"" Mar 16 16:45:56 crc kubenswrapper[5120]: I0316 16:45:56.973845 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:45:57 crc kubenswrapper[5120]: I0316 16:45:57.035102 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/93aa847e-5758-407c-bc62-6e72d895ef76-logs\") pod \"glance-default-internal-api-0\" (UID: \"93aa847e-5758-407c-bc62-6e72d895ef76\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:45:57 crc kubenswrapper[5120]: I0316 16:45:57.035152 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/93aa847e-5758-407c-bc62-6e72d895ef76-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"93aa847e-5758-407c-bc62-6e72d895ef76\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:45:57 crc kubenswrapper[5120]: I0316 16:45:57.035194 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/dcac8fc1-81ec-4845-b0d0-30e6a05bbb1f-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"dcac8fc1-81ec-4845-b0d0-30e6a05bbb1f\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:45:57 crc kubenswrapper[5120]: I0316 16:45:57.035383 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/93aa847e-5758-407c-bc62-6e72d895ef76-scripts\") pod \"glance-default-internal-api-0\" (UID: \"93aa847e-5758-407c-bc62-6e72d895ef76\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:45:57 crc kubenswrapper[5120]: I0316 16:45:57.035455 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"glance-default-internal-api-0\" (UID: \"93aa847e-5758-407c-bc62-6e72d895ef76\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:45:57 crc kubenswrapper[5120]: I0316 16:45:57.035477 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/dcac8fc1-81ec-4845-b0d0-30e6a05bbb1f-scripts\") pod \"glance-default-external-api-0\" (UID: \"dcac8fc1-81ec-4845-b0d0-30e6a05bbb1f\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:45:57 crc kubenswrapper[5120]: I0316 16:45:57.035501 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4x4g6\" (UniqueName: \"kubernetes.io/projected/dcac8fc1-81ec-4845-b0d0-30e6a05bbb1f-kube-api-access-4x4g6\") pod \"glance-default-external-api-0\" (UID: \"dcac8fc1-81ec-4845-b0d0-30e6a05bbb1f\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:45:57 crc kubenswrapper[5120]: I0316 16:45:57.035580 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dcac8fc1-81ec-4845-b0d0-30e6a05bbb1f-config-data\") pod \"glance-default-external-api-0\" (UID: \"dcac8fc1-81ec-4845-b0d0-30e6a05bbb1f\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:45:57 crc kubenswrapper[5120]: I0316 16:45:57.035601 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dcac8fc1-81ec-4845-b0d0-30e6a05bbb1f-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"dcac8fc1-81ec-4845-b0d0-30e6a05bbb1f\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:45:57 crc kubenswrapper[5120]: I0316 16:45:57.035623 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/93aa847e-5758-407c-bc62-6e72d895ef76-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"93aa847e-5758-407c-bc62-6e72d895ef76\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:45:57 crc kubenswrapper[5120]: I0316 16:45:57.035670 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d79dn\" (UniqueName: \"kubernetes.io/projected/93aa847e-5758-407c-bc62-6e72d895ef76-kube-api-access-d79dn\") pod \"glance-default-internal-api-0\" (UID: \"93aa847e-5758-407c-bc62-6e72d895ef76\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:45:57 crc kubenswrapper[5120]: I0316 16:45:57.035707 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/93aa847e-5758-407c-bc62-6e72d895ef76-config-data\") pod \"glance-default-internal-api-0\" (UID: \"93aa847e-5758-407c-bc62-6e72d895ef76\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:45:57 crc kubenswrapper[5120]: I0316 16:45:57.035724 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"glance-default-external-api-0\" (UID: \"dcac8fc1-81ec-4845-b0d0-30e6a05bbb1f\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:45:57 crc kubenswrapper[5120]: I0316 16:45:57.035773 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/dcac8fc1-81ec-4845-b0d0-30e6a05bbb1f-logs\") pod \"glance-default-external-api-0\" (UID: \"dcac8fc1-81ec-4845-b0d0-30e6a05bbb1f\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:45:57 crc kubenswrapper[5120]: I0316 16:45:57.038006 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/dcac8fc1-81ec-4845-b0d0-30e6a05bbb1f-logs\") pod \"glance-default-external-api-0\" (UID: \"dcac8fc1-81ec-4845-b0d0-30e6a05bbb1f\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:45:57 crc kubenswrapper[5120]: I0316 16:45:57.038334 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"glance-default-external-api-0\" (UID: \"dcac8fc1-81ec-4845-b0d0-30e6a05bbb1f\") device mount path \"/mnt/openstack/pv02\"" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:45:57 crc kubenswrapper[5120]: I0316 16:45:57.041992 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/dcac8fc1-81ec-4845-b0d0-30e6a05bbb1f-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"dcac8fc1-81ec-4845-b0d0-30e6a05bbb1f\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:45:57 crc kubenswrapper[5120]: I0316 16:45:57.042633 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/dcac8fc1-81ec-4845-b0d0-30e6a05bbb1f-scripts\") pod \"glance-default-external-api-0\" (UID: \"dcac8fc1-81ec-4845-b0d0-30e6a05bbb1f\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:45:57 crc kubenswrapper[5120]: I0316 16:45:57.046267 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dcac8fc1-81ec-4845-b0d0-30e6a05bbb1f-config-data\") pod \"glance-default-external-api-0\" (UID: \"dcac8fc1-81ec-4845-b0d0-30e6a05bbb1f\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:45:57 crc kubenswrapper[5120]: I0316 16:45:57.053810 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dcac8fc1-81ec-4845-b0d0-30e6a05bbb1f-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"dcac8fc1-81ec-4845-b0d0-30e6a05bbb1f\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:45:57 crc kubenswrapper[5120]: I0316 16:45:57.070861 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"glance-default-external-api-0\" (UID: \"dcac8fc1-81ec-4845-b0d0-30e6a05bbb1f\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:45:57 crc kubenswrapper[5120]: I0316 16:45:57.082645 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4x4g6\" (UniqueName: \"kubernetes.io/projected/dcac8fc1-81ec-4845-b0d0-30e6a05bbb1f-kube-api-access-4x4g6\") pod \"glance-default-external-api-0\" (UID: \"dcac8fc1-81ec-4845-b0d0-30e6a05bbb1f\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:45:57 crc kubenswrapper[5120]: I0316 16:45:57.138562 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/93aa847e-5758-407c-bc62-6e72d895ef76-logs\") pod \"glance-default-internal-api-0\" (UID: \"93aa847e-5758-407c-bc62-6e72d895ef76\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:45:57 crc kubenswrapper[5120]: I0316 16:45:57.138951 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/93aa847e-5758-407c-bc62-6e72d895ef76-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"93aa847e-5758-407c-bc62-6e72d895ef76\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:45:57 crc kubenswrapper[5120]: I0316 16:45:57.139014 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/93aa847e-5758-407c-bc62-6e72d895ef76-scripts\") pod \"glance-default-internal-api-0\" (UID: \"93aa847e-5758-407c-bc62-6e72d895ef76\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:45:57 crc kubenswrapper[5120]: I0316 16:45:57.139081 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"glance-default-internal-api-0\" (UID: \"93aa847e-5758-407c-bc62-6e72d895ef76\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:45:57 crc kubenswrapper[5120]: I0316 16:45:57.139183 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/93aa847e-5758-407c-bc62-6e72d895ef76-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"93aa847e-5758-407c-bc62-6e72d895ef76\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:45:57 crc kubenswrapper[5120]: I0316 16:45:57.139229 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d79dn\" (UniqueName: \"kubernetes.io/projected/93aa847e-5758-407c-bc62-6e72d895ef76-kube-api-access-d79dn\") pod \"glance-default-internal-api-0\" (UID: \"93aa847e-5758-407c-bc62-6e72d895ef76\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:45:57 crc kubenswrapper[5120]: I0316 16:45:57.139262 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/93aa847e-5758-407c-bc62-6e72d895ef76-config-data\") pod \"glance-default-internal-api-0\" (UID: \"93aa847e-5758-407c-bc62-6e72d895ef76\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:45:57 crc kubenswrapper[5120]: I0316 16:45:57.145118 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/93aa847e-5758-407c-bc62-6e72d895ef76-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"93aa847e-5758-407c-bc62-6e72d895ef76\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:45:57 crc kubenswrapper[5120]: I0316 16:45:57.145296 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"glance-default-internal-api-0\" (UID: \"93aa847e-5758-407c-bc62-6e72d895ef76\") device mount path \"/mnt/openstack/pv01\"" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:45:57 crc kubenswrapper[5120]: I0316 16:45:57.145930 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/93aa847e-5758-407c-bc62-6e72d895ef76-logs\") pod \"glance-default-internal-api-0\" (UID: \"93aa847e-5758-407c-bc62-6e72d895ef76\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:45:57 crc kubenswrapper[5120]: I0316 16:45:57.146526 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/93aa847e-5758-407c-bc62-6e72d895ef76-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"93aa847e-5758-407c-bc62-6e72d895ef76\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:45:57 crc kubenswrapper[5120]: I0316 16:45:57.150140 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/93aa847e-5758-407c-bc62-6e72d895ef76-scripts\") pod \"glance-default-internal-api-0\" (UID: \"93aa847e-5758-407c-bc62-6e72d895ef76\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:45:57 crc kubenswrapper[5120]: I0316 16:45:57.151526 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/93aa847e-5758-407c-bc62-6e72d895ef76-config-data\") pod \"glance-default-internal-api-0\" (UID: \"93aa847e-5758-407c-bc62-6e72d895ef76\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:45:57 crc kubenswrapper[5120]: I0316 16:45:57.177307 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d79dn\" (UniqueName: \"kubernetes.io/projected/93aa847e-5758-407c-bc62-6e72d895ef76-kube-api-access-d79dn\") pod \"glance-default-internal-api-0\" (UID: \"93aa847e-5758-407c-bc62-6e72d895ef76\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:45:57 crc kubenswrapper[5120]: I0316 16:45:57.189873 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-hvllz"] Mar 16 16:45:57 crc kubenswrapper[5120]: I0316 16:45:57.200896 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"glance-default-internal-api-0\" (UID: \"93aa847e-5758-407c-bc62-6e72d895ef76\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:45:57 crc kubenswrapper[5120]: I0316 16:45:57.203332 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:45:57 crc kubenswrapper[5120]: I0316 16:45:57.254300 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:45:57 crc kubenswrapper[5120]: I0316 16:45:57.292624 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:45:57 crc kubenswrapper[5120]: I0316 16:45:57.728467 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:45:57 crc kubenswrapper[5120]: W0316 16:45:57.729796 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddcac8fc1_81ec_4845_b0d0_30e6a05bbb1f.slice/crio-6d46565cece99776821560d4674bd0b0e6ed24daf13e58bf543fd0c4cc7ec07e WatchSource:0}: Error finding container 6d46565cece99776821560d4674bd0b0e6ed24daf13e58bf543fd0c4cc7ec07e: Status 404 returned error can't find the container with id 6d46565cece99776821560d4674bd0b0e6ed24daf13e58bf543fd0c4cc7ec07e Mar 16 16:45:57 crc kubenswrapper[5120]: I0316 16:45:57.826409 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:45:57 crc kubenswrapper[5120]: W0316 16:45:57.829069 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod93aa847e_5758_407c_bc62_6e72d895ef76.slice/crio-53a6fefe76ef2562858b31cc6baac672105d40810f926586714923bbf9f58927 WatchSource:0}: Error finding container 53a6fefe76ef2562858b31cc6baac672105d40810f926586714923bbf9f58927: Status 404 returned error can't find the container with id 53a6fefe76ef2562858b31cc6baac672105d40810f926586714923bbf9f58927 Mar 16 16:45:57 crc kubenswrapper[5120]: I0316 16:45:57.849612 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-hvllz" event={"ID":"8b2bc00f-2d60-481e-803d-b4dbd39cdc4e","Type":"ContainerStarted","Data":"f3d77c9fbe50994018fa2c0f804675a9e28cc1a9053d5f233017c151b839b925"} Mar 16 16:45:57 crc kubenswrapper[5120]: I0316 16:45:57.849652 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-hvllz" event={"ID":"8b2bc00f-2d60-481e-803d-b4dbd39cdc4e","Type":"ContainerStarted","Data":"9af6d12b5740d4639feaec0a004614ba0ed4d5dbae646278e3d31dea58882ebf"} Mar 16 16:45:57 crc kubenswrapper[5120]: I0316 16:45:57.851511 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"93aa847e-5758-407c-bc62-6e72d895ef76","Type":"ContainerStarted","Data":"53a6fefe76ef2562858b31cc6baac672105d40810f926586714923bbf9f58927"} Mar 16 16:45:57 crc kubenswrapper[5120]: I0316 16:45:57.854541 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-lmn5g" event={"ID":"35cf2836-2898-4b13-944c-e61b5b4c005b","Type":"ContainerStarted","Data":"0cf4bef158dd114153ad706a5f5a58700444bcb26541c0d6c3f9cb7df814b032"} Mar 16 16:45:57 crc kubenswrapper[5120]: I0316 16:45:57.854571 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-lmn5g" event={"ID":"35cf2836-2898-4b13-944c-e61b5b4c005b","Type":"ContainerStarted","Data":"9232418b9e2304334f625ce65eb96feb94160f64be81b7a23f9a6c25a218281e"} Mar 16 16:45:57 crc kubenswrapper[5120]: I0316 16:45:57.860365 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"dcac8fc1-81ec-4845-b0d0-30e6a05bbb1f","Type":"ContainerStarted","Data":"6d46565cece99776821560d4674bd0b0e6ed24daf13e58bf543fd0c4cc7ec07e"} Mar 16 16:45:57 crc kubenswrapper[5120]: I0316 16:45:57.867819 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-db-sync-hvllz" podStartSLOduration=1.867795031 podStartE2EDuration="1.867795031s" podCreationTimestamp="2026-03-16 16:45:56 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:45:57.863333549 +0000 UTC m=+4460.017265206" watchObservedRunningTime="2026-03-16 16:45:57.867795031 +0000 UTC m=+4460.021726698" Mar 16 16:45:57 crc kubenswrapper[5120]: I0316 16:45:57.873625 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-tkzkl" event={"ID":"dd9bf080-af81-4ff8-a892-50552f0c6be1","Type":"ContainerStarted","Data":"915b5731ab24fdf439082f82008a3e9949a33a942c1c182ba42ff728115d12a9"} Mar 16 16:45:57 crc kubenswrapper[5120]: I0316 16:45:57.873690 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-tkzkl" event={"ID":"dd9bf080-af81-4ff8-a892-50552f0c6be1","Type":"ContainerStarted","Data":"f8c9e1cdfd5b4e2f3fd92d9825dd2249b25ac0610789bcefa9380aff5c7b9646"} Mar 16 16:45:57 crc kubenswrapper[5120]: I0316 16:45:57.877689 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"9259fe9e-b8ac-4419-a121-b51b0b3916e4","Type":"ContainerStarted","Data":"dde480787a6338cfa8c8e6b68dd4be6300087ecbba8f8c64ee6939a269aeb634"} Mar 16 16:45:57 crc kubenswrapper[5120]: I0316 16:45:57.891648 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-db-sync-lmn5g" podStartSLOduration=1.891630229 podStartE2EDuration="1.891630229s" podCreationTimestamp="2026-03-16 16:45:56 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:45:57.884605318 +0000 UTC m=+4460.038536975" watchObservedRunningTime="2026-03-16 16:45:57.891630229 +0000 UTC m=+4460.045561876" Mar 16 16:45:57 crc kubenswrapper[5120]: I0316 16:45:57.935037 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-bootstrap-tkzkl" podStartSLOduration=2.93501687 podStartE2EDuration="2.93501687s" podCreationTimestamp="2026-03-16 16:45:55 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:45:57.908356104 +0000 UTC m=+4460.062287791" watchObservedRunningTime="2026-03-16 16:45:57.93501687 +0000 UTC m=+4460.088948547" Mar 16 16:45:58 crc kubenswrapper[5120]: I0316 16:45:58.368823 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-6xnr6"] Mar 16 16:45:58 crc kubenswrapper[5120]: I0316 16:45:58.382394 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-6xnr6" Mar 16 16:45:58 crc kubenswrapper[5120]: I0316 16:45:58.385685 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-6xnr6"] Mar 16 16:45:58 crc kubenswrapper[5120]: I0316 16:45:58.414078 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-cinder-dockercfg-2mhmf\"" Mar 16 16:45:58 crc kubenswrapper[5120]: I0316 16:45:58.414624 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-config-data\"" Mar 16 16:45:58 crc kubenswrapper[5120]: I0316 16:45:58.415965 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-scripts\"" Mar 16 16:45:58 crc kubenswrapper[5120]: I0316 16:45:58.467052 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6495cc54-9f66-446a-8e99-e2e6b7a95ddc-scripts\") pod \"cinder-db-sync-6xnr6\" (UID: \"6495cc54-9f66-446a-8e99-e2e6b7a95ddc\") " pod="openstack-kuttl-tests/cinder-db-sync-6xnr6" Mar 16 16:45:58 crc kubenswrapper[5120]: I0316 16:45:58.467149 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6495cc54-9f66-446a-8e99-e2e6b7a95ddc-combined-ca-bundle\") pod \"cinder-db-sync-6xnr6\" (UID: \"6495cc54-9f66-446a-8e99-e2e6b7a95ddc\") " pod="openstack-kuttl-tests/cinder-db-sync-6xnr6" Mar 16 16:45:58 crc kubenswrapper[5120]: I0316 16:45:58.467243 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/6495cc54-9f66-446a-8e99-e2e6b7a95ddc-etc-machine-id\") pod \"cinder-db-sync-6xnr6\" (UID: \"6495cc54-9f66-446a-8e99-e2e6b7a95ddc\") " pod="openstack-kuttl-tests/cinder-db-sync-6xnr6" Mar 16 16:45:58 crc kubenswrapper[5120]: I0316 16:45:58.467342 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6495cc54-9f66-446a-8e99-e2e6b7a95ddc-config-data\") pod \"cinder-db-sync-6xnr6\" (UID: \"6495cc54-9f66-446a-8e99-e2e6b7a95ddc\") " pod="openstack-kuttl-tests/cinder-db-sync-6xnr6" Mar 16 16:45:58 crc kubenswrapper[5120]: I0316 16:45:58.467400 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/6495cc54-9f66-446a-8e99-e2e6b7a95ddc-db-sync-config-data\") pod \"cinder-db-sync-6xnr6\" (UID: \"6495cc54-9f66-446a-8e99-e2e6b7a95ddc\") " pod="openstack-kuttl-tests/cinder-db-sync-6xnr6" Mar 16 16:45:58 crc kubenswrapper[5120]: I0316 16:45:58.467445 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klm5v\" (UniqueName: \"kubernetes.io/projected/6495cc54-9f66-446a-8e99-e2e6b7a95ddc-kube-api-access-klm5v\") pod \"cinder-db-sync-6xnr6\" (UID: \"6495cc54-9f66-446a-8e99-e2e6b7a95ddc\") " pod="openstack-kuttl-tests/cinder-db-sync-6xnr6" Mar 16 16:45:58 crc kubenswrapper[5120]: I0316 16:45:58.572631 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6495cc54-9f66-446a-8e99-e2e6b7a95ddc-scripts\") pod \"cinder-db-sync-6xnr6\" (UID: \"6495cc54-9f66-446a-8e99-e2e6b7a95ddc\") " pod="openstack-kuttl-tests/cinder-db-sync-6xnr6" Mar 16 16:45:58 crc kubenswrapper[5120]: I0316 16:45:58.572928 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6495cc54-9f66-446a-8e99-e2e6b7a95ddc-combined-ca-bundle\") pod \"cinder-db-sync-6xnr6\" (UID: \"6495cc54-9f66-446a-8e99-e2e6b7a95ddc\") " pod="openstack-kuttl-tests/cinder-db-sync-6xnr6" Mar 16 16:45:58 crc kubenswrapper[5120]: I0316 16:45:58.572989 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/6495cc54-9f66-446a-8e99-e2e6b7a95ddc-etc-machine-id\") pod \"cinder-db-sync-6xnr6\" (UID: \"6495cc54-9f66-446a-8e99-e2e6b7a95ddc\") " pod="openstack-kuttl-tests/cinder-db-sync-6xnr6" Mar 16 16:45:58 crc kubenswrapper[5120]: I0316 16:45:58.573056 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6495cc54-9f66-446a-8e99-e2e6b7a95ddc-config-data\") pod \"cinder-db-sync-6xnr6\" (UID: \"6495cc54-9f66-446a-8e99-e2e6b7a95ddc\") " pod="openstack-kuttl-tests/cinder-db-sync-6xnr6" Mar 16 16:45:58 crc kubenswrapper[5120]: I0316 16:45:58.573091 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/6495cc54-9f66-446a-8e99-e2e6b7a95ddc-db-sync-config-data\") pod \"cinder-db-sync-6xnr6\" (UID: \"6495cc54-9f66-446a-8e99-e2e6b7a95ddc\") " pod="openstack-kuttl-tests/cinder-db-sync-6xnr6" Mar 16 16:45:58 crc kubenswrapper[5120]: I0316 16:45:58.573121 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-klm5v\" (UniqueName: \"kubernetes.io/projected/6495cc54-9f66-446a-8e99-e2e6b7a95ddc-kube-api-access-klm5v\") pod \"cinder-db-sync-6xnr6\" (UID: \"6495cc54-9f66-446a-8e99-e2e6b7a95ddc\") " pod="openstack-kuttl-tests/cinder-db-sync-6xnr6" Mar 16 16:45:58 crc kubenswrapper[5120]: I0316 16:45:58.573819 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/6495cc54-9f66-446a-8e99-e2e6b7a95ddc-etc-machine-id\") pod \"cinder-db-sync-6xnr6\" (UID: \"6495cc54-9f66-446a-8e99-e2e6b7a95ddc\") " pod="openstack-kuttl-tests/cinder-db-sync-6xnr6" Mar 16 16:45:58 crc kubenswrapper[5120]: I0316 16:45:58.578596 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6495cc54-9f66-446a-8e99-e2e6b7a95ddc-scripts\") pod \"cinder-db-sync-6xnr6\" (UID: \"6495cc54-9f66-446a-8e99-e2e6b7a95ddc\") " pod="openstack-kuttl-tests/cinder-db-sync-6xnr6" Mar 16 16:45:58 crc kubenswrapper[5120]: I0316 16:45:58.578620 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/6495cc54-9f66-446a-8e99-e2e6b7a95ddc-db-sync-config-data\") pod \"cinder-db-sync-6xnr6\" (UID: \"6495cc54-9f66-446a-8e99-e2e6b7a95ddc\") " pod="openstack-kuttl-tests/cinder-db-sync-6xnr6" Mar 16 16:45:58 crc kubenswrapper[5120]: I0316 16:45:58.580292 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6495cc54-9f66-446a-8e99-e2e6b7a95ddc-combined-ca-bundle\") pod \"cinder-db-sync-6xnr6\" (UID: \"6495cc54-9f66-446a-8e99-e2e6b7a95ddc\") " pod="openstack-kuttl-tests/cinder-db-sync-6xnr6" Mar 16 16:45:58 crc kubenswrapper[5120]: I0316 16:45:58.583890 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6495cc54-9f66-446a-8e99-e2e6b7a95ddc-config-data\") pod \"cinder-db-sync-6xnr6\" (UID: \"6495cc54-9f66-446a-8e99-e2e6b7a95ddc\") " pod="openstack-kuttl-tests/cinder-db-sync-6xnr6" Mar 16 16:45:58 crc kubenswrapper[5120]: I0316 16:45:58.610438 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-klm5v\" (UniqueName: \"kubernetes.io/projected/6495cc54-9f66-446a-8e99-e2e6b7a95ddc-kube-api-access-klm5v\") pod \"cinder-db-sync-6xnr6\" (UID: \"6495cc54-9f66-446a-8e99-e2e6b7a95ddc\") " pod="openstack-kuttl-tests/cinder-db-sync-6xnr6" Mar 16 16:45:58 crc kubenswrapper[5120]: I0316 16:45:58.754677 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-6xnr6" Mar 16 16:45:58 crc kubenswrapper[5120]: I0316 16:45:58.760537 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-xw2hd"] Mar 16 16:45:58 crc kubenswrapper[5120]: I0316 16:45:58.767161 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-xw2hd" Mar 16 16:45:58 crc kubenswrapper[5120]: I0316 16:45:58.769223 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-config-data\"" Mar 16 16:45:58 crc kubenswrapper[5120]: I0316 16:45:58.769703 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-barbican-dockercfg-8nrg8\"" Mar 16 16:45:58 crc kubenswrapper[5120]: I0316 16:45:58.782077 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-xw2hd"] Mar 16 16:45:58 crc kubenswrapper[5120]: I0316 16:45:58.910181 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3fca6612-32d4-454a-aec8-3b8d03ef5b29-combined-ca-bundle\") pod \"barbican-db-sync-xw2hd\" (UID: \"3fca6612-32d4-454a-aec8-3b8d03ef5b29\") " pod="openstack-kuttl-tests/barbican-db-sync-xw2hd" Mar 16 16:45:58 crc kubenswrapper[5120]: I0316 16:45:58.910526 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqljr\" (UniqueName: \"kubernetes.io/projected/3fca6612-32d4-454a-aec8-3b8d03ef5b29-kube-api-access-fqljr\") pod \"barbican-db-sync-xw2hd\" (UID: \"3fca6612-32d4-454a-aec8-3b8d03ef5b29\") " pod="openstack-kuttl-tests/barbican-db-sync-xw2hd" Mar 16 16:45:58 crc kubenswrapper[5120]: I0316 16:45:58.910583 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/3fca6612-32d4-454a-aec8-3b8d03ef5b29-db-sync-config-data\") pod \"barbican-db-sync-xw2hd\" (UID: \"3fca6612-32d4-454a-aec8-3b8d03ef5b29\") " pod="openstack-kuttl-tests/barbican-db-sync-xw2hd" Mar 16 16:45:58 crc kubenswrapper[5120]: I0316 16:45:58.923182 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"dcac8fc1-81ec-4845-b0d0-30e6a05bbb1f","Type":"ContainerStarted","Data":"e72148aadfa843c0c3ae1f7c85a9efa5f3ea2f2c0d518aea7817677d69ae155c"} Mar 16 16:45:58 crc kubenswrapper[5120]: I0316 16:45:58.925953 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"9259fe9e-b8ac-4419-a121-b51b0b3916e4","Type":"ContainerStarted","Data":"e58e09571e92dd362e7bb6d4f218a78ec9d72cbc97af4b4a2df448feffc01fd9"} Mar 16 16:45:58 crc kubenswrapper[5120]: I0316 16:45:58.937985 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"93aa847e-5758-407c-bc62-6e72d895ef76","Type":"ContainerStarted","Data":"b99d2425893ee7d0bb78b5ae298044655ddbb8d1c0112a8bd52e375342228cf5"} Mar 16 16:45:59 crc kubenswrapper[5120]: I0316 16:45:59.012907 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3fca6612-32d4-454a-aec8-3b8d03ef5b29-combined-ca-bundle\") pod \"barbican-db-sync-xw2hd\" (UID: \"3fca6612-32d4-454a-aec8-3b8d03ef5b29\") " pod="openstack-kuttl-tests/barbican-db-sync-xw2hd" Mar 16 16:45:59 crc kubenswrapper[5120]: I0316 16:45:59.012974 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fqljr\" (UniqueName: \"kubernetes.io/projected/3fca6612-32d4-454a-aec8-3b8d03ef5b29-kube-api-access-fqljr\") pod \"barbican-db-sync-xw2hd\" (UID: \"3fca6612-32d4-454a-aec8-3b8d03ef5b29\") " pod="openstack-kuttl-tests/barbican-db-sync-xw2hd" Mar 16 16:45:59 crc kubenswrapper[5120]: I0316 16:45:59.013024 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/3fca6612-32d4-454a-aec8-3b8d03ef5b29-db-sync-config-data\") pod \"barbican-db-sync-xw2hd\" (UID: \"3fca6612-32d4-454a-aec8-3b8d03ef5b29\") " pod="openstack-kuttl-tests/barbican-db-sync-xw2hd" Mar 16 16:45:59 crc kubenswrapper[5120]: I0316 16:45:59.018153 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/3fca6612-32d4-454a-aec8-3b8d03ef5b29-db-sync-config-data\") pod \"barbican-db-sync-xw2hd\" (UID: \"3fca6612-32d4-454a-aec8-3b8d03ef5b29\") " pod="openstack-kuttl-tests/barbican-db-sync-xw2hd" Mar 16 16:45:59 crc kubenswrapper[5120]: I0316 16:45:59.020778 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3fca6612-32d4-454a-aec8-3b8d03ef5b29-combined-ca-bundle\") pod \"barbican-db-sync-xw2hd\" (UID: \"3fca6612-32d4-454a-aec8-3b8d03ef5b29\") " pod="openstack-kuttl-tests/barbican-db-sync-xw2hd" Mar 16 16:45:59 crc kubenswrapper[5120]: I0316 16:45:59.034343 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqljr\" (UniqueName: \"kubernetes.io/projected/3fca6612-32d4-454a-aec8-3b8d03ef5b29-kube-api-access-fqljr\") pod \"barbican-db-sync-xw2hd\" (UID: \"3fca6612-32d4-454a-aec8-3b8d03ef5b29\") " pod="openstack-kuttl-tests/barbican-db-sync-xw2hd" Mar 16 16:45:59 crc kubenswrapper[5120]: I0316 16:45:59.150480 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-xw2hd" Mar 16 16:45:59 crc kubenswrapper[5120]: I0316 16:45:59.323050 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-6xnr6"] Mar 16 16:45:59 crc kubenswrapper[5120]: I0316 16:45:59.476038 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-xw2hd"] Mar 16 16:45:59 crc kubenswrapper[5120]: W0316 16:45:59.500470 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3fca6612_32d4_454a_aec8_3b8d03ef5b29.slice/crio-924ed6a0f6595e9f31d68c4fea688d516178d9567ec47ba5c3bbdb3157ceb9c0 WatchSource:0}: Error finding container 924ed6a0f6595e9f31d68c4fea688d516178d9567ec47ba5c3bbdb3157ceb9c0: Status 404 returned error can't find the container with id 924ed6a0f6595e9f31d68c4fea688d516178d9567ec47ba5c3bbdb3157ceb9c0 Mar 16 16:45:59 crc kubenswrapper[5120]: I0316 16:45:59.979746 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"9259fe9e-b8ac-4419-a121-b51b0b3916e4","Type":"ContainerStarted","Data":"41b124cd4bd6e249658c5e31609d126a411aaf2a7bb739d7c0b64c0c0d12b50d"} Mar 16 16:45:59 crc kubenswrapper[5120]: I0316 16:45:59.980187 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"9259fe9e-b8ac-4419-a121-b51b0b3916e4","Type":"ContainerStarted","Data":"9a4f01458ca26dbbbe15024176ef0c7a21cde99cbadf5bd66dfb71f1a4761a24"} Mar 16 16:45:59 crc kubenswrapper[5120]: I0316 16:45:59.985688 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-xw2hd" event={"ID":"3fca6612-32d4-454a-aec8-3b8d03ef5b29","Type":"ContainerStarted","Data":"2a9c5587c8fe02a6f22d38cec648003ce298ea78b8e8e16f3602da1d675de4c6"} Mar 16 16:45:59 crc kubenswrapper[5120]: I0316 16:45:59.985726 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-xw2hd" event={"ID":"3fca6612-32d4-454a-aec8-3b8d03ef5b29","Type":"ContainerStarted","Data":"924ed6a0f6595e9f31d68c4fea688d516178d9567ec47ba5c3bbdb3157ceb9c0"} Mar 16 16:45:59 crc kubenswrapper[5120]: I0316 16:45:59.990482 5120 generic.go:358] "Generic (PLEG): container finished" podID="8b2bc00f-2d60-481e-803d-b4dbd39cdc4e" containerID="f3d77c9fbe50994018fa2c0f804675a9e28cc1a9053d5f233017c151b839b925" exitCode=0 Mar 16 16:45:59 crc kubenswrapper[5120]: I0316 16:45:59.990576 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-hvllz" event={"ID":"8b2bc00f-2d60-481e-803d-b4dbd39cdc4e","Type":"ContainerDied","Data":"f3d77c9fbe50994018fa2c0f804675a9e28cc1a9053d5f233017c151b839b925"} Mar 16 16:46:00 crc kubenswrapper[5120]: I0316 16:45:59.996918 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-6xnr6" event={"ID":"6495cc54-9f66-446a-8e99-e2e6b7a95ddc","Type":"ContainerStarted","Data":"e9ed59b38f0e00b59eb45f32b175a500328df71e2df0b7ae04fe35475a8699c9"} Mar 16 16:46:00 crc kubenswrapper[5120]: I0316 16:46:00.000309 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-db-sync-xw2hd" podStartSLOduration=2.000288842 podStartE2EDuration="2.000288842s" podCreationTimestamp="2026-03-16 16:45:58 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:45:59.998538303 +0000 UTC m=+4462.152469960" watchObservedRunningTime="2026-03-16 16:46:00.000288842 +0000 UTC m=+4462.154220499" Mar 16 16:46:00 crc kubenswrapper[5120]: I0316 16:46:00.007071 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"93aa847e-5758-407c-bc62-6e72d895ef76","Type":"ContainerStarted","Data":"d74da543a4cf1021dca35c2034a9aa8d2f0a9e792a1e589d2be2e140069ab929"} Mar 16 16:46:00 crc kubenswrapper[5120]: I0316 16:46:00.013579 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"dcac8fc1-81ec-4845-b0d0-30e6a05bbb1f","Type":"ContainerStarted","Data":"ed3347ea7d2468f79274a2c70278a17cd2e43c1a264a6e44f4829ce2ebbf4f53"} Mar 16 16:46:00 crc kubenswrapper[5120]: I0316 16:46:00.052667 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-external-api-0" podStartSLOduration=4.052022279 podStartE2EDuration="4.052022279s" podCreationTimestamp="2026-03-16 16:45:56 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:46:00.045742328 +0000 UTC m=+4462.199673995" watchObservedRunningTime="2026-03-16 16:46:00.052022279 +0000 UTC m=+4462.205953936" Mar 16 16:46:00 crc kubenswrapper[5120]: I0316 16:46:00.075537 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-internal-api-0" podStartSLOduration=4.075521317 podStartE2EDuration="4.075521317s" podCreationTimestamp="2026-03-16 16:45:56 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:46:00.074377947 +0000 UTC m=+4462.228309604" watchObservedRunningTime="2026-03-16 16:46:00.075521317 +0000 UTC m=+4462.229452974" Mar 16 16:46:00 crc kubenswrapper[5120]: I0316 16:46:00.152932 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-infra/auto-csr-approver-29561326-gqjgw"] Mar 16 16:46:00 crc kubenswrapper[5120]: I0316 16:46:00.160934 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561326-gqjgw" Mar 16 16:46:00 crc kubenswrapper[5120]: I0316 16:46:00.165434 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561326-gqjgw"] Mar 16 16:46:00 crc kubenswrapper[5120]: I0316 16:46:00.170989 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"openshift-service-ca.crt\"" Mar 16 16:46:00 crc kubenswrapper[5120]: I0316 16:46:00.174169 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-infra\"/\"csr-approver-sa-dockercfg-x2nsz\"" Mar 16 16:46:00 crc kubenswrapper[5120]: I0316 16:46:00.174462 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"kube-root-ca.crt\"" Mar 16 16:46:00 crc kubenswrapper[5120]: I0316 16:46:00.257509 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x289d\" (UniqueName: \"kubernetes.io/projected/e7055eaf-c436-4eb2-9a78-12e452cd331f-kube-api-access-x289d\") pod \"auto-csr-approver-29561326-gqjgw\" (UID: \"e7055eaf-c436-4eb2-9a78-12e452cd331f\") " pod="openshift-infra/auto-csr-approver-29561326-gqjgw" Mar 16 16:46:00 crc kubenswrapper[5120]: I0316 16:46:00.365877 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x289d\" (UniqueName: \"kubernetes.io/projected/e7055eaf-c436-4eb2-9a78-12e452cd331f-kube-api-access-x289d\") pod \"auto-csr-approver-29561326-gqjgw\" (UID: \"e7055eaf-c436-4eb2-9a78-12e452cd331f\") " pod="openshift-infra/auto-csr-approver-29561326-gqjgw" Mar 16 16:46:00 crc kubenswrapper[5120]: I0316 16:46:00.429754 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x289d\" (UniqueName: \"kubernetes.io/projected/e7055eaf-c436-4eb2-9a78-12e452cd331f-kube-api-access-x289d\") pod \"auto-csr-approver-29561326-gqjgw\" (UID: \"e7055eaf-c436-4eb2-9a78-12e452cd331f\") " pod="openshift-infra/auto-csr-approver-29561326-gqjgw" Mar 16 16:46:00 crc kubenswrapper[5120]: I0316 16:46:00.513630 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561326-gqjgw" Mar 16 16:46:01 crc kubenswrapper[5120]: I0316 16:46:01.058989 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561326-gqjgw"] Mar 16 16:46:01 crc kubenswrapper[5120]: W0316 16:46:01.075146 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode7055eaf_c436_4eb2_9a78_12e452cd331f.slice/crio-ebf02f5f92dec53f6d380204c8924afab627f8a11c8e3fb99b815252b344cffc WatchSource:0}: Error finding container ebf02f5f92dec53f6d380204c8924afab627f8a11c8e3fb99b815252b344cffc: Status 404 returned error can't find the container with id ebf02f5f92dec53f6d380204c8924afab627f8a11c8e3fb99b815252b344cffc Mar 16 16:46:01 crc kubenswrapper[5120]: I0316 16:46:01.387314 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-hvllz" Mar 16 16:46:01 crc kubenswrapper[5120]: I0316 16:46:01.497944 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8b2bc00f-2d60-481e-803d-b4dbd39cdc4e-scripts\") pod \"8b2bc00f-2d60-481e-803d-b4dbd39cdc4e\" (UID: \"8b2bc00f-2d60-481e-803d-b4dbd39cdc4e\") " Mar 16 16:46:01 crc kubenswrapper[5120]: I0316 16:46:01.498614 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8b2bc00f-2d60-481e-803d-b4dbd39cdc4e-combined-ca-bundle\") pod \"8b2bc00f-2d60-481e-803d-b4dbd39cdc4e\" (UID: \"8b2bc00f-2d60-481e-803d-b4dbd39cdc4e\") " Mar 16 16:46:01 crc kubenswrapper[5120]: I0316 16:46:01.498676 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8b2bc00f-2d60-481e-803d-b4dbd39cdc4e-logs\") pod \"8b2bc00f-2d60-481e-803d-b4dbd39cdc4e\" (UID: \"8b2bc00f-2d60-481e-803d-b4dbd39cdc4e\") " Mar 16 16:46:01 crc kubenswrapper[5120]: I0316 16:46:01.498702 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-965zx\" (UniqueName: \"kubernetes.io/projected/8b2bc00f-2d60-481e-803d-b4dbd39cdc4e-kube-api-access-965zx\") pod \"8b2bc00f-2d60-481e-803d-b4dbd39cdc4e\" (UID: \"8b2bc00f-2d60-481e-803d-b4dbd39cdc4e\") " Mar 16 16:46:01 crc kubenswrapper[5120]: I0316 16:46:01.498886 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8b2bc00f-2d60-481e-803d-b4dbd39cdc4e-config-data\") pod \"8b2bc00f-2d60-481e-803d-b4dbd39cdc4e\" (UID: \"8b2bc00f-2d60-481e-803d-b4dbd39cdc4e\") " Mar 16 16:46:01 crc kubenswrapper[5120]: I0316 16:46:01.499529 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b2bc00f-2d60-481e-803d-b4dbd39cdc4e-logs" (OuterVolumeSpecName: "logs") pod "8b2bc00f-2d60-481e-803d-b4dbd39cdc4e" (UID: "8b2bc00f-2d60-481e-803d-b4dbd39cdc4e"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:46:01 crc kubenswrapper[5120]: I0316 16:46:01.499953 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8b2bc00f-2d60-481e-803d-b4dbd39cdc4e-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:46:01 crc kubenswrapper[5120]: I0316 16:46:01.511058 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b2bc00f-2d60-481e-803d-b4dbd39cdc4e-kube-api-access-965zx" (OuterVolumeSpecName: "kube-api-access-965zx") pod "8b2bc00f-2d60-481e-803d-b4dbd39cdc4e" (UID: "8b2bc00f-2d60-481e-803d-b4dbd39cdc4e"). InnerVolumeSpecName "kube-api-access-965zx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:46:01 crc kubenswrapper[5120]: I0316 16:46:01.511597 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8b2bc00f-2d60-481e-803d-b4dbd39cdc4e-scripts" (OuterVolumeSpecName: "scripts") pod "8b2bc00f-2d60-481e-803d-b4dbd39cdc4e" (UID: "8b2bc00f-2d60-481e-803d-b4dbd39cdc4e"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:46:01 crc kubenswrapper[5120]: I0316 16:46:01.526989 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8b2bc00f-2d60-481e-803d-b4dbd39cdc4e-config-data" (OuterVolumeSpecName: "config-data") pod "8b2bc00f-2d60-481e-803d-b4dbd39cdc4e" (UID: "8b2bc00f-2d60-481e-803d-b4dbd39cdc4e"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:46:01 crc kubenswrapper[5120]: I0316 16:46:01.533211 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8b2bc00f-2d60-481e-803d-b4dbd39cdc4e-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "8b2bc00f-2d60-481e-803d-b4dbd39cdc4e" (UID: "8b2bc00f-2d60-481e-803d-b4dbd39cdc4e"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:46:01 crc kubenswrapper[5120]: I0316 16:46:01.602216 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8b2bc00f-2d60-481e-803d-b4dbd39cdc4e-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:46:01 crc kubenswrapper[5120]: I0316 16:46:01.602254 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8b2bc00f-2d60-481e-803d-b4dbd39cdc4e-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:46:01 crc kubenswrapper[5120]: I0316 16:46:01.602264 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-965zx\" (UniqueName: \"kubernetes.io/projected/8b2bc00f-2d60-481e-803d-b4dbd39cdc4e-kube-api-access-965zx\") on node \"crc\" DevicePath \"\"" Mar 16 16:46:01 crc kubenswrapper[5120]: I0316 16:46:01.602275 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8b2bc00f-2d60-481e-803d-b4dbd39cdc4e-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:46:02 crc kubenswrapper[5120]: I0316 16:46:02.054340 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-hvllz" Mar 16 16:46:02 crc kubenswrapper[5120]: I0316 16:46:02.054339 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-hvllz" event={"ID":"8b2bc00f-2d60-481e-803d-b4dbd39cdc4e","Type":"ContainerDied","Data":"9af6d12b5740d4639feaec0a004614ba0ed4d5dbae646278e3d31dea58882ebf"} Mar 16 16:46:02 crc kubenswrapper[5120]: I0316 16:46:02.054466 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9af6d12b5740d4639feaec0a004614ba0ed4d5dbae646278e3d31dea58882ebf" Mar 16 16:46:02 crc kubenswrapper[5120]: I0316 16:46:02.079520 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-6xnr6" event={"ID":"6495cc54-9f66-446a-8e99-e2e6b7a95ddc","Type":"ContainerStarted","Data":"765b2fb99593c126008bdd8a3191c1144a0861f214b619c08ceb37602641664b"} Mar 16 16:46:02 crc kubenswrapper[5120]: I0316 16:46:02.088827 5120 generic.go:358] "Generic (PLEG): container finished" podID="dd9bf080-af81-4ff8-a892-50552f0c6be1" containerID="915b5731ab24fdf439082f82008a3e9949a33a942c1c182ba42ff728115d12a9" exitCode=0 Mar 16 16:46:02 crc kubenswrapper[5120]: I0316 16:46:02.089244 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-tkzkl" event={"ID":"dd9bf080-af81-4ff8-a892-50552f0c6be1","Type":"ContainerDied","Data":"915b5731ab24fdf439082f82008a3e9949a33a942c1c182ba42ff728115d12a9"} Mar 16 16:46:02 crc kubenswrapper[5120]: I0316 16:46:02.098119 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561326-gqjgw" event={"ID":"e7055eaf-c436-4eb2-9a78-12e452cd331f","Type":"ContainerStarted","Data":"ebf02f5f92dec53f6d380204c8924afab627f8a11c8e3fb99b815252b344cffc"} Mar 16 16:46:02 crc kubenswrapper[5120]: I0316 16:46:02.135904 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-db-sync-6xnr6" podStartSLOduration=4.135875857 podStartE2EDuration="4.135875857s" podCreationTimestamp="2026-03-16 16:45:58 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:46:02.110097125 +0000 UTC m=+4464.264028792" watchObservedRunningTime="2026-03-16 16:46:02.135875857 +0000 UTC m=+4464.289807514" Mar 16 16:46:02 crc kubenswrapper[5120]: I0316 16:46:02.149895 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-54bf5db978-kpsbr"] Mar 16 16:46:02 crc kubenswrapper[5120]: I0316 16:46:02.151396 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b2bc00f-2d60-481e-803d-b4dbd39cdc4e" containerName="placement-db-sync" Mar 16 16:46:02 crc kubenswrapper[5120]: I0316 16:46:02.151423 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b2bc00f-2d60-481e-803d-b4dbd39cdc4e" containerName="placement-db-sync" Mar 16 16:46:02 crc kubenswrapper[5120]: I0316 16:46:02.151631 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="8b2bc00f-2d60-481e-803d-b4dbd39cdc4e" containerName="placement-db-sync" Mar 16 16:46:02 crc kubenswrapper[5120]: I0316 16:46:02.166539 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-54bf5db978-kpsbr"] Mar 16 16:46:02 crc kubenswrapper[5120]: I0316 16:46:02.166753 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-54bf5db978-kpsbr" Mar 16 16:46:02 crc kubenswrapper[5120]: I0316 16:46:02.170110 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-scripts\"" Mar 16 16:46:02 crc kubenswrapper[5120]: I0316 16:46:02.170407 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-config-data\"" Mar 16 16:46:02 crc kubenswrapper[5120]: I0316 16:46:02.170577 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-placement-dockercfg-rb5jt\"" Mar 16 16:46:02 crc kubenswrapper[5120]: I0316 16:46:02.331373 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/174be312-c22c-4576-a6e8-55fd5408af8d-config-data\") pod \"placement-54bf5db978-kpsbr\" (UID: \"174be312-c22c-4576-a6e8-55fd5408af8d\") " pod="openstack-kuttl-tests/placement-54bf5db978-kpsbr" Mar 16 16:46:02 crc kubenswrapper[5120]: I0316 16:46:02.331864 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/174be312-c22c-4576-a6e8-55fd5408af8d-logs\") pod \"placement-54bf5db978-kpsbr\" (UID: \"174be312-c22c-4576-a6e8-55fd5408af8d\") " pod="openstack-kuttl-tests/placement-54bf5db978-kpsbr" Mar 16 16:46:02 crc kubenswrapper[5120]: I0316 16:46:02.331958 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/174be312-c22c-4576-a6e8-55fd5408af8d-scripts\") pod \"placement-54bf5db978-kpsbr\" (UID: \"174be312-c22c-4576-a6e8-55fd5408af8d\") " pod="openstack-kuttl-tests/placement-54bf5db978-kpsbr" Mar 16 16:46:02 crc kubenswrapper[5120]: I0316 16:46:02.332073 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rc4s6\" (UniqueName: \"kubernetes.io/projected/174be312-c22c-4576-a6e8-55fd5408af8d-kube-api-access-rc4s6\") pod \"placement-54bf5db978-kpsbr\" (UID: \"174be312-c22c-4576-a6e8-55fd5408af8d\") " pod="openstack-kuttl-tests/placement-54bf5db978-kpsbr" Mar 16 16:46:02 crc kubenswrapper[5120]: I0316 16:46:02.332292 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/174be312-c22c-4576-a6e8-55fd5408af8d-combined-ca-bundle\") pod \"placement-54bf5db978-kpsbr\" (UID: \"174be312-c22c-4576-a6e8-55fd5408af8d\") " pod="openstack-kuttl-tests/placement-54bf5db978-kpsbr" Mar 16 16:46:02 crc kubenswrapper[5120]: I0316 16:46:02.434690 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/174be312-c22c-4576-a6e8-55fd5408af8d-config-data\") pod \"placement-54bf5db978-kpsbr\" (UID: \"174be312-c22c-4576-a6e8-55fd5408af8d\") " pod="openstack-kuttl-tests/placement-54bf5db978-kpsbr" Mar 16 16:46:02 crc kubenswrapper[5120]: I0316 16:46:02.434788 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/174be312-c22c-4576-a6e8-55fd5408af8d-logs\") pod \"placement-54bf5db978-kpsbr\" (UID: \"174be312-c22c-4576-a6e8-55fd5408af8d\") " pod="openstack-kuttl-tests/placement-54bf5db978-kpsbr" Mar 16 16:46:02 crc kubenswrapper[5120]: I0316 16:46:02.434824 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/174be312-c22c-4576-a6e8-55fd5408af8d-scripts\") pod \"placement-54bf5db978-kpsbr\" (UID: \"174be312-c22c-4576-a6e8-55fd5408af8d\") " pod="openstack-kuttl-tests/placement-54bf5db978-kpsbr" Mar 16 16:46:02 crc kubenswrapper[5120]: I0316 16:46:02.434906 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rc4s6\" (UniqueName: \"kubernetes.io/projected/174be312-c22c-4576-a6e8-55fd5408af8d-kube-api-access-rc4s6\") pod \"placement-54bf5db978-kpsbr\" (UID: \"174be312-c22c-4576-a6e8-55fd5408af8d\") " pod="openstack-kuttl-tests/placement-54bf5db978-kpsbr" Mar 16 16:46:02 crc kubenswrapper[5120]: I0316 16:46:02.435218 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/174be312-c22c-4576-a6e8-55fd5408af8d-combined-ca-bundle\") pod \"placement-54bf5db978-kpsbr\" (UID: \"174be312-c22c-4576-a6e8-55fd5408af8d\") " pod="openstack-kuttl-tests/placement-54bf5db978-kpsbr" Mar 16 16:46:02 crc kubenswrapper[5120]: I0316 16:46:02.436515 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/174be312-c22c-4576-a6e8-55fd5408af8d-logs\") pod \"placement-54bf5db978-kpsbr\" (UID: \"174be312-c22c-4576-a6e8-55fd5408af8d\") " pod="openstack-kuttl-tests/placement-54bf5db978-kpsbr" Mar 16 16:46:02 crc kubenswrapper[5120]: I0316 16:46:02.439407 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/174be312-c22c-4576-a6e8-55fd5408af8d-config-data\") pod \"placement-54bf5db978-kpsbr\" (UID: \"174be312-c22c-4576-a6e8-55fd5408af8d\") " pod="openstack-kuttl-tests/placement-54bf5db978-kpsbr" Mar 16 16:46:02 crc kubenswrapper[5120]: I0316 16:46:02.443408 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/174be312-c22c-4576-a6e8-55fd5408af8d-scripts\") pod \"placement-54bf5db978-kpsbr\" (UID: \"174be312-c22c-4576-a6e8-55fd5408af8d\") " pod="openstack-kuttl-tests/placement-54bf5db978-kpsbr" Mar 16 16:46:02 crc kubenswrapper[5120]: I0316 16:46:02.446347 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/174be312-c22c-4576-a6e8-55fd5408af8d-combined-ca-bundle\") pod \"placement-54bf5db978-kpsbr\" (UID: \"174be312-c22c-4576-a6e8-55fd5408af8d\") " pod="openstack-kuttl-tests/placement-54bf5db978-kpsbr" Mar 16 16:46:02 crc kubenswrapper[5120]: I0316 16:46:02.464909 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rc4s6\" (UniqueName: \"kubernetes.io/projected/174be312-c22c-4576-a6e8-55fd5408af8d-kube-api-access-rc4s6\") pod \"placement-54bf5db978-kpsbr\" (UID: \"174be312-c22c-4576-a6e8-55fd5408af8d\") " pod="openstack-kuttl-tests/placement-54bf5db978-kpsbr" Mar 16 16:46:02 crc kubenswrapper[5120]: I0316 16:46:02.489859 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-54bf5db978-kpsbr" Mar 16 16:46:02 crc kubenswrapper[5120]: I0316 16:46:02.961608 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-54bf5db978-kpsbr"] Mar 16 16:46:03 crc kubenswrapper[5120]: I0316 16:46:03.113035 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561326-gqjgw" event={"ID":"e7055eaf-c436-4eb2-9a78-12e452cd331f","Type":"ContainerDied","Data":"770161b1964e36563527a816a1285b36148767c3e13625debfcd5d6fee0b59b8"} Mar 16 16:46:03 crc kubenswrapper[5120]: I0316 16:46:03.113743 5120 generic.go:358] "Generic (PLEG): container finished" podID="e7055eaf-c436-4eb2-9a78-12e452cd331f" containerID="770161b1964e36563527a816a1285b36148767c3e13625debfcd5d6fee0b59b8" exitCode=0 Mar 16 16:46:03 crc kubenswrapper[5120]: I0316 16:46:03.123614 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"9259fe9e-b8ac-4419-a121-b51b0b3916e4","Type":"ContainerStarted","Data":"90a00282b842a2cce608b3e9d8bf71cc5604e903a51cde201ce4727099efd55e"} Mar 16 16:46:03 crc kubenswrapper[5120]: I0316 16:46:03.123937 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:46:03 crc kubenswrapper[5120]: I0316 16:46:03.126248 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-54bf5db978-kpsbr" event={"ID":"174be312-c22c-4576-a6e8-55fd5408af8d","Type":"ContainerStarted","Data":"d4564b844cc6f569a50039ac3cdc750e67720fa77fb37d090da2f6037d6a98af"} Mar 16 16:46:03 crc kubenswrapper[5120]: I0316 16:46:03.165716 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.075089139 podStartE2EDuration="7.165692341s" podCreationTimestamp="2026-03-16 16:45:56 +0000 UTC" firstStartedPulling="2026-03-16 16:45:57.277170254 +0000 UTC m=+4459.431101911" lastFinishedPulling="2026-03-16 16:46:02.367773456 +0000 UTC m=+4464.521705113" observedRunningTime="2026-03-16 16:46:03.155597846 +0000 UTC m=+4465.309529503" watchObservedRunningTime="2026-03-16 16:46:03.165692341 +0000 UTC m=+4465.319623998" Mar 16 16:46:03 crc kubenswrapper[5120]: I0316 16:46:03.471743 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-tkzkl" Mar 16 16:46:03 crc kubenswrapper[5120]: I0316 16:46:03.562373 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dd9bf080-af81-4ff8-a892-50552f0c6be1-combined-ca-bundle\") pod \"dd9bf080-af81-4ff8-a892-50552f0c6be1\" (UID: \"dd9bf080-af81-4ff8-a892-50552f0c6be1\") " Mar 16 16:46:03 crc kubenswrapper[5120]: I0316 16:46:03.562440 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/dd9bf080-af81-4ff8-a892-50552f0c6be1-fernet-keys\") pod \"dd9bf080-af81-4ff8-a892-50552f0c6be1\" (UID: \"dd9bf080-af81-4ff8-a892-50552f0c6be1\") " Mar 16 16:46:03 crc kubenswrapper[5120]: I0316 16:46:03.562505 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dd9bf080-af81-4ff8-a892-50552f0c6be1-config-data\") pod \"dd9bf080-af81-4ff8-a892-50552f0c6be1\" (UID: \"dd9bf080-af81-4ff8-a892-50552f0c6be1\") " Mar 16 16:46:03 crc kubenswrapper[5120]: I0316 16:46:03.562708 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wr58s\" (UniqueName: \"kubernetes.io/projected/dd9bf080-af81-4ff8-a892-50552f0c6be1-kube-api-access-wr58s\") pod \"dd9bf080-af81-4ff8-a892-50552f0c6be1\" (UID: \"dd9bf080-af81-4ff8-a892-50552f0c6be1\") " Mar 16 16:46:03 crc kubenswrapper[5120]: I0316 16:46:03.562819 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/dd9bf080-af81-4ff8-a892-50552f0c6be1-credential-keys\") pod \"dd9bf080-af81-4ff8-a892-50552f0c6be1\" (UID: \"dd9bf080-af81-4ff8-a892-50552f0c6be1\") " Mar 16 16:46:03 crc kubenswrapper[5120]: I0316 16:46:03.562845 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/dd9bf080-af81-4ff8-a892-50552f0c6be1-scripts\") pod \"dd9bf080-af81-4ff8-a892-50552f0c6be1\" (UID: \"dd9bf080-af81-4ff8-a892-50552f0c6be1\") " Mar 16 16:46:03 crc kubenswrapper[5120]: I0316 16:46:03.567950 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd9bf080-af81-4ff8-a892-50552f0c6be1-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "dd9bf080-af81-4ff8-a892-50552f0c6be1" (UID: "dd9bf080-af81-4ff8-a892-50552f0c6be1"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:46:03 crc kubenswrapper[5120]: I0316 16:46:03.568268 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd9bf080-af81-4ff8-a892-50552f0c6be1-scripts" (OuterVolumeSpecName: "scripts") pod "dd9bf080-af81-4ff8-a892-50552f0c6be1" (UID: "dd9bf080-af81-4ff8-a892-50552f0c6be1"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:46:03 crc kubenswrapper[5120]: I0316 16:46:03.568491 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd9bf080-af81-4ff8-a892-50552f0c6be1-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "dd9bf080-af81-4ff8-a892-50552f0c6be1" (UID: "dd9bf080-af81-4ff8-a892-50552f0c6be1"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:46:03 crc kubenswrapper[5120]: I0316 16:46:03.569140 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd9bf080-af81-4ff8-a892-50552f0c6be1-kube-api-access-wr58s" (OuterVolumeSpecName: "kube-api-access-wr58s") pod "dd9bf080-af81-4ff8-a892-50552f0c6be1" (UID: "dd9bf080-af81-4ff8-a892-50552f0c6be1"). InnerVolumeSpecName "kube-api-access-wr58s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:46:03 crc kubenswrapper[5120]: I0316 16:46:03.597921 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd9bf080-af81-4ff8-a892-50552f0c6be1-config-data" (OuterVolumeSpecName: "config-data") pod "dd9bf080-af81-4ff8-a892-50552f0c6be1" (UID: "dd9bf080-af81-4ff8-a892-50552f0c6be1"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:46:03 crc kubenswrapper[5120]: I0316 16:46:03.610904 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd9bf080-af81-4ff8-a892-50552f0c6be1-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "dd9bf080-af81-4ff8-a892-50552f0c6be1" (UID: "dd9bf080-af81-4ff8-a892-50552f0c6be1"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:46:03 crc kubenswrapper[5120]: I0316 16:46:03.666415 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dd9bf080-af81-4ff8-a892-50552f0c6be1-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:46:03 crc kubenswrapper[5120]: I0316 16:46:03.666464 5120 reconciler_common.go:299] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/dd9bf080-af81-4ff8-a892-50552f0c6be1-fernet-keys\") on node \"crc\" DevicePath \"\"" Mar 16 16:46:03 crc kubenswrapper[5120]: I0316 16:46:03.666479 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dd9bf080-af81-4ff8-a892-50552f0c6be1-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:46:03 crc kubenswrapper[5120]: I0316 16:46:03.666494 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wr58s\" (UniqueName: \"kubernetes.io/projected/dd9bf080-af81-4ff8-a892-50552f0c6be1-kube-api-access-wr58s\") on node \"crc\" DevicePath \"\"" Mar 16 16:46:03 crc kubenswrapper[5120]: I0316 16:46:03.666509 5120 reconciler_common.go:299] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/dd9bf080-af81-4ff8-a892-50552f0c6be1-credential-keys\") on node \"crc\" DevicePath \"\"" Mar 16 16:46:03 crc kubenswrapper[5120]: I0316 16:46:03.666521 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/dd9bf080-af81-4ff8-a892-50552f0c6be1-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:46:04 crc kubenswrapper[5120]: I0316 16:46:04.171526 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-tkzkl" Mar 16 16:46:04 crc kubenswrapper[5120]: I0316 16:46:04.171564 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-tkzkl" event={"ID":"dd9bf080-af81-4ff8-a892-50552f0c6be1","Type":"ContainerDied","Data":"f8c9e1cdfd5b4e2f3fd92d9825dd2249b25ac0610789bcefa9380aff5c7b9646"} Mar 16 16:46:04 crc kubenswrapper[5120]: I0316 16:46:04.171621 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f8c9e1cdfd5b4e2f3fd92d9825dd2249b25ac0610789bcefa9380aff5c7b9646" Mar 16 16:46:04 crc kubenswrapper[5120]: I0316 16:46:04.176415 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-54bf5db978-kpsbr" event={"ID":"174be312-c22c-4576-a6e8-55fd5408af8d","Type":"ContainerStarted","Data":"09bd7a3d7571c33d89e8f2cd860d4af58e479dd2ab1fb30baa46d267c81c1666"} Mar 16 16:46:04 crc kubenswrapper[5120]: I0316 16:46:04.176476 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-54bf5db978-kpsbr" Mar 16 16:46:04 crc kubenswrapper[5120]: I0316 16:46:04.176491 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-54bf5db978-kpsbr" event={"ID":"174be312-c22c-4576-a6e8-55fd5408af8d","Type":"ContainerStarted","Data":"d6f1a9666b19578cc92b6bea3ba758546bac86273c35edc2b038d02550c541ed"} Mar 16 16:46:04 crc kubenswrapper[5120]: I0316 16:46:04.176505 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-54bf5db978-kpsbr" Mar 16 16:46:04 crc kubenswrapper[5120]: I0316 16:46:04.179795 5120 generic.go:358] "Generic (PLEG): container finished" podID="3fca6612-32d4-454a-aec8-3b8d03ef5b29" containerID="2a9c5587c8fe02a6f22d38cec648003ce298ea78b8e8e16f3602da1d675de4c6" exitCode=0 Mar 16 16:46:04 crc kubenswrapper[5120]: I0316 16:46:04.180045 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-xw2hd" event={"ID":"3fca6612-32d4-454a-aec8-3b8d03ef5b29","Type":"ContainerDied","Data":"2a9c5587c8fe02a6f22d38cec648003ce298ea78b8e8e16f3602da1d675de4c6"} Mar 16 16:46:04 crc kubenswrapper[5120]: I0316 16:46:04.200883 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-54bf5db978-kpsbr" podStartSLOduration=2.200860711 podStartE2EDuration="2.200860711s" podCreationTimestamp="2026-03-16 16:46:02 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:46:04.198690612 +0000 UTC m=+4466.352622269" watchObservedRunningTime="2026-03-16 16:46:04.200860711 +0000 UTC m=+4466.354792368" Mar 16 16:46:04 crc kubenswrapper[5120]: I0316 16:46:04.244971 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-tkzkl"] Mar 16 16:46:04 crc kubenswrapper[5120]: I0316 16:46:04.252514 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-tkzkl"] Mar 16 16:46:04 crc kubenswrapper[5120]: I0316 16:46:04.309345 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-g8bj2"] Mar 16 16:46:04 crc kubenswrapper[5120]: I0316 16:46:04.310857 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd9bf080-af81-4ff8-a892-50552f0c6be1" containerName="keystone-bootstrap" Mar 16 16:46:04 crc kubenswrapper[5120]: I0316 16:46:04.310882 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd9bf080-af81-4ff8-a892-50552f0c6be1" containerName="keystone-bootstrap" Mar 16 16:46:04 crc kubenswrapper[5120]: I0316 16:46:04.313771 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="dd9bf080-af81-4ff8-a892-50552f0c6be1" containerName="keystone-bootstrap" Mar 16 16:46:04 crc kubenswrapper[5120]: I0316 16:46:04.321324 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-g8bj2"] Mar 16 16:46:04 crc kubenswrapper[5120]: I0316 16:46:04.321448 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-g8bj2" Mar 16 16:46:04 crc kubenswrapper[5120]: I0316 16:46:04.327507 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-scripts\"" Mar 16 16:46:04 crc kubenswrapper[5120]: I0316 16:46:04.327694 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"osp-secret\"" Mar 16 16:46:04 crc kubenswrapper[5120]: I0316 16:46:04.327788 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-keystone-dockercfg-xfb6m\"" Mar 16 16:46:04 crc kubenswrapper[5120]: I0316 16:46:04.327994 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone\"" Mar 16 16:46:04 crc kubenswrapper[5120]: I0316 16:46:04.328353 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-config-data\"" Mar 16 16:46:04 crc kubenswrapper[5120]: I0316 16:46:04.381392 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/49473f92-70a6-4bf6-b958-fe5a9e24cbb7-fernet-keys\") pod \"keystone-bootstrap-g8bj2\" (UID: \"49473f92-70a6-4bf6-b958-fe5a9e24cbb7\") " pod="openstack-kuttl-tests/keystone-bootstrap-g8bj2" Mar 16 16:46:04 crc kubenswrapper[5120]: I0316 16:46:04.381474 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/49473f92-70a6-4bf6-b958-fe5a9e24cbb7-scripts\") pod \"keystone-bootstrap-g8bj2\" (UID: \"49473f92-70a6-4bf6-b958-fe5a9e24cbb7\") " pod="openstack-kuttl-tests/keystone-bootstrap-g8bj2" Mar 16 16:46:04 crc kubenswrapper[5120]: I0316 16:46:04.381578 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/49473f92-70a6-4bf6-b958-fe5a9e24cbb7-combined-ca-bundle\") pod \"keystone-bootstrap-g8bj2\" (UID: \"49473f92-70a6-4bf6-b958-fe5a9e24cbb7\") " pod="openstack-kuttl-tests/keystone-bootstrap-g8bj2" Mar 16 16:46:04 crc kubenswrapper[5120]: I0316 16:46:04.381647 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/49473f92-70a6-4bf6-b958-fe5a9e24cbb7-config-data\") pod \"keystone-bootstrap-g8bj2\" (UID: \"49473f92-70a6-4bf6-b958-fe5a9e24cbb7\") " pod="openstack-kuttl-tests/keystone-bootstrap-g8bj2" Mar 16 16:46:04 crc kubenswrapper[5120]: I0316 16:46:04.382040 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/49473f92-70a6-4bf6-b958-fe5a9e24cbb7-credential-keys\") pod \"keystone-bootstrap-g8bj2\" (UID: \"49473f92-70a6-4bf6-b958-fe5a9e24cbb7\") " pod="openstack-kuttl-tests/keystone-bootstrap-g8bj2" Mar 16 16:46:04 crc kubenswrapper[5120]: I0316 16:46:04.382291 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7dp7\" (UniqueName: \"kubernetes.io/projected/49473f92-70a6-4bf6-b958-fe5a9e24cbb7-kube-api-access-k7dp7\") pod \"keystone-bootstrap-g8bj2\" (UID: \"49473f92-70a6-4bf6-b958-fe5a9e24cbb7\") " pod="openstack-kuttl-tests/keystone-bootstrap-g8bj2" Mar 16 16:46:04 crc kubenswrapper[5120]: I0316 16:46:04.484751 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k7dp7\" (UniqueName: \"kubernetes.io/projected/49473f92-70a6-4bf6-b958-fe5a9e24cbb7-kube-api-access-k7dp7\") pod \"keystone-bootstrap-g8bj2\" (UID: \"49473f92-70a6-4bf6-b958-fe5a9e24cbb7\") " pod="openstack-kuttl-tests/keystone-bootstrap-g8bj2" Mar 16 16:46:04 crc kubenswrapper[5120]: I0316 16:46:04.484973 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/49473f92-70a6-4bf6-b958-fe5a9e24cbb7-fernet-keys\") pod \"keystone-bootstrap-g8bj2\" (UID: \"49473f92-70a6-4bf6-b958-fe5a9e24cbb7\") " pod="openstack-kuttl-tests/keystone-bootstrap-g8bj2" Mar 16 16:46:04 crc kubenswrapper[5120]: I0316 16:46:04.485028 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/49473f92-70a6-4bf6-b958-fe5a9e24cbb7-scripts\") pod \"keystone-bootstrap-g8bj2\" (UID: \"49473f92-70a6-4bf6-b958-fe5a9e24cbb7\") " pod="openstack-kuttl-tests/keystone-bootstrap-g8bj2" Mar 16 16:46:04 crc kubenswrapper[5120]: I0316 16:46:04.485091 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/49473f92-70a6-4bf6-b958-fe5a9e24cbb7-combined-ca-bundle\") pod \"keystone-bootstrap-g8bj2\" (UID: \"49473f92-70a6-4bf6-b958-fe5a9e24cbb7\") " pod="openstack-kuttl-tests/keystone-bootstrap-g8bj2" Mar 16 16:46:04 crc kubenswrapper[5120]: I0316 16:46:04.485165 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/49473f92-70a6-4bf6-b958-fe5a9e24cbb7-config-data\") pod \"keystone-bootstrap-g8bj2\" (UID: \"49473f92-70a6-4bf6-b958-fe5a9e24cbb7\") " pod="openstack-kuttl-tests/keystone-bootstrap-g8bj2" Mar 16 16:46:04 crc kubenswrapper[5120]: I0316 16:46:04.485361 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/49473f92-70a6-4bf6-b958-fe5a9e24cbb7-credential-keys\") pod \"keystone-bootstrap-g8bj2\" (UID: \"49473f92-70a6-4bf6-b958-fe5a9e24cbb7\") " pod="openstack-kuttl-tests/keystone-bootstrap-g8bj2" Mar 16 16:46:04 crc kubenswrapper[5120]: I0316 16:46:04.490580 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/49473f92-70a6-4bf6-b958-fe5a9e24cbb7-credential-keys\") pod \"keystone-bootstrap-g8bj2\" (UID: \"49473f92-70a6-4bf6-b958-fe5a9e24cbb7\") " pod="openstack-kuttl-tests/keystone-bootstrap-g8bj2" Mar 16 16:46:04 crc kubenswrapper[5120]: I0316 16:46:04.491431 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/49473f92-70a6-4bf6-b958-fe5a9e24cbb7-combined-ca-bundle\") pod \"keystone-bootstrap-g8bj2\" (UID: \"49473f92-70a6-4bf6-b958-fe5a9e24cbb7\") " pod="openstack-kuttl-tests/keystone-bootstrap-g8bj2" Mar 16 16:46:04 crc kubenswrapper[5120]: I0316 16:46:04.492036 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/49473f92-70a6-4bf6-b958-fe5a9e24cbb7-fernet-keys\") pod \"keystone-bootstrap-g8bj2\" (UID: \"49473f92-70a6-4bf6-b958-fe5a9e24cbb7\") " pod="openstack-kuttl-tests/keystone-bootstrap-g8bj2" Mar 16 16:46:04 crc kubenswrapper[5120]: I0316 16:46:04.492731 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/49473f92-70a6-4bf6-b958-fe5a9e24cbb7-config-data\") pod \"keystone-bootstrap-g8bj2\" (UID: \"49473f92-70a6-4bf6-b958-fe5a9e24cbb7\") " pod="openstack-kuttl-tests/keystone-bootstrap-g8bj2" Mar 16 16:46:04 crc kubenswrapper[5120]: I0316 16:46:04.493674 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/49473f92-70a6-4bf6-b958-fe5a9e24cbb7-scripts\") pod \"keystone-bootstrap-g8bj2\" (UID: \"49473f92-70a6-4bf6-b958-fe5a9e24cbb7\") " pod="openstack-kuttl-tests/keystone-bootstrap-g8bj2" Mar 16 16:46:04 crc kubenswrapper[5120]: I0316 16:46:04.517279 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7dp7\" (UniqueName: \"kubernetes.io/projected/49473f92-70a6-4bf6-b958-fe5a9e24cbb7-kube-api-access-k7dp7\") pod \"keystone-bootstrap-g8bj2\" (UID: \"49473f92-70a6-4bf6-b958-fe5a9e24cbb7\") " pod="openstack-kuttl-tests/keystone-bootstrap-g8bj2" Mar 16 16:46:04 crc kubenswrapper[5120]: I0316 16:46:04.582276 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561326-gqjgw" Mar 16 16:46:04 crc kubenswrapper[5120]: I0316 16:46:04.639448 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-g8bj2" Mar 16 16:46:04 crc kubenswrapper[5120]: I0316 16:46:04.676471 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dd9bf080-af81-4ff8-a892-50552f0c6be1" path="/var/lib/kubelet/pods/dd9bf080-af81-4ff8-a892-50552f0c6be1/volumes" Mar 16 16:46:04 crc kubenswrapper[5120]: I0316 16:46:04.688817 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x289d\" (UniqueName: \"kubernetes.io/projected/e7055eaf-c436-4eb2-9a78-12e452cd331f-kube-api-access-x289d\") pod \"e7055eaf-c436-4eb2-9a78-12e452cd331f\" (UID: \"e7055eaf-c436-4eb2-9a78-12e452cd331f\") " Mar 16 16:46:04 crc kubenswrapper[5120]: I0316 16:46:04.693946 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7055eaf-c436-4eb2-9a78-12e452cd331f-kube-api-access-x289d" (OuterVolumeSpecName: "kube-api-access-x289d") pod "e7055eaf-c436-4eb2-9a78-12e452cd331f" (UID: "e7055eaf-c436-4eb2-9a78-12e452cd331f"). InnerVolumeSpecName "kube-api-access-x289d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:46:04 crc kubenswrapper[5120]: I0316 16:46:04.793064 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x289d\" (UniqueName: \"kubernetes.io/projected/e7055eaf-c436-4eb2-9a78-12e452cd331f-kube-api-access-x289d\") on node \"crc\" DevicePath \"\"" Mar 16 16:46:05 crc kubenswrapper[5120]: I0316 16:46:05.085016 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-g8bj2"] Mar 16 16:46:05 crc kubenswrapper[5120]: I0316 16:46:05.192582 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561326-gqjgw" Mar 16 16:46:05 crc kubenswrapper[5120]: I0316 16:46:05.192595 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561326-gqjgw" event={"ID":"e7055eaf-c436-4eb2-9a78-12e452cd331f","Type":"ContainerDied","Data":"ebf02f5f92dec53f6d380204c8924afab627f8a11c8e3fb99b815252b344cffc"} Mar 16 16:46:05 crc kubenswrapper[5120]: I0316 16:46:05.193865 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ebf02f5f92dec53f6d380204c8924afab627f8a11c8e3fb99b815252b344cffc" Mar 16 16:46:05 crc kubenswrapper[5120]: I0316 16:46:05.196889 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-g8bj2" event={"ID":"49473f92-70a6-4bf6-b958-fe5a9e24cbb7","Type":"ContainerStarted","Data":"2df57007bb09c5d6332ab33d9926209e2d7082415c8365fa72a2ed969da7e5f9"} Mar 16 16:46:05 crc kubenswrapper[5120]: I0316 16:46:05.490586 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-xw2hd" Mar 16 16:46:05 crc kubenswrapper[5120]: I0316 16:46:05.524405 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fqljr\" (UniqueName: \"kubernetes.io/projected/3fca6612-32d4-454a-aec8-3b8d03ef5b29-kube-api-access-fqljr\") pod \"3fca6612-32d4-454a-aec8-3b8d03ef5b29\" (UID: \"3fca6612-32d4-454a-aec8-3b8d03ef5b29\") " Mar 16 16:46:05 crc kubenswrapper[5120]: I0316 16:46:05.524469 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/3fca6612-32d4-454a-aec8-3b8d03ef5b29-db-sync-config-data\") pod \"3fca6612-32d4-454a-aec8-3b8d03ef5b29\" (UID: \"3fca6612-32d4-454a-aec8-3b8d03ef5b29\") " Mar 16 16:46:05 crc kubenswrapper[5120]: I0316 16:46:05.524549 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3fca6612-32d4-454a-aec8-3b8d03ef5b29-combined-ca-bundle\") pod \"3fca6612-32d4-454a-aec8-3b8d03ef5b29\" (UID: \"3fca6612-32d4-454a-aec8-3b8d03ef5b29\") " Mar 16 16:46:05 crc kubenswrapper[5120]: I0316 16:46:05.539022 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3fca6612-32d4-454a-aec8-3b8d03ef5b29-kube-api-access-fqljr" (OuterVolumeSpecName: "kube-api-access-fqljr") pod "3fca6612-32d4-454a-aec8-3b8d03ef5b29" (UID: "3fca6612-32d4-454a-aec8-3b8d03ef5b29"). InnerVolumeSpecName "kube-api-access-fqljr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:46:05 crc kubenswrapper[5120]: I0316 16:46:05.546719 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3fca6612-32d4-454a-aec8-3b8d03ef5b29-db-sync-config-data" (OuterVolumeSpecName: "db-sync-config-data") pod "3fca6612-32d4-454a-aec8-3b8d03ef5b29" (UID: "3fca6612-32d4-454a-aec8-3b8d03ef5b29"). InnerVolumeSpecName "db-sync-config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:46:05 crc kubenswrapper[5120]: I0316 16:46:05.572308 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3fca6612-32d4-454a-aec8-3b8d03ef5b29-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "3fca6612-32d4-454a-aec8-3b8d03ef5b29" (UID: "3fca6612-32d4-454a-aec8-3b8d03ef5b29"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:46:05 crc kubenswrapper[5120]: I0316 16:46:05.627850 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3fca6612-32d4-454a-aec8-3b8d03ef5b29-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:46:05 crc kubenswrapper[5120]: I0316 16:46:05.627889 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fqljr\" (UniqueName: \"kubernetes.io/projected/3fca6612-32d4-454a-aec8-3b8d03ef5b29-kube-api-access-fqljr\") on node \"crc\" DevicePath \"\"" Mar 16 16:46:05 crc kubenswrapper[5120]: I0316 16:46:05.627901 5120 reconciler_common.go:299] "Volume detached for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/3fca6612-32d4-454a-aec8-3b8d03ef5b29-db-sync-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:46:05 crc kubenswrapper[5120]: I0316 16:46:05.645525 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-infra/auto-csr-approver-29561320-krs6p"] Mar 16 16:46:05 crc kubenswrapper[5120]: I0316 16:46:05.653791 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-infra/auto-csr-approver-29561320-krs6p"] Mar 16 16:46:06 crc kubenswrapper[5120]: I0316 16:46:06.216197 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-g8bj2" event={"ID":"49473f92-70a6-4bf6-b958-fe5a9e24cbb7","Type":"ContainerStarted","Data":"b19b1f7b89a52c3fd792809f8a1745634a6cda441d9b359b08e17e40288842ce"} Mar 16 16:46:06 crc kubenswrapper[5120]: I0316 16:46:06.236057 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-xw2hd" Mar 16 16:46:06 crc kubenswrapper[5120]: I0316 16:46:06.236007 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-xw2hd" event={"ID":"3fca6612-32d4-454a-aec8-3b8d03ef5b29","Type":"ContainerDied","Data":"924ed6a0f6595e9f31d68c4fea688d516178d9567ec47ba5c3bbdb3157ceb9c0"} Mar 16 16:46:06 crc kubenswrapper[5120]: I0316 16:46:06.236549 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="924ed6a0f6595e9f31d68c4fea688d516178d9567ec47ba5c3bbdb3157ceb9c0" Mar 16 16:46:06 crc kubenswrapper[5120]: I0316 16:46:06.259958 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-bootstrap-g8bj2" podStartSLOduration=2.259938564 podStartE2EDuration="2.259938564s" podCreationTimestamp="2026-03-16 16:46:04 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:46:06.249309705 +0000 UTC m=+4468.403241362" watchObservedRunningTime="2026-03-16 16:46:06.259938564 +0000 UTC m=+4468.413870221" Mar 16 16:46:06 crc kubenswrapper[5120]: I0316 16:46:06.399177 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-worker-954498cf-phl8v"] Mar 16 16:46:06 crc kubenswrapper[5120]: I0316 16:46:06.400177 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fca6612-32d4-454a-aec8-3b8d03ef5b29" containerName="barbican-db-sync" Mar 16 16:46:06 crc kubenswrapper[5120]: I0316 16:46:06.400197 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fca6612-32d4-454a-aec8-3b8d03ef5b29" containerName="barbican-db-sync" Mar 16 16:46:06 crc kubenswrapper[5120]: I0316 16:46:06.400280 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7055eaf-c436-4eb2-9a78-12e452cd331f" containerName="oc" Mar 16 16:46:06 crc kubenswrapper[5120]: I0316 16:46:06.400289 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7055eaf-c436-4eb2-9a78-12e452cd331f" containerName="oc" Mar 16 16:46:06 crc kubenswrapper[5120]: I0316 16:46:06.400451 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e7055eaf-c436-4eb2-9a78-12e452cd331f" containerName="oc" Mar 16 16:46:06 crc kubenswrapper[5120]: I0316 16:46:06.400475 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="3fca6612-32d4-454a-aec8-3b8d03ef5b29" containerName="barbican-db-sync" Mar 16 16:46:06 crc kubenswrapper[5120]: I0316 16:46:06.405960 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-954498cf-phl8v" Mar 16 16:46:06 crc kubenswrapper[5120]: I0316 16:46:06.414337 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-worker-config-data\"" Mar 16 16:46:06 crc kubenswrapper[5120]: I0316 16:46:06.414939 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-config-data\"" Mar 16 16:46:06 crc kubenswrapper[5120]: I0316 16:46:06.415230 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-barbican-dockercfg-8nrg8\"" Mar 16 16:46:06 crc kubenswrapper[5120]: I0316 16:46:06.441131 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-954498cf-phl8v"] Mar 16 16:46:06 crc kubenswrapper[5120]: I0316 16:46:06.448583 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2cb227a9-f8ad-4f55-a381-42bcaa8d0e6d-config-data\") pod \"barbican-worker-954498cf-phl8v\" (UID: \"2cb227a9-f8ad-4f55-a381-42bcaa8d0e6d\") " pod="openstack-kuttl-tests/barbican-worker-954498cf-phl8v" Mar 16 16:46:06 crc kubenswrapper[5120]: I0316 16:46:06.448651 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jthmg\" (UniqueName: \"kubernetes.io/projected/2cb227a9-f8ad-4f55-a381-42bcaa8d0e6d-kube-api-access-jthmg\") pod \"barbican-worker-954498cf-phl8v\" (UID: \"2cb227a9-f8ad-4f55-a381-42bcaa8d0e6d\") " pod="openstack-kuttl-tests/barbican-worker-954498cf-phl8v" Mar 16 16:46:06 crc kubenswrapper[5120]: I0316 16:46:06.448682 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2cb227a9-f8ad-4f55-a381-42bcaa8d0e6d-logs\") pod \"barbican-worker-954498cf-phl8v\" (UID: \"2cb227a9-f8ad-4f55-a381-42bcaa8d0e6d\") " pod="openstack-kuttl-tests/barbican-worker-954498cf-phl8v" Mar 16 16:46:06 crc kubenswrapper[5120]: I0316 16:46:06.448846 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/2cb227a9-f8ad-4f55-a381-42bcaa8d0e6d-config-data-custom\") pod \"barbican-worker-954498cf-phl8v\" (UID: \"2cb227a9-f8ad-4f55-a381-42bcaa8d0e6d\") " pod="openstack-kuttl-tests/barbican-worker-954498cf-phl8v" Mar 16 16:46:06 crc kubenswrapper[5120]: I0316 16:46:06.449050 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2cb227a9-f8ad-4f55-a381-42bcaa8d0e6d-combined-ca-bundle\") pod \"barbican-worker-954498cf-phl8v\" (UID: \"2cb227a9-f8ad-4f55-a381-42bcaa8d0e6d\") " pod="openstack-kuttl-tests/barbican-worker-954498cf-phl8v" Mar 16 16:46:06 crc kubenswrapper[5120]: I0316 16:46:06.466374 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-5557b6754b-qz56v"] Mar 16 16:46:06 crc kubenswrapper[5120]: I0316 16:46:06.472404 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-5557b6754b-qz56v" Mar 16 16:46:06 crc kubenswrapper[5120]: I0316 16:46:06.475389 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-keystone-listener-config-data\"" Mar 16 16:46:06 crc kubenswrapper[5120]: I0316 16:46:06.507658 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-5557b6754b-qz56v"] Mar 16 16:46:06 crc kubenswrapper[5120]: I0316 16:46:06.551462 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2cb227a9-f8ad-4f55-a381-42bcaa8d0e6d-config-data\") pod \"barbican-worker-954498cf-phl8v\" (UID: \"2cb227a9-f8ad-4f55-a381-42bcaa8d0e6d\") " pod="openstack-kuttl-tests/barbican-worker-954498cf-phl8v" Mar 16 16:46:06 crc kubenswrapper[5120]: I0316 16:46:06.551512 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jthmg\" (UniqueName: \"kubernetes.io/projected/2cb227a9-f8ad-4f55-a381-42bcaa8d0e6d-kube-api-access-jthmg\") pod \"barbican-worker-954498cf-phl8v\" (UID: \"2cb227a9-f8ad-4f55-a381-42bcaa8d0e6d\") " pod="openstack-kuttl-tests/barbican-worker-954498cf-phl8v" Mar 16 16:46:06 crc kubenswrapper[5120]: I0316 16:46:06.551536 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2cb227a9-f8ad-4f55-a381-42bcaa8d0e6d-logs\") pod \"barbican-worker-954498cf-phl8v\" (UID: \"2cb227a9-f8ad-4f55-a381-42bcaa8d0e6d\") " pod="openstack-kuttl-tests/barbican-worker-954498cf-phl8v" Mar 16 16:46:06 crc kubenswrapper[5120]: I0316 16:46:06.551577 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/212dc541-58a2-45d9-97bf-c566530e09da-combined-ca-bundle\") pod \"barbican-keystone-listener-5557b6754b-qz56v\" (UID: \"212dc541-58a2-45d9-97bf-c566530e09da\") " pod="openstack-kuttl-tests/barbican-keystone-listener-5557b6754b-qz56v" Mar 16 16:46:06 crc kubenswrapper[5120]: I0316 16:46:06.551612 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sddgz\" (UniqueName: \"kubernetes.io/projected/212dc541-58a2-45d9-97bf-c566530e09da-kube-api-access-sddgz\") pod \"barbican-keystone-listener-5557b6754b-qz56v\" (UID: \"212dc541-58a2-45d9-97bf-c566530e09da\") " pod="openstack-kuttl-tests/barbican-keystone-listener-5557b6754b-qz56v" Mar 16 16:46:06 crc kubenswrapper[5120]: I0316 16:46:06.551646 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/2cb227a9-f8ad-4f55-a381-42bcaa8d0e6d-config-data-custom\") pod \"barbican-worker-954498cf-phl8v\" (UID: \"2cb227a9-f8ad-4f55-a381-42bcaa8d0e6d\") " pod="openstack-kuttl-tests/barbican-worker-954498cf-phl8v" Mar 16 16:46:06 crc kubenswrapper[5120]: I0316 16:46:06.551675 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/212dc541-58a2-45d9-97bf-c566530e09da-logs\") pod \"barbican-keystone-listener-5557b6754b-qz56v\" (UID: \"212dc541-58a2-45d9-97bf-c566530e09da\") " pod="openstack-kuttl-tests/barbican-keystone-listener-5557b6754b-qz56v" Mar 16 16:46:06 crc kubenswrapper[5120]: I0316 16:46:06.551784 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/212dc541-58a2-45d9-97bf-c566530e09da-config-data\") pod \"barbican-keystone-listener-5557b6754b-qz56v\" (UID: \"212dc541-58a2-45d9-97bf-c566530e09da\") " pod="openstack-kuttl-tests/barbican-keystone-listener-5557b6754b-qz56v" Mar 16 16:46:06 crc kubenswrapper[5120]: I0316 16:46:06.551830 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2cb227a9-f8ad-4f55-a381-42bcaa8d0e6d-combined-ca-bundle\") pod \"barbican-worker-954498cf-phl8v\" (UID: \"2cb227a9-f8ad-4f55-a381-42bcaa8d0e6d\") " pod="openstack-kuttl-tests/barbican-worker-954498cf-phl8v" Mar 16 16:46:06 crc kubenswrapper[5120]: I0316 16:46:06.551909 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/212dc541-58a2-45d9-97bf-c566530e09da-config-data-custom\") pod \"barbican-keystone-listener-5557b6754b-qz56v\" (UID: \"212dc541-58a2-45d9-97bf-c566530e09da\") " pod="openstack-kuttl-tests/barbican-keystone-listener-5557b6754b-qz56v" Mar 16 16:46:06 crc kubenswrapper[5120]: I0316 16:46:06.553817 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2cb227a9-f8ad-4f55-a381-42bcaa8d0e6d-logs\") pod \"barbican-worker-954498cf-phl8v\" (UID: \"2cb227a9-f8ad-4f55-a381-42bcaa8d0e6d\") " pod="openstack-kuttl-tests/barbican-worker-954498cf-phl8v" Mar 16 16:46:06 crc kubenswrapper[5120]: I0316 16:46:06.571177 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2cb227a9-f8ad-4f55-a381-42bcaa8d0e6d-config-data\") pod \"barbican-worker-954498cf-phl8v\" (UID: \"2cb227a9-f8ad-4f55-a381-42bcaa8d0e6d\") " pod="openstack-kuttl-tests/barbican-worker-954498cf-phl8v" Mar 16 16:46:06 crc kubenswrapper[5120]: I0316 16:46:06.573728 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/2cb227a9-f8ad-4f55-a381-42bcaa8d0e6d-config-data-custom\") pod \"barbican-worker-954498cf-phl8v\" (UID: \"2cb227a9-f8ad-4f55-a381-42bcaa8d0e6d\") " pod="openstack-kuttl-tests/barbican-worker-954498cf-phl8v" Mar 16 16:46:06 crc kubenswrapper[5120]: I0316 16:46:06.580748 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2cb227a9-f8ad-4f55-a381-42bcaa8d0e6d-combined-ca-bundle\") pod \"barbican-worker-954498cf-phl8v\" (UID: \"2cb227a9-f8ad-4f55-a381-42bcaa8d0e6d\") " pod="openstack-kuttl-tests/barbican-worker-954498cf-phl8v" Mar 16 16:46:06 crc kubenswrapper[5120]: I0316 16:46:06.589706 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jthmg\" (UniqueName: \"kubernetes.io/projected/2cb227a9-f8ad-4f55-a381-42bcaa8d0e6d-kube-api-access-jthmg\") pod \"barbican-worker-954498cf-phl8v\" (UID: \"2cb227a9-f8ad-4f55-a381-42bcaa8d0e6d\") " pod="openstack-kuttl-tests/barbican-worker-954498cf-phl8v" Mar 16 16:46:06 crc kubenswrapper[5120]: I0316 16:46:06.630606 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-api-6bfffc7f7b-nsf4t"] Mar 16 16:46:06 crc kubenswrapper[5120]: I0316 16:46:06.654962 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-6bfffc7f7b-nsf4t" Mar 16 16:46:06 crc kubenswrapper[5120]: I0316 16:46:06.657362 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/212dc541-58a2-45d9-97bf-c566530e09da-logs\") pod \"barbican-keystone-listener-5557b6754b-qz56v\" (UID: \"212dc541-58a2-45d9-97bf-c566530e09da\") " pod="openstack-kuttl-tests/barbican-keystone-listener-5557b6754b-qz56v" Mar 16 16:46:06 crc kubenswrapper[5120]: I0316 16:46:06.657469 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/212dc541-58a2-45d9-97bf-c566530e09da-config-data\") pod \"barbican-keystone-listener-5557b6754b-qz56v\" (UID: \"212dc541-58a2-45d9-97bf-c566530e09da\") " pod="openstack-kuttl-tests/barbican-keystone-listener-5557b6754b-qz56v" Mar 16 16:46:06 crc kubenswrapper[5120]: I0316 16:46:06.657568 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/212dc541-58a2-45d9-97bf-c566530e09da-config-data-custom\") pod \"barbican-keystone-listener-5557b6754b-qz56v\" (UID: \"212dc541-58a2-45d9-97bf-c566530e09da\") " pod="openstack-kuttl-tests/barbican-keystone-listener-5557b6754b-qz56v" Mar 16 16:46:06 crc kubenswrapper[5120]: I0316 16:46:06.657686 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/212dc541-58a2-45d9-97bf-c566530e09da-combined-ca-bundle\") pod \"barbican-keystone-listener-5557b6754b-qz56v\" (UID: \"212dc541-58a2-45d9-97bf-c566530e09da\") " pod="openstack-kuttl-tests/barbican-keystone-listener-5557b6754b-qz56v" Mar 16 16:46:06 crc kubenswrapper[5120]: I0316 16:46:06.657718 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sddgz\" (UniqueName: \"kubernetes.io/projected/212dc541-58a2-45d9-97bf-c566530e09da-kube-api-access-sddgz\") pod \"barbican-keystone-listener-5557b6754b-qz56v\" (UID: \"212dc541-58a2-45d9-97bf-c566530e09da\") " pod="openstack-kuttl-tests/barbican-keystone-listener-5557b6754b-qz56v" Mar 16 16:46:06 crc kubenswrapper[5120]: I0316 16:46:06.658286 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/212dc541-58a2-45d9-97bf-c566530e09da-logs\") pod \"barbican-keystone-listener-5557b6754b-qz56v\" (UID: \"212dc541-58a2-45d9-97bf-c566530e09da\") " pod="openstack-kuttl-tests/barbican-keystone-listener-5557b6754b-qz56v" Mar 16 16:46:06 crc kubenswrapper[5120]: I0316 16:46:06.663091 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-api-config-data\"" Mar 16 16:46:06 crc kubenswrapper[5120]: I0316 16:46:06.665960 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/212dc541-58a2-45d9-97bf-c566530e09da-config-data\") pod \"barbican-keystone-listener-5557b6754b-qz56v\" (UID: \"212dc541-58a2-45d9-97bf-c566530e09da\") " pod="openstack-kuttl-tests/barbican-keystone-listener-5557b6754b-qz56v" Mar 16 16:46:06 crc kubenswrapper[5120]: I0316 16:46:06.681455 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/212dc541-58a2-45d9-97bf-c566530e09da-config-data-custom\") pod \"barbican-keystone-listener-5557b6754b-qz56v\" (UID: \"212dc541-58a2-45d9-97bf-c566530e09da\") " pod="openstack-kuttl-tests/barbican-keystone-listener-5557b6754b-qz56v" Mar 16 16:46:06 crc kubenswrapper[5120]: I0316 16:46:06.681519 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sddgz\" (UniqueName: \"kubernetes.io/projected/212dc541-58a2-45d9-97bf-c566530e09da-kube-api-access-sddgz\") pod \"barbican-keystone-listener-5557b6754b-qz56v\" (UID: \"212dc541-58a2-45d9-97bf-c566530e09da\") " pod="openstack-kuttl-tests/barbican-keystone-listener-5557b6754b-qz56v" Mar 16 16:46:06 crc kubenswrapper[5120]: I0316 16:46:06.681583 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/212dc541-58a2-45d9-97bf-c566530e09da-combined-ca-bundle\") pod \"barbican-keystone-listener-5557b6754b-qz56v\" (UID: \"212dc541-58a2-45d9-97bf-c566530e09da\") " pod="openstack-kuttl-tests/barbican-keystone-listener-5557b6754b-qz56v" Mar 16 16:46:06 crc kubenswrapper[5120]: I0316 16:46:06.692872 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="923b199c-e73a-49ce-b4b7-cf219cc0fc76" path="/var/lib/kubelet/pods/923b199c-e73a-49ce-b4b7-cf219cc0fc76/volumes" Mar 16 16:46:06 crc kubenswrapper[5120]: I0316 16:46:06.696232 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-6bfffc7f7b-nsf4t"] Mar 16 16:46:06 crc kubenswrapper[5120]: I0316 16:46:06.751301 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-954498cf-phl8v" Mar 16 16:46:06 crc kubenswrapper[5120]: I0316 16:46:06.759200 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/60e2f357-0615-41a0-96bd-915aacafdfe5-logs\") pod \"barbican-api-6bfffc7f7b-nsf4t\" (UID: \"60e2f357-0615-41a0-96bd-915aacafdfe5\") " pod="openstack-kuttl-tests/barbican-api-6bfffc7f7b-nsf4t" Mar 16 16:46:06 crc kubenswrapper[5120]: I0316 16:46:06.759299 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/60e2f357-0615-41a0-96bd-915aacafdfe5-config-data-custom\") pod \"barbican-api-6bfffc7f7b-nsf4t\" (UID: \"60e2f357-0615-41a0-96bd-915aacafdfe5\") " pod="openstack-kuttl-tests/barbican-api-6bfffc7f7b-nsf4t" Mar 16 16:46:06 crc kubenswrapper[5120]: I0316 16:46:06.759382 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2djr\" (UniqueName: \"kubernetes.io/projected/60e2f357-0615-41a0-96bd-915aacafdfe5-kube-api-access-m2djr\") pod \"barbican-api-6bfffc7f7b-nsf4t\" (UID: \"60e2f357-0615-41a0-96bd-915aacafdfe5\") " pod="openstack-kuttl-tests/barbican-api-6bfffc7f7b-nsf4t" Mar 16 16:46:06 crc kubenswrapper[5120]: I0316 16:46:06.759405 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/60e2f357-0615-41a0-96bd-915aacafdfe5-config-data\") pod \"barbican-api-6bfffc7f7b-nsf4t\" (UID: \"60e2f357-0615-41a0-96bd-915aacafdfe5\") " pod="openstack-kuttl-tests/barbican-api-6bfffc7f7b-nsf4t" Mar 16 16:46:06 crc kubenswrapper[5120]: I0316 16:46:06.759603 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/60e2f357-0615-41a0-96bd-915aacafdfe5-combined-ca-bundle\") pod \"barbican-api-6bfffc7f7b-nsf4t\" (UID: \"60e2f357-0615-41a0-96bd-915aacafdfe5\") " pod="openstack-kuttl-tests/barbican-api-6bfffc7f7b-nsf4t" Mar 16 16:46:06 crc kubenswrapper[5120]: I0316 16:46:06.811079 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-5557b6754b-qz56v" Mar 16 16:46:06 crc kubenswrapper[5120]: I0316 16:46:06.861001 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/60e2f357-0615-41a0-96bd-915aacafdfe5-combined-ca-bundle\") pod \"barbican-api-6bfffc7f7b-nsf4t\" (UID: \"60e2f357-0615-41a0-96bd-915aacafdfe5\") " pod="openstack-kuttl-tests/barbican-api-6bfffc7f7b-nsf4t" Mar 16 16:46:06 crc kubenswrapper[5120]: I0316 16:46:06.861171 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/60e2f357-0615-41a0-96bd-915aacafdfe5-logs\") pod \"barbican-api-6bfffc7f7b-nsf4t\" (UID: \"60e2f357-0615-41a0-96bd-915aacafdfe5\") " pod="openstack-kuttl-tests/barbican-api-6bfffc7f7b-nsf4t" Mar 16 16:46:06 crc kubenswrapper[5120]: I0316 16:46:06.861219 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/60e2f357-0615-41a0-96bd-915aacafdfe5-config-data-custom\") pod \"barbican-api-6bfffc7f7b-nsf4t\" (UID: \"60e2f357-0615-41a0-96bd-915aacafdfe5\") " pod="openstack-kuttl-tests/barbican-api-6bfffc7f7b-nsf4t" Mar 16 16:46:06 crc kubenswrapper[5120]: I0316 16:46:06.861274 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m2djr\" (UniqueName: \"kubernetes.io/projected/60e2f357-0615-41a0-96bd-915aacafdfe5-kube-api-access-m2djr\") pod \"barbican-api-6bfffc7f7b-nsf4t\" (UID: \"60e2f357-0615-41a0-96bd-915aacafdfe5\") " pod="openstack-kuttl-tests/barbican-api-6bfffc7f7b-nsf4t" Mar 16 16:46:06 crc kubenswrapper[5120]: I0316 16:46:06.861293 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/60e2f357-0615-41a0-96bd-915aacafdfe5-config-data\") pod \"barbican-api-6bfffc7f7b-nsf4t\" (UID: \"60e2f357-0615-41a0-96bd-915aacafdfe5\") " pod="openstack-kuttl-tests/barbican-api-6bfffc7f7b-nsf4t" Mar 16 16:46:06 crc kubenswrapper[5120]: I0316 16:46:06.861921 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/60e2f357-0615-41a0-96bd-915aacafdfe5-logs\") pod \"barbican-api-6bfffc7f7b-nsf4t\" (UID: \"60e2f357-0615-41a0-96bd-915aacafdfe5\") " pod="openstack-kuttl-tests/barbican-api-6bfffc7f7b-nsf4t" Mar 16 16:46:06 crc kubenswrapper[5120]: I0316 16:46:06.868853 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/60e2f357-0615-41a0-96bd-915aacafdfe5-combined-ca-bundle\") pod \"barbican-api-6bfffc7f7b-nsf4t\" (UID: \"60e2f357-0615-41a0-96bd-915aacafdfe5\") " pod="openstack-kuttl-tests/barbican-api-6bfffc7f7b-nsf4t" Mar 16 16:46:06 crc kubenswrapper[5120]: I0316 16:46:06.868920 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/60e2f357-0615-41a0-96bd-915aacafdfe5-config-data-custom\") pod \"barbican-api-6bfffc7f7b-nsf4t\" (UID: \"60e2f357-0615-41a0-96bd-915aacafdfe5\") " pod="openstack-kuttl-tests/barbican-api-6bfffc7f7b-nsf4t" Mar 16 16:46:06 crc kubenswrapper[5120]: I0316 16:46:06.871435 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/60e2f357-0615-41a0-96bd-915aacafdfe5-config-data\") pod \"barbican-api-6bfffc7f7b-nsf4t\" (UID: \"60e2f357-0615-41a0-96bd-915aacafdfe5\") " pod="openstack-kuttl-tests/barbican-api-6bfffc7f7b-nsf4t" Mar 16 16:46:06 crc kubenswrapper[5120]: I0316 16:46:06.894450 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2djr\" (UniqueName: \"kubernetes.io/projected/60e2f357-0615-41a0-96bd-915aacafdfe5-kube-api-access-m2djr\") pod \"barbican-api-6bfffc7f7b-nsf4t\" (UID: \"60e2f357-0615-41a0-96bd-915aacafdfe5\") " pod="openstack-kuttl-tests/barbican-api-6bfffc7f7b-nsf4t" Mar 16 16:46:07 crc kubenswrapper[5120]: I0316 16:46:07.075573 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-6bfffc7f7b-nsf4t" Mar 16 16:46:07 crc kubenswrapper[5120]: I0316 16:46:07.205317 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:46:07 crc kubenswrapper[5120]: I0316 16:46:07.205893 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:46:07 crc kubenswrapper[5120]: I0316 16:46:07.292992 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:46:07 crc kubenswrapper[5120]: I0316 16:46:07.295337 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:46:07 crc kubenswrapper[5120]: I0316 16:46:07.297420 5120 generic.go:358] "Generic (PLEG): container finished" podID="6495cc54-9f66-446a-8e99-e2e6b7a95ddc" containerID="765b2fb99593c126008bdd8a3191c1144a0861f214b619c08ceb37602641664b" exitCode=0 Mar 16 16:46:07 crc kubenswrapper[5120]: I0316 16:46:07.297612 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-6xnr6" event={"ID":"6495cc54-9f66-446a-8e99-e2e6b7a95ddc","Type":"ContainerDied","Data":"765b2fb99593c126008bdd8a3191c1144a0861f214b619c08ceb37602641664b"} Mar 16 16:46:07 crc kubenswrapper[5120]: I0316 16:46:07.327389 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:46:07 crc kubenswrapper[5120]: I0316 16:46:07.332520 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-954498cf-phl8v"] Mar 16 16:46:07 crc kubenswrapper[5120]: I0316 16:46:07.352477 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:46:07 crc kubenswrapper[5120]: I0316 16:46:07.352740 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:46:07 crc kubenswrapper[5120]: I0316 16:46:07.358019 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:46:07 crc kubenswrapper[5120]: I0316 16:46:07.593099 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-5557b6754b-qz56v"] Mar 16 16:46:07 crc kubenswrapper[5120]: W0316 16:46:07.595728 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod212dc541_58a2_45d9_97bf_c566530e09da.slice/crio-70b990c3026dbb904d0e75574885e41f7a85f0f23bfc3d8e589c4f0b53db5ef8 WatchSource:0}: Error finding container 70b990c3026dbb904d0e75574885e41f7a85f0f23bfc3d8e589c4f0b53db5ef8: Status 404 returned error can't find the container with id 70b990c3026dbb904d0e75574885e41f7a85f0f23bfc3d8e589c4f0b53db5ef8 Mar 16 16:46:07 crc kubenswrapper[5120]: I0316 16:46:07.716436 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-6bfffc7f7b-nsf4t"] Mar 16 16:46:08 crc kubenswrapper[5120]: I0316 16:46:08.308294 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-954498cf-phl8v" event={"ID":"2cb227a9-f8ad-4f55-a381-42bcaa8d0e6d","Type":"ContainerStarted","Data":"4f7f82ca8e1a4a0957dba075673975af65961420c6af1aeb6b6bcd73c7fea190"} Mar 16 16:46:08 crc kubenswrapper[5120]: I0316 16:46:08.308585 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-954498cf-phl8v" event={"ID":"2cb227a9-f8ad-4f55-a381-42bcaa8d0e6d","Type":"ContainerStarted","Data":"0f217d3fd94d1e155058e7e6011bf370c2d51eb2b3fab54ee2062a8a37613fda"} Mar 16 16:46:08 crc kubenswrapper[5120]: I0316 16:46:08.308598 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-954498cf-phl8v" event={"ID":"2cb227a9-f8ad-4f55-a381-42bcaa8d0e6d","Type":"ContainerStarted","Data":"16dfb35306e6725c4b2bbe4a675e5aaea07e50b26632bdfbc22550459f81eb63"} Mar 16 16:46:08 crc kubenswrapper[5120]: I0316 16:46:08.311337 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-6bfffc7f7b-nsf4t" event={"ID":"60e2f357-0615-41a0-96bd-915aacafdfe5","Type":"ContainerStarted","Data":"17759932300f392a7b5b2def1a818fc53789d1218140353960d6f212eab11166"} Mar 16 16:46:08 crc kubenswrapper[5120]: I0316 16:46:08.311374 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-6bfffc7f7b-nsf4t" event={"ID":"60e2f357-0615-41a0-96bd-915aacafdfe5","Type":"ContainerStarted","Data":"b949cf03f2fca0675a17a1589561439ec214ce954c9fa89e42d03257ac493108"} Mar 16 16:46:08 crc kubenswrapper[5120]: I0316 16:46:08.311388 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-6bfffc7f7b-nsf4t" event={"ID":"60e2f357-0615-41a0-96bd-915aacafdfe5","Type":"ContainerStarted","Data":"22a40018bb8b6dfa78c604559f3bbc906a63381744a9805b4b87f19836f6eca7"} Mar 16 16:46:08 crc kubenswrapper[5120]: I0316 16:46:08.311984 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-6bfffc7f7b-nsf4t" Mar 16 16:46:08 crc kubenswrapper[5120]: I0316 16:46:08.312019 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-6bfffc7f7b-nsf4t" Mar 16 16:46:08 crc kubenswrapper[5120]: I0316 16:46:08.316838 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-5557b6754b-qz56v" event={"ID":"212dc541-58a2-45d9-97bf-c566530e09da","Type":"ContainerStarted","Data":"b5a8e25af29663b0e92ce6455221395d411176d4e0eaba6d4a9f1c247a698247"} Mar 16 16:46:08 crc kubenswrapper[5120]: I0316 16:46:08.316870 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-5557b6754b-qz56v" event={"ID":"212dc541-58a2-45d9-97bf-c566530e09da","Type":"ContainerStarted","Data":"415e6f7ee0e108f07f5f3d7faec221ed4234102299dd4517f5a17bf72926ea53"} Mar 16 16:46:08 crc kubenswrapper[5120]: I0316 16:46:08.316879 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-5557b6754b-qz56v" event={"ID":"212dc541-58a2-45d9-97bf-c566530e09da","Type":"ContainerStarted","Data":"70b990c3026dbb904d0e75574885e41f7a85f0f23bfc3d8e589c4f0b53db5ef8"} Mar 16 16:46:08 crc kubenswrapper[5120]: I0316 16:46:08.316891 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:46:08 crc kubenswrapper[5120]: I0316 16:46:08.317954 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:46:08 crc kubenswrapper[5120]: I0316 16:46:08.317975 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:46:08 crc kubenswrapper[5120]: I0316 16:46:08.317984 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:46:08 crc kubenswrapper[5120]: I0316 16:46:08.345823 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-worker-954498cf-phl8v" podStartSLOduration=2.345803966 podStartE2EDuration="2.345803966s" podCreationTimestamp="2026-03-16 16:46:06 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:46:08.344663335 +0000 UTC m=+4470.498595002" watchObservedRunningTime="2026-03-16 16:46:08.345803966 +0000 UTC m=+4470.499735623" Mar 16 16:46:08 crc kubenswrapper[5120]: I0316 16:46:08.376481 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-api-6bfffc7f7b-nsf4t" podStartSLOduration=2.37646174 podStartE2EDuration="2.37646174s" podCreationTimestamp="2026-03-16 16:46:06 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:46:08.373198582 +0000 UTC m=+4470.527130249" watchObservedRunningTime="2026-03-16 16:46:08.37646174 +0000 UTC m=+4470.530393397" Mar 16 16:46:08 crc kubenswrapper[5120]: I0316 16:46:08.409087 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-keystone-listener-5557b6754b-qz56v" podStartSLOduration=2.409065087 podStartE2EDuration="2.409065087s" podCreationTimestamp="2026-03-16 16:46:06 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:46:08.398272604 +0000 UTC m=+4470.552204271" watchObservedRunningTime="2026-03-16 16:46:08.409065087 +0000 UTC m=+4470.562996754" Mar 16 16:46:08 crc kubenswrapper[5120]: I0316 16:46:08.862686 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-6xnr6" Mar 16 16:46:09 crc kubenswrapper[5120]: E0316 16:46:09.027311 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1599659 actualBytes=10240 Mar 16 16:46:09 crc kubenswrapper[5120]: I0316 16:46:09.057563 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-klm5v\" (UniqueName: \"kubernetes.io/projected/6495cc54-9f66-446a-8e99-e2e6b7a95ddc-kube-api-access-klm5v\") pod \"6495cc54-9f66-446a-8e99-e2e6b7a95ddc\" (UID: \"6495cc54-9f66-446a-8e99-e2e6b7a95ddc\") " Mar 16 16:46:09 crc kubenswrapper[5120]: I0316 16:46:09.058095 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6495cc54-9f66-446a-8e99-e2e6b7a95ddc-scripts\") pod \"6495cc54-9f66-446a-8e99-e2e6b7a95ddc\" (UID: \"6495cc54-9f66-446a-8e99-e2e6b7a95ddc\") " Mar 16 16:46:09 crc kubenswrapper[5120]: I0316 16:46:09.058125 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/6495cc54-9f66-446a-8e99-e2e6b7a95ddc-etc-machine-id\") pod \"6495cc54-9f66-446a-8e99-e2e6b7a95ddc\" (UID: \"6495cc54-9f66-446a-8e99-e2e6b7a95ddc\") " Mar 16 16:46:09 crc kubenswrapper[5120]: I0316 16:46:09.058267 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/6495cc54-9f66-446a-8e99-e2e6b7a95ddc-db-sync-config-data\") pod \"6495cc54-9f66-446a-8e99-e2e6b7a95ddc\" (UID: \"6495cc54-9f66-446a-8e99-e2e6b7a95ddc\") " Mar 16 16:46:09 crc kubenswrapper[5120]: I0316 16:46:09.059016 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6495cc54-9f66-446a-8e99-e2e6b7a95ddc-combined-ca-bundle\") pod \"6495cc54-9f66-446a-8e99-e2e6b7a95ddc\" (UID: \"6495cc54-9f66-446a-8e99-e2e6b7a95ddc\") " Mar 16 16:46:09 crc kubenswrapper[5120]: I0316 16:46:09.059098 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6495cc54-9f66-446a-8e99-e2e6b7a95ddc-config-data\") pod \"6495cc54-9f66-446a-8e99-e2e6b7a95ddc\" (UID: \"6495cc54-9f66-446a-8e99-e2e6b7a95ddc\") " Mar 16 16:46:09 crc kubenswrapper[5120]: I0316 16:46:09.059856 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/6495cc54-9f66-446a-8e99-e2e6b7a95ddc-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "6495cc54-9f66-446a-8e99-e2e6b7a95ddc" (UID: "6495cc54-9f66-446a-8e99-e2e6b7a95ddc"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 16:46:09 crc kubenswrapper[5120]: I0316 16:46:09.060262 5120 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/6495cc54-9f66-446a-8e99-e2e6b7a95ddc-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 16:46:09 crc kubenswrapper[5120]: I0316 16:46:09.071011 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6495cc54-9f66-446a-8e99-e2e6b7a95ddc-db-sync-config-data" (OuterVolumeSpecName: "db-sync-config-data") pod "6495cc54-9f66-446a-8e99-e2e6b7a95ddc" (UID: "6495cc54-9f66-446a-8e99-e2e6b7a95ddc"). InnerVolumeSpecName "db-sync-config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:46:09 crc kubenswrapper[5120]: I0316 16:46:09.078805 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6495cc54-9f66-446a-8e99-e2e6b7a95ddc-scripts" (OuterVolumeSpecName: "scripts") pod "6495cc54-9f66-446a-8e99-e2e6b7a95ddc" (UID: "6495cc54-9f66-446a-8e99-e2e6b7a95ddc"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:46:09 crc kubenswrapper[5120]: I0316 16:46:09.082748 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6495cc54-9f66-446a-8e99-e2e6b7a95ddc-kube-api-access-klm5v" (OuterVolumeSpecName: "kube-api-access-klm5v") pod "6495cc54-9f66-446a-8e99-e2e6b7a95ddc" (UID: "6495cc54-9f66-446a-8e99-e2e6b7a95ddc"). InnerVolumeSpecName "kube-api-access-klm5v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:46:09 crc kubenswrapper[5120]: I0316 16:46:09.117179 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6495cc54-9f66-446a-8e99-e2e6b7a95ddc-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "6495cc54-9f66-446a-8e99-e2e6b7a95ddc" (UID: "6495cc54-9f66-446a-8e99-e2e6b7a95ddc"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:46:09 crc kubenswrapper[5120]: I0316 16:46:09.118545 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6495cc54-9f66-446a-8e99-e2e6b7a95ddc-config-data" (OuterVolumeSpecName: "config-data") pod "6495cc54-9f66-446a-8e99-e2e6b7a95ddc" (UID: "6495cc54-9f66-446a-8e99-e2e6b7a95ddc"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:46:09 crc kubenswrapper[5120]: I0316 16:46:09.161705 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6495cc54-9f66-446a-8e99-e2e6b7a95ddc-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:46:09 crc kubenswrapper[5120]: I0316 16:46:09.161735 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6495cc54-9f66-446a-8e99-e2e6b7a95ddc-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:46:09 crc kubenswrapper[5120]: I0316 16:46:09.161746 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-klm5v\" (UniqueName: \"kubernetes.io/projected/6495cc54-9f66-446a-8e99-e2e6b7a95ddc-kube-api-access-klm5v\") on node \"crc\" DevicePath \"\"" Mar 16 16:46:09 crc kubenswrapper[5120]: I0316 16:46:09.161770 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6495cc54-9f66-446a-8e99-e2e6b7a95ddc-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:46:09 crc kubenswrapper[5120]: I0316 16:46:09.161779 5120 reconciler_common.go:299] "Volume detached for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/6495cc54-9f66-446a-8e99-e2e6b7a95ddc-db-sync-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:46:09 crc kubenswrapper[5120]: I0316 16:46:09.326741 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-6xnr6" Mar 16 16:46:09 crc kubenswrapper[5120]: I0316 16:46:09.326785 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-6xnr6" event={"ID":"6495cc54-9f66-446a-8e99-e2e6b7a95ddc","Type":"ContainerDied","Data":"e9ed59b38f0e00b59eb45f32b175a500328df71e2df0b7ae04fe35475a8699c9"} Mar 16 16:46:09 crc kubenswrapper[5120]: I0316 16:46:09.326837 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e9ed59b38f0e00b59eb45f32b175a500328df71e2df0b7ae04fe35475a8699c9" Mar 16 16:46:09 crc kubenswrapper[5120]: I0316 16:46:09.558925 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:46:09 crc kubenswrapper[5120]: I0316 16:46:09.562459 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6495cc54-9f66-446a-8e99-e2e6b7a95ddc" containerName="cinder-db-sync" Mar 16 16:46:09 crc kubenswrapper[5120]: I0316 16:46:09.562484 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="6495cc54-9f66-446a-8e99-e2e6b7a95ddc" containerName="cinder-db-sync" Mar 16 16:46:09 crc kubenswrapper[5120]: I0316 16:46:09.562680 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="6495cc54-9f66-446a-8e99-e2e6b7a95ddc" containerName="cinder-db-sync" Mar 16 16:46:09 crc kubenswrapper[5120]: I0316 16:46:09.568175 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:46:09 crc kubenswrapper[5120]: I0316 16:46:09.573787 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-cinder-dockercfg-2mhmf\"" Mar 16 16:46:09 crc kubenswrapper[5120]: I0316 16:46:09.573808 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-scripts\"" Mar 16 16:46:09 crc kubenswrapper[5120]: I0316 16:46:09.574106 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-scheduler-config-data\"" Mar 16 16:46:09 crc kubenswrapper[5120]: I0316 16:46:09.574261 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-config-data\"" Mar 16 16:46:09 crc kubenswrapper[5120]: I0316 16:46:09.579153 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:46:09 crc kubenswrapper[5120]: I0316 16:46:09.663855 5120 scope.go:117] "RemoveContainer" containerID="35a7dd6e19084cee69ca16203bca6378ea0cdf6a685ca2093ab847e5904eb9e6" Mar 16 16:46:09 crc kubenswrapper[5120]: E0316 16:46:09.664129 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:46:09 crc kubenswrapper[5120]: I0316 16:46:09.664536 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:46:09 crc kubenswrapper[5120]: I0316 16:46:09.672232 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:46:09 crc kubenswrapper[5120]: I0316 16:46:09.674626 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-api-config-data\"" Mar 16 16:46:09 crc kubenswrapper[5120]: I0316 16:46:09.677463 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/fdf65609-0eb4-41e2-8750-13e175eca797-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"fdf65609-0eb4-41e2-8750-13e175eca797\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:46:09 crc kubenswrapper[5120]: I0316 16:46:09.677746 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/fdf65609-0eb4-41e2-8750-13e175eca797-scripts\") pod \"cinder-scheduler-0\" (UID: \"fdf65609-0eb4-41e2-8750-13e175eca797\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:46:09 crc kubenswrapper[5120]: I0316 16:46:09.677815 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fdf65609-0eb4-41e2-8750-13e175eca797-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"fdf65609-0eb4-41e2-8750-13e175eca797\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:46:09 crc kubenswrapper[5120]: I0316 16:46:09.677943 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/fdf65609-0eb4-41e2-8750-13e175eca797-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"fdf65609-0eb4-41e2-8750-13e175eca797\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:46:09 crc kubenswrapper[5120]: I0316 16:46:09.678036 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wffpv\" (UniqueName: \"kubernetes.io/projected/fdf65609-0eb4-41e2-8750-13e175eca797-kube-api-access-wffpv\") pod \"cinder-scheduler-0\" (UID: \"fdf65609-0eb4-41e2-8750-13e175eca797\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:46:09 crc kubenswrapper[5120]: I0316 16:46:09.678199 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fdf65609-0eb4-41e2-8750-13e175eca797-config-data\") pod \"cinder-scheduler-0\" (UID: \"fdf65609-0eb4-41e2-8750-13e175eca797\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:46:09 crc kubenswrapper[5120]: I0316 16:46:09.684630 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:46:09 crc kubenswrapper[5120]: I0316 16:46:09.781732 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/21c25ad9-ce40-4a35-911c-bed267b17113-etc-machine-id\") pod \"cinder-api-0\" (UID: \"21c25ad9-ce40-4a35-911c-bed267b17113\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:46:09 crc kubenswrapper[5120]: I0316 16:46:09.781911 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/21c25ad9-ce40-4a35-911c-bed267b17113-config-data\") pod \"cinder-api-0\" (UID: \"21c25ad9-ce40-4a35-911c-bed267b17113\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:46:09 crc kubenswrapper[5120]: I0316 16:46:09.781989 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/21c25ad9-ce40-4a35-911c-bed267b17113-config-data-custom\") pod \"cinder-api-0\" (UID: \"21c25ad9-ce40-4a35-911c-bed267b17113\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:46:09 crc kubenswrapper[5120]: I0316 16:46:09.782076 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/21c25ad9-ce40-4a35-911c-bed267b17113-logs\") pod \"cinder-api-0\" (UID: \"21c25ad9-ce40-4a35-911c-bed267b17113\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:46:09 crc kubenswrapper[5120]: I0316 16:46:09.782130 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/fdf65609-0eb4-41e2-8750-13e175eca797-scripts\") pod \"cinder-scheduler-0\" (UID: \"fdf65609-0eb4-41e2-8750-13e175eca797\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:46:09 crc kubenswrapper[5120]: I0316 16:46:09.782164 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fdf65609-0eb4-41e2-8750-13e175eca797-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"fdf65609-0eb4-41e2-8750-13e175eca797\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:46:09 crc kubenswrapper[5120]: I0316 16:46:09.782301 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/fdf65609-0eb4-41e2-8750-13e175eca797-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"fdf65609-0eb4-41e2-8750-13e175eca797\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:46:09 crc kubenswrapper[5120]: I0316 16:46:09.782394 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wffpv\" (UniqueName: \"kubernetes.io/projected/fdf65609-0eb4-41e2-8750-13e175eca797-kube-api-access-wffpv\") pod \"cinder-scheduler-0\" (UID: \"fdf65609-0eb4-41e2-8750-13e175eca797\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:46:09 crc kubenswrapper[5120]: I0316 16:46:09.782502 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7pcq\" (UniqueName: \"kubernetes.io/projected/21c25ad9-ce40-4a35-911c-bed267b17113-kube-api-access-q7pcq\") pod \"cinder-api-0\" (UID: \"21c25ad9-ce40-4a35-911c-bed267b17113\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:46:09 crc kubenswrapper[5120]: I0316 16:46:09.782608 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fdf65609-0eb4-41e2-8750-13e175eca797-config-data\") pod \"cinder-scheduler-0\" (UID: \"fdf65609-0eb4-41e2-8750-13e175eca797\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:46:09 crc kubenswrapper[5120]: I0316 16:46:09.782651 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/21c25ad9-ce40-4a35-911c-bed267b17113-scripts\") pod \"cinder-api-0\" (UID: \"21c25ad9-ce40-4a35-911c-bed267b17113\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:46:09 crc kubenswrapper[5120]: I0316 16:46:09.782732 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/21c25ad9-ce40-4a35-911c-bed267b17113-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"21c25ad9-ce40-4a35-911c-bed267b17113\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:46:09 crc kubenswrapper[5120]: I0316 16:46:09.782833 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/fdf65609-0eb4-41e2-8750-13e175eca797-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"fdf65609-0eb4-41e2-8750-13e175eca797\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:46:09 crc kubenswrapper[5120]: I0316 16:46:09.785220 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/fdf65609-0eb4-41e2-8750-13e175eca797-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"fdf65609-0eb4-41e2-8750-13e175eca797\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:46:09 crc kubenswrapper[5120]: I0316 16:46:09.796670 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/fdf65609-0eb4-41e2-8750-13e175eca797-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"fdf65609-0eb4-41e2-8750-13e175eca797\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:46:09 crc kubenswrapper[5120]: I0316 16:46:09.800448 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fdf65609-0eb4-41e2-8750-13e175eca797-config-data\") pod \"cinder-scheduler-0\" (UID: \"fdf65609-0eb4-41e2-8750-13e175eca797\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:46:09 crc kubenswrapper[5120]: I0316 16:46:09.804493 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fdf65609-0eb4-41e2-8750-13e175eca797-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"fdf65609-0eb4-41e2-8750-13e175eca797\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:46:09 crc kubenswrapper[5120]: I0316 16:46:09.816268 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/fdf65609-0eb4-41e2-8750-13e175eca797-scripts\") pod \"cinder-scheduler-0\" (UID: \"fdf65609-0eb4-41e2-8750-13e175eca797\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:46:09 crc kubenswrapper[5120]: I0316 16:46:09.828425 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wffpv\" (UniqueName: \"kubernetes.io/projected/fdf65609-0eb4-41e2-8750-13e175eca797-kube-api-access-wffpv\") pod \"cinder-scheduler-0\" (UID: \"fdf65609-0eb4-41e2-8750-13e175eca797\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:46:09 crc kubenswrapper[5120]: I0316 16:46:09.885648 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q7pcq\" (UniqueName: \"kubernetes.io/projected/21c25ad9-ce40-4a35-911c-bed267b17113-kube-api-access-q7pcq\") pod \"cinder-api-0\" (UID: \"21c25ad9-ce40-4a35-911c-bed267b17113\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:46:09 crc kubenswrapper[5120]: I0316 16:46:09.885791 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/21c25ad9-ce40-4a35-911c-bed267b17113-scripts\") pod \"cinder-api-0\" (UID: \"21c25ad9-ce40-4a35-911c-bed267b17113\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:46:09 crc kubenswrapper[5120]: I0316 16:46:09.885854 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/21c25ad9-ce40-4a35-911c-bed267b17113-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"21c25ad9-ce40-4a35-911c-bed267b17113\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:46:09 crc kubenswrapper[5120]: I0316 16:46:09.885912 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/21c25ad9-ce40-4a35-911c-bed267b17113-etc-machine-id\") pod \"cinder-api-0\" (UID: \"21c25ad9-ce40-4a35-911c-bed267b17113\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:46:09 crc kubenswrapper[5120]: I0316 16:46:09.885965 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/21c25ad9-ce40-4a35-911c-bed267b17113-config-data\") pod \"cinder-api-0\" (UID: \"21c25ad9-ce40-4a35-911c-bed267b17113\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:46:09 crc kubenswrapper[5120]: I0316 16:46:09.886032 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/21c25ad9-ce40-4a35-911c-bed267b17113-config-data-custom\") pod \"cinder-api-0\" (UID: \"21c25ad9-ce40-4a35-911c-bed267b17113\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:46:09 crc kubenswrapper[5120]: I0316 16:46:09.886084 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/21c25ad9-ce40-4a35-911c-bed267b17113-logs\") pod \"cinder-api-0\" (UID: \"21c25ad9-ce40-4a35-911c-bed267b17113\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:46:09 crc kubenswrapper[5120]: I0316 16:46:09.886201 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/21c25ad9-ce40-4a35-911c-bed267b17113-etc-machine-id\") pod \"cinder-api-0\" (UID: \"21c25ad9-ce40-4a35-911c-bed267b17113\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:46:09 crc kubenswrapper[5120]: I0316 16:46:09.886702 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/21c25ad9-ce40-4a35-911c-bed267b17113-logs\") pod \"cinder-api-0\" (UID: \"21c25ad9-ce40-4a35-911c-bed267b17113\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:46:09 crc kubenswrapper[5120]: I0316 16:46:09.894434 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/21c25ad9-ce40-4a35-911c-bed267b17113-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"21c25ad9-ce40-4a35-911c-bed267b17113\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:46:09 crc kubenswrapper[5120]: I0316 16:46:09.896735 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:46:09 crc kubenswrapper[5120]: I0316 16:46:09.897628 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/21c25ad9-ce40-4a35-911c-bed267b17113-config-data-custom\") pod \"cinder-api-0\" (UID: \"21c25ad9-ce40-4a35-911c-bed267b17113\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:46:09 crc kubenswrapper[5120]: I0316 16:46:09.898081 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/21c25ad9-ce40-4a35-911c-bed267b17113-scripts\") pod \"cinder-api-0\" (UID: \"21c25ad9-ce40-4a35-911c-bed267b17113\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:46:09 crc kubenswrapper[5120]: I0316 16:46:09.898290 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/21c25ad9-ce40-4a35-911c-bed267b17113-config-data\") pod \"cinder-api-0\" (UID: \"21c25ad9-ce40-4a35-911c-bed267b17113\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:46:09 crc kubenswrapper[5120]: I0316 16:46:09.913540 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7pcq\" (UniqueName: \"kubernetes.io/projected/21c25ad9-ce40-4a35-911c-bed267b17113-kube-api-access-q7pcq\") pod \"cinder-api-0\" (UID: \"21c25ad9-ce40-4a35-911c-bed267b17113\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:46:09 crc kubenswrapper[5120]: I0316 16:46:09.988931 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:46:10 crc kubenswrapper[5120]: I0316 16:46:10.338391 5120 generic.go:358] "Generic (PLEG): container finished" podID="49473f92-70a6-4bf6-b958-fe5a9e24cbb7" containerID="b19b1f7b89a52c3fd792809f8a1745634a6cda441d9b359b08e17e40288842ce" exitCode=0 Mar 16 16:46:10 crc kubenswrapper[5120]: I0316 16:46:10.338473 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-g8bj2" event={"ID":"49473f92-70a6-4bf6-b958-fe5a9e24cbb7","Type":"ContainerDied","Data":"b19b1f7b89a52c3fd792809f8a1745634a6cda441d9b359b08e17e40288842ce"} Mar 16 16:46:10 crc kubenswrapper[5120]: I0316 16:46:10.339157 5120 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Mar 16 16:46:10 crc kubenswrapper[5120]: I0316 16:46:10.339167 5120 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Mar 16 16:46:10 crc kubenswrapper[5120]: I0316 16:46:10.340734 5120 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Mar 16 16:46:10 crc kubenswrapper[5120]: I0316 16:46:10.340806 5120 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Mar 16 16:46:10 crc kubenswrapper[5120]: I0316 16:46:10.391549 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:46:10 crc kubenswrapper[5120]: I0316 16:46:10.490184 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:46:10 crc kubenswrapper[5120]: W0316 16:46:10.493435 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod21c25ad9_ce40_4a35_911c_bed267b17113.slice/crio-108e91ca27af6ad44f4a61b4762f19969e4c3aa249046aaf92533c70883c7fd0 WatchSource:0}: Error finding container 108e91ca27af6ad44f4a61b4762f19969e4c3aa249046aaf92533c70883c7fd0: Status 404 returned error can't find the container with id 108e91ca27af6ad44f4a61b4762f19969e4c3aa249046aaf92533c70883c7fd0 Mar 16 16:46:10 crc kubenswrapper[5120]: I0316 16:46:10.955235 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:46:10 crc kubenswrapper[5120]: I0316 16:46:10.964654 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:46:11 crc kubenswrapper[5120]: I0316 16:46:11.358349 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"21c25ad9-ce40-4a35-911c-bed267b17113","Type":"ContainerStarted","Data":"108e91ca27af6ad44f4a61b4762f19969e4c3aa249046aaf92533c70883c7fd0"} Mar 16 16:46:11 crc kubenswrapper[5120]: I0316 16:46:11.363407 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"fdf65609-0eb4-41e2-8750-13e175eca797","Type":"ContainerStarted","Data":"40223a2e27f4ad88290330f81a22a6890349c410cd07220da79ab860c0261a68"} Mar 16 16:46:11 crc kubenswrapper[5120]: I0316 16:46:11.363449 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"fdf65609-0eb4-41e2-8750-13e175eca797","Type":"ContainerStarted","Data":"7181880fedd54602177bfaa8007b6027e6e719bf11a3d2ee03506368c29aa1f1"} Mar 16 16:46:11 crc kubenswrapper[5120]: I0316 16:46:11.428534 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:46:11 crc kubenswrapper[5120]: I0316 16:46:11.428857 5120 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Mar 16 16:46:11 crc kubenswrapper[5120]: I0316 16:46:11.436308 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:46:11 crc kubenswrapper[5120]: I0316 16:46:11.848906 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-g8bj2" Mar 16 16:46:11 crc kubenswrapper[5120]: I0316 16:46:11.943142 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/49473f92-70a6-4bf6-b958-fe5a9e24cbb7-credential-keys\") pod \"49473f92-70a6-4bf6-b958-fe5a9e24cbb7\" (UID: \"49473f92-70a6-4bf6-b958-fe5a9e24cbb7\") " Mar 16 16:46:11 crc kubenswrapper[5120]: I0316 16:46:11.943285 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k7dp7\" (UniqueName: \"kubernetes.io/projected/49473f92-70a6-4bf6-b958-fe5a9e24cbb7-kube-api-access-k7dp7\") pod \"49473f92-70a6-4bf6-b958-fe5a9e24cbb7\" (UID: \"49473f92-70a6-4bf6-b958-fe5a9e24cbb7\") " Mar 16 16:46:11 crc kubenswrapper[5120]: I0316 16:46:11.943419 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/49473f92-70a6-4bf6-b958-fe5a9e24cbb7-combined-ca-bundle\") pod \"49473f92-70a6-4bf6-b958-fe5a9e24cbb7\" (UID: \"49473f92-70a6-4bf6-b958-fe5a9e24cbb7\") " Mar 16 16:46:11 crc kubenswrapper[5120]: I0316 16:46:11.944698 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/49473f92-70a6-4bf6-b958-fe5a9e24cbb7-fernet-keys\") pod \"49473f92-70a6-4bf6-b958-fe5a9e24cbb7\" (UID: \"49473f92-70a6-4bf6-b958-fe5a9e24cbb7\") " Mar 16 16:46:11 crc kubenswrapper[5120]: I0316 16:46:11.944739 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/49473f92-70a6-4bf6-b958-fe5a9e24cbb7-config-data\") pod \"49473f92-70a6-4bf6-b958-fe5a9e24cbb7\" (UID: \"49473f92-70a6-4bf6-b958-fe5a9e24cbb7\") " Mar 16 16:46:11 crc kubenswrapper[5120]: I0316 16:46:11.944805 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/49473f92-70a6-4bf6-b958-fe5a9e24cbb7-scripts\") pod \"49473f92-70a6-4bf6-b958-fe5a9e24cbb7\" (UID: \"49473f92-70a6-4bf6-b958-fe5a9e24cbb7\") " Mar 16 16:46:11 crc kubenswrapper[5120]: I0316 16:46:11.950933 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/49473f92-70a6-4bf6-b958-fe5a9e24cbb7-scripts" (OuterVolumeSpecName: "scripts") pod "49473f92-70a6-4bf6-b958-fe5a9e24cbb7" (UID: "49473f92-70a6-4bf6-b958-fe5a9e24cbb7"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:46:11 crc kubenswrapper[5120]: I0316 16:46:11.955973 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49473f92-70a6-4bf6-b958-fe5a9e24cbb7-kube-api-access-k7dp7" (OuterVolumeSpecName: "kube-api-access-k7dp7") pod "49473f92-70a6-4bf6-b958-fe5a9e24cbb7" (UID: "49473f92-70a6-4bf6-b958-fe5a9e24cbb7"). InnerVolumeSpecName "kube-api-access-k7dp7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:46:11 crc kubenswrapper[5120]: I0316 16:46:11.957108 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/49473f92-70a6-4bf6-b958-fe5a9e24cbb7-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "49473f92-70a6-4bf6-b958-fe5a9e24cbb7" (UID: "49473f92-70a6-4bf6-b958-fe5a9e24cbb7"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:46:11 crc kubenswrapper[5120]: I0316 16:46:11.963692 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/49473f92-70a6-4bf6-b958-fe5a9e24cbb7-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "49473f92-70a6-4bf6-b958-fe5a9e24cbb7" (UID: "49473f92-70a6-4bf6-b958-fe5a9e24cbb7"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:46:11 crc kubenswrapper[5120]: I0316 16:46:11.983885 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/49473f92-70a6-4bf6-b958-fe5a9e24cbb7-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "49473f92-70a6-4bf6-b958-fe5a9e24cbb7" (UID: "49473f92-70a6-4bf6-b958-fe5a9e24cbb7"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:46:12 crc kubenswrapper[5120]: I0316 16:46:12.015092 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/49473f92-70a6-4bf6-b958-fe5a9e24cbb7-config-data" (OuterVolumeSpecName: "config-data") pod "49473f92-70a6-4bf6-b958-fe5a9e24cbb7" (UID: "49473f92-70a6-4bf6-b958-fe5a9e24cbb7"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:46:12 crc kubenswrapper[5120]: I0316 16:46:12.050706 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/49473f92-70a6-4bf6-b958-fe5a9e24cbb7-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:46:12 crc kubenswrapper[5120]: I0316 16:46:12.050755 5120 reconciler_common.go:299] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/49473f92-70a6-4bf6-b958-fe5a9e24cbb7-fernet-keys\") on node \"crc\" DevicePath \"\"" Mar 16 16:46:12 crc kubenswrapper[5120]: I0316 16:46:12.050784 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/49473f92-70a6-4bf6-b958-fe5a9e24cbb7-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:46:12 crc kubenswrapper[5120]: I0316 16:46:12.050795 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/49473f92-70a6-4bf6-b958-fe5a9e24cbb7-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:46:12 crc kubenswrapper[5120]: I0316 16:46:12.050809 5120 reconciler_common.go:299] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/49473f92-70a6-4bf6-b958-fe5a9e24cbb7-credential-keys\") on node \"crc\" DevicePath \"\"" Mar 16 16:46:12 crc kubenswrapper[5120]: I0316 16:46:12.050820 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k7dp7\" (UniqueName: \"kubernetes.io/projected/49473f92-70a6-4bf6-b958-fe5a9e24cbb7-kube-api-access-k7dp7\") on node \"crc\" DevicePath \"\"" Mar 16 16:46:12 crc kubenswrapper[5120]: I0316 16:46:12.456725 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"21c25ad9-ce40-4a35-911c-bed267b17113","Type":"ContainerStarted","Data":"41490435f5073420f991ba6106d2149c017f85bfdca66a0675331966b235256a"} Mar 16 16:46:12 crc kubenswrapper[5120]: I0316 16:46:12.461347 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"fdf65609-0eb4-41e2-8750-13e175eca797","Type":"ContainerStarted","Data":"c54f65d70a57c77007f97f8b1a0ef5f2e3668a5a7e597763fa7b165f3080e974"} Mar 16 16:46:12 crc kubenswrapper[5120]: I0316 16:46:12.464705 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-g8bj2" event={"ID":"49473f92-70a6-4bf6-b958-fe5a9e24cbb7","Type":"ContainerDied","Data":"2df57007bb09c5d6332ab33d9926209e2d7082415c8365fa72a2ed969da7e5f9"} Mar 16 16:46:12 crc kubenswrapper[5120]: I0316 16:46:12.464735 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2df57007bb09c5d6332ab33d9926209e2d7082415c8365fa72a2ed969da7e5f9" Mar 16 16:46:12 crc kubenswrapper[5120]: I0316 16:46:12.464788 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-g8bj2" Mar 16 16:46:12 crc kubenswrapper[5120]: I0316 16:46:12.524618 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-scheduler-0" podStartSLOduration=3.5245860430000002 podStartE2EDuration="3.524586043s" podCreationTimestamp="2026-03-16 16:46:09 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:46:12.500340203 +0000 UTC m=+4474.654271860" watchObservedRunningTime="2026-03-16 16:46:12.524586043 +0000 UTC m=+4474.678517700" Mar 16 16:46:12 crc kubenswrapper[5120]: I0316 16:46:12.558835 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-5c4b57cb66-89p9b"] Mar 16 16:46:12 crc kubenswrapper[5120]: I0316 16:46:12.559985 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49473f92-70a6-4bf6-b958-fe5a9e24cbb7" containerName="keystone-bootstrap" Mar 16 16:46:12 crc kubenswrapper[5120]: I0316 16:46:12.560007 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="49473f92-70a6-4bf6-b958-fe5a9e24cbb7" containerName="keystone-bootstrap" Mar 16 16:46:12 crc kubenswrapper[5120]: I0316 16:46:12.560210 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="49473f92-70a6-4bf6-b958-fe5a9e24cbb7" containerName="keystone-bootstrap" Mar 16 16:46:12 crc kubenswrapper[5120]: I0316 16:46:12.564319 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-5c4b57cb66-89p9b" Mar 16 16:46:12 crc kubenswrapper[5120]: I0316 16:46:12.576321 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-5c4b57cb66-89p9b"] Mar 16 16:46:12 crc kubenswrapper[5120]: I0316 16:46:12.586847 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-scripts\"" Mar 16 16:46:12 crc kubenswrapper[5120]: I0316 16:46:12.587049 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone\"" Mar 16 16:46:12 crc kubenswrapper[5120]: I0316 16:46:12.587161 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-config-data\"" Mar 16 16:46:12 crc kubenswrapper[5120]: I0316 16:46:12.587356 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-keystone-dockercfg-xfb6m\"" Mar 16 16:46:12 crc kubenswrapper[5120]: I0316 16:46:12.671865 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcnm8\" (UniqueName: \"kubernetes.io/projected/3b5c836c-a676-4484-a577-057899847899-kube-api-access-xcnm8\") pod \"keystone-5c4b57cb66-89p9b\" (UID: \"3b5c836c-a676-4484-a577-057899847899\") " pod="openstack-kuttl-tests/keystone-5c4b57cb66-89p9b" Mar 16 16:46:12 crc kubenswrapper[5120]: I0316 16:46:12.671979 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3b5c836c-a676-4484-a577-057899847899-config-data\") pod \"keystone-5c4b57cb66-89p9b\" (UID: \"3b5c836c-a676-4484-a577-057899847899\") " pod="openstack-kuttl-tests/keystone-5c4b57cb66-89p9b" Mar 16 16:46:12 crc kubenswrapper[5120]: I0316 16:46:12.672242 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/3b5c836c-a676-4484-a577-057899847899-fernet-keys\") pod \"keystone-5c4b57cb66-89p9b\" (UID: \"3b5c836c-a676-4484-a577-057899847899\") " pod="openstack-kuttl-tests/keystone-5c4b57cb66-89p9b" Mar 16 16:46:12 crc kubenswrapper[5120]: I0316 16:46:12.672292 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3b5c836c-a676-4484-a577-057899847899-scripts\") pod \"keystone-5c4b57cb66-89p9b\" (UID: \"3b5c836c-a676-4484-a577-057899847899\") " pod="openstack-kuttl-tests/keystone-5c4b57cb66-89p9b" Mar 16 16:46:12 crc kubenswrapper[5120]: I0316 16:46:12.672385 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3b5c836c-a676-4484-a577-057899847899-combined-ca-bundle\") pod \"keystone-5c4b57cb66-89p9b\" (UID: \"3b5c836c-a676-4484-a577-057899847899\") " pod="openstack-kuttl-tests/keystone-5c4b57cb66-89p9b" Mar 16 16:46:12 crc kubenswrapper[5120]: I0316 16:46:12.672457 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/3b5c836c-a676-4484-a577-057899847899-credential-keys\") pod \"keystone-5c4b57cb66-89p9b\" (UID: \"3b5c836c-a676-4484-a577-057899847899\") " pod="openstack-kuttl-tests/keystone-5c4b57cb66-89p9b" Mar 16 16:46:12 crc kubenswrapper[5120]: I0316 16:46:12.774977 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xcnm8\" (UniqueName: \"kubernetes.io/projected/3b5c836c-a676-4484-a577-057899847899-kube-api-access-xcnm8\") pod \"keystone-5c4b57cb66-89p9b\" (UID: \"3b5c836c-a676-4484-a577-057899847899\") " pod="openstack-kuttl-tests/keystone-5c4b57cb66-89p9b" Mar 16 16:46:12 crc kubenswrapper[5120]: I0316 16:46:12.775072 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3b5c836c-a676-4484-a577-057899847899-config-data\") pod \"keystone-5c4b57cb66-89p9b\" (UID: \"3b5c836c-a676-4484-a577-057899847899\") " pod="openstack-kuttl-tests/keystone-5c4b57cb66-89p9b" Mar 16 16:46:12 crc kubenswrapper[5120]: I0316 16:46:12.775342 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/3b5c836c-a676-4484-a577-057899847899-fernet-keys\") pod \"keystone-5c4b57cb66-89p9b\" (UID: \"3b5c836c-a676-4484-a577-057899847899\") " pod="openstack-kuttl-tests/keystone-5c4b57cb66-89p9b" Mar 16 16:46:12 crc kubenswrapper[5120]: I0316 16:46:12.775384 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3b5c836c-a676-4484-a577-057899847899-scripts\") pod \"keystone-5c4b57cb66-89p9b\" (UID: \"3b5c836c-a676-4484-a577-057899847899\") " pod="openstack-kuttl-tests/keystone-5c4b57cb66-89p9b" Mar 16 16:46:12 crc kubenswrapper[5120]: I0316 16:46:12.775474 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3b5c836c-a676-4484-a577-057899847899-combined-ca-bundle\") pod \"keystone-5c4b57cb66-89p9b\" (UID: \"3b5c836c-a676-4484-a577-057899847899\") " pod="openstack-kuttl-tests/keystone-5c4b57cb66-89p9b" Mar 16 16:46:12 crc kubenswrapper[5120]: I0316 16:46:12.775556 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/3b5c836c-a676-4484-a577-057899847899-credential-keys\") pod \"keystone-5c4b57cb66-89p9b\" (UID: \"3b5c836c-a676-4484-a577-057899847899\") " pod="openstack-kuttl-tests/keystone-5c4b57cb66-89p9b" Mar 16 16:46:12 crc kubenswrapper[5120]: I0316 16:46:12.780524 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3b5c836c-a676-4484-a577-057899847899-scripts\") pod \"keystone-5c4b57cb66-89p9b\" (UID: \"3b5c836c-a676-4484-a577-057899847899\") " pod="openstack-kuttl-tests/keystone-5c4b57cb66-89p9b" Mar 16 16:46:12 crc kubenswrapper[5120]: I0316 16:46:12.781752 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3b5c836c-a676-4484-a577-057899847899-config-data\") pod \"keystone-5c4b57cb66-89p9b\" (UID: \"3b5c836c-a676-4484-a577-057899847899\") " pod="openstack-kuttl-tests/keystone-5c4b57cb66-89p9b" Mar 16 16:46:12 crc kubenswrapper[5120]: I0316 16:46:12.787607 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3b5c836c-a676-4484-a577-057899847899-combined-ca-bundle\") pod \"keystone-5c4b57cb66-89p9b\" (UID: \"3b5c836c-a676-4484-a577-057899847899\") " pod="openstack-kuttl-tests/keystone-5c4b57cb66-89p9b" Mar 16 16:46:12 crc kubenswrapper[5120]: I0316 16:46:12.787703 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/3b5c836c-a676-4484-a577-057899847899-fernet-keys\") pod \"keystone-5c4b57cb66-89p9b\" (UID: \"3b5c836c-a676-4484-a577-057899847899\") " pod="openstack-kuttl-tests/keystone-5c4b57cb66-89p9b" Mar 16 16:46:12 crc kubenswrapper[5120]: I0316 16:46:12.788027 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/3b5c836c-a676-4484-a577-057899847899-credential-keys\") pod \"keystone-5c4b57cb66-89p9b\" (UID: \"3b5c836c-a676-4484-a577-057899847899\") " pod="openstack-kuttl-tests/keystone-5c4b57cb66-89p9b" Mar 16 16:46:12 crc kubenswrapper[5120]: I0316 16:46:12.802507 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcnm8\" (UniqueName: \"kubernetes.io/projected/3b5c836c-a676-4484-a577-057899847899-kube-api-access-xcnm8\") pod \"keystone-5c4b57cb66-89p9b\" (UID: \"3b5c836c-a676-4484-a577-057899847899\") " pod="openstack-kuttl-tests/keystone-5c4b57cb66-89p9b" Mar 16 16:46:12 crc kubenswrapper[5120]: I0316 16:46:12.907973 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-5c4b57cb66-89p9b" Mar 16 16:46:13 crc kubenswrapper[5120]: I0316 16:46:13.399116 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-5c4b57cb66-89p9b"] Mar 16 16:46:13 crc kubenswrapper[5120]: I0316 16:46:13.512727 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"21c25ad9-ce40-4a35-911c-bed267b17113","Type":"ContainerStarted","Data":"f586b7458c17be75b61140ec0419ddf37d294472d0c8b62c001ca393046fad04"} Mar 16 16:46:13 crc kubenswrapper[5120]: I0316 16:46:13.515796 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-5c4b57cb66-89p9b" event={"ID":"3b5c836c-a676-4484-a577-057899847899","Type":"ContainerStarted","Data":"c486760186daed7722fb676cbb612aed303e16b299a61e12d750ce3cd2f53fb6"} Mar 16 16:46:13 crc kubenswrapper[5120]: I0316 16:46:13.552968 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-api-0" podStartSLOduration=4.552945347 podStartE2EDuration="4.552945347s" podCreationTimestamp="2026-03-16 16:46:09 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:46:13.537558599 +0000 UTC m=+4475.691490256" watchObservedRunningTime="2026-03-16 16:46:13.552945347 +0000 UTC m=+4475.706877004" Mar 16 16:46:14 crc kubenswrapper[5120]: I0316 16:46:14.525612 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-5c4b57cb66-89p9b" event={"ID":"3b5c836c-a676-4484-a577-057899847899","Type":"ContainerStarted","Data":"2229358481ea699ecdeddc39c36ff43b5623e1e57e408300ca16a94f93846517"} Mar 16 16:46:14 crc kubenswrapper[5120]: I0316 16:46:14.527314 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/keystone-5c4b57cb66-89p9b" Mar 16 16:46:14 crc kubenswrapper[5120]: I0316 16:46:14.527727 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:46:14 crc kubenswrapper[5120]: I0316 16:46:14.557264 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-5c4b57cb66-89p9b" podStartSLOduration=2.557247707 podStartE2EDuration="2.557247707s" podCreationTimestamp="2026-03-16 16:46:12 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:46:14.544526401 +0000 UTC m=+4476.698458078" watchObservedRunningTime="2026-03-16 16:46:14.557247707 +0000 UTC m=+4476.711179364" Mar 16 16:46:14 crc kubenswrapper[5120]: I0316 16:46:14.898244 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:46:15 crc kubenswrapper[5120]: I0316 16:46:15.537435 5120 generic.go:358] "Generic (PLEG): container finished" podID="35cf2836-2898-4b13-944c-e61b5b4c005b" containerID="0cf4bef158dd114153ad706a5f5a58700444bcb26541c0d6c3f9cb7df814b032" exitCode=0 Mar 16 16:46:15 crc kubenswrapper[5120]: I0316 16:46:15.537515 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-lmn5g" event={"ID":"35cf2836-2898-4b13-944c-e61b5b4c005b","Type":"ContainerDied","Data":"0cf4bef158dd114153ad706a5f5a58700444bcb26541c0d6c3f9cb7df814b032"} Mar 16 16:46:16 crc kubenswrapper[5120]: I0316 16:46:16.765196 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-6bfffc7f7b-nsf4t" Mar 16 16:46:16 crc kubenswrapper[5120]: I0316 16:46:16.809264 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-6bfffc7f7b-nsf4t" Mar 16 16:46:16 crc kubenswrapper[5120]: I0316 16:46:16.921108 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-lmn5g" Mar 16 16:46:17 crc kubenswrapper[5120]: I0316 16:46:17.060326 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-77bbc99f7d-fbdfw"] Mar 16 16:46:17 crc kubenswrapper[5120]: I0316 16:46:17.061436 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35cf2836-2898-4b13-944c-e61b5b4c005b" containerName="neutron-db-sync" Mar 16 16:46:17 crc kubenswrapper[5120]: I0316 16:46:17.061456 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="35cf2836-2898-4b13-944c-e61b5b4c005b" containerName="neutron-db-sync" Mar 16 16:46:17 crc kubenswrapper[5120]: I0316 16:46:17.061653 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="35cf2836-2898-4b13-944c-e61b5b4c005b" containerName="neutron-db-sync" Mar 16 16:46:17 crc kubenswrapper[5120]: I0316 16:46:17.080919 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-77bbc99f7d-fbdfw" Mar 16 16:46:17 crc kubenswrapper[5120]: I0316 16:46:17.082455 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/35cf2836-2898-4b13-944c-e61b5b4c005b-config\") pod \"35cf2836-2898-4b13-944c-e61b5b4c005b\" (UID: \"35cf2836-2898-4b13-944c-e61b5b4c005b\") " Mar 16 16:46:17 crc kubenswrapper[5120]: I0316 16:46:17.082532 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/35cf2836-2898-4b13-944c-e61b5b4c005b-combined-ca-bundle\") pod \"35cf2836-2898-4b13-944c-e61b5b4c005b\" (UID: \"35cf2836-2898-4b13-944c-e61b5b4c005b\") " Mar 16 16:46:17 crc kubenswrapper[5120]: I0316 16:46:17.082814 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8x84n\" (UniqueName: \"kubernetes.io/projected/35cf2836-2898-4b13-944c-e61b5b4c005b-kube-api-access-8x84n\") pod \"35cf2836-2898-4b13-944c-e61b5b4c005b\" (UID: \"35cf2836-2898-4b13-944c-e61b5b4c005b\") " Mar 16 16:46:17 crc kubenswrapper[5120]: I0316 16:46:17.090662 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-77bbc99f7d-fbdfw"] Mar 16 16:46:17 crc kubenswrapper[5120]: I0316 16:46:17.106728 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-worker-5d966495c9-4n5ss"] Mar 16 16:46:17 crc kubenswrapper[5120]: I0316 16:46:17.141497 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-5d966495c9-4n5ss"] Mar 16 16:46:17 crc kubenswrapper[5120]: I0316 16:46:17.141645 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-5d966495c9-4n5ss" Mar 16 16:46:17 crc kubenswrapper[5120]: I0316 16:46:17.150164 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35cf2836-2898-4b13-944c-e61b5b4c005b-kube-api-access-8x84n" (OuterVolumeSpecName: "kube-api-access-8x84n") pod "35cf2836-2898-4b13-944c-e61b5b4c005b" (UID: "35cf2836-2898-4b13-944c-e61b5b4c005b"). InnerVolumeSpecName "kube-api-access-8x84n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:46:17 crc kubenswrapper[5120]: I0316 16:46:17.186154 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7fdb0b94-e011-4907-9a1e-a67153d87979-config-data\") pod \"barbican-keystone-listener-77bbc99f7d-fbdfw\" (UID: \"7fdb0b94-e011-4907-9a1e-a67153d87979\") " pod="openstack-kuttl-tests/barbican-keystone-listener-77bbc99f7d-fbdfw" Mar 16 16:46:17 crc kubenswrapper[5120]: I0316 16:46:17.186290 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srqmm\" (UniqueName: \"kubernetes.io/projected/7fdb0b94-e011-4907-9a1e-a67153d87979-kube-api-access-srqmm\") pod \"barbican-keystone-listener-77bbc99f7d-fbdfw\" (UID: \"7fdb0b94-e011-4907-9a1e-a67153d87979\") " pod="openstack-kuttl-tests/barbican-keystone-listener-77bbc99f7d-fbdfw" Mar 16 16:46:17 crc kubenswrapper[5120]: I0316 16:46:17.186413 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7fdb0b94-e011-4907-9a1e-a67153d87979-combined-ca-bundle\") pod \"barbican-keystone-listener-77bbc99f7d-fbdfw\" (UID: \"7fdb0b94-e011-4907-9a1e-a67153d87979\") " pod="openstack-kuttl-tests/barbican-keystone-listener-77bbc99f7d-fbdfw" Mar 16 16:46:17 crc kubenswrapper[5120]: I0316 16:46:17.186500 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7fdb0b94-e011-4907-9a1e-a67153d87979-logs\") pod \"barbican-keystone-listener-77bbc99f7d-fbdfw\" (UID: \"7fdb0b94-e011-4907-9a1e-a67153d87979\") " pod="openstack-kuttl-tests/barbican-keystone-listener-77bbc99f7d-fbdfw" Mar 16 16:46:17 crc kubenswrapper[5120]: I0316 16:46:17.190454 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-api-66f8c58b5d-5nmtn"] Mar 16 16:46:17 crc kubenswrapper[5120]: I0316 16:46:17.191808 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/7fdb0b94-e011-4907-9a1e-a67153d87979-config-data-custom\") pod \"barbican-keystone-listener-77bbc99f7d-fbdfw\" (UID: \"7fdb0b94-e011-4907-9a1e-a67153d87979\") " pod="openstack-kuttl-tests/barbican-keystone-listener-77bbc99f7d-fbdfw" Mar 16 16:46:17 crc kubenswrapper[5120]: I0316 16:46:17.192076 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8x84n\" (UniqueName: \"kubernetes.io/projected/35cf2836-2898-4b13-944c-e61b5b4c005b-kube-api-access-8x84n\") on node \"crc\" DevicePath \"\"" Mar 16 16:46:17 crc kubenswrapper[5120]: I0316 16:46:17.198419 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-66f8c58b5d-5nmtn" Mar 16 16:46:17 crc kubenswrapper[5120]: I0316 16:46:17.205915 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-66f8c58b5d-5nmtn"] Mar 16 16:46:17 crc kubenswrapper[5120]: I0316 16:46:17.231913 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/35cf2836-2898-4b13-944c-e61b5b4c005b-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "35cf2836-2898-4b13-944c-e61b5b4c005b" (UID: "35cf2836-2898-4b13-944c-e61b5b4c005b"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:46:17 crc kubenswrapper[5120]: I0316 16:46:17.236800 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/35cf2836-2898-4b13-944c-e61b5b4c005b-config" (OuterVolumeSpecName: "config") pod "35cf2836-2898-4b13-944c-e61b5b4c005b" (UID: "35cf2836-2898-4b13-944c-e61b5b4c005b"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:46:17 crc kubenswrapper[5120]: I0316 16:46:17.294549 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7872e738-4d0c-48dd-952c-d878aafc51af-combined-ca-bundle\") pod \"barbican-worker-5d966495c9-4n5ss\" (UID: \"7872e738-4d0c-48dd-952c-d878aafc51af\") " pod="openstack-kuttl-tests/barbican-worker-5d966495c9-4n5ss" Mar 16 16:46:17 crc kubenswrapper[5120]: I0316 16:46:17.294693 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3dad7391-908f-4984-9272-f28450644483-config-data\") pod \"barbican-api-66f8c58b5d-5nmtn\" (UID: \"3dad7391-908f-4984-9272-f28450644483\") " pod="openstack-kuttl-tests/barbican-api-66f8c58b5d-5nmtn" Mar 16 16:46:17 crc kubenswrapper[5120]: I0316 16:46:17.294756 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3dad7391-908f-4984-9272-f28450644483-logs\") pod \"barbican-api-66f8c58b5d-5nmtn\" (UID: \"3dad7391-908f-4984-9272-f28450644483\") " pod="openstack-kuttl-tests/barbican-api-66f8c58b5d-5nmtn" Mar 16 16:46:17 crc kubenswrapper[5120]: I0316 16:46:17.294841 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7fdb0b94-e011-4907-9a1e-a67153d87979-config-data\") pod \"barbican-keystone-listener-77bbc99f7d-fbdfw\" (UID: \"7fdb0b94-e011-4907-9a1e-a67153d87979\") " pod="openstack-kuttl-tests/barbican-keystone-listener-77bbc99f7d-fbdfw" Mar 16 16:46:17 crc kubenswrapper[5120]: I0316 16:46:17.294872 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7872e738-4d0c-48dd-952c-d878aafc51af-logs\") pod \"barbican-worker-5d966495c9-4n5ss\" (UID: \"7872e738-4d0c-48dd-952c-d878aafc51af\") " pod="openstack-kuttl-tests/barbican-worker-5d966495c9-4n5ss" Mar 16 16:46:17 crc kubenswrapper[5120]: I0316 16:46:17.294993 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4ggl\" (UniqueName: \"kubernetes.io/projected/3dad7391-908f-4984-9272-f28450644483-kube-api-access-x4ggl\") pod \"barbican-api-66f8c58b5d-5nmtn\" (UID: \"3dad7391-908f-4984-9272-f28450644483\") " pod="openstack-kuttl-tests/barbican-api-66f8c58b5d-5nmtn" Mar 16 16:46:17 crc kubenswrapper[5120]: I0316 16:46:17.295099 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-srqmm\" (UniqueName: \"kubernetes.io/projected/7fdb0b94-e011-4907-9a1e-a67153d87979-kube-api-access-srqmm\") pod \"barbican-keystone-listener-77bbc99f7d-fbdfw\" (UID: \"7fdb0b94-e011-4907-9a1e-a67153d87979\") " pod="openstack-kuttl-tests/barbican-keystone-listener-77bbc99f7d-fbdfw" Mar 16 16:46:17 crc kubenswrapper[5120]: I0316 16:46:17.295138 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3dad7391-908f-4984-9272-f28450644483-combined-ca-bundle\") pod \"barbican-api-66f8c58b5d-5nmtn\" (UID: \"3dad7391-908f-4984-9272-f28450644483\") " pod="openstack-kuttl-tests/barbican-api-66f8c58b5d-5nmtn" Mar 16 16:46:17 crc kubenswrapper[5120]: I0316 16:46:17.297697 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7872e738-4d0c-48dd-952c-d878aafc51af-config-data\") pod \"barbican-worker-5d966495c9-4n5ss\" (UID: \"7872e738-4d0c-48dd-952c-d878aafc51af\") " pod="openstack-kuttl-tests/barbican-worker-5d966495c9-4n5ss" Mar 16 16:46:17 crc kubenswrapper[5120]: I0316 16:46:17.297773 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gtlg8\" (UniqueName: \"kubernetes.io/projected/7872e738-4d0c-48dd-952c-d878aafc51af-kube-api-access-gtlg8\") pod \"barbican-worker-5d966495c9-4n5ss\" (UID: \"7872e738-4d0c-48dd-952c-d878aafc51af\") " pod="openstack-kuttl-tests/barbican-worker-5d966495c9-4n5ss" Mar 16 16:46:17 crc kubenswrapper[5120]: I0316 16:46:17.297833 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/3dad7391-908f-4984-9272-f28450644483-config-data-custom\") pod \"barbican-api-66f8c58b5d-5nmtn\" (UID: \"3dad7391-908f-4984-9272-f28450644483\") " pod="openstack-kuttl-tests/barbican-api-66f8c58b5d-5nmtn" Mar 16 16:46:17 crc kubenswrapper[5120]: I0316 16:46:17.297957 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7fdb0b94-e011-4907-9a1e-a67153d87979-combined-ca-bundle\") pod \"barbican-keystone-listener-77bbc99f7d-fbdfw\" (UID: \"7fdb0b94-e011-4907-9a1e-a67153d87979\") " pod="openstack-kuttl-tests/barbican-keystone-listener-77bbc99f7d-fbdfw" Mar 16 16:46:17 crc kubenswrapper[5120]: I0316 16:46:17.298018 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7fdb0b94-e011-4907-9a1e-a67153d87979-logs\") pod \"barbican-keystone-listener-77bbc99f7d-fbdfw\" (UID: \"7fdb0b94-e011-4907-9a1e-a67153d87979\") " pod="openstack-kuttl-tests/barbican-keystone-listener-77bbc99f7d-fbdfw" Mar 16 16:46:17 crc kubenswrapper[5120]: I0316 16:46:17.298058 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/7872e738-4d0c-48dd-952c-d878aafc51af-config-data-custom\") pod \"barbican-worker-5d966495c9-4n5ss\" (UID: \"7872e738-4d0c-48dd-952c-d878aafc51af\") " pod="openstack-kuttl-tests/barbican-worker-5d966495c9-4n5ss" Mar 16 16:46:17 crc kubenswrapper[5120]: I0316 16:46:17.298153 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/7fdb0b94-e011-4907-9a1e-a67153d87979-config-data-custom\") pod \"barbican-keystone-listener-77bbc99f7d-fbdfw\" (UID: \"7fdb0b94-e011-4907-9a1e-a67153d87979\") " pod="openstack-kuttl-tests/barbican-keystone-listener-77bbc99f7d-fbdfw" Mar 16 16:46:17 crc kubenswrapper[5120]: I0316 16:46:17.298354 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/35cf2836-2898-4b13-944c-e61b5b4c005b-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:46:17 crc kubenswrapper[5120]: I0316 16:46:17.298571 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/35cf2836-2898-4b13-944c-e61b5b4c005b-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:46:17 crc kubenswrapper[5120]: I0316 16:46:17.298823 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7fdb0b94-e011-4907-9a1e-a67153d87979-logs\") pod \"barbican-keystone-listener-77bbc99f7d-fbdfw\" (UID: \"7fdb0b94-e011-4907-9a1e-a67153d87979\") " pod="openstack-kuttl-tests/barbican-keystone-listener-77bbc99f7d-fbdfw" Mar 16 16:46:17 crc kubenswrapper[5120]: I0316 16:46:17.300567 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7fdb0b94-e011-4907-9a1e-a67153d87979-config-data\") pod \"barbican-keystone-listener-77bbc99f7d-fbdfw\" (UID: \"7fdb0b94-e011-4907-9a1e-a67153d87979\") " pod="openstack-kuttl-tests/barbican-keystone-listener-77bbc99f7d-fbdfw" Mar 16 16:46:17 crc kubenswrapper[5120]: I0316 16:46:17.304738 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/7fdb0b94-e011-4907-9a1e-a67153d87979-config-data-custom\") pod \"barbican-keystone-listener-77bbc99f7d-fbdfw\" (UID: \"7fdb0b94-e011-4907-9a1e-a67153d87979\") " pod="openstack-kuttl-tests/barbican-keystone-listener-77bbc99f7d-fbdfw" Mar 16 16:46:17 crc kubenswrapper[5120]: I0316 16:46:17.308199 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7fdb0b94-e011-4907-9a1e-a67153d87979-combined-ca-bundle\") pod \"barbican-keystone-listener-77bbc99f7d-fbdfw\" (UID: \"7fdb0b94-e011-4907-9a1e-a67153d87979\") " pod="openstack-kuttl-tests/barbican-keystone-listener-77bbc99f7d-fbdfw" Mar 16 16:46:17 crc kubenswrapper[5120]: I0316 16:46:17.313002 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-srqmm\" (UniqueName: \"kubernetes.io/projected/7fdb0b94-e011-4907-9a1e-a67153d87979-kube-api-access-srqmm\") pod \"barbican-keystone-listener-77bbc99f7d-fbdfw\" (UID: \"7fdb0b94-e011-4907-9a1e-a67153d87979\") " pod="openstack-kuttl-tests/barbican-keystone-listener-77bbc99f7d-fbdfw" Mar 16 16:46:17 crc kubenswrapper[5120]: I0316 16:46:17.400436 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3dad7391-908f-4984-9272-f28450644483-config-data\") pod \"barbican-api-66f8c58b5d-5nmtn\" (UID: \"3dad7391-908f-4984-9272-f28450644483\") " pod="openstack-kuttl-tests/barbican-api-66f8c58b5d-5nmtn" Mar 16 16:46:17 crc kubenswrapper[5120]: I0316 16:46:17.400548 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3dad7391-908f-4984-9272-f28450644483-logs\") pod \"barbican-api-66f8c58b5d-5nmtn\" (UID: \"3dad7391-908f-4984-9272-f28450644483\") " pod="openstack-kuttl-tests/barbican-api-66f8c58b5d-5nmtn" Mar 16 16:46:17 crc kubenswrapper[5120]: I0316 16:46:17.400609 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7872e738-4d0c-48dd-952c-d878aafc51af-logs\") pod \"barbican-worker-5d966495c9-4n5ss\" (UID: \"7872e738-4d0c-48dd-952c-d878aafc51af\") " pod="openstack-kuttl-tests/barbican-worker-5d966495c9-4n5ss" Mar 16 16:46:17 crc kubenswrapper[5120]: I0316 16:46:17.400997 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7872e738-4d0c-48dd-952c-d878aafc51af-logs\") pod \"barbican-worker-5d966495c9-4n5ss\" (UID: \"7872e738-4d0c-48dd-952c-d878aafc51af\") " pod="openstack-kuttl-tests/barbican-worker-5d966495c9-4n5ss" Mar 16 16:46:17 crc kubenswrapper[5120]: I0316 16:46:17.401038 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x4ggl\" (UniqueName: \"kubernetes.io/projected/3dad7391-908f-4984-9272-f28450644483-kube-api-access-x4ggl\") pod \"barbican-api-66f8c58b5d-5nmtn\" (UID: \"3dad7391-908f-4984-9272-f28450644483\") " pod="openstack-kuttl-tests/barbican-api-66f8c58b5d-5nmtn" Mar 16 16:46:17 crc kubenswrapper[5120]: I0316 16:46:17.401103 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3dad7391-908f-4984-9272-f28450644483-combined-ca-bundle\") pod \"barbican-api-66f8c58b5d-5nmtn\" (UID: \"3dad7391-908f-4984-9272-f28450644483\") " pod="openstack-kuttl-tests/barbican-api-66f8c58b5d-5nmtn" Mar 16 16:46:17 crc kubenswrapper[5120]: I0316 16:46:17.401131 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7872e738-4d0c-48dd-952c-d878aafc51af-config-data\") pod \"barbican-worker-5d966495c9-4n5ss\" (UID: \"7872e738-4d0c-48dd-952c-d878aafc51af\") " pod="openstack-kuttl-tests/barbican-worker-5d966495c9-4n5ss" Mar 16 16:46:17 crc kubenswrapper[5120]: I0316 16:46:17.401153 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gtlg8\" (UniqueName: \"kubernetes.io/projected/7872e738-4d0c-48dd-952c-d878aafc51af-kube-api-access-gtlg8\") pod \"barbican-worker-5d966495c9-4n5ss\" (UID: \"7872e738-4d0c-48dd-952c-d878aafc51af\") " pod="openstack-kuttl-tests/barbican-worker-5d966495c9-4n5ss" Mar 16 16:46:17 crc kubenswrapper[5120]: I0316 16:46:17.401181 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/3dad7391-908f-4984-9272-f28450644483-config-data-custom\") pod \"barbican-api-66f8c58b5d-5nmtn\" (UID: \"3dad7391-908f-4984-9272-f28450644483\") " pod="openstack-kuttl-tests/barbican-api-66f8c58b5d-5nmtn" Mar 16 16:46:17 crc kubenswrapper[5120]: I0316 16:46:17.401236 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/7872e738-4d0c-48dd-952c-d878aafc51af-config-data-custom\") pod \"barbican-worker-5d966495c9-4n5ss\" (UID: \"7872e738-4d0c-48dd-952c-d878aafc51af\") " pod="openstack-kuttl-tests/barbican-worker-5d966495c9-4n5ss" Mar 16 16:46:17 crc kubenswrapper[5120]: I0316 16:46:17.401271 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3dad7391-908f-4984-9272-f28450644483-logs\") pod \"barbican-api-66f8c58b5d-5nmtn\" (UID: \"3dad7391-908f-4984-9272-f28450644483\") " pod="openstack-kuttl-tests/barbican-api-66f8c58b5d-5nmtn" Mar 16 16:46:17 crc kubenswrapper[5120]: I0316 16:46:17.401401 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7872e738-4d0c-48dd-952c-d878aafc51af-combined-ca-bundle\") pod \"barbican-worker-5d966495c9-4n5ss\" (UID: \"7872e738-4d0c-48dd-952c-d878aafc51af\") " pod="openstack-kuttl-tests/barbican-worker-5d966495c9-4n5ss" Mar 16 16:46:17 crc kubenswrapper[5120]: I0316 16:46:17.404913 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-77bbc99f7d-fbdfw" Mar 16 16:46:17 crc kubenswrapper[5120]: I0316 16:46:17.405661 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/3dad7391-908f-4984-9272-f28450644483-config-data-custom\") pod \"barbican-api-66f8c58b5d-5nmtn\" (UID: \"3dad7391-908f-4984-9272-f28450644483\") " pod="openstack-kuttl-tests/barbican-api-66f8c58b5d-5nmtn" Mar 16 16:46:17 crc kubenswrapper[5120]: I0316 16:46:17.406538 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7872e738-4d0c-48dd-952c-d878aafc51af-combined-ca-bundle\") pod \"barbican-worker-5d966495c9-4n5ss\" (UID: \"7872e738-4d0c-48dd-952c-d878aafc51af\") " pod="openstack-kuttl-tests/barbican-worker-5d966495c9-4n5ss" Mar 16 16:46:17 crc kubenswrapper[5120]: I0316 16:46:17.407468 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7872e738-4d0c-48dd-952c-d878aafc51af-config-data\") pod \"barbican-worker-5d966495c9-4n5ss\" (UID: \"7872e738-4d0c-48dd-952c-d878aafc51af\") " pod="openstack-kuttl-tests/barbican-worker-5d966495c9-4n5ss" Mar 16 16:46:17 crc kubenswrapper[5120]: I0316 16:46:17.412719 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3dad7391-908f-4984-9272-f28450644483-combined-ca-bundle\") pod \"barbican-api-66f8c58b5d-5nmtn\" (UID: \"3dad7391-908f-4984-9272-f28450644483\") " pod="openstack-kuttl-tests/barbican-api-66f8c58b5d-5nmtn" Mar 16 16:46:17 crc kubenswrapper[5120]: I0316 16:46:17.420349 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gtlg8\" (UniqueName: \"kubernetes.io/projected/7872e738-4d0c-48dd-952c-d878aafc51af-kube-api-access-gtlg8\") pod \"barbican-worker-5d966495c9-4n5ss\" (UID: \"7872e738-4d0c-48dd-952c-d878aafc51af\") " pod="openstack-kuttl-tests/barbican-worker-5d966495c9-4n5ss" Mar 16 16:46:17 crc kubenswrapper[5120]: I0316 16:46:17.420971 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/7872e738-4d0c-48dd-952c-d878aafc51af-config-data-custom\") pod \"barbican-worker-5d966495c9-4n5ss\" (UID: \"7872e738-4d0c-48dd-952c-d878aafc51af\") " pod="openstack-kuttl-tests/barbican-worker-5d966495c9-4n5ss" Mar 16 16:46:17 crc kubenswrapper[5120]: I0316 16:46:17.422120 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4ggl\" (UniqueName: \"kubernetes.io/projected/3dad7391-908f-4984-9272-f28450644483-kube-api-access-x4ggl\") pod \"barbican-api-66f8c58b5d-5nmtn\" (UID: \"3dad7391-908f-4984-9272-f28450644483\") " pod="openstack-kuttl-tests/barbican-api-66f8c58b5d-5nmtn" Mar 16 16:46:17 crc kubenswrapper[5120]: I0316 16:46:17.422718 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3dad7391-908f-4984-9272-f28450644483-config-data\") pod \"barbican-api-66f8c58b5d-5nmtn\" (UID: \"3dad7391-908f-4984-9272-f28450644483\") " pod="openstack-kuttl-tests/barbican-api-66f8c58b5d-5nmtn" Mar 16 16:46:17 crc kubenswrapper[5120]: I0316 16:46:17.562298 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-lmn5g" Mar 16 16:46:17 crc kubenswrapper[5120]: I0316 16:46:17.562515 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-lmn5g" event={"ID":"35cf2836-2898-4b13-944c-e61b5b4c005b","Type":"ContainerDied","Data":"9232418b9e2304334f625ce65eb96feb94160f64be81b7a23f9a6c25a218281e"} Mar 16 16:46:17 crc kubenswrapper[5120]: I0316 16:46:17.563309 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9232418b9e2304334f625ce65eb96feb94160f64be81b7a23f9a6c25a218281e" Mar 16 16:46:17 crc kubenswrapper[5120]: I0316 16:46:17.601536 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-5d966495c9-4n5ss" Mar 16 16:46:17 crc kubenswrapper[5120]: I0316 16:46:17.612991 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-66f8c58b5d-5nmtn" Mar 16 16:46:17 crc kubenswrapper[5120]: I0316 16:46:17.860302 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-c59d54458-jxsr6"] Mar 16 16:46:17 crc kubenswrapper[5120]: I0316 16:46:17.874834 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-c59d54458-jxsr6" Mar 16 16:46:17 crc kubenswrapper[5120]: I0316 16:46:17.877752 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-config\"" Mar 16 16:46:17 crc kubenswrapper[5120]: I0316 16:46:17.878100 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-neutron-dockercfg-49ghd\"" Mar 16 16:46:17 crc kubenswrapper[5120]: I0316 16:46:17.878211 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-httpd-config\"" Mar 16 16:46:17 crc kubenswrapper[5120]: I0316 16:46:17.885367 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-c59d54458-jxsr6"] Mar 16 16:46:17 crc kubenswrapper[5120]: I0316 16:46:17.898413 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-77bbc99f7d-fbdfw"] Mar 16 16:46:17 crc kubenswrapper[5120]: I0316 16:46:17.922794 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/38e3968d-4055-452c-a026-2fd65f640c94-httpd-config\") pod \"neutron-c59d54458-jxsr6\" (UID: \"38e3968d-4055-452c-a026-2fd65f640c94\") " pod="openstack-kuttl-tests/neutron-c59d54458-jxsr6" Mar 16 16:46:17 crc kubenswrapper[5120]: I0316 16:46:17.922917 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54jvf\" (UniqueName: \"kubernetes.io/projected/38e3968d-4055-452c-a026-2fd65f640c94-kube-api-access-54jvf\") pod \"neutron-c59d54458-jxsr6\" (UID: \"38e3968d-4055-452c-a026-2fd65f640c94\") " pod="openstack-kuttl-tests/neutron-c59d54458-jxsr6" Mar 16 16:46:17 crc kubenswrapper[5120]: I0316 16:46:17.923048 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/38e3968d-4055-452c-a026-2fd65f640c94-config\") pod \"neutron-c59d54458-jxsr6\" (UID: \"38e3968d-4055-452c-a026-2fd65f640c94\") " pod="openstack-kuttl-tests/neutron-c59d54458-jxsr6" Mar 16 16:46:17 crc kubenswrapper[5120]: I0316 16:46:17.923088 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/38e3968d-4055-452c-a026-2fd65f640c94-combined-ca-bundle\") pod \"neutron-c59d54458-jxsr6\" (UID: \"38e3968d-4055-452c-a026-2fd65f640c94\") " pod="openstack-kuttl-tests/neutron-c59d54458-jxsr6" Mar 16 16:46:18 crc kubenswrapper[5120]: I0316 16:46:18.025713 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/38e3968d-4055-452c-a026-2fd65f640c94-config\") pod \"neutron-c59d54458-jxsr6\" (UID: \"38e3968d-4055-452c-a026-2fd65f640c94\") " pod="openstack-kuttl-tests/neutron-c59d54458-jxsr6" Mar 16 16:46:18 crc kubenswrapper[5120]: I0316 16:46:18.026560 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/38e3968d-4055-452c-a026-2fd65f640c94-combined-ca-bundle\") pod \"neutron-c59d54458-jxsr6\" (UID: \"38e3968d-4055-452c-a026-2fd65f640c94\") " pod="openstack-kuttl-tests/neutron-c59d54458-jxsr6" Mar 16 16:46:18 crc kubenswrapper[5120]: I0316 16:46:18.026749 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/38e3968d-4055-452c-a026-2fd65f640c94-httpd-config\") pod \"neutron-c59d54458-jxsr6\" (UID: \"38e3968d-4055-452c-a026-2fd65f640c94\") " pod="openstack-kuttl-tests/neutron-c59d54458-jxsr6" Mar 16 16:46:18 crc kubenswrapper[5120]: I0316 16:46:18.026923 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-54jvf\" (UniqueName: \"kubernetes.io/projected/38e3968d-4055-452c-a026-2fd65f640c94-kube-api-access-54jvf\") pod \"neutron-c59d54458-jxsr6\" (UID: \"38e3968d-4055-452c-a026-2fd65f640c94\") " pod="openstack-kuttl-tests/neutron-c59d54458-jxsr6" Mar 16 16:46:18 crc kubenswrapper[5120]: I0316 16:46:18.033075 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/38e3968d-4055-452c-a026-2fd65f640c94-httpd-config\") pod \"neutron-c59d54458-jxsr6\" (UID: \"38e3968d-4055-452c-a026-2fd65f640c94\") " pod="openstack-kuttl-tests/neutron-c59d54458-jxsr6" Mar 16 16:46:18 crc kubenswrapper[5120]: I0316 16:46:18.033488 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/38e3968d-4055-452c-a026-2fd65f640c94-config\") pod \"neutron-c59d54458-jxsr6\" (UID: \"38e3968d-4055-452c-a026-2fd65f640c94\") " pod="openstack-kuttl-tests/neutron-c59d54458-jxsr6" Mar 16 16:46:18 crc kubenswrapper[5120]: I0316 16:46:18.040605 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/38e3968d-4055-452c-a026-2fd65f640c94-combined-ca-bundle\") pod \"neutron-c59d54458-jxsr6\" (UID: \"38e3968d-4055-452c-a026-2fd65f640c94\") " pod="openstack-kuttl-tests/neutron-c59d54458-jxsr6" Mar 16 16:46:18 crc kubenswrapper[5120]: I0316 16:46:18.045626 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-54jvf\" (UniqueName: \"kubernetes.io/projected/38e3968d-4055-452c-a026-2fd65f640c94-kube-api-access-54jvf\") pod \"neutron-c59d54458-jxsr6\" (UID: \"38e3968d-4055-452c-a026-2fd65f640c94\") " pod="openstack-kuttl-tests/neutron-c59d54458-jxsr6" Mar 16 16:46:18 crc kubenswrapper[5120]: I0316 16:46:18.125265 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-66f8c58b5d-5nmtn"] Mar 16 16:46:18 crc kubenswrapper[5120]: I0316 16:46:18.169038 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:46:18 crc kubenswrapper[5120]: I0316 16:46:18.169313 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="9259fe9e-b8ac-4419-a121-b51b0b3916e4" containerName="ceilometer-central-agent" containerID="cri-o://e58e09571e92dd362e7bb6d4f218a78ec9d72cbc97af4b4a2df448feffc01fd9" gracePeriod=30 Mar 16 16:46:18 crc kubenswrapper[5120]: I0316 16:46:18.170032 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="9259fe9e-b8ac-4419-a121-b51b0b3916e4" containerName="proxy-httpd" containerID="cri-o://90a00282b842a2cce608b3e9d8bf71cc5604e903a51cde201ce4727099efd55e" gracePeriod=30 Mar 16 16:46:18 crc kubenswrapper[5120]: I0316 16:46:18.170096 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="9259fe9e-b8ac-4419-a121-b51b0b3916e4" containerName="sg-core" containerID="cri-o://41b124cd4bd6e249658c5e31609d126a411aaf2a7bb739d7c0b64c0c0d12b50d" gracePeriod=30 Mar 16 16:46:18 crc kubenswrapper[5120]: I0316 16:46:18.170134 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="9259fe9e-b8ac-4419-a121-b51b0b3916e4" containerName="ceilometer-notification-agent" containerID="cri-o://9a4f01458ca26dbbbe15024176ef0c7a21cde99cbadf5bd66dfb71f1a4761a24" gracePeriod=30 Mar 16 16:46:18 crc kubenswrapper[5120]: I0316 16:46:18.192529 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/ceilometer-0" podUID="9259fe9e-b8ac-4419-a121-b51b0b3916e4" containerName="proxy-httpd" probeResult="failure" output="HTTP probe failed with statuscode: 502" Mar 16 16:46:18 crc kubenswrapper[5120]: I0316 16:46:18.234176 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-5d966495c9-4n5ss"] Mar 16 16:46:18 crc kubenswrapper[5120]: I0316 16:46:18.242838 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-c59d54458-jxsr6" Mar 16 16:46:18 crc kubenswrapper[5120]: I0316 16:46:18.575018 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-5d966495c9-4n5ss" event={"ID":"7872e738-4d0c-48dd-952c-d878aafc51af","Type":"ContainerStarted","Data":"2bcf867b5f7513b9f5de5259f817492a68be7846d89a1bc2dacdab498fcfca0f"} Mar 16 16:46:18 crc kubenswrapper[5120]: I0316 16:46:18.575323 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-5d966495c9-4n5ss" event={"ID":"7872e738-4d0c-48dd-952c-d878aafc51af","Type":"ContainerStarted","Data":"b52f93373b460f94721948a04747edc62ce2f2c4c20aa3a65ef4af35ba37a003"} Mar 16 16:46:18 crc kubenswrapper[5120]: I0316 16:46:18.586523 5120 generic.go:358] "Generic (PLEG): container finished" podID="9259fe9e-b8ac-4419-a121-b51b0b3916e4" containerID="90a00282b842a2cce608b3e9d8bf71cc5604e903a51cde201ce4727099efd55e" exitCode=0 Mar 16 16:46:18 crc kubenswrapper[5120]: I0316 16:46:18.586555 5120 generic.go:358] "Generic (PLEG): container finished" podID="9259fe9e-b8ac-4419-a121-b51b0b3916e4" containerID="41b124cd4bd6e249658c5e31609d126a411aaf2a7bb739d7c0b64c0c0d12b50d" exitCode=2 Mar 16 16:46:18 crc kubenswrapper[5120]: I0316 16:46:18.586722 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"9259fe9e-b8ac-4419-a121-b51b0b3916e4","Type":"ContainerDied","Data":"90a00282b842a2cce608b3e9d8bf71cc5604e903a51cde201ce4727099efd55e"} Mar 16 16:46:18 crc kubenswrapper[5120]: I0316 16:46:18.586755 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"9259fe9e-b8ac-4419-a121-b51b0b3916e4","Type":"ContainerDied","Data":"41b124cd4bd6e249658c5e31609d126a411aaf2a7bb739d7c0b64c0c0d12b50d"} Mar 16 16:46:18 crc kubenswrapper[5120]: I0316 16:46:18.591082 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-77bbc99f7d-fbdfw" event={"ID":"7fdb0b94-e011-4907-9a1e-a67153d87979","Type":"ContainerStarted","Data":"044c15ffa7eb7b7e365430d8cd90ac7de7dc64f1a62dd9960f7cd1eb40ab2934"} Mar 16 16:46:18 crc kubenswrapper[5120]: I0316 16:46:18.591120 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-77bbc99f7d-fbdfw" event={"ID":"7fdb0b94-e011-4907-9a1e-a67153d87979","Type":"ContainerStarted","Data":"413ac662c0970f63340ee428f2ce77c5b13deb609b8adfca801cfa11779825e7"} Mar 16 16:46:18 crc kubenswrapper[5120]: I0316 16:46:18.591130 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-77bbc99f7d-fbdfw" event={"ID":"7fdb0b94-e011-4907-9a1e-a67153d87979","Type":"ContainerStarted","Data":"fb6abc80f55ba32dce51b6c134df5b30b086356e3e5f54f629695ba2b8a9d559"} Mar 16 16:46:18 crc kubenswrapper[5120]: I0316 16:46:18.596550 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-66f8c58b5d-5nmtn" event={"ID":"3dad7391-908f-4984-9272-f28450644483","Type":"ContainerStarted","Data":"4a1d05bdf4568f0d31e23dfca9c9fbb8395d941ca4ddc89fd84bacfb20b93fd3"} Mar 16 16:46:18 crc kubenswrapper[5120]: I0316 16:46:18.596582 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-66f8c58b5d-5nmtn" event={"ID":"3dad7391-908f-4984-9272-f28450644483","Type":"ContainerStarted","Data":"cac2bcb77c635648598795eec3f74ab142eff75b48a560a7988ecc861b94ea94"} Mar 16 16:46:18 crc kubenswrapper[5120]: I0316 16:46:18.597171 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-66f8c58b5d-5nmtn" Mar 16 16:46:18 crc kubenswrapper[5120]: I0316 16:46:18.597230 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-66f8c58b5d-5nmtn" Mar 16 16:46:18 crc kubenswrapper[5120]: I0316 16:46:18.609529 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-keystone-listener-77bbc99f7d-fbdfw" podStartSLOduration=1.609510533 podStartE2EDuration="1.609510533s" podCreationTimestamp="2026-03-16 16:46:17 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:46:18.60867304 +0000 UTC m=+4480.762604697" watchObservedRunningTime="2026-03-16 16:46:18.609510533 +0000 UTC m=+4480.763442190" Mar 16 16:46:18 crc kubenswrapper[5120]: I0316 16:46:18.639947 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-api-66f8c58b5d-5nmtn" podStartSLOduration=1.639926749 podStartE2EDuration="1.639926749s" podCreationTimestamp="2026-03-16 16:46:17 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:46:18.62558596 +0000 UTC m=+4480.779517617" watchObservedRunningTime="2026-03-16 16:46:18.639926749 +0000 UTC m=+4480.793858396" Mar 16 16:46:18 crc kubenswrapper[5120]: I0316 16:46:18.654752 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-5557b6754b-qz56v"] Mar 16 16:46:18 crc kubenswrapper[5120]: I0316 16:46:18.656539 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-5557b6754b-qz56v" podUID="212dc541-58a2-45d9-97bf-c566530e09da" containerName="barbican-keystone-listener-log" containerID="cri-o://415e6f7ee0e108f07f5f3d7faec221ed4234102299dd4517f5a17bf72926ea53" gracePeriod=30 Mar 16 16:46:18 crc kubenswrapper[5120]: I0316 16:46:18.657042 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-5557b6754b-qz56v" podUID="212dc541-58a2-45d9-97bf-c566530e09da" containerName="barbican-keystone-listener" containerID="cri-o://b5a8e25af29663b0e92ce6455221395d411176d4e0eaba6d4a9f1c247a698247" gracePeriod=30 Mar 16 16:46:18 crc kubenswrapper[5120]: I0316 16:46:18.745242 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-c59d54458-jxsr6"] Mar 16 16:46:18 crc kubenswrapper[5120]: W0316 16:46:18.745717 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod38e3968d_4055_452c_a026_2fd65f640c94.slice/crio-9ffd4db2095c5610c79a52cad064ac2e1b4b7dc0eb040709f787e6dd09c44c3c WatchSource:0}: Error finding container 9ffd4db2095c5610c79a52cad064ac2e1b4b7dc0eb040709f787e6dd09c44c3c: Status 404 returned error can't find the container with id 9ffd4db2095c5610c79a52cad064ac2e1b4b7dc0eb040709f787e6dd09c44c3c Mar 16 16:46:19 crc kubenswrapper[5120]: I0316 16:46:19.626610 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-5d966495c9-4n5ss" event={"ID":"7872e738-4d0c-48dd-952c-d878aafc51af","Type":"ContainerStarted","Data":"1f29684c403dda9045db07e7ddb6e0614e8cd5b3820d6ba12d2a76504a2cb5db"} Mar 16 16:46:19 crc kubenswrapper[5120]: I0316 16:46:19.647512 5120 generic.go:358] "Generic (PLEG): container finished" podID="9259fe9e-b8ac-4419-a121-b51b0b3916e4" containerID="e58e09571e92dd362e7bb6d4f218a78ec9d72cbc97af4b4a2df448feffc01fd9" exitCode=0 Mar 16 16:46:19 crc kubenswrapper[5120]: I0316 16:46:19.648104 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"9259fe9e-b8ac-4419-a121-b51b0b3916e4","Type":"ContainerDied","Data":"e58e09571e92dd362e7bb6d4f218a78ec9d72cbc97af4b4a2df448feffc01fd9"} Mar 16 16:46:19 crc kubenswrapper[5120]: I0316 16:46:19.652199 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-worker-5d966495c9-4n5ss" podStartSLOduration=2.652178936 podStartE2EDuration="2.652178936s" podCreationTimestamp="2026-03-16 16:46:17 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:46:19.648563298 +0000 UTC m=+4481.802494965" watchObservedRunningTime="2026-03-16 16:46:19.652178936 +0000 UTC m=+4481.806110583" Mar 16 16:46:19 crc kubenswrapper[5120]: I0316 16:46:19.662946 5120 generic.go:358] "Generic (PLEG): container finished" podID="212dc541-58a2-45d9-97bf-c566530e09da" containerID="415e6f7ee0e108f07f5f3d7faec221ed4234102299dd4517f5a17bf72926ea53" exitCode=143 Mar 16 16:46:19 crc kubenswrapper[5120]: I0316 16:46:19.662954 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-5557b6754b-qz56v" event={"ID":"212dc541-58a2-45d9-97bf-c566530e09da","Type":"ContainerDied","Data":"415e6f7ee0e108f07f5f3d7faec221ed4234102299dd4517f5a17bf72926ea53"} Mar 16 16:46:19 crc kubenswrapper[5120]: I0316 16:46:19.667598 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-c59d54458-jxsr6" event={"ID":"38e3968d-4055-452c-a026-2fd65f640c94","Type":"ContainerStarted","Data":"ffb40f5577b6914ba356f72dc5e5487f3271ee8e4fb606a56342dab08732b090"} Mar 16 16:46:19 crc kubenswrapper[5120]: I0316 16:46:19.667653 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-c59d54458-jxsr6" event={"ID":"38e3968d-4055-452c-a026-2fd65f640c94","Type":"ContainerStarted","Data":"0b4d6823af37760f7a48856d2232b195af45794910cb01da7c0e5e7aab0b7775"} Mar 16 16:46:19 crc kubenswrapper[5120]: I0316 16:46:19.667665 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-c59d54458-jxsr6" event={"ID":"38e3968d-4055-452c-a026-2fd65f640c94","Type":"ContainerStarted","Data":"9ffd4db2095c5610c79a52cad064ac2e1b4b7dc0eb040709f787e6dd09c44c3c"} Mar 16 16:46:19 crc kubenswrapper[5120]: I0316 16:46:19.668800 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/neutron-c59d54458-jxsr6" Mar 16 16:46:19 crc kubenswrapper[5120]: I0316 16:46:19.674702 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-66f8c58b5d-5nmtn" event={"ID":"3dad7391-908f-4984-9272-f28450644483","Type":"ContainerStarted","Data":"87642dd0e9423953bb1babdced238f4c04ce8fa1d0b2bd4e731927d40588bdd3"} Mar 16 16:46:19 crc kubenswrapper[5120]: I0316 16:46:19.682780 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-954498cf-phl8v"] Mar 16 16:46:19 crc kubenswrapper[5120]: I0316 16:46:19.683032 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-954498cf-phl8v" podUID="2cb227a9-f8ad-4f55-a381-42bcaa8d0e6d" containerName="barbican-worker-log" containerID="cri-o://0f217d3fd94d1e155058e7e6011bf370c2d51eb2b3fab54ee2062a8a37613fda" gracePeriod=30 Mar 16 16:46:19 crc kubenswrapper[5120]: I0316 16:46:19.683162 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-954498cf-phl8v" podUID="2cb227a9-f8ad-4f55-a381-42bcaa8d0e6d" containerName="barbican-worker" containerID="cri-o://4f7f82ca8e1a4a0957dba075673975af65961420c6af1aeb6b6bcd73c7fea190" gracePeriod=30 Mar 16 16:46:19 crc kubenswrapper[5120]: I0316 16:46:19.689598 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-c59d54458-jxsr6" podStartSLOduration=2.689577154 podStartE2EDuration="2.689577154s" podCreationTimestamp="2026-03-16 16:46:17 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:46:19.688587676 +0000 UTC m=+4481.842519333" watchObservedRunningTime="2026-03-16 16:46:19.689577154 +0000 UTC m=+4481.843508811" Mar 16 16:46:20 crc kubenswrapper[5120]: I0316 16:46:20.137862 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:46:20 crc kubenswrapper[5120]: I0316 16:46:20.340977 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:46:20 crc kubenswrapper[5120]: I0316 16:46:20.378188 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:46:20 crc kubenswrapper[5120]: I0316 16:46:20.378814 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="21c25ad9-ce40-4a35-911c-bed267b17113" containerName="cinder-api-log" containerID="cri-o://41490435f5073420f991ba6106d2149c017f85bfdca66a0675331966b235256a" gracePeriod=30 Mar 16 16:46:20 crc kubenswrapper[5120]: I0316 16:46:20.379022 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="21c25ad9-ce40-4a35-911c-bed267b17113" containerName="cinder-api" containerID="cri-o://f586b7458c17be75b61140ec0419ddf37d294472d0c8b62c001ca393046fad04" gracePeriod=30 Mar 16 16:46:20 crc kubenswrapper[5120]: I0316 16:46:20.384191 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openstack-kuttl-tests/cinder-api-0" podUID="21c25ad9-ce40-4a35-911c-bed267b17113" containerName="cinder-api" probeResult="failure" output="Get \"http://10.217.1.167:8776/healthcheck\": EOF" Mar 16 16:46:20 crc kubenswrapper[5120]: I0316 16:46:20.385327 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/cinder-api-0" podUID="21c25ad9-ce40-4a35-911c-bed267b17113" containerName="cinder-api" probeResult="failure" output="Get \"http://10.217.1.167:8776/healthcheck\": EOF" Mar 16 16:46:20 crc kubenswrapper[5120]: I0316 16:46:20.685679 5120 generic.go:358] "Generic (PLEG): container finished" podID="21c25ad9-ce40-4a35-911c-bed267b17113" containerID="41490435f5073420f991ba6106d2149c017f85bfdca66a0675331966b235256a" exitCode=143 Mar 16 16:46:20 crc kubenswrapper[5120]: I0316 16:46:20.685985 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"21c25ad9-ce40-4a35-911c-bed267b17113","Type":"ContainerDied","Data":"41490435f5073420f991ba6106d2149c017f85bfdca66a0675331966b235256a"} Mar 16 16:46:20 crc kubenswrapper[5120]: I0316 16:46:20.688347 5120 generic.go:358] "Generic (PLEG): container finished" podID="2cb227a9-f8ad-4f55-a381-42bcaa8d0e6d" containerID="0f217d3fd94d1e155058e7e6011bf370c2d51eb2b3fab54ee2062a8a37613fda" exitCode=143 Mar 16 16:46:20 crc kubenswrapper[5120]: I0316 16:46:20.688414 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-954498cf-phl8v" event={"ID":"2cb227a9-f8ad-4f55-a381-42bcaa8d0e6d","Type":"ContainerDied","Data":"0f217d3fd94d1e155058e7e6011bf370c2d51eb2b3fab54ee2062a8a37613fda"} Mar 16 16:46:20 crc kubenswrapper[5120]: I0316 16:46:20.688921 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="fdf65609-0eb4-41e2-8750-13e175eca797" containerName="cinder-scheduler" containerID="cri-o://40223a2e27f4ad88290330f81a22a6890349c410cd07220da79ab860c0261a68" gracePeriod=30 Mar 16 16:46:20 crc kubenswrapper[5120]: I0316 16:46:20.689068 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="fdf65609-0eb4-41e2-8750-13e175eca797" containerName="probe" containerID="cri-o://c54f65d70a57c77007f97f8b1a0ef5f2e3668a5a7e597763fa7b165f3080e974" gracePeriod=30 Mar 16 16:46:21 crc kubenswrapper[5120]: I0316 16:46:21.700334 5120 generic.go:358] "Generic (PLEG): container finished" podID="fdf65609-0eb4-41e2-8750-13e175eca797" containerID="c54f65d70a57c77007f97f8b1a0ef5f2e3668a5a7e597763fa7b165f3080e974" exitCode=0 Mar 16 16:46:21 crc kubenswrapper[5120]: I0316 16:46:21.700413 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"fdf65609-0eb4-41e2-8750-13e175eca797","Type":"ContainerDied","Data":"c54f65d70a57c77007f97f8b1a0ef5f2e3668a5a7e597763fa7b165f3080e974"} Mar 16 16:46:22 crc kubenswrapper[5120]: I0316 16:46:22.712643 5120 generic.go:358] "Generic (PLEG): container finished" podID="fdf65609-0eb4-41e2-8750-13e175eca797" containerID="40223a2e27f4ad88290330f81a22a6890349c410cd07220da79ab860c0261a68" exitCode=0 Mar 16 16:46:22 crc kubenswrapper[5120]: I0316 16:46:22.713225 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"fdf65609-0eb4-41e2-8750-13e175eca797","Type":"ContainerDied","Data":"40223a2e27f4ad88290330f81a22a6890349c410cd07220da79ab860c0261a68"} Mar 16 16:46:22 crc kubenswrapper[5120]: I0316 16:46:22.717007 5120 generic.go:358] "Generic (PLEG): container finished" podID="9259fe9e-b8ac-4419-a121-b51b0b3916e4" containerID="9a4f01458ca26dbbbe15024176ef0c7a21cde99cbadf5bd66dfb71f1a4761a24" exitCode=0 Mar 16 16:46:22 crc kubenswrapper[5120]: I0316 16:46:22.717040 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"9259fe9e-b8ac-4419-a121-b51b0b3916e4","Type":"ContainerDied","Data":"9a4f01458ca26dbbbe15024176ef0c7a21cde99cbadf5bd66dfb71f1a4761a24"} Mar 16 16:46:23 crc kubenswrapper[5120]: I0316 16:46:23.094349 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:46:23 crc kubenswrapper[5120]: I0316 16:46:23.105582 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:46:23 crc kubenswrapper[5120]: I0316 16:46:23.256346 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fdf65609-0eb4-41e2-8750-13e175eca797-combined-ca-bundle\") pod \"fdf65609-0eb4-41e2-8750-13e175eca797\" (UID: \"fdf65609-0eb4-41e2-8750-13e175eca797\") " Mar 16 16:46:23 crc kubenswrapper[5120]: I0316 16:46:23.256521 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9259fe9e-b8ac-4419-a121-b51b0b3916e4-scripts\") pod \"9259fe9e-b8ac-4419-a121-b51b0b3916e4\" (UID: \"9259fe9e-b8ac-4419-a121-b51b0b3916e4\") " Mar 16 16:46:23 crc kubenswrapper[5120]: I0316 16:46:23.256612 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/fdf65609-0eb4-41e2-8750-13e175eca797-etc-machine-id\") pod \"fdf65609-0eb4-41e2-8750-13e175eca797\" (UID: \"fdf65609-0eb4-41e2-8750-13e175eca797\") " Mar 16 16:46:23 crc kubenswrapper[5120]: I0316 16:46:23.256668 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/fdf65609-0eb4-41e2-8750-13e175eca797-config-data-custom\") pod \"fdf65609-0eb4-41e2-8750-13e175eca797\" (UID: \"fdf65609-0eb4-41e2-8750-13e175eca797\") " Mar 16 16:46:23 crc kubenswrapper[5120]: I0316 16:46:23.256719 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/fdf65609-0eb4-41e2-8750-13e175eca797-scripts\") pod \"fdf65609-0eb4-41e2-8750-13e175eca797\" (UID: \"fdf65609-0eb4-41e2-8750-13e175eca797\") " Mar 16 16:46:23 crc kubenswrapper[5120]: I0316 16:46:23.256755 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/9259fe9e-b8ac-4419-a121-b51b0b3916e4-run-httpd\") pod \"9259fe9e-b8ac-4419-a121-b51b0b3916e4\" (UID: \"9259fe9e-b8ac-4419-a121-b51b0b3916e4\") " Mar 16 16:46:23 crc kubenswrapper[5120]: I0316 16:46:23.256798 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/fdf65609-0eb4-41e2-8750-13e175eca797-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "fdf65609-0eb4-41e2-8750-13e175eca797" (UID: "fdf65609-0eb4-41e2-8750-13e175eca797"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 16:46:23 crc kubenswrapper[5120]: I0316 16:46:23.257224 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9259fe9e-b8ac-4419-a121-b51b0b3916e4-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "9259fe9e-b8ac-4419-a121-b51b0b3916e4" (UID: "9259fe9e-b8ac-4419-a121-b51b0b3916e4"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:46:23 crc kubenswrapper[5120]: I0316 16:46:23.257273 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rb4dt\" (UniqueName: \"kubernetes.io/projected/9259fe9e-b8ac-4419-a121-b51b0b3916e4-kube-api-access-rb4dt\") pod \"9259fe9e-b8ac-4419-a121-b51b0b3916e4\" (UID: \"9259fe9e-b8ac-4419-a121-b51b0b3916e4\") " Mar 16 16:46:23 crc kubenswrapper[5120]: I0316 16:46:23.257300 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9259fe9e-b8ac-4419-a121-b51b0b3916e4-combined-ca-bundle\") pod \"9259fe9e-b8ac-4419-a121-b51b0b3916e4\" (UID: \"9259fe9e-b8ac-4419-a121-b51b0b3916e4\") " Mar 16 16:46:23 crc kubenswrapper[5120]: I0316 16:46:23.257720 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/9259fe9e-b8ac-4419-a121-b51b0b3916e4-sg-core-conf-yaml\") pod \"9259fe9e-b8ac-4419-a121-b51b0b3916e4\" (UID: \"9259fe9e-b8ac-4419-a121-b51b0b3916e4\") " Mar 16 16:46:23 crc kubenswrapper[5120]: I0316 16:46:23.257985 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9259fe9e-b8ac-4419-a121-b51b0b3916e4-config-data\") pod \"9259fe9e-b8ac-4419-a121-b51b0b3916e4\" (UID: \"9259fe9e-b8ac-4419-a121-b51b0b3916e4\") " Mar 16 16:46:23 crc kubenswrapper[5120]: I0316 16:46:23.258126 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/9259fe9e-b8ac-4419-a121-b51b0b3916e4-log-httpd\") pod \"9259fe9e-b8ac-4419-a121-b51b0b3916e4\" (UID: \"9259fe9e-b8ac-4419-a121-b51b0b3916e4\") " Mar 16 16:46:23 crc kubenswrapper[5120]: I0316 16:46:23.258546 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fdf65609-0eb4-41e2-8750-13e175eca797-config-data\") pod \"fdf65609-0eb4-41e2-8750-13e175eca797\" (UID: \"fdf65609-0eb4-41e2-8750-13e175eca797\") " Mar 16 16:46:23 crc kubenswrapper[5120]: I0316 16:46:23.258572 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wffpv\" (UniqueName: \"kubernetes.io/projected/fdf65609-0eb4-41e2-8750-13e175eca797-kube-api-access-wffpv\") pod \"fdf65609-0eb4-41e2-8750-13e175eca797\" (UID: \"fdf65609-0eb4-41e2-8750-13e175eca797\") " Mar 16 16:46:23 crc kubenswrapper[5120]: I0316 16:46:23.258945 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9259fe9e-b8ac-4419-a121-b51b0b3916e4-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "9259fe9e-b8ac-4419-a121-b51b0b3916e4" (UID: "9259fe9e-b8ac-4419-a121-b51b0b3916e4"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:46:23 crc kubenswrapper[5120]: I0316 16:46:23.259572 5120 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/fdf65609-0eb4-41e2-8750-13e175eca797-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 16:46:23 crc kubenswrapper[5120]: I0316 16:46:23.259602 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/9259fe9e-b8ac-4419-a121-b51b0b3916e4-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:46:23 crc kubenswrapper[5120]: I0316 16:46:23.259614 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/9259fe9e-b8ac-4419-a121-b51b0b3916e4-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:46:23 crc kubenswrapper[5120]: I0316 16:46:23.262498 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9259fe9e-b8ac-4419-a121-b51b0b3916e4-scripts" (OuterVolumeSpecName: "scripts") pod "9259fe9e-b8ac-4419-a121-b51b0b3916e4" (UID: "9259fe9e-b8ac-4419-a121-b51b0b3916e4"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:46:23 crc kubenswrapper[5120]: I0316 16:46:23.262981 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fdf65609-0eb4-41e2-8750-13e175eca797-scripts" (OuterVolumeSpecName: "scripts") pod "fdf65609-0eb4-41e2-8750-13e175eca797" (UID: "fdf65609-0eb4-41e2-8750-13e175eca797"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:46:23 crc kubenswrapper[5120]: I0316 16:46:23.263214 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9259fe9e-b8ac-4419-a121-b51b0b3916e4-kube-api-access-rb4dt" (OuterVolumeSpecName: "kube-api-access-rb4dt") pod "9259fe9e-b8ac-4419-a121-b51b0b3916e4" (UID: "9259fe9e-b8ac-4419-a121-b51b0b3916e4"). InnerVolumeSpecName "kube-api-access-rb4dt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:46:23 crc kubenswrapper[5120]: I0316 16:46:23.268042 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fdf65609-0eb4-41e2-8750-13e175eca797-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "fdf65609-0eb4-41e2-8750-13e175eca797" (UID: "fdf65609-0eb4-41e2-8750-13e175eca797"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:46:23 crc kubenswrapper[5120]: I0316 16:46:23.283694 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fdf65609-0eb4-41e2-8750-13e175eca797-kube-api-access-wffpv" (OuterVolumeSpecName: "kube-api-access-wffpv") pod "fdf65609-0eb4-41e2-8750-13e175eca797" (UID: "fdf65609-0eb4-41e2-8750-13e175eca797"). InnerVolumeSpecName "kube-api-access-wffpv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:46:23 crc kubenswrapper[5120]: I0316 16:46:23.298947 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9259fe9e-b8ac-4419-a121-b51b0b3916e4-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "9259fe9e-b8ac-4419-a121-b51b0b3916e4" (UID: "9259fe9e-b8ac-4419-a121-b51b0b3916e4"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:46:23 crc kubenswrapper[5120]: I0316 16:46:23.315446 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fdf65609-0eb4-41e2-8750-13e175eca797-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "fdf65609-0eb4-41e2-8750-13e175eca797" (UID: "fdf65609-0eb4-41e2-8750-13e175eca797"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:46:23 crc kubenswrapper[5120]: I0316 16:46:23.351745 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9259fe9e-b8ac-4419-a121-b51b0b3916e4-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "9259fe9e-b8ac-4419-a121-b51b0b3916e4" (UID: "9259fe9e-b8ac-4419-a121-b51b0b3916e4"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:46:23 crc kubenswrapper[5120]: I0316 16:46:23.359945 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9259fe9e-b8ac-4419-a121-b51b0b3916e4-config-data" (OuterVolumeSpecName: "config-data") pod "9259fe9e-b8ac-4419-a121-b51b0b3916e4" (UID: "9259fe9e-b8ac-4419-a121-b51b0b3916e4"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:46:23 crc kubenswrapper[5120]: I0316 16:46:23.360872 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9259fe9e-b8ac-4419-a121-b51b0b3916e4-config-data\") pod \"9259fe9e-b8ac-4419-a121-b51b0b3916e4\" (UID: \"9259fe9e-b8ac-4419-a121-b51b0b3916e4\") " Mar 16 16:46:23 crc kubenswrapper[5120]: W0316 16:46:23.361046 5120 empty_dir.go:511] Warning: Unmount skipped because path does not exist: /var/lib/kubelet/pods/9259fe9e-b8ac-4419-a121-b51b0b3916e4/volumes/kubernetes.io~secret/config-data Mar 16 16:46:23 crc kubenswrapper[5120]: I0316 16:46:23.361079 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9259fe9e-b8ac-4419-a121-b51b0b3916e4-config-data" (OuterVolumeSpecName: "config-data") pod "9259fe9e-b8ac-4419-a121-b51b0b3916e4" (UID: "9259fe9e-b8ac-4419-a121-b51b0b3916e4"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:46:23 crc kubenswrapper[5120]: I0316 16:46:23.361908 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fdf65609-0eb4-41e2-8750-13e175eca797-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:46:23 crc kubenswrapper[5120]: I0316 16:46:23.361932 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9259fe9e-b8ac-4419-a121-b51b0b3916e4-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:46:23 crc kubenswrapper[5120]: I0316 16:46:23.361943 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/fdf65609-0eb4-41e2-8750-13e175eca797-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:46:23 crc kubenswrapper[5120]: I0316 16:46:23.361955 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/fdf65609-0eb4-41e2-8750-13e175eca797-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:46:23 crc kubenswrapper[5120]: I0316 16:46:23.361966 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rb4dt\" (UniqueName: \"kubernetes.io/projected/9259fe9e-b8ac-4419-a121-b51b0b3916e4-kube-api-access-rb4dt\") on node \"crc\" DevicePath \"\"" Mar 16 16:46:23 crc kubenswrapper[5120]: I0316 16:46:23.361978 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9259fe9e-b8ac-4419-a121-b51b0b3916e4-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:46:23 crc kubenswrapper[5120]: I0316 16:46:23.361986 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/9259fe9e-b8ac-4419-a121-b51b0b3916e4-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 16:46:23 crc kubenswrapper[5120]: I0316 16:46:23.361994 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9259fe9e-b8ac-4419-a121-b51b0b3916e4-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:46:23 crc kubenswrapper[5120]: I0316 16:46:23.362003 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wffpv\" (UniqueName: \"kubernetes.io/projected/fdf65609-0eb4-41e2-8750-13e175eca797-kube-api-access-wffpv\") on node \"crc\" DevicePath \"\"" Mar 16 16:46:23 crc kubenswrapper[5120]: I0316 16:46:23.380328 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fdf65609-0eb4-41e2-8750-13e175eca797-config-data" (OuterVolumeSpecName: "config-data") pod "fdf65609-0eb4-41e2-8750-13e175eca797" (UID: "fdf65609-0eb4-41e2-8750-13e175eca797"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:46:23 crc kubenswrapper[5120]: I0316 16:46:23.464309 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fdf65609-0eb4-41e2-8750-13e175eca797-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:46:23 crc kubenswrapper[5120]: I0316 16:46:23.734655 5120 generic.go:358] "Generic (PLEG): container finished" podID="2cb227a9-f8ad-4f55-a381-42bcaa8d0e6d" containerID="4f7f82ca8e1a4a0957dba075673975af65961420c6af1aeb6b6bcd73c7fea190" exitCode=0 Mar 16 16:46:23 crc kubenswrapper[5120]: I0316 16:46:23.735197 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-954498cf-phl8v" event={"ID":"2cb227a9-f8ad-4f55-a381-42bcaa8d0e6d","Type":"ContainerDied","Data":"4f7f82ca8e1a4a0957dba075673975af65961420c6af1aeb6b6bcd73c7fea190"} Mar 16 16:46:23 crc kubenswrapper[5120]: I0316 16:46:23.739344 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"9259fe9e-b8ac-4419-a121-b51b0b3916e4","Type":"ContainerDied","Data":"dde480787a6338cfa8c8e6b68dd4be6300087ecbba8f8c64ee6939a269aeb634"} Mar 16 16:46:23 crc kubenswrapper[5120]: I0316 16:46:23.739446 5120 scope.go:117] "RemoveContainer" containerID="90a00282b842a2cce608b3e9d8bf71cc5604e903a51cde201ce4727099efd55e" Mar 16 16:46:23 crc kubenswrapper[5120]: I0316 16:46:23.739704 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:46:23 crc kubenswrapper[5120]: I0316 16:46:23.748253 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:46:23 crc kubenswrapper[5120]: I0316 16:46:23.748248 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"fdf65609-0eb4-41e2-8750-13e175eca797","Type":"ContainerDied","Data":"7181880fedd54602177bfaa8007b6027e6e719bf11a3d2ee03506368c29aa1f1"} Mar 16 16:46:23 crc kubenswrapper[5120]: I0316 16:46:23.754220 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-5557b6754b-qz56v" Mar 16 16:46:23 crc kubenswrapper[5120]: I0316 16:46:23.762032 5120 generic.go:358] "Generic (PLEG): container finished" podID="212dc541-58a2-45d9-97bf-c566530e09da" containerID="b5a8e25af29663b0e92ce6455221395d411176d4e0eaba6d4a9f1c247a698247" exitCode=0 Mar 16 16:46:23 crc kubenswrapper[5120]: I0316 16:46:23.762141 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-5557b6754b-qz56v" event={"ID":"212dc541-58a2-45d9-97bf-c566530e09da","Type":"ContainerDied","Data":"b5a8e25af29663b0e92ce6455221395d411176d4e0eaba6d4a9f1c247a698247"} Mar 16 16:46:23 crc kubenswrapper[5120]: I0316 16:46:23.762198 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-5557b6754b-qz56v" event={"ID":"212dc541-58a2-45d9-97bf-c566530e09da","Type":"ContainerDied","Data":"70b990c3026dbb904d0e75574885e41f7a85f0f23bfc3d8e589c4f0b53db5ef8"} Mar 16 16:46:23 crc kubenswrapper[5120]: I0316 16:46:23.767110 5120 scope.go:117] "RemoveContainer" containerID="41b124cd4bd6e249658c5e31609d126a411aaf2a7bb739d7c0b64c0c0d12b50d" Mar 16 16:46:23 crc kubenswrapper[5120]: I0316 16:46:23.832578 5120 scope.go:117] "RemoveContainer" containerID="9a4f01458ca26dbbbe15024176ef0c7a21cde99cbadf5bd66dfb71f1a4761a24" Mar 16 16:46:23 crc kubenswrapper[5120]: I0316 16:46:23.892462 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/212dc541-58a2-45d9-97bf-c566530e09da-config-data-custom\") pod \"212dc541-58a2-45d9-97bf-c566530e09da\" (UID: \"212dc541-58a2-45d9-97bf-c566530e09da\") " Mar 16 16:46:23 crc kubenswrapper[5120]: I0316 16:46:23.892522 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/212dc541-58a2-45d9-97bf-c566530e09da-combined-ca-bundle\") pod \"212dc541-58a2-45d9-97bf-c566530e09da\" (UID: \"212dc541-58a2-45d9-97bf-c566530e09da\") " Mar 16 16:46:23 crc kubenswrapper[5120]: I0316 16:46:23.893539 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/212dc541-58a2-45d9-97bf-c566530e09da-config-data\") pod \"212dc541-58a2-45d9-97bf-c566530e09da\" (UID: \"212dc541-58a2-45d9-97bf-c566530e09da\") " Mar 16 16:46:23 crc kubenswrapper[5120]: I0316 16:46:23.893614 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/212dc541-58a2-45d9-97bf-c566530e09da-logs\") pod \"212dc541-58a2-45d9-97bf-c566530e09da\" (UID: \"212dc541-58a2-45d9-97bf-c566530e09da\") " Mar 16 16:46:23 crc kubenswrapper[5120]: I0316 16:46:23.894755 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/212dc541-58a2-45d9-97bf-c566530e09da-logs" (OuterVolumeSpecName: "logs") pod "212dc541-58a2-45d9-97bf-c566530e09da" (UID: "212dc541-58a2-45d9-97bf-c566530e09da"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:46:23 crc kubenswrapper[5120]: I0316 16:46:23.899387 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/212dc541-58a2-45d9-97bf-c566530e09da-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "212dc541-58a2-45d9-97bf-c566530e09da" (UID: "212dc541-58a2-45d9-97bf-c566530e09da"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:46:23 crc kubenswrapper[5120]: I0316 16:46:23.899550 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sddgz\" (UniqueName: \"kubernetes.io/projected/212dc541-58a2-45d9-97bf-c566530e09da-kube-api-access-sddgz\") pod \"212dc541-58a2-45d9-97bf-c566530e09da\" (UID: \"212dc541-58a2-45d9-97bf-c566530e09da\") " Mar 16 16:46:23 crc kubenswrapper[5120]: I0316 16:46:23.900853 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/212dc541-58a2-45d9-97bf-c566530e09da-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:46:23 crc kubenswrapper[5120]: I0316 16:46:23.900872 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/212dc541-58a2-45d9-97bf-c566530e09da-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:46:23 crc kubenswrapper[5120]: I0316 16:46:23.906315 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/212dc541-58a2-45d9-97bf-c566530e09da-kube-api-access-sddgz" (OuterVolumeSpecName: "kube-api-access-sddgz") pod "212dc541-58a2-45d9-97bf-c566530e09da" (UID: "212dc541-58a2-45d9-97bf-c566530e09da"). InnerVolumeSpecName "kube-api-access-sddgz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:46:23 crc kubenswrapper[5120]: I0316 16:46:23.907196 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:46:23 crc kubenswrapper[5120]: I0316 16:46:23.931373 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/212dc541-58a2-45d9-97bf-c566530e09da-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "212dc541-58a2-45d9-97bf-c566530e09da" (UID: "212dc541-58a2-45d9-97bf-c566530e09da"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:46:23 crc kubenswrapper[5120]: I0316 16:46:23.931468 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:46:23 crc kubenswrapper[5120]: I0316 16:46:23.942000 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:46:23 crc kubenswrapper[5120]: I0316 16:46:23.956495 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-954498cf-phl8v" Mar 16 16:46:23 crc kubenswrapper[5120]: I0316 16:46:23.962032 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:46:23 crc kubenswrapper[5120]: I0316 16:46:23.966566 5120 scope.go:117] "RemoveContainer" containerID="e58e09571e92dd362e7bb6d4f218a78ec9d72cbc97af4b4a2df448feffc01fd9" Mar 16 16:46:23 crc kubenswrapper[5120]: I0316 16:46:23.969164 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/212dc541-58a2-45d9-97bf-c566530e09da-config-data" (OuterVolumeSpecName: "config-data") pod "212dc541-58a2-45d9-97bf-c566530e09da" (UID: "212dc541-58a2-45d9-97bf-c566530e09da"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:46:23 crc kubenswrapper[5120]: I0316 16:46:23.977263 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:46:23 crc kubenswrapper[5120]: I0316 16:46:23.978787 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="212dc541-58a2-45d9-97bf-c566530e09da" containerName="barbican-keystone-listener-log" Mar 16 16:46:23 crc kubenswrapper[5120]: I0316 16:46:23.978809 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="212dc541-58a2-45d9-97bf-c566530e09da" containerName="barbican-keystone-listener-log" Mar 16 16:46:23 crc kubenswrapper[5120]: I0316 16:46:23.978823 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9259fe9e-b8ac-4419-a121-b51b0b3916e4" containerName="proxy-httpd" Mar 16 16:46:23 crc kubenswrapper[5120]: I0316 16:46:23.978829 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9259fe9e-b8ac-4419-a121-b51b0b3916e4" containerName="proxy-httpd" Mar 16 16:46:23 crc kubenswrapper[5120]: I0316 16:46:23.978844 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9259fe9e-b8ac-4419-a121-b51b0b3916e4" containerName="ceilometer-notification-agent" Mar 16 16:46:23 crc kubenswrapper[5120]: I0316 16:46:23.978856 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9259fe9e-b8ac-4419-a121-b51b0b3916e4" containerName="ceilometer-notification-agent" Mar 16 16:46:23 crc kubenswrapper[5120]: I0316 16:46:23.978867 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2cb227a9-f8ad-4f55-a381-42bcaa8d0e6d" containerName="barbican-worker-log" Mar 16 16:46:23 crc kubenswrapper[5120]: I0316 16:46:23.978873 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="2cb227a9-f8ad-4f55-a381-42bcaa8d0e6d" containerName="barbican-worker-log" Mar 16 16:46:23 crc kubenswrapper[5120]: I0316 16:46:23.978893 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fdf65609-0eb4-41e2-8750-13e175eca797" containerName="probe" Mar 16 16:46:23 crc kubenswrapper[5120]: I0316 16:46:23.978900 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="fdf65609-0eb4-41e2-8750-13e175eca797" containerName="probe" Mar 16 16:46:23 crc kubenswrapper[5120]: I0316 16:46:23.978912 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9259fe9e-b8ac-4419-a121-b51b0b3916e4" containerName="sg-core" Mar 16 16:46:23 crc kubenswrapper[5120]: I0316 16:46:23.978919 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9259fe9e-b8ac-4419-a121-b51b0b3916e4" containerName="sg-core" Mar 16 16:46:23 crc kubenswrapper[5120]: I0316 16:46:23.978944 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2cb227a9-f8ad-4f55-a381-42bcaa8d0e6d" containerName="barbican-worker" Mar 16 16:46:23 crc kubenswrapper[5120]: I0316 16:46:23.978952 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="2cb227a9-f8ad-4f55-a381-42bcaa8d0e6d" containerName="barbican-worker" Mar 16 16:46:23 crc kubenswrapper[5120]: I0316 16:46:23.978977 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fdf65609-0eb4-41e2-8750-13e175eca797" containerName="cinder-scheduler" Mar 16 16:46:23 crc kubenswrapper[5120]: I0316 16:46:23.978985 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="fdf65609-0eb4-41e2-8750-13e175eca797" containerName="cinder-scheduler" Mar 16 16:46:23 crc kubenswrapper[5120]: I0316 16:46:23.979048 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9259fe9e-b8ac-4419-a121-b51b0b3916e4" containerName="ceilometer-central-agent" Mar 16 16:46:23 crc kubenswrapper[5120]: I0316 16:46:23.979080 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9259fe9e-b8ac-4419-a121-b51b0b3916e4" containerName="ceilometer-central-agent" Mar 16 16:46:23 crc kubenswrapper[5120]: I0316 16:46:23.979110 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="212dc541-58a2-45d9-97bf-c566530e09da" containerName="barbican-keystone-listener" Mar 16 16:46:23 crc kubenswrapper[5120]: I0316 16:46:23.979116 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="212dc541-58a2-45d9-97bf-c566530e09da" containerName="barbican-keystone-listener" Mar 16 16:46:23 crc kubenswrapper[5120]: I0316 16:46:23.979318 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="9259fe9e-b8ac-4419-a121-b51b0b3916e4" containerName="ceilometer-notification-agent" Mar 16 16:46:23 crc kubenswrapper[5120]: I0316 16:46:23.979339 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="9259fe9e-b8ac-4419-a121-b51b0b3916e4" containerName="proxy-httpd" Mar 16 16:46:23 crc kubenswrapper[5120]: I0316 16:46:23.979351 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="2cb227a9-f8ad-4f55-a381-42bcaa8d0e6d" containerName="barbican-worker" Mar 16 16:46:23 crc kubenswrapper[5120]: I0316 16:46:23.979365 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="9259fe9e-b8ac-4419-a121-b51b0b3916e4" containerName="sg-core" Mar 16 16:46:23 crc kubenswrapper[5120]: I0316 16:46:23.979372 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="fdf65609-0eb4-41e2-8750-13e175eca797" containerName="probe" Mar 16 16:46:23 crc kubenswrapper[5120]: I0316 16:46:23.979385 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="fdf65609-0eb4-41e2-8750-13e175eca797" containerName="cinder-scheduler" Mar 16 16:46:23 crc kubenswrapper[5120]: I0316 16:46:23.979397 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="212dc541-58a2-45d9-97bf-c566530e09da" containerName="barbican-keystone-listener-log" Mar 16 16:46:23 crc kubenswrapper[5120]: I0316 16:46:23.979411 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="212dc541-58a2-45d9-97bf-c566530e09da" containerName="barbican-keystone-listener" Mar 16 16:46:23 crc kubenswrapper[5120]: I0316 16:46:23.979423 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="9259fe9e-b8ac-4419-a121-b51b0b3916e4" containerName="ceilometer-central-agent" Mar 16 16:46:23 crc kubenswrapper[5120]: I0316 16:46:23.979454 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="2cb227a9-f8ad-4f55-a381-42bcaa8d0e6d" containerName="barbican-worker-log" Mar 16 16:46:23 crc kubenswrapper[5120]: I0316 16:46:23.990698 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:46:23 crc kubenswrapper[5120]: I0316 16:46:23.990886 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:46:23 crc kubenswrapper[5120]: I0316 16:46:23.993912 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:46:23 crc kubenswrapper[5120]: I0316 16:46:23.996604 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-scheduler-config-data\"" Mar 16 16:46:24 crc kubenswrapper[5120]: I0316 16:46:24.002656 5120 scope.go:117] "RemoveContainer" containerID="c54f65d70a57c77007f97f8b1a0ef5f2e3668a5a7e597763fa7b165f3080e974" Mar 16 16:46:24 crc kubenswrapper[5120]: I0316 16:46:24.003799 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sddgz\" (UniqueName: \"kubernetes.io/projected/212dc541-58a2-45d9-97bf-c566530e09da-kube-api-access-sddgz\") on node \"crc\" DevicePath \"\"" Mar 16 16:46:24 crc kubenswrapper[5120]: I0316 16:46:24.003826 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/212dc541-58a2-45d9-97bf-c566530e09da-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:46:24 crc kubenswrapper[5120]: I0316 16:46:24.003836 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/212dc541-58a2-45d9-97bf-c566530e09da-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:46:24 crc kubenswrapper[5120]: I0316 16:46:24.005267 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:46:24 crc kubenswrapper[5120]: I0316 16:46:24.005422 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:46:24 crc kubenswrapper[5120]: I0316 16:46:24.010467 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 16:46:24 crc kubenswrapper[5120]: I0316 16:46:24.012985 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 16:46:24 crc kubenswrapper[5120]: I0316 16:46:24.056941 5120 scope.go:117] "RemoveContainer" containerID="40223a2e27f4ad88290330f81a22a6890349c410cd07220da79ab860c0261a68" Mar 16 16:46:24 crc kubenswrapper[5120]: I0316 16:46:24.090438 5120 scope.go:117] "RemoveContainer" containerID="b5a8e25af29663b0e92ce6455221395d411176d4e0eaba6d4a9f1c247a698247" Mar 16 16:46:24 crc kubenswrapper[5120]: I0316 16:46:24.104645 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/2cb227a9-f8ad-4f55-a381-42bcaa8d0e6d-config-data-custom\") pod \"2cb227a9-f8ad-4f55-a381-42bcaa8d0e6d\" (UID: \"2cb227a9-f8ad-4f55-a381-42bcaa8d0e6d\") " Mar 16 16:46:24 crc kubenswrapper[5120]: I0316 16:46:24.104828 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2cb227a9-f8ad-4f55-a381-42bcaa8d0e6d-config-data\") pod \"2cb227a9-f8ad-4f55-a381-42bcaa8d0e6d\" (UID: \"2cb227a9-f8ad-4f55-a381-42bcaa8d0e6d\") " Mar 16 16:46:24 crc kubenswrapper[5120]: I0316 16:46:24.104982 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2cb227a9-f8ad-4f55-a381-42bcaa8d0e6d-logs\") pod \"2cb227a9-f8ad-4f55-a381-42bcaa8d0e6d\" (UID: \"2cb227a9-f8ad-4f55-a381-42bcaa8d0e6d\") " Mar 16 16:46:24 crc kubenswrapper[5120]: I0316 16:46:24.105035 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2cb227a9-f8ad-4f55-a381-42bcaa8d0e6d-combined-ca-bundle\") pod \"2cb227a9-f8ad-4f55-a381-42bcaa8d0e6d\" (UID: \"2cb227a9-f8ad-4f55-a381-42bcaa8d0e6d\") " Mar 16 16:46:24 crc kubenswrapper[5120]: I0316 16:46:24.105137 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jthmg\" (UniqueName: \"kubernetes.io/projected/2cb227a9-f8ad-4f55-a381-42bcaa8d0e6d-kube-api-access-jthmg\") pod \"2cb227a9-f8ad-4f55-a381-42bcaa8d0e6d\" (UID: \"2cb227a9-f8ad-4f55-a381-42bcaa8d0e6d\") " Mar 16 16:46:24 crc kubenswrapper[5120]: I0316 16:46:24.105484 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/69041368-3d55-45dc-82b1-6880eff4c75f-config-data\") pod \"ceilometer-0\" (UID: \"69041368-3d55-45dc-82b1-6880eff4c75f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:46:24 crc kubenswrapper[5120]: I0316 16:46:24.105522 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/69041368-3d55-45dc-82b1-6880eff4c75f-scripts\") pod \"ceilometer-0\" (UID: \"69041368-3d55-45dc-82b1-6880eff4c75f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:46:24 crc kubenswrapper[5120]: I0316 16:46:24.105560 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29xzr\" (UniqueName: \"kubernetes.io/projected/69041368-3d55-45dc-82b1-6880eff4c75f-kube-api-access-29xzr\") pod \"ceilometer-0\" (UID: \"69041368-3d55-45dc-82b1-6880eff4c75f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:46:24 crc kubenswrapper[5120]: I0316 16:46:24.105582 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/69041368-3d55-45dc-82b1-6880eff4c75f-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"69041368-3d55-45dc-82b1-6880eff4c75f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:46:24 crc kubenswrapper[5120]: I0316 16:46:24.105669 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/03693dff-f5dd-4199-8cb2-e6f12d5a0703-config-data\") pod \"cinder-scheduler-0\" (UID: \"03693dff-f5dd-4199-8cb2-e6f12d5a0703\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:46:24 crc kubenswrapper[5120]: I0316 16:46:24.105695 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/03693dff-f5dd-4199-8cb2-e6f12d5a0703-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"03693dff-f5dd-4199-8cb2-e6f12d5a0703\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:46:24 crc kubenswrapper[5120]: I0316 16:46:24.105898 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/69041368-3d55-45dc-82b1-6880eff4c75f-run-httpd\") pod \"ceilometer-0\" (UID: \"69041368-3d55-45dc-82b1-6880eff4c75f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:46:24 crc kubenswrapper[5120]: I0316 16:46:24.105984 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/03693dff-f5dd-4199-8cb2-e6f12d5a0703-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"03693dff-f5dd-4199-8cb2-e6f12d5a0703\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:46:24 crc kubenswrapper[5120]: I0316 16:46:24.106014 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/69041368-3d55-45dc-82b1-6880eff4c75f-log-httpd\") pod \"ceilometer-0\" (UID: \"69041368-3d55-45dc-82b1-6880eff4c75f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:46:24 crc kubenswrapper[5120]: I0316 16:46:24.106084 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bd4vt\" (UniqueName: \"kubernetes.io/projected/03693dff-f5dd-4199-8cb2-e6f12d5a0703-kube-api-access-bd4vt\") pod \"cinder-scheduler-0\" (UID: \"03693dff-f5dd-4199-8cb2-e6f12d5a0703\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:46:24 crc kubenswrapper[5120]: I0316 16:46:24.106145 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/69041368-3d55-45dc-82b1-6880eff4c75f-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"69041368-3d55-45dc-82b1-6880eff4c75f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:46:24 crc kubenswrapper[5120]: I0316 16:46:24.106181 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/03693dff-f5dd-4199-8cb2-e6f12d5a0703-scripts\") pod \"cinder-scheduler-0\" (UID: \"03693dff-f5dd-4199-8cb2-e6f12d5a0703\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:46:24 crc kubenswrapper[5120]: I0316 16:46:24.106204 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/03693dff-f5dd-4199-8cb2-e6f12d5a0703-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"03693dff-f5dd-4199-8cb2-e6f12d5a0703\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:46:24 crc kubenswrapper[5120]: I0316 16:46:24.106933 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2cb227a9-f8ad-4f55-a381-42bcaa8d0e6d-logs" (OuterVolumeSpecName: "logs") pod "2cb227a9-f8ad-4f55-a381-42bcaa8d0e6d" (UID: "2cb227a9-f8ad-4f55-a381-42bcaa8d0e6d"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:46:24 crc kubenswrapper[5120]: I0316 16:46:24.110919 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2cb227a9-f8ad-4f55-a381-42bcaa8d0e6d-kube-api-access-jthmg" (OuterVolumeSpecName: "kube-api-access-jthmg") pod "2cb227a9-f8ad-4f55-a381-42bcaa8d0e6d" (UID: "2cb227a9-f8ad-4f55-a381-42bcaa8d0e6d"). InnerVolumeSpecName "kube-api-access-jthmg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:46:24 crc kubenswrapper[5120]: I0316 16:46:24.112144 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2cb227a9-f8ad-4f55-a381-42bcaa8d0e6d-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "2cb227a9-f8ad-4f55-a381-42bcaa8d0e6d" (UID: "2cb227a9-f8ad-4f55-a381-42bcaa8d0e6d"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:46:24 crc kubenswrapper[5120]: I0316 16:46:24.121126 5120 scope.go:117] "RemoveContainer" containerID="415e6f7ee0e108f07f5f3d7faec221ed4234102299dd4517f5a17bf72926ea53" Mar 16 16:46:24 crc kubenswrapper[5120]: I0316 16:46:24.143137 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2cb227a9-f8ad-4f55-a381-42bcaa8d0e6d-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "2cb227a9-f8ad-4f55-a381-42bcaa8d0e6d" (UID: "2cb227a9-f8ad-4f55-a381-42bcaa8d0e6d"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:46:24 crc kubenswrapper[5120]: I0316 16:46:24.157012 5120 scope.go:117] "RemoveContainer" containerID="b5a8e25af29663b0e92ce6455221395d411176d4e0eaba6d4a9f1c247a698247" Mar 16 16:46:24 crc kubenswrapper[5120]: E0316 16:46:24.157925 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b5a8e25af29663b0e92ce6455221395d411176d4e0eaba6d4a9f1c247a698247\": container with ID starting with b5a8e25af29663b0e92ce6455221395d411176d4e0eaba6d4a9f1c247a698247 not found: ID does not exist" containerID="b5a8e25af29663b0e92ce6455221395d411176d4e0eaba6d4a9f1c247a698247" Mar 16 16:46:24 crc kubenswrapper[5120]: I0316 16:46:24.157974 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5a8e25af29663b0e92ce6455221395d411176d4e0eaba6d4a9f1c247a698247"} err="failed to get container status \"b5a8e25af29663b0e92ce6455221395d411176d4e0eaba6d4a9f1c247a698247\": rpc error: code = NotFound desc = could not find container \"b5a8e25af29663b0e92ce6455221395d411176d4e0eaba6d4a9f1c247a698247\": container with ID starting with b5a8e25af29663b0e92ce6455221395d411176d4e0eaba6d4a9f1c247a698247 not found: ID does not exist" Mar 16 16:46:24 crc kubenswrapper[5120]: I0316 16:46:24.158023 5120 scope.go:117] "RemoveContainer" containerID="415e6f7ee0e108f07f5f3d7faec221ed4234102299dd4517f5a17bf72926ea53" Mar 16 16:46:24 crc kubenswrapper[5120]: E0316 16:46:24.158646 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"415e6f7ee0e108f07f5f3d7faec221ed4234102299dd4517f5a17bf72926ea53\": container with ID starting with 415e6f7ee0e108f07f5f3d7faec221ed4234102299dd4517f5a17bf72926ea53 not found: ID does not exist" containerID="415e6f7ee0e108f07f5f3d7faec221ed4234102299dd4517f5a17bf72926ea53" Mar 16 16:46:24 crc kubenswrapper[5120]: I0316 16:46:24.158721 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"415e6f7ee0e108f07f5f3d7faec221ed4234102299dd4517f5a17bf72926ea53"} err="failed to get container status \"415e6f7ee0e108f07f5f3d7faec221ed4234102299dd4517f5a17bf72926ea53\": rpc error: code = NotFound desc = could not find container \"415e6f7ee0e108f07f5f3d7faec221ed4234102299dd4517f5a17bf72926ea53\": container with ID starting with 415e6f7ee0e108f07f5f3d7faec221ed4234102299dd4517f5a17bf72926ea53 not found: ID does not exist" Mar 16 16:46:24 crc kubenswrapper[5120]: I0316 16:46:24.167815 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2cb227a9-f8ad-4f55-a381-42bcaa8d0e6d-config-data" (OuterVolumeSpecName: "config-data") pod "2cb227a9-f8ad-4f55-a381-42bcaa8d0e6d" (UID: "2cb227a9-f8ad-4f55-a381-42bcaa8d0e6d"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:46:24 crc kubenswrapper[5120]: I0316 16:46:24.209227 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/69041368-3d55-45dc-82b1-6880eff4c75f-config-data\") pod \"ceilometer-0\" (UID: \"69041368-3d55-45dc-82b1-6880eff4c75f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:46:24 crc kubenswrapper[5120]: I0316 16:46:24.209337 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/69041368-3d55-45dc-82b1-6880eff4c75f-scripts\") pod \"ceilometer-0\" (UID: \"69041368-3d55-45dc-82b1-6880eff4c75f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:46:24 crc kubenswrapper[5120]: I0316 16:46:24.209386 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-29xzr\" (UniqueName: \"kubernetes.io/projected/69041368-3d55-45dc-82b1-6880eff4c75f-kube-api-access-29xzr\") pod \"ceilometer-0\" (UID: \"69041368-3d55-45dc-82b1-6880eff4c75f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:46:24 crc kubenswrapper[5120]: I0316 16:46:24.209410 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/69041368-3d55-45dc-82b1-6880eff4c75f-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"69041368-3d55-45dc-82b1-6880eff4c75f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:46:24 crc kubenswrapper[5120]: I0316 16:46:24.209508 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/03693dff-f5dd-4199-8cb2-e6f12d5a0703-config-data\") pod \"cinder-scheduler-0\" (UID: \"03693dff-f5dd-4199-8cb2-e6f12d5a0703\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:46:24 crc kubenswrapper[5120]: I0316 16:46:24.209559 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/03693dff-f5dd-4199-8cb2-e6f12d5a0703-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"03693dff-f5dd-4199-8cb2-e6f12d5a0703\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:46:24 crc kubenswrapper[5120]: I0316 16:46:24.209642 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/69041368-3d55-45dc-82b1-6880eff4c75f-run-httpd\") pod \"ceilometer-0\" (UID: \"69041368-3d55-45dc-82b1-6880eff4c75f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:46:24 crc kubenswrapper[5120]: I0316 16:46:24.209719 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/03693dff-f5dd-4199-8cb2-e6f12d5a0703-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"03693dff-f5dd-4199-8cb2-e6f12d5a0703\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:46:24 crc kubenswrapper[5120]: I0316 16:46:24.209755 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/69041368-3d55-45dc-82b1-6880eff4c75f-log-httpd\") pod \"ceilometer-0\" (UID: \"69041368-3d55-45dc-82b1-6880eff4c75f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:46:24 crc kubenswrapper[5120]: I0316 16:46:24.209835 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bd4vt\" (UniqueName: \"kubernetes.io/projected/03693dff-f5dd-4199-8cb2-e6f12d5a0703-kube-api-access-bd4vt\") pod \"cinder-scheduler-0\" (UID: \"03693dff-f5dd-4199-8cb2-e6f12d5a0703\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:46:24 crc kubenswrapper[5120]: I0316 16:46:24.209908 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/69041368-3d55-45dc-82b1-6880eff4c75f-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"69041368-3d55-45dc-82b1-6880eff4c75f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:46:24 crc kubenswrapper[5120]: I0316 16:46:24.209950 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/03693dff-f5dd-4199-8cb2-e6f12d5a0703-scripts\") pod \"cinder-scheduler-0\" (UID: \"03693dff-f5dd-4199-8cb2-e6f12d5a0703\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:46:24 crc kubenswrapper[5120]: I0316 16:46:24.209985 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/03693dff-f5dd-4199-8cb2-e6f12d5a0703-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"03693dff-f5dd-4199-8cb2-e6f12d5a0703\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:46:24 crc kubenswrapper[5120]: I0316 16:46:24.210176 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2cb227a9-f8ad-4f55-a381-42bcaa8d0e6d-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:46:24 crc kubenswrapper[5120]: I0316 16:46:24.210201 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2cb227a9-f8ad-4f55-a381-42bcaa8d0e6d-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:46:24 crc kubenswrapper[5120]: I0316 16:46:24.210213 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2cb227a9-f8ad-4f55-a381-42bcaa8d0e6d-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:46:24 crc kubenswrapper[5120]: I0316 16:46:24.210227 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jthmg\" (UniqueName: \"kubernetes.io/projected/2cb227a9-f8ad-4f55-a381-42bcaa8d0e6d-kube-api-access-jthmg\") on node \"crc\" DevicePath \"\"" Mar 16 16:46:24 crc kubenswrapper[5120]: I0316 16:46:24.210242 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/2cb227a9-f8ad-4f55-a381-42bcaa8d0e6d-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:46:24 crc kubenswrapper[5120]: I0316 16:46:24.210297 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/03693dff-f5dd-4199-8cb2-e6f12d5a0703-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"03693dff-f5dd-4199-8cb2-e6f12d5a0703\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:46:24 crc kubenswrapper[5120]: I0316 16:46:24.211682 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/69041368-3d55-45dc-82b1-6880eff4c75f-run-httpd\") pod \"ceilometer-0\" (UID: \"69041368-3d55-45dc-82b1-6880eff4c75f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:46:24 crc kubenswrapper[5120]: I0316 16:46:24.215867 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/69041368-3d55-45dc-82b1-6880eff4c75f-scripts\") pod \"ceilometer-0\" (UID: \"69041368-3d55-45dc-82b1-6880eff4c75f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:46:24 crc kubenswrapper[5120]: I0316 16:46:24.216046 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/69041368-3d55-45dc-82b1-6880eff4c75f-config-data\") pod \"ceilometer-0\" (UID: \"69041368-3d55-45dc-82b1-6880eff4c75f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:46:24 crc kubenswrapper[5120]: I0316 16:46:24.216202 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/69041368-3d55-45dc-82b1-6880eff4c75f-log-httpd\") pod \"ceilometer-0\" (UID: \"69041368-3d55-45dc-82b1-6880eff4c75f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:46:24 crc kubenswrapper[5120]: I0316 16:46:24.218239 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/03693dff-f5dd-4199-8cb2-e6f12d5a0703-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"03693dff-f5dd-4199-8cb2-e6f12d5a0703\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:46:24 crc kubenswrapper[5120]: I0316 16:46:24.220237 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/03693dff-f5dd-4199-8cb2-e6f12d5a0703-config-data\") pod \"cinder-scheduler-0\" (UID: \"03693dff-f5dd-4199-8cb2-e6f12d5a0703\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:46:24 crc kubenswrapper[5120]: I0316 16:46:24.220429 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/03693dff-f5dd-4199-8cb2-e6f12d5a0703-scripts\") pod \"cinder-scheduler-0\" (UID: \"03693dff-f5dd-4199-8cb2-e6f12d5a0703\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:46:24 crc kubenswrapper[5120]: I0316 16:46:24.221470 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/69041368-3d55-45dc-82b1-6880eff4c75f-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"69041368-3d55-45dc-82b1-6880eff4c75f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:46:24 crc kubenswrapper[5120]: I0316 16:46:24.221621 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/69041368-3d55-45dc-82b1-6880eff4c75f-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"69041368-3d55-45dc-82b1-6880eff4c75f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:46:24 crc kubenswrapper[5120]: I0316 16:46:24.222044 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/03693dff-f5dd-4199-8cb2-e6f12d5a0703-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"03693dff-f5dd-4199-8cb2-e6f12d5a0703\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:46:24 crc kubenswrapper[5120]: I0316 16:46:24.226818 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bd4vt\" (UniqueName: \"kubernetes.io/projected/03693dff-f5dd-4199-8cb2-e6f12d5a0703-kube-api-access-bd4vt\") pod \"cinder-scheduler-0\" (UID: \"03693dff-f5dd-4199-8cb2-e6f12d5a0703\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:46:24 crc kubenswrapper[5120]: I0316 16:46:24.233707 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-29xzr\" (UniqueName: \"kubernetes.io/projected/69041368-3d55-45dc-82b1-6880eff4c75f-kube-api-access-29xzr\") pod \"ceilometer-0\" (UID: \"69041368-3d55-45dc-82b1-6880eff4c75f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:46:24 crc kubenswrapper[5120]: I0316 16:46:24.326710 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:46:24 crc kubenswrapper[5120]: I0316 16:46:24.336320 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:46:24 crc kubenswrapper[5120]: I0316 16:46:24.677749 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9259fe9e-b8ac-4419-a121-b51b0b3916e4" path="/var/lib/kubelet/pods/9259fe9e-b8ac-4419-a121-b51b0b3916e4/volumes" Mar 16 16:46:24 crc kubenswrapper[5120]: I0316 16:46:24.679270 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fdf65609-0eb4-41e2-8750-13e175eca797" path="/var/lib/kubelet/pods/fdf65609-0eb4-41e2-8750-13e175eca797/volumes" Mar 16 16:46:24 crc kubenswrapper[5120]: I0316 16:46:24.681479 5120 scope.go:117] "RemoveContainer" containerID="35a7dd6e19084cee69ca16203bca6378ea0cdf6a685ca2093ab847e5904eb9e6" Mar 16 16:46:24 crc kubenswrapper[5120]: E0316 16:46:24.681912 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:46:24 crc kubenswrapper[5120]: I0316 16:46:24.785599 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-5557b6754b-qz56v" Mar 16 16:46:24 crc kubenswrapper[5120]: I0316 16:46:24.788701 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-954498cf-phl8v" event={"ID":"2cb227a9-f8ad-4f55-a381-42bcaa8d0e6d","Type":"ContainerDied","Data":"16dfb35306e6725c4b2bbe4a675e5aaea07e50b26632bdfbc22550459f81eb63"} Mar 16 16:46:24 crc kubenswrapper[5120]: I0316 16:46:24.788764 5120 scope.go:117] "RemoveContainer" containerID="4f7f82ca8e1a4a0957dba075673975af65961420c6af1aeb6b6bcd73c7fea190" Mar 16 16:46:24 crc kubenswrapper[5120]: I0316 16:46:24.788780 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-954498cf-phl8v" Mar 16 16:46:24 crc kubenswrapper[5120]: I0316 16:46:24.818860 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-5557b6754b-qz56v"] Mar 16 16:46:24 crc kubenswrapper[5120]: I0316 16:46:24.822351 5120 scope.go:117] "RemoveContainer" containerID="0f217d3fd94d1e155058e7e6011bf370c2d51eb2b3fab54ee2062a8a37613fda" Mar 16 16:46:24 crc kubenswrapper[5120]: I0316 16:46:24.833430 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-5557b6754b-qz56v"] Mar 16 16:46:24 crc kubenswrapper[5120]: I0316 16:46:24.844084 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-954498cf-phl8v"] Mar 16 16:46:24 crc kubenswrapper[5120]: I0316 16:46:24.853198 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-worker-954498cf-phl8v"] Mar 16 16:46:24 crc kubenswrapper[5120]: W0316 16:46:24.859877 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod03693dff_f5dd_4199_8cb2_e6f12d5a0703.slice/crio-4f732e9d57b8287f8c063dd2db2237abf22a9402fef503e6427871e72a34e99c WatchSource:0}: Error finding container 4f732e9d57b8287f8c063dd2db2237abf22a9402fef503e6427871e72a34e99c: Status 404 returned error can't find the container with id 4f732e9d57b8287f8c063dd2db2237abf22a9402fef503e6427871e72a34e99c Mar 16 16:46:24 crc kubenswrapper[5120]: I0316 16:46:24.871771 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:46:24 crc kubenswrapper[5120]: I0316 16:46:24.966289 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:46:25 crc kubenswrapper[5120]: I0316 16:46:25.805677 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/cinder-api-0" podUID="21c25ad9-ce40-4a35-911c-bed267b17113" containerName="cinder-api" probeResult="failure" output="Get \"http://10.217.1.167:8776/healthcheck\": read tcp 10.217.0.2:59758->10.217.1.167:8776: read: connection reset by peer" Mar 16 16:46:25 crc kubenswrapper[5120]: I0316 16:46:25.809165 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"03693dff-f5dd-4199-8cb2-e6f12d5a0703","Type":"ContainerStarted","Data":"f12dd69527499a1398e4a608adaef103b3aa7f300de680b04045d0b9a14eedc2"} Mar 16 16:46:25 crc kubenswrapper[5120]: I0316 16:46:25.809221 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"03693dff-f5dd-4199-8cb2-e6f12d5a0703","Type":"ContainerStarted","Data":"4f732e9d57b8287f8c063dd2db2237abf22a9402fef503e6427871e72a34e99c"} Mar 16 16:46:25 crc kubenswrapper[5120]: I0316 16:46:25.812946 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"69041368-3d55-45dc-82b1-6880eff4c75f","Type":"ContainerStarted","Data":"fc014cab76a0214aba3ceedfa3e838e7547aa03a6f9cffc160b3094c414980d9"} Mar 16 16:46:26 crc kubenswrapper[5120]: I0316 16:46:26.688392 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="212dc541-58a2-45d9-97bf-c566530e09da" path="/var/lib/kubelet/pods/212dc541-58a2-45d9-97bf-c566530e09da/volumes" Mar 16 16:46:26 crc kubenswrapper[5120]: I0316 16:46:26.689680 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2cb227a9-f8ad-4f55-a381-42bcaa8d0e6d" path="/var/lib/kubelet/pods/2cb227a9-f8ad-4f55-a381-42bcaa8d0e6d/volumes" Mar 16 16:46:26 crc kubenswrapper[5120]: I0316 16:46:26.789501 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:46:26 crc kubenswrapper[5120]: I0316 16:46:26.873692 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"69041368-3d55-45dc-82b1-6880eff4c75f","Type":"ContainerStarted","Data":"d8e5e912050e5f5eb58c05109643a945e6d57c1d01ee32094185da4f827c3c99"} Mar 16 16:46:26 crc kubenswrapper[5120]: I0316 16:46:26.873751 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"69041368-3d55-45dc-82b1-6880eff4c75f","Type":"ContainerStarted","Data":"33d0e5a780156723eacebd11e487d2496152b46a9b10a72a8efc178ca749e8e2"} Mar 16 16:46:26 crc kubenswrapper[5120]: I0316 16:46:26.876710 5120 generic.go:358] "Generic (PLEG): container finished" podID="21c25ad9-ce40-4a35-911c-bed267b17113" containerID="f586b7458c17be75b61140ec0419ddf37d294472d0c8b62c001ca393046fad04" exitCode=0 Mar 16 16:46:26 crc kubenswrapper[5120]: I0316 16:46:26.876849 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"21c25ad9-ce40-4a35-911c-bed267b17113","Type":"ContainerDied","Data":"f586b7458c17be75b61140ec0419ddf37d294472d0c8b62c001ca393046fad04"} Mar 16 16:46:26 crc kubenswrapper[5120]: I0316 16:46:26.876870 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"21c25ad9-ce40-4a35-911c-bed267b17113","Type":"ContainerDied","Data":"108e91ca27af6ad44f4a61b4762f19969e4c3aa249046aaf92533c70883c7fd0"} Mar 16 16:46:26 crc kubenswrapper[5120]: I0316 16:46:26.876889 5120 scope.go:117] "RemoveContainer" containerID="f586b7458c17be75b61140ec0419ddf37d294472d0c8b62c001ca393046fad04" Mar 16 16:46:26 crc kubenswrapper[5120]: I0316 16:46:26.877060 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:46:26 crc kubenswrapper[5120]: I0316 16:46:26.892298 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"03693dff-f5dd-4199-8cb2-e6f12d5a0703","Type":"ContainerStarted","Data":"56bafd5d554c07424b2372cb9d09d48c6c8a503553bf48586be2bda216c559d8"} Mar 16 16:46:26 crc kubenswrapper[5120]: I0316 16:46:26.932867 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-scheduler-0" podStartSLOduration=3.9328419439999998 podStartE2EDuration="3.932841944s" podCreationTimestamp="2026-03-16 16:46:23 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:46:26.91617849 +0000 UTC m=+4489.070110147" watchObservedRunningTime="2026-03-16 16:46:26.932841944 +0000 UTC m=+4489.086773621" Mar 16 16:46:26 crc kubenswrapper[5120]: I0316 16:46:26.942250 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/21c25ad9-ce40-4a35-911c-bed267b17113-config-data\") pod \"21c25ad9-ce40-4a35-911c-bed267b17113\" (UID: \"21c25ad9-ce40-4a35-911c-bed267b17113\") " Mar 16 16:46:26 crc kubenswrapper[5120]: I0316 16:46:26.942352 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/21c25ad9-ce40-4a35-911c-bed267b17113-logs\") pod \"21c25ad9-ce40-4a35-911c-bed267b17113\" (UID: \"21c25ad9-ce40-4a35-911c-bed267b17113\") " Mar 16 16:46:26 crc kubenswrapper[5120]: I0316 16:46:26.942524 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/21c25ad9-ce40-4a35-911c-bed267b17113-scripts\") pod \"21c25ad9-ce40-4a35-911c-bed267b17113\" (UID: \"21c25ad9-ce40-4a35-911c-bed267b17113\") " Mar 16 16:46:26 crc kubenswrapper[5120]: I0316 16:46:26.942558 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q7pcq\" (UniqueName: \"kubernetes.io/projected/21c25ad9-ce40-4a35-911c-bed267b17113-kube-api-access-q7pcq\") pod \"21c25ad9-ce40-4a35-911c-bed267b17113\" (UID: \"21c25ad9-ce40-4a35-911c-bed267b17113\") " Mar 16 16:46:26 crc kubenswrapper[5120]: I0316 16:46:26.942715 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/21c25ad9-ce40-4a35-911c-bed267b17113-combined-ca-bundle\") pod \"21c25ad9-ce40-4a35-911c-bed267b17113\" (UID: \"21c25ad9-ce40-4a35-911c-bed267b17113\") " Mar 16 16:46:26 crc kubenswrapper[5120]: I0316 16:46:26.942811 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/21c25ad9-ce40-4a35-911c-bed267b17113-etc-machine-id\") pod \"21c25ad9-ce40-4a35-911c-bed267b17113\" (UID: \"21c25ad9-ce40-4a35-911c-bed267b17113\") " Mar 16 16:46:26 crc kubenswrapper[5120]: I0316 16:46:26.942926 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/21c25ad9-ce40-4a35-911c-bed267b17113-config-data-custom\") pod \"21c25ad9-ce40-4a35-911c-bed267b17113\" (UID: \"21c25ad9-ce40-4a35-911c-bed267b17113\") " Mar 16 16:46:26 crc kubenswrapper[5120]: I0316 16:46:26.943054 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21c25ad9-ce40-4a35-911c-bed267b17113-logs" (OuterVolumeSpecName: "logs") pod "21c25ad9-ce40-4a35-911c-bed267b17113" (UID: "21c25ad9-ce40-4a35-911c-bed267b17113"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:46:26 crc kubenswrapper[5120]: I0316 16:46:26.943924 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/21c25ad9-ce40-4a35-911c-bed267b17113-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:46:26 crc kubenswrapper[5120]: I0316 16:46:26.944314 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/21c25ad9-ce40-4a35-911c-bed267b17113-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "21c25ad9-ce40-4a35-911c-bed267b17113" (UID: "21c25ad9-ce40-4a35-911c-bed267b17113"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 16:46:26 crc kubenswrapper[5120]: I0316 16:46:26.960543 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21c25ad9-ce40-4a35-911c-bed267b17113-kube-api-access-q7pcq" (OuterVolumeSpecName: "kube-api-access-q7pcq") pod "21c25ad9-ce40-4a35-911c-bed267b17113" (UID: "21c25ad9-ce40-4a35-911c-bed267b17113"). InnerVolumeSpecName "kube-api-access-q7pcq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:46:26 crc kubenswrapper[5120]: I0316 16:46:26.960880 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/21c25ad9-ce40-4a35-911c-bed267b17113-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "21c25ad9-ce40-4a35-911c-bed267b17113" (UID: "21c25ad9-ce40-4a35-911c-bed267b17113"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:46:26 crc kubenswrapper[5120]: I0316 16:46:26.963721 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/21c25ad9-ce40-4a35-911c-bed267b17113-scripts" (OuterVolumeSpecName: "scripts") pod "21c25ad9-ce40-4a35-911c-bed267b17113" (UID: "21c25ad9-ce40-4a35-911c-bed267b17113"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:46:26 crc kubenswrapper[5120]: I0316 16:46:26.981564 5120 scope.go:117] "RemoveContainer" containerID="41490435f5073420f991ba6106d2149c017f85bfdca66a0675331966b235256a" Mar 16 16:46:27 crc kubenswrapper[5120]: I0316 16:46:27.006832 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/21c25ad9-ce40-4a35-911c-bed267b17113-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "21c25ad9-ce40-4a35-911c-bed267b17113" (UID: "21c25ad9-ce40-4a35-911c-bed267b17113"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:46:27 crc kubenswrapper[5120]: I0316 16:46:27.045838 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/21c25ad9-ce40-4a35-911c-bed267b17113-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:46:27 crc kubenswrapper[5120]: I0316 16:46:27.045866 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q7pcq\" (UniqueName: \"kubernetes.io/projected/21c25ad9-ce40-4a35-911c-bed267b17113-kube-api-access-q7pcq\") on node \"crc\" DevicePath \"\"" Mar 16 16:46:27 crc kubenswrapper[5120]: I0316 16:46:27.045876 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/21c25ad9-ce40-4a35-911c-bed267b17113-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:46:27 crc kubenswrapper[5120]: I0316 16:46:27.045885 5120 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/21c25ad9-ce40-4a35-911c-bed267b17113-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 16:46:27 crc kubenswrapper[5120]: I0316 16:46:27.045895 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/21c25ad9-ce40-4a35-911c-bed267b17113-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:46:27 crc kubenswrapper[5120]: I0316 16:46:27.054868 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/21c25ad9-ce40-4a35-911c-bed267b17113-config-data" (OuterVolumeSpecName: "config-data") pod "21c25ad9-ce40-4a35-911c-bed267b17113" (UID: "21c25ad9-ce40-4a35-911c-bed267b17113"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:46:27 crc kubenswrapper[5120]: I0316 16:46:27.120927 5120 scope.go:117] "RemoveContainer" containerID="f586b7458c17be75b61140ec0419ddf37d294472d0c8b62c001ca393046fad04" Mar 16 16:46:27 crc kubenswrapper[5120]: E0316 16:46:27.121883 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f586b7458c17be75b61140ec0419ddf37d294472d0c8b62c001ca393046fad04\": container with ID starting with f586b7458c17be75b61140ec0419ddf37d294472d0c8b62c001ca393046fad04 not found: ID does not exist" containerID="f586b7458c17be75b61140ec0419ddf37d294472d0c8b62c001ca393046fad04" Mar 16 16:46:27 crc kubenswrapper[5120]: I0316 16:46:27.121918 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f586b7458c17be75b61140ec0419ddf37d294472d0c8b62c001ca393046fad04"} err="failed to get container status \"f586b7458c17be75b61140ec0419ddf37d294472d0c8b62c001ca393046fad04\": rpc error: code = NotFound desc = could not find container \"f586b7458c17be75b61140ec0419ddf37d294472d0c8b62c001ca393046fad04\": container with ID starting with f586b7458c17be75b61140ec0419ddf37d294472d0c8b62c001ca393046fad04 not found: ID does not exist" Mar 16 16:46:27 crc kubenswrapper[5120]: I0316 16:46:27.121938 5120 scope.go:117] "RemoveContainer" containerID="41490435f5073420f991ba6106d2149c017f85bfdca66a0675331966b235256a" Mar 16 16:46:27 crc kubenswrapper[5120]: E0316 16:46:27.122147 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"41490435f5073420f991ba6106d2149c017f85bfdca66a0675331966b235256a\": container with ID starting with 41490435f5073420f991ba6106d2149c017f85bfdca66a0675331966b235256a not found: ID does not exist" containerID="41490435f5073420f991ba6106d2149c017f85bfdca66a0675331966b235256a" Mar 16 16:46:27 crc kubenswrapper[5120]: I0316 16:46:27.122190 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41490435f5073420f991ba6106d2149c017f85bfdca66a0675331966b235256a"} err="failed to get container status \"41490435f5073420f991ba6106d2149c017f85bfdca66a0675331966b235256a\": rpc error: code = NotFound desc = could not find container \"41490435f5073420f991ba6106d2149c017f85bfdca66a0675331966b235256a\": container with ID starting with 41490435f5073420f991ba6106d2149c017f85bfdca66a0675331966b235256a not found: ID does not exist" Mar 16 16:46:27 crc kubenswrapper[5120]: I0316 16:46:27.147362 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/21c25ad9-ce40-4a35-911c-bed267b17113-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:46:27 crc kubenswrapper[5120]: I0316 16:46:27.220384 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:46:27 crc kubenswrapper[5120]: I0316 16:46:27.237781 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:46:27 crc kubenswrapper[5120]: I0316 16:46:27.245691 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:46:27 crc kubenswrapper[5120]: I0316 16:46:27.246997 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21c25ad9-ce40-4a35-911c-bed267b17113" containerName="cinder-api-log" Mar 16 16:46:27 crc kubenswrapper[5120]: I0316 16:46:27.247022 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="21c25ad9-ce40-4a35-911c-bed267b17113" containerName="cinder-api-log" Mar 16 16:46:27 crc kubenswrapper[5120]: I0316 16:46:27.247077 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21c25ad9-ce40-4a35-911c-bed267b17113" containerName="cinder-api" Mar 16 16:46:27 crc kubenswrapper[5120]: I0316 16:46:27.247085 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="21c25ad9-ce40-4a35-911c-bed267b17113" containerName="cinder-api" Mar 16 16:46:27 crc kubenswrapper[5120]: I0316 16:46:27.247362 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="21c25ad9-ce40-4a35-911c-bed267b17113" containerName="cinder-api-log" Mar 16 16:46:27 crc kubenswrapper[5120]: I0316 16:46:27.247388 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="21c25ad9-ce40-4a35-911c-bed267b17113" containerName="cinder-api" Mar 16 16:46:27 crc kubenswrapper[5120]: I0316 16:46:27.256655 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:46:27 crc kubenswrapper[5120]: I0316 16:46:27.256888 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:46:27 crc kubenswrapper[5120]: I0316 16:46:27.263277 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-api-config-data\"" Mar 16 16:46:27 crc kubenswrapper[5120]: I0316 16:46:27.350946 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/5988349f-8dba-4fde-acf3-6d8acf01117f-config-data-custom\") pod \"cinder-api-0\" (UID: \"5988349f-8dba-4fde-acf3-6d8acf01117f\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:46:27 crc kubenswrapper[5120]: I0316 16:46:27.351217 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/5988349f-8dba-4fde-acf3-6d8acf01117f-etc-machine-id\") pod \"cinder-api-0\" (UID: \"5988349f-8dba-4fde-acf3-6d8acf01117f\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:46:27 crc kubenswrapper[5120]: I0316 16:46:27.351303 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qc4gm\" (UniqueName: \"kubernetes.io/projected/5988349f-8dba-4fde-acf3-6d8acf01117f-kube-api-access-qc4gm\") pod \"cinder-api-0\" (UID: \"5988349f-8dba-4fde-acf3-6d8acf01117f\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:46:27 crc kubenswrapper[5120]: I0316 16:46:27.351585 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5988349f-8dba-4fde-acf3-6d8acf01117f-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"5988349f-8dba-4fde-acf3-6d8acf01117f\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:46:27 crc kubenswrapper[5120]: I0316 16:46:27.351965 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5988349f-8dba-4fde-acf3-6d8acf01117f-config-data\") pod \"cinder-api-0\" (UID: \"5988349f-8dba-4fde-acf3-6d8acf01117f\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:46:27 crc kubenswrapper[5120]: I0316 16:46:27.352007 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5988349f-8dba-4fde-acf3-6d8acf01117f-scripts\") pod \"cinder-api-0\" (UID: \"5988349f-8dba-4fde-acf3-6d8acf01117f\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:46:27 crc kubenswrapper[5120]: I0316 16:46:27.352063 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5988349f-8dba-4fde-acf3-6d8acf01117f-logs\") pod \"cinder-api-0\" (UID: \"5988349f-8dba-4fde-acf3-6d8acf01117f\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:46:27 crc kubenswrapper[5120]: I0316 16:46:27.454474 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5988349f-8dba-4fde-acf3-6d8acf01117f-config-data\") pod \"cinder-api-0\" (UID: \"5988349f-8dba-4fde-acf3-6d8acf01117f\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:46:27 crc kubenswrapper[5120]: I0316 16:46:27.454736 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5988349f-8dba-4fde-acf3-6d8acf01117f-scripts\") pod \"cinder-api-0\" (UID: \"5988349f-8dba-4fde-acf3-6d8acf01117f\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:46:27 crc kubenswrapper[5120]: I0316 16:46:27.454860 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5988349f-8dba-4fde-acf3-6d8acf01117f-logs\") pod \"cinder-api-0\" (UID: \"5988349f-8dba-4fde-acf3-6d8acf01117f\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:46:27 crc kubenswrapper[5120]: I0316 16:46:27.454965 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/5988349f-8dba-4fde-acf3-6d8acf01117f-config-data-custom\") pod \"cinder-api-0\" (UID: \"5988349f-8dba-4fde-acf3-6d8acf01117f\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:46:27 crc kubenswrapper[5120]: I0316 16:46:27.455163 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/5988349f-8dba-4fde-acf3-6d8acf01117f-etc-machine-id\") pod \"cinder-api-0\" (UID: \"5988349f-8dba-4fde-acf3-6d8acf01117f\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:46:27 crc kubenswrapper[5120]: I0316 16:46:27.455257 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qc4gm\" (UniqueName: \"kubernetes.io/projected/5988349f-8dba-4fde-acf3-6d8acf01117f-kube-api-access-qc4gm\") pod \"cinder-api-0\" (UID: \"5988349f-8dba-4fde-acf3-6d8acf01117f\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:46:27 crc kubenswrapper[5120]: I0316 16:46:27.455391 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5988349f-8dba-4fde-acf3-6d8acf01117f-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"5988349f-8dba-4fde-acf3-6d8acf01117f\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:46:27 crc kubenswrapper[5120]: I0316 16:46:27.456298 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5988349f-8dba-4fde-acf3-6d8acf01117f-logs\") pod \"cinder-api-0\" (UID: \"5988349f-8dba-4fde-acf3-6d8acf01117f\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:46:27 crc kubenswrapper[5120]: I0316 16:46:27.458904 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5988349f-8dba-4fde-acf3-6d8acf01117f-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"5988349f-8dba-4fde-acf3-6d8acf01117f\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:46:27 crc kubenswrapper[5120]: I0316 16:46:27.461822 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/5988349f-8dba-4fde-acf3-6d8acf01117f-etc-machine-id\") pod \"cinder-api-0\" (UID: \"5988349f-8dba-4fde-acf3-6d8acf01117f\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:46:27 crc kubenswrapper[5120]: I0316 16:46:27.463180 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/5988349f-8dba-4fde-acf3-6d8acf01117f-config-data-custom\") pod \"cinder-api-0\" (UID: \"5988349f-8dba-4fde-acf3-6d8acf01117f\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:46:27 crc kubenswrapper[5120]: I0316 16:46:27.463639 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5988349f-8dba-4fde-acf3-6d8acf01117f-config-data\") pod \"cinder-api-0\" (UID: \"5988349f-8dba-4fde-acf3-6d8acf01117f\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:46:27 crc kubenswrapper[5120]: I0316 16:46:27.465244 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5988349f-8dba-4fde-acf3-6d8acf01117f-scripts\") pod \"cinder-api-0\" (UID: \"5988349f-8dba-4fde-acf3-6d8acf01117f\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:46:27 crc kubenswrapper[5120]: I0316 16:46:27.484305 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qc4gm\" (UniqueName: \"kubernetes.io/projected/5988349f-8dba-4fde-acf3-6d8acf01117f-kube-api-access-qc4gm\") pod \"cinder-api-0\" (UID: \"5988349f-8dba-4fde-acf3-6d8acf01117f\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:46:27 crc kubenswrapper[5120]: I0316 16:46:27.584441 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:46:27 crc kubenswrapper[5120]: I0316 16:46:27.912433 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"69041368-3d55-45dc-82b1-6880eff4c75f","Type":"ContainerStarted","Data":"4a05de3cf2a25759a43b272be6e2c9c4e0e5961db58b0cf3d9152985af452edd"} Mar 16 16:46:28 crc kubenswrapper[5120]: I0316 16:46:28.082298 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:46:28 crc kubenswrapper[5120]: I0316 16:46:28.486532 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-66f8c58b5d-5nmtn" Mar 16 16:46:28 crc kubenswrapper[5120]: I0316 16:46:28.490417 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-66f8c58b5d-5nmtn" Mar 16 16:46:28 crc kubenswrapper[5120]: I0316 16:46:28.568947 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-6bfffc7f7b-nsf4t"] Mar 16 16:46:28 crc kubenswrapper[5120]: I0316 16:46:28.569184 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-6bfffc7f7b-nsf4t" podUID="60e2f357-0615-41a0-96bd-915aacafdfe5" containerName="barbican-api-log" containerID="cri-o://b949cf03f2fca0675a17a1589561439ec214ce954c9fa89e42d03257ac493108" gracePeriod=30 Mar 16 16:46:28 crc kubenswrapper[5120]: I0316 16:46:28.569657 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-6bfffc7f7b-nsf4t" podUID="60e2f357-0615-41a0-96bd-915aacafdfe5" containerName="barbican-api" containerID="cri-o://17759932300f392a7b5b2def1a818fc53789d1218140353960d6f212eab11166" gracePeriod=30 Mar 16 16:46:28 crc kubenswrapper[5120]: I0316 16:46:28.692248 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="21c25ad9-ce40-4a35-911c-bed267b17113" path="/var/lib/kubelet/pods/21c25ad9-ce40-4a35-911c-bed267b17113/volumes" Mar 16 16:46:28 crc kubenswrapper[5120]: I0316 16:46:28.930392 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"5988349f-8dba-4fde-acf3-6d8acf01117f","Type":"ContainerStarted","Data":"94adda9f3db9d3289d254844d87731640cdd1c022dc2c28e816cc1f45741e90a"} Mar 16 16:46:28 crc kubenswrapper[5120]: I0316 16:46:28.930743 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"5988349f-8dba-4fde-acf3-6d8acf01117f","Type":"ContainerStarted","Data":"b98174217ef5451e25236a261499c70e2f814da3b66d0e251af6b80df389ae6c"} Mar 16 16:46:28 crc kubenswrapper[5120]: I0316 16:46:28.934141 5120 generic.go:358] "Generic (PLEG): container finished" podID="60e2f357-0615-41a0-96bd-915aacafdfe5" containerID="b949cf03f2fca0675a17a1589561439ec214ce954c9fa89e42d03257ac493108" exitCode=143 Mar 16 16:46:28 crc kubenswrapper[5120]: I0316 16:46:28.934221 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-6bfffc7f7b-nsf4t" event={"ID":"60e2f357-0615-41a0-96bd-915aacafdfe5","Type":"ContainerDied","Data":"b949cf03f2fca0675a17a1589561439ec214ce954c9fa89e42d03257ac493108"} Mar 16 16:46:29 crc kubenswrapper[5120]: I0316 16:46:29.327669 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:46:29 crc kubenswrapper[5120]: I0316 16:46:29.946912 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"5988349f-8dba-4fde-acf3-6d8acf01117f","Type":"ContainerStarted","Data":"337f914f7d65a7cc1d629598ef727728aeeeb98f0d532479dda2dac058d447f5"} Mar 16 16:46:29 crc kubenswrapper[5120]: I0316 16:46:29.948167 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:46:29 crc kubenswrapper[5120]: I0316 16:46:29.953349 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"69041368-3d55-45dc-82b1-6880eff4c75f","Type":"ContainerStarted","Data":"c0f907cdc02c1cadc88f78979038f82963123d98be8b6a203795b6b07e9b470b"} Mar 16 16:46:29 crc kubenswrapper[5120]: I0316 16:46:29.953798 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:46:29 crc kubenswrapper[5120]: I0316 16:46:29.967122 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-api-0" podStartSLOduration=2.967096375 podStartE2EDuration="2.967096375s" podCreationTimestamp="2026-03-16 16:46:27 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:46:29.965566483 +0000 UTC m=+4492.119498140" watchObservedRunningTime="2026-03-16 16:46:29.967096375 +0000 UTC m=+4492.121028022" Mar 16 16:46:29 crc kubenswrapper[5120]: I0316 16:46:29.990849 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.385641804 podStartE2EDuration="6.990793239s" podCreationTimestamp="2026-03-16 16:46:23 +0000 UTC" firstStartedPulling="2026-03-16 16:46:24.970123111 +0000 UTC m=+4487.124054758" lastFinishedPulling="2026-03-16 16:46:29.575274536 +0000 UTC m=+4491.729206193" observedRunningTime="2026-03-16 16:46:29.983883781 +0000 UTC m=+4492.137815438" watchObservedRunningTime="2026-03-16 16:46:29.990793239 +0000 UTC m=+4492.144724896" Mar 16 16:46:31 crc kubenswrapper[5120]: I0316 16:46:31.753436 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-6bfffc7f7b-nsf4t" podUID="60e2f357-0615-41a0-96bd-915aacafdfe5" containerName="barbican-api" probeResult="failure" output="Get \"http://10.217.1.165:9311/healthcheck\": read tcp 10.217.0.2:42614->10.217.1.165:9311: read: connection reset by peer" Mar 16 16:46:31 crc kubenswrapper[5120]: I0316 16:46:31.809599 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-6bfffc7f7b-nsf4t" podUID="60e2f357-0615-41a0-96bd-915aacafdfe5" containerName="barbican-api-log" probeResult="failure" output="Get \"http://10.217.1.165:9311/healthcheck\": dial tcp 10.217.1.165:9311: connect: connection refused" Mar 16 16:46:31 crc kubenswrapper[5120]: I0316 16:46:31.978190 5120 generic.go:358] "Generic (PLEG): container finished" podID="60e2f357-0615-41a0-96bd-915aacafdfe5" containerID="17759932300f392a7b5b2def1a818fc53789d1218140353960d6f212eab11166" exitCode=0 Mar 16 16:46:31 crc kubenswrapper[5120]: I0316 16:46:31.978275 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-6bfffc7f7b-nsf4t" event={"ID":"60e2f357-0615-41a0-96bd-915aacafdfe5","Type":"ContainerDied","Data":"17759932300f392a7b5b2def1a818fc53789d1218140353960d6f212eab11166"} Mar 16 16:46:32 crc kubenswrapper[5120]: I0316 16:46:32.236952 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-6bfffc7f7b-nsf4t" Mar 16 16:46:32 crc kubenswrapper[5120]: I0316 16:46:32.290852 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/60e2f357-0615-41a0-96bd-915aacafdfe5-config-data\") pod \"60e2f357-0615-41a0-96bd-915aacafdfe5\" (UID: \"60e2f357-0615-41a0-96bd-915aacafdfe5\") " Mar 16 16:46:32 crc kubenswrapper[5120]: I0316 16:46:32.290975 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/60e2f357-0615-41a0-96bd-915aacafdfe5-config-data-custom\") pod \"60e2f357-0615-41a0-96bd-915aacafdfe5\" (UID: \"60e2f357-0615-41a0-96bd-915aacafdfe5\") " Mar 16 16:46:32 crc kubenswrapper[5120]: I0316 16:46:32.291039 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/60e2f357-0615-41a0-96bd-915aacafdfe5-logs\") pod \"60e2f357-0615-41a0-96bd-915aacafdfe5\" (UID: \"60e2f357-0615-41a0-96bd-915aacafdfe5\") " Mar 16 16:46:32 crc kubenswrapper[5120]: I0316 16:46:32.291098 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/60e2f357-0615-41a0-96bd-915aacafdfe5-combined-ca-bundle\") pod \"60e2f357-0615-41a0-96bd-915aacafdfe5\" (UID: \"60e2f357-0615-41a0-96bd-915aacafdfe5\") " Mar 16 16:46:32 crc kubenswrapper[5120]: I0316 16:46:32.291220 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m2djr\" (UniqueName: \"kubernetes.io/projected/60e2f357-0615-41a0-96bd-915aacafdfe5-kube-api-access-m2djr\") pod \"60e2f357-0615-41a0-96bd-915aacafdfe5\" (UID: \"60e2f357-0615-41a0-96bd-915aacafdfe5\") " Mar 16 16:46:32 crc kubenswrapper[5120]: I0316 16:46:32.292006 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60e2f357-0615-41a0-96bd-915aacafdfe5-logs" (OuterVolumeSpecName: "logs") pod "60e2f357-0615-41a0-96bd-915aacafdfe5" (UID: "60e2f357-0615-41a0-96bd-915aacafdfe5"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:46:32 crc kubenswrapper[5120]: I0316 16:46:32.301727 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/60e2f357-0615-41a0-96bd-915aacafdfe5-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "60e2f357-0615-41a0-96bd-915aacafdfe5" (UID: "60e2f357-0615-41a0-96bd-915aacafdfe5"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:46:32 crc kubenswrapper[5120]: I0316 16:46:32.302122 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60e2f357-0615-41a0-96bd-915aacafdfe5-kube-api-access-m2djr" (OuterVolumeSpecName: "kube-api-access-m2djr") pod "60e2f357-0615-41a0-96bd-915aacafdfe5" (UID: "60e2f357-0615-41a0-96bd-915aacafdfe5"). InnerVolumeSpecName "kube-api-access-m2djr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:46:32 crc kubenswrapper[5120]: I0316 16:46:32.337144 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/60e2f357-0615-41a0-96bd-915aacafdfe5-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "60e2f357-0615-41a0-96bd-915aacafdfe5" (UID: "60e2f357-0615-41a0-96bd-915aacafdfe5"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:46:32 crc kubenswrapper[5120]: I0316 16:46:32.342579 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/60e2f357-0615-41a0-96bd-915aacafdfe5-config-data" (OuterVolumeSpecName: "config-data") pod "60e2f357-0615-41a0-96bd-915aacafdfe5" (UID: "60e2f357-0615-41a0-96bd-915aacafdfe5"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:46:32 crc kubenswrapper[5120]: I0316 16:46:32.393671 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/60e2f357-0615-41a0-96bd-915aacafdfe5-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:46:32 crc kubenswrapper[5120]: I0316 16:46:32.393715 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/60e2f357-0615-41a0-96bd-915aacafdfe5-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:46:32 crc kubenswrapper[5120]: I0316 16:46:32.393727 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/60e2f357-0615-41a0-96bd-915aacafdfe5-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:46:32 crc kubenswrapper[5120]: I0316 16:46:32.393739 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/60e2f357-0615-41a0-96bd-915aacafdfe5-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:46:32 crc kubenswrapper[5120]: I0316 16:46:32.393748 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m2djr\" (UniqueName: \"kubernetes.io/projected/60e2f357-0615-41a0-96bd-915aacafdfe5-kube-api-access-m2djr\") on node \"crc\" DevicePath \"\"" Mar 16 16:46:32 crc kubenswrapper[5120]: I0316 16:46:32.995306 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-6bfffc7f7b-nsf4t" event={"ID":"60e2f357-0615-41a0-96bd-915aacafdfe5","Type":"ContainerDied","Data":"22a40018bb8b6dfa78c604559f3bbc906a63381744a9805b4b87f19836f6eca7"} Mar 16 16:46:32 crc kubenswrapper[5120]: I0316 16:46:32.995365 5120 scope.go:117] "RemoveContainer" containerID="17759932300f392a7b5b2def1a818fc53789d1218140353960d6f212eab11166" Mar 16 16:46:32 crc kubenswrapper[5120]: I0316 16:46:32.995518 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-6bfffc7f7b-nsf4t" Mar 16 16:46:33 crc kubenswrapper[5120]: I0316 16:46:33.029144 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-6bfffc7f7b-nsf4t"] Mar 16 16:46:33 crc kubenswrapper[5120]: I0316 16:46:33.036192 5120 scope.go:117] "RemoveContainer" containerID="b949cf03f2fca0675a17a1589561439ec214ce954c9fa89e42d03257ac493108" Mar 16 16:46:33 crc kubenswrapper[5120]: I0316 16:46:33.037933 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-api-6bfffc7f7b-nsf4t"] Mar 16 16:46:34 crc kubenswrapper[5120]: I0316 16:46:34.532237 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:46:34 crc kubenswrapper[5120]: I0316 16:46:34.678393 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="60e2f357-0615-41a0-96bd-915aacafdfe5" path="/var/lib/kubelet/pods/60e2f357-0615-41a0-96bd-915aacafdfe5/volumes" Mar 16 16:46:35 crc kubenswrapper[5120]: I0316 16:46:35.202220 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/placement-54bf5db978-kpsbr" Mar 16 16:46:35 crc kubenswrapper[5120]: I0316 16:46:35.663684 5120 scope.go:117] "RemoveContainer" containerID="35a7dd6e19084cee69ca16203bca6378ea0cdf6a685ca2093ab847e5904eb9e6" Mar 16 16:46:35 crc kubenswrapper[5120]: E0316 16:46:35.664306 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:46:36 crc kubenswrapper[5120]: I0316 16:46:36.157948 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/placement-54bf5db978-kpsbr" Mar 16 16:46:36 crc kubenswrapper[5120]: I0316 16:46:36.371929 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-744476466-rznwv"] Mar 16 16:46:36 crc kubenswrapper[5120]: I0316 16:46:36.373501 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60e2f357-0615-41a0-96bd-915aacafdfe5" containerName="barbican-api-log" Mar 16 16:46:36 crc kubenswrapper[5120]: I0316 16:46:36.373534 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="60e2f357-0615-41a0-96bd-915aacafdfe5" containerName="barbican-api-log" Mar 16 16:46:36 crc kubenswrapper[5120]: I0316 16:46:36.373588 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60e2f357-0615-41a0-96bd-915aacafdfe5" containerName="barbican-api" Mar 16 16:46:36 crc kubenswrapper[5120]: I0316 16:46:36.373596 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="60e2f357-0615-41a0-96bd-915aacafdfe5" containerName="barbican-api" Mar 16 16:46:36 crc kubenswrapper[5120]: I0316 16:46:36.373839 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="60e2f357-0615-41a0-96bd-915aacafdfe5" containerName="barbican-api-log" Mar 16 16:46:36 crc kubenswrapper[5120]: I0316 16:46:36.373858 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="60e2f357-0615-41a0-96bd-915aacafdfe5" containerName="barbican-api" Mar 16 16:46:36 crc kubenswrapper[5120]: I0316 16:46:36.383528 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-744476466-rznwv" Mar 16 16:46:36 crc kubenswrapper[5120]: I0316 16:46:36.412557 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-744476466-rznwv"] Mar 16 16:46:36 crc kubenswrapper[5120]: I0316 16:46:36.493806 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/135e00b3-e635-4283-912a-4d92b9980619-scripts\") pod \"placement-744476466-rznwv\" (UID: \"135e00b3-e635-4283-912a-4d92b9980619\") " pod="openstack-kuttl-tests/placement-744476466-rznwv" Mar 16 16:46:36 crc kubenswrapper[5120]: I0316 16:46:36.494402 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/135e00b3-e635-4283-912a-4d92b9980619-logs\") pod \"placement-744476466-rznwv\" (UID: \"135e00b3-e635-4283-912a-4d92b9980619\") " pod="openstack-kuttl-tests/placement-744476466-rznwv" Mar 16 16:46:36 crc kubenswrapper[5120]: I0316 16:46:36.494503 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/135e00b3-e635-4283-912a-4d92b9980619-combined-ca-bundle\") pod \"placement-744476466-rznwv\" (UID: \"135e00b3-e635-4283-912a-4d92b9980619\") " pod="openstack-kuttl-tests/placement-744476466-rznwv" Mar 16 16:46:36 crc kubenswrapper[5120]: I0316 16:46:36.494618 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/135e00b3-e635-4283-912a-4d92b9980619-config-data\") pod \"placement-744476466-rznwv\" (UID: \"135e00b3-e635-4283-912a-4d92b9980619\") " pod="openstack-kuttl-tests/placement-744476466-rznwv" Mar 16 16:46:36 crc kubenswrapper[5120]: I0316 16:46:36.494739 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jls7z\" (UniqueName: \"kubernetes.io/projected/135e00b3-e635-4283-912a-4d92b9980619-kube-api-access-jls7z\") pod \"placement-744476466-rznwv\" (UID: \"135e00b3-e635-4283-912a-4d92b9980619\") " pod="openstack-kuttl-tests/placement-744476466-rznwv" Mar 16 16:46:36 crc kubenswrapper[5120]: I0316 16:46:36.597490 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/135e00b3-e635-4283-912a-4d92b9980619-logs\") pod \"placement-744476466-rznwv\" (UID: \"135e00b3-e635-4283-912a-4d92b9980619\") " pod="openstack-kuttl-tests/placement-744476466-rznwv" Mar 16 16:46:36 crc kubenswrapper[5120]: I0316 16:46:36.597818 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/135e00b3-e635-4283-912a-4d92b9980619-combined-ca-bundle\") pod \"placement-744476466-rznwv\" (UID: \"135e00b3-e635-4283-912a-4d92b9980619\") " pod="openstack-kuttl-tests/placement-744476466-rznwv" Mar 16 16:46:36 crc kubenswrapper[5120]: I0316 16:46:36.597972 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/135e00b3-e635-4283-912a-4d92b9980619-config-data\") pod \"placement-744476466-rznwv\" (UID: \"135e00b3-e635-4283-912a-4d92b9980619\") " pod="openstack-kuttl-tests/placement-744476466-rznwv" Mar 16 16:46:36 crc kubenswrapper[5120]: I0316 16:46:36.598078 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jls7z\" (UniqueName: \"kubernetes.io/projected/135e00b3-e635-4283-912a-4d92b9980619-kube-api-access-jls7z\") pod \"placement-744476466-rznwv\" (UID: \"135e00b3-e635-4283-912a-4d92b9980619\") " pod="openstack-kuttl-tests/placement-744476466-rznwv" Mar 16 16:46:36 crc kubenswrapper[5120]: I0316 16:46:36.598075 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/135e00b3-e635-4283-912a-4d92b9980619-logs\") pod \"placement-744476466-rznwv\" (UID: \"135e00b3-e635-4283-912a-4d92b9980619\") " pod="openstack-kuttl-tests/placement-744476466-rznwv" Mar 16 16:46:36 crc kubenswrapper[5120]: I0316 16:46:36.598443 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/135e00b3-e635-4283-912a-4d92b9980619-scripts\") pod \"placement-744476466-rznwv\" (UID: \"135e00b3-e635-4283-912a-4d92b9980619\") " pod="openstack-kuttl-tests/placement-744476466-rznwv" Mar 16 16:46:36 crc kubenswrapper[5120]: I0316 16:46:36.605627 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/135e00b3-e635-4283-912a-4d92b9980619-combined-ca-bundle\") pod \"placement-744476466-rznwv\" (UID: \"135e00b3-e635-4283-912a-4d92b9980619\") " pod="openstack-kuttl-tests/placement-744476466-rznwv" Mar 16 16:46:36 crc kubenswrapper[5120]: I0316 16:46:36.605700 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/135e00b3-e635-4283-912a-4d92b9980619-config-data\") pod \"placement-744476466-rznwv\" (UID: \"135e00b3-e635-4283-912a-4d92b9980619\") " pod="openstack-kuttl-tests/placement-744476466-rznwv" Mar 16 16:46:36 crc kubenswrapper[5120]: I0316 16:46:36.606234 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/135e00b3-e635-4283-912a-4d92b9980619-scripts\") pod \"placement-744476466-rznwv\" (UID: \"135e00b3-e635-4283-912a-4d92b9980619\") " pod="openstack-kuttl-tests/placement-744476466-rznwv" Mar 16 16:46:36 crc kubenswrapper[5120]: I0316 16:46:36.616523 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jls7z\" (UniqueName: \"kubernetes.io/projected/135e00b3-e635-4283-912a-4d92b9980619-kube-api-access-jls7z\") pod \"placement-744476466-rznwv\" (UID: \"135e00b3-e635-4283-912a-4d92b9980619\") " pod="openstack-kuttl-tests/placement-744476466-rznwv" Mar 16 16:46:36 crc kubenswrapper[5120]: I0316 16:46:36.722083 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-744476466-rznwv" Mar 16 16:46:37 crc kubenswrapper[5120]: I0316 16:46:37.165100 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-744476466-rznwv"] Mar 16 16:46:38 crc kubenswrapper[5120]: I0316 16:46:38.046983 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-744476466-rznwv" event={"ID":"135e00b3-e635-4283-912a-4d92b9980619","Type":"ContainerStarted","Data":"c53f7e092db576b6e0e10d597a048f947c016b1156713955f8e87ff0ba09916d"} Mar 16 16:46:38 crc kubenswrapper[5120]: I0316 16:46:38.047593 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-744476466-rznwv" Mar 16 16:46:38 crc kubenswrapper[5120]: I0316 16:46:38.047647 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-744476466-rznwv" event={"ID":"135e00b3-e635-4283-912a-4d92b9980619","Type":"ContainerStarted","Data":"8232234c6702e776970ca9018deee4f37ee79888d00739aa240d430b731caae0"} Mar 16 16:46:38 crc kubenswrapper[5120]: I0316 16:46:38.047666 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-744476466-rznwv" Mar 16 16:46:38 crc kubenswrapper[5120]: I0316 16:46:38.047679 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-744476466-rznwv" event={"ID":"135e00b3-e635-4283-912a-4d92b9980619","Type":"ContainerStarted","Data":"521282fc97e706c2eedba63d9722b73e97a040e5e8f94a15cb21248c0eb7736a"} Mar 16 16:46:38 crc kubenswrapper[5120]: I0316 16:46:38.082380 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-744476466-rznwv" podStartSLOduration=2.082356636 podStartE2EDuration="2.082356636s" podCreationTimestamp="2026-03-16 16:46:36 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:46:38.067498072 +0000 UTC m=+4500.221429729" watchObservedRunningTime="2026-03-16 16:46:38.082356636 +0000 UTC m=+4500.236288293" Mar 16 16:46:38 crc kubenswrapper[5120]: I0316 16:46:38.795081 5120 scope.go:117] "RemoveContainer" containerID="72701fdf1cf1cec7e9fae9d3f4b6fff794c32859c8aaa391b361a4000e46a79b" Mar 16 16:46:38 crc kubenswrapper[5120]: I0316 16:46:38.910455 5120 scope.go:117] "RemoveContainer" containerID="3bcec915e7223bdb07f6613dbdea33acad9483e93a74956f3fd570255480cc93" Mar 16 16:46:38 crc kubenswrapper[5120]: I0316 16:46:38.942366 5120 scope.go:117] "RemoveContainer" containerID="349678580bf491d57538e484f9dd1d67a9b8ab9a5d78de41e2d1b85ff9f12a0f" Mar 16 16:46:39 crc kubenswrapper[5120]: I0316 16:46:39.028838 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:46:39 crc kubenswrapper[5120]: I0316 16:46:39.150298 5120 scope.go:117] "RemoveContainer" containerID="aadc12739b009e1a848bf4915d0375cc6b1442f11f47066a9eec1aa733161216" Mar 16 16:46:39 crc kubenswrapper[5120]: I0316 16:46:39.175371 5120 scope.go:117] "RemoveContainer" containerID="1ea409ae64b201ef508d30db2aa0c4c11a4740db227c558e18bd2fa6b2daf45e" Mar 16 16:46:45 crc kubenswrapper[5120]: I0316 16:46:45.684039 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-v822j_ac55471d-4e42-475f-a082-50f611571482/kube-multus/0.log" Mar 16 16:46:45 crc kubenswrapper[5120]: I0316 16:46:45.689105 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-crc_9f0bc7fcb0822a2c13eb2d22cd8c0641/kube-controller-manager/0.log" Mar 16 16:46:45 crc kubenswrapper[5120]: I0316 16:46:45.696693 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-v822j_ac55471d-4e42-475f-a082-50f611571482/kube-multus/0.log" Mar 16 16:46:45 crc kubenswrapper[5120]: I0316 16:46:45.701006 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-crc_9f0bc7fcb0822a2c13eb2d22cd8c0641/kube-controller-manager/0.log" Mar 16 16:46:47 crc kubenswrapper[5120]: I0316 16:46:47.995735 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/keystone-5c4b57cb66-89p9b" Mar 16 16:46:50 crc kubenswrapper[5120]: I0316 16:46:50.664166 5120 scope.go:117] "RemoveContainer" containerID="35a7dd6e19084cee69ca16203bca6378ea0cdf6a685ca2093ab847e5904eb9e6" Mar 16 16:46:50 crc kubenswrapper[5120]: E0316 16:46:50.664698 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:46:51 crc kubenswrapper[5120]: I0316 16:46:51.710458 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/neutron-c59d54458-jxsr6" Mar 16 16:46:51 crc kubenswrapper[5120]: I0316 16:46:51.992131 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 16:46:51 crc kubenswrapper[5120]: I0316 16:46:51.999451 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Mar 16 16:46:52 crc kubenswrapper[5120]: I0316 16:46:52.002482 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"openstackclient-openstackclient-dockercfg-lvnzz\"" Mar 16 16:46:52 crc kubenswrapper[5120]: I0316 16:46:52.002736 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-config\"" Mar 16 16:46:52 crc kubenswrapper[5120]: I0316 16:46:52.002933 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"openstack-config-secret\"" Mar 16 16:46:52 crc kubenswrapper[5120]: I0316 16:46:52.009375 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 16:46:52 crc kubenswrapper[5120]: I0316 16:46:52.079532 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c89f3439-256a-47de-9a4b-33f3a5231721-combined-ca-bundle\") pod \"openstackclient\" (UID: \"c89f3439-256a-47de-9a4b-33f3a5231721\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:46:52 crc kubenswrapper[5120]: I0316 16:46:52.079726 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cx8mt\" (UniqueName: \"kubernetes.io/projected/c89f3439-256a-47de-9a4b-33f3a5231721-kube-api-access-cx8mt\") pod \"openstackclient\" (UID: \"c89f3439-256a-47de-9a4b-33f3a5231721\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:46:52 crc kubenswrapper[5120]: I0316 16:46:52.080151 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/c89f3439-256a-47de-9a4b-33f3a5231721-openstack-config\") pod \"openstackclient\" (UID: \"c89f3439-256a-47de-9a4b-33f3a5231721\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:46:52 crc kubenswrapper[5120]: I0316 16:46:52.080289 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/c89f3439-256a-47de-9a4b-33f3a5231721-openstack-config-secret\") pod \"openstackclient\" (UID: \"c89f3439-256a-47de-9a4b-33f3a5231721\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:46:52 crc kubenswrapper[5120]: I0316 16:46:52.181753 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cx8mt\" (UniqueName: \"kubernetes.io/projected/c89f3439-256a-47de-9a4b-33f3a5231721-kube-api-access-cx8mt\") pod \"openstackclient\" (UID: \"c89f3439-256a-47de-9a4b-33f3a5231721\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:46:52 crc kubenswrapper[5120]: I0316 16:46:52.181952 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/c89f3439-256a-47de-9a4b-33f3a5231721-openstack-config\") pod \"openstackclient\" (UID: \"c89f3439-256a-47de-9a4b-33f3a5231721\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:46:52 crc kubenswrapper[5120]: I0316 16:46:52.182022 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/c89f3439-256a-47de-9a4b-33f3a5231721-openstack-config-secret\") pod \"openstackclient\" (UID: \"c89f3439-256a-47de-9a4b-33f3a5231721\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:46:52 crc kubenswrapper[5120]: I0316 16:46:52.182205 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c89f3439-256a-47de-9a4b-33f3a5231721-combined-ca-bundle\") pod \"openstackclient\" (UID: \"c89f3439-256a-47de-9a4b-33f3a5231721\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:46:52 crc kubenswrapper[5120]: I0316 16:46:52.184060 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/c89f3439-256a-47de-9a4b-33f3a5231721-openstack-config\") pod \"openstackclient\" (UID: \"c89f3439-256a-47de-9a4b-33f3a5231721\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:46:52 crc kubenswrapper[5120]: I0316 16:46:52.190800 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c89f3439-256a-47de-9a4b-33f3a5231721-combined-ca-bundle\") pod \"openstackclient\" (UID: \"c89f3439-256a-47de-9a4b-33f3a5231721\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:46:52 crc kubenswrapper[5120]: I0316 16:46:52.191435 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/c89f3439-256a-47de-9a4b-33f3a5231721-openstack-config-secret\") pod \"openstackclient\" (UID: \"c89f3439-256a-47de-9a4b-33f3a5231721\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:46:52 crc kubenswrapper[5120]: I0316 16:46:52.205855 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cx8mt\" (UniqueName: \"kubernetes.io/projected/c89f3439-256a-47de-9a4b-33f3a5231721-kube-api-access-cx8mt\") pod \"openstackclient\" (UID: \"c89f3439-256a-47de-9a4b-33f3a5231721\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:46:52 crc kubenswrapper[5120]: I0316 16:46:52.334675 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Mar 16 16:46:52 crc kubenswrapper[5120]: W0316 16:46:52.791939 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc89f3439_256a_47de_9a4b_33f3a5231721.slice/crio-4831e611d35132b682e0ca65ab25b631e7c2ca20556cefed239add40558374a0 WatchSource:0}: Error finding container 4831e611d35132b682e0ca65ab25b631e7c2ca20556cefed239add40558374a0: Status 404 returned error can't find the container with id 4831e611d35132b682e0ca65ab25b631e7c2ca20556cefed239add40558374a0 Mar 16 16:46:52 crc kubenswrapper[5120]: I0316 16:46:52.793930 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 16:46:53 crc kubenswrapper[5120]: I0316 16:46:53.222241 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstackclient" event={"ID":"c89f3439-256a-47de-9a4b-33f3a5231721","Type":"ContainerStarted","Data":"e57a4c9ac68cdf613fab20d09b18fbc7abe70575a805ef23da6a7c2bb2219851"} Mar 16 16:46:53 crc kubenswrapper[5120]: I0316 16:46:53.222614 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstackclient" event={"ID":"c89f3439-256a-47de-9a4b-33f3a5231721","Type":"ContainerStarted","Data":"4831e611d35132b682e0ca65ab25b631e7c2ca20556cefed239add40558374a0"} Mar 16 16:46:54 crc kubenswrapper[5120]: I0316 16:46:54.339342 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstackclient" podStartSLOduration=3.339319148 podStartE2EDuration="3.339319148s" podCreationTimestamp="2026-03-16 16:46:51 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:46:53.289071638 +0000 UTC m=+4515.443003305" watchObservedRunningTime="2026-03-16 16:46:54.339319148 +0000 UTC m=+4516.493250805" Mar 16 16:46:54 crc kubenswrapper[5120]: I0316 16:46:54.347455 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:46:54 crc kubenswrapper[5120]: I0316 16:46:54.347738 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="69041368-3d55-45dc-82b1-6880eff4c75f" containerName="ceilometer-central-agent" containerID="cri-o://33d0e5a780156723eacebd11e487d2496152b46a9b10a72a8efc178ca749e8e2" gracePeriod=30 Mar 16 16:46:54 crc kubenswrapper[5120]: I0316 16:46:54.347852 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="69041368-3d55-45dc-82b1-6880eff4c75f" containerName="proxy-httpd" containerID="cri-o://c0f907cdc02c1cadc88f78979038f82963123d98be8b6a203795b6b07e9b470b" gracePeriod=30 Mar 16 16:46:54 crc kubenswrapper[5120]: I0316 16:46:54.347895 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="69041368-3d55-45dc-82b1-6880eff4c75f" containerName="sg-core" containerID="cri-o://4a05de3cf2a25759a43b272be6e2c9c4e0e5961db58b0cf3d9152985af452edd" gracePeriod=30 Mar 16 16:46:54 crc kubenswrapper[5120]: I0316 16:46:54.347968 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="69041368-3d55-45dc-82b1-6880eff4c75f" containerName="ceilometer-notification-agent" containerID="cri-o://d8e5e912050e5f5eb58c05109643a945e6d57c1d01ee32094185da4f827c3c99" gracePeriod=30 Mar 16 16:46:54 crc kubenswrapper[5120]: I0316 16:46:54.357277 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.111940 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.243365 5120 generic.go:358] "Generic (PLEG): container finished" podID="69041368-3d55-45dc-82b1-6880eff4c75f" containerID="c0f907cdc02c1cadc88f78979038f82963123d98be8b6a203795b6b07e9b470b" exitCode=0 Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.243393 5120 generic.go:358] "Generic (PLEG): container finished" podID="69041368-3d55-45dc-82b1-6880eff4c75f" containerID="4a05de3cf2a25759a43b272be6e2c9c4e0e5961db58b0cf3d9152985af452edd" exitCode=2 Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.243401 5120 generic.go:358] "Generic (PLEG): container finished" podID="69041368-3d55-45dc-82b1-6880eff4c75f" containerID="d8e5e912050e5f5eb58c05109643a945e6d57c1d01ee32094185da4f827c3c99" exitCode=0 Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.243399 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"69041368-3d55-45dc-82b1-6880eff4c75f","Type":"ContainerDied","Data":"c0f907cdc02c1cadc88f78979038f82963123d98be8b6a203795b6b07e9b470b"} Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.243436 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"69041368-3d55-45dc-82b1-6880eff4c75f","Type":"ContainerDied","Data":"4a05de3cf2a25759a43b272be6e2c9c4e0e5961db58b0cf3d9152985af452edd"} Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.243448 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"69041368-3d55-45dc-82b1-6880eff4c75f","Type":"ContainerDied","Data":"d8e5e912050e5f5eb58c05109643a945e6d57c1d01ee32094185da4f827c3c99"} Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.243458 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"69041368-3d55-45dc-82b1-6880eff4c75f","Type":"ContainerDied","Data":"33d0e5a780156723eacebd11e487d2496152b46a9b10a72a8efc178ca749e8e2"} Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.243473 5120 scope.go:117] "RemoveContainer" containerID="c0f907cdc02c1cadc88f78979038f82963123d98be8b6a203795b6b07e9b470b" Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.243408 5120 generic.go:358] "Generic (PLEG): container finished" podID="69041368-3d55-45dc-82b1-6880eff4c75f" containerID="33d0e5a780156723eacebd11e487d2496152b46a9b10a72a8efc178ca749e8e2" exitCode=0 Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.243502 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.243606 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"69041368-3d55-45dc-82b1-6880eff4c75f","Type":"ContainerDied","Data":"fc014cab76a0214aba3ceedfa3e838e7547aa03a6f9cffc160b3094c414980d9"} Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.260503 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/69041368-3d55-45dc-82b1-6880eff4c75f-run-httpd\") pod \"69041368-3d55-45dc-82b1-6880eff4c75f\" (UID: \"69041368-3d55-45dc-82b1-6880eff4c75f\") " Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.260615 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/69041368-3d55-45dc-82b1-6880eff4c75f-scripts\") pod \"69041368-3d55-45dc-82b1-6880eff4c75f\" (UID: \"69041368-3d55-45dc-82b1-6880eff4c75f\") " Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.260734 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/69041368-3d55-45dc-82b1-6880eff4c75f-log-httpd\") pod \"69041368-3d55-45dc-82b1-6880eff4c75f\" (UID: \"69041368-3d55-45dc-82b1-6880eff4c75f\") " Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.260870 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-29xzr\" (UniqueName: \"kubernetes.io/projected/69041368-3d55-45dc-82b1-6880eff4c75f-kube-api-access-29xzr\") pod \"69041368-3d55-45dc-82b1-6880eff4c75f\" (UID: \"69041368-3d55-45dc-82b1-6880eff4c75f\") " Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.261021 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/69041368-3d55-45dc-82b1-6880eff4c75f-combined-ca-bundle\") pod \"69041368-3d55-45dc-82b1-6880eff4c75f\" (UID: \"69041368-3d55-45dc-82b1-6880eff4c75f\") " Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.261511 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/69041368-3d55-45dc-82b1-6880eff4c75f-sg-core-conf-yaml\") pod \"69041368-3d55-45dc-82b1-6880eff4c75f\" (UID: \"69041368-3d55-45dc-82b1-6880eff4c75f\") " Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.261543 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69041368-3d55-45dc-82b1-6880eff4c75f-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "69041368-3d55-45dc-82b1-6880eff4c75f" (UID: "69041368-3d55-45dc-82b1-6880eff4c75f"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.261721 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/69041368-3d55-45dc-82b1-6880eff4c75f-config-data\") pod \"69041368-3d55-45dc-82b1-6880eff4c75f\" (UID: \"69041368-3d55-45dc-82b1-6880eff4c75f\") " Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.262144 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69041368-3d55-45dc-82b1-6880eff4c75f-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "69041368-3d55-45dc-82b1-6880eff4c75f" (UID: "69041368-3d55-45dc-82b1-6880eff4c75f"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.262992 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/69041368-3d55-45dc-82b1-6880eff4c75f-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.263014 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/69041368-3d55-45dc-82b1-6880eff4c75f-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.268120 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69041368-3d55-45dc-82b1-6880eff4c75f-kube-api-access-29xzr" (OuterVolumeSpecName: "kube-api-access-29xzr") pod "69041368-3d55-45dc-82b1-6880eff4c75f" (UID: "69041368-3d55-45dc-82b1-6880eff4c75f"). InnerVolumeSpecName "kube-api-access-29xzr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.269260 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69041368-3d55-45dc-82b1-6880eff4c75f-scripts" (OuterVolumeSpecName: "scripts") pod "69041368-3d55-45dc-82b1-6880eff4c75f" (UID: "69041368-3d55-45dc-82b1-6880eff4c75f"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.293125 5120 scope.go:117] "RemoveContainer" containerID="4a05de3cf2a25759a43b272be6e2c9c4e0e5961db58b0cf3d9152985af452edd" Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.306585 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69041368-3d55-45dc-82b1-6880eff4c75f-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "69041368-3d55-45dc-82b1-6880eff4c75f" (UID: "69041368-3d55-45dc-82b1-6880eff4c75f"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.322819 5120 scope.go:117] "RemoveContainer" containerID="d8e5e912050e5f5eb58c05109643a945e6d57c1d01ee32094185da4f827c3c99" Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.367157 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-29xzr\" (UniqueName: \"kubernetes.io/projected/69041368-3d55-45dc-82b1-6880eff4c75f-kube-api-access-29xzr\") on node \"crc\" DevicePath \"\"" Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.367207 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/69041368-3d55-45dc-82b1-6880eff4c75f-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.367221 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/69041368-3d55-45dc-82b1-6880eff4c75f-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.372535 5120 scope.go:117] "RemoveContainer" containerID="33d0e5a780156723eacebd11e487d2496152b46a9b10a72a8efc178ca749e8e2" Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.373641 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69041368-3d55-45dc-82b1-6880eff4c75f-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "69041368-3d55-45dc-82b1-6880eff4c75f" (UID: "69041368-3d55-45dc-82b1-6880eff4c75f"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.380433 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69041368-3d55-45dc-82b1-6880eff4c75f-config-data" (OuterVolumeSpecName: "config-data") pod "69041368-3d55-45dc-82b1-6880eff4c75f" (UID: "69041368-3d55-45dc-82b1-6880eff4c75f"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.454900 5120 scope.go:117] "RemoveContainer" containerID="c0f907cdc02c1cadc88f78979038f82963123d98be8b6a203795b6b07e9b470b" Mar 16 16:46:55 crc kubenswrapper[5120]: E0316 16:46:55.458938 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c0f907cdc02c1cadc88f78979038f82963123d98be8b6a203795b6b07e9b470b\": container with ID starting with c0f907cdc02c1cadc88f78979038f82963123d98be8b6a203795b6b07e9b470b not found: ID does not exist" containerID="c0f907cdc02c1cadc88f78979038f82963123d98be8b6a203795b6b07e9b470b" Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.458988 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0f907cdc02c1cadc88f78979038f82963123d98be8b6a203795b6b07e9b470b"} err="failed to get container status \"c0f907cdc02c1cadc88f78979038f82963123d98be8b6a203795b6b07e9b470b\": rpc error: code = NotFound desc = could not find container \"c0f907cdc02c1cadc88f78979038f82963123d98be8b6a203795b6b07e9b470b\": container with ID starting with c0f907cdc02c1cadc88f78979038f82963123d98be8b6a203795b6b07e9b470b not found: ID does not exist" Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.459015 5120 scope.go:117] "RemoveContainer" containerID="4a05de3cf2a25759a43b272be6e2c9c4e0e5961db58b0cf3d9152985af452edd" Mar 16 16:46:55 crc kubenswrapper[5120]: E0316 16:46:55.467022 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4a05de3cf2a25759a43b272be6e2c9c4e0e5961db58b0cf3d9152985af452edd\": container with ID starting with 4a05de3cf2a25759a43b272be6e2c9c4e0e5961db58b0cf3d9152985af452edd not found: ID does not exist" containerID="4a05de3cf2a25759a43b272be6e2c9c4e0e5961db58b0cf3d9152985af452edd" Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.467097 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a05de3cf2a25759a43b272be6e2c9c4e0e5961db58b0cf3d9152985af452edd"} err="failed to get container status \"4a05de3cf2a25759a43b272be6e2c9c4e0e5961db58b0cf3d9152985af452edd\": rpc error: code = NotFound desc = could not find container \"4a05de3cf2a25759a43b272be6e2c9c4e0e5961db58b0cf3d9152985af452edd\": container with ID starting with 4a05de3cf2a25759a43b272be6e2c9c4e0e5961db58b0cf3d9152985af452edd not found: ID does not exist" Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.467133 5120 scope.go:117] "RemoveContainer" containerID="d8e5e912050e5f5eb58c05109643a945e6d57c1d01ee32094185da4f827c3c99" Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.469875 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/69041368-3d55-45dc-82b1-6880eff4c75f-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.469902 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/69041368-3d55-45dc-82b1-6880eff4c75f-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:46:55 crc kubenswrapper[5120]: E0316 16:46:55.470904 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d8e5e912050e5f5eb58c05109643a945e6d57c1d01ee32094185da4f827c3c99\": container with ID starting with d8e5e912050e5f5eb58c05109643a945e6d57c1d01ee32094185da4f827c3c99 not found: ID does not exist" containerID="d8e5e912050e5f5eb58c05109643a945e6d57c1d01ee32094185da4f827c3c99" Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.470955 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8e5e912050e5f5eb58c05109643a945e6d57c1d01ee32094185da4f827c3c99"} err="failed to get container status \"d8e5e912050e5f5eb58c05109643a945e6d57c1d01ee32094185da4f827c3c99\": rpc error: code = NotFound desc = could not find container \"d8e5e912050e5f5eb58c05109643a945e6d57c1d01ee32094185da4f827c3c99\": container with ID starting with d8e5e912050e5f5eb58c05109643a945e6d57c1d01ee32094185da4f827c3c99 not found: ID does not exist" Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.470986 5120 scope.go:117] "RemoveContainer" containerID="33d0e5a780156723eacebd11e487d2496152b46a9b10a72a8efc178ca749e8e2" Mar 16 16:46:55 crc kubenswrapper[5120]: E0316 16:46:55.482970 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"33d0e5a780156723eacebd11e487d2496152b46a9b10a72a8efc178ca749e8e2\": container with ID starting with 33d0e5a780156723eacebd11e487d2496152b46a9b10a72a8efc178ca749e8e2 not found: ID does not exist" containerID="33d0e5a780156723eacebd11e487d2496152b46a9b10a72a8efc178ca749e8e2" Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.483041 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33d0e5a780156723eacebd11e487d2496152b46a9b10a72a8efc178ca749e8e2"} err="failed to get container status \"33d0e5a780156723eacebd11e487d2496152b46a9b10a72a8efc178ca749e8e2\": rpc error: code = NotFound desc = could not find container \"33d0e5a780156723eacebd11e487d2496152b46a9b10a72a8efc178ca749e8e2\": container with ID starting with 33d0e5a780156723eacebd11e487d2496152b46a9b10a72a8efc178ca749e8e2 not found: ID does not exist" Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.483073 5120 scope.go:117] "RemoveContainer" containerID="c0f907cdc02c1cadc88f78979038f82963123d98be8b6a203795b6b07e9b470b" Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.493833 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0f907cdc02c1cadc88f78979038f82963123d98be8b6a203795b6b07e9b470b"} err="failed to get container status \"c0f907cdc02c1cadc88f78979038f82963123d98be8b6a203795b6b07e9b470b\": rpc error: code = NotFound desc = could not find container \"c0f907cdc02c1cadc88f78979038f82963123d98be8b6a203795b6b07e9b470b\": container with ID starting with c0f907cdc02c1cadc88f78979038f82963123d98be8b6a203795b6b07e9b470b not found: ID does not exist" Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.493912 5120 scope.go:117] "RemoveContainer" containerID="4a05de3cf2a25759a43b272be6e2c9c4e0e5961db58b0cf3d9152985af452edd" Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.497371 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a05de3cf2a25759a43b272be6e2c9c4e0e5961db58b0cf3d9152985af452edd"} err="failed to get container status \"4a05de3cf2a25759a43b272be6e2c9c4e0e5961db58b0cf3d9152985af452edd\": rpc error: code = NotFound desc = could not find container \"4a05de3cf2a25759a43b272be6e2c9c4e0e5961db58b0cf3d9152985af452edd\": container with ID starting with 4a05de3cf2a25759a43b272be6e2c9c4e0e5961db58b0cf3d9152985af452edd not found: ID does not exist" Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.497428 5120 scope.go:117] "RemoveContainer" containerID="d8e5e912050e5f5eb58c05109643a945e6d57c1d01ee32094185da4f827c3c99" Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.498232 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8e5e912050e5f5eb58c05109643a945e6d57c1d01ee32094185da4f827c3c99"} err="failed to get container status \"d8e5e912050e5f5eb58c05109643a945e6d57c1d01ee32094185da4f827c3c99\": rpc error: code = NotFound desc = could not find container \"d8e5e912050e5f5eb58c05109643a945e6d57c1d01ee32094185da4f827c3c99\": container with ID starting with d8e5e912050e5f5eb58c05109643a945e6d57c1d01ee32094185da4f827c3c99 not found: ID does not exist" Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.498267 5120 scope.go:117] "RemoveContainer" containerID="33d0e5a780156723eacebd11e487d2496152b46a9b10a72a8efc178ca749e8e2" Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.502617 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33d0e5a780156723eacebd11e487d2496152b46a9b10a72a8efc178ca749e8e2"} err="failed to get container status \"33d0e5a780156723eacebd11e487d2496152b46a9b10a72a8efc178ca749e8e2\": rpc error: code = NotFound desc = could not find container \"33d0e5a780156723eacebd11e487d2496152b46a9b10a72a8efc178ca749e8e2\": container with ID starting with 33d0e5a780156723eacebd11e487d2496152b46a9b10a72a8efc178ca749e8e2 not found: ID does not exist" Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.502664 5120 scope.go:117] "RemoveContainer" containerID="c0f907cdc02c1cadc88f78979038f82963123d98be8b6a203795b6b07e9b470b" Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.512956 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0f907cdc02c1cadc88f78979038f82963123d98be8b6a203795b6b07e9b470b"} err="failed to get container status \"c0f907cdc02c1cadc88f78979038f82963123d98be8b6a203795b6b07e9b470b\": rpc error: code = NotFound desc = could not find container \"c0f907cdc02c1cadc88f78979038f82963123d98be8b6a203795b6b07e9b470b\": container with ID starting with c0f907cdc02c1cadc88f78979038f82963123d98be8b6a203795b6b07e9b470b not found: ID does not exist" Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.513012 5120 scope.go:117] "RemoveContainer" containerID="4a05de3cf2a25759a43b272be6e2c9c4e0e5961db58b0cf3d9152985af452edd" Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.518476 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a05de3cf2a25759a43b272be6e2c9c4e0e5961db58b0cf3d9152985af452edd"} err="failed to get container status \"4a05de3cf2a25759a43b272be6e2c9c4e0e5961db58b0cf3d9152985af452edd\": rpc error: code = NotFound desc = could not find container \"4a05de3cf2a25759a43b272be6e2c9c4e0e5961db58b0cf3d9152985af452edd\": container with ID starting with 4a05de3cf2a25759a43b272be6e2c9c4e0e5961db58b0cf3d9152985af452edd not found: ID does not exist" Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.518516 5120 scope.go:117] "RemoveContainer" containerID="d8e5e912050e5f5eb58c05109643a945e6d57c1d01ee32094185da4f827c3c99" Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.521860 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8e5e912050e5f5eb58c05109643a945e6d57c1d01ee32094185da4f827c3c99"} err="failed to get container status \"d8e5e912050e5f5eb58c05109643a945e6d57c1d01ee32094185da4f827c3c99\": rpc error: code = NotFound desc = could not find container \"d8e5e912050e5f5eb58c05109643a945e6d57c1d01ee32094185da4f827c3c99\": container with ID starting with d8e5e912050e5f5eb58c05109643a945e6d57c1d01ee32094185da4f827c3c99 not found: ID does not exist" Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.521916 5120 scope.go:117] "RemoveContainer" containerID="33d0e5a780156723eacebd11e487d2496152b46a9b10a72a8efc178ca749e8e2" Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.525933 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33d0e5a780156723eacebd11e487d2496152b46a9b10a72a8efc178ca749e8e2"} err="failed to get container status \"33d0e5a780156723eacebd11e487d2496152b46a9b10a72a8efc178ca749e8e2\": rpc error: code = NotFound desc = could not find container \"33d0e5a780156723eacebd11e487d2496152b46a9b10a72a8efc178ca749e8e2\": container with ID starting with 33d0e5a780156723eacebd11e487d2496152b46a9b10a72a8efc178ca749e8e2 not found: ID does not exist" Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.525980 5120 scope.go:117] "RemoveContainer" containerID="c0f907cdc02c1cadc88f78979038f82963123d98be8b6a203795b6b07e9b470b" Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.531190 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0f907cdc02c1cadc88f78979038f82963123d98be8b6a203795b6b07e9b470b"} err="failed to get container status \"c0f907cdc02c1cadc88f78979038f82963123d98be8b6a203795b6b07e9b470b\": rpc error: code = NotFound desc = could not find container \"c0f907cdc02c1cadc88f78979038f82963123d98be8b6a203795b6b07e9b470b\": container with ID starting with c0f907cdc02c1cadc88f78979038f82963123d98be8b6a203795b6b07e9b470b not found: ID does not exist" Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.531233 5120 scope.go:117] "RemoveContainer" containerID="4a05de3cf2a25759a43b272be6e2c9c4e0e5961db58b0cf3d9152985af452edd" Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.531461 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a05de3cf2a25759a43b272be6e2c9c4e0e5961db58b0cf3d9152985af452edd"} err="failed to get container status \"4a05de3cf2a25759a43b272be6e2c9c4e0e5961db58b0cf3d9152985af452edd\": rpc error: code = NotFound desc = could not find container \"4a05de3cf2a25759a43b272be6e2c9c4e0e5961db58b0cf3d9152985af452edd\": container with ID starting with 4a05de3cf2a25759a43b272be6e2c9c4e0e5961db58b0cf3d9152985af452edd not found: ID does not exist" Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.531477 5120 scope.go:117] "RemoveContainer" containerID="d8e5e912050e5f5eb58c05109643a945e6d57c1d01ee32094185da4f827c3c99" Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.531648 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8e5e912050e5f5eb58c05109643a945e6d57c1d01ee32094185da4f827c3c99"} err="failed to get container status \"d8e5e912050e5f5eb58c05109643a945e6d57c1d01ee32094185da4f827c3c99\": rpc error: code = NotFound desc = could not find container \"d8e5e912050e5f5eb58c05109643a945e6d57c1d01ee32094185da4f827c3c99\": container with ID starting with d8e5e912050e5f5eb58c05109643a945e6d57c1d01ee32094185da4f827c3c99 not found: ID does not exist" Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.531662 5120 scope.go:117] "RemoveContainer" containerID="33d0e5a780156723eacebd11e487d2496152b46a9b10a72a8efc178ca749e8e2" Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.531835 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33d0e5a780156723eacebd11e487d2496152b46a9b10a72a8efc178ca749e8e2"} err="failed to get container status \"33d0e5a780156723eacebd11e487d2496152b46a9b10a72a8efc178ca749e8e2\": rpc error: code = NotFound desc = could not find container \"33d0e5a780156723eacebd11e487d2496152b46a9b10a72a8efc178ca749e8e2\": container with ID starting with 33d0e5a780156723eacebd11e487d2496152b46a9b10a72a8efc178ca749e8e2 not found: ID does not exist" Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.537364 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/swift-proxy-cc67b5786-c2cmq"] Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.539524 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69041368-3d55-45dc-82b1-6880eff4c75f" containerName="ceilometer-notification-agent" Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.539557 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="69041368-3d55-45dc-82b1-6880eff4c75f" containerName="ceilometer-notification-agent" Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.539576 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69041368-3d55-45dc-82b1-6880eff4c75f" containerName="ceilometer-central-agent" Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.539583 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="69041368-3d55-45dc-82b1-6880eff4c75f" containerName="ceilometer-central-agent" Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.539623 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69041368-3d55-45dc-82b1-6880eff4c75f" containerName="proxy-httpd" Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.539633 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="69041368-3d55-45dc-82b1-6880eff4c75f" containerName="proxy-httpd" Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.539660 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69041368-3d55-45dc-82b1-6880eff4c75f" containerName="sg-core" Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.539666 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="69041368-3d55-45dc-82b1-6880eff4c75f" containerName="sg-core" Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.539864 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="69041368-3d55-45dc-82b1-6880eff4c75f" containerName="proxy-httpd" Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.539879 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="69041368-3d55-45dc-82b1-6880eff4c75f" containerName="ceilometer-notification-agent" Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.539886 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="69041368-3d55-45dc-82b1-6880eff4c75f" containerName="sg-core" Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.539894 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="69041368-3d55-45dc-82b1-6880eff4c75f" containerName="ceilometer-central-agent" Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.688438 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-proxy-cc67b5786-c2cmq"] Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.688547 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.688561 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.689532 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-cc67b5786-c2cmq" Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.699199 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"swift-proxy-config-data\"" Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.709098 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.781585 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e367a07e-829a-4ad9-96b4-c91caa885ac7-combined-ca-bundle\") pod \"swift-proxy-cc67b5786-c2cmq\" (UID: \"e367a07e-829a-4ad9-96b4-c91caa885ac7\") " pod="openstack-kuttl-tests/swift-proxy-cc67b5786-c2cmq" Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.781679 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e367a07e-829a-4ad9-96b4-c91caa885ac7-log-httpd\") pod \"swift-proxy-cc67b5786-c2cmq\" (UID: \"e367a07e-829a-4ad9-96b4-c91caa885ac7\") " pod="openstack-kuttl-tests/swift-proxy-cc67b5786-c2cmq" Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.781815 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6s4mc\" (UniqueName: \"kubernetes.io/projected/e367a07e-829a-4ad9-96b4-c91caa885ac7-kube-api-access-6s4mc\") pod \"swift-proxy-cc67b5786-c2cmq\" (UID: \"e367a07e-829a-4ad9-96b4-c91caa885ac7\") " pod="openstack-kuttl-tests/swift-proxy-cc67b5786-c2cmq" Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.782238 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e367a07e-829a-4ad9-96b4-c91caa885ac7-config-data\") pod \"swift-proxy-cc67b5786-c2cmq\" (UID: \"e367a07e-829a-4ad9-96b4-c91caa885ac7\") " pod="openstack-kuttl-tests/swift-proxy-cc67b5786-c2cmq" Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.782314 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/e367a07e-829a-4ad9-96b4-c91caa885ac7-etc-swift\") pod \"swift-proxy-cc67b5786-c2cmq\" (UID: \"e367a07e-829a-4ad9-96b4-c91caa885ac7\") " pod="openstack-kuttl-tests/swift-proxy-cc67b5786-c2cmq" Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.782341 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e367a07e-829a-4ad9-96b4-c91caa885ac7-run-httpd\") pod \"swift-proxy-cc67b5786-c2cmq\" (UID: \"e367a07e-829a-4ad9-96b4-c91caa885ac7\") " pod="openstack-kuttl-tests/swift-proxy-cc67b5786-c2cmq" Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.812821 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.812950 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.817818 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.824735 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.884616 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e367a07e-829a-4ad9-96b4-c91caa885ac7-config-data\") pod \"swift-proxy-cc67b5786-c2cmq\" (UID: \"e367a07e-829a-4ad9-96b4-c91caa885ac7\") " pod="openstack-kuttl-tests/swift-proxy-cc67b5786-c2cmq" Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.884666 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1ca85760-1e74-418a-be27-e52a2a6dac49-config-data\") pod \"ceilometer-0\" (UID: \"1ca85760-1e74-418a-be27-e52a2a6dac49\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.884708 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/e367a07e-829a-4ad9-96b4-c91caa885ac7-etc-swift\") pod \"swift-proxy-cc67b5786-c2cmq\" (UID: \"e367a07e-829a-4ad9-96b4-c91caa885ac7\") " pod="openstack-kuttl-tests/swift-proxy-cc67b5786-c2cmq" Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.884732 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e367a07e-829a-4ad9-96b4-c91caa885ac7-run-httpd\") pod \"swift-proxy-cc67b5786-c2cmq\" (UID: \"e367a07e-829a-4ad9-96b4-c91caa885ac7\") " pod="openstack-kuttl-tests/swift-proxy-cc67b5786-c2cmq" Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.884875 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1ca85760-1e74-418a-be27-e52a2a6dac49-scripts\") pod \"ceilometer-0\" (UID: \"1ca85760-1e74-418a-be27-e52a2a6dac49\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.885008 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1ca85760-1e74-418a-be27-e52a2a6dac49-log-httpd\") pod \"ceilometer-0\" (UID: \"1ca85760-1e74-418a-be27-e52a2a6dac49\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.885080 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1ca85760-1e74-418a-be27-e52a2a6dac49-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"1ca85760-1e74-418a-be27-e52a2a6dac49\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.885235 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/1ca85760-1e74-418a-be27-e52a2a6dac49-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"1ca85760-1e74-418a-be27-e52a2a6dac49\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.885405 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e367a07e-829a-4ad9-96b4-c91caa885ac7-combined-ca-bundle\") pod \"swift-proxy-cc67b5786-c2cmq\" (UID: \"e367a07e-829a-4ad9-96b4-c91caa885ac7\") " pod="openstack-kuttl-tests/swift-proxy-cc67b5786-c2cmq" Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.885418 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e367a07e-829a-4ad9-96b4-c91caa885ac7-run-httpd\") pod \"swift-proxy-cc67b5786-c2cmq\" (UID: \"e367a07e-829a-4ad9-96b4-c91caa885ac7\") " pod="openstack-kuttl-tests/swift-proxy-cc67b5786-c2cmq" Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.885434 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1ca85760-1e74-418a-be27-e52a2a6dac49-run-httpd\") pod \"ceilometer-0\" (UID: \"1ca85760-1e74-418a-be27-e52a2a6dac49\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.885502 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e367a07e-829a-4ad9-96b4-c91caa885ac7-log-httpd\") pod \"swift-proxy-cc67b5786-c2cmq\" (UID: \"e367a07e-829a-4ad9-96b4-c91caa885ac7\") " pod="openstack-kuttl-tests/swift-proxy-cc67b5786-c2cmq" Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.885577 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6s4mc\" (UniqueName: \"kubernetes.io/projected/e367a07e-829a-4ad9-96b4-c91caa885ac7-kube-api-access-6s4mc\") pod \"swift-proxy-cc67b5786-c2cmq\" (UID: \"e367a07e-829a-4ad9-96b4-c91caa885ac7\") " pod="openstack-kuttl-tests/swift-proxy-cc67b5786-c2cmq" Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.885743 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wj4w\" (UniqueName: \"kubernetes.io/projected/1ca85760-1e74-418a-be27-e52a2a6dac49-kube-api-access-2wj4w\") pod \"ceilometer-0\" (UID: \"1ca85760-1e74-418a-be27-e52a2a6dac49\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.885904 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e367a07e-829a-4ad9-96b4-c91caa885ac7-log-httpd\") pod \"swift-proxy-cc67b5786-c2cmq\" (UID: \"e367a07e-829a-4ad9-96b4-c91caa885ac7\") " pod="openstack-kuttl-tests/swift-proxy-cc67b5786-c2cmq" Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.889213 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e367a07e-829a-4ad9-96b4-c91caa885ac7-combined-ca-bundle\") pod \"swift-proxy-cc67b5786-c2cmq\" (UID: \"e367a07e-829a-4ad9-96b4-c91caa885ac7\") " pod="openstack-kuttl-tests/swift-proxy-cc67b5786-c2cmq" Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.889511 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/e367a07e-829a-4ad9-96b4-c91caa885ac7-etc-swift\") pod \"swift-proxy-cc67b5786-c2cmq\" (UID: \"e367a07e-829a-4ad9-96b4-c91caa885ac7\") " pod="openstack-kuttl-tests/swift-proxy-cc67b5786-c2cmq" Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.889913 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e367a07e-829a-4ad9-96b4-c91caa885ac7-config-data\") pod \"swift-proxy-cc67b5786-c2cmq\" (UID: \"e367a07e-829a-4ad9-96b4-c91caa885ac7\") " pod="openstack-kuttl-tests/swift-proxy-cc67b5786-c2cmq" Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.921037 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6s4mc\" (UniqueName: \"kubernetes.io/projected/e367a07e-829a-4ad9-96b4-c91caa885ac7-kube-api-access-6s4mc\") pod \"swift-proxy-cc67b5786-c2cmq\" (UID: \"e367a07e-829a-4ad9-96b4-c91caa885ac7\") " pod="openstack-kuttl-tests/swift-proxy-cc67b5786-c2cmq" Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.987939 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2wj4w\" (UniqueName: \"kubernetes.io/projected/1ca85760-1e74-418a-be27-e52a2a6dac49-kube-api-access-2wj4w\") pod \"ceilometer-0\" (UID: \"1ca85760-1e74-418a-be27-e52a2a6dac49\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.988025 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1ca85760-1e74-418a-be27-e52a2a6dac49-config-data\") pod \"ceilometer-0\" (UID: \"1ca85760-1e74-418a-be27-e52a2a6dac49\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.988095 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1ca85760-1e74-418a-be27-e52a2a6dac49-scripts\") pod \"ceilometer-0\" (UID: \"1ca85760-1e74-418a-be27-e52a2a6dac49\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.988122 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1ca85760-1e74-418a-be27-e52a2a6dac49-log-httpd\") pod \"ceilometer-0\" (UID: \"1ca85760-1e74-418a-be27-e52a2a6dac49\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.988164 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1ca85760-1e74-418a-be27-e52a2a6dac49-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"1ca85760-1e74-418a-be27-e52a2a6dac49\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.988209 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/1ca85760-1e74-418a-be27-e52a2a6dac49-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"1ca85760-1e74-418a-be27-e52a2a6dac49\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.988278 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1ca85760-1e74-418a-be27-e52a2a6dac49-run-httpd\") pod \"ceilometer-0\" (UID: \"1ca85760-1e74-418a-be27-e52a2a6dac49\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.989026 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1ca85760-1e74-418a-be27-e52a2a6dac49-log-httpd\") pod \"ceilometer-0\" (UID: \"1ca85760-1e74-418a-be27-e52a2a6dac49\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.989110 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1ca85760-1e74-418a-be27-e52a2a6dac49-run-httpd\") pod \"ceilometer-0\" (UID: \"1ca85760-1e74-418a-be27-e52a2a6dac49\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.991945 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/1ca85760-1e74-418a-be27-e52a2a6dac49-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"1ca85760-1e74-418a-be27-e52a2a6dac49\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.992651 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1ca85760-1e74-418a-be27-e52a2a6dac49-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"1ca85760-1e74-418a-be27-e52a2a6dac49\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.992908 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1ca85760-1e74-418a-be27-e52a2a6dac49-scripts\") pod \"ceilometer-0\" (UID: \"1ca85760-1e74-418a-be27-e52a2a6dac49\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:46:55 crc kubenswrapper[5120]: I0316 16:46:55.994094 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1ca85760-1e74-418a-be27-e52a2a6dac49-config-data\") pod \"ceilometer-0\" (UID: \"1ca85760-1e74-418a-be27-e52a2a6dac49\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:46:56 crc kubenswrapper[5120]: I0316 16:46:56.006011 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wj4w\" (UniqueName: \"kubernetes.io/projected/1ca85760-1e74-418a-be27-e52a2a6dac49-kube-api-access-2wj4w\") pod \"ceilometer-0\" (UID: \"1ca85760-1e74-418a-be27-e52a2a6dac49\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:46:56 crc kubenswrapper[5120]: I0316 16:46:56.034406 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-cc67b5786-c2cmq" Mar 16 16:46:56 crc kubenswrapper[5120]: I0316 16:46:56.135067 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:46:56 crc kubenswrapper[5120]: I0316 16:46:56.495854 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-proxy-cc67b5786-c2cmq"] Mar 16 16:46:56 crc kubenswrapper[5120]: W0316 16:46:56.502100 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode367a07e_829a_4ad9_96b4_c91caa885ac7.slice/crio-d7be4be7e0b43b0d825bdab3532a165287879d22cbf67c424587176d6463bf40 WatchSource:0}: Error finding container d7be4be7e0b43b0d825bdab3532a165287879d22cbf67c424587176d6463bf40: Status 404 returned error can't find the container with id d7be4be7e0b43b0d825bdab3532a165287879d22cbf67c424587176d6463bf40 Mar 16 16:46:56 crc kubenswrapper[5120]: I0316 16:46:56.650861 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:46:56 crc kubenswrapper[5120]: I0316 16:46:56.687940 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="69041368-3d55-45dc-82b1-6880eff4c75f" path="/var/lib/kubelet/pods/69041368-3d55-45dc-82b1-6880eff4c75f/volumes" Mar 16 16:46:56 crc kubenswrapper[5120]: I0316 16:46:56.689155 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:46:57 crc kubenswrapper[5120]: I0316 16:46:57.283916 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-cc67b5786-c2cmq" event={"ID":"e367a07e-829a-4ad9-96b4-c91caa885ac7","Type":"ContainerStarted","Data":"372c7be9a29c3eff8a82a86058ca9e149effcda013dae07b02322a76efb4777b"} Mar 16 16:46:57 crc kubenswrapper[5120]: I0316 16:46:57.284238 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/swift-proxy-cc67b5786-c2cmq" Mar 16 16:46:57 crc kubenswrapper[5120]: I0316 16:46:57.284250 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-cc67b5786-c2cmq" event={"ID":"e367a07e-829a-4ad9-96b4-c91caa885ac7","Type":"ContainerStarted","Data":"979f2dceced6185d9838ead2e115e9dd970603f1ff26cc2bb6d5fb47a603ffbd"} Mar 16 16:46:57 crc kubenswrapper[5120]: I0316 16:46:57.284259 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-cc67b5786-c2cmq" event={"ID":"e367a07e-829a-4ad9-96b4-c91caa885ac7","Type":"ContainerStarted","Data":"d7be4be7e0b43b0d825bdab3532a165287879d22cbf67c424587176d6463bf40"} Mar 16 16:46:57 crc kubenswrapper[5120]: I0316 16:46:57.286864 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1ca85760-1e74-418a-be27-e52a2a6dac49","Type":"ContainerStarted","Data":"409eeb3e4fb5f9b3ac38fbaf02becb94e56e324674aff7d3038acde8557087ad"} Mar 16 16:46:57 crc kubenswrapper[5120]: I0316 16:46:57.310937 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/swift-proxy-cc67b5786-c2cmq" podStartSLOduration=2.3109163759999998 podStartE2EDuration="2.310916376s" podCreationTimestamp="2026-03-16 16:46:55 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:46:57.303660428 +0000 UTC m=+4519.457592085" watchObservedRunningTime="2026-03-16 16:46:57.310916376 +0000 UTC m=+4519.464848043" Mar 16 16:46:58 crc kubenswrapper[5120]: I0316 16:46:58.296373 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1ca85760-1e74-418a-be27-e52a2a6dac49","Type":"ContainerStarted","Data":"d1fbb00b92463a21cf79b603f3caf860bedd78d33fda25f3945a9d8b45ac41e4"} Mar 16 16:46:58 crc kubenswrapper[5120]: I0316 16:46:58.297088 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/swift-proxy-cc67b5786-c2cmq" Mar 16 16:46:59 crc kubenswrapper[5120]: I0316 16:46:59.321496 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1ca85760-1e74-418a-be27-e52a2a6dac49","Type":"ContainerStarted","Data":"77ec3053fe95ea6ad0e977f3a81112af3412e073e6957bf9bfca69061c9cf477"} Mar 16 16:46:59 crc kubenswrapper[5120]: I0316 16:46:59.321852 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1ca85760-1e74-418a-be27-e52a2a6dac49","Type":"ContainerStarted","Data":"2b78df72dc64bdedfa363ecf3b5f81ebb031eb3a22bfb78605bf75def38398ba"} Mar 16 16:47:00 crc kubenswrapper[5120]: I0316 16:47:00.634851 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-896cw"] Mar 16 16:47:00 crc kubenswrapper[5120]: I0316 16:47:00.640370 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-db-create-896cw" Mar 16 16:47:00 crc kubenswrapper[5120]: I0316 16:47:00.658479 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-896cw"] Mar 16 16:47:00 crc kubenswrapper[5120]: I0316 16:47:00.720219 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckmb5\" (UniqueName: \"kubernetes.io/projected/a4f2ecaa-1975-4371-b2ed-ee48bac2ddfc-kube-api-access-ckmb5\") pod \"nova-api-db-create-896cw\" (UID: \"a4f2ecaa-1975-4371-b2ed-ee48bac2ddfc\") " pod="openstack-kuttl-tests/nova-api-db-create-896cw" Mar 16 16:47:00 crc kubenswrapper[5120]: I0316 16:47:00.721141 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a4f2ecaa-1975-4371-b2ed-ee48bac2ddfc-operator-scripts\") pod \"nova-api-db-create-896cw\" (UID: \"a4f2ecaa-1975-4371-b2ed-ee48bac2ddfc\") " pod="openstack-kuttl-tests/nova-api-db-create-896cw" Mar 16 16:47:00 crc kubenswrapper[5120]: I0316 16:47:00.726956 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-5k6v4"] Mar 16 16:47:00 crc kubenswrapper[5120]: I0316 16:47:00.734423 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-db-create-5k6v4" Mar 16 16:47:00 crc kubenswrapper[5120]: I0316 16:47:00.743827 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-774a-account-create-update-cvlrt"] Mar 16 16:47:00 crc kubenswrapper[5120]: I0316 16:47:00.752941 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-774a-account-create-update-cvlrt" Mar 16 16:47:00 crc kubenswrapper[5120]: I0316 16:47:00.754742 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-5k6v4"] Mar 16 16:47:00 crc kubenswrapper[5120]: I0316 16:47:00.757803 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-db-secret\"" Mar 16 16:47:00 crc kubenswrapper[5120]: I0316 16:47:00.765757 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-774a-account-create-update-cvlrt"] Mar 16 16:47:00 crc kubenswrapper[5120]: I0316 16:47:00.823412 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a4f2ecaa-1975-4371-b2ed-ee48bac2ddfc-operator-scripts\") pod \"nova-api-db-create-896cw\" (UID: \"a4f2ecaa-1975-4371-b2ed-ee48bac2ddfc\") " pod="openstack-kuttl-tests/nova-api-db-create-896cw" Mar 16 16:47:00 crc kubenswrapper[5120]: I0316 16:47:00.823954 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ckmb5\" (UniqueName: \"kubernetes.io/projected/a4f2ecaa-1975-4371-b2ed-ee48bac2ddfc-kube-api-access-ckmb5\") pod \"nova-api-db-create-896cw\" (UID: \"a4f2ecaa-1975-4371-b2ed-ee48bac2ddfc\") " pod="openstack-kuttl-tests/nova-api-db-create-896cw" Mar 16 16:47:00 crc kubenswrapper[5120]: I0316 16:47:00.824043 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/67f5aec7-8a45-4909-ae10-dcbdc979fb43-operator-scripts\") pod \"nova-api-774a-account-create-update-cvlrt\" (UID: \"67f5aec7-8a45-4909-ae10-dcbdc979fb43\") " pod="openstack-kuttl-tests/nova-api-774a-account-create-update-cvlrt" Mar 16 16:47:00 crc kubenswrapper[5120]: I0316 16:47:00.824131 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdxtm\" (UniqueName: \"kubernetes.io/projected/86bdc983-99ae-4f65-b8e0-37bef61cb70f-kube-api-access-rdxtm\") pod \"nova-cell0-db-create-5k6v4\" (UID: \"86bdc983-99ae-4f65-b8e0-37bef61cb70f\") " pod="openstack-kuttl-tests/nova-cell0-db-create-5k6v4" Mar 16 16:47:00 crc kubenswrapper[5120]: I0316 16:47:00.824209 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvk4v\" (UniqueName: \"kubernetes.io/projected/67f5aec7-8a45-4909-ae10-dcbdc979fb43-kube-api-access-fvk4v\") pod \"nova-api-774a-account-create-update-cvlrt\" (UID: \"67f5aec7-8a45-4909-ae10-dcbdc979fb43\") " pod="openstack-kuttl-tests/nova-api-774a-account-create-update-cvlrt" Mar 16 16:47:00 crc kubenswrapper[5120]: I0316 16:47:00.824276 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/86bdc983-99ae-4f65-b8e0-37bef61cb70f-operator-scripts\") pod \"nova-cell0-db-create-5k6v4\" (UID: \"86bdc983-99ae-4f65-b8e0-37bef61cb70f\") " pod="openstack-kuttl-tests/nova-cell0-db-create-5k6v4" Mar 16 16:47:00 crc kubenswrapper[5120]: I0316 16:47:00.824345 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a4f2ecaa-1975-4371-b2ed-ee48bac2ddfc-operator-scripts\") pod \"nova-api-db-create-896cw\" (UID: \"a4f2ecaa-1975-4371-b2ed-ee48bac2ddfc\") " pod="openstack-kuttl-tests/nova-api-db-create-896cw" Mar 16 16:47:00 crc kubenswrapper[5120]: I0316 16:47:00.848832 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckmb5\" (UniqueName: \"kubernetes.io/projected/a4f2ecaa-1975-4371-b2ed-ee48bac2ddfc-kube-api-access-ckmb5\") pod \"nova-api-db-create-896cw\" (UID: \"a4f2ecaa-1975-4371-b2ed-ee48bac2ddfc\") " pod="openstack-kuttl-tests/nova-api-db-create-896cw" Mar 16 16:47:00 crc kubenswrapper[5120]: I0316 16:47:00.923005 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-dq2mb"] Mar 16 16:47:00 crc kubenswrapper[5120]: I0316 16:47:00.926698 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/67f5aec7-8a45-4909-ae10-dcbdc979fb43-operator-scripts\") pod \"nova-api-774a-account-create-update-cvlrt\" (UID: \"67f5aec7-8a45-4909-ae10-dcbdc979fb43\") " pod="openstack-kuttl-tests/nova-api-774a-account-create-update-cvlrt" Mar 16 16:47:00 crc kubenswrapper[5120]: I0316 16:47:00.926799 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rdxtm\" (UniqueName: \"kubernetes.io/projected/86bdc983-99ae-4f65-b8e0-37bef61cb70f-kube-api-access-rdxtm\") pod \"nova-cell0-db-create-5k6v4\" (UID: \"86bdc983-99ae-4f65-b8e0-37bef61cb70f\") " pod="openstack-kuttl-tests/nova-cell0-db-create-5k6v4" Mar 16 16:47:00 crc kubenswrapper[5120]: I0316 16:47:00.926860 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fvk4v\" (UniqueName: \"kubernetes.io/projected/67f5aec7-8a45-4909-ae10-dcbdc979fb43-kube-api-access-fvk4v\") pod \"nova-api-774a-account-create-update-cvlrt\" (UID: \"67f5aec7-8a45-4909-ae10-dcbdc979fb43\") " pod="openstack-kuttl-tests/nova-api-774a-account-create-update-cvlrt" Mar 16 16:47:00 crc kubenswrapper[5120]: I0316 16:47:00.926906 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/86bdc983-99ae-4f65-b8e0-37bef61cb70f-operator-scripts\") pod \"nova-cell0-db-create-5k6v4\" (UID: \"86bdc983-99ae-4f65-b8e0-37bef61cb70f\") " pod="openstack-kuttl-tests/nova-cell0-db-create-5k6v4" Mar 16 16:47:00 crc kubenswrapper[5120]: I0316 16:47:00.927721 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/86bdc983-99ae-4f65-b8e0-37bef61cb70f-operator-scripts\") pod \"nova-cell0-db-create-5k6v4\" (UID: \"86bdc983-99ae-4f65-b8e0-37bef61cb70f\") " pod="openstack-kuttl-tests/nova-cell0-db-create-5k6v4" Mar 16 16:47:00 crc kubenswrapper[5120]: I0316 16:47:00.927901 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/67f5aec7-8a45-4909-ae10-dcbdc979fb43-operator-scripts\") pod \"nova-api-774a-account-create-update-cvlrt\" (UID: \"67f5aec7-8a45-4909-ae10-dcbdc979fb43\") " pod="openstack-kuttl-tests/nova-api-774a-account-create-update-cvlrt" Mar 16 16:47:00 crc kubenswrapper[5120]: I0316 16:47:00.929037 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-db-create-dq2mb" Mar 16 16:47:00 crc kubenswrapper[5120]: I0316 16:47:00.951190 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-dq2mb"] Mar 16 16:47:00 crc kubenswrapper[5120]: I0316 16:47:00.953480 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvk4v\" (UniqueName: \"kubernetes.io/projected/67f5aec7-8a45-4909-ae10-dcbdc979fb43-kube-api-access-fvk4v\") pod \"nova-api-774a-account-create-update-cvlrt\" (UID: \"67f5aec7-8a45-4909-ae10-dcbdc979fb43\") " pod="openstack-kuttl-tests/nova-api-774a-account-create-update-cvlrt" Mar 16 16:47:00 crc kubenswrapper[5120]: I0316 16:47:00.959238 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdxtm\" (UniqueName: \"kubernetes.io/projected/86bdc983-99ae-4f65-b8e0-37bef61cb70f-kube-api-access-rdxtm\") pod \"nova-cell0-db-create-5k6v4\" (UID: \"86bdc983-99ae-4f65-b8e0-37bef61cb70f\") " pod="openstack-kuttl-tests/nova-cell0-db-create-5k6v4" Mar 16 16:47:00 crc kubenswrapper[5120]: I0316 16:47:00.961535 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-5a68-account-create-update-6nxhs"] Mar 16 16:47:00 crc kubenswrapper[5120]: I0316 16:47:00.964221 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-db-create-896cw" Mar 16 16:47:01 crc kubenswrapper[5120]: I0316 16:47:01.005871 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-5a68-account-create-update-6nxhs"] Mar 16 16:47:01 crc kubenswrapper[5120]: I0316 16:47:01.006274 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-5a68-account-create-update-6nxhs" Mar 16 16:47:01 crc kubenswrapper[5120]: I0316 16:47:01.015622 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-db-secret\"" Mar 16 16:47:01 crc kubenswrapper[5120]: I0316 16:47:01.031617 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ll48v\" (UniqueName: \"kubernetes.io/projected/93bf3a3e-5820-451f-b1c4-6e302325b1b7-kube-api-access-ll48v\") pod \"nova-cell1-db-create-dq2mb\" (UID: \"93bf3a3e-5820-451f-b1c4-6e302325b1b7\") " pod="openstack-kuttl-tests/nova-cell1-db-create-dq2mb" Mar 16 16:47:01 crc kubenswrapper[5120]: I0316 16:47:01.032149 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/93bf3a3e-5820-451f-b1c4-6e302325b1b7-operator-scripts\") pod \"nova-cell1-db-create-dq2mb\" (UID: \"93bf3a3e-5820-451f-b1c4-6e302325b1b7\") " pod="openstack-kuttl-tests/nova-cell1-db-create-dq2mb" Mar 16 16:47:01 crc kubenswrapper[5120]: I0316 16:47:01.087184 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-db-create-5k6v4" Mar 16 16:47:01 crc kubenswrapper[5120]: I0316 16:47:01.102052 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-774a-account-create-update-cvlrt" Mar 16 16:47:01 crc kubenswrapper[5120]: I0316 16:47:01.138844 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/93bf3a3e-5820-451f-b1c4-6e302325b1b7-operator-scripts\") pod \"nova-cell1-db-create-dq2mb\" (UID: \"93bf3a3e-5820-451f-b1c4-6e302325b1b7\") " pod="openstack-kuttl-tests/nova-cell1-db-create-dq2mb" Mar 16 16:47:01 crc kubenswrapper[5120]: I0316 16:47:01.139406 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6npc\" (UniqueName: \"kubernetes.io/projected/cd80c01f-91bc-4691-87be-a4d998cfc8ed-kube-api-access-x6npc\") pod \"nova-cell0-5a68-account-create-update-6nxhs\" (UID: \"cd80c01f-91bc-4691-87be-a4d998cfc8ed\") " pod="openstack-kuttl-tests/nova-cell0-5a68-account-create-update-6nxhs" Mar 16 16:47:01 crc kubenswrapper[5120]: I0316 16:47:01.139625 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/cd80c01f-91bc-4691-87be-a4d998cfc8ed-operator-scripts\") pod \"nova-cell0-5a68-account-create-update-6nxhs\" (UID: \"cd80c01f-91bc-4691-87be-a4d998cfc8ed\") " pod="openstack-kuttl-tests/nova-cell0-5a68-account-create-update-6nxhs" Mar 16 16:47:01 crc kubenswrapper[5120]: I0316 16:47:01.139685 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ll48v\" (UniqueName: \"kubernetes.io/projected/93bf3a3e-5820-451f-b1c4-6e302325b1b7-kube-api-access-ll48v\") pod \"nova-cell1-db-create-dq2mb\" (UID: \"93bf3a3e-5820-451f-b1c4-6e302325b1b7\") " pod="openstack-kuttl-tests/nova-cell1-db-create-dq2mb" Mar 16 16:47:01 crc kubenswrapper[5120]: I0316 16:47:01.140785 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/93bf3a3e-5820-451f-b1c4-6e302325b1b7-operator-scripts\") pod \"nova-cell1-db-create-dq2mb\" (UID: \"93bf3a3e-5820-451f-b1c4-6e302325b1b7\") " pod="openstack-kuttl-tests/nova-cell1-db-create-dq2mb" Mar 16 16:47:01 crc kubenswrapper[5120]: I0316 16:47:01.143639 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-4d68-account-create-update-ps6wq"] Mar 16 16:47:01 crc kubenswrapper[5120]: I0316 16:47:01.159506 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-4d68-account-create-update-ps6wq"] Mar 16 16:47:01 crc kubenswrapper[5120]: I0316 16:47:01.159639 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-4d68-account-create-update-ps6wq" Mar 16 16:47:01 crc kubenswrapper[5120]: I0316 16:47:01.163550 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-db-secret\"" Mar 16 16:47:01 crc kubenswrapper[5120]: I0316 16:47:01.173926 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ll48v\" (UniqueName: \"kubernetes.io/projected/93bf3a3e-5820-451f-b1c4-6e302325b1b7-kube-api-access-ll48v\") pod \"nova-cell1-db-create-dq2mb\" (UID: \"93bf3a3e-5820-451f-b1c4-6e302325b1b7\") " pod="openstack-kuttl-tests/nova-cell1-db-create-dq2mb" Mar 16 16:47:01 crc kubenswrapper[5120]: I0316 16:47:01.242342 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wfbx\" (UniqueName: \"kubernetes.io/projected/c4757645-5b79-4163-a7f8-f4380d7615e4-kube-api-access-7wfbx\") pod \"nova-cell1-4d68-account-create-update-ps6wq\" (UID: \"c4757645-5b79-4163-a7f8-f4380d7615e4\") " pod="openstack-kuttl-tests/nova-cell1-4d68-account-create-update-ps6wq" Mar 16 16:47:01 crc kubenswrapper[5120]: I0316 16:47:01.242450 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x6npc\" (UniqueName: \"kubernetes.io/projected/cd80c01f-91bc-4691-87be-a4d998cfc8ed-kube-api-access-x6npc\") pod \"nova-cell0-5a68-account-create-update-6nxhs\" (UID: \"cd80c01f-91bc-4691-87be-a4d998cfc8ed\") " pod="openstack-kuttl-tests/nova-cell0-5a68-account-create-update-6nxhs" Mar 16 16:47:01 crc kubenswrapper[5120]: I0316 16:47:01.242566 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/cd80c01f-91bc-4691-87be-a4d998cfc8ed-operator-scripts\") pod \"nova-cell0-5a68-account-create-update-6nxhs\" (UID: \"cd80c01f-91bc-4691-87be-a4d998cfc8ed\") " pod="openstack-kuttl-tests/nova-cell0-5a68-account-create-update-6nxhs" Mar 16 16:47:01 crc kubenswrapper[5120]: I0316 16:47:01.242629 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c4757645-5b79-4163-a7f8-f4380d7615e4-operator-scripts\") pod \"nova-cell1-4d68-account-create-update-ps6wq\" (UID: \"c4757645-5b79-4163-a7f8-f4380d7615e4\") " pod="openstack-kuttl-tests/nova-cell1-4d68-account-create-update-ps6wq" Mar 16 16:47:01 crc kubenswrapper[5120]: I0316 16:47:01.244444 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/cd80c01f-91bc-4691-87be-a4d998cfc8ed-operator-scripts\") pod \"nova-cell0-5a68-account-create-update-6nxhs\" (UID: \"cd80c01f-91bc-4691-87be-a4d998cfc8ed\") " pod="openstack-kuttl-tests/nova-cell0-5a68-account-create-update-6nxhs" Mar 16 16:47:01 crc kubenswrapper[5120]: I0316 16:47:01.272310 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6npc\" (UniqueName: \"kubernetes.io/projected/cd80c01f-91bc-4691-87be-a4d998cfc8ed-kube-api-access-x6npc\") pod \"nova-cell0-5a68-account-create-update-6nxhs\" (UID: \"cd80c01f-91bc-4691-87be-a4d998cfc8ed\") " pod="openstack-kuttl-tests/nova-cell0-5a68-account-create-update-6nxhs" Mar 16 16:47:01 crc kubenswrapper[5120]: I0316 16:47:01.344357 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c4757645-5b79-4163-a7f8-f4380d7615e4-operator-scripts\") pod \"nova-cell1-4d68-account-create-update-ps6wq\" (UID: \"c4757645-5b79-4163-a7f8-f4380d7615e4\") " pod="openstack-kuttl-tests/nova-cell1-4d68-account-create-update-ps6wq" Mar 16 16:47:01 crc kubenswrapper[5120]: I0316 16:47:01.344586 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7wfbx\" (UniqueName: \"kubernetes.io/projected/c4757645-5b79-4163-a7f8-f4380d7615e4-kube-api-access-7wfbx\") pod \"nova-cell1-4d68-account-create-update-ps6wq\" (UID: \"c4757645-5b79-4163-a7f8-f4380d7615e4\") " pod="openstack-kuttl-tests/nova-cell1-4d68-account-create-update-ps6wq" Mar 16 16:47:01 crc kubenswrapper[5120]: I0316 16:47:01.345326 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c4757645-5b79-4163-a7f8-f4380d7615e4-operator-scripts\") pod \"nova-cell1-4d68-account-create-update-ps6wq\" (UID: \"c4757645-5b79-4163-a7f8-f4380d7615e4\") " pod="openstack-kuttl-tests/nova-cell1-4d68-account-create-update-ps6wq" Mar 16 16:47:01 crc kubenswrapper[5120]: I0316 16:47:01.366711 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wfbx\" (UniqueName: \"kubernetes.io/projected/c4757645-5b79-4163-a7f8-f4380d7615e4-kube-api-access-7wfbx\") pod \"nova-cell1-4d68-account-create-update-ps6wq\" (UID: \"c4757645-5b79-4163-a7f8-f4380d7615e4\") " pod="openstack-kuttl-tests/nova-cell1-4d68-account-create-update-ps6wq" Mar 16 16:47:01 crc kubenswrapper[5120]: I0316 16:47:01.367220 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-db-create-dq2mb" Mar 16 16:47:01 crc kubenswrapper[5120]: I0316 16:47:01.388623 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-5a68-account-create-update-6nxhs" Mar 16 16:47:01 crc kubenswrapper[5120]: I0316 16:47:01.485908 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-896cw"] Mar 16 16:47:01 crc kubenswrapper[5120]: I0316 16:47:01.508820 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-4d68-account-create-update-ps6wq" Mar 16 16:47:01 crc kubenswrapper[5120]: I0316 16:47:01.701874 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-774a-account-create-update-cvlrt"] Mar 16 16:47:01 crc kubenswrapper[5120]: I0316 16:47:01.842482 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-5k6v4"] Mar 16 16:47:02 crc kubenswrapper[5120]: I0316 16:47:02.096996 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-dq2mb"] Mar 16 16:47:02 crc kubenswrapper[5120]: I0316 16:47:02.110492 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-5a68-account-create-update-6nxhs"] Mar 16 16:47:02 crc kubenswrapper[5120]: W0316 16:47:02.133532 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcd80c01f_91bc_4691_87be_a4d998cfc8ed.slice/crio-00820fc752e352d862c2e4aa2aa7e7b4b719a4e4d972f19ddd9325e3508911fe WatchSource:0}: Error finding container 00820fc752e352d862c2e4aa2aa7e7b4b719a4e4d972f19ddd9325e3508911fe: Status 404 returned error can't find the container with id 00820fc752e352d862c2e4aa2aa7e7b4b719a4e4d972f19ddd9325e3508911fe Mar 16 16:47:02 crc kubenswrapper[5120]: I0316 16:47:02.311266 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-4d68-account-create-update-ps6wq"] Mar 16 16:47:02 crc kubenswrapper[5120]: I0316 16:47:02.354168 5120 generic.go:358] "Generic (PLEG): container finished" podID="67f5aec7-8a45-4909-ae10-dcbdc979fb43" containerID="a206f277f6d8961656366e86484996a06d8e3091f3c7991768bd7db49f033cfd" exitCode=0 Mar 16 16:47:02 crc kubenswrapper[5120]: I0316 16:47:02.354321 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-774a-account-create-update-cvlrt" event={"ID":"67f5aec7-8a45-4909-ae10-dcbdc979fb43","Type":"ContainerDied","Data":"a206f277f6d8961656366e86484996a06d8e3091f3c7991768bd7db49f033cfd"} Mar 16 16:47:02 crc kubenswrapper[5120]: I0316 16:47:02.354351 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-774a-account-create-update-cvlrt" event={"ID":"67f5aec7-8a45-4909-ae10-dcbdc979fb43","Type":"ContainerStarted","Data":"7e25440e0e71ef6457dbd91d5931dab459884f8d5c83460fb944d7b472e8e7ff"} Mar 16 16:47:02 crc kubenswrapper[5120]: I0316 16:47:02.359749 5120 generic.go:358] "Generic (PLEG): container finished" podID="a4f2ecaa-1975-4371-b2ed-ee48bac2ddfc" containerID="9b8f5f687f3848ddd999d88a2c20bfc3bc7ac68fe731ddb054d06d138c8313e4" exitCode=0 Mar 16 16:47:02 crc kubenswrapper[5120]: I0316 16:47:02.359852 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-db-create-896cw" event={"ID":"a4f2ecaa-1975-4371-b2ed-ee48bac2ddfc","Type":"ContainerDied","Data":"9b8f5f687f3848ddd999d88a2c20bfc3bc7ac68fe731ddb054d06d138c8313e4"} Mar 16 16:47:02 crc kubenswrapper[5120]: I0316 16:47:02.359879 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-db-create-896cw" event={"ID":"a4f2ecaa-1975-4371-b2ed-ee48bac2ddfc","Type":"ContainerStarted","Data":"a497b9244e0075a07c2ace4af956acd535cb79aefda0826dbadc78a9c7849dcb"} Mar 16 16:47:02 crc kubenswrapper[5120]: W0316 16:47:02.360572 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc4757645_5b79_4163_a7f8_f4380d7615e4.slice/crio-191e45d76babedd09c7b74e3576cec67aef68d11e9240ed0ecafe8eb2ef96ed4 WatchSource:0}: Error finding container 191e45d76babedd09c7b74e3576cec67aef68d11e9240ed0ecafe8eb2ef96ed4: Status 404 returned error can't find the container with id 191e45d76babedd09c7b74e3576cec67aef68d11e9240ed0ecafe8eb2ef96ed4 Mar 16 16:47:02 crc kubenswrapper[5120]: I0316 16:47:02.362493 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-db-create-dq2mb" event={"ID":"93bf3a3e-5820-451f-b1c4-6e302325b1b7","Type":"ContainerStarted","Data":"ab314d269b95311dd83d6cd9de30ce2d74e5b31d6d44eebcb9e1272a51f31343"} Mar 16 16:47:02 crc kubenswrapper[5120]: I0316 16:47:02.367572 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-db-create-5k6v4" event={"ID":"86bdc983-99ae-4f65-b8e0-37bef61cb70f","Type":"ContainerStarted","Data":"2b532f991da0367328f2fb4572b52398bdb803df0c8f63311aa996276464de2a"} Mar 16 16:47:02 crc kubenswrapper[5120]: I0316 16:47:02.367601 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-db-create-5k6v4" event={"ID":"86bdc983-99ae-4f65-b8e0-37bef61cb70f","Type":"ContainerStarted","Data":"4f2a9f599b7459b1671c36fdea35e639125484eac165f03ac55060abdb1bafba"} Mar 16 16:47:02 crc kubenswrapper[5120]: I0316 16:47:02.372712 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-5a68-account-create-update-6nxhs" event={"ID":"cd80c01f-91bc-4691-87be-a4d998cfc8ed","Type":"ContainerStarted","Data":"00820fc752e352d862c2e4aa2aa7e7b4b719a4e4d972f19ddd9325e3508911fe"} Mar 16 16:47:02 crc kubenswrapper[5120]: I0316 16:47:02.382963 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1ca85760-1e74-418a-be27-e52a2a6dac49","Type":"ContainerStarted","Data":"23ef435dbdc1bb1b210727961b8ddf2b9ade496127372a946c888f080a0bc5cf"} Mar 16 16:47:02 crc kubenswrapper[5120]: I0316 16:47:02.383164 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="1ca85760-1e74-418a-be27-e52a2a6dac49" containerName="ceilometer-central-agent" containerID="cri-o://d1fbb00b92463a21cf79b603f3caf860bedd78d33fda25f3945a9d8b45ac41e4" gracePeriod=30 Mar 16 16:47:02 crc kubenswrapper[5120]: I0316 16:47:02.383216 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:47:02 crc kubenswrapper[5120]: I0316 16:47:02.383223 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="1ca85760-1e74-418a-be27-e52a2a6dac49" containerName="sg-core" containerID="cri-o://77ec3053fe95ea6ad0e977f3a81112af3412e073e6957bf9bfca69061c9cf477" gracePeriod=30 Mar 16 16:47:02 crc kubenswrapper[5120]: I0316 16:47:02.383255 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="1ca85760-1e74-418a-be27-e52a2a6dac49" containerName="ceilometer-notification-agent" containerID="cri-o://2b78df72dc64bdedfa363ecf3b5f81ebb031eb3a22bfb78605bf75def38398ba" gracePeriod=30 Mar 16 16:47:02 crc kubenswrapper[5120]: I0316 16:47:02.383316 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="1ca85760-1e74-418a-be27-e52a2a6dac49" containerName="proxy-httpd" containerID="cri-o://23ef435dbdc1bb1b210727961b8ddf2b9ade496127372a946c888f080a0bc5cf" gracePeriod=30 Mar 16 16:47:02 crc kubenswrapper[5120]: I0316 16:47:02.432352 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-db-create-5k6v4" podStartSLOduration=2.432314024 podStartE2EDuration="2.432314024s" podCreationTimestamp="2026-03-16 16:47:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:47:02.409614206 +0000 UTC m=+4524.563545863" watchObservedRunningTime="2026-03-16 16:47:02.432314024 +0000 UTC m=+4524.586245681" Mar 16 16:47:02 crc kubenswrapper[5120]: I0316 16:47:02.444132 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.875274518 podStartE2EDuration="7.444102135s" podCreationTimestamp="2026-03-16 16:46:55 +0000 UTC" firstStartedPulling="2026-03-16 16:46:56.658201479 +0000 UTC m=+4518.812133136" lastFinishedPulling="2026-03-16 16:47:01.227029096 +0000 UTC m=+4523.380960753" observedRunningTime="2026-03-16 16:47:02.440678171 +0000 UTC m=+4524.594609838" watchObservedRunningTime="2026-03-16 16:47:02.444102135 +0000 UTC m=+4524.598033792" Mar 16 16:47:02 crc kubenswrapper[5120]: I0316 16:47:02.740970 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:47:02 crc kubenswrapper[5120]: I0316 16:47:02.741277 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="dcac8fc1-81ec-4845-b0d0-30e6a05bbb1f" containerName="glance-httpd" containerID="cri-o://ed3347ea7d2468f79274a2c70278a17cd2e43c1a264a6e44f4829ce2ebbf4f53" gracePeriod=30 Mar 16 16:47:02 crc kubenswrapper[5120]: I0316 16:47:02.741229 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="dcac8fc1-81ec-4845-b0d0-30e6a05bbb1f" containerName="glance-log" containerID="cri-o://e72148aadfa843c0c3ae1f7c85a9efa5f3ea2f2c0d518aea7817677d69ae155c" gracePeriod=30 Mar 16 16:47:03 crc kubenswrapper[5120]: I0316 16:47:03.394399 5120 generic.go:358] "Generic (PLEG): container finished" podID="93bf3a3e-5820-451f-b1c4-6e302325b1b7" containerID="b5635d2ec11446bea39b1a5733a1d2aef8b62952bbe76432eaa12ecad82b272d" exitCode=0 Mar 16 16:47:03 crc kubenswrapper[5120]: I0316 16:47:03.394488 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-db-create-dq2mb" event={"ID":"93bf3a3e-5820-451f-b1c4-6e302325b1b7","Type":"ContainerDied","Data":"b5635d2ec11446bea39b1a5733a1d2aef8b62952bbe76432eaa12ecad82b272d"} Mar 16 16:47:03 crc kubenswrapper[5120]: I0316 16:47:03.401059 5120 generic.go:358] "Generic (PLEG): container finished" podID="86bdc983-99ae-4f65-b8e0-37bef61cb70f" containerID="2b532f991da0367328f2fb4572b52398bdb803df0c8f63311aa996276464de2a" exitCode=0 Mar 16 16:47:03 crc kubenswrapper[5120]: I0316 16:47:03.401178 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-db-create-5k6v4" event={"ID":"86bdc983-99ae-4f65-b8e0-37bef61cb70f","Type":"ContainerDied","Data":"2b532f991da0367328f2fb4572b52398bdb803df0c8f63311aa996276464de2a"} Mar 16 16:47:03 crc kubenswrapper[5120]: I0316 16:47:03.403596 5120 generic.go:358] "Generic (PLEG): container finished" podID="cd80c01f-91bc-4691-87be-a4d998cfc8ed" containerID="e320e939f4be1457bc589639d9ed3c38aa64fb2533774ea309fdacd36ba48287" exitCode=0 Mar 16 16:47:03 crc kubenswrapper[5120]: I0316 16:47:03.403641 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-5a68-account-create-update-6nxhs" event={"ID":"cd80c01f-91bc-4691-87be-a4d998cfc8ed","Type":"ContainerDied","Data":"e320e939f4be1457bc589639d9ed3c38aa64fb2533774ea309fdacd36ba48287"} Mar 16 16:47:03 crc kubenswrapper[5120]: I0316 16:47:03.407198 5120 generic.go:358] "Generic (PLEG): container finished" podID="1ca85760-1e74-418a-be27-e52a2a6dac49" containerID="23ef435dbdc1bb1b210727961b8ddf2b9ade496127372a946c888f080a0bc5cf" exitCode=0 Mar 16 16:47:03 crc kubenswrapper[5120]: I0316 16:47:03.407226 5120 generic.go:358] "Generic (PLEG): container finished" podID="1ca85760-1e74-418a-be27-e52a2a6dac49" containerID="77ec3053fe95ea6ad0e977f3a81112af3412e073e6957bf9bfca69061c9cf477" exitCode=2 Mar 16 16:47:03 crc kubenswrapper[5120]: I0316 16:47:03.407236 5120 generic.go:358] "Generic (PLEG): container finished" podID="1ca85760-1e74-418a-be27-e52a2a6dac49" containerID="2b78df72dc64bdedfa363ecf3b5f81ebb031eb3a22bfb78605bf75def38398ba" exitCode=0 Mar 16 16:47:03 crc kubenswrapper[5120]: I0316 16:47:03.407245 5120 generic.go:358] "Generic (PLEG): container finished" podID="1ca85760-1e74-418a-be27-e52a2a6dac49" containerID="d1fbb00b92463a21cf79b603f3caf860bedd78d33fda25f3945a9d8b45ac41e4" exitCode=0 Mar 16 16:47:03 crc kubenswrapper[5120]: I0316 16:47:03.407267 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1ca85760-1e74-418a-be27-e52a2a6dac49","Type":"ContainerDied","Data":"23ef435dbdc1bb1b210727961b8ddf2b9ade496127372a946c888f080a0bc5cf"} Mar 16 16:47:03 crc kubenswrapper[5120]: I0316 16:47:03.407331 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1ca85760-1e74-418a-be27-e52a2a6dac49","Type":"ContainerDied","Data":"77ec3053fe95ea6ad0e977f3a81112af3412e073e6957bf9bfca69061c9cf477"} Mar 16 16:47:03 crc kubenswrapper[5120]: I0316 16:47:03.407349 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1ca85760-1e74-418a-be27-e52a2a6dac49","Type":"ContainerDied","Data":"2b78df72dc64bdedfa363ecf3b5f81ebb031eb3a22bfb78605bf75def38398ba"} Mar 16 16:47:03 crc kubenswrapper[5120]: I0316 16:47:03.407360 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1ca85760-1e74-418a-be27-e52a2a6dac49","Type":"ContainerDied","Data":"d1fbb00b92463a21cf79b603f3caf860bedd78d33fda25f3945a9d8b45ac41e4"} Mar 16 16:47:03 crc kubenswrapper[5120]: I0316 16:47:03.407370 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1ca85760-1e74-418a-be27-e52a2a6dac49","Type":"ContainerDied","Data":"409eeb3e4fb5f9b3ac38fbaf02becb94e56e324674aff7d3038acde8557087ad"} Mar 16 16:47:03 crc kubenswrapper[5120]: I0316 16:47:03.407382 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="409eeb3e4fb5f9b3ac38fbaf02becb94e56e324674aff7d3038acde8557087ad" Mar 16 16:47:03 crc kubenswrapper[5120]: I0316 16:47:03.411212 5120 generic.go:358] "Generic (PLEG): container finished" podID="dcac8fc1-81ec-4845-b0d0-30e6a05bbb1f" containerID="e72148aadfa843c0c3ae1f7c85a9efa5f3ea2f2c0d518aea7817677d69ae155c" exitCode=143 Mar 16 16:47:03 crc kubenswrapper[5120]: I0316 16:47:03.411253 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"dcac8fc1-81ec-4845-b0d0-30e6a05bbb1f","Type":"ContainerDied","Data":"e72148aadfa843c0c3ae1f7c85a9efa5f3ea2f2c0d518aea7817677d69ae155c"} Mar 16 16:47:03 crc kubenswrapper[5120]: I0316 16:47:03.417286 5120 generic.go:358] "Generic (PLEG): container finished" podID="c4757645-5b79-4163-a7f8-f4380d7615e4" containerID="56a8ebbbbbff235c01b61f95471e8f8102370f89a7873cb32553e5333a7da92e" exitCode=0 Mar 16 16:47:03 crc kubenswrapper[5120]: I0316 16:47:03.417679 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-4d68-account-create-update-ps6wq" event={"ID":"c4757645-5b79-4163-a7f8-f4380d7615e4","Type":"ContainerDied","Data":"56a8ebbbbbff235c01b61f95471e8f8102370f89a7873cb32553e5333a7da92e"} Mar 16 16:47:03 crc kubenswrapper[5120]: I0316 16:47:03.417708 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-4d68-account-create-update-ps6wq" event={"ID":"c4757645-5b79-4163-a7f8-f4380d7615e4","Type":"ContainerStarted","Data":"191e45d76babedd09c7b74e3576cec67aef68d11e9240ed0ecafe8eb2ef96ed4"} Mar 16 16:47:03 crc kubenswrapper[5120]: I0316 16:47:03.484373 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:47:03 crc kubenswrapper[5120]: I0316 16:47:03.615386 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1ca85760-1e74-418a-be27-e52a2a6dac49-config-data\") pod \"1ca85760-1e74-418a-be27-e52a2a6dac49\" (UID: \"1ca85760-1e74-418a-be27-e52a2a6dac49\") " Mar 16 16:47:03 crc kubenswrapper[5120]: I0316 16:47:03.615431 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2wj4w\" (UniqueName: \"kubernetes.io/projected/1ca85760-1e74-418a-be27-e52a2a6dac49-kube-api-access-2wj4w\") pod \"1ca85760-1e74-418a-be27-e52a2a6dac49\" (UID: \"1ca85760-1e74-418a-be27-e52a2a6dac49\") " Mar 16 16:47:03 crc kubenswrapper[5120]: I0316 16:47:03.615519 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1ca85760-1e74-418a-be27-e52a2a6dac49-log-httpd\") pod \"1ca85760-1e74-418a-be27-e52a2a6dac49\" (UID: \"1ca85760-1e74-418a-be27-e52a2a6dac49\") " Mar 16 16:47:03 crc kubenswrapper[5120]: I0316 16:47:03.615611 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/1ca85760-1e74-418a-be27-e52a2a6dac49-sg-core-conf-yaml\") pod \"1ca85760-1e74-418a-be27-e52a2a6dac49\" (UID: \"1ca85760-1e74-418a-be27-e52a2a6dac49\") " Mar 16 16:47:03 crc kubenswrapper[5120]: I0316 16:47:03.616853 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1ca85760-1e74-418a-be27-e52a2a6dac49-scripts\") pod \"1ca85760-1e74-418a-be27-e52a2a6dac49\" (UID: \"1ca85760-1e74-418a-be27-e52a2a6dac49\") " Mar 16 16:47:03 crc kubenswrapper[5120]: I0316 16:47:03.616960 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1ca85760-1e74-418a-be27-e52a2a6dac49-combined-ca-bundle\") pod \"1ca85760-1e74-418a-be27-e52a2a6dac49\" (UID: \"1ca85760-1e74-418a-be27-e52a2a6dac49\") " Mar 16 16:47:03 crc kubenswrapper[5120]: I0316 16:47:03.617190 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1ca85760-1e74-418a-be27-e52a2a6dac49-run-httpd\") pod \"1ca85760-1e74-418a-be27-e52a2a6dac49\" (UID: \"1ca85760-1e74-418a-be27-e52a2a6dac49\") " Mar 16 16:47:03 crc kubenswrapper[5120]: I0316 16:47:03.618286 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ca85760-1e74-418a-be27-e52a2a6dac49-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "1ca85760-1e74-418a-be27-e52a2a6dac49" (UID: "1ca85760-1e74-418a-be27-e52a2a6dac49"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:47:03 crc kubenswrapper[5120]: I0316 16:47:03.619150 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ca85760-1e74-418a-be27-e52a2a6dac49-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "1ca85760-1e74-418a-be27-e52a2a6dac49" (UID: "1ca85760-1e74-418a-be27-e52a2a6dac49"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:47:03 crc kubenswrapper[5120]: I0316 16:47:03.624149 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ca85760-1e74-418a-be27-e52a2a6dac49-kube-api-access-2wj4w" (OuterVolumeSpecName: "kube-api-access-2wj4w") pod "1ca85760-1e74-418a-be27-e52a2a6dac49" (UID: "1ca85760-1e74-418a-be27-e52a2a6dac49"). InnerVolumeSpecName "kube-api-access-2wj4w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:47:03 crc kubenswrapper[5120]: I0316 16:47:03.628409 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ca85760-1e74-418a-be27-e52a2a6dac49-scripts" (OuterVolumeSpecName: "scripts") pod "1ca85760-1e74-418a-be27-e52a2a6dac49" (UID: "1ca85760-1e74-418a-be27-e52a2a6dac49"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:47:03 crc kubenswrapper[5120]: I0316 16:47:03.658921 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:47:03 crc kubenswrapper[5120]: I0316 16:47:03.659201 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="93aa847e-5758-407c-bc62-6e72d895ef76" containerName="glance-log" containerID="cri-o://b99d2425893ee7d0bb78b5ae298044655ddbb8d1c0112a8bd52e375342228cf5" gracePeriod=30 Mar 16 16:47:03 crc kubenswrapper[5120]: I0316 16:47:03.659357 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="93aa847e-5758-407c-bc62-6e72d895ef76" containerName="glance-httpd" containerID="cri-o://d74da543a4cf1021dca35c2034a9aa8d2f0a9e792a1e589d2be2e140069ab929" gracePeriod=30 Mar 16 16:47:03 crc kubenswrapper[5120]: I0316 16:47:03.665712 5120 scope.go:117] "RemoveContainer" containerID="35a7dd6e19084cee69ca16203bca6378ea0cdf6a685ca2093ab847e5904eb9e6" Mar 16 16:47:03 crc kubenswrapper[5120]: E0316 16:47:03.666243 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:47:03 crc kubenswrapper[5120]: I0316 16:47:03.687008 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ca85760-1e74-418a-be27-e52a2a6dac49-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "1ca85760-1e74-418a-be27-e52a2a6dac49" (UID: "1ca85760-1e74-418a-be27-e52a2a6dac49"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:47:03 crc kubenswrapper[5120]: I0316 16:47:03.721020 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1ca85760-1e74-418a-be27-e52a2a6dac49-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:47:03 crc kubenswrapper[5120]: I0316 16:47:03.721052 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/1ca85760-1e74-418a-be27-e52a2a6dac49-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 16:47:03 crc kubenswrapper[5120]: I0316 16:47:03.721062 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1ca85760-1e74-418a-be27-e52a2a6dac49-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:47:03 crc kubenswrapper[5120]: I0316 16:47:03.721080 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1ca85760-1e74-418a-be27-e52a2a6dac49-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:47:03 crc kubenswrapper[5120]: I0316 16:47:03.721090 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2wj4w\" (UniqueName: \"kubernetes.io/projected/1ca85760-1e74-418a-be27-e52a2a6dac49-kube-api-access-2wj4w\") on node \"crc\" DevicePath \"\"" Mar 16 16:47:03 crc kubenswrapper[5120]: I0316 16:47:03.741930 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ca85760-1e74-418a-be27-e52a2a6dac49-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "1ca85760-1e74-418a-be27-e52a2a6dac49" (UID: "1ca85760-1e74-418a-be27-e52a2a6dac49"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:47:03 crc kubenswrapper[5120]: I0316 16:47:03.804230 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ca85760-1e74-418a-be27-e52a2a6dac49-config-data" (OuterVolumeSpecName: "config-data") pod "1ca85760-1e74-418a-be27-e52a2a6dac49" (UID: "1ca85760-1e74-418a-be27-e52a2a6dac49"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:47:03 crc kubenswrapper[5120]: I0316 16:47:03.824647 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1ca85760-1e74-418a-be27-e52a2a6dac49-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:47:03 crc kubenswrapper[5120]: I0316 16:47:03.824681 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1ca85760-1e74-418a-be27-e52a2a6dac49-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:47:04 crc kubenswrapper[5120]: I0316 16:47:04.072600 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-db-create-896cw" Mar 16 16:47:04 crc kubenswrapper[5120]: I0316 16:47:04.096809 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-774a-account-create-update-cvlrt" Mar 16 16:47:04 crc kubenswrapper[5120]: I0316 16:47:04.241143 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fvk4v\" (UniqueName: \"kubernetes.io/projected/67f5aec7-8a45-4909-ae10-dcbdc979fb43-kube-api-access-fvk4v\") pod \"67f5aec7-8a45-4909-ae10-dcbdc979fb43\" (UID: \"67f5aec7-8a45-4909-ae10-dcbdc979fb43\") " Mar 16 16:47:04 crc kubenswrapper[5120]: I0316 16:47:04.241249 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ckmb5\" (UniqueName: \"kubernetes.io/projected/a4f2ecaa-1975-4371-b2ed-ee48bac2ddfc-kube-api-access-ckmb5\") pod \"a4f2ecaa-1975-4371-b2ed-ee48bac2ddfc\" (UID: \"a4f2ecaa-1975-4371-b2ed-ee48bac2ddfc\") " Mar 16 16:47:04 crc kubenswrapper[5120]: I0316 16:47:04.241343 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/67f5aec7-8a45-4909-ae10-dcbdc979fb43-operator-scripts\") pod \"67f5aec7-8a45-4909-ae10-dcbdc979fb43\" (UID: \"67f5aec7-8a45-4909-ae10-dcbdc979fb43\") " Mar 16 16:47:04 crc kubenswrapper[5120]: I0316 16:47:04.241828 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a4f2ecaa-1975-4371-b2ed-ee48bac2ddfc-operator-scripts\") pod \"a4f2ecaa-1975-4371-b2ed-ee48bac2ddfc\" (UID: \"a4f2ecaa-1975-4371-b2ed-ee48bac2ddfc\") " Mar 16 16:47:04 crc kubenswrapper[5120]: I0316 16:47:04.242029 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/67f5aec7-8a45-4909-ae10-dcbdc979fb43-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "67f5aec7-8a45-4909-ae10-dcbdc979fb43" (UID: "67f5aec7-8a45-4909-ae10-dcbdc979fb43"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:47:04 crc kubenswrapper[5120]: I0316 16:47:04.242487 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a4f2ecaa-1975-4371-b2ed-ee48bac2ddfc-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "a4f2ecaa-1975-4371-b2ed-ee48bac2ddfc" (UID: "a4f2ecaa-1975-4371-b2ed-ee48bac2ddfc"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:47:04 crc kubenswrapper[5120]: I0316 16:47:04.247060 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67f5aec7-8a45-4909-ae10-dcbdc979fb43-kube-api-access-fvk4v" (OuterVolumeSpecName: "kube-api-access-fvk4v") pod "67f5aec7-8a45-4909-ae10-dcbdc979fb43" (UID: "67f5aec7-8a45-4909-ae10-dcbdc979fb43"). InnerVolumeSpecName "kube-api-access-fvk4v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:47:04 crc kubenswrapper[5120]: I0316 16:47:04.247456 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/67f5aec7-8a45-4909-ae10-dcbdc979fb43-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:47:04 crc kubenswrapper[5120]: I0316 16:47:04.247493 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a4f2ecaa-1975-4371-b2ed-ee48bac2ddfc-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:47:04 crc kubenswrapper[5120]: I0316 16:47:04.249287 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a4f2ecaa-1975-4371-b2ed-ee48bac2ddfc-kube-api-access-ckmb5" (OuterVolumeSpecName: "kube-api-access-ckmb5") pod "a4f2ecaa-1975-4371-b2ed-ee48bac2ddfc" (UID: "a4f2ecaa-1975-4371-b2ed-ee48bac2ddfc"). InnerVolumeSpecName "kube-api-access-ckmb5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:47:04 crc kubenswrapper[5120]: I0316 16:47:04.329187 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/swift-proxy-cc67b5786-c2cmq" Mar 16 16:47:04 crc kubenswrapper[5120]: I0316 16:47:04.330283 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/swift-proxy-cc67b5786-c2cmq" Mar 16 16:47:04 crc kubenswrapper[5120]: I0316 16:47:04.349349 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fvk4v\" (UniqueName: \"kubernetes.io/projected/67f5aec7-8a45-4909-ae10-dcbdc979fb43-kube-api-access-fvk4v\") on node \"crc\" DevicePath \"\"" Mar 16 16:47:04 crc kubenswrapper[5120]: I0316 16:47:04.349390 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ckmb5\" (UniqueName: \"kubernetes.io/projected/a4f2ecaa-1975-4371-b2ed-ee48bac2ddfc-kube-api-access-ckmb5\") on node \"crc\" DevicePath \"\"" Mar 16 16:47:04 crc kubenswrapper[5120]: I0316 16:47:04.428207 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-774a-account-create-update-cvlrt" Mar 16 16:47:04 crc kubenswrapper[5120]: I0316 16:47:04.428228 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-774a-account-create-update-cvlrt" event={"ID":"67f5aec7-8a45-4909-ae10-dcbdc979fb43","Type":"ContainerDied","Data":"7e25440e0e71ef6457dbd91d5931dab459884f8d5c83460fb944d7b472e8e7ff"} Mar 16 16:47:04 crc kubenswrapper[5120]: I0316 16:47:04.428262 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7e25440e0e71ef6457dbd91d5931dab459884f8d5c83460fb944d7b472e8e7ff" Mar 16 16:47:04 crc kubenswrapper[5120]: I0316 16:47:04.430803 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-db-create-896cw" event={"ID":"a4f2ecaa-1975-4371-b2ed-ee48bac2ddfc","Type":"ContainerDied","Data":"a497b9244e0075a07c2ace4af956acd535cb79aefda0826dbadc78a9c7849dcb"} Mar 16 16:47:04 crc kubenswrapper[5120]: I0316 16:47:04.430848 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a497b9244e0075a07c2ace4af956acd535cb79aefda0826dbadc78a9c7849dcb" Mar 16 16:47:04 crc kubenswrapper[5120]: I0316 16:47:04.430933 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-db-create-896cw" Mar 16 16:47:04 crc kubenswrapper[5120]: I0316 16:47:04.433068 5120 generic.go:358] "Generic (PLEG): container finished" podID="93aa847e-5758-407c-bc62-6e72d895ef76" containerID="b99d2425893ee7d0bb78b5ae298044655ddbb8d1c0112a8bd52e375342228cf5" exitCode=143 Mar 16 16:47:04 crc kubenswrapper[5120]: I0316 16:47:04.433153 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"93aa847e-5758-407c-bc62-6e72d895ef76","Type":"ContainerDied","Data":"b99d2425893ee7d0bb78b5ae298044655ddbb8d1c0112a8bd52e375342228cf5"} Mar 16 16:47:04 crc kubenswrapper[5120]: I0316 16:47:04.433245 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:47:04 crc kubenswrapper[5120]: I0316 16:47:04.512820 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:47:04 crc kubenswrapper[5120]: I0316 16:47:04.523840 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:47:04 crc kubenswrapper[5120]: I0316 16:47:04.533233 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:47:04 crc kubenswrapper[5120]: I0316 16:47:04.534516 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ca85760-1e74-418a-be27-e52a2a6dac49" containerName="sg-core" Mar 16 16:47:04 crc kubenswrapper[5120]: I0316 16:47:04.534545 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ca85760-1e74-418a-be27-e52a2a6dac49" containerName="sg-core" Mar 16 16:47:04 crc kubenswrapper[5120]: I0316 16:47:04.534558 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ca85760-1e74-418a-be27-e52a2a6dac49" containerName="proxy-httpd" Mar 16 16:47:04 crc kubenswrapper[5120]: I0316 16:47:04.534565 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ca85760-1e74-418a-be27-e52a2a6dac49" containerName="proxy-httpd" Mar 16 16:47:04 crc kubenswrapper[5120]: I0316 16:47:04.534575 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ca85760-1e74-418a-be27-e52a2a6dac49" containerName="ceilometer-central-agent" Mar 16 16:47:04 crc kubenswrapper[5120]: I0316 16:47:04.534583 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ca85760-1e74-418a-be27-e52a2a6dac49" containerName="ceilometer-central-agent" Mar 16 16:47:04 crc kubenswrapper[5120]: I0316 16:47:04.534621 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ca85760-1e74-418a-be27-e52a2a6dac49" containerName="ceilometer-notification-agent" Mar 16 16:47:04 crc kubenswrapper[5120]: I0316 16:47:04.534629 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ca85760-1e74-418a-be27-e52a2a6dac49" containerName="ceilometer-notification-agent" Mar 16 16:47:04 crc kubenswrapper[5120]: I0316 16:47:04.534643 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4f2ecaa-1975-4371-b2ed-ee48bac2ddfc" containerName="mariadb-database-create" Mar 16 16:47:04 crc kubenswrapper[5120]: I0316 16:47:04.534650 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4f2ecaa-1975-4371-b2ed-ee48bac2ddfc" containerName="mariadb-database-create" Mar 16 16:47:04 crc kubenswrapper[5120]: I0316 16:47:04.534702 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67f5aec7-8a45-4909-ae10-dcbdc979fb43" containerName="mariadb-account-create-update" Mar 16 16:47:04 crc kubenswrapper[5120]: I0316 16:47:04.534710 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="67f5aec7-8a45-4909-ae10-dcbdc979fb43" containerName="mariadb-account-create-update" Mar 16 16:47:04 crc kubenswrapper[5120]: I0316 16:47:04.534952 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1ca85760-1e74-418a-be27-e52a2a6dac49" containerName="ceilometer-central-agent" Mar 16 16:47:04 crc kubenswrapper[5120]: I0316 16:47:04.535010 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1ca85760-1e74-418a-be27-e52a2a6dac49" containerName="proxy-httpd" Mar 16 16:47:04 crc kubenswrapper[5120]: I0316 16:47:04.535023 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1ca85760-1e74-418a-be27-e52a2a6dac49" containerName="ceilometer-notification-agent" Mar 16 16:47:04 crc kubenswrapper[5120]: I0316 16:47:04.535039 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="67f5aec7-8a45-4909-ae10-dcbdc979fb43" containerName="mariadb-account-create-update" Mar 16 16:47:04 crc kubenswrapper[5120]: I0316 16:47:04.535056 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="a4f2ecaa-1975-4371-b2ed-ee48bac2ddfc" containerName="mariadb-database-create" Mar 16 16:47:04 crc kubenswrapper[5120]: I0316 16:47:04.535067 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1ca85760-1e74-418a-be27-e52a2a6dac49" containerName="sg-core" Mar 16 16:47:04 crc kubenswrapper[5120]: I0316 16:47:04.553097 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:47:04 crc kubenswrapper[5120]: I0316 16:47:04.553263 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:47:04 crc kubenswrapper[5120]: I0316 16:47:04.555995 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 16:47:04 crc kubenswrapper[5120]: I0316 16:47:04.556353 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 16:47:04 crc kubenswrapper[5120]: I0316 16:47:04.660289 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qgqhh\" (UniqueName: \"kubernetes.io/projected/47657b56-a651-4772-a9fd-9571c816bdf1-kube-api-access-qgqhh\") pod \"ceilometer-0\" (UID: \"47657b56-a651-4772-a9fd-9571c816bdf1\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:47:04 crc kubenswrapper[5120]: I0316 16:47:04.660476 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/47657b56-a651-4772-a9fd-9571c816bdf1-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"47657b56-a651-4772-a9fd-9571c816bdf1\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:47:04 crc kubenswrapper[5120]: I0316 16:47:04.660548 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/47657b56-a651-4772-a9fd-9571c816bdf1-log-httpd\") pod \"ceilometer-0\" (UID: \"47657b56-a651-4772-a9fd-9571c816bdf1\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:47:04 crc kubenswrapper[5120]: I0316 16:47:04.660581 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/47657b56-a651-4772-a9fd-9571c816bdf1-scripts\") pod \"ceilometer-0\" (UID: \"47657b56-a651-4772-a9fd-9571c816bdf1\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:47:04 crc kubenswrapper[5120]: I0316 16:47:04.660670 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/47657b56-a651-4772-a9fd-9571c816bdf1-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"47657b56-a651-4772-a9fd-9571c816bdf1\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:47:04 crc kubenswrapper[5120]: I0316 16:47:04.660884 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/47657b56-a651-4772-a9fd-9571c816bdf1-run-httpd\") pod \"ceilometer-0\" (UID: \"47657b56-a651-4772-a9fd-9571c816bdf1\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:47:04 crc kubenswrapper[5120]: I0316 16:47:04.660943 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/47657b56-a651-4772-a9fd-9571c816bdf1-config-data\") pod \"ceilometer-0\" (UID: \"47657b56-a651-4772-a9fd-9571c816bdf1\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:47:04 crc kubenswrapper[5120]: I0316 16:47:04.676784 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ca85760-1e74-418a-be27-e52a2a6dac49" path="/var/lib/kubelet/pods/1ca85760-1e74-418a-be27-e52a2a6dac49/volumes" Mar 16 16:47:04 crc kubenswrapper[5120]: I0316 16:47:04.763338 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/47657b56-a651-4772-a9fd-9571c816bdf1-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"47657b56-a651-4772-a9fd-9571c816bdf1\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:47:04 crc kubenswrapper[5120]: I0316 16:47:04.763563 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/47657b56-a651-4772-a9fd-9571c816bdf1-run-httpd\") pod \"ceilometer-0\" (UID: \"47657b56-a651-4772-a9fd-9571c816bdf1\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:47:04 crc kubenswrapper[5120]: I0316 16:47:04.763616 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/47657b56-a651-4772-a9fd-9571c816bdf1-config-data\") pod \"ceilometer-0\" (UID: \"47657b56-a651-4772-a9fd-9571c816bdf1\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:47:04 crc kubenswrapper[5120]: I0316 16:47:04.764956 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qgqhh\" (UniqueName: \"kubernetes.io/projected/47657b56-a651-4772-a9fd-9571c816bdf1-kube-api-access-qgqhh\") pod \"ceilometer-0\" (UID: \"47657b56-a651-4772-a9fd-9571c816bdf1\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:47:04 crc kubenswrapper[5120]: I0316 16:47:04.764980 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/47657b56-a651-4772-a9fd-9571c816bdf1-run-httpd\") pod \"ceilometer-0\" (UID: \"47657b56-a651-4772-a9fd-9571c816bdf1\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:47:04 crc kubenswrapper[5120]: I0316 16:47:04.766973 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/47657b56-a651-4772-a9fd-9571c816bdf1-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"47657b56-a651-4772-a9fd-9571c816bdf1\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:47:04 crc kubenswrapper[5120]: I0316 16:47:04.767090 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/47657b56-a651-4772-a9fd-9571c816bdf1-log-httpd\") pod \"ceilometer-0\" (UID: \"47657b56-a651-4772-a9fd-9571c816bdf1\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:47:04 crc kubenswrapper[5120]: I0316 16:47:04.767129 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/47657b56-a651-4772-a9fd-9571c816bdf1-scripts\") pod \"ceilometer-0\" (UID: \"47657b56-a651-4772-a9fd-9571c816bdf1\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:47:04 crc kubenswrapper[5120]: I0316 16:47:04.767742 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/47657b56-a651-4772-a9fd-9571c816bdf1-log-httpd\") pod \"ceilometer-0\" (UID: \"47657b56-a651-4772-a9fd-9571c816bdf1\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:47:04 crc kubenswrapper[5120]: I0316 16:47:04.771033 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/47657b56-a651-4772-a9fd-9571c816bdf1-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"47657b56-a651-4772-a9fd-9571c816bdf1\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:47:04 crc kubenswrapper[5120]: I0316 16:47:04.772960 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/47657b56-a651-4772-a9fd-9571c816bdf1-config-data\") pod \"ceilometer-0\" (UID: \"47657b56-a651-4772-a9fd-9571c816bdf1\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:47:04 crc kubenswrapper[5120]: I0316 16:47:04.775554 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/47657b56-a651-4772-a9fd-9571c816bdf1-scripts\") pod \"ceilometer-0\" (UID: \"47657b56-a651-4772-a9fd-9571c816bdf1\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:47:04 crc kubenswrapper[5120]: I0316 16:47:04.782728 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/47657b56-a651-4772-a9fd-9571c816bdf1-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"47657b56-a651-4772-a9fd-9571c816bdf1\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:47:04 crc kubenswrapper[5120]: I0316 16:47:04.785492 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qgqhh\" (UniqueName: \"kubernetes.io/projected/47657b56-a651-4772-a9fd-9571c816bdf1-kube-api-access-qgqhh\") pod \"ceilometer-0\" (UID: \"47657b56-a651-4772-a9fd-9571c816bdf1\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:47:04 crc kubenswrapper[5120]: I0316 16:47:04.879748 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:47:05 crc kubenswrapper[5120]: I0316 16:47:05.012646 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-db-create-5k6v4" Mar 16 16:47:05 crc kubenswrapper[5120]: I0316 16:47:05.092034 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/86bdc983-99ae-4f65-b8e0-37bef61cb70f-operator-scripts\") pod \"86bdc983-99ae-4f65-b8e0-37bef61cb70f\" (UID: \"86bdc983-99ae-4f65-b8e0-37bef61cb70f\") " Mar 16 16:47:05 crc kubenswrapper[5120]: I0316 16:47:05.092400 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rdxtm\" (UniqueName: \"kubernetes.io/projected/86bdc983-99ae-4f65-b8e0-37bef61cb70f-kube-api-access-rdxtm\") pod \"86bdc983-99ae-4f65-b8e0-37bef61cb70f\" (UID: \"86bdc983-99ae-4f65-b8e0-37bef61cb70f\") " Mar 16 16:47:05 crc kubenswrapper[5120]: I0316 16:47:05.106163 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86bdc983-99ae-4f65-b8e0-37bef61cb70f-kube-api-access-rdxtm" (OuterVolumeSpecName: "kube-api-access-rdxtm") pod "86bdc983-99ae-4f65-b8e0-37bef61cb70f" (UID: "86bdc983-99ae-4f65-b8e0-37bef61cb70f"). InnerVolumeSpecName "kube-api-access-rdxtm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:47:05 crc kubenswrapper[5120]: I0316 16:47:05.115300 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/86bdc983-99ae-4f65-b8e0-37bef61cb70f-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "86bdc983-99ae-4f65-b8e0-37bef61cb70f" (UID: "86bdc983-99ae-4f65-b8e0-37bef61cb70f"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:47:05 crc kubenswrapper[5120]: I0316 16:47:05.195461 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/86bdc983-99ae-4f65-b8e0-37bef61cb70f-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:47:05 crc kubenswrapper[5120]: I0316 16:47:05.195507 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rdxtm\" (UniqueName: \"kubernetes.io/projected/86bdc983-99ae-4f65-b8e0-37bef61cb70f-kube-api-access-rdxtm\") on node \"crc\" DevicePath \"\"" Mar 16 16:47:05 crc kubenswrapper[5120]: I0316 16:47:05.216691 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-5a68-account-create-update-6nxhs" Mar 16 16:47:05 crc kubenswrapper[5120]: I0316 16:47:05.227959 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-db-create-dq2mb" Mar 16 16:47:05 crc kubenswrapper[5120]: I0316 16:47:05.242646 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-4d68-account-create-update-ps6wq" Mar 16 16:47:05 crc kubenswrapper[5120]: I0316 16:47:05.297112 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/cd80c01f-91bc-4691-87be-a4d998cfc8ed-operator-scripts\") pod \"cd80c01f-91bc-4691-87be-a4d998cfc8ed\" (UID: \"cd80c01f-91bc-4691-87be-a4d998cfc8ed\") " Mar 16 16:47:05 crc kubenswrapper[5120]: I0316 16:47:05.297352 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7wfbx\" (UniqueName: \"kubernetes.io/projected/c4757645-5b79-4163-a7f8-f4380d7615e4-kube-api-access-7wfbx\") pod \"c4757645-5b79-4163-a7f8-f4380d7615e4\" (UID: \"c4757645-5b79-4163-a7f8-f4380d7615e4\") " Mar 16 16:47:05 crc kubenswrapper[5120]: I0316 16:47:05.297471 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/93bf3a3e-5820-451f-b1c4-6e302325b1b7-operator-scripts\") pod \"93bf3a3e-5820-451f-b1c4-6e302325b1b7\" (UID: \"93bf3a3e-5820-451f-b1c4-6e302325b1b7\") " Mar 16 16:47:05 crc kubenswrapper[5120]: I0316 16:47:05.297564 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c4757645-5b79-4163-a7f8-f4380d7615e4-operator-scripts\") pod \"c4757645-5b79-4163-a7f8-f4380d7615e4\" (UID: \"c4757645-5b79-4163-a7f8-f4380d7615e4\") " Mar 16 16:47:05 crc kubenswrapper[5120]: I0316 16:47:05.297579 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd80c01f-91bc-4691-87be-a4d998cfc8ed-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "cd80c01f-91bc-4691-87be-a4d998cfc8ed" (UID: "cd80c01f-91bc-4691-87be-a4d998cfc8ed"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:47:05 crc kubenswrapper[5120]: I0316 16:47:05.297634 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x6npc\" (UniqueName: \"kubernetes.io/projected/cd80c01f-91bc-4691-87be-a4d998cfc8ed-kube-api-access-x6npc\") pod \"cd80c01f-91bc-4691-87be-a4d998cfc8ed\" (UID: \"cd80c01f-91bc-4691-87be-a4d998cfc8ed\") " Mar 16 16:47:05 crc kubenswrapper[5120]: I0316 16:47:05.297664 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ll48v\" (UniqueName: \"kubernetes.io/projected/93bf3a3e-5820-451f-b1c4-6e302325b1b7-kube-api-access-ll48v\") pod \"93bf3a3e-5820-451f-b1c4-6e302325b1b7\" (UID: \"93bf3a3e-5820-451f-b1c4-6e302325b1b7\") " Mar 16 16:47:05 crc kubenswrapper[5120]: I0316 16:47:05.297882 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c4757645-5b79-4163-a7f8-f4380d7615e4-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "c4757645-5b79-4163-a7f8-f4380d7615e4" (UID: "c4757645-5b79-4163-a7f8-f4380d7615e4"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:47:05 crc kubenswrapper[5120]: I0316 16:47:05.298000 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/93bf3a3e-5820-451f-b1c4-6e302325b1b7-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "93bf3a3e-5820-451f-b1c4-6e302325b1b7" (UID: "93bf3a3e-5820-451f-b1c4-6e302325b1b7"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:47:05 crc kubenswrapper[5120]: I0316 16:47:05.298712 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c4757645-5b79-4163-a7f8-f4380d7615e4-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:47:05 crc kubenswrapper[5120]: I0316 16:47:05.298729 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/cd80c01f-91bc-4691-87be-a4d998cfc8ed-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:47:05 crc kubenswrapper[5120]: I0316 16:47:05.298741 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/93bf3a3e-5820-451f-b1c4-6e302325b1b7-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:47:05 crc kubenswrapper[5120]: I0316 16:47:05.303486 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4757645-5b79-4163-a7f8-f4380d7615e4-kube-api-access-7wfbx" (OuterVolumeSpecName: "kube-api-access-7wfbx") pod "c4757645-5b79-4163-a7f8-f4380d7615e4" (UID: "c4757645-5b79-4163-a7f8-f4380d7615e4"). InnerVolumeSpecName "kube-api-access-7wfbx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:47:05 crc kubenswrapper[5120]: I0316 16:47:05.309015 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd80c01f-91bc-4691-87be-a4d998cfc8ed-kube-api-access-x6npc" (OuterVolumeSpecName: "kube-api-access-x6npc") pod "cd80c01f-91bc-4691-87be-a4d998cfc8ed" (UID: "cd80c01f-91bc-4691-87be-a4d998cfc8ed"). InnerVolumeSpecName "kube-api-access-x6npc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:47:05 crc kubenswrapper[5120]: I0316 16:47:05.310946 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93bf3a3e-5820-451f-b1c4-6e302325b1b7-kube-api-access-ll48v" (OuterVolumeSpecName: "kube-api-access-ll48v") pod "93bf3a3e-5820-451f-b1c4-6e302325b1b7" (UID: "93bf3a3e-5820-451f-b1c4-6e302325b1b7"). InnerVolumeSpecName "kube-api-access-ll48v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:47:05 crc kubenswrapper[5120]: I0316 16:47:05.401700 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7wfbx\" (UniqueName: \"kubernetes.io/projected/c4757645-5b79-4163-a7f8-f4380d7615e4-kube-api-access-7wfbx\") on node \"crc\" DevicePath \"\"" Mar 16 16:47:05 crc kubenswrapper[5120]: I0316 16:47:05.401742 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x6npc\" (UniqueName: \"kubernetes.io/projected/cd80c01f-91bc-4691-87be-a4d998cfc8ed-kube-api-access-x6npc\") on node \"crc\" DevicePath \"\"" Mar 16 16:47:05 crc kubenswrapper[5120]: I0316 16:47:05.401751 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ll48v\" (UniqueName: \"kubernetes.io/projected/93bf3a3e-5820-451f-b1c4-6e302325b1b7-kube-api-access-ll48v\") on node \"crc\" DevicePath \"\"" Mar 16 16:47:05 crc kubenswrapper[5120]: I0316 16:47:05.413962 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:47:05 crc kubenswrapper[5120]: I0316 16:47:05.445788 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-4d68-account-create-update-ps6wq" event={"ID":"c4757645-5b79-4163-a7f8-f4380d7615e4","Type":"ContainerDied","Data":"191e45d76babedd09c7b74e3576cec67aef68d11e9240ed0ecafe8eb2ef96ed4"} Mar 16 16:47:05 crc kubenswrapper[5120]: I0316 16:47:05.445831 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="191e45d76babedd09c7b74e3576cec67aef68d11e9240ed0ecafe8eb2ef96ed4" Mar 16 16:47:05 crc kubenswrapper[5120]: I0316 16:47:05.445903 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-4d68-account-create-update-ps6wq" Mar 16 16:47:05 crc kubenswrapper[5120]: I0316 16:47:05.453450 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-db-create-dq2mb" event={"ID":"93bf3a3e-5820-451f-b1c4-6e302325b1b7","Type":"ContainerDied","Data":"ab314d269b95311dd83d6cd9de30ce2d74e5b31d6d44eebcb9e1272a51f31343"} Mar 16 16:47:05 crc kubenswrapper[5120]: I0316 16:47:05.453492 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ab314d269b95311dd83d6cd9de30ce2d74e5b31d6d44eebcb9e1272a51f31343" Mar 16 16:47:05 crc kubenswrapper[5120]: I0316 16:47:05.453566 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-db-create-dq2mb" Mar 16 16:47:05 crc kubenswrapper[5120]: I0316 16:47:05.456867 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-db-create-5k6v4" event={"ID":"86bdc983-99ae-4f65-b8e0-37bef61cb70f","Type":"ContainerDied","Data":"4f2a9f599b7459b1671c36fdea35e639125484eac165f03ac55060abdb1bafba"} Mar 16 16:47:05 crc kubenswrapper[5120]: I0316 16:47:05.456906 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4f2a9f599b7459b1671c36fdea35e639125484eac165f03ac55060abdb1bafba" Mar 16 16:47:05 crc kubenswrapper[5120]: I0316 16:47:05.456970 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-db-create-5k6v4" Mar 16 16:47:05 crc kubenswrapper[5120]: I0316 16:47:05.460675 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-5a68-account-create-update-6nxhs" event={"ID":"cd80c01f-91bc-4691-87be-a4d998cfc8ed","Type":"ContainerDied","Data":"00820fc752e352d862c2e4aa2aa7e7b4b719a4e4d972f19ddd9325e3508911fe"} Mar 16 16:47:05 crc kubenswrapper[5120]: I0316 16:47:05.460718 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="00820fc752e352d862c2e4aa2aa7e7b4b719a4e4d972f19ddd9325e3508911fe" Mar 16 16:47:05 crc kubenswrapper[5120]: I0316 16:47:05.460834 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-5a68-account-create-update-6nxhs" Mar 16 16:47:05 crc kubenswrapper[5120]: W0316 16:47:05.497587 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod47657b56_a651_4772_a9fd_9571c816bdf1.slice/crio-066073bb8f5db56d7ce448e25c215f11e1e9e88437bbb92311d8612cae5adac4 WatchSource:0}: Error finding container 066073bb8f5db56d7ce448e25c215f11e1e9e88437bbb92311d8612cae5adac4: Status 404 returned error can't find the container with id 066073bb8f5db56d7ce448e25c215f11e1e9e88437bbb92311d8612cae5adac4 Mar 16 16:47:05 crc kubenswrapper[5120]: I0316 16:47:05.501170 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:47:06 crc kubenswrapper[5120]: I0316 16:47:06.494809 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"47657b56-a651-4772-a9fd-9571c816bdf1","Type":"ContainerStarted","Data":"a540e1d24ade08845cd83fe49d87346421ce32a5e31629ec91d2f7f1c23c430d"} Mar 16 16:47:06 crc kubenswrapper[5120]: I0316 16:47:06.495155 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"47657b56-a651-4772-a9fd-9571c816bdf1","Type":"ContainerStarted","Data":"066073bb8f5db56d7ce448e25c215f11e1e9e88437bbb92311d8612cae5adac4"} Mar 16 16:47:06 crc kubenswrapper[5120]: I0316 16:47:06.505964 5120 generic.go:358] "Generic (PLEG): container finished" podID="dcac8fc1-81ec-4845-b0d0-30e6a05bbb1f" containerID="ed3347ea7d2468f79274a2c70278a17cd2e43c1a264a6e44f4829ce2ebbf4f53" exitCode=0 Mar 16 16:47:06 crc kubenswrapper[5120]: I0316 16:47:06.506262 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"dcac8fc1-81ec-4845-b0d0-30e6a05bbb1f","Type":"ContainerDied","Data":"ed3347ea7d2468f79274a2c70278a17cd2e43c1a264a6e44f4829ce2ebbf4f53"} Mar 16 16:47:06 crc kubenswrapper[5120]: I0316 16:47:06.634121 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:47:06 crc kubenswrapper[5120]: I0316 16:47:06.744704 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"dcac8fc1-81ec-4845-b0d0-30e6a05bbb1f\" (UID: \"dcac8fc1-81ec-4845-b0d0-30e6a05bbb1f\") " Mar 16 16:47:06 crc kubenswrapper[5120]: I0316 16:47:06.744806 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4x4g6\" (UniqueName: \"kubernetes.io/projected/dcac8fc1-81ec-4845-b0d0-30e6a05bbb1f-kube-api-access-4x4g6\") pod \"dcac8fc1-81ec-4845-b0d0-30e6a05bbb1f\" (UID: \"dcac8fc1-81ec-4845-b0d0-30e6a05bbb1f\") " Mar 16 16:47:06 crc kubenswrapper[5120]: I0316 16:47:06.744858 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dcac8fc1-81ec-4845-b0d0-30e6a05bbb1f-combined-ca-bundle\") pod \"dcac8fc1-81ec-4845-b0d0-30e6a05bbb1f\" (UID: \"dcac8fc1-81ec-4845-b0d0-30e6a05bbb1f\") " Mar 16 16:47:06 crc kubenswrapper[5120]: I0316 16:47:06.744925 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/dcac8fc1-81ec-4845-b0d0-30e6a05bbb1f-scripts\") pod \"dcac8fc1-81ec-4845-b0d0-30e6a05bbb1f\" (UID: \"dcac8fc1-81ec-4845-b0d0-30e6a05bbb1f\") " Mar 16 16:47:06 crc kubenswrapper[5120]: I0316 16:47:06.744956 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/dcac8fc1-81ec-4845-b0d0-30e6a05bbb1f-logs\") pod \"dcac8fc1-81ec-4845-b0d0-30e6a05bbb1f\" (UID: \"dcac8fc1-81ec-4845-b0d0-30e6a05bbb1f\") " Mar 16 16:47:06 crc kubenswrapper[5120]: I0316 16:47:06.745085 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/dcac8fc1-81ec-4845-b0d0-30e6a05bbb1f-httpd-run\") pod \"dcac8fc1-81ec-4845-b0d0-30e6a05bbb1f\" (UID: \"dcac8fc1-81ec-4845-b0d0-30e6a05bbb1f\") " Mar 16 16:47:06 crc kubenswrapper[5120]: I0316 16:47:06.745538 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dcac8fc1-81ec-4845-b0d0-30e6a05bbb1f-config-data\") pod \"dcac8fc1-81ec-4845-b0d0-30e6a05bbb1f\" (UID: \"dcac8fc1-81ec-4845-b0d0-30e6a05bbb1f\") " Mar 16 16:47:06 crc kubenswrapper[5120]: I0316 16:47:06.750471 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dcac8fc1-81ec-4845-b0d0-30e6a05bbb1f-logs" (OuterVolumeSpecName: "logs") pod "dcac8fc1-81ec-4845-b0d0-30e6a05bbb1f" (UID: "dcac8fc1-81ec-4845-b0d0-30e6a05bbb1f"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:47:06 crc kubenswrapper[5120]: I0316 16:47:06.753957 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dcac8fc1-81ec-4845-b0d0-30e6a05bbb1f-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "dcac8fc1-81ec-4845-b0d0-30e6a05bbb1f" (UID: "dcac8fc1-81ec-4845-b0d0-30e6a05bbb1f"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:47:06 crc kubenswrapper[5120]: I0316 16:47:06.758404 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dcac8fc1-81ec-4845-b0d0-30e6a05bbb1f-kube-api-access-4x4g6" (OuterVolumeSpecName: "kube-api-access-4x4g6") pod "dcac8fc1-81ec-4845-b0d0-30e6a05bbb1f" (UID: "dcac8fc1-81ec-4845-b0d0-30e6a05bbb1f"). InnerVolumeSpecName "kube-api-access-4x4g6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:47:06 crc kubenswrapper[5120]: I0316 16:47:06.760446 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage02-crc" (OuterVolumeSpecName: "glance") pod "dcac8fc1-81ec-4845-b0d0-30e6a05bbb1f" (UID: "dcac8fc1-81ec-4845-b0d0-30e6a05bbb1f"). InnerVolumeSpecName "local-storage02-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:47:06 crc kubenswrapper[5120]: I0316 16:47:06.769937 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dcac8fc1-81ec-4845-b0d0-30e6a05bbb1f-scripts" (OuterVolumeSpecName: "scripts") pod "dcac8fc1-81ec-4845-b0d0-30e6a05bbb1f" (UID: "dcac8fc1-81ec-4845-b0d0-30e6a05bbb1f"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:47:06 crc kubenswrapper[5120]: I0316 16:47:06.802935 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dcac8fc1-81ec-4845-b0d0-30e6a05bbb1f-config-data" (OuterVolumeSpecName: "config-data") pod "dcac8fc1-81ec-4845-b0d0-30e6a05bbb1f" (UID: "dcac8fc1-81ec-4845-b0d0-30e6a05bbb1f"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:47:06 crc kubenswrapper[5120]: I0316 16:47:06.815160 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dcac8fc1-81ec-4845-b0d0-30e6a05bbb1f-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "dcac8fc1-81ec-4845-b0d0-30e6a05bbb1f" (UID: "dcac8fc1-81ec-4845-b0d0-30e6a05bbb1f"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:47:06 crc kubenswrapper[5120]: I0316 16:47:06.848522 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dcac8fc1-81ec-4845-b0d0-30e6a05bbb1f-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:47:06 crc kubenswrapper[5120]: I0316 16:47:06.848579 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") on node \"crc\" " Mar 16 16:47:06 crc kubenswrapper[5120]: I0316 16:47:06.848594 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4x4g6\" (UniqueName: \"kubernetes.io/projected/dcac8fc1-81ec-4845-b0d0-30e6a05bbb1f-kube-api-access-4x4g6\") on node \"crc\" DevicePath \"\"" Mar 16 16:47:06 crc kubenswrapper[5120]: I0316 16:47:06.848611 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dcac8fc1-81ec-4845-b0d0-30e6a05bbb1f-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:47:06 crc kubenswrapper[5120]: I0316 16:47:06.848624 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/dcac8fc1-81ec-4845-b0d0-30e6a05bbb1f-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:47:06 crc kubenswrapper[5120]: I0316 16:47:06.848637 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/dcac8fc1-81ec-4845-b0d0-30e6a05bbb1f-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:47:06 crc kubenswrapper[5120]: I0316 16:47:06.848649 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/dcac8fc1-81ec-4845-b0d0-30e6a05bbb1f-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 16:47:06 crc kubenswrapper[5120]: I0316 16:47:06.886310 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage02-crc" (UniqueName: "kubernetes.io/local-volume/local-storage02-crc") on node "crc" Mar 16 16:47:06 crc kubenswrapper[5120]: I0316 16:47:06.950193 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:47:07 crc kubenswrapper[5120]: I0316 16:47:07.393917 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:47:07 crc kubenswrapper[5120]: I0316 16:47:07.480519 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/93aa847e-5758-407c-bc62-6e72d895ef76-httpd-run\") pod \"93aa847e-5758-407c-bc62-6e72d895ef76\" (UID: \"93aa847e-5758-407c-bc62-6e72d895ef76\") " Mar 16 16:47:07 crc kubenswrapper[5120]: I0316 16:47:07.480607 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d79dn\" (UniqueName: \"kubernetes.io/projected/93aa847e-5758-407c-bc62-6e72d895ef76-kube-api-access-d79dn\") pod \"93aa847e-5758-407c-bc62-6e72d895ef76\" (UID: \"93aa847e-5758-407c-bc62-6e72d895ef76\") " Mar 16 16:47:07 crc kubenswrapper[5120]: I0316 16:47:07.480708 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"93aa847e-5758-407c-bc62-6e72d895ef76\" (UID: \"93aa847e-5758-407c-bc62-6e72d895ef76\") " Mar 16 16:47:07 crc kubenswrapper[5120]: I0316 16:47:07.480850 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/93aa847e-5758-407c-bc62-6e72d895ef76-logs\") pod \"93aa847e-5758-407c-bc62-6e72d895ef76\" (UID: \"93aa847e-5758-407c-bc62-6e72d895ef76\") " Mar 16 16:47:07 crc kubenswrapper[5120]: I0316 16:47:07.480868 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/93aa847e-5758-407c-bc62-6e72d895ef76-combined-ca-bundle\") pod \"93aa847e-5758-407c-bc62-6e72d895ef76\" (UID: \"93aa847e-5758-407c-bc62-6e72d895ef76\") " Mar 16 16:47:07 crc kubenswrapper[5120]: I0316 16:47:07.480948 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/93aa847e-5758-407c-bc62-6e72d895ef76-scripts\") pod \"93aa847e-5758-407c-bc62-6e72d895ef76\" (UID: \"93aa847e-5758-407c-bc62-6e72d895ef76\") " Mar 16 16:47:07 crc kubenswrapper[5120]: I0316 16:47:07.481011 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/93aa847e-5758-407c-bc62-6e72d895ef76-config-data\") pod \"93aa847e-5758-407c-bc62-6e72d895ef76\" (UID: \"93aa847e-5758-407c-bc62-6e72d895ef76\") " Mar 16 16:47:07 crc kubenswrapper[5120]: I0316 16:47:07.482422 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93aa847e-5758-407c-bc62-6e72d895ef76-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "93aa847e-5758-407c-bc62-6e72d895ef76" (UID: "93aa847e-5758-407c-bc62-6e72d895ef76"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:47:07 crc kubenswrapper[5120]: I0316 16:47:07.483059 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93aa847e-5758-407c-bc62-6e72d895ef76-logs" (OuterVolumeSpecName: "logs") pod "93aa847e-5758-407c-bc62-6e72d895ef76" (UID: "93aa847e-5758-407c-bc62-6e72d895ef76"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:47:07 crc kubenswrapper[5120]: I0316 16:47:07.488466 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93aa847e-5758-407c-bc62-6e72d895ef76-kube-api-access-d79dn" (OuterVolumeSpecName: "kube-api-access-d79dn") pod "93aa847e-5758-407c-bc62-6e72d895ef76" (UID: "93aa847e-5758-407c-bc62-6e72d895ef76"). InnerVolumeSpecName "kube-api-access-d79dn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:47:07 crc kubenswrapper[5120]: I0316 16:47:07.491886 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage01-crc" (OuterVolumeSpecName: "glance") pod "93aa847e-5758-407c-bc62-6e72d895ef76" (UID: "93aa847e-5758-407c-bc62-6e72d895ef76"). InnerVolumeSpecName "local-storage01-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:47:07 crc kubenswrapper[5120]: I0316 16:47:07.494068 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93aa847e-5758-407c-bc62-6e72d895ef76-scripts" (OuterVolumeSpecName: "scripts") pod "93aa847e-5758-407c-bc62-6e72d895ef76" (UID: "93aa847e-5758-407c-bc62-6e72d895ef76"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:47:07 crc kubenswrapper[5120]: I0316 16:47:07.555037 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93aa847e-5758-407c-bc62-6e72d895ef76-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "93aa847e-5758-407c-bc62-6e72d895ef76" (UID: "93aa847e-5758-407c-bc62-6e72d895ef76"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:47:07 crc kubenswrapper[5120]: I0316 16:47:07.571310 5120 generic.go:358] "Generic (PLEG): container finished" podID="93aa847e-5758-407c-bc62-6e72d895ef76" containerID="d74da543a4cf1021dca35c2034a9aa8d2f0a9e792a1e589d2be2e140069ab929" exitCode=0 Mar 16 16:47:07 crc kubenswrapper[5120]: I0316 16:47:07.571739 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"93aa847e-5758-407c-bc62-6e72d895ef76","Type":"ContainerDied","Data":"d74da543a4cf1021dca35c2034a9aa8d2f0a9e792a1e589d2be2e140069ab929"} Mar 16 16:47:07 crc kubenswrapper[5120]: I0316 16:47:07.571817 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"93aa847e-5758-407c-bc62-6e72d895ef76","Type":"ContainerDied","Data":"53a6fefe76ef2562858b31cc6baac672105d40810f926586714923bbf9f58927"} Mar 16 16:47:07 crc kubenswrapper[5120]: I0316 16:47:07.571845 5120 scope.go:117] "RemoveContainer" containerID="d74da543a4cf1021dca35c2034a9aa8d2f0a9e792a1e589d2be2e140069ab929" Mar 16 16:47:07 crc kubenswrapper[5120]: I0316 16:47:07.571959 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:47:07 crc kubenswrapper[5120]: I0316 16:47:07.573124 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93aa847e-5758-407c-bc62-6e72d895ef76-config-data" (OuterVolumeSpecName: "config-data") pod "93aa847e-5758-407c-bc62-6e72d895ef76" (UID: "93aa847e-5758-407c-bc62-6e72d895ef76"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:47:07 crc kubenswrapper[5120]: I0316 16:47:07.581295 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"47657b56-a651-4772-a9fd-9571c816bdf1","Type":"ContainerStarted","Data":"f0380f0700356672f20213c972cf3bf7933a573b2baedf5e35c34185fb4bc457"} Mar 16 16:47:07 crc kubenswrapper[5120]: I0316 16:47:07.584281 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/93aa847e-5758-407c-bc62-6e72d895ef76-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 16:47:07 crc kubenswrapper[5120]: I0316 16:47:07.584321 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d79dn\" (UniqueName: \"kubernetes.io/projected/93aa847e-5758-407c-bc62-6e72d895ef76-kube-api-access-d79dn\") on node \"crc\" DevicePath \"\"" Mar 16 16:47:07 crc kubenswrapper[5120]: I0316 16:47:07.584348 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") on node \"crc\" " Mar 16 16:47:07 crc kubenswrapper[5120]: I0316 16:47:07.584361 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/93aa847e-5758-407c-bc62-6e72d895ef76-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:47:07 crc kubenswrapper[5120]: I0316 16:47:07.584370 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/93aa847e-5758-407c-bc62-6e72d895ef76-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:47:07 crc kubenswrapper[5120]: I0316 16:47:07.584379 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/93aa847e-5758-407c-bc62-6e72d895ef76-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:47:07 crc kubenswrapper[5120]: I0316 16:47:07.584387 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/93aa847e-5758-407c-bc62-6e72d895ef76-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:47:07 crc kubenswrapper[5120]: I0316 16:47:07.593592 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:47:07 crc kubenswrapper[5120]: I0316 16:47:07.593985 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"dcac8fc1-81ec-4845-b0d0-30e6a05bbb1f","Type":"ContainerDied","Data":"6d46565cece99776821560d4674bd0b0e6ed24daf13e58bf543fd0c4cc7ec07e"} Mar 16 16:47:07 crc kubenswrapper[5120]: I0316 16:47:07.612715 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage01-crc" (UniqueName: "kubernetes.io/local-volume/local-storage01-crc") on node "crc" Mar 16 16:47:07 crc kubenswrapper[5120]: I0316 16:47:07.615988 5120 scope.go:117] "RemoveContainer" containerID="b99d2425893ee7d0bb78b5ae298044655ddbb8d1c0112a8bd52e375342228cf5" Mar 16 16:47:07 crc kubenswrapper[5120]: I0316 16:47:07.654129 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:47:07 crc kubenswrapper[5120]: I0316 16:47:07.654851 5120 scope.go:117] "RemoveContainer" containerID="d74da543a4cf1021dca35c2034a9aa8d2f0a9e792a1e589d2be2e140069ab929" Mar 16 16:47:07 crc kubenswrapper[5120]: E0316 16:47:07.655873 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d74da543a4cf1021dca35c2034a9aa8d2f0a9e792a1e589d2be2e140069ab929\": container with ID starting with d74da543a4cf1021dca35c2034a9aa8d2f0a9e792a1e589d2be2e140069ab929 not found: ID does not exist" containerID="d74da543a4cf1021dca35c2034a9aa8d2f0a9e792a1e589d2be2e140069ab929" Mar 16 16:47:07 crc kubenswrapper[5120]: I0316 16:47:07.655916 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d74da543a4cf1021dca35c2034a9aa8d2f0a9e792a1e589d2be2e140069ab929"} err="failed to get container status \"d74da543a4cf1021dca35c2034a9aa8d2f0a9e792a1e589d2be2e140069ab929\": rpc error: code = NotFound desc = could not find container \"d74da543a4cf1021dca35c2034a9aa8d2f0a9e792a1e589d2be2e140069ab929\": container with ID starting with d74da543a4cf1021dca35c2034a9aa8d2f0a9e792a1e589d2be2e140069ab929 not found: ID does not exist" Mar 16 16:47:07 crc kubenswrapper[5120]: I0316 16:47:07.655941 5120 scope.go:117] "RemoveContainer" containerID="b99d2425893ee7d0bb78b5ae298044655ddbb8d1c0112a8bd52e375342228cf5" Mar 16 16:47:07 crc kubenswrapper[5120]: E0316 16:47:07.658891 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b99d2425893ee7d0bb78b5ae298044655ddbb8d1c0112a8bd52e375342228cf5\": container with ID starting with b99d2425893ee7d0bb78b5ae298044655ddbb8d1c0112a8bd52e375342228cf5 not found: ID does not exist" containerID="b99d2425893ee7d0bb78b5ae298044655ddbb8d1c0112a8bd52e375342228cf5" Mar 16 16:47:07 crc kubenswrapper[5120]: I0316 16:47:07.658939 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b99d2425893ee7d0bb78b5ae298044655ddbb8d1c0112a8bd52e375342228cf5"} err="failed to get container status \"b99d2425893ee7d0bb78b5ae298044655ddbb8d1c0112a8bd52e375342228cf5\": rpc error: code = NotFound desc = could not find container \"b99d2425893ee7d0bb78b5ae298044655ddbb8d1c0112a8bd52e375342228cf5\": container with ID starting with b99d2425893ee7d0bb78b5ae298044655ddbb8d1c0112a8bd52e375342228cf5 not found: ID does not exist" Mar 16 16:47:07 crc kubenswrapper[5120]: I0316 16:47:07.658970 5120 scope.go:117] "RemoveContainer" containerID="ed3347ea7d2468f79274a2c70278a17cd2e43c1a264a6e44f4829ce2ebbf4f53" Mar 16 16:47:07 crc kubenswrapper[5120]: I0316 16:47:07.670566 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:47:07 crc kubenswrapper[5120]: I0316 16:47:07.687578 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:47:07 crc kubenswrapper[5120]: I0316 16:47:07.695963 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:47:07 crc kubenswrapper[5120]: I0316 16:47:07.697393 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd80c01f-91bc-4691-87be-a4d998cfc8ed" containerName="mariadb-account-create-update" Mar 16 16:47:07 crc kubenswrapper[5120]: I0316 16:47:07.697414 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd80c01f-91bc-4691-87be-a4d998cfc8ed" containerName="mariadb-account-create-update" Mar 16 16:47:07 crc kubenswrapper[5120]: I0316 16:47:07.697439 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dcac8fc1-81ec-4845-b0d0-30e6a05bbb1f" containerName="glance-log" Mar 16 16:47:07 crc kubenswrapper[5120]: I0316 16:47:07.697447 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="dcac8fc1-81ec-4845-b0d0-30e6a05bbb1f" containerName="glance-log" Mar 16 16:47:07 crc kubenswrapper[5120]: I0316 16:47:07.697460 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93bf3a3e-5820-451f-b1c4-6e302325b1b7" containerName="mariadb-database-create" Mar 16 16:47:07 crc kubenswrapper[5120]: I0316 16:47:07.697469 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="93bf3a3e-5820-451f-b1c4-6e302325b1b7" containerName="mariadb-database-create" Mar 16 16:47:07 crc kubenswrapper[5120]: I0316 16:47:07.697484 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93aa847e-5758-407c-bc62-6e72d895ef76" containerName="glance-httpd" Mar 16 16:47:07 crc kubenswrapper[5120]: I0316 16:47:07.697490 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="93aa847e-5758-407c-bc62-6e72d895ef76" containerName="glance-httpd" Mar 16 16:47:07 crc kubenswrapper[5120]: I0316 16:47:07.697508 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86bdc983-99ae-4f65-b8e0-37bef61cb70f" containerName="mariadb-database-create" Mar 16 16:47:07 crc kubenswrapper[5120]: I0316 16:47:07.697514 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="86bdc983-99ae-4f65-b8e0-37bef61cb70f" containerName="mariadb-database-create" Mar 16 16:47:07 crc kubenswrapper[5120]: I0316 16:47:07.697531 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93aa847e-5758-407c-bc62-6e72d895ef76" containerName="glance-log" Mar 16 16:47:07 crc kubenswrapper[5120]: I0316 16:47:07.697537 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="93aa847e-5758-407c-bc62-6e72d895ef76" containerName="glance-log" Mar 16 16:47:07 crc kubenswrapper[5120]: I0316 16:47:07.697560 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4757645-5b79-4163-a7f8-f4380d7615e4" containerName="mariadb-account-create-update" Mar 16 16:47:07 crc kubenswrapper[5120]: I0316 16:47:07.697568 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4757645-5b79-4163-a7f8-f4380d7615e4" containerName="mariadb-account-create-update" Mar 16 16:47:07 crc kubenswrapper[5120]: I0316 16:47:07.697583 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dcac8fc1-81ec-4845-b0d0-30e6a05bbb1f" containerName="glance-httpd" Mar 16 16:47:07 crc kubenswrapper[5120]: I0316 16:47:07.697589 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="dcac8fc1-81ec-4845-b0d0-30e6a05bbb1f" containerName="glance-httpd" Mar 16 16:47:07 crc kubenswrapper[5120]: I0316 16:47:07.697818 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="93bf3a3e-5820-451f-b1c4-6e302325b1b7" containerName="mariadb-database-create" Mar 16 16:47:07 crc kubenswrapper[5120]: I0316 16:47:07.698287 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="dcac8fc1-81ec-4845-b0d0-30e6a05bbb1f" containerName="glance-httpd" Mar 16 16:47:07 crc kubenswrapper[5120]: I0316 16:47:07.698307 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="86bdc983-99ae-4f65-b8e0-37bef61cb70f" containerName="mariadb-database-create" Mar 16 16:47:07 crc kubenswrapper[5120]: I0316 16:47:07.698342 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="cd80c01f-91bc-4691-87be-a4d998cfc8ed" containerName="mariadb-account-create-update" Mar 16 16:47:07 crc kubenswrapper[5120]: I0316 16:47:07.698356 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="dcac8fc1-81ec-4845-b0d0-30e6a05bbb1f" containerName="glance-log" Mar 16 16:47:07 crc kubenswrapper[5120]: I0316 16:47:07.698375 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="93aa847e-5758-407c-bc62-6e72d895ef76" containerName="glance-httpd" Mar 16 16:47:07 crc kubenswrapper[5120]: I0316 16:47:07.698390 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c4757645-5b79-4163-a7f8-f4380d7615e4" containerName="mariadb-account-create-update" Mar 16 16:47:07 crc kubenswrapper[5120]: I0316 16:47:07.698399 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="93aa847e-5758-407c-bc62-6e72d895ef76" containerName="glance-log" Mar 16 16:47:07 crc kubenswrapper[5120]: I0316 16:47:07.720068 5120 scope.go:117] "RemoveContainer" containerID="e72148aadfa843c0c3ae1f7c85a9efa5f3ea2f2c0d518aea7817677d69ae155c" Mar 16 16:47:07 crc kubenswrapper[5120]: I0316 16:47:07.722946 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:47:07 crc kubenswrapper[5120]: I0316 16:47:07.723127 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:47:07 crc kubenswrapper[5120]: I0316 16:47:07.727689 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-external-config-data\"" Mar 16 16:47:07 crc kubenswrapper[5120]: I0316 16:47:07.790474 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/b9ac41f6-42c9-4d95-b38c-287da24a2adf-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"b9ac41f6-42c9-4d95-b38c-287da24a2adf\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:47:07 crc kubenswrapper[5120]: I0316 16:47:07.790587 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"glance-default-external-api-0\" (UID: \"b9ac41f6-42c9-4d95-b38c-287da24a2adf\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:47:07 crc kubenswrapper[5120]: I0316 16:47:07.790638 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b9ac41f6-42c9-4d95-b38c-287da24a2adf-scripts\") pod \"glance-default-external-api-0\" (UID: \"b9ac41f6-42c9-4d95-b38c-287da24a2adf\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:47:07 crc kubenswrapper[5120]: I0316 16:47:07.790818 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cnq2\" (UniqueName: \"kubernetes.io/projected/b9ac41f6-42c9-4d95-b38c-287da24a2adf-kube-api-access-2cnq2\") pod \"glance-default-external-api-0\" (UID: \"b9ac41f6-42c9-4d95-b38c-287da24a2adf\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:47:07 crc kubenswrapper[5120]: I0316 16:47:07.791072 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b9ac41f6-42c9-4d95-b38c-287da24a2adf-config-data\") pod \"glance-default-external-api-0\" (UID: \"b9ac41f6-42c9-4d95-b38c-287da24a2adf\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:47:07 crc kubenswrapper[5120]: I0316 16:47:07.791140 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b9ac41f6-42c9-4d95-b38c-287da24a2adf-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"b9ac41f6-42c9-4d95-b38c-287da24a2adf\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:47:07 crc kubenswrapper[5120]: I0316 16:47:07.791198 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b9ac41f6-42c9-4d95-b38c-287da24a2adf-logs\") pod \"glance-default-external-api-0\" (UID: \"b9ac41f6-42c9-4d95-b38c-287da24a2adf\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:47:07 crc kubenswrapper[5120]: I0316 16:47:07.893280 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b9ac41f6-42c9-4d95-b38c-287da24a2adf-config-data\") pod \"glance-default-external-api-0\" (UID: \"b9ac41f6-42c9-4d95-b38c-287da24a2adf\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:47:07 crc kubenswrapper[5120]: I0316 16:47:07.893519 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b9ac41f6-42c9-4d95-b38c-287da24a2adf-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"b9ac41f6-42c9-4d95-b38c-287da24a2adf\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:47:07 crc kubenswrapper[5120]: I0316 16:47:07.893617 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b9ac41f6-42c9-4d95-b38c-287da24a2adf-logs\") pod \"glance-default-external-api-0\" (UID: \"b9ac41f6-42c9-4d95-b38c-287da24a2adf\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:47:07 crc kubenswrapper[5120]: I0316 16:47:07.893930 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/b9ac41f6-42c9-4d95-b38c-287da24a2adf-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"b9ac41f6-42c9-4d95-b38c-287da24a2adf\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:47:07 crc kubenswrapper[5120]: I0316 16:47:07.894033 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"glance-default-external-api-0\" (UID: \"b9ac41f6-42c9-4d95-b38c-287da24a2adf\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:47:07 crc kubenswrapper[5120]: I0316 16:47:07.894135 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b9ac41f6-42c9-4d95-b38c-287da24a2adf-scripts\") pod \"glance-default-external-api-0\" (UID: \"b9ac41f6-42c9-4d95-b38c-287da24a2adf\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:47:07 crc kubenswrapper[5120]: I0316 16:47:07.894275 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2cnq2\" (UniqueName: \"kubernetes.io/projected/b9ac41f6-42c9-4d95-b38c-287da24a2adf-kube-api-access-2cnq2\") pod \"glance-default-external-api-0\" (UID: \"b9ac41f6-42c9-4d95-b38c-287da24a2adf\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:47:07 crc kubenswrapper[5120]: I0316 16:47:07.895582 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/b9ac41f6-42c9-4d95-b38c-287da24a2adf-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"b9ac41f6-42c9-4d95-b38c-287da24a2adf\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:47:07 crc kubenswrapper[5120]: I0316 16:47:07.895827 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"glance-default-external-api-0\" (UID: \"b9ac41f6-42c9-4d95-b38c-287da24a2adf\") device mount path \"/mnt/openstack/pv02\"" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:47:07 crc kubenswrapper[5120]: I0316 16:47:07.904580 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b9ac41f6-42c9-4d95-b38c-287da24a2adf-config-data\") pod \"glance-default-external-api-0\" (UID: \"b9ac41f6-42c9-4d95-b38c-287da24a2adf\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:47:07 crc kubenswrapper[5120]: I0316 16:47:07.904648 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b9ac41f6-42c9-4d95-b38c-287da24a2adf-logs\") pod \"glance-default-external-api-0\" (UID: \"b9ac41f6-42c9-4d95-b38c-287da24a2adf\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:47:07 crc kubenswrapper[5120]: I0316 16:47:07.907069 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b9ac41f6-42c9-4d95-b38c-287da24a2adf-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"b9ac41f6-42c9-4d95-b38c-287da24a2adf\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:47:07 crc kubenswrapper[5120]: I0316 16:47:07.910658 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b9ac41f6-42c9-4d95-b38c-287da24a2adf-scripts\") pod \"glance-default-external-api-0\" (UID: \"b9ac41f6-42c9-4d95-b38c-287da24a2adf\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:47:07 crc kubenswrapper[5120]: I0316 16:47:07.925035 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cnq2\" (UniqueName: \"kubernetes.io/projected/b9ac41f6-42c9-4d95-b38c-287da24a2adf-kube-api-access-2cnq2\") pod \"glance-default-external-api-0\" (UID: \"b9ac41f6-42c9-4d95-b38c-287da24a2adf\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:47:07 crc kubenswrapper[5120]: I0316 16:47:07.942261 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:47:07 crc kubenswrapper[5120]: I0316 16:47:07.942645 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"glance-default-external-api-0\" (UID: \"b9ac41f6-42c9-4d95-b38c-287da24a2adf\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:47:07 crc kubenswrapper[5120]: I0316 16:47:07.955720 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:47:07 crc kubenswrapper[5120]: I0316 16:47:07.973610 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:47:08 crc kubenswrapper[5120]: I0316 16:47:08.023285 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:47:08 crc kubenswrapper[5120]: I0316 16:47:08.023423 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:47:08 crc kubenswrapper[5120]: I0316 16:47:08.026604 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-internal-config-data\"" Mar 16 16:47:08 crc kubenswrapper[5120]: I0316 16:47:08.058915 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:47:08 crc kubenswrapper[5120]: I0316 16:47:08.102038 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/00cf7a69-dcf7-45dd-9291-3e4d75ece0da-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"00cf7a69-dcf7-45dd-9291-3e4d75ece0da\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:47:08 crc kubenswrapper[5120]: I0316 16:47:08.102150 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tx8rk\" (UniqueName: \"kubernetes.io/projected/00cf7a69-dcf7-45dd-9291-3e4d75ece0da-kube-api-access-tx8rk\") pod \"glance-default-internal-api-0\" (UID: \"00cf7a69-dcf7-45dd-9291-3e4d75ece0da\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:47:08 crc kubenswrapper[5120]: I0316 16:47:08.102183 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/00cf7a69-dcf7-45dd-9291-3e4d75ece0da-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"00cf7a69-dcf7-45dd-9291-3e4d75ece0da\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:47:08 crc kubenswrapper[5120]: I0316 16:47:08.102270 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/00cf7a69-dcf7-45dd-9291-3e4d75ece0da-logs\") pod \"glance-default-internal-api-0\" (UID: \"00cf7a69-dcf7-45dd-9291-3e4d75ece0da\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:47:08 crc kubenswrapper[5120]: I0316 16:47:08.102364 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/00cf7a69-dcf7-45dd-9291-3e4d75ece0da-scripts\") pod \"glance-default-internal-api-0\" (UID: \"00cf7a69-dcf7-45dd-9291-3e4d75ece0da\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:47:08 crc kubenswrapper[5120]: I0316 16:47:08.102571 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"glance-default-internal-api-0\" (UID: \"00cf7a69-dcf7-45dd-9291-3e4d75ece0da\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:47:08 crc kubenswrapper[5120]: I0316 16:47:08.102902 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/00cf7a69-dcf7-45dd-9291-3e4d75ece0da-config-data\") pod \"glance-default-internal-api-0\" (UID: \"00cf7a69-dcf7-45dd-9291-3e4d75ece0da\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:47:08 crc kubenswrapper[5120]: I0316 16:47:08.205941 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/00cf7a69-dcf7-45dd-9291-3e4d75ece0da-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"00cf7a69-dcf7-45dd-9291-3e4d75ece0da\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:47:08 crc kubenswrapper[5120]: I0316 16:47:08.206427 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/00cf7a69-dcf7-45dd-9291-3e4d75ece0da-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"00cf7a69-dcf7-45dd-9291-3e4d75ece0da\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:47:08 crc kubenswrapper[5120]: I0316 16:47:08.206518 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tx8rk\" (UniqueName: \"kubernetes.io/projected/00cf7a69-dcf7-45dd-9291-3e4d75ece0da-kube-api-access-tx8rk\") pod \"glance-default-internal-api-0\" (UID: \"00cf7a69-dcf7-45dd-9291-3e4d75ece0da\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:47:08 crc kubenswrapper[5120]: I0316 16:47:08.206610 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/00cf7a69-dcf7-45dd-9291-3e4d75ece0da-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"00cf7a69-dcf7-45dd-9291-3e4d75ece0da\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:47:08 crc kubenswrapper[5120]: I0316 16:47:08.206706 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/00cf7a69-dcf7-45dd-9291-3e4d75ece0da-logs\") pod \"glance-default-internal-api-0\" (UID: \"00cf7a69-dcf7-45dd-9291-3e4d75ece0da\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:47:08 crc kubenswrapper[5120]: I0316 16:47:08.206878 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/00cf7a69-dcf7-45dd-9291-3e4d75ece0da-scripts\") pod \"glance-default-internal-api-0\" (UID: \"00cf7a69-dcf7-45dd-9291-3e4d75ece0da\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:47:08 crc kubenswrapper[5120]: I0316 16:47:08.207075 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"glance-default-internal-api-0\" (UID: \"00cf7a69-dcf7-45dd-9291-3e4d75ece0da\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:47:08 crc kubenswrapper[5120]: I0316 16:47:08.207204 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/00cf7a69-dcf7-45dd-9291-3e4d75ece0da-config-data\") pod \"glance-default-internal-api-0\" (UID: \"00cf7a69-dcf7-45dd-9291-3e4d75ece0da\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:47:08 crc kubenswrapper[5120]: I0316 16:47:08.212122 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/00cf7a69-dcf7-45dd-9291-3e4d75ece0da-config-data\") pod \"glance-default-internal-api-0\" (UID: \"00cf7a69-dcf7-45dd-9291-3e4d75ece0da\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:47:08 crc kubenswrapper[5120]: I0316 16:47:08.216411 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/00cf7a69-dcf7-45dd-9291-3e4d75ece0da-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"00cf7a69-dcf7-45dd-9291-3e4d75ece0da\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:47:08 crc kubenswrapper[5120]: I0316 16:47:08.218979 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/00cf7a69-dcf7-45dd-9291-3e4d75ece0da-logs\") pod \"glance-default-internal-api-0\" (UID: \"00cf7a69-dcf7-45dd-9291-3e4d75ece0da\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:47:08 crc kubenswrapper[5120]: I0316 16:47:08.227240 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/00cf7a69-dcf7-45dd-9291-3e4d75ece0da-scripts\") pod \"glance-default-internal-api-0\" (UID: \"00cf7a69-dcf7-45dd-9291-3e4d75ece0da\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:47:08 crc kubenswrapper[5120]: I0316 16:47:08.227572 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"glance-default-internal-api-0\" (UID: \"00cf7a69-dcf7-45dd-9291-3e4d75ece0da\") device mount path \"/mnt/openstack/pv01\"" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:47:08 crc kubenswrapper[5120]: I0316 16:47:08.282650 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tx8rk\" (UniqueName: \"kubernetes.io/projected/00cf7a69-dcf7-45dd-9291-3e4d75ece0da-kube-api-access-tx8rk\") pod \"glance-default-internal-api-0\" (UID: \"00cf7a69-dcf7-45dd-9291-3e4d75ece0da\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:47:08 crc kubenswrapper[5120]: I0316 16:47:08.329875 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"glance-default-internal-api-0\" (UID: \"00cf7a69-dcf7-45dd-9291-3e4d75ece0da\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:47:08 crc kubenswrapper[5120]: I0316 16:47:08.360885 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:47:08 crc kubenswrapper[5120]: I0316 16:47:08.617999 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"47657b56-a651-4772-a9fd-9571c816bdf1","Type":"ContainerStarted","Data":"836fb1fb28d25a0a26164c678fe01fcc6b7b244baa86af1dab59f1eedf5c2723"} Mar 16 16:47:08 crc kubenswrapper[5120]: I0316 16:47:08.639167 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:47:08 crc kubenswrapper[5120]: W0316 16:47:08.649078 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb9ac41f6_42c9_4d95_b38c_287da24a2adf.slice/crio-4ad5228c03807961e746b3c00a810bec1d5494d878ea20c132d09b8793f929a8 WatchSource:0}: Error finding container 4ad5228c03807961e746b3c00a810bec1d5494d878ea20c132d09b8793f929a8: Status 404 returned error can't find the container with id 4ad5228c03807961e746b3c00a810bec1d5494d878ea20c132d09b8793f929a8 Mar 16 16:47:08 crc kubenswrapper[5120]: I0316 16:47:08.679207 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93aa847e-5758-407c-bc62-6e72d895ef76" path="/var/lib/kubelet/pods/93aa847e-5758-407c-bc62-6e72d895ef76/volumes" Mar 16 16:47:08 crc kubenswrapper[5120]: I0316 16:47:08.681177 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dcac8fc1-81ec-4845-b0d0-30e6a05bbb1f" path="/var/lib/kubelet/pods/dcac8fc1-81ec-4845-b0d0-30e6a05bbb1f/volumes" Mar 16 16:47:08 crc kubenswrapper[5120]: I0316 16:47:08.951243 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:47:09 crc kubenswrapper[5120]: I0316 16:47:09.084252 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/placement-744476466-rznwv" Mar 16 16:47:09 crc kubenswrapper[5120]: I0316 16:47:09.641852 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"b9ac41f6-42c9-4d95-b38c-287da24a2adf","Type":"ContainerStarted","Data":"abcc80872762df0d1cfbaa3fc4ee7102269763a95ca5fd3084ec39f82e0cafdb"} Mar 16 16:47:09 crc kubenswrapper[5120]: I0316 16:47:09.642228 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"b9ac41f6-42c9-4d95-b38c-287da24a2adf","Type":"ContainerStarted","Data":"4ad5228c03807961e746b3c00a810bec1d5494d878ea20c132d09b8793f929a8"} Mar 16 16:47:09 crc kubenswrapper[5120]: I0316 16:47:09.647459 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"00cf7a69-dcf7-45dd-9291-3e4d75ece0da","Type":"ContainerStarted","Data":"5f472509547f5092278120a4b65dbbfd4e2176831bee126bd9fa7e81c878b449"} Mar 16 16:47:09 crc kubenswrapper[5120]: E0316 16:47:09.869929 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1755304 actualBytes=10240 Mar 16 16:47:10 crc kubenswrapper[5120]: I0316 16:47:10.207117 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/placement-744476466-rznwv" Mar 16 16:47:10 crc kubenswrapper[5120]: I0316 16:47:10.284392 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-54bf5db978-kpsbr"] Mar 16 16:47:10 crc kubenswrapper[5120]: I0316 16:47:10.284642 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-54bf5db978-kpsbr" podUID="174be312-c22c-4576-a6e8-55fd5408af8d" containerName="placement-log" containerID="cri-o://d6f1a9666b19578cc92b6bea3ba758546bac86273c35edc2b038d02550c541ed" gracePeriod=30 Mar 16 16:47:10 crc kubenswrapper[5120]: I0316 16:47:10.285116 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-54bf5db978-kpsbr" podUID="174be312-c22c-4576-a6e8-55fd5408af8d" containerName="placement-api" containerID="cri-o://09bd7a3d7571c33d89e8f2cd860d4af58e479dd2ab1fb30baa46d267c81c1666" gracePeriod=30 Mar 16 16:47:10 crc kubenswrapper[5120]: I0316 16:47:10.678695 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"00cf7a69-dcf7-45dd-9291-3e4d75ece0da","Type":"ContainerStarted","Data":"25a0f6ab9cd653f0d4ee96cd81c134f0a6c81ac1d4193f06a891df2ef4a46fec"} Mar 16 16:47:10 crc kubenswrapper[5120]: I0316 16:47:10.683408 5120 generic.go:358] "Generic (PLEG): container finished" podID="174be312-c22c-4576-a6e8-55fd5408af8d" containerID="d6f1a9666b19578cc92b6bea3ba758546bac86273c35edc2b038d02550c541ed" exitCode=143 Mar 16 16:47:10 crc kubenswrapper[5120]: I0316 16:47:10.683478 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-54bf5db978-kpsbr" event={"ID":"174be312-c22c-4576-a6e8-55fd5408af8d","Type":"ContainerDied","Data":"d6f1a9666b19578cc92b6bea3ba758546bac86273c35edc2b038d02550c541ed"} Mar 16 16:47:10 crc kubenswrapper[5120]: I0316 16:47:10.732143 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-external-api-0" podStartSLOduration=3.732120335 podStartE2EDuration="3.732120335s" podCreationTimestamp="2026-03-16 16:47:07 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:47:10.727071548 +0000 UTC m=+4532.881003205" watchObservedRunningTime="2026-03-16 16:47:10.732120335 +0000 UTC m=+4532.886051992" Mar 16 16:47:11 crc kubenswrapper[5120]: I0316 16:47:11.176037 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-cc9l2"] Mar 16 16:47:11 crc kubenswrapper[5120]: I0316 16:47:11.182743 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-cc9l2" Mar 16 16:47:11 crc kubenswrapper[5120]: I0316 16:47:11.185400 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-conductor-scripts\"" Mar 16 16:47:11 crc kubenswrapper[5120]: I0316 16:47:11.186624 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-conductor-config-data\"" Mar 16 16:47:11 crc kubenswrapper[5120]: I0316 16:47:11.190925 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-cc9l2"] Mar 16 16:47:11 crc kubenswrapper[5120]: I0316 16:47:11.198987 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-nova-dockercfg-c8q2v\"" Mar 16 16:47:11 crc kubenswrapper[5120]: I0316 16:47:11.322176 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b0efd462-99b7-4e0f-a098-4add05cf74a2-config-data\") pod \"nova-cell0-conductor-db-sync-cc9l2\" (UID: \"b0efd462-99b7-4e0f-a098-4add05cf74a2\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-cc9l2" Mar 16 16:47:11 crc kubenswrapper[5120]: I0316 16:47:11.322327 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b0efd462-99b7-4e0f-a098-4add05cf74a2-scripts\") pod \"nova-cell0-conductor-db-sync-cc9l2\" (UID: \"b0efd462-99b7-4e0f-a098-4add05cf74a2\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-cc9l2" Mar 16 16:47:11 crc kubenswrapper[5120]: I0316 16:47:11.322356 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b0efd462-99b7-4e0f-a098-4add05cf74a2-combined-ca-bundle\") pod \"nova-cell0-conductor-db-sync-cc9l2\" (UID: \"b0efd462-99b7-4e0f-a098-4add05cf74a2\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-cc9l2" Mar 16 16:47:11 crc kubenswrapper[5120]: I0316 16:47:11.322488 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfw96\" (UniqueName: \"kubernetes.io/projected/b0efd462-99b7-4e0f-a098-4add05cf74a2-kube-api-access-xfw96\") pod \"nova-cell0-conductor-db-sync-cc9l2\" (UID: \"b0efd462-99b7-4e0f-a098-4add05cf74a2\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-cc9l2" Mar 16 16:47:11 crc kubenswrapper[5120]: I0316 16:47:11.425165 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b0efd462-99b7-4e0f-a098-4add05cf74a2-scripts\") pod \"nova-cell0-conductor-db-sync-cc9l2\" (UID: \"b0efd462-99b7-4e0f-a098-4add05cf74a2\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-cc9l2" Mar 16 16:47:11 crc kubenswrapper[5120]: I0316 16:47:11.425217 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b0efd462-99b7-4e0f-a098-4add05cf74a2-combined-ca-bundle\") pod \"nova-cell0-conductor-db-sync-cc9l2\" (UID: \"b0efd462-99b7-4e0f-a098-4add05cf74a2\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-cc9l2" Mar 16 16:47:11 crc kubenswrapper[5120]: I0316 16:47:11.425253 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xfw96\" (UniqueName: \"kubernetes.io/projected/b0efd462-99b7-4e0f-a098-4add05cf74a2-kube-api-access-xfw96\") pod \"nova-cell0-conductor-db-sync-cc9l2\" (UID: \"b0efd462-99b7-4e0f-a098-4add05cf74a2\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-cc9l2" Mar 16 16:47:11 crc kubenswrapper[5120]: I0316 16:47:11.425602 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b0efd462-99b7-4e0f-a098-4add05cf74a2-config-data\") pod \"nova-cell0-conductor-db-sync-cc9l2\" (UID: \"b0efd462-99b7-4e0f-a098-4add05cf74a2\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-cc9l2" Mar 16 16:47:11 crc kubenswrapper[5120]: I0316 16:47:11.429933 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b0efd462-99b7-4e0f-a098-4add05cf74a2-config-data\") pod \"nova-cell0-conductor-db-sync-cc9l2\" (UID: \"b0efd462-99b7-4e0f-a098-4add05cf74a2\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-cc9l2" Mar 16 16:47:11 crc kubenswrapper[5120]: I0316 16:47:11.435171 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b0efd462-99b7-4e0f-a098-4add05cf74a2-scripts\") pod \"nova-cell0-conductor-db-sync-cc9l2\" (UID: \"b0efd462-99b7-4e0f-a098-4add05cf74a2\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-cc9l2" Mar 16 16:47:11 crc kubenswrapper[5120]: I0316 16:47:11.435961 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b0efd462-99b7-4e0f-a098-4add05cf74a2-combined-ca-bundle\") pod \"nova-cell0-conductor-db-sync-cc9l2\" (UID: \"b0efd462-99b7-4e0f-a098-4add05cf74a2\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-cc9l2" Mar 16 16:47:11 crc kubenswrapper[5120]: I0316 16:47:11.450251 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfw96\" (UniqueName: \"kubernetes.io/projected/b0efd462-99b7-4e0f-a098-4add05cf74a2-kube-api-access-xfw96\") pod \"nova-cell0-conductor-db-sync-cc9l2\" (UID: \"b0efd462-99b7-4e0f-a098-4add05cf74a2\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-cc9l2" Mar 16 16:47:11 crc kubenswrapper[5120]: I0316 16:47:11.501039 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-cc9l2" Mar 16 16:47:11 crc kubenswrapper[5120]: I0316 16:47:11.714581 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"00cf7a69-dcf7-45dd-9291-3e4d75ece0da","Type":"ContainerStarted","Data":"62b12f4f75e2aae38db45282d142c8c9e3c9bde4fe29592bc1d89f41c324da4f"} Mar 16 16:47:11 crc kubenswrapper[5120]: I0316 16:47:11.719199 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="47657b56-a651-4772-a9fd-9571c816bdf1" containerName="ceilometer-central-agent" containerID="cri-o://a540e1d24ade08845cd83fe49d87346421ce32a5e31629ec91d2f7f1c23c430d" gracePeriod=30 Mar 16 16:47:11 crc kubenswrapper[5120]: I0316 16:47:11.719238 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"47657b56-a651-4772-a9fd-9571c816bdf1","Type":"ContainerStarted","Data":"e14f05f19054d22c803d42682f90a14db0f09b272ad6d1fbabd0c0eea7020ef2"} Mar 16 16:47:11 crc kubenswrapper[5120]: I0316 16:47:11.719341 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:47:11 crc kubenswrapper[5120]: I0316 16:47:11.719390 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="47657b56-a651-4772-a9fd-9571c816bdf1" containerName="sg-core" containerID="cri-o://836fb1fb28d25a0a26164c678fe01fcc6b7b244baa86af1dab59f1eedf5c2723" gracePeriod=30 Mar 16 16:47:11 crc kubenswrapper[5120]: I0316 16:47:11.719453 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="47657b56-a651-4772-a9fd-9571c816bdf1" containerName="ceilometer-notification-agent" containerID="cri-o://f0380f0700356672f20213c972cf3bf7933a573b2baedf5e35c34185fb4bc457" gracePeriod=30 Mar 16 16:47:11 crc kubenswrapper[5120]: I0316 16:47:11.719470 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="47657b56-a651-4772-a9fd-9571c816bdf1" containerName="proxy-httpd" containerID="cri-o://e14f05f19054d22c803d42682f90a14db0f09b272ad6d1fbabd0c0eea7020ef2" gracePeriod=30 Mar 16 16:47:11 crc kubenswrapper[5120]: I0316 16:47:11.727708 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"b9ac41f6-42c9-4d95-b38c-287da24a2adf","Type":"ContainerStarted","Data":"2def4dceb4ba620f3875201d8253e69fd705949b2567eee3de227d80401cf93b"} Mar 16 16:47:11 crc kubenswrapper[5120]: I0316 16:47:11.753500 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-internal-api-0" podStartSLOduration=4.75347873 podStartE2EDuration="4.75347873s" podCreationTimestamp="2026-03-16 16:47:07 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:47:11.747277481 +0000 UTC m=+4533.901209138" watchObservedRunningTime="2026-03-16 16:47:11.75347873 +0000 UTC m=+4533.907410387" Mar 16 16:47:11 crc kubenswrapper[5120]: I0316 16:47:11.794950 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.429577612 podStartE2EDuration="7.794931437s" podCreationTimestamp="2026-03-16 16:47:04 +0000 UTC" firstStartedPulling="2026-03-16 16:47:05.500330484 +0000 UTC m=+4527.654262141" lastFinishedPulling="2026-03-16 16:47:10.865684309 +0000 UTC m=+4533.019615966" observedRunningTime="2026-03-16 16:47:11.766688079 +0000 UTC m=+4533.920619736" watchObservedRunningTime="2026-03-16 16:47:11.794931437 +0000 UTC m=+4533.948863094" Mar 16 16:47:11 crc kubenswrapper[5120]: I0316 16:47:11.966719 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-cc9l2"] Mar 16 16:47:11 crc kubenswrapper[5120]: W0316 16:47:11.971613 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb0efd462_99b7_4e0f_a098_4add05cf74a2.slice/crio-f52fe0038c866c287704c312355ce2d9dc9fe97b89614aa16067f07e7a453895 WatchSource:0}: Error finding container f52fe0038c866c287704c312355ce2d9dc9fe97b89614aa16067f07e7a453895: Status 404 returned error can't find the container with id f52fe0038c866c287704c312355ce2d9dc9fe97b89614aa16067f07e7a453895 Mar 16 16:47:12 crc kubenswrapper[5120]: I0316 16:47:12.745127 5120 generic.go:358] "Generic (PLEG): container finished" podID="47657b56-a651-4772-a9fd-9571c816bdf1" containerID="e14f05f19054d22c803d42682f90a14db0f09b272ad6d1fbabd0c0eea7020ef2" exitCode=0 Mar 16 16:47:12 crc kubenswrapper[5120]: I0316 16:47:12.745452 5120 generic.go:358] "Generic (PLEG): container finished" podID="47657b56-a651-4772-a9fd-9571c816bdf1" containerID="836fb1fb28d25a0a26164c678fe01fcc6b7b244baa86af1dab59f1eedf5c2723" exitCode=2 Mar 16 16:47:12 crc kubenswrapper[5120]: I0316 16:47:12.745460 5120 generic.go:358] "Generic (PLEG): container finished" podID="47657b56-a651-4772-a9fd-9571c816bdf1" containerID="f0380f0700356672f20213c972cf3bf7933a573b2baedf5e35c34185fb4bc457" exitCode=0 Mar 16 16:47:12 crc kubenswrapper[5120]: I0316 16:47:12.745221 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"47657b56-a651-4772-a9fd-9571c816bdf1","Type":"ContainerDied","Data":"e14f05f19054d22c803d42682f90a14db0f09b272ad6d1fbabd0c0eea7020ef2"} Mar 16 16:47:12 crc kubenswrapper[5120]: I0316 16:47:12.745525 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"47657b56-a651-4772-a9fd-9571c816bdf1","Type":"ContainerDied","Data":"836fb1fb28d25a0a26164c678fe01fcc6b7b244baa86af1dab59f1eedf5c2723"} Mar 16 16:47:12 crc kubenswrapper[5120]: I0316 16:47:12.745546 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"47657b56-a651-4772-a9fd-9571c816bdf1","Type":"ContainerDied","Data":"f0380f0700356672f20213c972cf3bf7933a573b2baedf5e35c34185fb4bc457"} Mar 16 16:47:12 crc kubenswrapper[5120]: I0316 16:47:12.749211 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-cc9l2" event={"ID":"b0efd462-99b7-4e0f-a098-4add05cf74a2","Type":"ContainerStarted","Data":"99f4e0fddd3bd83c3b372377993a97c3a112e1e6892657f44e0402569984fed6"} Mar 16 16:47:12 crc kubenswrapper[5120]: I0316 16:47:12.749304 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-cc9l2" event={"ID":"b0efd462-99b7-4e0f-a098-4add05cf74a2","Type":"ContainerStarted","Data":"f52fe0038c866c287704c312355ce2d9dc9fe97b89614aa16067f07e7a453895"} Mar 16 16:47:12 crc kubenswrapper[5120]: I0316 16:47:12.767208 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-cc9l2" podStartSLOduration=1.767192456 podStartE2EDuration="1.767192456s" podCreationTimestamp="2026-03-16 16:47:11 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:47:12.766749533 +0000 UTC m=+4534.920681190" watchObservedRunningTime="2026-03-16 16:47:12.767192456 +0000 UTC m=+4534.921124113" Mar 16 16:47:14 crc kubenswrapper[5120]: I0316 16:47:14.272469 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-54bf5db978-kpsbr" Mar 16 16:47:14 crc kubenswrapper[5120]: I0316 16:47:14.402788 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/174be312-c22c-4576-a6e8-55fd5408af8d-logs\") pod \"174be312-c22c-4576-a6e8-55fd5408af8d\" (UID: \"174be312-c22c-4576-a6e8-55fd5408af8d\") " Mar 16 16:47:14 crc kubenswrapper[5120]: I0316 16:47:14.403024 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/174be312-c22c-4576-a6e8-55fd5408af8d-config-data\") pod \"174be312-c22c-4576-a6e8-55fd5408af8d\" (UID: \"174be312-c22c-4576-a6e8-55fd5408af8d\") " Mar 16 16:47:14 crc kubenswrapper[5120]: I0316 16:47:14.403235 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rc4s6\" (UniqueName: \"kubernetes.io/projected/174be312-c22c-4576-a6e8-55fd5408af8d-kube-api-access-rc4s6\") pod \"174be312-c22c-4576-a6e8-55fd5408af8d\" (UID: \"174be312-c22c-4576-a6e8-55fd5408af8d\") " Mar 16 16:47:14 crc kubenswrapper[5120]: I0316 16:47:14.403258 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/174be312-c22c-4576-a6e8-55fd5408af8d-scripts\") pod \"174be312-c22c-4576-a6e8-55fd5408af8d\" (UID: \"174be312-c22c-4576-a6e8-55fd5408af8d\") " Mar 16 16:47:14 crc kubenswrapper[5120]: I0316 16:47:14.404073 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/174be312-c22c-4576-a6e8-55fd5408af8d-logs" (OuterVolumeSpecName: "logs") pod "174be312-c22c-4576-a6e8-55fd5408af8d" (UID: "174be312-c22c-4576-a6e8-55fd5408af8d"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:47:14 crc kubenswrapper[5120]: I0316 16:47:14.404147 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/174be312-c22c-4576-a6e8-55fd5408af8d-combined-ca-bundle\") pod \"174be312-c22c-4576-a6e8-55fd5408af8d\" (UID: \"174be312-c22c-4576-a6e8-55fd5408af8d\") " Mar 16 16:47:14 crc kubenswrapper[5120]: I0316 16:47:14.404615 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/174be312-c22c-4576-a6e8-55fd5408af8d-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:47:14 crc kubenswrapper[5120]: I0316 16:47:14.410485 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/174be312-c22c-4576-a6e8-55fd5408af8d-kube-api-access-rc4s6" (OuterVolumeSpecName: "kube-api-access-rc4s6") pod "174be312-c22c-4576-a6e8-55fd5408af8d" (UID: "174be312-c22c-4576-a6e8-55fd5408af8d"). InnerVolumeSpecName "kube-api-access-rc4s6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:47:14 crc kubenswrapper[5120]: I0316 16:47:14.410850 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/174be312-c22c-4576-a6e8-55fd5408af8d-scripts" (OuterVolumeSpecName: "scripts") pod "174be312-c22c-4576-a6e8-55fd5408af8d" (UID: "174be312-c22c-4576-a6e8-55fd5408af8d"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:47:14 crc kubenswrapper[5120]: I0316 16:47:14.468842 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/174be312-c22c-4576-a6e8-55fd5408af8d-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "174be312-c22c-4576-a6e8-55fd5408af8d" (UID: "174be312-c22c-4576-a6e8-55fd5408af8d"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:47:14 crc kubenswrapper[5120]: I0316 16:47:14.468894 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/174be312-c22c-4576-a6e8-55fd5408af8d-config-data" (OuterVolumeSpecName: "config-data") pod "174be312-c22c-4576-a6e8-55fd5408af8d" (UID: "174be312-c22c-4576-a6e8-55fd5408af8d"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:47:14 crc kubenswrapper[5120]: I0316 16:47:14.506924 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/174be312-c22c-4576-a6e8-55fd5408af8d-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:47:14 crc kubenswrapper[5120]: I0316 16:47:14.506963 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rc4s6\" (UniqueName: \"kubernetes.io/projected/174be312-c22c-4576-a6e8-55fd5408af8d-kube-api-access-rc4s6\") on node \"crc\" DevicePath \"\"" Mar 16 16:47:14 crc kubenswrapper[5120]: I0316 16:47:14.506978 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/174be312-c22c-4576-a6e8-55fd5408af8d-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:47:14 crc kubenswrapper[5120]: I0316 16:47:14.506990 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/174be312-c22c-4576-a6e8-55fd5408af8d-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:47:14 crc kubenswrapper[5120]: I0316 16:47:14.777664 5120 generic.go:358] "Generic (PLEG): container finished" podID="174be312-c22c-4576-a6e8-55fd5408af8d" containerID="09bd7a3d7571c33d89e8f2cd860d4af58e479dd2ab1fb30baa46d267c81c1666" exitCode=0 Mar 16 16:47:14 crc kubenswrapper[5120]: I0316 16:47:14.777795 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-54bf5db978-kpsbr" Mar 16 16:47:14 crc kubenswrapper[5120]: I0316 16:47:14.777805 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-54bf5db978-kpsbr" event={"ID":"174be312-c22c-4576-a6e8-55fd5408af8d","Type":"ContainerDied","Data":"09bd7a3d7571c33d89e8f2cd860d4af58e479dd2ab1fb30baa46d267c81c1666"} Mar 16 16:47:14 crc kubenswrapper[5120]: I0316 16:47:14.777866 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-54bf5db978-kpsbr" event={"ID":"174be312-c22c-4576-a6e8-55fd5408af8d","Type":"ContainerDied","Data":"d4564b844cc6f569a50039ac3cdc750e67720fa77fb37d090da2f6037d6a98af"} Mar 16 16:47:14 crc kubenswrapper[5120]: I0316 16:47:14.777890 5120 scope.go:117] "RemoveContainer" containerID="09bd7a3d7571c33d89e8f2cd860d4af58e479dd2ab1fb30baa46d267c81c1666" Mar 16 16:47:14 crc kubenswrapper[5120]: I0316 16:47:14.807120 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-54bf5db978-kpsbr"] Mar 16 16:47:14 crc kubenswrapper[5120]: I0316 16:47:14.815415 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-54bf5db978-kpsbr"] Mar 16 16:47:14 crc kubenswrapper[5120]: I0316 16:47:14.818077 5120 scope.go:117] "RemoveContainer" containerID="d6f1a9666b19578cc92b6bea3ba758546bac86273c35edc2b038d02550c541ed" Mar 16 16:47:14 crc kubenswrapper[5120]: I0316 16:47:14.855551 5120 scope.go:117] "RemoveContainer" containerID="09bd7a3d7571c33d89e8f2cd860d4af58e479dd2ab1fb30baa46d267c81c1666" Mar 16 16:47:14 crc kubenswrapper[5120]: E0316 16:47:14.856032 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"09bd7a3d7571c33d89e8f2cd860d4af58e479dd2ab1fb30baa46d267c81c1666\": container with ID starting with 09bd7a3d7571c33d89e8f2cd860d4af58e479dd2ab1fb30baa46d267c81c1666 not found: ID does not exist" containerID="09bd7a3d7571c33d89e8f2cd860d4af58e479dd2ab1fb30baa46d267c81c1666" Mar 16 16:47:14 crc kubenswrapper[5120]: I0316 16:47:14.856095 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09bd7a3d7571c33d89e8f2cd860d4af58e479dd2ab1fb30baa46d267c81c1666"} err="failed to get container status \"09bd7a3d7571c33d89e8f2cd860d4af58e479dd2ab1fb30baa46d267c81c1666\": rpc error: code = NotFound desc = could not find container \"09bd7a3d7571c33d89e8f2cd860d4af58e479dd2ab1fb30baa46d267c81c1666\": container with ID starting with 09bd7a3d7571c33d89e8f2cd860d4af58e479dd2ab1fb30baa46d267c81c1666 not found: ID does not exist" Mar 16 16:47:14 crc kubenswrapper[5120]: I0316 16:47:14.856126 5120 scope.go:117] "RemoveContainer" containerID="d6f1a9666b19578cc92b6bea3ba758546bac86273c35edc2b038d02550c541ed" Mar 16 16:47:14 crc kubenswrapper[5120]: E0316 16:47:14.856562 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d6f1a9666b19578cc92b6bea3ba758546bac86273c35edc2b038d02550c541ed\": container with ID starting with d6f1a9666b19578cc92b6bea3ba758546bac86273c35edc2b038d02550c541ed not found: ID does not exist" containerID="d6f1a9666b19578cc92b6bea3ba758546bac86273c35edc2b038d02550c541ed" Mar 16 16:47:14 crc kubenswrapper[5120]: I0316 16:47:14.856617 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6f1a9666b19578cc92b6bea3ba758546bac86273c35edc2b038d02550c541ed"} err="failed to get container status \"d6f1a9666b19578cc92b6bea3ba758546bac86273c35edc2b038d02550c541ed\": rpc error: code = NotFound desc = could not find container \"d6f1a9666b19578cc92b6bea3ba758546bac86273c35edc2b038d02550c541ed\": container with ID starting with d6f1a9666b19578cc92b6bea3ba758546bac86273c35edc2b038d02550c541ed not found: ID does not exist" Mar 16 16:47:15 crc kubenswrapper[5120]: I0316 16:47:15.390527 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:47:15 crc kubenswrapper[5120]: I0316 16:47:15.529323 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/47657b56-a651-4772-a9fd-9571c816bdf1-log-httpd\") pod \"47657b56-a651-4772-a9fd-9571c816bdf1\" (UID: \"47657b56-a651-4772-a9fd-9571c816bdf1\") " Mar 16 16:47:15 crc kubenswrapper[5120]: I0316 16:47:15.529854 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qgqhh\" (UniqueName: \"kubernetes.io/projected/47657b56-a651-4772-a9fd-9571c816bdf1-kube-api-access-qgqhh\") pod \"47657b56-a651-4772-a9fd-9571c816bdf1\" (UID: \"47657b56-a651-4772-a9fd-9571c816bdf1\") " Mar 16 16:47:15 crc kubenswrapper[5120]: I0316 16:47:15.529895 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/47657b56-a651-4772-a9fd-9571c816bdf1-run-httpd\") pod \"47657b56-a651-4772-a9fd-9571c816bdf1\" (UID: \"47657b56-a651-4772-a9fd-9571c816bdf1\") " Mar 16 16:47:15 crc kubenswrapper[5120]: I0316 16:47:15.529920 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/47657b56-a651-4772-a9fd-9571c816bdf1-scripts\") pod \"47657b56-a651-4772-a9fd-9571c816bdf1\" (UID: \"47657b56-a651-4772-a9fd-9571c816bdf1\") " Mar 16 16:47:15 crc kubenswrapper[5120]: I0316 16:47:15.530067 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/47657b56-a651-4772-a9fd-9571c816bdf1-combined-ca-bundle\") pod \"47657b56-a651-4772-a9fd-9571c816bdf1\" (UID: \"47657b56-a651-4772-a9fd-9571c816bdf1\") " Mar 16 16:47:15 crc kubenswrapper[5120]: I0316 16:47:15.530141 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/47657b56-a651-4772-a9fd-9571c816bdf1-sg-core-conf-yaml\") pod \"47657b56-a651-4772-a9fd-9571c816bdf1\" (UID: \"47657b56-a651-4772-a9fd-9571c816bdf1\") " Mar 16 16:47:15 crc kubenswrapper[5120]: I0316 16:47:15.530186 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/47657b56-a651-4772-a9fd-9571c816bdf1-config-data\") pod \"47657b56-a651-4772-a9fd-9571c816bdf1\" (UID: \"47657b56-a651-4772-a9fd-9571c816bdf1\") " Mar 16 16:47:15 crc kubenswrapper[5120]: I0316 16:47:15.530390 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47657b56-a651-4772-a9fd-9571c816bdf1-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "47657b56-a651-4772-a9fd-9571c816bdf1" (UID: "47657b56-a651-4772-a9fd-9571c816bdf1"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:47:15 crc kubenswrapper[5120]: I0316 16:47:15.530553 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47657b56-a651-4772-a9fd-9571c816bdf1-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "47657b56-a651-4772-a9fd-9571c816bdf1" (UID: "47657b56-a651-4772-a9fd-9571c816bdf1"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:47:15 crc kubenswrapper[5120]: I0316 16:47:15.531066 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/47657b56-a651-4772-a9fd-9571c816bdf1-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:47:15 crc kubenswrapper[5120]: I0316 16:47:15.531095 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/47657b56-a651-4772-a9fd-9571c816bdf1-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:47:15 crc kubenswrapper[5120]: I0316 16:47:15.535365 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47657b56-a651-4772-a9fd-9571c816bdf1-kube-api-access-qgqhh" (OuterVolumeSpecName: "kube-api-access-qgqhh") pod "47657b56-a651-4772-a9fd-9571c816bdf1" (UID: "47657b56-a651-4772-a9fd-9571c816bdf1"). InnerVolumeSpecName "kube-api-access-qgqhh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:47:15 crc kubenswrapper[5120]: I0316 16:47:15.538634 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/47657b56-a651-4772-a9fd-9571c816bdf1-scripts" (OuterVolumeSpecName: "scripts") pod "47657b56-a651-4772-a9fd-9571c816bdf1" (UID: "47657b56-a651-4772-a9fd-9571c816bdf1"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:47:15 crc kubenswrapper[5120]: I0316 16:47:15.557735 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/47657b56-a651-4772-a9fd-9571c816bdf1-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "47657b56-a651-4772-a9fd-9571c816bdf1" (UID: "47657b56-a651-4772-a9fd-9571c816bdf1"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:47:15 crc kubenswrapper[5120]: I0316 16:47:15.605916 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/47657b56-a651-4772-a9fd-9571c816bdf1-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "47657b56-a651-4772-a9fd-9571c816bdf1" (UID: "47657b56-a651-4772-a9fd-9571c816bdf1"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:47:15 crc kubenswrapper[5120]: I0316 16:47:15.633575 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/47657b56-a651-4772-a9fd-9571c816bdf1-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:47:15 crc kubenswrapper[5120]: I0316 16:47:15.633628 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/47657b56-a651-4772-a9fd-9571c816bdf1-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 16:47:15 crc kubenswrapper[5120]: I0316 16:47:15.633640 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qgqhh\" (UniqueName: \"kubernetes.io/projected/47657b56-a651-4772-a9fd-9571c816bdf1-kube-api-access-qgqhh\") on node \"crc\" DevicePath \"\"" Mar 16 16:47:15 crc kubenswrapper[5120]: I0316 16:47:15.633650 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/47657b56-a651-4772-a9fd-9571c816bdf1-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:47:15 crc kubenswrapper[5120]: I0316 16:47:15.647713 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/47657b56-a651-4772-a9fd-9571c816bdf1-config-data" (OuterVolumeSpecName: "config-data") pod "47657b56-a651-4772-a9fd-9571c816bdf1" (UID: "47657b56-a651-4772-a9fd-9571c816bdf1"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:47:15 crc kubenswrapper[5120]: I0316 16:47:15.735155 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/47657b56-a651-4772-a9fd-9571c816bdf1-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:47:15 crc kubenswrapper[5120]: I0316 16:47:15.791008 5120 generic.go:358] "Generic (PLEG): container finished" podID="47657b56-a651-4772-a9fd-9571c816bdf1" containerID="a540e1d24ade08845cd83fe49d87346421ce32a5e31629ec91d2f7f1c23c430d" exitCode=0 Mar 16 16:47:15 crc kubenswrapper[5120]: I0316 16:47:15.791123 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"47657b56-a651-4772-a9fd-9571c816bdf1","Type":"ContainerDied","Data":"a540e1d24ade08845cd83fe49d87346421ce32a5e31629ec91d2f7f1c23c430d"} Mar 16 16:47:15 crc kubenswrapper[5120]: I0316 16:47:15.791180 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"47657b56-a651-4772-a9fd-9571c816bdf1","Type":"ContainerDied","Data":"066073bb8f5db56d7ce448e25c215f11e1e9e88437bbb92311d8612cae5adac4"} Mar 16 16:47:15 crc kubenswrapper[5120]: I0316 16:47:15.791204 5120 scope.go:117] "RemoveContainer" containerID="e14f05f19054d22c803d42682f90a14db0f09b272ad6d1fbabd0c0eea7020ef2" Mar 16 16:47:15 crc kubenswrapper[5120]: I0316 16:47:15.791140 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:47:15 crc kubenswrapper[5120]: I0316 16:47:15.811231 5120 scope.go:117] "RemoveContainer" containerID="836fb1fb28d25a0a26164c678fe01fcc6b7b244baa86af1dab59f1eedf5c2723" Mar 16 16:47:15 crc kubenswrapper[5120]: I0316 16:47:15.888037 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:47:15 crc kubenswrapper[5120]: I0316 16:47:15.888119 5120 scope.go:117] "RemoveContainer" containerID="f0380f0700356672f20213c972cf3bf7933a573b2baedf5e35c34185fb4bc457" Mar 16 16:47:15 crc kubenswrapper[5120]: I0316 16:47:15.898467 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:47:15 crc kubenswrapper[5120]: I0316 16:47:15.911661 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:47:15 crc kubenswrapper[5120]: I0316 16:47:15.912739 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47657b56-a651-4772-a9fd-9571c816bdf1" containerName="ceilometer-notification-agent" Mar 16 16:47:15 crc kubenswrapper[5120]: I0316 16:47:15.912753 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="47657b56-a651-4772-a9fd-9571c816bdf1" containerName="ceilometer-notification-agent" Mar 16 16:47:15 crc kubenswrapper[5120]: I0316 16:47:15.912838 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="174be312-c22c-4576-a6e8-55fd5408af8d" containerName="placement-log" Mar 16 16:47:15 crc kubenswrapper[5120]: I0316 16:47:15.912844 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="174be312-c22c-4576-a6e8-55fd5408af8d" containerName="placement-log" Mar 16 16:47:15 crc kubenswrapper[5120]: I0316 16:47:15.912858 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47657b56-a651-4772-a9fd-9571c816bdf1" containerName="proxy-httpd" Mar 16 16:47:15 crc kubenswrapper[5120]: I0316 16:47:15.912865 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="47657b56-a651-4772-a9fd-9571c816bdf1" containerName="proxy-httpd" Mar 16 16:47:15 crc kubenswrapper[5120]: I0316 16:47:15.912890 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47657b56-a651-4772-a9fd-9571c816bdf1" containerName="ceilometer-central-agent" Mar 16 16:47:15 crc kubenswrapper[5120]: I0316 16:47:15.912895 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="47657b56-a651-4772-a9fd-9571c816bdf1" containerName="ceilometer-central-agent" Mar 16 16:47:15 crc kubenswrapper[5120]: I0316 16:47:15.912909 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="174be312-c22c-4576-a6e8-55fd5408af8d" containerName="placement-api" Mar 16 16:47:15 crc kubenswrapper[5120]: I0316 16:47:15.912915 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="174be312-c22c-4576-a6e8-55fd5408af8d" containerName="placement-api" Mar 16 16:47:15 crc kubenswrapper[5120]: I0316 16:47:15.912944 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47657b56-a651-4772-a9fd-9571c816bdf1" containerName="sg-core" Mar 16 16:47:15 crc kubenswrapper[5120]: I0316 16:47:15.912949 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="47657b56-a651-4772-a9fd-9571c816bdf1" containerName="sg-core" Mar 16 16:47:15 crc kubenswrapper[5120]: I0316 16:47:15.913111 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="174be312-c22c-4576-a6e8-55fd5408af8d" containerName="placement-log" Mar 16 16:47:15 crc kubenswrapper[5120]: I0316 16:47:15.913119 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="47657b56-a651-4772-a9fd-9571c816bdf1" containerName="proxy-httpd" Mar 16 16:47:15 crc kubenswrapper[5120]: I0316 16:47:15.913132 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="47657b56-a651-4772-a9fd-9571c816bdf1" containerName="ceilometer-notification-agent" Mar 16 16:47:15 crc kubenswrapper[5120]: I0316 16:47:15.913142 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="47657b56-a651-4772-a9fd-9571c816bdf1" containerName="sg-core" Mar 16 16:47:15 crc kubenswrapper[5120]: I0316 16:47:15.913151 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="47657b56-a651-4772-a9fd-9571c816bdf1" containerName="ceilometer-central-agent" Mar 16 16:47:15 crc kubenswrapper[5120]: I0316 16:47:15.913164 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="174be312-c22c-4576-a6e8-55fd5408af8d" containerName="placement-api" Mar 16 16:47:15 crc kubenswrapper[5120]: I0316 16:47:15.927638 5120 scope.go:117] "RemoveContainer" containerID="a540e1d24ade08845cd83fe49d87346421ce32a5e31629ec91d2f7f1c23c430d" Mar 16 16:47:15 crc kubenswrapper[5120]: I0316 16:47:15.943726 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:47:15 crc kubenswrapper[5120]: I0316 16:47:15.943951 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:47:15 crc kubenswrapper[5120]: I0316 16:47:15.947997 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 16:47:15 crc kubenswrapper[5120]: I0316 16:47:15.948573 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 16:47:15 crc kubenswrapper[5120]: I0316 16:47:15.954151 5120 scope.go:117] "RemoveContainer" containerID="e14f05f19054d22c803d42682f90a14db0f09b272ad6d1fbabd0c0eea7020ef2" Mar 16 16:47:15 crc kubenswrapper[5120]: E0316 16:47:15.955153 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e14f05f19054d22c803d42682f90a14db0f09b272ad6d1fbabd0c0eea7020ef2\": container with ID starting with e14f05f19054d22c803d42682f90a14db0f09b272ad6d1fbabd0c0eea7020ef2 not found: ID does not exist" containerID="e14f05f19054d22c803d42682f90a14db0f09b272ad6d1fbabd0c0eea7020ef2" Mar 16 16:47:15 crc kubenswrapper[5120]: I0316 16:47:15.955301 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e14f05f19054d22c803d42682f90a14db0f09b272ad6d1fbabd0c0eea7020ef2"} err="failed to get container status \"e14f05f19054d22c803d42682f90a14db0f09b272ad6d1fbabd0c0eea7020ef2\": rpc error: code = NotFound desc = could not find container \"e14f05f19054d22c803d42682f90a14db0f09b272ad6d1fbabd0c0eea7020ef2\": container with ID starting with e14f05f19054d22c803d42682f90a14db0f09b272ad6d1fbabd0c0eea7020ef2 not found: ID does not exist" Mar 16 16:47:15 crc kubenswrapper[5120]: I0316 16:47:15.955420 5120 scope.go:117] "RemoveContainer" containerID="836fb1fb28d25a0a26164c678fe01fcc6b7b244baa86af1dab59f1eedf5c2723" Mar 16 16:47:15 crc kubenswrapper[5120]: E0316 16:47:15.955781 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"836fb1fb28d25a0a26164c678fe01fcc6b7b244baa86af1dab59f1eedf5c2723\": container with ID starting with 836fb1fb28d25a0a26164c678fe01fcc6b7b244baa86af1dab59f1eedf5c2723 not found: ID does not exist" containerID="836fb1fb28d25a0a26164c678fe01fcc6b7b244baa86af1dab59f1eedf5c2723" Mar 16 16:47:15 crc kubenswrapper[5120]: I0316 16:47:15.955891 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"836fb1fb28d25a0a26164c678fe01fcc6b7b244baa86af1dab59f1eedf5c2723"} err="failed to get container status \"836fb1fb28d25a0a26164c678fe01fcc6b7b244baa86af1dab59f1eedf5c2723\": rpc error: code = NotFound desc = could not find container \"836fb1fb28d25a0a26164c678fe01fcc6b7b244baa86af1dab59f1eedf5c2723\": container with ID starting with 836fb1fb28d25a0a26164c678fe01fcc6b7b244baa86af1dab59f1eedf5c2723 not found: ID does not exist" Mar 16 16:47:15 crc kubenswrapper[5120]: I0316 16:47:15.955974 5120 scope.go:117] "RemoveContainer" containerID="f0380f0700356672f20213c972cf3bf7933a573b2baedf5e35c34185fb4bc457" Mar 16 16:47:15 crc kubenswrapper[5120]: E0316 16:47:15.956319 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f0380f0700356672f20213c972cf3bf7933a573b2baedf5e35c34185fb4bc457\": container with ID starting with f0380f0700356672f20213c972cf3bf7933a573b2baedf5e35c34185fb4bc457 not found: ID does not exist" containerID="f0380f0700356672f20213c972cf3bf7933a573b2baedf5e35c34185fb4bc457" Mar 16 16:47:15 crc kubenswrapper[5120]: I0316 16:47:15.956364 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0380f0700356672f20213c972cf3bf7933a573b2baedf5e35c34185fb4bc457"} err="failed to get container status \"f0380f0700356672f20213c972cf3bf7933a573b2baedf5e35c34185fb4bc457\": rpc error: code = NotFound desc = could not find container \"f0380f0700356672f20213c972cf3bf7933a573b2baedf5e35c34185fb4bc457\": container with ID starting with f0380f0700356672f20213c972cf3bf7933a573b2baedf5e35c34185fb4bc457 not found: ID does not exist" Mar 16 16:47:15 crc kubenswrapper[5120]: I0316 16:47:15.956391 5120 scope.go:117] "RemoveContainer" containerID="a540e1d24ade08845cd83fe49d87346421ce32a5e31629ec91d2f7f1c23c430d" Mar 16 16:47:15 crc kubenswrapper[5120]: E0316 16:47:15.956612 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a540e1d24ade08845cd83fe49d87346421ce32a5e31629ec91d2f7f1c23c430d\": container with ID starting with a540e1d24ade08845cd83fe49d87346421ce32a5e31629ec91d2f7f1c23c430d not found: ID does not exist" containerID="a540e1d24ade08845cd83fe49d87346421ce32a5e31629ec91d2f7f1c23c430d" Mar 16 16:47:15 crc kubenswrapper[5120]: I0316 16:47:15.956728 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a540e1d24ade08845cd83fe49d87346421ce32a5e31629ec91d2f7f1c23c430d"} err="failed to get container status \"a540e1d24ade08845cd83fe49d87346421ce32a5e31629ec91d2f7f1c23c430d\": rpc error: code = NotFound desc = could not find container \"a540e1d24ade08845cd83fe49d87346421ce32a5e31629ec91d2f7f1c23c430d\": container with ID starting with a540e1d24ade08845cd83fe49d87346421ce32a5e31629ec91d2f7f1c23c430d not found: ID does not exist" Mar 16 16:47:16 crc kubenswrapper[5120]: I0316 16:47:16.144019 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/bd6a69b9-4429-4065-84ad-ab70fca7b288-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"bd6a69b9-4429-4065-84ad-ab70fca7b288\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:47:16 crc kubenswrapper[5120]: I0316 16:47:16.144421 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/bd6a69b9-4429-4065-84ad-ab70fca7b288-scripts\") pod \"ceilometer-0\" (UID: \"bd6a69b9-4429-4065-84ad-ab70fca7b288\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:47:16 crc kubenswrapper[5120]: I0316 16:47:16.144575 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bd6a69b9-4429-4065-84ad-ab70fca7b288-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"bd6a69b9-4429-4065-84ad-ab70fca7b288\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:47:16 crc kubenswrapper[5120]: I0316 16:47:16.144702 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/bd6a69b9-4429-4065-84ad-ab70fca7b288-run-httpd\") pod \"ceilometer-0\" (UID: \"bd6a69b9-4429-4065-84ad-ab70fca7b288\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:47:16 crc kubenswrapper[5120]: I0316 16:47:16.144877 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/bd6a69b9-4429-4065-84ad-ab70fca7b288-log-httpd\") pod \"ceilometer-0\" (UID: \"bd6a69b9-4429-4065-84ad-ab70fca7b288\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:47:16 crc kubenswrapper[5120]: I0316 16:47:16.145037 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bd6a69b9-4429-4065-84ad-ab70fca7b288-config-data\") pod \"ceilometer-0\" (UID: \"bd6a69b9-4429-4065-84ad-ab70fca7b288\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:47:16 crc kubenswrapper[5120]: I0316 16:47:16.145321 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcsxf\" (UniqueName: \"kubernetes.io/projected/bd6a69b9-4429-4065-84ad-ab70fca7b288-kube-api-access-xcsxf\") pod \"ceilometer-0\" (UID: \"bd6a69b9-4429-4065-84ad-ab70fca7b288\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:47:16 crc kubenswrapper[5120]: I0316 16:47:16.246825 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bd6a69b9-4429-4065-84ad-ab70fca7b288-config-data\") pod \"ceilometer-0\" (UID: \"bd6a69b9-4429-4065-84ad-ab70fca7b288\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:47:16 crc kubenswrapper[5120]: I0316 16:47:16.247998 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xcsxf\" (UniqueName: \"kubernetes.io/projected/bd6a69b9-4429-4065-84ad-ab70fca7b288-kube-api-access-xcsxf\") pod \"ceilometer-0\" (UID: \"bd6a69b9-4429-4065-84ad-ab70fca7b288\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:47:16 crc kubenswrapper[5120]: I0316 16:47:16.248119 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/bd6a69b9-4429-4065-84ad-ab70fca7b288-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"bd6a69b9-4429-4065-84ad-ab70fca7b288\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:47:16 crc kubenswrapper[5120]: I0316 16:47:16.248276 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/bd6a69b9-4429-4065-84ad-ab70fca7b288-scripts\") pod \"ceilometer-0\" (UID: \"bd6a69b9-4429-4065-84ad-ab70fca7b288\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:47:16 crc kubenswrapper[5120]: I0316 16:47:16.248406 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bd6a69b9-4429-4065-84ad-ab70fca7b288-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"bd6a69b9-4429-4065-84ad-ab70fca7b288\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:47:16 crc kubenswrapper[5120]: I0316 16:47:16.248622 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/bd6a69b9-4429-4065-84ad-ab70fca7b288-run-httpd\") pod \"ceilometer-0\" (UID: \"bd6a69b9-4429-4065-84ad-ab70fca7b288\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:47:16 crc kubenswrapper[5120]: I0316 16:47:16.248717 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/bd6a69b9-4429-4065-84ad-ab70fca7b288-log-httpd\") pod \"ceilometer-0\" (UID: \"bd6a69b9-4429-4065-84ad-ab70fca7b288\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:47:16 crc kubenswrapper[5120]: I0316 16:47:16.249159 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/bd6a69b9-4429-4065-84ad-ab70fca7b288-run-httpd\") pod \"ceilometer-0\" (UID: \"bd6a69b9-4429-4065-84ad-ab70fca7b288\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:47:16 crc kubenswrapper[5120]: I0316 16:47:16.249235 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/bd6a69b9-4429-4065-84ad-ab70fca7b288-log-httpd\") pod \"ceilometer-0\" (UID: \"bd6a69b9-4429-4065-84ad-ab70fca7b288\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:47:16 crc kubenswrapper[5120]: I0316 16:47:16.251901 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/bd6a69b9-4429-4065-84ad-ab70fca7b288-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"bd6a69b9-4429-4065-84ad-ab70fca7b288\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:47:16 crc kubenswrapper[5120]: I0316 16:47:16.252037 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bd6a69b9-4429-4065-84ad-ab70fca7b288-config-data\") pod \"ceilometer-0\" (UID: \"bd6a69b9-4429-4065-84ad-ab70fca7b288\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:47:16 crc kubenswrapper[5120]: I0316 16:47:16.253302 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bd6a69b9-4429-4065-84ad-ab70fca7b288-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"bd6a69b9-4429-4065-84ad-ab70fca7b288\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:47:16 crc kubenswrapper[5120]: I0316 16:47:16.253916 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/bd6a69b9-4429-4065-84ad-ab70fca7b288-scripts\") pod \"ceilometer-0\" (UID: \"bd6a69b9-4429-4065-84ad-ab70fca7b288\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:47:16 crc kubenswrapper[5120]: I0316 16:47:16.269206 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcsxf\" (UniqueName: \"kubernetes.io/projected/bd6a69b9-4429-4065-84ad-ab70fca7b288-kube-api-access-xcsxf\") pod \"ceilometer-0\" (UID: \"bd6a69b9-4429-4065-84ad-ab70fca7b288\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:47:16 crc kubenswrapper[5120]: I0316 16:47:16.271968 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:47:16 crc kubenswrapper[5120]: I0316 16:47:16.680329 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="174be312-c22c-4576-a6e8-55fd5408af8d" path="/var/lib/kubelet/pods/174be312-c22c-4576-a6e8-55fd5408af8d/volumes" Mar 16 16:47:16 crc kubenswrapper[5120]: I0316 16:47:16.681627 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="47657b56-a651-4772-a9fd-9571c816bdf1" path="/var/lib/kubelet/pods/47657b56-a651-4772-a9fd-9571c816bdf1/volumes" Mar 16 16:47:16 crc kubenswrapper[5120]: I0316 16:47:16.743615 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:47:16 crc kubenswrapper[5120]: W0316 16:47:16.750889 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbd6a69b9_4429_4065_84ad_ab70fca7b288.slice/crio-318b9803a444bb42567b39c6bf1ac770beaa334b2a57380602ddea81ad1daf4e WatchSource:0}: Error finding container 318b9803a444bb42567b39c6bf1ac770beaa334b2a57380602ddea81ad1daf4e: Status 404 returned error can't find the container with id 318b9803a444bb42567b39c6bf1ac770beaa334b2a57380602ddea81ad1daf4e Mar 16 16:47:16 crc kubenswrapper[5120]: I0316 16:47:16.803609 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"bd6a69b9-4429-4065-84ad-ab70fca7b288","Type":"ContainerStarted","Data":"318b9803a444bb42567b39c6bf1ac770beaa334b2a57380602ddea81ad1daf4e"} Mar 16 16:47:17 crc kubenswrapper[5120]: I0316 16:47:17.664245 5120 scope.go:117] "RemoveContainer" containerID="35a7dd6e19084cee69ca16203bca6378ea0cdf6a685ca2093ab847e5904eb9e6" Mar 16 16:47:17 crc kubenswrapper[5120]: E0316 16:47:17.664623 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:47:17 crc kubenswrapper[5120]: I0316 16:47:17.828337 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"bd6a69b9-4429-4065-84ad-ab70fca7b288","Type":"ContainerStarted","Data":"9dacb617af356ea758a77af50c1b853f9c9aced20028d343a930fe914c22d3c1"} Mar 16 16:47:18 crc kubenswrapper[5120]: I0316 16:47:18.060302 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:47:18 crc kubenswrapper[5120]: I0316 16:47:18.060620 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:47:18 crc kubenswrapper[5120]: I0316 16:47:18.104437 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:47:18 crc kubenswrapper[5120]: I0316 16:47:18.107534 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:47:18 crc kubenswrapper[5120]: I0316 16:47:18.361675 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:47:18 crc kubenswrapper[5120]: I0316 16:47:18.361719 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:47:18 crc kubenswrapper[5120]: I0316 16:47:18.394077 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:47:18 crc kubenswrapper[5120]: I0316 16:47:18.398810 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:47:18 crc kubenswrapper[5120]: I0316 16:47:18.840900 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"bd6a69b9-4429-4065-84ad-ab70fca7b288","Type":"ContainerStarted","Data":"d3a83eea8f5002e68331850ded0f70a5c92b21ba855d9c91a9d33d04ba694d99"} Mar 16 16:47:18 crc kubenswrapper[5120]: I0316 16:47:18.842900 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:47:18 crc kubenswrapper[5120]: I0316 16:47:18.842932 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:47:18 crc kubenswrapper[5120]: I0316 16:47:18.842942 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:47:18 crc kubenswrapper[5120]: I0316 16:47:18.842951 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:47:19 crc kubenswrapper[5120]: I0316 16:47:19.857160 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"bd6a69b9-4429-4065-84ad-ab70fca7b288","Type":"ContainerStarted","Data":"70c9136286a78b1f98aa1551309317bc834e4448d0aea9aa09943c62de5c6784"} Mar 16 16:47:20 crc kubenswrapper[5120]: I0316 16:47:20.970428 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:47:20 crc kubenswrapper[5120]: I0316 16:47:20.971010 5120 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Mar 16 16:47:21 crc kubenswrapper[5120]: I0316 16:47:21.012527 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:47:21 crc kubenswrapper[5120]: I0316 16:47:21.012674 5120 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Mar 16 16:47:21 crc kubenswrapper[5120]: I0316 16:47:21.015921 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:47:21 crc kubenswrapper[5120]: I0316 16:47:21.093929 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:47:21 crc kubenswrapper[5120]: I0316 16:47:21.096053 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:47:21 crc kubenswrapper[5120]: I0316 16:47:21.876866 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"bd6a69b9-4429-4065-84ad-ab70fca7b288","Type":"ContainerStarted","Data":"f603bd8d265be450427adde59383a0abf796238f942b2cbf7477de86bcc55efb"} Mar 16 16:47:21 crc kubenswrapper[5120]: I0316 16:47:21.877749 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="bd6a69b9-4429-4065-84ad-ab70fca7b288" containerName="ceilometer-central-agent" containerID="cri-o://9dacb617af356ea758a77af50c1b853f9c9aced20028d343a930fe914c22d3c1" gracePeriod=30 Mar 16 16:47:21 crc kubenswrapper[5120]: I0316 16:47:21.877910 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="bd6a69b9-4429-4065-84ad-ab70fca7b288" containerName="proxy-httpd" containerID="cri-o://f603bd8d265be450427adde59383a0abf796238f942b2cbf7477de86bcc55efb" gracePeriod=30 Mar 16 16:47:21 crc kubenswrapper[5120]: I0316 16:47:21.878043 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="bd6a69b9-4429-4065-84ad-ab70fca7b288" containerName="sg-core" containerID="cri-o://70c9136286a78b1f98aa1551309317bc834e4448d0aea9aa09943c62de5c6784" gracePeriod=30 Mar 16 16:47:21 crc kubenswrapper[5120]: I0316 16:47:21.878167 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="bd6a69b9-4429-4065-84ad-ab70fca7b288" containerName="ceilometer-notification-agent" containerID="cri-o://d3a83eea8f5002e68331850ded0f70a5c92b21ba855d9c91a9d33d04ba694d99" gracePeriod=30 Mar 16 16:47:21 crc kubenswrapper[5120]: I0316 16:47:21.911549 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.395238814 podStartE2EDuration="6.911524572s" podCreationTimestamp="2026-03-16 16:47:15 +0000 UTC" firstStartedPulling="2026-03-16 16:47:16.752485799 +0000 UTC m=+4538.906417456" lastFinishedPulling="2026-03-16 16:47:21.268771557 +0000 UTC m=+4543.422703214" observedRunningTime="2026-03-16 16:47:21.900675336 +0000 UTC m=+4544.054607003" watchObservedRunningTime="2026-03-16 16:47:21.911524572 +0000 UTC m=+4544.065456229" Mar 16 16:47:22 crc kubenswrapper[5120]: I0316 16:47:22.889779 5120 generic.go:358] "Generic (PLEG): container finished" podID="bd6a69b9-4429-4065-84ad-ab70fca7b288" containerID="f603bd8d265be450427adde59383a0abf796238f942b2cbf7477de86bcc55efb" exitCode=0 Mar 16 16:47:22 crc kubenswrapper[5120]: I0316 16:47:22.890154 5120 generic.go:358] "Generic (PLEG): container finished" podID="bd6a69b9-4429-4065-84ad-ab70fca7b288" containerID="70c9136286a78b1f98aa1551309317bc834e4448d0aea9aa09943c62de5c6784" exitCode=2 Mar 16 16:47:22 crc kubenswrapper[5120]: I0316 16:47:22.890167 5120 generic.go:358] "Generic (PLEG): container finished" podID="bd6a69b9-4429-4065-84ad-ab70fca7b288" containerID="d3a83eea8f5002e68331850ded0f70a5c92b21ba855d9c91a9d33d04ba694d99" exitCode=0 Mar 16 16:47:22 crc kubenswrapper[5120]: I0316 16:47:22.889865 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"bd6a69b9-4429-4065-84ad-ab70fca7b288","Type":"ContainerDied","Data":"f603bd8d265be450427adde59383a0abf796238f942b2cbf7477de86bcc55efb"} Mar 16 16:47:22 crc kubenswrapper[5120]: I0316 16:47:22.890297 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"bd6a69b9-4429-4065-84ad-ab70fca7b288","Type":"ContainerDied","Data":"70c9136286a78b1f98aa1551309317bc834e4448d0aea9aa09943c62de5c6784"} Mar 16 16:47:22 crc kubenswrapper[5120]: I0316 16:47:22.890319 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"bd6a69b9-4429-4065-84ad-ab70fca7b288","Type":"ContainerDied","Data":"d3a83eea8f5002e68331850ded0f70a5c92b21ba855d9c91a9d33d04ba694d99"} Mar 16 16:47:24 crc kubenswrapper[5120]: I0316 16:47:24.911849 5120 generic.go:358] "Generic (PLEG): container finished" podID="b0efd462-99b7-4e0f-a098-4add05cf74a2" containerID="99f4e0fddd3bd83c3b372377993a97c3a112e1e6892657f44e0402569984fed6" exitCode=0 Mar 16 16:47:24 crc kubenswrapper[5120]: I0316 16:47:24.911957 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-cc9l2" event={"ID":"b0efd462-99b7-4e0f-a098-4add05cf74a2","Type":"ContainerDied","Data":"99f4e0fddd3bd83c3b372377993a97c3a112e1e6892657f44e0402569984fed6"} Mar 16 16:47:25 crc kubenswrapper[5120]: I0316 16:47:25.927256 5120 generic.go:358] "Generic (PLEG): container finished" podID="bd6a69b9-4429-4065-84ad-ab70fca7b288" containerID="9dacb617af356ea758a77af50c1b853f9c9aced20028d343a930fe914c22d3c1" exitCode=0 Mar 16 16:47:25 crc kubenswrapper[5120]: I0316 16:47:25.927349 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"bd6a69b9-4429-4065-84ad-ab70fca7b288","Type":"ContainerDied","Data":"9dacb617af356ea758a77af50c1b853f9c9aced20028d343a930fe914c22d3c1"} Mar 16 16:47:26 crc kubenswrapper[5120]: I0316 16:47:26.445388 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:47:26 crc kubenswrapper[5120]: I0316 16:47:26.450422 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-cc9l2" Mar 16 16:47:26 crc kubenswrapper[5120]: I0316 16:47:26.581743 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bd6a69b9-4429-4065-84ad-ab70fca7b288-combined-ca-bundle\") pod \"bd6a69b9-4429-4065-84ad-ab70fca7b288\" (UID: \"bd6a69b9-4429-4065-84ad-ab70fca7b288\") " Mar 16 16:47:26 crc kubenswrapper[5120]: I0316 16:47:26.581864 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bd6a69b9-4429-4065-84ad-ab70fca7b288-config-data\") pod \"bd6a69b9-4429-4065-84ad-ab70fca7b288\" (UID: \"bd6a69b9-4429-4065-84ad-ab70fca7b288\") " Mar 16 16:47:26 crc kubenswrapper[5120]: I0316 16:47:26.581917 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b0efd462-99b7-4e0f-a098-4add05cf74a2-scripts\") pod \"b0efd462-99b7-4e0f-a098-4add05cf74a2\" (UID: \"b0efd462-99b7-4e0f-a098-4add05cf74a2\") " Mar 16 16:47:26 crc kubenswrapper[5120]: I0316 16:47:26.581971 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/bd6a69b9-4429-4065-84ad-ab70fca7b288-run-httpd\") pod \"bd6a69b9-4429-4065-84ad-ab70fca7b288\" (UID: \"bd6a69b9-4429-4065-84ad-ab70fca7b288\") " Mar 16 16:47:26 crc kubenswrapper[5120]: I0316 16:47:26.582082 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/bd6a69b9-4429-4065-84ad-ab70fca7b288-scripts\") pod \"bd6a69b9-4429-4065-84ad-ab70fca7b288\" (UID: \"bd6a69b9-4429-4065-84ad-ab70fca7b288\") " Mar 16 16:47:26 crc kubenswrapper[5120]: I0316 16:47:26.582167 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/bd6a69b9-4429-4065-84ad-ab70fca7b288-sg-core-conf-yaml\") pod \"bd6a69b9-4429-4065-84ad-ab70fca7b288\" (UID: \"bd6a69b9-4429-4065-84ad-ab70fca7b288\") " Mar 16 16:47:26 crc kubenswrapper[5120]: I0316 16:47:26.582209 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b0efd462-99b7-4e0f-a098-4add05cf74a2-config-data\") pod \"b0efd462-99b7-4e0f-a098-4add05cf74a2\" (UID: \"b0efd462-99b7-4e0f-a098-4add05cf74a2\") " Mar 16 16:47:26 crc kubenswrapper[5120]: I0316 16:47:26.582463 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/bd6a69b9-4429-4065-84ad-ab70fca7b288-log-httpd\") pod \"bd6a69b9-4429-4065-84ad-ab70fca7b288\" (UID: \"bd6a69b9-4429-4065-84ad-ab70fca7b288\") " Mar 16 16:47:26 crc kubenswrapper[5120]: I0316 16:47:26.582540 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b0efd462-99b7-4e0f-a098-4add05cf74a2-combined-ca-bundle\") pod \"b0efd462-99b7-4e0f-a098-4add05cf74a2\" (UID: \"b0efd462-99b7-4e0f-a098-4add05cf74a2\") " Mar 16 16:47:26 crc kubenswrapper[5120]: I0316 16:47:26.582587 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xfw96\" (UniqueName: \"kubernetes.io/projected/b0efd462-99b7-4e0f-a098-4add05cf74a2-kube-api-access-xfw96\") pod \"b0efd462-99b7-4e0f-a098-4add05cf74a2\" (UID: \"b0efd462-99b7-4e0f-a098-4add05cf74a2\") " Mar 16 16:47:26 crc kubenswrapper[5120]: I0316 16:47:26.582625 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xcsxf\" (UniqueName: \"kubernetes.io/projected/bd6a69b9-4429-4065-84ad-ab70fca7b288-kube-api-access-xcsxf\") pod \"bd6a69b9-4429-4065-84ad-ab70fca7b288\" (UID: \"bd6a69b9-4429-4065-84ad-ab70fca7b288\") " Mar 16 16:47:26 crc kubenswrapper[5120]: I0316 16:47:26.585074 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd6a69b9-4429-4065-84ad-ab70fca7b288-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "bd6a69b9-4429-4065-84ad-ab70fca7b288" (UID: "bd6a69b9-4429-4065-84ad-ab70fca7b288"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:47:26 crc kubenswrapper[5120]: I0316 16:47:26.586091 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd6a69b9-4429-4065-84ad-ab70fca7b288-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "bd6a69b9-4429-4065-84ad-ab70fca7b288" (UID: "bd6a69b9-4429-4065-84ad-ab70fca7b288"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:47:26 crc kubenswrapper[5120]: I0316 16:47:26.593974 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0efd462-99b7-4e0f-a098-4add05cf74a2-kube-api-access-xfw96" (OuterVolumeSpecName: "kube-api-access-xfw96") pod "b0efd462-99b7-4e0f-a098-4add05cf74a2" (UID: "b0efd462-99b7-4e0f-a098-4add05cf74a2"). InnerVolumeSpecName "kube-api-access-xfw96". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:47:26 crc kubenswrapper[5120]: I0316 16:47:26.595011 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd6a69b9-4429-4065-84ad-ab70fca7b288-kube-api-access-xcsxf" (OuterVolumeSpecName: "kube-api-access-xcsxf") pod "bd6a69b9-4429-4065-84ad-ab70fca7b288" (UID: "bd6a69b9-4429-4065-84ad-ab70fca7b288"). InnerVolumeSpecName "kube-api-access-xcsxf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:47:26 crc kubenswrapper[5120]: I0316 16:47:26.595040 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b0efd462-99b7-4e0f-a098-4add05cf74a2-scripts" (OuterVolumeSpecName: "scripts") pod "b0efd462-99b7-4e0f-a098-4add05cf74a2" (UID: "b0efd462-99b7-4e0f-a098-4add05cf74a2"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:47:26 crc kubenswrapper[5120]: I0316 16:47:26.596103 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd6a69b9-4429-4065-84ad-ab70fca7b288-scripts" (OuterVolumeSpecName: "scripts") pod "bd6a69b9-4429-4065-84ad-ab70fca7b288" (UID: "bd6a69b9-4429-4065-84ad-ab70fca7b288"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:47:26 crc kubenswrapper[5120]: I0316 16:47:26.616645 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b0efd462-99b7-4e0f-a098-4add05cf74a2-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "b0efd462-99b7-4e0f-a098-4add05cf74a2" (UID: "b0efd462-99b7-4e0f-a098-4add05cf74a2"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:47:26 crc kubenswrapper[5120]: I0316 16:47:26.617077 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd6a69b9-4429-4065-84ad-ab70fca7b288-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "bd6a69b9-4429-4065-84ad-ab70fca7b288" (UID: "bd6a69b9-4429-4065-84ad-ab70fca7b288"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:47:26 crc kubenswrapper[5120]: I0316 16:47:26.630242 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b0efd462-99b7-4e0f-a098-4add05cf74a2-config-data" (OuterVolumeSpecName: "config-data") pod "b0efd462-99b7-4e0f-a098-4add05cf74a2" (UID: "b0efd462-99b7-4e0f-a098-4add05cf74a2"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:47:26 crc kubenswrapper[5120]: I0316 16:47:26.664532 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd6a69b9-4429-4065-84ad-ab70fca7b288-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "bd6a69b9-4429-4065-84ad-ab70fca7b288" (UID: "bd6a69b9-4429-4065-84ad-ab70fca7b288"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:47:26 crc kubenswrapper[5120]: I0316 16:47:26.685235 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b0efd462-99b7-4e0f-a098-4add05cf74a2-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:47:26 crc kubenswrapper[5120]: I0316 16:47:26.685270 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/bd6a69b9-4429-4065-84ad-ab70fca7b288-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:47:26 crc kubenswrapper[5120]: I0316 16:47:26.685283 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/bd6a69b9-4429-4065-84ad-ab70fca7b288-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:47:26 crc kubenswrapper[5120]: I0316 16:47:26.685295 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/bd6a69b9-4429-4065-84ad-ab70fca7b288-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 16:47:26 crc kubenswrapper[5120]: I0316 16:47:26.685310 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b0efd462-99b7-4e0f-a098-4add05cf74a2-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:47:26 crc kubenswrapper[5120]: I0316 16:47:26.685322 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/bd6a69b9-4429-4065-84ad-ab70fca7b288-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:47:26 crc kubenswrapper[5120]: I0316 16:47:26.685335 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b0efd462-99b7-4e0f-a098-4add05cf74a2-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:47:26 crc kubenswrapper[5120]: I0316 16:47:26.685347 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xfw96\" (UniqueName: \"kubernetes.io/projected/b0efd462-99b7-4e0f-a098-4add05cf74a2-kube-api-access-xfw96\") on node \"crc\" DevicePath \"\"" Mar 16 16:47:26 crc kubenswrapper[5120]: I0316 16:47:26.685360 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xcsxf\" (UniqueName: \"kubernetes.io/projected/bd6a69b9-4429-4065-84ad-ab70fca7b288-kube-api-access-xcsxf\") on node \"crc\" DevicePath \"\"" Mar 16 16:47:26 crc kubenswrapper[5120]: I0316 16:47:26.685372 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bd6a69b9-4429-4065-84ad-ab70fca7b288-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:47:26 crc kubenswrapper[5120]: I0316 16:47:26.690611 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd6a69b9-4429-4065-84ad-ab70fca7b288-config-data" (OuterVolumeSpecName: "config-data") pod "bd6a69b9-4429-4065-84ad-ab70fca7b288" (UID: "bd6a69b9-4429-4065-84ad-ab70fca7b288"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:47:26 crc kubenswrapper[5120]: I0316 16:47:26.788151 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bd6a69b9-4429-4065-84ad-ab70fca7b288-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:47:26 crc kubenswrapper[5120]: I0316 16:47:26.938321 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-cc9l2" Mar 16 16:47:26 crc kubenswrapper[5120]: I0316 16:47:26.938344 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-cc9l2" event={"ID":"b0efd462-99b7-4e0f-a098-4add05cf74a2","Type":"ContainerDied","Data":"f52fe0038c866c287704c312355ce2d9dc9fe97b89614aa16067f07e7a453895"} Mar 16 16:47:26 crc kubenswrapper[5120]: I0316 16:47:26.939289 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f52fe0038c866c287704c312355ce2d9dc9fe97b89614aa16067f07e7a453895" Mar 16 16:47:26 crc kubenswrapper[5120]: I0316 16:47:26.941579 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"bd6a69b9-4429-4065-84ad-ab70fca7b288","Type":"ContainerDied","Data":"318b9803a444bb42567b39c6bf1ac770beaa334b2a57380602ddea81ad1daf4e"} Mar 16 16:47:26 crc kubenswrapper[5120]: I0316 16:47:26.941631 5120 scope.go:117] "RemoveContainer" containerID="f603bd8d265be450427adde59383a0abf796238f942b2cbf7477de86bcc55efb" Mar 16 16:47:26 crc kubenswrapper[5120]: I0316 16:47:26.941777 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:47:26 crc kubenswrapper[5120]: I0316 16:47:26.989773 5120 scope.go:117] "RemoveContainer" containerID="70c9136286a78b1f98aa1551309317bc834e4448d0aea9aa09943c62de5c6784" Mar 16 16:47:26 crc kubenswrapper[5120]: I0316 16:47:26.996901 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:47:27 crc kubenswrapper[5120]: I0316 16:47:27.012019 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:47:27 crc kubenswrapper[5120]: I0316 16:47:27.033148 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:47:27 crc kubenswrapper[5120]: I0316 16:47:27.034622 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd6a69b9-4429-4065-84ad-ab70fca7b288" containerName="ceilometer-central-agent" Mar 16 16:47:27 crc kubenswrapper[5120]: I0316 16:47:27.034648 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd6a69b9-4429-4065-84ad-ab70fca7b288" containerName="ceilometer-central-agent" Mar 16 16:47:27 crc kubenswrapper[5120]: I0316 16:47:27.034665 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0efd462-99b7-4e0f-a098-4add05cf74a2" containerName="nova-cell0-conductor-db-sync" Mar 16 16:47:27 crc kubenswrapper[5120]: I0316 16:47:27.034672 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0efd462-99b7-4e0f-a098-4add05cf74a2" containerName="nova-cell0-conductor-db-sync" Mar 16 16:47:27 crc kubenswrapper[5120]: I0316 16:47:27.034710 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd6a69b9-4429-4065-84ad-ab70fca7b288" containerName="ceilometer-notification-agent" Mar 16 16:47:27 crc kubenswrapper[5120]: I0316 16:47:27.034716 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd6a69b9-4429-4065-84ad-ab70fca7b288" containerName="ceilometer-notification-agent" Mar 16 16:47:27 crc kubenswrapper[5120]: I0316 16:47:27.034750 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd6a69b9-4429-4065-84ad-ab70fca7b288" containerName="proxy-httpd" Mar 16 16:47:27 crc kubenswrapper[5120]: I0316 16:47:27.034772 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd6a69b9-4429-4065-84ad-ab70fca7b288" containerName="proxy-httpd" Mar 16 16:47:27 crc kubenswrapper[5120]: I0316 16:47:27.034796 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd6a69b9-4429-4065-84ad-ab70fca7b288" containerName="sg-core" Mar 16 16:47:27 crc kubenswrapper[5120]: I0316 16:47:27.034803 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd6a69b9-4429-4065-84ad-ab70fca7b288" containerName="sg-core" Mar 16 16:47:27 crc kubenswrapper[5120]: I0316 16:47:27.035050 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="bd6a69b9-4429-4065-84ad-ab70fca7b288" containerName="ceilometer-notification-agent" Mar 16 16:47:27 crc kubenswrapper[5120]: I0316 16:47:27.035064 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="bd6a69b9-4429-4065-84ad-ab70fca7b288" containerName="ceilometer-central-agent" Mar 16 16:47:27 crc kubenswrapper[5120]: I0316 16:47:27.035078 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="b0efd462-99b7-4e0f-a098-4add05cf74a2" containerName="nova-cell0-conductor-db-sync" Mar 16 16:47:27 crc kubenswrapper[5120]: I0316 16:47:27.035091 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="bd6a69b9-4429-4065-84ad-ab70fca7b288" containerName="proxy-httpd" Mar 16 16:47:27 crc kubenswrapper[5120]: I0316 16:47:27.035105 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="bd6a69b9-4429-4065-84ad-ab70fca7b288" containerName="sg-core" Mar 16 16:47:27 crc kubenswrapper[5120]: I0316 16:47:27.044579 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:47:27 crc kubenswrapper[5120]: I0316 16:47:27.044741 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:47:27 crc kubenswrapper[5120]: I0316 16:47:27.048831 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 16:47:27 crc kubenswrapper[5120]: I0316 16:47:27.049202 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 16:47:27 crc kubenswrapper[5120]: I0316 16:47:27.055754 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:47:27 crc kubenswrapper[5120]: I0316 16:47:27.077227 5120 scope.go:117] "RemoveContainer" containerID="d3a83eea8f5002e68331850ded0f70a5c92b21ba855d9c91a9d33d04ba694d99" Mar 16 16:47:27 crc kubenswrapper[5120]: I0316 16:47:27.084545 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:47:27 crc kubenswrapper[5120]: I0316 16:47:27.084669 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:47:27 crc kubenswrapper[5120]: I0316 16:47:27.088261 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-conductor-config-data\"" Mar 16 16:47:27 crc kubenswrapper[5120]: I0316 16:47:27.088627 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-nova-dockercfg-c8q2v\"" Mar 16 16:47:27 crc kubenswrapper[5120]: I0316 16:47:27.095370 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j72hh\" (UniqueName: \"kubernetes.io/projected/fd7587f4-1e7b-4a93-a267-203d419ed999-kube-api-access-j72hh\") pod \"ceilometer-0\" (UID: \"fd7587f4-1e7b-4a93-a267-203d419ed999\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:47:27 crc kubenswrapper[5120]: I0316 16:47:27.096294 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fd7587f4-1e7b-4a93-a267-203d419ed999-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"fd7587f4-1e7b-4a93-a267-203d419ed999\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:47:27 crc kubenswrapper[5120]: I0316 16:47:27.096562 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fd7587f4-1e7b-4a93-a267-203d419ed999-config-data\") pod \"ceilometer-0\" (UID: \"fd7587f4-1e7b-4a93-a267-203d419ed999\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:47:27 crc kubenswrapper[5120]: I0316 16:47:27.096652 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/fd7587f4-1e7b-4a93-a267-203d419ed999-log-httpd\") pod \"ceilometer-0\" (UID: \"fd7587f4-1e7b-4a93-a267-203d419ed999\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:47:27 crc kubenswrapper[5120]: I0316 16:47:27.096752 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/fd7587f4-1e7b-4a93-a267-203d419ed999-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"fd7587f4-1e7b-4a93-a267-203d419ed999\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:47:27 crc kubenswrapper[5120]: I0316 16:47:27.102674 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/fd7587f4-1e7b-4a93-a267-203d419ed999-scripts\") pod \"ceilometer-0\" (UID: \"fd7587f4-1e7b-4a93-a267-203d419ed999\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:47:27 crc kubenswrapper[5120]: I0316 16:47:27.102969 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/fd7587f4-1e7b-4a93-a267-203d419ed999-run-httpd\") pod \"ceilometer-0\" (UID: \"fd7587f4-1e7b-4a93-a267-203d419ed999\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:47:27 crc kubenswrapper[5120]: I0316 16:47:27.107422 5120 scope.go:117] "RemoveContainer" containerID="9dacb617af356ea758a77af50c1b853f9c9aced20028d343a930fe914c22d3c1" Mar 16 16:47:27 crc kubenswrapper[5120]: I0316 16:47:27.205572 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/fd7587f4-1e7b-4a93-a267-203d419ed999-log-httpd\") pod \"ceilometer-0\" (UID: \"fd7587f4-1e7b-4a93-a267-203d419ed999\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:47:27 crc kubenswrapper[5120]: I0316 16:47:27.205625 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/fd7587f4-1e7b-4a93-a267-203d419ed999-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"fd7587f4-1e7b-4a93-a267-203d419ed999\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:47:27 crc kubenswrapper[5120]: I0316 16:47:27.205667 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/fd7587f4-1e7b-4a93-a267-203d419ed999-scripts\") pod \"ceilometer-0\" (UID: \"fd7587f4-1e7b-4a93-a267-203d419ed999\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:47:27 crc kubenswrapper[5120]: I0316 16:47:27.205712 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e664c968-423f-4657-9165-c50d4c890aa1-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"e664c968-423f-4657-9165-c50d4c890aa1\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:47:27 crc kubenswrapper[5120]: I0316 16:47:27.205809 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/fd7587f4-1e7b-4a93-a267-203d419ed999-run-httpd\") pod \"ceilometer-0\" (UID: \"fd7587f4-1e7b-4a93-a267-203d419ed999\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:47:27 crc kubenswrapper[5120]: I0316 16:47:27.205828 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7fq4w\" (UniqueName: \"kubernetes.io/projected/e664c968-423f-4657-9165-c50d4c890aa1-kube-api-access-7fq4w\") pod \"nova-cell0-conductor-0\" (UID: \"e664c968-423f-4657-9165-c50d4c890aa1\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:47:27 crc kubenswrapper[5120]: I0316 16:47:27.205919 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j72hh\" (UniqueName: \"kubernetes.io/projected/fd7587f4-1e7b-4a93-a267-203d419ed999-kube-api-access-j72hh\") pod \"ceilometer-0\" (UID: \"fd7587f4-1e7b-4a93-a267-203d419ed999\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:47:27 crc kubenswrapper[5120]: I0316 16:47:27.206065 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fd7587f4-1e7b-4a93-a267-203d419ed999-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"fd7587f4-1e7b-4a93-a267-203d419ed999\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:47:27 crc kubenswrapper[5120]: I0316 16:47:27.206100 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e664c968-423f-4657-9165-c50d4c890aa1-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"e664c968-423f-4657-9165-c50d4c890aa1\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:47:27 crc kubenswrapper[5120]: I0316 16:47:27.206176 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/fd7587f4-1e7b-4a93-a267-203d419ed999-log-httpd\") pod \"ceilometer-0\" (UID: \"fd7587f4-1e7b-4a93-a267-203d419ed999\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:47:27 crc kubenswrapper[5120]: I0316 16:47:27.206183 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fd7587f4-1e7b-4a93-a267-203d419ed999-config-data\") pod \"ceilometer-0\" (UID: \"fd7587f4-1e7b-4a93-a267-203d419ed999\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:47:27 crc kubenswrapper[5120]: I0316 16:47:27.207185 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/fd7587f4-1e7b-4a93-a267-203d419ed999-run-httpd\") pod \"ceilometer-0\" (UID: \"fd7587f4-1e7b-4a93-a267-203d419ed999\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:47:27 crc kubenswrapper[5120]: I0316 16:47:27.210479 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/fd7587f4-1e7b-4a93-a267-203d419ed999-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"fd7587f4-1e7b-4a93-a267-203d419ed999\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:47:27 crc kubenswrapper[5120]: I0316 16:47:27.211200 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fd7587f4-1e7b-4a93-a267-203d419ed999-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"fd7587f4-1e7b-4a93-a267-203d419ed999\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:47:27 crc kubenswrapper[5120]: I0316 16:47:27.211245 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/fd7587f4-1e7b-4a93-a267-203d419ed999-scripts\") pod \"ceilometer-0\" (UID: \"fd7587f4-1e7b-4a93-a267-203d419ed999\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:47:27 crc kubenswrapper[5120]: I0316 16:47:27.213174 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fd7587f4-1e7b-4a93-a267-203d419ed999-config-data\") pod \"ceilometer-0\" (UID: \"fd7587f4-1e7b-4a93-a267-203d419ed999\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:47:27 crc kubenswrapper[5120]: I0316 16:47:27.222712 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j72hh\" (UniqueName: \"kubernetes.io/projected/fd7587f4-1e7b-4a93-a267-203d419ed999-kube-api-access-j72hh\") pod \"ceilometer-0\" (UID: \"fd7587f4-1e7b-4a93-a267-203d419ed999\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:47:27 crc kubenswrapper[5120]: I0316 16:47:27.308058 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e664c968-423f-4657-9165-c50d4c890aa1-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"e664c968-423f-4657-9165-c50d4c890aa1\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:47:27 crc kubenswrapper[5120]: I0316 16:47:27.308523 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7fq4w\" (UniqueName: \"kubernetes.io/projected/e664c968-423f-4657-9165-c50d4c890aa1-kube-api-access-7fq4w\") pod \"nova-cell0-conductor-0\" (UID: \"e664c968-423f-4657-9165-c50d4c890aa1\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:47:27 crc kubenswrapper[5120]: I0316 16:47:27.308709 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e664c968-423f-4657-9165-c50d4c890aa1-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"e664c968-423f-4657-9165-c50d4c890aa1\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:47:27 crc kubenswrapper[5120]: I0316 16:47:27.312258 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e664c968-423f-4657-9165-c50d4c890aa1-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"e664c968-423f-4657-9165-c50d4c890aa1\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:47:27 crc kubenswrapper[5120]: I0316 16:47:27.312507 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e664c968-423f-4657-9165-c50d4c890aa1-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"e664c968-423f-4657-9165-c50d4c890aa1\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:47:27 crc kubenswrapper[5120]: I0316 16:47:27.329049 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7fq4w\" (UniqueName: \"kubernetes.io/projected/e664c968-423f-4657-9165-c50d4c890aa1-kube-api-access-7fq4w\") pod \"nova-cell0-conductor-0\" (UID: \"e664c968-423f-4657-9165-c50d4c890aa1\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:47:27 crc kubenswrapper[5120]: I0316 16:47:27.366935 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:47:27 crc kubenswrapper[5120]: I0316 16:47:27.419069 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:47:27 crc kubenswrapper[5120]: I0316 16:47:27.808951 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:47:27 crc kubenswrapper[5120]: W0316 16:47:27.809337 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfd7587f4_1e7b_4a93_a267_203d419ed999.slice/crio-98c313a6466a41557d8367390fbc2829ed07b4a1d247b6e0d2f40008179ad130 WatchSource:0}: Error finding container 98c313a6466a41557d8367390fbc2829ed07b4a1d247b6e0d2f40008179ad130: Status 404 returned error can't find the container with id 98c313a6466a41557d8367390fbc2829ed07b4a1d247b6e0d2f40008179ad130 Mar 16 16:47:27 crc kubenswrapper[5120]: I0316 16:47:27.923575 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:47:27 crc kubenswrapper[5120]: I0316 16:47:27.953302 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"e664c968-423f-4657-9165-c50d4c890aa1","Type":"ContainerStarted","Data":"97655399632d2ea41a62b2d29605f526f8918780a818e1426f3a52cd966af789"} Mar 16 16:47:27 crc kubenswrapper[5120]: I0316 16:47:27.956254 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"fd7587f4-1e7b-4a93-a267-203d419ed999","Type":"ContainerStarted","Data":"98c313a6466a41557d8367390fbc2829ed07b4a1d247b6e0d2f40008179ad130"} Mar 16 16:47:28 crc kubenswrapper[5120]: I0316 16:47:28.676420 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bd6a69b9-4429-4065-84ad-ab70fca7b288" path="/var/lib/kubelet/pods/bd6a69b9-4429-4065-84ad-ab70fca7b288/volumes" Mar 16 16:47:28 crc kubenswrapper[5120]: I0316 16:47:28.970369 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"fd7587f4-1e7b-4a93-a267-203d419ed999","Type":"ContainerStarted","Data":"02eafcd624c33d278f9a1bf4ea63735086abd29b4a9707025b785fa9f22810e1"} Mar 16 16:47:28 crc kubenswrapper[5120]: I0316 16:47:28.974394 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"e664c968-423f-4657-9165-c50d4c890aa1","Type":"ContainerStarted","Data":"ff1237f483556a49b6a2de39573f3752394dfe2800e0d6ee605557d2f81a85f1"} Mar 16 16:47:28 crc kubenswrapper[5120]: I0316 16:47:28.974864 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:47:29 crc kubenswrapper[5120]: I0316 16:47:29.001157 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podStartSLOduration=2.001140781 podStartE2EDuration="2.001140781s" podCreationTimestamp="2026-03-16 16:47:27 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:47:28.992440735 +0000 UTC m=+4551.146372412" watchObservedRunningTime="2026-03-16 16:47:29.001140781 +0000 UTC m=+4551.155072438" Mar 16 16:47:29 crc kubenswrapper[5120]: I0316 16:47:29.990008 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"fd7587f4-1e7b-4a93-a267-203d419ed999","Type":"ContainerStarted","Data":"f06693c4c47b1ddac7feedd75f38ef41eab337b71e37e8169cc2f5f54575f500"} Mar 16 16:47:29 crc kubenswrapper[5120]: I0316 16:47:29.990597 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"fd7587f4-1e7b-4a93-a267-203d419ed999","Type":"ContainerStarted","Data":"7ffb3b3875a09a74132c992ec36db29e3fa1fc30b5cb6e7425f6925fc993b4e0"} Mar 16 16:47:30 crc kubenswrapper[5120]: I0316 16:47:30.678324 5120 scope.go:117] "RemoveContainer" containerID="35a7dd6e19084cee69ca16203bca6378ea0cdf6a685ca2093ab847e5904eb9e6" Mar 16 16:47:30 crc kubenswrapper[5120]: E0316 16:47:30.678788 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:47:32 crc kubenswrapper[5120]: I0316 16:47:32.014389 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"fd7587f4-1e7b-4a93-a267-203d419ed999","Type":"ContainerStarted","Data":"d1205b79a32c596cfc4f7d09f803d9f32a0917ea81be923d0a7683363b040c85"} Mar 16 16:47:32 crc kubenswrapper[5120]: I0316 16:47:32.014750 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:47:32 crc kubenswrapper[5120]: I0316 16:47:32.039207 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.501303224 podStartE2EDuration="6.039186626s" podCreationTimestamp="2026-03-16 16:47:26 +0000 UTC" firstStartedPulling="2026-03-16 16:47:27.81115872 +0000 UTC m=+4549.965090377" lastFinishedPulling="2026-03-16 16:47:31.349042122 +0000 UTC m=+4553.502973779" observedRunningTime="2026-03-16 16:47:32.032539555 +0000 UTC m=+4554.186471212" watchObservedRunningTime="2026-03-16 16:47:32.039186626 +0000 UTC m=+4554.193118283" Mar 16 16:47:35 crc kubenswrapper[5120]: I0316 16:47:35.019531 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:47:35 crc kubenswrapper[5120]: I0316 16:47:35.443749 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:47:35 crc kubenswrapper[5120]: I0316 16:47:35.444006 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="e664c968-423f-4657-9165-c50d4c890aa1" containerName="nova-cell0-conductor-conductor" containerID="cri-o://ff1237f483556a49b6a2de39573f3752394dfe2800e0d6ee605557d2f81a85f1" gracePeriod=30 Mar 16 16:47:35 crc kubenswrapper[5120]: I0316 16:47:35.584079 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-6qwtb"] Mar 16 16:47:35 crc kubenswrapper[5120]: I0316 16:47:35.590200 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-6qwtb" Mar 16 16:47:35 crc kubenswrapper[5120]: I0316 16:47:35.592074 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-manage-config-data\"" Mar 16 16:47:35 crc kubenswrapper[5120]: I0316 16:47:35.595062 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-manage-scripts\"" Mar 16 16:47:35 crc kubenswrapper[5120]: I0316 16:47:35.600098 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-6qwtb"] Mar 16 16:47:35 crc kubenswrapper[5120]: I0316 16:47:35.672062 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/580e419d-0472-485f-b809-5a610832d21f-combined-ca-bundle\") pod \"nova-cell0-cell-mapping-6qwtb\" (UID: \"580e419d-0472-485f-b809-5a610832d21f\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-6qwtb" Mar 16 16:47:35 crc kubenswrapper[5120]: I0316 16:47:35.672153 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/580e419d-0472-485f-b809-5a610832d21f-scripts\") pod \"nova-cell0-cell-mapping-6qwtb\" (UID: \"580e419d-0472-485f-b809-5a610832d21f\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-6qwtb" Mar 16 16:47:35 crc kubenswrapper[5120]: I0316 16:47:35.672299 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gnc6\" (UniqueName: \"kubernetes.io/projected/580e419d-0472-485f-b809-5a610832d21f-kube-api-access-6gnc6\") pod \"nova-cell0-cell-mapping-6qwtb\" (UID: \"580e419d-0472-485f-b809-5a610832d21f\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-6qwtb" Mar 16 16:47:35 crc kubenswrapper[5120]: I0316 16:47:35.672387 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/580e419d-0472-485f-b809-5a610832d21f-config-data\") pod \"nova-cell0-cell-mapping-6qwtb\" (UID: \"580e419d-0472-485f-b809-5a610832d21f\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-6qwtb" Mar 16 16:47:35 crc kubenswrapper[5120]: I0316 16:47:35.750726 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:47:35 crc kubenswrapper[5120]: I0316 16:47:35.775647 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/580e419d-0472-485f-b809-5a610832d21f-combined-ca-bundle\") pod \"nova-cell0-cell-mapping-6qwtb\" (UID: \"580e419d-0472-485f-b809-5a610832d21f\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-6qwtb" Mar 16 16:47:35 crc kubenswrapper[5120]: I0316 16:47:35.775734 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/580e419d-0472-485f-b809-5a610832d21f-scripts\") pod \"nova-cell0-cell-mapping-6qwtb\" (UID: \"580e419d-0472-485f-b809-5a610832d21f\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-6qwtb" Mar 16 16:47:35 crc kubenswrapper[5120]: I0316 16:47:35.775865 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6gnc6\" (UniqueName: \"kubernetes.io/projected/580e419d-0472-485f-b809-5a610832d21f-kube-api-access-6gnc6\") pod \"nova-cell0-cell-mapping-6qwtb\" (UID: \"580e419d-0472-485f-b809-5a610832d21f\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-6qwtb" Mar 16 16:47:35 crc kubenswrapper[5120]: I0316 16:47:35.775921 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/580e419d-0472-485f-b809-5a610832d21f-config-data\") pod \"nova-cell0-cell-mapping-6qwtb\" (UID: \"580e419d-0472-485f-b809-5a610832d21f\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-6qwtb" Mar 16 16:47:35 crc kubenswrapper[5120]: I0316 16:47:35.782531 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/580e419d-0472-485f-b809-5a610832d21f-scripts\") pod \"nova-cell0-cell-mapping-6qwtb\" (UID: \"580e419d-0472-485f-b809-5a610832d21f\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-6qwtb" Mar 16 16:47:35 crc kubenswrapper[5120]: I0316 16:47:35.786477 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/580e419d-0472-485f-b809-5a610832d21f-combined-ca-bundle\") pod \"nova-cell0-cell-mapping-6qwtb\" (UID: \"580e419d-0472-485f-b809-5a610832d21f\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-6qwtb" Mar 16 16:47:35 crc kubenswrapper[5120]: I0316 16:47:35.814619 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/580e419d-0472-485f-b809-5a610832d21f-config-data\") pod \"nova-cell0-cell-mapping-6qwtb\" (UID: \"580e419d-0472-485f-b809-5a610832d21f\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-6qwtb" Mar 16 16:47:35 crc kubenswrapper[5120]: I0316 16:47:35.826280 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gnc6\" (UniqueName: \"kubernetes.io/projected/580e419d-0472-485f-b809-5a610832d21f-kube-api-access-6gnc6\") pod \"nova-cell0-cell-mapping-6qwtb\" (UID: \"580e419d-0472-485f-b809-5a610832d21f\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-6qwtb" Mar 16 16:47:35 crc kubenswrapper[5120]: I0316 16:47:35.846905 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:47:35 crc kubenswrapper[5120]: I0316 16:47:35.846956 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:47:35 crc kubenswrapper[5120]: I0316 16:47:35.847186 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:47:35 crc kubenswrapper[5120]: I0316 16:47:35.853876 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-scheduler-config-data\"" Mar 16 16:47:35 crc kubenswrapper[5120]: I0316 16:47:35.872883 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:47:35 crc kubenswrapper[5120]: I0316 16:47:35.873041 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:47:35 crc kubenswrapper[5120]: I0316 16:47:35.879520 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-config-data\"" Mar 16 16:47:35 crc kubenswrapper[5120]: I0316 16:47:35.880843 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1272c05f-07f3-4206-ad8f-50db9f288160-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"1272c05f-07f3-4206-ad8f-50db9f288160\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:47:35 crc kubenswrapper[5120]: I0316 16:47:35.881048 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5d5z\" (UniqueName: \"kubernetes.io/projected/ffb58abe-0995-4f67-a71e-1a30dd9a53a9-kube-api-access-f5d5z\") pod \"nova-api-0\" (UID: \"ffb58abe-0995-4f67-a71e-1a30dd9a53a9\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:47:35 crc kubenswrapper[5120]: I0316 16:47:35.881086 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ffb58abe-0995-4f67-a71e-1a30dd9a53a9-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"ffb58abe-0995-4f67-a71e-1a30dd9a53a9\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:47:35 crc kubenswrapper[5120]: I0316 16:47:35.881104 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wps9p\" (UniqueName: \"kubernetes.io/projected/1272c05f-07f3-4206-ad8f-50db9f288160-kube-api-access-wps9p\") pod \"nova-scheduler-0\" (UID: \"1272c05f-07f3-4206-ad8f-50db9f288160\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:47:35 crc kubenswrapper[5120]: I0316 16:47:35.881146 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1272c05f-07f3-4206-ad8f-50db9f288160-config-data\") pod \"nova-scheduler-0\" (UID: \"1272c05f-07f3-4206-ad8f-50db9f288160\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:47:35 crc kubenswrapper[5120]: I0316 16:47:35.881201 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ffb58abe-0995-4f67-a71e-1a30dd9a53a9-logs\") pod \"nova-api-0\" (UID: \"ffb58abe-0995-4f67-a71e-1a30dd9a53a9\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:47:35 crc kubenswrapper[5120]: I0316 16:47:35.881217 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ffb58abe-0995-4f67-a71e-1a30dd9a53a9-config-data\") pod \"nova-api-0\" (UID: \"ffb58abe-0995-4f67-a71e-1a30dd9a53a9\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:47:35 crc kubenswrapper[5120]: I0316 16:47:35.910741 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-6qwtb" Mar 16 16:47:35 crc kubenswrapper[5120]: I0316 16:47:35.928838 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:47:35 crc kubenswrapper[5120]: I0316 16:47:35.987869 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:47:35 crc kubenswrapper[5120]: I0316 16:47:35.988022 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:47:35 crc kubenswrapper[5120]: I0316 16:47:35.988459 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f5d5z\" (UniqueName: \"kubernetes.io/projected/ffb58abe-0995-4f67-a71e-1a30dd9a53a9-kube-api-access-f5d5z\") pod \"nova-api-0\" (UID: \"ffb58abe-0995-4f67-a71e-1a30dd9a53a9\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:47:35 crc kubenswrapper[5120]: I0316 16:47:35.988509 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ffb58abe-0995-4f67-a71e-1a30dd9a53a9-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"ffb58abe-0995-4f67-a71e-1a30dd9a53a9\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:47:35 crc kubenswrapper[5120]: I0316 16:47:35.988528 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wps9p\" (UniqueName: \"kubernetes.io/projected/1272c05f-07f3-4206-ad8f-50db9f288160-kube-api-access-wps9p\") pod \"nova-scheduler-0\" (UID: \"1272c05f-07f3-4206-ad8f-50db9f288160\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:47:35 crc kubenswrapper[5120]: I0316 16:47:35.988578 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1272c05f-07f3-4206-ad8f-50db9f288160-config-data\") pod \"nova-scheduler-0\" (UID: \"1272c05f-07f3-4206-ad8f-50db9f288160\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:47:35 crc kubenswrapper[5120]: I0316 16:47:35.988654 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ffb58abe-0995-4f67-a71e-1a30dd9a53a9-logs\") pod \"nova-api-0\" (UID: \"ffb58abe-0995-4f67-a71e-1a30dd9a53a9\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:47:35 crc kubenswrapper[5120]: I0316 16:47:35.988673 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ffb58abe-0995-4f67-a71e-1a30dd9a53a9-config-data\") pod \"nova-api-0\" (UID: \"ffb58abe-0995-4f67-a71e-1a30dd9a53a9\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:47:35 crc kubenswrapper[5120]: I0316 16:47:35.988846 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1272c05f-07f3-4206-ad8f-50db9f288160-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"1272c05f-07f3-4206-ad8f-50db9f288160\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:47:35 crc kubenswrapper[5120]: I0316 16:47:35.989696 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ffb58abe-0995-4f67-a71e-1a30dd9a53a9-logs\") pod \"nova-api-0\" (UID: \"ffb58abe-0995-4f67-a71e-1a30dd9a53a9\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:47:35 crc kubenswrapper[5120]: I0316 16:47:35.995259 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1272c05f-07f3-4206-ad8f-50db9f288160-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"1272c05f-07f3-4206-ad8f-50db9f288160\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:47:35 crc kubenswrapper[5120]: I0316 16:47:35.995899 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1272c05f-07f3-4206-ad8f-50db9f288160-config-data\") pod \"nova-scheduler-0\" (UID: \"1272c05f-07f3-4206-ad8f-50db9f288160\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:47:35 crc kubenswrapper[5120]: I0316 16:47:35.996588 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-metadata-config-data\"" Mar 16 16:47:35 crc kubenswrapper[5120]: I0316 16:47:35.997948 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ffb58abe-0995-4f67-a71e-1a30dd9a53a9-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"ffb58abe-0995-4f67-a71e-1a30dd9a53a9\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:47:36 crc kubenswrapper[5120]: I0316 16:47:36.015481 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wps9p\" (UniqueName: \"kubernetes.io/projected/1272c05f-07f3-4206-ad8f-50db9f288160-kube-api-access-wps9p\") pod \"nova-scheduler-0\" (UID: \"1272c05f-07f3-4206-ad8f-50db9f288160\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:47:36 crc kubenswrapper[5120]: I0316 16:47:36.028445 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ffb58abe-0995-4f67-a71e-1a30dd9a53a9-config-data\") pod \"nova-api-0\" (UID: \"ffb58abe-0995-4f67-a71e-1a30dd9a53a9\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:47:36 crc kubenswrapper[5120]: I0316 16:47:36.044357 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5d5z\" (UniqueName: \"kubernetes.io/projected/ffb58abe-0995-4f67-a71e-1a30dd9a53a9-kube-api-access-f5d5z\") pod \"nova-api-0\" (UID: \"ffb58abe-0995-4f67-a71e-1a30dd9a53a9\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:47:36 crc kubenswrapper[5120]: I0316 16:47:36.067967 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:47:36 crc kubenswrapper[5120]: I0316 16:47:36.081824 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:47:36 crc kubenswrapper[5120]: I0316 16:47:36.089160 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-novncproxy-config-data\"" Mar 16 16:47:36 crc kubenswrapper[5120]: I0316 16:47:36.090711 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qgd9\" (UniqueName: \"kubernetes.io/projected/babd9a47-eaa5-4b06-a2d3-16732a4b2dc7-kube-api-access-9qgd9\") pod \"nova-cell1-novncproxy-0\" (UID: \"babd9a47-eaa5-4b06-a2d3-16732a4b2dc7\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:47:36 crc kubenswrapper[5120]: I0316 16:47:36.090740 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/babd9a47-eaa5-4b06-a2d3-16732a4b2dc7-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"babd9a47-eaa5-4b06-a2d3-16732a4b2dc7\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:47:36 crc kubenswrapper[5120]: I0316 16:47:36.090919 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/efc34cca-3f74-4fbb-a4f1-e058be54acc3-config-data\") pod \"nova-metadata-0\" (UID: \"efc34cca-3f74-4fbb-a4f1-e058be54acc3\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:47:36 crc kubenswrapper[5120]: I0316 16:47:36.090938 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/efc34cca-3f74-4fbb-a4f1-e058be54acc3-logs\") pod \"nova-metadata-0\" (UID: \"efc34cca-3f74-4fbb-a4f1-e058be54acc3\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:47:36 crc kubenswrapper[5120]: I0316 16:47:36.091004 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/babd9a47-eaa5-4b06-a2d3-16732a4b2dc7-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"babd9a47-eaa5-4b06-a2d3-16732a4b2dc7\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:47:36 crc kubenswrapper[5120]: I0316 16:47:36.091083 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2z5x\" (UniqueName: \"kubernetes.io/projected/efc34cca-3f74-4fbb-a4f1-e058be54acc3-kube-api-access-n2z5x\") pod \"nova-metadata-0\" (UID: \"efc34cca-3f74-4fbb-a4f1-e058be54acc3\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:47:36 crc kubenswrapper[5120]: I0316 16:47:36.091161 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/efc34cca-3f74-4fbb-a4f1-e058be54acc3-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"efc34cca-3f74-4fbb-a4f1-e058be54acc3\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:47:36 crc kubenswrapper[5120]: I0316 16:47:36.120819 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:47:36 crc kubenswrapper[5120]: I0316 16:47:36.194014 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/efc34cca-3f74-4fbb-a4f1-e058be54acc3-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"efc34cca-3f74-4fbb-a4f1-e058be54acc3\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:47:36 crc kubenswrapper[5120]: I0316 16:47:36.194129 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9qgd9\" (UniqueName: \"kubernetes.io/projected/babd9a47-eaa5-4b06-a2d3-16732a4b2dc7-kube-api-access-9qgd9\") pod \"nova-cell1-novncproxy-0\" (UID: \"babd9a47-eaa5-4b06-a2d3-16732a4b2dc7\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:47:36 crc kubenswrapper[5120]: I0316 16:47:36.194156 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/babd9a47-eaa5-4b06-a2d3-16732a4b2dc7-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"babd9a47-eaa5-4b06-a2d3-16732a4b2dc7\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:47:36 crc kubenswrapper[5120]: I0316 16:47:36.194605 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/efc34cca-3f74-4fbb-a4f1-e058be54acc3-config-data\") pod \"nova-metadata-0\" (UID: \"efc34cca-3f74-4fbb-a4f1-e058be54acc3\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:47:36 crc kubenswrapper[5120]: I0316 16:47:36.194633 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/efc34cca-3f74-4fbb-a4f1-e058be54acc3-logs\") pod \"nova-metadata-0\" (UID: \"efc34cca-3f74-4fbb-a4f1-e058be54acc3\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:47:36 crc kubenswrapper[5120]: I0316 16:47:36.194930 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/babd9a47-eaa5-4b06-a2d3-16732a4b2dc7-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"babd9a47-eaa5-4b06-a2d3-16732a4b2dc7\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:47:36 crc kubenswrapper[5120]: I0316 16:47:36.195139 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n2z5x\" (UniqueName: \"kubernetes.io/projected/efc34cca-3f74-4fbb-a4f1-e058be54acc3-kube-api-access-n2z5x\") pod \"nova-metadata-0\" (UID: \"efc34cca-3f74-4fbb-a4f1-e058be54acc3\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:47:36 crc kubenswrapper[5120]: I0316 16:47:36.197410 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/efc34cca-3f74-4fbb-a4f1-e058be54acc3-logs\") pod \"nova-metadata-0\" (UID: \"efc34cca-3f74-4fbb-a4f1-e058be54acc3\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:47:36 crc kubenswrapper[5120]: I0316 16:47:36.203972 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/efc34cca-3f74-4fbb-a4f1-e058be54acc3-config-data\") pod \"nova-metadata-0\" (UID: \"efc34cca-3f74-4fbb-a4f1-e058be54acc3\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:47:36 crc kubenswrapper[5120]: I0316 16:47:36.206387 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/babd9a47-eaa5-4b06-a2d3-16732a4b2dc7-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"babd9a47-eaa5-4b06-a2d3-16732a4b2dc7\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:47:36 crc kubenswrapper[5120]: I0316 16:47:36.206701 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/efc34cca-3f74-4fbb-a4f1-e058be54acc3-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"efc34cca-3f74-4fbb-a4f1-e058be54acc3\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:47:36 crc kubenswrapper[5120]: I0316 16:47:36.208535 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/babd9a47-eaa5-4b06-a2d3-16732a4b2dc7-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"babd9a47-eaa5-4b06-a2d3-16732a4b2dc7\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:47:36 crc kubenswrapper[5120]: I0316 16:47:36.211200 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:47:36 crc kubenswrapper[5120]: I0316 16:47:36.218394 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2z5x\" (UniqueName: \"kubernetes.io/projected/efc34cca-3f74-4fbb-a4f1-e058be54acc3-kube-api-access-n2z5x\") pod \"nova-metadata-0\" (UID: \"efc34cca-3f74-4fbb-a4f1-e058be54acc3\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:47:36 crc kubenswrapper[5120]: I0316 16:47:36.222085 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:47:36 crc kubenswrapper[5120]: I0316 16:47:36.227241 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qgd9\" (UniqueName: \"kubernetes.io/projected/babd9a47-eaa5-4b06-a2d3-16732a4b2dc7-kube-api-access-9qgd9\") pod \"nova-cell1-novncproxy-0\" (UID: \"babd9a47-eaa5-4b06-a2d3-16732a4b2dc7\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:47:36 crc kubenswrapper[5120]: I0316 16:47:36.456370 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:47:36 crc kubenswrapper[5120]: I0316 16:47:36.481260 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:47:36 crc kubenswrapper[5120]: I0316 16:47:36.528380 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-6qwtb"] Mar 16 16:47:36 crc kubenswrapper[5120]: W0316 16:47:36.736284 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1272c05f_07f3_4206_ad8f_50db9f288160.slice/crio-7868e704c293273069e86d6c5114624343696aa8c23af25ef4cbb7f8fa779274 WatchSource:0}: Error finding container 7868e704c293273069e86d6c5114624343696aa8c23af25ef4cbb7f8fa779274: Status 404 returned error can't find the container with id 7868e704c293273069e86d6c5114624343696aa8c23af25ef4cbb7f8fa779274 Mar 16 16:47:36 crc kubenswrapper[5120]: I0316 16:47:36.737597 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:47:36 crc kubenswrapper[5120]: I0316 16:47:36.874096 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:47:36 crc kubenswrapper[5120]: I0316 16:47:36.998032 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:47:37 crc kubenswrapper[5120]: W0316 16:47:37.006183 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podefc34cca_3f74_4fbb_a4f1_e058be54acc3.slice/crio-e25b042c77353d33ecdf454f81a5a61264aa2d3cb0be4ec4271c4a1c90154ff8 WatchSource:0}: Error finding container e25b042c77353d33ecdf454f81a5a61264aa2d3cb0be4ec4271c4a1c90154ff8: Status 404 returned error can't find the container with id e25b042c77353d33ecdf454f81a5a61264aa2d3cb0be4ec4271c4a1c90154ff8 Mar 16 16:47:37 crc kubenswrapper[5120]: I0316 16:47:37.082505 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:47:37 crc kubenswrapper[5120]: I0316 16:47:37.116037 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-6qwtb" event={"ID":"580e419d-0472-485f-b809-5a610832d21f","Type":"ContainerStarted","Data":"b56b840eff04c2ab9a162f3cdec5eebed9702876d18bf834243ab5cb9ff66aaa"} Mar 16 16:47:37 crc kubenswrapper[5120]: I0316 16:47:37.116078 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-6qwtb" event={"ID":"580e419d-0472-485f-b809-5a610832d21f","Type":"ContainerStarted","Data":"01cde18bf8dc9a87c37fbab56f352b27f74d6f3e81269ecc5f10d42230c3e3a1"} Mar 16 16:47:37 crc kubenswrapper[5120]: I0316 16:47:37.125788 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"ffb58abe-0995-4f67-a71e-1a30dd9a53a9","Type":"ContainerStarted","Data":"8e1ffa892c8a06f33c177867eaad62dbb3bb150473edc890e40b8aa51ef6412d"} Mar 16 16:47:37 crc kubenswrapper[5120]: I0316 16:47:37.133916 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"1272c05f-07f3-4206-ad8f-50db9f288160","Type":"ContainerStarted","Data":"7868e704c293273069e86d6c5114624343696aa8c23af25ef4cbb7f8fa779274"} Mar 16 16:47:37 crc kubenswrapper[5120]: I0316 16:47:37.135099 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"efc34cca-3f74-4fbb-a4f1-e058be54acc3","Type":"ContainerStarted","Data":"e25b042c77353d33ecdf454f81a5a61264aa2d3cb0be4ec4271c4a1c90154ff8"} Mar 16 16:47:37 crc kubenswrapper[5120]: I0316 16:47:37.151771 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-kkvsb"] Mar 16 16:47:37 crc kubenswrapper[5120]: I0316 16:47:37.173093 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-6qwtb" podStartSLOduration=2.173075765 podStartE2EDuration="2.173075765s" podCreationTimestamp="2026-03-16 16:47:35 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:47:37.14867336 +0000 UTC m=+4559.302605017" watchObservedRunningTime="2026-03-16 16:47:37.173075765 +0000 UTC m=+4559.327007422" Mar 16 16:47:37 crc kubenswrapper[5120]: I0316 16:47:37.212578 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-kkvsb"] Mar 16 16:47:37 crc kubenswrapper[5120]: I0316 16:47:37.212693 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-kkvsb" Mar 16 16:47:37 crc kubenswrapper[5120]: I0316 16:47:37.217434 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-conductor-config-data\"" Mar 16 16:47:37 crc kubenswrapper[5120]: I0316 16:47:37.217630 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-conductor-scripts\"" Mar 16 16:47:37 crc kubenswrapper[5120]: I0316 16:47:37.344635 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2889\" (UniqueName: \"kubernetes.io/projected/fa2dd400-9a52-4610-b9db-83f796bab4a6-kube-api-access-j2889\") pod \"nova-cell1-conductor-db-sync-kkvsb\" (UID: \"fa2dd400-9a52-4610-b9db-83f796bab4a6\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-kkvsb" Mar 16 16:47:37 crc kubenswrapper[5120]: I0316 16:47:37.344996 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/fa2dd400-9a52-4610-b9db-83f796bab4a6-scripts\") pod \"nova-cell1-conductor-db-sync-kkvsb\" (UID: \"fa2dd400-9a52-4610-b9db-83f796bab4a6\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-kkvsb" Mar 16 16:47:37 crc kubenswrapper[5120]: I0316 16:47:37.345113 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fa2dd400-9a52-4610-b9db-83f796bab4a6-config-data\") pod \"nova-cell1-conductor-db-sync-kkvsb\" (UID: \"fa2dd400-9a52-4610-b9db-83f796bab4a6\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-kkvsb" Mar 16 16:47:37 crc kubenswrapper[5120]: I0316 16:47:37.345358 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fa2dd400-9a52-4610-b9db-83f796bab4a6-combined-ca-bundle\") pod \"nova-cell1-conductor-db-sync-kkvsb\" (UID: \"fa2dd400-9a52-4610-b9db-83f796bab4a6\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-kkvsb" Mar 16 16:47:37 crc kubenswrapper[5120]: I0316 16:47:37.447399 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/fa2dd400-9a52-4610-b9db-83f796bab4a6-scripts\") pod \"nova-cell1-conductor-db-sync-kkvsb\" (UID: \"fa2dd400-9a52-4610-b9db-83f796bab4a6\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-kkvsb" Mar 16 16:47:37 crc kubenswrapper[5120]: I0316 16:47:37.447502 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fa2dd400-9a52-4610-b9db-83f796bab4a6-config-data\") pod \"nova-cell1-conductor-db-sync-kkvsb\" (UID: \"fa2dd400-9a52-4610-b9db-83f796bab4a6\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-kkvsb" Mar 16 16:47:37 crc kubenswrapper[5120]: I0316 16:47:37.447577 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fa2dd400-9a52-4610-b9db-83f796bab4a6-combined-ca-bundle\") pod \"nova-cell1-conductor-db-sync-kkvsb\" (UID: \"fa2dd400-9a52-4610-b9db-83f796bab4a6\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-kkvsb" Mar 16 16:47:37 crc kubenswrapper[5120]: I0316 16:47:37.447645 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j2889\" (UniqueName: \"kubernetes.io/projected/fa2dd400-9a52-4610-b9db-83f796bab4a6-kube-api-access-j2889\") pod \"nova-cell1-conductor-db-sync-kkvsb\" (UID: \"fa2dd400-9a52-4610-b9db-83f796bab4a6\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-kkvsb" Mar 16 16:47:37 crc kubenswrapper[5120]: I0316 16:47:37.452530 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fa2dd400-9a52-4610-b9db-83f796bab4a6-config-data\") pod \"nova-cell1-conductor-db-sync-kkvsb\" (UID: \"fa2dd400-9a52-4610-b9db-83f796bab4a6\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-kkvsb" Mar 16 16:47:37 crc kubenswrapper[5120]: I0316 16:47:37.453182 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fa2dd400-9a52-4610-b9db-83f796bab4a6-combined-ca-bundle\") pod \"nova-cell1-conductor-db-sync-kkvsb\" (UID: \"fa2dd400-9a52-4610-b9db-83f796bab4a6\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-kkvsb" Mar 16 16:47:37 crc kubenswrapper[5120]: I0316 16:47:37.461820 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/fa2dd400-9a52-4610-b9db-83f796bab4a6-scripts\") pod \"nova-cell1-conductor-db-sync-kkvsb\" (UID: \"fa2dd400-9a52-4610-b9db-83f796bab4a6\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-kkvsb" Mar 16 16:47:37 crc kubenswrapper[5120]: I0316 16:47:37.464505 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2889\" (UniqueName: \"kubernetes.io/projected/fa2dd400-9a52-4610-b9db-83f796bab4a6-kube-api-access-j2889\") pod \"nova-cell1-conductor-db-sync-kkvsb\" (UID: \"fa2dd400-9a52-4610-b9db-83f796bab4a6\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-kkvsb" Mar 16 16:47:37 crc kubenswrapper[5120]: I0316 16:47:37.530867 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-kkvsb" Mar 16 16:47:38 crc kubenswrapper[5120]: I0316 16:47:38.033821 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-kkvsb"] Mar 16 16:47:38 crc kubenswrapper[5120]: I0316 16:47:38.156820 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"babd9a47-eaa5-4b06-a2d3-16732a4b2dc7","Type":"ContainerStarted","Data":"38067664f50ab8da43ddd0e6355751fdc9ef3eb7d2256c031cb4164e85be88dc"} Mar 16 16:47:38 crc kubenswrapper[5120]: I0316 16:47:38.156892 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"babd9a47-eaa5-4b06-a2d3-16732a4b2dc7","Type":"ContainerStarted","Data":"76411f14fc4d568d664b206dbdb72ead8d1a3fecc1443de684c3e1c83dea1140"} Mar 16 16:47:38 crc kubenswrapper[5120]: I0316 16:47:38.161040 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"ffb58abe-0995-4f67-a71e-1a30dd9a53a9","Type":"ContainerStarted","Data":"dbb3d0badb5a54cc37ad2919d646bde9b1985fca256eab9bb00a3edd74bb997b"} Mar 16 16:47:38 crc kubenswrapper[5120]: I0316 16:47:38.161301 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"ffb58abe-0995-4f67-a71e-1a30dd9a53a9","Type":"ContainerStarted","Data":"2c3e1e2693c070919563ab14ce53a0c720ffd295a65909c1f35aedc1c4f54aca"} Mar 16 16:47:38 crc kubenswrapper[5120]: I0316 16:47:38.173004 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"1272c05f-07f3-4206-ad8f-50db9f288160","Type":"ContainerStarted","Data":"98a95690a367a9d47eb6a2f83e9e51d4a7f4ddd8db7381a156aa0628f61af42a"} Mar 16 16:47:38 crc kubenswrapper[5120]: I0316 16:47:38.184601 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podStartSLOduration=3.18458264 podStartE2EDuration="3.18458264s" podCreationTimestamp="2026-03-16 16:47:35 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:47:38.172036819 +0000 UTC m=+4560.325968476" watchObservedRunningTime="2026-03-16 16:47:38.18458264 +0000 UTC m=+4560.338514297" Mar 16 16:47:38 crc kubenswrapper[5120]: I0316 16:47:38.201491 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=3.20147404 podStartE2EDuration="3.20147404s" podCreationTimestamp="2026-03-16 16:47:35 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:47:38.197326377 +0000 UTC m=+4560.351258034" watchObservedRunningTime="2026-03-16 16:47:38.20147404 +0000 UTC m=+4560.355405697" Mar 16 16:47:38 crc kubenswrapper[5120]: I0316 16:47:38.207124 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"efc34cca-3f74-4fbb-a4f1-e058be54acc3","Type":"ContainerStarted","Data":"9774a490e427b07efec3e6172a6590aa16e8a4591618ab0a2aabf66a6561a5cf"} Mar 16 16:47:38 crc kubenswrapper[5120]: I0316 16:47:38.207358 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"efc34cca-3f74-4fbb-a4f1-e058be54acc3","Type":"ContainerStarted","Data":"372549177c4113b336f00bad35ad4176409adac22d868180f47a53d7795e9b25"} Mar 16 16:47:38 crc kubenswrapper[5120]: I0316 16:47:38.211613 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-kkvsb" event={"ID":"fa2dd400-9a52-4610-b9db-83f796bab4a6","Type":"ContainerStarted","Data":"c07aa7e8d1988beda9258884d81290d335ab07784ae2dded293d4b70a0311e06"} Mar 16 16:47:38 crc kubenswrapper[5120]: I0316 16:47:38.232733 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-scheduler-0" podStartSLOduration=3.232713409 podStartE2EDuration="3.232713409s" podCreationTimestamp="2026-03-16 16:47:35 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:47:38.215712857 +0000 UTC m=+4560.369644524" watchObservedRunningTime="2026-03-16 16:47:38.232713409 +0000 UTC m=+4560.386645066" Mar 16 16:47:38 crc kubenswrapper[5120]: I0316 16:47:38.254957 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=3.254933744 podStartE2EDuration="3.254933744s" podCreationTimestamp="2026-03-16 16:47:35 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:47:38.241943481 +0000 UTC m=+4560.395875168" watchObservedRunningTime="2026-03-16 16:47:38.254933744 +0000 UTC m=+4560.408865401" Mar 16 16:47:38 crc kubenswrapper[5120]: I0316 16:47:38.738593 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:47:38 crc kubenswrapper[5120]: I0316 16:47:38.739458 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="fd7587f4-1e7b-4a93-a267-203d419ed999" containerName="ceilometer-central-agent" containerID="cri-o://02eafcd624c33d278f9a1bf4ea63735086abd29b4a9707025b785fa9f22810e1" gracePeriod=30 Mar 16 16:47:38 crc kubenswrapper[5120]: I0316 16:47:38.739833 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="fd7587f4-1e7b-4a93-a267-203d419ed999" containerName="proxy-httpd" containerID="cri-o://d1205b79a32c596cfc4f7d09f803d9f32a0917ea81be923d0a7683363b040c85" gracePeriod=30 Mar 16 16:47:38 crc kubenswrapper[5120]: I0316 16:47:38.739919 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="fd7587f4-1e7b-4a93-a267-203d419ed999" containerName="sg-core" containerID="cri-o://f06693c4c47b1ddac7feedd75f38ef41eab337b71e37e8169cc2f5f54575f500" gracePeriod=30 Mar 16 16:47:38 crc kubenswrapper[5120]: I0316 16:47:38.739969 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="fd7587f4-1e7b-4a93-a267-203d419ed999" containerName="ceilometer-notification-agent" containerID="cri-o://7ffb3b3875a09a74132c992ec36db29e3fa1fc30b5cb6e7425f6925fc993b4e0" gracePeriod=30 Mar 16 16:47:39 crc kubenswrapper[5120]: I0316 16:47:39.225913 5120 generic.go:358] "Generic (PLEG): container finished" podID="fd7587f4-1e7b-4a93-a267-203d419ed999" containerID="d1205b79a32c596cfc4f7d09f803d9f32a0917ea81be923d0a7683363b040c85" exitCode=0 Mar 16 16:47:39 crc kubenswrapper[5120]: I0316 16:47:39.225943 5120 generic.go:358] "Generic (PLEG): container finished" podID="fd7587f4-1e7b-4a93-a267-203d419ed999" containerID="f06693c4c47b1ddac7feedd75f38ef41eab337b71e37e8169cc2f5f54575f500" exitCode=2 Mar 16 16:47:39 crc kubenswrapper[5120]: I0316 16:47:39.225950 5120 generic.go:358] "Generic (PLEG): container finished" podID="fd7587f4-1e7b-4a93-a267-203d419ed999" containerID="02eafcd624c33d278f9a1bf4ea63735086abd29b4a9707025b785fa9f22810e1" exitCode=0 Mar 16 16:47:39 crc kubenswrapper[5120]: I0316 16:47:39.226213 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"fd7587f4-1e7b-4a93-a267-203d419ed999","Type":"ContainerDied","Data":"d1205b79a32c596cfc4f7d09f803d9f32a0917ea81be923d0a7683363b040c85"} Mar 16 16:47:39 crc kubenswrapper[5120]: I0316 16:47:39.226240 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"fd7587f4-1e7b-4a93-a267-203d419ed999","Type":"ContainerDied","Data":"f06693c4c47b1ddac7feedd75f38ef41eab337b71e37e8169cc2f5f54575f500"} Mar 16 16:47:39 crc kubenswrapper[5120]: I0316 16:47:39.226250 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"fd7587f4-1e7b-4a93-a267-203d419ed999","Type":"ContainerDied","Data":"02eafcd624c33d278f9a1bf4ea63735086abd29b4a9707025b785fa9f22810e1"} Mar 16 16:47:39 crc kubenswrapper[5120]: I0316 16:47:39.228264 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-kkvsb" event={"ID":"fa2dd400-9a52-4610-b9db-83f796bab4a6","Type":"ContainerStarted","Data":"4f5b8eb8ad5405e72b5100c937572a066ecca0841f65b758f88635db29ceb2a5"} Mar 16 16:47:39 crc kubenswrapper[5120]: I0316 16:47:39.248526 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-kkvsb" podStartSLOduration=2.248506273 podStartE2EDuration="2.248506273s" podCreationTimestamp="2026-03-16 16:47:37 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:47:39.245051908 +0000 UTC m=+4561.398983565" watchObservedRunningTime="2026-03-16 16:47:39.248506273 +0000 UTC m=+4561.402437930" Mar 16 16:47:39 crc kubenswrapper[5120]: I0316 16:47:39.410684 5120 scope.go:117] "RemoveContainer" containerID="55f9dbd289925ebb596ea54b408e443def1aead1817f034dd6ea070167e77aca" Mar 16 16:47:39 crc kubenswrapper[5120]: I0316 16:47:39.433607 5120 scope.go:117] "RemoveContainer" containerID="b4d629c90a77b40b3994b6e3ddb2a08d2727fc55e70e1c041f6c46ca86939a90" Mar 16 16:47:39 crc kubenswrapper[5120]: I0316 16:47:39.479738 5120 scope.go:117] "RemoveContainer" containerID="9a4a8fd4f39a6b85b0ff44030c92f4491969f088a2ccfda2072a7d8c4937c89a" Mar 16 16:47:39 crc kubenswrapper[5120]: I0316 16:47:39.610428 5120 scope.go:117] "RemoveContainer" containerID="fbb614ab9d99809725c904658acafddfbc9f74f0dc462732da0498f6f5eba626" Mar 16 16:47:39 crc kubenswrapper[5120]: I0316 16:47:39.691150 5120 scope.go:117] "RemoveContainer" containerID="882f88cce34c8ad0be4f79d5d1b957d5dc1916e0debeb5c24a920fdb99b85c10" Mar 16 16:47:39 crc kubenswrapper[5120]: I0316 16:47:39.774526 5120 scope.go:117] "RemoveContainer" containerID="12d08efec8a746d4f7be40b469e8dce666fcd5acfa2921f815dab63846d95a88" Mar 16 16:47:39 crc kubenswrapper[5120]: I0316 16:47:39.861984 5120 scope.go:117] "RemoveContainer" containerID="a290e42d33aa4dd54212c995dd819c044c219b591caf4d3bcff2b1ba5beb03c6" Mar 16 16:47:39 crc kubenswrapper[5120]: I0316 16:47:39.940904 5120 scope.go:117] "RemoveContainer" containerID="bb27e3403a0599425fb7f61691a53c6f295064572efb98c7cf63b85c8dd7a556" Mar 16 16:47:40 crc kubenswrapper[5120]: E0316 16:47:40.000999 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of ff1237f483556a49b6a2de39573f3752394dfe2800e0d6ee605557d2f81a85f1 is running failed: container process not found" containerID="ff1237f483556a49b6a2de39573f3752394dfe2800e0d6ee605557d2f81a85f1" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:47:40 crc kubenswrapper[5120]: E0316 16:47:40.001666 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of ff1237f483556a49b6a2de39573f3752394dfe2800e0d6ee605557d2f81a85f1 is running failed: container process not found" containerID="ff1237f483556a49b6a2de39573f3752394dfe2800e0d6ee605557d2f81a85f1" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:47:40 crc kubenswrapper[5120]: E0316 16:47:40.002144 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of ff1237f483556a49b6a2de39573f3752394dfe2800e0d6ee605557d2f81a85f1 is running failed: container process not found" containerID="ff1237f483556a49b6a2de39573f3752394dfe2800e0d6ee605557d2f81a85f1" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:47:40 crc kubenswrapper[5120]: E0316 16:47:40.002180 5120 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of ff1237f483556a49b6a2de39573f3752394dfe2800e0d6ee605557d2f81a85f1 is running failed: container process not found" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="e664c968-423f-4657-9165-c50d4c890aa1" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 16:47:40 crc kubenswrapper[5120]: I0316 16:47:40.141113 5120 scope.go:117] "RemoveContainer" containerID="937fa6da786caa9dcb484ba184476895b4b12d7842037a069491ecd2fd930ae0" Mar 16 16:47:40 crc kubenswrapper[5120]: I0316 16:47:40.179589 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:47:40 crc kubenswrapper[5120]: I0316 16:47:40.255170 5120 generic.go:358] "Generic (PLEG): container finished" podID="e664c968-423f-4657-9165-c50d4c890aa1" containerID="ff1237f483556a49b6a2de39573f3752394dfe2800e0d6ee605557d2f81a85f1" exitCode=0 Mar 16 16:47:40 crc kubenswrapper[5120]: I0316 16:47:40.255384 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:47:40 crc kubenswrapper[5120]: I0316 16:47:40.255659 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"e664c968-423f-4657-9165-c50d4c890aa1","Type":"ContainerDied","Data":"ff1237f483556a49b6a2de39573f3752394dfe2800e0d6ee605557d2f81a85f1"} Mar 16 16:47:40 crc kubenswrapper[5120]: I0316 16:47:40.255704 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"e664c968-423f-4657-9165-c50d4c890aa1","Type":"ContainerDied","Data":"97655399632d2ea41a62b2d29605f526f8918780a818e1426f3a52cd966af789"} Mar 16 16:47:40 crc kubenswrapper[5120]: I0316 16:47:40.255725 5120 scope.go:117] "RemoveContainer" containerID="ff1237f483556a49b6a2de39573f3752394dfe2800e0d6ee605557d2f81a85f1" Mar 16 16:47:40 crc kubenswrapper[5120]: I0316 16:47:40.285906 5120 generic.go:358] "Generic (PLEG): container finished" podID="fd7587f4-1e7b-4a93-a267-203d419ed999" containerID="7ffb3b3875a09a74132c992ec36db29e3fa1fc30b5cb6e7425f6925fc993b4e0" exitCode=0 Mar 16 16:47:40 crc kubenswrapper[5120]: I0316 16:47:40.286268 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"fd7587f4-1e7b-4a93-a267-203d419ed999","Type":"ContainerDied","Data":"7ffb3b3875a09a74132c992ec36db29e3fa1fc30b5cb6e7425f6925fc993b4e0"} Mar 16 16:47:40 crc kubenswrapper[5120]: I0316 16:47:40.302285 5120 scope.go:117] "RemoveContainer" containerID="ff1237f483556a49b6a2de39573f3752394dfe2800e0d6ee605557d2f81a85f1" Mar 16 16:47:40 crc kubenswrapper[5120]: E0316 16:47:40.303257 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ff1237f483556a49b6a2de39573f3752394dfe2800e0d6ee605557d2f81a85f1\": container with ID starting with ff1237f483556a49b6a2de39573f3752394dfe2800e0d6ee605557d2f81a85f1 not found: ID does not exist" containerID="ff1237f483556a49b6a2de39573f3752394dfe2800e0d6ee605557d2f81a85f1" Mar 16 16:47:40 crc kubenswrapper[5120]: I0316 16:47:40.303293 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff1237f483556a49b6a2de39573f3752394dfe2800e0d6ee605557d2f81a85f1"} err="failed to get container status \"ff1237f483556a49b6a2de39573f3752394dfe2800e0d6ee605557d2f81a85f1\": rpc error: code = NotFound desc = could not find container \"ff1237f483556a49b6a2de39573f3752394dfe2800e0d6ee605557d2f81a85f1\": container with ID starting with ff1237f483556a49b6a2de39573f3752394dfe2800e0d6ee605557d2f81a85f1 not found: ID does not exist" Mar 16 16:47:40 crc kubenswrapper[5120]: I0316 16:47:40.342985 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7fq4w\" (UniqueName: \"kubernetes.io/projected/e664c968-423f-4657-9165-c50d4c890aa1-kube-api-access-7fq4w\") pod \"e664c968-423f-4657-9165-c50d4c890aa1\" (UID: \"e664c968-423f-4657-9165-c50d4c890aa1\") " Mar 16 16:47:40 crc kubenswrapper[5120]: I0316 16:47:40.343167 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e664c968-423f-4657-9165-c50d4c890aa1-config-data\") pod \"e664c968-423f-4657-9165-c50d4c890aa1\" (UID: \"e664c968-423f-4657-9165-c50d4c890aa1\") " Mar 16 16:47:40 crc kubenswrapper[5120]: I0316 16:47:40.343304 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e664c968-423f-4657-9165-c50d4c890aa1-combined-ca-bundle\") pod \"e664c968-423f-4657-9165-c50d4c890aa1\" (UID: \"e664c968-423f-4657-9165-c50d4c890aa1\") " Mar 16 16:47:40 crc kubenswrapper[5120]: I0316 16:47:40.354328 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e664c968-423f-4657-9165-c50d4c890aa1-kube-api-access-7fq4w" (OuterVolumeSpecName: "kube-api-access-7fq4w") pod "e664c968-423f-4657-9165-c50d4c890aa1" (UID: "e664c968-423f-4657-9165-c50d4c890aa1"). InnerVolumeSpecName "kube-api-access-7fq4w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:47:40 crc kubenswrapper[5120]: I0316 16:47:40.381970 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e664c968-423f-4657-9165-c50d4c890aa1-config-data" (OuterVolumeSpecName: "config-data") pod "e664c968-423f-4657-9165-c50d4c890aa1" (UID: "e664c968-423f-4657-9165-c50d4c890aa1"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:47:40 crc kubenswrapper[5120]: I0316 16:47:40.390893 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e664c968-423f-4657-9165-c50d4c890aa1-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e664c968-423f-4657-9165-c50d4c890aa1" (UID: "e664c968-423f-4657-9165-c50d4c890aa1"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:47:40 crc kubenswrapper[5120]: I0316 16:47:40.410454 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:47:40 crc kubenswrapper[5120]: I0316 16:47:40.445767 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7fq4w\" (UniqueName: \"kubernetes.io/projected/e664c968-423f-4657-9165-c50d4c890aa1-kube-api-access-7fq4w\") on node \"crc\" DevicePath \"\"" Mar 16 16:47:40 crc kubenswrapper[5120]: I0316 16:47:40.445799 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e664c968-423f-4657-9165-c50d4c890aa1-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:47:40 crc kubenswrapper[5120]: I0316 16:47:40.445809 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e664c968-423f-4657-9165-c50d4c890aa1-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:47:40 crc kubenswrapper[5120]: I0316 16:47:40.547394 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/fd7587f4-1e7b-4a93-a267-203d419ed999-scripts\") pod \"fd7587f4-1e7b-4a93-a267-203d419ed999\" (UID: \"fd7587f4-1e7b-4a93-a267-203d419ed999\") " Mar 16 16:47:40 crc kubenswrapper[5120]: I0316 16:47:40.547867 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/fd7587f4-1e7b-4a93-a267-203d419ed999-log-httpd\") pod \"fd7587f4-1e7b-4a93-a267-203d419ed999\" (UID: \"fd7587f4-1e7b-4a93-a267-203d419ed999\") " Mar 16 16:47:40 crc kubenswrapper[5120]: I0316 16:47:40.547904 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/fd7587f4-1e7b-4a93-a267-203d419ed999-run-httpd\") pod \"fd7587f4-1e7b-4a93-a267-203d419ed999\" (UID: \"fd7587f4-1e7b-4a93-a267-203d419ed999\") " Mar 16 16:47:40 crc kubenswrapper[5120]: I0316 16:47:40.548220 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/fd7587f4-1e7b-4a93-a267-203d419ed999-sg-core-conf-yaml\") pod \"fd7587f4-1e7b-4a93-a267-203d419ed999\" (UID: \"fd7587f4-1e7b-4a93-a267-203d419ed999\") " Mar 16 16:47:40 crc kubenswrapper[5120]: I0316 16:47:40.548479 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j72hh\" (UniqueName: \"kubernetes.io/projected/fd7587f4-1e7b-4a93-a267-203d419ed999-kube-api-access-j72hh\") pod \"fd7587f4-1e7b-4a93-a267-203d419ed999\" (UID: \"fd7587f4-1e7b-4a93-a267-203d419ed999\") " Mar 16 16:47:40 crc kubenswrapper[5120]: I0316 16:47:40.548569 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fd7587f4-1e7b-4a93-a267-203d419ed999-config-data\") pod \"fd7587f4-1e7b-4a93-a267-203d419ed999\" (UID: \"fd7587f4-1e7b-4a93-a267-203d419ed999\") " Mar 16 16:47:40 crc kubenswrapper[5120]: I0316 16:47:40.548622 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fd7587f4-1e7b-4a93-a267-203d419ed999-combined-ca-bundle\") pod \"fd7587f4-1e7b-4a93-a267-203d419ed999\" (UID: \"fd7587f4-1e7b-4a93-a267-203d419ed999\") " Mar 16 16:47:40 crc kubenswrapper[5120]: I0316 16:47:40.548611 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd7587f4-1e7b-4a93-a267-203d419ed999-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "fd7587f4-1e7b-4a93-a267-203d419ed999" (UID: "fd7587f4-1e7b-4a93-a267-203d419ed999"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:47:40 crc kubenswrapper[5120]: I0316 16:47:40.548630 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd7587f4-1e7b-4a93-a267-203d419ed999-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "fd7587f4-1e7b-4a93-a267-203d419ed999" (UID: "fd7587f4-1e7b-4a93-a267-203d419ed999"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:47:40 crc kubenswrapper[5120]: I0316 16:47:40.549564 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/fd7587f4-1e7b-4a93-a267-203d419ed999-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:47:40 crc kubenswrapper[5120]: I0316 16:47:40.549587 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/fd7587f4-1e7b-4a93-a267-203d419ed999-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:47:40 crc kubenswrapper[5120]: I0316 16:47:40.552269 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fd7587f4-1e7b-4a93-a267-203d419ed999-scripts" (OuterVolumeSpecName: "scripts") pod "fd7587f4-1e7b-4a93-a267-203d419ed999" (UID: "fd7587f4-1e7b-4a93-a267-203d419ed999"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:47:40 crc kubenswrapper[5120]: I0316 16:47:40.553387 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd7587f4-1e7b-4a93-a267-203d419ed999-kube-api-access-j72hh" (OuterVolumeSpecName: "kube-api-access-j72hh") pod "fd7587f4-1e7b-4a93-a267-203d419ed999" (UID: "fd7587f4-1e7b-4a93-a267-203d419ed999"). InnerVolumeSpecName "kube-api-access-j72hh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:47:40 crc kubenswrapper[5120]: I0316 16:47:40.590505 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fd7587f4-1e7b-4a93-a267-203d419ed999-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "fd7587f4-1e7b-4a93-a267-203d419ed999" (UID: "fd7587f4-1e7b-4a93-a267-203d419ed999"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:47:40 crc kubenswrapper[5120]: I0316 16:47:40.612442 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:47:40 crc kubenswrapper[5120]: I0316 16:47:40.623983 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:47:40 crc kubenswrapper[5120]: I0316 16:47:40.634859 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:47:40 crc kubenswrapper[5120]: I0316 16:47:40.636333 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd7587f4-1e7b-4a93-a267-203d419ed999" containerName="proxy-httpd" Mar 16 16:47:40 crc kubenswrapper[5120]: I0316 16:47:40.636362 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd7587f4-1e7b-4a93-a267-203d419ed999" containerName="proxy-httpd" Mar 16 16:47:40 crc kubenswrapper[5120]: I0316 16:47:40.636385 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd7587f4-1e7b-4a93-a267-203d419ed999" containerName="ceilometer-notification-agent" Mar 16 16:47:40 crc kubenswrapper[5120]: I0316 16:47:40.636394 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd7587f4-1e7b-4a93-a267-203d419ed999" containerName="ceilometer-notification-agent" Mar 16 16:47:40 crc kubenswrapper[5120]: I0316 16:47:40.636432 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd7587f4-1e7b-4a93-a267-203d419ed999" containerName="sg-core" Mar 16 16:47:40 crc kubenswrapper[5120]: I0316 16:47:40.636439 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd7587f4-1e7b-4a93-a267-203d419ed999" containerName="sg-core" Mar 16 16:47:40 crc kubenswrapper[5120]: I0316 16:47:40.636650 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e664c968-423f-4657-9165-c50d4c890aa1" containerName="nova-cell0-conductor-conductor" Mar 16 16:47:40 crc kubenswrapper[5120]: I0316 16:47:40.636657 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e664c968-423f-4657-9165-c50d4c890aa1" containerName="nova-cell0-conductor-conductor" Mar 16 16:47:40 crc kubenswrapper[5120]: I0316 16:47:40.636691 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd7587f4-1e7b-4a93-a267-203d419ed999" containerName="ceilometer-central-agent" Mar 16 16:47:40 crc kubenswrapper[5120]: I0316 16:47:40.636698 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd7587f4-1e7b-4a93-a267-203d419ed999" containerName="ceilometer-central-agent" Mar 16 16:47:40 crc kubenswrapper[5120]: I0316 16:47:40.636951 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="fd7587f4-1e7b-4a93-a267-203d419ed999" containerName="sg-core" Mar 16 16:47:40 crc kubenswrapper[5120]: I0316 16:47:40.636968 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="fd7587f4-1e7b-4a93-a267-203d419ed999" containerName="ceilometer-central-agent" Mar 16 16:47:40 crc kubenswrapper[5120]: I0316 16:47:40.636982 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="fd7587f4-1e7b-4a93-a267-203d419ed999" containerName="proxy-httpd" Mar 16 16:47:40 crc kubenswrapper[5120]: I0316 16:47:40.636995 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="fd7587f4-1e7b-4a93-a267-203d419ed999" containerName="ceilometer-notification-agent" Mar 16 16:47:40 crc kubenswrapper[5120]: I0316 16:47:40.637004 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e664c968-423f-4657-9165-c50d4c890aa1" containerName="nova-cell0-conductor-conductor" Mar 16 16:47:40 crc kubenswrapper[5120]: I0316 16:47:40.655385 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j72hh\" (UniqueName: \"kubernetes.io/projected/fd7587f4-1e7b-4a93-a267-203d419ed999-kube-api-access-j72hh\") on node \"crc\" DevicePath \"\"" Mar 16 16:47:40 crc kubenswrapper[5120]: I0316 16:47:40.655430 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/fd7587f4-1e7b-4a93-a267-203d419ed999-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:47:40 crc kubenswrapper[5120]: I0316 16:47:40.655447 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/fd7587f4-1e7b-4a93-a267-203d419ed999-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 16:47:40 crc kubenswrapper[5120]: I0316 16:47:40.663827 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:47:40 crc kubenswrapper[5120]: I0316 16:47:40.671117 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:47:40 crc kubenswrapper[5120]: I0316 16:47:40.675163 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-conductor-config-data\"" Mar 16 16:47:40 crc kubenswrapper[5120]: I0316 16:47:40.679641 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fd7587f4-1e7b-4a93-a267-203d419ed999-config-data" (OuterVolumeSpecName: "config-data") pod "fd7587f4-1e7b-4a93-a267-203d419ed999" (UID: "fd7587f4-1e7b-4a93-a267-203d419ed999"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:47:40 crc kubenswrapper[5120]: I0316 16:47:40.682183 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e664c968-423f-4657-9165-c50d4c890aa1" path="/var/lib/kubelet/pods/e664c968-423f-4657-9165-c50d4c890aa1/volumes" Mar 16 16:47:40 crc kubenswrapper[5120]: I0316 16:47:40.696738 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fd7587f4-1e7b-4a93-a267-203d419ed999-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "fd7587f4-1e7b-4a93-a267-203d419ed999" (UID: "fd7587f4-1e7b-4a93-a267-203d419ed999"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:47:40 crc kubenswrapper[5120]: I0316 16:47:40.757317 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7g6cq\" (UniqueName: \"kubernetes.io/projected/f3277ed1-d61b-491c-b6dc-1964a1422ea9-kube-api-access-7g6cq\") pod \"nova-cell0-conductor-0\" (UID: \"f3277ed1-d61b-491c-b6dc-1964a1422ea9\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:47:40 crc kubenswrapper[5120]: I0316 16:47:40.757494 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f3277ed1-d61b-491c-b6dc-1964a1422ea9-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"f3277ed1-d61b-491c-b6dc-1964a1422ea9\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:47:40 crc kubenswrapper[5120]: I0316 16:47:40.758207 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f3277ed1-d61b-491c-b6dc-1964a1422ea9-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"f3277ed1-d61b-491c-b6dc-1964a1422ea9\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:47:40 crc kubenswrapper[5120]: I0316 16:47:40.758416 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fd7587f4-1e7b-4a93-a267-203d419ed999-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:47:40 crc kubenswrapper[5120]: I0316 16:47:40.758433 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fd7587f4-1e7b-4a93-a267-203d419ed999-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:47:40 crc kubenswrapper[5120]: I0316 16:47:40.860879 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f3277ed1-d61b-491c-b6dc-1964a1422ea9-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"f3277ed1-d61b-491c-b6dc-1964a1422ea9\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:47:40 crc kubenswrapper[5120]: I0316 16:47:40.860957 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7g6cq\" (UniqueName: \"kubernetes.io/projected/f3277ed1-d61b-491c-b6dc-1964a1422ea9-kube-api-access-7g6cq\") pod \"nova-cell0-conductor-0\" (UID: \"f3277ed1-d61b-491c-b6dc-1964a1422ea9\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:47:40 crc kubenswrapper[5120]: I0316 16:47:40.861033 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f3277ed1-d61b-491c-b6dc-1964a1422ea9-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"f3277ed1-d61b-491c-b6dc-1964a1422ea9\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:47:40 crc kubenswrapper[5120]: I0316 16:47:40.865613 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f3277ed1-d61b-491c-b6dc-1964a1422ea9-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"f3277ed1-d61b-491c-b6dc-1964a1422ea9\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:47:40 crc kubenswrapper[5120]: I0316 16:47:40.867210 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f3277ed1-d61b-491c-b6dc-1964a1422ea9-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"f3277ed1-d61b-491c-b6dc-1964a1422ea9\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:47:40 crc kubenswrapper[5120]: I0316 16:47:40.880526 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7g6cq\" (UniqueName: \"kubernetes.io/projected/f3277ed1-d61b-491c-b6dc-1964a1422ea9-kube-api-access-7g6cq\") pod \"nova-cell0-conductor-0\" (UID: \"f3277ed1-d61b-491c-b6dc-1964a1422ea9\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:47:41 crc kubenswrapper[5120]: I0316 16:47:41.002675 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:47:41 crc kubenswrapper[5120]: I0316 16:47:41.211403 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:47:41 crc kubenswrapper[5120]: I0316 16:47:41.341156 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"fd7587f4-1e7b-4a93-a267-203d419ed999","Type":"ContainerDied","Data":"98c313a6466a41557d8367390fbc2829ed07b4a1d247b6e0d2f40008179ad130"} Mar 16 16:47:41 crc kubenswrapper[5120]: I0316 16:47:41.341227 5120 scope.go:117] "RemoveContainer" containerID="d1205b79a32c596cfc4f7d09f803d9f32a0917ea81be923d0a7683363b040c85" Mar 16 16:47:41 crc kubenswrapper[5120]: I0316 16:47:41.341252 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:47:41 crc kubenswrapper[5120]: I0316 16:47:41.385466 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:47:41 crc kubenswrapper[5120]: I0316 16:47:41.392789 5120 scope.go:117] "RemoveContainer" containerID="f06693c4c47b1ddac7feedd75f38ef41eab337b71e37e8169cc2f5f54575f500" Mar 16 16:47:41 crc kubenswrapper[5120]: I0316 16:47:41.400365 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:47:41 crc kubenswrapper[5120]: I0316 16:47:41.413701 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:47:41 crc kubenswrapper[5120]: I0316 16:47:41.435420 5120 scope.go:117] "RemoveContainer" containerID="7ffb3b3875a09a74132c992ec36db29e3fa1fc30b5cb6e7425f6925fc993b4e0" Mar 16 16:47:41 crc kubenswrapper[5120]: I0316 16:47:41.435860 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:47:41 crc kubenswrapper[5120]: I0316 16:47:41.435995 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:47:41 crc kubenswrapper[5120]: I0316 16:47:41.437963 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 16:47:41 crc kubenswrapper[5120]: I0316 16:47:41.438035 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 16:47:41 crc kubenswrapper[5120]: I0316 16:47:41.478204 5120 scope.go:117] "RemoveContainer" containerID="02eafcd624c33d278f9a1bf4ea63735086abd29b4a9707025b785fa9f22810e1" Mar 16 16:47:41 crc kubenswrapper[5120]: I0316 16:47:41.482145 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:47:41 crc kubenswrapper[5120]: I0316 16:47:41.508675 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:47:41 crc kubenswrapper[5120]: W0316 16:47:41.514336 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf3277ed1_d61b_491c_b6dc_1964a1422ea9.slice/crio-6bf44295eb9a2acfe3d045f946a7ad32c7dd8daaf097fac7c9d48ada61d2a628 WatchSource:0}: Error finding container 6bf44295eb9a2acfe3d045f946a7ad32c7dd8daaf097fac7c9d48ada61d2a628: Status 404 returned error can't find the container with id 6bf44295eb9a2acfe3d045f946a7ad32c7dd8daaf097fac7c9d48ada61d2a628 Mar 16 16:47:41 crc kubenswrapper[5120]: I0316 16:47:41.587887 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/97af92e8-708d-43e1-a696-09a0add1eeff-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"97af92e8-708d-43e1-a696-09a0add1eeff\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:47:41 crc kubenswrapper[5120]: I0316 16:47:41.588024 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/97af92e8-708d-43e1-a696-09a0add1eeff-log-httpd\") pod \"ceilometer-0\" (UID: \"97af92e8-708d-43e1-a696-09a0add1eeff\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:47:41 crc kubenswrapper[5120]: I0316 16:47:41.588446 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmfq4\" (UniqueName: \"kubernetes.io/projected/97af92e8-708d-43e1-a696-09a0add1eeff-kube-api-access-fmfq4\") pod \"ceilometer-0\" (UID: \"97af92e8-708d-43e1-a696-09a0add1eeff\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:47:41 crc kubenswrapper[5120]: I0316 16:47:41.589151 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/97af92e8-708d-43e1-a696-09a0add1eeff-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"97af92e8-708d-43e1-a696-09a0add1eeff\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:47:41 crc kubenswrapper[5120]: I0316 16:47:41.589219 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/97af92e8-708d-43e1-a696-09a0add1eeff-run-httpd\") pod \"ceilometer-0\" (UID: \"97af92e8-708d-43e1-a696-09a0add1eeff\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:47:41 crc kubenswrapper[5120]: I0316 16:47:41.589258 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/97af92e8-708d-43e1-a696-09a0add1eeff-scripts\") pod \"ceilometer-0\" (UID: \"97af92e8-708d-43e1-a696-09a0add1eeff\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:47:41 crc kubenswrapper[5120]: I0316 16:47:41.589310 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/97af92e8-708d-43e1-a696-09a0add1eeff-config-data\") pod \"ceilometer-0\" (UID: \"97af92e8-708d-43e1-a696-09a0add1eeff\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:47:41 crc kubenswrapper[5120]: I0316 16:47:41.691003 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/97af92e8-708d-43e1-a696-09a0add1eeff-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"97af92e8-708d-43e1-a696-09a0add1eeff\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:47:41 crc kubenswrapper[5120]: I0316 16:47:41.691077 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/97af92e8-708d-43e1-a696-09a0add1eeff-run-httpd\") pod \"ceilometer-0\" (UID: \"97af92e8-708d-43e1-a696-09a0add1eeff\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:47:41 crc kubenswrapper[5120]: I0316 16:47:41.691123 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/97af92e8-708d-43e1-a696-09a0add1eeff-scripts\") pod \"ceilometer-0\" (UID: \"97af92e8-708d-43e1-a696-09a0add1eeff\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:47:41 crc kubenswrapper[5120]: I0316 16:47:41.691154 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/97af92e8-708d-43e1-a696-09a0add1eeff-config-data\") pod \"ceilometer-0\" (UID: \"97af92e8-708d-43e1-a696-09a0add1eeff\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:47:41 crc kubenswrapper[5120]: I0316 16:47:41.691287 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/97af92e8-708d-43e1-a696-09a0add1eeff-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"97af92e8-708d-43e1-a696-09a0add1eeff\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:47:41 crc kubenswrapper[5120]: I0316 16:47:41.691369 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/97af92e8-708d-43e1-a696-09a0add1eeff-log-httpd\") pod \"ceilometer-0\" (UID: \"97af92e8-708d-43e1-a696-09a0add1eeff\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:47:41 crc kubenswrapper[5120]: I0316 16:47:41.691454 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fmfq4\" (UniqueName: \"kubernetes.io/projected/97af92e8-708d-43e1-a696-09a0add1eeff-kube-api-access-fmfq4\") pod \"ceilometer-0\" (UID: \"97af92e8-708d-43e1-a696-09a0add1eeff\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:47:41 crc kubenswrapper[5120]: I0316 16:47:41.691821 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/97af92e8-708d-43e1-a696-09a0add1eeff-run-httpd\") pod \"ceilometer-0\" (UID: \"97af92e8-708d-43e1-a696-09a0add1eeff\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:47:41 crc kubenswrapper[5120]: I0316 16:47:41.693638 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/97af92e8-708d-43e1-a696-09a0add1eeff-log-httpd\") pod \"ceilometer-0\" (UID: \"97af92e8-708d-43e1-a696-09a0add1eeff\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:47:41 crc kubenswrapper[5120]: I0316 16:47:41.695338 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/97af92e8-708d-43e1-a696-09a0add1eeff-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"97af92e8-708d-43e1-a696-09a0add1eeff\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:47:41 crc kubenswrapper[5120]: I0316 16:47:41.695895 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/97af92e8-708d-43e1-a696-09a0add1eeff-scripts\") pod \"ceilometer-0\" (UID: \"97af92e8-708d-43e1-a696-09a0add1eeff\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:47:41 crc kubenswrapper[5120]: I0316 16:47:41.696360 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/97af92e8-708d-43e1-a696-09a0add1eeff-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"97af92e8-708d-43e1-a696-09a0add1eeff\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:47:41 crc kubenswrapper[5120]: I0316 16:47:41.697954 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/97af92e8-708d-43e1-a696-09a0add1eeff-config-data\") pod \"ceilometer-0\" (UID: \"97af92e8-708d-43e1-a696-09a0add1eeff\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:47:41 crc kubenswrapper[5120]: I0316 16:47:41.716473 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmfq4\" (UniqueName: \"kubernetes.io/projected/97af92e8-708d-43e1-a696-09a0add1eeff-kube-api-access-fmfq4\") pod \"ceilometer-0\" (UID: \"97af92e8-708d-43e1-a696-09a0add1eeff\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:47:41 crc kubenswrapper[5120]: I0316 16:47:41.758465 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:47:42 crc kubenswrapper[5120]: I0316 16:47:42.313891 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:47:42 crc kubenswrapper[5120]: I0316 16:47:42.356971 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"97af92e8-708d-43e1-a696-09a0add1eeff","Type":"ContainerStarted","Data":"e657b22e8fe8c1a6eb71a2699c7a02232ac853bc27b666ad9a460eb7d2668261"} Mar 16 16:47:42 crc kubenswrapper[5120]: I0316 16:47:42.360675 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"f3277ed1-d61b-491c-b6dc-1964a1422ea9","Type":"ContainerStarted","Data":"0133a2cd785424001989a4b5c72950fd6eb0e3bedabf2dd40ea720d83389adb9"} Mar 16 16:47:42 crc kubenswrapper[5120]: I0316 16:47:42.360729 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"f3277ed1-d61b-491c-b6dc-1964a1422ea9","Type":"ContainerStarted","Data":"6bf44295eb9a2acfe3d045f946a7ad32c7dd8daaf097fac7c9d48ada61d2a628"} Mar 16 16:47:42 crc kubenswrapper[5120]: I0316 16:47:42.361562 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:47:42 crc kubenswrapper[5120]: I0316 16:47:42.387562 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podStartSLOduration=2.387543705 podStartE2EDuration="2.387543705s" podCreationTimestamp="2026-03-16 16:47:40 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:47:42.383391922 +0000 UTC m=+4564.537323599" watchObservedRunningTime="2026-03-16 16:47:42.387543705 +0000 UTC m=+4564.541475362" Mar 16 16:47:42 crc kubenswrapper[5120]: I0316 16:47:42.664231 5120 scope.go:117] "RemoveContainer" containerID="35a7dd6e19084cee69ca16203bca6378ea0cdf6a685ca2093ab847e5904eb9e6" Mar 16 16:47:42 crc kubenswrapper[5120]: E0316 16:47:42.664732 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:47:42 crc kubenswrapper[5120]: I0316 16:47:42.676558 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd7587f4-1e7b-4a93-a267-203d419ed999" path="/var/lib/kubelet/pods/fd7587f4-1e7b-4a93-a267-203d419ed999/volumes" Mar 16 16:47:43 crc kubenswrapper[5120]: I0316 16:47:43.376155 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"97af92e8-708d-43e1-a696-09a0add1eeff","Type":"ContainerStarted","Data":"9d31d22d4ad32959dd0f3ad5a676d5bc90321a3c94e9c784124bf26f6f9761f5"} Mar 16 16:47:45 crc kubenswrapper[5120]: I0316 16:47:45.399080 5120 generic.go:358] "Generic (PLEG): container finished" podID="fa2dd400-9a52-4610-b9db-83f796bab4a6" containerID="4f5b8eb8ad5405e72b5100c937572a066ecca0841f65b758f88635db29ceb2a5" exitCode=0 Mar 16 16:47:45 crc kubenswrapper[5120]: I0316 16:47:45.399155 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-kkvsb" event={"ID":"fa2dd400-9a52-4610-b9db-83f796bab4a6","Type":"ContainerDied","Data":"4f5b8eb8ad5405e72b5100c937572a066ecca0841f65b758f88635db29ceb2a5"} Mar 16 16:47:45 crc kubenswrapper[5120]: I0316 16:47:45.408478 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"97af92e8-708d-43e1-a696-09a0add1eeff","Type":"ContainerStarted","Data":"aabeb8e05002f153b244132f42cd668f06d7a4f6f0c05e8d34fb494dca4b0b6c"} Mar 16 16:47:45 crc kubenswrapper[5120]: I0316 16:47:45.414443 5120 generic.go:358] "Generic (PLEG): container finished" podID="580e419d-0472-485f-b809-5a610832d21f" containerID="b56b840eff04c2ab9a162f3cdec5eebed9702876d18bf834243ab5cb9ff66aaa" exitCode=0 Mar 16 16:47:45 crc kubenswrapper[5120]: I0316 16:47:45.414903 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-6qwtb" event={"ID":"580e419d-0472-485f-b809-5a610832d21f","Type":"ContainerDied","Data":"b56b840eff04c2ab9a162f3cdec5eebed9702876d18bf834243ab5cb9ff66aaa"} Mar 16 16:47:46 crc kubenswrapper[5120]: I0316 16:47:46.211751 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:47:46 crc kubenswrapper[5120]: I0316 16:47:46.223691 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:47:46 crc kubenswrapper[5120]: I0316 16:47:46.223746 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:47:46 crc kubenswrapper[5120]: I0316 16:47:46.239582 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:47:46 crc kubenswrapper[5120]: I0316 16:47:46.437407 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"97af92e8-708d-43e1-a696-09a0add1eeff","Type":"ContainerStarted","Data":"8a6fdfa8d205b11bcdadd5e12986b78f02788776ed316b85307b7596b793804f"} Mar 16 16:47:46 crc kubenswrapper[5120]: I0316 16:47:46.458120 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:47:46 crc kubenswrapper[5120]: I0316 16:47:46.458167 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:47:46 crc kubenswrapper[5120]: I0316 16:47:46.478881 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:47:46 crc kubenswrapper[5120]: I0316 16:47:46.482212 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:47:46 crc kubenswrapper[5120]: I0316 16:47:46.507952 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:47:46 crc kubenswrapper[5120]: I0316 16:47:46.992098 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-6qwtb" Mar 16 16:47:47 crc kubenswrapper[5120]: I0316 16:47:47.013840 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-kkvsb" Mar 16 16:47:47 crc kubenswrapper[5120]: I0316 16:47:47.155144 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6gnc6\" (UniqueName: \"kubernetes.io/projected/580e419d-0472-485f-b809-5a610832d21f-kube-api-access-6gnc6\") pod \"580e419d-0472-485f-b809-5a610832d21f\" (UID: \"580e419d-0472-485f-b809-5a610832d21f\") " Mar 16 16:47:47 crc kubenswrapper[5120]: I0316 16:47:47.155498 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fa2dd400-9a52-4610-b9db-83f796bab4a6-config-data\") pod \"fa2dd400-9a52-4610-b9db-83f796bab4a6\" (UID: \"fa2dd400-9a52-4610-b9db-83f796bab4a6\") " Mar 16 16:47:47 crc kubenswrapper[5120]: I0316 16:47:47.155617 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/580e419d-0472-485f-b809-5a610832d21f-scripts\") pod \"580e419d-0472-485f-b809-5a610832d21f\" (UID: \"580e419d-0472-485f-b809-5a610832d21f\") " Mar 16 16:47:47 crc kubenswrapper[5120]: I0316 16:47:47.155690 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/fa2dd400-9a52-4610-b9db-83f796bab4a6-scripts\") pod \"fa2dd400-9a52-4610-b9db-83f796bab4a6\" (UID: \"fa2dd400-9a52-4610-b9db-83f796bab4a6\") " Mar 16 16:47:47 crc kubenswrapper[5120]: I0316 16:47:47.155816 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fa2dd400-9a52-4610-b9db-83f796bab4a6-combined-ca-bundle\") pod \"fa2dd400-9a52-4610-b9db-83f796bab4a6\" (UID: \"fa2dd400-9a52-4610-b9db-83f796bab4a6\") " Mar 16 16:47:47 crc kubenswrapper[5120]: I0316 16:47:47.155957 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j2889\" (UniqueName: \"kubernetes.io/projected/fa2dd400-9a52-4610-b9db-83f796bab4a6-kube-api-access-j2889\") pod \"fa2dd400-9a52-4610-b9db-83f796bab4a6\" (UID: \"fa2dd400-9a52-4610-b9db-83f796bab4a6\") " Mar 16 16:47:47 crc kubenswrapper[5120]: I0316 16:47:47.156179 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/580e419d-0472-485f-b809-5a610832d21f-combined-ca-bundle\") pod \"580e419d-0472-485f-b809-5a610832d21f\" (UID: \"580e419d-0472-485f-b809-5a610832d21f\") " Mar 16 16:47:47 crc kubenswrapper[5120]: I0316 16:47:47.156248 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/580e419d-0472-485f-b809-5a610832d21f-config-data\") pod \"580e419d-0472-485f-b809-5a610832d21f\" (UID: \"580e419d-0472-485f-b809-5a610832d21f\") " Mar 16 16:47:47 crc kubenswrapper[5120]: I0316 16:47:47.160558 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa2dd400-9a52-4610-b9db-83f796bab4a6-scripts" (OuterVolumeSpecName: "scripts") pod "fa2dd400-9a52-4610-b9db-83f796bab4a6" (UID: "fa2dd400-9a52-4610-b9db-83f796bab4a6"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:47:47 crc kubenswrapper[5120]: I0316 16:47:47.161231 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa2dd400-9a52-4610-b9db-83f796bab4a6-kube-api-access-j2889" (OuterVolumeSpecName: "kube-api-access-j2889") pod "fa2dd400-9a52-4610-b9db-83f796bab4a6" (UID: "fa2dd400-9a52-4610-b9db-83f796bab4a6"). InnerVolumeSpecName "kube-api-access-j2889". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:47:47 crc kubenswrapper[5120]: I0316 16:47:47.162904 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/580e419d-0472-485f-b809-5a610832d21f-scripts" (OuterVolumeSpecName: "scripts") pod "580e419d-0472-485f-b809-5a610832d21f" (UID: "580e419d-0472-485f-b809-5a610832d21f"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:47:47 crc kubenswrapper[5120]: I0316 16:47:47.162977 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/580e419d-0472-485f-b809-5a610832d21f-kube-api-access-6gnc6" (OuterVolumeSpecName: "kube-api-access-6gnc6") pod "580e419d-0472-485f-b809-5a610832d21f" (UID: "580e419d-0472-485f-b809-5a610832d21f"). InnerVolumeSpecName "kube-api-access-6gnc6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:47:47 crc kubenswrapper[5120]: I0316 16:47:47.195231 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa2dd400-9a52-4610-b9db-83f796bab4a6-config-data" (OuterVolumeSpecName: "config-data") pod "fa2dd400-9a52-4610-b9db-83f796bab4a6" (UID: "fa2dd400-9a52-4610-b9db-83f796bab4a6"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:47:47 crc kubenswrapper[5120]: I0316 16:47:47.200285 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa2dd400-9a52-4610-b9db-83f796bab4a6-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "fa2dd400-9a52-4610-b9db-83f796bab4a6" (UID: "fa2dd400-9a52-4610-b9db-83f796bab4a6"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:47:47 crc kubenswrapper[5120]: I0316 16:47:47.203688 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/580e419d-0472-485f-b809-5a610832d21f-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "580e419d-0472-485f-b809-5a610832d21f" (UID: "580e419d-0472-485f-b809-5a610832d21f"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:47:47 crc kubenswrapper[5120]: I0316 16:47:47.219182 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/580e419d-0472-485f-b809-5a610832d21f-config-data" (OuterVolumeSpecName: "config-data") pod "580e419d-0472-485f-b809-5a610832d21f" (UID: "580e419d-0472-485f-b809-5a610832d21f"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:47:47 crc kubenswrapper[5120]: I0316 16:47:47.259332 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fa2dd400-9a52-4610-b9db-83f796bab4a6-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:47:47 crc kubenswrapper[5120]: I0316 16:47:47.259365 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j2889\" (UniqueName: \"kubernetes.io/projected/fa2dd400-9a52-4610-b9db-83f796bab4a6-kube-api-access-j2889\") on node \"crc\" DevicePath \"\"" Mar 16 16:47:47 crc kubenswrapper[5120]: I0316 16:47:47.259378 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/580e419d-0472-485f-b809-5a610832d21f-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:47:47 crc kubenswrapper[5120]: I0316 16:47:47.259386 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/580e419d-0472-485f-b809-5a610832d21f-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:47:47 crc kubenswrapper[5120]: I0316 16:47:47.259396 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6gnc6\" (UniqueName: \"kubernetes.io/projected/580e419d-0472-485f-b809-5a610832d21f-kube-api-access-6gnc6\") on node \"crc\" DevicePath \"\"" Mar 16 16:47:47 crc kubenswrapper[5120]: I0316 16:47:47.259404 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fa2dd400-9a52-4610-b9db-83f796bab4a6-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:47:47 crc kubenswrapper[5120]: I0316 16:47:47.259412 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/580e419d-0472-485f-b809-5a610832d21f-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:47:47 crc kubenswrapper[5120]: I0316 16:47:47.259421 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/fa2dd400-9a52-4610-b9db-83f796bab4a6-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:47:47 crc kubenswrapper[5120]: I0316 16:47:47.265359 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="ffb58abe-0995-4f67-a71e-1a30dd9a53a9" containerName="nova-api-log" probeResult="failure" output="Get \"http://10.217.1.195:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 16:47:47 crc kubenswrapper[5120]: I0316 16:47:47.265412 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="ffb58abe-0995-4f67-a71e-1a30dd9a53a9" containerName="nova-api-api" probeResult="failure" output="Get \"http://10.217.1.195:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 16:47:47 crc kubenswrapper[5120]: I0316 16:47:47.465176 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-kkvsb" Mar 16 16:47:47 crc kubenswrapper[5120]: I0316 16:47:47.465197 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-kkvsb" event={"ID":"fa2dd400-9a52-4610-b9db-83f796bab4a6","Type":"ContainerDied","Data":"c07aa7e8d1988beda9258884d81290d335ab07784ae2dded293d4b70a0311e06"} Mar 16 16:47:47 crc kubenswrapper[5120]: I0316 16:47:47.465255 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c07aa7e8d1988beda9258884d81290d335ab07784ae2dded293d4b70a0311e06" Mar 16 16:47:47 crc kubenswrapper[5120]: I0316 16:47:47.469532 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"97af92e8-708d-43e1-a696-09a0add1eeff","Type":"ContainerStarted","Data":"3f3a7f32e25242218c3c35e2f06d8a5ac1293e8ab957875e4d641bceb15b40e3"} Mar 16 16:47:47 crc kubenswrapper[5120]: I0316 16:47:47.469964 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:47:47 crc kubenswrapper[5120]: I0316 16:47:47.473261 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-6qwtb" Mar 16 16:47:47 crc kubenswrapper[5120]: I0316 16:47:47.474033 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-6qwtb" event={"ID":"580e419d-0472-485f-b809-5a610832d21f","Type":"ContainerDied","Data":"01cde18bf8dc9a87c37fbab56f352b27f74d6f3e81269ecc5f10d42230c3e3a1"} Mar 16 16:47:47 crc kubenswrapper[5120]: I0316 16:47:47.474109 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="01cde18bf8dc9a87c37fbab56f352b27f74d6f3e81269ecc5f10d42230c3e3a1" Mar 16 16:47:47 crc kubenswrapper[5120]: I0316 16:47:47.499956 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="efc34cca-3f74-4fbb-a4f1-e058be54acc3" containerName="nova-metadata-log" probeResult="failure" output="Get \"http://10.217.1.196:8775/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 16:47:47 crc kubenswrapper[5120]: I0316 16:47:47.500509 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="efc34cca-3f74-4fbb-a4f1-e058be54acc3" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"http://10.217.1.196:8775/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 16:47:47 crc kubenswrapper[5120]: I0316 16:47:47.514076 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=1.838504242 podStartE2EDuration="6.514053022s" podCreationTimestamp="2026-03-16 16:47:41 +0000 UTC" firstStartedPulling="2026-03-16 16:47:42.321352004 +0000 UTC m=+4564.475283661" lastFinishedPulling="2026-03-16 16:47:46.996900784 +0000 UTC m=+4569.150832441" observedRunningTime="2026-03-16 16:47:47.493896234 +0000 UTC m=+4569.647827891" watchObservedRunningTime="2026-03-16 16:47:47.514053022 +0000 UTC m=+4569.667984689" Mar 16 16:47:47 crc kubenswrapper[5120]: I0316 16:47:47.533121 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 16:47:47 crc kubenswrapper[5120]: I0316 16:47:47.534710 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="580e419d-0472-485f-b809-5a610832d21f" containerName="nova-manage" Mar 16 16:47:47 crc kubenswrapper[5120]: I0316 16:47:47.534740 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="580e419d-0472-485f-b809-5a610832d21f" containerName="nova-manage" Mar 16 16:47:47 crc kubenswrapper[5120]: I0316 16:47:47.534808 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa2dd400-9a52-4610-b9db-83f796bab4a6" containerName="nova-cell1-conductor-db-sync" Mar 16 16:47:47 crc kubenswrapper[5120]: I0316 16:47:47.534819 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa2dd400-9a52-4610-b9db-83f796bab4a6" containerName="nova-cell1-conductor-db-sync" Mar 16 16:47:47 crc kubenswrapper[5120]: I0316 16:47:47.535034 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="fa2dd400-9a52-4610-b9db-83f796bab4a6" containerName="nova-cell1-conductor-db-sync" Mar 16 16:47:47 crc kubenswrapper[5120]: I0316 16:47:47.535051 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="580e419d-0472-485f-b809-5a610832d21f" containerName="nova-manage" Mar 16 16:47:47 crc kubenswrapper[5120]: I0316 16:47:47.575401 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:47:47 crc kubenswrapper[5120]: I0316 16:47:47.575524 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:47:47 crc kubenswrapper[5120]: I0316 16:47:47.575740 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 16:47:47 crc kubenswrapper[5120]: I0316 16:47:47.579075 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-conductor-config-data\"" Mar 16 16:47:47 crc kubenswrapper[5120]: I0316 16:47:47.670861 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7nzcc\" (UniqueName: \"kubernetes.io/projected/e93e7d0f-2924-48c0-bc57-3a9597f83d70-kube-api-access-7nzcc\") pod \"nova-cell1-conductor-0\" (UID: \"e93e7d0f-2924-48c0-bc57-3a9597f83d70\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:47:47 crc kubenswrapper[5120]: I0316 16:47:47.671209 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e93e7d0f-2924-48c0-bc57-3a9597f83d70-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"e93e7d0f-2924-48c0-bc57-3a9597f83d70\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:47:47 crc kubenswrapper[5120]: I0316 16:47:47.671325 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e93e7d0f-2924-48c0-bc57-3a9597f83d70-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"e93e7d0f-2924-48c0-bc57-3a9597f83d70\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:47:47 crc kubenswrapper[5120]: I0316 16:47:47.772727 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7nzcc\" (UniqueName: \"kubernetes.io/projected/e93e7d0f-2924-48c0-bc57-3a9597f83d70-kube-api-access-7nzcc\") pod \"nova-cell1-conductor-0\" (UID: \"e93e7d0f-2924-48c0-bc57-3a9597f83d70\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:47:47 crc kubenswrapper[5120]: I0316 16:47:47.772790 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e93e7d0f-2924-48c0-bc57-3a9597f83d70-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"e93e7d0f-2924-48c0-bc57-3a9597f83d70\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:47:47 crc kubenswrapper[5120]: I0316 16:47:47.772946 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e93e7d0f-2924-48c0-bc57-3a9597f83d70-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"e93e7d0f-2924-48c0-bc57-3a9597f83d70\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:47:47 crc kubenswrapper[5120]: I0316 16:47:47.778917 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e93e7d0f-2924-48c0-bc57-3a9597f83d70-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"e93e7d0f-2924-48c0-bc57-3a9597f83d70\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:47:47 crc kubenswrapper[5120]: I0316 16:47:47.779555 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e93e7d0f-2924-48c0-bc57-3a9597f83d70-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"e93e7d0f-2924-48c0-bc57-3a9597f83d70\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:47:47 crc kubenswrapper[5120]: I0316 16:47:47.791111 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7nzcc\" (UniqueName: \"kubernetes.io/projected/e93e7d0f-2924-48c0-bc57-3a9597f83d70-kube-api-access-7nzcc\") pod \"nova-cell1-conductor-0\" (UID: \"e93e7d0f-2924-48c0-bc57-3a9597f83d70\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:47:47 crc kubenswrapper[5120]: I0316 16:47:47.895255 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:47:48 crc kubenswrapper[5120]: I0316 16:47:48.413964 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:47:48 crc kubenswrapper[5120]: I0316 16:47:48.419018 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 16:47:48 crc kubenswrapper[5120]: I0316 16:47:48.485896 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"e93e7d0f-2924-48c0-bc57-3a9597f83d70","Type":"ContainerStarted","Data":"8155440509b03817b69d7556f9abfce3189fa875d3a900c0a8221c4e13fe8b90"} Mar 16 16:47:48 crc kubenswrapper[5120]: I0316 16:47:48.876839 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:47:48 crc kubenswrapper[5120]: I0316 16:47:48.877292 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="ffb58abe-0995-4f67-a71e-1a30dd9a53a9" containerName="nova-api-api" containerID="cri-o://dbb3d0badb5a54cc37ad2919d646bde9b1985fca256eab9bb00a3edd74bb997b" gracePeriod=30 Mar 16 16:47:48 crc kubenswrapper[5120]: I0316 16:47:48.877500 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="ffb58abe-0995-4f67-a71e-1a30dd9a53a9" containerName="nova-api-log" containerID="cri-o://2c3e1e2693c070919563ab14ce53a0c720ffd295a65909c1f35aedc1c4f54aca" gracePeriod=30 Mar 16 16:47:48 crc kubenswrapper[5120]: I0316 16:47:48.892885 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:47:48 crc kubenswrapper[5120]: I0316 16:47:48.893129 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="1272c05f-07f3-4206-ad8f-50db9f288160" containerName="nova-scheduler-scheduler" containerID="cri-o://98a95690a367a9d47eb6a2f83e9e51d4a7f4ddd8db7381a156aa0628f61af42a" gracePeriod=30 Mar 16 16:47:48 crc kubenswrapper[5120]: I0316 16:47:48.918755 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:47:48 crc kubenswrapper[5120]: I0316 16:47:48.919219 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="efc34cca-3f74-4fbb-a4f1-e058be54acc3" containerName="nova-metadata-log" containerID="cri-o://372549177c4113b336f00bad35ad4176409adac22d868180f47a53d7795e9b25" gracePeriod=30 Mar 16 16:47:48 crc kubenswrapper[5120]: I0316 16:47:48.919392 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="efc34cca-3f74-4fbb-a4f1-e058be54acc3" containerName="nova-metadata-metadata" containerID="cri-o://9774a490e427b07efec3e6172a6590aa16e8a4591618ab0a2aabf66a6561a5cf" gracePeriod=30 Mar 16 16:47:49 crc kubenswrapper[5120]: I0316 16:47:49.500783 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"e93e7d0f-2924-48c0-bc57-3a9597f83d70","Type":"ContainerStarted","Data":"731ac2f25a5505892d3ba2b5085eb8ac263c0111abf4d7334a1812bbc50579a5"} Mar 16 16:47:49 crc kubenswrapper[5120]: I0316 16:47:49.502321 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:47:49 crc kubenswrapper[5120]: I0316 16:47:49.504337 5120 generic.go:358] "Generic (PLEG): container finished" podID="ffb58abe-0995-4f67-a71e-1a30dd9a53a9" containerID="2c3e1e2693c070919563ab14ce53a0c720ffd295a65909c1f35aedc1c4f54aca" exitCode=143 Mar 16 16:47:49 crc kubenswrapper[5120]: I0316 16:47:49.504661 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"ffb58abe-0995-4f67-a71e-1a30dd9a53a9","Type":"ContainerDied","Data":"2c3e1e2693c070919563ab14ce53a0c720ffd295a65909c1f35aedc1c4f54aca"} Mar 16 16:47:49 crc kubenswrapper[5120]: I0316 16:47:49.508661 5120 generic.go:358] "Generic (PLEG): container finished" podID="efc34cca-3f74-4fbb-a4f1-e058be54acc3" containerID="372549177c4113b336f00bad35ad4176409adac22d868180f47a53d7795e9b25" exitCode=143 Mar 16 16:47:49 crc kubenswrapper[5120]: I0316 16:47:49.508755 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"efc34cca-3f74-4fbb-a4f1-e058be54acc3","Type":"ContainerDied","Data":"372549177c4113b336f00bad35ad4176409adac22d868180f47a53d7795e9b25"} Mar 16 16:47:49 crc kubenswrapper[5120]: I0316 16:47:49.527814 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podStartSLOduration=2.527756201 podStartE2EDuration="2.527756201s" podCreationTimestamp="2026-03-16 16:47:47 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:47:49.520690689 +0000 UTC m=+4571.674622356" watchObservedRunningTime="2026-03-16 16:47:49.527756201 +0000 UTC m=+4571.681687858" Mar 16 16:47:51 crc kubenswrapper[5120]: E0316 16:47:51.441254 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="98a95690a367a9d47eb6a2f83e9e51d4a7f4ddd8db7381a156aa0628f61af42a" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:47:51 crc kubenswrapper[5120]: E0316 16:47:51.444342 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="98a95690a367a9d47eb6a2f83e9e51d4a7f4ddd8db7381a156aa0628f61af42a" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:47:51 crc kubenswrapper[5120]: E0316 16:47:51.445815 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="98a95690a367a9d47eb6a2f83e9e51d4a7f4ddd8db7381a156aa0628f61af42a" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:47:51 crc kubenswrapper[5120]: E0316 16:47:51.445854 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="1272c05f-07f3-4206-ad8f-50db9f288160" containerName="nova-scheduler-scheduler" probeResult="unknown" Mar 16 16:47:52 crc kubenswrapper[5120]: I0316 16:47:52.546144 5120 generic.go:358] "Generic (PLEG): container finished" podID="efc34cca-3f74-4fbb-a4f1-e058be54acc3" containerID="9774a490e427b07efec3e6172a6590aa16e8a4591618ab0a2aabf66a6561a5cf" exitCode=0 Mar 16 16:47:52 crc kubenswrapper[5120]: I0316 16:47:52.546216 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"efc34cca-3f74-4fbb-a4f1-e058be54acc3","Type":"ContainerDied","Data":"9774a490e427b07efec3e6172a6590aa16e8a4591618ab0a2aabf66a6561a5cf"} Mar 16 16:47:52 crc kubenswrapper[5120]: I0316 16:47:52.546717 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"efc34cca-3f74-4fbb-a4f1-e058be54acc3","Type":"ContainerDied","Data":"e25b042c77353d33ecdf454f81a5a61264aa2d3cb0be4ec4271c4a1c90154ff8"} Mar 16 16:47:52 crc kubenswrapper[5120]: I0316 16:47:52.546728 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e25b042c77353d33ecdf454f81a5a61264aa2d3cb0be4ec4271c4a1c90154ff8" Mar 16 16:47:52 crc kubenswrapper[5120]: I0316 16:47:52.606234 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:47:52 crc kubenswrapper[5120]: I0316 16:47:52.694895 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/efc34cca-3f74-4fbb-a4f1-e058be54acc3-config-data\") pod \"efc34cca-3f74-4fbb-a4f1-e058be54acc3\" (UID: \"efc34cca-3f74-4fbb-a4f1-e058be54acc3\") " Mar 16 16:47:52 crc kubenswrapper[5120]: I0316 16:47:52.695017 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/efc34cca-3f74-4fbb-a4f1-e058be54acc3-combined-ca-bundle\") pod \"efc34cca-3f74-4fbb-a4f1-e058be54acc3\" (UID: \"efc34cca-3f74-4fbb-a4f1-e058be54acc3\") " Mar 16 16:47:52 crc kubenswrapper[5120]: I0316 16:47:52.695121 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/efc34cca-3f74-4fbb-a4f1-e058be54acc3-logs\") pod \"efc34cca-3f74-4fbb-a4f1-e058be54acc3\" (UID: \"efc34cca-3f74-4fbb-a4f1-e058be54acc3\") " Mar 16 16:47:52 crc kubenswrapper[5120]: I0316 16:47:52.695215 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n2z5x\" (UniqueName: \"kubernetes.io/projected/efc34cca-3f74-4fbb-a4f1-e058be54acc3-kube-api-access-n2z5x\") pod \"efc34cca-3f74-4fbb-a4f1-e058be54acc3\" (UID: \"efc34cca-3f74-4fbb-a4f1-e058be54acc3\") " Mar 16 16:47:52 crc kubenswrapper[5120]: I0316 16:47:52.695685 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/efc34cca-3f74-4fbb-a4f1-e058be54acc3-logs" (OuterVolumeSpecName: "logs") pod "efc34cca-3f74-4fbb-a4f1-e058be54acc3" (UID: "efc34cca-3f74-4fbb-a4f1-e058be54acc3"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:47:52 crc kubenswrapper[5120]: I0316 16:47:52.701490 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/efc34cca-3f74-4fbb-a4f1-e058be54acc3-kube-api-access-n2z5x" (OuterVolumeSpecName: "kube-api-access-n2z5x") pod "efc34cca-3f74-4fbb-a4f1-e058be54acc3" (UID: "efc34cca-3f74-4fbb-a4f1-e058be54acc3"). InnerVolumeSpecName "kube-api-access-n2z5x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:47:52 crc kubenswrapper[5120]: I0316 16:47:52.703115 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/efc34cca-3f74-4fbb-a4f1-e058be54acc3-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:47:52 crc kubenswrapper[5120]: I0316 16:47:52.703145 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n2z5x\" (UniqueName: \"kubernetes.io/projected/efc34cca-3f74-4fbb-a4f1-e058be54acc3-kube-api-access-n2z5x\") on node \"crc\" DevicePath \"\"" Mar 16 16:47:52 crc kubenswrapper[5120]: I0316 16:47:52.722512 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/efc34cca-3f74-4fbb-a4f1-e058be54acc3-config-data" (OuterVolumeSpecName: "config-data") pod "efc34cca-3f74-4fbb-a4f1-e058be54acc3" (UID: "efc34cca-3f74-4fbb-a4f1-e058be54acc3"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:47:52 crc kubenswrapper[5120]: I0316 16:47:52.726746 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/efc34cca-3f74-4fbb-a4f1-e058be54acc3-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "efc34cca-3f74-4fbb-a4f1-e058be54acc3" (UID: "efc34cca-3f74-4fbb-a4f1-e058be54acc3"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:47:52 crc kubenswrapper[5120]: I0316 16:47:52.805515 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/efc34cca-3f74-4fbb-a4f1-e058be54acc3-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:47:52 crc kubenswrapper[5120]: I0316 16:47:52.805555 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/efc34cca-3f74-4fbb-a4f1-e058be54acc3-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:47:53 crc kubenswrapper[5120]: I0316 16:47:53.558938 5120 generic.go:358] "Generic (PLEG): container finished" podID="ffb58abe-0995-4f67-a71e-1a30dd9a53a9" containerID="dbb3d0badb5a54cc37ad2919d646bde9b1985fca256eab9bb00a3edd74bb997b" exitCode=0 Mar 16 16:47:53 crc kubenswrapper[5120]: I0316 16:47:53.559122 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"ffb58abe-0995-4f67-a71e-1a30dd9a53a9","Type":"ContainerDied","Data":"dbb3d0badb5a54cc37ad2919d646bde9b1985fca256eab9bb00a3edd74bb997b"} Mar 16 16:47:53 crc kubenswrapper[5120]: I0316 16:47:53.559737 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:47:53 crc kubenswrapper[5120]: I0316 16:47:53.760740 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:47:53 crc kubenswrapper[5120]: I0316 16:47:53.772616 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:47:53 crc kubenswrapper[5120]: I0316 16:47:53.796174 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:47:53 crc kubenswrapper[5120]: I0316 16:47:53.810964 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:47:53 crc kubenswrapper[5120]: I0316 16:47:53.813099 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ffb58abe-0995-4f67-a71e-1a30dd9a53a9" containerName="nova-api-api" Mar 16 16:47:53 crc kubenswrapper[5120]: I0316 16:47:53.813127 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ffb58abe-0995-4f67-a71e-1a30dd9a53a9" containerName="nova-api-api" Mar 16 16:47:53 crc kubenswrapper[5120]: I0316 16:47:53.813146 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ffb58abe-0995-4f67-a71e-1a30dd9a53a9" containerName="nova-api-log" Mar 16 16:47:53 crc kubenswrapper[5120]: I0316 16:47:53.813153 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ffb58abe-0995-4f67-a71e-1a30dd9a53a9" containerName="nova-api-log" Mar 16 16:47:53 crc kubenswrapper[5120]: I0316 16:47:53.813176 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efc34cca-3f74-4fbb-a4f1-e058be54acc3" containerName="nova-metadata-metadata" Mar 16 16:47:53 crc kubenswrapper[5120]: I0316 16:47:53.813184 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="efc34cca-3f74-4fbb-a4f1-e058be54acc3" containerName="nova-metadata-metadata" Mar 16 16:47:53 crc kubenswrapper[5120]: I0316 16:47:53.813198 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efc34cca-3f74-4fbb-a4f1-e058be54acc3" containerName="nova-metadata-log" Mar 16 16:47:53 crc kubenswrapper[5120]: I0316 16:47:53.813206 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="efc34cca-3f74-4fbb-a4f1-e058be54acc3" containerName="nova-metadata-log" Mar 16 16:47:53 crc kubenswrapper[5120]: I0316 16:47:53.813457 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="efc34cca-3f74-4fbb-a4f1-e058be54acc3" containerName="nova-metadata-metadata" Mar 16 16:47:53 crc kubenswrapper[5120]: I0316 16:47:53.813476 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ffb58abe-0995-4f67-a71e-1a30dd9a53a9" containerName="nova-api-log" Mar 16 16:47:53 crc kubenswrapper[5120]: I0316 16:47:53.813490 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="efc34cca-3f74-4fbb-a4f1-e058be54acc3" containerName="nova-metadata-log" Mar 16 16:47:53 crc kubenswrapper[5120]: I0316 16:47:53.813502 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ffb58abe-0995-4f67-a71e-1a30dd9a53a9" containerName="nova-api-api" Mar 16 16:47:53 crc kubenswrapper[5120]: I0316 16:47:53.823579 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:47:53 crc kubenswrapper[5120]: I0316 16:47:53.827666 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ffb58abe-0995-4f67-a71e-1a30dd9a53a9-logs\") pod \"ffb58abe-0995-4f67-a71e-1a30dd9a53a9\" (UID: \"ffb58abe-0995-4f67-a71e-1a30dd9a53a9\") " Mar 16 16:47:53 crc kubenswrapper[5120]: I0316 16:47:53.827929 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ffb58abe-0995-4f67-a71e-1a30dd9a53a9-combined-ca-bundle\") pod \"ffb58abe-0995-4f67-a71e-1a30dd9a53a9\" (UID: \"ffb58abe-0995-4f67-a71e-1a30dd9a53a9\") " Mar 16 16:47:53 crc kubenswrapper[5120]: I0316 16:47:53.828306 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ffb58abe-0995-4f67-a71e-1a30dd9a53a9-config-data\") pod \"ffb58abe-0995-4f67-a71e-1a30dd9a53a9\" (UID: \"ffb58abe-0995-4f67-a71e-1a30dd9a53a9\") " Mar 16 16:47:53 crc kubenswrapper[5120]: I0316 16:47:53.828543 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f5d5z\" (UniqueName: \"kubernetes.io/projected/ffb58abe-0995-4f67-a71e-1a30dd9a53a9-kube-api-access-f5d5z\") pod \"ffb58abe-0995-4f67-a71e-1a30dd9a53a9\" (UID: \"ffb58abe-0995-4f67-a71e-1a30dd9a53a9\") " Mar 16 16:47:53 crc kubenswrapper[5120]: I0316 16:47:53.830847 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ffb58abe-0995-4f67-a71e-1a30dd9a53a9-logs" (OuterVolumeSpecName: "logs") pod "ffb58abe-0995-4f67-a71e-1a30dd9a53a9" (UID: "ffb58abe-0995-4f67-a71e-1a30dd9a53a9"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:47:53 crc kubenswrapper[5120]: I0316 16:47:53.833627 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-metadata-config-data\"" Mar 16 16:47:53 crc kubenswrapper[5120]: I0316 16:47:53.835494 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:47:53 crc kubenswrapper[5120]: I0316 16:47:53.854607 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ffb58abe-0995-4f67-a71e-1a30dd9a53a9-kube-api-access-f5d5z" (OuterVolumeSpecName: "kube-api-access-f5d5z") pod "ffb58abe-0995-4f67-a71e-1a30dd9a53a9" (UID: "ffb58abe-0995-4f67-a71e-1a30dd9a53a9"). InnerVolumeSpecName "kube-api-access-f5d5z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:47:53 crc kubenswrapper[5120]: I0316 16:47:53.875018 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ffb58abe-0995-4f67-a71e-1a30dd9a53a9-config-data" (OuterVolumeSpecName: "config-data") pod "ffb58abe-0995-4f67-a71e-1a30dd9a53a9" (UID: "ffb58abe-0995-4f67-a71e-1a30dd9a53a9"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:47:53 crc kubenswrapper[5120]: I0316 16:47:53.879316 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ffb58abe-0995-4f67-a71e-1a30dd9a53a9-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ffb58abe-0995-4f67-a71e-1a30dd9a53a9" (UID: "ffb58abe-0995-4f67-a71e-1a30dd9a53a9"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:47:53 crc kubenswrapper[5120]: I0316 16:47:53.931386 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f3a3bb6d-7c8a-4d71-8e0c-0643dfeaf22a-logs\") pod \"nova-metadata-0\" (UID: \"f3a3bb6d-7c8a-4d71-8e0c-0643dfeaf22a\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:47:53 crc kubenswrapper[5120]: I0316 16:47:53.932020 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f3a3bb6d-7c8a-4d71-8e0c-0643dfeaf22a-config-data\") pod \"nova-metadata-0\" (UID: \"f3a3bb6d-7c8a-4d71-8e0c-0643dfeaf22a\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:47:53 crc kubenswrapper[5120]: I0316 16:47:53.932057 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvgtj\" (UniqueName: \"kubernetes.io/projected/f3a3bb6d-7c8a-4d71-8e0c-0643dfeaf22a-kube-api-access-zvgtj\") pod \"nova-metadata-0\" (UID: \"f3a3bb6d-7c8a-4d71-8e0c-0643dfeaf22a\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:47:53 crc kubenswrapper[5120]: I0316 16:47:53.932130 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f3a3bb6d-7c8a-4d71-8e0c-0643dfeaf22a-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"f3a3bb6d-7c8a-4d71-8e0c-0643dfeaf22a\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:47:53 crc kubenswrapper[5120]: I0316 16:47:53.932476 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ffb58abe-0995-4f67-a71e-1a30dd9a53a9-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:47:53 crc kubenswrapper[5120]: I0316 16:47:53.932489 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ffb58abe-0995-4f67-a71e-1a30dd9a53a9-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:47:53 crc kubenswrapper[5120]: I0316 16:47:53.932502 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f5d5z\" (UniqueName: \"kubernetes.io/projected/ffb58abe-0995-4f67-a71e-1a30dd9a53a9-kube-api-access-f5d5z\") on node \"crc\" DevicePath \"\"" Mar 16 16:47:53 crc kubenswrapper[5120]: I0316 16:47:53.932514 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ffb58abe-0995-4f67-a71e-1a30dd9a53a9-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:47:53 crc kubenswrapper[5120]: I0316 16:47:53.933158 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:47:54 crc kubenswrapper[5120]: I0316 16:47:54.033997 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wps9p\" (UniqueName: \"kubernetes.io/projected/1272c05f-07f3-4206-ad8f-50db9f288160-kube-api-access-wps9p\") pod \"1272c05f-07f3-4206-ad8f-50db9f288160\" (UID: \"1272c05f-07f3-4206-ad8f-50db9f288160\") " Mar 16 16:47:54 crc kubenswrapper[5120]: I0316 16:47:54.034334 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1272c05f-07f3-4206-ad8f-50db9f288160-combined-ca-bundle\") pod \"1272c05f-07f3-4206-ad8f-50db9f288160\" (UID: \"1272c05f-07f3-4206-ad8f-50db9f288160\") " Mar 16 16:47:54 crc kubenswrapper[5120]: I0316 16:47:54.034575 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1272c05f-07f3-4206-ad8f-50db9f288160-config-data\") pod \"1272c05f-07f3-4206-ad8f-50db9f288160\" (UID: \"1272c05f-07f3-4206-ad8f-50db9f288160\") " Mar 16 16:47:54 crc kubenswrapper[5120]: I0316 16:47:54.035025 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f3a3bb6d-7c8a-4d71-8e0c-0643dfeaf22a-logs\") pod \"nova-metadata-0\" (UID: \"f3a3bb6d-7c8a-4d71-8e0c-0643dfeaf22a\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:47:54 crc kubenswrapper[5120]: I0316 16:47:54.035149 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f3a3bb6d-7c8a-4d71-8e0c-0643dfeaf22a-config-data\") pod \"nova-metadata-0\" (UID: \"f3a3bb6d-7c8a-4d71-8e0c-0643dfeaf22a\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:47:54 crc kubenswrapper[5120]: I0316 16:47:54.035185 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zvgtj\" (UniqueName: \"kubernetes.io/projected/f3a3bb6d-7c8a-4d71-8e0c-0643dfeaf22a-kube-api-access-zvgtj\") pod \"nova-metadata-0\" (UID: \"f3a3bb6d-7c8a-4d71-8e0c-0643dfeaf22a\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:47:54 crc kubenswrapper[5120]: I0316 16:47:54.035250 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f3a3bb6d-7c8a-4d71-8e0c-0643dfeaf22a-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"f3a3bb6d-7c8a-4d71-8e0c-0643dfeaf22a\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:47:54 crc kubenswrapper[5120]: I0316 16:47:54.035352 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f3a3bb6d-7c8a-4d71-8e0c-0643dfeaf22a-logs\") pod \"nova-metadata-0\" (UID: \"f3a3bb6d-7c8a-4d71-8e0c-0643dfeaf22a\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:47:54 crc kubenswrapper[5120]: I0316 16:47:54.039209 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f3a3bb6d-7c8a-4d71-8e0c-0643dfeaf22a-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"f3a3bb6d-7c8a-4d71-8e0c-0643dfeaf22a\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:47:54 crc kubenswrapper[5120]: I0316 16:47:54.039799 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f3a3bb6d-7c8a-4d71-8e0c-0643dfeaf22a-config-data\") pod \"nova-metadata-0\" (UID: \"f3a3bb6d-7c8a-4d71-8e0c-0643dfeaf22a\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:47:54 crc kubenswrapper[5120]: I0316 16:47:54.041974 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1272c05f-07f3-4206-ad8f-50db9f288160-kube-api-access-wps9p" (OuterVolumeSpecName: "kube-api-access-wps9p") pod "1272c05f-07f3-4206-ad8f-50db9f288160" (UID: "1272c05f-07f3-4206-ad8f-50db9f288160"). InnerVolumeSpecName "kube-api-access-wps9p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:47:54 crc kubenswrapper[5120]: I0316 16:47:54.053686 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvgtj\" (UniqueName: \"kubernetes.io/projected/f3a3bb6d-7c8a-4d71-8e0c-0643dfeaf22a-kube-api-access-zvgtj\") pod \"nova-metadata-0\" (UID: \"f3a3bb6d-7c8a-4d71-8e0c-0643dfeaf22a\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:47:54 crc kubenswrapper[5120]: I0316 16:47:54.062413 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1272c05f-07f3-4206-ad8f-50db9f288160-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "1272c05f-07f3-4206-ad8f-50db9f288160" (UID: "1272c05f-07f3-4206-ad8f-50db9f288160"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:47:54 crc kubenswrapper[5120]: I0316 16:47:54.063292 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1272c05f-07f3-4206-ad8f-50db9f288160-config-data" (OuterVolumeSpecName: "config-data") pod "1272c05f-07f3-4206-ad8f-50db9f288160" (UID: "1272c05f-07f3-4206-ad8f-50db9f288160"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:47:54 crc kubenswrapper[5120]: I0316 16:47:54.137133 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wps9p\" (UniqueName: \"kubernetes.io/projected/1272c05f-07f3-4206-ad8f-50db9f288160-kube-api-access-wps9p\") on node \"crc\" DevicePath \"\"" Mar 16 16:47:54 crc kubenswrapper[5120]: I0316 16:47:54.137184 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1272c05f-07f3-4206-ad8f-50db9f288160-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:47:54 crc kubenswrapper[5120]: I0316 16:47:54.137194 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1272c05f-07f3-4206-ad8f-50db9f288160-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:47:54 crc kubenswrapper[5120]: I0316 16:47:54.227137 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:47:54 crc kubenswrapper[5120]: I0316 16:47:54.570125 5120 generic.go:358] "Generic (PLEG): container finished" podID="1272c05f-07f3-4206-ad8f-50db9f288160" containerID="98a95690a367a9d47eb6a2f83e9e51d4a7f4ddd8db7381a156aa0628f61af42a" exitCode=0 Mar 16 16:47:54 crc kubenswrapper[5120]: I0316 16:47:54.570177 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"1272c05f-07f3-4206-ad8f-50db9f288160","Type":"ContainerDied","Data":"98a95690a367a9d47eb6a2f83e9e51d4a7f4ddd8db7381a156aa0628f61af42a"} Mar 16 16:47:54 crc kubenswrapper[5120]: I0316 16:47:54.570865 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"1272c05f-07f3-4206-ad8f-50db9f288160","Type":"ContainerDied","Data":"7868e704c293273069e86d6c5114624343696aa8c23af25ef4cbb7f8fa779274"} Mar 16 16:47:54 crc kubenswrapper[5120]: I0316 16:47:54.570884 5120 scope.go:117] "RemoveContainer" containerID="98a95690a367a9d47eb6a2f83e9e51d4a7f4ddd8db7381a156aa0628f61af42a" Mar 16 16:47:54 crc kubenswrapper[5120]: I0316 16:47:54.570216 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:47:54 crc kubenswrapper[5120]: I0316 16:47:54.575008 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"ffb58abe-0995-4f67-a71e-1a30dd9a53a9","Type":"ContainerDied","Data":"8e1ffa892c8a06f33c177867eaad62dbb3bb150473edc890e40b8aa51ef6412d"} Mar 16 16:47:54 crc kubenswrapper[5120]: I0316 16:47:54.575041 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:47:54 crc kubenswrapper[5120]: I0316 16:47:54.609718 5120 scope.go:117] "RemoveContainer" containerID="98a95690a367a9d47eb6a2f83e9e51d4a7f4ddd8db7381a156aa0628f61af42a" Mar 16 16:47:54 crc kubenswrapper[5120]: E0316 16:47:54.610245 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"98a95690a367a9d47eb6a2f83e9e51d4a7f4ddd8db7381a156aa0628f61af42a\": container with ID starting with 98a95690a367a9d47eb6a2f83e9e51d4a7f4ddd8db7381a156aa0628f61af42a not found: ID does not exist" containerID="98a95690a367a9d47eb6a2f83e9e51d4a7f4ddd8db7381a156aa0628f61af42a" Mar 16 16:47:54 crc kubenswrapper[5120]: I0316 16:47:54.610291 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98a95690a367a9d47eb6a2f83e9e51d4a7f4ddd8db7381a156aa0628f61af42a"} err="failed to get container status \"98a95690a367a9d47eb6a2f83e9e51d4a7f4ddd8db7381a156aa0628f61af42a\": rpc error: code = NotFound desc = could not find container \"98a95690a367a9d47eb6a2f83e9e51d4a7f4ddd8db7381a156aa0628f61af42a\": container with ID starting with 98a95690a367a9d47eb6a2f83e9e51d4a7f4ddd8db7381a156aa0628f61af42a not found: ID does not exist" Mar 16 16:47:54 crc kubenswrapper[5120]: I0316 16:47:54.610312 5120 scope.go:117] "RemoveContainer" containerID="dbb3d0badb5a54cc37ad2919d646bde9b1985fca256eab9bb00a3edd74bb997b" Mar 16 16:47:54 crc kubenswrapper[5120]: I0316 16:47:54.644981 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:47:54 crc kubenswrapper[5120]: I0316 16:47:54.665479 5120 scope.go:117] "RemoveContainer" containerID="35a7dd6e19084cee69ca16203bca6378ea0cdf6a685ca2093ab847e5904eb9e6" Mar 16 16:47:54 crc kubenswrapper[5120]: E0316 16:47:54.665960 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:47:54 crc kubenswrapper[5120]: I0316 16:47:54.675963 5120 scope.go:117] "RemoveContainer" containerID="2c3e1e2693c070919563ab14ce53a0c720ffd295a65909c1f35aedc1c4f54aca" Mar 16 16:47:54 crc kubenswrapper[5120]: I0316 16:47:54.704983 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="efc34cca-3f74-4fbb-a4f1-e058be54acc3" path="/var/lib/kubelet/pods/efc34cca-3f74-4fbb-a4f1-e058be54acc3/volumes" Mar 16 16:47:54 crc kubenswrapper[5120]: I0316 16:47:54.706041 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:47:54 crc kubenswrapper[5120]: I0316 16:47:54.706092 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:47:54 crc kubenswrapper[5120]: I0316 16:47:54.707712 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1272c05f-07f3-4206-ad8f-50db9f288160" containerName="nova-scheduler-scheduler" Mar 16 16:47:54 crc kubenswrapper[5120]: I0316 16:47:54.707749 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1272c05f-07f3-4206-ad8f-50db9f288160" containerName="nova-scheduler-scheduler" Mar 16 16:47:54 crc kubenswrapper[5120]: I0316 16:47:54.708077 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1272c05f-07f3-4206-ad8f-50db9f288160" containerName="nova-scheduler-scheduler" Mar 16 16:47:54 crc kubenswrapper[5120]: I0316 16:47:54.724066 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:47:54 crc kubenswrapper[5120]: I0316 16:47:54.724238 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:47:54 crc kubenswrapper[5120]: I0316 16:47:54.725916 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:47:54 crc kubenswrapper[5120]: I0316 16:47:54.731285 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-config-data\"" Mar 16 16:47:54 crc kubenswrapper[5120]: I0316 16:47:54.733852 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:47:54 crc kubenswrapper[5120]: I0316 16:47:54.746529 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:47:54 crc kubenswrapper[5120]: I0316 16:47:54.752157 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:47:54 crc kubenswrapper[5120]: I0316 16:47:54.754393 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-scheduler-config-data\"" Mar 16 16:47:54 crc kubenswrapper[5120]: I0316 16:47:54.757592 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:47:54 crc kubenswrapper[5120]: I0316 16:47:54.771211 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:47:54 crc kubenswrapper[5120]: I0316 16:47:54.886899 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2hqn\" (UniqueName: \"kubernetes.io/projected/3fb21e8a-174a-4469-b1d1-675d191207be-kube-api-access-l2hqn\") pod \"nova-api-0\" (UID: \"3fb21e8a-174a-4469-b1d1-675d191207be\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:47:54 crc kubenswrapper[5120]: I0316 16:47:54.886976 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/12cc9828-99e7-41ff-a791-04bf41f73d04-config-data\") pod \"nova-scheduler-0\" (UID: \"12cc9828-99e7-41ff-a791-04bf41f73d04\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:47:54 crc kubenswrapper[5120]: I0316 16:47:54.887033 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3fb21e8a-174a-4469-b1d1-675d191207be-logs\") pod \"nova-api-0\" (UID: \"3fb21e8a-174a-4469-b1d1-675d191207be\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:47:54 crc kubenswrapper[5120]: I0316 16:47:54.887066 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xl2bn\" (UniqueName: \"kubernetes.io/projected/12cc9828-99e7-41ff-a791-04bf41f73d04-kube-api-access-xl2bn\") pod \"nova-scheduler-0\" (UID: \"12cc9828-99e7-41ff-a791-04bf41f73d04\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:47:54 crc kubenswrapper[5120]: I0316 16:47:54.887085 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3fb21e8a-174a-4469-b1d1-675d191207be-config-data\") pod \"nova-api-0\" (UID: \"3fb21e8a-174a-4469-b1d1-675d191207be\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:47:54 crc kubenswrapper[5120]: I0316 16:47:54.887172 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/12cc9828-99e7-41ff-a791-04bf41f73d04-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"12cc9828-99e7-41ff-a791-04bf41f73d04\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:47:54 crc kubenswrapper[5120]: I0316 16:47:54.887200 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3fb21e8a-174a-4469-b1d1-675d191207be-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"3fb21e8a-174a-4469-b1d1-675d191207be\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:47:54 crc kubenswrapper[5120]: I0316 16:47:54.989805 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l2hqn\" (UniqueName: \"kubernetes.io/projected/3fb21e8a-174a-4469-b1d1-675d191207be-kube-api-access-l2hqn\") pod \"nova-api-0\" (UID: \"3fb21e8a-174a-4469-b1d1-675d191207be\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:47:54 crc kubenswrapper[5120]: I0316 16:47:54.989908 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/12cc9828-99e7-41ff-a791-04bf41f73d04-config-data\") pod \"nova-scheduler-0\" (UID: \"12cc9828-99e7-41ff-a791-04bf41f73d04\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:47:54 crc kubenswrapper[5120]: I0316 16:47:54.989988 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3fb21e8a-174a-4469-b1d1-675d191207be-logs\") pod \"nova-api-0\" (UID: \"3fb21e8a-174a-4469-b1d1-675d191207be\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:47:54 crc kubenswrapper[5120]: I0316 16:47:54.990039 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xl2bn\" (UniqueName: \"kubernetes.io/projected/12cc9828-99e7-41ff-a791-04bf41f73d04-kube-api-access-xl2bn\") pod \"nova-scheduler-0\" (UID: \"12cc9828-99e7-41ff-a791-04bf41f73d04\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:47:54 crc kubenswrapper[5120]: I0316 16:47:54.990128 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3fb21e8a-174a-4469-b1d1-675d191207be-config-data\") pod \"nova-api-0\" (UID: \"3fb21e8a-174a-4469-b1d1-675d191207be\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:47:54 crc kubenswrapper[5120]: I0316 16:47:54.990526 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/12cc9828-99e7-41ff-a791-04bf41f73d04-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"12cc9828-99e7-41ff-a791-04bf41f73d04\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:47:54 crc kubenswrapper[5120]: I0316 16:47:54.990585 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3fb21e8a-174a-4469-b1d1-675d191207be-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"3fb21e8a-174a-4469-b1d1-675d191207be\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:47:54 crc kubenswrapper[5120]: I0316 16:47:54.991151 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3fb21e8a-174a-4469-b1d1-675d191207be-logs\") pod \"nova-api-0\" (UID: \"3fb21e8a-174a-4469-b1d1-675d191207be\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:47:54 crc kubenswrapper[5120]: I0316 16:47:54.994830 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3fb21e8a-174a-4469-b1d1-675d191207be-config-data\") pod \"nova-api-0\" (UID: \"3fb21e8a-174a-4469-b1d1-675d191207be\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:47:54 crc kubenswrapper[5120]: I0316 16:47:54.996693 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3fb21e8a-174a-4469-b1d1-675d191207be-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"3fb21e8a-174a-4469-b1d1-675d191207be\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:47:54 crc kubenswrapper[5120]: I0316 16:47:54.998004 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/12cc9828-99e7-41ff-a791-04bf41f73d04-config-data\") pod \"nova-scheduler-0\" (UID: \"12cc9828-99e7-41ff-a791-04bf41f73d04\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:47:55 crc kubenswrapper[5120]: I0316 16:47:55.005354 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/12cc9828-99e7-41ff-a791-04bf41f73d04-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"12cc9828-99e7-41ff-a791-04bf41f73d04\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:47:55 crc kubenswrapper[5120]: I0316 16:47:55.007740 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2hqn\" (UniqueName: \"kubernetes.io/projected/3fb21e8a-174a-4469-b1d1-675d191207be-kube-api-access-l2hqn\") pod \"nova-api-0\" (UID: \"3fb21e8a-174a-4469-b1d1-675d191207be\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:47:55 crc kubenswrapper[5120]: I0316 16:47:55.009183 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xl2bn\" (UniqueName: \"kubernetes.io/projected/12cc9828-99e7-41ff-a791-04bf41f73d04-kube-api-access-xl2bn\") pod \"nova-scheduler-0\" (UID: \"12cc9828-99e7-41ff-a791-04bf41f73d04\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:47:55 crc kubenswrapper[5120]: I0316 16:47:55.114283 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:47:55 crc kubenswrapper[5120]: I0316 16:47:55.144795 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:47:55 crc kubenswrapper[5120]: I0316 16:47:55.565694 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:47:55 crc kubenswrapper[5120]: I0316 16:47:55.586315 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"f3a3bb6d-7c8a-4d71-8e0c-0643dfeaf22a","Type":"ContainerStarted","Data":"1fee9192977e6d435dcca6fcd391ab5cfb489871c847ce736d44a559c0101a1a"} Mar 16 16:47:55 crc kubenswrapper[5120]: I0316 16:47:55.586366 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"f3a3bb6d-7c8a-4d71-8e0c-0643dfeaf22a","Type":"ContainerStarted","Data":"aa2bd836b9e31251f5d2c19ded112b6b2b88dec48badd74e3248328903d27c91"} Mar 16 16:47:55 crc kubenswrapper[5120]: I0316 16:47:55.586379 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"f3a3bb6d-7c8a-4d71-8e0c-0643dfeaf22a","Type":"ContainerStarted","Data":"bc69d24a6d1005fb471202bd5cf189e8fc9ba3368d2e17b41c56c36a7bc1e3d2"} Mar 16 16:47:55 crc kubenswrapper[5120]: I0316 16:47:55.588251 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"3fb21e8a-174a-4469-b1d1-675d191207be","Type":"ContainerStarted","Data":"9898e327eb57c328e69a3d87c53193bf57d0172d83d088812613860915f509ed"} Mar 16 16:47:55 crc kubenswrapper[5120]: I0316 16:47:55.613605 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=2.613580066 podStartE2EDuration="2.613580066s" podCreationTimestamp="2026-03-16 16:47:53 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:47:55.602556866 +0000 UTC m=+4577.756488523" watchObservedRunningTime="2026-03-16 16:47:55.613580066 +0000 UTC m=+4577.767511723" Mar 16 16:47:55 crc kubenswrapper[5120]: I0316 16:47:55.647215 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:47:55 crc kubenswrapper[5120]: W0316 16:47:55.652349 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod12cc9828_99e7_41ff_a791_04bf41f73d04.slice/crio-8209e7c9617b37948f47a3c7dd01114b383e23a3da2924cef2f55142fac0db86 WatchSource:0}: Error finding container 8209e7c9617b37948f47a3c7dd01114b383e23a3da2924cef2f55142fac0db86: Status 404 returned error can't find the container with id 8209e7c9617b37948f47a3c7dd01114b383e23a3da2924cef2f55142fac0db86 Mar 16 16:47:56 crc kubenswrapper[5120]: I0316 16:47:56.571594 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:47:56 crc kubenswrapper[5120]: I0316 16:47:56.605619 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"3fb21e8a-174a-4469-b1d1-675d191207be","Type":"ContainerStarted","Data":"67f7201985d4a854659bb874c2e52b4032709b7457af2dffc65bf935af8248d2"} Mar 16 16:47:56 crc kubenswrapper[5120]: I0316 16:47:56.605685 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"3fb21e8a-174a-4469-b1d1-675d191207be","Type":"ContainerStarted","Data":"fcab0967308cc12e7b00d4f585a1d0218038cf8fabf5e3cbe4cf52308a84bac4"} Mar 16 16:47:56 crc kubenswrapper[5120]: I0316 16:47:56.614101 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"12cc9828-99e7-41ff-a791-04bf41f73d04","Type":"ContainerStarted","Data":"236b05f29fc955e331fb9486a5f097bbfdcc8db1e9d9672361213e52e82cc086"} Mar 16 16:47:56 crc kubenswrapper[5120]: I0316 16:47:56.614145 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"12cc9828-99e7-41ff-a791-04bf41f73d04","Type":"ContainerStarted","Data":"8209e7c9617b37948f47a3c7dd01114b383e23a3da2924cef2f55142fac0db86"} Mar 16 16:47:56 crc kubenswrapper[5120]: I0316 16:47:56.634544 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=2.634522239 podStartE2EDuration="2.634522239s" podCreationTimestamp="2026-03-16 16:47:54 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:47:56.623971723 +0000 UTC m=+4578.777903390" watchObservedRunningTime="2026-03-16 16:47:56.634522239 +0000 UTC m=+4578.788453916" Mar 16 16:47:56 crc kubenswrapper[5120]: I0316 16:47:56.650203 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-scheduler-0" podStartSLOduration=2.650182675 podStartE2EDuration="2.650182675s" podCreationTimestamp="2026-03-16 16:47:54 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:47:56.639197507 +0000 UTC m=+4578.793129194" watchObservedRunningTime="2026-03-16 16:47:56.650182675 +0000 UTC m=+4578.804114342" Mar 16 16:47:56 crc kubenswrapper[5120]: I0316 16:47:56.676639 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1272c05f-07f3-4206-ad8f-50db9f288160" path="/var/lib/kubelet/pods/1272c05f-07f3-4206-ad8f-50db9f288160/volumes" Mar 16 16:47:56 crc kubenswrapper[5120]: I0316 16:47:56.677734 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ffb58abe-0995-4f67-a71e-1a30dd9a53a9" path="/var/lib/kubelet/pods/ffb58abe-0995-4f67-a71e-1a30dd9a53a9/volumes" Mar 16 16:47:57 crc kubenswrapper[5120]: I0316 16:47:57.057026 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-47xrk"] Mar 16 16:47:57 crc kubenswrapper[5120]: I0316 16:47:57.066361 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-47xrk" Mar 16 16:47:57 crc kubenswrapper[5120]: I0316 16:47:57.069902 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-47xrk"] Mar 16 16:47:57 crc kubenswrapper[5120]: I0316 16:47:57.070899 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-manage-scripts\"" Mar 16 16:47:57 crc kubenswrapper[5120]: I0316 16:47:57.070927 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-manage-config-data\"" Mar 16 16:47:57 crc kubenswrapper[5120]: I0316 16:47:57.243031 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4aa560c9-7785-4e87-a285-6a229c5ef04f-combined-ca-bundle\") pod \"nova-cell1-cell-mapping-47xrk\" (UID: \"4aa560c9-7785-4e87-a285-6a229c5ef04f\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-47xrk" Mar 16 16:47:57 crc kubenswrapper[5120]: I0316 16:47:57.243072 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gtb96\" (UniqueName: \"kubernetes.io/projected/4aa560c9-7785-4e87-a285-6a229c5ef04f-kube-api-access-gtb96\") pod \"nova-cell1-cell-mapping-47xrk\" (UID: \"4aa560c9-7785-4e87-a285-6a229c5ef04f\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-47xrk" Mar 16 16:47:57 crc kubenswrapper[5120]: I0316 16:47:57.243115 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4aa560c9-7785-4e87-a285-6a229c5ef04f-scripts\") pod \"nova-cell1-cell-mapping-47xrk\" (UID: \"4aa560c9-7785-4e87-a285-6a229c5ef04f\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-47xrk" Mar 16 16:47:57 crc kubenswrapper[5120]: I0316 16:47:57.243238 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4aa560c9-7785-4e87-a285-6a229c5ef04f-config-data\") pod \"nova-cell1-cell-mapping-47xrk\" (UID: \"4aa560c9-7785-4e87-a285-6a229c5ef04f\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-47xrk" Mar 16 16:47:57 crc kubenswrapper[5120]: I0316 16:47:57.345358 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4aa560c9-7785-4e87-a285-6a229c5ef04f-combined-ca-bundle\") pod \"nova-cell1-cell-mapping-47xrk\" (UID: \"4aa560c9-7785-4e87-a285-6a229c5ef04f\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-47xrk" Mar 16 16:47:57 crc kubenswrapper[5120]: I0316 16:47:57.345412 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gtb96\" (UniqueName: \"kubernetes.io/projected/4aa560c9-7785-4e87-a285-6a229c5ef04f-kube-api-access-gtb96\") pod \"nova-cell1-cell-mapping-47xrk\" (UID: \"4aa560c9-7785-4e87-a285-6a229c5ef04f\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-47xrk" Mar 16 16:47:57 crc kubenswrapper[5120]: I0316 16:47:57.345452 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4aa560c9-7785-4e87-a285-6a229c5ef04f-scripts\") pod \"nova-cell1-cell-mapping-47xrk\" (UID: \"4aa560c9-7785-4e87-a285-6a229c5ef04f\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-47xrk" Mar 16 16:47:57 crc kubenswrapper[5120]: I0316 16:47:57.345572 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4aa560c9-7785-4e87-a285-6a229c5ef04f-config-data\") pod \"nova-cell1-cell-mapping-47xrk\" (UID: \"4aa560c9-7785-4e87-a285-6a229c5ef04f\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-47xrk" Mar 16 16:47:57 crc kubenswrapper[5120]: I0316 16:47:57.353067 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4aa560c9-7785-4e87-a285-6a229c5ef04f-scripts\") pod \"nova-cell1-cell-mapping-47xrk\" (UID: \"4aa560c9-7785-4e87-a285-6a229c5ef04f\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-47xrk" Mar 16 16:47:57 crc kubenswrapper[5120]: I0316 16:47:57.355406 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4aa560c9-7785-4e87-a285-6a229c5ef04f-config-data\") pod \"nova-cell1-cell-mapping-47xrk\" (UID: \"4aa560c9-7785-4e87-a285-6a229c5ef04f\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-47xrk" Mar 16 16:47:57 crc kubenswrapper[5120]: I0316 16:47:57.363585 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4aa560c9-7785-4e87-a285-6a229c5ef04f-combined-ca-bundle\") pod \"nova-cell1-cell-mapping-47xrk\" (UID: \"4aa560c9-7785-4e87-a285-6a229c5ef04f\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-47xrk" Mar 16 16:47:57 crc kubenswrapper[5120]: I0316 16:47:57.365484 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gtb96\" (UniqueName: \"kubernetes.io/projected/4aa560c9-7785-4e87-a285-6a229c5ef04f-kube-api-access-gtb96\") pod \"nova-cell1-cell-mapping-47xrk\" (UID: \"4aa560c9-7785-4e87-a285-6a229c5ef04f\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-47xrk" Mar 16 16:47:57 crc kubenswrapper[5120]: I0316 16:47:57.419415 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-47xrk" Mar 16 16:47:57 crc kubenswrapper[5120]: I0316 16:47:57.943943 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-47xrk"] Mar 16 16:47:58 crc kubenswrapper[5120]: I0316 16:47:58.639003 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-47xrk" event={"ID":"4aa560c9-7785-4e87-a285-6a229c5ef04f","Type":"ContainerStarted","Data":"49198fce7eb3bdcdb7ccf2288ad18d982d0e75faee4130ae433591d9a4ebd092"} Mar 16 16:47:58 crc kubenswrapper[5120]: I0316 16:47:58.639305 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-47xrk" event={"ID":"4aa560c9-7785-4e87-a285-6a229c5ef04f","Type":"ContainerStarted","Data":"d6042ab8a976216c2d23f60b1bc3462c0b7df754ee4c9cd9c780fb2aeee19891"} Mar 16 16:47:58 crc kubenswrapper[5120]: I0316 16:47:58.660704 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-47xrk" podStartSLOduration=1.660677467 podStartE2EDuration="1.660677467s" podCreationTimestamp="2026-03-16 16:47:57 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:47:58.657247894 +0000 UTC m=+4580.811179561" watchObservedRunningTime="2026-03-16 16:47:58.660677467 +0000 UTC m=+4580.814609134" Mar 16 16:48:00 crc kubenswrapper[5120]: I0316 16:48:00.141822 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-infra/auto-csr-approver-29561328-2kz8m"] Mar 16 16:48:00 crc kubenswrapper[5120]: I0316 16:48:00.159322 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561328-2kz8m"] Mar 16 16:48:00 crc kubenswrapper[5120]: I0316 16:48:00.159386 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:48:00 crc kubenswrapper[5120]: I0316 16:48:00.159780 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561328-2kz8m" Mar 16 16:48:00 crc kubenswrapper[5120]: I0316 16:48:00.161936 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"kube-root-ca.crt\"" Mar 16 16:48:00 crc kubenswrapper[5120]: I0316 16:48:00.162379 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"openshift-service-ca.crt\"" Mar 16 16:48:00 crc kubenswrapper[5120]: I0316 16:48:00.162562 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-infra\"/\"csr-approver-sa-dockercfg-x2nsz\"" Mar 16 16:48:00 crc kubenswrapper[5120]: I0316 16:48:00.241122 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbp2t\" (UniqueName: \"kubernetes.io/projected/f07b5400-a812-4bb9-82ee-516b11a3c655-kube-api-access-lbp2t\") pod \"auto-csr-approver-29561328-2kz8m\" (UID: \"f07b5400-a812-4bb9-82ee-516b11a3c655\") " pod="openshift-infra/auto-csr-approver-29561328-2kz8m" Mar 16 16:48:00 crc kubenswrapper[5120]: I0316 16:48:00.344265 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lbp2t\" (UniqueName: \"kubernetes.io/projected/f07b5400-a812-4bb9-82ee-516b11a3c655-kube-api-access-lbp2t\") pod \"auto-csr-approver-29561328-2kz8m\" (UID: \"f07b5400-a812-4bb9-82ee-516b11a3c655\") " pod="openshift-infra/auto-csr-approver-29561328-2kz8m" Mar 16 16:48:00 crc kubenswrapper[5120]: I0316 16:48:00.363483 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbp2t\" (UniqueName: \"kubernetes.io/projected/f07b5400-a812-4bb9-82ee-516b11a3c655-kube-api-access-lbp2t\") pod \"auto-csr-approver-29561328-2kz8m\" (UID: \"f07b5400-a812-4bb9-82ee-516b11a3c655\") " pod="openshift-infra/auto-csr-approver-29561328-2kz8m" Mar 16 16:48:00 crc kubenswrapper[5120]: I0316 16:48:00.494570 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561328-2kz8m" Mar 16 16:48:00 crc kubenswrapper[5120]: I0316 16:48:00.939895 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561328-2kz8m"] Mar 16 16:48:01 crc kubenswrapper[5120]: I0316 16:48:01.668159 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561328-2kz8m" event={"ID":"f07b5400-a812-4bb9-82ee-516b11a3c655","Type":"ContainerStarted","Data":"189ea1ea913eb8f134cf01473bab9e45f3bdbe4d18d89868bcba63c4341593d4"} Mar 16 16:48:02 crc kubenswrapper[5120]: I0316 16:48:02.680625 5120 generic.go:358] "Generic (PLEG): container finished" podID="f07b5400-a812-4bb9-82ee-516b11a3c655" containerID="84402998ec5dc95878258815ff6c436722b11de13d52212e9d338beef3cb5c72" exitCode=0 Mar 16 16:48:02 crc kubenswrapper[5120]: I0316 16:48:02.681045 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561328-2kz8m" event={"ID":"f07b5400-a812-4bb9-82ee-516b11a3c655","Type":"ContainerDied","Data":"84402998ec5dc95878258815ff6c436722b11de13d52212e9d338beef3cb5c72"} Mar 16 16:48:03 crc kubenswrapper[5120]: I0316 16:48:03.694577 5120 generic.go:358] "Generic (PLEG): container finished" podID="4aa560c9-7785-4e87-a285-6a229c5ef04f" containerID="49198fce7eb3bdcdb7ccf2288ad18d982d0e75faee4130ae433591d9a4ebd092" exitCode=0 Mar 16 16:48:03 crc kubenswrapper[5120]: I0316 16:48:03.694682 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-47xrk" event={"ID":"4aa560c9-7785-4e87-a285-6a229c5ef04f","Type":"ContainerDied","Data":"49198fce7eb3bdcdb7ccf2288ad18d982d0e75faee4130ae433591d9a4ebd092"} Mar 16 16:48:04 crc kubenswrapper[5120]: I0316 16:48:04.065412 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561328-2kz8m" Mar 16 16:48:04 crc kubenswrapper[5120]: I0316 16:48:04.136178 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lbp2t\" (UniqueName: \"kubernetes.io/projected/f07b5400-a812-4bb9-82ee-516b11a3c655-kube-api-access-lbp2t\") pod \"f07b5400-a812-4bb9-82ee-516b11a3c655\" (UID: \"f07b5400-a812-4bb9-82ee-516b11a3c655\") " Mar 16 16:48:04 crc kubenswrapper[5120]: I0316 16:48:04.142777 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f07b5400-a812-4bb9-82ee-516b11a3c655-kube-api-access-lbp2t" (OuterVolumeSpecName: "kube-api-access-lbp2t") pod "f07b5400-a812-4bb9-82ee-516b11a3c655" (UID: "f07b5400-a812-4bb9-82ee-516b11a3c655"). InnerVolumeSpecName "kube-api-access-lbp2t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:48:04 crc kubenswrapper[5120]: I0316 16:48:04.228601 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:48:04 crc kubenswrapper[5120]: I0316 16:48:04.228640 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:48:04 crc kubenswrapper[5120]: I0316 16:48:04.241538 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lbp2t\" (UniqueName: \"kubernetes.io/projected/f07b5400-a812-4bb9-82ee-516b11a3c655-kube-api-access-lbp2t\") on node \"crc\" DevicePath \"\"" Mar 16 16:48:04 crc kubenswrapper[5120]: I0316 16:48:04.706422 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561328-2kz8m" Mar 16 16:48:04 crc kubenswrapper[5120]: I0316 16:48:04.706520 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561328-2kz8m" event={"ID":"f07b5400-a812-4bb9-82ee-516b11a3c655","Type":"ContainerDied","Data":"189ea1ea913eb8f134cf01473bab9e45f3bdbe4d18d89868bcba63c4341593d4"} Mar 16 16:48:04 crc kubenswrapper[5120]: I0316 16:48:04.706581 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="189ea1ea913eb8f134cf01473bab9e45f3bdbe4d18d89868bcba63c4341593d4" Mar 16 16:48:05 crc kubenswrapper[5120]: I0316 16:48:05.065552 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-47xrk" Mar 16 16:48:05 crc kubenswrapper[5120]: I0316 16:48:05.114837 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:48:05 crc kubenswrapper[5120]: I0316 16:48:05.114884 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:48:05 crc kubenswrapper[5120]: I0316 16:48:05.137637 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-infra/auto-csr-approver-29561322-5qbc2"] Mar 16 16:48:05 crc kubenswrapper[5120]: I0316 16:48:05.145003 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-infra/auto-csr-approver-29561322-5qbc2"] Mar 16 16:48:05 crc kubenswrapper[5120]: I0316 16:48:05.145226 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:48:05 crc kubenswrapper[5120]: I0316 16:48:05.166605 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4aa560c9-7785-4e87-a285-6a229c5ef04f-config-data\") pod \"4aa560c9-7785-4e87-a285-6a229c5ef04f\" (UID: \"4aa560c9-7785-4e87-a285-6a229c5ef04f\") " Mar 16 16:48:05 crc kubenswrapper[5120]: I0316 16:48:05.166754 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gtb96\" (UniqueName: \"kubernetes.io/projected/4aa560c9-7785-4e87-a285-6a229c5ef04f-kube-api-access-gtb96\") pod \"4aa560c9-7785-4e87-a285-6a229c5ef04f\" (UID: \"4aa560c9-7785-4e87-a285-6a229c5ef04f\") " Mar 16 16:48:05 crc kubenswrapper[5120]: I0316 16:48:05.166826 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4aa560c9-7785-4e87-a285-6a229c5ef04f-combined-ca-bundle\") pod \"4aa560c9-7785-4e87-a285-6a229c5ef04f\" (UID: \"4aa560c9-7785-4e87-a285-6a229c5ef04f\") " Mar 16 16:48:05 crc kubenswrapper[5120]: I0316 16:48:05.166942 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4aa560c9-7785-4e87-a285-6a229c5ef04f-scripts\") pod \"4aa560c9-7785-4e87-a285-6a229c5ef04f\" (UID: \"4aa560c9-7785-4e87-a285-6a229c5ef04f\") " Mar 16 16:48:05 crc kubenswrapper[5120]: I0316 16:48:05.173095 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4aa560c9-7785-4e87-a285-6a229c5ef04f-kube-api-access-gtb96" (OuterVolumeSpecName: "kube-api-access-gtb96") pod "4aa560c9-7785-4e87-a285-6a229c5ef04f" (UID: "4aa560c9-7785-4e87-a285-6a229c5ef04f"). InnerVolumeSpecName "kube-api-access-gtb96". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:48:05 crc kubenswrapper[5120]: I0316 16:48:05.173843 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:48:05 crc kubenswrapper[5120]: I0316 16:48:05.193151 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4aa560c9-7785-4e87-a285-6a229c5ef04f-scripts" (OuterVolumeSpecName: "scripts") pod "4aa560c9-7785-4e87-a285-6a229c5ef04f" (UID: "4aa560c9-7785-4e87-a285-6a229c5ef04f"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:48:05 crc kubenswrapper[5120]: I0316 16:48:05.201639 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4aa560c9-7785-4e87-a285-6a229c5ef04f-config-data" (OuterVolumeSpecName: "config-data") pod "4aa560c9-7785-4e87-a285-6a229c5ef04f" (UID: "4aa560c9-7785-4e87-a285-6a229c5ef04f"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:48:05 crc kubenswrapper[5120]: I0316 16:48:05.208070 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4aa560c9-7785-4e87-a285-6a229c5ef04f-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "4aa560c9-7785-4e87-a285-6a229c5ef04f" (UID: "4aa560c9-7785-4e87-a285-6a229c5ef04f"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:48:05 crc kubenswrapper[5120]: I0316 16:48:05.269141 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="f3a3bb6d-7c8a-4d71-8e0c-0643dfeaf22a" containerName="nova-metadata-log" probeResult="failure" output="Get \"http://10.217.1.202:8775/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 16:48:05 crc kubenswrapper[5120]: I0316 16:48:05.269913 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="f3a3bb6d-7c8a-4d71-8e0c-0643dfeaf22a" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"http://10.217.1.202:8775/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 16:48:05 crc kubenswrapper[5120]: I0316 16:48:05.270483 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4aa560c9-7785-4e87-a285-6a229c5ef04f-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:48:05 crc kubenswrapper[5120]: I0316 16:48:05.270507 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gtb96\" (UniqueName: \"kubernetes.io/projected/4aa560c9-7785-4e87-a285-6a229c5ef04f-kube-api-access-gtb96\") on node \"crc\" DevicePath \"\"" Mar 16 16:48:05 crc kubenswrapper[5120]: I0316 16:48:05.270518 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4aa560c9-7785-4e87-a285-6a229c5ef04f-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:48:05 crc kubenswrapper[5120]: I0316 16:48:05.270527 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4aa560c9-7785-4e87-a285-6a229c5ef04f-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:48:05 crc kubenswrapper[5120]: I0316 16:48:05.727293 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-47xrk" Mar 16 16:48:05 crc kubenswrapper[5120]: I0316 16:48:05.727314 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-47xrk" event={"ID":"4aa560c9-7785-4e87-a285-6a229c5ef04f","Type":"ContainerDied","Data":"d6042ab8a976216c2d23f60b1bc3462c0b7df754ee4c9cd9c780fb2aeee19891"} Mar 16 16:48:05 crc kubenswrapper[5120]: I0316 16:48:05.727387 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d6042ab8a976216c2d23f60b1bc3462c0b7df754ee4c9cd9c780fb2aeee19891" Mar 16 16:48:05 crc kubenswrapper[5120]: I0316 16:48:05.778028 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:48:05 crc kubenswrapper[5120]: I0316 16:48:05.896313 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:48:05 crc kubenswrapper[5120]: I0316 16:48:05.896560 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="3fb21e8a-174a-4469-b1d1-675d191207be" containerName="nova-api-log" containerID="cri-o://fcab0967308cc12e7b00d4f585a1d0218038cf8fabf5e3cbe4cf52308a84bac4" gracePeriod=30 Mar 16 16:48:05 crc kubenswrapper[5120]: I0316 16:48:05.896640 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="3fb21e8a-174a-4469-b1d1-675d191207be" containerName="nova-api-api" containerID="cri-o://67f7201985d4a854659bb874c2e52b4032709b7457af2dffc65bf935af8248d2" gracePeriod=30 Mar 16 16:48:05 crc kubenswrapper[5120]: I0316 16:48:05.905128 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="3fb21e8a-174a-4469-b1d1-675d191207be" containerName="nova-api-api" probeResult="failure" output="Get \"http://10.217.1.203:8774/\": EOF" Mar 16 16:48:05 crc kubenswrapper[5120]: I0316 16:48:05.908245 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="3fb21e8a-174a-4469-b1d1-675d191207be" containerName="nova-api-log" probeResult="failure" output="Get \"http://10.217.1.203:8774/\": EOF" Mar 16 16:48:05 crc kubenswrapper[5120]: I0316 16:48:05.926393 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:48:05 crc kubenswrapper[5120]: I0316 16:48:05.926683 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="f3a3bb6d-7c8a-4d71-8e0c-0643dfeaf22a" containerName="nova-metadata-log" containerID="cri-o://aa2bd836b9e31251f5d2c19ded112b6b2b88dec48badd74e3248328903d27c91" gracePeriod=30 Mar 16 16:48:05 crc kubenswrapper[5120]: I0316 16:48:05.926805 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="f3a3bb6d-7c8a-4d71-8e0c-0643dfeaf22a" containerName="nova-metadata-metadata" containerID="cri-o://1fee9192977e6d435dcca6fcd391ab5cfb489871c847ce736d44a559c0101a1a" gracePeriod=30 Mar 16 16:48:06 crc kubenswrapper[5120]: I0316 16:48:06.432688 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:48:06 crc kubenswrapper[5120]: I0316 16:48:06.676530 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a1a93363-54ba-4785-bd0a-b4ff5dd043b6" path="/var/lib/kubelet/pods/a1a93363-54ba-4785-bd0a-b4ff5dd043b6/volumes" Mar 16 16:48:06 crc kubenswrapper[5120]: I0316 16:48:06.739909 5120 generic.go:358] "Generic (PLEG): container finished" podID="3fb21e8a-174a-4469-b1d1-675d191207be" containerID="fcab0967308cc12e7b00d4f585a1d0218038cf8fabf5e3cbe4cf52308a84bac4" exitCode=143 Mar 16 16:48:06 crc kubenswrapper[5120]: I0316 16:48:06.741153 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"3fb21e8a-174a-4469-b1d1-675d191207be","Type":"ContainerDied","Data":"fcab0967308cc12e7b00d4f585a1d0218038cf8fabf5e3cbe4cf52308a84bac4"} Mar 16 16:48:06 crc kubenswrapper[5120]: I0316 16:48:06.742856 5120 generic.go:358] "Generic (PLEG): container finished" podID="f3a3bb6d-7c8a-4d71-8e0c-0643dfeaf22a" containerID="aa2bd836b9e31251f5d2c19ded112b6b2b88dec48badd74e3248328903d27c91" exitCode=143 Mar 16 16:48:06 crc kubenswrapper[5120]: I0316 16:48:06.743019 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"f3a3bb6d-7c8a-4d71-8e0c-0643dfeaf22a","Type":"ContainerDied","Data":"aa2bd836b9e31251f5d2c19ded112b6b2b88dec48badd74e3248328903d27c91"} Mar 16 16:48:07 crc kubenswrapper[5120]: I0316 16:48:07.753366 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="12cc9828-99e7-41ff-a791-04bf41f73d04" containerName="nova-scheduler-scheduler" containerID="cri-o://236b05f29fc955e331fb9486a5f097bbfdcc8db1e9d9672361213e52e82cc086" gracePeriod=30 Mar 16 16:48:08 crc kubenswrapper[5120]: E0316 16:48:08.120985 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1872301 actualBytes=10240 Mar 16 16:48:09 crc kubenswrapper[5120]: I0316 16:48:09.664549 5120 scope.go:117] "RemoveContainer" containerID="35a7dd6e19084cee69ca16203bca6378ea0cdf6a685ca2093ab847e5904eb9e6" Mar 16 16:48:09 crc kubenswrapper[5120]: E0316 16:48:09.664937 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:48:10 crc kubenswrapper[5120]: E0316 16:48:10.732892 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="236b05f29fc955e331fb9486a5f097bbfdcc8db1e9d9672361213e52e82cc086" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:48:10 crc kubenswrapper[5120]: E0316 16:48:10.735792 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="236b05f29fc955e331fb9486a5f097bbfdcc8db1e9d9672361213e52e82cc086" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:48:10 crc kubenswrapper[5120]: E0316 16:48:10.737609 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="236b05f29fc955e331fb9486a5f097bbfdcc8db1e9d9672361213e52e82cc086" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:48:10 crc kubenswrapper[5120]: E0316 16:48:10.737824 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="12cc9828-99e7-41ff-a791-04bf41f73d04" containerName="nova-scheduler-scheduler" probeResult="unknown" Mar 16 16:48:10 crc kubenswrapper[5120]: I0316 16:48:10.786305 5120 generic.go:358] "Generic (PLEG): container finished" podID="f3a3bb6d-7c8a-4d71-8e0c-0643dfeaf22a" containerID="1fee9192977e6d435dcca6fcd391ab5cfb489871c847ce736d44a559c0101a1a" exitCode=0 Mar 16 16:48:10 crc kubenswrapper[5120]: I0316 16:48:10.786393 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"f3a3bb6d-7c8a-4d71-8e0c-0643dfeaf22a","Type":"ContainerDied","Data":"1fee9192977e6d435dcca6fcd391ab5cfb489871c847ce736d44a559c0101a1a"} Mar 16 16:48:10 crc kubenswrapper[5120]: I0316 16:48:10.786430 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"f3a3bb6d-7c8a-4d71-8e0c-0643dfeaf22a","Type":"ContainerDied","Data":"bc69d24a6d1005fb471202bd5cf189e8fc9ba3368d2e17b41c56c36a7bc1e3d2"} Mar 16 16:48:10 crc kubenswrapper[5120]: I0316 16:48:10.786443 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bc69d24a6d1005fb471202bd5cf189e8fc9ba3368d2e17b41c56c36a7bc1e3d2" Mar 16 16:48:10 crc kubenswrapper[5120]: I0316 16:48:10.808900 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:48:10 crc kubenswrapper[5120]: I0316 16:48:10.908529 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f3a3bb6d-7c8a-4d71-8e0c-0643dfeaf22a-logs\") pod \"f3a3bb6d-7c8a-4d71-8e0c-0643dfeaf22a\" (UID: \"f3a3bb6d-7c8a-4d71-8e0c-0643dfeaf22a\") " Mar 16 16:48:10 crc kubenswrapper[5120]: I0316 16:48:10.908706 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f3a3bb6d-7c8a-4d71-8e0c-0643dfeaf22a-config-data\") pod \"f3a3bb6d-7c8a-4d71-8e0c-0643dfeaf22a\" (UID: \"f3a3bb6d-7c8a-4d71-8e0c-0643dfeaf22a\") " Mar 16 16:48:10 crc kubenswrapper[5120]: I0316 16:48:10.909074 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3a3bb6d-7c8a-4d71-8e0c-0643dfeaf22a-logs" (OuterVolumeSpecName: "logs") pod "f3a3bb6d-7c8a-4d71-8e0c-0643dfeaf22a" (UID: "f3a3bb6d-7c8a-4d71-8e0c-0643dfeaf22a"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:48:10 crc kubenswrapper[5120]: I0316 16:48:10.909142 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f3a3bb6d-7c8a-4d71-8e0c-0643dfeaf22a-combined-ca-bundle\") pod \"f3a3bb6d-7c8a-4d71-8e0c-0643dfeaf22a\" (UID: \"f3a3bb6d-7c8a-4d71-8e0c-0643dfeaf22a\") " Mar 16 16:48:10 crc kubenswrapper[5120]: I0316 16:48:10.909187 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zvgtj\" (UniqueName: \"kubernetes.io/projected/f3a3bb6d-7c8a-4d71-8e0c-0643dfeaf22a-kube-api-access-zvgtj\") pod \"f3a3bb6d-7c8a-4d71-8e0c-0643dfeaf22a\" (UID: \"f3a3bb6d-7c8a-4d71-8e0c-0643dfeaf22a\") " Mar 16 16:48:10 crc kubenswrapper[5120]: I0316 16:48:10.909813 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f3a3bb6d-7c8a-4d71-8e0c-0643dfeaf22a-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:48:10 crc kubenswrapper[5120]: I0316 16:48:10.915241 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3a3bb6d-7c8a-4d71-8e0c-0643dfeaf22a-kube-api-access-zvgtj" (OuterVolumeSpecName: "kube-api-access-zvgtj") pod "f3a3bb6d-7c8a-4d71-8e0c-0643dfeaf22a" (UID: "f3a3bb6d-7c8a-4d71-8e0c-0643dfeaf22a"). InnerVolumeSpecName "kube-api-access-zvgtj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:48:10 crc kubenswrapper[5120]: I0316 16:48:10.939142 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3a3bb6d-7c8a-4d71-8e0c-0643dfeaf22a-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f3a3bb6d-7c8a-4d71-8e0c-0643dfeaf22a" (UID: "f3a3bb6d-7c8a-4d71-8e0c-0643dfeaf22a"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:48:10 crc kubenswrapper[5120]: I0316 16:48:10.942161 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3a3bb6d-7c8a-4d71-8e0c-0643dfeaf22a-config-data" (OuterVolumeSpecName: "config-data") pod "f3a3bb6d-7c8a-4d71-8e0c-0643dfeaf22a" (UID: "f3a3bb6d-7c8a-4d71-8e0c-0643dfeaf22a"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:48:11 crc kubenswrapper[5120]: I0316 16:48:11.012180 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zvgtj\" (UniqueName: \"kubernetes.io/projected/f3a3bb6d-7c8a-4d71-8e0c-0643dfeaf22a-kube-api-access-zvgtj\") on node \"crc\" DevicePath \"\"" Mar 16 16:48:11 crc kubenswrapper[5120]: I0316 16:48:11.012378 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f3a3bb6d-7c8a-4d71-8e0c-0643dfeaf22a-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:48:11 crc kubenswrapper[5120]: I0316 16:48:11.012477 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f3a3bb6d-7c8a-4d71-8e0c-0643dfeaf22a-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:48:11 crc kubenswrapper[5120]: I0316 16:48:11.810956 5120 generic.go:358] "Generic (PLEG): container finished" podID="3fb21e8a-174a-4469-b1d1-675d191207be" containerID="67f7201985d4a854659bb874c2e52b4032709b7457af2dffc65bf935af8248d2" exitCode=0 Mar 16 16:48:11 crc kubenswrapper[5120]: I0316 16:48:11.811336 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:48:11 crc kubenswrapper[5120]: I0316 16:48:11.811172 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"3fb21e8a-174a-4469-b1d1-675d191207be","Type":"ContainerDied","Data":"67f7201985d4a854659bb874c2e52b4032709b7457af2dffc65bf935af8248d2"} Mar 16 16:48:11 crc kubenswrapper[5120]: I0316 16:48:11.896391 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:48:11 crc kubenswrapper[5120]: I0316 16:48:11.917468 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:48:11 crc kubenswrapper[5120]: I0316 16:48:11.933827 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:48:11 crc kubenswrapper[5120]: I0316 16:48:11.949920 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:48:11 crc kubenswrapper[5120]: I0316 16:48:11.950993 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4aa560c9-7785-4e87-a285-6a229c5ef04f" containerName="nova-manage" Mar 16 16:48:11 crc kubenswrapper[5120]: I0316 16:48:11.951009 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="4aa560c9-7785-4e87-a285-6a229c5ef04f" containerName="nova-manage" Mar 16 16:48:11 crc kubenswrapper[5120]: I0316 16:48:11.951030 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3a3bb6d-7c8a-4d71-8e0c-0643dfeaf22a" containerName="nova-metadata-metadata" Mar 16 16:48:11 crc kubenswrapper[5120]: I0316 16:48:11.951035 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3a3bb6d-7c8a-4d71-8e0c-0643dfeaf22a" containerName="nova-metadata-metadata" Mar 16 16:48:11 crc kubenswrapper[5120]: I0316 16:48:11.951051 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3a3bb6d-7c8a-4d71-8e0c-0643dfeaf22a" containerName="nova-metadata-log" Mar 16 16:48:11 crc kubenswrapper[5120]: I0316 16:48:11.951058 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3a3bb6d-7c8a-4d71-8e0c-0643dfeaf22a" containerName="nova-metadata-log" Mar 16 16:48:11 crc kubenswrapper[5120]: I0316 16:48:11.951073 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fb21e8a-174a-4469-b1d1-675d191207be" containerName="nova-api-log" Mar 16 16:48:11 crc kubenswrapper[5120]: I0316 16:48:11.951078 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fb21e8a-174a-4469-b1d1-675d191207be" containerName="nova-api-log" Mar 16 16:48:11 crc kubenswrapper[5120]: I0316 16:48:11.951087 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f07b5400-a812-4bb9-82ee-516b11a3c655" containerName="oc" Mar 16 16:48:11 crc kubenswrapper[5120]: I0316 16:48:11.951092 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f07b5400-a812-4bb9-82ee-516b11a3c655" containerName="oc" Mar 16 16:48:11 crc kubenswrapper[5120]: I0316 16:48:11.951106 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fb21e8a-174a-4469-b1d1-675d191207be" containerName="nova-api-api" Mar 16 16:48:11 crc kubenswrapper[5120]: I0316 16:48:11.951112 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fb21e8a-174a-4469-b1d1-675d191207be" containerName="nova-api-api" Mar 16 16:48:11 crc kubenswrapper[5120]: I0316 16:48:11.951268 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="3fb21e8a-174a-4469-b1d1-675d191207be" containerName="nova-api-api" Mar 16 16:48:11 crc kubenswrapper[5120]: I0316 16:48:11.951278 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f3a3bb6d-7c8a-4d71-8e0c-0643dfeaf22a" containerName="nova-metadata-metadata" Mar 16 16:48:11 crc kubenswrapper[5120]: I0316 16:48:11.951293 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="3fb21e8a-174a-4469-b1d1-675d191207be" containerName="nova-api-log" Mar 16 16:48:11 crc kubenswrapper[5120]: I0316 16:48:11.951309 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="4aa560c9-7785-4e87-a285-6a229c5ef04f" containerName="nova-manage" Mar 16 16:48:11 crc kubenswrapper[5120]: I0316 16:48:11.951315 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f3a3bb6d-7c8a-4d71-8e0c-0643dfeaf22a" containerName="nova-metadata-log" Mar 16 16:48:11 crc kubenswrapper[5120]: I0316 16:48:11.951324 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f07b5400-a812-4bb9-82ee-516b11a3c655" containerName="oc" Mar 16 16:48:11 crc kubenswrapper[5120]: I0316 16:48:11.955691 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:48:11 crc kubenswrapper[5120]: I0316 16:48:11.964745 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-metadata-config-data\"" Mar 16 16:48:11 crc kubenswrapper[5120]: I0316 16:48:11.984636 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:48:12 crc kubenswrapper[5120]: I0316 16:48:12.066270 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3fb21e8a-174a-4469-b1d1-675d191207be-logs\") pod \"3fb21e8a-174a-4469-b1d1-675d191207be\" (UID: \"3fb21e8a-174a-4469-b1d1-675d191207be\") " Mar 16 16:48:12 crc kubenswrapper[5120]: I0316 16:48:12.066561 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3fb21e8a-174a-4469-b1d1-675d191207be-combined-ca-bundle\") pod \"3fb21e8a-174a-4469-b1d1-675d191207be\" (UID: \"3fb21e8a-174a-4469-b1d1-675d191207be\") " Mar 16 16:48:12 crc kubenswrapper[5120]: I0316 16:48:12.066954 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3fb21e8a-174a-4469-b1d1-675d191207be-config-data\") pod \"3fb21e8a-174a-4469-b1d1-675d191207be\" (UID: \"3fb21e8a-174a-4469-b1d1-675d191207be\") " Mar 16 16:48:12 crc kubenswrapper[5120]: I0316 16:48:12.066981 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fb21e8a-174a-4469-b1d1-675d191207be-logs" (OuterVolumeSpecName: "logs") pod "3fb21e8a-174a-4469-b1d1-675d191207be" (UID: "3fb21e8a-174a-4469-b1d1-675d191207be"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:48:12 crc kubenswrapper[5120]: I0316 16:48:12.067015 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l2hqn\" (UniqueName: \"kubernetes.io/projected/3fb21e8a-174a-4469-b1d1-675d191207be-kube-api-access-l2hqn\") pod \"3fb21e8a-174a-4469-b1d1-675d191207be\" (UID: \"3fb21e8a-174a-4469-b1d1-675d191207be\") " Mar 16 16:48:12 crc kubenswrapper[5120]: I0316 16:48:12.067633 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8jc8\" (UniqueName: \"kubernetes.io/projected/a7864faa-1e6e-4644-a5f5-f51e429e1e2b-kube-api-access-r8jc8\") pod \"nova-metadata-0\" (UID: \"a7864faa-1e6e-4644-a5f5-f51e429e1e2b\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:48:12 crc kubenswrapper[5120]: I0316 16:48:12.067860 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a7864faa-1e6e-4644-a5f5-f51e429e1e2b-config-data\") pod \"nova-metadata-0\" (UID: \"a7864faa-1e6e-4644-a5f5-f51e429e1e2b\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:48:12 crc kubenswrapper[5120]: I0316 16:48:12.067989 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a7864faa-1e6e-4644-a5f5-f51e429e1e2b-logs\") pod \"nova-metadata-0\" (UID: \"a7864faa-1e6e-4644-a5f5-f51e429e1e2b\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:48:12 crc kubenswrapper[5120]: I0316 16:48:12.068093 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a7864faa-1e6e-4644-a5f5-f51e429e1e2b-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"a7864faa-1e6e-4644-a5f5-f51e429e1e2b\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:48:12 crc kubenswrapper[5120]: I0316 16:48:12.068174 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3fb21e8a-174a-4469-b1d1-675d191207be-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:48:12 crc kubenswrapper[5120]: I0316 16:48:12.075681 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3fb21e8a-174a-4469-b1d1-675d191207be-kube-api-access-l2hqn" (OuterVolumeSpecName: "kube-api-access-l2hqn") pod "3fb21e8a-174a-4469-b1d1-675d191207be" (UID: "3fb21e8a-174a-4469-b1d1-675d191207be"). InnerVolumeSpecName "kube-api-access-l2hqn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:48:12 crc kubenswrapper[5120]: I0316 16:48:12.102884 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3fb21e8a-174a-4469-b1d1-675d191207be-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "3fb21e8a-174a-4469-b1d1-675d191207be" (UID: "3fb21e8a-174a-4469-b1d1-675d191207be"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:48:12 crc kubenswrapper[5120]: I0316 16:48:12.111559 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3fb21e8a-174a-4469-b1d1-675d191207be-config-data" (OuterVolumeSpecName: "config-data") pod "3fb21e8a-174a-4469-b1d1-675d191207be" (UID: "3fb21e8a-174a-4469-b1d1-675d191207be"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:48:12 crc kubenswrapper[5120]: I0316 16:48:12.170247 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a7864faa-1e6e-4644-a5f5-f51e429e1e2b-logs\") pod \"nova-metadata-0\" (UID: \"a7864faa-1e6e-4644-a5f5-f51e429e1e2b\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:48:12 crc kubenswrapper[5120]: I0316 16:48:12.170315 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a7864faa-1e6e-4644-a5f5-f51e429e1e2b-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"a7864faa-1e6e-4644-a5f5-f51e429e1e2b\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:48:12 crc kubenswrapper[5120]: I0316 16:48:12.170516 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r8jc8\" (UniqueName: \"kubernetes.io/projected/a7864faa-1e6e-4644-a5f5-f51e429e1e2b-kube-api-access-r8jc8\") pod \"nova-metadata-0\" (UID: \"a7864faa-1e6e-4644-a5f5-f51e429e1e2b\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:48:12 crc kubenswrapper[5120]: I0316 16:48:12.170600 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a7864faa-1e6e-4644-a5f5-f51e429e1e2b-config-data\") pod \"nova-metadata-0\" (UID: \"a7864faa-1e6e-4644-a5f5-f51e429e1e2b\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:48:12 crc kubenswrapper[5120]: I0316 16:48:12.170668 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3fb21e8a-174a-4469-b1d1-675d191207be-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:48:12 crc kubenswrapper[5120]: I0316 16:48:12.170680 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3fb21e8a-174a-4469-b1d1-675d191207be-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:48:12 crc kubenswrapper[5120]: I0316 16:48:12.170690 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l2hqn\" (UniqueName: \"kubernetes.io/projected/3fb21e8a-174a-4469-b1d1-675d191207be-kube-api-access-l2hqn\") on node \"crc\" DevicePath \"\"" Mar 16 16:48:12 crc kubenswrapper[5120]: I0316 16:48:12.171063 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a7864faa-1e6e-4644-a5f5-f51e429e1e2b-logs\") pod \"nova-metadata-0\" (UID: \"a7864faa-1e6e-4644-a5f5-f51e429e1e2b\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:48:12 crc kubenswrapper[5120]: I0316 16:48:12.175141 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a7864faa-1e6e-4644-a5f5-f51e429e1e2b-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"a7864faa-1e6e-4644-a5f5-f51e429e1e2b\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:48:12 crc kubenswrapper[5120]: I0316 16:48:12.187379 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8jc8\" (UniqueName: \"kubernetes.io/projected/a7864faa-1e6e-4644-a5f5-f51e429e1e2b-kube-api-access-r8jc8\") pod \"nova-metadata-0\" (UID: \"a7864faa-1e6e-4644-a5f5-f51e429e1e2b\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:48:12 crc kubenswrapper[5120]: I0316 16:48:12.188174 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a7864faa-1e6e-4644-a5f5-f51e429e1e2b-config-data\") pod \"nova-metadata-0\" (UID: \"a7864faa-1e6e-4644-a5f5-f51e429e1e2b\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:48:12 crc kubenswrapper[5120]: I0316 16:48:12.285612 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:48:12 crc kubenswrapper[5120]: I0316 16:48:12.374192 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/12cc9828-99e7-41ff-a791-04bf41f73d04-config-data\") pod \"12cc9828-99e7-41ff-a791-04bf41f73d04\" (UID: \"12cc9828-99e7-41ff-a791-04bf41f73d04\") " Mar 16 16:48:12 crc kubenswrapper[5120]: I0316 16:48:12.374329 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/12cc9828-99e7-41ff-a791-04bf41f73d04-combined-ca-bundle\") pod \"12cc9828-99e7-41ff-a791-04bf41f73d04\" (UID: \"12cc9828-99e7-41ff-a791-04bf41f73d04\") " Mar 16 16:48:12 crc kubenswrapper[5120]: I0316 16:48:12.374970 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xl2bn\" (UniqueName: \"kubernetes.io/projected/12cc9828-99e7-41ff-a791-04bf41f73d04-kube-api-access-xl2bn\") pod \"12cc9828-99e7-41ff-a791-04bf41f73d04\" (UID: \"12cc9828-99e7-41ff-a791-04bf41f73d04\") " Mar 16 16:48:12 crc kubenswrapper[5120]: I0316 16:48:12.378424 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12cc9828-99e7-41ff-a791-04bf41f73d04-kube-api-access-xl2bn" (OuterVolumeSpecName: "kube-api-access-xl2bn") pod "12cc9828-99e7-41ff-a791-04bf41f73d04" (UID: "12cc9828-99e7-41ff-a791-04bf41f73d04"). InnerVolumeSpecName "kube-api-access-xl2bn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:48:12 crc kubenswrapper[5120]: I0316 16:48:12.399959 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/12cc9828-99e7-41ff-a791-04bf41f73d04-config-data" (OuterVolumeSpecName: "config-data") pod "12cc9828-99e7-41ff-a791-04bf41f73d04" (UID: "12cc9828-99e7-41ff-a791-04bf41f73d04"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:48:12 crc kubenswrapper[5120]: I0316 16:48:12.400079 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/12cc9828-99e7-41ff-a791-04bf41f73d04-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "12cc9828-99e7-41ff-a791-04bf41f73d04" (UID: "12cc9828-99e7-41ff-a791-04bf41f73d04"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:48:12 crc kubenswrapper[5120]: I0316 16:48:12.460601 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:48:12 crc kubenswrapper[5120]: I0316 16:48:12.477116 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xl2bn\" (UniqueName: \"kubernetes.io/projected/12cc9828-99e7-41ff-a791-04bf41f73d04-kube-api-access-xl2bn\") on node \"crc\" DevicePath \"\"" Mar 16 16:48:12 crc kubenswrapper[5120]: I0316 16:48:12.477166 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/12cc9828-99e7-41ff-a791-04bf41f73d04-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:48:12 crc kubenswrapper[5120]: I0316 16:48:12.477187 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/12cc9828-99e7-41ff-a791-04bf41f73d04-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:48:12 crc kubenswrapper[5120]: I0316 16:48:12.673798 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f3a3bb6d-7c8a-4d71-8e0c-0643dfeaf22a" path="/var/lib/kubelet/pods/f3a3bb6d-7c8a-4d71-8e0c-0643dfeaf22a/volumes" Mar 16 16:48:12 crc kubenswrapper[5120]: I0316 16:48:12.822130 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"3fb21e8a-174a-4469-b1d1-675d191207be","Type":"ContainerDied","Data":"9898e327eb57c328e69a3d87c53193bf57d0172d83d088812613860915f509ed"} Mar 16 16:48:12 crc kubenswrapper[5120]: I0316 16:48:12.822186 5120 scope.go:117] "RemoveContainer" containerID="67f7201985d4a854659bb874c2e52b4032709b7457af2dffc65bf935af8248d2" Mar 16 16:48:12 crc kubenswrapper[5120]: I0316 16:48:12.822346 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:48:12 crc kubenswrapper[5120]: I0316 16:48:12.828911 5120 generic.go:358] "Generic (PLEG): container finished" podID="12cc9828-99e7-41ff-a791-04bf41f73d04" containerID="236b05f29fc955e331fb9486a5f097bbfdcc8db1e9d9672361213e52e82cc086" exitCode=0 Mar 16 16:48:12 crc kubenswrapper[5120]: I0316 16:48:12.829006 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:48:12 crc kubenswrapper[5120]: I0316 16:48:12.829040 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"12cc9828-99e7-41ff-a791-04bf41f73d04","Type":"ContainerDied","Data":"236b05f29fc955e331fb9486a5f097bbfdcc8db1e9d9672361213e52e82cc086"} Mar 16 16:48:12 crc kubenswrapper[5120]: I0316 16:48:12.829074 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"12cc9828-99e7-41ff-a791-04bf41f73d04","Type":"ContainerDied","Data":"8209e7c9617b37948f47a3c7dd01114b383e23a3da2924cef2f55142fac0db86"} Mar 16 16:48:12 crc kubenswrapper[5120]: I0316 16:48:12.851878 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:48:12 crc kubenswrapper[5120]: I0316 16:48:12.859447 5120 scope.go:117] "RemoveContainer" containerID="fcab0967308cc12e7b00d4f585a1d0218038cf8fabf5e3cbe4cf52308a84bac4" Mar 16 16:48:12 crc kubenswrapper[5120]: I0316 16:48:12.883256 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:48:12 crc kubenswrapper[5120]: I0316 16:48:12.893409 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:48:12 crc kubenswrapper[5120]: I0316 16:48:12.894740 5120 scope.go:117] "RemoveContainer" containerID="236b05f29fc955e331fb9486a5f097bbfdcc8db1e9d9672361213e52e82cc086" Mar 16 16:48:12 crc kubenswrapper[5120]: I0316 16:48:12.913551 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:48:12 crc kubenswrapper[5120]: I0316 16:48:12.923081 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:48:12 crc kubenswrapper[5120]: I0316 16:48:12.924611 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12cc9828-99e7-41ff-a791-04bf41f73d04" containerName="nova-scheduler-scheduler" Mar 16 16:48:12 crc kubenswrapper[5120]: I0316 16:48:12.924633 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="12cc9828-99e7-41ff-a791-04bf41f73d04" containerName="nova-scheduler-scheduler" Mar 16 16:48:12 crc kubenswrapper[5120]: I0316 16:48:12.924859 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="12cc9828-99e7-41ff-a791-04bf41f73d04" containerName="nova-scheduler-scheduler" Mar 16 16:48:12 crc kubenswrapper[5120]: I0316 16:48:12.926350 5120 scope.go:117] "RemoveContainer" containerID="236b05f29fc955e331fb9486a5f097bbfdcc8db1e9d9672361213e52e82cc086" Mar 16 16:48:12 crc kubenswrapper[5120]: E0316 16:48:12.926795 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"236b05f29fc955e331fb9486a5f097bbfdcc8db1e9d9672361213e52e82cc086\": container with ID starting with 236b05f29fc955e331fb9486a5f097bbfdcc8db1e9d9672361213e52e82cc086 not found: ID does not exist" containerID="236b05f29fc955e331fb9486a5f097bbfdcc8db1e9d9672361213e52e82cc086" Mar 16 16:48:12 crc kubenswrapper[5120]: I0316 16:48:12.926823 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"236b05f29fc955e331fb9486a5f097bbfdcc8db1e9d9672361213e52e82cc086"} err="failed to get container status \"236b05f29fc955e331fb9486a5f097bbfdcc8db1e9d9672361213e52e82cc086\": rpc error: code = NotFound desc = could not find container \"236b05f29fc955e331fb9486a5f097bbfdcc8db1e9d9672361213e52e82cc086\": container with ID starting with 236b05f29fc955e331fb9486a5f097bbfdcc8db1e9d9672361213e52e82cc086 not found: ID does not exist" Mar 16 16:48:12 crc kubenswrapper[5120]: I0316 16:48:12.943895 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:48:12 crc kubenswrapper[5120]: I0316 16:48:12.944101 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:48:12 crc kubenswrapper[5120]: I0316 16:48:12.948800 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-config-data\"" Mar 16 16:48:12 crc kubenswrapper[5120]: I0316 16:48:12.952232 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:48:12 crc kubenswrapper[5120]: I0316 16:48:12.957912 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:48:12 crc kubenswrapper[5120]: I0316 16:48:12.959815 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-scheduler-config-data\"" Mar 16 16:48:12 crc kubenswrapper[5120]: I0316 16:48:12.966637 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:48:12 crc kubenswrapper[5120]: I0316 16:48:12.976083 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:48:12 crc kubenswrapper[5120]: I0316 16:48:12.987899 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6433979b-c153-4721-8866-0d9bcd0480bb-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"6433979b-c153-4721-8866-0d9bcd0480bb\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:48:12 crc kubenswrapper[5120]: I0316 16:48:12.988033 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/016dd61b-9c8d-4a62-a30f-5893f3aa41d7-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"016dd61b-9c8d-4a62-a30f-5893f3aa41d7\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:48:12 crc kubenswrapper[5120]: I0316 16:48:12.988173 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmbms\" (UniqueName: \"kubernetes.io/projected/016dd61b-9c8d-4a62-a30f-5893f3aa41d7-kube-api-access-hmbms\") pod \"nova-api-0\" (UID: \"016dd61b-9c8d-4a62-a30f-5893f3aa41d7\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:48:12 crc kubenswrapper[5120]: I0316 16:48:12.988288 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6433979b-c153-4721-8866-0d9bcd0480bb-config-data\") pod \"nova-scheduler-0\" (UID: \"6433979b-c153-4721-8866-0d9bcd0480bb\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:48:12 crc kubenswrapper[5120]: I0316 16:48:12.988502 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/016dd61b-9c8d-4a62-a30f-5893f3aa41d7-config-data\") pod \"nova-api-0\" (UID: \"016dd61b-9c8d-4a62-a30f-5893f3aa41d7\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:48:12 crc kubenswrapper[5120]: I0316 16:48:12.988575 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znlrd\" (UniqueName: \"kubernetes.io/projected/6433979b-c153-4721-8866-0d9bcd0480bb-kube-api-access-znlrd\") pod \"nova-scheduler-0\" (UID: \"6433979b-c153-4721-8866-0d9bcd0480bb\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:48:12 crc kubenswrapper[5120]: I0316 16:48:12.988772 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/016dd61b-9c8d-4a62-a30f-5893f3aa41d7-logs\") pod \"nova-api-0\" (UID: \"016dd61b-9c8d-4a62-a30f-5893f3aa41d7\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:48:13 crc kubenswrapper[5120]: I0316 16:48:13.090796 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hmbms\" (UniqueName: \"kubernetes.io/projected/016dd61b-9c8d-4a62-a30f-5893f3aa41d7-kube-api-access-hmbms\") pod \"nova-api-0\" (UID: \"016dd61b-9c8d-4a62-a30f-5893f3aa41d7\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:48:13 crc kubenswrapper[5120]: I0316 16:48:13.091063 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6433979b-c153-4721-8866-0d9bcd0480bb-config-data\") pod \"nova-scheduler-0\" (UID: \"6433979b-c153-4721-8866-0d9bcd0480bb\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:48:13 crc kubenswrapper[5120]: I0316 16:48:13.091227 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/016dd61b-9c8d-4a62-a30f-5893f3aa41d7-config-data\") pod \"nova-api-0\" (UID: \"016dd61b-9c8d-4a62-a30f-5893f3aa41d7\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:48:13 crc kubenswrapper[5120]: I0316 16:48:13.091272 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-znlrd\" (UniqueName: \"kubernetes.io/projected/6433979b-c153-4721-8866-0d9bcd0480bb-kube-api-access-znlrd\") pod \"nova-scheduler-0\" (UID: \"6433979b-c153-4721-8866-0d9bcd0480bb\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:48:13 crc kubenswrapper[5120]: I0316 16:48:13.091346 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/016dd61b-9c8d-4a62-a30f-5893f3aa41d7-logs\") pod \"nova-api-0\" (UID: \"016dd61b-9c8d-4a62-a30f-5893f3aa41d7\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:48:13 crc kubenswrapper[5120]: I0316 16:48:13.091426 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6433979b-c153-4721-8866-0d9bcd0480bb-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"6433979b-c153-4721-8866-0d9bcd0480bb\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:48:13 crc kubenswrapper[5120]: I0316 16:48:13.091531 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/016dd61b-9c8d-4a62-a30f-5893f3aa41d7-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"016dd61b-9c8d-4a62-a30f-5893f3aa41d7\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:48:13 crc kubenswrapper[5120]: I0316 16:48:13.091858 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/016dd61b-9c8d-4a62-a30f-5893f3aa41d7-logs\") pod \"nova-api-0\" (UID: \"016dd61b-9c8d-4a62-a30f-5893f3aa41d7\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:48:13 crc kubenswrapper[5120]: I0316 16:48:13.098660 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/016dd61b-9c8d-4a62-a30f-5893f3aa41d7-config-data\") pod \"nova-api-0\" (UID: \"016dd61b-9c8d-4a62-a30f-5893f3aa41d7\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:48:13 crc kubenswrapper[5120]: I0316 16:48:13.098697 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6433979b-c153-4721-8866-0d9bcd0480bb-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"6433979b-c153-4721-8866-0d9bcd0480bb\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:48:13 crc kubenswrapper[5120]: I0316 16:48:13.099415 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6433979b-c153-4721-8866-0d9bcd0480bb-config-data\") pod \"nova-scheduler-0\" (UID: \"6433979b-c153-4721-8866-0d9bcd0480bb\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:48:13 crc kubenswrapper[5120]: I0316 16:48:13.100277 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/016dd61b-9c8d-4a62-a30f-5893f3aa41d7-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"016dd61b-9c8d-4a62-a30f-5893f3aa41d7\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:48:13 crc kubenswrapper[5120]: I0316 16:48:13.108969 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmbms\" (UniqueName: \"kubernetes.io/projected/016dd61b-9c8d-4a62-a30f-5893f3aa41d7-kube-api-access-hmbms\") pod \"nova-api-0\" (UID: \"016dd61b-9c8d-4a62-a30f-5893f3aa41d7\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:48:13 crc kubenswrapper[5120]: I0316 16:48:13.109529 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-znlrd\" (UniqueName: \"kubernetes.io/projected/6433979b-c153-4721-8866-0d9bcd0480bb-kube-api-access-znlrd\") pod \"nova-scheduler-0\" (UID: \"6433979b-c153-4721-8866-0d9bcd0480bb\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:48:13 crc kubenswrapper[5120]: I0316 16:48:13.289179 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:48:13 crc kubenswrapper[5120]: I0316 16:48:13.354638 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:48:13 crc kubenswrapper[5120]: I0316 16:48:13.741254 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:48:13 crc kubenswrapper[5120]: W0316 16:48:13.741730 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod016dd61b_9c8d_4a62_a30f_5893f3aa41d7.slice/crio-1a19d1a84a5791daf556544e978d38039eb9387d54be9dde3ff5c41ba5243189 WatchSource:0}: Error finding container 1a19d1a84a5791daf556544e978d38039eb9387d54be9dde3ff5c41ba5243189: Status 404 returned error can't find the container with id 1a19d1a84a5791daf556544e978d38039eb9387d54be9dde3ff5c41ba5243189 Mar 16 16:48:13 crc kubenswrapper[5120]: I0316 16:48:13.850473 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"a7864faa-1e6e-4644-a5f5-f51e429e1e2b","Type":"ContainerStarted","Data":"8e0902e36245c8105626461234c99769028f119d7a8f9080029df1ebb3dcb8df"} Mar 16 16:48:13 crc kubenswrapper[5120]: I0316 16:48:13.850859 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"a7864faa-1e6e-4644-a5f5-f51e429e1e2b","Type":"ContainerStarted","Data":"cf0a8f06eaed0e3687e612c1d60597d999644af14a5963369c5ba62e98f9bcb7"} Mar 16 16:48:13 crc kubenswrapper[5120]: I0316 16:48:13.850881 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"a7864faa-1e6e-4644-a5f5-f51e429e1e2b","Type":"ContainerStarted","Data":"3b5b2c377af57264b092d4a5622cb87435698c54adb1b0abdec8da8e7e9388b8"} Mar 16 16:48:13 crc kubenswrapper[5120]: I0316 16:48:13.852657 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:48:13 crc kubenswrapper[5120]: I0316 16:48:13.854694 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"016dd61b-9c8d-4a62-a30f-5893f3aa41d7","Type":"ContainerStarted","Data":"1a19d1a84a5791daf556544e978d38039eb9387d54be9dde3ff5c41ba5243189"} Mar 16 16:48:13 crc kubenswrapper[5120]: I0316 16:48:13.873290 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=2.873270822 podStartE2EDuration="2.873270822s" podCreationTimestamp="2026-03-16 16:48:11 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:48:13.87137004 +0000 UTC m=+4596.025301707" watchObservedRunningTime="2026-03-16 16:48:13.873270822 +0000 UTC m=+4596.027202479" Mar 16 16:48:13 crc kubenswrapper[5120]: W0316 16:48:13.877310 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6433979b_c153_4721_8866_0d9bcd0480bb.slice/crio-d3beee3372ca73605fce2f005f2d7157f670d8d40a35fd6b1fee04fb58657029 WatchSource:0}: Error finding container d3beee3372ca73605fce2f005f2d7157f670d8d40a35fd6b1fee04fb58657029: Status 404 returned error can't find the container with id d3beee3372ca73605fce2f005f2d7157f670d8d40a35fd6b1fee04fb58657029 Mar 16 16:48:14 crc kubenswrapper[5120]: I0316 16:48:14.676201 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="12cc9828-99e7-41ff-a791-04bf41f73d04" path="/var/lib/kubelet/pods/12cc9828-99e7-41ff-a791-04bf41f73d04/volumes" Mar 16 16:48:14 crc kubenswrapper[5120]: I0316 16:48:14.677278 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3fb21e8a-174a-4469-b1d1-675d191207be" path="/var/lib/kubelet/pods/3fb21e8a-174a-4469-b1d1-675d191207be/volumes" Mar 16 16:48:14 crc kubenswrapper[5120]: I0316 16:48:14.868116 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"6433979b-c153-4721-8866-0d9bcd0480bb","Type":"ContainerStarted","Data":"22d8a51d4ad3c9bcfd9809d3a1832743ec83f25d019d4ab903345f8d3f5e7a5b"} Mar 16 16:48:14 crc kubenswrapper[5120]: I0316 16:48:14.868442 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"6433979b-c153-4721-8866-0d9bcd0480bb","Type":"ContainerStarted","Data":"d3beee3372ca73605fce2f005f2d7157f670d8d40a35fd6b1fee04fb58657029"} Mar 16 16:48:14 crc kubenswrapper[5120]: I0316 16:48:14.871025 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"016dd61b-9c8d-4a62-a30f-5893f3aa41d7","Type":"ContainerStarted","Data":"ae3296fd136f37d44efdbffedb932b3d7fc4bb15548e013e662c90d6198d2a1b"} Mar 16 16:48:14 crc kubenswrapper[5120]: I0316 16:48:14.871070 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"016dd61b-9c8d-4a62-a30f-5893f3aa41d7","Type":"ContainerStarted","Data":"6ee451353950a7132e69bb0501c1336e4efe418735cba54a3fc794a9239eef2e"} Mar 16 16:48:14 crc kubenswrapper[5120]: I0316 16:48:14.894338 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=2.894317205 podStartE2EDuration="2.894317205s" podCreationTimestamp="2026-03-16 16:48:12 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:48:14.89340224 +0000 UTC m=+4597.047333897" watchObservedRunningTime="2026-03-16 16:48:14.894317205 +0000 UTC m=+4597.048248862" Mar 16 16:48:14 crc kubenswrapper[5120]: I0316 16:48:14.917250 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-scheduler-0" podStartSLOduration=2.917226503 podStartE2EDuration="2.917226503s" podCreationTimestamp="2026-03-16 16:48:12 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:48:14.909523881 +0000 UTC m=+4597.063455538" watchObservedRunningTime="2026-03-16 16:48:14.917226503 +0000 UTC m=+4597.071158160" Mar 16 16:48:18 crc kubenswrapper[5120]: I0316 16:48:18.355322 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:48:18 crc kubenswrapper[5120]: I0316 16:48:18.494056 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:48:22 crc kubenswrapper[5120]: I0316 16:48:22.461543 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:48:22 crc kubenswrapper[5120]: I0316 16:48:22.463536 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:48:22 crc kubenswrapper[5120]: I0316 16:48:22.663958 5120 scope.go:117] "RemoveContainer" containerID="35a7dd6e19084cee69ca16203bca6378ea0cdf6a685ca2093ab847e5904eb9e6" Mar 16 16:48:23 crc kubenswrapper[5120]: I0316 16:48:23.017972 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" event={"ID":"e2275cb4-4905-4d66-a87e-8010120db2bd","Type":"ContainerStarted","Data":"d95ef19660110ac1115024184453586b03ae38594893e63ab9da89b1f1382ac4"} Mar 16 16:48:23 crc kubenswrapper[5120]: I0316 16:48:23.289785 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:48:23 crc kubenswrapper[5120]: I0316 16:48:23.289877 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:48:23 crc kubenswrapper[5120]: I0316 16:48:23.355977 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:48:23 crc kubenswrapper[5120]: I0316 16:48:23.402148 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:48:23 crc kubenswrapper[5120]: I0316 16:48:23.503135 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="a7864faa-1e6e-4644-a5f5-f51e429e1e2b" containerName="nova-metadata-log" probeResult="failure" output="Get \"http://10.217.1.207:8775/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 16:48:23 crc kubenswrapper[5120]: I0316 16:48:23.503982 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="a7864faa-1e6e-4644-a5f5-f51e429e1e2b" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"http://10.217.1.207:8775/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 16:48:24 crc kubenswrapper[5120]: I0316 16:48:24.081912 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:48:24 crc kubenswrapper[5120]: I0316 16:48:24.331972 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="016dd61b-9c8d-4a62-a30f-5893f3aa41d7" containerName="nova-api-log" probeResult="failure" output="Get \"http://10.217.1.208:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 16:48:24 crc kubenswrapper[5120]: I0316 16:48:24.332053 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="016dd61b-9c8d-4a62-a30f-5893f3aa41d7" containerName="nova-api-api" probeResult="failure" output="Get \"http://10.217.1.208:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 16:48:30 crc kubenswrapper[5120]: I0316 16:48:30.461684 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:48:30 crc kubenswrapper[5120]: I0316 16:48:30.463314 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:48:31 crc kubenswrapper[5120]: I0316 16:48:31.290185 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:48:31 crc kubenswrapper[5120]: I0316 16:48:31.290242 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:48:32 crc kubenswrapper[5120]: I0316 16:48:32.463807 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:48:32 crc kubenswrapper[5120]: I0316 16:48:32.464238 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:48:32 crc kubenswrapper[5120]: I0316 16:48:32.465862 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:48:32 crc kubenswrapper[5120]: I0316 16:48:32.466360 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:48:33 crc kubenswrapper[5120]: I0316 16:48:33.294369 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:48:33 crc kubenswrapper[5120]: I0316 16:48:33.294445 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:48:33 crc kubenswrapper[5120]: I0316 16:48:33.297104 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:48:33 crc kubenswrapper[5120]: I0316 16:48:33.297913 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:48:35 crc kubenswrapper[5120]: I0316 16:48:35.127427 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:48:35 crc kubenswrapper[5120]: I0316 16:48:35.128146 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="97af92e8-708d-43e1-a696-09a0add1eeff" containerName="ceilometer-central-agent" containerID="cri-o://9d31d22d4ad32959dd0f3ad5a676d5bc90321a3c94e9c784124bf26f6f9761f5" gracePeriod=30 Mar 16 16:48:35 crc kubenswrapper[5120]: I0316 16:48:35.128308 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="97af92e8-708d-43e1-a696-09a0add1eeff" containerName="proxy-httpd" containerID="cri-o://3f3a7f32e25242218c3c35e2f06d8a5ac1293e8ab957875e4d641bceb15b40e3" gracePeriod=30 Mar 16 16:48:35 crc kubenswrapper[5120]: I0316 16:48:35.128356 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="97af92e8-708d-43e1-a696-09a0add1eeff" containerName="sg-core" containerID="cri-o://8a6fdfa8d205b11bcdadd5e12986b78f02788776ed316b85307b7596b793804f" gracePeriod=30 Mar 16 16:48:35 crc kubenswrapper[5120]: I0316 16:48:35.128396 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="97af92e8-708d-43e1-a696-09a0add1eeff" containerName="ceilometer-notification-agent" containerID="cri-o://aabeb8e05002f153b244132f42cd668f06d7a4f6f0c05e8d34fb494dca4b0b6c" gracePeriod=30 Mar 16 16:48:36 crc kubenswrapper[5120]: I0316 16:48:36.226336 5120 generic.go:358] "Generic (PLEG): container finished" podID="97af92e8-708d-43e1-a696-09a0add1eeff" containerID="3f3a7f32e25242218c3c35e2f06d8a5ac1293e8ab957875e4d641bceb15b40e3" exitCode=0 Mar 16 16:48:36 crc kubenswrapper[5120]: I0316 16:48:36.227144 5120 generic.go:358] "Generic (PLEG): container finished" podID="97af92e8-708d-43e1-a696-09a0add1eeff" containerID="8a6fdfa8d205b11bcdadd5e12986b78f02788776ed316b85307b7596b793804f" exitCode=2 Mar 16 16:48:36 crc kubenswrapper[5120]: I0316 16:48:36.227154 5120 generic.go:358] "Generic (PLEG): container finished" podID="97af92e8-708d-43e1-a696-09a0add1eeff" containerID="aabeb8e05002f153b244132f42cd668f06d7a4f6f0c05e8d34fb494dca4b0b6c" exitCode=0 Mar 16 16:48:36 crc kubenswrapper[5120]: I0316 16:48:36.227163 5120 generic.go:358] "Generic (PLEG): container finished" podID="97af92e8-708d-43e1-a696-09a0add1eeff" containerID="9d31d22d4ad32959dd0f3ad5a676d5bc90321a3c94e9c784124bf26f6f9761f5" exitCode=0 Mar 16 16:48:36 crc kubenswrapper[5120]: I0316 16:48:36.227500 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"97af92e8-708d-43e1-a696-09a0add1eeff","Type":"ContainerDied","Data":"3f3a7f32e25242218c3c35e2f06d8a5ac1293e8ab957875e4d641bceb15b40e3"} Mar 16 16:48:36 crc kubenswrapper[5120]: I0316 16:48:36.227612 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"97af92e8-708d-43e1-a696-09a0add1eeff","Type":"ContainerDied","Data":"8a6fdfa8d205b11bcdadd5e12986b78f02788776ed316b85307b7596b793804f"} Mar 16 16:48:36 crc kubenswrapper[5120]: I0316 16:48:36.227629 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"97af92e8-708d-43e1-a696-09a0add1eeff","Type":"ContainerDied","Data":"aabeb8e05002f153b244132f42cd668f06d7a4f6f0c05e8d34fb494dca4b0b6c"} Mar 16 16:48:36 crc kubenswrapper[5120]: I0316 16:48:36.227640 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"97af92e8-708d-43e1-a696-09a0add1eeff","Type":"ContainerDied","Data":"9d31d22d4ad32959dd0f3ad5a676d5bc90321a3c94e9c784124bf26f6f9761f5"} Mar 16 16:48:36 crc kubenswrapper[5120]: I0316 16:48:36.241669 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:48:36 crc kubenswrapper[5120]: I0316 16:48:36.330313 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/97af92e8-708d-43e1-a696-09a0add1eeff-combined-ca-bundle\") pod \"97af92e8-708d-43e1-a696-09a0add1eeff\" (UID: \"97af92e8-708d-43e1-a696-09a0add1eeff\") " Mar 16 16:48:36 crc kubenswrapper[5120]: I0316 16:48:36.330490 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/97af92e8-708d-43e1-a696-09a0add1eeff-run-httpd\") pod \"97af92e8-708d-43e1-a696-09a0add1eeff\" (UID: \"97af92e8-708d-43e1-a696-09a0add1eeff\") " Mar 16 16:48:36 crc kubenswrapper[5120]: I0316 16:48:36.330676 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fmfq4\" (UniqueName: \"kubernetes.io/projected/97af92e8-708d-43e1-a696-09a0add1eeff-kube-api-access-fmfq4\") pod \"97af92e8-708d-43e1-a696-09a0add1eeff\" (UID: \"97af92e8-708d-43e1-a696-09a0add1eeff\") " Mar 16 16:48:36 crc kubenswrapper[5120]: I0316 16:48:36.330827 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/97af92e8-708d-43e1-a696-09a0add1eeff-config-data\") pod \"97af92e8-708d-43e1-a696-09a0add1eeff\" (UID: \"97af92e8-708d-43e1-a696-09a0add1eeff\") " Mar 16 16:48:36 crc kubenswrapper[5120]: I0316 16:48:36.330959 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/97af92e8-708d-43e1-a696-09a0add1eeff-sg-core-conf-yaml\") pod \"97af92e8-708d-43e1-a696-09a0add1eeff\" (UID: \"97af92e8-708d-43e1-a696-09a0add1eeff\") " Mar 16 16:48:36 crc kubenswrapper[5120]: I0316 16:48:36.331344 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/97af92e8-708d-43e1-a696-09a0add1eeff-scripts\") pod \"97af92e8-708d-43e1-a696-09a0add1eeff\" (UID: \"97af92e8-708d-43e1-a696-09a0add1eeff\") " Mar 16 16:48:36 crc kubenswrapper[5120]: I0316 16:48:36.331398 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/97af92e8-708d-43e1-a696-09a0add1eeff-log-httpd\") pod \"97af92e8-708d-43e1-a696-09a0add1eeff\" (UID: \"97af92e8-708d-43e1-a696-09a0add1eeff\") " Mar 16 16:48:36 crc kubenswrapper[5120]: I0316 16:48:36.332924 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97af92e8-708d-43e1-a696-09a0add1eeff-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "97af92e8-708d-43e1-a696-09a0add1eeff" (UID: "97af92e8-708d-43e1-a696-09a0add1eeff"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:48:36 crc kubenswrapper[5120]: I0316 16:48:36.333805 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97af92e8-708d-43e1-a696-09a0add1eeff-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "97af92e8-708d-43e1-a696-09a0add1eeff" (UID: "97af92e8-708d-43e1-a696-09a0add1eeff"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:48:36 crc kubenswrapper[5120]: I0316 16:48:36.338803 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/97af92e8-708d-43e1-a696-09a0add1eeff-scripts" (OuterVolumeSpecName: "scripts") pod "97af92e8-708d-43e1-a696-09a0add1eeff" (UID: "97af92e8-708d-43e1-a696-09a0add1eeff"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:48:36 crc kubenswrapper[5120]: I0316 16:48:36.338807 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97af92e8-708d-43e1-a696-09a0add1eeff-kube-api-access-fmfq4" (OuterVolumeSpecName: "kube-api-access-fmfq4") pod "97af92e8-708d-43e1-a696-09a0add1eeff" (UID: "97af92e8-708d-43e1-a696-09a0add1eeff"). InnerVolumeSpecName "kube-api-access-fmfq4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:48:36 crc kubenswrapper[5120]: I0316 16:48:36.362826 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/97af92e8-708d-43e1-a696-09a0add1eeff-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "97af92e8-708d-43e1-a696-09a0add1eeff" (UID: "97af92e8-708d-43e1-a696-09a0add1eeff"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:48:36 crc kubenswrapper[5120]: I0316 16:48:36.414045 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/97af92e8-708d-43e1-a696-09a0add1eeff-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "97af92e8-708d-43e1-a696-09a0add1eeff" (UID: "97af92e8-708d-43e1-a696-09a0add1eeff"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:48:36 crc kubenswrapper[5120]: I0316 16:48:36.434457 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/97af92e8-708d-43e1-a696-09a0add1eeff-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 16:48:36 crc kubenswrapper[5120]: I0316 16:48:36.434497 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/97af92e8-708d-43e1-a696-09a0add1eeff-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:48:36 crc kubenswrapper[5120]: I0316 16:48:36.434512 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/97af92e8-708d-43e1-a696-09a0add1eeff-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:48:36 crc kubenswrapper[5120]: I0316 16:48:36.434523 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/97af92e8-708d-43e1-a696-09a0add1eeff-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:48:36 crc kubenswrapper[5120]: I0316 16:48:36.434535 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/97af92e8-708d-43e1-a696-09a0add1eeff-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:48:36 crc kubenswrapper[5120]: I0316 16:48:36.434547 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fmfq4\" (UniqueName: \"kubernetes.io/projected/97af92e8-708d-43e1-a696-09a0add1eeff-kube-api-access-fmfq4\") on node \"crc\" DevicePath \"\"" Mar 16 16:48:36 crc kubenswrapper[5120]: I0316 16:48:36.437439 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/97af92e8-708d-43e1-a696-09a0add1eeff-config-data" (OuterVolumeSpecName: "config-data") pod "97af92e8-708d-43e1-a696-09a0add1eeff" (UID: "97af92e8-708d-43e1-a696-09a0add1eeff"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:48:36 crc kubenswrapper[5120]: I0316 16:48:36.536426 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/97af92e8-708d-43e1-a696-09a0add1eeff-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:48:37 crc kubenswrapper[5120]: I0316 16:48:37.244523 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:48:37 crc kubenswrapper[5120]: I0316 16:48:37.244742 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"97af92e8-708d-43e1-a696-09a0add1eeff","Type":"ContainerDied","Data":"e657b22e8fe8c1a6eb71a2699c7a02232ac853bc27b666ad9a460eb7d2668261"} Mar 16 16:48:37 crc kubenswrapper[5120]: I0316 16:48:37.245208 5120 scope.go:117] "RemoveContainer" containerID="3f3a7f32e25242218c3c35e2f06d8a5ac1293e8ab957875e4d641bceb15b40e3" Mar 16 16:48:37 crc kubenswrapper[5120]: I0316 16:48:37.277916 5120 scope.go:117] "RemoveContainer" containerID="8a6fdfa8d205b11bcdadd5e12986b78f02788776ed316b85307b7596b793804f" Mar 16 16:48:37 crc kubenswrapper[5120]: I0316 16:48:37.289821 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:48:37 crc kubenswrapper[5120]: I0316 16:48:37.304607 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:48:37 crc kubenswrapper[5120]: I0316 16:48:37.318372 5120 scope.go:117] "RemoveContainer" containerID="aabeb8e05002f153b244132f42cd668f06d7a4f6f0c05e8d34fb494dca4b0b6c" Mar 16 16:48:37 crc kubenswrapper[5120]: I0316 16:48:37.318579 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:48:37 crc kubenswrapper[5120]: I0316 16:48:37.322112 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97af92e8-708d-43e1-a696-09a0add1eeff" containerName="sg-core" Mar 16 16:48:37 crc kubenswrapper[5120]: I0316 16:48:37.322178 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="97af92e8-708d-43e1-a696-09a0add1eeff" containerName="sg-core" Mar 16 16:48:37 crc kubenswrapper[5120]: I0316 16:48:37.322273 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97af92e8-708d-43e1-a696-09a0add1eeff" containerName="ceilometer-notification-agent" Mar 16 16:48:37 crc kubenswrapper[5120]: I0316 16:48:37.322283 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="97af92e8-708d-43e1-a696-09a0add1eeff" containerName="ceilometer-notification-agent" Mar 16 16:48:37 crc kubenswrapper[5120]: I0316 16:48:37.322315 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97af92e8-708d-43e1-a696-09a0add1eeff" containerName="proxy-httpd" Mar 16 16:48:37 crc kubenswrapper[5120]: I0316 16:48:37.322325 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="97af92e8-708d-43e1-a696-09a0add1eeff" containerName="proxy-httpd" Mar 16 16:48:37 crc kubenswrapper[5120]: I0316 16:48:37.322342 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97af92e8-708d-43e1-a696-09a0add1eeff" containerName="ceilometer-central-agent" Mar 16 16:48:37 crc kubenswrapper[5120]: I0316 16:48:37.322351 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="97af92e8-708d-43e1-a696-09a0add1eeff" containerName="ceilometer-central-agent" Mar 16 16:48:37 crc kubenswrapper[5120]: I0316 16:48:37.322594 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="97af92e8-708d-43e1-a696-09a0add1eeff" containerName="ceilometer-central-agent" Mar 16 16:48:37 crc kubenswrapper[5120]: I0316 16:48:37.322609 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="97af92e8-708d-43e1-a696-09a0add1eeff" containerName="proxy-httpd" Mar 16 16:48:37 crc kubenswrapper[5120]: I0316 16:48:37.322636 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="97af92e8-708d-43e1-a696-09a0add1eeff" containerName="sg-core" Mar 16 16:48:37 crc kubenswrapper[5120]: I0316 16:48:37.322653 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="97af92e8-708d-43e1-a696-09a0add1eeff" containerName="ceilometer-notification-agent" Mar 16 16:48:37 crc kubenswrapper[5120]: I0316 16:48:37.344086 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:48:37 crc kubenswrapper[5120]: I0316 16:48:37.344263 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:48:37 crc kubenswrapper[5120]: I0316 16:48:37.347350 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 16:48:37 crc kubenswrapper[5120]: I0316 16:48:37.347511 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 16:48:37 crc kubenswrapper[5120]: I0316 16:48:37.355209 5120 scope.go:117] "RemoveContainer" containerID="9d31d22d4ad32959dd0f3ad5a676d5bc90321a3c94e9c784124bf26f6f9761f5" Mar 16 16:48:37 crc kubenswrapper[5120]: I0316 16:48:37.457330 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/845a4572-72f5-4247-b546-c9974f7ae78d-log-httpd\") pod \"ceilometer-0\" (UID: \"845a4572-72f5-4247-b546-c9974f7ae78d\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:48:37 crc kubenswrapper[5120]: I0316 16:48:37.457650 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/845a4572-72f5-4247-b546-c9974f7ae78d-run-httpd\") pod \"ceilometer-0\" (UID: \"845a4572-72f5-4247-b546-c9974f7ae78d\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:48:37 crc kubenswrapper[5120]: I0316 16:48:37.457719 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/845a4572-72f5-4247-b546-c9974f7ae78d-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"845a4572-72f5-4247-b546-c9974f7ae78d\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:48:37 crc kubenswrapper[5120]: I0316 16:48:37.457783 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/845a4572-72f5-4247-b546-c9974f7ae78d-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"845a4572-72f5-4247-b546-c9974f7ae78d\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:48:37 crc kubenswrapper[5120]: I0316 16:48:37.458157 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/845a4572-72f5-4247-b546-c9974f7ae78d-scripts\") pod \"ceilometer-0\" (UID: \"845a4572-72f5-4247-b546-c9974f7ae78d\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:48:37 crc kubenswrapper[5120]: I0316 16:48:37.458370 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vb8g\" (UniqueName: \"kubernetes.io/projected/845a4572-72f5-4247-b546-c9974f7ae78d-kube-api-access-9vb8g\") pod \"ceilometer-0\" (UID: \"845a4572-72f5-4247-b546-c9974f7ae78d\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:48:37 crc kubenswrapper[5120]: I0316 16:48:37.458412 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/845a4572-72f5-4247-b546-c9974f7ae78d-config-data\") pod \"ceilometer-0\" (UID: \"845a4572-72f5-4247-b546-c9974f7ae78d\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:48:37 crc kubenswrapper[5120]: I0316 16:48:37.561158 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/845a4572-72f5-4247-b546-c9974f7ae78d-log-httpd\") pod \"ceilometer-0\" (UID: \"845a4572-72f5-4247-b546-c9974f7ae78d\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:48:37 crc kubenswrapper[5120]: I0316 16:48:37.561300 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/845a4572-72f5-4247-b546-c9974f7ae78d-run-httpd\") pod \"ceilometer-0\" (UID: \"845a4572-72f5-4247-b546-c9974f7ae78d\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:48:37 crc kubenswrapper[5120]: I0316 16:48:37.561324 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/845a4572-72f5-4247-b546-c9974f7ae78d-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"845a4572-72f5-4247-b546-c9974f7ae78d\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:48:37 crc kubenswrapper[5120]: I0316 16:48:37.561357 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/845a4572-72f5-4247-b546-c9974f7ae78d-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"845a4572-72f5-4247-b546-c9974f7ae78d\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:48:37 crc kubenswrapper[5120]: I0316 16:48:37.561534 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/845a4572-72f5-4247-b546-c9974f7ae78d-scripts\") pod \"ceilometer-0\" (UID: \"845a4572-72f5-4247-b546-c9974f7ae78d\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:48:37 crc kubenswrapper[5120]: I0316 16:48:37.561682 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9vb8g\" (UniqueName: \"kubernetes.io/projected/845a4572-72f5-4247-b546-c9974f7ae78d-kube-api-access-9vb8g\") pod \"ceilometer-0\" (UID: \"845a4572-72f5-4247-b546-c9974f7ae78d\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:48:37 crc kubenswrapper[5120]: I0316 16:48:37.561715 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/845a4572-72f5-4247-b546-c9974f7ae78d-config-data\") pod \"ceilometer-0\" (UID: \"845a4572-72f5-4247-b546-c9974f7ae78d\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:48:37 crc kubenswrapper[5120]: I0316 16:48:37.562102 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/845a4572-72f5-4247-b546-c9974f7ae78d-log-httpd\") pod \"ceilometer-0\" (UID: \"845a4572-72f5-4247-b546-c9974f7ae78d\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:48:37 crc kubenswrapper[5120]: I0316 16:48:37.562165 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/845a4572-72f5-4247-b546-c9974f7ae78d-run-httpd\") pod \"ceilometer-0\" (UID: \"845a4572-72f5-4247-b546-c9974f7ae78d\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:48:37 crc kubenswrapper[5120]: I0316 16:48:37.568800 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/845a4572-72f5-4247-b546-c9974f7ae78d-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"845a4572-72f5-4247-b546-c9974f7ae78d\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:48:37 crc kubenswrapper[5120]: I0316 16:48:37.568850 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/845a4572-72f5-4247-b546-c9974f7ae78d-scripts\") pod \"ceilometer-0\" (UID: \"845a4572-72f5-4247-b546-c9974f7ae78d\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:48:37 crc kubenswrapper[5120]: I0316 16:48:37.568905 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/845a4572-72f5-4247-b546-c9974f7ae78d-config-data\") pod \"ceilometer-0\" (UID: \"845a4572-72f5-4247-b546-c9974f7ae78d\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:48:37 crc kubenswrapper[5120]: I0316 16:48:37.571016 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/845a4572-72f5-4247-b546-c9974f7ae78d-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"845a4572-72f5-4247-b546-c9974f7ae78d\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:48:37 crc kubenswrapper[5120]: I0316 16:48:37.582229 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vb8g\" (UniqueName: \"kubernetes.io/projected/845a4572-72f5-4247-b546-c9974f7ae78d-kube-api-access-9vb8g\") pod \"ceilometer-0\" (UID: \"845a4572-72f5-4247-b546-c9974f7ae78d\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:48:37 crc kubenswrapper[5120]: I0316 16:48:37.668787 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:48:38 crc kubenswrapper[5120]: I0316 16:48:38.139263 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:48:38 crc kubenswrapper[5120]: W0316 16:48:38.142006 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod845a4572_72f5_4247_b546_c9974f7ae78d.slice/crio-073a2d08e95b6faa5cad043ae49363bafb4974cd9985fc26d5dfbcadafe33ff3 WatchSource:0}: Error finding container 073a2d08e95b6faa5cad043ae49363bafb4974cd9985fc26d5dfbcadafe33ff3: Status 404 returned error can't find the container with id 073a2d08e95b6faa5cad043ae49363bafb4974cd9985fc26d5dfbcadafe33ff3 Mar 16 16:48:38 crc kubenswrapper[5120]: I0316 16:48:38.257800 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"845a4572-72f5-4247-b546-c9974f7ae78d","Type":"ContainerStarted","Data":"073a2d08e95b6faa5cad043ae49363bafb4974cd9985fc26d5dfbcadafe33ff3"} Mar 16 16:48:38 crc kubenswrapper[5120]: I0316 16:48:38.683727 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="97af92e8-708d-43e1-a696-09a0add1eeff" path="/var/lib/kubelet/pods/97af92e8-708d-43e1-a696-09a0add1eeff/volumes" Mar 16 16:48:39 crc kubenswrapper[5120]: I0316 16:48:39.269033 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"845a4572-72f5-4247-b546-c9974f7ae78d","Type":"ContainerStarted","Data":"ee76de54b5123c4dfd41f8ebbde4df9133509c49a4031078292d09bed98358e3"} Mar 16 16:48:40 crc kubenswrapper[5120]: I0316 16:48:40.301693 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"845a4572-72f5-4247-b546-c9974f7ae78d","Type":"ContainerStarted","Data":"e395c97f46524d2be4c3f22c7dd5e308856748f9b69a0197842a05ba44953ce8"} Mar 16 16:48:40 crc kubenswrapper[5120]: I0316 16:48:40.610170 5120 scope.go:117] "RemoveContainer" containerID="3b41ba48fc5e4fef65e0512c491ade0925ab29f2fc97fe6fdf0ec45d6bdc38ce" Mar 16 16:48:40 crc kubenswrapper[5120]: I0316 16:48:40.861797 5120 scope.go:117] "RemoveContainer" containerID="5b2c10361ce32e62cbc26f25779afcb963c9d2c3b460f958122b9cbe6ba8e51a" Mar 16 16:48:41 crc kubenswrapper[5120]: I0316 16:48:41.317734 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"845a4572-72f5-4247-b546-c9974f7ae78d","Type":"ContainerStarted","Data":"d16d8b561d29194b70bd7462a92933c5a49972813766602967563ef931d51af3"} Mar 16 16:48:45 crc kubenswrapper[5120]: I0316 16:48:45.369443 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"845a4572-72f5-4247-b546-c9974f7ae78d","Type":"ContainerStarted","Data":"a1342b28e33d351be9c4dcf0a337be7231153eb4a15daff492d2ab2085cab787"} Mar 16 16:48:45 crc kubenswrapper[5120]: I0316 16:48:45.370203 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:48:45 crc kubenswrapper[5120]: I0316 16:48:45.393501 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.164231124 podStartE2EDuration="8.393483352s" podCreationTimestamp="2026-03-16 16:48:37 +0000 UTC" firstStartedPulling="2026-03-16 16:48:38.144349944 +0000 UTC m=+4620.298281601" lastFinishedPulling="2026-03-16 16:48:44.373602182 +0000 UTC m=+4626.527533829" observedRunningTime="2026-03-16 16:48:45.392382952 +0000 UTC m=+4627.546314629" watchObservedRunningTime="2026-03-16 16:48:45.393483352 +0000 UTC m=+4627.547415179" Mar 16 16:49:07 crc kubenswrapper[5120]: E0316 16:49:07.950927 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1872310 actualBytes=10240 Mar 16 16:49:16 crc kubenswrapper[5120]: I0316 16:49:16.384303 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:49:27 crc kubenswrapper[5120]: I0316 16:49:27.910775 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:49:27 crc kubenswrapper[5120]: I0316 16:49:27.911655 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="03693dff-f5dd-4199-8cb2-e6f12d5a0703" containerName="cinder-scheduler" containerID="cri-o://f12dd69527499a1398e4a608adaef103b3aa7f300de680b04045d0b9a14eedc2" gracePeriod=30 Mar 16 16:49:27 crc kubenswrapper[5120]: I0316 16:49:27.911719 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="03693dff-f5dd-4199-8cb2-e6f12d5a0703" containerName="probe" containerID="cri-o://56bafd5d554c07424b2372cb9d09d48c6c8a503553bf48586be2bda216c559d8" gracePeriod=30 Mar 16 16:49:27 crc kubenswrapper[5120]: I0316 16:49:27.936523 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 16:49:28 crc kubenswrapper[5120]: I0316 16:49:28.038988 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-worker-7766ff8bd9-h465l"] Mar 16 16:49:28 crc kubenswrapper[5120]: I0316 16:49:28.060663 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-7766ff8bd9-h465l" Mar 16 16:49:28 crc kubenswrapper[5120]: I0316 16:49:28.125398 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-7c948f8f9d-v55lx"] Mar 16 16:49:28 crc kubenswrapper[5120]: I0316 16:49:28.146574 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-7c948f8f9d-v55lx" Mar 16 16:49:28 crc kubenswrapper[5120]: I0316 16:49:28.157545 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-7766ff8bd9-h465l"] Mar 16 16:49:28 crc kubenswrapper[5120]: I0316 16:49:28.183079 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bcef263e-93a6-4f2b-9447-230cf3444ebb-config-data\") pod \"barbican-worker-7766ff8bd9-h465l\" (UID: \"bcef263e-93a6-4f2b-9447-230cf3444ebb\") " pod="openstack-kuttl-tests/barbican-worker-7766ff8bd9-h465l" Mar 16 16:49:28 crc kubenswrapper[5120]: I0316 16:49:28.183205 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/bcef263e-93a6-4f2b-9447-230cf3444ebb-logs\") pod \"barbican-worker-7766ff8bd9-h465l\" (UID: \"bcef263e-93a6-4f2b-9447-230cf3444ebb\") " pod="openstack-kuttl-tests/barbican-worker-7766ff8bd9-h465l" Mar 16 16:49:28 crc kubenswrapper[5120]: I0316 16:49:28.183249 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9fjw2\" (UniqueName: \"kubernetes.io/projected/bcef263e-93a6-4f2b-9447-230cf3444ebb-kube-api-access-9fjw2\") pod \"barbican-worker-7766ff8bd9-h465l\" (UID: \"bcef263e-93a6-4f2b-9447-230cf3444ebb\") " pod="openstack-kuttl-tests/barbican-worker-7766ff8bd9-h465l" Mar 16 16:49:28 crc kubenswrapper[5120]: I0316 16:49:28.183269 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bcef263e-93a6-4f2b-9447-230cf3444ebb-combined-ca-bundle\") pod \"barbican-worker-7766ff8bd9-h465l\" (UID: \"bcef263e-93a6-4f2b-9447-230cf3444ebb\") " pod="openstack-kuttl-tests/barbican-worker-7766ff8bd9-h465l" Mar 16 16:49:28 crc kubenswrapper[5120]: I0316 16:49:28.183434 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/bcef263e-93a6-4f2b-9447-230cf3444ebb-config-data-custom\") pod \"barbican-worker-7766ff8bd9-h465l\" (UID: \"bcef263e-93a6-4f2b-9447-230cf3444ebb\") " pod="openstack-kuttl-tests/barbican-worker-7766ff8bd9-h465l" Mar 16 16:49:28 crc kubenswrapper[5120]: I0316 16:49:28.186829 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:49:28 crc kubenswrapper[5120]: I0316 16:49:28.187130 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="5988349f-8dba-4fde-acf3-6d8acf01117f" containerName="cinder-api-log" containerID="cri-o://94adda9f3db9d3289d254844d87731640cdd1c022dc2c28e816cc1f45741e90a" gracePeriod=30 Mar 16 16:49:28 crc kubenswrapper[5120]: I0316 16:49:28.187274 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="5988349f-8dba-4fde-acf3-6d8acf01117f" containerName="cinder-api" containerID="cri-o://337f914f7d65a7cc1d629598ef727728aeeeb98f0d532479dda2dac058d447f5" gracePeriod=30 Mar 16 16:49:28 crc kubenswrapper[5120]: I0316 16:49:28.224533 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-7c948f8f9d-v55lx"] Mar 16 16:49:28 crc kubenswrapper[5120]: I0316 16:49:28.252407 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-7b66994cdb-4jkjq"] Mar 16 16:49:28 crc kubenswrapper[5120]: I0316 16:49:28.271389 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-7b66994cdb-4jkjq" Mar 16 16:49:28 crc kubenswrapper[5120]: I0316 16:49:28.285731 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0be76020-d856-43c3-a89a-7ab5b83c0606-logs\") pod \"barbican-keystone-listener-7c948f8f9d-v55lx\" (UID: \"0be76020-d856-43c3-a89a-7ab5b83c0606\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7c948f8f9d-v55lx" Mar 16 16:49:28 crc kubenswrapper[5120]: I0316 16:49:28.285900 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0be76020-d856-43c3-a89a-7ab5b83c0606-config-data\") pod \"barbican-keystone-listener-7c948f8f9d-v55lx\" (UID: \"0be76020-d856-43c3-a89a-7ab5b83c0606\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7c948f8f9d-v55lx" Mar 16 16:49:28 crc kubenswrapper[5120]: I0316 16:49:28.285977 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8kqhx\" (UniqueName: \"kubernetes.io/projected/0be76020-d856-43c3-a89a-7ab5b83c0606-kube-api-access-8kqhx\") pod \"barbican-keystone-listener-7c948f8f9d-v55lx\" (UID: \"0be76020-d856-43c3-a89a-7ab5b83c0606\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7c948f8f9d-v55lx" Mar 16 16:49:28 crc kubenswrapper[5120]: I0316 16:49:28.286135 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/bcef263e-93a6-4f2b-9447-230cf3444ebb-config-data-custom\") pod \"barbican-worker-7766ff8bd9-h465l\" (UID: \"bcef263e-93a6-4f2b-9447-230cf3444ebb\") " pod="openstack-kuttl-tests/barbican-worker-7766ff8bd9-h465l" Mar 16 16:49:28 crc kubenswrapper[5120]: I0316 16:49:28.286281 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bcef263e-93a6-4f2b-9447-230cf3444ebb-config-data\") pod \"barbican-worker-7766ff8bd9-h465l\" (UID: \"bcef263e-93a6-4f2b-9447-230cf3444ebb\") " pod="openstack-kuttl-tests/barbican-worker-7766ff8bd9-h465l" Mar 16 16:49:28 crc kubenswrapper[5120]: I0316 16:49:28.286422 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0be76020-d856-43c3-a89a-7ab5b83c0606-combined-ca-bundle\") pod \"barbican-keystone-listener-7c948f8f9d-v55lx\" (UID: \"0be76020-d856-43c3-a89a-7ab5b83c0606\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7c948f8f9d-v55lx" Mar 16 16:49:28 crc kubenswrapper[5120]: I0316 16:49:28.286492 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/bcef263e-93a6-4f2b-9447-230cf3444ebb-logs\") pod \"barbican-worker-7766ff8bd9-h465l\" (UID: \"bcef263e-93a6-4f2b-9447-230cf3444ebb\") " pod="openstack-kuttl-tests/barbican-worker-7766ff8bd9-h465l" Mar 16 16:49:28 crc kubenswrapper[5120]: I0316 16:49:28.286558 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9fjw2\" (UniqueName: \"kubernetes.io/projected/bcef263e-93a6-4f2b-9447-230cf3444ebb-kube-api-access-9fjw2\") pod \"barbican-worker-7766ff8bd9-h465l\" (UID: \"bcef263e-93a6-4f2b-9447-230cf3444ebb\") " pod="openstack-kuttl-tests/barbican-worker-7766ff8bd9-h465l" Mar 16 16:49:28 crc kubenswrapper[5120]: I0316 16:49:28.286582 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bcef263e-93a6-4f2b-9447-230cf3444ebb-combined-ca-bundle\") pod \"barbican-worker-7766ff8bd9-h465l\" (UID: \"bcef263e-93a6-4f2b-9447-230cf3444ebb\") " pod="openstack-kuttl-tests/barbican-worker-7766ff8bd9-h465l" Mar 16 16:49:28 crc kubenswrapper[5120]: I0316 16:49:28.286624 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/0be76020-d856-43c3-a89a-7ab5b83c0606-config-data-custom\") pod \"barbican-keystone-listener-7c948f8f9d-v55lx\" (UID: \"0be76020-d856-43c3-a89a-7ab5b83c0606\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7c948f8f9d-v55lx" Mar 16 16:49:28 crc kubenswrapper[5120]: I0316 16:49:28.287577 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/bcef263e-93a6-4f2b-9447-230cf3444ebb-logs\") pod \"barbican-worker-7766ff8bd9-h465l\" (UID: \"bcef263e-93a6-4f2b-9447-230cf3444ebb\") " pod="openstack-kuttl-tests/barbican-worker-7766ff8bd9-h465l" Mar 16 16:49:28 crc kubenswrapper[5120]: I0316 16:49:28.289844 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-7b66994cdb-4jkjq"] Mar 16 16:49:28 crc kubenswrapper[5120]: I0316 16:49:28.306664 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bcef263e-93a6-4f2b-9447-230cf3444ebb-combined-ca-bundle\") pod \"barbican-worker-7766ff8bd9-h465l\" (UID: \"bcef263e-93a6-4f2b-9447-230cf3444ebb\") " pod="openstack-kuttl-tests/barbican-worker-7766ff8bd9-h465l" Mar 16 16:49:28 crc kubenswrapper[5120]: I0316 16:49:28.317711 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/bcef263e-93a6-4f2b-9447-230cf3444ebb-config-data-custom\") pod \"barbican-worker-7766ff8bd9-h465l\" (UID: \"bcef263e-93a6-4f2b-9447-230cf3444ebb\") " pod="openstack-kuttl-tests/barbican-worker-7766ff8bd9-h465l" Mar 16 16:49:28 crc kubenswrapper[5120]: I0316 16:49:28.321786 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bcef263e-93a6-4f2b-9447-230cf3444ebb-config-data\") pod \"barbican-worker-7766ff8bd9-h465l\" (UID: \"bcef263e-93a6-4f2b-9447-230cf3444ebb\") " pod="openstack-kuttl-tests/barbican-worker-7766ff8bd9-h465l" Mar 16 16:49:28 crc kubenswrapper[5120]: I0316 16:49:28.338726 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9fjw2\" (UniqueName: \"kubernetes.io/projected/bcef263e-93a6-4f2b-9447-230cf3444ebb-kube-api-access-9fjw2\") pod \"barbican-worker-7766ff8bd9-h465l\" (UID: \"bcef263e-93a6-4f2b-9447-230cf3444ebb\") " pod="openstack-kuttl-tests/barbican-worker-7766ff8bd9-h465l" Mar 16 16:49:28 crc kubenswrapper[5120]: I0316 16:49:28.354578 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-7c948f8f9d-v55lx"] Mar 16 16:49:28 crc kubenswrapper[5120]: E0316 16:49:28.355433 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[combined-ca-bundle config-data config-data-custom kube-api-access-8kqhx logs], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openstack-kuttl-tests/barbican-keystone-listener-7c948f8f9d-v55lx" podUID="0be76020-d856-43c3-a89a-7ab5b83c0606" Mar 16 16:49:28 crc kubenswrapper[5120]: I0316 16:49:28.388864 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-747966fd58-rqj7f"] Mar 16 16:49:28 crc kubenswrapper[5120]: I0316 16:49:28.391107 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0be76020-d856-43c3-a89a-7ab5b83c0606-combined-ca-bundle\") pod \"barbican-keystone-listener-7c948f8f9d-v55lx\" (UID: \"0be76020-d856-43c3-a89a-7ab5b83c0606\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7c948f8f9d-v55lx" Mar 16 16:49:28 crc kubenswrapper[5120]: I0316 16:49:28.391264 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/0be76020-d856-43c3-a89a-7ab5b83c0606-config-data-custom\") pod \"barbican-keystone-listener-7c948f8f9d-v55lx\" (UID: \"0be76020-d856-43c3-a89a-7ab5b83c0606\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7c948f8f9d-v55lx" Mar 16 16:49:28 crc kubenswrapper[5120]: I0316 16:49:28.391315 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/011b06d9-6610-4fc7-97ab-697050a06ec4-config\") pod \"neutron-7b66994cdb-4jkjq\" (UID: \"011b06d9-6610-4fc7-97ab-697050a06ec4\") " pod="openstack-kuttl-tests/neutron-7b66994cdb-4jkjq" Mar 16 16:49:28 crc kubenswrapper[5120]: I0316 16:49:28.391394 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/011b06d9-6610-4fc7-97ab-697050a06ec4-httpd-config\") pod \"neutron-7b66994cdb-4jkjq\" (UID: \"011b06d9-6610-4fc7-97ab-697050a06ec4\") " pod="openstack-kuttl-tests/neutron-7b66994cdb-4jkjq" Mar 16 16:49:28 crc kubenswrapper[5120]: I0316 16:49:28.391440 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0be76020-d856-43c3-a89a-7ab5b83c0606-logs\") pod \"barbican-keystone-listener-7c948f8f9d-v55lx\" (UID: \"0be76020-d856-43c3-a89a-7ab5b83c0606\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7c948f8f9d-v55lx" Mar 16 16:49:28 crc kubenswrapper[5120]: I0316 16:49:28.391469 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/011b06d9-6610-4fc7-97ab-697050a06ec4-combined-ca-bundle\") pod \"neutron-7b66994cdb-4jkjq\" (UID: \"011b06d9-6610-4fc7-97ab-697050a06ec4\") " pod="openstack-kuttl-tests/neutron-7b66994cdb-4jkjq" Mar 16 16:49:28 crc kubenswrapper[5120]: I0316 16:49:28.391519 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0be76020-d856-43c3-a89a-7ab5b83c0606-config-data\") pod \"barbican-keystone-listener-7c948f8f9d-v55lx\" (UID: \"0be76020-d856-43c3-a89a-7ab5b83c0606\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7c948f8f9d-v55lx" Mar 16 16:49:28 crc kubenswrapper[5120]: I0316 16:49:28.391564 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8kqhx\" (UniqueName: \"kubernetes.io/projected/0be76020-d856-43c3-a89a-7ab5b83c0606-kube-api-access-8kqhx\") pod \"barbican-keystone-listener-7c948f8f9d-v55lx\" (UID: \"0be76020-d856-43c3-a89a-7ab5b83c0606\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7c948f8f9d-v55lx" Mar 16 16:49:28 crc kubenswrapper[5120]: I0316 16:49:28.391606 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qgfjn\" (UniqueName: \"kubernetes.io/projected/011b06d9-6610-4fc7-97ab-697050a06ec4-kube-api-access-qgfjn\") pod \"neutron-7b66994cdb-4jkjq\" (UID: \"011b06d9-6610-4fc7-97ab-697050a06ec4\") " pod="openstack-kuttl-tests/neutron-7b66994cdb-4jkjq" Mar 16 16:49:28 crc kubenswrapper[5120]: I0316 16:49:28.392979 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0be76020-d856-43c3-a89a-7ab5b83c0606-logs\") pod \"barbican-keystone-listener-7c948f8f9d-v55lx\" (UID: \"0be76020-d856-43c3-a89a-7ab5b83c0606\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7c948f8f9d-v55lx" Mar 16 16:49:28 crc kubenswrapper[5120]: I0316 16:49:28.404516 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-747966fd58-rqj7f" Mar 16 16:49:28 crc kubenswrapper[5120]: I0316 16:49:28.431627 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0be76020-d856-43c3-a89a-7ab5b83c0606-combined-ca-bundle\") pod \"barbican-keystone-listener-7c948f8f9d-v55lx\" (UID: \"0be76020-d856-43c3-a89a-7ab5b83c0606\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7c948f8f9d-v55lx" Mar 16 16:49:28 crc kubenswrapper[5120]: I0316 16:49:28.431937 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0be76020-d856-43c3-a89a-7ab5b83c0606-config-data\") pod \"barbican-keystone-listener-7c948f8f9d-v55lx\" (UID: \"0be76020-d856-43c3-a89a-7ab5b83c0606\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7c948f8f9d-v55lx" Mar 16 16:49:28 crc kubenswrapper[5120]: I0316 16:49:28.441100 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-7766ff8bd9-h465l" Mar 16 16:49:28 crc kubenswrapper[5120]: I0316 16:49:28.484341 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-747966fd58-rqj7f"] Mar 16 16:49:28 crc kubenswrapper[5120]: I0316 16:49:28.486440 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/0be76020-d856-43c3-a89a-7ab5b83c0606-config-data-custom\") pod \"barbican-keystone-listener-7c948f8f9d-v55lx\" (UID: \"0be76020-d856-43c3-a89a-7ab5b83c0606\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7c948f8f9d-v55lx" Mar 16 16:49:28 crc kubenswrapper[5120]: I0316 16:49:28.500553 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/011b06d9-6610-4fc7-97ab-697050a06ec4-httpd-config\") pod \"neutron-7b66994cdb-4jkjq\" (UID: \"011b06d9-6610-4fc7-97ab-697050a06ec4\") " pod="openstack-kuttl-tests/neutron-7b66994cdb-4jkjq" Mar 16 16:49:28 crc kubenswrapper[5120]: I0316 16:49:28.500654 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/011b06d9-6610-4fc7-97ab-697050a06ec4-combined-ca-bundle\") pod \"neutron-7b66994cdb-4jkjq\" (UID: \"011b06d9-6610-4fc7-97ab-697050a06ec4\") " pod="openstack-kuttl-tests/neutron-7b66994cdb-4jkjq" Mar 16 16:49:28 crc kubenswrapper[5120]: I0316 16:49:28.500708 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qgfjn\" (UniqueName: \"kubernetes.io/projected/011b06d9-6610-4fc7-97ab-697050a06ec4-kube-api-access-qgfjn\") pod \"neutron-7b66994cdb-4jkjq\" (UID: \"011b06d9-6610-4fc7-97ab-697050a06ec4\") " pod="openstack-kuttl-tests/neutron-7b66994cdb-4jkjq" Mar 16 16:49:28 crc kubenswrapper[5120]: I0316 16:49:28.500749 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b530ed0b-581b-40f8-b872-1f920e152d92-config-data\") pod \"keystone-747966fd58-rqj7f\" (UID: \"b530ed0b-581b-40f8-b872-1f920e152d92\") " pod="openstack-kuttl-tests/keystone-747966fd58-rqj7f" Mar 16 16:49:28 crc kubenswrapper[5120]: I0316 16:49:28.500791 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b530ed0b-581b-40f8-b872-1f920e152d92-combined-ca-bundle\") pod \"keystone-747966fd58-rqj7f\" (UID: \"b530ed0b-581b-40f8-b872-1f920e152d92\") " pod="openstack-kuttl-tests/keystone-747966fd58-rqj7f" Mar 16 16:49:28 crc kubenswrapper[5120]: I0316 16:49:28.500821 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/b530ed0b-581b-40f8-b872-1f920e152d92-fernet-keys\") pod \"keystone-747966fd58-rqj7f\" (UID: \"b530ed0b-581b-40f8-b872-1f920e152d92\") " pod="openstack-kuttl-tests/keystone-747966fd58-rqj7f" Mar 16 16:49:28 crc kubenswrapper[5120]: I0316 16:49:28.500866 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ltr84\" (UniqueName: \"kubernetes.io/projected/b530ed0b-581b-40f8-b872-1f920e152d92-kube-api-access-ltr84\") pod \"keystone-747966fd58-rqj7f\" (UID: \"b530ed0b-581b-40f8-b872-1f920e152d92\") " pod="openstack-kuttl-tests/keystone-747966fd58-rqj7f" Mar 16 16:49:28 crc kubenswrapper[5120]: I0316 16:49:28.501055 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b530ed0b-581b-40f8-b872-1f920e152d92-scripts\") pod \"keystone-747966fd58-rqj7f\" (UID: \"b530ed0b-581b-40f8-b872-1f920e152d92\") " pod="openstack-kuttl-tests/keystone-747966fd58-rqj7f" Mar 16 16:49:28 crc kubenswrapper[5120]: I0316 16:49:28.501210 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/011b06d9-6610-4fc7-97ab-697050a06ec4-config\") pod \"neutron-7b66994cdb-4jkjq\" (UID: \"011b06d9-6610-4fc7-97ab-697050a06ec4\") " pod="openstack-kuttl-tests/neutron-7b66994cdb-4jkjq" Mar 16 16:49:28 crc kubenswrapper[5120]: I0316 16:49:28.501266 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/b530ed0b-581b-40f8-b872-1f920e152d92-credential-keys\") pod \"keystone-747966fd58-rqj7f\" (UID: \"b530ed0b-581b-40f8-b872-1f920e152d92\") " pod="openstack-kuttl-tests/keystone-747966fd58-rqj7f" Mar 16 16:49:28 crc kubenswrapper[5120]: I0316 16:49:28.503617 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8kqhx\" (UniqueName: \"kubernetes.io/projected/0be76020-d856-43c3-a89a-7ab5b83c0606-kube-api-access-8kqhx\") pod \"barbican-keystone-listener-7c948f8f9d-v55lx\" (UID: \"0be76020-d856-43c3-a89a-7ab5b83c0606\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7c948f8f9d-v55lx" Mar 16 16:49:28 crc kubenswrapper[5120]: I0316 16:49:28.511722 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/011b06d9-6610-4fc7-97ab-697050a06ec4-config\") pod \"neutron-7b66994cdb-4jkjq\" (UID: \"011b06d9-6610-4fc7-97ab-697050a06ec4\") " pod="openstack-kuttl-tests/neutron-7b66994cdb-4jkjq" Mar 16 16:49:28 crc kubenswrapper[5120]: I0316 16:49:28.531514 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/011b06d9-6610-4fc7-97ab-697050a06ec4-combined-ca-bundle\") pod \"neutron-7b66994cdb-4jkjq\" (UID: \"011b06d9-6610-4fc7-97ab-697050a06ec4\") " pod="openstack-kuttl-tests/neutron-7b66994cdb-4jkjq" Mar 16 16:49:28 crc kubenswrapper[5120]: I0316 16:49:28.531808 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-86d6cb7f98-5w9h4"] Mar 16 16:49:28 crc kubenswrapper[5120]: I0316 16:49:28.548995 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-86d6cb7f98-5w9h4" Mar 16 16:49:28 crc kubenswrapper[5120]: I0316 16:49:28.549060 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/011b06d9-6610-4fc7-97ab-697050a06ec4-httpd-config\") pod \"neutron-7b66994cdb-4jkjq\" (UID: \"011b06d9-6610-4fc7-97ab-697050a06ec4\") " pod="openstack-kuttl-tests/neutron-7b66994cdb-4jkjq" Mar 16 16:49:28 crc kubenswrapper[5120]: I0316 16:49:28.551704 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 16:49:28 crc kubenswrapper[5120]: I0316 16:49:28.556103 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qgfjn\" (UniqueName: \"kubernetes.io/projected/011b06d9-6610-4fc7-97ab-697050a06ec4-kube-api-access-qgfjn\") pod \"neutron-7b66994cdb-4jkjq\" (UID: \"011b06d9-6610-4fc7-97ab-697050a06ec4\") " pod="openstack-kuttl-tests/neutron-7b66994cdb-4jkjq" Mar 16 16:49:28 crc kubenswrapper[5120]: I0316 16:49:28.604265 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/5b516ced-8076-4f11-8398-77eaca65d050-config-data-custom\") pod \"barbican-keystone-listener-86d6cb7f98-5w9h4\" (UID: \"5b516ced-8076-4f11-8398-77eaca65d050\") " pod="openstack-kuttl-tests/barbican-keystone-listener-86d6cb7f98-5w9h4" Mar 16 16:49:28 crc kubenswrapper[5120]: I0316 16:49:28.604348 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5b516ced-8076-4f11-8398-77eaca65d050-logs\") pod \"barbican-keystone-listener-86d6cb7f98-5w9h4\" (UID: \"5b516ced-8076-4f11-8398-77eaca65d050\") " pod="openstack-kuttl-tests/barbican-keystone-listener-86d6cb7f98-5w9h4" Mar 16 16:49:28 crc kubenswrapper[5120]: I0316 16:49:28.604413 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b530ed0b-581b-40f8-b872-1f920e152d92-scripts\") pod \"keystone-747966fd58-rqj7f\" (UID: \"b530ed0b-581b-40f8-b872-1f920e152d92\") " pod="openstack-kuttl-tests/keystone-747966fd58-rqj7f" Mar 16 16:49:28 crc kubenswrapper[5120]: I0316 16:49:28.604533 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5b516ced-8076-4f11-8398-77eaca65d050-combined-ca-bundle\") pod \"barbican-keystone-listener-86d6cb7f98-5w9h4\" (UID: \"5b516ced-8076-4f11-8398-77eaca65d050\") " pod="openstack-kuttl-tests/barbican-keystone-listener-86d6cb7f98-5w9h4" Mar 16 16:49:28 crc kubenswrapper[5120]: I0316 16:49:28.604637 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/b530ed0b-581b-40f8-b872-1f920e152d92-credential-keys\") pod \"keystone-747966fd58-rqj7f\" (UID: \"b530ed0b-581b-40f8-b872-1f920e152d92\") " pod="openstack-kuttl-tests/keystone-747966fd58-rqj7f" Mar 16 16:49:28 crc kubenswrapper[5120]: I0316 16:49:28.604674 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzc92\" (UniqueName: \"kubernetes.io/projected/5b516ced-8076-4f11-8398-77eaca65d050-kube-api-access-jzc92\") pod \"barbican-keystone-listener-86d6cb7f98-5w9h4\" (UID: \"5b516ced-8076-4f11-8398-77eaca65d050\") " pod="openstack-kuttl-tests/barbican-keystone-listener-86d6cb7f98-5w9h4" Mar 16 16:49:28 crc kubenswrapper[5120]: I0316 16:49:28.604783 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b530ed0b-581b-40f8-b872-1f920e152d92-config-data\") pod \"keystone-747966fd58-rqj7f\" (UID: \"b530ed0b-581b-40f8-b872-1f920e152d92\") " pod="openstack-kuttl-tests/keystone-747966fd58-rqj7f" Mar 16 16:49:28 crc kubenswrapper[5120]: I0316 16:49:28.604806 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b530ed0b-581b-40f8-b872-1f920e152d92-combined-ca-bundle\") pod \"keystone-747966fd58-rqj7f\" (UID: \"b530ed0b-581b-40f8-b872-1f920e152d92\") " pod="openstack-kuttl-tests/keystone-747966fd58-rqj7f" Mar 16 16:49:28 crc kubenswrapper[5120]: I0316 16:49:28.604833 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/b530ed0b-581b-40f8-b872-1f920e152d92-fernet-keys\") pod \"keystone-747966fd58-rqj7f\" (UID: \"b530ed0b-581b-40f8-b872-1f920e152d92\") " pod="openstack-kuttl-tests/keystone-747966fd58-rqj7f" Mar 16 16:49:28 crc kubenswrapper[5120]: I0316 16:49:28.604886 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ltr84\" (UniqueName: \"kubernetes.io/projected/b530ed0b-581b-40f8-b872-1f920e152d92-kube-api-access-ltr84\") pod \"keystone-747966fd58-rqj7f\" (UID: \"b530ed0b-581b-40f8-b872-1f920e152d92\") " pod="openstack-kuttl-tests/keystone-747966fd58-rqj7f" Mar 16 16:49:28 crc kubenswrapper[5120]: I0316 16:49:28.605112 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5b516ced-8076-4f11-8398-77eaca65d050-config-data\") pod \"barbican-keystone-listener-86d6cb7f98-5w9h4\" (UID: \"5b516ced-8076-4f11-8398-77eaca65d050\") " pod="openstack-kuttl-tests/barbican-keystone-listener-86d6cb7f98-5w9h4" Mar 16 16:49:28 crc kubenswrapper[5120]: I0316 16:49:28.607968 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-86d6cb7f98-5w9h4"] Mar 16 16:49:28 crc kubenswrapper[5120]: I0316 16:49:28.612932 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/b530ed0b-581b-40f8-b872-1f920e152d92-fernet-keys\") pod \"keystone-747966fd58-rqj7f\" (UID: \"b530ed0b-581b-40f8-b872-1f920e152d92\") " pod="openstack-kuttl-tests/keystone-747966fd58-rqj7f" Mar 16 16:49:28 crc kubenswrapper[5120]: I0316 16:49:28.613028 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b530ed0b-581b-40f8-b872-1f920e152d92-combined-ca-bundle\") pod \"keystone-747966fd58-rqj7f\" (UID: \"b530ed0b-581b-40f8-b872-1f920e152d92\") " pod="openstack-kuttl-tests/keystone-747966fd58-rqj7f" Mar 16 16:49:28 crc kubenswrapper[5120]: I0316 16:49:28.613120 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-7b66994cdb-4jkjq" Mar 16 16:49:28 crc kubenswrapper[5120]: I0316 16:49:28.621204 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/b530ed0b-581b-40f8-b872-1f920e152d92-credential-keys\") pod \"keystone-747966fd58-rqj7f\" (UID: \"b530ed0b-581b-40f8-b872-1f920e152d92\") " pod="openstack-kuttl-tests/keystone-747966fd58-rqj7f" Mar 16 16:49:28 crc kubenswrapper[5120]: I0316 16:49:28.626237 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b530ed0b-581b-40f8-b872-1f920e152d92-config-data\") pod \"keystone-747966fd58-rqj7f\" (UID: \"b530ed0b-581b-40f8-b872-1f920e152d92\") " pod="openstack-kuttl-tests/keystone-747966fd58-rqj7f" Mar 16 16:49:28 crc kubenswrapper[5120]: I0316 16:49:28.635276 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b530ed0b-581b-40f8-b872-1f920e152d92-scripts\") pod \"keystone-747966fd58-rqj7f\" (UID: \"b530ed0b-581b-40f8-b872-1f920e152d92\") " pod="openstack-kuttl-tests/keystone-747966fd58-rqj7f" Mar 16 16:49:28 crc kubenswrapper[5120]: I0316 16:49:28.685552 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ltr84\" (UniqueName: \"kubernetes.io/projected/b530ed0b-581b-40f8-b872-1f920e152d92-kube-api-access-ltr84\") pod \"keystone-747966fd58-rqj7f\" (UID: \"b530ed0b-581b-40f8-b872-1f920e152d92\") " pod="openstack-kuttl-tests/keystone-747966fd58-rqj7f" Mar 16 16:49:28 crc kubenswrapper[5120]: I0316 16:49:28.707933 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5b516ced-8076-4f11-8398-77eaca65d050-config-data\") pod \"barbican-keystone-listener-86d6cb7f98-5w9h4\" (UID: \"5b516ced-8076-4f11-8398-77eaca65d050\") " pod="openstack-kuttl-tests/barbican-keystone-listener-86d6cb7f98-5w9h4" Mar 16 16:49:28 crc kubenswrapper[5120]: I0316 16:49:28.707995 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/5b516ced-8076-4f11-8398-77eaca65d050-config-data-custom\") pod \"barbican-keystone-listener-86d6cb7f98-5w9h4\" (UID: \"5b516ced-8076-4f11-8398-77eaca65d050\") " pod="openstack-kuttl-tests/barbican-keystone-listener-86d6cb7f98-5w9h4" Mar 16 16:49:28 crc kubenswrapper[5120]: I0316 16:49:28.708024 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5b516ced-8076-4f11-8398-77eaca65d050-logs\") pod \"barbican-keystone-listener-86d6cb7f98-5w9h4\" (UID: \"5b516ced-8076-4f11-8398-77eaca65d050\") " pod="openstack-kuttl-tests/barbican-keystone-listener-86d6cb7f98-5w9h4" Mar 16 16:49:28 crc kubenswrapper[5120]: I0316 16:49:28.708108 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5b516ced-8076-4f11-8398-77eaca65d050-combined-ca-bundle\") pod \"barbican-keystone-listener-86d6cb7f98-5w9h4\" (UID: \"5b516ced-8076-4f11-8398-77eaca65d050\") " pod="openstack-kuttl-tests/barbican-keystone-listener-86d6cb7f98-5w9h4" Mar 16 16:49:28 crc kubenswrapper[5120]: I0316 16:49:28.708218 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jzc92\" (UniqueName: \"kubernetes.io/projected/5b516ced-8076-4f11-8398-77eaca65d050-kube-api-access-jzc92\") pod \"barbican-keystone-listener-86d6cb7f98-5w9h4\" (UID: \"5b516ced-8076-4f11-8398-77eaca65d050\") " pod="openstack-kuttl-tests/barbican-keystone-listener-86d6cb7f98-5w9h4" Mar 16 16:49:28 crc kubenswrapper[5120]: I0316 16:49:28.714709 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5b516ced-8076-4f11-8398-77eaca65d050-logs\") pod \"barbican-keystone-listener-86d6cb7f98-5w9h4\" (UID: \"5b516ced-8076-4f11-8398-77eaca65d050\") " pod="openstack-kuttl-tests/barbican-keystone-listener-86d6cb7f98-5w9h4" Mar 16 16:49:28 crc kubenswrapper[5120]: I0316 16:49:28.727125 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5b516ced-8076-4f11-8398-77eaca65d050-config-data\") pod \"barbican-keystone-listener-86d6cb7f98-5w9h4\" (UID: \"5b516ced-8076-4f11-8398-77eaca65d050\") " pod="openstack-kuttl-tests/barbican-keystone-listener-86d6cb7f98-5w9h4" Mar 16 16:49:28 crc kubenswrapper[5120]: I0316 16:49:28.727290 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/5b516ced-8076-4f11-8398-77eaca65d050-config-data-custom\") pod \"barbican-keystone-listener-86d6cb7f98-5w9h4\" (UID: \"5b516ced-8076-4f11-8398-77eaca65d050\") " pod="openstack-kuttl-tests/barbican-keystone-listener-86d6cb7f98-5w9h4" Mar 16 16:49:28 crc kubenswrapper[5120]: I0316 16:49:28.727708 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5b516ced-8076-4f11-8398-77eaca65d050-combined-ca-bundle\") pod \"barbican-keystone-listener-86d6cb7f98-5w9h4\" (UID: \"5b516ced-8076-4f11-8398-77eaca65d050\") " pod="openstack-kuttl-tests/barbican-keystone-listener-86d6cb7f98-5w9h4" Mar 16 16:49:28 crc kubenswrapper[5120]: I0316 16:49:28.765083 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzc92\" (UniqueName: \"kubernetes.io/projected/5b516ced-8076-4f11-8398-77eaca65d050-kube-api-access-jzc92\") pod \"barbican-keystone-listener-86d6cb7f98-5w9h4\" (UID: \"5b516ced-8076-4f11-8398-77eaca65d050\") " pod="openstack-kuttl-tests/barbican-keystone-listener-86d6cb7f98-5w9h4" Mar 16 16:49:28 crc kubenswrapper[5120]: I0316 16:49:28.874873 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-7c948f8f9d-v55lx" Mar 16 16:49:28 crc kubenswrapper[5120]: I0316 16:49:28.936616 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-747966fd58-rqj7f" Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.405118 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-7766ff8bd9-h465l"] Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.405628 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-worker-5dc7897bc-w6pc6"] Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.426093 5120 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.445599 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-5dc7897bc-w6pc6"] Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.445641 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-api-f5b8b4576-z8chc"] Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.447244 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-5dc7897bc-w6pc6" Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.467290 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-86d6cb7f98-5w9h4" Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.522310 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5dc86\" (UniqueName: \"kubernetes.io/projected/9ad6c5f4-1902-463a-8a6f-6beade89b6a1-kube-api-access-5dc86\") pod \"barbican-worker-5dc7897bc-w6pc6\" (UID: \"9ad6c5f4-1902-463a-8a6f-6beade89b6a1\") " pod="openstack-kuttl-tests/barbican-worker-5dc7897bc-w6pc6" Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.522441 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9ad6c5f4-1902-463a-8a6f-6beade89b6a1-combined-ca-bundle\") pod \"barbican-worker-5dc7897bc-w6pc6\" (UID: \"9ad6c5f4-1902-463a-8a6f-6beade89b6a1\") " pod="openstack-kuttl-tests/barbican-worker-5dc7897bc-w6pc6" Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.522592 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9ad6c5f4-1902-463a-8a6f-6beade89b6a1-logs\") pod \"barbican-worker-5dc7897bc-w6pc6\" (UID: \"9ad6c5f4-1902-463a-8a6f-6beade89b6a1\") " pod="openstack-kuttl-tests/barbican-worker-5dc7897bc-w6pc6" Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.522647 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9ad6c5f4-1902-463a-8a6f-6beade89b6a1-config-data\") pod \"barbican-worker-5dc7897bc-w6pc6\" (UID: \"9ad6c5f4-1902-463a-8a6f-6beade89b6a1\") " pod="openstack-kuttl-tests/barbican-worker-5dc7897bc-w6pc6" Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.522697 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/9ad6c5f4-1902-463a-8a6f-6beade89b6a1-config-data-custom\") pod \"barbican-worker-5dc7897bc-w6pc6\" (UID: \"9ad6c5f4-1902-463a-8a6f-6beade89b6a1\") " pod="openstack-kuttl-tests/barbican-worker-5dc7897bc-w6pc6" Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.523063 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-7c948f8f9d-v55lx" Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.523283 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-f5b8b4576-z8chc"] Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.523315 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.523334 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-7b66994cdb-4jkjq"] Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.523358 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-47xrk"] Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.523369 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-47xrk"] Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.523388 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.523401 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.523423 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.523436 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-b95f7696b-gs4k6"] Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.524140 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="f3277ed1-d61b-491c-b6dc-1964a1422ea9" containerName="nova-cell0-conductor-conductor" containerID="cri-o://0133a2cd785424001989a4b5c72950fd6eb0e3bedabf2dd40ea720d83389adb9" gracePeriod=30 Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.524321 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-f5b8b4576-z8chc" Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.524436 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podUID="babd9a47-eaa5-4b06-a2d3-16732a4b2dc7" containerName="nova-cell1-novncproxy-novncproxy" containerID="cri-o://38067664f50ab8da43ddd0e6355751fdc9ef3eb7d2256c031cb4164e85be88dc" gracePeriod=30 Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.524651 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="a7864faa-1e6e-4644-a5f5-f51e429e1e2b" containerName="nova-metadata-log" containerID="cri-o://cf0a8f06eaed0e3687e612c1d60597d999644af14a5963369c5ba62e98f9bcb7" gracePeriod=30 Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.525141 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="a7864faa-1e6e-4644-a5f5-f51e429e1e2b" containerName="nova-metadata-metadata" containerID="cri-o://8e0902e36245c8105626461234c99769028f119d7a8f9080029df1ebb3dcb8df" gracePeriod=30 Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.526030 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="016dd61b-9c8d-4a62-a30f-5893f3aa41d7" containerName="nova-api-log" containerID="cri-o://6ee451353950a7132e69bb0501c1336e4efe418735cba54a3fc794a9239eef2e" gracePeriod=30 Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.526288 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="016dd61b-9c8d-4a62-a30f-5893f3aa41d7" containerName="nova-api-api" containerID="cri-o://ae3296fd136f37d44efdbffedb932b3d7fc4bb15548e013e662c90d6198d2a1b" gracePeriod=30 Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.553877 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-b95f7696b-gs4k6"] Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.553916 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.553960 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-6sq2s"] Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.556704 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-b95f7696b-gs4k6" Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.561226 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="6433979b-c153-4721-8866-0d9bcd0480bb" containerName="nova-scheduler-scheduler" containerID="cri-o://22d8a51d4ad3c9bcfd9809d3a1832743ec83f25d019d4ab903345f8d3f5e7a5b" gracePeriod=30 Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.602862 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-6sq2s"] Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.603151 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.603164 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-7766ff8bd9-h465l"] Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.603311 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/memcached-0" podUID="02bf1e48-defb-443a-98b5-9eed2dc9947c" containerName="memcached" containerID="cri-o://f692602c06cc74dc1226e987b63623cea4c756357514c56d959b07b5301a0298" gracePeriod=30 Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.603450 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-6sq2s" Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.612115 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-manage-config-data\"" Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.612172 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-manage-scripts\"" Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.612319 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-7b66994cdb-4jkjq"] Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.642339 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0be76020-d856-43c3-a89a-7ab5b83c0606-logs\") pod \"0be76020-d856-43c3-a89a-7ab5b83c0606\" (UID: \"0be76020-d856-43c3-a89a-7ab5b83c0606\") " Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.642732 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8kqhx\" (UniqueName: \"kubernetes.io/projected/0be76020-d856-43c3-a89a-7ab5b83c0606-kube-api-access-8kqhx\") pod \"0be76020-d856-43c3-a89a-7ab5b83c0606\" (UID: \"0be76020-d856-43c3-a89a-7ab5b83c0606\") " Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.642840 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0be76020-d856-43c3-a89a-7ab5b83c0606-combined-ca-bundle\") pod \"0be76020-d856-43c3-a89a-7ab5b83c0606\" (UID: \"0be76020-d856-43c3-a89a-7ab5b83c0606\") " Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.642883 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0be76020-d856-43c3-a89a-7ab5b83c0606-config-data\") pod \"0be76020-d856-43c3-a89a-7ab5b83c0606\" (UID: \"0be76020-d856-43c3-a89a-7ab5b83c0606\") " Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.642982 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/0be76020-d856-43c3-a89a-7ab5b83c0606-config-data-custom\") pod \"0be76020-d856-43c3-a89a-7ab5b83c0606\" (UID: \"0be76020-d856-43c3-a89a-7ab5b83c0606\") " Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.643299 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/9ad6c5f4-1902-463a-8a6f-6beade89b6a1-config-data-custom\") pod \"barbican-worker-5dc7897bc-w6pc6\" (UID: \"9ad6c5f4-1902-463a-8a6f-6beade89b6a1\") " pod="openstack-kuttl-tests/barbican-worker-5dc7897bc-w6pc6" Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.643373 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jm89s\" (UniqueName: \"kubernetes.io/projected/199c0d37-3938-4dff-bc4c-b94e06321673-kube-api-access-jm89s\") pod \"nova-cell1-cell-mapping-6sq2s\" (UID: \"199c0d37-3938-4dff-bc4c-b94e06321673\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-6sq2s" Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.643401 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ac5817ce-1c59-4375-9fb6-f2fcd39bdba2-combined-ca-bundle\") pod \"barbican-api-f5b8b4576-z8chc\" (UID: \"ac5817ce-1c59-4375-9fb6-f2fcd39bdba2\") " pod="openstack-kuttl-tests/barbican-api-f5b8b4576-z8chc" Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.643488 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ac5817ce-1c59-4375-9fb6-f2fcd39bdba2-config-data\") pod \"barbican-api-f5b8b4576-z8chc\" (UID: \"ac5817ce-1c59-4375-9fb6-f2fcd39bdba2\") " pod="openstack-kuttl-tests/barbican-api-f5b8b4576-z8chc" Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.643532 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/ac5817ce-1c59-4375-9fb6-f2fcd39bdba2-config-data-custom\") pod \"barbican-api-f5b8b4576-z8chc\" (UID: \"ac5817ce-1c59-4375-9fb6-f2fcd39bdba2\") " pod="openstack-kuttl-tests/barbican-api-f5b8b4576-z8chc" Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.643659 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5dc86\" (UniqueName: \"kubernetes.io/projected/9ad6c5f4-1902-463a-8a6f-6beade89b6a1-kube-api-access-5dc86\") pod \"barbican-worker-5dc7897bc-w6pc6\" (UID: \"9ad6c5f4-1902-463a-8a6f-6beade89b6a1\") " pod="openstack-kuttl-tests/barbican-worker-5dc7897bc-w6pc6" Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.643732 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/370e78a7-6b53-4f13-aa62-8afa448a0b7d-config\") pod \"neutron-b95f7696b-gs4k6\" (UID: \"370e78a7-6b53-4f13-aa62-8afa448a0b7d\") " pod="openstack-kuttl-tests/neutron-b95f7696b-gs4k6" Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.643841 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/370e78a7-6b53-4f13-aa62-8afa448a0b7d-httpd-config\") pod \"neutron-b95f7696b-gs4k6\" (UID: \"370e78a7-6b53-4f13-aa62-8afa448a0b7d\") " pod="openstack-kuttl-tests/neutron-b95f7696b-gs4k6" Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.643887 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9ad6c5f4-1902-463a-8a6f-6beade89b6a1-combined-ca-bundle\") pod \"barbican-worker-5dc7897bc-w6pc6\" (UID: \"9ad6c5f4-1902-463a-8a6f-6beade89b6a1\") " pod="openstack-kuttl-tests/barbican-worker-5dc7897bc-w6pc6" Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.643915 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/199c0d37-3938-4dff-bc4c-b94e06321673-scripts\") pod \"nova-cell1-cell-mapping-6sq2s\" (UID: \"199c0d37-3938-4dff-bc4c-b94e06321673\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-6sq2s" Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.643987 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/370e78a7-6b53-4f13-aa62-8afa448a0b7d-combined-ca-bundle\") pod \"neutron-b95f7696b-gs4k6\" (UID: \"370e78a7-6b53-4f13-aa62-8afa448a0b7d\") " pod="openstack-kuttl-tests/neutron-b95f7696b-gs4k6" Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.644053 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ac5817ce-1c59-4375-9fb6-f2fcd39bdba2-logs\") pod \"barbican-api-f5b8b4576-z8chc\" (UID: \"ac5817ce-1c59-4375-9fb6-f2fcd39bdba2\") " pod="openstack-kuttl-tests/barbican-api-f5b8b4576-z8chc" Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.644100 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szbpz\" (UniqueName: \"kubernetes.io/projected/ac5817ce-1c59-4375-9fb6-f2fcd39bdba2-kube-api-access-szbpz\") pod \"barbican-api-f5b8b4576-z8chc\" (UID: \"ac5817ce-1c59-4375-9fb6-f2fcd39bdba2\") " pod="openstack-kuttl-tests/barbican-api-f5b8b4576-z8chc" Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.644166 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9ad6c5f4-1902-463a-8a6f-6beade89b6a1-logs\") pod \"barbican-worker-5dc7897bc-w6pc6\" (UID: \"9ad6c5f4-1902-463a-8a6f-6beade89b6a1\") " pod="openstack-kuttl-tests/barbican-worker-5dc7897bc-w6pc6" Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.644205 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zx5fh\" (UniqueName: \"kubernetes.io/projected/370e78a7-6b53-4f13-aa62-8afa448a0b7d-kube-api-access-zx5fh\") pod \"neutron-b95f7696b-gs4k6\" (UID: \"370e78a7-6b53-4f13-aa62-8afa448a0b7d\") " pod="openstack-kuttl-tests/neutron-b95f7696b-gs4k6" Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.644262 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/199c0d37-3938-4dff-bc4c-b94e06321673-combined-ca-bundle\") pod \"nova-cell1-cell-mapping-6sq2s\" (UID: \"199c0d37-3938-4dff-bc4c-b94e06321673\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-6sq2s" Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.644294 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/199c0d37-3938-4dff-bc4c-b94e06321673-config-data\") pod \"nova-cell1-cell-mapping-6sq2s\" (UID: \"199c0d37-3938-4dff-bc4c-b94e06321673\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-6sq2s" Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.644320 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9ad6c5f4-1902-463a-8a6f-6beade89b6a1-config-data\") pod \"barbican-worker-5dc7897bc-w6pc6\" (UID: \"9ad6c5f4-1902-463a-8a6f-6beade89b6a1\") " pod="openstack-kuttl-tests/barbican-worker-5dc7897bc-w6pc6" Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.644982 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0be76020-d856-43c3-a89a-7ab5b83c0606-logs" (OuterVolumeSpecName: "logs") pod "0be76020-d856-43c3-a89a-7ab5b83c0606" (UID: "0be76020-d856-43c3-a89a-7ab5b83c0606"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.647508 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9ad6c5f4-1902-463a-8a6f-6beade89b6a1-logs\") pod \"barbican-worker-5dc7897bc-w6pc6\" (UID: \"9ad6c5f4-1902-463a-8a6f-6beade89b6a1\") " pod="openstack-kuttl-tests/barbican-worker-5dc7897bc-w6pc6" Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.670647 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0be76020-d856-43c3-a89a-7ab5b83c0606-kube-api-access-8kqhx" (OuterVolumeSpecName: "kube-api-access-8kqhx") pod "0be76020-d856-43c3-a89a-7ab5b83c0606" (UID: "0be76020-d856-43c3-a89a-7ab5b83c0606"). InnerVolumeSpecName "kube-api-access-8kqhx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.674262 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0be76020-d856-43c3-a89a-7ab5b83c0606-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "0be76020-d856-43c3-a89a-7ab5b83c0606" (UID: "0be76020-d856-43c3-a89a-7ab5b83c0606"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.679605 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5dc86\" (UniqueName: \"kubernetes.io/projected/9ad6c5f4-1902-463a-8a6f-6beade89b6a1-kube-api-access-5dc86\") pod \"barbican-worker-5dc7897bc-w6pc6\" (UID: \"9ad6c5f4-1902-463a-8a6f-6beade89b6a1\") " pod="openstack-kuttl-tests/barbican-worker-5dc7897bc-w6pc6" Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.683254 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9ad6c5f4-1902-463a-8a6f-6beade89b6a1-config-data\") pod \"barbican-worker-5dc7897bc-w6pc6\" (UID: \"9ad6c5f4-1902-463a-8a6f-6beade89b6a1\") " pod="openstack-kuttl-tests/barbican-worker-5dc7897bc-w6pc6" Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.685242 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0be76020-d856-43c3-a89a-7ab5b83c0606-config-data" (OuterVolumeSpecName: "config-data") pod "0be76020-d856-43c3-a89a-7ab5b83c0606" (UID: "0be76020-d856-43c3-a89a-7ab5b83c0606"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.687905 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/9ad6c5f4-1902-463a-8a6f-6beade89b6a1-config-data-custom\") pod \"barbican-worker-5dc7897bc-w6pc6\" (UID: \"9ad6c5f4-1902-463a-8a6f-6beade89b6a1\") " pod="openstack-kuttl-tests/barbican-worker-5dc7897bc-w6pc6" Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.689832 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9ad6c5f4-1902-463a-8a6f-6beade89b6a1-combined-ca-bundle\") pod \"barbican-worker-5dc7897bc-w6pc6\" (UID: \"9ad6c5f4-1902-463a-8a6f-6beade89b6a1\") " pod="openstack-kuttl-tests/barbican-worker-5dc7897bc-w6pc6" Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.704509 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0be76020-d856-43c3-a89a-7ab5b83c0606-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "0be76020-d856-43c3-a89a-7ab5b83c0606" (UID: "0be76020-d856-43c3-a89a-7ab5b83c0606"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.713881 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.714157 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="b9ac41f6-42c9-4d95-b38c-287da24a2adf" containerName="glance-log" containerID="cri-o://abcc80872762df0d1cfbaa3fc4ee7102269763a95ca5fd3084ec39f82e0cafdb" gracePeriod=30 Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.714312 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="b9ac41f6-42c9-4d95-b38c-287da24a2adf" containerName="glance-httpd" containerID="cri-o://2def4dceb4ba620f3875201d8253e69fd705949b2567eee3de227d80401cf93b" gracePeriod=30 Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.736746 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-5dc7897bc-w6pc6" Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.746530 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ac5817ce-1c59-4375-9fb6-f2fcd39bdba2-config-data\") pod \"barbican-api-f5b8b4576-z8chc\" (UID: \"ac5817ce-1c59-4375-9fb6-f2fcd39bdba2\") " pod="openstack-kuttl-tests/barbican-api-f5b8b4576-z8chc" Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.746600 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/ac5817ce-1c59-4375-9fb6-f2fcd39bdba2-config-data-custom\") pod \"barbican-api-f5b8b4576-z8chc\" (UID: \"ac5817ce-1c59-4375-9fb6-f2fcd39bdba2\") " pod="openstack-kuttl-tests/barbican-api-f5b8b4576-z8chc" Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.746741 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/370e78a7-6b53-4f13-aa62-8afa448a0b7d-config\") pod \"neutron-b95f7696b-gs4k6\" (UID: \"370e78a7-6b53-4f13-aa62-8afa448a0b7d\") " pod="openstack-kuttl-tests/neutron-b95f7696b-gs4k6" Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.746862 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/370e78a7-6b53-4f13-aa62-8afa448a0b7d-httpd-config\") pod \"neutron-b95f7696b-gs4k6\" (UID: \"370e78a7-6b53-4f13-aa62-8afa448a0b7d\") " pod="openstack-kuttl-tests/neutron-b95f7696b-gs4k6" Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.746889 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/199c0d37-3938-4dff-bc4c-b94e06321673-scripts\") pod \"nova-cell1-cell-mapping-6sq2s\" (UID: \"199c0d37-3938-4dff-bc4c-b94e06321673\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-6sq2s" Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.746937 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/370e78a7-6b53-4f13-aa62-8afa448a0b7d-combined-ca-bundle\") pod \"neutron-b95f7696b-gs4k6\" (UID: \"370e78a7-6b53-4f13-aa62-8afa448a0b7d\") " pod="openstack-kuttl-tests/neutron-b95f7696b-gs4k6" Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.747027 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ac5817ce-1c59-4375-9fb6-f2fcd39bdba2-logs\") pod \"barbican-api-f5b8b4576-z8chc\" (UID: \"ac5817ce-1c59-4375-9fb6-f2fcd39bdba2\") " pod="openstack-kuttl-tests/barbican-api-f5b8b4576-z8chc" Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.747078 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-szbpz\" (UniqueName: \"kubernetes.io/projected/ac5817ce-1c59-4375-9fb6-f2fcd39bdba2-kube-api-access-szbpz\") pod \"barbican-api-f5b8b4576-z8chc\" (UID: \"ac5817ce-1c59-4375-9fb6-f2fcd39bdba2\") " pod="openstack-kuttl-tests/barbican-api-f5b8b4576-z8chc" Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.747167 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zx5fh\" (UniqueName: \"kubernetes.io/projected/370e78a7-6b53-4f13-aa62-8afa448a0b7d-kube-api-access-zx5fh\") pod \"neutron-b95f7696b-gs4k6\" (UID: \"370e78a7-6b53-4f13-aa62-8afa448a0b7d\") " pod="openstack-kuttl-tests/neutron-b95f7696b-gs4k6" Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.747205 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/199c0d37-3938-4dff-bc4c-b94e06321673-combined-ca-bundle\") pod \"nova-cell1-cell-mapping-6sq2s\" (UID: \"199c0d37-3938-4dff-bc4c-b94e06321673\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-6sq2s" Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.747229 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/199c0d37-3938-4dff-bc4c-b94e06321673-config-data\") pod \"nova-cell1-cell-mapping-6sq2s\" (UID: \"199c0d37-3938-4dff-bc4c-b94e06321673\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-6sq2s" Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.747324 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jm89s\" (UniqueName: \"kubernetes.io/projected/199c0d37-3938-4dff-bc4c-b94e06321673-kube-api-access-jm89s\") pod \"nova-cell1-cell-mapping-6sq2s\" (UID: \"199c0d37-3938-4dff-bc4c-b94e06321673\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-6sq2s" Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.747340 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ac5817ce-1c59-4375-9fb6-f2fcd39bdba2-combined-ca-bundle\") pod \"barbican-api-f5b8b4576-z8chc\" (UID: \"ac5817ce-1c59-4375-9fb6-f2fcd39bdba2\") " pod="openstack-kuttl-tests/barbican-api-f5b8b4576-z8chc" Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.747444 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8kqhx\" (UniqueName: \"kubernetes.io/projected/0be76020-d856-43c3-a89a-7ab5b83c0606-kube-api-access-8kqhx\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.747456 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0be76020-d856-43c3-a89a-7ab5b83c0606-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.747464 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0be76020-d856-43c3-a89a-7ab5b83c0606-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.747474 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/0be76020-d856-43c3-a89a-7ab5b83c0606-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.747482 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0be76020-d856-43c3-a89a-7ab5b83c0606-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.749478 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ac5817ce-1c59-4375-9fb6-f2fcd39bdba2-logs\") pod \"barbican-api-f5b8b4576-z8chc\" (UID: \"ac5817ce-1c59-4375-9fb6-f2fcd39bdba2\") " pod="openstack-kuttl-tests/barbican-api-f5b8b4576-z8chc" Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.765714 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/370e78a7-6b53-4f13-aa62-8afa448a0b7d-config\") pod \"neutron-b95f7696b-gs4k6\" (UID: \"370e78a7-6b53-4f13-aa62-8afa448a0b7d\") " pod="openstack-kuttl-tests/neutron-b95f7696b-gs4k6" Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.777390 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ac5817ce-1c59-4375-9fb6-f2fcd39bdba2-combined-ca-bundle\") pod \"barbican-api-f5b8b4576-z8chc\" (UID: \"ac5817ce-1c59-4375-9fb6-f2fcd39bdba2\") " pod="openstack-kuttl-tests/barbican-api-f5b8b4576-z8chc" Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.779540 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/199c0d37-3938-4dff-bc4c-b94e06321673-config-data\") pod \"nova-cell1-cell-mapping-6sq2s\" (UID: \"199c0d37-3938-4dff-bc4c-b94e06321673\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-6sq2s" Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.780034 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/370e78a7-6b53-4f13-aa62-8afa448a0b7d-httpd-config\") pod \"neutron-b95f7696b-gs4k6\" (UID: \"370e78a7-6b53-4f13-aa62-8afa448a0b7d\") " pod="openstack-kuttl-tests/neutron-b95f7696b-gs4k6" Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.780534 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/370e78a7-6b53-4f13-aa62-8afa448a0b7d-combined-ca-bundle\") pod \"neutron-b95f7696b-gs4k6\" (UID: \"370e78a7-6b53-4f13-aa62-8afa448a0b7d\") " pod="openstack-kuttl-tests/neutron-b95f7696b-gs4k6" Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.781397 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/ac5817ce-1c59-4375-9fb6-f2fcd39bdba2-config-data-custom\") pod \"barbican-api-f5b8b4576-z8chc\" (UID: \"ac5817ce-1c59-4375-9fb6-f2fcd39bdba2\") " pod="openstack-kuttl-tests/barbican-api-f5b8b4576-z8chc" Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.781455 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/199c0d37-3938-4dff-bc4c-b94e06321673-combined-ca-bundle\") pod \"nova-cell1-cell-mapping-6sq2s\" (UID: \"199c0d37-3938-4dff-bc4c-b94e06321673\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-6sq2s" Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.791491 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/199c0d37-3938-4dff-bc4c-b94e06321673-scripts\") pod \"nova-cell1-cell-mapping-6sq2s\" (UID: \"199c0d37-3938-4dff-bc4c-b94e06321673\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-6sq2s" Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.797678 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ac5817ce-1c59-4375-9fb6-f2fcd39bdba2-config-data\") pod \"barbican-api-f5b8b4576-z8chc\" (UID: \"ac5817ce-1c59-4375-9fb6-f2fcd39bdba2\") " pod="openstack-kuttl-tests/barbican-api-f5b8b4576-z8chc" Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.816574 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-747966fd58-rqj7f"] Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.823703 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jm89s\" (UniqueName: \"kubernetes.io/projected/199c0d37-3938-4dff-bc4c-b94e06321673-kube-api-access-jm89s\") pod \"nova-cell1-cell-mapping-6sq2s\" (UID: \"199c0d37-3938-4dff-bc4c-b94e06321673\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-6sq2s" Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.831081 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zx5fh\" (UniqueName: \"kubernetes.io/projected/370e78a7-6b53-4f13-aa62-8afa448a0b7d-kube-api-access-zx5fh\") pod \"neutron-b95f7696b-gs4k6\" (UID: \"370e78a7-6b53-4f13-aa62-8afa448a0b7d\") " pod="openstack-kuttl-tests/neutron-b95f7696b-gs4k6" Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.838395 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-szbpz\" (UniqueName: \"kubernetes.io/projected/ac5817ce-1c59-4375-9fb6-f2fcd39bdba2-kube-api-access-szbpz\") pod \"barbican-api-f5b8b4576-z8chc\" (UID: \"ac5817ce-1c59-4375-9fb6-f2fcd39bdba2\") " pod="openstack-kuttl-tests/barbican-api-f5b8b4576-z8chc" Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.838979 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-f5b8b4576-z8chc" Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.869506 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-b95f7696b-gs4k6" Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.898385 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-6sq2s" Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.946826 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.954037 5120 generic.go:358] "Generic (PLEG): container finished" podID="016dd61b-9c8d-4a62-a30f-5893f3aa41d7" containerID="6ee451353950a7132e69bb0501c1336e4efe418735cba54a3fc794a9239eef2e" exitCode=143 Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.954147 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"016dd61b-9c8d-4a62-a30f-5893f3aa41d7","Type":"ContainerDied","Data":"6ee451353950a7132e69bb0501c1336e4efe418735cba54a3fc794a9239eef2e"} Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.978327 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="c3654d56-932f-4a2c-ae7d-c5aa896a3335" containerName="account-server" containerID="cri-o://c7597b14c46effc0b5e75329c58fef2db86348b4ca6946ae9f6477dc35893a0e" gracePeriod=30 Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.978730 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="c3654d56-932f-4a2c-ae7d-c5aa896a3335" containerName="object-server" containerID="cri-o://787835b144ba391e7ea878ac319488125e890928c0bbbe44d53383ad86f552c7" gracePeriod=30 Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.979029 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="c3654d56-932f-4a2c-ae7d-c5aa896a3335" containerName="container-updater" containerID="cri-o://93059601596c57dd4cb0821f6b812899443bad5a5184ea352f0349395bd32703" gracePeriod=30 Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.979099 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="c3654d56-932f-4a2c-ae7d-c5aa896a3335" containerName="container-auditor" containerID="cri-o://200b8316513df356c73810c0a9920beb8581c557012243461773380bc64ba067" gracePeriod=30 Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.979133 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="c3654d56-932f-4a2c-ae7d-c5aa896a3335" containerName="container-replicator" containerID="cri-o://e1f833adb929804d26e1c407c05f87e3c0f32afbfc09f6a35b8e8f77cf17c662" gracePeriod=30 Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.979166 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="c3654d56-932f-4a2c-ae7d-c5aa896a3335" containerName="container-server" containerID="cri-o://493264b8a5de6551d9d5bfbb72f85a7cccffbde4a4ad31f5a93c687e619bd8f3" gracePeriod=30 Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.979200 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="c3654d56-932f-4a2c-ae7d-c5aa896a3335" containerName="account-reaper" containerID="cri-o://a0580816327b0eb8461ef400bb4f56c4a674f2735ad70d7f9fccfeceb50b4ce0" gracePeriod=30 Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.979238 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="c3654d56-932f-4a2c-ae7d-c5aa896a3335" containerName="account-auditor" containerID="cri-o://0b105e090b93d50bd77aae540a71b896fad1b6b84d9968e0904aa102fa6be83c" gracePeriod=30 Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.979278 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="c3654d56-932f-4a2c-ae7d-c5aa896a3335" containerName="account-replicator" containerID="cri-o://ae08a40e5389e61f869b34a0c0c20a08d3c7ebdd649af11eaaeed4303c931780" gracePeriod=30 Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.979423 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="c3654d56-932f-4a2c-ae7d-c5aa896a3335" containerName="object-expirer" containerID="cri-o://bbfdb8cd78e965981b9507e7d59cc5686daa0ae97c6392812a75eafdabac1d0d" gracePeriod=30 Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.981174 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="c3654d56-932f-4a2c-ae7d-c5aa896a3335" containerName="rsync" containerID="cri-o://840e8d5d339442d19ad82f931a88f23400d38e38958d9210156aba093a24fe32" gracePeriod=30 Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.981280 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="c3654d56-932f-4a2c-ae7d-c5aa896a3335" containerName="swift-recon-cron" containerID="cri-o://b4ea9da196622b7914ca097753c95ef95b0450f814aa7eb8b3ee9bde9a4bb236" gracePeriod=30 Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.981328 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="c3654d56-932f-4a2c-ae7d-c5aa896a3335" containerName="object-auditor" containerID="cri-o://dd8a27afa3228552faad0faf477c17d3d1dbb200e35fbfca68c54c20c3200dfb" gracePeriod=30 Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.981390 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="c3654d56-932f-4a2c-ae7d-c5aa896a3335" containerName="object-updater" containerID="cri-o://7ac9c4c926a37d322994f6cad0d9392748087406803d3c491f27f39850ff7533" gracePeriod=30 Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.981432 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="c3654d56-932f-4a2c-ae7d-c5aa896a3335" containerName="object-replicator" containerID="cri-o://69b2a39b40f82d61bff95e3155bd323f14189e904e82d1bf527e593f9184d026" gracePeriod=30 Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.995899 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.996192 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="00cf7a69-dcf7-45dd-9291-3e4d75ece0da" containerName="glance-log" containerID="cri-o://25a0f6ab9cd653f0d4ee96cd81c134f0a6c81ac1d4193f06a891df2ef4a46fec" gracePeriod=30 Mar 16 16:49:29 crc kubenswrapper[5120]: I0316 16:49:29.996343 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="00cf7a69-dcf7-45dd-9291-3e4d75ece0da" containerName="glance-httpd" containerID="cri-o://62b12f4f75e2aae38db45282d142c8c9e3c9bde4fe29592bc1d89f41c324da4f" gracePeriod=30 Mar 16 16:49:30 crc kubenswrapper[5120]: I0316 16:49:30.018870 5120 generic.go:358] "Generic (PLEG): container finished" podID="b9ac41f6-42c9-4d95-b38c-287da24a2adf" containerID="abcc80872762df0d1cfbaa3fc4ee7102269763a95ca5fd3084ec39f82e0cafdb" exitCode=143 Mar 16 16:49:30 crc kubenswrapper[5120]: I0316 16:49:30.018963 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"b9ac41f6-42c9-4d95-b38c-287da24a2adf","Type":"ContainerDied","Data":"abcc80872762df0d1cfbaa3fc4ee7102269763a95ca5fd3084ec39f82e0cafdb"} Mar 16 16:49:30 crc kubenswrapper[5120]: I0316 16:49:30.039949 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-b95f7696b-gs4k6"] Mar 16 16:49:30 crc kubenswrapper[5120]: I0316 16:49:30.041655 5120 generic.go:358] "Generic (PLEG): container finished" podID="5988349f-8dba-4fde-acf3-6d8acf01117f" containerID="94adda9f3db9d3289d254844d87731640cdd1c022dc2c28e816cc1f45741e90a" exitCode=143 Mar 16 16:49:30 crc kubenswrapper[5120]: I0316 16:49:30.041815 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"5988349f-8dba-4fde-acf3-6d8acf01117f","Type":"ContainerDied","Data":"94adda9f3db9d3289d254844d87731640cdd1c022dc2c28e816cc1f45741e90a"} Mar 16 16:49:30 crc kubenswrapper[5120]: I0316 16:49:30.049972 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-7b66994cdb-4jkjq" event={"ID":"011b06d9-6610-4fc7-97ab-697050a06ec4","Type":"ContainerStarted","Data":"bdd67c8187077276b76c9b57773e538caed737000a2a9b46d9cc3fe51595fdcc"} Mar 16 16:49:30 crc kubenswrapper[5120]: I0316 16:49:30.089617 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-7766ff8bd9-h465l" event={"ID":"bcef263e-93a6-4f2b-9447-230cf3444ebb","Type":"ContainerStarted","Data":"3569126c14524346f11066283d244841a399726e44b4cf3ffea1461f9abd8f4d"} Mar 16 16:49:30 crc kubenswrapper[5120]: I0316 16:49:30.089679 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-747966fd58-rqj7f"] Mar 16 16:49:30 crc kubenswrapper[5120]: I0316 16:49:30.135557 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-7c948f8f9d-v55lx" Mar 16 16:49:30 crc kubenswrapper[5120]: I0316 16:49:30.135869 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-747966fd58-rqj7f" event={"ID":"b530ed0b-581b-40f8-b872-1f920e152d92","Type":"ContainerStarted","Data":"1b9a4330eaf831815ad0281a92870eec2bc924fcca48fb8d9a03a1df5a371e75"} Mar 16 16:49:30 crc kubenswrapper[5120]: I0316 16:49:30.202463 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-5c574fdfbb-8rvsq"] Mar 16 16:49:30 crc kubenswrapper[5120]: I0316 16:49:30.231127 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-5c574fdfbb-8rvsq" Mar 16 16:49:30 crc kubenswrapper[5120]: I0316 16:49:30.355216 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-5c574fdfbb-8rvsq"] Mar 16 16:49:30 crc kubenswrapper[5120]: I0316 16:49:30.392672 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-dc86d464-4bdds"] Mar 16 16:49:30 crc kubenswrapper[5120]: I0316 16:49:30.392682 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8931787a-1e50-415c-8d97-6c2ab294b4f4-combined-ca-bundle\") pod \"neutron-5c574fdfbb-8rvsq\" (UID: \"8931787a-1e50-415c-8d97-6c2ab294b4f4\") " pod="openstack-kuttl-tests/neutron-5c574fdfbb-8rvsq" Mar 16 16:49:30 crc kubenswrapper[5120]: I0316 16:49:30.397941 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8931787a-1e50-415c-8d97-6c2ab294b4f4-config\") pod \"neutron-5c574fdfbb-8rvsq\" (UID: \"8931787a-1e50-415c-8d97-6c2ab294b4f4\") " pod="openstack-kuttl-tests/neutron-5c574fdfbb-8rvsq" Mar 16 16:49:30 crc kubenswrapper[5120]: I0316 16:49:30.398004 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/8931787a-1e50-415c-8d97-6c2ab294b4f4-httpd-config\") pod \"neutron-5c574fdfbb-8rvsq\" (UID: \"8931787a-1e50-415c-8d97-6c2ab294b4f4\") " pod="openstack-kuttl-tests/neutron-5c574fdfbb-8rvsq" Mar 16 16:49:30 crc kubenswrapper[5120]: I0316 16:49:30.398186 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mg2kd\" (UniqueName: \"kubernetes.io/projected/8931787a-1e50-415c-8d97-6c2ab294b4f4-kube-api-access-mg2kd\") pod \"neutron-5c574fdfbb-8rvsq\" (UID: \"8931787a-1e50-415c-8d97-6c2ab294b4f4\") " pod="openstack-kuttl-tests/neutron-5c574fdfbb-8rvsq" Mar 16 16:49:30 crc kubenswrapper[5120]: I0316 16:49:30.415029 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-dc86d464-4bdds" Mar 16 16:49:30 crc kubenswrapper[5120]: I0316 16:49:30.475941 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-dc86d464-4bdds"] Mar 16 16:49:30 crc kubenswrapper[5120]: I0316 16:49:30.513672 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mg2kd\" (UniqueName: \"kubernetes.io/projected/8931787a-1e50-415c-8d97-6c2ab294b4f4-kube-api-access-mg2kd\") pod \"neutron-5c574fdfbb-8rvsq\" (UID: \"8931787a-1e50-415c-8d97-6c2ab294b4f4\") " pod="openstack-kuttl-tests/neutron-5c574fdfbb-8rvsq" Mar 16 16:49:30 crc kubenswrapper[5120]: I0316 16:49:30.513804 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/493b4ab5-5510-42b3-aec8-e25ba084e342-combined-ca-bundle\") pod \"keystone-dc86d464-4bdds\" (UID: \"493b4ab5-5510-42b3-aec8-e25ba084e342\") " pod="openstack-kuttl-tests/keystone-dc86d464-4bdds" Mar 16 16:49:30 crc kubenswrapper[5120]: I0316 16:49:30.513933 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/493b4ab5-5510-42b3-aec8-e25ba084e342-config-data\") pod \"keystone-dc86d464-4bdds\" (UID: \"493b4ab5-5510-42b3-aec8-e25ba084e342\") " pod="openstack-kuttl-tests/keystone-dc86d464-4bdds" Mar 16 16:49:30 crc kubenswrapper[5120]: I0316 16:49:30.513949 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/493b4ab5-5510-42b3-aec8-e25ba084e342-credential-keys\") pod \"keystone-dc86d464-4bdds\" (UID: \"493b4ab5-5510-42b3-aec8-e25ba084e342\") " pod="openstack-kuttl-tests/keystone-dc86d464-4bdds" Mar 16 16:49:30 crc kubenswrapper[5120]: I0316 16:49:30.514239 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjfv7\" (UniqueName: \"kubernetes.io/projected/493b4ab5-5510-42b3-aec8-e25ba084e342-kube-api-access-fjfv7\") pod \"keystone-dc86d464-4bdds\" (UID: \"493b4ab5-5510-42b3-aec8-e25ba084e342\") " pod="openstack-kuttl-tests/keystone-dc86d464-4bdds" Mar 16 16:49:30 crc kubenswrapper[5120]: I0316 16:49:30.514287 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/493b4ab5-5510-42b3-aec8-e25ba084e342-scripts\") pod \"keystone-dc86d464-4bdds\" (UID: \"493b4ab5-5510-42b3-aec8-e25ba084e342\") " pod="openstack-kuttl-tests/keystone-dc86d464-4bdds" Mar 16 16:49:30 crc kubenswrapper[5120]: I0316 16:49:30.514348 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/493b4ab5-5510-42b3-aec8-e25ba084e342-fernet-keys\") pod \"keystone-dc86d464-4bdds\" (UID: \"493b4ab5-5510-42b3-aec8-e25ba084e342\") " pod="openstack-kuttl-tests/keystone-dc86d464-4bdds" Mar 16 16:49:30 crc kubenswrapper[5120]: I0316 16:49:30.514420 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8931787a-1e50-415c-8d97-6c2ab294b4f4-combined-ca-bundle\") pod \"neutron-5c574fdfbb-8rvsq\" (UID: \"8931787a-1e50-415c-8d97-6c2ab294b4f4\") " pod="openstack-kuttl-tests/neutron-5c574fdfbb-8rvsq" Mar 16 16:49:30 crc kubenswrapper[5120]: I0316 16:49:30.514461 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8931787a-1e50-415c-8d97-6c2ab294b4f4-config\") pod \"neutron-5c574fdfbb-8rvsq\" (UID: \"8931787a-1e50-415c-8d97-6c2ab294b4f4\") " pod="openstack-kuttl-tests/neutron-5c574fdfbb-8rvsq" Mar 16 16:49:30 crc kubenswrapper[5120]: I0316 16:49:30.514495 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/8931787a-1e50-415c-8d97-6c2ab294b4f4-httpd-config\") pod \"neutron-5c574fdfbb-8rvsq\" (UID: \"8931787a-1e50-415c-8d97-6c2ab294b4f4\") " pod="openstack-kuttl-tests/neutron-5c574fdfbb-8rvsq" Mar 16 16:49:30 crc kubenswrapper[5120]: I0316 16:49:30.533107 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8931787a-1e50-415c-8d97-6c2ab294b4f4-combined-ca-bundle\") pod \"neutron-5c574fdfbb-8rvsq\" (UID: \"8931787a-1e50-415c-8d97-6c2ab294b4f4\") " pod="openstack-kuttl-tests/neutron-5c574fdfbb-8rvsq" Mar 16 16:49:30 crc kubenswrapper[5120]: I0316 16:49:30.533241 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/8931787a-1e50-415c-8d97-6c2ab294b4f4-config\") pod \"neutron-5c574fdfbb-8rvsq\" (UID: \"8931787a-1e50-415c-8d97-6c2ab294b4f4\") " pod="openstack-kuttl-tests/neutron-5c574fdfbb-8rvsq" Mar 16 16:49:30 crc kubenswrapper[5120]: I0316 16:49:30.546564 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/8931787a-1e50-415c-8d97-6c2ab294b4f4-httpd-config\") pod \"neutron-5c574fdfbb-8rvsq\" (UID: \"8931787a-1e50-415c-8d97-6c2ab294b4f4\") " pod="openstack-kuttl-tests/neutron-5c574fdfbb-8rvsq" Mar 16 16:49:30 crc kubenswrapper[5120]: I0316 16:49:30.553233 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mg2kd\" (UniqueName: \"kubernetes.io/projected/8931787a-1e50-415c-8d97-6c2ab294b4f4-kube-api-access-mg2kd\") pod \"neutron-5c574fdfbb-8rvsq\" (UID: \"8931787a-1e50-415c-8d97-6c2ab294b4f4\") " pod="openstack-kuttl-tests/neutron-5c574fdfbb-8rvsq" Mar 16 16:49:30 crc kubenswrapper[5120]: I0316 16:49:30.562311 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-5c574fdfbb-8rvsq" Mar 16 16:49:30 crc kubenswrapper[5120]: I0316 16:49:30.617828 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/493b4ab5-5510-42b3-aec8-e25ba084e342-scripts\") pod \"keystone-dc86d464-4bdds\" (UID: \"493b4ab5-5510-42b3-aec8-e25ba084e342\") " pod="openstack-kuttl-tests/keystone-dc86d464-4bdds" Mar 16 16:49:30 crc kubenswrapper[5120]: I0316 16:49:30.617884 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/493b4ab5-5510-42b3-aec8-e25ba084e342-fernet-keys\") pod \"keystone-dc86d464-4bdds\" (UID: \"493b4ab5-5510-42b3-aec8-e25ba084e342\") " pod="openstack-kuttl-tests/keystone-dc86d464-4bdds" Mar 16 16:49:30 crc kubenswrapper[5120]: I0316 16:49:30.618037 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/493b4ab5-5510-42b3-aec8-e25ba084e342-combined-ca-bundle\") pod \"keystone-dc86d464-4bdds\" (UID: \"493b4ab5-5510-42b3-aec8-e25ba084e342\") " pod="openstack-kuttl-tests/keystone-dc86d464-4bdds" Mar 16 16:49:30 crc kubenswrapper[5120]: I0316 16:49:30.618098 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/493b4ab5-5510-42b3-aec8-e25ba084e342-config-data\") pod \"keystone-dc86d464-4bdds\" (UID: \"493b4ab5-5510-42b3-aec8-e25ba084e342\") " pod="openstack-kuttl-tests/keystone-dc86d464-4bdds" Mar 16 16:49:30 crc kubenswrapper[5120]: I0316 16:49:30.618115 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/493b4ab5-5510-42b3-aec8-e25ba084e342-credential-keys\") pod \"keystone-dc86d464-4bdds\" (UID: \"493b4ab5-5510-42b3-aec8-e25ba084e342\") " pod="openstack-kuttl-tests/keystone-dc86d464-4bdds" Mar 16 16:49:30 crc kubenswrapper[5120]: I0316 16:49:30.618278 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fjfv7\" (UniqueName: \"kubernetes.io/projected/493b4ab5-5510-42b3-aec8-e25ba084e342-kube-api-access-fjfv7\") pod \"keystone-dc86d464-4bdds\" (UID: \"493b4ab5-5510-42b3-aec8-e25ba084e342\") " pod="openstack-kuttl-tests/keystone-dc86d464-4bdds" Mar 16 16:49:30 crc kubenswrapper[5120]: I0316 16:49:30.624816 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-7c948f8f9d-v55lx"] Mar 16 16:49:30 crc kubenswrapper[5120]: I0316 16:49:30.631536 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/493b4ab5-5510-42b3-aec8-e25ba084e342-scripts\") pod \"keystone-dc86d464-4bdds\" (UID: \"493b4ab5-5510-42b3-aec8-e25ba084e342\") " pod="openstack-kuttl-tests/keystone-dc86d464-4bdds" Mar 16 16:49:30 crc kubenswrapper[5120]: I0316 16:49:30.633570 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/493b4ab5-5510-42b3-aec8-e25ba084e342-fernet-keys\") pod \"keystone-dc86d464-4bdds\" (UID: \"493b4ab5-5510-42b3-aec8-e25ba084e342\") " pod="openstack-kuttl-tests/keystone-dc86d464-4bdds" Mar 16 16:49:30 crc kubenswrapper[5120]: I0316 16:49:30.634008 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/493b4ab5-5510-42b3-aec8-e25ba084e342-credential-keys\") pod \"keystone-dc86d464-4bdds\" (UID: \"493b4ab5-5510-42b3-aec8-e25ba084e342\") " pod="openstack-kuttl-tests/keystone-dc86d464-4bdds" Mar 16 16:49:30 crc kubenswrapper[5120]: I0316 16:49:30.635644 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/493b4ab5-5510-42b3-aec8-e25ba084e342-combined-ca-bundle\") pod \"keystone-dc86d464-4bdds\" (UID: \"493b4ab5-5510-42b3-aec8-e25ba084e342\") " pod="openstack-kuttl-tests/keystone-dc86d464-4bdds" Mar 16 16:49:30 crc kubenswrapper[5120]: I0316 16:49:30.663774 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/493b4ab5-5510-42b3-aec8-e25ba084e342-config-data\") pod \"keystone-dc86d464-4bdds\" (UID: \"493b4ab5-5510-42b3-aec8-e25ba084e342\") " pod="openstack-kuttl-tests/keystone-dc86d464-4bdds" Mar 16 16:49:30 crc kubenswrapper[5120]: I0316 16:49:30.727983 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjfv7\" (UniqueName: \"kubernetes.io/projected/493b4ab5-5510-42b3-aec8-e25ba084e342-kube-api-access-fjfv7\") pod \"keystone-dc86d464-4bdds\" (UID: \"493b4ab5-5510-42b3-aec8-e25ba084e342\") " pod="openstack-kuttl-tests/keystone-dc86d464-4bdds" Mar 16 16:49:30 crc kubenswrapper[5120]: I0316 16:49:30.744227 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4aa560c9-7785-4e87-a285-6a229c5ef04f" path="/var/lib/kubelet/pods/4aa560c9-7785-4e87-a285-6a229c5ef04f/volumes" Mar 16 16:49:30 crc kubenswrapper[5120]: I0316 16:49:30.753311 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-7c948f8f9d-v55lx"] Mar 16 16:49:30 crc kubenswrapper[5120]: I0316 16:49:30.753366 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-86d6cb7f98-5w9h4"] Mar 16 16:49:30 crc kubenswrapper[5120]: W0316 16:49:30.974280 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5b516ced_8076_4f11_8398_77eaca65d050.slice/crio-ea8fa9acebfa083a0c61cb7a20c7766444b3591286bfbdcb3fe52ed066ff33f8 WatchSource:0}: Error finding container ea8fa9acebfa083a0c61cb7a20c7766444b3591286bfbdcb3fe52ed066ff33f8: Status 404 returned error can't find the container with id ea8fa9acebfa083a0c61cb7a20c7766444b3591286bfbdcb3fe52ed066ff33f8 Mar 16 16:49:31 crc kubenswrapper[5120]: E0316 16:49:31.060756 5120 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc3654d56_932f_4a2c_ae7d_c5aa896a3335.slice/crio-conmon-840e8d5d339442d19ad82f931a88f23400d38e38958d9210156aba093a24fe32.scope\": RecentStats: unable to find data in memory cache]" Mar 16 16:49:31 crc kubenswrapper[5120]: I0316 16:49:31.185656 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-dc86d464-4bdds" Mar 16 16:49:31 crc kubenswrapper[5120]: I0316 16:49:31.202231 5120 generic.go:358] "Generic (PLEG): container finished" podID="a7864faa-1e6e-4644-a5f5-f51e429e1e2b" containerID="cf0a8f06eaed0e3687e612c1d60597d999644af14a5963369c5ba62e98f9bcb7" exitCode=143 Mar 16 16:49:31 crc kubenswrapper[5120]: I0316 16:49:31.202435 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"a7864faa-1e6e-4644-a5f5-f51e429e1e2b","Type":"ContainerDied","Data":"cf0a8f06eaed0e3687e612c1d60597d999644af14a5963369c5ba62e98f9bcb7"} Mar 16 16:49:31 crc kubenswrapper[5120]: I0316 16:49:31.221745 5120 generic.go:358] "Generic (PLEG): container finished" podID="babd9a47-eaa5-4b06-a2d3-16732a4b2dc7" containerID="38067664f50ab8da43ddd0e6355751fdc9ef3eb7d2256c031cb4164e85be88dc" exitCode=0 Mar 16 16:49:31 crc kubenswrapper[5120]: I0316 16:49:31.222393 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"babd9a47-eaa5-4b06-a2d3-16732a4b2dc7","Type":"ContainerDied","Data":"38067664f50ab8da43ddd0e6355751fdc9ef3eb7d2256c031cb4164e85be88dc"} Mar 16 16:49:31 crc kubenswrapper[5120]: I0316 16:49:31.289531 5120 generic.go:358] "Generic (PLEG): container finished" podID="02bf1e48-defb-443a-98b5-9eed2dc9947c" containerID="f692602c06cc74dc1226e987b63623cea4c756357514c56d959b07b5301a0298" exitCode=0 Mar 16 16:49:31 crc kubenswrapper[5120]: I0316 16:49:31.289647 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"02bf1e48-defb-443a-98b5-9eed2dc9947c","Type":"ContainerDied","Data":"f692602c06cc74dc1226e987b63623cea4c756357514c56d959b07b5301a0298"} Mar 16 16:49:31 crc kubenswrapper[5120]: I0316 16:49:31.312171 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-7766ff8bd9-h465l" event={"ID":"bcef263e-93a6-4f2b-9447-230cf3444ebb","Type":"ContainerStarted","Data":"fd8d08106194a056ec614acba84c7771bd985e90cbff88f7465efdc32db63dbb"} Mar 16 16:49:31 crc kubenswrapper[5120]: I0316 16:49:31.331491 5120 generic.go:358] "Generic (PLEG): container finished" podID="00cf7a69-dcf7-45dd-9291-3e4d75ece0da" containerID="25a0f6ab9cd653f0d4ee96cd81c134f0a6c81ac1d4193f06a891df2ef4a46fec" exitCode=143 Mar 16 16:49:31 crc kubenswrapper[5120]: I0316 16:49:31.331738 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"00cf7a69-dcf7-45dd-9291-3e4d75ece0da","Type":"ContainerDied","Data":"25a0f6ab9cd653f0d4ee96cd81c134f0a6c81ac1d4193f06a891df2ef4a46fec"} Mar 16 16:49:31 crc kubenswrapper[5120]: I0316 16:49:31.338903 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-86d6cb7f98-5w9h4" event={"ID":"5b516ced-8076-4f11-8398-77eaca65d050","Type":"ContainerStarted","Data":"ea8fa9acebfa083a0c61cb7a20c7766444b3591286bfbdcb3fe52ed066ff33f8"} Mar 16 16:49:31 crc kubenswrapper[5120]: I0316 16:49:31.410543 5120 generic.go:358] "Generic (PLEG): container finished" podID="c3654d56-932f-4a2c-ae7d-c5aa896a3335" containerID="840e8d5d339442d19ad82f931a88f23400d38e38958d9210156aba093a24fe32" exitCode=0 Mar 16 16:49:31 crc kubenswrapper[5120]: I0316 16:49:31.410575 5120 generic.go:358] "Generic (PLEG): container finished" podID="c3654d56-932f-4a2c-ae7d-c5aa896a3335" containerID="bbfdb8cd78e965981b9507e7d59cc5686daa0ae97c6392812a75eafdabac1d0d" exitCode=0 Mar 16 16:49:31 crc kubenswrapper[5120]: I0316 16:49:31.410581 5120 generic.go:358] "Generic (PLEG): container finished" podID="c3654d56-932f-4a2c-ae7d-c5aa896a3335" containerID="7ac9c4c926a37d322994f6cad0d9392748087406803d3c491f27f39850ff7533" exitCode=0 Mar 16 16:49:31 crc kubenswrapper[5120]: I0316 16:49:31.410589 5120 generic.go:358] "Generic (PLEG): container finished" podID="c3654d56-932f-4a2c-ae7d-c5aa896a3335" containerID="dd8a27afa3228552faad0faf477c17d3d1dbb200e35fbfca68c54c20c3200dfb" exitCode=0 Mar 16 16:49:31 crc kubenswrapper[5120]: I0316 16:49:31.410594 5120 generic.go:358] "Generic (PLEG): container finished" podID="c3654d56-932f-4a2c-ae7d-c5aa896a3335" containerID="69b2a39b40f82d61bff95e3155bd323f14189e904e82d1bf527e593f9184d026" exitCode=0 Mar 16 16:49:31 crc kubenswrapper[5120]: I0316 16:49:31.410599 5120 generic.go:358] "Generic (PLEG): container finished" podID="c3654d56-932f-4a2c-ae7d-c5aa896a3335" containerID="93059601596c57dd4cb0821f6b812899443bad5a5184ea352f0349395bd32703" exitCode=0 Mar 16 16:49:31 crc kubenswrapper[5120]: I0316 16:49:31.410605 5120 generic.go:358] "Generic (PLEG): container finished" podID="c3654d56-932f-4a2c-ae7d-c5aa896a3335" containerID="200b8316513df356c73810c0a9920beb8581c557012243461773380bc64ba067" exitCode=0 Mar 16 16:49:31 crc kubenswrapper[5120]: I0316 16:49:31.410610 5120 generic.go:358] "Generic (PLEG): container finished" podID="c3654d56-932f-4a2c-ae7d-c5aa896a3335" containerID="e1f833adb929804d26e1c407c05f87e3c0f32afbfc09f6a35b8e8f77cf17c662" exitCode=0 Mar 16 16:49:31 crc kubenswrapper[5120]: I0316 16:49:31.410615 5120 generic.go:358] "Generic (PLEG): container finished" podID="c3654d56-932f-4a2c-ae7d-c5aa896a3335" containerID="493264b8a5de6551d9d5bfbb72f85a7cccffbde4a4ad31f5a93c687e619bd8f3" exitCode=0 Mar 16 16:49:31 crc kubenswrapper[5120]: I0316 16:49:31.410621 5120 generic.go:358] "Generic (PLEG): container finished" podID="c3654d56-932f-4a2c-ae7d-c5aa896a3335" containerID="a0580816327b0eb8461ef400bb4f56c4a674f2735ad70d7f9fccfeceb50b4ce0" exitCode=0 Mar 16 16:49:31 crc kubenswrapper[5120]: I0316 16:49:31.410625 5120 generic.go:358] "Generic (PLEG): container finished" podID="c3654d56-932f-4a2c-ae7d-c5aa896a3335" containerID="0b105e090b93d50bd77aae540a71b896fad1b6b84d9968e0904aa102fa6be83c" exitCode=0 Mar 16 16:49:31 crc kubenswrapper[5120]: I0316 16:49:31.410631 5120 generic.go:358] "Generic (PLEG): container finished" podID="c3654d56-932f-4a2c-ae7d-c5aa896a3335" containerID="ae08a40e5389e61f869b34a0c0c20a08d3c7ebdd649af11eaaeed4303c931780" exitCode=0 Mar 16 16:49:31 crc kubenswrapper[5120]: I0316 16:49:31.410637 5120 generic.go:358] "Generic (PLEG): container finished" podID="c3654d56-932f-4a2c-ae7d-c5aa896a3335" containerID="c7597b14c46effc0b5e75329c58fef2db86348b4ca6946ae9f6477dc35893a0e" exitCode=0 Mar 16 16:49:31 crc kubenswrapper[5120]: I0316 16:49:31.410725 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"c3654d56-932f-4a2c-ae7d-c5aa896a3335","Type":"ContainerDied","Data":"840e8d5d339442d19ad82f931a88f23400d38e38958d9210156aba093a24fe32"} Mar 16 16:49:31 crc kubenswrapper[5120]: I0316 16:49:31.410750 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"c3654d56-932f-4a2c-ae7d-c5aa896a3335","Type":"ContainerDied","Data":"bbfdb8cd78e965981b9507e7d59cc5686daa0ae97c6392812a75eafdabac1d0d"} Mar 16 16:49:31 crc kubenswrapper[5120]: I0316 16:49:31.410779 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"c3654d56-932f-4a2c-ae7d-c5aa896a3335","Type":"ContainerDied","Data":"7ac9c4c926a37d322994f6cad0d9392748087406803d3c491f27f39850ff7533"} Mar 16 16:49:31 crc kubenswrapper[5120]: I0316 16:49:31.410791 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"c3654d56-932f-4a2c-ae7d-c5aa896a3335","Type":"ContainerDied","Data":"dd8a27afa3228552faad0faf477c17d3d1dbb200e35fbfca68c54c20c3200dfb"} Mar 16 16:49:31 crc kubenswrapper[5120]: I0316 16:49:31.410802 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"c3654d56-932f-4a2c-ae7d-c5aa896a3335","Type":"ContainerDied","Data":"69b2a39b40f82d61bff95e3155bd323f14189e904e82d1bf527e593f9184d026"} Mar 16 16:49:31 crc kubenswrapper[5120]: I0316 16:49:31.410814 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"c3654d56-932f-4a2c-ae7d-c5aa896a3335","Type":"ContainerDied","Data":"93059601596c57dd4cb0821f6b812899443bad5a5184ea352f0349395bd32703"} Mar 16 16:49:31 crc kubenswrapper[5120]: I0316 16:49:31.410827 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"c3654d56-932f-4a2c-ae7d-c5aa896a3335","Type":"ContainerDied","Data":"200b8316513df356c73810c0a9920beb8581c557012243461773380bc64ba067"} Mar 16 16:49:31 crc kubenswrapper[5120]: I0316 16:49:31.410838 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"c3654d56-932f-4a2c-ae7d-c5aa896a3335","Type":"ContainerDied","Data":"e1f833adb929804d26e1c407c05f87e3c0f32afbfc09f6a35b8e8f77cf17c662"} Mar 16 16:49:31 crc kubenswrapper[5120]: I0316 16:49:31.410849 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"c3654d56-932f-4a2c-ae7d-c5aa896a3335","Type":"ContainerDied","Data":"493264b8a5de6551d9d5bfbb72f85a7cccffbde4a4ad31f5a93c687e619bd8f3"} Mar 16 16:49:31 crc kubenswrapper[5120]: I0316 16:49:31.410861 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"c3654d56-932f-4a2c-ae7d-c5aa896a3335","Type":"ContainerDied","Data":"a0580816327b0eb8461ef400bb4f56c4a674f2735ad70d7f9fccfeceb50b4ce0"} Mar 16 16:49:31 crc kubenswrapper[5120]: I0316 16:49:31.410871 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"c3654d56-932f-4a2c-ae7d-c5aa896a3335","Type":"ContainerDied","Data":"0b105e090b93d50bd77aae540a71b896fad1b6b84d9968e0904aa102fa6be83c"} Mar 16 16:49:31 crc kubenswrapper[5120]: I0316 16:49:31.410881 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"c3654d56-932f-4a2c-ae7d-c5aa896a3335","Type":"ContainerDied","Data":"ae08a40e5389e61f869b34a0c0c20a08d3c7ebdd649af11eaaeed4303c931780"} Mar 16 16:49:31 crc kubenswrapper[5120]: I0316 16:49:31.410890 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"c3654d56-932f-4a2c-ae7d-c5aa896a3335","Type":"ContainerDied","Data":"c7597b14c46effc0b5e75329c58fef2db86348b4ca6946ae9f6477dc35893a0e"} Mar 16 16:49:31 crc kubenswrapper[5120]: I0316 16:49:31.435441 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-5dc7897bc-w6pc6"] Mar 16 16:49:31 crc kubenswrapper[5120]: I0316 16:49:31.589743 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/rabbitmq-server-0" podUID="07aa860b-bb17-4a36-bc23-549bfd1bdb5c" containerName="rabbitmq" containerID="cri-o://45cb557a01c4d5f3fcaf3f1ae59379de4a157caa00add93b62710010548ac944" gracePeriod=604797 Mar 16 16:49:31 crc kubenswrapper[5120]: W0316 16:49:31.903676 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9ad6c5f4_1902_463a_8a6f_6beade89b6a1.slice/crio-8220bdc2e571e91e899f7e4dd3dd14f66801469c79c409329b723a9607a96105 WatchSource:0}: Error finding container 8220bdc2e571e91e899f7e4dd3dd14f66801469c79c409329b723a9607a96105: Status 404 returned error can't find the container with id 8220bdc2e571e91e899f7e4dd3dd14f66801469c79c409329b723a9607a96105 Mar 16 16:49:32 crc kubenswrapper[5120]: I0316 16:49:32.038383 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 16:49:32 crc kubenswrapper[5120]: I0316 16:49:32.039247 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podUID="d6803c98-d09b-4fbe-9fd6-b8b91ac81c77" containerName="openstack-network-exporter" containerID="cri-o://f2a9e2812d2124684265fddf41aa8bbd158c31d431c3c4f1f41c3d41428a1d03" gracePeriod=300 Mar 16 16:49:32 crc kubenswrapper[5120]: I0316 16:49:32.182258 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podUID="d6803c98-d09b-4fbe-9fd6-b8b91ac81c77" containerName="ovsdbserver-sb" containerID="cri-o://9e4c6ac619f9d44e6512347976721eb7f2ded5db301b59c7afe2d9148feca5f9" gracePeriod=300 Mar 16 16:49:32 crc kubenswrapper[5120]: I0316 16:49:32.256346 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 16:49:32 crc kubenswrapper[5120]: I0316 16:49:32.256668 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovn-northd-0" podUID="9d4a3a13-20de-450c-b14b-9f148b93bdcc" containerName="ovn-northd" containerID="cri-o://e4568b8c4c24477e088010519cc3fe4c88c7800a42f8be6e09c85136ea3ec934" gracePeriod=30 Mar 16 16:49:32 crc kubenswrapper[5120]: I0316 16:49:32.257362 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovn-northd-0" podUID="9d4a3a13-20de-450c-b14b-9f148b93bdcc" containerName="openstack-network-exporter" containerID="cri-o://7a82fe03a967791396cd15b59558158cfdbef68e46a52b16df2605a21ba6fbe2" gracePeriod=30 Mar 16 16:49:32 crc kubenswrapper[5120]: I0316 16:49:32.274162 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Mar 16 16:49:32 crc kubenswrapper[5120]: I0316 16:49:32.394608 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4lnld\" (UniqueName: \"kubernetes.io/projected/02bf1e48-defb-443a-98b5-9eed2dc9947c-kube-api-access-4lnld\") pod \"02bf1e48-defb-443a-98b5-9eed2dc9947c\" (UID: \"02bf1e48-defb-443a-98b5-9eed2dc9947c\") " Mar 16 16:49:32 crc kubenswrapper[5120]: I0316 16:49:32.395240 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/02bf1e48-defb-443a-98b5-9eed2dc9947c-config-data\") pod \"02bf1e48-defb-443a-98b5-9eed2dc9947c\" (UID: \"02bf1e48-defb-443a-98b5-9eed2dc9947c\") " Mar 16 16:49:32 crc kubenswrapper[5120]: I0316 16:49:32.395329 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/02bf1e48-defb-443a-98b5-9eed2dc9947c-kolla-config\") pod \"02bf1e48-defb-443a-98b5-9eed2dc9947c\" (UID: \"02bf1e48-defb-443a-98b5-9eed2dc9947c\") " Mar 16 16:49:32 crc kubenswrapper[5120]: I0316 16:49:32.396713 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02bf1e48-defb-443a-98b5-9eed2dc9947c-config-data" (OuterVolumeSpecName: "config-data") pod "02bf1e48-defb-443a-98b5-9eed2dc9947c" (UID: "02bf1e48-defb-443a-98b5-9eed2dc9947c"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:49:32 crc kubenswrapper[5120]: I0316 16:49:32.403525 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02bf1e48-defb-443a-98b5-9eed2dc9947c-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "02bf1e48-defb-443a-98b5-9eed2dc9947c" (UID: "02bf1e48-defb-443a-98b5-9eed2dc9947c"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:49:32 crc kubenswrapper[5120]: I0316 16:49:32.404296 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/02bf1e48-defb-443a-98b5-9eed2dc9947c-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:32 crc kubenswrapper[5120]: I0316 16:49:32.404310 5120 reconciler_common.go:299] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/02bf1e48-defb-443a-98b5-9eed2dc9947c-kolla-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:32 crc kubenswrapper[5120]: I0316 16:49:32.404579 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02bf1e48-defb-443a-98b5-9eed2dc9947c-kube-api-access-4lnld" (OuterVolumeSpecName: "kube-api-access-4lnld") pod "02bf1e48-defb-443a-98b5-9eed2dc9947c" (UID: "02bf1e48-defb-443a-98b5-9eed2dc9947c"). InnerVolumeSpecName "kube-api-access-4lnld". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:49:32 crc kubenswrapper[5120]: I0316 16:49:32.512365 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-f5b8b4576-z8chc"] Mar 16 16:49:32 crc kubenswrapper[5120]: I0316 16:49:32.521894 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4lnld\" (UniqueName: \"kubernetes.io/projected/02bf1e48-defb-443a-98b5-9eed2dc9947c-kube-api-access-4lnld\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:32 crc kubenswrapper[5120]: I0316 16:49:32.570611 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-6sq2s"] Mar 16 16:49:32 crc kubenswrapper[5120]: I0316 16:49:32.621222 5120 generic.go:358] "Generic (PLEG): container finished" podID="03693dff-f5dd-4199-8cb2-e6f12d5a0703" containerID="56bafd5d554c07424b2372cb9d09d48c6c8a503553bf48586be2bda216c559d8" exitCode=0 Mar 16 16:49:32 crc kubenswrapper[5120]: I0316 16:49:32.621255 5120 generic.go:358] "Generic (PLEG): container finished" podID="03693dff-f5dd-4199-8cb2-e6f12d5a0703" containerID="f12dd69527499a1398e4a608adaef103b3aa7f300de680b04045d0b9a14eedc2" exitCode=0 Mar 16 16:49:32 crc kubenswrapper[5120]: I0316 16:49:32.621363 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"03693dff-f5dd-4199-8cb2-e6f12d5a0703","Type":"ContainerDied","Data":"56bafd5d554c07424b2372cb9d09d48c6c8a503553bf48586be2bda216c559d8"} Mar 16 16:49:32 crc kubenswrapper[5120]: I0316 16:49:32.621418 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"03693dff-f5dd-4199-8cb2-e6f12d5a0703","Type":"ContainerDied","Data":"f12dd69527499a1398e4a608adaef103b3aa7f300de680b04045d0b9a14eedc2"} Mar 16 16:49:32 crc kubenswrapper[5120]: I0316 16:49:32.624011 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:49:32 crc kubenswrapper[5120]: I0316 16:49:32.624527 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-5c574fdfbb-8rvsq"] Mar 16 16:49:32 crc kubenswrapper[5120]: I0316 16:49:32.636457 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-678df6fbdb-lfhdz"] Mar 16 16:49:32 crc kubenswrapper[5120]: I0316 16:49:32.639226 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="babd9a47-eaa5-4b06-a2d3-16732a4b2dc7" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 16:49:32 crc kubenswrapper[5120]: I0316 16:49:32.639254 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="babd9a47-eaa5-4b06-a2d3-16732a4b2dc7" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 16:49:32 crc kubenswrapper[5120]: I0316 16:49:32.639272 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02bf1e48-defb-443a-98b5-9eed2dc9947c" containerName="memcached" Mar 16 16:49:32 crc kubenswrapper[5120]: I0316 16:49:32.639278 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="02bf1e48-defb-443a-98b5-9eed2dc9947c" containerName="memcached" Mar 16 16:49:32 crc kubenswrapper[5120]: I0316 16:49:32.639554 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="02bf1e48-defb-443a-98b5-9eed2dc9947c" containerName="memcached" Mar 16 16:49:32 crc kubenswrapper[5120]: I0316 16:49:32.639574 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="babd9a47-eaa5-4b06-a2d3-16732a4b2dc7" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 16:49:32 crc kubenswrapper[5120]: I0316 16:49:32.650281 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-7b66994cdb-4jkjq" event={"ID":"011b06d9-6610-4fc7-97ab-697050a06ec4","Type":"ContainerStarted","Data":"72cf42ee5a1dd1662d5e629838f7321e79ca35c759f851acd86e0dcb0d0733a1"} Mar 16 16:49:32 crc kubenswrapper[5120]: I0316 16:49:32.650324 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-678df6fbdb-lfhdz"] Mar 16 16:49:32 crc kubenswrapper[5120]: I0316 16:49:32.650428 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-678df6fbdb-lfhdz" Mar 16 16:49:32 crc kubenswrapper[5120]: I0316 16:49:32.683224 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" podUID="aa12529b-b6fe-4512-88ec-fd6250636e6b" containerName="rabbitmq" containerID="cri-o://c850be05d5aca34a4b506a8d1a6a6816d3a77902224755fcceb07ca0e744a3d9" gracePeriod=604796 Mar 16 16:49:32 crc kubenswrapper[5120]: I0316 16:49:32.698620 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0be76020-d856-43c3-a89a-7ab5b83c0606" path="/var/lib/kubelet/pods/0be76020-d856-43c3-a89a-7ab5b83c0606/volumes" Mar 16 16:49:32 crc kubenswrapper[5120]: I0316 16:49:32.703930 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Mar 16 16:49:32 crc kubenswrapper[5120]: I0316 16:49:32.716881 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_d6803c98-d09b-4fbe-9fd6-b8b91ac81c77/ovsdbserver-sb/0.log" Mar 16 16:49:32 crc kubenswrapper[5120]: I0316 16:49:32.716921 5120 generic.go:358] "Generic (PLEG): container finished" podID="d6803c98-d09b-4fbe-9fd6-b8b91ac81c77" containerID="f2a9e2812d2124684265fddf41aa8bbd158c31d431c3c4f1f41c3d41428a1d03" exitCode=2 Mar 16 16:49:32 crc kubenswrapper[5120]: I0316 16:49:32.716935 5120 generic.go:358] "Generic (PLEG): container finished" podID="d6803c98-d09b-4fbe-9fd6-b8b91ac81c77" containerID="9e4c6ac619f9d44e6512347976721eb7f2ded5db301b59c7afe2d9148feca5f9" exitCode=143 Mar 16 16:49:32 crc kubenswrapper[5120]: I0316 16:49:32.740352 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9qgd9\" (UniqueName: \"kubernetes.io/projected/babd9a47-eaa5-4b06-a2d3-16732a4b2dc7-kube-api-access-9qgd9\") pod \"babd9a47-eaa5-4b06-a2d3-16732a4b2dc7\" (UID: \"babd9a47-eaa5-4b06-a2d3-16732a4b2dc7\") " Mar 16 16:49:32 crc kubenswrapper[5120]: I0316 16:49:32.740452 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/babd9a47-eaa5-4b06-a2d3-16732a4b2dc7-combined-ca-bundle\") pod \"babd9a47-eaa5-4b06-a2d3-16732a4b2dc7\" (UID: \"babd9a47-eaa5-4b06-a2d3-16732a4b2dc7\") " Mar 16 16:49:32 crc kubenswrapper[5120]: I0316 16:49:32.740750 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/babd9a47-eaa5-4b06-a2d3-16732a4b2dc7-config-data\") pod \"babd9a47-eaa5-4b06-a2d3-16732a4b2dc7\" (UID: \"babd9a47-eaa5-4b06-a2d3-16732a4b2dc7\") " Mar 16 16:49:32 crc kubenswrapper[5120]: I0316 16:49:32.740980 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/398bb1bd-f380-4374-b880-d7217d37e010-config\") pod \"neutron-678df6fbdb-lfhdz\" (UID: \"398bb1bd-f380-4374-b880-d7217d37e010\") " pod="openstack-kuttl-tests/neutron-678df6fbdb-lfhdz" Mar 16 16:49:32 crc kubenswrapper[5120]: I0316 16:49:32.741088 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbbx5\" (UniqueName: \"kubernetes.io/projected/398bb1bd-f380-4374-b880-d7217d37e010-kube-api-access-wbbx5\") pod \"neutron-678df6fbdb-lfhdz\" (UID: \"398bb1bd-f380-4374-b880-d7217d37e010\") " pod="openstack-kuttl-tests/neutron-678df6fbdb-lfhdz" Mar 16 16:49:32 crc kubenswrapper[5120]: I0316 16:49:32.741358 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/398bb1bd-f380-4374-b880-d7217d37e010-combined-ca-bundle\") pod \"neutron-678df6fbdb-lfhdz\" (UID: \"398bb1bd-f380-4374-b880-d7217d37e010\") " pod="openstack-kuttl-tests/neutron-678df6fbdb-lfhdz" Mar 16 16:49:32 crc kubenswrapper[5120]: I0316 16:49:32.741597 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/398bb1bd-f380-4374-b880-d7217d37e010-httpd-config\") pod \"neutron-678df6fbdb-lfhdz\" (UID: \"398bb1bd-f380-4374-b880-d7217d37e010\") " pod="openstack-kuttl-tests/neutron-678df6fbdb-lfhdz" Mar 16 16:49:32 crc kubenswrapper[5120]: I0316 16:49:32.748436 5120 generic.go:358] "Generic (PLEG): container finished" podID="c3654d56-932f-4a2c-ae7d-c5aa896a3335" containerID="787835b144ba391e7ea878ac319488125e890928c0bbbe44d53383ad86f552c7" exitCode=0 Mar 16 16:49:32 crc kubenswrapper[5120]: I0316 16:49:32.770438 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/babd9a47-eaa5-4b06-a2d3-16732a4b2dc7-kube-api-access-9qgd9" (OuterVolumeSpecName: "kube-api-access-9qgd9") pod "babd9a47-eaa5-4b06-a2d3-16732a4b2dc7" (UID: "babd9a47-eaa5-4b06-a2d3-16732a4b2dc7"). InnerVolumeSpecName "kube-api-access-9qgd9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:49:32 crc kubenswrapper[5120]: I0316 16:49:32.776116 5120 generic.go:358] "Generic (PLEG): container finished" podID="6433979b-c153-4721-8866-0d9bcd0480bb" containerID="22d8a51d4ad3c9bcfd9809d3a1832743ec83f25d019d4ab903345f8d3f5e7a5b" exitCode=0 Mar 16 16:49:32 crc kubenswrapper[5120]: I0316 16:49:32.784168 5120 generic.go:358] "Generic (PLEG): container finished" podID="9d4a3a13-20de-450c-b14b-9f148b93bdcc" containerID="7a82fe03a967791396cd15b59558158cfdbef68e46a52b16df2605a21ba6fbe2" exitCode=2 Mar 16 16:49:32 crc kubenswrapper[5120]: I0316 16:49:32.786718 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:49:32 crc kubenswrapper[5120]: I0316 16:49:32.822612 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/babd9a47-eaa5-4b06-a2d3-16732a4b2dc7-config-data" (OuterVolumeSpecName: "config-data") pod "babd9a47-eaa5-4b06-a2d3-16732a4b2dc7" (UID: "babd9a47-eaa5-4b06-a2d3-16732a4b2dc7"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:49:32 crc kubenswrapper[5120]: I0316 16:49:32.856247 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/398bb1bd-f380-4374-b880-d7217d37e010-httpd-config\") pod \"neutron-678df6fbdb-lfhdz\" (UID: \"398bb1bd-f380-4374-b880-d7217d37e010\") " pod="openstack-kuttl-tests/neutron-678df6fbdb-lfhdz" Mar 16 16:49:32 crc kubenswrapper[5120]: I0316 16:49:32.856345 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/398bb1bd-f380-4374-b880-d7217d37e010-config\") pod \"neutron-678df6fbdb-lfhdz\" (UID: \"398bb1bd-f380-4374-b880-d7217d37e010\") " pod="openstack-kuttl-tests/neutron-678df6fbdb-lfhdz" Mar 16 16:49:32 crc kubenswrapper[5120]: I0316 16:49:32.856404 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wbbx5\" (UniqueName: \"kubernetes.io/projected/398bb1bd-f380-4374-b880-d7217d37e010-kube-api-access-wbbx5\") pod \"neutron-678df6fbdb-lfhdz\" (UID: \"398bb1bd-f380-4374-b880-d7217d37e010\") " pod="openstack-kuttl-tests/neutron-678df6fbdb-lfhdz" Mar 16 16:49:32 crc kubenswrapper[5120]: I0316 16:49:32.856668 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/398bb1bd-f380-4374-b880-d7217d37e010-combined-ca-bundle\") pod \"neutron-678df6fbdb-lfhdz\" (UID: \"398bb1bd-f380-4374-b880-d7217d37e010\") " pod="openstack-kuttl-tests/neutron-678df6fbdb-lfhdz" Mar 16 16:49:32 crc kubenswrapper[5120]: I0316 16:49:32.856825 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/babd9a47-eaa5-4b06-a2d3-16732a4b2dc7-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:32 crc kubenswrapper[5120]: I0316 16:49:32.856840 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9qgd9\" (UniqueName: \"kubernetes.io/projected/babd9a47-eaa5-4b06-a2d3-16732a4b2dc7-kube-api-access-9qgd9\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:32 crc kubenswrapper[5120]: I0316 16:49:32.871548 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/398bb1bd-f380-4374-b880-d7217d37e010-combined-ca-bundle\") pod \"neutron-678df6fbdb-lfhdz\" (UID: \"398bb1bd-f380-4374-b880-d7217d37e010\") " pod="openstack-kuttl-tests/neutron-678df6fbdb-lfhdz" Mar 16 16:49:32 crc kubenswrapper[5120]: I0316 16:49:32.873706 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/398bb1bd-f380-4374-b880-d7217d37e010-config\") pod \"neutron-678df6fbdb-lfhdz\" (UID: \"398bb1bd-f380-4374-b880-d7217d37e010\") " pod="openstack-kuttl-tests/neutron-678df6fbdb-lfhdz" Mar 16 16:49:32 crc kubenswrapper[5120]: I0316 16:49:32.882306 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/398bb1bd-f380-4374-b880-d7217d37e010-httpd-config\") pod \"neutron-678df6fbdb-lfhdz\" (UID: \"398bb1bd-f380-4374-b880-d7217d37e010\") " pod="openstack-kuttl-tests/neutron-678df6fbdb-lfhdz" Mar 16 16:49:32 crc kubenswrapper[5120]: I0316 16:49:32.884150 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbbx5\" (UniqueName: \"kubernetes.io/projected/398bb1bd-f380-4374-b880-d7217d37e010-kube-api-access-wbbx5\") pod \"neutron-678df6fbdb-lfhdz\" (UID: \"398bb1bd-f380-4374-b880-d7217d37e010\") " pod="openstack-kuttl-tests/neutron-678df6fbdb-lfhdz" Mar 16 16:49:32 crc kubenswrapper[5120]: I0316 16:49:32.925125 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"02bf1e48-defb-443a-98b5-9eed2dc9947c","Type":"ContainerDied","Data":"64fd0e6048b16f89edb0f228c40532f4d93cf948d7c852bec53795e3affc6b31"} Mar 16 16:49:32 crc kubenswrapper[5120]: I0316 16:49:32.925164 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"d6803c98-d09b-4fbe-9fd6-b8b91ac81c77","Type":"ContainerDied","Data":"f2a9e2812d2124684265fddf41aa8bbd158c31d431c3c4f1f41c3d41428a1d03"} Mar 16 16:49:32 crc kubenswrapper[5120]: I0316 16:49:32.925179 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"d6803c98-d09b-4fbe-9fd6-b8b91ac81c77","Type":"ContainerDied","Data":"9e4c6ac619f9d44e6512347976721eb7f2ded5db301b59c7afe2d9148feca5f9"} Mar 16 16:49:32 crc kubenswrapper[5120]: I0316 16:49:32.925189 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"c3654d56-932f-4a2c-ae7d-c5aa896a3335","Type":"ContainerDied","Data":"787835b144ba391e7ea878ac319488125e890928c0bbbe44d53383ad86f552c7"} Mar 16 16:49:32 crc kubenswrapper[5120]: I0316 16:49:32.925203 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"6433979b-c153-4721-8866-0d9bcd0480bb","Type":"ContainerDied","Data":"22d8a51d4ad3c9bcfd9809d3a1832743ec83f25d019d4ab903345f8d3f5e7a5b"} Mar 16 16:49:32 crc kubenswrapper[5120]: I0316 16:49:32.925234 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-5dc7897bc-w6pc6" event={"ID":"9ad6c5f4-1902-463a-8a6f-6beade89b6a1","Type":"ContainerStarted","Data":"8220bdc2e571e91e899f7e4dd3dd14f66801469c79c409329b723a9607a96105"} Mar 16 16:49:32 crc kubenswrapper[5120]: I0316 16:49:32.925246 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"9d4a3a13-20de-450c-b14b-9f148b93bdcc","Type":"ContainerDied","Data":"7a82fe03a967791396cd15b59558158cfdbef68e46a52b16df2605a21ba6fbe2"} Mar 16 16:49:32 crc kubenswrapper[5120]: I0316 16:49:32.925257 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"babd9a47-eaa5-4b06-a2d3-16732a4b2dc7","Type":"ContainerDied","Data":"76411f14fc4d568d664b206dbdb72ead8d1a3fecc1443de684c3e1c83dea1140"} Mar 16 16:49:32 crc kubenswrapper[5120]: I0316 16:49:32.925276 5120 scope.go:117] "RemoveContainer" containerID="f692602c06cc74dc1226e987b63623cea4c756357514c56d959b07b5301a0298" Mar 16 16:49:32 crc kubenswrapper[5120]: I0316 16:49:32.926604 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/babd9a47-eaa5-4b06-a2d3-16732a4b2dc7-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "babd9a47-eaa5-4b06-a2d3-16732a4b2dc7" (UID: "babd9a47-eaa5-4b06-a2d3-16732a4b2dc7"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:49:32 crc kubenswrapper[5120]: I0316 16:49:32.958616 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/babd9a47-eaa5-4b06-a2d3-16732a4b2dc7-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:33 crc kubenswrapper[5120]: I0316 16:49:33.004433 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-678df6fbdb-lfhdz" Mar 16 16:49:33 crc kubenswrapper[5120]: I0316 16:49:33.004904 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 16:49:33 crc kubenswrapper[5120]: I0316 16:49:33.009462 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:49:33 crc kubenswrapper[5120]: I0316 16:49:33.034017 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 16:49:33 crc kubenswrapper[5120]: I0316 16:49:33.056299 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 16:49:33 crc kubenswrapper[5120]: I0316 16:49:33.058502 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03693dff-f5dd-4199-8cb2-e6f12d5a0703" containerName="cinder-scheduler" Mar 16 16:49:33 crc kubenswrapper[5120]: I0316 16:49:33.058585 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="03693dff-f5dd-4199-8cb2-e6f12d5a0703" containerName="cinder-scheduler" Mar 16 16:49:33 crc kubenswrapper[5120]: I0316 16:49:33.058636 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03693dff-f5dd-4199-8cb2-e6f12d5a0703" containerName="probe" Mar 16 16:49:33 crc kubenswrapper[5120]: I0316 16:49:33.058644 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="03693dff-f5dd-4199-8cb2-e6f12d5a0703" containerName="probe" Mar 16 16:49:33 crc kubenswrapper[5120]: I0316 16:49:33.059057 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="03693dff-f5dd-4199-8cb2-e6f12d5a0703" containerName="probe" Mar 16 16:49:33 crc kubenswrapper[5120]: I0316 16:49:33.059116 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="03693dff-f5dd-4199-8cb2-e6f12d5a0703" containerName="cinder-scheduler" Mar 16 16:49:33 crc kubenswrapper[5120]: I0316 16:49:33.070339 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Mar 16 16:49:33 crc kubenswrapper[5120]: I0316 16:49:33.073052 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"memcached-memcached-dockercfg-njnwg\"" Mar 16 16:49:33 crc kubenswrapper[5120]: I0316 16:49:33.073474 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"memcached-config-data\"" Mar 16 16:49:33 crc kubenswrapper[5120]: I0316 16:49:33.074165 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-memcached-svc\"" Mar 16 16:49:33 crc kubenswrapper[5120]: I0316 16:49:33.085941 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 16:49:33 crc kubenswrapper[5120]: I0316 16:49:33.136533 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/cinder-api-0" podUID="5988349f-8dba-4fde-acf3-6d8acf01117f" containerName="cinder-api" probeResult="failure" output="Get \"http://10.217.1.175:8776/healthcheck\": read tcp 10.217.0.2:43368->10.217.1.175:8776: read: connection reset by peer" Mar 16 16:49:33 crc kubenswrapper[5120]: I0316 16:49:33.143258 5120 scope.go:117] "RemoveContainer" containerID="38067664f50ab8da43ddd0e6355751fdc9ef3eb7d2256c031cb4164e85be88dc" Mar 16 16:49:33 crc kubenswrapper[5120]: I0316 16:49:33.164354 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/03693dff-f5dd-4199-8cb2-e6f12d5a0703-config-data-custom\") pod \"03693dff-f5dd-4199-8cb2-e6f12d5a0703\" (UID: \"03693dff-f5dd-4199-8cb2-e6f12d5a0703\") " Mar 16 16:49:33 crc kubenswrapper[5120]: I0316 16:49:33.165014 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bd4vt\" (UniqueName: \"kubernetes.io/projected/03693dff-f5dd-4199-8cb2-e6f12d5a0703-kube-api-access-bd4vt\") pod \"03693dff-f5dd-4199-8cb2-e6f12d5a0703\" (UID: \"03693dff-f5dd-4199-8cb2-e6f12d5a0703\") " Mar 16 16:49:33 crc kubenswrapper[5120]: I0316 16:49:33.165066 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/03693dff-f5dd-4199-8cb2-e6f12d5a0703-combined-ca-bundle\") pod \"03693dff-f5dd-4199-8cb2-e6f12d5a0703\" (UID: \"03693dff-f5dd-4199-8cb2-e6f12d5a0703\") " Mar 16 16:49:33 crc kubenswrapper[5120]: I0316 16:49:33.165148 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/03693dff-f5dd-4199-8cb2-e6f12d5a0703-scripts\") pod \"03693dff-f5dd-4199-8cb2-e6f12d5a0703\" (UID: \"03693dff-f5dd-4199-8cb2-e6f12d5a0703\") " Mar 16 16:49:33 crc kubenswrapper[5120]: I0316 16:49:33.165318 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/03693dff-f5dd-4199-8cb2-e6f12d5a0703-config-data\") pod \"03693dff-f5dd-4199-8cb2-e6f12d5a0703\" (UID: \"03693dff-f5dd-4199-8cb2-e6f12d5a0703\") " Mar 16 16:49:33 crc kubenswrapper[5120]: I0316 16:49:33.165409 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/03693dff-f5dd-4199-8cb2-e6f12d5a0703-etc-machine-id\") pod \"03693dff-f5dd-4199-8cb2-e6f12d5a0703\" (UID: \"03693dff-f5dd-4199-8cb2-e6f12d5a0703\") " Mar 16 16:49:33 crc kubenswrapper[5120]: I0316 16:49:33.165813 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/243f6b1f-595b-44eb-aaa5-0b3df41c88c1-memcached-tls-certs\") pod \"memcached-0\" (UID: \"243f6b1f-595b-44eb-aaa5-0b3df41c88c1\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:49:33 crc kubenswrapper[5120]: I0316 16:49:33.165899 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/243f6b1f-595b-44eb-aaa5-0b3df41c88c1-kolla-config\") pod \"memcached-0\" (UID: \"243f6b1f-595b-44eb-aaa5-0b3df41c88c1\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:49:33 crc kubenswrapper[5120]: I0316 16:49:33.166003 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/243f6b1f-595b-44eb-aaa5-0b3df41c88c1-combined-ca-bundle\") pod \"memcached-0\" (UID: \"243f6b1f-595b-44eb-aaa5-0b3df41c88c1\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:49:33 crc kubenswrapper[5120]: I0316 16:49:33.166182 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/243f6b1f-595b-44eb-aaa5-0b3df41c88c1-config-data\") pod \"memcached-0\" (UID: \"243f6b1f-595b-44eb-aaa5-0b3df41c88c1\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:49:33 crc kubenswrapper[5120]: I0316 16:49:33.166309 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njnw4\" (UniqueName: \"kubernetes.io/projected/243f6b1f-595b-44eb-aaa5-0b3df41c88c1-kube-api-access-njnw4\") pod \"memcached-0\" (UID: \"243f6b1f-595b-44eb-aaa5-0b3df41c88c1\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:49:33 crc kubenswrapper[5120]: I0316 16:49:33.168716 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/03693dff-f5dd-4199-8cb2-e6f12d5a0703-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "03693dff-f5dd-4199-8cb2-e6f12d5a0703" (UID: "03693dff-f5dd-4199-8cb2-e6f12d5a0703"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 16:49:33 crc kubenswrapper[5120]: I0316 16:49:33.200960 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03693dff-f5dd-4199-8cb2-e6f12d5a0703-kube-api-access-bd4vt" (OuterVolumeSpecName: "kube-api-access-bd4vt") pod "03693dff-f5dd-4199-8cb2-e6f12d5a0703" (UID: "03693dff-f5dd-4199-8cb2-e6f12d5a0703"). InnerVolumeSpecName "kube-api-access-bd4vt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:49:33 crc kubenswrapper[5120]: I0316 16:49:33.202195 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/03693dff-f5dd-4199-8cb2-e6f12d5a0703-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "03693dff-f5dd-4199-8cb2-e6f12d5a0703" (UID: "03693dff-f5dd-4199-8cb2-e6f12d5a0703"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:49:33 crc kubenswrapper[5120]: I0316 16:49:33.225113 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:49:33 crc kubenswrapper[5120]: I0316 16:49:33.247823 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:49:33 crc kubenswrapper[5120]: I0316 16:49:33.250094 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/03693dff-f5dd-4199-8cb2-e6f12d5a0703-scripts" (OuterVolumeSpecName: "scripts") pod "03693dff-f5dd-4199-8cb2-e6f12d5a0703" (UID: "03693dff-f5dd-4199-8cb2-e6f12d5a0703"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:49:33 crc kubenswrapper[5120]: I0316 16:49:33.263947 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:49:33 crc kubenswrapper[5120]: I0316 16:49:33.292313 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:49:33 crc kubenswrapper[5120]: I0316 16:49:33.296186 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/243f6b1f-595b-44eb-aaa5-0b3df41c88c1-config-data\") pod \"memcached-0\" (UID: \"243f6b1f-595b-44eb-aaa5-0b3df41c88c1\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:49:33 crc kubenswrapper[5120]: I0316 16:49:33.296409 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-njnw4\" (UniqueName: \"kubernetes.io/projected/243f6b1f-595b-44eb-aaa5-0b3df41c88c1-kube-api-access-njnw4\") pod \"memcached-0\" (UID: \"243f6b1f-595b-44eb-aaa5-0b3df41c88c1\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:49:33 crc kubenswrapper[5120]: I0316 16:49:33.296713 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/243f6b1f-595b-44eb-aaa5-0b3df41c88c1-memcached-tls-certs\") pod \"memcached-0\" (UID: \"243f6b1f-595b-44eb-aaa5-0b3df41c88c1\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:49:33 crc kubenswrapper[5120]: I0316 16:49:33.297006 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/243f6b1f-595b-44eb-aaa5-0b3df41c88c1-kolla-config\") pod \"memcached-0\" (UID: \"243f6b1f-595b-44eb-aaa5-0b3df41c88c1\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:49:33 crc kubenswrapper[5120]: I0316 16:49:33.297147 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/243f6b1f-595b-44eb-aaa5-0b3df41c88c1-combined-ca-bundle\") pod \"memcached-0\" (UID: \"243f6b1f-595b-44eb-aaa5-0b3df41c88c1\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:49:33 crc kubenswrapper[5120]: I0316 16:49:33.297321 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/03693dff-f5dd-4199-8cb2-e6f12d5a0703-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:33 crc kubenswrapper[5120]: I0316 16:49:33.297344 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bd4vt\" (UniqueName: \"kubernetes.io/projected/03693dff-f5dd-4199-8cb2-e6f12d5a0703-kube-api-access-bd4vt\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:33 crc kubenswrapper[5120]: I0316 16:49:33.297358 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/03693dff-f5dd-4199-8cb2-e6f12d5a0703-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:33 crc kubenswrapper[5120]: I0316 16:49:33.297370 5120 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/03693dff-f5dd-4199-8cb2-e6f12d5a0703-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:33 crc kubenswrapper[5120]: I0316 16:49:33.300105 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/243f6b1f-595b-44eb-aaa5-0b3df41c88c1-config-data\") pod \"memcached-0\" (UID: \"243f6b1f-595b-44eb-aaa5-0b3df41c88c1\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:49:33 crc kubenswrapper[5120]: I0316 16:49:33.301164 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/243f6b1f-595b-44eb-aaa5-0b3df41c88c1-kolla-config\") pod \"memcached-0\" (UID: \"243f6b1f-595b-44eb-aaa5-0b3df41c88c1\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:49:33 crc kubenswrapper[5120]: I0316 16:49:33.303257 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-novncproxy-config-data\"" Mar 16 16:49:33 crc kubenswrapper[5120]: I0316 16:49:33.307638 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/243f6b1f-595b-44eb-aaa5-0b3df41c88c1-memcached-tls-certs\") pod \"memcached-0\" (UID: \"243f6b1f-595b-44eb-aaa5-0b3df41c88c1\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:49:33 crc kubenswrapper[5120]: I0316 16:49:33.314377 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/243f6b1f-595b-44eb-aaa5-0b3df41c88c1-combined-ca-bundle\") pod \"memcached-0\" (UID: \"243f6b1f-595b-44eb-aaa5-0b3df41c88c1\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:49:33 crc kubenswrapper[5120]: I0316 16:49:33.342641 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-njnw4\" (UniqueName: \"kubernetes.io/projected/243f6b1f-595b-44eb-aaa5-0b3df41c88c1-kube-api-access-njnw4\") pod \"memcached-0\" (UID: \"243f6b1f-595b-44eb-aaa5-0b3df41c88c1\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:49:33 crc kubenswrapper[5120]: I0316 16:49:33.350735 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:49:33 crc kubenswrapper[5120]: E0316 16:49:33.386238 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="0133a2cd785424001989a4b5c72950fd6eb0e3bedabf2dd40ea720d83389adb9" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:49:33 crc kubenswrapper[5120]: I0316 16:49:33.434545 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a54c7e34-6cda-4e15-83b3-1ccd2fac7cff-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"a54c7e34-6cda-4e15-83b3-1ccd2fac7cff\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:49:33 crc kubenswrapper[5120]: I0316 16:49:33.435050 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a54c7e34-6cda-4e15-83b3-1ccd2fac7cff-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"a54c7e34-6cda-4e15-83b3-1ccd2fac7cff\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:49:33 crc kubenswrapper[5120]: I0316 16:49:33.435264 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6l8ff\" (UniqueName: \"kubernetes.io/projected/a54c7e34-6cda-4e15-83b3-1ccd2fac7cff-kube-api-access-6l8ff\") pod \"nova-cell1-novncproxy-0\" (UID: \"a54c7e34-6cda-4e15-83b3-1ccd2fac7cff\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:49:33 crc kubenswrapper[5120]: E0316 16:49:33.435537 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="0133a2cd785424001989a4b5c72950fd6eb0e3bedabf2dd40ea720d83389adb9" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:49:33 crc kubenswrapper[5120]: E0316 16:49:33.439548 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="0133a2cd785424001989a4b5c72950fd6eb0e3bedabf2dd40ea720d83389adb9" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:49:33 crc kubenswrapper[5120]: E0316 16:49:33.439631 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="f3277ed1-d61b-491c-b6dc-1964a1422ea9" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 16:49:33 crc kubenswrapper[5120]: I0316 16:49:33.496327 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/03693dff-f5dd-4199-8cb2-e6f12d5a0703-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "03693dff-f5dd-4199-8cb2-e6f12d5a0703" (UID: "03693dff-f5dd-4199-8cb2-e6f12d5a0703"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:49:33 crc kubenswrapper[5120]: I0316 16:49:33.529532 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Mar 16 16:49:33 crc kubenswrapper[5120]: I0316 16:49:33.551340 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a54c7e34-6cda-4e15-83b3-1ccd2fac7cff-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"a54c7e34-6cda-4e15-83b3-1ccd2fac7cff\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:49:33 crc kubenswrapper[5120]: I0316 16:49:33.551530 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6l8ff\" (UniqueName: \"kubernetes.io/projected/a54c7e34-6cda-4e15-83b3-1ccd2fac7cff-kube-api-access-6l8ff\") pod \"nova-cell1-novncproxy-0\" (UID: \"a54c7e34-6cda-4e15-83b3-1ccd2fac7cff\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:49:33 crc kubenswrapper[5120]: I0316 16:49:33.551716 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a54c7e34-6cda-4e15-83b3-1ccd2fac7cff-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"a54c7e34-6cda-4e15-83b3-1ccd2fac7cff\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:49:33 crc kubenswrapper[5120]: I0316 16:49:33.552086 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/03693dff-f5dd-4199-8cb2-e6f12d5a0703-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:33 crc kubenswrapper[5120]: I0316 16:49:33.569543 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a54c7e34-6cda-4e15-83b3-1ccd2fac7cff-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"a54c7e34-6cda-4e15-83b3-1ccd2fac7cff\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:49:33 crc kubenswrapper[5120]: I0316 16:49:33.574522 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a54c7e34-6cda-4e15-83b3-1ccd2fac7cff-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"a54c7e34-6cda-4e15-83b3-1ccd2fac7cff\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:49:33 crc kubenswrapper[5120]: I0316 16:49:33.603985 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/03693dff-f5dd-4199-8cb2-e6f12d5a0703-config-data" (OuterVolumeSpecName: "config-data") pod "03693dff-f5dd-4199-8cb2-e6f12d5a0703" (UID: "03693dff-f5dd-4199-8cb2-e6f12d5a0703"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:49:33 crc kubenswrapper[5120]: I0316 16:49:33.604127 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6l8ff\" (UniqueName: \"kubernetes.io/projected/a54c7e34-6cda-4e15-83b3-1ccd2fac7cff-kube-api-access-6l8ff\") pod \"nova-cell1-novncproxy-0\" (UID: \"a54c7e34-6cda-4e15-83b3-1ccd2fac7cff\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:49:33 crc kubenswrapper[5120]: I0316 16:49:33.658477 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/03693dff-f5dd-4199-8cb2-e6f12d5a0703-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:33 crc kubenswrapper[5120]: I0316 16:49:33.669577 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:49:33 crc kubenswrapper[5120]: I0316 16:49:33.798424 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:49:33 crc kubenswrapper[5120]: I0316 16:49:33.820281 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-dc86d464-4bdds"] Mar 16 16:49:33 crc kubenswrapper[5120]: I0316 16:49:33.866876 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"03693dff-f5dd-4199-8cb2-e6f12d5a0703","Type":"ContainerDied","Data":"4f732e9d57b8287f8c063dd2db2237abf22a9402fef503e6427871e72a34e99c"} Mar 16 16:49:33 crc kubenswrapper[5120]: I0316 16:49:33.866931 5120 scope.go:117] "RemoveContainer" containerID="56bafd5d554c07424b2372cb9d09d48c6c8a503553bf48586be2bda216c559d8" Mar 16 16:49:33 crc kubenswrapper[5120]: I0316 16:49:33.867148 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:49:33 crc kubenswrapper[5120]: I0316 16:49:33.875665 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6433979b-c153-4721-8866-0d9bcd0480bb-config-data\") pod \"6433979b-c153-4721-8866-0d9bcd0480bb\" (UID: \"6433979b-c153-4721-8866-0d9bcd0480bb\") " Mar 16 16:49:33 crc kubenswrapper[5120]: I0316 16:49:33.876055 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6433979b-c153-4721-8866-0d9bcd0480bb-combined-ca-bundle\") pod \"6433979b-c153-4721-8866-0d9bcd0480bb\" (UID: \"6433979b-c153-4721-8866-0d9bcd0480bb\") " Mar 16 16:49:33 crc kubenswrapper[5120]: I0316 16:49:33.876265 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-znlrd\" (UniqueName: \"kubernetes.io/projected/6433979b-c153-4721-8866-0d9bcd0480bb-kube-api-access-znlrd\") pod \"6433979b-c153-4721-8866-0d9bcd0480bb\" (UID: \"6433979b-c153-4721-8866-0d9bcd0480bb\") " Mar 16 16:49:33 crc kubenswrapper[5120]: I0316 16:49:33.877893 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-5c574fdfbb-8rvsq"] Mar 16 16:49:33 crc kubenswrapper[5120]: I0316 16:49:33.884152 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_d6803c98-d09b-4fbe-9fd6-b8b91ac81c77/ovsdbserver-sb/0.log" Mar 16 16:49:33 crc kubenswrapper[5120]: I0316 16:49:33.884225 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:49:33 crc kubenswrapper[5120]: I0316 16:49:33.894447 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6433979b-c153-4721-8866-0d9bcd0480bb-kube-api-access-znlrd" (OuterVolumeSpecName: "kube-api-access-znlrd") pod "6433979b-c153-4721-8866-0d9bcd0480bb" (UID: "6433979b-c153-4721-8866-0d9bcd0480bb"). InnerVolumeSpecName "kube-api-access-znlrd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:49:33 crc kubenswrapper[5120]: I0316 16:49:33.958120 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-7b66994cdb-4jkjq" event={"ID":"011b06d9-6610-4fc7-97ab-697050a06ec4","Type":"ContainerStarted","Data":"92c36406d876860c08867e44be63e833b6198fb1f978bc1800b6ac3eef6ae838"} Mar 16 16:49:33 crc kubenswrapper[5120]: I0316 16:49:33.958335 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-7b66994cdb-4jkjq" podUID="011b06d9-6610-4fc7-97ab-697050a06ec4" containerName="neutron-api" containerID="cri-o://72cf42ee5a1dd1662d5e629838f7321e79ca35c759f851acd86e0dcb0d0733a1" gracePeriod=30 Mar 16 16:49:33 crc kubenswrapper[5120]: I0316 16:49:33.958400 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/neutron-7b66994cdb-4jkjq" Mar 16 16:49:33 crc kubenswrapper[5120]: I0316 16:49:33.958457 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-7b66994cdb-4jkjq" podUID="011b06d9-6610-4fc7-97ab-697050a06ec4" containerName="neutron-httpd" containerID="cri-o://92c36406d876860c08867e44be63e833b6198fb1f978bc1800b6ac3eef6ae838" gracePeriod=30 Mar 16 16:49:33 crc kubenswrapper[5120]: I0316 16:49:33.980348 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6433979b-c153-4721-8866-0d9bcd0480bb-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "6433979b-c153-4721-8866-0d9bcd0480bb" (UID: "6433979b-c153-4721-8866-0d9bcd0480bb"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:49:33 crc kubenswrapper[5120]: I0316 16:49:33.983049 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nbrpd\" (UniqueName: \"kubernetes.io/projected/d6803c98-d09b-4fbe-9fd6-b8b91ac81c77-kube-api-access-nbrpd\") pod \"d6803c98-d09b-4fbe-9fd6-b8b91ac81c77\" (UID: \"d6803c98-d09b-4fbe-9fd6-b8b91ac81c77\") " Mar 16 16:49:33 crc kubenswrapper[5120]: I0316 16:49:33.983313 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovndbcluster-sb-etc-ovn\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"d6803c98-d09b-4fbe-9fd6-b8b91ac81c77\" (UID: \"d6803c98-d09b-4fbe-9fd6-b8b91ac81c77\") " Mar 16 16:49:33 crc kubenswrapper[5120]: I0316 16:49:33.984247 5120 scope.go:117] "RemoveContainer" containerID="f12dd69527499a1398e4a608adaef103b3aa7f300de680b04045d0b9a14eedc2" Mar 16 16:49:33 crc kubenswrapper[5120]: I0316 16:49:33.986088 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d6803c98-d09b-4fbe-9fd6-b8b91ac81c77-config\") pod \"d6803c98-d09b-4fbe-9fd6-b8b91ac81c77\" (UID: \"d6803c98-d09b-4fbe-9fd6-b8b91ac81c77\") " Mar 16 16:49:33 crc kubenswrapper[5120]: I0316 16:49:33.986275 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/d6803c98-d09b-4fbe-9fd6-b8b91ac81c77-ovsdb-rundir\") pod \"d6803c98-d09b-4fbe-9fd6-b8b91ac81c77\" (UID: \"d6803c98-d09b-4fbe-9fd6-b8b91ac81c77\") " Mar 16 16:49:33 crc kubenswrapper[5120]: I0316 16:49:33.986328 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d6803c98-d09b-4fbe-9fd6-b8b91ac81c77-combined-ca-bundle\") pod \"d6803c98-d09b-4fbe-9fd6-b8b91ac81c77\" (UID: \"d6803c98-d09b-4fbe-9fd6-b8b91ac81c77\") " Mar 16 16:49:33 crc kubenswrapper[5120]: I0316 16:49:33.986379 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/d6803c98-d09b-4fbe-9fd6-b8b91ac81c77-scripts\") pod \"d6803c98-d09b-4fbe-9fd6-b8b91ac81c77\" (UID: \"d6803c98-d09b-4fbe-9fd6-b8b91ac81c77\") " Mar 16 16:49:33 crc kubenswrapper[5120]: I0316 16:49:33.987071 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6433979b-c153-4721-8866-0d9bcd0480bb-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:33 crc kubenswrapper[5120]: I0316 16:49:33.987088 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-znlrd\" (UniqueName: \"kubernetes.io/projected/6433979b-c153-4721-8866-0d9bcd0480bb-kube-api-access-znlrd\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:34 crc kubenswrapper[5120]: I0316 16:49:33.995080 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6803c98-d09b-4fbe-9fd6-b8b91ac81c77-config" (OuterVolumeSpecName: "config") pod "d6803c98-d09b-4fbe-9fd6-b8b91ac81c77" (UID: "d6803c98-d09b-4fbe-9fd6-b8b91ac81c77"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:49:34 crc kubenswrapper[5120]: I0316 16:49:33.996121 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6803c98-d09b-4fbe-9fd6-b8b91ac81c77-ovsdb-rundir" (OuterVolumeSpecName: "ovsdb-rundir") pod "d6803c98-d09b-4fbe-9fd6-b8b91ac81c77" (UID: "d6803c98-d09b-4fbe-9fd6-b8b91ac81c77"). InnerVolumeSpecName "ovsdb-rundir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:49:34 crc kubenswrapper[5120]: I0316 16:49:33.996362 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6803c98-d09b-4fbe-9fd6-b8b91ac81c77-scripts" (OuterVolumeSpecName: "scripts") pod "d6803c98-d09b-4fbe-9fd6-b8b91ac81c77" (UID: "d6803c98-d09b-4fbe-9fd6-b8b91ac81c77"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:49:34 crc kubenswrapper[5120]: I0316 16:49:34.018990 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6803c98-d09b-4fbe-9fd6-b8b91ac81c77-kube-api-access-nbrpd" (OuterVolumeSpecName: "kube-api-access-nbrpd") pod "d6803c98-d09b-4fbe-9fd6-b8b91ac81c77" (UID: "d6803c98-d09b-4fbe-9fd6-b8b91ac81c77"). InnerVolumeSpecName "kube-api-access-nbrpd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:49:34 crc kubenswrapper[5120]: I0316 16:49:34.025623 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-7766ff8bd9-h465l" event={"ID":"bcef263e-93a6-4f2b-9447-230cf3444ebb","Type":"ContainerStarted","Data":"67d7f767275baf4f8697f11b59c239c085138a655b3e68580095be420c283f25"} Mar 16 16:49:34 crc kubenswrapper[5120]: I0316 16:49:34.025865 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-7766ff8bd9-h465l" podUID="bcef263e-93a6-4f2b-9447-230cf3444ebb" containerName="barbican-worker-log" containerID="cri-o://fd8d08106194a056ec614acba84c7771bd985e90cbff88f7465efdc32db63dbb" gracePeriod=30 Mar 16 16:49:34 crc kubenswrapper[5120]: I0316 16:49:34.026031 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-7766ff8bd9-h465l" podUID="bcef263e-93a6-4f2b-9447-230cf3444ebb" containerName="barbican-worker" containerID="cri-o://67d7f767275baf4f8697f11b59c239c085138a655b3e68580095be420c283f25" gracePeriod=30 Mar 16 16:49:34 crc kubenswrapper[5120]: I0316 16:49:34.051584 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage06-crc" (OuterVolumeSpecName: "ovndbcluster-sb-etc-ovn") pod "d6803c98-d09b-4fbe-9fd6-b8b91ac81c77" (UID: "d6803c98-d09b-4fbe-9fd6-b8b91ac81c77"). InnerVolumeSpecName "local-storage06-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:49:34 crc kubenswrapper[5120]: I0316 16:49:34.068910 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_d6803c98-d09b-4fbe-9fd6-b8b91ac81c77/ovsdbserver-sb/0.log" Mar 16 16:49:34 crc kubenswrapper[5120]: I0316 16:49:34.069151 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"d6803c98-d09b-4fbe-9fd6-b8b91ac81c77","Type":"ContainerDied","Data":"14e2177cfb5814ed4f0442e9a44b345c2cc01352225c1d8fa18b46f8a8f33ff7"} Mar 16 16:49:34 crc kubenswrapper[5120]: I0316 16:49:34.069160 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:49:34 crc kubenswrapper[5120]: I0316 16:49:34.077918 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-747966fd58-rqj7f" event={"ID":"b530ed0b-581b-40f8-b872-1f920e152d92","Type":"ContainerStarted","Data":"a96a0a1cebbfc0e08bfd7e404ebb107b0a0392a1007e54716f743992433ae538"} Mar 16 16:49:34 crc kubenswrapper[5120]: I0316 16:49:34.078046 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/keystone-747966fd58-rqj7f" podUID="b530ed0b-581b-40f8-b872-1f920e152d92" containerName="keystone-api" containerID="cri-o://a96a0a1cebbfc0e08bfd7e404ebb107b0a0392a1007e54716f743992433ae538" gracePeriod=30 Mar 16 16:49:34 crc kubenswrapper[5120]: I0316 16:49:34.078115 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/keystone-747966fd58-rqj7f" Mar 16 16:49:34 crc kubenswrapper[5120]: W0316 16:49:34.087389 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod370e78a7_6b53_4f13_aa62_8afa448a0b7d.slice/crio-2921e0957349541b86198a536e2b759114dbb4ac32753e84237e1bbbd29f1f4a WatchSource:0}: Error finding container 2921e0957349541b86198a536e2b759114dbb4ac32753e84237e1bbbd29f1f4a: Status 404 returned error can't find the container with id 2921e0957349541b86198a536e2b759114dbb4ac32753e84237e1bbbd29f1f4a Mar 16 16:49:34 crc kubenswrapper[5120]: I0316 16:49:34.097900 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-86d6cb7f98-5w9h4" event={"ID":"5b516ced-8076-4f11-8398-77eaca65d050","Type":"ContainerStarted","Data":"130578ec08e3530ef1b82a4fd9b1a63bb6ef4eebe8c92ece6756d519d188e39a"} Mar 16 16:49:34 crc kubenswrapper[5120]: I0316 16:49:34.108159 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-b95f7696b-gs4k6"] Mar 16 16:49:34 crc kubenswrapper[5120]: I0316 16:49:34.108198 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-f5b8b4576-z8chc" event={"ID":"ac5817ce-1c59-4375-9fb6-f2fcd39bdba2","Type":"ContainerStarted","Data":"be40308576e89148c93edcdbd11c87815b9099d6b09aac2462c959ad6c8219c5"} Mar 16 16:49:34 crc kubenswrapper[5120]: I0316 16:49:34.110562 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nbrpd\" (UniqueName: \"kubernetes.io/projected/d6803c98-d09b-4fbe-9fd6-b8b91ac81c77-kube-api-access-nbrpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:34 crc kubenswrapper[5120]: I0316 16:49:34.110648 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") on node \"crc\" " Mar 16 16:49:34 crc kubenswrapper[5120]: I0316 16:49:34.113680 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d6803c98-d09b-4fbe-9fd6-b8b91ac81c77-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:34 crc kubenswrapper[5120]: I0316 16:49:34.113734 5120 reconciler_common.go:299] "Volume detached for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/d6803c98-d09b-4fbe-9fd6-b8b91ac81c77-ovsdb-rundir\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:34 crc kubenswrapper[5120]: I0316 16:49:34.113749 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/d6803c98-d09b-4fbe-9fd6-b8b91ac81c77-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:34 crc kubenswrapper[5120]: I0316 16:49:34.114206 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"6433979b-c153-4721-8866-0d9bcd0480bb","Type":"ContainerDied","Data":"d3beee3372ca73605fce2f005f2d7157f670d8d40a35fd6b1fee04fb58657029"} Mar 16 16:49:34 crc kubenswrapper[5120]: I0316 16:49:34.114245 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:49:34 crc kubenswrapper[5120]: I0316 16:49:34.134138 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-5dc7897bc-w6pc6" event={"ID":"9ad6c5f4-1902-463a-8a6f-6beade89b6a1","Type":"ContainerStarted","Data":"5fa0203e88f871ddd2ecef9d8dfe845cb0e16600196a7b9cbc2d21f7e6ec7ba5"} Mar 16 16:49:34 crc kubenswrapper[5120]: I0316 16:49:34.136438 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-6sq2s" event={"ID":"199c0d37-3938-4dff-bc4c-b94e06321673","Type":"ContainerStarted","Data":"a97f96ac1cd87cba0b55ec8ed7b5a54af5f9292e24a69dab7c862eddcfb9017d"} Mar 16 16:49:34 crc kubenswrapper[5120]: I0316 16:49:34.136491 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-6sq2s" event={"ID":"199c0d37-3938-4dff-bc4c-b94e06321673","Type":"ContainerStarted","Data":"eccffae6e15c85c83010aafbb29e2cba09749a84de6f064deb9773433e32d46e"} Mar 16 16:49:34 crc kubenswrapper[5120]: I0316 16:49:34.145944 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6433979b-c153-4721-8866-0d9bcd0480bb-config-data" (OuterVolumeSpecName: "config-data") pod "6433979b-c153-4721-8866-0d9bcd0480bb" (UID: "6433979b-c153-4721-8866-0d9bcd0480bb"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:49:34 crc kubenswrapper[5120]: I0316 16:49:34.147587 5120 generic.go:358] "Generic (PLEG): container finished" podID="5988349f-8dba-4fde-acf3-6d8acf01117f" containerID="337f914f7d65a7cc1d629598ef727728aeeeb98f0d532479dda2dac058d447f5" exitCode=0 Mar 16 16:49:34 crc kubenswrapper[5120]: I0316 16:49:34.147652 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"5988349f-8dba-4fde-acf3-6d8acf01117f","Type":"ContainerDied","Data":"337f914f7d65a7cc1d629598ef727728aeeeb98f0d532479dda2dac058d447f5"} Mar 16 16:49:34 crc kubenswrapper[5120]: I0316 16:49:34.164226 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:49:34 crc kubenswrapper[5120]: I0316 16:49:34.172010 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:49:34 crc kubenswrapper[5120]: I0316 16:49:34.184021 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:49:34 crc kubenswrapper[5120]: I0316 16:49:34.185350 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6803c98-d09b-4fbe-9fd6-b8b91ac81c77" containerName="openstack-network-exporter" Mar 16 16:49:34 crc kubenswrapper[5120]: I0316 16:49:34.185372 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6803c98-d09b-4fbe-9fd6-b8b91ac81c77" containerName="openstack-network-exporter" Mar 16 16:49:34 crc kubenswrapper[5120]: I0316 16:49:34.185407 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6433979b-c153-4721-8866-0d9bcd0480bb" containerName="nova-scheduler-scheduler" Mar 16 16:49:34 crc kubenswrapper[5120]: I0316 16:49:34.185414 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="6433979b-c153-4721-8866-0d9bcd0480bb" containerName="nova-scheduler-scheduler" Mar 16 16:49:34 crc kubenswrapper[5120]: I0316 16:49:34.185450 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6803c98-d09b-4fbe-9fd6-b8b91ac81c77" containerName="ovsdbserver-sb" Mar 16 16:49:34 crc kubenswrapper[5120]: I0316 16:49:34.185456 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6803c98-d09b-4fbe-9fd6-b8b91ac81c77" containerName="ovsdbserver-sb" Mar 16 16:49:34 crc kubenswrapper[5120]: I0316 16:49:34.185694 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="6433979b-c153-4721-8866-0d9bcd0480bb" containerName="nova-scheduler-scheduler" Mar 16 16:49:34 crc kubenswrapper[5120]: I0316 16:49:34.185723 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="d6803c98-d09b-4fbe-9fd6-b8b91ac81c77" containerName="openstack-network-exporter" Mar 16 16:49:34 crc kubenswrapper[5120]: I0316 16:49:34.185734 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="d6803c98-d09b-4fbe-9fd6-b8b91ac81c77" containerName="ovsdbserver-sb" Mar 16 16:49:34 crc kubenswrapper[5120]: I0316 16:49:34.193055 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:49:34 crc kubenswrapper[5120]: I0316 16:49:34.202172 5120 scope.go:117] "RemoveContainer" containerID="f2a9e2812d2124684265fddf41aa8bbd158c31d431c3c4f1f41c3d41428a1d03" Mar 16 16:49:34 crc kubenswrapper[5120]: I0316 16:49:34.202614 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-scheduler-config-data\"" Mar 16 16:49:34 crc kubenswrapper[5120]: I0316 16:49:34.211376 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:49:34 crc kubenswrapper[5120]: I0316 16:49:34.219340 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-7b66994cdb-4jkjq" podStartSLOduration=6.219317758 podStartE2EDuration="6.219317758s" podCreationTimestamp="2026-03-16 16:49:28 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:49:34.087125982 +0000 UTC m=+4676.241057659" watchObservedRunningTime="2026-03-16 16:49:34.219317758 +0000 UTC m=+4676.373249425" Mar 16 16:49:34 crc kubenswrapper[5120]: I0316 16:49:34.219431 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6433979b-c153-4721-8866-0d9bcd0480bb-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:34 crc kubenswrapper[5120]: I0316 16:49:34.241010 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-worker-7766ff8bd9-h465l" podStartSLOduration=7.240977693 podStartE2EDuration="7.240977693s" podCreationTimestamp="2026-03-16 16:49:27 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:49:34.1322455 +0000 UTC m=+4676.286177157" watchObservedRunningTime="2026-03-16 16:49:34.240977693 +0000 UTC m=+4676.394909360" Mar 16 16:49:34 crc kubenswrapper[5120]: I0316 16:49:34.276426 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-747966fd58-rqj7f" podStartSLOduration=6.276390334 podStartE2EDuration="6.276390334s" podCreationTimestamp="2026-03-16 16:49:28 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:49:34.20878797 +0000 UTC m=+4676.362719627" watchObservedRunningTime="2026-03-16 16:49:34.276390334 +0000 UTC m=+4676.430322001" Mar 16 16:49:34 crc kubenswrapper[5120]: I0316 16:49:34.310665 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-6sq2s" podStartSLOduration=6.310647115 podStartE2EDuration="6.310647115s" podCreationTimestamp="2026-03-16 16:49:28 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:49:34.258498713 +0000 UTC m=+4676.412430380" watchObservedRunningTime="2026-03-16 16:49:34.310647115 +0000 UTC m=+4676.464578772" Mar 16 16:49:34 crc kubenswrapper[5120]: I0316 16:49:34.327097 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage06-crc" (UniqueName: "kubernetes.io/local-volume/local-storage06-crc") on node "crc" Mar 16 16:49:34 crc kubenswrapper[5120]: I0316 16:49:34.332608 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5f1fe655-07dd-4959-98ac-372e797369fa-config-data\") pod \"cinder-scheduler-0\" (UID: \"5f1fe655-07dd-4959-98ac-372e797369fa\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:49:34 crc kubenswrapper[5120]: I0316 16:49:34.332673 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/5f1fe655-07dd-4959-98ac-372e797369fa-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"5f1fe655-07dd-4959-98ac-372e797369fa\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:49:34 crc kubenswrapper[5120]: I0316 16:49:34.332839 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5f1fe655-07dd-4959-98ac-372e797369fa-scripts\") pod \"cinder-scheduler-0\" (UID: \"5f1fe655-07dd-4959-98ac-372e797369fa\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:49:34 crc kubenswrapper[5120]: I0316 16:49:34.333011 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5f1fe655-07dd-4959-98ac-372e797369fa-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"5f1fe655-07dd-4959-98ac-372e797369fa\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:49:34 crc kubenswrapper[5120]: I0316 16:49:34.333087 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/5f1fe655-07dd-4959-98ac-372e797369fa-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"5f1fe655-07dd-4959-98ac-372e797369fa\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:49:34 crc kubenswrapper[5120]: I0316 16:49:34.333225 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-df9bf\" (UniqueName: \"kubernetes.io/projected/5f1fe655-07dd-4959-98ac-372e797369fa-kube-api-access-df9bf\") pod \"cinder-scheduler-0\" (UID: \"5f1fe655-07dd-4959-98ac-372e797369fa\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:49:34 crc kubenswrapper[5120]: I0316 16:49:34.333349 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:34 crc kubenswrapper[5120]: I0316 16:49:34.341154 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6803c98-d09b-4fbe-9fd6-b8b91ac81c77-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "d6803c98-d09b-4fbe-9fd6-b8b91ac81c77" (UID: "d6803c98-d09b-4fbe-9fd6-b8b91ac81c77"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:49:34 crc kubenswrapper[5120]: I0316 16:49:34.437512 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5f1fe655-07dd-4959-98ac-372e797369fa-scripts\") pod \"cinder-scheduler-0\" (UID: \"5f1fe655-07dd-4959-98ac-372e797369fa\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:49:34 crc kubenswrapper[5120]: I0316 16:49:34.437641 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5f1fe655-07dd-4959-98ac-372e797369fa-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"5f1fe655-07dd-4959-98ac-372e797369fa\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:49:34 crc kubenswrapper[5120]: I0316 16:49:34.437688 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/5f1fe655-07dd-4959-98ac-372e797369fa-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"5f1fe655-07dd-4959-98ac-372e797369fa\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:49:34 crc kubenswrapper[5120]: I0316 16:49:34.437779 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-df9bf\" (UniqueName: \"kubernetes.io/projected/5f1fe655-07dd-4959-98ac-372e797369fa-kube-api-access-df9bf\") pod \"cinder-scheduler-0\" (UID: \"5f1fe655-07dd-4959-98ac-372e797369fa\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:49:34 crc kubenswrapper[5120]: I0316 16:49:34.437897 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5f1fe655-07dd-4959-98ac-372e797369fa-config-data\") pod \"cinder-scheduler-0\" (UID: \"5f1fe655-07dd-4959-98ac-372e797369fa\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:49:34 crc kubenswrapper[5120]: I0316 16:49:34.437919 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/5f1fe655-07dd-4959-98ac-372e797369fa-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"5f1fe655-07dd-4959-98ac-372e797369fa\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:49:34 crc kubenswrapper[5120]: I0316 16:49:34.438048 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d6803c98-d09b-4fbe-9fd6-b8b91ac81c77-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:34 crc kubenswrapper[5120]: I0316 16:49:34.438097 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/5f1fe655-07dd-4959-98ac-372e797369fa-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"5f1fe655-07dd-4959-98ac-372e797369fa\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:49:34 crc kubenswrapper[5120]: I0316 16:49:34.448451 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5f1fe655-07dd-4959-98ac-372e797369fa-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"5f1fe655-07dd-4959-98ac-372e797369fa\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:49:34 crc kubenswrapper[5120]: I0316 16:49:34.449964 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5f1fe655-07dd-4959-98ac-372e797369fa-config-data\") pod \"cinder-scheduler-0\" (UID: \"5f1fe655-07dd-4959-98ac-372e797369fa\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:49:34 crc kubenswrapper[5120]: I0316 16:49:34.468779 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/5f1fe655-07dd-4959-98ac-372e797369fa-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"5f1fe655-07dd-4959-98ac-372e797369fa\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:49:34 crc kubenswrapper[5120]: I0316 16:49:34.481433 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-df9bf\" (UniqueName: \"kubernetes.io/projected/5f1fe655-07dd-4959-98ac-372e797369fa-kube-api-access-df9bf\") pod \"cinder-scheduler-0\" (UID: \"5f1fe655-07dd-4959-98ac-372e797369fa\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:49:34 crc kubenswrapper[5120]: I0316 16:49:34.497493 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5f1fe655-07dd-4959-98ac-372e797369fa-scripts\") pod \"cinder-scheduler-0\" (UID: \"5f1fe655-07dd-4959-98ac-372e797369fa\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:49:34 crc kubenswrapper[5120]: I0316 16:49:34.613424 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:49:34 crc kubenswrapper[5120]: I0316 16:49:34.668174 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:49:34 crc kubenswrapper[5120]: I0316 16:49:34.700603 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="02bf1e48-defb-443a-98b5-9eed2dc9947c" path="/var/lib/kubelet/pods/02bf1e48-defb-443a-98b5-9eed2dc9947c/volumes" Mar 16 16:49:34 crc kubenswrapper[5120]: I0316 16:49:34.701986 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="03693dff-f5dd-4199-8cb2-e6f12d5a0703" path="/var/lib/kubelet/pods/03693dff-f5dd-4199-8cb2-e6f12d5a0703/volumes" Mar 16 16:49:34 crc kubenswrapper[5120]: I0316 16:49:34.703004 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="babd9a47-eaa5-4b06-a2d3-16732a4b2dc7" path="/var/lib/kubelet/pods/babd9a47-eaa5-4b06-a2d3-16732a4b2dc7/volumes" Mar 16 16:49:34 crc kubenswrapper[5120]: I0316 16:49:34.746424 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qc4gm\" (UniqueName: \"kubernetes.io/projected/5988349f-8dba-4fde-acf3-6d8acf01117f-kube-api-access-qc4gm\") pod \"5988349f-8dba-4fde-acf3-6d8acf01117f\" (UID: \"5988349f-8dba-4fde-acf3-6d8acf01117f\") " Mar 16 16:49:34 crc kubenswrapper[5120]: I0316 16:49:34.746664 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5988349f-8dba-4fde-acf3-6d8acf01117f-logs\") pod \"5988349f-8dba-4fde-acf3-6d8acf01117f\" (UID: \"5988349f-8dba-4fde-acf3-6d8acf01117f\") " Mar 16 16:49:34 crc kubenswrapper[5120]: I0316 16:49:34.746800 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5988349f-8dba-4fde-acf3-6d8acf01117f-combined-ca-bundle\") pod \"5988349f-8dba-4fde-acf3-6d8acf01117f\" (UID: \"5988349f-8dba-4fde-acf3-6d8acf01117f\") " Mar 16 16:49:34 crc kubenswrapper[5120]: I0316 16:49:34.746826 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/5988349f-8dba-4fde-acf3-6d8acf01117f-etc-machine-id\") pod \"5988349f-8dba-4fde-acf3-6d8acf01117f\" (UID: \"5988349f-8dba-4fde-acf3-6d8acf01117f\") " Mar 16 16:49:34 crc kubenswrapper[5120]: I0316 16:49:34.747147 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5988349f-8dba-4fde-acf3-6d8acf01117f-scripts\") pod \"5988349f-8dba-4fde-acf3-6d8acf01117f\" (UID: \"5988349f-8dba-4fde-acf3-6d8acf01117f\") " Mar 16 16:49:34 crc kubenswrapper[5120]: I0316 16:49:34.747195 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5988349f-8dba-4fde-acf3-6d8acf01117f-config-data\") pod \"5988349f-8dba-4fde-acf3-6d8acf01117f\" (UID: \"5988349f-8dba-4fde-acf3-6d8acf01117f\") " Mar 16 16:49:34 crc kubenswrapper[5120]: I0316 16:49:34.747366 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/5988349f-8dba-4fde-acf3-6d8acf01117f-config-data-custom\") pod \"5988349f-8dba-4fde-acf3-6d8acf01117f\" (UID: \"5988349f-8dba-4fde-acf3-6d8acf01117f\") " Mar 16 16:49:34 crc kubenswrapper[5120]: I0316 16:49:34.747575 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5988349f-8dba-4fde-acf3-6d8acf01117f-logs" (OuterVolumeSpecName: "logs") pod "5988349f-8dba-4fde-acf3-6d8acf01117f" (UID: "5988349f-8dba-4fde-acf3-6d8acf01117f"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:49:34 crc kubenswrapper[5120]: I0316 16:49:34.749140 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5988349f-8dba-4fde-acf3-6d8acf01117f-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:34 crc kubenswrapper[5120]: I0316 16:49:34.759357 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/5988349f-8dba-4fde-acf3-6d8acf01117f-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "5988349f-8dba-4fde-acf3-6d8acf01117f" (UID: "5988349f-8dba-4fde-acf3-6d8acf01117f"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 16:49:34 crc kubenswrapper[5120]: I0316 16:49:34.785053 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5988349f-8dba-4fde-acf3-6d8acf01117f-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "5988349f-8dba-4fde-acf3-6d8acf01117f" (UID: "5988349f-8dba-4fde-acf3-6d8acf01117f"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:49:34 crc kubenswrapper[5120]: I0316 16:49:34.790103 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5988349f-8dba-4fde-acf3-6d8acf01117f-scripts" (OuterVolumeSpecName: "scripts") pod "5988349f-8dba-4fde-acf3-6d8acf01117f" (UID: "5988349f-8dba-4fde-acf3-6d8acf01117f"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:49:34 crc kubenswrapper[5120]: I0316 16:49:34.790293 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5988349f-8dba-4fde-acf3-6d8acf01117f-kube-api-access-qc4gm" (OuterVolumeSpecName: "kube-api-access-qc4gm") pod "5988349f-8dba-4fde-acf3-6d8acf01117f" (UID: "5988349f-8dba-4fde-acf3-6d8acf01117f"). InnerVolumeSpecName "kube-api-access-qc4gm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:49:34 crc kubenswrapper[5120]: I0316 16:49:34.844458 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5988349f-8dba-4fde-acf3-6d8acf01117f-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "5988349f-8dba-4fde-acf3-6d8acf01117f" (UID: "5988349f-8dba-4fde-acf3-6d8acf01117f"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:49:34 crc kubenswrapper[5120]: I0316 16:49:34.851742 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5988349f-8dba-4fde-acf3-6d8acf01117f-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:34 crc kubenswrapper[5120]: I0316 16:49:34.851956 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/5988349f-8dba-4fde-acf3-6d8acf01117f-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:34 crc kubenswrapper[5120]: I0316 16:49:34.851969 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qc4gm\" (UniqueName: \"kubernetes.io/projected/5988349f-8dba-4fde-acf3-6d8acf01117f-kube-api-access-qc4gm\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:34 crc kubenswrapper[5120]: I0316 16:49:34.851987 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5988349f-8dba-4fde-acf3-6d8acf01117f-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:34 crc kubenswrapper[5120]: I0316 16:49:34.851996 5120 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/5988349f-8dba-4fde-acf3-6d8acf01117f-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:34 crc kubenswrapper[5120]: I0316 16:49:34.899546 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5988349f-8dba-4fde-acf3-6d8acf01117f-config-data" (OuterVolumeSpecName: "config-data") pod "5988349f-8dba-4fde-acf3-6d8acf01117f" (UID: "5988349f-8dba-4fde-acf3-6d8acf01117f"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:49:34 crc kubenswrapper[5120]: I0316 16:49:34.920968 5120 scope.go:117] "RemoveContainer" containerID="9e4c6ac619f9d44e6512347976721eb7f2ded5db301b59c7afe2d9148feca5f9" Mar 16 16:49:35 crc kubenswrapper[5120]: I0316 16:49:35.019504 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5988349f-8dba-4fde-acf3-6d8acf01117f-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:35 crc kubenswrapper[5120]: I0316 16:49:35.231025 5120 generic.go:358] "Generic (PLEG): container finished" podID="a7864faa-1e6e-4644-a5f5-f51e429e1e2b" containerID="8e0902e36245c8105626461234c99769028f119d7a8f9080029df1ebb3dcb8df" exitCode=0 Mar 16 16:49:35 crc kubenswrapper[5120]: I0316 16:49:35.244931 5120 generic.go:358] "Generic (PLEG): container finished" podID="016dd61b-9c8d-4a62-a30f-5893f3aa41d7" containerID="ae3296fd136f37d44efdbffedb932b3d7fc4bb15548e013e662c90d6198d2a1b" exitCode=0 Mar 16 16:49:35 crc kubenswrapper[5120]: I0316 16:49:35.259608 5120 generic.go:358] "Generic (PLEG): container finished" podID="b9ac41f6-42c9-4d95-b38c-287da24a2adf" containerID="2def4dceb4ba620f3875201d8253e69fd705949b2567eee3de227d80401cf93b" exitCode=0 Mar 16 16:49:35 crc kubenswrapper[5120]: I0316 16:49:35.262258 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:49:35 crc kubenswrapper[5120]: I0316 16:49:35.303514 5120 generic.go:358] "Generic (PLEG): container finished" podID="011b06d9-6610-4fc7-97ab-697050a06ec4" containerID="92c36406d876860c08867e44be63e833b6198fb1f978bc1800b6ac3eef6ae838" exitCode=0 Mar 16 16:49:35 crc kubenswrapper[5120]: I0316 16:49:35.305644 5120 generic.go:358] "Generic (PLEG): container finished" podID="bcef263e-93a6-4f2b-9447-230cf3444ebb" containerID="fd8d08106194a056ec614acba84c7771bd985e90cbff88f7465efdc32db63dbb" exitCode=143 Mar 16 16:49:35 crc kubenswrapper[5120]: I0316 16:49:35.307540 5120 generic.go:358] "Generic (PLEG): container finished" podID="00cf7a69-dcf7-45dd-9291-3e4d75ece0da" containerID="62b12f4f75e2aae38db45282d142c8c9e3c9bde4fe29592bc1d89f41c324da4f" exitCode=0 Mar 16 16:49:35 crc kubenswrapper[5120]: I0316 16:49:35.311589 5120 generic.go:358] "Generic (PLEG): container finished" podID="b530ed0b-581b-40f8-b872-1f920e152d92" containerID="a96a0a1cebbfc0e08bfd7e404ebb107b0a0392a1007e54716f743992433ae538" exitCode=0 Mar 16 16:49:35 crc kubenswrapper[5120]: E0316 16:49:35.916825 5120 kubelet.go:2642] "Housekeeping took longer than expected" err="housekeeping took too long" expected="1s" actual="1.253s" Mar 16 16:49:35 crc kubenswrapper[5120]: I0316 16:49:35.917205 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-dc86d464-4bdds" event={"ID":"493b4ab5-5510-42b3-aec8-e25ba084e342","Type":"ContainerStarted","Data":"ba4d946584db14e7cc1c5b86c76d0497dfd52f3b28dd830c7c309dd1d412936a"} Mar 16 16:49:35 crc kubenswrapper[5120]: I0316 16:49:35.917226 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:49:35 crc kubenswrapper[5120]: I0316 16:49:35.917239 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"a7864faa-1e6e-4644-a5f5-f51e429e1e2b","Type":"ContainerDied","Data":"8e0902e36245c8105626461234c99769028f119d7a8f9080029df1ebb3dcb8df"} Mar 16 16:49:35 crc kubenswrapper[5120]: I0316 16:49:35.917257 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:49:35 crc kubenswrapper[5120]: I0316 16:49:35.917274 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:49:35 crc kubenswrapper[5120]: I0316 16:49:35.920742 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5988349f-8dba-4fde-acf3-6d8acf01117f" containerName="cinder-api" Mar 16 16:49:35 crc kubenswrapper[5120]: I0316 16:49:35.920794 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="5988349f-8dba-4fde-acf3-6d8acf01117f" containerName="cinder-api" Mar 16 16:49:35 crc kubenswrapper[5120]: I0316 16:49:35.920818 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5988349f-8dba-4fde-acf3-6d8acf01117f" containerName="cinder-api-log" Mar 16 16:49:35 crc kubenswrapper[5120]: I0316 16:49:35.920824 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="5988349f-8dba-4fde-acf3-6d8acf01117f" containerName="cinder-api-log" Mar 16 16:49:35 crc kubenswrapper[5120]: I0316 16:49:35.921147 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="5988349f-8dba-4fde-acf3-6d8acf01117f" containerName="cinder-api" Mar 16 16:49:35 crc kubenswrapper[5120]: I0316 16:49:35.921168 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="5988349f-8dba-4fde-acf3-6d8acf01117f" containerName="cinder-api-log" Mar 16 16:49:35 crc kubenswrapper[5120]: I0316 16:49:35.926285 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"016dd61b-9c8d-4a62-a30f-5893f3aa41d7","Type":"ContainerDied","Data":"ae3296fd136f37d44efdbffedb932b3d7fc4bb15548e013e662c90d6198d2a1b"} Mar 16 16:49:35 crc kubenswrapper[5120]: I0316 16:49:35.926331 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 16:49:35 crc kubenswrapper[5120]: I0316 16:49:35.926391 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"b9ac41f6-42c9-4d95-b38c-287da24a2adf","Type":"ContainerDied","Data":"2def4dceb4ba620f3875201d8253e69fd705949b2567eee3de227d80401cf93b"} Mar 16 16:49:35 crc kubenswrapper[5120]: I0316 16:49:35.926414 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 16:49:35 crc kubenswrapper[5120]: I0316 16:49:35.926461 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"5988349f-8dba-4fde-acf3-6d8acf01117f","Type":"ContainerDied","Data":"b98174217ef5451e25236a261499c70e2f814da3b66d0e251af6b80df389ae6c"} Mar 16 16:49:35 crc kubenswrapper[5120]: I0316 16:49:35.926486 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:49:35 crc kubenswrapper[5120]: I0316 16:49:35.926504 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-7b66994cdb-4jkjq" event={"ID":"011b06d9-6610-4fc7-97ab-697050a06ec4","Type":"ContainerDied","Data":"92c36406d876860c08867e44be63e833b6198fb1f978bc1800b6ac3eef6ae838"} Mar 16 16:49:35 crc kubenswrapper[5120]: I0316 16:49:35.926548 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-7766ff8bd9-h465l" event={"ID":"bcef263e-93a6-4f2b-9447-230cf3444ebb","Type":"ContainerDied","Data":"fd8d08106194a056ec614acba84c7771bd985e90cbff88f7465efdc32db63dbb"} Mar 16 16:49:35 crc kubenswrapper[5120]: I0316 16:49:35.926566 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"00cf7a69-dcf7-45dd-9291-3e4d75ece0da","Type":"ContainerDied","Data":"62b12f4f75e2aae38db45282d142c8c9e3c9bde4fe29592bc1d89f41c324da4f"} Mar 16 16:49:35 crc kubenswrapper[5120]: I0316 16:49:35.926704 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:49:35 crc kubenswrapper[5120]: I0316 16:49:35.926940 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-b95f7696b-gs4k6" event={"ID":"370e78a7-6b53-4f13-aa62-8afa448a0b7d","Type":"ContainerStarted","Data":"2921e0957349541b86198a536e2b759114dbb4ac32753e84237e1bbbd29f1f4a"} Mar 16 16:49:35 crc kubenswrapper[5120]: I0316 16:49:35.926960 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-747966fd58-rqj7f" event={"ID":"b530ed0b-581b-40f8-b872-1f920e152d92","Type":"ContainerDied","Data":"a96a0a1cebbfc0e08bfd7e404ebb107b0a0392a1007e54716f743992433ae538"} Mar 16 16:49:35 crc kubenswrapper[5120]: I0316 16:49:35.926975 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 16:49:35 crc kubenswrapper[5120]: I0316 16:49:35.929474 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-scheduler-config-data\"" Mar 16 16:49:35 crc kubenswrapper[5120]: I0316 16:49:35.972410 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 16:49:35 crc kubenswrapper[5120]: I0316 16:49:35.972525 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-f5b8b4576-z8chc" event={"ID":"ac5817ce-1c59-4375-9fb6-f2fcd39bdba2","Type":"ContainerStarted","Data":"b193bd33b7db08ee7085bbb3617c49c02aeec692a9a9f0a2afacd9c0b2a844f7"} Mar 16 16:49:35 crc kubenswrapper[5120]: I0316 16:49:35.972561 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 16:49:35 crc kubenswrapper[5120]: I0316 16:49:35.972587 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-5c574fdfbb-8rvsq" event={"ID":"8931787a-1e50-415c-8d97-6c2ab294b4f4","Type":"ContainerStarted","Data":"95c8e85a14f1e4e20c3db6086b04a132d86640df97749641eba22126b0ffe247"} Mar 16 16:49:35 crc kubenswrapper[5120]: I0316 16:49:35.972607 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:49:35 crc kubenswrapper[5120]: I0316 16:49:35.972628 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-678df6fbdb-lfhdz"] Mar 16 16:49:35 crc kubenswrapper[5120]: I0316 16:49:35.972625 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:49:35 crc kubenswrapper[5120]: I0316 16:49:35.972642 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 16:49:35 crc kubenswrapper[5120]: I0316 16:49:35.975629 5120 scope.go:117] "RemoveContainer" containerID="22d8a51d4ad3c9bcfd9809d3a1832743ec83f25d019d4ab903345f8d3f5e7a5b" Mar 16 16:49:35 crc kubenswrapper[5120]: I0316 16:49:35.986372 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovndbcluster-sb-scripts\"" Mar 16 16:49:35 crc kubenswrapper[5120]: I0316 16:49:35.986489 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ovncluster-ovndbcluster-sb-dockercfg-w4q4s\"" Mar 16 16:49:35 crc kubenswrapper[5120]: I0316 16:49:35.986972 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podUID="1ea30b51-1d30-4a53-834a-264069b9566e" containerName="openstack-network-exporter" containerID="cri-o://003073661eb6e19b10f6cf567edeb936c2c742ac60be9015f1217bdf877de6c2" gracePeriod=300 Mar 16 16:49:35 crc kubenswrapper[5120]: I0316 16:49:35.994305 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9hrb\" (UniqueName: \"kubernetes.io/projected/2961edb8-5975-4d74-800e-732bed5d9791-kube-api-access-g9hrb\") pod \"nova-scheduler-0\" (UID: \"2961edb8-5975-4d74-800e-732bed5d9791\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:49:35 crc kubenswrapper[5120]: I0316 16:49:35.994364 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2961edb8-5975-4d74-800e-732bed5d9791-config-data\") pod \"nova-scheduler-0\" (UID: \"2961edb8-5975-4d74-800e-732bed5d9791\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:49:35 crc kubenswrapper[5120]: I0316 16:49:35.994570 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2961edb8-5975-4d74-800e-732bed5d9791-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"2961edb8-5975-4d74-800e-732bed5d9791\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:49:35 crc kubenswrapper[5120]: I0316 16:49:35.997549 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovndbcluster-sb-config\"" Mar 16 16:49:35 crc kubenswrapper[5120]: I0316 16:49:35.997843 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ovn-metrics\"" Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.011392 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.027292 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ovndbcluster-sb-ovndbs\"" Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.109658 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/bb689081-a0bf-445f-aa9f-12a38c98a269-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"bb689081-a0bf-445f-aa9f-12a38c98a269\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.109779 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bb689081-a0bf-445f-aa9f-12a38c98a269-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"bb689081-a0bf-445f-aa9f-12a38c98a269\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.109870 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bb689081-a0bf-445f-aa9f-12a38c98a269-config\") pod \"ovsdbserver-sb-0\" (UID: \"bb689081-a0bf-445f-aa9f-12a38c98a269\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.109930 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/bb689081-a0bf-445f-aa9f-12a38c98a269-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"bb689081-a0bf-445f-aa9f-12a38c98a269\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.110056 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g9hrb\" (UniqueName: \"kubernetes.io/projected/2961edb8-5975-4d74-800e-732bed5d9791-kube-api-access-g9hrb\") pod \"nova-scheduler-0\" (UID: \"2961edb8-5975-4d74-800e-732bed5d9791\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.110081 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2961edb8-5975-4d74-800e-732bed5d9791-config-data\") pod \"nova-scheduler-0\" (UID: \"2961edb8-5975-4d74-800e-732bed5d9791\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.110111 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/bb689081-a0bf-445f-aa9f-12a38c98a269-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"bb689081-a0bf-445f-aa9f-12a38c98a269\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.110192 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xl7rl\" (UniqueName: \"kubernetes.io/projected/bb689081-a0bf-445f-aa9f-12a38c98a269-kube-api-access-xl7rl\") pod \"ovsdbserver-sb-0\" (UID: \"bb689081-a0bf-445f-aa9f-12a38c98a269\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.117641 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"ovsdbserver-sb-0\" (UID: \"bb689081-a0bf-445f-aa9f-12a38c98a269\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.118055 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/bb689081-a0bf-445f-aa9f-12a38c98a269-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"bb689081-a0bf-445f-aa9f-12a38c98a269\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.118104 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2961edb8-5975-4d74-800e-732bed5d9791-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"2961edb8-5975-4d74-800e-732bed5d9791\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.124958 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2961edb8-5975-4d74-800e-732bed5d9791-config-data\") pod \"nova-scheduler-0\" (UID: \"2961edb8-5975-4d74-800e-732bed5d9791\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.132536 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2961edb8-5975-4d74-800e-732bed5d9791-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"2961edb8-5975-4d74-800e-732bed5d9791\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.135480 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.145223 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.148355 5120 scope.go:117] "RemoveContainer" containerID="337f914f7d65a7cc1d629598ef727728aeeeb98f0d532479dda2dac058d447f5" Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.157546 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.168279 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.171555 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9hrb\" (UniqueName: \"kubernetes.io/projected/2961edb8-5975-4d74-800e-732bed5d9791-kube-api-access-g9hrb\") pod \"nova-scheduler-0\" (UID: \"2961edb8-5975-4d74-800e-732bed5d9791\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.218085 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podUID="1ea30b51-1d30-4a53-834a-264069b9566e" containerName="ovsdbserver-nb" containerID="cri-o://988cc78cd1a034b04ef4fe1c6b8c6446a3f4b4f920c30017e4f07d239fd47cf9" gracePeriod=300 Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.219858 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.220971 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="016dd61b-9c8d-4a62-a30f-5893f3aa41d7" containerName="nova-api-api" Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.220996 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="016dd61b-9c8d-4a62-a30f-5893f3aa41d7" containerName="nova-api-api" Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.221021 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9ac41f6-42c9-4d95-b38c-287da24a2adf" containerName="glance-httpd" Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.221030 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9ac41f6-42c9-4d95-b38c-287da24a2adf" containerName="glance-httpd" Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.221045 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7864faa-1e6e-4644-a5f5-f51e429e1e2b" containerName="nova-metadata-metadata" Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.221053 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7864faa-1e6e-4644-a5f5-f51e429e1e2b" containerName="nova-metadata-metadata" Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.221068 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7864faa-1e6e-4644-a5f5-f51e429e1e2b" containerName="nova-metadata-log" Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.221074 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7864faa-1e6e-4644-a5f5-f51e429e1e2b" containerName="nova-metadata-log" Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.221092 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9ac41f6-42c9-4d95-b38c-287da24a2adf" containerName="glance-log" Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.221099 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9ac41f6-42c9-4d95-b38c-287da24a2adf" containerName="glance-log" Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.221144 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="016dd61b-9c8d-4a62-a30f-5893f3aa41d7" containerName="nova-api-log" Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.221151 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="016dd61b-9c8d-4a62-a30f-5893f3aa41d7" containerName="nova-api-log" Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.233210 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="b9ac41f6-42c9-4d95-b38c-287da24a2adf" containerName="glance-httpd" Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.233270 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="a7864faa-1e6e-4644-a5f5-f51e429e1e2b" containerName="nova-metadata-metadata" Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.233293 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="016dd61b-9c8d-4a62-a30f-5893f3aa41d7" containerName="nova-api-log" Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.233306 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="b9ac41f6-42c9-4d95-b38c-287da24a2adf" containerName="glance-log" Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.233318 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="a7864faa-1e6e-4644-a5f5-f51e429e1e2b" containerName="nova-metadata-log" Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.233327 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="016dd61b-9c8d-4a62-a30f-5893f3aa41d7" containerName="nova-api-api" Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.234053 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b9ac41f6-42c9-4d95-b38c-287da24a2adf-logs\") pod \"b9ac41f6-42c9-4d95-b38c-287da24a2adf\" (UID: \"b9ac41f6-42c9-4d95-b38c-287da24a2adf\") " Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.234132 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b9ac41f6-42c9-4d95-b38c-287da24a2adf-config-data\") pod \"b9ac41f6-42c9-4d95-b38c-287da24a2adf\" (UID: \"b9ac41f6-42c9-4d95-b38c-287da24a2adf\") " Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.234219 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/016dd61b-9c8d-4a62-a30f-5893f3aa41d7-logs\") pod \"016dd61b-9c8d-4a62-a30f-5893f3aa41d7\" (UID: \"016dd61b-9c8d-4a62-a30f-5893f3aa41d7\") " Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.234257 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a7864faa-1e6e-4644-a5f5-f51e429e1e2b-config-data\") pod \"a7864faa-1e6e-4644-a5f5-f51e429e1e2b\" (UID: \"a7864faa-1e6e-4644-a5f5-f51e429e1e2b\") " Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.234385 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hmbms\" (UniqueName: \"kubernetes.io/projected/016dd61b-9c8d-4a62-a30f-5893f3aa41d7-kube-api-access-hmbms\") pod \"016dd61b-9c8d-4a62-a30f-5893f3aa41d7\" (UID: \"016dd61b-9c8d-4a62-a30f-5893f3aa41d7\") " Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.234427 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/016dd61b-9c8d-4a62-a30f-5893f3aa41d7-combined-ca-bundle\") pod \"016dd61b-9c8d-4a62-a30f-5893f3aa41d7\" (UID: \"016dd61b-9c8d-4a62-a30f-5893f3aa41d7\") " Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.234458 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a7864faa-1e6e-4644-a5f5-f51e429e1e2b-combined-ca-bundle\") pod \"a7864faa-1e6e-4644-a5f5-f51e429e1e2b\" (UID: \"a7864faa-1e6e-4644-a5f5-f51e429e1e2b\") " Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.234519 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r8jc8\" (UniqueName: \"kubernetes.io/projected/a7864faa-1e6e-4644-a5f5-f51e429e1e2b-kube-api-access-r8jc8\") pod \"a7864faa-1e6e-4644-a5f5-f51e429e1e2b\" (UID: \"a7864faa-1e6e-4644-a5f5-f51e429e1e2b\") " Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.234633 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/b9ac41f6-42c9-4d95-b38c-287da24a2adf-httpd-run\") pod \"b9ac41f6-42c9-4d95-b38c-287da24a2adf\" (UID: \"b9ac41f6-42c9-4d95-b38c-287da24a2adf\") " Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.234674 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"b9ac41f6-42c9-4d95-b38c-287da24a2adf\" (UID: \"b9ac41f6-42c9-4d95-b38c-287da24a2adf\") " Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.234721 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b9ac41f6-42c9-4d95-b38c-287da24a2adf-scripts\") pod \"b9ac41f6-42c9-4d95-b38c-287da24a2adf\" (UID: \"b9ac41f6-42c9-4d95-b38c-287da24a2adf\") " Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.234913 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b9ac41f6-42c9-4d95-b38c-287da24a2adf-combined-ca-bundle\") pod \"b9ac41f6-42c9-4d95-b38c-287da24a2adf\" (UID: \"b9ac41f6-42c9-4d95-b38c-287da24a2adf\") " Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.235077 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a7864faa-1e6e-4644-a5f5-f51e429e1e2b-logs\") pod \"a7864faa-1e6e-4644-a5f5-f51e429e1e2b\" (UID: \"a7864faa-1e6e-4644-a5f5-f51e429e1e2b\") " Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.235113 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2cnq2\" (UniqueName: \"kubernetes.io/projected/b9ac41f6-42c9-4d95-b38c-287da24a2adf-kube-api-access-2cnq2\") pod \"b9ac41f6-42c9-4d95-b38c-287da24a2adf\" (UID: \"b9ac41f6-42c9-4d95-b38c-287da24a2adf\") " Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.235156 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/016dd61b-9c8d-4a62-a30f-5893f3aa41d7-config-data\") pod \"016dd61b-9c8d-4a62-a30f-5893f3aa41d7\" (UID: \"016dd61b-9c8d-4a62-a30f-5893f3aa41d7\") " Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.235490 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/bb689081-a0bf-445f-aa9f-12a38c98a269-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"bb689081-a0bf-445f-aa9f-12a38c98a269\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.235572 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bb689081-a0bf-445f-aa9f-12a38c98a269-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"bb689081-a0bf-445f-aa9f-12a38c98a269\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.235645 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bb689081-a0bf-445f-aa9f-12a38c98a269-config\") pod \"ovsdbserver-sb-0\" (UID: \"bb689081-a0bf-445f-aa9f-12a38c98a269\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.235711 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/bb689081-a0bf-445f-aa9f-12a38c98a269-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"bb689081-a0bf-445f-aa9f-12a38c98a269\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.235891 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/bb689081-a0bf-445f-aa9f-12a38c98a269-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"bb689081-a0bf-445f-aa9f-12a38c98a269\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.235989 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xl7rl\" (UniqueName: \"kubernetes.io/projected/bb689081-a0bf-445f-aa9f-12a38c98a269-kube-api-access-xl7rl\") pod \"ovsdbserver-sb-0\" (UID: \"bb689081-a0bf-445f-aa9f-12a38c98a269\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.236287 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"ovsdbserver-sb-0\" (UID: \"bb689081-a0bf-445f-aa9f-12a38c98a269\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.236365 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/bb689081-a0bf-445f-aa9f-12a38c98a269-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"bb689081-a0bf-445f-aa9f-12a38c98a269\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.238147 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9ac41f6-42c9-4d95-b38c-287da24a2adf-logs" (OuterVolumeSpecName: "logs") pod "b9ac41f6-42c9-4d95-b38c-287da24a2adf" (UID: "b9ac41f6-42c9-4d95-b38c-287da24a2adf"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.238537 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/bb689081-a0bf-445f-aa9f-12a38c98a269-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"bb689081-a0bf-445f-aa9f-12a38c98a269\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.239027 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/bb689081-a0bf-445f-aa9f-12a38c98a269-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"bb689081-a0bf-445f-aa9f-12a38c98a269\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.241253 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7864faa-1e6e-4644-a5f5-f51e429e1e2b-logs" (OuterVolumeSpecName: "logs") pod "a7864faa-1e6e-4644-a5f5-f51e429e1e2b" (UID: "a7864faa-1e6e-4644-a5f5-f51e429e1e2b"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.241627 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/016dd61b-9c8d-4a62-a30f-5893f3aa41d7-logs" (OuterVolumeSpecName: "logs") pod "016dd61b-9c8d-4a62-a30f-5893f3aa41d7" (UID: "016dd61b-9c8d-4a62-a30f-5893f3aa41d7"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.245018 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bb689081-a0bf-445f-aa9f-12a38c98a269-config\") pod \"ovsdbserver-sb-0\" (UID: \"bb689081-a0bf-445f-aa9f-12a38c98a269\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.247408 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"ovsdbserver-sb-0\" (UID: \"bb689081-a0bf-445f-aa9f-12a38c98a269\") device mount path \"/mnt/openstack/pv06\"" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.254455 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9ac41f6-42c9-4d95-b38c-287da24a2adf-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "b9ac41f6-42c9-4d95-b38c-287da24a2adf" (UID: "b9ac41f6-42c9-4d95-b38c-287da24a2adf"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.258368 5120 scope.go:117] "RemoveContainer" containerID="94adda9f3db9d3289d254844d87731640cdd1c022dc2c28e816cc1f45741e90a" Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.259219 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bb689081-a0bf-445f-aa9f-12a38c98a269-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"bb689081-a0bf-445f-aa9f-12a38c98a269\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.267154 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/016dd61b-9c8d-4a62-a30f-5893f3aa41d7-kube-api-access-hmbms" (OuterVolumeSpecName: "kube-api-access-hmbms") pod "016dd61b-9c8d-4a62-a30f-5893f3aa41d7" (UID: "016dd61b-9c8d-4a62-a30f-5893f3aa41d7"). InnerVolumeSpecName "kube-api-access-hmbms". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.277719 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xl7rl\" (UniqueName: \"kubernetes.io/projected/bb689081-a0bf-445f-aa9f-12a38c98a269-kube-api-access-xl7rl\") pod \"ovsdbserver-sb-0\" (UID: \"bb689081-a0bf-445f-aa9f-12a38c98a269\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.282938 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/bb689081-a0bf-445f-aa9f-12a38c98a269-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"bb689081-a0bf-445f-aa9f-12a38c98a269\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.283455 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/bb689081-a0bf-445f-aa9f-12a38c98a269-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"bb689081-a0bf-445f-aa9f-12a38c98a269\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.283612 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9ac41f6-42c9-4d95-b38c-287da24a2adf-scripts" (OuterVolumeSpecName: "scripts") pod "b9ac41f6-42c9-4d95-b38c-287da24a2adf" (UID: "b9ac41f6-42c9-4d95-b38c-287da24a2adf"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.291714 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.291866 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.296903 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9ac41f6-42c9-4d95-b38c-287da24a2adf-kube-api-access-2cnq2" (OuterVolumeSpecName: "kube-api-access-2cnq2") pod "b9ac41f6-42c9-4d95-b38c-287da24a2adf" (UID: "b9ac41f6-42c9-4d95-b38c-287da24a2adf"). InnerVolumeSpecName "kube-api-access-2cnq2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.297234 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-api-config-data\"" Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.313707 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7864faa-1e6e-4644-a5f5-f51e429e1e2b-kube-api-access-r8jc8" (OuterVolumeSpecName: "kube-api-access-r8jc8") pod "a7864faa-1e6e-4644-a5f5-f51e429e1e2b" (UID: "a7864faa-1e6e-4644-a5f5-f51e429e1e2b"). InnerVolumeSpecName "kube-api-access-r8jc8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.332352 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage02-crc" (OuterVolumeSpecName: "glance") pod "b9ac41f6-42c9-4d95-b38c-287da24a2adf" (UID: "b9ac41f6-42c9-4d95-b38c-287da24a2adf"). InnerVolumeSpecName "local-storage02-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.339081 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3b14f53d-9d11-42e8-b823-65b88191e532-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"3b14f53d-9d11-42e8-b823-65b88191e532\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.339157 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/3b14f53d-9d11-42e8-b823-65b88191e532-etc-machine-id\") pod \"cinder-api-0\" (UID: \"3b14f53d-9d11-42e8-b823-65b88191e532\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.339201 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3b14f53d-9d11-42e8-b823-65b88191e532-logs\") pod \"cinder-api-0\" (UID: \"3b14f53d-9d11-42e8-b823-65b88191e532\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.339345 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/3b14f53d-9d11-42e8-b823-65b88191e532-config-data-custom\") pod \"cinder-api-0\" (UID: \"3b14f53d-9d11-42e8-b823-65b88191e532\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.339491 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3b14f53d-9d11-42e8-b823-65b88191e532-config-data\") pod \"cinder-api-0\" (UID: \"3b14f53d-9d11-42e8-b823-65b88191e532\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.339637 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nt6zh\" (UniqueName: \"kubernetes.io/projected/3b14f53d-9d11-42e8-b823-65b88191e532-kube-api-access-nt6zh\") pod \"cinder-api-0\" (UID: \"3b14f53d-9d11-42e8-b823-65b88191e532\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.339662 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3b14f53d-9d11-42e8-b823-65b88191e532-scripts\") pod \"cinder-api-0\" (UID: \"3b14f53d-9d11-42e8-b823-65b88191e532\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.339808 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/b9ac41f6-42c9-4d95-b38c-287da24a2adf-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.339834 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") on node \"crc\" " Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.339846 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b9ac41f6-42c9-4d95-b38c-287da24a2adf-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.339859 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a7864faa-1e6e-4644-a5f5-f51e429e1e2b-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.339873 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2cnq2\" (UniqueName: \"kubernetes.io/projected/b9ac41f6-42c9-4d95-b38c-287da24a2adf-kube-api-access-2cnq2\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.340606 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b9ac41f6-42c9-4d95-b38c-287da24a2adf-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.340623 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/016dd61b-9c8d-4a62-a30f-5893f3aa41d7-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.340636 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hmbms\" (UniqueName: \"kubernetes.io/projected/016dd61b-9c8d-4a62-a30f-5893f3aa41d7-kube-api-access-hmbms\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.340648 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r8jc8\" (UniqueName: \"kubernetes.io/projected/a7864faa-1e6e-4644-a5f5-f51e429e1e2b-kube-api-access-r8jc8\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.344839 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.370946 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-5dc7897bc-w6pc6" event={"ID":"9ad6c5f4-1902-463a-8a6f-6beade89b6a1","Type":"ContainerStarted","Data":"6e240afa0b6c2548f071bab943c62ba78e67a0bd1fc1ce0d71d9a3a13fc14d31"} Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.375432 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"a7864faa-1e6e-4644-a5f5-f51e429e1e2b","Type":"ContainerDied","Data":"3b5b2c377af57264b092d4a5622cb87435698c54adb1b0abdec8da8e7e9388b8"} Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.375578 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.379268 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"016dd61b-9c8d-4a62-a30f-5893f3aa41d7","Type":"ContainerDied","Data":"1a19d1a84a5791daf556544e978d38039eb9387d54be9dde3ff5c41ba5243189"} Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.379358 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.383100 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"b9ac41f6-42c9-4d95-b38c-287da24a2adf","Type":"ContainerDied","Data":"4ad5228c03807961e746b3c00a810bec1d5494d878ea20c132d09b8793f929a8"} Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.383192 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.414180 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-worker-5dc7897bc-w6pc6" podStartSLOduration=8.414160144 podStartE2EDuration="8.414160144s" podCreationTimestamp="2026-03-16 16:49:28 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:49:36.408641152 +0000 UTC m=+4678.562572819" watchObservedRunningTime="2026-03-16 16:49:36.414160144 +0000 UTC m=+4678.568091801" Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.444996 5120 scope.go:117] "RemoveContainer" containerID="8e0902e36245c8105626461234c99769028f119d7a8f9080029df1ebb3dcb8df" Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.452921 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"243f6b1f-595b-44eb-aaa5-0b3df41c88c1","Type":"ContainerStarted","Data":"d39e83b86a56d5e176237b38616dd7059d1b2f47f9b2887f33600f1b487d2e9f"} Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.459580 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3b14f53d-9d11-42e8-b823-65b88191e532-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"3b14f53d-9d11-42e8-b823-65b88191e532\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.459877 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/3b14f53d-9d11-42e8-b823-65b88191e532-etc-machine-id\") pod \"cinder-api-0\" (UID: \"3b14f53d-9d11-42e8-b823-65b88191e532\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.460073 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3b14f53d-9d11-42e8-b823-65b88191e532-logs\") pod \"cinder-api-0\" (UID: \"3b14f53d-9d11-42e8-b823-65b88191e532\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.460485 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/3b14f53d-9d11-42e8-b823-65b88191e532-config-data-custom\") pod \"cinder-api-0\" (UID: \"3b14f53d-9d11-42e8-b823-65b88191e532\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.460983 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3b14f53d-9d11-42e8-b823-65b88191e532-config-data\") pod \"cinder-api-0\" (UID: \"3b14f53d-9d11-42e8-b823-65b88191e532\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.461373 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nt6zh\" (UniqueName: \"kubernetes.io/projected/3b14f53d-9d11-42e8-b823-65b88191e532-kube-api-access-nt6zh\") pod \"cinder-api-0\" (UID: \"3b14f53d-9d11-42e8-b823-65b88191e532\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.461534 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3b14f53d-9d11-42e8-b823-65b88191e532-scripts\") pod \"cinder-api-0\" (UID: \"3b14f53d-9d11-42e8-b823-65b88191e532\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.462545 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/3b14f53d-9d11-42e8-b823-65b88191e532-etc-machine-id\") pod \"cinder-api-0\" (UID: \"3b14f53d-9d11-42e8-b823-65b88191e532\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.468856 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-5d966495c9-4n5ss"] Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.469285 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-747966fd58-rqj7f" Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.470746 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3b14f53d-9d11-42e8-b823-65b88191e532-logs\") pod \"cinder-api-0\" (UID: \"3b14f53d-9d11-42e8-b823-65b88191e532\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.471383 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-5d966495c9-4n5ss" podUID="7872e738-4d0c-48dd-952c-d878aafc51af" containerName="barbican-worker-log" containerID="cri-o://2bcf867b5f7513b9f5de5259f817492a68be7846d89a1bc2dacdab498fcfca0f" gracePeriod=30 Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.471549 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-5d966495c9-4n5ss" podUID="7872e738-4d0c-48dd-952c-d878aafc51af" containerName="barbican-worker" containerID="cri-o://1f29684c403dda9045db07e7ddb6e0614e8cd5b3820d6ba12d2a76504a2cb5db" gracePeriod=30 Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.472952 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"00cf7a69-dcf7-45dd-9291-3e4d75ece0da","Type":"ContainerDied","Data":"5f472509547f5092278120a4b65dbbfd4e2176831bee126bd9fa7e81c878b449"} Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.473001 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5f472509547f5092278120a4b65dbbfd4e2176831bee126bd9fa7e81c878b449" Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.480059 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3b14f53d-9d11-42e8-b823-65b88191e532-config-data\") pod \"cinder-api-0\" (UID: \"3b14f53d-9d11-42e8-b823-65b88191e532\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.493004 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nt6zh\" (UniqueName: \"kubernetes.io/projected/3b14f53d-9d11-42e8-b823-65b88191e532-kube-api-access-nt6zh\") pod \"cinder-api-0\" (UID: \"3b14f53d-9d11-42e8-b823-65b88191e532\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.498399 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/3b14f53d-9d11-42e8-b823-65b88191e532-config-data-custom\") pod \"cinder-api-0\" (UID: \"3b14f53d-9d11-42e8-b823-65b88191e532\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.501942 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3b14f53d-9d11-42e8-b823-65b88191e532-scripts\") pod \"cinder-api-0\" (UID: \"3b14f53d-9d11-42e8-b823-65b88191e532\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.502545 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3b14f53d-9d11-42e8-b823-65b88191e532-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"3b14f53d-9d11-42e8-b823-65b88191e532\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.507969 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-747966fd58-rqj7f" event={"ID":"b530ed0b-581b-40f8-b872-1f920e152d92","Type":"ContainerDied","Data":"1b9a4330eaf831815ad0281a92870eec2bc924fcca48fb8d9a03a1df5a371e75"} Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.509613 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-747966fd58-rqj7f" Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.528202 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.532914 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-86d6cb7f98-5w9h4" event={"ID":"5b516ced-8076-4f11-8398-77eaca65d050","Type":"ContainerStarted","Data":"a752e45aa7e4b33fe1182320f27ff0f06c8dfce5d35bce8af70125146f2883a7"} Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.563222 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/b530ed0b-581b-40f8-b872-1f920e152d92-credential-keys\") pod \"b530ed0b-581b-40f8-b872-1f920e152d92\" (UID: \"b530ed0b-581b-40f8-b872-1f920e152d92\") " Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.563586 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/b530ed0b-581b-40f8-b872-1f920e152d92-fernet-keys\") pod \"b530ed0b-581b-40f8-b872-1f920e152d92\" (UID: \"b530ed0b-581b-40f8-b872-1f920e152d92\") " Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.563739 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b530ed0b-581b-40f8-b872-1f920e152d92-config-data\") pod \"b530ed0b-581b-40f8-b872-1f920e152d92\" (UID: \"b530ed0b-581b-40f8-b872-1f920e152d92\") " Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.564049 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b530ed0b-581b-40f8-b872-1f920e152d92-combined-ca-bundle\") pod \"b530ed0b-581b-40f8-b872-1f920e152d92\" (UID: \"b530ed0b-581b-40f8-b872-1f920e152d92\") " Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.564082 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ltr84\" (UniqueName: \"kubernetes.io/projected/b530ed0b-581b-40f8-b872-1f920e152d92-kube-api-access-ltr84\") pod \"b530ed0b-581b-40f8-b872-1f920e152d92\" (UID: \"b530ed0b-581b-40f8-b872-1f920e152d92\") " Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.564118 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b530ed0b-581b-40f8-b872-1f920e152d92-scripts\") pod \"b530ed0b-581b-40f8-b872-1f920e152d92\" (UID: \"b530ed0b-581b-40f8-b872-1f920e152d92\") " Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.565326 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_1ea30b51-1d30-4a53-834a-264069b9566e/ovsdbserver-nb/0.log" Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.565385 5120 generic.go:358] "Generic (PLEG): container finished" podID="1ea30b51-1d30-4a53-834a-264069b9566e" containerID="003073661eb6e19b10f6cf567edeb936c2c742ac60be9015f1217bdf877de6c2" exitCode=2 Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.565551 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"1ea30b51-1d30-4a53-834a-264069b9566e","Type":"ContainerDied","Data":"003073661eb6e19b10f6cf567edeb936c2c742ac60be9015f1217bdf877de6c2"} Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.576399 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-678df6fbdb-lfhdz" event={"ID":"398bb1bd-f380-4374-b880-d7217d37e010","Type":"ContainerStarted","Data":"93a2d92c3bf1eb69083a4a6ce8aeb25bddf5d8a4b69a4861349c2dbfa9f8a8d5"} Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.586905 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-keystone-listener-86d6cb7f98-5w9h4" podStartSLOduration=8.586881482 podStartE2EDuration="8.586881482s" podCreationTimestamp="2026-03-16 16:49:28 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:49:36.55329807 +0000 UTC m=+4678.707229727" watchObservedRunningTime="2026-03-16 16:49:36.586881482 +0000 UTC m=+4678.740813149" Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.590074 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-dc86d464-4bdds" event={"ID":"493b4ab5-5510-42b3-aec8-e25ba084e342","Type":"ContainerStarted","Data":"2eda6f3d92981939fa924e831aa99864f6c3a94073648c4246a802247bac6b6f"} Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.591571 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/keystone-dc86d464-4bdds" Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.623334 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b530ed0b-581b-40f8-b872-1f920e152d92-kube-api-access-ltr84" (OuterVolumeSpecName: "kube-api-access-ltr84") pod "b530ed0b-581b-40f8-b872-1f920e152d92" (UID: "b530ed0b-581b-40f8-b872-1f920e152d92"). InnerVolumeSpecName "kube-api-access-ltr84". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.628681 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b530ed0b-581b-40f8-b872-1f920e152d92-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "b530ed0b-581b-40f8-b872-1f920e152d92" (UID: "b530ed0b-581b-40f8-b872-1f920e152d92"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.647189 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"a54c7e34-6cda-4e15-83b3-1ccd2fac7cff","Type":"ContainerStarted","Data":"68116beed2f3dc5cde6e9bd25d9fde1a454f2a49596ee141bcf47fa8cd3cd899"} Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.665044 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-77bbc99f7d-fbdfw"] Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.671714 5120 reconciler_common.go:299] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/b530ed0b-581b-40f8-b872-1f920e152d92-credential-keys\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.674866 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ltr84\" (UniqueName: \"kubernetes.io/projected/b530ed0b-581b-40f8-b872-1f920e152d92-kube-api-access-ltr84\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.672640 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-77bbc99f7d-fbdfw" podUID="7fdb0b94-e011-4907-9a1e-a67153d87979" containerName="barbican-keystone-listener" containerID="cri-o://044c15ffa7eb7b7e365430d8cd90ac7de7dc64f1a62dd9960f7cd1eb40ab2934" gracePeriod=30 Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.672669 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b530ed0b-581b-40f8-b872-1f920e152d92-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "b530ed0b-581b-40f8-b872-1f920e152d92" (UID: "b530ed0b-581b-40f8-b872-1f920e152d92"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.671982 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-77bbc99f7d-fbdfw" podUID="7fdb0b94-e011-4907-9a1e-a67153d87979" containerName="barbican-keystone-listener-log" containerID="cri-o://413ac662c0970f63340ee428f2ce77c5b13deb609b8adfca801cfa11779825e7" gracePeriod=30 Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.741724 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5988349f-8dba-4fde-acf3-6d8acf01117f" path="/var/lib/kubelet/pods/5988349f-8dba-4fde-acf3-6d8acf01117f/volumes" Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.743216 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6433979b-c153-4721-8866-0d9bcd0480bb" path="/var/lib/kubelet/pods/6433979b-c153-4721-8866-0d9bcd0480bb/volumes" Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.744291 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d6803c98-d09b-4fbe-9fd6-b8b91ac81c77" path="/var/lib/kubelet/pods/d6803c98-d09b-4fbe-9fd6-b8b91ac81c77/volumes" Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.763386 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-dc86d464-4bdds" podStartSLOduration=6.763358083 podStartE2EDuration="6.763358083s" podCreationTimestamp="2026-03-16 16:49:30 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:49:36.647956438 +0000 UTC m=+4678.801888105" watchObservedRunningTime="2026-03-16 16:49:36.763358083 +0000 UTC m=+4678.917289740" Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.765983 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b530ed0b-581b-40f8-b872-1f920e152d92-scripts" (OuterVolumeSpecName: "scripts") pod "b530ed0b-581b-40f8-b872-1f920e152d92" (UID: "b530ed0b-581b-40f8-b872-1f920e152d92"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.780381 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b530ed0b-581b-40f8-b872-1f920e152d92-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:36 crc kubenswrapper[5120]: I0316 16:49:36.780420 5120 reconciler_common.go:299] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/b530ed0b-581b-40f8-b872-1f920e152d92-fernet-keys\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:37 crc kubenswrapper[5120]: E0316 16:49:37.127231 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="e4568b8c4c24477e088010519cc3fe4c88c7800a42f8be6e09c85136ea3ec934" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Mar 16 16:49:37 crc kubenswrapper[5120]: E0316 16:49:37.131046 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="e4568b8c4c24477e088010519cc3fe4c88c7800a42f8be6e09c85136ea3ec934" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Mar 16 16:49:37 crc kubenswrapper[5120]: E0316 16:49:37.179196 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="e4568b8c4c24477e088010519cc3fe4c88c7800a42f8be6e09c85136ea3ec934" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Mar 16 16:49:37 crc kubenswrapper[5120]: E0316 16:49:37.179262 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/ovn-northd-0" podUID="9d4a3a13-20de-450c-b14b-9f148b93bdcc" containerName="ovn-northd" probeResult="unknown" Mar 16 16:49:37 crc kubenswrapper[5120]: I0316 16:49:37.344003 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"ovsdbserver-sb-0\" (UID: \"bb689081-a0bf-445f-aa9f-12a38c98a269\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:49:37 crc kubenswrapper[5120]: I0316 16:49:37.394238 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9ac41f6-42c9-4d95-b38c-287da24a2adf-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "b9ac41f6-42c9-4d95-b38c-287da24a2adf" (UID: "b9ac41f6-42c9-4d95-b38c-287da24a2adf"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:49:37 crc kubenswrapper[5120]: I0316 16:49:37.394441 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage02-crc" (UniqueName: "kubernetes.io/local-volume/local-storage02-crc") on node "crc" Mar 16 16:49:37 crc kubenswrapper[5120]: I0316 16:49:37.398324 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/016dd61b-9c8d-4a62-a30f-5893f3aa41d7-config-data" (OuterVolumeSpecName: "config-data") pod "016dd61b-9c8d-4a62-a30f-5893f3aa41d7" (UID: "016dd61b-9c8d-4a62-a30f-5893f3aa41d7"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:49:37 crc kubenswrapper[5120]: I0316 16:49:37.429563 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/016dd61b-9c8d-4a62-a30f-5893f3aa41d7-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:37 crc kubenswrapper[5120]: I0316 16:49:37.429602 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:37 crc kubenswrapper[5120]: I0316 16:49:37.429614 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b9ac41f6-42c9-4d95-b38c-287da24a2adf-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:37 crc kubenswrapper[5120]: I0316 16:49:37.478856 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podUID="babd9a47-eaa5-4b06-a2d3-16732a4b2dc7" containerName="nova-cell1-novncproxy-novncproxy" probeResult="failure" output="Get \"http://10.217.1.197:6080/vnc_lite.html\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 16:49:37 crc kubenswrapper[5120]: I0316 16:49:37.510396 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/rabbitmq-server-0" podUID="07aa860b-bb17-4a36-bc23-549bfd1bdb5c" containerName="rabbitmq" probeResult="failure" output="dial tcp 10.217.1.123:5672: connect: connection refused" Mar 16 16:49:37 crc kubenswrapper[5120]: I0316 16:49:37.510959 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" podUID="aa12529b-b6fe-4512-88ec-fd6250636e6b" containerName="rabbitmq" probeResult="failure" output="dial tcp 10.217.1.122:5672: connect: connection refused" Mar 16 16:49:37 crc kubenswrapper[5120]: I0316 16:49:37.515961 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7864faa-1e6e-4644-a5f5-f51e429e1e2b-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "a7864faa-1e6e-4644-a5f5-f51e429e1e2b" (UID: "a7864faa-1e6e-4644-a5f5-f51e429e1e2b"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:49:37 crc kubenswrapper[5120]: I0316 16:49:37.533078 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a7864faa-1e6e-4644-a5f5-f51e429e1e2b-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:37 crc kubenswrapper[5120]: I0316 16:49:37.558418 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7864faa-1e6e-4644-a5f5-f51e429e1e2b-config-data" (OuterVolumeSpecName: "config-data") pod "a7864faa-1e6e-4644-a5f5-f51e429e1e2b" (UID: "a7864faa-1e6e-4644-a5f5-f51e429e1e2b"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:49:37 crc kubenswrapper[5120]: I0316 16:49:37.571707 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b530ed0b-581b-40f8-b872-1f920e152d92-config-data" (OuterVolumeSpecName: "config-data") pod "b530ed0b-581b-40f8-b872-1f920e152d92" (UID: "b530ed0b-581b-40f8-b872-1f920e152d92"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:49:37 crc kubenswrapper[5120]: I0316 16:49:37.625541 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:49:37 crc kubenswrapper[5120]: I0316 16:49:37.635669 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a7864faa-1e6e-4644-a5f5-f51e429e1e2b-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:37 crc kubenswrapper[5120]: I0316 16:49:37.635713 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b530ed0b-581b-40f8-b872-1f920e152d92-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:37 crc kubenswrapper[5120]: I0316 16:49:37.652997 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/016dd61b-9c8d-4a62-a30f-5893f3aa41d7-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "016dd61b-9c8d-4a62-a30f-5893f3aa41d7" (UID: "016dd61b-9c8d-4a62-a30f-5893f3aa41d7"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:49:37 crc kubenswrapper[5120]: I0316 16:49:37.737553 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/016dd61b-9c8d-4a62-a30f-5893f3aa41d7-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:37 crc kubenswrapper[5120]: I0316 16:49:37.814900 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b530ed0b-581b-40f8-b872-1f920e152d92-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "b530ed0b-581b-40f8-b872-1f920e152d92" (UID: "b530ed0b-581b-40f8-b872-1f920e152d92"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:49:37 crc kubenswrapper[5120]: I0316 16:49:37.848856 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b530ed0b-581b-40f8-b872-1f920e152d92-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:37 crc kubenswrapper[5120]: I0316 16:49:37.949446 5120 generic.go:358] "Generic (PLEG): container finished" podID="7fdb0b94-e011-4907-9a1e-a67153d87979" containerID="413ac662c0970f63340ee428f2ce77c5b13deb609b8adfca801cfa11779825e7" exitCode=143 Mar 16 16:49:38 crc kubenswrapper[5120]: E0316 16:49:38.034931 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 988cc78cd1a034b04ef4fe1c6b8c6446a3f4b4f920c30017e4f07d239fd47cf9 is running failed: container process not found" containerID="988cc78cd1a034b04ef4fe1c6b8c6446a3f4b4f920c30017e4f07d239fd47cf9" cmd=["/usr/bin/pidof","ovsdb-server"] Mar 16 16:49:38 crc kubenswrapper[5120]: E0316 16:49:38.042911 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 988cc78cd1a034b04ef4fe1c6b8c6446a3f4b4f920c30017e4f07d239fd47cf9 is running failed: container process not found" containerID="988cc78cd1a034b04ef4fe1c6b8c6446a3f4b4f920c30017e4f07d239fd47cf9" cmd=["/usr/bin/pidof","ovsdb-server"] Mar 16 16:49:38 crc kubenswrapper[5120]: E0316 16:49:38.056649 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 988cc78cd1a034b04ef4fe1c6b8c6446a3f4b4f920c30017e4f07d239fd47cf9 is running failed: container process not found" containerID="988cc78cd1a034b04ef4fe1c6b8c6446a3f4b4f920c30017e4f07d239fd47cf9" cmd=["/usr/bin/pidof","ovsdb-server"] Mar 16 16:49:38 crc kubenswrapper[5120]: E0316 16:49:38.066978 5120 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 988cc78cd1a034b04ef4fe1c6b8c6446a3f4b4f920c30017e4f07d239fd47cf9 is running failed: container process not found" probeType="Readiness" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podUID="1ea30b51-1d30-4a53-834a-264069b9566e" containerName="ovsdbserver-nb" probeResult="unknown" Mar 16 16:49:38 crc kubenswrapper[5120]: I0316 16:49:38.061000 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9ac41f6-42c9-4d95-b38c-287da24a2adf-config-data" (OuterVolumeSpecName: "config-data") pod "b9ac41f6-42c9-4d95-b38c-287da24a2adf" (UID: "b9ac41f6-42c9-4d95-b38c-287da24a2adf"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:49:38 crc kubenswrapper[5120]: I0316 16:49:38.060879 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_1ea30b51-1d30-4a53-834a-264069b9566e/ovsdbserver-nb/0.log" Mar 16 16:49:38 crc kubenswrapper[5120]: I0316 16:49:38.067302 5120 generic.go:358] "Generic (PLEG): container finished" podID="1ea30b51-1d30-4a53-834a-264069b9566e" containerID="988cc78cd1a034b04ef4fe1c6b8c6446a3f4b4f920c30017e4f07d239fd47cf9" exitCode=143 Mar 16 16:49:38 crc kubenswrapper[5120]: I0316 16:49:38.072724 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b9ac41f6-42c9-4d95-b38c-287da24a2adf-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:38 crc kubenswrapper[5120]: E0316 16:49:38.133188 5120 kubelet.go:2642] "Housekeeping took longer than expected" err="housekeeping took too long" expected="1s" actual="1.455s" Mar 16 16:49:38 crc kubenswrapper[5120]: I0316 16:49:38.133246 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-77bbc99f7d-fbdfw" event={"ID":"7fdb0b94-e011-4907-9a1e-a67153d87979","Type":"ContainerDied","Data":"413ac662c0970f63340ee428f2ce77c5b13deb609b8adfca801cfa11779825e7"} Mar 16 16:49:38 crc kubenswrapper[5120]: I0316 16:49:38.133279 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-b95f7696b-gs4k6" event={"ID":"370e78a7-6b53-4f13-aa62-8afa448a0b7d","Type":"ContainerStarted","Data":"504b102dbe299e584d590a98680203d1fc45f024425a99a136dae5714a040b0c"} Mar 16 16:49:38 crc kubenswrapper[5120]: I0316 16:49:38.133373 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:49:38 crc kubenswrapper[5120]: I0316 16:49:38.133389 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"5f1fe655-07dd-4959-98ac-372e797369fa","Type":"ContainerStarted","Data":"c0d57a65e10063e7d97899325f17848ce2f91612db081aab6388df11671dd7c8"} Mar 16 16:49:38 crc kubenswrapper[5120]: I0316 16:49:38.133407 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:49:38 crc kubenswrapper[5120]: I0316 16:49:38.133423 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"1ea30b51-1d30-4a53-834a-264069b9566e","Type":"ContainerDied","Data":"988cc78cd1a034b04ef4fe1c6b8c6446a3f4b4f920c30017e4f07d239fd47cf9"} Mar 16 16:49:38 crc kubenswrapper[5120]: I0316 16:49:38.133438 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"1ea30b51-1d30-4a53-834a-264069b9566e","Type":"ContainerDied","Data":"8fa146db3a765f475db4c7b9e3096ed0b042379bd533be682b32263a2f81b4a7"} Mar 16 16:49:38 crc kubenswrapper[5120]: I0316 16:49:38.133450 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8fa146db3a765f475db4c7b9e3096ed0b042379bd533be682b32263a2f81b4a7" Mar 16 16:49:38 crc kubenswrapper[5120]: I0316 16:49:38.133460 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-678df6fbdb-lfhdz" event={"ID":"398bb1bd-f380-4374-b880-d7217d37e010","Type":"ContainerStarted","Data":"357e8754e619bde82ee9a20e2bb6e7f080cf0e315df9fb1354335a7aa606bd9f"} Mar 16 16:49:38 crc kubenswrapper[5120]: I0316 16:49:38.133816 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="845a4572-72f5-4247-b546-c9974f7ae78d" containerName="ceilometer-central-agent" containerID="cri-o://ee76de54b5123c4dfd41f8ebbde4df9133509c49a4031078292d09bed98358e3" gracePeriod=30 Mar 16 16:49:38 crc kubenswrapper[5120]: I0316 16:49:38.146869 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="845a4572-72f5-4247-b546-c9974f7ae78d" containerName="proxy-httpd" containerID="cri-o://a1342b28e33d351be9c4dcf0a337be7231153eb4a15daff492d2ab2085cab787" gracePeriod=30 Mar 16 16:49:38 crc kubenswrapper[5120]: I0316 16:49:38.147263 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="845a4572-72f5-4247-b546-c9974f7ae78d" containerName="ceilometer-notification-agent" containerID="cri-o://e395c97f46524d2be4c3f22c7dd5e308856748f9b69a0197842a05ba44953ce8" gracePeriod=30 Mar 16 16:49:38 crc kubenswrapper[5120]: I0316 16:49:38.147307 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="845a4572-72f5-4247-b546-c9974f7ae78d" containerName="sg-core" containerID="cri-o://d16d8b561d29194b70bd7462a92933c5a49972813766602967563ef931d51af3" gracePeriod=30 Mar 16 16:49:38 crc kubenswrapper[5120]: I0316 16:49:38.153209 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-5c574fdfbb-8rvsq" event={"ID":"8931787a-1e50-415c-8d97-6c2ab294b4f4","Type":"ContainerStarted","Data":"d8e6f9c22bd7d66c182898a8c06b4817335fd2fd9d4c4e0036cdaca44ef91a73"} Mar 16 16:49:38 crc kubenswrapper[5120]: I0316 16:49:38.167666 5120 generic.go:358] "Generic (PLEG): container finished" podID="7872e738-4d0c-48dd-952c-d878aafc51af" containerID="2bcf867b5f7513b9f5de5259f817492a68be7846d89a1bc2dacdab498fcfca0f" exitCode=143 Mar 16 16:49:38 crc kubenswrapper[5120]: I0316 16:49:38.167782 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-5d966495c9-4n5ss" event={"ID":"7872e738-4d0c-48dd-952c-d878aafc51af","Type":"ContainerDied","Data":"2bcf867b5f7513b9f5de5259f817492a68be7846d89a1bc2dacdab498fcfca0f"} Mar 16 16:49:38 crc kubenswrapper[5120]: I0316 16:49:38.182035 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"a54c7e34-6cda-4e15-83b3-1ccd2fac7cff","Type":"ContainerStarted","Data":"d6e7af6dd3189bcd54f1b9651a384fdb614ec07728b05cfef52fd2b0137dcbb8"} Mar 16 16:49:38 crc kubenswrapper[5120]: I0316 16:49:38.196027 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"2961edb8-5975-4d74-800e-732bed5d9791","Type":"ContainerStarted","Data":"6e60cca01ae88b2d66a2aea7eeb455becfcf18e388a762e1b0e46352ceffe6cb"} Mar 16 16:49:38 crc kubenswrapper[5120]: I0316 16:49:38.225090 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podStartSLOduration=5.225063225 podStartE2EDuration="5.225063225s" podCreationTimestamp="2026-03-16 16:49:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:49:38.216213312 +0000 UTC m=+4680.370144969" watchObservedRunningTime="2026-03-16 16:49:38.225063225 +0000 UTC m=+4680.378994882" Mar 16 16:49:38 crc kubenswrapper[5120]: I0316 16:49:38.322921 5120 scope.go:117] "RemoveContainer" containerID="cf0a8f06eaed0e3687e612c1d60597d999644af14a5963369c5ba62e98f9bcb7" Mar 16 16:49:38 crc kubenswrapper[5120]: I0316 16:49:38.400565 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 16:49:38 crc kubenswrapper[5120]: E0316 16:49:38.423333 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="0133a2cd785424001989a4b5c72950fd6eb0e3bedabf2dd40ea720d83389adb9" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:49:38 crc kubenswrapper[5120]: E0316 16:49:38.447246 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="0133a2cd785424001989a4b5c72950fd6eb0e3bedabf2dd40ea720d83389adb9" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:49:38 crc kubenswrapper[5120]: E0316 16:49:38.452866 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="0133a2cd785424001989a4b5c72950fd6eb0e3bedabf2dd40ea720d83389adb9" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:49:38 crc kubenswrapper[5120]: E0316 16:49:38.452931 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="f3277ed1-d61b-491c-b6dc-1964a1422ea9" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 16:49:38 crc kubenswrapper[5120]: I0316 16:49:38.732499 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:49:39 crc kubenswrapper[5120]: I0316 16:49:39.337104 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-api-f5b8b4576-z8chc" podStartSLOduration=11.337083164 podStartE2EDuration="11.337083164s" podCreationTimestamp="2026-03-16 16:49:28 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:49:39.302927316 +0000 UTC m=+4681.456858973" watchObservedRunningTime="2026-03-16 16:49:39.337083164 +0000 UTC m=+4681.491014821" Mar 16 16:49:39 crc kubenswrapper[5120]: I0316 16:49:39.357902 5120 generic.go:358] "Generic (PLEG): container finished" podID="845a4572-72f5-4247-b546-c9974f7ae78d" containerID="a1342b28e33d351be9c4dcf0a337be7231153eb4a15daff492d2ab2085cab787" exitCode=0 Mar 16 16:49:39 crc kubenswrapper[5120]: I0316 16:49:39.357940 5120 generic.go:358] "Generic (PLEG): container finished" podID="845a4572-72f5-4247-b546-c9974f7ae78d" containerID="d16d8b561d29194b70bd7462a92933c5a49972813766602967563ef931d51af3" exitCode=2 Mar 16 16:49:39 crc kubenswrapper[5120]: I0316 16:49:39.403075 5120 generic.go:358] "Generic (PLEG): container finished" podID="7872e738-4d0c-48dd-952c-d878aafc51af" containerID="1f29684c403dda9045db07e7ddb6e0614e8cd5b3820d6ba12d2a76504a2cb5db" exitCode=0 Mar 16 16:49:39 crc kubenswrapper[5120]: I0316 16:49:39.424619 5120 generic.go:358] "Generic (PLEG): container finished" podID="07aa860b-bb17-4a36-bc23-549bfd1bdb5c" containerID="45cb557a01c4d5f3fcaf3f1ae59379de4a157caa00add93b62710010548ac944" exitCode=0 Mar 16 16:49:39 crc kubenswrapper[5120]: I0316 16:49:39.563502 5120 generic.go:358] "Generic (PLEG): container finished" podID="7fdb0b94-e011-4907-9a1e-a67153d87979" containerID="044c15ffa7eb7b7e365430d8cd90ac7de7dc64f1a62dd9960f7cd1eb40ab2934" exitCode=0 Mar 16 16:49:39 crc kubenswrapper[5120]: I0316 16:49:39.628062 5120 generic.go:358] "Generic (PLEG): container finished" podID="aa12529b-b6fe-4512-88ec-fd6250636e6b" containerID="c850be05d5aca34a4b506a8d1a6a6816d3a77902224755fcceb07ca0e744a3d9" exitCode=0 Mar 16 16:49:39 crc kubenswrapper[5120]: E0316 16:49:39.758425 5120 kubelet.go:2642] "Housekeeping took longer than expected" err="housekeeping took too long" expected="1s" actual="1.026s" Mar 16 16:49:39 crc kubenswrapper[5120]: I0316 16:49:39.758471 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-f5b8b4576-z8chc" Mar 16 16:49:39 crc kubenswrapper[5120]: I0316 16:49:39.758579 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-f5b8b4576-z8chc" event={"ID":"ac5817ce-1c59-4375-9fb6-f2fcd39bdba2","Type":"ContainerStarted","Data":"e1f008207b4e65c35dbbb1a2b363b53644df41f9b03a1b7ee6b4a6e099ab0cdb"} Mar 16 16:49:39 crc kubenswrapper[5120]: I0316 16:49:39.758598 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"845a4572-72f5-4247-b546-c9974f7ae78d","Type":"ContainerDied","Data":"a1342b28e33d351be9c4dcf0a337be7231153eb4a15daff492d2ab2085cab787"} Mar 16 16:49:39 crc kubenswrapper[5120]: I0316 16:49:39.758621 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-f5b8b4576-z8chc" Mar 16 16:49:39 crc kubenswrapper[5120]: I0316 16:49:39.758645 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"845a4572-72f5-4247-b546-c9974f7ae78d","Type":"ContainerDied","Data":"d16d8b561d29194b70bd7462a92933c5a49972813766602967563ef931d51af3"} Mar 16 16:49:39 crc kubenswrapper[5120]: I0316 16:49:39.758657 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-5d966495c9-4n5ss" event={"ID":"7872e738-4d0c-48dd-952c-d878aafc51af","Type":"ContainerDied","Data":"1f29684c403dda9045db07e7ddb6e0614e8cd5b3820d6ba12d2a76504a2cb5db"} Mar 16 16:49:39 crc kubenswrapper[5120]: I0316 16:49:39.758668 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"07aa860b-bb17-4a36-bc23-549bfd1bdb5c","Type":"ContainerDied","Data":"45cb557a01c4d5f3fcaf3f1ae59379de4a157caa00add93b62710010548ac944"} Mar 16 16:49:39 crc kubenswrapper[5120]: I0316 16:49:39.758681 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"07aa860b-bb17-4a36-bc23-549bfd1bdb5c","Type":"ContainerDied","Data":"1840f15ea1580195538d5cef1caa915da98c1920e62725427692611e9d581023"} Mar 16 16:49:39 crc kubenswrapper[5120]: I0316 16:49:39.758691 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1840f15ea1580195538d5cef1caa915da98c1920e62725427692611e9d581023" Mar 16 16:49:39 crc kubenswrapper[5120]: I0316 16:49:39.758700 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-77bbc99f7d-fbdfw" event={"ID":"7fdb0b94-e011-4907-9a1e-a67153d87979","Type":"ContainerDied","Data":"044c15ffa7eb7b7e365430d8cd90ac7de7dc64f1a62dd9960f7cd1eb40ab2934"} Mar 16 16:49:39 crc kubenswrapper[5120]: I0316 16:49:39.758716 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"aa12529b-b6fe-4512-88ec-fd6250636e6b","Type":"ContainerDied","Data":"c850be05d5aca34a4b506a8d1a6a6816d3a77902224755fcceb07ca0e744a3d9"} Mar 16 16:49:40 crc kubenswrapper[5120]: I0316 16:49:40.210030 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-77797b894-rctcp"] Mar 16 16:49:40 crc kubenswrapper[5120]: I0316 16:49:40.211487 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b530ed0b-581b-40f8-b872-1f920e152d92" containerName="keystone-api" Mar 16 16:49:40 crc kubenswrapper[5120]: I0316 16:49:40.211515 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="b530ed0b-581b-40f8-b872-1f920e152d92" containerName="keystone-api" Mar 16 16:49:40 crc kubenswrapper[5120]: I0316 16:49:40.211850 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="b530ed0b-581b-40f8-b872-1f920e152d92" containerName="keystone-api" Mar 16 16:49:40 crc kubenswrapper[5120]: I0316 16:49:40.233584 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-77797b894-rctcp"] Mar 16 16:49:40 crc kubenswrapper[5120]: I0316 16:49:40.233879 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-77797b894-rctcp" Mar 16 16:49:40 crc kubenswrapper[5120]: I0316 16:49:40.236786 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-placement-public-svc\"" Mar 16 16:49:40 crc kubenswrapper[5120]: I0316 16:49:40.237078 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-placement-internal-svc\"" Mar 16 16:49:40 crc kubenswrapper[5120]: I0316 16:49:40.300194 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/710921c8-80e7-46a5-8792-8ffc9795500c-combined-ca-bundle\") pod \"placement-77797b894-rctcp\" (UID: \"710921c8-80e7-46a5-8792-8ffc9795500c\") " pod="openstack-kuttl-tests/placement-77797b894-rctcp" Mar 16 16:49:40 crc kubenswrapper[5120]: I0316 16:49:40.300268 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/710921c8-80e7-46a5-8792-8ffc9795500c-logs\") pod \"placement-77797b894-rctcp\" (UID: \"710921c8-80e7-46a5-8792-8ffc9795500c\") " pod="openstack-kuttl-tests/placement-77797b894-rctcp" Mar 16 16:49:40 crc kubenswrapper[5120]: I0316 16:49:40.300553 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/710921c8-80e7-46a5-8792-8ffc9795500c-public-tls-certs\") pod \"placement-77797b894-rctcp\" (UID: \"710921c8-80e7-46a5-8792-8ffc9795500c\") " pod="openstack-kuttl-tests/placement-77797b894-rctcp" Mar 16 16:49:40 crc kubenswrapper[5120]: I0316 16:49:40.300660 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/710921c8-80e7-46a5-8792-8ffc9795500c-scripts\") pod \"placement-77797b894-rctcp\" (UID: \"710921c8-80e7-46a5-8792-8ffc9795500c\") " pod="openstack-kuttl-tests/placement-77797b894-rctcp" Mar 16 16:49:40 crc kubenswrapper[5120]: I0316 16:49:40.300981 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/710921c8-80e7-46a5-8792-8ffc9795500c-config-data\") pod \"placement-77797b894-rctcp\" (UID: \"710921c8-80e7-46a5-8792-8ffc9795500c\") " pod="openstack-kuttl-tests/placement-77797b894-rctcp" Mar 16 16:49:40 crc kubenswrapper[5120]: I0316 16:49:40.301041 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/710921c8-80e7-46a5-8792-8ffc9795500c-internal-tls-certs\") pod \"placement-77797b894-rctcp\" (UID: \"710921c8-80e7-46a5-8792-8ffc9795500c\") " pod="openstack-kuttl-tests/placement-77797b894-rctcp" Mar 16 16:49:40 crc kubenswrapper[5120]: I0316 16:49:40.301064 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cw64d\" (UniqueName: \"kubernetes.io/projected/710921c8-80e7-46a5-8792-8ffc9795500c-kube-api-access-cw64d\") pod \"placement-77797b894-rctcp\" (UID: \"710921c8-80e7-46a5-8792-8ffc9795500c\") " pod="openstack-kuttl-tests/placement-77797b894-rctcp" Mar 16 16:49:40 crc kubenswrapper[5120]: I0316 16:49:40.403620 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/710921c8-80e7-46a5-8792-8ffc9795500c-public-tls-certs\") pod \"placement-77797b894-rctcp\" (UID: \"710921c8-80e7-46a5-8792-8ffc9795500c\") " pod="openstack-kuttl-tests/placement-77797b894-rctcp" Mar 16 16:49:40 crc kubenswrapper[5120]: I0316 16:49:40.403941 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/710921c8-80e7-46a5-8792-8ffc9795500c-scripts\") pod \"placement-77797b894-rctcp\" (UID: \"710921c8-80e7-46a5-8792-8ffc9795500c\") " pod="openstack-kuttl-tests/placement-77797b894-rctcp" Mar 16 16:49:40 crc kubenswrapper[5120]: I0316 16:49:40.404054 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/710921c8-80e7-46a5-8792-8ffc9795500c-config-data\") pod \"placement-77797b894-rctcp\" (UID: \"710921c8-80e7-46a5-8792-8ffc9795500c\") " pod="openstack-kuttl-tests/placement-77797b894-rctcp" Mar 16 16:49:40 crc kubenswrapper[5120]: I0316 16:49:40.404085 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/710921c8-80e7-46a5-8792-8ffc9795500c-internal-tls-certs\") pod \"placement-77797b894-rctcp\" (UID: \"710921c8-80e7-46a5-8792-8ffc9795500c\") " pod="openstack-kuttl-tests/placement-77797b894-rctcp" Mar 16 16:49:40 crc kubenswrapper[5120]: I0316 16:49:40.404101 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cw64d\" (UniqueName: \"kubernetes.io/projected/710921c8-80e7-46a5-8792-8ffc9795500c-kube-api-access-cw64d\") pod \"placement-77797b894-rctcp\" (UID: \"710921c8-80e7-46a5-8792-8ffc9795500c\") " pod="openstack-kuttl-tests/placement-77797b894-rctcp" Mar 16 16:49:40 crc kubenswrapper[5120]: I0316 16:49:40.404391 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/710921c8-80e7-46a5-8792-8ffc9795500c-combined-ca-bundle\") pod \"placement-77797b894-rctcp\" (UID: \"710921c8-80e7-46a5-8792-8ffc9795500c\") " pod="openstack-kuttl-tests/placement-77797b894-rctcp" Mar 16 16:49:40 crc kubenswrapper[5120]: I0316 16:49:40.404428 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/710921c8-80e7-46a5-8792-8ffc9795500c-logs\") pod \"placement-77797b894-rctcp\" (UID: \"710921c8-80e7-46a5-8792-8ffc9795500c\") " pod="openstack-kuttl-tests/placement-77797b894-rctcp" Mar 16 16:49:40 crc kubenswrapper[5120]: I0316 16:49:40.404954 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/710921c8-80e7-46a5-8792-8ffc9795500c-logs\") pod \"placement-77797b894-rctcp\" (UID: \"710921c8-80e7-46a5-8792-8ffc9795500c\") " pod="openstack-kuttl-tests/placement-77797b894-rctcp" Mar 16 16:49:40 crc kubenswrapper[5120]: I0316 16:49:40.413289 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/710921c8-80e7-46a5-8792-8ffc9795500c-public-tls-certs\") pod \"placement-77797b894-rctcp\" (UID: \"710921c8-80e7-46a5-8792-8ffc9795500c\") " pod="openstack-kuttl-tests/placement-77797b894-rctcp" Mar 16 16:49:40 crc kubenswrapper[5120]: I0316 16:49:40.413502 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/710921c8-80e7-46a5-8792-8ffc9795500c-combined-ca-bundle\") pod \"placement-77797b894-rctcp\" (UID: \"710921c8-80e7-46a5-8792-8ffc9795500c\") " pod="openstack-kuttl-tests/placement-77797b894-rctcp" Mar 16 16:49:40 crc kubenswrapper[5120]: I0316 16:49:40.417060 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/710921c8-80e7-46a5-8792-8ffc9795500c-scripts\") pod \"placement-77797b894-rctcp\" (UID: \"710921c8-80e7-46a5-8792-8ffc9795500c\") " pod="openstack-kuttl-tests/placement-77797b894-rctcp" Mar 16 16:49:40 crc kubenswrapper[5120]: I0316 16:49:40.417474 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/710921c8-80e7-46a5-8792-8ffc9795500c-internal-tls-certs\") pod \"placement-77797b894-rctcp\" (UID: \"710921c8-80e7-46a5-8792-8ffc9795500c\") " pod="openstack-kuttl-tests/placement-77797b894-rctcp" Mar 16 16:49:40 crc kubenswrapper[5120]: I0316 16:49:40.428649 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cw64d\" (UniqueName: \"kubernetes.io/projected/710921c8-80e7-46a5-8792-8ffc9795500c-kube-api-access-cw64d\") pod \"placement-77797b894-rctcp\" (UID: \"710921c8-80e7-46a5-8792-8ffc9795500c\") " pod="openstack-kuttl-tests/placement-77797b894-rctcp" Mar 16 16:49:40 crc kubenswrapper[5120]: I0316 16:49:40.435798 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/710921c8-80e7-46a5-8792-8ffc9795500c-config-data\") pod \"placement-77797b894-rctcp\" (UID: \"710921c8-80e7-46a5-8792-8ffc9795500c\") " pod="openstack-kuttl-tests/placement-77797b894-rctcp" Mar 16 16:49:40 crc kubenswrapper[5120]: I0316 16:49:40.652157 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"aa12529b-b6fe-4512-88ec-fd6250636e6b","Type":"ContainerDied","Data":"5db48ac99e4cd426cb85d822a777dca0f601cfb0be745e2cc1641e57f65425b3"} Mar 16 16:49:40 crc kubenswrapper[5120]: I0316 16:49:40.652213 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5db48ac99e4cd426cb85d822a777dca0f601cfb0be745e2cc1641e57f65425b3" Mar 16 16:49:40 crc kubenswrapper[5120]: I0316 16:49:40.657555 5120 generic.go:358] "Generic (PLEG): container finished" podID="845a4572-72f5-4247-b546-c9974f7ae78d" containerID="ee76de54b5123c4dfd41f8ebbde4df9133509c49a4031078292d09bed98358e3" exitCode=0 Mar 16 16:49:40 crc kubenswrapper[5120]: I0316 16:49:40.657653 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"845a4572-72f5-4247-b546-c9974f7ae78d","Type":"ContainerDied","Data":"ee76de54b5123c4dfd41f8ebbde4df9133509c49a4031078292d09bed98358e3"} Mar 16 16:49:40 crc kubenswrapper[5120]: I0316 16:49:40.662849 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"bb689081-a0bf-445f-aa9f-12a38c98a269","Type":"ContainerStarted","Data":"f77cbfbe48658688edd4f31666e6628c1e33e2efc976e6dafb00b12746fffa5e"} Mar 16 16:49:40 crc kubenswrapper[5120]: I0316 16:49:40.669516 5120 generic.go:358] "Generic (PLEG): container finished" podID="f3277ed1-d61b-491c-b6dc-1964a1422ea9" containerID="0133a2cd785424001989a4b5c72950fd6eb0e3bedabf2dd40ea720d83389adb9" exitCode=0 Mar 16 16:49:40 crc kubenswrapper[5120]: I0316 16:49:40.684980 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"f3277ed1-d61b-491c-b6dc-1964a1422ea9","Type":"ContainerDied","Data":"0133a2cd785424001989a4b5c72950fd6eb0e3bedabf2dd40ea720d83389adb9"} Mar 16 16:49:40 crc kubenswrapper[5120]: I0316 16:49:40.685024 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"f3277ed1-d61b-491c-b6dc-1964a1422ea9","Type":"ContainerDied","Data":"6bf44295eb9a2acfe3d045f946a7ad32c7dd8daaf097fac7c9d48ada61d2a628"} Mar 16 16:49:40 crc kubenswrapper[5120]: I0316 16:49:40.685035 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6bf44295eb9a2acfe3d045f946a7ad32c7dd8daaf097fac7c9d48ada61d2a628" Mar 16 16:49:40 crc kubenswrapper[5120]: I0316 16:49:40.685044 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-5d966495c9-4n5ss" event={"ID":"7872e738-4d0c-48dd-952c-d878aafc51af","Type":"ContainerDied","Data":"b52f93373b460f94721948a04747edc62ce2f2c4c20aa3a65ef4af35ba37a003"} Mar 16 16:49:40 crc kubenswrapper[5120]: I0316 16:49:40.685054 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b52f93373b460f94721948a04747edc62ce2f2c4c20aa3a65ef4af35ba37a003" Mar 16 16:49:40 crc kubenswrapper[5120]: I0316 16:49:40.685063 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-77bbc99f7d-fbdfw" event={"ID":"7fdb0b94-e011-4907-9a1e-a67153d87979","Type":"ContainerDied","Data":"fb6abc80f55ba32dce51b6c134df5b30b086356e3e5f54f629695ba2b8a9d559"} Mar 16 16:49:40 crc kubenswrapper[5120]: I0316 16:49:40.685072 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fb6abc80f55ba32dce51b6c134df5b30b086356e3e5f54f629695ba2b8a9d559" Mar 16 16:49:40 crc kubenswrapper[5120]: I0316 16:49:40.705183 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:49:40 crc kubenswrapper[5120]: I0316 16:49:40.735739 5120 scope.go:117] "RemoveContainer" containerID="ae3296fd136f37d44efdbffedb932b3d7fc4bb15548e013e662c90d6198d2a1b" Mar 16 16:49:40 crc kubenswrapper[5120]: I0316 16:49:40.804776 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:49:40 crc kubenswrapper[5120]: I0316 16:49:40.816490 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/00cf7a69-dcf7-45dd-9291-3e4d75ece0da-scripts\") pod \"00cf7a69-dcf7-45dd-9291-3e4d75ece0da\" (UID: \"00cf7a69-dcf7-45dd-9291-3e4d75ece0da\") " Mar 16 16:49:40 crc kubenswrapper[5120]: I0316 16:49:40.816573 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tx8rk\" (UniqueName: \"kubernetes.io/projected/00cf7a69-dcf7-45dd-9291-3e4d75ece0da-kube-api-access-tx8rk\") pod \"00cf7a69-dcf7-45dd-9291-3e4d75ece0da\" (UID: \"00cf7a69-dcf7-45dd-9291-3e4d75ece0da\") " Mar 16 16:49:40 crc kubenswrapper[5120]: I0316 16:49:40.816682 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/00cf7a69-dcf7-45dd-9291-3e4d75ece0da-combined-ca-bundle\") pod \"00cf7a69-dcf7-45dd-9291-3e4d75ece0da\" (UID: \"00cf7a69-dcf7-45dd-9291-3e4d75ece0da\") " Mar 16 16:49:40 crc kubenswrapper[5120]: I0316 16:49:40.816825 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/00cf7a69-dcf7-45dd-9291-3e4d75ece0da-httpd-run\") pod \"00cf7a69-dcf7-45dd-9291-3e4d75ece0da\" (UID: \"00cf7a69-dcf7-45dd-9291-3e4d75ece0da\") " Mar 16 16:49:40 crc kubenswrapper[5120]: I0316 16:49:40.816848 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"00cf7a69-dcf7-45dd-9291-3e4d75ece0da\" (UID: \"00cf7a69-dcf7-45dd-9291-3e4d75ece0da\") " Mar 16 16:49:40 crc kubenswrapper[5120]: I0316 16:49:40.817021 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/00cf7a69-dcf7-45dd-9291-3e4d75ece0da-config-data\") pod \"00cf7a69-dcf7-45dd-9291-3e4d75ece0da\" (UID: \"00cf7a69-dcf7-45dd-9291-3e4d75ece0da\") " Mar 16 16:49:40 crc kubenswrapper[5120]: I0316 16:49:40.817224 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/00cf7a69-dcf7-45dd-9291-3e4d75ece0da-logs\") pod \"00cf7a69-dcf7-45dd-9291-3e4d75ece0da\" (UID: \"00cf7a69-dcf7-45dd-9291-3e4d75ece0da\") " Mar 16 16:49:40 crc kubenswrapper[5120]: I0316 16:49:40.818090 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00cf7a69-dcf7-45dd-9291-3e4d75ece0da-logs" (OuterVolumeSpecName: "logs") pod "00cf7a69-dcf7-45dd-9291-3e4d75ece0da" (UID: "00cf7a69-dcf7-45dd-9291-3e4d75ece0da"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:49:40 crc kubenswrapper[5120]: I0316 16:49:40.823129 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/00cf7a69-dcf7-45dd-9291-3e4d75ece0da-scripts" (OuterVolumeSpecName: "scripts") pod "00cf7a69-dcf7-45dd-9291-3e4d75ece0da" (UID: "00cf7a69-dcf7-45dd-9291-3e4d75ece0da"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:49:40 crc kubenswrapper[5120]: I0316 16:49:40.823317 5120 scope.go:117] "RemoveContainer" containerID="6ee451353950a7132e69bb0501c1336e4efe418735cba54a3fc794a9239eef2e" Mar 16 16:49:40 crc kubenswrapper[5120]: I0316 16:49:40.825254 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00cf7a69-dcf7-45dd-9291-3e4d75ece0da-kube-api-access-tx8rk" (OuterVolumeSpecName: "kube-api-access-tx8rk") pod "00cf7a69-dcf7-45dd-9291-3e4d75ece0da" (UID: "00cf7a69-dcf7-45dd-9291-3e4d75ece0da"). InnerVolumeSpecName "kube-api-access-tx8rk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:49:40 crc kubenswrapper[5120]: I0316 16:49:40.826494 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00cf7a69-dcf7-45dd-9291-3e4d75ece0da-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "00cf7a69-dcf7-45dd-9291-3e4d75ece0da" (UID: "00cf7a69-dcf7-45dd-9291-3e4d75ece0da"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:49:40 crc kubenswrapper[5120]: I0316 16:49:40.826575 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:49:40 crc kubenswrapper[5120]: I0316 16:49:40.838303 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage01-crc" (OuterVolumeSpecName: "glance") pod "00cf7a69-dcf7-45dd-9291-3e4d75ece0da" (UID: "00cf7a69-dcf7-45dd-9291-3e4d75ece0da"). InnerVolumeSpecName "local-storage01-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:49:40 crc kubenswrapper[5120]: I0316 16:49:40.839844 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:49:40 crc kubenswrapper[5120]: I0316 16:49:40.841055 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00cf7a69-dcf7-45dd-9291-3e4d75ece0da" containerName="glance-log" Mar 16 16:49:40 crc kubenswrapper[5120]: I0316 16:49:40.841078 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="00cf7a69-dcf7-45dd-9291-3e4d75ece0da" containerName="glance-log" Mar 16 16:49:40 crc kubenswrapper[5120]: I0316 16:49:40.841140 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00cf7a69-dcf7-45dd-9291-3e4d75ece0da" containerName="glance-httpd" Mar 16 16:49:40 crc kubenswrapper[5120]: I0316 16:49:40.841147 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="00cf7a69-dcf7-45dd-9291-3e4d75ece0da" containerName="glance-httpd" Mar 16 16:49:40 crc kubenswrapper[5120]: I0316 16:49:40.841309 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="00cf7a69-dcf7-45dd-9291-3e4d75ece0da" containerName="glance-httpd" Mar 16 16:49:40 crc kubenswrapper[5120]: I0316 16:49:40.841328 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="00cf7a69-dcf7-45dd-9291-3e4d75ece0da" containerName="glance-log" Mar 16 16:49:40 crc kubenswrapper[5120]: I0316 16:49:40.855723 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/00cf7a69-dcf7-45dd-9291-3e4d75ece0da-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "00cf7a69-dcf7-45dd-9291-3e4d75ece0da" (UID: "00cf7a69-dcf7-45dd-9291-3e4d75ece0da"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:49:40 crc kubenswrapper[5120]: I0316 16:49:40.867350 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:49:40 crc kubenswrapper[5120]: I0316 16:49:40.867505 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:49:40 crc kubenswrapper[5120]: I0316 16:49:40.875540 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-metadata-config-data\"" Mar 16 16:49:40 crc kubenswrapper[5120]: I0316 16:49:40.918190 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_1ea30b51-1d30-4a53-834a-264069b9566e/ovsdbserver-nb/0.log" Mar 16 16:49:40 crc kubenswrapper[5120]: I0316 16:49:40.918274 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:49:40 crc kubenswrapper[5120]: I0316 16:49:40.919216 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/77fd10d5-5894-450f-bba5-8261c3ca1b4e-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"77fd10d5-5894-450f-bba5-8261c3ca1b4e\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:49:40 crc kubenswrapper[5120]: I0316 16:49:40.919319 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/77fd10d5-5894-450f-bba5-8261c3ca1b4e-config-data\") pod \"nova-metadata-0\" (UID: \"77fd10d5-5894-450f-bba5-8261c3ca1b4e\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:49:40 crc kubenswrapper[5120]: I0316 16:49:40.919403 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bcjb\" (UniqueName: \"kubernetes.io/projected/77fd10d5-5894-450f-bba5-8261c3ca1b4e-kube-api-access-6bcjb\") pod \"nova-metadata-0\" (UID: \"77fd10d5-5894-450f-bba5-8261c3ca1b4e\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:49:40 crc kubenswrapper[5120]: I0316 16:49:40.919982 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/77fd10d5-5894-450f-bba5-8261c3ca1b4e-logs\") pod \"nova-metadata-0\" (UID: \"77fd10d5-5894-450f-bba5-8261c3ca1b4e\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:49:40 crc kubenswrapper[5120]: I0316 16:49:40.920139 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/00cf7a69-dcf7-45dd-9291-3e4d75ece0da-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:40 crc kubenswrapper[5120]: I0316 16:49:40.920164 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tx8rk\" (UniqueName: \"kubernetes.io/projected/00cf7a69-dcf7-45dd-9291-3e4d75ece0da-kube-api-access-tx8rk\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:40 crc kubenswrapper[5120]: I0316 16:49:40.920185 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/00cf7a69-dcf7-45dd-9291-3e4d75ece0da-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:40 crc kubenswrapper[5120]: I0316 16:49:40.920199 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/00cf7a69-dcf7-45dd-9291-3e4d75ece0da-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:40 crc kubenswrapper[5120]: I0316 16:49:40.920223 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") on node \"crc\" " Mar 16 16:49:40 crc kubenswrapper[5120]: I0316 16:49:40.920235 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/00cf7a69-dcf7-45dd-9291-3e4d75ece0da-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:40 crc kubenswrapper[5120]: I0316 16:49:40.976615 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/00cf7a69-dcf7-45dd-9291-3e4d75ece0da-config-data" (OuterVolumeSpecName: "config-data") pod "00cf7a69-dcf7-45dd-9291-3e4d75ece0da" (UID: "00cf7a69-dcf7-45dd-9291-3e4d75ece0da"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:49:40 crc kubenswrapper[5120]: I0316 16:49:40.990029 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage01-crc" (UniqueName: "kubernetes.io/local-volume/local-storage01-crc") on node "crc" Mar 16 16:49:41 crc kubenswrapper[5120]: I0316 16:49:41.024124 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovndbcluster-nb-etc-ovn\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") pod \"1ea30b51-1d30-4a53-834a-264069b9566e\" (UID: \"1ea30b51-1d30-4a53-834a-264069b9566e\") " Mar 16 16:49:41 crc kubenswrapper[5120]: I0316 16:49:41.024982 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1ea30b51-1d30-4a53-834a-264069b9566e-combined-ca-bundle\") pod \"1ea30b51-1d30-4a53-834a-264069b9566e\" (UID: \"1ea30b51-1d30-4a53-834a-264069b9566e\") " Mar 16 16:49:41 crc kubenswrapper[5120]: I0316 16:49:41.025082 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/1ea30b51-1d30-4a53-834a-264069b9566e-ovsdb-rundir\") pod \"1ea30b51-1d30-4a53-834a-264069b9566e\" (UID: \"1ea30b51-1d30-4a53-834a-264069b9566e\") " Mar 16 16:49:41 crc kubenswrapper[5120]: I0316 16:49:41.025127 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1ea30b51-1d30-4a53-834a-264069b9566e-config\") pod \"1ea30b51-1d30-4a53-834a-264069b9566e\" (UID: \"1ea30b51-1d30-4a53-834a-264069b9566e\") " Mar 16 16:49:41 crc kubenswrapper[5120]: I0316 16:49:41.025249 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wpr8m\" (UniqueName: \"kubernetes.io/projected/1ea30b51-1d30-4a53-834a-264069b9566e-kube-api-access-wpr8m\") pod \"1ea30b51-1d30-4a53-834a-264069b9566e\" (UID: \"1ea30b51-1d30-4a53-834a-264069b9566e\") " Mar 16 16:49:41 crc kubenswrapper[5120]: I0316 16:49:41.025637 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ea30b51-1d30-4a53-834a-264069b9566e-ovsdb-rundir" (OuterVolumeSpecName: "ovsdb-rundir") pod "1ea30b51-1d30-4a53-834a-264069b9566e" (UID: "1ea30b51-1d30-4a53-834a-264069b9566e"). InnerVolumeSpecName "ovsdb-rundir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:49:41 crc kubenswrapper[5120]: I0316 16:49:41.025678 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/1ea30b51-1d30-4a53-834a-264069b9566e-scripts\") pod \"1ea30b51-1d30-4a53-834a-264069b9566e\" (UID: \"1ea30b51-1d30-4a53-834a-264069b9566e\") " Mar 16 16:49:41 crc kubenswrapper[5120]: I0316 16:49:41.025866 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ea30b51-1d30-4a53-834a-264069b9566e-config" (OuterVolumeSpecName: "config") pod "1ea30b51-1d30-4a53-834a-264069b9566e" (UID: "1ea30b51-1d30-4a53-834a-264069b9566e"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:49:41 crc kubenswrapper[5120]: I0316 16:49:41.026119 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ea30b51-1d30-4a53-834a-264069b9566e-scripts" (OuterVolumeSpecName: "scripts") pod "1ea30b51-1d30-4a53-834a-264069b9566e" (UID: "1ea30b51-1d30-4a53-834a-264069b9566e"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:49:41 crc kubenswrapper[5120]: I0316 16:49:41.026612 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/77fd10d5-5894-450f-bba5-8261c3ca1b4e-logs\") pod \"nova-metadata-0\" (UID: \"77fd10d5-5894-450f-bba5-8261c3ca1b4e\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:49:41 crc kubenswrapper[5120]: I0316 16:49:41.026207 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/77fd10d5-5894-450f-bba5-8261c3ca1b4e-logs\") pod \"nova-metadata-0\" (UID: \"77fd10d5-5894-450f-bba5-8261c3ca1b4e\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:49:41 crc kubenswrapper[5120]: I0316 16:49:41.027207 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/77fd10d5-5894-450f-bba5-8261c3ca1b4e-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"77fd10d5-5894-450f-bba5-8261c3ca1b4e\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:49:41 crc kubenswrapper[5120]: I0316 16:49:41.027441 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/77fd10d5-5894-450f-bba5-8261c3ca1b4e-config-data\") pod \"nova-metadata-0\" (UID: \"77fd10d5-5894-450f-bba5-8261c3ca1b4e\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:49:41 crc kubenswrapper[5120]: I0316 16:49:41.027655 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6bcjb\" (UniqueName: \"kubernetes.io/projected/77fd10d5-5894-450f-bba5-8261c3ca1b4e-kube-api-access-6bcjb\") pod \"nova-metadata-0\" (UID: \"77fd10d5-5894-450f-bba5-8261c3ca1b4e\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:49:41 crc kubenswrapper[5120]: I0316 16:49:41.027987 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:41 crc kubenswrapper[5120]: I0316 16:49:41.028013 5120 reconciler_common.go:299] "Volume detached for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/1ea30b51-1d30-4a53-834a-264069b9566e-ovsdb-rundir\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:41 crc kubenswrapper[5120]: I0316 16:49:41.028030 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1ea30b51-1d30-4a53-834a-264069b9566e-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:41 crc kubenswrapper[5120]: I0316 16:49:41.028041 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/00cf7a69-dcf7-45dd-9291-3e4d75ece0da-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:41 crc kubenswrapper[5120]: I0316 16:49:41.028053 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/1ea30b51-1d30-4a53-834a-264069b9566e-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:41 crc kubenswrapper[5120]: I0316 16:49:41.028613 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage17-crc" (OuterVolumeSpecName: "ovndbcluster-nb-etc-ovn") pod "1ea30b51-1d30-4a53-834a-264069b9566e" (UID: "1ea30b51-1d30-4a53-834a-264069b9566e"). InnerVolumeSpecName "local-storage17-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:49:41 crc kubenswrapper[5120]: I0316 16:49:41.033405 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/77fd10d5-5894-450f-bba5-8261c3ca1b4e-config-data\") pod \"nova-metadata-0\" (UID: \"77fd10d5-5894-450f-bba5-8261c3ca1b4e\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:49:41 crc kubenswrapper[5120]: I0316 16:49:41.036073 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ea30b51-1d30-4a53-834a-264069b9566e-kube-api-access-wpr8m" (OuterVolumeSpecName: "kube-api-access-wpr8m") pod "1ea30b51-1d30-4a53-834a-264069b9566e" (UID: "1ea30b51-1d30-4a53-834a-264069b9566e"). InnerVolumeSpecName "kube-api-access-wpr8m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:49:41 crc kubenswrapper[5120]: I0316 16:49:41.036992 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/77fd10d5-5894-450f-bba5-8261c3ca1b4e-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"77fd10d5-5894-450f-bba5-8261c3ca1b4e\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:49:41 crc kubenswrapper[5120]: I0316 16:49:41.065046 5120 scope.go:117] "RemoveContainer" containerID="2def4dceb4ba620f3875201d8253e69fd705949b2567eee3de227d80401cf93b" Mar 16 16:49:41 crc kubenswrapper[5120]: I0316 16:49:41.093788 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bcjb\" (UniqueName: \"kubernetes.io/projected/77fd10d5-5894-450f-bba5-8261c3ca1b4e-kube-api-access-6bcjb\") pod \"nova-metadata-0\" (UID: \"77fd10d5-5894-450f-bba5-8261c3ca1b4e\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:49:41 crc kubenswrapper[5120]: I0316 16:49:41.101598 5120 scope.go:117] "RemoveContainer" containerID="c58ce299fe1cdb3dcbe143284d5e0efe2c90efc37550b5f03322b2bea2cf9a71" Mar 16 16:49:41 crc kubenswrapper[5120]: I0316 16:49:41.135431 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") on node \"crc\" " Mar 16 16:49:41 crc kubenswrapper[5120]: I0316 16:49:41.135475 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wpr8m\" (UniqueName: \"kubernetes.io/projected/1ea30b51-1d30-4a53-834a-264069b9566e-kube-api-access-wpr8m\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:41 crc kubenswrapper[5120]: I0316 16:49:41.144324 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ea30b51-1d30-4a53-834a-264069b9566e-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "1ea30b51-1d30-4a53-834a-264069b9566e" (UID: "1ea30b51-1d30-4a53-834a-264069b9566e"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:49:41 crc kubenswrapper[5120]: I0316 16:49:41.159706 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage17-crc" (UniqueName: "kubernetes.io/local-volume/local-storage17-crc") on node "crc" Mar 16 16:49:41 crc kubenswrapper[5120]: I0316 16:49:41.238221 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:41 crc kubenswrapper[5120]: I0316 16:49:41.238563 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1ea30b51-1d30-4a53-834a-264069b9566e-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:41 crc kubenswrapper[5120]: I0316 16:49:41.241930 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:49:41 crc kubenswrapper[5120]: I0316 16:49:41.339428 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/07aa860b-bb17-4a36-bc23-549bfd1bdb5c-rabbitmq-erlang-cookie\") pod \"07aa860b-bb17-4a36-bc23-549bfd1bdb5c\" (UID: \"07aa860b-bb17-4a36-bc23-549bfd1bdb5c\") " Mar 16 16:49:41 crc kubenswrapper[5120]: I0316 16:49:41.339556 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/07aa860b-bb17-4a36-bc23-549bfd1bdb5c-rabbitmq-plugins\") pod \"07aa860b-bb17-4a36-bc23-549bfd1bdb5c\" (UID: \"07aa860b-bb17-4a36-bc23-549bfd1bdb5c\") " Mar 16 16:49:41 crc kubenswrapper[5120]: I0316 16:49:41.339614 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/07aa860b-bb17-4a36-bc23-549bfd1bdb5c-pod-info\") pod \"07aa860b-bb17-4a36-bc23-549bfd1bdb5c\" (UID: \"07aa860b-bb17-4a36-bc23-549bfd1bdb5c\") " Mar 16 16:49:41 crc kubenswrapper[5120]: I0316 16:49:41.339663 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/07aa860b-bb17-4a36-bc23-549bfd1bdb5c-rabbitmq-confd\") pod \"07aa860b-bb17-4a36-bc23-549bfd1bdb5c\" (UID: \"07aa860b-bb17-4a36-bc23-549bfd1bdb5c\") " Mar 16 16:49:41 crc kubenswrapper[5120]: I0316 16:49:41.339741 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/07aa860b-bb17-4a36-bc23-549bfd1bdb5c-erlang-cookie-secret\") pod \"07aa860b-bb17-4a36-bc23-549bfd1bdb5c\" (UID: \"07aa860b-bb17-4a36-bc23-549bfd1bdb5c\") " Mar 16 16:49:41 crc kubenswrapper[5120]: I0316 16:49:41.340294 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07aa860b-bb17-4a36-bc23-549bfd1bdb5c-rabbitmq-plugins" (OuterVolumeSpecName: "rabbitmq-plugins") pod "07aa860b-bb17-4a36-bc23-549bfd1bdb5c" (UID: "07aa860b-bb17-4a36-bc23-549bfd1bdb5c"). InnerVolumeSpecName "rabbitmq-plugins". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:49:41 crc kubenswrapper[5120]: I0316 16:49:41.348476 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07aa860b-bb17-4a36-bc23-549bfd1bdb5c-rabbitmq-erlang-cookie" (OuterVolumeSpecName: "rabbitmq-erlang-cookie") pod "07aa860b-bb17-4a36-bc23-549bfd1bdb5c" (UID: "07aa860b-bb17-4a36-bc23-549bfd1bdb5c"). InnerVolumeSpecName "rabbitmq-erlang-cookie". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:49:41 crc kubenswrapper[5120]: I0316 16:49:41.348864 5120 scope.go:117] "RemoveContainer" containerID="10e209dfe1f9708e3d21b9b100a91d59bd982ee2a4aa40b2c08c2b1ccd44b1c0" Mar 16 16:49:41 crc kubenswrapper[5120]: I0316 16:49:41.353360 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"persistence\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") pod \"07aa860b-bb17-4a36-bc23-549bfd1bdb5c\" (UID: \"07aa860b-bb17-4a36-bc23-549bfd1bdb5c\") " Mar 16 16:49:41 crc kubenswrapper[5120]: I0316 16:49:41.353465 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/07aa860b-bb17-4a36-bc23-549bfd1bdb5c-server-conf\") pod \"07aa860b-bb17-4a36-bc23-549bfd1bdb5c\" (UID: \"07aa860b-bb17-4a36-bc23-549bfd1bdb5c\") " Mar 16 16:49:41 crc kubenswrapper[5120]: I0316 16:49:41.353523 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l4ldd\" (UniqueName: \"kubernetes.io/projected/07aa860b-bb17-4a36-bc23-549bfd1bdb5c-kube-api-access-l4ldd\") pod \"07aa860b-bb17-4a36-bc23-549bfd1bdb5c\" (UID: \"07aa860b-bb17-4a36-bc23-549bfd1bdb5c\") " Mar 16 16:49:41 crc kubenswrapper[5120]: I0316 16:49:41.353928 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/07aa860b-bb17-4a36-bc23-549bfd1bdb5c-plugins-conf\") pod \"07aa860b-bb17-4a36-bc23-549bfd1bdb5c\" (UID: \"07aa860b-bb17-4a36-bc23-549bfd1bdb5c\") " Mar 16 16:49:41 crc kubenswrapper[5120]: I0316 16:49:41.354768 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/07aa860b-bb17-4a36-bc23-549bfd1bdb5c-rabbitmq-erlang-cookie\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:41 crc kubenswrapper[5120]: I0316 16:49:41.354787 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/07aa860b-bb17-4a36-bc23-549bfd1bdb5c-rabbitmq-plugins\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:41 crc kubenswrapper[5120]: I0316 16:49:41.357588 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/07aa860b-bb17-4a36-bc23-549bfd1bdb5c-plugins-conf" (OuterVolumeSpecName: "plugins-conf") pod "07aa860b-bb17-4a36-bc23-549bfd1bdb5c" (UID: "07aa860b-bb17-4a36-bc23-549bfd1bdb5c"). InnerVolumeSpecName "plugins-conf". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:49:41 crc kubenswrapper[5120]: I0316 16:49:41.365399 5120 scope.go:117] "RemoveContainer" containerID="abcc80872762df0d1cfbaa3fc4ee7102269763a95ca5fd3084ec39f82e0cafdb" Mar 16 16:49:41 crc kubenswrapper[5120]: I0316 16:49:41.365909 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/07aa860b-bb17-4a36-bc23-549bfd1bdb5c-pod-info" (OuterVolumeSpecName: "pod-info") pod "07aa860b-bb17-4a36-bc23-549bfd1bdb5c" (UID: "07aa860b-bb17-4a36-bc23-549bfd1bdb5c"). InnerVolumeSpecName "pod-info". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Mar 16 16:49:41 crc kubenswrapper[5120]: I0316 16:49:41.371983 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07aa860b-bb17-4a36-bc23-549bfd1bdb5c-kube-api-access-l4ldd" (OuterVolumeSpecName: "kube-api-access-l4ldd") pod "07aa860b-bb17-4a36-bc23-549bfd1bdb5c" (UID: "07aa860b-bb17-4a36-bc23-549bfd1bdb5c"). InnerVolumeSpecName "kube-api-access-l4ldd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:49:41 crc kubenswrapper[5120]: I0316 16:49:41.382714 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage18-crc" (OuterVolumeSpecName: "persistence") pod "07aa860b-bb17-4a36-bc23-549bfd1bdb5c" (UID: "07aa860b-bb17-4a36-bc23-549bfd1bdb5c"). InnerVolumeSpecName "local-storage18-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:49:41 crc kubenswrapper[5120]: I0316 16:49:41.382867 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07aa860b-bb17-4a36-bc23-549bfd1bdb5c-erlang-cookie-secret" (OuterVolumeSpecName: "erlang-cookie-secret") pod "07aa860b-bb17-4a36-bc23-549bfd1bdb5c" (UID: "07aa860b-bb17-4a36-bc23-549bfd1bdb5c"). InnerVolumeSpecName "erlang-cookie-secret". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:49:41 crc kubenswrapper[5120]: I0316 16:49:41.414895 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/07aa860b-bb17-4a36-bc23-549bfd1bdb5c-server-conf" (OuterVolumeSpecName: "server-conf") pod "07aa860b-bb17-4a36-bc23-549bfd1bdb5c" (UID: "07aa860b-bb17-4a36-bc23-549bfd1bdb5c"). InnerVolumeSpecName "server-conf". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:49:41 crc kubenswrapper[5120]: I0316 16:49:41.457952 5120 reconciler_common.go:299] "Volume detached for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/07aa860b-bb17-4a36-bc23-549bfd1bdb5c-plugins-conf\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:41 crc kubenswrapper[5120]: I0316 16:49:41.458257 5120 reconciler_common.go:299] "Volume detached for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/07aa860b-bb17-4a36-bc23-549bfd1bdb5c-pod-info\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:41 crc kubenswrapper[5120]: I0316 16:49:41.458375 5120 reconciler_common.go:299] "Volume detached for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/07aa860b-bb17-4a36-bc23-549bfd1bdb5c-erlang-cookie-secret\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:41 crc kubenswrapper[5120]: I0316 16:49:41.458529 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage18-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") on node \"crc\" " Mar 16 16:49:41 crc kubenswrapper[5120]: I0316 16:49:41.458664 5120 reconciler_common.go:299] "Volume detached for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/07aa860b-bb17-4a36-bc23-549bfd1bdb5c-server-conf\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:41 crc kubenswrapper[5120]: I0316 16:49:41.458805 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l4ldd\" (UniqueName: \"kubernetes.io/projected/07aa860b-bb17-4a36-bc23-549bfd1bdb5c-kube-api-access-l4ldd\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:41 crc kubenswrapper[5120]: I0316 16:49:41.540179 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage18-crc" (UniqueName: "kubernetes.io/local-volume/local-storage18-crc") on node "crc" Mar 16 16:49:41 crc kubenswrapper[5120]: I0316 16:49:41.561999 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage18-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:41 crc kubenswrapper[5120]: I0316 16:49:41.597338 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:49:41 crc kubenswrapper[5120]: I0316 16:49:41.606503 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-5d966495c9-4n5ss" Mar 16 16:49:41 crc kubenswrapper[5120]: I0316 16:49:41.628000 5120 scope.go:117] "RemoveContainer" containerID="a96a0a1cebbfc0e08bfd7e404ebb107b0a0392a1007e54716f743992433ae538" Mar 16 16:49:41 crc kubenswrapper[5120]: I0316 16:49:41.638640 5120 scope.go:117] "RemoveContainer" containerID="c58db8625c8fa139b58596a9b64d009fd72fbf9ea6ce1858fb7fd48fe833e794" Mar 16 16:49:41 crc kubenswrapper[5120]: I0316 16:49:41.686809 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gtlg8\" (UniqueName: \"kubernetes.io/projected/7872e738-4d0c-48dd-952c-d878aafc51af-kube-api-access-gtlg8\") pod \"7872e738-4d0c-48dd-952c-d878aafc51af\" (UID: \"7872e738-4d0c-48dd-952c-d878aafc51af\") " Mar 16 16:49:41 crc kubenswrapper[5120]: I0316 16:49:41.686929 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7872e738-4d0c-48dd-952c-d878aafc51af-combined-ca-bundle\") pod \"7872e738-4d0c-48dd-952c-d878aafc51af\" (UID: \"7872e738-4d0c-48dd-952c-d878aafc51af\") " Mar 16 16:49:41 crc kubenswrapper[5120]: I0316 16:49:41.687090 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7872e738-4d0c-48dd-952c-d878aafc51af-config-data\") pod \"7872e738-4d0c-48dd-952c-d878aafc51af\" (UID: \"7872e738-4d0c-48dd-952c-d878aafc51af\") " Mar 16 16:49:41 crc kubenswrapper[5120]: I0316 16:49:41.687155 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7872e738-4d0c-48dd-952c-d878aafc51af-logs\") pod \"7872e738-4d0c-48dd-952c-d878aafc51af\" (UID: \"7872e738-4d0c-48dd-952c-d878aafc51af\") " Mar 16 16:49:41 crc kubenswrapper[5120]: I0316 16:49:41.687263 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/7872e738-4d0c-48dd-952c-d878aafc51af-config-data-custom\") pod \"7872e738-4d0c-48dd-952c-d878aafc51af\" (UID: \"7872e738-4d0c-48dd-952c-d878aafc51af\") " Mar 16 16:49:41 crc kubenswrapper[5120]: I0316 16:49:41.696244 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7872e738-4d0c-48dd-952c-d878aafc51af-logs" (OuterVolumeSpecName: "logs") pod "7872e738-4d0c-48dd-952c-d878aafc51af" (UID: "7872e738-4d0c-48dd-952c-d878aafc51af"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:49:41 crc kubenswrapper[5120]: I0316 16:49:41.716143 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"243f6b1f-595b-44eb-aaa5-0b3df41c88c1","Type":"ContainerStarted","Data":"3ae202ea0f0a4566831c4712a39b08992086f44465f4ad6f31062d4721860630"} Mar 16 16:49:41 crc kubenswrapper[5120]: I0316 16:49:41.717294 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/memcached-0" Mar 16 16:49:41 crc kubenswrapper[5120]: I0316 16:49:41.717428 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:49:41 crc kubenswrapper[5120]: I0316 16:49:41.720667 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:49:41 crc kubenswrapper[5120]: I0316 16:49:41.720900 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:49:41 crc kubenswrapper[5120]: I0316 16:49:41.721232 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-5d966495c9-4n5ss" Mar 16 16:49:41 crc kubenswrapper[5120]: I0316 16:49:41.722622 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7872e738-4d0c-48dd-952c-d878aafc51af-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "7872e738-4d0c-48dd-952c-d878aafc51af" (UID: "7872e738-4d0c-48dd-952c-d878aafc51af"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:49:41 crc kubenswrapper[5120]: I0316 16:49:41.740071 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7872e738-4d0c-48dd-952c-d878aafc51af-kube-api-access-gtlg8" (OuterVolumeSpecName: "kube-api-access-gtlg8") pod "7872e738-4d0c-48dd-952c-d878aafc51af" (UID: "7872e738-4d0c-48dd-952c-d878aafc51af"). InnerVolumeSpecName "kube-api-access-gtlg8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:49:41 crc kubenswrapper[5120]: I0316 16:49:41.749016 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/memcached-0" podStartSLOduration=8.748998383 podStartE2EDuration="8.748998383s" podCreationTimestamp="2026-03-16 16:49:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:49:41.740610663 +0000 UTC m=+4683.894542320" watchObservedRunningTime="2026-03-16 16:49:41.748998383 +0000 UTC m=+4683.902930040" Mar 16 16:49:41 crc kubenswrapper[5120]: I0316 16:49:41.791920 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gtlg8\" (UniqueName: \"kubernetes.io/projected/7872e738-4d0c-48dd-952c-d878aafc51af-kube-api-access-gtlg8\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:41 crc kubenswrapper[5120]: I0316 16:49:41.791948 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7872e738-4d0c-48dd-952c-d878aafc51af-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:41 crc kubenswrapper[5120]: I0316 16:49:41.791962 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/7872e738-4d0c-48dd-952c-d878aafc51af-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:41 crc kubenswrapper[5120]: I0316 16:49:41.895910 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7872e738-4d0c-48dd-952c-d878aafc51af-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "7872e738-4d0c-48dd-952c-d878aafc51af" (UID: "7872e738-4d0c-48dd-952c-d878aafc51af"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:49:41 crc kubenswrapper[5120]: I0316 16:49:41.909742 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7872e738-4d0c-48dd-952c-d878aafc51af-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:42 crc kubenswrapper[5120]: I0316 16:49:42.193944 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7872e738-4d0c-48dd-952c-d878aafc51af-config-data" (OuterVolumeSpecName: "config-data") pod "7872e738-4d0c-48dd-952c-d878aafc51af" (UID: "7872e738-4d0c-48dd-952c-d878aafc51af"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:49:42 crc kubenswrapper[5120]: I0316 16:49:42.218243 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7872e738-4d0c-48dd-952c-d878aafc51af-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:42 crc kubenswrapper[5120]: I0316 16:49:42.272603 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07aa860b-bb17-4a36-bc23-549bfd1bdb5c-rabbitmq-confd" (OuterVolumeSpecName: "rabbitmq-confd") pod "07aa860b-bb17-4a36-bc23-549bfd1bdb5c" (UID: "07aa860b-bb17-4a36-bc23-549bfd1bdb5c"). InnerVolumeSpecName "rabbitmq-confd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:49:42 crc kubenswrapper[5120]: I0316 16:49:42.321693 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/07aa860b-bb17-4a36-bc23-549bfd1bdb5c-rabbitmq-confd\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:42 crc kubenswrapper[5120]: I0316 16:49:42.331681 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:49:42 crc kubenswrapper[5120]: I0316 16:49:42.453730 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:49:42 crc kubenswrapper[5120]: I0316 16:49:42.470106 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-77bbc99f7d-fbdfw" Mar 16 16:49:42 crc kubenswrapper[5120]: W0316 16:49:42.495978 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3b14f53d_9d11_42e8_b823_65b88191e532.slice/crio-1970b0e40ef3c4ad9035016a3cd4de3a0bd8ae459d5382a39e1162295c194612 WatchSource:0}: Error finding container 1970b0e40ef3c4ad9035016a3cd4de3a0bd8ae459d5382a39e1162295c194612: Status 404 returned error can't find the container with id 1970b0e40ef3c4ad9035016a3cd4de3a0bd8ae459d5382a39e1162295c194612 Mar 16 16:49:42 crc kubenswrapper[5120]: I0316 16:49:42.531781 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7fdb0b94-e011-4907-9a1e-a67153d87979-logs\") pod \"7fdb0b94-e011-4907-9a1e-a67153d87979\" (UID: \"7fdb0b94-e011-4907-9a1e-a67153d87979\") " Mar 16 16:49:42 crc kubenswrapper[5120]: I0316 16:49:42.532870 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/aa12529b-b6fe-4512-88ec-fd6250636e6b-rabbitmq-confd\") pod \"aa12529b-b6fe-4512-88ec-fd6250636e6b\" (UID: \"aa12529b-b6fe-4512-88ec-fd6250636e6b\") " Mar 16 16:49:42 crc kubenswrapper[5120]: I0316 16:49:42.532722 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7fdb0b94-e011-4907-9a1e-a67153d87979-logs" (OuterVolumeSpecName: "logs") pod "7fdb0b94-e011-4907-9a1e-a67153d87979" (UID: "7fdb0b94-e011-4907-9a1e-a67153d87979"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:49:42 crc kubenswrapper[5120]: I0316 16:49:42.542201 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:49:42 crc kubenswrapper[5120]: I0316 16:49:42.548019 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/aa12529b-b6fe-4512-88ec-fd6250636e6b-server-conf\") pod \"aa12529b-b6fe-4512-88ec-fd6250636e6b\" (UID: \"aa12529b-b6fe-4512-88ec-fd6250636e6b\") " Mar 16 16:49:42 crc kubenswrapper[5120]: I0316 16:49:42.548227 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7fdb0b94-e011-4907-9a1e-a67153d87979-config-data\") pod \"7fdb0b94-e011-4907-9a1e-a67153d87979\" (UID: \"7fdb0b94-e011-4907-9a1e-a67153d87979\") " Mar 16 16:49:42 crc kubenswrapper[5120]: I0316 16:49:42.548373 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/7fdb0b94-e011-4907-9a1e-a67153d87979-config-data-custom\") pod \"7fdb0b94-e011-4907-9a1e-a67153d87979\" (UID: \"7fdb0b94-e011-4907-9a1e-a67153d87979\") " Mar 16 16:49:42 crc kubenswrapper[5120]: I0316 16:49:42.548491 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/aa12529b-b6fe-4512-88ec-fd6250636e6b-rabbitmq-erlang-cookie\") pod \"aa12529b-b6fe-4512-88ec-fd6250636e6b\" (UID: \"aa12529b-b6fe-4512-88ec-fd6250636e6b\") " Mar 16 16:49:42 crc kubenswrapper[5120]: I0316 16:49:42.548669 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/aa12529b-b6fe-4512-88ec-fd6250636e6b-plugins-conf\") pod \"aa12529b-b6fe-4512-88ec-fd6250636e6b\" (UID: \"aa12529b-b6fe-4512-88ec-fd6250636e6b\") " Mar 16 16:49:42 crc kubenswrapper[5120]: I0316 16:49:42.548788 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7fdb0b94-e011-4907-9a1e-a67153d87979-combined-ca-bundle\") pod \"7fdb0b94-e011-4907-9a1e-a67153d87979\" (UID: \"7fdb0b94-e011-4907-9a1e-a67153d87979\") " Mar 16 16:49:42 crc kubenswrapper[5120]: I0316 16:49:42.548903 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/aa12529b-b6fe-4512-88ec-fd6250636e6b-rabbitmq-plugins\") pod \"aa12529b-b6fe-4512-88ec-fd6250636e6b\" (UID: \"aa12529b-b6fe-4512-88ec-fd6250636e6b\") " Mar 16 16:49:42 crc kubenswrapper[5120]: I0316 16:49:42.549030 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-srqmm\" (UniqueName: \"kubernetes.io/projected/7fdb0b94-e011-4907-9a1e-a67153d87979-kube-api-access-srqmm\") pod \"7fdb0b94-e011-4907-9a1e-a67153d87979\" (UID: \"7fdb0b94-e011-4907-9a1e-a67153d87979\") " Mar 16 16:49:42 crc kubenswrapper[5120]: I0316 16:49:42.549205 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/aa12529b-b6fe-4512-88ec-fd6250636e6b-pod-info\") pod \"aa12529b-b6fe-4512-88ec-fd6250636e6b\" (UID: \"aa12529b-b6fe-4512-88ec-fd6250636e6b\") " Mar 16 16:49:42 crc kubenswrapper[5120]: I0316 16:49:42.549386 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8frxv\" (UniqueName: \"kubernetes.io/projected/aa12529b-b6fe-4512-88ec-fd6250636e6b-kube-api-access-8frxv\") pod \"aa12529b-b6fe-4512-88ec-fd6250636e6b\" (UID: \"aa12529b-b6fe-4512-88ec-fd6250636e6b\") " Mar 16 16:49:42 crc kubenswrapper[5120]: I0316 16:49:42.549520 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/aa12529b-b6fe-4512-88ec-fd6250636e6b-erlang-cookie-secret\") pod \"aa12529b-b6fe-4512-88ec-fd6250636e6b\" (UID: \"aa12529b-b6fe-4512-88ec-fd6250636e6b\") " Mar 16 16:49:42 crc kubenswrapper[5120]: I0316 16:49:42.549634 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"persistence\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"aa12529b-b6fe-4512-88ec-fd6250636e6b\" (UID: \"aa12529b-b6fe-4512-88ec-fd6250636e6b\") " Mar 16 16:49:42 crc kubenswrapper[5120]: I0316 16:49:42.559213 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa12529b-b6fe-4512-88ec-fd6250636e6b-rabbitmq-erlang-cookie" (OuterVolumeSpecName: "rabbitmq-erlang-cookie") pod "aa12529b-b6fe-4512-88ec-fd6250636e6b" (UID: "aa12529b-b6fe-4512-88ec-fd6250636e6b"). InnerVolumeSpecName "rabbitmq-erlang-cookie". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:49:42 crc kubenswrapper[5120]: I0316 16:49:42.559971 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa12529b-b6fe-4512-88ec-fd6250636e6b-plugins-conf" (OuterVolumeSpecName: "plugins-conf") pod "aa12529b-b6fe-4512-88ec-fd6250636e6b" (UID: "aa12529b-b6fe-4512-88ec-fd6250636e6b"). InnerVolumeSpecName "plugins-conf". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:49:42 crc kubenswrapper[5120]: I0316 16:49:42.561641 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/aa12529b-b6fe-4512-88ec-fd6250636e6b-rabbitmq-erlang-cookie\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:42 crc kubenswrapper[5120]: I0316 16:49:42.561755 5120 reconciler_common.go:299] "Volume detached for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/aa12529b-b6fe-4512-88ec-fd6250636e6b-plugins-conf\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:42 crc kubenswrapper[5120]: I0316 16:49:42.561867 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7fdb0b94-e011-4907-9a1e-a67153d87979-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:42 crc kubenswrapper[5120]: I0316 16:49:42.562041 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa12529b-b6fe-4512-88ec-fd6250636e6b-rabbitmq-plugins" (OuterVolumeSpecName: "rabbitmq-plugins") pod "aa12529b-b6fe-4512-88ec-fd6250636e6b" (UID: "aa12529b-b6fe-4512-88ec-fd6250636e6b"). InnerVolumeSpecName "rabbitmq-plugins". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:49:42 crc kubenswrapper[5120]: I0316 16:49:42.587010 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa12529b-b6fe-4512-88ec-fd6250636e6b-kube-api-access-8frxv" (OuterVolumeSpecName: "kube-api-access-8frxv") pod "aa12529b-b6fe-4512-88ec-fd6250636e6b" (UID: "aa12529b-b6fe-4512-88ec-fd6250636e6b"). InnerVolumeSpecName "kube-api-access-8frxv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:49:42 crc kubenswrapper[5120]: I0316 16:49:42.590310 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/aa12529b-b6fe-4512-88ec-fd6250636e6b-pod-info" (OuterVolumeSpecName: "pod-info") pod "aa12529b-b6fe-4512-88ec-fd6250636e6b" (UID: "aa12529b-b6fe-4512-88ec-fd6250636e6b"). InnerVolumeSpecName "pod-info". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Mar 16 16:49:42 crc kubenswrapper[5120]: I0316 16:49:42.610253 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:49:42 crc kubenswrapper[5120]: I0316 16:49:42.610420 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage12-crc" (OuterVolumeSpecName: "persistence") pod "aa12529b-b6fe-4512-88ec-fd6250636e6b" (UID: "aa12529b-b6fe-4512-88ec-fd6250636e6b"). InnerVolumeSpecName "local-storage12-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:49:42 crc kubenswrapper[5120]: I0316 16:49:42.610418 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aa12529b-b6fe-4512-88ec-fd6250636e6b-erlang-cookie-secret" (OuterVolumeSpecName: "erlang-cookie-secret") pod "aa12529b-b6fe-4512-88ec-fd6250636e6b" (UID: "aa12529b-b6fe-4512-88ec-fd6250636e6b"). InnerVolumeSpecName "erlang-cookie-secret". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:49:42 crc kubenswrapper[5120]: I0316 16:49:42.618990 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7fdb0b94-e011-4907-9a1e-a67153d87979-kube-api-access-srqmm" (OuterVolumeSpecName: "kube-api-access-srqmm") pod "7fdb0b94-e011-4907-9a1e-a67153d87979" (UID: "7fdb0b94-e011-4907-9a1e-a67153d87979"). InnerVolumeSpecName "kube-api-access-srqmm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:49:42 crc kubenswrapper[5120]: I0316 16:49:42.624890 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7fdb0b94-e011-4907-9a1e-a67153d87979-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "7fdb0b94-e011-4907-9a1e-a67153d87979" (UID: "7fdb0b94-e011-4907-9a1e-a67153d87979"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:49:42 crc kubenswrapper[5120]: I0316 16:49:42.653233 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:49:42 crc kubenswrapper[5120]: I0316 16:49:42.681772 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f3277ed1-d61b-491c-b6dc-1964a1422ea9-combined-ca-bundle\") pod \"f3277ed1-d61b-491c-b6dc-1964a1422ea9\" (UID: \"f3277ed1-d61b-491c-b6dc-1964a1422ea9\") " Mar 16 16:49:42 crc kubenswrapper[5120]: I0316 16:49:42.683048 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f3277ed1-d61b-491c-b6dc-1964a1422ea9-config-data\") pod \"f3277ed1-d61b-491c-b6dc-1964a1422ea9\" (UID: \"f3277ed1-d61b-491c-b6dc-1964a1422ea9\") " Mar 16 16:49:42 crc kubenswrapper[5120]: I0316 16:49:42.683091 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7g6cq\" (UniqueName: \"kubernetes.io/projected/f3277ed1-d61b-491c-b6dc-1964a1422ea9-kube-api-access-7g6cq\") pod \"f3277ed1-d61b-491c-b6dc-1964a1422ea9\" (UID: \"f3277ed1-d61b-491c-b6dc-1964a1422ea9\") " Mar 16 16:49:42 crc kubenswrapper[5120]: I0316 16:49:42.686206 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/7fdb0b94-e011-4907-9a1e-a67153d87979-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:42 crc kubenswrapper[5120]: I0316 16:49:42.686227 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/aa12529b-b6fe-4512-88ec-fd6250636e6b-rabbitmq-plugins\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:42 crc kubenswrapper[5120]: I0316 16:49:42.686236 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-srqmm\" (UniqueName: \"kubernetes.io/projected/7fdb0b94-e011-4907-9a1e-a67153d87979-kube-api-access-srqmm\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:42 crc kubenswrapper[5120]: I0316 16:49:42.686245 5120 reconciler_common.go:299] "Volume detached for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/aa12529b-b6fe-4512-88ec-fd6250636e6b-pod-info\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:42 crc kubenswrapper[5120]: I0316 16:49:42.686254 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8frxv\" (UniqueName: \"kubernetes.io/projected/aa12529b-b6fe-4512-88ec-fd6250636e6b-kube-api-access-8frxv\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:42 crc kubenswrapper[5120]: I0316 16:49:42.686262 5120 reconciler_common.go:299] "Volume detached for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/aa12529b-b6fe-4512-88ec-fd6250636e6b-erlang-cookie-secret\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:42 crc kubenswrapper[5120]: I0316 16:49:42.686287 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") on node \"crc\" " Mar 16 16:49:42 crc kubenswrapper[5120]: I0316 16:49:42.686572 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7fdb0b94-e011-4907-9a1e-a67153d87979-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "7fdb0b94-e011-4907-9a1e-a67153d87979" (UID: "7fdb0b94-e011-4907-9a1e-a67153d87979"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:49:42 crc kubenswrapper[5120]: I0316 16:49:42.786304 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-77797b894-rctcp" Mar 16 16:49:42 crc kubenswrapper[5120]: I0316 16:49:42.813970 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7fdb0b94-e011-4907-9a1e-a67153d87979-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:42 crc kubenswrapper[5120]: I0316 16:49:42.818518 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:49:42 crc kubenswrapper[5120]: I0316 16:49:42.820993 5120 scope.go:117] "RemoveContainer" containerID="73cb5da1aa4e0db6fc05d7ab18a073503756b66a6de287a0621f708490718f69" Mar 16 16:49:42 crc kubenswrapper[5120]: I0316 16:49:42.836712 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="00cf7a69-dcf7-45dd-9291-3e4d75ece0da" path="/var/lib/kubelet/pods/00cf7a69-dcf7-45dd-9291-3e4d75ece0da/volumes" Mar 16 16:49:42 crc kubenswrapper[5120]: I0316 16:49:42.837852 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a7864faa-1e6e-4644-a5f5-f51e429e1e2b" path="/var/lib/kubelet/pods/a7864faa-1e6e-4644-a5f5-f51e429e1e2b/volumes" Mar 16 16:49:42 crc kubenswrapper[5120]: I0316 16:49:42.866230 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7fdb0b94-e011-4907-9a1e-a67153d87979-config-data" (OuterVolumeSpecName: "config-data") pod "7fdb0b94-e011-4907-9a1e-a67153d87979" (UID: "7fdb0b94-e011-4907-9a1e-a67153d87979"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:49:42 crc kubenswrapper[5120]: I0316 16:49:42.907519 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3277ed1-d61b-491c-b6dc-1964a1422ea9-kube-api-access-7g6cq" (OuterVolumeSpecName: "kube-api-access-7g6cq") pod "f3277ed1-d61b-491c-b6dc-1964a1422ea9" (UID: "f3277ed1-d61b-491c-b6dc-1964a1422ea9"). InnerVolumeSpecName "kube-api-access-7g6cq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:49:42 crc kubenswrapper[5120]: I0316 16:49:42.922448 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7fdb0b94-e011-4907-9a1e-a67153d87979-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:42 crc kubenswrapper[5120]: I0316 16:49:42.922493 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7g6cq\" (UniqueName: \"kubernetes.io/projected/f3277ed1-d61b-491c-b6dc-1964a1422ea9-kube-api-access-7g6cq\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:42 crc kubenswrapper[5120]: I0316 16:49:42.940564 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa12529b-b6fe-4512-88ec-fd6250636e6b-server-conf" (OuterVolumeSpecName: "server-conf") pod "aa12529b-b6fe-4512-88ec-fd6250636e6b" (UID: "aa12529b-b6fe-4512-88ec-fd6250636e6b"). InnerVolumeSpecName "server-conf". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:49:42 crc kubenswrapper[5120]: I0316 16:49:42.989929 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3277ed1-d61b-491c-b6dc-1964a1422ea9-config-data" (OuterVolumeSpecName: "config-data") pod "f3277ed1-d61b-491c-b6dc-1964a1422ea9" (UID: "f3277ed1-d61b-491c-b6dc-1964a1422ea9"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.024604 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage12-crc" (UniqueName: "kubernetes.io/local-volume/local-storage12-crc") on node "crc" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.032818 5120 reconciler_common.go:299] "Volume detached for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/aa12529b-b6fe-4512-88ec-fd6250636e6b-server-conf\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.032851 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f3277ed1-d61b-491c-b6dc-1964a1422ea9-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.032861 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.051227 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-5c574fdfbb-8rvsq" podUID="8931787a-1e50-415c-8d97-6c2ab294b4f4" containerName="neutron-api" containerID="cri-o://d8e6f9c22bd7d66c182898a8c06b4817335fd2fd9d4c4e0036cdaca44ef91a73" gracePeriod=30 Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.051714 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-5c574fdfbb-8rvsq" podUID="8931787a-1e50-415c-8d97-6c2ab294b4f4" containerName="neutron-httpd" containerID="cri-o://7788939b5c6289f5f75e37cc4aa76bdcfb55dea29b690d9ac7eb291a4e844f06" gracePeriod=30 Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.084049 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"5f1fe655-07dd-4959-98ac-372e797369fa","Type":"ContainerStarted","Data":"a6f63c2438cda8e5c1e39916b22f7196bbe3ad25f488b320afd6a8e2d66d01b9"} Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.084343 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-678df6fbdb-lfhdz" event={"ID":"398bb1bd-f380-4374-b880-d7217d37e010","Type":"ContainerStarted","Data":"b932247b64920daaa5151fe9bb97c9f517c85a794047e555fbd45772a062a8e1"} Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.084366 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/neutron-678df6fbdb-lfhdz" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.084378 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/neutron-5c574fdfbb-8rvsq" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.084428 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-f5b8b4576-z8chc" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.084438 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.084456 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.085522 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7fdb0b94-e011-4907-9a1e-a67153d87979" containerName="barbican-keystone-listener-log" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.085538 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7fdb0b94-e011-4907-9a1e-a67153d87979" containerName="barbican-keystone-listener-log" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.085564 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa12529b-b6fe-4512-88ec-fd6250636e6b" containerName="rabbitmq" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.085569 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa12529b-b6fe-4512-88ec-fd6250636e6b" containerName="rabbitmq" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.085580 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ea30b51-1d30-4a53-834a-264069b9566e" containerName="ovsdbserver-nb" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.085586 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ea30b51-1d30-4a53-834a-264069b9566e" containerName="ovsdbserver-nb" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.085595 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7fdb0b94-e011-4907-9a1e-a67153d87979" containerName="barbican-keystone-listener" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.085600 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7fdb0b94-e011-4907-9a1e-a67153d87979" containerName="barbican-keystone-listener" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.085627 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07aa860b-bb17-4a36-bc23-549bfd1bdb5c" containerName="rabbitmq" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.085632 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="07aa860b-bb17-4a36-bc23-549bfd1bdb5c" containerName="rabbitmq" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.085644 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ea30b51-1d30-4a53-834a-264069b9566e" containerName="openstack-network-exporter" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.085649 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ea30b51-1d30-4a53-834a-264069b9566e" containerName="openstack-network-exporter" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.085667 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7872e738-4d0c-48dd-952c-d878aafc51af" containerName="barbican-worker" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.085673 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7872e738-4d0c-48dd-952c-d878aafc51af" containerName="barbican-worker" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.085682 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07aa860b-bb17-4a36-bc23-549bfd1bdb5c" containerName="setup-container" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.085687 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="07aa860b-bb17-4a36-bc23-549bfd1bdb5c" containerName="setup-container" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.085696 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3277ed1-d61b-491c-b6dc-1964a1422ea9" containerName="nova-cell0-conductor-conductor" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.085701 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3277ed1-d61b-491c-b6dc-1964a1422ea9" containerName="nova-cell0-conductor-conductor" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.085720 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7872e738-4d0c-48dd-952c-d878aafc51af" containerName="barbican-worker-log" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.085726 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7872e738-4d0c-48dd-952c-d878aafc51af" containerName="barbican-worker-log" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.085734 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa12529b-b6fe-4512-88ec-fd6250636e6b" containerName="setup-container" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.085739 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa12529b-b6fe-4512-88ec-fd6250636e6b" containerName="setup-container" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.087843 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7872e738-4d0c-48dd-952c-d878aafc51af" containerName="barbican-worker-log" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.087870 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7fdb0b94-e011-4907-9a1e-a67153d87979" containerName="barbican-keystone-listener-log" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.087888 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7872e738-4d0c-48dd-952c-d878aafc51af" containerName="barbican-worker" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.087902 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f3277ed1-d61b-491c-b6dc-1964a1422ea9" containerName="nova-cell0-conductor-conductor" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.087914 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1ea30b51-1d30-4a53-834a-264069b9566e" containerName="ovsdbserver-nb" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.087923 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="aa12529b-b6fe-4512-88ec-fd6250636e6b" containerName="rabbitmq" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.087936 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1ea30b51-1d30-4a53-834a-264069b9566e" containerName="openstack-network-exporter" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.087948 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="07aa860b-bb17-4a36-bc23-549bfd1bdb5c" containerName="rabbitmq" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.087960 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7fdb0b94-e011-4907-9a1e-a67153d87979" containerName="barbican-keystone-listener" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.091338 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3277ed1-d61b-491c-b6dc-1964a1422ea9-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f3277ed1-d61b-491c-b6dc-1964a1422ea9" (UID: "f3277ed1-d61b-491c-b6dc-1964a1422ea9"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.126134 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa12529b-b6fe-4512-88ec-fd6250636e6b-rabbitmq-confd" (OuterVolumeSpecName: "rabbitmq-confd") pod "aa12529b-b6fe-4512-88ec-fd6250636e6b" (UID: "aa12529b-b6fe-4512-88ec-fd6250636e6b"). InnerVolumeSpecName "rabbitmq-confd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.126773 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.126919 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.127558 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.127597 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.135910 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"bb689081-a0bf-445f-aa9f-12a38c98a269","Type":"ContainerStarted","Data":"923a669bca7315d4fb93e0c792a4a355ec7d35b80a15a8429162435af8939525"} Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.135946 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-5c574fdfbb-8rvsq" event={"ID":"8931787a-1e50-415c-8d97-6c2ab294b4f4","Type":"ContainerStarted","Data":"7788939b5c6289f5f75e37cc4aa76bdcfb55dea29b690d9ac7eb291a4e844f06"} Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.135965 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"2961edb8-5975-4d74-800e-732bed5d9791","Type":"ContainerStarted","Data":"583f5e8456c375c564641fbbd1cf323930ba07fd7dcce921278f431729b9f67f"} Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.135978 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.136078 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.136237 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-glance-dockercfg-6m2c9\"" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.136457 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-internal-config-data\"" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.136822 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-scripts\"" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.140624 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/aa12529b-b6fe-4512-88ec-fd6250636e6b-rabbitmq-confd\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.140645 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f3277ed1-d61b-491c-b6dc-1964a1422ea9-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.146173 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovndbcluster-nb-config\"" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.146199 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ovncluster-ovndbcluster-nb-dockercfg-6n6ct\"" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.146718 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovndbcluster-nb-scripts\"" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.146910 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ovndbcluster-nb-ovndbs\"" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.177401 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-7b66994cdb-4jkjq_011b06d9-6610-4fc7-97ab-697050a06ec4/neutron-api/0.log" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.177472 5120 generic.go:358] "Generic (PLEG): container finished" podID="011b06d9-6610-4fc7-97ab-697050a06ec4" containerID="72cf42ee5a1dd1662d5e629838f7321e79ca35c759f851acd86e0dcb0d0733a1" exitCode=1 Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.177716 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-7b66994cdb-4jkjq" event={"ID":"011b06d9-6610-4fc7-97ab-697050a06ec4","Type":"ContainerDied","Data":"72cf42ee5a1dd1662d5e629838f7321e79ca35c759f851acd86e0dcb0d0733a1"} Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.182641 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-7b66994cdb-4jkjq_011b06d9-6610-4fc7-97ab-697050a06ec4/neutron-api/0.log" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.182746 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-7b66994cdb-4jkjq" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.192899 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-5d966495c9-4n5ss"] Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.240595 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-b95f7696b-gs4k6" event={"ID":"370e78a7-6b53-4f13-aa62-8afa448a0b7d","Type":"ContainerStarted","Data":"da5f4edb49e75db3f4b00835e874103c3a616a2ae027795d81631b1e318afdda"} Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.240802 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-b95f7696b-gs4k6" podUID="370e78a7-6b53-4f13-aa62-8afa448a0b7d" containerName="neutron-api" containerID="cri-o://504b102dbe299e584d590a98680203d1fc45f024425a99a136dae5714a040b0c" gracePeriod=30 Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.241091 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-b95f7696b-gs4k6" podUID="370e78a7-6b53-4f13-aa62-8afa448a0b7d" containerName="neutron-httpd" containerID="cri-o://da5f4edb49e75db3f4b00835e874103c3a616a2ae027795d81631b1e318afdda" gracePeriod=30 Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.241174 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/neutron-b95f7696b-gs4k6" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.241995 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qgfjn\" (UniqueName: \"kubernetes.io/projected/011b06d9-6610-4fc7-97ab-697050a06ec4-kube-api-access-qgfjn\") pod \"011b06d9-6610-4fc7-97ab-697050a06ec4\" (UID: \"011b06d9-6610-4fc7-97ab-697050a06ec4\") " Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.242060 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/011b06d9-6610-4fc7-97ab-697050a06ec4-combined-ca-bundle\") pod \"011b06d9-6610-4fc7-97ab-697050a06ec4\" (UID: \"011b06d9-6610-4fc7-97ab-697050a06ec4\") " Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.242493 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/011b06d9-6610-4fc7-97ab-697050a06ec4-httpd-config\") pod \"011b06d9-6610-4fc7-97ab-697050a06ec4\" (UID: \"011b06d9-6610-4fc7-97ab-697050a06ec4\") " Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.242574 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/011b06d9-6610-4fc7-97ab-697050a06ec4-config\") pod \"011b06d9-6610-4fc7-97ab-697050a06ec4\" (UID: \"011b06d9-6610-4fc7-97ab-697050a06ec4\") " Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.242820 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wf2z4\" (UniqueName: \"kubernetes.io/projected/d6038d72-b1a2-4d71-b831-d5fa1de027a7-kube-api-access-wf2z4\") pod \"glance-default-internal-api-0\" (UID: \"d6038d72-b1a2-4d71-b831-d5fa1de027a7\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.242843 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") pod \"ovsdbserver-nb-0\" (UID: \"b0528e86-65e5-4d4c-9dd9-4cd6b9475cbc\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.242901 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/b0528e86-65e5-4d4c-9dd9-4cd6b9475cbc-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"b0528e86-65e5-4d4c-9dd9-4cd6b9475cbc\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.242923 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d6038d72-b1a2-4d71-b831-d5fa1de027a7-logs\") pod \"glance-default-internal-api-0\" (UID: \"d6038d72-b1a2-4d71-b831-d5fa1de027a7\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.242986 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d6038d72-b1a2-4d71-b831-d5fa1de027a7-scripts\") pod \"glance-default-internal-api-0\" (UID: \"d6038d72-b1a2-4d71-b831-d5fa1de027a7\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.243007 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/d6038d72-b1a2-4d71-b831-d5fa1de027a7-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"d6038d72-b1a2-4d71-b831-d5fa1de027a7\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.243056 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/b0528e86-65e5-4d4c-9dd9-4cd6b9475cbc-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"b0528e86-65e5-4d4c-9dd9-4cd6b9475cbc\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.243090 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/b0528e86-65e5-4d4c-9dd9-4cd6b9475cbc-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"b0528e86-65e5-4d4c-9dd9-4cd6b9475cbc\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.244037 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"glance-default-internal-api-0\" (UID: \"d6038d72-b1a2-4d71-b831-d5fa1de027a7\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.244061 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d6038d72-b1a2-4d71-b831-d5fa1de027a7-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"d6038d72-b1a2-4d71-b831-d5fa1de027a7\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.244126 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d6038d72-b1a2-4d71-b831-d5fa1de027a7-config-data\") pod \"glance-default-internal-api-0\" (UID: \"d6038d72-b1a2-4d71-b831-d5fa1de027a7\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.244164 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vwrj\" (UniqueName: \"kubernetes.io/projected/b0528e86-65e5-4d4c-9dd9-4cd6b9475cbc-kube-api-access-4vwrj\") pod \"ovsdbserver-nb-0\" (UID: \"b0528e86-65e5-4d4c-9dd9-4cd6b9475cbc\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.244220 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b0528e86-65e5-4d4c-9dd9-4cd6b9475cbc-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"b0528e86-65e5-4d4c-9dd9-4cd6b9475cbc\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.244258 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/b0528e86-65e5-4d4c-9dd9-4cd6b9475cbc-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"b0528e86-65e5-4d4c-9dd9-4cd6b9475cbc\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.244296 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b0528e86-65e5-4d4c-9dd9-4cd6b9475cbc-config\") pod \"ovsdbserver-nb-0\" (UID: \"b0528e86-65e5-4d4c-9dd9-4cd6b9475cbc\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.252274 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/011b06d9-6610-4fc7-97ab-697050a06ec4-httpd-config" (OuterVolumeSpecName: "httpd-config") pod "011b06d9-6610-4fc7-97ab-697050a06ec4" (UID: "011b06d9-6610-4fc7-97ab-697050a06ec4"). InnerVolumeSpecName "httpd-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.254661 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"3b14f53d-9d11-42e8-b823-65b88191e532","Type":"ContainerStarted","Data":"1970b0e40ef3c4ad9035016a3cd4de3a0bd8ae459d5382a39e1162295c194612"} Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.257888 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/011b06d9-6610-4fc7-97ab-697050a06ec4-kube-api-access-qgfjn" (OuterVolumeSpecName: "kube-api-access-qgfjn") pod "011b06d9-6610-4fc7-97ab-697050a06ec4" (UID: "011b06d9-6610-4fc7-97ab-697050a06ec4"). InnerVolumeSpecName "kube-api-access-qgfjn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.259959 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-77bbc99f7d-fbdfw" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.261108 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.264183 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.266090 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-worker-5d966495c9-4n5ss"] Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.301830 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.331966 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.347253 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d6038d72-b1a2-4d71-b831-d5fa1de027a7-logs\") pod \"glance-default-internal-api-0\" (UID: \"d6038d72-b1a2-4d71-b831-d5fa1de027a7\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.347502 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d6038d72-b1a2-4d71-b831-d5fa1de027a7-scripts\") pod \"glance-default-internal-api-0\" (UID: \"d6038d72-b1a2-4d71-b831-d5fa1de027a7\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.347666 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/d6038d72-b1a2-4d71-b831-d5fa1de027a7-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"d6038d72-b1a2-4d71-b831-d5fa1de027a7\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.347819 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d6038d72-b1a2-4d71-b831-d5fa1de027a7-logs\") pod \"glance-default-internal-api-0\" (UID: \"d6038d72-b1a2-4d71-b831-d5fa1de027a7\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.347934 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/b0528e86-65e5-4d4c-9dd9-4cd6b9475cbc-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"b0528e86-65e5-4d4c-9dd9-4cd6b9475cbc\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.348010 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/b0528e86-65e5-4d4c-9dd9-4cd6b9475cbc-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"b0528e86-65e5-4d4c-9dd9-4cd6b9475cbc\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.348219 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"glance-default-internal-api-0\" (UID: \"d6038d72-b1a2-4d71-b831-d5fa1de027a7\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.348250 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d6038d72-b1a2-4d71-b831-d5fa1de027a7-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"d6038d72-b1a2-4d71-b831-d5fa1de027a7\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.348356 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d6038d72-b1a2-4d71-b831-d5fa1de027a7-config-data\") pod \"glance-default-internal-api-0\" (UID: \"d6038d72-b1a2-4d71-b831-d5fa1de027a7\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.348465 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4vwrj\" (UniqueName: \"kubernetes.io/projected/b0528e86-65e5-4d4c-9dd9-4cd6b9475cbc-kube-api-access-4vwrj\") pod \"ovsdbserver-nb-0\" (UID: \"b0528e86-65e5-4d4c-9dd9-4cd6b9475cbc\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.348542 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b0528e86-65e5-4d4c-9dd9-4cd6b9475cbc-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"b0528e86-65e5-4d4c-9dd9-4cd6b9475cbc\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.348606 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/b0528e86-65e5-4d4c-9dd9-4cd6b9475cbc-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"b0528e86-65e5-4d4c-9dd9-4cd6b9475cbc\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.348675 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b0528e86-65e5-4d4c-9dd9-4cd6b9475cbc-config\") pod \"ovsdbserver-nb-0\" (UID: \"b0528e86-65e5-4d4c-9dd9-4cd6b9475cbc\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.348859 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wf2z4\" (UniqueName: \"kubernetes.io/projected/d6038d72-b1a2-4d71-b831-d5fa1de027a7-kube-api-access-wf2z4\") pod \"glance-default-internal-api-0\" (UID: \"d6038d72-b1a2-4d71-b831-d5fa1de027a7\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.348903 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") pod \"ovsdbserver-nb-0\" (UID: \"b0528e86-65e5-4d4c-9dd9-4cd6b9475cbc\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.348996 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/b0528e86-65e5-4d4c-9dd9-4cd6b9475cbc-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"b0528e86-65e5-4d4c-9dd9-4cd6b9475cbc\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.349073 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/011b06d9-6610-4fc7-97ab-697050a06ec4-httpd-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.349089 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qgfjn\" (UniqueName: \"kubernetes.io/projected/011b06d9-6610-4fc7-97ab-697050a06ec4-kube-api-access-qgfjn\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.350375 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/b0528e86-65e5-4d4c-9dd9-4cd6b9475cbc-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"b0528e86-65e5-4d4c-9dd9-4cd6b9475cbc\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.350546 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"glance-default-internal-api-0\" (UID: \"d6038d72-b1a2-4d71-b831-d5fa1de027a7\") device mount path \"/mnt/openstack/pv01\"" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.363218 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.363479 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") pod \"ovsdbserver-nb-0\" (UID: \"b0528e86-65e5-4d4c-9dd9-4cd6b9475cbc\") device mount path \"/mnt/openstack/pv17\"" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.364832 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="011b06d9-6610-4fc7-97ab-697050a06ec4" containerName="neutron-httpd" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.364852 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="011b06d9-6610-4fc7-97ab-697050a06ec4" containerName="neutron-httpd" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.364867 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="011b06d9-6610-4fc7-97ab-697050a06ec4" containerName="neutron-api" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.364875 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="011b06d9-6610-4fc7-97ab-697050a06ec4" containerName="neutron-api" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.365049 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="011b06d9-6610-4fc7-97ab-697050a06ec4" containerName="neutron-api" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.365065 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="011b06d9-6610-4fc7-97ab-697050a06ec4" containerName="neutron-httpd" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.366046 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b0528e86-65e5-4d4c-9dd9-4cd6b9475cbc-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"b0528e86-65e5-4d4c-9dd9-4cd6b9475cbc\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.369876 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d6038d72-b1a2-4d71-b831-d5fa1de027a7-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"d6038d72-b1a2-4d71-b831-d5fa1de027a7\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.370993 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d6038d72-b1a2-4d71-b831-d5fa1de027a7-scripts\") pod \"glance-default-internal-api-0\" (UID: \"d6038d72-b1a2-4d71-b831-d5fa1de027a7\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.371137 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b0528e86-65e5-4d4c-9dd9-4cd6b9475cbc-config\") pod \"ovsdbserver-nb-0\" (UID: \"b0528e86-65e5-4d4c-9dd9-4cd6b9475cbc\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.372849 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/b0528e86-65e5-4d4c-9dd9-4cd6b9475cbc-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"b0528e86-65e5-4d4c-9dd9-4cd6b9475cbc\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.377533 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.377672 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.386114 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/d6038d72-b1a2-4d71-b831-d5fa1de027a7-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"d6038d72-b1a2-4d71-b831-d5fa1de027a7\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.396477 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/b0528e86-65e5-4d4c-9dd9-4cd6b9475cbc-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"b0528e86-65e5-4d4c-9dd9-4cd6b9475cbc\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.399260 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-rabbitmq-svc\"" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.399561 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-server-conf\"" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.399881 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-config-data\"" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.400047 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-plugins-conf\"" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.400226 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-server-dockercfg-fd7mp\"" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.400401 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-default-user\"" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.400600 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-erlang-cookie\"" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.410891 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wf2z4\" (UniqueName: \"kubernetes.io/projected/d6038d72-b1a2-4d71-b831-d5fa1de027a7-kube-api-access-wf2z4\") pod \"glance-default-internal-api-0\" (UID: \"d6038d72-b1a2-4d71-b831-d5fa1de027a7\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.412106 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/b0528e86-65e5-4d4c-9dd9-4cd6b9475cbc-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"b0528e86-65e5-4d4c-9dd9-4cd6b9475cbc\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.412368 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d6038d72-b1a2-4d71-b831-d5fa1de027a7-config-data\") pod \"glance-default-internal-api-0\" (UID: \"d6038d72-b1a2-4d71-b831-d5fa1de027a7\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.417568 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vwrj\" (UniqueName: \"kubernetes.io/projected/b0528e86-65e5-4d4c-9dd9-4cd6b9475cbc-kube-api-access-4vwrj\") pod \"ovsdbserver-nb-0\" (UID: \"b0528e86-65e5-4d4c-9dd9-4cd6b9475cbc\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.503196 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/c6ba454f-2263-4fc3-bd13-35f921464d24-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"c6ba454f-2263-4fc3-bd13-35f921464d24\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.503254 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage18-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") pod \"rabbitmq-server-0\" (UID: \"c6ba454f-2263-4fc3-bd13-35f921464d24\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.503317 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/c6ba454f-2263-4fc3-bd13-35f921464d24-server-conf\") pod \"rabbitmq-server-0\" (UID: \"c6ba454f-2263-4fc3-bd13-35f921464d24\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.503391 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/c6ba454f-2263-4fc3-bd13-35f921464d24-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"c6ba454f-2263-4fc3-bd13-35f921464d24\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.503492 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/c6ba454f-2263-4fc3-bd13-35f921464d24-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"c6ba454f-2263-4fc3-bd13-35f921464d24\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.503539 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/c6ba454f-2263-4fc3-bd13-35f921464d24-pod-info\") pod \"rabbitmq-server-0\" (UID: \"c6ba454f-2263-4fc3-bd13-35f921464d24\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.503562 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/c6ba454f-2263-4fc3-bd13-35f921464d24-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"c6ba454f-2263-4fc3-bd13-35f921464d24\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.504042 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/c6ba454f-2263-4fc3-bd13-35f921464d24-config-data\") pod \"rabbitmq-server-0\" (UID: \"c6ba454f-2263-4fc3-bd13-35f921464d24\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.504083 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpt4z\" (UniqueName: \"kubernetes.io/projected/c6ba454f-2263-4fc3-bd13-35f921464d24-kube-api-access-kpt4z\") pod \"rabbitmq-server-0\" (UID: \"c6ba454f-2263-4fc3-bd13-35f921464d24\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.504118 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/c6ba454f-2263-4fc3-bd13-35f921464d24-rabbitmq-tls\") pod \"rabbitmq-server-0\" (UID: \"c6ba454f-2263-4fc3-bd13-35f921464d24\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.504194 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/c6ba454f-2263-4fc3-bd13-35f921464d24-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"c6ba454f-2263-4fc3-bd13-35f921464d24\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.536297 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-678df6fbdb-lfhdz" podStartSLOduration=11.536272947 podStartE2EDuration="11.536272947s" podCreationTimestamp="2026-03-16 16:49:32 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:49:42.949846908 +0000 UTC m=+4685.103778565" watchObservedRunningTime="2026-03-16 16:49:43.536272947 +0000 UTC m=+4685.690204604" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.568943 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-5c574fdfbb-8rvsq" podStartSLOduration=13.568923033 podStartE2EDuration="13.568923033s" podCreationTimestamp="2026-03-16 16:49:30 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:49:43.091894805 +0000 UTC m=+4685.245826482" watchObservedRunningTime="2026-03-16 16:49:43.568923033 +0000 UTC m=+4685.722854690" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.633806 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/c6ba454f-2263-4fc3-bd13-35f921464d24-server-conf\") pod \"rabbitmq-server-0\" (UID: \"c6ba454f-2263-4fc3-bd13-35f921464d24\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.634079 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/c6ba454f-2263-4fc3-bd13-35f921464d24-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"c6ba454f-2263-4fc3-bd13-35f921464d24\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.634148 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/c6ba454f-2263-4fc3-bd13-35f921464d24-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"c6ba454f-2263-4fc3-bd13-35f921464d24\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.634181 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/c6ba454f-2263-4fc3-bd13-35f921464d24-pod-info\") pod \"rabbitmq-server-0\" (UID: \"c6ba454f-2263-4fc3-bd13-35f921464d24\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.634201 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/c6ba454f-2263-4fc3-bd13-35f921464d24-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"c6ba454f-2263-4fc3-bd13-35f921464d24\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.634394 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/c6ba454f-2263-4fc3-bd13-35f921464d24-config-data\") pod \"rabbitmq-server-0\" (UID: \"c6ba454f-2263-4fc3-bd13-35f921464d24\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.634423 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kpt4z\" (UniqueName: \"kubernetes.io/projected/c6ba454f-2263-4fc3-bd13-35f921464d24-kube-api-access-kpt4z\") pod \"rabbitmq-server-0\" (UID: \"c6ba454f-2263-4fc3-bd13-35f921464d24\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.634452 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/c6ba454f-2263-4fc3-bd13-35f921464d24-rabbitmq-tls\") pod \"rabbitmq-server-0\" (UID: \"c6ba454f-2263-4fc3-bd13-35f921464d24\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.634507 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/c6ba454f-2263-4fc3-bd13-35f921464d24-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"c6ba454f-2263-4fc3-bd13-35f921464d24\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.634564 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/c6ba454f-2263-4fc3-bd13-35f921464d24-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"c6ba454f-2263-4fc3-bd13-35f921464d24\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.634588 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage18-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") pod \"rabbitmq-server-0\" (UID: \"c6ba454f-2263-4fc3-bd13-35f921464d24\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.634962 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage18-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") pod \"rabbitmq-server-0\" (UID: \"c6ba454f-2263-4fc3-bd13-35f921464d24\") device mount path \"/mnt/openstack/pv18\"" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.640216 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/c6ba454f-2263-4fc3-bd13-35f921464d24-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"c6ba454f-2263-4fc3-bd13-35f921464d24\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.641119 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/c6ba454f-2263-4fc3-bd13-35f921464d24-server-conf\") pod \"rabbitmq-server-0\" (UID: \"c6ba454f-2263-4fc3-bd13-35f921464d24\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.641438 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/c6ba454f-2263-4fc3-bd13-35f921464d24-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"c6ba454f-2263-4fc3-bd13-35f921464d24\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.643588 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/c6ba454f-2263-4fc3-bd13-35f921464d24-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"c6ba454f-2263-4fc3-bd13-35f921464d24\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.649751 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/c6ba454f-2263-4fc3-bd13-35f921464d24-config-data\") pod \"rabbitmq-server-0\" (UID: \"c6ba454f-2263-4fc3-bd13-35f921464d24\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.656054 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/c6ba454f-2263-4fc3-bd13-35f921464d24-rabbitmq-tls\") pod \"rabbitmq-server-0\" (UID: \"c6ba454f-2263-4fc3-bd13-35f921464d24\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.658588 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/c6ba454f-2263-4fc3-bd13-35f921464d24-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"c6ba454f-2263-4fc3-bd13-35f921464d24\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.665084 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-scheduler-0" podStartSLOduration=9.66506625 podStartE2EDuration="9.66506625s" podCreationTimestamp="2026-03-16 16:49:34 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:49:43.219225458 +0000 UTC m=+4685.373157115" watchObservedRunningTime="2026-03-16 16:49:43.66506625 +0000 UTC m=+4685.818997907" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.673574 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.679133 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/c6ba454f-2263-4fc3-bd13-35f921464d24-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"c6ba454f-2263-4fc3-bd13-35f921464d24\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.682092 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/c6ba454f-2263-4fc3-bd13-35f921464d24-pod-info\") pod \"rabbitmq-server-0\" (UID: \"c6ba454f-2263-4fc3-bd13-35f921464d24\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.696295 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.702456 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-b95f7696b-gs4k6" podStartSLOduration=15.702432815 podStartE2EDuration="15.702432815s" podCreationTimestamp="2026-03-16 16:49:28 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:49:43.279098281 +0000 UTC m=+4685.433029938" watchObservedRunningTime="2026-03-16 16:49:43.702432815 +0000 UTC m=+4685.856364472" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.704843 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpt4z\" (UniqueName: \"kubernetes.io/projected/c6ba454f-2263-4fc3-bd13-35f921464d24-kube-api-access-kpt4z\") pod \"rabbitmq-server-0\" (UID: \"c6ba454f-2263-4fc3-bd13-35f921464d24\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.767053 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.773582 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.801445 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.828962 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.858426 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.858552 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.862663 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-conductor-config-data\"" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.863132 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.870973 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.876106 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") pod \"ovsdbserver-nb-0\" (UID: \"b0528e86-65e5-4d4c-9dd9-4cd6b9475cbc\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.881490 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-cell1-server-conf\"" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.882092 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-rabbitmq-cell1-svc\"" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.882267 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-cell1-server-dockercfg-vghkd\"" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.882433 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-cell1-default-user\"" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.882543 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-cell1-config-data\"" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.882662 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-cell1-erlang-cookie\"" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.882800 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-cell1-plugins-conf\"" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.891091 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"glance-default-internal-api-0\" (UID: \"d6038d72-b1a2-4d71-b831-d5fa1de027a7\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.901969 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.955010 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-77bbc99f7d-fbdfw"] Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.994954 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/81b72eda-5dae-44c1-a720-9ca9e22cb100-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"81b72eda-5dae-44c1-a720-9ca9e22cb100\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.995029 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/27ae46b8-fa26-48e8-a9bb-36bc910c3caf-rabbitmq-tls\") pod \"rabbitmq-cell1-server-0\" (UID: \"27ae46b8-fa26-48e8-a9bb-36bc910c3caf\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.995063 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/27ae46b8-fa26-48e8-a9bb-36bc910c3caf-plugins-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"27ae46b8-fa26-48e8-a9bb-36bc910c3caf\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.995150 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/27ae46b8-fa26-48e8-a9bb-36bc910c3caf-rabbitmq-erlang-cookie\") pod \"rabbitmq-cell1-server-0\" (UID: \"27ae46b8-fa26-48e8-a9bb-36bc910c3caf\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.995171 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2885z\" (UniqueName: \"kubernetes.io/projected/81b72eda-5dae-44c1-a720-9ca9e22cb100-kube-api-access-2885z\") pod \"nova-cell0-conductor-0\" (UID: \"81b72eda-5dae-44c1-a720-9ca9e22cb100\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.995194 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/27ae46b8-fa26-48e8-a9bb-36bc910c3caf-erlang-cookie-secret\") pod \"rabbitmq-cell1-server-0\" (UID: \"27ae46b8-fa26-48e8-a9bb-36bc910c3caf\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:49:43 crc kubenswrapper[5120]: I0316 16:49:43.995354 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ndj8t\" (UniqueName: \"kubernetes.io/projected/27ae46b8-fa26-48e8-a9bb-36bc910c3caf-kube-api-access-ndj8t\") pod \"rabbitmq-cell1-server-0\" (UID: \"27ae46b8-fa26-48e8-a9bb-36bc910c3caf\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:49:44 crc kubenswrapper[5120]: I0316 16:49:43.995460 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/81b72eda-5dae-44c1-a720-9ca9e22cb100-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"81b72eda-5dae-44c1-a720-9ca9e22cb100\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:49:44 crc kubenswrapper[5120]: I0316 16:49:43.995517 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/27ae46b8-fa26-48e8-a9bb-36bc910c3caf-rabbitmq-confd\") pod \"rabbitmq-cell1-server-0\" (UID: \"27ae46b8-fa26-48e8-a9bb-36bc910c3caf\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:49:44 crc kubenswrapper[5120]: I0316 16:49:43.995571 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"27ae46b8-fa26-48e8-a9bb-36bc910c3caf\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:49:44 crc kubenswrapper[5120]: I0316 16:49:44.004031 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/27ae46b8-fa26-48e8-a9bb-36bc910c3caf-config-data\") pod \"rabbitmq-cell1-server-0\" (UID: \"27ae46b8-fa26-48e8-a9bb-36bc910c3caf\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:49:44 crc kubenswrapper[5120]: I0316 16:49:44.004105 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/27ae46b8-fa26-48e8-a9bb-36bc910c3caf-pod-info\") pod \"rabbitmq-cell1-server-0\" (UID: \"27ae46b8-fa26-48e8-a9bb-36bc910c3caf\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:49:44 crc kubenswrapper[5120]: I0316 16:49:44.004142 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/27ae46b8-fa26-48e8-a9bb-36bc910c3caf-rabbitmq-plugins\") pod \"rabbitmq-cell1-server-0\" (UID: \"27ae46b8-fa26-48e8-a9bb-36bc910c3caf\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:49:44 crc kubenswrapper[5120]: I0316 16:49:44.004232 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/27ae46b8-fa26-48e8-a9bb-36bc910c3caf-server-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"27ae46b8-fa26-48e8-a9bb-36bc910c3caf\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:49:44 crc kubenswrapper[5120]: I0316 16:49:44.004643 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-77bbc99f7d-fbdfw"] Mar 16 16:49:44 crc kubenswrapper[5120]: I0316 16:49:44.040873 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 16:49:44 crc kubenswrapper[5120]: I0316 16:49:44.067342 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:49:44 crc kubenswrapper[5120]: I0316 16:49:44.083996 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:49:44 crc kubenswrapper[5120]: I0316 16:49:44.105508 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage18-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") pod \"rabbitmq-server-0\" (UID: \"c6ba454f-2263-4fc3-bd13-35f921464d24\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:49:44 crc kubenswrapper[5120]: I0316 16:49:44.117166 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/81b72eda-5dae-44c1-a720-9ca9e22cb100-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"81b72eda-5dae-44c1-a720-9ca9e22cb100\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:49:44 crc kubenswrapper[5120]: I0316 16:49:44.117238 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/27ae46b8-fa26-48e8-a9bb-36bc910c3caf-rabbitmq-confd\") pod \"rabbitmq-cell1-server-0\" (UID: \"27ae46b8-fa26-48e8-a9bb-36bc910c3caf\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:49:44 crc kubenswrapper[5120]: I0316 16:49:44.117283 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"27ae46b8-fa26-48e8-a9bb-36bc910c3caf\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:49:44 crc kubenswrapper[5120]: I0316 16:49:44.117376 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/27ae46b8-fa26-48e8-a9bb-36bc910c3caf-config-data\") pod \"rabbitmq-cell1-server-0\" (UID: \"27ae46b8-fa26-48e8-a9bb-36bc910c3caf\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:49:44 crc kubenswrapper[5120]: I0316 16:49:44.117407 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/27ae46b8-fa26-48e8-a9bb-36bc910c3caf-pod-info\") pod \"rabbitmq-cell1-server-0\" (UID: \"27ae46b8-fa26-48e8-a9bb-36bc910c3caf\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:49:44 crc kubenswrapper[5120]: I0316 16:49:44.117435 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/27ae46b8-fa26-48e8-a9bb-36bc910c3caf-rabbitmq-plugins\") pod \"rabbitmq-cell1-server-0\" (UID: \"27ae46b8-fa26-48e8-a9bb-36bc910c3caf\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:49:44 crc kubenswrapper[5120]: I0316 16:49:44.117487 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/27ae46b8-fa26-48e8-a9bb-36bc910c3caf-server-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"27ae46b8-fa26-48e8-a9bb-36bc910c3caf\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:49:44 crc kubenswrapper[5120]: I0316 16:49:44.117523 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/81b72eda-5dae-44c1-a720-9ca9e22cb100-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"81b72eda-5dae-44c1-a720-9ca9e22cb100\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:49:44 crc kubenswrapper[5120]: I0316 16:49:44.117552 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/27ae46b8-fa26-48e8-a9bb-36bc910c3caf-rabbitmq-tls\") pod \"rabbitmq-cell1-server-0\" (UID: \"27ae46b8-fa26-48e8-a9bb-36bc910c3caf\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:49:44 crc kubenswrapper[5120]: I0316 16:49:44.117579 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/27ae46b8-fa26-48e8-a9bb-36bc910c3caf-plugins-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"27ae46b8-fa26-48e8-a9bb-36bc910c3caf\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:49:44 crc kubenswrapper[5120]: I0316 16:49:44.117633 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/27ae46b8-fa26-48e8-a9bb-36bc910c3caf-rabbitmq-erlang-cookie\") pod \"rabbitmq-cell1-server-0\" (UID: \"27ae46b8-fa26-48e8-a9bb-36bc910c3caf\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:49:44 crc kubenswrapper[5120]: I0316 16:49:44.117650 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2885z\" (UniqueName: \"kubernetes.io/projected/81b72eda-5dae-44c1-a720-9ca9e22cb100-kube-api-access-2885z\") pod \"nova-cell0-conductor-0\" (UID: \"81b72eda-5dae-44c1-a720-9ca9e22cb100\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:49:44 crc kubenswrapper[5120]: I0316 16:49:44.117673 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/27ae46b8-fa26-48e8-a9bb-36bc910c3caf-erlang-cookie-secret\") pod \"rabbitmq-cell1-server-0\" (UID: \"27ae46b8-fa26-48e8-a9bb-36bc910c3caf\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:49:44 crc kubenswrapper[5120]: I0316 16:49:44.117810 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ndj8t\" (UniqueName: \"kubernetes.io/projected/27ae46b8-fa26-48e8-a9bb-36bc910c3caf-kube-api-access-ndj8t\") pod \"rabbitmq-cell1-server-0\" (UID: \"27ae46b8-fa26-48e8-a9bb-36bc910c3caf\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:49:44 crc kubenswrapper[5120]: I0316 16:49:44.120625 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/27ae46b8-fa26-48e8-a9bb-36bc910c3caf-server-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"27ae46b8-fa26-48e8-a9bb-36bc910c3caf\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:49:44 crc kubenswrapper[5120]: I0316 16:49:44.121631 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"27ae46b8-fa26-48e8-a9bb-36bc910c3caf\") device mount path \"/mnt/openstack/pv12\"" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:49:44 crc kubenswrapper[5120]: I0316 16:49:44.124920 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/27ae46b8-fa26-48e8-a9bb-36bc910c3caf-config-data\") pod \"rabbitmq-cell1-server-0\" (UID: \"27ae46b8-fa26-48e8-a9bb-36bc910c3caf\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:49:44 crc kubenswrapper[5120]: I0316 16:49:44.135345 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/27ae46b8-fa26-48e8-a9bb-36bc910c3caf-plugins-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"27ae46b8-fa26-48e8-a9bb-36bc910c3caf\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:49:44 crc kubenswrapper[5120]: I0316 16:49:44.135821 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/27ae46b8-fa26-48e8-a9bb-36bc910c3caf-rabbitmq-erlang-cookie\") pod \"rabbitmq-cell1-server-0\" (UID: \"27ae46b8-fa26-48e8-a9bb-36bc910c3caf\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:49:44 crc kubenswrapper[5120]: I0316 16:49:44.143002 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/27ae46b8-fa26-48e8-a9bb-36bc910c3caf-rabbitmq-plugins\") pod \"rabbitmq-cell1-server-0\" (UID: \"27ae46b8-fa26-48e8-a9bb-36bc910c3caf\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:49:44 crc kubenswrapper[5120]: I0316 16:49:44.146434 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/81b72eda-5dae-44c1-a720-9ca9e22cb100-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"81b72eda-5dae-44c1-a720-9ca9e22cb100\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:49:44 crc kubenswrapper[5120]: I0316 16:49:44.146570 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/27ae46b8-fa26-48e8-a9bb-36bc910c3caf-pod-info\") pod \"rabbitmq-cell1-server-0\" (UID: \"27ae46b8-fa26-48e8-a9bb-36bc910c3caf\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:49:44 crc kubenswrapper[5120]: I0316 16:49:44.150691 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/81b72eda-5dae-44c1-a720-9ca9e22cb100-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"81b72eda-5dae-44c1-a720-9ca9e22cb100\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:49:44 crc kubenswrapper[5120]: I0316 16:49:44.161576 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2885z\" (UniqueName: \"kubernetes.io/projected/81b72eda-5dae-44c1-a720-9ca9e22cb100-kube-api-access-2885z\") pod \"nova-cell0-conductor-0\" (UID: \"81b72eda-5dae-44c1-a720-9ca9e22cb100\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:49:44 crc kubenswrapper[5120]: I0316 16:49:44.162486 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:49:44 crc kubenswrapper[5120]: I0316 16:49:44.187711 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/27ae46b8-fa26-48e8-a9bb-36bc910c3caf-rabbitmq-confd\") pod \"rabbitmq-cell1-server-0\" (UID: \"27ae46b8-fa26-48e8-a9bb-36bc910c3caf\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:49:44 crc kubenswrapper[5120]: I0316 16:49:44.198570 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ndj8t\" (UniqueName: \"kubernetes.io/projected/27ae46b8-fa26-48e8-a9bb-36bc910c3caf-kube-api-access-ndj8t\") pod \"rabbitmq-cell1-server-0\" (UID: \"27ae46b8-fa26-48e8-a9bb-36bc910c3caf\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:49:44 crc kubenswrapper[5120]: I0316 16:49:44.205058 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/27ae46b8-fa26-48e8-a9bb-36bc910c3caf-rabbitmq-tls\") pod \"rabbitmq-cell1-server-0\" (UID: \"27ae46b8-fa26-48e8-a9bb-36bc910c3caf\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:49:44 crc kubenswrapper[5120]: I0316 16:49:44.216390 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/27ae46b8-fa26-48e8-a9bb-36bc910c3caf-erlang-cookie-secret\") pod \"rabbitmq-cell1-server-0\" (UID: \"27ae46b8-fa26-48e8-a9bb-36bc910c3caf\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:49:44 crc kubenswrapper[5120]: I0316 16:49:44.221528 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:49:44 crc kubenswrapper[5120]: I0316 16:49:44.230576 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"27ae46b8-fa26-48e8-a9bb-36bc910c3caf\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:49:44 crc kubenswrapper[5120]: I0316 16:49:44.245214 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/011b06d9-6610-4fc7-97ab-697050a06ec4-config" (OuterVolumeSpecName: "config") pod "011b06d9-6610-4fc7-97ab-697050a06ec4" (UID: "011b06d9-6610-4fc7-97ab-697050a06ec4"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:49:44 crc kubenswrapper[5120]: I0316 16:49:44.250679 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/011b06d9-6610-4fc7-97ab-697050a06ec4-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "011b06d9-6610-4fc7-97ab-697050a06ec4" (UID: "011b06d9-6610-4fc7-97ab-697050a06ec4"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:49:44 crc kubenswrapper[5120]: I0316 16:49:44.326511 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/011b06d9-6610-4fc7-97ab-697050a06ec4-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:44 crc kubenswrapper[5120]: I0316 16:49:44.326545 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/011b06d9-6610-4fc7-97ab-697050a06ec4-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:44 crc kubenswrapper[5120]: I0316 16:49:44.329581 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-77797b894-rctcp"] Mar 16 16:49:44 crc kubenswrapper[5120]: I0316 16:49:44.352525 5120 generic.go:358] "Generic (PLEG): container finished" podID="199c0d37-3938-4dff-bc4c-b94e06321673" containerID="a97f96ac1cd87cba0b55ec8ed7b5a54af5f9292e24a69dab7c862eddcfb9017d" exitCode=0 Mar 16 16:49:44 crc kubenswrapper[5120]: I0316 16:49:44.352653 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-6sq2s" event={"ID":"199c0d37-3938-4dff-bc4c-b94e06321673","Type":"ContainerDied","Data":"a97f96ac1cd87cba0b55ec8ed7b5a54af5f9292e24a69dab7c862eddcfb9017d"} Mar 16 16:49:44 crc kubenswrapper[5120]: I0316 16:49:44.403595 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-7b66994cdb-4jkjq_011b06d9-6610-4fc7-97ab-697050a06ec4/neutron-api/0.log" Mar 16 16:49:44 crc kubenswrapper[5120]: I0316 16:49:44.404216 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-7b66994cdb-4jkjq" Mar 16 16:49:44 crc kubenswrapper[5120]: I0316 16:49:44.405123 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-7b66994cdb-4jkjq" event={"ID":"011b06d9-6610-4fc7-97ab-697050a06ec4","Type":"ContainerDied","Data":"bdd67c8187077276b76c9b57773e538caed737000a2a9b46d9cc3fe51595fdcc"} Mar 16 16:49:44 crc kubenswrapper[5120]: I0316 16:49:44.405274 5120 scope.go:117] "RemoveContainer" containerID="92c36406d876860c08867e44be63e833b6198fb1f978bc1800b6ac3eef6ae838" Mar 16 16:49:44 crc kubenswrapper[5120]: I0316 16:49:44.491412 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"77fd10d5-5894-450f-bba5-8261c3ca1b4e","Type":"ContainerStarted","Data":"844bc8457c6481da76a51e34f1e2d8b7851a01dba9b5f8cf7a34977dbdf5fc77"} Mar 16 16:49:44 crc kubenswrapper[5120]: I0316 16:49:44.557329 5120 generic.go:358] "Generic (PLEG): container finished" podID="370e78a7-6b53-4f13-aa62-8afa448a0b7d" containerID="da5f4edb49e75db3f4b00835e874103c3a616a2ae027795d81631b1e318afdda" exitCode=0 Mar 16 16:49:44 crc kubenswrapper[5120]: I0316 16:49:44.557910 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-b95f7696b-gs4k6" event={"ID":"370e78a7-6b53-4f13-aa62-8afa448a0b7d","Type":"ContainerDied","Data":"da5f4edb49e75db3f4b00835e874103c3a616a2ae027795d81631b1e318afdda"} Mar 16 16:49:44 crc kubenswrapper[5120]: I0316 16:49:44.581872 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:49:44 crc kubenswrapper[5120]: I0316 16:49:44.595070 5120 generic.go:358] "Generic (PLEG): container finished" podID="845a4572-72f5-4247-b546-c9974f7ae78d" containerID="e395c97f46524d2be4c3f22c7dd5e308856748f9b69a0197842a05ba44953ce8" exitCode=0 Mar 16 16:49:44 crc kubenswrapper[5120]: I0316 16:49:44.595222 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"845a4572-72f5-4247-b546-c9974f7ae78d","Type":"ContainerDied","Data":"e395c97f46524d2be4c3f22c7dd5e308856748f9b69a0197842a05ba44953ce8"} Mar 16 16:49:44 crc kubenswrapper[5120]: I0316 16:49:44.654863 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-7b66994cdb-4jkjq"] Mar 16 16:49:44 crc kubenswrapper[5120]: I0316 16:49:44.665049 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-7b66994cdb-4jkjq"] Mar 16 16:49:44 crc kubenswrapper[5120]: I0316 16:49:44.729660 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podStartSLOduration=10.729640696 podStartE2EDuration="10.729640696s" podCreationTimestamp="2026-03-16 16:49:34 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:49:44.703513539 +0000 UTC m=+4686.857445196" watchObservedRunningTime="2026-03-16 16:49:44.729640696 +0000 UTC m=+4686.883572353" Mar 16 16:49:44 crc kubenswrapper[5120]: I0316 16:49:44.748494 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="011b06d9-6610-4fc7-97ab-697050a06ec4" path="/var/lib/kubelet/pods/011b06d9-6610-4fc7-97ab-697050a06ec4/volumes" Mar 16 16:49:44 crc kubenswrapper[5120]: I0316 16:49:44.756103 5120 generic.go:358] "Generic (PLEG): container finished" podID="8931787a-1e50-415c-8d97-6c2ab294b4f4" containerID="7788939b5c6289f5f75e37cc4aa76bdcfb55dea29b690d9ac7eb291a4e844f06" exitCode=0 Mar 16 16:49:44 crc kubenswrapper[5120]: I0316 16:49:44.756584 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="07aa860b-bb17-4a36-bc23-549bfd1bdb5c" path="/var/lib/kubelet/pods/07aa860b-bb17-4a36-bc23-549bfd1bdb5c/volumes" Mar 16 16:49:44 crc kubenswrapper[5120]: I0316 16:49:44.761830 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ea30b51-1d30-4a53-834a-264069b9566e" path="/var/lib/kubelet/pods/1ea30b51-1d30-4a53-834a-264069b9566e/volumes" Mar 16 16:49:44 crc kubenswrapper[5120]: I0316 16:49:44.768186 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7872e738-4d0c-48dd-952c-d878aafc51af" path="/var/lib/kubelet/pods/7872e738-4d0c-48dd-952c-d878aafc51af/volumes" Mar 16 16:49:44 crc kubenswrapper[5120]: I0316 16:49:44.768957 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7fdb0b94-e011-4907-9a1e-a67153d87979" path="/var/lib/kubelet/pods/7fdb0b94-e011-4907-9a1e-a67153d87979/volumes" Mar 16 16:49:44 crc kubenswrapper[5120]: I0316 16:49:44.769753 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa12529b-b6fe-4512-88ec-fd6250636e6b" path="/var/lib/kubelet/pods/aa12529b-b6fe-4512-88ec-fd6250636e6b/volumes" Mar 16 16:49:44 crc kubenswrapper[5120]: I0316 16:49:44.771658 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f3277ed1-d61b-491c-b6dc-1964a1422ea9" path="/var/lib/kubelet/pods/f3277ed1-d61b-491c-b6dc-1964a1422ea9/volumes" Mar 16 16:49:44 crc kubenswrapper[5120]: I0316 16:49:44.772424 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-5c574fdfbb-8rvsq" event={"ID":"8931787a-1e50-415c-8d97-6c2ab294b4f4","Type":"ContainerDied","Data":"7788939b5c6289f5f75e37cc4aa76bdcfb55dea29b690d9ac7eb291a4e844f06"} Mar 16 16:49:44 crc kubenswrapper[5120]: I0316 16:49:44.790222 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:49:44 crc kubenswrapper[5120]: I0316 16:49:44.899450 5120 scope.go:117] "RemoveContainer" containerID="72cf42ee5a1dd1662d5e629838f7321e79ca35c759f851acd86e0dcb0d0733a1" Mar 16 16:49:45 crc kubenswrapper[5120]: I0316 16:49:45.067806 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:49:45 crc kubenswrapper[5120]: I0316 16:49:45.209449 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:49:45 crc kubenswrapper[5120]: I0316 16:49:45.599731 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 16:49:45 crc kubenswrapper[5120]: W0316 16:49:45.776710 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd6038d72_b1a2_4d71_b831_d5fa1de027a7.slice/crio-e90d4b6202e7a6e8bf55dd3a3e0a1ee52a5cd401d96d7ece30b6880c03460ac6 WatchSource:0}: Error finding container e90d4b6202e7a6e8bf55dd3a3e0a1ee52a5cd401d96d7ece30b6880c03460ac6: Status 404 returned error can't find the container with id e90d4b6202e7a6e8bf55dd3a3e0a1ee52a5cd401d96d7ece30b6880c03460ac6 Mar 16 16:49:45 crc kubenswrapper[5120]: I0316 16:49:45.788855 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 16:49:45 crc kubenswrapper[5120]: I0316 16:49:45.826463 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"5f1fe655-07dd-4959-98ac-372e797369fa","Type":"ContainerStarted","Data":"69f752550a5578263c364529de570d74151a5bd7974ef22cf21fdb0c1513409f"} Mar 16 16:49:45 crc kubenswrapper[5120]: I0316 16:49:45.923353 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-scheduler-0" podStartSLOduration=11.923325195 podStartE2EDuration="11.923325195s" podCreationTimestamp="2026-03-16 16:49:34 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:49:45.886899516 +0000 UTC m=+4688.040831203" watchObservedRunningTime="2026-03-16 16:49:45.923325195 +0000 UTC m=+4688.077256852" Mar 16 16:49:45 crc kubenswrapper[5120]: I0316 16:49:45.935315 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"845a4572-72f5-4247-b546-c9974f7ae78d","Type":"ContainerDied","Data":"073a2d08e95b6faa5cad043ae49363bafb4974cd9985fc26d5dfbcadafe33ff3"} Mar 16 16:49:45 crc kubenswrapper[5120]: I0316 16:49:45.935375 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="073a2d08e95b6faa5cad043ae49363bafb4974cd9985fc26d5dfbcadafe33ff3" Mar 16 16:49:45 crc kubenswrapper[5120]: I0316 16:49:45.951252 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"bb689081-a0bf-445f-aa9f-12a38c98a269","Type":"ContainerStarted","Data":"a1cd73640c37a42fa6ebe4301abe6341be42e951fc430d48f97879efaf1fc878"} Mar 16 16:49:45 crc kubenswrapper[5120]: I0316 16:49:45.960528 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-77797b894-rctcp" event={"ID":"710921c8-80e7-46a5-8792-8ffc9795500c","Type":"ContainerStarted","Data":"078afbab4745fda4580ecef3ad5cf20ee58cf893e22d5242c87f6b84de9639f5"} Mar 16 16:49:45 crc kubenswrapper[5120]: I0316 16:49:45.980099 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-northd-0_9d4a3a13-20de-450c-b14b-9f148b93bdcc/ovn-northd/0.log" Mar 16 16:49:45 crc kubenswrapper[5120]: I0316 16:49:45.980157 5120 generic.go:358] "Generic (PLEG): container finished" podID="9d4a3a13-20de-450c-b14b-9f148b93bdcc" containerID="e4568b8c4c24477e088010519cc3fe4c88c7800a42f8be6e09c85136ea3ec934" exitCode=139 Mar 16 16:49:45 crc kubenswrapper[5120]: I0316 16:49:45.980471 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"9d4a3a13-20de-450c-b14b-9f148b93bdcc","Type":"ContainerDied","Data":"e4568b8c4c24477e088010519cc3fe4c88c7800a42f8be6e09c85136ea3ec934"} Mar 16 16:49:46 crc kubenswrapper[5120]: I0316 16:49:45.998137 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:49:46 crc kubenswrapper[5120]: I0316 16:49:46.104082 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:49:46 crc kubenswrapper[5120]: I0316 16:49:46.143559 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-northd-0_9d4a3a13-20de-450c-b14b-9f148b93bdcc/ovn-northd/0.log" Mar 16 16:49:46 crc kubenswrapper[5120]: I0316 16:49:46.143641 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:49:46 crc kubenswrapper[5120]: I0316 16:49:46.249532 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/845a4572-72f5-4247-b546-c9974f7ae78d-log-httpd\") pod \"845a4572-72f5-4247-b546-c9974f7ae78d\" (UID: \"845a4572-72f5-4247-b546-c9974f7ae78d\") " Mar 16 16:49:46 crc kubenswrapper[5120]: I0316 16:49:46.250081 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9d4a3a13-20de-450c-b14b-9f148b93bdcc-config\") pod \"9d4a3a13-20de-450c-b14b-9f148b93bdcc\" (UID: \"9d4a3a13-20de-450c-b14b-9f148b93bdcc\") " Mar 16 16:49:46 crc kubenswrapper[5120]: I0316 16:49:46.250159 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9d4a3a13-20de-450c-b14b-9f148b93bdcc-combined-ca-bundle\") pod \"9d4a3a13-20de-450c-b14b-9f148b93bdcc\" (UID: \"9d4a3a13-20de-450c-b14b-9f148b93bdcc\") " Mar 16 16:49:46 crc kubenswrapper[5120]: I0316 16:49:46.250210 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/845a4572-72f5-4247-b546-c9974f7ae78d-config-data\") pod \"845a4572-72f5-4247-b546-c9974f7ae78d\" (UID: \"845a4572-72f5-4247-b546-c9974f7ae78d\") " Mar 16 16:49:46 crc kubenswrapper[5120]: I0316 16:49:46.250230 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/9d4a3a13-20de-450c-b14b-9f148b93bdcc-scripts\") pod \"9d4a3a13-20de-450c-b14b-9f148b93bdcc\" (UID: \"9d4a3a13-20de-450c-b14b-9f148b93bdcc\") " Mar 16 16:49:46 crc kubenswrapper[5120]: I0316 16:49:46.250263 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/845a4572-72f5-4247-b546-c9974f7ae78d-combined-ca-bundle\") pod \"845a4572-72f5-4247-b546-c9974f7ae78d\" (UID: \"845a4572-72f5-4247-b546-c9974f7ae78d\") " Mar 16 16:49:46 crc kubenswrapper[5120]: I0316 16:49:46.250281 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-czwcw\" (UniqueName: \"kubernetes.io/projected/9d4a3a13-20de-450c-b14b-9f148b93bdcc-kube-api-access-czwcw\") pod \"9d4a3a13-20de-450c-b14b-9f148b93bdcc\" (UID: \"9d4a3a13-20de-450c-b14b-9f148b93bdcc\") " Mar 16 16:49:46 crc kubenswrapper[5120]: I0316 16:49:46.250379 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9vb8g\" (UniqueName: \"kubernetes.io/projected/845a4572-72f5-4247-b546-c9974f7ae78d-kube-api-access-9vb8g\") pod \"845a4572-72f5-4247-b546-c9974f7ae78d\" (UID: \"845a4572-72f5-4247-b546-c9974f7ae78d\") " Mar 16 16:49:46 crc kubenswrapper[5120]: I0316 16:49:46.250424 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/845a4572-72f5-4247-b546-c9974f7ae78d-scripts\") pod \"845a4572-72f5-4247-b546-c9974f7ae78d\" (UID: \"845a4572-72f5-4247-b546-c9974f7ae78d\") " Mar 16 16:49:46 crc kubenswrapper[5120]: I0316 16:49:46.250466 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/845a4572-72f5-4247-b546-c9974f7ae78d-sg-core-conf-yaml\") pod \"845a4572-72f5-4247-b546-c9974f7ae78d\" (UID: \"845a4572-72f5-4247-b546-c9974f7ae78d\") " Mar 16 16:49:46 crc kubenswrapper[5120]: I0316 16:49:46.250516 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/9d4a3a13-20de-450c-b14b-9f148b93bdcc-ovn-rundir\") pod \"9d4a3a13-20de-450c-b14b-9f148b93bdcc\" (UID: \"9d4a3a13-20de-450c-b14b-9f148b93bdcc\") " Mar 16 16:49:46 crc kubenswrapper[5120]: I0316 16:49:46.250534 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/845a4572-72f5-4247-b546-c9974f7ae78d-run-httpd\") pod \"845a4572-72f5-4247-b546-c9974f7ae78d\" (UID: \"845a4572-72f5-4247-b546-c9974f7ae78d\") " Mar 16 16:49:46 crc kubenswrapper[5120]: I0316 16:49:46.253349 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d4a3a13-20de-450c-b14b-9f148b93bdcc-ovn-rundir" (OuterVolumeSpecName: "ovn-rundir") pod "9d4a3a13-20de-450c-b14b-9f148b93bdcc" (UID: "9d4a3a13-20de-450c-b14b-9f148b93bdcc"). InnerVolumeSpecName "ovn-rundir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:49:46 crc kubenswrapper[5120]: I0316 16:49:46.254600 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/845a4572-72f5-4247-b546-c9974f7ae78d-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "845a4572-72f5-4247-b546-c9974f7ae78d" (UID: "845a4572-72f5-4247-b546-c9974f7ae78d"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:49:46 crc kubenswrapper[5120]: I0316 16:49:46.254895 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/845a4572-72f5-4247-b546-c9974f7ae78d-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "845a4572-72f5-4247-b546-c9974f7ae78d" (UID: "845a4572-72f5-4247-b546-c9974f7ae78d"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:49:46 crc kubenswrapper[5120]: I0316 16:49:46.255177 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d4a3a13-20de-450c-b14b-9f148b93bdcc-config" (OuterVolumeSpecName: "config") pod "9d4a3a13-20de-450c-b14b-9f148b93bdcc" (UID: "9d4a3a13-20de-450c-b14b-9f148b93bdcc"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:49:46 crc kubenswrapper[5120]: I0316 16:49:46.255554 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d4a3a13-20de-450c-b14b-9f148b93bdcc-scripts" (OuterVolumeSpecName: "scripts") pod "9d4a3a13-20de-450c-b14b-9f148b93bdcc" (UID: "9d4a3a13-20de-450c-b14b-9f148b93bdcc"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:49:46 crc kubenswrapper[5120]: I0316 16:49:46.259472 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 16:49:46 crc kubenswrapper[5120]: I0316 16:49:46.310044 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/845a4572-72f5-4247-b546-c9974f7ae78d-kube-api-access-9vb8g" (OuterVolumeSpecName: "kube-api-access-9vb8g") pod "845a4572-72f5-4247-b546-c9974f7ae78d" (UID: "845a4572-72f5-4247-b546-c9974f7ae78d"). InnerVolumeSpecName "kube-api-access-9vb8g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:49:46 crc kubenswrapper[5120]: I0316 16:49:46.312544 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/845a4572-72f5-4247-b546-c9974f7ae78d-scripts" (OuterVolumeSpecName: "scripts") pod "845a4572-72f5-4247-b546-c9974f7ae78d" (UID: "845a4572-72f5-4247-b546-c9974f7ae78d"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:49:46 crc kubenswrapper[5120]: I0316 16:49:46.328676 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d4a3a13-20de-450c-b14b-9f148b93bdcc-kube-api-access-czwcw" (OuterVolumeSpecName: "kube-api-access-czwcw") pod "9d4a3a13-20de-450c-b14b-9f148b93bdcc" (UID: "9d4a3a13-20de-450c-b14b-9f148b93bdcc"). InnerVolumeSpecName "kube-api-access-czwcw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:49:46 crc kubenswrapper[5120]: I0316 16:49:46.350900 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:49:46 crc kubenswrapper[5120]: I0316 16:49:46.351924 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:49:46 crc kubenswrapper[5120]: I0316 16:49:46.354388 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9d4a3a13-20de-450c-b14b-9f148b93bdcc-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:46 crc kubenswrapper[5120]: I0316 16:49:46.354416 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/9d4a3a13-20de-450c-b14b-9f148b93bdcc-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:46 crc kubenswrapper[5120]: I0316 16:49:46.354428 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-czwcw\" (UniqueName: \"kubernetes.io/projected/9d4a3a13-20de-450c-b14b-9f148b93bdcc-kube-api-access-czwcw\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:46 crc kubenswrapper[5120]: I0316 16:49:46.354437 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9vb8g\" (UniqueName: \"kubernetes.io/projected/845a4572-72f5-4247-b546-c9974f7ae78d-kube-api-access-9vb8g\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:46 crc kubenswrapper[5120]: I0316 16:49:46.354446 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/845a4572-72f5-4247-b546-c9974f7ae78d-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:46 crc kubenswrapper[5120]: I0316 16:49:46.354456 5120 reconciler_common.go:299] "Volume detached for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/9d4a3a13-20de-450c-b14b-9f148b93bdcc-ovn-rundir\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:46 crc kubenswrapper[5120]: I0316 16:49:46.354465 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/845a4572-72f5-4247-b546-c9974f7ae78d-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:46 crc kubenswrapper[5120]: I0316 16:49:46.354474 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/845a4572-72f5-4247-b546-c9974f7ae78d-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:46 crc kubenswrapper[5120]: I0316 16:49:46.403517 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:49:46 crc kubenswrapper[5120]: I0316 16:49:46.410041 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/845a4572-72f5-4247-b546-c9974f7ae78d-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "845a4572-72f5-4247-b546-c9974f7ae78d" (UID: "845a4572-72f5-4247-b546-c9974f7ae78d"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:49:46 crc kubenswrapper[5120]: I0316 16:49:46.457351 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/845a4572-72f5-4247-b546-c9974f7ae78d-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:46 crc kubenswrapper[5120]: I0316 16:49:46.492227 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-f5b8b4576-z8chc" Mar 16 16:49:46 crc kubenswrapper[5120]: I0316 16:49:46.575049 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9d4a3a13-20de-450c-b14b-9f148b93bdcc-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "9d4a3a13-20de-450c-b14b-9f148b93bdcc" (UID: "9d4a3a13-20de-450c-b14b-9f148b93bdcc"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:49:46 crc kubenswrapper[5120]: I0316 16:49:46.616070 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-66f8c58b5d-5nmtn"] Mar 16 16:49:46 crc kubenswrapper[5120]: I0316 16:49:46.616597 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-66f8c58b5d-5nmtn" podUID="3dad7391-908f-4984-9272-f28450644483" containerName="barbican-api-log" containerID="cri-o://4a1d05bdf4568f0d31e23dfca9c9fbb8395d941ca4ddc89fd84bacfb20b93fd3" gracePeriod=30 Mar 16 16:49:46 crc kubenswrapper[5120]: I0316 16:49:46.616740 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-66f8c58b5d-5nmtn" podUID="3dad7391-908f-4984-9272-f28450644483" containerName="barbican-api" containerID="cri-o://87642dd0e9423953bb1babdced238f4c04ce8fa1d0b2bd4e731927d40588bdd3" gracePeriod=30 Mar 16 16:49:46 crc kubenswrapper[5120]: I0316 16:49:46.626372 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:49:46 crc kubenswrapper[5120]: I0316 16:49:46.662495 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9d4a3a13-20de-450c-b14b-9f148b93bdcc-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:46 crc kubenswrapper[5120]: I0316 16:49:46.758154 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-6sq2s" Mar 16 16:49:46 crc kubenswrapper[5120]: I0316 16:49:46.763535 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/199c0d37-3938-4dff-bc4c-b94e06321673-config-data\") pod \"199c0d37-3938-4dff-bc4c-b94e06321673\" (UID: \"199c0d37-3938-4dff-bc4c-b94e06321673\") " Mar 16 16:49:46 crc kubenswrapper[5120]: I0316 16:49:46.763614 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jm89s\" (UniqueName: \"kubernetes.io/projected/199c0d37-3938-4dff-bc4c-b94e06321673-kube-api-access-jm89s\") pod \"199c0d37-3938-4dff-bc4c-b94e06321673\" (UID: \"199c0d37-3938-4dff-bc4c-b94e06321673\") " Mar 16 16:49:46 crc kubenswrapper[5120]: I0316 16:49:46.763980 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/199c0d37-3938-4dff-bc4c-b94e06321673-combined-ca-bundle\") pod \"199c0d37-3938-4dff-bc4c-b94e06321673\" (UID: \"199c0d37-3938-4dff-bc4c-b94e06321673\") " Mar 16 16:49:46 crc kubenswrapper[5120]: I0316 16:49:46.764300 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/199c0d37-3938-4dff-bc4c-b94e06321673-scripts\") pod \"199c0d37-3938-4dff-bc4c-b94e06321673\" (UID: \"199c0d37-3938-4dff-bc4c-b94e06321673\") " Mar 16 16:49:46 crc kubenswrapper[5120]: I0316 16:49:46.768033 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/845a4572-72f5-4247-b546-c9974f7ae78d-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "845a4572-72f5-4247-b546-c9974f7ae78d" (UID: "845a4572-72f5-4247-b546-c9974f7ae78d"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:49:46 crc kubenswrapper[5120]: I0316 16:49:46.802864 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/199c0d37-3938-4dff-bc4c-b94e06321673-scripts" (OuterVolumeSpecName: "scripts") pod "199c0d37-3938-4dff-bc4c-b94e06321673" (UID: "199c0d37-3938-4dff-bc4c-b94e06321673"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:49:46 crc kubenswrapper[5120]: I0316 16:49:46.867922 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/845a4572-72f5-4247-b546-c9974f7ae78d-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:46 crc kubenswrapper[5120]: I0316 16:49:46.868611 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/199c0d37-3938-4dff-bc4c-b94e06321673-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:46 crc kubenswrapper[5120]: I0316 16:49:46.897546 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/199c0d37-3938-4dff-bc4c-b94e06321673-kube-api-access-jm89s" (OuterVolumeSpecName: "kube-api-access-jm89s") pod "199c0d37-3938-4dff-bc4c-b94e06321673" (UID: "199c0d37-3938-4dff-bc4c-b94e06321673"). InnerVolumeSpecName "kube-api-access-jm89s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:49:46 crc kubenswrapper[5120]: I0316 16:49:46.971304 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jm89s\" (UniqueName: \"kubernetes.io/projected/199c0d37-3938-4dff-bc4c-b94e06321673-kube-api-access-jm89s\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:47 crc kubenswrapper[5120]: I0316 16:49:47.052435 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:49:47 crc kubenswrapper[5120]: I0316 16:49:47.123978 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-77797b894-rctcp" event={"ID":"710921c8-80e7-46a5-8792-8ffc9795500c","Type":"ContainerStarted","Data":"994a5a64c6e8bfa1489bcf220f2bea0b606e14b2ee9f634800fe3f596ce39925"} Mar 16 16:49:47 crc kubenswrapper[5120]: I0316 16:49:47.139291 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"27ae46b8-fa26-48e8-a9bb-36bc910c3caf","Type":"ContainerStarted","Data":"8b5327a45c28caa026704115816d96c025ee7d4b8061ce577a938f38ed2830da"} Mar 16 16:49:47 crc kubenswrapper[5120]: I0316 16:49:47.158196 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-northd-0_9d4a3a13-20de-450c-b14b-9f148b93bdcc/ovn-northd/0.log" Mar 16 16:49:47 crc kubenswrapper[5120]: I0316 16:49:47.158356 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"9d4a3a13-20de-450c-b14b-9f148b93bdcc","Type":"ContainerDied","Data":"0079f1a97399b68a8304112359e1c20a0d09ec511f566f90048b9075c44a2301"} Mar 16 16:49:47 crc kubenswrapper[5120]: I0316 16:49:47.158393 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:49:47 crc kubenswrapper[5120]: I0316 16:49:47.158433 5120 scope.go:117] "RemoveContainer" containerID="7a82fe03a967791396cd15b59558158cfdbef68e46a52b16df2605a21ba6fbe2" Mar 16 16:49:47 crc kubenswrapper[5120]: I0316 16:49:47.171639 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"d6038d72-b1a2-4d71-b831-d5fa1de027a7","Type":"ContainerStarted","Data":"e90d4b6202e7a6e8bf55dd3a3e0a1ee52a5cd401d96d7ece30b6880c03460ac6"} Mar 16 16:49:47 crc kubenswrapper[5120]: I0316 16:49:47.187651 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-6sq2s" event={"ID":"199c0d37-3938-4dff-bc4c-b94e06321673","Type":"ContainerDied","Data":"eccffae6e15c85c83010aafbb29e2cba09749a84de6f064deb9773433e32d46e"} Mar 16 16:49:47 crc kubenswrapper[5120]: I0316 16:49:47.187688 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="eccffae6e15c85c83010aafbb29e2cba09749a84de6f064deb9773433e32d46e" Mar 16 16:49:47 crc kubenswrapper[5120]: I0316 16:49:47.187672 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-6sq2s" Mar 16 16:49:47 crc kubenswrapper[5120]: I0316 16:49:47.194134 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"b0528e86-65e5-4d4c-9dd9-4cd6b9475cbc","Type":"ContainerStarted","Data":"ba3130cc8b0b36e13d379cb4a3029e53bda6e7a65af59efe12086382b782823c"} Mar 16 16:49:47 crc kubenswrapper[5120]: I0316 16:49:47.200786 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"77fd10d5-5894-450f-bba5-8261c3ca1b4e","Type":"ContainerStarted","Data":"914e787e46b4c31fdd99718734026a273335e75723c3b60d39b1ad2048616920"} Mar 16 16:49:47 crc kubenswrapper[5120]: I0316 16:49:47.209987 5120 generic.go:358] "Generic (PLEG): container finished" podID="3dad7391-908f-4984-9272-f28450644483" containerID="4a1d05bdf4568f0d31e23dfca9c9fbb8395d941ca4ddc89fd84bacfb20b93fd3" exitCode=143 Mar 16 16:49:47 crc kubenswrapper[5120]: I0316 16:49:47.210186 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-66f8c58b5d-5nmtn" event={"ID":"3dad7391-908f-4984-9272-f28450644483","Type":"ContainerDied","Data":"4a1d05bdf4568f0d31e23dfca9c9fbb8395d941ca4ddc89fd84bacfb20b93fd3"} Mar 16 16:49:47 crc kubenswrapper[5120]: I0316 16:49:47.217566 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"81b72eda-5dae-44c1-a720-9ca9e22cb100","Type":"ContainerStarted","Data":"138928b1d622524a36978ed699bbc7954164b4b12a161b676d9b0f03d5d7286d"} Mar 16 16:49:47 crc kubenswrapper[5120]: I0316 16:49:47.220598 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"c6ba454f-2263-4fc3-bd13-35f921464d24","Type":"ContainerStarted","Data":"92ba644b45ffa3cbdcf9578fc87c1f63031fa2914e80fb658b9360ede334b93a"} Mar 16 16:49:47 crc kubenswrapper[5120]: I0316 16:49:47.220628 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:49:47 crc kubenswrapper[5120]: I0316 16:49:47.220693 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:49:47 crc kubenswrapper[5120]: I0316 16:49:47.680462 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/199c0d37-3938-4dff-bc4c-b94e06321673-config-data" (OuterVolumeSpecName: "config-data") pod "199c0d37-3938-4dff-bc4c-b94e06321673" (UID: "199c0d37-3938-4dff-bc4c-b94e06321673"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:49:47 crc kubenswrapper[5120]: I0316 16:49:47.704608 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/199c0d37-3938-4dff-bc4c-b94e06321673-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:47 crc kubenswrapper[5120]: I0316 16:49:47.713940 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/199c0d37-3938-4dff-bc4c-b94e06321673-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "199c0d37-3938-4dff-bc4c-b94e06321673" (UID: "199c0d37-3938-4dff-bc4c-b94e06321673"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:49:47 crc kubenswrapper[5120]: I0316 16:49:47.797486 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/845a4572-72f5-4247-b546-c9974f7ae78d-config-data" (OuterVolumeSpecName: "config-data") pod "845a4572-72f5-4247-b546-c9974f7ae78d" (UID: "845a4572-72f5-4247-b546-c9974f7ae78d"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:49:47 crc kubenswrapper[5120]: I0316 16:49:47.806670 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/199c0d37-3938-4dff-bc4c-b94e06321673-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:47 crc kubenswrapper[5120]: I0316 16:49:47.806987 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/845a4572-72f5-4247-b546-c9974f7ae78d-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:47 crc kubenswrapper[5120]: I0316 16:49:47.813735 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:49:48 crc kubenswrapper[5120]: I0316 16:49:48.048195 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:49:48 crc kubenswrapper[5120]: I0316 16:49:48.175477 5120 scope.go:117] "RemoveContainer" containerID="e4568b8c4c24477e088010519cc3fe4c88c7800a42f8be6e09c85136ea3ec934" Mar 16 16:49:48 crc kubenswrapper[5120]: I0316 16:49:48.265426 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 16:49:48 crc kubenswrapper[5120]: I0316 16:49:48.267949 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/memcached-0" Mar 16 16:49:48 crc kubenswrapper[5120]: I0316 16:49:48.290817 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 16:49:48 crc kubenswrapper[5120]: I0316 16:49:48.309870 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 16:49:48 crc kubenswrapper[5120]: I0316 16:49:48.313449 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="845a4572-72f5-4247-b546-c9974f7ae78d" containerName="ceilometer-notification-agent" Mar 16 16:49:48 crc kubenswrapper[5120]: I0316 16:49:48.313476 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="845a4572-72f5-4247-b546-c9974f7ae78d" containerName="ceilometer-notification-agent" Mar 16 16:49:48 crc kubenswrapper[5120]: I0316 16:49:48.313593 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="199c0d37-3938-4dff-bc4c-b94e06321673" containerName="nova-manage" Mar 16 16:49:48 crc kubenswrapper[5120]: I0316 16:49:48.313641 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="199c0d37-3938-4dff-bc4c-b94e06321673" containerName="nova-manage" Mar 16 16:49:48 crc kubenswrapper[5120]: I0316 16:49:48.313666 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="845a4572-72f5-4247-b546-c9974f7ae78d" containerName="sg-core" Mar 16 16:49:48 crc kubenswrapper[5120]: I0316 16:49:48.313674 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="845a4572-72f5-4247-b546-c9974f7ae78d" containerName="sg-core" Mar 16 16:49:48 crc kubenswrapper[5120]: I0316 16:49:48.313732 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d4a3a13-20de-450c-b14b-9f148b93bdcc" containerName="ovn-northd" Mar 16 16:49:48 crc kubenswrapper[5120]: I0316 16:49:48.313740 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d4a3a13-20de-450c-b14b-9f148b93bdcc" containerName="ovn-northd" Mar 16 16:49:48 crc kubenswrapper[5120]: I0316 16:49:48.313751 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="845a4572-72f5-4247-b546-c9974f7ae78d" containerName="ceilometer-central-agent" Mar 16 16:49:48 crc kubenswrapper[5120]: I0316 16:49:48.313818 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="845a4572-72f5-4247-b546-c9974f7ae78d" containerName="ceilometer-central-agent" Mar 16 16:49:48 crc kubenswrapper[5120]: I0316 16:49:48.313892 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="845a4572-72f5-4247-b546-c9974f7ae78d" containerName="proxy-httpd" Mar 16 16:49:48 crc kubenswrapper[5120]: I0316 16:49:48.313902 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="845a4572-72f5-4247-b546-c9974f7ae78d" containerName="proxy-httpd" Mar 16 16:49:48 crc kubenswrapper[5120]: I0316 16:49:48.313928 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d4a3a13-20de-450c-b14b-9f148b93bdcc" containerName="openstack-network-exporter" Mar 16 16:49:48 crc kubenswrapper[5120]: I0316 16:49:48.314000 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d4a3a13-20de-450c-b14b-9f148b93bdcc" containerName="openstack-network-exporter" Mar 16 16:49:48 crc kubenswrapper[5120]: I0316 16:49:48.314352 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="845a4572-72f5-4247-b546-c9974f7ae78d" containerName="sg-core" Mar 16 16:49:48 crc kubenswrapper[5120]: I0316 16:49:48.314412 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="845a4572-72f5-4247-b546-c9974f7ae78d" containerName="proxy-httpd" Mar 16 16:49:48 crc kubenswrapper[5120]: I0316 16:49:48.314429 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="845a4572-72f5-4247-b546-c9974f7ae78d" containerName="ceilometer-notification-agent" Mar 16 16:49:48 crc kubenswrapper[5120]: I0316 16:49:48.314443 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="9d4a3a13-20de-450c-b14b-9f148b93bdcc" containerName="ovn-northd" Mar 16 16:49:48 crc kubenswrapper[5120]: I0316 16:49:48.314488 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="845a4572-72f5-4247-b546-c9974f7ae78d" containerName="ceilometer-central-agent" Mar 16 16:49:48 crc kubenswrapper[5120]: I0316 16:49:48.314507 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="199c0d37-3938-4dff-bc4c-b94e06321673" containerName="nova-manage" Mar 16 16:49:48 crc kubenswrapper[5120]: I0316 16:49:48.314524 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="9d4a3a13-20de-450c-b14b-9f148b93bdcc" containerName="openstack-network-exporter" Mar 16 16:49:48 crc kubenswrapper[5120]: I0316 16:49:48.325649 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:49:48 crc kubenswrapper[5120]: I0316 16:49:48.332976 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovnnorthd-config\"" Mar 16 16:49:48 crc kubenswrapper[5120]: I0316 16:49:48.333288 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovnnorthd-scripts\"" Mar 16 16:49:48 crc kubenswrapper[5120]: I0316 16:49:48.333433 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ovnnorthd-ovndbs\"" Mar 16 16:49:48 crc kubenswrapper[5120]: I0316 16:49:48.334753 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ovnnorthd-ovnnorthd-dockercfg-gxfx7\"" Mar 16 16:49:48 crc kubenswrapper[5120]: I0316 16:49:48.341299 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"c6ba454f-2263-4fc3-bd13-35f921464d24","Type":"ContainerStarted","Data":"b0b5305a6846284b79d23bdb4082f7f0f42d0d97115e9730ee20618a55daedc4"} Mar 16 16:49:48 crc kubenswrapper[5120]: I0316 16:49:48.342867 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:49:48 crc kubenswrapper[5120]: I0316 16:49:48.343130 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/46fdeab7-fc69-4767-85fb-6fe77323a249-scripts\") pod \"ovn-northd-0\" (UID: \"46fdeab7-fc69-4767-85fb-6fe77323a249\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:49:48 crc kubenswrapper[5120]: I0316 16:49:48.343223 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/46fdeab7-fc69-4767-85fb-6fe77323a249-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"46fdeab7-fc69-4767-85fb-6fe77323a249\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:49:48 crc kubenswrapper[5120]: I0316 16:49:48.343265 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/46fdeab7-fc69-4767-85fb-6fe77323a249-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"46fdeab7-fc69-4767-85fb-6fe77323a249\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:49:48 crc kubenswrapper[5120]: I0316 16:49:48.343315 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/46fdeab7-fc69-4767-85fb-6fe77323a249-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"46fdeab7-fc69-4767-85fb-6fe77323a249\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:49:48 crc kubenswrapper[5120]: I0316 16:49:48.343360 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/46fdeab7-fc69-4767-85fb-6fe77323a249-config\") pod \"ovn-northd-0\" (UID: \"46fdeab7-fc69-4767-85fb-6fe77323a249\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:49:48 crc kubenswrapper[5120]: I0316 16:49:48.343435 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k58nm\" (UniqueName: \"kubernetes.io/projected/46fdeab7-fc69-4767-85fb-6fe77323a249-kube-api-access-k58nm\") pod \"ovn-northd-0\" (UID: \"46fdeab7-fc69-4767-85fb-6fe77323a249\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:49:48 crc kubenswrapper[5120]: I0316 16:49:48.344662 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/46fdeab7-fc69-4767-85fb-6fe77323a249-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"46fdeab7-fc69-4767-85fb-6fe77323a249\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:49:48 crc kubenswrapper[5120]: I0316 16:49:48.367220 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 16:49:48 crc kubenswrapper[5120]: I0316 16:49:48.400260 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:49:48 crc kubenswrapper[5120]: I0316 16:49:48.425424 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:49:48 crc kubenswrapper[5120]: I0316 16:49:48.446847 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/46fdeab7-fc69-4767-85fb-6fe77323a249-config\") pod \"ovn-northd-0\" (UID: \"46fdeab7-fc69-4767-85fb-6fe77323a249\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:49:48 crc kubenswrapper[5120]: I0316 16:49:48.463238 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k58nm\" (UniqueName: \"kubernetes.io/projected/46fdeab7-fc69-4767-85fb-6fe77323a249-kube-api-access-k58nm\") pod \"ovn-northd-0\" (UID: \"46fdeab7-fc69-4767-85fb-6fe77323a249\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:49:48 crc kubenswrapper[5120]: I0316 16:49:48.463878 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/46fdeab7-fc69-4767-85fb-6fe77323a249-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"46fdeab7-fc69-4767-85fb-6fe77323a249\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:49:48 crc kubenswrapper[5120]: I0316 16:49:48.464012 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/46fdeab7-fc69-4767-85fb-6fe77323a249-scripts\") pod \"ovn-northd-0\" (UID: \"46fdeab7-fc69-4767-85fb-6fe77323a249\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:49:48 crc kubenswrapper[5120]: I0316 16:49:48.464082 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/46fdeab7-fc69-4767-85fb-6fe77323a249-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"46fdeab7-fc69-4767-85fb-6fe77323a249\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:49:48 crc kubenswrapper[5120]: I0316 16:49:48.464129 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/46fdeab7-fc69-4767-85fb-6fe77323a249-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"46fdeab7-fc69-4767-85fb-6fe77323a249\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:49:48 crc kubenswrapper[5120]: I0316 16:49:48.464223 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/46fdeab7-fc69-4767-85fb-6fe77323a249-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"46fdeab7-fc69-4767-85fb-6fe77323a249\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:49:48 crc kubenswrapper[5120]: I0316 16:49:48.449147 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/46fdeab7-fc69-4767-85fb-6fe77323a249-config\") pod \"ovn-northd-0\" (UID: \"46fdeab7-fc69-4767-85fb-6fe77323a249\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:49:48 crc kubenswrapper[5120]: I0316 16:49:48.454918 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"77fd10d5-5894-450f-bba5-8261c3ca1b4e","Type":"ContainerStarted","Data":"e99233f186dadd9cbfe0d387a7a97a27cb4ddc12f00726daadef528e5f4b6948"} Mar 16 16:49:48 crc kubenswrapper[5120]: I0316 16:49:48.455063 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:49:48 crc kubenswrapper[5120]: I0316 16:49:48.475724 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/46fdeab7-fc69-4767-85fb-6fe77323a249-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"46fdeab7-fc69-4767-85fb-6fe77323a249\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:49:48 crc kubenswrapper[5120]: I0316 16:49:48.476684 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/46fdeab7-fc69-4767-85fb-6fe77323a249-scripts\") pod \"ovn-northd-0\" (UID: \"46fdeab7-fc69-4767-85fb-6fe77323a249\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:49:48 crc kubenswrapper[5120]: I0316 16:49:48.481388 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 16:49:48 crc kubenswrapper[5120]: I0316 16:49:48.481742 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 16:49:48 crc kubenswrapper[5120]: I0316 16:49:48.482879 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"81b72eda-5dae-44c1-a720-9ca9e22cb100","Type":"ContainerStarted","Data":"5767c79fc6bfdc88326d2909a4045fd0fa6001cd3d1249601d70195496f04121"} Mar 16 16:49:48 crc kubenswrapper[5120]: I0316 16:49:48.483042 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:49:48 crc kubenswrapper[5120]: I0316 16:49:48.503399 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/46fdeab7-fc69-4767-85fb-6fe77323a249-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"46fdeab7-fc69-4767-85fb-6fe77323a249\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:49:48 crc kubenswrapper[5120]: I0316 16:49:48.504026 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:49:48 crc kubenswrapper[5120]: I0316 16:49:48.516076 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/46fdeab7-fc69-4767-85fb-6fe77323a249-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"46fdeab7-fc69-4767-85fb-6fe77323a249\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:49:48 crc kubenswrapper[5120]: I0316 16:49:48.519777 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k58nm\" (UniqueName: \"kubernetes.io/projected/46fdeab7-fc69-4767-85fb-6fe77323a249-kube-api-access-k58nm\") pod \"ovn-northd-0\" (UID: \"46fdeab7-fc69-4767-85fb-6fe77323a249\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:49:48 crc kubenswrapper[5120]: I0316 16:49:48.538252 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=8.538228194 podStartE2EDuration="8.538228194s" podCreationTimestamp="2026-03-16 16:49:40 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:49:48.515153101 +0000 UTC m=+4690.669084758" watchObservedRunningTime="2026-03-16 16:49:48.538228194 +0000 UTC m=+4690.692159851" Mar 16 16:49:48 crc kubenswrapper[5120]: I0316 16:49:48.539883 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/46fdeab7-fc69-4767-85fb-6fe77323a249-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"46fdeab7-fc69-4767-85fb-6fe77323a249\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:49:48 crc kubenswrapper[5120]: I0316 16:49:48.540351 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:49:48 crc kubenswrapper[5120]: I0316 16:49:48.562901 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:49:48 crc kubenswrapper[5120]: I0316 16:49:48.580750 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-g8bj2"] Mar 16 16:49:48 crc kubenswrapper[5120]: I0316 16:49:48.589124 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-g8bj2"] Mar 16 16:49:48 crc kubenswrapper[5120]: I0316 16:49:48.599039 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podStartSLOduration=5.599016742 podStartE2EDuration="5.599016742s" podCreationTimestamp="2026-03-16 16:49:43 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:49:48.591039823 +0000 UTC m=+4690.744971490" watchObservedRunningTime="2026-03-16 16:49:48.599016742 +0000 UTC m=+4690.752948389" Mar 16 16:49:48 crc kubenswrapper[5120]: I0316 16:49:48.687994 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e2cf7c36-f4c0-4831-8b31-480469e7da93-run-httpd\") pod \"ceilometer-0\" (UID: \"e2cf7c36-f4c0-4831-8b31-480469e7da93\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:49:48 crc kubenswrapper[5120]: I0316 16:49:48.688075 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e2cf7c36-f4c0-4831-8b31-480469e7da93-config-data\") pod \"ceilometer-0\" (UID: \"e2cf7c36-f4c0-4831-8b31-480469e7da93\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:49:48 crc kubenswrapper[5120]: I0316 16:49:48.688234 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e2cf7c36-f4c0-4831-8b31-480469e7da93-scripts\") pod \"ceilometer-0\" (UID: \"e2cf7c36-f4c0-4831-8b31-480469e7da93\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:49:48 crc kubenswrapper[5120]: I0316 16:49:48.697062 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e2cf7c36-f4c0-4831-8b31-480469e7da93-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"e2cf7c36-f4c0-4831-8b31-480469e7da93\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:49:48 crc kubenswrapper[5120]: I0316 16:49:48.697187 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mhs7\" (UniqueName: \"kubernetes.io/projected/e2cf7c36-f4c0-4831-8b31-480469e7da93-kube-api-access-6mhs7\") pod \"ceilometer-0\" (UID: \"e2cf7c36-f4c0-4831-8b31-480469e7da93\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:49:48 crc kubenswrapper[5120]: I0316 16:49:48.697246 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/e2cf7c36-f4c0-4831-8b31-480469e7da93-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"e2cf7c36-f4c0-4831-8b31-480469e7da93\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:49:48 crc kubenswrapper[5120]: I0316 16:49:48.697398 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e2cf7c36-f4c0-4831-8b31-480469e7da93-log-httpd\") pod \"ceilometer-0\" (UID: \"e2cf7c36-f4c0-4831-8b31-480469e7da93\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:49:48 crc kubenswrapper[5120]: I0316 16:49:48.726389 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:49:48 crc kubenswrapper[5120]: I0316 16:49:48.736262 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="49473f92-70a6-4bf6-b958-fe5a9e24cbb7" path="/var/lib/kubelet/pods/49473f92-70a6-4bf6-b958-fe5a9e24cbb7/volumes" Mar 16 16:49:48 crc kubenswrapper[5120]: I0316 16:49:48.737234 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="845a4572-72f5-4247-b546-c9974f7ae78d" path="/var/lib/kubelet/pods/845a4572-72f5-4247-b546-c9974f7ae78d/volumes" Mar 16 16:49:48 crc kubenswrapper[5120]: I0316 16:49:48.738407 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9d4a3a13-20de-450c-b14b-9f148b93bdcc" path="/var/lib/kubelet/pods/9d4a3a13-20de-450c-b14b-9f148b93bdcc/volumes" Mar 16 16:49:48 crc kubenswrapper[5120]: I0316 16:49:48.745686 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:49:48 crc kubenswrapper[5120]: I0316 16:49:48.798900 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-worker-576bc9cb6c-q5s4k"] Mar 16 16:49:48 crc kubenswrapper[5120]: I0316 16:49:48.807253 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e2cf7c36-f4c0-4831-8b31-480469e7da93-scripts\") pod \"ceilometer-0\" (UID: \"e2cf7c36-f4c0-4831-8b31-480469e7da93\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:49:48 crc kubenswrapper[5120]: I0316 16:49:48.807408 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e2cf7c36-f4c0-4831-8b31-480469e7da93-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"e2cf7c36-f4c0-4831-8b31-480469e7da93\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:49:48 crc kubenswrapper[5120]: I0316 16:49:48.807470 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6mhs7\" (UniqueName: \"kubernetes.io/projected/e2cf7c36-f4c0-4831-8b31-480469e7da93-kube-api-access-6mhs7\") pod \"ceilometer-0\" (UID: \"e2cf7c36-f4c0-4831-8b31-480469e7da93\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:49:48 crc kubenswrapper[5120]: I0316 16:49:48.807520 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/e2cf7c36-f4c0-4831-8b31-480469e7da93-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"e2cf7c36-f4c0-4831-8b31-480469e7da93\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:49:48 crc kubenswrapper[5120]: I0316 16:49:48.807599 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-576bc9cb6c-q5s4k" Mar 16 16:49:48 crc kubenswrapper[5120]: I0316 16:49:48.807615 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e2cf7c36-f4c0-4831-8b31-480469e7da93-log-httpd\") pod \"ceilometer-0\" (UID: \"e2cf7c36-f4c0-4831-8b31-480469e7da93\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:49:48 crc kubenswrapper[5120]: I0316 16:49:48.807827 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e2cf7c36-f4c0-4831-8b31-480469e7da93-run-httpd\") pod \"ceilometer-0\" (UID: \"e2cf7c36-f4c0-4831-8b31-480469e7da93\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:49:48 crc kubenswrapper[5120]: I0316 16:49:48.807877 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e2cf7c36-f4c0-4831-8b31-480469e7da93-config-data\") pod \"ceilometer-0\" (UID: \"e2cf7c36-f4c0-4831-8b31-480469e7da93\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:49:48 crc kubenswrapper[5120]: I0316 16:49:48.811314 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e2cf7c36-f4c0-4831-8b31-480469e7da93-log-httpd\") pod \"ceilometer-0\" (UID: \"e2cf7c36-f4c0-4831-8b31-480469e7da93\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:49:48 crc kubenswrapper[5120]: I0316 16:49:48.812158 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e2cf7c36-f4c0-4831-8b31-480469e7da93-run-httpd\") pod \"ceilometer-0\" (UID: \"e2cf7c36-f4c0-4831-8b31-480469e7da93\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:49:48 crc kubenswrapper[5120]: I0316 16:49:48.859901 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-576c5b55d6-5zsh7"] Mar 16 16:49:48 crc kubenswrapper[5120]: I0316 16:49:48.893145 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-576c5b55d6-5zsh7" Mar 16 16:49:48 crc kubenswrapper[5120]: I0316 16:49:48.913966 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mhs7\" (UniqueName: \"kubernetes.io/projected/e2cf7c36-f4c0-4831-8b31-480469e7da93-kube-api-access-6mhs7\") pod \"ceilometer-0\" (UID: \"e2cf7c36-f4c0-4831-8b31-480469e7da93\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:49:48 crc kubenswrapper[5120]: I0316 16:49:48.925836 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-576bc9cb6c-q5s4k"] Mar 16 16:49:48 crc kubenswrapper[5120]: I0316 16:49:48.960397 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 16:49:48 crc kubenswrapper[5120]: I0316 16:49:48.960602 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="e93e7d0f-2924-48c0-bc57-3a9597f83d70" containerName="nova-cell1-conductor-conductor" containerID="cri-o://731ac2f25a5505892d3ba2b5085eb8ac263c0111abf4d7334a1812bbc50579a5" gracePeriod=30 Mar 16 16:49:48 crc kubenswrapper[5120]: I0316 16:49:48.964026 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/e2cf7c36-f4c0-4831-8b31-480469e7da93-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"e2cf7c36-f4c0-4831-8b31-480469e7da93\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:49:48 crc kubenswrapper[5120]: I0316 16:49:48.969963 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e2cf7c36-f4c0-4831-8b31-480469e7da93-scripts\") pod \"ceilometer-0\" (UID: \"e2cf7c36-f4c0-4831-8b31-480469e7da93\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:49:48 crc kubenswrapper[5120]: I0316 16:49:48.973787 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e2cf7c36-f4c0-4831-8b31-480469e7da93-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"e2cf7c36-f4c0-4831-8b31-480469e7da93\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:48.999544 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-576c5b55d6-5zsh7"] Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.001741 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e2cf7c36-f4c0-4831-8b31-480469e7da93-config-data\") pod \"ceilometer-0\" (UID: \"e2cf7c36-f4c0-4831-8b31-480469e7da93\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.015566 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fb4496e5-279b-4520-a345-c4ed00ede8c9-combined-ca-bundle\") pod \"barbican-keystone-listener-576c5b55d6-5zsh7\" (UID: \"fb4496e5-279b-4520-a345-c4ed00ede8c9\") " pod="openstack-kuttl-tests/barbican-keystone-listener-576c5b55d6-5zsh7" Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.015633 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/976611b4-4a36-49a3-9bd6-f7b5ca2899f4-logs\") pod \"barbican-worker-576bc9cb6c-q5s4k\" (UID: \"976611b4-4a36-49a3-9bd6-f7b5ca2899f4\") " pod="openstack-kuttl-tests/barbican-worker-576bc9cb6c-q5s4k" Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.015671 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fb4496e5-279b-4520-a345-c4ed00ede8c9-config-data\") pod \"barbican-keystone-listener-576c5b55d6-5zsh7\" (UID: \"fb4496e5-279b-4520-a345-c4ed00ede8c9\") " pod="openstack-kuttl-tests/barbican-keystone-listener-576c5b55d6-5zsh7" Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.015733 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/976611b4-4a36-49a3-9bd6-f7b5ca2899f4-config-data\") pod \"barbican-worker-576bc9cb6c-q5s4k\" (UID: \"976611b4-4a36-49a3-9bd6-f7b5ca2899f4\") " pod="openstack-kuttl-tests/barbican-worker-576bc9cb6c-q5s4k" Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.015749 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/976611b4-4a36-49a3-9bd6-f7b5ca2899f4-config-data-custom\") pod \"barbican-worker-576bc9cb6c-q5s4k\" (UID: \"976611b4-4a36-49a3-9bd6-f7b5ca2899f4\") " pod="openstack-kuttl-tests/barbican-worker-576bc9cb6c-q5s4k" Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.015780 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/976611b4-4a36-49a3-9bd6-f7b5ca2899f4-combined-ca-bundle\") pod \"barbican-worker-576bc9cb6c-q5s4k\" (UID: \"976611b4-4a36-49a3-9bd6-f7b5ca2899f4\") " pod="openstack-kuttl-tests/barbican-worker-576bc9cb6c-q5s4k" Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.015795 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwp88\" (UniqueName: \"kubernetes.io/projected/fb4496e5-279b-4520-a345-c4ed00ede8c9-kube-api-access-kwp88\") pod \"barbican-keystone-listener-576c5b55d6-5zsh7\" (UID: \"fb4496e5-279b-4520-a345-c4ed00ede8c9\") " pod="openstack-kuttl-tests/barbican-keystone-listener-576c5b55d6-5zsh7" Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.015910 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/fb4496e5-279b-4520-a345-c4ed00ede8c9-logs\") pod \"barbican-keystone-listener-576c5b55d6-5zsh7\" (UID: \"fb4496e5-279b-4520-a345-c4ed00ede8c9\") " pod="openstack-kuttl-tests/barbican-keystone-listener-576c5b55d6-5zsh7" Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.015954 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrgnj\" (UniqueName: \"kubernetes.io/projected/976611b4-4a36-49a3-9bd6-f7b5ca2899f4-kube-api-access-zrgnj\") pod \"barbican-worker-576bc9cb6c-q5s4k\" (UID: \"976611b4-4a36-49a3-9bd6-f7b5ca2899f4\") " pod="openstack-kuttl-tests/barbican-worker-576bc9cb6c-q5s4k" Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.016022 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/fb4496e5-279b-4520-a345-c4ed00ede8c9-config-data-custom\") pod \"barbican-keystone-listener-576c5b55d6-5zsh7\" (UID: \"fb4496e5-279b-4520-a345-c4ed00ede8c9\") " pod="openstack-kuttl-tests/barbican-keystone-listener-576c5b55d6-5zsh7" Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.041323 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.043560 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-g9ds4"] Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.119744 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-678df6fbdb-lfhdz"] Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.120210 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-678df6fbdb-lfhdz" podUID="398bb1bd-f380-4374-b880-d7217d37e010" containerName="neutron-api" containerID="cri-o://357e8754e619bde82ee9a20e2bb6e7f080cf0e315df9fb1354335a7aa606bd9f" gracePeriod=30 Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.120439 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-g9ds4" Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.121725 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-678df6fbdb-lfhdz" podUID="398bb1bd-f380-4374-b880-d7217d37e010" containerName="neutron-httpd" containerID="cri-o://b932247b64920daaa5151fe9bb97c9f517c85a794047e555fbd45772a062a8e1" gracePeriod=30 Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.136982 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"osp-secret\"" Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.160485 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/fb4496e5-279b-4520-a345-c4ed00ede8c9-logs\") pod \"barbican-keystone-listener-576c5b55d6-5zsh7\" (UID: \"fb4496e5-279b-4520-a345-c4ed00ede8c9\") " pod="openstack-kuttl-tests/barbican-keystone-listener-576c5b55d6-5zsh7" Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.160621 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zrgnj\" (UniqueName: \"kubernetes.io/projected/976611b4-4a36-49a3-9bd6-f7b5ca2899f4-kube-api-access-zrgnj\") pod \"barbican-worker-576bc9cb6c-q5s4k\" (UID: \"976611b4-4a36-49a3-9bd6-f7b5ca2899f4\") " pod="openstack-kuttl-tests/barbican-worker-576bc9cb6c-q5s4k" Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.160800 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/fb4496e5-279b-4520-a345-c4ed00ede8c9-config-data-custom\") pod \"barbican-keystone-listener-576c5b55d6-5zsh7\" (UID: \"fb4496e5-279b-4520-a345-c4ed00ede8c9\") " pod="openstack-kuttl-tests/barbican-keystone-listener-576c5b55d6-5zsh7" Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.161689 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/fb4496e5-279b-4520-a345-c4ed00ede8c9-logs\") pod \"barbican-keystone-listener-576c5b55d6-5zsh7\" (UID: \"fb4496e5-279b-4520-a345-c4ed00ede8c9\") " pod="openstack-kuttl-tests/barbican-keystone-listener-576c5b55d6-5zsh7" Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.169122 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-g9ds4"] Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.170154 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fb4496e5-279b-4520-a345-c4ed00ede8c9-combined-ca-bundle\") pod \"barbican-keystone-listener-576c5b55d6-5zsh7\" (UID: \"fb4496e5-279b-4520-a345-c4ed00ede8c9\") " pod="openstack-kuttl-tests/barbican-keystone-listener-576c5b55d6-5zsh7" Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.170256 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/976611b4-4a36-49a3-9bd6-f7b5ca2899f4-logs\") pod \"barbican-worker-576bc9cb6c-q5s4k\" (UID: \"976611b4-4a36-49a3-9bd6-f7b5ca2899f4\") " pod="openstack-kuttl-tests/barbican-worker-576bc9cb6c-q5s4k" Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.170303 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fb4496e5-279b-4520-a345-c4ed00ede8c9-config-data\") pod \"barbican-keystone-listener-576c5b55d6-5zsh7\" (UID: \"fb4496e5-279b-4520-a345-c4ed00ede8c9\") " pod="openstack-kuttl-tests/barbican-keystone-listener-576c5b55d6-5zsh7" Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.170393 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/976611b4-4a36-49a3-9bd6-f7b5ca2899f4-config-data\") pod \"barbican-worker-576bc9cb6c-q5s4k\" (UID: \"976611b4-4a36-49a3-9bd6-f7b5ca2899f4\") " pod="openstack-kuttl-tests/barbican-worker-576bc9cb6c-q5s4k" Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.170421 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/976611b4-4a36-49a3-9bd6-f7b5ca2899f4-config-data-custom\") pod \"barbican-worker-576bc9cb6c-q5s4k\" (UID: \"976611b4-4a36-49a3-9bd6-f7b5ca2899f4\") " pod="openstack-kuttl-tests/barbican-worker-576bc9cb6c-q5s4k" Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.170441 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/976611b4-4a36-49a3-9bd6-f7b5ca2899f4-combined-ca-bundle\") pod \"barbican-worker-576bc9cb6c-q5s4k\" (UID: \"976611b4-4a36-49a3-9bd6-f7b5ca2899f4\") " pod="openstack-kuttl-tests/barbican-worker-576bc9cb6c-q5s4k" Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.170463 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kwp88\" (UniqueName: \"kubernetes.io/projected/fb4496e5-279b-4520-a345-c4ed00ede8c9-kube-api-access-kwp88\") pod \"barbican-keystone-listener-576c5b55d6-5zsh7\" (UID: \"fb4496e5-279b-4520-a345-c4ed00ede8c9\") " pod="openstack-kuttl-tests/barbican-keystone-listener-576c5b55d6-5zsh7" Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.183673 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-api-5698458656-mpwfb"] Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.203649 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/neutron-678df6fbdb-lfhdz" podUID="398bb1bd-f380-4374-b880-d7217d37e010" containerName="neutron-httpd" probeResult="failure" output="Get \"http://10.217.1.222:9696/\": EOF" Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.229729 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/976611b4-4a36-49a3-9bd6-f7b5ca2899f4-logs\") pod \"barbican-worker-576bc9cb6c-q5s4k\" (UID: \"976611b4-4a36-49a3-9bd6-f7b5ca2899f4\") " pod="openstack-kuttl-tests/barbican-worker-576bc9cb6c-q5s4k" Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.233625 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fb4496e5-279b-4520-a345-c4ed00ede8c9-config-data\") pod \"barbican-keystone-listener-576c5b55d6-5zsh7\" (UID: \"fb4496e5-279b-4520-a345-c4ed00ede8c9\") " pod="openstack-kuttl-tests/barbican-keystone-listener-576c5b55d6-5zsh7" Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.241017 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwp88\" (UniqueName: \"kubernetes.io/projected/fb4496e5-279b-4520-a345-c4ed00ede8c9-kube-api-access-kwp88\") pod \"barbican-keystone-listener-576c5b55d6-5zsh7\" (UID: \"fb4496e5-279b-4520-a345-c4ed00ede8c9\") " pod="openstack-kuttl-tests/barbican-keystone-listener-576c5b55d6-5zsh7" Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.246073 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/976611b4-4a36-49a3-9bd6-f7b5ca2899f4-config-data-custom\") pod \"barbican-worker-576bc9cb6c-q5s4k\" (UID: \"976611b4-4a36-49a3-9bd6-f7b5ca2899f4\") " pod="openstack-kuttl-tests/barbican-worker-576bc9cb6c-q5s4k" Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.257720 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fb4496e5-279b-4520-a345-c4ed00ede8c9-combined-ca-bundle\") pod \"barbican-keystone-listener-576c5b55d6-5zsh7\" (UID: \"fb4496e5-279b-4520-a345-c4ed00ede8c9\") " pod="openstack-kuttl-tests/barbican-keystone-listener-576c5b55d6-5zsh7" Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.261692 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/fb4496e5-279b-4520-a345-c4ed00ede8c9-config-data-custom\") pod \"barbican-keystone-listener-576c5b55d6-5zsh7\" (UID: \"fb4496e5-279b-4520-a345-c4ed00ede8c9\") " pod="openstack-kuttl-tests/barbican-keystone-listener-576c5b55d6-5zsh7" Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.265032 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/976611b4-4a36-49a3-9bd6-f7b5ca2899f4-config-data\") pod \"barbican-worker-576bc9cb6c-q5s4k\" (UID: \"976611b4-4a36-49a3-9bd6-f7b5ca2899f4\") " pod="openstack-kuttl-tests/barbican-worker-576bc9cb6c-q5s4k" Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.266046 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-77797b894-rctcp"] Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.266199 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-745d8c69c6-mxmrn"] Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.272055 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-5698458656-mpwfb" Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.276973 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/eab40383-182c-4760-80e0-652dc37d1e68-scripts\") pod \"keystone-bootstrap-g9ds4\" (UID: \"eab40383-182c-4760-80e0-652dc37d1e68\") " pod="openstack-kuttl-tests/keystone-bootstrap-g9ds4" Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.278879 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/eab40383-182c-4760-80e0-652dc37d1e68-credential-keys\") pod \"keystone-bootstrap-g9ds4\" (UID: \"eab40383-182c-4760-80e0-652dc37d1e68\") " pod="openstack-kuttl-tests/keystone-bootstrap-g9ds4" Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.280388 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/eab40383-182c-4760-80e0-652dc37d1e68-config-data\") pod \"keystone-bootstrap-g9ds4\" (UID: \"eab40383-182c-4760-80e0-652dc37d1e68\") " pod="openstack-kuttl-tests/keystone-bootstrap-g9ds4" Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.280702 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eab40383-182c-4760-80e0-652dc37d1e68-combined-ca-bundle\") pod \"keystone-bootstrap-g9ds4\" (UID: \"eab40383-182c-4760-80e0-652dc37d1e68\") " pod="openstack-kuttl-tests/keystone-bootstrap-g9ds4" Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.280790 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/eab40383-182c-4760-80e0-652dc37d1e68-fernet-keys\") pod \"keystone-bootstrap-g9ds4\" (UID: \"eab40383-182c-4760-80e0-652dc37d1e68\") " pod="openstack-kuttl-tests/keystone-bootstrap-g9ds4" Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.280947 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmqfc\" (UniqueName: \"kubernetes.io/projected/eab40383-182c-4760-80e0-652dc37d1e68-kube-api-access-mmqfc\") pod \"keystone-bootstrap-g9ds4\" (UID: \"eab40383-182c-4760-80e0-652dc37d1e68\") " pod="openstack-kuttl-tests/keystone-bootstrap-g9ds4" Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.306322 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-745d8c69c6-mxmrn" Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.321818 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-5698458656-mpwfb"] Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.371639 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrgnj\" (UniqueName: \"kubernetes.io/projected/976611b4-4a36-49a3-9bd6-f7b5ca2899f4-kube-api-access-zrgnj\") pod \"barbican-worker-576bc9cb6c-q5s4k\" (UID: \"976611b4-4a36-49a3-9bd6-f7b5ca2899f4\") " pod="openstack-kuttl-tests/barbican-worker-576bc9cb6c-q5s4k" Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.374695 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/976611b4-4a36-49a3-9bd6-f7b5ca2899f4-combined-ca-bundle\") pod \"barbican-worker-576bc9cb6c-q5s4k\" (UID: \"976611b4-4a36-49a3-9bd6-f7b5ca2899f4\") " pod="openstack-kuttl-tests/barbican-worker-576bc9cb6c-q5s4k" Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.383623 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6e401532-2076-4686-b3cd-59b0629d8a98-combined-ca-bundle\") pod \"neutron-745d8c69c6-mxmrn\" (UID: \"6e401532-2076-4686-b3cd-59b0629d8a98\") " pod="openstack-kuttl-tests/neutron-745d8c69c6-mxmrn" Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.383688 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2743712c-9e9b-43d6-b07e-19ec95dc3be7-combined-ca-bundle\") pod \"barbican-api-5698458656-mpwfb\" (UID: \"2743712c-9e9b-43d6-b07e-19ec95dc3be7\") " pod="openstack-kuttl-tests/barbican-api-5698458656-mpwfb" Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.383728 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mmqfc\" (UniqueName: \"kubernetes.io/projected/eab40383-182c-4760-80e0-652dc37d1e68-kube-api-access-mmqfc\") pod \"keystone-bootstrap-g9ds4\" (UID: \"eab40383-182c-4760-80e0-652dc37d1e68\") " pod="openstack-kuttl-tests/keystone-bootstrap-g9ds4" Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.383804 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/6e401532-2076-4686-b3cd-59b0629d8a98-httpd-config\") pod \"neutron-745d8c69c6-mxmrn\" (UID: \"6e401532-2076-4686-b3cd-59b0629d8a98\") " pod="openstack-kuttl-tests/neutron-745d8c69c6-mxmrn" Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.383836 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxqjk\" (UniqueName: \"kubernetes.io/projected/6e401532-2076-4686-b3cd-59b0629d8a98-kube-api-access-mxqjk\") pod \"neutron-745d8c69c6-mxmrn\" (UID: \"6e401532-2076-4686-b3cd-59b0629d8a98\") " pod="openstack-kuttl-tests/neutron-745d8c69c6-mxmrn" Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.383890 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2743712c-9e9b-43d6-b07e-19ec95dc3be7-logs\") pod \"barbican-api-5698458656-mpwfb\" (UID: \"2743712c-9e9b-43d6-b07e-19ec95dc3be7\") " pod="openstack-kuttl-tests/barbican-api-5698458656-mpwfb" Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.383921 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6e401532-2076-4686-b3cd-59b0629d8a98-config\") pod \"neutron-745d8c69c6-mxmrn\" (UID: \"6e401532-2076-4686-b3cd-59b0629d8a98\") " pod="openstack-kuttl-tests/neutron-745d8c69c6-mxmrn" Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.384017 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6lklb\" (UniqueName: \"kubernetes.io/projected/2743712c-9e9b-43d6-b07e-19ec95dc3be7-kube-api-access-6lklb\") pod \"barbican-api-5698458656-mpwfb\" (UID: \"2743712c-9e9b-43d6-b07e-19ec95dc3be7\") " pod="openstack-kuttl-tests/barbican-api-5698458656-mpwfb" Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.384120 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/eab40383-182c-4760-80e0-652dc37d1e68-scripts\") pod \"keystone-bootstrap-g9ds4\" (UID: \"eab40383-182c-4760-80e0-652dc37d1e68\") " pod="openstack-kuttl-tests/keystone-bootstrap-g9ds4" Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.384145 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/eab40383-182c-4760-80e0-652dc37d1e68-credential-keys\") pod \"keystone-bootstrap-g9ds4\" (UID: \"eab40383-182c-4760-80e0-652dc37d1e68\") " pod="openstack-kuttl-tests/keystone-bootstrap-g9ds4" Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.384179 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/eab40383-182c-4760-80e0-652dc37d1e68-config-data\") pod \"keystone-bootstrap-g9ds4\" (UID: \"eab40383-182c-4760-80e0-652dc37d1e68\") " pod="openstack-kuttl-tests/keystone-bootstrap-g9ds4" Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.384217 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2743712c-9e9b-43d6-b07e-19ec95dc3be7-config-data\") pod \"barbican-api-5698458656-mpwfb\" (UID: \"2743712c-9e9b-43d6-b07e-19ec95dc3be7\") " pod="openstack-kuttl-tests/barbican-api-5698458656-mpwfb" Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.384350 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/2743712c-9e9b-43d6-b07e-19ec95dc3be7-config-data-custom\") pod \"barbican-api-5698458656-mpwfb\" (UID: \"2743712c-9e9b-43d6-b07e-19ec95dc3be7\") " pod="openstack-kuttl-tests/barbican-api-5698458656-mpwfb" Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.384379 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eab40383-182c-4760-80e0-652dc37d1e68-combined-ca-bundle\") pod \"keystone-bootstrap-g9ds4\" (UID: \"eab40383-182c-4760-80e0-652dc37d1e68\") " pod="openstack-kuttl-tests/keystone-bootstrap-g9ds4" Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.384417 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/eab40383-182c-4760-80e0-652dc37d1e68-fernet-keys\") pod \"keystone-bootstrap-g9ds4\" (UID: \"eab40383-182c-4760-80e0-652dc37d1e68\") " pod="openstack-kuttl-tests/keystone-bootstrap-g9ds4" Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.410238 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/eab40383-182c-4760-80e0-652dc37d1e68-config-data\") pod \"keystone-bootstrap-g9ds4\" (UID: \"eab40383-182c-4760-80e0-652dc37d1e68\") " pod="openstack-kuttl-tests/keystone-bootstrap-g9ds4" Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.410347 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eab40383-182c-4760-80e0-652dc37d1e68-combined-ca-bundle\") pod \"keystone-bootstrap-g9ds4\" (UID: \"eab40383-182c-4760-80e0-652dc37d1e68\") " pod="openstack-kuttl-tests/keystone-bootstrap-g9ds4" Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.410539 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/eab40383-182c-4760-80e0-652dc37d1e68-scripts\") pod \"keystone-bootstrap-g9ds4\" (UID: \"eab40383-182c-4760-80e0-652dc37d1e68\") " pod="openstack-kuttl-tests/keystone-bootstrap-g9ds4" Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.415702 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmqfc\" (UniqueName: \"kubernetes.io/projected/eab40383-182c-4760-80e0-652dc37d1e68-kube-api-access-mmqfc\") pod \"keystone-bootstrap-g9ds4\" (UID: \"eab40383-182c-4760-80e0-652dc37d1e68\") " pod="openstack-kuttl-tests/keystone-bootstrap-g9ds4" Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.417428 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/eab40383-182c-4760-80e0-652dc37d1e68-credential-keys\") pod \"keystone-bootstrap-g9ds4\" (UID: \"eab40383-182c-4760-80e0-652dc37d1e68\") " pod="openstack-kuttl-tests/keystone-bootstrap-g9ds4" Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.426846 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-7d79f76d78-2wccd"] Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.439498 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/eab40383-182c-4760-80e0-652dc37d1e68-fernet-keys\") pod \"keystone-bootstrap-g9ds4\" (UID: \"eab40383-182c-4760-80e0-652dc37d1e68\") " pod="openstack-kuttl-tests/keystone-bootstrap-g9ds4" Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.452338 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-7d79f76d78-2wccd" Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.474061 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-7d79f76d78-2wccd"] Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.485909 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/6e401532-2076-4686-b3cd-59b0629d8a98-httpd-config\") pod \"neutron-745d8c69c6-mxmrn\" (UID: \"6e401532-2076-4686-b3cd-59b0629d8a98\") " pod="openstack-kuttl-tests/neutron-745d8c69c6-mxmrn" Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.485954 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mxqjk\" (UniqueName: \"kubernetes.io/projected/6e401532-2076-4686-b3cd-59b0629d8a98-kube-api-access-mxqjk\") pod \"neutron-745d8c69c6-mxmrn\" (UID: \"6e401532-2076-4686-b3cd-59b0629d8a98\") " pod="openstack-kuttl-tests/neutron-745d8c69c6-mxmrn" Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.485999 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2743712c-9e9b-43d6-b07e-19ec95dc3be7-logs\") pod \"barbican-api-5698458656-mpwfb\" (UID: \"2743712c-9e9b-43d6-b07e-19ec95dc3be7\") " pod="openstack-kuttl-tests/barbican-api-5698458656-mpwfb" Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.486031 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6e401532-2076-4686-b3cd-59b0629d8a98-config\") pod \"neutron-745d8c69c6-mxmrn\" (UID: \"6e401532-2076-4686-b3cd-59b0629d8a98\") " pod="openstack-kuttl-tests/neutron-745d8c69c6-mxmrn" Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.486050 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/76725a9c-9344-4783-879a-a5ccfb8ba113-internal-tls-certs\") pod \"placement-7d79f76d78-2wccd\" (UID: \"76725a9c-9344-4783-879a-a5ccfb8ba113\") " pod="openstack-kuttl-tests/placement-7d79f76d78-2wccd" Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.486149 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6lklb\" (UniqueName: \"kubernetes.io/projected/2743712c-9e9b-43d6-b07e-19ec95dc3be7-kube-api-access-6lklb\") pod \"barbican-api-5698458656-mpwfb\" (UID: \"2743712c-9e9b-43d6-b07e-19ec95dc3be7\") " pod="openstack-kuttl-tests/barbican-api-5698458656-mpwfb" Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.486253 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-584mp\" (UniqueName: \"kubernetes.io/projected/76725a9c-9344-4783-879a-a5ccfb8ba113-kube-api-access-584mp\") pod \"placement-7d79f76d78-2wccd\" (UID: \"76725a9c-9344-4783-879a-a5ccfb8ba113\") " pod="openstack-kuttl-tests/placement-7d79f76d78-2wccd" Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.486275 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2743712c-9e9b-43d6-b07e-19ec95dc3be7-config-data\") pod \"barbican-api-5698458656-mpwfb\" (UID: \"2743712c-9e9b-43d6-b07e-19ec95dc3be7\") " pod="openstack-kuttl-tests/barbican-api-5698458656-mpwfb" Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.486381 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/76725a9c-9344-4783-879a-a5ccfb8ba113-scripts\") pod \"placement-7d79f76d78-2wccd\" (UID: \"76725a9c-9344-4783-879a-a5ccfb8ba113\") " pod="openstack-kuttl-tests/placement-7d79f76d78-2wccd" Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.486397 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/76725a9c-9344-4783-879a-a5ccfb8ba113-config-data\") pod \"placement-7d79f76d78-2wccd\" (UID: \"76725a9c-9344-4783-879a-a5ccfb8ba113\") " pod="openstack-kuttl-tests/placement-7d79f76d78-2wccd" Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.486426 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/2743712c-9e9b-43d6-b07e-19ec95dc3be7-config-data-custom\") pod \"barbican-api-5698458656-mpwfb\" (UID: \"2743712c-9e9b-43d6-b07e-19ec95dc3be7\") " pod="openstack-kuttl-tests/barbican-api-5698458656-mpwfb" Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.486463 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/76725a9c-9344-4783-879a-a5ccfb8ba113-logs\") pod \"placement-7d79f76d78-2wccd\" (UID: \"76725a9c-9344-4783-879a-a5ccfb8ba113\") " pod="openstack-kuttl-tests/placement-7d79f76d78-2wccd" Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.486514 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6e401532-2076-4686-b3cd-59b0629d8a98-combined-ca-bundle\") pod \"neutron-745d8c69c6-mxmrn\" (UID: \"6e401532-2076-4686-b3cd-59b0629d8a98\") " pod="openstack-kuttl-tests/neutron-745d8c69c6-mxmrn" Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.486550 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2743712c-9e9b-43d6-b07e-19ec95dc3be7-combined-ca-bundle\") pod \"barbican-api-5698458656-mpwfb\" (UID: \"2743712c-9e9b-43d6-b07e-19ec95dc3be7\") " pod="openstack-kuttl-tests/barbican-api-5698458656-mpwfb" Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.486595 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/76725a9c-9344-4783-879a-a5ccfb8ba113-public-tls-certs\") pod \"placement-7d79f76d78-2wccd\" (UID: \"76725a9c-9344-4783-879a-a5ccfb8ba113\") " pod="openstack-kuttl-tests/placement-7d79f76d78-2wccd" Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.486625 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/76725a9c-9344-4783-879a-a5ccfb8ba113-combined-ca-bundle\") pod \"placement-7d79f76d78-2wccd\" (UID: \"76725a9c-9344-4783-879a-a5ccfb8ba113\") " pod="openstack-kuttl-tests/placement-7d79f76d78-2wccd" Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.496721 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2743712c-9e9b-43d6-b07e-19ec95dc3be7-logs\") pod \"barbican-api-5698458656-mpwfb\" (UID: \"2743712c-9e9b-43d6-b07e-19ec95dc3be7\") " pod="openstack-kuttl-tests/barbican-api-5698458656-mpwfb" Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.509036 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/6e401532-2076-4686-b3cd-59b0629d8a98-httpd-config\") pod \"neutron-745d8c69c6-mxmrn\" (UID: \"6e401532-2076-4686-b3cd-59b0629d8a98\") " pod="openstack-kuttl-tests/neutron-745d8c69c6-mxmrn" Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.510717 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2743712c-9e9b-43d6-b07e-19ec95dc3be7-config-data\") pod \"barbican-api-5698458656-mpwfb\" (UID: \"2743712c-9e9b-43d6-b07e-19ec95dc3be7\") " pod="openstack-kuttl-tests/barbican-api-5698458656-mpwfb" Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.516661 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2743712c-9e9b-43d6-b07e-19ec95dc3be7-combined-ca-bundle\") pod \"barbican-api-5698458656-mpwfb\" (UID: \"2743712c-9e9b-43d6-b07e-19ec95dc3be7\") " pod="openstack-kuttl-tests/barbican-api-5698458656-mpwfb" Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.541817 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-745d8c69c6-mxmrn"] Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.568854 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.602516 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-584mp\" (UniqueName: \"kubernetes.io/projected/76725a9c-9344-4783-879a-a5ccfb8ba113-kube-api-access-584mp\") pod \"placement-7d79f76d78-2wccd\" (UID: \"76725a9c-9344-4783-879a-a5ccfb8ba113\") " pod="openstack-kuttl-tests/placement-7d79f76d78-2wccd" Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.602668 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/76725a9c-9344-4783-879a-a5ccfb8ba113-scripts\") pod \"placement-7d79f76d78-2wccd\" (UID: \"76725a9c-9344-4783-879a-a5ccfb8ba113\") " pod="openstack-kuttl-tests/placement-7d79f76d78-2wccd" Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.602691 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/76725a9c-9344-4783-879a-a5ccfb8ba113-config-data\") pod \"placement-7d79f76d78-2wccd\" (UID: \"76725a9c-9344-4783-879a-a5ccfb8ba113\") " pod="openstack-kuttl-tests/placement-7d79f76d78-2wccd" Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.602733 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/76725a9c-9344-4783-879a-a5ccfb8ba113-logs\") pod \"placement-7d79f76d78-2wccd\" (UID: \"76725a9c-9344-4783-879a-a5ccfb8ba113\") " pod="openstack-kuttl-tests/placement-7d79f76d78-2wccd" Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.602873 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/76725a9c-9344-4783-879a-a5ccfb8ba113-public-tls-certs\") pod \"placement-7d79f76d78-2wccd\" (UID: \"76725a9c-9344-4783-879a-a5ccfb8ba113\") " pod="openstack-kuttl-tests/placement-7d79f76d78-2wccd" Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.602903 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/76725a9c-9344-4783-879a-a5ccfb8ba113-combined-ca-bundle\") pod \"placement-7d79f76d78-2wccd\" (UID: \"76725a9c-9344-4783-879a-a5ccfb8ba113\") " pod="openstack-kuttl-tests/placement-7d79f76d78-2wccd" Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.603001 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/76725a9c-9344-4783-879a-a5ccfb8ba113-internal-tls-certs\") pod \"placement-7d79f76d78-2wccd\" (UID: \"76725a9c-9344-4783-879a-a5ccfb8ba113\") " pod="openstack-kuttl-tests/placement-7d79f76d78-2wccd" Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.604450 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/2743712c-9e9b-43d6-b07e-19ec95dc3be7-config-data-custom\") pod \"barbican-api-5698458656-mpwfb\" (UID: \"2743712c-9e9b-43d6-b07e-19ec95dc3be7\") " pod="openstack-kuttl-tests/barbican-api-5698458656-mpwfb" Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.604501 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6e401532-2076-4686-b3cd-59b0629d8a98-combined-ca-bundle\") pod \"neutron-745d8c69c6-mxmrn\" (UID: \"6e401532-2076-4686-b3cd-59b0629d8a98\") " pod="openstack-kuttl-tests/neutron-745d8c69c6-mxmrn" Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.606298 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/76725a9c-9344-4783-879a-a5ccfb8ba113-logs\") pod \"placement-7d79f76d78-2wccd\" (UID: \"76725a9c-9344-4783-879a-a5ccfb8ba113\") " pod="openstack-kuttl-tests/placement-7d79f76d78-2wccd" Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.611401 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/6e401532-2076-4686-b3cd-59b0629d8a98-config\") pod \"neutron-745d8c69c6-mxmrn\" (UID: \"6e401532-2076-4686-b3cd-59b0629d8a98\") " pod="openstack-kuttl-tests/neutron-745d8c69c6-mxmrn" Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.612774 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6lklb\" (UniqueName: \"kubernetes.io/projected/2743712c-9e9b-43d6-b07e-19ec95dc3be7-kube-api-access-6lklb\") pod \"barbican-api-5698458656-mpwfb\" (UID: \"2743712c-9e9b-43d6-b07e-19ec95dc3be7\") " pod="openstack-kuttl-tests/barbican-api-5698458656-mpwfb" Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.615377 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.616817 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxqjk\" (UniqueName: \"kubernetes.io/projected/6e401532-2076-4686-b3cd-59b0629d8a98-kube-api-access-mxqjk\") pod \"neutron-745d8c69c6-mxmrn\" (UID: \"6e401532-2076-4686-b3cd-59b0629d8a98\") " pod="openstack-kuttl-tests/neutron-745d8c69c6-mxmrn" Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.617445 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/76725a9c-9344-4783-879a-a5ccfb8ba113-config-data\") pod \"placement-7d79f76d78-2wccd\" (UID: \"76725a9c-9344-4783-879a-a5ccfb8ba113\") " pod="openstack-kuttl-tests/placement-7d79f76d78-2wccd" Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.618724 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/76725a9c-9344-4783-879a-a5ccfb8ba113-scripts\") pod \"placement-7d79f76d78-2wccd\" (UID: \"76725a9c-9344-4783-879a-a5ccfb8ba113\") " pod="openstack-kuttl-tests/placement-7d79f76d78-2wccd" Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.620266 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"d6038d72-b1a2-4d71-b831-d5fa1de027a7","Type":"ContainerStarted","Data":"f70311d415dc9cf04b16655a0e023649f8f9eefdc08997f434414134d73c229f"} Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.621269 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/76725a9c-9344-4783-879a-a5ccfb8ba113-public-tls-certs\") pod \"placement-7d79f76d78-2wccd\" (UID: \"76725a9c-9344-4783-879a-a5ccfb8ba113\") " pod="openstack-kuttl-tests/placement-7d79f76d78-2wccd" Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.682737 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/76725a9c-9344-4783-879a-a5ccfb8ba113-combined-ca-bundle\") pod \"placement-7d79f76d78-2wccd\" (UID: \"76725a9c-9344-4783-879a-a5ccfb8ba113\") " pod="openstack-kuttl-tests/placement-7d79f76d78-2wccd" Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.683193 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/76725a9c-9344-4783-879a-a5ccfb8ba113-internal-tls-certs\") pod \"placement-7d79f76d78-2wccd\" (UID: \"76725a9c-9344-4783-879a-a5ccfb8ba113\") " pod="openstack-kuttl-tests/placement-7d79f76d78-2wccd" Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.713581 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-584mp\" (UniqueName: \"kubernetes.io/projected/76725a9c-9344-4783-879a-a5ccfb8ba113-kube-api-access-584mp\") pod \"placement-7d79f76d78-2wccd\" (UID: \"76725a9c-9344-4783-879a-a5ccfb8ba113\") " pod="openstack-kuttl-tests/placement-7d79f76d78-2wccd" Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.717702 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"b0528e86-65e5-4d4c-9dd9-4cd6b9475cbc","Type":"ContainerStarted","Data":"17fae53bebd68929640aced62b696757a63ddac64d6806e132818ca836ccc804"} Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.798700 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"3b14f53d-9d11-42e8-b823-65b88191e532","Type":"ContainerStarted","Data":"e979fc4bbbbee656bb574a38e76d8d095ee03dac2aa27609130add421f993387"} Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.801870 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-5c574fdfbb-8rvsq_8931787a-1e50-415c-8d97-6c2ab294b4f4/neutron-api/0.log" Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.801907 5120 generic.go:358] "Generic (PLEG): container finished" podID="8931787a-1e50-415c-8d97-6c2ab294b4f4" containerID="d8e6f9c22bd7d66c182898a8c06b4817335fd2fd9d4c4e0036cdaca44ef91a73" exitCode=1 Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.802038 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-5c574fdfbb-8rvsq" event={"ID":"8931787a-1e50-415c-8d97-6c2ab294b4f4","Type":"ContainerDied","Data":"d8e6f9c22bd7d66c182898a8c06b4817335fd2fd9d4c4e0036cdaca44ef91a73"} Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.818869 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-77797b894-rctcp" event={"ID":"710921c8-80e7-46a5-8792-8ffc9795500c","Type":"ContainerStarted","Data":"7df173ac73cf5e36a6f13cc1a0ed41c6457fd5b2890bc60acb47c3b5135ca48b"} Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.818904 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-77797b894-rctcp" podUID="710921c8-80e7-46a5-8792-8ffc9795500c" containerName="placement-log" containerID="cri-o://994a5a64c6e8bfa1489bcf220f2bea0b606e14b2ee9f634800fe3f596ce39925" gracePeriod=30 Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.819057 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-77797b894-rctcp" podUID="710921c8-80e7-46a5-8792-8ffc9795500c" containerName="placement-api" containerID="cri-o://7df173ac73cf5e36a6f13cc1a0ed41c6457fd5b2890bc60acb47c3b5135ca48b" gracePeriod=30 Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.821803 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-77797b894-rctcp" Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.821847 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-77797b894-rctcp" Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.887107 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-66f8c58b5d-5nmtn" podUID="3dad7391-908f-4984-9272-f28450644483" containerName="barbican-api-log" probeResult="failure" output="Get \"http://10.217.1.171:9311/healthcheck\": read tcp 10.217.0.2:37968->10.217.1.171:9311: read: connection reset by peer" Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.887568 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-66f8c58b5d-5nmtn" podUID="3dad7391-908f-4984-9272-f28450644483" containerName="barbican-api" probeResult="failure" output="Get \"http://10.217.1.171:9311/healthcheck\": read tcp 10.217.0.2:39342->10.217.1.171:9311: read: connection reset by peer" Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.899919 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.912941 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-77797b894-rctcp" podStartSLOduration=9.912918258 podStartE2EDuration="9.912918258s" podCreationTimestamp="2026-03-16 16:49:40 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:49:49.866082553 +0000 UTC m=+4692.020014220" watchObservedRunningTime="2026-03-16 16:49:49.912918258 +0000 UTC m=+4692.066849915" Mar 16 16:49:49 crc kubenswrapper[5120]: I0316 16:49:49.964234 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:49:50 crc kubenswrapper[5120]: I0316 16:49:50.157051 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:49:50 crc kubenswrapper[5120]: I0316 16:49:50.347467 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-576bc9cb6c-q5s4k" Mar 16 16:49:50 crc kubenswrapper[5120]: I0316 16:49:50.394607 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-576c5b55d6-5zsh7" Mar 16 16:49:50 crc kubenswrapper[5120]: I0316 16:49:50.570666 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-g9ds4" Mar 16 16:49:50 crc kubenswrapper[5120]: I0316 16:49:50.621747 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-5698458656-mpwfb" Mar 16 16:49:50 crc kubenswrapper[5120]: I0316 16:49:50.652727 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-745d8c69c6-mxmrn" Mar 16 16:49:50 crc kubenswrapper[5120]: I0316 16:49:50.703301 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-7d79f76d78-2wccd" Mar 16 16:49:50 crc kubenswrapper[5120]: I0316 16:49:50.792291 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-5c574fdfbb-8rvsq_8931787a-1e50-415c-8d97-6c2ab294b4f4/neutron-api/0.log" Mar 16 16:49:50 crc kubenswrapper[5120]: I0316 16:49:50.792422 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-5c574fdfbb-8rvsq" Mar 16 16:49:50 crc kubenswrapper[5120]: I0316 16:49:50.848015 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-745d8c69c6-mxmrn"] Mar 16 16:49:50 crc kubenswrapper[5120]: I0316 16:49:50.848090 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-9f898f5b6-g9g57"] Mar 16 16:49:50 crc kubenswrapper[5120]: I0316 16:49:50.849113 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8931787a-1e50-415c-8d97-6c2ab294b4f4" containerName="neutron-httpd" Mar 16 16:49:50 crc kubenswrapper[5120]: I0316 16:49:50.849132 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8931787a-1e50-415c-8d97-6c2ab294b4f4" containerName="neutron-httpd" Mar 16 16:49:50 crc kubenswrapper[5120]: I0316 16:49:50.849174 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8931787a-1e50-415c-8d97-6c2ab294b4f4" containerName="neutron-api" Mar 16 16:49:50 crc kubenswrapper[5120]: I0316 16:49:50.849180 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8931787a-1e50-415c-8d97-6c2ab294b4f4" containerName="neutron-api" Mar 16 16:49:50 crc kubenswrapper[5120]: I0316 16:49:50.849374 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="8931787a-1e50-415c-8d97-6c2ab294b4f4" containerName="neutron-api" Mar 16 16:49:50 crc kubenswrapper[5120]: I0316 16:49:50.849384 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="8931787a-1e50-415c-8d97-6c2ab294b4f4" containerName="neutron-httpd" Mar 16 16:49:50 crc kubenswrapper[5120]: I0316 16:49:50.867559 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-b95f7696b-gs4k6_370e78a7-6b53-4f13-aa62-8afa448a0b7d/neutron-api/0.log" Mar 16 16:49:50 crc kubenswrapper[5120]: I0316 16:49:50.867646 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-b95f7696b-gs4k6" Mar 16 16:49:50 crc kubenswrapper[5120]: I0316 16:49:50.870640 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-9f898f5b6-g9g57"] Mar 16 16:49:50 crc kubenswrapper[5120]: I0316 16:49:50.870886 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-9f898f5b6-g9g57" Mar 16 16:49:50 crc kubenswrapper[5120]: I0316 16:49:50.874242 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-neutron-ovndbs\"" Mar 16 16:49:50 crc kubenswrapper[5120]: I0316 16:49:50.874622 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-neutron-public-svc\"" Mar 16 16:49:50 crc kubenswrapper[5120]: I0316 16:49:50.875070 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-neutron-internal-svc\"" Mar 16 16:49:50 crc kubenswrapper[5120]: I0316 16:49:50.937599 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8931787a-1e50-415c-8d97-6c2ab294b4f4-combined-ca-bundle\") pod \"8931787a-1e50-415c-8d97-6c2ab294b4f4\" (UID: \"8931787a-1e50-415c-8d97-6c2ab294b4f4\") " Mar 16 16:49:50 crc kubenswrapper[5120]: I0316 16:49:50.938124 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/370e78a7-6b53-4f13-aa62-8afa448a0b7d-config\") pod \"370e78a7-6b53-4f13-aa62-8afa448a0b7d\" (UID: \"370e78a7-6b53-4f13-aa62-8afa448a0b7d\") " Mar 16 16:49:50 crc kubenswrapper[5120]: I0316 16:49:50.938178 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/370e78a7-6b53-4f13-aa62-8afa448a0b7d-httpd-config\") pod \"370e78a7-6b53-4f13-aa62-8afa448a0b7d\" (UID: \"370e78a7-6b53-4f13-aa62-8afa448a0b7d\") " Mar 16 16:49:50 crc kubenswrapper[5120]: I0316 16:49:50.938262 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/370e78a7-6b53-4f13-aa62-8afa448a0b7d-combined-ca-bundle\") pod \"370e78a7-6b53-4f13-aa62-8afa448a0b7d\" (UID: \"370e78a7-6b53-4f13-aa62-8afa448a0b7d\") " Mar 16 16:49:50 crc kubenswrapper[5120]: I0316 16:49:50.938398 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zx5fh\" (UniqueName: \"kubernetes.io/projected/370e78a7-6b53-4f13-aa62-8afa448a0b7d-kube-api-access-zx5fh\") pod \"370e78a7-6b53-4f13-aa62-8afa448a0b7d\" (UID: \"370e78a7-6b53-4f13-aa62-8afa448a0b7d\") " Mar 16 16:49:50 crc kubenswrapper[5120]: I0316 16:49:50.938580 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mg2kd\" (UniqueName: \"kubernetes.io/projected/8931787a-1e50-415c-8d97-6c2ab294b4f4-kube-api-access-mg2kd\") pod \"8931787a-1e50-415c-8d97-6c2ab294b4f4\" (UID: \"8931787a-1e50-415c-8d97-6c2ab294b4f4\") " Mar 16 16:49:50 crc kubenswrapper[5120]: I0316 16:49:50.938685 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/8931787a-1e50-415c-8d97-6c2ab294b4f4-httpd-config\") pod \"8931787a-1e50-415c-8d97-6c2ab294b4f4\" (UID: \"8931787a-1e50-415c-8d97-6c2ab294b4f4\") " Mar 16 16:49:50 crc kubenswrapper[5120]: I0316 16:49:50.938736 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8931787a-1e50-415c-8d97-6c2ab294b4f4-config\") pod \"8931787a-1e50-415c-8d97-6c2ab294b4f4\" (UID: \"8931787a-1e50-415c-8d97-6c2ab294b4f4\") " Mar 16 16:49:50 crc kubenswrapper[5120]: I0316 16:49:50.965282 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/cdf5b2c0-4a53-4c60-a566-d18398c0c560-config\") pod \"neutron-9f898f5b6-g9g57\" (UID: \"cdf5b2c0-4a53-4c60-a566-d18398c0c560\") " pod="openstack-kuttl-tests/neutron-9f898f5b6-g9g57" Mar 16 16:49:50 crc kubenswrapper[5120]: I0316 16:49:50.965515 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cdf5b2c0-4a53-4c60-a566-d18398c0c560-combined-ca-bundle\") pod \"neutron-9f898f5b6-g9g57\" (UID: \"cdf5b2c0-4a53-4c60-a566-d18398c0c560\") " pod="openstack-kuttl-tests/neutron-9f898f5b6-g9g57" Mar 16 16:49:50 crc kubenswrapper[5120]: I0316 16:49:50.966078 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/cdf5b2c0-4a53-4c60-a566-d18398c0c560-ovndb-tls-certs\") pod \"neutron-9f898f5b6-g9g57\" (UID: \"cdf5b2c0-4a53-4c60-a566-d18398c0c560\") " pod="openstack-kuttl-tests/neutron-9f898f5b6-g9g57" Mar 16 16:49:50 crc kubenswrapper[5120]: I0316 16:49:50.966129 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/cdf5b2c0-4a53-4c60-a566-d18398c0c560-httpd-config\") pod \"neutron-9f898f5b6-g9g57\" (UID: \"cdf5b2c0-4a53-4c60-a566-d18398c0c560\") " pod="openstack-kuttl-tests/neutron-9f898f5b6-g9g57" Mar 16 16:49:50 crc kubenswrapper[5120]: I0316 16:49:50.966163 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/cdf5b2c0-4a53-4c60-a566-d18398c0c560-public-tls-certs\") pod \"neutron-9f898f5b6-g9g57\" (UID: \"cdf5b2c0-4a53-4c60-a566-d18398c0c560\") " pod="openstack-kuttl-tests/neutron-9f898f5b6-g9g57" Mar 16 16:49:50 crc kubenswrapper[5120]: I0316 16:49:50.966616 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/cdf5b2c0-4a53-4c60-a566-d18398c0c560-internal-tls-certs\") pod \"neutron-9f898f5b6-g9g57\" (UID: \"cdf5b2c0-4a53-4c60-a566-d18398c0c560\") " pod="openstack-kuttl-tests/neutron-9f898f5b6-g9g57" Mar 16 16:49:50 crc kubenswrapper[5120]: I0316 16:49:50.968072 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6p9s6\" (UniqueName: \"kubernetes.io/projected/cdf5b2c0-4a53-4c60-a566-d18398c0c560-kube-api-access-6p9s6\") pod \"neutron-9f898f5b6-g9g57\" (UID: \"cdf5b2c0-4a53-4c60-a566-d18398c0c560\") " pod="openstack-kuttl-tests/neutron-9f898f5b6-g9g57" Mar 16 16:49:50 crc kubenswrapper[5120]: I0316 16:49:50.969803 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/370e78a7-6b53-4f13-aa62-8afa448a0b7d-httpd-config" (OuterVolumeSpecName: "httpd-config") pod "370e78a7-6b53-4f13-aa62-8afa448a0b7d" (UID: "370e78a7-6b53-4f13-aa62-8afa448a0b7d"). InnerVolumeSpecName "httpd-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:49:50 crc kubenswrapper[5120]: I0316 16:49:50.973482 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"b0528e86-65e5-4d4c-9dd9-4cd6b9475cbc","Type":"ContainerStarted","Data":"87c8a7508d62404f45bb9bb4f0bf291163f78d5842cd089a3101282b7236de16"} Mar 16 16:49:50 crc kubenswrapper[5120]: I0316 16:49:50.977140 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8931787a-1e50-415c-8d97-6c2ab294b4f4-kube-api-access-mg2kd" (OuterVolumeSpecName: "kube-api-access-mg2kd") pod "8931787a-1e50-415c-8d97-6c2ab294b4f4" (UID: "8931787a-1e50-415c-8d97-6c2ab294b4f4"). InnerVolumeSpecName "kube-api-access-mg2kd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:49:50 crc kubenswrapper[5120]: I0316 16:49:50.985891 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/370e78a7-6b53-4f13-aa62-8afa448a0b7d-kube-api-access-zx5fh" (OuterVolumeSpecName: "kube-api-access-zx5fh") pod "370e78a7-6b53-4f13-aa62-8afa448a0b7d" (UID: "370e78a7-6b53-4f13-aa62-8afa448a0b7d"). InnerVolumeSpecName "kube-api-access-zx5fh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:49:50 crc kubenswrapper[5120]: I0316 16:49:50.997224 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8931787a-1e50-415c-8d97-6c2ab294b4f4-httpd-config" (OuterVolumeSpecName: "httpd-config") pod "8931787a-1e50-415c-8d97-6c2ab294b4f4" (UID: "8931787a-1e50-415c-8d97-6c2ab294b4f4"). InnerVolumeSpecName "httpd-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:49:51 crc kubenswrapper[5120]: I0316 16:49:51.075030 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/cdf5b2c0-4a53-4c60-a566-d18398c0c560-internal-tls-certs\") pod \"neutron-9f898f5b6-g9g57\" (UID: \"cdf5b2c0-4a53-4c60-a566-d18398c0c560\") " pod="openstack-kuttl-tests/neutron-9f898f5b6-g9g57" Mar 16 16:49:51 crc kubenswrapper[5120]: I0316 16:49:51.075074 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-66f8c58b5d-5nmtn" event={"ID":"3dad7391-908f-4984-9272-f28450644483","Type":"ContainerDied","Data":"87642dd0e9423953bb1babdced238f4c04ce8fa1d0b2bd4e731927d40588bdd3"} Mar 16 16:49:51 crc kubenswrapper[5120]: I0316 16:49:51.075010 5120 generic.go:358] "Generic (PLEG): container finished" podID="3dad7391-908f-4984-9272-f28450644483" containerID="87642dd0e9423953bb1babdced238f4c04ce8fa1d0b2bd4e731927d40588bdd3" exitCode=0 Mar 16 16:49:51 crc kubenswrapper[5120]: I0316 16:49:51.077107 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6p9s6\" (UniqueName: \"kubernetes.io/projected/cdf5b2c0-4a53-4c60-a566-d18398c0c560-kube-api-access-6p9s6\") pod \"neutron-9f898f5b6-g9g57\" (UID: \"cdf5b2c0-4a53-4c60-a566-d18398c0c560\") " pod="openstack-kuttl-tests/neutron-9f898f5b6-g9g57" Mar 16 16:49:51 crc kubenswrapper[5120]: I0316 16:49:51.077265 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/cdf5b2c0-4a53-4c60-a566-d18398c0c560-config\") pod \"neutron-9f898f5b6-g9g57\" (UID: \"cdf5b2c0-4a53-4c60-a566-d18398c0c560\") " pod="openstack-kuttl-tests/neutron-9f898f5b6-g9g57" Mar 16 16:49:51 crc kubenswrapper[5120]: I0316 16:49:51.077402 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cdf5b2c0-4a53-4c60-a566-d18398c0c560-combined-ca-bundle\") pod \"neutron-9f898f5b6-g9g57\" (UID: \"cdf5b2c0-4a53-4c60-a566-d18398c0c560\") " pod="openstack-kuttl-tests/neutron-9f898f5b6-g9g57" Mar 16 16:49:51 crc kubenswrapper[5120]: I0316 16:49:51.077685 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/cdf5b2c0-4a53-4c60-a566-d18398c0c560-ovndb-tls-certs\") pod \"neutron-9f898f5b6-g9g57\" (UID: \"cdf5b2c0-4a53-4c60-a566-d18398c0c560\") " pod="openstack-kuttl-tests/neutron-9f898f5b6-g9g57" Mar 16 16:49:51 crc kubenswrapper[5120]: I0316 16:49:51.077740 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/cdf5b2c0-4a53-4c60-a566-d18398c0c560-httpd-config\") pod \"neutron-9f898f5b6-g9g57\" (UID: \"cdf5b2c0-4a53-4c60-a566-d18398c0c560\") " pod="openstack-kuttl-tests/neutron-9f898f5b6-g9g57" Mar 16 16:49:51 crc kubenswrapper[5120]: I0316 16:49:51.077790 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/cdf5b2c0-4a53-4c60-a566-d18398c0c560-public-tls-certs\") pod \"neutron-9f898f5b6-g9g57\" (UID: \"cdf5b2c0-4a53-4c60-a566-d18398c0c560\") " pod="openstack-kuttl-tests/neutron-9f898f5b6-g9g57" Mar 16 16:49:51 crc kubenswrapper[5120]: I0316 16:49:51.078038 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mg2kd\" (UniqueName: \"kubernetes.io/projected/8931787a-1e50-415c-8d97-6c2ab294b4f4-kube-api-access-mg2kd\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:51 crc kubenswrapper[5120]: I0316 16:49:51.078057 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/8931787a-1e50-415c-8d97-6c2ab294b4f4-httpd-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:51 crc kubenswrapper[5120]: I0316 16:49:51.078071 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/370e78a7-6b53-4f13-aa62-8afa448a0b7d-httpd-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:51 crc kubenswrapper[5120]: I0316 16:49:51.078085 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zx5fh\" (UniqueName: \"kubernetes.io/projected/370e78a7-6b53-4f13-aa62-8afa448a0b7d-kube-api-access-zx5fh\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:51 crc kubenswrapper[5120]: I0316 16:49:51.083567 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-66f8c58b5d-5nmtn" Mar 16 16:49:51 crc kubenswrapper[5120]: I0316 16:49:51.088119 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/cdf5b2c0-4a53-4c60-a566-d18398c0c560-internal-tls-certs\") pod \"neutron-9f898f5b6-g9g57\" (UID: \"cdf5b2c0-4a53-4c60-a566-d18398c0c560\") " pod="openstack-kuttl-tests/neutron-9f898f5b6-g9g57" Mar 16 16:49:51 crc kubenswrapper[5120]: I0316 16:49:51.093375 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podStartSLOduration=9.093347333 podStartE2EDuration="9.093347333s" podCreationTimestamp="2026-03-16 16:49:42 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:49:51.002885231 +0000 UTC m=+4693.156816898" watchObservedRunningTime="2026-03-16 16:49:51.093347333 +0000 UTC m=+4693.247278990" Mar 16 16:49:51 crc kubenswrapper[5120]: I0316 16:49:51.106882 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/cdf5b2c0-4a53-4c60-a566-d18398c0c560-httpd-config\") pod \"neutron-9f898f5b6-g9g57\" (UID: \"cdf5b2c0-4a53-4c60-a566-d18398c0c560\") " pod="openstack-kuttl-tests/neutron-9f898f5b6-g9g57" Mar 16 16:49:51 crc kubenswrapper[5120]: I0316 16:49:51.131075 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-b95f7696b-gs4k6_370e78a7-6b53-4f13-aa62-8afa448a0b7d/neutron-api/0.log" Mar 16 16:49:51 crc kubenswrapper[5120]: I0316 16:49:51.131129 5120 generic.go:358] "Generic (PLEG): container finished" podID="370e78a7-6b53-4f13-aa62-8afa448a0b7d" containerID="504b102dbe299e584d590a98680203d1fc45f024425a99a136dae5714a040b0c" exitCode=1 Mar 16 16:49:51 crc kubenswrapper[5120]: I0316 16:49:51.131319 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-b95f7696b-gs4k6" Mar 16 16:49:51 crc kubenswrapper[5120]: I0316 16:49:51.131744 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-b95f7696b-gs4k6" event={"ID":"370e78a7-6b53-4f13-aa62-8afa448a0b7d","Type":"ContainerDied","Data":"504b102dbe299e584d590a98680203d1fc45f024425a99a136dae5714a040b0c"} Mar 16 16:49:51 crc kubenswrapper[5120]: I0316 16:49:51.134076 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-b95f7696b-gs4k6" event={"ID":"370e78a7-6b53-4f13-aa62-8afa448a0b7d","Type":"ContainerDied","Data":"2921e0957349541b86198a536e2b759114dbb4ac32753e84237e1bbbd29f1f4a"} Mar 16 16:49:51 crc kubenswrapper[5120]: I0316 16:49:51.134142 5120 scope.go:117] "RemoveContainer" containerID="da5f4edb49e75db3f4b00835e874103c3a616a2ae027795d81631b1e318afdda" Mar 16 16:49:51 crc kubenswrapper[5120]: I0316 16:49:51.144817 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/cdf5b2c0-4a53-4c60-a566-d18398c0c560-config\") pod \"neutron-9f898f5b6-g9g57\" (UID: \"cdf5b2c0-4a53-4c60-a566-d18398c0c560\") " pod="openstack-kuttl-tests/neutron-9f898f5b6-g9g57" Mar 16 16:49:51 crc kubenswrapper[5120]: I0316 16:49:51.152864 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6p9s6\" (UniqueName: \"kubernetes.io/projected/cdf5b2c0-4a53-4c60-a566-d18398c0c560-kube-api-access-6p9s6\") pod \"neutron-9f898f5b6-g9g57\" (UID: \"cdf5b2c0-4a53-4c60-a566-d18398c0c560\") " pod="openstack-kuttl-tests/neutron-9f898f5b6-g9g57" Mar 16 16:49:51 crc kubenswrapper[5120]: I0316 16:49:51.154211 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cdf5b2c0-4a53-4c60-a566-d18398c0c560-combined-ca-bundle\") pod \"neutron-9f898f5b6-g9g57\" (UID: \"cdf5b2c0-4a53-4c60-a566-d18398c0c560\") " pod="openstack-kuttl-tests/neutron-9f898f5b6-g9g57" Mar 16 16:49:51 crc kubenswrapper[5120]: I0316 16:49:51.154623 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/cdf5b2c0-4a53-4c60-a566-d18398c0c560-ovndb-tls-certs\") pod \"neutron-9f898f5b6-g9g57\" (UID: \"cdf5b2c0-4a53-4c60-a566-d18398c0c560\") " pod="openstack-kuttl-tests/neutron-9f898f5b6-g9g57" Mar 16 16:49:51 crc kubenswrapper[5120]: I0316 16:49:51.163414 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"46fdeab7-fc69-4767-85fb-6fe77323a249","Type":"ContainerStarted","Data":"7e1d6d598b7117b019f831fbc287bdb7edb6c8410369f34469cffa1a0c72a732"} Mar 16 16:49:51 crc kubenswrapper[5120]: I0316 16:49:51.164335 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/cdf5b2c0-4a53-4c60-a566-d18398c0c560-public-tls-certs\") pod \"neutron-9f898f5b6-g9g57\" (UID: \"cdf5b2c0-4a53-4c60-a566-d18398c0c560\") " pod="openstack-kuttl-tests/neutron-9f898f5b6-g9g57" Mar 16 16:49:51 crc kubenswrapper[5120]: I0316 16:49:51.184329 5120 generic.go:358] "Generic (PLEG): container finished" podID="398bb1bd-f380-4374-b880-d7217d37e010" containerID="b932247b64920daaa5151fe9bb97c9f517c85a794047e555fbd45772a062a8e1" exitCode=0 Mar 16 16:49:51 crc kubenswrapper[5120]: I0316 16:49:51.184454 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-678df6fbdb-lfhdz" event={"ID":"398bb1bd-f380-4374-b880-d7217d37e010","Type":"ContainerDied","Data":"b932247b64920daaa5151fe9bb97c9f517c85a794047e555fbd45772a062a8e1"} Mar 16 16:49:51 crc kubenswrapper[5120]: I0316 16:49:51.185920 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3dad7391-908f-4984-9272-f28450644483-config-data\") pod \"3dad7391-908f-4984-9272-f28450644483\" (UID: \"3dad7391-908f-4984-9272-f28450644483\") " Mar 16 16:49:51 crc kubenswrapper[5120]: I0316 16:49:51.186518 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x4ggl\" (UniqueName: \"kubernetes.io/projected/3dad7391-908f-4984-9272-f28450644483-kube-api-access-x4ggl\") pod \"3dad7391-908f-4984-9272-f28450644483\" (UID: \"3dad7391-908f-4984-9272-f28450644483\") " Mar 16 16:49:51 crc kubenswrapper[5120]: I0316 16:49:51.186633 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3dad7391-908f-4984-9272-f28450644483-combined-ca-bundle\") pod \"3dad7391-908f-4984-9272-f28450644483\" (UID: \"3dad7391-908f-4984-9272-f28450644483\") " Mar 16 16:49:51 crc kubenswrapper[5120]: I0316 16:49:51.186828 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/3dad7391-908f-4984-9272-f28450644483-config-data-custom\") pod \"3dad7391-908f-4984-9272-f28450644483\" (UID: \"3dad7391-908f-4984-9272-f28450644483\") " Mar 16 16:49:51 crc kubenswrapper[5120]: I0316 16:49:51.187089 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3dad7391-908f-4984-9272-f28450644483-logs\") pod \"3dad7391-908f-4984-9272-f28450644483\" (UID: \"3dad7391-908f-4984-9272-f28450644483\") " Mar 16 16:49:51 crc kubenswrapper[5120]: I0316 16:49:51.189128 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3dad7391-908f-4984-9272-f28450644483-logs" (OuterVolumeSpecName: "logs") pod "3dad7391-908f-4984-9272-f28450644483" (UID: "3dad7391-908f-4984-9272-f28450644483"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:49:51 crc kubenswrapper[5120]: I0316 16:49:51.237075 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3dad7391-908f-4984-9272-f28450644483-kube-api-access-x4ggl" (OuterVolumeSpecName: "kube-api-access-x4ggl") pod "3dad7391-908f-4984-9272-f28450644483" (UID: "3dad7391-908f-4984-9272-f28450644483"). InnerVolumeSpecName "kube-api-access-x4ggl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:49:51 crc kubenswrapper[5120]: I0316 16:49:51.237444 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3dad7391-908f-4984-9272-f28450644483-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "3dad7391-908f-4984-9272-f28450644483" (UID: "3dad7391-908f-4984-9272-f28450644483"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:49:51 crc kubenswrapper[5120]: I0316 16:49:51.237512 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/370e78a7-6b53-4f13-aa62-8afa448a0b7d-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "370e78a7-6b53-4f13-aa62-8afa448a0b7d" (UID: "370e78a7-6b53-4f13-aa62-8afa448a0b7d"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:49:51 crc kubenswrapper[5120]: I0316 16:49:51.243991 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3dad7391-908f-4984-9272-f28450644483-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "3dad7391-908f-4984-9272-f28450644483" (UID: "3dad7391-908f-4984-9272-f28450644483"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:49:51 crc kubenswrapper[5120]: I0316 16:49:51.244176 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8931787a-1e50-415c-8d97-6c2ab294b4f4-config" (OuterVolumeSpecName: "config") pod "8931787a-1e50-415c-8d97-6c2ab294b4f4" (UID: "8931787a-1e50-415c-8d97-6c2ab294b4f4"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:49:51 crc kubenswrapper[5120]: I0316 16:49:51.247469 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-9f898f5b6-g9g57" Mar 16 16:49:51 crc kubenswrapper[5120]: I0316 16:49:51.284918 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/370e78a7-6b53-4f13-aa62-8afa448a0b7d-config" (OuterVolumeSpecName: "config") pod "370e78a7-6b53-4f13-aa62-8afa448a0b7d" (UID: "370e78a7-6b53-4f13-aa62-8afa448a0b7d"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:49:51 crc kubenswrapper[5120]: I0316 16:49:51.292530 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/370e78a7-6b53-4f13-aa62-8afa448a0b7d-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:51 crc kubenswrapper[5120]: I0316 16:49:51.292572 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/370e78a7-6b53-4f13-aa62-8afa448a0b7d-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:51 crc kubenswrapper[5120]: I0316 16:49:51.292626 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x4ggl\" (UniqueName: \"kubernetes.io/projected/3dad7391-908f-4984-9272-f28450644483-kube-api-access-x4ggl\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:51 crc kubenswrapper[5120]: I0316 16:49:51.292639 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3dad7391-908f-4984-9272-f28450644483-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:51 crc kubenswrapper[5120]: I0316 16:49:51.292650 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/3dad7391-908f-4984-9272-f28450644483-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:51 crc kubenswrapper[5120]: I0316 16:49:51.292661 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/8931787a-1e50-415c-8d97-6c2ab294b4f4-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:51 crc kubenswrapper[5120]: I0316 16:49:51.292671 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3dad7391-908f-4984-9272-f28450644483-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:51 crc kubenswrapper[5120]: I0316 16:49:51.333970 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8931787a-1e50-415c-8d97-6c2ab294b4f4-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "8931787a-1e50-415c-8d97-6c2ab294b4f4" (UID: "8931787a-1e50-415c-8d97-6c2ab294b4f4"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:49:51 crc kubenswrapper[5120]: I0316 16:49:51.347960 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3dad7391-908f-4984-9272-f28450644483-config-data" (OuterVolumeSpecName: "config-data") pod "3dad7391-908f-4984-9272-f28450644483" (UID: "3dad7391-908f-4984-9272-f28450644483"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:49:51 crc kubenswrapper[5120]: I0316 16:49:51.348408 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-5c574fdfbb-8rvsq_8931787a-1e50-415c-8d97-6c2ab294b4f4/neutron-api/0.log" Mar 16 16:49:51 crc kubenswrapper[5120]: I0316 16:49:51.348549 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-5c574fdfbb-8rvsq" event={"ID":"8931787a-1e50-415c-8d97-6c2ab294b4f4","Type":"ContainerDied","Data":"95c8e85a14f1e4e20c3db6086b04a132d86640df97749641eba22126b0ffe247"} Mar 16 16:49:51 crc kubenswrapper[5120]: I0316 16:49:51.348590 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-5c574fdfbb-8rvsq" Mar 16 16:49:51 crc kubenswrapper[5120]: I0316 16:49:51.355523 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"e2cf7c36-f4c0-4831-8b31-480469e7da93","Type":"ContainerStarted","Data":"70ca15033adb4cc8ab2f68cb24d9e0896b4010993bb8df83f897dfbea5f50e2f"} Mar 16 16:49:51 crc kubenswrapper[5120]: I0316 16:49:51.361049 5120 generic.go:358] "Generic (PLEG): container finished" podID="710921c8-80e7-46a5-8792-8ffc9795500c" containerID="994a5a64c6e8bfa1489bcf220f2bea0b606e14b2ee9f634800fe3f596ce39925" exitCode=143 Mar 16 16:49:51 crc kubenswrapper[5120]: I0316 16:49:51.361174 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-77797b894-rctcp" event={"ID":"710921c8-80e7-46a5-8792-8ffc9795500c","Type":"ContainerDied","Data":"994a5a64c6e8bfa1489bcf220f2bea0b606e14b2ee9f634800fe3f596ce39925"} Mar 16 16:49:51 crc kubenswrapper[5120]: I0316 16:49:51.399338 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="81b72eda-5dae-44c1-a720-9ca9e22cb100" containerName="nova-cell0-conductor-conductor" containerID="cri-o://5767c79fc6bfdc88326d2909a4045fd0fa6001cd3d1249601d70195496f04121" gracePeriod=30 Mar 16 16:49:51 crc kubenswrapper[5120]: I0316 16:49:51.399887 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3dad7391-908f-4984-9272-f28450644483-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:51 crc kubenswrapper[5120]: I0316 16:49:51.399922 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8931787a-1e50-415c-8d97-6c2ab294b4f4-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:51 crc kubenswrapper[5120]: I0316 16:49:51.399919 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"27ae46b8-fa26-48e8-a9bb-36bc910c3caf","Type":"ContainerStarted","Data":"449f83a213ae844b7d7517f9c8b501e0b09ea767c80cb2310babca43f16e2cf7"} Mar 16 16:49:51 crc kubenswrapper[5120]: I0316 16:49:51.399887 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="2961edb8-5975-4d74-800e-732bed5d9791" containerName="nova-scheduler-scheduler" containerID="cri-o://583f5e8456c375c564641fbbd1cf323930ba07fd7dcce921278f431729b9f67f" gracePeriod=30 Mar 16 16:49:51 crc kubenswrapper[5120]: I0316 16:49:51.437211 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:49:51 crc kubenswrapper[5120]: I0316 16:49:51.440217 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-576bc9cb6c-q5s4k"] Mar 16 16:49:51 crc kubenswrapper[5120]: I0316 16:49:51.560872 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:49:51 crc kubenswrapper[5120]: E0316 16:49:51.566043 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="731ac2f25a5505892d3ba2b5085eb8ac263c0111abf4d7334a1812bbc50579a5" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:49:51 crc kubenswrapper[5120]: E0316 16:49:51.600921 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="731ac2f25a5505892d3ba2b5085eb8ac263c0111abf4d7334a1812bbc50579a5" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:49:51 crc kubenswrapper[5120]: E0316 16:49:51.629541 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="731ac2f25a5505892d3ba2b5085eb8ac263c0111abf4d7334a1812bbc50579a5" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:49:51 crc kubenswrapper[5120]: E0316 16:49:51.629646 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="e93e7d0f-2924-48c0-bc57-3a9597f83d70" containerName="nova-cell1-conductor-conductor" probeResult="unknown" Mar 16 16:49:51 crc kubenswrapper[5120]: I0316 16:49:51.681935 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-b95f7696b-gs4k6"] Mar 16 16:49:51 crc kubenswrapper[5120]: I0316 16:49:51.709001 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-b95f7696b-gs4k6"] Mar 16 16:49:51 crc kubenswrapper[5120]: I0316 16:49:51.739625 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-5c574fdfbb-8rvsq"] Mar 16 16:49:51 crc kubenswrapper[5120]: I0316 16:49:51.747286 5120 scope.go:117] "RemoveContainer" containerID="504b102dbe299e584d590a98680203d1fc45f024425a99a136dae5714a040b0c" Mar 16 16:49:51 crc kubenswrapper[5120]: I0316 16:49:51.778341 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-5c574fdfbb-8rvsq"] Mar 16 16:49:51 crc kubenswrapper[5120]: I0316 16:49:51.962888 5120 scope.go:117] "RemoveContainer" containerID="da5f4edb49e75db3f4b00835e874103c3a616a2ae027795d81631b1e318afdda" Mar 16 16:49:51 crc kubenswrapper[5120]: E0316 16:49:51.964991 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da5f4edb49e75db3f4b00835e874103c3a616a2ae027795d81631b1e318afdda\": container with ID starting with da5f4edb49e75db3f4b00835e874103c3a616a2ae027795d81631b1e318afdda not found: ID does not exist" containerID="da5f4edb49e75db3f4b00835e874103c3a616a2ae027795d81631b1e318afdda" Mar 16 16:49:51 crc kubenswrapper[5120]: I0316 16:49:51.965035 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da5f4edb49e75db3f4b00835e874103c3a616a2ae027795d81631b1e318afdda"} err="failed to get container status \"da5f4edb49e75db3f4b00835e874103c3a616a2ae027795d81631b1e318afdda\": rpc error: code = NotFound desc = could not find container \"da5f4edb49e75db3f4b00835e874103c3a616a2ae027795d81631b1e318afdda\": container with ID starting with da5f4edb49e75db3f4b00835e874103c3a616a2ae027795d81631b1e318afdda not found: ID does not exist" Mar 16 16:49:51 crc kubenswrapper[5120]: I0316 16:49:51.965058 5120 scope.go:117] "RemoveContainer" containerID="504b102dbe299e584d590a98680203d1fc45f024425a99a136dae5714a040b0c" Mar 16 16:49:51 crc kubenswrapper[5120]: I0316 16:49:51.967975 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-576c5b55d6-5zsh7"] Mar 16 16:49:51 crc kubenswrapper[5120]: E0316 16:49:51.970878 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"504b102dbe299e584d590a98680203d1fc45f024425a99a136dae5714a040b0c\": container with ID starting with 504b102dbe299e584d590a98680203d1fc45f024425a99a136dae5714a040b0c not found: ID does not exist" containerID="504b102dbe299e584d590a98680203d1fc45f024425a99a136dae5714a040b0c" Mar 16 16:49:51 crc kubenswrapper[5120]: I0316 16:49:51.971002 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"504b102dbe299e584d590a98680203d1fc45f024425a99a136dae5714a040b0c"} err="failed to get container status \"504b102dbe299e584d590a98680203d1fc45f024425a99a136dae5714a040b0c\": rpc error: code = NotFound desc = could not find container \"504b102dbe299e584d590a98680203d1fc45f024425a99a136dae5714a040b0c\": container with ID starting with 504b102dbe299e584d590a98680203d1fc45f024425a99a136dae5714a040b0c not found: ID does not exist" Mar 16 16:49:51 crc kubenswrapper[5120]: I0316 16:49:51.971108 5120 scope.go:117] "RemoveContainer" containerID="7788939b5c6289f5f75e37cc4aa76bdcfb55dea29b690d9ac7eb291a4e844f06" Mar 16 16:49:52 crc kubenswrapper[5120]: I0316 16:49:52.052695 5120 scope.go:117] "RemoveContainer" containerID="d8e6f9c22bd7d66c182898a8c06b4817335fd2fd9d4c4e0036cdaca44ef91a73" Mar 16 16:49:52 crc kubenswrapper[5120]: E0316 16:49:52.233672 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="583f5e8456c375c564641fbbd1cf323930ba07fd7dcce921278f431729b9f67f" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:49:52 crc kubenswrapper[5120]: E0316 16:49:52.242072 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="583f5e8456c375c564641fbbd1cf323930ba07fd7dcce921278f431729b9f67f" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:49:52 crc kubenswrapper[5120]: E0316 16:49:52.251599 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="583f5e8456c375c564641fbbd1cf323930ba07fd7dcce921278f431729b9f67f" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:49:52 crc kubenswrapper[5120]: E0316 16:49:52.251860 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="2961edb8-5975-4d74-800e-732bed5d9791" containerName="nova-scheduler-scheduler" probeResult="unknown" Mar 16 16:49:52 crc kubenswrapper[5120]: W0316 16:49:52.390510 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podeab40383_182c_4760_80e0_652dc37d1e68.slice/crio-fae7f4e57b33054714c7f920d27902490deeb9517c1337a77f2ca664e38649ff WatchSource:0}: Error finding container fae7f4e57b33054714c7f920d27902490deeb9517c1337a77f2ca664e38649ff: Status 404 returned error can't find the container with id fae7f4e57b33054714c7f920d27902490deeb9517c1337a77f2ca664e38649ff Mar 16 16:49:52 crc kubenswrapper[5120]: I0316 16:49:52.402819 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-g9ds4"] Mar 16 16:49:52 crc kubenswrapper[5120]: I0316 16:49:52.439866 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-5698458656-mpwfb"] Mar 16 16:49:52 crc kubenswrapper[5120]: I0316 16:49:52.453968 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-7d79f76d78-2wccd"] Mar 16 16:49:52 crc kubenswrapper[5120]: W0316 16:49:52.461292 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcdf5b2c0_4a53_4c60_a566_d18398c0c560.slice/crio-df898b0de10922feb7b36fd60f394f8e931174b83857c581c6ff95197175f244 WatchSource:0}: Error finding container df898b0de10922feb7b36fd60f394f8e931174b83857c581c6ff95197175f244: Status 404 returned error can't find the container with id df898b0de10922feb7b36fd60f394f8e931174b83857c581c6ff95197175f244 Mar 16 16:49:52 crc kubenswrapper[5120]: W0316 16:49:52.467634 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6e401532_2076_4686_b3cd_59b0629d8a98.slice/crio-b05f807b39f0414ac1e4b9e596b33773aefa07d56964dc6a65a8c5a15189b010 WatchSource:0}: Error finding container b05f807b39f0414ac1e4b9e596b33773aefa07d56964dc6a65a8c5a15189b010: Status 404 returned error can't find the container with id b05f807b39f0414ac1e4b9e596b33773aefa07d56964dc6a65a8c5a15189b010 Mar 16 16:49:52 crc kubenswrapper[5120]: I0316 16:49:52.469453 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-9f898f5b6-g9g57"] Mar 16 16:49:52 crc kubenswrapper[5120]: I0316 16:49:52.479828 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-745d8c69c6-mxmrn"] Mar 16 16:49:52 crc kubenswrapper[5120]: I0316 16:49:52.486381 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"d6038d72-b1a2-4d71-b831-d5fa1de027a7","Type":"ContainerStarted","Data":"753614b6b45ccefdf7745ba5f04677f3ea2b8d9cfc249235942e77233725e467"} Mar 16 16:49:52 crc kubenswrapper[5120]: I0316 16:49:52.486570 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="d6038d72-b1a2-4d71-b831-d5fa1de027a7" containerName="glance-log" containerID="cri-o://f70311d415dc9cf04b16655a0e023649f8f9eefdc08997f434414134d73c229f" gracePeriod=30 Mar 16 16:49:52 crc kubenswrapper[5120]: I0316 16:49:52.487028 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="d6038d72-b1a2-4d71-b831-d5fa1de027a7" containerName="glance-httpd" containerID="cri-o://753614b6b45ccefdf7745ba5f04677f3ea2b8d9cfc249235942e77233725e467" gracePeriod=30 Mar 16 16:49:52 crc kubenswrapper[5120]: I0316 16:49:52.502160 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-66f8c58b5d-5nmtn" event={"ID":"3dad7391-908f-4984-9272-f28450644483","Type":"ContainerDied","Data":"cac2bcb77c635648598795eec3f74ab142eff75b48a560a7988ecc861b94ea94"} Mar 16 16:49:52 crc kubenswrapper[5120]: I0316 16:49:52.502214 5120 scope.go:117] "RemoveContainer" containerID="87642dd0e9423953bb1babdced238f4c04ce8fa1d0b2bd4e731927d40588bdd3" Mar 16 16:49:52 crc kubenswrapper[5120]: I0316 16:49:52.502320 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-66f8c58b5d-5nmtn" Mar 16 16:49:52 crc kubenswrapper[5120]: I0316 16:49:52.521400 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-internal-api-0" podStartSLOduration=10.521385001 podStartE2EDuration="10.521385001s" podCreationTimestamp="2026-03-16 16:49:42 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:49:52.518381059 +0000 UTC m=+4694.672312716" watchObservedRunningTime="2026-03-16 16:49:52.521385001 +0000 UTC m=+4694.675316658" Mar 16 16:49:52 crc kubenswrapper[5120]: I0316 16:49:52.536031 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"3b14f53d-9d11-42e8-b823-65b88191e532","Type":"ContainerStarted","Data":"2ca72404e6e53a2d11f05afd65185916597407c15f175e1504f6a3dc9090a621"} Mar 16 16:49:52 crc kubenswrapper[5120]: I0316 16:49:52.536392 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:49:52 crc kubenswrapper[5120]: I0316 16:49:52.582630 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"46fdeab7-fc69-4767-85fb-6fe77323a249","Type":"ContainerStarted","Data":"85e0a2833bfbae668b16b016594cba1808c5730c52cef8b62d6c1961bf38adf3"} Mar 16 16:49:52 crc kubenswrapper[5120]: I0316 16:49:52.584086 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:49:52 crc kubenswrapper[5120]: I0316 16:49:52.584301 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"46fdeab7-fc69-4767-85fb-6fe77323a249","Type":"ContainerStarted","Data":"772d7d749c19d303ab351e9da9794092ed431692caf8ea6741351516c112156b"} Mar 16 16:49:52 crc kubenswrapper[5120]: I0316 16:49:52.585530 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-576bc9cb6c-q5s4k" event={"ID":"976611b4-4a36-49a3-9bd6-f7b5ca2899f4","Type":"ContainerStarted","Data":"cb64ef40b3869f4282e91f93befbe663c5f19a49ae3de83e88840e49b9ad4dea"} Mar 16 16:49:52 crc kubenswrapper[5120]: I0316 16:49:52.586788 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-576bc9cb6c-q5s4k" event={"ID":"976611b4-4a36-49a3-9bd6-f7b5ca2899f4","Type":"ContainerStarted","Data":"ec9368546d7da7390886e73f6b2ffd0491828efa7bf77ae960aa285225bfaf20"} Mar 16 16:49:52 crc kubenswrapper[5120]: I0316 16:49:52.536414 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="3b14f53d-9d11-42e8-b823-65b88191e532" containerName="cinder-api-log" containerID="cri-o://e979fc4bbbbee656bb574a38e76d8d095ee03dac2aa27609130add421f993387" gracePeriod=30 Mar 16 16:49:52 crc kubenswrapper[5120]: I0316 16:49:52.536682 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="3b14f53d-9d11-42e8-b823-65b88191e532" containerName="cinder-api" containerID="cri-o://2ca72404e6e53a2d11f05afd65185916597407c15f175e1504f6a3dc9090a621" gracePeriod=30 Mar 16 16:49:52 crc kubenswrapper[5120]: I0316 16:49:52.587928 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-api-0" podStartSLOduration=17.587901536 podStartE2EDuration="17.587901536s" podCreationTimestamp="2026-03-16 16:49:35 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:49:52.581786728 +0000 UTC m=+4694.735718385" watchObservedRunningTime="2026-03-16 16:49:52.587901536 +0000 UTC m=+4694.741833193" Mar 16 16:49:52 crc kubenswrapper[5120]: I0316 16:49:52.590651 5120 generic.go:358] "Generic (PLEG): container finished" podID="e93e7d0f-2924-48c0-bc57-3a9597f83d70" containerID="731ac2f25a5505892d3ba2b5085eb8ac263c0111abf4d7334a1812bbc50579a5" exitCode=0 Mar 16 16:49:52 crc kubenswrapper[5120]: I0316 16:49:52.590882 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"e93e7d0f-2924-48c0-bc57-3a9597f83d70","Type":"ContainerDied","Data":"731ac2f25a5505892d3ba2b5085eb8ac263c0111abf4d7334a1812bbc50579a5"} Mar 16 16:49:52 crc kubenswrapper[5120]: I0316 16:49:52.633685 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-576c5b55d6-5zsh7" event={"ID":"fb4496e5-279b-4520-a345-c4ed00ede8c9","Type":"ContainerStarted","Data":"23578f5116e14f4d9f5a46397b186adf8fa1ad65b95d3433e3dc931c3d9d7a17"} Mar 16 16:49:52 crc kubenswrapper[5120]: I0316 16:49:52.654339 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"e2cf7c36-f4c0-4831-8b31-480469e7da93","Type":"ContainerStarted","Data":"09da8f68fb8f4fbba594b87f5fc69576b135d9f56519c0bf5a6aa0861a336c18"} Mar 16 16:49:52 crc kubenswrapper[5120]: I0316 16:49:52.656189 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:49:52 crc kubenswrapper[5120]: I0316 16:49:52.656561 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="5f1fe655-07dd-4959-98ac-372e797369fa" containerName="cinder-scheduler" containerID="cri-o://a6f63c2438cda8e5c1e39916b22f7196bbe3ad25f488b320afd6a8e2d66d01b9" gracePeriod=30 Mar 16 16:49:52 crc kubenswrapper[5120]: I0316 16:49:52.658085 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-g9ds4" event={"ID":"eab40383-182c-4760-80e0-652dc37d1e68","Type":"ContainerStarted","Data":"fae7f4e57b33054714c7f920d27902490deeb9517c1337a77f2ca664e38649ff"} Mar 16 16:49:52 crc kubenswrapper[5120]: I0316 16:49:52.658549 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="5f1fe655-07dd-4959-98ac-372e797369fa" containerName="probe" containerID="cri-o://69f752550a5578263c364529de570d74151a5bd7974ef22cf21fdb0c1513409f" gracePeriod=30 Mar 16 16:49:52 crc kubenswrapper[5120]: I0316 16:49:52.703159 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="370e78a7-6b53-4f13-aa62-8afa448a0b7d" path="/var/lib/kubelet/pods/370e78a7-6b53-4f13-aa62-8afa448a0b7d/volumes" Mar 16 16:49:52 crc kubenswrapper[5120]: I0316 16:49:52.703998 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8931787a-1e50-415c-8d97-6c2ab294b4f4" path="/var/lib/kubelet/pods/8931787a-1e50-415c-8d97-6c2ab294b4f4/volumes" Mar 16 16:49:52 crc kubenswrapper[5120]: I0316 16:49:52.763815 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e93e7d0f-2924-48c0-bc57-3a9597f83d70-config-data\") pod \"e93e7d0f-2924-48c0-bc57-3a9597f83d70\" (UID: \"e93e7d0f-2924-48c0-bc57-3a9597f83d70\") " Mar 16 16:49:52 crc kubenswrapper[5120]: I0316 16:49:52.763955 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e93e7d0f-2924-48c0-bc57-3a9597f83d70-combined-ca-bundle\") pod \"e93e7d0f-2924-48c0-bc57-3a9597f83d70\" (UID: \"e93e7d0f-2924-48c0-bc57-3a9597f83d70\") " Mar 16 16:49:52 crc kubenswrapper[5120]: I0316 16:49:52.764060 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7nzcc\" (UniqueName: \"kubernetes.io/projected/e93e7d0f-2924-48c0-bc57-3a9597f83d70-kube-api-access-7nzcc\") pod \"e93e7d0f-2924-48c0-bc57-3a9597f83d70\" (UID: \"e93e7d0f-2924-48c0-bc57-3a9597f83d70\") " Mar 16 16:49:52 crc kubenswrapper[5120]: I0316 16:49:52.782349 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovn-northd-0" podStartSLOduration=4.78232881 podStartE2EDuration="4.78232881s" podCreationTimestamp="2026-03-16 16:49:48 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:49:52.60625218 +0000 UTC m=+4694.760183837" watchObservedRunningTime="2026-03-16 16:49:52.78232881 +0000 UTC m=+4694.936260467" Mar 16 16:49:52 crc kubenswrapper[5120]: I0316 16:49:52.793802 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-66f8c58b5d-5nmtn"] Mar 16 16:49:52 crc kubenswrapper[5120]: I0316 16:49:52.805316 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e93e7d0f-2924-48c0-bc57-3a9597f83d70-kube-api-access-7nzcc" (OuterVolumeSpecName: "kube-api-access-7nzcc") pod "e93e7d0f-2924-48c0-bc57-3a9597f83d70" (UID: "e93e7d0f-2924-48c0-bc57-3a9597f83d70"). InnerVolumeSpecName "kube-api-access-7nzcc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:49:52 crc kubenswrapper[5120]: I0316 16:49:52.810989 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-api-66f8c58b5d-5nmtn"] Mar 16 16:49:52 crc kubenswrapper[5120]: I0316 16:49:52.821277 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:49:52 crc kubenswrapper[5120]: I0316 16:49:52.821324 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:49:52 crc kubenswrapper[5120]: I0316 16:49:52.868575 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7nzcc\" (UniqueName: \"kubernetes.io/projected/e93e7d0f-2924-48c0-bc57-3a9597f83d70-kube-api-access-7nzcc\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:52 crc kubenswrapper[5120]: I0316 16:49:52.966850 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e93e7d0f-2924-48c0-bc57-3a9597f83d70-config-data" (OuterVolumeSpecName: "config-data") pod "e93e7d0f-2924-48c0-bc57-3a9597f83d70" (UID: "e93e7d0f-2924-48c0-bc57-3a9597f83d70"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:49:52 crc kubenswrapper[5120]: I0316 16:49:52.972284 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e93e7d0f-2924-48c0-bc57-3a9597f83d70-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:53 crc kubenswrapper[5120]: I0316 16:49:53.012739 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e93e7d0f-2924-48c0-bc57-3a9597f83d70-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e93e7d0f-2924-48c0-bc57-3a9597f83d70" (UID: "e93e7d0f-2924-48c0-bc57-3a9597f83d70"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:49:53 crc kubenswrapper[5120]: I0316 16:49:53.079054 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e93e7d0f-2924-48c0-bc57-3a9597f83d70-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:53 crc kubenswrapper[5120]: I0316 16:49:53.085903 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:49:53 crc kubenswrapper[5120]: I0316 16:49:53.152043 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:49:53 crc kubenswrapper[5120]: I0316 16:49:53.514105 5120 scope.go:117] "RemoveContainer" containerID="4a1d05bdf4568f0d31e23dfca9c9fbb8395d941ca4ddc89fd84bacfb20b93fd3" Mar 16 16:49:53 crc kubenswrapper[5120]: I0316 16:49:53.679187 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-g9ds4" event={"ID":"eab40383-182c-4760-80e0-652dc37d1e68","Type":"ContainerStarted","Data":"1d0ccd154a7c0690b5a9fdd694f4ee68fe8dec94bc1b4bbc45efa9cae8b6c9b8"} Mar 16 16:49:53 crc kubenswrapper[5120]: I0316 16:49:53.697041 5120 generic.go:358] "Generic (PLEG): container finished" podID="d6038d72-b1a2-4d71-b831-d5fa1de027a7" containerID="753614b6b45ccefdf7745ba5f04677f3ea2b8d9cfc249235942e77233725e467" exitCode=143 Mar 16 16:49:53 crc kubenswrapper[5120]: I0316 16:49:53.697099 5120 generic.go:358] "Generic (PLEG): container finished" podID="d6038d72-b1a2-4d71-b831-d5fa1de027a7" containerID="f70311d415dc9cf04b16655a0e023649f8f9eefdc08997f434414134d73c229f" exitCode=143 Mar 16 16:49:53 crc kubenswrapper[5120]: I0316 16:49:53.697210 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"d6038d72-b1a2-4d71-b831-d5fa1de027a7","Type":"ContainerDied","Data":"753614b6b45ccefdf7745ba5f04677f3ea2b8d9cfc249235942e77233725e467"} Mar 16 16:49:53 crc kubenswrapper[5120]: I0316 16:49:53.697266 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"d6038d72-b1a2-4d71-b831-d5fa1de027a7","Type":"ContainerDied","Data":"f70311d415dc9cf04b16655a0e023649f8f9eefdc08997f434414134d73c229f"} Mar 16 16:49:53 crc kubenswrapper[5120]: I0316 16:49:53.708008 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-9f898f5b6-g9g57" event={"ID":"cdf5b2c0-4a53-4c60-a566-d18398c0c560","Type":"ContainerStarted","Data":"df898b0de10922feb7b36fd60f394f8e931174b83857c581c6ff95197175f244"} Mar 16 16:49:53 crc kubenswrapper[5120]: I0316 16:49:53.717378 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-745d8c69c6-mxmrn" event={"ID":"6e401532-2076-4686-b3cd-59b0629d8a98","Type":"ContainerStarted","Data":"b05f807b39f0414ac1e4b9e596b33773aefa07d56964dc6a65a8c5a15189b010"} Mar 16 16:49:53 crc kubenswrapper[5120]: I0316 16:49:53.726904 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-bootstrap-g9ds4" podStartSLOduration=5.726880194 podStartE2EDuration="5.726880194s" podCreationTimestamp="2026-03-16 16:49:48 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:49:53.718232987 +0000 UTC m=+4695.872164644" watchObservedRunningTime="2026-03-16 16:49:53.726880194 +0000 UTC m=+4695.880811861" Mar 16 16:49:53 crc kubenswrapper[5120]: I0316 16:49:53.747959 5120 generic.go:358] "Generic (PLEG): container finished" podID="3b14f53d-9d11-42e8-b823-65b88191e532" containerID="e979fc4bbbbee656bb574a38e76d8d095ee03dac2aa27609130add421f993387" exitCode=143 Mar 16 16:49:53 crc kubenswrapper[5120]: I0316 16:49:53.748064 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"3b14f53d-9d11-42e8-b823-65b88191e532","Type":"ContainerDied","Data":"e979fc4bbbbee656bb574a38e76d8d095ee03dac2aa27609130add421f993387"} Mar 16 16:49:53 crc kubenswrapper[5120]: I0316 16:49:53.764088 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-5698458656-mpwfb" event={"ID":"2743712c-9e9b-43d6-b07e-19ec95dc3be7","Type":"ContainerStarted","Data":"56538ad3166ee4cefffaba3c1a02fabff7ffd18c7d2b948a51e56f92a279dbbd"} Mar 16 16:49:53 crc kubenswrapper[5120]: I0316 16:49:53.764149 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-5698458656-mpwfb" event={"ID":"2743712c-9e9b-43d6-b07e-19ec95dc3be7","Type":"ContainerStarted","Data":"bbcf69e754da0b5279f29d75d404adb090d28a7bd8e3800a992491b9371ccbec"} Mar 16 16:49:53 crc kubenswrapper[5120]: I0316 16:49:53.767546 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-7d79f76d78-2wccd" event={"ID":"76725a9c-9344-4783-879a-a5ccfb8ba113","Type":"ContainerStarted","Data":"5f72c22d4be62bc31587692dcc838788d79e8c75db1a6a0ccc3277bae2fc488c"} Mar 16 16:49:53 crc kubenswrapper[5120]: I0316 16:49:53.773247 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:49:53 crc kubenswrapper[5120]: I0316 16:49:53.791281 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-576bc9cb6c-q5s4k" event={"ID":"976611b4-4a36-49a3-9bd6-f7b5ca2899f4","Type":"ContainerStarted","Data":"7ec001db9d9a0dc8f997385521689fb1115f53c263a2c629d27622f8ad07041d"} Mar 16 16:49:53 crc kubenswrapper[5120]: I0316 16:49:53.835511 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"e93e7d0f-2924-48c0-bc57-3a9597f83d70","Type":"ContainerDied","Data":"8155440509b03817b69d7556f9abfce3189fa875d3a900c0a8221c4e13fe8b90"} Mar 16 16:49:53 crc kubenswrapper[5120]: I0316 16:49:53.835584 5120 scope.go:117] "RemoveContainer" containerID="731ac2f25a5505892d3ba2b5085eb8ac263c0111abf4d7334a1812bbc50579a5" Mar 16 16:49:53 crc kubenswrapper[5120]: I0316 16:49:53.835729 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:49:53 crc kubenswrapper[5120]: I0316 16:49:53.866901 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-576c5b55d6-5zsh7" event={"ID":"fb4496e5-279b-4520-a345-c4ed00ede8c9","Type":"ContainerStarted","Data":"31db12e43658d9b439ba1ed20816294a537012094b7d53a0e297f4d8b5dc66b2"} Mar 16 16:49:53 crc kubenswrapper[5120]: I0316 16:49:53.866949 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:49:53 crc kubenswrapper[5120]: I0316 16:49:53.869962 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="77fd10d5-5894-450f-bba5-8261c3ca1b4e" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"http://10.217.1.230:8775/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 16:49:53 crc kubenswrapper[5120]: I0316 16:49:53.872147 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-worker-576bc9cb6c-q5s4k" podStartSLOduration=5.872129499 podStartE2EDuration="5.872129499s" podCreationTimestamp="2026-03-16 16:49:48 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:49:53.84265115 +0000 UTC m=+4695.996582807" watchObservedRunningTime="2026-03-16 16:49:53.872129499 +0000 UTC m=+4696.026061156" Mar 16 16:49:53 crc kubenswrapper[5120]: I0316 16:49:53.881159 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="77fd10d5-5894-450f-bba5-8261c3ca1b4e" containerName="nova-metadata-log" probeResult="failure" output="Get \"http://10.217.1.230:8775/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 16:49:53 crc kubenswrapper[5120]: I0316 16:49:53.902406 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-5dc7897bc-w6pc6"] Mar 16 16:49:53 crc kubenswrapper[5120]: I0316 16:49:53.902652 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-5dc7897bc-w6pc6" podUID="9ad6c5f4-1902-463a-8a6f-6beade89b6a1" containerName="barbican-worker-log" containerID="cri-o://5fa0203e88f871ddd2ecef9d8dfe845cb0e16600196a7b9cbc2d21f7e6ec7ba5" gracePeriod=30 Mar 16 16:49:53 crc kubenswrapper[5120]: I0316 16:49:53.902791 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-5dc7897bc-w6pc6" podUID="9ad6c5f4-1902-463a-8a6f-6beade89b6a1" containerName="barbican-worker" containerID="cri-o://6e240afa0b6c2548f071bab943c62ba78e67a0bd1fc1ce0d71d9a3a13fc14d31" gracePeriod=30 Mar 16 16:49:53 crc kubenswrapper[5120]: I0316 16:49:53.921160 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"d6038d72-b1a2-4d71-b831-d5fa1de027a7\" (UID: \"d6038d72-b1a2-4d71-b831-d5fa1de027a7\") " Mar 16 16:49:53 crc kubenswrapper[5120]: I0316 16:49:53.921286 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d6038d72-b1a2-4d71-b831-d5fa1de027a7-config-data\") pod \"d6038d72-b1a2-4d71-b831-d5fa1de027a7\" (UID: \"d6038d72-b1a2-4d71-b831-d5fa1de027a7\") " Mar 16 16:49:53 crc kubenswrapper[5120]: I0316 16:49:53.921400 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/d6038d72-b1a2-4d71-b831-d5fa1de027a7-httpd-run\") pod \"d6038d72-b1a2-4d71-b831-d5fa1de027a7\" (UID: \"d6038d72-b1a2-4d71-b831-d5fa1de027a7\") " Mar 16 16:49:53 crc kubenswrapper[5120]: I0316 16:49:53.921454 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d6038d72-b1a2-4d71-b831-d5fa1de027a7-logs\") pod \"d6038d72-b1a2-4d71-b831-d5fa1de027a7\" (UID: \"d6038d72-b1a2-4d71-b831-d5fa1de027a7\") " Mar 16 16:49:53 crc kubenswrapper[5120]: I0316 16:49:53.921584 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d6038d72-b1a2-4d71-b831-d5fa1de027a7-combined-ca-bundle\") pod \"d6038d72-b1a2-4d71-b831-d5fa1de027a7\" (UID: \"d6038d72-b1a2-4d71-b831-d5fa1de027a7\") " Mar 16 16:49:53 crc kubenswrapper[5120]: I0316 16:49:53.921689 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wf2z4\" (UniqueName: \"kubernetes.io/projected/d6038d72-b1a2-4d71-b831-d5fa1de027a7-kube-api-access-wf2z4\") pod \"d6038d72-b1a2-4d71-b831-d5fa1de027a7\" (UID: \"d6038d72-b1a2-4d71-b831-d5fa1de027a7\") " Mar 16 16:49:53 crc kubenswrapper[5120]: I0316 16:49:53.921747 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d6038d72-b1a2-4d71-b831-d5fa1de027a7-scripts\") pod \"d6038d72-b1a2-4d71-b831-d5fa1de027a7\" (UID: \"d6038d72-b1a2-4d71-b831-d5fa1de027a7\") " Mar 16 16:49:53 crc kubenswrapper[5120]: I0316 16:49:53.922499 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6038d72-b1a2-4d71-b831-d5fa1de027a7-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "d6038d72-b1a2-4d71-b831-d5fa1de027a7" (UID: "d6038d72-b1a2-4d71-b831-d5fa1de027a7"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:49:53 crc kubenswrapper[5120]: I0316 16:49:53.922940 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/d6038d72-b1a2-4d71-b831-d5fa1de027a7-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:53 crc kubenswrapper[5120]: I0316 16:49:53.923145 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6038d72-b1a2-4d71-b831-d5fa1de027a7-logs" (OuterVolumeSpecName: "logs") pod "d6038d72-b1a2-4d71-b831-d5fa1de027a7" (UID: "d6038d72-b1a2-4d71-b831-d5fa1de027a7"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:49:53 crc kubenswrapper[5120]: I0316 16:49:53.930341 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 16:49:53 crc kubenswrapper[5120]: I0316 16:49:53.933839 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage01-crc" (OuterVolumeSpecName: "glance") pod "d6038d72-b1a2-4d71-b831-d5fa1de027a7" (UID: "d6038d72-b1a2-4d71-b831-d5fa1de027a7"). InnerVolumeSpecName "local-storage01-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:49:53 crc kubenswrapper[5120]: I0316 16:49:53.942943 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6038d72-b1a2-4d71-b831-d5fa1de027a7-kube-api-access-wf2z4" (OuterVolumeSpecName: "kube-api-access-wf2z4") pod "d6038d72-b1a2-4d71-b831-d5fa1de027a7" (UID: "d6038d72-b1a2-4d71-b831-d5fa1de027a7"). InnerVolumeSpecName "kube-api-access-wf2z4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:49:53 crc kubenswrapper[5120]: I0316 16:49:53.976099 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 16:49:53 crc kubenswrapper[5120]: I0316 16:49:53.992026 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6038d72-b1a2-4d71-b831-d5fa1de027a7-scripts" (OuterVolumeSpecName: "scripts") pod "d6038d72-b1a2-4d71-b831-d5fa1de027a7" (UID: "d6038d72-b1a2-4d71-b831-d5fa1de027a7"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:49:53 crc kubenswrapper[5120]: I0316 16:49:53.999621 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 16:49:54 crc kubenswrapper[5120]: I0316 16:49:54.001011 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e93e7d0f-2924-48c0-bc57-3a9597f83d70" containerName="nova-cell1-conductor-conductor" Mar 16 16:49:54 crc kubenswrapper[5120]: I0316 16:49:54.001035 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e93e7d0f-2924-48c0-bc57-3a9597f83d70" containerName="nova-cell1-conductor-conductor" Mar 16 16:49:54 crc kubenswrapper[5120]: I0316 16:49:54.001069 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6038d72-b1a2-4d71-b831-d5fa1de027a7" containerName="glance-httpd" Mar 16 16:49:54 crc kubenswrapper[5120]: I0316 16:49:54.001075 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6038d72-b1a2-4d71-b831-d5fa1de027a7" containerName="glance-httpd" Mar 16 16:49:54 crc kubenswrapper[5120]: I0316 16:49:54.001085 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6038d72-b1a2-4d71-b831-d5fa1de027a7" containerName="glance-log" Mar 16 16:49:54 crc kubenswrapper[5120]: I0316 16:49:54.001091 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6038d72-b1a2-4d71-b831-d5fa1de027a7" containerName="glance-log" Mar 16 16:49:54 crc kubenswrapper[5120]: I0316 16:49:54.001108 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="370e78a7-6b53-4f13-aa62-8afa448a0b7d" containerName="neutron-api" Mar 16 16:49:54 crc kubenswrapper[5120]: I0316 16:49:54.001115 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="370e78a7-6b53-4f13-aa62-8afa448a0b7d" containerName="neutron-api" Mar 16 16:49:54 crc kubenswrapper[5120]: I0316 16:49:54.001134 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="370e78a7-6b53-4f13-aa62-8afa448a0b7d" containerName="neutron-httpd" Mar 16 16:49:54 crc kubenswrapper[5120]: I0316 16:49:54.001140 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="370e78a7-6b53-4f13-aa62-8afa448a0b7d" containerName="neutron-httpd" Mar 16 16:49:54 crc kubenswrapper[5120]: I0316 16:49:54.001161 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3dad7391-908f-4984-9272-f28450644483" containerName="barbican-api-log" Mar 16 16:49:54 crc kubenswrapper[5120]: I0316 16:49:54.001166 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="3dad7391-908f-4984-9272-f28450644483" containerName="barbican-api-log" Mar 16 16:49:54 crc kubenswrapper[5120]: I0316 16:49:54.001173 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3dad7391-908f-4984-9272-f28450644483" containerName="barbican-api" Mar 16 16:49:54 crc kubenswrapper[5120]: I0316 16:49:54.001178 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="3dad7391-908f-4984-9272-f28450644483" containerName="barbican-api" Mar 16 16:49:54 crc kubenswrapper[5120]: I0316 16:49:54.001351 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="d6038d72-b1a2-4d71-b831-d5fa1de027a7" containerName="glance-httpd" Mar 16 16:49:54 crc kubenswrapper[5120]: I0316 16:49:54.001366 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="370e78a7-6b53-4f13-aa62-8afa448a0b7d" containerName="neutron-httpd" Mar 16 16:49:54 crc kubenswrapper[5120]: I0316 16:49:54.001380 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="3dad7391-908f-4984-9272-f28450644483" containerName="barbican-api-log" Mar 16 16:49:54 crc kubenswrapper[5120]: I0316 16:49:54.001390 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e93e7d0f-2924-48c0-bc57-3a9597f83d70" containerName="nova-cell1-conductor-conductor" Mar 16 16:49:54 crc kubenswrapper[5120]: I0316 16:49:54.001399 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="3dad7391-908f-4984-9272-f28450644483" containerName="barbican-api" Mar 16 16:49:54 crc kubenswrapper[5120]: I0316 16:49:54.001410 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="370e78a7-6b53-4f13-aa62-8afa448a0b7d" containerName="neutron-api" Mar 16 16:49:54 crc kubenswrapper[5120]: I0316 16:49:54.001419 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="d6038d72-b1a2-4d71-b831-d5fa1de027a7" containerName="glance-log" Mar 16 16:49:54 crc kubenswrapper[5120]: I0316 16:49:54.030299 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") on node \"crc\" " Mar 16 16:49:54 crc kubenswrapper[5120]: I0316 16:49:54.030336 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d6038d72-b1a2-4d71-b831-d5fa1de027a7-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:54 crc kubenswrapper[5120]: I0316 16:49:54.030351 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wf2z4\" (UniqueName: \"kubernetes.io/projected/d6038d72-b1a2-4d71-b831-d5fa1de027a7-kube-api-access-wf2z4\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:54 crc kubenswrapper[5120]: I0316 16:49:54.030363 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d6038d72-b1a2-4d71-b831-d5fa1de027a7-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:54 crc kubenswrapper[5120]: I0316 16:49:54.051972 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6038d72-b1a2-4d71-b831-d5fa1de027a7-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "d6038d72-b1a2-4d71-b831-d5fa1de027a7" (UID: "d6038d72-b1a2-4d71-b831-d5fa1de027a7"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:49:54 crc kubenswrapper[5120]: I0316 16:49:54.059451 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 16:49:54 crc kubenswrapper[5120]: I0316 16:49:54.059619 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:49:54 crc kubenswrapper[5120]: I0316 16:49:54.110306 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-conductor-config-data\"" Mar 16 16:49:54 crc kubenswrapper[5120]: I0316 16:49:54.136425 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0fdb1c41-3340-4013-99ea-c36c3891ff92-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"0fdb1c41-3340-4013-99ea-c36c3891ff92\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:49:54 crc kubenswrapper[5120]: I0316 16:49:54.136707 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgzmk\" (UniqueName: \"kubernetes.io/projected/0fdb1c41-3340-4013-99ea-c36c3891ff92-kube-api-access-xgzmk\") pod \"nova-cell1-conductor-0\" (UID: \"0fdb1c41-3340-4013-99ea-c36c3891ff92\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:49:54 crc kubenswrapper[5120]: I0316 16:49:54.136827 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0fdb1c41-3340-4013-99ea-c36c3891ff92-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"0fdb1c41-3340-4013-99ea-c36c3891ff92\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:49:54 crc kubenswrapper[5120]: I0316 16:49:54.136883 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d6038d72-b1a2-4d71-b831-d5fa1de027a7-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:54 crc kubenswrapper[5120]: I0316 16:49:54.160783 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage01-crc" (UniqueName: "kubernetes.io/local-volume/local-storage01-crc") on node "crc" Mar 16 16:49:54 crc kubenswrapper[5120]: I0316 16:49:54.190186 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6038d72-b1a2-4d71-b831-d5fa1de027a7-config-data" (OuterVolumeSpecName: "config-data") pod "d6038d72-b1a2-4d71-b831-d5fa1de027a7" (UID: "d6038d72-b1a2-4d71-b831-d5fa1de027a7"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:49:54 crc kubenswrapper[5120]: I0316 16:49:54.251646 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0fdb1c41-3340-4013-99ea-c36c3891ff92-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"0fdb1c41-3340-4013-99ea-c36c3891ff92\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:49:54 crc kubenswrapper[5120]: I0316 16:49:54.252269 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xgzmk\" (UniqueName: \"kubernetes.io/projected/0fdb1c41-3340-4013-99ea-c36c3891ff92-kube-api-access-xgzmk\") pod \"nova-cell1-conductor-0\" (UID: \"0fdb1c41-3340-4013-99ea-c36c3891ff92\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:49:54 crc kubenswrapper[5120]: I0316 16:49:54.252459 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0fdb1c41-3340-4013-99ea-c36c3891ff92-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"0fdb1c41-3340-4013-99ea-c36c3891ff92\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:49:54 crc kubenswrapper[5120]: I0316 16:49:54.252560 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:54 crc kubenswrapper[5120]: I0316 16:49:54.252580 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d6038d72-b1a2-4d71-b831-d5fa1de027a7-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:54 crc kubenswrapper[5120]: I0316 16:49:54.282969 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0fdb1c41-3340-4013-99ea-c36c3891ff92-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"0fdb1c41-3340-4013-99ea-c36c3891ff92\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:49:54 crc kubenswrapper[5120]: I0316 16:49:54.310933 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0fdb1c41-3340-4013-99ea-c36c3891ff92-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"0fdb1c41-3340-4013-99ea-c36c3891ff92\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:49:54 crc kubenswrapper[5120]: I0316 16:49:54.313281 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgzmk\" (UniqueName: \"kubernetes.io/projected/0fdb1c41-3340-4013-99ea-c36c3891ff92-kube-api-access-xgzmk\") pod \"nova-cell1-conductor-0\" (UID: \"0fdb1c41-3340-4013-99ea-c36c3891ff92\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:49:54 crc kubenswrapper[5120]: I0316 16:49:54.932603 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3dad7391-908f-4984-9272-f28450644483" path="/var/lib/kubelet/pods/3dad7391-908f-4984-9272-f28450644483/volumes" Mar 16 16:49:54 crc kubenswrapper[5120]: I0316 16:49:54.933725 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e93e7d0f-2924-48c0-bc57-3a9597f83d70" path="/var/lib/kubelet/pods/e93e7d0f-2924-48c0-bc57-3a9597f83d70/volumes" Mar 16 16:49:55 crc kubenswrapper[5120]: I0316 16:49:55.007222 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-5698458656-mpwfb" event={"ID":"2743712c-9e9b-43d6-b07e-19ec95dc3be7","Type":"ContainerStarted","Data":"5d8291c7f08ffb8f0d180d80e30096214390d3c784fcf321d76d6edbfdc27dcd"} Mar 16 16:49:55 crc kubenswrapper[5120]: I0316 16:49:55.012124 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-5698458656-mpwfb" Mar 16 16:49:55 crc kubenswrapper[5120]: I0316 16:49:55.012156 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-5698458656-mpwfb" Mar 16 16:49:55 crc kubenswrapper[5120]: I0316 16:49:55.051014 5120 generic.go:358] "Generic (PLEG): container finished" podID="5f1fe655-07dd-4959-98ac-372e797369fa" containerID="69f752550a5578263c364529de570d74151a5bd7974ef22cf21fdb0c1513409f" exitCode=0 Mar 16 16:49:55 crc kubenswrapper[5120]: I0316 16:49:55.051368 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"5f1fe655-07dd-4959-98ac-372e797369fa","Type":"ContainerDied","Data":"69f752550a5578263c364529de570d74151a5bd7974ef22cf21fdb0c1513409f"} Mar 16 16:49:55 crc kubenswrapper[5120]: I0316 16:49:55.070428 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-api-5698458656-mpwfb" podStartSLOduration=7.070400452 podStartE2EDuration="7.070400452s" podCreationTimestamp="2026-03-16 16:49:48 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:49:55.034666393 +0000 UTC m=+4697.188598070" watchObservedRunningTime="2026-03-16 16:49:55.070400452 +0000 UTC m=+4697.224332109" Mar 16 16:49:55 crc kubenswrapper[5120]: I0316 16:49:55.083402 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:49:55 crc kubenswrapper[5120]: I0316 16:49:55.093348 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-678df6fbdb-lfhdz_398bb1bd-f380-4374-b880-d7217d37e010/neutron-api/0.log" Mar 16 16:49:55 crc kubenswrapper[5120]: I0316 16:49:55.093402 5120 generic.go:358] "Generic (PLEG): container finished" podID="398bb1bd-f380-4374-b880-d7217d37e010" containerID="357e8754e619bde82ee9a20e2bb6e7f080cf0e315df9fb1354335a7aa606bd9f" exitCode=1 Mar 16 16:49:55 crc kubenswrapper[5120]: I0316 16:49:55.093708 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-678df6fbdb-lfhdz" event={"ID":"398bb1bd-f380-4374-b880-d7217d37e010","Type":"ContainerDied","Data":"357e8754e619bde82ee9a20e2bb6e7f080cf0e315df9fb1354335a7aa606bd9f"} Mar 16 16:49:55 crc kubenswrapper[5120]: I0316 16:49:55.108435 5120 generic.go:358] "Generic (PLEG): container finished" podID="9ad6c5f4-1902-463a-8a6f-6beade89b6a1" containerID="5fa0203e88f871ddd2ecef9d8dfe845cb0e16600196a7b9cbc2d21f7e6ec7ba5" exitCode=143 Mar 16 16:49:55 crc kubenswrapper[5120]: I0316 16:49:55.108613 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-5dc7897bc-w6pc6" event={"ID":"9ad6c5f4-1902-463a-8a6f-6beade89b6a1","Type":"ContainerDied","Data":"5fa0203e88f871ddd2ecef9d8dfe845cb0e16600196a7b9cbc2d21f7e6ec7ba5"} Mar 16 16:49:55 crc kubenswrapper[5120]: I0316 16:49:55.111557 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"d6038d72-b1a2-4d71-b831-d5fa1de027a7","Type":"ContainerDied","Data":"e90d4b6202e7a6e8bf55dd3a3e0a1ee52a5cd401d96d7ece30b6880c03460ac6"} Mar 16 16:49:55 crc kubenswrapper[5120]: I0316 16:49:55.111598 5120 scope.go:117] "RemoveContainer" containerID="753614b6b45ccefdf7745ba5f04677f3ea2b8d9cfc249235942e77233725e467" Mar 16 16:49:55 crc kubenswrapper[5120]: I0316 16:49:55.111749 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:49:55 crc kubenswrapper[5120]: I0316 16:49:55.148810 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-9f898f5b6-g9g57" event={"ID":"cdf5b2c0-4a53-4c60-a566-d18398c0c560","Type":"ContainerStarted","Data":"7acf7b8f3d2c22d03c90e2cc9b9207ac80353b7bf126751bf2eff2f88c0697d8"} Mar 16 16:49:55 crc kubenswrapper[5120]: I0316 16:49:55.185464 5120 scope.go:117] "RemoveContainer" containerID="f70311d415dc9cf04b16655a0e023649f8f9eefdc08997f434414134d73c229f" Mar 16 16:49:55 crc kubenswrapper[5120]: I0316 16:49:55.201442 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:49:55 crc kubenswrapper[5120]: I0316 16:49:55.245822 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:49:55 crc kubenswrapper[5120]: I0316 16:49:55.273510 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:49:55 crc kubenswrapper[5120]: I0316 16:49:55.287424 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:49:55 crc kubenswrapper[5120]: I0316 16:49:55.287595 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:49:55 crc kubenswrapper[5120]: I0316 16:49:55.293491 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-internal-config-data\"" Mar 16 16:49:55 crc kubenswrapper[5120]: I0316 16:49:55.293707 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-scripts\"" Mar 16 16:49:55 crc kubenswrapper[5120]: I0316 16:49:55.294370 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-internal-svc\"" Mar 16 16:49:55 crc kubenswrapper[5120]: I0316 16:49:55.294527 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-glance-dockercfg-6m2c9\"" Mar 16 16:49:55 crc kubenswrapper[5120]: I0316 16:49:55.349122 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:49:55 crc kubenswrapper[5120]: I0316 16:49:55.466239 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"glance-default-internal-api-0\" (UID: \"e5b6bb5a-fb93-4761-b995-1842090c7047\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:49:55 crc kubenswrapper[5120]: I0316 16:49:55.467064 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e5b6bb5a-fb93-4761-b995-1842090c7047-scripts\") pod \"glance-default-internal-api-0\" (UID: \"e5b6bb5a-fb93-4761-b995-1842090c7047\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:49:55 crc kubenswrapper[5120]: I0316 16:49:55.467342 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e5b6bb5a-fb93-4761-b995-1842090c7047-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"e5b6bb5a-fb93-4761-b995-1842090c7047\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:49:55 crc kubenswrapper[5120]: I0316 16:49:55.467887 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dwmsm\" (UniqueName: \"kubernetes.io/projected/e5b6bb5a-fb93-4761-b995-1842090c7047-kube-api-access-dwmsm\") pod \"glance-default-internal-api-0\" (UID: \"e5b6bb5a-fb93-4761-b995-1842090c7047\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:49:55 crc kubenswrapper[5120]: I0316 16:49:55.467993 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e5b6bb5a-fb93-4761-b995-1842090c7047-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"e5b6bb5a-fb93-4761-b995-1842090c7047\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:49:55 crc kubenswrapper[5120]: I0316 16:49:55.468061 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e5b6bb5a-fb93-4761-b995-1842090c7047-logs\") pod \"glance-default-internal-api-0\" (UID: \"e5b6bb5a-fb93-4761-b995-1842090c7047\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:49:55 crc kubenswrapper[5120]: I0316 16:49:55.468167 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e5b6bb5a-fb93-4761-b995-1842090c7047-config-data\") pod \"glance-default-internal-api-0\" (UID: \"e5b6bb5a-fb93-4761-b995-1842090c7047\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:49:55 crc kubenswrapper[5120]: I0316 16:49:55.468241 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/e5b6bb5a-fb93-4761-b995-1842090c7047-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"e5b6bb5a-fb93-4761-b995-1842090c7047\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:49:55 crc kubenswrapper[5120]: I0316 16:49:55.570229 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dwmsm\" (UniqueName: \"kubernetes.io/projected/e5b6bb5a-fb93-4761-b995-1842090c7047-kube-api-access-dwmsm\") pod \"glance-default-internal-api-0\" (UID: \"e5b6bb5a-fb93-4761-b995-1842090c7047\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:49:55 crc kubenswrapper[5120]: I0316 16:49:55.570566 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e5b6bb5a-fb93-4761-b995-1842090c7047-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"e5b6bb5a-fb93-4761-b995-1842090c7047\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:49:55 crc kubenswrapper[5120]: I0316 16:49:55.570595 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e5b6bb5a-fb93-4761-b995-1842090c7047-logs\") pod \"glance-default-internal-api-0\" (UID: \"e5b6bb5a-fb93-4761-b995-1842090c7047\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:49:55 crc kubenswrapper[5120]: I0316 16:49:55.570663 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e5b6bb5a-fb93-4761-b995-1842090c7047-config-data\") pod \"glance-default-internal-api-0\" (UID: \"e5b6bb5a-fb93-4761-b995-1842090c7047\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:49:55 crc kubenswrapper[5120]: I0316 16:49:55.570718 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/e5b6bb5a-fb93-4761-b995-1842090c7047-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"e5b6bb5a-fb93-4761-b995-1842090c7047\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:49:55 crc kubenswrapper[5120]: I0316 16:49:55.570803 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"glance-default-internal-api-0\" (UID: \"e5b6bb5a-fb93-4761-b995-1842090c7047\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:49:55 crc kubenswrapper[5120]: I0316 16:49:55.570824 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e5b6bb5a-fb93-4761-b995-1842090c7047-scripts\") pod \"glance-default-internal-api-0\" (UID: \"e5b6bb5a-fb93-4761-b995-1842090c7047\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:49:55 crc kubenswrapper[5120]: I0316 16:49:55.570919 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e5b6bb5a-fb93-4761-b995-1842090c7047-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"e5b6bb5a-fb93-4761-b995-1842090c7047\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:49:55 crc kubenswrapper[5120]: I0316 16:49:55.572906 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"glance-default-internal-api-0\" (UID: \"e5b6bb5a-fb93-4761-b995-1842090c7047\") device mount path \"/mnt/openstack/pv01\"" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:49:55 crc kubenswrapper[5120]: I0316 16:49:55.578569 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/e5b6bb5a-fb93-4761-b995-1842090c7047-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"e5b6bb5a-fb93-4761-b995-1842090c7047\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:49:55 crc kubenswrapper[5120]: I0316 16:49:55.579444 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e5b6bb5a-fb93-4761-b995-1842090c7047-logs\") pod \"glance-default-internal-api-0\" (UID: \"e5b6bb5a-fb93-4761-b995-1842090c7047\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:49:55 crc kubenswrapper[5120]: I0316 16:49:55.602972 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e5b6bb5a-fb93-4761-b995-1842090c7047-config-data\") pod \"glance-default-internal-api-0\" (UID: \"e5b6bb5a-fb93-4761-b995-1842090c7047\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:49:55 crc kubenswrapper[5120]: I0316 16:49:55.610569 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e5b6bb5a-fb93-4761-b995-1842090c7047-scripts\") pod \"glance-default-internal-api-0\" (UID: \"e5b6bb5a-fb93-4761-b995-1842090c7047\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:49:55 crc kubenswrapper[5120]: I0316 16:49:55.624458 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e5b6bb5a-fb93-4761-b995-1842090c7047-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"e5b6bb5a-fb93-4761-b995-1842090c7047\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:49:55 crc kubenswrapper[5120]: I0316 16:49:55.631785 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dwmsm\" (UniqueName: \"kubernetes.io/projected/e5b6bb5a-fb93-4761-b995-1842090c7047-kube-api-access-dwmsm\") pod \"glance-default-internal-api-0\" (UID: \"e5b6bb5a-fb93-4761-b995-1842090c7047\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:49:55 crc kubenswrapper[5120]: I0316 16:49:55.635404 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e5b6bb5a-fb93-4761-b995-1842090c7047-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"e5b6bb5a-fb93-4761-b995-1842090c7047\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:49:55 crc kubenswrapper[5120]: I0316 16:49:55.642834 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"glance-default-internal-api-0\" (UID: \"e5b6bb5a-fb93-4761-b995-1842090c7047\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:49:55 crc kubenswrapper[5120]: I0316 16:49:55.804172 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:49:55 crc kubenswrapper[5120]: I0316 16:49:55.810625 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-678df6fbdb-lfhdz_398bb1bd-f380-4374-b880-d7217d37e010/neutron-api/0.log" Mar 16 16:49:55 crc kubenswrapper[5120]: I0316 16:49:55.810716 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-678df6fbdb-lfhdz" Mar 16 16:49:55 crc kubenswrapper[5120]: I0316 16:49:55.927839 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 16:49:55 crc kubenswrapper[5120]: I0316 16:49:55.994677 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/398bb1bd-f380-4374-b880-d7217d37e010-config\") pod \"398bb1bd-f380-4374-b880-d7217d37e010\" (UID: \"398bb1bd-f380-4374-b880-d7217d37e010\") " Mar 16 16:49:55 crc kubenswrapper[5120]: I0316 16:49:55.994985 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/398bb1bd-f380-4374-b880-d7217d37e010-httpd-config\") pod \"398bb1bd-f380-4374-b880-d7217d37e010\" (UID: \"398bb1bd-f380-4374-b880-d7217d37e010\") " Mar 16 16:49:55 crc kubenswrapper[5120]: I0316 16:49:55.995018 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/398bb1bd-f380-4374-b880-d7217d37e010-combined-ca-bundle\") pod \"398bb1bd-f380-4374-b880-d7217d37e010\" (UID: \"398bb1bd-f380-4374-b880-d7217d37e010\") " Mar 16 16:49:55 crc kubenswrapper[5120]: I0316 16:49:55.995132 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wbbx5\" (UniqueName: \"kubernetes.io/projected/398bb1bd-f380-4374-b880-d7217d37e010-kube-api-access-wbbx5\") pod \"398bb1bd-f380-4374-b880-d7217d37e010\" (UID: \"398bb1bd-f380-4374-b880-d7217d37e010\") " Mar 16 16:49:56 crc kubenswrapper[5120]: I0316 16:49:56.011002 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/398bb1bd-f380-4374-b880-d7217d37e010-kube-api-access-wbbx5" (OuterVolumeSpecName: "kube-api-access-wbbx5") pod "398bb1bd-f380-4374-b880-d7217d37e010" (UID: "398bb1bd-f380-4374-b880-d7217d37e010"). InnerVolumeSpecName "kube-api-access-wbbx5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:49:56 crc kubenswrapper[5120]: I0316 16:49:56.034516 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/398bb1bd-f380-4374-b880-d7217d37e010-httpd-config" (OuterVolumeSpecName: "httpd-config") pod "398bb1bd-f380-4374-b880-d7217d37e010" (UID: "398bb1bd-f380-4374-b880-d7217d37e010"). InnerVolumeSpecName "httpd-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:49:56 crc kubenswrapper[5120]: I0316 16:49:56.102049 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/398bb1bd-f380-4374-b880-d7217d37e010-httpd-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:56 crc kubenswrapper[5120]: I0316 16:49:56.102086 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wbbx5\" (UniqueName: \"kubernetes.io/projected/398bb1bd-f380-4374-b880-d7217d37e010-kube-api-access-wbbx5\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:56 crc kubenswrapper[5120]: I0316 16:49:56.211017 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-745d8c69c6-mxmrn" event={"ID":"6e401532-2076-4686-b3cd-59b0629d8a98","Type":"ContainerStarted","Data":"b94c9dace8d978b9884fd9eb3c2d9b207fd644529e20169a1f3b58038c6eeed4"} Mar 16 16:49:56 crc kubenswrapper[5120]: I0316 16:49:56.211078 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-745d8c69c6-mxmrn" event={"ID":"6e401532-2076-4686-b3cd-59b0629d8a98","Type":"ContainerStarted","Data":"9571e0c79783deb3cda39e05db9a2c7ebbbdc091c2ffa216a55fd690c9879f18"} Mar 16 16:49:56 crc kubenswrapper[5120]: I0316 16:49:56.211299 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-745d8c69c6-mxmrn" podUID="6e401532-2076-4686-b3cd-59b0629d8a98" containerName="neutron-api" containerID="cri-o://9571e0c79783deb3cda39e05db9a2c7ebbbdc091c2ffa216a55fd690c9879f18" gracePeriod=30 Mar 16 16:49:56 crc kubenswrapper[5120]: I0316 16:49:56.211604 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-745d8c69c6-mxmrn" podUID="6e401532-2076-4686-b3cd-59b0629d8a98" containerName="neutron-httpd" containerID="cri-o://b94c9dace8d978b9884fd9eb3c2d9b207fd644529e20169a1f3b58038c6eeed4" gracePeriod=30 Mar 16 16:49:56 crc kubenswrapper[5120]: I0316 16:49:56.211597 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/neutron-745d8c69c6-mxmrn" Mar 16 16:49:56 crc kubenswrapper[5120]: I0316 16:49:56.239338 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"0fdb1c41-3340-4013-99ea-c36c3891ff92","Type":"ContainerStarted","Data":"9d4272fa4dc2f3763e756aee01190f84f865c3d367ea1207eace6a36796f6fcc"} Mar 16 16:49:56 crc kubenswrapper[5120]: I0316 16:49:56.252343 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-7d79f76d78-2wccd" event={"ID":"76725a9c-9344-4783-879a-a5ccfb8ba113","Type":"ContainerStarted","Data":"cbad9909ed660642808dd41fc2eb57364913b31411887e63d5aa7e51bcfac5f2"} Mar 16 16:49:56 crc kubenswrapper[5120]: I0316 16:49:56.252739 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-7d79f76d78-2wccd" event={"ID":"76725a9c-9344-4783-879a-a5ccfb8ba113","Type":"ContainerStarted","Data":"3c0d9b67b2189176f48613a02fe74c98727c6d53e854de247f7fef9df9ae9b9f"} Mar 16 16:49:56 crc kubenswrapper[5120]: I0316 16:49:56.254516 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-7d79f76d78-2wccd" Mar 16 16:49:56 crc kubenswrapper[5120]: I0316 16:49:56.254552 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-7d79f76d78-2wccd" Mar 16 16:49:56 crc kubenswrapper[5120]: I0316 16:49:56.256858 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/398bb1bd-f380-4374-b880-d7217d37e010-config" (OuterVolumeSpecName: "config") pod "398bb1bd-f380-4374-b880-d7217d37e010" (UID: "398bb1bd-f380-4374-b880-d7217d37e010"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:49:56 crc kubenswrapper[5120]: I0316 16:49:56.266298 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-678df6fbdb-lfhdz_398bb1bd-f380-4374-b880-d7217d37e010/neutron-api/0.log" Mar 16 16:49:56 crc kubenswrapper[5120]: I0316 16:49:56.266484 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-678df6fbdb-lfhdz" event={"ID":"398bb1bd-f380-4374-b880-d7217d37e010","Type":"ContainerDied","Data":"93a2d92c3bf1eb69083a4a6ce8aeb25bddf5d8a4b69a4861349c2dbfa9f8a8d5"} Mar 16 16:49:56 crc kubenswrapper[5120]: I0316 16:49:56.266535 5120 scope.go:117] "RemoveContainer" containerID="b932247b64920daaa5151fe9bb97c9f517c85a794047e555fbd45772a062a8e1" Mar 16 16:49:56 crc kubenswrapper[5120]: I0316 16:49:56.266725 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-678df6fbdb-lfhdz" Mar 16 16:49:56 crc kubenswrapper[5120]: I0316 16:49:56.285004 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-745d8c69c6-mxmrn" podStartSLOduration=8.284975225 podStartE2EDuration="8.284975225s" podCreationTimestamp="2026-03-16 16:49:48 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:49:56.240018481 +0000 UTC m=+4698.393950138" watchObservedRunningTime="2026-03-16 16:49:56.284975225 +0000 UTC m=+4698.438906882" Mar 16 16:49:56 crc kubenswrapper[5120]: I0316 16:49:56.288091 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-576c5b55d6-5zsh7" event={"ID":"fb4496e5-279b-4520-a345-c4ed00ede8c9","Type":"ContainerStarted","Data":"6b88504f95b540a2b147aae744cdfc0147fe840248de0b7dbb003027bcb85307"} Mar 16 16:49:56 crc kubenswrapper[5120]: I0316 16:49:56.296116 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-7d79f76d78-2wccd" podStartSLOduration=8.29609254 podStartE2EDuration="8.29609254s" podCreationTimestamp="2026-03-16 16:49:48 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:49:56.281921401 +0000 UTC m=+4698.435853058" watchObservedRunningTime="2026-03-16 16:49:56.29609254 +0000 UTC m=+4698.450024197" Mar 16 16:49:56 crc kubenswrapper[5120]: I0316 16:49:56.307174 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/398bb1bd-f380-4374-b880-d7217d37e010-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "398bb1bd-f380-4374-b880-d7217d37e010" (UID: "398bb1bd-f380-4374-b880-d7217d37e010"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:49:56 crc kubenswrapper[5120]: I0316 16:49:56.307926 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"e2cf7c36-f4c0-4831-8b31-480469e7da93","Type":"ContainerStarted","Data":"103a8032a6a4014e1df990d0cb46eb8ffe1a02da2ee5c3d25609463114e65f9b"} Mar 16 16:49:56 crc kubenswrapper[5120]: I0316 16:49:56.311290 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/398bb1bd-f380-4374-b880-d7217d37e010-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:56 crc kubenswrapper[5120]: I0316 16:49:56.311329 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/398bb1bd-f380-4374-b880-d7217d37e010-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:56 crc kubenswrapper[5120]: I0316 16:49:56.317720 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-keystone-listener-576c5b55d6-5zsh7" podStartSLOduration=8.317703022 podStartE2EDuration="8.317703022s" podCreationTimestamp="2026-03-16 16:49:48 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:49:56.307657337 +0000 UTC m=+4698.461589014" watchObservedRunningTime="2026-03-16 16:49:56.317703022 +0000 UTC m=+4698.471634679" Mar 16 16:49:56 crc kubenswrapper[5120]: I0316 16:49:56.353995 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-86d6cb7f98-5w9h4"] Mar 16 16:49:56 crc kubenswrapper[5120]: I0316 16:49:56.354321 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-86d6cb7f98-5w9h4" podUID="5b516ced-8076-4f11-8398-77eaca65d050" containerName="barbican-keystone-listener-log" containerID="cri-o://130578ec08e3530ef1b82a4fd9b1a63bb6ef4eebe8c92ece6756d519d188e39a" gracePeriod=30 Mar 16 16:49:56 crc kubenswrapper[5120]: I0316 16:49:56.354981 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-86d6cb7f98-5w9h4" podUID="5b516ced-8076-4f11-8398-77eaca65d050" containerName="barbican-keystone-listener" containerID="cri-o://a752e45aa7e4b33fe1182320f27ff0f06c8dfce5d35bce8af70125146f2883a7" gracePeriod=30 Mar 16 16:49:56 crc kubenswrapper[5120]: I0316 16:49:56.442161 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:49:56 crc kubenswrapper[5120]: I0316 16:49:56.446125 5120 scope.go:117] "RemoveContainer" containerID="357e8754e619bde82ee9a20e2bb6e7f080cf0e315df9fb1354335a7aa606bd9f" Mar 16 16:49:56 crc kubenswrapper[5120]: E0316 16:49:56.452593 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="5767c79fc6bfdc88326d2909a4045fd0fa6001cd3d1249601d70195496f04121" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:49:56 crc kubenswrapper[5120]: E0316 16:49:56.462591 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="5767c79fc6bfdc88326d2909a4045fd0fa6001cd3d1249601d70195496f04121" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:49:56 crc kubenswrapper[5120]: E0316 16:49:56.471950 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="5767c79fc6bfdc88326d2909a4045fd0fa6001cd3d1249601d70195496f04121" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:49:56 crc kubenswrapper[5120]: E0316 16:49:56.472030 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="81b72eda-5dae-44c1-a720-9ca9e22cb100" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 16:49:56 crc kubenswrapper[5120]: I0316 16:49:56.686446 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d6038d72-b1a2-4d71-b831-d5fa1de027a7" path="/var/lib/kubelet/pods/d6038d72-b1a2-4d71-b831-d5fa1de027a7/volumes" Mar 16 16:49:56 crc kubenswrapper[5120]: I0316 16:49:56.687934 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-678df6fbdb-lfhdz"] Mar 16 16:49:56 crc kubenswrapper[5120]: I0316 16:49:56.708111 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-678df6fbdb-lfhdz"] Mar 16 16:49:57 crc kubenswrapper[5120]: E0316 16:49:57.228924 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="583f5e8456c375c564641fbbd1cf323930ba07fd7dcce921278f431729b9f67f" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:49:57 crc kubenswrapper[5120]: E0316 16:49:57.230853 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="583f5e8456c375c564641fbbd1cf323930ba07fd7dcce921278f431729b9f67f" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:49:57 crc kubenswrapper[5120]: E0316 16:49:57.237576 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="583f5e8456c375c564641fbbd1cf323930ba07fd7dcce921278f431729b9f67f" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:49:57 crc kubenswrapper[5120]: E0316 16:49:57.237613 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="2961edb8-5975-4d74-800e-732bed5d9791" containerName="nova-scheduler-scheduler" probeResult="unknown" Mar 16 16:49:57 crc kubenswrapper[5120]: I0316 16:49:57.339114 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"e2cf7c36-f4c0-4831-8b31-480469e7da93","Type":"ContainerStarted","Data":"ca317b94d7c8d23ce9d78526961632ffc30a0d05d48213eb9d48e10e7fea1d29"} Mar 16 16:49:57 crc kubenswrapper[5120]: I0316 16:49:57.343202 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"e5b6bb5a-fb93-4761-b995-1842090c7047","Type":"ContainerStarted","Data":"2b9935a76c689d891dbd70e6b7ca971448436faf6f4d14142924c0f37d07fac9"} Mar 16 16:49:57 crc kubenswrapper[5120]: I0316 16:49:57.347719 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-9f898f5b6-g9g57" event={"ID":"cdf5b2c0-4a53-4c60-a566-d18398c0c560","Type":"ContainerStarted","Data":"365b620ab0a5f5b67686132db3d88ec20960fac4cc2e2d4565362ace99ba2a1d"} Mar 16 16:49:57 crc kubenswrapper[5120]: I0316 16:49:57.347843 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/neutron-9f898f5b6-g9g57" Mar 16 16:49:57 crc kubenswrapper[5120]: I0316 16:49:57.349570 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-745d8c69c6-mxmrn_6e401532-2076-4686-b3cd-59b0629d8a98/neutron-httpd/0.log" Mar 16 16:49:57 crc kubenswrapper[5120]: I0316 16:49:57.350297 5120 generic.go:358] "Generic (PLEG): container finished" podID="6e401532-2076-4686-b3cd-59b0629d8a98" containerID="b94c9dace8d978b9884fd9eb3c2d9b207fd644529e20169a1f3b58038c6eeed4" exitCode=1 Mar 16 16:49:57 crc kubenswrapper[5120]: I0316 16:49:57.350396 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-745d8c69c6-mxmrn" event={"ID":"6e401532-2076-4686-b3cd-59b0629d8a98","Type":"ContainerDied","Data":"b94c9dace8d978b9884fd9eb3c2d9b207fd644529e20169a1f3b58038c6eeed4"} Mar 16 16:49:57 crc kubenswrapper[5120]: I0316 16:49:57.356997 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"0fdb1c41-3340-4013-99ea-c36c3891ff92","Type":"ContainerStarted","Data":"e6bcb147e4f0b03e95a2e0f1151e9002f062da54d82588fa24bd8fa862af858b"} Mar 16 16:49:57 crc kubenswrapper[5120]: I0316 16:49:57.357074 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:49:57 crc kubenswrapper[5120]: I0316 16:49:57.365426 5120 generic.go:358] "Generic (PLEG): container finished" podID="5b516ced-8076-4f11-8398-77eaca65d050" containerID="130578ec08e3530ef1b82a4fd9b1a63bb6ef4eebe8c92ece6756d519d188e39a" exitCode=143 Mar 16 16:49:57 crc kubenswrapper[5120]: I0316 16:49:57.365603 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-86d6cb7f98-5w9h4" event={"ID":"5b516ced-8076-4f11-8398-77eaca65d050","Type":"ContainerDied","Data":"130578ec08e3530ef1b82a4fd9b1a63bb6ef4eebe8c92ece6756d519d188e39a"} Mar 16 16:49:57 crc kubenswrapper[5120]: I0316 16:49:57.374781 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-9f898f5b6-g9g57" podStartSLOduration=7.374748732 podStartE2EDuration="7.374748732s" podCreationTimestamp="2026-03-16 16:49:50 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:49:57.36954958 +0000 UTC m=+4699.523481237" watchObservedRunningTime="2026-03-16 16:49:57.374748732 +0000 UTC m=+4699.528680389" Mar 16 16:49:57 crc kubenswrapper[5120]: I0316 16:49:57.855303 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podStartSLOduration=4.855281035 podStartE2EDuration="4.855281035s" podCreationTimestamp="2026-03-16 16:49:53 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:49:57.401747243 +0000 UTC m=+4699.555678910" watchObservedRunningTime="2026-03-16 16:49:57.855281035 +0000 UTC m=+4700.009212692" Mar 16 16:49:57 crc kubenswrapper[5120]: I0316 16:49:57.858462 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-5698458656-mpwfb"] Mar 16 16:49:57 crc kubenswrapper[5120]: I0316 16:49:57.858741 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-5698458656-mpwfb" podUID="2743712c-9e9b-43d6-b07e-19ec95dc3be7" containerName="barbican-api-log" containerID="cri-o://56538ad3166ee4cefffaba3c1a02fabff7ffd18c7d2b948a51e56f92a279dbbd" gracePeriod=30 Mar 16 16:49:57 crc kubenswrapper[5120]: I0316 16:49:57.859369 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-5698458656-mpwfb" podUID="2743712c-9e9b-43d6-b07e-19ec95dc3be7" containerName="barbican-api" containerID="cri-o://5d8291c7f08ffb8f0d180d80e30096214390d3c784fcf321d76d6edbfdc27dcd" gracePeriod=30 Mar 16 16:49:57 crc kubenswrapper[5120]: I0316 16:49:57.910342 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-api-75647f6cb4-4jcdp"] Mar 16 16:49:57 crc kubenswrapper[5120]: I0316 16:49:57.919531 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="398bb1bd-f380-4374-b880-d7217d37e010" containerName="neutron-api" Mar 16 16:49:57 crc kubenswrapper[5120]: I0316 16:49:57.919575 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="398bb1bd-f380-4374-b880-d7217d37e010" containerName="neutron-api" Mar 16 16:49:57 crc kubenswrapper[5120]: I0316 16:49:57.919596 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="398bb1bd-f380-4374-b880-d7217d37e010" containerName="neutron-httpd" Mar 16 16:49:57 crc kubenswrapper[5120]: I0316 16:49:57.919605 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="398bb1bd-f380-4374-b880-d7217d37e010" containerName="neutron-httpd" Mar 16 16:49:57 crc kubenswrapper[5120]: I0316 16:49:57.919818 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="398bb1bd-f380-4374-b880-d7217d37e010" containerName="neutron-httpd" Mar 16 16:49:57 crc kubenswrapper[5120]: I0316 16:49:57.919847 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="398bb1bd-f380-4374-b880-d7217d37e010" containerName="neutron-api" Mar 16 16:49:57 crc kubenswrapper[5120]: I0316 16:49:57.941576 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-75647f6cb4-4jcdp" Mar 16 16:49:57 crc kubenswrapper[5120]: I0316 16:49:57.944838 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-75647f6cb4-4jcdp"] Mar 16 16:49:57 crc kubenswrapper[5120]: I0316 16:49:57.954366 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-barbican-public-svc\"" Mar 16 16:49:57 crc kubenswrapper[5120]: I0316 16:49:57.954417 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-barbican-internal-svc\"" Mar 16 16:49:57 crc kubenswrapper[5120]: I0316 16:49:57.974697 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0e2f5941-c2dd-490a-a6f8-5fc6f7af568e-combined-ca-bundle\") pod \"barbican-api-75647f6cb4-4jcdp\" (UID: \"0e2f5941-c2dd-490a-a6f8-5fc6f7af568e\") " pod="openstack-kuttl-tests/barbican-api-75647f6cb4-4jcdp" Mar 16 16:49:57 crc kubenswrapper[5120]: I0316 16:49:57.974885 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/0e2f5941-c2dd-490a-a6f8-5fc6f7af568e-config-data-custom\") pod \"barbican-api-75647f6cb4-4jcdp\" (UID: \"0e2f5941-c2dd-490a-a6f8-5fc6f7af568e\") " pod="openstack-kuttl-tests/barbican-api-75647f6cb4-4jcdp" Mar 16 16:49:57 crc kubenswrapper[5120]: I0316 16:49:57.974933 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/0e2f5941-c2dd-490a-a6f8-5fc6f7af568e-internal-tls-certs\") pod \"barbican-api-75647f6cb4-4jcdp\" (UID: \"0e2f5941-c2dd-490a-a6f8-5fc6f7af568e\") " pod="openstack-kuttl-tests/barbican-api-75647f6cb4-4jcdp" Mar 16 16:49:57 crc kubenswrapper[5120]: I0316 16:49:57.975058 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/0e2f5941-c2dd-490a-a6f8-5fc6f7af568e-public-tls-certs\") pod \"barbican-api-75647f6cb4-4jcdp\" (UID: \"0e2f5941-c2dd-490a-a6f8-5fc6f7af568e\") " pod="openstack-kuttl-tests/barbican-api-75647f6cb4-4jcdp" Mar 16 16:49:57 crc kubenswrapper[5120]: I0316 16:49:57.975114 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0e2f5941-c2dd-490a-a6f8-5fc6f7af568e-logs\") pod \"barbican-api-75647f6cb4-4jcdp\" (UID: \"0e2f5941-c2dd-490a-a6f8-5fc6f7af568e\") " pod="openstack-kuttl-tests/barbican-api-75647f6cb4-4jcdp" Mar 16 16:49:57 crc kubenswrapper[5120]: I0316 16:49:57.975195 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wj4g\" (UniqueName: \"kubernetes.io/projected/0e2f5941-c2dd-490a-a6f8-5fc6f7af568e-kube-api-access-6wj4g\") pod \"barbican-api-75647f6cb4-4jcdp\" (UID: \"0e2f5941-c2dd-490a-a6f8-5fc6f7af568e\") " pod="openstack-kuttl-tests/barbican-api-75647f6cb4-4jcdp" Mar 16 16:49:57 crc kubenswrapper[5120]: I0316 16:49:57.975259 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0e2f5941-c2dd-490a-a6f8-5fc6f7af568e-config-data\") pod \"barbican-api-75647f6cb4-4jcdp\" (UID: \"0e2f5941-c2dd-490a-a6f8-5fc6f7af568e\") " pod="openstack-kuttl-tests/barbican-api-75647f6cb4-4jcdp" Mar 16 16:49:58 crc kubenswrapper[5120]: I0316 16:49:58.078141 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0e2f5941-c2dd-490a-a6f8-5fc6f7af568e-combined-ca-bundle\") pod \"barbican-api-75647f6cb4-4jcdp\" (UID: \"0e2f5941-c2dd-490a-a6f8-5fc6f7af568e\") " pod="openstack-kuttl-tests/barbican-api-75647f6cb4-4jcdp" Mar 16 16:49:58 crc kubenswrapper[5120]: I0316 16:49:58.078220 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/0e2f5941-c2dd-490a-a6f8-5fc6f7af568e-config-data-custom\") pod \"barbican-api-75647f6cb4-4jcdp\" (UID: \"0e2f5941-c2dd-490a-a6f8-5fc6f7af568e\") " pod="openstack-kuttl-tests/barbican-api-75647f6cb4-4jcdp" Mar 16 16:49:58 crc kubenswrapper[5120]: I0316 16:49:58.078244 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/0e2f5941-c2dd-490a-a6f8-5fc6f7af568e-internal-tls-certs\") pod \"barbican-api-75647f6cb4-4jcdp\" (UID: \"0e2f5941-c2dd-490a-a6f8-5fc6f7af568e\") " pod="openstack-kuttl-tests/barbican-api-75647f6cb4-4jcdp" Mar 16 16:49:58 crc kubenswrapper[5120]: I0316 16:49:58.079031 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/0e2f5941-c2dd-490a-a6f8-5fc6f7af568e-public-tls-certs\") pod \"barbican-api-75647f6cb4-4jcdp\" (UID: \"0e2f5941-c2dd-490a-a6f8-5fc6f7af568e\") " pod="openstack-kuttl-tests/barbican-api-75647f6cb4-4jcdp" Mar 16 16:49:58 crc kubenswrapper[5120]: I0316 16:49:58.079078 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0e2f5941-c2dd-490a-a6f8-5fc6f7af568e-logs\") pod \"barbican-api-75647f6cb4-4jcdp\" (UID: \"0e2f5941-c2dd-490a-a6f8-5fc6f7af568e\") " pod="openstack-kuttl-tests/barbican-api-75647f6cb4-4jcdp" Mar 16 16:49:58 crc kubenswrapper[5120]: I0316 16:49:58.079153 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6wj4g\" (UniqueName: \"kubernetes.io/projected/0e2f5941-c2dd-490a-a6f8-5fc6f7af568e-kube-api-access-6wj4g\") pod \"barbican-api-75647f6cb4-4jcdp\" (UID: \"0e2f5941-c2dd-490a-a6f8-5fc6f7af568e\") " pod="openstack-kuttl-tests/barbican-api-75647f6cb4-4jcdp" Mar 16 16:49:58 crc kubenswrapper[5120]: I0316 16:49:58.079189 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0e2f5941-c2dd-490a-a6f8-5fc6f7af568e-config-data\") pod \"barbican-api-75647f6cb4-4jcdp\" (UID: \"0e2f5941-c2dd-490a-a6f8-5fc6f7af568e\") " pod="openstack-kuttl-tests/barbican-api-75647f6cb4-4jcdp" Mar 16 16:49:58 crc kubenswrapper[5120]: I0316 16:49:58.081206 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0e2f5941-c2dd-490a-a6f8-5fc6f7af568e-logs\") pod \"barbican-api-75647f6cb4-4jcdp\" (UID: \"0e2f5941-c2dd-490a-a6f8-5fc6f7af568e\") " pod="openstack-kuttl-tests/barbican-api-75647f6cb4-4jcdp" Mar 16 16:49:58 crc kubenswrapper[5120]: I0316 16:49:58.086018 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/0e2f5941-c2dd-490a-a6f8-5fc6f7af568e-internal-tls-certs\") pod \"barbican-api-75647f6cb4-4jcdp\" (UID: \"0e2f5941-c2dd-490a-a6f8-5fc6f7af568e\") " pod="openstack-kuttl-tests/barbican-api-75647f6cb4-4jcdp" Mar 16 16:49:58 crc kubenswrapper[5120]: I0316 16:49:58.087549 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0e2f5941-c2dd-490a-a6f8-5fc6f7af568e-combined-ca-bundle\") pod \"barbican-api-75647f6cb4-4jcdp\" (UID: \"0e2f5941-c2dd-490a-a6f8-5fc6f7af568e\") " pod="openstack-kuttl-tests/barbican-api-75647f6cb4-4jcdp" Mar 16 16:49:58 crc kubenswrapper[5120]: I0316 16:49:58.088735 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/0e2f5941-c2dd-490a-a6f8-5fc6f7af568e-config-data-custom\") pod \"barbican-api-75647f6cb4-4jcdp\" (UID: \"0e2f5941-c2dd-490a-a6f8-5fc6f7af568e\") " pod="openstack-kuttl-tests/barbican-api-75647f6cb4-4jcdp" Mar 16 16:49:58 crc kubenswrapper[5120]: I0316 16:49:58.090817 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0e2f5941-c2dd-490a-a6f8-5fc6f7af568e-config-data\") pod \"barbican-api-75647f6cb4-4jcdp\" (UID: \"0e2f5941-c2dd-490a-a6f8-5fc6f7af568e\") " pod="openstack-kuttl-tests/barbican-api-75647f6cb4-4jcdp" Mar 16 16:49:58 crc kubenswrapper[5120]: I0316 16:49:58.094318 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/0e2f5941-c2dd-490a-a6f8-5fc6f7af568e-public-tls-certs\") pod \"barbican-api-75647f6cb4-4jcdp\" (UID: \"0e2f5941-c2dd-490a-a6f8-5fc6f7af568e\") " pod="openstack-kuttl-tests/barbican-api-75647f6cb4-4jcdp" Mar 16 16:49:58 crc kubenswrapper[5120]: I0316 16:49:58.102706 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wj4g\" (UniqueName: \"kubernetes.io/projected/0e2f5941-c2dd-490a-a6f8-5fc6f7af568e-kube-api-access-6wj4g\") pod \"barbican-api-75647f6cb4-4jcdp\" (UID: \"0e2f5941-c2dd-490a-a6f8-5fc6f7af568e\") " pod="openstack-kuttl-tests/barbican-api-75647f6cb4-4jcdp" Mar 16 16:49:58 crc kubenswrapper[5120]: I0316 16:49:58.307558 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-75647f6cb4-4jcdp" Mar 16 16:49:58 crc kubenswrapper[5120]: I0316 16:49:58.394186 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-5698458656-mpwfb" event={"ID":"2743712c-9e9b-43d6-b07e-19ec95dc3be7","Type":"ContainerDied","Data":"56538ad3166ee4cefffaba3c1a02fabff7ffd18c7d2b948a51e56f92a279dbbd"} Mar 16 16:49:58 crc kubenswrapper[5120]: I0316 16:49:58.394289 5120 generic.go:358] "Generic (PLEG): container finished" podID="2743712c-9e9b-43d6-b07e-19ec95dc3be7" containerID="56538ad3166ee4cefffaba3c1a02fabff7ffd18c7d2b948a51e56f92a279dbbd" exitCode=143 Mar 16 16:49:58 crc kubenswrapper[5120]: I0316 16:49:58.409922 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"e5b6bb5a-fb93-4761-b995-1842090c7047","Type":"ContainerStarted","Data":"9ce74e3e7c03671f217a90ecc54371da22afef7549bf1a2fab8103a986ef97ef"} Mar 16 16:49:58 crc kubenswrapper[5120]: I0316 16:49:58.685455 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="398bb1bd-f380-4374-b880-d7217d37e010" path="/var/lib/kubelet/pods/398bb1bd-f380-4374-b880-d7217d37e010/volumes" Mar 16 16:49:58 crc kubenswrapper[5120]: I0316 16:49:58.914630 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-75647f6cb4-4jcdp"] Mar 16 16:49:59 crc kubenswrapper[5120]: I0316 16:49:59.050120 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-5698458656-mpwfb" Mar 16 16:49:59 crc kubenswrapper[5120]: I0316 16:49:59.113764 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2743712c-9e9b-43d6-b07e-19ec95dc3be7-logs\") pod \"2743712c-9e9b-43d6-b07e-19ec95dc3be7\" (UID: \"2743712c-9e9b-43d6-b07e-19ec95dc3be7\") " Mar 16 16:49:59 crc kubenswrapper[5120]: I0316 16:49:59.114157 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6lklb\" (UniqueName: \"kubernetes.io/projected/2743712c-9e9b-43d6-b07e-19ec95dc3be7-kube-api-access-6lklb\") pod \"2743712c-9e9b-43d6-b07e-19ec95dc3be7\" (UID: \"2743712c-9e9b-43d6-b07e-19ec95dc3be7\") " Mar 16 16:49:59 crc kubenswrapper[5120]: I0316 16:49:59.114291 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2743712c-9e9b-43d6-b07e-19ec95dc3be7-config-data\") pod \"2743712c-9e9b-43d6-b07e-19ec95dc3be7\" (UID: \"2743712c-9e9b-43d6-b07e-19ec95dc3be7\") " Mar 16 16:49:59 crc kubenswrapper[5120]: I0316 16:49:59.114576 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/2743712c-9e9b-43d6-b07e-19ec95dc3be7-config-data-custom\") pod \"2743712c-9e9b-43d6-b07e-19ec95dc3be7\" (UID: \"2743712c-9e9b-43d6-b07e-19ec95dc3be7\") " Mar 16 16:49:59 crc kubenswrapper[5120]: I0316 16:49:59.114795 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2743712c-9e9b-43d6-b07e-19ec95dc3be7-combined-ca-bundle\") pod \"2743712c-9e9b-43d6-b07e-19ec95dc3be7\" (UID: \"2743712c-9e9b-43d6-b07e-19ec95dc3be7\") " Mar 16 16:49:59 crc kubenswrapper[5120]: I0316 16:49:59.115021 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2743712c-9e9b-43d6-b07e-19ec95dc3be7-logs" (OuterVolumeSpecName: "logs") pod "2743712c-9e9b-43d6-b07e-19ec95dc3be7" (UID: "2743712c-9e9b-43d6-b07e-19ec95dc3be7"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:49:59 crc kubenswrapper[5120]: I0316 16:49:59.115829 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2743712c-9e9b-43d6-b07e-19ec95dc3be7-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:59 crc kubenswrapper[5120]: I0316 16:49:59.127238 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2743712c-9e9b-43d6-b07e-19ec95dc3be7-kube-api-access-6lklb" (OuterVolumeSpecName: "kube-api-access-6lklb") pod "2743712c-9e9b-43d6-b07e-19ec95dc3be7" (UID: "2743712c-9e9b-43d6-b07e-19ec95dc3be7"). InnerVolumeSpecName "kube-api-access-6lklb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:49:59 crc kubenswrapper[5120]: I0316 16:49:59.127721 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2743712c-9e9b-43d6-b07e-19ec95dc3be7-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "2743712c-9e9b-43d6-b07e-19ec95dc3be7" (UID: "2743712c-9e9b-43d6-b07e-19ec95dc3be7"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:49:59 crc kubenswrapper[5120]: I0316 16:49:59.185953 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2743712c-9e9b-43d6-b07e-19ec95dc3be7-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "2743712c-9e9b-43d6-b07e-19ec95dc3be7" (UID: "2743712c-9e9b-43d6-b07e-19ec95dc3be7"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:49:59 crc kubenswrapper[5120]: I0316 16:49:59.186189 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2743712c-9e9b-43d6-b07e-19ec95dc3be7-config-data" (OuterVolumeSpecName: "config-data") pod "2743712c-9e9b-43d6-b07e-19ec95dc3be7" (UID: "2743712c-9e9b-43d6-b07e-19ec95dc3be7"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:49:59 crc kubenswrapper[5120]: I0316 16:49:59.218071 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/2743712c-9e9b-43d6-b07e-19ec95dc3be7-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:59 crc kubenswrapper[5120]: I0316 16:49:59.218375 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2743712c-9e9b-43d6-b07e-19ec95dc3be7-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:59 crc kubenswrapper[5120]: I0316 16:49:59.218455 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6lklb\" (UniqueName: \"kubernetes.io/projected/2743712c-9e9b-43d6-b07e-19ec95dc3be7-kube-api-access-6lklb\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:59 crc kubenswrapper[5120]: I0316 16:49:59.218554 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2743712c-9e9b-43d6-b07e-19ec95dc3be7-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:49:59 crc kubenswrapper[5120]: I0316 16:49:59.425028 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"e5b6bb5a-fb93-4761-b995-1842090c7047","Type":"ContainerStarted","Data":"253c53bba99c38e72727f99679b1008d2ae517e9eefdcfc28a8327f9fd2df9dd"} Mar 16 16:49:59 crc kubenswrapper[5120]: I0316 16:49:59.426961 5120 generic.go:358] "Generic (PLEG): container finished" podID="eab40383-182c-4760-80e0-652dc37d1e68" containerID="1d0ccd154a7c0690b5a9fdd694f4ee68fe8dec94bc1b4bbc45efa9cae8b6c9b8" exitCode=0 Mar 16 16:49:59 crc kubenswrapper[5120]: I0316 16:49:59.427046 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-g9ds4" event={"ID":"eab40383-182c-4760-80e0-652dc37d1e68","Type":"ContainerDied","Data":"1d0ccd154a7c0690b5a9fdd694f4ee68fe8dec94bc1b4bbc45efa9cae8b6c9b8"} Mar 16 16:49:59 crc kubenswrapper[5120]: I0316 16:49:59.431580 5120 generic.go:358] "Generic (PLEG): container finished" podID="2743712c-9e9b-43d6-b07e-19ec95dc3be7" containerID="5d8291c7f08ffb8f0d180d80e30096214390d3c784fcf321d76d6edbfdc27dcd" exitCode=0 Mar 16 16:49:59 crc kubenswrapper[5120]: I0316 16:49:59.431707 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-5698458656-mpwfb" event={"ID":"2743712c-9e9b-43d6-b07e-19ec95dc3be7","Type":"ContainerDied","Data":"5d8291c7f08ffb8f0d180d80e30096214390d3c784fcf321d76d6edbfdc27dcd"} Mar 16 16:49:59 crc kubenswrapper[5120]: I0316 16:49:59.431739 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-5698458656-mpwfb" event={"ID":"2743712c-9e9b-43d6-b07e-19ec95dc3be7","Type":"ContainerDied","Data":"bbcf69e754da0b5279f29d75d404adb090d28a7bd8e3800a992491b9371ccbec"} Mar 16 16:49:59 crc kubenswrapper[5120]: I0316 16:49:59.431775 5120 scope.go:117] "RemoveContainer" containerID="5d8291c7f08ffb8f0d180d80e30096214390d3c784fcf321d76d6edbfdc27dcd" Mar 16 16:49:59 crc kubenswrapper[5120]: I0316 16:49:59.431919 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-5698458656-mpwfb" Mar 16 16:49:59 crc kubenswrapper[5120]: I0316 16:49:59.443163 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-75647f6cb4-4jcdp" event={"ID":"0e2f5941-c2dd-490a-a6f8-5fc6f7af568e","Type":"ContainerStarted","Data":"dd7fe7ffe304ba89a5574b9d845f1b3cdb0da51bf7c22a04814b909af709fdba"} Mar 16 16:49:59 crc kubenswrapper[5120]: I0316 16:49:59.443215 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-75647f6cb4-4jcdp" event={"ID":"0e2f5941-c2dd-490a-a6f8-5fc6f7af568e","Type":"ContainerStarted","Data":"d008b96930826b3ad4855ce77924c0f44db1b58741ce3fab411ab371dca65c12"} Mar 16 16:49:59 crc kubenswrapper[5120]: I0316 16:49:59.462546 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-internal-api-0" podStartSLOduration=4.462526209 podStartE2EDuration="4.462526209s" podCreationTimestamp="2026-03-16 16:49:55 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:49:59.44684857 +0000 UTC m=+4701.600780247" watchObservedRunningTime="2026-03-16 16:49:59.462526209 +0000 UTC m=+4701.616457866" Mar 16 16:49:59 crc kubenswrapper[5120]: I0316 16:49:59.499518 5120 scope.go:117] "RemoveContainer" containerID="56538ad3166ee4cefffaba3c1a02fabff7ffd18c7d2b948a51e56f92a279dbbd" Mar 16 16:49:59 crc kubenswrapper[5120]: I0316 16:49:59.510206 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-5698458656-mpwfb"] Mar 16 16:49:59 crc kubenswrapper[5120]: I0316 16:49:59.534665 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-api-5698458656-mpwfb"] Mar 16 16:49:59 crc kubenswrapper[5120]: I0316 16:49:59.542219 5120 scope.go:117] "RemoveContainer" containerID="5d8291c7f08ffb8f0d180d80e30096214390d3c784fcf321d76d6edbfdc27dcd" Mar 16 16:49:59 crc kubenswrapper[5120]: E0316 16:49:59.542660 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d8291c7f08ffb8f0d180d80e30096214390d3c784fcf321d76d6edbfdc27dcd\": container with ID starting with 5d8291c7f08ffb8f0d180d80e30096214390d3c784fcf321d76d6edbfdc27dcd not found: ID does not exist" containerID="5d8291c7f08ffb8f0d180d80e30096214390d3c784fcf321d76d6edbfdc27dcd" Mar 16 16:49:59 crc kubenswrapper[5120]: I0316 16:49:59.542692 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d8291c7f08ffb8f0d180d80e30096214390d3c784fcf321d76d6edbfdc27dcd"} err="failed to get container status \"5d8291c7f08ffb8f0d180d80e30096214390d3c784fcf321d76d6edbfdc27dcd\": rpc error: code = NotFound desc = could not find container \"5d8291c7f08ffb8f0d180d80e30096214390d3c784fcf321d76d6edbfdc27dcd\": container with ID starting with 5d8291c7f08ffb8f0d180d80e30096214390d3c784fcf321d76d6edbfdc27dcd not found: ID does not exist" Mar 16 16:49:59 crc kubenswrapper[5120]: I0316 16:49:59.542713 5120 scope.go:117] "RemoveContainer" containerID="56538ad3166ee4cefffaba3c1a02fabff7ffd18c7d2b948a51e56f92a279dbbd" Mar 16 16:49:59 crc kubenswrapper[5120]: E0316 16:49:59.542908 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"56538ad3166ee4cefffaba3c1a02fabff7ffd18c7d2b948a51e56f92a279dbbd\": container with ID starting with 56538ad3166ee4cefffaba3c1a02fabff7ffd18c7d2b948a51e56f92a279dbbd not found: ID does not exist" containerID="56538ad3166ee4cefffaba3c1a02fabff7ffd18c7d2b948a51e56f92a279dbbd" Mar 16 16:49:59 crc kubenswrapper[5120]: I0316 16:49:59.542926 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56538ad3166ee4cefffaba3c1a02fabff7ffd18c7d2b948a51e56f92a279dbbd"} err="failed to get container status \"56538ad3166ee4cefffaba3c1a02fabff7ffd18c7d2b948a51e56f92a279dbbd\": rpc error: code = NotFound desc = could not find container \"56538ad3166ee4cefffaba3c1a02fabff7ffd18c7d2b948a51e56f92a279dbbd\": container with ID starting with 56538ad3166ee4cefffaba3c1a02fabff7ffd18c7d2b948a51e56f92a279dbbd not found: ID does not exist" Mar 16 16:50:00 crc kubenswrapper[5120]: I0316 16:50:00.178874 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-infra/auto-csr-approver-29561330-mwqvz"] Mar 16 16:50:00 crc kubenswrapper[5120]: I0316 16:50:00.189007 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2743712c-9e9b-43d6-b07e-19ec95dc3be7" containerName="barbican-api-log" Mar 16 16:50:00 crc kubenswrapper[5120]: I0316 16:50:00.190575 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="2743712c-9e9b-43d6-b07e-19ec95dc3be7" containerName="barbican-api-log" Mar 16 16:50:00 crc kubenswrapper[5120]: I0316 16:50:00.192449 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2743712c-9e9b-43d6-b07e-19ec95dc3be7" containerName="barbican-api" Mar 16 16:50:00 crc kubenswrapper[5120]: I0316 16:50:00.192471 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="2743712c-9e9b-43d6-b07e-19ec95dc3be7" containerName="barbican-api" Mar 16 16:50:00 crc kubenswrapper[5120]: I0316 16:50:00.193728 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="2743712c-9e9b-43d6-b07e-19ec95dc3be7" containerName="barbican-api-log" Mar 16 16:50:00 crc kubenswrapper[5120]: I0316 16:50:00.193798 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="2743712c-9e9b-43d6-b07e-19ec95dc3be7" containerName="barbican-api" Mar 16 16:50:00 crc kubenswrapper[5120]: I0316 16:50:00.213738 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561330-mwqvz"] Mar 16 16:50:00 crc kubenswrapper[5120]: I0316 16:50:00.214091 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561330-mwqvz" Mar 16 16:50:00 crc kubenswrapper[5120]: I0316 16:50:00.217809 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"kube-root-ca.crt\"" Mar 16 16:50:00 crc kubenswrapper[5120]: I0316 16:50:00.218023 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"openshift-service-ca.crt\"" Mar 16 16:50:00 crc kubenswrapper[5120]: I0316 16:50:00.218129 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-infra\"/\"csr-approver-sa-dockercfg-x2nsz\"" Mar 16 16:50:00 crc kubenswrapper[5120]: I0316 16:50:00.257474 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62drm\" (UniqueName: \"kubernetes.io/projected/207d2e98-cd6e-4019-9deb-240e09d44bb7-kube-api-access-62drm\") pod \"auto-csr-approver-29561330-mwqvz\" (UID: \"207d2e98-cd6e-4019-9deb-240e09d44bb7\") " pod="openshift-infra/auto-csr-approver-29561330-mwqvz" Mar 16 16:50:00 crc kubenswrapper[5120]: I0316 16:50:00.360320 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-62drm\" (UniqueName: \"kubernetes.io/projected/207d2e98-cd6e-4019-9deb-240e09d44bb7-kube-api-access-62drm\") pod \"auto-csr-approver-29561330-mwqvz\" (UID: \"207d2e98-cd6e-4019-9deb-240e09d44bb7\") " pod="openshift-infra/auto-csr-approver-29561330-mwqvz" Mar 16 16:50:00 crc kubenswrapper[5120]: I0316 16:50:00.386750 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-62drm\" (UniqueName: \"kubernetes.io/projected/207d2e98-cd6e-4019-9deb-240e09d44bb7-kube-api-access-62drm\") pod \"auto-csr-approver-29561330-mwqvz\" (UID: \"207d2e98-cd6e-4019-9deb-240e09d44bb7\") " pod="openshift-infra/auto-csr-approver-29561330-mwqvz" Mar 16 16:50:00 crc kubenswrapper[5120]: I0316 16:50:00.482860 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:50:00 crc kubenswrapper[5120]: I0316 16:50:00.483794 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"e2cf7c36-f4c0-4831-8b31-480469e7da93","Type":"ContainerStarted","Data":"11878faa82614ab3fac28926a06d729b441926acc8aeba8820f45579d0f53a0b"} Mar 16 16:50:00 crc kubenswrapper[5120]: I0316 16:50:00.483971 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="e2cf7c36-f4c0-4831-8b31-480469e7da93" containerName="ceilometer-central-agent" containerID="cri-o://09da8f68fb8f4fbba594b87f5fc69576b135d9f56519c0bf5a6aa0861a336c18" gracePeriod=30 Mar 16 16:50:00 crc kubenswrapper[5120]: I0316 16:50:00.484180 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:50:00 crc kubenswrapper[5120]: I0316 16:50:00.484227 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="e2cf7c36-f4c0-4831-8b31-480469e7da93" containerName="proxy-httpd" containerID="cri-o://11878faa82614ab3fac28926a06d729b441926acc8aeba8820f45579d0f53a0b" gracePeriod=30 Mar 16 16:50:00 crc kubenswrapper[5120]: I0316 16:50:00.484268 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="e2cf7c36-f4c0-4831-8b31-480469e7da93" containerName="sg-core" containerID="cri-o://ca317b94d7c8d23ce9d78526961632ffc30a0d05d48213eb9d48e10e7fea1d29" gracePeriod=30 Mar 16 16:50:00 crc kubenswrapper[5120]: I0316 16:50:00.484304 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="e2cf7c36-f4c0-4831-8b31-480469e7da93" containerName="ceilometer-notification-agent" containerID="cri-o://103a8032a6a4014e1df990d0cb46eb8ffe1a02da2ee5c3d25609463114e65f9b" gracePeriod=30 Mar 16 16:50:00 crc kubenswrapper[5120]: I0316 16:50:00.539163 5120 generic.go:358] "Generic (PLEG): container finished" podID="c3654d56-932f-4a2c-ae7d-c5aa896a3335" containerID="b4ea9da196622b7914ca097753c95ef95b0450f814aa7eb8b3ee9bde9a4bb236" exitCode=137 Mar 16 16:50:00 crc kubenswrapper[5120]: I0316 16:50:00.539949 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"c3654d56-932f-4a2c-ae7d-c5aa896a3335","Type":"ContainerDied","Data":"b4ea9da196622b7914ca097753c95ef95b0450f814aa7eb8b3ee9bde9a4bb236"} Mar 16 16:50:00 crc kubenswrapper[5120]: I0316 16:50:00.547700 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561330-mwqvz" Mar 16 16:50:00 crc kubenswrapper[5120]: I0316 16:50:00.556182 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.97915917 podStartE2EDuration="12.556162933s" podCreationTimestamp="2026-03-16 16:49:48 +0000 UTC" firstStartedPulling="2026-03-16 16:49:50.252378901 +0000 UTC m=+4692.406310558" lastFinishedPulling="2026-03-16 16:49:59.829382674 +0000 UTC m=+4701.983314321" observedRunningTime="2026-03-16 16:50:00.547601078 +0000 UTC m=+4702.701532735" watchObservedRunningTime="2026-03-16 16:50:00.556162933 +0000 UTC m=+4702.710094590" Mar 16 16:50:00 crc kubenswrapper[5120]: I0316 16:50:00.577874 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-75647f6cb4-4jcdp" event={"ID":"0e2f5941-c2dd-490a-a6f8-5fc6f7af568e","Type":"ContainerStarted","Data":"19cf3db62f08f61aa863610fbf6dc0bd5a259c611c8b79ce81173b436a47a9ba"} Mar 16 16:50:00 crc kubenswrapper[5120]: I0316 16:50:00.577917 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-75647f6cb4-4jcdp" Mar 16 16:50:00 crc kubenswrapper[5120]: I0316 16:50:00.577930 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-75647f6cb4-4jcdp" Mar 16 16:50:00 crc kubenswrapper[5120]: I0316 16:50:00.672837 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:50:00 crc kubenswrapper[5120]: I0316 16:50:00.697969 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2743712c-9e9b-43d6-b07e-19ec95dc3be7" path="/var/lib/kubelet/pods/2743712c-9e9b-43d6-b07e-19ec95dc3be7/volumes" Mar 16 16:50:00 crc kubenswrapper[5120]: I0316 16:50:00.717738 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-api-75647f6cb4-4jcdp" podStartSLOduration=3.717721076 podStartE2EDuration="3.717721076s" podCreationTimestamp="2026-03-16 16:49:57 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:50:00.618638277 +0000 UTC m=+4702.772569954" watchObservedRunningTime="2026-03-16 16:50:00.717721076 +0000 UTC m=+4702.871652723" Mar 16 16:50:00 crc kubenswrapper[5120]: I0316 16:50:00.773047 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/c3654d56-932f-4a2c-ae7d-c5aa896a3335-etc-swift\") pod \"c3654d56-932f-4a2c-ae7d-c5aa896a3335\" (UID: \"c3654d56-932f-4a2c-ae7d-c5aa896a3335\") " Mar 16 16:50:00 crc kubenswrapper[5120]: I0316 16:50:00.773439 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9pfq2\" (UniqueName: \"kubernetes.io/projected/c3654d56-932f-4a2c-ae7d-c5aa896a3335-kube-api-access-9pfq2\") pod \"c3654d56-932f-4a2c-ae7d-c5aa896a3335\" (UID: \"c3654d56-932f-4a2c-ae7d-c5aa896a3335\") " Mar 16 16:50:00 crc kubenswrapper[5120]: I0316 16:50:00.773524 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/c3654d56-932f-4a2c-ae7d-c5aa896a3335-cache\") pod \"c3654d56-932f-4a2c-ae7d-c5aa896a3335\" (UID: \"c3654d56-932f-4a2c-ae7d-c5aa896a3335\") " Mar 16 16:50:00 crc kubenswrapper[5120]: I0316 16:50:00.773695 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/c3654d56-932f-4a2c-ae7d-c5aa896a3335-lock\") pod \"c3654d56-932f-4a2c-ae7d-c5aa896a3335\" (UID: \"c3654d56-932f-4a2c-ae7d-c5aa896a3335\") " Mar 16 16:50:00 crc kubenswrapper[5120]: I0316 16:50:00.774235 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3654d56-932f-4a2c-ae7d-c5aa896a3335-lock" (OuterVolumeSpecName: "lock") pod "c3654d56-932f-4a2c-ae7d-c5aa896a3335" (UID: "c3654d56-932f-4a2c-ae7d-c5aa896a3335"). InnerVolumeSpecName "lock". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:50:00 crc kubenswrapper[5120]: I0316 16:50:00.774582 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3654d56-932f-4a2c-ae7d-c5aa896a3335-cache" (OuterVolumeSpecName: "cache") pod "c3654d56-932f-4a2c-ae7d-c5aa896a3335" (UID: "c3654d56-932f-4a2c-ae7d-c5aa896a3335"). InnerVolumeSpecName "cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:50:00 crc kubenswrapper[5120]: I0316 16:50:00.774697 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c3654d56-932f-4a2c-ae7d-c5aa896a3335-combined-ca-bundle\") pod \"c3654d56-932f-4a2c-ae7d-c5aa896a3335\" (UID: \"c3654d56-932f-4a2c-ae7d-c5aa896a3335\") " Mar 16 16:50:00 crc kubenswrapper[5120]: I0316 16:50:00.774992 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"swift\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"c3654d56-932f-4a2c-ae7d-c5aa896a3335\" (UID: \"c3654d56-932f-4a2c-ae7d-c5aa896a3335\") " Mar 16 16:50:00 crc kubenswrapper[5120]: I0316 16:50:00.775876 5120 reconciler_common.go:299] "Volume detached for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/c3654d56-932f-4a2c-ae7d-c5aa896a3335-cache\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:00 crc kubenswrapper[5120]: I0316 16:50:00.775901 5120 reconciler_common.go:299] "Volume detached for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/c3654d56-932f-4a2c-ae7d-c5aa896a3335-lock\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:00 crc kubenswrapper[5120]: I0316 16:50:00.779603 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage05-crc" (OuterVolumeSpecName: "swift") pod "c3654d56-932f-4a2c-ae7d-c5aa896a3335" (UID: "c3654d56-932f-4a2c-ae7d-c5aa896a3335"). InnerVolumeSpecName "local-storage05-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:50:00 crc kubenswrapper[5120]: I0316 16:50:00.780138 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3654d56-932f-4a2c-ae7d-c5aa896a3335-kube-api-access-9pfq2" (OuterVolumeSpecName: "kube-api-access-9pfq2") pod "c3654d56-932f-4a2c-ae7d-c5aa896a3335" (UID: "c3654d56-932f-4a2c-ae7d-c5aa896a3335"). InnerVolumeSpecName "kube-api-access-9pfq2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:50:00 crc kubenswrapper[5120]: I0316 16:50:00.780185 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3654d56-932f-4a2c-ae7d-c5aa896a3335-etc-swift" (OuterVolumeSpecName: "etc-swift") pod "c3654d56-932f-4a2c-ae7d-c5aa896a3335" (UID: "c3654d56-932f-4a2c-ae7d-c5aa896a3335"). InnerVolumeSpecName "etc-swift". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:50:00 crc kubenswrapper[5120]: I0316 16:50:00.827350 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:50:00 crc kubenswrapper[5120]: I0316 16:50:00.827450 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:50:00 crc kubenswrapper[5120]: I0316 16:50:00.878248 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") on node \"crc\" " Mar 16 16:50:00 crc kubenswrapper[5120]: I0316 16:50:00.878278 5120 reconciler_common.go:299] "Volume detached for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/c3654d56-932f-4a2c-ae7d-c5aa896a3335-etc-swift\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:00 crc kubenswrapper[5120]: I0316 16:50:00.878288 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9pfq2\" (UniqueName: \"kubernetes.io/projected/c3654d56-932f-4a2c-ae7d-c5aa896a3335-kube-api-access-9pfq2\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:00 crc kubenswrapper[5120]: I0316 16:50:00.899548 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage05-crc" (UniqueName: "kubernetes.io/local-volume/local-storage05-crc") on node "crc" Mar 16 16:50:00 crc kubenswrapper[5120]: I0316 16:50:00.980825 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:00 crc kubenswrapper[5120]: I0316 16:50:00.986468 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-g9ds4" Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.082193 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mmqfc\" (UniqueName: \"kubernetes.io/projected/eab40383-182c-4760-80e0-652dc37d1e68-kube-api-access-mmqfc\") pod \"eab40383-182c-4760-80e0-652dc37d1e68\" (UID: \"eab40383-182c-4760-80e0-652dc37d1e68\") " Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.082292 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/eab40383-182c-4760-80e0-652dc37d1e68-config-data\") pod \"eab40383-182c-4760-80e0-652dc37d1e68\" (UID: \"eab40383-182c-4760-80e0-652dc37d1e68\") " Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.082327 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/eab40383-182c-4760-80e0-652dc37d1e68-credential-keys\") pod \"eab40383-182c-4760-80e0-652dc37d1e68\" (UID: \"eab40383-182c-4760-80e0-652dc37d1e68\") " Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.082351 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/eab40383-182c-4760-80e0-652dc37d1e68-scripts\") pod \"eab40383-182c-4760-80e0-652dc37d1e68\" (UID: \"eab40383-182c-4760-80e0-652dc37d1e68\") " Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.082557 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/eab40383-182c-4760-80e0-652dc37d1e68-fernet-keys\") pod \"eab40383-182c-4760-80e0-652dc37d1e68\" (UID: \"eab40383-182c-4760-80e0-652dc37d1e68\") " Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.082585 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eab40383-182c-4760-80e0-652dc37d1e68-combined-ca-bundle\") pod \"eab40383-182c-4760-80e0-652dc37d1e68\" (UID: \"eab40383-182c-4760-80e0-652dc37d1e68\") " Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.085957 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eab40383-182c-4760-80e0-652dc37d1e68-scripts" (OuterVolumeSpecName: "scripts") pod "eab40383-182c-4760-80e0-652dc37d1e68" (UID: "eab40383-182c-4760-80e0-652dc37d1e68"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.086261 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eab40383-182c-4760-80e0-652dc37d1e68-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "eab40383-182c-4760-80e0-652dc37d1e68" (UID: "eab40383-182c-4760-80e0-652dc37d1e68"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.086629 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eab40383-182c-4760-80e0-652dc37d1e68-kube-api-access-mmqfc" (OuterVolumeSpecName: "kube-api-access-mmqfc") pod "eab40383-182c-4760-80e0-652dc37d1e68" (UID: "eab40383-182c-4760-80e0-652dc37d1e68"). InnerVolumeSpecName "kube-api-access-mmqfc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.087604 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eab40383-182c-4760-80e0-652dc37d1e68-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "eab40383-182c-4760-80e0-652dc37d1e68" (UID: "eab40383-182c-4760-80e0-652dc37d1e68"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.110888 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eab40383-182c-4760-80e0-652dc37d1e68-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "eab40383-182c-4760-80e0-652dc37d1e68" (UID: "eab40383-182c-4760-80e0-652dc37d1e68"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.111003 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eab40383-182c-4760-80e0-652dc37d1e68-config-data" (OuterVolumeSpecName: "config-data") pod "eab40383-182c-4760-80e0-652dc37d1e68" (UID: "eab40383-182c-4760-80e0-652dc37d1e68"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:50:01 crc kubenswrapper[5120]: W0316 16:50:01.164192 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod207d2e98_cd6e_4019_9deb_240e09d44bb7.slice/crio-00e424b909430ec701a623e6de0518a8a0d849e2337824d18dcdefda9b425479 WatchSource:0}: Error finding container 00e424b909430ec701a623e6de0518a8a0d849e2337824d18dcdefda9b425479: Status 404 returned error can't find the container with id 00e424b909430ec701a623e6de0518a8a0d849e2337824d18dcdefda9b425479 Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.166246 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561330-mwqvz"] Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.185590 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mmqfc\" (UniqueName: \"kubernetes.io/projected/eab40383-182c-4760-80e0-652dc37d1e68-kube-api-access-mmqfc\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.185627 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/eab40383-182c-4760-80e0-652dc37d1e68-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.185638 5120 reconciler_common.go:299] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/eab40383-182c-4760-80e0-652dc37d1e68-credential-keys\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.185646 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/eab40383-182c-4760-80e0-652dc37d1e68-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.185654 5120 reconciler_common.go:299] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/eab40383-182c-4760-80e0-652dc37d1e68-fernet-keys\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.185663 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eab40383-182c-4760-80e0-652dc37d1e68-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.239002 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c3654d56-932f-4a2c-ae7d-c5aa896a3335-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "c3654d56-932f-4a2c-ae7d-c5aa896a3335" (UID: "c3654d56-932f-4a2c-ae7d-c5aa896a3335"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.288700 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c3654d56-932f-4a2c-ae7d-c5aa896a3335-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:01 crc kubenswrapper[5120]: E0316 16:50:01.403421 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="5767c79fc6bfdc88326d2909a4045fd0fa6001cd3d1249601d70195496f04121" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:50:01 crc kubenswrapper[5120]: E0316 16:50:01.406408 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="5767c79fc6bfdc88326d2909a4045fd0fa6001cd3d1249601d70195496f04121" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:50:01 crc kubenswrapper[5120]: E0316 16:50:01.414320 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="5767c79fc6bfdc88326d2909a4045fd0fa6001cd3d1249601d70195496f04121" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:50:01 crc kubenswrapper[5120]: E0316 16:50:01.414414 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="81b72eda-5dae-44c1-a720-9ca9e22cb100" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.581166 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-dc86d464-4bdds"] Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.581563 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/keystone-dc86d464-4bdds" podUID="493b4ab5-5510-42b3-aec8-e25ba084e342" containerName="keystone-api" containerID="cri-o://2eda6f3d92981939fa924e831aa99864f6c3a94073648c4246a802247bac6b6f" gracePeriod=30 Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.586529 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/keystone-dc86d464-4bdds" podUID="493b4ab5-5510-42b3-aec8-e25ba084e342" containerName="keystone-api" probeResult="failure" output="Get \"http://10.217.1.221:5000/v3\": EOF" Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.588537 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openstack-kuttl-tests/keystone-dc86d464-4bdds" podUID="493b4ab5-5510-42b3-aec8-e25ba084e342" containerName="keystone-api" probeResult="failure" output="Get \"http://10.217.1.221:5000/v3\": EOF" Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.589910 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561330-mwqvz" event={"ID":"207d2e98-cd6e-4019-9deb-240e09d44bb7","Type":"ContainerStarted","Data":"00e424b909430ec701a623e6de0518a8a0d849e2337824d18dcdefda9b425479"} Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.612162 5120 generic.go:358] "Generic (PLEG): container finished" podID="e2cf7c36-f4c0-4831-8b31-480469e7da93" containerID="11878faa82614ab3fac28926a06d729b441926acc8aeba8820f45579d0f53a0b" exitCode=0 Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.612201 5120 generic.go:358] "Generic (PLEG): container finished" podID="e2cf7c36-f4c0-4831-8b31-480469e7da93" containerID="ca317b94d7c8d23ce9d78526961632ffc30a0d05d48213eb9d48e10e7fea1d29" exitCode=2 Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.612214 5120 generic.go:358] "Generic (PLEG): container finished" podID="e2cf7c36-f4c0-4831-8b31-480469e7da93" containerID="103a8032a6a4014e1df990d0cb46eb8ffe1a02da2ee5c3d25609463114e65f9b" exitCode=0 Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.612229 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"e2cf7c36-f4c0-4831-8b31-480469e7da93","Type":"ContainerDied","Data":"11878faa82614ab3fac28926a06d729b441926acc8aeba8820f45579d0f53a0b"} Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.612275 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"e2cf7c36-f4c0-4831-8b31-480469e7da93","Type":"ContainerDied","Data":"ca317b94d7c8d23ce9d78526961632ffc30a0d05d48213eb9d48e10e7fea1d29"} Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.612284 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"e2cf7c36-f4c0-4831-8b31-480469e7da93","Type":"ContainerDied","Data":"103a8032a6a4014e1df990d0cb46eb8ffe1a02da2ee5c3d25609463114e65f9b"} Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.617050 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-g9ds4" event={"ID":"eab40383-182c-4760-80e0-652dc37d1e68","Type":"ContainerDied","Data":"fae7f4e57b33054714c7f920d27902490deeb9517c1337a77f2ca664e38649ff"} Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.617097 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fae7f4e57b33054714c7f920d27902490deeb9517c1337a77f2ca664e38649ff" Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.617185 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-g9ds4" Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.633098 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-74597bb8cb-kbqx7"] Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.634188 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3654d56-932f-4a2c-ae7d-c5aa896a3335" containerName="swift-recon-cron" Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.634206 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3654d56-932f-4a2c-ae7d-c5aa896a3335" containerName="swift-recon-cron" Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.634223 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3654d56-932f-4a2c-ae7d-c5aa896a3335" containerName="object-expirer" Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.634229 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3654d56-932f-4a2c-ae7d-c5aa896a3335" containerName="object-expirer" Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.634242 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3654d56-932f-4a2c-ae7d-c5aa896a3335" containerName="object-auditor" Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.634248 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3654d56-932f-4a2c-ae7d-c5aa896a3335" containerName="object-auditor" Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.634257 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3654d56-932f-4a2c-ae7d-c5aa896a3335" containerName="account-reaper" Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.634264 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3654d56-932f-4a2c-ae7d-c5aa896a3335" containerName="account-reaper" Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.634277 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3654d56-932f-4a2c-ae7d-c5aa896a3335" containerName="object-replicator" Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.634282 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3654d56-932f-4a2c-ae7d-c5aa896a3335" containerName="object-replicator" Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.634293 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3654d56-932f-4a2c-ae7d-c5aa896a3335" containerName="container-updater" Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.634298 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3654d56-932f-4a2c-ae7d-c5aa896a3335" containerName="container-updater" Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.634308 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eab40383-182c-4760-80e0-652dc37d1e68" containerName="keystone-bootstrap" Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.634314 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="eab40383-182c-4760-80e0-652dc37d1e68" containerName="keystone-bootstrap" Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.634322 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3654d56-932f-4a2c-ae7d-c5aa896a3335" containerName="account-replicator" Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.634327 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3654d56-932f-4a2c-ae7d-c5aa896a3335" containerName="account-replicator" Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.634343 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3654d56-932f-4a2c-ae7d-c5aa896a3335" containerName="account-server" Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.634349 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3654d56-932f-4a2c-ae7d-c5aa896a3335" containerName="account-server" Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.634357 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3654d56-932f-4a2c-ae7d-c5aa896a3335" containerName="object-updater" Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.634362 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3654d56-932f-4a2c-ae7d-c5aa896a3335" containerName="object-updater" Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.634374 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3654d56-932f-4a2c-ae7d-c5aa896a3335" containerName="account-auditor" Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.634380 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3654d56-932f-4a2c-ae7d-c5aa896a3335" containerName="account-auditor" Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.634400 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3654d56-932f-4a2c-ae7d-c5aa896a3335" containerName="container-replicator" Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.634407 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3654d56-932f-4a2c-ae7d-c5aa896a3335" containerName="container-replicator" Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.634416 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3654d56-932f-4a2c-ae7d-c5aa896a3335" containerName="container-server" Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.634421 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3654d56-932f-4a2c-ae7d-c5aa896a3335" containerName="container-server" Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.634429 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3654d56-932f-4a2c-ae7d-c5aa896a3335" containerName="container-auditor" Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.634435 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3654d56-932f-4a2c-ae7d-c5aa896a3335" containerName="container-auditor" Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.634444 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3654d56-932f-4a2c-ae7d-c5aa896a3335" containerName="object-server" Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.634449 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3654d56-932f-4a2c-ae7d-c5aa896a3335" containerName="object-server" Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.634457 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3654d56-932f-4a2c-ae7d-c5aa896a3335" containerName="rsync" Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.634463 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3654d56-932f-4a2c-ae7d-c5aa896a3335" containerName="rsync" Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.634652 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c3654d56-932f-4a2c-ae7d-c5aa896a3335" containerName="account-replicator" Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.634668 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c3654d56-932f-4a2c-ae7d-c5aa896a3335" containerName="container-server" Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.634681 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c3654d56-932f-4a2c-ae7d-c5aa896a3335" containerName="object-auditor" Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.634692 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c3654d56-932f-4a2c-ae7d-c5aa896a3335" containerName="account-reaper" Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.634703 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c3654d56-932f-4a2c-ae7d-c5aa896a3335" containerName="swift-recon-cron" Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.634711 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c3654d56-932f-4a2c-ae7d-c5aa896a3335" containerName="object-expirer" Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.634720 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c3654d56-932f-4a2c-ae7d-c5aa896a3335" containerName="container-replicator" Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.634728 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c3654d56-932f-4a2c-ae7d-c5aa896a3335" containerName="container-updater" Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.634735 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c3654d56-932f-4a2c-ae7d-c5aa896a3335" containerName="account-auditor" Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.634741 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c3654d56-932f-4a2c-ae7d-c5aa896a3335" containerName="object-server" Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.634749 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c3654d56-932f-4a2c-ae7d-c5aa896a3335" containerName="object-updater" Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.634775 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="eab40383-182c-4760-80e0-652dc37d1e68" containerName="keystone-bootstrap" Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.634784 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c3654d56-932f-4a2c-ae7d-c5aa896a3335" containerName="container-auditor" Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.634795 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c3654d56-932f-4a2c-ae7d-c5aa896a3335" containerName="rsync" Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.634804 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c3654d56-932f-4a2c-ae7d-c5aa896a3335" containerName="object-replicator" Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.634814 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c3654d56-932f-4a2c-ae7d-c5aa896a3335" containerName="account-server" Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.662574 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"c3654d56-932f-4a2c-ae7d-c5aa896a3335","Type":"ContainerDied","Data":"2f5387837996a61ccd0f76a9a21b770c51ae72fd005a8ede0b79b657a746b128"} Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.662645 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-74597bb8cb-kbqx7"] Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.662787 5120 scope.go:117] "RemoveContainer" containerID="b4ea9da196622b7914ca097753c95ef95b0450f814aa7eb8b3ee9bde9a4bb236" Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.663083 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-74597bb8cb-kbqx7" Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.664378 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.667148 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-keystone-internal-svc\"" Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.667386 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-keystone-public-svc\"" Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.702561 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/c27e11d8-d691-4894-995b-b4855e61ab80-credential-keys\") pod \"keystone-74597bb8cb-kbqx7\" (UID: \"c27e11d8-d691-4894-995b-b4855e61ab80\") " pod="openstack-kuttl-tests/keystone-74597bb8cb-kbqx7" Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.703069 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/c27e11d8-d691-4894-995b-b4855e61ab80-internal-tls-certs\") pod \"keystone-74597bb8cb-kbqx7\" (UID: \"c27e11d8-d691-4894-995b-b4855e61ab80\") " pod="openstack-kuttl-tests/keystone-74597bb8cb-kbqx7" Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.703198 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/c27e11d8-d691-4894-995b-b4855e61ab80-fernet-keys\") pod \"keystone-74597bb8cb-kbqx7\" (UID: \"c27e11d8-d691-4894-995b-b4855e61ab80\") " pod="openstack-kuttl-tests/keystone-74597bb8cb-kbqx7" Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.703344 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c27e11d8-d691-4894-995b-b4855e61ab80-config-data\") pod \"keystone-74597bb8cb-kbqx7\" (UID: \"c27e11d8-d691-4894-995b-b4855e61ab80\") " pod="openstack-kuttl-tests/keystone-74597bb8cb-kbqx7" Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.703550 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7gcs\" (UniqueName: \"kubernetes.io/projected/c27e11d8-d691-4894-995b-b4855e61ab80-kube-api-access-s7gcs\") pod \"keystone-74597bb8cb-kbqx7\" (UID: \"c27e11d8-d691-4894-995b-b4855e61ab80\") " pod="openstack-kuttl-tests/keystone-74597bb8cb-kbqx7" Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.703613 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c27e11d8-d691-4894-995b-b4855e61ab80-combined-ca-bundle\") pod \"keystone-74597bb8cb-kbqx7\" (UID: \"c27e11d8-d691-4894-995b-b4855e61ab80\") " pod="openstack-kuttl-tests/keystone-74597bb8cb-kbqx7" Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.703653 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c27e11d8-d691-4894-995b-b4855e61ab80-scripts\") pod \"keystone-74597bb8cb-kbqx7\" (UID: \"c27e11d8-d691-4894-995b-b4855e61ab80\") " pod="openstack-kuttl-tests/keystone-74597bb8cb-kbqx7" Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.703672 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/c27e11d8-d691-4894-995b-b4855e61ab80-public-tls-certs\") pod \"keystone-74597bb8cb-kbqx7\" (UID: \"c27e11d8-d691-4894-995b-b4855e61ab80\") " pod="openstack-kuttl-tests/keystone-74597bb8cb-kbqx7" Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.722666 5120 scope.go:117] "RemoveContainer" containerID="840e8d5d339442d19ad82f931a88f23400d38e38958d9210156aba093a24fe32" Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.728946 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.760899 5120 scope.go:117] "RemoveContainer" containerID="bbfdb8cd78e965981b9507e7d59cc5686daa0ae97c6392812a75eafdabac1d0d" Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.762248 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.779098 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.805291 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c27e11d8-d691-4894-995b-b4855e61ab80-config-data\") pod \"keystone-74597bb8cb-kbqx7\" (UID: \"c27e11d8-d691-4894-995b-b4855e61ab80\") " pod="openstack-kuttl-tests/keystone-74597bb8cb-kbqx7" Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.805428 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s7gcs\" (UniqueName: \"kubernetes.io/projected/c27e11d8-d691-4894-995b-b4855e61ab80-kube-api-access-s7gcs\") pod \"keystone-74597bb8cb-kbqx7\" (UID: \"c27e11d8-d691-4894-995b-b4855e61ab80\") " pod="openstack-kuttl-tests/keystone-74597bb8cb-kbqx7" Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.805471 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c27e11d8-d691-4894-995b-b4855e61ab80-combined-ca-bundle\") pod \"keystone-74597bb8cb-kbqx7\" (UID: \"c27e11d8-d691-4894-995b-b4855e61ab80\") " pod="openstack-kuttl-tests/keystone-74597bb8cb-kbqx7" Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.805500 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c27e11d8-d691-4894-995b-b4855e61ab80-scripts\") pod \"keystone-74597bb8cb-kbqx7\" (UID: \"c27e11d8-d691-4894-995b-b4855e61ab80\") " pod="openstack-kuttl-tests/keystone-74597bb8cb-kbqx7" Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.805524 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/c27e11d8-d691-4894-995b-b4855e61ab80-public-tls-certs\") pod \"keystone-74597bb8cb-kbqx7\" (UID: \"c27e11d8-d691-4894-995b-b4855e61ab80\") " pod="openstack-kuttl-tests/keystone-74597bb8cb-kbqx7" Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.805666 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/c27e11d8-d691-4894-995b-b4855e61ab80-credential-keys\") pod \"keystone-74597bb8cb-kbqx7\" (UID: \"c27e11d8-d691-4894-995b-b4855e61ab80\") " pod="openstack-kuttl-tests/keystone-74597bb8cb-kbqx7" Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.805795 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/c27e11d8-d691-4894-995b-b4855e61ab80-internal-tls-certs\") pod \"keystone-74597bb8cb-kbqx7\" (UID: \"c27e11d8-d691-4894-995b-b4855e61ab80\") " pod="openstack-kuttl-tests/keystone-74597bb8cb-kbqx7" Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.805863 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/c27e11d8-d691-4894-995b-b4855e61ab80-fernet-keys\") pod \"keystone-74597bb8cb-kbqx7\" (UID: \"c27e11d8-d691-4894-995b-b4855e61ab80\") " pod="openstack-kuttl-tests/keystone-74597bb8cb-kbqx7" Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.811308 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c27e11d8-d691-4894-995b-b4855e61ab80-scripts\") pod \"keystone-74597bb8cb-kbqx7\" (UID: \"c27e11d8-d691-4894-995b-b4855e61ab80\") " pod="openstack-kuttl-tests/keystone-74597bb8cb-kbqx7" Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.813009 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.813227 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.815921 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/c27e11d8-d691-4894-995b-b4855e61ab80-internal-tls-certs\") pod \"keystone-74597bb8cb-kbqx7\" (UID: \"c27e11d8-d691-4894-995b-b4855e61ab80\") " pod="openstack-kuttl-tests/keystone-74597bb8cb-kbqx7" Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.817909 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"swift-storage-config-data\"" Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.821541 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/c27e11d8-d691-4894-995b-b4855e61ab80-credential-keys\") pod \"keystone-74597bb8cb-kbqx7\" (UID: \"c27e11d8-d691-4894-995b-b4855e61ab80\") " pod="openstack-kuttl-tests/keystone-74597bb8cb-kbqx7" Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.822142 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c27e11d8-d691-4894-995b-b4855e61ab80-config-data\") pod \"keystone-74597bb8cb-kbqx7\" (UID: \"c27e11d8-d691-4894-995b-b4855e61ab80\") " pod="openstack-kuttl-tests/keystone-74597bb8cb-kbqx7" Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.830457 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/c27e11d8-d691-4894-995b-b4855e61ab80-fernet-keys\") pod \"keystone-74597bb8cb-kbqx7\" (UID: \"c27e11d8-d691-4894-995b-b4855e61ab80\") " pod="openstack-kuttl-tests/keystone-74597bb8cb-kbqx7" Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.831043 5120 scope.go:117] "RemoveContainer" containerID="7ac9c4c926a37d322994f6cad0d9392748087406803d3c491f27f39850ff7533" Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.832187 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c27e11d8-d691-4894-995b-b4855e61ab80-combined-ca-bundle\") pod \"keystone-74597bb8cb-kbqx7\" (UID: \"c27e11d8-d691-4894-995b-b4855e61ab80\") " pod="openstack-kuttl-tests/keystone-74597bb8cb-kbqx7" Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.832401 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/c27e11d8-d691-4894-995b-b4855e61ab80-public-tls-certs\") pod \"keystone-74597bb8cb-kbqx7\" (UID: \"c27e11d8-d691-4894-995b-b4855e61ab80\") " pod="openstack-kuttl-tests/keystone-74597bb8cb-kbqx7" Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.835486 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7gcs\" (UniqueName: \"kubernetes.io/projected/c27e11d8-d691-4894-995b-b4855e61ab80-kube-api-access-s7gcs\") pod \"keystone-74597bb8cb-kbqx7\" (UID: \"c27e11d8-d691-4894-995b-b4855e61ab80\") " pod="openstack-kuttl-tests/keystone-74597bb8cb-kbqx7" Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.910127 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btzhb\" (UniqueName: \"kubernetes.io/projected/19792b24-d033-444c-85e4-6c61e15b3ef9-kube-api-access-btzhb\") pod \"swift-storage-0\" (UID: \"19792b24-d033-444c-85e4-6c61e15b3ef9\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.911812 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/19792b24-d033-444c-85e4-6c61e15b3ef9-cache\") pod \"swift-storage-0\" (UID: \"19792b24-d033-444c-85e4-6c61e15b3ef9\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.911992 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/19792b24-d033-444c-85e4-6c61e15b3ef9-etc-swift\") pod \"swift-storage-0\" (UID: \"19792b24-d033-444c-85e4-6c61e15b3ef9\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.912109 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/19792b24-d033-444c-85e4-6c61e15b3ef9-combined-ca-bundle\") pod \"swift-storage-0\" (UID: \"19792b24-d033-444c-85e4-6c61e15b3ef9\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.912330 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"swift-storage-0\" (UID: \"19792b24-d033-444c-85e4-6c61e15b3ef9\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.912535 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/19792b24-d033-444c-85e4-6c61e15b3ef9-lock\") pod \"swift-storage-0\" (UID: \"19792b24-d033-444c-85e4-6c61e15b3ef9\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.935573 5120 scope.go:117] "RemoveContainer" containerID="dd8a27afa3228552faad0faf477c17d3d1dbb200e35fbfca68c54c20c3200dfb" Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.966488 5120 scope.go:117] "RemoveContainer" containerID="69b2a39b40f82d61bff95e3155bd323f14189e904e82d1bf527e593f9184d026" Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.992532 5120 scope.go:117] "RemoveContainer" containerID="787835b144ba391e7ea878ac319488125e890928c0bbbe44d53383ad86f552c7" Mar 16 16:50:01 crc kubenswrapper[5120]: I0316 16:50:01.995728 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-74597bb8cb-kbqx7" Mar 16 16:50:02 crc kubenswrapper[5120]: I0316 16:50:02.015609 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"swift-storage-0\" (UID: \"19792b24-d033-444c-85e4-6c61e15b3ef9\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:50:02 crc kubenswrapper[5120]: I0316 16:50:02.015803 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/19792b24-d033-444c-85e4-6c61e15b3ef9-lock\") pod \"swift-storage-0\" (UID: \"19792b24-d033-444c-85e4-6c61e15b3ef9\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:50:02 crc kubenswrapper[5120]: I0316 16:50:02.015910 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-btzhb\" (UniqueName: \"kubernetes.io/projected/19792b24-d033-444c-85e4-6c61e15b3ef9-kube-api-access-btzhb\") pod \"swift-storage-0\" (UID: \"19792b24-d033-444c-85e4-6c61e15b3ef9\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:50:02 crc kubenswrapper[5120]: I0316 16:50:02.016058 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"swift-storage-0\" (UID: \"19792b24-d033-444c-85e4-6c61e15b3ef9\") device mount path \"/mnt/openstack/pv05\"" pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:50:02 crc kubenswrapper[5120]: I0316 16:50:02.016454 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/19792b24-d033-444c-85e4-6c61e15b3ef9-cache\") pod \"swift-storage-0\" (UID: \"19792b24-d033-444c-85e4-6c61e15b3ef9\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:50:02 crc kubenswrapper[5120]: I0316 16:50:02.016560 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/19792b24-d033-444c-85e4-6c61e15b3ef9-etc-swift\") pod \"swift-storage-0\" (UID: \"19792b24-d033-444c-85e4-6c61e15b3ef9\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:50:02 crc kubenswrapper[5120]: I0316 16:50:02.016618 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/19792b24-d033-444c-85e4-6c61e15b3ef9-combined-ca-bundle\") pod \"swift-storage-0\" (UID: \"19792b24-d033-444c-85e4-6c61e15b3ef9\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:50:02 crc kubenswrapper[5120]: I0316 16:50:02.016794 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/19792b24-d033-444c-85e4-6c61e15b3ef9-lock\") pod \"swift-storage-0\" (UID: \"19792b24-d033-444c-85e4-6c61e15b3ef9\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:50:02 crc kubenswrapper[5120]: I0316 16:50:02.017129 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/19792b24-d033-444c-85e4-6c61e15b3ef9-cache\") pod \"swift-storage-0\" (UID: \"19792b24-d033-444c-85e4-6c61e15b3ef9\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:50:02 crc kubenswrapper[5120]: I0316 16:50:02.024564 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/19792b24-d033-444c-85e4-6c61e15b3ef9-etc-swift\") pod \"swift-storage-0\" (UID: \"19792b24-d033-444c-85e4-6c61e15b3ef9\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:50:02 crc kubenswrapper[5120]: I0316 16:50:02.035161 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-btzhb\" (UniqueName: \"kubernetes.io/projected/19792b24-d033-444c-85e4-6c61e15b3ef9-kube-api-access-btzhb\") pod \"swift-storage-0\" (UID: \"19792b24-d033-444c-85e4-6c61e15b3ef9\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:50:02 crc kubenswrapper[5120]: I0316 16:50:02.041996 5120 scope.go:117] "RemoveContainer" containerID="93059601596c57dd4cb0821f6b812899443bad5a5184ea352f0349395bd32703" Mar 16 16:50:02 crc kubenswrapper[5120]: I0316 16:50:02.073280 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/19792b24-d033-444c-85e4-6c61e15b3ef9-combined-ca-bundle\") pod \"swift-storage-0\" (UID: \"19792b24-d033-444c-85e4-6c61e15b3ef9\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:50:02 crc kubenswrapper[5120]: I0316 16:50:02.075274 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"swift-storage-0\" (UID: \"19792b24-d033-444c-85e4-6c61e15b3ef9\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:50:02 crc kubenswrapper[5120]: I0316 16:50:02.103627 5120 scope.go:117] "RemoveContainer" containerID="200b8316513df356c73810c0a9920beb8581c557012243461773380bc64ba067" Mar 16 16:50:02 crc kubenswrapper[5120]: I0316 16:50:02.126994 5120 scope.go:117] "RemoveContainer" containerID="e1f833adb929804d26e1c407c05f87e3c0f32afbfc09f6a35b8e8f77cf17c662" Mar 16 16:50:02 crc kubenswrapper[5120]: I0316 16:50:02.152569 5120 scope.go:117] "RemoveContainer" containerID="493264b8a5de6551d9d5bfbb72f85a7cccffbde4a4ad31f5a93c687e619bd8f3" Mar 16 16:50:02 crc kubenswrapper[5120]: E0316 16:50:02.229572 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="583f5e8456c375c564641fbbd1cf323930ba07fd7dcce921278f431729b9f67f" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:50:02 crc kubenswrapper[5120]: I0316 16:50:02.232272 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:50:02 crc kubenswrapper[5120]: E0316 16:50:02.237861 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="583f5e8456c375c564641fbbd1cf323930ba07fd7dcce921278f431729b9f67f" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:50:02 crc kubenswrapper[5120]: E0316 16:50:02.251040 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="583f5e8456c375c564641fbbd1cf323930ba07fd7dcce921278f431729b9f67f" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:50:02 crc kubenswrapper[5120]: E0316 16:50:02.251116 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="2961edb8-5975-4d74-800e-732bed5d9791" containerName="nova-scheduler-scheduler" probeResult="unknown" Mar 16 16:50:02 crc kubenswrapper[5120]: I0316 16:50:02.251676 5120 scope.go:117] "RemoveContainer" containerID="a0580816327b0eb8461ef400bb4f56c4a674f2735ad70d7f9fccfeceb50b4ce0" Mar 16 16:50:02 crc kubenswrapper[5120]: I0316 16:50:02.356921 5120 scope.go:117] "RemoveContainer" containerID="0b105e090b93d50bd77aae540a71b896fad1b6b84d9968e0904aa102fa6be83c" Mar 16 16:50:02 crc kubenswrapper[5120]: I0316 16:50:02.603425 5120 scope.go:117] "RemoveContainer" containerID="ae08a40e5389e61f869b34a0c0c20a08d3c7ebdd649af11eaaeed4303c931780" Mar 16 16:50:02 crc kubenswrapper[5120]: I0316 16:50:02.610137 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-74597bb8cb-kbqx7"] Mar 16 16:50:02 crc kubenswrapper[5120]: I0316 16:50:02.645573 5120 scope.go:117] "RemoveContainer" containerID="c7597b14c46effc0b5e75329c58fef2db86348b4ca6946ae9f6477dc35893a0e" Mar 16 16:50:02 crc kubenswrapper[5120]: I0316 16:50:02.687831 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c3654d56-932f-4a2c-ae7d-c5aa896a3335" path="/var/lib/kubelet/pods/c3654d56-932f-4a2c-ae7d-c5aa896a3335/volumes" Mar 16 16:50:02 crc kubenswrapper[5120]: I0316 16:50:02.689912 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-74597bb8cb-kbqx7" event={"ID":"c27e11d8-d691-4894-995b-b4855e61ab80","Type":"ContainerStarted","Data":"322cd78bae04fbbedc6bc5edcab8f12010b854ad044b9317282ee8705689df19"} Mar 16 16:50:02 crc kubenswrapper[5120]: I0316 16:50:02.828491 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:50:02 crc kubenswrapper[5120]: I0316 16:50:02.829300 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:50:02 crc kubenswrapper[5120]: I0316 16:50:02.831852 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:50:02 crc kubenswrapper[5120]: I0316 16:50:02.939827 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 16:50:03 crc kubenswrapper[5120]: I0316 16:50:03.474000 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:50:03 crc kubenswrapper[5120]: I0316 16:50:03.731579 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561330-mwqvz" event={"ID":"207d2e98-cd6e-4019-9deb-240e09d44bb7","Type":"ContainerStarted","Data":"c46f9e15772d39f116270252a3295bca3e89cde74acfa2086206c3d0706abd66"} Mar 16 16:50:03 crc kubenswrapper[5120]: I0316 16:50:03.745671 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"19792b24-d033-444c-85e4-6c61e15b3ef9","Type":"ContainerStarted","Data":"5e5f592520f6ae20d5410c39304d3dbb7bd389193db5398803d4448db4514bde"} Mar 16 16:50:03 crc kubenswrapper[5120]: I0316 16:50:03.745715 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"19792b24-d033-444c-85e4-6c61e15b3ef9","Type":"ContainerStarted","Data":"33a337777a56380f0a0d97bc5d689d730f9a15c8b90423ac83df28cd5f72cdea"} Mar 16 16:50:03 crc kubenswrapper[5120]: I0316 16:50:03.745725 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"19792b24-d033-444c-85e4-6c61e15b3ef9","Type":"ContainerStarted","Data":"44da37f7e3871e1da11e7aa77a8ca0ef4ccc8d659c2f038b5f3f3317e5f01b9b"} Mar 16 16:50:03 crc kubenswrapper[5120]: I0316 16:50:03.755780 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-infra/auto-csr-approver-29561330-mwqvz" podStartSLOduration=2.244595266 podStartE2EDuration="3.755734283s" podCreationTimestamp="2026-03-16 16:50:00 +0000 UTC" firstStartedPulling="2026-03-16 16:50:01.168311068 +0000 UTC m=+4703.322242725" lastFinishedPulling="2026-03-16 16:50:02.679450085 +0000 UTC m=+4704.833381742" observedRunningTime="2026-03-16 16:50:03.747457866 +0000 UTC m=+4705.901389533" watchObservedRunningTime="2026-03-16 16:50:03.755734283 +0000 UTC m=+4705.909665950" Mar 16 16:50:03 crc kubenswrapper[5120]: I0316 16:50:03.756972 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-74597bb8cb-kbqx7" event={"ID":"c27e11d8-d691-4894-995b-b4855e61ab80","Type":"ContainerStarted","Data":"94a0984603d5bdc59410680ea92bf614dd65b62b0534a0dff6970ab8a0e20e27"} Mar 16 16:50:03 crc kubenswrapper[5120]: I0316 16:50:03.761010 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/keystone-74597bb8cb-kbqx7" Mar 16 16:50:03 crc kubenswrapper[5120]: I0316 16:50:03.764956 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:50:03 crc kubenswrapper[5120]: I0316 16:50:03.790389 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-74597bb8cb-kbqx7" podStartSLOduration=2.790365863 podStartE2EDuration="2.790365863s" podCreationTimestamp="2026-03-16 16:50:01 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:50:03.782337633 +0000 UTC m=+4705.936269300" watchObservedRunningTime="2026-03-16 16:50:03.790365863 +0000 UTC m=+4705.944297510" Mar 16 16:50:03 crc kubenswrapper[5120]: I0316 16:50:03.930649 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:50:04 crc kubenswrapper[5120]: I0316 16:50:04.490969 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-7766ff8bd9-h465l" Mar 16 16:50:04 crc kubenswrapper[5120]: I0316 16:50:04.602352 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9fjw2\" (UniqueName: \"kubernetes.io/projected/bcef263e-93a6-4f2b-9447-230cf3444ebb-kube-api-access-9fjw2\") pod \"bcef263e-93a6-4f2b-9447-230cf3444ebb\" (UID: \"bcef263e-93a6-4f2b-9447-230cf3444ebb\") " Mar 16 16:50:04 crc kubenswrapper[5120]: I0316 16:50:04.602622 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bcef263e-93a6-4f2b-9447-230cf3444ebb-config-data\") pod \"bcef263e-93a6-4f2b-9447-230cf3444ebb\" (UID: \"bcef263e-93a6-4f2b-9447-230cf3444ebb\") " Mar 16 16:50:04 crc kubenswrapper[5120]: I0316 16:50:04.602700 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/bcef263e-93a6-4f2b-9447-230cf3444ebb-config-data-custom\") pod \"bcef263e-93a6-4f2b-9447-230cf3444ebb\" (UID: \"bcef263e-93a6-4f2b-9447-230cf3444ebb\") " Mar 16 16:50:04 crc kubenswrapper[5120]: I0316 16:50:04.603246 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/bcef263e-93a6-4f2b-9447-230cf3444ebb-logs\") pod \"bcef263e-93a6-4f2b-9447-230cf3444ebb\" (UID: \"bcef263e-93a6-4f2b-9447-230cf3444ebb\") " Mar 16 16:50:04 crc kubenswrapper[5120]: I0316 16:50:04.603341 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bcef263e-93a6-4f2b-9447-230cf3444ebb-combined-ca-bundle\") pod \"bcef263e-93a6-4f2b-9447-230cf3444ebb\" (UID: \"bcef263e-93a6-4f2b-9447-230cf3444ebb\") " Mar 16 16:50:04 crc kubenswrapper[5120]: I0316 16:50:04.604019 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bcef263e-93a6-4f2b-9447-230cf3444ebb-logs" (OuterVolumeSpecName: "logs") pod "bcef263e-93a6-4f2b-9447-230cf3444ebb" (UID: "bcef263e-93a6-4f2b-9447-230cf3444ebb"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:50:04 crc kubenswrapper[5120]: I0316 16:50:04.604775 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/bcef263e-93a6-4f2b-9447-230cf3444ebb-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:04 crc kubenswrapper[5120]: I0316 16:50:04.609258 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bcef263e-93a6-4f2b-9447-230cf3444ebb-kube-api-access-9fjw2" (OuterVolumeSpecName: "kube-api-access-9fjw2") pod "bcef263e-93a6-4f2b-9447-230cf3444ebb" (UID: "bcef263e-93a6-4f2b-9447-230cf3444ebb"). InnerVolumeSpecName "kube-api-access-9fjw2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:50:04 crc kubenswrapper[5120]: I0316 16:50:04.613986 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bcef263e-93a6-4f2b-9447-230cf3444ebb-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "bcef263e-93a6-4f2b-9447-230cf3444ebb" (UID: "bcef263e-93a6-4f2b-9447-230cf3444ebb"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:50:04 crc kubenswrapper[5120]: I0316 16:50:04.634703 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bcef263e-93a6-4f2b-9447-230cf3444ebb-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "bcef263e-93a6-4f2b-9447-230cf3444ebb" (UID: "bcef263e-93a6-4f2b-9447-230cf3444ebb"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:50:04 crc kubenswrapper[5120]: I0316 16:50:04.671752 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bcef263e-93a6-4f2b-9447-230cf3444ebb-config-data" (OuterVolumeSpecName: "config-data") pod "bcef263e-93a6-4f2b-9447-230cf3444ebb" (UID: "bcef263e-93a6-4f2b-9447-230cf3444ebb"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:50:04 crc kubenswrapper[5120]: I0316 16:50:04.707918 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9fjw2\" (UniqueName: \"kubernetes.io/projected/bcef263e-93a6-4f2b-9447-230cf3444ebb-kube-api-access-9fjw2\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:04 crc kubenswrapper[5120]: I0316 16:50:04.707964 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bcef263e-93a6-4f2b-9447-230cf3444ebb-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:04 crc kubenswrapper[5120]: I0316 16:50:04.707977 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/bcef263e-93a6-4f2b-9447-230cf3444ebb-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:04 crc kubenswrapper[5120]: I0316 16:50:04.707991 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bcef263e-93a6-4f2b-9447-230cf3444ebb-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:04 crc kubenswrapper[5120]: I0316 16:50:04.776377 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"19792b24-d033-444c-85e4-6c61e15b3ef9","Type":"ContainerStarted","Data":"85bedc1e29ce36a378b928f6e74a20a0006ccd5ad43cd648a09420884822acca"} Mar 16 16:50:04 crc kubenswrapper[5120]: I0316 16:50:04.777579 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"19792b24-d033-444c-85e4-6c61e15b3ef9","Type":"ContainerStarted","Data":"b46421efcad9d5cfce98cb45e238d48b28afe72553a9d24bf1fc722eba0f8bf5"} Mar 16 16:50:04 crc kubenswrapper[5120]: I0316 16:50:04.777697 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"19792b24-d033-444c-85e4-6c61e15b3ef9","Type":"ContainerStarted","Data":"0a7fb2f116993d3fda220b555e207a0d8e8a050b2888a15593419d4b03e68e4b"} Mar 16 16:50:04 crc kubenswrapper[5120]: I0316 16:50:04.778216 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"19792b24-d033-444c-85e4-6c61e15b3ef9","Type":"ContainerStarted","Data":"9e58c6ff88801705f86e0adf1fbca075d147a3be9b63d9898ff8495fa9308987"} Mar 16 16:50:04 crc kubenswrapper[5120]: I0316 16:50:04.779303 5120 generic.go:358] "Generic (PLEG): container finished" podID="bcef263e-93a6-4f2b-9447-230cf3444ebb" containerID="67d7f767275baf4f8697f11b59c239c085138a655b3e68580095be420c283f25" exitCode=137 Mar 16 16:50:04 crc kubenswrapper[5120]: I0316 16:50:04.779786 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-7766ff8bd9-h465l" event={"ID":"bcef263e-93a6-4f2b-9447-230cf3444ebb","Type":"ContainerDied","Data":"67d7f767275baf4f8697f11b59c239c085138a655b3e68580095be420c283f25"} Mar 16 16:50:04 crc kubenswrapper[5120]: I0316 16:50:04.779827 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-7766ff8bd9-h465l" event={"ID":"bcef263e-93a6-4f2b-9447-230cf3444ebb","Type":"ContainerDied","Data":"3569126c14524346f11066283d244841a399726e44b4cf3ffea1461f9abd8f4d"} Mar 16 16:50:04 crc kubenswrapper[5120]: I0316 16:50:04.779871 5120 scope.go:117] "RemoveContainer" containerID="67d7f767275baf4f8697f11b59c239c085138a655b3e68580095be420c283f25" Mar 16 16:50:04 crc kubenswrapper[5120]: I0316 16:50:04.783550 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-7766ff8bd9-h465l" Mar 16 16:50:04 crc kubenswrapper[5120]: I0316 16:50:04.799070 5120 generic.go:358] "Generic (PLEG): container finished" podID="207d2e98-cd6e-4019-9deb-240e09d44bb7" containerID="c46f9e15772d39f116270252a3295bca3e89cde74acfa2086206c3d0706abd66" exitCode=0 Mar 16 16:50:04 crc kubenswrapper[5120]: I0316 16:50:04.799491 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561330-mwqvz" event={"ID":"207d2e98-cd6e-4019-9deb-240e09d44bb7","Type":"ContainerDied","Data":"c46f9e15772d39f116270252a3295bca3e89cde74acfa2086206c3d0706abd66"} Mar 16 16:50:04 crc kubenswrapper[5120]: I0316 16:50:04.849938 5120 scope.go:117] "RemoveContainer" containerID="fd8d08106194a056ec614acba84c7771bd985e90cbff88f7465efdc32db63dbb" Mar 16 16:50:04 crc kubenswrapper[5120]: I0316 16:50:04.880300 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-7766ff8bd9-h465l"] Mar 16 16:50:04 crc kubenswrapper[5120]: I0316 16:50:04.894448 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-worker-7766ff8bd9-h465l"] Mar 16 16:50:04 crc kubenswrapper[5120]: I0316 16:50:04.917166 5120 scope.go:117] "RemoveContainer" containerID="67d7f767275baf4f8697f11b59c239c085138a655b3e68580095be420c283f25" Mar 16 16:50:04 crc kubenswrapper[5120]: E0316 16:50:04.918051 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"67d7f767275baf4f8697f11b59c239c085138a655b3e68580095be420c283f25\": container with ID starting with 67d7f767275baf4f8697f11b59c239c085138a655b3e68580095be420c283f25 not found: ID does not exist" containerID="67d7f767275baf4f8697f11b59c239c085138a655b3e68580095be420c283f25" Mar 16 16:50:04 crc kubenswrapper[5120]: I0316 16:50:04.918188 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67d7f767275baf4f8697f11b59c239c085138a655b3e68580095be420c283f25"} err="failed to get container status \"67d7f767275baf4f8697f11b59c239c085138a655b3e68580095be420c283f25\": rpc error: code = NotFound desc = could not find container \"67d7f767275baf4f8697f11b59c239c085138a655b3e68580095be420c283f25\": container with ID starting with 67d7f767275baf4f8697f11b59c239c085138a655b3e68580095be420c283f25 not found: ID does not exist" Mar 16 16:50:04 crc kubenswrapper[5120]: I0316 16:50:04.918303 5120 scope.go:117] "RemoveContainer" containerID="fd8d08106194a056ec614acba84c7771bd985e90cbff88f7465efdc32db63dbb" Mar 16 16:50:04 crc kubenswrapper[5120]: E0316 16:50:04.919111 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fd8d08106194a056ec614acba84c7771bd985e90cbff88f7465efdc32db63dbb\": container with ID starting with fd8d08106194a056ec614acba84c7771bd985e90cbff88f7465efdc32db63dbb not found: ID does not exist" containerID="fd8d08106194a056ec614acba84c7771bd985e90cbff88f7465efdc32db63dbb" Mar 16 16:50:04 crc kubenswrapper[5120]: I0316 16:50:04.919157 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd8d08106194a056ec614acba84c7771bd985e90cbff88f7465efdc32db63dbb"} err="failed to get container status \"fd8d08106194a056ec614acba84c7771bd985e90cbff88f7465efdc32db63dbb\": rpc error: code = NotFound desc = could not find container \"fd8d08106194a056ec614acba84c7771bd985e90cbff88f7465efdc32db63dbb\": container with ID starting with fd8d08106194a056ec614acba84c7771bd985e90cbff88f7465efdc32db63dbb not found: ID does not exist" Mar 16 16:50:05 crc kubenswrapper[5120]: I0316 16:50:05.805045 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:50:05 crc kubenswrapper[5120]: I0316 16:50:05.805654 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:50:05 crc kubenswrapper[5120]: I0316 16:50:05.832418 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"19792b24-d033-444c-85e4-6c61e15b3ef9","Type":"ContainerStarted","Data":"16aa9a28ba8e4dfebe20955c9aebe595a6848afaa458a5d1ccfd1c56d8bb2aed"} Mar 16 16:50:05 crc kubenswrapper[5120]: I0316 16:50:05.832473 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"19792b24-d033-444c-85e4-6c61e15b3ef9","Type":"ContainerStarted","Data":"3be70b5ff49ff4f874dd20f28a1aaeef0ab75a3db9f4663ccf26dfa635bec36b"} Mar 16 16:50:05 crc kubenswrapper[5120]: I0316 16:50:05.832486 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"19792b24-d033-444c-85e4-6c61e15b3ef9","Type":"ContainerStarted","Data":"83ccc49abbdcaf8fb197ccdc51e709384e13c3e5791c4949a472ee766ad078a7"} Mar 16 16:50:05 crc kubenswrapper[5120]: I0316 16:50:05.835855 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-745d8c69c6-mxmrn_6e401532-2076-4686-b3cd-59b0629d8a98/neutron-httpd/0.log" Mar 16 16:50:05 crc kubenswrapper[5120]: I0316 16:50:05.836909 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-745d8c69c6-mxmrn_6e401532-2076-4686-b3cd-59b0629d8a98/neutron-api/0.log" Mar 16 16:50:05 crc kubenswrapper[5120]: I0316 16:50:05.837112 5120 generic.go:358] "Generic (PLEG): container finished" podID="6e401532-2076-4686-b3cd-59b0629d8a98" containerID="9571e0c79783deb3cda39e05db9a2c7ebbbdc091c2ffa216a55fd690c9879f18" exitCode=1 Mar 16 16:50:05 crc kubenswrapper[5120]: I0316 16:50:05.837362 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-745d8c69c6-mxmrn" event={"ID":"6e401532-2076-4686-b3cd-59b0629d8a98","Type":"ContainerDied","Data":"9571e0c79783deb3cda39e05db9a2c7ebbbdc091c2ffa216a55fd690c9879f18"} Mar 16 16:50:05 crc kubenswrapper[5120]: I0316 16:50:05.861741 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:50:05 crc kubenswrapper[5120]: I0316 16:50:05.866258 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:50:06 crc kubenswrapper[5120]: I0316 16:50:06.021286 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-745d8c69c6-mxmrn_6e401532-2076-4686-b3cd-59b0629d8a98/neutron-httpd/0.log" Mar 16 16:50:06 crc kubenswrapper[5120]: I0316 16:50:06.022407 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-745d8c69c6-mxmrn_6e401532-2076-4686-b3cd-59b0629d8a98/neutron-api/0.log" Mar 16 16:50:06 crc kubenswrapper[5120]: I0316 16:50:06.022520 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-745d8c69c6-mxmrn" Mar 16 16:50:06 crc kubenswrapper[5120]: I0316 16:50:06.172415 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6e401532-2076-4686-b3cd-59b0629d8a98-combined-ca-bundle\") pod \"6e401532-2076-4686-b3cd-59b0629d8a98\" (UID: \"6e401532-2076-4686-b3cd-59b0629d8a98\") " Mar 16 16:50:06 crc kubenswrapper[5120]: I0316 16:50:06.172641 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6e401532-2076-4686-b3cd-59b0629d8a98-config\") pod \"6e401532-2076-4686-b3cd-59b0629d8a98\" (UID: \"6e401532-2076-4686-b3cd-59b0629d8a98\") " Mar 16 16:50:06 crc kubenswrapper[5120]: I0316 16:50:06.172811 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mxqjk\" (UniqueName: \"kubernetes.io/projected/6e401532-2076-4686-b3cd-59b0629d8a98-kube-api-access-mxqjk\") pod \"6e401532-2076-4686-b3cd-59b0629d8a98\" (UID: \"6e401532-2076-4686-b3cd-59b0629d8a98\") " Mar 16 16:50:06 crc kubenswrapper[5120]: I0316 16:50:06.173040 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/6e401532-2076-4686-b3cd-59b0629d8a98-httpd-config\") pod \"6e401532-2076-4686-b3cd-59b0629d8a98\" (UID: \"6e401532-2076-4686-b3cd-59b0629d8a98\") " Mar 16 16:50:06 crc kubenswrapper[5120]: I0316 16:50:06.177029 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e401532-2076-4686-b3cd-59b0629d8a98-kube-api-access-mxqjk" (OuterVolumeSpecName: "kube-api-access-mxqjk") pod "6e401532-2076-4686-b3cd-59b0629d8a98" (UID: "6e401532-2076-4686-b3cd-59b0629d8a98"). InnerVolumeSpecName "kube-api-access-mxqjk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:50:06 crc kubenswrapper[5120]: I0316 16:50:06.177145 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e401532-2076-4686-b3cd-59b0629d8a98-httpd-config" (OuterVolumeSpecName: "httpd-config") pod "6e401532-2076-4686-b3cd-59b0629d8a98" (UID: "6e401532-2076-4686-b3cd-59b0629d8a98"). InnerVolumeSpecName "httpd-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:50:06 crc kubenswrapper[5120]: I0316 16:50:06.230902 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e401532-2076-4686-b3cd-59b0629d8a98-config" (OuterVolumeSpecName: "config") pod "6e401532-2076-4686-b3cd-59b0629d8a98" (UID: "6e401532-2076-4686-b3cd-59b0629d8a98"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:50:06 crc kubenswrapper[5120]: I0316 16:50:06.233245 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e401532-2076-4686-b3cd-59b0629d8a98-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "6e401532-2076-4686-b3cd-59b0629d8a98" (UID: "6e401532-2076-4686-b3cd-59b0629d8a98"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:50:06 crc kubenswrapper[5120]: I0316 16:50:06.277283 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6e401532-2076-4686-b3cd-59b0629d8a98-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:06 crc kubenswrapper[5120]: I0316 16:50:06.277335 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/6e401532-2076-4686-b3cd-59b0629d8a98-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:06 crc kubenswrapper[5120]: I0316 16:50:06.277350 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mxqjk\" (UniqueName: \"kubernetes.io/projected/6e401532-2076-4686-b3cd-59b0629d8a98-kube-api-access-mxqjk\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:06 crc kubenswrapper[5120]: I0316 16:50:06.277363 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/6e401532-2076-4686-b3cd-59b0629d8a98-httpd-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:06 crc kubenswrapper[5120]: I0316 16:50:06.330670 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561330-mwqvz" Mar 16 16:50:06 crc kubenswrapper[5120]: E0316 16:50:06.403605 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="5767c79fc6bfdc88326d2909a4045fd0fa6001cd3d1249601d70195496f04121" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:50:06 crc kubenswrapper[5120]: E0316 16:50:06.406366 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="5767c79fc6bfdc88326d2909a4045fd0fa6001cd3d1249601d70195496f04121" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:50:06 crc kubenswrapper[5120]: E0316 16:50:06.408112 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="5767c79fc6bfdc88326d2909a4045fd0fa6001cd3d1249601d70195496f04121" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:50:06 crc kubenswrapper[5120]: E0316 16:50:06.408157 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="81b72eda-5dae-44c1-a720-9ca9e22cb100" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 16:50:06 crc kubenswrapper[5120]: I0316 16:50:06.483671 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-62drm\" (UniqueName: \"kubernetes.io/projected/207d2e98-cd6e-4019-9deb-240e09d44bb7-kube-api-access-62drm\") pod \"207d2e98-cd6e-4019-9deb-240e09d44bb7\" (UID: \"207d2e98-cd6e-4019-9deb-240e09d44bb7\") " Mar 16 16:50:06 crc kubenswrapper[5120]: I0316 16:50:06.488670 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/207d2e98-cd6e-4019-9deb-240e09d44bb7-kube-api-access-62drm" (OuterVolumeSpecName: "kube-api-access-62drm") pod "207d2e98-cd6e-4019-9deb-240e09d44bb7" (UID: "207d2e98-cd6e-4019-9deb-240e09d44bb7"). InnerVolumeSpecName "kube-api-access-62drm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:50:06 crc kubenswrapper[5120]: I0316 16:50:06.588277 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-62drm\" (UniqueName: \"kubernetes.io/projected/207d2e98-cd6e-4019-9deb-240e09d44bb7-kube-api-access-62drm\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:06 crc kubenswrapper[5120]: I0316 16:50:06.680159 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bcef263e-93a6-4f2b-9447-230cf3444ebb" path="/var/lib/kubelet/pods/bcef263e-93a6-4f2b-9447-230cf3444ebb/volumes" Mar 16 16:50:06 crc kubenswrapper[5120]: I0316 16:50:06.877833 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-infra/auto-csr-approver-29561324-js8wp"] Mar 16 16:50:06 crc kubenswrapper[5120]: I0316 16:50:06.904451 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561330-mwqvz" Mar 16 16:50:06 crc kubenswrapper[5120]: I0316 16:50:06.904839 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561330-mwqvz" event={"ID":"207d2e98-cd6e-4019-9deb-240e09d44bb7","Type":"ContainerDied","Data":"00e424b909430ec701a623e6de0518a8a0d849e2337824d18dcdefda9b425479"} Mar 16 16:50:06 crc kubenswrapper[5120]: I0316 16:50:06.904886 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="00e424b909430ec701a623e6de0518a8a0d849e2337824d18dcdefda9b425479" Mar 16 16:50:06 crc kubenswrapper[5120]: I0316 16:50:06.914869 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-infra/auto-csr-approver-29561324-js8wp"] Mar 16 16:50:06 crc kubenswrapper[5120]: I0316 16:50:06.984498 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"19792b24-d033-444c-85e4-6c61e15b3ef9","Type":"ContainerStarted","Data":"a50f502dcf9ac9ec39a46fcdfb0987499d1691d3eab94d676808ebf31f0e2a68"} Mar 16 16:50:06 crc kubenswrapper[5120]: I0316 16:50:06.984557 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"19792b24-d033-444c-85e4-6c61e15b3ef9","Type":"ContainerStarted","Data":"411356d69e314d94388d3be8985c1067e90f4cda6e4f2ae2f79448189fdd7603"} Mar 16 16:50:06 crc kubenswrapper[5120]: I0316 16:50:06.984568 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"19792b24-d033-444c-85e4-6c61e15b3ef9","Type":"ContainerStarted","Data":"8cc66f619e52f2e843057161cb5972bf36695b3db04d91d03e4a9faa46d328b4"} Mar 16 16:50:06 crc kubenswrapper[5120]: I0316 16:50:06.984577 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"19792b24-d033-444c-85e4-6c61e15b3ef9","Type":"ContainerStarted","Data":"68f47c2138680932b56661bcd6125ef7eb13f546e55f20736f67e86ae78c7591"} Mar 16 16:50:06 crc kubenswrapper[5120]: I0316 16:50:06.999309 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-745d8c69c6-mxmrn_6e401532-2076-4686-b3cd-59b0629d8a98/neutron-httpd/0.log" Mar 16 16:50:07 crc kubenswrapper[5120]: I0316 16:50:07.002528 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-745d8c69c6-mxmrn_6e401532-2076-4686-b3cd-59b0629d8a98/neutron-api/0.log" Mar 16 16:50:07 crc kubenswrapper[5120]: I0316 16:50:07.003188 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-745d8c69c6-mxmrn" Mar 16 16:50:07 crc kubenswrapper[5120]: I0316 16:50:07.003864 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-745d8c69c6-mxmrn" event={"ID":"6e401532-2076-4686-b3cd-59b0629d8a98","Type":"ContainerDied","Data":"b05f807b39f0414ac1e4b9e596b33773aefa07d56964dc6a65a8c5a15189b010"} Mar 16 16:50:07 crc kubenswrapper[5120]: I0316 16:50:07.004070 5120 scope.go:117] "RemoveContainer" containerID="b94c9dace8d978b9884fd9eb3c2d9b207fd644529e20169a1f3b58038c6eeed4" Mar 16 16:50:07 crc kubenswrapper[5120]: I0316 16:50:07.010259 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:50:07 crc kubenswrapper[5120]: I0316 16:50:07.010678 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:50:07 crc kubenswrapper[5120]: I0316 16:50:07.091179 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-745d8c69c6-mxmrn"] Mar 16 16:50:07 crc kubenswrapper[5120]: I0316 16:50:07.120212 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-745d8c69c6-mxmrn"] Mar 16 16:50:07 crc kubenswrapper[5120]: I0316 16:50:07.150949 5120 scope.go:117] "RemoveContainer" containerID="9571e0c79783deb3cda39e05db9a2c7ebbbdc091c2ffa216a55fd690c9879f18" Mar 16 16:50:07 crc kubenswrapper[5120]: E0316 16:50:07.229216 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="583f5e8456c375c564641fbbd1cf323930ba07fd7dcce921278f431729b9f67f" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:50:07 crc kubenswrapper[5120]: E0316 16:50:07.236847 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="583f5e8456c375c564641fbbd1cf323930ba07fd7dcce921278f431729b9f67f" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:50:07 crc kubenswrapper[5120]: E0316 16:50:07.243474 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="583f5e8456c375c564641fbbd1cf323930ba07fd7dcce921278f431729b9f67f" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:50:07 crc kubenswrapper[5120]: E0316 16:50:07.243562 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="2961edb8-5975-4d74-800e-732bed5d9791" containerName="nova-scheduler-scheduler" probeResult="unknown" Mar 16 16:50:07 crc kubenswrapper[5120]: I0316 16:50:07.715293 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-dc86d464-4bdds" Mar 16 16:50:07 crc kubenswrapper[5120]: I0316 16:50:07.825438 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/493b4ab5-5510-42b3-aec8-e25ba084e342-combined-ca-bundle\") pod \"493b4ab5-5510-42b3-aec8-e25ba084e342\" (UID: \"493b4ab5-5510-42b3-aec8-e25ba084e342\") " Mar 16 16:50:07 crc kubenswrapper[5120]: I0316 16:50:07.825543 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fjfv7\" (UniqueName: \"kubernetes.io/projected/493b4ab5-5510-42b3-aec8-e25ba084e342-kube-api-access-fjfv7\") pod \"493b4ab5-5510-42b3-aec8-e25ba084e342\" (UID: \"493b4ab5-5510-42b3-aec8-e25ba084e342\") " Mar 16 16:50:07 crc kubenswrapper[5120]: I0316 16:50:07.825806 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/493b4ab5-5510-42b3-aec8-e25ba084e342-scripts\") pod \"493b4ab5-5510-42b3-aec8-e25ba084e342\" (UID: \"493b4ab5-5510-42b3-aec8-e25ba084e342\") " Mar 16 16:50:07 crc kubenswrapper[5120]: I0316 16:50:07.825851 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/493b4ab5-5510-42b3-aec8-e25ba084e342-config-data\") pod \"493b4ab5-5510-42b3-aec8-e25ba084e342\" (UID: \"493b4ab5-5510-42b3-aec8-e25ba084e342\") " Mar 16 16:50:07 crc kubenswrapper[5120]: I0316 16:50:07.825878 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/493b4ab5-5510-42b3-aec8-e25ba084e342-credential-keys\") pod \"493b4ab5-5510-42b3-aec8-e25ba084e342\" (UID: \"493b4ab5-5510-42b3-aec8-e25ba084e342\") " Mar 16 16:50:07 crc kubenswrapper[5120]: I0316 16:50:07.826049 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/493b4ab5-5510-42b3-aec8-e25ba084e342-fernet-keys\") pod \"493b4ab5-5510-42b3-aec8-e25ba084e342\" (UID: \"493b4ab5-5510-42b3-aec8-e25ba084e342\") " Mar 16 16:50:07 crc kubenswrapper[5120]: I0316 16:50:07.840248 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/493b4ab5-5510-42b3-aec8-e25ba084e342-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "493b4ab5-5510-42b3-aec8-e25ba084e342" (UID: "493b4ab5-5510-42b3-aec8-e25ba084e342"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:50:07 crc kubenswrapper[5120]: I0316 16:50:07.843033 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/493b4ab5-5510-42b3-aec8-e25ba084e342-kube-api-access-fjfv7" (OuterVolumeSpecName: "kube-api-access-fjfv7") pod "493b4ab5-5510-42b3-aec8-e25ba084e342" (UID: "493b4ab5-5510-42b3-aec8-e25ba084e342"). InnerVolumeSpecName "kube-api-access-fjfv7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:50:07 crc kubenswrapper[5120]: I0316 16:50:07.843903 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/493b4ab5-5510-42b3-aec8-e25ba084e342-scripts" (OuterVolumeSpecName: "scripts") pod "493b4ab5-5510-42b3-aec8-e25ba084e342" (UID: "493b4ab5-5510-42b3-aec8-e25ba084e342"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:50:07 crc kubenswrapper[5120]: I0316 16:50:07.848517 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/493b4ab5-5510-42b3-aec8-e25ba084e342-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "493b4ab5-5510-42b3-aec8-e25ba084e342" (UID: "493b4ab5-5510-42b3-aec8-e25ba084e342"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:50:07 crc kubenswrapper[5120]: I0316 16:50:07.876106 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/493b4ab5-5510-42b3-aec8-e25ba084e342-config-data" (OuterVolumeSpecName: "config-data") pod "493b4ab5-5510-42b3-aec8-e25ba084e342" (UID: "493b4ab5-5510-42b3-aec8-e25ba084e342"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:50:07 crc kubenswrapper[5120]: I0316 16:50:07.898064 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/493b4ab5-5510-42b3-aec8-e25ba084e342-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "493b4ab5-5510-42b3-aec8-e25ba084e342" (UID: "493b4ab5-5510-42b3-aec8-e25ba084e342"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:50:07 crc kubenswrapper[5120]: I0316 16:50:07.929085 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/493b4ab5-5510-42b3-aec8-e25ba084e342-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:07 crc kubenswrapper[5120]: I0316 16:50:07.929121 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fjfv7\" (UniqueName: \"kubernetes.io/projected/493b4ab5-5510-42b3-aec8-e25ba084e342-kube-api-access-fjfv7\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:07 crc kubenswrapper[5120]: I0316 16:50:07.929134 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/493b4ab5-5510-42b3-aec8-e25ba084e342-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:07 crc kubenswrapper[5120]: I0316 16:50:07.929144 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/493b4ab5-5510-42b3-aec8-e25ba084e342-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:07 crc kubenswrapper[5120]: I0316 16:50:07.929155 5120 reconciler_common.go:299] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/493b4ab5-5510-42b3-aec8-e25ba084e342-credential-keys\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:07 crc kubenswrapper[5120]: I0316 16:50:07.929164 5120 reconciler_common.go:299] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/493b4ab5-5510-42b3-aec8-e25ba084e342-fernet-keys\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:08 crc kubenswrapper[5120]: I0316 16:50:08.020427 5120 generic.go:358] "Generic (PLEG): container finished" podID="493b4ab5-5510-42b3-aec8-e25ba084e342" containerID="2eda6f3d92981939fa924e831aa99864f6c3a94073648c4246a802247bac6b6f" exitCode=0 Mar 16 16:50:08 crc kubenswrapper[5120]: I0316 16:50:08.020582 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-dc86d464-4bdds" Mar 16 16:50:08 crc kubenswrapper[5120]: I0316 16:50:08.020864 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-dc86d464-4bdds" event={"ID":"493b4ab5-5510-42b3-aec8-e25ba084e342","Type":"ContainerDied","Data":"2eda6f3d92981939fa924e831aa99864f6c3a94073648c4246a802247bac6b6f"} Mar 16 16:50:08 crc kubenswrapper[5120]: I0316 16:50:08.022012 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-dc86d464-4bdds" event={"ID":"493b4ab5-5510-42b3-aec8-e25ba084e342","Type":"ContainerDied","Data":"ba4d946584db14e7cc1c5b86c76d0497dfd52f3b28dd830c7c309dd1d412936a"} Mar 16 16:50:08 crc kubenswrapper[5120]: I0316 16:50:08.022060 5120 scope.go:117] "RemoveContainer" containerID="2eda6f3d92981939fa924e831aa99864f6c3a94073648c4246a802247bac6b6f" Mar 16 16:50:08 crc kubenswrapper[5120]: I0316 16:50:08.045515 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"19792b24-d033-444c-85e4-6c61e15b3ef9","Type":"ContainerStarted","Data":"f662ae8c35ca1f96dfff51a14c8bfa217d6d3c3615aefcfaf4fbaab8e0e3c8ff"} Mar 16 16:50:08 crc kubenswrapper[5120]: I0316 16:50:08.045563 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"19792b24-d033-444c-85e4-6c61e15b3ef9","Type":"ContainerStarted","Data":"d5ead9fcc8dbfab3297040cbfe1f71aefa0dbbb8a01a88712ffdf35d5d7ddb5a"} Mar 16 16:50:08 crc kubenswrapper[5120]: I0316 16:50:08.058012 5120 scope.go:117] "RemoveContainer" containerID="2eda6f3d92981939fa924e831aa99864f6c3a94073648c4246a802247bac6b6f" Mar 16 16:50:08 crc kubenswrapper[5120]: E0316 16:50:08.062877 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2eda6f3d92981939fa924e831aa99864f6c3a94073648c4246a802247bac6b6f\": container with ID starting with 2eda6f3d92981939fa924e831aa99864f6c3a94073648c4246a802247bac6b6f not found: ID does not exist" containerID="2eda6f3d92981939fa924e831aa99864f6c3a94073648c4246a802247bac6b6f" Mar 16 16:50:08 crc kubenswrapper[5120]: I0316 16:50:08.062943 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2eda6f3d92981939fa924e831aa99864f6c3a94073648c4246a802247bac6b6f"} err="failed to get container status \"2eda6f3d92981939fa924e831aa99864f6c3a94073648c4246a802247bac6b6f\": rpc error: code = NotFound desc = could not find container \"2eda6f3d92981939fa924e831aa99864f6c3a94073648c4246a802247bac6b6f\": container with ID starting with 2eda6f3d92981939fa924e831aa99864f6c3a94073648c4246a802247bac6b6f not found: ID does not exist" Mar 16 16:50:08 crc kubenswrapper[5120]: I0316 16:50:08.068282 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-dc86d464-4bdds"] Mar 16 16:50:08 crc kubenswrapper[5120]: I0316 16:50:08.079350 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-dc86d464-4bdds"] Mar 16 16:50:08 crc kubenswrapper[5120]: I0316 16:50:08.111541 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/swift-storage-0" podStartSLOduration=7.111517083 podStartE2EDuration="7.111517083s" podCreationTimestamp="2026-03-16 16:50:01 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:50:08.101352033 +0000 UTC m=+4710.255283710" watchObservedRunningTime="2026-03-16 16:50:08.111517083 +0000 UTC m=+4710.265448750" Mar 16 16:50:08 crc kubenswrapper[5120]: I0316 16:50:08.295154 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-65584897-gpm59"] Mar 16 16:50:08 crc kubenswrapper[5120]: I0316 16:50:08.324453 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e401532-2076-4686-b3cd-59b0629d8a98" containerName="neutron-httpd" Mar 16 16:50:08 crc kubenswrapper[5120]: I0316 16:50:08.324494 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e401532-2076-4686-b3cd-59b0629d8a98" containerName="neutron-httpd" Mar 16 16:50:08 crc kubenswrapper[5120]: I0316 16:50:08.324545 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bcef263e-93a6-4f2b-9447-230cf3444ebb" containerName="barbican-worker-log" Mar 16 16:50:08 crc kubenswrapper[5120]: I0316 16:50:08.324555 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="bcef263e-93a6-4f2b-9447-230cf3444ebb" containerName="barbican-worker-log" Mar 16 16:50:08 crc kubenswrapper[5120]: I0316 16:50:08.324638 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="493b4ab5-5510-42b3-aec8-e25ba084e342" containerName="keystone-api" Mar 16 16:50:08 crc kubenswrapper[5120]: I0316 16:50:08.324644 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="493b4ab5-5510-42b3-aec8-e25ba084e342" containerName="keystone-api" Mar 16 16:50:08 crc kubenswrapper[5120]: I0316 16:50:08.324685 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="207d2e98-cd6e-4019-9deb-240e09d44bb7" containerName="oc" Mar 16 16:50:08 crc kubenswrapper[5120]: I0316 16:50:08.324691 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="207d2e98-cd6e-4019-9deb-240e09d44bb7" containerName="oc" Mar 16 16:50:08 crc kubenswrapper[5120]: I0316 16:50:08.324713 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e401532-2076-4686-b3cd-59b0629d8a98" containerName="neutron-api" Mar 16 16:50:08 crc kubenswrapper[5120]: I0316 16:50:08.324719 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e401532-2076-4686-b3cd-59b0629d8a98" containerName="neutron-api" Mar 16 16:50:08 crc kubenswrapper[5120]: I0316 16:50:08.324785 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bcef263e-93a6-4f2b-9447-230cf3444ebb" containerName="barbican-worker" Mar 16 16:50:08 crc kubenswrapper[5120]: I0316 16:50:08.324793 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="bcef263e-93a6-4f2b-9447-230cf3444ebb" containerName="barbican-worker" Mar 16 16:50:08 crc kubenswrapper[5120]: I0316 16:50:08.325609 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="493b4ab5-5510-42b3-aec8-e25ba084e342" containerName="keystone-api" Mar 16 16:50:08 crc kubenswrapper[5120]: I0316 16:50:08.325640 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="6e401532-2076-4686-b3cd-59b0629d8a98" containerName="neutron-api" Mar 16 16:50:08 crc kubenswrapper[5120]: I0316 16:50:08.325669 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="bcef263e-93a6-4f2b-9447-230cf3444ebb" containerName="barbican-worker" Mar 16 16:50:08 crc kubenswrapper[5120]: I0316 16:50:08.325698 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="bcef263e-93a6-4f2b-9447-230cf3444ebb" containerName="barbican-worker-log" Mar 16 16:50:08 crc kubenswrapper[5120]: I0316 16:50:08.325716 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="207d2e98-cd6e-4019-9deb-240e09d44bb7" containerName="oc" Mar 16 16:50:08 crc kubenswrapper[5120]: I0316 16:50:08.325745 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="6e401532-2076-4686-b3cd-59b0629d8a98" containerName="neutron-httpd" Mar 16 16:50:08 crc kubenswrapper[5120]: I0316 16:50:08.380971 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-65584897-gpm59"] Mar 16 16:50:08 crc kubenswrapper[5120]: I0316 16:50:08.381107 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-65584897-gpm59" Mar 16 16:50:08 crc kubenswrapper[5120]: I0316 16:50:08.459625 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/6e679f0b-5939-456f-b116-1bf25a1029a7-dns-swift-storage-0\") pod \"dnsmasq-dnsmasq-65584897-gpm59\" (UID: \"6e679f0b-5939-456f-b116-1bf25a1029a7\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-65584897-gpm59" Mar 16 16:50:08 crc kubenswrapper[5120]: I0316 16:50:08.460291 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/6e679f0b-5939-456f-b116-1bf25a1029a7-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-65584897-gpm59\" (UID: \"6e679f0b-5939-456f-b116-1bf25a1029a7\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-65584897-gpm59" Mar 16 16:50:08 crc kubenswrapper[5120]: I0316 16:50:08.460474 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jqk9\" (UniqueName: \"kubernetes.io/projected/6e679f0b-5939-456f-b116-1bf25a1029a7-kube-api-access-5jqk9\") pod \"dnsmasq-dnsmasq-65584897-gpm59\" (UID: \"6e679f0b-5939-456f-b116-1bf25a1029a7\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-65584897-gpm59" Mar 16 16:50:08 crc kubenswrapper[5120]: I0316 16:50:08.460869 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6e679f0b-5939-456f-b116-1bf25a1029a7-config\") pod \"dnsmasq-dnsmasq-65584897-gpm59\" (UID: \"6e679f0b-5939-456f-b116-1bf25a1029a7\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-65584897-gpm59" Mar 16 16:50:08 crc kubenswrapper[5120]: I0316 16:50:08.566045 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5jqk9\" (UniqueName: \"kubernetes.io/projected/6e679f0b-5939-456f-b116-1bf25a1029a7-kube-api-access-5jqk9\") pod \"dnsmasq-dnsmasq-65584897-gpm59\" (UID: \"6e679f0b-5939-456f-b116-1bf25a1029a7\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-65584897-gpm59" Mar 16 16:50:08 crc kubenswrapper[5120]: I0316 16:50:08.566669 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6e679f0b-5939-456f-b116-1bf25a1029a7-config\") pod \"dnsmasq-dnsmasq-65584897-gpm59\" (UID: \"6e679f0b-5939-456f-b116-1bf25a1029a7\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-65584897-gpm59" Mar 16 16:50:08 crc kubenswrapper[5120]: I0316 16:50:08.566907 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/6e679f0b-5939-456f-b116-1bf25a1029a7-dns-swift-storage-0\") pod \"dnsmasq-dnsmasq-65584897-gpm59\" (UID: \"6e679f0b-5939-456f-b116-1bf25a1029a7\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-65584897-gpm59" Mar 16 16:50:08 crc kubenswrapper[5120]: I0316 16:50:08.567258 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/6e679f0b-5939-456f-b116-1bf25a1029a7-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-65584897-gpm59\" (UID: \"6e679f0b-5939-456f-b116-1bf25a1029a7\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-65584897-gpm59" Mar 16 16:50:08 crc kubenswrapper[5120]: I0316 16:50:08.568264 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/6e679f0b-5939-456f-b116-1bf25a1029a7-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-65584897-gpm59\" (UID: \"6e679f0b-5939-456f-b116-1bf25a1029a7\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-65584897-gpm59" Mar 16 16:50:08 crc kubenswrapper[5120]: I0316 16:50:08.569428 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6e679f0b-5939-456f-b116-1bf25a1029a7-config\") pod \"dnsmasq-dnsmasq-65584897-gpm59\" (UID: \"6e679f0b-5939-456f-b116-1bf25a1029a7\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-65584897-gpm59" Mar 16 16:50:08 crc kubenswrapper[5120]: I0316 16:50:08.569742 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/6e679f0b-5939-456f-b116-1bf25a1029a7-dns-swift-storage-0\") pod \"dnsmasq-dnsmasq-65584897-gpm59\" (UID: \"6e679f0b-5939-456f-b116-1bf25a1029a7\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-65584897-gpm59" Mar 16 16:50:08 crc kubenswrapper[5120]: I0316 16:50:08.593339 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jqk9\" (UniqueName: \"kubernetes.io/projected/6e679f0b-5939-456f-b116-1bf25a1029a7-kube-api-access-5jqk9\") pod \"dnsmasq-dnsmasq-65584897-gpm59\" (UID: \"6e679f0b-5939-456f-b116-1bf25a1029a7\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-65584897-gpm59" Mar 16 16:50:08 crc kubenswrapper[5120]: I0316 16:50:08.691326 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="493b4ab5-5510-42b3-aec8-e25ba084e342" path="/var/lib/kubelet/pods/493b4ab5-5510-42b3-aec8-e25ba084e342/volumes" Mar 16 16:50:08 crc kubenswrapper[5120]: I0316 16:50:08.693461 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6e401532-2076-4686-b3cd-59b0629d8a98" path="/var/lib/kubelet/pods/6e401532-2076-4686-b3cd-59b0629d8a98/volumes" Mar 16 16:50:08 crc kubenswrapper[5120]: I0316 16:50:08.705017 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b584daf0-61f5-4d60-9bbf-9e25b455058e" path="/var/lib/kubelet/pods/b584daf0-61f5-4d60-9bbf-9e25b455058e/volumes" Mar 16 16:50:08 crc kubenswrapper[5120]: I0316 16:50:08.711172 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-65584897-gpm59" Mar 16 16:50:08 crc kubenswrapper[5120]: I0316 16:50:08.756168 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-75647f6cb4-4jcdp" Mar 16 16:50:08 crc kubenswrapper[5120]: I0316 16:50:08.781706 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-75647f6cb4-4jcdp" Mar 16 16:50:08 crc kubenswrapper[5120]: I0316 16:50:08.878719 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-f5b8b4576-z8chc"] Mar 16 16:50:08 crc kubenswrapper[5120]: I0316 16:50:08.879024 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-f5b8b4576-z8chc" podUID="ac5817ce-1c59-4375-9fb6-f2fcd39bdba2" containerName="barbican-api-log" containerID="cri-o://b193bd33b7db08ee7085bbb3617c49c02aeec692a9a9f0a2afacd9c0b2a844f7" gracePeriod=30 Mar 16 16:50:08 crc kubenswrapper[5120]: I0316 16:50:08.879087 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-f5b8b4576-z8chc" podUID="ac5817ce-1c59-4375-9fb6-f2fcd39bdba2" containerName="barbican-api" containerID="cri-o://e1f008207b4e65c35dbbb1a2b363b53644df41f9b03a1b7ee6b4a6e099ab0cdb" gracePeriod=30 Mar 16 16:50:08 crc kubenswrapper[5120]: I0316 16:50:08.890179 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openstack-kuttl-tests/barbican-api-f5b8b4576-z8chc" podUID="ac5817ce-1c59-4375-9fb6-f2fcd39bdba2" containerName="barbican-api" probeResult="failure" output="Get \"http://10.217.1.217:9311/healthcheck\": EOF" Mar 16 16:50:09 crc kubenswrapper[5120]: I0316 16:50:09.094037 5120 generic.go:358] "Generic (PLEG): container finished" podID="ac5817ce-1c59-4375-9fb6-f2fcd39bdba2" containerID="b193bd33b7db08ee7085bbb3617c49c02aeec692a9a9f0a2afacd9c0b2a844f7" exitCode=143 Mar 16 16:50:09 crc kubenswrapper[5120]: I0316 16:50:09.094780 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-f5b8b4576-z8chc" event={"ID":"ac5817ce-1c59-4375-9fb6-f2fcd39bdba2","Type":"ContainerDied","Data":"b193bd33b7db08ee7085bbb3617c49c02aeec692a9a9f0a2afacd9c0b2a844f7"} Mar 16 16:50:09 crc kubenswrapper[5120]: I0316 16:50:09.116975 5120 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Mar 16 16:50:09 crc kubenswrapper[5120]: I0316 16:50:09.117014 5120 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Mar 16 16:50:09 crc kubenswrapper[5120]: I0316 16:50:09.322920 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-65584897-gpm59"] Mar 16 16:50:09 crc kubenswrapper[5120]: W0316 16:50:09.343991 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6e679f0b_5939_456f_b116_1bf25a1029a7.slice/crio-fea5fb52496b147906409567957a83553c916fe45aba57b1c764c1d5af2605d7 WatchSource:0}: Error finding container fea5fb52496b147906409567957a83553c916fe45aba57b1c764c1d5af2605d7: Status 404 returned error can't find the container with id fea5fb52496b147906409567957a83553c916fe45aba57b1c764c1d5af2605d7 Mar 16 16:50:09 crc kubenswrapper[5120]: I0316 16:50:09.505309 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:50:09 crc kubenswrapper[5120]: E0316 16:50:09.732198 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1989992 actualBytes=10240 Mar 16 16:50:09 crc kubenswrapper[5120]: I0316 16:50:09.743567 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:50:10 crc kubenswrapper[5120]: I0316 16:50:10.129181 5120 generic.go:358] "Generic (PLEG): container finished" podID="6e679f0b-5939-456f-b116-1bf25a1029a7" containerID="9fc43a83420f295444fdce9392001102544228806680c9836de43947fcb96b0e" exitCode=0 Mar 16 16:50:10 crc kubenswrapper[5120]: I0316 16:50:10.129245 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-65584897-gpm59" event={"ID":"6e679f0b-5939-456f-b116-1bf25a1029a7","Type":"ContainerDied","Data":"9fc43a83420f295444fdce9392001102544228806680c9836de43947fcb96b0e"} Mar 16 16:50:10 crc kubenswrapper[5120]: I0316 16:50:10.129622 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-65584897-gpm59" event={"ID":"6e679f0b-5939-456f-b116-1bf25a1029a7","Type":"ContainerStarted","Data":"fea5fb52496b147906409567957a83553c916fe45aba57b1c764c1d5af2605d7"} Mar 16 16:50:10 crc kubenswrapper[5120]: I0316 16:50:10.681598 5120 pod_container_manager_linux.go:217] "Failed to delete cgroup paths" cgroupName=["kubepods","besteffort","pod016dd61b-9c8d-4a62-a30f-5893f3aa41d7"] err="unable to destroy cgroup paths for cgroup [kubepods besteffort pod016dd61b-9c8d-4a62-a30f-5893f3aa41d7] : Timed out while waiting for systemd to remove kubepods-besteffort-pod016dd61b_9c8d_4a62_a30f_5893f3aa41d7.slice" Mar 16 16:50:10 crc kubenswrapper[5120]: E0316 16:50:10.681935 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to delete cgroup paths for [kubepods besteffort pod016dd61b-9c8d-4a62-a30f-5893f3aa41d7] : unable to destroy cgroup paths for cgroup [kubepods besteffort pod016dd61b-9c8d-4a62-a30f-5893f3aa41d7] : Timed out while waiting for systemd to remove kubepods-besteffort-pod016dd61b_9c8d_4a62_a30f_5893f3aa41d7.slice" pod="openstack-kuttl-tests/nova-api-0" podUID="016dd61b-9c8d-4a62-a30f-5893f3aa41d7" Mar 16 16:50:10 crc kubenswrapper[5120]: I0316 16:50:10.708102 5120 pod_container_manager_linux.go:217] "Failed to delete cgroup paths" cgroupName=["kubepods","besteffort","podb530ed0b-581b-40f8-b872-1f920e152d92"] err="unable to destroy cgroup paths for cgroup [kubepods besteffort podb530ed0b-581b-40f8-b872-1f920e152d92] : Timed out while waiting for systemd to remove kubepods-besteffort-podb530ed0b_581b_40f8_b872_1f920e152d92.slice" Mar 16 16:50:10 crc kubenswrapper[5120]: E0316 16:50:10.708418 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to delete cgroup paths for [kubepods besteffort podb530ed0b-581b-40f8-b872-1f920e152d92] : unable to destroy cgroup paths for cgroup [kubepods besteffort podb530ed0b-581b-40f8-b872-1f920e152d92] : Timed out while waiting for systemd to remove kubepods-besteffort-podb530ed0b_581b_40f8_b872_1f920e152d92.slice" pod="openstack-kuttl-tests/keystone-747966fd58-rqj7f" podUID="b530ed0b-581b-40f8-b872-1f920e152d92" Mar 16 16:50:10 crc kubenswrapper[5120]: I0316 16:50:10.736233 5120 pod_container_manager_linux.go:217] "Failed to delete cgroup paths" cgroupName=["kubepods","besteffort","pod016dd61b-9c8d-4a62-a30f-5893f3aa41d7"] err="unable to destroy cgroup paths for cgroup [kubepods besteffort pod016dd61b-9c8d-4a62-a30f-5893f3aa41d7] : Timed out while waiting for systemd to remove kubepods-besteffort-pod016dd61b_9c8d_4a62_a30f_5893f3aa41d7.slice" Mar 16 16:50:10 crc kubenswrapper[5120]: I0316 16:50:10.791949 5120 pod_container_manager_linux.go:217] "Failed to delete cgroup paths" cgroupName=["kubepods","besteffort","podb530ed0b-581b-40f8-b872-1f920e152d92"] err="unable to destroy cgroup paths for cgroup [kubepods besteffort podb530ed0b-581b-40f8-b872-1f920e152d92] : Timed out while waiting for systemd to remove kubepods-besteffort-podb530ed0b_581b_40f8_b872_1f920e152d92.slice" Mar 16 16:50:10 crc kubenswrapper[5120]: I0316 16:50:10.799549 5120 pod_container_manager_linux.go:217] "Failed to delete cgroup paths" cgroupName=["kubepods","besteffort","pod016dd61b-9c8d-4a62-a30f-5893f3aa41d7"] err="unable to destroy cgroup paths for cgroup [kubepods besteffort pod016dd61b-9c8d-4a62-a30f-5893f3aa41d7] : Timed out while waiting for systemd to remove kubepods-besteffort-pod016dd61b_9c8d_4a62_a30f_5893f3aa41d7.slice" Mar 16 16:50:10 crc kubenswrapper[5120]: I0316 16:50:10.803190 5120 pod_container_manager_linux.go:217] "Failed to delete cgroup paths" cgroupName=["kubepods","besteffort","podb9ac41f6-42c9-4d95-b38c-287da24a2adf"] err="unable to destroy cgroup paths for cgroup [kubepods besteffort podb9ac41f6-42c9-4d95-b38c-287da24a2adf] : Timed out while waiting for systemd to remove kubepods-besteffort-podb9ac41f6_42c9_4d95_b38c_287da24a2adf.slice" Mar 16 16:50:10 crc kubenswrapper[5120]: I0316 16:50:10.812498 5120 pod_container_manager_linux.go:217] "Failed to delete cgroup paths" cgroupName=["kubepods","besteffort","podb9ac41f6-42c9-4d95-b38c-287da24a2adf"] err="unable to destroy cgroup paths for cgroup [kubepods besteffort podb9ac41f6-42c9-4d95-b38c-287da24a2adf] : Timed out while waiting for systemd to remove kubepods-besteffort-podb9ac41f6_42c9_4d95_b38c_287da24a2adf.slice" Mar 16 16:50:10 crc kubenswrapper[5120]: E0316 16:50:10.812728 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to delete cgroup paths for [kubepods besteffort podb9ac41f6-42c9-4d95-b38c-287da24a2adf] : unable to destroy cgroup paths for cgroup [kubepods besteffort podb9ac41f6-42c9-4d95-b38c-287da24a2adf] : Timed out while waiting for systemd to remove kubepods-besteffort-podb9ac41f6_42c9_4d95_b38c_287da24a2adf.slice" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="b9ac41f6-42c9-4d95-b38c-287da24a2adf" Mar 16 16:50:11 crc kubenswrapper[5120]: I0316 16:50:11.140142 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:50:11 crc kubenswrapper[5120]: I0316 16:50:11.140142 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-65584897-gpm59" event={"ID":"6e679f0b-5939-456f-b116-1bf25a1029a7","Type":"ContainerStarted","Data":"3666df42cfd33ba5ccafbed3b2aa94ce1282a8aeb78f91a46955d0241367b401"} Mar 16 16:50:11 crc kubenswrapper[5120]: I0316 16:50:11.140148 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:50:11 crc kubenswrapper[5120]: I0316 16:50:11.141813 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-747966fd58-rqj7f" Mar 16 16:50:11 crc kubenswrapper[5120]: I0316 16:50:11.142421 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-65584897-gpm59" Mar 16 16:50:11 crc kubenswrapper[5120]: I0316 16:50:11.228036 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:50:11 crc kubenswrapper[5120]: I0316 16:50:11.246326 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:50:11 crc kubenswrapper[5120]: I0316 16:50:11.252352 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-65584897-gpm59" podStartSLOduration=3.25233662 podStartE2EDuration="3.25233662s" podCreationTimestamp="2026-03-16 16:50:08 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:50:11.218623655 +0000 UTC m=+4713.372555312" watchObservedRunningTime="2026-03-16 16:50:11.25233662 +0000 UTC m=+4713.406268277" Mar 16 16:50:11 crc kubenswrapper[5120]: I0316 16:50:11.281328 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:50:11 crc kubenswrapper[5120]: I0316 16:50:11.297977 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:50:11 crc kubenswrapper[5120]: I0316 16:50:11.302743 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-config-data\"" Mar 16 16:50:11 crc kubenswrapper[5120]: I0316 16:50:11.310905 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:50:11 crc kubenswrapper[5120]: I0316 16:50:11.346543 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-747966fd58-rqj7f"] Mar 16 16:50:11 crc kubenswrapper[5120]: I0316 16:50:11.358688 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-747966fd58-rqj7f"] Mar 16 16:50:11 crc kubenswrapper[5120]: I0316 16:50:11.389488 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:50:11 crc kubenswrapper[5120]: I0316 16:50:11.397879 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:50:11 crc kubenswrapper[5120]: E0316 16:50:11.402418 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="5767c79fc6bfdc88326d2909a4045fd0fa6001cd3d1249601d70195496f04121" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:50:11 crc kubenswrapper[5120]: E0316 16:50:11.404283 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="5767c79fc6bfdc88326d2909a4045fd0fa6001cd3d1249601d70195496f04121" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:50:11 crc kubenswrapper[5120]: E0316 16:50:11.405581 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="5767c79fc6bfdc88326d2909a4045fd0fa6001cd3d1249601d70195496f04121" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:50:11 crc kubenswrapper[5120]: E0316 16:50:11.405658 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="81b72eda-5dae-44c1-a720-9ca9e22cb100" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 16:50:11 crc kubenswrapper[5120]: I0316 16:50:11.411256 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:50:11 crc kubenswrapper[5120]: I0316 16:50:11.417050 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:50:11 crc kubenswrapper[5120]: I0316 16:50:11.422680 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-public-svc\"" Mar 16 16:50:11 crc kubenswrapper[5120]: I0316 16:50:11.423103 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-external-config-data\"" Mar 16 16:50:11 crc kubenswrapper[5120]: I0316 16:50:11.430362 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:50:11 crc kubenswrapper[5120]: I0316 16:50:11.463464 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c349c18b-ceb6-4eb9-8f6b-012f5d5e8654-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"c349c18b-ceb6-4eb9-8f6b-012f5d5e8654\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:50:11 crc kubenswrapper[5120]: I0316 16:50:11.463533 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c349c18b-ceb6-4eb9-8f6b-012f5d5e8654-logs\") pod \"nova-api-0\" (UID: \"c349c18b-ceb6-4eb9-8f6b-012f5d5e8654\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:50:11 crc kubenswrapper[5120]: I0316 16:50:11.463577 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c349c18b-ceb6-4eb9-8f6b-012f5d5e8654-config-data\") pod \"nova-api-0\" (UID: \"c349c18b-ceb6-4eb9-8f6b-012f5d5e8654\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:50:11 crc kubenswrapper[5120]: I0316 16:50:11.463678 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vs29\" (UniqueName: \"kubernetes.io/projected/c349c18b-ceb6-4eb9-8f6b-012f5d5e8654-kube-api-access-6vs29\") pod \"nova-api-0\" (UID: \"c349c18b-ceb6-4eb9-8f6b-012f5d5e8654\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:50:11 crc kubenswrapper[5120]: I0316 16:50:11.565546 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6a9b9d92-8d3c-4366-83fb-0ea460a622d9-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"6a9b9d92-8d3c-4366-83fb-0ea460a622d9\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:50:11 crc kubenswrapper[5120]: I0316 16:50:11.565861 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6vs29\" (UniqueName: \"kubernetes.io/projected/c349c18b-ceb6-4eb9-8f6b-012f5d5e8654-kube-api-access-6vs29\") pod \"nova-api-0\" (UID: \"c349c18b-ceb6-4eb9-8f6b-012f5d5e8654\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:50:11 crc kubenswrapper[5120]: I0316 16:50:11.565989 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6a9b9d92-8d3c-4366-83fb-0ea460a622d9-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"6a9b9d92-8d3c-4366-83fb-0ea460a622d9\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:50:11 crc kubenswrapper[5120]: I0316 16:50:11.566100 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdxqr\" (UniqueName: \"kubernetes.io/projected/6a9b9d92-8d3c-4366-83fb-0ea460a622d9-kube-api-access-gdxqr\") pod \"glance-default-external-api-0\" (UID: \"6a9b9d92-8d3c-4366-83fb-0ea460a622d9\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:50:11 crc kubenswrapper[5120]: I0316 16:50:11.566214 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/6a9b9d92-8d3c-4366-83fb-0ea460a622d9-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"6a9b9d92-8d3c-4366-83fb-0ea460a622d9\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:50:11 crc kubenswrapper[5120]: I0316 16:50:11.566412 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6a9b9d92-8d3c-4366-83fb-0ea460a622d9-scripts\") pod \"glance-default-external-api-0\" (UID: \"6a9b9d92-8d3c-4366-83fb-0ea460a622d9\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:50:11 crc kubenswrapper[5120]: I0316 16:50:11.566515 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"glance-default-external-api-0\" (UID: \"6a9b9d92-8d3c-4366-83fb-0ea460a622d9\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:50:11 crc kubenswrapper[5120]: I0316 16:50:11.566682 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6a9b9d92-8d3c-4366-83fb-0ea460a622d9-logs\") pod \"glance-default-external-api-0\" (UID: \"6a9b9d92-8d3c-4366-83fb-0ea460a622d9\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:50:11 crc kubenswrapper[5120]: I0316 16:50:11.566912 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c349c18b-ceb6-4eb9-8f6b-012f5d5e8654-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"c349c18b-ceb6-4eb9-8f6b-012f5d5e8654\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:50:11 crc kubenswrapper[5120]: I0316 16:50:11.567048 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c349c18b-ceb6-4eb9-8f6b-012f5d5e8654-logs\") pod \"nova-api-0\" (UID: \"c349c18b-ceb6-4eb9-8f6b-012f5d5e8654\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:50:11 crc kubenswrapper[5120]: I0316 16:50:11.567094 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c349c18b-ceb6-4eb9-8f6b-012f5d5e8654-config-data\") pod \"nova-api-0\" (UID: \"c349c18b-ceb6-4eb9-8f6b-012f5d5e8654\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:50:11 crc kubenswrapper[5120]: I0316 16:50:11.567118 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6a9b9d92-8d3c-4366-83fb-0ea460a622d9-config-data\") pod \"glance-default-external-api-0\" (UID: \"6a9b9d92-8d3c-4366-83fb-0ea460a622d9\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:50:11 crc kubenswrapper[5120]: I0316 16:50:11.567801 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c349c18b-ceb6-4eb9-8f6b-012f5d5e8654-logs\") pod \"nova-api-0\" (UID: \"c349c18b-ceb6-4eb9-8f6b-012f5d5e8654\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:50:11 crc kubenswrapper[5120]: I0316 16:50:11.573461 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c349c18b-ceb6-4eb9-8f6b-012f5d5e8654-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"c349c18b-ceb6-4eb9-8f6b-012f5d5e8654\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:50:11 crc kubenswrapper[5120]: I0316 16:50:11.574512 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c349c18b-ceb6-4eb9-8f6b-012f5d5e8654-config-data\") pod \"nova-api-0\" (UID: \"c349c18b-ceb6-4eb9-8f6b-012f5d5e8654\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:50:11 crc kubenswrapper[5120]: I0316 16:50:11.582826 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vs29\" (UniqueName: \"kubernetes.io/projected/c349c18b-ceb6-4eb9-8f6b-012f5d5e8654-kube-api-access-6vs29\") pod \"nova-api-0\" (UID: \"c349c18b-ceb6-4eb9-8f6b-012f5d5e8654\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:50:11 crc kubenswrapper[5120]: I0316 16:50:11.624257 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:50:11 crc kubenswrapper[5120]: I0316 16:50:11.671658 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6a9b9d92-8d3c-4366-83fb-0ea460a622d9-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"6a9b9d92-8d3c-4366-83fb-0ea460a622d9\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:50:11 crc kubenswrapper[5120]: I0316 16:50:11.672039 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gdxqr\" (UniqueName: \"kubernetes.io/projected/6a9b9d92-8d3c-4366-83fb-0ea460a622d9-kube-api-access-gdxqr\") pod \"glance-default-external-api-0\" (UID: \"6a9b9d92-8d3c-4366-83fb-0ea460a622d9\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:50:11 crc kubenswrapper[5120]: I0316 16:50:11.672092 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/6a9b9d92-8d3c-4366-83fb-0ea460a622d9-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"6a9b9d92-8d3c-4366-83fb-0ea460a622d9\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:50:11 crc kubenswrapper[5120]: I0316 16:50:11.672255 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6a9b9d92-8d3c-4366-83fb-0ea460a622d9-scripts\") pod \"glance-default-external-api-0\" (UID: \"6a9b9d92-8d3c-4366-83fb-0ea460a622d9\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:50:11 crc kubenswrapper[5120]: I0316 16:50:11.672290 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"glance-default-external-api-0\" (UID: \"6a9b9d92-8d3c-4366-83fb-0ea460a622d9\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:50:11 crc kubenswrapper[5120]: I0316 16:50:11.672405 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6a9b9d92-8d3c-4366-83fb-0ea460a622d9-logs\") pod \"glance-default-external-api-0\" (UID: \"6a9b9d92-8d3c-4366-83fb-0ea460a622d9\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:50:11 crc kubenswrapper[5120]: I0316 16:50:11.672551 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6a9b9d92-8d3c-4366-83fb-0ea460a622d9-config-data\") pod \"glance-default-external-api-0\" (UID: \"6a9b9d92-8d3c-4366-83fb-0ea460a622d9\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:50:11 crc kubenswrapper[5120]: I0316 16:50:11.672718 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6a9b9d92-8d3c-4366-83fb-0ea460a622d9-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"6a9b9d92-8d3c-4366-83fb-0ea460a622d9\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:50:11 crc kubenswrapper[5120]: I0316 16:50:11.675329 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"glance-default-external-api-0\" (UID: \"6a9b9d92-8d3c-4366-83fb-0ea460a622d9\") device mount path \"/mnt/openstack/pv02\"" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:50:11 crc kubenswrapper[5120]: I0316 16:50:11.676145 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6a9b9d92-8d3c-4366-83fb-0ea460a622d9-logs\") pod \"glance-default-external-api-0\" (UID: \"6a9b9d92-8d3c-4366-83fb-0ea460a622d9\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:50:11 crc kubenswrapper[5120]: I0316 16:50:11.676503 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/6a9b9d92-8d3c-4366-83fb-0ea460a622d9-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"6a9b9d92-8d3c-4366-83fb-0ea460a622d9\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:50:11 crc kubenswrapper[5120]: I0316 16:50:11.678589 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6a9b9d92-8d3c-4366-83fb-0ea460a622d9-scripts\") pod \"glance-default-external-api-0\" (UID: \"6a9b9d92-8d3c-4366-83fb-0ea460a622d9\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:50:11 crc kubenswrapper[5120]: I0316 16:50:11.679415 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6a9b9d92-8d3c-4366-83fb-0ea460a622d9-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"6a9b9d92-8d3c-4366-83fb-0ea460a622d9\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:50:11 crc kubenswrapper[5120]: I0316 16:50:11.683827 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6a9b9d92-8d3c-4366-83fb-0ea460a622d9-config-data\") pod \"glance-default-external-api-0\" (UID: \"6a9b9d92-8d3c-4366-83fb-0ea460a622d9\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:50:11 crc kubenswrapper[5120]: I0316 16:50:11.696690 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6a9b9d92-8d3c-4366-83fb-0ea460a622d9-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"6a9b9d92-8d3c-4366-83fb-0ea460a622d9\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:50:11 crc kubenswrapper[5120]: I0316 16:50:11.704823 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdxqr\" (UniqueName: \"kubernetes.io/projected/6a9b9d92-8d3c-4366-83fb-0ea460a622d9-kube-api-access-gdxqr\") pod \"glance-default-external-api-0\" (UID: \"6a9b9d92-8d3c-4366-83fb-0ea460a622d9\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:50:11 crc kubenswrapper[5120]: I0316 16:50:11.716465 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"glance-default-external-api-0\" (UID: \"6a9b9d92-8d3c-4366-83fb-0ea460a622d9\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:50:11 crc kubenswrapper[5120]: I0316 16:50:11.770221 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:50:12 crc kubenswrapper[5120]: W0316 16:50:12.131652 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc349c18b_ceb6_4eb9_8f6b_012f5d5e8654.slice/crio-f0716716f06f3789fa696bb4bf20a61494ab5610bcf1842e1fb304632336b785 WatchSource:0}: Error finding container f0716716f06f3789fa696bb4bf20a61494ab5610bcf1842e1fb304632336b785: Status 404 returned error can't find the container with id f0716716f06f3789fa696bb4bf20a61494ab5610bcf1842e1fb304632336b785 Mar 16 16:50:12 crc kubenswrapper[5120]: I0316 16:50:12.134156 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:50:12 crc kubenswrapper[5120]: I0316 16:50:12.153735 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"c349c18b-ceb6-4eb9-8f6b-012f5d5e8654","Type":"ContainerStarted","Data":"f0716716f06f3789fa696bb4bf20a61494ab5610bcf1842e1fb304632336b785"} Mar 16 16:50:12 crc kubenswrapper[5120]: I0316 16:50:12.156639 5120 generic.go:358] "Generic (PLEG): container finished" podID="ac5817ce-1c59-4375-9fb6-f2fcd39bdba2" containerID="e1f008207b4e65c35dbbb1a2b363b53644df41f9b03a1b7ee6b4a6e099ab0cdb" exitCode=0 Mar 16 16:50:12 crc kubenswrapper[5120]: I0316 16:50:12.156712 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-f5b8b4576-z8chc" event={"ID":"ac5817ce-1c59-4375-9fb6-f2fcd39bdba2","Type":"ContainerDied","Data":"e1f008207b4e65c35dbbb1a2b363b53644df41f9b03a1b7ee6b4a6e099ab0cdb"} Mar 16 16:50:12 crc kubenswrapper[5120]: E0316 16:50:12.229908 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="583f5e8456c375c564641fbbd1cf323930ba07fd7dcce921278f431729b9f67f" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:50:12 crc kubenswrapper[5120]: E0316 16:50:12.231977 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="583f5e8456c375c564641fbbd1cf323930ba07fd7dcce921278f431729b9f67f" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:50:12 crc kubenswrapper[5120]: I0316 16:50:12.232770 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:50:12 crc kubenswrapper[5120]: E0316 16:50:12.234074 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="583f5e8456c375c564641fbbd1cf323930ba07fd7dcce921278f431729b9f67f" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:50:12 crc kubenswrapper[5120]: E0316 16:50:12.234137 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="2961edb8-5975-4d74-800e-732bed5d9791" containerName="nova-scheduler-scheduler" probeResult="unknown" Mar 16 16:50:12 crc kubenswrapper[5120]: W0316 16:50:12.245297 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6a9b9d92_8d3c_4366_83fb_0ea460a622d9.slice/crio-95e6f98a71b0fb6a1711d4679ebe344f7fc97980903ac279616f4c3b347109e8 WatchSource:0}: Error finding container 95e6f98a71b0fb6a1711d4679ebe344f7fc97980903ac279616f4c3b347109e8: Status 404 returned error can't find the container with id 95e6f98a71b0fb6a1711d4679ebe344f7fc97980903ac279616f4c3b347109e8 Mar 16 16:50:12 crc kubenswrapper[5120]: I0316 16:50:12.381035 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-f5b8b4576-z8chc" Mar 16 16:50:12 crc kubenswrapper[5120]: I0316 16:50:12.518959 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ac5817ce-1c59-4375-9fb6-f2fcd39bdba2-config-data\") pod \"ac5817ce-1c59-4375-9fb6-f2fcd39bdba2\" (UID: \"ac5817ce-1c59-4375-9fb6-f2fcd39bdba2\") " Mar 16 16:50:12 crc kubenswrapper[5120]: I0316 16:50:12.519091 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ac5817ce-1c59-4375-9fb6-f2fcd39bdba2-logs\") pod \"ac5817ce-1c59-4375-9fb6-f2fcd39bdba2\" (UID: \"ac5817ce-1c59-4375-9fb6-f2fcd39bdba2\") " Mar 16 16:50:12 crc kubenswrapper[5120]: I0316 16:50:12.519166 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-szbpz\" (UniqueName: \"kubernetes.io/projected/ac5817ce-1c59-4375-9fb6-f2fcd39bdba2-kube-api-access-szbpz\") pod \"ac5817ce-1c59-4375-9fb6-f2fcd39bdba2\" (UID: \"ac5817ce-1c59-4375-9fb6-f2fcd39bdba2\") " Mar 16 16:50:12 crc kubenswrapper[5120]: I0316 16:50:12.519459 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/ac5817ce-1c59-4375-9fb6-f2fcd39bdba2-config-data-custom\") pod \"ac5817ce-1c59-4375-9fb6-f2fcd39bdba2\" (UID: \"ac5817ce-1c59-4375-9fb6-f2fcd39bdba2\") " Mar 16 16:50:12 crc kubenswrapper[5120]: I0316 16:50:12.519558 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ac5817ce-1c59-4375-9fb6-f2fcd39bdba2-combined-ca-bundle\") pod \"ac5817ce-1c59-4375-9fb6-f2fcd39bdba2\" (UID: \"ac5817ce-1c59-4375-9fb6-f2fcd39bdba2\") " Mar 16 16:50:12 crc kubenswrapper[5120]: I0316 16:50:12.519723 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac5817ce-1c59-4375-9fb6-f2fcd39bdba2-logs" (OuterVolumeSpecName: "logs") pod "ac5817ce-1c59-4375-9fb6-f2fcd39bdba2" (UID: "ac5817ce-1c59-4375-9fb6-f2fcd39bdba2"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:50:12 crc kubenswrapper[5120]: I0316 16:50:12.520416 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ac5817ce-1c59-4375-9fb6-f2fcd39bdba2-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:12 crc kubenswrapper[5120]: I0316 16:50:12.525345 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac5817ce-1c59-4375-9fb6-f2fcd39bdba2-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "ac5817ce-1c59-4375-9fb6-f2fcd39bdba2" (UID: "ac5817ce-1c59-4375-9fb6-f2fcd39bdba2"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:50:12 crc kubenswrapper[5120]: I0316 16:50:12.525642 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac5817ce-1c59-4375-9fb6-f2fcd39bdba2-kube-api-access-szbpz" (OuterVolumeSpecName: "kube-api-access-szbpz") pod "ac5817ce-1c59-4375-9fb6-f2fcd39bdba2" (UID: "ac5817ce-1c59-4375-9fb6-f2fcd39bdba2"). InnerVolumeSpecName "kube-api-access-szbpz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:50:12 crc kubenswrapper[5120]: I0316 16:50:12.550956 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac5817ce-1c59-4375-9fb6-f2fcd39bdba2-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ac5817ce-1c59-4375-9fb6-f2fcd39bdba2" (UID: "ac5817ce-1c59-4375-9fb6-f2fcd39bdba2"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:50:12 crc kubenswrapper[5120]: I0316 16:50:12.576343 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac5817ce-1c59-4375-9fb6-f2fcd39bdba2-config-data" (OuterVolumeSpecName: "config-data") pod "ac5817ce-1c59-4375-9fb6-f2fcd39bdba2" (UID: "ac5817ce-1c59-4375-9fb6-f2fcd39bdba2"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:50:12 crc kubenswrapper[5120]: I0316 16:50:12.622461 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-szbpz\" (UniqueName: \"kubernetes.io/projected/ac5817ce-1c59-4375-9fb6-f2fcd39bdba2-kube-api-access-szbpz\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:12 crc kubenswrapper[5120]: I0316 16:50:12.622491 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/ac5817ce-1c59-4375-9fb6-f2fcd39bdba2-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:12 crc kubenswrapper[5120]: I0316 16:50:12.622500 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ac5817ce-1c59-4375-9fb6-f2fcd39bdba2-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:12 crc kubenswrapper[5120]: I0316 16:50:12.622509 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ac5817ce-1c59-4375-9fb6-f2fcd39bdba2-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:12 crc kubenswrapper[5120]: I0316 16:50:12.677969 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="016dd61b-9c8d-4a62-a30f-5893f3aa41d7" path="/var/lib/kubelet/pods/016dd61b-9c8d-4a62-a30f-5893f3aa41d7/volumes" Mar 16 16:50:12 crc kubenswrapper[5120]: I0316 16:50:12.678796 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b530ed0b-581b-40f8-b872-1f920e152d92" path="/var/lib/kubelet/pods/b530ed0b-581b-40f8-b872-1f920e152d92/volumes" Mar 16 16:50:12 crc kubenswrapper[5120]: I0316 16:50:12.679954 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b9ac41f6-42c9-4d95-b38c-287da24a2adf" path="/var/lib/kubelet/pods/b9ac41f6-42c9-4d95-b38c-287da24a2adf/volumes" Mar 16 16:50:12 crc kubenswrapper[5120]: E0316 16:50:12.778386 5120 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podac5817ce_1c59_4375_9fb6_f2fcd39bdba2.slice\": RecentStats: unable to find data in memory cache]" Mar 16 16:50:13 crc kubenswrapper[5120]: I0316 16:50:13.173311 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"6a9b9d92-8d3c-4366-83fb-0ea460a622d9","Type":"ContainerStarted","Data":"5b3e8c00b8713699d929b1a7c050c59f2a7f5613beb583159b969397e1462736"} Mar 16 16:50:13 crc kubenswrapper[5120]: I0316 16:50:13.173560 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"6a9b9d92-8d3c-4366-83fb-0ea460a622d9","Type":"ContainerStarted","Data":"95e6f98a71b0fb6a1711d4679ebe344f7fc97980903ac279616f4c3b347109e8"} Mar 16 16:50:13 crc kubenswrapper[5120]: I0316 16:50:13.178696 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"c349c18b-ceb6-4eb9-8f6b-012f5d5e8654","Type":"ContainerStarted","Data":"2901ace11bd9e3b5e207d7aa23bc9a560f064adec1bc12b58280084152e5205f"} Mar 16 16:50:13 crc kubenswrapper[5120]: I0316 16:50:13.178941 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"c349c18b-ceb6-4eb9-8f6b-012f5d5e8654","Type":"ContainerStarted","Data":"738e85f41e17b8e6dfb85b7c1752250faed5553ee17a30e2737756697e76bcf6"} Mar 16 16:50:13 crc kubenswrapper[5120]: I0316 16:50:13.184742 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-f5b8b4576-z8chc" Mar 16 16:50:13 crc kubenswrapper[5120]: I0316 16:50:13.184799 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-f5b8b4576-z8chc" event={"ID":"ac5817ce-1c59-4375-9fb6-f2fcd39bdba2","Type":"ContainerDied","Data":"be40308576e89148c93edcdbd11c87815b9099d6b09aac2462c959ad6c8219c5"} Mar 16 16:50:13 crc kubenswrapper[5120]: I0316 16:50:13.185183 5120 scope.go:117] "RemoveContainer" containerID="e1f008207b4e65c35dbbb1a2b363b53644df41f9b03a1b7ee6b4a6e099ab0cdb" Mar 16 16:50:13 crc kubenswrapper[5120]: I0316 16:50:13.212116 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=2.212097705 podStartE2EDuration="2.212097705s" podCreationTimestamp="2026-03-16 16:50:11 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:50:13.21006991 +0000 UTC m=+4715.364001607" watchObservedRunningTime="2026-03-16 16:50:13.212097705 +0000 UTC m=+4715.366029382" Mar 16 16:50:13 crc kubenswrapper[5120]: I0316 16:50:13.236049 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-f5b8b4576-z8chc"] Mar 16 16:50:13 crc kubenswrapper[5120]: I0316 16:50:13.242321 5120 scope.go:117] "RemoveContainer" containerID="b193bd33b7db08ee7085bbb3617c49c02aeec692a9a9f0a2afacd9c0b2a844f7" Mar 16 16:50:13 crc kubenswrapper[5120]: I0316 16:50:13.246465 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-api-f5b8b4576-z8chc"] Mar 16 16:50:14 crc kubenswrapper[5120]: I0316 16:50:14.213785 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"6a9b9d92-8d3c-4366-83fb-0ea460a622d9","Type":"ContainerStarted","Data":"020f44c3cf6c107e17a170eb3a7361b1a565b2597ea573ccf12fb50dd79f6013"} Mar 16 16:50:14 crc kubenswrapper[5120]: I0316 16:50:14.250937 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-external-api-0" podStartSLOduration=3.250920405 podStartE2EDuration="3.250920405s" podCreationTimestamp="2026-03-16 16:50:11 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:50:14.238044842 +0000 UTC m=+4716.391976509" watchObservedRunningTime="2026-03-16 16:50:14.250920405 +0000 UTC m=+4716.404852062" Mar 16 16:50:14 crc kubenswrapper[5120]: I0316 16:50:14.679713 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ac5817ce-1c59-4375-9fb6-f2fcd39bdba2" path="/var/lib/kubelet/pods/ac5817ce-1c59-4375-9fb6-f2fcd39bdba2/volumes" Mar 16 16:50:16 crc kubenswrapper[5120]: E0316 16:50:16.402651 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="5767c79fc6bfdc88326d2909a4045fd0fa6001cd3d1249601d70195496f04121" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:50:16 crc kubenswrapper[5120]: E0316 16:50:16.405350 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="5767c79fc6bfdc88326d2909a4045fd0fa6001cd3d1249601d70195496f04121" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:50:16 crc kubenswrapper[5120]: E0316 16:50:16.406908 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="5767c79fc6bfdc88326d2909a4045fd0fa6001cd3d1249601d70195496f04121" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:50:16 crc kubenswrapper[5120]: E0316 16:50:16.406944 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="81b72eda-5dae-44c1-a720-9ca9e22cb100" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 16:50:17 crc kubenswrapper[5120]: I0316 16:50:17.159915 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-65584897-gpm59" Mar 16 16:50:17 crc kubenswrapper[5120]: I0316 16:50:17.232394 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-74cc5969f7-kfk8k"] Mar 16 16:50:17 crc kubenswrapper[5120]: I0316 16:50:17.232641 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-74cc5969f7-kfk8k" podUID="7f52f9e0-b276-4df9-8e45-dbffbd69c651" containerName="dnsmasq-dns" containerID="cri-o://fa1db73021ede1a006e697bc3f0126bb6863797006fe50ecdfc444501b2254e4" gracePeriod=10 Mar 16 16:50:17 crc kubenswrapper[5120]: E0316 16:50:17.233886 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="583f5e8456c375c564641fbbd1cf323930ba07fd7dcce921278f431729b9f67f" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:50:17 crc kubenswrapper[5120]: E0316 16:50:17.240647 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="583f5e8456c375c564641fbbd1cf323930ba07fd7dcce921278f431729b9f67f" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:50:17 crc kubenswrapper[5120]: E0316 16:50:17.256603 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="583f5e8456c375c564641fbbd1cf323930ba07fd7dcce921278f431729b9f67f" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:50:17 crc kubenswrapper[5120]: E0316 16:50:17.256676 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="2961edb8-5975-4d74-800e-732bed5d9791" containerName="nova-scheduler-scheduler" probeResult="unknown" Mar 16 16:50:17 crc kubenswrapper[5120]: I0316 16:50:17.748743 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-74cc5969f7-kfk8k" Mar 16 16:50:17 crc kubenswrapper[5120]: I0316 16:50:17.862573 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7f52f9e0-b276-4df9-8e45-dbffbd69c651-config\") pod \"7f52f9e0-b276-4df9-8e45-dbffbd69c651\" (UID: \"7f52f9e0-b276-4df9-8e45-dbffbd69c651\") " Mar 16 16:50:17 crc kubenswrapper[5120]: I0316 16:50:17.862720 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/7f52f9e0-b276-4df9-8e45-dbffbd69c651-dnsmasq-svc\") pod \"7f52f9e0-b276-4df9-8e45-dbffbd69c651\" (UID: \"7f52f9e0-b276-4df9-8e45-dbffbd69c651\") " Mar 16 16:50:17 crc kubenswrapper[5120]: I0316 16:50:17.862799 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vpqr9\" (UniqueName: \"kubernetes.io/projected/7f52f9e0-b276-4df9-8e45-dbffbd69c651-kube-api-access-vpqr9\") pod \"7f52f9e0-b276-4df9-8e45-dbffbd69c651\" (UID: \"7f52f9e0-b276-4df9-8e45-dbffbd69c651\") " Mar 16 16:50:17 crc kubenswrapper[5120]: I0316 16:50:17.863062 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/7f52f9e0-b276-4df9-8e45-dbffbd69c651-dns-swift-storage-0\") pod \"7f52f9e0-b276-4df9-8e45-dbffbd69c651\" (UID: \"7f52f9e0-b276-4df9-8e45-dbffbd69c651\") " Mar 16 16:50:17 crc kubenswrapper[5120]: I0316 16:50:17.868737 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f52f9e0-b276-4df9-8e45-dbffbd69c651-kube-api-access-vpqr9" (OuterVolumeSpecName: "kube-api-access-vpqr9") pod "7f52f9e0-b276-4df9-8e45-dbffbd69c651" (UID: "7f52f9e0-b276-4df9-8e45-dbffbd69c651"). InnerVolumeSpecName "kube-api-access-vpqr9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:50:17 crc kubenswrapper[5120]: I0316 16:50:17.919421 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f52f9e0-b276-4df9-8e45-dbffbd69c651-config" (OuterVolumeSpecName: "config") pod "7f52f9e0-b276-4df9-8e45-dbffbd69c651" (UID: "7f52f9e0-b276-4df9-8e45-dbffbd69c651"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:50:17 crc kubenswrapper[5120]: I0316 16:50:17.929280 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f52f9e0-b276-4df9-8e45-dbffbd69c651-dns-swift-storage-0" (OuterVolumeSpecName: "dns-swift-storage-0") pod "7f52f9e0-b276-4df9-8e45-dbffbd69c651" (UID: "7f52f9e0-b276-4df9-8e45-dbffbd69c651"). InnerVolumeSpecName "dns-swift-storage-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:50:17 crc kubenswrapper[5120]: I0316 16:50:17.934091 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f52f9e0-b276-4df9-8e45-dbffbd69c651-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "7f52f9e0-b276-4df9-8e45-dbffbd69c651" (UID: "7f52f9e0-b276-4df9-8e45-dbffbd69c651"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:50:17 crc kubenswrapper[5120]: I0316 16:50:17.966894 5120 reconciler_common.go:299] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/7f52f9e0-b276-4df9-8e45-dbffbd69c651-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:17 crc kubenswrapper[5120]: I0316 16:50:17.966958 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vpqr9\" (UniqueName: \"kubernetes.io/projected/7f52f9e0-b276-4df9-8e45-dbffbd69c651-kube-api-access-vpqr9\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:17 crc kubenswrapper[5120]: I0316 16:50:17.966975 5120 reconciler_common.go:299] "Volume detached for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/7f52f9e0-b276-4df9-8e45-dbffbd69c651-dns-swift-storage-0\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:17 crc kubenswrapper[5120]: I0316 16:50:17.966989 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7f52f9e0-b276-4df9-8e45-dbffbd69c651-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:18 crc kubenswrapper[5120]: I0316 16:50:18.271138 5120 generic.go:358] "Generic (PLEG): container finished" podID="7f52f9e0-b276-4df9-8e45-dbffbd69c651" containerID="fa1db73021ede1a006e697bc3f0126bb6863797006fe50ecdfc444501b2254e4" exitCode=0 Mar 16 16:50:18 crc kubenswrapper[5120]: I0316 16:50:18.271302 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-74cc5969f7-kfk8k" event={"ID":"7f52f9e0-b276-4df9-8e45-dbffbd69c651","Type":"ContainerDied","Data":"fa1db73021ede1a006e697bc3f0126bb6863797006fe50ecdfc444501b2254e4"} Mar 16 16:50:18 crc kubenswrapper[5120]: I0316 16:50:18.271517 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-74cc5969f7-kfk8k" event={"ID":"7f52f9e0-b276-4df9-8e45-dbffbd69c651","Type":"ContainerDied","Data":"eb1eab63a35164cc3a60c41943d0aac6261c365e196af60eb6f311fcd4633786"} Mar 16 16:50:18 crc kubenswrapper[5120]: I0316 16:50:18.271536 5120 scope.go:117] "RemoveContainer" containerID="fa1db73021ede1a006e697bc3f0126bb6863797006fe50ecdfc444501b2254e4" Mar 16 16:50:18 crc kubenswrapper[5120]: I0316 16:50:18.271365 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-74cc5969f7-kfk8k" Mar 16 16:50:18 crc kubenswrapper[5120]: I0316 16:50:18.304052 5120 scope.go:117] "RemoveContainer" containerID="fb65141ffc8c1d8df6608fedbcd6dd675c38fe59ae0d9365982202b46f7ab811" Mar 16 16:50:18 crc kubenswrapper[5120]: I0316 16:50:18.312525 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-74cc5969f7-kfk8k"] Mar 16 16:50:18 crc kubenswrapper[5120]: I0316 16:50:18.332221 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-74cc5969f7-kfk8k"] Mar 16 16:50:18 crc kubenswrapper[5120]: I0316 16:50:18.336566 5120 scope.go:117] "RemoveContainer" containerID="fa1db73021ede1a006e697bc3f0126bb6863797006fe50ecdfc444501b2254e4" Mar 16 16:50:18 crc kubenswrapper[5120]: E0316 16:50:18.337804 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa1db73021ede1a006e697bc3f0126bb6863797006fe50ecdfc444501b2254e4\": container with ID starting with fa1db73021ede1a006e697bc3f0126bb6863797006fe50ecdfc444501b2254e4 not found: ID does not exist" containerID="fa1db73021ede1a006e697bc3f0126bb6863797006fe50ecdfc444501b2254e4" Mar 16 16:50:18 crc kubenswrapper[5120]: I0316 16:50:18.337844 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa1db73021ede1a006e697bc3f0126bb6863797006fe50ecdfc444501b2254e4"} err="failed to get container status \"fa1db73021ede1a006e697bc3f0126bb6863797006fe50ecdfc444501b2254e4\": rpc error: code = NotFound desc = could not find container \"fa1db73021ede1a006e697bc3f0126bb6863797006fe50ecdfc444501b2254e4\": container with ID starting with fa1db73021ede1a006e697bc3f0126bb6863797006fe50ecdfc444501b2254e4 not found: ID does not exist" Mar 16 16:50:18 crc kubenswrapper[5120]: I0316 16:50:18.337914 5120 scope.go:117] "RemoveContainer" containerID="fb65141ffc8c1d8df6608fedbcd6dd675c38fe59ae0d9365982202b46f7ab811" Mar 16 16:50:18 crc kubenswrapper[5120]: E0316 16:50:18.338312 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb65141ffc8c1d8df6608fedbcd6dd675c38fe59ae0d9365982202b46f7ab811\": container with ID starting with fb65141ffc8c1d8df6608fedbcd6dd675c38fe59ae0d9365982202b46f7ab811 not found: ID does not exist" containerID="fb65141ffc8c1d8df6608fedbcd6dd675c38fe59ae0d9365982202b46f7ab811" Mar 16 16:50:18 crc kubenswrapper[5120]: I0316 16:50:18.338341 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb65141ffc8c1d8df6608fedbcd6dd675c38fe59ae0d9365982202b46f7ab811"} err="failed to get container status \"fb65141ffc8c1d8df6608fedbcd6dd675c38fe59ae0d9365982202b46f7ab811\": rpc error: code = NotFound desc = could not find container \"fb65141ffc8c1d8df6608fedbcd6dd675c38fe59ae0d9365982202b46f7ab811\": container with ID starting with fb65141ffc8c1d8df6608fedbcd6dd675c38fe59ae0d9365982202b46f7ab811 not found: ID does not exist" Mar 16 16:50:18 crc kubenswrapper[5120]: I0316 16:50:18.674631 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7f52f9e0-b276-4df9-8e45-dbffbd69c651" path="/var/lib/kubelet/pods/7f52f9e0-b276-4df9-8e45-dbffbd69c651/volumes" Mar 16 16:50:19 crc kubenswrapper[5120]: I0316 16:50:19.861323 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/placement-77797b894-rctcp" podUID="710921c8-80e7-46a5-8792-8ffc9795500c" containerName="placement-log" probeResult="failure" output="Get \"https://10.217.1.229:8778/\": EOF" Mar 16 16:50:19 crc kubenswrapper[5120]: I0316 16:50:19.862929 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/placement-77797b894-rctcp" podUID="710921c8-80e7-46a5-8792-8ffc9795500c" containerName="placement-api" probeResult="failure" output="Get \"https://10.217.1.229:8778/\": EOF" Mar 16 16:50:20 crc kubenswrapper[5120]: I0316 16:50:20.310435 5120 generic.go:358] "Generic (PLEG): container finished" podID="c6ba454f-2263-4fc3-bd13-35f921464d24" containerID="b0b5305a6846284b79d23bdb4082f7f0f42d0d97115e9730ee20618a55daedc4" exitCode=0 Mar 16 16:50:20 crc kubenswrapper[5120]: I0316 16:50:20.311058 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"c6ba454f-2263-4fc3-bd13-35f921464d24","Type":"ContainerDied","Data":"b0b5305a6846284b79d23bdb4082f7f0f42d0d97115e9730ee20618a55daedc4"} Mar 16 16:50:20 crc kubenswrapper[5120]: I0316 16:50:20.317355 5120 generic.go:358] "Generic (PLEG): container finished" podID="710921c8-80e7-46a5-8792-8ffc9795500c" containerID="7df173ac73cf5e36a6f13cc1a0ed41c6457fd5b2890bc60acb47c3b5135ca48b" exitCode=137 Mar 16 16:50:20 crc kubenswrapper[5120]: I0316 16:50:20.318001 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-77797b894-rctcp" event={"ID":"710921c8-80e7-46a5-8792-8ffc9795500c","Type":"ContainerDied","Data":"7df173ac73cf5e36a6f13cc1a0ed41c6457fd5b2890bc60acb47c3b5135ca48b"} Mar 16 16:50:20 crc kubenswrapper[5120]: I0316 16:50:20.318047 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-77797b894-rctcp" event={"ID":"710921c8-80e7-46a5-8792-8ffc9795500c","Type":"ContainerDied","Data":"078afbab4745fda4580ecef3ad5cf20ee58cf893e22d5242c87f6b84de9639f5"} Mar 16 16:50:20 crc kubenswrapper[5120]: I0316 16:50:20.318064 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="078afbab4745fda4580ecef3ad5cf20ee58cf893e22d5242c87f6b84de9639f5" Mar 16 16:50:20 crc kubenswrapper[5120]: I0316 16:50:20.473116 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-77797b894-rctcp" Mar 16 16:50:20 crc kubenswrapper[5120]: I0316 16:50:20.643609 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/710921c8-80e7-46a5-8792-8ffc9795500c-internal-tls-certs\") pod \"710921c8-80e7-46a5-8792-8ffc9795500c\" (UID: \"710921c8-80e7-46a5-8792-8ffc9795500c\") " Mar 16 16:50:20 crc kubenswrapper[5120]: I0316 16:50:20.643976 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/710921c8-80e7-46a5-8792-8ffc9795500c-combined-ca-bundle\") pod \"710921c8-80e7-46a5-8792-8ffc9795500c\" (UID: \"710921c8-80e7-46a5-8792-8ffc9795500c\") " Mar 16 16:50:20 crc kubenswrapper[5120]: I0316 16:50:20.644031 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/710921c8-80e7-46a5-8792-8ffc9795500c-logs\") pod \"710921c8-80e7-46a5-8792-8ffc9795500c\" (UID: \"710921c8-80e7-46a5-8792-8ffc9795500c\") " Mar 16 16:50:20 crc kubenswrapper[5120]: I0316 16:50:20.644251 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/710921c8-80e7-46a5-8792-8ffc9795500c-scripts\") pod \"710921c8-80e7-46a5-8792-8ffc9795500c\" (UID: \"710921c8-80e7-46a5-8792-8ffc9795500c\") " Mar 16 16:50:20 crc kubenswrapper[5120]: I0316 16:50:20.644289 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/710921c8-80e7-46a5-8792-8ffc9795500c-public-tls-certs\") pod \"710921c8-80e7-46a5-8792-8ffc9795500c\" (UID: \"710921c8-80e7-46a5-8792-8ffc9795500c\") " Mar 16 16:50:20 crc kubenswrapper[5120]: I0316 16:50:20.644330 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/710921c8-80e7-46a5-8792-8ffc9795500c-config-data\") pod \"710921c8-80e7-46a5-8792-8ffc9795500c\" (UID: \"710921c8-80e7-46a5-8792-8ffc9795500c\") " Mar 16 16:50:20 crc kubenswrapper[5120]: I0316 16:50:20.644415 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/710921c8-80e7-46a5-8792-8ffc9795500c-logs" (OuterVolumeSpecName: "logs") pod "710921c8-80e7-46a5-8792-8ffc9795500c" (UID: "710921c8-80e7-46a5-8792-8ffc9795500c"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:50:20 crc kubenswrapper[5120]: I0316 16:50:20.644497 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cw64d\" (UniqueName: \"kubernetes.io/projected/710921c8-80e7-46a5-8792-8ffc9795500c-kube-api-access-cw64d\") pod \"710921c8-80e7-46a5-8792-8ffc9795500c\" (UID: \"710921c8-80e7-46a5-8792-8ffc9795500c\") " Mar 16 16:50:20 crc kubenswrapper[5120]: I0316 16:50:20.645557 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/710921c8-80e7-46a5-8792-8ffc9795500c-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:20 crc kubenswrapper[5120]: I0316 16:50:20.649068 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/710921c8-80e7-46a5-8792-8ffc9795500c-kube-api-access-cw64d" (OuterVolumeSpecName: "kube-api-access-cw64d") pod "710921c8-80e7-46a5-8792-8ffc9795500c" (UID: "710921c8-80e7-46a5-8792-8ffc9795500c"). InnerVolumeSpecName "kube-api-access-cw64d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:50:20 crc kubenswrapper[5120]: I0316 16:50:20.649439 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/710921c8-80e7-46a5-8792-8ffc9795500c-scripts" (OuterVolumeSpecName: "scripts") pod "710921c8-80e7-46a5-8792-8ffc9795500c" (UID: "710921c8-80e7-46a5-8792-8ffc9795500c"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:50:20 crc kubenswrapper[5120]: I0316 16:50:20.698652 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/710921c8-80e7-46a5-8792-8ffc9795500c-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "710921c8-80e7-46a5-8792-8ffc9795500c" (UID: "710921c8-80e7-46a5-8792-8ffc9795500c"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:50:20 crc kubenswrapper[5120]: I0316 16:50:20.720356 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/710921c8-80e7-46a5-8792-8ffc9795500c-config-data" (OuterVolumeSpecName: "config-data") pod "710921c8-80e7-46a5-8792-8ffc9795500c" (UID: "710921c8-80e7-46a5-8792-8ffc9795500c"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:50:20 crc kubenswrapper[5120]: I0316 16:50:20.748421 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/710921c8-80e7-46a5-8792-8ffc9795500c-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:20 crc kubenswrapper[5120]: I0316 16:50:20.748461 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/710921c8-80e7-46a5-8792-8ffc9795500c-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:20 crc kubenswrapper[5120]: I0316 16:50:20.748470 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/710921c8-80e7-46a5-8792-8ffc9795500c-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:20 crc kubenswrapper[5120]: I0316 16:50:20.748479 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cw64d\" (UniqueName: \"kubernetes.io/projected/710921c8-80e7-46a5-8792-8ffc9795500c-kube-api-access-cw64d\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:20 crc kubenswrapper[5120]: I0316 16:50:20.752165 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/710921c8-80e7-46a5-8792-8ffc9795500c-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "710921c8-80e7-46a5-8792-8ffc9795500c" (UID: "710921c8-80e7-46a5-8792-8ffc9795500c"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:50:20 crc kubenswrapper[5120]: I0316 16:50:20.766722 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/710921c8-80e7-46a5-8792-8ffc9795500c-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "710921c8-80e7-46a5-8792-8ffc9795500c" (UID: "710921c8-80e7-46a5-8792-8ffc9795500c"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:50:20 crc kubenswrapper[5120]: I0316 16:50:20.850494 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/710921c8-80e7-46a5-8792-8ffc9795500c-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:20 crc kubenswrapper[5120]: I0316 16:50:20.850536 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/710921c8-80e7-46a5-8792-8ffc9795500c-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:21 crc kubenswrapper[5120]: I0316 16:50:21.330555 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"c6ba454f-2263-4fc3-bd13-35f921464d24","Type":"ContainerStarted","Data":"d132e86febb95aaac349850de3398e5eb968a0b02b7fc9c1c262ba103110a6d5"} Mar 16 16:50:21 crc kubenswrapper[5120]: I0316 16:50:21.330855 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-77797b894-rctcp" Mar 16 16:50:21 crc kubenswrapper[5120]: I0316 16:50:21.332414 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:50:21 crc kubenswrapper[5120]: I0316 16:50:21.365412 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/rabbitmq-server-0" podStartSLOduration=39.36539288 podStartE2EDuration="39.36539288s" podCreationTimestamp="2026-03-16 16:49:42 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:50:21.363112837 +0000 UTC m=+4723.517044494" watchObservedRunningTime="2026-03-16 16:50:21.36539288 +0000 UTC m=+4723.519324537" Mar 16 16:50:21 crc kubenswrapper[5120]: I0316 16:50:21.386839 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-77797b894-rctcp"] Mar 16 16:50:21 crc kubenswrapper[5120]: I0316 16:50:21.395660 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-77797b894-rctcp"] Mar 16 16:50:21 crc kubenswrapper[5120]: E0316 16:50:21.402801 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="5767c79fc6bfdc88326d2909a4045fd0fa6001cd3d1249601d70195496f04121" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:50:21 crc kubenswrapper[5120]: E0316 16:50:21.404643 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="5767c79fc6bfdc88326d2909a4045fd0fa6001cd3d1249601d70195496f04121" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:50:21 crc kubenswrapper[5120]: E0316 16:50:21.406162 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="5767c79fc6bfdc88326d2909a4045fd0fa6001cd3d1249601d70195496f04121" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:50:21 crc kubenswrapper[5120]: E0316 16:50:21.406214 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="81b72eda-5dae-44c1-a720-9ca9e22cb100" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 16:50:21 crc kubenswrapper[5120]: I0316 16:50:21.625361 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:50:21 crc kubenswrapper[5120]: I0316 16:50:21.625714 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:50:21 crc kubenswrapper[5120]: I0316 16:50:21.771197 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:50:21 crc kubenswrapper[5120]: I0316 16:50:21.771245 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:50:21 crc kubenswrapper[5120]: I0316 16:50:21.823998 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:50:21 crc kubenswrapper[5120]: I0316 16:50:21.848149 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:50:22 crc kubenswrapper[5120]: I0316 16:50:22.008169 5120 patch_prober.go:28] interesting pod/machine-config-daemon-7bf76 container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 16:50:22 crc kubenswrapper[5120]: I0316 16:50:22.008249 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 16:50:22 crc kubenswrapper[5120]: I0316 16:50:22.104002 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:50:22 crc kubenswrapper[5120]: I0316 16:50:22.142501 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:50:22 crc kubenswrapper[5120]: I0316 16:50:22.190564 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2885z\" (UniqueName: \"kubernetes.io/projected/81b72eda-5dae-44c1-a720-9ca9e22cb100-kube-api-access-2885z\") pod \"81b72eda-5dae-44c1-a720-9ca9e22cb100\" (UID: \"81b72eda-5dae-44c1-a720-9ca9e22cb100\") " Mar 16 16:50:22 crc kubenswrapper[5120]: I0316 16:50:22.191025 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2961edb8-5975-4d74-800e-732bed5d9791-config-data\") pod \"2961edb8-5975-4d74-800e-732bed5d9791\" (UID: \"2961edb8-5975-4d74-800e-732bed5d9791\") " Mar 16 16:50:22 crc kubenswrapper[5120]: I0316 16:50:22.191125 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/81b72eda-5dae-44c1-a720-9ca9e22cb100-combined-ca-bundle\") pod \"81b72eda-5dae-44c1-a720-9ca9e22cb100\" (UID: \"81b72eda-5dae-44c1-a720-9ca9e22cb100\") " Mar 16 16:50:22 crc kubenswrapper[5120]: I0316 16:50:22.191241 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2961edb8-5975-4d74-800e-732bed5d9791-combined-ca-bundle\") pod \"2961edb8-5975-4d74-800e-732bed5d9791\" (UID: \"2961edb8-5975-4d74-800e-732bed5d9791\") " Mar 16 16:50:22 crc kubenswrapper[5120]: I0316 16:50:22.191362 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/81b72eda-5dae-44c1-a720-9ca9e22cb100-config-data\") pod \"81b72eda-5dae-44c1-a720-9ca9e22cb100\" (UID: \"81b72eda-5dae-44c1-a720-9ca9e22cb100\") " Mar 16 16:50:22 crc kubenswrapper[5120]: I0316 16:50:22.191386 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g9hrb\" (UniqueName: \"kubernetes.io/projected/2961edb8-5975-4d74-800e-732bed5d9791-kube-api-access-g9hrb\") pod \"2961edb8-5975-4d74-800e-732bed5d9791\" (UID: \"2961edb8-5975-4d74-800e-732bed5d9791\") " Mar 16 16:50:22 crc kubenswrapper[5120]: I0316 16:50:22.232241 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2961edb8-5975-4d74-800e-732bed5d9791-kube-api-access-g9hrb" (OuterVolumeSpecName: "kube-api-access-g9hrb") pod "2961edb8-5975-4d74-800e-732bed5d9791" (UID: "2961edb8-5975-4d74-800e-732bed5d9791"). InnerVolumeSpecName "kube-api-access-g9hrb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:50:22 crc kubenswrapper[5120]: I0316 16:50:22.244508 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81b72eda-5dae-44c1-a720-9ca9e22cb100-kube-api-access-2885z" (OuterVolumeSpecName: "kube-api-access-2885z") pod "81b72eda-5dae-44c1-a720-9ca9e22cb100" (UID: "81b72eda-5dae-44c1-a720-9ca9e22cb100"). InnerVolumeSpecName "kube-api-access-2885z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:50:22 crc kubenswrapper[5120]: I0316 16:50:22.262513 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/81b72eda-5dae-44c1-a720-9ca9e22cb100-config-data" (OuterVolumeSpecName: "config-data") pod "81b72eda-5dae-44c1-a720-9ca9e22cb100" (UID: "81b72eda-5dae-44c1-a720-9ca9e22cb100"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:50:22 crc kubenswrapper[5120]: I0316 16:50:22.274612 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/81b72eda-5dae-44c1-a720-9ca9e22cb100-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "81b72eda-5dae-44c1-a720-9ca9e22cb100" (UID: "81b72eda-5dae-44c1-a720-9ca9e22cb100"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:50:22 crc kubenswrapper[5120]: I0316 16:50:22.290453 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2961edb8-5975-4d74-800e-732bed5d9791-config-data" (OuterVolumeSpecName: "config-data") pod "2961edb8-5975-4d74-800e-732bed5d9791" (UID: "2961edb8-5975-4d74-800e-732bed5d9791"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:50:22 crc kubenswrapper[5120]: I0316 16:50:22.294396 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2961edb8-5975-4d74-800e-732bed5d9791-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:22 crc kubenswrapper[5120]: I0316 16:50:22.294432 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/81b72eda-5dae-44c1-a720-9ca9e22cb100-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:22 crc kubenswrapper[5120]: I0316 16:50:22.294443 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/81b72eda-5dae-44c1-a720-9ca9e22cb100-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:22 crc kubenswrapper[5120]: I0316 16:50:22.294455 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g9hrb\" (UniqueName: \"kubernetes.io/projected/2961edb8-5975-4d74-800e-732bed5d9791-kube-api-access-g9hrb\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:22 crc kubenswrapper[5120]: I0316 16:50:22.294467 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2885z\" (UniqueName: \"kubernetes.io/projected/81b72eda-5dae-44c1-a720-9ca9e22cb100-kube-api-access-2885z\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:22 crc kubenswrapper[5120]: I0316 16:50:22.309083 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2961edb8-5975-4d74-800e-732bed5d9791-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "2961edb8-5975-4d74-800e-732bed5d9791" (UID: "2961edb8-5975-4d74-800e-732bed5d9791"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:22.344463 5120 generic.go:358] "Generic (PLEG): container finished" podID="27ae46b8-fa26-48e8-a9bb-36bc910c3caf" containerID="449f83a213ae844b7d7517f9c8b501e0b09ea767c80cb2310babca43f16e2cf7" exitCode=0 Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:22.344654 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"27ae46b8-fa26-48e8-a9bb-36bc910c3caf","Type":"ContainerDied","Data":"449f83a213ae844b7d7517f9c8b501e0b09ea767c80cb2310babca43f16e2cf7"} Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:22.348495 5120 generic.go:358] "Generic (PLEG): container finished" podID="2961edb8-5975-4d74-800e-732bed5d9791" containerID="583f5e8456c375c564641fbbd1cf323930ba07fd7dcce921278f431729b9f67f" exitCode=137 Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:22.349259 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:22.349506 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"2961edb8-5975-4d74-800e-732bed5d9791","Type":"ContainerDied","Data":"583f5e8456c375c564641fbbd1cf323930ba07fd7dcce921278f431729b9f67f"} Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:22.349561 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"2961edb8-5975-4d74-800e-732bed5d9791","Type":"ContainerDied","Data":"6e60cca01ae88b2d66a2aea7eeb455becfcf18e388a762e1b0e46352ceffe6cb"} Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:22.349586 5120 scope.go:117] "RemoveContainer" containerID="583f5e8456c375c564641fbbd1cf323930ba07fd7dcce921278f431729b9f67f" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:22.364419 5120 generic.go:358] "Generic (PLEG): container finished" podID="81b72eda-5dae-44c1-a720-9ca9e22cb100" containerID="5767c79fc6bfdc88326d2909a4045fd0fa6001cd3d1249601d70195496f04121" exitCode=137 Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:22.367023 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"81b72eda-5dae-44c1-a720-9ca9e22cb100","Type":"ContainerDied","Data":"5767c79fc6bfdc88326d2909a4045fd0fa6001cd3d1249601d70195496f04121"} Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:22.367069 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"81b72eda-5dae-44c1-a720-9ca9e22cb100","Type":"ContainerDied","Data":"138928b1d622524a36978ed699bbc7954164b4b12a161b676d9b0f03d5d7286d"} Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:22.367206 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:22.367540 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:22.367569 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:22.380538 5120 scope.go:117] "RemoveContainer" containerID="583f5e8456c375c564641fbbd1cf323930ba07fd7dcce921278f431729b9f67f" Mar 16 16:50:23 crc kubenswrapper[5120]: E0316 16:50:22.380989 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"583f5e8456c375c564641fbbd1cf323930ba07fd7dcce921278f431729b9f67f\": container with ID starting with 583f5e8456c375c564641fbbd1cf323930ba07fd7dcce921278f431729b9f67f not found: ID does not exist" containerID="583f5e8456c375c564641fbbd1cf323930ba07fd7dcce921278f431729b9f67f" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:22.381029 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"583f5e8456c375c564641fbbd1cf323930ba07fd7dcce921278f431729b9f67f"} err="failed to get container status \"583f5e8456c375c564641fbbd1cf323930ba07fd7dcce921278f431729b9f67f\": rpc error: code = NotFound desc = could not find container \"583f5e8456c375c564641fbbd1cf323930ba07fd7dcce921278f431729b9f67f\": container with ID starting with 583f5e8456c375c564641fbbd1cf323930ba07fd7dcce921278f431729b9f67f not found: ID does not exist" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:22.381053 5120 scope.go:117] "RemoveContainer" containerID="5767c79fc6bfdc88326d2909a4045fd0fa6001cd3d1249601d70195496f04121" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:22.401394 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2961edb8-5975-4d74-800e-732bed5d9791-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:22.426554 5120 scope.go:117] "RemoveContainer" containerID="5767c79fc6bfdc88326d2909a4045fd0fa6001cd3d1249601d70195496f04121" Mar 16 16:50:23 crc kubenswrapper[5120]: E0316 16:50:22.427870 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5767c79fc6bfdc88326d2909a4045fd0fa6001cd3d1249601d70195496f04121\": container with ID starting with 5767c79fc6bfdc88326d2909a4045fd0fa6001cd3d1249601d70195496f04121 not found: ID does not exist" containerID="5767c79fc6bfdc88326d2909a4045fd0fa6001cd3d1249601d70195496f04121" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:22.427916 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5767c79fc6bfdc88326d2909a4045fd0fa6001cd3d1249601d70195496f04121"} err="failed to get container status \"5767c79fc6bfdc88326d2909a4045fd0fa6001cd3d1249601d70195496f04121\": rpc error: code = NotFound desc = could not find container \"5767c79fc6bfdc88326d2909a4045fd0fa6001cd3d1249601d70195496f04121\": container with ID starting with 5767c79fc6bfdc88326d2909a4045fd0fa6001cd3d1249601d70195496f04121 not found: ID does not exist" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:22.451314 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:22.492042 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:22.532305 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:22.556364 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:22.569052 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:22.570864 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f52f9e0-b276-4df9-8e45-dbffbd69c651" containerName="init" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:22.570884 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f52f9e0-b276-4df9-8e45-dbffbd69c651" containerName="init" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:22.570899 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="710921c8-80e7-46a5-8792-8ffc9795500c" containerName="placement-log" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:22.570906 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="710921c8-80e7-46a5-8792-8ffc9795500c" containerName="placement-log" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:22.570990 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="710921c8-80e7-46a5-8792-8ffc9795500c" containerName="placement-api" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:22.570999 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="710921c8-80e7-46a5-8792-8ffc9795500c" containerName="placement-api" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:22.571012 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2961edb8-5975-4d74-800e-732bed5d9791" containerName="nova-scheduler-scheduler" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:22.571036 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="2961edb8-5975-4d74-800e-732bed5d9791" containerName="nova-scheduler-scheduler" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:22.571047 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac5817ce-1c59-4375-9fb6-f2fcd39bdba2" containerName="barbican-api" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:22.571053 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac5817ce-1c59-4375-9fb6-f2fcd39bdba2" containerName="barbican-api" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:22.571095 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81b72eda-5dae-44c1-a720-9ca9e22cb100" containerName="nova-cell0-conductor-conductor" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:22.571103 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="81b72eda-5dae-44c1-a720-9ca9e22cb100" containerName="nova-cell0-conductor-conductor" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:22.571139 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f52f9e0-b276-4df9-8e45-dbffbd69c651" containerName="dnsmasq-dns" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:22.571145 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f52f9e0-b276-4df9-8e45-dbffbd69c651" containerName="dnsmasq-dns" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:22.571158 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac5817ce-1c59-4375-9fb6-f2fcd39bdba2" containerName="barbican-api-log" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:22.571165 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac5817ce-1c59-4375-9fb6-f2fcd39bdba2" containerName="barbican-api-log" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:22.571425 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ac5817ce-1c59-4375-9fb6-f2fcd39bdba2" containerName="barbican-api-log" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:22.571448 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="710921c8-80e7-46a5-8792-8ffc9795500c" containerName="placement-api" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:22.571467 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7f52f9e0-b276-4df9-8e45-dbffbd69c651" containerName="dnsmasq-dns" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:22.571484 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ac5817ce-1c59-4375-9fb6-f2fcd39bdba2" containerName="barbican-api" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:22.571496 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="710921c8-80e7-46a5-8792-8ffc9795500c" containerName="placement-log" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:22.571508 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="81b72eda-5dae-44c1-a720-9ca9e22cb100" containerName="nova-cell0-conductor-conductor" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:22.571521 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="2961edb8-5975-4d74-800e-732bed5d9791" containerName="nova-scheduler-scheduler" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:22.587608 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:22.587750 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:22.590887 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-scheduler-config-data\"" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:22.597073 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:22.606978 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:22.613050 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-conductor-config-data\"" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:22.626406 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:22.666974 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="c349c18b-ceb6-4eb9-8f6b-012f5d5e8654" containerName="nova-api-log" probeResult="failure" output="Get \"http://10.217.1.252:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:22.678046 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="c349c18b-ceb6-4eb9-8f6b-012f5d5e8654" containerName="nova-api-api" probeResult="failure" output="Get \"http://10.217.1.252:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:22.687215 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2961edb8-5975-4d74-800e-732bed5d9791" path="/var/lib/kubelet/pods/2961edb8-5975-4d74-800e-732bed5d9791/volumes" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:22.688202 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="710921c8-80e7-46a5-8792-8ffc9795500c" path="/var/lib/kubelet/pods/710921c8-80e7-46a5-8792-8ffc9795500c/volumes" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:22.688950 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="81b72eda-5dae-44c1-a720-9ca9e22cb100" path="/var/lib/kubelet/pods/81b72eda-5dae-44c1-a720-9ca9e22cb100/volumes" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:22.718215 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/13fec4e9-e645-49ff-a0f7-7a0e82e649bf-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"13fec4e9-e645-49ff-a0f7-7a0e82e649bf\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:22.718322 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/972b647a-3fa9-490c-afdd-4a1f28ca3ded-config-data\") pod \"nova-scheduler-0\" (UID: \"972b647a-3fa9-490c-afdd-4a1f28ca3ded\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:22.718418 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/13fec4e9-e645-49ff-a0f7-7a0e82e649bf-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"13fec4e9-e645-49ff-a0f7-7a0e82e649bf\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:22.718616 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jb96\" (UniqueName: \"kubernetes.io/projected/13fec4e9-e645-49ff-a0f7-7a0e82e649bf-kube-api-access-5jb96\") pod \"nova-cell0-conductor-0\" (UID: \"13fec4e9-e645-49ff-a0f7-7a0e82e649bf\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:22.718698 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9lcl\" (UniqueName: \"kubernetes.io/projected/972b647a-3fa9-490c-afdd-4a1f28ca3ded-kube-api-access-x9lcl\") pod \"nova-scheduler-0\" (UID: \"972b647a-3fa9-490c-afdd-4a1f28ca3ded\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:22.718738 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/972b647a-3fa9-490c-afdd-4a1f28ca3ded-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"972b647a-3fa9-490c-afdd-4a1f28ca3ded\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:22.822225 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5jb96\" (UniqueName: \"kubernetes.io/projected/13fec4e9-e645-49ff-a0f7-7a0e82e649bf-kube-api-access-5jb96\") pod \"nova-cell0-conductor-0\" (UID: \"13fec4e9-e645-49ff-a0f7-7a0e82e649bf\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:22.822324 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x9lcl\" (UniqueName: \"kubernetes.io/projected/972b647a-3fa9-490c-afdd-4a1f28ca3ded-kube-api-access-x9lcl\") pod \"nova-scheduler-0\" (UID: \"972b647a-3fa9-490c-afdd-4a1f28ca3ded\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:22.822370 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/972b647a-3fa9-490c-afdd-4a1f28ca3ded-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"972b647a-3fa9-490c-afdd-4a1f28ca3ded\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:22.822641 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/13fec4e9-e645-49ff-a0f7-7a0e82e649bf-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"13fec4e9-e645-49ff-a0f7-7a0e82e649bf\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:22.822701 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/972b647a-3fa9-490c-afdd-4a1f28ca3ded-config-data\") pod \"nova-scheduler-0\" (UID: \"972b647a-3fa9-490c-afdd-4a1f28ca3ded\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:22.822784 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/13fec4e9-e645-49ff-a0f7-7a0e82e649bf-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"13fec4e9-e645-49ff-a0f7-7a0e82e649bf\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:22.835584 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/972b647a-3fa9-490c-afdd-4a1f28ca3ded-config-data\") pod \"nova-scheduler-0\" (UID: \"972b647a-3fa9-490c-afdd-4a1f28ca3ded\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:22.836205 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/13fec4e9-e645-49ff-a0f7-7a0e82e649bf-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"13fec4e9-e645-49ff-a0f7-7a0e82e649bf\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:22.843079 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/13fec4e9-e645-49ff-a0f7-7a0e82e649bf-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"13fec4e9-e645-49ff-a0f7-7a0e82e649bf\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:22.852632 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9lcl\" (UniqueName: \"kubernetes.io/projected/972b647a-3fa9-490c-afdd-4a1f28ca3ded-kube-api-access-x9lcl\") pod \"nova-scheduler-0\" (UID: \"972b647a-3fa9-490c-afdd-4a1f28ca3ded\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:22.852710 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jb96\" (UniqueName: \"kubernetes.io/projected/13fec4e9-e645-49ff-a0f7-7a0e82e649bf-kube-api-access-5jb96\") pod \"nova-cell0-conductor-0\" (UID: \"13fec4e9-e645-49ff-a0f7-7a0e82e649bf\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:22.858639 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/972b647a-3fa9-490c-afdd-4a1f28ca3ded-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"972b647a-3fa9-490c-afdd-4a1f28ca3ded\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:22.948017 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:22.958833 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:23.380046 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:23.384131 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"27ae46b8-fa26-48e8-a9bb-36bc910c3caf","Type":"ContainerStarted","Data":"67d364b2aaba2a401705ec4f2931d79fe5a55f4f1d2ab7387f8debc4e1e79018"} Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:23.385112 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:23.391540 5120 generic.go:358] "Generic (PLEG): container finished" podID="3b14f53d-9d11-42e8-b823-65b88191e532" containerID="2ca72404e6e53a2d11f05afd65185916597407c15f175e1504f6a3dc9090a621" exitCode=137 Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:23.391698 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"3b14f53d-9d11-42e8-b823-65b88191e532","Type":"ContainerDied","Data":"2ca72404e6e53a2d11f05afd65185916597407c15f175e1504f6a3dc9090a621"} Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:23.391721 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"3b14f53d-9d11-42e8-b823-65b88191e532","Type":"ContainerDied","Data":"1970b0e40ef3c4ad9035016a3cd4de3a0bd8ae459d5382a39e1162295c194612"} Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:23.391740 5120 scope.go:117] "RemoveContainer" containerID="2ca72404e6e53a2d11f05afd65185916597407c15f175e1504f6a3dc9090a621" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:23.391880 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:23.432943 5120 generic.go:358] "Generic (PLEG): container finished" podID="5f1fe655-07dd-4959-98ac-372e797369fa" containerID="a6f63c2438cda8e5c1e39916b22f7196bbe3ad25f488b320afd6a8e2d66d01b9" exitCode=137 Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:23.433089 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"5f1fe655-07dd-4959-98ac-372e797369fa","Type":"ContainerDied","Data":"a6f63c2438cda8e5c1e39916b22f7196bbe3ad25f488b320afd6a8e2d66d01b9"} Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:23.450420 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" podStartSLOduration=40.450399881 podStartE2EDuration="40.450399881s" podCreationTimestamp="2026-03-16 16:49:43 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:50:23.429560539 +0000 UTC m=+4725.583492196" watchObservedRunningTime="2026-03-16 16:50:23.450399881 +0000 UTC m=+4725.604331538" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:23.463796 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3b14f53d-9d11-42e8-b823-65b88191e532-scripts\") pod \"3b14f53d-9d11-42e8-b823-65b88191e532\" (UID: \"3b14f53d-9d11-42e8-b823-65b88191e532\") " Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:23.464254 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/3b14f53d-9d11-42e8-b823-65b88191e532-config-data-custom\") pod \"3b14f53d-9d11-42e8-b823-65b88191e532\" (UID: \"3b14f53d-9d11-42e8-b823-65b88191e532\") " Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:23.464509 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nt6zh\" (UniqueName: \"kubernetes.io/projected/3b14f53d-9d11-42e8-b823-65b88191e532-kube-api-access-nt6zh\") pod \"3b14f53d-9d11-42e8-b823-65b88191e532\" (UID: \"3b14f53d-9d11-42e8-b823-65b88191e532\") " Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:23.464647 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3b14f53d-9d11-42e8-b823-65b88191e532-combined-ca-bundle\") pod \"3b14f53d-9d11-42e8-b823-65b88191e532\" (UID: \"3b14f53d-9d11-42e8-b823-65b88191e532\") " Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:23.464694 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/3b14f53d-9d11-42e8-b823-65b88191e532-etc-machine-id\") pod \"3b14f53d-9d11-42e8-b823-65b88191e532\" (UID: \"3b14f53d-9d11-42e8-b823-65b88191e532\") " Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:23.464873 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3b14f53d-9d11-42e8-b823-65b88191e532-logs\") pod \"3b14f53d-9d11-42e8-b823-65b88191e532\" (UID: \"3b14f53d-9d11-42e8-b823-65b88191e532\") " Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:23.464939 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3b14f53d-9d11-42e8-b823-65b88191e532-config-data\") pod \"3b14f53d-9d11-42e8-b823-65b88191e532\" (UID: \"3b14f53d-9d11-42e8-b823-65b88191e532\") " Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:23.465538 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/3b14f53d-9d11-42e8-b823-65b88191e532-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "3b14f53d-9d11-42e8-b823-65b88191e532" (UID: "3b14f53d-9d11-42e8-b823-65b88191e532"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:23.465699 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b14f53d-9d11-42e8-b823-65b88191e532-logs" (OuterVolumeSpecName: "logs") pod "3b14f53d-9d11-42e8-b823-65b88191e532" (UID: "3b14f53d-9d11-42e8-b823-65b88191e532"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:23.470844 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b14f53d-9d11-42e8-b823-65b88191e532-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "3b14f53d-9d11-42e8-b823-65b88191e532" (UID: "3b14f53d-9d11-42e8-b823-65b88191e532"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:23.470916 5120 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/3b14f53d-9d11-42e8-b823-65b88191e532-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:23.471023 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3b14f53d-9d11-42e8-b823-65b88191e532-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:23.473385 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b14f53d-9d11-42e8-b823-65b88191e532-scripts" (OuterVolumeSpecName: "scripts") pod "3b14f53d-9d11-42e8-b823-65b88191e532" (UID: "3b14f53d-9d11-42e8-b823-65b88191e532"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:23.483309 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b14f53d-9d11-42e8-b823-65b88191e532-kube-api-access-nt6zh" (OuterVolumeSpecName: "kube-api-access-nt6zh") pod "3b14f53d-9d11-42e8-b823-65b88191e532" (UID: "3b14f53d-9d11-42e8-b823-65b88191e532"). InnerVolumeSpecName "kube-api-access-nt6zh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:23.489513 5120 scope.go:117] "RemoveContainer" containerID="e979fc4bbbbee656bb574a38e76d8d095ee03dac2aa27609130add421f993387" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:23.526922 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b14f53d-9d11-42e8-b823-65b88191e532-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "3b14f53d-9d11-42e8-b823-65b88191e532" (UID: "3b14f53d-9d11-42e8-b823-65b88191e532"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:23.574971 5120 scope.go:117] "RemoveContainer" containerID="2ca72404e6e53a2d11f05afd65185916597407c15f175e1504f6a3dc9090a621" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:23.576219 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b14f53d-9d11-42e8-b823-65b88191e532-config-data" (OuterVolumeSpecName: "config-data") pod "3b14f53d-9d11-42e8-b823-65b88191e532" (UID: "3b14f53d-9d11-42e8-b823-65b88191e532"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:23.576485 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3b14f53d-9d11-42e8-b823-65b88191e532-config-data\") pod \"3b14f53d-9d11-42e8-b823-65b88191e532\" (UID: \"3b14f53d-9d11-42e8-b823-65b88191e532\") " Mar 16 16:50:23 crc kubenswrapper[5120]: W0316 16:50:23.576659 5120 empty_dir.go:511] Warning: Unmount skipped because path does not exist: /var/lib/kubelet/pods/3b14f53d-9d11-42e8-b823-65b88191e532/volumes/kubernetes.io~secret/config-data Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:23.576673 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b14f53d-9d11-42e8-b823-65b88191e532-config-data" (OuterVolumeSpecName: "config-data") pod "3b14f53d-9d11-42e8-b823-65b88191e532" (UID: "3b14f53d-9d11-42e8-b823-65b88191e532"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:50:23 crc kubenswrapper[5120]: E0316 16:50:23.576684 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2ca72404e6e53a2d11f05afd65185916597407c15f175e1504f6a3dc9090a621\": container with ID starting with 2ca72404e6e53a2d11f05afd65185916597407c15f175e1504f6a3dc9090a621 not found: ID does not exist" containerID="2ca72404e6e53a2d11f05afd65185916597407c15f175e1504f6a3dc9090a621" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:23.576712 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ca72404e6e53a2d11f05afd65185916597407c15f175e1504f6a3dc9090a621"} err="failed to get container status \"2ca72404e6e53a2d11f05afd65185916597407c15f175e1504f6a3dc9090a621\": rpc error: code = NotFound desc = could not find container \"2ca72404e6e53a2d11f05afd65185916597407c15f175e1504f6a3dc9090a621\": container with ID starting with 2ca72404e6e53a2d11f05afd65185916597407c15f175e1504f6a3dc9090a621 not found: ID does not exist" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:23.576733 5120 scope.go:117] "RemoveContainer" containerID="e979fc4bbbbee656bb574a38e76d8d095ee03dac2aa27609130add421f993387" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:23.578661 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3b14f53d-9d11-42e8-b823-65b88191e532-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:23.578678 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3b14f53d-9d11-42e8-b823-65b88191e532-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:23.578686 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3b14f53d-9d11-42e8-b823-65b88191e532-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:23.578694 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/3b14f53d-9d11-42e8-b823-65b88191e532-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:23.578702 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nt6zh\" (UniqueName: \"kubernetes.io/projected/3b14f53d-9d11-42e8-b823-65b88191e532-kube-api-access-nt6zh\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:23 crc kubenswrapper[5120]: E0316 16:50:23.580421 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e979fc4bbbbee656bb574a38e76d8d095ee03dac2aa27609130add421f993387\": container with ID starting with e979fc4bbbbee656bb574a38e76d8d095ee03dac2aa27609130add421f993387 not found: ID does not exist" containerID="e979fc4bbbbee656bb574a38e76d8d095ee03dac2aa27609130add421f993387" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:23.580491 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e979fc4bbbbee656bb574a38e76d8d095ee03dac2aa27609130add421f993387"} err="failed to get container status \"e979fc4bbbbee656bb574a38e76d8d095ee03dac2aa27609130add421f993387\": rpc error: code = NotFound desc = could not find container \"e979fc4bbbbee656bb574a38e76d8d095ee03dac2aa27609130add421f993387\": container with ID starting with e979fc4bbbbee656bb574a38e76d8d095ee03dac2aa27609130add421f993387 not found: ID does not exist" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:23.701449 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:23.768041 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:23.783709 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5f1fe655-07dd-4959-98ac-372e797369fa-config-data\") pod \"5f1fe655-07dd-4959-98ac-372e797369fa\" (UID: \"5f1fe655-07dd-4959-98ac-372e797369fa\") " Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:23.783874 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5f1fe655-07dd-4959-98ac-372e797369fa-combined-ca-bundle\") pod \"5f1fe655-07dd-4959-98ac-372e797369fa\" (UID: \"5f1fe655-07dd-4959-98ac-372e797369fa\") " Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:23.784109 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/5f1fe655-07dd-4959-98ac-372e797369fa-config-data-custom\") pod \"5f1fe655-07dd-4959-98ac-372e797369fa\" (UID: \"5f1fe655-07dd-4959-98ac-372e797369fa\") " Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:23.784384 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5f1fe655-07dd-4959-98ac-372e797369fa-scripts\") pod \"5f1fe655-07dd-4959-98ac-372e797369fa\" (UID: \"5f1fe655-07dd-4959-98ac-372e797369fa\") " Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:23.784443 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/5f1fe655-07dd-4959-98ac-372e797369fa-etc-machine-id\") pod \"5f1fe655-07dd-4959-98ac-372e797369fa\" (UID: \"5f1fe655-07dd-4959-98ac-372e797369fa\") " Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:23.784495 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-df9bf\" (UniqueName: \"kubernetes.io/projected/5f1fe655-07dd-4959-98ac-372e797369fa-kube-api-access-df9bf\") pod \"5f1fe655-07dd-4959-98ac-372e797369fa\" (UID: \"5f1fe655-07dd-4959-98ac-372e797369fa\") " Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:23.792890 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/5f1fe655-07dd-4959-98ac-372e797369fa-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "5f1fe655-07dd-4959-98ac-372e797369fa" (UID: "5f1fe655-07dd-4959-98ac-372e797369fa"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:23.799439 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:23.814548 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f1fe655-07dd-4959-98ac-372e797369fa-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "5f1fe655-07dd-4959-98ac-372e797369fa" (UID: "5f1fe655-07dd-4959-98ac-372e797369fa"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:23.814622 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f1fe655-07dd-4959-98ac-372e797369fa-scripts" (OuterVolumeSpecName: "scripts") pod "5f1fe655-07dd-4959-98ac-372e797369fa" (UID: "5f1fe655-07dd-4959-98ac-372e797369fa"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:23.814656 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f1fe655-07dd-4959-98ac-372e797369fa-kube-api-access-df9bf" (OuterVolumeSpecName: "kube-api-access-df9bf") pod "5f1fe655-07dd-4959-98ac-372e797369fa" (UID: "5f1fe655-07dd-4959-98ac-372e797369fa"). InnerVolumeSpecName "kube-api-access-df9bf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:23.832706 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:23.834004 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f1fe655-07dd-4959-98ac-372e797369fa" containerName="probe" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:23.834026 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f1fe655-07dd-4959-98ac-372e797369fa" containerName="probe" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:23.834038 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b14f53d-9d11-42e8-b823-65b88191e532" containerName="cinder-api-log" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:23.834044 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b14f53d-9d11-42e8-b823-65b88191e532" containerName="cinder-api-log" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:23.834060 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b14f53d-9d11-42e8-b823-65b88191e532" containerName="cinder-api" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:23.834066 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b14f53d-9d11-42e8-b823-65b88191e532" containerName="cinder-api" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:23.834110 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f1fe655-07dd-4959-98ac-372e797369fa" containerName="cinder-scheduler" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:23.834116 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f1fe655-07dd-4959-98ac-372e797369fa" containerName="cinder-scheduler" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:23.834289 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="5f1fe655-07dd-4959-98ac-372e797369fa" containerName="cinder-scheduler" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:23.834300 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="5f1fe655-07dd-4959-98ac-372e797369fa" containerName="probe" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:23.834320 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="3b14f53d-9d11-42e8-b823-65b88191e532" containerName="cinder-api" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:23.834332 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="3b14f53d-9d11-42e8-b823-65b88191e532" containerName="cinder-api-log" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:23.854031 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:23.865515 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-cinder-public-svc\"" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:23.866182 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-cinder-internal-svc\"" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:23.874353 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-api-config-data\"" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:23.887025 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:23.904471 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2627e341-ad91-4de8-96da-e58d58d40fb9-scripts\") pod \"cinder-api-0\" (UID: \"2627e341-ad91-4de8-96da-e58d58d40fb9\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:23.909678 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2627e341-ad91-4de8-96da-e58d58d40fb9-logs\") pod \"cinder-api-0\" (UID: \"2627e341-ad91-4de8-96da-e58d58d40fb9\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:23.912001 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74k2c\" (UniqueName: \"kubernetes.io/projected/2627e341-ad91-4de8-96da-e58d58d40fb9-kube-api-access-74k2c\") pod \"cinder-api-0\" (UID: \"2627e341-ad91-4de8-96da-e58d58d40fb9\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:23.916223 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2627e341-ad91-4de8-96da-e58d58d40fb9-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"2627e341-ad91-4de8-96da-e58d58d40fb9\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:23.921502 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/2627e341-ad91-4de8-96da-e58d58d40fb9-config-data-custom\") pod \"cinder-api-0\" (UID: \"2627e341-ad91-4de8-96da-e58d58d40fb9\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:23.921870 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/2627e341-ad91-4de8-96da-e58d58d40fb9-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"2627e341-ad91-4de8-96da-e58d58d40fb9\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:23.922313 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f1fe655-07dd-4959-98ac-372e797369fa-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "5f1fe655-07dd-4959-98ac-372e797369fa" (UID: "5f1fe655-07dd-4959-98ac-372e797369fa"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:23.929682 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/2627e341-ad91-4de8-96da-e58d58d40fb9-etc-machine-id\") pod \"cinder-api-0\" (UID: \"2627e341-ad91-4de8-96da-e58d58d40fb9\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:23.930075 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2627e341-ad91-4de8-96da-e58d58d40fb9-config-data\") pod \"cinder-api-0\" (UID: \"2627e341-ad91-4de8-96da-e58d58d40fb9\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:23.930189 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/2627e341-ad91-4de8-96da-e58d58d40fb9-public-tls-certs\") pod \"cinder-api-0\" (UID: \"2627e341-ad91-4de8-96da-e58d58d40fb9\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:23.930624 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5f1fe655-07dd-4959-98ac-372e797369fa-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:23.931341 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:23.933873 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/5f1fe655-07dd-4959-98ac-372e797369fa-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:23.937391 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5f1fe655-07dd-4959-98ac-372e797369fa-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:23.937471 5120 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/5f1fe655-07dd-4959-98ac-372e797369fa-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:23.937547 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-df9bf\" (UniqueName: \"kubernetes.io/projected/5f1fe655-07dd-4959-98ac-372e797369fa-kube-api-access-df9bf\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:23 crc kubenswrapper[5120]: I0316 16:50:23.949822 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:50:24 crc kubenswrapper[5120]: I0316 16:50:24.034066 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f1fe655-07dd-4959-98ac-372e797369fa-config-data" (OuterVolumeSpecName: "config-data") pod "5f1fe655-07dd-4959-98ac-372e797369fa" (UID: "5f1fe655-07dd-4959-98ac-372e797369fa"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:50:24 crc kubenswrapper[5120]: I0316 16:50:24.042833 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2627e341-ad91-4de8-96da-e58d58d40fb9-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"2627e341-ad91-4de8-96da-e58d58d40fb9\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:50:24 crc kubenswrapper[5120]: I0316 16:50:24.042918 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/2627e341-ad91-4de8-96da-e58d58d40fb9-config-data-custom\") pod \"cinder-api-0\" (UID: \"2627e341-ad91-4de8-96da-e58d58d40fb9\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:50:24 crc kubenswrapper[5120]: I0316 16:50:24.042990 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/2627e341-ad91-4de8-96da-e58d58d40fb9-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"2627e341-ad91-4de8-96da-e58d58d40fb9\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:50:24 crc kubenswrapper[5120]: I0316 16:50:24.043016 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/2627e341-ad91-4de8-96da-e58d58d40fb9-etc-machine-id\") pod \"cinder-api-0\" (UID: \"2627e341-ad91-4de8-96da-e58d58d40fb9\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:50:24 crc kubenswrapper[5120]: I0316 16:50:24.043053 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2627e341-ad91-4de8-96da-e58d58d40fb9-config-data\") pod \"cinder-api-0\" (UID: \"2627e341-ad91-4de8-96da-e58d58d40fb9\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:50:24 crc kubenswrapper[5120]: I0316 16:50:24.043074 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/2627e341-ad91-4de8-96da-e58d58d40fb9-public-tls-certs\") pod \"cinder-api-0\" (UID: \"2627e341-ad91-4de8-96da-e58d58d40fb9\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:50:24 crc kubenswrapper[5120]: I0316 16:50:24.043203 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2627e341-ad91-4de8-96da-e58d58d40fb9-scripts\") pod \"cinder-api-0\" (UID: \"2627e341-ad91-4de8-96da-e58d58d40fb9\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:50:24 crc kubenswrapper[5120]: I0316 16:50:24.043254 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2627e341-ad91-4de8-96da-e58d58d40fb9-logs\") pod \"cinder-api-0\" (UID: \"2627e341-ad91-4de8-96da-e58d58d40fb9\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:50:24 crc kubenswrapper[5120]: I0316 16:50:24.043360 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-74k2c\" (UniqueName: \"kubernetes.io/projected/2627e341-ad91-4de8-96da-e58d58d40fb9-kube-api-access-74k2c\") pod \"cinder-api-0\" (UID: \"2627e341-ad91-4de8-96da-e58d58d40fb9\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:50:24 crc kubenswrapper[5120]: I0316 16:50:24.043453 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5f1fe655-07dd-4959-98ac-372e797369fa-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:24 crc kubenswrapper[5120]: I0316 16:50:24.043896 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/2627e341-ad91-4de8-96da-e58d58d40fb9-etc-machine-id\") pod \"cinder-api-0\" (UID: \"2627e341-ad91-4de8-96da-e58d58d40fb9\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:50:24 crc kubenswrapper[5120]: I0316 16:50:24.044338 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2627e341-ad91-4de8-96da-e58d58d40fb9-logs\") pod \"cinder-api-0\" (UID: \"2627e341-ad91-4de8-96da-e58d58d40fb9\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:50:24 crc kubenswrapper[5120]: I0316 16:50:24.048103 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/2627e341-ad91-4de8-96da-e58d58d40fb9-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"2627e341-ad91-4de8-96da-e58d58d40fb9\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:50:24 crc kubenswrapper[5120]: I0316 16:50:24.051446 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/2627e341-ad91-4de8-96da-e58d58d40fb9-config-data-custom\") pod \"cinder-api-0\" (UID: \"2627e341-ad91-4de8-96da-e58d58d40fb9\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:50:24 crc kubenswrapper[5120]: I0316 16:50:24.051869 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2627e341-ad91-4de8-96da-e58d58d40fb9-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"2627e341-ad91-4de8-96da-e58d58d40fb9\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:50:24 crc kubenswrapper[5120]: I0316 16:50:24.052292 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/2627e341-ad91-4de8-96da-e58d58d40fb9-public-tls-certs\") pod \"cinder-api-0\" (UID: \"2627e341-ad91-4de8-96da-e58d58d40fb9\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:50:24 crc kubenswrapper[5120]: I0316 16:50:24.063164 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-74k2c\" (UniqueName: \"kubernetes.io/projected/2627e341-ad91-4de8-96da-e58d58d40fb9-kube-api-access-74k2c\") pod \"cinder-api-0\" (UID: \"2627e341-ad91-4de8-96da-e58d58d40fb9\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:50:24 crc kubenswrapper[5120]: I0316 16:50:24.067215 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2627e341-ad91-4de8-96da-e58d58d40fb9-scripts\") pod \"cinder-api-0\" (UID: \"2627e341-ad91-4de8-96da-e58d58d40fb9\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:50:24 crc kubenswrapper[5120]: I0316 16:50:24.073003 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2627e341-ad91-4de8-96da-e58d58d40fb9-config-data\") pod \"cinder-api-0\" (UID: \"2627e341-ad91-4de8-96da-e58d58d40fb9\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:50:24 crc kubenswrapper[5120]: I0316 16:50:24.181751 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:50:24 crc kubenswrapper[5120]: I0316 16:50:24.382116 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-5dc7897bc-w6pc6" Mar 16 16:50:24 crc kubenswrapper[5120]: I0316 16:50:24.473433 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"13fec4e9-e645-49ff-a0f7-7a0e82e649bf","Type":"ContainerStarted","Data":"e82f26a62a70ae830638c1e14bb7758b9129d37278e1dc47197c58bb380cc559"} Mar 16 16:50:24 crc kubenswrapper[5120]: I0316 16:50:24.476932 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:50:24 crc kubenswrapper[5120]: I0316 16:50:24.481619 5120 generic.go:358] "Generic (PLEG): container finished" podID="9ad6c5f4-1902-463a-8a6f-6beade89b6a1" containerID="6e240afa0b6c2548f071bab943c62ba78e67a0bd1fc1ce0d71d9a3a13fc14d31" exitCode=137 Mar 16 16:50:24 crc kubenswrapper[5120]: I0316 16:50:24.482208 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-5dc7897bc-w6pc6" event={"ID":"9ad6c5f4-1902-463a-8a6f-6beade89b6a1","Type":"ContainerDied","Data":"6e240afa0b6c2548f071bab943c62ba78e67a0bd1fc1ce0d71d9a3a13fc14d31"} Mar 16 16:50:24 crc kubenswrapper[5120]: I0316 16:50:24.482246 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-5dc7897bc-w6pc6" event={"ID":"9ad6c5f4-1902-463a-8a6f-6beade89b6a1","Type":"ContainerDied","Data":"8220bdc2e571e91e899f7e4dd3dd14f66801469c79c409329b723a9607a96105"} Mar 16 16:50:24 crc kubenswrapper[5120]: I0316 16:50:24.482268 5120 scope.go:117] "RemoveContainer" containerID="6e240afa0b6c2548f071bab943c62ba78e67a0bd1fc1ce0d71d9a3a13fc14d31" Mar 16 16:50:24 crc kubenswrapper[5120]: I0316 16:50:24.482400 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-5dc7897bc-w6pc6" Mar 16 16:50:24 crc kubenswrapper[5120]: I0316 16:50:24.500274 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"5f1fe655-07dd-4959-98ac-372e797369fa","Type":"ContainerDied","Data":"c0d57a65e10063e7d97899325f17848ce2f91612db081aab6388df11671dd7c8"} Mar 16 16:50:24 crc kubenswrapper[5120]: I0316 16:50:24.500444 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:50:24 crc kubenswrapper[5120]: I0316 16:50:24.512156 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podStartSLOduration=2.5121383489999998 podStartE2EDuration="2.512138349s" podCreationTimestamp="2026-03-16 16:50:22 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:50:24.500314465 +0000 UTC m=+4726.654246122" watchObservedRunningTime="2026-03-16 16:50:24.512138349 +0000 UTC m=+4726.666070006" Mar 16 16:50:24 crc kubenswrapper[5120]: I0316 16:50:24.522086 5120 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Mar 16 16:50:24 crc kubenswrapper[5120]: I0316 16:50:24.522115 5120 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Mar 16 16:50:24 crc kubenswrapper[5120]: I0316 16:50:24.523618 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"972b647a-3fa9-490c-afdd-4a1f28ca3ded","Type":"ContainerStarted","Data":"003c69850fc1d72a815496932d511bd381c20e583d24d4cdd9ba14a98e115862"} Mar 16 16:50:24 crc kubenswrapper[5120]: I0316 16:50:24.523664 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"972b647a-3fa9-490c-afdd-4a1f28ca3ded","Type":"ContainerStarted","Data":"91d74e2e274e80821ace8ed32d26c55f9a0d53c8c830d66c3a98772ea3efac92"} Mar 16 16:50:24 crc kubenswrapper[5120]: I0316 16:50:24.549105 5120 scope.go:117] "RemoveContainer" containerID="5fa0203e88f871ddd2ecef9d8dfe845cb0e16600196a7b9cbc2d21f7e6ec7ba5" Mar 16 16:50:24 crc kubenswrapper[5120]: I0316 16:50:24.561266 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/9ad6c5f4-1902-463a-8a6f-6beade89b6a1-config-data-custom\") pod \"9ad6c5f4-1902-463a-8a6f-6beade89b6a1\" (UID: \"9ad6c5f4-1902-463a-8a6f-6beade89b6a1\") " Mar 16 16:50:24 crc kubenswrapper[5120]: I0316 16:50:24.561788 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5dc86\" (UniqueName: \"kubernetes.io/projected/9ad6c5f4-1902-463a-8a6f-6beade89b6a1-kube-api-access-5dc86\") pod \"9ad6c5f4-1902-463a-8a6f-6beade89b6a1\" (UID: \"9ad6c5f4-1902-463a-8a6f-6beade89b6a1\") " Mar 16 16:50:24 crc kubenswrapper[5120]: I0316 16:50:24.562388 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9ad6c5f4-1902-463a-8a6f-6beade89b6a1-logs\") pod \"9ad6c5f4-1902-463a-8a6f-6beade89b6a1\" (UID: \"9ad6c5f4-1902-463a-8a6f-6beade89b6a1\") " Mar 16 16:50:24 crc kubenswrapper[5120]: I0316 16:50:24.562606 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9ad6c5f4-1902-463a-8a6f-6beade89b6a1-config-data\") pod \"9ad6c5f4-1902-463a-8a6f-6beade89b6a1\" (UID: \"9ad6c5f4-1902-463a-8a6f-6beade89b6a1\") " Mar 16 16:50:24 crc kubenswrapper[5120]: I0316 16:50:24.562831 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9ad6c5f4-1902-463a-8a6f-6beade89b6a1-combined-ca-bundle\") pod \"9ad6c5f4-1902-463a-8a6f-6beade89b6a1\" (UID: \"9ad6c5f4-1902-463a-8a6f-6beade89b6a1\") " Mar 16 16:50:24 crc kubenswrapper[5120]: I0316 16:50:24.568048 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ad6c5f4-1902-463a-8a6f-6beade89b6a1-logs" (OuterVolumeSpecName: "logs") pod "9ad6c5f4-1902-463a-8a6f-6beade89b6a1" (UID: "9ad6c5f4-1902-463a-8a6f-6beade89b6a1"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:50:24 crc kubenswrapper[5120]: I0316 16:50:24.577157 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ad6c5f4-1902-463a-8a6f-6beade89b6a1-kube-api-access-5dc86" (OuterVolumeSpecName: "kube-api-access-5dc86") pod "9ad6c5f4-1902-463a-8a6f-6beade89b6a1" (UID: "9ad6c5f4-1902-463a-8a6f-6beade89b6a1"). InnerVolumeSpecName "kube-api-access-5dc86". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:50:24 crc kubenswrapper[5120]: I0316 16:50:24.579604 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ad6c5f4-1902-463a-8a6f-6beade89b6a1-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "9ad6c5f4-1902-463a-8a6f-6beade89b6a1" (UID: "9ad6c5f4-1902-463a-8a6f-6beade89b6a1"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:50:24 crc kubenswrapper[5120]: I0316 16:50:24.627975 5120 scope.go:117] "RemoveContainer" containerID="6e240afa0b6c2548f071bab943c62ba78e67a0bd1fc1ce0d71d9a3a13fc14d31" Mar 16 16:50:24 crc kubenswrapper[5120]: I0316 16:50:24.631229 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-scheduler-0" podStartSLOduration=2.631190485 podStartE2EDuration="2.631190485s" podCreationTimestamp="2026-03-16 16:50:22 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:50:24.553201926 +0000 UTC m=+4726.707133583" watchObservedRunningTime="2026-03-16 16:50:24.631190485 +0000 UTC m=+4726.785122142" Mar 16 16:50:24 crc kubenswrapper[5120]: E0316 16:50:24.633150 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6e240afa0b6c2548f071bab943c62ba78e67a0bd1fc1ce0d71d9a3a13fc14d31\": container with ID starting with 6e240afa0b6c2548f071bab943c62ba78e67a0bd1fc1ce0d71d9a3a13fc14d31 not found: ID does not exist" containerID="6e240afa0b6c2548f071bab943c62ba78e67a0bd1fc1ce0d71d9a3a13fc14d31" Mar 16 16:50:24 crc kubenswrapper[5120]: I0316 16:50:24.633223 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e240afa0b6c2548f071bab943c62ba78e67a0bd1fc1ce0d71d9a3a13fc14d31"} err="failed to get container status \"6e240afa0b6c2548f071bab943c62ba78e67a0bd1fc1ce0d71d9a3a13fc14d31\": rpc error: code = NotFound desc = could not find container \"6e240afa0b6c2548f071bab943c62ba78e67a0bd1fc1ce0d71d9a3a13fc14d31\": container with ID starting with 6e240afa0b6c2548f071bab943c62ba78e67a0bd1fc1ce0d71d9a3a13fc14d31 not found: ID does not exist" Mar 16 16:50:24 crc kubenswrapper[5120]: I0316 16:50:24.633273 5120 scope.go:117] "RemoveContainer" containerID="5fa0203e88f871ddd2ecef9d8dfe845cb0e16600196a7b9cbc2d21f7e6ec7ba5" Mar 16 16:50:24 crc kubenswrapper[5120]: E0316 16:50:24.635834 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5fa0203e88f871ddd2ecef9d8dfe845cb0e16600196a7b9cbc2d21f7e6ec7ba5\": container with ID starting with 5fa0203e88f871ddd2ecef9d8dfe845cb0e16600196a7b9cbc2d21f7e6ec7ba5 not found: ID does not exist" containerID="5fa0203e88f871ddd2ecef9d8dfe845cb0e16600196a7b9cbc2d21f7e6ec7ba5" Mar 16 16:50:24 crc kubenswrapper[5120]: I0316 16:50:24.635978 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5fa0203e88f871ddd2ecef9d8dfe845cb0e16600196a7b9cbc2d21f7e6ec7ba5"} err="failed to get container status \"5fa0203e88f871ddd2ecef9d8dfe845cb0e16600196a7b9cbc2d21f7e6ec7ba5\": rpc error: code = NotFound desc = could not find container \"5fa0203e88f871ddd2ecef9d8dfe845cb0e16600196a7b9cbc2d21f7e6ec7ba5\": container with ID starting with 5fa0203e88f871ddd2ecef9d8dfe845cb0e16600196a7b9cbc2d21f7e6ec7ba5 not found: ID does not exist" Mar 16 16:50:24 crc kubenswrapper[5120]: I0316 16:50:24.636103 5120 scope.go:117] "RemoveContainer" containerID="69f752550a5578263c364529de570d74151a5bd7974ef22cf21fdb0c1513409f" Mar 16 16:50:24 crc kubenswrapper[5120]: I0316 16:50:24.635995 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ad6c5f4-1902-463a-8a6f-6beade89b6a1-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "9ad6c5f4-1902-463a-8a6f-6beade89b6a1" (UID: "9ad6c5f4-1902-463a-8a6f-6beade89b6a1"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:50:24 crc kubenswrapper[5120]: I0316 16:50:24.670907 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/9ad6c5f4-1902-463a-8a6f-6beade89b6a1-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:24 crc kubenswrapper[5120]: I0316 16:50:24.670965 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5dc86\" (UniqueName: \"kubernetes.io/projected/9ad6c5f4-1902-463a-8a6f-6beade89b6a1-kube-api-access-5dc86\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:24 crc kubenswrapper[5120]: I0316 16:50:24.670978 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9ad6c5f4-1902-463a-8a6f-6beade89b6a1-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:24 crc kubenswrapper[5120]: I0316 16:50:24.670990 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9ad6c5f4-1902-463a-8a6f-6beade89b6a1-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:24 crc kubenswrapper[5120]: I0316 16:50:24.713533 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3b14f53d-9d11-42e8-b823-65b88191e532" path="/var/lib/kubelet/pods/3b14f53d-9d11-42e8-b823-65b88191e532/volumes" Mar 16 16:50:24 crc kubenswrapper[5120]: I0316 16:50:24.714855 5120 scope.go:117] "RemoveContainer" containerID="a6f63c2438cda8e5c1e39916b22f7196bbe3ad25f488b320afd6a8e2d66d01b9" Mar 16 16:50:24 crc kubenswrapper[5120]: I0316 16:50:24.723874 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:50:24 crc kubenswrapper[5120]: I0316 16:50:24.723915 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:50:24 crc kubenswrapper[5120]: I0316 16:50:24.754924 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ad6c5f4-1902-463a-8a6f-6beade89b6a1-config-data" (OuterVolumeSpecName: "config-data") pod "9ad6c5f4-1902-463a-8a6f-6beade89b6a1" (UID: "9ad6c5f4-1902-463a-8a6f-6beade89b6a1"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:50:24 crc kubenswrapper[5120]: I0316 16:50:24.763363 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:50:24 crc kubenswrapper[5120]: I0316 16:50:24.766107 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ad6c5f4-1902-463a-8a6f-6beade89b6a1" containerName="barbican-worker-log" Mar 16 16:50:24 crc kubenswrapper[5120]: I0316 16:50:24.766261 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ad6c5f4-1902-463a-8a6f-6beade89b6a1" containerName="barbican-worker-log" Mar 16 16:50:24 crc kubenswrapper[5120]: I0316 16:50:24.766320 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ad6c5f4-1902-463a-8a6f-6beade89b6a1" containerName="barbican-worker" Mar 16 16:50:24 crc kubenswrapper[5120]: I0316 16:50:24.766377 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ad6c5f4-1902-463a-8a6f-6beade89b6a1" containerName="barbican-worker" Mar 16 16:50:24 crc kubenswrapper[5120]: I0316 16:50:24.766658 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="9ad6c5f4-1902-463a-8a6f-6beade89b6a1" containerName="barbican-worker" Mar 16 16:50:24 crc kubenswrapper[5120]: I0316 16:50:24.766806 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="9ad6c5f4-1902-463a-8a6f-6beade89b6a1" containerName="barbican-worker-log" Mar 16 16:50:24 crc kubenswrapper[5120]: I0316 16:50:24.773753 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9ad6c5f4-1902-463a-8a6f-6beade89b6a1-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:24 crc kubenswrapper[5120]: I0316 16:50:24.778113 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:50:24 crc kubenswrapper[5120]: I0316 16:50:24.783023 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:50:24 crc kubenswrapper[5120]: I0316 16:50:24.788339 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-scheduler-config-data\"" Mar 16 16:50:24 crc kubenswrapper[5120]: I0316 16:50:24.852255 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-5dc7897bc-w6pc6"] Mar 16 16:50:24 crc kubenswrapper[5120]: I0316 16:50:24.889950 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c186765a-7323-4f11-ac91-6c1ab1f2ac4f-scripts\") pod \"cinder-scheduler-0\" (UID: \"c186765a-7323-4f11-ac91-6c1ab1f2ac4f\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:50:24 crc kubenswrapper[5120]: I0316 16:50:24.890530 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljnd7\" (UniqueName: \"kubernetes.io/projected/c186765a-7323-4f11-ac91-6c1ab1f2ac4f-kube-api-access-ljnd7\") pod \"cinder-scheduler-0\" (UID: \"c186765a-7323-4f11-ac91-6c1ab1f2ac4f\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:50:24 crc kubenswrapper[5120]: I0316 16:50:24.890670 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c186765a-7323-4f11-ac91-6c1ab1f2ac4f-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"c186765a-7323-4f11-ac91-6c1ab1f2ac4f\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:50:24 crc kubenswrapper[5120]: I0316 16:50:24.891010 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/c186765a-7323-4f11-ac91-6c1ab1f2ac4f-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"c186765a-7323-4f11-ac91-6c1ab1f2ac4f\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:50:24 crc kubenswrapper[5120]: I0316 16:50:24.891075 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/c186765a-7323-4f11-ac91-6c1ab1f2ac4f-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"c186765a-7323-4f11-ac91-6c1ab1f2ac4f\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:50:24 crc kubenswrapper[5120]: I0316 16:50:24.891205 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c186765a-7323-4f11-ac91-6c1ab1f2ac4f-config-data\") pod \"cinder-scheduler-0\" (UID: \"c186765a-7323-4f11-ac91-6c1ab1f2ac4f\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:50:24 crc kubenswrapper[5120]: I0316 16:50:24.922887 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-worker-5dc7897bc-w6pc6"] Mar 16 16:50:24 crc kubenswrapper[5120]: I0316 16:50:24.964907 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:50:25 crc kubenswrapper[5120]: I0316 16:50:25.002997 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c186765a-7323-4f11-ac91-6c1ab1f2ac4f-scripts\") pod \"cinder-scheduler-0\" (UID: \"c186765a-7323-4f11-ac91-6c1ab1f2ac4f\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:50:25 crc kubenswrapper[5120]: I0316 16:50:25.003184 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ljnd7\" (UniqueName: \"kubernetes.io/projected/c186765a-7323-4f11-ac91-6c1ab1f2ac4f-kube-api-access-ljnd7\") pod \"cinder-scheduler-0\" (UID: \"c186765a-7323-4f11-ac91-6c1ab1f2ac4f\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:50:25 crc kubenswrapper[5120]: I0316 16:50:25.003250 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c186765a-7323-4f11-ac91-6c1ab1f2ac4f-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"c186765a-7323-4f11-ac91-6c1ab1f2ac4f\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:50:25 crc kubenswrapper[5120]: I0316 16:50:25.020000 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/c186765a-7323-4f11-ac91-6c1ab1f2ac4f-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"c186765a-7323-4f11-ac91-6c1ab1f2ac4f\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:50:25 crc kubenswrapper[5120]: I0316 16:50:25.020089 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/c186765a-7323-4f11-ac91-6c1ab1f2ac4f-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"c186765a-7323-4f11-ac91-6c1ab1f2ac4f\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:50:25 crc kubenswrapper[5120]: I0316 16:50:25.020207 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c186765a-7323-4f11-ac91-6c1ab1f2ac4f-config-data\") pod \"cinder-scheduler-0\" (UID: \"c186765a-7323-4f11-ac91-6c1ab1f2ac4f\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:50:25 crc kubenswrapper[5120]: I0316 16:50:25.022910 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/c186765a-7323-4f11-ac91-6c1ab1f2ac4f-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"c186765a-7323-4f11-ac91-6c1ab1f2ac4f\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:50:25 crc kubenswrapper[5120]: I0316 16:50:25.024673 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c186765a-7323-4f11-ac91-6c1ab1f2ac4f-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"c186765a-7323-4f11-ac91-6c1ab1f2ac4f\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:50:25 crc kubenswrapper[5120]: I0316 16:50:25.033429 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c186765a-7323-4f11-ac91-6c1ab1f2ac4f-scripts\") pod \"cinder-scheduler-0\" (UID: \"c186765a-7323-4f11-ac91-6c1ab1f2ac4f\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:50:25 crc kubenswrapper[5120]: I0316 16:50:25.036120 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/c186765a-7323-4f11-ac91-6c1ab1f2ac4f-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"c186765a-7323-4f11-ac91-6c1ab1f2ac4f\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:50:25 crc kubenswrapper[5120]: I0316 16:50:25.044216 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c186765a-7323-4f11-ac91-6c1ab1f2ac4f-config-data\") pod \"cinder-scheduler-0\" (UID: \"c186765a-7323-4f11-ac91-6c1ab1f2ac4f\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:50:25 crc kubenswrapper[5120]: I0316 16:50:25.067381 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljnd7\" (UniqueName: \"kubernetes.io/projected/c186765a-7323-4f11-ac91-6c1ab1f2ac4f-kube-api-access-ljnd7\") pod \"cinder-scheduler-0\" (UID: \"c186765a-7323-4f11-ac91-6c1ab1f2ac4f\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:50:25 crc kubenswrapper[5120]: I0316 16:50:25.106311 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:50:25 crc kubenswrapper[5120]: I0316 16:50:25.582232 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"2627e341-ad91-4de8-96da-e58d58d40fb9","Type":"ContainerStarted","Data":"5f14ed12598e2a07b42260232a28c704797737412d8121a472e05a19630e5fca"} Mar 16 16:50:25 crc kubenswrapper[5120]: I0316 16:50:25.585750 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"13fec4e9-e645-49ff-a0f7-7a0e82e649bf","Type":"ContainerStarted","Data":"14ffd8fe32173a96d9e6500856342d18ff25578e696684283bc74578e3e1a9ca"} Mar 16 16:50:25 crc kubenswrapper[5120]: I0316 16:50:25.754111 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:50:25 crc kubenswrapper[5120]: W0316 16:50:25.878503 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc186765a_7323_4f11_ac91_6c1ab1f2ac4f.slice/crio-7c0a8ceaa4d969753cf61aabd1c8ae72d0f1b9c3d478a1085343a325feb08631 WatchSource:0}: Error finding container 7c0a8ceaa4d969753cf61aabd1c8ae72d0f1b9c3d478a1085343a325feb08631: Status 404 returned error can't find the container with id 7c0a8ceaa4d969753cf61aabd1c8ae72d0f1b9c3d478a1085343a325feb08631 Mar 16 16:50:26 crc kubenswrapper[5120]: I0316 16:50:26.524717 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:50:26 crc kubenswrapper[5120]: I0316 16:50:26.525884 5120 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Mar 16 16:50:26 crc kubenswrapper[5120]: I0316 16:50:26.574866 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:50:26 crc kubenswrapper[5120]: I0316 16:50:26.646811 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"2627e341-ad91-4de8-96da-e58d58d40fb9","Type":"ContainerStarted","Data":"c74f707751274cb9f40149f4d93eefc2868fbd3cda3e57a098d9924341521900"} Mar 16 16:50:26 crc kubenswrapper[5120]: I0316 16:50:26.686346 5120 generic.go:358] "Generic (PLEG): container finished" podID="5b516ced-8076-4f11-8398-77eaca65d050" containerID="a752e45aa7e4b33fe1182320f27ff0f06c8dfce5d35bce8af70125146f2883a7" exitCode=137 Mar 16 16:50:26 crc kubenswrapper[5120]: I0316 16:50:26.698635 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5f1fe655-07dd-4959-98ac-372e797369fa" path="/var/lib/kubelet/pods/5f1fe655-07dd-4959-98ac-372e797369fa/volumes" Mar 16 16:50:26 crc kubenswrapper[5120]: I0316 16:50:26.699681 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ad6c5f4-1902-463a-8a6f-6beade89b6a1" path="/var/lib/kubelet/pods/9ad6c5f4-1902-463a-8a6f-6beade89b6a1/volumes" Mar 16 16:50:26 crc kubenswrapper[5120]: I0316 16:50:26.700379 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-86d6cb7f98-5w9h4" event={"ID":"5b516ced-8076-4f11-8398-77eaca65d050","Type":"ContainerDied","Data":"a752e45aa7e4b33fe1182320f27ff0f06c8dfce5d35bce8af70125146f2883a7"} Mar 16 16:50:26 crc kubenswrapper[5120]: I0316 16:50:26.706986 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"c186765a-7323-4f11-ac91-6c1ab1f2ac4f","Type":"ContainerStarted","Data":"7c0a8ceaa4d969753cf61aabd1c8ae72d0f1b9c3d478a1085343a325feb08631"} Mar 16 16:50:27 crc kubenswrapper[5120]: I0316 16:50:27.246605 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-86d6cb7f98-5w9h4" Mar 16 16:50:27 crc kubenswrapper[5120]: I0316 16:50:27.412950 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5b516ced-8076-4f11-8398-77eaca65d050-config-data\") pod \"5b516ced-8076-4f11-8398-77eaca65d050\" (UID: \"5b516ced-8076-4f11-8398-77eaca65d050\") " Mar 16 16:50:27 crc kubenswrapper[5120]: I0316 16:50:27.413057 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/5b516ced-8076-4f11-8398-77eaca65d050-config-data-custom\") pod \"5b516ced-8076-4f11-8398-77eaca65d050\" (UID: \"5b516ced-8076-4f11-8398-77eaca65d050\") " Mar 16 16:50:27 crc kubenswrapper[5120]: I0316 16:50:27.414035 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jzc92\" (UniqueName: \"kubernetes.io/projected/5b516ced-8076-4f11-8398-77eaca65d050-kube-api-access-jzc92\") pod \"5b516ced-8076-4f11-8398-77eaca65d050\" (UID: \"5b516ced-8076-4f11-8398-77eaca65d050\") " Mar 16 16:50:27 crc kubenswrapper[5120]: I0316 16:50:27.414355 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5b516ced-8076-4f11-8398-77eaca65d050-combined-ca-bundle\") pod \"5b516ced-8076-4f11-8398-77eaca65d050\" (UID: \"5b516ced-8076-4f11-8398-77eaca65d050\") " Mar 16 16:50:27 crc kubenswrapper[5120]: I0316 16:50:27.414559 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5b516ced-8076-4f11-8398-77eaca65d050-logs\") pod \"5b516ced-8076-4f11-8398-77eaca65d050\" (UID: \"5b516ced-8076-4f11-8398-77eaca65d050\") " Mar 16 16:50:27 crc kubenswrapper[5120]: I0316 16:50:27.415075 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b516ced-8076-4f11-8398-77eaca65d050-logs" (OuterVolumeSpecName: "logs") pod "5b516ced-8076-4f11-8398-77eaca65d050" (UID: "5b516ced-8076-4f11-8398-77eaca65d050"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:50:27 crc kubenswrapper[5120]: I0316 16:50:27.416600 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5b516ced-8076-4f11-8398-77eaca65d050-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:27 crc kubenswrapper[5120]: I0316 16:50:27.425646 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b516ced-8076-4f11-8398-77eaca65d050-kube-api-access-jzc92" (OuterVolumeSpecName: "kube-api-access-jzc92") pod "5b516ced-8076-4f11-8398-77eaca65d050" (UID: "5b516ced-8076-4f11-8398-77eaca65d050"). InnerVolumeSpecName "kube-api-access-jzc92". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:50:27 crc kubenswrapper[5120]: I0316 16:50:27.446939 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b516ced-8076-4f11-8398-77eaca65d050-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "5b516ced-8076-4f11-8398-77eaca65d050" (UID: "5b516ced-8076-4f11-8398-77eaca65d050"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:50:27 crc kubenswrapper[5120]: I0316 16:50:27.461188 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b516ced-8076-4f11-8398-77eaca65d050-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "5b516ced-8076-4f11-8398-77eaca65d050" (UID: "5b516ced-8076-4f11-8398-77eaca65d050"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:50:27 crc kubenswrapper[5120]: I0316 16:50:27.510973 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b516ced-8076-4f11-8398-77eaca65d050-config-data" (OuterVolumeSpecName: "config-data") pod "5b516ced-8076-4f11-8398-77eaca65d050" (UID: "5b516ced-8076-4f11-8398-77eaca65d050"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:50:27 crc kubenswrapper[5120]: I0316 16:50:27.518486 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5b516ced-8076-4f11-8398-77eaca65d050-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:27 crc kubenswrapper[5120]: I0316 16:50:27.518522 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5b516ced-8076-4f11-8398-77eaca65d050-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:27 crc kubenswrapper[5120]: I0316 16:50:27.518532 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/5b516ced-8076-4f11-8398-77eaca65d050-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:27 crc kubenswrapper[5120]: I0316 16:50:27.518541 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jzc92\" (UniqueName: \"kubernetes.io/projected/5b516ced-8076-4f11-8398-77eaca65d050-kube-api-access-jzc92\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:27 crc kubenswrapper[5120]: I0316 16:50:27.785138 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"c186765a-7323-4f11-ac91-6c1ab1f2ac4f","Type":"ContainerStarted","Data":"40c9d0ca2040ab594fed757bb25e8a4e0800b5d718f67c29748ee6caecf34c93"} Mar 16 16:50:27 crc kubenswrapper[5120]: I0316 16:50:27.804273 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-86d6cb7f98-5w9h4" event={"ID":"5b516ced-8076-4f11-8398-77eaca65d050","Type":"ContainerDied","Data":"ea8fa9acebfa083a0c61cb7a20c7766444b3591286bfbdcb3fe52ed066ff33f8"} Mar 16 16:50:27 crc kubenswrapper[5120]: I0316 16:50:27.804356 5120 scope.go:117] "RemoveContainer" containerID="a752e45aa7e4b33fe1182320f27ff0f06c8dfce5d35bce8af70125146f2883a7" Mar 16 16:50:27 crc kubenswrapper[5120]: I0316 16:50:27.804638 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-86d6cb7f98-5w9h4" Mar 16 16:50:27 crc kubenswrapper[5120]: I0316 16:50:27.838070 5120 scope.go:117] "RemoveContainer" containerID="130578ec08e3530ef1b82a4fd9b1a63bb6ef4eebe8c92ece6756d519d188e39a" Mar 16 16:50:27 crc kubenswrapper[5120]: I0316 16:50:27.862829 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-86d6cb7f98-5w9h4"] Mar 16 16:50:27 crc kubenswrapper[5120]: I0316 16:50:27.877609 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-86d6cb7f98-5w9h4"] Mar 16 16:50:27 crc kubenswrapper[5120]: I0316 16:50:27.949051 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:50:28 crc kubenswrapper[5120]: I0316 16:50:28.426118 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/placement-7d79f76d78-2wccd" Mar 16 16:50:28 crc kubenswrapper[5120]: I0316 16:50:28.433521 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/neutron-9f898f5b6-g9g57" Mar 16 16:50:28 crc kubenswrapper[5120]: I0316 16:50:28.545131 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-c59d54458-jxsr6"] Mar 16 16:50:28 crc kubenswrapper[5120]: I0316 16:50:28.545425 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-c59d54458-jxsr6" podUID="38e3968d-4055-452c-a026-2fd65f640c94" containerName="neutron-api" containerID="cri-o://0b4d6823af37760f7a48856d2232b195af45794910cb01da7c0e5e7aab0b7775" gracePeriod=30 Mar 16 16:50:28 crc kubenswrapper[5120]: I0316 16:50:28.546227 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-c59d54458-jxsr6" podUID="38e3968d-4055-452c-a026-2fd65f640c94" containerName="neutron-httpd" containerID="cri-o://ffb40f5577b6914ba356f72dc5e5487f3271ee8e4fb606a56342dab08732b090" gracePeriod=30 Mar 16 16:50:28 crc kubenswrapper[5120]: I0316 16:50:28.697315 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b516ced-8076-4f11-8398-77eaca65d050" path="/var/lib/kubelet/pods/5b516ced-8076-4f11-8398-77eaca65d050/volumes" Mar 16 16:50:28 crc kubenswrapper[5120]: I0316 16:50:28.820174 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"c186765a-7323-4f11-ac91-6c1ab1f2ac4f","Type":"ContainerStarted","Data":"609de6baddc7fc53ce05c0d9ebc736f4466bffcd372ef8e11b45d04f5a528f5f"} Mar 16 16:50:28 crc kubenswrapper[5120]: I0316 16:50:28.825951 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"2627e341-ad91-4de8-96da-e58d58d40fb9","Type":"ContainerStarted","Data":"82d54ad68569e47a7c9f69774a92e01246e782c11e23830d6d82dfe12081e84d"} Mar 16 16:50:28 crc kubenswrapper[5120]: I0316 16:50:28.826206 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:50:28 crc kubenswrapper[5120]: I0316 16:50:28.858045 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-scheduler-0" podStartSLOduration=4.858022209 podStartE2EDuration="4.858022209s" podCreationTimestamp="2026-03-16 16:50:24 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:50:28.847910822 +0000 UTC m=+4731.001842489" watchObservedRunningTime="2026-03-16 16:50:28.858022209 +0000 UTC m=+4731.011953866" Mar 16 16:50:28 crc kubenswrapper[5120]: I0316 16:50:28.870712 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-api-0" podStartSLOduration=5.870692736 podStartE2EDuration="5.870692736s" podCreationTimestamp="2026-03-16 16:50:23 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:50:28.870263525 +0000 UTC m=+4731.024195192" watchObservedRunningTime="2026-03-16 16:50:28.870692736 +0000 UTC m=+4731.024624393" Mar 16 16:50:29 crc kubenswrapper[5120]: I0316 16:50:29.625336 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:50:29 crc kubenswrapper[5120]: I0316 16:50:29.625430 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:50:29 crc kubenswrapper[5120]: I0316 16:50:29.751629 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/placement-7d79f76d78-2wccd" Mar 16 16:50:29 crc kubenswrapper[5120]: I0316 16:50:29.831689 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-744476466-rznwv"] Mar 16 16:50:29 crc kubenswrapper[5120]: I0316 16:50:29.835293 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-744476466-rznwv" podUID="135e00b3-e635-4283-912a-4d92b9980619" containerName="placement-log" containerID="cri-o://8232234c6702e776970ca9018deee4f37ee79888d00739aa240d430b731caae0" gracePeriod=30 Mar 16 16:50:29 crc kubenswrapper[5120]: I0316 16:50:29.835597 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-744476466-rznwv" podUID="135e00b3-e635-4283-912a-4d92b9980619" containerName="placement-api" containerID="cri-o://c53f7e092db576b6e0e10d597a048f947c016b1156713955f8e87ff0ba09916d" gracePeriod=30 Mar 16 16:50:29 crc kubenswrapper[5120]: I0316 16:50:29.857028 5120 generic.go:358] "Generic (PLEG): container finished" podID="38e3968d-4055-452c-a026-2fd65f640c94" containerID="ffb40f5577b6914ba356f72dc5e5487f3271ee8e4fb606a56342dab08732b090" exitCode=0 Mar 16 16:50:29 crc kubenswrapper[5120]: I0316 16:50:29.857917 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-c59d54458-jxsr6" event={"ID":"38e3968d-4055-452c-a026-2fd65f640c94","Type":"ContainerDied","Data":"ffb40f5577b6914ba356f72dc5e5487f3271ee8e4fb606a56342dab08732b090"} Mar 16 16:50:30 crc kubenswrapper[5120]: I0316 16:50:30.108077 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:50:30 crc kubenswrapper[5120]: I0316 16:50:30.487077 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/ceilometer-0" podUID="e2cf7c36-f4c0-4831-8b31-480469e7da93" containerName="proxy-httpd" probeResult="failure" output="Get \"http://10.217.1.237:3000/\": dial tcp 10.217.1.237:3000: connect: connection refused" Mar 16 16:50:30 crc kubenswrapper[5120]: I0316 16:50:30.871817 5120 generic.go:358] "Generic (PLEG): container finished" podID="135e00b3-e635-4283-912a-4d92b9980619" containerID="8232234c6702e776970ca9018deee4f37ee79888d00739aa240d430b731caae0" exitCode=143 Mar 16 16:50:30 crc kubenswrapper[5120]: I0316 16:50:30.872103 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-744476466-rznwv" event={"ID":"135e00b3-e635-4283-912a-4d92b9980619","Type":"ContainerDied","Data":"8232234c6702e776970ca9018deee4f37ee79888d00739aa240d430b731caae0"} Mar 16 16:50:30 crc kubenswrapper[5120]: I0316 16:50:30.879093 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"e2cf7c36-f4c0-4831-8b31-480469e7da93","Type":"ContainerDied","Data":"09da8f68fb8f4fbba594b87f5fc69576b135d9f56519c0bf5a6aa0861a336c18"} Mar 16 16:50:30 crc kubenswrapper[5120]: I0316 16:50:30.877110 5120 generic.go:358] "Generic (PLEG): container finished" podID="e2cf7c36-f4c0-4831-8b31-480469e7da93" containerID="09da8f68fb8f4fbba594b87f5fc69576b135d9f56519c0bf5a6aa0861a336c18" exitCode=137 Mar 16 16:50:30 crc kubenswrapper[5120]: I0316 16:50:30.985640 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:50:31 crc kubenswrapper[5120]: I0316 16:50:31.155824 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e2cf7c36-f4c0-4831-8b31-480469e7da93-scripts\") pod \"e2cf7c36-f4c0-4831-8b31-480469e7da93\" (UID: \"e2cf7c36-f4c0-4831-8b31-480469e7da93\") " Mar 16 16:50:31 crc kubenswrapper[5120]: I0316 16:50:31.156029 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e2cf7c36-f4c0-4831-8b31-480469e7da93-combined-ca-bundle\") pod \"e2cf7c36-f4c0-4831-8b31-480469e7da93\" (UID: \"e2cf7c36-f4c0-4831-8b31-480469e7da93\") " Mar 16 16:50:31 crc kubenswrapper[5120]: I0316 16:50:31.156097 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e2cf7c36-f4c0-4831-8b31-480469e7da93-run-httpd\") pod \"e2cf7c36-f4c0-4831-8b31-480469e7da93\" (UID: \"e2cf7c36-f4c0-4831-8b31-480469e7da93\") " Mar 16 16:50:31 crc kubenswrapper[5120]: I0316 16:50:31.156342 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/e2cf7c36-f4c0-4831-8b31-480469e7da93-sg-core-conf-yaml\") pod \"e2cf7c36-f4c0-4831-8b31-480469e7da93\" (UID: \"e2cf7c36-f4c0-4831-8b31-480469e7da93\") " Mar 16 16:50:31 crc kubenswrapper[5120]: I0316 16:50:31.156478 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e2cf7c36-f4c0-4831-8b31-480469e7da93-config-data\") pod \"e2cf7c36-f4c0-4831-8b31-480469e7da93\" (UID: \"e2cf7c36-f4c0-4831-8b31-480469e7da93\") " Mar 16 16:50:31 crc kubenswrapper[5120]: I0316 16:50:31.156653 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e2cf7c36-f4c0-4831-8b31-480469e7da93-log-httpd\") pod \"e2cf7c36-f4c0-4831-8b31-480469e7da93\" (UID: \"e2cf7c36-f4c0-4831-8b31-480469e7da93\") " Mar 16 16:50:31 crc kubenswrapper[5120]: I0316 16:50:31.156719 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6mhs7\" (UniqueName: \"kubernetes.io/projected/e2cf7c36-f4c0-4831-8b31-480469e7da93-kube-api-access-6mhs7\") pod \"e2cf7c36-f4c0-4831-8b31-480469e7da93\" (UID: \"e2cf7c36-f4c0-4831-8b31-480469e7da93\") " Mar 16 16:50:31 crc kubenswrapper[5120]: I0316 16:50:31.157450 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2cf7c36-f4c0-4831-8b31-480469e7da93-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "e2cf7c36-f4c0-4831-8b31-480469e7da93" (UID: "e2cf7c36-f4c0-4831-8b31-480469e7da93"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:50:31 crc kubenswrapper[5120]: I0316 16:50:31.159032 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2cf7c36-f4c0-4831-8b31-480469e7da93-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "e2cf7c36-f4c0-4831-8b31-480469e7da93" (UID: "e2cf7c36-f4c0-4831-8b31-480469e7da93"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:50:31 crc kubenswrapper[5120]: I0316 16:50:31.177548 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2cf7c36-f4c0-4831-8b31-480469e7da93-kube-api-access-6mhs7" (OuterVolumeSpecName: "kube-api-access-6mhs7") pod "e2cf7c36-f4c0-4831-8b31-480469e7da93" (UID: "e2cf7c36-f4c0-4831-8b31-480469e7da93"). InnerVolumeSpecName "kube-api-access-6mhs7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:50:31 crc kubenswrapper[5120]: I0316 16:50:31.180887 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e2cf7c36-f4c0-4831-8b31-480469e7da93-scripts" (OuterVolumeSpecName: "scripts") pod "e2cf7c36-f4c0-4831-8b31-480469e7da93" (UID: "e2cf7c36-f4c0-4831-8b31-480469e7da93"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:50:31 crc kubenswrapper[5120]: I0316 16:50:31.195532 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e2cf7c36-f4c0-4831-8b31-480469e7da93-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "e2cf7c36-f4c0-4831-8b31-480469e7da93" (UID: "e2cf7c36-f4c0-4831-8b31-480469e7da93"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:50:31 crc kubenswrapper[5120]: I0316 16:50:31.261904 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e2cf7c36-f4c0-4831-8b31-480469e7da93-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:31 crc kubenswrapper[5120]: I0316 16:50:31.261957 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e2cf7c36-f4c0-4831-8b31-480469e7da93-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:31 crc kubenswrapper[5120]: I0316 16:50:31.261975 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/e2cf7c36-f4c0-4831-8b31-480469e7da93-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:31 crc kubenswrapper[5120]: I0316 16:50:31.261992 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e2cf7c36-f4c0-4831-8b31-480469e7da93-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:31 crc kubenswrapper[5120]: I0316 16:50:31.262007 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6mhs7\" (UniqueName: \"kubernetes.io/projected/e2cf7c36-f4c0-4831-8b31-480469e7da93-kube-api-access-6mhs7\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:31 crc kubenswrapper[5120]: I0316 16:50:31.274900 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e2cf7c36-f4c0-4831-8b31-480469e7da93-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e2cf7c36-f4c0-4831-8b31-480469e7da93" (UID: "e2cf7c36-f4c0-4831-8b31-480469e7da93"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:50:31 crc kubenswrapper[5120]: I0316 16:50:31.285266 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e2cf7c36-f4c0-4831-8b31-480469e7da93-config-data" (OuterVolumeSpecName: "config-data") pod "e2cf7c36-f4c0-4831-8b31-480469e7da93" (UID: "e2cf7c36-f4c0-4831-8b31-480469e7da93"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:50:31 crc kubenswrapper[5120]: I0316 16:50:31.364596 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e2cf7c36-f4c0-4831-8b31-480469e7da93-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:31 crc kubenswrapper[5120]: I0316 16:50:31.364634 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e2cf7c36-f4c0-4831-8b31-480469e7da93-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:31 crc kubenswrapper[5120]: I0316 16:50:31.630577 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:50:31 crc kubenswrapper[5120]: I0316 16:50:31.630639 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:50:31 crc kubenswrapper[5120]: I0316 16:50:31.633089 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:50:31 crc kubenswrapper[5120]: I0316 16:50:31.641242 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:50:31 crc kubenswrapper[5120]: I0316 16:50:31.745543 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:50:31 crc kubenswrapper[5120]: I0316 16:50:31.891960 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"e2cf7c36-f4c0-4831-8b31-480469e7da93","Type":"ContainerDied","Data":"70ca15033adb4cc8ab2f68cb24d9e0896b4010993bb8df83f897dfbea5f50e2f"} Mar 16 16:50:31 crc kubenswrapper[5120]: I0316 16:50:31.892032 5120 scope.go:117] "RemoveContainer" containerID="11878faa82614ab3fac28926a06d729b441926acc8aeba8820f45579d0f53a0b" Mar 16 16:50:31 crc kubenswrapper[5120]: I0316 16:50:31.892132 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:50:31 crc kubenswrapper[5120]: I0316 16:50:31.932613 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:50:31 crc kubenswrapper[5120]: I0316 16:50:31.941096 5120 scope.go:117] "RemoveContainer" containerID="ca317b94d7c8d23ce9d78526961632ffc30a0d05d48213eb9d48e10e7fea1d29" Mar 16 16:50:31 crc kubenswrapper[5120]: I0316 16:50:31.957327 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:50:31 crc kubenswrapper[5120]: I0316 16:50:31.967441 5120 scope.go:117] "RemoveContainer" containerID="103a8032a6a4014e1df990d0cb46eb8ffe1a02da2ee5c3d25609463114e65f9b" Mar 16 16:50:31 crc kubenswrapper[5120]: I0316 16:50:31.970475 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:50:31 crc kubenswrapper[5120]: I0316 16:50:31.971870 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b516ced-8076-4f11-8398-77eaca65d050" containerName="barbican-keystone-listener" Mar 16 16:50:31 crc kubenswrapper[5120]: I0316 16:50:31.971891 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b516ced-8076-4f11-8398-77eaca65d050" containerName="barbican-keystone-listener" Mar 16 16:50:31 crc kubenswrapper[5120]: I0316 16:50:31.971902 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2cf7c36-f4c0-4831-8b31-480469e7da93" containerName="ceilometer-central-agent" Mar 16 16:50:31 crc kubenswrapper[5120]: I0316 16:50:31.971910 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2cf7c36-f4c0-4831-8b31-480469e7da93" containerName="ceilometer-central-agent" Mar 16 16:50:31 crc kubenswrapper[5120]: I0316 16:50:31.971926 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2cf7c36-f4c0-4831-8b31-480469e7da93" containerName="sg-core" Mar 16 16:50:31 crc kubenswrapper[5120]: I0316 16:50:31.971933 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2cf7c36-f4c0-4831-8b31-480469e7da93" containerName="sg-core" Mar 16 16:50:31 crc kubenswrapper[5120]: I0316 16:50:31.971972 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2cf7c36-f4c0-4831-8b31-480469e7da93" containerName="proxy-httpd" Mar 16 16:50:31 crc kubenswrapper[5120]: I0316 16:50:31.971980 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2cf7c36-f4c0-4831-8b31-480469e7da93" containerName="proxy-httpd" Mar 16 16:50:31 crc kubenswrapper[5120]: I0316 16:50:31.972004 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b516ced-8076-4f11-8398-77eaca65d050" containerName="barbican-keystone-listener-log" Mar 16 16:50:31 crc kubenswrapper[5120]: I0316 16:50:31.972013 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b516ced-8076-4f11-8398-77eaca65d050" containerName="barbican-keystone-listener-log" Mar 16 16:50:31 crc kubenswrapper[5120]: I0316 16:50:31.972059 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2cf7c36-f4c0-4831-8b31-480469e7da93" containerName="ceilometer-notification-agent" Mar 16 16:50:31 crc kubenswrapper[5120]: I0316 16:50:31.972070 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2cf7c36-f4c0-4831-8b31-480469e7da93" containerName="ceilometer-notification-agent" Mar 16 16:50:31 crc kubenswrapper[5120]: I0316 16:50:31.972253 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e2cf7c36-f4c0-4831-8b31-480469e7da93" containerName="proxy-httpd" Mar 16 16:50:31 crc kubenswrapper[5120]: I0316 16:50:31.972268 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="5b516ced-8076-4f11-8398-77eaca65d050" containerName="barbican-keystone-listener" Mar 16 16:50:31 crc kubenswrapper[5120]: I0316 16:50:31.972282 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="5b516ced-8076-4f11-8398-77eaca65d050" containerName="barbican-keystone-listener-log" Mar 16 16:50:31 crc kubenswrapper[5120]: I0316 16:50:31.972292 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e2cf7c36-f4c0-4831-8b31-480469e7da93" containerName="ceilometer-central-agent" Mar 16 16:50:31 crc kubenswrapper[5120]: I0316 16:50:31.972302 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e2cf7c36-f4c0-4831-8b31-480469e7da93" containerName="sg-core" Mar 16 16:50:31 crc kubenswrapper[5120]: I0316 16:50:31.972314 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e2cf7c36-f4c0-4831-8b31-480469e7da93" containerName="ceilometer-notification-agent" Mar 16 16:50:31 crc kubenswrapper[5120]: I0316 16:50:31.981808 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:50:31 crc kubenswrapper[5120]: I0316 16:50:31.981929 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:50:31 crc kubenswrapper[5120]: I0316 16:50:31.984518 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 16:50:31 crc kubenswrapper[5120]: I0316 16:50:31.984699 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 16:50:32 crc kubenswrapper[5120]: I0316 16:50:32.072993 5120 scope.go:117] "RemoveContainer" containerID="09da8f68fb8f4fbba594b87f5fc69576b135d9f56519c0bf5a6aa0861a336c18" Mar 16 16:50:32 crc kubenswrapper[5120]: I0316 16:50:32.083637 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/618db375-cac6-46d6-a08f-28876736a830-scripts\") pod \"ceilometer-0\" (UID: \"618db375-cac6-46d6-a08f-28876736a830\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:50:32 crc kubenswrapper[5120]: I0316 16:50:32.083680 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/618db375-cac6-46d6-a08f-28876736a830-run-httpd\") pod \"ceilometer-0\" (UID: \"618db375-cac6-46d6-a08f-28876736a830\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:50:32 crc kubenswrapper[5120]: I0316 16:50:32.083743 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/618db375-cac6-46d6-a08f-28876736a830-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"618db375-cac6-46d6-a08f-28876736a830\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:50:32 crc kubenswrapper[5120]: I0316 16:50:32.083927 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/618db375-cac6-46d6-a08f-28876736a830-log-httpd\") pod \"ceilometer-0\" (UID: \"618db375-cac6-46d6-a08f-28876736a830\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:50:32 crc kubenswrapper[5120]: I0316 16:50:32.084464 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/618db375-cac6-46d6-a08f-28876736a830-config-data\") pod \"ceilometer-0\" (UID: \"618db375-cac6-46d6-a08f-28876736a830\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:50:32 crc kubenswrapper[5120]: I0316 16:50:32.085078 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/618db375-cac6-46d6-a08f-28876736a830-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"618db375-cac6-46d6-a08f-28876736a830\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:50:32 crc kubenswrapper[5120]: I0316 16:50:32.085410 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4pjc7\" (UniqueName: \"kubernetes.io/projected/618db375-cac6-46d6-a08f-28876736a830-kube-api-access-4pjc7\") pod \"ceilometer-0\" (UID: \"618db375-cac6-46d6-a08f-28876736a830\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:50:32 crc kubenswrapper[5120]: I0316 16:50:32.187619 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/618db375-cac6-46d6-a08f-28876736a830-config-data\") pod \"ceilometer-0\" (UID: \"618db375-cac6-46d6-a08f-28876736a830\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:50:32 crc kubenswrapper[5120]: I0316 16:50:32.187677 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/618db375-cac6-46d6-a08f-28876736a830-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"618db375-cac6-46d6-a08f-28876736a830\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:50:32 crc kubenswrapper[5120]: I0316 16:50:32.187786 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4pjc7\" (UniqueName: \"kubernetes.io/projected/618db375-cac6-46d6-a08f-28876736a830-kube-api-access-4pjc7\") pod \"ceilometer-0\" (UID: \"618db375-cac6-46d6-a08f-28876736a830\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:50:32 crc kubenswrapper[5120]: I0316 16:50:32.187949 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/618db375-cac6-46d6-a08f-28876736a830-scripts\") pod \"ceilometer-0\" (UID: \"618db375-cac6-46d6-a08f-28876736a830\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:50:32 crc kubenswrapper[5120]: I0316 16:50:32.188075 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/618db375-cac6-46d6-a08f-28876736a830-run-httpd\") pod \"ceilometer-0\" (UID: \"618db375-cac6-46d6-a08f-28876736a830\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:50:32 crc kubenswrapper[5120]: I0316 16:50:32.188208 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/618db375-cac6-46d6-a08f-28876736a830-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"618db375-cac6-46d6-a08f-28876736a830\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:50:32 crc kubenswrapper[5120]: I0316 16:50:32.188234 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/618db375-cac6-46d6-a08f-28876736a830-log-httpd\") pod \"ceilometer-0\" (UID: \"618db375-cac6-46d6-a08f-28876736a830\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:50:32 crc kubenswrapper[5120]: I0316 16:50:32.188657 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/618db375-cac6-46d6-a08f-28876736a830-run-httpd\") pod \"ceilometer-0\" (UID: \"618db375-cac6-46d6-a08f-28876736a830\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:50:32 crc kubenswrapper[5120]: I0316 16:50:32.188820 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/618db375-cac6-46d6-a08f-28876736a830-log-httpd\") pod \"ceilometer-0\" (UID: \"618db375-cac6-46d6-a08f-28876736a830\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:50:32 crc kubenswrapper[5120]: I0316 16:50:32.193324 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/618db375-cac6-46d6-a08f-28876736a830-scripts\") pod \"ceilometer-0\" (UID: \"618db375-cac6-46d6-a08f-28876736a830\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:50:32 crc kubenswrapper[5120]: I0316 16:50:32.193691 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/618db375-cac6-46d6-a08f-28876736a830-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"618db375-cac6-46d6-a08f-28876736a830\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:50:32 crc kubenswrapper[5120]: I0316 16:50:32.195726 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/618db375-cac6-46d6-a08f-28876736a830-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"618db375-cac6-46d6-a08f-28876736a830\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:50:32 crc kubenswrapper[5120]: I0316 16:50:32.196632 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/618db375-cac6-46d6-a08f-28876736a830-config-data\") pod \"ceilometer-0\" (UID: \"618db375-cac6-46d6-a08f-28876736a830\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:50:32 crc kubenswrapper[5120]: I0316 16:50:32.212940 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4pjc7\" (UniqueName: \"kubernetes.io/projected/618db375-cac6-46d6-a08f-28876736a830-kube-api-access-4pjc7\") pod \"ceilometer-0\" (UID: \"618db375-cac6-46d6-a08f-28876736a830\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:50:32 crc kubenswrapper[5120]: I0316 16:50:32.345847 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:50:32 crc kubenswrapper[5120]: I0316 16:50:32.373088 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:50:32 crc kubenswrapper[5120]: I0316 16:50:32.694144 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e2cf7c36-f4c0-4831-8b31-480469e7da93" path="/var/lib/kubelet/pods/e2cf7c36-f4c0-4831-8b31-480469e7da93/volumes" Mar 16 16:50:32 crc kubenswrapper[5120]: I0316 16:50:32.695445 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:50:32 crc kubenswrapper[5120]: I0316 16:50:32.695953 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="13fec4e9-e645-49ff-a0f7-7a0e82e649bf" containerName="nova-cell0-conductor-conductor" containerID="cri-o://14ffd8fe32173a96d9e6500856342d18ff25578e696684283bc74578e3e1a9ca" gracePeriod=30 Mar 16 16:50:32 crc kubenswrapper[5120]: I0316 16:50:32.869090 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-6qwtb"] Mar 16 16:50:32 crc kubenswrapper[5120]: I0316 16:50:32.878410 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-6qwtb"] Mar 16 16:50:32 crc kubenswrapper[5120]: I0316 16:50:32.901062 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:50:32 crc kubenswrapper[5120]: I0316 16:50:32.901317 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="972b647a-3fa9-490c-afdd-4a1f28ca3ded" containerName="nova-scheduler-scheduler" containerID="cri-o://003c69850fc1d72a815496932d511bd381c20e583d24d4cdd9ba14a98e115862" gracePeriod=30 Mar 16 16:50:32 crc kubenswrapper[5120]: I0316 16:50:32.913439 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:50:32 crc kubenswrapper[5120]: I0316 16:50:32.962731 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:50:32 crc kubenswrapper[5120]: I0316 16:50:32.963109 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="77fd10d5-5894-450f-bba5-8261c3ca1b4e" containerName="nova-metadata-log" containerID="cri-o://914e787e46b4c31fdd99718734026a273335e75723c3b60d39b1ad2048616920" gracePeriod=30 Mar 16 16:50:32 crc kubenswrapper[5120]: I0316 16:50:32.963252 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="77fd10d5-5894-450f-bba5-8261c3ca1b4e" containerName="nova-metadata-metadata" containerID="cri-o://e99233f186dadd9cbfe0d387a7a97a27cb4ddc12f00726daadef528e5f4b6948" gracePeriod=30 Mar 16 16:50:32 crc kubenswrapper[5120]: I0316 16:50:32.983624 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:50:33 crc kubenswrapper[5120]: I0316 16:50:33.152836 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-hj5tn"] Mar 16 16:50:33 crc kubenswrapper[5120]: I0316 16:50:33.174493 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-hj5tn" Mar 16 16:50:33 crc kubenswrapper[5120]: I0316 16:50:33.178519 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-manage-config-data\"" Mar 16 16:50:33 crc kubenswrapper[5120]: I0316 16:50:33.179323 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-manage-scripts\"" Mar 16 16:50:33 crc kubenswrapper[5120]: I0316 16:50:33.189719 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-hj5tn"] Mar 16 16:50:33 crc kubenswrapper[5120]: I0316 16:50:33.231936 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-587mk\" (UniqueName: \"kubernetes.io/projected/dab6fe18-dcd9-476e-a0bc-866bff4864c8-kube-api-access-587mk\") pod \"nova-cell0-cell-mapping-hj5tn\" (UID: \"dab6fe18-dcd9-476e-a0bc-866bff4864c8\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-hj5tn" Mar 16 16:50:33 crc kubenswrapper[5120]: I0316 16:50:33.232222 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dab6fe18-dcd9-476e-a0bc-866bff4864c8-combined-ca-bundle\") pod \"nova-cell0-cell-mapping-hj5tn\" (UID: \"dab6fe18-dcd9-476e-a0bc-866bff4864c8\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-hj5tn" Mar 16 16:50:33 crc kubenswrapper[5120]: I0316 16:50:33.232291 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dab6fe18-dcd9-476e-a0bc-866bff4864c8-config-data\") pod \"nova-cell0-cell-mapping-hj5tn\" (UID: \"dab6fe18-dcd9-476e-a0bc-866bff4864c8\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-hj5tn" Mar 16 16:50:33 crc kubenswrapper[5120]: I0316 16:50:33.232367 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/dab6fe18-dcd9-476e-a0bc-866bff4864c8-scripts\") pod \"nova-cell0-cell-mapping-hj5tn\" (UID: \"dab6fe18-dcd9-476e-a0bc-866bff4864c8\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-hj5tn" Mar 16 16:50:33 crc kubenswrapper[5120]: I0316 16:50:33.334278 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-587mk\" (UniqueName: \"kubernetes.io/projected/dab6fe18-dcd9-476e-a0bc-866bff4864c8-kube-api-access-587mk\") pod \"nova-cell0-cell-mapping-hj5tn\" (UID: \"dab6fe18-dcd9-476e-a0bc-866bff4864c8\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-hj5tn" Mar 16 16:50:33 crc kubenswrapper[5120]: I0316 16:50:33.334435 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dab6fe18-dcd9-476e-a0bc-866bff4864c8-combined-ca-bundle\") pod \"nova-cell0-cell-mapping-hj5tn\" (UID: \"dab6fe18-dcd9-476e-a0bc-866bff4864c8\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-hj5tn" Mar 16 16:50:33 crc kubenswrapper[5120]: I0316 16:50:33.334475 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dab6fe18-dcd9-476e-a0bc-866bff4864c8-config-data\") pod \"nova-cell0-cell-mapping-hj5tn\" (UID: \"dab6fe18-dcd9-476e-a0bc-866bff4864c8\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-hj5tn" Mar 16 16:50:33 crc kubenswrapper[5120]: I0316 16:50:33.334500 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/dab6fe18-dcd9-476e-a0bc-866bff4864c8-scripts\") pod \"nova-cell0-cell-mapping-hj5tn\" (UID: \"dab6fe18-dcd9-476e-a0bc-866bff4864c8\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-hj5tn" Mar 16 16:50:33 crc kubenswrapper[5120]: I0316 16:50:33.343136 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/dab6fe18-dcd9-476e-a0bc-866bff4864c8-scripts\") pod \"nova-cell0-cell-mapping-hj5tn\" (UID: \"dab6fe18-dcd9-476e-a0bc-866bff4864c8\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-hj5tn" Mar 16 16:50:33 crc kubenswrapper[5120]: I0316 16:50:33.344055 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dab6fe18-dcd9-476e-a0bc-866bff4864c8-combined-ca-bundle\") pod \"nova-cell0-cell-mapping-hj5tn\" (UID: \"dab6fe18-dcd9-476e-a0bc-866bff4864c8\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-hj5tn" Mar 16 16:50:33 crc kubenswrapper[5120]: I0316 16:50:33.344914 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dab6fe18-dcd9-476e-a0bc-866bff4864c8-config-data\") pod \"nova-cell0-cell-mapping-hj5tn\" (UID: \"dab6fe18-dcd9-476e-a0bc-866bff4864c8\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-hj5tn" Mar 16 16:50:33 crc kubenswrapper[5120]: I0316 16:50:33.364217 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-587mk\" (UniqueName: \"kubernetes.io/projected/dab6fe18-dcd9-476e-a0bc-866bff4864c8-kube-api-access-587mk\") pod \"nova-cell0-cell-mapping-hj5tn\" (UID: \"dab6fe18-dcd9-476e-a0bc-866bff4864c8\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-hj5tn" Mar 16 16:50:33 crc kubenswrapper[5120]: I0316 16:50:33.454456 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-744476466-rznwv" Mar 16 16:50:33 crc kubenswrapper[5120]: I0316 16:50:33.540288 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/135e00b3-e635-4283-912a-4d92b9980619-combined-ca-bundle\") pod \"135e00b3-e635-4283-912a-4d92b9980619\" (UID: \"135e00b3-e635-4283-912a-4d92b9980619\") " Mar 16 16:50:33 crc kubenswrapper[5120]: I0316 16:50:33.540506 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jls7z\" (UniqueName: \"kubernetes.io/projected/135e00b3-e635-4283-912a-4d92b9980619-kube-api-access-jls7z\") pod \"135e00b3-e635-4283-912a-4d92b9980619\" (UID: \"135e00b3-e635-4283-912a-4d92b9980619\") " Mar 16 16:50:33 crc kubenswrapper[5120]: I0316 16:50:33.540572 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/135e00b3-e635-4283-912a-4d92b9980619-scripts\") pod \"135e00b3-e635-4283-912a-4d92b9980619\" (UID: \"135e00b3-e635-4283-912a-4d92b9980619\") " Mar 16 16:50:33 crc kubenswrapper[5120]: I0316 16:50:33.540623 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/135e00b3-e635-4283-912a-4d92b9980619-config-data\") pod \"135e00b3-e635-4283-912a-4d92b9980619\" (UID: \"135e00b3-e635-4283-912a-4d92b9980619\") " Mar 16 16:50:33 crc kubenswrapper[5120]: I0316 16:50:33.540659 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/135e00b3-e635-4283-912a-4d92b9980619-logs\") pod \"135e00b3-e635-4283-912a-4d92b9980619\" (UID: \"135e00b3-e635-4283-912a-4d92b9980619\") " Mar 16 16:50:33 crc kubenswrapper[5120]: I0316 16:50:33.542787 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/135e00b3-e635-4283-912a-4d92b9980619-logs" (OuterVolumeSpecName: "logs") pod "135e00b3-e635-4283-912a-4d92b9980619" (UID: "135e00b3-e635-4283-912a-4d92b9980619"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:50:33 crc kubenswrapper[5120]: I0316 16:50:33.550907 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/135e00b3-e635-4283-912a-4d92b9980619-kube-api-access-jls7z" (OuterVolumeSpecName: "kube-api-access-jls7z") pod "135e00b3-e635-4283-912a-4d92b9980619" (UID: "135e00b3-e635-4283-912a-4d92b9980619"). InnerVolumeSpecName "kube-api-access-jls7z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:50:33 crc kubenswrapper[5120]: I0316 16:50:33.553994 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/135e00b3-e635-4283-912a-4d92b9980619-scripts" (OuterVolumeSpecName: "scripts") pod "135e00b3-e635-4283-912a-4d92b9980619" (UID: "135e00b3-e635-4283-912a-4d92b9980619"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:50:33 crc kubenswrapper[5120]: I0316 16:50:33.554083 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-hj5tn" Mar 16 16:50:33 crc kubenswrapper[5120]: I0316 16:50:33.615409 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/135e00b3-e635-4283-912a-4d92b9980619-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "135e00b3-e635-4283-912a-4d92b9980619" (UID: "135e00b3-e635-4283-912a-4d92b9980619"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:50:33 crc kubenswrapper[5120]: I0316 16:50:33.624924 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/135e00b3-e635-4283-912a-4d92b9980619-config-data" (OuterVolumeSpecName: "config-data") pod "135e00b3-e635-4283-912a-4d92b9980619" (UID: "135e00b3-e635-4283-912a-4d92b9980619"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:50:33 crc kubenswrapper[5120]: I0316 16:50:33.645481 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jls7z\" (UniqueName: \"kubernetes.io/projected/135e00b3-e635-4283-912a-4d92b9980619-kube-api-access-jls7z\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:33 crc kubenswrapper[5120]: I0316 16:50:33.645521 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/135e00b3-e635-4283-912a-4d92b9980619-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:33 crc kubenswrapper[5120]: I0316 16:50:33.645532 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/135e00b3-e635-4283-912a-4d92b9980619-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:33 crc kubenswrapper[5120]: I0316 16:50:33.645544 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/135e00b3-e635-4283-912a-4d92b9980619-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:33 crc kubenswrapper[5120]: I0316 16:50:33.645553 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/135e00b3-e635-4283-912a-4d92b9980619-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:33 crc kubenswrapper[5120]: I0316 16:50:33.967083 5120 generic.go:358] "Generic (PLEG): container finished" podID="77fd10d5-5894-450f-bba5-8261c3ca1b4e" containerID="914e787e46b4c31fdd99718734026a273335e75723c3b60d39b1ad2048616920" exitCode=143 Mar 16 16:50:33 crc kubenswrapper[5120]: I0316 16:50:33.967485 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"77fd10d5-5894-450f-bba5-8261c3ca1b4e","Type":"ContainerDied","Data":"914e787e46b4c31fdd99718734026a273335e75723c3b60d39b1ad2048616920"} Mar 16 16:50:33 crc kubenswrapper[5120]: I0316 16:50:33.976244 5120 generic.go:358] "Generic (PLEG): container finished" podID="135e00b3-e635-4283-912a-4d92b9980619" containerID="c53f7e092db576b6e0e10d597a048f947c016b1156713955f8e87ff0ba09916d" exitCode=0 Mar 16 16:50:33 crc kubenswrapper[5120]: I0316 16:50:33.976553 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-744476466-rznwv" event={"ID":"135e00b3-e635-4283-912a-4d92b9980619","Type":"ContainerDied","Data":"c53f7e092db576b6e0e10d597a048f947c016b1156713955f8e87ff0ba09916d"} Mar 16 16:50:33 crc kubenswrapper[5120]: I0316 16:50:33.976597 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-744476466-rznwv" event={"ID":"135e00b3-e635-4283-912a-4d92b9980619","Type":"ContainerDied","Data":"521282fc97e706c2eedba63d9722b73e97a040e5e8f94a15cb21248c0eb7736a"} Mar 16 16:50:33 crc kubenswrapper[5120]: I0316 16:50:33.976617 5120 scope.go:117] "RemoveContainer" containerID="c53f7e092db576b6e0e10d597a048f947c016b1156713955f8e87ff0ba09916d" Mar 16 16:50:33 crc kubenswrapper[5120]: I0316 16:50:33.976819 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-744476466-rznwv" Mar 16 16:50:34 crc kubenswrapper[5120]: I0316 16:50:34.014129 5120 generic.go:358] "Generic (PLEG): container finished" podID="972b647a-3fa9-490c-afdd-4a1f28ca3ded" containerID="003c69850fc1d72a815496932d511bd381c20e583d24d4cdd9ba14a98e115862" exitCode=0 Mar 16 16:50:34 crc kubenswrapper[5120]: I0316 16:50:34.014662 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"972b647a-3fa9-490c-afdd-4a1f28ca3ded","Type":"ContainerDied","Data":"003c69850fc1d72a815496932d511bd381c20e583d24d4cdd9ba14a98e115862"} Mar 16 16:50:34 crc kubenswrapper[5120]: I0316 16:50:34.039470 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="c349c18b-ceb6-4eb9-8f6b-012f5d5e8654" containerName="nova-api-log" containerID="cri-o://738e85f41e17b8e6dfb85b7c1752250faed5553ee17a30e2737756697e76bcf6" gracePeriod=30 Mar 16 16:50:34 crc kubenswrapper[5120]: I0316 16:50:34.039868 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"618db375-cac6-46d6-a08f-28876736a830","Type":"ContainerStarted","Data":"ab80ba76dec4a3675ff982093b1e00458b7271c24416bcba616c2b5a8146daec"} Mar 16 16:50:34 crc kubenswrapper[5120]: I0316 16:50:34.039900 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"618db375-cac6-46d6-a08f-28876736a830","Type":"ContainerStarted","Data":"0ed02e0fd9cf8474d44abb591370f48197ec35833c8c5fa8be0871a07ecbb12e"} Mar 16 16:50:34 crc kubenswrapper[5120]: I0316 16:50:34.039951 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="c349c18b-ceb6-4eb9-8f6b-012f5d5e8654" containerName="nova-api-api" containerID="cri-o://2901ace11bd9e3b5e207d7aa23bc9a560f064adec1bc12b58280084152e5205f" gracePeriod=30 Mar 16 16:50:34 crc kubenswrapper[5120]: I0316 16:50:34.073970 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-744476466-rznwv"] Mar 16 16:50:34 crc kubenswrapper[5120]: I0316 16:50:34.106014 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-744476466-rznwv"] Mar 16 16:50:34 crc kubenswrapper[5120]: I0316 16:50:34.125944 5120 scope.go:117] "RemoveContainer" containerID="8232234c6702e776970ca9018deee4f37ee79888d00739aa240d430b731caae0" Mar 16 16:50:34 crc kubenswrapper[5120]: I0316 16:50:34.165928 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-hj5tn"] Mar 16 16:50:34 crc kubenswrapper[5120]: I0316 16:50:34.174326 5120 scope.go:117] "RemoveContainer" containerID="c53f7e092db576b6e0e10d597a048f947c016b1156713955f8e87ff0ba09916d" Mar 16 16:50:34 crc kubenswrapper[5120]: E0316 16:50:34.184143 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c53f7e092db576b6e0e10d597a048f947c016b1156713955f8e87ff0ba09916d\": container with ID starting with c53f7e092db576b6e0e10d597a048f947c016b1156713955f8e87ff0ba09916d not found: ID does not exist" containerID="c53f7e092db576b6e0e10d597a048f947c016b1156713955f8e87ff0ba09916d" Mar 16 16:50:34 crc kubenswrapper[5120]: I0316 16:50:34.184201 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c53f7e092db576b6e0e10d597a048f947c016b1156713955f8e87ff0ba09916d"} err="failed to get container status \"c53f7e092db576b6e0e10d597a048f947c016b1156713955f8e87ff0ba09916d\": rpc error: code = NotFound desc = could not find container \"c53f7e092db576b6e0e10d597a048f947c016b1156713955f8e87ff0ba09916d\": container with ID starting with c53f7e092db576b6e0e10d597a048f947c016b1156713955f8e87ff0ba09916d not found: ID does not exist" Mar 16 16:50:34 crc kubenswrapper[5120]: I0316 16:50:34.184232 5120 scope.go:117] "RemoveContainer" containerID="8232234c6702e776970ca9018deee4f37ee79888d00739aa240d430b731caae0" Mar 16 16:50:34 crc kubenswrapper[5120]: E0316 16:50:34.194007 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8232234c6702e776970ca9018deee4f37ee79888d00739aa240d430b731caae0\": container with ID starting with 8232234c6702e776970ca9018deee4f37ee79888d00739aa240d430b731caae0 not found: ID does not exist" containerID="8232234c6702e776970ca9018deee4f37ee79888d00739aa240d430b731caae0" Mar 16 16:50:34 crc kubenswrapper[5120]: I0316 16:50:34.194079 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8232234c6702e776970ca9018deee4f37ee79888d00739aa240d430b731caae0"} err="failed to get container status \"8232234c6702e776970ca9018deee4f37ee79888d00739aa240d430b731caae0\": rpc error: code = NotFound desc = could not find container \"8232234c6702e776970ca9018deee4f37ee79888d00739aa240d430b731caae0\": container with ID starting with 8232234c6702e776970ca9018deee4f37ee79888d00739aa240d430b731caae0 not found: ID does not exist" Mar 16 16:50:34 crc kubenswrapper[5120]: I0316 16:50:34.447892 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:50:34 crc kubenswrapper[5120]: I0316 16:50:34.478526 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x9lcl\" (UniqueName: \"kubernetes.io/projected/972b647a-3fa9-490c-afdd-4a1f28ca3ded-kube-api-access-x9lcl\") pod \"972b647a-3fa9-490c-afdd-4a1f28ca3ded\" (UID: \"972b647a-3fa9-490c-afdd-4a1f28ca3ded\") " Mar 16 16:50:34 crc kubenswrapper[5120]: I0316 16:50:34.478835 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/972b647a-3fa9-490c-afdd-4a1f28ca3ded-combined-ca-bundle\") pod \"972b647a-3fa9-490c-afdd-4a1f28ca3ded\" (UID: \"972b647a-3fa9-490c-afdd-4a1f28ca3ded\") " Mar 16 16:50:34 crc kubenswrapper[5120]: I0316 16:50:34.478988 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/972b647a-3fa9-490c-afdd-4a1f28ca3ded-config-data\") pod \"972b647a-3fa9-490c-afdd-4a1f28ca3ded\" (UID: \"972b647a-3fa9-490c-afdd-4a1f28ca3ded\") " Mar 16 16:50:34 crc kubenswrapper[5120]: I0316 16:50:34.523503 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/972b647a-3fa9-490c-afdd-4a1f28ca3ded-kube-api-access-x9lcl" (OuterVolumeSpecName: "kube-api-access-x9lcl") pod "972b647a-3fa9-490c-afdd-4a1f28ca3ded" (UID: "972b647a-3fa9-490c-afdd-4a1f28ca3ded"). InnerVolumeSpecName "kube-api-access-x9lcl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:50:34 crc kubenswrapper[5120]: I0316 16:50:34.528261 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/972b647a-3fa9-490c-afdd-4a1f28ca3ded-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "972b647a-3fa9-490c-afdd-4a1f28ca3ded" (UID: "972b647a-3fa9-490c-afdd-4a1f28ca3ded"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:50:34 crc kubenswrapper[5120]: I0316 16:50:34.533730 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/972b647a-3fa9-490c-afdd-4a1f28ca3ded-config-data" (OuterVolumeSpecName: "config-data") pod "972b647a-3fa9-490c-afdd-4a1f28ca3ded" (UID: "972b647a-3fa9-490c-afdd-4a1f28ca3ded"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:50:34 crc kubenswrapper[5120]: I0316 16:50:34.534151 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:50:34 crc kubenswrapper[5120]: I0316 16:50:34.582390 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/972b647a-3fa9-490c-afdd-4a1f28ca3ded-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:34 crc kubenswrapper[5120]: I0316 16:50:34.582441 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x9lcl\" (UniqueName: \"kubernetes.io/projected/972b647a-3fa9-490c-afdd-4a1f28ca3ded-kube-api-access-x9lcl\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:34 crc kubenswrapper[5120]: I0316 16:50:34.582453 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/972b647a-3fa9-490c-afdd-4a1f28ca3ded-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:34 crc kubenswrapper[5120]: I0316 16:50:34.704263 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="135e00b3-e635-4283-912a-4d92b9980619" path="/var/lib/kubelet/pods/135e00b3-e635-4283-912a-4d92b9980619/volumes" Mar 16 16:50:34 crc kubenswrapper[5120]: I0316 16:50:34.705296 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="580e419d-0472-485f-b809-5a610832d21f" path="/var/lib/kubelet/pods/580e419d-0472-485f-b809-5a610832d21f/volumes" Mar 16 16:50:34 crc kubenswrapper[5120]: I0316 16:50:34.735653 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 16:50:34 crc kubenswrapper[5120]: I0316 16:50:34.735986 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="0fdb1c41-3340-4013-99ea-c36c3891ff92" containerName="nova-cell1-conductor-conductor" containerID="cri-o://e6bcb147e4f0b03e95a2e0f1151e9002f062da54d82588fa24bd8fa862af858b" gracePeriod=30 Mar 16 16:50:34 crc kubenswrapper[5120]: I0316 16:50:34.775651 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:50:34 crc kubenswrapper[5120]: I0316 16:50:34.775949 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podUID="a54c7e34-6cda-4e15-83b3-1ccd2fac7cff" containerName="nova-cell1-novncproxy-novncproxy" containerID="cri-o://d6e7af6dd3189bcd54f1b9651a384fdb614ec07728b05cfef52fd2b0137dcbb8" gracePeriod=30 Mar 16 16:50:35 crc kubenswrapper[5120]: I0316 16:50:35.065975 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:50:35 crc kubenswrapper[5120]: I0316 16:50:35.066456 5120 generic.go:358] "Generic (PLEG): container finished" podID="c349c18b-ceb6-4eb9-8f6b-012f5d5e8654" containerID="738e85f41e17b8e6dfb85b7c1752250faed5553ee17a30e2737756697e76bcf6" exitCode=143 Mar 16 16:50:35 crc kubenswrapper[5120]: I0316 16:50:35.066482 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"c349c18b-ceb6-4eb9-8f6b-012f5d5e8654","Type":"ContainerDied","Data":"738e85f41e17b8e6dfb85b7c1752250faed5553ee17a30e2737756697e76bcf6"} Mar 16 16:50:35 crc kubenswrapper[5120]: I0316 16:50:35.068415 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-6sq2s"] Mar 16 16:50:35 crc kubenswrapper[5120]: I0316 16:50:35.069743 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:50:35 crc kubenswrapper[5120]: I0316 16:50:35.069793 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"972b647a-3fa9-490c-afdd-4a1f28ca3ded","Type":"ContainerDied","Data":"91d74e2e274e80821ace8ed32d26c55f9a0d53c8c830d66c3a98772ea3efac92"} Mar 16 16:50:35 crc kubenswrapper[5120]: I0316 16:50:35.069828 5120 scope.go:117] "RemoveContainer" containerID="003c69850fc1d72a815496932d511bd381c20e583d24d4cdd9ba14a98e115862" Mar 16 16:50:35 crc kubenswrapper[5120]: I0316 16:50:35.078737 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-6sq2s"] Mar 16 16:50:35 crc kubenswrapper[5120]: I0316 16:50:35.080636 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-hj5tn" event={"ID":"dab6fe18-dcd9-476e-a0bc-866bff4864c8","Type":"ContainerStarted","Data":"3fa997bc814940b3b4080dddc58219038b0c096a73b18c1d1e89cd5769c6c049"} Mar 16 16:50:35 crc kubenswrapper[5120]: I0316 16:50:35.080687 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-hj5tn" event={"ID":"dab6fe18-dcd9-476e-a0bc-866bff4864c8","Type":"ContainerStarted","Data":"d489cc7a1b3d61092023c19c436d160d27c60a605755f7161b7a6da2a890132a"} Mar 16 16:50:35 crc kubenswrapper[5120]: I0316 16:50:35.087168 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"618db375-cac6-46d6-a08f-28876736a830","Type":"ContainerStarted","Data":"87f188699035fa3e4f635ee01426488e93891371f8acdae14745402ab43d60a5"} Mar 16 16:50:35 crc kubenswrapper[5120]: I0316 16:50:35.095424 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5jb96\" (UniqueName: \"kubernetes.io/projected/13fec4e9-e645-49ff-a0f7-7a0e82e649bf-kube-api-access-5jb96\") pod \"13fec4e9-e645-49ff-a0f7-7a0e82e649bf\" (UID: \"13fec4e9-e645-49ff-a0f7-7a0e82e649bf\") " Mar 16 16:50:35 crc kubenswrapper[5120]: I0316 16:50:35.095616 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/13fec4e9-e645-49ff-a0f7-7a0e82e649bf-combined-ca-bundle\") pod \"13fec4e9-e645-49ff-a0f7-7a0e82e649bf\" (UID: \"13fec4e9-e645-49ff-a0f7-7a0e82e649bf\") " Mar 16 16:50:35 crc kubenswrapper[5120]: I0316 16:50:35.095677 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/13fec4e9-e645-49ff-a0f7-7a0e82e649bf-config-data\") pod \"13fec4e9-e645-49ff-a0f7-7a0e82e649bf\" (UID: \"13fec4e9-e645-49ff-a0f7-7a0e82e649bf\") " Mar 16 16:50:35 crc kubenswrapper[5120]: I0316 16:50:35.100803 5120 generic.go:358] "Generic (PLEG): container finished" podID="13fec4e9-e645-49ff-a0f7-7a0e82e649bf" containerID="14ffd8fe32173a96d9e6500856342d18ff25578e696684283bc74578e3e1a9ca" exitCode=0 Mar 16 16:50:35 crc kubenswrapper[5120]: I0316 16:50:35.101002 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:50:35 crc kubenswrapper[5120]: I0316 16:50:35.101007 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"13fec4e9-e645-49ff-a0f7-7a0e82e649bf","Type":"ContainerDied","Data":"14ffd8fe32173a96d9e6500856342d18ff25578e696684283bc74578e3e1a9ca"} Mar 16 16:50:35 crc kubenswrapper[5120]: I0316 16:50:35.157431 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13fec4e9-e645-49ff-a0f7-7a0e82e649bf-kube-api-access-5jb96" (OuterVolumeSpecName: "kube-api-access-5jb96") pod "13fec4e9-e645-49ff-a0f7-7a0e82e649bf" (UID: "13fec4e9-e645-49ff-a0f7-7a0e82e649bf"). InnerVolumeSpecName "kube-api-access-5jb96". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:50:35 crc kubenswrapper[5120]: I0316 16:50:35.159127 5120 scope.go:117] "RemoveContainer" containerID="14ffd8fe32173a96d9e6500856342d18ff25578e696684283bc74578e3e1a9ca" Mar 16 16:50:35 crc kubenswrapper[5120]: I0316 16:50:35.170957 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/13fec4e9-e645-49ff-a0f7-7a0e82e649bf-config-data" (OuterVolumeSpecName: "config-data") pod "13fec4e9-e645-49ff-a0f7-7a0e82e649bf" (UID: "13fec4e9-e645-49ff-a0f7-7a0e82e649bf"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:50:35 crc kubenswrapper[5120]: I0316 16:50:35.200942 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/13fec4e9-e645-49ff-a0f7-7a0e82e649bf-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "13fec4e9-e645-49ff-a0f7-7a0e82e649bf" (UID: "13fec4e9-e645-49ff-a0f7-7a0e82e649bf"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:50:35 crc kubenswrapper[5120]: I0316 16:50:35.203023 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/13fec4e9-e645-49ff-a0f7-7a0e82e649bf-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:35 crc kubenswrapper[5120]: I0316 16:50:35.203048 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/13fec4e9-e645-49ff-a0f7-7a0e82e649bf-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:35 crc kubenswrapper[5120]: I0316 16:50:35.203057 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5jb96\" (UniqueName: \"kubernetes.io/projected/13fec4e9-e645-49ff-a0f7-7a0e82e649bf-kube-api-access-5jb96\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:35 crc kubenswrapper[5120]: I0316 16:50:35.216754 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:50:35 crc kubenswrapper[5120]: I0316 16:50:35.227831 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:50:35 crc kubenswrapper[5120]: I0316 16:50:35.233820 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-hj5tn" podStartSLOduration=2.233800867 podStartE2EDuration="2.233800867s" podCreationTimestamp="2026-03-16 16:50:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:50:35.156949309 +0000 UTC m=+4737.310880966" watchObservedRunningTime="2026-03-16 16:50:35.233800867 +0000 UTC m=+4737.387732524" Mar 16 16:50:35 crc kubenswrapper[5120]: I0316 16:50:35.251446 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:50:35 crc kubenswrapper[5120]: I0316 16:50:35.253216 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="135e00b3-e635-4283-912a-4d92b9980619" containerName="placement-log" Mar 16 16:50:35 crc kubenswrapper[5120]: I0316 16:50:35.253325 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="135e00b3-e635-4283-912a-4d92b9980619" containerName="placement-log" Mar 16 16:50:35 crc kubenswrapper[5120]: I0316 16:50:35.253496 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13fec4e9-e645-49ff-a0f7-7a0e82e649bf" containerName="nova-cell0-conductor-conductor" Mar 16 16:50:35 crc kubenswrapper[5120]: I0316 16:50:35.253574 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="13fec4e9-e645-49ff-a0f7-7a0e82e649bf" containerName="nova-cell0-conductor-conductor" Mar 16 16:50:35 crc kubenswrapper[5120]: I0316 16:50:35.253702 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="135e00b3-e635-4283-912a-4d92b9980619" containerName="placement-api" Mar 16 16:50:35 crc kubenswrapper[5120]: I0316 16:50:35.253792 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="135e00b3-e635-4283-912a-4d92b9980619" containerName="placement-api" Mar 16 16:50:35 crc kubenswrapper[5120]: I0316 16:50:35.253871 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="972b647a-3fa9-490c-afdd-4a1f28ca3ded" containerName="nova-scheduler-scheduler" Mar 16 16:50:35 crc kubenswrapper[5120]: I0316 16:50:35.253934 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="972b647a-3fa9-490c-afdd-4a1f28ca3ded" containerName="nova-scheduler-scheduler" Mar 16 16:50:35 crc kubenswrapper[5120]: I0316 16:50:35.254359 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="135e00b3-e635-4283-912a-4d92b9980619" containerName="placement-log" Mar 16 16:50:35 crc kubenswrapper[5120]: I0316 16:50:35.254462 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="13fec4e9-e645-49ff-a0f7-7a0e82e649bf" containerName="nova-cell0-conductor-conductor" Mar 16 16:50:35 crc kubenswrapper[5120]: I0316 16:50:35.254546 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="972b647a-3fa9-490c-afdd-4a1f28ca3ded" containerName="nova-scheduler-scheduler" Mar 16 16:50:35 crc kubenswrapper[5120]: I0316 16:50:35.254631 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="135e00b3-e635-4283-912a-4d92b9980619" containerName="placement-api" Mar 16 16:50:35 crc kubenswrapper[5120]: I0316 16:50:35.259998 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:50:35 crc kubenswrapper[5120]: I0316 16:50:35.260066 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:50:35 crc kubenswrapper[5120]: I0316 16:50:35.263205 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-scheduler-config-data\"" Mar 16 16:50:35 crc kubenswrapper[5120]: I0316 16:50:35.305944 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5cdd3029-6592-4907-9550-54a84c3a8cf0-config-data\") pod \"nova-scheduler-0\" (UID: \"5cdd3029-6592-4907-9550-54a84c3a8cf0\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:50:35 crc kubenswrapper[5120]: I0316 16:50:35.306172 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hz8cs\" (UniqueName: \"kubernetes.io/projected/5cdd3029-6592-4907-9550-54a84c3a8cf0-kube-api-access-hz8cs\") pod \"nova-scheduler-0\" (UID: \"5cdd3029-6592-4907-9550-54a84c3a8cf0\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:50:35 crc kubenswrapper[5120]: I0316 16:50:35.306235 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5cdd3029-6592-4907-9550-54a84c3a8cf0-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"5cdd3029-6592-4907-9550-54a84c3a8cf0\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:50:35 crc kubenswrapper[5120]: I0316 16:50:35.408202 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hz8cs\" (UniqueName: \"kubernetes.io/projected/5cdd3029-6592-4907-9550-54a84c3a8cf0-kube-api-access-hz8cs\") pod \"nova-scheduler-0\" (UID: \"5cdd3029-6592-4907-9550-54a84c3a8cf0\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:50:35 crc kubenswrapper[5120]: I0316 16:50:35.408263 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5cdd3029-6592-4907-9550-54a84c3a8cf0-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"5cdd3029-6592-4907-9550-54a84c3a8cf0\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:50:35 crc kubenswrapper[5120]: I0316 16:50:35.408484 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5cdd3029-6592-4907-9550-54a84c3a8cf0-config-data\") pod \"nova-scheduler-0\" (UID: \"5cdd3029-6592-4907-9550-54a84c3a8cf0\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:50:35 crc kubenswrapper[5120]: I0316 16:50:35.421566 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5cdd3029-6592-4907-9550-54a84c3a8cf0-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"5cdd3029-6592-4907-9550-54a84c3a8cf0\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:50:35 crc kubenswrapper[5120]: I0316 16:50:35.440199 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:50:35 crc kubenswrapper[5120]: I0316 16:50:35.440610 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5cdd3029-6592-4907-9550-54a84c3a8cf0-config-data\") pod \"nova-scheduler-0\" (UID: \"5cdd3029-6592-4907-9550-54a84c3a8cf0\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:50:35 crc kubenswrapper[5120]: I0316 16:50:35.441289 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hz8cs\" (UniqueName: \"kubernetes.io/projected/5cdd3029-6592-4907-9550-54a84c3a8cf0-kube-api-access-hz8cs\") pod \"nova-scheduler-0\" (UID: \"5cdd3029-6592-4907-9550-54a84c3a8cf0\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:50:35 crc kubenswrapper[5120]: I0316 16:50:35.582358 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:50:35 crc kubenswrapper[5120]: I0316 16:50:35.603702 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:50:35 crc kubenswrapper[5120]: I0316 16:50:35.657401 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:50:35 crc kubenswrapper[5120]: I0316 16:50:35.667853 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:50:35 crc kubenswrapper[5120]: I0316 16:50:35.669041 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:50:35 crc kubenswrapper[5120]: I0316 16:50:35.677185 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-conductor-config-data\"" Mar 16 16:50:35 crc kubenswrapper[5120]: I0316 16:50:35.727363 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:50:35 crc kubenswrapper[5120]: I0316 16:50:35.730556 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qq7l\" (UniqueName: \"kubernetes.io/projected/55b29fdd-871f-4603-afd0-b2e13728f594-kube-api-access-5qq7l\") pod \"nova-cell0-conductor-0\" (UID: \"55b29fdd-871f-4603-afd0-b2e13728f594\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:50:35 crc kubenswrapper[5120]: I0316 16:50:35.730867 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/55b29fdd-871f-4603-afd0-b2e13728f594-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"55b29fdd-871f-4603-afd0-b2e13728f594\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:50:35 crc kubenswrapper[5120]: I0316 16:50:35.734701 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/55b29fdd-871f-4603-afd0-b2e13728f594-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"55b29fdd-871f-4603-afd0-b2e13728f594\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:50:35 crc kubenswrapper[5120]: I0316 16:50:35.838684 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/55b29fdd-871f-4603-afd0-b2e13728f594-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"55b29fdd-871f-4603-afd0-b2e13728f594\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:50:35 crc kubenswrapper[5120]: I0316 16:50:35.839253 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5qq7l\" (UniqueName: \"kubernetes.io/projected/55b29fdd-871f-4603-afd0-b2e13728f594-kube-api-access-5qq7l\") pod \"nova-cell0-conductor-0\" (UID: \"55b29fdd-871f-4603-afd0-b2e13728f594\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:50:35 crc kubenswrapper[5120]: I0316 16:50:35.839591 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/55b29fdd-871f-4603-afd0-b2e13728f594-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"55b29fdd-871f-4603-afd0-b2e13728f594\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:50:35 crc kubenswrapper[5120]: I0316 16:50:35.848141 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/55b29fdd-871f-4603-afd0-b2e13728f594-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"55b29fdd-871f-4603-afd0-b2e13728f594\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:50:35 crc kubenswrapper[5120]: I0316 16:50:35.849029 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/55b29fdd-871f-4603-afd0-b2e13728f594-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"55b29fdd-871f-4603-afd0-b2e13728f594\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:50:35 crc kubenswrapper[5120]: I0316 16:50:35.872511 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qq7l\" (UniqueName: \"kubernetes.io/projected/55b29fdd-871f-4603-afd0-b2e13728f594-kube-api-access-5qq7l\") pod \"nova-cell0-conductor-0\" (UID: \"55b29fdd-871f-4603-afd0-b2e13728f594\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:50:35 crc kubenswrapper[5120]: I0316 16:50:35.909277 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:50:35 crc kubenswrapper[5120]: I0316 16:50:35.941564 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6l8ff\" (UniqueName: \"kubernetes.io/projected/a54c7e34-6cda-4e15-83b3-1ccd2fac7cff-kube-api-access-6l8ff\") pod \"a54c7e34-6cda-4e15-83b3-1ccd2fac7cff\" (UID: \"a54c7e34-6cda-4e15-83b3-1ccd2fac7cff\") " Mar 16 16:50:35 crc kubenswrapper[5120]: I0316 16:50:35.941972 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a54c7e34-6cda-4e15-83b3-1ccd2fac7cff-combined-ca-bundle\") pod \"a54c7e34-6cda-4e15-83b3-1ccd2fac7cff\" (UID: \"a54c7e34-6cda-4e15-83b3-1ccd2fac7cff\") " Mar 16 16:50:35 crc kubenswrapper[5120]: I0316 16:50:35.942264 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a54c7e34-6cda-4e15-83b3-1ccd2fac7cff-config-data\") pod \"a54c7e34-6cda-4e15-83b3-1ccd2fac7cff\" (UID: \"a54c7e34-6cda-4e15-83b3-1ccd2fac7cff\") " Mar 16 16:50:35 crc kubenswrapper[5120]: I0316 16:50:35.947456 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a54c7e34-6cda-4e15-83b3-1ccd2fac7cff-kube-api-access-6l8ff" (OuterVolumeSpecName: "kube-api-access-6l8ff") pod "a54c7e34-6cda-4e15-83b3-1ccd2fac7cff" (UID: "a54c7e34-6cda-4e15-83b3-1ccd2fac7cff"). InnerVolumeSpecName "kube-api-access-6l8ff". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:50:35 crc kubenswrapper[5120]: I0316 16:50:35.994332 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a54c7e34-6cda-4e15-83b3-1ccd2fac7cff-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "a54c7e34-6cda-4e15-83b3-1ccd2fac7cff" (UID: "a54c7e34-6cda-4e15-83b3-1ccd2fac7cff"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:50:36 crc kubenswrapper[5120]: I0316 16:50:36.004936 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a54c7e34-6cda-4e15-83b3-1ccd2fac7cff-config-data" (OuterVolumeSpecName: "config-data") pod "a54c7e34-6cda-4e15-83b3-1ccd2fac7cff" (UID: "a54c7e34-6cda-4e15-83b3-1ccd2fac7cff"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:50:36 crc kubenswrapper[5120]: I0316 16:50:36.006381 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:50:36 crc kubenswrapper[5120]: I0316 16:50:36.051544 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a54c7e34-6cda-4e15-83b3-1ccd2fac7cff-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:36 crc kubenswrapper[5120]: I0316 16:50:36.051588 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6l8ff\" (UniqueName: \"kubernetes.io/projected/a54c7e34-6cda-4e15-83b3-1ccd2fac7cff-kube-api-access-6l8ff\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:36 crc kubenswrapper[5120]: I0316 16:50:36.051603 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a54c7e34-6cda-4e15-83b3-1ccd2fac7cff-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:36 crc kubenswrapper[5120]: I0316 16:50:36.136078 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"618db375-cac6-46d6-a08f-28876736a830","Type":"ContainerStarted","Data":"08ba1d8d616e1a4d3481ee141f5cfcd35903c3d5cb87514a7c23d574f47cf0ea"} Mar 16 16:50:36 crc kubenswrapper[5120]: I0316 16:50:36.146796 5120 generic.go:358] "Generic (PLEG): container finished" podID="a54c7e34-6cda-4e15-83b3-1ccd2fac7cff" containerID="d6e7af6dd3189bcd54f1b9651a384fdb614ec07728b05cfef52fd2b0137dcbb8" exitCode=0 Mar 16 16:50:36 crc kubenswrapper[5120]: I0316 16:50:36.146914 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"a54c7e34-6cda-4e15-83b3-1ccd2fac7cff","Type":"ContainerDied","Data":"d6e7af6dd3189bcd54f1b9651a384fdb614ec07728b05cfef52fd2b0137dcbb8"} Mar 16 16:50:36 crc kubenswrapper[5120]: I0316 16:50:36.146941 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"a54c7e34-6cda-4e15-83b3-1ccd2fac7cff","Type":"ContainerDied","Data":"68116beed2f3dc5cde6e9bd25d9fde1a454f2a49596ee141bcf47fa8cd3cd899"} Mar 16 16:50:36 crc kubenswrapper[5120]: I0316 16:50:36.146956 5120 scope.go:117] "RemoveContainer" containerID="d6e7af6dd3189bcd54f1b9651a384fdb614ec07728b05cfef52fd2b0137dcbb8" Mar 16 16:50:36 crc kubenswrapper[5120]: I0316 16:50:36.147116 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:50:36 crc kubenswrapper[5120]: I0316 16:50:36.206738 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:50:36 crc kubenswrapper[5120]: I0316 16:50:36.225468 5120 scope.go:117] "RemoveContainer" containerID="d6e7af6dd3189bcd54f1b9651a384fdb614ec07728b05cfef52fd2b0137dcbb8" Mar 16 16:50:36 crc kubenswrapper[5120]: E0316 16:50:36.230847 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d6e7af6dd3189bcd54f1b9651a384fdb614ec07728b05cfef52fd2b0137dcbb8\": container with ID starting with d6e7af6dd3189bcd54f1b9651a384fdb614ec07728b05cfef52fd2b0137dcbb8 not found: ID does not exist" containerID="d6e7af6dd3189bcd54f1b9651a384fdb614ec07728b05cfef52fd2b0137dcbb8" Mar 16 16:50:36 crc kubenswrapper[5120]: I0316 16:50:36.230900 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6e7af6dd3189bcd54f1b9651a384fdb614ec07728b05cfef52fd2b0137dcbb8"} err="failed to get container status \"d6e7af6dd3189bcd54f1b9651a384fdb614ec07728b05cfef52fd2b0137dcbb8\": rpc error: code = NotFound desc = could not find container \"d6e7af6dd3189bcd54f1b9651a384fdb614ec07728b05cfef52fd2b0137dcbb8\": container with ID starting with d6e7af6dd3189bcd54f1b9651a384fdb614ec07728b05cfef52fd2b0137dcbb8 not found: ID does not exist" Mar 16 16:50:36 crc kubenswrapper[5120]: I0316 16:50:36.230944 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:50:36 crc kubenswrapper[5120]: W0316 16:50:36.246170 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5cdd3029_6592_4907_9550_54a84c3a8cf0.slice/crio-e4b1e44b4a378122faf4462622f97816d1e815735d0d653021a904d2888a2b83 WatchSource:0}: Error finding container e4b1e44b4a378122faf4462622f97816d1e815735d0d653021a904d2888a2b83: Status 404 returned error can't find the container with id e4b1e44b4a378122faf4462622f97816d1e815735d0d653021a904d2888a2b83 Mar 16 16:50:36 crc kubenswrapper[5120]: I0316 16:50:36.248527 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:50:36 crc kubenswrapper[5120]: I0316 16:50:36.265035 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:50:36 crc kubenswrapper[5120]: I0316 16:50:36.266604 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a54c7e34-6cda-4e15-83b3-1ccd2fac7cff" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 16:50:36 crc kubenswrapper[5120]: I0316 16:50:36.266626 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a54c7e34-6cda-4e15-83b3-1ccd2fac7cff" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 16:50:36 crc kubenswrapper[5120]: I0316 16:50:36.266964 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="a54c7e34-6cda-4e15-83b3-1ccd2fac7cff" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 16:50:36 crc kubenswrapper[5120]: I0316 16:50:36.273607 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:50:36 crc kubenswrapper[5120]: I0316 16:50:36.280931 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-novncproxy-config-data\"" Mar 16 16:50:36 crc kubenswrapper[5120]: I0316 16:50:36.282678 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-novncproxy-cell1-vencrypt\"" Mar 16 16:50:36 crc kubenswrapper[5120]: I0316 16:50:36.283010 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-novncproxy-cell1-public-svc\"" Mar 16 16:50:36 crc kubenswrapper[5120]: I0316 16:50:36.289491 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:50:36 crc kubenswrapper[5120]: I0316 16:50:36.372895 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wt6sm\" (UniqueName: \"kubernetes.io/projected/77414d5d-6b19-4bd2-b964-66650dd767e9-kube-api-access-wt6sm\") pod \"nova-cell1-novncproxy-0\" (UID: \"77414d5d-6b19-4bd2-b964-66650dd767e9\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:50:36 crc kubenswrapper[5120]: I0316 16:50:36.373196 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/77414d5d-6b19-4bd2-b964-66650dd767e9-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"77414d5d-6b19-4bd2-b964-66650dd767e9\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:50:36 crc kubenswrapper[5120]: I0316 16:50:36.373404 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/77414d5d-6b19-4bd2-b964-66650dd767e9-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"77414d5d-6b19-4bd2-b964-66650dd767e9\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:50:36 crc kubenswrapper[5120]: I0316 16:50:36.373613 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/77414d5d-6b19-4bd2-b964-66650dd767e9-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"77414d5d-6b19-4bd2-b964-66650dd767e9\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:50:36 crc kubenswrapper[5120]: I0316 16:50:36.373740 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/77414d5d-6b19-4bd2-b964-66650dd767e9-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"77414d5d-6b19-4bd2-b964-66650dd767e9\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:50:36 crc kubenswrapper[5120]: I0316 16:50:36.479204 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wt6sm\" (UniqueName: \"kubernetes.io/projected/77414d5d-6b19-4bd2-b964-66650dd767e9-kube-api-access-wt6sm\") pod \"nova-cell1-novncproxy-0\" (UID: \"77414d5d-6b19-4bd2-b964-66650dd767e9\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:50:36 crc kubenswrapper[5120]: I0316 16:50:36.479521 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/77414d5d-6b19-4bd2-b964-66650dd767e9-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"77414d5d-6b19-4bd2-b964-66650dd767e9\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:50:36 crc kubenswrapper[5120]: I0316 16:50:36.479744 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/77414d5d-6b19-4bd2-b964-66650dd767e9-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"77414d5d-6b19-4bd2-b964-66650dd767e9\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:50:36 crc kubenswrapper[5120]: I0316 16:50:36.479972 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/77414d5d-6b19-4bd2-b964-66650dd767e9-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"77414d5d-6b19-4bd2-b964-66650dd767e9\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:50:36 crc kubenswrapper[5120]: I0316 16:50:36.480055 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/77414d5d-6b19-4bd2-b964-66650dd767e9-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"77414d5d-6b19-4bd2-b964-66650dd767e9\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:50:36 crc kubenswrapper[5120]: I0316 16:50:36.489847 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/77414d5d-6b19-4bd2-b964-66650dd767e9-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"77414d5d-6b19-4bd2-b964-66650dd767e9\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:50:36 crc kubenswrapper[5120]: I0316 16:50:36.489887 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/77414d5d-6b19-4bd2-b964-66650dd767e9-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"77414d5d-6b19-4bd2-b964-66650dd767e9\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:50:36 crc kubenswrapper[5120]: I0316 16:50:36.490664 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/77414d5d-6b19-4bd2-b964-66650dd767e9-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"77414d5d-6b19-4bd2-b964-66650dd767e9\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:50:36 crc kubenswrapper[5120]: I0316 16:50:36.491611 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/77414d5d-6b19-4bd2-b964-66650dd767e9-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"77414d5d-6b19-4bd2-b964-66650dd767e9\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:50:36 crc kubenswrapper[5120]: I0316 16:50:36.508895 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wt6sm\" (UniqueName: \"kubernetes.io/projected/77414d5d-6b19-4bd2-b964-66650dd767e9-kube-api-access-wt6sm\") pod \"nova-cell1-novncproxy-0\" (UID: \"77414d5d-6b19-4bd2-b964-66650dd767e9\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:50:36 crc kubenswrapper[5120]: I0316 16:50:36.579423 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:50:36 crc kubenswrapper[5120]: I0316 16:50:36.674845 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:50:36 crc kubenswrapper[5120]: I0316 16:50:36.692069 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="13fec4e9-e645-49ff-a0f7-7a0e82e649bf" path="/var/lib/kubelet/pods/13fec4e9-e645-49ff-a0f7-7a0e82e649bf/volumes" Mar 16 16:50:36 crc kubenswrapper[5120]: I0316 16:50:36.692676 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="199c0d37-3938-4dff-bc4c-b94e06321673" path="/var/lib/kubelet/pods/199c0d37-3938-4dff-bc4c-b94e06321673/volumes" Mar 16 16:50:36 crc kubenswrapper[5120]: I0316 16:50:36.693231 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="972b647a-3fa9-490c-afdd-4a1f28ca3ded" path="/var/lib/kubelet/pods/972b647a-3fa9-490c-afdd-4a1f28ca3ded/volumes" Mar 16 16:50:36 crc kubenswrapper[5120]: I0316 16:50:36.693699 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a54c7e34-6cda-4e15-83b3-1ccd2fac7cff" path="/var/lib/kubelet/pods/a54c7e34-6cda-4e15-83b3-1ccd2fac7cff/volumes" Mar 16 16:50:36 crc kubenswrapper[5120]: I0316 16:50:36.827162 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:50:36 crc kubenswrapper[5120]: I0316 16:50:36.895576 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/77fd10d5-5894-450f-bba5-8261c3ca1b4e-logs\") pod \"77fd10d5-5894-450f-bba5-8261c3ca1b4e\" (UID: \"77fd10d5-5894-450f-bba5-8261c3ca1b4e\") " Mar 16 16:50:36 crc kubenswrapper[5120]: I0316 16:50:36.896008 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/77fd10d5-5894-450f-bba5-8261c3ca1b4e-combined-ca-bundle\") pod \"77fd10d5-5894-450f-bba5-8261c3ca1b4e\" (UID: \"77fd10d5-5894-450f-bba5-8261c3ca1b4e\") " Mar 16 16:50:36 crc kubenswrapper[5120]: I0316 16:50:36.896037 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6bcjb\" (UniqueName: \"kubernetes.io/projected/77fd10d5-5894-450f-bba5-8261c3ca1b4e-kube-api-access-6bcjb\") pod \"77fd10d5-5894-450f-bba5-8261c3ca1b4e\" (UID: \"77fd10d5-5894-450f-bba5-8261c3ca1b4e\") " Mar 16 16:50:36 crc kubenswrapper[5120]: I0316 16:50:36.896081 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/77fd10d5-5894-450f-bba5-8261c3ca1b4e-config-data\") pod \"77fd10d5-5894-450f-bba5-8261c3ca1b4e\" (UID: \"77fd10d5-5894-450f-bba5-8261c3ca1b4e\") " Mar 16 16:50:36 crc kubenswrapper[5120]: I0316 16:50:36.896133 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77fd10d5-5894-450f-bba5-8261c3ca1b4e-logs" (OuterVolumeSpecName: "logs") pod "77fd10d5-5894-450f-bba5-8261c3ca1b4e" (UID: "77fd10d5-5894-450f-bba5-8261c3ca1b4e"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:50:36 crc kubenswrapper[5120]: I0316 16:50:36.896621 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/77fd10d5-5894-450f-bba5-8261c3ca1b4e-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:36 crc kubenswrapper[5120]: I0316 16:50:36.908961 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77fd10d5-5894-450f-bba5-8261c3ca1b4e-kube-api-access-6bcjb" (OuterVolumeSpecName: "kube-api-access-6bcjb") pod "77fd10d5-5894-450f-bba5-8261c3ca1b4e" (UID: "77fd10d5-5894-450f-bba5-8261c3ca1b4e"). InnerVolumeSpecName "kube-api-access-6bcjb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:50:36 crc kubenswrapper[5120]: I0316 16:50:36.968953 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/77fd10d5-5894-450f-bba5-8261c3ca1b4e-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "77fd10d5-5894-450f-bba5-8261c3ca1b4e" (UID: "77fd10d5-5894-450f-bba5-8261c3ca1b4e"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:50:36 crc kubenswrapper[5120]: I0316 16:50:36.998638 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/77fd10d5-5894-450f-bba5-8261c3ca1b4e-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:36 crc kubenswrapper[5120]: I0316 16:50:36.998683 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6bcjb\" (UniqueName: \"kubernetes.io/projected/77fd10d5-5894-450f-bba5-8261c3ca1b4e-kube-api-access-6bcjb\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:37 crc kubenswrapper[5120]: I0316 16:50:37.000204 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/77fd10d5-5894-450f-bba5-8261c3ca1b4e-config-data" (OuterVolumeSpecName: "config-data") pod "77fd10d5-5894-450f-bba5-8261c3ca1b4e" (UID: "77fd10d5-5894-450f-bba5-8261c3ca1b4e"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:50:37 crc kubenswrapper[5120]: I0316 16:50:37.100827 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/77fd10d5-5894-450f-bba5-8261c3ca1b4e-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:37 crc kubenswrapper[5120]: I0316 16:50:37.182549 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"55b29fdd-871f-4603-afd0-b2e13728f594","Type":"ContainerStarted","Data":"aa03e4da90e39959e9684043c680d3e34939e072ebb3c5c54a4e9e7c897bc0b8"} Mar 16 16:50:37 crc kubenswrapper[5120]: I0316 16:50:37.182594 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"55b29fdd-871f-4603-afd0-b2e13728f594","Type":"ContainerStarted","Data":"34198e76539b7841693e7fc332617a6391aa64da3fe2af7a4cc005ab50b67dc3"} Mar 16 16:50:37 crc kubenswrapper[5120]: I0316 16:50:37.182879 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:50:37 crc kubenswrapper[5120]: I0316 16:50:37.190046 5120 generic.go:358] "Generic (PLEG): container finished" podID="77fd10d5-5894-450f-bba5-8261c3ca1b4e" containerID="e99233f186dadd9cbfe0d387a7a97a27cb4ddc12f00726daadef528e5f4b6948" exitCode=0 Mar 16 16:50:37 crc kubenswrapper[5120]: I0316 16:50:37.190155 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:50:37 crc kubenswrapper[5120]: I0316 16:50:37.190426 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"77fd10d5-5894-450f-bba5-8261c3ca1b4e","Type":"ContainerDied","Data":"e99233f186dadd9cbfe0d387a7a97a27cb4ddc12f00726daadef528e5f4b6948"} Mar 16 16:50:37 crc kubenswrapper[5120]: I0316 16:50:37.190464 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"77fd10d5-5894-450f-bba5-8261c3ca1b4e","Type":"ContainerDied","Data":"844bc8457c6481da76a51e34f1e2d8b7851a01dba9b5f8cf7a34977dbdf5fc77"} Mar 16 16:50:37 crc kubenswrapper[5120]: I0316 16:50:37.190481 5120 scope.go:117] "RemoveContainer" containerID="e99233f186dadd9cbfe0d387a7a97a27cb4ddc12f00726daadef528e5f4b6948" Mar 16 16:50:37 crc kubenswrapper[5120]: I0316 16:50:37.199006 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"5cdd3029-6592-4907-9550-54a84c3a8cf0","Type":"ContainerStarted","Data":"b3efc5cb9d6e81368d13ae721d54c3339ffa4a0c8227b34ea0cd4048bdef31c8"} Mar 16 16:50:37 crc kubenswrapper[5120]: I0316 16:50:37.199057 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"5cdd3029-6592-4907-9550-54a84c3a8cf0","Type":"ContainerStarted","Data":"e4b1e44b4a378122faf4462622f97816d1e815735d0d653021a904d2888a2b83"} Mar 16 16:50:37 crc kubenswrapper[5120]: I0316 16:50:37.223246 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podStartSLOduration=2.223221497 podStartE2EDuration="2.223221497s" podCreationTimestamp="2026-03-16 16:50:35 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:50:37.199147505 +0000 UTC m=+4739.353079182" watchObservedRunningTime="2026-03-16 16:50:37.223221497 +0000 UTC m=+4739.377153174" Mar 16 16:50:37 crc kubenswrapper[5120]: I0316 16:50:37.244604 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:50:37 crc kubenswrapper[5120]: I0316 16:50:37.254045 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-scheduler-0" podStartSLOduration=2.254023292 podStartE2EDuration="2.254023292s" podCreationTimestamp="2026-03-16 16:50:35 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:50:37.2164279 +0000 UTC m=+4739.370359557" watchObservedRunningTime="2026-03-16 16:50:37.254023292 +0000 UTC m=+4739.407954949" Mar 16 16:50:37 crc kubenswrapper[5120]: I0316 16:50:37.262578 5120 scope.go:117] "RemoveContainer" containerID="914e787e46b4c31fdd99718734026a273335e75723c3b60d39b1ad2048616920" Mar 16 16:50:37 crc kubenswrapper[5120]: I0316 16:50:37.652506 5120 scope.go:117] "RemoveContainer" containerID="e99233f186dadd9cbfe0d387a7a97a27cb4ddc12f00726daadef528e5f4b6948" Mar 16 16:50:37 crc kubenswrapper[5120]: E0316 16:50:37.656934 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e99233f186dadd9cbfe0d387a7a97a27cb4ddc12f00726daadef528e5f4b6948\": container with ID starting with e99233f186dadd9cbfe0d387a7a97a27cb4ddc12f00726daadef528e5f4b6948 not found: ID does not exist" containerID="e99233f186dadd9cbfe0d387a7a97a27cb4ddc12f00726daadef528e5f4b6948" Mar 16 16:50:37 crc kubenswrapper[5120]: I0316 16:50:37.657169 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e99233f186dadd9cbfe0d387a7a97a27cb4ddc12f00726daadef528e5f4b6948"} err="failed to get container status \"e99233f186dadd9cbfe0d387a7a97a27cb4ddc12f00726daadef528e5f4b6948\": rpc error: code = NotFound desc = could not find container \"e99233f186dadd9cbfe0d387a7a97a27cb4ddc12f00726daadef528e5f4b6948\": container with ID starting with e99233f186dadd9cbfe0d387a7a97a27cb4ddc12f00726daadef528e5f4b6948 not found: ID does not exist" Mar 16 16:50:37 crc kubenswrapper[5120]: I0316 16:50:37.657249 5120 scope.go:117] "RemoveContainer" containerID="914e787e46b4c31fdd99718734026a273335e75723c3b60d39b1ad2048616920" Mar 16 16:50:37 crc kubenswrapper[5120]: E0316 16:50:37.660228 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"914e787e46b4c31fdd99718734026a273335e75723c3b60d39b1ad2048616920\": container with ID starting with 914e787e46b4c31fdd99718734026a273335e75723c3b60d39b1ad2048616920 not found: ID does not exist" containerID="914e787e46b4c31fdd99718734026a273335e75723c3b60d39b1ad2048616920" Mar 16 16:50:37 crc kubenswrapper[5120]: I0316 16:50:37.660278 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"914e787e46b4c31fdd99718734026a273335e75723c3b60d39b1ad2048616920"} err="failed to get container status \"914e787e46b4c31fdd99718734026a273335e75723c3b60d39b1ad2048616920\": rpc error: code = NotFound desc = could not find container \"914e787e46b4c31fdd99718734026a273335e75723c3b60d39b1ad2048616920\": container with ID starting with 914e787e46b4c31fdd99718734026a273335e75723c3b60d39b1ad2048616920 not found: ID does not exist" Mar 16 16:50:37 crc kubenswrapper[5120]: I0316 16:50:37.699295 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:50:37 crc kubenswrapper[5120]: I0316 16:50:37.723850 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:50:37 crc kubenswrapper[5120]: I0316 16:50:37.745387 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:50:37 crc kubenswrapper[5120]: I0316 16:50:37.750004 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77fd10d5-5894-450f-bba5-8261c3ca1b4e" containerName="nova-metadata-log" Mar 16 16:50:37 crc kubenswrapper[5120]: I0316 16:50:37.750041 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="77fd10d5-5894-450f-bba5-8261c3ca1b4e" containerName="nova-metadata-log" Mar 16 16:50:37 crc kubenswrapper[5120]: I0316 16:50:37.750095 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77fd10d5-5894-450f-bba5-8261c3ca1b4e" containerName="nova-metadata-metadata" Mar 16 16:50:37 crc kubenswrapper[5120]: I0316 16:50:37.750104 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="77fd10d5-5894-450f-bba5-8261c3ca1b4e" containerName="nova-metadata-metadata" Mar 16 16:50:37 crc kubenswrapper[5120]: I0316 16:50:37.750333 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="77fd10d5-5894-450f-bba5-8261c3ca1b4e" containerName="nova-metadata-log" Mar 16 16:50:37 crc kubenswrapper[5120]: I0316 16:50:37.750375 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="77fd10d5-5894-450f-bba5-8261c3ca1b4e" containerName="nova-metadata-metadata" Mar 16 16:50:37 crc kubenswrapper[5120]: I0316 16:50:37.765365 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:50:37 crc kubenswrapper[5120]: I0316 16:50:37.770177 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-metadata-config-data\"" Mar 16 16:50:37 crc kubenswrapper[5120]: I0316 16:50:37.772647 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-metadata-internal-svc\"" Mar 16 16:50:37 crc kubenswrapper[5120]: I0316 16:50:37.793167 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:50:37 crc kubenswrapper[5120]: I0316 16:50:37.843565 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4b6n\" (UniqueName: \"kubernetes.io/projected/570380b9-e6ba-4935-8812-f3e4f48ed53d-kube-api-access-f4b6n\") pod \"nova-metadata-0\" (UID: \"570380b9-e6ba-4935-8812-f3e4f48ed53d\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:50:37 crc kubenswrapper[5120]: I0316 16:50:37.843623 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/570380b9-e6ba-4935-8812-f3e4f48ed53d-logs\") pod \"nova-metadata-0\" (UID: \"570380b9-e6ba-4935-8812-f3e4f48ed53d\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:50:37 crc kubenswrapper[5120]: I0316 16:50:37.843648 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/570380b9-e6ba-4935-8812-f3e4f48ed53d-config-data\") pod \"nova-metadata-0\" (UID: \"570380b9-e6ba-4935-8812-f3e4f48ed53d\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:50:37 crc kubenswrapper[5120]: I0316 16:50:37.843784 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/570380b9-e6ba-4935-8812-f3e4f48ed53d-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"570380b9-e6ba-4935-8812-f3e4f48ed53d\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:50:37 crc kubenswrapper[5120]: I0316 16:50:37.843910 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/570380b9-e6ba-4935-8812-f3e4f48ed53d-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"570380b9-e6ba-4935-8812-f3e4f48ed53d\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:50:37 crc kubenswrapper[5120]: I0316 16:50:37.946238 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/570380b9-e6ba-4935-8812-f3e4f48ed53d-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"570380b9-e6ba-4935-8812-f3e4f48ed53d\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:50:37 crc kubenswrapper[5120]: I0316 16:50:37.946747 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f4b6n\" (UniqueName: \"kubernetes.io/projected/570380b9-e6ba-4935-8812-f3e4f48ed53d-kube-api-access-f4b6n\") pod \"nova-metadata-0\" (UID: \"570380b9-e6ba-4935-8812-f3e4f48ed53d\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:50:37 crc kubenswrapper[5120]: I0316 16:50:37.946835 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/570380b9-e6ba-4935-8812-f3e4f48ed53d-logs\") pod \"nova-metadata-0\" (UID: \"570380b9-e6ba-4935-8812-f3e4f48ed53d\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:50:37 crc kubenswrapper[5120]: I0316 16:50:37.946922 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/570380b9-e6ba-4935-8812-f3e4f48ed53d-config-data\") pod \"nova-metadata-0\" (UID: \"570380b9-e6ba-4935-8812-f3e4f48ed53d\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:50:37 crc kubenswrapper[5120]: I0316 16:50:37.947098 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/570380b9-e6ba-4935-8812-f3e4f48ed53d-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"570380b9-e6ba-4935-8812-f3e4f48ed53d\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:50:37 crc kubenswrapper[5120]: I0316 16:50:37.948111 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/570380b9-e6ba-4935-8812-f3e4f48ed53d-logs\") pod \"nova-metadata-0\" (UID: \"570380b9-e6ba-4935-8812-f3e4f48ed53d\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:50:37 crc kubenswrapper[5120]: I0316 16:50:37.957616 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/570380b9-e6ba-4935-8812-f3e4f48ed53d-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"570380b9-e6ba-4935-8812-f3e4f48ed53d\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:50:37 crc kubenswrapper[5120]: I0316 16:50:37.957692 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/570380b9-e6ba-4935-8812-f3e4f48ed53d-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"570380b9-e6ba-4935-8812-f3e4f48ed53d\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:50:37 crc kubenswrapper[5120]: I0316 16:50:37.960666 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/570380b9-e6ba-4935-8812-f3e4f48ed53d-config-data\") pod \"nova-metadata-0\" (UID: \"570380b9-e6ba-4935-8812-f3e4f48ed53d\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:50:37 crc kubenswrapper[5120]: I0316 16:50:37.973330 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4b6n\" (UniqueName: \"kubernetes.io/projected/570380b9-e6ba-4935-8812-f3e4f48ed53d-kube-api-access-f4b6n\") pod \"nova-metadata-0\" (UID: \"570380b9-e6ba-4935-8812-f3e4f48ed53d\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:50:37 crc kubenswrapper[5120]: I0316 16:50:37.983479 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:50:38 crc kubenswrapper[5120]: I0316 16:50:38.014115 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:50:38 crc kubenswrapper[5120]: I0316 16:50:38.048968 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c349c18b-ceb6-4eb9-8f6b-012f5d5e8654-config-data\") pod \"c349c18b-ceb6-4eb9-8f6b-012f5d5e8654\" (UID: \"c349c18b-ceb6-4eb9-8f6b-012f5d5e8654\") " Mar 16 16:50:38 crc kubenswrapper[5120]: I0316 16:50:38.049604 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6vs29\" (UniqueName: \"kubernetes.io/projected/c349c18b-ceb6-4eb9-8f6b-012f5d5e8654-kube-api-access-6vs29\") pod \"c349c18b-ceb6-4eb9-8f6b-012f5d5e8654\" (UID: \"c349c18b-ceb6-4eb9-8f6b-012f5d5e8654\") " Mar 16 16:50:38 crc kubenswrapper[5120]: I0316 16:50:38.049895 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c349c18b-ceb6-4eb9-8f6b-012f5d5e8654-combined-ca-bundle\") pod \"c349c18b-ceb6-4eb9-8f6b-012f5d5e8654\" (UID: \"c349c18b-ceb6-4eb9-8f6b-012f5d5e8654\") " Mar 16 16:50:38 crc kubenswrapper[5120]: I0316 16:50:38.050070 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c349c18b-ceb6-4eb9-8f6b-012f5d5e8654-logs\") pod \"c349c18b-ceb6-4eb9-8f6b-012f5d5e8654\" (UID: \"c349c18b-ceb6-4eb9-8f6b-012f5d5e8654\") " Mar 16 16:50:38 crc kubenswrapper[5120]: I0316 16:50:38.052286 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/keystone-74597bb8cb-kbqx7" Mar 16 16:50:38 crc kubenswrapper[5120]: I0316 16:50:38.053310 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c349c18b-ceb6-4eb9-8f6b-012f5d5e8654-logs" (OuterVolumeSpecName: "logs") pod "c349c18b-ceb6-4eb9-8f6b-012f5d5e8654" (UID: "c349c18b-ceb6-4eb9-8f6b-012f5d5e8654"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:50:38 crc kubenswrapper[5120]: I0316 16:50:38.074211 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c349c18b-ceb6-4eb9-8f6b-012f5d5e8654-kube-api-access-6vs29" (OuterVolumeSpecName: "kube-api-access-6vs29") pod "c349c18b-ceb6-4eb9-8f6b-012f5d5e8654" (UID: "c349c18b-ceb6-4eb9-8f6b-012f5d5e8654"). InnerVolumeSpecName "kube-api-access-6vs29". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:50:38 crc kubenswrapper[5120]: I0316 16:50:38.108443 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c349c18b-ceb6-4eb9-8f6b-012f5d5e8654-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "c349c18b-ceb6-4eb9-8f6b-012f5d5e8654" (UID: "c349c18b-ceb6-4eb9-8f6b-012f5d5e8654"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:50:38 crc kubenswrapper[5120]: I0316 16:50:38.115217 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:50:38 crc kubenswrapper[5120]: I0316 16:50:38.154293 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6vs29\" (UniqueName: \"kubernetes.io/projected/c349c18b-ceb6-4eb9-8f6b-012f5d5e8654-kube-api-access-6vs29\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:38 crc kubenswrapper[5120]: I0316 16:50:38.154332 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c349c18b-ceb6-4eb9-8f6b-012f5d5e8654-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:38 crc kubenswrapper[5120]: I0316 16:50:38.154345 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c349c18b-ceb6-4eb9-8f6b-012f5d5e8654-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:38 crc kubenswrapper[5120]: I0316 16:50:38.215864 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c349c18b-ceb6-4eb9-8f6b-012f5d5e8654-config-data" (OuterVolumeSpecName: "config-data") pod "c349c18b-ceb6-4eb9-8f6b-012f5d5e8654" (UID: "c349c18b-ceb6-4eb9-8f6b-012f5d5e8654"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:50:38 crc kubenswrapper[5120]: I0316 16:50:38.260482 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c349c18b-ceb6-4eb9-8f6b-012f5d5e8654-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:38 crc kubenswrapper[5120]: I0316 16:50:38.281664 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-5c4b57cb66-89p9b"] Mar 16 16:50:38 crc kubenswrapper[5120]: I0316 16:50:38.282146 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/keystone-5c4b57cb66-89p9b" podUID="3b5c836c-a676-4484-a577-057899847899" containerName="keystone-api" containerID="cri-o://2229358481ea699ecdeddc39c36ff43b5623e1e57e408300ca16a94f93846517" gracePeriod=30 Mar 16 16:50:38 crc kubenswrapper[5120]: I0316 16:50:38.346687 5120 generic.go:358] "Generic (PLEG): container finished" podID="0fdb1c41-3340-4013-99ea-c36c3891ff92" containerID="e6bcb147e4f0b03e95a2e0f1151e9002f062da54d82588fa24bd8fa862af858b" exitCode=0 Mar 16 16:50:38 crc kubenswrapper[5120]: I0316 16:50:38.346842 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"0fdb1c41-3340-4013-99ea-c36c3891ff92","Type":"ContainerDied","Data":"e6bcb147e4f0b03e95a2e0f1151e9002f062da54d82588fa24bd8fa862af858b"} Mar 16 16:50:38 crc kubenswrapper[5120]: I0316 16:50:38.395936 5120 generic.go:358] "Generic (PLEG): container finished" podID="c349c18b-ceb6-4eb9-8f6b-012f5d5e8654" containerID="2901ace11bd9e3b5e207d7aa23bc9a560f064adec1bc12b58280084152e5205f" exitCode=0 Mar 16 16:50:38 crc kubenswrapper[5120]: I0316 16:50:38.396082 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"c349c18b-ceb6-4eb9-8f6b-012f5d5e8654","Type":"ContainerDied","Data":"2901ace11bd9e3b5e207d7aa23bc9a560f064adec1bc12b58280084152e5205f"} Mar 16 16:50:38 crc kubenswrapper[5120]: I0316 16:50:38.396111 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"c349c18b-ceb6-4eb9-8f6b-012f5d5e8654","Type":"ContainerDied","Data":"f0716716f06f3789fa696bb4bf20a61494ab5610bcf1842e1fb304632336b785"} Mar 16 16:50:38 crc kubenswrapper[5120]: I0316 16:50:38.396127 5120 scope.go:117] "RemoveContainer" containerID="2901ace11bd9e3b5e207d7aa23bc9a560f064adec1bc12b58280084152e5205f" Mar 16 16:50:38 crc kubenswrapper[5120]: I0316 16:50:38.396273 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:50:38 crc kubenswrapper[5120]: E0316 16:50:38.415102 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of e6bcb147e4f0b03e95a2e0f1151e9002f062da54d82588fa24bd8fa862af858b is running failed: container process not found" containerID="e6bcb147e4f0b03e95a2e0f1151e9002f062da54d82588fa24bd8fa862af858b" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:50:38 crc kubenswrapper[5120]: E0316 16:50:38.417332 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of e6bcb147e4f0b03e95a2e0f1151e9002f062da54d82588fa24bd8fa862af858b is running failed: container process not found" containerID="e6bcb147e4f0b03e95a2e0f1151e9002f062da54d82588fa24bd8fa862af858b" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:50:38 crc kubenswrapper[5120]: E0316 16:50:38.417824 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of e6bcb147e4f0b03e95a2e0f1151e9002f062da54d82588fa24bd8fa862af858b is running failed: container process not found" containerID="e6bcb147e4f0b03e95a2e0f1151e9002f062da54d82588fa24bd8fa862af858b" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:50:38 crc kubenswrapper[5120]: E0316 16:50:38.417866 5120 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of e6bcb147e4f0b03e95a2e0f1151e9002f062da54d82588fa24bd8fa862af858b is running failed: container process not found" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="0fdb1c41-3340-4013-99ea-c36c3891ff92" containerName="nova-cell1-conductor-conductor" probeResult="unknown" Mar 16 16:50:38 crc kubenswrapper[5120]: I0316 16:50:38.417981 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"77414d5d-6b19-4bd2-b964-66650dd767e9","Type":"ContainerStarted","Data":"dc440801bbbe91fcc8b94aa7c5ee5ff1fd954b01d0f25becddbd192c10a6b61a"} Mar 16 16:50:38 crc kubenswrapper[5120]: I0316 16:50:38.418085 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"77414d5d-6b19-4bd2-b964-66650dd767e9","Type":"ContainerStarted","Data":"610568e147ff5f71ce70eff3d7ddd8589da2c14f0afbd846ac64380aba032351"} Mar 16 16:50:38 crc kubenswrapper[5120]: I0316 16:50:38.453291 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podStartSLOduration=2.453265692 podStartE2EDuration="2.453265692s" podCreationTimestamp="2026-03-16 16:50:36 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:50:38.44442504 +0000 UTC m=+4740.598356697" watchObservedRunningTime="2026-03-16 16:50:38.453265692 +0000 UTC m=+4740.607197349" Mar 16 16:50:38 crc kubenswrapper[5120]: I0316 16:50:38.472367 5120 scope.go:117] "RemoveContainer" containerID="738e85f41e17b8e6dfb85b7c1752250faed5553ee17a30e2737756697e76bcf6" Mar 16 16:50:38 crc kubenswrapper[5120]: I0316 16:50:38.509420 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:50:38 crc kubenswrapper[5120]: I0316 16:50:38.535830 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:50:38 crc kubenswrapper[5120]: I0316 16:50:38.539102 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:50:38 crc kubenswrapper[5120]: I0316 16:50:38.540392 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c349c18b-ceb6-4eb9-8f6b-012f5d5e8654" containerName="nova-api-log" Mar 16 16:50:38 crc kubenswrapper[5120]: I0316 16:50:38.540408 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c349c18b-ceb6-4eb9-8f6b-012f5d5e8654" containerName="nova-api-log" Mar 16 16:50:38 crc kubenswrapper[5120]: I0316 16:50:38.540436 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c349c18b-ceb6-4eb9-8f6b-012f5d5e8654" containerName="nova-api-api" Mar 16 16:50:38 crc kubenswrapper[5120]: I0316 16:50:38.540442 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c349c18b-ceb6-4eb9-8f6b-012f5d5e8654" containerName="nova-api-api" Mar 16 16:50:38 crc kubenswrapper[5120]: I0316 16:50:38.540629 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c349c18b-ceb6-4eb9-8f6b-012f5d5e8654" containerName="nova-api-api" Mar 16 16:50:38 crc kubenswrapper[5120]: I0316 16:50:38.540653 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c349c18b-ceb6-4eb9-8f6b-012f5d5e8654" containerName="nova-api-log" Mar 16 16:50:38 crc kubenswrapper[5120]: I0316 16:50:38.549485 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:50:38 crc kubenswrapper[5120]: I0316 16:50:38.551058 5120 scope.go:117] "RemoveContainer" containerID="2901ace11bd9e3b5e207d7aa23bc9a560f064adec1bc12b58280084152e5205f" Mar 16 16:50:38 crc kubenswrapper[5120]: E0316 16:50:38.551989 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2901ace11bd9e3b5e207d7aa23bc9a560f064adec1bc12b58280084152e5205f\": container with ID starting with 2901ace11bd9e3b5e207d7aa23bc9a560f064adec1bc12b58280084152e5205f not found: ID does not exist" containerID="2901ace11bd9e3b5e207d7aa23bc9a560f064adec1bc12b58280084152e5205f" Mar 16 16:50:38 crc kubenswrapper[5120]: I0316 16:50:38.552023 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2901ace11bd9e3b5e207d7aa23bc9a560f064adec1bc12b58280084152e5205f"} err="failed to get container status \"2901ace11bd9e3b5e207d7aa23bc9a560f064adec1bc12b58280084152e5205f\": rpc error: code = NotFound desc = could not find container \"2901ace11bd9e3b5e207d7aa23bc9a560f064adec1bc12b58280084152e5205f\": container with ID starting with 2901ace11bd9e3b5e207d7aa23bc9a560f064adec1bc12b58280084152e5205f not found: ID does not exist" Mar 16 16:50:38 crc kubenswrapper[5120]: I0316 16:50:38.552044 5120 scope.go:117] "RemoveContainer" containerID="738e85f41e17b8e6dfb85b7c1752250faed5553ee17a30e2737756697e76bcf6" Mar 16 16:50:38 crc kubenswrapper[5120]: E0316 16:50:38.553081 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"738e85f41e17b8e6dfb85b7c1752250faed5553ee17a30e2737756697e76bcf6\": container with ID starting with 738e85f41e17b8e6dfb85b7c1752250faed5553ee17a30e2737756697e76bcf6 not found: ID does not exist" containerID="738e85f41e17b8e6dfb85b7c1752250faed5553ee17a30e2737756697e76bcf6" Mar 16 16:50:38 crc kubenswrapper[5120]: I0316 16:50:38.553144 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"738e85f41e17b8e6dfb85b7c1752250faed5553ee17a30e2737756697e76bcf6"} err="failed to get container status \"738e85f41e17b8e6dfb85b7c1752250faed5553ee17a30e2737756697e76bcf6\": rpc error: code = NotFound desc = could not find container \"738e85f41e17b8e6dfb85b7c1752250faed5553ee17a30e2737756697e76bcf6\": container with ID starting with 738e85f41e17b8e6dfb85b7c1752250faed5553ee17a30e2737756697e76bcf6 not found: ID does not exist" Mar 16 16:50:38 crc kubenswrapper[5120]: I0316 16:50:38.554624 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-config-data\"" Mar 16 16:50:38 crc kubenswrapper[5120]: I0316 16:50:38.558984 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-internal-svc\"" Mar 16 16:50:38 crc kubenswrapper[5120]: I0316 16:50:38.559641 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-public-svc\"" Mar 16 16:50:38 crc kubenswrapper[5120]: I0316 16:50:38.582779 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/d6889bc6-32bf-4828-ad98-2f08730fddd6-internal-tls-certs\") pod \"nova-api-0\" (UID: \"d6889bc6-32bf-4828-ad98-2f08730fddd6\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:50:38 crc kubenswrapper[5120]: I0316 16:50:38.582935 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d6889bc6-32bf-4828-ad98-2f08730fddd6-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"d6889bc6-32bf-4828-ad98-2f08730fddd6\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:50:38 crc kubenswrapper[5120]: I0316 16:50:38.583118 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d6889bc6-32bf-4828-ad98-2f08730fddd6-logs\") pod \"nova-api-0\" (UID: \"d6889bc6-32bf-4828-ad98-2f08730fddd6\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:50:38 crc kubenswrapper[5120]: I0316 16:50:38.583238 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d6889bc6-32bf-4828-ad98-2f08730fddd6-config-data\") pod \"nova-api-0\" (UID: \"d6889bc6-32bf-4828-ad98-2f08730fddd6\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:50:38 crc kubenswrapper[5120]: I0316 16:50:38.583296 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c54tn\" (UniqueName: \"kubernetes.io/projected/d6889bc6-32bf-4828-ad98-2f08730fddd6-kube-api-access-c54tn\") pod \"nova-api-0\" (UID: \"d6889bc6-32bf-4828-ad98-2f08730fddd6\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:50:38 crc kubenswrapper[5120]: I0316 16:50:38.583380 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/d6889bc6-32bf-4828-ad98-2f08730fddd6-public-tls-certs\") pod \"nova-api-0\" (UID: \"d6889bc6-32bf-4828-ad98-2f08730fddd6\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:50:38 crc kubenswrapper[5120]: I0316 16:50:38.593707 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:50:38 crc kubenswrapper[5120]: I0316 16:50:38.691504 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d6889bc6-32bf-4828-ad98-2f08730fddd6-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"d6889bc6-32bf-4828-ad98-2f08730fddd6\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:50:38 crc kubenswrapper[5120]: I0316 16:50:38.691727 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d6889bc6-32bf-4828-ad98-2f08730fddd6-logs\") pod \"nova-api-0\" (UID: \"d6889bc6-32bf-4828-ad98-2f08730fddd6\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:50:38 crc kubenswrapper[5120]: I0316 16:50:38.691896 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d6889bc6-32bf-4828-ad98-2f08730fddd6-config-data\") pod \"nova-api-0\" (UID: \"d6889bc6-32bf-4828-ad98-2f08730fddd6\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:50:38 crc kubenswrapper[5120]: I0316 16:50:38.691961 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c54tn\" (UniqueName: \"kubernetes.io/projected/d6889bc6-32bf-4828-ad98-2f08730fddd6-kube-api-access-c54tn\") pod \"nova-api-0\" (UID: \"d6889bc6-32bf-4828-ad98-2f08730fddd6\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:50:38 crc kubenswrapper[5120]: I0316 16:50:38.692043 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/d6889bc6-32bf-4828-ad98-2f08730fddd6-public-tls-certs\") pod \"nova-api-0\" (UID: \"d6889bc6-32bf-4828-ad98-2f08730fddd6\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:50:38 crc kubenswrapper[5120]: I0316 16:50:38.692272 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/d6889bc6-32bf-4828-ad98-2f08730fddd6-internal-tls-certs\") pod \"nova-api-0\" (UID: \"d6889bc6-32bf-4828-ad98-2f08730fddd6\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:50:38 crc kubenswrapper[5120]: I0316 16:50:38.696839 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d6889bc6-32bf-4828-ad98-2f08730fddd6-logs\") pod \"nova-api-0\" (UID: \"d6889bc6-32bf-4828-ad98-2f08730fddd6\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:50:38 crc kubenswrapper[5120]: I0316 16:50:38.697947 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d6889bc6-32bf-4828-ad98-2f08730fddd6-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"d6889bc6-32bf-4828-ad98-2f08730fddd6\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:50:38 crc kubenswrapper[5120]: I0316 16:50:38.701163 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-internal-svc\"" Mar 16 16:50:38 crc kubenswrapper[5120]: I0316 16:50:38.704485 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-config-data\"" Mar 16 16:50:38 crc kubenswrapper[5120]: I0316 16:50:38.704818 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-public-svc\"" Mar 16 16:50:38 crc kubenswrapper[5120]: I0316 16:50:38.709895 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="77fd10d5-5894-450f-bba5-8261c3ca1b4e" path="/var/lib/kubelet/pods/77fd10d5-5894-450f-bba5-8261c3ca1b4e/volumes" Mar 16 16:50:38 crc kubenswrapper[5120]: I0316 16:50:38.713821 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c349c18b-ceb6-4eb9-8f6b-012f5d5e8654" path="/var/lib/kubelet/pods/c349c18b-ceb6-4eb9-8f6b-012f5d5e8654/volumes" Mar 16 16:50:38 crc kubenswrapper[5120]: I0316 16:50:38.713969 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/d6889bc6-32bf-4828-ad98-2f08730fddd6-public-tls-certs\") pod \"nova-api-0\" (UID: \"d6889bc6-32bf-4828-ad98-2f08730fddd6\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:50:38 crc kubenswrapper[5120]: I0316 16:50:38.714322 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/d6889bc6-32bf-4828-ad98-2f08730fddd6-internal-tls-certs\") pod \"nova-api-0\" (UID: \"d6889bc6-32bf-4828-ad98-2f08730fddd6\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:50:38 crc kubenswrapper[5120]: I0316 16:50:38.719504 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d6889bc6-32bf-4828-ad98-2f08730fddd6-config-data\") pod \"nova-api-0\" (UID: \"d6889bc6-32bf-4828-ad98-2f08730fddd6\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:50:38 crc kubenswrapper[5120]: I0316 16:50:38.730368 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c54tn\" (UniqueName: \"kubernetes.io/projected/d6889bc6-32bf-4828-ad98-2f08730fddd6-kube-api-access-c54tn\") pod \"nova-api-0\" (UID: \"d6889bc6-32bf-4828-ad98-2f08730fddd6\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:50:38 crc kubenswrapper[5120]: I0316 16:50:38.887657 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:50:38 crc kubenswrapper[5120]: I0316 16:50:38.894032 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:50:38 crc kubenswrapper[5120]: I0316 16:50:38.923218 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:50:39 crc kubenswrapper[5120]: I0316 16:50:39.009221 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0fdb1c41-3340-4013-99ea-c36c3891ff92-config-data\") pod \"0fdb1c41-3340-4013-99ea-c36c3891ff92\" (UID: \"0fdb1c41-3340-4013-99ea-c36c3891ff92\") " Mar 16 16:50:39 crc kubenswrapper[5120]: I0316 16:50:39.009600 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xgzmk\" (UniqueName: \"kubernetes.io/projected/0fdb1c41-3340-4013-99ea-c36c3891ff92-kube-api-access-xgzmk\") pod \"0fdb1c41-3340-4013-99ea-c36c3891ff92\" (UID: \"0fdb1c41-3340-4013-99ea-c36c3891ff92\") " Mar 16 16:50:39 crc kubenswrapper[5120]: I0316 16:50:39.009713 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0fdb1c41-3340-4013-99ea-c36c3891ff92-combined-ca-bundle\") pod \"0fdb1c41-3340-4013-99ea-c36c3891ff92\" (UID: \"0fdb1c41-3340-4013-99ea-c36c3891ff92\") " Mar 16 16:50:39 crc kubenswrapper[5120]: I0316 16:50:39.032508 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0fdb1c41-3340-4013-99ea-c36c3891ff92-kube-api-access-xgzmk" (OuterVolumeSpecName: "kube-api-access-xgzmk") pod "0fdb1c41-3340-4013-99ea-c36c3891ff92" (UID: "0fdb1c41-3340-4013-99ea-c36c3891ff92"). InnerVolumeSpecName "kube-api-access-xgzmk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:50:39 crc kubenswrapper[5120]: I0316 16:50:39.079148 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0fdb1c41-3340-4013-99ea-c36c3891ff92-config-data" (OuterVolumeSpecName: "config-data") pod "0fdb1c41-3340-4013-99ea-c36c3891ff92" (UID: "0fdb1c41-3340-4013-99ea-c36c3891ff92"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:50:39 crc kubenswrapper[5120]: I0316 16:50:39.104619 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0fdb1c41-3340-4013-99ea-c36c3891ff92-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "0fdb1c41-3340-4013-99ea-c36c3891ff92" (UID: "0fdb1c41-3340-4013-99ea-c36c3891ff92"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:50:39 crc kubenswrapper[5120]: I0316 16:50:39.113371 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0fdb1c41-3340-4013-99ea-c36c3891ff92-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:39 crc kubenswrapper[5120]: I0316 16:50:39.113435 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xgzmk\" (UniqueName: \"kubernetes.io/projected/0fdb1c41-3340-4013-99ea-c36c3891ff92-kube-api-access-xgzmk\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:39 crc kubenswrapper[5120]: I0316 16:50:39.113445 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0fdb1c41-3340-4013-99ea-c36c3891ff92-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:39 crc kubenswrapper[5120]: I0316 16:50:39.452337 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"618db375-cac6-46d6-a08f-28876736a830","Type":"ContainerStarted","Data":"b94076ad923a3199dde422501504a0aa5fb6fab8335e5f33ec2625a0715ed02b"} Mar 16 16:50:39 crc kubenswrapper[5120]: I0316 16:50:39.452947 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:50:39 crc kubenswrapper[5120]: I0316 16:50:39.462359 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"0fdb1c41-3340-4013-99ea-c36c3891ff92","Type":"ContainerDied","Data":"9d4272fa4dc2f3763e756aee01190f84f865c3d367ea1207eace6a36796f6fcc"} Mar 16 16:50:39 crc kubenswrapper[5120]: I0316 16:50:39.462424 5120 scope.go:117] "RemoveContainer" containerID="e6bcb147e4f0b03e95a2e0f1151e9002f062da54d82588fa24bd8fa862af858b" Mar 16 16:50:39 crc kubenswrapper[5120]: I0316 16:50:39.462593 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:50:39 crc kubenswrapper[5120]: I0316 16:50:39.481288 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"570380b9-e6ba-4935-8812-f3e4f48ed53d","Type":"ContainerStarted","Data":"5a4f662960a10d972cf348528756aa6eec9a1bd75a99f3b3a6a9c26d3247fb09"} Mar 16 16:50:39 crc kubenswrapper[5120]: I0316 16:50:39.481383 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"570380b9-e6ba-4935-8812-f3e4f48ed53d","Type":"ContainerStarted","Data":"dd5b42f6649241e8db1cd79ac797a47039bdf1a9d11633fbc9ea739874f5d498"} Mar 16 16:50:39 crc kubenswrapper[5120]: I0316 16:50:39.486391 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.830269462 podStartE2EDuration="8.486372115s" podCreationTimestamp="2026-03-16 16:50:31 +0000 UTC" firstStartedPulling="2026-03-16 16:50:32.983897422 +0000 UTC m=+4735.137829069" lastFinishedPulling="2026-03-16 16:50:38.640000055 +0000 UTC m=+4740.793931722" observedRunningTime="2026-03-16 16:50:39.481834421 +0000 UTC m=+4741.635766088" watchObservedRunningTime="2026-03-16 16:50:39.486372115 +0000 UTC m=+4741.640303772" Mar 16 16:50:39 crc kubenswrapper[5120]: I0316 16:50:39.551830 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 16:50:39 crc kubenswrapper[5120]: I0316 16:50:39.561801 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 16:50:39 crc kubenswrapper[5120]: I0316 16:50:39.575996 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:50:39 crc kubenswrapper[5120]: I0316 16:50:39.617292 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 16:50:39 crc kubenswrapper[5120]: I0316 16:50:39.618932 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0fdb1c41-3340-4013-99ea-c36c3891ff92" containerName="nova-cell1-conductor-conductor" Mar 16 16:50:39 crc kubenswrapper[5120]: I0316 16:50:39.618962 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="0fdb1c41-3340-4013-99ea-c36c3891ff92" containerName="nova-cell1-conductor-conductor" Mar 16 16:50:39 crc kubenswrapper[5120]: I0316 16:50:39.619210 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="0fdb1c41-3340-4013-99ea-c36c3891ff92" containerName="nova-cell1-conductor-conductor" Mar 16 16:50:39 crc kubenswrapper[5120]: I0316 16:50:39.630926 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:50:39 crc kubenswrapper[5120]: I0316 16:50:39.636306 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-conductor-config-data\"" Mar 16 16:50:39 crc kubenswrapper[5120]: I0316 16:50:39.637868 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 16:50:39 crc kubenswrapper[5120]: I0316 16:50:39.741377 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zb7w\" (UniqueName: \"kubernetes.io/projected/eb90a8d0-f858-47b0-9aa6-f71216c2dbf3-kube-api-access-6zb7w\") pod \"nova-cell1-conductor-0\" (UID: \"eb90a8d0-f858-47b0-9aa6-f71216c2dbf3\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:50:39 crc kubenswrapper[5120]: I0316 16:50:39.741669 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eb90a8d0-f858-47b0-9aa6-f71216c2dbf3-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"eb90a8d0-f858-47b0-9aa6-f71216c2dbf3\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:50:39 crc kubenswrapper[5120]: I0316 16:50:39.742213 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/eb90a8d0-f858-47b0-9aa6-f71216c2dbf3-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"eb90a8d0-f858-47b0-9aa6-f71216c2dbf3\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:50:39 crc kubenswrapper[5120]: I0316 16:50:39.844892 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/eb90a8d0-f858-47b0-9aa6-f71216c2dbf3-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"eb90a8d0-f858-47b0-9aa6-f71216c2dbf3\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:50:39 crc kubenswrapper[5120]: I0316 16:50:39.845037 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6zb7w\" (UniqueName: \"kubernetes.io/projected/eb90a8d0-f858-47b0-9aa6-f71216c2dbf3-kube-api-access-6zb7w\") pod \"nova-cell1-conductor-0\" (UID: \"eb90a8d0-f858-47b0-9aa6-f71216c2dbf3\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:50:39 crc kubenswrapper[5120]: I0316 16:50:39.845168 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eb90a8d0-f858-47b0-9aa6-f71216c2dbf3-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"eb90a8d0-f858-47b0-9aa6-f71216c2dbf3\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:50:39 crc kubenswrapper[5120]: I0316 16:50:39.849405 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/eb90a8d0-f858-47b0-9aa6-f71216c2dbf3-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"eb90a8d0-f858-47b0-9aa6-f71216c2dbf3\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:50:39 crc kubenswrapper[5120]: I0316 16:50:39.868413 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zb7w\" (UniqueName: \"kubernetes.io/projected/eb90a8d0-f858-47b0-9aa6-f71216c2dbf3-kube-api-access-6zb7w\") pod \"nova-cell1-conductor-0\" (UID: \"eb90a8d0-f858-47b0-9aa6-f71216c2dbf3\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:50:39 crc kubenswrapper[5120]: I0316 16:50:39.883485 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eb90a8d0-f858-47b0-9aa6-f71216c2dbf3-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"eb90a8d0-f858-47b0-9aa6-f71216c2dbf3\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:50:39 crc kubenswrapper[5120]: I0316 16:50:39.958871 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:50:40 crc kubenswrapper[5120]: I0316 16:50:40.337886 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 16:50:40 crc kubenswrapper[5120]: I0316 16:50:40.518858 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"d6889bc6-32bf-4828-ad98-2f08730fddd6","Type":"ContainerStarted","Data":"6b0e2fd6c626189d757f28b2efb62f642e0b7739467fc756b9941b1ea3f4083f"} Mar 16 16:50:40 crc kubenswrapper[5120]: I0316 16:50:40.519051 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"d6889bc6-32bf-4828-ad98-2f08730fddd6","Type":"ContainerStarted","Data":"ce6c08f074bcf140005337a7f227c6661b14e776f29aa838494adeeae8b544e7"} Mar 16 16:50:40 crc kubenswrapper[5120]: I0316 16:50:40.519072 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"d6889bc6-32bf-4828-ad98-2f08730fddd6","Type":"ContainerStarted","Data":"642afc1ea05ce3c87232f51de3db930b7dfe93f08bc4c402ceba39243e9cb88e"} Mar 16 16:50:40 crc kubenswrapper[5120]: I0316 16:50:40.552269 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"570380b9-e6ba-4935-8812-f3e4f48ed53d","Type":"ContainerStarted","Data":"f3141fcba3521a0f7ffcaf6761a3132cc55165b6f019eac2e30363057409d511"} Mar 16 16:50:40 crc kubenswrapper[5120]: I0316 16:50:40.562800 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"eb90a8d0-f858-47b0-9aa6-f71216c2dbf3","Type":"ContainerStarted","Data":"90c5c6a4e98960536b9b83bf266edb75481aec7335ac5d55cac6c865f2b8a81f"} Mar 16 16:50:40 crc kubenswrapper[5120]: I0316 16:50:40.605859 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=2.605837807 podStartE2EDuration="2.605837807s" podCreationTimestamp="2026-03-16 16:50:38 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:50:40.539657412 +0000 UTC m=+4742.693589069" watchObservedRunningTime="2026-03-16 16:50:40.605837807 +0000 UTC m=+4742.759769464" Mar 16 16:50:40 crc kubenswrapper[5120]: I0316 16:50:40.606146 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=3.606140836 podStartE2EDuration="3.606140836s" podCreationTimestamp="2026-03-16 16:50:37 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:50:40.586298701 +0000 UTC m=+4742.740230368" watchObservedRunningTime="2026-03-16 16:50:40.606140836 +0000 UTC m=+4742.760072493" Mar 16 16:50:40 crc kubenswrapper[5120]: I0316 16:50:40.680677 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0fdb1c41-3340-4013-99ea-c36c3891ff92" path="/var/lib/kubelet/pods/0fdb1c41-3340-4013-99ea-c36c3891ff92/volumes" Mar 16 16:50:40 crc kubenswrapper[5120]: I0316 16:50:40.681700 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:50:41 crc kubenswrapper[5120]: I0316 16:50:41.579905 5120 generic.go:358] "Generic (PLEG): container finished" podID="55b29fdd-871f-4603-afd0-b2e13728f594" containerID="aa03e4da90e39959e9684043c680d3e34939e072ebb3c5c54a4e9e7c897bc0b8" exitCode=1 Mar 16 16:50:41 crc kubenswrapper[5120]: I0316 16:50:41.580063 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"55b29fdd-871f-4603-afd0-b2e13728f594","Type":"ContainerDied","Data":"aa03e4da90e39959e9684043c680d3e34939e072ebb3c5c54a4e9e7c897bc0b8"} Mar 16 16:50:41 crc kubenswrapper[5120]: I0316 16:50:41.581200 5120 scope.go:117] "RemoveContainer" containerID="aa03e4da90e39959e9684043c680d3e34939e072ebb3c5c54a4e9e7c897bc0b8" Mar 16 16:50:41 crc kubenswrapper[5120]: I0316 16:50:41.584153 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"eb90a8d0-f858-47b0-9aa6-f71216c2dbf3","Type":"ContainerStarted","Data":"2afbc86ce4b710643717284b621aea1d6ef607f26bd64e0e5894cc523ddd9abe"} Mar 16 16:50:41 crc kubenswrapper[5120]: I0316 16:50:41.584230 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:50:41 crc kubenswrapper[5120]: I0316 16:50:41.590209 5120 generic.go:358] "Generic (PLEG): container finished" podID="3b5c836c-a676-4484-a577-057899847899" containerID="2229358481ea699ecdeddc39c36ff43b5623e1e57e408300ca16a94f93846517" exitCode=0 Mar 16 16:50:41 crc kubenswrapper[5120]: I0316 16:50:41.590302 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-5c4b57cb66-89p9b" event={"ID":"3b5c836c-a676-4484-a577-057899847899","Type":"ContainerDied","Data":"2229358481ea699ecdeddc39c36ff43b5623e1e57e408300ca16a94f93846517"} Mar 16 16:50:41 crc kubenswrapper[5120]: I0316 16:50:41.632105 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podStartSLOduration=2.632087352 podStartE2EDuration="2.632087352s" podCreationTimestamp="2026-03-16 16:50:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:50:41.630111598 +0000 UTC m=+4743.784043255" watchObservedRunningTime="2026-03-16 16:50:41.632087352 +0000 UTC m=+4743.786019009" Mar 16 16:50:41 crc kubenswrapper[5120]: I0316 16:50:41.679976 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:50:42 crc kubenswrapper[5120]: I0316 16:50:42.009181 5120 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:50:42 crc kubenswrapper[5120]: I0316 16:50:42.019062 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-5c4b57cb66-89p9b" Mar 16 16:50:42 crc kubenswrapper[5120]: I0316 16:50:42.136440 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xcnm8\" (UniqueName: \"kubernetes.io/projected/3b5c836c-a676-4484-a577-057899847899-kube-api-access-xcnm8\") pod \"3b5c836c-a676-4484-a577-057899847899\" (UID: \"3b5c836c-a676-4484-a577-057899847899\") " Mar 16 16:50:42 crc kubenswrapper[5120]: I0316 16:50:42.136502 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/3b5c836c-a676-4484-a577-057899847899-fernet-keys\") pod \"3b5c836c-a676-4484-a577-057899847899\" (UID: \"3b5c836c-a676-4484-a577-057899847899\") " Mar 16 16:50:42 crc kubenswrapper[5120]: I0316 16:50:42.136607 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3b5c836c-a676-4484-a577-057899847899-config-data\") pod \"3b5c836c-a676-4484-a577-057899847899\" (UID: \"3b5c836c-a676-4484-a577-057899847899\") " Mar 16 16:50:42 crc kubenswrapper[5120]: I0316 16:50:42.137693 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3b5c836c-a676-4484-a577-057899847899-scripts\") pod \"3b5c836c-a676-4484-a577-057899847899\" (UID: \"3b5c836c-a676-4484-a577-057899847899\") " Mar 16 16:50:42 crc kubenswrapper[5120]: I0316 16:50:42.138280 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/3b5c836c-a676-4484-a577-057899847899-credential-keys\") pod \"3b5c836c-a676-4484-a577-057899847899\" (UID: \"3b5c836c-a676-4484-a577-057899847899\") " Mar 16 16:50:42 crc kubenswrapper[5120]: I0316 16:50:42.138401 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3b5c836c-a676-4484-a577-057899847899-combined-ca-bundle\") pod \"3b5c836c-a676-4484-a577-057899847899\" (UID: \"3b5c836c-a676-4484-a577-057899847899\") " Mar 16 16:50:42 crc kubenswrapper[5120]: I0316 16:50:42.147942 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b5c836c-a676-4484-a577-057899847899-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "3b5c836c-a676-4484-a577-057899847899" (UID: "3b5c836c-a676-4484-a577-057899847899"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:50:42 crc kubenswrapper[5120]: I0316 16:50:42.148186 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b5c836c-a676-4484-a577-057899847899-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "3b5c836c-a676-4484-a577-057899847899" (UID: "3b5c836c-a676-4484-a577-057899847899"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:50:42 crc kubenswrapper[5120]: I0316 16:50:42.148886 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b5c836c-a676-4484-a577-057899847899-kube-api-access-xcnm8" (OuterVolumeSpecName: "kube-api-access-xcnm8") pod "3b5c836c-a676-4484-a577-057899847899" (UID: "3b5c836c-a676-4484-a577-057899847899"). InnerVolumeSpecName "kube-api-access-xcnm8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:50:42 crc kubenswrapper[5120]: I0316 16:50:42.167212 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b5c836c-a676-4484-a577-057899847899-scripts" (OuterVolumeSpecName: "scripts") pod "3b5c836c-a676-4484-a577-057899847899" (UID: "3b5c836c-a676-4484-a577-057899847899"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:50:42 crc kubenswrapper[5120]: I0316 16:50:42.208950 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b5c836c-a676-4484-a577-057899847899-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "3b5c836c-a676-4484-a577-057899847899" (UID: "3b5c836c-a676-4484-a577-057899847899"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:50:42 crc kubenswrapper[5120]: I0316 16:50:42.208964 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b5c836c-a676-4484-a577-057899847899-config-data" (OuterVolumeSpecName: "config-data") pod "3b5c836c-a676-4484-a577-057899847899" (UID: "3b5c836c-a676-4484-a577-057899847899"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:50:42 crc kubenswrapper[5120]: I0316 16:50:42.242292 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xcnm8\" (UniqueName: \"kubernetes.io/projected/3b5c836c-a676-4484-a577-057899847899-kube-api-access-xcnm8\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:42 crc kubenswrapper[5120]: I0316 16:50:42.242332 5120 reconciler_common.go:299] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/3b5c836c-a676-4484-a577-057899847899-fernet-keys\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:42 crc kubenswrapper[5120]: I0316 16:50:42.242362 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3b5c836c-a676-4484-a577-057899847899-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:42 crc kubenswrapper[5120]: I0316 16:50:42.242371 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3b5c836c-a676-4484-a577-057899847899-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:42 crc kubenswrapper[5120]: I0316 16:50:42.242381 5120 reconciler_common.go:299] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/3b5c836c-a676-4484-a577-057899847899-credential-keys\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:42 crc kubenswrapper[5120]: I0316 16:50:42.242389 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3b5c836c-a676-4484-a577-057899847899-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:42 crc kubenswrapper[5120]: I0316 16:50:42.442191 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:50:42 crc kubenswrapper[5120]: I0316 16:50:42.451187 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:50:42 crc kubenswrapper[5120]: I0316 16:50:42.463411 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:50:42 crc kubenswrapper[5120]: I0316 16:50:42.463786 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="5cdd3029-6592-4907-9550-54a84c3a8cf0" containerName="nova-scheduler-scheduler" containerID="cri-o://b3efc5cb9d6e81368d13ae721d54c3339ffa4a0c8227b34ea0cd4048bdef31c8" gracePeriod=30 Mar 16 16:50:42 crc kubenswrapper[5120]: I0316 16:50:42.493271 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:50:42 crc kubenswrapper[5120]: I0316 16:50:42.507112 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:50:42 crc kubenswrapper[5120]: I0316 16:50:42.549653 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 16:50:42 crc kubenswrapper[5120]: I0316 16:50:42.603364 5120 generic.go:358] "Generic (PLEG): container finished" podID="dab6fe18-dcd9-476e-a0bc-866bff4864c8" containerID="3fa997bc814940b3b4080dddc58219038b0c096a73b18c1d1e89cd5769c6c049" exitCode=0 Mar 16 16:50:42 crc kubenswrapper[5120]: I0316 16:50:42.603475 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-hj5tn" event={"ID":"dab6fe18-dcd9-476e-a0bc-866bff4864c8","Type":"ContainerDied","Data":"3fa997bc814940b3b4080dddc58219038b0c096a73b18c1d1e89cd5769c6c049"} Mar 16 16:50:42 crc kubenswrapper[5120]: I0316 16:50:42.609945 5120 generic.go:358] "Generic (PLEG): container finished" podID="5cdd3029-6592-4907-9550-54a84c3a8cf0" containerID="b3efc5cb9d6e81368d13ae721d54c3339ffa4a0c8227b34ea0cd4048bdef31c8" exitCode=1 Mar 16 16:50:42 crc kubenswrapper[5120]: I0316 16:50:42.610462 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"5cdd3029-6592-4907-9550-54a84c3a8cf0","Type":"ContainerDied","Data":"b3efc5cb9d6e81368d13ae721d54c3339ffa4a0c8227b34ea0cd4048bdef31c8"} Mar 16 16:50:42 crc kubenswrapper[5120]: I0316 16:50:42.618265 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"55b29fdd-871f-4603-afd0-b2e13728f594","Type":"ContainerStarted","Data":"efec4213034fff9ef64172922016741a3af69ee9511bd701e257ed3c886e8388"} Mar 16 16:50:42 crc kubenswrapper[5120]: I0316 16:50:42.618522 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:50:42 crc kubenswrapper[5120]: I0316 16:50:42.620801 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-5c4b57cb66-89p9b" event={"ID":"3b5c836c-a676-4484-a577-057899847899","Type":"ContainerDied","Data":"c486760186daed7722fb676cbb612aed303e16b299a61e12d750ce3cd2f53fb6"} Mar 16 16:50:42 crc kubenswrapper[5120]: I0316 16:50:42.620834 5120 scope.go:117] "RemoveContainer" containerID="2229358481ea699ecdeddc39c36ff43b5623e1e57e408300ca16a94f93846517" Mar 16 16:50:42 crc kubenswrapper[5120]: I0316 16:50:42.621183 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="d6889bc6-32bf-4828-ad98-2f08730fddd6" containerName="nova-api-log" containerID="cri-o://ce6c08f074bcf140005337a7f227c6661b14e776f29aa838494adeeae8b544e7" gracePeriod=30 Mar 16 16:50:42 crc kubenswrapper[5120]: I0316 16:50:42.621409 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-5c4b57cb66-89p9b" Mar 16 16:50:42 crc kubenswrapper[5120]: I0316 16:50:42.621428 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="d6889bc6-32bf-4828-ad98-2f08730fddd6" containerName="nova-api-api" containerID="cri-o://6b0e2fd6c626189d757f28b2efb62f642e0b7739467fc756b9941b1ea3f4083f" gracePeriod=30 Mar 16 16:50:42 crc kubenswrapper[5120]: I0316 16:50:42.621856 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="570380b9-e6ba-4935-8812-f3e4f48ed53d" containerName="nova-metadata-log" containerID="cri-o://5a4f662960a10d972cf348528756aa6eec9a1bd75a99f3b3a6a9c26d3247fb09" gracePeriod=30 Mar 16 16:50:42 crc kubenswrapper[5120]: I0316 16:50:42.622818 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="570380b9-e6ba-4935-8812-f3e4f48ed53d" containerName="nova-metadata-metadata" containerID="cri-o://f3141fcba3521a0f7ffcaf6761a3132cc55165b6f019eac2e30363057409d511" gracePeriod=30 Mar 16 16:50:42 crc kubenswrapper[5120]: I0316 16:50:42.622965 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podUID="77414d5d-6b19-4bd2-b964-66650dd767e9" containerName="nova-cell1-novncproxy-novncproxy" containerID="cri-o://dc440801bbbe91fcc8b94aa7c5ee5ff1fd954b01d0f25becddbd192c10a6b61a" gracePeriod=30 Mar 16 16:50:42 crc kubenswrapper[5120]: I0316 16:50:42.735789 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-5c4b57cb66-89p9b"] Mar 16 16:50:42 crc kubenswrapper[5120]: I0316 16:50:42.749743 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-5c4b57cb66-89p9b"] Mar 16 16:50:43 crc kubenswrapper[5120]: I0316 16:50:43.046240 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:50:43 crc kubenswrapper[5120]: I0316 16:50:43.185281 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hz8cs\" (UniqueName: \"kubernetes.io/projected/5cdd3029-6592-4907-9550-54a84c3a8cf0-kube-api-access-hz8cs\") pod \"5cdd3029-6592-4907-9550-54a84c3a8cf0\" (UID: \"5cdd3029-6592-4907-9550-54a84c3a8cf0\") " Mar 16 16:50:43 crc kubenswrapper[5120]: I0316 16:50:43.187625 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5cdd3029-6592-4907-9550-54a84c3a8cf0-combined-ca-bundle\") pod \"5cdd3029-6592-4907-9550-54a84c3a8cf0\" (UID: \"5cdd3029-6592-4907-9550-54a84c3a8cf0\") " Mar 16 16:50:43 crc kubenswrapper[5120]: I0316 16:50:43.187991 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5cdd3029-6592-4907-9550-54a84c3a8cf0-config-data\") pod \"5cdd3029-6592-4907-9550-54a84c3a8cf0\" (UID: \"5cdd3029-6592-4907-9550-54a84c3a8cf0\") " Mar 16 16:50:43 crc kubenswrapper[5120]: I0316 16:50:43.197432 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5cdd3029-6592-4907-9550-54a84c3a8cf0-kube-api-access-hz8cs" (OuterVolumeSpecName: "kube-api-access-hz8cs") pod "5cdd3029-6592-4907-9550-54a84c3a8cf0" (UID: "5cdd3029-6592-4907-9550-54a84c3a8cf0"). InnerVolumeSpecName "kube-api-access-hz8cs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:50:43 crc kubenswrapper[5120]: I0316 16:50:43.208935 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/swift-proxy-588bfd87d6-cq2c8"] Mar 16 16:50:43 crc kubenswrapper[5120]: I0316 16:50:43.210883 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5cdd3029-6592-4907-9550-54a84c3a8cf0" containerName="nova-scheduler-scheduler" Mar 16 16:50:43 crc kubenswrapper[5120]: I0316 16:50:43.210908 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="5cdd3029-6592-4907-9550-54a84c3a8cf0" containerName="nova-scheduler-scheduler" Mar 16 16:50:43 crc kubenswrapper[5120]: I0316 16:50:43.211652 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b5c836c-a676-4484-a577-057899847899" containerName="keystone-api" Mar 16 16:50:43 crc kubenswrapper[5120]: I0316 16:50:43.211669 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b5c836c-a676-4484-a577-057899847899" containerName="keystone-api" Mar 16 16:50:43 crc kubenswrapper[5120]: I0316 16:50:43.211949 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="5cdd3029-6592-4907-9550-54a84c3a8cf0" containerName="nova-scheduler-scheduler" Mar 16 16:50:43 crc kubenswrapper[5120]: I0316 16:50:43.211969 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="3b5c836c-a676-4484-a577-057899847899" containerName="keystone-api" Mar 16 16:50:43 crc kubenswrapper[5120]: I0316 16:50:43.219773 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:50:43 crc kubenswrapper[5120]: I0316 16:50:43.251594 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5cdd3029-6592-4907-9550-54a84c3a8cf0-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "5cdd3029-6592-4907-9550-54a84c3a8cf0" (UID: "5cdd3029-6592-4907-9550-54a84c3a8cf0"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:50:43 crc kubenswrapper[5120]: I0316 16:50:43.251700 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5cdd3029-6592-4907-9550-54a84c3a8cf0-config-data" (OuterVolumeSpecName: "config-data") pod "5cdd3029-6592-4907-9550-54a84c3a8cf0" (UID: "5cdd3029-6592-4907-9550-54a84c3a8cf0"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:50:43 crc kubenswrapper[5120]: I0316 16:50:43.253604 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-proxy-588bfd87d6-cq2c8"] Mar 16 16:50:43 crc kubenswrapper[5120]: I0316 16:50:43.253794 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-588bfd87d6-cq2c8" Mar 16 16:50:43 crc kubenswrapper[5120]: I0316 16:50:43.255923 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-swift-internal-svc\"" Mar 16 16:50:43 crc kubenswrapper[5120]: I0316 16:50:43.290600 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-swift-public-svc\"" Mar 16 16:50:43 crc kubenswrapper[5120]: I0316 16:50:43.292241 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hz8cs\" (UniqueName: \"kubernetes.io/projected/5cdd3029-6592-4907-9550-54a84c3a8cf0-kube-api-access-hz8cs\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:43 crc kubenswrapper[5120]: I0316 16:50:43.292278 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5cdd3029-6592-4907-9550-54a84c3a8cf0-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:43 crc kubenswrapper[5120]: I0316 16:50:43.292295 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5cdd3029-6592-4907-9550-54a84c3a8cf0-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:43 crc kubenswrapper[5120]: I0316 16:50:43.396439 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/570380b9-e6ba-4935-8812-f3e4f48ed53d-nova-metadata-tls-certs\") pod \"570380b9-e6ba-4935-8812-f3e4f48ed53d\" (UID: \"570380b9-e6ba-4935-8812-f3e4f48ed53d\") " Mar 16 16:50:43 crc kubenswrapper[5120]: I0316 16:50:43.396492 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/570380b9-e6ba-4935-8812-f3e4f48ed53d-logs\") pod \"570380b9-e6ba-4935-8812-f3e4f48ed53d\" (UID: \"570380b9-e6ba-4935-8812-f3e4f48ed53d\") " Mar 16 16:50:43 crc kubenswrapper[5120]: I0316 16:50:43.396513 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/570380b9-e6ba-4935-8812-f3e4f48ed53d-combined-ca-bundle\") pod \"570380b9-e6ba-4935-8812-f3e4f48ed53d\" (UID: \"570380b9-e6ba-4935-8812-f3e4f48ed53d\") " Mar 16 16:50:43 crc kubenswrapper[5120]: I0316 16:50:43.396667 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/570380b9-e6ba-4935-8812-f3e4f48ed53d-config-data\") pod \"570380b9-e6ba-4935-8812-f3e4f48ed53d\" (UID: \"570380b9-e6ba-4935-8812-f3e4f48ed53d\") " Mar 16 16:50:43 crc kubenswrapper[5120]: I0316 16:50:43.396717 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f4b6n\" (UniqueName: \"kubernetes.io/projected/570380b9-e6ba-4935-8812-f3e4f48ed53d-kube-api-access-f4b6n\") pod \"570380b9-e6ba-4935-8812-f3e4f48ed53d\" (UID: \"570380b9-e6ba-4935-8812-f3e4f48ed53d\") " Mar 16 16:50:43 crc kubenswrapper[5120]: I0316 16:50:43.397648 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/119df2a8-0cad-4926-9ad1-eced0db2037d-log-httpd\") pod \"swift-proxy-588bfd87d6-cq2c8\" (UID: \"119df2a8-0cad-4926-9ad1-eced0db2037d\") " pod="openstack-kuttl-tests/swift-proxy-588bfd87d6-cq2c8" Mar 16 16:50:43 crc kubenswrapper[5120]: I0316 16:50:43.397809 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/119df2a8-0cad-4926-9ad1-eced0db2037d-etc-swift\") pod \"swift-proxy-588bfd87d6-cq2c8\" (UID: \"119df2a8-0cad-4926-9ad1-eced0db2037d\") " pod="openstack-kuttl-tests/swift-proxy-588bfd87d6-cq2c8" Mar 16 16:50:43 crc kubenswrapper[5120]: I0316 16:50:43.397863 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/119df2a8-0cad-4926-9ad1-eced0db2037d-public-tls-certs\") pod \"swift-proxy-588bfd87d6-cq2c8\" (UID: \"119df2a8-0cad-4926-9ad1-eced0db2037d\") " pod="openstack-kuttl-tests/swift-proxy-588bfd87d6-cq2c8" Mar 16 16:50:43 crc kubenswrapper[5120]: I0316 16:50:43.398057 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/119df2a8-0cad-4926-9ad1-eced0db2037d-internal-tls-certs\") pod \"swift-proxy-588bfd87d6-cq2c8\" (UID: \"119df2a8-0cad-4926-9ad1-eced0db2037d\") " pod="openstack-kuttl-tests/swift-proxy-588bfd87d6-cq2c8" Mar 16 16:50:43 crc kubenswrapper[5120]: I0316 16:50:43.398798 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/570380b9-e6ba-4935-8812-f3e4f48ed53d-logs" (OuterVolumeSpecName: "logs") pod "570380b9-e6ba-4935-8812-f3e4f48ed53d" (UID: "570380b9-e6ba-4935-8812-f3e4f48ed53d"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:50:43 crc kubenswrapper[5120]: I0316 16:50:43.399099 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkqn8\" (UniqueName: \"kubernetes.io/projected/119df2a8-0cad-4926-9ad1-eced0db2037d-kube-api-access-pkqn8\") pod \"swift-proxy-588bfd87d6-cq2c8\" (UID: \"119df2a8-0cad-4926-9ad1-eced0db2037d\") " pod="openstack-kuttl-tests/swift-proxy-588bfd87d6-cq2c8" Mar 16 16:50:43 crc kubenswrapper[5120]: I0316 16:50:43.399164 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/119df2a8-0cad-4926-9ad1-eced0db2037d-config-data\") pod \"swift-proxy-588bfd87d6-cq2c8\" (UID: \"119df2a8-0cad-4926-9ad1-eced0db2037d\") " pod="openstack-kuttl-tests/swift-proxy-588bfd87d6-cq2c8" Mar 16 16:50:43 crc kubenswrapper[5120]: I0316 16:50:43.399215 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/119df2a8-0cad-4926-9ad1-eced0db2037d-combined-ca-bundle\") pod \"swift-proxy-588bfd87d6-cq2c8\" (UID: \"119df2a8-0cad-4926-9ad1-eced0db2037d\") " pod="openstack-kuttl-tests/swift-proxy-588bfd87d6-cq2c8" Mar 16 16:50:43 crc kubenswrapper[5120]: I0316 16:50:43.399271 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/119df2a8-0cad-4926-9ad1-eced0db2037d-run-httpd\") pod \"swift-proxy-588bfd87d6-cq2c8\" (UID: \"119df2a8-0cad-4926-9ad1-eced0db2037d\") " pod="openstack-kuttl-tests/swift-proxy-588bfd87d6-cq2c8" Mar 16 16:50:43 crc kubenswrapper[5120]: I0316 16:50:43.409060 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/570380b9-e6ba-4935-8812-f3e4f48ed53d-kube-api-access-f4b6n" (OuterVolumeSpecName: "kube-api-access-f4b6n") pod "570380b9-e6ba-4935-8812-f3e4f48ed53d" (UID: "570380b9-e6ba-4935-8812-f3e4f48ed53d"). InnerVolumeSpecName "kube-api-access-f4b6n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:50:43 crc kubenswrapper[5120]: I0316 16:50:43.471890 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/570380b9-e6ba-4935-8812-f3e4f48ed53d-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "570380b9-e6ba-4935-8812-f3e4f48ed53d" (UID: "570380b9-e6ba-4935-8812-f3e4f48ed53d"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:50:43 crc kubenswrapper[5120]: I0316 16:50:43.501777 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/119df2a8-0cad-4926-9ad1-eced0db2037d-log-httpd\") pod \"swift-proxy-588bfd87d6-cq2c8\" (UID: \"119df2a8-0cad-4926-9ad1-eced0db2037d\") " pod="openstack-kuttl-tests/swift-proxy-588bfd87d6-cq2c8" Mar 16 16:50:43 crc kubenswrapper[5120]: I0316 16:50:43.501916 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/119df2a8-0cad-4926-9ad1-eced0db2037d-etc-swift\") pod \"swift-proxy-588bfd87d6-cq2c8\" (UID: \"119df2a8-0cad-4926-9ad1-eced0db2037d\") " pod="openstack-kuttl-tests/swift-proxy-588bfd87d6-cq2c8" Mar 16 16:50:43 crc kubenswrapper[5120]: I0316 16:50:43.501965 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/119df2a8-0cad-4926-9ad1-eced0db2037d-public-tls-certs\") pod \"swift-proxy-588bfd87d6-cq2c8\" (UID: \"119df2a8-0cad-4926-9ad1-eced0db2037d\") " pod="openstack-kuttl-tests/swift-proxy-588bfd87d6-cq2c8" Mar 16 16:50:43 crc kubenswrapper[5120]: I0316 16:50:43.502143 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/119df2a8-0cad-4926-9ad1-eced0db2037d-internal-tls-certs\") pod \"swift-proxy-588bfd87d6-cq2c8\" (UID: \"119df2a8-0cad-4926-9ad1-eced0db2037d\") " pod="openstack-kuttl-tests/swift-proxy-588bfd87d6-cq2c8" Mar 16 16:50:43 crc kubenswrapper[5120]: I0316 16:50:43.502264 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pkqn8\" (UniqueName: \"kubernetes.io/projected/119df2a8-0cad-4926-9ad1-eced0db2037d-kube-api-access-pkqn8\") pod \"swift-proxy-588bfd87d6-cq2c8\" (UID: \"119df2a8-0cad-4926-9ad1-eced0db2037d\") " pod="openstack-kuttl-tests/swift-proxy-588bfd87d6-cq2c8" Mar 16 16:50:43 crc kubenswrapper[5120]: I0316 16:50:43.502304 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/119df2a8-0cad-4926-9ad1-eced0db2037d-config-data\") pod \"swift-proxy-588bfd87d6-cq2c8\" (UID: \"119df2a8-0cad-4926-9ad1-eced0db2037d\") " pod="openstack-kuttl-tests/swift-proxy-588bfd87d6-cq2c8" Mar 16 16:50:43 crc kubenswrapper[5120]: I0316 16:50:43.502342 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/119df2a8-0cad-4926-9ad1-eced0db2037d-combined-ca-bundle\") pod \"swift-proxy-588bfd87d6-cq2c8\" (UID: \"119df2a8-0cad-4926-9ad1-eced0db2037d\") " pod="openstack-kuttl-tests/swift-proxy-588bfd87d6-cq2c8" Mar 16 16:50:43 crc kubenswrapper[5120]: I0316 16:50:43.502384 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/119df2a8-0cad-4926-9ad1-eced0db2037d-run-httpd\") pod \"swift-proxy-588bfd87d6-cq2c8\" (UID: \"119df2a8-0cad-4926-9ad1-eced0db2037d\") " pod="openstack-kuttl-tests/swift-proxy-588bfd87d6-cq2c8" Mar 16 16:50:43 crc kubenswrapper[5120]: I0316 16:50:43.502479 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f4b6n\" (UniqueName: \"kubernetes.io/projected/570380b9-e6ba-4935-8812-f3e4f48ed53d-kube-api-access-f4b6n\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:43 crc kubenswrapper[5120]: I0316 16:50:43.502494 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/570380b9-e6ba-4935-8812-f3e4f48ed53d-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:43 crc kubenswrapper[5120]: I0316 16:50:43.502503 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/570380b9-e6ba-4935-8812-f3e4f48ed53d-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:43 crc kubenswrapper[5120]: I0316 16:50:43.503141 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/119df2a8-0cad-4926-9ad1-eced0db2037d-run-httpd\") pod \"swift-proxy-588bfd87d6-cq2c8\" (UID: \"119df2a8-0cad-4926-9ad1-eced0db2037d\") " pod="openstack-kuttl-tests/swift-proxy-588bfd87d6-cq2c8" Mar 16 16:50:43 crc kubenswrapper[5120]: I0316 16:50:43.508967 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/570380b9-e6ba-4935-8812-f3e4f48ed53d-config-data" (OuterVolumeSpecName: "config-data") pod "570380b9-e6ba-4935-8812-f3e4f48ed53d" (UID: "570380b9-e6ba-4935-8812-f3e4f48ed53d"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:50:43 crc kubenswrapper[5120]: I0316 16:50:43.509677 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/119df2a8-0cad-4926-9ad1-eced0db2037d-etc-swift\") pod \"swift-proxy-588bfd87d6-cq2c8\" (UID: \"119df2a8-0cad-4926-9ad1-eced0db2037d\") " pod="openstack-kuttl-tests/swift-proxy-588bfd87d6-cq2c8" Mar 16 16:50:43 crc kubenswrapper[5120]: I0316 16:50:43.510186 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/119df2a8-0cad-4926-9ad1-eced0db2037d-log-httpd\") pod \"swift-proxy-588bfd87d6-cq2c8\" (UID: \"119df2a8-0cad-4926-9ad1-eced0db2037d\") " pod="openstack-kuttl-tests/swift-proxy-588bfd87d6-cq2c8" Mar 16 16:50:43 crc kubenswrapper[5120]: I0316 16:50:43.519549 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/119df2a8-0cad-4926-9ad1-eced0db2037d-combined-ca-bundle\") pod \"swift-proxy-588bfd87d6-cq2c8\" (UID: \"119df2a8-0cad-4926-9ad1-eced0db2037d\") " pod="openstack-kuttl-tests/swift-proxy-588bfd87d6-cq2c8" Mar 16 16:50:43 crc kubenswrapper[5120]: I0316 16:50:43.521955 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/119df2a8-0cad-4926-9ad1-eced0db2037d-public-tls-certs\") pod \"swift-proxy-588bfd87d6-cq2c8\" (UID: \"119df2a8-0cad-4926-9ad1-eced0db2037d\") " pod="openstack-kuttl-tests/swift-proxy-588bfd87d6-cq2c8" Mar 16 16:50:43 crc kubenswrapper[5120]: I0316 16:50:43.525586 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/119df2a8-0cad-4926-9ad1-eced0db2037d-config-data\") pod \"swift-proxy-588bfd87d6-cq2c8\" (UID: \"119df2a8-0cad-4926-9ad1-eced0db2037d\") " pod="openstack-kuttl-tests/swift-proxy-588bfd87d6-cq2c8" Mar 16 16:50:43 crc kubenswrapper[5120]: I0316 16:50:43.526054 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkqn8\" (UniqueName: \"kubernetes.io/projected/119df2a8-0cad-4926-9ad1-eced0db2037d-kube-api-access-pkqn8\") pod \"swift-proxy-588bfd87d6-cq2c8\" (UID: \"119df2a8-0cad-4926-9ad1-eced0db2037d\") " pod="openstack-kuttl-tests/swift-proxy-588bfd87d6-cq2c8" Mar 16 16:50:43 crc kubenswrapper[5120]: I0316 16:50:43.529644 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/119df2a8-0cad-4926-9ad1-eced0db2037d-internal-tls-certs\") pod \"swift-proxy-588bfd87d6-cq2c8\" (UID: \"119df2a8-0cad-4926-9ad1-eced0db2037d\") " pod="openstack-kuttl-tests/swift-proxy-588bfd87d6-cq2c8" Mar 16 16:50:43 crc kubenswrapper[5120]: I0316 16:50:43.562504 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/570380b9-e6ba-4935-8812-f3e4f48ed53d-nova-metadata-tls-certs" (OuterVolumeSpecName: "nova-metadata-tls-certs") pod "570380b9-e6ba-4935-8812-f3e4f48ed53d" (UID: "570380b9-e6ba-4935-8812-f3e4f48ed53d"). InnerVolumeSpecName "nova-metadata-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:50:43 crc kubenswrapper[5120]: I0316 16:50:43.618524 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-588bfd87d6-cq2c8" Mar 16 16:50:43 crc kubenswrapper[5120]: I0316 16:50:43.658630 5120 reconciler_common.go:299] "Volume detached for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/570380b9-e6ba-4935-8812-f3e4f48ed53d-nova-metadata-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:43 crc kubenswrapper[5120]: I0316 16:50:43.658671 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/570380b9-e6ba-4935-8812-f3e4f48ed53d-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:43 crc kubenswrapper[5120]: I0316 16:50:43.691934 5120 generic.go:358] "Generic (PLEG): container finished" podID="570380b9-e6ba-4935-8812-f3e4f48ed53d" containerID="f3141fcba3521a0f7ffcaf6761a3132cc55165b6f019eac2e30363057409d511" exitCode=0 Mar 16 16:50:43 crc kubenswrapper[5120]: I0316 16:50:43.691963 5120 generic.go:358] "Generic (PLEG): container finished" podID="570380b9-e6ba-4935-8812-f3e4f48ed53d" containerID="5a4f662960a10d972cf348528756aa6eec9a1bd75a99f3b3a6a9c26d3247fb09" exitCode=143 Mar 16 16:50:43 crc kubenswrapper[5120]: I0316 16:50:43.692112 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"570380b9-e6ba-4935-8812-f3e4f48ed53d","Type":"ContainerDied","Data":"f3141fcba3521a0f7ffcaf6761a3132cc55165b6f019eac2e30363057409d511"} Mar 16 16:50:43 crc kubenswrapper[5120]: I0316 16:50:43.692146 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"570380b9-e6ba-4935-8812-f3e4f48ed53d","Type":"ContainerDied","Data":"5a4f662960a10d972cf348528756aa6eec9a1bd75a99f3b3a6a9c26d3247fb09"} Mar 16 16:50:43 crc kubenswrapper[5120]: I0316 16:50:43.692156 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"570380b9-e6ba-4935-8812-f3e4f48ed53d","Type":"ContainerDied","Data":"dd5b42f6649241e8db1cd79ac797a47039bdf1a9d11633fbc9ea739874f5d498"} Mar 16 16:50:43 crc kubenswrapper[5120]: I0316 16:50:43.692171 5120 scope.go:117] "RemoveContainer" containerID="f3141fcba3521a0f7ffcaf6761a3132cc55165b6f019eac2e30363057409d511" Mar 16 16:50:43 crc kubenswrapper[5120]: I0316 16:50:43.692358 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:50:43 crc kubenswrapper[5120]: I0316 16:50:43.721222 5120 generic.go:358] "Generic (PLEG): container finished" podID="77414d5d-6b19-4bd2-b964-66650dd767e9" containerID="dc440801bbbe91fcc8b94aa7c5ee5ff1fd954b01d0f25becddbd192c10a6b61a" exitCode=0 Mar 16 16:50:43 crc kubenswrapper[5120]: I0316 16:50:43.721857 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"77414d5d-6b19-4bd2-b964-66650dd767e9","Type":"ContainerDied","Data":"dc440801bbbe91fcc8b94aa7c5ee5ff1fd954b01d0f25becddbd192c10a6b61a"} Mar 16 16:50:43 crc kubenswrapper[5120]: I0316 16:50:43.732983 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:50:43 crc kubenswrapper[5120]: I0316 16:50:43.733001 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"5cdd3029-6592-4907-9550-54a84c3a8cf0","Type":"ContainerDied","Data":"e4b1e44b4a378122faf4462622f97816d1e815735d0d653021a904d2888a2b83"} Mar 16 16:50:43 crc kubenswrapper[5120]: I0316 16:50:43.757667 5120 generic.go:358] "Generic (PLEG): container finished" podID="d6889bc6-32bf-4828-ad98-2f08730fddd6" containerID="6b0e2fd6c626189d757f28b2efb62f642e0b7739467fc756b9941b1ea3f4083f" exitCode=0 Mar 16 16:50:43 crc kubenswrapper[5120]: I0316 16:50:43.757694 5120 generic.go:358] "Generic (PLEG): container finished" podID="d6889bc6-32bf-4828-ad98-2f08730fddd6" containerID="ce6c08f074bcf140005337a7f227c6661b14e776f29aa838494adeeae8b544e7" exitCode=143 Mar 16 16:50:43 crc kubenswrapper[5120]: I0316 16:50:43.757969 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="55b29fdd-871f-4603-afd0-b2e13728f594" containerName="nova-cell0-conductor-conductor" containerID="cri-o://efec4213034fff9ef64172922016741a3af69ee9511bd701e257ed3c886e8388" gracePeriod=30 Mar 16 16:50:43 crc kubenswrapper[5120]: I0316 16:50:43.758281 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"d6889bc6-32bf-4828-ad98-2f08730fddd6","Type":"ContainerDied","Data":"6b0e2fd6c626189d757f28b2efb62f642e0b7739467fc756b9941b1ea3f4083f"} Mar 16 16:50:43 crc kubenswrapper[5120]: I0316 16:50:43.758311 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"d6889bc6-32bf-4828-ad98-2f08730fddd6","Type":"ContainerDied","Data":"ce6c08f074bcf140005337a7f227c6661b14e776f29aa838494adeeae8b544e7"} Mar 16 16:50:43 crc kubenswrapper[5120]: I0316 16:50:43.758406 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="eb90a8d0-f858-47b0-9aa6-f71216c2dbf3" containerName="nova-cell1-conductor-conductor" containerID="cri-o://2afbc86ce4b710643717284b621aea1d6ef607f26bd64e0e5894cc523ddd9abe" gracePeriod=30 Mar 16 16:50:43 crc kubenswrapper[5120]: I0316 16:50:43.835105 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:50:43 crc kubenswrapper[5120]: I0316 16:50:43.847731 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:50:43 crc kubenswrapper[5120]: I0316 16:50:43.856441 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:50:43 crc kubenswrapper[5120]: I0316 16:50:43.885686 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:50:43 crc kubenswrapper[5120]: I0316 16:50:43.887235 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6889bc6-32bf-4828-ad98-2f08730fddd6" containerName="nova-api-log" Mar 16 16:50:43 crc kubenswrapper[5120]: I0316 16:50:43.887295 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6889bc6-32bf-4828-ad98-2f08730fddd6" containerName="nova-api-log" Mar 16 16:50:43 crc kubenswrapper[5120]: I0316 16:50:43.887329 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="570380b9-e6ba-4935-8812-f3e4f48ed53d" containerName="nova-metadata-log" Mar 16 16:50:43 crc kubenswrapper[5120]: I0316 16:50:43.887338 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="570380b9-e6ba-4935-8812-f3e4f48ed53d" containerName="nova-metadata-log" Mar 16 16:50:43 crc kubenswrapper[5120]: I0316 16:50:43.887344 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="570380b9-e6ba-4935-8812-f3e4f48ed53d" containerName="nova-metadata-metadata" Mar 16 16:50:43 crc kubenswrapper[5120]: I0316 16:50:43.887350 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="570380b9-e6ba-4935-8812-f3e4f48ed53d" containerName="nova-metadata-metadata" Mar 16 16:50:43 crc kubenswrapper[5120]: I0316 16:50:43.887391 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6889bc6-32bf-4828-ad98-2f08730fddd6" containerName="nova-api-api" Mar 16 16:50:43 crc kubenswrapper[5120]: I0316 16:50:43.887396 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6889bc6-32bf-4828-ad98-2f08730fddd6" containerName="nova-api-api" Mar 16 16:50:43 crc kubenswrapper[5120]: I0316 16:50:43.887583 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="d6889bc6-32bf-4828-ad98-2f08730fddd6" containerName="nova-api-api" Mar 16 16:50:43 crc kubenswrapper[5120]: I0316 16:50:43.887599 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="d6889bc6-32bf-4828-ad98-2f08730fddd6" containerName="nova-api-log" Mar 16 16:50:43 crc kubenswrapper[5120]: I0316 16:50:43.887609 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="570380b9-e6ba-4935-8812-f3e4f48ed53d" containerName="nova-metadata-log" Mar 16 16:50:43 crc kubenswrapper[5120]: I0316 16:50:43.887627 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="570380b9-e6ba-4935-8812-f3e4f48ed53d" containerName="nova-metadata-metadata" Mar 16 16:50:43 crc kubenswrapper[5120]: I0316 16:50:43.930837 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:50:43 crc kubenswrapper[5120]: I0316 16:50:43.943465 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-metadata-config-data\"" Mar 16 16:50:43 crc kubenswrapper[5120]: I0316 16:50:43.943703 5120 scope.go:117] "RemoveContainer" containerID="5a4f662960a10d972cf348528756aa6eec9a1bd75a99f3b3a6a9c26d3247fb09" Mar 16 16:50:43 crc kubenswrapper[5120]: I0316 16:50:43.944057 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-metadata-internal-svc\"" Mar 16 16:50:43 crc kubenswrapper[5120]: I0316 16:50:43.966597 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:50:43 crc kubenswrapper[5120]: I0316 16:50:43.985589 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/d6889bc6-32bf-4828-ad98-2f08730fddd6-internal-tls-certs\") pod \"d6889bc6-32bf-4828-ad98-2f08730fddd6\" (UID: \"d6889bc6-32bf-4828-ad98-2f08730fddd6\") " Mar 16 16:50:43 crc kubenswrapper[5120]: I0316 16:50:43.986091 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d6889bc6-32bf-4828-ad98-2f08730fddd6-config-data\") pod \"d6889bc6-32bf-4828-ad98-2f08730fddd6\" (UID: \"d6889bc6-32bf-4828-ad98-2f08730fddd6\") " Mar 16 16:50:43 crc kubenswrapper[5120]: I0316 16:50:43.994721 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d6889bc6-32bf-4828-ad98-2f08730fddd6-combined-ca-bundle\") pod \"d6889bc6-32bf-4828-ad98-2f08730fddd6\" (UID: \"d6889bc6-32bf-4828-ad98-2f08730fddd6\") " Mar 16 16:50:43 crc kubenswrapper[5120]: I0316 16:50:43.994888 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c54tn\" (UniqueName: \"kubernetes.io/projected/d6889bc6-32bf-4828-ad98-2f08730fddd6-kube-api-access-c54tn\") pod \"d6889bc6-32bf-4828-ad98-2f08730fddd6\" (UID: \"d6889bc6-32bf-4828-ad98-2f08730fddd6\") " Mar 16 16:50:43 crc kubenswrapper[5120]: I0316 16:50:43.995582 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/d6889bc6-32bf-4828-ad98-2f08730fddd6-public-tls-certs\") pod \"d6889bc6-32bf-4828-ad98-2f08730fddd6\" (UID: \"d6889bc6-32bf-4828-ad98-2f08730fddd6\") " Mar 16 16:50:43 crc kubenswrapper[5120]: I0316 16:50:43.996898 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d6889bc6-32bf-4828-ad98-2f08730fddd6-logs\") pod \"d6889bc6-32bf-4828-ad98-2f08730fddd6\" (UID: \"d6889bc6-32bf-4828-ad98-2f08730fddd6\") " Mar 16 16:50:44 crc kubenswrapper[5120]: I0316 16:50:43.999845 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:50:44 crc kubenswrapper[5120]: I0316 16:50:44.003357 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6889bc6-32bf-4828-ad98-2f08730fddd6-logs" (OuterVolumeSpecName: "logs") pod "d6889bc6-32bf-4828-ad98-2f08730fddd6" (UID: "d6889bc6-32bf-4828-ad98-2f08730fddd6"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:50:44 crc kubenswrapper[5120]: I0316 16:50:44.029129 5120 scope.go:117] "RemoveContainer" containerID="f3141fcba3521a0f7ffcaf6761a3132cc55165b6f019eac2e30363057409d511" Mar 16 16:50:44 crc kubenswrapper[5120]: E0316 16:50:44.030180 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f3141fcba3521a0f7ffcaf6761a3132cc55165b6f019eac2e30363057409d511\": container with ID starting with f3141fcba3521a0f7ffcaf6761a3132cc55165b6f019eac2e30363057409d511 not found: ID does not exist" containerID="f3141fcba3521a0f7ffcaf6761a3132cc55165b6f019eac2e30363057409d511" Mar 16 16:50:44 crc kubenswrapper[5120]: I0316 16:50:44.030217 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3141fcba3521a0f7ffcaf6761a3132cc55165b6f019eac2e30363057409d511"} err="failed to get container status \"f3141fcba3521a0f7ffcaf6761a3132cc55165b6f019eac2e30363057409d511\": rpc error: code = NotFound desc = could not find container \"f3141fcba3521a0f7ffcaf6761a3132cc55165b6f019eac2e30363057409d511\": container with ID starting with f3141fcba3521a0f7ffcaf6761a3132cc55165b6f019eac2e30363057409d511 not found: ID does not exist" Mar 16 16:50:44 crc kubenswrapper[5120]: I0316 16:50:44.030241 5120 scope.go:117] "RemoveContainer" containerID="5a4f662960a10d972cf348528756aa6eec9a1bd75a99f3b3a6a9c26d3247fb09" Mar 16 16:50:44 crc kubenswrapper[5120]: E0316 16:50:44.037881 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5a4f662960a10d972cf348528756aa6eec9a1bd75a99f3b3a6a9c26d3247fb09\": container with ID starting with 5a4f662960a10d972cf348528756aa6eec9a1bd75a99f3b3a6a9c26d3247fb09 not found: ID does not exist" containerID="5a4f662960a10d972cf348528756aa6eec9a1bd75a99f3b3a6a9c26d3247fb09" Mar 16 16:50:44 crc kubenswrapper[5120]: I0316 16:50:44.037926 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a4f662960a10d972cf348528756aa6eec9a1bd75a99f3b3a6a9c26d3247fb09"} err="failed to get container status \"5a4f662960a10d972cf348528756aa6eec9a1bd75a99f3b3a6a9c26d3247fb09\": rpc error: code = NotFound desc = could not find container \"5a4f662960a10d972cf348528756aa6eec9a1bd75a99f3b3a6a9c26d3247fb09\": container with ID starting with 5a4f662960a10d972cf348528756aa6eec9a1bd75a99f3b3a6a9c26d3247fb09 not found: ID does not exist" Mar 16 16:50:44 crc kubenswrapper[5120]: I0316 16:50:44.037967 5120 scope.go:117] "RemoveContainer" containerID="f3141fcba3521a0f7ffcaf6761a3132cc55165b6f019eac2e30363057409d511" Mar 16 16:50:44 crc kubenswrapper[5120]: I0316 16:50:44.039181 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3141fcba3521a0f7ffcaf6761a3132cc55165b6f019eac2e30363057409d511"} err="failed to get container status \"f3141fcba3521a0f7ffcaf6761a3132cc55165b6f019eac2e30363057409d511\": rpc error: code = NotFound desc = could not find container \"f3141fcba3521a0f7ffcaf6761a3132cc55165b6f019eac2e30363057409d511\": container with ID starting with f3141fcba3521a0f7ffcaf6761a3132cc55165b6f019eac2e30363057409d511 not found: ID does not exist" Mar 16 16:50:44 crc kubenswrapper[5120]: I0316 16:50:44.039228 5120 scope.go:117] "RemoveContainer" containerID="5a4f662960a10d972cf348528756aa6eec9a1bd75a99f3b3a6a9c26d3247fb09" Mar 16 16:50:44 crc kubenswrapper[5120]: I0316 16:50:44.042280 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a4f662960a10d972cf348528756aa6eec9a1bd75a99f3b3a6a9c26d3247fb09"} err="failed to get container status \"5a4f662960a10d972cf348528756aa6eec9a1bd75a99f3b3a6a9c26d3247fb09\": rpc error: code = NotFound desc = could not find container \"5a4f662960a10d972cf348528756aa6eec9a1bd75a99f3b3a6a9c26d3247fb09\": container with ID starting with 5a4f662960a10d972cf348528756aa6eec9a1bd75a99f3b3a6a9c26d3247fb09 not found: ID does not exist" Mar 16 16:50:44 crc kubenswrapper[5120]: I0316 16:50:44.042305 5120 scope.go:117] "RemoveContainer" containerID="b3efc5cb9d6e81368d13ae721d54c3339ffa4a0c8227b34ea0cd4048bdef31c8" Mar 16 16:50:44 crc kubenswrapper[5120]: I0316 16:50:44.042450 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:50:44 crc kubenswrapper[5120]: I0316 16:50:44.059639 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:50:44 crc kubenswrapper[5120]: I0316 16:50:44.060527 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6889bc6-32bf-4828-ad98-2f08730fddd6-kube-api-access-c54tn" (OuterVolumeSpecName: "kube-api-access-c54tn") pod "d6889bc6-32bf-4828-ad98-2f08730fddd6" (UID: "d6889bc6-32bf-4828-ad98-2f08730fddd6"). InnerVolumeSpecName "kube-api-access-c54tn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:50:44 crc kubenswrapper[5120]: I0316 16:50:44.085273 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:50:44 crc kubenswrapper[5120]: I0316 16:50:44.085483 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:50:44 crc kubenswrapper[5120]: I0316 16:50:44.090905 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6889bc6-32bf-4828-ad98-2f08730fddd6-config-data" (OuterVolumeSpecName: "config-data") pod "d6889bc6-32bf-4828-ad98-2f08730fddd6" (UID: "d6889bc6-32bf-4828-ad98-2f08730fddd6"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:50:44 crc kubenswrapper[5120]: I0316 16:50:44.091175 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-scheduler-config-data\"" Mar 16 16:50:44 crc kubenswrapper[5120]: I0316 16:50:44.101577 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6889bc6-32bf-4828-ad98-2f08730fddd6-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "d6889bc6-32bf-4828-ad98-2f08730fddd6" (UID: "d6889bc6-32bf-4828-ad98-2f08730fddd6"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:50:44 crc kubenswrapper[5120]: I0316 16:50:44.107128 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b19e43df-ec26-473e-a23f-06c30f7d85e7-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"b19e43df-ec26-473e-a23f-06c30f7d85e7\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:50:44 crc kubenswrapper[5120]: I0316 16:50:44.107384 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/b19e43df-ec26-473e-a23f-06c30f7d85e7-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"b19e43df-ec26-473e-a23f-06c30f7d85e7\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:50:44 crc kubenswrapper[5120]: I0316 16:50:44.107591 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b19e43df-ec26-473e-a23f-06c30f7d85e7-config-data\") pod \"nova-metadata-0\" (UID: \"b19e43df-ec26-473e-a23f-06c30f7d85e7\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:50:44 crc kubenswrapper[5120]: I0316 16:50:44.107642 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b19e43df-ec26-473e-a23f-06c30f7d85e7-logs\") pod \"nova-metadata-0\" (UID: \"b19e43df-ec26-473e-a23f-06c30f7d85e7\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:50:44 crc kubenswrapper[5120]: I0316 16:50:44.107807 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2djb\" (UniqueName: \"kubernetes.io/projected/b19e43df-ec26-473e-a23f-06c30f7d85e7-kube-api-access-t2djb\") pod \"nova-metadata-0\" (UID: \"b19e43df-ec26-473e-a23f-06c30f7d85e7\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:50:44 crc kubenswrapper[5120]: I0316 16:50:44.107883 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d6889bc6-32bf-4828-ad98-2f08730fddd6-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:44 crc kubenswrapper[5120]: I0316 16:50:44.107895 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d6889bc6-32bf-4828-ad98-2f08730fddd6-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:44 crc kubenswrapper[5120]: I0316 16:50:44.107912 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c54tn\" (UniqueName: \"kubernetes.io/projected/d6889bc6-32bf-4828-ad98-2f08730fddd6-kube-api-access-c54tn\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:44 crc kubenswrapper[5120]: I0316 16:50:44.107922 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d6889bc6-32bf-4828-ad98-2f08730fddd6-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:44 crc kubenswrapper[5120]: E0316 16:50:44.134967 5120 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5cdd3029_6592_4907_9550_54a84c3a8cf0.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod570380b9_e6ba_4935_8812_f3e4f48ed53d.slice/crio-dd5b42f6649241e8db1cd79ac797a47039bdf1a9d11633fbc9ea739874f5d498\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5cdd3029_6592_4907_9550_54a84c3a8cf0.slice/crio-e4b1e44b4a378122faf4462622f97816d1e815735d0d653021a904d2888a2b83\": RecentStats: unable to find data in memory cache]" Mar 16 16:50:44 crc kubenswrapper[5120]: I0316 16:50:44.162980 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6889bc6-32bf-4828-ad98-2f08730fddd6-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "d6889bc6-32bf-4828-ad98-2f08730fddd6" (UID: "d6889bc6-32bf-4828-ad98-2f08730fddd6"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:50:44 crc kubenswrapper[5120]: I0316 16:50:44.174908 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6889bc6-32bf-4828-ad98-2f08730fddd6-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "d6889bc6-32bf-4828-ad98-2f08730fddd6" (UID: "d6889bc6-32bf-4828-ad98-2f08730fddd6"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:50:44 crc kubenswrapper[5120]: I0316 16:50:44.212708 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b19e43df-ec26-473e-a23f-06c30f7d85e7-config-data\") pod \"nova-metadata-0\" (UID: \"b19e43df-ec26-473e-a23f-06c30f7d85e7\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:50:44 crc kubenswrapper[5120]: I0316 16:50:44.213183 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b19e43df-ec26-473e-a23f-06c30f7d85e7-logs\") pod \"nova-metadata-0\" (UID: \"b19e43df-ec26-473e-a23f-06c30f7d85e7\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:50:44 crc kubenswrapper[5120]: I0316 16:50:44.213324 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t2djb\" (UniqueName: \"kubernetes.io/projected/b19e43df-ec26-473e-a23f-06c30f7d85e7-kube-api-access-t2djb\") pod \"nova-metadata-0\" (UID: \"b19e43df-ec26-473e-a23f-06c30f7d85e7\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:50:44 crc kubenswrapper[5120]: I0316 16:50:44.213415 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b19e43df-ec26-473e-a23f-06c30f7d85e7-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"b19e43df-ec26-473e-a23f-06c30f7d85e7\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:50:44 crc kubenswrapper[5120]: I0316 16:50:44.213582 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xc4n\" (UniqueName: \"kubernetes.io/projected/17638423-bcdb-4b88-b3c8-5faa97ef3d0d-kube-api-access-4xc4n\") pod \"nova-scheduler-0\" (UID: \"17638423-bcdb-4b88-b3c8-5faa97ef3d0d\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:50:44 crc kubenswrapper[5120]: I0316 16:50:44.213670 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/b19e43df-ec26-473e-a23f-06c30f7d85e7-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"b19e43df-ec26-473e-a23f-06c30f7d85e7\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:50:44 crc kubenswrapper[5120]: I0316 16:50:44.213710 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/17638423-bcdb-4b88-b3c8-5faa97ef3d0d-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"17638423-bcdb-4b88-b3c8-5faa97ef3d0d\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:50:44 crc kubenswrapper[5120]: I0316 16:50:44.213802 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/17638423-bcdb-4b88-b3c8-5faa97ef3d0d-config-data\") pod \"nova-scheduler-0\" (UID: \"17638423-bcdb-4b88-b3c8-5faa97ef3d0d\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:50:44 crc kubenswrapper[5120]: I0316 16:50:44.213963 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/d6889bc6-32bf-4828-ad98-2f08730fddd6-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:44 crc kubenswrapper[5120]: I0316 16:50:44.213985 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/d6889bc6-32bf-4828-ad98-2f08730fddd6-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:44 crc kubenswrapper[5120]: I0316 16:50:44.219833 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b19e43df-ec26-473e-a23f-06c30f7d85e7-logs\") pod \"nova-metadata-0\" (UID: \"b19e43df-ec26-473e-a23f-06c30f7d85e7\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:50:44 crc kubenswrapper[5120]: I0316 16:50:44.227610 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b19e43df-ec26-473e-a23f-06c30f7d85e7-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"b19e43df-ec26-473e-a23f-06c30f7d85e7\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:50:44 crc kubenswrapper[5120]: I0316 16:50:44.244460 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2djb\" (UniqueName: \"kubernetes.io/projected/b19e43df-ec26-473e-a23f-06c30f7d85e7-kube-api-access-t2djb\") pod \"nova-metadata-0\" (UID: \"b19e43df-ec26-473e-a23f-06c30f7d85e7\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:50:44 crc kubenswrapper[5120]: I0316 16:50:44.245323 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b19e43df-ec26-473e-a23f-06c30f7d85e7-config-data\") pod \"nova-metadata-0\" (UID: \"b19e43df-ec26-473e-a23f-06c30f7d85e7\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:50:44 crc kubenswrapper[5120]: I0316 16:50:44.247266 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/b19e43df-ec26-473e-a23f-06c30f7d85e7-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"b19e43df-ec26-473e-a23f-06c30f7d85e7\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:50:44 crc kubenswrapper[5120]: I0316 16:50:44.257733 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:50:44 crc kubenswrapper[5120]: I0316 16:50:44.265200 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:50:44 crc kubenswrapper[5120]: I0316 16:50:44.318134 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4xc4n\" (UniqueName: \"kubernetes.io/projected/17638423-bcdb-4b88-b3c8-5faa97ef3d0d-kube-api-access-4xc4n\") pod \"nova-scheduler-0\" (UID: \"17638423-bcdb-4b88-b3c8-5faa97ef3d0d\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:50:44 crc kubenswrapper[5120]: I0316 16:50:44.318212 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/17638423-bcdb-4b88-b3c8-5faa97ef3d0d-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"17638423-bcdb-4b88-b3c8-5faa97ef3d0d\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:50:44 crc kubenswrapper[5120]: I0316 16:50:44.318438 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/17638423-bcdb-4b88-b3c8-5faa97ef3d0d-config-data\") pod \"nova-scheduler-0\" (UID: \"17638423-bcdb-4b88-b3c8-5faa97ef3d0d\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:50:44 crc kubenswrapper[5120]: I0316 16:50:44.326462 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/17638423-bcdb-4b88-b3c8-5faa97ef3d0d-config-data\") pod \"nova-scheduler-0\" (UID: \"17638423-bcdb-4b88-b3c8-5faa97ef3d0d\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:50:44 crc kubenswrapper[5120]: I0316 16:50:44.329619 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/17638423-bcdb-4b88-b3c8-5faa97ef3d0d-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"17638423-bcdb-4b88-b3c8-5faa97ef3d0d\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:50:44 crc kubenswrapper[5120]: I0316 16:50:44.339632 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xc4n\" (UniqueName: \"kubernetes.io/projected/17638423-bcdb-4b88-b3c8-5faa97ef3d0d-kube-api-access-4xc4n\") pod \"nova-scheduler-0\" (UID: \"17638423-bcdb-4b88-b3c8-5faa97ef3d0d\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:50:44 crc kubenswrapper[5120]: I0316 16:50:44.350182 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-hj5tn" Mar 16 16:50:44 crc kubenswrapper[5120]: I0316 16:50:44.414073 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:50:44 crc kubenswrapper[5120]: I0316 16:50:44.420586 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/77414d5d-6b19-4bd2-b964-66650dd767e9-vencrypt-tls-certs\") pod \"77414d5d-6b19-4bd2-b964-66650dd767e9\" (UID: \"77414d5d-6b19-4bd2-b964-66650dd767e9\") " Mar 16 16:50:44 crc kubenswrapper[5120]: I0316 16:50:44.420857 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/77414d5d-6b19-4bd2-b964-66650dd767e9-nova-novncproxy-tls-certs\") pod \"77414d5d-6b19-4bd2-b964-66650dd767e9\" (UID: \"77414d5d-6b19-4bd2-b964-66650dd767e9\") " Mar 16 16:50:44 crc kubenswrapper[5120]: I0316 16:50:44.421011 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/77414d5d-6b19-4bd2-b964-66650dd767e9-config-data\") pod \"77414d5d-6b19-4bd2-b964-66650dd767e9\" (UID: \"77414d5d-6b19-4bd2-b964-66650dd767e9\") " Mar 16 16:50:44 crc kubenswrapper[5120]: I0316 16:50:44.421141 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wt6sm\" (UniqueName: \"kubernetes.io/projected/77414d5d-6b19-4bd2-b964-66650dd767e9-kube-api-access-wt6sm\") pod \"77414d5d-6b19-4bd2-b964-66650dd767e9\" (UID: \"77414d5d-6b19-4bd2-b964-66650dd767e9\") " Mar 16 16:50:44 crc kubenswrapper[5120]: I0316 16:50:44.421288 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/77414d5d-6b19-4bd2-b964-66650dd767e9-combined-ca-bundle\") pod \"77414d5d-6b19-4bd2-b964-66650dd767e9\" (UID: \"77414d5d-6b19-4bd2-b964-66650dd767e9\") " Mar 16 16:50:44 crc kubenswrapper[5120]: I0316 16:50:44.444592 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77414d5d-6b19-4bd2-b964-66650dd767e9-kube-api-access-wt6sm" (OuterVolumeSpecName: "kube-api-access-wt6sm") pod "77414d5d-6b19-4bd2-b964-66650dd767e9" (UID: "77414d5d-6b19-4bd2-b964-66650dd767e9"). InnerVolumeSpecName "kube-api-access-wt6sm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:50:44 crc kubenswrapper[5120]: I0316 16:50:44.523413 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dab6fe18-dcd9-476e-a0bc-866bff4864c8-combined-ca-bundle\") pod \"dab6fe18-dcd9-476e-a0bc-866bff4864c8\" (UID: \"dab6fe18-dcd9-476e-a0bc-866bff4864c8\") " Mar 16 16:50:44 crc kubenswrapper[5120]: I0316 16:50:44.523746 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/dab6fe18-dcd9-476e-a0bc-866bff4864c8-scripts\") pod \"dab6fe18-dcd9-476e-a0bc-866bff4864c8\" (UID: \"dab6fe18-dcd9-476e-a0bc-866bff4864c8\") " Mar 16 16:50:44 crc kubenswrapper[5120]: I0316 16:50:44.524335 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dab6fe18-dcd9-476e-a0bc-866bff4864c8-config-data\") pod \"dab6fe18-dcd9-476e-a0bc-866bff4864c8\" (UID: \"dab6fe18-dcd9-476e-a0bc-866bff4864c8\") " Mar 16 16:50:44 crc kubenswrapper[5120]: I0316 16:50:44.525288 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-587mk\" (UniqueName: \"kubernetes.io/projected/dab6fe18-dcd9-476e-a0bc-866bff4864c8-kube-api-access-587mk\") pod \"dab6fe18-dcd9-476e-a0bc-866bff4864c8\" (UID: \"dab6fe18-dcd9-476e-a0bc-866bff4864c8\") " Mar 16 16:50:44 crc kubenswrapper[5120]: I0316 16:50:44.528259 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wt6sm\" (UniqueName: \"kubernetes.io/projected/77414d5d-6b19-4bd2-b964-66650dd767e9-kube-api-access-wt6sm\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:44 crc kubenswrapper[5120]: I0316 16:50:44.535356 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dab6fe18-dcd9-476e-a0bc-866bff4864c8-kube-api-access-587mk" (OuterVolumeSpecName: "kube-api-access-587mk") pod "dab6fe18-dcd9-476e-a0bc-866bff4864c8" (UID: "dab6fe18-dcd9-476e-a0bc-866bff4864c8"). InnerVolumeSpecName "kube-api-access-587mk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:50:44 crc kubenswrapper[5120]: I0316 16:50:44.546328 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dab6fe18-dcd9-476e-a0bc-866bff4864c8-scripts" (OuterVolumeSpecName: "scripts") pod "dab6fe18-dcd9-476e-a0bc-866bff4864c8" (UID: "dab6fe18-dcd9-476e-a0bc-866bff4864c8"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:50:44 crc kubenswrapper[5120]: I0316 16:50:44.562041 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/77414d5d-6b19-4bd2-b964-66650dd767e9-vencrypt-tls-certs" (OuterVolumeSpecName: "vencrypt-tls-certs") pod "77414d5d-6b19-4bd2-b964-66650dd767e9" (UID: "77414d5d-6b19-4bd2-b964-66650dd767e9"). InnerVolumeSpecName "vencrypt-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:50:44 crc kubenswrapper[5120]: I0316 16:50:44.562095 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/77414d5d-6b19-4bd2-b964-66650dd767e9-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "77414d5d-6b19-4bd2-b964-66650dd767e9" (UID: "77414d5d-6b19-4bd2-b964-66650dd767e9"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:50:44 crc kubenswrapper[5120]: I0316 16:50:44.562130 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/77414d5d-6b19-4bd2-b964-66650dd767e9-config-data" (OuterVolumeSpecName: "config-data") pod "77414d5d-6b19-4bd2-b964-66650dd767e9" (UID: "77414d5d-6b19-4bd2-b964-66650dd767e9"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:50:44 crc kubenswrapper[5120]: I0316 16:50:44.613329 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-proxy-588bfd87d6-cq2c8"] Mar 16 16:50:44 crc kubenswrapper[5120]: I0316 16:50:44.622089 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dab6fe18-dcd9-476e-a0bc-866bff4864c8-config-data" (OuterVolumeSpecName: "config-data") pod "dab6fe18-dcd9-476e-a0bc-866bff4864c8" (UID: "dab6fe18-dcd9-476e-a0bc-866bff4864c8"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:50:44 crc kubenswrapper[5120]: I0316 16:50:44.624086 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dab6fe18-dcd9-476e-a0bc-866bff4864c8-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "dab6fe18-dcd9-476e-a0bc-866bff4864c8" (UID: "dab6fe18-dcd9-476e-a0bc-866bff4864c8"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:50:44 crc kubenswrapper[5120]: I0316 16:50:44.632590 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-587mk\" (UniqueName: \"kubernetes.io/projected/dab6fe18-dcd9-476e-a0bc-866bff4864c8-kube-api-access-587mk\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:44 crc kubenswrapper[5120]: I0316 16:50:44.632624 5120 reconciler_common.go:299] "Volume detached for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/77414d5d-6b19-4bd2-b964-66650dd767e9-vencrypt-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:44 crc kubenswrapper[5120]: I0316 16:50:44.632637 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dab6fe18-dcd9-476e-a0bc-866bff4864c8-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:44 crc kubenswrapper[5120]: I0316 16:50:44.632648 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/dab6fe18-dcd9-476e-a0bc-866bff4864c8-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:44 crc kubenswrapper[5120]: I0316 16:50:44.632658 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dab6fe18-dcd9-476e-a0bc-866bff4864c8-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:44 crc kubenswrapper[5120]: I0316 16:50:44.632666 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/77414d5d-6b19-4bd2-b964-66650dd767e9-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:44 crc kubenswrapper[5120]: I0316 16:50:44.632678 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/77414d5d-6b19-4bd2-b964-66650dd767e9-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:44 crc kubenswrapper[5120]: I0316 16:50:44.635420 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/77414d5d-6b19-4bd2-b964-66650dd767e9-nova-novncproxy-tls-certs" (OuterVolumeSpecName: "nova-novncproxy-tls-certs") pod "77414d5d-6b19-4bd2-b964-66650dd767e9" (UID: "77414d5d-6b19-4bd2-b964-66650dd767e9"). InnerVolumeSpecName "nova-novncproxy-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:50:44 crc kubenswrapper[5120]: I0316 16:50:44.747994 5120 reconciler_common.go:299] "Volume detached for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/77414d5d-6b19-4bd2-b964-66650dd767e9-nova-novncproxy-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:44 crc kubenswrapper[5120]: I0316 16:50:44.748459 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3b5c836c-a676-4484-a577-057899847899" path="/var/lib/kubelet/pods/3b5c836c-a676-4484-a577-057899847899/volumes" Mar 16 16:50:44 crc kubenswrapper[5120]: I0316 16:50:44.750176 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="570380b9-e6ba-4935-8812-f3e4f48ed53d" path="/var/lib/kubelet/pods/570380b9-e6ba-4935-8812-f3e4f48ed53d/volumes" Mar 16 16:50:44 crc kubenswrapper[5120]: I0316 16:50:44.751042 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5cdd3029-6592-4907-9550-54a84c3a8cf0" path="/var/lib/kubelet/pods/5cdd3029-6592-4907-9550-54a84c3a8cf0/volumes" Mar 16 16:50:44 crc kubenswrapper[5120]: I0316 16:50:44.828555 5120 generic.go:358] "Generic (PLEG): container finished" podID="38e3968d-4055-452c-a026-2fd65f640c94" containerID="0b4d6823af37760f7a48856d2232b195af45794910cb01da7c0e5e7aab0b7775" exitCode=0 Mar 16 16:50:44 crc kubenswrapper[5120]: I0316 16:50:44.828671 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-c59d54458-jxsr6" event={"ID":"38e3968d-4055-452c-a026-2fd65f640c94","Type":"ContainerDied","Data":"0b4d6823af37760f7a48856d2232b195af45794910cb01da7c0e5e7aab0b7775"} Mar 16 16:50:44 crc kubenswrapper[5120]: I0316 16:50:44.838934 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"77414d5d-6b19-4bd2-b964-66650dd767e9","Type":"ContainerDied","Data":"610568e147ff5f71ce70eff3d7ddd8589da2c14f0afbd846ac64380aba032351"} Mar 16 16:50:44 crc kubenswrapper[5120]: I0316 16:50:44.838981 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:50:44 crc kubenswrapper[5120]: I0316 16:50:44.839005 5120 scope.go:117] "RemoveContainer" containerID="dc440801bbbe91fcc8b94aa7c5ee5ff1fd954b01d0f25becddbd192c10a6b61a" Mar 16 16:50:44 crc kubenswrapper[5120]: I0316 16:50:44.840932 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-588bfd87d6-cq2c8" event={"ID":"119df2a8-0cad-4926-9ad1-eced0db2037d","Type":"ContainerStarted","Data":"a6e6bc3be1119c3cd3003876cd117df507bfa52033efb69aee2caaa223aa07f7"} Mar 16 16:50:44 crc kubenswrapper[5120]: I0316 16:50:44.854600 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-hj5tn" event={"ID":"dab6fe18-dcd9-476e-a0bc-866bff4864c8","Type":"ContainerDied","Data":"d489cc7a1b3d61092023c19c436d160d27c60a605755f7161b7a6da2a890132a"} Mar 16 16:50:44 crc kubenswrapper[5120]: I0316 16:50:44.854651 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d489cc7a1b3d61092023c19c436d160d27c60a605755f7161b7a6da2a890132a" Mar 16 16:50:44 crc kubenswrapper[5120]: I0316 16:50:44.854747 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-hj5tn" Mar 16 16:50:44 crc kubenswrapper[5120]: I0316 16:50:44.892012 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"d6889bc6-32bf-4828-ad98-2f08730fddd6","Type":"ContainerDied","Data":"642afc1ea05ce3c87232f51de3db930b7dfe93f08bc4c402ceba39243e9cb88e"} Mar 16 16:50:44 crc kubenswrapper[5120]: I0316 16:50:44.892125 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:50:44 crc kubenswrapper[5120]: I0316 16:50:44.922409 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:50:44 crc kubenswrapper[5120]: I0316 16:50:44.969881 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:50:44 crc kubenswrapper[5120]: I0316 16:50:44.981832 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:50:44 crc kubenswrapper[5120]: W0316 16:50:44.995147 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb19e43df_ec26_473e_a23f_06c30f7d85e7.slice/crio-a3e1bd2402a702eb8bed5a6e349dfad26a8a8295006ac516c4168859e87337bb WatchSource:0}: Error finding container a3e1bd2402a702eb8bed5a6e349dfad26a8a8295006ac516c4168859e87337bb: Status 404 returned error can't find the container with id a3e1bd2402a702eb8bed5a6e349dfad26a8a8295006ac516c4168859e87337bb Mar 16 16:50:45 crc kubenswrapper[5120]: I0316 16:50:45.007847 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:50:45 crc kubenswrapper[5120]: I0316 16:50:45.008952 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dab6fe18-dcd9-476e-a0bc-866bff4864c8" containerName="nova-manage" Mar 16 16:50:45 crc kubenswrapper[5120]: I0316 16:50:45.008965 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="dab6fe18-dcd9-476e-a0bc-866bff4864c8" containerName="nova-manage" Mar 16 16:50:45 crc kubenswrapper[5120]: I0316 16:50:45.008993 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77414d5d-6b19-4bd2-b964-66650dd767e9" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 16:50:45 crc kubenswrapper[5120]: I0316 16:50:45.009000 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="77414d5d-6b19-4bd2-b964-66650dd767e9" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 16:50:45 crc kubenswrapper[5120]: I0316 16:50:45.009202 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="dab6fe18-dcd9-476e-a0bc-866bff4864c8" containerName="nova-manage" Mar 16 16:50:45 crc kubenswrapper[5120]: I0316 16:50:45.009224 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="77414d5d-6b19-4bd2-b964-66650dd767e9" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 16:50:45 crc kubenswrapper[5120]: I0316 16:50:45.023967 5120 scope.go:117] "RemoveContainer" containerID="6b0e2fd6c626189d757f28b2efb62f642e0b7739467fc756b9941b1ea3f4083f" Mar 16 16:50:45 crc kubenswrapper[5120]: I0316 16:50:45.030315 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:50:45 crc kubenswrapper[5120]: I0316 16:50:45.033277 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-novncproxy-cell1-vencrypt\"" Mar 16 16:50:45 crc kubenswrapper[5120]: I0316 16:50:45.033570 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-novncproxy-config-data\"" Mar 16 16:50:45 crc kubenswrapper[5120]: I0316 16:50:45.033787 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-novncproxy-cell1-public-svc\"" Mar 16 16:50:45 crc kubenswrapper[5120]: I0316 16:50:45.042861 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:50:45 crc kubenswrapper[5120]: I0316 16:50:45.053820 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:50:45 crc kubenswrapper[5120]: I0316 16:50:45.066283 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:50:45 crc kubenswrapper[5120]: I0316 16:50:45.082909 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:50:45 crc kubenswrapper[5120]: I0316 16:50:45.088372 5120 scope.go:117] "RemoveContainer" containerID="ce6c08f074bcf140005337a7f227c6661b14e776f29aa838494adeeae8b544e7" Mar 16 16:50:45 crc kubenswrapper[5120]: I0316 16:50:45.111207 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:50:45 crc kubenswrapper[5120]: I0316 16:50:45.113639 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-config-data\"" Mar 16 16:50:45 crc kubenswrapper[5120]: I0316 16:50:45.113942 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-internal-svc\"" Mar 16 16:50:45 crc kubenswrapper[5120]: I0316 16:50:45.114093 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-public-svc\"" Mar 16 16:50:45 crc kubenswrapper[5120]: I0316 16:50:45.118222 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:50:45 crc kubenswrapper[5120]: I0316 16:50:45.164333 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/3dd23150-3886-4b39-b37c-f25f89a6a6a3-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"3dd23150-3886-4b39-b37c-f25f89a6a6a3\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:50:45 crc kubenswrapper[5120]: I0316 16:50:45.164419 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3dd23150-3886-4b39-b37c-f25f89a6a6a3-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"3dd23150-3886-4b39-b37c-f25f89a6a6a3\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:50:45 crc kubenswrapper[5120]: I0316 16:50:45.164443 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3dd23150-3886-4b39-b37c-f25f89a6a6a3-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"3dd23150-3886-4b39-b37c-f25f89a6a6a3\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:50:45 crc kubenswrapper[5120]: I0316 16:50:45.164465 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kh8lb\" (UniqueName: \"kubernetes.io/projected/3dd23150-3886-4b39-b37c-f25f89a6a6a3-kube-api-access-kh8lb\") pod \"nova-cell1-novncproxy-0\" (UID: \"3dd23150-3886-4b39-b37c-f25f89a6a6a3\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:50:45 crc kubenswrapper[5120]: I0316 16:50:45.164516 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/3dd23150-3886-4b39-b37c-f25f89a6a6a3-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"3dd23150-3886-4b39-b37c-f25f89a6a6a3\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:50:45 crc kubenswrapper[5120]: I0316 16:50:45.189258 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-c59d54458-jxsr6" Mar 16 16:50:45 crc kubenswrapper[5120]: I0316 16:50:45.266114 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/38e3968d-4055-452c-a026-2fd65f640c94-combined-ca-bundle\") pod \"38e3968d-4055-452c-a026-2fd65f640c94\" (UID: \"38e3968d-4055-452c-a026-2fd65f640c94\") " Mar 16 16:50:45 crc kubenswrapper[5120]: I0316 16:50:45.266381 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-54jvf\" (UniqueName: \"kubernetes.io/projected/38e3968d-4055-452c-a026-2fd65f640c94-kube-api-access-54jvf\") pod \"38e3968d-4055-452c-a026-2fd65f640c94\" (UID: \"38e3968d-4055-452c-a026-2fd65f640c94\") " Mar 16 16:50:45 crc kubenswrapper[5120]: I0316 16:50:45.266692 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/38e3968d-4055-452c-a026-2fd65f640c94-httpd-config\") pod \"38e3968d-4055-452c-a026-2fd65f640c94\" (UID: \"38e3968d-4055-452c-a026-2fd65f640c94\") " Mar 16 16:50:45 crc kubenswrapper[5120]: I0316 16:50:45.266749 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/38e3968d-4055-452c-a026-2fd65f640c94-config\") pod \"38e3968d-4055-452c-a026-2fd65f640c94\" (UID: \"38e3968d-4055-452c-a026-2fd65f640c94\") " Mar 16 16:50:45 crc kubenswrapper[5120]: I0316 16:50:45.267457 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b50dad34-ac9d-48e2-833e-a902932cc311-logs\") pod \"nova-api-0\" (UID: \"b50dad34-ac9d-48e2-833e-a902932cc311\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:50:45 crc kubenswrapper[5120]: I0316 16:50:45.267504 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/3dd23150-3886-4b39-b37c-f25f89a6a6a3-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"3dd23150-3886-4b39-b37c-f25f89a6a6a3\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:50:45 crc kubenswrapper[5120]: I0316 16:50:45.267530 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/b50dad34-ac9d-48e2-833e-a902932cc311-internal-tls-certs\") pod \"nova-api-0\" (UID: \"b50dad34-ac9d-48e2-833e-a902932cc311\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:50:45 crc kubenswrapper[5120]: I0316 16:50:45.267598 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvbdt\" (UniqueName: \"kubernetes.io/projected/b50dad34-ac9d-48e2-833e-a902932cc311-kube-api-access-zvbdt\") pod \"nova-api-0\" (UID: \"b50dad34-ac9d-48e2-833e-a902932cc311\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:50:45 crc kubenswrapper[5120]: I0316 16:50:45.267636 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3dd23150-3886-4b39-b37c-f25f89a6a6a3-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"3dd23150-3886-4b39-b37c-f25f89a6a6a3\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:50:45 crc kubenswrapper[5120]: I0316 16:50:45.267656 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/b50dad34-ac9d-48e2-833e-a902932cc311-public-tls-certs\") pod \"nova-api-0\" (UID: \"b50dad34-ac9d-48e2-833e-a902932cc311\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:50:45 crc kubenswrapper[5120]: I0316 16:50:45.267680 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3dd23150-3886-4b39-b37c-f25f89a6a6a3-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"3dd23150-3886-4b39-b37c-f25f89a6a6a3\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:50:45 crc kubenswrapper[5120]: I0316 16:50:45.267704 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kh8lb\" (UniqueName: \"kubernetes.io/projected/3dd23150-3886-4b39-b37c-f25f89a6a6a3-kube-api-access-kh8lb\") pod \"nova-cell1-novncproxy-0\" (UID: \"3dd23150-3886-4b39-b37c-f25f89a6a6a3\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:50:45 crc kubenswrapper[5120]: I0316 16:50:45.267790 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/3dd23150-3886-4b39-b37c-f25f89a6a6a3-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"3dd23150-3886-4b39-b37c-f25f89a6a6a3\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:50:45 crc kubenswrapper[5120]: I0316 16:50:45.267823 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b50dad34-ac9d-48e2-833e-a902932cc311-config-data\") pod \"nova-api-0\" (UID: \"b50dad34-ac9d-48e2-833e-a902932cc311\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:50:45 crc kubenswrapper[5120]: I0316 16:50:45.268003 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b50dad34-ac9d-48e2-833e-a902932cc311-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"b50dad34-ac9d-48e2-833e-a902932cc311\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:50:45 crc kubenswrapper[5120]: I0316 16:50:45.277829 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38e3968d-4055-452c-a026-2fd65f640c94-httpd-config" (OuterVolumeSpecName: "httpd-config") pod "38e3968d-4055-452c-a026-2fd65f640c94" (UID: "38e3968d-4055-452c-a026-2fd65f640c94"). InnerVolumeSpecName "httpd-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:50:45 crc kubenswrapper[5120]: I0316 16:50:45.284568 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38e3968d-4055-452c-a026-2fd65f640c94-kube-api-access-54jvf" (OuterVolumeSpecName: "kube-api-access-54jvf") pod "38e3968d-4055-452c-a026-2fd65f640c94" (UID: "38e3968d-4055-452c-a026-2fd65f640c94"). InnerVolumeSpecName "kube-api-access-54jvf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:50:45 crc kubenswrapper[5120]: I0316 16:50:45.295634 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/3dd23150-3886-4b39-b37c-f25f89a6a6a3-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"3dd23150-3886-4b39-b37c-f25f89a6a6a3\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:50:45 crc kubenswrapper[5120]: I0316 16:50:45.298406 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3dd23150-3886-4b39-b37c-f25f89a6a6a3-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"3dd23150-3886-4b39-b37c-f25f89a6a6a3\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:50:45 crc kubenswrapper[5120]: I0316 16:50:45.298489 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3dd23150-3886-4b39-b37c-f25f89a6a6a3-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"3dd23150-3886-4b39-b37c-f25f89a6a6a3\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:50:45 crc kubenswrapper[5120]: I0316 16:50:45.318405 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kh8lb\" (UniqueName: \"kubernetes.io/projected/3dd23150-3886-4b39-b37c-f25f89a6a6a3-kube-api-access-kh8lb\") pod \"nova-cell1-novncproxy-0\" (UID: \"3dd23150-3886-4b39-b37c-f25f89a6a6a3\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:50:45 crc kubenswrapper[5120]: I0316 16:50:45.321392 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/3dd23150-3886-4b39-b37c-f25f89a6a6a3-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"3dd23150-3886-4b39-b37c-f25f89a6a6a3\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:50:45 crc kubenswrapper[5120]: I0316 16:50:45.370604 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b50dad34-ac9d-48e2-833e-a902932cc311-logs\") pod \"nova-api-0\" (UID: \"b50dad34-ac9d-48e2-833e-a902932cc311\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:50:45 crc kubenswrapper[5120]: I0316 16:50:45.370691 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/b50dad34-ac9d-48e2-833e-a902932cc311-internal-tls-certs\") pod \"nova-api-0\" (UID: \"b50dad34-ac9d-48e2-833e-a902932cc311\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:50:45 crc kubenswrapper[5120]: I0316 16:50:45.370779 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zvbdt\" (UniqueName: \"kubernetes.io/projected/b50dad34-ac9d-48e2-833e-a902932cc311-kube-api-access-zvbdt\") pod \"nova-api-0\" (UID: \"b50dad34-ac9d-48e2-833e-a902932cc311\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:50:45 crc kubenswrapper[5120]: I0316 16:50:45.370820 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/b50dad34-ac9d-48e2-833e-a902932cc311-public-tls-certs\") pod \"nova-api-0\" (UID: \"b50dad34-ac9d-48e2-833e-a902932cc311\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:50:45 crc kubenswrapper[5120]: I0316 16:50:45.370901 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b50dad34-ac9d-48e2-833e-a902932cc311-config-data\") pod \"nova-api-0\" (UID: \"b50dad34-ac9d-48e2-833e-a902932cc311\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:50:45 crc kubenswrapper[5120]: I0316 16:50:45.371063 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b50dad34-ac9d-48e2-833e-a902932cc311-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"b50dad34-ac9d-48e2-833e-a902932cc311\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:50:45 crc kubenswrapper[5120]: I0316 16:50:45.374010 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-54jvf\" (UniqueName: \"kubernetes.io/projected/38e3968d-4055-452c-a026-2fd65f640c94-kube-api-access-54jvf\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:45 crc kubenswrapper[5120]: I0316 16:50:45.374036 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/38e3968d-4055-452c-a026-2fd65f640c94-httpd-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:45 crc kubenswrapper[5120]: I0316 16:50:45.372096 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:50:45 crc kubenswrapper[5120]: I0316 16:50:45.371508 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b50dad34-ac9d-48e2-833e-a902932cc311-logs\") pod \"nova-api-0\" (UID: \"b50dad34-ac9d-48e2-833e-a902932cc311\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:50:45 crc kubenswrapper[5120]: I0316 16:50:45.382898 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/b50dad34-ac9d-48e2-833e-a902932cc311-public-tls-certs\") pod \"nova-api-0\" (UID: \"b50dad34-ac9d-48e2-833e-a902932cc311\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:50:45 crc kubenswrapper[5120]: I0316 16:50:45.389473 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/b50dad34-ac9d-48e2-833e-a902932cc311-internal-tls-certs\") pod \"nova-api-0\" (UID: \"b50dad34-ac9d-48e2-833e-a902932cc311\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:50:45 crc kubenswrapper[5120]: I0316 16:50:45.394226 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b50dad34-ac9d-48e2-833e-a902932cc311-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"b50dad34-ac9d-48e2-833e-a902932cc311\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:50:45 crc kubenswrapper[5120]: I0316 16:50:45.399488 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b50dad34-ac9d-48e2-833e-a902932cc311-config-data\") pod \"nova-api-0\" (UID: \"b50dad34-ac9d-48e2-833e-a902932cc311\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:50:45 crc kubenswrapper[5120]: I0316 16:50:45.406962 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvbdt\" (UniqueName: \"kubernetes.io/projected/b50dad34-ac9d-48e2-833e-a902932cc311-kube-api-access-zvbdt\") pod \"nova-api-0\" (UID: \"b50dad34-ac9d-48e2-833e-a902932cc311\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:50:45 crc kubenswrapper[5120]: I0316 16:50:45.425568 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38e3968d-4055-452c-a026-2fd65f640c94-config" (OuterVolumeSpecName: "config") pod "38e3968d-4055-452c-a026-2fd65f640c94" (UID: "38e3968d-4055-452c-a026-2fd65f640c94"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:50:45 crc kubenswrapper[5120]: I0316 16:50:45.488497 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/38e3968d-4055-452c-a026-2fd65f640c94-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:45 crc kubenswrapper[5120]: I0316 16:50:45.493410 5120 scope.go:117] "RemoveContainer" containerID="98b2374030d93b00ce1ee54fb9150860666bb11c6341068f7353f783167c3c70" Mar 16 16:50:45 crc kubenswrapper[5120]: I0316 16:50:45.498727 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:50:45 crc kubenswrapper[5120]: I0316 16:50:45.506880 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38e3968d-4055-452c-a026-2fd65f640c94-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "38e3968d-4055-452c-a026-2fd65f640c94" (UID: "38e3968d-4055-452c-a026-2fd65f640c94"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:50:45 crc kubenswrapper[5120]: W0316 16:50:45.509186 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod17638423_bcdb_4b88_b3c8_5faa97ef3d0d.slice/crio-42c62c71087679bfec82bdea705ab9734387eb872276a60c990beaf3d7218b07 WatchSource:0}: Error finding container 42c62c71087679bfec82bdea705ab9734387eb872276a60c990beaf3d7218b07: Status 404 returned error can't find the container with id 42c62c71087679bfec82bdea705ab9734387eb872276a60c990beaf3d7218b07 Mar 16 16:50:45 crc kubenswrapper[5120]: I0316 16:50:45.521011 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:50:45 crc kubenswrapper[5120]: I0316 16:50:45.602130 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/38e3968d-4055-452c-a026-2fd65f640c94-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:45 crc kubenswrapper[5120]: I0316 16:50:45.654457 5120 scope.go:117] "RemoveContainer" containerID="b18f58ad72df1394f60852743cec1405ff4ce5968d7a0bc69501221e5ebaf3dd" Mar 16 16:50:45 crc kubenswrapper[5120]: I0316 16:50:45.687465 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:50:45 crc kubenswrapper[5120]: I0316 16:50:45.712192 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:50:45 crc kubenswrapper[5120]: I0316 16:50:45.729545 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:50:45 crc kubenswrapper[5120]: I0316 16:50:45.747365 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:50:45 crc kubenswrapper[5120]: I0316 16:50:45.788316 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:50:45 crc kubenswrapper[5120]: I0316 16:50:45.925611 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eb90a8d0-f858-47b0-9aa6-f71216c2dbf3-combined-ca-bundle\") pod \"eb90a8d0-f858-47b0-9aa6-f71216c2dbf3\" (UID: \"eb90a8d0-f858-47b0-9aa6-f71216c2dbf3\") " Mar 16 16:50:45 crc kubenswrapper[5120]: I0316 16:50:45.926055 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6zb7w\" (UniqueName: \"kubernetes.io/projected/eb90a8d0-f858-47b0-9aa6-f71216c2dbf3-kube-api-access-6zb7w\") pod \"eb90a8d0-f858-47b0-9aa6-f71216c2dbf3\" (UID: \"eb90a8d0-f858-47b0-9aa6-f71216c2dbf3\") " Mar 16 16:50:45 crc kubenswrapper[5120]: I0316 16:50:45.926165 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/eb90a8d0-f858-47b0-9aa6-f71216c2dbf3-config-data\") pod \"eb90a8d0-f858-47b0-9aa6-f71216c2dbf3\" (UID: \"eb90a8d0-f858-47b0-9aa6-f71216c2dbf3\") " Mar 16 16:50:45 crc kubenswrapper[5120]: I0316 16:50:45.952026 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb90a8d0-f858-47b0-9aa6-f71216c2dbf3-kube-api-access-6zb7w" (OuterVolumeSpecName: "kube-api-access-6zb7w") pod "eb90a8d0-f858-47b0-9aa6-f71216c2dbf3" (UID: "eb90a8d0-f858-47b0-9aa6-f71216c2dbf3"). InnerVolumeSpecName "kube-api-access-6zb7w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:50:46 crc kubenswrapper[5120]: I0316 16:50:46.016474 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eb90a8d0-f858-47b0-9aa6-f71216c2dbf3-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "eb90a8d0-f858-47b0-9aa6-f71216c2dbf3" (UID: "eb90a8d0-f858-47b0-9aa6-f71216c2dbf3"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:50:46 crc kubenswrapper[5120]: I0316 16:50:46.037307 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eb90a8d0-f858-47b0-9aa6-f71216c2dbf3-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:46 crc kubenswrapper[5120]: I0316 16:50:46.038557 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6zb7w\" (UniqueName: \"kubernetes.io/projected/eb90a8d0-f858-47b0-9aa6-f71216c2dbf3-kube-api-access-6zb7w\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:46 crc kubenswrapper[5120]: I0316 16:50:46.056194 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eb90a8d0-f858-47b0-9aa6-f71216c2dbf3-config-data" (OuterVolumeSpecName: "config-data") pod "eb90a8d0-f858-47b0-9aa6-f71216c2dbf3" (UID: "eb90a8d0-f858-47b0-9aa6-f71216c2dbf3"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:50:46 crc kubenswrapper[5120]: I0316 16:50:46.083056 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:50:46 crc kubenswrapper[5120]: I0316 16:50:46.091329 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"b19e43df-ec26-473e-a23f-06c30f7d85e7","Type":"ContainerStarted","Data":"cc96184aaab6fef272ba57e59f50ba1695409339b08bb1794e71b8ee249784ea"} Mar 16 16:50:46 crc kubenswrapper[5120]: I0316 16:50:46.091389 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"b19e43df-ec26-473e-a23f-06c30f7d85e7","Type":"ContainerStarted","Data":"a3e1bd2402a702eb8bed5a6e349dfad26a8a8295006ac516c4168859e87337bb"} Mar 16 16:50:46 crc kubenswrapper[5120]: I0316 16:50:46.126483 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-c59d54458-jxsr6" event={"ID":"38e3968d-4055-452c-a026-2fd65f640c94","Type":"ContainerDied","Data":"9ffd4db2095c5610c79a52cad064ac2e1b4b7dc0eb040709f787e6dd09c44c3c"} Mar 16 16:50:46 crc kubenswrapper[5120]: I0316 16:50:46.126535 5120 scope.go:117] "RemoveContainer" containerID="ffb40f5577b6914ba356f72dc5e5487f3271ee8e4fb606a56342dab08732b090" Mar 16 16:50:46 crc kubenswrapper[5120]: I0316 16:50:46.126655 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-c59d54458-jxsr6" Mar 16 16:50:46 crc kubenswrapper[5120]: I0316 16:50:46.142347 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/eb90a8d0-f858-47b0-9aa6-f71216c2dbf3-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:46 crc kubenswrapper[5120]: I0316 16:50:46.160074 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"17638423-bcdb-4b88-b3c8-5faa97ef3d0d","Type":"ContainerStarted","Data":"42c62c71087679bfec82bdea705ab9734387eb872276a60c990beaf3d7218b07"} Mar 16 16:50:46 crc kubenswrapper[5120]: I0316 16:50:46.195303 5120 generic.go:358] "Generic (PLEG): container finished" podID="eb90a8d0-f858-47b0-9aa6-f71216c2dbf3" containerID="2afbc86ce4b710643717284b621aea1d6ef607f26bd64e0e5894cc523ddd9abe" exitCode=1 Mar 16 16:50:46 crc kubenswrapper[5120]: I0316 16:50:46.195483 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"eb90a8d0-f858-47b0-9aa6-f71216c2dbf3","Type":"ContainerDied","Data":"2afbc86ce4b710643717284b621aea1d6ef607f26bd64e0e5894cc523ddd9abe"} Mar 16 16:50:46 crc kubenswrapper[5120]: I0316 16:50:46.195525 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"eb90a8d0-f858-47b0-9aa6-f71216c2dbf3","Type":"ContainerDied","Data":"90c5c6a4e98960536b9b83bf266edb75481aec7335ac5d55cac6c865f2b8a81f"} Mar 16 16:50:46 crc kubenswrapper[5120]: I0316 16:50:46.195864 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:50:46 crc kubenswrapper[5120]: I0316 16:50:46.207297 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-588bfd87d6-cq2c8" event={"ID":"119df2a8-0cad-4926-9ad1-eced0db2037d","Type":"ContainerStarted","Data":"b9b06f5bd596d4bdbcb9074a49c7fb274d36644b6129bce1b9dce24f5aae10eb"} Mar 16 16:50:46 crc kubenswrapper[5120]: I0316 16:50:46.218807 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-c59d54458-jxsr6"] Mar 16 16:50:46 crc kubenswrapper[5120]: I0316 16:50:46.240374 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-c59d54458-jxsr6"] Mar 16 16:50:46 crc kubenswrapper[5120]: I0316 16:50:46.252022 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 16:50:46 crc kubenswrapper[5120]: I0316 16:50:46.260640 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 16:50:46 crc kubenswrapper[5120]: I0316 16:50:46.338010 5120 scope.go:117] "RemoveContainer" containerID="0b4d6823af37760f7a48856d2232b195af45794910cb01da7c0e5e7aab0b7775" Mar 16 16:50:46 crc kubenswrapper[5120]: I0316 16:50:46.339268 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 16:50:46 crc kubenswrapper[5120]: I0316 16:50:46.340458 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38e3968d-4055-452c-a026-2fd65f640c94" containerName="neutron-httpd" Mar 16 16:50:46 crc kubenswrapper[5120]: I0316 16:50:46.340545 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="38e3968d-4055-452c-a026-2fd65f640c94" containerName="neutron-httpd" Mar 16 16:50:46 crc kubenswrapper[5120]: I0316 16:50:46.340653 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38e3968d-4055-452c-a026-2fd65f640c94" containerName="neutron-api" Mar 16 16:50:46 crc kubenswrapper[5120]: I0316 16:50:46.340714 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="38e3968d-4055-452c-a026-2fd65f640c94" containerName="neutron-api" Mar 16 16:50:46 crc kubenswrapper[5120]: I0316 16:50:46.340786 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb90a8d0-f858-47b0-9aa6-f71216c2dbf3" containerName="nova-cell1-conductor-conductor" Mar 16 16:50:46 crc kubenswrapper[5120]: I0316 16:50:46.340835 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb90a8d0-f858-47b0-9aa6-f71216c2dbf3" containerName="nova-cell1-conductor-conductor" Mar 16 16:50:46 crc kubenswrapper[5120]: I0316 16:50:46.341047 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="eb90a8d0-f858-47b0-9aa6-f71216c2dbf3" containerName="nova-cell1-conductor-conductor" Mar 16 16:50:46 crc kubenswrapper[5120]: I0316 16:50:46.341110 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="38e3968d-4055-452c-a026-2fd65f640c94" containerName="neutron-httpd" Mar 16 16:50:46 crc kubenswrapper[5120]: I0316 16:50:46.341172 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="38e3968d-4055-452c-a026-2fd65f640c94" containerName="neutron-api" Mar 16 16:50:46 crc kubenswrapper[5120]: I0316 16:50:46.352027 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:50:46 crc kubenswrapper[5120]: I0316 16:50:46.357301 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-conductor-config-data\"" Mar 16 16:50:46 crc kubenswrapper[5120]: I0316 16:50:46.385472 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 16:50:46 crc kubenswrapper[5120]: I0316 16:50:46.436052 5120 scope.go:117] "RemoveContainer" containerID="2afbc86ce4b710643717284b621aea1d6ef607f26bd64e0e5894cc523ddd9abe" Mar 16 16:50:46 crc kubenswrapper[5120]: I0316 16:50:46.451400 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d43280dd-cd49-4365-8474-7bab9f5b4899-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"d43280dd-cd49-4365-8474-7bab9f5b4899\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:50:46 crc kubenswrapper[5120]: I0316 16:50:46.451568 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8wq5\" (UniqueName: \"kubernetes.io/projected/d43280dd-cd49-4365-8474-7bab9f5b4899-kube-api-access-p8wq5\") pod \"nova-cell1-conductor-0\" (UID: \"d43280dd-cd49-4365-8474-7bab9f5b4899\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:50:46 crc kubenswrapper[5120]: I0316 16:50:46.451682 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d43280dd-cd49-4365-8474-7bab9f5b4899-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"d43280dd-cd49-4365-8474-7bab9f5b4899\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:50:46 crc kubenswrapper[5120]: I0316 16:50:46.464890 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:50:46 crc kubenswrapper[5120]: I0316 16:50:46.487365 5120 scope.go:117] "RemoveContainer" containerID="2afbc86ce4b710643717284b621aea1d6ef607f26bd64e0e5894cc523ddd9abe" Mar 16 16:50:46 crc kubenswrapper[5120]: E0316 16:50:46.488515 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2afbc86ce4b710643717284b621aea1d6ef607f26bd64e0e5894cc523ddd9abe\": container with ID starting with 2afbc86ce4b710643717284b621aea1d6ef607f26bd64e0e5894cc523ddd9abe not found: ID does not exist" containerID="2afbc86ce4b710643717284b621aea1d6ef607f26bd64e0e5894cc523ddd9abe" Mar 16 16:50:46 crc kubenswrapper[5120]: I0316 16:50:46.488580 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2afbc86ce4b710643717284b621aea1d6ef607f26bd64e0e5894cc523ddd9abe"} err="failed to get container status \"2afbc86ce4b710643717284b621aea1d6ef607f26bd64e0e5894cc523ddd9abe\": rpc error: code = NotFound desc = could not find container \"2afbc86ce4b710643717284b621aea1d6ef607f26bd64e0e5894cc523ddd9abe\": container with ID starting with 2afbc86ce4b710643717284b621aea1d6ef607f26bd64e0e5894cc523ddd9abe not found: ID does not exist" Mar 16 16:50:46 crc kubenswrapper[5120]: I0316 16:50:46.553507 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d43280dd-cd49-4365-8474-7bab9f5b4899-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"d43280dd-cd49-4365-8474-7bab9f5b4899\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:50:46 crc kubenswrapper[5120]: I0316 16:50:46.553660 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p8wq5\" (UniqueName: \"kubernetes.io/projected/d43280dd-cd49-4365-8474-7bab9f5b4899-kube-api-access-p8wq5\") pod \"nova-cell1-conductor-0\" (UID: \"d43280dd-cd49-4365-8474-7bab9f5b4899\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:50:46 crc kubenswrapper[5120]: I0316 16:50:46.553798 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d43280dd-cd49-4365-8474-7bab9f5b4899-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"d43280dd-cd49-4365-8474-7bab9f5b4899\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:50:46 crc kubenswrapper[5120]: I0316 16:50:46.566649 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d43280dd-cd49-4365-8474-7bab9f5b4899-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"d43280dd-cd49-4365-8474-7bab9f5b4899\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:50:46 crc kubenswrapper[5120]: I0316 16:50:46.568483 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d43280dd-cd49-4365-8474-7bab9f5b4899-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"d43280dd-cd49-4365-8474-7bab9f5b4899\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:50:46 crc kubenswrapper[5120]: I0316 16:50:46.578292 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8wq5\" (UniqueName: \"kubernetes.io/projected/d43280dd-cd49-4365-8474-7bab9f5b4899-kube-api-access-p8wq5\") pod \"nova-cell1-conductor-0\" (UID: \"d43280dd-cd49-4365-8474-7bab9f5b4899\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:50:46 crc kubenswrapper[5120]: I0316 16:50:46.685072 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:50:46 crc kubenswrapper[5120]: I0316 16:50:46.691542 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="38e3968d-4055-452c-a026-2fd65f640c94" path="/var/lib/kubelet/pods/38e3968d-4055-452c-a026-2fd65f640c94/volumes" Mar 16 16:50:46 crc kubenswrapper[5120]: I0316 16:50:46.693629 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="77414d5d-6b19-4bd2-b964-66650dd767e9" path="/var/lib/kubelet/pods/77414d5d-6b19-4bd2-b964-66650dd767e9/volumes" Mar 16 16:50:46 crc kubenswrapper[5120]: I0316 16:50:46.694241 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d6889bc6-32bf-4828-ad98-2f08730fddd6" path="/var/lib/kubelet/pods/d6889bc6-32bf-4828-ad98-2f08730fddd6/volumes" Mar 16 16:50:46 crc kubenswrapper[5120]: I0316 16:50:46.695338 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eb90a8d0-f858-47b0-9aa6-f71216c2dbf3" path="/var/lib/kubelet/pods/eb90a8d0-f858-47b0-9aa6-f71216c2dbf3/volumes" Mar 16 16:50:47 crc kubenswrapper[5120]: I0316 16:50:47.243492 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 16:50:47 crc kubenswrapper[5120]: I0316 16:50:47.261447 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"17638423-bcdb-4b88-b3c8-5faa97ef3d0d","Type":"ContainerStarted","Data":"ca30b4bf5029782ac5fccfa5bde0a8f21e74359eb71da809a8208214a27e1a23"} Mar 16 16:50:47 crc kubenswrapper[5120]: I0316 16:50:47.261642 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="17638423-bcdb-4b88-b3c8-5faa97ef3d0d" containerName="nova-scheduler-scheduler" containerID="cri-o://ca30b4bf5029782ac5fccfa5bde0a8f21e74359eb71da809a8208214a27e1a23" gracePeriod=30 Mar 16 16:50:47 crc kubenswrapper[5120]: I0316 16:50:47.280017 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 16:50:47 crc kubenswrapper[5120]: I0316 16:50:47.289217 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-588bfd87d6-cq2c8" event={"ID":"119df2a8-0cad-4926-9ad1-eced0db2037d","Type":"ContainerStarted","Data":"07617e76b5d2c78f4060a6aa82a0449bb7e6be66b37fdf9f043fabc4528cb11c"} Mar 16 16:50:47 crc kubenswrapper[5120]: I0316 16:50:47.290977 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/swift-proxy-588bfd87d6-cq2c8" Mar 16 16:50:47 crc kubenswrapper[5120]: I0316 16:50:47.291093 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/swift-proxy-588bfd87d6-cq2c8" Mar 16 16:50:47 crc kubenswrapper[5120]: I0316 16:50:47.289260 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-scheduler-0" podStartSLOduration=4.289242865 podStartE2EDuration="4.289242865s" podCreationTimestamp="2026-03-16 16:50:43 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:50:47.285004299 +0000 UTC m=+4749.438935956" watchObservedRunningTime="2026-03-16 16:50:47.289242865 +0000 UTC m=+4749.443174522" Mar 16 16:50:47 crc kubenswrapper[5120]: I0316 16:50:47.298610 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"b19e43df-ec26-473e-a23f-06c30f7d85e7","Type":"ContainerStarted","Data":"e884b23494332ba8aebf4738f6efdf28d7343a7d04449a1a32760481d6c09f19"} Mar 16 16:50:47 crc kubenswrapper[5120]: I0316 16:50:47.298934 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="b19e43df-ec26-473e-a23f-06c30f7d85e7" containerName="nova-metadata-log" containerID="cri-o://cc96184aaab6fef272ba57e59f50ba1695409339b08bb1794e71b8ee249784ea" gracePeriod=30 Mar 16 16:50:47 crc kubenswrapper[5120]: I0316 16:50:47.299107 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="b19e43df-ec26-473e-a23f-06c30f7d85e7" containerName="nova-metadata-metadata" containerID="cri-o://e884b23494332ba8aebf4738f6efdf28d7343a7d04449a1a32760481d6c09f19" gracePeriod=30 Mar 16 16:50:47 crc kubenswrapper[5120]: I0316 16:50:47.342529 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podUID="3dd23150-3886-4b39-b37c-f25f89a6a6a3" containerName="nova-cell1-novncproxy-novncproxy" containerID="cri-o://576542c7a6aba49256f021a7a58f1c009884e872a1c8345cc417bd2c6f35f4b8" gracePeriod=30 Mar 16 16:50:47 crc kubenswrapper[5120]: I0316 16:50:47.342566 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"3dd23150-3886-4b39-b37c-f25f89a6a6a3","Type":"ContainerStarted","Data":"576542c7a6aba49256f021a7a58f1c009884e872a1c8345cc417bd2c6f35f4b8"} Mar 16 16:50:47 crc kubenswrapper[5120]: I0316 16:50:47.342789 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"3dd23150-3886-4b39-b37c-f25f89a6a6a3","Type":"ContainerStarted","Data":"147f9dbc5bdec8bf5b67c4a6cc8c724cd78d704987cafa98a2f1de7c380ea3da"} Mar 16 16:50:47 crc kubenswrapper[5120]: I0316 16:50:47.353649 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/swift-proxy-588bfd87d6-cq2c8" podStartSLOduration=4.353628911 podStartE2EDuration="4.353628911s" podCreationTimestamp="2026-03-16 16:50:43 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:50:47.316594005 +0000 UTC m=+4749.470525662" watchObservedRunningTime="2026-03-16 16:50:47.353628911 +0000 UTC m=+4749.507560568" Mar 16 16:50:47 crc kubenswrapper[5120]: I0316 16:50:47.394639 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"b50dad34-ac9d-48e2-833e-a902932cc311","Type":"ContainerStarted","Data":"dbf315c8df9205f2482ada22ca7c46d5ccb8e4b09237efdd69223dcf7cf4c7af"} Mar 16 16:50:47 crc kubenswrapper[5120]: I0316 16:50:47.395020 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"b50dad34-ac9d-48e2-833e-a902932cc311","Type":"ContainerStarted","Data":"88056889e91daa4719a90aee633b6c699f2759c2e1c250d3fcaf5747c34c7a28"} Mar 16 16:50:47 crc kubenswrapper[5120]: I0316 16:50:47.408277 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=4.40825557 podStartE2EDuration="4.40825557s" podCreationTimestamp="2026-03-16 16:50:43 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:50:47.352165821 +0000 UTC m=+4749.506097498" watchObservedRunningTime="2026-03-16 16:50:47.40825557 +0000 UTC m=+4749.562187227" Mar 16 16:50:47 crc kubenswrapper[5120]: I0316 16:50:47.418250 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podStartSLOduration=3.418230194 podStartE2EDuration="3.418230194s" podCreationTimestamp="2026-03-16 16:50:44 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:50:47.398891023 +0000 UTC m=+4749.552822680" watchObservedRunningTime="2026-03-16 16:50:47.418230194 +0000 UTC m=+4749.572161851" Mar 16 16:50:47 crc kubenswrapper[5120]: I0316 16:50:47.420581 5120 generic.go:358] "Generic (PLEG): container finished" podID="55b29fdd-871f-4603-afd0-b2e13728f594" containerID="efec4213034fff9ef64172922016741a3af69ee9511bd701e257ed3c886e8388" exitCode=1 Mar 16 16:50:47 crc kubenswrapper[5120]: I0316 16:50:47.420730 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"55b29fdd-871f-4603-afd0-b2e13728f594","Type":"ContainerDied","Data":"efec4213034fff9ef64172922016741a3af69ee9511bd701e257ed3c886e8388"} Mar 16 16:50:47 crc kubenswrapper[5120]: I0316 16:50:47.420946 5120 scope.go:117] "RemoveContainer" containerID="aa03e4da90e39959e9684043c680d3e34939e072ebb3c5c54a4e9e7c897bc0b8" Mar 16 16:50:47 crc kubenswrapper[5120]: I0316 16:50:47.777749 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:50:47 crc kubenswrapper[5120]: I0316 16:50:47.947808 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/55b29fdd-871f-4603-afd0-b2e13728f594-combined-ca-bundle\") pod \"55b29fdd-871f-4603-afd0-b2e13728f594\" (UID: \"55b29fdd-871f-4603-afd0-b2e13728f594\") " Mar 16 16:50:47 crc kubenswrapper[5120]: I0316 16:50:47.948352 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/55b29fdd-871f-4603-afd0-b2e13728f594-config-data\") pod \"55b29fdd-871f-4603-afd0-b2e13728f594\" (UID: \"55b29fdd-871f-4603-afd0-b2e13728f594\") " Mar 16 16:50:47 crc kubenswrapper[5120]: I0316 16:50:47.948575 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5qq7l\" (UniqueName: \"kubernetes.io/projected/55b29fdd-871f-4603-afd0-b2e13728f594-kube-api-access-5qq7l\") pod \"55b29fdd-871f-4603-afd0-b2e13728f594\" (UID: \"55b29fdd-871f-4603-afd0-b2e13728f594\") " Mar 16 16:50:47 crc kubenswrapper[5120]: I0316 16:50:47.987013 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/55b29fdd-871f-4603-afd0-b2e13728f594-kube-api-access-5qq7l" (OuterVolumeSpecName: "kube-api-access-5qq7l") pod "55b29fdd-871f-4603-afd0-b2e13728f594" (UID: "55b29fdd-871f-4603-afd0-b2e13728f594"). InnerVolumeSpecName "kube-api-access-5qq7l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:50:48 crc kubenswrapper[5120]: I0316 16:50:48.035576 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/55b29fdd-871f-4603-afd0-b2e13728f594-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "55b29fdd-871f-4603-afd0-b2e13728f594" (UID: "55b29fdd-871f-4603-afd0-b2e13728f594"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:50:48 crc kubenswrapper[5120]: I0316 16:50:48.043657 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/55b29fdd-871f-4603-afd0-b2e13728f594-config-data" (OuterVolumeSpecName: "config-data") pod "55b29fdd-871f-4603-afd0-b2e13728f594" (UID: "55b29fdd-871f-4603-afd0-b2e13728f594"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:50:48 crc kubenswrapper[5120]: I0316 16:50:48.051560 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/55b29fdd-871f-4603-afd0-b2e13728f594-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:48 crc kubenswrapper[5120]: I0316 16:50:48.051594 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5qq7l\" (UniqueName: \"kubernetes.io/projected/55b29fdd-871f-4603-afd0-b2e13728f594-kube-api-access-5qq7l\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:48 crc kubenswrapper[5120]: I0316 16:50:48.051604 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/55b29fdd-871f-4603-afd0-b2e13728f594-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:48 crc kubenswrapper[5120]: I0316 16:50:48.102067 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:50:48 crc kubenswrapper[5120]: I0316 16:50:48.255067 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b19e43df-ec26-473e-a23f-06c30f7d85e7-config-data\") pod \"b19e43df-ec26-473e-a23f-06c30f7d85e7\" (UID: \"b19e43df-ec26-473e-a23f-06c30f7d85e7\") " Mar 16 16:50:48 crc kubenswrapper[5120]: I0316 16:50:48.255810 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/b19e43df-ec26-473e-a23f-06c30f7d85e7-nova-metadata-tls-certs\") pod \"b19e43df-ec26-473e-a23f-06c30f7d85e7\" (UID: \"b19e43df-ec26-473e-a23f-06c30f7d85e7\") " Mar 16 16:50:48 crc kubenswrapper[5120]: I0316 16:50:48.255892 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b19e43df-ec26-473e-a23f-06c30f7d85e7-combined-ca-bundle\") pod \"b19e43df-ec26-473e-a23f-06c30f7d85e7\" (UID: \"b19e43df-ec26-473e-a23f-06c30f7d85e7\") " Mar 16 16:50:48 crc kubenswrapper[5120]: I0316 16:50:48.255971 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t2djb\" (UniqueName: \"kubernetes.io/projected/b19e43df-ec26-473e-a23f-06c30f7d85e7-kube-api-access-t2djb\") pod \"b19e43df-ec26-473e-a23f-06c30f7d85e7\" (UID: \"b19e43df-ec26-473e-a23f-06c30f7d85e7\") " Mar 16 16:50:48 crc kubenswrapper[5120]: I0316 16:50:48.256034 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b19e43df-ec26-473e-a23f-06c30f7d85e7-logs\") pod \"b19e43df-ec26-473e-a23f-06c30f7d85e7\" (UID: \"b19e43df-ec26-473e-a23f-06c30f7d85e7\") " Mar 16 16:50:48 crc kubenswrapper[5120]: I0316 16:50:48.256461 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b19e43df-ec26-473e-a23f-06c30f7d85e7-logs" (OuterVolumeSpecName: "logs") pod "b19e43df-ec26-473e-a23f-06c30f7d85e7" (UID: "b19e43df-ec26-473e-a23f-06c30f7d85e7"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:50:48 crc kubenswrapper[5120]: I0316 16:50:48.257049 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b19e43df-ec26-473e-a23f-06c30f7d85e7-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:48 crc kubenswrapper[5120]: I0316 16:50:48.264569 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b19e43df-ec26-473e-a23f-06c30f7d85e7-kube-api-access-t2djb" (OuterVolumeSpecName: "kube-api-access-t2djb") pod "b19e43df-ec26-473e-a23f-06c30f7d85e7" (UID: "b19e43df-ec26-473e-a23f-06c30f7d85e7"). InnerVolumeSpecName "kube-api-access-t2djb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:50:48 crc kubenswrapper[5120]: I0316 16:50:48.281705 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b19e43df-ec26-473e-a23f-06c30f7d85e7-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "b19e43df-ec26-473e-a23f-06c30f7d85e7" (UID: "b19e43df-ec26-473e-a23f-06c30f7d85e7"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:50:48 crc kubenswrapper[5120]: I0316 16:50:48.307560 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b19e43df-ec26-473e-a23f-06c30f7d85e7-config-data" (OuterVolumeSpecName: "config-data") pod "b19e43df-ec26-473e-a23f-06c30f7d85e7" (UID: "b19e43df-ec26-473e-a23f-06c30f7d85e7"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:50:48 crc kubenswrapper[5120]: I0316 16:50:48.335050 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b19e43df-ec26-473e-a23f-06c30f7d85e7-nova-metadata-tls-certs" (OuterVolumeSpecName: "nova-metadata-tls-certs") pod "b19e43df-ec26-473e-a23f-06c30f7d85e7" (UID: "b19e43df-ec26-473e-a23f-06c30f7d85e7"). InnerVolumeSpecName "nova-metadata-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:50:48 crc kubenswrapper[5120]: I0316 16:50:48.353771 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:50:48 crc kubenswrapper[5120]: I0316 16:50:48.354167 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="618db375-cac6-46d6-a08f-28876736a830" containerName="ceilometer-central-agent" containerID="cri-o://ab80ba76dec4a3675ff982093b1e00458b7271c24416bcba616c2b5a8146daec" gracePeriod=30 Mar 16 16:50:48 crc kubenswrapper[5120]: I0316 16:50:48.354208 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="618db375-cac6-46d6-a08f-28876736a830" containerName="sg-core" containerID="cri-o://08ba1d8d616e1a4d3481ee141f5cfcd35903c3d5cb87514a7c23d574f47cf0ea" gracePeriod=30 Mar 16 16:50:48 crc kubenswrapper[5120]: I0316 16:50:48.354217 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="618db375-cac6-46d6-a08f-28876736a830" containerName="ceilometer-notification-agent" containerID="cri-o://87f188699035fa3e4f635ee01426488e93891371f8acdae14745402ab43d60a5" gracePeriod=30 Mar 16 16:50:48 crc kubenswrapper[5120]: I0316 16:50:48.354225 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="618db375-cac6-46d6-a08f-28876736a830" containerName="proxy-httpd" containerID="cri-o://b94076ad923a3199dde422501504a0aa5fb6fab8335e5f33ec2625a0715ed02b" gracePeriod=30 Mar 16 16:50:48 crc kubenswrapper[5120]: I0316 16:50:48.362984 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b19e43df-ec26-473e-a23f-06c30f7d85e7-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:48 crc kubenswrapper[5120]: I0316 16:50:48.363319 5120 reconciler_common.go:299] "Volume detached for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/b19e43df-ec26-473e-a23f-06c30f7d85e7-nova-metadata-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:48 crc kubenswrapper[5120]: I0316 16:50:48.363334 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b19e43df-ec26-473e-a23f-06c30f7d85e7-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:48 crc kubenswrapper[5120]: I0316 16:50:48.363346 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t2djb\" (UniqueName: \"kubernetes.io/projected/b19e43df-ec26-473e-a23f-06c30f7d85e7-kube-api-access-t2djb\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:48 crc kubenswrapper[5120]: I0316 16:50:48.437986 5120 generic.go:358] "Generic (PLEG): container finished" podID="b19e43df-ec26-473e-a23f-06c30f7d85e7" containerID="e884b23494332ba8aebf4738f6efdf28d7343a7d04449a1a32760481d6c09f19" exitCode=0 Mar 16 16:50:48 crc kubenswrapper[5120]: I0316 16:50:48.438015 5120 generic.go:358] "Generic (PLEG): container finished" podID="b19e43df-ec26-473e-a23f-06c30f7d85e7" containerID="cc96184aaab6fef272ba57e59f50ba1695409339b08bb1794e71b8ee249784ea" exitCode=143 Mar 16 16:50:48 crc kubenswrapper[5120]: I0316 16:50:48.438027 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"b19e43df-ec26-473e-a23f-06c30f7d85e7","Type":"ContainerDied","Data":"e884b23494332ba8aebf4738f6efdf28d7343a7d04449a1a32760481d6c09f19"} Mar 16 16:50:48 crc kubenswrapper[5120]: I0316 16:50:48.438066 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:50:48 crc kubenswrapper[5120]: I0316 16:50:48.438087 5120 scope.go:117] "RemoveContainer" containerID="e884b23494332ba8aebf4738f6efdf28d7343a7d04449a1a32760481d6c09f19" Mar 16 16:50:48 crc kubenswrapper[5120]: I0316 16:50:48.438075 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"b19e43df-ec26-473e-a23f-06c30f7d85e7","Type":"ContainerDied","Data":"cc96184aaab6fef272ba57e59f50ba1695409339b08bb1794e71b8ee249784ea"} Mar 16 16:50:48 crc kubenswrapper[5120]: I0316 16:50:48.438232 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"b19e43df-ec26-473e-a23f-06c30f7d85e7","Type":"ContainerDied","Data":"a3e1bd2402a702eb8bed5a6e349dfad26a8a8295006ac516c4168859e87337bb"} Mar 16 16:50:48 crc kubenswrapper[5120]: I0316 16:50:48.440669 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"b50dad34-ac9d-48e2-833e-a902932cc311","Type":"ContainerStarted","Data":"7448b0b7bc2b1e855e283f1cab2693cd3203789ace9d495c8b5e48e0d439c2b6"} Mar 16 16:50:48 crc kubenswrapper[5120]: I0316 16:50:48.440740 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="b50dad34-ac9d-48e2-833e-a902932cc311" containerName="nova-api-log" containerID="cri-o://dbf315c8df9205f2482ada22ca7c46d5ccb8e4b09237efdd69223dcf7cf4c7af" gracePeriod=30 Mar 16 16:50:48 crc kubenswrapper[5120]: I0316 16:50:48.440750 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="b50dad34-ac9d-48e2-833e-a902932cc311" containerName="nova-api-api" containerID="cri-o://7448b0b7bc2b1e855e283f1cab2693cd3203789ace9d495c8b5e48e0d439c2b6" gracePeriod=30 Mar 16 16:50:48 crc kubenswrapper[5120]: I0316 16:50:48.448250 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"55b29fdd-871f-4603-afd0-b2e13728f594","Type":"ContainerDied","Data":"34198e76539b7841693e7fc332617a6391aa64da3fe2af7a4cc005ab50b67dc3"} Mar 16 16:50:48 crc kubenswrapper[5120]: I0316 16:50:48.448351 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:50:48 crc kubenswrapper[5120]: I0316 16:50:48.459569 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"d43280dd-cd49-4365-8474-7bab9f5b4899","Type":"ContainerStarted","Data":"59ea000c80804f2740555310ca43eeb4d84a66364bbce05903490e9bceb834a3"} Mar 16 16:50:48 crc kubenswrapper[5120]: I0316 16:50:48.459648 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"d43280dd-cd49-4365-8474-7bab9f5b4899","Type":"ContainerStarted","Data":"a9b79029d6d24387ee795053a4928277373ff61e824b64993fa8965d16384c08"} Mar 16 16:50:48 crc kubenswrapper[5120]: I0316 16:50:48.460319 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="d43280dd-cd49-4365-8474-7bab9f5b4899" containerName="nova-cell1-conductor-conductor" containerID="cri-o://59ea000c80804f2740555310ca43eeb4d84a66364bbce05903490e9bceb834a3" gracePeriod=30 Mar 16 16:50:48 crc kubenswrapper[5120]: I0316 16:50:48.477464 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=4.477282848 podStartE2EDuration="4.477282848s" podCreationTimestamp="2026-03-16 16:50:44 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:50:48.465600988 +0000 UTC m=+4750.619532645" watchObservedRunningTime="2026-03-16 16:50:48.477282848 +0000 UTC m=+4750.631214505" Mar 16 16:50:48 crc kubenswrapper[5120]: I0316 16:50:48.479267 5120 scope.go:117] "RemoveContainer" containerID="cc96184aaab6fef272ba57e59f50ba1695409339b08bb1794e71b8ee249784ea" Mar 16 16:50:48 crc kubenswrapper[5120]: I0316 16:50:48.502056 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podStartSLOduration=2.502039577 podStartE2EDuration="2.502039577s" podCreationTimestamp="2026-03-16 16:50:46 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:50:48.492170477 +0000 UTC m=+4750.646102134" watchObservedRunningTime="2026-03-16 16:50:48.502039577 +0000 UTC m=+4750.655971234" Mar 16 16:50:48 crc kubenswrapper[5120]: I0316 16:50:48.535595 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:50:48 crc kubenswrapper[5120]: I0316 16:50:48.551340 5120 scope.go:117] "RemoveContainer" containerID="e884b23494332ba8aebf4738f6efdf28d7343a7d04449a1a32760481d6c09f19" Mar 16 16:50:48 crc kubenswrapper[5120]: E0316 16:50:48.554292 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e884b23494332ba8aebf4738f6efdf28d7343a7d04449a1a32760481d6c09f19\": container with ID starting with e884b23494332ba8aebf4738f6efdf28d7343a7d04449a1a32760481d6c09f19 not found: ID does not exist" containerID="e884b23494332ba8aebf4738f6efdf28d7343a7d04449a1a32760481d6c09f19" Mar 16 16:50:48 crc kubenswrapper[5120]: I0316 16:50:48.554335 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e884b23494332ba8aebf4738f6efdf28d7343a7d04449a1a32760481d6c09f19"} err="failed to get container status \"e884b23494332ba8aebf4738f6efdf28d7343a7d04449a1a32760481d6c09f19\": rpc error: code = NotFound desc = could not find container \"e884b23494332ba8aebf4738f6efdf28d7343a7d04449a1a32760481d6c09f19\": container with ID starting with e884b23494332ba8aebf4738f6efdf28d7343a7d04449a1a32760481d6c09f19 not found: ID does not exist" Mar 16 16:50:48 crc kubenswrapper[5120]: I0316 16:50:48.554359 5120 scope.go:117] "RemoveContainer" containerID="cc96184aaab6fef272ba57e59f50ba1695409339b08bb1794e71b8ee249784ea" Mar 16 16:50:48 crc kubenswrapper[5120]: E0316 16:50:48.555379 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc96184aaab6fef272ba57e59f50ba1695409339b08bb1794e71b8ee249784ea\": container with ID starting with cc96184aaab6fef272ba57e59f50ba1695409339b08bb1794e71b8ee249784ea not found: ID does not exist" containerID="cc96184aaab6fef272ba57e59f50ba1695409339b08bb1794e71b8ee249784ea" Mar 16 16:50:48 crc kubenswrapper[5120]: I0316 16:50:48.555407 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc96184aaab6fef272ba57e59f50ba1695409339b08bb1794e71b8ee249784ea"} err="failed to get container status \"cc96184aaab6fef272ba57e59f50ba1695409339b08bb1794e71b8ee249784ea\": rpc error: code = NotFound desc = could not find container \"cc96184aaab6fef272ba57e59f50ba1695409339b08bb1794e71b8ee249784ea\": container with ID starting with cc96184aaab6fef272ba57e59f50ba1695409339b08bb1794e71b8ee249784ea not found: ID does not exist" Mar 16 16:50:48 crc kubenswrapper[5120]: I0316 16:50:48.555423 5120 scope.go:117] "RemoveContainer" containerID="e884b23494332ba8aebf4738f6efdf28d7343a7d04449a1a32760481d6c09f19" Mar 16 16:50:48 crc kubenswrapper[5120]: I0316 16:50:48.555944 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e884b23494332ba8aebf4738f6efdf28d7343a7d04449a1a32760481d6c09f19"} err="failed to get container status \"e884b23494332ba8aebf4738f6efdf28d7343a7d04449a1a32760481d6c09f19\": rpc error: code = NotFound desc = could not find container \"e884b23494332ba8aebf4738f6efdf28d7343a7d04449a1a32760481d6c09f19\": container with ID starting with e884b23494332ba8aebf4738f6efdf28d7343a7d04449a1a32760481d6c09f19 not found: ID does not exist" Mar 16 16:50:48 crc kubenswrapper[5120]: I0316 16:50:48.555963 5120 scope.go:117] "RemoveContainer" containerID="cc96184aaab6fef272ba57e59f50ba1695409339b08bb1794e71b8ee249784ea" Mar 16 16:50:48 crc kubenswrapper[5120]: I0316 16:50:48.557158 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc96184aaab6fef272ba57e59f50ba1695409339b08bb1794e71b8ee249784ea"} err="failed to get container status \"cc96184aaab6fef272ba57e59f50ba1695409339b08bb1794e71b8ee249784ea\": rpc error: code = NotFound desc = could not find container \"cc96184aaab6fef272ba57e59f50ba1695409339b08bb1794e71b8ee249784ea\": container with ID starting with cc96184aaab6fef272ba57e59f50ba1695409339b08bb1794e71b8ee249784ea not found: ID does not exist" Mar 16 16:50:48 crc kubenswrapper[5120]: I0316 16:50:48.557197 5120 scope.go:117] "RemoveContainer" containerID="efec4213034fff9ef64172922016741a3af69ee9511bd701e257ed3c886e8388" Mar 16 16:50:48 crc kubenswrapper[5120]: I0316 16:50:48.581930 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:50:48 crc kubenswrapper[5120]: I0316 16:50:48.601970 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:50:48 crc kubenswrapper[5120]: I0316 16:50:48.608424 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:50:48 crc kubenswrapper[5120]: I0316 16:50:48.712262 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="55b29fdd-871f-4603-afd0-b2e13728f594" path="/var/lib/kubelet/pods/55b29fdd-871f-4603-afd0-b2e13728f594/volumes" Mar 16 16:50:48 crc kubenswrapper[5120]: I0316 16:50:48.712964 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b19e43df-ec26-473e-a23f-06c30f7d85e7" path="/var/lib/kubelet/pods/b19e43df-ec26-473e-a23f-06c30f7d85e7/volumes" Mar 16 16:50:48 crc kubenswrapper[5120]: I0316 16:50:48.713634 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:50:48 crc kubenswrapper[5120]: I0316 16:50:48.714534 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55b29fdd-871f-4603-afd0-b2e13728f594" containerName="nova-cell0-conductor-conductor" Mar 16 16:50:48 crc kubenswrapper[5120]: I0316 16:50:48.714552 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="55b29fdd-871f-4603-afd0-b2e13728f594" containerName="nova-cell0-conductor-conductor" Mar 16 16:50:48 crc kubenswrapper[5120]: I0316 16:50:48.714676 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b19e43df-ec26-473e-a23f-06c30f7d85e7" containerName="nova-metadata-log" Mar 16 16:50:48 crc kubenswrapper[5120]: I0316 16:50:48.714685 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="b19e43df-ec26-473e-a23f-06c30f7d85e7" containerName="nova-metadata-log" Mar 16 16:50:48 crc kubenswrapper[5120]: I0316 16:50:48.714705 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55b29fdd-871f-4603-afd0-b2e13728f594" containerName="nova-cell0-conductor-conductor" Mar 16 16:50:48 crc kubenswrapper[5120]: I0316 16:50:48.714712 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="55b29fdd-871f-4603-afd0-b2e13728f594" containerName="nova-cell0-conductor-conductor" Mar 16 16:50:48 crc kubenswrapper[5120]: I0316 16:50:48.714723 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b19e43df-ec26-473e-a23f-06c30f7d85e7" containerName="nova-metadata-metadata" Mar 16 16:50:48 crc kubenswrapper[5120]: I0316 16:50:48.714729 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="b19e43df-ec26-473e-a23f-06c30f7d85e7" containerName="nova-metadata-metadata" Mar 16 16:50:48 crc kubenswrapper[5120]: I0316 16:50:48.715276 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="55b29fdd-871f-4603-afd0-b2e13728f594" containerName="nova-cell0-conductor-conductor" Mar 16 16:50:48 crc kubenswrapper[5120]: I0316 16:50:48.715294 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="b19e43df-ec26-473e-a23f-06c30f7d85e7" containerName="nova-metadata-metadata" Mar 16 16:50:48 crc kubenswrapper[5120]: I0316 16:50:48.715310 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="55b29fdd-871f-4603-afd0-b2e13728f594" containerName="nova-cell0-conductor-conductor" Mar 16 16:50:48 crc kubenswrapper[5120]: I0316 16:50:48.715324 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="b19e43df-ec26-473e-a23f-06c30f7d85e7" containerName="nova-metadata-log" Mar 16 16:50:48 crc kubenswrapper[5120]: I0316 16:50:48.723402 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:50:48 crc kubenswrapper[5120]: I0316 16:50:48.723522 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:50:48 crc kubenswrapper[5120]: I0316 16:50:48.730266 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:50:48 crc kubenswrapper[5120]: I0316 16:50:48.731985 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-metadata-config-data\"" Mar 16 16:50:48 crc kubenswrapper[5120]: I0316 16:50:48.734289 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-metadata-internal-svc\"" Mar 16 16:50:48 crc kubenswrapper[5120]: I0316 16:50:48.735571 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:50:48 crc kubenswrapper[5120]: I0316 16:50:48.738523 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-conductor-config-data\"" Mar 16 16:50:48 crc kubenswrapper[5120]: I0316 16:50:48.760922 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:50:48 crc kubenswrapper[5120]: I0316 16:50:48.904592 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdwkm\" (UniqueName: \"kubernetes.io/projected/01f62262-5954-44de-80cb-c1cf1c179a0f-kube-api-access-vdwkm\") pod \"nova-cell0-conductor-0\" (UID: \"01f62262-5954-44de-80cb-c1cf1c179a0f\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:50:48 crc kubenswrapper[5120]: I0316 16:50:48.904962 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/01f62262-5954-44de-80cb-c1cf1c179a0f-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"01f62262-5954-44de-80cb-c1cf1c179a0f\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:50:48 crc kubenswrapper[5120]: I0316 16:50:48.905003 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/01f62262-5954-44de-80cb-c1cf1c179a0f-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"01f62262-5954-44de-80cb-c1cf1c179a0f\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:50:48 crc kubenswrapper[5120]: I0316 16:50:48.905036 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/fca63e3b-929a-4864-b234-3dcb19a31da8-logs\") pod \"nova-metadata-0\" (UID: \"fca63e3b-929a-4864-b234-3dcb19a31da8\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:50:48 crc kubenswrapper[5120]: I0316 16:50:48.905322 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9cgj\" (UniqueName: \"kubernetes.io/projected/fca63e3b-929a-4864-b234-3dcb19a31da8-kube-api-access-s9cgj\") pod \"nova-metadata-0\" (UID: \"fca63e3b-929a-4864-b234-3dcb19a31da8\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:50:48 crc kubenswrapper[5120]: I0316 16:50:48.905643 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/fca63e3b-929a-4864-b234-3dcb19a31da8-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"fca63e3b-929a-4864-b234-3dcb19a31da8\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:50:48 crc kubenswrapper[5120]: I0316 16:50:48.905701 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fca63e3b-929a-4864-b234-3dcb19a31da8-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"fca63e3b-929a-4864-b234-3dcb19a31da8\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:50:48 crc kubenswrapper[5120]: I0316 16:50:48.905870 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fca63e3b-929a-4864-b234-3dcb19a31da8-config-data\") pod \"nova-metadata-0\" (UID: \"fca63e3b-929a-4864-b234-3dcb19a31da8\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.010183 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s9cgj\" (UniqueName: \"kubernetes.io/projected/fca63e3b-929a-4864-b234-3dcb19a31da8-kube-api-access-s9cgj\") pod \"nova-metadata-0\" (UID: \"fca63e3b-929a-4864-b234-3dcb19a31da8\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.010330 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/fca63e3b-929a-4864-b234-3dcb19a31da8-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"fca63e3b-929a-4864-b234-3dcb19a31da8\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.010349 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fca63e3b-929a-4864-b234-3dcb19a31da8-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"fca63e3b-929a-4864-b234-3dcb19a31da8\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.010423 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fca63e3b-929a-4864-b234-3dcb19a31da8-config-data\") pod \"nova-metadata-0\" (UID: \"fca63e3b-929a-4864-b234-3dcb19a31da8\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.010537 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vdwkm\" (UniqueName: \"kubernetes.io/projected/01f62262-5954-44de-80cb-c1cf1c179a0f-kube-api-access-vdwkm\") pod \"nova-cell0-conductor-0\" (UID: \"01f62262-5954-44de-80cb-c1cf1c179a0f\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.010579 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/01f62262-5954-44de-80cb-c1cf1c179a0f-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"01f62262-5954-44de-80cb-c1cf1c179a0f\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.010615 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/01f62262-5954-44de-80cb-c1cf1c179a0f-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"01f62262-5954-44de-80cb-c1cf1c179a0f\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.010642 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/fca63e3b-929a-4864-b234-3dcb19a31da8-logs\") pod \"nova-metadata-0\" (UID: \"fca63e3b-929a-4864-b234-3dcb19a31da8\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.011069 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/fca63e3b-929a-4864-b234-3dcb19a31da8-logs\") pod \"nova-metadata-0\" (UID: \"fca63e3b-929a-4864-b234-3dcb19a31da8\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.020141 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fca63e3b-929a-4864-b234-3dcb19a31da8-config-data\") pod \"nova-metadata-0\" (UID: \"fca63e3b-929a-4864-b234-3dcb19a31da8\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.020170 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/01f62262-5954-44de-80cb-c1cf1c179a0f-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"01f62262-5954-44de-80cb-c1cf1c179a0f\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.023018 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fca63e3b-929a-4864-b234-3dcb19a31da8-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"fca63e3b-929a-4864-b234-3dcb19a31da8\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.024746 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/fca63e3b-929a-4864-b234-3dcb19a31da8-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"fca63e3b-929a-4864-b234-3dcb19a31da8\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.035430 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/01f62262-5954-44de-80cb-c1cf1c179a0f-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"01f62262-5954-44de-80cb-c1cf1c179a0f\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.040449 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9cgj\" (UniqueName: \"kubernetes.io/projected/fca63e3b-929a-4864-b234-3dcb19a31da8-kube-api-access-s9cgj\") pod \"nova-metadata-0\" (UID: \"fca63e3b-929a-4864-b234-3dcb19a31da8\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.041612 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdwkm\" (UniqueName: \"kubernetes.io/projected/01f62262-5954-44de-80cb-c1cf1c179a0f-kube-api-access-vdwkm\") pod \"nova-cell0-conductor-0\" (UID: \"01f62262-5954-44de-80cb-c1cf1c179a0f\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.054494 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.073281 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.073289 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.114322 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b50dad34-ac9d-48e2-833e-a902932cc311-logs\") pod \"b50dad34-ac9d-48e2-833e-a902932cc311\" (UID: \"b50dad34-ac9d-48e2-833e-a902932cc311\") " Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.114437 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b50dad34-ac9d-48e2-833e-a902932cc311-config-data\") pod \"b50dad34-ac9d-48e2-833e-a902932cc311\" (UID: \"b50dad34-ac9d-48e2-833e-a902932cc311\") " Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.116322 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b50dad34-ac9d-48e2-833e-a902932cc311-logs" (OuterVolumeSpecName: "logs") pod "b50dad34-ac9d-48e2-833e-a902932cc311" (UID: "b50dad34-ac9d-48e2-833e-a902932cc311"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.154982 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b50dad34-ac9d-48e2-833e-a902932cc311-config-data" (OuterVolumeSpecName: "config-data") pod "b50dad34-ac9d-48e2-833e-a902932cc311" (UID: "b50dad34-ac9d-48e2-833e-a902932cc311"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.217555 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/b50dad34-ac9d-48e2-833e-a902932cc311-internal-tls-certs\") pod \"b50dad34-ac9d-48e2-833e-a902932cc311\" (UID: \"b50dad34-ac9d-48e2-833e-a902932cc311\") " Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.217823 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b50dad34-ac9d-48e2-833e-a902932cc311-combined-ca-bundle\") pod \"b50dad34-ac9d-48e2-833e-a902932cc311\" (UID: \"b50dad34-ac9d-48e2-833e-a902932cc311\") " Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.217986 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zvbdt\" (UniqueName: \"kubernetes.io/projected/b50dad34-ac9d-48e2-833e-a902932cc311-kube-api-access-zvbdt\") pod \"b50dad34-ac9d-48e2-833e-a902932cc311\" (UID: \"b50dad34-ac9d-48e2-833e-a902932cc311\") " Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.218711 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/b50dad34-ac9d-48e2-833e-a902932cc311-public-tls-certs\") pod \"b50dad34-ac9d-48e2-833e-a902932cc311\" (UID: \"b50dad34-ac9d-48e2-833e-a902932cc311\") " Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.220047 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b50dad34-ac9d-48e2-833e-a902932cc311-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.220072 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b50dad34-ac9d-48e2-833e-a902932cc311-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.223486 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b50dad34-ac9d-48e2-833e-a902932cc311-kube-api-access-zvbdt" (OuterVolumeSpecName: "kube-api-access-zvbdt") pod "b50dad34-ac9d-48e2-833e-a902932cc311" (UID: "b50dad34-ac9d-48e2-833e-a902932cc311"). InnerVolumeSpecName "kube-api-access-zvbdt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.259274 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b50dad34-ac9d-48e2-833e-a902932cc311-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "b50dad34-ac9d-48e2-833e-a902932cc311" (UID: "b50dad34-ac9d-48e2-833e-a902932cc311"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.288046 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b50dad34-ac9d-48e2-833e-a902932cc311-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "b50dad34-ac9d-48e2-833e-a902932cc311" (UID: "b50dad34-ac9d-48e2-833e-a902932cc311"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.310452 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.325550 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4pjc7\" (UniqueName: \"kubernetes.io/projected/618db375-cac6-46d6-a08f-28876736a830-kube-api-access-4pjc7\") pod \"618db375-cac6-46d6-a08f-28876736a830\" (UID: \"618db375-cac6-46d6-a08f-28876736a830\") " Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.325694 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/618db375-cac6-46d6-a08f-28876736a830-config-data\") pod \"618db375-cac6-46d6-a08f-28876736a830\" (UID: \"618db375-cac6-46d6-a08f-28876736a830\") " Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.325718 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/618db375-cac6-46d6-a08f-28876736a830-log-httpd\") pod \"618db375-cac6-46d6-a08f-28876736a830\" (UID: \"618db375-cac6-46d6-a08f-28876736a830\") " Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.326108 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/618db375-cac6-46d6-a08f-28876736a830-combined-ca-bundle\") pod \"618db375-cac6-46d6-a08f-28876736a830\" (UID: \"618db375-cac6-46d6-a08f-28876736a830\") " Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.326565 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/618db375-cac6-46d6-a08f-28876736a830-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "618db375-cac6-46d6-a08f-28876736a830" (UID: "618db375-cac6-46d6-a08f-28876736a830"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.328683 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/618db375-cac6-46d6-a08f-28876736a830-sg-core-conf-yaml\") pod \"618db375-cac6-46d6-a08f-28876736a830\" (UID: \"618db375-cac6-46d6-a08f-28876736a830\") " Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.328905 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/618db375-cac6-46d6-a08f-28876736a830-run-httpd\") pod \"618db375-cac6-46d6-a08f-28876736a830\" (UID: \"618db375-cac6-46d6-a08f-28876736a830\") " Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.329446 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/618db375-cac6-46d6-a08f-28876736a830-scripts\") pod \"618db375-cac6-46d6-a08f-28876736a830\" (UID: \"618db375-cac6-46d6-a08f-28876736a830\") " Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.329603 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/618db375-cac6-46d6-a08f-28876736a830-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "618db375-cac6-46d6-a08f-28876736a830" (UID: "618db375-cac6-46d6-a08f-28876736a830"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.330028 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/618db375-cac6-46d6-a08f-28876736a830-kube-api-access-4pjc7" (OuterVolumeSpecName: "kube-api-access-4pjc7") pod "618db375-cac6-46d6-a08f-28876736a830" (UID: "618db375-cac6-46d6-a08f-28876736a830"). InnerVolumeSpecName "kube-api-access-4pjc7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.335537 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/618db375-cac6-46d6-a08f-28876736a830-scripts" (OuterVolumeSpecName: "scripts") pod "618db375-cac6-46d6-a08f-28876736a830" (UID: "618db375-cac6-46d6-a08f-28876736a830"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.336267 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4pjc7\" (UniqueName: \"kubernetes.io/projected/618db375-cac6-46d6-a08f-28876736a830-kube-api-access-4pjc7\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.336303 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b50dad34-ac9d-48e2-833e-a902932cc311-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.336312 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/618db375-cac6-46d6-a08f-28876736a830-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.336323 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zvbdt\" (UniqueName: \"kubernetes.io/projected/b50dad34-ac9d-48e2-833e-a902932cc311-kube-api-access-zvbdt\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.336332 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/b50dad34-ac9d-48e2-833e-a902932cc311-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.336340 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/618db375-cac6-46d6-a08f-28876736a830-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.336349 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/618db375-cac6-46d6-a08f-28876736a830-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.370533 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b50dad34-ac9d-48e2-833e-a902932cc311-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "b50dad34-ac9d-48e2-833e-a902932cc311" (UID: "b50dad34-ac9d-48e2-833e-a902932cc311"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.399166 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/618db375-cac6-46d6-a08f-28876736a830-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "618db375-cac6-46d6-a08f-28876736a830" (UID: "618db375-cac6-46d6-a08f-28876736a830"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.416883 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.440702 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/b50dad34-ac9d-48e2-833e-a902932cc311-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.440769 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/618db375-cac6-46d6-a08f-28876736a830-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.445616 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/618db375-cac6-46d6-a08f-28876736a830-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "618db375-cac6-46d6-a08f-28876736a830" (UID: "618db375-cac6-46d6-a08f-28876736a830"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.475956 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/618db375-cac6-46d6-a08f-28876736a830-config-data" (OuterVolumeSpecName: "config-data") pod "618db375-cac6-46d6-a08f-28876736a830" (UID: "618db375-cac6-46d6-a08f-28876736a830"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.494069 5120 generic.go:358] "Generic (PLEG): container finished" podID="618db375-cac6-46d6-a08f-28876736a830" containerID="b94076ad923a3199dde422501504a0aa5fb6fab8335e5f33ec2625a0715ed02b" exitCode=0 Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.494104 5120 generic.go:358] "Generic (PLEG): container finished" podID="618db375-cac6-46d6-a08f-28876736a830" containerID="08ba1d8d616e1a4d3481ee141f5cfcd35903c3d5cb87514a7c23d574f47cf0ea" exitCode=2 Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.494112 5120 generic.go:358] "Generic (PLEG): container finished" podID="618db375-cac6-46d6-a08f-28876736a830" containerID="87f188699035fa3e4f635ee01426488e93891371f8acdae14745402ab43d60a5" exitCode=0 Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.494120 5120 generic.go:358] "Generic (PLEG): container finished" podID="618db375-cac6-46d6-a08f-28876736a830" containerID="ab80ba76dec4a3675ff982093b1e00458b7271c24416bcba616c2b5a8146daec" exitCode=0 Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.494222 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"618db375-cac6-46d6-a08f-28876736a830","Type":"ContainerDied","Data":"b94076ad923a3199dde422501504a0aa5fb6fab8335e5f33ec2625a0715ed02b"} Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.494253 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"618db375-cac6-46d6-a08f-28876736a830","Type":"ContainerDied","Data":"08ba1d8d616e1a4d3481ee141f5cfcd35903c3d5cb87514a7c23d574f47cf0ea"} Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.494268 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"618db375-cac6-46d6-a08f-28876736a830","Type":"ContainerDied","Data":"87f188699035fa3e4f635ee01426488e93891371f8acdae14745402ab43d60a5"} Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.494279 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"618db375-cac6-46d6-a08f-28876736a830","Type":"ContainerDied","Data":"ab80ba76dec4a3675ff982093b1e00458b7271c24416bcba616c2b5a8146daec"} Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.494289 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"618db375-cac6-46d6-a08f-28876736a830","Type":"ContainerDied","Data":"0ed02e0fd9cf8474d44abb591370f48197ec35833c8c5fa8be0871a07ecbb12e"} Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.494308 5120 scope.go:117] "RemoveContainer" containerID="b94076ad923a3199dde422501504a0aa5fb6fab8335e5f33ec2625a0715ed02b" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.494472 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.511606 5120 generic.go:358] "Generic (PLEG): container finished" podID="b50dad34-ac9d-48e2-833e-a902932cc311" containerID="7448b0b7bc2b1e855e283f1cab2693cd3203789ace9d495c8b5e48e0d439c2b6" exitCode=0 Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.511638 5120 generic.go:358] "Generic (PLEG): container finished" podID="b50dad34-ac9d-48e2-833e-a902932cc311" containerID="dbf315c8df9205f2482ada22ca7c46d5ccb8e4b09237efdd69223dcf7cf4c7af" exitCode=143 Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.511915 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"b50dad34-ac9d-48e2-833e-a902932cc311","Type":"ContainerDied","Data":"7448b0b7bc2b1e855e283f1cab2693cd3203789ace9d495c8b5e48e0d439c2b6"} Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.511954 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"b50dad34-ac9d-48e2-833e-a902932cc311","Type":"ContainerDied","Data":"dbf315c8df9205f2482ada22ca7c46d5ccb8e4b09237efdd69223dcf7cf4c7af"} Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.511969 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"b50dad34-ac9d-48e2-833e-a902932cc311","Type":"ContainerDied","Data":"88056889e91daa4719a90aee633b6c699f2759c2e1c250d3fcaf5747c34c7a28"} Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.511986 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.532332 5120 scope.go:117] "RemoveContainer" containerID="08ba1d8d616e1a4d3481ee141f5cfcd35903c3d5cb87514a7c23d574f47cf0ea" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.548003 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/618db375-cac6-46d6-a08f-28876736a830-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.548040 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/618db375-cac6-46d6-a08f-28876736a830-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.566917 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.577275 5120 scope.go:117] "RemoveContainer" containerID="87f188699035fa3e4f635ee01426488e93891371f8acdae14745402ab43d60a5" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.592872 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.618141 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.622534 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="618db375-cac6-46d6-a08f-28876736a830" containerName="ceilometer-notification-agent" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.622584 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="618db375-cac6-46d6-a08f-28876736a830" containerName="ceilometer-notification-agent" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.623007 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="618db375-cac6-46d6-a08f-28876736a830" containerName="proxy-httpd" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.623026 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="618db375-cac6-46d6-a08f-28876736a830" containerName="proxy-httpd" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.623049 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b50dad34-ac9d-48e2-833e-a902932cc311" containerName="nova-api-log" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.623057 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="b50dad34-ac9d-48e2-833e-a902932cc311" containerName="nova-api-log" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.623091 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="618db375-cac6-46d6-a08f-28876736a830" containerName="sg-core" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.623098 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="618db375-cac6-46d6-a08f-28876736a830" containerName="sg-core" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.623113 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b50dad34-ac9d-48e2-833e-a902932cc311" containerName="nova-api-api" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.623119 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="b50dad34-ac9d-48e2-833e-a902932cc311" containerName="nova-api-api" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.623131 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="618db375-cac6-46d6-a08f-28876736a830" containerName="ceilometer-central-agent" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.623155 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="618db375-cac6-46d6-a08f-28876736a830" containerName="ceilometer-central-agent" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.631118 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="618db375-cac6-46d6-a08f-28876736a830" containerName="ceilometer-notification-agent" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.631203 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="618db375-cac6-46d6-a08f-28876736a830" containerName="sg-core" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.631233 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="618db375-cac6-46d6-a08f-28876736a830" containerName="proxy-httpd" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.631269 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="b50dad34-ac9d-48e2-833e-a902932cc311" containerName="nova-api-api" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.631288 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="618db375-cac6-46d6-a08f-28876736a830" containerName="ceilometer-central-agent" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.631309 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="b50dad34-ac9d-48e2-833e-a902932cc311" containerName="nova-api-log" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.663048 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.671946 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.674134 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.675739 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.727232 5120 scope.go:117] "RemoveContainer" containerID="ab80ba76dec4a3675ff982093b1e00458b7271c24416bcba616c2b5a8146daec" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.729398 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.755889 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:50:49 crc kubenswrapper[5120]: W0316 16:50:49.758059 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod01f62262_5954_44de_80cb_c1cf1c179a0f.slice/crio-f82e977db20799693423a2354a1e22f26fb2cd8cddbbd074437a51e18f474944 WatchSource:0}: Error finding container f82e977db20799693423a2354a1e22f26fb2cd8cddbbd074437a51e18f474944: Status 404 returned error can't find the container with id f82e977db20799693423a2354a1e22f26fb2cd8cddbbd074437a51e18f474944 Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.761172 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pljgc\" (UniqueName: \"kubernetes.io/projected/f48a2d5a-71e3-4fe6-aa44-9f6e1ae65cd5-kube-api-access-pljgc\") pod \"ceilometer-0\" (UID: \"f48a2d5a-71e3-4fe6-aa44-9f6e1ae65cd5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.761231 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f48a2d5a-71e3-4fe6-aa44-9f6e1ae65cd5-scripts\") pod \"ceilometer-0\" (UID: \"f48a2d5a-71e3-4fe6-aa44-9f6e1ae65cd5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.761303 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f48a2d5a-71e3-4fe6-aa44-9f6e1ae65cd5-run-httpd\") pod \"ceilometer-0\" (UID: \"f48a2d5a-71e3-4fe6-aa44-9f6e1ae65cd5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.761735 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f48a2d5a-71e3-4fe6-aa44-9f6e1ae65cd5-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"f48a2d5a-71e3-4fe6-aa44-9f6e1ae65cd5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.761824 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f48a2d5a-71e3-4fe6-aa44-9f6e1ae65cd5-log-httpd\") pod \"ceilometer-0\" (UID: \"f48a2d5a-71e3-4fe6-aa44-9f6e1ae65cd5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.761878 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/f48a2d5a-71e3-4fe6-aa44-9f6e1ae65cd5-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"f48a2d5a-71e3-4fe6-aa44-9f6e1ae65cd5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.762191 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f48a2d5a-71e3-4fe6-aa44-9f6e1ae65cd5-config-data\") pod \"ceilometer-0\" (UID: \"f48a2d5a-71e3-4fe6-aa44-9f6e1ae65cd5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.788706 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.803178 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.812378 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.818631 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.820768 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-config-data\"" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.821021 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-internal-svc\"" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.821543 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.822132 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-public-svc\"" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.863800 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f48a2d5a-71e3-4fe6-aa44-9f6e1ae65cd5-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"f48a2d5a-71e3-4fe6-aa44-9f6e1ae65cd5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.863852 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f48a2d5a-71e3-4fe6-aa44-9f6e1ae65cd5-log-httpd\") pod \"ceilometer-0\" (UID: \"f48a2d5a-71e3-4fe6-aa44-9f6e1ae65cd5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.863884 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/f48a2d5a-71e3-4fe6-aa44-9f6e1ae65cd5-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"f48a2d5a-71e3-4fe6-aa44-9f6e1ae65cd5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.863982 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjv6m\" (UniqueName: \"kubernetes.io/projected/c73b6011-0761-469f-9490-c8a294f80020-kube-api-access-tjv6m\") pod \"nova-api-0\" (UID: \"c73b6011-0761-469f-9490-c8a294f80020\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.864061 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/c73b6011-0761-469f-9490-c8a294f80020-internal-tls-certs\") pod \"nova-api-0\" (UID: \"c73b6011-0761-469f-9490-c8a294f80020\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.864135 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c73b6011-0761-469f-9490-c8a294f80020-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"c73b6011-0761-469f-9490-c8a294f80020\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.864178 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f48a2d5a-71e3-4fe6-aa44-9f6e1ae65cd5-config-data\") pod \"ceilometer-0\" (UID: \"f48a2d5a-71e3-4fe6-aa44-9f6e1ae65cd5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.864195 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/c73b6011-0761-469f-9490-c8a294f80020-public-tls-certs\") pod \"nova-api-0\" (UID: \"c73b6011-0761-469f-9490-c8a294f80020\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.864227 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pljgc\" (UniqueName: \"kubernetes.io/projected/f48a2d5a-71e3-4fe6-aa44-9f6e1ae65cd5-kube-api-access-pljgc\") pod \"ceilometer-0\" (UID: \"f48a2d5a-71e3-4fe6-aa44-9f6e1ae65cd5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.864248 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f48a2d5a-71e3-4fe6-aa44-9f6e1ae65cd5-scripts\") pod \"ceilometer-0\" (UID: \"f48a2d5a-71e3-4fe6-aa44-9f6e1ae65cd5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.864275 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c73b6011-0761-469f-9490-c8a294f80020-config-data\") pod \"nova-api-0\" (UID: \"c73b6011-0761-469f-9490-c8a294f80020\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.864310 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f48a2d5a-71e3-4fe6-aa44-9f6e1ae65cd5-run-httpd\") pod \"ceilometer-0\" (UID: \"f48a2d5a-71e3-4fe6-aa44-9f6e1ae65cd5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.864390 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c73b6011-0761-469f-9490-c8a294f80020-logs\") pod \"nova-api-0\" (UID: \"c73b6011-0761-469f-9490-c8a294f80020\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.874977 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f48a2d5a-71e3-4fe6-aa44-9f6e1ae65cd5-run-httpd\") pod \"ceilometer-0\" (UID: \"f48a2d5a-71e3-4fe6-aa44-9f6e1ae65cd5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.876177 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f48a2d5a-71e3-4fe6-aa44-9f6e1ae65cd5-config-data\") pod \"ceilometer-0\" (UID: \"f48a2d5a-71e3-4fe6-aa44-9f6e1ae65cd5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.886230 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f48a2d5a-71e3-4fe6-aa44-9f6e1ae65cd5-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"f48a2d5a-71e3-4fe6-aa44-9f6e1ae65cd5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.900039 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/f48a2d5a-71e3-4fe6-aa44-9f6e1ae65cd5-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"f48a2d5a-71e3-4fe6-aa44-9f6e1ae65cd5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.900292 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f48a2d5a-71e3-4fe6-aa44-9f6e1ae65cd5-log-httpd\") pod \"ceilometer-0\" (UID: \"f48a2d5a-71e3-4fe6-aa44-9f6e1ae65cd5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.900533 5120 scope.go:117] "RemoveContainer" containerID="b94076ad923a3199dde422501504a0aa5fb6fab8335e5f33ec2625a0715ed02b" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.902387 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f48a2d5a-71e3-4fe6-aa44-9f6e1ae65cd5-scripts\") pod \"ceilometer-0\" (UID: \"f48a2d5a-71e3-4fe6-aa44-9f6e1ae65cd5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:50:49 crc kubenswrapper[5120]: E0316 16:50:49.909812 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b94076ad923a3199dde422501504a0aa5fb6fab8335e5f33ec2625a0715ed02b\": container with ID starting with b94076ad923a3199dde422501504a0aa5fb6fab8335e5f33ec2625a0715ed02b not found: ID does not exist" containerID="b94076ad923a3199dde422501504a0aa5fb6fab8335e5f33ec2625a0715ed02b" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.909891 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b94076ad923a3199dde422501504a0aa5fb6fab8335e5f33ec2625a0715ed02b"} err="failed to get container status \"b94076ad923a3199dde422501504a0aa5fb6fab8335e5f33ec2625a0715ed02b\": rpc error: code = NotFound desc = could not find container \"b94076ad923a3199dde422501504a0aa5fb6fab8335e5f33ec2625a0715ed02b\": container with ID starting with b94076ad923a3199dde422501504a0aa5fb6fab8335e5f33ec2625a0715ed02b not found: ID does not exist" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.909934 5120 scope.go:117] "RemoveContainer" containerID="08ba1d8d616e1a4d3481ee141f5cfcd35903c3d5cb87514a7c23d574f47cf0ea" Mar 16 16:50:49 crc kubenswrapper[5120]: E0316 16:50:49.919949 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"08ba1d8d616e1a4d3481ee141f5cfcd35903c3d5cb87514a7c23d574f47cf0ea\": container with ID starting with 08ba1d8d616e1a4d3481ee141f5cfcd35903c3d5cb87514a7c23d574f47cf0ea not found: ID does not exist" containerID="08ba1d8d616e1a4d3481ee141f5cfcd35903c3d5cb87514a7c23d574f47cf0ea" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.920001 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08ba1d8d616e1a4d3481ee141f5cfcd35903c3d5cb87514a7c23d574f47cf0ea"} err="failed to get container status \"08ba1d8d616e1a4d3481ee141f5cfcd35903c3d5cb87514a7c23d574f47cf0ea\": rpc error: code = NotFound desc = could not find container \"08ba1d8d616e1a4d3481ee141f5cfcd35903c3d5cb87514a7c23d574f47cf0ea\": container with ID starting with 08ba1d8d616e1a4d3481ee141f5cfcd35903c3d5cb87514a7c23d574f47cf0ea not found: ID does not exist" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.920026 5120 scope.go:117] "RemoveContainer" containerID="87f188699035fa3e4f635ee01426488e93891371f8acdae14745402ab43d60a5" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.920851 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pljgc\" (UniqueName: \"kubernetes.io/projected/f48a2d5a-71e3-4fe6-aa44-9f6e1ae65cd5-kube-api-access-pljgc\") pod \"ceilometer-0\" (UID: \"f48a2d5a-71e3-4fe6-aa44-9f6e1ae65cd5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:50:49 crc kubenswrapper[5120]: E0316 16:50:49.926001 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"87f188699035fa3e4f635ee01426488e93891371f8acdae14745402ab43d60a5\": container with ID starting with 87f188699035fa3e4f635ee01426488e93891371f8acdae14745402ab43d60a5 not found: ID does not exist" containerID="87f188699035fa3e4f635ee01426488e93891371f8acdae14745402ab43d60a5" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.926046 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87f188699035fa3e4f635ee01426488e93891371f8acdae14745402ab43d60a5"} err="failed to get container status \"87f188699035fa3e4f635ee01426488e93891371f8acdae14745402ab43d60a5\": rpc error: code = NotFound desc = could not find container \"87f188699035fa3e4f635ee01426488e93891371f8acdae14745402ab43d60a5\": container with ID starting with 87f188699035fa3e4f635ee01426488e93891371f8acdae14745402ab43d60a5 not found: ID does not exist" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.926072 5120 scope.go:117] "RemoveContainer" containerID="ab80ba76dec4a3675ff982093b1e00458b7271c24416bcba616c2b5a8146daec" Mar 16 16:50:49 crc kubenswrapper[5120]: E0316 16:50:49.927374 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab80ba76dec4a3675ff982093b1e00458b7271c24416bcba616c2b5a8146daec\": container with ID starting with ab80ba76dec4a3675ff982093b1e00458b7271c24416bcba616c2b5a8146daec not found: ID does not exist" containerID="ab80ba76dec4a3675ff982093b1e00458b7271c24416bcba616c2b5a8146daec" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.927413 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab80ba76dec4a3675ff982093b1e00458b7271c24416bcba616c2b5a8146daec"} err="failed to get container status \"ab80ba76dec4a3675ff982093b1e00458b7271c24416bcba616c2b5a8146daec\": rpc error: code = NotFound desc = could not find container \"ab80ba76dec4a3675ff982093b1e00458b7271c24416bcba616c2b5a8146daec\": container with ID starting with ab80ba76dec4a3675ff982093b1e00458b7271c24416bcba616c2b5a8146daec not found: ID does not exist" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.927436 5120 scope.go:117] "RemoveContainer" containerID="b94076ad923a3199dde422501504a0aa5fb6fab8335e5f33ec2625a0715ed02b" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.927651 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b94076ad923a3199dde422501504a0aa5fb6fab8335e5f33ec2625a0715ed02b"} err="failed to get container status \"b94076ad923a3199dde422501504a0aa5fb6fab8335e5f33ec2625a0715ed02b\": rpc error: code = NotFound desc = could not find container \"b94076ad923a3199dde422501504a0aa5fb6fab8335e5f33ec2625a0715ed02b\": container with ID starting with b94076ad923a3199dde422501504a0aa5fb6fab8335e5f33ec2625a0715ed02b not found: ID does not exist" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.927665 5120 scope.go:117] "RemoveContainer" containerID="08ba1d8d616e1a4d3481ee141f5cfcd35903c3d5cb87514a7c23d574f47cf0ea" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.928351 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08ba1d8d616e1a4d3481ee141f5cfcd35903c3d5cb87514a7c23d574f47cf0ea"} err="failed to get container status \"08ba1d8d616e1a4d3481ee141f5cfcd35903c3d5cb87514a7c23d574f47cf0ea\": rpc error: code = NotFound desc = could not find container \"08ba1d8d616e1a4d3481ee141f5cfcd35903c3d5cb87514a7c23d574f47cf0ea\": container with ID starting with 08ba1d8d616e1a4d3481ee141f5cfcd35903c3d5cb87514a7c23d574f47cf0ea not found: ID does not exist" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.928373 5120 scope.go:117] "RemoveContainer" containerID="87f188699035fa3e4f635ee01426488e93891371f8acdae14745402ab43d60a5" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.930274 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.931424 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87f188699035fa3e4f635ee01426488e93891371f8acdae14745402ab43d60a5"} err="failed to get container status \"87f188699035fa3e4f635ee01426488e93891371f8acdae14745402ab43d60a5\": rpc error: code = NotFound desc = could not find container \"87f188699035fa3e4f635ee01426488e93891371f8acdae14745402ab43d60a5\": container with ID starting with 87f188699035fa3e4f635ee01426488e93891371f8acdae14745402ab43d60a5 not found: ID does not exist" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.931453 5120 scope.go:117] "RemoveContainer" containerID="ab80ba76dec4a3675ff982093b1e00458b7271c24416bcba616c2b5a8146daec" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.934035 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab80ba76dec4a3675ff982093b1e00458b7271c24416bcba616c2b5a8146daec"} err="failed to get container status \"ab80ba76dec4a3675ff982093b1e00458b7271c24416bcba616c2b5a8146daec\": rpc error: code = NotFound desc = could not find container \"ab80ba76dec4a3675ff982093b1e00458b7271c24416bcba616c2b5a8146daec\": container with ID starting with ab80ba76dec4a3675ff982093b1e00458b7271c24416bcba616c2b5a8146daec not found: ID does not exist" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.934067 5120 scope.go:117] "RemoveContainer" containerID="b94076ad923a3199dde422501504a0aa5fb6fab8335e5f33ec2625a0715ed02b" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.935688 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b94076ad923a3199dde422501504a0aa5fb6fab8335e5f33ec2625a0715ed02b"} err="failed to get container status \"b94076ad923a3199dde422501504a0aa5fb6fab8335e5f33ec2625a0715ed02b\": rpc error: code = NotFound desc = could not find container \"b94076ad923a3199dde422501504a0aa5fb6fab8335e5f33ec2625a0715ed02b\": container with ID starting with b94076ad923a3199dde422501504a0aa5fb6fab8335e5f33ec2625a0715ed02b not found: ID does not exist" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.935718 5120 scope.go:117] "RemoveContainer" containerID="08ba1d8d616e1a4d3481ee141f5cfcd35903c3d5cb87514a7c23d574f47cf0ea" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.935915 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08ba1d8d616e1a4d3481ee141f5cfcd35903c3d5cb87514a7c23d574f47cf0ea"} err="failed to get container status \"08ba1d8d616e1a4d3481ee141f5cfcd35903c3d5cb87514a7c23d574f47cf0ea\": rpc error: code = NotFound desc = could not find container \"08ba1d8d616e1a4d3481ee141f5cfcd35903c3d5cb87514a7c23d574f47cf0ea\": container with ID starting with 08ba1d8d616e1a4d3481ee141f5cfcd35903c3d5cb87514a7c23d574f47cf0ea not found: ID does not exist" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.935935 5120 scope.go:117] "RemoveContainer" containerID="87f188699035fa3e4f635ee01426488e93891371f8acdae14745402ab43d60a5" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.936408 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87f188699035fa3e4f635ee01426488e93891371f8acdae14745402ab43d60a5"} err="failed to get container status \"87f188699035fa3e4f635ee01426488e93891371f8acdae14745402ab43d60a5\": rpc error: code = NotFound desc = could not find container \"87f188699035fa3e4f635ee01426488e93891371f8acdae14745402ab43d60a5\": container with ID starting with 87f188699035fa3e4f635ee01426488e93891371f8acdae14745402ab43d60a5 not found: ID does not exist" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.936467 5120 scope.go:117] "RemoveContainer" containerID="ab80ba76dec4a3675ff982093b1e00458b7271c24416bcba616c2b5a8146daec" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.940665 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab80ba76dec4a3675ff982093b1e00458b7271c24416bcba616c2b5a8146daec"} err="failed to get container status \"ab80ba76dec4a3675ff982093b1e00458b7271c24416bcba616c2b5a8146daec\": rpc error: code = NotFound desc = could not find container \"ab80ba76dec4a3675ff982093b1e00458b7271c24416bcba616c2b5a8146daec\": container with ID starting with ab80ba76dec4a3675ff982093b1e00458b7271c24416bcba616c2b5a8146daec not found: ID does not exist" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.940698 5120 scope.go:117] "RemoveContainer" containerID="b94076ad923a3199dde422501504a0aa5fb6fab8335e5f33ec2625a0715ed02b" Mar 16 16:50:49 crc kubenswrapper[5120]: E0316 16:50:49.941807 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[combined-ca-bundle config-data internal-tls-certs kube-api-access-tjv6m logs public-tls-certs], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openstack-kuttl-tests/nova-api-0" podUID="c73b6011-0761-469f-9490-c8a294f80020" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.942557 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b94076ad923a3199dde422501504a0aa5fb6fab8335e5f33ec2625a0715ed02b"} err="failed to get container status \"b94076ad923a3199dde422501504a0aa5fb6fab8335e5f33ec2625a0715ed02b\": rpc error: code = NotFound desc = could not find container \"b94076ad923a3199dde422501504a0aa5fb6fab8335e5f33ec2625a0715ed02b\": container with ID starting with b94076ad923a3199dde422501504a0aa5fb6fab8335e5f33ec2625a0715ed02b not found: ID does not exist" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.942586 5120 scope.go:117] "RemoveContainer" containerID="08ba1d8d616e1a4d3481ee141f5cfcd35903c3d5cb87514a7c23d574f47cf0ea" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.943002 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08ba1d8d616e1a4d3481ee141f5cfcd35903c3d5cb87514a7c23d574f47cf0ea"} err="failed to get container status \"08ba1d8d616e1a4d3481ee141f5cfcd35903c3d5cb87514a7c23d574f47cf0ea\": rpc error: code = NotFound desc = could not find container \"08ba1d8d616e1a4d3481ee141f5cfcd35903c3d5cb87514a7c23d574f47cf0ea\": container with ID starting with 08ba1d8d616e1a4d3481ee141f5cfcd35903c3d5cb87514a7c23d574f47cf0ea not found: ID does not exist" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.943063 5120 scope.go:117] "RemoveContainer" containerID="87f188699035fa3e4f635ee01426488e93891371f8acdae14745402ab43d60a5" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.944702 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87f188699035fa3e4f635ee01426488e93891371f8acdae14745402ab43d60a5"} err="failed to get container status \"87f188699035fa3e4f635ee01426488e93891371f8acdae14745402ab43d60a5\": rpc error: code = NotFound desc = could not find container \"87f188699035fa3e4f635ee01426488e93891371f8acdae14745402ab43d60a5\": container with ID starting with 87f188699035fa3e4f635ee01426488e93891371f8acdae14745402ab43d60a5 not found: ID does not exist" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.944725 5120 scope.go:117] "RemoveContainer" containerID="ab80ba76dec4a3675ff982093b1e00458b7271c24416bcba616c2b5a8146daec" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.944921 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab80ba76dec4a3675ff982093b1e00458b7271c24416bcba616c2b5a8146daec"} err="failed to get container status \"ab80ba76dec4a3675ff982093b1e00458b7271c24416bcba616c2b5a8146daec\": rpc error: code = NotFound desc = could not find container \"ab80ba76dec4a3675ff982093b1e00458b7271c24416bcba616c2b5a8146daec\": container with ID starting with ab80ba76dec4a3675ff982093b1e00458b7271c24416bcba616c2b5a8146daec not found: ID does not exist" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.944939 5120 scope.go:117] "RemoveContainer" containerID="7448b0b7bc2b1e855e283f1cab2693cd3203789ace9d495c8b5e48e0d439c2b6" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.947836 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.967408 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c73b6011-0761-469f-9490-c8a294f80020-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"c73b6011-0761-469f-9490-c8a294f80020\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.967509 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/c73b6011-0761-469f-9490-c8a294f80020-public-tls-certs\") pod \"nova-api-0\" (UID: \"c73b6011-0761-469f-9490-c8a294f80020\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.967573 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c73b6011-0761-469f-9490-c8a294f80020-config-data\") pod \"nova-api-0\" (UID: \"c73b6011-0761-469f-9490-c8a294f80020\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.967719 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c73b6011-0761-469f-9490-c8a294f80020-logs\") pod \"nova-api-0\" (UID: \"c73b6011-0761-469f-9490-c8a294f80020\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.967937 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tjv6m\" (UniqueName: \"kubernetes.io/projected/c73b6011-0761-469f-9490-c8a294f80020-kube-api-access-tjv6m\") pod \"nova-api-0\" (UID: \"c73b6011-0761-469f-9490-c8a294f80020\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.968063 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/c73b6011-0761-469f-9490-c8a294f80020-internal-tls-certs\") pod \"nova-api-0\" (UID: \"c73b6011-0761-469f-9490-c8a294f80020\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.972539 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/c73b6011-0761-469f-9490-c8a294f80020-internal-tls-certs\") pod \"nova-api-0\" (UID: \"c73b6011-0761-469f-9490-c8a294f80020\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.972815 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c73b6011-0761-469f-9490-c8a294f80020-logs\") pod \"nova-api-0\" (UID: \"c73b6011-0761-469f-9490-c8a294f80020\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.974988 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c73b6011-0761-469f-9490-c8a294f80020-config-data\") pod \"nova-api-0\" (UID: \"c73b6011-0761-469f-9490-c8a294f80020\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.981495 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c73b6011-0761-469f-9490-c8a294f80020-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"c73b6011-0761-469f-9490-c8a294f80020\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.984928 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/c73b6011-0761-469f-9490-c8a294f80020-public-tls-certs\") pod \"nova-api-0\" (UID: \"c73b6011-0761-469f-9490-c8a294f80020\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.995811 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjv6m\" (UniqueName: \"kubernetes.io/projected/c73b6011-0761-469f-9490-c8a294f80020-kube-api-access-tjv6m\") pod \"nova-api-0\" (UID: \"c73b6011-0761-469f-9490-c8a294f80020\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:50:49 crc kubenswrapper[5120]: I0316 16:50:49.996160 5120 scope.go:117] "RemoveContainer" containerID="dbf315c8df9205f2482ada22ca7c46d5ccb8e4b09237efdd69223dcf7cf4c7af" Mar 16 16:50:50 crc kubenswrapper[5120]: I0316 16:50:50.025726 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:50:50 crc kubenswrapper[5120]: I0316 16:50:50.034415 5120 scope.go:117] "RemoveContainer" containerID="7448b0b7bc2b1e855e283f1cab2693cd3203789ace9d495c8b5e48e0d439c2b6" Mar 16 16:50:50 crc kubenswrapper[5120]: E0316 16:50:50.035184 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7448b0b7bc2b1e855e283f1cab2693cd3203789ace9d495c8b5e48e0d439c2b6\": container with ID starting with 7448b0b7bc2b1e855e283f1cab2693cd3203789ace9d495c8b5e48e0d439c2b6 not found: ID does not exist" containerID="7448b0b7bc2b1e855e283f1cab2693cd3203789ace9d495c8b5e48e0d439c2b6" Mar 16 16:50:50 crc kubenswrapper[5120]: I0316 16:50:50.035238 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7448b0b7bc2b1e855e283f1cab2693cd3203789ace9d495c8b5e48e0d439c2b6"} err="failed to get container status \"7448b0b7bc2b1e855e283f1cab2693cd3203789ace9d495c8b5e48e0d439c2b6\": rpc error: code = NotFound desc = could not find container \"7448b0b7bc2b1e855e283f1cab2693cd3203789ace9d495c8b5e48e0d439c2b6\": container with ID starting with 7448b0b7bc2b1e855e283f1cab2693cd3203789ace9d495c8b5e48e0d439c2b6 not found: ID does not exist" Mar 16 16:50:50 crc kubenswrapper[5120]: I0316 16:50:50.035263 5120 scope.go:117] "RemoveContainer" containerID="dbf315c8df9205f2482ada22ca7c46d5ccb8e4b09237efdd69223dcf7cf4c7af" Mar 16 16:50:50 crc kubenswrapper[5120]: E0316 16:50:50.035520 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dbf315c8df9205f2482ada22ca7c46d5ccb8e4b09237efdd69223dcf7cf4c7af\": container with ID starting with dbf315c8df9205f2482ada22ca7c46d5ccb8e4b09237efdd69223dcf7cf4c7af not found: ID does not exist" containerID="dbf315c8df9205f2482ada22ca7c46d5ccb8e4b09237efdd69223dcf7cf4c7af" Mar 16 16:50:50 crc kubenswrapper[5120]: I0316 16:50:50.035551 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dbf315c8df9205f2482ada22ca7c46d5ccb8e4b09237efdd69223dcf7cf4c7af"} err="failed to get container status \"dbf315c8df9205f2482ada22ca7c46d5ccb8e4b09237efdd69223dcf7cf4c7af\": rpc error: code = NotFound desc = could not find container \"dbf315c8df9205f2482ada22ca7c46d5ccb8e4b09237efdd69223dcf7cf4c7af\": container with ID starting with dbf315c8df9205f2482ada22ca7c46d5ccb8e4b09237efdd69223dcf7cf4c7af not found: ID does not exist" Mar 16 16:50:50 crc kubenswrapper[5120]: I0316 16:50:50.035565 5120 scope.go:117] "RemoveContainer" containerID="7448b0b7bc2b1e855e283f1cab2693cd3203789ace9d495c8b5e48e0d439c2b6" Mar 16 16:50:50 crc kubenswrapper[5120]: I0316 16:50:50.035766 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7448b0b7bc2b1e855e283f1cab2693cd3203789ace9d495c8b5e48e0d439c2b6"} err="failed to get container status \"7448b0b7bc2b1e855e283f1cab2693cd3203789ace9d495c8b5e48e0d439c2b6\": rpc error: code = NotFound desc = could not find container \"7448b0b7bc2b1e855e283f1cab2693cd3203789ace9d495c8b5e48e0d439c2b6\": container with ID starting with 7448b0b7bc2b1e855e283f1cab2693cd3203789ace9d495c8b5e48e0d439c2b6 not found: ID does not exist" Mar 16 16:50:50 crc kubenswrapper[5120]: I0316 16:50:50.035784 5120 scope.go:117] "RemoveContainer" containerID="dbf315c8df9205f2482ada22ca7c46d5ccb8e4b09237efdd69223dcf7cf4c7af" Mar 16 16:50:50 crc kubenswrapper[5120]: I0316 16:50:50.035975 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dbf315c8df9205f2482ada22ca7c46d5ccb8e4b09237efdd69223dcf7cf4c7af"} err="failed to get container status \"dbf315c8df9205f2482ada22ca7c46d5ccb8e4b09237efdd69223dcf7cf4c7af\": rpc error: code = NotFound desc = could not find container \"dbf315c8df9205f2482ada22ca7c46d5ccb8e4b09237efdd69223dcf7cf4c7af\": container with ID starting with dbf315c8df9205f2482ada22ca7c46d5ccb8e4b09237efdd69223dcf7cf4c7af not found: ID does not exist" Mar 16 16:50:50 crc kubenswrapper[5120]: I0316 16:50:50.056266 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:50:50 crc kubenswrapper[5120]: W0316 16:50:50.318328 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf48a2d5a_71e3_4fe6_aa44_9f6e1ae65cd5.slice/crio-b56f13ebb3abb6a7b1c6366cb8e0cb3ab8b8410eecfa9a86f2a029103dfbe860 WatchSource:0}: Error finding container b56f13ebb3abb6a7b1c6366cb8e0cb3ab8b8410eecfa9a86f2a029103dfbe860: Status 404 returned error can't find the container with id b56f13ebb3abb6a7b1c6366cb8e0cb3ab8b8410eecfa9a86f2a029103dfbe860 Mar 16 16:50:50 crc kubenswrapper[5120]: I0316 16:50:50.319011 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:50:50 crc kubenswrapper[5120]: I0316 16:50:50.372651 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:50:50 crc kubenswrapper[5120]: I0316 16:50:50.524936 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"f48a2d5a-71e3-4fe6-aa44-9f6e1ae65cd5","Type":"ContainerStarted","Data":"b56f13ebb3abb6a7b1c6366cb8e0cb3ab8b8410eecfa9a86f2a029103dfbe860"} Mar 16 16:50:50 crc kubenswrapper[5120]: I0316 16:50:50.528315 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"fca63e3b-929a-4864-b234-3dcb19a31da8","Type":"ContainerStarted","Data":"957583e99dcbe835d4fd5b23c3b4fd6601163e041d7816d888c380b9971cf8b2"} Mar 16 16:50:50 crc kubenswrapper[5120]: I0316 16:50:50.528357 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"fca63e3b-929a-4864-b234-3dcb19a31da8","Type":"ContainerStarted","Data":"389d94f15b6d6db7557fb56fc24f463b822baa0cf93fdf828501b25531874846"} Mar 16 16:50:50 crc kubenswrapper[5120]: I0316 16:50:50.528368 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"fca63e3b-929a-4864-b234-3dcb19a31da8","Type":"ContainerStarted","Data":"524d479d272b0cd150a269b1dc0c259e3cdba8242bc9d7515938d56b05ba95ee"} Mar 16 16:50:50 crc kubenswrapper[5120]: I0316 16:50:50.528533 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="fca63e3b-929a-4864-b234-3dcb19a31da8" containerName="nova-metadata-log" containerID="cri-o://389d94f15b6d6db7557fb56fc24f463b822baa0cf93fdf828501b25531874846" gracePeriod=30 Mar 16 16:50:50 crc kubenswrapper[5120]: I0316 16:50:50.528975 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="fca63e3b-929a-4864-b234-3dcb19a31da8" containerName="nova-metadata-metadata" containerID="cri-o://957583e99dcbe835d4fd5b23c3b4fd6601163e041d7816d888c380b9971cf8b2" gracePeriod=30 Mar 16 16:50:50 crc kubenswrapper[5120]: I0316 16:50:50.553026 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=2.553006435 podStartE2EDuration="2.553006435s" podCreationTimestamp="2026-03-16 16:50:48 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:50:50.551151234 +0000 UTC m=+4752.705082901" watchObservedRunningTime="2026-03-16 16:50:50.553006435 +0000 UTC m=+4752.706938092" Mar 16 16:50:50 crc kubenswrapper[5120]: I0316 16:50:50.559346 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:50:50 crc kubenswrapper[5120]: I0316 16:50:50.559771 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"01f62262-5954-44de-80cb-c1cf1c179a0f","Type":"ContainerStarted","Data":"b56f0565dc2be984512ca563ce8d4aba134cd33629dfbaa67b4f8b221b49f35c"} Mar 16 16:50:50 crc kubenswrapper[5120]: I0316 16:50:50.559817 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"01f62262-5954-44de-80cb-c1cf1c179a0f","Type":"ContainerStarted","Data":"f82e977db20799693423a2354a1e22f26fb2cd8cddbbd074437a51e18f474944"} Mar 16 16:50:50 crc kubenswrapper[5120]: I0316 16:50:50.559930 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:50:50 crc kubenswrapper[5120]: I0316 16:50:50.559935 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="01f62262-5954-44de-80cb-c1cf1c179a0f" containerName="nova-cell0-conductor-conductor" containerID="cri-o://b56f0565dc2be984512ca563ce8d4aba134cd33629dfbaa67b4f8b221b49f35c" gracePeriod=30 Mar 16 16:50:50 crc kubenswrapper[5120]: I0316 16:50:50.586330 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podStartSLOduration=2.586311159 podStartE2EDuration="2.586311159s" podCreationTimestamp="2026-03-16 16:50:48 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:50:50.586069682 +0000 UTC m=+4752.740001339" watchObservedRunningTime="2026-03-16 16:50:50.586311159 +0000 UTC m=+4752.740242826" Mar 16 16:50:50 crc kubenswrapper[5120]: I0316 16:50:50.639942 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:50:50 crc kubenswrapper[5120]: I0316 16:50:50.680738 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="618db375-cac6-46d6-a08f-28876736a830" path="/var/lib/kubelet/pods/618db375-cac6-46d6-a08f-28876736a830/volumes" Mar 16 16:50:50 crc kubenswrapper[5120]: I0316 16:50:50.681737 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b50dad34-ac9d-48e2-833e-a902932cc311" path="/var/lib/kubelet/pods/b50dad34-ac9d-48e2-833e-a902932cc311/volumes" Mar 16 16:50:50 crc kubenswrapper[5120]: I0316 16:50:50.689749 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c73b6011-0761-469f-9490-c8a294f80020-logs\") pod \"c73b6011-0761-469f-9490-c8a294f80020\" (UID: \"c73b6011-0761-469f-9490-c8a294f80020\") " Mar 16 16:50:50 crc kubenswrapper[5120]: I0316 16:50:50.689876 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/c73b6011-0761-469f-9490-c8a294f80020-public-tls-certs\") pod \"c73b6011-0761-469f-9490-c8a294f80020\" (UID: \"c73b6011-0761-469f-9490-c8a294f80020\") " Mar 16 16:50:50 crc kubenswrapper[5120]: I0316 16:50:50.690109 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c73b6011-0761-469f-9490-c8a294f80020-logs" (OuterVolumeSpecName: "logs") pod "c73b6011-0761-469f-9490-c8a294f80020" (UID: "c73b6011-0761-469f-9490-c8a294f80020"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:50:50 crc kubenswrapper[5120]: I0316 16:50:50.690121 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tjv6m\" (UniqueName: \"kubernetes.io/projected/c73b6011-0761-469f-9490-c8a294f80020-kube-api-access-tjv6m\") pod \"c73b6011-0761-469f-9490-c8a294f80020\" (UID: \"c73b6011-0761-469f-9490-c8a294f80020\") " Mar 16 16:50:50 crc kubenswrapper[5120]: I0316 16:50:50.690266 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c73b6011-0761-469f-9490-c8a294f80020-combined-ca-bundle\") pod \"c73b6011-0761-469f-9490-c8a294f80020\" (UID: \"c73b6011-0761-469f-9490-c8a294f80020\") " Mar 16 16:50:50 crc kubenswrapper[5120]: I0316 16:50:50.690647 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c73b6011-0761-469f-9490-c8a294f80020-config-data\") pod \"c73b6011-0761-469f-9490-c8a294f80020\" (UID: \"c73b6011-0761-469f-9490-c8a294f80020\") " Mar 16 16:50:50 crc kubenswrapper[5120]: I0316 16:50:50.691214 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/c73b6011-0761-469f-9490-c8a294f80020-internal-tls-certs\") pod \"c73b6011-0761-469f-9490-c8a294f80020\" (UID: \"c73b6011-0761-469f-9490-c8a294f80020\") " Mar 16 16:50:50 crc kubenswrapper[5120]: I0316 16:50:50.692232 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c73b6011-0761-469f-9490-c8a294f80020-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:50 crc kubenswrapper[5120]: I0316 16:50:50.697609 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c73b6011-0761-469f-9490-c8a294f80020-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "c73b6011-0761-469f-9490-c8a294f80020" (UID: "c73b6011-0761-469f-9490-c8a294f80020"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:50:50 crc kubenswrapper[5120]: I0316 16:50:50.697635 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c73b6011-0761-469f-9490-c8a294f80020-config-data" (OuterVolumeSpecName: "config-data") pod "c73b6011-0761-469f-9490-c8a294f80020" (UID: "c73b6011-0761-469f-9490-c8a294f80020"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:50:50 crc kubenswrapper[5120]: I0316 16:50:50.697681 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c73b6011-0761-469f-9490-c8a294f80020-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "c73b6011-0761-469f-9490-c8a294f80020" (UID: "c73b6011-0761-469f-9490-c8a294f80020"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:50:50 crc kubenswrapper[5120]: I0316 16:50:50.699989 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c73b6011-0761-469f-9490-c8a294f80020-kube-api-access-tjv6m" (OuterVolumeSpecName: "kube-api-access-tjv6m") pod "c73b6011-0761-469f-9490-c8a294f80020" (UID: "c73b6011-0761-469f-9490-c8a294f80020"). InnerVolumeSpecName "kube-api-access-tjv6m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:50:50 crc kubenswrapper[5120]: I0316 16:50:50.701937 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c73b6011-0761-469f-9490-c8a294f80020-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "c73b6011-0761-469f-9490-c8a294f80020" (UID: "c73b6011-0761-469f-9490-c8a294f80020"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:50:50 crc kubenswrapper[5120]: I0316 16:50:50.795313 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tjv6m\" (UniqueName: \"kubernetes.io/projected/c73b6011-0761-469f-9490-c8a294f80020-kube-api-access-tjv6m\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:50 crc kubenswrapper[5120]: I0316 16:50:50.795348 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c73b6011-0761-469f-9490-c8a294f80020-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:50 crc kubenswrapper[5120]: I0316 16:50:50.795357 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c73b6011-0761-469f-9490-c8a294f80020-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:50 crc kubenswrapper[5120]: I0316 16:50:50.795366 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/c73b6011-0761-469f-9490-c8a294f80020-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:50 crc kubenswrapper[5120]: I0316 16:50:50.795375 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/c73b6011-0761-469f-9490-c8a294f80020-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:51 crc kubenswrapper[5120]: I0316 16:50:51.076406 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:50:51 crc kubenswrapper[5120]: I0316 16:50:51.573750 5120 generic.go:358] "Generic (PLEG): container finished" podID="fca63e3b-929a-4864-b234-3dcb19a31da8" containerID="389d94f15b6d6db7557fb56fc24f463b822baa0cf93fdf828501b25531874846" exitCode=143 Mar 16 16:50:51 crc kubenswrapper[5120]: I0316 16:50:51.573844 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"fca63e3b-929a-4864-b234-3dcb19a31da8","Type":"ContainerDied","Data":"389d94f15b6d6db7557fb56fc24f463b822baa0cf93fdf828501b25531874846"} Mar 16 16:50:51 crc kubenswrapper[5120]: I0316 16:50:51.574410 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:50:51 crc kubenswrapper[5120]: I0316 16:50:51.636203 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:50:51 crc kubenswrapper[5120]: I0316 16:50:51.658391 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:50:51 crc kubenswrapper[5120]: I0316 16:50:51.691944 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:50:51 crc kubenswrapper[5120]: I0316 16:50:51.709056 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:50:51 crc kubenswrapper[5120]: I0316 16:50:51.709227 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:50:51 crc kubenswrapper[5120]: I0316 16:50:51.714111 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-public-svc\"" Mar 16 16:50:51 crc kubenswrapper[5120]: I0316 16:50:51.714350 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-internal-svc\"" Mar 16 16:50:51 crc kubenswrapper[5120]: I0316 16:50:51.714984 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-config-data\"" Mar 16 16:50:51 crc kubenswrapper[5120]: I0316 16:50:51.819593 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6ca84af3-af8c-4723-8898-0b8335f784a5-internal-tls-certs\") pod \"nova-api-0\" (UID: \"6ca84af3-af8c-4723-8898-0b8335f784a5\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:50:51 crc kubenswrapper[5120]: I0316 16:50:51.819703 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6ca84af3-af8c-4723-8898-0b8335f784a5-public-tls-certs\") pod \"nova-api-0\" (UID: \"6ca84af3-af8c-4723-8898-0b8335f784a5\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:50:51 crc kubenswrapper[5120]: I0316 16:50:51.819752 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6ca84af3-af8c-4723-8898-0b8335f784a5-config-data\") pod \"nova-api-0\" (UID: \"6ca84af3-af8c-4723-8898-0b8335f784a5\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:50:51 crc kubenswrapper[5120]: I0316 16:50:51.819823 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6ca84af3-af8c-4723-8898-0b8335f784a5-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"6ca84af3-af8c-4723-8898-0b8335f784a5\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:50:51 crc kubenswrapper[5120]: I0316 16:50:51.819927 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6ca84af3-af8c-4723-8898-0b8335f784a5-logs\") pod \"nova-api-0\" (UID: \"6ca84af3-af8c-4723-8898-0b8335f784a5\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:50:51 crc kubenswrapper[5120]: I0316 16:50:51.820010 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-776rs\" (UniqueName: \"kubernetes.io/projected/6ca84af3-af8c-4723-8898-0b8335f784a5-kube-api-access-776rs\") pod \"nova-api-0\" (UID: \"6ca84af3-af8c-4723-8898-0b8335f784a5\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:50:51 crc kubenswrapper[5120]: I0316 16:50:51.928261 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6ca84af3-af8c-4723-8898-0b8335f784a5-logs\") pod \"nova-api-0\" (UID: \"6ca84af3-af8c-4723-8898-0b8335f784a5\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:50:51 crc kubenswrapper[5120]: I0316 16:50:51.928726 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-776rs\" (UniqueName: \"kubernetes.io/projected/6ca84af3-af8c-4723-8898-0b8335f784a5-kube-api-access-776rs\") pod \"nova-api-0\" (UID: \"6ca84af3-af8c-4723-8898-0b8335f784a5\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:50:51 crc kubenswrapper[5120]: I0316 16:50:51.928788 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6ca84af3-af8c-4723-8898-0b8335f784a5-logs\") pod \"nova-api-0\" (UID: \"6ca84af3-af8c-4723-8898-0b8335f784a5\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:50:51 crc kubenswrapper[5120]: I0316 16:50:51.929013 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6ca84af3-af8c-4723-8898-0b8335f784a5-internal-tls-certs\") pod \"nova-api-0\" (UID: \"6ca84af3-af8c-4723-8898-0b8335f784a5\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:50:51 crc kubenswrapper[5120]: I0316 16:50:51.929840 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6ca84af3-af8c-4723-8898-0b8335f784a5-public-tls-certs\") pod \"nova-api-0\" (UID: \"6ca84af3-af8c-4723-8898-0b8335f784a5\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:50:51 crc kubenswrapper[5120]: I0316 16:50:51.929935 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6ca84af3-af8c-4723-8898-0b8335f784a5-config-data\") pod \"nova-api-0\" (UID: \"6ca84af3-af8c-4723-8898-0b8335f784a5\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:50:51 crc kubenswrapper[5120]: I0316 16:50:51.929981 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6ca84af3-af8c-4723-8898-0b8335f784a5-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"6ca84af3-af8c-4723-8898-0b8335f784a5\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:50:51 crc kubenswrapper[5120]: I0316 16:50:51.937304 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6ca84af3-af8c-4723-8898-0b8335f784a5-public-tls-certs\") pod \"nova-api-0\" (UID: \"6ca84af3-af8c-4723-8898-0b8335f784a5\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:50:51 crc kubenswrapper[5120]: I0316 16:50:51.937406 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6ca84af3-af8c-4723-8898-0b8335f784a5-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"6ca84af3-af8c-4723-8898-0b8335f784a5\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:50:51 crc kubenswrapper[5120]: I0316 16:50:51.937427 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6ca84af3-af8c-4723-8898-0b8335f784a5-internal-tls-certs\") pod \"nova-api-0\" (UID: \"6ca84af3-af8c-4723-8898-0b8335f784a5\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:50:51 crc kubenswrapper[5120]: I0316 16:50:51.937809 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6ca84af3-af8c-4723-8898-0b8335f784a5-config-data\") pod \"nova-api-0\" (UID: \"6ca84af3-af8c-4723-8898-0b8335f784a5\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:50:51 crc kubenswrapper[5120]: I0316 16:50:51.963862 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-776rs\" (UniqueName: \"kubernetes.io/projected/6ca84af3-af8c-4723-8898-0b8335f784a5-kube-api-access-776rs\") pod \"nova-api-0\" (UID: \"6ca84af3-af8c-4723-8898-0b8335f784a5\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:50:52 crc kubenswrapper[5120]: I0316 16:50:52.007566 5120 patch_prober.go:28] interesting pod/machine-config-daemon-7bf76 container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 16:50:52 crc kubenswrapper[5120]: I0316 16:50:52.007624 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 16:50:52 crc kubenswrapper[5120]: I0316 16:50:52.033918 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:50:52 crc kubenswrapper[5120]: I0316 16:50:52.583870 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:50:52 crc kubenswrapper[5120]: W0316 16:50:52.587005 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6ca84af3_af8c_4723_8898_0b8335f784a5.slice/crio-fd88fdb175cf1cc36af140fd1d22a7611f1600555c7ab6c34e7cb4a8bbaf18c7 WatchSource:0}: Error finding container fd88fdb175cf1cc36af140fd1d22a7611f1600555c7ab6c34e7cb4a8bbaf18c7: Status 404 returned error can't find the container with id fd88fdb175cf1cc36af140fd1d22a7611f1600555c7ab6c34e7cb4a8bbaf18c7 Mar 16 16:50:52 crc kubenswrapper[5120]: I0316 16:50:52.678246 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c73b6011-0761-469f-9490-c8a294f80020" path="/var/lib/kubelet/pods/c73b6011-0761-469f-9490-c8a294f80020/volumes" Mar 16 16:50:53 crc kubenswrapper[5120]: I0316 16:50:53.461928 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:50:53 crc kubenswrapper[5120]: E0316 16:50:53.465542 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="59ea000c80804f2740555310ca43eeb4d84a66364bbce05903490e9bceb834a3" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:50:53 crc kubenswrapper[5120]: I0316 16:50:53.469501 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/swift-proxy-588bfd87d6-cq2c8" Mar 16 16:50:53 crc kubenswrapper[5120]: E0316 16:50:53.469619 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="59ea000c80804f2740555310ca43eeb4d84a66364bbce05903490e9bceb834a3" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:50:53 crc kubenswrapper[5120]: I0316 16:50:53.470208 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/swift-proxy-588bfd87d6-cq2c8" Mar 16 16:50:53 crc kubenswrapper[5120]: E0316 16:50:53.471966 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="59ea000c80804f2740555310ca43eeb4d84a66364bbce05903490e9bceb834a3" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:50:53 crc kubenswrapper[5120]: E0316 16:50:53.472043 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="d43280dd-cd49-4365-8474-7bab9f5b4899" containerName="nova-cell1-conductor-conductor" probeResult="unknown" Mar 16 16:50:53 crc kubenswrapper[5120]: I0316 16:50:53.549451 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-proxy-cc67b5786-c2cmq"] Mar 16 16:50:53 crc kubenswrapper[5120]: I0316 16:50:53.549747 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-proxy-cc67b5786-c2cmq" podUID="e367a07e-829a-4ad9-96b4-c91caa885ac7" containerName="proxy-server" containerID="cri-o://372c7be9a29c3eff8a82a86058ca9e149effcda013dae07b02322a76efb4777b" gracePeriod=30 Mar 16 16:50:53 crc kubenswrapper[5120]: I0316 16:50:53.549913 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-proxy-cc67b5786-c2cmq" podUID="e367a07e-829a-4ad9-96b4-c91caa885ac7" containerName="proxy-httpd" containerID="cri-o://979f2dceced6185d9838ead2e115e9dd970603f1ff26cc2bb6d5fb47a603ffbd" gracePeriod=30 Mar 16 16:50:53 crc kubenswrapper[5120]: I0316 16:50:53.607869 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"f48a2d5a-71e3-4fe6-aa44-9f6e1ae65cd5","Type":"ContainerStarted","Data":"c572e3ed545bda23c8515edc573ff526f728a3d8b7cfe2e6a290282109c437df"} Mar 16 16:50:53 crc kubenswrapper[5120]: I0316 16:50:53.616067 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"6ca84af3-af8c-4723-8898-0b8335f784a5","Type":"ContainerStarted","Data":"3d396f592ed4c8b66577fab0f92ffa65d7dfb3d04444e3bc76a8f6017ce657b6"} Mar 16 16:50:53 crc kubenswrapper[5120]: I0316 16:50:53.616139 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"6ca84af3-af8c-4723-8898-0b8335f784a5","Type":"ContainerStarted","Data":"6f77904ebe2f2cd80ae43eb269a40f4091aad970e3d39b702938036b8cf6be60"} Mar 16 16:50:53 crc kubenswrapper[5120]: I0316 16:50:53.616156 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"6ca84af3-af8c-4723-8898-0b8335f784a5","Type":"ContainerStarted","Data":"fd88fdb175cf1cc36af140fd1d22a7611f1600555c7ab6c34e7cb4a8bbaf18c7"} Mar 16 16:50:53 crc kubenswrapper[5120]: I0316 16:50:53.649957 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=2.649915788 podStartE2EDuration="2.649915788s" podCreationTimestamp="2026-03-16 16:50:51 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:50:53.636104929 +0000 UTC m=+4755.790036606" watchObservedRunningTime="2026-03-16 16:50:53.649915788 +0000 UTC m=+4755.803847445" Mar 16 16:50:54 crc kubenswrapper[5120]: I0316 16:50:54.291533 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-cc67b5786-c2cmq" Mar 16 16:50:54 crc kubenswrapper[5120]: I0316 16:50:54.403262 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e367a07e-829a-4ad9-96b4-c91caa885ac7-config-data\") pod \"e367a07e-829a-4ad9-96b4-c91caa885ac7\" (UID: \"e367a07e-829a-4ad9-96b4-c91caa885ac7\") " Mar 16 16:50:54 crc kubenswrapper[5120]: I0316 16:50:54.403310 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e367a07e-829a-4ad9-96b4-c91caa885ac7-combined-ca-bundle\") pod \"e367a07e-829a-4ad9-96b4-c91caa885ac7\" (UID: \"e367a07e-829a-4ad9-96b4-c91caa885ac7\") " Mar 16 16:50:54 crc kubenswrapper[5120]: I0316 16:50:54.403376 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/e367a07e-829a-4ad9-96b4-c91caa885ac7-etc-swift\") pod \"e367a07e-829a-4ad9-96b4-c91caa885ac7\" (UID: \"e367a07e-829a-4ad9-96b4-c91caa885ac7\") " Mar 16 16:50:54 crc kubenswrapper[5120]: I0316 16:50:54.403441 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e367a07e-829a-4ad9-96b4-c91caa885ac7-run-httpd\") pod \"e367a07e-829a-4ad9-96b4-c91caa885ac7\" (UID: \"e367a07e-829a-4ad9-96b4-c91caa885ac7\") " Mar 16 16:50:54 crc kubenswrapper[5120]: I0316 16:50:54.403624 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e367a07e-829a-4ad9-96b4-c91caa885ac7-log-httpd\") pod \"e367a07e-829a-4ad9-96b4-c91caa885ac7\" (UID: \"e367a07e-829a-4ad9-96b4-c91caa885ac7\") " Mar 16 16:50:54 crc kubenswrapper[5120]: I0316 16:50:54.403934 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6s4mc\" (UniqueName: \"kubernetes.io/projected/e367a07e-829a-4ad9-96b4-c91caa885ac7-kube-api-access-6s4mc\") pod \"e367a07e-829a-4ad9-96b4-c91caa885ac7\" (UID: \"e367a07e-829a-4ad9-96b4-c91caa885ac7\") " Mar 16 16:50:54 crc kubenswrapper[5120]: I0316 16:50:54.406719 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e367a07e-829a-4ad9-96b4-c91caa885ac7-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "e367a07e-829a-4ad9-96b4-c91caa885ac7" (UID: "e367a07e-829a-4ad9-96b4-c91caa885ac7"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:50:54 crc kubenswrapper[5120]: I0316 16:50:54.407643 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e367a07e-829a-4ad9-96b4-c91caa885ac7-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "e367a07e-829a-4ad9-96b4-c91caa885ac7" (UID: "e367a07e-829a-4ad9-96b4-c91caa885ac7"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:50:54 crc kubenswrapper[5120]: I0316 16:50:54.414972 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e367a07e-829a-4ad9-96b4-c91caa885ac7-etc-swift" (OuterVolumeSpecName: "etc-swift") pod "e367a07e-829a-4ad9-96b4-c91caa885ac7" (UID: "e367a07e-829a-4ad9-96b4-c91caa885ac7"). InnerVolumeSpecName "etc-swift". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:50:54 crc kubenswrapper[5120]: I0316 16:50:54.415930 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e367a07e-829a-4ad9-96b4-c91caa885ac7-kube-api-access-6s4mc" (OuterVolumeSpecName: "kube-api-access-6s4mc") pod "e367a07e-829a-4ad9-96b4-c91caa885ac7" (UID: "e367a07e-829a-4ad9-96b4-c91caa885ac7"). InnerVolumeSpecName "kube-api-access-6s4mc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:50:54 crc kubenswrapper[5120]: I0316 16:50:54.472871 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e367a07e-829a-4ad9-96b4-c91caa885ac7-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e367a07e-829a-4ad9-96b4-c91caa885ac7" (UID: "e367a07e-829a-4ad9-96b4-c91caa885ac7"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:50:54 crc kubenswrapper[5120]: I0316 16:50:54.473705 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e367a07e-829a-4ad9-96b4-c91caa885ac7-config-data" (OuterVolumeSpecName: "config-data") pod "e367a07e-829a-4ad9-96b4-c91caa885ac7" (UID: "e367a07e-829a-4ad9-96b4-c91caa885ac7"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:50:54 crc kubenswrapper[5120]: I0316 16:50:54.507500 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e367a07e-829a-4ad9-96b4-c91caa885ac7-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:54 crc kubenswrapper[5120]: I0316 16:50:54.507543 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6s4mc\" (UniqueName: \"kubernetes.io/projected/e367a07e-829a-4ad9-96b4-c91caa885ac7-kube-api-access-6s4mc\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:54 crc kubenswrapper[5120]: I0316 16:50:54.507555 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e367a07e-829a-4ad9-96b4-c91caa885ac7-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:54 crc kubenswrapper[5120]: I0316 16:50:54.507564 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e367a07e-829a-4ad9-96b4-c91caa885ac7-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:54 crc kubenswrapper[5120]: I0316 16:50:54.507572 5120 reconciler_common.go:299] "Volume detached for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/e367a07e-829a-4ad9-96b4-c91caa885ac7-etc-swift\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:54 crc kubenswrapper[5120]: I0316 16:50:54.507581 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e367a07e-829a-4ad9-96b4-c91caa885ac7-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:50:54 crc kubenswrapper[5120]: I0316 16:50:54.626706 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"f48a2d5a-71e3-4fe6-aa44-9f6e1ae65cd5","Type":"ContainerStarted","Data":"562ad65653e549769b0785758bbb02e15b2461aff7d42fe78c26ac0230470143"} Mar 16 16:50:54 crc kubenswrapper[5120]: I0316 16:50:54.630152 5120 generic.go:358] "Generic (PLEG): container finished" podID="e367a07e-829a-4ad9-96b4-c91caa885ac7" containerID="372c7be9a29c3eff8a82a86058ca9e149effcda013dae07b02322a76efb4777b" exitCode=0 Mar 16 16:50:54 crc kubenswrapper[5120]: I0316 16:50:54.630174 5120 generic.go:358] "Generic (PLEG): container finished" podID="e367a07e-829a-4ad9-96b4-c91caa885ac7" containerID="979f2dceced6185d9838ead2e115e9dd970603f1ff26cc2bb6d5fb47a603ffbd" exitCode=0 Mar 16 16:50:54 crc kubenswrapper[5120]: I0316 16:50:54.630253 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-cc67b5786-c2cmq" event={"ID":"e367a07e-829a-4ad9-96b4-c91caa885ac7","Type":"ContainerDied","Data":"372c7be9a29c3eff8a82a86058ca9e149effcda013dae07b02322a76efb4777b"} Mar 16 16:50:54 crc kubenswrapper[5120]: I0316 16:50:54.630315 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-cc67b5786-c2cmq" event={"ID":"e367a07e-829a-4ad9-96b4-c91caa885ac7","Type":"ContainerDied","Data":"979f2dceced6185d9838ead2e115e9dd970603f1ff26cc2bb6d5fb47a603ffbd"} Mar 16 16:50:54 crc kubenswrapper[5120]: I0316 16:50:54.630340 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-cc67b5786-c2cmq" event={"ID":"e367a07e-829a-4ad9-96b4-c91caa885ac7","Type":"ContainerDied","Data":"d7be4be7e0b43b0d825bdab3532a165287879d22cbf67c424587176d6463bf40"} Mar 16 16:50:54 crc kubenswrapper[5120]: I0316 16:50:54.630364 5120 scope.go:117] "RemoveContainer" containerID="372c7be9a29c3eff8a82a86058ca9e149effcda013dae07b02322a76efb4777b" Mar 16 16:50:54 crc kubenswrapper[5120]: I0316 16:50:54.630564 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-cc67b5786-c2cmq" Mar 16 16:50:54 crc kubenswrapper[5120]: I0316 16:50:54.663037 5120 scope.go:117] "RemoveContainer" containerID="979f2dceced6185d9838ead2e115e9dd970603f1ff26cc2bb6d5fb47a603ffbd" Mar 16 16:50:54 crc kubenswrapper[5120]: I0316 16:50:54.679678 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-proxy-cc67b5786-c2cmq"] Mar 16 16:50:54 crc kubenswrapper[5120]: I0316 16:50:54.684842 5120 scope.go:117] "RemoveContainer" containerID="372c7be9a29c3eff8a82a86058ca9e149effcda013dae07b02322a76efb4777b" Mar 16 16:50:54 crc kubenswrapper[5120]: E0316 16:50:54.685403 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"372c7be9a29c3eff8a82a86058ca9e149effcda013dae07b02322a76efb4777b\": container with ID starting with 372c7be9a29c3eff8a82a86058ca9e149effcda013dae07b02322a76efb4777b not found: ID does not exist" containerID="372c7be9a29c3eff8a82a86058ca9e149effcda013dae07b02322a76efb4777b" Mar 16 16:50:54 crc kubenswrapper[5120]: I0316 16:50:54.685440 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"372c7be9a29c3eff8a82a86058ca9e149effcda013dae07b02322a76efb4777b"} err="failed to get container status \"372c7be9a29c3eff8a82a86058ca9e149effcda013dae07b02322a76efb4777b\": rpc error: code = NotFound desc = could not find container \"372c7be9a29c3eff8a82a86058ca9e149effcda013dae07b02322a76efb4777b\": container with ID starting with 372c7be9a29c3eff8a82a86058ca9e149effcda013dae07b02322a76efb4777b not found: ID does not exist" Mar 16 16:50:54 crc kubenswrapper[5120]: I0316 16:50:54.685462 5120 scope.go:117] "RemoveContainer" containerID="979f2dceced6185d9838ead2e115e9dd970603f1ff26cc2bb6d5fb47a603ffbd" Mar 16 16:50:54 crc kubenswrapper[5120]: E0316 16:50:54.686312 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"979f2dceced6185d9838ead2e115e9dd970603f1ff26cc2bb6d5fb47a603ffbd\": container with ID starting with 979f2dceced6185d9838ead2e115e9dd970603f1ff26cc2bb6d5fb47a603ffbd not found: ID does not exist" containerID="979f2dceced6185d9838ead2e115e9dd970603f1ff26cc2bb6d5fb47a603ffbd" Mar 16 16:50:54 crc kubenswrapper[5120]: I0316 16:50:54.686336 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"979f2dceced6185d9838ead2e115e9dd970603f1ff26cc2bb6d5fb47a603ffbd"} err="failed to get container status \"979f2dceced6185d9838ead2e115e9dd970603f1ff26cc2bb6d5fb47a603ffbd\": rpc error: code = NotFound desc = could not find container \"979f2dceced6185d9838ead2e115e9dd970603f1ff26cc2bb6d5fb47a603ffbd\": container with ID starting with 979f2dceced6185d9838ead2e115e9dd970603f1ff26cc2bb6d5fb47a603ffbd not found: ID does not exist" Mar 16 16:50:54 crc kubenswrapper[5120]: I0316 16:50:54.686355 5120 scope.go:117] "RemoveContainer" containerID="372c7be9a29c3eff8a82a86058ca9e149effcda013dae07b02322a76efb4777b" Mar 16 16:50:54 crc kubenswrapper[5120]: I0316 16:50:54.686598 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"372c7be9a29c3eff8a82a86058ca9e149effcda013dae07b02322a76efb4777b"} err="failed to get container status \"372c7be9a29c3eff8a82a86058ca9e149effcda013dae07b02322a76efb4777b\": rpc error: code = NotFound desc = could not find container \"372c7be9a29c3eff8a82a86058ca9e149effcda013dae07b02322a76efb4777b\": container with ID starting with 372c7be9a29c3eff8a82a86058ca9e149effcda013dae07b02322a76efb4777b not found: ID does not exist" Mar 16 16:50:54 crc kubenswrapper[5120]: I0316 16:50:54.686621 5120 scope.go:117] "RemoveContainer" containerID="979f2dceced6185d9838ead2e115e9dd970603f1ff26cc2bb6d5fb47a603ffbd" Mar 16 16:50:54 crc kubenswrapper[5120]: I0316 16:50:54.686820 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"979f2dceced6185d9838ead2e115e9dd970603f1ff26cc2bb6d5fb47a603ffbd"} err="failed to get container status \"979f2dceced6185d9838ead2e115e9dd970603f1ff26cc2bb6d5fb47a603ffbd\": rpc error: code = NotFound desc = could not find container \"979f2dceced6185d9838ead2e115e9dd970603f1ff26cc2bb6d5fb47a603ffbd\": container with ID starting with 979f2dceced6185d9838ead2e115e9dd970603f1ff26cc2bb6d5fb47a603ffbd not found: ID does not exist" Mar 16 16:50:54 crc kubenswrapper[5120]: I0316 16:50:54.687573 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/swift-proxy-cc67b5786-c2cmq"] Mar 16 16:50:55 crc kubenswrapper[5120]: E0316 16:50:55.562302 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="b56f0565dc2be984512ca563ce8d4aba134cd33629dfbaa67b4f8b221b49f35c" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:50:55 crc kubenswrapper[5120]: E0316 16:50:55.565475 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="b56f0565dc2be984512ca563ce8d4aba134cd33629dfbaa67b4f8b221b49f35c" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:50:55 crc kubenswrapper[5120]: E0316 16:50:55.568092 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="b56f0565dc2be984512ca563ce8d4aba134cd33629dfbaa67b4f8b221b49f35c" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:50:55 crc kubenswrapper[5120]: E0316 16:50:55.568165 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="01f62262-5954-44de-80cb-c1cf1c179a0f" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 16:50:55 crc kubenswrapper[5120]: I0316 16:50:55.651312 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"f48a2d5a-71e3-4fe6-aa44-9f6e1ae65cd5","Type":"ContainerStarted","Data":"da9c557f144aa7a20d0cd7bb8042cc5a4c2af81e74d91478868bba234c779e70"} Mar 16 16:50:56 crc kubenswrapper[5120]: I0316 16:50:56.678931 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e367a07e-829a-4ad9-96b4-c91caa885ac7" path="/var/lib/kubelet/pods/e367a07e-829a-4ad9-96b4-c91caa885ac7/volumes" Mar 16 16:50:57 crc kubenswrapper[5120]: I0316 16:50:57.674707 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"f48a2d5a-71e3-4fe6-aa44-9f6e1ae65cd5","Type":"ContainerStarted","Data":"d7d2032417ff30d0c8ae603e6be3dbd62729153b88bd4727d91aa7ac4131c8ef"} Mar 16 16:50:57 crc kubenswrapper[5120]: I0316 16:50:57.675547 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="f48a2d5a-71e3-4fe6-aa44-9f6e1ae65cd5" containerName="ceilometer-central-agent" containerID="cri-o://c572e3ed545bda23c8515edc573ff526f728a3d8b7cfe2e6a290282109c437df" gracePeriod=30 Mar 16 16:50:57 crc kubenswrapper[5120]: I0316 16:50:57.675670 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="f48a2d5a-71e3-4fe6-aa44-9f6e1ae65cd5" containerName="sg-core" containerID="cri-o://da9c557f144aa7a20d0cd7bb8042cc5a4c2af81e74d91478868bba234c779e70" gracePeriod=30 Mar 16 16:50:57 crc kubenswrapper[5120]: I0316 16:50:57.675579 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="f48a2d5a-71e3-4fe6-aa44-9f6e1ae65cd5" containerName="proxy-httpd" containerID="cri-o://d7d2032417ff30d0c8ae603e6be3dbd62729153b88bd4727d91aa7ac4131c8ef" gracePeriod=30 Mar 16 16:50:57 crc kubenswrapper[5120]: I0316 16:50:57.675617 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="f48a2d5a-71e3-4fe6-aa44-9f6e1ae65cd5" containerName="ceilometer-notification-agent" containerID="cri-o://562ad65653e549769b0785758bbb02e15b2461aff7d42fe78c26ac0230470143" gracePeriod=30 Mar 16 16:50:57 crc kubenswrapper[5120]: I0316 16:50:57.675623 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:50:57 crc kubenswrapper[5120]: I0316 16:50:57.710808 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.474158426 podStartE2EDuration="8.710790177s" podCreationTimestamp="2026-03-16 16:50:49 +0000 UTC" firstStartedPulling="2026-03-16 16:50:50.320118695 +0000 UTC m=+4752.474050352" lastFinishedPulling="2026-03-16 16:50:56.556750446 +0000 UTC m=+4758.710682103" observedRunningTime="2026-03-16 16:50:57.707183178 +0000 UTC m=+4759.861114835" watchObservedRunningTime="2026-03-16 16:50:57.710790177 +0000 UTC m=+4759.864721834" Mar 16 16:50:58 crc kubenswrapper[5120]: E0316 16:50:58.463392 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="59ea000c80804f2740555310ca43eeb4d84a66364bbce05903490e9bceb834a3" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:50:58 crc kubenswrapper[5120]: E0316 16:50:58.465548 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="59ea000c80804f2740555310ca43eeb4d84a66364bbce05903490e9bceb834a3" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:50:58 crc kubenswrapper[5120]: E0316 16:50:58.467206 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="59ea000c80804f2740555310ca43eeb4d84a66364bbce05903490e9bceb834a3" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:50:58 crc kubenswrapper[5120]: E0316 16:50:58.467257 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="d43280dd-cd49-4365-8474-7bab9f5b4899" containerName="nova-cell1-conductor-conductor" probeResult="unknown" Mar 16 16:50:58 crc kubenswrapper[5120]: I0316 16:50:58.687246 5120 generic.go:358] "Generic (PLEG): container finished" podID="f48a2d5a-71e3-4fe6-aa44-9f6e1ae65cd5" containerID="d7d2032417ff30d0c8ae603e6be3dbd62729153b88bd4727d91aa7ac4131c8ef" exitCode=0 Mar 16 16:50:58 crc kubenswrapper[5120]: I0316 16:50:58.687274 5120 generic.go:358] "Generic (PLEG): container finished" podID="f48a2d5a-71e3-4fe6-aa44-9f6e1ae65cd5" containerID="da9c557f144aa7a20d0cd7bb8042cc5a4c2af81e74d91478868bba234c779e70" exitCode=2 Mar 16 16:50:58 crc kubenswrapper[5120]: I0316 16:50:58.687280 5120 generic.go:358] "Generic (PLEG): container finished" podID="f48a2d5a-71e3-4fe6-aa44-9f6e1ae65cd5" containerID="562ad65653e549769b0785758bbb02e15b2461aff7d42fe78c26ac0230470143" exitCode=0 Mar 16 16:50:58 crc kubenswrapper[5120]: I0316 16:50:58.687614 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"f48a2d5a-71e3-4fe6-aa44-9f6e1ae65cd5","Type":"ContainerDied","Data":"d7d2032417ff30d0c8ae603e6be3dbd62729153b88bd4727d91aa7ac4131c8ef"} Mar 16 16:50:58 crc kubenswrapper[5120]: I0316 16:50:58.687647 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"f48a2d5a-71e3-4fe6-aa44-9f6e1ae65cd5","Type":"ContainerDied","Data":"da9c557f144aa7a20d0cd7bb8042cc5a4c2af81e74d91478868bba234c779e70"} Mar 16 16:50:58 crc kubenswrapper[5120]: I0316 16:50:58.687659 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"f48a2d5a-71e3-4fe6-aa44-9f6e1ae65cd5","Type":"ContainerDied","Data":"562ad65653e549769b0785758bbb02e15b2461aff7d42fe78c26ac0230470143"} Mar 16 16:51:00 crc kubenswrapper[5120]: E0316 16:51:00.564448 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="b56f0565dc2be984512ca563ce8d4aba134cd33629dfbaa67b4f8b221b49f35c" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:51:00 crc kubenswrapper[5120]: E0316 16:51:00.567126 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="b56f0565dc2be984512ca563ce8d4aba134cd33629dfbaa67b4f8b221b49f35c" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:51:00 crc kubenswrapper[5120]: E0316 16:51:00.570326 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="b56f0565dc2be984512ca563ce8d4aba134cd33629dfbaa67b4f8b221b49f35c" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:51:00 crc kubenswrapper[5120]: E0316 16:51:00.570398 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="01f62262-5954-44de-80cb-c1cf1c179a0f" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 16:51:02 crc kubenswrapper[5120]: I0316 16:51:02.035189 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:51:02 crc kubenswrapper[5120]: I0316 16:51:02.035247 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:51:03 crc kubenswrapper[5120]: I0316 16:51:03.041927 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="6ca84af3-af8c-4723-8898-0b8335f784a5" containerName="nova-api-log" probeResult="failure" output="Get \"https://10.217.0.104:8774/\": context deadline exceeded" Mar 16 16:51:03 crc kubenswrapper[5120]: I0316 16:51:03.053013 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="6ca84af3-af8c-4723-8898-0b8335f784a5" containerName="nova-api-api" probeResult="failure" output="Get \"https://10.217.0.104:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 16:51:03 crc kubenswrapper[5120]: I0316 16:51:03.185979 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:51:03 crc kubenswrapper[5120]: I0316 16:51:03.251157 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f48a2d5a-71e3-4fe6-aa44-9f6e1ae65cd5-combined-ca-bundle\") pod \"f48a2d5a-71e3-4fe6-aa44-9f6e1ae65cd5\" (UID: \"f48a2d5a-71e3-4fe6-aa44-9f6e1ae65cd5\") " Mar 16 16:51:03 crc kubenswrapper[5120]: I0316 16:51:03.251307 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/f48a2d5a-71e3-4fe6-aa44-9f6e1ae65cd5-sg-core-conf-yaml\") pod \"f48a2d5a-71e3-4fe6-aa44-9f6e1ae65cd5\" (UID: \"f48a2d5a-71e3-4fe6-aa44-9f6e1ae65cd5\") " Mar 16 16:51:03 crc kubenswrapper[5120]: I0316 16:51:03.251381 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f48a2d5a-71e3-4fe6-aa44-9f6e1ae65cd5-config-data\") pod \"f48a2d5a-71e3-4fe6-aa44-9f6e1ae65cd5\" (UID: \"f48a2d5a-71e3-4fe6-aa44-9f6e1ae65cd5\") " Mar 16 16:51:03 crc kubenswrapper[5120]: I0316 16:51:03.251552 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f48a2d5a-71e3-4fe6-aa44-9f6e1ae65cd5-log-httpd\") pod \"f48a2d5a-71e3-4fe6-aa44-9f6e1ae65cd5\" (UID: \"f48a2d5a-71e3-4fe6-aa44-9f6e1ae65cd5\") " Mar 16 16:51:03 crc kubenswrapper[5120]: I0316 16:51:03.251585 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f48a2d5a-71e3-4fe6-aa44-9f6e1ae65cd5-scripts\") pod \"f48a2d5a-71e3-4fe6-aa44-9f6e1ae65cd5\" (UID: \"f48a2d5a-71e3-4fe6-aa44-9f6e1ae65cd5\") " Mar 16 16:51:03 crc kubenswrapper[5120]: I0316 16:51:03.251706 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pljgc\" (UniqueName: \"kubernetes.io/projected/f48a2d5a-71e3-4fe6-aa44-9f6e1ae65cd5-kube-api-access-pljgc\") pod \"f48a2d5a-71e3-4fe6-aa44-9f6e1ae65cd5\" (UID: \"f48a2d5a-71e3-4fe6-aa44-9f6e1ae65cd5\") " Mar 16 16:51:03 crc kubenswrapper[5120]: I0316 16:51:03.251818 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f48a2d5a-71e3-4fe6-aa44-9f6e1ae65cd5-run-httpd\") pod \"f48a2d5a-71e3-4fe6-aa44-9f6e1ae65cd5\" (UID: \"f48a2d5a-71e3-4fe6-aa44-9f6e1ae65cd5\") " Mar 16 16:51:03 crc kubenswrapper[5120]: I0316 16:51:03.253071 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f48a2d5a-71e3-4fe6-aa44-9f6e1ae65cd5-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "f48a2d5a-71e3-4fe6-aa44-9f6e1ae65cd5" (UID: "f48a2d5a-71e3-4fe6-aa44-9f6e1ae65cd5"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:51:03 crc kubenswrapper[5120]: I0316 16:51:03.257151 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f48a2d5a-71e3-4fe6-aa44-9f6e1ae65cd5-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "f48a2d5a-71e3-4fe6-aa44-9f6e1ae65cd5" (UID: "f48a2d5a-71e3-4fe6-aa44-9f6e1ae65cd5"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:51:03 crc kubenswrapper[5120]: I0316 16:51:03.258147 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f48a2d5a-71e3-4fe6-aa44-9f6e1ae65cd5-scripts" (OuterVolumeSpecName: "scripts") pod "f48a2d5a-71e3-4fe6-aa44-9f6e1ae65cd5" (UID: "f48a2d5a-71e3-4fe6-aa44-9f6e1ae65cd5"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:51:03 crc kubenswrapper[5120]: I0316 16:51:03.267934 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f48a2d5a-71e3-4fe6-aa44-9f6e1ae65cd5-kube-api-access-pljgc" (OuterVolumeSpecName: "kube-api-access-pljgc") pod "f48a2d5a-71e3-4fe6-aa44-9f6e1ae65cd5" (UID: "f48a2d5a-71e3-4fe6-aa44-9f6e1ae65cd5"). InnerVolumeSpecName "kube-api-access-pljgc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:51:03 crc kubenswrapper[5120]: I0316 16:51:03.286220 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f48a2d5a-71e3-4fe6-aa44-9f6e1ae65cd5-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "f48a2d5a-71e3-4fe6-aa44-9f6e1ae65cd5" (UID: "f48a2d5a-71e3-4fe6-aa44-9f6e1ae65cd5"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:51:03 crc kubenswrapper[5120]: I0316 16:51:03.338265 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f48a2d5a-71e3-4fe6-aa44-9f6e1ae65cd5-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f48a2d5a-71e3-4fe6-aa44-9f6e1ae65cd5" (UID: "f48a2d5a-71e3-4fe6-aa44-9f6e1ae65cd5"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:51:03 crc kubenswrapper[5120]: I0316 16:51:03.354515 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f48a2d5a-71e3-4fe6-aa44-9f6e1ae65cd5-config-data" (OuterVolumeSpecName: "config-data") pod "f48a2d5a-71e3-4fe6-aa44-9f6e1ae65cd5" (UID: "f48a2d5a-71e3-4fe6-aa44-9f6e1ae65cd5"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:51:03 crc kubenswrapper[5120]: I0316 16:51:03.355653 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f48a2d5a-71e3-4fe6-aa44-9f6e1ae65cd5-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:51:03 crc kubenswrapper[5120]: I0316 16:51:03.355692 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f48a2d5a-71e3-4fe6-aa44-9f6e1ae65cd5-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:51:03 crc kubenswrapper[5120]: I0316 16:51:03.355705 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pljgc\" (UniqueName: \"kubernetes.io/projected/f48a2d5a-71e3-4fe6-aa44-9f6e1ae65cd5-kube-api-access-pljgc\") on node \"crc\" DevicePath \"\"" Mar 16 16:51:03 crc kubenswrapper[5120]: I0316 16:51:03.355719 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f48a2d5a-71e3-4fe6-aa44-9f6e1ae65cd5-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:51:03 crc kubenswrapper[5120]: I0316 16:51:03.355730 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f48a2d5a-71e3-4fe6-aa44-9f6e1ae65cd5-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:51:03 crc kubenswrapper[5120]: I0316 16:51:03.355742 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/f48a2d5a-71e3-4fe6-aa44-9f6e1ae65cd5-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 16:51:03 crc kubenswrapper[5120]: I0316 16:51:03.355753 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f48a2d5a-71e3-4fe6-aa44-9f6e1ae65cd5-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:51:03 crc kubenswrapper[5120]: E0316 16:51:03.464805 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="59ea000c80804f2740555310ca43eeb4d84a66364bbce05903490e9bceb834a3" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:51:03 crc kubenswrapper[5120]: E0316 16:51:03.466491 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="59ea000c80804f2740555310ca43eeb4d84a66364bbce05903490e9bceb834a3" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:51:03 crc kubenswrapper[5120]: E0316 16:51:03.468077 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="59ea000c80804f2740555310ca43eeb4d84a66364bbce05903490e9bceb834a3" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:51:03 crc kubenswrapper[5120]: E0316 16:51:03.468112 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="d43280dd-cd49-4365-8474-7bab9f5b4899" containerName="nova-cell1-conductor-conductor" probeResult="unknown" Mar 16 16:51:03 crc kubenswrapper[5120]: I0316 16:51:03.741317 5120 generic.go:358] "Generic (PLEG): container finished" podID="f48a2d5a-71e3-4fe6-aa44-9f6e1ae65cd5" containerID="c572e3ed545bda23c8515edc573ff526f728a3d8b7cfe2e6a290282109c437df" exitCode=0 Mar 16 16:51:03 crc kubenswrapper[5120]: I0316 16:51:03.741584 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"f48a2d5a-71e3-4fe6-aa44-9f6e1ae65cd5","Type":"ContainerDied","Data":"c572e3ed545bda23c8515edc573ff526f728a3d8b7cfe2e6a290282109c437df"} Mar 16 16:51:03 crc kubenswrapper[5120]: I0316 16:51:03.741609 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"f48a2d5a-71e3-4fe6-aa44-9f6e1ae65cd5","Type":"ContainerDied","Data":"b56f13ebb3abb6a7b1c6366cb8e0cb3ab8b8410eecfa9a86f2a029103dfbe860"} Mar 16 16:51:03 crc kubenswrapper[5120]: I0316 16:51:03.741626 5120 scope.go:117] "RemoveContainer" containerID="d7d2032417ff30d0c8ae603e6be3dbd62729153b88bd4727d91aa7ac4131c8ef" Mar 16 16:51:03 crc kubenswrapper[5120]: I0316 16:51:03.741792 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:51:03 crc kubenswrapper[5120]: I0316 16:51:03.781141 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:51:03 crc kubenswrapper[5120]: I0316 16:51:03.784386 5120 scope.go:117] "RemoveContainer" containerID="da9c557f144aa7a20d0cd7bb8042cc5a4c2af81e74d91478868bba234c779e70" Mar 16 16:51:03 crc kubenswrapper[5120]: I0316 16:51:03.789690 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:51:03 crc kubenswrapper[5120]: I0316 16:51:03.818107 5120 scope.go:117] "RemoveContainer" containerID="562ad65653e549769b0785758bbb02e15b2461aff7d42fe78c26ac0230470143" Mar 16 16:51:03 crc kubenswrapper[5120]: I0316 16:51:03.824189 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:51:03 crc kubenswrapper[5120]: I0316 16:51:03.825666 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e367a07e-829a-4ad9-96b4-c91caa885ac7" containerName="proxy-server" Mar 16 16:51:03 crc kubenswrapper[5120]: I0316 16:51:03.825684 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e367a07e-829a-4ad9-96b4-c91caa885ac7" containerName="proxy-server" Mar 16 16:51:03 crc kubenswrapper[5120]: I0316 16:51:03.825709 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e367a07e-829a-4ad9-96b4-c91caa885ac7" containerName="proxy-httpd" Mar 16 16:51:03 crc kubenswrapper[5120]: I0316 16:51:03.825717 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e367a07e-829a-4ad9-96b4-c91caa885ac7" containerName="proxy-httpd" Mar 16 16:51:03 crc kubenswrapper[5120]: I0316 16:51:03.825731 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f48a2d5a-71e3-4fe6-aa44-9f6e1ae65cd5" containerName="sg-core" Mar 16 16:51:03 crc kubenswrapper[5120]: I0316 16:51:03.825740 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f48a2d5a-71e3-4fe6-aa44-9f6e1ae65cd5" containerName="sg-core" Mar 16 16:51:03 crc kubenswrapper[5120]: I0316 16:51:03.825796 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f48a2d5a-71e3-4fe6-aa44-9f6e1ae65cd5" containerName="ceilometer-notification-agent" Mar 16 16:51:03 crc kubenswrapper[5120]: I0316 16:51:03.825805 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f48a2d5a-71e3-4fe6-aa44-9f6e1ae65cd5" containerName="ceilometer-notification-agent" Mar 16 16:51:03 crc kubenswrapper[5120]: I0316 16:51:03.825845 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f48a2d5a-71e3-4fe6-aa44-9f6e1ae65cd5" containerName="proxy-httpd" Mar 16 16:51:03 crc kubenswrapper[5120]: I0316 16:51:03.825852 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f48a2d5a-71e3-4fe6-aa44-9f6e1ae65cd5" containerName="proxy-httpd" Mar 16 16:51:03 crc kubenswrapper[5120]: I0316 16:51:03.825867 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f48a2d5a-71e3-4fe6-aa44-9f6e1ae65cd5" containerName="ceilometer-central-agent" Mar 16 16:51:03 crc kubenswrapper[5120]: I0316 16:51:03.825877 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f48a2d5a-71e3-4fe6-aa44-9f6e1ae65cd5" containerName="ceilometer-central-agent" Mar 16 16:51:03 crc kubenswrapper[5120]: I0316 16:51:03.826144 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e367a07e-829a-4ad9-96b4-c91caa885ac7" containerName="proxy-server" Mar 16 16:51:03 crc kubenswrapper[5120]: I0316 16:51:03.826164 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f48a2d5a-71e3-4fe6-aa44-9f6e1ae65cd5" containerName="ceilometer-notification-agent" Mar 16 16:51:03 crc kubenswrapper[5120]: I0316 16:51:03.826174 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f48a2d5a-71e3-4fe6-aa44-9f6e1ae65cd5" containerName="proxy-httpd" Mar 16 16:51:03 crc kubenswrapper[5120]: I0316 16:51:03.826192 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f48a2d5a-71e3-4fe6-aa44-9f6e1ae65cd5" containerName="ceilometer-central-agent" Mar 16 16:51:03 crc kubenswrapper[5120]: I0316 16:51:03.826243 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f48a2d5a-71e3-4fe6-aa44-9f6e1ae65cd5" containerName="sg-core" Mar 16 16:51:03 crc kubenswrapper[5120]: I0316 16:51:03.826255 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e367a07e-829a-4ad9-96b4-c91caa885ac7" containerName="proxy-httpd" Mar 16 16:51:03 crc kubenswrapper[5120]: I0316 16:51:03.844825 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:51:03 crc kubenswrapper[5120]: I0316 16:51:03.845005 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:51:03 crc kubenswrapper[5120]: I0316 16:51:03.848406 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 16:51:03 crc kubenswrapper[5120]: I0316 16:51:03.848654 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 16:51:03 crc kubenswrapper[5120]: I0316 16:51:03.881188 5120 scope.go:117] "RemoveContainer" containerID="c572e3ed545bda23c8515edc573ff526f728a3d8b7cfe2e6a290282109c437df" Mar 16 16:51:03 crc kubenswrapper[5120]: I0316 16:51:03.914383 5120 scope.go:117] "RemoveContainer" containerID="d7d2032417ff30d0c8ae603e6be3dbd62729153b88bd4727d91aa7ac4131c8ef" Mar 16 16:51:03 crc kubenswrapper[5120]: E0316 16:51:03.914875 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d7d2032417ff30d0c8ae603e6be3dbd62729153b88bd4727d91aa7ac4131c8ef\": container with ID starting with d7d2032417ff30d0c8ae603e6be3dbd62729153b88bd4727d91aa7ac4131c8ef not found: ID does not exist" containerID="d7d2032417ff30d0c8ae603e6be3dbd62729153b88bd4727d91aa7ac4131c8ef" Mar 16 16:51:03 crc kubenswrapper[5120]: I0316 16:51:03.914910 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7d2032417ff30d0c8ae603e6be3dbd62729153b88bd4727d91aa7ac4131c8ef"} err="failed to get container status \"d7d2032417ff30d0c8ae603e6be3dbd62729153b88bd4727d91aa7ac4131c8ef\": rpc error: code = NotFound desc = could not find container \"d7d2032417ff30d0c8ae603e6be3dbd62729153b88bd4727d91aa7ac4131c8ef\": container with ID starting with d7d2032417ff30d0c8ae603e6be3dbd62729153b88bd4727d91aa7ac4131c8ef not found: ID does not exist" Mar 16 16:51:03 crc kubenswrapper[5120]: I0316 16:51:03.914938 5120 scope.go:117] "RemoveContainer" containerID="da9c557f144aa7a20d0cd7bb8042cc5a4c2af81e74d91478868bba234c779e70" Mar 16 16:51:03 crc kubenswrapper[5120]: E0316 16:51:03.915224 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da9c557f144aa7a20d0cd7bb8042cc5a4c2af81e74d91478868bba234c779e70\": container with ID starting with da9c557f144aa7a20d0cd7bb8042cc5a4c2af81e74d91478868bba234c779e70 not found: ID does not exist" containerID="da9c557f144aa7a20d0cd7bb8042cc5a4c2af81e74d91478868bba234c779e70" Mar 16 16:51:03 crc kubenswrapper[5120]: I0316 16:51:03.915278 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da9c557f144aa7a20d0cd7bb8042cc5a4c2af81e74d91478868bba234c779e70"} err="failed to get container status \"da9c557f144aa7a20d0cd7bb8042cc5a4c2af81e74d91478868bba234c779e70\": rpc error: code = NotFound desc = could not find container \"da9c557f144aa7a20d0cd7bb8042cc5a4c2af81e74d91478868bba234c779e70\": container with ID starting with da9c557f144aa7a20d0cd7bb8042cc5a4c2af81e74d91478868bba234c779e70 not found: ID does not exist" Mar 16 16:51:03 crc kubenswrapper[5120]: I0316 16:51:03.915312 5120 scope.go:117] "RemoveContainer" containerID="562ad65653e549769b0785758bbb02e15b2461aff7d42fe78c26ac0230470143" Mar 16 16:51:03 crc kubenswrapper[5120]: E0316 16:51:03.915978 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"562ad65653e549769b0785758bbb02e15b2461aff7d42fe78c26ac0230470143\": container with ID starting with 562ad65653e549769b0785758bbb02e15b2461aff7d42fe78c26ac0230470143 not found: ID does not exist" containerID="562ad65653e549769b0785758bbb02e15b2461aff7d42fe78c26ac0230470143" Mar 16 16:51:03 crc kubenswrapper[5120]: I0316 16:51:03.916031 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"562ad65653e549769b0785758bbb02e15b2461aff7d42fe78c26ac0230470143"} err="failed to get container status \"562ad65653e549769b0785758bbb02e15b2461aff7d42fe78c26ac0230470143\": rpc error: code = NotFound desc = could not find container \"562ad65653e549769b0785758bbb02e15b2461aff7d42fe78c26ac0230470143\": container with ID starting with 562ad65653e549769b0785758bbb02e15b2461aff7d42fe78c26ac0230470143 not found: ID does not exist" Mar 16 16:51:03 crc kubenswrapper[5120]: I0316 16:51:03.916054 5120 scope.go:117] "RemoveContainer" containerID="c572e3ed545bda23c8515edc573ff526f728a3d8b7cfe2e6a290282109c437df" Mar 16 16:51:03 crc kubenswrapper[5120]: E0316 16:51:03.916420 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c572e3ed545bda23c8515edc573ff526f728a3d8b7cfe2e6a290282109c437df\": container with ID starting with c572e3ed545bda23c8515edc573ff526f728a3d8b7cfe2e6a290282109c437df not found: ID does not exist" containerID="c572e3ed545bda23c8515edc573ff526f728a3d8b7cfe2e6a290282109c437df" Mar 16 16:51:03 crc kubenswrapper[5120]: I0316 16:51:03.916448 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c572e3ed545bda23c8515edc573ff526f728a3d8b7cfe2e6a290282109c437df"} err="failed to get container status \"c572e3ed545bda23c8515edc573ff526f728a3d8b7cfe2e6a290282109c437df\": rpc error: code = NotFound desc = could not find container \"c572e3ed545bda23c8515edc573ff526f728a3d8b7cfe2e6a290282109c437df\": container with ID starting with c572e3ed545bda23c8515edc573ff526f728a3d8b7cfe2e6a290282109c437df not found: ID does not exist" Mar 16 16:51:03 crc kubenswrapper[5120]: I0316 16:51:03.978407 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/80fb18b8-bf77-40ea-b1e0-3aaf669105cf-config-data\") pod \"ceilometer-0\" (UID: \"80fb18b8-bf77-40ea-b1e0-3aaf669105cf\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:51:03 crc kubenswrapper[5120]: I0316 16:51:03.978920 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rc5fw\" (UniqueName: \"kubernetes.io/projected/80fb18b8-bf77-40ea-b1e0-3aaf669105cf-kube-api-access-rc5fw\") pod \"ceilometer-0\" (UID: \"80fb18b8-bf77-40ea-b1e0-3aaf669105cf\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:51:03 crc kubenswrapper[5120]: I0316 16:51:03.979112 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/80fb18b8-bf77-40ea-b1e0-3aaf669105cf-log-httpd\") pod \"ceilometer-0\" (UID: \"80fb18b8-bf77-40ea-b1e0-3aaf669105cf\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:51:03 crc kubenswrapper[5120]: I0316 16:51:03.979256 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/80fb18b8-bf77-40ea-b1e0-3aaf669105cf-scripts\") pod \"ceilometer-0\" (UID: \"80fb18b8-bf77-40ea-b1e0-3aaf669105cf\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:51:03 crc kubenswrapper[5120]: I0316 16:51:03.979328 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/80fb18b8-bf77-40ea-b1e0-3aaf669105cf-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"80fb18b8-bf77-40ea-b1e0-3aaf669105cf\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:51:03 crc kubenswrapper[5120]: I0316 16:51:03.979351 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/80fb18b8-bf77-40ea-b1e0-3aaf669105cf-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"80fb18b8-bf77-40ea-b1e0-3aaf669105cf\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:51:03 crc kubenswrapper[5120]: I0316 16:51:03.979846 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/80fb18b8-bf77-40ea-b1e0-3aaf669105cf-run-httpd\") pod \"ceilometer-0\" (UID: \"80fb18b8-bf77-40ea-b1e0-3aaf669105cf\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:51:04 crc kubenswrapper[5120]: I0316 16:51:04.083998 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/80fb18b8-bf77-40ea-b1e0-3aaf669105cf-run-httpd\") pod \"ceilometer-0\" (UID: \"80fb18b8-bf77-40ea-b1e0-3aaf669105cf\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:51:04 crc kubenswrapper[5120]: I0316 16:51:04.084748 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/80fb18b8-bf77-40ea-b1e0-3aaf669105cf-config-data\") pod \"ceilometer-0\" (UID: \"80fb18b8-bf77-40ea-b1e0-3aaf669105cf\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:51:04 crc kubenswrapper[5120]: I0316 16:51:04.085078 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rc5fw\" (UniqueName: \"kubernetes.io/projected/80fb18b8-bf77-40ea-b1e0-3aaf669105cf-kube-api-access-rc5fw\") pod \"ceilometer-0\" (UID: \"80fb18b8-bf77-40ea-b1e0-3aaf669105cf\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:51:04 crc kubenswrapper[5120]: I0316 16:51:04.085149 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/80fb18b8-bf77-40ea-b1e0-3aaf669105cf-log-httpd\") pod \"ceilometer-0\" (UID: \"80fb18b8-bf77-40ea-b1e0-3aaf669105cf\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:51:04 crc kubenswrapper[5120]: I0316 16:51:04.085244 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/80fb18b8-bf77-40ea-b1e0-3aaf669105cf-scripts\") pod \"ceilometer-0\" (UID: \"80fb18b8-bf77-40ea-b1e0-3aaf669105cf\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:51:04 crc kubenswrapper[5120]: I0316 16:51:04.085315 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/80fb18b8-bf77-40ea-b1e0-3aaf669105cf-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"80fb18b8-bf77-40ea-b1e0-3aaf669105cf\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:51:04 crc kubenswrapper[5120]: I0316 16:51:04.085338 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/80fb18b8-bf77-40ea-b1e0-3aaf669105cf-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"80fb18b8-bf77-40ea-b1e0-3aaf669105cf\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:51:04 crc kubenswrapper[5120]: I0316 16:51:04.084793 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/80fb18b8-bf77-40ea-b1e0-3aaf669105cf-run-httpd\") pod \"ceilometer-0\" (UID: \"80fb18b8-bf77-40ea-b1e0-3aaf669105cf\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:51:04 crc kubenswrapper[5120]: I0316 16:51:04.085866 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/80fb18b8-bf77-40ea-b1e0-3aaf669105cf-log-httpd\") pod \"ceilometer-0\" (UID: \"80fb18b8-bf77-40ea-b1e0-3aaf669105cf\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:51:04 crc kubenswrapper[5120]: I0316 16:51:04.091138 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/80fb18b8-bf77-40ea-b1e0-3aaf669105cf-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"80fb18b8-bf77-40ea-b1e0-3aaf669105cf\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:51:04 crc kubenswrapper[5120]: I0316 16:51:04.091398 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/80fb18b8-bf77-40ea-b1e0-3aaf669105cf-scripts\") pod \"ceilometer-0\" (UID: \"80fb18b8-bf77-40ea-b1e0-3aaf669105cf\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:51:04 crc kubenswrapper[5120]: I0316 16:51:04.091810 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/80fb18b8-bf77-40ea-b1e0-3aaf669105cf-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"80fb18b8-bf77-40ea-b1e0-3aaf669105cf\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:51:04 crc kubenswrapper[5120]: I0316 16:51:04.103749 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/80fb18b8-bf77-40ea-b1e0-3aaf669105cf-config-data\") pod \"ceilometer-0\" (UID: \"80fb18b8-bf77-40ea-b1e0-3aaf669105cf\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:51:04 crc kubenswrapper[5120]: I0316 16:51:04.119776 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rc5fw\" (UniqueName: \"kubernetes.io/projected/80fb18b8-bf77-40ea-b1e0-3aaf669105cf-kube-api-access-rc5fw\") pod \"ceilometer-0\" (UID: \"80fb18b8-bf77-40ea-b1e0-3aaf669105cf\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:51:04 crc kubenswrapper[5120]: I0316 16:51:04.173988 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:51:04 crc kubenswrapper[5120]: I0316 16:51:04.504888 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:51:04 crc kubenswrapper[5120]: W0316 16:51:04.506469 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod80fb18b8_bf77_40ea_b1e0_3aaf669105cf.slice/crio-abbdac35262cef5fab1fd357d2315f4eee6908b358c53dabb6444ad7b5735307 WatchSource:0}: Error finding container abbdac35262cef5fab1fd357d2315f4eee6908b358c53dabb6444ad7b5735307: Status 404 returned error can't find the container with id abbdac35262cef5fab1fd357d2315f4eee6908b358c53dabb6444ad7b5735307 Mar 16 16:51:04 crc kubenswrapper[5120]: I0316 16:51:04.676338 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f48a2d5a-71e3-4fe6-aa44-9f6e1ae65cd5" path="/var/lib/kubelet/pods/f48a2d5a-71e3-4fe6-aa44-9f6e1ae65cd5/volumes" Mar 16 16:51:04 crc kubenswrapper[5120]: I0316 16:51:04.754695 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"80fb18b8-bf77-40ea-b1e0-3aaf669105cf","Type":"ContainerStarted","Data":"abbdac35262cef5fab1fd357d2315f4eee6908b358c53dabb6444ad7b5735307"} Mar 16 16:51:05 crc kubenswrapper[5120]: E0316 16:51:05.942749 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="b56f0565dc2be984512ca563ce8d4aba134cd33629dfbaa67b4f8b221b49f35c" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:51:05 crc kubenswrapper[5120]: E0316 16:51:05.948950 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="b56f0565dc2be984512ca563ce8d4aba134cd33629dfbaa67b4f8b221b49f35c" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:51:05 crc kubenswrapper[5120]: E0316 16:51:05.955693 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="b56f0565dc2be984512ca563ce8d4aba134cd33629dfbaa67b4f8b221b49f35c" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:51:05 crc kubenswrapper[5120]: E0316 16:51:05.956601 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="01f62262-5954-44de-80cb-c1cf1c179a0f" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 16:51:06 crc kubenswrapper[5120]: I0316 16:51:06.958881 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"80fb18b8-bf77-40ea-b1e0-3aaf669105cf","Type":"ContainerStarted","Data":"3cabff67a47069cf0fc3763bad22aac33ac2bcc133d14dadb9dcb928d1a398c5"} Mar 16 16:51:06 crc kubenswrapper[5120]: I0316 16:51:06.959242 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"80fb18b8-bf77-40ea-b1e0-3aaf669105cf","Type":"ContainerStarted","Data":"80ff5007813c4fe9e0adedf2f6c002cb23db55cf073abe867371ae2680fb055f"} Mar 16 16:51:07 crc kubenswrapper[5120]: I0316 16:51:07.055035 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:51:07 crc kubenswrapper[5120]: I0316 16:51:07.055098 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:51:07 crc kubenswrapper[5120]: I0316 16:51:07.982889 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"80fb18b8-bf77-40ea-b1e0-3aaf669105cf","Type":"ContainerStarted","Data":"96754acd658afa00103c4e69b4aa4a9e8d4eb42cee4ed892fcca97422b7d4a9a"} Mar 16 16:51:08 crc kubenswrapper[5120]: E0316 16:51:08.131638 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1873667 actualBytes=10240 Mar 16 16:51:08 crc kubenswrapper[5120]: E0316 16:51:08.464543 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="59ea000c80804f2740555310ca43eeb4d84a66364bbce05903490e9bceb834a3" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:51:08 crc kubenswrapper[5120]: E0316 16:51:08.466898 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="59ea000c80804f2740555310ca43eeb4d84a66364bbce05903490e9bceb834a3" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:51:08 crc kubenswrapper[5120]: E0316 16:51:08.468538 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="59ea000c80804f2740555310ca43eeb4d84a66364bbce05903490e9bceb834a3" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:51:08 crc kubenswrapper[5120]: E0316 16:51:08.468601 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="d43280dd-cd49-4365-8474-7bab9f5b4899" containerName="nova-cell1-conductor-conductor" probeResult="unknown" Mar 16 16:51:10 crc kubenswrapper[5120]: I0316 16:51:10.005334 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"80fb18b8-bf77-40ea-b1e0-3aaf669105cf","Type":"ContainerStarted","Data":"a7d5e5a671e901da3bd0d5c5089eebd248c33919242368e79004c9963ddc7435"} Mar 16 16:51:10 crc kubenswrapper[5120]: I0316 16:51:10.006898 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:51:10 crc kubenswrapper[5120]: I0316 16:51:10.033905 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.205257475 podStartE2EDuration="7.033881637s" podCreationTimestamp="2026-03-16 16:51:03 +0000 UTC" firstStartedPulling="2026-03-16 16:51:04.508590833 +0000 UTC m=+4766.662522490" lastFinishedPulling="2026-03-16 16:51:09.337214995 +0000 UTC m=+4771.491146652" observedRunningTime="2026-03-16 16:51:10.025293092 +0000 UTC m=+4772.179224789" watchObservedRunningTime="2026-03-16 16:51:10.033881637 +0000 UTC m=+4772.187813294" Mar 16 16:51:10 crc kubenswrapper[5120]: I0316 16:51:10.035245 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:51:10 crc kubenswrapper[5120]: I0316 16:51:10.036410 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:51:10 crc kubenswrapper[5120]: E0316 16:51:10.565233 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="b56f0565dc2be984512ca563ce8d4aba134cd33629dfbaa67b4f8b221b49f35c" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:51:10 crc kubenswrapper[5120]: E0316 16:51:10.568126 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="b56f0565dc2be984512ca563ce8d4aba134cd33629dfbaa67b4f8b221b49f35c" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:51:10 crc kubenswrapper[5120]: E0316 16:51:10.569638 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="b56f0565dc2be984512ca563ce8d4aba134cd33629dfbaa67b4f8b221b49f35c" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:51:10 crc kubenswrapper[5120]: E0316 16:51:10.569692 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="01f62262-5954-44de-80cb-c1cf1c179a0f" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 16:51:12 crc kubenswrapper[5120]: I0316 16:51:12.043873 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:51:12 crc kubenswrapper[5120]: I0316 16:51:12.044611 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:51:12 crc kubenswrapper[5120]: I0316 16:51:12.050832 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:51:13 crc kubenswrapper[5120]: I0316 16:51:13.042981 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:51:13 crc kubenswrapper[5120]: E0316 16:51:13.462303 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="59ea000c80804f2740555310ca43eeb4d84a66364bbce05903490e9bceb834a3" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:51:13 crc kubenswrapper[5120]: E0316 16:51:13.463628 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="59ea000c80804f2740555310ca43eeb4d84a66364bbce05903490e9bceb834a3" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:51:13 crc kubenswrapper[5120]: E0316 16:51:13.465092 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="59ea000c80804f2740555310ca43eeb4d84a66364bbce05903490e9bceb834a3" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:51:13 crc kubenswrapper[5120]: E0316 16:51:13.465155 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="d43280dd-cd49-4365-8474-7bab9f5b4899" containerName="nova-cell1-conductor-conductor" probeResult="unknown" Mar 16 16:51:15 crc kubenswrapper[5120]: E0316 16:51:15.563355 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="b56f0565dc2be984512ca563ce8d4aba134cd33629dfbaa67b4f8b221b49f35c" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:51:15 crc kubenswrapper[5120]: E0316 16:51:15.565176 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="b56f0565dc2be984512ca563ce8d4aba134cd33629dfbaa67b4f8b221b49f35c" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:51:15 crc kubenswrapper[5120]: E0316 16:51:15.566558 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="b56f0565dc2be984512ca563ce8d4aba134cd33629dfbaa67b4f8b221b49f35c" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:51:15 crc kubenswrapper[5120]: E0316 16:51:15.566600 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="01f62262-5954-44de-80cb-c1cf1c179a0f" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 16:51:17 crc kubenswrapper[5120]: I0316 16:51:17.708270 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:51:17 crc kubenswrapper[5120]: I0316 16:51:17.781355 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:51:17 crc kubenswrapper[5120]: I0316 16:51:17.865467 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kh8lb\" (UniqueName: \"kubernetes.io/projected/3dd23150-3886-4b39-b37c-f25f89a6a6a3-kube-api-access-kh8lb\") pod \"3dd23150-3886-4b39-b37c-f25f89a6a6a3\" (UID: \"3dd23150-3886-4b39-b37c-f25f89a6a6a3\") " Mar 16 16:51:17 crc kubenswrapper[5120]: I0316 16:51:17.865747 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4xc4n\" (UniqueName: \"kubernetes.io/projected/17638423-bcdb-4b88-b3c8-5faa97ef3d0d-kube-api-access-4xc4n\") pod \"17638423-bcdb-4b88-b3c8-5faa97ef3d0d\" (UID: \"17638423-bcdb-4b88-b3c8-5faa97ef3d0d\") " Mar 16 16:51:17 crc kubenswrapper[5120]: I0316 16:51:17.866024 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3dd23150-3886-4b39-b37c-f25f89a6a6a3-combined-ca-bundle\") pod \"3dd23150-3886-4b39-b37c-f25f89a6a6a3\" (UID: \"3dd23150-3886-4b39-b37c-f25f89a6a6a3\") " Mar 16 16:51:17 crc kubenswrapper[5120]: I0316 16:51:17.866224 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/3dd23150-3886-4b39-b37c-f25f89a6a6a3-vencrypt-tls-certs\") pod \"3dd23150-3886-4b39-b37c-f25f89a6a6a3\" (UID: \"3dd23150-3886-4b39-b37c-f25f89a6a6a3\") " Mar 16 16:51:17 crc kubenswrapper[5120]: I0316 16:51:17.866286 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3dd23150-3886-4b39-b37c-f25f89a6a6a3-config-data\") pod \"3dd23150-3886-4b39-b37c-f25f89a6a6a3\" (UID: \"3dd23150-3886-4b39-b37c-f25f89a6a6a3\") " Mar 16 16:51:17 crc kubenswrapper[5120]: I0316 16:51:17.866344 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/17638423-bcdb-4b88-b3c8-5faa97ef3d0d-combined-ca-bundle\") pod \"17638423-bcdb-4b88-b3c8-5faa97ef3d0d\" (UID: \"17638423-bcdb-4b88-b3c8-5faa97ef3d0d\") " Mar 16 16:51:17 crc kubenswrapper[5120]: I0316 16:51:17.866427 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/3dd23150-3886-4b39-b37c-f25f89a6a6a3-nova-novncproxy-tls-certs\") pod \"3dd23150-3886-4b39-b37c-f25f89a6a6a3\" (UID: \"3dd23150-3886-4b39-b37c-f25f89a6a6a3\") " Mar 16 16:51:17 crc kubenswrapper[5120]: I0316 16:51:17.866453 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/17638423-bcdb-4b88-b3c8-5faa97ef3d0d-config-data\") pod \"17638423-bcdb-4b88-b3c8-5faa97ef3d0d\" (UID: \"17638423-bcdb-4b88-b3c8-5faa97ef3d0d\") " Mar 16 16:51:17 crc kubenswrapper[5120]: I0316 16:51:17.873740 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17638423-bcdb-4b88-b3c8-5faa97ef3d0d-kube-api-access-4xc4n" (OuterVolumeSpecName: "kube-api-access-4xc4n") pod "17638423-bcdb-4b88-b3c8-5faa97ef3d0d" (UID: "17638423-bcdb-4b88-b3c8-5faa97ef3d0d"). InnerVolumeSpecName "kube-api-access-4xc4n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:51:17 crc kubenswrapper[5120]: I0316 16:51:17.874827 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3dd23150-3886-4b39-b37c-f25f89a6a6a3-kube-api-access-kh8lb" (OuterVolumeSpecName: "kube-api-access-kh8lb") pod "3dd23150-3886-4b39-b37c-f25f89a6a6a3" (UID: "3dd23150-3886-4b39-b37c-f25f89a6a6a3"). InnerVolumeSpecName "kube-api-access-kh8lb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:51:17 crc kubenswrapper[5120]: I0316 16:51:17.896688 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/17638423-bcdb-4b88-b3c8-5faa97ef3d0d-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "17638423-bcdb-4b88-b3c8-5faa97ef3d0d" (UID: "17638423-bcdb-4b88-b3c8-5faa97ef3d0d"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:51:17 crc kubenswrapper[5120]: I0316 16:51:17.898124 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3dd23150-3886-4b39-b37c-f25f89a6a6a3-config-data" (OuterVolumeSpecName: "config-data") pod "3dd23150-3886-4b39-b37c-f25f89a6a6a3" (UID: "3dd23150-3886-4b39-b37c-f25f89a6a6a3"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:51:17 crc kubenswrapper[5120]: I0316 16:51:17.899231 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/17638423-bcdb-4b88-b3c8-5faa97ef3d0d-config-data" (OuterVolumeSpecName: "config-data") pod "17638423-bcdb-4b88-b3c8-5faa97ef3d0d" (UID: "17638423-bcdb-4b88-b3c8-5faa97ef3d0d"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:51:17 crc kubenswrapper[5120]: I0316 16:51:17.900373 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3dd23150-3886-4b39-b37c-f25f89a6a6a3-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "3dd23150-3886-4b39-b37c-f25f89a6a6a3" (UID: "3dd23150-3886-4b39-b37c-f25f89a6a6a3"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:51:17 crc kubenswrapper[5120]: I0316 16:51:17.917721 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3dd23150-3886-4b39-b37c-f25f89a6a6a3-vencrypt-tls-certs" (OuterVolumeSpecName: "vencrypt-tls-certs") pod "3dd23150-3886-4b39-b37c-f25f89a6a6a3" (UID: "3dd23150-3886-4b39-b37c-f25f89a6a6a3"). InnerVolumeSpecName "vencrypt-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:51:17 crc kubenswrapper[5120]: I0316 16:51:17.923164 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3dd23150-3886-4b39-b37c-f25f89a6a6a3-nova-novncproxy-tls-certs" (OuterVolumeSpecName: "nova-novncproxy-tls-certs") pod "3dd23150-3886-4b39-b37c-f25f89a6a6a3" (UID: "3dd23150-3886-4b39-b37c-f25f89a6a6a3"). InnerVolumeSpecName "nova-novncproxy-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:51:17 crc kubenswrapper[5120]: I0316 16:51:17.969641 5120 reconciler_common.go:299] "Volume detached for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/3dd23150-3886-4b39-b37c-f25f89a6a6a3-nova-novncproxy-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:51:17 crc kubenswrapper[5120]: I0316 16:51:17.969691 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/17638423-bcdb-4b88-b3c8-5faa97ef3d0d-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:51:17 crc kubenswrapper[5120]: I0316 16:51:17.969709 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kh8lb\" (UniqueName: \"kubernetes.io/projected/3dd23150-3886-4b39-b37c-f25f89a6a6a3-kube-api-access-kh8lb\") on node \"crc\" DevicePath \"\"" Mar 16 16:51:17 crc kubenswrapper[5120]: I0316 16:51:17.969723 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4xc4n\" (UniqueName: \"kubernetes.io/projected/17638423-bcdb-4b88-b3c8-5faa97ef3d0d-kube-api-access-4xc4n\") on node \"crc\" DevicePath \"\"" Mar 16 16:51:17 crc kubenswrapper[5120]: I0316 16:51:17.969734 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3dd23150-3886-4b39-b37c-f25f89a6a6a3-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:51:17 crc kubenswrapper[5120]: I0316 16:51:17.969746 5120 reconciler_common.go:299] "Volume detached for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/3dd23150-3886-4b39-b37c-f25f89a6a6a3-vencrypt-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:51:17 crc kubenswrapper[5120]: I0316 16:51:17.969777 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3dd23150-3886-4b39-b37c-f25f89a6a6a3-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:51:17 crc kubenswrapper[5120]: I0316 16:51:17.969789 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/17638423-bcdb-4b88-b3c8-5faa97ef3d0d-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:51:18 crc kubenswrapper[5120]: I0316 16:51:18.090631 5120 generic.go:358] "Generic (PLEG): container finished" podID="3dd23150-3886-4b39-b37c-f25f89a6a6a3" containerID="576542c7a6aba49256f021a7a58f1c009884e872a1c8345cc417bd2c6f35f4b8" exitCode=137 Mar 16 16:51:18 crc kubenswrapper[5120]: I0316 16:51:18.091099 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:51:18 crc kubenswrapper[5120]: I0316 16:51:18.091094 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"3dd23150-3886-4b39-b37c-f25f89a6a6a3","Type":"ContainerDied","Data":"576542c7a6aba49256f021a7a58f1c009884e872a1c8345cc417bd2c6f35f4b8"} Mar 16 16:51:18 crc kubenswrapper[5120]: I0316 16:51:18.093183 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"3dd23150-3886-4b39-b37c-f25f89a6a6a3","Type":"ContainerDied","Data":"147f9dbc5bdec8bf5b67c4a6cc8c724cd78d704987cafa98a2f1de7c380ea3da"} Mar 16 16:51:18 crc kubenswrapper[5120]: I0316 16:51:18.093219 5120 scope.go:117] "RemoveContainer" containerID="576542c7a6aba49256f021a7a58f1c009884e872a1c8345cc417bd2c6f35f4b8" Mar 16 16:51:18 crc kubenswrapper[5120]: I0316 16:51:18.096468 5120 generic.go:358] "Generic (PLEG): container finished" podID="17638423-bcdb-4b88-b3c8-5faa97ef3d0d" containerID="ca30b4bf5029782ac5fccfa5bde0a8f21e74359eb71da809a8208214a27e1a23" exitCode=137 Mar 16 16:51:18 crc kubenswrapper[5120]: I0316 16:51:18.096572 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"17638423-bcdb-4b88-b3c8-5faa97ef3d0d","Type":"ContainerDied","Data":"ca30b4bf5029782ac5fccfa5bde0a8f21e74359eb71da809a8208214a27e1a23"} Mar 16 16:51:18 crc kubenswrapper[5120]: I0316 16:51:18.096598 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:51:18 crc kubenswrapper[5120]: I0316 16:51:18.096610 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"17638423-bcdb-4b88-b3c8-5faa97ef3d0d","Type":"ContainerDied","Data":"42c62c71087679bfec82bdea705ab9734387eb872276a60c990beaf3d7218b07"} Mar 16 16:51:18 crc kubenswrapper[5120]: I0316 16:51:18.144629 5120 scope.go:117] "RemoveContainer" containerID="576542c7a6aba49256f021a7a58f1c009884e872a1c8345cc417bd2c6f35f4b8" Mar 16 16:51:18 crc kubenswrapper[5120]: I0316 16:51:18.145706 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:51:18 crc kubenswrapper[5120]: E0316 16:51:18.145946 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"576542c7a6aba49256f021a7a58f1c009884e872a1c8345cc417bd2c6f35f4b8\": container with ID starting with 576542c7a6aba49256f021a7a58f1c009884e872a1c8345cc417bd2c6f35f4b8 not found: ID does not exist" containerID="576542c7a6aba49256f021a7a58f1c009884e872a1c8345cc417bd2c6f35f4b8" Mar 16 16:51:18 crc kubenswrapper[5120]: I0316 16:51:18.145987 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"576542c7a6aba49256f021a7a58f1c009884e872a1c8345cc417bd2c6f35f4b8"} err="failed to get container status \"576542c7a6aba49256f021a7a58f1c009884e872a1c8345cc417bd2c6f35f4b8\": rpc error: code = NotFound desc = could not find container \"576542c7a6aba49256f021a7a58f1c009884e872a1c8345cc417bd2c6f35f4b8\": container with ID starting with 576542c7a6aba49256f021a7a58f1c009884e872a1c8345cc417bd2c6f35f4b8 not found: ID does not exist" Mar 16 16:51:18 crc kubenswrapper[5120]: I0316 16:51:18.146012 5120 scope.go:117] "RemoveContainer" containerID="ca30b4bf5029782ac5fccfa5bde0a8f21e74359eb71da809a8208214a27e1a23" Mar 16 16:51:18 crc kubenswrapper[5120]: I0316 16:51:18.160579 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:51:18 crc kubenswrapper[5120]: I0316 16:51:18.184971 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:51:18 crc kubenswrapper[5120]: I0316 16:51:18.199409 5120 scope.go:117] "RemoveContainer" containerID="ca30b4bf5029782ac5fccfa5bde0a8f21e74359eb71da809a8208214a27e1a23" Mar 16 16:51:18 crc kubenswrapper[5120]: E0316 16:51:18.200029 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca30b4bf5029782ac5fccfa5bde0a8f21e74359eb71da809a8208214a27e1a23\": container with ID starting with ca30b4bf5029782ac5fccfa5bde0a8f21e74359eb71da809a8208214a27e1a23 not found: ID does not exist" containerID="ca30b4bf5029782ac5fccfa5bde0a8f21e74359eb71da809a8208214a27e1a23" Mar 16 16:51:18 crc kubenswrapper[5120]: I0316 16:51:18.200070 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca30b4bf5029782ac5fccfa5bde0a8f21e74359eb71da809a8208214a27e1a23"} err="failed to get container status \"ca30b4bf5029782ac5fccfa5bde0a8f21e74359eb71da809a8208214a27e1a23\": rpc error: code = NotFound desc = could not find container \"ca30b4bf5029782ac5fccfa5bde0a8f21e74359eb71da809a8208214a27e1a23\": container with ID starting with ca30b4bf5029782ac5fccfa5bde0a8f21e74359eb71da809a8208214a27e1a23 not found: ID does not exist" Mar 16 16:51:18 crc kubenswrapper[5120]: I0316 16:51:18.202496 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:51:18 crc kubenswrapper[5120]: I0316 16:51:18.204156 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17638423-bcdb-4b88-b3c8-5faa97ef3d0d" containerName="nova-scheduler-scheduler" Mar 16 16:51:18 crc kubenswrapper[5120]: I0316 16:51:18.204324 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="17638423-bcdb-4b88-b3c8-5faa97ef3d0d" containerName="nova-scheduler-scheduler" Mar 16 16:51:18 crc kubenswrapper[5120]: I0316 16:51:18.204431 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3dd23150-3886-4b39-b37c-f25f89a6a6a3" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 16:51:18 crc kubenswrapper[5120]: I0316 16:51:18.204504 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="3dd23150-3886-4b39-b37c-f25f89a6a6a3" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 16:51:18 crc kubenswrapper[5120]: I0316 16:51:18.204916 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="17638423-bcdb-4b88-b3c8-5faa97ef3d0d" containerName="nova-scheduler-scheduler" Mar 16 16:51:18 crc kubenswrapper[5120]: I0316 16:51:18.205027 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="3dd23150-3886-4b39-b37c-f25f89a6a6a3" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 16:51:18 crc kubenswrapper[5120]: I0316 16:51:18.214929 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:51:18 crc kubenswrapper[5120]: I0316 16:51:18.217022 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:51:18 crc kubenswrapper[5120]: I0316 16:51:18.217124 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-scheduler-config-data\"" Mar 16 16:51:18 crc kubenswrapper[5120]: I0316 16:51:18.233010 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:51:18 crc kubenswrapper[5120]: I0316 16:51:18.245744 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:51:18 crc kubenswrapper[5120]: I0316 16:51:18.252917 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:51:18 crc kubenswrapper[5120]: I0316 16:51:18.257642 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-novncproxy-cell1-vencrypt\"" Mar 16 16:51:18 crc kubenswrapper[5120]: I0316 16:51:18.257841 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-novncproxy-config-data\"" Mar 16 16:51:18 crc kubenswrapper[5120]: I0316 16:51:18.258009 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-novncproxy-cell1-public-svc\"" Mar 16 16:51:18 crc kubenswrapper[5120]: I0316 16:51:18.262065 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:51:18 crc kubenswrapper[5120]: I0316 16:51:18.378096 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkrds\" (UniqueName: \"kubernetes.io/projected/9f5ce683-1975-46fb-ab27-2e4888748b7b-kube-api-access-hkrds\") pod \"nova-cell1-novncproxy-0\" (UID: \"9f5ce683-1975-46fb-ab27-2e4888748b7b\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:51:18 crc kubenswrapper[5120]: I0316 16:51:18.378204 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8de404c3-c457-4550-94a9-86d2d14103ee-config-data\") pod \"nova-scheduler-0\" (UID: \"8de404c3-c457-4550-94a9-86d2d14103ee\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:51:18 crc kubenswrapper[5120]: I0316 16:51:18.378331 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9f5ce683-1975-46fb-ab27-2e4888748b7b-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"9f5ce683-1975-46fb-ab27-2e4888748b7b\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:51:18 crc kubenswrapper[5120]: I0316 16:51:18.378363 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8de404c3-c457-4550-94a9-86d2d14103ee-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"8de404c3-c457-4550-94a9-86d2d14103ee\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:51:18 crc kubenswrapper[5120]: I0316 16:51:18.378675 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/9f5ce683-1975-46fb-ab27-2e4888748b7b-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"9f5ce683-1975-46fb-ab27-2e4888748b7b\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:51:18 crc kubenswrapper[5120]: I0316 16:51:18.378799 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzmfr\" (UniqueName: \"kubernetes.io/projected/8de404c3-c457-4550-94a9-86d2d14103ee-kube-api-access-qzmfr\") pod \"nova-scheduler-0\" (UID: \"8de404c3-c457-4550-94a9-86d2d14103ee\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:51:18 crc kubenswrapper[5120]: I0316 16:51:18.378936 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9f5ce683-1975-46fb-ab27-2e4888748b7b-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"9f5ce683-1975-46fb-ab27-2e4888748b7b\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:51:18 crc kubenswrapper[5120]: I0316 16:51:18.378967 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/9f5ce683-1975-46fb-ab27-2e4888748b7b-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"9f5ce683-1975-46fb-ab27-2e4888748b7b\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:51:18 crc kubenswrapper[5120]: E0316 16:51:18.463910 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="59ea000c80804f2740555310ca43eeb4d84a66364bbce05903490e9bceb834a3" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:51:18 crc kubenswrapper[5120]: E0316 16:51:18.465627 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="59ea000c80804f2740555310ca43eeb4d84a66364bbce05903490e9bceb834a3" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:51:18 crc kubenswrapper[5120]: E0316 16:51:18.467592 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="59ea000c80804f2740555310ca43eeb4d84a66364bbce05903490e9bceb834a3" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:51:18 crc kubenswrapper[5120]: E0316 16:51:18.467640 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="d43280dd-cd49-4365-8474-7bab9f5b4899" containerName="nova-cell1-conductor-conductor" probeResult="unknown" Mar 16 16:51:18 crc kubenswrapper[5120]: I0316 16:51:18.481019 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/9f5ce683-1975-46fb-ab27-2e4888748b7b-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"9f5ce683-1975-46fb-ab27-2e4888748b7b\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:51:18 crc kubenswrapper[5120]: I0316 16:51:18.481107 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qzmfr\" (UniqueName: \"kubernetes.io/projected/8de404c3-c457-4550-94a9-86d2d14103ee-kube-api-access-qzmfr\") pod \"nova-scheduler-0\" (UID: \"8de404c3-c457-4550-94a9-86d2d14103ee\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:51:18 crc kubenswrapper[5120]: I0316 16:51:18.481196 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9f5ce683-1975-46fb-ab27-2e4888748b7b-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"9f5ce683-1975-46fb-ab27-2e4888748b7b\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:51:18 crc kubenswrapper[5120]: I0316 16:51:18.481337 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/9f5ce683-1975-46fb-ab27-2e4888748b7b-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"9f5ce683-1975-46fb-ab27-2e4888748b7b\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:51:18 crc kubenswrapper[5120]: I0316 16:51:18.481582 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hkrds\" (UniqueName: \"kubernetes.io/projected/9f5ce683-1975-46fb-ab27-2e4888748b7b-kube-api-access-hkrds\") pod \"nova-cell1-novncproxy-0\" (UID: \"9f5ce683-1975-46fb-ab27-2e4888748b7b\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:51:18 crc kubenswrapper[5120]: I0316 16:51:18.481825 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8de404c3-c457-4550-94a9-86d2d14103ee-config-data\") pod \"nova-scheduler-0\" (UID: \"8de404c3-c457-4550-94a9-86d2d14103ee\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:51:18 crc kubenswrapper[5120]: I0316 16:51:18.482099 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9f5ce683-1975-46fb-ab27-2e4888748b7b-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"9f5ce683-1975-46fb-ab27-2e4888748b7b\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:51:18 crc kubenswrapper[5120]: I0316 16:51:18.482181 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8de404c3-c457-4550-94a9-86d2d14103ee-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"8de404c3-c457-4550-94a9-86d2d14103ee\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:51:18 crc kubenswrapper[5120]: I0316 16:51:18.487100 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/9f5ce683-1975-46fb-ab27-2e4888748b7b-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"9f5ce683-1975-46fb-ab27-2e4888748b7b\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:51:18 crc kubenswrapper[5120]: I0316 16:51:18.487135 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/9f5ce683-1975-46fb-ab27-2e4888748b7b-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"9f5ce683-1975-46fb-ab27-2e4888748b7b\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:51:18 crc kubenswrapper[5120]: I0316 16:51:18.487295 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9f5ce683-1975-46fb-ab27-2e4888748b7b-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"9f5ce683-1975-46fb-ab27-2e4888748b7b\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:51:18 crc kubenswrapper[5120]: I0316 16:51:18.488268 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8de404c3-c457-4550-94a9-86d2d14103ee-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"8de404c3-c457-4550-94a9-86d2d14103ee\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:51:18 crc kubenswrapper[5120]: I0316 16:51:18.488354 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8de404c3-c457-4550-94a9-86d2d14103ee-config-data\") pod \"nova-scheduler-0\" (UID: \"8de404c3-c457-4550-94a9-86d2d14103ee\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:51:18 crc kubenswrapper[5120]: I0316 16:51:18.489574 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9f5ce683-1975-46fb-ab27-2e4888748b7b-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"9f5ce683-1975-46fb-ab27-2e4888748b7b\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:51:18 crc kubenswrapper[5120]: I0316 16:51:18.498912 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzmfr\" (UniqueName: \"kubernetes.io/projected/8de404c3-c457-4550-94a9-86d2d14103ee-kube-api-access-qzmfr\") pod \"nova-scheduler-0\" (UID: \"8de404c3-c457-4550-94a9-86d2d14103ee\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:51:18 crc kubenswrapper[5120]: I0316 16:51:18.499254 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkrds\" (UniqueName: \"kubernetes.io/projected/9f5ce683-1975-46fb-ab27-2e4888748b7b-kube-api-access-hkrds\") pod \"nova-cell1-novncproxy-0\" (UID: \"9f5ce683-1975-46fb-ab27-2e4888748b7b\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:51:18 crc kubenswrapper[5120]: I0316 16:51:18.539547 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:51:18 crc kubenswrapper[5120]: I0316 16:51:18.573684 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:51:18 crc kubenswrapper[5120]: I0316 16:51:18.696076 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="17638423-bcdb-4b88-b3c8-5faa97ef3d0d" path="/var/lib/kubelet/pods/17638423-bcdb-4b88-b3c8-5faa97ef3d0d/volumes" Mar 16 16:51:18 crc kubenswrapper[5120]: I0316 16:51:18.696752 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3dd23150-3886-4b39-b37c-f25f89a6a6a3" path="/var/lib/kubelet/pods/3dd23150-3886-4b39-b37c-f25f89a6a6a3/volumes" Mar 16 16:51:18 crc kubenswrapper[5120]: I0316 16:51:18.902222 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:51:18 crc kubenswrapper[5120]: I0316 16:51:18.994600 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d43280dd-cd49-4365-8474-7bab9f5b4899-combined-ca-bundle\") pod \"d43280dd-cd49-4365-8474-7bab9f5b4899\" (UID: \"d43280dd-cd49-4365-8474-7bab9f5b4899\") " Mar 16 16:51:18 crc kubenswrapper[5120]: I0316 16:51:18.994931 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p8wq5\" (UniqueName: \"kubernetes.io/projected/d43280dd-cd49-4365-8474-7bab9f5b4899-kube-api-access-p8wq5\") pod \"d43280dd-cd49-4365-8474-7bab9f5b4899\" (UID: \"d43280dd-cd49-4365-8474-7bab9f5b4899\") " Mar 16 16:51:18 crc kubenswrapper[5120]: I0316 16:51:18.995090 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d43280dd-cd49-4365-8474-7bab9f5b4899-config-data\") pod \"d43280dd-cd49-4365-8474-7bab9f5b4899\" (UID: \"d43280dd-cd49-4365-8474-7bab9f5b4899\") " Mar 16 16:51:19 crc kubenswrapper[5120]: I0316 16:51:19.000479 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d43280dd-cd49-4365-8474-7bab9f5b4899-kube-api-access-p8wq5" (OuterVolumeSpecName: "kube-api-access-p8wq5") pod "d43280dd-cd49-4365-8474-7bab9f5b4899" (UID: "d43280dd-cd49-4365-8474-7bab9f5b4899"). InnerVolumeSpecName "kube-api-access-p8wq5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:51:19 crc kubenswrapper[5120]: I0316 16:51:19.024065 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d43280dd-cd49-4365-8474-7bab9f5b4899-config-data" (OuterVolumeSpecName: "config-data") pod "d43280dd-cd49-4365-8474-7bab9f5b4899" (UID: "d43280dd-cd49-4365-8474-7bab9f5b4899"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:51:19 crc kubenswrapper[5120]: I0316 16:51:19.024941 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d43280dd-cd49-4365-8474-7bab9f5b4899-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "d43280dd-cd49-4365-8474-7bab9f5b4899" (UID: "d43280dd-cd49-4365-8474-7bab9f5b4899"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:51:19 crc kubenswrapper[5120]: W0316 16:51:19.087838 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8de404c3_c457_4550_94a9_86d2d14103ee.slice/crio-8f106e68ca9e9c0e7de4fef9702205c793e38bbdaca94044a59a09de8b8d124a WatchSource:0}: Error finding container 8f106e68ca9e9c0e7de4fef9702205c793e38bbdaca94044a59a09de8b8d124a: Status 404 returned error can't find the container with id 8f106e68ca9e9c0e7de4fef9702205c793e38bbdaca94044a59a09de8b8d124a Mar 16 16:51:19 crc kubenswrapper[5120]: I0316 16:51:19.095887 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:51:19 crc kubenswrapper[5120]: I0316 16:51:19.098891 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d43280dd-cd49-4365-8474-7bab9f5b4899-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:51:19 crc kubenswrapper[5120]: I0316 16:51:19.098927 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p8wq5\" (UniqueName: \"kubernetes.io/projected/d43280dd-cd49-4365-8474-7bab9f5b4899-kube-api-access-p8wq5\") on node \"crc\" DevicePath \"\"" Mar 16 16:51:19 crc kubenswrapper[5120]: I0316 16:51:19.098940 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d43280dd-cd49-4365-8474-7bab9f5b4899-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:51:19 crc kubenswrapper[5120]: W0316 16:51:19.104131 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9f5ce683_1975_46fb_ab27_2e4888748b7b.slice/crio-a172cebe85d9a2fe2276e6e7db49eaad80a4af379fb448d63913ff1dfc716a47 WatchSource:0}: Error finding container a172cebe85d9a2fe2276e6e7db49eaad80a4af379fb448d63913ff1dfc716a47: Status 404 returned error can't find the container with id a172cebe85d9a2fe2276e6e7db49eaad80a4af379fb448d63913ff1dfc716a47 Mar 16 16:51:19 crc kubenswrapper[5120]: I0316 16:51:19.106500 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:51:19 crc kubenswrapper[5120]: I0316 16:51:19.111786 5120 generic.go:358] "Generic (PLEG): container finished" podID="d43280dd-cd49-4365-8474-7bab9f5b4899" containerID="59ea000c80804f2740555310ca43eeb4d84a66364bbce05903490e9bceb834a3" exitCode=137 Mar 16 16:51:19 crc kubenswrapper[5120]: I0316 16:51:19.111864 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"d43280dd-cd49-4365-8474-7bab9f5b4899","Type":"ContainerDied","Data":"59ea000c80804f2740555310ca43eeb4d84a66364bbce05903490e9bceb834a3"} Mar 16 16:51:19 crc kubenswrapper[5120]: I0316 16:51:19.111892 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"d43280dd-cd49-4365-8474-7bab9f5b4899","Type":"ContainerDied","Data":"a9b79029d6d24387ee795053a4928277373ff61e824b64993fa8965d16384c08"} Mar 16 16:51:19 crc kubenswrapper[5120]: I0316 16:51:19.111911 5120 scope.go:117] "RemoveContainer" containerID="59ea000c80804f2740555310ca43eeb4d84a66364bbce05903490e9bceb834a3" Mar 16 16:51:19 crc kubenswrapper[5120]: I0316 16:51:19.112030 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:51:19 crc kubenswrapper[5120]: I0316 16:51:19.114463 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"8de404c3-c457-4550-94a9-86d2d14103ee","Type":"ContainerStarted","Data":"8f106e68ca9e9c0e7de4fef9702205c793e38bbdaca94044a59a09de8b8d124a"} Mar 16 16:51:19 crc kubenswrapper[5120]: I0316 16:51:19.150324 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 16:51:19 crc kubenswrapper[5120]: I0316 16:51:19.165862 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 16:51:19 crc kubenswrapper[5120]: I0316 16:51:19.175134 5120 scope.go:117] "RemoveContainer" containerID="59ea000c80804f2740555310ca43eeb4d84a66364bbce05903490e9bceb834a3" Mar 16 16:51:19 crc kubenswrapper[5120]: E0316 16:51:19.181377 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"59ea000c80804f2740555310ca43eeb4d84a66364bbce05903490e9bceb834a3\": container with ID starting with 59ea000c80804f2740555310ca43eeb4d84a66364bbce05903490e9bceb834a3 not found: ID does not exist" containerID="59ea000c80804f2740555310ca43eeb4d84a66364bbce05903490e9bceb834a3" Mar 16 16:51:19 crc kubenswrapper[5120]: I0316 16:51:19.181448 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59ea000c80804f2740555310ca43eeb4d84a66364bbce05903490e9bceb834a3"} err="failed to get container status \"59ea000c80804f2740555310ca43eeb4d84a66364bbce05903490e9bceb834a3\": rpc error: code = NotFound desc = could not find container \"59ea000c80804f2740555310ca43eeb4d84a66364bbce05903490e9bceb834a3\": container with ID starting with 59ea000c80804f2740555310ca43eeb4d84a66364bbce05903490e9bceb834a3 not found: ID does not exist" Mar 16 16:51:19 crc kubenswrapper[5120]: I0316 16:51:19.187050 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 16:51:19 crc kubenswrapper[5120]: I0316 16:51:19.188094 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d43280dd-cd49-4365-8474-7bab9f5b4899" containerName="nova-cell1-conductor-conductor" Mar 16 16:51:19 crc kubenswrapper[5120]: I0316 16:51:19.188116 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="d43280dd-cd49-4365-8474-7bab9f5b4899" containerName="nova-cell1-conductor-conductor" Mar 16 16:51:19 crc kubenswrapper[5120]: I0316 16:51:19.188329 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="d43280dd-cd49-4365-8474-7bab9f5b4899" containerName="nova-cell1-conductor-conductor" Mar 16 16:51:19 crc kubenswrapper[5120]: I0316 16:51:19.205107 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 16:51:19 crc kubenswrapper[5120]: I0316 16:51:19.205161 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:51:19 crc kubenswrapper[5120]: I0316 16:51:19.208229 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-conductor-config-data\"" Mar 16 16:51:19 crc kubenswrapper[5120]: I0316 16:51:19.304440 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/adaee0e3-17f6-4f23-97c4-00bd5f6a8d6c-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"adaee0e3-17f6-4f23-97c4-00bd5f6a8d6c\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:51:19 crc kubenswrapper[5120]: I0316 16:51:19.307097 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwwlm\" (UniqueName: \"kubernetes.io/projected/adaee0e3-17f6-4f23-97c4-00bd5f6a8d6c-kube-api-access-pwwlm\") pod \"nova-cell1-conductor-0\" (UID: \"adaee0e3-17f6-4f23-97c4-00bd5f6a8d6c\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:51:19 crc kubenswrapper[5120]: I0316 16:51:19.307407 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/adaee0e3-17f6-4f23-97c4-00bd5f6a8d6c-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"adaee0e3-17f6-4f23-97c4-00bd5f6a8d6c\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:51:19 crc kubenswrapper[5120]: I0316 16:51:19.410685 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/adaee0e3-17f6-4f23-97c4-00bd5f6a8d6c-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"adaee0e3-17f6-4f23-97c4-00bd5f6a8d6c\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:51:19 crc kubenswrapper[5120]: I0316 16:51:19.411149 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pwwlm\" (UniqueName: \"kubernetes.io/projected/adaee0e3-17f6-4f23-97c4-00bd5f6a8d6c-kube-api-access-pwwlm\") pod \"nova-cell1-conductor-0\" (UID: \"adaee0e3-17f6-4f23-97c4-00bd5f6a8d6c\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:51:19 crc kubenswrapper[5120]: I0316 16:51:19.411317 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/adaee0e3-17f6-4f23-97c4-00bd5f6a8d6c-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"adaee0e3-17f6-4f23-97c4-00bd5f6a8d6c\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:51:19 crc kubenswrapper[5120]: I0316 16:51:19.415329 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/adaee0e3-17f6-4f23-97c4-00bd5f6a8d6c-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"adaee0e3-17f6-4f23-97c4-00bd5f6a8d6c\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:51:19 crc kubenswrapper[5120]: I0316 16:51:19.415478 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/adaee0e3-17f6-4f23-97c4-00bd5f6a8d6c-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"adaee0e3-17f6-4f23-97c4-00bd5f6a8d6c\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:51:19 crc kubenswrapper[5120]: I0316 16:51:19.432286 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwwlm\" (UniqueName: \"kubernetes.io/projected/adaee0e3-17f6-4f23-97c4-00bd5f6a8d6c-kube-api-access-pwwlm\") pod \"nova-cell1-conductor-0\" (UID: \"adaee0e3-17f6-4f23-97c4-00bd5f6a8d6c\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:51:19 crc kubenswrapper[5120]: I0316 16:51:19.532581 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:51:19 crc kubenswrapper[5120]: I0316 16:51:19.989845 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 16:51:19 crc kubenswrapper[5120]: W0316 16:51:19.994097 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podadaee0e3_17f6_4f23_97c4_00bd5f6a8d6c.slice/crio-4d9d8144ea52793dbcee152726e18d4789bb3b79df22d6e3cef138eb8d397405 WatchSource:0}: Error finding container 4d9d8144ea52793dbcee152726e18d4789bb3b79df22d6e3cef138eb8d397405: Status 404 returned error can't find the container with id 4d9d8144ea52793dbcee152726e18d4789bb3b79df22d6e3cef138eb8d397405 Mar 16 16:51:20 crc kubenswrapper[5120]: I0316 16:51:20.131110 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"adaee0e3-17f6-4f23-97c4-00bd5f6a8d6c","Type":"ContainerStarted","Data":"4d9d8144ea52793dbcee152726e18d4789bb3b79df22d6e3cef138eb8d397405"} Mar 16 16:51:20 crc kubenswrapper[5120]: I0316 16:51:20.134459 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"8de404c3-c457-4550-94a9-86d2d14103ee","Type":"ContainerStarted","Data":"aef63c7abec2124d66e4a26586c1f663a4990f4bd7b6b055ba532c7a3a159e97"} Mar 16 16:51:20 crc kubenswrapper[5120]: I0316 16:51:20.137071 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"9f5ce683-1975-46fb-ab27-2e4888748b7b","Type":"ContainerStarted","Data":"6ec7a760a1240a7bf2d5c6d87956f6162ba6eb01f9c73461e515eedd1212d168"} Mar 16 16:51:20 crc kubenswrapper[5120]: I0316 16:51:20.137113 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"9f5ce683-1975-46fb-ab27-2e4888748b7b","Type":"ContainerStarted","Data":"a172cebe85d9a2fe2276e6e7db49eaad80a4af379fb448d63913ff1dfc716a47"} Mar 16 16:51:20 crc kubenswrapper[5120]: I0316 16:51:20.166020 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-scheduler-0" podStartSLOduration=2.16600452 podStartE2EDuration="2.16600452s" podCreationTimestamp="2026-03-16 16:51:18 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:51:20.153426535 +0000 UTC m=+4782.307358202" watchObservedRunningTime="2026-03-16 16:51:20.16600452 +0000 UTC m=+4782.319936177" Mar 16 16:51:20 crc kubenswrapper[5120]: I0316 16:51:20.205855 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podStartSLOduration=2.205831462 podStartE2EDuration="2.205831462s" podCreationTimestamp="2026-03-16 16:51:18 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:51:20.169006512 +0000 UTC m=+4782.322938169" watchObservedRunningTime="2026-03-16 16:51:20.205831462 +0000 UTC m=+4782.359763119" Mar 16 16:51:20 crc kubenswrapper[5120]: E0316 16:51:20.563499 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="b56f0565dc2be984512ca563ce8d4aba134cd33629dfbaa67b4f8b221b49f35c" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:51:20 crc kubenswrapper[5120]: E0316 16:51:20.566438 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="b56f0565dc2be984512ca563ce8d4aba134cd33629dfbaa67b4f8b221b49f35c" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:51:20 crc kubenswrapper[5120]: E0316 16:51:20.568579 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="b56f0565dc2be984512ca563ce8d4aba134cd33629dfbaa67b4f8b221b49f35c" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:51:20 crc kubenswrapper[5120]: E0316 16:51:20.568638 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="01f62262-5954-44de-80cb-c1cf1c179a0f" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 16:51:20 crc kubenswrapper[5120]: I0316 16:51:20.677101 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d43280dd-cd49-4365-8474-7bab9f5b4899" path="/var/lib/kubelet/pods/d43280dd-cd49-4365-8474-7bab9f5b4899/volumes" Mar 16 16:51:20 crc kubenswrapper[5120]: I0316 16:51:20.935163 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:51:20 crc kubenswrapper[5120]: I0316 16:51:20.962584 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/fca63e3b-929a-4864-b234-3dcb19a31da8-nova-metadata-tls-certs\") pod \"fca63e3b-929a-4864-b234-3dcb19a31da8\" (UID: \"fca63e3b-929a-4864-b234-3dcb19a31da8\") " Mar 16 16:51:20 crc kubenswrapper[5120]: I0316 16:51:20.962646 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s9cgj\" (UniqueName: \"kubernetes.io/projected/fca63e3b-929a-4864-b234-3dcb19a31da8-kube-api-access-s9cgj\") pod \"fca63e3b-929a-4864-b234-3dcb19a31da8\" (UID: \"fca63e3b-929a-4864-b234-3dcb19a31da8\") " Mar 16 16:51:20 crc kubenswrapper[5120]: I0316 16:51:20.962790 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/fca63e3b-929a-4864-b234-3dcb19a31da8-logs\") pod \"fca63e3b-929a-4864-b234-3dcb19a31da8\" (UID: \"fca63e3b-929a-4864-b234-3dcb19a31da8\") " Mar 16 16:51:20 crc kubenswrapper[5120]: I0316 16:51:20.963070 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fca63e3b-929a-4864-b234-3dcb19a31da8-combined-ca-bundle\") pod \"fca63e3b-929a-4864-b234-3dcb19a31da8\" (UID: \"fca63e3b-929a-4864-b234-3dcb19a31da8\") " Mar 16 16:51:20 crc kubenswrapper[5120]: I0316 16:51:20.963308 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fca63e3b-929a-4864-b234-3dcb19a31da8-config-data\") pod \"fca63e3b-929a-4864-b234-3dcb19a31da8\" (UID: \"fca63e3b-929a-4864-b234-3dcb19a31da8\") " Mar 16 16:51:20 crc kubenswrapper[5120]: I0316 16:51:20.965421 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fca63e3b-929a-4864-b234-3dcb19a31da8-logs" (OuterVolumeSpecName: "logs") pod "fca63e3b-929a-4864-b234-3dcb19a31da8" (UID: "fca63e3b-929a-4864-b234-3dcb19a31da8"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:51:20 crc kubenswrapper[5120]: I0316 16:51:20.971443 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fca63e3b-929a-4864-b234-3dcb19a31da8-kube-api-access-s9cgj" (OuterVolumeSpecName: "kube-api-access-s9cgj") pod "fca63e3b-929a-4864-b234-3dcb19a31da8" (UID: "fca63e3b-929a-4864-b234-3dcb19a31da8"). InnerVolumeSpecName "kube-api-access-s9cgj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:51:20 crc kubenswrapper[5120]: I0316 16:51:20.995080 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fca63e3b-929a-4864-b234-3dcb19a31da8-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "fca63e3b-929a-4864-b234-3dcb19a31da8" (UID: "fca63e3b-929a-4864-b234-3dcb19a31da8"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:51:21 crc kubenswrapper[5120]: I0316 16:51:21.002749 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fca63e3b-929a-4864-b234-3dcb19a31da8-config-data" (OuterVolumeSpecName: "config-data") pod "fca63e3b-929a-4864-b234-3dcb19a31da8" (UID: "fca63e3b-929a-4864-b234-3dcb19a31da8"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:51:21 crc kubenswrapper[5120]: I0316 16:51:21.009429 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:51:21 crc kubenswrapper[5120]: I0316 16:51:21.026442 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fca63e3b-929a-4864-b234-3dcb19a31da8-nova-metadata-tls-certs" (OuterVolumeSpecName: "nova-metadata-tls-certs") pod "fca63e3b-929a-4864-b234-3dcb19a31da8" (UID: "fca63e3b-929a-4864-b234-3dcb19a31da8"). InnerVolumeSpecName "nova-metadata-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:51:21 crc kubenswrapper[5120]: I0316 16:51:21.065102 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/01f62262-5954-44de-80cb-c1cf1c179a0f-config-data\") pod \"01f62262-5954-44de-80cb-c1cf1c179a0f\" (UID: \"01f62262-5954-44de-80cb-c1cf1c179a0f\") " Mar 16 16:51:21 crc kubenswrapper[5120]: I0316 16:51:21.065495 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/01f62262-5954-44de-80cb-c1cf1c179a0f-combined-ca-bundle\") pod \"01f62262-5954-44de-80cb-c1cf1c179a0f\" (UID: \"01f62262-5954-44de-80cb-c1cf1c179a0f\") " Mar 16 16:51:21 crc kubenswrapper[5120]: I0316 16:51:21.065698 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vdwkm\" (UniqueName: \"kubernetes.io/projected/01f62262-5954-44de-80cb-c1cf1c179a0f-kube-api-access-vdwkm\") pod \"01f62262-5954-44de-80cb-c1cf1c179a0f\" (UID: \"01f62262-5954-44de-80cb-c1cf1c179a0f\") " Mar 16 16:51:21 crc kubenswrapper[5120]: I0316 16:51:21.067110 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fca63e3b-929a-4864-b234-3dcb19a31da8-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:51:21 crc kubenswrapper[5120]: I0316 16:51:21.067144 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fca63e3b-929a-4864-b234-3dcb19a31da8-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:51:21 crc kubenswrapper[5120]: I0316 16:51:21.067159 5120 reconciler_common.go:299] "Volume detached for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/fca63e3b-929a-4864-b234-3dcb19a31da8-nova-metadata-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:51:21 crc kubenswrapper[5120]: I0316 16:51:21.067174 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s9cgj\" (UniqueName: \"kubernetes.io/projected/fca63e3b-929a-4864-b234-3dcb19a31da8-kube-api-access-s9cgj\") on node \"crc\" DevicePath \"\"" Mar 16 16:51:21 crc kubenswrapper[5120]: I0316 16:51:21.067187 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/fca63e3b-929a-4864-b234-3dcb19a31da8-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:51:21 crc kubenswrapper[5120]: I0316 16:51:21.069370 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01f62262-5954-44de-80cb-c1cf1c179a0f-kube-api-access-vdwkm" (OuterVolumeSpecName: "kube-api-access-vdwkm") pod "01f62262-5954-44de-80cb-c1cf1c179a0f" (UID: "01f62262-5954-44de-80cb-c1cf1c179a0f"). InnerVolumeSpecName "kube-api-access-vdwkm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:51:21 crc kubenswrapper[5120]: I0316 16:51:21.090605 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/01f62262-5954-44de-80cb-c1cf1c179a0f-config-data" (OuterVolumeSpecName: "config-data") pod "01f62262-5954-44de-80cb-c1cf1c179a0f" (UID: "01f62262-5954-44de-80cb-c1cf1c179a0f"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:51:21 crc kubenswrapper[5120]: I0316 16:51:21.092096 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/01f62262-5954-44de-80cb-c1cf1c179a0f-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "01f62262-5954-44de-80cb-c1cf1c179a0f" (UID: "01f62262-5954-44de-80cb-c1cf1c179a0f"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:51:21 crc kubenswrapper[5120]: I0316 16:51:21.149300 5120 generic.go:358] "Generic (PLEG): container finished" podID="01f62262-5954-44de-80cb-c1cf1c179a0f" containerID="b56f0565dc2be984512ca563ce8d4aba134cd33629dfbaa67b4f8b221b49f35c" exitCode=137 Mar 16 16:51:21 crc kubenswrapper[5120]: I0316 16:51:21.149518 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"01f62262-5954-44de-80cb-c1cf1c179a0f","Type":"ContainerDied","Data":"b56f0565dc2be984512ca563ce8d4aba134cd33629dfbaa67b4f8b221b49f35c"} Mar 16 16:51:21 crc kubenswrapper[5120]: I0316 16:51:21.149836 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"01f62262-5954-44de-80cb-c1cf1c179a0f","Type":"ContainerDied","Data":"f82e977db20799693423a2354a1e22f26fb2cd8cddbbd074437a51e18f474944"} Mar 16 16:51:21 crc kubenswrapper[5120]: I0316 16:51:21.149889 5120 scope.go:117] "RemoveContainer" containerID="b56f0565dc2be984512ca563ce8d4aba134cd33629dfbaa67b4f8b221b49f35c" Mar 16 16:51:21 crc kubenswrapper[5120]: I0316 16:51:21.149602 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:51:21 crc kubenswrapper[5120]: I0316 16:51:21.162444 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"adaee0e3-17f6-4f23-97c4-00bd5f6a8d6c","Type":"ContainerStarted","Data":"ba4af8aa3c89740443bcafa47b272ccb7a4f3b2222974c478de29e30c4166272"} Mar 16 16:51:21 crc kubenswrapper[5120]: I0316 16:51:21.162515 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:51:21 crc kubenswrapper[5120]: I0316 16:51:21.169920 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/01f62262-5954-44de-80cb-c1cf1c179a0f-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:51:21 crc kubenswrapper[5120]: I0316 16:51:21.169958 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/01f62262-5954-44de-80cb-c1cf1c179a0f-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:51:21 crc kubenswrapper[5120]: I0316 16:51:21.169973 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vdwkm\" (UniqueName: \"kubernetes.io/projected/01f62262-5954-44de-80cb-c1cf1c179a0f-kube-api-access-vdwkm\") on node \"crc\" DevicePath \"\"" Mar 16 16:51:21 crc kubenswrapper[5120]: I0316 16:51:21.188248 5120 generic.go:358] "Generic (PLEG): container finished" podID="fca63e3b-929a-4864-b234-3dcb19a31da8" containerID="957583e99dcbe835d4fd5b23c3b4fd6601163e041d7816d888c380b9971cf8b2" exitCode=137 Mar 16 16:51:21 crc kubenswrapper[5120]: I0316 16:51:21.188312 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podStartSLOduration=2.188294826 podStartE2EDuration="2.188294826s" podCreationTimestamp="2026-03-16 16:51:19 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:51:21.183046362 +0000 UTC m=+4783.336978029" watchObservedRunningTime="2026-03-16 16:51:21.188294826 +0000 UTC m=+4783.342226483" Mar 16 16:51:21 crc kubenswrapper[5120]: I0316 16:51:21.190046 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:51:21 crc kubenswrapper[5120]: I0316 16:51:21.193323 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"fca63e3b-929a-4864-b234-3dcb19a31da8","Type":"ContainerDied","Data":"957583e99dcbe835d4fd5b23c3b4fd6601163e041d7816d888c380b9971cf8b2"} Mar 16 16:51:21 crc kubenswrapper[5120]: I0316 16:51:21.193396 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"fca63e3b-929a-4864-b234-3dcb19a31da8","Type":"ContainerDied","Data":"524d479d272b0cd150a269b1dc0c259e3cdba8242bc9d7515938d56b05ba95ee"} Mar 16 16:51:21 crc kubenswrapper[5120]: I0316 16:51:21.209212 5120 scope.go:117] "RemoveContainer" containerID="b56f0565dc2be984512ca563ce8d4aba134cd33629dfbaa67b4f8b221b49f35c" Mar 16 16:51:21 crc kubenswrapper[5120]: E0316 16:51:21.209700 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b56f0565dc2be984512ca563ce8d4aba134cd33629dfbaa67b4f8b221b49f35c\": container with ID starting with b56f0565dc2be984512ca563ce8d4aba134cd33629dfbaa67b4f8b221b49f35c not found: ID does not exist" containerID="b56f0565dc2be984512ca563ce8d4aba134cd33629dfbaa67b4f8b221b49f35c" Mar 16 16:51:21 crc kubenswrapper[5120]: I0316 16:51:21.209755 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b56f0565dc2be984512ca563ce8d4aba134cd33629dfbaa67b4f8b221b49f35c"} err="failed to get container status \"b56f0565dc2be984512ca563ce8d4aba134cd33629dfbaa67b4f8b221b49f35c\": rpc error: code = NotFound desc = could not find container \"b56f0565dc2be984512ca563ce8d4aba134cd33629dfbaa67b4f8b221b49f35c\": container with ID starting with b56f0565dc2be984512ca563ce8d4aba134cd33629dfbaa67b4f8b221b49f35c not found: ID does not exist" Mar 16 16:51:21 crc kubenswrapper[5120]: I0316 16:51:21.209793 5120 scope.go:117] "RemoveContainer" containerID="957583e99dcbe835d4fd5b23c3b4fd6601163e041d7816d888c380b9971cf8b2" Mar 16 16:51:21 crc kubenswrapper[5120]: I0316 16:51:21.227294 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:51:21 crc kubenswrapper[5120]: I0316 16:51:21.241310 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:51:21 crc kubenswrapper[5120]: I0316 16:51:21.258180 5120 scope.go:117] "RemoveContainer" containerID="389d94f15b6d6db7557fb56fc24f463b822baa0cf93fdf828501b25531874846" Mar 16 16:51:21 crc kubenswrapper[5120]: I0316 16:51:21.258570 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:51:21 crc kubenswrapper[5120]: I0316 16:51:21.260083 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fca63e3b-929a-4864-b234-3dcb19a31da8" containerName="nova-metadata-log" Mar 16 16:51:21 crc kubenswrapper[5120]: I0316 16:51:21.260117 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="fca63e3b-929a-4864-b234-3dcb19a31da8" containerName="nova-metadata-log" Mar 16 16:51:21 crc kubenswrapper[5120]: I0316 16:51:21.260138 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fca63e3b-929a-4864-b234-3dcb19a31da8" containerName="nova-metadata-metadata" Mar 16 16:51:21 crc kubenswrapper[5120]: I0316 16:51:21.260146 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="fca63e3b-929a-4864-b234-3dcb19a31da8" containerName="nova-metadata-metadata" Mar 16 16:51:21 crc kubenswrapper[5120]: I0316 16:51:21.260207 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01f62262-5954-44de-80cb-c1cf1c179a0f" containerName="nova-cell0-conductor-conductor" Mar 16 16:51:21 crc kubenswrapper[5120]: I0316 16:51:21.260218 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="01f62262-5954-44de-80cb-c1cf1c179a0f" containerName="nova-cell0-conductor-conductor" Mar 16 16:51:21 crc kubenswrapper[5120]: I0316 16:51:21.260446 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="fca63e3b-929a-4864-b234-3dcb19a31da8" containerName="nova-metadata-metadata" Mar 16 16:51:21 crc kubenswrapper[5120]: I0316 16:51:21.260469 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="fca63e3b-929a-4864-b234-3dcb19a31da8" containerName="nova-metadata-log" Mar 16 16:51:21 crc kubenswrapper[5120]: I0316 16:51:21.260486 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="01f62262-5954-44de-80cb-c1cf1c179a0f" containerName="nova-cell0-conductor-conductor" Mar 16 16:51:21 crc kubenswrapper[5120]: I0316 16:51:21.273304 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:51:21 crc kubenswrapper[5120]: I0316 16:51:21.279037 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:51:21 crc kubenswrapper[5120]: I0316 16:51:21.285950 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-conductor-config-data\"" Mar 16 16:51:21 crc kubenswrapper[5120]: I0316 16:51:21.289864 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:51:21 crc kubenswrapper[5120]: I0316 16:51:21.300945 5120 scope.go:117] "RemoveContainer" containerID="957583e99dcbe835d4fd5b23c3b4fd6601163e041d7816d888c380b9971cf8b2" Mar 16 16:51:21 crc kubenswrapper[5120]: E0316 16:51:21.304644 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"957583e99dcbe835d4fd5b23c3b4fd6601163e041d7816d888c380b9971cf8b2\": container with ID starting with 957583e99dcbe835d4fd5b23c3b4fd6601163e041d7816d888c380b9971cf8b2 not found: ID does not exist" containerID="957583e99dcbe835d4fd5b23c3b4fd6601163e041d7816d888c380b9971cf8b2" Mar 16 16:51:21 crc kubenswrapper[5120]: I0316 16:51:21.304695 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"957583e99dcbe835d4fd5b23c3b4fd6601163e041d7816d888c380b9971cf8b2"} err="failed to get container status \"957583e99dcbe835d4fd5b23c3b4fd6601163e041d7816d888c380b9971cf8b2\": rpc error: code = NotFound desc = could not find container \"957583e99dcbe835d4fd5b23c3b4fd6601163e041d7816d888c380b9971cf8b2\": container with ID starting with 957583e99dcbe835d4fd5b23c3b4fd6601163e041d7816d888c380b9971cf8b2 not found: ID does not exist" Mar 16 16:51:21 crc kubenswrapper[5120]: I0316 16:51:21.304724 5120 scope.go:117] "RemoveContainer" containerID="389d94f15b6d6db7557fb56fc24f463b822baa0cf93fdf828501b25531874846" Mar 16 16:51:21 crc kubenswrapper[5120]: E0316 16:51:21.305065 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"389d94f15b6d6db7557fb56fc24f463b822baa0cf93fdf828501b25531874846\": container with ID starting with 389d94f15b6d6db7557fb56fc24f463b822baa0cf93fdf828501b25531874846 not found: ID does not exist" containerID="389d94f15b6d6db7557fb56fc24f463b822baa0cf93fdf828501b25531874846" Mar 16 16:51:21 crc kubenswrapper[5120]: I0316 16:51:21.305085 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"389d94f15b6d6db7557fb56fc24f463b822baa0cf93fdf828501b25531874846"} err="failed to get container status \"389d94f15b6d6db7557fb56fc24f463b822baa0cf93fdf828501b25531874846\": rpc error: code = NotFound desc = could not find container \"389d94f15b6d6db7557fb56fc24f463b822baa0cf93fdf828501b25531874846\": container with ID starting with 389d94f15b6d6db7557fb56fc24f463b822baa0cf93fdf828501b25531874846 not found: ID does not exist" Mar 16 16:51:21 crc kubenswrapper[5120]: I0316 16:51:21.306991 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:51:21 crc kubenswrapper[5120]: I0316 16:51:21.316649 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:51:21 crc kubenswrapper[5120]: I0316 16:51:21.328799 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:51:21 crc kubenswrapper[5120]: I0316 16:51:21.328599 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:51:21 crc kubenswrapper[5120]: I0316 16:51:21.332154 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-metadata-internal-svc\"" Mar 16 16:51:21 crc kubenswrapper[5120]: I0316 16:51:21.334640 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-metadata-config-data\"" Mar 16 16:51:21 crc kubenswrapper[5120]: I0316 16:51:21.374543 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8a04cbe2-cde0-405c-820b-f2651d753654-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"8a04cbe2-cde0-405c-820b-f2651d753654\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:51:21 crc kubenswrapper[5120]: I0316 16:51:21.374605 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/f7182274-f2a8-4ce4-9621-931b6c09d615-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"f7182274-f2a8-4ce4-9621-931b6c09d615\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:51:21 crc kubenswrapper[5120]: I0316 16:51:21.374645 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8a04cbe2-cde0-405c-820b-f2651d753654-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"8a04cbe2-cde0-405c-820b-f2651d753654\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:51:21 crc kubenswrapper[5120]: I0316 16:51:21.374689 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f7182274-f2a8-4ce4-9621-931b6c09d615-config-data\") pod \"nova-metadata-0\" (UID: \"f7182274-f2a8-4ce4-9621-931b6c09d615\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:51:21 crc kubenswrapper[5120]: I0316 16:51:21.374880 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wp597\" (UniqueName: \"kubernetes.io/projected/8a04cbe2-cde0-405c-820b-f2651d753654-kube-api-access-wp597\") pod \"nova-cell0-conductor-0\" (UID: \"8a04cbe2-cde0-405c-820b-f2651d753654\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:51:21 crc kubenswrapper[5120]: I0316 16:51:21.374962 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f7182274-f2a8-4ce4-9621-931b6c09d615-logs\") pod \"nova-metadata-0\" (UID: \"f7182274-f2a8-4ce4-9621-931b6c09d615\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:51:21 crc kubenswrapper[5120]: I0316 16:51:21.374980 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f7182274-f2a8-4ce4-9621-931b6c09d615-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"f7182274-f2a8-4ce4-9621-931b6c09d615\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:51:21 crc kubenswrapper[5120]: I0316 16:51:21.375038 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvc5s\" (UniqueName: \"kubernetes.io/projected/f7182274-f2a8-4ce4-9621-931b6c09d615-kube-api-access-wvc5s\") pod \"nova-metadata-0\" (UID: \"f7182274-f2a8-4ce4-9621-931b6c09d615\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:51:21 crc kubenswrapper[5120]: I0316 16:51:21.477863 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8a04cbe2-cde0-405c-820b-f2651d753654-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"8a04cbe2-cde0-405c-820b-f2651d753654\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:51:21 crc kubenswrapper[5120]: I0316 16:51:21.478095 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/f7182274-f2a8-4ce4-9621-931b6c09d615-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"f7182274-f2a8-4ce4-9621-931b6c09d615\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:51:21 crc kubenswrapper[5120]: I0316 16:51:21.478215 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8a04cbe2-cde0-405c-820b-f2651d753654-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"8a04cbe2-cde0-405c-820b-f2651d753654\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:51:21 crc kubenswrapper[5120]: I0316 16:51:21.478311 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f7182274-f2a8-4ce4-9621-931b6c09d615-config-data\") pod \"nova-metadata-0\" (UID: \"f7182274-f2a8-4ce4-9621-931b6c09d615\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:51:21 crc kubenswrapper[5120]: I0316 16:51:21.478521 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wp597\" (UniqueName: \"kubernetes.io/projected/8a04cbe2-cde0-405c-820b-f2651d753654-kube-api-access-wp597\") pod \"nova-cell0-conductor-0\" (UID: \"8a04cbe2-cde0-405c-820b-f2651d753654\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:51:21 crc kubenswrapper[5120]: I0316 16:51:21.478679 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f7182274-f2a8-4ce4-9621-931b6c09d615-logs\") pod \"nova-metadata-0\" (UID: \"f7182274-f2a8-4ce4-9621-931b6c09d615\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:51:21 crc kubenswrapper[5120]: I0316 16:51:21.478756 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f7182274-f2a8-4ce4-9621-931b6c09d615-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"f7182274-f2a8-4ce4-9621-931b6c09d615\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:51:21 crc kubenswrapper[5120]: I0316 16:51:21.479336 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wvc5s\" (UniqueName: \"kubernetes.io/projected/f7182274-f2a8-4ce4-9621-931b6c09d615-kube-api-access-wvc5s\") pod \"nova-metadata-0\" (UID: \"f7182274-f2a8-4ce4-9621-931b6c09d615\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:51:21 crc kubenswrapper[5120]: I0316 16:51:21.480063 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f7182274-f2a8-4ce4-9621-931b6c09d615-logs\") pod \"nova-metadata-0\" (UID: \"f7182274-f2a8-4ce4-9621-931b6c09d615\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:51:21 crc kubenswrapper[5120]: I0316 16:51:21.482959 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8a04cbe2-cde0-405c-820b-f2651d753654-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"8a04cbe2-cde0-405c-820b-f2651d753654\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:51:21 crc kubenswrapper[5120]: I0316 16:51:21.483506 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/f7182274-f2a8-4ce4-9621-931b6c09d615-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"f7182274-f2a8-4ce4-9621-931b6c09d615\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:51:21 crc kubenswrapper[5120]: I0316 16:51:21.483595 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f7182274-f2a8-4ce4-9621-931b6c09d615-config-data\") pod \"nova-metadata-0\" (UID: \"f7182274-f2a8-4ce4-9621-931b6c09d615\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:51:21 crc kubenswrapper[5120]: I0316 16:51:21.491385 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f7182274-f2a8-4ce4-9621-931b6c09d615-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"f7182274-f2a8-4ce4-9621-931b6c09d615\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:51:21 crc kubenswrapper[5120]: I0316 16:51:21.492093 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8a04cbe2-cde0-405c-820b-f2651d753654-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"8a04cbe2-cde0-405c-820b-f2651d753654\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:51:21 crc kubenswrapper[5120]: I0316 16:51:21.497168 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wp597\" (UniqueName: \"kubernetes.io/projected/8a04cbe2-cde0-405c-820b-f2651d753654-kube-api-access-wp597\") pod \"nova-cell0-conductor-0\" (UID: \"8a04cbe2-cde0-405c-820b-f2651d753654\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:51:21 crc kubenswrapper[5120]: I0316 16:51:21.498883 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvc5s\" (UniqueName: \"kubernetes.io/projected/f7182274-f2a8-4ce4-9621-931b6c09d615-kube-api-access-wvc5s\") pod \"nova-metadata-0\" (UID: \"f7182274-f2a8-4ce4-9621-931b6c09d615\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:51:21 crc kubenswrapper[5120]: I0316 16:51:21.607222 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:51:21 crc kubenswrapper[5120]: I0316 16:51:21.657837 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:51:21 crc kubenswrapper[5120]: W0316 16:51:21.954682 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8a04cbe2_cde0_405c_820b_f2651d753654.slice/crio-4466816f22da7e60b0e19c145c0ca5171adcdb32dd9fd2fa983a1c4b48a045fb WatchSource:0}: Error finding container 4466816f22da7e60b0e19c145c0ca5171adcdb32dd9fd2fa983a1c4b48a045fb: Status 404 returned error can't find the container with id 4466816f22da7e60b0e19c145c0ca5171adcdb32dd9fd2fa983a1c4b48a045fb Mar 16 16:51:21 crc kubenswrapper[5120]: I0316 16:51:21.959348 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:51:22 crc kubenswrapper[5120]: I0316 16:51:22.007770 5120 patch_prober.go:28] interesting pod/machine-config-daemon-7bf76 container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 16:51:22 crc kubenswrapper[5120]: I0316 16:51:22.007834 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 16:51:22 crc kubenswrapper[5120]: I0316 16:51:22.008676 5120 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" Mar 16 16:51:22 crc kubenswrapper[5120]: I0316 16:51:22.009438 5120 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="machine-config-daemon" containerStatusID={"Type":"cri-o","ID":"d95ef19660110ac1115024184453586b03ae38594893e63ab9da89b1f1382ac4"} pod="openshift-machine-config-operator/machine-config-daemon-7bf76" containerMessage="Container machine-config-daemon failed liveness probe, will be restarted" Mar 16 16:51:22 crc kubenswrapper[5120]: I0316 16:51:22.009799 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" containerID="cri-o://d95ef19660110ac1115024184453586b03ae38594893e63ab9da89b1f1382ac4" gracePeriod=600 Mar 16 16:51:22 crc kubenswrapper[5120]: I0316 16:51:22.211567 5120 generic.go:358] "Generic (PLEG): container finished" podID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerID="d95ef19660110ac1115024184453586b03ae38594893e63ab9da89b1f1382ac4" exitCode=0 Mar 16 16:51:22 crc kubenswrapper[5120]: I0316 16:51:22.211727 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" event={"ID":"e2275cb4-4905-4d66-a87e-8010120db2bd","Type":"ContainerDied","Data":"d95ef19660110ac1115024184453586b03ae38594893e63ab9da89b1f1382ac4"} Mar 16 16:51:22 crc kubenswrapper[5120]: I0316 16:51:22.211785 5120 scope.go:117] "RemoveContainer" containerID="35a7dd6e19084cee69ca16203bca6378ea0cdf6a685ca2093ab847e5904eb9e6" Mar 16 16:51:22 crc kubenswrapper[5120]: I0316 16:51:22.213684 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"8a04cbe2-cde0-405c-820b-f2651d753654","Type":"ContainerStarted","Data":"0b2132e2ff271b061aeedada07b1b4b7222370b28d5b9e6d518cdc82cd879170"} Mar 16 16:51:22 crc kubenswrapper[5120]: I0316 16:51:22.213710 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"8a04cbe2-cde0-405c-820b-f2651d753654","Type":"ContainerStarted","Data":"4466816f22da7e60b0e19c145c0ca5171adcdb32dd9fd2fa983a1c4b48a045fb"} Mar 16 16:51:22 crc kubenswrapper[5120]: I0316 16:51:22.214002 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:51:22 crc kubenswrapper[5120]: I0316 16:51:22.214107 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:51:22 crc kubenswrapper[5120]: I0316 16:51:22.246901 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podStartSLOduration=1.246878348 podStartE2EDuration="1.246878348s" podCreationTimestamp="2026-03-16 16:51:21 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:51:22.236908034 +0000 UTC m=+4784.390839691" watchObservedRunningTime="2026-03-16 16:51:22.246878348 +0000 UTC m=+4784.400810005" Mar 16 16:51:22 crc kubenswrapper[5120]: I0316 16:51:22.677024 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="01f62262-5954-44de-80cb-c1cf1c179a0f" path="/var/lib/kubelet/pods/01f62262-5954-44de-80cb-c1cf1c179a0f/volumes" Mar 16 16:51:22 crc kubenswrapper[5120]: I0316 16:51:22.678189 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fca63e3b-929a-4864-b234-3dcb19a31da8" path="/var/lib/kubelet/pods/fca63e3b-929a-4864-b234-3dcb19a31da8/volumes" Mar 16 16:51:23 crc kubenswrapper[5120]: I0316 16:51:23.231657 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" event={"ID":"e2275cb4-4905-4d66-a87e-8010120db2bd","Type":"ContainerStarted","Data":"083f72646c8d47c9c0467b39be99ddfa9c2e5900ae0a29ad53d7b39b950274b4"} Mar 16 16:51:23 crc kubenswrapper[5120]: I0316 16:51:23.236885 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"f7182274-f2a8-4ce4-9621-931b6c09d615","Type":"ContainerStarted","Data":"10428364ceda5da532b5ba48b76f9f11d92d824c7767697d56f8dddfe2c930d4"} Mar 16 16:51:23 crc kubenswrapper[5120]: I0316 16:51:23.237072 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"f7182274-f2a8-4ce4-9621-931b6c09d615","Type":"ContainerStarted","Data":"0707a388241d46300b7c4e0847dc358237e3d49226246bb50df0de188916930b"} Mar 16 16:51:23 crc kubenswrapper[5120]: I0316 16:51:23.237151 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"f7182274-f2a8-4ce4-9621-931b6c09d615","Type":"ContainerStarted","Data":"ebc77c1f271dc75e828fe12ed1657234ead0ee6d898cb4b4320b7e218144db89"} Mar 16 16:51:23 crc kubenswrapper[5120]: I0316 16:51:23.274065 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=2.2740486779999998 podStartE2EDuration="2.274048678s" podCreationTimestamp="2026-03-16 16:51:21 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:51:23.271407396 +0000 UTC m=+4785.425339053" watchObservedRunningTime="2026-03-16 16:51:23.274048678 +0000 UTC m=+4785.427980335" Mar 16 16:51:23 crc kubenswrapper[5120]: I0316 16:51:23.540680 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:51:23 crc kubenswrapper[5120]: I0316 16:51:23.574543 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:51:27 crc kubenswrapper[5120]: I0316 16:51:27.246981 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:51:28 crc kubenswrapper[5120]: I0316 16:51:28.273113 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:51:28 crc kubenswrapper[5120]: I0316 16:51:28.540465 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:51:28 crc kubenswrapper[5120]: I0316 16:51:28.571177 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:51:28 crc kubenswrapper[5120]: I0316 16:51:28.574197 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:51:28 crc kubenswrapper[5120]: I0316 16:51:28.593858 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:51:29 crc kubenswrapper[5120]: I0316 16:51:29.321686 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:51:29 crc kubenswrapper[5120]: I0316 16:51:29.330371 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:51:29 crc kubenswrapper[5120]: I0316 16:51:29.696344 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-dv2s7"] Mar 16 16:51:29 crc kubenswrapper[5120]: I0316 16:51:29.701692 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-dv2s7" Mar 16 16:51:29 crc kubenswrapper[5120]: I0316 16:51:29.703830 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-manage-config-data\"" Mar 16 16:51:29 crc kubenswrapper[5120]: I0316 16:51:29.740086 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-manage-scripts\"" Mar 16 16:51:29 crc kubenswrapper[5120]: I0316 16:51:29.749050 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-dv2s7"] Mar 16 16:51:29 crc kubenswrapper[5120]: I0316 16:51:29.771640 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:51:29 crc kubenswrapper[5120]: I0316 16:51:29.771918 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="6ca84af3-af8c-4723-8898-0b8335f784a5" containerName="nova-api-log" containerID="cri-o://6f77904ebe2f2cd80ae43eb269a40f4091aad970e3d39b702938036b8cf6be60" gracePeriod=30 Mar 16 16:51:29 crc kubenswrapper[5120]: I0316 16:51:29.771985 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="6ca84af3-af8c-4723-8898-0b8335f784a5" containerName="nova-api-api" containerID="cri-o://3d396f592ed4c8b66577fab0f92ffa65d7dfb3d04444e3bc76a8f6017ce657b6" gracePeriod=30 Mar 16 16:51:29 crc kubenswrapper[5120]: I0316 16:51:29.796222 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/13be48e8-1309-42ee-89fb-67d9cf4543aa-scripts\") pod \"nova-cell1-cell-mapping-dv2s7\" (UID: \"13be48e8-1309-42ee-89fb-67d9cf4543aa\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-dv2s7" Mar 16 16:51:29 crc kubenswrapper[5120]: I0316 16:51:29.796312 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44mf9\" (UniqueName: \"kubernetes.io/projected/13be48e8-1309-42ee-89fb-67d9cf4543aa-kube-api-access-44mf9\") pod \"nova-cell1-cell-mapping-dv2s7\" (UID: \"13be48e8-1309-42ee-89fb-67d9cf4543aa\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-dv2s7" Mar 16 16:51:29 crc kubenswrapper[5120]: I0316 16:51:29.796383 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/13be48e8-1309-42ee-89fb-67d9cf4543aa-combined-ca-bundle\") pod \"nova-cell1-cell-mapping-dv2s7\" (UID: \"13be48e8-1309-42ee-89fb-67d9cf4543aa\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-dv2s7" Mar 16 16:51:29 crc kubenswrapper[5120]: I0316 16:51:29.796541 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/13be48e8-1309-42ee-89fb-67d9cf4543aa-config-data\") pod \"nova-cell1-cell-mapping-dv2s7\" (UID: \"13be48e8-1309-42ee-89fb-67d9cf4543aa\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-dv2s7" Mar 16 16:51:29 crc kubenswrapper[5120]: I0316 16:51:29.801587 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:51:29 crc kubenswrapper[5120]: I0316 16:51:29.801839 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="f7182274-f2a8-4ce4-9621-931b6c09d615" containerName="nova-metadata-log" containerID="cri-o://0707a388241d46300b7c4e0847dc358237e3d49226246bb50df0de188916930b" gracePeriod=30 Mar 16 16:51:29 crc kubenswrapper[5120]: I0316 16:51:29.802693 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="f7182274-f2a8-4ce4-9621-931b6c09d615" containerName="nova-metadata-metadata" containerID="cri-o://10428364ceda5da532b5ba48b76f9f11d92d824c7767697d56f8dddfe2c930d4" gracePeriod=30 Mar 16 16:51:29 crc kubenswrapper[5120]: I0316 16:51:29.902528 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/13be48e8-1309-42ee-89fb-67d9cf4543aa-config-data\") pod \"nova-cell1-cell-mapping-dv2s7\" (UID: \"13be48e8-1309-42ee-89fb-67d9cf4543aa\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-dv2s7" Mar 16 16:51:29 crc kubenswrapper[5120]: I0316 16:51:29.902909 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/13be48e8-1309-42ee-89fb-67d9cf4543aa-scripts\") pod \"nova-cell1-cell-mapping-dv2s7\" (UID: \"13be48e8-1309-42ee-89fb-67d9cf4543aa\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-dv2s7" Mar 16 16:51:29 crc kubenswrapper[5120]: I0316 16:51:29.902994 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-44mf9\" (UniqueName: \"kubernetes.io/projected/13be48e8-1309-42ee-89fb-67d9cf4543aa-kube-api-access-44mf9\") pod \"nova-cell1-cell-mapping-dv2s7\" (UID: \"13be48e8-1309-42ee-89fb-67d9cf4543aa\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-dv2s7" Mar 16 16:51:29 crc kubenswrapper[5120]: I0316 16:51:29.903030 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/13be48e8-1309-42ee-89fb-67d9cf4543aa-combined-ca-bundle\") pod \"nova-cell1-cell-mapping-dv2s7\" (UID: \"13be48e8-1309-42ee-89fb-67d9cf4543aa\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-dv2s7" Mar 16 16:51:29 crc kubenswrapper[5120]: I0316 16:51:29.911440 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/13be48e8-1309-42ee-89fb-67d9cf4543aa-scripts\") pod \"nova-cell1-cell-mapping-dv2s7\" (UID: \"13be48e8-1309-42ee-89fb-67d9cf4543aa\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-dv2s7" Mar 16 16:51:29 crc kubenswrapper[5120]: I0316 16:51:29.911627 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/13be48e8-1309-42ee-89fb-67d9cf4543aa-combined-ca-bundle\") pod \"nova-cell1-cell-mapping-dv2s7\" (UID: \"13be48e8-1309-42ee-89fb-67d9cf4543aa\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-dv2s7" Mar 16 16:51:29 crc kubenswrapper[5120]: I0316 16:51:29.912026 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/13be48e8-1309-42ee-89fb-67d9cf4543aa-config-data\") pod \"nova-cell1-cell-mapping-dv2s7\" (UID: \"13be48e8-1309-42ee-89fb-67d9cf4543aa\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-dv2s7" Mar 16 16:51:29 crc kubenswrapper[5120]: I0316 16:51:29.923665 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-44mf9\" (UniqueName: \"kubernetes.io/projected/13be48e8-1309-42ee-89fb-67d9cf4543aa-kube-api-access-44mf9\") pod \"nova-cell1-cell-mapping-dv2s7\" (UID: \"13be48e8-1309-42ee-89fb-67d9cf4543aa\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-dv2s7" Mar 16 16:51:30 crc kubenswrapper[5120]: I0316 16:51:30.055116 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-dv2s7" Mar 16 16:51:30 crc kubenswrapper[5120]: I0316 16:51:30.318133 5120 generic.go:358] "Generic (PLEG): container finished" podID="6ca84af3-af8c-4723-8898-0b8335f784a5" containerID="6f77904ebe2f2cd80ae43eb269a40f4091aad970e3d39b702938036b8cf6be60" exitCode=143 Mar 16 16:51:30 crc kubenswrapper[5120]: I0316 16:51:30.318321 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"6ca84af3-af8c-4723-8898-0b8335f784a5","Type":"ContainerDied","Data":"6f77904ebe2f2cd80ae43eb269a40f4091aad970e3d39b702938036b8cf6be60"} Mar 16 16:51:30 crc kubenswrapper[5120]: I0316 16:51:30.319050 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:51:30 crc kubenswrapper[5120]: I0316 16:51:30.321520 5120 generic.go:358] "Generic (PLEG): container finished" podID="f7182274-f2a8-4ce4-9621-931b6c09d615" containerID="10428364ceda5da532b5ba48b76f9f11d92d824c7767697d56f8dddfe2c930d4" exitCode=0 Mar 16 16:51:30 crc kubenswrapper[5120]: I0316 16:51:30.321544 5120 generic.go:358] "Generic (PLEG): container finished" podID="f7182274-f2a8-4ce4-9621-931b6c09d615" containerID="0707a388241d46300b7c4e0847dc358237e3d49226246bb50df0de188916930b" exitCode=143 Mar 16 16:51:30 crc kubenswrapper[5120]: I0316 16:51:30.321628 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"f7182274-f2a8-4ce4-9621-931b6c09d615","Type":"ContainerDied","Data":"10428364ceda5da532b5ba48b76f9f11d92d824c7767697d56f8dddfe2c930d4"} Mar 16 16:51:30 crc kubenswrapper[5120]: I0316 16:51:30.321700 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"f7182274-f2a8-4ce4-9621-931b6c09d615","Type":"ContainerDied","Data":"0707a388241d46300b7c4e0847dc358237e3d49226246bb50df0de188916930b"} Mar 16 16:51:30 crc kubenswrapper[5120]: I0316 16:51:30.321711 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"f7182274-f2a8-4ce4-9621-931b6c09d615","Type":"ContainerDied","Data":"ebc77c1f271dc75e828fe12ed1657234ead0ee6d898cb4b4320b7e218144db89"} Mar 16 16:51:30 crc kubenswrapper[5120]: I0316 16:51:30.321729 5120 scope.go:117] "RemoveContainer" containerID="10428364ceda5da532b5ba48b76f9f11d92d824c7767697d56f8dddfe2c930d4" Mar 16 16:51:30 crc kubenswrapper[5120]: I0316 16:51:30.357538 5120 scope.go:117] "RemoveContainer" containerID="0707a388241d46300b7c4e0847dc358237e3d49226246bb50df0de188916930b" Mar 16 16:51:30 crc kubenswrapper[5120]: I0316 16:51:30.378129 5120 scope.go:117] "RemoveContainer" containerID="10428364ceda5da532b5ba48b76f9f11d92d824c7767697d56f8dddfe2c930d4" Mar 16 16:51:30 crc kubenswrapper[5120]: E0316 16:51:30.378632 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"10428364ceda5da532b5ba48b76f9f11d92d824c7767697d56f8dddfe2c930d4\": container with ID starting with 10428364ceda5da532b5ba48b76f9f11d92d824c7767697d56f8dddfe2c930d4 not found: ID does not exist" containerID="10428364ceda5da532b5ba48b76f9f11d92d824c7767697d56f8dddfe2c930d4" Mar 16 16:51:30 crc kubenswrapper[5120]: I0316 16:51:30.378691 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10428364ceda5da532b5ba48b76f9f11d92d824c7767697d56f8dddfe2c930d4"} err="failed to get container status \"10428364ceda5da532b5ba48b76f9f11d92d824c7767697d56f8dddfe2c930d4\": rpc error: code = NotFound desc = could not find container \"10428364ceda5da532b5ba48b76f9f11d92d824c7767697d56f8dddfe2c930d4\": container with ID starting with 10428364ceda5da532b5ba48b76f9f11d92d824c7767697d56f8dddfe2c930d4 not found: ID does not exist" Mar 16 16:51:30 crc kubenswrapper[5120]: I0316 16:51:30.378718 5120 scope.go:117] "RemoveContainer" containerID="0707a388241d46300b7c4e0847dc358237e3d49226246bb50df0de188916930b" Mar 16 16:51:30 crc kubenswrapper[5120]: E0316 16:51:30.379163 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0707a388241d46300b7c4e0847dc358237e3d49226246bb50df0de188916930b\": container with ID starting with 0707a388241d46300b7c4e0847dc358237e3d49226246bb50df0de188916930b not found: ID does not exist" containerID="0707a388241d46300b7c4e0847dc358237e3d49226246bb50df0de188916930b" Mar 16 16:51:30 crc kubenswrapper[5120]: I0316 16:51:30.379227 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0707a388241d46300b7c4e0847dc358237e3d49226246bb50df0de188916930b"} err="failed to get container status \"0707a388241d46300b7c4e0847dc358237e3d49226246bb50df0de188916930b\": rpc error: code = NotFound desc = could not find container \"0707a388241d46300b7c4e0847dc358237e3d49226246bb50df0de188916930b\": container with ID starting with 0707a388241d46300b7c4e0847dc358237e3d49226246bb50df0de188916930b not found: ID does not exist" Mar 16 16:51:30 crc kubenswrapper[5120]: I0316 16:51:30.379247 5120 scope.go:117] "RemoveContainer" containerID="10428364ceda5da532b5ba48b76f9f11d92d824c7767697d56f8dddfe2c930d4" Mar 16 16:51:30 crc kubenswrapper[5120]: I0316 16:51:30.379579 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10428364ceda5da532b5ba48b76f9f11d92d824c7767697d56f8dddfe2c930d4"} err="failed to get container status \"10428364ceda5da532b5ba48b76f9f11d92d824c7767697d56f8dddfe2c930d4\": rpc error: code = NotFound desc = could not find container \"10428364ceda5da532b5ba48b76f9f11d92d824c7767697d56f8dddfe2c930d4\": container with ID starting with 10428364ceda5da532b5ba48b76f9f11d92d824c7767697d56f8dddfe2c930d4 not found: ID does not exist" Mar 16 16:51:30 crc kubenswrapper[5120]: I0316 16:51:30.379601 5120 scope.go:117] "RemoveContainer" containerID="0707a388241d46300b7c4e0847dc358237e3d49226246bb50df0de188916930b" Mar 16 16:51:30 crc kubenswrapper[5120]: I0316 16:51:30.379934 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0707a388241d46300b7c4e0847dc358237e3d49226246bb50df0de188916930b"} err="failed to get container status \"0707a388241d46300b7c4e0847dc358237e3d49226246bb50df0de188916930b\": rpc error: code = NotFound desc = could not find container \"0707a388241d46300b7c4e0847dc358237e3d49226246bb50df0de188916930b\": container with ID starting with 0707a388241d46300b7c4e0847dc358237e3d49226246bb50df0de188916930b not found: ID does not exist" Mar 16 16:51:30 crc kubenswrapper[5120]: I0316 16:51:30.417910 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f7182274-f2a8-4ce4-9621-931b6c09d615-combined-ca-bundle\") pod \"f7182274-f2a8-4ce4-9621-931b6c09d615\" (UID: \"f7182274-f2a8-4ce4-9621-931b6c09d615\") " Mar 16 16:51:30 crc kubenswrapper[5120]: I0316 16:51:30.418038 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wvc5s\" (UniqueName: \"kubernetes.io/projected/f7182274-f2a8-4ce4-9621-931b6c09d615-kube-api-access-wvc5s\") pod \"f7182274-f2a8-4ce4-9621-931b6c09d615\" (UID: \"f7182274-f2a8-4ce4-9621-931b6c09d615\") " Mar 16 16:51:30 crc kubenswrapper[5120]: I0316 16:51:30.418305 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f7182274-f2a8-4ce4-9621-931b6c09d615-config-data\") pod \"f7182274-f2a8-4ce4-9621-931b6c09d615\" (UID: \"f7182274-f2a8-4ce4-9621-931b6c09d615\") " Mar 16 16:51:30 crc kubenswrapper[5120]: I0316 16:51:30.419243 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/f7182274-f2a8-4ce4-9621-931b6c09d615-nova-metadata-tls-certs\") pod \"f7182274-f2a8-4ce4-9621-931b6c09d615\" (UID: \"f7182274-f2a8-4ce4-9621-931b6c09d615\") " Mar 16 16:51:30 crc kubenswrapper[5120]: I0316 16:51:30.419508 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f7182274-f2a8-4ce4-9621-931b6c09d615-logs\") pod \"f7182274-f2a8-4ce4-9621-931b6c09d615\" (UID: \"f7182274-f2a8-4ce4-9621-931b6c09d615\") " Mar 16 16:51:30 crc kubenswrapper[5120]: I0316 16:51:30.419863 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7182274-f2a8-4ce4-9621-931b6c09d615-logs" (OuterVolumeSpecName: "logs") pod "f7182274-f2a8-4ce4-9621-931b6c09d615" (UID: "f7182274-f2a8-4ce4-9621-931b6c09d615"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:51:30 crc kubenswrapper[5120]: I0316 16:51:30.422211 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f7182274-f2a8-4ce4-9621-931b6c09d615-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:51:30 crc kubenswrapper[5120]: I0316 16:51:30.424070 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7182274-f2a8-4ce4-9621-931b6c09d615-kube-api-access-wvc5s" (OuterVolumeSpecName: "kube-api-access-wvc5s") pod "f7182274-f2a8-4ce4-9621-931b6c09d615" (UID: "f7182274-f2a8-4ce4-9621-931b6c09d615"). InnerVolumeSpecName "kube-api-access-wvc5s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:51:30 crc kubenswrapper[5120]: I0316 16:51:30.446277 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f7182274-f2a8-4ce4-9621-931b6c09d615-config-data" (OuterVolumeSpecName: "config-data") pod "f7182274-f2a8-4ce4-9621-931b6c09d615" (UID: "f7182274-f2a8-4ce4-9621-931b6c09d615"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:51:30 crc kubenswrapper[5120]: I0316 16:51:30.451334 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f7182274-f2a8-4ce4-9621-931b6c09d615-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f7182274-f2a8-4ce4-9621-931b6c09d615" (UID: "f7182274-f2a8-4ce4-9621-931b6c09d615"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:51:30 crc kubenswrapper[5120]: I0316 16:51:30.474645 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f7182274-f2a8-4ce4-9621-931b6c09d615-nova-metadata-tls-certs" (OuterVolumeSpecName: "nova-metadata-tls-certs") pod "f7182274-f2a8-4ce4-9621-931b6c09d615" (UID: "f7182274-f2a8-4ce4-9621-931b6c09d615"). InnerVolumeSpecName "nova-metadata-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:51:30 crc kubenswrapper[5120]: I0316 16:51:30.527675 5120 reconciler_common.go:299] "Volume detached for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/f7182274-f2a8-4ce4-9621-931b6c09d615-nova-metadata-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:51:30 crc kubenswrapper[5120]: I0316 16:51:30.527706 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f7182274-f2a8-4ce4-9621-931b6c09d615-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:51:30 crc kubenswrapper[5120]: I0316 16:51:30.527716 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wvc5s\" (UniqueName: \"kubernetes.io/projected/f7182274-f2a8-4ce4-9621-931b6c09d615-kube-api-access-wvc5s\") on node \"crc\" DevicePath \"\"" Mar 16 16:51:30 crc kubenswrapper[5120]: I0316 16:51:30.527725 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f7182274-f2a8-4ce4-9621-931b6c09d615-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:51:30 crc kubenswrapper[5120]: I0316 16:51:30.538564 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-dv2s7"] Mar 16 16:51:30 crc kubenswrapper[5120]: W0316 16:51:30.539284 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod13be48e8_1309_42ee_89fb_67d9cf4543aa.slice/crio-4ac21efc3894357ecf02af88eeae5b12d8b832b4fe5c33eebf5c7dc8a68b6ba3 WatchSource:0}: Error finding container 4ac21efc3894357ecf02af88eeae5b12d8b832b4fe5c33eebf5c7dc8a68b6ba3: Status 404 returned error can't find the container with id 4ac21efc3894357ecf02af88eeae5b12d8b832b4fe5c33eebf5c7dc8a68b6ba3 Mar 16 16:51:31 crc kubenswrapper[5120]: I0316 16:51:31.333318 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:51:31 crc kubenswrapper[5120]: I0316 16:51:31.336473 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-dv2s7" event={"ID":"13be48e8-1309-42ee-89fb-67d9cf4543aa","Type":"ContainerStarted","Data":"7bc686e799420528fff50623d35b3694e51b9c28e0c49dd111e1d529654399c2"} Mar 16 16:51:31 crc kubenswrapper[5120]: I0316 16:51:31.336660 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-dv2s7" event={"ID":"13be48e8-1309-42ee-89fb-67d9cf4543aa","Type":"ContainerStarted","Data":"4ac21efc3894357ecf02af88eeae5b12d8b832b4fe5c33eebf5c7dc8a68b6ba3"} Mar 16 16:51:31 crc kubenswrapper[5120]: I0316 16:51:31.367176 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:51:31 crc kubenswrapper[5120]: I0316 16:51:31.379638 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:51:31 crc kubenswrapper[5120]: I0316 16:51:31.385730 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-dv2s7" podStartSLOduration=2.385704929 podStartE2EDuration="2.385704929s" podCreationTimestamp="2026-03-16 16:51:29 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:51:31.376646191 +0000 UTC m=+4793.530577848" watchObservedRunningTime="2026-03-16 16:51:31.385704929 +0000 UTC m=+4793.539636586" Mar 16 16:51:31 crc kubenswrapper[5120]: I0316 16:51:31.408414 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:51:31 crc kubenswrapper[5120]: I0316 16:51:31.409842 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7182274-f2a8-4ce4-9621-931b6c09d615" containerName="nova-metadata-metadata" Mar 16 16:51:31 crc kubenswrapper[5120]: I0316 16:51:31.409868 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7182274-f2a8-4ce4-9621-931b6c09d615" containerName="nova-metadata-metadata" Mar 16 16:51:31 crc kubenswrapper[5120]: I0316 16:51:31.409889 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7182274-f2a8-4ce4-9621-931b6c09d615" containerName="nova-metadata-log" Mar 16 16:51:31 crc kubenswrapper[5120]: I0316 16:51:31.409899 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7182274-f2a8-4ce4-9621-931b6c09d615" containerName="nova-metadata-log" Mar 16 16:51:31 crc kubenswrapper[5120]: I0316 16:51:31.410149 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f7182274-f2a8-4ce4-9621-931b6c09d615" containerName="nova-metadata-log" Mar 16 16:51:31 crc kubenswrapper[5120]: I0316 16:51:31.410196 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f7182274-f2a8-4ce4-9621-931b6c09d615" containerName="nova-metadata-metadata" Mar 16 16:51:31 crc kubenswrapper[5120]: I0316 16:51:31.417809 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:51:31 crc kubenswrapper[5120]: I0316 16:51:31.419862 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:51:31 crc kubenswrapper[5120]: I0316 16:51:31.422843 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-metadata-config-data\"" Mar 16 16:51:31 crc kubenswrapper[5120]: I0316 16:51:31.423799 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-metadata-internal-svc\"" Mar 16 16:51:31 crc kubenswrapper[5120]: I0316 16:51:31.553473 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/7dbe7cf5-e8a9-4037-85a4-3d1037495e0a-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"7dbe7cf5-e8a9-4037-85a4-3d1037495e0a\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:51:31 crc kubenswrapper[5120]: I0316 16:51:31.553535 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7dbe7cf5-e8a9-4037-85a4-3d1037495e0a-logs\") pod \"nova-metadata-0\" (UID: \"7dbe7cf5-e8a9-4037-85a4-3d1037495e0a\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:51:31 crc kubenswrapper[5120]: I0316 16:51:31.553616 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4fp6\" (UniqueName: \"kubernetes.io/projected/7dbe7cf5-e8a9-4037-85a4-3d1037495e0a-kube-api-access-t4fp6\") pod \"nova-metadata-0\" (UID: \"7dbe7cf5-e8a9-4037-85a4-3d1037495e0a\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:51:31 crc kubenswrapper[5120]: I0316 16:51:31.553794 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7dbe7cf5-e8a9-4037-85a4-3d1037495e0a-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"7dbe7cf5-e8a9-4037-85a4-3d1037495e0a\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:51:31 crc kubenswrapper[5120]: I0316 16:51:31.553893 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7dbe7cf5-e8a9-4037-85a4-3d1037495e0a-config-data\") pod \"nova-metadata-0\" (UID: \"7dbe7cf5-e8a9-4037-85a4-3d1037495e0a\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:51:31 crc kubenswrapper[5120]: I0316 16:51:31.656381 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7dbe7cf5-e8a9-4037-85a4-3d1037495e0a-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"7dbe7cf5-e8a9-4037-85a4-3d1037495e0a\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:51:31 crc kubenswrapper[5120]: I0316 16:51:31.656526 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7dbe7cf5-e8a9-4037-85a4-3d1037495e0a-config-data\") pod \"nova-metadata-0\" (UID: \"7dbe7cf5-e8a9-4037-85a4-3d1037495e0a\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:51:31 crc kubenswrapper[5120]: I0316 16:51:31.656678 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/7dbe7cf5-e8a9-4037-85a4-3d1037495e0a-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"7dbe7cf5-e8a9-4037-85a4-3d1037495e0a\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:51:31 crc kubenswrapper[5120]: I0316 16:51:31.656702 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7dbe7cf5-e8a9-4037-85a4-3d1037495e0a-logs\") pod \"nova-metadata-0\" (UID: \"7dbe7cf5-e8a9-4037-85a4-3d1037495e0a\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:51:31 crc kubenswrapper[5120]: I0316 16:51:31.657161 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t4fp6\" (UniqueName: \"kubernetes.io/projected/7dbe7cf5-e8a9-4037-85a4-3d1037495e0a-kube-api-access-t4fp6\") pod \"nova-metadata-0\" (UID: \"7dbe7cf5-e8a9-4037-85a4-3d1037495e0a\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:51:31 crc kubenswrapper[5120]: I0316 16:51:31.657239 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7dbe7cf5-e8a9-4037-85a4-3d1037495e0a-logs\") pod \"nova-metadata-0\" (UID: \"7dbe7cf5-e8a9-4037-85a4-3d1037495e0a\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:51:31 crc kubenswrapper[5120]: I0316 16:51:31.681605 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/7dbe7cf5-e8a9-4037-85a4-3d1037495e0a-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"7dbe7cf5-e8a9-4037-85a4-3d1037495e0a\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:51:31 crc kubenswrapper[5120]: I0316 16:51:31.681882 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7dbe7cf5-e8a9-4037-85a4-3d1037495e0a-config-data\") pod \"nova-metadata-0\" (UID: \"7dbe7cf5-e8a9-4037-85a4-3d1037495e0a\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:51:31 crc kubenswrapper[5120]: I0316 16:51:31.682118 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7dbe7cf5-e8a9-4037-85a4-3d1037495e0a-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"7dbe7cf5-e8a9-4037-85a4-3d1037495e0a\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:51:31 crc kubenswrapper[5120]: I0316 16:51:31.684175 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4fp6\" (UniqueName: \"kubernetes.io/projected/7dbe7cf5-e8a9-4037-85a4-3d1037495e0a-kube-api-access-t4fp6\") pod \"nova-metadata-0\" (UID: \"7dbe7cf5-e8a9-4037-85a4-3d1037495e0a\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:51:31 crc kubenswrapper[5120]: I0316 16:51:31.744875 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:51:32 crc kubenswrapper[5120]: I0316 16:51:32.272588 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:51:32 crc kubenswrapper[5120]: W0316 16:51:32.279029 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7dbe7cf5_e8a9_4037_85a4_3d1037495e0a.slice/crio-528c833c9f9bac17131437099cf9b56b57dbef4a50451768c548cc8419103acf WatchSource:0}: Error finding container 528c833c9f9bac17131437099cf9b56b57dbef4a50451768c548cc8419103acf: Status 404 returned error can't find the container with id 528c833c9f9bac17131437099cf9b56b57dbef4a50451768c548cc8419103acf Mar 16 16:51:32 crc kubenswrapper[5120]: I0316 16:51:32.349414 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"7dbe7cf5-e8a9-4037-85a4-3d1037495e0a","Type":"ContainerStarted","Data":"528c833c9f9bac17131437099cf9b56b57dbef4a50451768c548cc8419103acf"} Mar 16 16:51:32 crc kubenswrapper[5120]: I0316 16:51:32.675719 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f7182274-f2a8-4ce4-9621-931b6c09d615" path="/var/lib/kubelet/pods/f7182274-f2a8-4ce4-9621-931b6c09d615/volumes" Mar 16 16:51:32 crc kubenswrapper[5120]: I0316 16:51:32.903945 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/nova-api-0" podUID="6ca84af3-af8c-4723-8898-0b8335f784a5" containerName="nova-api-api" probeResult="failure" output="Get \"https://10.217.0.104:8774/\": read tcp 10.217.0.2:43150->10.217.0.104:8774: read: connection reset by peer" Mar 16 16:51:32 crc kubenswrapper[5120]: I0316 16:51:32.904273 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/nova-api-0" podUID="6ca84af3-af8c-4723-8898-0b8335f784a5" containerName="nova-api-log" probeResult="failure" output="Get \"https://10.217.0.104:8774/\": read tcp 10.217.0.2:43162->10.217.0.104:8774: read: connection reset by peer" Mar 16 16:51:32 crc kubenswrapper[5120]: I0316 16:51:32.958314 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:51:32 crc kubenswrapper[5120]: I0316 16:51:32.958522 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="8de404c3-c457-4550-94a9-86d2d14103ee" containerName="nova-scheduler-scheduler" containerID="cri-o://aef63c7abec2124d66e4a26586c1f663a4990f4bd7b6b055ba532c7a3a159e97" gracePeriod=30 Mar 16 16:51:33 crc kubenswrapper[5120]: I0316 16:51:33.346940 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:51:33 crc kubenswrapper[5120]: I0316 16:51:33.386437 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"7dbe7cf5-e8a9-4037-85a4-3d1037495e0a","Type":"ContainerStarted","Data":"b3ccc2c042453043309ef00ac96a6eb5ad8715043dbaa8d8eab366f506834ea9"} Mar 16 16:51:33 crc kubenswrapper[5120]: I0316 16:51:33.386484 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"7dbe7cf5-e8a9-4037-85a4-3d1037495e0a","Type":"ContainerStarted","Data":"49b9e115a44d0f576eb25e240f36fe022686c248257bbb453d5431b615f39266"} Mar 16 16:51:33 crc kubenswrapper[5120]: I0316 16:51:33.404520 5120 generic.go:358] "Generic (PLEG): container finished" podID="6ca84af3-af8c-4723-8898-0b8335f784a5" containerID="3d396f592ed4c8b66577fab0f92ffa65d7dfb3d04444e3bc76a8f6017ce657b6" exitCode=0 Mar 16 16:51:33 crc kubenswrapper[5120]: I0316 16:51:33.404827 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"6ca84af3-af8c-4723-8898-0b8335f784a5","Type":"ContainerDied","Data":"3d396f592ed4c8b66577fab0f92ffa65d7dfb3d04444e3bc76a8f6017ce657b6"} Mar 16 16:51:33 crc kubenswrapper[5120]: I0316 16:51:33.404861 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"6ca84af3-af8c-4723-8898-0b8335f784a5","Type":"ContainerDied","Data":"fd88fdb175cf1cc36af140fd1d22a7611f1600555c7ab6c34e7cb4a8bbaf18c7"} Mar 16 16:51:33 crc kubenswrapper[5120]: I0316 16:51:33.404864 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:51:33 crc kubenswrapper[5120]: I0316 16:51:33.404900 5120 scope.go:117] "RemoveContainer" containerID="3d396f592ed4c8b66577fab0f92ffa65d7dfb3d04444e3bc76a8f6017ce657b6" Mar 16 16:51:33 crc kubenswrapper[5120]: I0316 16:51:33.413159 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=2.413144651 podStartE2EDuration="2.413144651s" podCreationTimestamp="2026-03-16 16:51:31 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:51:33.409967724 +0000 UTC m=+4795.563899391" watchObservedRunningTime="2026-03-16 16:51:33.413144651 +0000 UTC m=+4795.567076308" Mar 16 16:51:33 crc kubenswrapper[5120]: I0316 16:51:33.439281 5120 scope.go:117] "RemoveContainer" containerID="6f77904ebe2f2cd80ae43eb269a40f4091aad970e3d39b702938036b8cf6be60" Mar 16 16:51:33 crc kubenswrapper[5120]: I0316 16:51:33.465425 5120 scope.go:117] "RemoveContainer" containerID="3d396f592ed4c8b66577fab0f92ffa65d7dfb3d04444e3bc76a8f6017ce657b6" Mar 16 16:51:33 crc kubenswrapper[5120]: E0316 16:51:33.467119 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d396f592ed4c8b66577fab0f92ffa65d7dfb3d04444e3bc76a8f6017ce657b6\": container with ID starting with 3d396f592ed4c8b66577fab0f92ffa65d7dfb3d04444e3bc76a8f6017ce657b6 not found: ID does not exist" containerID="3d396f592ed4c8b66577fab0f92ffa65d7dfb3d04444e3bc76a8f6017ce657b6" Mar 16 16:51:33 crc kubenswrapper[5120]: I0316 16:51:33.467207 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d396f592ed4c8b66577fab0f92ffa65d7dfb3d04444e3bc76a8f6017ce657b6"} err="failed to get container status \"3d396f592ed4c8b66577fab0f92ffa65d7dfb3d04444e3bc76a8f6017ce657b6\": rpc error: code = NotFound desc = could not find container \"3d396f592ed4c8b66577fab0f92ffa65d7dfb3d04444e3bc76a8f6017ce657b6\": container with ID starting with 3d396f592ed4c8b66577fab0f92ffa65d7dfb3d04444e3bc76a8f6017ce657b6 not found: ID does not exist" Mar 16 16:51:33 crc kubenswrapper[5120]: I0316 16:51:33.467274 5120 scope.go:117] "RemoveContainer" containerID="6f77904ebe2f2cd80ae43eb269a40f4091aad970e3d39b702938036b8cf6be60" Mar 16 16:51:33 crc kubenswrapper[5120]: E0316 16:51:33.467957 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f77904ebe2f2cd80ae43eb269a40f4091aad970e3d39b702938036b8cf6be60\": container with ID starting with 6f77904ebe2f2cd80ae43eb269a40f4091aad970e3d39b702938036b8cf6be60 not found: ID does not exist" containerID="6f77904ebe2f2cd80ae43eb269a40f4091aad970e3d39b702938036b8cf6be60" Mar 16 16:51:33 crc kubenswrapper[5120]: I0316 16:51:33.468017 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f77904ebe2f2cd80ae43eb269a40f4091aad970e3d39b702938036b8cf6be60"} err="failed to get container status \"6f77904ebe2f2cd80ae43eb269a40f4091aad970e3d39b702938036b8cf6be60\": rpc error: code = NotFound desc = could not find container \"6f77904ebe2f2cd80ae43eb269a40f4091aad970e3d39b702938036b8cf6be60\": container with ID starting with 6f77904ebe2f2cd80ae43eb269a40f4091aad970e3d39b702938036b8cf6be60 not found: ID does not exist" Mar 16 16:51:33 crc kubenswrapper[5120]: I0316 16:51:33.505887 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6ca84af3-af8c-4723-8898-0b8335f784a5-logs\") pod \"6ca84af3-af8c-4723-8898-0b8335f784a5\" (UID: \"6ca84af3-af8c-4723-8898-0b8335f784a5\") " Mar 16 16:51:33 crc kubenswrapper[5120]: I0316 16:51:33.506045 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6ca84af3-af8c-4723-8898-0b8335f784a5-combined-ca-bundle\") pod \"6ca84af3-af8c-4723-8898-0b8335f784a5\" (UID: \"6ca84af3-af8c-4723-8898-0b8335f784a5\") " Mar 16 16:51:33 crc kubenswrapper[5120]: I0316 16:51:33.506158 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6ca84af3-af8c-4723-8898-0b8335f784a5-public-tls-certs\") pod \"6ca84af3-af8c-4723-8898-0b8335f784a5\" (UID: \"6ca84af3-af8c-4723-8898-0b8335f784a5\") " Mar 16 16:51:33 crc kubenswrapper[5120]: I0316 16:51:33.506267 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6ca84af3-af8c-4723-8898-0b8335f784a5-internal-tls-certs\") pod \"6ca84af3-af8c-4723-8898-0b8335f784a5\" (UID: \"6ca84af3-af8c-4723-8898-0b8335f784a5\") " Mar 16 16:51:33 crc kubenswrapper[5120]: I0316 16:51:33.506297 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-776rs\" (UniqueName: \"kubernetes.io/projected/6ca84af3-af8c-4723-8898-0b8335f784a5-kube-api-access-776rs\") pod \"6ca84af3-af8c-4723-8898-0b8335f784a5\" (UID: \"6ca84af3-af8c-4723-8898-0b8335f784a5\") " Mar 16 16:51:33 crc kubenswrapper[5120]: I0316 16:51:33.506388 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6ca84af3-af8c-4723-8898-0b8335f784a5-config-data\") pod \"6ca84af3-af8c-4723-8898-0b8335f784a5\" (UID: \"6ca84af3-af8c-4723-8898-0b8335f784a5\") " Mar 16 16:51:33 crc kubenswrapper[5120]: I0316 16:51:33.507298 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ca84af3-af8c-4723-8898-0b8335f784a5-logs" (OuterVolumeSpecName: "logs") pod "6ca84af3-af8c-4723-8898-0b8335f784a5" (UID: "6ca84af3-af8c-4723-8898-0b8335f784a5"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:51:33 crc kubenswrapper[5120]: I0316 16:51:33.508249 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6ca84af3-af8c-4723-8898-0b8335f784a5-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:51:33 crc kubenswrapper[5120]: I0316 16:51:33.513251 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ca84af3-af8c-4723-8898-0b8335f784a5-kube-api-access-776rs" (OuterVolumeSpecName: "kube-api-access-776rs") pod "6ca84af3-af8c-4723-8898-0b8335f784a5" (UID: "6ca84af3-af8c-4723-8898-0b8335f784a5"). InnerVolumeSpecName "kube-api-access-776rs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:51:33 crc kubenswrapper[5120]: I0316 16:51:33.542659 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ca84af3-af8c-4723-8898-0b8335f784a5-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "6ca84af3-af8c-4723-8898-0b8335f784a5" (UID: "6ca84af3-af8c-4723-8898-0b8335f784a5"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:51:33 crc kubenswrapper[5120]: I0316 16:51:33.555275 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ca84af3-af8c-4723-8898-0b8335f784a5-config-data" (OuterVolumeSpecName: "config-data") pod "6ca84af3-af8c-4723-8898-0b8335f784a5" (UID: "6ca84af3-af8c-4723-8898-0b8335f784a5"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:51:33 crc kubenswrapper[5120]: I0316 16:51:33.563656 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ca84af3-af8c-4723-8898-0b8335f784a5-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "6ca84af3-af8c-4723-8898-0b8335f784a5" (UID: "6ca84af3-af8c-4723-8898-0b8335f784a5"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:51:33 crc kubenswrapper[5120]: I0316 16:51:33.579826 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ca84af3-af8c-4723-8898-0b8335f784a5-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "6ca84af3-af8c-4723-8898-0b8335f784a5" (UID: "6ca84af3-af8c-4723-8898-0b8335f784a5"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:51:33 crc kubenswrapper[5120]: I0316 16:51:33.610326 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6ca84af3-af8c-4723-8898-0b8335f784a5-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:51:33 crc kubenswrapper[5120]: I0316 16:51:33.610365 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6ca84af3-af8c-4723-8898-0b8335f784a5-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:51:33 crc kubenswrapper[5120]: I0316 16:51:33.610374 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-776rs\" (UniqueName: \"kubernetes.io/projected/6ca84af3-af8c-4723-8898-0b8335f784a5-kube-api-access-776rs\") on node \"crc\" DevicePath \"\"" Mar 16 16:51:33 crc kubenswrapper[5120]: I0316 16:51:33.610386 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6ca84af3-af8c-4723-8898-0b8335f784a5-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:51:33 crc kubenswrapper[5120]: I0316 16:51:33.610394 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6ca84af3-af8c-4723-8898-0b8335f784a5-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:51:33 crc kubenswrapper[5120]: I0316 16:51:33.778997 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:51:33 crc kubenswrapper[5120]: I0316 16:51:33.796253 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:51:33 crc kubenswrapper[5120]: I0316 16:51:33.832498 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:51:33 crc kubenswrapper[5120]: I0316 16:51:33.833937 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ca84af3-af8c-4723-8898-0b8335f784a5" containerName="nova-api-log" Mar 16 16:51:33 crc kubenswrapper[5120]: I0316 16:51:33.833958 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ca84af3-af8c-4723-8898-0b8335f784a5" containerName="nova-api-log" Mar 16 16:51:33 crc kubenswrapper[5120]: I0316 16:51:33.834044 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ca84af3-af8c-4723-8898-0b8335f784a5" containerName="nova-api-api" Mar 16 16:51:33 crc kubenswrapper[5120]: I0316 16:51:33.834053 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ca84af3-af8c-4723-8898-0b8335f784a5" containerName="nova-api-api" Mar 16 16:51:33 crc kubenswrapper[5120]: I0316 16:51:33.834268 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="6ca84af3-af8c-4723-8898-0b8335f784a5" containerName="nova-api-api" Mar 16 16:51:33 crc kubenswrapper[5120]: I0316 16:51:33.834289 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="6ca84af3-af8c-4723-8898-0b8335f784a5" containerName="nova-api-log" Mar 16 16:51:33 crc kubenswrapper[5120]: I0316 16:51:33.843654 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:51:33 crc kubenswrapper[5120]: I0316 16:51:33.843797 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:51:33 crc kubenswrapper[5120]: I0316 16:51:33.846875 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-config-data\"" Mar 16 16:51:33 crc kubenswrapper[5120]: I0316 16:51:33.847748 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-internal-svc\"" Mar 16 16:51:33 crc kubenswrapper[5120]: I0316 16:51:33.848911 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-public-svc\"" Mar 16 16:51:34 crc kubenswrapper[5120]: I0316 16:51:34.019835 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhkww\" (UniqueName: \"kubernetes.io/projected/a6f1dbb0-3139-400a-97f4-f87e17691da5-kube-api-access-bhkww\") pod \"nova-api-0\" (UID: \"a6f1dbb0-3139-400a-97f4-f87e17691da5\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:51:34 crc kubenswrapper[5120]: I0316 16:51:34.020176 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a6f1dbb0-3139-400a-97f4-f87e17691da5-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"a6f1dbb0-3139-400a-97f4-f87e17691da5\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:51:34 crc kubenswrapper[5120]: I0316 16:51:34.020350 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a6f1dbb0-3139-400a-97f4-f87e17691da5-logs\") pod \"nova-api-0\" (UID: \"a6f1dbb0-3139-400a-97f4-f87e17691da5\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:51:34 crc kubenswrapper[5120]: I0316 16:51:34.020542 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/a6f1dbb0-3139-400a-97f4-f87e17691da5-internal-tls-certs\") pod \"nova-api-0\" (UID: \"a6f1dbb0-3139-400a-97f4-f87e17691da5\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:51:34 crc kubenswrapper[5120]: I0316 16:51:34.020665 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/a6f1dbb0-3139-400a-97f4-f87e17691da5-public-tls-certs\") pod \"nova-api-0\" (UID: \"a6f1dbb0-3139-400a-97f4-f87e17691da5\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:51:34 crc kubenswrapper[5120]: I0316 16:51:34.020927 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a6f1dbb0-3139-400a-97f4-f87e17691da5-config-data\") pod \"nova-api-0\" (UID: \"a6f1dbb0-3139-400a-97f4-f87e17691da5\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:51:34 crc kubenswrapper[5120]: I0316 16:51:34.123464 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a6f1dbb0-3139-400a-97f4-f87e17691da5-config-data\") pod \"nova-api-0\" (UID: \"a6f1dbb0-3139-400a-97f4-f87e17691da5\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:51:34 crc kubenswrapper[5120]: I0316 16:51:34.124242 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bhkww\" (UniqueName: \"kubernetes.io/projected/a6f1dbb0-3139-400a-97f4-f87e17691da5-kube-api-access-bhkww\") pod \"nova-api-0\" (UID: \"a6f1dbb0-3139-400a-97f4-f87e17691da5\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:51:34 crc kubenswrapper[5120]: I0316 16:51:34.124404 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a6f1dbb0-3139-400a-97f4-f87e17691da5-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"a6f1dbb0-3139-400a-97f4-f87e17691da5\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:51:34 crc kubenswrapper[5120]: I0316 16:51:34.125028 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a6f1dbb0-3139-400a-97f4-f87e17691da5-logs\") pod \"nova-api-0\" (UID: \"a6f1dbb0-3139-400a-97f4-f87e17691da5\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:51:34 crc kubenswrapper[5120]: I0316 16:51:34.125266 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/a6f1dbb0-3139-400a-97f4-f87e17691da5-internal-tls-certs\") pod \"nova-api-0\" (UID: \"a6f1dbb0-3139-400a-97f4-f87e17691da5\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:51:34 crc kubenswrapper[5120]: I0316 16:51:34.125474 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a6f1dbb0-3139-400a-97f4-f87e17691da5-logs\") pod \"nova-api-0\" (UID: \"a6f1dbb0-3139-400a-97f4-f87e17691da5\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:51:34 crc kubenswrapper[5120]: I0316 16:51:34.125595 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/a6f1dbb0-3139-400a-97f4-f87e17691da5-public-tls-certs\") pod \"nova-api-0\" (UID: \"a6f1dbb0-3139-400a-97f4-f87e17691da5\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:51:34 crc kubenswrapper[5120]: I0316 16:51:34.127900 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a6f1dbb0-3139-400a-97f4-f87e17691da5-config-data\") pod \"nova-api-0\" (UID: \"a6f1dbb0-3139-400a-97f4-f87e17691da5\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:51:34 crc kubenswrapper[5120]: I0316 16:51:34.130616 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a6f1dbb0-3139-400a-97f4-f87e17691da5-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"a6f1dbb0-3139-400a-97f4-f87e17691da5\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:51:34 crc kubenswrapper[5120]: I0316 16:51:34.143358 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/a6f1dbb0-3139-400a-97f4-f87e17691da5-public-tls-certs\") pod \"nova-api-0\" (UID: \"a6f1dbb0-3139-400a-97f4-f87e17691da5\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:51:34 crc kubenswrapper[5120]: I0316 16:51:34.143370 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/a6f1dbb0-3139-400a-97f4-f87e17691da5-internal-tls-certs\") pod \"nova-api-0\" (UID: \"a6f1dbb0-3139-400a-97f4-f87e17691da5\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:51:34 crc kubenswrapper[5120]: I0316 16:51:34.154931 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhkww\" (UniqueName: \"kubernetes.io/projected/a6f1dbb0-3139-400a-97f4-f87e17691da5-kube-api-access-bhkww\") pod \"nova-api-0\" (UID: \"a6f1dbb0-3139-400a-97f4-f87e17691da5\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:51:34 crc kubenswrapper[5120]: I0316 16:51:34.165046 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:51:34 crc kubenswrapper[5120]: E0316 16:51:34.305648 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="aef63c7abec2124d66e4a26586c1f663a4990f4bd7b6b055ba532c7a3a159e97" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:51:34 crc kubenswrapper[5120]: E0316 16:51:34.308134 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="aef63c7abec2124d66e4a26586c1f663a4990f4bd7b6b055ba532c7a3a159e97" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:51:34 crc kubenswrapper[5120]: E0316 16:51:34.309484 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="aef63c7abec2124d66e4a26586c1f663a4990f4bd7b6b055ba532c7a3a159e97" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:51:34 crc kubenswrapper[5120]: E0316 16:51:34.309541 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="8de404c3-c457-4550-94a9-86d2d14103ee" containerName="nova-scheduler-scheduler" probeResult="unknown" Mar 16 16:51:34 crc kubenswrapper[5120]: I0316 16:51:34.662647 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:51:34 crc kubenswrapper[5120]: I0316 16:51:34.681572 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ca84af3-af8c-4723-8898-0b8335f784a5" path="/var/lib/kubelet/pods/6ca84af3-af8c-4723-8898-0b8335f784a5/volumes" Mar 16 16:51:35 crc kubenswrapper[5120]: I0316 16:51:35.435249 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"a6f1dbb0-3139-400a-97f4-f87e17691da5","Type":"ContainerStarted","Data":"7aedf856240c2cdadd5d85ae3e42f342dd660238e51bb77e6423860500972a0a"} Mar 16 16:51:35 crc kubenswrapper[5120]: I0316 16:51:35.435557 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"a6f1dbb0-3139-400a-97f4-f87e17691da5","Type":"ContainerStarted","Data":"924df3d49c37c311e68f2b3d0001218d80969162f7c0fb9f04441ae01655c6ab"} Mar 16 16:51:35 crc kubenswrapper[5120]: I0316 16:51:35.435566 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"a6f1dbb0-3139-400a-97f4-f87e17691da5","Type":"ContainerStarted","Data":"6583c661e90c38bd2316ce11c59ff147c2ab7a55647b96fbe128dc29aace20b4"} Mar 16 16:51:35 crc kubenswrapper[5120]: I0316 16:51:35.468025 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=2.468007446 podStartE2EDuration="2.468007446s" podCreationTimestamp="2026-03-16 16:51:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:51:35.456902201 +0000 UTC m=+4797.610833858" watchObservedRunningTime="2026-03-16 16:51:35.468007446 +0000 UTC m=+4797.621939103" Mar 16 16:51:36 crc kubenswrapper[5120]: I0316 16:51:36.114513 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:51:36 crc kubenswrapper[5120]: I0316 16:51:36.183770 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qzmfr\" (UniqueName: \"kubernetes.io/projected/8de404c3-c457-4550-94a9-86d2d14103ee-kube-api-access-qzmfr\") pod \"8de404c3-c457-4550-94a9-86d2d14103ee\" (UID: \"8de404c3-c457-4550-94a9-86d2d14103ee\") " Mar 16 16:51:36 crc kubenswrapper[5120]: I0316 16:51:36.184363 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8de404c3-c457-4550-94a9-86d2d14103ee-combined-ca-bundle\") pod \"8de404c3-c457-4550-94a9-86d2d14103ee\" (UID: \"8de404c3-c457-4550-94a9-86d2d14103ee\") " Mar 16 16:51:36 crc kubenswrapper[5120]: I0316 16:51:36.184492 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8de404c3-c457-4550-94a9-86d2d14103ee-config-data\") pod \"8de404c3-c457-4550-94a9-86d2d14103ee\" (UID: \"8de404c3-c457-4550-94a9-86d2d14103ee\") " Mar 16 16:51:36 crc kubenswrapper[5120]: I0316 16:51:36.190277 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8de404c3-c457-4550-94a9-86d2d14103ee-kube-api-access-qzmfr" (OuterVolumeSpecName: "kube-api-access-qzmfr") pod "8de404c3-c457-4550-94a9-86d2d14103ee" (UID: "8de404c3-c457-4550-94a9-86d2d14103ee"). InnerVolumeSpecName "kube-api-access-qzmfr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:51:36 crc kubenswrapper[5120]: I0316 16:51:36.214894 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8de404c3-c457-4550-94a9-86d2d14103ee-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "8de404c3-c457-4550-94a9-86d2d14103ee" (UID: "8de404c3-c457-4550-94a9-86d2d14103ee"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:51:36 crc kubenswrapper[5120]: I0316 16:51:36.216126 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8de404c3-c457-4550-94a9-86d2d14103ee-config-data" (OuterVolumeSpecName: "config-data") pod "8de404c3-c457-4550-94a9-86d2d14103ee" (UID: "8de404c3-c457-4550-94a9-86d2d14103ee"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:51:36 crc kubenswrapper[5120]: I0316 16:51:36.287676 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qzmfr\" (UniqueName: \"kubernetes.io/projected/8de404c3-c457-4550-94a9-86d2d14103ee-kube-api-access-qzmfr\") on node \"crc\" DevicePath \"\"" Mar 16 16:51:36 crc kubenswrapper[5120]: I0316 16:51:36.287708 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8de404c3-c457-4550-94a9-86d2d14103ee-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:51:36 crc kubenswrapper[5120]: I0316 16:51:36.287720 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8de404c3-c457-4550-94a9-86d2d14103ee-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:51:36 crc kubenswrapper[5120]: I0316 16:51:36.445616 5120 generic.go:358] "Generic (PLEG): container finished" podID="13be48e8-1309-42ee-89fb-67d9cf4543aa" containerID="7bc686e799420528fff50623d35b3694e51b9c28e0c49dd111e1d529654399c2" exitCode=0 Mar 16 16:51:36 crc kubenswrapper[5120]: I0316 16:51:36.445717 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-dv2s7" event={"ID":"13be48e8-1309-42ee-89fb-67d9cf4543aa","Type":"ContainerDied","Data":"7bc686e799420528fff50623d35b3694e51b9c28e0c49dd111e1d529654399c2"} Mar 16 16:51:36 crc kubenswrapper[5120]: I0316 16:51:36.448343 5120 generic.go:358] "Generic (PLEG): container finished" podID="8de404c3-c457-4550-94a9-86d2d14103ee" containerID="aef63c7abec2124d66e4a26586c1f663a4990f4bd7b6b055ba532c7a3a159e97" exitCode=0 Mar 16 16:51:36 crc kubenswrapper[5120]: I0316 16:51:36.448413 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:51:36 crc kubenswrapper[5120]: I0316 16:51:36.448495 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"8de404c3-c457-4550-94a9-86d2d14103ee","Type":"ContainerDied","Data":"aef63c7abec2124d66e4a26586c1f663a4990f4bd7b6b055ba532c7a3a159e97"} Mar 16 16:51:36 crc kubenswrapper[5120]: I0316 16:51:36.448543 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"8de404c3-c457-4550-94a9-86d2d14103ee","Type":"ContainerDied","Data":"8f106e68ca9e9c0e7de4fef9702205c793e38bbdaca94044a59a09de8b8d124a"} Mar 16 16:51:36 crc kubenswrapper[5120]: I0316 16:51:36.448567 5120 scope.go:117] "RemoveContainer" containerID="aef63c7abec2124d66e4a26586c1f663a4990f4bd7b6b055ba532c7a3a159e97" Mar 16 16:51:36 crc kubenswrapper[5120]: I0316 16:51:36.480633 5120 scope.go:117] "RemoveContainer" containerID="aef63c7abec2124d66e4a26586c1f663a4990f4bd7b6b055ba532c7a3a159e97" Mar 16 16:51:36 crc kubenswrapper[5120]: E0316 16:51:36.483920 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aef63c7abec2124d66e4a26586c1f663a4990f4bd7b6b055ba532c7a3a159e97\": container with ID starting with aef63c7abec2124d66e4a26586c1f663a4990f4bd7b6b055ba532c7a3a159e97 not found: ID does not exist" containerID="aef63c7abec2124d66e4a26586c1f663a4990f4bd7b6b055ba532c7a3a159e97" Mar 16 16:51:36 crc kubenswrapper[5120]: I0316 16:51:36.483964 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aef63c7abec2124d66e4a26586c1f663a4990f4bd7b6b055ba532c7a3a159e97"} err="failed to get container status \"aef63c7abec2124d66e4a26586c1f663a4990f4bd7b6b055ba532c7a3a159e97\": rpc error: code = NotFound desc = could not find container \"aef63c7abec2124d66e4a26586c1f663a4990f4bd7b6b055ba532c7a3a159e97\": container with ID starting with aef63c7abec2124d66e4a26586c1f663a4990f4bd7b6b055ba532c7a3a159e97 not found: ID does not exist" Mar 16 16:51:36 crc kubenswrapper[5120]: I0316 16:51:36.491748 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:51:36 crc kubenswrapper[5120]: I0316 16:51:36.504043 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:51:36 crc kubenswrapper[5120]: I0316 16:51:36.521899 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:51:36 crc kubenswrapper[5120]: I0316 16:51:36.523288 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8de404c3-c457-4550-94a9-86d2d14103ee" containerName="nova-scheduler-scheduler" Mar 16 16:51:36 crc kubenswrapper[5120]: I0316 16:51:36.523315 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8de404c3-c457-4550-94a9-86d2d14103ee" containerName="nova-scheduler-scheduler" Mar 16 16:51:36 crc kubenswrapper[5120]: I0316 16:51:36.523586 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="8de404c3-c457-4550-94a9-86d2d14103ee" containerName="nova-scheduler-scheduler" Mar 16 16:51:36 crc kubenswrapper[5120]: I0316 16:51:36.537110 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:51:36 crc kubenswrapper[5120]: I0316 16:51:36.537314 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:51:36 crc kubenswrapper[5120]: I0316 16:51:36.538828 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-scheduler-config-data\"" Mar 16 16:51:36 crc kubenswrapper[5120]: I0316 16:51:36.593566 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5fb0cf64-0c42-43e1-8653-abce2f04520a-config-data\") pod \"nova-scheduler-0\" (UID: \"5fb0cf64-0c42-43e1-8653-abce2f04520a\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:51:36 crc kubenswrapper[5120]: I0316 16:51:36.593680 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dz57\" (UniqueName: \"kubernetes.io/projected/5fb0cf64-0c42-43e1-8653-abce2f04520a-kube-api-access-6dz57\") pod \"nova-scheduler-0\" (UID: \"5fb0cf64-0c42-43e1-8653-abce2f04520a\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:51:36 crc kubenswrapper[5120]: I0316 16:51:36.593789 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5fb0cf64-0c42-43e1-8653-abce2f04520a-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"5fb0cf64-0c42-43e1-8653-abce2f04520a\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:51:36 crc kubenswrapper[5120]: I0316 16:51:36.676066 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8de404c3-c457-4550-94a9-86d2d14103ee" path="/var/lib/kubelet/pods/8de404c3-c457-4550-94a9-86d2d14103ee/volumes" Mar 16 16:51:36 crc kubenswrapper[5120]: I0316 16:51:36.696246 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5fb0cf64-0c42-43e1-8653-abce2f04520a-config-data\") pod \"nova-scheduler-0\" (UID: \"5fb0cf64-0c42-43e1-8653-abce2f04520a\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:51:36 crc kubenswrapper[5120]: I0316 16:51:36.696386 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6dz57\" (UniqueName: \"kubernetes.io/projected/5fb0cf64-0c42-43e1-8653-abce2f04520a-kube-api-access-6dz57\") pod \"nova-scheduler-0\" (UID: \"5fb0cf64-0c42-43e1-8653-abce2f04520a\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:51:36 crc kubenswrapper[5120]: I0316 16:51:36.696501 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5fb0cf64-0c42-43e1-8653-abce2f04520a-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"5fb0cf64-0c42-43e1-8653-abce2f04520a\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:51:36 crc kubenswrapper[5120]: I0316 16:51:36.702617 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5fb0cf64-0c42-43e1-8653-abce2f04520a-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"5fb0cf64-0c42-43e1-8653-abce2f04520a\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:51:36 crc kubenswrapper[5120]: I0316 16:51:36.706940 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5fb0cf64-0c42-43e1-8653-abce2f04520a-config-data\") pod \"nova-scheduler-0\" (UID: \"5fb0cf64-0c42-43e1-8653-abce2f04520a\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:51:36 crc kubenswrapper[5120]: I0316 16:51:36.713316 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dz57\" (UniqueName: \"kubernetes.io/projected/5fb0cf64-0c42-43e1-8653-abce2f04520a-kube-api-access-6dz57\") pod \"nova-scheduler-0\" (UID: \"5fb0cf64-0c42-43e1-8653-abce2f04520a\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:51:36 crc kubenswrapper[5120]: I0316 16:51:36.858010 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:51:37 crc kubenswrapper[5120]: I0316 16:51:37.291342 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:51:37 crc kubenswrapper[5120]: I0316 16:51:37.458736 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"5fb0cf64-0c42-43e1-8653-abce2f04520a","Type":"ContainerStarted","Data":"4ce04ef26d40a53e305c7d4453ca5852a613cd3d80d02a12ed871f6e2ff483a9"} Mar 16 16:51:37 crc kubenswrapper[5120]: I0316 16:51:37.761020 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-dv2s7" Mar 16 16:51:37 crc kubenswrapper[5120]: I0316 16:51:37.836344 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/13be48e8-1309-42ee-89fb-67d9cf4543aa-config-data\") pod \"13be48e8-1309-42ee-89fb-67d9cf4543aa\" (UID: \"13be48e8-1309-42ee-89fb-67d9cf4543aa\") " Mar 16 16:51:37 crc kubenswrapper[5120]: I0316 16:51:37.836808 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/13be48e8-1309-42ee-89fb-67d9cf4543aa-combined-ca-bundle\") pod \"13be48e8-1309-42ee-89fb-67d9cf4543aa\" (UID: \"13be48e8-1309-42ee-89fb-67d9cf4543aa\") " Mar 16 16:51:37 crc kubenswrapper[5120]: I0316 16:51:37.837002 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/13be48e8-1309-42ee-89fb-67d9cf4543aa-scripts\") pod \"13be48e8-1309-42ee-89fb-67d9cf4543aa\" (UID: \"13be48e8-1309-42ee-89fb-67d9cf4543aa\") " Mar 16 16:51:37 crc kubenswrapper[5120]: I0316 16:51:37.837502 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-44mf9\" (UniqueName: \"kubernetes.io/projected/13be48e8-1309-42ee-89fb-67d9cf4543aa-kube-api-access-44mf9\") pod \"13be48e8-1309-42ee-89fb-67d9cf4543aa\" (UID: \"13be48e8-1309-42ee-89fb-67d9cf4543aa\") " Mar 16 16:51:37 crc kubenswrapper[5120]: I0316 16:51:37.841342 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13be48e8-1309-42ee-89fb-67d9cf4543aa-kube-api-access-44mf9" (OuterVolumeSpecName: "kube-api-access-44mf9") pod "13be48e8-1309-42ee-89fb-67d9cf4543aa" (UID: "13be48e8-1309-42ee-89fb-67d9cf4543aa"). InnerVolumeSpecName "kube-api-access-44mf9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:51:37 crc kubenswrapper[5120]: I0316 16:51:37.841596 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/13be48e8-1309-42ee-89fb-67d9cf4543aa-scripts" (OuterVolumeSpecName: "scripts") pod "13be48e8-1309-42ee-89fb-67d9cf4543aa" (UID: "13be48e8-1309-42ee-89fb-67d9cf4543aa"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:51:37 crc kubenswrapper[5120]: I0316 16:51:37.863309 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/13be48e8-1309-42ee-89fb-67d9cf4543aa-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "13be48e8-1309-42ee-89fb-67d9cf4543aa" (UID: "13be48e8-1309-42ee-89fb-67d9cf4543aa"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:51:37 crc kubenswrapper[5120]: I0316 16:51:37.863723 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/13be48e8-1309-42ee-89fb-67d9cf4543aa-config-data" (OuterVolumeSpecName: "config-data") pod "13be48e8-1309-42ee-89fb-67d9cf4543aa" (UID: "13be48e8-1309-42ee-89fb-67d9cf4543aa"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:51:37 crc kubenswrapper[5120]: I0316 16:51:37.941433 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/13be48e8-1309-42ee-89fb-67d9cf4543aa-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:51:37 crc kubenswrapper[5120]: I0316 16:51:37.941482 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/13be48e8-1309-42ee-89fb-67d9cf4543aa-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:51:37 crc kubenswrapper[5120]: I0316 16:51:37.941496 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/13be48e8-1309-42ee-89fb-67d9cf4543aa-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:51:37 crc kubenswrapper[5120]: I0316 16:51:37.941510 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-44mf9\" (UniqueName: \"kubernetes.io/projected/13be48e8-1309-42ee-89fb-67d9cf4543aa-kube-api-access-44mf9\") on node \"crc\" DevicePath \"\"" Mar 16 16:51:38 crc kubenswrapper[5120]: I0316 16:51:38.473185 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-dv2s7" event={"ID":"13be48e8-1309-42ee-89fb-67d9cf4543aa","Type":"ContainerDied","Data":"4ac21efc3894357ecf02af88eeae5b12d8b832b4fe5c33eebf5c7dc8a68b6ba3"} Mar 16 16:51:38 crc kubenswrapper[5120]: I0316 16:51:38.473506 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4ac21efc3894357ecf02af88eeae5b12d8b832b4fe5c33eebf5c7dc8a68b6ba3" Mar 16 16:51:38 crc kubenswrapper[5120]: I0316 16:51:38.473590 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-dv2s7" Mar 16 16:51:38 crc kubenswrapper[5120]: I0316 16:51:38.490015 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"5fb0cf64-0c42-43e1-8653-abce2f04520a","Type":"ContainerStarted","Data":"92afa50f82f57d1996b20bf453bdb7a41b77104d36fb062065416da1feedfd6a"} Mar 16 16:51:38 crc kubenswrapper[5120]: I0316 16:51:38.563095 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-scheduler-0" podStartSLOduration=2.563071328 podStartE2EDuration="2.563071328s" podCreationTimestamp="2026-03-16 16:51:36 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:51:38.52230981 +0000 UTC m=+4800.676241477" watchObservedRunningTime="2026-03-16 16:51:38.563071328 +0000 UTC m=+4800.717002995" Mar 16 16:51:38 crc kubenswrapper[5120]: I0316 16:51:38.569164 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:51:38 crc kubenswrapper[5120]: I0316 16:51:38.569496 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="a6f1dbb0-3139-400a-97f4-f87e17691da5" containerName="nova-api-log" containerID="cri-o://924df3d49c37c311e68f2b3d0001218d80969162f7c0fb9f04441ae01655c6ab" gracePeriod=30 Mar 16 16:51:38 crc kubenswrapper[5120]: I0316 16:51:38.569554 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="a6f1dbb0-3139-400a-97f4-f87e17691da5" containerName="nova-api-api" containerID="cri-o://7aedf856240c2cdadd5d85ae3e42f342dd660238e51bb77e6423860500972a0a" gracePeriod=30 Mar 16 16:51:38 crc kubenswrapper[5120]: I0316 16:51:38.583829 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:51:38 crc kubenswrapper[5120]: I0316 16:51:38.636424 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:51:38 crc kubenswrapper[5120]: I0316 16:51:38.636686 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="7dbe7cf5-e8a9-4037-85a4-3d1037495e0a" containerName="nova-metadata-log" containerID="cri-o://49b9e115a44d0f576eb25e240f36fe022686c248257bbb453d5431b615f39266" gracePeriod=30 Mar 16 16:51:38 crc kubenswrapper[5120]: I0316 16:51:38.636834 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="7dbe7cf5-e8a9-4037-85a4-3d1037495e0a" containerName="nova-metadata-metadata" containerID="cri-o://b3ccc2c042453043309ef00ac96a6eb5ad8715043dbaa8d8eab366f506834ea9" gracePeriod=30 Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.142659 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.158729 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.298959 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7dbe7cf5-e8a9-4037-85a4-3d1037495e0a-config-data\") pod \"7dbe7cf5-e8a9-4037-85a4-3d1037495e0a\" (UID: \"7dbe7cf5-e8a9-4037-85a4-3d1037495e0a\") " Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.299073 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a6f1dbb0-3139-400a-97f4-f87e17691da5-combined-ca-bundle\") pod \"a6f1dbb0-3139-400a-97f4-f87e17691da5\" (UID: \"a6f1dbb0-3139-400a-97f4-f87e17691da5\") " Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.299101 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/a6f1dbb0-3139-400a-97f4-f87e17691da5-public-tls-certs\") pod \"a6f1dbb0-3139-400a-97f4-f87e17691da5\" (UID: \"a6f1dbb0-3139-400a-97f4-f87e17691da5\") " Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.299393 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7dbe7cf5-e8a9-4037-85a4-3d1037495e0a-logs\") pod \"7dbe7cf5-e8a9-4037-85a4-3d1037495e0a\" (UID: \"7dbe7cf5-e8a9-4037-85a4-3d1037495e0a\") " Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.299505 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7dbe7cf5-e8a9-4037-85a4-3d1037495e0a-combined-ca-bundle\") pod \"7dbe7cf5-e8a9-4037-85a4-3d1037495e0a\" (UID: \"7dbe7cf5-e8a9-4037-85a4-3d1037495e0a\") " Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.299859 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7dbe7cf5-e8a9-4037-85a4-3d1037495e0a-logs" (OuterVolumeSpecName: "logs") pod "7dbe7cf5-e8a9-4037-85a4-3d1037495e0a" (UID: "7dbe7cf5-e8a9-4037-85a4-3d1037495e0a"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.299890 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a6f1dbb0-3139-400a-97f4-f87e17691da5-config-data\") pod \"a6f1dbb0-3139-400a-97f4-f87e17691da5\" (UID: \"a6f1dbb0-3139-400a-97f4-f87e17691da5\") " Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.299980 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t4fp6\" (UniqueName: \"kubernetes.io/projected/7dbe7cf5-e8a9-4037-85a4-3d1037495e0a-kube-api-access-t4fp6\") pod \"7dbe7cf5-e8a9-4037-85a4-3d1037495e0a\" (UID: \"7dbe7cf5-e8a9-4037-85a4-3d1037495e0a\") " Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.300027 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/7dbe7cf5-e8a9-4037-85a4-3d1037495e0a-nova-metadata-tls-certs\") pod \"7dbe7cf5-e8a9-4037-85a4-3d1037495e0a\" (UID: \"7dbe7cf5-e8a9-4037-85a4-3d1037495e0a\") " Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.300078 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a6f1dbb0-3139-400a-97f4-f87e17691da5-logs\") pod \"a6f1dbb0-3139-400a-97f4-f87e17691da5\" (UID: \"a6f1dbb0-3139-400a-97f4-f87e17691da5\") " Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.300165 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bhkww\" (UniqueName: \"kubernetes.io/projected/a6f1dbb0-3139-400a-97f4-f87e17691da5-kube-api-access-bhkww\") pod \"a6f1dbb0-3139-400a-97f4-f87e17691da5\" (UID: \"a6f1dbb0-3139-400a-97f4-f87e17691da5\") " Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.300292 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/a6f1dbb0-3139-400a-97f4-f87e17691da5-internal-tls-certs\") pod \"a6f1dbb0-3139-400a-97f4-f87e17691da5\" (UID: \"a6f1dbb0-3139-400a-97f4-f87e17691da5\") " Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.301563 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7dbe7cf5-e8a9-4037-85a4-3d1037495e0a-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.302283 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6f1dbb0-3139-400a-97f4-f87e17691da5-logs" (OuterVolumeSpecName: "logs") pod "a6f1dbb0-3139-400a-97f4-f87e17691da5" (UID: "a6f1dbb0-3139-400a-97f4-f87e17691da5"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.306739 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6f1dbb0-3139-400a-97f4-f87e17691da5-kube-api-access-bhkww" (OuterVolumeSpecName: "kube-api-access-bhkww") pod "a6f1dbb0-3139-400a-97f4-f87e17691da5" (UID: "a6f1dbb0-3139-400a-97f4-f87e17691da5"). InnerVolumeSpecName "kube-api-access-bhkww". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.313923 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7dbe7cf5-e8a9-4037-85a4-3d1037495e0a-kube-api-access-t4fp6" (OuterVolumeSpecName: "kube-api-access-t4fp6") pod "7dbe7cf5-e8a9-4037-85a4-3d1037495e0a" (UID: "7dbe7cf5-e8a9-4037-85a4-3d1037495e0a"). InnerVolumeSpecName "kube-api-access-t4fp6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.329456 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6f1dbb0-3139-400a-97f4-f87e17691da5-config-data" (OuterVolumeSpecName: "config-data") pod "a6f1dbb0-3139-400a-97f4-f87e17691da5" (UID: "a6f1dbb0-3139-400a-97f4-f87e17691da5"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.333924 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7dbe7cf5-e8a9-4037-85a4-3d1037495e0a-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "7dbe7cf5-e8a9-4037-85a4-3d1037495e0a" (UID: "7dbe7cf5-e8a9-4037-85a4-3d1037495e0a"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.336016 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6f1dbb0-3139-400a-97f4-f87e17691da5-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "a6f1dbb0-3139-400a-97f4-f87e17691da5" (UID: "a6f1dbb0-3139-400a-97f4-f87e17691da5"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.343072 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7dbe7cf5-e8a9-4037-85a4-3d1037495e0a-config-data" (OuterVolumeSpecName: "config-data") pod "7dbe7cf5-e8a9-4037-85a4-3d1037495e0a" (UID: "7dbe7cf5-e8a9-4037-85a4-3d1037495e0a"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.354610 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6f1dbb0-3139-400a-97f4-f87e17691da5-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "a6f1dbb0-3139-400a-97f4-f87e17691da5" (UID: "a6f1dbb0-3139-400a-97f4-f87e17691da5"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.361180 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6f1dbb0-3139-400a-97f4-f87e17691da5-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "a6f1dbb0-3139-400a-97f4-f87e17691da5" (UID: "a6f1dbb0-3139-400a-97f4-f87e17691da5"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.361258 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7dbe7cf5-e8a9-4037-85a4-3d1037495e0a-nova-metadata-tls-certs" (OuterVolumeSpecName: "nova-metadata-tls-certs") pod "7dbe7cf5-e8a9-4037-85a4-3d1037495e0a" (UID: "7dbe7cf5-e8a9-4037-85a4-3d1037495e0a"). InnerVolumeSpecName "nova-metadata-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.404097 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a6f1dbb0-3139-400a-97f4-f87e17691da5-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.404131 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t4fp6\" (UniqueName: \"kubernetes.io/projected/7dbe7cf5-e8a9-4037-85a4-3d1037495e0a-kube-api-access-t4fp6\") on node \"crc\" DevicePath \"\"" Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.404141 5120 reconciler_common.go:299] "Volume detached for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/7dbe7cf5-e8a9-4037-85a4-3d1037495e0a-nova-metadata-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.404149 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a6f1dbb0-3139-400a-97f4-f87e17691da5-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.404158 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bhkww\" (UniqueName: \"kubernetes.io/projected/a6f1dbb0-3139-400a-97f4-f87e17691da5-kube-api-access-bhkww\") on node \"crc\" DevicePath \"\"" Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.404166 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/a6f1dbb0-3139-400a-97f4-f87e17691da5-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.404179 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7dbe7cf5-e8a9-4037-85a4-3d1037495e0a-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.404187 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a6f1dbb0-3139-400a-97f4-f87e17691da5-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.404197 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/a6f1dbb0-3139-400a-97f4-f87e17691da5-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.404205 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7dbe7cf5-e8a9-4037-85a4-3d1037495e0a-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.502979 5120 generic.go:358] "Generic (PLEG): container finished" podID="a6f1dbb0-3139-400a-97f4-f87e17691da5" containerID="7aedf856240c2cdadd5d85ae3e42f342dd660238e51bb77e6423860500972a0a" exitCode=0 Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.503019 5120 generic.go:358] "Generic (PLEG): container finished" podID="a6f1dbb0-3139-400a-97f4-f87e17691da5" containerID="924df3d49c37c311e68f2b3d0001218d80969162f7c0fb9f04441ae01655c6ab" exitCode=143 Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.503066 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.503049 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"a6f1dbb0-3139-400a-97f4-f87e17691da5","Type":"ContainerDied","Data":"7aedf856240c2cdadd5d85ae3e42f342dd660238e51bb77e6423860500972a0a"} Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.503266 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"a6f1dbb0-3139-400a-97f4-f87e17691da5","Type":"ContainerDied","Data":"924df3d49c37c311e68f2b3d0001218d80969162f7c0fb9f04441ae01655c6ab"} Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.503288 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"a6f1dbb0-3139-400a-97f4-f87e17691da5","Type":"ContainerDied","Data":"6583c661e90c38bd2316ce11c59ff147c2ab7a55647b96fbe128dc29aace20b4"} Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.503308 5120 scope.go:117] "RemoveContainer" containerID="7aedf856240c2cdadd5d85ae3e42f342dd660238e51bb77e6423860500972a0a" Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.509701 5120 generic.go:358] "Generic (PLEG): container finished" podID="7dbe7cf5-e8a9-4037-85a4-3d1037495e0a" containerID="b3ccc2c042453043309ef00ac96a6eb5ad8715043dbaa8d8eab366f506834ea9" exitCode=0 Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.509736 5120 generic.go:358] "Generic (PLEG): container finished" podID="7dbe7cf5-e8a9-4037-85a4-3d1037495e0a" containerID="49b9e115a44d0f576eb25e240f36fe022686c248257bbb453d5431b615f39266" exitCode=143 Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.509745 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"7dbe7cf5-e8a9-4037-85a4-3d1037495e0a","Type":"ContainerDied","Data":"b3ccc2c042453043309ef00ac96a6eb5ad8715043dbaa8d8eab366f506834ea9"} Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.509795 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.509808 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"7dbe7cf5-e8a9-4037-85a4-3d1037495e0a","Type":"ContainerDied","Data":"49b9e115a44d0f576eb25e240f36fe022686c248257bbb453d5431b615f39266"} Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.509824 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"7dbe7cf5-e8a9-4037-85a4-3d1037495e0a","Type":"ContainerDied","Data":"528c833c9f9bac17131437099cf9b56b57dbef4a50451768c548cc8419103acf"} Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.534719 5120 scope.go:117] "RemoveContainer" containerID="924df3d49c37c311e68f2b3d0001218d80969162f7c0fb9f04441ae01655c6ab" Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.542178 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.557366 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.575843 5120 scope.go:117] "RemoveContainer" containerID="7aedf856240c2cdadd5d85ae3e42f342dd660238e51bb77e6423860500972a0a" Mar 16 16:51:39 crc kubenswrapper[5120]: E0316 16:51:39.577558 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7aedf856240c2cdadd5d85ae3e42f342dd660238e51bb77e6423860500972a0a\": container with ID starting with 7aedf856240c2cdadd5d85ae3e42f342dd660238e51bb77e6423860500972a0a not found: ID does not exist" containerID="7aedf856240c2cdadd5d85ae3e42f342dd660238e51bb77e6423860500972a0a" Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.577621 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7aedf856240c2cdadd5d85ae3e42f342dd660238e51bb77e6423860500972a0a"} err="failed to get container status \"7aedf856240c2cdadd5d85ae3e42f342dd660238e51bb77e6423860500972a0a\": rpc error: code = NotFound desc = could not find container \"7aedf856240c2cdadd5d85ae3e42f342dd660238e51bb77e6423860500972a0a\": container with ID starting with 7aedf856240c2cdadd5d85ae3e42f342dd660238e51bb77e6423860500972a0a not found: ID does not exist" Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.577665 5120 scope.go:117] "RemoveContainer" containerID="924df3d49c37c311e68f2b3d0001218d80969162f7c0fb9f04441ae01655c6ab" Mar 16 16:51:39 crc kubenswrapper[5120]: E0316 16:51:39.578438 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"924df3d49c37c311e68f2b3d0001218d80969162f7c0fb9f04441ae01655c6ab\": container with ID starting with 924df3d49c37c311e68f2b3d0001218d80969162f7c0fb9f04441ae01655c6ab not found: ID does not exist" containerID="924df3d49c37c311e68f2b3d0001218d80969162f7c0fb9f04441ae01655c6ab" Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.578490 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"924df3d49c37c311e68f2b3d0001218d80969162f7c0fb9f04441ae01655c6ab"} err="failed to get container status \"924df3d49c37c311e68f2b3d0001218d80969162f7c0fb9f04441ae01655c6ab\": rpc error: code = NotFound desc = could not find container \"924df3d49c37c311e68f2b3d0001218d80969162f7c0fb9f04441ae01655c6ab\": container with ID starting with 924df3d49c37c311e68f2b3d0001218d80969162f7c0fb9f04441ae01655c6ab not found: ID does not exist" Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.578523 5120 scope.go:117] "RemoveContainer" containerID="7aedf856240c2cdadd5d85ae3e42f342dd660238e51bb77e6423860500972a0a" Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.579078 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7aedf856240c2cdadd5d85ae3e42f342dd660238e51bb77e6423860500972a0a"} err="failed to get container status \"7aedf856240c2cdadd5d85ae3e42f342dd660238e51bb77e6423860500972a0a\": rpc error: code = NotFound desc = could not find container \"7aedf856240c2cdadd5d85ae3e42f342dd660238e51bb77e6423860500972a0a\": container with ID starting with 7aedf856240c2cdadd5d85ae3e42f342dd660238e51bb77e6423860500972a0a not found: ID does not exist" Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.579108 5120 scope.go:117] "RemoveContainer" containerID="924df3d49c37c311e68f2b3d0001218d80969162f7c0fb9f04441ae01655c6ab" Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.579489 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"924df3d49c37c311e68f2b3d0001218d80969162f7c0fb9f04441ae01655c6ab"} err="failed to get container status \"924df3d49c37c311e68f2b3d0001218d80969162f7c0fb9f04441ae01655c6ab\": rpc error: code = NotFound desc = could not find container \"924df3d49c37c311e68f2b3d0001218d80969162f7c0fb9f04441ae01655c6ab\": container with ID starting with 924df3d49c37c311e68f2b3d0001218d80969162f7c0fb9f04441ae01655c6ab not found: ID does not exist" Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.579622 5120 scope.go:117] "RemoveContainer" containerID="b3ccc2c042453043309ef00ac96a6eb5ad8715043dbaa8d8eab366f506834ea9" Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.580287 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.592159 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.615736 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.617116 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7dbe7cf5-e8a9-4037-85a4-3d1037495e0a" containerName="nova-metadata-log" Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.617143 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7dbe7cf5-e8a9-4037-85a4-3d1037495e0a" containerName="nova-metadata-log" Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.617209 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6f1dbb0-3139-400a-97f4-f87e17691da5" containerName="nova-api-api" Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.617222 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6f1dbb0-3139-400a-97f4-f87e17691da5" containerName="nova-api-api" Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.617246 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7dbe7cf5-e8a9-4037-85a4-3d1037495e0a" containerName="nova-metadata-metadata" Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.617254 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7dbe7cf5-e8a9-4037-85a4-3d1037495e0a" containerName="nova-metadata-metadata" Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.617317 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6f1dbb0-3139-400a-97f4-f87e17691da5" containerName="nova-api-log" Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.617325 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6f1dbb0-3139-400a-97f4-f87e17691da5" containerName="nova-api-log" Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.617349 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13be48e8-1309-42ee-89fb-67d9cf4543aa" containerName="nova-manage" Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.617356 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="13be48e8-1309-42ee-89fb-67d9cf4543aa" containerName="nova-manage" Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.617566 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="a6f1dbb0-3139-400a-97f4-f87e17691da5" containerName="nova-api-log" Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.617605 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="13be48e8-1309-42ee-89fb-67d9cf4543aa" containerName="nova-manage" Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.617621 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7dbe7cf5-e8a9-4037-85a4-3d1037495e0a" containerName="nova-metadata-metadata" Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.617637 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7dbe7cf5-e8a9-4037-85a4-3d1037495e0a" containerName="nova-metadata-log" Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.617650 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="a6f1dbb0-3139-400a-97f4-f87e17691da5" containerName="nova-api-api" Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.627585 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.630199 5120 scope.go:117] "RemoveContainer" containerID="49b9e115a44d0f576eb25e240f36fe022686c248257bbb453d5431b615f39266" Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.630325 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.631569 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-internal-svc\"" Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.631829 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-config-data\"" Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.631736 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-public-svc\"" Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.639426 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.649737 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.649950 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.652740 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-metadata-config-data\"" Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.653056 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-metadata-internal-svc\"" Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.670300 5120 scope.go:117] "RemoveContainer" containerID="b3ccc2c042453043309ef00ac96a6eb5ad8715043dbaa8d8eab366f506834ea9" Mar 16 16:51:39 crc kubenswrapper[5120]: E0316 16:51:39.671891 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b3ccc2c042453043309ef00ac96a6eb5ad8715043dbaa8d8eab366f506834ea9\": container with ID starting with b3ccc2c042453043309ef00ac96a6eb5ad8715043dbaa8d8eab366f506834ea9 not found: ID does not exist" containerID="b3ccc2c042453043309ef00ac96a6eb5ad8715043dbaa8d8eab366f506834ea9" Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.672030 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3ccc2c042453043309ef00ac96a6eb5ad8715043dbaa8d8eab366f506834ea9"} err="failed to get container status \"b3ccc2c042453043309ef00ac96a6eb5ad8715043dbaa8d8eab366f506834ea9\": rpc error: code = NotFound desc = could not find container \"b3ccc2c042453043309ef00ac96a6eb5ad8715043dbaa8d8eab366f506834ea9\": container with ID starting with b3ccc2c042453043309ef00ac96a6eb5ad8715043dbaa8d8eab366f506834ea9 not found: ID does not exist" Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.672138 5120 scope.go:117] "RemoveContainer" containerID="49b9e115a44d0f576eb25e240f36fe022686c248257bbb453d5431b615f39266" Mar 16 16:51:39 crc kubenswrapper[5120]: E0316 16:51:39.672774 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"49b9e115a44d0f576eb25e240f36fe022686c248257bbb453d5431b615f39266\": container with ID starting with 49b9e115a44d0f576eb25e240f36fe022686c248257bbb453d5431b615f39266 not found: ID does not exist" containerID="49b9e115a44d0f576eb25e240f36fe022686c248257bbb453d5431b615f39266" Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.672902 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49b9e115a44d0f576eb25e240f36fe022686c248257bbb453d5431b615f39266"} err="failed to get container status \"49b9e115a44d0f576eb25e240f36fe022686c248257bbb453d5431b615f39266\": rpc error: code = NotFound desc = could not find container \"49b9e115a44d0f576eb25e240f36fe022686c248257bbb453d5431b615f39266\": container with ID starting with 49b9e115a44d0f576eb25e240f36fe022686c248257bbb453d5431b615f39266 not found: ID does not exist" Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.672933 5120 scope.go:117] "RemoveContainer" containerID="b3ccc2c042453043309ef00ac96a6eb5ad8715043dbaa8d8eab366f506834ea9" Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.673257 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3ccc2c042453043309ef00ac96a6eb5ad8715043dbaa8d8eab366f506834ea9"} err="failed to get container status \"b3ccc2c042453043309ef00ac96a6eb5ad8715043dbaa8d8eab366f506834ea9\": rpc error: code = NotFound desc = could not find container \"b3ccc2c042453043309ef00ac96a6eb5ad8715043dbaa8d8eab366f506834ea9\": container with ID starting with b3ccc2c042453043309ef00ac96a6eb5ad8715043dbaa8d8eab366f506834ea9 not found: ID does not exist" Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.673312 5120 scope.go:117] "RemoveContainer" containerID="49b9e115a44d0f576eb25e240f36fe022686c248257bbb453d5431b615f39266" Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.673636 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49b9e115a44d0f576eb25e240f36fe022686c248257bbb453d5431b615f39266"} err="failed to get container status \"49b9e115a44d0f576eb25e240f36fe022686c248257bbb453d5431b615f39266\": rpc error: code = NotFound desc = could not find container \"49b9e115a44d0f576eb25e240f36fe022686c248257bbb453d5431b615f39266\": container with ID starting with 49b9e115a44d0f576eb25e240f36fe022686c248257bbb453d5431b615f39266 not found: ID does not exist" Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.816097 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/8a564f44-3c8d-4dff-b968-96f276382786-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"8a564f44-3c8d-4dff-b968-96f276382786\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.816351 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vfxc\" (UniqueName: \"kubernetes.io/projected/b3abb705-1e8c-4922-a449-616479bf0721-kube-api-access-9vfxc\") pod \"nova-api-0\" (UID: \"b3abb705-1e8c-4922-a449-616479bf0721\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.816718 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8a564f44-3c8d-4dff-b968-96f276382786-logs\") pod \"nova-metadata-0\" (UID: \"8a564f44-3c8d-4dff-b968-96f276382786\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.816885 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ksh5\" (UniqueName: \"kubernetes.io/projected/8a564f44-3c8d-4dff-b968-96f276382786-kube-api-access-5ksh5\") pod \"nova-metadata-0\" (UID: \"8a564f44-3c8d-4dff-b968-96f276382786\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.817166 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b3abb705-1e8c-4922-a449-616479bf0721-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"b3abb705-1e8c-4922-a449-616479bf0721\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.817194 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8a564f44-3c8d-4dff-b968-96f276382786-config-data\") pod \"nova-metadata-0\" (UID: \"8a564f44-3c8d-4dff-b968-96f276382786\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.817338 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/b3abb705-1e8c-4922-a449-616479bf0721-internal-tls-certs\") pod \"nova-api-0\" (UID: \"b3abb705-1e8c-4922-a449-616479bf0721\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.817692 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b3abb705-1e8c-4922-a449-616479bf0721-config-data\") pod \"nova-api-0\" (UID: \"b3abb705-1e8c-4922-a449-616479bf0721\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.817853 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/b3abb705-1e8c-4922-a449-616479bf0721-public-tls-certs\") pod \"nova-api-0\" (UID: \"b3abb705-1e8c-4922-a449-616479bf0721\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.818156 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b3abb705-1e8c-4922-a449-616479bf0721-logs\") pod \"nova-api-0\" (UID: \"b3abb705-1e8c-4922-a449-616479bf0721\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.818221 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8a564f44-3c8d-4dff-b968-96f276382786-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"8a564f44-3c8d-4dff-b968-96f276382786\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.920278 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5ksh5\" (UniqueName: \"kubernetes.io/projected/8a564f44-3c8d-4dff-b968-96f276382786-kube-api-access-5ksh5\") pod \"nova-metadata-0\" (UID: \"8a564f44-3c8d-4dff-b968-96f276382786\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.920354 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b3abb705-1e8c-4922-a449-616479bf0721-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"b3abb705-1e8c-4922-a449-616479bf0721\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.920381 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8a564f44-3c8d-4dff-b968-96f276382786-config-data\") pod \"nova-metadata-0\" (UID: \"8a564f44-3c8d-4dff-b968-96f276382786\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.920423 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/b3abb705-1e8c-4922-a449-616479bf0721-internal-tls-certs\") pod \"nova-api-0\" (UID: \"b3abb705-1e8c-4922-a449-616479bf0721\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.920499 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b3abb705-1e8c-4922-a449-616479bf0721-config-data\") pod \"nova-api-0\" (UID: \"b3abb705-1e8c-4922-a449-616479bf0721\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.920537 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/b3abb705-1e8c-4922-a449-616479bf0721-public-tls-certs\") pod \"nova-api-0\" (UID: \"b3abb705-1e8c-4922-a449-616479bf0721\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.920628 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b3abb705-1e8c-4922-a449-616479bf0721-logs\") pod \"nova-api-0\" (UID: \"b3abb705-1e8c-4922-a449-616479bf0721\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.920656 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8a564f44-3c8d-4dff-b968-96f276382786-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"8a564f44-3c8d-4dff-b968-96f276382786\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.920780 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/8a564f44-3c8d-4dff-b968-96f276382786-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"8a564f44-3c8d-4dff-b968-96f276382786\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.920841 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9vfxc\" (UniqueName: \"kubernetes.io/projected/b3abb705-1e8c-4922-a449-616479bf0721-kube-api-access-9vfxc\") pod \"nova-api-0\" (UID: \"b3abb705-1e8c-4922-a449-616479bf0721\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.920917 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8a564f44-3c8d-4dff-b968-96f276382786-logs\") pod \"nova-metadata-0\" (UID: \"8a564f44-3c8d-4dff-b968-96f276382786\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.921316 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8a564f44-3c8d-4dff-b968-96f276382786-logs\") pod \"nova-metadata-0\" (UID: \"8a564f44-3c8d-4dff-b968-96f276382786\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.922719 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b3abb705-1e8c-4922-a449-616479bf0721-logs\") pod \"nova-api-0\" (UID: \"b3abb705-1e8c-4922-a449-616479bf0721\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.926900 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b3abb705-1e8c-4922-a449-616479bf0721-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"b3abb705-1e8c-4922-a449-616479bf0721\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.927027 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/b3abb705-1e8c-4922-a449-616479bf0721-public-tls-certs\") pod \"nova-api-0\" (UID: \"b3abb705-1e8c-4922-a449-616479bf0721\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.927627 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/b3abb705-1e8c-4922-a449-616479bf0721-internal-tls-certs\") pod \"nova-api-0\" (UID: \"b3abb705-1e8c-4922-a449-616479bf0721\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.928790 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8a564f44-3c8d-4dff-b968-96f276382786-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"8a564f44-3c8d-4dff-b968-96f276382786\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.929400 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8a564f44-3c8d-4dff-b968-96f276382786-config-data\") pod \"nova-metadata-0\" (UID: \"8a564f44-3c8d-4dff-b968-96f276382786\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.929878 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b3abb705-1e8c-4922-a449-616479bf0721-config-data\") pod \"nova-api-0\" (UID: \"b3abb705-1e8c-4922-a449-616479bf0721\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.930021 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/8a564f44-3c8d-4dff-b968-96f276382786-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"8a564f44-3c8d-4dff-b968-96f276382786\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.942938 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vfxc\" (UniqueName: \"kubernetes.io/projected/b3abb705-1e8c-4922-a449-616479bf0721-kube-api-access-9vfxc\") pod \"nova-api-0\" (UID: \"b3abb705-1e8c-4922-a449-616479bf0721\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.943581 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ksh5\" (UniqueName: \"kubernetes.io/projected/8a564f44-3c8d-4dff-b968-96f276382786-kube-api-access-5ksh5\") pod \"nova-metadata-0\" (UID: \"8a564f44-3c8d-4dff-b968-96f276382786\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.951008 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:51:39 crc kubenswrapper[5120]: I0316 16:51:39.978878 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:51:40 crc kubenswrapper[5120]: I0316 16:51:40.435685 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:51:40 crc kubenswrapper[5120]: I0316 16:51:40.525905 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"b3abb705-1e8c-4922-a449-616479bf0721","Type":"ContainerStarted","Data":"6928e73af7b17a1bda240411ad8f161cc88491300ba4dfe0ca3535865049d782"} Mar 16 16:51:40 crc kubenswrapper[5120]: I0316 16:51:40.527710 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:51:40 crc kubenswrapper[5120]: I0316 16:51:40.531297 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="5fb0cf64-0c42-43e1-8653-abce2f04520a" containerName="nova-scheduler-scheduler" containerID="cri-o://92afa50f82f57d1996b20bf453bdb7a41b77104d36fb062065416da1feedfd6a" gracePeriod=30 Mar 16 16:51:40 crc kubenswrapper[5120]: I0316 16:51:40.675943 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7dbe7cf5-e8a9-4037-85a4-3d1037495e0a" path="/var/lib/kubelet/pods/7dbe7cf5-e8a9-4037-85a4-3d1037495e0a/volumes" Mar 16 16:51:40 crc kubenswrapper[5120]: I0316 16:51:40.676554 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a6f1dbb0-3139-400a-97f4-f87e17691da5" path="/var/lib/kubelet/pods/a6f1dbb0-3139-400a-97f4-f87e17691da5/volumes" Mar 16 16:51:41 crc kubenswrapper[5120]: I0316 16:51:41.020016 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:51:41 crc kubenswrapper[5120]: I0316 16:51:41.408715 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:51:41 crc kubenswrapper[5120]: I0316 16:51:41.472871 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5fb0cf64-0c42-43e1-8653-abce2f04520a-combined-ca-bundle\") pod \"5fb0cf64-0c42-43e1-8653-abce2f04520a\" (UID: \"5fb0cf64-0c42-43e1-8653-abce2f04520a\") " Mar 16 16:51:41 crc kubenswrapper[5120]: I0316 16:51:41.473961 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5fb0cf64-0c42-43e1-8653-abce2f04520a-config-data\") pod \"5fb0cf64-0c42-43e1-8653-abce2f04520a\" (UID: \"5fb0cf64-0c42-43e1-8653-abce2f04520a\") " Mar 16 16:51:41 crc kubenswrapper[5120]: I0316 16:51:41.474020 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6dz57\" (UniqueName: \"kubernetes.io/projected/5fb0cf64-0c42-43e1-8653-abce2f04520a-kube-api-access-6dz57\") pod \"5fb0cf64-0c42-43e1-8653-abce2f04520a\" (UID: \"5fb0cf64-0c42-43e1-8653-abce2f04520a\") " Mar 16 16:51:41 crc kubenswrapper[5120]: I0316 16:51:41.478465 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5fb0cf64-0c42-43e1-8653-abce2f04520a-kube-api-access-6dz57" (OuterVolumeSpecName: "kube-api-access-6dz57") pod "5fb0cf64-0c42-43e1-8653-abce2f04520a" (UID: "5fb0cf64-0c42-43e1-8653-abce2f04520a"). InnerVolumeSpecName "kube-api-access-6dz57". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:51:41 crc kubenswrapper[5120]: I0316 16:51:41.501981 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5fb0cf64-0c42-43e1-8653-abce2f04520a-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "5fb0cf64-0c42-43e1-8653-abce2f04520a" (UID: "5fb0cf64-0c42-43e1-8653-abce2f04520a"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:51:41 crc kubenswrapper[5120]: I0316 16:51:41.503939 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5fb0cf64-0c42-43e1-8653-abce2f04520a-config-data" (OuterVolumeSpecName: "config-data") pod "5fb0cf64-0c42-43e1-8653-abce2f04520a" (UID: "5fb0cf64-0c42-43e1-8653-abce2f04520a"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:51:41 crc kubenswrapper[5120]: I0316 16:51:41.544122 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"b3abb705-1e8c-4922-a449-616479bf0721","Type":"ContainerStarted","Data":"0d81c2b074c35c712a28eea449678c1bb236db51f5c95f1df01bdf619672c22d"} Mar 16 16:51:41 crc kubenswrapper[5120]: I0316 16:51:41.544177 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"b3abb705-1e8c-4922-a449-616479bf0721","Type":"ContainerStarted","Data":"b1398616db52eed8170c4625ae054d108d6793d99ce5ec107004afe72c8bcb39"} Mar 16 16:51:41 crc kubenswrapper[5120]: I0316 16:51:41.549312 5120 generic.go:358] "Generic (PLEG): container finished" podID="5fb0cf64-0c42-43e1-8653-abce2f04520a" containerID="92afa50f82f57d1996b20bf453bdb7a41b77104d36fb062065416da1feedfd6a" exitCode=0 Mar 16 16:51:41 crc kubenswrapper[5120]: I0316 16:51:41.549428 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:51:41 crc kubenswrapper[5120]: I0316 16:51:41.549464 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"5fb0cf64-0c42-43e1-8653-abce2f04520a","Type":"ContainerDied","Data":"92afa50f82f57d1996b20bf453bdb7a41b77104d36fb062065416da1feedfd6a"} Mar 16 16:51:41 crc kubenswrapper[5120]: I0316 16:51:41.549528 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"5fb0cf64-0c42-43e1-8653-abce2f04520a","Type":"ContainerDied","Data":"4ce04ef26d40a53e305c7d4453ca5852a613cd3d80d02a12ed871f6e2ff483a9"} Mar 16 16:51:41 crc kubenswrapper[5120]: I0316 16:51:41.549555 5120 scope.go:117] "RemoveContainer" containerID="92afa50f82f57d1996b20bf453bdb7a41b77104d36fb062065416da1feedfd6a" Mar 16 16:51:41 crc kubenswrapper[5120]: I0316 16:51:41.553362 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"8a564f44-3c8d-4dff-b968-96f276382786","Type":"ContainerStarted","Data":"2f86dbe111359426e7c3145a6535162eda586f161b335551970a0c38fcb780ec"} Mar 16 16:51:41 crc kubenswrapper[5120]: I0316 16:51:41.553413 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"8a564f44-3c8d-4dff-b968-96f276382786","Type":"ContainerStarted","Data":"0970df69e7dcb99e02e2b51ae8385d57de92fa7a1df72fa7d9dc8321b67d814b"} Mar 16 16:51:41 crc kubenswrapper[5120]: I0316 16:51:41.553425 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"8a564f44-3c8d-4dff-b968-96f276382786","Type":"ContainerStarted","Data":"ce94507326157848414a61aacbca19082c0442507f48c133d55fa7f03f76d724"} Mar 16 16:51:41 crc kubenswrapper[5120]: I0316 16:51:41.580460 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5fb0cf64-0c42-43e1-8653-abce2f04520a-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:51:41 crc kubenswrapper[5120]: I0316 16:51:41.580509 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6dz57\" (UniqueName: \"kubernetes.io/projected/5fb0cf64-0c42-43e1-8653-abce2f04520a-kube-api-access-6dz57\") on node \"crc\" DevicePath \"\"" Mar 16 16:51:41 crc kubenswrapper[5120]: I0316 16:51:41.580525 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5fb0cf64-0c42-43e1-8653-abce2f04520a-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:51:41 crc kubenswrapper[5120]: I0316 16:51:41.584407 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=2.5843517670000002 podStartE2EDuration="2.584351767s" podCreationTimestamp="2026-03-16 16:51:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:51:41.566200829 +0000 UTC m=+4803.720132516" watchObservedRunningTime="2026-03-16 16:51:41.584351767 +0000 UTC m=+4803.738283434" Mar 16 16:51:41 crc kubenswrapper[5120]: I0316 16:51:41.603329 5120 scope.go:117] "RemoveContainer" containerID="92afa50f82f57d1996b20bf453bdb7a41b77104d36fb062065416da1feedfd6a" Mar 16 16:51:41 crc kubenswrapper[5120]: E0316 16:51:41.605059 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"92afa50f82f57d1996b20bf453bdb7a41b77104d36fb062065416da1feedfd6a\": container with ID starting with 92afa50f82f57d1996b20bf453bdb7a41b77104d36fb062065416da1feedfd6a not found: ID does not exist" containerID="92afa50f82f57d1996b20bf453bdb7a41b77104d36fb062065416da1feedfd6a" Mar 16 16:51:41 crc kubenswrapper[5120]: I0316 16:51:41.605109 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92afa50f82f57d1996b20bf453bdb7a41b77104d36fb062065416da1feedfd6a"} err="failed to get container status \"92afa50f82f57d1996b20bf453bdb7a41b77104d36fb062065416da1feedfd6a\": rpc error: code = NotFound desc = could not find container \"92afa50f82f57d1996b20bf453bdb7a41b77104d36fb062065416da1feedfd6a\": container with ID starting with 92afa50f82f57d1996b20bf453bdb7a41b77104d36fb062065416da1feedfd6a not found: ID does not exist" Mar 16 16:51:41 crc kubenswrapper[5120]: I0316 16:51:41.605826 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=2.605811465 podStartE2EDuration="2.605811465s" podCreationTimestamp="2026-03-16 16:51:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:51:41.59393123 +0000 UTC m=+4803.747862887" watchObservedRunningTime="2026-03-16 16:51:41.605811465 +0000 UTC m=+4803.759743132" Mar 16 16:51:41 crc kubenswrapper[5120]: I0316 16:51:41.651614 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:51:41 crc kubenswrapper[5120]: I0316 16:51:41.660540 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:51:41 crc kubenswrapper[5120]: I0316 16:51:41.669682 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:51:41 crc kubenswrapper[5120]: I0316 16:51:41.671270 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5fb0cf64-0c42-43e1-8653-abce2f04520a" containerName="nova-scheduler-scheduler" Mar 16 16:51:41 crc kubenswrapper[5120]: I0316 16:51:41.671299 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="5fb0cf64-0c42-43e1-8653-abce2f04520a" containerName="nova-scheduler-scheduler" Mar 16 16:51:41 crc kubenswrapper[5120]: I0316 16:51:41.671560 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="5fb0cf64-0c42-43e1-8653-abce2f04520a" containerName="nova-scheduler-scheduler" Mar 16 16:51:41 crc kubenswrapper[5120]: I0316 16:51:41.680358 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:51:41 crc kubenswrapper[5120]: I0316 16:51:41.680511 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:51:41 crc kubenswrapper[5120]: I0316 16:51:41.690011 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-scheduler-config-data\"" Mar 16 16:51:41 crc kubenswrapper[5120]: I0316 16:51:41.785205 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rf8s\" (UniqueName: \"kubernetes.io/projected/37c6de80-ff10-4d44-a806-b8ad82e62d82-kube-api-access-8rf8s\") pod \"nova-scheduler-0\" (UID: \"37c6de80-ff10-4d44-a806-b8ad82e62d82\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:51:41 crc kubenswrapper[5120]: I0316 16:51:41.785693 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/37c6de80-ff10-4d44-a806-b8ad82e62d82-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"37c6de80-ff10-4d44-a806-b8ad82e62d82\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:51:41 crc kubenswrapper[5120]: I0316 16:51:41.785828 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/37c6de80-ff10-4d44-a806-b8ad82e62d82-config-data\") pod \"nova-scheduler-0\" (UID: \"37c6de80-ff10-4d44-a806-b8ad82e62d82\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:51:41 crc kubenswrapper[5120]: I0316 16:51:41.887924 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8rf8s\" (UniqueName: \"kubernetes.io/projected/37c6de80-ff10-4d44-a806-b8ad82e62d82-kube-api-access-8rf8s\") pod \"nova-scheduler-0\" (UID: \"37c6de80-ff10-4d44-a806-b8ad82e62d82\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:51:41 crc kubenswrapper[5120]: I0316 16:51:41.888073 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/37c6de80-ff10-4d44-a806-b8ad82e62d82-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"37c6de80-ff10-4d44-a806-b8ad82e62d82\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:51:41 crc kubenswrapper[5120]: I0316 16:51:41.888180 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/37c6de80-ff10-4d44-a806-b8ad82e62d82-config-data\") pod \"nova-scheduler-0\" (UID: \"37c6de80-ff10-4d44-a806-b8ad82e62d82\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:51:41 crc kubenswrapper[5120]: I0316 16:51:41.893578 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/37c6de80-ff10-4d44-a806-b8ad82e62d82-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"37c6de80-ff10-4d44-a806-b8ad82e62d82\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:51:41 crc kubenswrapper[5120]: I0316 16:51:41.903410 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/37c6de80-ff10-4d44-a806-b8ad82e62d82-config-data\") pod \"nova-scheduler-0\" (UID: \"37c6de80-ff10-4d44-a806-b8ad82e62d82\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:51:41 crc kubenswrapper[5120]: I0316 16:51:41.914067 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rf8s\" (UniqueName: \"kubernetes.io/projected/37c6de80-ff10-4d44-a806-b8ad82e62d82-kube-api-access-8rf8s\") pod \"nova-scheduler-0\" (UID: \"37c6de80-ff10-4d44-a806-b8ad82e62d82\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:51:41 crc kubenswrapper[5120]: I0316 16:51:41.998179 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:51:42 crc kubenswrapper[5120]: I0316 16:51:42.433560 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:51:42 crc kubenswrapper[5120]: I0316 16:51:42.564509 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"37c6de80-ff10-4d44-a806-b8ad82e62d82","Type":"ContainerStarted","Data":"0982eea59a394495c17b6233f9b1ef735cc558e5b0c7ba79e5e4cf4a4f418e3c"} Mar 16 16:51:42 crc kubenswrapper[5120]: I0316 16:51:42.673805 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5fb0cf64-0c42-43e1-8653-abce2f04520a" path="/var/lib/kubelet/pods/5fb0cf64-0c42-43e1-8653-abce2f04520a/volumes" Mar 16 16:51:43 crc kubenswrapper[5120]: I0316 16:51:43.579219 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"37c6de80-ff10-4d44-a806-b8ad82e62d82","Type":"ContainerStarted","Data":"35987799f969f71c82b912431ea13f98b634d539c89a2bd6ce077420efb8f161"} Mar 16 16:51:43 crc kubenswrapper[5120]: I0316 16:51:43.599363 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-scheduler-0" podStartSLOduration=2.599347237 podStartE2EDuration="2.599347237s" podCreationTimestamp="2026-03-16 16:51:41 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:51:43.598653709 +0000 UTC m=+4805.752585416" watchObservedRunningTime="2026-03-16 16:51:43.599347237 +0000 UTC m=+4805.753278884" Mar 16 16:51:44 crc kubenswrapper[5120]: I0316 16:51:44.525237 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 16:51:44 crc kubenswrapper[5120]: I0316 16:51:44.525494 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/kube-state-metrics-0" podUID="42e40835-5700-459b-9305-620ef2e878bd" containerName="kube-state-metrics" containerID="cri-o://698c9b4f317d85a2377119c53ce2796dc7e12e87855669823ca2d9866a9442f2" gracePeriod=30 Mar 16 16:51:45 crc kubenswrapper[5120]: I0316 16:51:45.126871 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:51:45 crc kubenswrapper[5120]: I0316 16:51:45.278529 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p9hgn\" (UniqueName: \"kubernetes.io/projected/42e40835-5700-459b-9305-620ef2e878bd-kube-api-access-p9hgn\") pod \"42e40835-5700-459b-9305-620ef2e878bd\" (UID: \"42e40835-5700-459b-9305-620ef2e878bd\") " Mar 16 16:51:45 crc kubenswrapper[5120]: I0316 16:51:45.285654 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42e40835-5700-459b-9305-620ef2e878bd-kube-api-access-p9hgn" (OuterVolumeSpecName: "kube-api-access-p9hgn") pod "42e40835-5700-459b-9305-620ef2e878bd" (UID: "42e40835-5700-459b-9305-620ef2e878bd"). InnerVolumeSpecName "kube-api-access-p9hgn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:51:45 crc kubenswrapper[5120]: I0316 16:51:45.382356 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p9hgn\" (UniqueName: \"kubernetes.io/projected/42e40835-5700-459b-9305-620ef2e878bd-kube-api-access-p9hgn\") on node \"crc\" DevicePath \"\"" Mar 16 16:51:45 crc kubenswrapper[5120]: I0316 16:51:45.604366 5120 generic.go:358] "Generic (PLEG): container finished" podID="42e40835-5700-459b-9305-620ef2e878bd" containerID="698c9b4f317d85a2377119c53ce2796dc7e12e87855669823ca2d9866a9442f2" exitCode=2 Mar 16 16:51:45 crc kubenswrapper[5120]: I0316 16:51:45.605345 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:51:45 crc kubenswrapper[5120]: I0316 16:51:45.605381 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"42e40835-5700-459b-9305-620ef2e878bd","Type":"ContainerDied","Data":"698c9b4f317d85a2377119c53ce2796dc7e12e87855669823ca2d9866a9442f2"} Mar 16 16:51:45 crc kubenswrapper[5120]: I0316 16:51:45.605431 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"42e40835-5700-459b-9305-620ef2e878bd","Type":"ContainerDied","Data":"f731517b1564d31a06e54530141db771fe71f314638f0fffff9e3351f576c74a"} Mar 16 16:51:45 crc kubenswrapper[5120]: I0316 16:51:45.605456 5120 scope.go:117] "RemoveContainer" containerID="698c9b4f317d85a2377119c53ce2796dc7e12e87855669823ca2d9866a9442f2" Mar 16 16:51:45 crc kubenswrapper[5120]: I0316 16:51:45.642834 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 16:51:45 crc kubenswrapper[5120]: I0316 16:51:45.646050 5120 scope.go:117] "RemoveContainer" containerID="698c9b4f317d85a2377119c53ce2796dc7e12e87855669823ca2d9866a9442f2" Mar 16 16:51:45 crc kubenswrapper[5120]: E0316 16:51:45.655969 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"698c9b4f317d85a2377119c53ce2796dc7e12e87855669823ca2d9866a9442f2\": container with ID starting with 698c9b4f317d85a2377119c53ce2796dc7e12e87855669823ca2d9866a9442f2 not found: ID does not exist" containerID="698c9b4f317d85a2377119c53ce2796dc7e12e87855669823ca2d9866a9442f2" Mar 16 16:51:45 crc kubenswrapper[5120]: I0316 16:51:45.656017 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"698c9b4f317d85a2377119c53ce2796dc7e12e87855669823ca2d9866a9442f2"} err="failed to get container status \"698c9b4f317d85a2377119c53ce2796dc7e12e87855669823ca2d9866a9442f2\": rpc error: code = NotFound desc = could not find container \"698c9b4f317d85a2377119c53ce2796dc7e12e87855669823ca2d9866a9442f2\": container with ID starting with 698c9b4f317d85a2377119c53ce2796dc7e12e87855669823ca2d9866a9442f2 not found: ID does not exist" Mar 16 16:51:45 crc kubenswrapper[5120]: I0316 16:51:45.672434 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 16:51:45 crc kubenswrapper[5120]: I0316 16:51:45.683451 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 16:51:45 crc kubenswrapper[5120]: I0316 16:51:45.684909 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42e40835-5700-459b-9305-620ef2e878bd" containerName="kube-state-metrics" Mar 16 16:51:45 crc kubenswrapper[5120]: I0316 16:51:45.684935 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="42e40835-5700-459b-9305-620ef2e878bd" containerName="kube-state-metrics" Mar 16 16:51:45 crc kubenswrapper[5120]: I0316 16:51:45.685201 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="42e40835-5700-459b-9305-620ef2e878bd" containerName="kube-state-metrics" Mar 16 16:51:45 crc kubenswrapper[5120]: I0316 16:51:45.691252 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:51:45 crc kubenswrapper[5120]: I0316 16:51:45.693417 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-kube-state-metrics-svc\"" Mar 16 16:51:45 crc kubenswrapper[5120]: I0316 16:51:45.697358 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"kube-state-metrics-tls-config\"" Mar 16 16:51:45 crc kubenswrapper[5120]: I0316 16:51:45.707062 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 16:51:45 crc kubenswrapper[5120]: I0316 16:51:45.792736 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6pbsz\" (UniqueName: \"kubernetes.io/projected/70574728-2a53-4b17-941b-e437321d936c-kube-api-access-6pbsz\") pod \"kube-state-metrics-0\" (UID: \"70574728-2a53-4b17-941b-e437321d936c\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:51:45 crc kubenswrapper[5120]: I0316 16:51:45.792841 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/70574728-2a53-4b17-941b-e437321d936c-kube-state-metrics-tls-config\") pod \"kube-state-metrics-0\" (UID: \"70574728-2a53-4b17-941b-e437321d936c\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:51:45 crc kubenswrapper[5120]: I0316 16:51:45.793455 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/70574728-2a53-4b17-941b-e437321d936c-combined-ca-bundle\") pod \"kube-state-metrics-0\" (UID: \"70574728-2a53-4b17-941b-e437321d936c\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:51:45 crc kubenswrapper[5120]: I0316 16:51:45.794212 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/70574728-2a53-4b17-941b-e437321d936c-kube-state-metrics-tls-certs\") pod \"kube-state-metrics-0\" (UID: \"70574728-2a53-4b17-941b-e437321d936c\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:51:45 crc kubenswrapper[5120]: I0316 16:51:45.870725 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-v822j_ac55471d-4e42-475f-a082-50f611571482/kube-multus/0.log" Mar 16 16:51:45 crc kubenswrapper[5120]: I0316 16:51:45.878877 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-crc_9f0bc7fcb0822a2c13eb2d22cd8c0641/kube-controller-manager/0.log" Mar 16 16:51:45 crc kubenswrapper[5120]: I0316 16:51:45.884122 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-v822j_ac55471d-4e42-475f-a082-50f611571482/kube-multus/0.log" Mar 16 16:51:45 crc kubenswrapper[5120]: I0316 16:51:45.890477 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-crc_9f0bc7fcb0822a2c13eb2d22cd8c0641/kube-controller-manager/0.log" Mar 16 16:51:45 crc kubenswrapper[5120]: I0316 16:51:45.899484 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/70574728-2a53-4b17-941b-e437321d936c-combined-ca-bundle\") pod \"kube-state-metrics-0\" (UID: \"70574728-2a53-4b17-941b-e437321d936c\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:51:45 crc kubenswrapper[5120]: I0316 16:51:45.899622 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/70574728-2a53-4b17-941b-e437321d936c-kube-state-metrics-tls-certs\") pod \"kube-state-metrics-0\" (UID: \"70574728-2a53-4b17-941b-e437321d936c\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:51:45 crc kubenswrapper[5120]: I0316 16:51:45.899853 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6pbsz\" (UniqueName: \"kubernetes.io/projected/70574728-2a53-4b17-941b-e437321d936c-kube-api-access-6pbsz\") pod \"kube-state-metrics-0\" (UID: \"70574728-2a53-4b17-941b-e437321d936c\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:51:45 crc kubenswrapper[5120]: I0316 16:51:45.900001 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/70574728-2a53-4b17-941b-e437321d936c-kube-state-metrics-tls-config\") pod \"kube-state-metrics-0\" (UID: \"70574728-2a53-4b17-941b-e437321d936c\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:51:45 crc kubenswrapper[5120]: I0316 16:51:45.909603 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/70574728-2a53-4b17-941b-e437321d936c-kube-state-metrics-tls-certs\") pod \"kube-state-metrics-0\" (UID: \"70574728-2a53-4b17-941b-e437321d936c\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:51:45 crc kubenswrapper[5120]: I0316 16:51:45.909637 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/70574728-2a53-4b17-941b-e437321d936c-combined-ca-bundle\") pod \"kube-state-metrics-0\" (UID: \"70574728-2a53-4b17-941b-e437321d936c\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:51:45 crc kubenswrapper[5120]: I0316 16:51:45.912436 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/70574728-2a53-4b17-941b-e437321d936c-kube-state-metrics-tls-config\") pod \"kube-state-metrics-0\" (UID: \"70574728-2a53-4b17-941b-e437321d936c\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:51:45 crc kubenswrapper[5120]: I0316 16:51:45.920635 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6pbsz\" (UniqueName: \"kubernetes.io/projected/70574728-2a53-4b17-941b-e437321d936c-kube-api-access-6pbsz\") pod \"kube-state-metrics-0\" (UID: \"70574728-2a53-4b17-941b-e437321d936c\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:51:46 crc kubenswrapper[5120]: I0316 16:51:46.019735 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:51:46 crc kubenswrapper[5120]: I0316 16:51:46.496372 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 16:51:46 crc kubenswrapper[5120]: W0316 16:51:46.499027 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod70574728_2a53_4b17_941b_e437321d936c.slice/crio-aabc043f79852d74fd789cdb38394bef1b7d52d056cafc1583e41d9c1aa2610c WatchSource:0}: Error finding container aabc043f79852d74fd789cdb38394bef1b7d52d056cafc1583e41d9c1aa2610c: Status 404 returned error can't find the container with id aabc043f79852d74fd789cdb38394bef1b7d52d056cafc1583e41d9c1aa2610c Mar 16 16:51:46 crc kubenswrapper[5120]: I0316 16:51:46.599908 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:51:46 crc kubenswrapper[5120]: I0316 16:51:46.600243 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="80fb18b8-bf77-40ea-b1e0-3aaf669105cf" containerName="ceilometer-central-agent" containerID="cri-o://80ff5007813c4fe9e0adedf2f6c002cb23db55cf073abe867371ae2680fb055f" gracePeriod=30 Mar 16 16:51:46 crc kubenswrapper[5120]: I0316 16:51:46.600297 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="80fb18b8-bf77-40ea-b1e0-3aaf669105cf" containerName="ceilometer-notification-agent" containerID="cri-o://3cabff67a47069cf0fc3763bad22aac33ac2bcc133d14dadb9dcb928d1a398c5" gracePeriod=30 Mar 16 16:51:46 crc kubenswrapper[5120]: I0316 16:51:46.600316 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="80fb18b8-bf77-40ea-b1e0-3aaf669105cf" containerName="sg-core" containerID="cri-o://96754acd658afa00103c4e69b4aa4a9e8d4eb42cee4ed892fcca97422b7d4a9a" gracePeriod=30 Mar 16 16:51:46 crc kubenswrapper[5120]: I0316 16:51:46.600329 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="80fb18b8-bf77-40ea-b1e0-3aaf669105cf" containerName="proxy-httpd" containerID="cri-o://a7d5e5a671e901da3bd0d5c5089eebd248c33919242368e79004c9963ddc7435" gracePeriod=30 Mar 16 16:51:46 crc kubenswrapper[5120]: I0316 16:51:46.617450 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"70574728-2a53-4b17-941b-e437321d936c","Type":"ContainerStarted","Data":"aabc043f79852d74fd789cdb38394bef1b7d52d056cafc1583e41d9c1aa2610c"} Mar 16 16:51:46 crc kubenswrapper[5120]: I0316 16:51:46.675491 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="42e40835-5700-459b-9305-620ef2e878bd" path="/var/lib/kubelet/pods/42e40835-5700-459b-9305-620ef2e878bd/volumes" Mar 16 16:51:46 crc kubenswrapper[5120]: I0316 16:51:46.998528 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:51:47 crc kubenswrapper[5120]: I0316 16:51:47.631198 5120 generic.go:358] "Generic (PLEG): container finished" podID="80fb18b8-bf77-40ea-b1e0-3aaf669105cf" containerID="a7d5e5a671e901da3bd0d5c5089eebd248c33919242368e79004c9963ddc7435" exitCode=0 Mar 16 16:51:47 crc kubenswrapper[5120]: I0316 16:51:47.631234 5120 generic.go:358] "Generic (PLEG): container finished" podID="80fb18b8-bf77-40ea-b1e0-3aaf669105cf" containerID="96754acd658afa00103c4e69b4aa4a9e8d4eb42cee4ed892fcca97422b7d4a9a" exitCode=2 Mar 16 16:51:47 crc kubenswrapper[5120]: I0316 16:51:47.631242 5120 generic.go:358] "Generic (PLEG): container finished" podID="80fb18b8-bf77-40ea-b1e0-3aaf669105cf" containerID="80ff5007813c4fe9e0adedf2f6c002cb23db55cf073abe867371ae2680fb055f" exitCode=0 Mar 16 16:51:47 crc kubenswrapper[5120]: I0316 16:51:47.631278 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"80fb18b8-bf77-40ea-b1e0-3aaf669105cf","Type":"ContainerDied","Data":"a7d5e5a671e901da3bd0d5c5089eebd248c33919242368e79004c9963ddc7435"} Mar 16 16:51:47 crc kubenswrapper[5120]: I0316 16:51:47.631323 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"80fb18b8-bf77-40ea-b1e0-3aaf669105cf","Type":"ContainerDied","Data":"96754acd658afa00103c4e69b4aa4a9e8d4eb42cee4ed892fcca97422b7d4a9a"} Mar 16 16:51:47 crc kubenswrapper[5120]: I0316 16:51:47.631334 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"80fb18b8-bf77-40ea-b1e0-3aaf669105cf","Type":"ContainerDied","Data":"80ff5007813c4fe9e0adedf2f6c002cb23db55cf073abe867371ae2680fb055f"} Mar 16 16:51:47 crc kubenswrapper[5120]: I0316 16:51:47.633085 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"70574728-2a53-4b17-941b-e437321d936c","Type":"ContainerStarted","Data":"bad8f59b506232e4d0ac3673dae365123d4638c90ab2bc268e14c1ebf90f8454"} Mar 16 16:51:47 crc kubenswrapper[5120]: I0316 16:51:47.633148 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:51:47 crc kubenswrapper[5120]: I0316 16:51:47.663497 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/kube-state-metrics-0" podStartSLOduration=2.22475854 podStartE2EDuration="2.663477196s" podCreationTimestamp="2026-03-16 16:51:45 +0000 UTC" firstStartedPulling="2026-03-16 16:51:46.501379384 +0000 UTC m=+4808.655311041" lastFinishedPulling="2026-03-16 16:51:46.94009804 +0000 UTC m=+4809.094029697" observedRunningTime="2026-03-16 16:51:47.651328362 +0000 UTC m=+4809.805260029" watchObservedRunningTime="2026-03-16 16:51:47.663477196 +0000 UTC m=+4809.817408853" Mar 16 16:51:48 crc kubenswrapper[5120]: I0316 16:51:48.014952 5120 scope.go:117] "RemoveContainer" containerID="c884d9c9de37e1f61b04f7eb0e974e6a6a3ec2080b77e6a8aa54d6abdc051364" Mar 16 16:51:48 crc kubenswrapper[5120]: I0316 16:51:48.052544 5120 scope.go:117] "RemoveContainer" containerID="988cc78cd1a034b04ef4fe1c6b8c6446a3f4b4f920c30017e4f07d239fd47cf9" Mar 16 16:51:48 crc kubenswrapper[5120]: I0316 16:51:48.085699 5120 scope.go:117] "RemoveContainer" containerID="003073661eb6e19b10f6cf567edeb936c2c742ac60be9015f1217bdf877de6c2" Mar 16 16:51:48 crc kubenswrapper[5120]: I0316 16:51:48.105881 5120 scope.go:117] "RemoveContainer" containerID="1d73b9c9d778512c90fbbba6af4110c146eab5899bbf4e3cd6133df1fe84e7ca" Mar 16 16:51:48 crc kubenswrapper[5120]: I0316 16:51:48.132798 5120 scope.go:117] "RemoveContainer" containerID="45cb557a01c4d5f3fcaf3f1ae59379de4a157caa00add93b62710010548ac944" Mar 16 16:51:48 crc kubenswrapper[5120]: I0316 16:51:48.168202 5120 scope.go:117] "RemoveContainer" containerID="f182e6699482e456fa658eb8a49ef764c4fb838a5601db8f345f511d180cfe9d" Mar 16 16:51:48 crc kubenswrapper[5120]: I0316 16:51:48.197550 5120 scope.go:117] "RemoveContainer" containerID="c850be05d5aca34a4b506a8d1a6a6816d3a77902224755fcceb07ca0e744a3d9" Mar 16 16:51:49 crc kubenswrapper[5120]: I0316 16:51:49.480155 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:51:49 crc kubenswrapper[5120]: I0316 16:51:49.600229 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rc5fw\" (UniqueName: \"kubernetes.io/projected/80fb18b8-bf77-40ea-b1e0-3aaf669105cf-kube-api-access-rc5fw\") pod \"80fb18b8-bf77-40ea-b1e0-3aaf669105cf\" (UID: \"80fb18b8-bf77-40ea-b1e0-3aaf669105cf\") " Mar 16 16:51:49 crc kubenswrapper[5120]: I0316 16:51:49.600491 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/80fb18b8-bf77-40ea-b1e0-3aaf669105cf-config-data\") pod \"80fb18b8-bf77-40ea-b1e0-3aaf669105cf\" (UID: \"80fb18b8-bf77-40ea-b1e0-3aaf669105cf\") " Mar 16 16:51:49 crc kubenswrapper[5120]: I0316 16:51:49.601200 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/80fb18b8-bf77-40ea-b1e0-3aaf669105cf-combined-ca-bundle\") pod \"80fb18b8-bf77-40ea-b1e0-3aaf669105cf\" (UID: \"80fb18b8-bf77-40ea-b1e0-3aaf669105cf\") " Mar 16 16:51:49 crc kubenswrapper[5120]: I0316 16:51:49.601426 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/80fb18b8-bf77-40ea-b1e0-3aaf669105cf-log-httpd\") pod \"80fb18b8-bf77-40ea-b1e0-3aaf669105cf\" (UID: \"80fb18b8-bf77-40ea-b1e0-3aaf669105cf\") " Mar 16 16:51:49 crc kubenswrapper[5120]: I0316 16:51:49.601621 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/80fb18b8-bf77-40ea-b1e0-3aaf669105cf-run-httpd\") pod \"80fb18b8-bf77-40ea-b1e0-3aaf669105cf\" (UID: \"80fb18b8-bf77-40ea-b1e0-3aaf669105cf\") " Mar 16 16:51:49 crc kubenswrapper[5120]: I0316 16:51:49.601950 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80fb18b8-bf77-40ea-b1e0-3aaf669105cf-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "80fb18b8-bf77-40ea-b1e0-3aaf669105cf" (UID: "80fb18b8-bf77-40ea-b1e0-3aaf669105cf"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:51:49 crc kubenswrapper[5120]: I0316 16:51:49.601989 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80fb18b8-bf77-40ea-b1e0-3aaf669105cf-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "80fb18b8-bf77-40ea-b1e0-3aaf669105cf" (UID: "80fb18b8-bf77-40ea-b1e0-3aaf669105cf"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:51:49 crc kubenswrapper[5120]: I0316 16:51:49.602291 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/80fb18b8-bf77-40ea-b1e0-3aaf669105cf-scripts\") pod \"80fb18b8-bf77-40ea-b1e0-3aaf669105cf\" (UID: \"80fb18b8-bf77-40ea-b1e0-3aaf669105cf\") " Mar 16 16:51:49 crc kubenswrapper[5120]: I0316 16:51:49.602615 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/80fb18b8-bf77-40ea-b1e0-3aaf669105cf-sg-core-conf-yaml\") pod \"80fb18b8-bf77-40ea-b1e0-3aaf669105cf\" (UID: \"80fb18b8-bf77-40ea-b1e0-3aaf669105cf\") " Mar 16 16:51:49 crc kubenswrapper[5120]: I0316 16:51:49.603459 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/80fb18b8-bf77-40ea-b1e0-3aaf669105cf-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:51:49 crc kubenswrapper[5120]: I0316 16:51:49.603484 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/80fb18b8-bf77-40ea-b1e0-3aaf669105cf-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:51:49 crc kubenswrapper[5120]: I0316 16:51:49.606400 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80fb18b8-bf77-40ea-b1e0-3aaf669105cf-scripts" (OuterVolumeSpecName: "scripts") pod "80fb18b8-bf77-40ea-b1e0-3aaf669105cf" (UID: "80fb18b8-bf77-40ea-b1e0-3aaf669105cf"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:51:49 crc kubenswrapper[5120]: I0316 16:51:49.606707 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80fb18b8-bf77-40ea-b1e0-3aaf669105cf-kube-api-access-rc5fw" (OuterVolumeSpecName: "kube-api-access-rc5fw") pod "80fb18b8-bf77-40ea-b1e0-3aaf669105cf" (UID: "80fb18b8-bf77-40ea-b1e0-3aaf669105cf"). InnerVolumeSpecName "kube-api-access-rc5fw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:51:49 crc kubenswrapper[5120]: I0316 16:51:49.635724 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80fb18b8-bf77-40ea-b1e0-3aaf669105cf-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "80fb18b8-bf77-40ea-b1e0-3aaf669105cf" (UID: "80fb18b8-bf77-40ea-b1e0-3aaf669105cf"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:51:49 crc kubenswrapper[5120]: I0316 16:51:49.666994 5120 generic.go:358] "Generic (PLEG): container finished" podID="80fb18b8-bf77-40ea-b1e0-3aaf669105cf" containerID="3cabff67a47069cf0fc3763bad22aac33ac2bcc133d14dadb9dcb928d1a398c5" exitCode=0 Mar 16 16:51:49 crc kubenswrapper[5120]: I0316 16:51:49.667696 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:51:49 crc kubenswrapper[5120]: I0316 16:51:49.668319 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"80fb18b8-bf77-40ea-b1e0-3aaf669105cf","Type":"ContainerDied","Data":"3cabff67a47069cf0fc3763bad22aac33ac2bcc133d14dadb9dcb928d1a398c5"} Mar 16 16:51:49 crc kubenswrapper[5120]: I0316 16:51:49.668359 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"80fb18b8-bf77-40ea-b1e0-3aaf669105cf","Type":"ContainerDied","Data":"abbdac35262cef5fab1fd357d2315f4eee6908b358c53dabb6444ad7b5735307"} Mar 16 16:51:49 crc kubenswrapper[5120]: I0316 16:51:49.668379 5120 scope.go:117] "RemoveContainer" containerID="a7d5e5a671e901da3bd0d5c5089eebd248c33919242368e79004c9963ddc7435" Mar 16 16:51:49 crc kubenswrapper[5120]: I0316 16:51:49.691969 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80fb18b8-bf77-40ea-b1e0-3aaf669105cf-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "80fb18b8-bf77-40ea-b1e0-3aaf669105cf" (UID: "80fb18b8-bf77-40ea-b1e0-3aaf669105cf"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:51:49 crc kubenswrapper[5120]: I0316 16:51:49.706525 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/80fb18b8-bf77-40ea-b1e0-3aaf669105cf-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:51:49 crc kubenswrapper[5120]: I0316 16:51:49.706566 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/80fb18b8-bf77-40ea-b1e0-3aaf669105cf-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 16:51:49 crc kubenswrapper[5120]: I0316 16:51:49.706698 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rc5fw\" (UniqueName: \"kubernetes.io/projected/80fb18b8-bf77-40ea-b1e0-3aaf669105cf-kube-api-access-rc5fw\") on node \"crc\" DevicePath \"\"" Mar 16 16:51:49 crc kubenswrapper[5120]: I0316 16:51:49.706713 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/80fb18b8-bf77-40ea-b1e0-3aaf669105cf-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:51:49 crc kubenswrapper[5120]: I0316 16:51:49.713274 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80fb18b8-bf77-40ea-b1e0-3aaf669105cf-config-data" (OuterVolumeSpecName: "config-data") pod "80fb18b8-bf77-40ea-b1e0-3aaf669105cf" (UID: "80fb18b8-bf77-40ea-b1e0-3aaf669105cf"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:51:49 crc kubenswrapper[5120]: I0316 16:51:49.720367 5120 scope.go:117] "RemoveContainer" containerID="96754acd658afa00103c4e69b4aa4a9e8d4eb42cee4ed892fcca97422b7d4a9a" Mar 16 16:51:49 crc kubenswrapper[5120]: I0316 16:51:49.746704 5120 scope.go:117] "RemoveContainer" containerID="3cabff67a47069cf0fc3763bad22aac33ac2bcc133d14dadb9dcb928d1a398c5" Mar 16 16:51:49 crc kubenswrapper[5120]: I0316 16:51:49.766721 5120 scope.go:117] "RemoveContainer" containerID="80ff5007813c4fe9e0adedf2f6c002cb23db55cf073abe867371ae2680fb055f" Mar 16 16:51:49 crc kubenswrapper[5120]: I0316 16:51:49.790958 5120 scope.go:117] "RemoveContainer" containerID="a7d5e5a671e901da3bd0d5c5089eebd248c33919242368e79004c9963ddc7435" Mar 16 16:51:49 crc kubenswrapper[5120]: E0316 16:51:49.791367 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a7d5e5a671e901da3bd0d5c5089eebd248c33919242368e79004c9963ddc7435\": container with ID starting with a7d5e5a671e901da3bd0d5c5089eebd248c33919242368e79004c9963ddc7435 not found: ID does not exist" containerID="a7d5e5a671e901da3bd0d5c5089eebd248c33919242368e79004c9963ddc7435" Mar 16 16:51:49 crc kubenswrapper[5120]: I0316 16:51:49.791408 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7d5e5a671e901da3bd0d5c5089eebd248c33919242368e79004c9963ddc7435"} err="failed to get container status \"a7d5e5a671e901da3bd0d5c5089eebd248c33919242368e79004c9963ddc7435\": rpc error: code = NotFound desc = could not find container \"a7d5e5a671e901da3bd0d5c5089eebd248c33919242368e79004c9963ddc7435\": container with ID starting with a7d5e5a671e901da3bd0d5c5089eebd248c33919242368e79004c9963ddc7435 not found: ID does not exist" Mar 16 16:51:49 crc kubenswrapper[5120]: I0316 16:51:49.791433 5120 scope.go:117] "RemoveContainer" containerID="96754acd658afa00103c4e69b4aa4a9e8d4eb42cee4ed892fcca97422b7d4a9a" Mar 16 16:51:49 crc kubenswrapper[5120]: E0316 16:51:49.791628 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"96754acd658afa00103c4e69b4aa4a9e8d4eb42cee4ed892fcca97422b7d4a9a\": container with ID starting with 96754acd658afa00103c4e69b4aa4a9e8d4eb42cee4ed892fcca97422b7d4a9a not found: ID does not exist" containerID="96754acd658afa00103c4e69b4aa4a9e8d4eb42cee4ed892fcca97422b7d4a9a" Mar 16 16:51:49 crc kubenswrapper[5120]: I0316 16:51:49.791651 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96754acd658afa00103c4e69b4aa4a9e8d4eb42cee4ed892fcca97422b7d4a9a"} err="failed to get container status \"96754acd658afa00103c4e69b4aa4a9e8d4eb42cee4ed892fcca97422b7d4a9a\": rpc error: code = NotFound desc = could not find container \"96754acd658afa00103c4e69b4aa4a9e8d4eb42cee4ed892fcca97422b7d4a9a\": container with ID starting with 96754acd658afa00103c4e69b4aa4a9e8d4eb42cee4ed892fcca97422b7d4a9a not found: ID does not exist" Mar 16 16:51:49 crc kubenswrapper[5120]: I0316 16:51:49.791667 5120 scope.go:117] "RemoveContainer" containerID="3cabff67a47069cf0fc3763bad22aac33ac2bcc133d14dadb9dcb928d1a398c5" Mar 16 16:51:49 crc kubenswrapper[5120]: E0316 16:51:49.791853 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3cabff67a47069cf0fc3763bad22aac33ac2bcc133d14dadb9dcb928d1a398c5\": container with ID starting with 3cabff67a47069cf0fc3763bad22aac33ac2bcc133d14dadb9dcb928d1a398c5 not found: ID does not exist" containerID="3cabff67a47069cf0fc3763bad22aac33ac2bcc133d14dadb9dcb928d1a398c5" Mar 16 16:51:49 crc kubenswrapper[5120]: I0316 16:51:49.791874 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3cabff67a47069cf0fc3763bad22aac33ac2bcc133d14dadb9dcb928d1a398c5"} err="failed to get container status \"3cabff67a47069cf0fc3763bad22aac33ac2bcc133d14dadb9dcb928d1a398c5\": rpc error: code = NotFound desc = could not find container \"3cabff67a47069cf0fc3763bad22aac33ac2bcc133d14dadb9dcb928d1a398c5\": container with ID starting with 3cabff67a47069cf0fc3763bad22aac33ac2bcc133d14dadb9dcb928d1a398c5 not found: ID does not exist" Mar 16 16:51:49 crc kubenswrapper[5120]: I0316 16:51:49.791892 5120 scope.go:117] "RemoveContainer" containerID="80ff5007813c4fe9e0adedf2f6c002cb23db55cf073abe867371ae2680fb055f" Mar 16 16:51:49 crc kubenswrapper[5120]: E0316 16:51:49.792062 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"80ff5007813c4fe9e0adedf2f6c002cb23db55cf073abe867371ae2680fb055f\": container with ID starting with 80ff5007813c4fe9e0adedf2f6c002cb23db55cf073abe867371ae2680fb055f not found: ID does not exist" containerID="80ff5007813c4fe9e0adedf2f6c002cb23db55cf073abe867371ae2680fb055f" Mar 16 16:51:49 crc kubenswrapper[5120]: I0316 16:51:49.792081 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80ff5007813c4fe9e0adedf2f6c002cb23db55cf073abe867371ae2680fb055f"} err="failed to get container status \"80ff5007813c4fe9e0adedf2f6c002cb23db55cf073abe867371ae2680fb055f\": rpc error: code = NotFound desc = could not find container \"80ff5007813c4fe9e0adedf2f6c002cb23db55cf073abe867371ae2680fb055f\": container with ID starting with 80ff5007813c4fe9e0adedf2f6c002cb23db55cf073abe867371ae2680fb055f not found: ID does not exist" Mar 16 16:51:49 crc kubenswrapper[5120]: I0316 16:51:49.809613 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/80fb18b8-bf77-40ea-b1e0-3aaf669105cf-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:51:49 crc kubenswrapper[5120]: I0316 16:51:49.954091 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:51:49 crc kubenswrapper[5120]: I0316 16:51:49.954437 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:51:49 crc kubenswrapper[5120]: I0316 16:51:49.979263 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:51:49 crc kubenswrapper[5120]: I0316 16:51:49.979380 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:51:50 crc kubenswrapper[5120]: I0316 16:51:50.016819 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:51:50 crc kubenswrapper[5120]: I0316 16:51:50.026280 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:51:50 crc kubenswrapper[5120]: I0316 16:51:50.043493 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:51:50 crc kubenswrapper[5120]: I0316 16:51:50.044511 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80fb18b8-bf77-40ea-b1e0-3aaf669105cf" containerName="ceilometer-notification-agent" Mar 16 16:51:50 crc kubenswrapper[5120]: I0316 16:51:50.044533 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="80fb18b8-bf77-40ea-b1e0-3aaf669105cf" containerName="ceilometer-notification-agent" Mar 16 16:51:50 crc kubenswrapper[5120]: I0316 16:51:50.044573 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80fb18b8-bf77-40ea-b1e0-3aaf669105cf" containerName="proxy-httpd" Mar 16 16:51:50 crc kubenswrapper[5120]: I0316 16:51:50.044580 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="80fb18b8-bf77-40ea-b1e0-3aaf669105cf" containerName="proxy-httpd" Mar 16 16:51:50 crc kubenswrapper[5120]: I0316 16:51:50.044595 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80fb18b8-bf77-40ea-b1e0-3aaf669105cf" containerName="ceilometer-central-agent" Mar 16 16:51:50 crc kubenswrapper[5120]: I0316 16:51:50.044600 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="80fb18b8-bf77-40ea-b1e0-3aaf669105cf" containerName="ceilometer-central-agent" Mar 16 16:51:50 crc kubenswrapper[5120]: I0316 16:51:50.044613 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80fb18b8-bf77-40ea-b1e0-3aaf669105cf" containerName="sg-core" Mar 16 16:51:50 crc kubenswrapper[5120]: I0316 16:51:50.044618 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="80fb18b8-bf77-40ea-b1e0-3aaf669105cf" containerName="sg-core" Mar 16 16:51:50 crc kubenswrapper[5120]: I0316 16:51:50.044814 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="80fb18b8-bf77-40ea-b1e0-3aaf669105cf" containerName="proxy-httpd" Mar 16 16:51:50 crc kubenswrapper[5120]: I0316 16:51:50.044828 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="80fb18b8-bf77-40ea-b1e0-3aaf669105cf" containerName="sg-core" Mar 16 16:51:50 crc kubenswrapper[5120]: I0316 16:51:50.044841 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="80fb18b8-bf77-40ea-b1e0-3aaf669105cf" containerName="ceilometer-central-agent" Mar 16 16:51:50 crc kubenswrapper[5120]: I0316 16:51:50.044851 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="80fb18b8-bf77-40ea-b1e0-3aaf669105cf" containerName="ceilometer-notification-agent" Mar 16 16:51:50 crc kubenswrapper[5120]: I0316 16:51:50.051946 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:51:50 crc kubenswrapper[5120]: I0316 16:51:50.055567 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 16:51:50 crc kubenswrapper[5120]: I0316 16:51:50.056195 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ceilometer-internal-svc\"" Mar 16 16:51:50 crc kubenswrapper[5120]: I0316 16:51:50.060809 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 16:51:50 crc kubenswrapper[5120]: I0316 16:51:50.064339 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:51:50 crc kubenswrapper[5120]: I0316 16:51:50.119591 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7e017064-86c6-413e-b003-2f5df3306952-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"7e017064-86c6-413e-b003-2f5df3306952\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:51:50 crc kubenswrapper[5120]: I0316 16:51:50.119647 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4bdr9\" (UniqueName: \"kubernetes.io/projected/7e017064-86c6-413e-b003-2f5df3306952-kube-api-access-4bdr9\") pod \"ceilometer-0\" (UID: \"7e017064-86c6-413e-b003-2f5df3306952\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:51:50 crc kubenswrapper[5120]: I0316 16:51:50.119878 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/7e017064-86c6-413e-b003-2f5df3306952-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"7e017064-86c6-413e-b003-2f5df3306952\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:51:50 crc kubenswrapper[5120]: I0316 16:51:50.119904 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7e017064-86c6-413e-b003-2f5df3306952-log-httpd\") pod \"ceilometer-0\" (UID: \"7e017064-86c6-413e-b003-2f5df3306952\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:51:50 crc kubenswrapper[5120]: I0316 16:51:50.120072 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/7e017064-86c6-413e-b003-2f5df3306952-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"7e017064-86c6-413e-b003-2f5df3306952\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:51:50 crc kubenswrapper[5120]: I0316 16:51:50.120096 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7e017064-86c6-413e-b003-2f5df3306952-run-httpd\") pod \"ceilometer-0\" (UID: \"7e017064-86c6-413e-b003-2f5df3306952\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:51:50 crc kubenswrapper[5120]: I0316 16:51:50.120139 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7e017064-86c6-413e-b003-2f5df3306952-config-data\") pod \"ceilometer-0\" (UID: \"7e017064-86c6-413e-b003-2f5df3306952\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:51:50 crc kubenswrapper[5120]: I0316 16:51:50.120197 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7e017064-86c6-413e-b003-2f5df3306952-scripts\") pod \"ceilometer-0\" (UID: \"7e017064-86c6-413e-b003-2f5df3306952\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:51:50 crc kubenswrapper[5120]: I0316 16:51:50.223138 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/7e017064-86c6-413e-b003-2f5df3306952-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"7e017064-86c6-413e-b003-2f5df3306952\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:51:50 crc kubenswrapper[5120]: I0316 16:51:50.223216 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7e017064-86c6-413e-b003-2f5df3306952-run-httpd\") pod \"ceilometer-0\" (UID: \"7e017064-86c6-413e-b003-2f5df3306952\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:51:50 crc kubenswrapper[5120]: I0316 16:51:50.223826 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7e017064-86c6-413e-b003-2f5df3306952-run-httpd\") pod \"ceilometer-0\" (UID: \"7e017064-86c6-413e-b003-2f5df3306952\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:51:50 crc kubenswrapper[5120]: I0316 16:51:50.223881 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7e017064-86c6-413e-b003-2f5df3306952-config-data\") pod \"ceilometer-0\" (UID: \"7e017064-86c6-413e-b003-2f5df3306952\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:51:50 crc kubenswrapper[5120]: I0316 16:51:50.223947 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7e017064-86c6-413e-b003-2f5df3306952-scripts\") pod \"ceilometer-0\" (UID: \"7e017064-86c6-413e-b003-2f5df3306952\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:51:50 crc kubenswrapper[5120]: I0316 16:51:50.224572 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7e017064-86c6-413e-b003-2f5df3306952-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"7e017064-86c6-413e-b003-2f5df3306952\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:51:50 crc kubenswrapper[5120]: I0316 16:51:50.224614 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4bdr9\" (UniqueName: \"kubernetes.io/projected/7e017064-86c6-413e-b003-2f5df3306952-kube-api-access-4bdr9\") pod \"ceilometer-0\" (UID: \"7e017064-86c6-413e-b003-2f5df3306952\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:51:50 crc kubenswrapper[5120]: I0316 16:51:50.224809 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/7e017064-86c6-413e-b003-2f5df3306952-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"7e017064-86c6-413e-b003-2f5df3306952\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:51:50 crc kubenswrapper[5120]: I0316 16:51:50.224882 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7e017064-86c6-413e-b003-2f5df3306952-log-httpd\") pod \"ceilometer-0\" (UID: \"7e017064-86c6-413e-b003-2f5df3306952\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:51:50 crc kubenswrapper[5120]: I0316 16:51:50.225318 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7e017064-86c6-413e-b003-2f5df3306952-log-httpd\") pod \"ceilometer-0\" (UID: \"7e017064-86c6-413e-b003-2f5df3306952\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:51:50 crc kubenswrapper[5120]: I0316 16:51:50.228419 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/7e017064-86c6-413e-b003-2f5df3306952-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"7e017064-86c6-413e-b003-2f5df3306952\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:51:50 crc kubenswrapper[5120]: I0316 16:51:50.228704 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7e017064-86c6-413e-b003-2f5df3306952-scripts\") pod \"ceilometer-0\" (UID: \"7e017064-86c6-413e-b003-2f5df3306952\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:51:50 crc kubenswrapper[5120]: I0316 16:51:50.234492 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/7e017064-86c6-413e-b003-2f5df3306952-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"7e017064-86c6-413e-b003-2f5df3306952\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:51:50 crc kubenswrapper[5120]: I0316 16:51:50.235215 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7e017064-86c6-413e-b003-2f5df3306952-config-data\") pod \"ceilometer-0\" (UID: \"7e017064-86c6-413e-b003-2f5df3306952\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:51:50 crc kubenswrapper[5120]: I0316 16:51:50.236378 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7e017064-86c6-413e-b003-2f5df3306952-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"7e017064-86c6-413e-b003-2f5df3306952\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:51:50 crc kubenswrapper[5120]: I0316 16:51:50.247514 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bdr9\" (UniqueName: \"kubernetes.io/projected/7e017064-86c6-413e-b003-2f5df3306952-kube-api-access-4bdr9\") pod \"ceilometer-0\" (UID: \"7e017064-86c6-413e-b003-2f5df3306952\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:51:50 crc kubenswrapper[5120]: I0316 16:51:50.370947 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:51:50 crc kubenswrapper[5120]: I0316 16:51:50.674666 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="80fb18b8-bf77-40ea-b1e0-3aaf669105cf" path="/var/lib/kubelet/pods/80fb18b8-bf77-40ea-b1e0-3aaf669105cf/volumes" Mar 16 16:51:50 crc kubenswrapper[5120]: I0316 16:51:50.837453 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:51:50 crc kubenswrapper[5120]: I0316 16:51:50.960151 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="b3abb705-1e8c-4922-a449-616479bf0721" containerName="nova-api-log" probeResult="failure" output="Get \"https://10.217.0.115:8774/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Mar 16 16:51:50 crc kubenswrapper[5120]: I0316 16:51:50.960159 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="b3abb705-1e8c-4922-a449-616479bf0721" containerName="nova-api-api" probeResult="failure" output="Get \"https://10.217.0.115:8774/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Mar 16 16:51:50 crc kubenswrapper[5120]: I0316 16:51:50.986067 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="8a564f44-3c8d-4dff-b968-96f276382786" containerName="nova-metadata-log" probeResult="failure" output="Get \"https://10.217.0.116:8775/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 16:51:50 crc kubenswrapper[5120]: I0316 16:51:50.986111 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="8a564f44-3c8d-4dff-b968-96f276382786" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"https://10.217.0.116:8775/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 16:51:51 crc kubenswrapper[5120]: I0316 16:51:51.711235 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7e017064-86c6-413e-b003-2f5df3306952","Type":"ContainerStarted","Data":"8076f151882b8dc675d8117040df085f2fbb510f4b9ba2a91b7fffe7ac6bc425"} Mar 16 16:51:51 crc kubenswrapper[5120]: I0316 16:51:51.998303 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:51:52 crc kubenswrapper[5120]: I0316 16:51:52.029859 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:51:52 crc kubenswrapper[5120]: I0316 16:51:52.724626 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7e017064-86c6-413e-b003-2f5df3306952","Type":"ContainerStarted","Data":"0cf2639ccd5dcff044d74634742ba674b06691c33be27480bff7ec2d5a0d3b02"} Mar 16 16:51:52 crc kubenswrapper[5120]: I0316 16:51:52.724954 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7e017064-86c6-413e-b003-2f5df3306952","Type":"ContainerStarted","Data":"8218d57425e63f9f4bbf8069b07d24343f9df58411b9fc34d1dabf1911b5d806"} Mar 16 16:51:52 crc kubenswrapper[5120]: I0316 16:51:52.754607 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:51:54 crc kubenswrapper[5120]: I0316 16:51:54.744980 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7e017064-86c6-413e-b003-2f5df3306952","Type":"ContainerStarted","Data":"e737c3a8474b5b2441a2fe0e5e4c4c27b963e84e3c1ac1e70370959759d8773d"} Mar 16 16:51:57 crc kubenswrapper[5120]: I0316 16:51:57.952271 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:51:57 crc kubenswrapper[5120]: I0316 16:51:57.953870 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:51:57 crc kubenswrapper[5120]: I0316 16:51:57.979208 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:51:57 crc kubenswrapper[5120]: I0316 16:51:57.980101 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:51:58 crc kubenswrapper[5120]: I0316 16:51:58.651046 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:51:58 crc kubenswrapper[5120]: I0316 16:51:58.795402 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7e017064-86c6-413e-b003-2f5df3306952","Type":"ContainerStarted","Data":"a27b058fc327b7f2b23592539c20e14a76cfbc908fe6c7ae8c356b40f8a204c5"} Mar 16 16:51:58 crc kubenswrapper[5120]: I0316 16:51:58.796546 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:51:58 crc kubenswrapper[5120]: I0316 16:51:58.823557 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.121674566 podStartE2EDuration="8.823539409s" podCreationTimestamp="2026-03-16 16:51:50 +0000 UTC" firstStartedPulling="2026-03-16 16:51:50.839033787 +0000 UTC m=+4812.992965444" lastFinishedPulling="2026-03-16 16:51:57.54089862 +0000 UTC m=+4819.694830287" observedRunningTime="2026-03-16 16:51:58.819658003 +0000 UTC m=+4820.973589670" watchObservedRunningTime="2026-03-16 16:51:58.823539409 +0000 UTC m=+4820.977471066" Mar 16 16:51:59 crc kubenswrapper[5120]: I0316 16:51:59.960754 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:51:59 crc kubenswrapper[5120]: I0316 16:51:59.961809 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:51:59 crc kubenswrapper[5120]: I0316 16:51:59.968718 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:51:59 crc kubenswrapper[5120]: I0316 16:51:59.969153 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:51:59 crc kubenswrapper[5120]: I0316 16:51:59.986727 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:51:59 crc kubenswrapper[5120]: I0316 16:51:59.994138 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:51:59 crc kubenswrapper[5120]: I0316 16:51:59.995602 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:52:00 crc kubenswrapper[5120]: I0316 16:52:00.146301 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-infra/auto-csr-approver-29561332-xz4qr"] Mar 16 16:52:00 crc kubenswrapper[5120]: I0316 16:52:00.155492 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561332-xz4qr" Mar 16 16:52:00 crc kubenswrapper[5120]: I0316 16:52:00.157292 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561332-xz4qr"] Mar 16 16:52:00 crc kubenswrapper[5120]: I0316 16:52:00.158565 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-infra\"/\"csr-approver-sa-dockercfg-x2nsz\"" Mar 16 16:52:00 crc kubenswrapper[5120]: I0316 16:52:00.158965 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"openshift-service-ca.crt\"" Mar 16 16:52:00 crc kubenswrapper[5120]: I0316 16:52:00.165451 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"kube-root-ca.crt\"" Mar 16 16:52:00 crc kubenswrapper[5120]: I0316 16:52:00.220998 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjxxr\" (UniqueName: \"kubernetes.io/projected/12dbee04-52e9-4d27-970f-3d0c46ee809f-kube-api-access-qjxxr\") pod \"auto-csr-approver-29561332-xz4qr\" (UID: \"12dbee04-52e9-4d27-970f-3d0c46ee809f\") " pod="openshift-infra/auto-csr-approver-29561332-xz4qr" Mar 16 16:52:00 crc kubenswrapper[5120]: I0316 16:52:00.323783 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qjxxr\" (UniqueName: \"kubernetes.io/projected/12dbee04-52e9-4d27-970f-3d0c46ee809f-kube-api-access-qjxxr\") pod \"auto-csr-approver-29561332-xz4qr\" (UID: \"12dbee04-52e9-4d27-970f-3d0c46ee809f\") " pod="openshift-infra/auto-csr-approver-29561332-xz4qr" Mar 16 16:52:00 crc kubenswrapper[5120]: I0316 16:52:00.346436 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjxxr\" (UniqueName: \"kubernetes.io/projected/12dbee04-52e9-4d27-970f-3d0c46ee809f-kube-api-access-qjxxr\") pod \"auto-csr-approver-29561332-xz4qr\" (UID: \"12dbee04-52e9-4d27-970f-3d0c46ee809f\") " pod="openshift-infra/auto-csr-approver-29561332-xz4qr" Mar 16 16:52:00 crc kubenswrapper[5120]: I0316 16:52:00.484950 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561332-xz4qr" Mar 16 16:52:00 crc kubenswrapper[5120]: I0316 16:52:00.819082 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:52:00 crc kubenswrapper[5120]: I0316 16:52:00.934930 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561332-xz4qr"] Mar 16 16:52:01 crc kubenswrapper[5120]: I0316 16:52:01.824156 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561332-xz4qr" event={"ID":"12dbee04-52e9-4d27-970f-3d0c46ee809f","Type":"ContainerStarted","Data":"0e3998ebde2c092329da262f165c68aeca1ee38a6064513967f84fa4fa67a046"} Mar 16 16:52:02 crc kubenswrapper[5120]: I0316 16:52:02.837063 5120 generic.go:358] "Generic (PLEG): container finished" podID="12dbee04-52e9-4d27-970f-3d0c46ee809f" containerID="685540b4d7b41517ec9bca45f9216630bb3f86d3740942c5bd283fb216943915" exitCode=0 Mar 16 16:52:02 crc kubenswrapper[5120]: I0316 16:52:02.837164 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561332-xz4qr" event={"ID":"12dbee04-52e9-4d27-970f-3d0c46ee809f","Type":"ContainerDied","Data":"685540b4d7b41517ec9bca45f9216630bb3f86d3740942c5bd283fb216943915"} Mar 16 16:52:04 crc kubenswrapper[5120]: I0316 16:52:04.191205 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561332-xz4qr" Mar 16 16:52:04 crc kubenswrapper[5120]: I0316 16:52:04.339643 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qjxxr\" (UniqueName: \"kubernetes.io/projected/12dbee04-52e9-4d27-970f-3d0c46ee809f-kube-api-access-qjxxr\") pod \"12dbee04-52e9-4d27-970f-3d0c46ee809f\" (UID: \"12dbee04-52e9-4d27-970f-3d0c46ee809f\") " Mar 16 16:52:04 crc kubenswrapper[5120]: I0316 16:52:04.345817 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12dbee04-52e9-4d27-970f-3d0c46ee809f-kube-api-access-qjxxr" (OuterVolumeSpecName: "kube-api-access-qjxxr") pod "12dbee04-52e9-4d27-970f-3d0c46ee809f" (UID: "12dbee04-52e9-4d27-970f-3d0c46ee809f"). InnerVolumeSpecName "kube-api-access-qjxxr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:52:04 crc kubenswrapper[5120]: I0316 16:52:04.442635 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qjxxr\" (UniqueName: \"kubernetes.io/projected/12dbee04-52e9-4d27-970f-3d0c46ee809f-kube-api-access-qjxxr\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:04 crc kubenswrapper[5120]: I0316 16:52:04.859793 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561332-xz4qr" Mar 16 16:52:04 crc kubenswrapper[5120]: I0316 16:52:04.859921 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561332-xz4qr" event={"ID":"12dbee04-52e9-4d27-970f-3d0c46ee809f","Type":"ContainerDied","Data":"0e3998ebde2c092329da262f165c68aeca1ee38a6064513967f84fa4fa67a046"} Mar 16 16:52:04 crc kubenswrapper[5120]: I0316 16:52:04.860236 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0e3998ebde2c092329da262f165c68aeca1ee38a6064513967f84fa4fa67a046" Mar 16 16:52:05 crc kubenswrapper[5120]: I0316 16:52:05.262949 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-infra/auto-csr-approver-29561326-gqjgw"] Mar 16 16:52:05 crc kubenswrapper[5120]: I0316 16:52:05.274537 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-infra/auto-csr-approver-29561326-gqjgw"] Mar 16 16:52:06 crc kubenswrapper[5120]: I0316 16:52:06.675699 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e7055eaf-c436-4eb2-9a78-12e452cd331f" path="/var/lib/kubelet/pods/e7055eaf-c436-4eb2-9a78-12e452cd331f/volumes" Mar 16 16:52:08 crc kubenswrapper[5120]: E0316 16:52:08.029862 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1873700 actualBytes=10240 Mar 16 16:52:29 crc kubenswrapper[5120]: I0316 16:52:29.828277 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:52:42 crc kubenswrapper[5120]: I0316 16:52:42.831744 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 16:52:42 crc kubenswrapper[5120]: I0316 16:52:42.832540 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovn-northd-0" podUID="46fdeab7-fc69-4767-85fb-6fe77323a249" containerName="ovn-northd" containerID="cri-o://772d7d749c19d303ab351e9da9794092ed431692caf8ea6741351516c112156b" gracePeriod=30 Mar 16 16:52:42 crc kubenswrapper[5120]: I0316 16:52:42.832682 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovn-northd-0" podUID="46fdeab7-fc69-4767-85fb-6fe77323a249" containerName="openstack-network-exporter" containerID="cri-o://85e0a2833bfbae668b16b016594cba1808c5730c52cef8b62d6c1961bf38adf3" gracePeriod=30 Mar 16 16:52:42 crc kubenswrapper[5120]: I0316 16:52:42.841567 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 16:52:42 crc kubenswrapper[5120]: I0316 16:52:42.841792 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/openstackclient" podUID="c89f3439-256a-47de-9a4b-33f3a5231721" containerName="openstackclient" containerID="cri-o://e57a4c9ac68cdf613fab20d09b18fbc7abe70575a805ef23da6a7c2bb2219851" gracePeriod=2 Mar 16 16:52:42 crc kubenswrapper[5120]: I0316 16:52:42.850017 5120 status_manager.go:895] "Failed to get status for pod" podUID="c89f3439-256a-47de-9a4b-33f3a5231721" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 16:52:42 crc kubenswrapper[5120]: I0316 16:52:42.855791 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 16:52:42 crc kubenswrapper[5120]: I0316 16:52:42.881772 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 16:52:42 crc kubenswrapper[5120]: I0316 16:52:42.882000 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/memcached-0" podUID="243f6b1f-595b-44eb-aaa5-0b3df41c88c1" containerName="memcached" containerID="cri-o://3ae202ea0f0a4566831c4712a39b08992086f44465f4ad6f31062d4721860630" gracePeriod=30 Mar 16 16:52:42 crc kubenswrapper[5120]: I0316 16:52:42.887680 5120 status_manager.go:895] "Failed to get status for pod" podUID="c89f3439-256a-47de-9a4b-33f3a5231721" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 16:52:42 crc kubenswrapper[5120]: I0316 16:52:42.891660 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 16:52:42 crc kubenswrapper[5120]: I0316 16:52:42.892293 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podUID="b0528e86-65e5-4d4c-9dd9-4cd6b9475cbc" containerName="openstack-network-exporter" containerID="cri-o://87c8a7508d62404f45bb9bb4f0bf291163f78d5842cd089a3101282b7236de16" gracePeriod=300 Mar 16 16:52:42 crc kubenswrapper[5120]: I0316 16:52:42.926255 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-worker-5964c9d8c-plh78"] Mar 16 16:52:42 crc kubenswrapper[5120]: I0316 16:52:42.936716 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12dbee04-52e9-4d27-970f-3d0c46ee809f" containerName="oc" Mar 16 16:52:42 crc kubenswrapper[5120]: I0316 16:52:42.936967 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="12dbee04-52e9-4d27-970f-3d0c46ee809f" containerName="oc" Mar 16 16:52:42 crc kubenswrapper[5120]: I0316 16:52:42.937053 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c89f3439-256a-47de-9a4b-33f3a5231721" containerName="openstackclient" Mar 16 16:52:42 crc kubenswrapper[5120]: I0316 16:52:42.937110 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c89f3439-256a-47de-9a4b-33f3a5231721" containerName="openstackclient" Mar 16 16:52:42 crc kubenswrapper[5120]: I0316 16:52:42.937423 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c89f3439-256a-47de-9a4b-33f3a5231721" containerName="openstackclient" Mar 16 16:52:42 crc kubenswrapper[5120]: I0316 16:52:42.937514 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="12dbee04-52e9-4d27-970f-3d0c46ee809f" containerName="oc" Mar 16 16:52:42 crc kubenswrapper[5120]: I0316 16:52:42.951662 5120 status_manager.go:895] "Failed to get status for pod" podUID="c89f3439-256a-47de-9a4b-33f3a5231721" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 16:52:42 crc kubenswrapper[5120]: I0316 16:52:42.953594 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-5964c9d8c-plh78" Mar 16 16:52:42 crc kubenswrapper[5120]: I0316 16:52:42.982366 5120 status_manager.go:905] "Pod was deleted and then recreated, skipping status update" pod="openstack-kuttl-tests/openstackclient" oldPodUID="c89f3439-256a-47de-9a4b-33f3a5231721" podUID="74ab0944-2f5c-4a9d-a848-8e2a8d17d9cd" Mar 16 16:52:42 crc kubenswrapper[5120]: I0316 16:52:42.992692 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:52:42 crc kubenswrapper[5120]: I0316 16:52:42.992967 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="c186765a-7323-4f11-ac91-6c1ab1f2ac4f" containerName="cinder-scheduler" containerID="cri-o://40c9d0ca2040ab594fed757bb25e8a4e0800b5d718f67c29748ee6caecf34c93" gracePeriod=30 Mar 16 16:52:42 crc kubenswrapper[5120]: I0316 16:52:42.993099 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="c186765a-7323-4f11-ac91-6c1ab1f2ac4f" containerName="probe" containerID="cri-o://609de6baddc7fc53ce05c0d9ebc736f4466bffcd372ef8e11b45d04f5a528f5f" gracePeriod=30 Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.020845 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-5964c9d8c-plh78"] Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.041328 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2n5xx\" (UniqueName: \"kubernetes.io/projected/d6db354d-c48c-4497-a289-18edadffce47-kube-api-access-2n5xx\") pod \"barbican-worker-5964c9d8c-plh78\" (UID: \"d6db354d-c48c-4497-a289-18edadffce47\") " pod="openstack-kuttl-tests/barbican-worker-5964c9d8c-plh78" Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.041473 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d6db354d-c48c-4497-a289-18edadffce47-combined-ca-bundle\") pod \"barbican-worker-5964c9d8c-plh78\" (UID: \"d6db354d-c48c-4497-a289-18edadffce47\") " pod="openstack-kuttl-tests/barbican-worker-5964c9d8c-plh78" Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.041602 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d6db354d-c48c-4497-a289-18edadffce47-config-data\") pod \"barbican-worker-5964c9d8c-plh78\" (UID: \"d6db354d-c48c-4497-a289-18edadffce47\") " pod="openstack-kuttl-tests/barbican-worker-5964c9d8c-plh78" Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.041686 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/d6db354d-c48c-4497-a289-18edadffce47-config-data-custom\") pod \"barbican-worker-5964c9d8c-plh78\" (UID: \"d6db354d-c48c-4497-a289-18edadffce47\") " pod="openstack-kuttl-tests/barbican-worker-5964c9d8c-plh78" Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.041787 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d6db354d-c48c-4497-a289-18edadffce47-logs\") pod \"barbican-worker-5964c9d8c-plh78\" (UID: \"d6db354d-c48c-4497-a289-18edadffce47\") " pod="openstack-kuttl-tests/barbican-worker-5964c9d8c-plh78" Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.055337 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-646d48c554-kk5ms"] Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.089813 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-646d48c554-kk5ms" Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.093308 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-api-7bf49bf568-fbg2k"] Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.133907 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.136514 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-7bf49bf568-fbg2k" Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.149628 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.150226 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2n5xx\" (UniqueName: \"kubernetes.io/projected/d6db354d-c48c-4497-a289-18edadffce47-kube-api-access-2n5xx\") pod \"barbican-worker-5964c9d8c-plh78\" (UID: \"d6db354d-c48c-4497-a289-18edadffce47\") " pod="openstack-kuttl-tests/barbican-worker-5964c9d8c-plh78" Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.150280 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d6db354d-c48c-4497-a289-18edadffce47-combined-ca-bundle\") pod \"barbican-worker-5964c9d8c-plh78\" (UID: \"d6db354d-c48c-4497-a289-18edadffce47\") " pod="openstack-kuttl-tests/barbican-worker-5964c9d8c-plh78" Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.150346 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d6db354d-c48c-4497-a289-18edadffce47-config-data\") pod \"barbican-worker-5964c9d8c-plh78\" (UID: \"d6db354d-c48c-4497-a289-18edadffce47\") " pod="openstack-kuttl-tests/barbican-worker-5964c9d8c-plh78" Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.150377 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fa4601ff-7ef6-4d2c-b0ca-b153763db12f-config-data\") pod \"barbican-keystone-listener-646d48c554-kk5ms\" (UID: \"fa4601ff-7ef6-4d2c-b0ca-b153763db12f\") " pod="openstack-kuttl-tests/barbican-keystone-listener-646d48c554-kk5ms" Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.150397 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/d6db354d-c48c-4497-a289-18edadffce47-config-data-custom\") pod \"barbican-worker-5964c9d8c-plh78\" (UID: \"d6db354d-c48c-4497-a289-18edadffce47\") " pod="openstack-kuttl-tests/barbican-worker-5964c9d8c-plh78" Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.150425 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d6db354d-c48c-4497-a289-18edadffce47-logs\") pod \"barbican-worker-5964c9d8c-plh78\" (UID: \"d6db354d-c48c-4497-a289-18edadffce47\") " pod="openstack-kuttl-tests/barbican-worker-5964c9d8c-plh78" Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.150545 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/fa4601ff-7ef6-4d2c-b0ca-b153763db12f-logs\") pod \"barbican-keystone-listener-646d48c554-kk5ms\" (UID: \"fa4601ff-7ef6-4d2c-b0ca-b153763db12f\") " pod="openstack-kuttl-tests/barbican-keystone-listener-646d48c554-kk5ms" Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.150605 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fa4601ff-7ef6-4d2c-b0ca-b153763db12f-combined-ca-bundle\") pod \"barbican-keystone-listener-646d48c554-kk5ms\" (UID: \"fa4601ff-7ef6-4d2c-b0ca-b153763db12f\") " pod="openstack-kuttl-tests/barbican-keystone-listener-646d48c554-kk5ms" Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.150640 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sc4js\" (UniqueName: \"kubernetes.io/projected/fa4601ff-7ef6-4d2c-b0ca-b153763db12f-kube-api-access-sc4js\") pod \"barbican-keystone-listener-646d48c554-kk5ms\" (UID: \"fa4601ff-7ef6-4d2c-b0ca-b153763db12f\") " pod="openstack-kuttl-tests/barbican-keystone-listener-646d48c554-kk5ms" Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.150723 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/fa4601ff-7ef6-4d2c-b0ca-b153763db12f-config-data-custom\") pod \"barbican-keystone-listener-646d48c554-kk5ms\" (UID: \"fa4601ff-7ef6-4d2c-b0ca-b153763db12f\") " pod="openstack-kuttl-tests/barbican-keystone-listener-646d48c554-kk5ms" Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.152538 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d6db354d-c48c-4497-a289-18edadffce47-logs\") pod \"barbican-worker-5964c9d8c-plh78\" (UID: \"d6db354d-c48c-4497-a289-18edadffce47\") " pod="openstack-kuttl-tests/barbican-worker-5964c9d8c-plh78" Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.161535 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d6db354d-c48c-4497-a289-18edadffce47-config-data\") pod \"barbican-worker-5964c9d8c-plh78\" (UID: \"d6db354d-c48c-4497-a289-18edadffce47\") " pod="openstack-kuttl-tests/barbican-worker-5964c9d8c-plh78" Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.200829 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-7bf49bf568-fbg2k"] Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.203735 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d6db354d-c48c-4497-a289-18edadffce47-combined-ca-bundle\") pod \"barbican-worker-5964c9d8c-plh78\" (UID: \"d6db354d-c48c-4497-a289-18edadffce47\") " pod="openstack-kuttl-tests/barbican-worker-5964c9d8c-plh78" Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.219527 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/d6db354d-c48c-4497-a289-18edadffce47-config-data-custom\") pod \"barbican-worker-5964c9d8c-plh78\" (UID: \"d6db354d-c48c-4497-a289-18edadffce47\") " pod="openstack-kuttl-tests/barbican-worker-5964c9d8c-plh78" Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.252309 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fa4601ff-7ef6-4d2c-b0ca-b153763db12f-combined-ca-bundle\") pod \"barbican-keystone-listener-646d48c554-kk5ms\" (UID: \"fa4601ff-7ef6-4d2c-b0ca-b153763db12f\") " pod="openstack-kuttl-tests/barbican-keystone-listener-646d48c554-kk5ms" Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.252368 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sc4js\" (UniqueName: \"kubernetes.io/projected/fa4601ff-7ef6-4d2c-b0ca-b153763db12f-kube-api-access-sc4js\") pod \"barbican-keystone-listener-646d48c554-kk5ms\" (UID: \"fa4601ff-7ef6-4d2c-b0ca-b153763db12f\") " pod="openstack-kuttl-tests/barbican-keystone-listener-646d48c554-kk5ms" Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.252442 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/c846d2b2-0638-44bd-9ad0-6b6c76f8d16f-internal-tls-certs\") pod \"barbican-api-7bf49bf568-fbg2k\" (UID: \"c846d2b2-0638-44bd-9ad0-6b6c76f8d16f\") " pod="openstack-kuttl-tests/barbican-api-7bf49bf568-fbg2k" Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.252469 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/fa4601ff-7ef6-4d2c-b0ca-b153763db12f-config-data-custom\") pod \"barbican-keystone-listener-646d48c554-kk5ms\" (UID: \"fa4601ff-7ef6-4d2c-b0ca-b153763db12f\") " pod="openstack-kuttl-tests/barbican-keystone-listener-646d48c554-kk5ms" Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.252556 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c846d2b2-0638-44bd-9ad0-6b6c76f8d16f-combined-ca-bundle\") pod \"barbican-api-7bf49bf568-fbg2k\" (UID: \"c846d2b2-0638-44bd-9ad0-6b6c76f8d16f\") " pod="openstack-kuttl-tests/barbican-api-7bf49bf568-fbg2k" Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.252574 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/c846d2b2-0638-44bd-9ad0-6b6c76f8d16f-public-tls-certs\") pod \"barbican-api-7bf49bf568-fbg2k\" (UID: \"c846d2b2-0638-44bd-9ad0-6b6c76f8d16f\") " pod="openstack-kuttl-tests/barbican-api-7bf49bf568-fbg2k" Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.252612 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6cjz\" (UniqueName: \"kubernetes.io/projected/c846d2b2-0638-44bd-9ad0-6b6c76f8d16f-kube-api-access-k6cjz\") pod \"barbican-api-7bf49bf568-fbg2k\" (UID: \"c846d2b2-0638-44bd-9ad0-6b6c76f8d16f\") " pod="openstack-kuttl-tests/barbican-api-7bf49bf568-fbg2k" Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.252666 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/74ab0944-2f5c-4a9d-a848-8e2a8d17d9cd-openstack-config-secret\") pod \"openstackclient\" (UID: \"74ab0944-2f5c-4a9d-a848-8e2a8d17d9cd\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.252722 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/c846d2b2-0638-44bd-9ad0-6b6c76f8d16f-config-data-custom\") pod \"barbican-api-7bf49bf568-fbg2k\" (UID: \"c846d2b2-0638-44bd-9ad0-6b6c76f8d16f\") " pod="openstack-kuttl-tests/barbican-api-7bf49bf568-fbg2k" Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.252774 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fa4601ff-7ef6-4d2c-b0ca-b153763db12f-config-data\") pod \"barbican-keystone-listener-646d48c554-kk5ms\" (UID: \"fa4601ff-7ef6-4d2c-b0ca-b153763db12f\") " pod="openstack-kuttl-tests/barbican-keystone-listener-646d48c554-kk5ms" Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.252834 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c846d2b2-0638-44bd-9ad0-6b6c76f8d16f-logs\") pod \"barbican-api-7bf49bf568-fbg2k\" (UID: \"c846d2b2-0638-44bd-9ad0-6b6c76f8d16f\") " pod="openstack-kuttl-tests/barbican-api-7bf49bf568-fbg2k" Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.252902 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/74ab0944-2f5c-4a9d-a848-8e2a8d17d9cd-openstack-config\") pod \"openstackclient\" (UID: \"74ab0944-2f5c-4a9d-a848-8e2a8d17d9cd\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.252927 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c846d2b2-0638-44bd-9ad0-6b6c76f8d16f-config-data\") pod \"barbican-api-7bf49bf568-fbg2k\" (UID: \"c846d2b2-0638-44bd-9ad0-6b6c76f8d16f\") " pod="openstack-kuttl-tests/barbican-api-7bf49bf568-fbg2k" Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.252959 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/74ab0944-2f5c-4a9d-a848-8e2a8d17d9cd-combined-ca-bundle\") pod \"openstackclient\" (UID: \"74ab0944-2f5c-4a9d-a848-8e2a8d17d9cd\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.252982 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/fa4601ff-7ef6-4d2c-b0ca-b153763db12f-logs\") pod \"barbican-keystone-listener-646d48c554-kk5ms\" (UID: \"fa4601ff-7ef6-4d2c-b0ca-b153763db12f\") " pod="openstack-kuttl-tests/barbican-keystone-listener-646d48c554-kk5ms" Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.253024 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6gg2\" (UniqueName: \"kubernetes.io/projected/74ab0944-2f5c-4a9d-a848-8e2a8d17d9cd-kube-api-access-t6gg2\") pod \"openstackclient\" (UID: \"74ab0944-2f5c-4a9d-a848-8e2a8d17d9cd\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.262428 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/fa4601ff-7ef6-4d2c-b0ca-b153763db12f-logs\") pod \"barbican-keystone-listener-646d48c554-kk5ms\" (UID: \"fa4601ff-7ef6-4d2c-b0ca-b153763db12f\") " pod="openstack-kuttl-tests/barbican-keystone-listener-646d48c554-kk5ms" Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.270859 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-646d48c554-kk5ms"] Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.272582 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fa4601ff-7ef6-4d2c-b0ca-b153763db12f-combined-ca-bundle\") pod \"barbican-keystone-listener-646d48c554-kk5ms\" (UID: \"fa4601ff-7ef6-4d2c-b0ca-b153763db12f\") " pod="openstack-kuttl-tests/barbican-keystone-listener-646d48c554-kk5ms" Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.276244 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fa4601ff-7ef6-4d2c-b0ca-b153763db12f-config-data\") pod \"barbican-keystone-listener-646d48c554-kk5ms\" (UID: \"fa4601ff-7ef6-4d2c-b0ca-b153763db12f\") " pod="openstack-kuttl-tests/barbican-keystone-listener-646d48c554-kk5ms" Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.279908 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2n5xx\" (UniqueName: \"kubernetes.io/projected/d6db354d-c48c-4497-a289-18edadffce47-kube-api-access-2n5xx\") pod \"barbican-worker-5964c9d8c-plh78\" (UID: \"d6db354d-c48c-4497-a289-18edadffce47\") " pod="openstack-kuttl-tests/barbican-worker-5964c9d8c-plh78" Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.284324 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/fa4601ff-7ef6-4d2c-b0ca-b153763db12f-config-data-custom\") pod \"barbican-keystone-listener-646d48c554-kk5ms\" (UID: \"fa4601ff-7ef6-4d2c-b0ca-b153763db12f\") " pod="openstack-kuttl-tests/barbican-keystone-listener-646d48c554-kk5ms" Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.289398 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-5964c9d8c-plh78" Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.297947 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.309020 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.319730 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="8a564f44-3c8d-4dff-b968-96f276382786" containerName="nova-metadata-log" containerID="cri-o://0970df69e7dcb99e02e2b51ae8385d57de92fa7a1df72fa7d9dc8321b67d814b" gracePeriod=30 Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.321152 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="8a564f44-3c8d-4dff-b968-96f276382786" containerName="nova-metadata-metadata" containerID="cri-o://2f86dbe111359426e7c3145a6535162eda586f161b335551970a0c38fcb780ec" gracePeriod=30 Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.329830 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.330133 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="37c6de80-ff10-4d44-a806-b8ad82e62d82" containerName="nova-scheduler-scheduler" containerID="cri-o://35987799f969f71c82b912431ea13f98b634d539c89a2bd6ce077420efb8f161" gracePeriod=30 Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.336314 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sc4js\" (UniqueName: \"kubernetes.io/projected/fa4601ff-7ef6-4d2c-b0ca-b153763db12f-kube-api-access-sc4js\") pod \"barbican-keystone-listener-646d48c554-kk5ms\" (UID: \"fa4601ff-7ef6-4d2c-b0ca-b153763db12f\") " pod="openstack-kuttl-tests/barbican-keystone-listener-646d48c554-kk5ms" Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.349538 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.349783 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="b3abb705-1e8c-4922-a449-616479bf0721" containerName="nova-api-log" containerID="cri-o://b1398616db52eed8170c4625ae054d108d6793d99ce5ec107004afe72c8bcb39" gracePeriod=30 Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.349891 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="b3abb705-1e8c-4922-a449-616479bf0721" containerName="nova-api-api" containerID="cri-o://0d81c2b074c35c712a28eea449678c1bb236db51f5c95f1df01bdf619672c22d" gracePeriod=30 Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.355349 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-northd-0_46fdeab7-fc69-4767-85fb-6fe77323a249/ovn-northd/0.log" Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.355394 5120 generic.go:358] "Generic (PLEG): container finished" podID="46fdeab7-fc69-4767-85fb-6fe77323a249" containerID="85e0a2833bfbae668b16b016594cba1808c5730c52cef8b62d6c1961bf38adf3" exitCode=2 Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.355408 5120 generic.go:358] "Generic (PLEG): container finished" podID="46fdeab7-fc69-4767-85fb-6fe77323a249" containerID="772d7d749c19d303ab351e9da9794092ed431692caf8ea6741351516c112156b" exitCode=143 Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.355657 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"46fdeab7-fc69-4767-85fb-6fe77323a249","Type":"ContainerDied","Data":"85e0a2833bfbae668b16b016594cba1808c5730c52cef8b62d6c1961bf38adf3"} Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.355685 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"46fdeab7-fc69-4767-85fb-6fe77323a249","Type":"ContainerDied","Data":"772d7d749c19d303ab351e9da9794092ed431692caf8ea6741351516c112156b"} Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.359022 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/74ab0944-2f5c-4a9d-a848-8e2a8d17d9cd-openstack-config-secret\") pod \"openstackclient\" (UID: \"74ab0944-2f5c-4a9d-a848-8e2a8d17d9cd\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.359091 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/c846d2b2-0638-44bd-9ad0-6b6c76f8d16f-config-data-custom\") pod \"barbican-api-7bf49bf568-fbg2k\" (UID: \"c846d2b2-0638-44bd-9ad0-6b6c76f8d16f\") " pod="openstack-kuttl-tests/barbican-api-7bf49bf568-fbg2k" Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.359175 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c846d2b2-0638-44bd-9ad0-6b6c76f8d16f-logs\") pod \"barbican-api-7bf49bf568-fbg2k\" (UID: \"c846d2b2-0638-44bd-9ad0-6b6c76f8d16f\") " pod="openstack-kuttl-tests/barbican-api-7bf49bf568-fbg2k" Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.359233 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/74ab0944-2f5c-4a9d-a848-8e2a8d17d9cd-openstack-config\") pod \"openstackclient\" (UID: \"74ab0944-2f5c-4a9d-a848-8e2a8d17d9cd\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.359257 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c846d2b2-0638-44bd-9ad0-6b6c76f8d16f-config-data\") pod \"barbican-api-7bf49bf568-fbg2k\" (UID: \"c846d2b2-0638-44bd-9ad0-6b6c76f8d16f\") " pod="openstack-kuttl-tests/barbican-api-7bf49bf568-fbg2k" Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.359288 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/74ab0944-2f5c-4a9d-a848-8e2a8d17d9cd-combined-ca-bundle\") pod \"openstackclient\" (UID: \"74ab0944-2f5c-4a9d-a848-8e2a8d17d9cd\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.359333 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t6gg2\" (UniqueName: \"kubernetes.io/projected/74ab0944-2f5c-4a9d-a848-8e2a8d17d9cd-kube-api-access-t6gg2\") pod \"openstackclient\" (UID: \"74ab0944-2f5c-4a9d-a848-8e2a8d17d9cd\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.359425 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/c846d2b2-0638-44bd-9ad0-6b6c76f8d16f-internal-tls-certs\") pod \"barbican-api-7bf49bf568-fbg2k\" (UID: \"c846d2b2-0638-44bd-9ad0-6b6c76f8d16f\") " pod="openstack-kuttl-tests/barbican-api-7bf49bf568-fbg2k" Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.359525 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c846d2b2-0638-44bd-9ad0-6b6c76f8d16f-combined-ca-bundle\") pod \"barbican-api-7bf49bf568-fbg2k\" (UID: \"c846d2b2-0638-44bd-9ad0-6b6c76f8d16f\") " pod="openstack-kuttl-tests/barbican-api-7bf49bf568-fbg2k" Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.359541 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/c846d2b2-0638-44bd-9ad0-6b6c76f8d16f-public-tls-certs\") pod \"barbican-api-7bf49bf568-fbg2k\" (UID: \"c846d2b2-0638-44bd-9ad0-6b6c76f8d16f\") " pod="openstack-kuttl-tests/barbican-api-7bf49bf568-fbg2k" Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.359578 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k6cjz\" (UniqueName: \"kubernetes.io/projected/c846d2b2-0638-44bd-9ad0-6b6c76f8d16f-kube-api-access-k6cjz\") pod \"barbican-api-7bf49bf568-fbg2k\" (UID: \"c846d2b2-0638-44bd-9ad0-6b6c76f8d16f\") " pod="openstack-kuttl-tests/barbican-api-7bf49bf568-fbg2k" Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.362517 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c846d2b2-0638-44bd-9ad0-6b6c76f8d16f-logs\") pod \"barbican-api-7bf49bf568-fbg2k\" (UID: \"c846d2b2-0638-44bd-9ad0-6b6c76f8d16f\") " pod="openstack-kuttl-tests/barbican-api-7bf49bf568-fbg2k" Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.366439 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/74ab0944-2f5c-4a9d-a848-8e2a8d17d9cd-openstack-config\") pod \"openstackclient\" (UID: \"74ab0944-2f5c-4a9d-a848-8e2a8d17d9cd\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.368254 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/74ab0944-2f5c-4a9d-a848-8e2a8d17d9cd-openstack-config-secret\") pod \"openstackclient\" (UID: \"74ab0944-2f5c-4a9d-a848-8e2a8d17d9cd\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.377820 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.378084 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="8a04cbe2-cde0-405c-820b-f2651d753654" containerName="nova-cell0-conductor-conductor" containerID="cri-o://0b2132e2ff271b061aeedada07b1b4b7222370b28d5b9e6d518cdc82cd879170" gracePeriod=30 Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.387591 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/74ab0944-2f5c-4a9d-a848-8e2a8d17d9cd-combined-ca-bundle\") pod \"openstackclient\" (UID: \"74ab0944-2f5c-4a9d-a848-8e2a8d17d9cd\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.391685 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c846d2b2-0638-44bd-9ad0-6b6c76f8d16f-combined-ca-bundle\") pod \"barbican-api-7bf49bf568-fbg2k\" (UID: \"c846d2b2-0638-44bd-9ad0-6b6c76f8d16f\") " pod="openstack-kuttl-tests/barbican-api-7bf49bf568-fbg2k" Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.391742 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/c846d2b2-0638-44bd-9ad0-6b6c76f8d16f-public-tls-certs\") pod \"barbican-api-7bf49bf568-fbg2k\" (UID: \"c846d2b2-0638-44bd-9ad0-6b6c76f8d16f\") " pod="openstack-kuttl-tests/barbican-api-7bf49bf568-fbg2k" Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.393262 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/c846d2b2-0638-44bd-9ad0-6b6c76f8d16f-config-data-custom\") pod \"barbican-api-7bf49bf568-fbg2k\" (UID: \"c846d2b2-0638-44bd-9ad0-6b6c76f8d16f\") " pod="openstack-kuttl-tests/barbican-api-7bf49bf568-fbg2k" Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.404980 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c846d2b2-0638-44bd-9ad0-6b6c76f8d16f-config-data\") pod \"barbican-api-7bf49bf568-fbg2k\" (UID: \"c846d2b2-0638-44bd-9ad0-6b6c76f8d16f\") " pod="openstack-kuttl-tests/barbican-api-7bf49bf568-fbg2k" Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.417701 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.417962 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="6a9b9d92-8d3c-4366-83fb-0ea460a622d9" containerName="glance-log" containerID="cri-o://5b3e8c00b8713699d929b1a7c050c59f2a7f5613beb583159b969397e1462736" gracePeriod=30 Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.418395 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="6a9b9d92-8d3c-4366-83fb-0ea460a622d9" containerName="glance-httpd" containerID="cri-o://020f44c3cf6c107e17a170eb3a7361b1a565b2597ea573ccf12fb50dd79f6013" gracePeriod=30 Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.423954 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/c846d2b2-0638-44bd-9ad0-6b6c76f8d16f-internal-tls-certs\") pod \"barbican-api-7bf49bf568-fbg2k\" (UID: \"c846d2b2-0638-44bd-9ad0-6b6c76f8d16f\") " pod="openstack-kuttl-tests/barbican-api-7bf49bf568-fbg2k" Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.443816 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-d99589cd-7z8cg"] Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.446654 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6cjz\" (UniqueName: \"kubernetes.io/projected/c846d2b2-0638-44bd-9ad0-6b6c76f8d16f-kube-api-access-k6cjz\") pod \"barbican-api-7bf49bf568-fbg2k\" (UID: \"c846d2b2-0638-44bd-9ad0-6b6c76f8d16f\") " pod="openstack-kuttl-tests/barbican-api-7bf49bf568-fbg2k" Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.473318 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6gg2\" (UniqueName: \"kubernetes.io/projected/74ab0944-2f5c-4a9d-a848-8e2a8d17d9cd-kube-api-access-t6gg2\") pod \"openstackclient\" (UID: \"74ab0944-2f5c-4a9d-a848-8e2a8d17d9cd\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.609284 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.609861 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-d99589cd-7z8cg" Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.613855 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-646d48c554-kk5ms" Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.640071 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-7bf49bf568-fbg2k" Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.661749 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podUID="b0528e86-65e5-4d4c-9dd9-4cd6b9475cbc" containerName="ovsdbserver-nb" containerID="cri-o://17fae53bebd68929640aced62b696757a63ddac64d6806e132818ca836ccc804" gracePeriod=300 Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.684463 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-d99589cd-7z8cg"] Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.691454 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.711182 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/cc7ba52a-5825-4399-9e38-4d5cd1c02156-scripts\") pod \"placement-d99589cd-7z8cg\" (UID: \"cc7ba52a-5825-4399-9e38-4d5cd1c02156\") " pod="openstack-kuttl-tests/placement-d99589cd-7z8cg" Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.711362 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/cc7ba52a-5825-4399-9e38-4d5cd1c02156-logs\") pod \"placement-d99589cd-7z8cg\" (UID: \"cc7ba52a-5825-4399-9e38-4d5cd1c02156\") " pod="openstack-kuttl-tests/placement-d99589cd-7z8cg" Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.711418 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/cc7ba52a-5825-4399-9e38-4d5cd1c02156-public-tls-certs\") pod \"placement-d99589cd-7z8cg\" (UID: \"cc7ba52a-5825-4399-9e38-4d5cd1c02156\") " pod="openstack-kuttl-tests/placement-d99589cd-7z8cg" Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.711575 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/cc7ba52a-5825-4399-9e38-4d5cd1c02156-internal-tls-certs\") pod \"placement-d99589cd-7z8cg\" (UID: \"cc7ba52a-5825-4399-9e38-4d5cd1c02156\") " pod="openstack-kuttl-tests/placement-d99589cd-7z8cg" Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.711746 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cc7ba52a-5825-4399-9e38-4d5cd1c02156-config-data\") pod \"placement-d99589cd-7z8cg\" (UID: \"cc7ba52a-5825-4399-9e38-4d5cd1c02156\") " pod="openstack-kuttl-tests/placement-d99589cd-7z8cg" Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.740207 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cc7ba52a-5825-4399-9e38-4d5cd1c02156-combined-ca-bundle\") pod \"placement-d99589cd-7z8cg\" (UID: \"cc7ba52a-5825-4399-9e38-4d5cd1c02156\") " pod="openstack-kuttl-tests/placement-d99589cd-7z8cg" Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.740333 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8mqx\" (UniqueName: \"kubernetes.io/projected/cc7ba52a-5825-4399-9e38-4d5cd1c02156-kube-api-access-r8mqx\") pod \"placement-d99589cd-7z8cg\" (UID: \"cc7ba52a-5825-4399-9e38-4d5cd1c02156\") " pod="openstack-kuttl-tests/placement-d99589cd-7z8cg" Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.750396 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.764409 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podUID="bb689081-a0bf-445f-aa9f-12a38c98a269" containerName="openstack-network-exporter" containerID="cri-o://a1cd73640c37a42fa6ebe4301abe6341be42e951fc430d48f97879efaf1fc878" gracePeriod=300 Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.810240 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.810555 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="e5b6bb5a-fb93-4761-b995-1842090c7047" containerName="glance-log" containerID="cri-o://9ce74e3e7c03671f217a90ecc54371da22afef7549bf1a2fab8103a986ef97ef" gracePeriod=30 Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.811099 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="e5b6bb5a-fb93-4761-b995-1842090c7047" containerName="glance-httpd" containerID="cri-o://253c53bba99c38e72727f99679b1008d2ae517e9eefdcfc28a8327f9fd2df9dd" gracePeriod=30 Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.845647 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r8mqx\" (UniqueName: \"kubernetes.io/projected/cc7ba52a-5825-4399-9e38-4d5cd1c02156-kube-api-access-r8mqx\") pod \"placement-d99589cd-7z8cg\" (UID: \"cc7ba52a-5825-4399-9e38-4d5cd1c02156\") " pod="openstack-kuttl-tests/placement-d99589cd-7z8cg" Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.845714 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/cc7ba52a-5825-4399-9e38-4d5cd1c02156-scripts\") pod \"placement-d99589cd-7z8cg\" (UID: \"cc7ba52a-5825-4399-9e38-4d5cd1c02156\") " pod="openstack-kuttl-tests/placement-d99589cd-7z8cg" Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.845953 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/cc7ba52a-5825-4399-9e38-4d5cd1c02156-logs\") pod \"placement-d99589cd-7z8cg\" (UID: \"cc7ba52a-5825-4399-9e38-4d5cd1c02156\") " pod="openstack-kuttl-tests/placement-d99589cd-7z8cg" Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.845995 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/cc7ba52a-5825-4399-9e38-4d5cd1c02156-public-tls-certs\") pod \"placement-d99589cd-7z8cg\" (UID: \"cc7ba52a-5825-4399-9e38-4d5cd1c02156\") " pod="openstack-kuttl-tests/placement-d99589cd-7z8cg" Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.846094 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/cc7ba52a-5825-4399-9e38-4d5cd1c02156-internal-tls-certs\") pod \"placement-d99589cd-7z8cg\" (UID: \"cc7ba52a-5825-4399-9e38-4d5cd1c02156\") " pod="openstack-kuttl-tests/placement-d99589cd-7z8cg" Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.846498 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cc7ba52a-5825-4399-9e38-4d5cd1c02156-config-data\") pod \"placement-d99589cd-7z8cg\" (UID: \"cc7ba52a-5825-4399-9e38-4d5cd1c02156\") " pod="openstack-kuttl-tests/placement-d99589cd-7z8cg" Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.846711 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cc7ba52a-5825-4399-9e38-4d5cd1c02156-combined-ca-bundle\") pod \"placement-d99589cd-7z8cg\" (UID: \"cc7ba52a-5825-4399-9e38-4d5cd1c02156\") " pod="openstack-kuttl-tests/placement-d99589cd-7z8cg" Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.846932 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/cc7ba52a-5825-4399-9e38-4d5cd1c02156-logs\") pod \"placement-d99589cd-7z8cg\" (UID: \"cc7ba52a-5825-4399-9e38-4d5cd1c02156\") " pod="openstack-kuttl-tests/placement-d99589cd-7z8cg" Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.858700 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cc7ba52a-5825-4399-9e38-4d5cd1c02156-combined-ca-bundle\") pod \"placement-d99589cd-7z8cg\" (UID: \"cc7ba52a-5825-4399-9e38-4d5cd1c02156\") " pod="openstack-kuttl-tests/placement-d99589cd-7z8cg" Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.861106 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/cc7ba52a-5825-4399-9e38-4d5cd1c02156-scripts\") pod \"placement-d99589cd-7z8cg\" (UID: \"cc7ba52a-5825-4399-9e38-4d5cd1c02156\") " pod="openstack-kuttl-tests/placement-d99589cd-7z8cg" Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.862160 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cc7ba52a-5825-4399-9e38-4d5cd1c02156-config-data\") pod \"placement-d99589cd-7z8cg\" (UID: \"cc7ba52a-5825-4399-9e38-4d5cd1c02156\") " pod="openstack-kuttl-tests/placement-d99589cd-7z8cg" Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.864665 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.865210 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podUID="9f5ce683-1975-46fb-ab27-2e4888748b7b" containerName="nova-cell1-novncproxy-novncproxy" containerID="cri-o://6ec7a760a1240a7bf2d5c6d87956f6162ba6eb01f9c73461e515eedd1212d168" gracePeriod=30 Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.868332 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8mqx\" (UniqueName: \"kubernetes.io/projected/cc7ba52a-5825-4399-9e38-4d5cd1c02156-kube-api-access-r8mqx\") pod \"placement-d99589cd-7z8cg\" (UID: \"cc7ba52a-5825-4399-9e38-4d5cd1c02156\") " pod="openstack-kuttl-tests/placement-d99589cd-7z8cg" Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.871352 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/cc7ba52a-5825-4399-9e38-4d5cd1c02156-internal-tls-certs\") pod \"placement-d99589cd-7z8cg\" (UID: \"cc7ba52a-5825-4399-9e38-4d5cd1c02156\") " pod="openstack-kuttl-tests/placement-d99589cd-7z8cg" Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.872210 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/cc7ba52a-5825-4399-9e38-4d5cd1c02156-public-tls-certs\") pod \"placement-d99589cd-7z8cg\" (UID: \"cc7ba52a-5825-4399-9e38-4d5cd1c02156\") " pod="openstack-kuttl-tests/placement-d99589cd-7z8cg" Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.882933 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podUID="bb689081-a0bf-445f-aa9f-12a38c98a269" containerName="ovsdbserver-sb" containerID="cri-o://923a669bca7315d4fb93e0c792a4a355ec7d35b80a15a8429162435af8939525" gracePeriod=300 Mar 16 16:52:43 crc kubenswrapper[5120]: E0316 16:52:43.883069 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 772d7d749c19d303ab351e9da9794092ed431692caf8ea6741351516c112156b is running failed: container process not found" containerID="772d7d749c19d303ab351e9da9794092ed431692caf8ea6741351516c112156b" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Mar 16 16:52:43 crc kubenswrapper[5120]: E0316 16:52:43.895375 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 772d7d749c19d303ab351e9da9794092ed431692caf8ea6741351516c112156b is running failed: container process not found" containerID="772d7d749c19d303ab351e9da9794092ed431692caf8ea6741351516c112156b" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.895551 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.896181 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="19792b24-d033-444c-85e4-6c61e15b3ef9" containerName="account-server" containerID="cri-o://33a337777a56380f0a0d97bc5d689d730f9a15c8b90423ac83df28cd5f72cdea" gracePeriod=30 Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.896643 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="19792b24-d033-444c-85e4-6c61e15b3ef9" containerName="swift-recon-cron" containerID="cri-o://f662ae8c35ca1f96dfff51a14c8bfa217d6d3c3615aefcfaf4fbaab8e0e3c8ff" gracePeriod=30 Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.896692 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="19792b24-d033-444c-85e4-6c61e15b3ef9" containerName="rsync" containerID="cri-o://d5ead9fcc8dbfab3297040cbfe1f71aefa0dbbb8a01a88712ffdf35d5d7ddb5a" gracePeriod=30 Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.896726 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="19792b24-d033-444c-85e4-6c61e15b3ef9" containerName="object-expirer" containerID="cri-o://a50f502dcf9ac9ec39a46fcdfb0987499d1691d3eab94d676808ebf31f0e2a68" gracePeriod=30 Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.896774 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="19792b24-d033-444c-85e4-6c61e15b3ef9" containerName="object-updater" containerID="cri-o://411356d69e314d94388d3be8985c1067e90f4cda6e4f2ae2f79448189fdd7603" gracePeriod=30 Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.896814 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="19792b24-d033-444c-85e4-6c61e15b3ef9" containerName="object-auditor" containerID="cri-o://8cc66f619e52f2e843057161cb5972bf36695b3db04d91d03e4a9faa46d328b4" gracePeriod=30 Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.896847 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="19792b24-d033-444c-85e4-6c61e15b3ef9" containerName="object-replicator" containerID="cri-o://68f47c2138680932b56661bcd6125ef7eb13f546e55f20736f67e86ae78c7591" gracePeriod=30 Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.896880 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="19792b24-d033-444c-85e4-6c61e15b3ef9" containerName="object-server" containerID="cri-o://16aa9a28ba8e4dfebe20955c9aebe595a6848afaa458a5d1ccfd1c56d8bb2aed" gracePeriod=30 Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.896930 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="19792b24-d033-444c-85e4-6c61e15b3ef9" containerName="container-updater" containerID="cri-o://3be70b5ff49ff4f874dd20f28a1aaeef0ab75a3db9f4663ccf26dfa635bec36b" gracePeriod=30 Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.896968 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="19792b24-d033-444c-85e4-6c61e15b3ef9" containerName="container-auditor" containerID="cri-o://83ccc49abbdcaf8fb197ccdc51e709384e13c3e5791c4949a472ee766ad078a7" gracePeriod=30 Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.897013 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="19792b24-d033-444c-85e4-6c61e15b3ef9" containerName="container-replicator" containerID="cri-o://85bedc1e29ce36a378b928f6e74a20a0006ccd5ad43cd648a09420884822acca" gracePeriod=30 Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.897053 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="19792b24-d033-444c-85e4-6c61e15b3ef9" containerName="container-server" containerID="cri-o://b46421efcad9d5cfce98cb45e238d48b28afe72553a9d24bf1fc722eba0f8bf5" gracePeriod=30 Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.897086 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="19792b24-d033-444c-85e4-6c61e15b3ef9" containerName="account-reaper" containerID="cri-o://0a7fb2f116993d3fda220b555e207a0d8e8a050b2888a15593419d4b03e68e4b" gracePeriod=30 Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.897131 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="19792b24-d033-444c-85e4-6c61e15b3ef9" containerName="account-auditor" containerID="cri-o://9e58c6ff88801705f86e0adf1fbca075d147a3be9b63d9898ff8495fa9308987" gracePeriod=30 Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.897179 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="19792b24-d033-444c-85e4-6c61e15b3ef9" containerName="account-replicator" containerID="cri-o://5e5f592520f6ae20d5410c39304d3dbb7bd389193db5398803d4448db4514bde" gracePeriod=30 Mar 16 16:52:43 crc kubenswrapper[5120]: E0316 16:52:43.897238 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 772d7d749c19d303ab351e9da9794092ed431692caf8ea6741351516c112156b is running failed: container process not found" containerID="772d7d749c19d303ab351e9da9794092ed431692caf8ea6741351516c112156b" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Mar 16 16:52:43 crc kubenswrapper[5120]: E0316 16:52:43.897273 5120 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 772d7d749c19d303ab351e9da9794092ed431692caf8ea6741351516c112156b is running failed: container process not found" probeType="Readiness" pod="openstack-kuttl-tests/ovn-northd-0" podUID="46fdeab7-fc69-4767-85fb-6fe77323a249" containerName="ovn-northd" probeResult="unknown" Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.915694 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.916003 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="2627e341-ad91-4de8-96da-e58d58d40fb9" containerName="cinder-api-log" containerID="cri-o://c74f707751274cb9f40149f4d93eefc2868fbd3cda3e57a098d9924341521900" gracePeriod=30 Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.916477 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="2627e341-ad91-4de8-96da-e58d58d40fb9" containerName="cinder-api" containerID="cri-o://82d54ad68569e47a7c9f69774a92e01246e782c11e23830d6d82dfe12081e84d" gracePeriod=30 Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.956291 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-d7c95f898-g5nln"] Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.973141 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.973507 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-d7c95f898-g5nln" Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.983825 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-d7c95f898-g5nln"] Mar 16 16:52:43 crc kubenswrapper[5120]: I0316 16:52:43.996740 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-57f7845c4b-tb6nd"] Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.004293 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-57f7845c4b-tb6nd" Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.014841 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-57f7845c4b-tb6nd"] Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.055121 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ebceb235-ad03-49fd-9921-f5be8c1851be-config\") pod \"neutron-d7c95f898-g5nln\" (UID: \"ebceb235-ad03-49fd-9921-f5be8c1851be\") " pod="openstack-kuttl-tests/neutron-d7c95f898-g5nln" Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.055253 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/ebceb235-ad03-49fd-9921-f5be8c1851be-httpd-config\") pod \"neutron-d7c95f898-g5nln\" (UID: \"ebceb235-ad03-49fd-9921-f5be8c1851be\") " pod="openstack-kuttl-tests/neutron-d7c95f898-g5nln" Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.055284 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/ebceb235-ad03-49fd-9921-f5be8c1851be-internal-tls-certs\") pod \"neutron-d7c95f898-g5nln\" (UID: \"ebceb235-ad03-49fd-9921-f5be8c1851be\") " pod="openstack-kuttl-tests/neutron-d7c95f898-g5nln" Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.055341 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/ebceb235-ad03-49fd-9921-f5be8c1851be-ovndb-tls-certs\") pod \"neutron-d7c95f898-g5nln\" (UID: \"ebceb235-ad03-49fd-9921-f5be8c1851be\") " pod="openstack-kuttl-tests/neutron-d7c95f898-g5nln" Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.055382 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ebceb235-ad03-49fd-9921-f5be8c1851be-public-tls-certs\") pod \"neutron-d7c95f898-g5nln\" (UID: \"ebceb235-ad03-49fd-9921-f5be8c1851be\") " pod="openstack-kuttl-tests/neutron-d7c95f898-g5nln" Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.055471 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ebceb235-ad03-49fd-9921-f5be8c1851be-combined-ca-bundle\") pod \"neutron-d7c95f898-g5nln\" (UID: \"ebceb235-ad03-49fd-9921-f5be8c1851be\") " pod="openstack-kuttl-tests/neutron-d7c95f898-g5nln" Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.055582 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7cdc\" (UniqueName: \"kubernetes.io/projected/ebceb235-ad03-49fd-9921-f5be8c1851be-kube-api-access-z7cdc\") pod \"neutron-d7c95f898-g5nln\" (UID: \"ebceb235-ad03-49fd-9921-f5be8c1851be\") " pod="openstack-kuttl-tests/neutron-d7c95f898-g5nln" Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.065920 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-5964c9d8c-plh78"] Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.101588 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-d99589cd-7z8cg" Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.117693 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/openstack-galera-0" podUID="359ce032-c698-43d8-a7eb-011091fe9a3d" containerName="galera" containerID="cri-o://a5caf3e8fdf3dd93a4bfbfe575eaae670bb5bbd6689dcc4b186bc986e9be8a55" gracePeriod=30 Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.171544 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ffa2d14d-1b44-445b-ab47-1bb134223111-scripts\") pod \"keystone-57f7845c4b-tb6nd\" (UID: \"ffa2d14d-1b44-445b-ab47-1bb134223111\") " pod="openstack-kuttl-tests/keystone-57f7845c4b-tb6nd" Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.171599 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/ffa2d14d-1b44-445b-ab47-1bb134223111-credential-keys\") pod \"keystone-57f7845c4b-tb6nd\" (UID: \"ffa2d14d-1b44-445b-ab47-1bb134223111\") " pod="openstack-kuttl-tests/keystone-57f7845c4b-tb6nd" Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.171624 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/ebceb235-ad03-49fd-9921-f5be8c1851be-ovndb-tls-certs\") pod \"neutron-d7c95f898-g5nln\" (UID: \"ebceb235-ad03-49fd-9921-f5be8c1851be\") " pod="openstack-kuttl-tests/neutron-d7c95f898-g5nln" Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.171666 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ebceb235-ad03-49fd-9921-f5be8c1851be-public-tls-certs\") pod \"neutron-d7c95f898-g5nln\" (UID: \"ebceb235-ad03-49fd-9921-f5be8c1851be\") " pod="openstack-kuttl-tests/neutron-d7c95f898-g5nln" Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.183486 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ffa2d14d-1b44-445b-ab47-1bb134223111-config-data\") pod \"keystone-57f7845c4b-tb6nd\" (UID: \"ffa2d14d-1b44-445b-ab47-1bb134223111\") " pod="openstack-kuttl-tests/keystone-57f7845c4b-tb6nd" Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.183938 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtklb\" (UniqueName: \"kubernetes.io/projected/ffa2d14d-1b44-445b-ab47-1bb134223111-kube-api-access-wtklb\") pod \"keystone-57f7845c4b-tb6nd\" (UID: \"ffa2d14d-1b44-445b-ab47-1bb134223111\") " pod="openstack-kuttl-tests/keystone-57f7845c4b-tb6nd" Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.186100 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/ffa2d14d-1b44-445b-ab47-1bb134223111-fernet-keys\") pod \"keystone-57f7845c4b-tb6nd\" (UID: \"ffa2d14d-1b44-445b-ab47-1bb134223111\") " pod="openstack-kuttl-tests/keystone-57f7845c4b-tb6nd" Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.186193 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ebceb235-ad03-49fd-9921-f5be8c1851be-combined-ca-bundle\") pod \"neutron-d7c95f898-g5nln\" (UID: \"ebceb235-ad03-49fd-9921-f5be8c1851be\") " pod="openstack-kuttl-tests/neutron-d7c95f898-g5nln" Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.186409 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z7cdc\" (UniqueName: \"kubernetes.io/projected/ebceb235-ad03-49fd-9921-f5be8c1851be-kube-api-access-z7cdc\") pod \"neutron-d7c95f898-g5nln\" (UID: \"ebceb235-ad03-49fd-9921-f5be8c1851be\") " pod="openstack-kuttl-tests/neutron-d7c95f898-g5nln" Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.186492 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ffa2d14d-1b44-445b-ab47-1bb134223111-combined-ca-bundle\") pod \"keystone-57f7845c4b-tb6nd\" (UID: \"ffa2d14d-1b44-445b-ab47-1bb134223111\") " pod="openstack-kuttl-tests/keystone-57f7845c4b-tb6nd" Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.186726 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/ffa2d14d-1b44-445b-ab47-1bb134223111-internal-tls-certs\") pod \"keystone-57f7845c4b-tb6nd\" (UID: \"ffa2d14d-1b44-445b-ab47-1bb134223111\") " pod="openstack-kuttl-tests/keystone-57f7845c4b-tb6nd" Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.189147 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ffa2d14d-1b44-445b-ab47-1bb134223111-public-tls-certs\") pod \"keystone-57f7845c4b-tb6nd\" (UID: \"ffa2d14d-1b44-445b-ab47-1bb134223111\") " pod="openstack-kuttl-tests/keystone-57f7845c4b-tb6nd" Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.189365 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ebceb235-ad03-49fd-9921-f5be8c1851be-config\") pod \"neutron-d7c95f898-g5nln\" (UID: \"ebceb235-ad03-49fd-9921-f5be8c1851be\") " pod="openstack-kuttl-tests/neutron-d7c95f898-g5nln" Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.189544 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/ebceb235-ad03-49fd-9921-f5be8c1851be-httpd-config\") pod \"neutron-d7c95f898-g5nln\" (UID: \"ebceb235-ad03-49fd-9921-f5be8c1851be\") " pod="openstack-kuttl-tests/neutron-d7c95f898-g5nln" Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.189595 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/ebceb235-ad03-49fd-9921-f5be8c1851be-internal-tls-certs\") pod \"neutron-d7c95f898-g5nln\" (UID: \"ebceb235-ad03-49fd-9921-f5be8c1851be\") " pod="openstack-kuttl-tests/neutron-d7c95f898-g5nln" Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.209782 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/ebceb235-ad03-49fd-9921-f5be8c1851be-config\") pod \"neutron-d7c95f898-g5nln\" (UID: \"ebceb235-ad03-49fd-9921-f5be8c1851be\") " pod="openstack-kuttl-tests/neutron-d7c95f898-g5nln" Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.211735 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ebceb235-ad03-49fd-9921-f5be8c1851be-combined-ca-bundle\") pod \"neutron-d7c95f898-g5nln\" (UID: \"ebceb235-ad03-49fd-9921-f5be8c1851be\") " pod="openstack-kuttl-tests/neutron-d7c95f898-g5nln" Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.219188 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/ebceb235-ad03-49fd-9921-f5be8c1851be-internal-tls-certs\") pod \"neutron-d7c95f898-g5nln\" (UID: \"ebceb235-ad03-49fd-9921-f5be8c1851be\") " pod="openstack-kuttl-tests/neutron-d7c95f898-g5nln" Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.225667 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7cdc\" (UniqueName: \"kubernetes.io/projected/ebceb235-ad03-49fd-9921-f5be8c1851be-kube-api-access-z7cdc\") pod \"neutron-d7c95f898-g5nln\" (UID: \"ebceb235-ad03-49fd-9921-f5be8c1851be\") " pod="openstack-kuttl-tests/neutron-d7c95f898-g5nln" Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.234988 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/ebceb235-ad03-49fd-9921-f5be8c1851be-httpd-config\") pod \"neutron-d7c95f898-g5nln\" (UID: \"ebceb235-ad03-49fd-9921-f5be8c1851be\") " pod="openstack-kuttl-tests/neutron-d7c95f898-g5nln" Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.237867 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/ebceb235-ad03-49fd-9921-f5be8c1851be-ovndb-tls-certs\") pod \"neutron-d7c95f898-g5nln\" (UID: \"ebceb235-ad03-49fd-9921-f5be8c1851be\") " pod="openstack-kuttl-tests/neutron-d7c95f898-g5nln" Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.238987 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ebceb235-ad03-49fd-9921-f5be8c1851be-public-tls-certs\") pod \"neutron-d7c95f898-g5nln\" (UID: \"ebceb235-ad03-49fd-9921-f5be8c1851be\") " pod="openstack-kuttl-tests/neutron-d7c95f898-g5nln" Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.297295 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ffa2d14d-1b44-445b-ab47-1bb134223111-scripts\") pod \"keystone-57f7845c4b-tb6nd\" (UID: \"ffa2d14d-1b44-445b-ab47-1bb134223111\") " pod="openstack-kuttl-tests/keystone-57f7845c4b-tb6nd" Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.297375 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/ffa2d14d-1b44-445b-ab47-1bb134223111-credential-keys\") pod \"keystone-57f7845c4b-tb6nd\" (UID: \"ffa2d14d-1b44-445b-ab47-1bb134223111\") " pod="openstack-kuttl-tests/keystone-57f7845c4b-tb6nd" Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.297462 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ffa2d14d-1b44-445b-ab47-1bb134223111-config-data\") pod \"keystone-57f7845c4b-tb6nd\" (UID: \"ffa2d14d-1b44-445b-ab47-1bb134223111\") " pod="openstack-kuttl-tests/keystone-57f7845c4b-tb6nd" Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.297520 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wtklb\" (UniqueName: \"kubernetes.io/projected/ffa2d14d-1b44-445b-ab47-1bb134223111-kube-api-access-wtklb\") pod \"keystone-57f7845c4b-tb6nd\" (UID: \"ffa2d14d-1b44-445b-ab47-1bb134223111\") " pod="openstack-kuttl-tests/keystone-57f7845c4b-tb6nd" Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.297570 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/ffa2d14d-1b44-445b-ab47-1bb134223111-fernet-keys\") pod \"keystone-57f7845c4b-tb6nd\" (UID: \"ffa2d14d-1b44-445b-ab47-1bb134223111\") " pod="openstack-kuttl-tests/keystone-57f7845c4b-tb6nd" Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.297745 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ffa2d14d-1b44-445b-ab47-1bb134223111-combined-ca-bundle\") pod \"keystone-57f7845c4b-tb6nd\" (UID: \"ffa2d14d-1b44-445b-ab47-1bb134223111\") " pod="openstack-kuttl-tests/keystone-57f7845c4b-tb6nd" Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.298260 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/ffa2d14d-1b44-445b-ab47-1bb134223111-internal-tls-certs\") pod \"keystone-57f7845c4b-tb6nd\" (UID: \"ffa2d14d-1b44-445b-ab47-1bb134223111\") " pod="openstack-kuttl-tests/keystone-57f7845c4b-tb6nd" Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.298382 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ffa2d14d-1b44-445b-ab47-1bb134223111-public-tls-certs\") pod \"keystone-57f7845c4b-tb6nd\" (UID: \"ffa2d14d-1b44-445b-ab47-1bb134223111\") " pod="openstack-kuttl-tests/keystone-57f7845c4b-tb6nd" Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.313404 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podUID="9f5ce683-1975-46fb-ab27-2e4888748b7b" containerName="nova-cell1-novncproxy-novncproxy" probeResult="failure" output="Get \"https://10.217.0.107:6080/vnc_lite.html\": dial tcp 10.217.0.107:6080: connect: connection refused" Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.316242 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/ffa2d14d-1b44-445b-ab47-1bb134223111-internal-tls-certs\") pod \"keystone-57f7845c4b-tb6nd\" (UID: \"ffa2d14d-1b44-445b-ab47-1bb134223111\") " pod="openstack-kuttl-tests/keystone-57f7845c4b-tb6nd" Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.322554 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/ffa2d14d-1b44-445b-ab47-1bb134223111-fernet-keys\") pod \"keystone-57f7845c4b-tb6nd\" (UID: \"ffa2d14d-1b44-445b-ab47-1bb134223111\") " pod="openstack-kuttl-tests/keystone-57f7845c4b-tb6nd" Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.324964 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ffa2d14d-1b44-445b-ab47-1bb134223111-config-data\") pod \"keystone-57f7845c4b-tb6nd\" (UID: \"ffa2d14d-1b44-445b-ab47-1bb134223111\") " pod="openstack-kuttl-tests/keystone-57f7845c4b-tb6nd" Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.334142 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/ffa2d14d-1b44-445b-ab47-1bb134223111-credential-keys\") pod \"keystone-57f7845c4b-tb6nd\" (UID: \"ffa2d14d-1b44-445b-ab47-1bb134223111\") " pod="openstack-kuttl-tests/keystone-57f7845c4b-tb6nd" Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.334370 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ffa2d14d-1b44-445b-ab47-1bb134223111-scripts\") pod \"keystone-57f7845c4b-tb6nd\" (UID: \"ffa2d14d-1b44-445b-ab47-1bb134223111\") " pod="openstack-kuttl-tests/keystone-57f7845c4b-tb6nd" Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.338419 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ffa2d14d-1b44-445b-ab47-1bb134223111-public-tls-certs\") pod \"keystone-57f7845c4b-tb6nd\" (UID: \"ffa2d14d-1b44-445b-ab47-1bb134223111\") " pod="openstack-kuttl-tests/keystone-57f7845c4b-tb6nd" Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.339075 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ffa2d14d-1b44-445b-ab47-1bb134223111-combined-ca-bundle\") pod \"keystone-57f7845c4b-tb6nd\" (UID: \"ffa2d14d-1b44-445b-ab47-1bb134223111\") " pod="openstack-kuttl-tests/keystone-57f7845c4b-tb6nd" Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.351104 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtklb\" (UniqueName: \"kubernetes.io/projected/ffa2d14d-1b44-445b-ab47-1bb134223111-kube-api-access-wtklb\") pod \"keystone-57f7845c4b-tb6nd\" (UID: \"ffa2d14d-1b44-445b-ab47-1bb134223111\") " pod="openstack-kuttl-tests/keystone-57f7845c4b-tb6nd" Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.361117 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-57f7845c4b-tb6nd" Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.399930 5120 generic.go:358] "Generic (PLEG): container finished" podID="2627e341-ad91-4de8-96da-e58d58d40fb9" containerID="c74f707751274cb9f40149f4d93eefc2868fbd3cda3e57a098d9924341521900" exitCode=143 Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.400074 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"2627e341-ad91-4de8-96da-e58d58d40fb9","Type":"ContainerDied","Data":"c74f707751274cb9f40149f4d93eefc2868fbd3cda3e57a098d9924341521900"} Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.404052 5120 generic.go:358] "Generic (PLEG): container finished" podID="8a564f44-3c8d-4dff-b968-96f276382786" containerID="0970df69e7dcb99e02e2b51ae8385d57de92fa7a1df72fa7d9dc8321b67d814b" exitCode=143 Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.404185 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"8a564f44-3c8d-4dff-b968-96f276382786","Type":"ContainerDied","Data":"0970df69e7dcb99e02e2b51ae8385d57de92fa7a1df72fa7d9dc8321b67d814b"} Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.427006 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_bb689081-a0bf-445f-aa9f-12a38c98a269/ovsdbserver-sb/0.log" Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.427065 5120 generic.go:358] "Generic (PLEG): container finished" podID="bb689081-a0bf-445f-aa9f-12a38c98a269" containerID="a1cd73640c37a42fa6ebe4301abe6341be42e951fc430d48f97879efaf1fc878" exitCode=2 Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.427081 5120 generic.go:358] "Generic (PLEG): container finished" podID="bb689081-a0bf-445f-aa9f-12a38c98a269" containerID="923a669bca7315d4fb93e0c792a4a355ec7d35b80a15a8429162435af8939525" exitCode=143 Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.427256 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"bb689081-a0bf-445f-aa9f-12a38c98a269","Type":"ContainerDied","Data":"a1cd73640c37a42fa6ebe4301abe6341be42e951fc430d48f97879efaf1fc878"} Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.427291 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"bb689081-a0bf-445f-aa9f-12a38c98a269","Type":"ContainerDied","Data":"923a669bca7315d4fb93e0c792a4a355ec7d35b80a15a8429162435af8939525"} Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.464466 5120 generic.go:358] "Generic (PLEG): container finished" podID="e5b6bb5a-fb93-4761-b995-1842090c7047" containerID="9ce74e3e7c03671f217a90ecc54371da22afef7549bf1a2fab8103a986ef97ef" exitCode=143 Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.464573 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"e5b6bb5a-fb93-4761-b995-1842090c7047","Type":"ContainerDied","Data":"9ce74e3e7c03671f217a90ecc54371da22afef7549bf1a2fab8103a986ef97ef"} Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.473853 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-d7c95f898-g5nln" Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.474209 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-northd-0_46fdeab7-fc69-4767-85fb-6fe77323a249/ovn-northd/0.log" Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.474297 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.483741 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.484004 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="adaee0e3-17f6-4f23-97c4-00bd5f6a8d6c" containerName="nova-cell1-conductor-conductor" containerID="cri-o://ba4af8aa3c89740443bcafa47b272ccb7a4f3b2222974c478de29e30c4166272" gracePeriod=30 Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.489867 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-5964c9d8c-plh78" event={"ID":"d6db354d-c48c-4497-a289-18edadffce47","Type":"ContainerStarted","Data":"950f4eeddc30179ddbd8a412891224574d9d1a599951b70fb7b9c7899af585db"} Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.512247 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/openstack-cell1-galera-0" podUID="30517467-b630-4ca2-815c-460999b6539a" containerName="galera" containerID="cri-o://b20277c633e0b78465cbdd8b3094afe9e4fc50b2aa342ab3382ce2a06551927f" gracePeriod=30 Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.558981 5120 generic.go:358] "Generic (PLEG): container finished" podID="19792b24-d033-444c-85e4-6c61e15b3ef9" containerID="a50f502dcf9ac9ec39a46fcdfb0987499d1691d3eab94d676808ebf31f0e2a68" exitCode=0 Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.559021 5120 generic.go:358] "Generic (PLEG): container finished" podID="19792b24-d033-444c-85e4-6c61e15b3ef9" containerID="411356d69e314d94388d3be8985c1067e90f4cda6e4f2ae2f79448189fdd7603" exitCode=0 Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.559031 5120 generic.go:358] "Generic (PLEG): container finished" podID="19792b24-d033-444c-85e4-6c61e15b3ef9" containerID="8cc66f619e52f2e843057161cb5972bf36695b3db04d91d03e4a9faa46d328b4" exitCode=0 Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.559038 5120 generic.go:358] "Generic (PLEG): container finished" podID="19792b24-d033-444c-85e4-6c61e15b3ef9" containerID="68f47c2138680932b56661bcd6125ef7eb13f546e55f20736f67e86ae78c7591" exitCode=0 Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.559043 5120 generic.go:358] "Generic (PLEG): container finished" podID="19792b24-d033-444c-85e4-6c61e15b3ef9" containerID="3be70b5ff49ff4f874dd20f28a1aaeef0ab75a3db9f4663ccf26dfa635bec36b" exitCode=0 Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.559048 5120 generic.go:358] "Generic (PLEG): container finished" podID="19792b24-d033-444c-85e4-6c61e15b3ef9" containerID="83ccc49abbdcaf8fb197ccdc51e709384e13c3e5791c4949a472ee766ad078a7" exitCode=0 Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.559054 5120 generic.go:358] "Generic (PLEG): container finished" podID="19792b24-d033-444c-85e4-6c61e15b3ef9" containerID="85bedc1e29ce36a378b928f6e74a20a0006ccd5ad43cd648a09420884822acca" exitCode=0 Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.559059 5120 generic.go:358] "Generic (PLEG): container finished" podID="19792b24-d033-444c-85e4-6c61e15b3ef9" containerID="b46421efcad9d5cfce98cb45e238d48b28afe72553a9d24bf1fc722eba0f8bf5" exitCode=0 Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.559064 5120 generic.go:358] "Generic (PLEG): container finished" podID="19792b24-d033-444c-85e4-6c61e15b3ef9" containerID="0a7fb2f116993d3fda220b555e207a0d8e8a050b2888a15593419d4b03e68e4b" exitCode=0 Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.559070 5120 generic.go:358] "Generic (PLEG): container finished" podID="19792b24-d033-444c-85e4-6c61e15b3ef9" containerID="9e58c6ff88801705f86e0adf1fbca075d147a3be9b63d9898ff8495fa9308987" exitCode=0 Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.559075 5120 generic.go:358] "Generic (PLEG): container finished" podID="19792b24-d033-444c-85e4-6c61e15b3ef9" containerID="5e5f592520f6ae20d5410c39304d3dbb7bd389193db5398803d4448db4514bde" exitCode=0 Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.559080 5120 generic.go:358] "Generic (PLEG): container finished" podID="19792b24-d033-444c-85e4-6c61e15b3ef9" containerID="33a337777a56380f0a0d97bc5d689d730f9a15c8b90423ac83df28cd5f72cdea" exitCode=0 Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.559197 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"19792b24-d033-444c-85e4-6c61e15b3ef9","Type":"ContainerDied","Data":"a50f502dcf9ac9ec39a46fcdfb0987499d1691d3eab94d676808ebf31f0e2a68"} Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.559238 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"19792b24-d033-444c-85e4-6c61e15b3ef9","Type":"ContainerDied","Data":"411356d69e314d94388d3be8985c1067e90f4cda6e4f2ae2f79448189fdd7603"} Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.559258 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"19792b24-d033-444c-85e4-6c61e15b3ef9","Type":"ContainerDied","Data":"8cc66f619e52f2e843057161cb5972bf36695b3db04d91d03e4a9faa46d328b4"} Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.559266 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"19792b24-d033-444c-85e4-6c61e15b3ef9","Type":"ContainerDied","Data":"68f47c2138680932b56661bcd6125ef7eb13f546e55f20736f67e86ae78c7591"} Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.559275 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"19792b24-d033-444c-85e4-6c61e15b3ef9","Type":"ContainerDied","Data":"3be70b5ff49ff4f874dd20f28a1aaeef0ab75a3db9f4663ccf26dfa635bec36b"} Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.559283 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"19792b24-d033-444c-85e4-6c61e15b3ef9","Type":"ContainerDied","Data":"83ccc49abbdcaf8fb197ccdc51e709384e13c3e5791c4949a472ee766ad078a7"} Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.559291 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"19792b24-d033-444c-85e4-6c61e15b3ef9","Type":"ContainerDied","Data":"85bedc1e29ce36a378b928f6e74a20a0006ccd5ad43cd648a09420884822acca"} Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.559303 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"19792b24-d033-444c-85e4-6c61e15b3ef9","Type":"ContainerDied","Data":"b46421efcad9d5cfce98cb45e238d48b28afe72553a9d24bf1fc722eba0f8bf5"} Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.559311 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"19792b24-d033-444c-85e4-6c61e15b3ef9","Type":"ContainerDied","Data":"0a7fb2f116993d3fda220b555e207a0d8e8a050b2888a15593419d4b03e68e4b"} Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.559319 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"19792b24-d033-444c-85e4-6c61e15b3ef9","Type":"ContainerDied","Data":"9e58c6ff88801705f86e0adf1fbca075d147a3be9b63d9898ff8495fa9308987"} Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.559327 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"19792b24-d033-444c-85e4-6c61e15b3ef9","Type":"ContainerDied","Data":"5e5f592520f6ae20d5410c39304d3dbb7bd389193db5398803d4448db4514bde"} Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.559335 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"19792b24-d033-444c-85e4-6c61e15b3ef9","Type":"ContainerDied","Data":"33a337777a56380f0a0d97bc5d689d730f9a15c8b90423ac83df28cd5f72cdea"} Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.579869 5120 generic.go:358] "Generic (PLEG): container finished" podID="b3abb705-1e8c-4922-a449-616479bf0721" containerID="b1398616db52eed8170c4625ae054d108d6793d99ce5ec107004afe72c8bcb39" exitCode=143 Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.580266 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"b3abb705-1e8c-4922-a449-616479bf0721","Type":"ContainerDied","Data":"b1398616db52eed8170c4625ae054d108d6793d99ce5ec107004afe72c8bcb39"} Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.585941 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_b0528e86-65e5-4d4c-9dd9-4cd6b9475cbc/ovsdbserver-nb/0.log" Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.585979 5120 generic.go:358] "Generic (PLEG): container finished" podID="b0528e86-65e5-4d4c-9dd9-4cd6b9475cbc" containerID="87c8a7508d62404f45bb9bb4f0bf291163f78d5842cd089a3101282b7236de16" exitCode=2 Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.585993 5120 generic.go:358] "Generic (PLEG): container finished" podID="b0528e86-65e5-4d4c-9dd9-4cd6b9475cbc" containerID="17fae53bebd68929640aced62b696757a63ddac64d6806e132818ca836ccc804" exitCode=143 Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.586054 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"b0528e86-65e5-4d4c-9dd9-4cd6b9475cbc","Type":"ContainerDied","Data":"87c8a7508d62404f45bb9bb4f0bf291163f78d5842cd089a3101282b7236de16"} Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.586081 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"b0528e86-65e5-4d4c-9dd9-4cd6b9475cbc","Type":"ContainerDied","Data":"17fae53bebd68929640aced62b696757a63ddac64d6806e132818ca836ccc804"} Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.589355 5120 generic.go:358] "Generic (PLEG): container finished" podID="6a9b9d92-8d3c-4366-83fb-0ea460a622d9" containerID="5b3e8c00b8713699d929b1a7c050c59f2a7f5613beb583159b969397e1462736" exitCode=143 Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.589445 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"6a9b9d92-8d3c-4366-83fb-0ea460a622d9","Type":"ContainerDied","Data":"5b3e8c00b8713699d929b1a7c050c59f2a7f5613beb583159b969397e1462736"} Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.593887 5120 generic.go:358] "Generic (PLEG): container finished" podID="243f6b1f-595b-44eb-aaa5-0b3df41c88c1" containerID="3ae202ea0f0a4566831c4712a39b08992086f44465f4ad6f31062d4721860630" exitCode=0 Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.594165 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"243f6b1f-595b-44eb-aaa5-0b3df41c88c1","Type":"ContainerDied","Data":"3ae202ea0f0a4566831c4712a39b08992086f44465f4ad6f31062d4721860630"} Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.616260 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k58nm\" (UniqueName: \"kubernetes.io/projected/46fdeab7-fc69-4767-85fb-6fe77323a249-kube-api-access-k58nm\") pod \"46fdeab7-fc69-4767-85fb-6fe77323a249\" (UID: \"46fdeab7-fc69-4767-85fb-6fe77323a249\") " Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.616414 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/46fdeab7-fc69-4767-85fb-6fe77323a249-config\") pod \"46fdeab7-fc69-4767-85fb-6fe77323a249\" (UID: \"46fdeab7-fc69-4767-85fb-6fe77323a249\") " Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.616645 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/46fdeab7-fc69-4767-85fb-6fe77323a249-ovn-northd-tls-certs\") pod \"46fdeab7-fc69-4767-85fb-6fe77323a249\" (UID: \"46fdeab7-fc69-4767-85fb-6fe77323a249\") " Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.616817 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/46fdeab7-fc69-4767-85fb-6fe77323a249-scripts\") pod \"46fdeab7-fc69-4767-85fb-6fe77323a249\" (UID: \"46fdeab7-fc69-4767-85fb-6fe77323a249\") " Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.616981 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/46fdeab7-fc69-4767-85fb-6fe77323a249-ovn-rundir\") pod \"46fdeab7-fc69-4767-85fb-6fe77323a249\" (UID: \"46fdeab7-fc69-4767-85fb-6fe77323a249\") " Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.617023 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/46fdeab7-fc69-4767-85fb-6fe77323a249-metrics-certs-tls-certs\") pod \"46fdeab7-fc69-4767-85fb-6fe77323a249\" (UID: \"46fdeab7-fc69-4767-85fb-6fe77323a249\") " Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.617050 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/46fdeab7-fc69-4767-85fb-6fe77323a249-combined-ca-bundle\") pod \"46fdeab7-fc69-4767-85fb-6fe77323a249\" (UID: \"46fdeab7-fc69-4767-85fb-6fe77323a249\") " Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.620328 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46fdeab7-fc69-4767-85fb-6fe77323a249-ovn-rundir" (OuterVolumeSpecName: "ovn-rundir") pod "46fdeab7-fc69-4767-85fb-6fe77323a249" (UID: "46fdeab7-fc69-4767-85fb-6fe77323a249"). InnerVolumeSpecName "ovn-rundir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.620829 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/46fdeab7-fc69-4767-85fb-6fe77323a249-scripts" (OuterVolumeSpecName: "scripts") pod "46fdeab7-fc69-4767-85fb-6fe77323a249" (UID: "46fdeab7-fc69-4767-85fb-6fe77323a249"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.622219 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/46fdeab7-fc69-4767-85fb-6fe77323a249-config" (OuterVolumeSpecName: "config") pod "46fdeab7-fc69-4767-85fb-6fe77323a249" (UID: "46fdeab7-fc69-4767-85fb-6fe77323a249"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.638311 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46fdeab7-fc69-4767-85fb-6fe77323a249-kube-api-access-k58nm" (OuterVolumeSpecName: "kube-api-access-k58nm") pod "46fdeab7-fc69-4767-85fb-6fe77323a249" (UID: "46fdeab7-fc69-4767-85fb-6fe77323a249"). InnerVolumeSpecName "kube-api-access-k58nm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.720843 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k58nm\" (UniqueName: \"kubernetes.io/projected/46fdeab7-fc69-4767-85fb-6fe77323a249-kube-api-access-k58nm\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.720887 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/46fdeab7-fc69-4767-85fb-6fe77323a249-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.720929 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/46fdeab7-fc69-4767-85fb-6fe77323a249-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.720941 5120 reconciler_common.go:299] "Volume detached for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/46fdeab7-fc69-4767-85fb-6fe77323a249-ovn-rundir\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.741402 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/46fdeab7-fc69-4767-85fb-6fe77323a249-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "46fdeab7-fc69-4767-85fb-6fe77323a249" (UID: "46fdeab7-fc69-4767-85fb-6fe77323a249"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.791689 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.792079 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="7e017064-86c6-413e-b003-2f5df3306952" containerName="ceilometer-central-agent" containerID="cri-o://8218d57425e63f9f4bbf8069b07d24343f9df58411b9fc34d1dabf1911b5d806" gracePeriod=30 Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.792222 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="7e017064-86c6-413e-b003-2f5df3306952" containerName="proxy-httpd" containerID="cri-o://a27b058fc327b7f2b23592539c20e14a76cfbc908fe6c7ae8c356b40f8a204c5" gracePeriod=30 Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.792276 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="7e017064-86c6-413e-b003-2f5df3306952" containerName="sg-core" containerID="cri-o://e737c3a8474b5b2441a2fe0e5e4c4c27b963e84e3c1ac1e70370959759d8773d" gracePeriod=30 Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.792320 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="7e017064-86c6-413e-b003-2f5df3306952" containerName="ceilometer-notification-agent" containerID="cri-o://0cf2639ccd5dcff044d74634742ba674b06691c33be27480bff7ec2d5a0d3b02" gracePeriod=30 Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.823201 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/46fdeab7-fc69-4767-85fb-6fe77323a249-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.833081 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/46fdeab7-fc69-4767-85fb-6fe77323a249-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "46fdeab7-fc69-4767-85fb-6fe77323a249" (UID: "46fdeab7-fc69-4767-85fb-6fe77323a249"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.890799 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/46fdeab7-fc69-4767-85fb-6fe77323a249-ovn-northd-tls-certs" (OuterVolumeSpecName: "ovn-northd-tls-certs") pod "46fdeab7-fc69-4767-85fb-6fe77323a249" (UID: "46fdeab7-fc69-4767-85fb-6fe77323a249"). InnerVolumeSpecName "ovn-northd-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.931568 5120 reconciler_common.go:299] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/46fdeab7-fc69-4767-85fb-6fe77323a249-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.931622 5120 reconciler_common.go:299] "Volume detached for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/46fdeab7-fc69-4767-85fb-6fe77323a249-ovn-northd-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:44 crc kubenswrapper[5120]: I0316 16:52:44.950135 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-7bf49bf568-fbg2k"] Mar 16 16:52:45 crc kubenswrapper[5120]: E0316 16:52:45.159315 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 17fae53bebd68929640aced62b696757a63ddac64d6806e132818ca836ccc804 is running failed: container process not found" containerID="17fae53bebd68929640aced62b696757a63ddac64d6806e132818ca836ccc804" cmd=["/usr/bin/pidof","ovsdb-server"] Mar 16 16:52:45 crc kubenswrapper[5120]: E0316 16:52:45.159773 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 17fae53bebd68929640aced62b696757a63ddac64d6806e132818ca836ccc804 is running failed: container process not found" containerID="17fae53bebd68929640aced62b696757a63ddac64d6806e132818ca836ccc804" cmd=["/usr/bin/pidof","ovsdb-server"] Mar 16 16:52:45 crc kubenswrapper[5120]: E0316 16:52:45.160020 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 17fae53bebd68929640aced62b696757a63ddac64d6806e132818ca836ccc804 is running failed: container process not found" containerID="17fae53bebd68929640aced62b696757a63ddac64d6806e132818ca836ccc804" cmd=["/usr/bin/pidof","ovsdb-server"] Mar 16 16:52:45 crc kubenswrapper[5120]: E0316 16:52:45.160052 5120 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 17fae53bebd68929640aced62b696757a63ddac64d6806e132818ca836ccc804 is running failed: container process not found" probeType="Readiness" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podUID="b0528e86-65e5-4d4c-9dd9-4cd6b9475cbc" containerName="ovsdbserver-nb" probeResult="unknown" Mar 16 16:52:45 crc kubenswrapper[5120]: W0316 16:52:45.353732 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc846d2b2_0638_44bd_9ad0_6b6c76f8d16f.slice/crio-901c6f74843665c442fb97ed1c0fc1f4acb387fbcca4ec3635f4769ff8daa9c0 WatchSource:0}: Error finding container 901c6f74843665c442fb97ed1c0fc1f4acb387fbcca4ec3635f4769ff8daa9c0: Status 404 returned error can't find the container with id 901c6f74843665c442fb97ed1c0fc1f4acb387fbcca4ec3635f4769ff8daa9c0 Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.461108 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.463661 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.478113 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_b0528e86-65e5-4d4c-9dd9-4cd6b9475cbc/ovsdbserver-nb/0.log" Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.478210 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.494971 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_bb689081-a0bf-445f-aa9f-12a38c98a269/ovsdbserver-sb/0.log" Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.495043 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.551156 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/243f6b1f-595b-44eb-aaa5-0b3df41c88c1-kolla-config\") pod \"243f6b1f-595b-44eb-aaa5-0b3df41c88c1\" (UID: \"243f6b1f-595b-44eb-aaa5-0b3df41c88c1\") " Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.551675 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/243f6b1f-595b-44eb-aaa5-0b3df41c88c1-config-data\") pod \"243f6b1f-595b-44eb-aaa5-0b3df41c88c1\" (UID: \"243f6b1f-595b-44eb-aaa5-0b3df41c88c1\") " Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.551795 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-njnw4\" (UniqueName: \"kubernetes.io/projected/243f6b1f-595b-44eb-aaa5-0b3df41c88c1-kube-api-access-njnw4\") pod \"243f6b1f-595b-44eb-aaa5-0b3df41c88c1\" (UID: \"243f6b1f-595b-44eb-aaa5-0b3df41c88c1\") " Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.551998 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/243f6b1f-595b-44eb-aaa5-0b3df41c88c1-combined-ca-bundle\") pod \"243f6b1f-595b-44eb-aaa5-0b3df41c88c1\" (UID: \"243f6b1f-595b-44eb-aaa5-0b3df41c88c1\") " Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.552141 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/243f6b1f-595b-44eb-aaa5-0b3df41c88c1-memcached-tls-certs\") pod \"243f6b1f-595b-44eb-aaa5-0b3df41c88c1\" (UID: \"243f6b1f-595b-44eb-aaa5-0b3df41c88c1\") " Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.556088 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/243f6b1f-595b-44eb-aaa5-0b3df41c88c1-config-data" (OuterVolumeSpecName: "config-data") pod "243f6b1f-595b-44eb-aaa5-0b3df41c88c1" (UID: "243f6b1f-595b-44eb-aaa5-0b3df41c88c1"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.556385 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/243f6b1f-595b-44eb-aaa5-0b3df41c88c1-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "243f6b1f-595b-44eb-aaa5-0b3df41c88c1" (UID: "243f6b1f-595b-44eb-aaa5-0b3df41c88c1"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.562744 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/243f6b1f-595b-44eb-aaa5-0b3df41c88c1-kube-api-access-njnw4" (OuterVolumeSpecName: "kube-api-access-njnw4") pod "243f6b1f-595b-44eb-aaa5-0b3df41c88c1" (UID: "243f6b1f-595b-44eb-aaa5-0b3df41c88c1"). InnerVolumeSpecName "kube-api-access-njnw4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.629879 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/243f6b1f-595b-44eb-aaa5-0b3df41c88c1-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "243f6b1f-595b-44eb-aaa5-0b3df41c88c1" (UID: "243f6b1f-595b-44eb-aaa5-0b3df41c88c1"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.635944 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/243f6b1f-595b-44eb-aaa5-0b3df41c88c1-memcached-tls-certs" (OuterVolumeSpecName: "memcached-tls-certs") pod "243f6b1f-595b-44eb-aaa5-0b3df41c88c1" (UID: "243f6b1f-595b-44eb-aaa5-0b3df41c88c1"). InnerVolumeSpecName "memcached-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.639443 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_b0528e86-65e5-4d4c-9dd9-4cd6b9475cbc/ovsdbserver-nb/0.log" Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.639543 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"b0528e86-65e5-4d4c-9dd9-4cd6b9475cbc","Type":"ContainerDied","Data":"ba3130cc8b0b36e13d379cb4a3029e53bda6e7a65af59efe12086382b782823c"} Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.639578 5120 scope.go:117] "RemoveContainer" containerID="87c8a7508d62404f45bb9bb4f0bf291163f78d5842cd089a3101282b7236de16" Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.639613 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.649314 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-7bf49bf568-fbg2k" event={"ID":"c846d2b2-0638-44bd-9ad0-6b6c76f8d16f","Type":"ContainerStarted","Data":"901c6f74843665c442fb97ed1c0fc1f4acb387fbcca4ec3635f4769ff8daa9c0"} Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.654864 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4vwrj\" (UniqueName: \"kubernetes.io/projected/b0528e86-65e5-4d4c-9dd9-4cd6b9475cbc-kube-api-access-4vwrj\") pod \"b0528e86-65e5-4d4c-9dd9-4cd6b9475cbc\" (UID: \"b0528e86-65e5-4d4c-9dd9-4cd6b9475cbc\") " Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.654912 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bb689081-a0bf-445f-aa9f-12a38c98a269-combined-ca-bundle\") pod \"bb689081-a0bf-445f-aa9f-12a38c98a269\" (UID: \"bb689081-a0bf-445f-aa9f-12a38c98a269\") " Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.654941 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovndbcluster-nb-etc-ovn\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") pod \"b0528e86-65e5-4d4c-9dd9-4cd6b9475cbc\" (UID: \"b0528e86-65e5-4d4c-9dd9-4cd6b9475cbc\") " Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.655064 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/b0528e86-65e5-4d4c-9dd9-4cd6b9475cbc-metrics-certs-tls-certs\") pod \"b0528e86-65e5-4d4c-9dd9-4cd6b9475cbc\" (UID: \"b0528e86-65e5-4d4c-9dd9-4cd6b9475cbc\") " Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.655097 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovndbcluster-sb-etc-ovn\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"bb689081-a0bf-445f-aa9f-12a38c98a269\" (UID: \"bb689081-a0bf-445f-aa9f-12a38c98a269\") " Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.655198 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/bb689081-a0bf-445f-aa9f-12a38c98a269-ovsdb-rundir\") pod \"bb689081-a0bf-445f-aa9f-12a38c98a269\" (UID: \"bb689081-a0bf-445f-aa9f-12a38c98a269\") " Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.655229 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/bb689081-a0bf-445f-aa9f-12a38c98a269-metrics-certs-tls-certs\") pod \"bb689081-a0bf-445f-aa9f-12a38c98a269\" (UID: \"bb689081-a0bf-445f-aa9f-12a38c98a269\") " Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.655306 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/b0528e86-65e5-4d4c-9dd9-4cd6b9475cbc-ovsdbserver-nb-tls-certs\") pod \"b0528e86-65e5-4d4c-9dd9-4cd6b9475cbc\" (UID: \"b0528e86-65e5-4d4c-9dd9-4cd6b9475cbc\") " Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.655354 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b0528e86-65e5-4d4c-9dd9-4cd6b9475cbc-config\") pod \"b0528e86-65e5-4d4c-9dd9-4cd6b9475cbc\" (UID: \"b0528e86-65e5-4d4c-9dd9-4cd6b9475cbc\") " Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.655383 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/b0528e86-65e5-4d4c-9dd9-4cd6b9475cbc-scripts\") pod \"b0528e86-65e5-4d4c-9dd9-4cd6b9475cbc\" (UID: \"b0528e86-65e5-4d4c-9dd9-4cd6b9475cbc\") " Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.655442 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/bb689081-a0bf-445f-aa9f-12a38c98a269-scripts\") pod \"bb689081-a0bf-445f-aa9f-12a38c98a269\" (UID: \"bb689081-a0bf-445f-aa9f-12a38c98a269\") " Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.655476 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/bb689081-a0bf-445f-aa9f-12a38c98a269-ovsdbserver-sb-tls-certs\") pod \"bb689081-a0bf-445f-aa9f-12a38c98a269\" (UID: \"bb689081-a0bf-445f-aa9f-12a38c98a269\") " Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.655578 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xl7rl\" (UniqueName: \"kubernetes.io/projected/bb689081-a0bf-445f-aa9f-12a38c98a269-kube-api-access-xl7rl\") pod \"bb689081-a0bf-445f-aa9f-12a38c98a269\" (UID: \"bb689081-a0bf-445f-aa9f-12a38c98a269\") " Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.655598 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b0528e86-65e5-4d4c-9dd9-4cd6b9475cbc-combined-ca-bundle\") pod \"b0528e86-65e5-4d4c-9dd9-4cd6b9475cbc\" (UID: \"b0528e86-65e5-4d4c-9dd9-4cd6b9475cbc\") " Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.655694 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/b0528e86-65e5-4d4c-9dd9-4cd6b9475cbc-ovsdb-rundir\") pod \"b0528e86-65e5-4d4c-9dd9-4cd6b9475cbc\" (UID: \"b0528e86-65e5-4d4c-9dd9-4cd6b9475cbc\") " Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.655857 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bb689081-a0bf-445f-aa9f-12a38c98a269-config\") pod \"bb689081-a0bf-445f-aa9f-12a38c98a269\" (UID: \"bb689081-a0bf-445f-aa9f-12a38c98a269\") " Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.656497 5120 reconciler_common.go:299] "Volume detached for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/243f6b1f-595b-44eb-aaa5-0b3df41c88c1-memcached-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.656516 5120 reconciler_common.go:299] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/243f6b1f-595b-44eb-aaa5-0b3df41c88c1-kolla-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.656525 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/243f6b1f-595b-44eb-aaa5-0b3df41c88c1-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.656534 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-njnw4\" (UniqueName: \"kubernetes.io/projected/243f6b1f-595b-44eb-aaa5-0b3df41c88c1-kube-api-access-njnw4\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.656544 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/243f6b1f-595b-44eb-aaa5-0b3df41c88c1-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.657312 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bb689081-a0bf-445f-aa9f-12a38c98a269-config" (OuterVolumeSpecName: "config") pod "bb689081-a0bf-445f-aa9f-12a38c98a269" (UID: "bb689081-a0bf-445f-aa9f-12a38c98a269"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.658877 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b0528e86-65e5-4d4c-9dd9-4cd6b9475cbc-config" (OuterVolumeSpecName: "config") pod "b0528e86-65e5-4d4c-9dd9-4cd6b9475cbc" (UID: "b0528e86-65e5-4d4c-9dd9-4cd6b9475cbc"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.659300 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b0528e86-65e5-4d4c-9dd9-4cd6b9475cbc-scripts" (OuterVolumeSpecName: "scripts") pod "b0528e86-65e5-4d4c-9dd9-4cd6b9475cbc" (UID: "b0528e86-65e5-4d4c-9dd9-4cd6b9475cbc"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.659352 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bb689081-a0bf-445f-aa9f-12a38c98a269-scripts" (OuterVolumeSpecName: "scripts") pod "bb689081-a0bf-445f-aa9f-12a38c98a269" (UID: "bb689081-a0bf-445f-aa9f-12a38c98a269"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.659986 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb689081-a0bf-445f-aa9f-12a38c98a269-ovsdb-rundir" (OuterVolumeSpecName: "ovsdb-rundir") pod "bb689081-a0bf-445f-aa9f-12a38c98a269" (UID: "bb689081-a0bf-445f-aa9f-12a38c98a269"). InnerVolumeSpecName "ovsdb-rundir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.660364 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0528e86-65e5-4d4c-9dd9-4cd6b9475cbc-ovsdb-rundir" (OuterVolumeSpecName: "ovsdb-rundir") pod "b0528e86-65e5-4d4c-9dd9-4cd6b9475cbc" (UID: "b0528e86-65e5-4d4c-9dd9-4cd6b9475cbc"). InnerVolumeSpecName "ovsdb-rundir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.662634 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb689081-a0bf-445f-aa9f-12a38c98a269-kube-api-access-xl7rl" (OuterVolumeSpecName: "kube-api-access-xl7rl") pod "bb689081-a0bf-445f-aa9f-12a38c98a269" (UID: "bb689081-a0bf-445f-aa9f-12a38c98a269"). InnerVolumeSpecName "kube-api-access-xl7rl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.664792 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage17-crc" (OuterVolumeSpecName: "ovndbcluster-nb-etc-ovn") pod "b0528e86-65e5-4d4c-9dd9-4cd6b9475cbc" (UID: "b0528e86-65e5-4d4c-9dd9-4cd6b9475cbc"). InnerVolumeSpecName "local-storage17-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.668127 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage06-crc" (OuterVolumeSpecName: "ovndbcluster-sb-etc-ovn") pod "bb689081-a0bf-445f-aa9f-12a38c98a269" (UID: "bb689081-a0bf-445f-aa9f-12a38c98a269"). InnerVolumeSpecName "local-storage06-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.689433 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.689460 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"243f6b1f-595b-44eb-aaa5-0b3df41c88c1","Type":"ContainerDied","Data":"d39e83b86a56d5e176237b38616dd7059d1b2f47f9b2887f33600f1b487d2e9f"} Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.690518 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0528e86-65e5-4d4c-9dd9-4cd6b9475cbc-kube-api-access-4vwrj" (OuterVolumeSpecName: "kube-api-access-4vwrj") pod "b0528e86-65e5-4d4c-9dd9-4cd6b9475cbc" (UID: "b0528e86-65e5-4d4c-9dd9-4cd6b9475cbc"). InnerVolumeSpecName "kube-api-access-4vwrj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.699354 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b0528e86-65e5-4d4c-9dd9-4cd6b9475cbc-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "b0528e86-65e5-4d4c-9dd9-4cd6b9475cbc" (UID: "b0528e86-65e5-4d4c-9dd9-4cd6b9475cbc"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.714005 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-646d48c554-kk5ms"] Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.723368 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bb689081-a0bf-445f-aa9f-12a38c98a269-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "bb689081-a0bf-445f-aa9f-12a38c98a269" (UID: "bb689081-a0bf-445f-aa9f-12a38c98a269"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.730204 5120 generic.go:358] "Generic (PLEG): container finished" podID="c89f3439-256a-47de-9a4b-33f3a5231721" containerID="e57a4c9ac68cdf613fab20d09b18fbc7abe70575a805ef23da6a7c2bb2219851" exitCode=137 Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.742082 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.760406 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") on node \"crc\" " Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.760678 5120 reconciler_common.go:299] "Volume detached for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/bb689081-a0bf-445f-aa9f-12a38c98a269-ovsdb-rundir\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.760808 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b0528e86-65e5-4d4c-9dd9-4cd6b9475cbc-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.760888 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/b0528e86-65e5-4d4c-9dd9-4cd6b9475cbc-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.760957 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/bb689081-a0bf-445f-aa9f-12a38c98a269-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.761026 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xl7rl\" (UniqueName: \"kubernetes.io/projected/bb689081-a0bf-445f-aa9f-12a38c98a269-kube-api-access-xl7rl\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.761097 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b0528e86-65e5-4d4c-9dd9-4cd6b9475cbc-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.761178 5120 reconciler_common.go:299] "Volume detached for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/b0528e86-65e5-4d4c-9dd9-4cd6b9475cbc-ovsdb-rundir\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.761248 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bb689081-a0bf-445f-aa9f-12a38c98a269-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.761316 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4vwrj\" (UniqueName: \"kubernetes.io/projected/b0528e86-65e5-4d4c-9dd9-4cd6b9475cbc-kube-api-access-4vwrj\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.761389 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bb689081-a0bf-445f-aa9f-12a38c98a269-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.761467 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") on node \"crc\" " Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.762989 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.765225 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-northd-0_46fdeab7-fc69-4767-85fb-6fe77323a249/ovn-northd/0.log" Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.765367 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"46fdeab7-fc69-4767-85fb-6fe77323a249","Type":"ContainerDied","Data":"7e1d6d598b7117b019f831fbc287bdb7edb6c8410369f34469cffa1a0c72a732"} Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.765462 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.785903 5120 generic.go:358] "Generic (PLEG): container finished" podID="30517467-b630-4ca2-815c-460999b6539a" containerID="b20277c633e0b78465cbdd8b3094afe9e4fc50b2aa342ab3382ce2a06551927f" exitCode=0 Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.786238 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"30517467-b630-4ca2-815c-460999b6539a","Type":"ContainerDied","Data":"b20277c633e0b78465cbdd8b3094afe9e4fc50b2aa342ab3382ce2a06551927f"} Mar 16 16:52:45 crc kubenswrapper[5120]: W0316 16:52:45.792840 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod74ab0944_2f5c_4a9d_a848_8e2a8d17d9cd.slice/crio-d0a301afc63d220a7463bc2a86a27cf70d1dec59cb76e7172773090e62c92b55 WatchSource:0}: Error finding container d0a301afc63d220a7463bc2a86a27cf70d1dec59cb76e7172773090e62c92b55: Status 404 returned error can't find the container with id d0a301afc63d220a7463bc2a86a27cf70d1dec59cb76e7172773090e62c92b55 Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.804204 5120 generic.go:358] "Generic (PLEG): container finished" podID="8a04cbe2-cde0-405c-820b-f2651d753654" containerID="0b2132e2ff271b061aeedada07b1b4b7222370b28d5b9e6d518cdc82cd879170" exitCode=0 Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.804531 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"8a04cbe2-cde0-405c-820b-f2651d753654","Type":"ContainerDied","Data":"0b2132e2ff271b061aeedada07b1b4b7222370b28d5b9e6d518cdc82cd879170"} Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.804604 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.807552 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb689081-a0bf-445f-aa9f-12a38c98a269" containerName="ovsdbserver-sb" Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.807592 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb689081-a0bf-445f-aa9f-12a38c98a269" containerName="ovsdbserver-sb" Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.807623 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46fdeab7-fc69-4767-85fb-6fe77323a249" containerName="openstack-network-exporter" Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.807638 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="46fdeab7-fc69-4767-85fb-6fe77323a249" containerName="openstack-network-exporter" Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.807749 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0528e86-65e5-4d4c-9dd9-4cd6b9475cbc" containerName="ovsdbserver-nb" Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.807778 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0528e86-65e5-4d4c-9dd9-4cd6b9475cbc" containerName="ovsdbserver-nb" Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.807795 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46fdeab7-fc69-4767-85fb-6fe77323a249" containerName="ovn-northd" Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.807803 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="46fdeab7-fc69-4767-85fb-6fe77323a249" containerName="ovn-northd" Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.807844 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="243f6b1f-595b-44eb-aaa5-0b3df41c88c1" containerName="memcached" Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.807850 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="243f6b1f-595b-44eb-aaa5-0b3df41c88c1" containerName="memcached" Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.807874 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0528e86-65e5-4d4c-9dd9-4cd6b9475cbc" containerName="openstack-network-exporter" Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.807882 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0528e86-65e5-4d4c-9dd9-4cd6b9475cbc" containerName="openstack-network-exporter" Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.807900 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb689081-a0bf-445f-aa9f-12a38c98a269" containerName="openstack-network-exporter" Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.807905 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb689081-a0bf-445f-aa9f-12a38c98a269" containerName="openstack-network-exporter" Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.808382 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="bb689081-a0bf-445f-aa9f-12a38c98a269" containerName="ovsdbserver-sb" Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.808403 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="46fdeab7-fc69-4767-85fb-6fe77323a249" containerName="openstack-network-exporter" Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.808410 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="bb689081-a0bf-445f-aa9f-12a38c98a269" containerName="openstack-network-exporter" Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.808430 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="46fdeab7-fc69-4767-85fb-6fe77323a249" containerName="ovn-northd" Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.808445 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="b0528e86-65e5-4d4c-9dd9-4cd6b9475cbc" containerName="ovsdbserver-nb" Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.808461 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="b0528e86-65e5-4d4c-9dd9-4cd6b9475cbc" containerName="openstack-network-exporter" Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.808478 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="243f6b1f-595b-44eb-aaa5-0b3df41c88c1" containerName="memcached" Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.815479 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.826310 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"memcached-memcached-dockercfg-njnwg\"" Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.826604 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-memcached-svc\"" Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.826845 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"memcached-config-data\"" Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.844410 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage17-crc" (UniqueName: "kubernetes.io/local-volume/local-storage17-crc") on node "crc" Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.845404 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_bb689081-a0bf-445f-aa9f-12a38c98a269/ovsdbserver-sb/0.log" Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.850716 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"bb689081-a0bf-445f-aa9f-12a38c98a269","Type":"ContainerDied","Data":"f77cbfbe48658688edd4f31666e6628c1e33e2efc976e6dafb00b12746fffa5e"} Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.851731 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.855927 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage06-crc" (UniqueName: "kubernetes.io/local-volume/local-storage06-crc") on node "crc" Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.872930 5120 generic.go:358] "Generic (PLEG): container finished" podID="9f5ce683-1975-46fb-ab27-2e4888748b7b" containerID="6ec7a760a1240a7bf2d5c6d87956f6162ba6eb01f9c73461e515eedd1212d168" exitCode=0 Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.873150 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"9f5ce683-1975-46fb-ab27-2e4888748b7b","Type":"ContainerDied","Data":"6ec7a760a1240a7bf2d5c6d87956f6162ba6eb01f9c73461e515eedd1212d168"} Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.876153 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.876251 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.879872 5120 generic.go:358] "Generic (PLEG): container finished" podID="c186765a-7323-4f11-ac91-6c1ab1f2ac4f" containerID="609de6baddc7fc53ce05c0d9ebc736f4466bffcd372ef8e11b45d04f5a528f5f" exitCode=0 Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.880032 5120 generic.go:358] "Generic (PLEG): container finished" podID="c186765a-7323-4f11-ac91-6c1ab1f2ac4f" containerID="40c9d0ca2040ab594fed757bb25e8a4e0800b5d718f67c29748ee6caecf34c93" exitCode=0 Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.880326 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"c186765a-7323-4f11-ac91-6c1ab1f2ac4f","Type":"ContainerDied","Data":"609de6baddc7fc53ce05c0d9ebc736f4466bffcd372ef8e11b45d04f5a528f5f"} Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.880557 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"c186765a-7323-4f11-ac91-6c1ab1f2ac4f","Type":"ContainerDied","Data":"40c9d0ca2040ab594fed757bb25e8a4e0800b5d718f67c29748ee6caecf34c93"} Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.891127 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bb689081-a0bf-445f-aa9f-12a38c98a269-ovsdbserver-sb-tls-certs" (OuterVolumeSpecName: "ovsdbserver-sb-tls-certs") pod "bb689081-a0bf-445f-aa9f-12a38c98a269" (UID: "bb689081-a0bf-445f-aa9f-12a38c98a269"). InnerVolumeSpecName "ovsdbserver-sb-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.899112 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.908958 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b0528e86-65e5-4d4c-9dd9-4cd6b9475cbc-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "b0528e86-65e5-4d4c-9dd9-4cd6b9475cbc" (UID: "b0528e86-65e5-4d4c-9dd9-4cd6b9475cbc"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.924520 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bb689081-a0bf-445f-aa9f-12a38c98a269-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "bb689081-a0bf-445f-aa9f-12a38c98a269" (UID: "bb689081-a0bf-445f-aa9f-12a38c98a269"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.933457 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.934884 5120 generic.go:358] "Generic (PLEG): container finished" podID="19792b24-d033-444c-85e4-6c61e15b3ef9" containerID="d5ead9fcc8dbfab3297040cbfe1f71aefa0dbbb8a01a88712ffdf35d5d7ddb5a" exitCode=0 Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.934913 5120 generic.go:358] "Generic (PLEG): container finished" podID="19792b24-d033-444c-85e4-6c61e15b3ef9" containerID="16aa9a28ba8e4dfebe20955c9aebe595a6848afaa458a5d1ccfd1c56d8bb2aed" exitCode=0 Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.935202 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"19792b24-d033-444c-85e4-6c61e15b3ef9","Type":"ContainerDied","Data":"d5ead9fcc8dbfab3297040cbfe1f71aefa0dbbb8a01a88712ffdf35d5d7ddb5a"} Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.935232 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"19792b24-d033-444c-85e4-6c61e15b3ef9","Type":"ContainerDied","Data":"16aa9a28ba8e4dfebe20955c9aebe595a6848afaa458a5d1ccfd1c56d8bb2aed"} Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.945484 5120 scope.go:117] "RemoveContainer" containerID="17fae53bebd68929640aced62b696757a63ddac64d6806e132818ca836ccc804" Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.978387 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/a3cdc115-5535-44fd-94b4-6256145dea7e-config-data\") pod \"memcached-0\" (UID: \"a3cdc115-5535-44fd-94b4-6256145dea7e\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.978534 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a3cdc115-5535-44fd-94b4-6256145dea7e-combined-ca-bundle\") pod \"memcached-0\" (UID: \"a3cdc115-5535-44fd-94b4-6256145dea7e\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.978563 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/a3cdc115-5535-44fd-94b4-6256145dea7e-kolla-config\") pod \"memcached-0\" (UID: \"a3cdc115-5535-44fd-94b4-6256145dea7e\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.978690 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwd67\" (UniqueName: \"kubernetes.io/projected/a3cdc115-5535-44fd-94b4-6256145dea7e-kube-api-access-kwd67\") pod \"memcached-0\" (UID: \"a3cdc115-5535-44fd-94b4-6256145dea7e\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.978814 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/a3cdc115-5535-44fd-94b4-6256145dea7e-memcached-tls-certs\") pod \"memcached-0\" (UID: \"a3cdc115-5535-44fd-94b4-6256145dea7e\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.978880 5120 reconciler_common.go:299] "Volume detached for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/bb689081-a0bf-445f-aa9f-12a38c98a269-ovsdbserver-sb-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.978891 5120 reconciler_common.go:299] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/b0528e86-65e5-4d4c-9dd9-4cd6b9475cbc-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:45 crc kubenswrapper[5120]: I0316 16:52:45.978900 5120 reconciler_common.go:299] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/bb689081-a0bf-445f-aa9f-12a38c98a269-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:46 crc kubenswrapper[5120]: I0316 16:52:46.019213 5120 generic.go:358] "Generic (PLEG): container finished" podID="7e017064-86c6-413e-b003-2f5df3306952" containerID="a27b058fc327b7f2b23592539c20e14a76cfbc908fe6c7ae8c356b40f8a204c5" exitCode=0 Mar 16 16:52:46 crc kubenswrapper[5120]: I0316 16:52:46.019247 5120 generic.go:358] "Generic (PLEG): container finished" podID="7e017064-86c6-413e-b003-2f5df3306952" containerID="e737c3a8474b5b2441a2fe0e5e4c4c27b963e84e3c1ac1e70370959759d8773d" exitCode=2 Mar 16 16:52:46 crc kubenswrapper[5120]: I0316 16:52:46.019255 5120 generic.go:358] "Generic (PLEG): container finished" podID="7e017064-86c6-413e-b003-2f5df3306952" containerID="8218d57425e63f9f4bbf8069b07d24343f9df58411b9fc34d1dabf1911b5d806" exitCode=0 Mar 16 16:52:46 crc kubenswrapper[5120]: I0316 16:52:46.019298 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 16:52:46 crc kubenswrapper[5120]: I0316 16:52:46.019331 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7e017064-86c6-413e-b003-2f5df3306952","Type":"ContainerDied","Data":"a27b058fc327b7f2b23592539c20e14a76cfbc908fe6c7ae8c356b40f8a204c5"} Mar 16 16:52:46 crc kubenswrapper[5120]: I0316 16:52:46.019350 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7e017064-86c6-413e-b003-2f5df3306952","Type":"ContainerDied","Data":"e737c3a8474b5b2441a2fe0e5e4c4c27b963e84e3c1ac1e70370959759d8773d"} Mar 16 16:52:46 crc kubenswrapper[5120]: I0316 16:52:46.019360 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7e017064-86c6-413e-b003-2f5df3306952","Type":"ContainerDied","Data":"8218d57425e63f9f4bbf8069b07d24343f9df58411b9fc34d1dabf1911b5d806"} Mar 16 16:52:46 crc kubenswrapper[5120]: I0316 16:52:46.019942 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Mar 16 16:52:46 crc kubenswrapper[5120]: I0316 16:52:46.034488 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:52:46 crc kubenswrapper[5120]: I0316 16:52:46.054983 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b0528e86-65e5-4d4c-9dd9-4cd6b9475cbc-ovsdbserver-nb-tls-certs" (OuterVolumeSpecName: "ovsdbserver-nb-tls-certs") pod "b0528e86-65e5-4d4c-9dd9-4cd6b9475cbc" (UID: "b0528e86-65e5-4d4c-9dd9-4cd6b9475cbc"). InnerVolumeSpecName "ovsdbserver-nb-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:52:46 crc kubenswrapper[5120]: I0316 16:52:46.080249 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 16:52:46 crc kubenswrapper[5120]: I0316 16:52:46.082099 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f5ce683-1975-46fb-ab27-2e4888748b7b" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 16:52:46 crc kubenswrapper[5120]: I0316 16:52:46.082126 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f5ce683-1975-46fb-ab27-2e4888748b7b" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 16:52:46 crc kubenswrapper[5120]: I0316 16:52:46.082386 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="9f5ce683-1975-46fb-ab27-2e4888748b7b" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 16:52:46 crc kubenswrapper[5120]: I0316 16:52:46.087354 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a3cdc115-5535-44fd-94b4-6256145dea7e-combined-ca-bundle\") pod \"memcached-0\" (UID: \"a3cdc115-5535-44fd-94b4-6256145dea7e\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:52:46 crc kubenswrapper[5120]: I0316 16:52:46.087627 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/a3cdc115-5535-44fd-94b4-6256145dea7e-kolla-config\") pod \"memcached-0\" (UID: \"a3cdc115-5535-44fd-94b4-6256145dea7e\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:52:46 crc kubenswrapper[5120]: I0316 16:52:46.087963 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kwd67\" (UniqueName: \"kubernetes.io/projected/a3cdc115-5535-44fd-94b4-6256145dea7e-kube-api-access-kwd67\") pod \"memcached-0\" (UID: \"a3cdc115-5535-44fd-94b4-6256145dea7e\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:52:46 crc kubenswrapper[5120]: I0316 16:52:46.088225 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/a3cdc115-5535-44fd-94b4-6256145dea7e-memcached-tls-certs\") pod \"memcached-0\" (UID: \"a3cdc115-5535-44fd-94b4-6256145dea7e\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:52:46 crc kubenswrapper[5120]: I0316 16:52:46.088455 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/a3cdc115-5535-44fd-94b4-6256145dea7e-config-data\") pod \"memcached-0\" (UID: \"a3cdc115-5535-44fd-94b4-6256145dea7e\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:52:46 crc kubenswrapper[5120]: I0316 16:52:46.094176 5120 reconciler_common.go:299] "Volume detached for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/b0528e86-65e5-4d4c-9dd9-4cd6b9475cbc-ovsdbserver-nb-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:46 crc kubenswrapper[5120]: I0316 16:52:46.089668 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/a3cdc115-5535-44fd-94b4-6256145dea7e-config-data\") pod \"memcached-0\" (UID: \"a3cdc115-5535-44fd-94b4-6256145dea7e\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:52:46 crc kubenswrapper[5120]: I0316 16:52:46.089470 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/a3cdc115-5535-44fd-94b4-6256145dea7e-kolla-config\") pod \"memcached-0\" (UID: \"a3cdc115-5535-44fd-94b4-6256145dea7e\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:52:46 crc kubenswrapper[5120]: I0316 16:52:46.098448 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/a3cdc115-5535-44fd-94b4-6256145dea7e-memcached-tls-certs\") pod \"memcached-0\" (UID: \"a3cdc115-5535-44fd-94b4-6256145dea7e\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:52:46 crc kubenswrapper[5120]: I0316 16:52:46.101494 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a3cdc115-5535-44fd-94b4-6256145dea7e-combined-ca-bundle\") pod \"memcached-0\" (UID: \"a3cdc115-5535-44fd-94b4-6256145dea7e\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:52:46 crc kubenswrapper[5120]: I0316 16:52:46.107467 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:52:46 crc kubenswrapper[5120]: I0316 16:52:46.110596 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovnnorthd-config\"" Mar 16 16:52:46 crc kubenswrapper[5120]: I0316 16:52:46.114243 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ovnnorthd-ovndbs\"" Mar 16 16:52:46 crc kubenswrapper[5120]: I0316 16:52:46.114576 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ovnnorthd-ovnnorthd-dockercfg-gxfx7\"" Mar 16 16:52:46 crc kubenswrapper[5120]: I0316 16:52:46.114834 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovnnorthd-scripts\"" Mar 16 16:52:46 crc kubenswrapper[5120]: I0316 16:52:46.120609 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwd67\" (UniqueName: \"kubernetes.io/projected/a3cdc115-5535-44fd-94b4-6256145dea7e-kube-api-access-kwd67\") pod \"memcached-0\" (UID: \"a3cdc115-5535-44fd-94b4-6256145dea7e\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:52:46 crc kubenswrapper[5120]: I0316 16:52:46.123319 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 16:52:46 crc kubenswrapper[5120]: I0316 16:52:46.139386 5120 scope.go:117] "RemoveContainer" containerID="3ae202ea0f0a4566831c4712a39b08992086f44465f4ad6f31062d4721860630" Mar 16 16:52:46 crc kubenswrapper[5120]: I0316 16:52:46.188487 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Mar 16 16:52:46 crc kubenswrapper[5120]: I0316 16:52:46.197697 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/9f5ce683-1975-46fb-ab27-2e4888748b7b-vencrypt-tls-certs\") pod \"9f5ce683-1975-46fb-ab27-2e4888748b7b\" (UID: \"9f5ce683-1975-46fb-ab27-2e4888748b7b\") " Mar 16 16:52:46 crc kubenswrapper[5120]: I0316 16:52:46.197774 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c89f3439-256a-47de-9a4b-33f3a5231721-combined-ca-bundle\") pod \"c89f3439-256a-47de-9a4b-33f3a5231721\" (UID: \"c89f3439-256a-47de-9a4b-33f3a5231721\") " Mar 16 16:52:46 crc kubenswrapper[5120]: I0316 16:52:46.197865 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9f5ce683-1975-46fb-ab27-2e4888748b7b-config-data\") pod \"9f5ce683-1975-46fb-ab27-2e4888748b7b\" (UID: \"9f5ce683-1975-46fb-ab27-2e4888748b7b\") " Mar 16 16:52:46 crc kubenswrapper[5120]: I0316 16:52:46.197947 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/c89f3439-256a-47de-9a4b-33f3a5231721-openstack-config\") pod \"c89f3439-256a-47de-9a4b-33f3a5231721\" (UID: \"c89f3439-256a-47de-9a4b-33f3a5231721\") " Mar 16 16:52:46 crc kubenswrapper[5120]: I0316 16:52:46.198550 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cx8mt\" (UniqueName: \"kubernetes.io/projected/c89f3439-256a-47de-9a4b-33f3a5231721-kube-api-access-cx8mt\") pod \"c89f3439-256a-47de-9a4b-33f3a5231721\" (UID: \"c89f3439-256a-47de-9a4b-33f3a5231721\") " Mar 16 16:52:46 crc kubenswrapper[5120]: I0316 16:52:46.198626 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/c89f3439-256a-47de-9a4b-33f3a5231721-openstack-config-secret\") pod \"c89f3439-256a-47de-9a4b-33f3a5231721\" (UID: \"c89f3439-256a-47de-9a4b-33f3a5231721\") " Mar 16 16:52:46 crc kubenswrapper[5120]: I0316 16:52:46.198689 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hkrds\" (UniqueName: \"kubernetes.io/projected/9f5ce683-1975-46fb-ab27-2e4888748b7b-kube-api-access-hkrds\") pod \"9f5ce683-1975-46fb-ab27-2e4888748b7b\" (UID: \"9f5ce683-1975-46fb-ab27-2e4888748b7b\") " Mar 16 16:52:46 crc kubenswrapper[5120]: I0316 16:52:46.198711 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/9f5ce683-1975-46fb-ab27-2e4888748b7b-nova-novncproxy-tls-certs\") pod \"9f5ce683-1975-46fb-ab27-2e4888748b7b\" (UID: \"9f5ce683-1975-46fb-ab27-2e4888748b7b\") " Mar 16 16:52:46 crc kubenswrapper[5120]: I0316 16:52:46.198871 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9f5ce683-1975-46fb-ab27-2e4888748b7b-combined-ca-bundle\") pod \"9f5ce683-1975-46fb-ab27-2e4888748b7b\" (UID: \"9f5ce683-1975-46fb-ab27-2e4888748b7b\") " Mar 16 16:52:46 crc kubenswrapper[5120]: I0316 16:52:46.199162 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/72edd543-4bf8-407e-9929-47d4e9727134-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"72edd543-4bf8-407e-9929-47d4e9727134\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:52:46 crc kubenswrapper[5120]: I0316 16:52:46.199207 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/72edd543-4bf8-407e-9929-47d4e9727134-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"72edd543-4bf8-407e-9929-47d4e9727134\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:52:46 crc kubenswrapper[5120]: I0316 16:52:46.199801 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/72edd543-4bf8-407e-9929-47d4e9727134-config\") pod \"ovn-northd-0\" (UID: \"72edd543-4bf8-407e-9929-47d4e9727134\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:52:46 crc kubenswrapper[5120]: I0316 16:52:46.222563 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/72edd543-4bf8-407e-9929-47d4e9727134-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"72edd543-4bf8-407e-9929-47d4e9727134\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:52:46 crc kubenswrapper[5120]: I0316 16:52:46.225736 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2pfcp\" (UniqueName: \"kubernetes.io/projected/72edd543-4bf8-407e-9929-47d4e9727134-kube-api-access-2pfcp\") pod \"ovn-northd-0\" (UID: \"72edd543-4bf8-407e-9929-47d4e9727134\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:52:46 crc kubenswrapper[5120]: I0316 16:52:46.225809 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/72edd543-4bf8-407e-9929-47d4e9727134-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"72edd543-4bf8-407e-9929-47d4e9727134\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:52:46 crc kubenswrapper[5120]: I0316 16:52:46.225889 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/72edd543-4bf8-407e-9929-47d4e9727134-scripts\") pod \"ovn-northd-0\" (UID: \"72edd543-4bf8-407e-9929-47d4e9727134\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:52:46 crc kubenswrapper[5120]: I0316 16:52:46.268535 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c89f3439-256a-47de-9a4b-33f3a5231721-kube-api-access-cx8mt" (OuterVolumeSpecName: "kube-api-access-cx8mt") pod "c89f3439-256a-47de-9a4b-33f3a5231721" (UID: "c89f3439-256a-47de-9a4b-33f3a5231721"). InnerVolumeSpecName "kube-api-access-cx8mt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:52:46 crc kubenswrapper[5120]: I0316 16:52:46.329487 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/72edd543-4bf8-407e-9929-47d4e9727134-config\") pod \"ovn-northd-0\" (UID: \"72edd543-4bf8-407e-9929-47d4e9727134\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:52:46 crc kubenswrapper[5120]: I0316 16:52:46.329534 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/72edd543-4bf8-407e-9929-47d4e9727134-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"72edd543-4bf8-407e-9929-47d4e9727134\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:52:46 crc kubenswrapper[5120]: I0316 16:52:46.329610 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2pfcp\" (UniqueName: \"kubernetes.io/projected/72edd543-4bf8-407e-9929-47d4e9727134-kube-api-access-2pfcp\") pod \"ovn-northd-0\" (UID: \"72edd543-4bf8-407e-9929-47d4e9727134\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:52:46 crc kubenswrapper[5120]: I0316 16:52:46.329637 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/72edd543-4bf8-407e-9929-47d4e9727134-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"72edd543-4bf8-407e-9929-47d4e9727134\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:52:46 crc kubenswrapper[5120]: I0316 16:52:46.329678 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/72edd543-4bf8-407e-9929-47d4e9727134-scripts\") pod \"ovn-northd-0\" (UID: \"72edd543-4bf8-407e-9929-47d4e9727134\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:52:46 crc kubenswrapper[5120]: I0316 16:52:46.329834 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/72edd543-4bf8-407e-9929-47d4e9727134-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"72edd543-4bf8-407e-9929-47d4e9727134\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:52:46 crc kubenswrapper[5120]: I0316 16:52:46.329867 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/72edd543-4bf8-407e-9929-47d4e9727134-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"72edd543-4bf8-407e-9929-47d4e9727134\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:52:46 crc kubenswrapper[5120]: I0316 16:52:46.329966 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cx8mt\" (UniqueName: \"kubernetes.io/projected/c89f3439-256a-47de-9a4b-33f3a5231721-kube-api-access-cx8mt\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:46 crc kubenswrapper[5120]: I0316 16:52:46.332403 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/72edd543-4bf8-407e-9929-47d4e9727134-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"72edd543-4bf8-407e-9929-47d4e9727134\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:52:46 crc kubenswrapper[5120]: I0316 16:52:46.334057 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 16:52:46 crc kubenswrapper[5120]: I0316 16:52:46.334962 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/72edd543-4bf8-407e-9929-47d4e9727134-scripts\") pod \"ovn-northd-0\" (UID: \"72edd543-4bf8-407e-9929-47d4e9727134\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:52:46 crc kubenswrapper[5120]: I0316 16:52:46.339321 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/72edd543-4bf8-407e-9929-47d4e9727134-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"72edd543-4bf8-407e-9929-47d4e9727134\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:52:46 crc kubenswrapper[5120]: I0316 16:52:46.347625 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/72edd543-4bf8-407e-9929-47d4e9727134-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"72edd543-4bf8-407e-9929-47d4e9727134\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:52:46 crc kubenswrapper[5120]: I0316 16:52:46.348127 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/72edd543-4bf8-407e-9929-47d4e9727134-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"72edd543-4bf8-407e-9929-47d4e9727134\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:52:46 crc kubenswrapper[5120]: I0316 16:52:46.348493 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f5ce683-1975-46fb-ab27-2e4888748b7b-kube-api-access-hkrds" (OuterVolumeSpecName: "kube-api-access-hkrds") pod "9f5ce683-1975-46fb-ab27-2e4888748b7b" (UID: "9f5ce683-1975-46fb-ab27-2e4888748b7b"). InnerVolumeSpecName "kube-api-access-hkrds". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:52:46 crc kubenswrapper[5120]: I0316 16:52:46.350383 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/72edd543-4bf8-407e-9929-47d4e9727134-config\") pod \"ovn-northd-0\" (UID: \"72edd543-4bf8-407e-9929-47d4e9727134\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:52:46 crc kubenswrapper[5120]: I0316 16:52:46.350794 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c89f3439-256a-47de-9a4b-33f3a5231721-openstack-config" (OuterVolumeSpecName: "openstack-config") pod "c89f3439-256a-47de-9a4b-33f3a5231721" (UID: "c89f3439-256a-47de-9a4b-33f3a5231721"). InnerVolumeSpecName "openstack-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:52:46 crc kubenswrapper[5120]: I0316 16:52:46.420813 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-646d48c554-kk5ms"] Mar 16 16:52:46 crc kubenswrapper[5120]: I0316 16:52:46.438283 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-5964c9d8c-plh78"] Mar 16 16:52:46 crc kubenswrapper[5120]: I0316 16:52:46.440300 5120 reconciler_common.go:299] "Volume detached for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/c89f3439-256a-47de-9a4b-33f3a5231721-openstack-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:46 crc kubenswrapper[5120]: I0316 16:52:46.440326 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hkrds\" (UniqueName: \"kubernetes.io/projected/9f5ce683-1975-46fb-ab27-2e4888748b7b-kube-api-access-hkrds\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:46 crc kubenswrapper[5120]: I0316 16:52:46.462928 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f5ce683-1975-46fb-ab27-2e4888748b7b-config-data" (OuterVolumeSpecName: "config-data") pod "9f5ce683-1975-46fb-ab27-2e4888748b7b" (UID: "9f5ce683-1975-46fb-ab27-2e4888748b7b"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:52:46 crc kubenswrapper[5120]: I0316 16:52:46.463790 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pfcp\" (UniqueName: \"kubernetes.io/projected/72edd543-4bf8-407e-9929-47d4e9727134-kube-api-access-2pfcp\") pod \"ovn-northd-0\" (UID: \"72edd543-4bf8-407e-9929-47d4e9727134\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:52:46 crc kubenswrapper[5120]: I0316 16:52:46.485132 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c89f3439-256a-47de-9a4b-33f3a5231721-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "c89f3439-256a-47de-9a4b-33f3a5231721" (UID: "c89f3439-256a-47de-9a4b-33f3a5231721"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:52:46 crc kubenswrapper[5120]: I0316 16:52:46.485153 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-786c646546-49lhr"] Mar 16 16:52:46 crc kubenswrapper[5120]: I0316 16:52:46.499030 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c89f3439-256a-47de-9a4b-33f3a5231721-openstack-config-secret" (OuterVolumeSpecName: "openstack-config-secret") pod "c89f3439-256a-47de-9a4b-33f3a5231721" (UID: "c89f3439-256a-47de-9a4b-33f3a5231721"). InnerVolumeSpecName "openstack-config-secret". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:52:46 crc kubenswrapper[5120]: I0316 16:52:46.505043 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f5ce683-1975-46fb-ab27-2e4888748b7b-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "9f5ce683-1975-46fb-ab27-2e4888748b7b" (UID: "9f5ce683-1975-46fb-ab27-2e4888748b7b"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:52:46 crc kubenswrapper[5120]: I0316 16:52:46.517246 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-786c646546-49lhr" Mar 16 16:52:46 crc kubenswrapper[5120]: I0316 16:52:46.554482 5120 reconciler_common.go:299] "Volume detached for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/c89f3439-256a-47de-9a4b-33f3a5231721-openstack-config-secret\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:46 crc kubenswrapper[5120]: I0316 16:52:46.554512 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9f5ce683-1975-46fb-ab27-2e4888748b7b-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:46 crc kubenswrapper[5120]: I0316 16:52:46.554521 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c89f3439-256a-47de-9a4b-33f3a5231721-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:46 crc kubenswrapper[5120]: I0316 16:52:46.554530 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9f5ce683-1975-46fb-ab27-2e4888748b7b-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:46 crc kubenswrapper[5120]: I0316 16:52:46.561118 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-786c646546-49lhr"] Mar 16 16:52:46 crc kubenswrapper[5120]: I0316 16:52:46.570264 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f5ce683-1975-46fb-ab27-2e4888748b7b-nova-novncproxy-tls-certs" (OuterVolumeSpecName: "nova-novncproxy-tls-certs") pod "9f5ce683-1975-46fb-ab27-2e4888748b7b" (UID: "9f5ce683-1975-46fb-ab27-2e4888748b7b"). InnerVolumeSpecName "nova-novncproxy-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:52:46 crc kubenswrapper[5120]: I0316 16:52:46.607419 5120 scope.go:117] "RemoveContainer" containerID="85e0a2833bfbae668b16b016594cba1808c5730c52cef8b62d6c1961bf38adf3" Mar 16 16:52:46 crc kubenswrapper[5120]: I0316 16:52:46.621324 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f5ce683-1975-46fb-ab27-2e4888748b7b-vencrypt-tls-certs" (OuterVolumeSpecName: "vencrypt-tls-certs") pod "9f5ce683-1975-46fb-ab27-2e4888748b7b" (UID: "9f5ce683-1975-46fb-ab27-2e4888748b7b"). InnerVolumeSpecName "vencrypt-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:52:46 crc kubenswrapper[5120]: I0316 16:52:46.658192 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a7564ece-3e31-426b-a07b-1b9e12d76d01-config-data\") pod \"barbican-keystone-listener-786c646546-49lhr\" (UID: \"a7564ece-3e31-426b-a07b-1b9e12d76d01\") " pod="openstack-kuttl-tests/barbican-keystone-listener-786c646546-49lhr" Mar 16 16:52:46 crc kubenswrapper[5120]: I0316 16:52:46.658811 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/a7564ece-3e31-426b-a07b-1b9e12d76d01-config-data-custom\") pod \"barbican-keystone-listener-786c646546-49lhr\" (UID: \"a7564ece-3e31-426b-a07b-1b9e12d76d01\") " pod="openstack-kuttl-tests/barbican-keystone-listener-786c646546-49lhr" Mar 16 16:52:46 crc kubenswrapper[5120]: I0316 16:52:46.658881 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a7564ece-3e31-426b-a07b-1b9e12d76d01-logs\") pod \"barbican-keystone-listener-786c646546-49lhr\" (UID: \"a7564ece-3e31-426b-a07b-1b9e12d76d01\") " pod="openstack-kuttl-tests/barbican-keystone-listener-786c646546-49lhr" Mar 16 16:52:46 crc kubenswrapper[5120]: I0316 16:52:46.658969 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxdkl\" (UniqueName: \"kubernetes.io/projected/a7564ece-3e31-426b-a07b-1b9e12d76d01-kube-api-access-vxdkl\") pod \"barbican-keystone-listener-786c646546-49lhr\" (UID: \"a7564ece-3e31-426b-a07b-1b9e12d76d01\") " pod="openstack-kuttl-tests/barbican-keystone-listener-786c646546-49lhr" Mar 16 16:52:46 crc kubenswrapper[5120]: I0316 16:52:46.659102 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a7564ece-3e31-426b-a07b-1b9e12d76d01-combined-ca-bundle\") pod \"barbican-keystone-listener-786c646546-49lhr\" (UID: \"a7564ece-3e31-426b-a07b-1b9e12d76d01\") " pod="openstack-kuttl-tests/barbican-keystone-listener-786c646546-49lhr" Mar 16 16:52:46 crc kubenswrapper[5120]: I0316 16:52:46.659331 5120 reconciler_common.go:299] "Volume detached for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/9f5ce683-1975-46fb-ab27-2e4888748b7b-vencrypt-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:46 crc kubenswrapper[5120]: I0316 16:52:46.659349 5120 reconciler_common.go:299] "Volume detached for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/9f5ce683-1975-46fb-ab27-2e4888748b7b-nova-novncproxy-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:46 crc kubenswrapper[5120]: I0316 16:52:46.716213 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:52:46 crc kubenswrapper[5120]: I0316 16:52:46.727171 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="243f6b1f-595b-44eb-aaa5-0b3df41c88c1" path="/var/lib/kubelet/pods/243f6b1f-595b-44eb-aaa5-0b3df41c88c1/volumes" Mar 16 16:52:46 crc kubenswrapper[5120]: I0316 16:52:46.730061 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="46fdeab7-fc69-4767-85fb-6fe77323a249" path="/var/lib/kubelet/pods/46fdeab7-fc69-4767-85fb-6fe77323a249/volumes" Mar 16 16:52:46 crc kubenswrapper[5120]: I0316 16:52:46.734011 5120 scope.go:117] "RemoveContainer" containerID="772d7d749c19d303ab351e9da9794092ed431692caf8ea6741351516c112156b" Mar 16 16:52:46 crc kubenswrapper[5120]: I0316 16:52:46.740218 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c89f3439-256a-47de-9a4b-33f3a5231721" path="/var/lib/kubelet/pods/c89f3439-256a-47de-9a4b-33f3a5231721/volumes" Mar 16 16:52:46 crc kubenswrapper[5120]: I0316 16:52:46.806905 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-worker-5f687f46f5-qdrk5"] Mar 16 16:52:46 crc kubenswrapper[5120]: I0316 16:52:46.841371 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-5f687f46f5-qdrk5" Mar 16 16:52:46 crc kubenswrapper[5120]: I0316 16:52:46.855643 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a7564ece-3e31-426b-a07b-1b9e12d76d01-combined-ca-bundle\") pod \"barbican-keystone-listener-786c646546-49lhr\" (UID: \"a7564ece-3e31-426b-a07b-1b9e12d76d01\") " pod="openstack-kuttl-tests/barbican-keystone-listener-786c646546-49lhr" Mar 16 16:52:46 crc kubenswrapper[5120]: I0316 16:52:46.855903 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a7564ece-3e31-426b-a07b-1b9e12d76d01-config-data\") pod \"barbican-keystone-listener-786c646546-49lhr\" (UID: \"a7564ece-3e31-426b-a07b-1b9e12d76d01\") " pod="openstack-kuttl-tests/barbican-keystone-listener-786c646546-49lhr" Mar 16 16:52:46 crc kubenswrapper[5120]: I0316 16:52:46.856538 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/a7564ece-3e31-426b-a07b-1b9e12d76d01-config-data-custom\") pod \"barbican-keystone-listener-786c646546-49lhr\" (UID: \"a7564ece-3e31-426b-a07b-1b9e12d76d01\") " pod="openstack-kuttl-tests/barbican-keystone-listener-786c646546-49lhr" Mar 16 16:52:46 crc kubenswrapper[5120]: I0316 16:52:46.856626 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a7564ece-3e31-426b-a07b-1b9e12d76d01-logs\") pod \"barbican-keystone-listener-786c646546-49lhr\" (UID: \"a7564ece-3e31-426b-a07b-1b9e12d76d01\") " pod="openstack-kuttl-tests/barbican-keystone-listener-786c646546-49lhr" Mar 16 16:52:46 crc kubenswrapper[5120]: I0316 16:52:46.856731 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vxdkl\" (UniqueName: \"kubernetes.io/projected/a7564ece-3e31-426b-a07b-1b9e12d76d01-kube-api-access-vxdkl\") pod \"barbican-keystone-listener-786c646546-49lhr\" (UID: \"a7564ece-3e31-426b-a07b-1b9e12d76d01\") " pod="openstack-kuttl-tests/barbican-keystone-listener-786c646546-49lhr" Mar 16 16:52:46 crc kubenswrapper[5120]: I0316 16:52:46.861373 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a7564ece-3e31-426b-a07b-1b9e12d76d01-logs\") pod \"barbican-keystone-listener-786c646546-49lhr\" (UID: \"a7564ece-3e31-426b-a07b-1b9e12d76d01\") " pod="openstack-kuttl-tests/barbican-keystone-listener-786c646546-49lhr" Mar 16 16:52:46 crc kubenswrapper[5120]: I0316 16:52:46.912265 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:52:46 crc kubenswrapper[5120]: I0316 16:52:46.938839 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-5f687f46f5-qdrk5"] Mar 16 16:52:46 crc kubenswrapper[5120]: I0316 16:52:46.962577 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c186765a-7323-4f11-ac91-6c1ab1f2ac4f-scripts\") pod \"c186765a-7323-4f11-ac91-6c1ab1f2ac4f\" (UID: \"c186765a-7323-4f11-ac91-6c1ab1f2ac4f\") " Mar 16 16:52:46 crc kubenswrapper[5120]: I0316 16:52:46.962699 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ljnd7\" (UniqueName: \"kubernetes.io/projected/c186765a-7323-4f11-ac91-6c1ab1f2ac4f-kube-api-access-ljnd7\") pod \"c186765a-7323-4f11-ac91-6c1ab1f2ac4f\" (UID: \"c186765a-7323-4f11-ac91-6c1ab1f2ac4f\") " Mar 16 16:52:46 crc kubenswrapper[5120]: I0316 16:52:46.963418 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/c186765a-7323-4f11-ac91-6c1ab1f2ac4f-config-data-custom\") pod \"c186765a-7323-4f11-ac91-6c1ab1f2ac4f\" (UID: \"c186765a-7323-4f11-ac91-6c1ab1f2ac4f\") " Mar 16 16:52:46 crc kubenswrapper[5120]: I0316 16:52:46.963583 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/c186765a-7323-4f11-ac91-6c1ab1f2ac4f-etc-machine-id\") pod \"c186765a-7323-4f11-ac91-6c1ab1f2ac4f\" (UID: \"c186765a-7323-4f11-ac91-6c1ab1f2ac4f\") " Mar 16 16:52:46 crc kubenswrapper[5120]: I0316 16:52:46.963606 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c186765a-7323-4f11-ac91-6c1ab1f2ac4f-config-data\") pod \"c186765a-7323-4f11-ac91-6c1ab1f2ac4f\" (UID: \"c186765a-7323-4f11-ac91-6c1ab1f2ac4f\") " Mar 16 16:52:46 crc kubenswrapper[5120]: I0316 16:52:46.963637 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c186765a-7323-4f11-ac91-6c1ab1f2ac4f-combined-ca-bundle\") pod \"c186765a-7323-4f11-ac91-6c1ab1f2ac4f\" (UID: \"c186765a-7323-4f11-ac91-6c1ab1f2ac4f\") " Mar 16 16:52:46 crc kubenswrapper[5120]: I0316 16:52:46.963974 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a5396fe3-454e-4707-b185-5ad652c091da-logs\") pod \"barbican-worker-5f687f46f5-qdrk5\" (UID: \"a5396fe3-454e-4707-b185-5ad652c091da\") " pod="openstack-kuttl-tests/barbican-worker-5f687f46f5-qdrk5" Mar 16 16:52:46 crc kubenswrapper[5120]: I0316 16:52:46.963994 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a5396fe3-454e-4707-b185-5ad652c091da-combined-ca-bundle\") pod \"barbican-worker-5f687f46f5-qdrk5\" (UID: \"a5396fe3-454e-4707-b185-5ad652c091da\") " pod="openstack-kuttl-tests/barbican-worker-5f687f46f5-qdrk5" Mar 16 16:52:46 crc kubenswrapper[5120]: I0316 16:52:46.964077 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a5396fe3-454e-4707-b185-5ad652c091da-config-data\") pod \"barbican-worker-5f687f46f5-qdrk5\" (UID: \"a5396fe3-454e-4707-b185-5ad652c091da\") " pod="openstack-kuttl-tests/barbican-worker-5f687f46f5-qdrk5" Mar 16 16:52:46 crc kubenswrapper[5120]: I0316 16:52:46.964132 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/a5396fe3-454e-4707-b185-5ad652c091da-config-data-custom\") pod \"barbican-worker-5f687f46f5-qdrk5\" (UID: \"a5396fe3-454e-4707-b185-5ad652c091da\") " pod="openstack-kuttl-tests/barbican-worker-5f687f46f5-qdrk5" Mar 16 16:52:46 crc kubenswrapper[5120]: I0316 16:52:46.964231 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2kpz\" (UniqueName: \"kubernetes.io/projected/a5396fe3-454e-4707-b185-5ad652c091da-kube-api-access-w2kpz\") pod \"barbican-worker-5f687f46f5-qdrk5\" (UID: \"a5396fe3-454e-4707-b185-5ad652c091da\") " pod="openstack-kuttl-tests/barbican-worker-5f687f46f5-qdrk5" Mar 16 16:52:46 crc kubenswrapper[5120]: I0316 16:52:46.967354 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/c186765a-7323-4f11-ac91-6c1ab1f2ac4f-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "c186765a-7323-4f11-ac91-6c1ab1f2ac4f" (UID: "c186765a-7323-4f11-ac91-6c1ab1f2ac4f"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.026050 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-7bf49bf568-fbg2k"] Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.037035 5120 scope.go:117] "RemoveContainer" containerID="a1cd73640c37a42fa6ebe4301abe6341be42e951fc430d48f97879efaf1fc878" Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.066076 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c186765a-7323-4f11-ac91-6c1ab1f2ac4f-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "c186765a-7323-4f11-ac91-6c1ab1f2ac4f" (UID: "c186765a-7323-4f11-ac91-6c1ab1f2ac4f"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.067675 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/a5396fe3-454e-4707-b185-5ad652c091da-config-data-custom\") pod \"barbican-worker-5f687f46f5-qdrk5\" (UID: \"a5396fe3-454e-4707-b185-5ad652c091da\") " pod="openstack-kuttl-tests/barbican-worker-5f687f46f5-qdrk5" Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.067872 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w2kpz\" (UniqueName: \"kubernetes.io/projected/a5396fe3-454e-4707-b185-5ad652c091da-kube-api-access-w2kpz\") pod \"barbican-worker-5f687f46f5-qdrk5\" (UID: \"a5396fe3-454e-4707-b185-5ad652c091da\") " pod="openstack-kuttl-tests/barbican-worker-5f687f46f5-qdrk5" Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.068246 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a5396fe3-454e-4707-b185-5ad652c091da-logs\") pod \"barbican-worker-5f687f46f5-qdrk5\" (UID: \"a5396fe3-454e-4707-b185-5ad652c091da\") " pod="openstack-kuttl-tests/barbican-worker-5f687f46f5-qdrk5" Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.068277 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a5396fe3-454e-4707-b185-5ad652c091da-combined-ca-bundle\") pod \"barbican-worker-5f687f46f5-qdrk5\" (UID: \"a5396fe3-454e-4707-b185-5ad652c091da\") " pod="openstack-kuttl-tests/barbican-worker-5f687f46f5-qdrk5" Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.068405 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a5396fe3-454e-4707-b185-5ad652c091da-config-data\") pod \"barbican-worker-5f687f46f5-qdrk5\" (UID: \"a5396fe3-454e-4707-b185-5ad652c091da\") " pod="openstack-kuttl-tests/barbican-worker-5f687f46f5-qdrk5" Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.068472 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/c186765a-7323-4f11-ac91-6c1ab1f2ac4f-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.068486 5120 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/c186765a-7323-4f11-ac91-6c1ab1f2ac4f-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.075187 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a5396fe3-454e-4707-b185-5ad652c091da-logs\") pod \"barbican-worker-5f687f46f5-qdrk5\" (UID: \"a5396fe3-454e-4707-b185-5ad652c091da\") " pod="openstack-kuttl-tests/barbican-worker-5f687f46f5-qdrk5" Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.171663 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c186765a-7323-4f11-ac91-6c1ab1f2ac4f-kube-api-access-ljnd7" (OuterVolumeSpecName: "kube-api-access-ljnd7") pod "c186765a-7323-4f11-ac91-6c1ab1f2ac4f" (UID: "c186765a-7323-4f11-ac91-6c1ab1f2ac4f"). InnerVolumeSpecName "kube-api-access-ljnd7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.176014 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ljnd7\" (UniqueName: \"kubernetes.io/projected/c186765a-7323-4f11-ac91-6c1ab1f2ac4f-kube-api-access-ljnd7\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.213670 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a7564ece-3e31-426b-a07b-1b9e12d76d01-combined-ca-bundle\") pod \"barbican-keystone-listener-786c646546-49lhr\" (UID: \"a7564ece-3e31-426b-a07b-1b9e12d76d01\") " pod="openstack-kuttl-tests/barbican-keystone-listener-786c646546-49lhr" Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.214077 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"9f5ce683-1975-46fb-ab27-2e4888748b7b","Type":"ContainerDied","Data":"a172cebe85d9a2fe2276e6e7db49eaad80a4af379fb448d63913ff1dfc716a47"} Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.214198 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.227367 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.273648 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c186765a-7323-4f11-ac91-6c1ab1f2ac4f-scripts" (OuterVolumeSpecName: "scripts") pod "c186765a-7323-4f11-ac91-6c1ab1f2ac4f" (UID: "c186765a-7323-4f11-ac91-6c1ab1f2ac4f"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:52:47 crc kubenswrapper[5120]: E0316 16:52:47.274613 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="ba4af8aa3c89740443bcafa47b272ccb7a4f3b2222974c478de29e30c4166272" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.274922 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.276348 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a7564ece-3e31-426b-a07b-1b9e12d76d01-config-data\") pod \"barbican-keystone-listener-786c646546-49lhr\" (UID: \"a7564ece-3e31-426b-a07b-1b9e12d76d01\") " pod="openstack-kuttl-tests/barbican-keystone-listener-786c646546-49lhr" Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.280888 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/a7564ece-3e31-426b-a07b-1b9e12d76d01-config-data-custom\") pod \"barbican-keystone-listener-786c646546-49lhr\" (UID: \"a7564ece-3e31-426b-a07b-1b9e12d76d01\") " pod="openstack-kuttl-tests/barbican-keystone-listener-786c646546-49lhr" Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.302573 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxdkl\" (UniqueName: \"kubernetes.io/projected/a7564ece-3e31-426b-a07b-1b9e12d76d01-kube-api-access-vxdkl\") pod \"barbican-keystone-listener-786c646546-49lhr\" (UID: \"a7564ece-3e31-426b-a07b-1b9e12d76d01\") " pod="openstack-kuttl-tests/barbican-keystone-listener-786c646546-49lhr" Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.304354 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a5396fe3-454e-4707-b185-5ad652c091da-config-data\") pod \"barbican-worker-5f687f46f5-qdrk5\" (UID: \"a5396fe3-454e-4707-b185-5ad652c091da\") " pod="openstack-kuttl-tests/barbican-worker-5f687f46f5-qdrk5" Mar 16 16:52:47 crc kubenswrapper[5120]: E0316 16:52:47.304470 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="ba4af8aa3c89740443bcafa47b272ccb7a4f3b2222974c478de29e30c4166272" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.321080 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2kpz\" (UniqueName: \"kubernetes.io/projected/a5396fe3-454e-4707-b185-5ad652c091da-kube-api-access-w2kpz\") pod \"barbican-worker-5f687f46f5-qdrk5\" (UID: \"a5396fe3-454e-4707-b185-5ad652c091da\") " pod="openstack-kuttl-tests/barbican-worker-5f687f46f5-qdrk5" Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.321901 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"c186765a-7323-4f11-ac91-6c1ab1f2ac4f","Type":"ContainerDied","Data":"7c0a8ceaa4d969753cf61aabd1c8ae72d0f1b9c3d478a1085343a325feb08631"} Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.322008 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.328056 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a5396fe3-454e-4707-b185-5ad652c091da-combined-ca-bundle\") pod \"barbican-worker-5f687f46f5-qdrk5\" (UID: \"a5396fe3-454e-4707-b185-5ad652c091da\") " pod="openstack-kuttl-tests/barbican-worker-5f687f46f5-qdrk5" Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.328816 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/a5396fe3-454e-4707-b185-5ad652c091da-config-data-custom\") pod \"barbican-worker-5f687f46f5-qdrk5\" (UID: \"a5396fe3-454e-4707-b185-5ad652c091da\") " pod="openstack-kuttl-tests/barbican-worker-5f687f46f5-qdrk5" Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.331804 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-d99589cd-7z8cg"] Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.340654 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c186765a-7323-4f11-ac91-6c1ab1f2ac4f-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:47 crc kubenswrapper[5120]: E0316 16:52:47.341601 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="ba4af8aa3c89740443bcafa47b272ccb7a4f3b2222974c478de29e30c4166272" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:52:47 crc kubenswrapper[5120]: E0316 16:52:47.343498 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="adaee0e3-17f6-4f23-97c4-00bd5f6a8d6c" containerName="nova-cell1-conductor-conductor" probeResult="unknown" Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.374032 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.376234 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c186765a-7323-4f11-ac91-6c1ab1f2ac4f" containerName="probe" Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.377205 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c186765a-7323-4f11-ac91-6c1ab1f2ac4f" containerName="probe" Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.377319 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c186765a-7323-4f11-ac91-6c1ab1f2ac4f" containerName="cinder-scheduler" Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.377381 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c186765a-7323-4f11-ac91-6c1ab1f2ac4f" containerName="cinder-scheduler" Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.380493 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c186765a-7323-4f11-ac91-6c1ab1f2ac4f" containerName="probe" Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.380891 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c186765a-7323-4f11-ac91-6c1ab1f2ac4f" containerName="cinder-scheduler" Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.435085 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-api-7f78b864cb-6dgjh"] Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.472004 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.478683 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ovncluster-ovndbcluster-sb-dockercfg-w4q4s\"" Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.479075 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovndbcluster-sb-config\"" Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.479312 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ovndbcluster-sb-ovndbs\"" Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.479647 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovndbcluster-sb-scripts\"" Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.516866 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-786c646546-49lhr" Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.530370 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.540180 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c186765a-7323-4f11-ac91-6c1ab1f2ac4f-config-data" (OuterVolumeSpecName: "config-data") pod "c186765a-7323-4f11-ac91-6c1ab1f2ac4f" (UID: "c186765a-7323-4f11-ac91-6c1ab1f2ac4f"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.543688 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/cinder-api-0" podUID="2627e341-ad91-4de8-96da-e58d58d40fb9" containerName="cinder-api" probeResult="failure" output="Get \"https://10.217.0.19:8776/healthcheck\": read tcp 10.217.0.2:55400->10.217.0.19:8776: read: connection reset by peer" Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.554857 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-5964c9d8c-plh78" event={"ID":"d6db354d-c48c-4497-a289-18edadffce47","Type":"ContainerStarted","Data":"97576e939ebce6bd9c9a57e020240747714a03086d075e2f102f522a8e9ab0ec"} Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.555847 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.555867 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstackclient" event={"ID":"74ab0944-2f5c-4a9d-a848-8e2a8d17d9cd","Type":"ContainerStarted","Data":"d0a301afc63d220a7463bc2a86a27cf70d1dec59cb76e7172773090e62c92b55"} Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.555887 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-d99589cd-7z8cg"] Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.556342 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-7f78b864cb-6dgjh" Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.580457 5120 generic.go:358] "Generic (PLEG): container finished" podID="359ce032-c698-43d8-a7eb-011091fe9a3d" containerID="a5caf3e8fdf3dd93a4bfbfe575eaae670bb5bbd6689dcc4b186bc986e9be8a55" exitCode=0 Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.580808 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"359ce032-c698-43d8-a7eb-011091fe9a3d","Type":"ContainerDied","Data":"a5caf3e8fdf3dd93a4bfbfe575eaae670bb5bbd6689dcc4b186bc986e9be8a55"} Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.609076 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c186765a-7323-4f11-ac91-6c1ab1f2ac4f-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "c186765a-7323-4f11-ac91-6c1ab1f2ac4f" (UID: "c186765a-7323-4f11-ac91-6c1ab1f2ac4f"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.628192 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-7f78b864cb-6dgjh"] Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.642113 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/18684823-3972-4cf6-8e42-792360b387bb-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"18684823-3972-4cf6-8e42-792360b387bb\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.642200 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/18684823-3972-4cf6-8e42-792360b387bb-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"18684823-3972-4cf6-8e42-792360b387bb\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.642264 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/18684823-3972-4cf6-8e42-792360b387bb-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"18684823-3972-4cf6-8e42-792360b387bb\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.642330 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/18684823-3972-4cf6-8e42-792360b387bb-config\") pod \"ovsdbserver-sb-0\" (UID: \"18684823-3972-4cf6-8e42-792360b387bb\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.642603 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"ovsdbserver-sb-0\" (UID: \"18684823-3972-4cf6-8e42-792360b387bb\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.642861 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/18684823-3972-4cf6-8e42-792360b387bb-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"18684823-3972-4cf6-8e42-792360b387bb\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.642908 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/18684823-3972-4cf6-8e42-792360b387bb-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"18684823-3972-4cf6-8e42-792360b387bb\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.642977 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rgzz7\" (UniqueName: \"kubernetes.io/projected/18684823-3972-4cf6-8e42-792360b387bb-kube-api-access-rgzz7\") pod \"ovsdbserver-sb-0\" (UID: \"18684823-3972-4cf6-8e42-792360b387bb\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.644988 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-646d48c554-kk5ms" event={"ID":"fa4601ff-7ef6-4d2c-b0ca-b153763db12f","Type":"ContainerStarted","Data":"063de06c3cb529ad295ecfbc11d77cf09a22b566c6f152893e823def46ef38f4"} Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.645046 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c186765a-7323-4f11-ac91-6c1ab1f2ac4f-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.645140 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c186765a-7323-4f11-ac91-6c1ab1f2ac4f-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.645387 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-5f687f46f5-qdrk5" Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.658408 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-69d57497c4-7bhm5"] Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.709516 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-69d57497c4-7bhm5"] Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.709574 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-57f7845c4b-tb6nd"] Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.710130 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-69d57497c4-7bhm5" Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.739222 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.747487 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/18684823-3972-4cf6-8e42-792360b387bb-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"18684823-3972-4cf6-8e42-792360b387bb\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.747577 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/18684823-3972-4cf6-8e42-792360b387bb-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"18684823-3972-4cf6-8e42-792360b387bb\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.747679 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/18684823-3972-4cf6-8e42-792360b387bb-config\") pod \"ovsdbserver-sb-0\" (UID: \"18684823-3972-4cf6-8e42-792360b387bb\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.747749 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c06f24f9-95b0-4a92-ad3a-6075764151ed-combined-ca-bundle\") pod \"barbican-api-7f78b864cb-6dgjh\" (UID: \"c06f24f9-95b0-4a92-ad3a-6075764151ed\") " pod="openstack-kuttl-tests/barbican-api-7f78b864cb-6dgjh" Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.748468 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"ovsdbserver-sb-0\" (UID: \"18684823-3972-4cf6-8e42-792360b387bb\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.748594 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c06f24f9-95b0-4a92-ad3a-6075764151ed-config-data\") pod \"barbican-api-7f78b864cb-6dgjh\" (UID: \"c06f24f9-95b0-4a92-ad3a-6075764151ed\") " pod="openstack-kuttl-tests/barbican-api-7f78b864cb-6dgjh" Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.748753 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/18684823-3972-4cf6-8e42-792360b387bb-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"18684823-3972-4cf6-8e42-792360b387bb\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.748800 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/18684823-3972-4cf6-8e42-792360b387bb-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"18684823-3972-4cf6-8e42-792360b387bb\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.748845 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/c06f24f9-95b0-4a92-ad3a-6075764151ed-config-data-custom\") pod \"barbican-api-7f78b864cb-6dgjh\" (UID: \"c06f24f9-95b0-4a92-ad3a-6075764151ed\") " pod="openstack-kuttl-tests/barbican-api-7f78b864cb-6dgjh" Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.748875 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rgzz7\" (UniqueName: \"kubernetes.io/projected/18684823-3972-4cf6-8e42-792360b387bb-kube-api-access-rgzz7\") pod \"ovsdbserver-sb-0\" (UID: \"18684823-3972-4cf6-8e42-792360b387bb\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.748916 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/c06f24f9-95b0-4a92-ad3a-6075764151ed-public-tls-certs\") pod \"barbican-api-7f78b864cb-6dgjh\" (UID: \"c06f24f9-95b0-4a92-ad3a-6075764151ed\") " pod="openstack-kuttl-tests/barbican-api-7f78b864cb-6dgjh" Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.748950 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/c06f24f9-95b0-4a92-ad3a-6075764151ed-internal-tls-certs\") pod \"barbican-api-7f78b864cb-6dgjh\" (UID: \"c06f24f9-95b0-4a92-ad3a-6075764151ed\") " pod="openstack-kuttl-tests/barbican-api-7f78b864cb-6dgjh" Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.748970 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7dr8\" (UniqueName: \"kubernetes.io/projected/c06f24f9-95b0-4a92-ad3a-6075764151ed-kube-api-access-c7dr8\") pod \"barbican-api-7f78b864cb-6dgjh\" (UID: \"c06f24f9-95b0-4a92-ad3a-6075764151ed\") " pod="openstack-kuttl-tests/barbican-api-7f78b864cb-6dgjh" Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.748997 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c06f24f9-95b0-4a92-ad3a-6075764151ed-logs\") pod \"barbican-api-7f78b864cb-6dgjh\" (UID: \"c06f24f9-95b0-4a92-ad3a-6075764151ed\") " pod="openstack-kuttl-tests/barbican-api-7f78b864cb-6dgjh" Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.749034 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/18684823-3972-4cf6-8e42-792360b387bb-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"18684823-3972-4cf6-8e42-792360b387bb\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.749246 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/18684823-3972-4cf6-8e42-792360b387bb-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"18684823-3972-4cf6-8e42-792360b387bb\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.749471 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"ovsdbserver-sb-0\" (UID: \"18684823-3972-4cf6-8e42-792360b387bb\") device mount path \"/mnt/openstack/pv06\"" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.749963 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/18684823-3972-4cf6-8e42-792360b387bb-config\") pod \"ovsdbserver-sb-0\" (UID: \"18684823-3972-4cf6-8e42-792360b387bb\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.751695 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/18684823-3972-4cf6-8e42-792360b387bb-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"18684823-3972-4cf6-8e42-792360b387bb\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.768247 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/18684823-3972-4cf6-8e42-792360b387bb-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"18684823-3972-4cf6-8e42-792360b387bb\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.769470 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/18684823-3972-4cf6-8e42-792360b387bb-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"18684823-3972-4cf6-8e42-792360b387bb\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:52:47 crc kubenswrapper[5120]: E0316 16:52:47.769938 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="35987799f969f71c82b912431ea13f98b634d539c89a2bd6ce077420efb8f161" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.772313 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/18684823-3972-4cf6-8e42-792360b387bb-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"18684823-3972-4cf6-8e42-792360b387bb\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:52:47 crc kubenswrapper[5120]: E0316 16:52:47.776942 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="35987799f969f71c82b912431ea13f98b634d539c89a2bd6ce077420efb8f161" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.777117 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.780599 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"ovsdbserver-sb-0\" (UID: \"18684823-3972-4cf6-8e42-792360b387bb\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:52:47 crc kubenswrapper[5120]: E0316 16:52:47.783053 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="35987799f969f71c82b912431ea13f98b634d539c89a2bd6ce077420efb8f161" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:52:47 crc kubenswrapper[5120]: E0316 16:52:47.783183 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="37c6de80-ff10-4d44-a806-b8ad82e62d82" containerName="nova-scheduler-scheduler" probeResult="unknown" Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.784127 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rgzz7\" (UniqueName: \"kubernetes.io/projected/18684823-3972-4cf6-8e42-792360b387bb-kube-api-access-rgzz7\") pod \"ovsdbserver-sb-0\" (UID: \"18684823-3972-4cf6-8e42-792360b387bb\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.792335 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.811873 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.812004 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.815224 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ovncluster-ovndbcluster-nb-dockercfg-6n6ct\"" Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.815575 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovndbcluster-nb-config\"" Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.819430 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-d7c95f898-g5nln"] Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.825992 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ovndbcluster-nb-ovndbs\"" Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.826565 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovndbcluster-nb-scripts\"" Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.853252 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c06f24f9-95b0-4a92-ad3a-6075764151ed-config-data\") pod \"barbican-api-7f78b864cb-6dgjh\" (UID: \"c06f24f9-95b0-4a92-ad3a-6075764151ed\") " pod="openstack-kuttl-tests/barbican-api-7f78b864cb-6dgjh" Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.855538 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f9a4fc77-147c-46f7-a4de-e36f3086b09b-scripts\") pod \"placement-69d57497c4-7bhm5\" (UID: \"f9a4fc77-147c-46f7-a4de-e36f3086b09b\") " pod="openstack-kuttl-tests/placement-69d57497c4-7bhm5" Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.857000 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f9a4fc77-147c-46f7-a4de-e36f3086b09b-public-tls-certs\") pod \"placement-69d57497c4-7bhm5\" (UID: \"f9a4fc77-147c-46f7-a4de-e36f3086b09b\") " pod="openstack-kuttl-tests/placement-69d57497c4-7bhm5" Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.857167 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/c06f24f9-95b0-4a92-ad3a-6075764151ed-config-data-custom\") pod \"barbican-api-7f78b864cb-6dgjh\" (UID: \"c06f24f9-95b0-4a92-ad3a-6075764151ed\") " pod="openstack-kuttl-tests/barbican-api-7f78b864cb-6dgjh" Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.857333 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/c06f24f9-95b0-4a92-ad3a-6075764151ed-public-tls-certs\") pod \"barbican-api-7f78b864cb-6dgjh\" (UID: \"c06f24f9-95b0-4a92-ad3a-6075764151ed\") " pod="openstack-kuttl-tests/barbican-api-7f78b864cb-6dgjh" Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.857457 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/c06f24f9-95b0-4a92-ad3a-6075764151ed-internal-tls-certs\") pod \"barbican-api-7f78b864cb-6dgjh\" (UID: \"c06f24f9-95b0-4a92-ad3a-6075764151ed\") " pod="openstack-kuttl-tests/barbican-api-7f78b864cb-6dgjh" Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.857626 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c7dr8\" (UniqueName: \"kubernetes.io/projected/c06f24f9-95b0-4a92-ad3a-6075764151ed-kube-api-access-c7dr8\") pod \"barbican-api-7f78b864cb-6dgjh\" (UID: \"c06f24f9-95b0-4a92-ad3a-6075764151ed\") " pod="openstack-kuttl-tests/barbican-api-7f78b864cb-6dgjh" Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.860775 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c06f24f9-95b0-4a92-ad3a-6075764151ed-config-data\") pod \"barbican-api-7f78b864cb-6dgjh\" (UID: \"c06f24f9-95b0-4a92-ad3a-6075764151ed\") " pod="openstack-kuttl-tests/barbican-api-7f78b864cb-6dgjh" Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.862405 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c06f24f9-95b0-4a92-ad3a-6075764151ed-logs\") pod \"barbican-api-7f78b864cb-6dgjh\" (UID: \"c06f24f9-95b0-4a92-ad3a-6075764151ed\") " pod="openstack-kuttl-tests/barbican-api-7f78b864cb-6dgjh" Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.863965 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f9a4fc77-147c-46f7-a4de-e36f3086b09b-combined-ca-bundle\") pod \"placement-69d57497c4-7bhm5\" (UID: \"f9a4fc77-147c-46f7-a4de-e36f3086b09b\") " pod="openstack-kuttl-tests/placement-69d57497c4-7bhm5" Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.864150 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f9a4fc77-147c-46f7-a4de-e36f3086b09b-config-data\") pod \"placement-69d57497c4-7bhm5\" (UID: \"f9a4fc77-147c-46f7-a4de-e36f3086b09b\") " pod="openstack-kuttl-tests/placement-69d57497c4-7bhm5" Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.864456 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbkzq\" (UniqueName: \"kubernetes.io/projected/f9a4fc77-147c-46f7-a4de-e36f3086b09b-kube-api-access-fbkzq\") pod \"placement-69d57497c4-7bhm5\" (UID: \"f9a4fc77-147c-46f7-a4de-e36f3086b09b\") " pod="openstack-kuttl-tests/placement-69d57497c4-7bhm5" Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.864648 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f9a4fc77-147c-46f7-a4de-e36f3086b09b-logs\") pod \"placement-69d57497c4-7bhm5\" (UID: \"f9a4fc77-147c-46f7-a4de-e36f3086b09b\") " pod="openstack-kuttl-tests/placement-69d57497c4-7bhm5" Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.864858 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c06f24f9-95b0-4a92-ad3a-6075764151ed-combined-ca-bundle\") pod \"barbican-api-7f78b864cb-6dgjh\" (UID: \"c06f24f9-95b0-4a92-ad3a-6075764151ed\") " pod="openstack-kuttl-tests/barbican-api-7f78b864cb-6dgjh" Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.876678 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f9a4fc77-147c-46f7-a4de-e36f3086b09b-internal-tls-certs\") pod \"placement-69d57497c4-7bhm5\" (UID: \"f9a4fc77-147c-46f7-a4de-e36f3086b09b\") " pod="openstack-kuttl-tests/placement-69d57497c4-7bhm5" Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.874380 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/c06f24f9-95b0-4a92-ad3a-6075764151ed-internal-tls-certs\") pod \"barbican-api-7f78b864cb-6dgjh\" (UID: \"c06f24f9-95b0-4a92-ad3a-6075764151ed\") " pod="openstack-kuttl-tests/barbican-api-7f78b864cb-6dgjh" Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.875125 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/c06f24f9-95b0-4a92-ad3a-6075764151ed-config-data-custom\") pod \"barbican-api-7f78b864cb-6dgjh\" (UID: \"c06f24f9-95b0-4a92-ad3a-6075764151ed\") " pod="openstack-kuttl-tests/barbican-api-7f78b864cb-6dgjh" Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.875277 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c06f24f9-95b0-4a92-ad3a-6075764151ed-combined-ca-bundle\") pod \"barbican-api-7f78b864cb-6dgjh\" (UID: \"c06f24f9-95b0-4a92-ad3a-6075764151ed\") " pod="openstack-kuttl-tests/barbican-api-7f78b864cb-6dgjh" Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.862775 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c06f24f9-95b0-4a92-ad3a-6075764151ed-logs\") pod \"barbican-api-7f78b864cb-6dgjh\" (UID: \"c06f24f9-95b0-4a92-ad3a-6075764151ed\") " pod="openstack-kuttl-tests/barbican-api-7f78b864cb-6dgjh" Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.881329 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/c06f24f9-95b0-4a92-ad3a-6075764151ed-public-tls-certs\") pod \"barbican-api-7f78b864cb-6dgjh\" (UID: \"c06f24f9-95b0-4a92-ad3a-6075764151ed\") " pod="openstack-kuttl-tests/barbican-api-7f78b864cb-6dgjh" Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.889513 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7dr8\" (UniqueName: \"kubernetes.io/projected/c06f24f9-95b0-4a92-ad3a-6075764151ed-kube-api-access-c7dr8\") pod \"barbican-api-7f78b864cb-6dgjh\" (UID: \"c06f24f9-95b0-4a92-ad3a-6075764151ed\") " pod="openstack-kuttl-tests/barbican-api-7f78b864cb-6dgjh" Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.897932 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.928860 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.977555 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.978658 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f9a4fc77-147c-46f7-a4de-e36f3086b09b-internal-tls-certs\") pod \"placement-69d57497c4-7bhm5\" (UID: \"f9a4fc77-147c-46f7-a4de-e36f3086b09b\") " pod="openstack-kuttl-tests/placement-69d57497c4-7bhm5" Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.978749 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/986cfe2c-03bb-4027-b930-79c5b3dd8fe4-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"986cfe2c-03bb-4027-b930-79c5b3dd8fe4\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.978859 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/986cfe2c-03bb-4027-b930-79c5b3dd8fe4-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"986cfe2c-03bb-4027-b930-79c5b3dd8fe4\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.978895 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/986cfe2c-03bb-4027-b930-79c5b3dd8fe4-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"986cfe2c-03bb-4027-b930-79c5b3dd8fe4\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.978926 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/986cfe2c-03bb-4027-b930-79c5b3dd8fe4-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"986cfe2c-03bb-4027-b930-79c5b3dd8fe4\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.979408 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f9a4fc77-147c-46f7-a4de-e36f3086b09b-scripts\") pod \"placement-69d57497c4-7bhm5\" (UID: \"f9a4fc77-147c-46f7-a4de-e36f3086b09b\") " pod="openstack-kuttl-tests/placement-69d57497c4-7bhm5" Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.979467 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/986cfe2c-03bb-4027-b930-79c5b3dd8fe4-config\") pod \"ovsdbserver-nb-0\" (UID: \"986cfe2c-03bb-4027-b930-79c5b3dd8fe4\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.979534 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f9a4fc77-147c-46f7-a4de-e36f3086b09b-public-tls-certs\") pod \"placement-69d57497c4-7bhm5\" (UID: \"f9a4fc77-147c-46f7-a4de-e36f3086b09b\") " pod="openstack-kuttl-tests/placement-69d57497c4-7bhm5" Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.984935 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f9a4fc77-147c-46f7-a4de-e36f3086b09b-public-tls-certs\") pod \"placement-69d57497c4-7bhm5\" (UID: \"f9a4fc77-147c-46f7-a4de-e36f3086b09b\") " pod="openstack-kuttl-tests/placement-69d57497c4-7bhm5" Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.987072 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f9a4fc77-147c-46f7-a4de-e36f3086b09b-scripts\") pod \"placement-69d57497c4-7bhm5\" (UID: \"f9a4fc77-147c-46f7-a4de-e36f3086b09b\") " pod="openstack-kuttl-tests/placement-69d57497c4-7bhm5" Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.991887 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.992728 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f9a4fc77-147c-46f7-a4de-e36f3086b09b-combined-ca-bundle\") pod \"placement-69d57497c4-7bhm5\" (UID: \"f9a4fc77-147c-46f7-a4de-e36f3086b09b\") " pod="openstack-kuttl-tests/placement-69d57497c4-7bhm5" Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.993073 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f9a4fc77-147c-46f7-a4de-e36f3086b09b-config-data\") pod \"placement-69d57497c4-7bhm5\" (UID: \"f9a4fc77-147c-46f7-a4de-e36f3086b09b\") " pod="openstack-kuttl-tests/placement-69d57497c4-7bhm5" Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.993115 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mhnc\" (UniqueName: \"kubernetes.io/projected/986cfe2c-03bb-4027-b930-79c5b3dd8fe4-kube-api-access-5mhnc\") pod \"ovsdbserver-nb-0\" (UID: \"986cfe2c-03bb-4027-b930-79c5b3dd8fe4\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.993292 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fbkzq\" (UniqueName: \"kubernetes.io/projected/f9a4fc77-147c-46f7-a4de-e36f3086b09b-kube-api-access-fbkzq\") pod \"placement-69d57497c4-7bhm5\" (UID: \"f9a4fc77-147c-46f7-a4de-e36f3086b09b\") " pod="openstack-kuttl-tests/placement-69d57497c4-7bhm5" Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.993381 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/986cfe2c-03bb-4027-b930-79c5b3dd8fe4-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"986cfe2c-03bb-4027-b930-79c5b3dd8fe4\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.993420 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f9a4fc77-147c-46f7-a4de-e36f3086b09b-logs\") pod \"placement-69d57497c4-7bhm5\" (UID: \"f9a4fc77-147c-46f7-a4de-e36f3086b09b\") " pod="openstack-kuttl-tests/placement-69d57497c4-7bhm5" Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.993450 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") pod \"ovsdbserver-nb-0\" (UID: \"986cfe2c-03bb-4027-b930-79c5b3dd8fe4\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.994437 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f9a4fc77-147c-46f7-a4de-e36f3086b09b-logs\") pod \"placement-69d57497c4-7bhm5\" (UID: \"f9a4fc77-147c-46f7-a4de-e36f3086b09b\") " pod="openstack-kuttl-tests/placement-69d57497c4-7bhm5" Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.994552 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f9a4fc77-147c-46f7-a4de-e36f3086b09b-internal-tls-certs\") pod \"placement-69d57497c4-7bhm5\" (UID: \"f9a4fc77-147c-46f7-a4de-e36f3086b09b\") " pod="openstack-kuttl-tests/placement-69d57497c4-7bhm5" Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.997615 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f9a4fc77-147c-46f7-a4de-e36f3086b09b-combined-ca-bundle\") pod \"placement-69d57497c4-7bhm5\" (UID: \"f9a4fc77-147c-46f7-a4de-e36f3086b09b\") " pod="openstack-kuttl-tests/placement-69d57497c4-7bhm5" Mar 16 16:52:47 crc kubenswrapper[5120]: I0316 16:52:47.998564 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f9a4fc77-147c-46f7-a4de-e36f3086b09b-config-data\") pod \"placement-69d57497c4-7bhm5\" (UID: \"f9a4fc77-147c-46f7-a4de-e36f3086b09b\") " pod="openstack-kuttl-tests/placement-69d57497c4-7bhm5" Mar 16 16:52:48 crc kubenswrapper[5120]: I0316 16:52:48.038532 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbkzq\" (UniqueName: \"kubernetes.io/projected/f9a4fc77-147c-46f7-a4de-e36f3086b09b-kube-api-access-fbkzq\") pod \"placement-69d57497c4-7bhm5\" (UID: \"f9a4fc77-147c-46f7-a4de-e36f3086b09b\") " pod="openstack-kuttl-tests/placement-69d57497c4-7bhm5" Mar 16 16:52:48 crc kubenswrapper[5120]: I0316 16:52:48.096010 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/986cfe2c-03bb-4027-b930-79c5b3dd8fe4-config\") pod \"ovsdbserver-nb-0\" (UID: \"986cfe2c-03bb-4027-b930-79c5b3dd8fe4\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:52:48 crc kubenswrapper[5120]: I0316 16:52:48.096224 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5mhnc\" (UniqueName: \"kubernetes.io/projected/986cfe2c-03bb-4027-b930-79c5b3dd8fe4-kube-api-access-5mhnc\") pod \"ovsdbserver-nb-0\" (UID: \"986cfe2c-03bb-4027-b930-79c5b3dd8fe4\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:52:48 crc kubenswrapper[5120]: I0316 16:52:48.096491 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/986cfe2c-03bb-4027-b930-79c5b3dd8fe4-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"986cfe2c-03bb-4027-b930-79c5b3dd8fe4\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:52:48 crc kubenswrapper[5120]: I0316 16:52:48.097721 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") pod \"ovsdbserver-nb-0\" (UID: \"986cfe2c-03bb-4027-b930-79c5b3dd8fe4\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:52:48 crc kubenswrapper[5120]: I0316 16:52:48.098276 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/986cfe2c-03bb-4027-b930-79c5b3dd8fe4-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"986cfe2c-03bb-4027-b930-79c5b3dd8fe4\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:52:48 crc kubenswrapper[5120]: I0316 16:52:48.098595 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/986cfe2c-03bb-4027-b930-79c5b3dd8fe4-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"986cfe2c-03bb-4027-b930-79c5b3dd8fe4\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:52:48 crc kubenswrapper[5120]: I0316 16:52:48.098719 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/986cfe2c-03bb-4027-b930-79c5b3dd8fe4-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"986cfe2c-03bb-4027-b930-79c5b3dd8fe4\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:52:48 crc kubenswrapper[5120]: I0316 16:52:48.098914 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/986cfe2c-03bb-4027-b930-79c5b3dd8fe4-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"986cfe2c-03bb-4027-b930-79c5b3dd8fe4\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:52:48 crc kubenswrapper[5120]: I0316 16:52:48.099699 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/986cfe2c-03bb-4027-b930-79c5b3dd8fe4-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"986cfe2c-03bb-4027-b930-79c5b3dd8fe4\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:52:48 crc kubenswrapper[5120]: I0316 16:52:48.099755 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") pod \"ovsdbserver-nb-0\" (UID: \"986cfe2c-03bb-4027-b930-79c5b3dd8fe4\") device mount path \"/mnt/openstack/pv17\"" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:52:48 crc kubenswrapper[5120]: I0316 16:52:48.101157 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/986cfe2c-03bb-4027-b930-79c5b3dd8fe4-config\") pod \"ovsdbserver-nb-0\" (UID: \"986cfe2c-03bb-4027-b930-79c5b3dd8fe4\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:52:48 crc kubenswrapper[5120]: I0316 16:52:48.100989 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/986cfe2c-03bb-4027-b930-79c5b3dd8fe4-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"986cfe2c-03bb-4027-b930-79c5b3dd8fe4\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:52:48 crc kubenswrapper[5120]: I0316 16:52:48.113943 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/986cfe2c-03bb-4027-b930-79c5b3dd8fe4-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"986cfe2c-03bb-4027-b930-79c5b3dd8fe4\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:52:48 crc kubenswrapper[5120]: I0316 16:52:48.119185 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/986cfe2c-03bb-4027-b930-79c5b3dd8fe4-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"986cfe2c-03bb-4027-b930-79c5b3dd8fe4\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:52:48 crc kubenswrapper[5120]: I0316 16:52:48.122642 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/986cfe2c-03bb-4027-b930-79c5b3dd8fe4-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"986cfe2c-03bb-4027-b930-79c5b3dd8fe4\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:52:48 crc kubenswrapper[5120]: I0316 16:52:48.153846 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mhnc\" (UniqueName: \"kubernetes.io/projected/986cfe2c-03bb-4027-b930-79c5b3dd8fe4-kube-api-access-5mhnc\") pod \"ovsdbserver-nb-0\" (UID: \"986cfe2c-03bb-4027-b930-79c5b3dd8fe4\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:52:48 crc kubenswrapper[5120]: I0316 16:52:48.188395 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") pod \"ovsdbserver-nb-0\" (UID: \"986cfe2c-03bb-4027-b930-79c5b3dd8fe4\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:52:48 crc kubenswrapper[5120]: E0316 16:52:48.238587 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 0b2132e2ff271b061aeedada07b1b4b7222370b28d5b9e6d518cdc82cd879170 is running failed: container process not found" containerID="0b2132e2ff271b061aeedada07b1b4b7222370b28d5b9e6d518cdc82cd879170" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:52:48 crc kubenswrapper[5120]: E0316 16:52:48.238963 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 0b2132e2ff271b061aeedada07b1b4b7222370b28d5b9e6d518cdc82cd879170 is running failed: container process not found" containerID="0b2132e2ff271b061aeedada07b1b4b7222370b28d5b9e6d518cdc82cd879170" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:52:48 crc kubenswrapper[5120]: E0316 16:52:48.239127 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 0b2132e2ff271b061aeedada07b1b4b7222370b28d5b9e6d518cdc82cd879170 is running failed: container process not found" containerID="0b2132e2ff271b061aeedada07b1b4b7222370b28d5b9e6d518cdc82cd879170" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:52:48 crc kubenswrapper[5120]: E0316 16:52:48.239150 5120 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 0b2132e2ff271b061aeedada07b1b4b7222370b28d5b9e6d518cdc82cd879170 is running failed: container process not found" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="8a04cbe2-cde0-405c-820b-f2651d753654" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 16:52:48 crc kubenswrapper[5120]: I0316 16:52:48.640916 5120 scope.go:117] "RemoveContainer" containerID="915b5731ab24fdf439082f82008a3e9949a33a942c1c182ba42ff728115d12a9" Mar 16 16:52:48 crc kubenswrapper[5120]: I0316 16:52:48.688138 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b0528e86-65e5-4d4c-9dd9-4cd6b9475cbc" path="/var/lib/kubelet/pods/b0528e86-65e5-4d4c-9dd9-4cd6b9475cbc/volumes" Mar 16 16:52:48 crc kubenswrapper[5120]: I0316 16:52:48.690063 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bb689081-a0bf-445f-aa9f-12a38c98a269" path="/var/lib/kubelet/pods/bb689081-a0bf-445f-aa9f-12a38c98a269/volumes" Mar 16 16:52:48 crc kubenswrapper[5120]: I0316 16:52:48.691308 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"359ce032-c698-43d8-a7eb-011091fe9a3d","Type":"ContainerDied","Data":"c66bb1ea3aba4a291cd32d3b92ff9acae01761acb99e048a15a16d9f61b236ce"} Mar 16 16:52:48 crc kubenswrapper[5120]: I0316 16:52:48.691340 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c66bb1ea3aba4a291cd32d3b92ff9acae01761acb99e048a15a16d9f61b236ce" Mar 16 16:52:48 crc kubenswrapper[5120]: I0316 16:52:48.706799 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:52:48 crc kubenswrapper[5120]: I0316 16:52:48.708592 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"30517467-b630-4ca2-815c-460999b6539a","Type":"ContainerDied","Data":"74f7ea172491c5603192601f3d166c2f197e7d43c2489499ef3a5dd8f75b91c2"} Mar 16 16:52:48 crc kubenswrapper[5120]: I0316 16:52:48.719263 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"8a04cbe2-cde0-405c-820b-f2651d753654","Type":"ContainerDied","Data":"4466816f22da7e60b0e19c145c0ca5171adcdb32dd9fd2fa983a1c4b48a045fb"} Mar 16 16:52:48 crc kubenswrapper[5120]: I0316 16:52:48.719301 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4466816f22da7e60b0e19c145c0ca5171adcdb32dd9fd2fa983a1c4b48a045fb" Mar 16 16:52:48 crc kubenswrapper[5120]: I0316 16:52:48.758640 5120 generic.go:358] "Generic (PLEG): container finished" podID="2627e341-ad91-4de8-96da-e58d58d40fb9" containerID="82d54ad68569e47a7c9f69774a92e01246e782c11e23830d6d82dfe12081e84d" exitCode=0 Mar 16 16:52:48 crc kubenswrapper[5120]: I0316 16:52:48.758900 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"2627e341-ad91-4de8-96da-e58d58d40fb9","Type":"ContainerDied","Data":"82d54ad68569e47a7c9f69774a92e01246e782c11e23830d6d82dfe12081e84d"} Mar 16 16:52:48 crc kubenswrapper[5120]: I0316 16:52:48.773866 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-57f7845c4b-tb6nd" event={"ID":"ffa2d14d-1b44-445b-ab47-1bb134223111","Type":"ContainerStarted","Data":"14163cd8360b3c73347f8b0c392c0ec0f73523533c85a6ad428afe07e0daabd6"} Mar 16 16:52:48 crc kubenswrapper[5120]: I0316 16:52:48.778446 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:52:48 crc kubenswrapper[5120]: I0316 16:52:48.779487 5120 generic.go:358] "Generic (PLEG): container finished" podID="8a564f44-3c8d-4dff-b968-96f276382786" containerID="2f86dbe111359426e7c3145a6535162eda586f161b335551970a0c38fcb780ec" exitCode=0 Mar 16 16:52:48 crc kubenswrapper[5120]: I0316 16:52:48.779565 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"8a564f44-3c8d-4dff-b968-96f276382786","Type":"ContainerDied","Data":"2f86dbe111359426e7c3145a6535162eda586f161b335551970a0c38fcb780ec"} Mar 16 16:52:48 crc kubenswrapper[5120]: I0316 16:52:48.779604 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"8a564f44-3c8d-4dff-b968-96f276382786","Type":"ContainerDied","Data":"ce94507326157848414a61aacbca19082c0442507f48c133d55fa7f03f76d724"} Mar 16 16:52:48 crc kubenswrapper[5120]: I0316 16:52:48.779617 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ce94507326157848414a61aacbca19082c0442507f48c133d55fa7f03f76d724" Mar 16 16:52:48 crc kubenswrapper[5120]: I0316 16:52:48.781528 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"72edd543-4bf8-407e-9929-47d4e9727134","Type":"ContainerStarted","Data":"7816c29183fb7097d4d22872253ba868dcbcd6a242a3b1c65c60c010d1c13774"} Mar 16 16:52:48 crc kubenswrapper[5120]: I0316 16:52:48.782846 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-d99589cd-7z8cg" event={"ID":"cc7ba52a-5825-4399-9e38-4d5cd1c02156","Type":"ContainerStarted","Data":"7f060b9de52d1b97b1d6fda914a02b312a1a97691413d86ad5b2bfb2c4243b85"} Mar 16 16:52:48 crc kubenswrapper[5120]: I0316 16:52:48.784146 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-d7c95f898-g5nln" event={"ID":"ebceb235-ad03-49fd-9921-f5be8c1851be","Type":"ContainerStarted","Data":"930d84eac7ee9769a915b1220e96a2bf962e2e5ee962c5e5cd7843c886ae0dce"} Mar 16 16:52:48 crc kubenswrapper[5120]: I0316 16:52:48.792990 5120 generic.go:358] "Generic (PLEG): container finished" podID="e5b6bb5a-fb93-4761-b995-1842090c7047" containerID="253c53bba99c38e72727f99679b1008d2ae517e9eefdcfc28a8327f9fd2df9dd" exitCode=0 Mar 16 16:52:48 crc kubenswrapper[5120]: I0316 16:52:48.793169 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"e5b6bb5a-fb93-4761-b995-1842090c7047","Type":"ContainerDied","Data":"253c53bba99c38e72727f99679b1008d2ae517e9eefdcfc28a8327f9fd2df9dd"} Mar 16 16:52:48 crc kubenswrapper[5120]: I0316 16:52:48.793194 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"e5b6bb5a-fb93-4761-b995-1842090c7047","Type":"ContainerDied","Data":"2b9935a76c689d891dbd70e6b7ca971448436faf6f4d14142924c0f37d07fac9"} Mar 16 16:52:48 crc kubenswrapper[5120]: I0316 16:52:48.793203 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2b9935a76c689d891dbd70e6b7ca971448436faf6f4d14142924c0f37d07fac9" Mar 16 16:52:48 crc kubenswrapper[5120]: I0316 16:52:48.798237 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"a3cdc115-5535-44fd-94b4-6256145dea7e","Type":"ContainerStarted","Data":"5fa94af7a48c95fb7b0d554faba8682ad288e705924b742b901e1a3c65aac076"} Mar 16 16:52:48 crc kubenswrapper[5120]: I0316 16:52:48.831874 5120 generic.go:358] "Generic (PLEG): container finished" podID="b3abb705-1e8c-4922-a449-616479bf0721" containerID="0d81c2b074c35c712a28eea449678c1bb236db51f5c95f1df01bdf619672c22d" exitCode=0 Mar 16 16:52:48 crc kubenswrapper[5120]: I0316 16:52:48.832148 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"b3abb705-1e8c-4922-a449-616479bf0721","Type":"ContainerDied","Data":"0d81c2b074c35c712a28eea449678c1bb236db51f5c95f1df01bdf619672c22d"} Mar 16 16:52:48 crc kubenswrapper[5120]: I0316 16:52:48.832180 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"b3abb705-1e8c-4922-a449-616479bf0721","Type":"ContainerDied","Data":"6928e73af7b17a1bda240411ad8f161cc88491300ba4dfe0ca3535865049d782"} Mar 16 16:52:48 crc kubenswrapper[5120]: I0316 16:52:48.832195 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6928e73af7b17a1bda240411ad8f161cc88491300ba4dfe0ca3535865049d782" Mar 16 16:52:48 crc kubenswrapper[5120]: I0316 16:52:48.834221 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:52:48 crc kubenswrapper[5120]: I0316 16:52:48.857962 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-7f78b864cb-6dgjh" Mar 16 16:52:48 crc kubenswrapper[5120]: I0316 16:52:48.867085 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tzvzn\" (UniqueName: \"kubernetes.io/projected/30517467-b630-4ca2-815c-460999b6539a-kube-api-access-tzvzn\") pod \"30517467-b630-4ca2-815c-460999b6539a\" (UID: \"30517467-b630-4ca2-815c-460999b6539a\") " Mar 16 16:52:48 crc kubenswrapper[5120]: I0316 16:52:48.867280 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/30517467-b630-4ca2-815c-460999b6539a-operator-scripts\") pod \"30517467-b630-4ca2-815c-460999b6539a\" (UID: \"30517467-b630-4ca2-815c-460999b6539a\") " Mar 16 16:52:48 crc kubenswrapper[5120]: I0316 16:52:48.867400 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/30517467-b630-4ca2-815c-460999b6539a-config-data-generated\") pod \"30517467-b630-4ca2-815c-460999b6539a\" (UID: \"30517467-b630-4ca2-815c-460999b6539a\") " Mar 16 16:52:48 crc kubenswrapper[5120]: I0316 16:52:48.867511 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/30517467-b630-4ca2-815c-460999b6539a-config-data-default\") pod \"30517467-b630-4ca2-815c-460999b6539a\" (UID: \"30517467-b630-4ca2-815c-460999b6539a\") " Mar 16 16:52:48 crc kubenswrapper[5120]: I0316 16:52:48.867672 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8a04cbe2-cde0-405c-820b-f2651d753654-combined-ca-bundle\") pod \"8a04cbe2-cde0-405c-820b-f2651d753654\" (UID: \"8a04cbe2-cde0-405c-820b-f2651d753654\") " Mar 16 16:52:48 crc kubenswrapper[5120]: I0316 16:52:48.867908 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8a04cbe2-cde0-405c-820b-f2651d753654-config-data\") pod \"8a04cbe2-cde0-405c-820b-f2651d753654\" (UID: \"8a04cbe2-cde0-405c-820b-f2651d753654\") " Mar 16 16:52:48 crc kubenswrapper[5120]: I0316 16:52:48.868265 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/30517467-b630-4ca2-815c-460999b6539a-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "30517467-b630-4ca2-815c-460999b6539a" (UID: "30517467-b630-4ca2-815c-460999b6539a"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:52:48 crc kubenswrapper[5120]: I0316 16:52:48.868786 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/30517467-b630-4ca2-815c-460999b6539a-config-data-generated" (OuterVolumeSpecName: "config-data-generated") pod "30517467-b630-4ca2-815c-460999b6539a" (UID: "30517467-b630-4ca2-815c-460999b6539a"). InnerVolumeSpecName "config-data-generated". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:52:48 crc kubenswrapper[5120]: I0316 16:52:48.869047 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wp597\" (UniqueName: \"kubernetes.io/projected/8a04cbe2-cde0-405c-820b-f2651d753654-kube-api-access-wp597\") pod \"8a04cbe2-cde0-405c-820b-f2651d753654\" (UID: \"8a04cbe2-cde0-405c-820b-f2651d753654\") " Mar 16 16:52:48 crc kubenswrapper[5120]: I0316 16:52:48.869271 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/30517467-b630-4ca2-815c-460999b6539a-kolla-config\") pod \"30517467-b630-4ca2-815c-460999b6539a\" (UID: \"30517467-b630-4ca2-815c-460999b6539a\") " Mar 16 16:52:48 crc kubenswrapper[5120]: I0316 16:52:48.869404 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/30517467-b630-4ca2-815c-460999b6539a-combined-ca-bundle\") pod \"30517467-b630-4ca2-815c-460999b6539a\" (UID: \"30517467-b630-4ca2-815c-460999b6539a\") " Mar 16 16:52:48 crc kubenswrapper[5120]: I0316 16:52:48.869626 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/30517467-b630-4ca2-815c-460999b6539a-galera-tls-certs\") pod \"30517467-b630-4ca2-815c-460999b6539a\" (UID: \"30517467-b630-4ca2-815c-460999b6539a\") " Mar 16 16:52:48 crc kubenswrapper[5120]: I0316 16:52:48.869790 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"mysql-db\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") pod \"30517467-b630-4ca2-815c-460999b6539a\" (UID: \"30517467-b630-4ca2-815c-460999b6539a\") " Mar 16 16:52:48 crc kubenswrapper[5120]: I0316 16:52:48.869905 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/30517467-b630-4ca2-815c-460999b6539a-config-data-default" (OuterVolumeSpecName: "config-data-default") pod "30517467-b630-4ca2-815c-460999b6539a" (UID: "30517467-b630-4ca2-815c-460999b6539a"). InnerVolumeSpecName "config-data-default". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:52:48 crc kubenswrapper[5120]: I0316 16:52:48.874130 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/30517467-b630-4ca2-815c-460999b6539a-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "30517467-b630-4ca2-815c-460999b6539a" (UID: "30517467-b630-4ca2-815c-460999b6539a"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:52:48 crc kubenswrapper[5120]: I0316 16:52:48.875345 5120 generic.go:358] "Generic (PLEG): container finished" podID="6a9b9d92-8d3c-4366-83fb-0ea460a622d9" containerID="020f44c3cf6c107e17a170eb3a7361b1a565b2597ea573ccf12fb50dd79f6013" exitCode=0 Mar 16 16:52:48 crc kubenswrapper[5120]: I0316 16:52:48.875582 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"6a9b9d92-8d3c-4366-83fb-0ea460a622d9","Type":"ContainerDied","Data":"020f44c3cf6c107e17a170eb3a7361b1a565b2597ea573ccf12fb50dd79f6013"} Mar 16 16:52:48 crc kubenswrapper[5120]: I0316 16:52:48.875615 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"6a9b9d92-8d3c-4366-83fb-0ea460a622d9","Type":"ContainerDied","Data":"95e6f98a71b0fb6a1711d4679ebe344f7fc97980903ac279616f4c3b347109e8"} Mar 16 16:52:48 crc kubenswrapper[5120]: I0316 16:52:48.875628 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="95e6f98a71b0fb6a1711d4679ebe344f7fc97980903ac279616f4c3b347109e8" Mar 16 16:52:48 crc kubenswrapper[5120]: I0316 16:52:48.881507 5120 reconciler_common.go:299] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/30517467-b630-4ca2-815c-460999b6539a-kolla-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:48 crc kubenswrapper[5120]: I0316 16:52:48.881540 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/30517467-b630-4ca2-815c-460999b6539a-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:48 crc kubenswrapper[5120]: I0316 16:52:48.881550 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/30517467-b630-4ca2-815c-460999b6539a-config-data-generated\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:48 crc kubenswrapper[5120]: I0316 16:52:48.881562 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/30517467-b630-4ca2-815c-460999b6539a-config-data-default\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:48 crc kubenswrapper[5120]: I0316 16:52:48.895700 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:52:48 crc kubenswrapper[5120]: I0316 16:52:48.903063 5120 generic.go:358] "Generic (PLEG): container finished" podID="adaee0e3-17f6-4f23-97c4-00bd5f6a8d6c" containerID="ba4af8aa3c89740443bcafa47b272ccb7a4f3b2222974c478de29e30c4166272" exitCode=0 Mar 16 16:52:48 crc kubenswrapper[5120]: I0316 16:52:48.903117 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"adaee0e3-17f6-4f23-97c4-00bd5f6a8d6c","Type":"ContainerDied","Data":"ba4af8aa3c89740443bcafa47b272ccb7a4f3b2222974c478de29e30c4166272"} Mar 16 16:52:48 crc kubenswrapper[5120]: I0316 16:52:48.907881 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-69d57497c4-7bhm5" Mar 16 16:52:48 crc kubenswrapper[5120]: I0316 16:52:48.912801 5120 scope.go:117] "RemoveContainer" containerID="923a669bca7315d4fb93e0c792a4a355ec7d35b80a15a8429162435af8939525" Mar 16 16:52:48 crc kubenswrapper[5120]: I0316 16:52:48.919177 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:52:48 crc kubenswrapper[5120]: I0316 16:52:48.927253 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:52:48 crc kubenswrapper[5120]: I0316 16:52:48.937372 5120 scope.go:117] "RemoveContainer" containerID="044c15ffa7eb7b7e365430d8cd90ac7de7dc64f1a62dd9960f7cd1eb40ab2934" Mar 16 16:52:48 crc kubenswrapper[5120]: I0316 16:52:48.942140 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a04cbe2-cde0-405c-820b-f2651d753654-kube-api-access-wp597" (OuterVolumeSpecName: "kube-api-access-wp597") pod "8a04cbe2-cde0-405c-820b-f2651d753654" (UID: "8a04cbe2-cde0-405c-820b-f2651d753654"). InnerVolumeSpecName "kube-api-access-wp597". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:52:48 crc kubenswrapper[5120]: W0316 16:52:48.956042 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda7564ece_3e31_426b_a07b_1b9e12d76d01.slice/crio-e7a9453dd3686f237314323dbfa581ff64f6a12f3d9c911a9d967ff2c6214631 WatchSource:0}: Error finding container e7a9453dd3686f237314323dbfa581ff64f6a12f3d9c911a9d967ff2c6214631: Status 404 returned error can't find the container with id e7a9453dd3686f237314323dbfa581ff64f6a12f3d9c911a9d967ff2c6214631 Mar 16 16:52:48 crc kubenswrapper[5120]: I0316 16:52:48.965202 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30517467-b630-4ca2-815c-460999b6539a-kube-api-access-tzvzn" (OuterVolumeSpecName: "kube-api-access-tzvzn") pod "30517467-b630-4ca2-815c-460999b6539a" (UID: "30517467-b630-4ca2-815c-460999b6539a"). InnerVolumeSpecName "kube-api-access-tzvzn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:52:48 crc kubenswrapper[5120]: I0316 16:52:48.987800 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5tbjl\" (UniqueName: \"kubernetes.io/projected/359ce032-c698-43d8-a7eb-011091fe9a3d-kube-api-access-5tbjl\") pod \"359ce032-c698-43d8-a7eb-011091fe9a3d\" (UID: \"359ce032-c698-43d8-a7eb-011091fe9a3d\") " Mar 16 16:52:48 crc kubenswrapper[5120]: I0316 16:52:48.987926 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/359ce032-c698-43d8-a7eb-011091fe9a3d-config-data-generated\") pod \"359ce032-c698-43d8-a7eb-011091fe9a3d\" (UID: \"359ce032-c698-43d8-a7eb-011091fe9a3d\") " Mar 16 16:52:48 crc kubenswrapper[5120]: I0316 16:52:48.987962 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/8a564f44-3c8d-4dff-b968-96f276382786-nova-metadata-tls-certs\") pod \"8a564f44-3c8d-4dff-b968-96f276382786\" (UID: \"8a564f44-3c8d-4dff-b968-96f276382786\") " Mar 16 16:52:48 crc kubenswrapper[5120]: I0316 16:52:48.988022 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8a564f44-3c8d-4dff-b968-96f276382786-logs\") pod \"8a564f44-3c8d-4dff-b968-96f276382786\" (UID: \"8a564f44-3c8d-4dff-b968-96f276382786\") " Mar 16 16:52:48 crc kubenswrapper[5120]: I0316 16:52:48.988121 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/359ce032-c698-43d8-a7eb-011091fe9a3d-operator-scripts\") pod \"359ce032-c698-43d8-a7eb-011091fe9a3d\" (UID: \"359ce032-c698-43d8-a7eb-011091fe9a3d\") " Mar 16 16:52:48 crc kubenswrapper[5120]: I0316 16:52:48.988175 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/359ce032-c698-43d8-a7eb-011091fe9a3d-kolla-config\") pod \"359ce032-c698-43d8-a7eb-011091fe9a3d\" (UID: \"359ce032-c698-43d8-a7eb-011091fe9a3d\") " Mar 16 16:52:48 crc kubenswrapper[5120]: I0316 16:52:48.988325 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/359ce032-c698-43d8-a7eb-011091fe9a3d-galera-tls-certs\") pod \"359ce032-c698-43d8-a7eb-011091fe9a3d\" (UID: \"359ce032-c698-43d8-a7eb-011091fe9a3d\") " Mar 16 16:52:48 crc kubenswrapper[5120]: I0316 16:52:48.988399 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8a564f44-3c8d-4dff-b968-96f276382786-combined-ca-bundle\") pod \"8a564f44-3c8d-4dff-b968-96f276382786\" (UID: \"8a564f44-3c8d-4dff-b968-96f276382786\") " Mar 16 16:52:48 crc kubenswrapper[5120]: I0316 16:52:48.988477 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8a564f44-3c8d-4dff-b968-96f276382786-config-data\") pod \"8a564f44-3c8d-4dff-b968-96f276382786\" (UID: \"8a564f44-3c8d-4dff-b968-96f276382786\") " Mar 16 16:52:48 crc kubenswrapper[5120]: I0316 16:52:48.988541 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/359ce032-c698-43d8-a7eb-011091fe9a3d-combined-ca-bundle\") pod \"359ce032-c698-43d8-a7eb-011091fe9a3d\" (UID: \"359ce032-c698-43d8-a7eb-011091fe9a3d\") " Mar 16 16:52:48 crc kubenswrapper[5120]: I0316 16:52:48.988671 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"mysql-db\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"359ce032-c698-43d8-a7eb-011091fe9a3d\" (UID: \"359ce032-c698-43d8-a7eb-011091fe9a3d\") " Mar 16 16:52:48 crc kubenswrapper[5120]: I0316 16:52:48.988728 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/359ce032-c698-43d8-a7eb-011091fe9a3d-config-data-default\") pod \"359ce032-c698-43d8-a7eb-011091fe9a3d\" (UID: \"359ce032-c698-43d8-a7eb-011091fe9a3d\") " Mar 16 16:52:48 crc kubenswrapper[5120]: I0316 16:52:48.988805 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5ksh5\" (UniqueName: \"kubernetes.io/projected/8a564f44-3c8d-4dff-b968-96f276382786-kube-api-access-5ksh5\") pod \"8a564f44-3c8d-4dff-b968-96f276382786\" (UID: \"8a564f44-3c8d-4dff-b968-96f276382786\") " Mar 16 16:52:48 crc kubenswrapper[5120]: I0316 16:52:48.989900 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wp597\" (UniqueName: \"kubernetes.io/projected/8a04cbe2-cde0-405c-820b-f2651d753654-kube-api-access-wp597\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:48 crc kubenswrapper[5120]: I0316 16:52:48.989920 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tzvzn\" (UniqueName: \"kubernetes.io/projected/30517467-b630-4ca2-815c-460999b6539a-kube-api-access-tzvzn\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:48 crc kubenswrapper[5120]: I0316 16:52:48.993639 5120 scope.go:117] "RemoveContainer" containerID="6ec7a760a1240a7bf2d5c6d87956f6162ba6eb01f9c73461e515eedd1212d168" Mar 16 16:52:48 crc kubenswrapper[5120]: I0316 16:52:48.995810 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a564f44-3c8d-4dff-b968-96f276382786-logs" (OuterVolumeSpecName: "logs") pod "8a564f44-3c8d-4dff-b968-96f276382786" (UID: "8a564f44-3c8d-4dff-b968-96f276382786"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:52:48 crc kubenswrapper[5120]: I0316 16:52:48.996003 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:52:48 crc kubenswrapper[5120]: I0316 16:52:48.996150 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/359ce032-c698-43d8-a7eb-011091fe9a3d-config-data-generated" (OuterVolumeSpecName: "config-data-generated") pod "359ce032-c698-43d8-a7eb-011091fe9a3d" (UID: "359ce032-c698-43d8-a7eb-011091fe9a3d"). InnerVolumeSpecName "config-data-generated". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:52:48 crc kubenswrapper[5120]: I0316 16:52:48.996192 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/359ce032-c698-43d8-a7eb-011091fe9a3d-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "359ce032-c698-43d8-a7eb-011091fe9a3d" (UID: "359ce032-c698-43d8-a7eb-011091fe9a3d"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:52:48 crc kubenswrapper[5120]: I0316 16:52:48.997859 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/359ce032-c698-43d8-a7eb-011091fe9a3d-config-data-default" (OuterVolumeSpecName: "config-data-default") pod "359ce032-c698-43d8-a7eb-011091fe9a3d" (UID: "359ce032-c698-43d8-a7eb-011091fe9a3d"). InnerVolumeSpecName "config-data-default". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.000853 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/359ce032-c698-43d8-a7eb-011091fe9a3d-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "359ce032-c698-43d8-a7eb-011091fe9a3d" (UID: "359ce032-c698-43d8-a7eb-011091fe9a3d"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.011320 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage14-crc" (OuterVolumeSpecName: "mysql-db") pod "30517467-b630-4ca2-815c-460999b6539a" (UID: "30517467-b630-4ca2-815c-460999b6539a"). InnerVolumeSpecName "local-storage14-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.016621 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.021639 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.055822 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-786c646546-49lhr"] Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.057601 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.058639 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.064925 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a564f44-3c8d-4dff-b968-96f276382786-kube-api-access-5ksh5" (OuterVolumeSpecName: "kube-api-access-5ksh5") pod "8a564f44-3c8d-4dff-b968-96f276382786" (UID: "8a564f44-3c8d-4dff-b968-96f276382786"). InnerVolumeSpecName "kube-api-access-5ksh5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.069934 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/359ce032-c698-43d8-a7eb-011091fe9a3d-kube-api-access-5tbjl" (OuterVolumeSpecName: "kube-api-access-5tbjl") pod "359ce032-c698-43d8-a7eb-011091fe9a3d" (UID: "359ce032-c698-43d8-a7eb-011091fe9a3d"). InnerVolumeSpecName "kube-api-access-5tbjl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.095218 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e5b6bb5a-fb93-4761-b995-1842090c7047-internal-tls-certs\") pod \"e5b6bb5a-fb93-4761-b995-1842090c7047\" (UID: \"e5b6bb5a-fb93-4761-b995-1842090c7047\") " Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.095298 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6a9b9d92-8d3c-4366-83fb-0ea460a622d9-scripts\") pod \"6a9b9d92-8d3c-4366-83fb-0ea460a622d9\" (UID: \"6a9b9d92-8d3c-4366-83fb-0ea460a622d9\") " Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.095323 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2627e341-ad91-4de8-96da-e58d58d40fb9-combined-ca-bundle\") pod \"2627e341-ad91-4de8-96da-e58d58d40fb9\" (UID: \"2627e341-ad91-4de8-96da-e58d58d40fb9\") " Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.095347 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dwmsm\" (UniqueName: \"kubernetes.io/projected/e5b6bb5a-fb93-4761-b995-1842090c7047-kube-api-access-dwmsm\") pod \"e5b6bb5a-fb93-4761-b995-1842090c7047\" (UID: \"e5b6bb5a-fb93-4761-b995-1842090c7047\") " Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.095472 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6a9b9d92-8d3c-4366-83fb-0ea460a622d9-logs\") pod \"6a9b9d92-8d3c-4366-83fb-0ea460a622d9\" (UID: \"6a9b9d92-8d3c-4366-83fb-0ea460a622d9\") " Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.095577 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/2627e341-ad91-4de8-96da-e58d58d40fb9-public-tls-certs\") pod \"2627e341-ad91-4de8-96da-e58d58d40fb9\" (UID: \"2627e341-ad91-4de8-96da-e58d58d40fb9\") " Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.095640 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e5b6bb5a-fb93-4761-b995-1842090c7047-logs\") pod \"e5b6bb5a-fb93-4761-b995-1842090c7047\" (UID: \"e5b6bb5a-fb93-4761-b995-1842090c7047\") " Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.095698 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/b3abb705-1e8c-4922-a449-616479bf0721-internal-tls-certs\") pod \"b3abb705-1e8c-4922-a449-616479bf0721\" (UID: \"b3abb705-1e8c-4922-a449-616479bf0721\") " Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.095721 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/b3abb705-1e8c-4922-a449-616479bf0721-public-tls-certs\") pod \"b3abb705-1e8c-4922-a449-616479bf0721\" (UID: \"b3abb705-1e8c-4922-a449-616479bf0721\") " Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.095769 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e5b6bb5a-fb93-4761-b995-1842090c7047-combined-ca-bundle\") pod \"e5b6bb5a-fb93-4761-b995-1842090c7047\" (UID: \"e5b6bb5a-fb93-4761-b995-1842090c7047\") " Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.095803 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6a9b9d92-8d3c-4366-83fb-0ea460a622d9-public-tls-certs\") pod \"6a9b9d92-8d3c-4366-83fb-0ea460a622d9\" (UID: \"6a9b9d92-8d3c-4366-83fb-0ea460a622d9\") " Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.095824 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/e5b6bb5a-fb93-4761-b995-1842090c7047-httpd-run\") pod \"e5b6bb5a-fb93-4761-b995-1842090c7047\" (UID: \"e5b6bb5a-fb93-4761-b995-1842090c7047\") " Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.095851 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b3abb705-1e8c-4922-a449-616479bf0721-config-data\") pod \"b3abb705-1e8c-4922-a449-616479bf0721\" (UID: \"b3abb705-1e8c-4922-a449-616479bf0721\") " Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.097163 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/6a9b9d92-8d3c-4366-83fb-0ea460a622d9-httpd-run\") pod \"6a9b9d92-8d3c-4366-83fb-0ea460a622d9\" (UID: \"6a9b9d92-8d3c-4366-83fb-0ea460a622d9\") " Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.097211 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6a9b9d92-8d3c-4366-83fb-0ea460a622d9-config-data\") pod \"6a9b9d92-8d3c-4366-83fb-0ea460a622d9\" (UID: \"6a9b9d92-8d3c-4366-83fb-0ea460a622d9\") " Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.097239 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"e5b6bb5a-fb93-4761-b995-1842090c7047\" (UID: \"e5b6bb5a-fb93-4761-b995-1842090c7047\") " Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.097264 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/2627e341-ad91-4de8-96da-e58d58d40fb9-config-data-custom\") pod \"2627e341-ad91-4de8-96da-e58d58d40fb9\" (UID: \"2627e341-ad91-4de8-96da-e58d58d40fb9\") " Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.097318 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e5b6bb5a-fb93-4761-b995-1842090c7047-scripts\") pod \"e5b6bb5a-fb93-4761-b995-1842090c7047\" (UID: \"e5b6bb5a-fb93-4761-b995-1842090c7047\") " Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.097340 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6a9b9d92-8d3c-4366-83fb-0ea460a622d9-combined-ca-bundle\") pod \"6a9b9d92-8d3c-4366-83fb-0ea460a622d9\" (UID: \"6a9b9d92-8d3c-4366-83fb-0ea460a622d9\") " Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.097376 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2627e341-ad91-4de8-96da-e58d58d40fb9-config-data\") pod \"2627e341-ad91-4de8-96da-e58d58d40fb9\" (UID: \"2627e341-ad91-4de8-96da-e58d58d40fb9\") " Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.097453 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gdxqr\" (UniqueName: \"kubernetes.io/projected/6a9b9d92-8d3c-4366-83fb-0ea460a622d9-kube-api-access-gdxqr\") pod \"6a9b9d92-8d3c-4366-83fb-0ea460a622d9\" (UID: \"6a9b9d92-8d3c-4366-83fb-0ea460a622d9\") " Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.097770 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9vfxc\" (UniqueName: \"kubernetes.io/projected/b3abb705-1e8c-4922-a449-616479bf0721-kube-api-access-9vfxc\") pod \"b3abb705-1e8c-4922-a449-616479bf0721\" (UID: \"b3abb705-1e8c-4922-a449-616479bf0721\") " Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.097804 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"6a9b9d92-8d3c-4366-83fb-0ea460a622d9\" (UID: \"6a9b9d92-8d3c-4366-83fb-0ea460a622d9\") " Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.097866 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/2627e341-ad91-4de8-96da-e58d58d40fb9-etc-machine-id\") pod \"2627e341-ad91-4de8-96da-e58d58d40fb9\" (UID: \"2627e341-ad91-4de8-96da-e58d58d40fb9\") " Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.097892 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2627e341-ad91-4de8-96da-e58d58d40fb9-logs\") pod \"2627e341-ad91-4de8-96da-e58d58d40fb9\" (UID: \"2627e341-ad91-4de8-96da-e58d58d40fb9\") " Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.098998 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b3abb705-1e8c-4922-a449-616479bf0721-combined-ca-bundle\") pod \"b3abb705-1e8c-4922-a449-616479bf0721\" (UID: \"b3abb705-1e8c-4922-a449-616479bf0721\") " Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.099521 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e5b6bb5a-fb93-4761-b995-1842090c7047-config-data\") pod \"e5b6bb5a-fb93-4761-b995-1842090c7047\" (UID: \"e5b6bb5a-fb93-4761-b995-1842090c7047\") " Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.101264 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-74k2c\" (UniqueName: \"kubernetes.io/projected/2627e341-ad91-4de8-96da-e58d58d40fb9-kube-api-access-74k2c\") pod \"2627e341-ad91-4de8-96da-e58d58d40fb9\" (UID: \"2627e341-ad91-4de8-96da-e58d58d40fb9\") " Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.101410 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2627e341-ad91-4de8-96da-e58d58d40fb9-scripts\") pod \"2627e341-ad91-4de8-96da-e58d58d40fb9\" (UID: \"2627e341-ad91-4de8-96da-e58d58d40fb9\") " Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.101466 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b3abb705-1e8c-4922-a449-616479bf0721-logs\") pod \"b3abb705-1e8c-4922-a449-616479bf0721\" (UID: \"b3abb705-1e8c-4922-a449-616479bf0721\") " Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.101504 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/2627e341-ad91-4de8-96da-e58d58d40fb9-internal-tls-certs\") pod \"2627e341-ad91-4de8-96da-e58d58d40fb9\" (UID: \"2627e341-ad91-4de8-96da-e58d58d40fb9\") " Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.107862 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/2627e341-ad91-4de8-96da-e58d58d40fb9-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "2627e341-ad91-4de8-96da-e58d58d40fb9" (UID: "2627e341-ad91-4de8-96da-e58d58d40fb9"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.111794 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/359ce032-c698-43d8-a7eb-011091fe9a3d-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.111818 5120 reconciler_common.go:299] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/359ce032-c698-43d8-a7eb-011091fe9a3d-kolla-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.111830 5120 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/2627e341-ad91-4de8-96da-e58d58d40fb9-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.111838 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/359ce032-c698-43d8-a7eb-011091fe9a3d-config-data-default\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.111849 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5ksh5\" (UniqueName: \"kubernetes.io/projected/8a564f44-3c8d-4dff-b968-96f276382786-kube-api-access-5ksh5\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.111860 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5tbjl\" (UniqueName: \"kubernetes.io/projected/359ce032-c698-43d8-a7eb-011091fe9a3d-kube-api-access-5tbjl\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.111870 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/359ce032-c698-43d8-a7eb-011091fe9a3d-config-data-generated\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.111881 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8a564f44-3c8d-4dff-b968-96f276382786-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.111901 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") on node \"crc\" " Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.118307 5120 scope.go:117] "RemoveContainer" containerID="11c1aefb15e5a5a9d7d8ce7e51a73870631244b296d1ab3b3a8e2cb53983324c" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.118597 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5b6bb5a-fb93-4761-b995-1842090c7047-logs" (OuterVolumeSpecName: "logs") pod "e5b6bb5a-fb93-4761-b995-1842090c7047" (UID: "e5b6bb5a-fb93-4761-b995-1842090c7047"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.118625 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a9b9d92-8d3c-4366-83fb-0ea460a622d9-logs" (OuterVolumeSpecName: "logs") pod "6a9b9d92-8d3c-4366-83fb-0ea460a622d9" (UID: "6a9b9d92-8d3c-4366-83fb-0ea460a622d9"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.119824 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2627e341-ad91-4de8-96da-e58d58d40fb9-logs" (OuterVolumeSpecName: "logs") pod "2627e341-ad91-4de8-96da-e58d58d40fb9" (UID: "2627e341-ad91-4de8-96da-e58d58d40fb9"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.124632 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3abb705-1e8c-4922-a449-616479bf0721-logs" (OuterVolumeSpecName: "logs") pod "b3abb705-1e8c-4922-a449-616479bf0721" (UID: "b3abb705-1e8c-4922-a449-616479bf0721"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.128235 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.128520 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a9b9d92-8d3c-4366-83fb-0ea460a622d9-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "6a9b9d92-8d3c-4366-83fb-0ea460a622d9" (UID: "6a9b9d92-8d3c-4366-83fb-0ea460a622d9"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.135355 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5b6bb5a-fb93-4761-b995-1842090c7047-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "e5b6bb5a-fb93-4761-b995-1842090c7047" (UID: "e5b6bb5a-fb93-4761-b995-1842090c7047"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.140477 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.163549 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e5b6bb5a-fb93-4761-b995-1842090c7047-scripts" (OuterVolumeSpecName: "scripts") pod "e5b6bb5a-fb93-4761-b995-1842090c7047" (UID: "e5b6bb5a-fb93-4761-b995-1842090c7047"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.163633 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage16-crc" (OuterVolumeSpecName: "mysql-db") pod "359ce032-c698-43d8-a7eb-011091fe9a3d" (UID: "359ce032-c698-43d8-a7eb-011091fe9a3d"). InnerVolumeSpecName "local-storage16-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.166421 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.188191 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.196019 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5b6bb5a-fb93-4761-b995-1842090c7047-kube-api-access-dwmsm" (OuterVolumeSpecName: "kube-api-access-dwmsm") pod "e5b6bb5a-fb93-4761-b995-1842090c7047" (UID: "e5b6bb5a-fb93-4761-b995-1842090c7047"). InnerVolumeSpecName "kube-api-access-dwmsm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.213166 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.213570 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/adaee0e3-17f6-4f23-97c4-00bd5f6a8d6c-config-data\") pod \"adaee0e3-17f6-4f23-97c4-00bd5f6a8d6c\" (UID: \"adaee0e3-17f6-4f23-97c4-00bd5f6a8d6c\") " Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.213958 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/adaee0e3-17f6-4f23-97c4-00bd5f6a8d6c-combined-ca-bundle\") pod \"adaee0e3-17f6-4f23-97c4-00bd5f6a8d6c\" (UID: \"adaee0e3-17f6-4f23-97c4-00bd5f6a8d6c\") " Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.214261 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a564f44-3c8d-4dff-b968-96f276382786" containerName="nova-metadata-metadata" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.214275 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a564f44-3c8d-4dff-b968-96f276382786" containerName="nova-metadata-metadata" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.214288 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2627e341-ad91-4de8-96da-e58d58d40fb9" containerName="cinder-api" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.214293 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="2627e341-ad91-4de8-96da-e58d58d40fb9" containerName="cinder-api" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.214307 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a9b9d92-8d3c-4366-83fb-0ea460a622d9" containerName="glance-httpd" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.214313 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a9b9d92-8d3c-4366-83fb-0ea460a622d9" containerName="glance-httpd" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.214322 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30517467-b630-4ca2-815c-460999b6539a" containerName="mysql-bootstrap" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.214328 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="30517467-b630-4ca2-815c-460999b6539a" containerName="mysql-bootstrap" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.214336 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5b6bb5a-fb93-4761-b995-1842090c7047" containerName="glance-log" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.214341 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5b6bb5a-fb93-4761-b995-1842090c7047" containerName="glance-log" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.214351 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30517467-b630-4ca2-815c-460999b6539a" containerName="galera" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.214356 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="30517467-b630-4ca2-815c-460999b6539a" containerName="galera" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.214397 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a564f44-3c8d-4dff-b968-96f276382786" containerName="nova-metadata-log" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.214403 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a564f44-3c8d-4dff-b968-96f276382786" containerName="nova-metadata-log" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.214411 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="359ce032-c698-43d8-a7eb-011091fe9a3d" containerName="mysql-bootstrap" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.214416 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="359ce032-c698-43d8-a7eb-011091fe9a3d" containerName="mysql-bootstrap" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.214426 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5b6bb5a-fb93-4761-b995-1842090c7047" containerName="glance-httpd" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.214432 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5b6bb5a-fb93-4761-b995-1842090c7047" containerName="glance-httpd" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.214439 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="359ce032-c698-43d8-a7eb-011091fe9a3d" containerName="galera" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.214444 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="359ce032-c698-43d8-a7eb-011091fe9a3d" containerName="galera" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.214460 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a04cbe2-cde0-405c-820b-f2651d753654" containerName="nova-cell0-conductor-conductor" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.214465 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a04cbe2-cde0-405c-820b-f2651d753654" containerName="nova-cell0-conductor-conductor" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.214472 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="adaee0e3-17f6-4f23-97c4-00bd5f6a8d6c" containerName="nova-cell1-conductor-conductor" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.214479 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="adaee0e3-17f6-4f23-97c4-00bd5f6a8d6c" containerName="nova-cell1-conductor-conductor" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.214490 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3abb705-1e8c-4922-a449-616479bf0721" containerName="nova-api-api" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.214495 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3abb705-1e8c-4922-a449-616479bf0721" containerName="nova-api-api" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.214507 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2627e341-ad91-4de8-96da-e58d58d40fb9" containerName="cinder-api-log" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.214512 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="2627e341-ad91-4de8-96da-e58d58d40fb9" containerName="cinder-api-log" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.214529 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a9b9d92-8d3c-4366-83fb-0ea460a622d9" containerName="glance-log" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.214534 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a9b9d92-8d3c-4366-83fb-0ea460a622d9" containerName="glance-log" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.214547 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3abb705-1e8c-4922-a449-616479bf0721" containerName="nova-api-log" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.214552 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3abb705-1e8c-4922-a449-616479bf0721" containerName="nova-api-log" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.214550 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pwwlm\" (UniqueName: \"kubernetes.io/projected/adaee0e3-17f6-4f23-97c4-00bd5f6a8d6c-kube-api-access-pwwlm\") pod \"adaee0e3-17f6-4f23-97c4-00bd5f6a8d6c\" (UID: \"adaee0e3-17f6-4f23-97c4-00bd5f6a8d6c\") " Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.214707 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="8a564f44-3c8d-4dff-b968-96f276382786" containerName="nova-metadata-metadata" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.214719 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="359ce032-c698-43d8-a7eb-011091fe9a3d" containerName="galera" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.214725 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="2627e341-ad91-4de8-96da-e58d58d40fb9" containerName="cinder-api-log" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.214732 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="8a04cbe2-cde0-405c-820b-f2651d753654" containerName="nova-cell0-conductor-conductor" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.214767 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e5b6bb5a-fb93-4761-b995-1842090c7047" containerName="glance-httpd" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.214782 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="b3abb705-1e8c-4922-a449-616479bf0721" containerName="nova-api-log" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.214793 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="adaee0e3-17f6-4f23-97c4-00bd5f6a8d6c" containerName="nova-cell1-conductor-conductor" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.214804 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e5b6bb5a-fb93-4761-b995-1842090c7047" containerName="glance-log" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.214812 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="6a9b9d92-8d3c-4366-83fb-0ea460a622d9" containerName="glance-httpd" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.214822 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="b3abb705-1e8c-4922-a449-616479bf0721" containerName="nova-api-api" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.214832 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="6a9b9d92-8d3c-4366-83fb-0ea460a622d9" containerName="glance-log" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.214845 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="2627e341-ad91-4de8-96da-e58d58d40fb9" containerName="cinder-api" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.214853 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="30517467-b630-4ca2-815c-460999b6539a" containerName="galera" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.214861 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="8a564f44-3c8d-4dff-b968-96f276382786" containerName="nova-metadata-log" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.215438 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e5b6bb5a-fb93-4761-b995-1842090c7047-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.215456 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2627e341-ad91-4de8-96da-e58d58d40fb9-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.215465 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b3abb705-1e8c-4922-a449-616479bf0721-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.215474 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dwmsm\" (UniqueName: \"kubernetes.io/projected/e5b6bb5a-fb93-4761-b995-1842090c7047-kube-api-access-dwmsm\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.215495 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") on node \"crc\" " Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.215504 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6a9b9d92-8d3c-4366-83fb-0ea460a622d9-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.215512 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e5b6bb5a-fb93-4761-b995-1842090c7047-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.215523 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/e5b6bb5a-fb93-4761-b995-1842090c7047-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.215532 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/6a9b9d92-8d3c-4366-83fb-0ea460a622d9-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.216179 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2627e341-ad91-4de8-96da-e58d58d40fb9-scripts" (OuterVolumeSpecName: "scripts") pod "2627e341-ad91-4de8-96da-e58d58d40fb9" (UID: "2627e341-ad91-4de8-96da-e58d58d40fb9"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.216248 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3abb705-1e8c-4922-a449-616479bf0721-kube-api-access-9vfxc" (OuterVolumeSpecName: "kube-api-access-9vfxc") pod "b3abb705-1e8c-4922-a449-616479bf0721" (UID: "b3abb705-1e8c-4922-a449-616479bf0721"). InnerVolumeSpecName "kube-api-access-9vfxc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.216263 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2627e341-ad91-4de8-96da-e58d58d40fb9-kube-api-access-74k2c" (OuterVolumeSpecName: "kube-api-access-74k2c") pod "2627e341-ad91-4de8-96da-e58d58d40fb9" (UID: "2627e341-ad91-4de8-96da-e58d58d40fb9"). InnerVolumeSpecName "kube-api-access-74k2c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.216490 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a9b9d92-8d3c-4366-83fb-0ea460a622d9-scripts" (OuterVolumeSpecName: "scripts") pod "6a9b9d92-8d3c-4366-83fb-0ea460a622d9" (UID: "6a9b9d92-8d3c-4366-83fb-0ea460a622d9"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.216631 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a9b9d92-8d3c-4366-83fb-0ea460a622d9-kube-api-access-gdxqr" (OuterVolumeSpecName: "kube-api-access-gdxqr") pod "6a9b9d92-8d3c-4366-83fb-0ea460a622d9" (UID: "6a9b9d92-8d3c-4366-83fb-0ea460a622d9"). InnerVolumeSpecName "kube-api-access-gdxqr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.218272 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage02-crc" (OuterVolumeSpecName: "glance") pod "6a9b9d92-8d3c-4366-83fb-0ea460a622d9" (UID: "6a9b9d92-8d3c-4366-83fb-0ea460a622d9"). InnerVolumeSpecName "local-storage02-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.218290 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage01-crc" (OuterVolumeSpecName: "glance") pod "e5b6bb5a-fb93-4761-b995-1842090c7047" (UID: "e5b6bb5a-fb93-4761-b995-1842090c7047"). InnerVolumeSpecName "local-storage01-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.233148 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.233786 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.235971 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-novncproxy-cell1-public-svc\"" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.236249 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-novncproxy-config-data\"" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.239472 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-novncproxy-cell1-vencrypt\"" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.241237 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2627e341-ad91-4de8-96da-e58d58d40fb9-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "2627e341-ad91-4de8-96da-e58d58d40fb9" (UID: "2627e341-ad91-4de8-96da-e58d58d40fb9"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.243112 5120 scope.go:117] "RemoveContainer" containerID="609de6baddc7fc53ce05c0d9ebc736f4466bffcd372ef8e11b45d04f5a528f5f" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.243299 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.246413 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/adaee0e3-17f6-4f23-97c4-00bd5f6a8d6c-kube-api-access-pwwlm" (OuterVolumeSpecName: "kube-api-access-pwwlm") pod "adaee0e3-17f6-4f23-97c4-00bd5f6a8d6c" (UID: "adaee0e3-17f6-4f23-97c4-00bd5f6a8d6c"). InnerVolumeSpecName "kube-api-access-pwwlm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.287268 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.287446 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.290053 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-scheduler-config-data\"" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.292505 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-5f687f46f5-qdrk5"] Mar 16 16:52:49 crc kubenswrapper[5120]: W0316 16:52:49.294363 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda5396fe3_454e_4707_b185_5ad652c091da.slice/crio-be7955c879196f7927192774b52896d6e3a3e49e67d75e0b1bbe507f4d08fbc9 WatchSource:0}: Error finding container be7955c879196f7927192774b52896d6e3a3e49e67d75e0b1bbe507f4d08fbc9: Status 404 returned error can't find the container with id be7955c879196f7927192774b52896d6e3a3e49e67d75e0b1bbe507f4d08fbc9 Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.335113 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/18e2f22a-0bc1-4514-afe4-56bdf5cb1670-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"18e2f22a-0bc1-4514-afe4-56bdf5cb1670\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.335265 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tkrl\" (UniqueName: \"kubernetes.io/projected/18e2f22a-0bc1-4514-afe4-56bdf5cb1670-kube-api-access-9tkrl\") pod \"nova-cell1-novncproxy-0\" (UID: \"18e2f22a-0bc1-4514-afe4-56bdf5cb1670\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.335804 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/18e2f22a-0bc1-4514-afe4-56bdf5cb1670-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"18e2f22a-0bc1-4514-afe4-56bdf5cb1670\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.336147 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/18e2f22a-0bc1-4514-afe4-56bdf5cb1670-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"18e2f22a-0bc1-4514-afe4-56bdf5cb1670\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.336258 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/18e2f22a-0bc1-4514-afe4-56bdf5cb1670-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"18e2f22a-0bc1-4514-afe4-56bdf5cb1670\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.336415 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pwwlm\" (UniqueName: \"kubernetes.io/projected/adaee0e3-17f6-4f23-97c4-00bd5f6a8d6c-kube-api-access-pwwlm\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.336476 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9vfxc\" (UniqueName: \"kubernetes.io/projected/b3abb705-1e8c-4922-a449-616479bf0721-kube-api-access-9vfxc\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.336540 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") on node \"crc\" " Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.336601 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-74k2c\" (UniqueName: \"kubernetes.io/projected/2627e341-ad91-4de8-96da-e58d58d40fb9-kube-api-access-74k2c\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.336659 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2627e341-ad91-4de8-96da-e58d58d40fb9-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.336721 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6a9b9d92-8d3c-4366-83fb-0ea460a622d9-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.336820 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") on node \"crc\" " Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.336879 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/2627e341-ad91-4de8-96da-e58d58d40fb9-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.336934 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gdxqr\" (UniqueName: \"kubernetes.io/projected/6a9b9d92-8d3c-4366-83fb-0ea460a622d9-kube-api-access-gdxqr\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.470104 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/18e2f22a-0bc1-4514-afe4-56bdf5cb1670-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"18e2f22a-0bc1-4514-afe4-56bdf5cb1670\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.470208 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/18e2f22a-0bc1-4514-afe4-56bdf5cb1670-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"18e2f22a-0bc1-4514-afe4-56bdf5cb1670\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.470249 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvlwp\" (UniqueName: \"kubernetes.io/projected/b91a9930-eec4-4af5-9aee-5d02dc78fabc-kube-api-access-zvlwp\") pod \"cinder-scheduler-0\" (UID: \"b91a9930-eec4-4af5-9aee-5d02dc78fabc\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.470313 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/18e2f22a-0bc1-4514-afe4-56bdf5cb1670-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"18e2f22a-0bc1-4514-afe4-56bdf5cb1670\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.470469 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9tkrl\" (UniqueName: \"kubernetes.io/projected/18e2f22a-0bc1-4514-afe4-56bdf5cb1670-kube-api-access-9tkrl\") pod \"nova-cell1-novncproxy-0\" (UID: \"18e2f22a-0bc1-4514-afe4-56bdf5cb1670\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.470574 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b91a9930-eec4-4af5-9aee-5d02dc78fabc-config-data\") pod \"cinder-scheduler-0\" (UID: \"b91a9930-eec4-4af5-9aee-5d02dc78fabc\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.470752 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b91a9930-eec4-4af5-9aee-5d02dc78fabc-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"b91a9930-eec4-4af5-9aee-5d02dc78fabc\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.470884 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b91a9930-eec4-4af5-9aee-5d02dc78fabc-scripts\") pod \"cinder-scheduler-0\" (UID: \"b91a9930-eec4-4af5-9aee-5d02dc78fabc\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.470940 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/b91a9930-eec4-4af5-9aee-5d02dc78fabc-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"b91a9930-eec4-4af5-9aee-5d02dc78fabc\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.471106 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/b91a9930-eec4-4af5-9aee-5d02dc78fabc-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"b91a9930-eec4-4af5-9aee-5d02dc78fabc\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.471164 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/18e2f22a-0bc1-4514-afe4-56bdf5cb1670-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"18e2f22a-0bc1-4514-afe4-56bdf5cb1670\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.496425 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/18e2f22a-0bc1-4514-afe4-56bdf5cb1670-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"18e2f22a-0bc1-4514-afe4-56bdf5cb1670\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.507446 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/18e2f22a-0bc1-4514-afe4-56bdf5cb1670-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"18e2f22a-0bc1-4514-afe4-56bdf5cb1670\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.511300 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tkrl\" (UniqueName: \"kubernetes.io/projected/18e2f22a-0bc1-4514-afe4-56bdf5cb1670-kube-api-access-9tkrl\") pod \"nova-cell1-novncproxy-0\" (UID: \"18e2f22a-0bc1-4514-afe4-56bdf5cb1670\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.511394 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/18e2f22a-0bc1-4514-afe4-56bdf5cb1670-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"18e2f22a-0bc1-4514-afe4-56bdf5cb1670\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.513618 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/18e2f22a-0bc1-4514-afe4-56bdf5cb1670-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"18e2f22a-0bc1-4514-afe4-56bdf5cb1670\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.577277 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zvlwp\" (UniqueName: \"kubernetes.io/projected/b91a9930-eec4-4af5-9aee-5d02dc78fabc-kube-api-access-zvlwp\") pod \"cinder-scheduler-0\" (UID: \"b91a9930-eec4-4af5-9aee-5d02dc78fabc\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.577439 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b91a9930-eec4-4af5-9aee-5d02dc78fabc-config-data\") pod \"cinder-scheduler-0\" (UID: \"b91a9930-eec4-4af5-9aee-5d02dc78fabc\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.577534 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b91a9930-eec4-4af5-9aee-5d02dc78fabc-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"b91a9930-eec4-4af5-9aee-5d02dc78fabc\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.577595 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b91a9930-eec4-4af5-9aee-5d02dc78fabc-scripts\") pod \"cinder-scheduler-0\" (UID: \"b91a9930-eec4-4af5-9aee-5d02dc78fabc\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.577630 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/b91a9930-eec4-4af5-9aee-5d02dc78fabc-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"b91a9930-eec4-4af5-9aee-5d02dc78fabc\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.577710 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/b91a9930-eec4-4af5-9aee-5d02dc78fabc-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"b91a9930-eec4-4af5-9aee-5d02dc78fabc\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.579589 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/b91a9930-eec4-4af5-9aee-5d02dc78fabc-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"b91a9930-eec4-4af5-9aee-5d02dc78fabc\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.601779 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b91a9930-eec4-4af5-9aee-5d02dc78fabc-config-data\") pod \"cinder-scheduler-0\" (UID: \"b91a9930-eec4-4af5-9aee-5d02dc78fabc\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.602274 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvlwp\" (UniqueName: \"kubernetes.io/projected/b91a9930-eec4-4af5-9aee-5d02dc78fabc-kube-api-access-zvlwp\") pod \"cinder-scheduler-0\" (UID: \"b91a9930-eec4-4af5-9aee-5d02dc78fabc\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.607342 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b91a9930-eec4-4af5-9aee-5d02dc78fabc-scripts\") pod \"cinder-scheduler-0\" (UID: \"b91a9930-eec4-4af5-9aee-5d02dc78fabc\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.607878 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/b91a9930-eec4-4af5-9aee-5d02dc78fabc-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"b91a9930-eec4-4af5-9aee-5d02dc78fabc\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.608677 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b91a9930-eec4-4af5-9aee-5d02dc78fabc-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"b91a9930-eec4-4af5-9aee-5d02dc78fabc\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.739281 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage16-crc" (UniqueName: "kubernetes.io/local-volume/local-storage16-crc") on node "crc" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.741741 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-7f78b864cb-6dgjh"] Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.783773 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.791623 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage14-crc" (UniqueName: "kubernetes.io/local-volume/local-storage14-crc") on node "crc" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.824781 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage02-crc" (UniqueName: "kubernetes.io/local-volume/local-storage02-crc") on node "crc" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.832328 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage01-crc" (UniqueName: "kubernetes.io/local-volume/local-storage01-crc") on node "crc" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.885953 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.885992 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.886002 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.889505 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 16:52:49 crc kubenswrapper[5120]: W0316 16:52:49.890512 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod18684823_3972_4cf6_8e42_792360b387bb.slice/crio-2565939eb23b5b631e3c1f1221225fa9c74e1f8026e97fe9032352ec781092ee WatchSource:0}: Error finding container 2565939eb23b5b631e3c1f1221225fa9c74e1f8026e97fe9032352ec781092ee: Status 404 returned error can't find the container with id 2565939eb23b5b631e3c1f1221225fa9c74e1f8026e97fe9032352ec781092ee Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.923720 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstackclient" event={"ID":"74ab0944-2f5c-4a9d-a848-8e2a8d17d9cd","Type":"ContainerStarted","Data":"c66e427fd88f88ad048e67d49836dce5591eefc18c9879eaec88a4f93093cca2"} Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.926499 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-7f78b864cb-6dgjh" event={"ID":"c06f24f9-95b0-4a92-ad3a-6075764151ed","Type":"ContainerStarted","Data":"fb7386c55c78681a2e07341fb97c2dc48901c61c310c18f7f94e1c781a2a5a7f"} Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.932634 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"adaee0e3-17f6-4f23-97c4-00bd5f6a8d6c","Type":"ContainerDied","Data":"4d9d8144ea52793dbcee152726e18d4789bb3b79df22d6e3cef138eb8d397405"} Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.933266 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.935281 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"18684823-3972-4cf6-8e42-792360b387bb","Type":"ContainerStarted","Data":"2565939eb23b5b631e3c1f1221225fa9c74e1f8026e97fe9032352ec781092ee"} Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.943381 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"2627e341-ad91-4de8-96da-e58d58d40fb9","Type":"ContainerDied","Data":"5f14ed12598e2a07b42260232a28c704797737412d8121a472e05a19630e5fca"} Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.943545 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.949291 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-5f687f46f5-qdrk5" event={"ID":"a5396fe3-454e-4707-b185-5ad652c091da","Type":"ContainerStarted","Data":"be7955c879196f7927192774b52896d6e3a3e49e67d75e0b1bbe507f4d08fbc9"} Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.973195 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-646d48c554-kk5ms" event={"ID":"fa4601ff-7ef6-4d2c-b0ca-b153763db12f","Type":"ContainerStarted","Data":"94f0f9d5ef7a9a1aa550cca1ce3c48dbb4ad2a4bfe3df33e0e300fede864cd03"} Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.976998 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstackclient" podStartSLOduration=7.97697905 podStartE2EDuration="7.97697905s" podCreationTimestamp="2026-03-16 16:52:42 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:52:49.953551348 +0000 UTC m=+4872.107483005" watchObservedRunningTime="2026-03-16 16:52:49.97697905 +0000 UTC m=+4872.130910707" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.981729 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/adaee0e3-17f6-4f23-97c4-00bd5f6a8d6c-config-data" (OuterVolumeSpecName: "config-data") pod "adaee0e3-17f6-4f23-97c4-00bd5f6a8d6c" (UID: "adaee0e3-17f6-4f23-97c4-00bd5f6a8d6c"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.983431 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-786c646546-49lhr" event={"ID":"a7564ece-3e31-426b-a07b-1b9e12d76d01","Type":"ContainerStarted","Data":"e7a9453dd3686f237314323dbfa581ff64f6a12f3d9c911a9d967ff2c6214631"} Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.989589 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/adaee0e3-17f6-4f23-97c4-00bd5f6a8d6c-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.994897 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-5964c9d8c-plh78" event={"ID":"d6db354d-c48c-4497-a289-18edadffce47","Type":"ContainerStarted","Data":"92292c523d4b4d250cef5eb000fa5d04e4e544218bdca4cbd993e7670963057a"} Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.995060 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-5964c9d8c-plh78" podUID="d6db354d-c48c-4497-a289-18edadffce47" containerName="barbican-worker-log" containerID="cri-o://97576e939ebce6bd9c9a57e020240747714a03086d075e2f102f522a8e9ab0ec" gracePeriod=30 Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.995709 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-5964c9d8c-plh78" podUID="d6db354d-c48c-4497-a289-18edadffce47" containerName="barbican-worker" containerID="cri-o://92292c523d4b4d250cef5eb000fa5d04e4e544218bdca4cbd993e7670963057a" gracePeriod=30 Mar 16 16:52:49 crc kubenswrapper[5120]: I0316 16:52:49.996112 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-69d57497c4-7bhm5"] Mar 16 16:52:50 crc kubenswrapper[5120]: I0316 16:52:50.005495 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:52:50 crc kubenswrapper[5120]: I0316 16:52:50.005968 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-7bf49bf568-fbg2k" event={"ID":"c846d2b2-0638-44bd-9ad0-6b6c76f8d16f","Type":"ContainerStarted","Data":"230653dbcfd778943f6ddd417a12dd48b5680b4e4b96b18fd7d3385ba610e6c3"} Mar 16 16:52:50 crc kubenswrapper[5120]: I0316 16:52:50.006035 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:52:50 crc kubenswrapper[5120]: I0316 16:52:50.006605 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:52:50 crc kubenswrapper[5120]: I0316 16:52:50.006748 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:52:50 crc kubenswrapper[5120]: I0316 16:52:50.006904 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:52:50 crc kubenswrapper[5120]: I0316 16:52:50.007032 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:52:50 crc kubenswrapper[5120]: I0316 16:52:50.007172 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:52:50 crc kubenswrapper[5120]: I0316 16:52:50.007777 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 16:52:50 crc kubenswrapper[5120]: I0316 16:52:50.017824 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-worker-5964c9d8c-plh78" podStartSLOduration=8.017805527 podStartE2EDuration="8.017805527s" podCreationTimestamp="2026-03-16 16:52:42 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:52:50.014570199 +0000 UTC m=+4872.168502116" watchObservedRunningTime="2026-03-16 16:52:50.017805527 +0000 UTC m=+4872.171737184" Mar 16 16:52:50 crc kubenswrapper[5120]: I0316 16:52:50.037128 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a04cbe2-cde0-405c-820b-f2651d753654-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "8a04cbe2-cde0-405c-820b-f2651d753654" (UID: "8a04cbe2-cde0-405c-820b-f2651d753654"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:52:50 crc kubenswrapper[5120]: I0316 16:52:50.092892 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8a04cbe2-cde0-405c-820b-f2651d753654-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:50 crc kubenswrapper[5120]: I0316 16:52:50.107025 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/30517467-b630-4ca2-815c-460999b6539a-galera-tls-certs" (OuterVolumeSpecName: "galera-tls-certs") pod "30517467-b630-4ca2-815c-460999b6539a" (UID: "30517467-b630-4ca2-815c-460999b6539a"). InnerVolumeSpecName "galera-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:52:50 crc kubenswrapper[5120]: I0316 16:52:50.109014 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a04cbe2-cde0-405c-820b-f2651d753654-config-data" (OuterVolumeSpecName: "config-data") pod "8a04cbe2-cde0-405c-820b-f2651d753654" (UID: "8a04cbe2-cde0-405c-820b-f2651d753654"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:52:50 crc kubenswrapper[5120]: W0316 16:52:50.114387 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod986cfe2c_03bb_4027_b930_79c5b3dd8fe4.slice/crio-6bcf9fcfa6fdb73227a7682ce12b9429dee0a0dee021ac8f4b9339538680beba WatchSource:0}: Error finding container 6bcf9fcfa6fdb73227a7682ce12b9429dee0a0dee021ac8f4b9339538680beba: Status 404 returned error can't find the container with id 6bcf9fcfa6fdb73227a7682ce12b9429dee0a0dee021ac8f4b9339538680beba Mar 16 16:52:50 crc kubenswrapper[5120]: I0316 16:52:50.125243 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2627e341-ad91-4de8-96da-e58d58d40fb9-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "2627e341-ad91-4de8-96da-e58d58d40fb9" (UID: "2627e341-ad91-4de8-96da-e58d58d40fb9"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:52:50 crc kubenswrapper[5120]: I0316 16:52:50.126951 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b3abb705-1e8c-4922-a449-616479bf0721-config-data" (OuterVolumeSpecName: "config-data") pod "b3abb705-1e8c-4922-a449-616479bf0721" (UID: "b3abb705-1e8c-4922-a449-616479bf0721"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:52:50 crc kubenswrapper[5120]: I0316 16:52:50.135084 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a564f44-3c8d-4dff-b968-96f276382786-config-data" (OuterVolumeSpecName: "config-data") pod "8a564f44-3c8d-4dff-b968-96f276382786" (UID: "8a564f44-3c8d-4dff-b968-96f276382786"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:52:50 crc kubenswrapper[5120]: I0316 16:52:50.182084 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/30517467-b630-4ca2-815c-460999b6539a-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "30517467-b630-4ca2-815c-460999b6539a" (UID: "30517467-b630-4ca2-815c-460999b6539a"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:52:50 crc kubenswrapper[5120]: I0316 16:52:50.182992 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a564f44-3c8d-4dff-b968-96f276382786-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "8a564f44-3c8d-4dff-b968-96f276382786" (UID: "8a564f44-3c8d-4dff-b968-96f276382786"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:52:50 crc kubenswrapper[5120]: I0316 16:52:50.196149 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/30517467-b630-4ca2-815c-460999b6539a-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:50 crc kubenswrapper[5120]: I0316 16:52:50.196184 5120 reconciler_common.go:299] "Volume detached for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/30517467-b630-4ca2-815c-460999b6539a-galera-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:50 crc kubenswrapper[5120]: I0316 16:52:50.196194 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b3abb705-1e8c-4922-a449-616479bf0721-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:50 crc kubenswrapper[5120]: I0316 16:52:50.196205 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8a564f44-3c8d-4dff-b968-96f276382786-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:50 crc kubenswrapper[5120]: I0316 16:52:50.196216 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8a04cbe2-cde0-405c-820b-f2651d753654-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:50 crc kubenswrapper[5120]: I0316 16:52:50.196228 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8a564f44-3c8d-4dff-b968-96f276382786-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:50 crc kubenswrapper[5120]: I0316 16:52:50.196239 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/2627e341-ad91-4de8-96da-e58d58d40fb9-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:50 crc kubenswrapper[5120]: I0316 16:52:50.200412 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/359ce032-c698-43d8-a7eb-011091fe9a3d-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "359ce032-c698-43d8-a7eb-011091fe9a3d" (UID: "359ce032-c698-43d8-a7eb-011091fe9a3d"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:52:50 crc kubenswrapper[5120]: I0316 16:52:50.239609 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e5b6bb5a-fb93-4761-b995-1842090c7047-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e5b6bb5a-fb93-4761-b995-1842090c7047" (UID: "e5b6bb5a-fb93-4761-b995-1842090c7047"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:52:50 crc kubenswrapper[5120]: I0316 16:52:50.241131 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a9b9d92-8d3c-4366-83fb-0ea460a622d9-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "6a9b9d92-8d3c-4366-83fb-0ea460a622d9" (UID: "6a9b9d92-8d3c-4366-83fb-0ea460a622d9"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:52:50 crc kubenswrapper[5120]: I0316 16:52:50.254607 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b3abb705-1e8c-4922-a449-616479bf0721-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "b3abb705-1e8c-4922-a449-616479bf0721" (UID: "b3abb705-1e8c-4922-a449-616479bf0721"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:52:50 crc kubenswrapper[5120]: I0316 16:52:50.262049 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b3abb705-1e8c-4922-a449-616479bf0721-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "b3abb705-1e8c-4922-a449-616479bf0721" (UID: "b3abb705-1e8c-4922-a449-616479bf0721"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:52:50 crc kubenswrapper[5120]: I0316 16:52:50.265818 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2627e341-ad91-4de8-96da-e58d58d40fb9-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "2627e341-ad91-4de8-96da-e58d58d40fb9" (UID: "2627e341-ad91-4de8-96da-e58d58d40fb9"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:52:50 crc kubenswrapper[5120]: I0316 16:52:50.287692 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/adaee0e3-17f6-4f23-97c4-00bd5f6a8d6c-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "adaee0e3-17f6-4f23-97c4-00bd5f6a8d6c" (UID: "adaee0e3-17f6-4f23-97c4-00bd5f6a8d6c"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:52:50 crc kubenswrapper[5120]: I0316 16:52:50.290272 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e5b6bb5a-fb93-4761-b995-1842090c7047-config-data" (OuterVolumeSpecName: "config-data") pod "e5b6bb5a-fb93-4761-b995-1842090c7047" (UID: "e5b6bb5a-fb93-4761-b995-1842090c7047"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:52:50 crc kubenswrapper[5120]: I0316 16:52:50.293930 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e5b6bb5a-fb93-4761-b995-1842090c7047-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "e5b6bb5a-fb93-4761-b995-1842090c7047" (UID: "e5b6bb5a-fb93-4761-b995-1842090c7047"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:52:50 crc kubenswrapper[5120]: I0316 16:52:50.299229 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b3abb705-1e8c-4922-a449-616479bf0721-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:50 crc kubenswrapper[5120]: I0316 16:52:50.299275 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e5b6bb5a-fb93-4761-b995-1842090c7047-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:50 crc kubenswrapper[5120]: I0316 16:52:50.299285 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/359ce032-c698-43d8-a7eb-011091fe9a3d-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:50 crc kubenswrapper[5120]: I0316 16:52:50.299296 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e5b6bb5a-fb93-4761-b995-1842090c7047-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:50 crc kubenswrapper[5120]: I0316 16:52:50.299310 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2627e341-ad91-4de8-96da-e58d58d40fb9-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:50 crc kubenswrapper[5120]: I0316 16:52:50.299320 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/adaee0e3-17f6-4f23-97c4-00bd5f6a8d6c-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:50 crc kubenswrapper[5120]: I0316 16:52:50.299331 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/b3abb705-1e8c-4922-a449-616479bf0721-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:50 crc kubenswrapper[5120]: I0316 16:52:50.299342 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e5b6bb5a-fb93-4761-b995-1842090c7047-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:50 crc kubenswrapper[5120]: I0316 16:52:50.299352 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6a9b9d92-8d3c-4366-83fb-0ea460a622d9-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:50 crc kubenswrapper[5120]: I0316 16:52:50.301433 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2627e341-ad91-4de8-96da-e58d58d40fb9-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "2627e341-ad91-4de8-96da-e58d58d40fb9" (UID: "2627e341-ad91-4de8-96da-e58d58d40fb9"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:52:50 crc kubenswrapper[5120]: I0316 16:52:50.339932 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a9b9d92-8d3c-4366-83fb-0ea460a622d9-config-data" (OuterVolumeSpecName: "config-data") pod "6a9b9d92-8d3c-4366-83fb-0ea460a622d9" (UID: "6a9b9d92-8d3c-4366-83fb-0ea460a622d9"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:52:50 crc kubenswrapper[5120]: I0316 16:52:50.350230 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a9b9d92-8d3c-4366-83fb-0ea460a622d9-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "6a9b9d92-8d3c-4366-83fb-0ea460a622d9" (UID: "6a9b9d92-8d3c-4366-83fb-0ea460a622d9"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:52:50 crc kubenswrapper[5120]: I0316 16:52:50.352436 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2627e341-ad91-4de8-96da-e58d58d40fb9-config-data" (OuterVolumeSpecName: "config-data") pod "2627e341-ad91-4de8-96da-e58d58d40fb9" (UID: "2627e341-ad91-4de8-96da-e58d58d40fb9"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:52:50 crc kubenswrapper[5120]: I0316 16:52:50.358830 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/359ce032-c698-43d8-a7eb-011091fe9a3d-galera-tls-certs" (OuterVolumeSpecName: "galera-tls-certs") pod "359ce032-c698-43d8-a7eb-011091fe9a3d" (UID: "359ce032-c698-43d8-a7eb-011091fe9a3d"). InnerVolumeSpecName "galera-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:52:50 crc kubenswrapper[5120]: I0316 16:52:50.361480 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b3abb705-1e8c-4922-a449-616479bf0721-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "b3abb705-1e8c-4922-a449-616479bf0721" (UID: "b3abb705-1e8c-4922-a449-616479bf0721"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:52:50 crc kubenswrapper[5120]: I0316 16:52:50.383166 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a564f44-3c8d-4dff-b968-96f276382786-nova-metadata-tls-certs" (OuterVolumeSpecName: "nova-metadata-tls-certs") pod "8a564f44-3c8d-4dff-b968-96f276382786" (UID: "8a564f44-3c8d-4dff-b968-96f276382786"). InnerVolumeSpecName "nova-metadata-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:52:50 crc kubenswrapper[5120]: I0316 16:52:50.406511 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/2627e341-ad91-4de8-96da-e58d58d40fb9-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:50 crc kubenswrapper[5120]: I0316 16:52:50.406548 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/b3abb705-1e8c-4922-a449-616479bf0721-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:50 crc kubenswrapper[5120]: I0316 16:52:50.406558 5120 reconciler_common.go:299] "Volume detached for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/8a564f44-3c8d-4dff-b968-96f276382786-nova-metadata-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:50 crc kubenswrapper[5120]: I0316 16:52:50.406571 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6a9b9d92-8d3c-4366-83fb-0ea460a622d9-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:50 crc kubenswrapper[5120]: I0316 16:52:50.406601 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6a9b9d92-8d3c-4366-83fb-0ea460a622d9-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:50 crc kubenswrapper[5120]: I0316 16:52:50.406612 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2627e341-ad91-4de8-96da-e58d58d40fb9-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:50 crc kubenswrapper[5120]: I0316 16:52:50.406620 5120 reconciler_common.go:299] "Volume detached for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/359ce032-c698-43d8-a7eb-011091fe9a3d-galera-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:50 crc kubenswrapper[5120]: I0316 16:52:50.600948 5120 scope.go:117] "RemoveContainer" containerID="b19b1f7b89a52c3fd792809f8a1745634a6cda441d9b359b08e17e40288842ce" Mar 16 16:52:50 crc kubenswrapper[5120]: I0316 16:52:50.667535 5120 scope.go:117] "RemoveContainer" containerID="40c9d0ca2040ab594fed757bb25e8a4e0800b5d718f67c29748ee6caecf34c93" Mar 16 16:52:50 crc kubenswrapper[5120]: I0316 16:52:50.686887 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f5ce683-1975-46fb-ab27-2e4888748b7b" path="/var/lib/kubelet/pods/9f5ce683-1975-46fb-ab27-2e4888748b7b/volumes" Mar 16 16:52:50 crc kubenswrapper[5120]: I0316 16:52:50.687832 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c186765a-7323-4f11-ac91-6c1ab1f2ac4f" path="/var/lib/kubelet/pods/c186765a-7323-4f11-ac91-6c1ab1f2ac4f/volumes" Mar 16 16:52:50 crc kubenswrapper[5120]: I0316 16:52:50.725439 5120 scope.go:117] "RemoveContainer" containerID="770161b1964e36563527a816a1285b36148767c3e13625debfcd5d6fee0b59b8" Mar 16 16:52:50 crc kubenswrapper[5120]: I0316 16:52:50.931904 5120 scope.go:117] "RemoveContainer" containerID="e57a4c9ac68cdf613fab20d09b18fbc7abe70575a805ef23da6a7c2bb2219851" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.013119 5120 scope.go:117] "RemoveContainer" containerID="413ac662c0970f63340ee428f2ce77c5b13deb609b8adfca801cfa11779825e7" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.034396 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.041674 5120 scope.go:117] "RemoveContainer" containerID="b20277c633e0b78465cbdd8b3094afe9e4fc50b2aa342ab3382ce2a06551927f" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.045220 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-57f7845c4b-tb6nd" event={"ID":"ffa2d14d-1b44-445b-ab47-1bb134223111","Type":"ContainerStarted","Data":"c1dd20bf9d5fa639b2879a8a31ac5f271715ba78f8066f88de902d4b35a4ff21"} Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.045399 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/keystone-57f7845c4b-tb6nd" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.074535 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-d7c95f898-g5nln" event={"ID":"ebceb235-ad03-49fd-9921-f5be8c1851be","Type":"ContainerStarted","Data":"b24f04e9b859c0e1ed187c680ab8fe6ea7ce43f2fdccb344c3d429c318b3a988"} Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.126646 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-57f7845c4b-tb6nd" podStartSLOduration=8.126621336 podStartE2EDuration="8.126621336s" podCreationTimestamp="2026-03-16 16:52:43 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:52:51.091490625 +0000 UTC m=+4873.245422282" watchObservedRunningTime="2026-03-16 16:52:51.126621336 +0000 UTC m=+4873.280552993" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.138707 5120 generic.go:358] "Generic (PLEG): container finished" podID="d6db354d-c48c-4497-a289-18edadffce47" containerID="97576e939ebce6bd9c9a57e020240747714a03086d075e2f102f522a8e9ab0ec" exitCode=143 Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.138877 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-5964c9d8c-plh78" event={"ID":"d6db354d-c48c-4497-a289-18edadffce47","Type":"ContainerDied","Data":"97576e939ebce6bd9c9a57e020240747714a03086d075e2f102f522a8e9ab0ec"} Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.141226 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-69d57497c4-7bhm5" event={"ID":"f9a4fc77-147c-46f7-a4de-e36f3086b09b","Type":"ContainerStarted","Data":"ed301e419aa7a47f5f5161bdd605f5d6e745f1b34c6ddc110a8a1cb5d67cc2dc"} Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.142176 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7e017064-86c6-413e-b003-2f5df3306952-combined-ca-bundle\") pod \"7e017064-86c6-413e-b003-2f5df3306952\" (UID: \"7e017064-86c6-413e-b003-2f5df3306952\") " Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.142220 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7e017064-86c6-413e-b003-2f5df3306952-run-httpd\") pod \"7e017064-86c6-413e-b003-2f5df3306952\" (UID: \"7e017064-86c6-413e-b003-2f5df3306952\") " Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.142426 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7e017064-86c6-413e-b003-2f5df3306952-log-httpd\") pod \"7e017064-86c6-413e-b003-2f5df3306952\" (UID: \"7e017064-86c6-413e-b003-2f5df3306952\") " Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.142542 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4bdr9\" (UniqueName: \"kubernetes.io/projected/7e017064-86c6-413e-b003-2f5df3306952-kube-api-access-4bdr9\") pod \"7e017064-86c6-413e-b003-2f5df3306952\" (UID: \"7e017064-86c6-413e-b003-2f5df3306952\") " Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.142695 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/7e017064-86c6-413e-b003-2f5df3306952-ceilometer-tls-certs\") pod \"7e017064-86c6-413e-b003-2f5df3306952\" (UID: \"7e017064-86c6-413e-b003-2f5df3306952\") " Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.142780 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7e017064-86c6-413e-b003-2f5df3306952-config-data\") pod \"7e017064-86c6-413e-b003-2f5df3306952\" (UID: \"7e017064-86c6-413e-b003-2f5df3306952\") " Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.142879 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7e017064-86c6-413e-b003-2f5df3306952-scripts\") pod \"7e017064-86c6-413e-b003-2f5df3306952\" (UID: \"7e017064-86c6-413e-b003-2f5df3306952\") " Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.142959 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/7e017064-86c6-413e-b003-2f5df3306952-sg-core-conf-yaml\") pod \"7e017064-86c6-413e-b003-2f5df3306952\" (UID: \"7e017064-86c6-413e-b003-2f5df3306952\") " Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.146398 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e017064-86c6-413e-b003-2f5df3306952-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "7e017064-86c6-413e-b003-2f5df3306952" (UID: "7e017064-86c6-413e-b003-2f5df3306952"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.146957 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e017064-86c6-413e-b003-2f5df3306952-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "7e017064-86c6-413e-b003-2f5df3306952" (UID: "7e017064-86c6-413e-b003-2f5df3306952"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.147020 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"986cfe2c-03bb-4027-b930-79c5b3dd8fe4","Type":"ContainerStarted","Data":"6bcf9fcfa6fdb73227a7682ce12b9429dee0a0dee021ac8f4b9339538680beba"} Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.162043 5120 generic.go:358] "Generic (PLEG): container finished" podID="7e017064-86c6-413e-b003-2f5df3306952" containerID="0cf2639ccd5dcff044d74634742ba674b06691c33be27480bff7ec2d5a0d3b02" exitCode=0 Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.162213 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7e017064-86c6-413e-b003-2f5df3306952","Type":"ContainerDied","Data":"0cf2639ccd5dcff044d74634742ba674b06691c33be27480bff7ec2d5a0d3b02"} Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.162241 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7e017064-86c6-413e-b003-2f5df3306952","Type":"ContainerDied","Data":"8076f151882b8dc675d8117040df085f2fbb510f4b9ba2a91b7fffe7ac6bc425"} Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.162317 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.172677 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.174130 5120 scope.go:117] "RemoveContainer" containerID="11c1aefb15e5a5a9d7d8ce7e51a73870631244b296d1ab3b3a8e2cb53983324c" Mar 16 16:52:51 crc kubenswrapper[5120]: E0316 16:52:51.175582 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"11c1aefb15e5a5a9d7d8ce7e51a73870631244b296d1ab3b3a8e2cb53983324c\": container with ID starting with 11c1aefb15e5a5a9d7d8ce7e51a73870631244b296d1ab3b3a8e2cb53983324c not found: ID does not exist" containerID="11c1aefb15e5a5a9d7d8ce7e51a73870631244b296d1ab3b3a8e2cb53983324c" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.175707 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11c1aefb15e5a5a9d7d8ce7e51a73870631244b296d1ab3b3a8e2cb53983324c"} err="failed to get container status \"11c1aefb15e5a5a9d7d8ce7e51a73870631244b296d1ab3b3a8e2cb53983324c\": rpc error: code = NotFound desc = could not find container \"11c1aefb15e5a5a9d7d8ce7e51a73870631244b296d1ab3b3a8e2cb53983324c\": container with ID starting with 11c1aefb15e5a5a9d7d8ce7e51a73870631244b296d1ab3b3a8e2cb53983324c not found: ID does not exist" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.176331 5120 scope.go:117] "RemoveContainer" containerID="ba4af8aa3c89740443bcafa47b272ccb7a4f3b2222974c478de29e30c4166272" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.202152 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.219824 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.239880 5120 scope.go:117] "RemoveContainer" containerID="60d6fa98b9b4949ed2cd960e5c015662986f8113964a21aacc5d89bd38f32581" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.248611 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7e017064-86c6-413e-b003-2f5df3306952-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.248646 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7e017064-86c6-413e-b003-2f5df3306952-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.257274 5120 scope.go:117] "RemoveContainer" containerID="82d54ad68569e47a7c9f69774a92e01246e782c11e23830d6d82dfe12081e84d" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.260310 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.261410 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e017064-86c6-413e-b003-2f5df3306952" containerName="proxy-httpd" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.261430 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e017064-86c6-413e-b003-2f5df3306952" containerName="proxy-httpd" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.261443 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e017064-86c6-413e-b003-2f5df3306952" containerName="ceilometer-central-agent" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.261451 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e017064-86c6-413e-b003-2f5df3306952" containerName="ceilometer-central-agent" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.261458 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e017064-86c6-413e-b003-2f5df3306952" containerName="ceilometer-notification-agent" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.261465 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e017064-86c6-413e-b003-2f5df3306952" containerName="ceilometer-notification-agent" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.261491 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e017064-86c6-413e-b003-2f5df3306952" containerName="sg-core" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.261497 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e017064-86c6-413e-b003-2f5df3306952" containerName="sg-core" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.261674 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7e017064-86c6-413e-b003-2f5df3306952" containerName="sg-core" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.261695 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7e017064-86c6-413e-b003-2f5df3306952" containerName="proxy-httpd" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.261702 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7e017064-86c6-413e-b003-2f5df3306952" containerName="ceilometer-notification-agent" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.261712 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7e017064-86c6-413e-b003-2f5df3306952" containerName="ceilometer-central-agent" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.304051 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.316268 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.319636 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-cinder-internal-svc\"" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.319924 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-cinder-public-svc\"" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.320052 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-api-config-data\"" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.329932 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.362424 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e017064-86c6-413e-b003-2f5df3306952-scripts" (OuterVolumeSpecName: "scripts") pod "7e017064-86c6-413e-b003-2f5df3306952" (UID: "7e017064-86c6-413e-b003-2f5df3306952"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.363778 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e017064-86c6-413e-b003-2f5df3306952-kube-api-access-4bdr9" (OuterVolumeSpecName: "kube-api-access-4bdr9") pod "7e017064-86c6-413e-b003-2f5df3306952" (UID: "7e017064-86c6-413e-b003-2f5df3306952"). InnerVolumeSpecName "kube-api-access-4bdr9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.407269 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/b4ce877d-d510-483c-9a9c-b149879f1755-etc-machine-id\") pod \"cinder-api-0\" (UID: \"b4ce877d-d510-483c-9a9c-b149879f1755\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.408513 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/b4ce877d-d510-483c-9a9c-b149879f1755-config-data-custom\") pod \"cinder-api-0\" (UID: \"b4ce877d-d510-483c-9a9c-b149879f1755\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.408589 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b4ce877d-d510-483c-9a9c-b149879f1755-logs\") pod \"cinder-api-0\" (UID: \"b4ce877d-d510-483c-9a9c-b149879f1755\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.408643 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b4ce877d-d510-483c-9a9c-b149879f1755-config-data\") pod \"cinder-api-0\" (UID: \"b4ce877d-d510-483c-9a9c-b149879f1755\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.408710 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b4ce877d-d510-483c-9a9c-b149879f1755-scripts\") pod \"cinder-api-0\" (UID: \"b4ce877d-d510-483c-9a9c-b149879f1755\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.408927 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/b4ce877d-d510-483c-9a9c-b149879f1755-public-tls-certs\") pod \"cinder-api-0\" (UID: \"b4ce877d-d510-483c-9a9c-b149879f1755\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.409126 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bf6s\" (UniqueName: \"kubernetes.io/projected/b4ce877d-d510-483c-9a9c-b149879f1755-kube-api-access-6bf6s\") pod \"cinder-api-0\" (UID: \"b4ce877d-d510-483c-9a9c-b149879f1755\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.409192 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b4ce877d-d510-483c-9a9c-b149879f1755-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"b4ce877d-d510-483c-9a9c-b149879f1755\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.409394 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/b4ce877d-d510-483c-9a9c-b149879f1755-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"b4ce877d-d510-483c-9a9c-b149879f1755\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.409798 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4bdr9\" (UniqueName: \"kubernetes.io/projected/7e017064-86c6-413e-b003-2f5df3306952-kube-api-access-4bdr9\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.409823 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7e017064-86c6-413e-b003-2f5df3306952-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.449254 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.513446 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.534179 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/b4ce877d-d510-483c-9a9c-b149879f1755-etc-machine-id\") pod \"cinder-api-0\" (UID: \"b4ce877d-d510-483c-9a9c-b149879f1755\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.534257 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/b4ce877d-d510-483c-9a9c-b149879f1755-config-data-custom\") pod \"cinder-api-0\" (UID: \"b4ce877d-d510-483c-9a9c-b149879f1755\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.534321 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b4ce877d-d510-483c-9a9c-b149879f1755-logs\") pod \"cinder-api-0\" (UID: \"b4ce877d-d510-483c-9a9c-b149879f1755\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.534373 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b4ce877d-d510-483c-9a9c-b149879f1755-config-data\") pod \"cinder-api-0\" (UID: \"b4ce877d-d510-483c-9a9c-b149879f1755\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.534421 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b4ce877d-d510-483c-9a9c-b149879f1755-scripts\") pod \"cinder-api-0\" (UID: \"b4ce877d-d510-483c-9a9c-b149879f1755\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.534471 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/b4ce877d-d510-483c-9a9c-b149879f1755-public-tls-certs\") pod \"cinder-api-0\" (UID: \"b4ce877d-d510-483c-9a9c-b149879f1755\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.534578 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6bf6s\" (UniqueName: \"kubernetes.io/projected/b4ce877d-d510-483c-9a9c-b149879f1755-kube-api-access-6bf6s\") pod \"cinder-api-0\" (UID: \"b4ce877d-d510-483c-9a9c-b149879f1755\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.534615 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b4ce877d-d510-483c-9a9c-b149879f1755-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"b4ce877d-d510-483c-9a9c-b149879f1755\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.534743 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/b4ce877d-d510-483c-9a9c-b149879f1755-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"b4ce877d-d510-483c-9a9c-b149879f1755\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.535615 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/b4ce877d-d510-483c-9a9c-b149879f1755-etc-machine-id\") pod \"cinder-api-0\" (UID: \"b4ce877d-d510-483c-9a9c-b149879f1755\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.540250 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b4ce877d-d510-483c-9a9c-b149879f1755-logs\") pod \"cinder-api-0\" (UID: \"b4ce877d-d510-483c-9a9c-b149879f1755\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.540883 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.549138 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b4ce877d-d510-483c-9a9c-b149879f1755-scripts\") pod \"cinder-api-0\" (UID: \"b4ce877d-d510-483c-9a9c-b149879f1755\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.549394 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/b4ce877d-d510-483c-9a9c-b149879f1755-config-data-custom\") pod \"cinder-api-0\" (UID: \"b4ce877d-d510-483c-9a9c-b149879f1755\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.551120 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b4ce877d-d510-483c-9a9c-b149879f1755-config-data\") pod \"cinder-api-0\" (UID: \"b4ce877d-d510-483c-9a9c-b149879f1755\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.555497 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.556300 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/b4ce877d-d510-483c-9a9c-b149879f1755-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"b4ce877d-d510-483c-9a9c-b149879f1755\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.556920 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/b4ce877d-d510-483c-9a9c-b149879f1755-public-tls-certs\") pod \"cinder-api-0\" (UID: \"b4ce877d-d510-483c-9a9c-b149879f1755\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.556999 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b4ce877d-d510-483c-9a9c-b149879f1755-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"b4ce877d-d510-483c-9a9c-b149879f1755\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.566225 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.568646 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-cell1-scripts\"" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.569645 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"galera-openstack-cell1-dockercfg-hwhs2\"" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.570133 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-galera-openstack-cell1-svc\"" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.570323 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-cell1-config-data\"" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.575672 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bf6s\" (UniqueName: \"kubernetes.io/projected/b4ce877d-d510-483c-9a9c-b149879f1755-kube-api-access-6bf6s\") pod \"cinder-api-0\" (UID: \"b4ce877d-d510-483c-9a9c-b149879f1755\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.584724 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.593636 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.595433 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-conductor-config-data\"" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.596807 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.629184 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.635937 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/e5c498e5-584c-4cdd-b008-c643b7bb1bc5-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"e5c498e5-584c-4cdd-b008-c643b7bb1bc5\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.636075 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/e5c498e5-584c-4cdd-b008-c643b7bb1bc5-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"e5c498e5-584c-4cdd-b008-c643b7bb1bc5\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.636092 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e5c498e5-584c-4cdd-b008-c643b7bb1bc5-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"e5c498e5-584c-4cdd-b008-c643b7bb1bc5\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.636120 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5vll\" (UniqueName: \"kubernetes.io/projected/f1c9b873-c644-4c80-941e-3ec3415485e4-kube-api-access-h5vll\") pod \"nova-cell1-conductor-0\" (UID: \"f1c9b873-c644-4c80-941e-3ec3415485e4\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.636136 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f1c9b873-c644-4c80-941e-3ec3415485e4-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"f1c9b873-c644-4c80-941e-3ec3415485e4\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.636206 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/e5c498e5-584c-4cdd-b008-c643b7bb1bc5-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"e5c498e5-584c-4cdd-b008-c643b7bb1bc5\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.636236 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f1c9b873-c644-4c80-941e-3ec3415485e4-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"f1c9b873-c644-4c80-941e-3ec3415485e4\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.636303 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/e5c498e5-584c-4cdd-b008-c643b7bb1bc5-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"e5c498e5-584c-4cdd-b008-c643b7bb1bc5\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.636321 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e5c498e5-584c-4cdd-b008-c643b7bb1bc5-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"e5c498e5-584c-4cdd-b008-c643b7bb1bc5\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.636353 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztvzr\" (UniqueName: \"kubernetes.io/projected/e5c498e5-584c-4cdd-b008-c643b7bb1bc5-kube-api-access-ztvzr\") pod \"openstack-cell1-galera-0\" (UID: \"e5c498e5-584c-4cdd-b008-c643b7bb1bc5\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.636383 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") pod \"openstack-cell1-galera-0\" (UID: \"e5c498e5-584c-4cdd-b008-c643b7bb1bc5\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.641138 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.648713 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.658201 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.669444 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.683019 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.690629 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.694644 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-scripts\"" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.694886 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-internal-config-data\"" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.695024 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-internal-svc\"" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.695237 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-glance-dockercfg-6m2c9\"" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.714169 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.724631 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.725664 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.727145 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-conductor-config-data\"" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.736882 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.740489 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/e5c498e5-584c-4cdd-b008-c643b7bb1bc5-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"e5c498e5-584c-4cdd-b008-c643b7bb1bc5\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.744060 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/e5c498e5-584c-4cdd-b008-c643b7bb1bc5-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"e5c498e5-584c-4cdd-b008-c643b7bb1bc5\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.749147 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f1c9b873-c644-4c80-941e-3ec3415485e4-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"f1c9b873-c644-4c80-941e-3ec3415485e4\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.749413 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/e5c498e5-584c-4cdd-b008-c643b7bb1bc5-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"e5c498e5-584c-4cdd-b008-c643b7bb1bc5\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.750070 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e5c498e5-584c-4cdd-b008-c643b7bb1bc5-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"e5c498e5-584c-4cdd-b008-c643b7bb1bc5\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.750877 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ztvzr\" (UniqueName: \"kubernetes.io/projected/e5c498e5-584c-4cdd-b008-c643b7bb1bc5-kube-api-access-ztvzr\") pod \"openstack-cell1-galera-0\" (UID: \"e5c498e5-584c-4cdd-b008-c643b7bb1bc5\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.751000 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") pod \"openstack-cell1-galera-0\" (UID: \"e5c498e5-584c-4cdd-b008-c643b7bb1bc5\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.751405 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/e5c498e5-584c-4cdd-b008-c643b7bb1bc5-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"e5c498e5-584c-4cdd-b008-c643b7bb1bc5\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.751772 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/e5c498e5-584c-4cdd-b008-c643b7bb1bc5-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"e5c498e5-584c-4cdd-b008-c643b7bb1bc5\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.751813 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e5c498e5-584c-4cdd-b008-c643b7bb1bc5-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"e5c498e5-584c-4cdd-b008-c643b7bb1bc5\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.751866 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h5vll\" (UniqueName: \"kubernetes.io/projected/f1c9b873-c644-4c80-941e-3ec3415485e4-kube-api-access-h5vll\") pod \"nova-cell1-conductor-0\" (UID: \"f1c9b873-c644-4c80-941e-3ec3415485e4\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.751912 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f1c9b873-c644-4c80-941e-3ec3415485e4-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"f1c9b873-c644-4c80-941e-3ec3415485e4\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.752233 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") pod \"openstack-cell1-galera-0\" (UID: \"e5c498e5-584c-4cdd-b008-c643b7bb1bc5\") device mount path \"/mnt/openstack/pv14\"" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.753456 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/e5c498e5-584c-4cdd-b008-c643b7bb1bc5-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"e5c498e5-584c-4cdd-b008-c643b7bb1bc5\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.753712 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/e5c498e5-584c-4cdd-b008-c643b7bb1bc5-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"e5c498e5-584c-4cdd-b008-c643b7bb1bc5\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.756530 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e5c498e5-584c-4cdd-b008-c643b7bb1bc5-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"e5c498e5-584c-4cdd-b008-c643b7bb1bc5\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.757783 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.782564 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f1c9b873-c644-4c80-941e-3ec3415485e4-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"f1c9b873-c644-4c80-941e-3ec3415485e4\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.792695 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f1c9b873-c644-4c80-941e-3ec3415485e4-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"f1c9b873-c644-4c80-941e-3ec3415485e4\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.793039 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.793834 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e5c498e5-584c-4cdd-b008-c643b7bb1bc5-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"e5c498e5-584c-4cdd-b008-c643b7bb1bc5\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.794555 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/e5c498e5-584c-4cdd-b008-c643b7bb1bc5-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"e5c498e5-584c-4cdd-b008-c643b7bb1bc5\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.799223 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztvzr\" (UniqueName: \"kubernetes.io/projected/e5c498e5-584c-4cdd-b008-c643b7bb1bc5-kube-api-access-ztvzr\") pod \"openstack-cell1-galera-0\" (UID: \"e5c498e5-584c-4cdd-b008-c643b7bb1bc5\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.803646 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5vll\" (UniqueName: \"kubernetes.io/projected/f1c9b873-c644-4c80-941e-3ec3415485e4-kube-api-access-h5vll\") pod \"nova-cell1-conductor-0\" (UID: \"f1c9b873-c644-4c80-941e-3ec3415485e4\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.819291 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.835691 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.848706 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.854834 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/50c82211-4383-41cb-a31c-9bdfb156b586-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"50c82211-4383-41cb-a31c-9bdfb156b586\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.854901 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/50c82211-4383-41cb-a31c-9bdfb156b586-config-data\") pod \"glance-default-internal-api-0\" (UID: \"50c82211-4383-41cb-a31c-9bdfb156b586\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.854946 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/26d7e714-e270-4150-9fc2-65e289bbd688-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"26d7e714-e270-4150-9fc2-65e289bbd688\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.854981 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/26d7e714-e270-4150-9fc2-65e289bbd688-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"26d7e714-e270-4150-9fc2-65e289bbd688\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.855000 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/50c82211-4383-41cb-a31c-9bdfb156b586-scripts\") pod \"glance-default-internal-api-0\" (UID: \"50c82211-4383-41cb-a31c-9bdfb156b586\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.855283 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/50c82211-4383-41cb-a31c-9bdfb156b586-logs\") pod \"glance-default-internal-api-0\" (UID: \"50c82211-4383-41cb-a31c-9bdfb156b586\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.855358 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8jxx\" (UniqueName: \"kubernetes.io/projected/26d7e714-e270-4150-9fc2-65e289bbd688-kube-api-access-v8jxx\") pod \"nova-cell0-conductor-0\" (UID: \"26d7e714-e270-4150-9fc2-65e289bbd688\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.855396 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"glance-default-internal-api-0\" (UID: \"50c82211-4383-41cb-a31c-9bdfb156b586\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.855523 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/50c82211-4383-41cb-a31c-9bdfb156b586-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"50c82211-4383-41cb-a31c-9bdfb156b586\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.855582 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtckr\" (UniqueName: \"kubernetes.io/projected/50c82211-4383-41cb-a31c-9bdfb156b586-kube-api-access-wtckr\") pod \"glance-default-internal-api-0\" (UID: \"50c82211-4383-41cb-a31c-9bdfb156b586\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.855670 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/50c82211-4383-41cb-a31c-9bdfb156b586-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"50c82211-4383-41cb-a31c-9bdfb156b586\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.873339 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.873478 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.875833 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-metadata-config-data\"" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.876683 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-metadata-internal-svc\"" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.896485 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.902540 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.905811 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-public-svc\"" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.906212 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-external-config-data\"" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.911929 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.940696 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.954598 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.958116 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/77e38408-57df-40be-95a1-64f61218c305-config-data\") pod \"nova-metadata-0\" (UID: \"77e38408-57df-40be-95a1-64f61218c305\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.958180 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/50c82211-4383-41cb-a31c-9bdfb156b586-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"50c82211-4383-41cb-a31c-9bdfb156b586\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.958221 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/50c82211-4383-41cb-a31c-9bdfb156b586-config-data\") pod \"glance-default-internal-api-0\" (UID: \"50c82211-4383-41cb-a31c-9bdfb156b586\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.958252 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/26d7e714-e270-4150-9fc2-65e289bbd688-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"26d7e714-e270-4150-9fc2-65e289bbd688\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.958286 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/26d7e714-e270-4150-9fc2-65e289bbd688-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"26d7e714-e270-4150-9fc2-65e289bbd688\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.958305 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/50c82211-4383-41cb-a31c-9bdfb156b586-scripts\") pod \"glance-default-internal-api-0\" (UID: \"50c82211-4383-41cb-a31c-9bdfb156b586\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.958349 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/77e38408-57df-40be-95a1-64f61218c305-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"77e38408-57df-40be-95a1-64f61218c305\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.958387 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/77e38408-57df-40be-95a1-64f61218c305-logs\") pod \"nova-metadata-0\" (UID: \"77e38408-57df-40be-95a1-64f61218c305\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.958471 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/50c82211-4383-41cb-a31c-9bdfb156b586-logs\") pod \"glance-default-internal-api-0\" (UID: \"50c82211-4383-41cb-a31c-9bdfb156b586\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.958516 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v8jxx\" (UniqueName: \"kubernetes.io/projected/26d7e714-e270-4150-9fc2-65e289bbd688-kube-api-access-v8jxx\") pod \"nova-cell0-conductor-0\" (UID: \"26d7e714-e270-4150-9fc2-65e289bbd688\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.958547 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"glance-default-internal-api-0\" (UID: \"50c82211-4383-41cb-a31c-9bdfb156b586\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.958572 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/77e38408-57df-40be-95a1-64f61218c305-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"77e38408-57df-40be-95a1-64f61218c305\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.958638 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/50c82211-4383-41cb-a31c-9bdfb156b586-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"50c82211-4383-41cb-a31c-9bdfb156b586\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.958676 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wtckr\" (UniqueName: \"kubernetes.io/projected/50c82211-4383-41cb-a31c-9bdfb156b586-kube-api-access-wtckr\") pod \"glance-default-internal-api-0\" (UID: \"50c82211-4383-41cb-a31c-9bdfb156b586\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.958732 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/50c82211-4383-41cb-a31c-9bdfb156b586-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"50c82211-4383-41cb-a31c-9bdfb156b586\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.958780 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bm89z\" (UniqueName: \"kubernetes.io/projected/77e38408-57df-40be-95a1-64f61218c305-kube-api-access-bm89z\") pod \"nova-metadata-0\" (UID: \"77e38408-57df-40be-95a1-64f61218c305\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.963366 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"glance-default-internal-api-0\" (UID: \"50c82211-4383-41cb-a31c-9bdfb156b586\") device mount path \"/mnt/openstack/pv01\"" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.963398 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/50c82211-4383-41cb-a31c-9bdfb156b586-logs\") pod \"glance-default-internal-api-0\" (UID: \"50c82211-4383-41cb-a31c-9bdfb156b586\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.964333 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/50c82211-4383-41cb-a31c-9bdfb156b586-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"50c82211-4383-41cb-a31c-9bdfb156b586\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.967797 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.981868 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/50c82211-4383-41cb-a31c-9bdfb156b586-config-data\") pod \"glance-default-internal-api-0\" (UID: \"50c82211-4383-41cb-a31c-9bdfb156b586\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.981841 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.983400 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtckr\" (UniqueName: \"kubernetes.io/projected/50c82211-4383-41cb-a31c-9bdfb156b586-kube-api-access-wtckr\") pod \"glance-default-internal-api-0\" (UID: \"50c82211-4383-41cb-a31c-9bdfb156b586\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.984895 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/50c82211-4383-41cb-a31c-9bdfb156b586-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"50c82211-4383-41cb-a31c-9bdfb156b586\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.990211 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.992007 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/50c82211-4383-41cb-a31c-9bdfb156b586-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"50c82211-4383-41cb-a31c-9bdfb156b586\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.992790 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/26d7e714-e270-4150-9fc2-65e289bbd688-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"26d7e714-e270-4150-9fc2-65e289bbd688\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.997677 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/26d7e714-e270-4150-9fc2-65e289bbd688-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"26d7e714-e270-4150-9fc2-65e289bbd688\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:52:51 crc kubenswrapper[5120]: I0316 16:52:51.999406 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/50c82211-4383-41cb-a31c-9bdfb156b586-scripts\") pod \"glance-default-internal-api-0\" (UID: \"50c82211-4383-41cb-a31c-9bdfb156b586\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.000032 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8jxx\" (UniqueName: \"kubernetes.io/projected/26d7e714-e270-4150-9fc2-65e289bbd688-kube-api-access-v8jxx\") pod \"nova-cell0-conductor-0\" (UID: \"26d7e714-e270-4150-9fc2-65e289bbd688\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.002014 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.002155 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.005164 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-internal-svc\"" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.006272 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-config-data\"" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.007090 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-public-svc\"" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.032049 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.032263 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.038716 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-galera-openstack-svc\"" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.038895 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-scripts\"" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.039855 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-config-data\"" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.041434 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.049859 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"galera-openstack-dockercfg-8xncx\"" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.083627 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/77e38408-57df-40be-95a1-64f61218c305-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"77e38408-57df-40be-95a1-64f61218c305\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.083715 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/77e38408-57df-40be-95a1-64f61218c305-logs\") pod \"nova-metadata-0\" (UID: \"77e38408-57df-40be-95a1-64f61218c305\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.083986 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/77e38408-57df-40be-95a1-64f61218c305-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"77e38408-57df-40be-95a1-64f61218c305\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.084215 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bm89z\" (UniqueName: \"kubernetes.io/projected/77e38408-57df-40be-95a1-64f61218c305-kube-api-access-bm89z\") pod \"nova-metadata-0\" (UID: \"77e38408-57df-40be-95a1-64f61218c305\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.084248 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/607fee19-adac-44b4-9f70-a6f6f3e59aed-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"607fee19-adac-44b4-9f70-a6f6f3e59aed\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.084282 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvfzn\" (UniqueName: \"kubernetes.io/projected/607fee19-adac-44b4-9f70-a6f6f3e59aed-kube-api-access-jvfzn\") pod \"glance-default-external-api-0\" (UID: \"607fee19-adac-44b4-9f70-a6f6f3e59aed\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.084317 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/607fee19-adac-44b4-9f70-a6f6f3e59aed-logs\") pod \"glance-default-external-api-0\" (UID: \"607fee19-adac-44b4-9f70-a6f6f3e59aed\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.084361 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/607fee19-adac-44b4-9f70-a6f6f3e59aed-scripts\") pod \"glance-default-external-api-0\" (UID: \"607fee19-adac-44b4-9f70-a6f6f3e59aed\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.084389 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/77e38408-57df-40be-95a1-64f61218c305-logs\") pod \"nova-metadata-0\" (UID: \"77e38408-57df-40be-95a1-64f61218c305\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.084540 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/607fee19-adac-44b4-9f70-a6f6f3e59aed-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"607fee19-adac-44b4-9f70-a6f6f3e59aed\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.084654 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"glance-default-external-api-0\" (UID: \"607fee19-adac-44b4-9f70-a6f6f3e59aed\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.084711 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/77e38408-57df-40be-95a1-64f61218c305-config-data\") pod \"nova-metadata-0\" (UID: \"77e38408-57df-40be-95a1-64f61218c305\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.085780 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/607fee19-adac-44b4-9f70-a6f6f3e59aed-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"607fee19-adac-44b4-9f70-a6f6f3e59aed\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.085837 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/607fee19-adac-44b4-9f70-a6f6f3e59aed-config-data\") pod \"glance-default-external-api-0\" (UID: \"607fee19-adac-44b4-9f70-a6f6f3e59aed\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.101285 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/77e38408-57df-40be-95a1-64f61218c305-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"77e38408-57df-40be-95a1-64f61218c305\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.102349 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/77e38408-57df-40be-95a1-64f61218c305-config-data\") pod \"nova-metadata-0\" (UID: \"77e38408-57df-40be-95a1-64f61218c305\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.102779 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/77e38408-57df-40be-95a1-64f61218c305-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"77e38408-57df-40be-95a1-64f61218c305\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.112502 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bm89z\" (UniqueName: \"kubernetes.io/projected/77e38408-57df-40be-95a1-64f61218c305-kube-api-access-bm89z\") pod \"nova-metadata-0\" (UID: \"77e38408-57df-40be-95a1-64f61218c305\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.118266 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") pod \"openstack-cell1-galera-0\" (UID: \"e5c498e5-584c-4cdd-b008-c643b7bb1bc5\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.189599 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"openstack-galera-0\" (UID: \"0d9062d0-d8bb-4ab3-b2c5-33fa78833a65\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.189638 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0fba253d-bef6-490a-8d34-6be75a260d03-logs\") pod \"nova-api-0\" (UID: \"0fba253d-bef6-490a-8d34-6be75a260d03\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.189695 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/0d9062d0-d8bb-4ab3-b2c5-33fa78833a65-kolla-config\") pod \"openstack-galera-0\" (UID: \"0d9062d0-d8bb-4ab3-b2c5-33fa78833a65\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.189737 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtv52\" (UniqueName: \"kubernetes.io/projected/0fba253d-bef6-490a-8d34-6be75a260d03-kube-api-access-mtv52\") pod \"nova-api-0\" (UID: \"0fba253d-bef6-490a-8d34-6be75a260d03\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.189838 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pncwl\" (UniqueName: \"kubernetes.io/projected/0d9062d0-d8bb-4ab3-b2c5-33fa78833a65-kube-api-access-pncwl\") pod \"openstack-galera-0\" (UID: \"0d9062d0-d8bb-4ab3-b2c5-33fa78833a65\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.189870 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/0fba253d-bef6-490a-8d34-6be75a260d03-internal-tls-certs\") pod \"nova-api-0\" (UID: \"0fba253d-bef6-490a-8d34-6be75a260d03\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.189931 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0fba253d-bef6-490a-8d34-6be75a260d03-config-data\") pod \"nova-api-0\" (UID: \"0fba253d-bef6-490a-8d34-6be75a260d03\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.189979 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/607fee19-adac-44b4-9f70-a6f6f3e59aed-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"607fee19-adac-44b4-9f70-a6f6f3e59aed\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.190194 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jvfzn\" (UniqueName: \"kubernetes.io/projected/607fee19-adac-44b4-9f70-a6f6f3e59aed-kube-api-access-jvfzn\") pod \"glance-default-external-api-0\" (UID: \"607fee19-adac-44b4-9f70-a6f6f3e59aed\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.190218 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/607fee19-adac-44b4-9f70-a6f6f3e59aed-logs\") pod \"glance-default-external-api-0\" (UID: \"607fee19-adac-44b4-9f70-a6f6f3e59aed\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.190374 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/607fee19-adac-44b4-9f70-a6f6f3e59aed-scripts\") pod \"glance-default-external-api-0\" (UID: \"607fee19-adac-44b4-9f70-a6f6f3e59aed\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.190408 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/0d9062d0-d8bb-4ab3-b2c5-33fa78833a65-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"0d9062d0-d8bb-4ab3-b2c5-33fa78833a65\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.190431 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/607fee19-adac-44b4-9f70-a6f6f3e59aed-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"607fee19-adac-44b4-9f70-a6f6f3e59aed\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.190820 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0fba253d-bef6-490a-8d34-6be75a260d03-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"0fba253d-bef6-490a-8d34-6be75a260d03\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.190858 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/0fba253d-bef6-490a-8d34-6be75a260d03-public-tls-certs\") pod \"nova-api-0\" (UID: \"0fba253d-bef6-490a-8d34-6be75a260d03\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.191118 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"glance-default-external-api-0\" (UID: \"607fee19-adac-44b4-9f70-a6f6f3e59aed\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.191184 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0d9062d0-d8bb-4ab3-b2c5-33fa78833a65-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"0d9062d0-d8bb-4ab3-b2c5-33fa78833a65\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.191258 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/0d9062d0-d8bb-4ab3-b2c5-33fa78833a65-config-data-generated\") pod \"openstack-galera-0\" (UID: \"0d9062d0-d8bb-4ab3-b2c5-33fa78833a65\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.191274 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/0d9062d0-d8bb-4ab3-b2c5-33fa78833a65-config-data-default\") pod \"openstack-galera-0\" (UID: \"0d9062d0-d8bb-4ab3-b2c5-33fa78833a65\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.191336 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0d9062d0-d8bb-4ab3-b2c5-33fa78833a65-operator-scripts\") pod \"openstack-galera-0\" (UID: \"0d9062d0-d8bb-4ab3-b2c5-33fa78833a65\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.191378 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/607fee19-adac-44b4-9f70-a6f6f3e59aed-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"607fee19-adac-44b4-9f70-a6f6f3e59aed\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.191396 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/607fee19-adac-44b4-9f70-a6f6f3e59aed-config-data\") pod \"glance-default-external-api-0\" (UID: \"607fee19-adac-44b4-9f70-a6f6f3e59aed\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.192149 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"glance-default-external-api-0\" (UID: \"607fee19-adac-44b4-9f70-a6f6f3e59aed\") device mount path \"/mnt/openstack/pv02\"" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.192187 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/607fee19-adac-44b4-9f70-a6f6f3e59aed-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"607fee19-adac-44b4-9f70-a6f6f3e59aed\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.194123 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/607fee19-adac-44b4-9f70-a6f6f3e59aed-logs\") pod \"glance-default-external-api-0\" (UID: \"607fee19-adac-44b4-9f70-a6f6f3e59aed\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.195695 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"72edd543-4bf8-407e-9929-47d4e9727134","Type":"ContainerStarted","Data":"dff05d001161dd73ee301824319b7393ecaf3fe56d375faa6a317018e3fee33b"} Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.197046 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-d99589cd-7z8cg" event={"ID":"cc7ba52a-5825-4399-9e38-4d5cd1c02156","Type":"ContainerStarted","Data":"90916447cca93d6401deab90112baaf449192048ae8cc43a6c81786b2c2628a9"} Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.197905 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.201062 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/607fee19-adac-44b4-9f70-a6f6f3e59aed-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"607fee19-adac-44b4-9f70-a6f6f3e59aed\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.204051 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"a3cdc115-5535-44fd-94b4-6256145dea7e","Type":"ContainerStarted","Data":"b34391ed51e1fef10fa960dbb4dc7aa97f95bec5ecc3a8f7a2c49da0363fdd4d"} Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.204109 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/memcached-0" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.209305 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/607fee19-adac-44b4-9f70-a6f6f3e59aed-scripts\") pod \"glance-default-external-api-0\" (UID: \"607fee19-adac-44b4-9f70-a6f6f3e59aed\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.211098 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/607fee19-adac-44b4-9f70-a6f6f3e59aed-config-data\") pod \"glance-default-external-api-0\" (UID: \"607fee19-adac-44b4-9f70-a6f6f3e59aed\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.213591 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/607fee19-adac-44b4-9f70-a6f6f3e59aed-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"607fee19-adac-44b4-9f70-a6f6f3e59aed\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.214035 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-7bf49bf568-fbg2k" event={"ID":"c846d2b2-0638-44bd-9ad0-6b6c76f8d16f","Type":"ContainerStarted","Data":"c902dfb54f96d7888fe00f01304e3a2ce668c40edb25e8195bacffff26645501"} Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.214070 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-7bf49bf568-fbg2k" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.214097 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-7bf49bf568-fbg2k" podUID="c846d2b2-0638-44bd-9ad0-6b6c76f8d16f" containerName="barbican-api-log" containerID="cri-o://230653dbcfd778943f6ddd417a12dd48b5680b4e4b96b18fd7d3385ba610e6c3" gracePeriod=30 Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.214116 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-7bf49bf568-fbg2k" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.214184 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-7bf49bf568-fbg2k" podUID="c846d2b2-0638-44bd-9ad0-6b6c76f8d16f" containerName="barbican-api" containerID="cri-o://c902dfb54f96d7888fe00f01304e3a2ce668c40edb25e8195bacffff26645501" gracePeriod=30 Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.220577 5120 generic.go:358] "Generic (PLEG): container finished" podID="37c6de80-ff10-4d44-a806-b8ad82e62d82" containerID="35987799f969f71c82b912431ea13f98b634d539c89a2bd6ce077420efb8f161" exitCode=0 Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.220660 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"37c6de80-ff10-4d44-a806-b8ad82e62d82","Type":"ContainerDied","Data":"35987799f969f71c82b912431ea13f98b634d539c89a2bd6ce077420efb8f161"} Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.220684 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"37c6de80-ff10-4d44-a806-b8ad82e62d82","Type":"ContainerDied","Data":"0982eea59a394495c17b6233f9b1ef735cc558e5b0c7ba79e5e4cf4a4f418e3c"} Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.220694 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0982eea59a394495c17b6233f9b1ef735cc558e5b0c7ba79e5e4cf4a4f418e3c" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.221783 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/memcached-0" podStartSLOduration=7.221751951 podStartE2EDuration="7.221751951s" podCreationTimestamp="2026-03-16 16:52:45 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:52:52.221462433 +0000 UTC m=+4874.375394090" watchObservedRunningTime="2026-03-16 16:52:52.221751951 +0000 UTC m=+4874.375683608" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.224356 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-7f78b864cb-6dgjh" event={"ID":"c06f24f9-95b0-4a92-ad3a-6075764151ed","Type":"ContainerStarted","Data":"7bbf1614038d4b969b640c6c4529cfbe2dbb4d18e62926c0ea76ab02c22db36b"} Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.225159 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvfzn\" (UniqueName: \"kubernetes.io/projected/607fee19-adac-44b4-9f70-a6f6f3e59aed-kube-api-access-jvfzn\") pod \"glance-default-external-api-0\" (UID: \"607fee19-adac-44b4-9f70-a6f6f3e59aed\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.287388 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"18684823-3972-4cf6-8e42-792360b387bb","Type":"ContainerStarted","Data":"c37bdc03a053afc82ef80c0a8a9c3c36b8cbfaa6885189827254366781339f42"} Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.292253 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-api-7bf49bf568-fbg2k" podStartSLOduration=10.292224209 podStartE2EDuration="10.292224209s" podCreationTimestamp="2026-03-16 16:52:42 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:52:52.244786681 +0000 UTC m=+4874.398718338" watchObservedRunningTime="2026-03-16 16:52:52.292224209 +0000 UTC m=+4874.446155866" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.298344 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0d9062d0-d8bb-4ab3-b2c5-33fa78833a65-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"0d9062d0-d8bb-4ab3-b2c5-33fa78833a65\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.298411 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/0d9062d0-d8bb-4ab3-b2c5-33fa78833a65-config-data-generated\") pod \"openstack-galera-0\" (UID: \"0d9062d0-d8bb-4ab3-b2c5-33fa78833a65\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.298435 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/0d9062d0-d8bb-4ab3-b2c5-33fa78833a65-config-data-default\") pod \"openstack-galera-0\" (UID: \"0d9062d0-d8bb-4ab3-b2c5-33fa78833a65\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.298473 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0d9062d0-d8bb-4ab3-b2c5-33fa78833a65-operator-scripts\") pod \"openstack-galera-0\" (UID: \"0d9062d0-d8bb-4ab3-b2c5-33fa78833a65\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.298594 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"openstack-galera-0\" (UID: \"0d9062d0-d8bb-4ab3-b2c5-33fa78833a65\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.298617 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0fba253d-bef6-490a-8d34-6be75a260d03-logs\") pod \"nova-api-0\" (UID: \"0fba253d-bef6-490a-8d34-6be75a260d03\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.299236 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/0d9062d0-d8bb-4ab3-b2c5-33fa78833a65-kolla-config\") pod \"openstack-galera-0\" (UID: \"0d9062d0-d8bb-4ab3-b2c5-33fa78833a65\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.299296 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mtv52\" (UniqueName: \"kubernetes.io/projected/0fba253d-bef6-490a-8d34-6be75a260d03-kube-api-access-mtv52\") pod \"nova-api-0\" (UID: \"0fba253d-bef6-490a-8d34-6be75a260d03\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.299406 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pncwl\" (UniqueName: \"kubernetes.io/projected/0d9062d0-d8bb-4ab3-b2c5-33fa78833a65-kube-api-access-pncwl\") pod \"openstack-galera-0\" (UID: \"0d9062d0-d8bb-4ab3-b2c5-33fa78833a65\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.299490 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"openstack-galera-0\" (UID: \"0d9062d0-d8bb-4ab3-b2c5-33fa78833a65\") device mount path \"/mnt/openstack/pv16\"" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.300181 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"18e2f22a-0bc1-4514-afe4-56bdf5cb1670","Type":"ContainerStarted","Data":"253b897b6cc39c0bdd916b41b82832e5e380542fd49c4ed5fb4c019329d88f75"} Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.300413 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/0d9062d0-d8bb-4ab3-b2c5-33fa78833a65-config-data-default\") pod \"openstack-galera-0\" (UID: \"0d9062d0-d8bb-4ab3-b2c5-33fa78833a65\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.301429 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0fba253d-bef6-490a-8d34-6be75a260d03-logs\") pod \"nova-api-0\" (UID: \"0fba253d-bef6-490a-8d34-6be75a260d03\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.301966 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0d9062d0-d8bb-4ab3-b2c5-33fa78833a65-operator-scripts\") pod \"openstack-galera-0\" (UID: \"0d9062d0-d8bb-4ab3-b2c5-33fa78833a65\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.303896 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/0d9062d0-d8bb-4ab3-b2c5-33fa78833a65-config-data-generated\") pod \"openstack-galera-0\" (UID: \"0d9062d0-d8bb-4ab3-b2c5-33fa78833a65\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.304800 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/0d9062d0-d8bb-4ab3-b2c5-33fa78833a65-kolla-config\") pod \"openstack-galera-0\" (UID: \"0d9062d0-d8bb-4ab3-b2c5-33fa78833a65\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.304914 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/0fba253d-bef6-490a-8d34-6be75a260d03-internal-tls-certs\") pod \"nova-api-0\" (UID: \"0fba253d-bef6-490a-8d34-6be75a260d03\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.305786 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0d9062d0-d8bb-4ab3-b2c5-33fa78833a65-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"0d9062d0-d8bb-4ab3-b2c5-33fa78833a65\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.305912 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0fba253d-bef6-490a-8d34-6be75a260d03-config-data\") pod \"nova-api-0\" (UID: \"0fba253d-bef6-490a-8d34-6be75a260d03\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.306022 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/0d9062d0-d8bb-4ab3-b2c5-33fa78833a65-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"0d9062d0-d8bb-4ab3-b2c5-33fa78833a65\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.306068 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0fba253d-bef6-490a-8d34-6be75a260d03-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"0fba253d-bef6-490a-8d34-6be75a260d03\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.306084 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/0fba253d-bef6-490a-8d34-6be75a260d03-public-tls-certs\") pod \"nova-api-0\" (UID: \"0fba253d-bef6-490a-8d34-6be75a260d03\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.316355 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/0d9062d0-d8bb-4ab3-b2c5-33fa78833a65-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"0d9062d0-d8bb-4ab3-b2c5-33fa78833a65\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.318963 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/0fba253d-bef6-490a-8d34-6be75a260d03-public-tls-certs\") pod \"nova-api-0\" (UID: \"0fba253d-bef6-490a-8d34-6be75a260d03\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.319454 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0fba253d-bef6-490a-8d34-6be75a260d03-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"0fba253d-bef6-490a-8d34-6be75a260d03\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.319609 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"glance-default-internal-api-0\" (UID: \"50c82211-4383-41cb-a31c-9bdfb156b586\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.320266 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e017064-86c6-413e-b003-2f5df3306952-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "7e017064-86c6-413e-b003-2f5df3306952" (UID: "7e017064-86c6-413e-b003-2f5df3306952"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.318829 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"glance-default-external-api-0\" (UID: \"607fee19-adac-44b4-9f70-a6f6f3e59aed\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.320624 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/0fba253d-bef6-490a-8d34-6be75a260d03-internal-tls-certs\") pod \"nova-api-0\" (UID: \"0fba253d-bef6-490a-8d34-6be75a260d03\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.329470 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtv52\" (UniqueName: \"kubernetes.io/projected/0fba253d-bef6-490a-8d34-6be75a260d03-kube-api-access-mtv52\") pod \"nova-api-0\" (UID: \"0fba253d-bef6-490a-8d34-6be75a260d03\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.330538 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0fba253d-bef6-490a-8d34-6be75a260d03-config-data\") pod \"nova-api-0\" (UID: \"0fba253d-bef6-490a-8d34-6be75a260d03\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.338852 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pncwl\" (UniqueName: \"kubernetes.io/projected/0d9062d0-d8bb-4ab3-b2c5-33fa78833a65-kube-api-access-pncwl\") pod \"openstack-galera-0\" (UID: \"0d9062d0-d8bb-4ab3-b2c5-33fa78833a65\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.393968 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e017064-86c6-413e-b003-2f5df3306952-ceilometer-tls-certs" (OuterVolumeSpecName: "ceilometer-tls-certs") pod "7e017064-86c6-413e-b003-2f5df3306952" (UID: "7e017064-86c6-413e-b003-2f5df3306952"). InnerVolumeSpecName "ceilometer-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.396057 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"openstack-galera-0\" (UID: \"0d9062d0-d8bb-4ab3-b2c5-33fa78833a65\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.407958 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e017064-86c6-413e-b003-2f5df3306952-config-data" (OuterVolumeSpecName: "config-data") pod "7e017064-86c6-413e-b003-2f5df3306952" (UID: "7e017064-86c6-413e-b003-2f5df3306952"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.408838 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7e017064-86c6-413e-b003-2f5df3306952-config-data\") pod \"7e017064-86c6-413e-b003-2f5df3306952\" (UID: \"7e017064-86c6-413e-b003-2f5df3306952\") " Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.410051 5120 reconciler_common.go:299] "Volume detached for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/7e017064-86c6-413e-b003-2f5df3306952-ceilometer-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.410078 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/7e017064-86c6-413e-b003-2f5df3306952-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:52 crc kubenswrapper[5120]: W0316 16:52:52.410443 5120 empty_dir.go:511] Warning: Unmount skipped because path does not exist: /var/lib/kubelet/pods/7e017064-86c6-413e-b003-2f5df3306952/volumes/kubernetes.io~secret/config-data Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.410466 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e017064-86c6-413e-b003-2f5df3306952-config-data" (OuterVolumeSpecName: "config-data") pod "7e017064-86c6-413e-b003-2f5df3306952" (UID: "7e017064-86c6-413e-b003-2f5df3306952"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.416593 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e017064-86c6-413e-b003-2f5df3306952-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "7e017064-86c6-413e-b003-2f5df3306952" (UID: "7e017064-86c6-413e-b003-2f5df3306952"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.513735 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7e017064-86c6-413e-b003-2f5df3306952-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.513805 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7e017064-86c6-413e-b003-2f5df3306952-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.576130 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.594192 5120 scope.go:117] "RemoveContainer" containerID="c74f707751274cb9f40149f4d93eefc2868fbd3cda3e57a098d9924341521900" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.646016 5120 scope.go:117] "RemoveContainer" containerID="b20277c633e0b78465cbdd8b3094afe9e4fc50b2aa342ab3382ce2a06551927f" Mar 16 16:52:52 crc kubenswrapper[5120]: E0316 16:52:52.646477 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b20277c633e0b78465cbdd8b3094afe9e4fc50b2aa342ab3382ce2a06551927f\": container with ID starting with b20277c633e0b78465cbdd8b3094afe9e4fc50b2aa342ab3382ce2a06551927f not found: ID does not exist" containerID="b20277c633e0b78465cbdd8b3094afe9e4fc50b2aa342ab3382ce2a06551927f" Mar 16 16:52:52 crc kubenswrapper[5120]: E0316 16:52:52.646507 5120 kuberuntime_gc.go:150] "Failed to remove container" err="failed to get container status \"b20277c633e0b78465cbdd8b3094afe9e4fc50b2aa342ab3382ce2a06551927f\": rpc error: code = NotFound desc = could not find container \"b20277c633e0b78465cbdd8b3094afe9e4fc50b2aa342ab3382ce2a06551927f\": container with ID starting with b20277c633e0b78465cbdd8b3094afe9e4fc50b2aa342ab3382ce2a06551927f not found: ID does not exist" containerID="b20277c633e0b78465cbdd8b3094afe9e4fc50b2aa342ab3382ce2a06551927f" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.646534 5120 scope.go:117] "RemoveContainer" containerID="1f29684c403dda9045db07e7ddb6e0614e8cd5b3820d6ba12d2a76504a2cb5db" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.677024 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2627e341-ad91-4de8-96da-e58d58d40fb9" path="/var/lib/kubelet/pods/2627e341-ad91-4de8-96da-e58d58d40fb9/volumes" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.678787 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="30517467-b630-4ca2-815c-460999b6539a" path="/var/lib/kubelet/pods/30517467-b630-4ca2-815c-460999b6539a/volumes" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.679589 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="359ce032-c698-43d8-a7eb-011091fe9a3d" path="/var/lib/kubelet/pods/359ce032-c698-43d8-a7eb-011091fe9a3d/volumes" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.680939 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a9b9d92-8d3c-4366-83fb-0ea460a622d9" path="/var/lib/kubelet/pods/6a9b9d92-8d3c-4366-83fb-0ea460a622d9/volumes" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.686103 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a04cbe2-cde0-405c-820b-f2651d753654" path="/var/lib/kubelet/pods/8a04cbe2-cde0-405c-820b-f2651d753654/volumes" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.686728 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a564f44-3c8d-4dff-b968-96f276382786" path="/var/lib/kubelet/pods/8a564f44-3c8d-4dff-b968-96f276382786/volumes" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.687863 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="adaee0e3-17f6-4f23-97c4-00bd5f6a8d6c" path="/var/lib/kubelet/pods/adaee0e3-17f6-4f23-97c4-00bd5f6a8d6c/volumes" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.688461 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b3abb705-1e8c-4922-a449-616479bf0721" path="/var/lib/kubelet/pods/b3abb705-1e8c-4922-a449-616479bf0721/volumes" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.689220 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e5b6bb5a-fb93-4761-b995-1842090c7047" path="/var/lib/kubelet/pods/e5b6bb5a-fb93-4761-b995-1842090c7047/volumes" Mar 16 16:52:52 crc kubenswrapper[5120]: E0316 16:52:52.730407 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 35987799f969f71c82b912431ea13f98b634d539c89a2bd6ce077420efb8f161 is running failed: container process not found" containerID="35987799f969f71c82b912431ea13f98b634d539c89a2bd6ce077420efb8f161" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:52:52 crc kubenswrapper[5120]: E0316 16:52:52.730790 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 35987799f969f71c82b912431ea13f98b634d539c89a2bd6ce077420efb8f161 is running failed: container process not found" containerID="35987799f969f71c82b912431ea13f98b634d539c89a2bd6ce077420efb8f161" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:52:52 crc kubenswrapper[5120]: E0316 16:52:52.731076 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 35987799f969f71c82b912431ea13f98b634d539c89a2bd6ce077420efb8f161 is running failed: container process not found" containerID="35987799f969f71c82b912431ea13f98b634d539c89a2bd6ce077420efb8f161" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:52:52 crc kubenswrapper[5120]: E0316 16:52:52.731114 5120 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 35987799f969f71c82b912431ea13f98b634d539c89a2bd6ce077420efb8f161 is running failed: container process not found" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="37c6de80-ff10-4d44-a806-b8ad82e62d82" containerName="nova-scheduler-scheduler" probeResult="unknown" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.790113 5120 scope.go:117] "RemoveContainer" containerID="2bcf867b5f7513b9f5de5259f817492a68be7846d89a1bc2dacdab498fcfca0f" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.802209 5120 scope.go:117] "RemoveContainer" containerID="a27b058fc327b7f2b23592539c20e14a76cfbc908fe6c7ae8c356b40f8a204c5" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.858786 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.874771 5120 scope.go:117] "RemoveContainer" containerID="e737c3a8474b5b2441a2fe0e5e4c4c27b963e84e3c1ac1e70370959759d8773d" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.891978 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.905868 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.933280 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.943132 5120 scope.go:117] "RemoveContainer" containerID="a5caf3e8fdf3dd93a4bfbfe575eaae670bb5bbd6689dcc4b186bc986e9be8a55" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.949998 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.951450 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.957328 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.957608 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ceilometer-internal-svc\"" Mar 16 16:52:52 crc kubenswrapper[5120]: I0316 16:52:52.957813 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 16:52:53 crc kubenswrapper[5120]: I0316 16:52:53.035555 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/61483cf5-d3db-49de-afa4-66f0efecdd70-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"61483cf5-d3db-49de-afa4-66f0efecdd70\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:52:53 crc kubenswrapper[5120]: I0316 16:52:53.035605 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/61483cf5-d3db-49de-afa4-66f0efecdd70-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"61483cf5-d3db-49de-afa4-66f0efecdd70\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:52:53 crc kubenswrapper[5120]: I0316 16:52:53.035710 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/61483cf5-d3db-49de-afa4-66f0efecdd70-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"61483cf5-d3db-49de-afa4-66f0efecdd70\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:52:53 crc kubenswrapper[5120]: I0316 16:52:53.035743 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/61483cf5-d3db-49de-afa4-66f0efecdd70-scripts\") pod \"ceilometer-0\" (UID: \"61483cf5-d3db-49de-afa4-66f0efecdd70\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:52:53 crc kubenswrapper[5120]: I0316 16:52:53.035854 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/61483cf5-d3db-49de-afa4-66f0efecdd70-config-data\") pod \"ceilometer-0\" (UID: \"61483cf5-d3db-49de-afa4-66f0efecdd70\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:52:53 crc kubenswrapper[5120]: I0316 16:52:53.035968 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/61483cf5-d3db-49de-afa4-66f0efecdd70-run-httpd\") pod \"ceilometer-0\" (UID: \"61483cf5-d3db-49de-afa4-66f0efecdd70\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:52:53 crc kubenswrapper[5120]: I0316 16:52:53.036021 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/61483cf5-d3db-49de-afa4-66f0efecdd70-log-httpd\") pod \"ceilometer-0\" (UID: \"61483cf5-d3db-49de-afa4-66f0efecdd70\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:52:53 crc kubenswrapper[5120]: I0316 16:52:53.036062 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xg6p5\" (UniqueName: \"kubernetes.io/projected/61483cf5-d3db-49de-afa4-66f0efecdd70-kube-api-access-xg6p5\") pod \"ceilometer-0\" (UID: \"61483cf5-d3db-49de-afa4-66f0efecdd70\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:52:53 crc kubenswrapper[5120]: I0316 16:52:53.083044 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-69d57497c4-7bhm5"] Mar 16 16:52:53 crc kubenswrapper[5120]: I0316 16:52:53.116252 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-7f77bff94b-c5ng2"] Mar 16 16:52:53 crc kubenswrapper[5120]: I0316 16:52:53.139475 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/61483cf5-d3db-49de-afa4-66f0efecdd70-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"61483cf5-d3db-49de-afa4-66f0efecdd70\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:52:53 crc kubenswrapper[5120]: I0316 16:52:53.139540 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/61483cf5-d3db-49de-afa4-66f0efecdd70-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"61483cf5-d3db-49de-afa4-66f0efecdd70\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:52:53 crc kubenswrapper[5120]: I0316 16:52:53.139711 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/61483cf5-d3db-49de-afa4-66f0efecdd70-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"61483cf5-d3db-49de-afa4-66f0efecdd70\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:52:53 crc kubenswrapper[5120]: I0316 16:52:53.139782 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/61483cf5-d3db-49de-afa4-66f0efecdd70-scripts\") pod \"ceilometer-0\" (UID: \"61483cf5-d3db-49de-afa4-66f0efecdd70\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:52:53 crc kubenswrapper[5120]: I0316 16:52:53.139917 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/61483cf5-d3db-49de-afa4-66f0efecdd70-config-data\") pod \"ceilometer-0\" (UID: \"61483cf5-d3db-49de-afa4-66f0efecdd70\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:52:53 crc kubenswrapper[5120]: I0316 16:52:53.142928 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/61483cf5-d3db-49de-afa4-66f0efecdd70-run-httpd\") pod \"ceilometer-0\" (UID: \"61483cf5-d3db-49de-afa4-66f0efecdd70\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:52:53 crc kubenswrapper[5120]: I0316 16:52:53.143097 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/61483cf5-d3db-49de-afa4-66f0efecdd70-log-httpd\") pod \"ceilometer-0\" (UID: \"61483cf5-d3db-49de-afa4-66f0efecdd70\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:52:53 crc kubenswrapper[5120]: I0316 16:52:53.143180 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xg6p5\" (UniqueName: \"kubernetes.io/projected/61483cf5-d3db-49de-afa4-66f0efecdd70-kube-api-access-xg6p5\") pod \"ceilometer-0\" (UID: \"61483cf5-d3db-49de-afa4-66f0efecdd70\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:52:53 crc kubenswrapper[5120]: I0316 16:52:53.144019 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/61483cf5-d3db-49de-afa4-66f0efecdd70-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"61483cf5-d3db-49de-afa4-66f0efecdd70\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:52:53 crc kubenswrapper[5120]: I0316 16:52:53.144517 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/61483cf5-d3db-49de-afa4-66f0efecdd70-run-httpd\") pod \"ceilometer-0\" (UID: \"61483cf5-d3db-49de-afa4-66f0efecdd70\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:52:53 crc kubenswrapper[5120]: I0316 16:52:53.144564 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/61483cf5-d3db-49de-afa4-66f0efecdd70-log-httpd\") pod \"ceilometer-0\" (UID: \"61483cf5-d3db-49de-afa4-66f0efecdd70\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:52:53 crc kubenswrapper[5120]: I0316 16:52:53.149482 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/61483cf5-d3db-49de-afa4-66f0efecdd70-scripts\") pod \"ceilometer-0\" (UID: \"61483cf5-d3db-49de-afa4-66f0efecdd70\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:52:53 crc kubenswrapper[5120]: I0316 16:52:53.152926 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-7f77bff94b-c5ng2"] Mar 16 16:52:53 crc kubenswrapper[5120]: I0316 16:52:53.153154 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-7f77bff94b-c5ng2" Mar 16 16:52:53 crc kubenswrapper[5120]: I0316 16:52:53.156323 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/61483cf5-d3db-49de-afa4-66f0efecdd70-config-data\") pod \"ceilometer-0\" (UID: \"61483cf5-d3db-49de-afa4-66f0efecdd70\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:52:53 crc kubenswrapper[5120]: I0316 16:52:53.164135 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/61483cf5-d3db-49de-afa4-66f0efecdd70-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"61483cf5-d3db-49de-afa4-66f0efecdd70\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:52:53 crc kubenswrapper[5120]: I0316 16:52:53.172417 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/61483cf5-d3db-49de-afa4-66f0efecdd70-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"61483cf5-d3db-49de-afa4-66f0efecdd70\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:52:53 crc kubenswrapper[5120]: I0316 16:52:53.186144 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:52:53 crc kubenswrapper[5120]: I0316 16:52:53.218588 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xg6p5\" (UniqueName: \"kubernetes.io/projected/61483cf5-d3db-49de-afa4-66f0efecdd70-kube-api-access-xg6p5\") pod \"ceilometer-0\" (UID: \"61483cf5-d3db-49de-afa4-66f0efecdd70\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:52:53 crc kubenswrapper[5120]: I0316 16:52:53.248024 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/67c7567e-232d-4853-961c-dcc1799c7dae-config-data\") pod \"placement-7f77bff94b-c5ng2\" (UID: \"67c7567e-232d-4853-961c-dcc1799c7dae\") " pod="openstack-kuttl-tests/placement-7f77bff94b-c5ng2" Mar 16 16:52:53 crc kubenswrapper[5120]: I0316 16:52:53.250939 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/67c7567e-232d-4853-961c-dcc1799c7dae-public-tls-certs\") pod \"placement-7f77bff94b-c5ng2\" (UID: \"67c7567e-232d-4853-961c-dcc1799c7dae\") " pod="openstack-kuttl-tests/placement-7f77bff94b-c5ng2" Mar 16 16:52:53 crc kubenswrapper[5120]: I0316 16:52:53.251170 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/67c7567e-232d-4853-961c-dcc1799c7dae-logs\") pod \"placement-7f77bff94b-c5ng2\" (UID: \"67c7567e-232d-4853-961c-dcc1799c7dae\") " pod="openstack-kuttl-tests/placement-7f77bff94b-c5ng2" Mar 16 16:52:53 crc kubenswrapper[5120]: I0316 16:52:53.251327 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkjvs\" (UniqueName: \"kubernetes.io/projected/67c7567e-232d-4853-961c-dcc1799c7dae-kube-api-access-wkjvs\") pod \"placement-7f77bff94b-c5ng2\" (UID: \"67c7567e-232d-4853-961c-dcc1799c7dae\") " pod="openstack-kuttl-tests/placement-7f77bff94b-c5ng2" Mar 16 16:52:53 crc kubenswrapper[5120]: I0316 16:52:53.251451 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/67c7567e-232d-4853-961c-dcc1799c7dae-combined-ca-bundle\") pod \"placement-7f77bff94b-c5ng2\" (UID: \"67c7567e-232d-4853-961c-dcc1799c7dae\") " pod="openstack-kuttl-tests/placement-7f77bff94b-c5ng2" Mar 16 16:52:53 crc kubenswrapper[5120]: I0316 16:52:53.251539 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/67c7567e-232d-4853-961c-dcc1799c7dae-internal-tls-certs\") pod \"placement-7f77bff94b-c5ng2\" (UID: \"67c7567e-232d-4853-961c-dcc1799c7dae\") " pod="openstack-kuttl-tests/placement-7f77bff94b-c5ng2" Mar 16 16:52:53 crc kubenswrapper[5120]: I0316 16:52:53.251639 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/67c7567e-232d-4853-961c-dcc1799c7dae-scripts\") pod \"placement-7f77bff94b-c5ng2\" (UID: \"67c7567e-232d-4853-961c-dcc1799c7dae\") " pod="openstack-kuttl-tests/placement-7f77bff94b-c5ng2" Mar 16 16:52:53 crc kubenswrapper[5120]: I0316 16:52:53.337012 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"b91a9930-eec4-4af5-9aee-5d02dc78fabc","Type":"ContainerStarted","Data":"06e2f505d2bd579b6df96b380bf3776387c478cd0e0a7fa427acf376d4656e87"} Mar 16 16:52:53 crc kubenswrapper[5120]: I0316 16:52:53.346396 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-7f78b864cb-6dgjh" event={"ID":"c06f24f9-95b0-4a92-ad3a-6075764151ed","Type":"ContainerStarted","Data":"5ca55cb347519b4334c3c6b37c431e0953788ca2ed0f3ca9ee1c934857dba490"} Mar 16 16:52:53 crc kubenswrapper[5120]: I0316 16:52:53.347442 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-7f78b864cb-6dgjh" Mar 16 16:52:53 crc kubenswrapper[5120]: I0316 16:52:53.347611 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-7f78b864cb-6dgjh" Mar 16 16:52:53 crc kubenswrapper[5120]: I0316 16:52:53.353782 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/67c7567e-232d-4853-961c-dcc1799c7dae-combined-ca-bundle\") pod \"placement-7f77bff94b-c5ng2\" (UID: \"67c7567e-232d-4853-961c-dcc1799c7dae\") " pod="openstack-kuttl-tests/placement-7f77bff94b-c5ng2" Mar 16 16:52:53 crc kubenswrapper[5120]: I0316 16:52:53.353866 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/67c7567e-232d-4853-961c-dcc1799c7dae-internal-tls-certs\") pod \"placement-7f77bff94b-c5ng2\" (UID: \"67c7567e-232d-4853-961c-dcc1799c7dae\") " pod="openstack-kuttl-tests/placement-7f77bff94b-c5ng2" Mar 16 16:52:53 crc kubenswrapper[5120]: I0316 16:52:53.353940 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/67c7567e-232d-4853-961c-dcc1799c7dae-scripts\") pod \"placement-7f77bff94b-c5ng2\" (UID: \"67c7567e-232d-4853-961c-dcc1799c7dae\") " pod="openstack-kuttl-tests/placement-7f77bff94b-c5ng2" Mar 16 16:52:53 crc kubenswrapper[5120]: I0316 16:52:53.354014 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/67c7567e-232d-4853-961c-dcc1799c7dae-config-data\") pod \"placement-7f77bff94b-c5ng2\" (UID: \"67c7567e-232d-4853-961c-dcc1799c7dae\") " pod="openstack-kuttl-tests/placement-7f77bff94b-c5ng2" Mar 16 16:52:53 crc kubenswrapper[5120]: I0316 16:52:53.354290 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/67c7567e-232d-4853-961c-dcc1799c7dae-public-tls-certs\") pod \"placement-7f77bff94b-c5ng2\" (UID: \"67c7567e-232d-4853-961c-dcc1799c7dae\") " pod="openstack-kuttl-tests/placement-7f77bff94b-c5ng2" Mar 16 16:52:53 crc kubenswrapper[5120]: I0316 16:52:53.354452 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/67c7567e-232d-4853-961c-dcc1799c7dae-logs\") pod \"placement-7f77bff94b-c5ng2\" (UID: \"67c7567e-232d-4853-961c-dcc1799c7dae\") " pod="openstack-kuttl-tests/placement-7f77bff94b-c5ng2" Mar 16 16:52:53 crc kubenswrapper[5120]: I0316 16:52:53.354500 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wkjvs\" (UniqueName: \"kubernetes.io/projected/67c7567e-232d-4853-961c-dcc1799c7dae-kube-api-access-wkjvs\") pod \"placement-7f77bff94b-c5ng2\" (UID: \"67c7567e-232d-4853-961c-dcc1799c7dae\") " pod="openstack-kuttl-tests/placement-7f77bff94b-c5ng2" Mar 16 16:52:53 crc kubenswrapper[5120]: I0316 16:52:53.380085 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/67c7567e-232d-4853-961c-dcc1799c7dae-internal-tls-certs\") pod \"placement-7f77bff94b-c5ng2\" (UID: \"67c7567e-232d-4853-961c-dcc1799c7dae\") " pod="openstack-kuttl-tests/placement-7f77bff94b-c5ng2" Mar 16 16:52:53 crc kubenswrapper[5120]: I0316 16:52:53.383455 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/67c7567e-232d-4853-961c-dcc1799c7dae-scripts\") pod \"placement-7f77bff94b-c5ng2\" (UID: \"67c7567e-232d-4853-961c-dcc1799c7dae\") " pod="openstack-kuttl-tests/placement-7f77bff94b-c5ng2" Mar 16 16:52:53 crc kubenswrapper[5120]: I0316 16:52:53.384698 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/67c7567e-232d-4853-961c-dcc1799c7dae-logs\") pod \"placement-7f77bff94b-c5ng2\" (UID: \"67c7567e-232d-4853-961c-dcc1799c7dae\") " pod="openstack-kuttl-tests/placement-7f77bff94b-c5ng2" Mar 16 16:52:53 crc kubenswrapper[5120]: I0316 16:52:53.393363 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-646d48c554-kk5ms" event={"ID":"fa4601ff-7ef6-4d2c-b0ca-b153763db12f","Type":"ContainerStarted","Data":"e7490c0e0d59a82483b2df6513e7e7eab4815275effa3bd260acd6d11c41af7d"} Mar 16 16:52:53 crc kubenswrapper[5120]: I0316 16:52:53.393685 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-api-7f78b864cb-6dgjh" podStartSLOduration=6.393663507 podStartE2EDuration="6.393663507s" podCreationTimestamp="2026-03-16 16:52:47 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:52:53.380378174 +0000 UTC m=+4875.534309851" watchObservedRunningTime="2026-03-16 16:52:53.393663507 +0000 UTC m=+4875.547595164" Mar 16 16:52:53 crc kubenswrapper[5120]: I0316 16:52:53.393821 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-646d48c554-kk5ms" podUID="fa4601ff-7ef6-4d2c-b0ca-b153763db12f" containerName="barbican-keystone-listener" containerID="cri-o://e7490c0e0d59a82483b2df6513e7e7eab4815275effa3bd260acd6d11c41af7d" gracePeriod=30 Mar 16 16:52:53 crc kubenswrapper[5120]: I0316 16:52:53.394401 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-646d48c554-kk5ms" podUID="fa4601ff-7ef6-4d2c-b0ca-b153763db12f" containerName="barbican-keystone-listener-log" containerID="cri-o://94f0f9d5ef7a9a1aa550cca1ce3c48dbb4ad2a4bfe3df33e0e300fede864cd03" gracePeriod=30 Mar 16 16:52:53 crc kubenswrapper[5120]: I0316 16:52:53.401959 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/67c7567e-232d-4853-961c-dcc1799c7dae-config-data\") pod \"placement-7f77bff94b-c5ng2\" (UID: \"67c7567e-232d-4853-961c-dcc1799c7dae\") " pod="openstack-kuttl-tests/placement-7f77bff94b-c5ng2" Mar 16 16:52:53 crc kubenswrapper[5120]: I0316 16:52:53.406644 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkjvs\" (UniqueName: \"kubernetes.io/projected/67c7567e-232d-4853-961c-dcc1799c7dae-kube-api-access-wkjvs\") pod \"placement-7f77bff94b-c5ng2\" (UID: \"67c7567e-232d-4853-961c-dcc1799c7dae\") " pod="openstack-kuttl-tests/placement-7f77bff94b-c5ng2" Mar 16 16:52:53 crc kubenswrapper[5120]: I0316 16:52:53.412672 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/67c7567e-232d-4853-961c-dcc1799c7dae-combined-ca-bundle\") pod \"placement-7f77bff94b-c5ng2\" (UID: \"67c7567e-232d-4853-961c-dcc1799c7dae\") " pod="openstack-kuttl-tests/placement-7f77bff94b-c5ng2" Mar 16 16:52:53 crc kubenswrapper[5120]: I0316 16:52:53.417031 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-786c646546-49lhr" event={"ID":"a7564ece-3e31-426b-a07b-1b9e12d76d01","Type":"ContainerStarted","Data":"a925b16bc707dd1b850ad386d8896edc36bd1221a6b55a9c743fc74aaec36eec"} Mar 16 16:52:53 crc kubenswrapper[5120]: I0316 16:52:53.423445 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-d7c95f898-g5nln" event={"ID":"ebceb235-ad03-49fd-9921-f5be8c1851be","Type":"ContainerStarted","Data":"6dbf15fc5cb9e1dfb9f424295383c4a6610b03bef67f06b2717ffa77e0acef49"} Mar 16 16:52:53 crc kubenswrapper[5120]: I0316 16:52:53.424654 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/neutron-d7c95f898-g5nln" Mar 16 16:52:53 crc kubenswrapper[5120]: I0316 16:52:53.430381 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/67c7567e-232d-4853-961c-dcc1799c7dae-public-tls-certs\") pod \"placement-7f77bff94b-c5ng2\" (UID: \"67c7567e-232d-4853-961c-dcc1799c7dae\") " pod="openstack-kuttl-tests/placement-7f77bff94b-c5ng2" Mar 16 16:52:53 crc kubenswrapper[5120]: I0316 16:52:53.435090 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-keystone-listener-646d48c554-kk5ms" podStartSLOduration=11.435067561 podStartE2EDuration="11.435067561s" podCreationTimestamp="2026-03-16 16:52:42 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:52:53.420332317 +0000 UTC m=+4875.574263974" watchObservedRunningTime="2026-03-16 16:52:53.435067561 +0000 UTC m=+4875.588999218" Mar 16 16:52:53 crc kubenswrapper[5120]: I0316 16:52:53.444697 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-69d57497c4-7bhm5" event={"ID":"f9a4fc77-147c-46f7-a4de-e36f3086b09b","Type":"ContainerStarted","Data":"214b9b807141dffba529059147015a1dff4f121e2338cd1014806da26ec56f8f"} Mar 16 16:52:53 crc kubenswrapper[5120]: I0316 16:52:53.459968 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"986cfe2c-03bb-4027-b930-79c5b3dd8fe4","Type":"ContainerStarted","Data":"4953a3c44bc238fbcf8c208701df55aea6785f9a7d44ee5bd9ecc32bbac1a728"} Mar 16 16:52:53 crc kubenswrapper[5120]: I0316 16:52:53.463907 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-d7c95f898-g5nln" podStartSLOduration=10.463869648 podStartE2EDuration="10.463869648s" podCreationTimestamp="2026-03-16 16:52:43 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:52:53.447743427 +0000 UTC m=+4875.601675094" watchObservedRunningTime="2026-03-16 16:52:53.463869648 +0000 UTC m=+4875.617801305" Mar 16 16:52:53 crc kubenswrapper[5120]: I0316 16:52:53.468103 5120 generic.go:358] "Generic (PLEG): container finished" podID="c846d2b2-0638-44bd-9ad0-6b6c76f8d16f" containerID="230653dbcfd778943f6ddd417a12dd48b5680b4e4b96b18fd7d3385ba610e6c3" exitCode=143 Mar 16 16:52:53 crc kubenswrapper[5120]: I0316 16:52:53.468203 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-7bf49bf568-fbg2k" event={"ID":"c846d2b2-0638-44bd-9ad0-6b6c76f8d16f","Type":"ContainerDied","Data":"230653dbcfd778943f6ddd417a12dd48b5680b4e4b96b18fd7d3385ba610e6c3"} Mar 16 16:52:53 crc kubenswrapper[5120]: I0316 16:52:53.572383 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:52:53 crc kubenswrapper[5120]: I0316 16:52:53.802121 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:52:53 crc kubenswrapper[5120]: I0316 16:52:53.810652 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:52:53 crc kubenswrapper[5120]: I0316 16:52:53.841209 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:52:53 crc kubenswrapper[5120]: I0316 16:52:53.855678 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:52:53 crc kubenswrapper[5120]: I0316 16:52:53.885126 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:52:53 crc kubenswrapper[5120]: I0316 16:52:53.903013 5120 scope.go:117] "RemoveContainer" containerID="0cf2639ccd5dcff044d74634742ba674b06691c33be27480bff7ec2d5a0d3b02" Mar 16 16:52:53 crc kubenswrapper[5120]: I0316 16:52:53.942105 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:52:53 crc kubenswrapper[5120]: I0316 16:52:53.960095 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:52:53 crc kubenswrapper[5120]: I0316 16:52:53.975074 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:52:53 crc kubenswrapper[5120]: I0316 16:52:53.993944 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:52:54 crc kubenswrapper[5120]: I0316 16:52:54.010646 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:52:54 crc kubenswrapper[5120]: I0316 16:52:54.034569 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-7f77bff94b-c5ng2" Mar 16 16:52:54 crc kubenswrapper[5120]: I0316 16:52:54.085593 5120 scope.go:117] "RemoveContainer" containerID="8218d57425e63f9f4bbf8069b07d24343f9df58411b9fc34d1dabf1911b5d806" Mar 16 16:52:54 crc kubenswrapper[5120]: I0316 16:52:54.089232 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8rf8s\" (UniqueName: \"kubernetes.io/projected/37c6de80-ff10-4d44-a806-b8ad82e62d82-kube-api-access-8rf8s\") pod \"37c6de80-ff10-4d44-a806-b8ad82e62d82\" (UID: \"37c6de80-ff10-4d44-a806-b8ad82e62d82\") " Mar 16 16:52:54 crc kubenswrapper[5120]: I0316 16:52:54.089795 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/37c6de80-ff10-4d44-a806-b8ad82e62d82-config-data\") pod \"37c6de80-ff10-4d44-a806-b8ad82e62d82\" (UID: \"37c6de80-ff10-4d44-a806-b8ad82e62d82\") " Mar 16 16:52:54 crc kubenswrapper[5120]: I0316 16:52:54.089915 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/37c6de80-ff10-4d44-a806-b8ad82e62d82-combined-ca-bundle\") pod \"37c6de80-ff10-4d44-a806-b8ad82e62d82\" (UID: \"37c6de80-ff10-4d44-a806-b8ad82e62d82\") " Mar 16 16:52:54 crc kubenswrapper[5120]: I0316 16:52:54.105474 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37c6de80-ff10-4d44-a806-b8ad82e62d82-kube-api-access-8rf8s" (OuterVolumeSpecName: "kube-api-access-8rf8s") pod "37c6de80-ff10-4d44-a806-b8ad82e62d82" (UID: "37c6de80-ff10-4d44-a806-b8ad82e62d82"). InnerVolumeSpecName "kube-api-access-8rf8s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:52:54 crc kubenswrapper[5120]: I0316 16:52:54.174747 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37c6de80-ff10-4d44-a806-b8ad82e62d82-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "37c6de80-ff10-4d44-a806-b8ad82e62d82" (UID: "37c6de80-ff10-4d44-a806-b8ad82e62d82"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:52:54 crc kubenswrapper[5120]: I0316 16:52:54.186959 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37c6de80-ff10-4d44-a806-b8ad82e62d82-config-data" (OuterVolumeSpecName: "config-data") pod "37c6de80-ff10-4d44-a806-b8ad82e62d82" (UID: "37c6de80-ff10-4d44-a806-b8ad82e62d82"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:52:54 crc kubenswrapper[5120]: I0316 16:52:54.205693 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/37c6de80-ff10-4d44-a806-b8ad82e62d82-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:54 crc kubenswrapper[5120]: I0316 16:52:54.205736 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/37c6de80-ff10-4d44-a806-b8ad82e62d82-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:54 crc kubenswrapper[5120]: I0316 16:52:54.205770 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8rf8s\" (UniqueName: \"kubernetes.io/projected/37c6de80-ff10-4d44-a806-b8ad82e62d82-kube-api-access-8rf8s\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:54 crc kubenswrapper[5120]: I0316 16:52:54.699508 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podUID="18684823-3972-4cf6-8e42-792360b387bb" containerName="openstack-network-exporter" containerID="cri-o://d6bea12055370a1dc7acd4f390291dbab688f64eab6591ce209d3b4f27519cf2" gracePeriod=300 Mar 16 16:52:54 crc kubenswrapper[5120]: I0316 16:52:54.709988 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7e017064-86c6-413e-b003-2f5df3306952" path="/var/lib/kubelet/pods/7e017064-86c6-413e-b003-2f5df3306952/volumes" Mar 16 16:52:54 crc kubenswrapper[5120]: I0316 16:52:54.712236 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"18684823-3972-4cf6-8e42-792360b387bb","Type":"ContainerStarted","Data":"d6bea12055370a1dc7acd4f390291dbab688f64eab6591ce209d3b4f27519cf2"} Mar 16 16:52:54 crc kubenswrapper[5120]: I0316 16:52:54.741237 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podStartSLOduration=7.74121651 podStartE2EDuration="7.74121651s" podCreationTimestamp="2026-03-16 16:52:47 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:52:54.737469578 +0000 UTC m=+4876.891401245" watchObservedRunningTime="2026-03-16 16:52:54.74121651 +0000 UTC m=+4876.895148167" Mar 16 16:52:54 crc kubenswrapper[5120]: I0316 16:52:54.764283 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"18e2f22a-0bc1-4514-afe4-56bdf5cb1670","Type":"ContainerStarted","Data":"c93e64b15c166ba718c199a2500ca4e4c998e0677346f6d61e58dc0ac5de1dbf"} Mar 16 16:52:54 crc kubenswrapper[5120]: I0316 16:52:54.765524 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 16:52:54 crc kubenswrapper[5120]: I0316 16:52:54.789984 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"b4ce877d-d510-483c-9a9c-b149879f1755","Type":"ContainerStarted","Data":"106fb2580c007101a64c83a69eca8e3b40b701c863865cb199fda26045d46575"} Mar 16 16:52:54 crc kubenswrapper[5120]: I0316 16:52:54.805859 5120 scope.go:117] "RemoveContainer" containerID="a27b058fc327b7f2b23592539c20e14a76cfbc908fe6c7ae8c356b40f8a204c5" Mar 16 16:52:54 crc kubenswrapper[5120]: E0316 16:52:54.809907 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a27b058fc327b7f2b23592539c20e14a76cfbc908fe6c7ae8c356b40f8a204c5\": container with ID starting with a27b058fc327b7f2b23592539c20e14a76cfbc908fe6c7ae8c356b40f8a204c5 not found: ID does not exist" containerID="a27b058fc327b7f2b23592539c20e14a76cfbc908fe6c7ae8c356b40f8a204c5" Mar 16 16:52:54 crc kubenswrapper[5120]: I0316 16:52:54.809958 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a27b058fc327b7f2b23592539c20e14a76cfbc908fe6c7ae8c356b40f8a204c5"} err="failed to get container status \"a27b058fc327b7f2b23592539c20e14a76cfbc908fe6c7ae8c356b40f8a204c5\": rpc error: code = NotFound desc = could not find container \"a27b058fc327b7f2b23592539c20e14a76cfbc908fe6c7ae8c356b40f8a204c5\": container with ID starting with a27b058fc327b7f2b23592539c20e14a76cfbc908fe6c7ae8c356b40f8a204c5 not found: ID does not exist" Mar 16 16:52:54 crc kubenswrapper[5120]: I0316 16:52:54.809991 5120 scope.go:117] "RemoveContainer" containerID="e737c3a8474b5b2441a2fe0e5e4c4c27b963e84e3c1ac1e70370959759d8773d" Mar 16 16:52:54 crc kubenswrapper[5120]: E0316 16:52:54.818133 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e737c3a8474b5b2441a2fe0e5e4c4c27b963e84e3c1ac1e70370959759d8773d\": container with ID starting with e737c3a8474b5b2441a2fe0e5e4c4c27b963e84e3c1ac1e70370959759d8773d not found: ID does not exist" containerID="e737c3a8474b5b2441a2fe0e5e4c4c27b963e84e3c1ac1e70370959759d8773d" Mar 16 16:52:54 crc kubenswrapper[5120]: I0316 16:52:54.818198 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e737c3a8474b5b2441a2fe0e5e4c4c27b963e84e3c1ac1e70370959759d8773d"} err="failed to get container status \"e737c3a8474b5b2441a2fe0e5e4c4c27b963e84e3c1ac1e70370959759d8773d\": rpc error: code = NotFound desc = could not find container \"e737c3a8474b5b2441a2fe0e5e4c4c27b963e84e3c1ac1e70370959759d8773d\": container with ID starting with e737c3a8474b5b2441a2fe0e5e4c4c27b963e84e3c1ac1e70370959759d8773d not found: ID does not exist" Mar 16 16:52:54 crc kubenswrapper[5120]: I0316 16:52:54.818233 5120 scope.go:117] "RemoveContainer" containerID="0cf2639ccd5dcff044d74634742ba674b06691c33be27480bff7ec2d5a0d3b02" Mar 16 16:52:54 crc kubenswrapper[5120]: E0316 16:52:54.821486 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0cf2639ccd5dcff044d74634742ba674b06691c33be27480bff7ec2d5a0d3b02\": container with ID starting with 0cf2639ccd5dcff044d74634742ba674b06691c33be27480bff7ec2d5a0d3b02 not found: ID does not exist" containerID="0cf2639ccd5dcff044d74634742ba674b06691c33be27480bff7ec2d5a0d3b02" Mar 16 16:52:54 crc kubenswrapper[5120]: I0316 16:52:54.821530 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0cf2639ccd5dcff044d74634742ba674b06691c33be27480bff7ec2d5a0d3b02"} err="failed to get container status \"0cf2639ccd5dcff044d74634742ba674b06691c33be27480bff7ec2d5a0d3b02\": rpc error: code = NotFound desc = could not find container \"0cf2639ccd5dcff044d74634742ba674b06691c33be27480bff7ec2d5a0d3b02\": container with ID starting with 0cf2639ccd5dcff044d74634742ba674b06691c33be27480bff7ec2d5a0d3b02 not found: ID does not exist" Mar 16 16:52:54 crc kubenswrapper[5120]: I0316 16:52:54.821558 5120 scope.go:117] "RemoveContainer" containerID="8218d57425e63f9f4bbf8069b07d24343f9df58411b9fc34d1dabf1911b5d806" Mar 16 16:52:54 crc kubenswrapper[5120]: E0316 16:52:54.823240 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8218d57425e63f9f4bbf8069b07d24343f9df58411b9fc34d1dabf1911b5d806\": container with ID starting with 8218d57425e63f9f4bbf8069b07d24343f9df58411b9fc34d1dabf1911b5d806 not found: ID does not exist" containerID="8218d57425e63f9f4bbf8069b07d24343f9df58411b9fc34d1dabf1911b5d806" Mar 16 16:52:54 crc kubenswrapper[5120]: I0316 16:52:54.823267 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8218d57425e63f9f4bbf8069b07d24343f9df58411b9fc34d1dabf1911b5d806"} err="failed to get container status \"8218d57425e63f9f4bbf8069b07d24343f9df58411b9fc34d1dabf1911b5d806\": rpc error: code = NotFound desc = could not find container \"8218d57425e63f9f4bbf8069b07d24343f9df58411b9fc34d1dabf1911b5d806\": container with ID starting with 8218d57425e63f9f4bbf8069b07d24343f9df58411b9fc34d1dabf1911b5d806 not found: ID does not exist" Mar 16 16:52:54 crc kubenswrapper[5120]: I0316 16:52:54.832529 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-5f687f46f5-qdrk5" event={"ID":"a5396fe3-454e-4707-b185-5ad652c091da","Type":"ContainerStarted","Data":"316ceb783284a9aa1a89110aa909af4bccff62799441dd3c5d0c4df5b0b80c62"} Mar 16 16:52:54 crc kubenswrapper[5120]: I0316 16:52:54.832575 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-5f687f46f5-qdrk5" event={"ID":"a5396fe3-454e-4707-b185-5ad652c091da","Type":"ContainerStarted","Data":"d527d53f1efda798a88fbbb030e0328a56d2926e6ca6e2916bd72f1280b74ff3"} Mar 16 16:52:54 crc kubenswrapper[5120]: I0316 16:52:54.848368 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"72edd543-4bf8-407e-9929-47d4e9727134","Type":"ContainerStarted","Data":"ca5a9a1a02d3db75901ec82f4c35e00a5d690aea3a401a915e06cc5e40282eea"} Mar 16 16:52:54 crc kubenswrapper[5120]: I0316 16:52:54.848655 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovn-northd-0" podUID="72edd543-4bf8-407e-9929-47d4e9727134" containerName="ovn-northd" containerID="cri-o://dff05d001161dd73ee301824319b7393ecaf3fe56d375faa6a317018e3fee33b" gracePeriod=30 Mar 16 16:52:54 crc kubenswrapper[5120]: I0316 16:52:54.848987 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:52:54 crc kubenswrapper[5120]: I0316 16:52:54.849035 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovn-northd-0" podUID="72edd543-4bf8-407e-9929-47d4e9727134" containerName="openstack-network-exporter" containerID="cri-o://ca5a9a1a02d3db75901ec82f4c35e00a5d690aea3a401a915e06cc5e40282eea" gracePeriod=30 Mar 16 16:52:54 crc kubenswrapper[5120]: I0316 16:52:54.860336 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podStartSLOduration=5.860311991 podStartE2EDuration="5.860311991s" podCreationTimestamp="2026-03-16 16:52:49 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:52:54.788203067 +0000 UTC m=+4876.942134724" watchObservedRunningTime="2026-03-16 16:52:54.860311991 +0000 UTC m=+4877.014243648" Mar 16 16:52:54 crc kubenswrapper[5120]: W0316 16:52:54.877608 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode5c498e5_584c_4cdd_b008_c643b7bb1bc5.slice/crio-8ad11216cee7d67fd4ad6baa240839fa389afe7496128def0dc5bd74133aa3e6 WatchSource:0}: Error finding container 8ad11216cee7d67fd4ad6baa240839fa389afe7496128def0dc5bd74133aa3e6: Status 404 returned error can't find the container with id 8ad11216cee7d67fd4ad6baa240839fa389afe7496128def0dc5bd74133aa3e6 Mar 16 16:52:54 crc kubenswrapper[5120]: I0316 16:52:54.883406 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-worker-5f687f46f5-qdrk5" podStartSLOduration=8.883362161 podStartE2EDuration="8.883362161s" podCreationTimestamp="2026-03-16 16:52:46 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:52:54.854215103 +0000 UTC m=+4877.008146760" watchObservedRunningTime="2026-03-16 16:52:54.883362161 +0000 UTC m=+4877.037293838" Mar 16 16:52:54 crc kubenswrapper[5120]: I0316 16:52:54.886033 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-d99589cd-7z8cg" event={"ID":"cc7ba52a-5825-4399-9e38-4d5cd1c02156","Type":"ContainerStarted","Data":"c269982f7bd61da7b75cbb3cc404cf21021ad56400074e1ad1d8e47d158c1c63"} Mar 16 16:52:54 crc kubenswrapper[5120]: I0316 16:52:54.886104 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-d99589cd-7z8cg" Mar 16 16:52:54 crc kubenswrapper[5120]: I0316 16:52:54.886142 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-d99589cd-7z8cg" Mar 16 16:52:54 crc kubenswrapper[5120]: I0316 16:52:54.886135 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-d99589cd-7z8cg" podUID="cc7ba52a-5825-4399-9e38-4d5cd1c02156" containerName="placement-log" containerID="cri-o://90916447cca93d6401deab90112baaf449192048ae8cc43a6c81786b2c2628a9" gracePeriod=30 Mar 16 16:52:54 crc kubenswrapper[5120]: I0316 16:52:54.886311 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-d99589cd-7z8cg" podUID="cc7ba52a-5825-4399-9e38-4d5cd1c02156" containerName="placement-api" containerID="cri-o://c269982f7bd61da7b75cbb3cc404cf21021ad56400074e1ad1d8e47d158c1c63" gracePeriod=30 Mar 16 16:52:54 crc kubenswrapper[5120]: I0316 16:52:54.890615 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovn-northd-0" podStartSLOduration=9.890588699 podStartE2EDuration="9.890588699s" podCreationTimestamp="2026-03-16 16:52:45 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:52:54.883355981 +0000 UTC m=+4877.037287638" watchObservedRunningTime="2026-03-16 16:52:54.890588699 +0000 UTC m=+4877.044520356" Mar 16 16:52:54 crc kubenswrapper[5120]: I0316 16:52:54.913129 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podUID="18684823-3972-4cf6-8e42-792360b387bb" containerName="ovsdbserver-sb" containerID="cri-o://c37bdc03a053afc82ef80c0a8a9c3c36b8cbfaa6885189827254366781339f42" gracePeriod=300 Mar 16 16:52:54 crc kubenswrapper[5120]: I0316 16:52:54.927009 5120 generic.go:358] "Generic (PLEG): container finished" podID="fa4601ff-7ef6-4d2c-b0ca-b153763db12f" containerID="94f0f9d5ef7a9a1aa550cca1ce3c48dbb4ad2a4bfe3df33e0e300fede864cd03" exitCode=143 Mar 16 16:52:54 crc kubenswrapper[5120]: I0316 16:52:54.927107 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-646d48c554-kk5ms" event={"ID":"fa4601ff-7ef6-4d2c-b0ca-b153763db12f","Type":"ContainerDied","Data":"94f0f9d5ef7a9a1aa550cca1ce3c48dbb4ad2a4bfe3df33e0e300fede864cd03"} Mar 16 16:52:54 crc kubenswrapper[5120]: I0316 16:52:54.941739 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-576bc9cb6c-q5s4k"] Mar 16 16:52:54 crc kubenswrapper[5120]: I0316 16:52:54.942038 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-576bc9cb6c-q5s4k" podUID="976611b4-4a36-49a3-9bd6-f7b5ca2899f4" containerName="barbican-worker-log" containerID="cri-o://cb64ef40b3869f4282e91f93befbe663c5f19a49ae3de83e88840e49b9ad4dea" gracePeriod=30 Mar 16 16:52:54 crc kubenswrapper[5120]: I0316 16:52:54.942197 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-576bc9cb6c-q5s4k" podUID="976611b4-4a36-49a3-9bd6-f7b5ca2899f4" containerName="barbican-worker" containerID="cri-o://7ec001db9d9a0dc8f997385521689fb1115f53c263a2c629d27622f8ad07041d" gracePeriod=30 Mar 16 16:52:54 crc kubenswrapper[5120]: I0316 16:52:54.942919 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-786c646546-49lhr" event={"ID":"a7564ece-3e31-426b-a07b-1b9e12d76d01","Type":"ContainerStarted","Data":"90fa913e82e6a693d89c84435eb04f963c4d8b4c4ab762c7bcba095c8c48203e"} Mar 16 16:52:54 crc kubenswrapper[5120]: I0316 16:52:54.958540 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-69d57497c4-7bhm5" event={"ID":"f9a4fc77-147c-46f7-a4de-e36f3086b09b","Type":"ContainerStarted","Data":"3184591cfeb6be7145725a7421e98898364ca1929244d5f99995dc4fa0dd58e0"} Mar 16 16:52:54 crc kubenswrapper[5120]: I0316 16:52:54.958796 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-69d57497c4-7bhm5" podUID="f9a4fc77-147c-46f7-a4de-e36f3086b09b" containerName="placement-log" containerID="cri-o://214b9b807141dffba529059147015a1dff4f121e2338cd1014806da26ec56f8f" gracePeriod=30 Mar 16 16:52:54 crc kubenswrapper[5120]: I0316 16:52:54.959399 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-69d57497c4-7bhm5" Mar 16 16:52:54 crc kubenswrapper[5120]: I0316 16:52:54.959428 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-69d57497c4-7bhm5" Mar 16 16:52:54 crc kubenswrapper[5120]: I0316 16:52:54.959498 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-69d57497c4-7bhm5" podUID="f9a4fc77-147c-46f7-a4de-e36f3086b09b" containerName="placement-api" containerID="cri-o://3184591cfeb6be7145725a7421e98898364ca1929244d5f99995dc4fa0dd58e0" gracePeriod=30 Mar 16 16:52:54 crc kubenswrapper[5120]: I0316 16:52:54.977687 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-d99589cd-7z8cg" podStartSLOduration=11.977666532 podStartE2EDuration="11.977666532s" podCreationTimestamp="2026-03-16 16:52:43 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:52:54.913223188 +0000 UTC m=+4877.067154855" watchObservedRunningTime="2026-03-16 16:52:54.977666532 +0000 UTC m=+4877.131598199" Mar 16 16:52:55 crc kubenswrapper[5120]: I0316 16:52:55.004444 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"986cfe2c-03bb-4027-b930-79c5b3dd8fe4","Type":"ContainerStarted","Data":"93704be7a1911253e9bec47c485dbaf555ed483872f59ee96ad929fb574a1c97"} Mar 16 16:52:55 crc kubenswrapper[5120]: I0316 16:52:55.004985 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podUID="986cfe2c-03bb-4027-b930-79c5b3dd8fe4" containerName="openstack-network-exporter" containerID="cri-o://93704be7a1911253e9bec47c485dbaf555ed483872f59ee96ad929fb574a1c97" gracePeriod=300 Mar 16 16:52:55 crc kubenswrapper[5120]: I0316 16:52:55.022703 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:52:55 crc kubenswrapper[5120]: I0316 16:52:55.045220 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 16:52:55 crc kubenswrapper[5120]: I0316 16:52:55.100542 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-keystone-listener-786c646546-49lhr" podStartSLOduration=9.100523305 podStartE2EDuration="9.100523305s" podCreationTimestamp="2026-03-16 16:52:46 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:52:54.976017927 +0000 UTC m=+4877.129949594" watchObservedRunningTime="2026-03-16 16:52:55.100523305 +0000 UTC m=+4877.254454972" Mar 16 16:52:55 crc kubenswrapper[5120]: I0316 16:52:55.148070 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-576c5b55d6-5zsh7"] Mar 16 16:52:55 crc kubenswrapper[5120]: I0316 16:52:55.148294 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-576c5b55d6-5zsh7" podUID="fb4496e5-279b-4520-a345-c4ed00ede8c9" containerName="barbican-keystone-listener-log" containerID="cri-o://31db12e43658d9b439ba1ed20816294a537012094b7d53a0e297f4d8b5dc66b2" gracePeriod=30 Mar 16 16:52:55 crc kubenswrapper[5120]: I0316 16:52:55.148724 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-576c5b55d6-5zsh7" podUID="fb4496e5-279b-4520-a345-c4ed00ede8c9" containerName="barbican-keystone-listener" containerID="cri-o://6b88504f95b540a2b147aae744cdfc0147fe840248de0b7dbb003027bcb85307" gracePeriod=30 Mar 16 16:52:55 crc kubenswrapper[5120]: I0316 16:52:55.173578 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-69d57497c4-7bhm5" podStartSLOduration=8.173554494 podStartE2EDuration="8.173554494s" podCreationTimestamp="2026-03-16 16:52:47 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:52:55.013143404 +0000 UTC m=+4877.167075081" watchObservedRunningTime="2026-03-16 16:52:55.173554494 +0000 UTC m=+4877.327486151" Mar 16 16:52:55 crc kubenswrapper[5120]: I0316 16:52:55.195809 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podStartSLOduration=8.195785502 podStartE2EDuration="8.195785502s" podCreationTimestamp="2026-03-16 16:52:47 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:52:55.038252341 +0000 UTC m=+4877.192183988" watchObservedRunningTime="2026-03-16 16:52:55.195785502 +0000 UTC m=+4877.349717179" Mar 16 16:52:55 crc kubenswrapper[5120]: I0316 16:52:55.301128 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podUID="986cfe2c-03bb-4027-b930-79c5b3dd8fe4" containerName="ovsdbserver-nb" containerID="cri-o://4953a3c44bc238fbcf8c208701df55aea6785f9a7d44ee5bd9ecc32bbac1a728" gracePeriod=300 Mar 16 16:52:55 crc kubenswrapper[5120]: I0316 16:52:55.342814 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:52:55 crc kubenswrapper[5120]: I0316 16:52:55.422079 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:52:55 crc kubenswrapper[5120]: I0316 16:52:55.477861 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:52:55 crc kubenswrapper[5120]: I0316 16:52:55.479134 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37c6de80-ff10-4d44-a806-b8ad82e62d82" containerName="nova-scheduler-scheduler" Mar 16 16:52:55 crc kubenswrapper[5120]: I0316 16:52:55.479156 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="37c6de80-ff10-4d44-a806-b8ad82e62d82" containerName="nova-scheduler-scheduler" Mar 16 16:52:55 crc kubenswrapper[5120]: I0316 16:52:55.479330 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="37c6de80-ff10-4d44-a806-b8ad82e62d82" containerName="nova-scheduler-scheduler" Mar 16 16:52:55 crc kubenswrapper[5120]: I0316 16:52:55.537068 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:52:55 crc kubenswrapper[5120]: I0316 16:52:55.541311 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:52:55 crc kubenswrapper[5120]: I0316 16:52:55.542135 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-scheduler-config-data\"" Mar 16 16:52:55 crc kubenswrapper[5120]: I0316 16:52:55.571967 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:52:55 crc kubenswrapper[5120]: I0316 16:52:55.618954 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:52:55 crc kubenswrapper[5120]: I0316 16:52:55.628920 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:52:55 crc kubenswrapper[5120]: I0316 16:52:55.684523 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/20f74fa1-8357-4b18-928a-4ae91c38bafe-config-data\") pod \"nova-scheduler-0\" (UID: \"20f74fa1-8357-4b18-928a-4ae91c38bafe\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:52:55 crc kubenswrapper[5120]: I0316 16:52:55.684622 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/20f74fa1-8357-4b18-928a-4ae91c38bafe-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"20f74fa1-8357-4b18-928a-4ae91c38bafe\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:52:55 crc kubenswrapper[5120]: I0316 16:52:55.684693 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7x7ml\" (UniqueName: \"kubernetes.io/projected/20f74fa1-8357-4b18-928a-4ae91c38bafe-kube-api-access-7x7ml\") pod \"nova-scheduler-0\" (UID: \"20f74fa1-8357-4b18-928a-4ae91c38bafe\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:52:55 crc kubenswrapper[5120]: I0316 16:52:55.746056 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:52:55 crc kubenswrapper[5120]: I0316 16:52:55.779474 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 16:52:55 crc kubenswrapper[5120]: I0316 16:52:55.790166 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/20f74fa1-8357-4b18-928a-4ae91c38bafe-config-data\") pod \"nova-scheduler-0\" (UID: \"20f74fa1-8357-4b18-928a-4ae91c38bafe\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:52:55 crc kubenswrapper[5120]: I0316 16:52:55.790344 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/20f74fa1-8357-4b18-928a-4ae91c38bafe-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"20f74fa1-8357-4b18-928a-4ae91c38bafe\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:52:55 crc kubenswrapper[5120]: I0316 16:52:55.790479 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7x7ml\" (UniqueName: \"kubernetes.io/projected/20f74fa1-8357-4b18-928a-4ae91c38bafe-kube-api-access-7x7ml\") pod \"nova-scheduler-0\" (UID: \"20f74fa1-8357-4b18-928a-4ae91c38bafe\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:52:55 crc kubenswrapper[5120]: I0316 16:52:55.802879 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/20f74fa1-8357-4b18-928a-4ae91c38bafe-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"20f74fa1-8357-4b18-928a-4ae91c38bafe\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:52:55 crc kubenswrapper[5120]: I0316 16:52:55.805426 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/20f74fa1-8357-4b18-928a-4ae91c38bafe-config-data\") pod \"nova-scheduler-0\" (UID: \"20f74fa1-8357-4b18-928a-4ae91c38bafe\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:52:55 crc kubenswrapper[5120]: I0316 16:52:55.809701 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7x7ml\" (UniqueName: \"kubernetes.io/projected/20f74fa1-8357-4b18-928a-4ae91c38bafe-kube-api-access-7x7ml\") pod \"nova-scheduler-0\" (UID: \"20f74fa1-8357-4b18-928a-4ae91c38bafe\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:52:55 crc kubenswrapper[5120]: W0316 16:52:55.998743 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod607fee19_adac_44b4_9f70_a6f6f3e59aed.slice/crio-8e7710e79f9090a4bc7c1041c56739c41ba1c4c8d5f71fddc3d32723f2be0e0e WatchSource:0}: Error finding container 8e7710e79f9090a4bc7c1041c56739c41ba1c4c8d5f71fddc3d32723f2be0e0e: Status 404 returned error can't find the container with id 8e7710e79f9090a4bc7c1041c56739c41ba1c4c8d5f71fddc3d32723f2be0e0e Mar 16 16:52:56 crc kubenswrapper[5120]: W0316 16:52:56.052266 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod26d7e714_e270_4150_9fc2_65e289bbd688.slice/crio-755c42e1ed74f1f57c1cc7f1151eab0b24f90cd185c3418945fdfde0ab53c586 WatchSource:0}: Error finding container 755c42e1ed74f1f57c1cc7f1151eab0b24f90cd185c3418945fdfde0ab53c586: Status 404 returned error can't find the container with id 755c42e1ed74f1f57c1cc7f1151eab0b24f90cd185c3418945fdfde0ab53c586 Mar 16 16:52:56 crc kubenswrapper[5120]: I0316 16:52:56.107401 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_18684823-3972-4cf6-8e42-792360b387bb/ovsdbserver-sb/0.log" Mar 16 16:52:56 crc kubenswrapper[5120]: I0316 16:52:56.107576 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"18684823-3972-4cf6-8e42-792360b387bb","Type":"ContainerDied","Data":"d6bea12055370a1dc7acd4f390291dbab688f64eab6591ce209d3b4f27519cf2"} Mar 16 16:52:56 crc kubenswrapper[5120]: I0316 16:52:56.107469 5120 generic.go:358] "Generic (PLEG): container finished" podID="18684823-3972-4cf6-8e42-792360b387bb" containerID="d6bea12055370a1dc7acd4f390291dbab688f64eab6591ce209d3b4f27519cf2" exitCode=2 Mar 16 16:52:56 crc kubenswrapper[5120]: I0316 16:52:56.108485 5120 generic.go:358] "Generic (PLEG): container finished" podID="18684823-3972-4cf6-8e42-792360b387bb" containerID="c37bdc03a053afc82ef80c0a8a9c3c36b8cbfaa6885189827254366781339f42" exitCode=143 Mar 16 16:52:56 crc kubenswrapper[5120]: I0316 16:52:56.108794 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"18684823-3972-4cf6-8e42-792360b387bb","Type":"ContainerDied","Data":"c37bdc03a053afc82ef80c0a8a9c3c36b8cbfaa6885189827254366781339f42"} Mar 16 16:52:56 crc kubenswrapper[5120]: I0316 16:52:56.108825 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"18684823-3972-4cf6-8e42-792360b387bb","Type":"ContainerDied","Data":"2565939eb23b5b631e3c1f1221225fa9c74e1f8026e97fe9032352ec781092ee"} Mar 16 16:52:56 crc kubenswrapper[5120]: I0316 16:52:56.108835 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2565939eb23b5b631e3c1f1221225fa9c74e1f8026e97fe9032352ec781092ee" Mar 16 16:52:56 crc kubenswrapper[5120]: I0316 16:52:56.119488 5120 generic.go:358] "Generic (PLEG): container finished" podID="72edd543-4bf8-407e-9929-47d4e9727134" containerID="ca5a9a1a02d3db75901ec82f4c35e00a5d690aea3a401a915e06cc5e40282eea" exitCode=2 Mar 16 16:52:56 crc kubenswrapper[5120]: I0316 16:52:56.119592 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"72edd543-4bf8-407e-9929-47d4e9727134","Type":"ContainerDied","Data":"ca5a9a1a02d3db75901ec82f4c35e00a5d690aea3a401a915e06cc5e40282eea"} Mar 16 16:52:56 crc kubenswrapper[5120]: I0316 16:52:56.137474 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"607fee19-adac-44b4-9f70-a6f6f3e59aed","Type":"ContainerStarted","Data":"8e7710e79f9090a4bc7c1041c56739c41ba1c4c8d5f71fddc3d32723f2be0e0e"} Mar 16 16:52:56 crc kubenswrapper[5120]: I0316 16:52:56.161109 5120 generic.go:358] "Generic (PLEG): container finished" podID="976611b4-4a36-49a3-9bd6-f7b5ca2899f4" containerID="7ec001db9d9a0dc8f997385521689fb1115f53c263a2c629d27622f8ad07041d" exitCode=0 Mar 16 16:52:56 crc kubenswrapper[5120]: I0316 16:52:56.161139 5120 generic.go:358] "Generic (PLEG): container finished" podID="976611b4-4a36-49a3-9bd6-f7b5ca2899f4" containerID="cb64ef40b3869f4282e91f93befbe663c5f19a49ae3de83e88840e49b9ad4dea" exitCode=143 Mar 16 16:52:56 crc kubenswrapper[5120]: I0316 16:52:56.161195 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-576bc9cb6c-q5s4k" event={"ID":"976611b4-4a36-49a3-9bd6-f7b5ca2899f4","Type":"ContainerDied","Data":"7ec001db9d9a0dc8f997385521689fb1115f53c263a2c629d27622f8ad07041d"} Mar 16 16:52:56 crc kubenswrapper[5120]: I0316 16:52:56.161226 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-576bc9cb6c-q5s4k" event={"ID":"976611b4-4a36-49a3-9bd6-f7b5ca2899f4","Type":"ContainerDied","Data":"cb64ef40b3869f4282e91f93befbe663c5f19a49ae3de83e88840e49b9ad4dea"} Mar 16 16:52:56 crc kubenswrapper[5120]: I0316 16:52:56.163973 5120 generic.go:358] "Generic (PLEG): container finished" podID="cc7ba52a-5825-4399-9e38-4d5cd1c02156" containerID="c269982f7bd61da7b75cbb3cc404cf21021ad56400074e1ad1d8e47d158c1c63" exitCode=0 Mar 16 16:52:56 crc kubenswrapper[5120]: I0316 16:52:56.163990 5120 generic.go:358] "Generic (PLEG): container finished" podID="cc7ba52a-5825-4399-9e38-4d5cd1c02156" containerID="90916447cca93d6401deab90112baaf449192048ae8cc43a6c81786b2c2628a9" exitCode=143 Mar 16 16:52:56 crc kubenswrapper[5120]: I0316 16:52:56.164019 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-d99589cd-7z8cg" event={"ID":"cc7ba52a-5825-4399-9e38-4d5cd1c02156","Type":"ContainerDied","Data":"c269982f7bd61da7b75cbb3cc404cf21021ad56400074e1ad1d8e47d158c1c63"} Mar 16 16:52:56 crc kubenswrapper[5120]: I0316 16:52:56.164035 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-d99589cd-7z8cg" event={"ID":"cc7ba52a-5825-4399-9e38-4d5cd1c02156","Type":"ContainerDied","Data":"90916447cca93d6401deab90112baaf449192048ae8cc43a6c81786b2c2628a9"} Mar 16 16:52:56 crc kubenswrapper[5120]: I0316 16:52:56.165605 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"e5c498e5-584c-4cdd-b008-c643b7bb1bc5","Type":"ContainerStarted","Data":"8ad11216cee7d67fd4ad6baa240839fa389afe7496128def0dc5bd74133aa3e6"} Mar 16 16:52:56 crc kubenswrapper[5120]: I0316 16:52:56.198130 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:52:56 crc kubenswrapper[5120]: I0316 16:52:56.198278 5120 generic.go:358] "Generic (PLEG): container finished" podID="fb4496e5-279b-4520-a345-c4ed00ede8c9" containerID="31db12e43658d9b439ba1ed20816294a537012094b7d53a0e297f4d8b5dc66b2" exitCode=143 Mar 16 16:52:56 crc kubenswrapper[5120]: I0316 16:52:56.198492 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-576c5b55d6-5zsh7" event={"ID":"fb4496e5-279b-4520-a345-c4ed00ede8c9","Type":"ContainerDied","Data":"31db12e43658d9b439ba1ed20816294a537012094b7d53a0e297f4d8b5dc66b2"} Mar 16 16:52:56 crc kubenswrapper[5120]: I0316 16:52:56.230986 5120 generic.go:358] "Generic (PLEG): container finished" podID="f9a4fc77-147c-46f7-a4de-e36f3086b09b" containerID="3184591cfeb6be7145725a7421e98898364ca1929244d5f99995dc4fa0dd58e0" exitCode=0 Mar 16 16:52:56 crc kubenswrapper[5120]: I0316 16:52:56.231051 5120 generic.go:358] "Generic (PLEG): container finished" podID="f9a4fc77-147c-46f7-a4de-e36f3086b09b" containerID="214b9b807141dffba529059147015a1dff4f121e2338cd1014806da26ec56f8f" exitCode=143 Mar 16 16:52:56 crc kubenswrapper[5120]: I0316 16:52:56.231239 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-69d57497c4-7bhm5" event={"ID":"f9a4fc77-147c-46f7-a4de-e36f3086b09b","Type":"ContainerDied","Data":"3184591cfeb6be7145725a7421e98898364ca1929244d5f99995dc4fa0dd58e0"} Mar 16 16:52:56 crc kubenswrapper[5120]: I0316 16:52:56.231267 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-69d57497c4-7bhm5" event={"ID":"f9a4fc77-147c-46f7-a4de-e36f3086b09b","Type":"ContainerDied","Data":"214b9b807141dffba529059147015a1dff4f121e2338cd1014806da26ec56f8f"} Mar 16 16:52:56 crc kubenswrapper[5120]: I0316 16:52:56.258951 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_986cfe2c-03bb-4027-b930-79c5b3dd8fe4/ovsdbserver-nb/0.log" Mar 16 16:52:56 crc kubenswrapper[5120]: I0316 16:52:56.258998 5120 generic.go:358] "Generic (PLEG): container finished" podID="986cfe2c-03bb-4027-b930-79c5b3dd8fe4" containerID="93704be7a1911253e9bec47c485dbaf555ed483872f59ee96ad929fb574a1c97" exitCode=2 Mar 16 16:52:56 crc kubenswrapper[5120]: I0316 16:52:56.259011 5120 generic.go:358] "Generic (PLEG): container finished" podID="986cfe2c-03bb-4027-b930-79c5b3dd8fe4" containerID="4953a3c44bc238fbcf8c208701df55aea6785f9a7d44ee5bd9ecc32bbac1a728" exitCode=143 Mar 16 16:52:56 crc kubenswrapper[5120]: I0316 16:52:56.259115 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"986cfe2c-03bb-4027-b930-79c5b3dd8fe4","Type":"ContainerDied","Data":"93704be7a1911253e9bec47c485dbaf555ed483872f59ee96ad929fb574a1c97"} Mar 16 16:52:56 crc kubenswrapper[5120]: I0316 16:52:56.259140 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"986cfe2c-03bb-4027-b930-79c5b3dd8fe4","Type":"ContainerDied","Data":"4953a3c44bc238fbcf8c208701df55aea6785f9a7d44ee5bd9ecc32bbac1a728"} Mar 16 16:52:56 crc kubenswrapper[5120]: I0316 16:52:56.283355 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"77e38408-57df-40be-95a1-64f61218c305","Type":"ContainerStarted","Data":"56beee6705d409b8332e29a165b9c99559accc543766bf994f3681efe23e8a0e"} Mar 16 16:52:56 crc kubenswrapper[5120]: I0316 16:52:56.306059 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"0d9062d0-d8bb-4ab3-b2c5-33fa78833a65","Type":"ContainerStarted","Data":"d14be80b2384b1c66a5747f2da507ba536fa23d0de33e607debc39288b289c33"} Mar 16 16:52:56 crc kubenswrapper[5120]: I0316 16:52:56.309175 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"f1c9b873-c644-4c80-941e-3ec3415485e4","Type":"ContainerStarted","Data":"147f67451a7acdf7de0b506f8b294ffb13728a5728c87a3e67d00fc81b70f28b"} Mar 16 16:52:56 crc kubenswrapper[5120]: I0316 16:52:56.474944 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:52:56 crc kubenswrapper[5120]: I0316 16:52:56.516739 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:52:56 crc kubenswrapper[5120]: I0316 16:52:56.550193 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-d99589cd-7z8cg" Mar 16 16:52:56 crc kubenswrapper[5120]: I0316 16:52:56.554254 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_18684823-3972-4cf6-8e42-792360b387bb/ovsdbserver-sb/0.log" Mar 16 16:52:56 crc kubenswrapper[5120]: I0316 16:52:56.554441 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:52:56 crc kubenswrapper[5120]: I0316 16:52:56.619576 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-69d57497c4-7bhm5" Mar 16 16:52:56 crc kubenswrapper[5120]: I0316 16:52:56.638682 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_986cfe2c-03bb-4027-b930-79c5b3dd8fe4/ovsdbserver-nb/0.log" Mar 16 16:52:56 crc kubenswrapper[5120]: I0316 16:52:56.638754 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:52:56 crc kubenswrapper[5120]: I0316 16:52:56.656863 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f9a4fc77-147c-46f7-a4de-e36f3086b09b-logs\") pod \"f9a4fc77-147c-46f7-a4de-e36f3086b09b\" (UID: \"f9a4fc77-147c-46f7-a4de-e36f3086b09b\") " Mar 16 16:52:56 crc kubenswrapper[5120]: I0316 16:52:56.656930 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cc7ba52a-5825-4399-9e38-4d5cd1c02156-config-data\") pod \"cc7ba52a-5825-4399-9e38-4d5cd1c02156\" (UID: \"cc7ba52a-5825-4399-9e38-4d5cd1c02156\") " Mar 16 16:52:56 crc kubenswrapper[5120]: I0316 16:52:56.656981 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/cc7ba52a-5825-4399-9e38-4d5cd1c02156-logs\") pod \"cc7ba52a-5825-4399-9e38-4d5cd1c02156\" (UID: \"cc7ba52a-5825-4399-9e38-4d5cd1c02156\") " Mar 16 16:52:56 crc kubenswrapper[5120]: I0316 16:52:56.657060 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovndbcluster-sb-etc-ovn\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"18684823-3972-4cf6-8e42-792360b387bb\" (UID: \"18684823-3972-4cf6-8e42-792360b387bb\") " Mar 16 16:52:56 crc kubenswrapper[5120]: I0316 16:52:56.657089 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/18684823-3972-4cf6-8e42-792360b387bb-config\") pod \"18684823-3972-4cf6-8e42-792360b387bb\" (UID: \"18684823-3972-4cf6-8e42-792360b387bb\") " Mar 16 16:52:56 crc kubenswrapper[5120]: I0316 16:52:56.657129 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cc7ba52a-5825-4399-9e38-4d5cd1c02156-combined-ca-bundle\") pod \"cc7ba52a-5825-4399-9e38-4d5cd1c02156\" (UID: \"cc7ba52a-5825-4399-9e38-4d5cd1c02156\") " Mar 16 16:52:56 crc kubenswrapper[5120]: I0316 16:52:56.657168 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/18684823-3972-4cf6-8e42-792360b387bb-ovsdb-rundir\") pod \"18684823-3972-4cf6-8e42-792360b387bb\" (UID: \"18684823-3972-4cf6-8e42-792360b387bb\") " Mar 16 16:52:56 crc kubenswrapper[5120]: I0316 16:52:56.657264 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/18684823-3972-4cf6-8e42-792360b387bb-scripts\") pod \"18684823-3972-4cf6-8e42-792360b387bb\" (UID: \"18684823-3972-4cf6-8e42-792360b387bb\") " Mar 16 16:52:56 crc kubenswrapper[5120]: I0316 16:52:56.657288 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f9a4fc77-147c-46f7-a4de-e36f3086b09b-internal-tls-certs\") pod \"f9a4fc77-147c-46f7-a4de-e36f3086b09b\" (UID: \"f9a4fc77-147c-46f7-a4de-e36f3086b09b\") " Mar 16 16:52:56 crc kubenswrapper[5120]: I0316 16:52:56.657327 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f9a4fc77-147c-46f7-a4de-e36f3086b09b-public-tls-certs\") pod \"f9a4fc77-147c-46f7-a4de-e36f3086b09b\" (UID: \"f9a4fc77-147c-46f7-a4de-e36f3086b09b\") " Mar 16 16:52:56 crc kubenswrapper[5120]: I0316 16:52:56.657355 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f9a4fc77-147c-46f7-a4de-e36f3086b09b-combined-ca-bundle\") pod \"f9a4fc77-147c-46f7-a4de-e36f3086b09b\" (UID: \"f9a4fc77-147c-46f7-a4de-e36f3086b09b\") " Mar 16 16:52:56 crc kubenswrapper[5120]: I0316 16:52:56.657439 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/cc7ba52a-5825-4399-9e38-4d5cd1c02156-scripts\") pod \"cc7ba52a-5825-4399-9e38-4d5cd1c02156\" (UID: \"cc7ba52a-5825-4399-9e38-4d5cd1c02156\") " Mar 16 16:52:56 crc kubenswrapper[5120]: I0316 16:52:56.657457 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r8mqx\" (UniqueName: \"kubernetes.io/projected/cc7ba52a-5825-4399-9e38-4d5cd1c02156-kube-api-access-r8mqx\") pod \"cc7ba52a-5825-4399-9e38-4d5cd1c02156\" (UID: \"cc7ba52a-5825-4399-9e38-4d5cd1c02156\") " Mar 16 16:52:56 crc kubenswrapper[5120]: I0316 16:52:56.657473 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rgzz7\" (UniqueName: \"kubernetes.io/projected/18684823-3972-4cf6-8e42-792360b387bb-kube-api-access-rgzz7\") pod \"18684823-3972-4cf6-8e42-792360b387bb\" (UID: \"18684823-3972-4cf6-8e42-792360b387bb\") " Mar 16 16:52:56 crc kubenswrapper[5120]: I0316 16:52:56.657511 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/cc7ba52a-5825-4399-9e38-4d5cd1c02156-internal-tls-certs\") pod \"cc7ba52a-5825-4399-9e38-4d5cd1c02156\" (UID: \"cc7ba52a-5825-4399-9e38-4d5cd1c02156\") " Mar 16 16:52:56 crc kubenswrapper[5120]: I0316 16:52:56.657545 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/18684823-3972-4cf6-8e42-792360b387bb-metrics-certs-tls-certs\") pod \"18684823-3972-4cf6-8e42-792360b387bb\" (UID: \"18684823-3972-4cf6-8e42-792360b387bb\") " Mar 16 16:52:56 crc kubenswrapper[5120]: I0316 16:52:56.657645 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f9a4fc77-147c-46f7-a4de-e36f3086b09b-scripts\") pod \"f9a4fc77-147c-46f7-a4de-e36f3086b09b\" (UID: \"f9a4fc77-147c-46f7-a4de-e36f3086b09b\") " Mar 16 16:52:56 crc kubenswrapper[5120]: I0316 16:52:56.657664 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/18684823-3972-4cf6-8e42-792360b387bb-combined-ca-bundle\") pod \"18684823-3972-4cf6-8e42-792360b387bb\" (UID: \"18684823-3972-4cf6-8e42-792360b387bb\") " Mar 16 16:52:56 crc kubenswrapper[5120]: I0316 16:52:56.657829 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/18684823-3972-4cf6-8e42-792360b387bb-ovsdbserver-sb-tls-certs\") pod \"18684823-3972-4cf6-8e42-792360b387bb\" (UID: \"18684823-3972-4cf6-8e42-792360b387bb\") " Mar 16 16:52:56 crc kubenswrapper[5120]: I0316 16:52:56.657994 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fbkzq\" (UniqueName: \"kubernetes.io/projected/f9a4fc77-147c-46f7-a4de-e36f3086b09b-kube-api-access-fbkzq\") pod \"f9a4fc77-147c-46f7-a4de-e36f3086b09b\" (UID: \"f9a4fc77-147c-46f7-a4de-e36f3086b09b\") " Mar 16 16:52:56 crc kubenswrapper[5120]: I0316 16:52:56.658119 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/cc7ba52a-5825-4399-9e38-4d5cd1c02156-public-tls-certs\") pod \"cc7ba52a-5825-4399-9e38-4d5cd1c02156\" (UID: \"cc7ba52a-5825-4399-9e38-4d5cd1c02156\") " Mar 16 16:52:56 crc kubenswrapper[5120]: I0316 16:52:56.658156 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f9a4fc77-147c-46f7-a4de-e36f3086b09b-config-data\") pod \"f9a4fc77-147c-46f7-a4de-e36f3086b09b\" (UID: \"f9a4fc77-147c-46f7-a4de-e36f3086b09b\") " Mar 16 16:52:56 crc kubenswrapper[5120]: I0316 16:52:56.662399 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9a4fc77-147c-46f7-a4de-e36f3086b09b-logs" (OuterVolumeSpecName: "logs") pod "f9a4fc77-147c-46f7-a4de-e36f3086b09b" (UID: "f9a4fc77-147c-46f7-a4de-e36f3086b09b"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:52:56 crc kubenswrapper[5120]: I0316 16:52:56.685255 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc7ba52a-5825-4399-9e38-4d5cd1c02156-logs" (OuterVolumeSpecName: "logs") pod "cc7ba52a-5825-4399-9e38-4d5cd1c02156" (UID: "cc7ba52a-5825-4399-9e38-4d5cd1c02156"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:52:56 crc kubenswrapper[5120]: I0316 16:52:56.685905 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18684823-3972-4cf6-8e42-792360b387bb-scripts" (OuterVolumeSpecName: "scripts") pod "18684823-3972-4cf6-8e42-792360b387bb" (UID: "18684823-3972-4cf6-8e42-792360b387bb"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:52:56 crc kubenswrapper[5120]: I0316 16:52:56.704770 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18684823-3972-4cf6-8e42-792360b387bb-ovsdb-rundir" (OuterVolumeSpecName: "ovsdb-rundir") pod "18684823-3972-4cf6-8e42-792360b387bb" (UID: "18684823-3972-4cf6-8e42-792360b387bb"). InnerVolumeSpecName "ovsdb-rundir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:52:56 crc kubenswrapper[5120]: I0316 16:52:56.705879 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18684823-3972-4cf6-8e42-792360b387bb-config" (OuterVolumeSpecName: "config") pod "18684823-3972-4cf6-8e42-792360b387bb" (UID: "18684823-3972-4cf6-8e42-792360b387bb"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:52:56 crc kubenswrapper[5120]: I0316 16:52:56.716338 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18684823-3972-4cf6-8e42-792360b387bb-kube-api-access-rgzz7" (OuterVolumeSpecName: "kube-api-access-rgzz7") pod "18684823-3972-4cf6-8e42-792360b387bb" (UID: "18684823-3972-4cf6-8e42-792360b387bb"). InnerVolumeSpecName "kube-api-access-rgzz7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:52:56 crc kubenswrapper[5120]: I0316 16:52:56.724591 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="37c6de80-ff10-4d44-a806-b8ad82e62d82" path="/var/lib/kubelet/pods/37c6de80-ff10-4d44-a806-b8ad82e62d82/volumes" Mar 16 16:52:56 crc kubenswrapper[5120]: I0316 16:52:56.741519 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f9a4fc77-147c-46f7-a4de-e36f3086b09b-scripts" (OuterVolumeSpecName: "scripts") pod "f9a4fc77-147c-46f7-a4de-e36f3086b09b" (UID: "f9a4fc77-147c-46f7-a4de-e36f3086b09b"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:52:56 crc kubenswrapper[5120]: I0316 16:52:56.742273 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc7ba52a-5825-4399-9e38-4d5cd1c02156-scripts" (OuterVolumeSpecName: "scripts") pod "cc7ba52a-5825-4399-9e38-4d5cd1c02156" (UID: "cc7ba52a-5825-4399-9e38-4d5cd1c02156"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:52:56 crc kubenswrapper[5120]: I0316 16:52:56.743289 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f9a4fc77-147c-46f7-a4de-e36f3086b09b-kube-api-access-fbkzq" (OuterVolumeSpecName: "kube-api-access-fbkzq") pod "f9a4fc77-147c-46f7-a4de-e36f3086b09b" (UID: "f9a4fc77-147c-46f7-a4de-e36f3086b09b"). InnerVolumeSpecName "kube-api-access-fbkzq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:52:56 crc kubenswrapper[5120]: I0316 16:52:56.747122 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc7ba52a-5825-4399-9e38-4d5cd1c02156-kube-api-access-r8mqx" (OuterVolumeSpecName: "kube-api-access-r8mqx") pod "cc7ba52a-5825-4399-9e38-4d5cd1c02156" (UID: "cc7ba52a-5825-4399-9e38-4d5cd1c02156"). InnerVolumeSpecName "kube-api-access-r8mqx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:52:56 crc kubenswrapper[5120]: I0316 16:52:56.747529 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage06-crc" (OuterVolumeSpecName: "ovndbcluster-sb-etc-ovn") pod "18684823-3972-4cf6-8e42-792360b387bb" (UID: "18684823-3972-4cf6-8e42-792360b387bb"). InnerVolumeSpecName "local-storage06-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:52:56 crc kubenswrapper[5120]: I0316 16:52:56.748174 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:52:56 crc kubenswrapper[5120]: I0316 16:52:56.758520 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-7f77bff94b-c5ng2"] Mar 16 16:52:56 crc kubenswrapper[5120]: W0316 16:52:56.767544 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod67c7567e_232d_4853_961c_dcc1799c7dae.slice/crio-56e362cb4fbcb771eb6d5aa2503e2ef1a11f7086f388039bf74abf8bf614cff2 WatchSource:0}: Error finding container 56e362cb4fbcb771eb6d5aa2503e2ef1a11f7086f388039bf74abf8bf614cff2: Status 404 returned error can't find the container with id 56e362cb4fbcb771eb6d5aa2503e2ef1a11f7086f388039bf74abf8bf614cff2 Mar 16 16:52:56 crc kubenswrapper[5120]: I0316 16:52:56.769622 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/986cfe2c-03bb-4027-b930-79c5b3dd8fe4-metrics-certs-tls-certs\") pod \"986cfe2c-03bb-4027-b930-79c5b3dd8fe4\" (UID: \"986cfe2c-03bb-4027-b930-79c5b3dd8fe4\") " Mar 16 16:52:56 crc kubenswrapper[5120]: I0316 16:52:56.770003 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/986cfe2c-03bb-4027-b930-79c5b3dd8fe4-combined-ca-bundle\") pod \"986cfe2c-03bb-4027-b930-79c5b3dd8fe4\" (UID: \"986cfe2c-03bb-4027-b930-79c5b3dd8fe4\") " Mar 16 16:52:56 crc kubenswrapper[5120]: I0316 16:52:56.770226 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/986cfe2c-03bb-4027-b930-79c5b3dd8fe4-scripts\") pod \"986cfe2c-03bb-4027-b930-79c5b3dd8fe4\" (UID: \"986cfe2c-03bb-4027-b930-79c5b3dd8fe4\") " Mar 16 16:52:56 crc kubenswrapper[5120]: I0316 16:52:56.771059 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/986cfe2c-03bb-4027-b930-79c5b3dd8fe4-ovsdb-rundir\") pod \"986cfe2c-03bb-4027-b930-79c5b3dd8fe4\" (UID: \"986cfe2c-03bb-4027-b930-79c5b3dd8fe4\") " Mar 16 16:52:56 crc kubenswrapper[5120]: I0316 16:52:56.771410 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/986cfe2c-03bb-4027-b930-79c5b3dd8fe4-ovsdbserver-nb-tls-certs\") pod \"986cfe2c-03bb-4027-b930-79c5b3dd8fe4\" (UID: \"986cfe2c-03bb-4027-b930-79c5b3dd8fe4\") " Mar 16 16:52:56 crc kubenswrapper[5120]: I0316 16:52:56.771589 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5mhnc\" (UniqueName: \"kubernetes.io/projected/986cfe2c-03bb-4027-b930-79c5b3dd8fe4-kube-api-access-5mhnc\") pod \"986cfe2c-03bb-4027-b930-79c5b3dd8fe4\" (UID: \"986cfe2c-03bb-4027-b930-79c5b3dd8fe4\") " Mar 16 16:52:56 crc kubenswrapper[5120]: I0316 16:52:56.771613 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/986cfe2c-03bb-4027-b930-79c5b3dd8fe4-scripts" (OuterVolumeSpecName: "scripts") pod "986cfe2c-03bb-4027-b930-79c5b3dd8fe4" (UID: "986cfe2c-03bb-4027-b930-79c5b3dd8fe4"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:52:56 crc kubenswrapper[5120]: I0316 16:52:56.771909 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/986cfe2c-03bb-4027-b930-79c5b3dd8fe4-config\") pod \"986cfe2c-03bb-4027-b930-79c5b3dd8fe4\" (UID: \"986cfe2c-03bb-4027-b930-79c5b3dd8fe4\") " Mar 16 16:52:56 crc kubenswrapper[5120]: I0316 16:52:56.772053 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovndbcluster-nb-etc-ovn\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") pod \"986cfe2c-03bb-4027-b930-79c5b3dd8fe4\" (UID: \"986cfe2c-03bb-4027-b930-79c5b3dd8fe4\") " Mar 16 16:52:56 crc kubenswrapper[5120]: I0316 16:52:56.772782 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/986cfe2c-03bb-4027-b930-79c5b3dd8fe4-config" (OuterVolumeSpecName: "config") pod "986cfe2c-03bb-4027-b930-79c5b3dd8fe4" (UID: "986cfe2c-03bb-4027-b930-79c5b3dd8fe4"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:52:56 crc kubenswrapper[5120]: I0316 16:52:56.772910 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/986cfe2c-03bb-4027-b930-79c5b3dd8fe4-ovsdb-rundir" (OuterVolumeSpecName: "ovsdb-rundir") pod "986cfe2c-03bb-4027-b930-79c5b3dd8fe4" (UID: "986cfe2c-03bb-4027-b930-79c5b3dd8fe4"). InnerVolumeSpecName "ovsdb-rundir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:52:56 crc kubenswrapper[5120]: I0316 16:52:56.778463 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f9a4fc77-147c-46f7-a4de-e36f3086b09b-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:56 crc kubenswrapper[5120]: I0316 16:52:56.778497 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/cc7ba52a-5825-4399-9e38-4d5cd1c02156-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:56 crc kubenswrapper[5120]: I0316 16:52:56.778521 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") on node \"crc\" " Mar 16 16:52:56 crc kubenswrapper[5120]: I0316 16:52:56.778533 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/18684823-3972-4cf6-8e42-792360b387bb-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:56 crc kubenswrapper[5120]: I0316 16:52:56.778544 5120 reconciler_common.go:299] "Volume detached for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/18684823-3972-4cf6-8e42-792360b387bb-ovsdb-rundir\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:56 crc kubenswrapper[5120]: I0316 16:52:56.778558 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/986cfe2c-03bb-4027-b930-79c5b3dd8fe4-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:56 crc kubenswrapper[5120]: I0316 16:52:56.778569 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/18684823-3972-4cf6-8e42-792360b387bb-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:56 crc kubenswrapper[5120]: I0316 16:52:56.778581 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/cc7ba52a-5825-4399-9e38-4d5cd1c02156-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:56 crc kubenswrapper[5120]: I0316 16:52:56.778596 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r8mqx\" (UniqueName: \"kubernetes.io/projected/cc7ba52a-5825-4399-9e38-4d5cd1c02156-kube-api-access-r8mqx\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:56 crc kubenswrapper[5120]: I0316 16:52:56.778610 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rgzz7\" (UniqueName: \"kubernetes.io/projected/18684823-3972-4cf6-8e42-792360b387bb-kube-api-access-rgzz7\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:56 crc kubenswrapper[5120]: I0316 16:52:56.778623 5120 reconciler_common.go:299] "Volume detached for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/986cfe2c-03bb-4027-b930-79c5b3dd8fe4-ovsdb-rundir\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:56 crc kubenswrapper[5120]: I0316 16:52:56.778635 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f9a4fc77-147c-46f7-a4de-e36f3086b09b-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:56 crc kubenswrapper[5120]: I0316 16:52:56.778648 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fbkzq\" (UniqueName: \"kubernetes.io/projected/f9a4fc77-147c-46f7-a4de-e36f3086b09b-kube-api-access-fbkzq\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:56 crc kubenswrapper[5120]: I0316 16:52:56.778661 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/986cfe2c-03bb-4027-b930-79c5b3dd8fe4-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:56 crc kubenswrapper[5120]: I0316 16:52:56.791453 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage17-crc" (OuterVolumeSpecName: "ovndbcluster-nb-etc-ovn") pod "986cfe2c-03bb-4027-b930-79c5b3dd8fe4" (UID: "986cfe2c-03bb-4027-b930-79c5b3dd8fe4"). InnerVolumeSpecName "local-storage17-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:52:56 crc kubenswrapper[5120]: I0316 16:52:56.793556 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/986cfe2c-03bb-4027-b930-79c5b3dd8fe4-kube-api-access-5mhnc" (OuterVolumeSpecName: "kube-api-access-5mhnc") pod "986cfe2c-03bb-4027-b930-79c5b3dd8fe4" (UID: "986cfe2c-03bb-4027-b930-79c5b3dd8fe4"). InnerVolumeSpecName "kube-api-access-5mhnc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:52:56 crc kubenswrapper[5120]: I0316 16:52:56.883559 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") on node \"crc\" " Mar 16 16:52:56 crc kubenswrapper[5120]: I0316 16:52:56.883622 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5mhnc\" (UniqueName: \"kubernetes.io/projected/986cfe2c-03bb-4027-b930-79c5b3dd8fe4-kube-api-access-5mhnc\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:56 crc kubenswrapper[5120]: I0316 16:52:56.889603 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-576bc9cb6c-q5s4k" Mar 16 16:52:56 crc kubenswrapper[5120]: I0316 16:52:56.984402 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/976611b4-4a36-49a3-9bd6-f7b5ca2899f4-combined-ca-bundle\") pod \"976611b4-4a36-49a3-9bd6-f7b5ca2899f4\" (UID: \"976611b4-4a36-49a3-9bd6-f7b5ca2899f4\") " Mar 16 16:52:56 crc kubenswrapper[5120]: I0316 16:52:56.984919 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zrgnj\" (UniqueName: \"kubernetes.io/projected/976611b4-4a36-49a3-9bd6-f7b5ca2899f4-kube-api-access-zrgnj\") pod \"976611b4-4a36-49a3-9bd6-f7b5ca2899f4\" (UID: \"976611b4-4a36-49a3-9bd6-f7b5ca2899f4\") " Mar 16 16:52:56 crc kubenswrapper[5120]: I0316 16:52:56.985213 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/976611b4-4a36-49a3-9bd6-f7b5ca2899f4-logs\") pod \"976611b4-4a36-49a3-9bd6-f7b5ca2899f4\" (UID: \"976611b4-4a36-49a3-9bd6-f7b5ca2899f4\") " Mar 16 16:52:56 crc kubenswrapper[5120]: I0316 16:52:56.985382 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/976611b4-4a36-49a3-9bd6-f7b5ca2899f4-config-data\") pod \"976611b4-4a36-49a3-9bd6-f7b5ca2899f4\" (UID: \"976611b4-4a36-49a3-9bd6-f7b5ca2899f4\") " Mar 16 16:52:56 crc kubenswrapper[5120]: I0316 16:52:56.985781 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/976611b4-4a36-49a3-9bd6-f7b5ca2899f4-config-data-custom\") pod \"976611b4-4a36-49a3-9bd6-f7b5ca2899f4\" (UID: \"976611b4-4a36-49a3-9bd6-f7b5ca2899f4\") " Mar 16 16:52:56 crc kubenswrapper[5120]: I0316 16:52:56.986517 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/976611b4-4a36-49a3-9bd6-f7b5ca2899f4-logs" (OuterVolumeSpecName: "logs") pod "976611b4-4a36-49a3-9bd6-f7b5ca2899f4" (UID: "976611b4-4a36-49a3-9bd6-f7b5ca2899f4"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:52:56 crc kubenswrapper[5120]: I0316 16:52:56.986790 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/976611b4-4a36-49a3-9bd6-f7b5ca2899f4-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:57 crc kubenswrapper[5120]: I0316 16:52:57.009327 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/976611b4-4a36-49a3-9bd6-f7b5ca2899f4-kube-api-access-zrgnj" (OuterVolumeSpecName: "kube-api-access-zrgnj") pod "976611b4-4a36-49a3-9bd6-f7b5ca2899f4" (UID: "976611b4-4a36-49a3-9bd6-f7b5ca2899f4"). InnerVolumeSpecName "kube-api-access-zrgnj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:52:57 crc kubenswrapper[5120]: I0316 16:52:57.010486 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/976611b4-4a36-49a3-9bd6-f7b5ca2899f4-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "976611b4-4a36-49a3-9bd6-f7b5ca2899f4" (UID: "976611b4-4a36-49a3-9bd6-f7b5ca2899f4"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:52:57 crc kubenswrapper[5120]: I0316 16:52:57.090038 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/976611b4-4a36-49a3-9bd6-f7b5ca2899f4-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:57 crc kubenswrapper[5120]: I0316 16:52:57.090067 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zrgnj\" (UniqueName: \"kubernetes.io/projected/976611b4-4a36-49a3-9bd6-f7b5ca2899f4-kube-api-access-zrgnj\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:57 crc kubenswrapper[5120]: I0316 16:52:57.118582 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage06-crc" (UniqueName: "kubernetes.io/local-volume/local-storage06-crc") on node "crc" Mar 16 16:52:57 crc kubenswrapper[5120]: I0316 16:52:57.193861 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:57 crc kubenswrapper[5120]: I0316 16:52:57.246162 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage17-crc" (UniqueName: "kubernetes.io/local-volume/local-storage17-crc") on node "crc" Mar 16 16:52:57 crc kubenswrapper[5120]: I0316 16:52:57.297712 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:57 crc kubenswrapper[5120]: I0316 16:52:57.370409 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:52:57 crc kubenswrapper[5120]: I0316 16:52:57.414915 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"f1c9b873-c644-4c80-941e-3ec3415485e4","Type":"ContainerStarted","Data":"e84a6ccec0bb33bc2cd454d4394c28b18bc68551ef47c224ec6f142319f3040e"} Mar 16 16:52:57 crc kubenswrapper[5120]: I0316 16:52:57.414991 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:52:57 crc kubenswrapper[5120]: I0316 16:52:57.418190 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"b91a9930-eec4-4af5-9aee-5d02dc78fabc","Type":"ContainerStarted","Data":"424e31545d803d2327b8e14c4a5a0a88e6c5500c83a65260f104ea072002902b"} Mar 16 16:52:57 crc kubenswrapper[5120]: I0316 16:52:57.423664 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18684823-3972-4cf6-8e42-792360b387bb-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "18684823-3972-4cf6-8e42-792360b387bb" (UID: "18684823-3972-4cf6-8e42-792360b387bb"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:52:57 crc kubenswrapper[5120]: I0316 16:52:57.432780 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-576bc9cb6c-q5s4k" event={"ID":"976611b4-4a36-49a3-9bd6-f7b5ca2899f4","Type":"ContainerDied","Data":"ec9368546d7da7390886e73f6b2ffd0491828efa7bf77ae960aa285225bfaf20"} Mar 16 16:52:57 crc kubenswrapper[5120]: I0316 16:52:57.432852 5120 scope.go:117] "RemoveContainer" containerID="7ec001db9d9a0dc8f997385521689fb1115f53c263a2c629d27622f8ad07041d" Mar 16 16:52:57 crc kubenswrapper[5120]: I0316 16:52:57.433037 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-576bc9cb6c-q5s4k" Mar 16 16:52:57 crc kubenswrapper[5120]: I0316 16:52:57.439950 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podStartSLOduration=6.439932666 podStartE2EDuration="6.439932666s" podCreationTimestamp="2026-03-16 16:52:51 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:52:57.43166676 +0000 UTC m=+4879.585598417" watchObservedRunningTime="2026-03-16 16:52:57.439932666 +0000 UTC m=+4879.593864323" Mar 16 16:52:57 crc kubenswrapper[5120]: I0316 16:52:57.462328 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-d99589cd-7z8cg" event={"ID":"cc7ba52a-5825-4399-9e38-4d5cd1c02156","Type":"ContainerDied","Data":"7f060b9de52d1b97b1d6fda914a02b312a1a97691413d86ad5b2bfb2c4243b85"} Mar 16 16:52:57 crc kubenswrapper[5120]: I0316 16:52:57.462451 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-d99589cd-7z8cg" Mar 16 16:52:57 crc kubenswrapper[5120]: I0316 16:52:57.475338 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"e5c498e5-584c-4cdd-b008-c643b7bb1bc5","Type":"ContainerStarted","Data":"1dbf24b95c7a96d399be4139efd5db0f1cb6a5b7e36d9f234f65251fcfc81330"} Mar 16 16:52:57 crc kubenswrapper[5120]: I0316 16:52:57.476083 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/986cfe2c-03bb-4027-b930-79c5b3dd8fe4-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "986cfe2c-03bb-4027-b930-79c5b3dd8fe4" (UID: "986cfe2c-03bb-4027-b930-79c5b3dd8fe4"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:52:57 crc kubenswrapper[5120]: I0316 16:52:57.485031 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:52:57 crc kubenswrapper[5120]: I0316 16:52:57.485239 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"26d7e714-e270-4150-9fc2-65e289bbd688","Type":"ContainerStarted","Data":"39ef33895c134d0ed936fb426895f0c7eb3288074422326f288eccff008d3774"} Mar 16 16:52:57 crc kubenswrapper[5120]: I0316 16:52:57.485263 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"26d7e714-e270-4150-9fc2-65e289bbd688","Type":"ContainerStarted","Data":"755c42e1ed74f1f57c1cc7f1151eab0b24f90cd185c3418945fdfde0ab53c586"} Mar 16 16:52:57 crc kubenswrapper[5120]: I0316 16:52:57.488169 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-7f77bff94b-c5ng2" event={"ID":"67c7567e-232d-4853-961c-dcc1799c7dae","Type":"ContainerStarted","Data":"56e362cb4fbcb771eb6d5aa2503e2ef1a11f7086f388039bf74abf8bf614cff2"} Mar 16 16:52:57 crc kubenswrapper[5120]: I0316 16:52:57.497242 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-69d57497c4-7bhm5" event={"ID":"f9a4fc77-147c-46f7-a4de-e36f3086b09b","Type":"ContainerDied","Data":"ed301e419aa7a47f5f5161bdd605f5d6e745f1b34c6ddc110a8a1cb5d67cc2dc"} Mar 16 16:52:57 crc kubenswrapper[5120]: I0316 16:52:57.497358 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-69d57497c4-7bhm5" Mar 16 16:52:57 crc kubenswrapper[5120]: I0316 16:52:57.511712 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"50c82211-4383-41cb-a31c-9bdfb156b586","Type":"ContainerStarted","Data":"21991810e78e02c4906f7d34a41a87570285929afef74ddaba7fe7f9d0ba84c0"} Mar 16 16:52:57 crc kubenswrapper[5120]: I0316 16:52:57.524189 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/18684823-3972-4cf6-8e42-792360b387bb-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:57 crc kubenswrapper[5120]: I0316 16:52:57.524226 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/986cfe2c-03bb-4027-b930-79c5b3dd8fe4-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:57 crc kubenswrapper[5120]: I0316 16:52:57.526702 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:52:57 crc kubenswrapper[5120]: I0316 16:52:57.526717 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"986cfe2c-03bb-4027-b930-79c5b3dd8fe4","Type":"ContainerDied","Data":"6bcf9fcfa6fdb73227a7682ce12b9429dee0a0dee021ac8f4b9339538680beba"} Mar 16 16:52:57 crc kubenswrapper[5120]: I0316 16:52:57.535952 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"61483cf5-d3db-49de-afa4-66f0efecdd70","Type":"ContainerStarted","Data":"619821620b07c15b5a46c94ce768d14dec3946f29b80468b52f71159f04265cc"} Mar 16 16:52:57 crc kubenswrapper[5120]: I0316 16:52:57.539156 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"0fba253d-bef6-490a-8d34-6be75a260d03","Type":"ContainerStarted","Data":"1bd233aaa2d94cd74f7be91d0921d4d062bfd66e884b04a33ccb25506a7bdded"} Mar 16 16:52:57 crc kubenswrapper[5120]: I0316 16:52:57.562972 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"77e38408-57df-40be-95a1-64f61218c305","Type":"ContainerStarted","Data":"07e36a960b4b0ff2c9a896db3032845779d0abb4605e926b1b1d6baa4a53ba03"} Mar 16 16:52:57 crc kubenswrapper[5120]: I0316 16:52:57.563039 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:52:57 crc kubenswrapper[5120]: I0316 16:52:57.599214 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podStartSLOduration=6.599192275 podStartE2EDuration="6.599192275s" podCreationTimestamp="2026-03-16 16:52:51 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:52:57.5175689 +0000 UTC m=+4879.671500587" watchObservedRunningTime="2026-03-16 16:52:57.599192275 +0000 UTC m=+4879.753123932" Mar 16 16:52:57 crc kubenswrapper[5120]: I0316 16:52:57.786013 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:52:57 crc kubenswrapper[5120]: I0316 16:52:57.902899 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/976611b4-4a36-49a3-9bd6-f7b5ca2899f4-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "976611b4-4a36-49a3-9bd6-f7b5ca2899f4" (UID: "976611b4-4a36-49a3-9bd6-f7b5ca2899f4"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:52:57 crc kubenswrapper[5120]: I0316 16:52:57.950580 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/976611b4-4a36-49a3-9bd6-f7b5ca2899f4-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:58 crc kubenswrapper[5120]: I0316 16:52:58.040558 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f9a4fc77-147c-46f7-a4de-e36f3086b09b-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f9a4fc77-147c-46f7-a4de-e36f3086b09b" (UID: "f9a4fc77-147c-46f7-a4de-e36f3086b09b"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:52:58 crc kubenswrapper[5120]: I0316 16:52:58.057678 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f9a4fc77-147c-46f7-a4de-e36f3086b09b-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:58 crc kubenswrapper[5120]: I0316 16:52:58.135339 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18684823-3972-4cf6-8e42-792360b387bb-ovsdbserver-sb-tls-certs" (OuterVolumeSpecName: "ovsdbserver-sb-tls-certs") pod "18684823-3972-4cf6-8e42-792360b387bb" (UID: "18684823-3972-4cf6-8e42-792360b387bb"). InnerVolumeSpecName "ovsdbserver-sb-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:52:58 crc kubenswrapper[5120]: I0316 16:52:58.135430 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f9a4fc77-147c-46f7-a4de-e36f3086b09b-config-data" (OuterVolumeSpecName: "config-data") pod "f9a4fc77-147c-46f7-a4de-e36f3086b09b" (UID: "f9a4fc77-147c-46f7-a4de-e36f3086b09b"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:52:58 crc kubenswrapper[5120]: I0316 16:52:58.200839 5120 reconciler_common.go:299] "Volume detached for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/18684823-3972-4cf6-8e42-792360b387bb-ovsdbserver-sb-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:58 crc kubenswrapper[5120]: I0316 16:52:58.200881 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f9a4fc77-147c-46f7-a4de-e36f3086b09b-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:58 crc kubenswrapper[5120]: I0316 16:52:58.291947 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc7ba52a-5825-4399-9e38-4d5cd1c02156-config-data" (OuterVolumeSpecName: "config-data") pod "cc7ba52a-5825-4399-9e38-4d5cd1c02156" (UID: "cc7ba52a-5825-4399-9e38-4d5cd1c02156"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:52:58 crc kubenswrapper[5120]: I0316 16:52:58.307268 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cc7ba52a-5825-4399-9e38-4d5cd1c02156-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:58 crc kubenswrapper[5120]: I0316 16:52:58.343047 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/986cfe2c-03bb-4027-b930-79c5b3dd8fe4-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "986cfe2c-03bb-4027-b930-79c5b3dd8fe4" (UID: "986cfe2c-03bb-4027-b930-79c5b3dd8fe4"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:52:58 crc kubenswrapper[5120]: I0316 16:52:58.385628 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/976611b4-4a36-49a3-9bd6-f7b5ca2899f4-config-data" (OuterVolumeSpecName: "config-data") pod "976611b4-4a36-49a3-9bd6-f7b5ca2899f4" (UID: "976611b4-4a36-49a3-9bd6-f7b5ca2899f4"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:52:58 crc kubenswrapper[5120]: I0316 16:52:58.396879 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc7ba52a-5825-4399-9e38-4d5cd1c02156-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "cc7ba52a-5825-4399-9e38-4d5cd1c02156" (UID: "cc7ba52a-5825-4399-9e38-4d5cd1c02156"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:52:58 crc kubenswrapper[5120]: I0316 16:52:58.413189 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/976611b4-4a36-49a3-9bd6-f7b5ca2899f4-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:58 crc kubenswrapper[5120]: I0316 16:52:58.413229 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/cc7ba52a-5825-4399-9e38-4d5cd1c02156-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:58 crc kubenswrapper[5120]: I0316 16:52:58.413246 5120 reconciler_common.go:299] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/986cfe2c-03bb-4027-b930-79c5b3dd8fe4-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:58 crc kubenswrapper[5120]: I0316 16:52:58.450946 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18684823-3972-4cf6-8e42-792360b387bb-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "18684823-3972-4cf6-8e42-792360b387bb" (UID: "18684823-3972-4cf6-8e42-792360b387bb"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:52:58 crc kubenswrapper[5120]: I0316 16:52:58.475091 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/memcached-0" Mar 16 16:52:58 crc kubenswrapper[5120]: I0316 16:52:58.494349 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/986cfe2c-03bb-4027-b930-79c5b3dd8fe4-ovsdbserver-nb-tls-certs" (OuterVolumeSpecName: "ovsdbserver-nb-tls-certs") pod "986cfe2c-03bb-4027-b930-79c5b3dd8fe4" (UID: "986cfe2c-03bb-4027-b930-79c5b3dd8fe4"). InnerVolumeSpecName "ovsdbserver-nb-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:52:58 crc kubenswrapper[5120]: I0316 16:52:58.516411 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc7ba52a-5825-4399-9e38-4d5cd1c02156-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "cc7ba52a-5825-4399-9e38-4d5cd1c02156" (UID: "cc7ba52a-5825-4399-9e38-4d5cd1c02156"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:52:58 crc kubenswrapper[5120]: I0316 16:52:58.517692 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cc7ba52a-5825-4399-9e38-4d5cd1c02156-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:58 crc kubenswrapper[5120]: I0316 16:52:58.517714 5120 reconciler_common.go:299] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/18684823-3972-4cf6-8e42-792360b387bb-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:58 crc kubenswrapper[5120]: I0316 16:52:58.517724 5120 reconciler_common.go:299] "Volume detached for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/986cfe2c-03bb-4027-b930-79c5b3dd8fe4-ovsdbserver-nb-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:58 crc kubenswrapper[5120]: I0316 16:52:58.562890 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 16:52:58 crc kubenswrapper[5120]: I0316 16:52:58.656290 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f9a4fc77-147c-46f7-a4de-e36f3086b09b-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "f9a4fc77-147c-46f7-a4de-e36f3086b09b" (UID: "f9a4fc77-147c-46f7-a4de-e36f3086b09b"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:52:58 crc kubenswrapper[5120]: I0316 16:52:58.661055 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f9a4fc77-147c-46f7-a4de-e36f3086b09b-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "f9a4fc77-147c-46f7-a4de-e36f3086b09b" (UID: "f9a4fc77-147c-46f7-a4de-e36f3086b09b"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:52:58 crc kubenswrapper[5120]: I0316 16:52:58.736629 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f9a4fc77-147c-46f7-a4de-e36f3086b09b-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:58 crc kubenswrapper[5120]: I0316 16:52:58.736665 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f9a4fc77-147c-46f7-a4de-e36f3086b09b-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:58 crc kubenswrapper[5120]: I0316 16:52:58.742524 5120 scope.go:117] "RemoveContainer" containerID="cb64ef40b3869f4282e91f93befbe663c5f19a49ae3de83e88840e49b9ad4dea" Mar 16 16:52:58 crc kubenswrapper[5120]: I0316 16:52:58.832005 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/memcached-0" podUID="a3cdc115-5535-44fd-94b4-6256145dea7e" containerName="memcached" containerID="cri-o://b34391ed51e1fef10fa960dbb4dc7aa97f95bec5ecc3a8f7a2c49da0363fdd4d" gracePeriod=30 Mar 16 16:52:58 crc kubenswrapper[5120]: I0316 16:52:58.859577 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"0d9062d0-d8bb-4ab3-b2c5-33fa78833a65","Type":"ContainerStarted","Data":"c7b4c951eebbeecee6717053b294c87b2bb789c71cabb8788e9ebfe41d5a8b39"} Mar 16 16:52:58 crc kubenswrapper[5120]: I0316 16:52:58.859620 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 16:52:58 crc kubenswrapper[5120]: I0316 16:52:58.859636 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"20f74fa1-8357-4b18-928a-4ae91c38bafe","Type":"ContainerStarted","Data":"373f9b078574a0bf83fdff059f3e1b65042968f942e3950468d07634679a3f85"} Mar 16 16:52:58 crc kubenswrapper[5120]: I0316 16:52:58.859650 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:52:58 crc kubenswrapper[5120]: I0316 16:52:58.978860 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 16:52:59 crc kubenswrapper[5120]: I0316 16:52:59.102317 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 16:52:59 crc kubenswrapper[5120]: I0316 16:52:59.106603 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18684823-3972-4cf6-8e42-792360b387bb" containerName="ovsdbserver-sb" Mar 16 16:52:59 crc kubenswrapper[5120]: I0316 16:52:59.106737 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="18684823-3972-4cf6-8e42-792360b387bb" containerName="ovsdbserver-sb" Mar 16 16:52:59 crc kubenswrapper[5120]: I0316 16:52:59.106822 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc7ba52a-5825-4399-9e38-4d5cd1c02156" containerName="placement-log" Mar 16 16:52:59 crc kubenswrapper[5120]: I0316 16:52:59.106874 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc7ba52a-5825-4399-9e38-4d5cd1c02156" containerName="placement-log" Mar 16 16:52:59 crc kubenswrapper[5120]: I0316 16:52:59.106927 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="986cfe2c-03bb-4027-b930-79c5b3dd8fe4" containerName="openstack-network-exporter" Mar 16 16:52:59 crc kubenswrapper[5120]: I0316 16:52:59.106980 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="986cfe2c-03bb-4027-b930-79c5b3dd8fe4" containerName="openstack-network-exporter" Mar 16 16:52:59 crc kubenswrapper[5120]: I0316 16:52:59.107033 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="976611b4-4a36-49a3-9bd6-f7b5ca2899f4" containerName="barbican-worker-log" Mar 16 16:52:59 crc kubenswrapper[5120]: I0316 16:52:59.107092 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="976611b4-4a36-49a3-9bd6-f7b5ca2899f4" containerName="barbican-worker-log" Mar 16 16:52:59 crc kubenswrapper[5120]: I0316 16:52:59.107154 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9a4fc77-147c-46f7-a4de-e36f3086b09b" containerName="placement-log" Mar 16 16:52:59 crc kubenswrapper[5120]: I0316 16:52:59.107226 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9a4fc77-147c-46f7-a4de-e36f3086b09b" containerName="placement-log" Mar 16 16:52:59 crc kubenswrapper[5120]: I0316 16:52:59.107325 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="986cfe2c-03bb-4027-b930-79c5b3dd8fe4" containerName="ovsdbserver-nb" Mar 16 16:52:59 crc kubenswrapper[5120]: I0316 16:52:59.107378 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="986cfe2c-03bb-4027-b930-79c5b3dd8fe4" containerName="ovsdbserver-nb" Mar 16 16:52:59 crc kubenswrapper[5120]: I0316 16:52:59.107431 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc7ba52a-5825-4399-9e38-4d5cd1c02156" containerName="placement-api" Mar 16 16:52:59 crc kubenswrapper[5120]: I0316 16:52:59.107486 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc7ba52a-5825-4399-9e38-4d5cd1c02156" containerName="placement-api" Mar 16 16:52:59 crc kubenswrapper[5120]: I0316 16:52:59.107541 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18684823-3972-4cf6-8e42-792360b387bb" containerName="openstack-network-exporter" Mar 16 16:52:59 crc kubenswrapper[5120]: I0316 16:52:59.107590 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="18684823-3972-4cf6-8e42-792360b387bb" containerName="openstack-network-exporter" Mar 16 16:52:59 crc kubenswrapper[5120]: I0316 16:52:59.107644 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="976611b4-4a36-49a3-9bd6-f7b5ca2899f4" containerName="barbican-worker" Mar 16 16:52:59 crc kubenswrapper[5120]: I0316 16:52:59.107692 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="976611b4-4a36-49a3-9bd6-f7b5ca2899f4" containerName="barbican-worker" Mar 16 16:52:59 crc kubenswrapper[5120]: I0316 16:52:59.107745 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9a4fc77-147c-46f7-a4de-e36f3086b09b" containerName="placement-api" Mar 16 16:52:59 crc kubenswrapper[5120]: I0316 16:52:59.107820 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9a4fc77-147c-46f7-a4de-e36f3086b09b" containerName="placement-api" Mar 16 16:52:59 crc kubenswrapper[5120]: I0316 16:52:59.108078 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="986cfe2c-03bb-4027-b930-79c5b3dd8fe4" containerName="openstack-network-exporter" Mar 16 16:52:59 crc kubenswrapper[5120]: I0316 16:52:59.108145 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="986cfe2c-03bb-4027-b930-79c5b3dd8fe4" containerName="ovsdbserver-nb" Mar 16 16:52:59 crc kubenswrapper[5120]: I0316 16:52:59.108229 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="976611b4-4a36-49a3-9bd6-f7b5ca2899f4" containerName="barbican-worker-log" Mar 16 16:52:59 crc kubenswrapper[5120]: I0316 16:52:59.108287 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="cc7ba52a-5825-4399-9e38-4d5cd1c02156" containerName="placement-log" Mar 16 16:52:59 crc kubenswrapper[5120]: I0316 16:52:59.108343 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="18684823-3972-4cf6-8e42-792360b387bb" containerName="ovsdbserver-sb" Mar 16 16:52:59 crc kubenswrapper[5120]: I0316 16:52:59.108427 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f9a4fc77-147c-46f7-a4de-e36f3086b09b" containerName="placement-api" Mar 16 16:52:59 crc kubenswrapper[5120]: I0316 16:52:59.108537 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="976611b4-4a36-49a3-9bd6-f7b5ca2899f4" containerName="barbican-worker" Mar 16 16:52:59 crc kubenswrapper[5120]: I0316 16:52:59.108705 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="cc7ba52a-5825-4399-9e38-4d5cd1c02156" containerName="placement-api" Mar 16 16:52:59 crc kubenswrapper[5120]: I0316 16:52:59.108806 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f9a4fc77-147c-46f7-a4de-e36f3086b09b" containerName="placement-log" Mar 16 16:52:59 crc kubenswrapper[5120]: I0316 16:52:59.108890 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="18684823-3972-4cf6-8e42-792360b387bb" containerName="openstack-network-exporter" Mar 16 16:52:59 crc kubenswrapper[5120]: I0316 16:52:59.116772 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:52:59 crc kubenswrapper[5120]: I0316 16:52:59.119174 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovndbcluster-sb-scripts\"" Mar 16 16:52:59 crc kubenswrapper[5120]: I0316 16:52:59.121704 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovndbcluster-sb-config\"" Mar 16 16:52:59 crc kubenswrapper[5120]: I0316 16:52:59.121823 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ovndbcluster-sb-ovndbs\"" Mar 16 16:52:59 crc kubenswrapper[5120]: I0316 16:52:59.121827 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ovncluster-ovndbcluster-sb-dockercfg-w4q4s\"" Mar 16 16:52:59 crc kubenswrapper[5120]: I0316 16:52:59.173765 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:52:59 crc kubenswrapper[5120]: I0316 16:52:59.203031 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:52:59 crc kubenswrapper[5120]: I0316 16:52:59.204037 5120 scope.go:117] "RemoveContainer" containerID="c269982f7bd61da7b75cbb3cc404cf21021ad56400074e1ad1d8e47d158c1c63" Mar 16 16:52:59 crc kubenswrapper[5120]: I0316 16:52:59.206598 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podUID="18e2f22a-0bc1-4514-afe4-56bdf5cb1670" containerName="nova-cell1-novncproxy-novncproxy" containerID="cri-o://c93e64b15c166ba718c199a2500ca4e4c998e0677346f6d61e58dc0ac5de1dbf" gracePeriod=30 Mar 16 16:52:59 crc kubenswrapper[5120]: I0316 16:52:59.229216 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:52:59 crc kubenswrapper[5120]: I0316 16:52:59.247553 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/6792b2c6-f5cf-454a-858a-cbd4159db76a-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"6792b2c6-f5cf-454a-858a-cbd4159db76a\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:52:59 crc kubenswrapper[5120]: I0316 16:52:59.247622 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/6792b2c6-f5cf-454a-858a-cbd4159db76a-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"6792b2c6-f5cf-454a-858a-cbd4159db76a\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:52:59 crc kubenswrapper[5120]: I0316 16:52:59.247805 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/6792b2c6-f5cf-454a-858a-cbd4159db76a-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"6792b2c6-f5cf-454a-858a-cbd4159db76a\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:52:59 crc kubenswrapper[5120]: I0316 16:52:59.247910 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/6792b2c6-f5cf-454a-858a-cbd4159db76a-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"6792b2c6-f5cf-454a-858a-cbd4159db76a\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:52:59 crc kubenswrapper[5120]: I0316 16:52:59.247999 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6792b2c6-f5cf-454a-858a-cbd4159db76a-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"6792b2c6-f5cf-454a-858a-cbd4159db76a\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:52:59 crc kubenswrapper[5120]: I0316 16:52:59.248034 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"ovsdbserver-sb-0\" (UID: \"6792b2c6-f5cf-454a-858a-cbd4159db76a\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:52:59 crc kubenswrapper[5120]: I0316 16:52:59.248074 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6zh5\" (UniqueName: \"kubernetes.io/projected/6792b2c6-f5cf-454a-858a-cbd4159db76a-kube-api-access-v6zh5\") pod \"ovsdbserver-sb-0\" (UID: \"6792b2c6-f5cf-454a-858a-cbd4159db76a\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:52:59 crc kubenswrapper[5120]: I0316 16:52:59.248187 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6792b2c6-f5cf-454a-858a-cbd4159db76a-config\") pod \"ovsdbserver-sb-0\" (UID: \"6792b2c6-f5cf-454a-858a-cbd4159db76a\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:52:59 crc kubenswrapper[5120]: I0316 16:52:59.248777 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:52:59 crc kubenswrapper[5120]: I0316 16:52:59.305875 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 16:52:59 crc kubenswrapper[5120]: I0316 16:52:59.323835 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:52:59 crc kubenswrapper[5120]: I0316 16:52:59.362785 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6792b2c6-f5cf-454a-858a-cbd4159db76a-config\") pod \"ovsdbserver-sb-0\" (UID: \"6792b2c6-f5cf-454a-858a-cbd4159db76a\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:52:59 crc kubenswrapper[5120]: I0316 16:52:59.363041 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/6792b2c6-f5cf-454a-858a-cbd4159db76a-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"6792b2c6-f5cf-454a-858a-cbd4159db76a\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:52:59 crc kubenswrapper[5120]: I0316 16:52:59.363091 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/6792b2c6-f5cf-454a-858a-cbd4159db76a-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"6792b2c6-f5cf-454a-858a-cbd4159db76a\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:52:59 crc kubenswrapper[5120]: I0316 16:52:59.363231 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/6792b2c6-f5cf-454a-858a-cbd4159db76a-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"6792b2c6-f5cf-454a-858a-cbd4159db76a\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:52:59 crc kubenswrapper[5120]: I0316 16:52:59.363346 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/6792b2c6-f5cf-454a-858a-cbd4159db76a-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"6792b2c6-f5cf-454a-858a-cbd4159db76a\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:52:59 crc kubenswrapper[5120]: I0316 16:52:59.363428 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6792b2c6-f5cf-454a-858a-cbd4159db76a-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"6792b2c6-f5cf-454a-858a-cbd4159db76a\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:52:59 crc kubenswrapper[5120]: I0316 16:52:59.363456 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"ovsdbserver-sb-0\" (UID: \"6792b2c6-f5cf-454a-858a-cbd4159db76a\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:52:59 crc kubenswrapper[5120]: I0316 16:52:59.363486 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v6zh5\" (UniqueName: \"kubernetes.io/projected/6792b2c6-f5cf-454a-858a-cbd4159db76a-kube-api-access-v6zh5\") pod \"ovsdbserver-sb-0\" (UID: \"6792b2c6-f5cf-454a-858a-cbd4159db76a\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:52:59 crc kubenswrapper[5120]: I0316 16:52:59.365993 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/6792b2c6-f5cf-454a-858a-cbd4159db76a-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"6792b2c6-f5cf-454a-858a-cbd4159db76a\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:52:59 crc kubenswrapper[5120]: I0316 16:52:59.393033 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6792b2c6-f5cf-454a-858a-cbd4159db76a-config\") pod \"ovsdbserver-sb-0\" (UID: \"6792b2c6-f5cf-454a-858a-cbd4159db76a\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:52:59 crc kubenswrapper[5120]: I0316 16:52:59.405383 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/6792b2c6-f5cf-454a-858a-cbd4159db76a-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"6792b2c6-f5cf-454a-858a-cbd4159db76a\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:52:59 crc kubenswrapper[5120]: I0316 16:52:59.405514 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"ovsdbserver-sb-0\" (UID: \"6792b2c6-f5cf-454a-858a-cbd4159db76a\") device mount path \"/mnt/openstack/pv06\"" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:52:59 crc kubenswrapper[5120]: I0316 16:52:59.442983 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/6792b2c6-f5cf-454a-858a-cbd4159db76a-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"6792b2c6-f5cf-454a-858a-cbd4159db76a\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:52:59 crc kubenswrapper[5120]: I0316 16:52:59.458432 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/6792b2c6-f5cf-454a-858a-cbd4159db76a-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"6792b2c6-f5cf-454a-858a-cbd4159db76a\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:52:59 crc kubenswrapper[5120]: I0316 16:52:59.462199 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6zh5\" (UniqueName: \"kubernetes.io/projected/6792b2c6-f5cf-454a-858a-cbd4159db76a-kube-api-access-v6zh5\") pod \"ovsdbserver-sb-0\" (UID: \"6792b2c6-f5cf-454a-858a-cbd4159db76a\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:52:59 crc kubenswrapper[5120]: I0316 16:52:59.466232 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6792b2c6-f5cf-454a-858a-cbd4159db76a-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"6792b2c6-f5cf-454a-858a-cbd4159db76a\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:52:59 crc kubenswrapper[5120]: I0316 16:52:59.491310 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 16:52:59 crc kubenswrapper[5120]: I0316 16:52:59.545881 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc7ba52a-5825-4399-9e38-4d5cd1c02156-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "cc7ba52a-5825-4399-9e38-4d5cd1c02156" (UID: "cc7ba52a-5825-4399-9e38-4d5cd1c02156"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:52:59 crc kubenswrapper[5120]: I0316 16:52:59.553124 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/cc7ba52a-5825-4399-9e38-4d5cd1c02156-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:52:59 crc kubenswrapper[5120]: I0316 16:52:59.631561 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-57f7845c4b-tb6nd"] Mar 16 16:52:59 crc kubenswrapper[5120]: I0316 16:52:59.631904 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/keystone-57f7845c4b-tb6nd" podUID="ffa2d14d-1b44-445b-ab47-1bb134223111" containerName="keystone-api" containerID="cri-o://c1dd20bf9d5fa639b2879a8a31ac5f271715ba78f8066f88de902d4b35a4ff21" gracePeriod=30 Mar 16 16:52:59 crc kubenswrapper[5120]: I0316 16:52:59.656342 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/keystone-57f7845c4b-tb6nd" podUID="ffa2d14d-1b44-445b-ab47-1bb134223111" containerName="keystone-api" probeResult="failure" output="Get \"https://10.217.0.127:5000/v3\": EOF" Mar 16 16:52:59 crc kubenswrapper[5120]: I0316 16:52:59.658765 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:52:59 crc kubenswrapper[5120]: I0316 16:52:59.662370 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"ovsdbserver-sb-0\" (UID: \"6792b2c6-f5cf-454a-858a-cbd4159db76a\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:52:59 crc kubenswrapper[5120]: I0316 16:52:59.717042 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-6d764c69b8-sv9d2"] Mar 16 16:52:59 crc kubenswrapper[5120]: I0316 16:52:59.748056 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:52:59 crc kubenswrapper[5120]: I0316 16:52:59.791225 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-6d764c69b8-sv9d2"] Mar 16 16:52:59 crc kubenswrapper[5120]: I0316 16:52:59.791370 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-6d764c69b8-sv9d2" Mar 16 16:52:59 crc kubenswrapper[5120]: I0316 16:52:59.896667 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/979d8a07-391d-483c-92d1-bb2d256edf99-internal-tls-certs\") pod \"keystone-6d764c69b8-sv9d2\" (UID: \"979d8a07-391d-483c-92d1-bb2d256edf99\") " pod="openstack-kuttl-tests/keystone-6d764c69b8-sv9d2" Mar 16 16:52:59 crc kubenswrapper[5120]: I0316 16:52:59.904300 5120 generic.go:358] "Generic (PLEG): container finished" podID="fb4496e5-279b-4520-a345-c4ed00ede8c9" containerID="6b88504f95b540a2b147aae744cdfc0147fe840248de0b7dbb003027bcb85307" exitCode=0 Mar 16 16:52:59 crc kubenswrapper[5120]: I0316 16:52:59.904329 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-576c5b55d6-5zsh7" event={"ID":"fb4496e5-279b-4520-a345-c4ed00ede8c9","Type":"ContainerDied","Data":"6b88504f95b540a2b147aae744cdfc0147fe840248de0b7dbb003027bcb85307"} Mar 16 16:52:59 crc kubenswrapper[5120]: I0316 16:52:59.919297 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-d7c95f898-g5nln"] Mar 16 16:52:59 crc kubenswrapper[5120]: I0316 16:52:59.919369 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/979d8a07-391d-483c-92d1-bb2d256edf99-credential-keys\") pod \"keystone-6d764c69b8-sv9d2\" (UID: \"979d8a07-391d-483c-92d1-bb2d256edf99\") " pod="openstack-kuttl-tests/keystone-6d764c69b8-sv9d2" Mar 16 16:52:59 crc kubenswrapper[5120]: I0316 16:52:59.919490 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/979d8a07-391d-483c-92d1-bb2d256edf99-config-data\") pod \"keystone-6d764c69b8-sv9d2\" (UID: \"979d8a07-391d-483c-92d1-bb2d256edf99\") " pod="openstack-kuttl-tests/keystone-6d764c69b8-sv9d2" Mar 16 16:52:59 crc kubenswrapper[5120]: I0316 16:52:59.919575 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-d7c95f898-g5nln" podUID="ebceb235-ad03-49fd-9921-f5be8c1851be" containerName="neutron-api" containerID="cri-o://b24f04e9b859c0e1ed187c680ab8fe6ea7ce43f2fdccb344c3d429c318b3a988" gracePeriod=30 Mar 16 16:52:59 crc kubenswrapper[5120]: I0316 16:52:59.919599 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/979d8a07-391d-483c-92d1-bb2d256edf99-combined-ca-bundle\") pod \"keystone-6d764c69b8-sv9d2\" (UID: \"979d8a07-391d-483c-92d1-bb2d256edf99\") " pod="openstack-kuttl-tests/keystone-6d764c69b8-sv9d2" Mar 16 16:52:59 crc kubenswrapper[5120]: I0316 16:52:59.919953 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/979d8a07-391d-483c-92d1-bb2d256edf99-fernet-keys\") pod \"keystone-6d764c69b8-sv9d2\" (UID: \"979d8a07-391d-483c-92d1-bb2d256edf99\") " pod="openstack-kuttl-tests/keystone-6d764c69b8-sv9d2" Mar 16 16:52:59 crc kubenswrapper[5120]: I0316 16:52:59.919994 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/979d8a07-391d-483c-92d1-bb2d256edf99-scripts\") pod \"keystone-6d764c69b8-sv9d2\" (UID: \"979d8a07-391d-483c-92d1-bb2d256edf99\") " pod="openstack-kuttl-tests/keystone-6d764c69b8-sv9d2" Mar 16 16:52:59 crc kubenswrapper[5120]: I0316 16:52:59.920183 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/979d8a07-391d-483c-92d1-bb2d256edf99-public-tls-certs\") pod \"keystone-6d764c69b8-sv9d2\" (UID: \"979d8a07-391d-483c-92d1-bb2d256edf99\") " pod="openstack-kuttl-tests/keystone-6d764c69b8-sv9d2" Mar 16 16:52:59 crc kubenswrapper[5120]: I0316 16:52:59.920336 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzd6q\" (UniqueName: \"kubernetes.io/projected/979d8a07-391d-483c-92d1-bb2d256edf99-kube-api-access-fzd6q\") pod \"keystone-6d764c69b8-sv9d2\" (UID: \"979d8a07-391d-483c-92d1-bb2d256edf99\") " pod="openstack-kuttl-tests/keystone-6d764c69b8-sv9d2" Mar 16 16:52:59 crc kubenswrapper[5120]: I0316 16:52:59.920482 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-d7c95f898-g5nln" podUID="ebceb235-ad03-49fd-9921-f5be8c1851be" containerName="neutron-httpd" containerID="cri-o://6dbf15fc5cb9e1dfb9f424295383c4a6610b03bef67f06b2717ffa77e0acef49" gracePeriod=30 Mar 16 16:52:59 crc kubenswrapper[5120]: I0316 16:52:59.963091 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/neutron-d7c95f898-g5nln" podUID="ebceb235-ad03-49fd-9921-f5be8c1851be" containerName="neutron-httpd" probeResult="failure" output="HTTP probe failed with statuscode: 503" Mar 16 16:52:59 crc kubenswrapper[5120]: I0316 16:52:59.985130 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-7f77bff94b-c5ng2" event={"ID":"67c7567e-232d-4853-961c-dcc1799c7dae","Type":"ContainerStarted","Data":"07bbe1168472f1c6963df0f4f0c99eef5b1a0f233ae4b737611b952de551752c"} Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.023807 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/979d8a07-391d-483c-92d1-bb2d256edf99-fernet-keys\") pod \"keystone-6d764c69b8-sv9d2\" (UID: \"979d8a07-391d-483c-92d1-bb2d256edf99\") " pod="openstack-kuttl-tests/keystone-6d764c69b8-sv9d2" Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.023863 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/979d8a07-391d-483c-92d1-bb2d256edf99-scripts\") pod \"keystone-6d764c69b8-sv9d2\" (UID: \"979d8a07-391d-483c-92d1-bb2d256edf99\") " pod="openstack-kuttl-tests/keystone-6d764c69b8-sv9d2" Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.023976 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/979d8a07-391d-483c-92d1-bb2d256edf99-public-tls-certs\") pod \"keystone-6d764c69b8-sv9d2\" (UID: \"979d8a07-391d-483c-92d1-bb2d256edf99\") " pod="openstack-kuttl-tests/keystone-6d764c69b8-sv9d2" Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.024067 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fzd6q\" (UniqueName: \"kubernetes.io/projected/979d8a07-391d-483c-92d1-bb2d256edf99-kube-api-access-fzd6q\") pod \"keystone-6d764c69b8-sv9d2\" (UID: \"979d8a07-391d-483c-92d1-bb2d256edf99\") " pod="openstack-kuttl-tests/keystone-6d764c69b8-sv9d2" Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.024184 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/979d8a07-391d-483c-92d1-bb2d256edf99-internal-tls-certs\") pod \"keystone-6d764c69b8-sv9d2\" (UID: \"979d8a07-391d-483c-92d1-bb2d256edf99\") " pod="openstack-kuttl-tests/keystone-6d764c69b8-sv9d2" Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.024230 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/979d8a07-391d-483c-92d1-bb2d256edf99-credential-keys\") pod \"keystone-6d764c69b8-sv9d2\" (UID: \"979d8a07-391d-483c-92d1-bb2d256edf99\") " pod="openstack-kuttl-tests/keystone-6d764c69b8-sv9d2" Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.024236 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"50c82211-4383-41cb-a31c-9bdfb156b586","Type":"ContainerStarted","Data":"423900fcfc665a7c0642a3969b0d45a290a37855935f76532dcda5ffb9c954cc"} Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.024276 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/979d8a07-391d-483c-92d1-bb2d256edf99-config-data\") pod \"keystone-6d764c69b8-sv9d2\" (UID: \"979d8a07-391d-483c-92d1-bb2d256edf99\") " pod="openstack-kuttl-tests/keystone-6d764c69b8-sv9d2" Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.024330 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/979d8a07-391d-483c-92d1-bb2d256edf99-combined-ca-bundle\") pod \"keystone-6d764c69b8-sv9d2\" (UID: \"979d8a07-391d-483c-92d1-bb2d256edf99\") " pod="openstack-kuttl-tests/keystone-6d764c69b8-sv9d2" Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.030113 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-576c5b55d6-5zsh7" Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.054408 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-84f95d87c8-s7s4d"] Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.055190 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/979d8a07-391d-483c-92d1-bb2d256edf99-config-data\") pod \"keystone-6d764c69b8-sv9d2\" (UID: \"979d8a07-391d-483c-92d1-bb2d256edf99\") " pod="openstack-kuttl-tests/keystone-6d764c69b8-sv9d2" Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.062516 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/979d8a07-391d-483c-92d1-bb2d256edf99-credential-keys\") pod \"keystone-6d764c69b8-sv9d2\" (UID: \"979d8a07-391d-483c-92d1-bb2d256edf99\") " pod="openstack-kuttl-tests/keystone-6d764c69b8-sv9d2" Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.062990 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/979d8a07-391d-483c-92d1-bb2d256edf99-public-tls-certs\") pod \"keystone-6d764c69b8-sv9d2\" (UID: \"979d8a07-391d-483c-92d1-bb2d256edf99\") " pod="openstack-kuttl-tests/keystone-6d764c69b8-sv9d2" Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.063407 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/979d8a07-391d-483c-92d1-bb2d256edf99-internal-tls-certs\") pod \"keystone-6d764c69b8-sv9d2\" (UID: \"979d8a07-391d-483c-92d1-bb2d256edf99\") " pod="openstack-kuttl-tests/keystone-6d764c69b8-sv9d2" Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.063921 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/979d8a07-391d-483c-92d1-bb2d256edf99-fernet-keys\") pod \"keystone-6d764c69b8-sv9d2\" (UID: \"979d8a07-391d-483c-92d1-bb2d256edf99\") " pod="openstack-kuttl-tests/keystone-6d764c69b8-sv9d2" Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.064174 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/979d8a07-391d-483c-92d1-bb2d256edf99-scripts\") pod \"keystone-6d764c69b8-sv9d2\" (UID: \"979d8a07-391d-483c-92d1-bb2d256edf99\") " pod="openstack-kuttl-tests/keystone-6d764c69b8-sv9d2" Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.085741 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/979d8a07-391d-483c-92d1-bb2d256edf99-combined-ca-bundle\") pod \"keystone-6d764c69b8-sv9d2\" (UID: \"979d8a07-391d-483c-92d1-bb2d256edf99\") " pod="openstack-kuttl-tests/keystone-6d764c69b8-sv9d2" Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.111554 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzd6q\" (UniqueName: \"kubernetes.io/projected/979d8a07-391d-483c-92d1-bb2d256edf99-kube-api-access-fzd6q\") pod \"keystone-6d764c69b8-sv9d2\" (UID: \"979d8a07-391d-483c-92d1-bb2d256edf99\") " pod="openstack-kuttl-tests/keystone-6d764c69b8-sv9d2" Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.114501 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb4496e5-279b-4520-a345-c4ed00ede8c9" containerName="barbican-keystone-listener-log" Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.114534 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb4496e5-279b-4520-a345-c4ed00ede8c9" containerName="barbican-keystone-listener-log" Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.114635 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb4496e5-279b-4520-a345-c4ed00ede8c9" containerName="barbican-keystone-listener" Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.114645 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb4496e5-279b-4520-a345-c4ed00ede8c9" containerName="barbican-keystone-listener" Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.114920 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="fb4496e5-279b-4520-a345-c4ed00ede8c9" containerName="barbican-keystone-listener-log" Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.114947 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="fb4496e5-279b-4520-a345-c4ed00ede8c9" containerName="barbican-keystone-listener" Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.125353 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/fb4496e5-279b-4520-a345-c4ed00ede8c9-config-data-custom\") pod \"fb4496e5-279b-4520-a345-c4ed00ede8c9\" (UID: \"fb4496e5-279b-4520-a345-c4ed00ede8c9\") " Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.125737 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/fb4496e5-279b-4520-a345-c4ed00ede8c9-logs\") pod \"fb4496e5-279b-4520-a345-c4ed00ede8c9\" (UID: \"fb4496e5-279b-4520-a345-c4ed00ede8c9\") " Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.125911 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kwp88\" (UniqueName: \"kubernetes.io/projected/fb4496e5-279b-4520-a345-c4ed00ede8c9-kube-api-access-kwp88\") pod \"fb4496e5-279b-4520-a345-c4ed00ede8c9\" (UID: \"fb4496e5-279b-4520-a345-c4ed00ede8c9\") " Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.126124 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fb4496e5-279b-4520-a345-c4ed00ede8c9-combined-ca-bundle\") pod \"fb4496e5-279b-4520-a345-c4ed00ede8c9\" (UID: \"fb4496e5-279b-4520-a345-c4ed00ede8c9\") " Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.126300 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fb4496e5-279b-4520-a345-c4ed00ede8c9-config-data\") pod \"fb4496e5-279b-4520-a345-c4ed00ede8c9\" (UID: \"fb4496e5-279b-4520-a345-c4ed00ede8c9\") " Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.128801 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb4496e5-279b-4520-a345-c4ed00ede8c9-logs" (OuterVolumeSpecName: "logs") pod "fb4496e5-279b-4520-a345-c4ed00ede8c9" (UID: "fb4496e5-279b-4520-a345-c4ed00ede8c9"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.165230 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb4496e5-279b-4520-a345-c4ed00ede8c9-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "fb4496e5-279b-4520-a345-c4ed00ede8c9" (UID: "fb4496e5-279b-4520-a345-c4ed00ede8c9"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.165792 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"0fba253d-bef6-490a-8d34-6be75a260d03","Type":"ContainerStarted","Data":"cf30bf858ee3854358c96c7f21db6e3d78dc11544569687a33f15adb8935dbe6"} Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.165835 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"b4ce877d-d510-483c-9a9c-b149879f1755","Type":"ContainerStarted","Data":"426729983f303ba8a51519f9cd7d552cb66105e64258abc8aac0b8ea4920460e"} Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.165855 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-84f95d87c8-s7s4d"] Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.166001 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-84f95d87c8-s7s4d" Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.199400 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb4496e5-279b-4520-a345-c4ed00ede8c9-kube-api-access-kwp88" (OuterVolumeSpecName: "kube-api-access-kwp88") pod "fb4496e5-279b-4520-a345-c4ed00ede8c9" (UID: "fb4496e5-279b-4520-a345-c4ed00ede8c9"). InnerVolumeSpecName "kube-api-access-kwp88". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.270487 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-6d764c69b8-sv9d2" Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.271158 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/3853023d-8cc5-42de-9f91-d0609e3fe565-internal-tls-certs\") pod \"neutron-84f95d87c8-s7s4d\" (UID: \"3853023d-8cc5-42de-9f91-d0609e3fe565\") " pod="openstack-kuttl-tests/neutron-84f95d87c8-s7s4d" Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.271442 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4pcj\" (UniqueName: \"kubernetes.io/projected/3853023d-8cc5-42de-9f91-d0609e3fe565-kube-api-access-g4pcj\") pod \"neutron-84f95d87c8-s7s4d\" (UID: \"3853023d-8cc5-42de-9f91-d0609e3fe565\") " pod="openstack-kuttl-tests/neutron-84f95d87c8-s7s4d" Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.271490 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/3853023d-8cc5-42de-9f91-d0609e3fe565-ovndb-tls-certs\") pod \"neutron-84f95d87c8-s7s4d\" (UID: \"3853023d-8cc5-42de-9f91-d0609e3fe565\") " pod="openstack-kuttl-tests/neutron-84f95d87c8-s7s4d" Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.271533 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/3853023d-8cc5-42de-9f91-d0609e3fe565-public-tls-certs\") pod \"neutron-84f95d87c8-s7s4d\" (UID: \"3853023d-8cc5-42de-9f91-d0609e3fe565\") " pod="openstack-kuttl-tests/neutron-84f95d87c8-s7s4d" Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.271709 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/3853023d-8cc5-42de-9f91-d0609e3fe565-httpd-config\") pod \"neutron-84f95d87c8-s7s4d\" (UID: \"3853023d-8cc5-42de-9f91-d0609e3fe565\") " pod="openstack-kuttl-tests/neutron-84f95d87c8-s7s4d" Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.271787 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3853023d-8cc5-42de-9f91-d0609e3fe565-config\") pod \"neutron-84f95d87c8-s7s4d\" (UID: \"3853023d-8cc5-42de-9f91-d0609e3fe565\") " pod="openstack-kuttl-tests/neutron-84f95d87c8-s7s4d" Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.271862 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3853023d-8cc5-42de-9f91-d0609e3fe565-combined-ca-bundle\") pod \"neutron-84f95d87c8-s7s4d\" (UID: \"3853023d-8cc5-42de-9f91-d0609e3fe565\") " pod="openstack-kuttl-tests/neutron-84f95d87c8-s7s4d" Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.272003 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/fb4496e5-279b-4520-a345-c4ed00ede8c9-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.272022 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/fb4496e5-279b-4520-a345-c4ed00ede8c9-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.272036 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kwp88\" (UniqueName: \"kubernetes.io/projected/fb4496e5-279b-4520-a345-c4ed00ede8c9-kube-api-access-kwp88\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.374617 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/3853023d-8cc5-42de-9f91-d0609e3fe565-httpd-config\") pod \"neutron-84f95d87c8-s7s4d\" (UID: \"3853023d-8cc5-42de-9f91-d0609e3fe565\") " pod="openstack-kuttl-tests/neutron-84f95d87c8-s7s4d" Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.374699 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3853023d-8cc5-42de-9f91-d0609e3fe565-config\") pod \"neutron-84f95d87c8-s7s4d\" (UID: \"3853023d-8cc5-42de-9f91-d0609e3fe565\") " pod="openstack-kuttl-tests/neutron-84f95d87c8-s7s4d" Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.374785 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3853023d-8cc5-42de-9f91-d0609e3fe565-combined-ca-bundle\") pod \"neutron-84f95d87c8-s7s4d\" (UID: \"3853023d-8cc5-42de-9f91-d0609e3fe565\") " pod="openstack-kuttl-tests/neutron-84f95d87c8-s7s4d" Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.374943 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/3853023d-8cc5-42de-9f91-d0609e3fe565-internal-tls-certs\") pod \"neutron-84f95d87c8-s7s4d\" (UID: \"3853023d-8cc5-42de-9f91-d0609e3fe565\") " pod="openstack-kuttl-tests/neutron-84f95d87c8-s7s4d" Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.375280 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g4pcj\" (UniqueName: \"kubernetes.io/projected/3853023d-8cc5-42de-9f91-d0609e3fe565-kube-api-access-g4pcj\") pod \"neutron-84f95d87c8-s7s4d\" (UID: \"3853023d-8cc5-42de-9f91-d0609e3fe565\") " pod="openstack-kuttl-tests/neutron-84f95d87c8-s7s4d" Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.375346 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/3853023d-8cc5-42de-9f91-d0609e3fe565-ovndb-tls-certs\") pod \"neutron-84f95d87c8-s7s4d\" (UID: \"3853023d-8cc5-42de-9f91-d0609e3fe565\") " pod="openstack-kuttl-tests/neutron-84f95d87c8-s7s4d" Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.375388 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/3853023d-8cc5-42de-9f91-d0609e3fe565-public-tls-certs\") pod \"neutron-84f95d87c8-s7s4d\" (UID: \"3853023d-8cc5-42de-9f91-d0609e3fe565\") " pod="openstack-kuttl-tests/neutron-84f95d87c8-s7s4d" Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.381736 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/3853023d-8cc5-42de-9f91-d0609e3fe565-public-tls-certs\") pod \"neutron-84f95d87c8-s7s4d\" (UID: \"3853023d-8cc5-42de-9f91-d0609e3fe565\") " pod="openstack-kuttl-tests/neutron-84f95d87c8-s7s4d" Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.383162 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/3853023d-8cc5-42de-9f91-d0609e3fe565-httpd-config\") pod \"neutron-84f95d87c8-s7s4d\" (UID: \"3853023d-8cc5-42de-9f91-d0609e3fe565\") " pod="openstack-kuttl-tests/neutron-84f95d87c8-s7s4d" Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.385537 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb4496e5-279b-4520-a345-c4ed00ede8c9-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "fb4496e5-279b-4520-a345-c4ed00ede8c9" (UID: "fb4496e5-279b-4520-a345-c4ed00ede8c9"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.387119 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="f1c9b873-c644-4c80-941e-3ec3415485e4" containerName="nova-cell1-conductor-conductor" containerID="cri-o://e84a6ccec0bb33bc2cd454d4394c28b18bc68551ef47c224ec6f142319f3040e" gracePeriod=30 Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.387527 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="20f74fa1-8357-4b18-928a-4ae91c38bafe" containerName="nova-scheduler-scheduler" containerID="cri-o://377eb38e724962e46bea949d6e0d9516f23c54581a6bf4678d880ce1bdeaddd8" gracePeriod=30 Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.387593 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"20f74fa1-8357-4b18-928a-4ae91c38bafe","Type":"ContainerStarted","Data":"377eb38e724962e46bea949d6e0d9516f23c54581a6bf4678d880ce1bdeaddd8"} Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.391708 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/3853023d-8cc5-42de-9f91-d0609e3fe565-ovndb-tls-certs\") pod \"neutron-84f95d87c8-s7s4d\" (UID: \"3853023d-8cc5-42de-9f91-d0609e3fe565\") " pod="openstack-kuttl-tests/neutron-84f95d87c8-s7s4d" Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.401911 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb4496e5-279b-4520-a345-c4ed00ede8c9-config-data" (OuterVolumeSpecName: "config-data") pod "fb4496e5-279b-4520-a345-c4ed00ede8c9" (UID: "fb4496e5-279b-4520-a345-c4ed00ede8c9"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.409553 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/3853023d-8cc5-42de-9f91-d0609e3fe565-config\") pod \"neutron-84f95d87c8-s7s4d\" (UID: \"3853023d-8cc5-42de-9f91-d0609e3fe565\") " pod="openstack-kuttl-tests/neutron-84f95d87c8-s7s4d" Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.412537 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4pcj\" (UniqueName: \"kubernetes.io/projected/3853023d-8cc5-42de-9f91-d0609e3fe565-kube-api-access-g4pcj\") pod \"neutron-84f95d87c8-s7s4d\" (UID: \"3853023d-8cc5-42de-9f91-d0609e3fe565\") " pod="openstack-kuttl-tests/neutron-84f95d87c8-s7s4d" Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.440318 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-69d57497c4-7bhm5"] Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.444814 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-69d57497c4-7bhm5"] Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.467067 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3853023d-8cc5-42de-9f91-d0609e3fe565-combined-ca-bundle\") pod \"neutron-84f95d87c8-s7s4d\" (UID: \"3853023d-8cc5-42de-9f91-d0609e3fe565\") " pod="openstack-kuttl-tests/neutron-84f95d87c8-s7s4d" Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.467425 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/3853023d-8cc5-42de-9f91-d0609e3fe565-internal-tls-certs\") pod \"neutron-84f95d87c8-s7s4d\" (UID: \"3853023d-8cc5-42de-9f91-d0609e3fe565\") " pod="openstack-kuttl-tests/neutron-84f95d87c8-s7s4d" Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.472740 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-576bc9cb6c-q5s4k"] Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.478502 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fb4496e5-279b-4520-a345-c4ed00ede8c9-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.478530 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fb4496e5-279b-4520-a345-c4ed00ede8c9-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.495168 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-worker-576bc9cb6c-q5s4k"] Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.515630 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.531705 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.545557 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.561302 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.561482 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.567123 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ovndbcluster-nb-ovndbs\"" Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.567335 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovndbcluster-nb-config\"" Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.567484 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ovncluster-ovndbcluster-nb-dockercfg-6n6ct\"" Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.572426 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovndbcluster-nb-scripts\"" Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.593645 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-d99589cd-7z8cg"] Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.617211 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-d99589cd-7z8cg"] Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.630617 5120 scope.go:117] "RemoveContainer" containerID="90916447cca93d6401deab90112baaf449192048ae8cc43a6c81786b2c2628a9" Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.639113 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-84f95d87c8-s7s4d" Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.694621 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") pod \"ovsdbserver-nb-0\" (UID: \"32963b23-d87d-4107-9a13-32737c586ab3\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.694777 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/32963b23-d87d-4107-9a13-32737c586ab3-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"32963b23-d87d-4107-9a13-32737c586ab3\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.694905 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/32963b23-d87d-4107-9a13-32737c586ab3-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"32963b23-d87d-4107-9a13-32737c586ab3\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.700152 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/32963b23-d87d-4107-9a13-32737c586ab3-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"32963b23-d87d-4107-9a13-32737c586ab3\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.700334 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/32963b23-d87d-4107-9a13-32737c586ab3-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"32963b23-d87d-4107-9a13-32737c586ab3\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.700616 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/32963b23-d87d-4107-9a13-32737c586ab3-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"32963b23-d87d-4107-9a13-32737c586ab3\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.700744 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79rnw\" (UniqueName: \"kubernetes.io/projected/32963b23-d87d-4107-9a13-32737c586ab3-kube-api-access-79rnw\") pod \"ovsdbserver-nb-0\" (UID: \"32963b23-d87d-4107-9a13-32737c586ab3\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.700927 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/32963b23-d87d-4107-9a13-32737c586ab3-config\") pod \"ovsdbserver-nb-0\" (UID: \"32963b23-d87d-4107-9a13-32737c586ab3\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.725886 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="18684823-3972-4cf6-8e42-792360b387bb" path="/var/lib/kubelet/pods/18684823-3972-4cf6-8e42-792360b387bb/volumes" Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.720686 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.734168 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-scheduler-0" podStartSLOduration=5.734141831 podStartE2EDuration="5.734141831s" podCreationTimestamp="2026-03-16 16:52:55 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:53:00.413179975 +0000 UTC m=+4882.567111642" watchObservedRunningTime="2026-03-16 16:53:00.734141831 +0000 UTC m=+4882.888073488" Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.743510 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="976611b4-4a36-49a3-9bd6-f7b5ca2899f4" path="/var/lib/kubelet/pods/976611b4-4a36-49a3-9bd6-f7b5ca2899f4/volumes" Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.756052 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="986cfe2c-03bb-4027-b930-79c5b3dd8fe4" path="/var/lib/kubelet/pods/986cfe2c-03bb-4027-b930-79c5b3dd8fe4/volumes" Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.757064 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc7ba52a-5825-4399-9e38-4d5cd1c02156" path="/var/lib/kubelet/pods/cc7ba52a-5825-4399-9e38-4d5cd1c02156/volumes" Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.766581 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f9a4fc77-147c-46f7-a4de-e36f3086b09b" path="/var/lib/kubelet/pods/f9a4fc77-147c-46f7-a4de-e36f3086b09b/volumes" Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.803073 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/32963b23-d87d-4107-9a13-32737c586ab3-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"32963b23-d87d-4107-9a13-32737c586ab3\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.803194 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-79rnw\" (UniqueName: \"kubernetes.io/projected/32963b23-d87d-4107-9a13-32737c586ab3-kube-api-access-79rnw\") pod \"ovsdbserver-nb-0\" (UID: \"32963b23-d87d-4107-9a13-32737c586ab3\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.803346 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/32963b23-d87d-4107-9a13-32737c586ab3-config\") pod \"ovsdbserver-nb-0\" (UID: \"32963b23-d87d-4107-9a13-32737c586ab3\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.803473 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") pod \"ovsdbserver-nb-0\" (UID: \"32963b23-d87d-4107-9a13-32737c586ab3\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.803533 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/32963b23-d87d-4107-9a13-32737c586ab3-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"32963b23-d87d-4107-9a13-32737c586ab3\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.803602 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/32963b23-d87d-4107-9a13-32737c586ab3-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"32963b23-d87d-4107-9a13-32737c586ab3\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.803640 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/32963b23-d87d-4107-9a13-32737c586ab3-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"32963b23-d87d-4107-9a13-32737c586ab3\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.803702 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/32963b23-d87d-4107-9a13-32737c586ab3-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"32963b23-d87d-4107-9a13-32737c586ab3\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.804163 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/32963b23-d87d-4107-9a13-32737c586ab3-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"32963b23-d87d-4107-9a13-32737c586ab3\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.805126 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") pod \"ovsdbserver-nb-0\" (UID: \"32963b23-d87d-4107-9a13-32737c586ab3\") device mount path \"/mnt/openstack/pv17\"" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.808620 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/32963b23-d87d-4107-9a13-32737c586ab3-config\") pod \"ovsdbserver-nb-0\" (UID: \"32963b23-d87d-4107-9a13-32737c586ab3\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.813194 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/32963b23-d87d-4107-9a13-32737c586ab3-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"32963b23-d87d-4107-9a13-32737c586ab3\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.842642 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/32963b23-d87d-4107-9a13-32737c586ab3-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"32963b23-d87d-4107-9a13-32737c586ab3\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.844772 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-79rnw\" (UniqueName: \"kubernetes.io/projected/32963b23-d87d-4107-9a13-32737c586ab3-kube-api-access-79rnw\") pod \"ovsdbserver-nb-0\" (UID: \"32963b23-d87d-4107-9a13-32737c586ab3\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.850827 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/32963b23-d87d-4107-9a13-32737c586ab3-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"32963b23-d87d-4107-9a13-32737c586ab3\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.859499 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/32963b23-d87d-4107-9a13-32737c586ab3-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"32963b23-d87d-4107-9a13-32737c586ab3\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.896994 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") pod \"ovsdbserver-nb-0\" (UID: \"32963b23-d87d-4107-9a13-32737c586ab3\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.906126 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/18e2f22a-0bc1-4514-afe4-56bdf5cb1670-nova-novncproxy-tls-certs\") pod \"18e2f22a-0bc1-4514-afe4-56bdf5cb1670\" (UID: \"18e2f22a-0bc1-4514-afe4-56bdf5cb1670\") " Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.906301 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9tkrl\" (UniqueName: \"kubernetes.io/projected/18e2f22a-0bc1-4514-afe4-56bdf5cb1670-kube-api-access-9tkrl\") pod \"18e2f22a-0bc1-4514-afe4-56bdf5cb1670\" (UID: \"18e2f22a-0bc1-4514-afe4-56bdf5cb1670\") " Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.906629 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/18e2f22a-0bc1-4514-afe4-56bdf5cb1670-combined-ca-bundle\") pod \"18e2f22a-0bc1-4514-afe4-56bdf5cb1670\" (UID: \"18e2f22a-0bc1-4514-afe4-56bdf5cb1670\") " Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.906739 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/18e2f22a-0bc1-4514-afe4-56bdf5cb1670-config-data\") pod \"18e2f22a-0bc1-4514-afe4-56bdf5cb1670\" (UID: \"18e2f22a-0bc1-4514-afe4-56bdf5cb1670\") " Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.906850 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/18e2f22a-0bc1-4514-afe4-56bdf5cb1670-vencrypt-tls-certs\") pod \"18e2f22a-0bc1-4514-afe4-56bdf5cb1670\" (UID: \"18e2f22a-0bc1-4514-afe4-56bdf5cb1670\") " Mar 16 16:53:00 crc kubenswrapper[5120]: I0316 16:53:00.975592 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-84f95d87c8-s7s4d"] Mar 16 16:53:01 crc kubenswrapper[5120]: I0316 16:53:01.019504 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18e2f22a-0bc1-4514-afe4-56bdf5cb1670-kube-api-access-9tkrl" (OuterVolumeSpecName: "kube-api-access-9tkrl") pod "18e2f22a-0bc1-4514-afe4-56bdf5cb1670" (UID: "18e2f22a-0bc1-4514-afe4-56bdf5cb1670"). InnerVolumeSpecName "kube-api-access-9tkrl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:53:01 crc kubenswrapper[5120]: I0316 16:53:01.021439 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-7555689c4b-84shq"] Mar 16 16:53:01 crc kubenswrapper[5120]: I0316 16:53:01.022562 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18e2f22a-0bc1-4514-afe4-56bdf5cb1670" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 16:53:01 crc kubenswrapper[5120]: I0316 16:53:01.022581 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="18e2f22a-0bc1-4514-afe4-56bdf5cb1670" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 16:53:01 crc kubenswrapper[5120]: I0316 16:53:01.022897 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="18e2f22a-0bc1-4514-afe4-56bdf5cb1670" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 16:53:01 crc kubenswrapper[5120]: I0316 16:53:01.035656 5120 scope.go:117] "RemoveContainer" containerID="3184591cfeb6be7145725a7421e98898364ca1929244d5f99995dc4fa0dd58e0" Mar 16 16:53:01 crc kubenswrapper[5120]: I0316 16:53:01.095046 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-7555689c4b-84shq"] Mar 16 16:53:01 crc kubenswrapper[5120]: I0316 16:53:01.095171 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-7555689c4b-84shq" Mar 16 16:53:01 crc kubenswrapper[5120]: I0316 16:53:01.125552 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9tkrl\" (UniqueName: \"kubernetes.io/projected/18e2f22a-0bc1-4514-afe4-56bdf5cb1670-kube-api-access-9tkrl\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:01 crc kubenswrapper[5120]: I0316 16:53:01.125602 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 16:53:01 crc kubenswrapper[5120]: I0316 16:53:01.182876 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-7555689c4b-84shq"] Mar 16 16:53:01 crc kubenswrapper[5120]: I0316 16:53:01.204522 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:53:01 crc kubenswrapper[5120]: I0316 16:53:01.224610 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-c8fc658f4-sqwl6"] Mar 16 16:53:01 crc kubenswrapper[5120]: I0316 16:53:01.232305 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-c8fc658f4-sqwl6"] Mar 16 16:53:01 crc kubenswrapper[5120]: I0316 16:53:01.232354 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-c8fc658f4-sqwl6" Mar 16 16:53:01 crc kubenswrapper[5120]: I0316 16:53:01.235525 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e5acac7f-9646-4be1-ac22-31326296e4de-combined-ca-bundle\") pod \"neutron-7555689c4b-84shq\" (UID: \"e5acac7f-9646-4be1-ac22-31326296e4de\") " pod="openstack-kuttl-tests/neutron-7555689c4b-84shq" Mar 16 16:53:01 crc kubenswrapper[5120]: I0316 16:53:01.235789 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7tbt\" (UniqueName: \"kubernetes.io/projected/e5acac7f-9646-4be1-ac22-31326296e4de-kube-api-access-w7tbt\") pod \"neutron-7555689c4b-84shq\" (UID: \"e5acac7f-9646-4be1-ac22-31326296e4de\") " pod="openstack-kuttl-tests/neutron-7555689c4b-84shq" Mar 16 16:53:01 crc kubenswrapper[5120]: I0316 16:53:01.236051 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e5acac7f-9646-4be1-ac22-31326296e4de-internal-tls-certs\") pod \"neutron-7555689c4b-84shq\" (UID: \"e5acac7f-9646-4be1-ac22-31326296e4de\") " pod="openstack-kuttl-tests/neutron-7555689c4b-84shq" Mar 16 16:53:01 crc kubenswrapper[5120]: I0316 16:53:01.236160 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e5acac7f-9646-4be1-ac22-31326296e4de-public-tls-certs\") pod \"neutron-7555689c4b-84shq\" (UID: \"e5acac7f-9646-4be1-ac22-31326296e4de\") " pod="openstack-kuttl-tests/neutron-7555689c4b-84shq" Mar 16 16:53:01 crc kubenswrapper[5120]: I0316 16:53:01.236185 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e5acac7f-9646-4be1-ac22-31326296e4de-config\") pod \"neutron-7555689c4b-84shq\" (UID: \"e5acac7f-9646-4be1-ac22-31326296e4de\") " pod="openstack-kuttl-tests/neutron-7555689c4b-84shq" Mar 16 16:53:01 crc kubenswrapper[5120]: I0316 16:53:01.236298 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/e5acac7f-9646-4be1-ac22-31326296e4de-ovndb-tls-certs\") pod \"neutron-7555689c4b-84shq\" (UID: \"e5acac7f-9646-4be1-ac22-31326296e4de\") " pod="openstack-kuttl-tests/neutron-7555689c4b-84shq" Mar 16 16:53:01 crc kubenswrapper[5120]: I0316 16:53:01.236419 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/e5acac7f-9646-4be1-ac22-31326296e4de-httpd-config\") pod \"neutron-7555689c4b-84shq\" (UID: \"e5acac7f-9646-4be1-ac22-31326296e4de\") " pod="openstack-kuttl-tests/neutron-7555689c4b-84shq" Mar 16 16:53:01 crc kubenswrapper[5120]: I0316 16:53:01.347635 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/e5acac7f-9646-4be1-ac22-31326296e4de-ovndb-tls-certs\") pod \"neutron-7555689c4b-84shq\" (UID: \"e5acac7f-9646-4be1-ac22-31326296e4de\") " pod="openstack-kuttl-tests/neutron-7555689c4b-84shq" Mar 16 16:53:01 crc kubenswrapper[5120]: I0316 16:53:01.347727 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/34e6ded3-dd6f-46bb-9d23-fa8724b78ace-combined-ca-bundle\") pod \"neutron-c8fc658f4-sqwl6\" (UID: \"34e6ded3-dd6f-46bb-9d23-fa8724b78ace\") " pod="openstack-kuttl-tests/neutron-c8fc658f4-sqwl6" Mar 16 16:53:01 crc kubenswrapper[5120]: I0316 16:53:01.347899 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/e5acac7f-9646-4be1-ac22-31326296e4de-httpd-config\") pod \"neutron-7555689c4b-84shq\" (UID: \"e5acac7f-9646-4be1-ac22-31326296e4de\") " pod="openstack-kuttl-tests/neutron-7555689c4b-84shq" Mar 16 16:53:01 crc kubenswrapper[5120]: I0316 16:53:01.348083 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e5acac7f-9646-4be1-ac22-31326296e4de-combined-ca-bundle\") pod \"neutron-7555689c4b-84shq\" (UID: \"e5acac7f-9646-4be1-ac22-31326296e4de\") " pod="openstack-kuttl-tests/neutron-7555689c4b-84shq" Mar 16 16:53:01 crc kubenswrapper[5120]: I0316 16:53:01.348127 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/34e6ded3-dd6f-46bb-9d23-fa8724b78ace-httpd-config\") pod \"neutron-c8fc658f4-sqwl6\" (UID: \"34e6ded3-dd6f-46bb-9d23-fa8724b78ace\") " pod="openstack-kuttl-tests/neutron-c8fc658f4-sqwl6" Mar 16 16:53:01 crc kubenswrapper[5120]: I0316 16:53:01.348150 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/34e6ded3-dd6f-46bb-9d23-fa8724b78ace-public-tls-certs\") pod \"neutron-c8fc658f4-sqwl6\" (UID: \"34e6ded3-dd6f-46bb-9d23-fa8724b78ace\") " pod="openstack-kuttl-tests/neutron-c8fc658f4-sqwl6" Mar 16 16:53:01 crc kubenswrapper[5120]: I0316 16:53:01.348250 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/34e6ded3-dd6f-46bb-9d23-fa8724b78ace-internal-tls-certs\") pod \"neutron-c8fc658f4-sqwl6\" (UID: \"34e6ded3-dd6f-46bb-9d23-fa8724b78ace\") " pod="openstack-kuttl-tests/neutron-c8fc658f4-sqwl6" Mar 16 16:53:01 crc kubenswrapper[5120]: I0316 16:53:01.348385 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w7tbt\" (UniqueName: \"kubernetes.io/projected/e5acac7f-9646-4be1-ac22-31326296e4de-kube-api-access-w7tbt\") pod \"neutron-7555689c4b-84shq\" (UID: \"e5acac7f-9646-4be1-ac22-31326296e4de\") " pod="openstack-kuttl-tests/neutron-7555689c4b-84shq" Mar 16 16:53:01 crc kubenswrapper[5120]: I0316 16:53:01.348525 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hrxh\" (UniqueName: \"kubernetes.io/projected/34e6ded3-dd6f-46bb-9d23-fa8724b78ace-kube-api-access-2hrxh\") pod \"neutron-c8fc658f4-sqwl6\" (UID: \"34e6ded3-dd6f-46bb-9d23-fa8724b78ace\") " pod="openstack-kuttl-tests/neutron-c8fc658f4-sqwl6" Mar 16 16:53:01 crc kubenswrapper[5120]: I0316 16:53:01.348625 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/34e6ded3-dd6f-46bb-9d23-fa8724b78ace-config\") pod \"neutron-c8fc658f4-sqwl6\" (UID: \"34e6ded3-dd6f-46bb-9d23-fa8724b78ace\") " pod="openstack-kuttl-tests/neutron-c8fc658f4-sqwl6" Mar 16 16:53:01 crc kubenswrapper[5120]: I0316 16:53:01.348656 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e5acac7f-9646-4be1-ac22-31326296e4de-internal-tls-certs\") pod \"neutron-7555689c4b-84shq\" (UID: \"e5acac7f-9646-4be1-ac22-31326296e4de\") " pod="openstack-kuttl-tests/neutron-7555689c4b-84shq" Mar 16 16:53:01 crc kubenswrapper[5120]: I0316 16:53:01.348776 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/34e6ded3-dd6f-46bb-9d23-fa8724b78ace-ovndb-tls-certs\") pod \"neutron-c8fc658f4-sqwl6\" (UID: \"34e6ded3-dd6f-46bb-9d23-fa8724b78ace\") " pod="openstack-kuttl-tests/neutron-c8fc658f4-sqwl6" Mar 16 16:53:01 crc kubenswrapper[5120]: I0316 16:53:01.348867 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e5acac7f-9646-4be1-ac22-31326296e4de-public-tls-certs\") pod \"neutron-7555689c4b-84shq\" (UID: \"e5acac7f-9646-4be1-ac22-31326296e4de\") " pod="openstack-kuttl-tests/neutron-7555689c4b-84shq" Mar 16 16:53:01 crc kubenswrapper[5120]: I0316 16:53:01.348906 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e5acac7f-9646-4be1-ac22-31326296e4de-config\") pod \"neutron-7555689c4b-84shq\" (UID: \"e5acac7f-9646-4be1-ac22-31326296e4de\") " pod="openstack-kuttl-tests/neutron-7555689c4b-84shq" Mar 16 16:53:01 crc kubenswrapper[5120]: I0316 16:53:01.362685 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/e5acac7f-9646-4be1-ac22-31326296e4de-httpd-config\") pod \"neutron-7555689c4b-84shq\" (UID: \"e5acac7f-9646-4be1-ac22-31326296e4de\") " pod="openstack-kuttl-tests/neutron-7555689c4b-84shq" Mar 16 16:53:01 crc kubenswrapper[5120]: I0316 16:53:01.364133 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/e5acac7f-9646-4be1-ac22-31326296e4de-ovndb-tls-certs\") pod \"neutron-7555689c4b-84shq\" (UID: \"e5acac7f-9646-4be1-ac22-31326296e4de\") " pod="openstack-kuttl-tests/neutron-7555689c4b-84shq" Mar 16 16:53:01 crc kubenswrapper[5120]: I0316 16:53:01.374068 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/e5acac7f-9646-4be1-ac22-31326296e4de-config\") pod \"neutron-7555689c4b-84shq\" (UID: \"e5acac7f-9646-4be1-ac22-31326296e4de\") " pod="openstack-kuttl-tests/neutron-7555689c4b-84shq" Mar 16 16:53:01 crc kubenswrapper[5120]: I0316 16:53:01.392776 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e5acac7f-9646-4be1-ac22-31326296e4de-internal-tls-certs\") pod \"neutron-7555689c4b-84shq\" (UID: \"e5acac7f-9646-4be1-ac22-31326296e4de\") " pod="openstack-kuttl-tests/neutron-7555689c4b-84shq" Mar 16 16:53:01 crc kubenswrapper[5120]: I0316 16:53:01.394622 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e5acac7f-9646-4be1-ac22-31326296e4de-public-tls-certs\") pod \"neutron-7555689c4b-84shq\" (UID: \"e5acac7f-9646-4be1-ac22-31326296e4de\") " pod="openstack-kuttl-tests/neutron-7555689c4b-84shq" Mar 16 16:53:01 crc kubenswrapper[5120]: I0316 16:53:01.394818 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e5acac7f-9646-4be1-ac22-31326296e4de-combined-ca-bundle\") pod \"neutron-7555689c4b-84shq\" (UID: \"e5acac7f-9646-4be1-ac22-31326296e4de\") " pod="openstack-kuttl-tests/neutron-7555689c4b-84shq" Mar 16 16:53:01 crc kubenswrapper[5120]: I0316 16:53:01.417629 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7tbt\" (UniqueName: \"kubernetes.io/projected/e5acac7f-9646-4be1-ac22-31326296e4de-kube-api-access-w7tbt\") pod \"neutron-7555689c4b-84shq\" (UID: \"e5acac7f-9646-4be1-ac22-31326296e4de\") " pod="openstack-kuttl-tests/neutron-7555689c4b-84shq" Mar 16 16:53:01 crc kubenswrapper[5120]: I0316 16:53:01.455589 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/34e6ded3-dd6f-46bb-9d23-fa8724b78ace-internal-tls-certs\") pod \"neutron-c8fc658f4-sqwl6\" (UID: \"34e6ded3-dd6f-46bb-9d23-fa8724b78ace\") " pod="openstack-kuttl-tests/neutron-c8fc658f4-sqwl6" Mar 16 16:53:01 crc kubenswrapper[5120]: I0316 16:53:01.455744 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2hrxh\" (UniqueName: \"kubernetes.io/projected/34e6ded3-dd6f-46bb-9d23-fa8724b78ace-kube-api-access-2hrxh\") pod \"neutron-c8fc658f4-sqwl6\" (UID: \"34e6ded3-dd6f-46bb-9d23-fa8724b78ace\") " pod="openstack-kuttl-tests/neutron-c8fc658f4-sqwl6" Mar 16 16:53:01 crc kubenswrapper[5120]: I0316 16:53:01.455816 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/34e6ded3-dd6f-46bb-9d23-fa8724b78ace-config\") pod \"neutron-c8fc658f4-sqwl6\" (UID: \"34e6ded3-dd6f-46bb-9d23-fa8724b78ace\") " pod="openstack-kuttl-tests/neutron-c8fc658f4-sqwl6" Mar 16 16:53:01 crc kubenswrapper[5120]: I0316 16:53:01.455875 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/34e6ded3-dd6f-46bb-9d23-fa8724b78ace-ovndb-tls-certs\") pod \"neutron-c8fc658f4-sqwl6\" (UID: \"34e6ded3-dd6f-46bb-9d23-fa8724b78ace\") " pod="openstack-kuttl-tests/neutron-c8fc658f4-sqwl6" Mar 16 16:53:01 crc kubenswrapper[5120]: I0316 16:53:01.455991 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/34e6ded3-dd6f-46bb-9d23-fa8724b78ace-combined-ca-bundle\") pod \"neutron-c8fc658f4-sqwl6\" (UID: \"34e6ded3-dd6f-46bb-9d23-fa8724b78ace\") " pod="openstack-kuttl-tests/neutron-c8fc658f4-sqwl6" Mar 16 16:53:01 crc kubenswrapper[5120]: I0316 16:53:01.456153 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/34e6ded3-dd6f-46bb-9d23-fa8724b78ace-httpd-config\") pod \"neutron-c8fc658f4-sqwl6\" (UID: \"34e6ded3-dd6f-46bb-9d23-fa8724b78ace\") " pod="openstack-kuttl-tests/neutron-c8fc658f4-sqwl6" Mar 16 16:53:01 crc kubenswrapper[5120]: I0316 16:53:01.456170 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/34e6ded3-dd6f-46bb-9d23-fa8724b78ace-public-tls-certs\") pod \"neutron-c8fc658f4-sqwl6\" (UID: \"34e6ded3-dd6f-46bb-9d23-fa8724b78ace\") " pod="openstack-kuttl-tests/neutron-c8fc658f4-sqwl6" Mar 16 16:53:01 crc kubenswrapper[5120]: I0316 16:53:01.480604 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-6d764c69b8-sv9d2"] Mar 16 16:53:01 crc kubenswrapper[5120]: I0316 16:53:01.516515 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/34e6ded3-dd6f-46bb-9d23-fa8724b78ace-internal-tls-certs\") pod \"neutron-c8fc658f4-sqwl6\" (UID: \"34e6ded3-dd6f-46bb-9d23-fa8724b78ace\") " pod="openstack-kuttl-tests/neutron-c8fc658f4-sqwl6" Mar 16 16:53:01 crc kubenswrapper[5120]: I0316 16:53:01.518290 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:53:01 crc kubenswrapper[5120]: I0316 16:53:01.526453 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/34e6ded3-dd6f-46bb-9d23-fa8724b78ace-ovndb-tls-certs\") pod \"neutron-c8fc658f4-sqwl6\" (UID: \"34e6ded3-dd6f-46bb-9d23-fa8724b78ace\") " pod="openstack-kuttl-tests/neutron-c8fc658f4-sqwl6" Mar 16 16:53:01 crc kubenswrapper[5120]: I0316 16:53:01.532655 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/34e6ded3-dd6f-46bb-9d23-fa8724b78ace-combined-ca-bundle\") pod \"neutron-c8fc658f4-sqwl6\" (UID: \"34e6ded3-dd6f-46bb-9d23-fa8724b78ace\") " pod="openstack-kuttl-tests/neutron-c8fc658f4-sqwl6" Mar 16 16:53:01 crc kubenswrapper[5120]: I0316 16:53:01.538073 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/34e6ded3-dd6f-46bb-9d23-fa8724b78ace-httpd-config\") pod \"neutron-c8fc658f4-sqwl6\" (UID: \"34e6ded3-dd6f-46bb-9d23-fa8724b78ace\") " pod="openstack-kuttl-tests/neutron-c8fc658f4-sqwl6" Mar 16 16:53:01 crc kubenswrapper[5120]: I0316 16:53:01.545522 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hrxh\" (UniqueName: \"kubernetes.io/projected/34e6ded3-dd6f-46bb-9d23-fa8724b78ace-kube-api-access-2hrxh\") pod \"neutron-c8fc658f4-sqwl6\" (UID: \"34e6ded3-dd6f-46bb-9d23-fa8724b78ace\") " pod="openstack-kuttl-tests/neutron-c8fc658f4-sqwl6" Mar 16 16:53:01 crc kubenswrapper[5120]: I0316 16:53:01.546228 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/34e6ded3-dd6f-46bb-9d23-fa8724b78ace-config\") pod \"neutron-c8fc658f4-sqwl6\" (UID: \"34e6ded3-dd6f-46bb-9d23-fa8724b78ace\") " pod="openstack-kuttl-tests/neutron-c8fc658f4-sqwl6" Mar 16 16:53:01 crc kubenswrapper[5120]: I0316 16:53:01.563447 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/34e6ded3-dd6f-46bb-9d23-fa8724b78ace-public-tls-certs\") pod \"neutron-c8fc658f4-sqwl6\" (UID: \"34e6ded3-dd6f-46bb-9d23-fa8724b78ace\") " pod="openstack-kuttl-tests/neutron-c8fc658f4-sqwl6" Mar 16 16:53:01 crc kubenswrapper[5120]: I0316 16:53:01.737320 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"b91a9930-eec4-4af5-9aee-5d02dc78fabc","Type":"ContainerStarted","Data":"9447a2fb9a0e4308274aa0d296a7cfd1a4423ed65d9e7c646f286f31ab7bd69e"} Mar 16 16:53:01 crc kubenswrapper[5120]: I0316 16:53:01.755829 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-c8fc658f4-sqwl6"] Mar 16 16:53:01 crc kubenswrapper[5120]: I0316 16:53:01.779818 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-f56965744-skhtb"] Mar 16 16:53:01 crc kubenswrapper[5120]: I0316 16:53:01.810420 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-scheduler-0" podStartSLOduration=12.810401148 podStartE2EDuration="12.810401148s" podCreationTimestamp="2026-03-16 16:52:49 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:53:01.808695171 +0000 UTC m=+4883.962626838" watchObservedRunningTime="2026-03-16 16:53:01.810401148 +0000 UTC m=+4883.964332805" Mar 16 16:53:01 crc kubenswrapper[5120]: I0316 16:53:01.811680 5120 generic.go:358] "Generic (PLEG): container finished" podID="18e2f22a-0bc1-4514-afe4-56bdf5cb1670" containerID="c93e64b15c166ba718c199a2500ca4e4c998e0677346f6d61e58dc0ac5de1dbf" exitCode=0 Mar 16 16:53:01 crc kubenswrapper[5120]: I0316 16:53:01.818403 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18e2f22a-0bc1-4514-afe4-56bdf5cb1670-nova-novncproxy-tls-certs" (OuterVolumeSpecName: "nova-novncproxy-tls-certs") pod "18e2f22a-0bc1-4514-afe4-56bdf5cb1670" (UID: "18e2f22a-0bc1-4514-afe4-56bdf5cb1670"). InnerVolumeSpecName "nova-novncproxy-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:01 crc kubenswrapper[5120]: I0316 16:53:01.827946 5120 generic.go:358] "Generic (PLEG): container finished" podID="e5c498e5-584c-4cdd-b008-c643b7bb1bc5" containerID="1dbf24b95c7a96d399be4139efd5db0f1cb6a5b7e36d9f234f65251fcfc81330" exitCode=0 Mar 16 16:53:01 crc kubenswrapper[5120]: I0316 16:53:01.835625 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"18e2f22a-0bc1-4514-afe4-56bdf5cb1670","Type":"ContainerDied","Data":"c93e64b15c166ba718c199a2500ca4e4c998e0677346f6d61e58dc0ac5de1dbf"} Mar 16 16:53:01 crc kubenswrapper[5120]: I0316 16:53:01.835672 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"18e2f22a-0bc1-4514-afe4-56bdf5cb1670","Type":"ContainerDied","Data":"253b897b6cc39c0bdd916b41b82832e5e380542fd49c4ed5fb4c019329d88f75"} Mar 16 16:53:01 crc kubenswrapper[5120]: I0316 16:53:01.835687 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-f56965744-skhtb"] Mar 16 16:53:01 crc kubenswrapper[5120]: I0316 16:53:01.835704 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"6792b2c6-f5cf-454a-858a-cbd4159db76a","Type":"ContainerStarted","Data":"6f037be1f8ac8aa6c914216a50a04df7a7b8faf86a594c9b73057837652528f1"} Mar 16 16:53:01 crc kubenswrapper[5120]: I0316 16:53:01.835718 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"607fee19-adac-44b4-9f70-a6f6f3e59aed","Type":"ContainerStarted","Data":"3e4d1b60e2bb40708ca0eb86088645db7b9870e10296a1eff67cb5ce00260ed7"} Mar 16 16:53:01 crc kubenswrapper[5120]: I0316 16:53:01.835731 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"e5c498e5-584c-4cdd-b008-c643b7bb1bc5","Type":"ContainerDied","Data":"1dbf24b95c7a96d399be4139efd5db0f1cb6a5b7e36d9f234f65251fcfc81330"} Mar 16 16:53:01 crc kubenswrapper[5120]: I0316 16:53:01.836032 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:53:01 crc kubenswrapper[5120]: I0316 16:53:01.836313 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-f56965744-skhtb" Mar 16 16:53:01 crc kubenswrapper[5120]: I0316 16:53:01.836926 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-576c5b55d6-5zsh7" event={"ID":"fb4496e5-279b-4520-a345-c4ed00ede8c9","Type":"ContainerDied","Data":"23578f5116e14f4d9f5a46397b186adf8fa1ad65b95d3433e3dc931c3d9d7a17"} Mar 16 16:53:01 crc kubenswrapper[5120]: I0316 16:53:01.837022 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-576c5b55d6-5zsh7" Mar 16 16:53:01 crc kubenswrapper[5120]: I0316 16:53:01.849933 5120 reconciler_common.go:299] "Volume detached for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/18e2f22a-0bc1-4514-afe4-56bdf5cb1670-nova-novncproxy-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:01 crc kubenswrapper[5120]: I0316 16:53:01.855249 5120 generic.go:358] "Generic (PLEG): container finished" podID="ebceb235-ad03-49fd-9921-f5be8c1851be" containerID="6dbf15fc5cb9e1dfb9f424295383c4a6610b03bef67f06b2717ffa77e0acef49" exitCode=0 Mar 16 16:53:01 crc kubenswrapper[5120]: I0316 16:53:01.855440 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-d7c95f898-g5nln" event={"ID":"ebceb235-ad03-49fd-9921-f5be8c1851be","Type":"ContainerDied","Data":"6dbf15fc5cb9e1dfb9f424295383c4a6610b03bef67f06b2717ffa77e0acef49"} Mar 16 16:53:01 crc kubenswrapper[5120]: I0316 16:53:01.862268 5120 generic.go:358] "Generic (PLEG): container finished" podID="a3cdc115-5535-44fd-94b4-6256145dea7e" containerID="b34391ed51e1fef10fa960dbb4dc7aa97f95bec5ecc3a8f7a2c49da0363fdd4d" exitCode=0 Mar 16 16:53:01 crc kubenswrapper[5120]: I0316 16:53:01.862392 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"a3cdc115-5535-44fd-94b4-6256145dea7e","Type":"ContainerDied","Data":"b34391ed51e1fef10fa960dbb4dc7aa97f95bec5ecc3a8f7a2c49da0363fdd4d"} Mar 16 16:53:01 crc kubenswrapper[5120]: I0316 16:53:01.881260 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"61483cf5-d3db-49de-afa4-66f0efecdd70","Type":"ContainerStarted","Data":"9dea7e07ec457522ac530558fa96a46af205c7f4f10ffce3f455074081c4bf97"} Mar 16 16:53:01 crc kubenswrapper[5120]: I0316 16:53:01.884265 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-7555689c4b-84shq" Mar 16 16:53:01 crc kubenswrapper[5120]: I0316 16:53:01.889295 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="26d7e714-e270-4150-9fc2-65e289bbd688" containerName="nova-cell0-conductor-conductor" containerID="cri-o://39ef33895c134d0ed936fb426895f0c7eb3288074422326f288eccff008d3774" gracePeriod=30 Mar 16 16:53:01 crc kubenswrapper[5120]: I0316 16:53:01.889940 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="77e38408-57df-40be-95a1-64f61218c305" containerName="nova-metadata-log" containerID="cri-o://07e36a960b4b0ff2c9a896db3032845779d0abb4605e926b1b1d6baa4a53ba03" gracePeriod=30 Mar 16 16:53:01 crc kubenswrapper[5120]: I0316 16:53:01.890009 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"77e38408-57df-40be-95a1-64f61218c305","Type":"ContainerStarted","Data":"cf6722e84e6785147486fa7c4a8c54e8644b345caa23fda210801539c7018124"} Mar 16 16:53:01 crc kubenswrapper[5120]: I0316 16:53:01.890100 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="77e38408-57df-40be-95a1-64f61218c305" containerName="nova-metadata-metadata" containerID="cri-o://cf6722e84e6785147486fa7c4a8c54e8644b345caa23fda210801539c7018124" gracePeriod=30 Mar 16 16:53:01 crc kubenswrapper[5120]: I0316 16:53:01.899463 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-c8fc658f4-sqwl6" Mar 16 16:53:01 crc kubenswrapper[5120]: I0316 16:53:01.907081 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18e2f22a-0bc1-4514-afe4-56bdf5cb1670-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "18e2f22a-0bc1-4514-afe4-56bdf5cb1670" (UID: "18e2f22a-0bc1-4514-afe4-56bdf5cb1670"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:01 crc kubenswrapper[5120]: I0316 16:53:01.935977 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Mar 16 16:53:01 crc kubenswrapper[5120]: I0316 16:53:01.952637 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nlbdb\" (UniqueName: \"kubernetes.io/projected/4907839f-9071-4378-90f6-f92ced0b0bf0-kube-api-access-nlbdb\") pod \"neutron-f56965744-skhtb\" (UID: \"4907839f-9071-4378-90f6-f92ced0b0bf0\") " pod="openstack-kuttl-tests/neutron-f56965744-skhtb" Mar 16 16:53:01 crc kubenswrapper[5120]: I0316 16:53:01.952691 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4907839f-9071-4378-90f6-f92ced0b0bf0-combined-ca-bundle\") pod \"neutron-f56965744-skhtb\" (UID: \"4907839f-9071-4378-90f6-f92ced0b0bf0\") " pod="openstack-kuttl-tests/neutron-f56965744-skhtb" Mar 16 16:53:01 crc kubenswrapper[5120]: I0316 16:53:01.953012 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/4907839f-9071-4378-90f6-f92ced0b0bf0-ovndb-tls-certs\") pod \"neutron-f56965744-skhtb\" (UID: \"4907839f-9071-4378-90f6-f92ced0b0bf0\") " pod="openstack-kuttl-tests/neutron-f56965744-skhtb" Mar 16 16:53:01 crc kubenswrapper[5120]: I0316 16:53:01.953102 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/4907839f-9071-4378-90f6-f92ced0b0bf0-public-tls-certs\") pod \"neutron-f56965744-skhtb\" (UID: \"4907839f-9071-4378-90f6-f92ced0b0bf0\") " pod="openstack-kuttl-tests/neutron-f56965744-skhtb" Mar 16 16:53:01 crc kubenswrapper[5120]: I0316 16:53:01.953203 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/4907839f-9071-4378-90f6-f92ced0b0bf0-internal-tls-certs\") pod \"neutron-f56965744-skhtb\" (UID: \"4907839f-9071-4378-90f6-f92ced0b0bf0\") " pod="openstack-kuttl-tests/neutron-f56965744-skhtb" Mar 16 16:53:01 crc kubenswrapper[5120]: I0316 16:53:01.953245 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/4907839f-9071-4378-90f6-f92ced0b0bf0-httpd-config\") pod \"neutron-f56965744-skhtb\" (UID: \"4907839f-9071-4378-90f6-f92ced0b0bf0\") " pod="openstack-kuttl-tests/neutron-f56965744-skhtb" Mar 16 16:53:01 crc kubenswrapper[5120]: I0316 16:53:01.953313 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4907839f-9071-4378-90f6-f92ced0b0bf0-config\") pod \"neutron-f56965744-skhtb\" (UID: \"4907839f-9071-4378-90f6-f92ced0b0bf0\") " pod="openstack-kuttl-tests/neutron-f56965744-skhtb" Mar 16 16:53:01 crc kubenswrapper[5120]: I0316 16:53:01.953379 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/18e2f22a-0bc1-4514-afe4-56bdf5cb1670-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:01 crc kubenswrapper[5120]: I0316 16:53:01.991512 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18e2f22a-0bc1-4514-afe4-56bdf5cb1670-config-data" (OuterVolumeSpecName: "config-data") pod "18e2f22a-0bc1-4514-afe4-56bdf5cb1670" (UID: "18e2f22a-0bc1-4514-afe4-56bdf5cb1670"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:01 crc kubenswrapper[5120]: I0316 16:53:01.991662 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18e2f22a-0bc1-4514-afe4-56bdf5cb1670-vencrypt-tls-certs" (OuterVolumeSpecName: "vencrypt-tls-certs") pod "18e2f22a-0bc1-4514-afe4-56bdf5cb1670" (UID: "18e2f22a-0bc1-4514-afe4-56bdf5cb1670"). InnerVolumeSpecName "vencrypt-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:02 crc kubenswrapper[5120]: I0316 16:53:02.018454 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-576c5b55d6-5zsh7"] Mar 16 16:53:02 crc kubenswrapper[5120]: I0316 16:53:02.027684 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-576c5b55d6-5zsh7"] Mar 16 16:53:02 crc kubenswrapper[5120]: I0316 16:53:02.039456 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=11.039409026 podStartE2EDuration="11.039409026s" podCreationTimestamp="2026-03-16 16:52:51 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:53:01.967199879 +0000 UTC m=+4884.121131536" watchObservedRunningTime="2026-03-16 16:53:02.039409026 +0000 UTC m=+4884.193340683" Mar 16 16:53:02 crc kubenswrapper[5120]: I0316 16:53:02.088885 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/a3cdc115-5535-44fd-94b4-6256145dea7e-kolla-config\") pod \"a3cdc115-5535-44fd-94b4-6256145dea7e\" (UID: \"a3cdc115-5535-44fd-94b4-6256145dea7e\") " Mar 16 16:53:02 crc kubenswrapper[5120]: I0316 16:53:02.089247 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a3cdc115-5535-44fd-94b4-6256145dea7e-combined-ca-bundle\") pod \"a3cdc115-5535-44fd-94b4-6256145dea7e\" (UID: \"a3cdc115-5535-44fd-94b4-6256145dea7e\") " Mar 16 16:53:02 crc kubenswrapper[5120]: I0316 16:53:02.090435 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a3cdc115-5535-44fd-94b4-6256145dea7e-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "a3cdc115-5535-44fd-94b4-6256145dea7e" (UID: "a3cdc115-5535-44fd-94b4-6256145dea7e"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:53:02 crc kubenswrapper[5120]: I0316 16:53:02.095352 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/a3cdc115-5535-44fd-94b4-6256145dea7e-memcached-tls-certs\") pod \"a3cdc115-5535-44fd-94b4-6256145dea7e\" (UID: \"a3cdc115-5535-44fd-94b4-6256145dea7e\") " Mar 16 16:53:02 crc kubenswrapper[5120]: I0316 16:53:02.095539 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/a3cdc115-5535-44fd-94b4-6256145dea7e-config-data\") pod \"a3cdc115-5535-44fd-94b4-6256145dea7e\" (UID: \"a3cdc115-5535-44fd-94b4-6256145dea7e\") " Mar 16 16:53:02 crc kubenswrapper[5120]: I0316 16:53:02.095648 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kwd67\" (UniqueName: \"kubernetes.io/projected/a3cdc115-5535-44fd-94b4-6256145dea7e-kube-api-access-kwd67\") pod \"a3cdc115-5535-44fd-94b4-6256145dea7e\" (UID: \"a3cdc115-5535-44fd-94b4-6256145dea7e\") " Mar 16 16:53:02 crc kubenswrapper[5120]: I0316 16:53:02.096188 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/4907839f-9071-4378-90f6-f92ced0b0bf0-ovndb-tls-certs\") pod \"neutron-f56965744-skhtb\" (UID: \"4907839f-9071-4378-90f6-f92ced0b0bf0\") " pod="openstack-kuttl-tests/neutron-f56965744-skhtb" Mar 16 16:53:02 crc kubenswrapper[5120]: I0316 16:53:02.101533 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/4907839f-9071-4378-90f6-f92ced0b0bf0-public-tls-certs\") pod \"neutron-f56965744-skhtb\" (UID: \"4907839f-9071-4378-90f6-f92ced0b0bf0\") " pod="openstack-kuttl-tests/neutron-f56965744-skhtb" Mar 16 16:53:02 crc kubenswrapper[5120]: I0316 16:53:02.101861 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/4907839f-9071-4378-90f6-f92ced0b0bf0-internal-tls-certs\") pod \"neutron-f56965744-skhtb\" (UID: \"4907839f-9071-4378-90f6-f92ced0b0bf0\") " pod="openstack-kuttl-tests/neutron-f56965744-skhtb" Mar 16 16:53:02 crc kubenswrapper[5120]: I0316 16:53:02.101980 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/4907839f-9071-4378-90f6-f92ced0b0bf0-httpd-config\") pod \"neutron-f56965744-skhtb\" (UID: \"4907839f-9071-4378-90f6-f92ced0b0bf0\") " pod="openstack-kuttl-tests/neutron-f56965744-skhtb" Mar 16 16:53:02 crc kubenswrapper[5120]: I0316 16:53:02.102101 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4907839f-9071-4378-90f6-f92ced0b0bf0-config\") pod \"neutron-f56965744-skhtb\" (UID: \"4907839f-9071-4378-90f6-f92ced0b0bf0\") " pod="openstack-kuttl-tests/neutron-f56965744-skhtb" Mar 16 16:53:02 crc kubenswrapper[5120]: I0316 16:53:02.102363 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nlbdb\" (UniqueName: \"kubernetes.io/projected/4907839f-9071-4378-90f6-f92ced0b0bf0-kube-api-access-nlbdb\") pod \"neutron-f56965744-skhtb\" (UID: \"4907839f-9071-4378-90f6-f92ced0b0bf0\") " pod="openstack-kuttl-tests/neutron-f56965744-skhtb" Mar 16 16:53:02 crc kubenswrapper[5120]: I0316 16:53:02.109114 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4907839f-9071-4378-90f6-f92ced0b0bf0-combined-ca-bundle\") pod \"neutron-f56965744-skhtb\" (UID: \"4907839f-9071-4378-90f6-f92ced0b0bf0\") " pod="openstack-kuttl-tests/neutron-f56965744-skhtb" Mar 16 16:53:02 crc kubenswrapper[5120]: I0316 16:53:02.109691 5120 reconciler_common.go:299] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/a3cdc115-5535-44fd-94b4-6256145dea7e-kolla-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:02 crc kubenswrapper[5120]: I0316 16:53:02.111955 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/18e2f22a-0bc1-4514-afe4-56bdf5cb1670-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:02 crc kubenswrapper[5120]: I0316 16:53:02.112068 5120 reconciler_common.go:299] "Volume detached for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/18e2f22a-0bc1-4514-afe4-56bdf5cb1670-vencrypt-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:02 crc kubenswrapper[5120]: I0316 16:53:02.098408 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a3cdc115-5535-44fd-94b4-6256145dea7e-config-data" (OuterVolumeSpecName: "config-data") pod "a3cdc115-5535-44fd-94b4-6256145dea7e" (UID: "a3cdc115-5535-44fd-94b4-6256145dea7e"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:53:02 crc kubenswrapper[5120]: I0316 16:53:02.155854 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3cdc115-5535-44fd-94b4-6256145dea7e-kube-api-access-kwd67" (OuterVolumeSpecName: "kube-api-access-kwd67") pod "a3cdc115-5535-44fd-94b4-6256145dea7e" (UID: "a3cdc115-5535-44fd-94b4-6256145dea7e"). InnerVolumeSpecName "kube-api-access-kwd67". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:53:02 crc kubenswrapper[5120]: I0316 16:53:02.176929 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4907839f-9071-4378-90f6-f92ced0b0bf0-combined-ca-bundle\") pod \"neutron-f56965744-skhtb\" (UID: \"4907839f-9071-4378-90f6-f92ced0b0bf0\") " pod="openstack-kuttl-tests/neutron-f56965744-skhtb" Mar 16 16:53:02 crc kubenswrapper[5120]: I0316 16:53:02.186985 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/4907839f-9071-4378-90f6-f92ced0b0bf0-internal-tls-certs\") pod \"neutron-f56965744-skhtb\" (UID: \"4907839f-9071-4378-90f6-f92ced0b0bf0\") " pod="openstack-kuttl-tests/neutron-f56965744-skhtb" Mar 16 16:53:02 crc kubenswrapper[5120]: I0316 16:53:02.187351 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/4907839f-9071-4378-90f6-f92ced0b0bf0-config\") pod \"neutron-f56965744-skhtb\" (UID: \"4907839f-9071-4378-90f6-f92ced0b0bf0\") " pod="openstack-kuttl-tests/neutron-f56965744-skhtb" Mar 16 16:53:02 crc kubenswrapper[5120]: I0316 16:53:02.189498 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/4907839f-9071-4378-90f6-f92ced0b0bf0-httpd-config\") pod \"neutron-f56965744-skhtb\" (UID: \"4907839f-9071-4378-90f6-f92ced0b0bf0\") " pod="openstack-kuttl-tests/neutron-f56965744-skhtb" Mar 16 16:53:02 crc kubenswrapper[5120]: I0316 16:53:02.190840 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/4907839f-9071-4378-90f6-f92ced0b0bf0-public-tls-certs\") pod \"neutron-f56965744-skhtb\" (UID: \"4907839f-9071-4378-90f6-f92ced0b0bf0\") " pod="openstack-kuttl-tests/neutron-f56965744-skhtb" Mar 16 16:53:02 crc kubenswrapper[5120]: I0316 16:53:02.203398 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nlbdb\" (UniqueName: \"kubernetes.io/projected/4907839f-9071-4378-90f6-f92ced0b0bf0-kube-api-access-nlbdb\") pod \"neutron-f56965744-skhtb\" (UID: \"4907839f-9071-4378-90f6-f92ced0b0bf0\") " pod="openstack-kuttl-tests/neutron-f56965744-skhtb" Mar 16 16:53:02 crc kubenswrapper[5120]: I0316 16:53:02.204418 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/4907839f-9071-4378-90f6-f92ced0b0bf0-ovndb-tls-certs\") pod \"neutron-f56965744-skhtb\" (UID: \"4907839f-9071-4378-90f6-f92ced0b0bf0\") " pod="openstack-kuttl-tests/neutron-f56965744-skhtb" Mar 16 16:53:02 crc kubenswrapper[5120]: I0316 16:53:02.221771 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-7bf49bf568-fbg2k" podUID="c846d2b2-0638-44bd-9ad0-6b6c76f8d16f" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.0.123:9311/healthcheck\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 16:53:02 crc kubenswrapper[5120]: I0316 16:53:02.222658 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-7bf49bf568-fbg2k" podUID="c846d2b2-0638-44bd-9ad0-6b6c76f8d16f" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.0.123:9311/healthcheck\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Mar 16 16:53:02 crc kubenswrapper[5120]: I0316 16:53:02.226630 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/a3cdc115-5535-44fd-94b4-6256145dea7e-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:02 crc kubenswrapper[5120]: I0316 16:53:02.226670 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kwd67\" (UniqueName: \"kubernetes.io/projected/a3cdc115-5535-44fd-94b4-6256145dea7e-kube-api-access-kwd67\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:02 crc kubenswrapper[5120]: I0316 16:53:02.284375 5120 scope.go:117] "RemoveContainer" containerID="214b9b807141dffba529059147015a1dff4f121e2338cd1014806da26ec56f8f" Mar 16 16:53:02 crc kubenswrapper[5120]: I0316 16:53:02.285105 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-f56965744-skhtb" Mar 16 16:53:02 crc kubenswrapper[5120]: I0316 16:53:02.547021 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a3cdc115-5535-44fd-94b4-6256145dea7e-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "a3cdc115-5535-44fd-94b4-6256145dea7e" (UID: "a3cdc115-5535-44fd-94b4-6256145dea7e"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:02 crc kubenswrapper[5120]: I0316 16:53:02.578080 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:53:02 crc kubenswrapper[5120]: I0316 16:53:02.579388 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="b91a9930-eec4-4af5-9aee-5d02dc78fabc" containerName="cinder-scheduler" probeResult="failure" output="Get \"http://10.217.0.137:8080/\": dial tcp 10.217.0.137:8080: connect: connection refused" Mar 16 16:53:02 crc kubenswrapper[5120]: I0316 16:53:02.679161 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a3cdc115-5535-44fd-94b4-6256145dea7e-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:02 crc kubenswrapper[5120]: I0316 16:53:02.724585 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fb4496e5-279b-4520-a345-c4ed00ede8c9" path="/var/lib/kubelet/pods/fb4496e5-279b-4520-a345-c4ed00ede8c9/volumes" Mar 16 16:53:02 crc kubenswrapper[5120]: I0316 16:53:02.861867 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openstack-kuttl-tests/barbican-api-7f78b864cb-6dgjh" podUID="c06f24f9-95b0-4a92-ad3a-6075764151ed" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.0.133:9311/healthcheck\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 16:53:02 crc kubenswrapper[5120]: I0316 16:53:02.989701 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-84f95d87c8-s7s4d"] Mar 16 16:53:02 crc kubenswrapper[5120]: I0316 16:53:02.995980 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a3cdc115-5535-44fd-94b4-6256145dea7e-memcached-tls-certs" (OuterVolumeSpecName: "memcached-tls-certs") pod "a3cdc115-5535-44fd-94b4-6256145dea7e" (UID: "a3cdc115-5535-44fd-94b4-6256145dea7e"). InnerVolumeSpecName "memcached-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:03 crc kubenswrapper[5120]: I0316 16:53:03.065708 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 16:53:03 crc kubenswrapper[5120]: I0316 16:53:03.095076 5120 reconciler_common.go:299] "Volume detached for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/a3cdc115-5535-44fd-94b4-6256145dea7e-memcached-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:03 crc kubenswrapper[5120]: I0316 16:53:03.154215 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-7f77bff94b-c5ng2" event={"ID":"67c7567e-232d-4853-961c-dcc1799c7dae","Type":"ContainerStarted","Data":"ca50e37e23a978feca05ae4a826e2b04ffb0b3d92fd61ca5f40ef219779adaee"} Mar 16 16:53:03 crc kubenswrapper[5120]: I0316 16:53:03.154950 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-7f77bff94b-c5ng2" Mar 16 16:53:03 crc kubenswrapper[5120]: I0316 16:53:03.155088 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-7f77bff94b-c5ng2" Mar 16 16:53:03 crc kubenswrapper[5120]: I0316 16:53:03.157286 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:53:03 crc kubenswrapper[5120]: I0316 16:53:03.242795 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:53:03 crc kubenswrapper[5120]: I0316 16:53:03.255058 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"a3cdc115-5535-44fd-94b4-6256145dea7e","Type":"ContainerDied","Data":"5fa94af7a48c95fb7b0d554faba8682ad288e705924b742b901e1a3c65aac076"} Mar 16 16:53:03 crc kubenswrapper[5120]: I0316 16:53:03.255225 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Mar 16 16:53:03 crc kubenswrapper[5120]: I0316 16:53:03.311249 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"0fba253d-bef6-490a-8d34-6be75a260d03","Type":"ContainerStarted","Data":"ce0287d83103e9544ee024f8b7ebcd28fe5e9a66b2efe0735defa49ab4a63b75"} Mar 16 16:53:03 crc kubenswrapper[5120]: I0316 16:53:03.311605 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="0fba253d-bef6-490a-8d34-6be75a260d03" containerName="nova-api-log" containerID="cri-o://cf30bf858ee3854358c96c7f21db6e3d78dc11544569687a33f15adb8935dbe6" gracePeriod=30 Mar 16 16:53:03 crc kubenswrapper[5120]: I0316 16:53:03.311949 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="0fba253d-bef6-490a-8d34-6be75a260d03" containerName="nova-api-api" containerID="cri-o://ce0287d83103e9544ee024f8b7ebcd28fe5e9a66b2efe0735defa49ab4a63b75" gracePeriod=30 Mar 16 16:53:03 crc kubenswrapper[5120]: I0316 16:53:03.324732 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:53:03 crc kubenswrapper[5120]: I0316 16:53:03.326160 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3cdc115-5535-44fd-94b4-6256145dea7e" containerName="memcached" Mar 16 16:53:03 crc kubenswrapper[5120]: I0316 16:53:03.326272 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3cdc115-5535-44fd-94b4-6256145dea7e" containerName="memcached" Mar 16 16:53:03 crc kubenswrapper[5120]: I0316 16:53:03.326735 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="a3cdc115-5535-44fd-94b4-6256145dea7e" containerName="memcached" Mar 16 16:53:03 crc kubenswrapper[5120]: I0316 16:53:03.337170 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:53:03 crc kubenswrapper[5120]: I0316 16:53:03.342988 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-novncproxy-cell1-public-svc\"" Mar 16 16:53:03 crc kubenswrapper[5120]: I0316 16:53:03.343181 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-novncproxy-cell1-vencrypt\"" Mar 16 16:53:03 crc kubenswrapper[5120]: I0316 16:53:03.343219 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-novncproxy-config-data\"" Mar 16 16:53:03 crc kubenswrapper[5120]: I0316 16:53:03.346221 5120 generic.go:358] "Generic (PLEG): container finished" podID="77e38408-57df-40be-95a1-64f61218c305" containerID="cf6722e84e6785147486fa7c4a8c54e8644b345caa23fda210801539c7018124" exitCode=0 Mar 16 16:53:03 crc kubenswrapper[5120]: I0316 16:53:03.346406 5120 generic.go:358] "Generic (PLEG): container finished" podID="77e38408-57df-40be-95a1-64f61218c305" containerID="07e36a960b4b0ff2c9a896db3032845779d0abb4605e926b1b1d6baa4a53ba03" exitCode=143 Mar 16 16:53:03 crc kubenswrapper[5120]: I0316 16:53:03.348496 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"77e38408-57df-40be-95a1-64f61218c305","Type":"ContainerDied","Data":"cf6722e84e6785147486fa7c4a8c54e8644b345caa23fda210801539c7018124"} Mar 16 16:53:03 crc kubenswrapper[5120]: I0316 16:53:03.348670 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"77e38408-57df-40be-95a1-64f61218c305","Type":"ContainerDied","Data":"07e36a960b4b0ff2c9a896db3032845779d0abb4605e926b1b1d6baa4a53ba03"} Mar 16 16:53:03 crc kubenswrapper[5120]: I0316 16:53:03.384275 5120 generic.go:358] "Generic (PLEG): container finished" podID="0d9062d0-d8bb-4ab3-b2c5-33fa78833a65" containerID="c7b4c951eebbeecee6717053b294c87b2bb789c71cabb8788e9ebfe41d5a8b39" exitCode=0 Mar 16 16:53:03 crc kubenswrapper[5120]: I0316 16:53:03.384490 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"0d9062d0-d8bb-4ab3-b2c5-33fa78833a65","Type":"ContainerDied","Data":"c7b4c951eebbeecee6717053b294c87b2bb789c71cabb8788e9ebfe41d5a8b39"} Mar 16 16:53:03 crc kubenswrapper[5120]: I0316 16:53:03.412432 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:53:03 crc kubenswrapper[5120]: I0316 16:53:03.412485 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-6d764c69b8-sv9d2" event={"ID":"979d8a07-391d-483c-92d1-bb2d256edf99","Type":"ContainerStarted","Data":"71e8c5d1c05658340afa51a102ec0dab25f74c91c4253d1a1f1c2b12d31e015a"} Mar 16 16:53:03 crc kubenswrapper[5120]: I0316 16:53:03.416367 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/dda14ac9-f9b1-4927-a4a4-147c5435906c-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"dda14ac9-f9b1-4927-a4a4-147c5435906c\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:53:03 crc kubenswrapper[5120]: I0316 16:53:03.416441 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/dda14ac9-f9b1-4927-a4a4-147c5435906c-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"dda14ac9-f9b1-4927-a4a4-147c5435906c\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:53:03 crc kubenswrapper[5120]: I0316 16:53:03.416896 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dda14ac9-f9b1-4927-a4a4-147c5435906c-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"dda14ac9-f9b1-4927-a4a4-147c5435906c\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:53:03 crc kubenswrapper[5120]: I0316 16:53:03.417065 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dh6lz\" (UniqueName: \"kubernetes.io/projected/dda14ac9-f9b1-4927-a4a4-147c5435906c-kube-api-access-dh6lz\") pod \"nova-cell1-novncproxy-0\" (UID: \"dda14ac9-f9b1-4927-a4a4-147c5435906c\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:53:03 crc kubenswrapper[5120]: I0316 16:53:03.417170 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dda14ac9-f9b1-4927-a4a4-147c5435906c-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"dda14ac9-f9b1-4927-a4a4-147c5435906c\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:53:03 crc kubenswrapper[5120]: I0316 16:53:03.478934 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/certified-operators-9t866"] Mar 16 16:53:03 crc kubenswrapper[5120]: I0316 16:53:03.491546 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-9t866" Mar 16 16:53:03 crc kubenswrapper[5120]: I0316 16:53:03.497347 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/certified-operators-9t866"] Mar 16 16:53:03 crc kubenswrapper[5120]: I0316 16:53:03.525739 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dda14ac9-f9b1-4927-a4a4-147c5435906c-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"dda14ac9-f9b1-4927-a4a4-147c5435906c\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:53:03 crc kubenswrapper[5120]: I0316 16:53:03.526010 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/dda14ac9-f9b1-4927-a4a4-147c5435906c-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"dda14ac9-f9b1-4927-a4a4-147c5435906c\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:53:03 crc kubenswrapper[5120]: I0316 16:53:03.526070 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/dda14ac9-f9b1-4927-a4a4-147c5435906c-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"dda14ac9-f9b1-4927-a4a4-147c5435906c\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:53:03 crc kubenswrapper[5120]: I0316 16:53:03.527124 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-7f77bff94b-c5ng2" podStartSLOduration=10.527106955 podStartE2EDuration="10.527106955s" podCreationTimestamp="2026-03-16 16:52:53 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:53:03.199419866 +0000 UTC m=+4885.353351523" watchObservedRunningTime="2026-03-16 16:53:03.527106955 +0000 UTC m=+4885.681038602" Mar 16 16:53:03 crc kubenswrapper[5120]: I0316 16:53:03.527275 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dda14ac9-f9b1-4927-a4a4-147c5435906c-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"dda14ac9-f9b1-4927-a4a4-147c5435906c\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:53:03 crc kubenswrapper[5120]: I0316 16:53:03.527530 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dh6lz\" (UniqueName: \"kubernetes.io/projected/dda14ac9-f9b1-4927-a4a4-147c5435906c-kube-api-access-dh6lz\") pod \"nova-cell1-novncproxy-0\" (UID: \"dda14ac9-f9b1-4927-a4a4-147c5435906c\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:53:03 crc kubenswrapper[5120]: I0316 16:53:03.528640 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=12.528630238 podStartE2EDuration="12.528630238s" podCreationTimestamp="2026-03-16 16:52:51 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:53:03.335658776 +0000 UTC m=+4885.489590433" watchObservedRunningTime="2026-03-16 16:53:03.528630238 +0000 UTC m=+4885.682561895" Mar 16 16:53:03 crc kubenswrapper[5120]: I0316 16:53:03.534931 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dda14ac9-f9b1-4927-a4a4-147c5435906c-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"dda14ac9-f9b1-4927-a4a4-147c5435906c\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:53:03 crc kubenswrapper[5120]: I0316 16:53:03.557076 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/dda14ac9-f9b1-4927-a4a4-147c5435906c-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"dda14ac9-f9b1-4927-a4a4-147c5435906c\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:53:03 crc kubenswrapper[5120]: I0316 16:53:03.563280 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 16:53:03 crc kubenswrapper[5120]: I0316 16:53:03.567585 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dda14ac9-f9b1-4927-a4a4-147c5435906c-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"dda14ac9-f9b1-4927-a4a4-147c5435906c\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:53:03 crc kubenswrapper[5120]: I0316 16:53:03.574203 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 16:53:03 crc kubenswrapper[5120]: I0316 16:53:03.575431 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/dda14ac9-f9b1-4927-a4a4-147c5435906c-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"dda14ac9-f9b1-4927-a4a4-147c5435906c\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:53:03 crc kubenswrapper[5120]: I0316 16:53:03.576432 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dh6lz\" (UniqueName: \"kubernetes.io/projected/dda14ac9-f9b1-4927-a4a4-147c5435906c-kube-api-access-dh6lz\") pod \"nova-cell1-novncproxy-0\" (UID: \"dda14ac9-f9b1-4927-a4a4-147c5435906c\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:53:03 crc kubenswrapper[5120]: I0316 16:53:03.581840 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 16:53:03 crc kubenswrapper[5120]: I0316 16:53:03.609413 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 16:53:03 crc kubenswrapper[5120]: I0316 16:53:03.609533 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Mar 16 16:53:03 crc kubenswrapper[5120]: I0316 16:53:03.623606 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"memcached-config-data\"" Mar 16 16:53:03 crc kubenswrapper[5120]: I0316 16:53:03.623917 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"memcached-memcached-dockercfg-njnwg\"" Mar 16 16:53:03 crc kubenswrapper[5120]: I0316 16:53:03.624083 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-memcached-svc\"" Mar 16 16:53:03 crc kubenswrapper[5120]: I0316 16:53:03.633087 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/e7bf94ef-c84b-45ee-a2d9-dd048b1172e3-catalog-content\") pod \"certified-operators-9t866\" (UID: \"e7bf94ef-c84b-45ee-a2d9-dd048b1172e3\") " pod="openshift-marketplace/certified-operators-9t866" Mar 16 16:53:03 crc kubenswrapper[5120]: I0316 16:53:03.633188 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtmzv\" (UniqueName: \"kubernetes.io/projected/e7bf94ef-c84b-45ee-a2d9-dd048b1172e3-kube-api-access-vtmzv\") pod \"certified-operators-9t866\" (UID: \"e7bf94ef-c84b-45ee-a2d9-dd048b1172e3\") " pod="openshift-marketplace/certified-operators-9t866" Mar 16 16:53:03 crc kubenswrapper[5120]: I0316 16:53:03.633285 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/e7bf94ef-c84b-45ee-a2d9-dd048b1172e3-utilities\") pod \"certified-operators-9t866\" (UID: \"e7bf94ef-c84b-45ee-a2d9-dd048b1172e3\") " pod="openshift-marketplace/certified-operators-9t866" Mar 16 16:53:03 crc kubenswrapper[5120]: I0316 16:53:03.698349 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:53:03 crc kubenswrapper[5120]: I0316 16:53:03.737296 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzsf7\" (UniqueName: \"kubernetes.io/projected/5e1c9d08-874f-40cb-9837-5cfd2509c352-kube-api-access-fzsf7\") pod \"memcached-0\" (UID: \"5e1c9d08-874f-40cb-9837-5cfd2509c352\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:53:03 crc kubenswrapper[5120]: I0316 16:53:03.737700 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/5e1c9d08-874f-40cb-9837-5cfd2509c352-kolla-config\") pod \"memcached-0\" (UID: \"5e1c9d08-874f-40cb-9837-5cfd2509c352\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:53:03 crc kubenswrapper[5120]: I0316 16:53:03.737737 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/e7bf94ef-c84b-45ee-a2d9-dd048b1172e3-catalog-content\") pod \"certified-operators-9t866\" (UID: \"e7bf94ef-c84b-45ee-a2d9-dd048b1172e3\") " pod="openshift-marketplace/certified-operators-9t866" Mar 16 16:53:03 crc kubenswrapper[5120]: I0316 16:53:03.737893 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vtmzv\" (UniqueName: \"kubernetes.io/projected/e7bf94ef-c84b-45ee-a2d9-dd048b1172e3-kube-api-access-vtmzv\") pod \"certified-operators-9t866\" (UID: \"e7bf94ef-c84b-45ee-a2d9-dd048b1172e3\") " pod="openshift-marketplace/certified-operators-9t866" Mar 16 16:53:03 crc kubenswrapper[5120]: I0316 16:53:03.738086 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/5e1c9d08-874f-40cb-9837-5cfd2509c352-memcached-tls-certs\") pod \"memcached-0\" (UID: \"5e1c9d08-874f-40cb-9837-5cfd2509c352\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:53:03 crc kubenswrapper[5120]: I0316 16:53:03.738124 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/e7bf94ef-c84b-45ee-a2d9-dd048b1172e3-utilities\") pod \"certified-operators-9t866\" (UID: \"e7bf94ef-c84b-45ee-a2d9-dd048b1172e3\") " pod="openshift-marketplace/certified-operators-9t866" Mar 16 16:53:03 crc kubenswrapper[5120]: I0316 16:53:03.738305 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5e1c9d08-874f-40cb-9837-5cfd2509c352-combined-ca-bundle\") pod \"memcached-0\" (UID: \"5e1c9d08-874f-40cb-9837-5cfd2509c352\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:53:03 crc kubenswrapper[5120]: I0316 16:53:03.738345 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/5e1c9d08-874f-40cb-9837-5cfd2509c352-config-data\") pod \"memcached-0\" (UID: \"5e1c9d08-874f-40cb-9837-5cfd2509c352\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:53:03 crc kubenswrapper[5120]: I0316 16:53:03.740157 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/e7bf94ef-c84b-45ee-a2d9-dd048b1172e3-catalog-content\") pod \"certified-operators-9t866\" (UID: \"e7bf94ef-c84b-45ee-a2d9-dd048b1172e3\") " pod="openshift-marketplace/certified-operators-9t866" Mar 16 16:53:03 crc kubenswrapper[5120]: I0316 16:53:03.742752 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/e7bf94ef-c84b-45ee-a2d9-dd048b1172e3-utilities\") pod \"certified-operators-9t866\" (UID: \"e7bf94ef-c84b-45ee-a2d9-dd048b1172e3\") " pod="openshift-marketplace/certified-operators-9t866" Mar 16 16:53:03 crc kubenswrapper[5120]: I0316 16:53:03.792431 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtmzv\" (UniqueName: \"kubernetes.io/projected/e7bf94ef-c84b-45ee-a2d9-dd048b1172e3-kube-api-access-vtmzv\") pod \"certified-operators-9t866\" (UID: \"e7bf94ef-c84b-45ee-a2d9-dd048b1172e3\") " pod="openshift-marketplace/certified-operators-9t866" Mar 16 16:53:03 crc kubenswrapper[5120]: I0316 16:53:03.841963 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/5e1c9d08-874f-40cb-9837-5cfd2509c352-memcached-tls-certs\") pod \"memcached-0\" (UID: \"5e1c9d08-874f-40cb-9837-5cfd2509c352\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:53:03 crc kubenswrapper[5120]: I0316 16:53:03.842108 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5e1c9d08-874f-40cb-9837-5cfd2509c352-combined-ca-bundle\") pod \"memcached-0\" (UID: \"5e1c9d08-874f-40cb-9837-5cfd2509c352\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:53:03 crc kubenswrapper[5120]: I0316 16:53:03.842134 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/5e1c9d08-874f-40cb-9837-5cfd2509c352-config-data\") pod \"memcached-0\" (UID: \"5e1c9d08-874f-40cb-9837-5cfd2509c352\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:53:03 crc kubenswrapper[5120]: I0316 16:53:03.842324 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fzsf7\" (UniqueName: \"kubernetes.io/projected/5e1c9d08-874f-40cb-9837-5cfd2509c352-kube-api-access-fzsf7\") pod \"memcached-0\" (UID: \"5e1c9d08-874f-40cb-9837-5cfd2509c352\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:53:03 crc kubenswrapper[5120]: I0316 16:53:03.842403 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/5e1c9d08-874f-40cb-9837-5cfd2509c352-kolla-config\") pod \"memcached-0\" (UID: \"5e1c9d08-874f-40cb-9837-5cfd2509c352\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:53:03 crc kubenswrapper[5120]: I0316 16:53:03.880462 5120 scope.go:117] "RemoveContainer" containerID="93704be7a1911253e9bec47c485dbaf555ed483872f59ee96ad929fb574a1c97" Mar 16 16:53:03 crc kubenswrapper[5120]: I0316 16:53:03.901871 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/5e1c9d08-874f-40cb-9837-5cfd2509c352-kolla-config\") pod \"memcached-0\" (UID: \"5e1c9d08-874f-40cb-9837-5cfd2509c352\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:53:03 crc kubenswrapper[5120]: I0316 16:53:03.920555 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/5e1c9d08-874f-40cb-9837-5cfd2509c352-config-data\") pod \"memcached-0\" (UID: \"5e1c9d08-874f-40cb-9837-5cfd2509c352\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:53:03 crc kubenswrapper[5120]: I0316 16:53:03.940383 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/5e1c9d08-874f-40cb-9837-5cfd2509c352-memcached-tls-certs\") pod \"memcached-0\" (UID: \"5e1c9d08-874f-40cb-9837-5cfd2509c352\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:53:03 crc kubenswrapper[5120]: I0316 16:53:03.965455 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzsf7\" (UniqueName: \"kubernetes.io/projected/5e1c9d08-874f-40cb-9837-5cfd2509c352-kube-api-access-fzsf7\") pod \"memcached-0\" (UID: \"5e1c9d08-874f-40cb-9837-5cfd2509c352\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:53:03 crc kubenswrapper[5120]: I0316 16:53:03.967509 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-9t866" Mar 16 16:53:04 crc kubenswrapper[5120]: I0316 16:53:04.035527 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5e1c9d08-874f-40cb-9837-5cfd2509c352-combined-ca-bundle\") pod \"memcached-0\" (UID: \"5e1c9d08-874f-40cb-9837-5cfd2509c352\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:53:04 crc kubenswrapper[5120]: I0316 16:53:04.268666 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-f56965744-skhtb"] Mar 16 16:53:04 crc kubenswrapper[5120]: I0316 16:53:04.343076 5120 scope.go:117] "RemoveContainer" containerID="4953a3c44bc238fbcf8c208701df55aea6785f9a7d44ee5bd9ecc32bbac1a728" Mar 16 16:53:04 crc kubenswrapper[5120]: I0316 16:53:04.419792 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Mar 16 16:53:04 crc kubenswrapper[5120]: I0316 16:53:04.612201 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:53:04 crc kubenswrapper[5120]: I0316 16:53:04.665687 5120 generic.go:358] "Generic (PLEG): container finished" podID="0fba253d-bef6-490a-8d34-6be75a260d03" containerID="ce0287d83103e9544ee024f8b7ebcd28fe5e9a66b2efe0735defa49ab4a63b75" exitCode=0 Mar 16 16:53:04 crc kubenswrapper[5120]: I0316 16:53:04.665709 5120 generic.go:358] "Generic (PLEG): container finished" podID="0fba253d-bef6-490a-8d34-6be75a260d03" containerID="cf30bf858ee3854358c96c7f21db6e3d78dc11544569687a33f15adb8935dbe6" exitCode=143 Mar 16 16:53:04 crc kubenswrapper[5120]: I0316 16:53:04.665817 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"0fba253d-bef6-490a-8d34-6be75a260d03","Type":"ContainerDied","Data":"ce0287d83103e9544ee024f8b7ebcd28fe5e9a66b2efe0735defa49ab4a63b75"} Mar 16 16:53:04 crc kubenswrapper[5120]: I0316 16:53:04.665843 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"0fba253d-bef6-490a-8d34-6be75a260d03","Type":"ContainerDied","Data":"cf30bf858ee3854358c96c7f21db6e3d78dc11544569687a33f15adb8935dbe6"} Mar 16 16:53:04 crc kubenswrapper[5120]: I0316 16:53:04.695870 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/77e38408-57df-40be-95a1-64f61218c305-combined-ca-bundle\") pod \"77e38408-57df-40be-95a1-64f61218c305\" (UID: \"77e38408-57df-40be-95a1-64f61218c305\") " Mar 16 16:53:04 crc kubenswrapper[5120]: I0316 16:53:04.696329 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/77e38408-57df-40be-95a1-64f61218c305-config-data\") pod \"77e38408-57df-40be-95a1-64f61218c305\" (UID: \"77e38408-57df-40be-95a1-64f61218c305\") " Mar 16 16:53:04 crc kubenswrapper[5120]: I0316 16:53:04.696596 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/77e38408-57df-40be-95a1-64f61218c305-logs\") pod \"77e38408-57df-40be-95a1-64f61218c305\" (UID: \"77e38408-57df-40be-95a1-64f61218c305\") " Mar 16 16:53:04 crc kubenswrapper[5120]: I0316 16:53:04.702556 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bm89z\" (UniqueName: \"kubernetes.io/projected/77e38408-57df-40be-95a1-64f61218c305-kube-api-access-bm89z\") pod \"77e38408-57df-40be-95a1-64f61218c305\" (UID: \"77e38408-57df-40be-95a1-64f61218c305\") " Mar 16 16:53:04 crc kubenswrapper[5120]: I0316 16:53:04.702652 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/77e38408-57df-40be-95a1-64f61218c305-nova-metadata-tls-certs\") pod \"77e38408-57df-40be-95a1-64f61218c305\" (UID: \"77e38408-57df-40be-95a1-64f61218c305\") " Mar 16 16:53:04 crc kubenswrapper[5120]: I0316 16:53:04.704086 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77e38408-57df-40be-95a1-64f61218c305-logs" (OuterVolumeSpecName: "logs") pod "77e38408-57df-40be-95a1-64f61218c305" (UID: "77e38408-57df-40be-95a1-64f61218c305"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:53:04 crc kubenswrapper[5120]: I0316 16:53:04.705598 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:53:04 crc kubenswrapper[5120]: I0316 16:53:04.711013 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="18e2f22a-0bc1-4514-afe4-56bdf5cb1670" path="/var/lib/kubelet/pods/18e2f22a-0bc1-4514-afe4-56bdf5cb1670/volumes" Mar 16 16:53:04 crc kubenswrapper[5120]: I0316 16:53:04.711601 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a3cdc115-5535-44fd-94b4-6256145dea7e" path="/var/lib/kubelet/pods/a3cdc115-5535-44fd-94b4-6256145dea7e/volumes" Mar 16 16:53:04 crc kubenswrapper[5120]: I0316 16:53:04.715988 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"77e38408-57df-40be-95a1-64f61218c305","Type":"ContainerDied","Data":"56beee6705d409b8332e29a165b9c99559accc543766bf994f3681efe23e8a0e"} Mar 16 16:53:04 crc kubenswrapper[5120]: I0316 16:53:04.730848 5120 generic.go:358] "Generic (PLEG): container finished" podID="f1c9b873-c644-4c80-941e-3ec3415485e4" containerID="e84a6ccec0bb33bc2cd454d4394c28b18bc68551ef47c224ec6f142319f3040e" exitCode=1 Mar 16 16:53:04 crc kubenswrapper[5120]: I0316 16:53:04.730927 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"f1c9b873-c644-4c80-941e-3ec3415485e4","Type":"ContainerDied","Data":"e84a6ccec0bb33bc2cd454d4394c28b18bc68551ef47c224ec6f142319f3040e"} Mar 16 16:53:04 crc kubenswrapper[5120]: I0316 16:53:04.753868 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77e38408-57df-40be-95a1-64f61218c305-kube-api-access-bm89z" (OuterVolumeSpecName: "kube-api-access-bm89z") pod "77e38408-57df-40be-95a1-64f61218c305" (UID: "77e38408-57df-40be-95a1-64f61218c305"). InnerVolumeSpecName "kube-api-access-bm89z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:53:04 crc kubenswrapper[5120]: I0316 16:53:04.755154 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"32963b23-d87d-4107-9a13-32737c586ab3","Type":"ContainerStarted","Data":"58c07a51b4172ab9053522a005ba3b17022f1d3fb05e71513b0dedcd67769622"} Mar 16 16:53:04 crc kubenswrapper[5120]: I0316 16:53:04.784538 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"b4ce877d-d510-483c-9a9c-b149879f1755","Type":"ContainerStarted","Data":"d2eb4e21ebfbf4c48740f681aa1f4c14b01ac6e6ac567636f37191d3ba9131bb"} Mar 16 16:53:04 crc kubenswrapper[5120]: I0316 16:53:04.784815 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="b4ce877d-d510-483c-9a9c-b149879f1755" containerName="cinder-api-log" containerID="cri-o://426729983f303ba8a51519f9cd7d552cb66105e64258abc8aac0b8ea4920460e" gracePeriod=30 Mar 16 16:53:04 crc kubenswrapper[5120]: I0316 16:53:04.784913 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:53:04 crc kubenswrapper[5120]: I0316 16:53:04.785432 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="b4ce877d-d510-483c-9a9c-b149879f1755" containerName="cinder-api" containerID="cri-o://d2eb4e21ebfbf4c48740f681aa1f4c14b01ac6e6ac567636f37191d3ba9131bb" gracePeriod=30 Mar 16 16:53:04 crc kubenswrapper[5120]: I0316 16:53:04.789039 5120 scope.go:117] "RemoveContainer" containerID="c93e64b15c166ba718c199a2500ca4e4c998e0677346f6d61e58dc0ac5de1dbf" Mar 16 16:53:04 crc kubenswrapper[5120]: I0316 16:53:04.811336 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-api-0" podStartSLOduration=13.811317945 podStartE2EDuration="13.811317945s" podCreationTimestamp="2026-03-16 16:52:51 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:53:04.80932879 +0000 UTC m=+4886.963260457" watchObservedRunningTime="2026-03-16 16:53:04.811317945 +0000 UTC m=+4886.965249602" Mar 16 16:53:04 crc kubenswrapper[5120]: I0316 16:53:04.818833 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bm89z\" (UniqueName: \"kubernetes.io/projected/77e38408-57df-40be-95a1-64f61218c305-kube-api-access-bm89z\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:04 crc kubenswrapper[5120]: I0316 16:53:04.818863 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/77e38408-57df-40be-95a1-64f61218c305-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:04 crc kubenswrapper[5120]: I0316 16:53:04.876965 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-84f95d87c8-s7s4d" event={"ID":"3853023d-8cc5-42de-9f91-d0609e3fe565","Type":"ContainerStarted","Data":"8a3d67c798c34d7edc582c34b6def56cd2c18e2d3984706dd66fb4a5aa30323f"} Mar 16 16:53:04 crc kubenswrapper[5120]: E0316 16:53:04.899247 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="dff05d001161dd73ee301824319b7393ecaf3fe56d375faa6a317018e3fee33b" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Mar 16 16:53:04 crc kubenswrapper[5120]: I0316 16:53:04.910216 5120 generic.go:358] "Generic (PLEG): container finished" podID="26d7e714-e270-4150-9fc2-65e289bbd688" containerID="39ef33895c134d0ed936fb426895f0c7eb3288074422326f288eccff008d3774" exitCode=1 Mar 16 16:53:04 crc kubenswrapper[5120]: I0316 16:53:04.910321 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"26d7e714-e270-4150-9fc2-65e289bbd688","Type":"ContainerDied","Data":"39ef33895c134d0ed936fb426895f0c7eb3288074422326f288eccff008d3774"} Mar 16 16:53:04 crc kubenswrapper[5120]: E0316 16:53:04.930090 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="dff05d001161dd73ee301824319b7393ecaf3fe56d375faa6a317018e3fee33b" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Mar 16 16:53:04 crc kubenswrapper[5120]: I0316 16:53:04.959476 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-c8fc658f4-sqwl6"] Mar 16 16:53:04 crc kubenswrapper[5120]: E0316 16:53:04.964193 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="dff05d001161dd73ee301824319b7393ecaf3fe56d375faa6a317018e3fee33b" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Mar 16 16:53:04 crc kubenswrapper[5120]: E0316 16:53:04.964252 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/ovn-northd-0" podUID="72edd543-4bf8-407e-9929-47d4e9727134" containerName="ovn-northd" probeResult="unknown" Mar 16 16:53:05 crc kubenswrapper[5120]: I0316 16:53:05.274140 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/77e38408-57df-40be-95a1-64f61218c305-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "77e38408-57df-40be-95a1-64f61218c305" (UID: "77e38408-57df-40be-95a1-64f61218c305"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:05 crc kubenswrapper[5120]: I0316 16:53:05.313040 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-7555689c4b-84shq"] Mar 16 16:53:05 crc kubenswrapper[5120]: I0316 16:53:05.342998 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/77e38408-57df-40be-95a1-64f61218c305-config-data" (OuterVolumeSpecName: "config-data") pod "77e38408-57df-40be-95a1-64f61218c305" (UID: "77e38408-57df-40be-95a1-64f61218c305"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:05 crc kubenswrapper[5120]: I0316 16:53:05.376490 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/77e38408-57df-40be-95a1-64f61218c305-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:05 crc kubenswrapper[5120]: I0316 16:53:05.376561 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/77e38408-57df-40be-95a1-64f61218c305-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:05 crc kubenswrapper[5120]: E0316 16:53:05.397852 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of e84a6ccec0bb33bc2cd454d4394c28b18bc68551ef47c224ec6f142319f3040e is running failed: container process not found" containerID="e84a6ccec0bb33bc2cd454d4394c28b18bc68551ef47c224ec6f142319f3040e" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:53:05 crc kubenswrapper[5120]: E0316 16:53:05.399135 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of e84a6ccec0bb33bc2cd454d4394c28b18bc68551ef47c224ec6f142319f3040e is running failed: container process not found" containerID="e84a6ccec0bb33bc2cd454d4394c28b18bc68551ef47c224ec6f142319f3040e" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:53:05 crc kubenswrapper[5120]: E0316 16:53:05.399506 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of e84a6ccec0bb33bc2cd454d4394c28b18bc68551ef47c224ec6f142319f3040e is running failed: container process not found" containerID="e84a6ccec0bb33bc2cd454d4394c28b18bc68551ef47c224ec6f142319f3040e" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:53:05 crc kubenswrapper[5120]: E0316 16:53:05.399548 5120 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of e84a6ccec0bb33bc2cd454d4394c28b18bc68551ef47c224ec6f142319f3040e is running failed: container process not found" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="f1c9b873-c644-4c80-941e-3ec3415485e4" containerName="nova-cell1-conductor-conductor" probeResult="unknown" Mar 16 16:53:05 crc kubenswrapper[5120]: W0316 16:53:05.428903 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod34e6ded3_dd6f_46bb_9d23_fa8724b78ace.slice/crio-12f22be8d9d792a80a93e43a38d6d62396ea6423e1fec7905bbcdafaa50b3aea WatchSource:0}: Error finding container 12f22be8d9d792a80a93e43a38d6d62396ea6423e1fec7905bbcdafaa50b3aea: Status 404 returned error can't find the container with id 12f22be8d9d792a80a93e43a38d6d62396ea6423e1fec7905bbcdafaa50b3aea Mar 16 16:53:05 crc kubenswrapper[5120]: I0316 16:53:05.519672 5120 scope.go:117] "RemoveContainer" containerID="c93e64b15c166ba718c199a2500ca4e4c998e0677346f6d61e58dc0ac5de1dbf" Mar 16 16:53:05 crc kubenswrapper[5120]: E0316 16:53:05.520681 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c93e64b15c166ba718c199a2500ca4e4c998e0677346f6d61e58dc0ac5de1dbf\": container with ID starting with c93e64b15c166ba718c199a2500ca4e4c998e0677346f6d61e58dc0ac5de1dbf not found: ID does not exist" containerID="c93e64b15c166ba718c199a2500ca4e4c998e0677346f6d61e58dc0ac5de1dbf" Mar 16 16:53:05 crc kubenswrapper[5120]: I0316 16:53:05.520744 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c93e64b15c166ba718c199a2500ca4e4c998e0677346f6d61e58dc0ac5de1dbf"} err="failed to get container status \"c93e64b15c166ba718c199a2500ca4e4c998e0677346f6d61e58dc0ac5de1dbf\": rpc error: code = NotFound desc = could not find container \"c93e64b15c166ba718c199a2500ca4e4c998e0677346f6d61e58dc0ac5de1dbf\": container with ID starting with c93e64b15c166ba718c199a2500ca4e4c998e0677346f6d61e58dc0ac5de1dbf not found: ID does not exist" Mar 16 16:53:05 crc kubenswrapper[5120]: I0316 16:53:05.520876 5120 scope.go:117] "RemoveContainer" containerID="6b88504f95b540a2b147aae744cdfc0147fe840248de0b7dbb003027bcb85307" Mar 16 16:53:05 crc kubenswrapper[5120]: I0316 16:53:05.616981 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 16:53:05 crc kubenswrapper[5120]: I0316 16:53:05.660600 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/certified-operators-9t866"] Mar 16 16:53:05 crc kubenswrapper[5120]: I0316 16:53:05.671850 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:53:05 crc kubenswrapper[5120]: I0316 16:53:05.778827 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/77e38408-57df-40be-95a1-64f61218c305-nova-metadata-tls-certs" (OuterVolumeSpecName: "nova-metadata-tls-certs") pod "77e38408-57df-40be-95a1-64f61218c305" (UID: "77e38408-57df-40be-95a1-64f61218c305"). InnerVolumeSpecName "nova-metadata-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:05 crc kubenswrapper[5120]: I0316 16:53:05.806870 5120 reconciler_common.go:299] "Volume detached for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/77e38408-57df-40be-95a1-64f61218c305-nova-metadata-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:05 crc kubenswrapper[5120]: I0316 16:53:05.873169 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openstack-kuttl-tests/barbican-api-7f78b864cb-6dgjh" podUID="c06f24f9-95b0-4a92-ad3a-6075764151ed" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.0.133:9311/healthcheck\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Mar 16 16:53:05 crc kubenswrapper[5120]: I0316 16:53:05.950208 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"6792b2c6-f5cf-454a-858a-cbd4159db76a","Type":"ContainerStarted","Data":"b906fd70f36d377ce541811ff12a62e890d86300690ff722e603d902f637f772"} Mar 16 16:53:05 crc kubenswrapper[5120]: I0316 16:53:05.958498 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"607fee19-adac-44b4-9f70-a6f6f3e59aed","Type":"ContainerStarted","Data":"eb2716296f9c5287a1ca3bce2395180fac10d428f3a9c4a1dd20632f18669519"} Mar 16 16:53:05 crc kubenswrapper[5120]: I0316 16:53:05.959243 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="607fee19-adac-44b4-9f70-a6f6f3e59aed" containerName="glance-log" containerID="cri-o://3e4d1b60e2bb40708ca0eb86088645db7b9870e10296a1eff67cb5ce00260ed7" gracePeriod=30 Mar 16 16:53:05 crc kubenswrapper[5120]: I0316 16:53:05.960238 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="607fee19-adac-44b4-9f70-a6f6f3e59aed" containerName="glance-httpd" containerID="cri-o://eb2716296f9c5287a1ca3bce2395180fac10d428f3a9c4a1dd20632f18669519" gracePeriod=30 Mar 16 16:53:06 crc kubenswrapper[5120]: I0316 16:53:06.007701 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-external-api-0" podStartSLOduration=15.00768109 podStartE2EDuration="15.00768109s" podCreationTimestamp="2026-03-16 16:52:51 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:53:06.002035476 +0000 UTC m=+4888.155967133" watchObservedRunningTime="2026-03-16 16:53:06.00768109 +0000 UTC m=+4888.161612747" Mar 16 16:53:06 crc kubenswrapper[5120]: I0316 16:53:06.024939 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"e5c498e5-584c-4cdd-b008-c643b7bb1bc5","Type":"ContainerStarted","Data":"4f87e2ba79ef2ad55e9134e65028d8ffb56874b0a0b9cd57961496fea5e06a3b"} Mar 16 16:53:06 crc kubenswrapper[5120]: I0316 16:53:06.030648 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"26d7e714-e270-4150-9fc2-65e289bbd688","Type":"ContainerDied","Data":"755c42e1ed74f1f57c1cc7f1151eab0b24f90cd185c3418945fdfde0ab53c586"} Mar 16 16:53:06 crc kubenswrapper[5120]: I0316 16:53:06.031000 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="755c42e1ed74f1f57c1cc7f1151eab0b24f90cd185c3418945fdfde0ab53c586" Mar 16 16:53:06 crc kubenswrapper[5120]: I0316 16:53:06.046452 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"dda14ac9-f9b1-4927-a4a4-147c5435906c","Type":"ContainerStarted","Data":"1a6bcc18858af7e864e387e78a9c5b12ab7f18a098d4e491c0abb014a5608ee5"} Mar 16 16:53:06 crc kubenswrapper[5120]: I0316 16:53:06.062982 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstack-cell1-galera-0" podStartSLOduration=15.062961644 podStartE2EDuration="15.062961644s" podCreationTimestamp="2026-03-16 16:52:51 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:53:06.056449325 +0000 UTC m=+4888.210380992" watchObservedRunningTime="2026-03-16 16:53:06.062961644 +0000 UTC m=+4888.216893301" Mar 16 16:53:06 crc kubenswrapper[5120]: I0316 16:53:06.074288 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-c8fc658f4-sqwl6" event={"ID":"34e6ded3-dd6f-46bb-9d23-fa8724b78ace","Type":"ContainerStarted","Data":"12f22be8d9d792a80a93e43a38d6d62396ea6423e1fec7905bbcdafaa50b3aea"} Mar 16 16:53:06 crc kubenswrapper[5120]: I0316 16:53:06.095511 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"50c82211-4383-41cb-a31c-9bdfb156b586","Type":"ContainerStarted","Data":"09f299b5d93c37d9587b3d1ab480436df43aab9b13b697336b90e9551005ece5"} Mar 16 16:53:06 crc kubenswrapper[5120]: I0316 16:53:06.096185 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="50c82211-4383-41cb-a31c-9bdfb156b586" containerName="glance-log" containerID="cri-o://423900fcfc665a7c0642a3969b0d45a290a37855935f76532dcda5ffb9c954cc" gracePeriod=30 Mar 16 16:53:06 crc kubenswrapper[5120]: I0316 16:53:06.097096 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="50c82211-4383-41cb-a31c-9bdfb156b586" containerName="glance-httpd" containerID="cri-o://09f299b5d93c37d9587b3d1ab480436df43aab9b13b697336b90e9551005ece5" gracePeriod=30 Mar 16 16:53:06 crc kubenswrapper[5120]: I0316 16:53:06.153591 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"61483cf5-d3db-49de-afa4-66f0efecdd70","Type":"ContainerStarted","Data":"7e4afb4b4a40e2ae0676505302e76e0be75d2f157b59d02034c7d6f97f9ffdcf"} Mar 16 16:53:06 crc kubenswrapper[5120]: I0316 16:53:06.162375 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"0fba253d-bef6-490a-8d34-6be75a260d03","Type":"ContainerDied","Data":"1bd233aaa2d94cd74f7be91d0921d4d062bfd66e884b04a33ccb25506a7bdded"} Mar 16 16:53:06 crc kubenswrapper[5120]: I0316 16:53:06.162424 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1bd233aaa2d94cd74f7be91d0921d4d062bfd66e884b04a33ccb25506a7bdded" Mar 16 16:53:06 crc kubenswrapper[5120]: I0316 16:53:06.171378 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-internal-api-0" podStartSLOduration=15.17135524 podStartE2EDuration="15.17135524s" podCreationTimestamp="2026-03-16 16:52:51 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:53:06.135335564 +0000 UTC m=+4888.289267221" watchObservedRunningTime="2026-03-16 16:53:06.17135524 +0000 UTC m=+4888.325286897" Mar 16 16:53:06 crc kubenswrapper[5120]: I0316 16:53:06.209171 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-9t866" event={"ID":"e7bf94ef-c84b-45ee-a2d9-dd048b1172e3","Type":"ContainerStarted","Data":"fc9446d25dc326bae63abeb98bb620dc50cfbf089e4c9935c8e1aa3f2cb86a9c"} Mar 16 16:53:06 crc kubenswrapper[5120]: I0316 16:53:06.246128 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"f1c9b873-c644-4c80-941e-3ec3415485e4","Type":"ContainerDied","Data":"147f67451a7acdf7de0b506f8b294ffb13728a5728c87a3e67d00fc81b70f28b"} Mar 16 16:53:06 crc kubenswrapper[5120]: I0316 16:53:06.246180 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="147f67451a7acdf7de0b506f8b294ffb13728a5728c87a3e67d00fc81b70f28b" Mar 16 16:53:06 crc kubenswrapper[5120]: I0316 16:53:06.249710 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-7555689c4b-84shq" event={"ID":"e5acac7f-9646-4be1-ac22-31326296e4de","Type":"ContainerStarted","Data":"5f9c8405278c1d27f0bef96dc113ce4effb5e74800d43c882d0387946ecc5ec9"} Mar 16 16:53:06 crc kubenswrapper[5120]: I0316 16:53:06.288202 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-6d764c69b8-sv9d2" event={"ID":"979d8a07-391d-483c-92d1-bb2d256edf99","Type":"ContainerStarted","Data":"e657edbdc4c1d1813bbd0fe5142cc396ab5f34be797282678df442f971bf15d2"} Mar 16 16:53:06 crc kubenswrapper[5120]: I0316 16:53:06.299965 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/keystone-6d764c69b8-sv9d2" Mar 16 16:53:06 crc kubenswrapper[5120]: I0316 16:53:06.331173 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-7f78b864cb-6dgjh" podUID="c06f24f9-95b0-4a92-ad3a-6075764151ed" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.0.133:9311/healthcheck\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 16:53:06 crc kubenswrapper[5120]: I0316 16:53:06.351316 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-f56965744-skhtb" event={"ID":"4907839f-9071-4378-90f6-f92ced0b0bf0","Type":"ContainerStarted","Data":"b3360375cb2fa00eecf25a726dfb40c55dbbe6d258c3a93d1eec2c531c8e8559"} Mar 16 16:53:06 crc kubenswrapper[5120]: I0316 16:53:06.351899 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-7f78b864cb-6dgjh" podUID="c06f24f9-95b0-4a92-ad3a-6075764151ed" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.0.133:9311/healthcheck\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 16:53:06 crc kubenswrapper[5120]: I0316 16:53:06.387365 5120 generic.go:358] "Generic (PLEG): container finished" podID="b4ce877d-d510-483c-9a9c-b149879f1755" containerID="d2eb4e21ebfbf4c48740f681aa1f4c14b01ac6e6ac567636f37191d3ba9131bb" exitCode=0 Mar 16 16:53:06 crc kubenswrapper[5120]: I0316 16:53:06.387399 5120 generic.go:358] "Generic (PLEG): container finished" podID="b4ce877d-d510-483c-9a9c-b149879f1755" containerID="426729983f303ba8a51519f9cd7d552cb66105e64258abc8aac0b8ea4920460e" exitCode=143 Mar 16 16:53:06 crc kubenswrapper[5120]: I0316 16:53:06.387533 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"b4ce877d-d510-483c-9a9c-b149879f1755","Type":"ContainerDied","Data":"d2eb4e21ebfbf4c48740f681aa1f4c14b01ac6e6ac567636f37191d3ba9131bb"} Mar 16 16:53:06 crc kubenswrapper[5120]: I0316 16:53:06.387611 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"b4ce877d-d510-483c-9a9c-b149879f1755","Type":"ContainerDied","Data":"426729983f303ba8a51519f9cd7d552cb66105e64258abc8aac0b8ea4920460e"} Mar 16 16:53:06 crc kubenswrapper[5120]: I0316 16:53:06.389506 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"5e1c9d08-874f-40cb-9837-5cfd2509c352","Type":"ContainerStarted","Data":"6af4dbdea93d2eb8d7714edbc826eca75252c54442fb425b5ab9ae208bdbcaa1"} Mar 16 16:53:06 crc kubenswrapper[5120]: I0316 16:53:06.473916 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-6d764c69b8-sv9d2" podStartSLOduration=8.47387345 podStartE2EDuration="8.47387345s" podCreationTimestamp="2026-03-16 16:52:58 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:53:06.370656145 +0000 UTC m=+4888.524587812" watchObservedRunningTime="2026-03-16 16:53:06.47387345 +0000 UTC m=+4888.627805107" Mar 16 16:53:06 crc kubenswrapper[5120]: E0316 16:53:06.897063 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 39ef33895c134d0ed936fb426895f0c7eb3288074422326f288eccff008d3774 is running failed: container process not found" containerID="39ef33895c134d0ed936fb426895f0c7eb3288074422326f288eccff008d3774" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:53:06 crc kubenswrapper[5120]: E0316 16:53:06.916323 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 39ef33895c134d0ed936fb426895f0c7eb3288074422326f288eccff008d3774 is running failed: container process not found" containerID="39ef33895c134d0ed936fb426895f0c7eb3288074422326f288eccff008d3774" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:53:06 crc kubenswrapper[5120]: E0316 16:53:06.922497 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 39ef33895c134d0ed936fb426895f0c7eb3288074422326f288eccff008d3774 is running failed: container process not found" containerID="39ef33895c134d0ed936fb426895f0c7eb3288074422326f288eccff008d3774" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:53:06 crc kubenswrapper[5120]: E0316 16:53:06.922570 5120 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 39ef33895c134d0ed936fb426895f0c7eb3288074422326f288eccff008d3774 is running failed: container process not found" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="26d7e714-e270-4150-9fc2-65e289bbd688" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 16:53:06 crc kubenswrapper[5120]: I0316 16:53:06.957118 5120 scope.go:117] "RemoveContainer" containerID="31db12e43658d9b439ba1ed20816294a537012094b7d53a0e297f4d8b5dc66b2" Mar 16 16:53:07 crc kubenswrapper[5120]: I0316 16:53:07.151099 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:53:07 crc kubenswrapper[5120]: I0316 16:53:07.163132 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:53:07 crc kubenswrapper[5120]: I0316 16:53:07.202668 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/26d7e714-e270-4150-9fc2-65e289bbd688-combined-ca-bundle\") pod \"26d7e714-e270-4150-9fc2-65e289bbd688\" (UID: \"26d7e714-e270-4150-9fc2-65e289bbd688\") " Mar 16 16:53:07 crc kubenswrapper[5120]: I0316 16:53:07.203112 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v8jxx\" (UniqueName: \"kubernetes.io/projected/26d7e714-e270-4150-9fc2-65e289bbd688-kube-api-access-v8jxx\") pod \"26d7e714-e270-4150-9fc2-65e289bbd688\" (UID: \"26d7e714-e270-4150-9fc2-65e289bbd688\") " Mar 16 16:53:07 crc kubenswrapper[5120]: I0316 16:53:07.203329 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/26d7e714-e270-4150-9fc2-65e289bbd688-config-data\") pod \"26d7e714-e270-4150-9fc2-65e289bbd688\" (UID: \"26d7e714-e270-4150-9fc2-65e289bbd688\") " Mar 16 16:53:07 crc kubenswrapper[5120]: I0316 16:53:07.213727 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:53:07 crc kubenswrapper[5120]: I0316 16:53:07.226438 5120 scope.go:117] "RemoveContainer" containerID="b34391ed51e1fef10fa960dbb4dc7aa97f95bec5ecc3a8f7a2c49da0363fdd4d" Mar 16 16:53:07 crc kubenswrapper[5120]: I0316 16:53:07.230932 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-7bf49bf568-fbg2k" podUID="c846d2b2-0638-44bd-9ad0-6b6c76f8d16f" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.0.123:9311/healthcheck\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 16:53:07 crc kubenswrapper[5120]: I0316 16:53:07.244161 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-7bf49bf568-fbg2k" podUID="c846d2b2-0638-44bd-9ad0-6b6c76f8d16f" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.0.123:9311/healthcheck\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Mar 16 16:53:07 crc kubenswrapper[5120]: I0316 16:53:07.291655 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26d7e714-e270-4150-9fc2-65e289bbd688-kube-api-access-v8jxx" (OuterVolumeSpecName: "kube-api-access-v8jxx") pod "26d7e714-e270-4150-9fc2-65e289bbd688" (UID: "26d7e714-e270-4150-9fc2-65e289bbd688"). InnerVolumeSpecName "kube-api-access-v8jxx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:53:07 crc kubenswrapper[5120]: I0316 16:53:07.305046 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/26d7e714-e270-4150-9fc2-65e289bbd688-config-data" (OuterVolumeSpecName: "config-data") pod "26d7e714-e270-4150-9fc2-65e289bbd688" (UID: "26d7e714-e270-4150-9fc2-65e289bbd688"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:07 crc kubenswrapper[5120]: I0316 16:53:07.316903 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:53:07 crc kubenswrapper[5120]: I0316 16:53:07.324455 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/26d7e714-e270-4150-9fc2-65e289bbd688-config-data\") pod \"26d7e714-e270-4150-9fc2-65e289bbd688\" (UID: \"26d7e714-e270-4150-9fc2-65e289bbd688\") " Mar 16 16:53:07 crc kubenswrapper[5120]: I0316 16:53:07.325708 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v8jxx\" (UniqueName: \"kubernetes.io/projected/26d7e714-e270-4150-9fc2-65e289bbd688-kube-api-access-v8jxx\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:07 crc kubenswrapper[5120]: W0316 16:53:07.325835 5120 empty_dir.go:511] Warning: Unmount skipped because path does not exist: /var/lib/kubelet/pods/26d7e714-e270-4150-9fc2-65e289bbd688/volumes/kubernetes.io~secret/config-data Mar 16 16:53:07 crc kubenswrapper[5120]: I0316 16:53:07.325847 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/26d7e714-e270-4150-9fc2-65e289bbd688-config-data" (OuterVolumeSpecName: "config-data") pod "26d7e714-e270-4150-9fc2-65e289bbd688" (UID: "26d7e714-e270-4150-9fc2-65e289bbd688"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:07 crc kubenswrapper[5120]: I0316 16:53:07.345723 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:53:07 crc kubenswrapper[5120]: I0316 16:53:07.348291 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26d7e714-e270-4150-9fc2-65e289bbd688" containerName="nova-cell0-conductor-conductor" Mar 16 16:53:07 crc kubenswrapper[5120]: I0316 16:53:07.348323 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="26d7e714-e270-4150-9fc2-65e289bbd688" containerName="nova-cell0-conductor-conductor" Mar 16 16:53:07 crc kubenswrapper[5120]: I0316 16:53:07.348359 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1c9b873-c644-4c80-941e-3ec3415485e4" containerName="nova-cell1-conductor-conductor" Mar 16 16:53:07 crc kubenswrapper[5120]: I0316 16:53:07.348367 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1c9b873-c644-4c80-941e-3ec3415485e4" containerName="nova-cell1-conductor-conductor" Mar 16 16:53:07 crc kubenswrapper[5120]: I0316 16:53:07.348380 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77e38408-57df-40be-95a1-64f61218c305" containerName="nova-metadata-metadata" Mar 16 16:53:07 crc kubenswrapper[5120]: I0316 16:53:07.348388 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="77e38408-57df-40be-95a1-64f61218c305" containerName="nova-metadata-metadata" Mar 16 16:53:07 crc kubenswrapper[5120]: I0316 16:53:07.348432 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77e38408-57df-40be-95a1-64f61218c305" containerName="nova-metadata-log" Mar 16 16:53:07 crc kubenswrapper[5120]: I0316 16:53:07.348440 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="77e38408-57df-40be-95a1-64f61218c305" containerName="nova-metadata-log" Mar 16 16:53:07 crc kubenswrapper[5120]: I0316 16:53:07.348669 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="77e38408-57df-40be-95a1-64f61218c305" containerName="nova-metadata-metadata" Mar 16 16:53:07 crc kubenswrapper[5120]: I0316 16:53:07.348688 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f1c9b873-c644-4c80-941e-3ec3415485e4" containerName="nova-cell1-conductor-conductor" Mar 16 16:53:07 crc kubenswrapper[5120]: I0316 16:53:07.348699 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="77e38408-57df-40be-95a1-64f61218c305" containerName="nova-metadata-log" Mar 16 16:53:07 crc kubenswrapper[5120]: I0316 16:53:07.348710 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="26d7e714-e270-4150-9fc2-65e289bbd688" containerName="nova-cell0-conductor-conductor" Mar 16 16:53:07 crc kubenswrapper[5120]: I0316 16:53:07.351631 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:53:07 crc kubenswrapper[5120]: I0316 16:53:07.382581 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:53:07 crc kubenswrapper[5120]: I0316 16:53:07.387253 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-metadata-internal-svc\"" Mar 16 16:53:07 crc kubenswrapper[5120]: I0316 16:53:07.388256 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-metadata-config-data\"" Mar 16 16:53:07 crc kubenswrapper[5120]: I0316 16:53:07.407472 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:53:07 crc kubenswrapper[5120]: I0316 16:53:07.421990 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:53:07 crc kubenswrapper[5120]: I0316 16:53:07.428350 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0fba253d-bef6-490a-8d34-6be75a260d03-logs\") pod \"0fba253d-bef6-490a-8d34-6be75a260d03\" (UID: \"0fba253d-bef6-490a-8d34-6be75a260d03\") " Mar 16 16:53:07 crc kubenswrapper[5120]: I0316 16:53:07.428729 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/0fba253d-bef6-490a-8d34-6be75a260d03-public-tls-certs\") pod \"0fba253d-bef6-490a-8d34-6be75a260d03\" (UID: \"0fba253d-bef6-490a-8d34-6be75a260d03\") " Mar 16 16:53:07 crc kubenswrapper[5120]: I0316 16:53:07.429000 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h5vll\" (UniqueName: \"kubernetes.io/projected/f1c9b873-c644-4c80-941e-3ec3415485e4-kube-api-access-h5vll\") pod \"f1c9b873-c644-4c80-941e-3ec3415485e4\" (UID: \"f1c9b873-c644-4c80-941e-3ec3415485e4\") " Mar 16 16:53:07 crc kubenswrapper[5120]: I0316 16:53:07.429137 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f1c9b873-c644-4c80-941e-3ec3415485e4-config-data\") pod \"f1c9b873-c644-4c80-941e-3ec3415485e4\" (UID: \"f1c9b873-c644-4c80-941e-3ec3415485e4\") " Mar 16 16:53:07 crc kubenswrapper[5120]: I0316 16:53:07.429310 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0fba253d-bef6-490a-8d34-6be75a260d03-combined-ca-bundle\") pod \"0fba253d-bef6-490a-8d34-6be75a260d03\" (UID: \"0fba253d-bef6-490a-8d34-6be75a260d03\") " Mar 16 16:53:07 crc kubenswrapper[5120]: I0316 16:53:07.429371 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mtv52\" (UniqueName: \"kubernetes.io/projected/0fba253d-bef6-490a-8d34-6be75a260d03-kube-api-access-mtv52\") pod \"0fba253d-bef6-490a-8d34-6be75a260d03\" (UID: \"0fba253d-bef6-490a-8d34-6be75a260d03\") " Mar 16 16:53:07 crc kubenswrapper[5120]: I0316 16:53:07.429412 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0fba253d-bef6-490a-8d34-6be75a260d03-config-data\") pod \"0fba253d-bef6-490a-8d34-6be75a260d03\" (UID: \"0fba253d-bef6-490a-8d34-6be75a260d03\") " Mar 16 16:53:07 crc kubenswrapper[5120]: I0316 16:53:07.429482 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f1c9b873-c644-4c80-941e-3ec3415485e4-combined-ca-bundle\") pod \"f1c9b873-c644-4c80-941e-3ec3415485e4\" (UID: \"f1c9b873-c644-4c80-941e-3ec3415485e4\") " Mar 16 16:53:07 crc kubenswrapper[5120]: I0316 16:53:07.429672 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/0fba253d-bef6-490a-8d34-6be75a260d03-internal-tls-certs\") pod \"0fba253d-bef6-490a-8d34-6be75a260d03\" (UID: \"0fba253d-bef6-490a-8d34-6be75a260d03\") " Mar 16 16:53:07 crc kubenswrapper[5120]: I0316 16:53:07.431517 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/26d7e714-e270-4150-9fc2-65e289bbd688-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:07 crc kubenswrapper[5120]: I0316 16:53:07.447547 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0fba253d-bef6-490a-8d34-6be75a260d03-kube-api-access-mtv52" (OuterVolumeSpecName: "kube-api-access-mtv52") pod "0fba253d-bef6-490a-8d34-6be75a260d03" (UID: "0fba253d-bef6-490a-8d34-6be75a260d03"). InnerVolumeSpecName "kube-api-access-mtv52". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:53:07 crc kubenswrapper[5120]: I0316 16:53:07.450835 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/26d7e714-e270-4150-9fc2-65e289bbd688-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "26d7e714-e270-4150-9fc2-65e289bbd688" (UID: "26d7e714-e270-4150-9fc2-65e289bbd688"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:07 crc kubenswrapper[5120]: I0316 16:53:07.451954 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0fba253d-bef6-490a-8d34-6be75a260d03-logs" (OuterVolumeSpecName: "logs") pod "0fba253d-bef6-490a-8d34-6be75a260d03" (UID: "0fba253d-bef6-490a-8d34-6be75a260d03"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:53:07 crc kubenswrapper[5120]: I0316 16:53:07.460438 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1c9b873-c644-4c80-941e-3ec3415485e4-kube-api-access-h5vll" (OuterVolumeSpecName: "kube-api-access-h5vll") pod "f1c9b873-c644-4c80-941e-3ec3415485e4" (UID: "f1c9b873-c644-4c80-941e-3ec3415485e4"). InnerVolumeSpecName "kube-api-access-h5vll". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:53:07 crc kubenswrapper[5120]: I0316 16:53:07.533615 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3fd94d95-2cbb-4ec5-9413-1a2ddc6480c5-config-data\") pod \"nova-metadata-0\" (UID: \"3fd94d95-2cbb-4ec5-9413-1a2ddc6480c5\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:53:07 crc kubenswrapper[5120]: I0316 16:53:07.534013 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/3fd94d95-2cbb-4ec5-9413-1a2ddc6480c5-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"3fd94d95-2cbb-4ec5-9413-1a2ddc6480c5\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:53:07 crc kubenswrapper[5120]: I0316 16:53:07.534171 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3fd94d95-2cbb-4ec5-9413-1a2ddc6480c5-logs\") pod \"nova-metadata-0\" (UID: \"3fd94d95-2cbb-4ec5-9413-1a2ddc6480c5\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:53:07 crc kubenswrapper[5120]: I0316 16:53:07.534347 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3fd94d95-2cbb-4ec5-9413-1a2ddc6480c5-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"3fd94d95-2cbb-4ec5-9413-1a2ddc6480c5\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:53:07 crc kubenswrapper[5120]: I0316 16:53:07.534479 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79m59\" (UniqueName: \"kubernetes.io/projected/3fd94d95-2cbb-4ec5-9413-1a2ddc6480c5-kube-api-access-79m59\") pod \"nova-metadata-0\" (UID: \"3fd94d95-2cbb-4ec5-9413-1a2ddc6480c5\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:53:07 crc kubenswrapper[5120]: I0316 16:53:07.534778 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mtv52\" (UniqueName: \"kubernetes.io/projected/0fba253d-bef6-490a-8d34-6be75a260d03-kube-api-access-mtv52\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:07 crc kubenswrapper[5120]: I0316 16:53:07.534875 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0fba253d-bef6-490a-8d34-6be75a260d03-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:07 crc kubenswrapper[5120]: I0316 16:53:07.534945 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h5vll\" (UniqueName: \"kubernetes.io/projected/f1c9b873-c644-4c80-941e-3ec3415485e4-kube-api-access-h5vll\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:07 crc kubenswrapper[5120]: I0316 16:53:07.535004 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/26d7e714-e270-4150-9fc2-65e289bbd688-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:07 crc kubenswrapper[5120]: I0316 16:53:07.557535 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"b4ce877d-d510-483c-9a9c-b149879f1755","Type":"ContainerDied","Data":"106fb2580c007101a64c83a69eca8e3b40b701c863865cb199fda26045d46575"} Mar 16 16:53:07 crc kubenswrapper[5120]: I0316 16:53:07.571611 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="106fb2580c007101a64c83a69eca8e3b40b701c863865cb199fda26045d46575" Mar 16 16:53:07 crc kubenswrapper[5120]: I0316 16:53:07.593886 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0fba253d-bef6-490a-8d34-6be75a260d03-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "0fba253d-bef6-490a-8d34-6be75a260d03" (UID: "0fba253d-bef6-490a-8d34-6be75a260d03"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:07 crc kubenswrapper[5120]: I0316 16:53:07.603166 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f1c9b873-c644-4c80-941e-3ec3415485e4-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f1c9b873-c644-4c80-941e-3ec3415485e4" (UID: "f1c9b873-c644-4c80-941e-3ec3415485e4"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:07 crc kubenswrapper[5120]: I0316 16:53:07.622330 5120 generic.go:358] "Generic (PLEG): container finished" podID="607fee19-adac-44b4-9f70-a6f6f3e59aed" containerID="3e4d1b60e2bb40708ca0eb86088645db7b9870e10296a1eff67cb5ce00260ed7" exitCode=143 Mar 16 16:53:07 crc kubenswrapper[5120]: I0316 16:53:07.622465 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"607fee19-adac-44b4-9f70-a6f6f3e59aed","Type":"ContainerDied","Data":"3e4d1b60e2bb40708ca0eb86088645db7b9870e10296a1eff67cb5ce00260ed7"} Mar 16 16:53:07 crc kubenswrapper[5120]: I0316 16:53:07.637071 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3fd94d95-2cbb-4ec5-9413-1a2ddc6480c5-logs\") pod \"nova-metadata-0\" (UID: \"3fd94d95-2cbb-4ec5-9413-1a2ddc6480c5\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:53:07 crc kubenswrapper[5120]: I0316 16:53:07.638220 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3fd94d95-2cbb-4ec5-9413-1a2ddc6480c5-logs\") pod \"nova-metadata-0\" (UID: \"3fd94d95-2cbb-4ec5-9413-1a2ddc6480c5\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:53:07 crc kubenswrapper[5120]: I0316 16:53:07.642371 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3fd94d95-2cbb-4ec5-9413-1a2ddc6480c5-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"3fd94d95-2cbb-4ec5-9413-1a2ddc6480c5\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:53:07 crc kubenswrapper[5120]: I0316 16:53:07.642477 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-79m59\" (UniqueName: \"kubernetes.io/projected/3fd94d95-2cbb-4ec5-9413-1a2ddc6480c5-kube-api-access-79m59\") pod \"nova-metadata-0\" (UID: \"3fd94d95-2cbb-4ec5-9413-1a2ddc6480c5\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:53:07 crc kubenswrapper[5120]: I0316 16:53:07.642908 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3fd94d95-2cbb-4ec5-9413-1a2ddc6480c5-config-data\") pod \"nova-metadata-0\" (UID: \"3fd94d95-2cbb-4ec5-9413-1a2ddc6480c5\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:53:07 crc kubenswrapper[5120]: I0316 16:53:07.643164 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/3fd94d95-2cbb-4ec5-9413-1a2ddc6480c5-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"3fd94d95-2cbb-4ec5-9413-1a2ddc6480c5\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:53:07 crc kubenswrapper[5120]: I0316 16:53:07.643260 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0fba253d-bef6-490a-8d34-6be75a260d03-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:07 crc kubenswrapper[5120]: I0316 16:53:07.643273 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f1c9b873-c644-4c80-941e-3ec3415485e4-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:07 crc kubenswrapper[5120]: I0316 16:53:07.653731 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3fd94d95-2cbb-4ec5-9413-1a2ddc6480c5-config-data\") pod \"nova-metadata-0\" (UID: \"3fd94d95-2cbb-4ec5-9413-1a2ddc6480c5\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:53:07 crc kubenswrapper[5120]: I0316 16:53:07.686707 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3fd94d95-2cbb-4ec5-9413-1a2ddc6480c5-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"3fd94d95-2cbb-4ec5-9413-1a2ddc6480c5\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:53:07 crc kubenswrapper[5120]: I0316 16:53:07.695205 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/3fd94d95-2cbb-4ec5-9413-1a2ddc6480c5-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"3fd94d95-2cbb-4ec5-9413-1a2ddc6480c5\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:53:07 crc kubenswrapper[5120]: I0316 16:53:07.702692 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0fba253d-bef6-490a-8d34-6be75a260d03-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "0fba253d-bef6-490a-8d34-6be75a260d03" (UID: "0fba253d-bef6-490a-8d34-6be75a260d03"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:07 crc kubenswrapper[5120]: I0316 16:53:07.703191 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-79m59\" (UniqueName: \"kubernetes.io/projected/3fd94d95-2cbb-4ec5-9413-1a2ddc6480c5-kube-api-access-79m59\") pod \"nova-metadata-0\" (UID: \"3fd94d95-2cbb-4ec5-9413-1a2ddc6480c5\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:53:07 crc kubenswrapper[5120]: I0316 16:53:07.703570 5120 generic.go:358] "Generic (PLEG): container finished" podID="50c82211-4383-41cb-a31c-9bdfb156b586" containerID="423900fcfc665a7c0642a3969b0d45a290a37855935f76532dcda5ffb9c954cc" exitCode=143 Mar 16 16:53:07 crc kubenswrapper[5120]: I0316 16:53:07.703821 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:53:07 crc kubenswrapper[5120]: I0316 16:53:07.703961 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"50c82211-4383-41cb-a31c-9bdfb156b586","Type":"ContainerDied","Data":"423900fcfc665a7c0642a3969b0d45a290a37855935f76532dcda5ffb9c954cc"} Mar 16 16:53:07 crc kubenswrapper[5120]: I0316 16:53:07.704158 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:53:07 crc kubenswrapper[5120]: I0316 16:53:07.704502 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:53:07 crc kubenswrapper[5120]: I0316 16:53:07.778879 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:53:07 crc kubenswrapper[5120]: I0316 16:53:07.780846 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/0fba253d-bef6-490a-8d34-6be75a260d03-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:07 crc kubenswrapper[5120]: I0316 16:53:07.859409 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:53:07 crc kubenswrapper[5120]: I0316 16:53:07.875162 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openstack-kuttl-tests/barbican-api-7f78b864cb-6dgjh" podUID="c06f24f9-95b0-4a92-ad3a-6075764151ed" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.0.133:9311/healthcheck\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Mar 16 16:53:07 crc kubenswrapper[5120]: I0316 16:53:07.879971 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:53:07 crc kubenswrapper[5120]: I0316 16:53:07.888622 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/b4ce877d-d510-483c-9a9c-b149879f1755-internal-tls-certs\") pod \"b4ce877d-d510-483c-9a9c-b149879f1755\" (UID: \"b4ce877d-d510-483c-9a9c-b149879f1755\") " Mar 16 16:53:07 crc kubenswrapper[5120]: I0316 16:53:07.888704 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b4ce877d-d510-483c-9a9c-b149879f1755-config-data\") pod \"b4ce877d-d510-483c-9a9c-b149879f1755\" (UID: \"b4ce877d-d510-483c-9a9c-b149879f1755\") " Mar 16 16:53:07 crc kubenswrapper[5120]: I0316 16:53:07.889058 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b4ce877d-d510-483c-9a9c-b149879f1755-combined-ca-bundle\") pod \"b4ce877d-d510-483c-9a9c-b149879f1755\" (UID: \"b4ce877d-d510-483c-9a9c-b149879f1755\") " Mar 16 16:53:07 crc kubenswrapper[5120]: I0316 16:53:07.889273 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b4ce877d-d510-483c-9a9c-b149879f1755-scripts\") pod \"b4ce877d-d510-483c-9a9c-b149879f1755\" (UID: \"b4ce877d-d510-483c-9a9c-b149879f1755\") " Mar 16 16:53:07 crc kubenswrapper[5120]: I0316 16:53:07.889335 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/b4ce877d-d510-483c-9a9c-b149879f1755-config-data-custom\") pod \"b4ce877d-d510-483c-9a9c-b149879f1755\" (UID: \"b4ce877d-d510-483c-9a9c-b149879f1755\") " Mar 16 16:53:07 crc kubenswrapper[5120]: I0316 16:53:07.889455 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b4ce877d-d510-483c-9a9c-b149879f1755-logs\") pod \"b4ce877d-d510-483c-9a9c-b149879f1755\" (UID: \"b4ce877d-d510-483c-9a9c-b149879f1755\") " Mar 16 16:53:07 crc kubenswrapper[5120]: I0316 16:53:07.889833 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/b4ce877d-d510-483c-9a9c-b149879f1755-public-tls-certs\") pod \"b4ce877d-d510-483c-9a9c-b149879f1755\" (UID: \"b4ce877d-d510-483c-9a9c-b149879f1755\") " Mar 16 16:53:07 crc kubenswrapper[5120]: I0316 16:53:07.890065 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6bf6s\" (UniqueName: \"kubernetes.io/projected/b4ce877d-d510-483c-9a9c-b149879f1755-kube-api-access-6bf6s\") pod \"b4ce877d-d510-483c-9a9c-b149879f1755\" (UID: \"b4ce877d-d510-483c-9a9c-b149879f1755\") " Mar 16 16:53:07 crc kubenswrapper[5120]: I0316 16:53:07.890135 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/b4ce877d-d510-483c-9a9c-b149879f1755-etc-machine-id\") pod \"b4ce877d-d510-483c-9a9c-b149879f1755\" (UID: \"b4ce877d-d510-483c-9a9c-b149879f1755\") " Mar 16 16:53:07 crc kubenswrapper[5120]: I0316 16:53:07.900660 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/b4ce877d-d510-483c-9a9c-b149879f1755-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "b4ce877d-d510-483c-9a9c-b149879f1755" (UID: "b4ce877d-d510-483c-9a9c-b149879f1755"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 16:53:07 crc kubenswrapper[5120]: I0316 16:53:07.900925 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4ce877d-d510-483c-9a9c-b149879f1755-logs" (OuterVolumeSpecName: "logs") pod "b4ce877d-d510-483c-9a9c-b149879f1755" (UID: "b4ce877d-d510-483c-9a9c-b149879f1755"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:53:07 crc kubenswrapper[5120]: I0316 16:53:07.905827 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:53:07 crc kubenswrapper[5120]: I0316 16:53:07.910418 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f1c9b873-c644-4c80-941e-3ec3415485e4-config-data" (OuterVolumeSpecName: "config-data") pod "f1c9b873-c644-4c80-941e-3ec3415485e4" (UID: "f1c9b873-c644-4c80-941e-3ec3415485e4"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:07 crc kubenswrapper[5120]: I0316 16:53:07.918212 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:53:07 crc kubenswrapper[5120]: I0316 16:53:07.946204 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4ce877d-d510-483c-9a9c-b149879f1755" containerName="cinder-api" Mar 16 16:53:07 crc kubenswrapper[5120]: I0316 16:53:07.946238 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4ce877d-d510-483c-9a9c-b149879f1755" containerName="cinder-api" Mar 16 16:53:07 crc kubenswrapper[5120]: I0316 16:53:07.946260 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0fba253d-bef6-490a-8d34-6be75a260d03" containerName="nova-api-api" Mar 16 16:53:07 crc kubenswrapper[5120]: I0316 16:53:07.946269 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="0fba253d-bef6-490a-8d34-6be75a260d03" containerName="nova-api-api" Mar 16 16:53:07 crc kubenswrapper[5120]: I0316 16:53:07.946295 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4ce877d-d510-483c-9a9c-b149879f1755" containerName="cinder-api-log" Mar 16 16:53:07 crc kubenswrapper[5120]: I0316 16:53:07.946302 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4ce877d-d510-483c-9a9c-b149879f1755" containerName="cinder-api-log" Mar 16 16:53:07 crc kubenswrapper[5120]: I0316 16:53:07.946314 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0fba253d-bef6-490a-8d34-6be75a260d03" containerName="nova-api-log" Mar 16 16:53:07 crc kubenswrapper[5120]: I0316 16:53:07.946320 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="0fba253d-bef6-490a-8d34-6be75a260d03" containerName="nova-api-log" Mar 16 16:53:07 crc kubenswrapper[5120]: I0316 16:53:07.946559 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="0fba253d-bef6-490a-8d34-6be75a260d03" containerName="nova-api-log" Mar 16 16:53:07 crc kubenswrapper[5120]: I0316 16:53:07.946576 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="b4ce877d-d510-483c-9a9c-b149879f1755" containerName="cinder-api-log" Mar 16 16:53:07 crc kubenswrapper[5120]: I0316 16:53:07.946593 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="b4ce877d-d510-483c-9a9c-b149879f1755" containerName="cinder-api" Mar 16 16:53:07 crc kubenswrapper[5120]: I0316 16:53:07.946606 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="0fba253d-bef6-490a-8d34-6be75a260d03" containerName="nova-api-api" Mar 16 16:53:07 crc kubenswrapper[5120]: I0316 16:53:07.922992 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0fba253d-bef6-490a-8d34-6be75a260d03-config-data" (OuterVolumeSpecName: "config-data") pod "0fba253d-bef6-490a-8d34-6be75a260d03" (UID: "0fba253d-bef6-490a-8d34-6be75a260d03"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:07 crc kubenswrapper[5120]: I0316 16:53:07.971661 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b4ce877d-d510-483c-9a9c-b149879f1755-scripts" (OuterVolumeSpecName: "scripts") pod "b4ce877d-d510-483c-9a9c-b149879f1755" (UID: "b4ce877d-d510-483c-9a9c-b149879f1755"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:07 crc kubenswrapper[5120]: I0316 16:53:07.971775 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b4ce877d-d510-483c-9a9c-b149879f1755-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "b4ce877d-d510-483c-9a9c-b149879f1755" (UID: "b4ce877d-d510-483c-9a9c-b149879f1755"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:07 crc kubenswrapper[5120]: I0316 16:53:07.971816 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4ce877d-d510-483c-9a9c-b149879f1755-kube-api-access-6bf6s" (OuterVolumeSpecName: "kube-api-access-6bf6s") pod "b4ce877d-d510-483c-9a9c-b149879f1755" (UID: "b4ce877d-d510-483c-9a9c-b149879f1755"). InnerVolumeSpecName "kube-api-access-6bf6s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:53:07 crc kubenswrapper[5120]: I0316 16:53:07.982938 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:53:07 crc kubenswrapper[5120]: I0316 16:53:07.983091 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:53:07 crc kubenswrapper[5120]: I0316 16:53:07.987029 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-conductor-config-data\"" Mar 16 16:53:08 crc kubenswrapper[5120]: I0316 16:53:08.023528 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdz95\" (UniqueName: \"kubernetes.io/projected/9c42ca14-5afb-4688-a2cf-ddf314020f18-kube-api-access-mdz95\") pod \"nova-cell0-conductor-0\" (UID: \"9c42ca14-5afb-4688-a2cf-ddf314020f18\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:53:08 crc kubenswrapper[5120]: I0316 16:53:08.023814 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9c42ca14-5afb-4688-a2cf-ddf314020f18-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"9c42ca14-5afb-4688-a2cf-ddf314020f18\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:53:08 crc kubenswrapper[5120]: I0316 16:53:08.023881 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9c42ca14-5afb-4688-a2cf-ddf314020f18-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"9c42ca14-5afb-4688-a2cf-ddf314020f18\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:53:08 crc kubenswrapper[5120]: I0316 16:53:08.025392 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b4ce877d-d510-483c-9a9c-b149879f1755-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:08 crc kubenswrapper[5120]: I0316 16:53:08.026530 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6bf6s\" (UniqueName: \"kubernetes.io/projected/b4ce877d-d510-483c-9a9c-b149879f1755-kube-api-access-6bf6s\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:08 crc kubenswrapper[5120]: I0316 16:53:08.026597 5120 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/b4ce877d-d510-483c-9a9c-b149879f1755-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:08 crc kubenswrapper[5120]: I0316 16:53:08.026609 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f1c9b873-c644-4c80-941e-3ec3415485e4-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:08 crc kubenswrapper[5120]: I0316 16:53:08.026618 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0fba253d-bef6-490a-8d34-6be75a260d03-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:08 crc kubenswrapper[5120]: I0316 16:53:08.026627 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b4ce877d-d510-483c-9a9c-b149879f1755-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:08 crc kubenswrapper[5120]: I0316 16:53:08.026636 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/b4ce877d-d510-483c-9a9c-b149879f1755-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:08 crc kubenswrapper[5120]: I0316 16:53:08.128337 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mdz95\" (UniqueName: \"kubernetes.io/projected/9c42ca14-5afb-4688-a2cf-ddf314020f18-kube-api-access-mdz95\") pod \"nova-cell0-conductor-0\" (UID: \"9c42ca14-5afb-4688-a2cf-ddf314020f18\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:53:08 crc kubenswrapper[5120]: I0316 16:53:08.128494 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9c42ca14-5afb-4688-a2cf-ddf314020f18-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"9c42ca14-5afb-4688-a2cf-ddf314020f18\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:53:08 crc kubenswrapper[5120]: I0316 16:53:08.128538 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9c42ca14-5afb-4688-a2cf-ddf314020f18-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"9c42ca14-5afb-4688-a2cf-ddf314020f18\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:53:08 crc kubenswrapper[5120]: I0316 16:53:08.158992 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9c42ca14-5afb-4688-a2cf-ddf314020f18-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"9c42ca14-5afb-4688-a2cf-ddf314020f18\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:53:08 crc kubenswrapper[5120]: I0316 16:53:08.159715 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9c42ca14-5afb-4688-a2cf-ddf314020f18-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"9c42ca14-5afb-4688-a2cf-ddf314020f18\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:53:08 crc kubenswrapper[5120]: I0316 16:53:08.175019 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdz95\" (UniqueName: \"kubernetes.io/projected/9c42ca14-5afb-4688-a2cf-ddf314020f18-kube-api-access-mdz95\") pod \"nova-cell0-conductor-0\" (UID: \"9c42ca14-5afb-4688-a2cf-ddf314020f18\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:53:08 crc kubenswrapper[5120]: I0316 16:53:08.314931 5120 scope.go:117] "RemoveContainer" containerID="cf6722e84e6785147486fa7c4a8c54e8644b345caa23fda210801539c7018124" Mar 16 16:53:08 crc kubenswrapper[5120]: I0316 16:53:08.336996 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0fba253d-bef6-490a-8d34-6be75a260d03-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "0fba253d-bef6-490a-8d34-6be75a260d03" (UID: "0fba253d-bef6-490a-8d34-6be75a260d03"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:08 crc kubenswrapper[5120]: I0316 16:53:08.346533 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/0fba253d-bef6-490a-8d34-6be75a260d03-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:08 crc kubenswrapper[5120]: I0316 16:53:08.694810 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="26d7e714-e270-4150-9fc2-65e289bbd688" path="/var/lib/kubelet/pods/26d7e714-e270-4150-9fc2-65e289bbd688/volumes" Mar 16 16:53:08 crc kubenswrapper[5120]: I0316 16:53:08.695634 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="77e38408-57df-40be-95a1-64f61218c305" path="/var/lib/kubelet/pods/77e38408-57df-40be-95a1-64f61218c305/volumes" Mar 16 16:53:08 crc kubenswrapper[5120]: I0316 16:53:08.879878 5120 generic.go:358] "Generic (PLEG): container finished" podID="ffa2d14d-1b44-445b-ab47-1bb134223111" containerID="c1dd20bf9d5fa639b2879a8a31ac5f271715ba78f8066f88de902d4b35a4ff21" exitCode=0 Mar 16 16:53:08 crc kubenswrapper[5120]: I0316 16:53:08.903735 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-northd-0_72edd543-4bf8-407e-9929-47d4e9727134/ovn-northd/0.log" Mar 16 16:53:08 crc kubenswrapper[5120]: I0316 16:53:08.903811 5120 generic.go:358] "Generic (PLEG): container finished" podID="72edd543-4bf8-407e-9929-47d4e9727134" containerID="dff05d001161dd73ee301824319b7393ecaf3fe56d375faa6a317018e3fee33b" exitCode=139 Mar 16 16:53:08 crc kubenswrapper[5120]: I0316 16:53:08.928310 5120 generic.go:358] "Generic (PLEG): container finished" podID="607fee19-adac-44b4-9f70-a6f6f3e59aed" containerID="eb2716296f9c5287a1ca3bce2395180fac10d428f3a9c4a1dd20632f18669519" exitCode=0 Mar 16 16:53:08 crc kubenswrapper[5120]: I0316 16:53:08.957304 5120 generic.go:358] "Generic (PLEG): container finished" podID="50c82211-4383-41cb-a31c-9bdfb156b586" containerID="09f299b5d93c37d9587b3d1ab480436df43aab9b13b697336b90e9551005ece5" exitCode=0 Mar 16 16:53:08 crc kubenswrapper[5120]: I0316 16:53:08.995221 5120 generic.go:358] "Generic (PLEG): container finished" podID="e7bf94ef-c84b-45ee-a2d9-dd048b1172e3" containerID="ca2994fb2295e6ee68175a99f1d2c7df1947a5932c1ee255c1044ea488131472" exitCode=0 Mar 16 16:53:09 crc kubenswrapper[5120]: I0316 16:53:09.062360 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:53:09 crc kubenswrapper[5120]: W0316 16:53:09.344108 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3fd94d95_2cbb_4ec5_9413_1a2ddc6480c5.slice/crio-e489e838ccecb7288819a101ff332dc7e84a8c0684631af83eb9b9799a5f1841 WatchSource:0}: Error finding container e489e838ccecb7288819a101ff332dc7e84a8c0684631af83eb9b9799a5f1841: Status 404 returned error can't find the container with id e489e838ccecb7288819a101ff332dc7e84a8c0684631af83eb9b9799a5f1841 Mar 16 16:53:09 crc kubenswrapper[5120]: I0316 16:53:09.466529 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b4ce877d-d510-483c-9a9c-b149879f1755-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "b4ce877d-d510-483c-9a9c-b149879f1755" (UID: "b4ce877d-d510-483c-9a9c-b149879f1755"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:09 crc kubenswrapper[5120]: I0316 16:53:09.505899 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b4ce877d-d510-483c-9a9c-b149879f1755-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:09 crc kubenswrapper[5120]: I0316 16:53:09.546985 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b4ce877d-d510-483c-9a9c-b149879f1755-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "b4ce877d-d510-483c-9a9c-b149879f1755" (UID: "b4ce877d-d510-483c-9a9c-b149879f1755"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:09 crc kubenswrapper[5120]: I0316 16:53:09.559159 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b4ce877d-d510-483c-9a9c-b149879f1755-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "b4ce877d-d510-483c-9a9c-b149879f1755" (UID: "b4ce877d-d510-483c-9a9c-b149879f1755"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:09 crc kubenswrapper[5120]: I0316 16:53:09.629547 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/b4ce877d-d510-483c-9a9c-b149879f1755-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:09 crc kubenswrapper[5120]: I0316 16:53:09.630421 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/b4ce877d-d510-483c-9a9c-b149879f1755-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:09 crc kubenswrapper[5120]: I0316 16:53:09.668044 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b4ce877d-d510-483c-9a9c-b149879f1755-config-data" (OuterVolumeSpecName: "config-data") pod "b4ce877d-d510-483c-9a9c-b149879f1755" (UID: "b4ce877d-d510-483c-9a9c-b149879f1755"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:09 crc kubenswrapper[5120]: I0316 16:53:09.736535 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b4ce877d-d510-483c-9a9c-b149879f1755-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:09 crc kubenswrapper[5120]: I0316 16:53:09.949167 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:53:09 crc kubenswrapper[5120]: E0316 16:53:09.956258 5120 kubelet.go:2642] "Housekeeping took longer than expected" err="housekeeping took too long" expected="1s" actual="1.292s" Mar 16 16:53:09 crc kubenswrapper[5120]: I0316 16:53:09.956305 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"32963b23-d87d-4107-9a13-32737c586ab3","Type":"ContainerStarted","Data":"8255a8dd841a9b7e8d1b59806b937aaa4fdc84daf4b743c2df720b34b3c55d87"} Mar 16 16:53:09 crc kubenswrapper[5120]: I0316 16:53:09.956410 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-57f7845c4b-tb6nd" event={"ID":"ffa2d14d-1b44-445b-ab47-1bb134223111","Type":"ContainerDied","Data":"c1dd20bf9d5fa639b2879a8a31ac5f271715ba78f8066f88de902d4b35a4ff21"} Mar 16 16:53:09 crc kubenswrapper[5120]: I0316 16:53:09.956432 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-84f95d87c8-s7s4d" event={"ID":"3853023d-8cc5-42de-9f91-d0609e3fe565","Type":"ContainerStarted","Data":"b9a2caba30341e48505a6ea01cdbdafc0cb59a73dd5f7b97f33e4a17575eabb8"} Mar 16 16:53:09 crc kubenswrapper[5120]: I0316 16:53:09.956446 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"72edd543-4bf8-407e-9929-47d4e9727134","Type":"ContainerDied","Data":"dff05d001161dd73ee301824319b7393ecaf3fe56d375faa6a317018e3fee33b"} Mar 16 16:53:09 crc kubenswrapper[5120]: I0316 16:53:09.956655 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"72edd543-4bf8-407e-9929-47d4e9727134","Type":"ContainerDied","Data":"7816c29183fb7097d4d22872253ba868dcbcd6a242a3b1c65c60c010d1c13774"} Mar 16 16:53:09 crc kubenswrapper[5120]: I0316 16:53:09.956665 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7816c29183fb7097d4d22872253ba868dcbcd6a242a3b1c65c60c010d1c13774" Mar 16 16:53:09 crc kubenswrapper[5120]: I0316 16:53:09.956677 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"607fee19-adac-44b4-9f70-a6f6f3e59aed","Type":"ContainerDied","Data":"eb2716296f9c5287a1ca3bce2395180fac10d428f3a9c4a1dd20632f18669519"} Mar 16 16:53:09 crc kubenswrapper[5120]: I0316 16:53:09.956690 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"607fee19-adac-44b4-9f70-a6f6f3e59aed","Type":"ContainerDied","Data":"8e7710e79f9090a4bc7c1041c56739c41ba1c4c8d5f71fddc3d32723f2be0e0e"} Mar 16 16:53:09 crc kubenswrapper[5120]: I0316 16:53:09.956700 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8e7710e79f9090a4bc7c1041c56739c41ba1c4c8d5f71fddc3d32723f2be0e0e" Mar 16 16:53:09 crc kubenswrapper[5120]: I0316 16:53:09.956720 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"50c82211-4383-41cb-a31c-9bdfb156b586","Type":"ContainerDied","Data":"09f299b5d93c37d9587b3d1ab480436df43aab9b13b697336b90e9551005ece5"} Mar 16 16:53:09 crc kubenswrapper[5120]: I0316 16:53:09.956779 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-7f78b864cb-6dgjh"] Mar 16 16:53:09 crc kubenswrapper[5120]: I0316 16:53:09.956801 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-9t866" event={"ID":"e7bf94ef-c84b-45ee-a2d9-dd048b1172e3","Type":"ContainerDied","Data":"ca2994fb2295e6ee68175a99f1d2c7df1947a5932c1ee255c1044ea488131472"} Mar 16 16:53:09 crc kubenswrapper[5120]: I0316 16:53:09.956815 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-api-5fd9d6b8f6-vq7wb"] Mar 16 16:53:09 crc kubenswrapper[5120]: I0316 16:53:09.964657 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"0d9062d0-d8bb-4ab3-b2c5-33fa78833a65","Type":"ContainerStarted","Data":"a01ee0b65bd51a1ae5744353a31cd6d57349aa7e7a9b8915b7f6de317ee1a034"} Mar 16 16:53:09 crc kubenswrapper[5120]: I0316 16:53:09.964696 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-5fd9d6b8f6-vq7wb"] Mar 16 16:53:09 crc kubenswrapper[5120]: I0316 16:53:09.964714 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-7555689c4b-84shq" event={"ID":"e5acac7f-9646-4be1-ac22-31326296e4de","Type":"ContainerStarted","Data":"db52ff3476db6cd59c6777eccc858aa2bfbf71202ed0fd58d0a238530b9853c7"} Mar 16 16:53:09 crc kubenswrapper[5120]: I0316 16:53:09.964728 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:53:09 crc kubenswrapper[5120]: I0316 16:53:09.965113 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-5fd9d6b8f6-vq7wb" Mar 16 16:53:09 crc kubenswrapper[5120]: I0316 16:53:09.966018 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-7f78b864cb-6dgjh" podUID="c06f24f9-95b0-4a92-ad3a-6075764151ed" containerName="barbican-api-log" containerID="cri-o://7bbf1614038d4b969b640c6c4529cfbe2dbb4d18e62926c0ea76ab02c22db36b" gracePeriod=30 Mar 16 16:53:09 crc kubenswrapper[5120]: I0316 16:53:09.966166 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-7f78b864cb-6dgjh" podUID="c06f24f9-95b0-4a92-ad3a-6075764151ed" containerName="barbican-api" containerID="cri-o://5ca55cb347519b4334c3c6b37c431e0953788ca2ed0f3ca9ee1c934857dba490" gracePeriod=30 Mar 16 16:53:09 crc kubenswrapper[5120]: I0316 16:53:09.995728 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openstack-kuttl-tests/barbican-api-7f78b864cb-6dgjh" podUID="c06f24f9-95b0-4a92-ad3a-6075764151ed" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.0.133:9311/healthcheck\": EOF" Mar 16 16:53:09 crc kubenswrapper[5120]: I0316 16:53:09.996515 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-7f78b864cb-6dgjh" podUID="c06f24f9-95b0-4a92-ad3a-6075764151ed" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.0.133:9311/healthcheck\": EOF" Mar 16 16:53:09 crc kubenswrapper[5120]: I0316 16:53:09.997238 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-7f78b864cb-6dgjh" podUID="c06f24f9-95b0-4a92-ad3a-6075764151ed" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.0.133:9311/healthcheck\": EOF" Mar 16 16:53:10 crc kubenswrapper[5120]: I0316 16:53:10.003099 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openstack-kuttl-tests/barbican-api-7f78b864cb-6dgjh" podUID="c06f24f9-95b0-4a92-ad3a-6075764151ed" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.0.133:9311/healthcheck\": EOF" Mar 16 16:53:10 crc kubenswrapper[5120]: I0316 16:53:10.003199 5120 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openstack-kuttl-tests/barbican-api-7f78b864cb-6dgjh" Mar 16 16:53:10 crc kubenswrapper[5120]: I0316 16:53:10.018971 5120 scope.go:117] "RemoveContainer" containerID="07e36a960b4b0ff2c9a896db3032845779d0abb4605e926b1b1d6baa4a53ba03" Mar 16 16:53:10 crc kubenswrapper[5120]: I0316 16:53:10.049556 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstack-galera-0" podStartSLOduration=19.049533259 podStartE2EDuration="19.049533259s" podCreationTimestamp="2026-03-16 16:52:51 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:53:10.035927856 +0000 UTC m=+4892.189859513" watchObservedRunningTime="2026-03-16 16:53:10.049533259 +0000 UTC m=+4892.203464916" Mar 16 16:53:10 crc kubenswrapper[5120]: I0316 16:53:10.051702 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/cb37f123-034b-4ccb-9f71-676a322e2a8b-config-data-custom\") pod \"barbican-api-5fd9d6b8f6-vq7wb\" (UID: \"cb37f123-034b-4ccb-9f71-676a322e2a8b\") " pod="openstack-kuttl-tests/barbican-api-5fd9d6b8f6-vq7wb" Mar 16 16:53:10 crc kubenswrapper[5120]: I0316 16:53:10.051782 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/cb37f123-034b-4ccb-9f71-676a322e2a8b-public-tls-certs\") pod \"barbican-api-5fd9d6b8f6-vq7wb\" (UID: \"cb37f123-034b-4ccb-9f71-676a322e2a8b\") " pod="openstack-kuttl-tests/barbican-api-5fd9d6b8f6-vq7wb" Mar 16 16:53:10 crc kubenswrapper[5120]: I0316 16:53:10.051863 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cb37f123-034b-4ccb-9f71-676a322e2a8b-config-data\") pod \"barbican-api-5fd9d6b8f6-vq7wb\" (UID: \"cb37f123-034b-4ccb-9f71-676a322e2a8b\") " pod="openstack-kuttl-tests/barbican-api-5fd9d6b8f6-vq7wb" Mar 16 16:53:10 crc kubenswrapper[5120]: I0316 16:53:10.051973 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/cb37f123-034b-4ccb-9f71-676a322e2a8b-internal-tls-certs\") pod \"barbican-api-5fd9d6b8f6-vq7wb\" (UID: \"cb37f123-034b-4ccb-9f71-676a322e2a8b\") " pod="openstack-kuttl-tests/barbican-api-5fd9d6b8f6-vq7wb" Mar 16 16:53:10 crc kubenswrapper[5120]: I0316 16:53:10.053464 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/cb37f123-034b-4ccb-9f71-676a322e2a8b-logs\") pod \"barbican-api-5fd9d6b8f6-vq7wb\" (UID: \"cb37f123-034b-4ccb-9f71-676a322e2a8b\") " pod="openstack-kuttl-tests/barbican-api-5fd9d6b8f6-vq7wb" Mar 16 16:53:10 crc kubenswrapper[5120]: I0316 16:53:10.140328 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cb37f123-034b-4ccb-9f71-676a322e2a8b-combined-ca-bundle\") pod \"barbican-api-5fd9d6b8f6-vq7wb\" (UID: \"cb37f123-034b-4ccb-9f71-676a322e2a8b\") " pod="openstack-kuttl-tests/barbican-api-5fd9d6b8f6-vq7wb" Mar 16 16:53:10 crc kubenswrapper[5120]: I0316 16:53:10.140504 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4r95\" (UniqueName: \"kubernetes.io/projected/cb37f123-034b-4ccb-9f71-676a322e2a8b-kube-api-access-r4r95\") pod \"barbican-api-5fd9d6b8f6-vq7wb\" (UID: \"cb37f123-034b-4ccb-9f71-676a322e2a8b\") " pod="openstack-kuttl-tests/barbican-api-5fd9d6b8f6-vq7wb" Mar 16 16:53:10 crc kubenswrapper[5120]: I0316 16:53:10.162462 5120 generic.go:358] "Generic (PLEG): container finished" podID="c06f24f9-95b0-4a92-ad3a-6075764151ed" containerID="7bbf1614038d4b969b640c6c4529cfbe2dbb4d18e62926c0ea76ab02c22db36b" exitCode=143 Mar 16 16:53:10 crc kubenswrapper[5120]: I0316 16:53:10.162640 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-7f78b864cb-6dgjh" event={"ID":"c06f24f9-95b0-4a92-ad3a-6075764151ed","Type":"ContainerDied","Data":"7bbf1614038d4b969b640c6c4529cfbe2dbb4d18e62926c0ea76ab02c22db36b"} Mar 16 16:53:10 crc kubenswrapper[5120]: I0316 16:53:10.168530 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-f56965744-skhtb" event={"ID":"4907839f-9071-4378-90f6-f92ced0b0bf0","Type":"ContainerStarted","Data":"2dfd289344b424c2a731001caf2fb6357db8afaf4bd8fe7f4af4a4e540466d5d"} Mar 16 16:53:10 crc kubenswrapper[5120]: I0316 16:53:10.174509 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-57f7845c4b-tb6nd" event={"ID":"ffa2d14d-1b44-445b-ab47-1bb134223111","Type":"ContainerDied","Data":"14163cd8360b3c73347f8b0c392c0ec0f73523533c85a6ad428afe07e0daabd6"} Mar 16 16:53:10 crc kubenswrapper[5120]: I0316 16:53:10.174543 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="14163cd8360b3c73347f8b0c392c0ec0f73523533c85a6ad428afe07e0daabd6" Mar 16 16:53:10 crc kubenswrapper[5120]: I0316 16:53:10.176486 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"3fd94d95-2cbb-4ec5-9413-1a2ddc6480c5","Type":"ContainerStarted","Data":"e489e838ccecb7288819a101ff332dc7e84a8c0684631af83eb9b9799a5f1841"} Mar 16 16:53:10 crc kubenswrapper[5120]: I0316 16:53:10.187558 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"5e1c9d08-874f-40cb-9837-5cfd2509c352","Type":"ContainerStarted","Data":"f314570a4d17cb896242fa890e6e2c5cde63f50249c5330dd067122e2196f485"} Mar 16 16:53:10 crc kubenswrapper[5120]: I0316 16:53:10.187637 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/memcached-0" Mar 16 16:53:10 crc kubenswrapper[5120]: I0316 16:53:10.197986 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"6792b2c6-f5cf-454a-858a-cbd4159db76a","Type":"ContainerStarted","Data":"80e2bda6dda2c8ad05b4c7384f2d187b58b6cdc73a7dd75783a0030f0515db21"} Mar 16 16:53:10 crc kubenswrapper[5120]: I0316 16:53:10.223344 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"dda14ac9-f9b1-4927-a4a4-147c5435906c","Type":"ContainerStarted","Data":"855d81c54b5a73dfb6e48b74a4cf1924e34cc373893fb720b9f3701b667bd089"} Mar 16 16:53:10 crc kubenswrapper[5120]: I0316 16:53:10.236184 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-c8fc658f4-sqwl6" event={"ID":"34e6ded3-dd6f-46bb-9d23-fa8724b78ace","Type":"ContainerStarted","Data":"41533c5d5556d3dc95717c5df3eb81b00a5d17695d07e9725bc580ce2a9acefb"} Mar 16 16:53:10 crc kubenswrapper[5120]: I0316 16:53:10.253256 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/cb37f123-034b-4ccb-9f71-676a322e2a8b-logs\") pod \"barbican-api-5fd9d6b8f6-vq7wb\" (UID: \"cb37f123-034b-4ccb-9f71-676a322e2a8b\") " pod="openstack-kuttl-tests/barbican-api-5fd9d6b8f6-vq7wb" Mar 16 16:53:10 crc kubenswrapper[5120]: I0316 16:53:10.253670 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cb37f123-034b-4ccb-9f71-676a322e2a8b-combined-ca-bundle\") pod \"barbican-api-5fd9d6b8f6-vq7wb\" (UID: \"cb37f123-034b-4ccb-9f71-676a322e2a8b\") " pod="openstack-kuttl-tests/barbican-api-5fd9d6b8f6-vq7wb" Mar 16 16:53:10 crc kubenswrapper[5120]: I0316 16:53:10.254688 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r4r95\" (UniqueName: \"kubernetes.io/projected/cb37f123-034b-4ccb-9f71-676a322e2a8b-kube-api-access-r4r95\") pod \"barbican-api-5fd9d6b8f6-vq7wb\" (UID: \"cb37f123-034b-4ccb-9f71-676a322e2a8b\") " pod="openstack-kuttl-tests/barbican-api-5fd9d6b8f6-vq7wb" Mar 16 16:53:10 crc kubenswrapper[5120]: I0316 16:53:10.257365 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/cb37f123-034b-4ccb-9f71-676a322e2a8b-config-data-custom\") pod \"barbican-api-5fd9d6b8f6-vq7wb\" (UID: \"cb37f123-034b-4ccb-9f71-676a322e2a8b\") " pod="openstack-kuttl-tests/barbican-api-5fd9d6b8f6-vq7wb" Mar 16 16:53:10 crc kubenswrapper[5120]: I0316 16:53:10.257405 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/cb37f123-034b-4ccb-9f71-676a322e2a8b-public-tls-certs\") pod \"barbican-api-5fd9d6b8f6-vq7wb\" (UID: \"cb37f123-034b-4ccb-9f71-676a322e2a8b\") " pod="openstack-kuttl-tests/barbican-api-5fd9d6b8f6-vq7wb" Mar 16 16:53:10 crc kubenswrapper[5120]: I0316 16:53:10.257471 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cb37f123-034b-4ccb-9f71-676a322e2a8b-config-data\") pod \"barbican-api-5fd9d6b8f6-vq7wb\" (UID: \"cb37f123-034b-4ccb-9f71-676a322e2a8b\") " pod="openstack-kuttl-tests/barbican-api-5fd9d6b8f6-vq7wb" Mar 16 16:53:10 crc kubenswrapper[5120]: I0316 16:53:10.257559 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/cb37f123-034b-4ccb-9f71-676a322e2a8b-internal-tls-certs\") pod \"barbican-api-5fd9d6b8f6-vq7wb\" (UID: \"cb37f123-034b-4ccb-9f71-676a322e2a8b\") " pod="openstack-kuttl-tests/barbican-api-5fd9d6b8f6-vq7wb" Mar 16 16:53:10 crc kubenswrapper[5120]: I0316 16:53:10.272602 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"50c82211-4383-41cb-a31c-9bdfb156b586","Type":"ContainerDied","Data":"21991810e78e02c4906f7d34a41a87570285929afef74ddaba7fe7f9d0ba84c0"} Mar 16 16:53:10 crc kubenswrapper[5120]: I0316 16:53:10.274769 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="21991810e78e02c4906f7d34a41a87570285929afef74ddaba7fe7f9d0ba84c0" Mar 16 16:53:10 crc kubenswrapper[5120]: I0316 16:53:10.273910 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/cb37f123-034b-4ccb-9f71-676a322e2a8b-logs\") pod \"barbican-api-5fd9d6b8f6-vq7wb\" (UID: \"cb37f123-034b-4ccb-9f71-676a322e2a8b\") " pod="openstack-kuttl-tests/barbican-api-5fd9d6b8f6-vq7wb" Mar 16 16:53:10 crc kubenswrapper[5120]: I0316 16:53:10.282520 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cb37f123-034b-4ccb-9f71-676a322e2a8b-combined-ca-bundle\") pod \"barbican-api-5fd9d6b8f6-vq7wb\" (UID: \"cb37f123-034b-4ccb-9f71-676a322e2a8b\") " pod="openstack-kuttl-tests/barbican-api-5fd9d6b8f6-vq7wb" Mar 16 16:53:10 crc kubenswrapper[5120]: I0316 16:53:10.283353 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/cb37f123-034b-4ccb-9f71-676a322e2a8b-public-tls-certs\") pod \"barbican-api-5fd9d6b8f6-vq7wb\" (UID: \"cb37f123-034b-4ccb-9f71-676a322e2a8b\") " pod="openstack-kuttl-tests/barbican-api-5fd9d6b8f6-vq7wb" Mar 16 16:53:10 crc kubenswrapper[5120]: I0316 16:53:10.285086 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/memcached-0" podStartSLOduration=7.284918661 podStartE2EDuration="7.284918661s" podCreationTimestamp="2026-03-16 16:53:03 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:53:10.214372361 +0000 UTC m=+4892.368304028" watchObservedRunningTime="2026-03-16 16:53:10.284918661 +0000 UTC m=+4892.438850318" Mar 16 16:53:10 crc kubenswrapper[5120]: I0316 16:53:10.293572 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/cb37f123-034b-4ccb-9f71-676a322e2a8b-config-data-custom\") pod \"barbican-api-5fd9d6b8f6-vq7wb\" (UID: \"cb37f123-034b-4ccb-9f71-676a322e2a8b\") " pod="openstack-kuttl-tests/barbican-api-5fd9d6b8f6-vq7wb" Mar 16 16:53:10 crc kubenswrapper[5120]: I0316 16:53:10.296141 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4r95\" (UniqueName: \"kubernetes.io/projected/cb37f123-034b-4ccb-9f71-676a322e2a8b-kube-api-access-r4r95\") pod \"barbican-api-5fd9d6b8f6-vq7wb\" (UID: \"cb37f123-034b-4ccb-9f71-676a322e2a8b\") " pod="openstack-kuttl-tests/barbican-api-5fd9d6b8f6-vq7wb" Mar 16 16:53:10 crc kubenswrapper[5120]: I0316 16:53:10.314302 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cb37f123-034b-4ccb-9f71-676a322e2a8b-config-data\") pod \"barbican-api-5fd9d6b8f6-vq7wb\" (UID: \"cb37f123-034b-4ccb-9f71-676a322e2a8b\") " pod="openstack-kuttl-tests/barbican-api-5fd9d6b8f6-vq7wb" Mar 16 16:53:10 crc kubenswrapper[5120]: I0316 16:53:10.321516 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/cb37f123-034b-4ccb-9f71-676a322e2a8b-internal-tls-certs\") pod \"barbican-api-5fd9d6b8f6-vq7wb\" (UID: \"cb37f123-034b-4ccb-9f71-676a322e2a8b\") " pod="openstack-kuttl-tests/barbican-api-5fd9d6b8f6-vq7wb" Mar 16 16:53:10 crc kubenswrapper[5120]: I0316 16:53:10.330135 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podStartSLOduration=12.330108128 podStartE2EDuration="12.330108128s" podCreationTimestamp="2026-03-16 16:52:58 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:53:10.265355546 +0000 UTC m=+4892.419287203" watchObservedRunningTime="2026-03-16 16:53:10.330108128 +0000 UTC m=+4892.484039785" Mar 16 16:53:10 crc kubenswrapper[5120]: I0316 16:53:10.366100 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podStartSLOduration=7.366081763 podStartE2EDuration="7.366081763s" podCreationTimestamp="2026-03-16 16:53:03 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:53:10.286276009 +0000 UTC m=+4892.440207666" watchObservedRunningTime="2026-03-16 16:53:10.366081763 +0000 UTC m=+4892.520013420" Mar 16 16:53:10 crc kubenswrapper[5120]: E0316 16:53:10.474645 5120 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf1c9b873_c644_4c80_941e_3ec3415485e4.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0fba253d_bef6_490a_8d34_6be75a260d03.slice/crio-1bd233aaa2d94cd74f7be91d0921d4d062bfd66e884b04a33ccb25506a7bdded\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podffa2d14d_1b44_445b_ab47_1bb134223111.slice/crio-conmon-c1dd20bf9d5fa639b2879a8a31ac5f271715ba78f8066f88de902d4b35a4ff21.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0fba253d_bef6_490a_8d34_6be75a260d03.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podffa2d14d_1b44_445b_ab47_1bb134223111.slice/crio-c1dd20bf9d5fa639b2879a8a31ac5f271715ba78f8066f88de902d4b35a4ff21.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7bf94ef_c84b_45ee_a2d9_dd048b1172e3.slice/crio-ca2994fb2295e6ee68175a99f1d2c7df1947a5932c1ee255c1044ea488131472.scope\": RecentStats: unable to find data in memory cache]" Mar 16 16:53:10 crc kubenswrapper[5120]: I0316 16:53:10.505301 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-northd-0_72edd543-4bf8-407e-9929-47d4e9727134/ovn-northd/0.log" Mar 16 16:53:10 crc kubenswrapper[5120]: I0316 16:53:10.505408 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:53:10 crc kubenswrapper[5120]: I0316 16:53:10.560638 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 16:53:10 crc kubenswrapper[5120]: I0316 16:53:10.568982 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/72edd543-4bf8-407e-9929-47d4e9727134-metrics-certs-tls-certs\") pod \"72edd543-4bf8-407e-9929-47d4e9727134\" (UID: \"72edd543-4bf8-407e-9929-47d4e9727134\") " Mar 16 16:53:10 crc kubenswrapper[5120]: I0316 16:53:10.569456 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/72edd543-4bf8-407e-9929-47d4e9727134-combined-ca-bundle\") pod \"72edd543-4bf8-407e-9929-47d4e9727134\" (UID: \"72edd543-4bf8-407e-9929-47d4e9727134\") " Mar 16 16:53:10 crc kubenswrapper[5120]: I0316 16:53:10.569800 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/72edd543-4bf8-407e-9929-47d4e9727134-ovn-rundir\") pod \"72edd543-4bf8-407e-9929-47d4e9727134\" (UID: \"72edd543-4bf8-407e-9929-47d4e9727134\") " Mar 16 16:53:10 crc kubenswrapper[5120]: I0316 16:53:10.570050 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/72edd543-4bf8-407e-9929-47d4e9727134-config\") pod \"72edd543-4bf8-407e-9929-47d4e9727134\" (UID: \"72edd543-4bf8-407e-9929-47d4e9727134\") " Mar 16 16:53:10 crc kubenswrapper[5120]: I0316 16:53:10.570089 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2pfcp\" (UniqueName: \"kubernetes.io/projected/72edd543-4bf8-407e-9929-47d4e9727134-kube-api-access-2pfcp\") pod \"72edd543-4bf8-407e-9929-47d4e9727134\" (UID: \"72edd543-4bf8-407e-9929-47d4e9727134\") " Mar 16 16:53:10 crc kubenswrapper[5120]: I0316 16:53:10.570154 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/72edd543-4bf8-407e-9929-47d4e9727134-ovn-northd-tls-certs\") pod \"72edd543-4bf8-407e-9929-47d4e9727134\" (UID: \"72edd543-4bf8-407e-9929-47d4e9727134\") " Mar 16 16:53:10 crc kubenswrapper[5120]: I0316 16:53:10.570179 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/72edd543-4bf8-407e-9929-47d4e9727134-scripts\") pod \"72edd543-4bf8-407e-9929-47d4e9727134\" (UID: \"72edd543-4bf8-407e-9929-47d4e9727134\") " Mar 16 16:53:10 crc kubenswrapper[5120]: I0316 16:53:10.570549 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72edd543-4bf8-407e-9929-47d4e9727134-ovn-rundir" (OuterVolumeSpecName: "ovn-rundir") pod "72edd543-4bf8-407e-9929-47d4e9727134" (UID: "72edd543-4bf8-407e-9929-47d4e9727134"). InnerVolumeSpecName "ovn-rundir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:53:10 crc kubenswrapper[5120]: I0316 16:53:10.573893 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/72edd543-4bf8-407e-9929-47d4e9727134-config" (OuterVolumeSpecName: "config") pod "72edd543-4bf8-407e-9929-47d4e9727134" (UID: "72edd543-4bf8-407e-9929-47d4e9727134"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:53:10 crc kubenswrapper[5120]: I0316 16:53:10.574509 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/72edd543-4bf8-407e-9929-47d4e9727134-scripts" (OuterVolumeSpecName: "scripts") pod "72edd543-4bf8-407e-9929-47d4e9727134" (UID: "72edd543-4bf8-407e-9929-47d4e9727134"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:53:10 crc kubenswrapper[5120]: I0316 16:53:10.575376 5120 reconciler_common.go:299] "Volume detached for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/72edd543-4bf8-407e-9929-47d4e9727134-ovn-rundir\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:10 crc kubenswrapper[5120]: I0316 16:53:10.575405 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/72edd543-4bf8-407e-9929-47d4e9727134-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:10 crc kubenswrapper[5120]: I0316 16:53:10.575414 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/72edd543-4bf8-407e-9929-47d4e9727134-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:10 crc kubenswrapper[5120]: I0316 16:53:10.624825 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:53:10 crc kubenswrapper[5120]: I0316 16:53:10.637663 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 16:53:10 crc kubenswrapper[5120]: I0316 16:53:10.657525 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72edd543-4bf8-407e-9929-47d4e9727134-kube-api-access-2pfcp" (OuterVolumeSpecName: "kube-api-access-2pfcp") pod "72edd543-4bf8-407e-9929-47d4e9727134" (UID: "72edd543-4bf8-407e-9929-47d4e9727134"). InnerVolumeSpecName "kube-api-access-2pfcp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:53:10 crc kubenswrapper[5120]: I0316 16:53:10.664098 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-5fd9d6b8f6-vq7wb"] Mar 16 16:53:10 crc kubenswrapper[5120]: I0316 16:53:10.678024 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jvfzn\" (UniqueName: \"kubernetes.io/projected/607fee19-adac-44b4-9f70-a6f6f3e59aed-kube-api-access-jvfzn\") pod \"607fee19-adac-44b4-9f70-a6f6f3e59aed\" (UID: \"607fee19-adac-44b4-9f70-a6f6f3e59aed\") " Mar 16 16:53:10 crc kubenswrapper[5120]: I0316 16:53:10.678128 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/607fee19-adac-44b4-9f70-a6f6f3e59aed-httpd-run\") pod \"607fee19-adac-44b4-9f70-a6f6f3e59aed\" (UID: \"607fee19-adac-44b4-9f70-a6f6f3e59aed\") " Mar 16 16:53:10 crc kubenswrapper[5120]: I0316 16:53:10.678179 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/607fee19-adac-44b4-9f70-a6f6f3e59aed-scripts\") pod \"607fee19-adac-44b4-9f70-a6f6f3e59aed\" (UID: \"607fee19-adac-44b4-9f70-a6f6f3e59aed\") " Mar 16 16:53:10 crc kubenswrapper[5120]: I0316 16:53:10.678555 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/607fee19-adac-44b4-9f70-a6f6f3e59aed-logs\") pod \"607fee19-adac-44b4-9f70-a6f6f3e59aed\" (UID: \"607fee19-adac-44b4-9f70-a6f6f3e59aed\") " Mar 16 16:53:10 crc kubenswrapper[5120]: I0316 16:53:10.678776 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/607fee19-adac-44b4-9f70-a6f6f3e59aed-config-data\") pod \"607fee19-adac-44b4-9f70-a6f6f3e59aed\" (UID: \"607fee19-adac-44b4-9f70-a6f6f3e59aed\") " Mar 16 16:53:10 crc kubenswrapper[5120]: I0316 16:53:10.678859 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/607fee19-adac-44b4-9f70-a6f6f3e59aed-combined-ca-bundle\") pod \"607fee19-adac-44b4-9f70-a6f6f3e59aed\" (UID: \"607fee19-adac-44b4-9f70-a6f6f3e59aed\") " Mar 16 16:53:10 crc kubenswrapper[5120]: I0316 16:53:10.678951 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"607fee19-adac-44b4-9f70-a6f6f3e59aed\" (UID: \"607fee19-adac-44b4-9f70-a6f6f3e59aed\") " Mar 16 16:53:10 crc kubenswrapper[5120]: I0316 16:53:10.679056 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/607fee19-adac-44b4-9f70-a6f6f3e59aed-public-tls-certs\") pod \"607fee19-adac-44b4-9f70-a6f6f3e59aed\" (UID: \"607fee19-adac-44b4-9f70-a6f6f3e59aed\") " Mar 16 16:53:10 crc kubenswrapper[5120]: I0316 16:53:10.679822 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2pfcp\" (UniqueName: \"kubernetes.io/projected/72edd543-4bf8-407e-9929-47d4e9727134-kube-api-access-2pfcp\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:10 crc kubenswrapper[5120]: I0316 16:53:10.680913 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/607fee19-adac-44b4-9f70-a6f6f3e59aed-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "607fee19-adac-44b4-9f70-a6f6f3e59aed" (UID: "607fee19-adac-44b4-9f70-a6f6f3e59aed"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:53:10 crc kubenswrapper[5120]: I0316 16:53:10.682263 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/607fee19-adac-44b4-9f70-a6f6f3e59aed-logs" (OuterVolumeSpecName: "logs") pod "607fee19-adac-44b4-9f70-a6f6f3e59aed" (UID: "607fee19-adac-44b4-9f70-a6f6f3e59aed"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:53:10 crc kubenswrapper[5120]: I0316 16:53:10.686224 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:53:10 crc kubenswrapper[5120]: I0316 16:53:10.707519 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f1c9b873-c644-4c80-941e-3ec3415485e4" path="/var/lib/kubelet/pods/f1c9b873-c644-4c80-941e-3ec3415485e4/volumes" Mar 16 16:53:10 crc kubenswrapper[5120]: I0316 16:53:10.756010 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/607fee19-adac-44b4-9f70-a6f6f3e59aed-kube-api-access-jvfzn" (OuterVolumeSpecName: "kube-api-access-jvfzn") pod "607fee19-adac-44b4-9f70-a6f6f3e59aed" (UID: "607fee19-adac-44b4-9f70-a6f6f3e59aed"). InnerVolumeSpecName "kube-api-access-jvfzn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:53:10 crc kubenswrapper[5120]: I0316 16:53:10.757736 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/607fee19-adac-44b4-9f70-a6f6f3e59aed-scripts" (OuterVolumeSpecName: "scripts") pod "607fee19-adac-44b4-9f70-a6f6f3e59aed" (UID: "607fee19-adac-44b4-9f70-a6f6f3e59aed"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:10 crc kubenswrapper[5120]: I0316 16:53:10.759985 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage02-crc" (OuterVolumeSpecName: "glance") pod "607fee19-adac-44b4-9f70-a6f6f3e59aed" (UID: "607fee19-adac-44b4-9f70-a6f6f3e59aed"). InnerVolumeSpecName "local-storage02-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:53:10 crc kubenswrapper[5120]: I0316 16:53:10.780836 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/50c82211-4383-41cb-a31c-9bdfb156b586-config-data\") pod \"50c82211-4383-41cb-a31c-9bdfb156b586\" (UID: \"50c82211-4383-41cb-a31c-9bdfb156b586\") " Mar 16 16:53:10 crc kubenswrapper[5120]: I0316 16:53:10.781022 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"50c82211-4383-41cb-a31c-9bdfb156b586\" (UID: \"50c82211-4383-41cb-a31c-9bdfb156b586\") " Mar 16 16:53:10 crc kubenswrapper[5120]: I0316 16:53:10.781193 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/50c82211-4383-41cb-a31c-9bdfb156b586-scripts\") pod \"50c82211-4383-41cb-a31c-9bdfb156b586\" (UID: \"50c82211-4383-41cb-a31c-9bdfb156b586\") " Mar 16 16:53:10 crc kubenswrapper[5120]: I0316 16:53:10.781529 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/50c82211-4383-41cb-a31c-9bdfb156b586-httpd-run\") pod \"50c82211-4383-41cb-a31c-9bdfb156b586\" (UID: \"50c82211-4383-41cb-a31c-9bdfb156b586\") " Mar 16 16:53:10 crc kubenswrapper[5120]: I0316 16:53:10.781586 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/50c82211-4383-41cb-a31c-9bdfb156b586-logs\") pod \"50c82211-4383-41cb-a31c-9bdfb156b586\" (UID: \"50c82211-4383-41cb-a31c-9bdfb156b586\") " Mar 16 16:53:10 crc kubenswrapper[5120]: I0316 16:53:10.781859 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/50c82211-4383-41cb-a31c-9bdfb156b586-internal-tls-certs\") pod \"50c82211-4383-41cb-a31c-9bdfb156b586\" (UID: \"50c82211-4383-41cb-a31c-9bdfb156b586\") " Mar 16 16:53:10 crc kubenswrapper[5120]: I0316 16:53:10.781930 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/50c82211-4383-41cb-a31c-9bdfb156b586-combined-ca-bundle\") pod \"50c82211-4383-41cb-a31c-9bdfb156b586\" (UID: \"50c82211-4383-41cb-a31c-9bdfb156b586\") " Mar 16 16:53:10 crc kubenswrapper[5120]: I0316 16:53:10.782117 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wtckr\" (UniqueName: \"kubernetes.io/projected/50c82211-4383-41cb-a31c-9bdfb156b586-kube-api-access-wtckr\") pod \"50c82211-4383-41cb-a31c-9bdfb156b586\" (UID: \"50c82211-4383-41cb-a31c-9bdfb156b586\") " Mar 16 16:53:10 crc kubenswrapper[5120]: I0316 16:53:10.783725 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/607fee19-adac-44b4-9f70-a6f6f3e59aed-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:10 crc kubenswrapper[5120]: I0316 16:53:10.783746 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/607fee19-adac-44b4-9f70-a6f6f3e59aed-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:10 crc kubenswrapper[5120]: I0316 16:53:10.783840 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/607fee19-adac-44b4-9f70-a6f6f3e59aed-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:10 crc kubenswrapper[5120]: I0316 16:53:10.783861 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") on node \"crc\" " Mar 16 16:53:10 crc kubenswrapper[5120]: I0316 16:53:10.783893 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jvfzn\" (UniqueName: \"kubernetes.io/projected/607fee19-adac-44b4-9f70-a6f6f3e59aed-kube-api-access-jvfzn\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:10 crc kubenswrapper[5120]: I0316 16:53:10.793566 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50c82211-4383-41cb-a31c-9bdfb156b586-logs" (OuterVolumeSpecName: "logs") pod "50c82211-4383-41cb-a31c-9bdfb156b586" (UID: "50c82211-4383-41cb-a31c-9bdfb156b586"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:53:10 crc kubenswrapper[5120]: I0316 16:53:10.797888 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50c82211-4383-41cb-a31c-9bdfb156b586-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "50c82211-4383-41cb-a31c-9bdfb156b586" (UID: "50c82211-4383-41cb-a31c-9bdfb156b586"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:53:10 crc kubenswrapper[5120]: I0316 16:53:10.884870 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage01-crc" (OuterVolumeSpecName: "glance") pod "50c82211-4383-41cb-a31c-9bdfb156b586" (UID: "50c82211-4383-41cb-a31c-9bdfb156b586"). InnerVolumeSpecName "local-storage01-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:53:10 crc kubenswrapper[5120]: I0316 16:53:10.887573 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") on node \"crc\" " Mar 16 16:53:10 crc kubenswrapper[5120]: I0316 16:53:10.887611 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/50c82211-4383-41cb-a31c-9bdfb156b586-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:10 crc kubenswrapper[5120]: I0316 16:53:10.887628 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/50c82211-4383-41cb-a31c-9bdfb156b586-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:10 crc kubenswrapper[5120]: I0316 16:53:10.891922 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/50c82211-4383-41cb-a31c-9bdfb156b586-scripts" (OuterVolumeSpecName: "scripts") pod "50c82211-4383-41cb-a31c-9bdfb156b586" (UID: "50c82211-4383-41cb-a31c-9bdfb156b586"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:10 crc kubenswrapper[5120]: I0316 16:53:10.900262 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50c82211-4383-41cb-a31c-9bdfb156b586-kube-api-access-wtckr" (OuterVolumeSpecName: "kube-api-access-wtckr") pod "50c82211-4383-41cb-a31c-9bdfb156b586" (UID: "50c82211-4383-41cb-a31c-9bdfb156b586"). InnerVolumeSpecName "kube-api-access-wtckr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:53:10 crc kubenswrapper[5120]: I0316 16:53:10.990639 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/50c82211-4383-41cb-a31c-9bdfb156b586-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:10 crc kubenswrapper[5120]: I0316 16:53:10.990683 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wtckr\" (UniqueName: \"kubernetes.io/projected/50c82211-4383-41cb-a31c-9bdfb156b586-kube-api-access-wtckr\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.079929 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/72edd543-4bf8-407e-9929-47d4e9727134-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "72edd543-4bf8-407e-9929-47d4e9727134" (UID: "72edd543-4bf8-407e-9929-47d4e9727134"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.094742 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/72edd543-4bf8-407e-9929-47d4e9727134-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.184836 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage02-crc" (UniqueName: "kubernetes.io/local-volume/local-storage02-crc") on node "crc" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.202420 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.211905 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage01-crc" (UniqueName: "kubernetes.io/local-volume/local-storage01-crc") on node "crc" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.227731 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/607fee19-adac-44b4-9f70-a6f6f3e59aed-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "607fee19-adac-44b4-9f70-a6f6f3e59aed" (UID: "607fee19-adac-44b4-9f70-a6f6f3e59aed"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.255072 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/607fee19-adac-44b4-9f70-a6f6f3e59aed-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "607fee19-adac-44b4-9f70-a6f6f3e59aed" (UID: "607fee19-adac-44b4-9f70-a6f6f3e59aed"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.266909 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/50c82211-4383-41cb-a31c-9bdfb156b586-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "50c82211-4383-41cb-a31c-9bdfb156b586" (UID: "50c82211-4383-41cb-a31c-9bdfb156b586"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.306286 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.306376 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/607fee19-adac-44b4-9f70-a6f6f3e59aed-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.306391 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/607fee19-adac-44b4-9f70-a6f6f3e59aed-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.306401 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/50c82211-4383-41cb-a31c-9bdfb156b586-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.324156 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/607fee19-adac-44b4-9f70-a6f6f3e59aed-config-data" (OuterVolumeSpecName: "config-data") pod "607fee19-adac-44b4-9f70-a6f6f3e59aed" (UID: "607fee19-adac-44b4-9f70-a6f6f3e59aed"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.339974 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/72edd543-4bf8-407e-9929-47d4e9727134-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "72edd543-4bf8-407e-9929-47d4e9727134" (UID: "72edd543-4bf8-407e-9929-47d4e9727134"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.348179 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-84f95d87c8-s7s4d" podUID="3853023d-8cc5-42de-9f91-d0609e3fe565" containerName="neutron-api" containerID="cri-o://b9a2caba30341e48505a6ea01cdbdafc0cb59a73dd5f7b97f33e4a17575eabb8" gracePeriod=30 Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.348963 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-84f95d87c8-s7s4d" podUID="3853023d-8cc5-42de-9f91-d0609e3fe565" containerName="neutron-httpd" containerID="cri-o://f3e936cde026930d40ab3b02ecb1037a34399b8de1a6ffd65c816093ed0720e7" gracePeriod=30 Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.359611 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/72edd543-4bf8-407e-9929-47d4e9727134-ovn-northd-tls-certs" (OuterVolumeSpecName: "ovn-northd-tls-certs") pod "72edd543-4bf8-407e-9929-47d4e9727134" (UID: "72edd543-4bf8-407e-9929-47d4e9727134"). InnerVolumeSpecName "ovn-northd-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.365800 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.366843 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.367005 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.400049 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/50c82211-4383-41cb-a31c-9bdfb156b586-config-data" (OuterVolumeSpecName: "config-data") pod "50c82211-4383-41cb-a31c-9bdfb156b586" (UID: "50c82211-4383-41cb-a31c-9bdfb156b586"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.403735 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-84f95d87c8-s7s4d" podStartSLOduration=13.403711843 podStartE2EDuration="13.403711843s" podCreationTimestamp="2026-03-16 16:52:58 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:53:11.369992501 +0000 UTC m=+4893.523924168" watchObservedRunningTime="2026-03-16 16:53:11.403711843 +0000 UTC m=+4893.557643510" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.409807 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/607fee19-adac-44b4-9f70-a6f6f3e59aed-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.410053 5120 reconciler_common.go:299] "Volume detached for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/72edd543-4bf8-407e-9929-47d4e9727134-ovn-northd-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.410187 5120 reconciler_common.go:299] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/72edd543-4bf8-407e-9929-47d4e9727134-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.410289 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/50c82211-4383-41cb-a31c-9bdfb156b586-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.412923 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/50c82211-4383-41cb-a31c-9bdfb156b586-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "50c82211-4383-41cb-a31c-9bdfb156b586" (UID: "50c82211-4383-41cb-a31c-9bdfb156b586"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.445658 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.445702 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-84f95d87c8-s7s4d" event={"ID":"3853023d-8cc5-42de-9f91-d0609e3fe565","Type":"ContainerStarted","Data":"f3e936cde026930d40ab3b02ecb1037a34399b8de1a6ffd65c816093ed0720e7"} Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.445733 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/neutron-84f95d87c8-s7s4d" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.445749 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.447131 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50c82211-4383-41cb-a31c-9bdfb156b586" containerName="glance-log" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.447217 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="50c82211-4383-41cb-a31c-9bdfb156b586" containerName="glance-log" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.447245 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="607fee19-adac-44b4-9f70-a6f6f3e59aed" containerName="glance-log" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.447281 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="607fee19-adac-44b4-9f70-a6f6f3e59aed" containerName="glance-log" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.447320 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72edd543-4bf8-407e-9929-47d4e9727134" containerName="openstack-network-exporter" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.447331 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="72edd543-4bf8-407e-9929-47d4e9727134" containerName="openstack-network-exporter" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.447382 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72edd543-4bf8-407e-9929-47d4e9727134" containerName="ovn-northd" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.447390 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="72edd543-4bf8-407e-9929-47d4e9727134" containerName="ovn-northd" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.447404 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50c82211-4383-41cb-a31c-9bdfb156b586" containerName="glance-httpd" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.447424 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="50c82211-4383-41cb-a31c-9bdfb156b586" containerName="glance-httpd" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.447442 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="607fee19-adac-44b4-9f70-a6f6f3e59aed" containerName="glance-httpd" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.447450 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="607fee19-adac-44b4-9f70-a6f6f3e59aed" containerName="glance-httpd" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.447692 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="72edd543-4bf8-407e-9929-47d4e9727134" containerName="ovn-northd" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.447710 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="607fee19-adac-44b4-9f70-a6f6f3e59aed" containerName="glance-log" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.447726 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="50c82211-4383-41cb-a31c-9bdfb156b586" containerName="glance-httpd" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.447740 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="72edd543-4bf8-407e-9929-47d4e9727134" containerName="openstack-network-exporter" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.447750 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="50c82211-4383-41cb-a31c-9bdfb156b586" containerName="glance-log" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.447782 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="607fee19-adac-44b4-9f70-a6f6f3e59aed" containerName="glance-httpd" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.454046 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-57f7845c4b-tb6nd" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.460994 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"9c42ca14-5afb-4688-a2cf-ddf314020f18","Type":"ContainerStarted","Data":"569b6997061d8e55b605d24f201f0495075733ef4ceb9693565c7b1a0e2c1a33"} Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.461032 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"61483cf5-d3db-49de-afa4-66f0efecdd70","Type":"ContainerStarted","Data":"eef8c8d8f98f45622b4eea759dfa1ab6270fda4adb6058f0408cabf7fcc9d269"} Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.461048 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.461080 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.461092 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.462198 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ffa2d14d-1b44-445b-ab47-1bb134223111" containerName="keystone-api" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.462212 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ffa2d14d-1b44-445b-ab47-1bb134223111" containerName="keystone-api" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.462438 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ffa2d14d-1b44-445b-ab47-1bb134223111" containerName="keystone-api" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.463054 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.473307 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-api-647f8b964-49qkc"] Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.474143 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-conductor-config-data\"" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.474886 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.477491 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-public-svc\"" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.487182 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-config-data\"" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.487613 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-internal-svc\"" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.513104 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ffa2d14d-1b44-445b-ab47-1bb134223111-config-data\") pod \"ffa2d14d-1b44-445b-ab47-1bb134223111\" (UID: \"ffa2d14d-1b44-445b-ab47-1bb134223111\") " Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.513190 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ffa2d14d-1b44-445b-ab47-1bb134223111-scripts\") pod \"ffa2d14d-1b44-445b-ab47-1bb134223111\" (UID: \"ffa2d14d-1b44-445b-ab47-1bb134223111\") " Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.513234 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/ffa2d14d-1b44-445b-ab47-1bb134223111-internal-tls-certs\") pod \"ffa2d14d-1b44-445b-ab47-1bb134223111\" (UID: \"ffa2d14d-1b44-445b-ab47-1bb134223111\") " Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.513349 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wtklb\" (UniqueName: \"kubernetes.io/projected/ffa2d14d-1b44-445b-ab47-1bb134223111-kube-api-access-wtklb\") pod \"ffa2d14d-1b44-445b-ab47-1bb134223111\" (UID: \"ffa2d14d-1b44-445b-ab47-1bb134223111\") " Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.513401 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ffa2d14d-1b44-445b-ab47-1bb134223111-public-tls-certs\") pod \"ffa2d14d-1b44-445b-ab47-1bb134223111\" (UID: \"ffa2d14d-1b44-445b-ab47-1bb134223111\") " Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.513489 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ffa2d14d-1b44-445b-ab47-1bb134223111-combined-ca-bundle\") pod \"ffa2d14d-1b44-445b-ab47-1bb134223111\" (UID: \"ffa2d14d-1b44-445b-ab47-1bb134223111\") " Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.513533 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/ffa2d14d-1b44-445b-ab47-1bb134223111-credential-keys\") pod \"ffa2d14d-1b44-445b-ab47-1bb134223111\" (UID: \"ffa2d14d-1b44-445b-ab47-1bb134223111\") " Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.513950 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/ffa2d14d-1b44-445b-ab47-1bb134223111-fernet-keys\") pod \"ffa2d14d-1b44-445b-ab47-1bb134223111\" (UID: \"ffa2d14d-1b44-445b-ab47-1bb134223111\") " Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.514384 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.514434 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.514450 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.514471 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.514485 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.514912 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bd162855-8210-41c5-9494-15a62edf991c-config-data\") pod \"nova-api-0\" (UID: \"bd162855-8210-41c5-9494-15a62edf991c\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.515030 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/bd162855-8210-41c5-9494-15a62edf991c-internal-tls-certs\") pod \"nova-api-0\" (UID: \"bd162855-8210-41c5-9494-15a62edf991c\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.515069 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/07523c84-c61c-42f5-9282-324e6cc37cf7-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"07523c84-c61c-42f5-9282-324e6cc37cf7\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.515337 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/bd162855-8210-41c5-9494-15a62edf991c-public-tls-certs\") pod \"nova-api-0\" (UID: \"bd162855-8210-41c5-9494-15a62edf991c\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.515378 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/07523c84-c61c-42f5-9282-324e6cc37cf7-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"07523c84-c61c-42f5-9282-324e6cc37cf7\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.515523 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ms4w5\" (UniqueName: \"kubernetes.io/projected/07523c84-c61c-42f5-9282-324e6cc37cf7-kube-api-access-ms4w5\") pod \"nova-cell1-conductor-0\" (UID: \"07523c84-c61c-42f5-9282-324e6cc37cf7\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.515560 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/bd162855-8210-41c5-9494-15a62edf991c-logs\") pod \"nova-api-0\" (UID: \"bd162855-8210-41c5-9494-15a62edf991c\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.515727 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bd162855-8210-41c5-9494-15a62edf991c-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"bd162855-8210-41c5-9494-15a62edf991c\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.528062 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ffa2d14d-1b44-445b-ab47-1bb134223111-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "ffa2d14d-1b44-445b-ab47-1bb134223111" (UID: "ffa2d14d-1b44-445b-ab47-1bb134223111"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.532941 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pmd4\" (UniqueName: \"kubernetes.io/projected/bd162855-8210-41c5-9494-15a62edf991c-kube-api-access-5pmd4\") pod \"nova-api-0\" (UID: \"bd162855-8210-41c5-9494-15a62edf991c\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.533490 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/50c82211-4383-41cb-a31c-9bdfb156b586-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.533870 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-647f8b964-49qkc" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.546823 5120 reconciler_common.go:299] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/ffa2d14d-1b44-445b-ab47-1bb134223111-fernet-keys\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.557417 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.557550 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-647f8b964-49qkc"] Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.557698 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.559451 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-cinder-public-svc\"" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.559642 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-api-config-data\"" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.561329 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-cinder-internal-svc\"" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.590045 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-5fd9d6b8f6-vq7wb" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.627440 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ffa2d14d-1b44-445b-ab47-1bb134223111-kube-api-access-wtklb" (OuterVolumeSpecName: "kube-api-access-wtklb") pod "ffa2d14d-1b44-445b-ab47-1bb134223111" (UID: "ffa2d14d-1b44-445b-ab47-1bb134223111"). InnerVolumeSpecName "kube-api-access-wtklb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.645269 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ffa2d14d-1b44-445b-ab47-1bb134223111-scripts" (OuterVolumeSpecName: "scripts") pod "ffa2d14d-1b44-445b-ab47-1bb134223111" (UID: "ffa2d14d-1b44-445b-ab47-1bb134223111"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.656755 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/a5d3f7a6-64f6-47f9-a144-41a356078e4b-internal-tls-certs\") pod \"barbican-api-647f8b964-49qkc\" (UID: \"a5d3f7a6-64f6-47f9-a144-41a356078e4b\") " pod="openstack-kuttl-tests/barbican-api-647f8b964-49qkc" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.656865 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/bd162855-8210-41c5-9494-15a62edf991c-public-tls-certs\") pod \"nova-api-0\" (UID: \"bd162855-8210-41c5-9494-15a62edf991c\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.656919 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/ef964d2a-6681-47c5-9a3b-29fe733ee9f0-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"ef964d2a-6681-47c5-9a3b-29fe733ee9f0\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.656968 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/07523c84-c61c-42f5-9282-324e6cc37cf7-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"07523c84-c61c-42f5-9282-324e6cc37cf7\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.657117 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a5d3f7a6-64f6-47f9-a144-41a356078e4b-logs\") pod \"barbican-api-647f8b964-49qkc\" (UID: \"a5d3f7a6-64f6-47f9-a144-41a356078e4b\") " pod="openstack-kuttl-tests/barbican-api-647f8b964-49qkc" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.657157 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/ef964d2a-6681-47c5-9a3b-29fe733ee9f0-etc-machine-id\") pod \"cinder-api-0\" (UID: \"ef964d2a-6681-47c5-9a3b-29fe733ee9f0\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.657219 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ms4w5\" (UniqueName: \"kubernetes.io/projected/07523c84-c61c-42f5-9282-324e6cc37cf7-kube-api-access-ms4w5\") pod \"nova-cell1-conductor-0\" (UID: \"07523c84-c61c-42f5-9282-324e6cc37cf7\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.657244 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcg7f\" (UniqueName: \"kubernetes.io/projected/a5d3f7a6-64f6-47f9-a144-41a356078e4b-kube-api-access-xcg7f\") pod \"barbican-api-647f8b964-49qkc\" (UID: \"a5d3f7a6-64f6-47f9-a144-41a356078e4b\") " pod="openstack-kuttl-tests/barbican-api-647f8b964-49qkc" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.657279 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/bd162855-8210-41c5-9494-15a62edf991c-logs\") pod \"nova-api-0\" (UID: \"bd162855-8210-41c5-9494-15a62edf991c\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.657343 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/a5d3f7a6-64f6-47f9-a144-41a356078e4b-public-tls-certs\") pod \"barbican-api-647f8b964-49qkc\" (UID: \"a5d3f7a6-64f6-47f9-a144-41a356078e4b\") " pod="openstack-kuttl-tests/barbican-api-647f8b964-49qkc" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.657450 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bd162855-8210-41c5-9494-15a62edf991c-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"bd162855-8210-41c5-9494-15a62edf991c\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.657501 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ef964d2a-6681-47c5-9a3b-29fe733ee9f0-public-tls-certs\") pod \"cinder-api-0\" (UID: \"ef964d2a-6681-47c5-9a3b-29fe733ee9f0\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.657567 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5pmd4\" (UniqueName: \"kubernetes.io/projected/bd162855-8210-41c5-9494-15a62edf991c-kube-api-access-5pmd4\") pod \"nova-api-0\" (UID: \"bd162855-8210-41c5-9494-15a62edf991c\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.657617 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ef964d2a-6681-47c5-9a3b-29fe733ee9f0-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"ef964d2a-6681-47c5-9a3b-29fe733ee9f0\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.657652 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ef964d2a-6681-47c5-9a3b-29fe733ee9f0-scripts\") pod \"cinder-api-0\" (UID: \"ef964d2a-6681-47c5-9a3b-29fe733ee9f0\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.657687 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ef964d2a-6681-47c5-9a3b-29fe733ee9f0-config-data\") pod \"cinder-api-0\" (UID: \"ef964d2a-6681-47c5-9a3b-29fe733ee9f0\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.657743 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a5d3f7a6-64f6-47f9-a144-41a356078e4b-combined-ca-bundle\") pod \"barbican-api-647f8b964-49qkc\" (UID: \"a5d3f7a6-64f6-47f9-a144-41a356078e4b\") " pod="openstack-kuttl-tests/barbican-api-647f8b964-49qkc" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.657819 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/a5d3f7a6-64f6-47f9-a144-41a356078e4b-config-data-custom\") pod \"barbican-api-647f8b964-49qkc\" (UID: \"a5d3f7a6-64f6-47f9-a144-41a356078e4b\") " pod="openstack-kuttl-tests/barbican-api-647f8b964-49qkc" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.657870 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ef964d2a-6681-47c5-9a3b-29fe733ee9f0-logs\") pod \"cinder-api-0\" (UID: \"ef964d2a-6681-47c5-9a3b-29fe733ee9f0\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.657966 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvkk5\" (UniqueName: \"kubernetes.io/projected/ef964d2a-6681-47c5-9a3b-29fe733ee9f0-kube-api-access-qvkk5\") pod \"cinder-api-0\" (UID: \"ef964d2a-6681-47c5-9a3b-29fe733ee9f0\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.658039 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bd162855-8210-41c5-9494-15a62edf991c-config-data\") pod \"nova-api-0\" (UID: \"bd162855-8210-41c5-9494-15a62edf991c\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.658108 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a5d3f7a6-64f6-47f9-a144-41a356078e4b-config-data\") pod \"barbican-api-647f8b964-49qkc\" (UID: \"a5d3f7a6-64f6-47f9-a144-41a356078e4b\") " pod="openstack-kuttl-tests/barbican-api-647f8b964-49qkc" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.658164 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/bd162855-8210-41c5-9494-15a62edf991c-internal-tls-certs\") pod \"nova-api-0\" (UID: \"bd162855-8210-41c5-9494-15a62edf991c\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.658216 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/07523c84-c61c-42f5-9282-324e6cc37cf7-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"07523c84-c61c-42f5-9282-324e6cc37cf7\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.658685 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/ef964d2a-6681-47c5-9a3b-29fe733ee9f0-config-data-custom\") pod \"cinder-api-0\" (UID: \"ef964d2a-6681-47c5-9a3b-29fe733ee9f0\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.658908 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wtklb\" (UniqueName: \"kubernetes.io/projected/ffa2d14d-1b44-445b-ab47-1bb134223111-kube-api-access-wtklb\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.658931 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ffa2d14d-1b44-445b-ab47-1bb134223111-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.666399 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ffa2d14d-1b44-445b-ab47-1bb134223111-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "ffa2d14d-1b44-445b-ab47-1bb134223111" (UID: "ffa2d14d-1b44-445b-ab47-1bb134223111"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.669483 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/bd162855-8210-41c5-9494-15a62edf991c-logs\") pod \"nova-api-0\" (UID: \"bd162855-8210-41c5-9494-15a62edf991c\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.703453 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bd162855-8210-41c5-9494-15a62edf991c-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"bd162855-8210-41c5-9494-15a62edf991c\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.703736 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/bd162855-8210-41c5-9494-15a62edf991c-public-tls-certs\") pod \"nova-api-0\" (UID: \"bd162855-8210-41c5-9494-15a62edf991c\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.724486 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/07523c84-c61c-42f5-9282-324e6cc37cf7-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"07523c84-c61c-42f5-9282-324e6cc37cf7\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.724723 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/07523c84-c61c-42f5-9282-324e6cc37cf7-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"07523c84-c61c-42f5-9282-324e6cc37cf7\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.725294 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bd162855-8210-41c5-9494-15a62edf991c-config-data\") pod \"nova-api-0\" (UID: \"bd162855-8210-41c5-9494-15a62edf991c\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.725555 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pmd4\" (UniqueName: \"kubernetes.io/projected/bd162855-8210-41c5-9494-15a62edf991c-kube-api-access-5pmd4\") pod \"nova-api-0\" (UID: \"bd162855-8210-41c5-9494-15a62edf991c\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.749383 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.753203 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/bd162855-8210-41c5-9494-15a62edf991c-internal-tls-certs\") pod \"nova-api-0\" (UID: \"bd162855-8210-41c5-9494-15a62edf991c\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.753477 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ms4w5\" (UniqueName: \"kubernetes.io/projected/07523c84-c61c-42f5-9282-324e6cc37cf7-kube-api-access-ms4w5\") pod \"nova-cell1-conductor-0\" (UID: \"07523c84-c61c-42f5-9282-324e6cc37cf7\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.765800 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/ef964d2a-6681-47c5-9a3b-29fe733ee9f0-config-data-custom\") pod \"cinder-api-0\" (UID: \"ef964d2a-6681-47c5-9a3b-29fe733ee9f0\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.767149 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/a5d3f7a6-64f6-47f9-a144-41a356078e4b-internal-tls-certs\") pod \"barbican-api-647f8b964-49qkc\" (UID: \"a5d3f7a6-64f6-47f9-a144-41a356078e4b\") " pod="openstack-kuttl-tests/barbican-api-647f8b964-49qkc" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.787558 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/ef964d2a-6681-47c5-9a3b-29fe733ee9f0-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"ef964d2a-6681-47c5-9a3b-29fe733ee9f0\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.793279 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a5d3f7a6-64f6-47f9-a144-41a356078e4b-logs\") pod \"barbican-api-647f8b964-49qkc\" (UID: \"a5d3f7a6-64f6-47f9-a144-41a356078e4b\") " pod="openstack-kuttl-tests/barbican-api-647f8b964-49qkc" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.793357 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/ef964d2a-6681-47c5-9a3b-29fe733ee9f0-etc-machine-id\") pod \"cinder-api-0\" (UID: \"ef964d2a-6681-47c5-9a3b-29fe733ee9f0\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.793441 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xcg7f\" (UniqueName: \"kubernetes.io/projected/a5d3f7a6-64f6-47f9-a144-41a356078e4b-kube-api-access-xcg7f\") pod \"barbican-api-647f8b964-49qkc\" (UID: \"a5d3f7a6-64f6-47f9-a144-41a356078e4b\") " pod="openstack-kuttl-tests/barbican-api-647f8b964-49qkc" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.793586 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/a5d3f7a6-64f6-47f9-a144-41a356078e4b-public-tls-certs\") pod \"barbican-api-647f8b964-49qkc\" (UID: \"a5d3f7a6-64f6-47f9-a144-41a356078e4b\") " pod="openstack-kuttl-tests/barbican-api-647f8b964-49qkc" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.793753 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a5d3f7a6-64f6-47f9-a144-41a356078e4b-logs\") pod \"barbican-api-647f8b964-49qkc\" (UID: \"a5d3f7a6-64f6-47f9-a144-41a356078e4b\") " pod="openstack-kuttl-tests/barbican-api-647f8b964-49qkc" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.793798 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ef964d2a-6681-47c5-9a3b-29fe733ee9f0-public-tls-certs\") pod \"cinder-api-0\" (UID: \"ef964d2a-6681-47c5-9a3b-29fe733ee9f0\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.793943 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ef964d2a-6681-47c5-9a3b-29fe733ee9f0-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"ef964d2a-6681-47c5-9a3b-29fe733ee9f0\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.793986 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ef964d2a-6681-47c5-9a3b-29fe733ee9f0-scripts\") pod \"cinder-api-0\" (UID: \"ef964d2a-6681-47c5-9a3b-29fe733ee9f0\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.817018 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ef964d2a-6681-47c5-9a3b-29fe733ee9f0-config-data\") pod \"cinder-api-0\" (UID: \"ef964d2a-6681-47c5-9a3b-29fe733ee9f0\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.817144 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a5d3f7a6-64f6-47f9-a144-41a356078e4b-combined-ca-bundle\") pod \"barbican-api-647f8b964-49qkc\" (UID: \"a5d3f7a6-64f6-47f9-a144-41a356078e4b\") " pod="openstack-kuttl-tests/barbican-api-647f8b964-49qkc" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.817965 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/a5d3f7a6-64f6-47f9-a144-41a356078e4b-internal-tls-certs\") pod \"barbican-api-647f8b964-49qkc\" (UID: \"a5d3f7a6-64f6-47f9-a144-41a356078e4b\") " pod="openstack-kuttl-tests/barbican-api-647f8b964-49qkc" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.823630 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/ef964d2a-6681-47c5-9a3b-29fe733ee9f0-etc-machine-id\") pod \"cinder-api-0\" (UID: \"ef964d2a-6681-47c5-9a3b-29fe733ee9f0\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.835538 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/ef964d2a-6681-47c5-9a3b-29fe733ee9f0-config-data-custom\") pod \"cinder-api-0\" (UID: \"ef964d2a-6681-47c5-9a3b-29fe733ee9f0\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.836795 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/ef964d2a-6681-47c5-9a3b-29fe733ee9f0-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"ef964d2a-6681-47c5-9a3b-29fe733ee9f0\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.837484 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/a5d3f7a6-64f6-47f9-a144-41a356078e4b-config-data-custom\") pod \"barbican-api-647f8b964-49qkc\" (UID: \"a5d3f7a6-64f6-47f9-a144-41a356078e4b\") " pod="openstack-kuttl-tests/barbican-api-647f8b964-49qkc" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.837543 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ef964d2a-6681-47c5-9a3b-29fe733ee9f0-logs\") pod \"cinder-api-0\" (UID: \"ef964d2a-6681-47c5-9a3b-29fe733ee9f0\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.837608 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qvkk5\" (UniqueName: \"kubernetes.io/projected/ef964d2a-6681-47c5-9a3b-29fe733ee9f0-kube-api-access-qvkk5\") pod \"cinder-api-0\" (UID: \"ef964d2a-6681-47c5-9a3b-29fe733ee9f0\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.837710 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a5d3f7a6-64f6-47f9-a144-41a356078e4b-config-data\") pod \"barbican-api-647f8b964-49qkc\" (UID: \"a5d3f7a6-64f6-47f9-a144-41a356078e4b\") " pod="openstack-kuttl-tests/barbican-api-647f8b964-49qkc" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.837796 5120 reconciler_common.go:299] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/ffa2d14d-1b44-445b-ab47-1bb134223111-credential-keys\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.841448 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ef964d2a-6681-47c5-9a3b-29fe733ee9f0-logs\") pod \"cinder-api-0\" (UID: \"ef964d2a-6681-47c5-9a3b-29fe733ee9f0\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.857926 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.868542 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.896494 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.898775 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/a5d3f7a6-64f6-47f9-a144-41a356078e4b-public-tls-certs\") pod \"barbican-api-647f8b964-49qkc\" (UID: \"a5d3f7a6-64f6-47f9-a144-41a356078e4b\") " pod="openstack-kuttl-tests/barbican-api-647f8b964-49qkc" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.899304 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ef964d2a-6681-47c5-9a3b-29fe733ee9f0-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"ef964d2a-6681-47c5-9a3b-29fe733ee9f0\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.899420 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ef964d2a-6681-47c5-9a3b-29fe733ee9f0-public-tls-certs\") pod \"cinder-api-0\" (UID: \"ef964d2a-6681-47c5-9a3b-29fe733ee9f0\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.918066 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ef964d2a-6681-47c5-9a3b-29fe733ee9f0-scripts\") pod \"cinder-api-0\" (UID: \"ef964d2a-6681-47c5-9a3b-29fe733ee9f0\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.920852 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvkk5\" (UniqueName: \"kubernetes.io/projected/ef964d2a-6681-47c5-9a3b-29fe733ee9f0-kube-api-access-qvkk5\") pod \"cinder-api-0\" (UID: \"ef964d2a-6681-47c5-9a3b-29fe733ee9f0\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.918314 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/a5d3f7a6-64f6-47f9-a144-41a356078e4b-config-data-custom\") pod \"barbican-api-647f8b964-49qkc\" (UID: \"a5d3f7a6-64f6-47f9-a144-41a356078e4b\") " pod="openstack-kuttl-tests/barbican-api-647f8b964-49qkc" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.921423 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcg7f\" (UniqueName: \"kubernetes.io/projected/a5d3f7a6-64f6-47f9-a144-41a356078e4b-kube-api-access-xcg7f\") pod \"barbican-api-647f8b964-49qkc\" (UID: \"a5d3f7a6-64f6-47f9-a144-41a356078e4b\") " pod="openstack-kuttl-tests/barbican-api-647f8b964-49qkc" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.921721 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a5d3f7a6-64f6-47f9-a144-41a356078e4b-combined-ca-bundle\") pod \"barbican-api-647f8b964-49qkc\" (UID: \"a5d3f7a6-64f6-47f9-a144-41a356078e4b\") " pod="openstack-kuttl-tests/barbican-api-647f8b964-49qkc" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.922977 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ef964d2a-6681-47c5-9a3b-29fe733ee9f0-config-data\") pod \"cinder-api-0\" (UID: \"ef964d2a-6681-47c5-9a3b-29fe733ee9f0\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.923164 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a5d3f7a6-64f6-47f9-a144-41a356078e4b-config-data\") pod \"barbican-api-647f8b964-49qkc\" (UID: \"a5d3f7a6-64f6-47f9-a144-41a356078e4b\") " pod="openstack-kuttl-tests/barbican-api-647f8b964-49qkc" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.938414 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.946718 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.951967 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovnnorthd-config\"" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.952372 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ovnnorthd-ovnnorthd-dockercfg-gxfx7\"" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.952436 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovnnorthd-scripts\"" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.952931 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ovnnorthd-ovndbs\"" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.949526 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.982479 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 16:53:11 crc kubenswrapper[5120]: I0316 16:53:11.994335 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.000792 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.036150 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.038155 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-647f8b964-49qkc" Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.049217 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/7a0880a9-40d3-4b78-890b-b24bf32a92e7-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"7a0880a9-40d3-4b78-890b-b24bf32a92e7\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.049317 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxs8t\" (UniqueName: \"kubernetes.io/projected/7a0880a9-40d3-4b78-890b-b24bf32a92e7-kube-api-access-rxs8t\") pod \"ovn-northd-0\" (UID: \"7a0880a9-40d3-4b78-890b-b24bf32a92e7\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.049394 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7a0880a9-40d3-4b78-890b-b24bf32a92e7-config\") pod \"ovn-northd-0\" (UID: \"7a0880a9-40d3-4b78-890b-b24bf32a92e7\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.049501 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/7a0880a9-40d3-4b78-890b-b24bf32a92e7-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"7a0880a9-40d3-4b78-890b-b24bf32a92e7\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.049738 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/7a0880a9-40d3-4b78-890b-b24bf32a92e7-scripts\") pod \"ovn-northd-0\" (UID: \"7a0880a9-40d3-4b78-890b-b24bf32a92e7\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.052166 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/7a0880a9-40d3-4b78-890b-b24bf32a92e7-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"7a0880a9-40d3-4b78-890b-b24bf32a92e7\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.052303 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7a0880a9-40d3-4b78-890b-b24bf32a92e7-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"7a0880a9-40d3-4b78-890b-b24bf32a92e7\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.049834 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.058589 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-public-svc\"" Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.059078 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-glance-dockercfg-6m2c9\"" Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.059271 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-external-config-data\"" Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.061262 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-scripts\"" Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.073036 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.079941 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.085995 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.109004 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.122528 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.148833 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.150751 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-internal-svc\"" Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.152390 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-internal-config-data\"" Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.153968 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jc8qg\" (UniqueName: \"kubernetes.io/projected/b609e161-5c22-4699-9af9-7f972834422a-kube-api-access-jc8qg\") pod \"glance-default-external-api-0\" (UID: \"b609e161-5c22-4699-9af9-7f972834422a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.154021 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b609e161-5c22-4699-9af9-7f972834422a-config-data\") pod \"glance-default-external-api-0\" (UID: \"b609e161-5c22-4699-9af9-7f972834422a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.154093 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/7a0880a9-40d3-4b78-890b-b24bf32a92e7-scripts\") pod \"ovn-northd-0\" (UID: \"7a0880a9-40d3-4b78-890b-b24bf32a92e7\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.154196 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/7a0880a9-40d3-4b78-890b-b24bf32a92e7-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"7a0880a9-40d3-4b78-890b-b24bf32a92e7\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.154266 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b609e161-5c22-4699-9af9-7f972834422a-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"b609e161-5c22-4699-9af9-7f972834422a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.154289 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b609e161-5c22-4699-9af9-7f972834422a-scripts\") pod \"glance-default-external-api-0\" (UID: \"b609e161-5c22-4699-9af9-7f972834422a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.154318 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7a0880a9-40d3-4b78-890b-b24bf32a92e7-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"7a0880a9-40d3-4b78-890b-b24bf32a92e7\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.154400 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/b609e161-5c22-4699-9af9-7f972834422a-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"b609e161-5c22-4699-9af9-7f972834422a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.154438 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/7a0880a9-40d3-4b78-890b-b24bf32a92e7-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"7a0880a9-40d3-4b78-890b-b24bf32a92e7\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.154468 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b609e161-5c22-4699-9af9-7f972834422a-logs\") pod \"glance-default-external-api-0\" (UID: \"b609e161-5c22-4699-9af9-7f972834422a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.154506 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rxs8t\" (UniqueName: \"kubernetes.io/projected/7a0880a9-40d3-4b78-890b-b24bf32a92e7-kube-api-access-rxs8t\") pod \"ovn-northd-0\" (UID: \"7a0880a9-40d3-4b78-890b-b24bf32a92e7\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.154562 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7a0880a9-40d3-4b78-890b-b24bf32a92e7-config\") pod \"ovn-northd-0\" (UID: \"7a0880a9-40d3-4b78-890b-b24bf32a92e7\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.154611 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"glance-default-external-api-0\" (UID: \"b609e161-5c22-4699-9af9-7f972834422a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.154640 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/b609e161-5c22-4699-9af9-7f972834422a-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"b609e161-5c22-4699-9af9-7f972834422a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.154684 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/7a0880a9-40d3-4b78-890b-b24bf32a92e7-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"7a0880a9-40d3-4b78-890b-b24bf32a92e7\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.156477 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/7a0880a9-40d3-4b78-890b-b24bf32a92e7-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"7a0880a9-40d3-4b78-890b-b24bf32a92e7\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.156935 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7a0880a9-40d3-4b78-890b-b24bf32a92e7-config\") pod \"ovn-northd-0\" (UID: \"7a0880a9-40d3-4b78-890b-b24bf32a92e7\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.157124 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/7a0880a9-40d3-4b78-890b-b24bf32a92e7-scripts\") pod \"ovn-northd-0\" (UID: \"7a0880a9-40d3-4b78-890b-b24bf32a92e7\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.164484 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/7a0880a9-40d3-4b78-890b-b24bf32a92e7-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"7a0880a9-40d3-4b78-890b-b24bf32a92e7\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.179130 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.183727 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxs8t\" (UniqueName: \"kubernetes.io/projected/7a0880a9-40d3-4b78-890b-b24bf32a92e7-kube-api-access-rxs8t\") pod \"ovn-northd-0\" (UID: \"7a0880a9-40d3-4b78-890b-b24bf32a92e7\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.215979 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7a0880a9-40d3-4b78-890b-b24bf32a92e7-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"7a0880a9-40d3-4b78-890b-b24bf32a92e7\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.220275 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/7a0880a9-40d3-4b78-890b-b24bf32a92e7-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"7a0880a9-40d3-4b78-890b-b24bf32a92e7\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.243854 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-7bf49bf568-fbg2k" podUID="c846d2b2-0638-44bd-9ad0-6b6c76f8d16f" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.0.123:9311/healthcheck\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.264113 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-7bf49bf568-fbg2k" podUID="c846d2b2-0638-44bd-9ad0-6b6c76f8d16f" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.0.123:9311/healthcheck\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.271287 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b609e161-5c22-4699-9af9-7f972834422a-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"b609e161-5c22-4699-9af9-7f972834422a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.271345 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b609e161-5c22-4699-9af9-7f972834422a-scripts\") pod \"glance-default-external-api-0\" (UID: \"b609e161-5c22-4699-9af9-7f972834422a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.271458 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/b609e161-5c22-4699-9af9-7f972834422a-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"b609e161-5c22-4699-9af9-7f972834422a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.271532 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b609e161-5c22-4699-9af9-7f972834422a-logs\") pod \"glance-default-external-api-0\" (UID: \"b609e161-5c22-4699-9af9-7f972834422a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.271680 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"glance-default-external-api-0\" (UID: \"b609e161-5c22-4699-9af9-7f972834422a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.271722 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/b609e161-5c22-4699-9af9-7f972834422a-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"b609e161-5c22-4699-9af9-7f972834422a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.271906 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jc8qg\" (UniqueName: \"kubernetes.io/projected/b609e161-5c22-4699-9af9-7f972834422a-kube-api-access-jc8qg\") pod \"glance-default-external-api-0\" (UID: \"b609e161-5c22-4699-9af9-7f972834422a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.271980 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b609e161-5c22-4699-9af9-7f972834422a-config-data\") pod \"glance-default-external-api-0\" (UID: \"b609e161-5c22-4699-9af9-7f972834422a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.272272 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"glance-default-internal-api-0\" (UID: \"3267cb77-9a07-4d71-aaa4-e1e5e033a70d\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.275491 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b609e161-5c22-4699-9af9-7f972834422a-logs\") pod \"glance-default-external-api-0\" (UID: \"b609e161-5c22-4699-9af9-7f972834422a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.275521 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"glance-default-external-api-0\" (UID: \"b609e161-5c22-4699-9af9-7f972834422a\") device mount path \"/mnt/openstack/pv02\"" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.275490 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/b609e161-5c22-4699-9af9-7f972834422a-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"b609e161-5c22-4699-9af9-7f972834422a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.309200 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jc8qg\" (UniqueName: \"kubernetes.io/projected/b609e161-5c22-4699-9af9-7f972834422a-kube-api-access-jc8qg\") pod \"glance-default-external-api-0\" (UID: \"b609e161-5c22-4699-9af9-7f972834422a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.310248 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b609e161-5c22-4699-9af9-7f972834422a-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"b609e161-5c22-4699-9af9-7f972834422a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.317181 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b609e161-5c22-4699-9af9-7f972834422a-scripts\") pod \"glance-default-external-api-0\" (UID: \"b609e161-5c22-4699-9af9-7f972834422a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.318596 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b609e161-5c22-4699-9af9-7f972834422a-config-data\") pod \"glance-default-external-api-0\" (UID: \"b609e161-5c22-4699-9af9-7f972834422a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.341573 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/b609e161-5c22-4699-9af9-7f972834422a-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"b609e161-5c22-4699-9af9-7f972834422a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.344659 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-5fd9d6b8f6-vq7wb"] Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.377468 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"glance-default-internal-api-0\" (UID: \"3267cb77-9a07-4d71-aaa4-e1e5e033a70d\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.377629 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/3267cb77-9a07-4d71-aaa4-e1e5e033a70d-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"3267cb77-9a07-4d71-aaa4-e1e5e033a70d\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.377672 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3267cb77-9a07-4d71-aaa4-e1e5e033a70d-config-data\") pod \"glance-default-internal-api-0\" (UID: \"3267cb77-9a07-4d71-aaa4-e1e5e033a70d\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.377727 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/3267cb77-9a07-4d71-aaa4-e1e5e033a70d-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"3267cb77-9a07-4d71-aaa4-e1e5e033a70d\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.377808 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3267cb77-9a07-4d71-aaa4-e1e5e033a70d-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"3267cb77-9a07-4d71-aaa4-e1e5e033a70d\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.378033 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3267cb77-9a07-4d71-aaa4-e1e5e033a70d-logs\") pod \"glance-default-internal-api-0\" (UID: \"3267cb77-9a07-4d71-aaa4-e1e5e033a70d\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.378058 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8h2g5\" (UniqueName: \"kubernetes.io/projected/3267cb77-9a07-4d71-aaa4-e1e5e033a70d-kube-api-access-8h2g5\") pod \"glance-default-internal-api-0\" (UID: \"3267cb77-9a07-4d71-aaa4-e1e5e033a70d\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.378491 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3267cb77-9a07-4d71-aaa4-e1e5e033a70d-scripts\") pod \"glance-default-internal-api-0\" (UID: \"3267cb77-9a07-4d71-aaa4-e1e5e033a70d\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.379479 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"glance-default-internal-api-0\" (UID: \"3267cb77-9a07-4d71-aaa4-e1e5e033a70d\") device mount path \"/mnt/openstack/pv01\"" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.435347 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-c8fc658f4-sqwl6" event={"ID":"34e6ded3-dd6f-46bb-9d23-fa8724b78ace","Type":"ContainerStarted","Data":"ba90d7d4271418c373258f2de19f2ceabbc3fe0f13f63bd5e630054ecae78152"} Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.435808 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-c8fc658f4-sqwl6" podUID="34e6ded3-dd6f-46bb-9d23-fa8724b78ace" containerName="neutron-api" containerID="cri-o://41533c5d5556d3dc95717c5df3eb81b00a5d17695d07e9725bc580ce2a9acefb" gracePeriod=30 Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.436130 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/neutron-c8fc658f4-sqwl6" Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.436088 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-c8fc658f4-sqwl6" podUID="34e6ded3-dd6f-46bb-9d23-fa8724b78ace" containerName="neutron-httpd" containerID="cri-o://ba90d7d4271418c373258f2de19f2ceabbc3fe0f13f63bd5e630054ecae78152" gracePeriod=30 Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.448559 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-7555689c4b-84shq" event={"ID":"e5acac7f-9646-4be1-ac22-31326296e4de","Type":"ContainerStarted","Data":"46c8ba259218ad0ae34a0926e382ef4fa4012a46c5f1102b8d5af7d0f2f25233"} Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.448856 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-7555689c4b-84shq" podUID="e5acac7f-9646-4be1-ac22-31326296e4de" containerName="neutron-api" containerID="cri-o://db52ff3476db6cd59c6777eccc858aa2bfbf71202ed0fd58d0a238530b9853c7" gracePeriod=30 Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.449175 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/neutron-7555689c4b-84shq" Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.449219 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-7555689c4b-84shq" podUID="e5acac7f-9646-4be1-ac22-31326296e4de" containerName="neutron-httpd" containerID="cri-o://46c8ba259218ad0ae34a0926e382ef4fa4012a46c5f1102b8d5af7d0f2f25233" gracePeriod=30 Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.457122 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-f56965744-skhtb" event={"ID":"4907839f-9071-4378-90f6-f92ced0b0bf0","Type":"ContainerStarted","Data":"c015127c07a61c75b148a24b94cb58126066d557796401e4738fd413970294a5"} Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.457270 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/neutron-f56965744-skhtb" Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.466903 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ffa2d14d-1b44-445b-ab47-1bb134223111-config-data" (OuterVolumeSpecName: "config-data") pod "ffa2d14d-1b44-445b-ab47-1bb134223111" (UID: "ffa2d14d-1b44-445b-ab47-1bb134223111"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.470053 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-5fd9d6b8f6-vq7wb" event={"ID":"cb37f123-034b-4ccb-9f71-676a322e2a8b","Type":"ContainerStarted","Data":"29fed01a604b3b52039deb0ab79c03e05a0c7fccb9557526dc131d470624bbf4"} Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.474126 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-c8fc658f4-sqwl6" podStartSLOduration=11.47409942 podStartE2EDuration="11.47409942s" podCreationTimestamp="2026-03-16 16:53:01 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:53:12.455269085 +0000 UTC m=+4894.609200742" watchObservedRunningTime="2026-03-16 16:53:12.47409942 +0000 UTC m=+4894.628031077" Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.482887 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3267cb77-9a07-4d71-aaa4-e1e5e033a70d-logs\") pod \"glance-default-internal-api-0\" (UID: \"3267cb77-9a07-4d71-aaa4-e1e5e033a70d\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.482933 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8h2g5\" (UniqueName: \"kubernetes.io/projected/3267cb77-9a07-4d71-aaa4-e1e5e033a70d-kube-api-access-8h2g5\") pod \"glance-default-internal-api-0\" (UID: \"3267cb77-9a07-4d71-aaa4-e1e5e033a70d\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.483112 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3267cb77-9a07-4d71-aaa4-e1e5e033a70d-scripts\") pod \"glance-default-internal-api-0\" (UID: \"3267cb77-9a07-4d71-aaa4-e1e5e033a70d\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.483569 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3267cb77-9a07-4d71-aaa4-e1e5e033a70d-logs\") pod \"glance-default-internal-api-0\" (UID: \"3267cb77-9a07-4d71-aaa4-e1e5e033a70d\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.484627 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/3267cb77-9a07-4d71-aaa4-e1e5e033a70d-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"3267cb77-9a07-4d71-aaa4-e1e5e033a70d\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.484698 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3267cb77-9a07-4d71-aaa4-e1e5e033a70d-config-data\") pod \"glance-default-internal-api-0\" (UID: \"3267cb77-9a07-4d71-aaa4-e1e5e033a70d\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.489148 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/3267cb77-9a07-4d71-aaa4-e1e5e033a70d-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"3267cb77-9a07-4d71-aaa4-e1e5e033a70d\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.489327 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3267cb77-9a07-4d71-aaa4-e1e5e033a70d-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"3267cb77-9a07-4d71-aaa4-e1e5e033a70d\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.489986 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ffa2d14d-1b44-445b-ab47-1bb134223111-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.490903 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/3267cb77-9a07-4d71-aaa4-e1e5e033a70d-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"3267cb77-9a07-4d71-aaa4-e1e5e033a70d\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.517424 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"3fd94d95-2cbb-4ec5-9413-1a2ddc6480c5","Type":"ContainerStarted","Data":"689441178da2c3680f3bbafa950dbb9dffebf6514eab1e2411af50dc9130eb26"} Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.517935 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-57f7845c4b-tb6nd" Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.549014 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3267cb77-9a07-4d71-aaa4-e1e5e033a70d-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"3267cb77-9a07-4d71-aaa4-e1e5e033a70d\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.552182 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3267cb77-9a07-4d71-aaa4-e1e5e033a70d-scripts\") pod \"glance-default-internal-api-0\" (UID: \"3267cb77-9a07-4d71-aaa4-e1e5e033a70d\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.573985 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-7555689c4b-84shq" podStartSLOduration=12.573958464 podStartE2EDuration="12.573958464s" podCreationTimestamp="2026-03-16 16:53:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:53:12.492890395 +0000 UTC m=+4894.646822052" watchObservedRunningTime="2026-03-16 16:53:12.573958464 +0000 UTC m=+4894.727890121" Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.604884 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-f56965744-skhtb" podStartSLOduration=11.60485666 podStartE2EDuration="11.60485666s" podCreationTimestamp="2026-03-16 16:53:01 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:53:12.540035776 +0000 UTC m=+4894.693967443" watchObservedRunningTime="2026-03-16 16:53:12.60485666 +0000 UTC m=+4894.758788337" Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.615997 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3267cb77-9a07-4d71-aaa4-e1e5e033a70d-config-data\") pod \"glance-default-internal-api-0\" (UID: \"3267cb77-9a07-4d71-aaa4-e1e5e033a70d\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.618147 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8h2g5\" (UniqueName: \"kubernetes.io/projected/3267cb77-9a07-4d71-aaa4-e1e5e033a70d-kube-api-access-8h2g5\") pod \"glance-default-internal-api-0\" (UID: \"3267cb77-9a07-4d71-aaa4-e1e5e033a70d\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.629907 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="b91a9930-eec4-4af5-9aee-5d02dc78fabc" containerName="cinder-scheduler" probeResult="failure" output="Get \"http://10.217.0.137:8080/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.630739 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/3267cb77-9a07-4d71-aaa4-e1e5e033a70d-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"3267cb77-9a07-4d71-aaa4-e1e5e033a70d\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.650992 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.675433 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-ccc65f956-nsglj"] Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.689475 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-ccc65f956-nsglj" Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.778569 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0fba253d-bef6-490a-8d34-6be75a260d03" path="/var/lib/kubelet/pods/0fba253d-bef6-490a-8d34-6be75a260d03/volumes" Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.788705 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="50c82211-4383-41cb-a31c-9bdfb156b586" path="/var/lib/kubelet/pods/50c82211-4383-41cb-a31c-9bdfb156b586/volumes" Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.789865 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="607fee19-adac-44b4-9f70-a6f6f3e59aed" path="/var/lib/kubelet/pods/607fee19-adac-44b4-9f70-a6f6f3e59aed/volumes" Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.799136 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="72edd543-4bf8-407e-9929-47d4e9727134" path="/var/lib/kubelet/pods/72edd543-4bf8-407e-9929-47d4e9727134/volumes" Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.800308 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b4ce877d-d510-483c-9a9c-b149879f1755" path="/var/lib/kubelet/pods/b4ce877d-d510-483c-9a9c-b149879f1755/volumes" Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.803276 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/cb10ccc3-03fc-4eb7-a637-c2bc721a9b69-config-data-custom\") pod \"barbican-keystone-listener-ccc65f956-nsglj\" (UID: \"cb10ccc3-03fc-4eb7-a637-c2bc721a9b69\") " pod="openstack-kuttl-tests/barbican-keystone-listener-ccc65f956-nsglj" Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.803424 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jg2z\" (UniqueName: \"kubernetes.io/projected/cb10ccc3-03fc-4eb7-a637-c2bc721a9b69-kube-api-access-8jg2z\") pod \"barbican-keystone-listener-ccc65f956-nsglj\" (UID: \"cb10ccc3-03fc-4eb7-a637-c2bc721a9b69\") " pod="openstack-kuttl-tests/barbican-keystone-listener-ccc65f956-nsglj" Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.815778 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cb10ccc3-03fc-4eb7-a637-c2bc721a9b69-config-data\") pod \"barbican-keystone-listener-ccc65f956-nsglj\" (UID: \"cb10ccc3-03fc-4eb7-a637-c2bc721a9b69\") " pod="openstack-kuttl-tests/barbican-keystone-listener-ccc65f956-nsglj" Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.816444 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/cb10ccc3-03fc-4eb7-a637-c2bc721a9b69-logs\") pod \"barbican-keystone-listener-ccc65f956-nsglj\" (UID: \"cb10ccc3-03fc-4eb7-a637-c2bc721a9b69\") " pod="openstack-kuttl-tests/barbican-keystone-listener-ccc65f956-nsglj" Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.816546 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cb10ccc3-03fc-4eb7-a637-c2bc721a9b69-combined-ca-bundle\") pod \"barbican-keystone-listener-ccc65f956-nsglj\" (UID: \"cb10ccc3-03fc-4eb7-a637-c2bc721a9b69\") " pod="openstack-kuttl-tests/barbican-keystone-listener-ccc65f956-nsglj" Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.941651 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8jg2z\" (UniqueName: \"kubernetes.io/projected/cb10ccc3-03fc-4eb7-a637-c2bc721a9b69-kube-api-access-8jg2z\") pod \"barbican-keystone-listener-ccc65f956-nsglj\" (UID: \"cb10ccc3-03fc-4eb7-a637-c2bc721a9b69\") " pod="openstack-kuttl-tests/barbican-keystone-listener-ccc65f956-nsglj" Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.978000 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cb10ccc3-03fc-4eb7-a637-c2bc721a9b69-config-data\") pod \"barbican-keystone-listener-ccc65f956-nsglj\" (UID: \"cb10ccc3-03fc-4eb7-a637-c2bc721a9b69\") " pod="openstack-kuttl-tests/barbican-keystone-listener-ccc65f956-nsglj" Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.978501 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/cb10ccc3-03fc-4eb7-a637-c2bc721a9b69-logs\") pod \"barbican-keystone-listener-ccc65f956-nsglj\" (UID: \"cb10ccc3-03fc-4eb7-a637-c2bc721a9b69\") " pod="openstack-kuttl-tests/barbican-keystone-listener-ccc65f956-nsglj" Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.978560 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cb10ccc3-03fc-4eb7-a637-c2bc721a9b69-combined-ca-bundle\") pod \"barbican-keystone-listener-ccc65f956-nsglj\" (UID: \"cb10ccc3-03fc-4eb7-a637-c2bc721a9b69\") " pod="openstack-kuttl-tests/barbican-keystone-listener-ccc65f956-nsglj" Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.978664 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/cb10ccc3-03fc-4eb7-a637-c2bc721a9b69-config-data-custom\") pod \"barbican-keystone-listener-ccc65f956-nsglj\" (UID: \"cb10ccc3-03fc-4eb7-a637-c2bc721a9b69\") " pod="openstack-kuttl-tests/barbican-keystone-listener-ccc65f956-nsglj" Mar 16 16:53:12 crc kubenswrapper[5120]: I0316 16:53:12.979983 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/cb10ccc3-03fc-4eb7-a637-c2bc721a9b69-logs\") pod \"barbican-keystone-listener-ccc65f956-nsglj\" (UID: \"cb10ccc3-03fc-4eb7-a637-c2bc721a9b69\") " pod="openstack-kuttl-tests/barbican-keystone-listener-ccc65f956-nsglj" Mar 16 16:53:13 crc kubenswrapper[5120]: I0316 16:53:13.002041 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ffa2d14d-1b44-445b-ab47-1bb134223111-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ffa2d14d-1b44-445b-ab47-1bb134223111" (UID: "ffa2d14d-1b44-445b-ab47-1bb134223111"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:13 crc kubenswrapper[5120]: I0316 16:53:13.014990 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/cb10ccc3-03fc-4eb7-a637-c2bc721a9b69-config-data-custom\") pod \"barbican-keystone-listener-ccc65f956-nsglj\" (UID: \"cb10ccc3-03fc-4eb7-a637-c2bc721a9b69\") " pod="openstack-kuttl-tests/barbican-keystone-listener-ccc65f956-nsglj" Mar 16 16:53:13 crc kubenswrapper[5120]: I0316 16:53:13.046801 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cb10ccc3-03fc-4eb7-a637-c2bc721a9b69-config-data\") pod \"barbican-keystone-listener-ccc65f956-nsglj\" (UID: \"cb10ccc3-03fc-4eb7-a637-c2bc721a9b69\") " pod="openstack-kuttl-tests/barbican-keystone-listener-ccc65f956-nsglj" Mar 16 16:53:13 crc kubenswrapper[5120]: I0316 16:53:13.079649 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cb10ccc3-03fc-4eb7-a637-c2bc721a9b69-combined-ca-bundle\") pod \"barbican-keystone-listener-ccc65f956-nsglj\" (UID: \"cb10ccc3-03fc-4eb7-a637-c2bc721a9b69\") " pod="openstack-kuttl-tests/barbican-keystone-listener-ccc65f956-nsglj" Mar 16 16:53:13 crc kubenswrapper[5120]: I0316 16:53:13.089147 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ffa2d14d-1b44-445b-ab47-1bb134223111-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:13 crc kubenswrapper[5120]: I0316 16:53:13.142632 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"glance-default-external-api-0\" (UID: \"b609e161-5c22-4699-9af9-7f972834422a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:53:13 crc kubenswrapper[5120]: I0316 16:53:13.143945 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ffa2d14d-1b44-445b-ab47-1bb134223111-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "ffa2d14d-1b44-445b-ab47-1bb134223111" (UID: "ffa2d14d-1b44-445b-ab47-1bb134223111"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:13 crc kubenswrapper[5120]: I0316 16:53:13.144288 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jg2z\" (UniqueName: \"kubernetes.io/projected/cb10ccc3-03fc-4eb7-a637-c2bc721a9b69-kube-api-access-8jg2z\") pod \"barbican-keystone-listener-ccc65f956-nsglj\" (UID: \"cb10ccc3-03fc-4eb7-a637-c2bc721a9b69\") " pod="openstack-kuttl-tests/barbican-keystone-listener-ccc65f956-nsglj" Mar 16 16:53:13 crc kubenswrapper[5120]: I0316 16:53:13.157562 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"glance-default-internal-api-0\" (UID: \"3267cb77-9a07-4d71-aaa4-e1e5e033a70d\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:53:13 crc kubenswrapper[5120]: I0316 16:53:13.179115 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ffa2d14d-1b44-445b-ab47-1bb134223111-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "ffa2d14d-1b44-445b-ab47-1bb134223111" (UID: "ffa2d14d-1b44-445b-ab47-1bb134223111"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:13 crc kubenswrapper[5120]: I0316 16:53:13.202581 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/ffa2d14d-1b44-445b-ab47-1bb134223111-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:13 crc kubenswrapper[5120]: I0316 16:53:13.202622 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ffa2d14d-1b44-445b-ab47-1bb134223111-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:13 crc kubenswrapper[5120]: I0316 16:53:13.252095 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:53:13 crc kubenswrapper[5120]: I0316 16:53:13.252423 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-worker-6f698c8979-vxjjg"] Mar 16 16:53:13 crc kubenswrapper[5120]: I0316 16:53:13.259125 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-ccc65f956-nsglj"] Mar 16 16:53:13 crc kubenswrapper[5120]: I0316 16:53:13.259158 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-6f698c8979-vxjjg"] Mar 16 16:53:13 crc kubenswrapper[5120]: I0316 16:53:13.259168 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 16:53:13 crc kubenswrapper[5120]: I0316 16:53:13.259179 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 16:53:13 crc kubenswrapper[5120]: I0316 16:53:13.259287 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-6f698c8979-vxjjg" Mar 16 16:53:13 crc kubenswrapper[5120]: I0316 16:53:13.264999 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 16:53:13 crc kubenswrapper[5120]: I0316 16:53:13.280751 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-647f8b964-49qkc"] Mar 16 16:53:13 crc kubenswrapper[5120]: I0316 16:53:13.302499 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:53:13 crc kubenswrapper[5120]: I0316 16:53:13.314516 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:53:13 crc kubenswrapper[5120]: I0316 16:53:13.334356 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-api-f67b885f6-v4nhp"] Mar 16 16:53:13 crc kubenswrapper[5120]: I0316 16:53:13.372941 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:53:13 crc kubenswrapper[5120]: I0316 16:53:13.381591 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-7f77bff94b-c5ng2"] Mar 16 16:53:13 crc kubenswrapper[5120]: I0316 16:53:13.381629 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-f67b885f6-v4nhp"] Mar 16 16:53:13 crc kubenswrapper[5120]: I0316 16:53:13.381886 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-7f77bff94b-c5ng2" podUID="67c7567e-232d-4853-961c-dcc1799c7dae" containerName="placement-log" containerID="cri-o://07bbe1168472f1c6963df0f4f0c99eef5b1a0f233ae4b737611b952de551752c" gracePeriod=30 Mar 16 16:53:13 crc kubenswrapper[5120]: I0316 16:53:13.382092 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-f67b885f6-v4nhp" Mar 16 16:53:13 crc kubenswrapper[5120]: I0316 16:53:13.382778 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-7f77bff94b-c5ng2" podUID="67c7567e-232d-4853-961c-dcc1799c7dae" containerName="placement-api" containerID="cri-o://ca50e37e23a978feca05ae4a826e2b04ffb0b3d92fd61ca5f40ef219779adaee" gracePeriod=30 Mar 16 16:53:13 crc kubenswrapper[5120]: I0316 16:53:13.398205 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/placement-7f77bff94b-c5ng2" podUID="67c7567e-232d-4853-961c-dcc1799c7dae" containerName="placement-api" probeResult="failure" output="Get \"https://10.217.0.148:8778/\": EOF" Mar 16 16:53:13 crc kubenswrapper[5120]: I0316 16:53:13.398500 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/placement-7f77bff94b-c5ng2" podUID="67c7567e-232d-4853-961c-dcc1799c7dae" containerName="placement-log" probeResult="failure" output="Get \"https://10.217.0.148:8778/\": EOF" Mar 16 16:53:13 crc kubenswrapper[5120]: I0316 16:53:13.399735 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 16:53:13 crc kubenswrapper[5120]: I0316 16:53:13.411250 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c1cda6a8-906f-4375-8909-a0548d69ecd6-logs\") pod \"barbican-worker-6f698c8979-vxjjg\" (UID: \"c1cda6a8-906f-4375-8909-a0548d69ecd6\") " pod="openstack-kuttl-tests/barbican-worker-6f698c8979-vxjjg" Mar 16 16:53:13 crc kubenswrapper[5120]: I0316 16:53:13.411369 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c1cda6a8-906f-4375-8909-a0548d69ecd6-combined-ca-bundle\") pod \"barbican-worker-6f698c8979-vxjjg\" (UID: \"c1cda6a8-906f-4375-8909-a0548d69ecd6\") " pod="openstack-kuttl-tests/barbican-worker-6f698c8979-vxjjg" Mar 16 16:53:13 crc kubenswrapper[5120]: I0316 16:53:13.415609 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:53:13 crc kubenswrapper[5120]: I0316 16:53:13.427414 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzkh2\" (UniqueName: \"kubernetes.io/projected/c1cda6a8-906f-4375-8909-a0548d69ecd6-kube-api-access-qzkh2\") pod \"barbican-worker-6f698c8979-vxjjg\" (UID: \"c1cda6a8-906f-4375-8909-a0548d69ecd6\") " pod="openstack-kuttl-tests/barbican-worker-6f698c8979-vxjjg" Mar 16 16:53:13 crc kubenswrapper[5120]: I0316 16:53:13.427840 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/c1cda6a8-906f-4375-8909-a0548d69ecd6-config-data-custom\") pod \"barbican-worker-6f698c8979-vxjjg\" (UID: \"c1cda6a8-906f-4375-8909-a0548d69ecd6\") " pod="openstack-kuttl-tests/barbican-worker-6f698c8979-vxjjg" Mar 16 16:53:13 crc kubenswrapper[5120]: I0316 16:53:13.428035 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c1cda6a8-906f-4375-8909-a0548d69ecd6-config-data\") pod \"barbican-worker-6f698c8979-vxjjg\" (UID: \"c1cda6a8-906f-4375-8909-a0548d69ecd6\") " pod="openstack-kuttl-tests/barbican-worker-6f698c8979-vxjjg" Mar 16 16:53:13 crc kubenswrapper[5120]: I0316 16:53:13.433873 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-88757f4fd-w4kvr"] Mar 16 16:53:13 crc kubenswrapper[5120]: I0316 16:53:13.449861 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-88757f4fd-w4kvr"] Mar 16 16:53:13 crc kubenswrapper[5120]: I0316 16:53:13.450199 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-88757f4fd-w4kvr" Mar 16 16:53:13 crc kubenswrapper[5120]: I0316 16:53:13.471801 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:53:13 crc kubenswrapper[5120]: I0316 16:53:13.489819 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:53:13 crc kubenswrapper[5120]: I0316 16:53:13.532438 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c1cda6a8-906f-4375-8909-a0548d69ecd6-combined-ca-bundle\") pod \"barbican-worker-6f698c8979-vxjjg\" (UID: \"c1cda6a8-906f-4375-8909-a0548d69ecd6\") " pod="openstack-kuttl-tests/barbican-worker-6f698c8979-vxjjg" Mar 16 16:53:13 crc kubenswrapper[5120]: I0316 16:53:13.532877 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/133b5e0f-d834-4c59-932f-957221e1727b-combined-ca-bundle\") pod \"barbican-api-f67b885f6-v4nhp\" (UID: \"133b5e0f-d834-4c59-932f-957221e1727b\") " pod="openstack-kuttl-tests/barbican-api-f67b885f6-v4nhp" Mar 16 16:53:13 crc kubenswrapper[5120]: I0316 16:53:13.532978 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qzkh2\" (UniqueName: \"kubernetes.io/projected/c1cda6a8-906f-4375-8909-a0548d69ecd6-kube-api-access-qzkh2\") pod \"barbican-worker-6f698c8979-vxjjg\" (UID: \"c1cda6a8-906f-4375-8909-a0548d69ecd6\") " pod="openstack-kuttl-tests/barbican-worker-6f698c8979-vxjjg" Mar 16 16:53:13 crc kubenswrapper[5120]: I0316 16:53:13.533001 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/133b5e0f-d834-4c59-932f-957221e1727b-config-data-custom\") pod \"barbican-api-f67b885f6-v4nhp\" (UID: \"133b5e0f-d834-4c59-932f-957221e1727b\") " pod="openstack-kuttl-tests/barbican-api-f67b885f6-v4nhp" Mar 16 16:53:13 crc kubenswrapper[5120]: I0316 16:53:13.533031 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/133b5e0f-d834-4c59-932f-957221e1727b-logs\") pod \"barbican-api-f67b885f6-v4nhp\" (UID: \"133b5e0f-d834-4c59-932f-957221e1727b\") " pod="openstack-kuttl-tests/barbican-api-f67b885f6-v4nhp" Mar 16 16:53:13 crc kubenswrapper[5120]: I0316 16:53:13.533048 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/133b5e0f-d834-4c59-932f-957221e1727b-config-data\") pod \"barbican-api-f67b885f6-v4nhp\" (UID: \"133b5e0f-d834-4c59-932f-957221e1727b\") " pod="openstack-kuttl-tests/barbican-api-f67b885f6-v4nhp" Mar 16 16:53:13 crc kubenswrapper[5120]: I0316 16:53:13.533210 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/133b5e0f-d834-4c59-932f-957221e1727b-internal-tls-certs\") pod \"barbican-api-f67b885f6-v4nhp\" (UID: \"133b5e0f-d834-4c59-932f-957221e1727b\") " pod="openstack-kuttl-tests/barbican-api-f67b885f6-v4nhp" Mar 16 16:53:13 crc kubenswrapper[5120]: I0316 16:53:13.533227 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/133b5e0f-d834-4c59-932f-957221e1727b-public-tls-certs\") pod \"barbican-api-f67b885f6-v4nhp\" (UID: \"133b5e0f-d834-4c59-932f-957221e1727b\") " pod="openstack-kuttl-tests/barbican-api-f67b885f6-v4nhp" Mar 16 16:53:13 crc kubenswrapper[5120]: I0316 16:53:13.533285 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/c1cda6a8-906f-4375-8909-a0548d69ecd6-config-data-custom\") pod \"barbican-worker-6f698c8979-vxjjg\" (UID: \"c1cda6a8-906f-4375-8909-a0548d69ecd6\") " pod="openstack-kuttl-tests/barbican-worker-6f698c8979-vxjjg" Mar 16 16:53:13 crc kubenswrapper[5120]: I0316 16:53:13.533405 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c1cda6a8-906f-4375-8909-a0548d69ecd6-config-data\") pod \"barbican-worker-6f698c8979-vxjjg\" (UID: \"c1cda6a8-906f-4375-8909-a0548d69ecd6\") " pod="openstack-kuttl-tests/barbican-worker-6f698c8979-vxjjg" Mar 16 16:53:13 crc kubenswrapper[5120]: I0316 16:53:13.533462 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbr7n\" (UniqueName: \"kubernetes.io/projected/133b5e0f-d834-4c59-932f-957221e1727b-kube-api-access-vbr7n\") pod \"barbican-api-f67b885f6-v4nhp\" (UID: \"133b5e0f-d834-4c59-932f-957221e1727b\") " pod="openstack-kuttl-tests/barbican-api-f67b885f6-v4nhp" Mar 16 16:53:13 crc kubenswrapper[5120]: I0316 16:53:13.533559 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c1cda6a8-906f-4375-8909-a0548d69ecd6-logs\") pod \"barbican-worker-6f698c8979-vxjjg\" (UID: \"c1cda6a8-906f-4375-8909-a0548d69ecd6\") " pod="openstack-kuttl-tests/barbican-worker-6f698c8979-vxjjg" Mar 16 16:53:13 crc kubenswrapper[5120]: I0316 16:53:13.536721 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c1cda6a8-906f-4375-8909-a0548d69ecd6-logs\") pod \"barbican-worker-6f698c8979-vxjjg\" (UID: \"c1cda6a8-906f-4375-8909-a0548d69ecd6\") " pod="openstack-kuttl-tests/barbican-worker-6f698c8979-vxjjg" Mar 16 16:53:13 crc kubenswrapper[5120]: I0316 16:53:13.557501 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c1cda6a8-906f-4375-8909-a0548d69ecd6-config-data\") pod \"barbican-worker-6f698c8979-vxjjg\" (UID: \"c1cda6a8-906f-4375-8909-a0548d69ecd6\") " pod="openstack-kuttl-tests/barbican-worker-6f698c8979-vxjjg" Mar 16 16:53:13 crc kubenswrapper[5120]: I0316 16:53:13.560045 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/c1cda6a8-906f-4375-8909-a0548d69ecd6-config-data-custom\") pod \"barbican-worker-6f698c8979-vxjjg\" (UID: \"c1cda6a8-906f-4375-8909-a0548d69ecd6\") " pod="openstack-kuttl-tests/barbican-worker-6f698c8979-vxjjg" Mar 16 16:53:13 crc kubenswrapper[5120]: I0316 16:53:13.569220 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-ccc65f956-nsglj" Mar 16 16:53:13 crc kubenswrapper[5120]: I0316 16:53:13.572355 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzkh2\" (UniqueName: \"kubernetes.io/projected/c1cda6a8-906f-4375-8909-a0548d69ecd6-kube-api-access-qzkh2\") pod \"barbican-worker-6f698c8979-vxjjg\" (UID: \"c1cda6a8-906f-4375-8909-a0548d69ecd6\") " pod="openstack-kuttl-tests/barbican-worker-6f698c8979-vxjjg" Mar 16 16:53:13 crc kubenswrapper[5120]: I0316 16:53:13.622766 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c1cda6a8-906f-4375-8909-a0548d69ecd6-combined-ca-bundle\") pod \"barbican-worker-6f698c8979-vxjjg\" (UID: \"c1cda6a8-906f-4375-8909-a0548d69ecd6\") " pod="openstack-kuttl-tests/barbican-worker-6f698c8979-vxjjg" Mar 16 16:53:13 crc kubenswrapper[5120]: I0316 16:53:13.642179 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/133b5e0f-d834-4c59-932f-957221e1727b-combined-ca-bundle\") pod \"barbican-api-f67b885f6-v4nhp\" (UID: \"133b5e0f-d834-4c59-932f-957221e1727b\") " pod="openstack-kuttl-tests/barbican-api-f67b885f6-v4nhp" Mar 16 16:53:13 crc kubenswrapper[5120]: I0316 16:53:13.642282 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/133b5e0f-d834-4c59-932f-957221e1727b-config-data-custom\") pod \"barbican-api-f67b885f6-v4nhp\" (UID: \"133b5e0f-d834-4c59-932f-957221e1727b\") " pod="openstack-kuttl-tests/barbican-api-f67b885f6-v4nhp" Mar 16 16:53:13 crc kubenswrapper[5120]: I0316 16:53:13.642322 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/133b5e0f-d834-4c59-932f-957221e1727b-logs\") pod \"barbican-api-f67b885f6-v4nhp\" (UID: \"133b5e0f-d834-4c59-932f-957221e1727b\") " pod="openstack-kuttl-tests/barbican-api-f67b885f6-v4nhp" Mar 16 16:53:13 crc kubenswrapper[5120]: I0316 16:53:13.642378 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/133b5e0f-d834-4c59-932f-957221e1727b-config-data\") pod \"barbican-api-f67b885f6-v4nhp\" (UID: \"133b5e0f-d834-4c59-932f-957221e1727b\") " pod="openstack-kuttl-tests/barbican-api-f67b885f6-v4nhp" Mar 16 16:53:13 crc kubenswrapper[5120]: I0316 16:53:13.642424 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxfk7\" (UniqueName: \"kubernetes.io/projected/9fab4617-1011-48f5-90ae-5415fd9b91b4-kube-api-access-bxfk7\") pod \"placement-88757f4fd-w4kvr\" (UID: \"9fab4617-1011-48f5-90ae-5415fd9b91b4\") " pod="openstack-kuttl-tests/placement-88757f4fd-w4kvr" Mar 16 16:53:13 crc kubenswrapper[5120]: I0316 16:53:13.642588 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/133b5e0f-d834-4c59-932f-957221e1727b-internal-tls-certs\") pod \"barbican-api-f67b885f6-v4nhp\" (UID: \"133b5e0f-d834-4c59-932f-957221e1727b\") " pod="openstack-kuttl-tests/barbican-api-f67b885f6-v4nhp" Mar 16 16:53:13 crc kubenswrapper[5120]: I0316 16:53:13.642611 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/133b5e0f-d834-4c59-932f-957221e1727b-public-tls-certs\") pod \"barbican-api-f67b885f6-v4nhp\" (UID: \"133b5e0f-d834-4c59-932f-957221e1727b\") " pod="openstack-kuttl-tests/barbican-api-f67b885f6-v4nhp" Mar 16 16:53:13 crc kubenswrapper[5120]: I0316 16:53:13.642735 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9fab4617-1011-48f5-90ae-5415fd9b91b4-logs\") pod \"placement-88757f4fd-w4kvr\" (UID: \"9fab4617-1011-48f5-90ae-5415fd9b91b4\") " pod="openstack-kuttl-tests/placement-88757f4fd-w4kvr" Mar 16 16:53:13 crc kubenswrapper[5120]: I0316 16:53:13.642794 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/9fab4617-1011-48f5-90ae-5415fd9b91b4-internal-tls-certs\") pod \"placement-88757f4fd-w4kvr\" (UID: \"9fab4617-1011-48f5-90ae-5415fd9b91b4\") " pod="openstack-kuttl-tests/placement-88757f4fd-w4kvr" Mar 16 16:53:13 crc kubenswrapper[5120]: I0316 16:53:13.642839 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/9fab4617-1011-48f5-90ae-5415fd9b91b4-public-tls-certs\") pod \"placement-88757f4fd-w4kvr\" (UID: \"9fab4617-1011-48f5-90ae-5415fd9b91b4\") " pod="openstack-kuttl-tests/placement-88757f4fd-w4kvr" Mar 16 16:53:13 crc kubenswrapper[5120]: I0316 16:53:13.642907 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9fab4617-1011-48f5-90ae-5415fd9b91b4-combined-ca-bundle\") pod \"placement-88757f4fd-w4kvr\" (UID: \"9fab4617-1011-48f5-90ae-5415fd9b91b4\") " pod="openstack-kuttl-tests/placement-88757f4fd-w4kvr" Mar 16 16:53:13 crc kubenswrapper[5120]: I0316 16:53:13.642935 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9fab4617-1011-48f5-90ae-5415fd9b91b4-config-data\") pod \"placement-88757f4fd-w4kvr\" (UID: \"9fab4617-1011-48f5-90ae-5415fd9b91b4\") " pod="openstack-kuttl-tests/placement-88757f4fd-w4kvr" Mar 16 16:53:13 crc kubenswrapper[5120]: I0316 16:53:13.643006 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vbr7n\" (UniqueName: \"kubernetes.io/projected/133b5e0f-d834-4c59-932f-957221e1727b-kube-api-access-vbr7n\") pod \"barbican-api-f67b885f6-v4nhp\" (UID: \"133b5e0f-d834-4c59-932f-957221e1727b\") " pod="openstack-kuttl-tests/barbican-api-f67b885f6-v4nhp" Mar 16 16:53:13 crc kubenswrapper[5120]: I0316 16:53:13.643033 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9fab4617-1011-48f5-90ae-5415fd9b91b4-scripts\") pod \"placement-88757f4fd-w4kvr\" (UID: \"9fab4617-1011-48f5-90ae-5415fd9b91b4\") " pod="openstack-kuttl-tests/placement-88757f4fd-w4kvr" Mar 16 16:53:13 crc kubenswrapper[5120]: I0316 16:53:13.649835 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-6f698c8979-vxjjg" Mar 16 16:53:13 crc kubenswrapper[5120]: I0316 16:53:13.651377 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/133b5e0f-d834-4c59-932f-957221e1727b-logs\") pod \"barbican-api-f67b885f6-v4nhp\" (UID: \"133b5e0f-d834-4c59-932f-957221e1727b\") " pod="openstack-kuttl-tests/barbican-api-f67b885f6-v4nhp" Mar 16 16:53:13 crc kubenswrapper[5120]: I0316 16:53:13.655357 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/133b5e0f-d834-4c59-932f-957221e1727b-combined-ca-bundle\") pod \"barbican-api-f67b885f6-v4nhp\" (UID: \"133b5e0f-d834-4c59-932f-957221e1727b\") " pod="openstack-kuttl-tests/barbican-api-f67b885f6-v4nhp" Mar 16 16:53:13 crc kubenswrapper[5120]: I0316 16:53:13.663272 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/133b5e0f-d834-4c59-932f-957221e1727b-config-data-custom\") pod \"barbican-api-f67b885f6-v4nhp\" (UID: \"133b5e0f-d834-4c59-932f-957221e1727b\") " pod="openstack-kuttl-tests/barbican-api-f67b885f6-v4nhp" Mar 16 16:53:13 crc kubenswrapper[5120]: I0316 16:53:13.681705 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/133b5e0f-d834-4c59-932f-957221e1727b-public-tls-certs\") pod \"barbican-api-f67b885f6-v4nhp\" (UID: \"133b5e0f-d834-4c59-932f-957221e1727b\") " pod="openstack-kuttl-tests/barbican-api-f67b885f6-v4nhp" Mar 16 16:53:13 crc kubenswrapper[5120]: I0316 16:53:13.682229 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/133b5e0f-d834-4c59-932f-957221e1727b-config-data\") pod \"barbican-api-f67b885f6-v4nhp\" (UID: \"133b5e0f-d834-4c59-932f-957221e1727b\") " pod="openstack-kuttl-tests/barbican-api-f67b885f6-v4nhp" Mar 16 16:53:13 crc kubenswrapper[5120]: I0316 16:53:13.682576 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/133b5e0f-d834-4c59-932f-957221e1727b-internal-tls-certs\") pod \"barbican-api-f67b885f6-v4nhp\" (UID: \"133b5e0f-d834-4c59-932f-957221e1727b\") " pod="openstack-kuttl-tests/barbican-api-f67b885f6-v4nhp" Mar 16 16:53:13 crc kubenswrapper[5120]: I0316 16:53:13.683325 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/openstack-galera-0" podUID="0d9062d0-d8bb-4ab3-b2c5-33fa78833a65" containerName="galera" containerID="cri-o://a01ee0b65bd51a1ae5744353a31cd6d57349aa7e7a9b8915b7f6de317ee1a034" gracePeriod=30 Mar 16 16:53:13 crc kubenswrapper[5120]: I0316 16:53:13.689724 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-647f8b964-49qkc"] Mar 16 16:53:13 crc kubenswrapper[5120]: I0316 16:53:13.692372 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"32963b23-d87d-4107-9a13-32737c586ab3","Type":"ContainerStarted","Data":"f6b4b7cbf54c515ab7a385a6ea30158950a8855c60ac7b02ba9e15f7d0ad1e8f"} Mar 16 16:53:13 crc kubenswrapper[5120]: I0316 16:53:13.706911 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:53:13 crc kubenswrapper[5120]: I0316 16:53:13.707064 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:53:13 crc kubenswrapper[5120]: I0316 16:53:13.711917 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"bd162855-8210-41c5-9494-15a62edf991c","Type":"ContainerStarted","Data":"7eb2a6d797380f16288ad092be047651678618f7e7d6d15349e161a42fff2de3"} Mar 16 16:53:13 crc kubenswrapper[5120]: I0316 16:53:13.722608 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbr7n\" (UniqueName: \"kubernetes.io/projected/133b5e0f-d834-4c59-932f-957221e1727b-kube-api-access-vbr7n\") pod \"barbican-api-f67b885f6-v4nhp\" (UID: \"133b5e0f-d834-4c59-932f-957221e1727b\") " pod="openstack-kuttl-tests/barbican-api-f67b885f6-v4nhp" Mar 16 16:53:13 crc kubenswrapper[5120]: I0316 16:53:13.731209 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"9c42ca14-5afb-4688-a2cf-ddf314020f18","Type":"ContainerStarted","Data":"3d1fa3f05cf04af9cd4ade7a65089fa1f8351ed405ba76f965c47bc010d6ef00"} Mar 16 16:53:13 crc kubenswrapper[5120]: I0316 16:53:13.731395 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:53:13 crc kubenswrapper[5120]: I0316 16:53:13.741433 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-57f7845c4b-tb6nd"] Mar 16 16:53:13 crc kubenswrapper[5120]: I0316 16:53:13.753921 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-57f7845c4b-tb6nd"] Mar 16 16:53:13 crc kubenswrapper[5120]: I0316 16:53:13.761815 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bxfk7\" (UniqueName: \"kubernetes.io/projected/9fab4617-1011-48f5-90ae-5415fd9b91b4-kube-api-access-bxfk7\") pod \"placement-88757f4fd-w4kvr\" (UID: \"9fab4617-1011-48f5-90ae-5415fd9b91b4\") " pod="openstack-kuttl-tests/placement-88757f4fd-w4kvr" Mar 16 16:53:13 crc kubenswrapper[5120]: I0316 16:53:13.762175 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9fab4617-1011-48f5-90ae-5415fd9b91b4-logs\") pod \"placement-88757f4fd-w4kvr\" (UID: \"9fab4617-1011-48f5-90ae-5415fd9b91b4\") " pod="openstack-kuttl-tests/placement-88757f4fd-w4kvr" Mar 16 16:53:13 crc kubenswrapper[5120]: I0316 16:53:13.762226 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/9fab4617-1011-48f5-90ae-5415fd9b91b4-internal-tls-certs\") pod \"placement-88757f4fd-w4kvr\" (UID: \"9fab4617-1011-48f5-90ae-5415fd9b91b4\") " pod="openstack-kuttl-tests/placement-88757f4fd-w4kvr" Mar 16 16:53:13 crc kubenswrapper[5120]: I0316 16:53:13.762264 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/9fab4617-1011-48f5-90ae-5415fd9b91b4-public-tls-certs\") pod \"placement-88757f4fd-w4kvr\" (UID: \"9fab4617-1011-48f5-90ae-5415fd9b91b4\") " pod="openstack-kuttl-tests/placement-88757f4fd-w4kvr" Mar 16 16:53:13 crc kubenswrapper[5120]: I0316 16:53:13.762315 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9fab4617-1011-48f5-90ae-5415fd9b91b4-combined-ca-bundle\") pod \"placement-88757f4fd-w4kvr\" (UID: \"9fab4617-1011-48f5-90ae-5415fd9b91b4\") " pod="openstack-kuttl-tests/placement-88757f4fd-w4kvr" Mar 16 16:53:13 crc kubenswrapper[5120]: I0316 16:53:13.762354 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9fab4617-1011-48f5-90ae-5415fd9b91b4-config-data\") pod \"placement-88757f4fd-w4kvr\" (UID: \"9fab4617-1011-48f5-90ae-5415fd9b91b4\") " pod="openstack-kuttl-tests/placement-88757f4fd-w4kvr" Mar 16 16:53:13 crc kubenswrapper[5120]: I0316 16:53:13.762405 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9fab4617-1011-48f5-90ae-5415fd9b91b4-scripts\") pod \"placement-88757f4fd-w4kvr\" (UID: \"9fab4617-1011-48f5-90ae-5415fd9b91b4\") " pod="openstack-kuttl-tests/placement-88757f4fd-w4kvr" Mar 16 16:53:13 crc kubenswrapper[5120]: I0316 16:53:13.765272 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9fab4617-1011-48f5-90ae-5415fd9b91b4-logs\") pod \"placement-88757f4fd-w4kvr\" (UID: \"9fab4617-1011-48f5-90ae-5415fd9b91b4\") " pod="openstack-kuttl-tests/placement-88757f4fd-w4kvr" Mar 16 16:53:13 crc kubenswrapper[5120]: I0316 16:53:13.766193 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"ef964d2a-6681-47c5-9a3b-29fe733ee9f0","Type":"ContainerStarted","Data":"2446250998c6c251636b6dd4e3ec6efc10eb71eb35137cd20d2e1249fc052665"} Mar 16 16:53:13 crc kubenswrapper[5120]: I0316 16:53:13.769659 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:53:13 crc kubenswrapper[5120]: I0316 16:53:13.771605 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podStartSLOduration=14.771591524 podStartE2EDuration="14.771591524s" podCreationTimestamp="2026-03-16 16:52:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:53:13.715428317 +0000 UTC m=+4895.869359984" watchObservedRunningTime="2026-03-16 16:53:13.771591524 +0000 UTC m=+4895.925523181" Mar 16 16:53:13 crc kubenswrapper[5120]: I0316 16:53:13.780195 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"07523c84-c61c-42f5-9282-324e6cc37cf7","Type":"ContainerStarted","Data":"822c8e6e6d134b675b07faab106cc3ce885e3689e9499fbfbda62fd42059acc7"} Mar 16 16:53:13 crc kubenswrapper[5120]: I0316 16:53:13.780282 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:53:13 crc kubenswrapper[5120]: I0316 16:53:13.781287 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:53:13 crc kubenswrapper[5120]: I0316 16:53:13.785247 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podStartSLOduration=6.785229837 podStartE2EDuration="6.785229837s" podCreationTimestamp="2026-03-16 16:53:07 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:53:13.762570147 +0000 UTC m=+4895.916501804" watchObservedRunningTime="2026-03-16 16:53:13.785229837 +0000 UTC m=+4895.939161494" Mar 16 16:53:13 crc kubenswrapper[5120]: I0316 16:53:13.787710 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9fab4617-1011-48f5-90ae-5415fd9b91b4-combined-ca-bundle\") pod \"placement-88757f4fd-w4kvr\" (UID: \"9fab4617-1011-48f5-90ae-5415fd9b91b4\") " pod="openstack-kuttl-tests/placement-88757f4fd-w4kvr" Mar 16 16:53:13 crc kubenswrapper[5120]: I0316 16:53:13.789432 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/9fab4617-1011-48f5-90ae-5415fd9b91b4-internal-tls-certs\") pod \"placement-88757f4fd-w4kvr\" (UID: \"9fab4617-1011-48f5-90ae-5415fd9b91b4\") " pod="openstack-kuttl-tests/placement-88757f4fd-w4kvr" Mar 16 16:53:13 crc kubenswrapper[5120]: I0316 16:53:13.789472 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9fab4617-1011-48f5-90ae-5415fd9b91b4-scripts\") pod \"placement-88757f4fd-w4kvr\" (UID: \"9fab4617-1011-48f5-90ae-5415fd9b91b4\") " pod="openstack-kuttl-tests/placement-88757f4fd-w4kvr" Mar 16 16:53:13 crc kubenswrapper[5120]: I0316 16:53:13.793042 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9fab4617-1011-48f5-90ae-5415fd9b91b4-config-data\") pod \"placement-88757f4fd-w4kvr\" (UID: \"9fab4617-1011-48f5-90ae-5415fd9b91b4\") " pod="openstack-kuttl-tests/placement-88757f4fd-w4kvr" Mar 16 16:53:13 crc kubenswrapper[5120]: I0316 16:53:13.802463 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/9fab4617-1011-48f5-90ae-5415fd9b91b4-public-tls-certs\") pod \"placement-88757f4fd-w4kvr\" (UID: \"9fab4617-1011-48f5-90ae-5415fd9b91b4\") " pod="openstack-kuttl-tests/placement-88757f4fd-w4kvr" Mar 16 16:53:13 crc kubenswrapper[5120]: I0316 16:53:13.804035 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:53:13 crc kubenswrapper[5120]: I0316 16:53:13.805497 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:53:13 crc kubenswrapper[5120]: I0316 16:53:13.807523 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxfk7\" (UniqueName: \"kubernetes.io/projected/9fab4617-1011-48f5-90ae-5415fd9b91b4-kube-api-access-bxfk7\") pod \"placement-88757f4fd-w4kvr\" (UID: \"9fab4617-1011-48f5-90ae-5415fd9b91b4\") " pod="openstack-kuttl-tests/placement-88757f4fd-w4kvr" Mar 16 16:53:13 crc kubenswrapper[5120]: I0316 16:53:13.852907 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podStartSLOduration=3.852890639 podStartE2EDuration="3.852890639s" podCreationTimestamp="2026-03-16 16:53:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:53:13.84926132 +0000 UTC m=+4896.003192997" watchObservedRunningTime="2026-03-16 16:53:13.852890639 +0000 UTC m=+4896.006822296" Mar 16 16:53:13 crc kubenswrapper[5120]: I0316 16:53:13.878137 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:53:14 crc kubenswrapper[5120]: I0316 16:53:13.996519 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:53:14 crc kubenswrapper[5120]: I0316 16:53:14.007083 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-f67b885f6-v4nhp" Mar 16 16:53:14 crc kubenswrapper[5120]: I0316 16:53:14.047461 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 16:53:14 crc kubenswrapper[5120]: I0316 16:53:14.074022 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-88757f4fd-w4kvr" Mar 16 16:53:14 crc kubenswrapper[5120]: I0316 16:53:14.428577 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 16:53:14 crc kubenswrapper[5120]: I0316 16:53:14.433487 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:53:14 crc kubenswrapper[5120]: I0316 16:53:14.546915 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-6f698c8979-vxjjg"] Mar 16 16:53:14 crc kubenswrapper[5120]: I0316 16:53:14.615819 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-ccc65f956-nsglj"] Mar 16 16:53:14 crc kubenswrapper[5120]: I0316 16:53:14.647825 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-worker-6cc74c8747-7pf27"] Mar 16 16:53:14 crc kubenswrapper[5120]: I0316 16:53:14.665194 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-6cc74c8747-7pf27" Mar 16 16:53:14 crc kubenswrapper[5120]: I0316 16:53:14.721778 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ffa2d14d-1b44-445b-ab47-1bb134223111" path="/var/lib/kubelet/pods/ffa2d14d-1b44-445b-ab47-1bb134223111/volumes" Mar 16 16:53:14 crc kubenswrapper[5120]: I0316 16:53:14.722527 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-6cc74c8747-7pf27"] Mar 16 16:53:14 crc kubenswrapper[5120]: I0316 16:53:14.743956 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-788658cdb6-tsr2b"] Mar 16 16:53:14 crc kubenswrapper[5120]: I0316 16:53:14.817858 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-788658cdb6-tsr2b" Mar 16 16:53:14 crc kubenswrapper[5120]: I0316 16:53:14.819729 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-788658cdb6-tsr2b"] Mar 16 16:53:14 crc kubenswrapper[5120]: I0316 16:53:14.831908 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ae73ae1d-4056-43c2-addd-f08999a4a7f6-config-data\") pod \"barbican-worker-6cc74c8747-7pf27\" (UID: \"ae73ae1d-4056-43c2-addd-f08999a4a7f6\") " pod="openstack-kuttl-tests/barbican-worker-6cc74c8747-7pf27" Mar 16 16:53:14 crc kubenswrapper[5120]: I0316 16:53:14.832057 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ae73ae1d-4056-43c2-addd-f08999a4a7f6-logs\") pod \"barbican-worker-6cc74c8747-7pf27\" (UID: \"ae73ae1d-4056-43c2-addd-f08999a4a7f6\") " pod="openstack-kuttl-tests/barbican-worker-6cc74c8747-7pf27" Mar 16 16:53:14 crc kubenswrapper[5120]: I0316 16:53:14.832085 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ae73ae1d-4056-43c2-addd-f08999a4a7f6-combined-ca-bundle\") pod \"barbican-worker-6cc74c8747-7pf27\" (UID: \"ae73ae1d-4056-43c2-addd-f08999a4a7f6\") " pod="openstack-kuttl-tests/barbican-worker-6cc74c8747-7pf27" Mar 16 16:53:14 crc kubenswrapper[5120]: I0316 16:53:14.832233 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/ae73ae1d-4056-43c2-addd-f08999a4a7f6-config-data-custom\") pod \"barbican-worker-6cc74c8747-7pf27\" (UID: \"ae73ae1d-4056-43c2-addd-f08999a4a7f6\") " pod="openstack-kuttl-tests/barbican-worker-6cc74c8747-7pf27" Mar 16 16:53:14 crc kubenswrapper[5120]: I0316 16:53:14.832314 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dhz2\" (UniqueName: \"kubernetes.io/projected/ae73ae1d-4056-43c2-addd-f08999a4a7f6-kube-api-access-8dhz2\") pod \"barbican-worker-6cc74c8747-7pf27\" (UID: \"ae73ae1d-4056-43c2-addd-f08999a4a7f6\") " pod="openstack-kuttl-tests/barbican-worker-6cc74c8747-7pf27" Mar 16 16:53:14 crc kubenswrapper[5120]: I0316 16:53:14.876817 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"07523c84-c61c-42f5-9282-324e6cc37cf7","Type":"ContainerStarted","Data":"a7a968e6d8db4b5312cb444cbccadb44d543d993578f1d5780def2a96ed57633"} Mar 16 16:53:14 crc kubenswrapper[5120]: I0316 16:53:14.897310 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-647f8b964-49qkc" event={"ID":"a5d3f7a6-64f6-47f9-a144-41a356078e4b","Type":"ContainerStarted","Data":"96358bb813e4ea51a42da5de9b5c9057c4e5124a128d0abfc9544b9ff7fb61e7"} Mar 16 16:53:14 crc kubenswrapper[5120]: I0316 16:53:14.923873 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"bd162855-8210-41c5-9494-15a62edf991c","Type":"ContainerStarted","Data":"de5b56d392648f53e472ea3236bd1ceb79ed7862f164f660f14895f66976aaab"} Mar 16 16:53:14 crc kubenswrapper[5120]: I0316 16:53:14.946215 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-88757f4fd-w4kvr"] Mar 16 16:53:14 crc kubenswrapper[5120]: I0316 16:53:14.956532 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/ae73ae1d-4056-43c2-addd-f08999a4a7f6-config-data-custom\") pod \"barbican-worker-6cc74c8747-7pf27\" (UID: \"ae73ae1d-4056-43c2-addd-f08999a4a7f6\") " pod="openstack-kuttl-tests/barbican-worker-6cc74c8747-7pf27" Mar 16 16:53:14 crc kubenswrapper[5120]: I0316 16:53:14.956665 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xlvvw\" (UniqueName: \"kubernetes.io/projected/472a9d94-a155-4916-aab9-4672a3c6c18c-kube-api-access-xlvvw\") pod \"barbican-keystone-listener-788658cdb6-tsr2b\" (UID: \"472a9d94-a155-4916-aab9-4672a3c6c18c\") " pod="openstack-kuttl-tests/barbican-keystone-listener-788658cdb6-tsr2b" Mar 16 16:53:14 crc kubenswrapper[5120]: I0316 16:53:14.956944 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8dhz2\" (UniqueName: \"kubernetes.io/projected/ae73ae1d-4056-43c2-addd-f08999a4a7f6-kube-api-access-8dhz2\") pod \"barbican-worker-6cc74c8747-7pf27\" (UID: \"ae73ae1d-4056-43c2-addd-f08999a4a7f6\") " pod="openstack-kuttl-tests/barbican-worker-6cc74c8747-7pf27" Mar 16 16:53:14 crc kubenswrapper[5120]: I0316 16:53:14.957005 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/472a9d94-a155-4916-aab9-4672a3c6c18c-config-data-custom\") pod \"barbican-keystone-listener-788658cdb6-tsr2b\" (UID: \"472a9d94-a155-4916-aab9-4672a3c6c18c\") " pod="openstack-kuttl-tests/barbican-keystone-listener-788658cdb6-tsr2b" Mar 16 16:53:14 crc kubenswrapper[5120]: I0316 16:53:14.957075 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/472a9d94-a155-4916-aab9-4672a3c6c18c-combined-ca-bundle\") pod \"barbican-keystone-listener-788658cdb6-tsr2b\" (UID: \"472a9d94-a155-4916-aab9-4672a3c6c18c\") " pod="openstack-kuttl-tests/barbican-keystone-listener-788658cdb6-tsr2b" Mar 16 16:53:14 crc kubenswrapper[5120]: I0316 16:53:14.957409 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ae73ae1d-4056-43c2-addd-f08999a4a7f6-config-data\") pod \"barbican-worker-6cc74c8747-7pf27\" (UID: \"ae73ae1d-4056-43c2-addd-f08999a4a7f6\") " pod="openstack-kuttl-tests/barbican-worker-6cc74c8747-7pf27" Mar 16 16:53:14 crc kubenswrapper[5120]: I0316 16:53:14.957431 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/472a9d94-a155-4916-aab9-4672a3c6c18c-logs\") pod \"barbican-keystone-listener-788658cdb6-tsr2b\" (UID: \"472a9d94-a155-4916-aab9-4672a3c6c18c\") " pod="openstack-kuttl-tests/barbican-keystone-listener-788658cdb6-tsr2b" Mar 16 16:53:14 crc kubenswrapper[5120]: I0316 16:53:14.957609 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ae73ae1d-4056-43c2-addd-f08999a4a7f6-logs\") pod \"barbican-worker-6cc74c8747-7pf27\" (UID: \"ae73ae1d-4056-43c2-addd-f08999a4a7f6\") " pod="openstack-kuttl-tests/barbican-worker-6cc74c8747-7pf27" Mar 16 16:53:14 crc kubenswrapper[5120]: I0316 16:53:14.957639 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ae73ae1d-4056-43c2-addd-f08999a4a7f6-combined-ca-bundle\") pod \"barbican-worker-6cc74c8747-7pf27\" (UID: \"ae73ae1d-4056-43c2-addd-f08999a4a7f6\") " pod="openstack-kuttl-tests/barbican-worker-6cc74c8747-7pf27" Mar 16 16:53:14 crc kubenswrapper[5120]: I0316 16:53:14.957688 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/472a9d94-a155-4916-aab9-4672a3c6c18c-config-data\") pod \"barbican-keystone-listener-788658cdb6-tsr2b\" (UID: \"472a9d94-a155-4916-aab9-4672a3c6c18c\") " pod="openstack-kuttl-tests/barbican-keystone-listener-788658cdb6-tsr2b" Mar 16 16:53:14 crc kubenswrapper[5120]: I0316 16:53:14.968231 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ae73ae1d-4056-43c2-addd-f08999a4a7f6-logs\") pod \"barbican-worker-6cc74c8747-7pf27\" (UID: \"ae73ae1d-4056-43c2-addd-f08999a4a7f6\") " pod="openstack-kuttl-tests/barbican-worker-6cc74c8747-7pf27" Mar 16 16:53:14 crc kubenswrapper[5120]: I0316 16:53:14.980487 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-5fd9d6b8f6-vq7wb" event={"ID":"cb37f123-034b-4ccb-9f71-676a322e2a8b","Type":"ContainerStarted","Data":"053113b17b02d421627a8e291f395e1cfd1afc02c65e30954739fd56da975ac8"} Mar 16 16:53:14 crc kubenswrapper[5120]: I0316 16:53:14.985571 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ae73ae1d-4056-43c2-addd-f08999a4a7f6-config-data\") pod \"barbican-worker-6cc74c8747-7pf27\" (UID: \"ae73ae1d-4056-43c2-addd-f08999a4a7f6\") " pod="openstack-kuttl-tests/barbican-worker-6cc74c8747-7pf27" Mar 16 16:53:15 crc kubenswrapper[5120]: I0316 16:53:15.013929 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-7f78b864cb-6dgjh" podUID="c06f24f9-95b0-4a92-ad3a-6075764151ed" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.0.133:9311/healthcheck\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Mar 16 16:53:15 crc kubenswrapper[5120]: I0316 16:53:15.014356 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openstack-kuttl-tests/barbican-api-7f78b864cb-6dgjh" podUID="c06f24f9-95b0-4a92-ad3a-6075764151ed" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.0.133:9311/healthcheck\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Mar 16 16:53:15 crc kubenswrapper[5120]: I0316 16:53:15.014407 5120 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openstack-kuttl-tests/barbican-api-7f78b864cb-6dgjh" Mar 16 16:53:15 crc kubenswrapper[5120]: I0316 16:53:15.014441 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-7f78b864cb-6dgjh" podUID="c06f24f9-95b0-4a92-ad3a-6075764151ed" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.0.133:9311/healthcheck\": context deadline exceeded" Mar 16 16:53:15 crc kubenswrapper[5120]: I0316 16:53:15.015712 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/ae73ae1d-4056-43c2-addd-f08999a4a7f6-config-data-custom\") pod \"barbican-worker-6cc74c8747-7pf27\" (UID: \"ae73ae1d-4056-43c2-addd-f08999a4a7f6\") " pod="openstack-kuttl-tests/barbican-worker-6cc74c8747-7pf27" Mar 16 16:53:15 crc kubenswrapper[5120]: I0316 16:53:15.038600 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dhz2\" (UniqueName: \"kubernetes.io/projected/ae73ae1d-4056-43c2-addd-f08999a4a7f6-kube-api-access-8dhz2\") pod \"barbican-worker-6cc74c8747-7pf27\" (UID: \"ae73ae1d-4056-43c2-addd-f08999a4a7f6\") " pod="openstack-kuttl-tests/barbican-worker-6cc74c8747-7pf27" Mar 16 16:53:15 crc kubenswrapper[5120]: I0316 16:53:15.044440 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ae73ae1d-4056-43c2-addd-f08999a4a7f6-combined-ca-bundle\") pod \"barbican-worker-6cc74c8747-7pf27\" (UID: \"ae73ae1d-4056-43c2-addd-f08999a4a7f6\") " pod="openstack-kuttl-tests/barbican-worker-6cc74c8747-7pf27" Mar 16 16:53:15 crc kubenswrapper[5120]: I0316 16:53:15.060586 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/472a9d94-a155-4916-aab9-4672a3c6c18c-logs\") pod \"barbican-keystone-listener-788658cdb6-tsr2b\" (UID: \"472a9d94-a155-4916-aab9-4672a3c6c18c\") " pod="openstack-kuttl-tests/barbican-keystone-listener-788658cdb6-tsr2b" Mar 16 16:53:15 crc kubenswrapper[5120]: I0316 16:53:15.060780 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/472a9d94-a155-4916-aab9-4672a3c6c18c-config-data\") pod \"barbican-keystone-listener-788658cdb6-tsr2b\" (UID: \"472a9d94-a155-4916-aab9-4672a3c6c18c\") " pod="openstack-kuttl-tests/barbican-keystone-listener-788658cdb6-tsr2b" Mar 16 16:53:15 crc kubenswrapper[5120]: I0316 16:53:15.060945 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xlvvw\" (UniqueName: \"kubernetes.io/projected/472a9d94-a155-4916-aab9-4672a3c6c18c-kube-api-access-xlvvw\") pod \"barbican-keystone-listener-788658cdb6-tsr2b\" (UID: \"472a9d94-a155-4916-aab9-4672a3c6c18c\") " pod="openstack-kuttl-tests/barbican-keystone-listener-788658cdb6-tsr2b" Mar 16 16:53:15 crc kubenswrapper[5120]: I0316 16:53:15.061013 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/472a9d94-a155-4916-aab9-4672a3c6c18c-config-data-custom\") pod \"barbican-keystone-listener-788658cdb6-tsr2b\" (UID: \"472a9d94-a155-4916-aab9-4672a3c6c18c\") " pod="openstack-kuttl-tests/barbican-keystone-listener-788658cdb6-tsr2b" Mar 16 16:53:15 crc kubenswrapper[5120]: I0316 16:53:15.061059 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/472a9d94-a155-4916-aab9-4672a3c6c18c-combined-ca-bundle\") pod \"barbican-keystone-listener-788658cdb6-tsr2b\" (UID: \"472a9d94-a155-4916-aab9-4672a3c6c18c\") " pod="openstack-kuttl-tests/barbican-keystone-listener-788658cdb6-tsr2b" Mar 16 16:53:15 crc kubenswrapper[5120]: I0316 16:53:15.062388 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/472a9d94-a155-4916-aab9-4672a3c6c18c-logs\") pod \"barbican-keystone-listener-788658cdb6-tsr2b\" (UID: \"472a9d94-a155-4916-aab9-4672a3c6c18c\") " pod="openstack-kuttl-tests/barbican-keystone-listener-788658cdb6-tsr2b" Mar 16 16:53:15 crc kubenswrapper[5120]: I0316 16:53:15.066459 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"3fd94d95-2cbb-4ec5-9413-1a2ddc6480c5","Type":"ContainerStarted","Data":"3aa559655b6f0b1f37412aa77a62ea4ba9bc14a1b72c18329bbf1a6ddbe914b3"} Mar 16 16:53:15 crc kubenswrapper[5120]: I0316 16:53:15.085724 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-f67b885f6-v4nhp"] Mar 16 16:53:15 crc kubenswrapper[5120]: I0316 16:53:15.087527 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/472a9d94-a155-4916-aab9-4672a3c6c18c-combined-ca-bundle\") pod \"barbican-keystone-listener-788658cdb6-tsr2b\" (UID: \"472a9d94-a155-4916-aab9-4672a3c6c18c\") " pod="openstack-kuttl-tests/barbican-keystone-listener-788658cdb6-tsr2b" Mar 16 16:53:15 crc kubenswrapper[5120]: I0316 16:53:15.103038 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/472a9d94-a155-4916-aab9-4672a3c6c18c-config-data-custom\") pod \"barbican-keystone-listener-788658cdb6-tsr2b\" (UID: \"472a9d94-a155-4916-aab9-4672a3c6c18c\") " pod="openstack-kuttl-tests/barbican-keystone-listener-788658cdb6-tsr2b" Mar 16 16:53:15 crc kubenswrapper[5120]: I0316 16:53:15.105593 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/472a9d94-a155-4916-aab9-4672a3c6c18c-config-data\") pod \"barbican-keystone-listener-788658cdb6-tsr2b\" (UID: \"472a9d94-a155-4916-aab9-4672a3c6c18c\") " pod="openstack-kuttl-tests/barbican-keystone-listener-788658cdb6-tsr2b" Mar 16 16:53:15 crc kubenswrapper[5120]: I0316 16:53:15.129175 5120 generic.go:358] "Generic (PLEG): container finished" podID="67c7567e-232d-4853-961c-dcc1799c7dae" containerID="07bbe1168472f1c6963df0f4f0c99eef5b1a0f233ae4b737611b952de551752c" exitCode=143 Mar 16 16:53:15 crc kubenswrapper[5120]: I0316 16:53:15.129348 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-7f77bff94b-c5ng2" event={"ID":"67c7567e-232d-4853-961c-dcc1799c7dae","Type":"ContainerDied","Data":"07bbe1168472f1c6963df0f4f0c99eef5b1a0f233ae4b737611b952de551752c"} Mar 16 16:53:15 crc kubenswrapper[5120]: I0316 16:53:15.130245 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-584b8687b4-5c6lr"] Mar 16 16:53:15 crc kubenswrapper[5120]: I0316 16:53:15.159489 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xlvvw\" (UniqueName: \"kubernetes.io/projected/472a9d94-a155-4916-aab9-4672a3c6c18c-kube-api-access-xlvvw\") pod \"barbican-keystone-listener-788658cdb6-tsr2b\" (UID: \"472a9d94-a155-4916-aab9-4672a3c6c18c\") " pod="openstack-kuttl-tests/barbican-keystone-listener-788658cdb6-tsr2b" Mar 16 16:53:15 crc kubenswrapper[5120]: I0316 16:53:15.228853 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-584b8687b4-5c6lr"] Mar 16 16:53:15 crc kubenswrapper[5120]: I0316 16:53:15.229173 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-584b8687b4-5c6lr" Mar 16 16:53:15 crc kubenswrapper[5120]: I0316 16:53:15.257605 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-788658cdb6-tsr2b" Mar 16 16:53:15 crc kubenswrapper[5120]: I0316 16:53:15.285182 5120 generic.go:358] "Generic (PLEG): container finished" podID="19792b24-d033-444c-85e4-6c61e15b3ef9" containerID="f662ae8c35ca1f96dfff51a14c8bfa217d6d3c3615aefcfaf4fbaab8e0e3c8ff" exitCode=137 Mar 16 16:53:15 crc kubenswrapper[5120]: I0316 16:53:15.285342 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"19792b24-d033-444c-85e4-6c61e15b3ef9","Type":"ContainerDied","Data":"f662ae8c35ca1f96dfff51a14c8bfa217d6d3c3615aefcfaf4fbaab8e0e3c8ff"} Mar 16 16:53:15 crc kubenswrapper[5120]: I0316 16:53:15.305631 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-api-78dc5f4cb-mjvvc"] Mar 16 16:53:15 crc kubenswrapper[5120]: I0316 16:53:15.316293 5120 generic.go:358] "Generic (PLEG): container finished" podID="0d9062d0-d8bb-4ab3-b2c5-33fa78833a65" containerID="a01ee0b65bd51a1ae5744353a31cd6d57349aa7e7a9b8915b7f6de317ee1a034" exitCode=143 Mar 16 16:53:15 crc kubenswrapper[5120]: I0316 16:53:15.319816 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podUID="32963b23-d87d-4107-9a13-32737c586ab3" containerName="openstack-network-exporter" containerID="cri-o://f6b4b7cbf54c515ab7a385a6ea30158950a8855c60ac7b02ba9e15f7d0ad1e8f" gracePeriod=300 Mar 16 16:53:15 crc kubenswrapper[5120]: I0316 16:53:15.320545 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podUID="6792b2c6-f5cf-454a-858a-cbd4159db76a" containerName="openstack-network-exporter" containerID="cri-o://80e2bda6dda2c8ad05b4c7384f2d187b58b6cdc73a7dd75783a0030f0515db21" gracePeriod=300 Mar 16 16:53:15 crc kubenswrapper[5120]: I0316 16:53:15.322590 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-78dc5f4cb-mjvvc" Mar 16 16:53:15 crc kubenswrapper[5120]: I0316 16:53:15.323710 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"0d9062d0-d8bb-4ab3-b2c5-33fa78833a65","Type":"ContainerDied","Data":"a01ee0b65bd51a1ae5744353a31cd6d57349aa7e7a9b8915b7f6de317ee1a034"} Mar 16 16:53:15 crc kubenswrapper[5120]: I0316 16:53:15.366346 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-6cc74c8747-7pf27" Mar 16 16:53:15 crc kubenswrapper[5120]: I0316 16:53:15.367449 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:53:15 crc kubenswrapper[5120]: I0316 16:53:15.397632 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/152925c6-48ae-4e8d-9a3f-68f01278fe95-internal-tls-certs\") pod \"barbican-api-78dc5f4cb-mjvvc\" (UID: \"152925c6-48ae-4e8d-9a3f-68f01278fe95\") " pod="openstack-kuttl-tests/barbican-api-78dc5f4cb-mjvvc" Mar 16 16:53:15 crc kubenswrapper[5120]: I0316 16:53:15.400477 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6ttt\" (UniqueName: \"kubernetes.io/projected/cc4853a6-faf5-45dc-b6f4-aa0b65d0ca8d-kube-api-access-n6ttt\") pod \"placement-584b8687b4-5c6lr\" (UID: \"cc4853a6-faf5-45dc-b6f4-aa0b65d0ca8d\") " pod="openstack-kuttl-tests/placement-584b8687b4-5c6lr" Mar 16 16:53:15 crc kubenswrapper[5120]: I0316 16:53:15.400647 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/152925c6-48ae-4e8d-9a3f-68f01278fe95-config-data-custom\") pod \"barbican-api-78dc5f4cb-mjvvc\" (UID: \"152925c6-48ae-4e8d-9a3f-68f01278fe95\") " pod="openstack-kuttl-tests/barbican-api-78dc5f4cb-mjvvc" Mar 16 16:53:15 crc kubenswrapper[5120]: I0316 16:53:15.400794 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/152925c6-48ae-4e8d-9a3f-68f01278fe95-config-data\") pod \"barbican-api-78dc5f4cb-mjvvc\" (UID: \"152925c6-48ae-4e8d-9a3f-68f01278fe95\") " pod="openstack-kuttl-tests/barbican-api-78dc5f4cb-mjvvc" Mar 16 16:53:15 crc kubenswrapper[5120]: I0316 16:53:15.401041 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/cc4853a6-faf5-45dc-b6f4-aa0b65d0ca8d-logs\") pod \"placement-584b8687b4-5c6lr\" (UID: \"cc4853a6-faf5-45dc-b6f4-aa0b65d0ca8d\") " pod="openstack-kuttl-tests/placement-584b8687b4-5c6lr" Mar 16 16:53:15 crc kubenswrapper[5120]: I0316 16:53:15.405058 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cc4853a6-faf5-45dc-b6f4-aa0b65d0ca8d-config-data\") pod \"placement-584b8687b4-5c6lr\" (UID: \"cc4853a6-faf5-45dc-b6f4-aa0b65d0ca8d\") " pod="openstack-kuttl-tests/placement-584b8687b4-5c6lr" Mar 16 16:53:15 crc kubenswrapper[5120]: I0316 16:53:15.405414 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/cc4853a6-faf5-45dc-b6f4-aa0b65d0ca8d-public-tls-certs\") pod \"placement-584b8687b4-5c6lr\" (UID: \"cc4853a6-faf5-45dc-b6f4-aa0b65d0ca8d\") " pod="openstack-kuttl-tests/placement-584b8687b4-5c6lr" Mar 16 16:53:15 crc kubenswrapper[5120]: I0316 16:53:15.406944 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/152925c6-48ae-4e8d-9a3f-68f01278fe95-logs\") pod \"barbican-api-78dc5f4cb-mjvvc\" (UID: \"152925c6-48ae-4e8d-9a3f-68f01278fe95\") " pod="openstack-kuttl-tests/barbican-api-78dc5f4cb-mjvvc" Mar 16 16:53:15 crc kubenswrapper[5120]: I0316 16:53:15.407385 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cc4853a6-faf5-45dc-b6f4-aa0b65d0ca8d-combined-ca-bundle\") pod \"placement-584b8687b4-5c6lr\" (UID: \"cc4853a6-faf5-45dc-b6f4-aa0b65d0ca8d\") " pod="openstack-kuttl-tests/placement-584b8687b4-5c6lr" Mar 16 16:53:15 crc kubenswrapper[5120]: I0316 16:53:15.410116 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xntln\" (UniqueName: \"kubernetes.io/projected/152925c6-48ae-4e8d-9a3f-68f01278fe95-kube-api-access-xntln\") pod \"barbican-api-78dc5f4cb-mjvvc\" (UID: \"152925c6-48ae-4e8d-9a3f-68f01278fe95\") " pod="openstack-kuttl-tests/barbican-api-78dc5f4cb-mjvvc" Mar 16 16:53:15 crc kubenswrapper[5120]: I0316 16:53:15.411510 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/152925c6-48ae-4e8d-9a3f-68f01278fe95-combined-ca-bundle\") pod \"barbican-api-78dc5f4cb-mjvvc\" (UID: \"152925c6-48ae-4e8d-9a3f-68f01278fe95\") " pod="openstack-kuttl-tests/barbican-api-78dc5f4cb-mjvvc" Mar 16 16:53:15 crc kubenswrapper[5120]: I0316 16:53:15.414667 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/152925c6-48ae-4e8d-9a3f-68f01278fe95-public-tls-certs\") pod \"barbican-api-78dc5f4cb-mjvvc\" (UID: \"152925c6-48ae-4e8d-9a3f-68f01278fe95\") " pod="openstack-kuttl-tests/barbican-api-78dc5f4cb-mjvvc" Mar 16 16:53:15 crc kubenswrapper[5120]: I0316 16:53:15.414884 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/cc4853a6-faf5-45dc-b6f4-aa0b65d0ca8d-scripts\") pod \"placement-584b8687b4-5c6lr\" (UID: \"cc4853a6-faf5-45dc-b6f4-aa0b65d0ca8d\") " pod="openstack-kuttl-tests/placement-584b8687b4-5c6lr" Mar 16 16:53:15 crc kubenswrapper[5120]: I0316 16:53:15.415213 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/cc4853a6-faf5-45dc-b6f4-aa0b65d0ca8d-internal-tls-certs\") pod \"placement-584b8687b4-5c6lr\" (UID: \"cc4853a6-faf5-45dc-b6f4-aa0b65d0ca8d\") " pod="openstack-kuttl-tests/placement-584b8687b4-5c6lr" Mar 16 16:53:15 crc kubenswrapper[5120]: I0316 16:53:15.433572 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-78dc5f4cb-mjvvc"] Mar 16 16:53:15 crc kubenswrapper[5120]: I0316 16:53:15.494847 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:53:15 crc kubenswrapper[5120]: I0316 16:53:15.531056 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=8.531029561 podStartE2EDuration="8.531029561s" podCreationTimestamp="2026-03-16 16:53:07 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:53:15.128918855 +0000 UTC m=+4897.282850502" watchObservedRunningTime="2026-03-16 16:53:15.531029561 +0000 UTC m=+4897.684961218" Mar 16 16:53:15 crc kubenswrapper[5120]: I0316 16:53:15.532792 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/0d9062d0-d8bb-4ab3-b2c5-33fa78833a65-config-data-default\") pod \"0d9062d0-d8bb-4ab3-b2c5-33fa78833a65\" (UID: \"0d9062d0-d8bb-4ab3-b2c5-33fa78833a65\") " Mar 16 16:53:15 crc kubenswrapper[5120]: I0316 16:53:15.534537 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d9062d0-d8bb-4ab3-b2c5-33fa78833a65-config-data-default" (OuterVolumeSpecName: "config-data-default") pod "0d9062d0-d8bb-4ab3-b2c5-33fa78833a65" (UID: "0d9062d0-d8bb-4ab3-b2c5-33fa78833a65"). InnerVolumeSpecName "config-data-default". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:53:15 crc kubenswrapper[5120]: I0316 16:53:15.538344 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/cc4853a6-faf5-45dc-b6f4-aa0b65d0ca8d-public-tls-certs\") pod \"placement-584b8687b4-5c6lr\" (UID: \"cc4853a6-faf5-45dc-b6f4-aa0b65d0ca8d\") " pod="openstack-kuttl-tests/placement-584b8687b4-5c6lr" Mar 16 16:53:15 crc kubenswrapper[5120]: I0316 16:53:15.538617 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/152925c6-48ae-4e8d-9a3f-68f01278fe95-logs\") pod \"barbican-api-78dc5f4cb-mjvvc\" (UID: \"152925c6-48ae-4e8d-9a3f-68f01278fe95\") " pod="openstack-kuttl-tests/barbican-api-78dc5f4cb-mjvvc" Mar 16 16:53:15 crc kubenswrapper[5120]: I0316 16:53:15.539022 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cc4853a6-faf5-45dc-b6f4-aa0b65d0ca8d-combined-ca-bundle\") pod \"placement-584b8687b4-5c6lr\" (UID: \"cc4853a6-faf5-45dc-b6f4-aa0b65d0ca8d\") " pod="openstack-kuttl-tests/placement-584b8687b4-5c6lr" Mar 16 16:53:15 crc kubenswrapper[5120]: I0316 16:53:15.542492 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/152925c6-48ae-4e8d-9a3f-68f01278fe95-logs\") pod \"barbican-api-78dc5f4cb-mjvvc\" (UID: \"152925c6-48ae-4e8d-9a3f-68f01278fe95\") " pod="openstack-kuttl-tests/barbican-api-78dc5f4cb-mjvvc" Mar 16 16:53:15 crc kubenswrapper[5120]: I0316 16:53:15.550054 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xntln\" (UniqueName: \"kubernetes.io/projected/152925c6-48ae-4e8d-9a3f-68f01278fe95-kube-api-access-xntln\") pod \"barbican-api-78dc5f4cb-mjvvc\" (UID: \"152925c6-48ae-4e8d-9a3f-68f01278fe95\") " pod="openstack-kuttl-tests/barbican-api-78dc5f4cb-mjvvc" Mar 16 16:53:15 crc kubenswrapper[5120]: I0316 16:53:15.551074 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/152925c6-48ae-4e8d-9a3f-68f01278fe95-combined-ca-bundle\") pod \"barbican-api-78dc5f4cb-mjvvc\" (UID: \"152925c6-48ae-4e8d-9a3f-68f01278fe95\") " pod="openstack-kuttl-tests/barbican-api-78dc5f4cb-mjvvc" Mar 16 16:53:15 crc kubenswrapper[5120]: I0316 16:53:15.551136 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/152925c6-48ae-4e8d-9a3f-68f01278fe95-public-tls-certs\") pod \"barbican-api-78dc5f4cb-mjvvc\" (UID: \"152925c6-48ae-4e8d-9a3f-68f01278fe95\") " pod="openstack-kuttl-tests/barbican-api-78dc5f4cb-mjvvc" Mar 16 16:53:15 crc kubenswrapper[5120]: I0316 16:53:15.551171 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/cc4853a6-faf5-45dc-b6f4-aa0b65d0ca8d-scripts\") pod \"placement-584b8687b4-5c6lr\" (UID: \"cc4853a6-faf5-45dc-b6f4-aa0b65d0ca8d\") " pod="openstack-kuttl-tests/placement-584b8687b4-5c6lr" Mar 16 16:53:15 crc kubenswrapper[5120]: I0316 16:53:15.551389 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/cc4853a6-faf5-45dc-b6f4-aa0b65d0ca8d-internal-tls-certs\") pod \"placement-584b8687b4-5c6lr\" (UID: \"cc4853a6-faf5-45dc-b6f4-aa0b65d0ca8d\") " pod="openstack-kuttl-tests/placement-584b8687b4-5c6lr" Mar 16 16:53:15 crc kubenswrapper[5120]: I0316 16:53:15.551455 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/152925c6-48ae-4e8d-9a3f-68f01278fe95-internal-tls-certs\") pod \"barbican-api-78dc5f4cb-mjvvc\" (UID: \"152925c6-48ae-4e8d-9a3f-68f01278fe95\") " pod="openstack-kuttl-tests/barbican-api-78dc5f4cb-mjvvc" Mar 16 16:53:15 crc kubenswrapper[5120]: I0316 16:53:15.551554 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n6ttt\" (UniqueName: \"kubernetes.io/projected/cc4853a6-faf5-45dc-b6f4-aa0b65d0ca8d-kube-api-access-n6ttt\") pod \"placement-584b8687b4-5c6lr\" (UID: \"cc4853a6-faf5-45dc-b6f4-aa0b65d0ca8d\") " pod="openstack-kuttl-tests/placement-584b8687b4-5c6lr" Mar 16 16:53:15 crc kubenswrapper[5120]: I0316 16:53:15.551612 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/152925c6-48ae-4e8d-9a3f-68f01278fe95-config-data-custom\") pod \"barbican-api-78dc5f4cb-mjvvc\" (UID: \"152925c6-48ae-4e8d-9a3f-68f01278fe95\") " pod="openstack-kuttl-tests/barbican-api-78dc5f4cb-mjvvc" Mar 16 16:53:15 crc kubenswrapper[5120]: I0316 16:53:15.551634 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/152925c6-48ae-4e8d-9a3f-68f01278fe95-config-data\") pod \"barbican-api-78dc5f4cb-mjvvc\" (UID: \"152925c6-48ae-4e8d-9a3f-68f01278fe95\") " pod="openstack-kuttl-tests/barbican-api-78dc5f4cb-mjvvc" Mar 16 16:53:15 crc kubenswrapper[5120]: I0316 16:53:15.551741 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/cc4853a6-faf5-45dc-b6f4-aa0b65d0ca8d-logs\") pod \"placement-584b8687b4-5c6lr\" (UID: \"cc4853a6-faf5-45dc-b6f4-aa0b65d0ca8d\") " pod="openstack-kuttl-tests/placement-584b8687b4-5c6lr" Mar 16 16:53:15 crc kubenswrapper[5120]: I0316 16:53:15.551826 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cc4853a6-faf5-45dc-b6f4-aa0b65d0ca8d-config-data\") pod \"placement-584b8687b4-5c6lr\" (UID: \"cc4853a6-faf5-45dc-b6f4-aa0b65d0ca8d\") " pod="openstack-kuttl-tests/placement-584b8687b4-5c6lr" Mar 16 16:53:15 crc kubenswrapper[5120]: I0316 16:53:15.551976 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/0d9062d0-d8bb-4ab3-b2c5-33fa78833a65-config-data-default\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:15 crc kubenswrapper[5120]: I0316 16:53:15.561149 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/cc4853a6-faf5-45dc-b6f4-aa0b65d0ca8d-logs\") pod \"placement-584b8687b4-5c6lr\" (UID: \"cc4853a6-faf5-45dc-b6f4-aa0b65d0ca8d\") " pod="openstack-kuttl-tests/placement-584b8687b4-5c6lr" Mar 16 16:53:15 crc kubenswrapper[5120]: I0316 16:53:15.573362 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podUID="6792b2c6-f5cf-454a-858a-cbd4159db76a" containerName="ovsdbserver-sb" containerID="cri-o://b906fd70f36d377ce541811ff12a62e890d86300690ff722e603d902f637f772" gracePeriod=300 Mar 16 16:53:15 crc kubenswrapper[5120]: I0316 16:53:15.592653 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/152925c6-48ae-4e8d-9a3f-68f01278fe95-combined-ca-bundle\") pod \"barbican-api-78dc5f4cb-mjvvc\" (UID: \"152925c6-48ae-4e8d-9a3f-68f01278fe95\") " pod="openstack-kuttl-tests/barbican-api-78dc5f4cb-mjvvc" Mar 16 16:53:15 crc kubenswrapper[5120]: I0316 16:53:15.595155 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/cc4853a6-faf5-45dc-b6f4-aa0b65d0ca8d-internal-tls-certs\") pod \"placement-584b8687b4-5c6lr\" (UID: \"cc4853a6-faf5-45dc-b6f4-aa0b65d0ca8d\") " pod="openstack-kuttl-tests/placement-584b8687b4-5c6lr" Mar 16 16:53:15 crc kubenswrapper[5120]: I0316 16:53:15.595434 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/152925c6-48ae-4e8d-9a3f-68f01278fe95-internal-tls-certs\") pod \"barbican-api-78dc5f4cb-mjvvc\" (UID: \"152925c6-48ae-4e8d-9a3f-68f01278fe95\") " pod="openstack-kuttl-tests/barbican-api-78dc5f4cb-mjvvc" Mar 16 16:53:15 crc kubenswrapper[5120]: I0316 16:53:15.595931 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cc4853a6-faf5-45dc-b6f4-aa0b65d0ca8d-config-data\") pod \"placement-584b8687b4-5c6lr\" (UID: \"cc4853a6-faf5-45dc-b6f4-aa0b65d0ca8d\") " pod="openstack-kuttl-tests/placement-584b8687b4-5c6lr" Mar 16 16:53:15 crc kubenswrapper[5120]: I0316 16:53:15.596317 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/cc4853a6-faf5-45dc-b6f4-aa0b65d0ca8d-public-tls-certs\") pod \"placement-584b8687b4-5c6lr\" (UID: \"cc4853a6-faf5-45dc-b6f4-aa0b65d0ca8d\") " pod="openstack-kuttl-tests/placement-584b8687b4-5c6lr" Mar 16 16:53:15 crc kubenswrapper[5120]: I0316 16:53:15.599836 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/152925c6-48ae-4e8d-9a3f-68f01278fe95-public-tls-certs\") pod \"barbican-api-78dc5f4cb-mjvvc\" (UID: \"152925c6-48ae-4e8d-9a3f-68f01278fe95\") " pod="openstack-kuttl-tests/barbican-api-78dc5f4cb-mjvvc" Mar 16 16:53:15 crc kubenswrapper[5120]: I0316 16:53:15.613599 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cc4853a6-faf5-45dc-b6f4-aa0b65d0ca8d-combined-ca-bundle\") pod \"placement-584b8687b4-5c6lr\" (UID: \"cc4853a6-faf5-45dc-b6f4-aa0b65d0ca8d\") " pod="openstack-kuttl-tests/placement-584b8687b4-5c6lr" Mar 16 16:53:15 crc kubenswrapper[5120]: I0316 16:53:15.614562 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/152925c6-48ae-4e8d-9a3f-68f01278fe95-config-data\") pod \"barbican-api-78dc5f4cb-mjvvc\" (UID: \"152925c6-48ae-4e8d-9a3f-68f01278fe95\") " pod="openstack-kuttl-tests/barbican-api-78dc5f4cb-mjvvc" Mar 16 16:53:15 crc kubenswrapper[5120]: I0316 16:53:15.624410 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xntln\" (UniqueName: \"kubernetes.io/projected/152925c6-48ae-4e8d-9a3f-68f01278fe95-kube-api-access-xntln\") pod \"barbican-api-78dc5f4cb-mjvvc\" (UID: \"152925c6-48ae-4e8d-9a3f-68f01278fe95\") " pod="openstack-kuttl-tests/barbican-api-78dc5f4cb-mjvvc" Mar 16 16:53:15 crc kubenswrapper[5120]: I0316 16:53:15.624516 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/152925c6-48ae-4e8d-9a3f-68f01278fe95-config-data-custom\") pod \"barbican-api-78dc5f4cb-mjvvc\" (UID: \"152925c6-48ae-4e8d-9a3f-68f01278fe95\") " pod="openstack-kuttl-tests/barbican-api-78dc5f4cb-mjvvc" Mar 16 16:53:15 crc kubenswrapper[5120]: I0316 16:53:15.654655 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"mysql-db\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"0d9062d0-d8bb-4ab3-b2c5-33fa78833a65\" (UID: \"0d9062d0-d8bb-4ab3-b2c5-33fa78833a65\") " Mar 16 16:53:15 crc kubenswrapper[5120]: I0316 16:53:15.654777 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0d9062d0-d8bb-4ab3-b2c5-33fa78833a65-operator-scripts\") pod \"0d9062d0-d8bb-4ab3-b2c5-33fa78833a65\" (UID: \"0d9062d0-d8bb-4ab3-b2c5-33fa78833a65\") " Mar 16 16:53:15 crc kubenswrapper[5120]: I0316 16:53:15.654847 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/0d9062d0-d8bb-4ab3-b2c5-33fa78833a65-kolla-config\") pod \"0d9062d0-d8bb-4ab3-b2c5-33fa78833a65\" (UID: \"0d9062d0-d8bb-4ab3-b2c5-33fa78833a65\") " Mar 16 16:53:15 crc kubenswrapper[5120]: I0316 16:53:15.656973 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d9062d0-d8bb-4ab3-b2c5-33fa78833a65-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "0d9062d0-d8bb-4ab3-b2c5-33fa78833a65" (UID: "0d9062d0-d8bb-4ab3-b2c5-33fa78833a65"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:53:15 crc kubenswrapper[5120]: I0316 16:53:15.662170 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d9062d0-d8bb-4ab3-b2c5-33fa78833a65-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "0d9062d0-d8bb-4ab3-b2c5-33fa78833a65" (UID: "0d9062d0-d8bb-4ab3-b2c5-33fa78833a65"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:53:15 crc kubenswrapper[5120]: I0316 16:53:15.666227 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podUID="32963b23-d87d-4107-9a13-32737c586ab3" containerName="ovsdbserver-nb" containerID="cri-o://8255a8dd841a9b7e8d1b59806b937aaa4fdc84daf4b743c2df720b34b3c55d87" gracePeriod=300 Mar 16 16:53:15 crc kubenswrapper[5120]: I0316 16:53:15.672272 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6ttt\" (UniqueName: \"kubernetes.io/projected/cc4853a6-faf5-45dc-b6f4-aa0b65d0ca8d-kube-api-access-n6ttt\") pod \"placement-584b8687b4-5c6lr\" (UID: \"cc4853a6-faf5-45dc-b6f4-aa0b65d0ca8d\") " pod="openstack-kuttl-tests/placement-584b8687b4-5c6lr" Mar 16 16:53:15 crc kubenswrapper[5120]: I0316 16:53:15.679910 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/cc4853a6-faf5-45dc-b6f4-aa0b65d0ca8d-scripts\") pod \"placement-584b8687b4-5c6lr\" (UID: \"cc4853a6-faf5-45dc-b6f4-aa0b65d0ca8d\") " pod="openstack-kuttl-tests/placement-584b8687b4-5c6lr" Mar 16 16:53:15 crc kubenswrapper[5120]: I0316 16:53:15.706557 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pncwl\" (UniqueName: \"kubernetes.io/projected/0d9062d0-d8bb-4ab3-b2c5-33fa78833a65-kube-api-access-pncwl\") pod \"0d9062d0-d8bb-4ab3-b2c5-33fa78833a65\" (UID: \"0d9062d0-d8bb-4ab3-b2c5-33fa78833a65\") " Mar 16 16:53:15 crc kubenswrapper[5120]: I0316 16:53:15.706632 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/0d9062d0-d8bb-4ab3-b2c5-33fa78833a65-galera-tls-certs\") pod \"0d9062d0-d8bb-4ab3-b2c5-33fa78833a65\" (UID: \"0d9062d0-d8bb-4ab3-b2c5-33fa78833a65\") " Mar 16 16:53:15 crc kubenswrapper[5120]: I0316 16:53:15.706720 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0d9062d0-d8bb-4ab3-b2c5-33fa78833a65-combined-ca-bundle\") pod \"0d9062d0-d8bb-4ab3-b2c5-33fa78833a65\" (UID: \"0d9062d0-d8bb-4ab3-b2c5-33fa78833a65\") " Mar 16 16:53:15 crc kubenswrapper[5120]: I0316 16:53:15.706972 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/0d9062d0-d8bb-4ab3-b2c5-33fa78833a65-config-data-generated\") pod \"0d9062d0-d8bb-4ab3-b2c5-33fa78833a65\" (UID: \"0d9062d0-d8bb-4ab3-b2c5-33fa78833a65\") " Mar 16 16:53:15 crc kubenswrapper[5120]: I0316 16:53:15.708842 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0d9062d0-d8bb-4ab3-b2c5-33fa78833a65-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:15 crc kubenswrapper[5120]: I0316 16:53:15.708863 5120 reconciler_common.go:299] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/0d9062d0-d8bb-4ab3-b2c5-33fa78833a65-kolla-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:15 crc kubenswrapper[5120]: I0316 16:53:15.723446 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d9062d0-d8bb-4ab3-b2c5-33fa78833a65-kube-api-access-pncwl" (OuterVolumeSpecName: "kube-api-access-pncwl") pod "0d9062d0-d8bb-4ab3-b2c5-33fa78833a65" (UID: "0d9062d0-d8bb-4ab3-b2c5-33fa78833a65"). InnerVolumeSpecName "kube-api-access-pncwl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:53:15 crc kubenswrapper[5120]: I0316 16:53:15.725338 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-78dc5f4cb-mjvvc" Mar 16 16:53:15 crc kubenswrapper[5120]: I0316 16:53:15.755942 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d9062d0-d8bb-4ab3-b2c5-33fa78833a65-config-data-generated" (OuterVolumeSpecName: "config-data-generated") pod "0d9062d0-d8bb-4ab3-b2c5-33fa78833a65" (UID: "0d9062d0-d8bb-4ab3-b2c5-33fa78833a65"). InnerVolumeSpecName "config-data-generated". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:53:15 crc kubenswrapper[5120]: I0316 16:53:15.760078 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage16-crc" (OuterVolumeSpecName: "mysql-db") pod "0d9062d0-d8bb-4ab3-b2c5-33fa78833a65" (UID: "0d9062d0-d8bb-4ab3-b2c5-33fa78833a65"). InnerVolumeSpecName "local-storage16-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:53:15 crc kubenswrapper[5120]: I0316 16:53:15.832754 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") on node \"crc\" " Mar 16 16:53:15 crc kubenswrapper[5120]: I0316 16:53:15.833030 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pncwl\" (UniqueName: \"kubernetes.io/projected/0d9062d0-d8bb-4ab3-b2c5-33fa78833a65-kube-api-access-pncwl\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:15 crc kubenswrapper[5120]: I0316 16:53:15.833058 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/0d9062d0-d8bb-4ab3-b2c5-33fa78833a65-config-data-generated\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:15 crc kubenswrapper[5120]: I0316 16:53:15.919575 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-584b8687b4-5c6lr" Mar 16 16:53:15 crc kubenswrapper[5120]: I0316 16:53:15.925900 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:53:15 crc kubenswrapper[5120]: I0316 16:53:15.965870 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:53:15 crc kubenswrapper[5120]: I0316 16:53:15.976870 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-ccc65f956-nsglj"] Mar 16 16:53:16 crc kubenswrapper[5120]: I0316 16:53:16.142701 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage16-crc" (UniqueName: "kubernetes.io/local-volume/local-storage16-crc") on node "crc" Mar 16 16:53:16 crc kubenswrapper[5120]: I0316 16:53:16.175825 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:16 crc kubenswrapper[5120]: W0316 16:53:16.176098 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb609e161_5c22_4699_9af9_7f972834422a.slice/crio-ef05364b41a708623dbcdc6a42b0aad4de2efb624ee23dae0425b96da450d25a WatchSource:0}: Error finding container ef05364b41a708623dbcdc6a42b0aad4de2efb624ee23dae0425b96da450d25a: Status 404 returned error can't find the container with id ef05364b41a708623dbcdc6a42b0aad4de2efb624ee23dae0425b96da450d25a Mar 16 16:53:16 crc kubenswrapper[5120]: I0316 16:53:16.205995 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:53:16 crc kubenswrapper[5120]: I0316 16:53:16.214173 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0d9062d0-d8bb-4ab3-b2c5-33fa78833a65-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "0d9062d0-d8bb-4ab3-b2c5-33fa78833a65" (UID: "0d9062d0-d8bb-4ab3-b2c5-33fa78833a65"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:16 crc kubenswrapper[5120]: I0316 16:53:16.278555 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0d9062d0-d8bb-4ab3-b2c5-33fa78833a65-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:16 crc kubenswrapper[5120]: I0316 16:53:16.279999 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:53:16 crc kubenswrapper[5120]: I0316 16:53:16.312275 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-f67b885f6-v4nhp"] Mar 16 16:53:16 crc kubenswrapper[5120]: I0316 16:53:16.342827 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-6f698c8979-vxjjg"] Mar 16 16:53:16 crc kubenswrapper[5120]: I0316 16:53:16.369206 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/memcached-0" Mar 16 16:53:16 crc kubenswrapper[5120]: I0316 16:53:16.398095 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-88757f4fd-w4kvr"] Mar 16 16:53:16 crc kubenswrapper[5120]: W0316 16:53:16.452323 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod133b5e0f_d834_4c59_932f_957221e1727b.slice/crio-550a482710c28eab0491207e17c6a03a7948797a16de7ca95046c49632833e1e WatchSource:0}: Error finding container 550a482710c28eab0491207e17c6a03a7948797a16de7ca95046c49632833e1e: Status 404 returned error can't find the container with id 550a482710c28eab0491207e17c6a03a7948797a16de7ca95046c49632833e1e Mar 16 16:53:16 crc kubenswrapper[5120]: I0316 16:53:16.472788 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0d9062d0-d8bb-4ab3-b2c5-33fa78833a65-galera-tls-certs" (OuterVolumeSpecName: "galera-tls-certs") pod "0d9062d0-d8bb-4ab3-b2c5-33fa78833a65" (UID: "0d9062d0-d8bb-4ab3-b2c5-33fa78833a65"). InnerVolumeSpecName "galera-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:16 crc kubenswrapper[5120]: I0316 16:53:16.492429 5120 reconciler_common.go:299] "Volume detached for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/0d9062d0-d8bb-4ab3-b2c5-33fa78833a65-galera-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:16 crc kubenswrapper[5120]: W0316 16:53:16.549905 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9fab4617_1011_48f5_90ae_5415fd9b91b4.slice/crio-06c504195824359573d119aba30897b0a5f404723faa634855a3d726aa4c206f WatchSource:0}: Error finding container 06c504195824359573d119aba30897b0a5f404723faa634855a3d726aa4c206f: Status 404 returned error can't find the container with id 06c504195824359573d119aba30897b0a5f404723faa634855a3d726aa4c206f Mar 16 16:53:16 crc kubenswrapper[5120]: E0316 16:53:16.599178 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=2079669 actualBytes=10240 Mar 16 16:53:16 crc kubenswrapper[5120]: I0316 16:53:16.616598 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 16:53:16 crc kubenswrapper[5120]: I0316 16:53:16.643807 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 16:53:16 crc kubenswrapper[5120]: I0316 16:53:16.656111 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:53:16 crc kubenswrapper[5120]: I0316 16:53:16.796157 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"19792b24-d033-444c-85e4-6c61e15b3ef9","Type":"ContainerDied","Data":"44da37f7e3871e1da11e7aa77a8ca0ef4ccc8d659c2f038b5f3f3317e5f01b9b"} Mar 16 16:53:16 crc kubenswrapper[5120]: I0316 16:53:16.802014 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="44da37f7e3871e1da11e7aa77a8ca0ef4ccc8d659c2f038b5f3f3317e5f01b9b" Mar 16 16:53:16 crc kubenswrapper[5120]: I0316 16:53:16.802253 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:53:16 crc kubenswrapper[5120]: I0316 16:53:16.802355 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:53:16 crc kubenswrapper[5120]: I0316 16:53:16.802441 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:53:16 crc kubenswrapper[5120]: I0316 16:53:16.802547 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:53:16 crc kubenswrapper[5120]: I0316 16:53:16.815360 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:53:16 crc kubenswrapper[5120]: I0316 16:53:16.843590 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"61483cf5-d3db-49de-afa4-66f0efecdd70","Type":"ContainerStarted","Data":"b9b50e1abd0a98057d330e8c90a59f5a055779de61849723c628b054ab0cd288"} Mar 16 16:53:16 crc kubenswrapper[5120]: I0316 16:53:16.843803 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="61483cf5-d3db-49de-afa4-66f0efecdd70" containerName="ceilometer-central-agent" containerID="cri-o://9dea7e07ec457522ac530558fa96a46af205c7f4f10ffce3f455074081c4bf97" gracePeriod=30 Mar 16 16:53:16 crc kubenswrapper[5120]: I0316 16:53:16.844063 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:53:16 crc kubenswrapper[5120]: I0316 16:53:16.844116 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="61483cf5-d3db-49de-afa4-66f0efecdd70" containerName="proxy-httpd" containerID="cri-o://b9b50e1abd0a98057d330e8c90a59f5a055779de61849723c628b054ab0cd288" gracePeriod=30 Mar 16 16:53:16 crc kubenswrapper[5120]: I0316 16:53:16.844203 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="61483cf5-d3db-49de-afa4-66f0efecdd70" containerName="sg-core" containerID="cri-o://eef8c8d8f98f45622b4eea759dfa1ab6270fda4adb6058f0408cabf7fcc9d269" gracePeriod=30 Mar 16 16:53:16 crc kubenswrapper[5120]: I0316 16:53:16.844247 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="61483cf5-d3db-49de-afa4-66f0efecdd70" containerName="ceilometer-notification-agent" containerID="cri-o://7e4afb4b4a40e2ae0676505302e76e0be75d2f157b59d02034c7d6f97f9ffdcf" gracePeriod=30 Mar 16 16:53:16 crc kubenswrapper[5120]: I0316 16:53:16.886840 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-6d764c69b8-sv9d2"] Mar 16 16:53:16 crc kubenswrapper[5120]: I0316 16:53:16.887129 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/keystone-6d764c69b8-sv9d2" podUID="979d8a07-391d-483c-92d1-bb2d256edf99" containerName="keystone-api" containerID="cri-o://e657edbdc4c1d1813bbd0fe5142cc396ab5f34be797282678df442f971bf15d2" gracePeriod=30 Mar 16 16:53:16 crc kubenswrapper[5120]: I0316 16:53:16.948220 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:53:16 crc kubenswrapper[5120]: I0316 16:53:16.952234 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"0d9062d0-d8bb-4ab3-b2c5-33fa78833a65","Type":"ContainerDied","Data":"d14be80b2384b1c66a5747f2da507ba536fa23d0de33e607debc39288b289c33"} Mar 16 16:53:16 crc kubenswrapper[5120]: I0316 16:53:16.952294 5120 scope.go:117] "RemoveContainer" containerID="a01ee0b65bd51a1ae5744353a31cd6d57349aa7e7a9b8915b7f6de317ee1a034" Mar 16 16:53:16 crc kubenswrapper[5120]: I0316 16:53:16.952512 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:53:16 crc kubenswrapper[5120]: I0316 16:53:16.953465 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/19792b24-d033-444c-85e4-6c61e15b3ef9-lock\") pod \"19792b24-d033-444c-85e4-6c61e15b3ef9\" (UID: \"19792b24-d033-444c-85e4-6c61e15b3ef9\") " Mar 16 16:53:16 crc kubenswrapper[5120]: I0316 16:53:16.953669 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/19792b24-d033-444c-85e4-6c61e15b3ef9-cache\") pod \"19792b24-d033-444c-85e4-6c61e15b3ef9\" (UID: \"19792b24-d033-444c-85e4-6c61e15b3ef9\") " Mar 16 16:53:16 crc kubenswrapper[5120]: I0316 16:53:16.953912 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-btzhb\" (UniqueName: \"kubernetes.io/projected/19792b24-d033-444c-85e4-6c61e15b3ef9-kube-api-access-btzhb\") pod \"19792b24-d033-444c-85e4-6c61e15b3ef9\" (UID: \"19792b24-d033-444c-85e4-6c61e15b3ef9\") " Mar 16 16:53:16 crc kubenswrapper[5120]: I0316 16:53:16.954084 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/19792b24-d033-444c-85e4-6c61e15b3ef9-combined-ca-bundle\") pod \"19792b24-d033-444c-85e4-6c61e15b3ef9\" (UID: \"19792b24-d033-444c-85e4-6c61e15b3ef9\") " Mar 16 16:53:16 crc kubenswrapper[5120]: I0316 16:53:16.954142 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"swift\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"19792b24-d033-444c-85e4-6c61e15b3ef9\" (UID: \"19792b24-d033-444c-85e4-6c61e15b3ef9\") " Mar 16 16:53:16 crc kubenswrapper[5120]: I0316 16:53:16.954327 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/19792b24-d033-444c-85e4-6c61e15b3ef9-etc-swift\") pod \"19792b24-d033-444c-85e4-6c61e15b3ef9\" (UID: \"19792b24-d033-444c-85e4-6c61e15b3ef9\") " Mar 16 16:53:16 crc kubenswrapper[5120]: I0316 16:53:16.955890 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19792b24-d033-444c-85e4-6c61e15b3ef9-cache" (OuterVolumeSpecName: "cache") pod "19792b24-d033-444c-85e4-6c61e15b3ef9" (UID: "19792b24-d033-444c-85e4-6c61e15b3ef9"). InnerVolumeSpecName "cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:53:16 crc kubenswrapper[5120]: I0316 16:53:16.957258 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19792b24-d033-444c-85e4-6c61e15b3ef9-lock" (OuterVolumeSpecName: "lock") pod "19792b24-d033-444c-85e4-6c61e15b3ef9" (UID: "19792b24-d033-444c-85e4-6c61e15b3ef9"). InnerVolumeSpecName "lock". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:53:16 crc kubenswrapper[5120]: I0316 16:53:16.983834 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage05-crc" (OuterVolumeSpecName: "swift") pod "19792b24-d033-444c-85e4-6c61e15b3ef9" (UID: "19792b24-d033-444c-85e4-6c61e15b3ef9"). InnerVolumeSpecName "local-storage05-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:53:16 crc kubenswrapper[5120]: I0316 16:53:16.983982 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19792b24-d033-444c-85e4-6c61e15b3ef9-etc-swift" (OuterVolumeSpecName: "etc-swift") pod "19792b24-d033-444c-85e4-6c61e15b3ef9" (UID: "19792b24-d033-444c-85e4-6c61e15b3ef9"). InnerVolumeSpecName "etc-swift". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.011943 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-f6bd6ffc7-nq4s9"] Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.013123 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19792b24-d033-444c-85e4-6c61e15b3ef9" containerName="swift-recon-cron" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.013136 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="19792b24-d033-444c-85e4-6c61e15b3ef9" containerName="swift-recon-cron" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.013154 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19792b24-d033-444c-85e4-6c61e15b3ef9" containerName="rsync" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.013160 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="19792b24-d033-444c-85e4-6c61e15b3ef9" containerName="rsync" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.013169 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19792b24-d033-444c-85e4-6c61e15b3ef9" containerName="container-updater" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.013176 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="19792b24-d033-444c-85e4-6c61e15b3ef9" containerName="container-updater" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.013190 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d9062d0-d8bb-4ab3-b2c5-33fa78833a65" containerName="mysql-bootstrap" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.013195 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d9062d0-d8bb-4ab3-b2c5-33fa78833a65" containerName="mysql-bootstrap" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.013208 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d9062d0-d8bb-4ab3-b2c5-33fa78833a65" containerName="galera" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.013214 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d9062d0-d8bb-4ab3-b2c5-33fa78833a65" containerName="galera" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.013221 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19792b24-d033-444c-85e4-6c61e15b3ef9" containerName="object-server" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.013226 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="19792b24-d033-444c-85e4-6c61e15b3ef9" containerName="object-server" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.013237 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19792b24-d033-444c-85e4-6c61e15b3ef9" containerName="container-replicator" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.013245 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="19792b24-d033-444c-85e4-6c61e15b3ef9" containerName="container-replicator" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.013256 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19792b24-d033-444c-85e4-6c61e15b3ef9" containerName="object-auditor" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.013262 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="19792b24-d033-444c-85e4-6c61e15b3ef9" containerName="object-auditor" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.013274 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19792b24-d033-444c-85e4-6c61e15b3ef9" containerName="account-reaper" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.013279 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="19792b24-d033-444c-85e4-6c61e15b3ef9" containerName="account-reaper" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.013291 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19792b24-d033-444c-85e4-6c61e15b3ef9" containerName="object-expirer" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.013296 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="19792b24-d033-444c-85e4-6c61e15b3ef9" containerName="object-expirer" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.013312 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19792b24-d033-444c-85e4-6c61e15b3ef9" containerName="container-auditor" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.013319 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="19792b24-d033-444c-85e4-6c61e15b3ef9" containerName="container-auditor" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.013338 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19792b24-d033-444c-85e4-6c61e15b3ef9" containerName="object-updater" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.013571 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="19792b24-d033-444c-85e4-6c61e15b3ef9" containerName="object-updater" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.013586 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19792b24-d033-444c-85e4-6c61e15b3ef9" containerName="object-replicator" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.013592 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="19792b24-d033-444c-85e4-6c61e15b3ef9" containerName="object-replicator" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.013615 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19792b24-d033-444c-85e4-6c61e15b3ef9" containerName="account-auditor" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.013629 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="19792b24-d033-444c-85e4-6c61e15b3ef9" containerName="account-auditor" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.013645 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19792b24-d033-444c-85e4-6c61e15b3ef9" containerName="account-replicator" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.013653 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="19792b24-d033-444c-85e4-6c61e15b3ef9" containerName="account-replicator" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.013668 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19792b24-d033-444c-85e4-6c61e15b3ef9" containerName="account-server" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.013674 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="19792b24-d033-444c-85e4-6c61e15b3ef9" containerName="account-server" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.013692 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19792b24-d033-444c-85e4-6c61e15b3ef9" containerName="container-server" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.013699 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="19792b24-d033-444c-85e4-6c61e15b3ef9" containerName="container-server" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.014092 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="19792b24-d033-444c-85e4-6c61e15b3ef9" containerName="swift-recon-cron" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.014115 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="19792b24-d033-444c-85e4-6c61e15b3ef9" containerName="object-server" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.014138 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="19792b24-d033-444c-85e4-6c61e15b3ef9" containerName="object-updater" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.014156 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="19792b24-d033-444c-85e4-6c61e15b3ef9" containerName="rsync" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.014176 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="19792b24-d033-444c-85e4-6c61e15b3ef9" containerName="object-replicator" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.014191 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="19792b24-d033-444c-85e4-6c61e15b3ef9" containerName="object-expirer" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.014205 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="19792b24-d033-444c-85e4-6c61e15b3ef9" containerName="account-server" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.014225 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="19792b24-d033-444c-85e4-6c61e15b3ef9" containerName="object-auditor" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.014241 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="19792b24-d033-444c-85e4-6c61e15b3ef9" containerName="account-reaper" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.014264 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="19792b24-d033-444c-85e4-6c61e15b3ef9" containerName="container-server" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.014277 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="19792b24-d033-444c-85e4-6c61e15b3ef9" containerName="account-auditor" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.014287 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="19792b24-d033-444c-85e4-6c61e15b3ef9" containerName="container-replicator" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.014303 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="19792b24-d033-444c-85e4-6c61e15b3ef9" containerName="account-replicator" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.014314 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="19792b24-d033-444c-85e4-6c61e15b3ef9" containerName="container-auditor" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.014326 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="0d9062d0-d8bb-4ab3-b2c5-33fa78833a65" containerName="galera" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.014334 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="19792b24-d033-444c-85e4-6c61e15b3ef9" containerName="container-updater" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.022708 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-f6bd6ffc7-nq4s9" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.028879 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19792b24-d033-444c-85e4-6c61e15b3ef9-kube-api-access-btzhb" (OuterVolumeSpecName: "kube-api-access-btzhb") pod "19792b24-d033-444c-85e4-6c61e15b3ef9" (UID: "19792b24-d033-444c-85e4-6c61e15b3ef9"). InnerVolumeSpecName "kube-api-access-btzhb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.028953 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"b609e161-5c22-4699-9af9-7f972834422a","Type":"ContainerStarted","Data":"ef05364b41a708623dbcdc6a42b0aad4de2efb624ee23dae0425b96da450d25a"} Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.045031 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"3267cb77-9a07-4d71-aaa4-e1e5e033a70d","Type":"ContainerStarted","Data":"8b53db1e0bd79866eb6c0dda62518f82ffff38e483b8bfb3cf474001723a5bf2"} Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.046809 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-ccc65f956-nsglj" event={"ID":"cb10ccc3-03fc-4eb7-a637-c2bc721a9b69","Type":"ContainerStarted","Data":"a29961f9d9be29682f336f87def6ba60877ce87e52ab36b59d592cfccb3b2498"} Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.060935 5120 reconciler_common.go:299] "Volume detached for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/19792b24-d033-444c-85e4-6c61e15b3ef9-lock\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.060998 5120 reconciler_common.go:299] "Volume detached for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/19792b24-d033-444c-85e4-6c61e15b3ef9-cache\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.061010 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-btzhb\" (UniqueName: \"kubernetes.io/projected/19792b24-d033-444c-85e4-6c61e15b3ef9-kube-api-access-btzhb\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.061401 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") on node \"crc\" " Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.061418 5120 reconciler_common.go:299] "Volume detached for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/19792b24-d033-444c-85e4-6c61e15b3ef9-etc-swift\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.084182 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-647f8b964-49qkc" event={"ID":"a5d3f7a6-64f6-47f9-a144-41a356078e4b","Type":"ContainerStarted","Data":"26bcb4771703f1b3befddf195c3f98963f2607b7b970751d8c680b603c3f68e7"} Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.108286 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_32963b23-d87d-4107-9a13-32737c586ab3/ovsdbserver-nb/0.log" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.108619 5120 generic.go:358] "Generic (PLEG): container finished" podID="32963b23-d87d-4107-9a13-32737c586ab3" containerID="f6b4b7cbf54c515ab7a385a6ea30158950a8855c60ac7b02ba9e15f7d0ad1e8f" exitCode=2 Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.108637 5120 generic.go:358] "Generic (PLEG): container finished" podID="32963b23-d87d-4107-9a13-32737c586ab3" containerID="8255a8dd841a9b7e8d1b59806b937aaa4fdc84daf4b743c2df720b34b3c55d87" exitCode=143 Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.108973 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-f6bd6ffc7-nq4s9"] Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.109004 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"32963b23-d87d-4107-9a13-32737c586ab3","Type":"ContainerDied","Data":"f6b4b7cbf54c515ab7a385a6ea30158950a8855c60ac7b02ba9e15f7d0ad1e8f"} Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.109027 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"32963b23-d87d-4107-9a13-32737c586ab3","Type":"ContainerDied","Data":"8255a8dd841a9b7e8d1b59806b937aaa4fdc84daf4b743c2df720b34b3c55d87"} Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.164263 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_6792b2c6-f5cf-454a-858a-cbd4159db76a/ovsdbserver-sb/0.log" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.164308 5120 generic.go:358] "Generic (PLEG): container finished" podID="6792b2c6-f5cf-454a-858a-cbd4159db76a" containerID="80e2bda6dda2c8ad05b4c7384f2d187b58b6cdc73a7dd75783a0030f0515db21" exitCode=2 Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.164323 5120 generic.go:358] "Generic (PLEG): container finished" podID="6792b2c6-f5cf-454a-858a-cbd4159db76a" containerID="b906fd70f36d377ce541811ff12a62e890d86300690ff722e603d902f637f772" exitCode=143 Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.164437 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"6792b2c6-f5cf-454a-858a-cbd4159db76a","Type":"ContainerDied","Data":"80e2bda6dda2c8ad05b4c7384f2d187b58b6cdc73a7dd75783a0030f0515db21"} Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.164461 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"6792b2c6-f5cf-454a-858a-cbd4159db76a","Type":"ContainerDied","Data":"b906fd70f36d377ce541811ff12a62e890d86300690ff722e603d902f637f772"} Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.168807 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/d59d2b2a-a98e-4f02-80f4-b6daa5b64d41-internal-tls-certs\") pod \"keystone-f6bd6ffc7-nq4s9\" (UID: \"d59d2b2a-a98e-4f02-80f4-b6daa5b64d41\") " pod="openstack-kuttl-tests/keystone-f6bd6ffc7-nq4s9" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.168877 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/d59d2b2a-a98e-4f02-80f4-b6daa5b64d41-credential-keys\") pod \"keystone-f6bd6ffc7-nq4s9\" (UID: \"d59d2b2a-a98e-4f02-80f4-b6daa5b64d41\") " pod="openstack-kuttl-tests/keystone-f6bd6ffc7-nq4s9" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.168947 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/d59d2b2a-a98e-4f02-80f4-b6daa5b64d41-fernet-keys\") pod \"keystone-f6bd6ffc7-nq4s9\" (UID: \"d59d2b2a-a98e-4f02-80f4-b6daa5b64d41\") " pod="openstack-kuttl-tests/keystone-f6bd6ffc7-nq4s9" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.169103 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/d59d2b2a-a98e-4f02-80f4-b6daa5b64d41-public-tls-certs\") pod \"keystone-f6bd6ffc7-nq4s9\" (UID: \"d59d2b2a-a98e-4f02-80f4-b6daa5b64d41\") " pod="openstack-kuttl-tests/keystone-f6bd6ffc7-nq4s9" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.169327 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d59d2b2a-a98e-4f02-80f4-b6daa5b64d41-combined-ca-bundle\") pod \"keystone-f6bd6ffc7-nq4s9\" (UID: \"d59d2b2a-a98e-4f02-80f4-b6daa5b64d41\") " pod="openstack-kuttl-tests/keystone-f6bd6ffc7-nq4s9" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.169381 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lsvg4\" (UniqueName: \"kubernetes.io/projected/d59d2b2a-a98e-4f02-80f4-b6daa5b64d41-kube-api-access-lsvg4\") pod \"keystone-f6bd6ffc7-nq4s9\" (UID: \"d59d2b2a-a98e-4f02-80f4-b6daa5b64d41\") " pod="openstack-kuttl-tests/keystone-f6bd6ffc7-nq4s9" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.169701 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d59d2b2a-a98e-4f02-80f4-b6daa5b64d41-config-data\") pod \"keystone-f6bd6ffc7-nq4s9\" (UID: \"d59d2b2a-a98e-4f02-80f4-b6daa5b64d41\") " pod="openstack-kuttl-tests/keystone-f6bd6ffc7-nq4s9" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.170485 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d59d2b2a-a98e-4f02-80f4-b6daa5b64d41-scripts\") pod \"keystone-f6bd6ffc7-nq4s9\" (UID: \"d59d2b2a-a98e-4f02-80f4-b6daa5b64d41\") " pod="openstack-kuttl-tests/keystone-f6bd6ffc7-nq4s9" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.231120 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-f56965744-skhtb"] Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.231524 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-f56965744-skhtb" podUID="4907839f-9071-4378-90f6-f92ced0b0bf0" containerName="neutron-api" containerID="cri-o://2dfd289344b424c2a731001caf2fb6357db8afaf4bd8fe7f4af4a4e540466d5d" gracePeriod=30 Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.233201 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-f56965744-skhtb" podUID="4907839f-9071-4378-90f6-f92ced0b0bf0" containerName="neutron-httpd" containerID="cri-o://c015127c07a61c75b148a24b94cb58126066d557796401e4738fd413970294a5" gracePeriod=30 Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.242539 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/neutron-f56965744-skhtb" podUID="4907839f-9071-4378-90f6-f92ced0b0bf0" containerName="neutron-httpd" probeResult="failure" output="HTTP probe failed with statuscode: 503" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.251180 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-7bf49bf568-fbg2k" podUID="c846d2b2-0638-44bd-9ad0-6b6c76f8d16f" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.0.123:9311/healthcheck\": context deadline exceeded" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.259519 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage05-crc" (UniqueName: "kubernetes.io/local-volume/local-storage05-crc") on node "crc" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.270918 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-7bf49bf568-fbg2k" podUID="c846d2b2-0638-44bd-9ad0-6b6c76f8d16f" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.0.123:9311/healthcheck\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.319864 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-7b9f48f6c8-rfj5g"] Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.341570 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="9c42ca14-5afb-4688-a2cf-ddf314020f18" containerName="nova-cell0-conductor-conductor" containerID="cri-o://3d1fa3f05cf04af9cd4ade7a65089fa1f8351ed405ba76f965c47bc010d6ef00" gracePeriod=30 Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.346748 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"7a0880a9-40d3-4b78-890b-b24bf32a92e7","Type":"ContainerStarted","Data":"20dc51b68de4802c753ddbf5f24db10c06ec689312f518cc67372e818b0937d6"} Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.347159 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-7b9f48f6c8-rfj5g" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.361019 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/d59d2b2a-a98e-4f02-80f4-b6daa5b64d41-public-tls-certs\") pod \"keystone-f6bd6ffc7-nq4s9\" (UID: \"d59d2b2a-a98e-4f02-80f4-b6daa5b64d41\") " pod="openstack-kuttl-tests/keystone-f6bd6ffc7-nq4s9" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.361377 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d59d2b2a-a98e-4f02-80f4-b6daa5b64d41-combined-ca-bundle\") pod \"keystone-f6bd6ffc7-nq4s9\" (UID: \"d59d2b2a-a98e-4f02-80f4-b6daa5b64d41\") " pod="openstack-kuttl-tests/keystone-f6bd6ffc7-nq4s9" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.361457 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lsvg4\" (UniqueName: \"kubernetes.io/projected/d59d2b2a-a98e-4f02-80f4-b6daa5b64d41-kube-api-access-lsvg4\") pod \"keystone-f6bd6ffc7-nq4s9\" (UID: \"d59d2b2a-a98e-4f02-80f4-b6daa5b64d41\") " pod="openstack-kuttl-tests/keystone-f6bd6ffc7-nq4s9" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.361831 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d59d2b2a-a98e-4f02-80f4-b6daa5b64d41-config-data\") pod \"keystone-f6bd6ffc7-nq4s9\" (UID: \"d59d2b2a-a98e-4f02-80f4-b6daa5b64d41\") " pod="openstack-kuttl-tests/keystone-f6bd6ffc7-nq4s9" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.362102 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d59d2b2a-a98e-4f02-80f4-b6daa5b64d41-scripts\") pod \"keystone-f6bd6ffc7-nq4s9\" (UID: \"d59d2b2a-a98e-4f02-80f4-b6daa5b64d41\") " pod="openstack-kuttl-tests/keystone-f6bd6ffc7-nq4s9" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.362242 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/d59d2b2a-a98e-4f02-80f4-b6daa5b64d41-internal-tls-certs\") pod \"keystone-f6bd6ffc7-nq4s9\" (UID: \"d59d2b2a-a98e-4f02-80f4-b6daa5b64d41\") " pod="openstack-kuttl-tests/keystone-f6bd6ffc7-nq4s9" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.362313 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/d59d2b2a-a98e-4f02-80f4-b6daa5b64d41-credential-keys\") pod \"keystone-f6bd6ffc7-nq4s9\" (UID: \"d59d2b2a-a98e-4f02-80f4-b6daa5b64d41\") " pod="openstack-kuttl-tests/keystone-f6bd6ffc7-nq4s9" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.362413 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/d59d2b2a-a98e-4f02-80f4-b6daa5b64d41-fernet-keys\") pod \"keystone-f6bd6ffc7-nq4s9\" (UID: \"d59d2b2a-a98e-4f02-80f4-b6daa5b64d41\") " pod="openstack-kuttl-tests/keystone-f6bd6ffc7-nq4s9" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.362689 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.383638 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-7b9f48f6c8-rfj5g"] Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.394873 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lsvg4\" (UniqueName: \"kubernetes.io/projected/d59d2b2a-a98e-4f02-80f4-b6daa5b64d41-kube-api-access-lsvg4\") pod \"keystone-f6bd6ffc7-nq4s9\" (UID: \"d59d2b2a-a98e-4f02-80f4-b6daa5b64d41\") " pod="openstack-kuttl-tests/keystone-f6bd6ffc7-nq4s9" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.394968 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/d59d2b2a-a98e-4f02-80f4-b6daa5b64d41-fernet-keys\") pod \"keystone-f6bd6ffc7-nq4s9\" (UID: \"d59d2b2a-a98e-4f02-80f4-b6daa5b64d41\") " pod="openstack-kuttl-tests/keystone-f6bd6ffc7-nq4s9" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.400799 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d59d2b2a-a98e-4f02-80f4-b6daa5b64d41-scripts\") pod \"keystone-f6bd6ffc7-nq4s9\" (UID: \"d59d2b2a-a98e-4f02-80f4-b6daa5b64d41\") " pod="openstack-kuttl-tests/keystone-f6bd6ffc7-nq4s9" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.405706 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d59d2b2a-a98e-4f02-80f4-b6daa5b64d41-config-data\") pod \"keystone-f6bd6ffc7-nq4s9\" (UID: \"d59d2b2a-a98e-4f02-80f4-b6daa5b64d41\") " pod="openstack-kuttl-tests/keystone-f6bd6ffc7-nq4s9" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.406146 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/d59d2b2a-a98e-4f02-80f4-b6daa5b64d41-public-tls-certs\") pod \"keystone-f6bd6ffc7-nq4s9\" (UID: \"d59d2b2a-a98e-4f02-80f4-b6daa5b64d41\") " pod="openstack-kuttl-tests/keystone-f6bd6ffc7-nq4s9" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.408516 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/d59d2b2a-a98e-4f02-80f4-b6daa5b64d41-internal-tls-certs\") pod \"keystone-f6bd6ffc7-nq4s9\" (UID: \"d59d2b2a-a98e-4f02-80f4-b6daa5b64d41\") " pod="openstack-kuttl-tests/keystone-f6bd6ffc7-nq4s9" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.410276 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d59d2b2a-a98e-4f02-80f4-b6daa5b64d41-combined-ca-bundle\") pod \"keystone-f6bd6ffc7-nq4s9\" (UID: \"d59d2b2a-a98e-4f02-80f4-b6daa5b64d41\") " pod="openstack-kuttl-tests/keystone-f6bd6ffc7-nq4s9" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.410826 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/d59d2b2a-a98e-4f02-80f4-b6daa5b64d41-credential-keys\") pod \"keystone-f6bd6ffc7-nq4s9\" (UID: \"d59d2b2a-a98e-4f02-80f4-b6daa5b64d41\") " pod="openstack-kuttl-tests/keystone-f6bd6ffc7-nq4s9" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.421725 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_6792b2c6-f5cf-454a-858a-cbd4159db76a/ovsdbserver-sb/0.log" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.422054 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.481646 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/6792b2c6-f5cf-454a-858a-cbd4159db76a-ovsdbserver-sb-tls-certs\") pod \"6792b2c6-f5cf-454a-858a-cbd4159db76a\" (UID: \"6792b2c6-f5cf-454a-858a-cbd4159db76a\") " Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.481803 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/6792b2c6-f5cf-454a-858a-cbd4159db76a-metrics-certs-tls-certs\") pod \"6792b2c6-f5cf-454a-858a-cbd4159db76a\" (UID: \"6792b2c6-f5cf-454a-858a-cbd4159db76a\") " Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.481906 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v6zh5\" (UniqueName: \"kubernetes.io/projected/6792b2c6-f5cf-454a-858a-cbd4159db76a-kube-api-access-v6zh5\") pod \"6792b2c6-f5cf-454a-858a-cbd4159db76a\" (UID: \"6792b2c6-f5cf-454a-858a-cbd4159db76a\") " Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.482040 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6792b2c6-f5cf-454a-858a-cbd4159db76a-config\") pod \"6792b2c6-f5cf-454a-858a-cbd4159db76a\" (UID: \"6792b2c6-f5cf-454a-858a-cbd4159db76a\") " Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.482192 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovndbcluster-sb-etc-ovn\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"6792b2c6-f5cf-454a-858a-cbd4159db76a\" (UID: \"6792b2c6-f5cf-454a-858a-cbd4159db76a\") " Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.482524 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6792b2c6-f5cf-454a-858a-cbd4159db76a-combined-ca-bundle\") pod \"6792b2c6-f5cf-454a-858a-cbd4159db76a\" (UID: \"6792b2c6-f5cf-454a-858a-cbd4159db76a\") " Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.482562 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/6792b2c6-f5cf-454a-858a-cbd4159db76a-scripts\") pod \"6792b2c6-f5cf-454a-858a-cbd4159db76a\" (UID: \"6792b2c6-f5cf-454a-858a-cbd4159db76a\") " Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.482714 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/6792b2c6-f5cf-454a-858a-cbd4159db76a-ovsdb-rundir\") pod \"6792b2c6-f5cf-454a-858a-cbd4159db76a\" (UID: \"6792b2c6-f5cf-454a-858a-cbd4159db76a\") " Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.484625 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/eb34a81f-663e-4027-bf2c-1d334bd06ba4-public-tls-certs\") pod \"neutron-7b9f48f6c8-rfj5g\" (UID: \"eb34a81f-663e-4027-bf2c-1d334bd06ba4\") " pod="openstack-kuttl-tests/neutron-7b9f48f6c8-rfj5g" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.486614 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6792b2c6-f5cf-454a-858a-cbd4159db76a-ovsdb-rundir" (OuterVolumeSpecName: "ovsdb-rundir") pod "6792b2c6-f5cf-454a-858a-cbd4159db76a" (UID: "6792b2c6-f5cf-454a-858a-cbd4159db76a"). InnerVolumeSpecName "ovsdb-rundir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.500127 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eb34a81f-663e-4027-bf2c-1d334bd06ba4-combined-ca-bundle\") pod \"neutron-7b9f48f6c8-rfj5g\" (UID: \"eb34a81f-663e-4027-bf2c-1d334bd06ba4\") " pod="openstack-kuttl-tests/neutron-7b9f48f6c8-rfj5g" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.521487 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/eb34a81f-663e-4027-bf2c-1d334bd06ba4-httpd-config\") pod \"neutron-7b9f48f6c8-rfj5g\" (UID: \"eb34a81f-663e-4027-bf2c-1d334bd06ba4\") " pod="openstack-kuttl-tests/neutron-7b9f48f6c8-rfj5g" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.521628 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wm5j9\" (UniqueName: \"kubernetes.io/projected/eb34a81f-663e-4027-bf2c-1d334bd06ba4-kube-api-access-wm5j9\") pod \"neutron-7b9f48f6c8-rfj5g\" (UID: \"eb34a81f-663e-4027-bf2c-1d334bd06ba4\") " pod="openstack-kuttl-tests/neutron-7b9f48f6c8-rfj5g" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.521706 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/eb34a81f-663e-4027-bf2c-1d334bd06ba4-internal-tls-certs\") pod \"neutron-7b9f48f6c8-rfj5g\" (UID: \"eb34a81f-663e-4027-bf2c-1d334bd06ba4\") " pod="openstack-kuttl-tests/neutron-7b9f48f6c8-rfj5g" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.521772 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/eb34a81f-663e-4027-bf2c-1d334bd06ba4-config\") pod \"neutron-7b9f48f6c8-rfj5g\" (UID: \"eb34a81f-663e-4027-bf2c-1d334bd06ba4\") " pod="openstack-kuttl-tests/neutron-7b9f48f6c8-rfj5g" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.522300 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/eb34a81f-663e-4027-bf2c-1d334bd06ba4-ovndb-tls-certs\") pod \"neutron-7b9f48f6c8-rfj5g\" (UID: \"eb34a81f-663e-4027-bf2c-1d334bd06ba4\") " pod="openstack-kuttl-tests/neutron-7b9f48f6c8-rfj5g" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.522807 5120 reconciler_common.go:299] "Volume detached for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/6792b2c6-f5cf-454a-858a-cbd4159db76a-ovsdb-rundir\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.523862 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6792b2c6-f5cf-454a-858a-cbd4159db76a-scripts" (OuterVolumeSpecName: "scripts") pod "6792b2c6-f5cf-454a-858a-cbd4159db76a" (UID: "6792b2c6-f5cf-454a-858a-cbd4159db76a"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.524399 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6792b2c6-f5cf-454a-858a-cbd4159db76a-config" (OuterVolumeSpecName: "config") pod "6792b2c6-f5cf-454a-858a-cbd4159db76a" (UID: "6792b2c6-f5cf-454a-858a-cbd4159db76a"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.524822 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_32963b23-d87d-4107-9a13-32737c586ab3/ovsdbserver-nb/0.log" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.524911 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.525615 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=8.704772316 podStartE2EDuration="25.525600853s" podCreationTimestamp="2026-03-16 16:52:52 +0000 UTC" firstStartedPulling="2026-03-16 16:52:56.687130741 +0000 UTC m=+4878.841062398" lastFinishedPulling="2026-03-16 16:53:13.507959278 +0000 UTC m=+4895.661890935" observedRunningTime="2026-03-16 16:53:16.983373273 +0000 UTC m=+4899.137304930" watchObservedRunningTime="2026-03-16 16:53:17.525600853 +0000 UTC m=+4899.679532510" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.591692 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-f6bd6ffc7-nq4s9" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.608913 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6792b2c6-f5cf-454a-858a-cbd4159db76a-kube-api-access-v6zh5" (OuterVolumeSpecName: "kube-api-access-v6zh5") pod "6792b2c6-f5cf-454a-858a-cbd4159db76a" (UID: "6792b2c6-f5cf-454a-858a-cbd4159db76a"). InnerVolumeSpecName "kube-api-access-v6zh5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.614843 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.618597 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage06-crc" (OuterVolumeSpecName: "ovndbcluster-sb-etc-ovn") pod "6792b2c6-f5cf-454a-858a-cbd4159db76a" (UID: "6792b2c6-f5cf-454a-858a-cbd4159db76a"). InnerVolumeSpecName "local-storage06-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.629642 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-79rnw\" (UniqueName: \"kubernetes.io/projected/32963b23-d87d-4107-9a13-32737c586ab3-kube-api-access-79rnw\") pod \"32963b23-d87d-4107-9a13-32737c586ab3\" (UID: \"32963b23-d87d-4107-9a13-32737c586ab3\") " Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.629797 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/32963b23-d87d-4107-9a13-32737c586ab3-scripts\") pod \"32963b23-d87d-4107-9a13-32737c586ab3\" (UID: \"32963b23-d87d-4107-9a13-32737c586ab3\") " Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.629982 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/32963b23-d87d-4107-9a13-32737c586ab3-metrics-certs-tls-certs\") pod \"32963b23-d87d-4107-9a13-32737c586ab3\" (UID: \"32963b23-d87d-4107-9a13-32737c586ab3\") " Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.630052 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/32963b23-d87d-4107-9a13-32737c586ab3-combined-ca-bundle\") pod \"32963b23-d87d-4107-9a13-32737c586ab3\" (UID: \"32963b23-d87d-4107-9a13-32737c586ab3\") " Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.630101 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/32963b23-d87d-4107-9a13-32737c586ab3-config\") pod \"32963b23-d87d-4107-9a13-32737c586ab3\" (UID: \"32963b23-d87d-4107-9a13-32737c586ab3\") " Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.630329 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/32963b23-d87d-4107-9a13-32737c586ab3-ovsdb-rundir\") pod \"32963b23-d87d-4107-9a13-32737c586ab3\" (UID: \"32963b23-d87d-4107-9a13-32737c586ab3\") " Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.630409 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovndbcluster-nb-etc-ovn\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") pod \"32963b23-d87d-4107-9a13-32737c586ab3\" (UID: \"32963b23-d87d-4107-9a13-32737c586ab3\") " Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.630639 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/32963b23-d87d-4107-9a13-32737c586ab3-ovsdbserver-nb-tls-certs\") pod \"32963b23-d87d-4107-9a13-32737c586ab3\" (UID: \"32963b23-d87d-4107-9a13-32737c586ab3\") " Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.630857 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/eb34a81f-663e-4027-bf2c-1d334bd06ba4-httpd-config\") pod \"neutron-7b9f48f6c8-rfj5g\" (UID: \"eb34a81f-663e-4027-bf2c-1d334bd06ba4\") " pod="openstack-kuttl-tests/neutron-7b9f48f6c8-rfj5g" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.630906 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wm5j9\" (UniqueName: \"kubernetes.io/projected/eb34a81f-663e-4027-bf2c-1d334bd06ba4-kube-api-access-wm5j9\") pod \"neutron-7b9f48f6c8-rfj5g\" (UID: \"eb34a81f-663e-4027-bf2c-1d334bd06ba4\") " pod="openstack-kuttl-tests/neutron-7b9f48f6c8-rfj5g" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.630944 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/eb34a81f-663e-4027-bf2c-1d334bd06ba4-internal-tls-certs\") pod \"neutron-7b9f48f6c8-rfj5g\" (UID: \"eb34a81f-663e-4027-bf2c-1d334bd06ba4\") " pod="openstack-kuttl-tests/neutron-7b9f48f6c8-rfj5g" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.631176 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/eb34a81f-663e-4027-bf2c-1d334bd06ba4-config\") pod \"neutron-7b9f48f6c8-rfj5g\" (UID: \"eb34a81f-663e-4027-bf2c-1d334bd06ba4\") " pod="openstack-kuttl-tests/neutron-7b9f48f6c8-rfj5g" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.631350 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/eb34a81f-663e-4027-bf2c-1d334bd06ba4-ovndb-tls-certs\") pod \"neutron-7b9f48f6c8-rfj5g\" (UID: \"eb34a81f-663e-4027-bf2c-1d334bd06ba4\") " pod="openstack-kuttl-tests/neutron-7b9f48f6c8-rfj5g" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.631561 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/eb34a81f-663e-4027-bf2c-1d334bd06ba4-public-tls-certs\") pod \"neutron-7b9f48f6c8-rfj5g\" (UID: \"eb34a81f-663e-4027-bf2c-1d334bd06ba4\") " pod="openstack-kuttl-tests/neutron-7b9f48f6c8-rfj5g" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.631667 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eb34a81f-663e-4027-bf2c-1d334bd06ba4-combined-ca-bundle\") pod \"neutron-7b9f48f6c8-rfj5g\" (UID: \"eb34a81f-663e-4027-bf2c-1d334bd06ba4\") " pod="openstack-kuttl-tests/neutron-7b9f48f6c8-rfj5g" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.631803 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v6zh5\" (UniqueName: \"kubernetes.io/projected/6792b2c6-f5cf-454a-858a-cbd4159db76a-kube-api-access-v6zh5\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.631819 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6792b2c6-f5cf-454a-858a-cbd4159db76a-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.631839 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") on node \"crc\" " Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.631849 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/6792b2c6-f5cf-454a-858a-cbd4159db76a-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.632942 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.644625 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/32963b23-d87d-4107-9a13-32737c586ab3-config" (OuterVolumeSpecName: "config") pod "32963b23-d87d-4107-9a13-32737c586ab3" (UID: "32963b23-d87d-4107-9a13-32737c586ab3"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.646171 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32963b23-d87d-4107-9a13-32737c586ab3-ovsdb-rundir" (OuterVolumeSpecName: "ovsdb-rundir") pod "32963b23-d87d-4107-9a13-32737c586ab3" (UID: "32963b23-d87d-4107-9a13-32737c586ab3"). InnerVolumeSpecName "ovsdb-rundir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.646512 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/32963b23-d87d-4107-9a13-32737c586ab3-scripts" (OuterVolumeSpecName: "scripts") pod "32963b23-d87d-4107-9a13-32737c586ab3" (UID: "32963b23-d87d-4107-9a13-32737c586ab3"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.658291 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.661067 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32963b23-d87d-4107-9a13-32737c586ab3" containerName="openstack-network-exporter" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.661091 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="32963b23-d87d-4107-9a13-32737c586ab3" containerName="openstack-network-exporter" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.661105 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6792b2c6-f5cf-454a-858a-cbd4159db76a" containerName="ovsdbserver-sb" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.661112 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="6792b2c6-f5cf-454a-858a-cbd4159db76a" containerName="ovsdbserver-sb" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.661172 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6792b2c6-f5cf-454a-858a-cbd4159db76a" containerName="openstack-network-exporter" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.661181 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="6792b2c6-f5cf-454a-858a-cbd4159db76a" containerName="openstack-network-exporter" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.661265 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32963b23-d87d-4107-9a13-32737c586ab3" containerName="ovsdbserver-nb" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.661274 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="32963b23-d87d-4107-9a13-32737c586ab3" containerName="ovsdbserver-nb" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.661573 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="6792b2c6-f5cf-454a-858a-cbd4159db76a" containerName="openstack-network-exporter" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.661594 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="32963b23-d87d-4107-9a13-32737c586ab3" containerName="ovsdbserver-nb" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.661614 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="32963b23-d87d-4107-9a13-32737c586ab3" containerName="openstack-network-exporter" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.661625 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="6792b2c6-f5cf-454a-858a-cbd4159db76a" containerName="ovsdbserver-sb" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.682167 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/eb34a81f-663e-4027-bf2c-1d334bd06ba4-config\") pod \"neutron-7b9f48f6c8-rfj5g\" (UID: \"eb34a81f-663e-4027-bf2c-1d334bd06ba4\") " pod="openstack-kuttl-tests/neutron-7b9f48f6c8-rfj5g" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.686040 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="b91a9930-eec4-4af5-9aee-5d02dc78fabc" containerName="cinder-scheduler" probeResult="failure" output="Get \"http://10.217.0.137:8080/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.692213 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.692332 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.693299 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/eb34a81f-663e-4027-bf2c-1d334bd06ba4-internal-tls-certs\") pod \"neutron-7b9f48f6c8-rfj5g\" (UID: \"eb34a81f-663e-4027-bf2c-1d334bd06ba4\") " pod="openstack-kuttl-tests/neutron-7b9f48f6c8-rfj5g" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.696191 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-galera-openstack-svc\"" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.700059 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-config-data\"" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.700518 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-scripts\"" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.703510 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"galera-openstack-dockercfg-8xncx\"" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.722522 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/eb34a81f-663e-4027-bf2c-1d334bd06ba4-httpd-config\") pod \"neutron-7b9f48f6c8-rfj5g\" (UID: \"eb34a81f-663e-4027-bf2c-1d334bd06ba4\") " pod="openstack-kuttl-tests/neutron-7b9f48f6c8-rfj5g" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.723163 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/eb34a81f-663e-4027-bf2c-1d334bd06ba4-public-tls-certs\") pod \"neutron-7b9f48f6c8-rfj5g\" (UID: \"eb34a81f-663e-4027-bf2c-1d334bd06ba4\") " pod="openstack-kuttl-tests/neutron-7b9f48f6c8-rfj5g" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.728573 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eb34a81f-663e-4027-bf2c-1d334bd06ba4-combined-ca-bundle\") pod \"neutron-7b9f48f6c8-rfj5g\" (UID: \"eb34a81f-663e-4027-bf2c-1d334bd06ba4\") " pod="openstack-kuttl-tests/neutron-7b9f48f6c8-rfj5g" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.730257 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/eb34a81f-663e-4027-bf2c-1d334bd06ba4-ovndb-tls-certs\") pod \"neutron-7b9f48f6c8-rfj5g\" (UID: \"eb34a81f-663e-4027-bf2c-1d334bd06ba4\") " pod="openstack-kuttl-tests/neutron-7b9f48f6c8-rfj5g" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.737537 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/32963b23-d87d-4107-9a13-32737c586ab3-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.738037 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/32963b23-d87d-4107-9a13-32737c586ab3-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.738059 5120 reconciler_common.go:299] "Volume detached for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/32963b23-d87d-4107-9a13-32737c586ab3-ovsdb-rundir\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.745773 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-788658cdb6-tsr2b"] Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.749067 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wm5j9\" (UniqueName: \"kubernetes.io/projected/eb34a81f-663e-4027-bf2c-1d334bd06ba4-kube-api-access-wm5j9\") pod \"neutron-7b9f48f6c8-rfj5g\" (UID: \"eb34a81f-663e-4027-bf2c-1d334bd06ba4\") " pod="openstack-kuttl-tests/neutron-7b9f48f6c8-rfj5g" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.771540 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage17-crc" (OuterVolumeSpecName: "ovndbcluster-nb-etc-ovn") pod "32963b23-d87d-4107-9a13-32737c586ab3" (UID: "32963b23-d87d-4107-9a13-32737c586ab3"). InnerVolumeSpecName "local-storage17-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.771558 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32963b23-d87d-4107-9a13-32737c586ab3-kube-api-access-79rnw" (OuterVolumeSpecName: "kube-api-access-79rnw") pod "32963b23-d87d-4107-9a13-32737c586ab3" (UID: "32963b23-d87d-4107-9a13-32737c586ab3"). InnerVolumeSpecName "kube-api-access-79rnw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.816691 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-6cc74c8747-7pf27"] Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.823462 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-584b8687b4-5c6lr"] Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.851614 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a93918e6-bb45-4717-afef-978bad1c6612-operator-scripts\") pod \"openstack-galera-0\" (UID: \"a93918e6-bb45-4717-afef-978bad1c6612\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.851827 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/a93918e6-bb45-4717-afef-978bad1c6612-config-data-default\") pod \"openstack-galera-0\" (UID: \"a93918e6-bb45-4717-afef-978bad1c6612\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.852339 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/a93918e6-bb45-4717-afef-978bad1c6612-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"a93918e6-bb45-4717-afef-978bad1c6612\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.852460 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"openstack-galera-0\" (UID: \"a93918e6-bb45-4717-afef-978bad1c6612\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.852512 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/a93918e6-bb45-4717-afef-978bad1c6612-kolla-config\") pod \"openstack-galera-0\" (UID: \"a93918e6-bb45-4717-afef-978bad1c6612\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.854191 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zf4d\" (UniqueName: \"kubernetes.io/projected/a93918e6-bb45-4717-afef-978bad1c6612-kube-api-access-7zf4d\") pod \"openstack-galera-0\" (UID: \"a93918e6-bb45-4717-afef-978bad1c6612\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.854264 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/a93918e6-bb45-4717-afef-978bad1c6612-config-data-generated\") pod \"openstack-galera-0\" (UID: \"a93918e6-bb45-4717-afef-978bad1c6612\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.854317 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a93918e6-bb45-4717-afef-978bad1c6612-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"a93918e6-bb45-4717-afef-978bad1c6612\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.854681 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") on node \"crc\" " Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.856010 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-79rnw\" (UniqueName: \"kubernetes.io/projected/32963b23-d87d-4107-9a13-32737c586ab3-kube-api-access-79rnw\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.862473 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.862659 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.958708 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"openstack-galera-0\" (UID: \"a93918e6-bb45-4717-afef-978bad1c6612\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.958787 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/a93918e6-bb45-4717-afef-978bad1c6612-kolla-config\") pod \"openstack-galera-0\" (UID: \"a93918e6-bb45-4717-afef-978bad1c6612\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.958917 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7zf4d\" (UniqueName: \"kubernetes.io/projected/a93918e6-bb45-4717-afef-978bad1c6612-kube-api-access-7zf4d\") pod \"openstack-galera-0\" (UID: \"a93918e6-bb45-4717-afef-978bad1c6612\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.958949 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/a93918e6-bb45-4717-afef-978bad1c6612-config-data-generated\") pod \"openstack-galera-0\" (UID: \"a93918e6-bb45-4717-afef-978bad1c6612\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.958980 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a93918e6-bb45-4717-afef-978bad1c6612-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"a93918e6-bb45-4717-afef-978bad1c6612\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.959257 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a93918e6-bb45-4717-afef-978bad1c6612-operator-scripts\") pod \"openstack-galera-0\" (UID: \"a93918e6-bb45-4717-afef-978bad1c6612\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.959337 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/a93918e6-bb45-4717-afef-978bad1c6612-config-data-default\") pod \"openstack-galera-0\" (UID: \"a93918e6-bb45-4717-afef-978bad1c6612\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.959372 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/a93918e6-bb45-4717-afef-978bad1c6612-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"a93918e6-bb45-4717-afef-978bad1c6612\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.967946 5120 scope.go:117] "RemoveContainer" containerID="c7b4c951eebbeecee6717053b294c87b2bb789c71cabb8788e9ebfe41d5a8b39" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.968649 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/a93918e6-bb45-4717-afef-978bad1c6612-config-data-generated\") pod \"openstack-galera-0\" (UID: \"a93918e6-bb45-4717-afef-978bad1c6612\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.968806 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"openstack-galera-0\" (UID: \"a93918e6-bb45-4717-afef-978bad1c6612\") device mount path \"/mnt/openstack/pv16\"" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.969654 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/a93918e6-bb45-4717-afef-978bad1c6612-config-data-default\") pod \"openstack-galera-0\" (UID: \"a93918e6-bb45-4717-afef-978bad1c6612\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.971373 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a93918e6-bb45-4717-afef-978bad1c6612-operator-scripts\") pod \"openstack-galera-0\" (UID: \"a93918e6-bb45-4717-afef-978bad1c6612\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:53:17 crc kubenswrapper[5120]: I0316 16:53:17.971496 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/a93918e6-bb45-4717-afef-978bad1c6612-kolla-config\") pod \"openstack-galera-0\" (UID: \"a93918e6-bb45-4717-afef-978bad1c6612\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:53:18 crc kubenswrapper[5120]: I0316 16:53:18.003266 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-7b9f48f6c8-rfj5g" Mar 16 16:53:18 crc kubenswrapper[5120]: I0316 16:53:18.005605 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a93918e6-bb45-4717-afef-978bad1c6612-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"a93918e6-bb45-4717-afef-978bad1c6612\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:53:18 crc kubenswrapper[5120]: I0316 16:53:18.007797 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/a93918e6-bb45-4717-afef-978bad1c6612-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"a93918e6-bb45-4717-afef-978bad1c6612\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:53:18 crc kubenswrapper[5120]: I0316 16:53:18.038437 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zf4d\" (UniqueName: \"kubernetes.io/projected/a93918e6-bb45-4717-afef-978bad1c6612-kube-api-access-7zf4d\") pod \"openstack-galera-0\" (UID: \"a93918e6-bb45-4717-afef-978bad1c6612\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:53:18 crc kubenswrapper[5120]: I0316 16:53:18.235044 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-78dc5f4cb-mjvvc"] Mar 16 16:53:18 crc kubenswrapper[5120]: I0316 16:53:18.311125 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"openstack-galera-0\" (UID: \"a93918e6-bb45-4717-afef-978bad1c6612\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:53:18 crc kubenswrapper[5120]: I0316 16:53:18.355849 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-6cc74c8747-7pf27" event={"ID":"ae73ae1d-4056-43c2-addd-f08999a4a7f6","Type":"ContainerStarted","Data":"a369ef2c2887ebfeeb749d5e1a9248058cb02b52a56c6abedde69851dbecd73c"} Mar 16 16:53:18 crc kubenswrapper[5120]: I0316 16:53:18.357703 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"ef964d2a-6681-47c5-9a3b-29fe733ee9f0","Type":"ContainerStarted","Data":"50a7aad84014a1700b53fcc27f170796a9610d2fc144e609cb89c547825e3660"} Mar 16 16:53:18 crc kubenswrapper[5120]: I0316 16:53:18.365009 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:53:18 crc kubenswrapper[5120]: I0316 16:53:18.368797 5120 generic.go:358] "Generic (PLEG): container finished" podID="61483cf5-d3db-49de-afa4-66f0efecdd70" containerID="b9b50e1abd0a98057d330e8c90a59f5a055779de61849723c628b054ab0cd288" exitCode=0 Mar 16 16:53:18 crc kubenswrapper[5120]: I0316 16:53:18.368828 5120 generic.go:358] "Generic (PLEG): container finished" podID="61483cf5-d3db-49de-afa4-66f0efecdd70" containerID="eef8c8d8f98f45622b4eea759dfa1ab6270fda4adb6058f0408cabf7fcc9d269" exitCode=2 Mar 16 16:53:18 crc kubenswrapper[5120]: I0316 16:53:18.368835 5120 generic.go:358] "Generic (PLEG): container finished" podID="61483cf5-d3db-49de-afa4-66f0efecdd70" containerID="7e4afb4b4a40e2ae0676505302e76e0be75d2f157b59d02034c7d6f97f9ffdcf" exitCode=0 Mar 16 16:53:18 crc kubenswrapper[5120]: I0316 16:53:18.368842 5120 generic.go:358] "Generic (PLEG): container finished" podID="61483cf5-d3db-49de-afa4-66f0efecdd70" containerID="9dea7e07ec457522ac530558fa96a46af205c7f4f10ffce3f455074081c4bf97" exitCode=0 Mar 16 16:53:18 crc kubenswrapper[5120]: I0316 16:53:18.368932 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"61483cf5-d3db-49de-afa4-66f0efecdd70","Type":"ContainerDied","Data":"b9b50e1abd0a98057d330e8c90a59f5a055779de61849723c628b054ab0cd288"} Mar 16 16:53:18 crc kubenswrapper[5120]: I0316 16:53:18.368968 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"61483cf5-d3db-49de-afa4-66f0efecdd70","Type":"ContainerDied","Data":"eef8c8d8f98f45622b4eea759dfa1ab6270fda4adb6058f0408cabf7fcc9d269"} Mar 16 16:53:18 crc kubenswrapper[5120]: I0316 16:53:18.368985 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"61483cf5-d3db-49de-afa4-66f0efecdd70","Type":"ContainerDied","Data":"7e4afb4b4a40e2ae0676505302e76e0be75d2f157b59d02034c7d6f97f9ffdcf"} Mar 16 16:53:18 crc kubenswrapper[5120]: I0316 16:53:18.368996 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"61483cf5-d3db-49de-afa4-66f0efecdd70","Type":"ContainerDied","Data":"9dea7e07ec457522ac530558fa96a46af205c7f4f10ffce3f455074081c4bf97"} Mar 16 16:53:18 crc kubenswrapper[5120]: I0316 16:53:18.377728 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-88757f4fd-w4kvr" event={"ID":"9fab4617-1011-48f5-90ae-5415fd9b91b4","Type":"ContainerStarted","Data":"06c504195824359573d119aba30897b0a5f404723faa634855a3d726aa4c206f"} Mar 16 16:53:18 crc kubenswrapper[5120]: I0316 16:53:18.382854 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-788658cdb6-tsr2b" event={"ID":"472a9d94-a155-4916-aab9-4672a3c6c18c","Type":"ContainerStarted","Data":"eb3a9598f945aac4abc7230fbcc3f3d38d0857fb176b3a19f8a277b9766e0b82"} Mar 16 16:53:18 crc kubenswrapper[5120]: I0316 16:53:18.391743 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage17-crc" (UniqueName: "kubernetes.io/local-volume/local-storage17-crc") on node "crc" Mar 16 16:53:18 crc kubenswrapper[5120]: I0316 16:53:18.416436 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-6f698c8979-vxjjg" event={"ID":"c1cda6a8-906f-4375-8909-a0548d69ecd6","Type":"ContainerStarted","Data":"4f879c3bd9816eb1ce4735187ae9751d3a5026166a511bc26fa6a7f0eb953556"} Mar 16 16:53:18 crc kubenswrapper[5120]: I0316 16:53:18.433664 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:18 crc kubenswrapper[5120]: I0316 16:53:18.473061 5120 generic.go:358] "Generic (PLEG): container finished" podID="4907839f-9071-4378-90f6-f92ced0b0bf0" containerID="c015127c07a61c75b148a24b94cb58126066d557796401e4738fd413970294a5" exitCode=0 Mar 16 16:53:18 crc kubenswrapper[5120]: I0316 16:53:18.473159 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-f56965744-skhtb" event={"ID":"4907839f-9071-4378-90f6-f92ced0b0bf0","Type":"ContainerDied","Data":"c015127c07a61c75b148a24b94cb58126066d557796401e4738fd413970294a5"} Mar 16 16:53:18 crc kubenswrapper[5120]: I0316 16:53:18.495854 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_32963b23-d87d-4107-9a13-32737c586ab3/ovsdbserver-nb/0.log" Mar 16 16:53:18 crc kubenswrapper[5120]: I0316 16:53:18.495989 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:53:18 crc kubenswrapper[5120]: I0316 16:53:18.496478 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"32963b23-d87d-4107-9a13-32737c586ab3","Type":"ContainerDied","Data":"58c07a51b4172ab9053522a005ba3b17022f1d3fb05e71513b0dedcd67769622"} Mar 16 16:53:18 crc kubenswrapper[5120]: I0316 16:53:18.526985 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"bd162855-8210-41c5-9494-15a62edf991c","Type":"ContainerStarted","Data":"fe3704d93cf9ed8fa0ca53adf27dda6cc128a01d21af312c28390e31e1f5577a"} Mar 16 16:53:18 crc kubenswrapper[5120]: I0316 16:53:18.544121 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-5fd9d6b8f6-vq7wb" event={"ID":"cb37f123-034b-4ccb-9f71-676a322e2a8b","Type":"ContainerStarted","Data":"e7988bbd4e370c1b3b8d66ef4078a84ae01eef1bd0c914a902ac15140a2da83a"} Mar 16 16:53:18 crc kubenswrapper[5120]: I0316 16:53:18.544315 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-5fd9d6b8f6-vq7wb" podUID="cb37f123-034b-4ccb-9f71-676a322e2a8b" containerName="barbican-api-log" containerID="cri-o://053113b17b02d421627a8e291f395e1cfd1afc02c65e30954739fd56da975ac8" gracePeriod=30 Mar 16 16:53:18 crc kubenswrapper[5120]: I0316 16:53:18.544455 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-5fd9d6b8f6-vq7wb" Mar 16 16:53:18 crc kubenswrapper[5120]: I0316 16:53:18.544825 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-5fd9d6b8f6-vq7wb" Mar 16 16:53:18 crc kubenswrapper[5120]: I0316 16:53:18.544955 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-5fd9d6b8f6-vq7wb" podUID="cb37f123-034b-4ccb-9f71-676a322e2a8b" containerName="barbican-api" containerID="cri-o://e7988bbd4e370c1b3b8d66ef4078a84ae01eef1bd0c914a902ac15140a2da83a" gracePeriod=30 Mar 16 16:53:18 crc kubenswrapper[5120]: I0316 16:53:18.547085 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-f67b885f6-v4nhp" event={"ID":"133b5e0f-d834-4c59-932f-957221e1727b","Type":"ContainerStarted","Data":"550a482710c28eab0491207e17c6a03a7948797a16de7ca95046c49632833e1e"} Mar 16 16:53:18 crc kubenswrapper[5120]: I0316 16:53:18.547353 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/32963b23-d87d-4107-9a13-32737c586ab3-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "32963b23-d87d-4107-9a13-32737c586ab3" (UID: "32963b23-d87d-4107-9a13-32737c586ab3"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:18 crc kubenswrapper[5120]: I0316 16:53:18.564725 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_6792b2c6-f5cf-454a-858a-cbd4159db76a/ovsdbserver-sb/0.log" Mar 16 16:53:18 crc kubenswrapper[5120]: I0316 16:53:18.565281 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:53:18 crc kubenswrapper[5120]: I0316 16:53:18.565491 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"6792b2c6-f5cf-454a-858a-cbd4159db76a","Type":"ContainerDied","Data":"6f037be1f8ac8aa6c914216a50a04df7a7b8faf86a594c9b73057837652528f1"} Mar 16 16:53:18 crc kubenswrapper[5120]: I0316 16:53:18.577212 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=8.577195106 podStartE2EDuration="8.577195106s" podCreationTimestamp="2026-03-16 16:53:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:53:18.569351302 +0000 UTC m=+4900.723282959" watchObservedRunningTime="2026-03-16 16:53:18.577195106 +0000 UTC m=+4900.731126763" Mar 16 16:53:18 crc kubenswrapper[5120]: I0316 16:53:18.598930 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"7a0880a9-40d3-4b78-890b-b24bf32a92e7","Type":"ContainerStarted","Data":"a3458e09a4d71e0651e5fbec6a91c41fed3e7b1d960d3b333305b6f923b0096e"} Mar 16 16:53:18 crc kubenswrapper[5120]: I0316 16:53:18.599114 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/memcached-0" podUID="5e1c9d08-874f-40cb-9837-5cfd2509c352" containerName="memcached" containerID="cri-o://f314570a4d17cb896242fa890e6e2c5cde63f50249c5330dd067122e2196f485" gracePeriod=30 Mar 16 16:53:18 crc kubenswrapper[5120]: I0316 16:53:18.599303 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="3fd94d95-2cbb-4ec5-9413-1a2ddc6480c5" containerName="nova-metadata-log" containerID="cri-o://689441178da2c3680f3bbafa950dbb9dffebf6514eab1e2411af50dc9130eb26" gracePeriod=30 Mar 16 16:53:18 crc kubenswrapper[5120]: I0316 16:53:18.599397 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="3fd94d95-2cbb-4ec5-9413-1a2ddc6480c5" containerName="nova-metadata-metadata" containerID="cri-o://3aa559655b6f0b1f37412aa77a62ea4ba9bc14a1b72c18329bbf1a6ddbe914b3" gracePeriod=30 Mar 16 16:53:18 crc kubenswrapper[5120]: I0316 16:53:18.599324 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:53:18 crc kubenswrapper[5120]: I0316 16:53:18.599504 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podUID="dda14ac9-f9b1-4927-a4a4-147c5435906c" containerName="nova-cell1-novncproxy-novncproxy" containerID="cri-o://855d81c54b5a73dfb6e48b74a4cf1924e34cc373893fb720b9f3701b667bd089" gracePeriod=30 Mar 16 16:53:18 crc kubenswrapper[5120]: I0316 16:53:18.599935 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="07523c84-c61c-42f5-9282-324e6cc37cf7" containerName="nova-cell1-conductor-conductor" containerID="cri-o://a7a968e6d8db4b5312cb444cbccadb44d543d993578f1d5780def2a96ed57633" gracePeriod=30 Mar 16 16:53:18 crc kubenswrapper[5120]: I0316 16:53:18.671567 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/32963b23-d87d-4107-9a13-32737c586ab3-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:18 crc kubenswrapper[5120]: I0316 16:53:18.697142 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="3fd94d95-2cbb-4ec5-9413-1a2ddc6480c5" containerName="nova-metadata-log" probeResult="failure" output="Get \"https://10.217.0.160:8775/\": EOF" Mar 16 16:53:18 crc kubenswrapper[5120]: I0316 16:53:18.699115 5120 pod_container_manager_linux.go:217] "Failed to delete cgroup paths" cgroupName=["kubepods","besteffort","podc89f3439-256a-47de-9a4b-33f3a5231721"] err="unable to destroy cgroup paths for cgroup [kubepods besteffort podc89f3439-256a-47de-9a4b-33f3a5231721] : Timed out while waiting for systemd to remove kubepods-besteffort-podc89f3439_256a_47de_9a4b_33f3a5231721.slice" Mar 16 16:53:18 crc kubenswrapper[5120]: I0316 16:53:18.699529 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="3fd94d95-2cbb-4ec5-9413-1a2ddc6480c5" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"https://10.217.0.160:8775/\": EOF" Mar 16 16:53:18 crc kubenswrapper[5120]: I0316 16:53:18.710994 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-api-5fd9d6b8f6-vq7wb" podStartSLOduration=9.703744081 podStartE2EDuration="9.703744081s" podCreationTimestamp="2026-03-16 16:53:09 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:53:18.625193461 +0000 UTC m=+4900.779125118" watchObservedRunningTime="2026-03-16 16:53:18.703744081 +0000 UTC m=+4900.857675738" Mar 16 16:53:18 crc kubenswrapper[5120]: I0316 16:53:18.731225 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/openstack-cell1-galera-0" podUID="e5c498e5-584c-4cdd-b008-c643b7bb1bc5" containerName="galera" containerID="cri-o://4f87e2ba79ef2ad55e9134e65028d8ffb56874b0a0b9cd57961496fea5e06a3b" gracePeriod=29 Mar 16 16:53:18 crc kubenswrapper[5120]: I0316 16:53:18.757348 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-5fd9d6b8f6-vq7wb" podUID="cb37f123-034b-4ccb-9f71-676a322e2a8b" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.0.162:9311/healthcheck\": read tcp 10.217.0.2:38024->10.217.0.162:9311: read: connection reset by peer" Mar 16 16:53:18 crc kubenswrapper[5120]: I0316 16:53:18.798402 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d9062d0-d8bb-4ab3-b2c5-33fa78833a65" path="/var/lib/kubelet/pods/0d9062d0-d8bb-4ab3-b2c5-33fa78833a65/volumes" Mar 16 16:53:19 crc kubenswrapper[5120]: I0316 16:53:19.026312 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage06-crc" (UniqueName: "kubernetes.io/local-volume/local-storage06-crc") on node "crc" Mar 16 16:53:19 crc kubenswrapper[5120]: I0316 16:53:19.144879 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6792b2c6-f5cf-454a-858a-cbd4159db76a-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "6792b2c6-f5cf-454a-858a-cbd4159db76a" (UID: "6792b2c6-f5cf-454a-858a-cbd4159db76a"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:19 crc kubenswrapper[5120]: I0316 16:53:19.176566 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:19 crc kubenswrapper[5120]: I0316 16:53:19.176610 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6792b2c6-f5cf-454a-858a-cbd4159db76a-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:19 crc kubenswrapper[5120]: I0316 16:53:19.179123 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/32963b23-d87d-4107-9a13-32737c586ab3-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "32963b23-d87d-4107-9a13-32737c586ab3" (UID: "32963b23-d87d-4107-9a13-32737c586ab3"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:19 crc kubenswrapper[5120]: I0316 16:53:19.279128 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6792b2c6-f5cf-454a-858a-cbd4159db76a-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "6792b2c6-f5cf-454a-858a-cbd4159db76a" (UID: "6792b2c6-f5cf-454a-858a-cbd4159db76a"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:19 crc kubenswrapper[5120]: I0316 16:53:19.281281 5120 reconciler_common.go:299] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/32963b23-d87d-4107-9a13-32737c586ab3-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:19 crc kubenswrapper[5120]: I0316 16:53:19.281303 5120 reconciler_common.go:299] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/6792b2c6-f5cf-454a-858a-cbd4159db76a-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:19 crc kubenswrapper[5120]: I0316 16:53:19.284089 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/32963b23-d87d-4107-9a13-32737c586ab3-ovsdbserver-nb-tls-certs" (OuterVolumeSpecName: "ovsdbserver-nb-tls-certs") pod "32963b23-d87d-4107-9a13-32737c586ab3" (UID: "32963b23-d87d-4107-9a13-32737c586ab3"). InnerVolumeSpecName "ovsdbserver-nb-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:19 crc kubenswrapper[5120]: I0316 16:53:19.388085 5120 reconciler_common.go:299] "Volume detached for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/32963b23-d87d-4107-9a13-32737c586ab3-ovsdbserver-nb-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:19 crc kubenswrapper[5120]: I0316 16:53:19.433078 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6792b2c6-f5cf-454a-858a-cbd4159db76a-ovsdbserver-sb-tls-certs" (OuterVolumeSpecName: "ovsdbserver-sb-tls-certs") pod "6792b2c6-f5cf-454a-858a-cbd4159db76a" (UID: "6792b2c6-f5cf-454a-858a-cbd4159db76a"). InnerVolumeSpecName "ovsdbserver-sb-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:19 crc kubenswrapper[5120]: I0316 16:53:19.492430 5120 reconciler_common.go:299] "Volume detached for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/6792b2c6-f5cf-454a-858a-cbd4159db76a-ovsdbserver-sb-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:19 crc kubenswrapper[5120]: I0316 16:53:19.662192 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:53:19 crc kubenswrapper[5120]: I0316 16:53:19.662239 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/keystone-6d764c69b8-sv9d2" Mar 16 16:53:19 crc kubenswrapper[5120]: I0316 16:53:19.818964 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-78dc5f4cb-mjvvc" event={"ID":"152925c6-48ae-4e8d-9a3f-68f01278fe95","Type":"ContainerStarted","Data":"1b9f6c76fb4d2ac23917b7ad430fe49a16da79062075306d04eb4d5c963ab848"} Mar 16 16:53:19 crc kubenswrapper[5120]: I0316 16:53:19.837742 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:53:19 crc kubenswrapper[5120]: I0316 16:53:19.850196 5120 generic.go:358] "Generic (PLEG): container finished" podID="07523c84-c61c-42f5-9282-324e6cc37cf7" containerID="a7a968e6d8db4b5312cb444cbccadb44d543d993578f1d5780def2a96ed57633" exitCode=1 Mar 16 16:53:19 crc kubenswrapper[5120]: I0316 16:53:19.851044 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"07523c84-c61c-42f5-9282-324e6cc37cf7","Type":"ContainerDied","Data":"a7a968e6d8db4b5312cb444cbccadb44d543d993578f1d5780def2a96ed57633"} Mar 16 16:53:19 crc kubenswrapper[5120]: I0316 16:53:19.859837 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 16:53:19 crc kubenswrapper[5120]: I0316 16:53:19.879624 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-647f8b964-49qkc" podUID="a5d3f7a6-64f6-47f9-a144-41a356078e4b" containerName="barbican-api-log" containerID="cri-o://26bcb4771703f1b3befddf195c3f98963f2607b7b970751d8c680b603c3f68e7" gracePeriod=30 Mar 16 16:53:19 crc kubenswrapper[5120]: I0316 16:53:19.879740 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-647f8b964-49qkc" podUID="a5d3f7a6-64f6-47f9-a144-41a356078e4b" containerName="barbican-api" containerID="cri-o://d7eef0307a62d5623eb48d8b895afed500f513ef1cfb23d17e6dc940cf05613f" gracePeriod=30 Mar 16 16:53:19 crc kubenswrapper[5120]: I0316 16:53:19.879625 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-647f8b964-49qkc" event={"ID":"a5d3f7a6-64f6-47f9-a144-41a356078e4b","Type":"ContainerStarted","Data":"d7eef0307a62d5623eb48d8b895afed500f513ef1cfb23d17e6dc940cf05613f"} Mar 16 16:53:19 crc kubenswrapper[5120]: I0316 16:53:19.880195 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-647f8b964-49qkc" Mar 16 16:53:19 crc kubenswrapper[5120]: I0316 16:53:19.880216 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-647f8b964-49qkc" Mar 16 16:53:19 crc kubenswrapper[5120]: I0316 16:53:19.889601 5120 generic.go:358] "Generic (PLEG): container finished" podID="cb37f123-034b-4ccb-9f71-676a322e2a8b" containerID="e7988bbd4e370c1b3b8d66ef4078a84ae01eef1bd0c914a902ac15140a2da83a" exitCode=0 Mar 16 16:53:19 crc kubenswrapper[5120]: I0316 16:53:19.889631 5120 generic.go:358] "Generic (PLEG): container finished" podID="cb37f123-034b-4ccb-9f71-676a322e2a8b" containerID="053113b17b02d421627a8e291f395e1cfd1afc02c65e30954739fd56da975ac8" exitCode=143 Mar 16 16:53:19 crc kubenswrapper[5120]: I0316 16:53:19.889709 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-5fd9d6b8f6-vq7wb" event={"ID":"cb37f123-034b-4ccb-9f71-676a322e2a8b","Type":"ContainerDied","Data":"e7988bbd4e370c1b3b8d66ef4078a84ae01eef1bd0c914a902ac15140a2da83a"} Mar 16 16:53:19 crc kubenswrapper[5120]: I0316 16:53:19.889733 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-5fd9d6b8f6-vq7wb" event={"ID":"cb37f123-034b-4ccb-9f71-676a322e2a8b","Type":"ContainerDied","Data":"053113b17b02d421627a8e291f395e1cfd1afc02c65e30954739fd56da975ac8"} Mar 16 16:53:19 crc kubenswrapper[5120]: I0316 16:53:19.893828 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-584b8687b4-5c6lr" event={"ID":"cc4853a6-faf5-45dc-b6f4-aa0b65d0ca8d","Type":"ContainerStarted","Data":"17575fc058505aee56aec379125503a468dac2ec3f4907c4ea5ab5c272a02ef6"} Mar 16 16:53:19 crc kubenswrapper[5120]: I0316 16:53:19.902584 5120 generic.go:358] "Generic (PLEG): container finished" podID="3fd94d95-2cbb-4ec5-9413-1a2ddc6480c5" containerID="689441178da2c3680f3bbafa950dbb9dffebf6514eab1e2411af50dc9130eb26" exitCode=143 Mar 16 16:53:19 crc kubenswrapper[5120]: I0316 16:53:19.902750 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"3fd94d95-2cbb-4ec5-9413-1a2ddc6480c5","Type":"ContainerDied","Data":"689441178da2c3680f3bbafa950dbb9dffebf6514eab1e2411af50dc9130eb26"} Mar 16 16:53:19 crc kubenswrapper[5120]: I0316 16:53:19.917625 5120 generic.go:358] "Generic (PLEG): container finished" podID="e5c498e5-584c-4cdd-b008-c643b7bb1bc5" containerID="4f87e2ba79ef2ad55e9134e65028d8ffb56874b0a0b9cd57961496fea5e06a3b" exitCode=0 Mar 16 16:53:19 crc kubenswrapper[5120]: I0316 16:53:19.917809 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 16:53:19 crc kubenswrapper[5120]: I0316 16:53:19.917843 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"e5c498e5-584c-4cdd-b008-c643b7bb1bc5","Type":"ContainerDied","Data":"4f87e2ba79ef2ad55e9134e65028d8ffb56874b0a0b9cd57961496fea5e06a3b"} Mar 16 16:53:19 crc kubenswrapper[5120]: I0316 16:53:19.918544 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/61483cf5-d3db-49de-afa4-66f0efecdd70-sg-core-conf-yaml\") pod \"61483cf5-d3db-49de-afa4-66f0efecdd70\" (UID: \"61483cf5-d3db-49de-afa4-66f0efecdd70\") " Mar 16 16:53:19 crc kubenswrapper[5120]: I0316 16:53:19.919898 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/61483cf5-d3db-49de-afa4-66f0efecdd70-run-httpd\") pod \"61483cf5-d3db-49de-afa4-66f0efecdd70\" (UID: \"61483cf5-d3db-49de-afa4-66f0efecdd70\") " Mar 16 16:53:19 crc kubenswrapper[5120]: I0316 16:53:19.920058 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xg6p5\" (UniqueName: \"kubernetes.io/projected/61483cf5-d3db-49de-afa4-66f0efecdd70-kube-api-access-xg6p5\") pod \"61483cf5-d3db-49de-afa4-66f0efecdd70\" (UID: \"61483cf5-d3db-49de-afa4-66f0efecdd70\") " Mar 16 16:53:19 crc kubenswrapper[5120]: I0316 16:53:19.920120 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/61483cf5-d3db-49de-afa4-66f0efecdd70-log-httpd\") pod \"61483cf5-d3db-49de-afa4-66f0efecdd70\" (UID: \"61483cf5-d3db-49de-afa4-66f0efecdd70\") " Mar 16 16:53:19 crc kubenswrapper[5120]: I0316 16:53:19.920152 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/61483cf5-d3db-49de-afa4-66f0efecdd70-combined-ca-bundle\") pod \"61483cf5-d3db-49de-afa4-66f0efecdd70\" (UID: \"61483cf5-d3db-49de-afa4-66f0efecdd70\") " Mar 16 16:53:19 crc kubenswrapper[5120]: I0316 16:53:19.920334 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/61483cf5-d3db-49de-afa4-66f0efecdd70-ceilometer-tls-certs\") pod \"61483cf5-d3db-49de-afa4-66f0efecdd70\" (UID: \"61483cf5-d3db-49de-afa4-66f0efecdd70\") " Mar 16 16:53:19 crc kubenswrapper[5120]: I0316 16:53:19.920374 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/61483cf5-d3db-49de-afa4-66f0efecdd70-config-data\") pod \"61483cf5-d3db-49de-afa4-66f0efecdd70\" (UID: \"61483cf5-d3db-49de-afa4-66f0efecdd70\") " Mar 16 16:53:19 crc kubenswrapper[5120]: I0316 16:53:19.920543 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/61483cf5-d3db-49de-afa4-66f0efecdd70-scripts\") pod \"61483cf5-d3db-49de-afa4-66f0efecdd70\" (UID: \"61483cf5-d3db-49de-afa4-66f0efecdd70\") " Mar 16 16:53:19 crc kubenswrapper[5120]: I0316 16:53:19.923268 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61483cf5-d3db-49de-afa4-66f0efecdd70-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "61483cf5-d3db-49de-afa4-66f0efecdd70" (UID: "61483cf5-d3db-49de-afa4-66f0efecdd70"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:53:19 crc kubenswrapper[5120]: I0316 16:53:19.924267 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61483cf5-d3db-49de-afa4-66f0efecdd70-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "61483cf5-d3db-49de-afa4-66f0efecdd70" (UID: "61483cf5-d3db-49de-afa4-66f0efecdd70"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:53:19 crc kubenswrapper[5120]: I0316 16:53:19.927128 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61483cf5-d3db-49de-afa4-66f0efecdd70-scripts" (OuterVolumeSpecName: "scripts") pod "61483cf5-d3db-49de-afa4-66f0efecdd70" (UID: "61483cf5-d3db-49de-afa4-66f0efecdd70"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:19 crc kubenswrapper[5120]: I0316 16:53:19.945503 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61483cf5-d3db-49de-afa4-66f0efecdd70-kube-api-access-xg6p5" (OuterVolumeSpecName: "kube-api-access-xg6p5") pod "61483cf5-d3db-49de-afa4-66f0efecdd70" (UID: "61483cf5-d3db-49de-afa4-66f0efecdd70"). InnerVolumeSpecName "kube-api-access-xg6p5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:53:19 crc kubenswrapper[5120]: I0316 16:53:19.952235 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-f6bd6ffc7-nq4s9"] Mar 16 16:53:19 crc kubenswrapper[5120]: I0316 16:53:19.954130 5120 generic.go:358] "Generic (PLEG): container finished" podID="dda14ac9-f9b1-4927-a4a4-147c5435906c" containerID="855d81c54b5a73dfb6e48b74a4cf1924e34cc373893fb720b9f3701b667bd089" exitCode=0 Mar 16 16:53:19 crc kubenswrapper[5120]: I0316 16:53:19.954243 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"dda14ac9-f9b1-4927-a4a4-147c5435906c","Type":"ContainerDied","Data":"855d81c54b5a73dfb6e48b74a4cf1924e34cc373893fb720b9f3701b667bd089"} Mar 16 16:53:19 crc kubenswrapper[5120]: I0316 16:53:19.979652 5120 generic.go:358] "Generic (PLEG): container finished" podID="9c42ca14-5afb-4688-a2cf-ddf314020f18" containerID="3d1fa3f05cf04af9cd4ade7a65089fa1f8351ed405ba76f965c47bc010d6ef00" exitCode=1 Mar 16 16:53:19 crc kubenswrapper[5120]: I0316 16:53:19.979849 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"9c42ca14-5afb-4688-a2cf-ddf314020f18","Type":"ContainerDied","Data":"3d1fa3f05cf04af9cd4ade7a65089fa1f8351ed405ba76f965c47bc010d6ef00"} Mar 16 16:53:19 crc kubenswrapper[5120]: I0316 16:53:19.992723 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="bd162855-8210-41c5-9494-15a62edf991c" containerName="nova-api-log" containerID="cri-o://de5b56d392648f53e472ea3236bd1ceb79ed7862f164f660f14895f66976aaab" gracePeriod=30 Mar 16 16:53:19 crc kubenswrapper[5120]: I0316 16:53:19.993133 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:53:19 crc kubenswrapper[5120]: I0316 16:53:19.993442 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"61483cf5-d3db-49de-afa4-66f0efecdd70","Type":"ContainerDied","Data":"619821620b07c15b5a46c94ce768d14dec3946f29b80468b52f71159f04265cc"} Mar 16 16:53:19 crc kubenswrapper[5120]: I0316 16:53:19.993485 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 16:53:19 crc kubenswrapper[5120]: I0316 16:53:19.995609 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61483cf5-d3db-49de-afa4-66f0efecdd70" containerName="ceilometer-central-agent" Mar 16 16:53:19 crc kubenswrapper[5120]: I0316 16:53:19.995638 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="61483cf5-d3db-49de-afa4-66f0efecdd70" containerName="ceilometer-central-agent" Mar 16 16:53:19 crc kubenswrapper[5120]: I0316 16:53:19.995705 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61483cf5-d3db-49de-afa4-66f0efecdd70" containerName="ceilometer-notification-agent" Mar 16 16:53:19 crc kubenswrapper[5120]: I0316 16:53:19.995714 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="61483cf5-d3db-49de-afa4-66f0efecdd70" containerName="ceilometer-notification-agent" Mar 16 16:53:19 crc kubenswrapper[5120]: I0316 16:53:19.995774 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61483cf5-d3db-49de-afa4-66f0efecdd70" containerName="sg-core" Mar 16 16:53:19 crc kubenswrapper[5120]: I0316 16:53:19.995784 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="61483cf5-d3db-49de-afa4-66f0efecdd70" containerName="sg-core" Mar 16 16:53:19 crc kubenswrapper[5120]: I0316 16:53:19.995794 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61483cf5-d3db-49de-afa4-66f0efecdd70" containerName="proxy-httpd" Mar 16 16:53:19 crc kubenswrapper[5120]: I0316 16:53:19.995802 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="61483cf5-d3db-49de-afa4-66f0efecdd70" containerName="proxy-httpd" Mar 16 16:53:19 crc kubenswrapper[5120]: I0316 16:53:19.996020 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="61483cf5-d3db-49de-afa4-66f0efecdd70" containerName="ceilometer-notification-agent" Mar 16 16:53:19 crc kubenswrapper[5120]: I0316 16:53:19.996697 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="61483cf5-d3db-49de-afa4-66f0efecdd70" containerName="ceilometer-central-agent" Mar 16 16:53:19 crc kubenswrapper[5120]: I0316 16:53:19.996718 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="61483cf5-d3db-49de-afa4-66f0efecdd70" containerName="proxy-httpd" Mar 16 16:53:19 crc kubenswrapper[5120]: I0316 16:53:19.996731 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="61483cf5-d3db-49de-afa4-66f0efecdd70" containerName="sg-core" Mar 16 16:53:19 crc kubenswrapper[5120]: I0316 16:53:19.997046 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="bd162855-8210-41c5-9494-15a62edf991c" containerName="nova-api-api" containerID="cri-o://fe3704d93cf9ed8fa0ca53adf27dda6cc128a01d21af312c28390e31e1f5577a" gracePeriod=30 Mar 16 16:53:20 crc kubenswrapper[5120]: I0316 16:53:20.017251 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 16:53:20 crc kubenswrapper[5120]: I0316 16:53:20.017599 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:53:20 crc kubenswrapper[5120]: I0316 16:53:20.017952 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-7f78b864cb-6dgjh" podUID="c06f24f9-95b0-4a92-ad3a-6075764151ed" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.0.133:9311/healthcheck\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Mar 16 16:53:20 crc kubenswrapper[5120]: I0316 16:53:20.018350 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-7f78b864cb-6dgjh" podUID="c06f24f9-95b0-4a92-ad3a-6075764151ed" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.0.133:9311/healthcheck\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Mar 16 16:53:20 crc kubenswrapper[5120]: I0316 16:53:20.022891 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ovncluster-ovndbcluster-nb-dockercfg-6n6ct\"" Mar 16 16:53:20 crc kubenswrapper[5120]: I0316 16:53:20.024323 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ovndbcluster-nb-ovndbs\"" Mar 16 16:53:20 crc kubenswrapper[5120]: I0316 16:53:20.024822 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovndbcluster-nb-scripts\"" Mar 16 16:53:20 crc kubenswrapper[5120]: I0316 16:53:20.027329 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovndbcluster-nb-config\"" Mar 16 16:53:20 crc kubenswrapper[5120]: I0316 16:53:20.033212 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-api-647f8b964-49qkc" podStartSLOduration=10.033158397 podStartE2EDuration="10.033158397s" podCreationTimestamp="2026-03-16 16:53:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:53:19.904106925 +0000 UTC m=+4902.058038582" watchObservedRunningTime="2026-03-16 16:53:20.033158397 +0000 UTC m=+4902.187090054" Mar 16 16:53:20 crc kubenswrapper[5120]: I0316 16:53:20.034964 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/61483cf5-d3db-49de-afa4-66f0efecdd70-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:20 crc kubenswrapper[5120]: I0316 16:53:20.035015 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/61483cf5-d3db-49de-afa4-66f0efecdd70-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:20 crc kubenswrapper[5120]: I0316 16:53:20.035032 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xg6p5\" (UniqueName: \"kubernetes.io/projected/61483cf5-d3db-49de-afa4-66f0efecdd70-kube-api-access-xg6p5\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:20 crc kubenswrapper[5120]: I0316 16:53:20.035048 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/61483cf5-d3db-49de-afa4-66f0efecdd70-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:20 crc kubenswrapper[5120]: I0316 16:53:20.100379 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 16:53:20 crc kubenswrapper[5120]: I0316 16:53:20.138666 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") pod \"ovsdbserver-nb-0\" (UID: \"b3ff7a5c-9d60-4d20-9308-0b7d88d605f6\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:53:20 crc kubenswrapper[5120]: I0316 16:53:20.138865 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/b3ff7a5c-9d60-4d20-9308-0b7d88d605f6-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"b3ff7a5c-9d60-4d20-9308-0b7d88d605f6\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:53:20 crc kubenswrapper[5120]: I0316 16:53:20.138993 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/b3ff7a5c-9d60-4d20-9308-0b7d88d605f6-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"b3ff7a5c-9d60-4d20-9308-0b7d88d605f6\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:53:20 crc kubenswrapper[5120]: I0316 16:53:20.139394 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b3ff7a5c-9d60-4d20-9308-0b7d88d605f6-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"b3ff7a5c-9d60-4d20-9308-0b7d88d605f6\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:53:20 crc kubenswrapper[5120]: I0316 16:53:20.139450 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/b3ff7a5c-9d60-4d20-9308-0b7d88d605f6-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"b3ff7a5c-9d60-4d20-9308-0b7d88d605f6\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:53:20 crc kubenswrapper[5120]: I0316 16:53:20.139640 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/b3ff7a5c-9d60-4d20-9308-0b7d88d605f6-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"b3ff7a5c-9d60-4d20-9308-0b7d88d605f6\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:53:20 crc kubenswrapper[5120]: I0316 16:53:20.139672 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42zrm\" (UniqueName: \"kubernetes.io/projected/b3ff7a5c-9d60-4d20-9308-0b7d88d605f6-kube-api-access-42zrm\") pod \"ovsdbserver-nb-0\" (UID: \"b3ff7a5c-9d60-4d20-9308-0b7d88d605f6\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:53:20 crc kubenswrapper[5120]: I0316 16:53:20.139694 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b3ff7a5c-9d60-4d20-9308-0b7d88d605f6-config\") pod \"ovsdbserver-nb-0\" (UID: \"b3ff7a5c-9d60-4d20-9308-0b7d88d605f6\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:53:20 crc kubenswrapper[5120]: I0316 16:53:20.242581 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/b3ff7a5c-9d60-4d20-9308-0b7d88d605f6-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"b3ff7a5c-9d60-4d20-9308-0b7d88d605f6\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:53:20 crc kubenswrapper[5120]: I0316 16:53:20.242833 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/b3ff7a5c-9d60-4d20-9308-0b7d88d605f6-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"b3ff7a5c-9d60-4d20-9308-0b7d88d605f6\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:53:20 crc kubenswrapper[5120]: I0316 16:53:20.243095 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b3ff7a5c-9d60-4d20-9308-0b7d88d605f6-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"b3ff7a5c-9d60-4d20-9308-0b7d88d605f6\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:53:20 crc kubenswrapper[5120]: I0316 16:53:20.243133 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/b3ff7a5c-9d60-4d20-9308-0b7d88d605f6-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"b3ff7a5c-9d60-4d20-9308-0b7d88d605f6\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:53:20 crc kubenswrapper[5120]: I0316 16:53:20.243245 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/b3ff7a5c-9d60-4d20-9308-0b7d88d605f6-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"b3ff7a5c-9d60-4d20-9308-0b7d88d605f6\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:53:20 crc kubenswrapper[5120]: I0316 16:53:20.243269 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-42zrm\" (UniqueName: \"kubernetes.io/projected/b3ff7a5c-9d60-4d20-9308-0b7d88d605f6-kube-api-access-42zrm\") pod \"ovsdbserver-nb-0\" (UID: \"b3ff7a5c-9d60-4d20-9308-0b7d88d605f6\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:53:20 crc kubenswrapper[5120]: I0316 16:53:20.243288 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b3ff7a5c-9d60-4d20-9308-0b7d88d605f6-config\") pod \"ovsdbserver-nb-0\" (UID: \"b3ff7a5c-9d60-4d20-9308-0b7d88d605f6\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:53:20 crc kubenswrapper[5120]: I0316 16:53:20.243332 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") pod \"ovsdbserver-nb-0\" (UID: \"b3ff7a5c-9d60-4d20-9308-0b7d88d605f6\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:53:20 crc kubenswrapper[5120]: I0316 16:53:20.243734 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") pod \"ovsdbserver-nb-0\" (UID: \"b3ff7a5c-9d60-4d20-9308-0b7d88d605f6\") device mount path \"/mnt/openstack/pv17\"" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:53:20 crc kubenswrapper[5120]: I0316 16:53:20.249872 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/b3ff7a5c-9d60-4d20-9308-0b7d88d605f6-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"b3ff7a5c-9d60-4d20-9308-0b7d88d605f6\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:53:20 crc kubenswrapper[5120]: I0316 16:53:20.251059 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/b3ff7a5c-9d60-4d20-9308-0b7d88d605f6-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"b3ff7a5c-9d60-4d20-9308-0b7d88d605f6\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:53:20 crc kubenswrapper[5120]: I0316 16:53:20.251488 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b3ff7a5c-9d60-4d20-9308-0b7d88d605f6-config\") pod \"ovsdbserver-nb-0\" (UID: \"b3ff7a5c-9d60-4d20-9308-0b7d88d605f6\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:53:20 crc kubenswrapper[5120]: I0316 16:53:20.259489 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/b3ff7a5c-9d60-4d20-9308-0b7d88d605f6-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"b3ff7a5c-9d60-4d20-9308-0b7d88d605f6\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:53:20 crc kubenswrapper[5120]: I0316 16:53:20.267966 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b3ff7a5c-9d60-4d20-9308-0b7d88d605f6-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"b3ff7a5c-9d60-4d20-9308-0b7d88d605f6\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:53:20 crc kubenswrapper[5120]: I0316 16:53:20.272783 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/b3ff7a5c-9d60-4d20-9308-0b7d88d605f6-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"b3ff7a5c-9d60-4d20-9308-0b7d88d605f6\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:53:20 crc kubenswrapper[5120]: I0316 16:53:20.314793 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-42zrm\" (UniqueName: \"kubernetes.io/projected/b3ff7a5c-9d60-4d20-9308-0b7d88d605f6-kube-api-access-42zrm\") pod \"ovsdbserver-nb-0\" (UID: \"b3ff7a5c-9d60-4d20-9308-0b7d88d605f6\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:53:20 crc kubenswrapper[5120]: I0316 16:53:20.484628 5120 scope.go:117] "RemoveContainer" containerID="f6b4b7cbf54c515ab7a385a6ea30158950a8855c60ac7b02ba9e15f7d0ad1e8f" Mar 16 16:53:20 crc kubenswrapper[5120]: I0316 16:53:20.626169 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61483cf5-d3db-49de-afa4-66f0efecdd70-ceilometer-tls-certs" (OuterVolumeSpecName: "ceilometer-tls-certs") pod "61483cf5-d3db-49de-afa4-66f0efecdd70" (UID: "61483cf5-d3db-49de-afa4-66f0efecdd70"). InnerVolumeSpecName "ceilometer-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:20 crc kubenswrapper[5120]: I0316 16:53:20.664569 5120 reconciler_common.go:299] "Volume detached for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/61483cf5-d3db-49de-afa4-66f0efecdd70-ceilometer-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:20 crc kubenswrapper[5120]: I0316 16:53:20.715136 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="32963b23-d87d-4107-9a13-32737c586ab3" path="/var/lib/kubelet/pods/32963b23-d87d-4107-9a13-32737c586ab3/volumes" Mar 16 16:53:20 crc kubenswrapper[5120]: I0316 16:53:20.977018 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/19792b24-d033-444c-85e4-6c61e15b3ef9-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "19792b24-d033-444c-85e4-6c61e15b3ef9" (UID: "19792b24-d033-444c-85e4-6c61e15b3ef9"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:20 crc kubenswrapper[5120]: I0316 16:53:20.984075 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/19792b24-d033-444c-85e4-6c61e15b3ef9-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:21 crc kubenswrapper[5120]: I0316 16:53:21.056254 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61483cf5-d3db-49de-afa4-66f0efecdd70-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "61483cf5-d3db-49de-afa4-66f0efecdd70" (UID: "61483cf5-d3db-49de-afa4-66f0efecdd70"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:21 crc kubenswrapper[5120]: I0316 16:53:21.058197 5120 generic.go:358] "Generic (PLEG): container finished" podID="a5d3f7a6-64f6-47f9-a144-41a356078e4b" containerID="d7eef0307a62d5623eb48d8b895afed500f513ef1cfb23d17e6dc940cf05613f" exitCode=0 Mar 16 16:53:21 crc kubenswrapper[5120]: I0316 16:53:21.058228 5120 generic.go:358] "Generic (PLEG): container finished" podID="a5d3f7a6-64f6-47f9-a144-41a356078e4b" containerID="26bcb4771703f1b3befddf195c3f98963f2607b7b970751d8c680b603c3f68e7" exitCode=143 Mar 16 16:53:21 crc kubenswrapper[5120]: I0316 16:53:21.062899 5120 generic.go:358] "Generic (PLEG): container finished" podID="bd162855-8210-41c5-9494-15a62edf991c" containerID="fe3704d93cf9ed8fa0ca53adf27dda6cc128a01d21af312c28390e31e1f5577a" exitCode=0 Mar 16 16:53:21 crc kubenswrapper[5120]: I0316 16:53:21.062931 5120 generic.go:358] "Generic (PLEG): container finished" podID="bd162855-8210-41c5-9494-15a62edf991c" containerID="de5b56d392648f53e472ea3236bd1ceb79ed7862f164f660f14895f66976aaab" exitCode=143 Mar 16 16:53:21 crc kubenswrapper[5120]: I0316 16:53:21.083143 5120 generic.go:358] "Generic (PLEG): container finished" podID="5e1c9d08-874f-40cb-9837-5cfd2509c352" containerID="f314570a4d17cb896242fa890e6e2c5cde63f50249c5330dd067122e2196f485" exitCode=0 Mar 16 16:53:21 crc kubenswrapper[5120]: I0316 16:53:21.087095 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/61483cf5-d3db-49de-afa4-66f0efecdd70-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:21 crc kubenswrapper[5120]: I0316 16:53:21.096375 5120 generic.go:358] "Generic (PLEG): container finished" podID="d6db354d-c48c-4497-a289-18edadffce47" containerID="92292c523d4b4d250cef5eb000fa5d04e4e544218bdca4cbd993e7670963057a" exitCode=137 Mar 16 16:53:21 crc kubenswrapper[5120]: I0316 16:53:21.151720 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") pod \"ovsdbserver-nb-0\" (UID: \"b3ff7a5c-9d60-4d20-9308-0b7d88d605f6\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:53:21 crc kubenswrapper[5120]: I0316 16:53:21.210512 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61483cf5-d3db-49de-afa4-66f0efecdd70-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "61483cf5-d3db-49de-afa4-66f0efecdd70" (UID: "61483cf5-d3db-49de-afa4-66f0efecdd70"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:21 crc kubenswrapper[5120]: I0316 16:53:21.274432 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61483cf5-d3db-49de-afa4-66f0efecdd70-config-data" (OuterVolumeSpecName: "config-data") pod "61483cf5-d3db-49de-afa4-66f0efecdd70" (UID: "61483cf5-d3db-49de-afa4-66f0efecdd70"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:21 crc kubenswrapper[5120]: I0316 16:53:21.294581 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/61483cf5-d3db-49de-afa4-66f0efecdd70-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:21 crc kubenswrapper[5120]: I0316 16:53:21.294616 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/61483cf5-d3db-49de-afa4-66f0efecdd70-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:21 crc kubenswrapper[5120]: I0316 16:53:21.320835 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:53:21 crc kubenswrapper[5120]: E0316 16:53:21.691231 5120 kubelet.go:2642] "Housekeeping took longer than expected" err="housekeeping took too long" expected="1s" actual="1.026s" Mar 16 16:53:21 crc kubenswrapper[5120]: I0316 16:53:21.691634 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-7b9f48f6c8-rfj5g"] Mar 16 16:53:21 crc kubenswrapper[5120]: I0316 16:53:21.691659 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-6f698c8979-vxjjg" event={"ID":"c1cda6a8-906f-4375-8909-a0548d69ecd6","Type":"ContainerStarted","Data":"8c318abdc8e7a1387979d48e25fa7864bc1adc1e661aaa39226b89b45ce5032f"} Mar 16 16:53:21 crc kubenswrapper[5120]: I0316 16:53:21.691724 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-ccc65f956-nsglj" event={"ID":"cb10ccc3-03fc-4eb7-a637-c2bc721a9b69","Type":"ContainerStarted","Data":"3ad9955eddb7852d5f0975d31c5bd54aa679fe305e10f6e084c39ef302c2e59b"} Mar 16 16:53:21 crc kubenswrapper[5120]: I0316 16:53:21.691983 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-647f8b964-49qkc" event={"ID":"a5d3f7a6-64f6-47f9-a144-41a356078e4b","Type":"ContainerDied","Data":"d7eef0307a62d5623eb48d8b895afed500f513ef1cfb23d17e6dc940cf05613f"} Mar 16 16:53:21 crc kubenswrapper[5120]: I0316 16:53:21.692007 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-647f8b964-49qkc" event={"ID":"a5d3f7a6-64f6-47f9-a144-41a356078e4b","Type":"ContainerDied","Data":"26bcb4771703f1b3befddf195c3f98963f2607b7b970751d8c680b603c3f68e7"} Mar 16 16:53:21 crc kubenswrapper[5120]: I0316 16:53:21.692065 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"bd162855-8210-41c5-9494-15a62edf991c","Type":"ContainerDied","Data":"fe3704d93cf9ed8fa0ca53adf27dda6cc128a01d21af312c28390e31e1f5577a"} Mar 16 16:53:21 crc kubenswrapper[5120]: I0316 16:53:21.692085 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"bd162855-8210-41c5-9494-15a62edf991c","Type":"ContainerDied","Data":"de5b56d392648f53e472ea3236bd1ceb79ed7862f164f660f14895f66976aaab"} Mar 16 16:53:21 crc kubenswrapper[5120]: I0316 16:53:21.692251 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-5fd9d6b8f6-vq7wb" event={"ID":"cb37f123-034b-4ccb-9f71-676a322e2a8b","Type":"ContainerDied","Data":"29fed01a604b3b52039deb0ab79c03e05a0c7fccb9557526dc131d470624bbf4"} Mar 16 16:53:21 crc kubenswrapper[5120]: I0316 16:53:21.692321 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="29fed01a604b3b52039deb0ab79c03e05a0c7fccb9557526dc131d470624bbf4" Mar 16 16:53:21 crc kubenswrapper[5120]: I0316 16:53:21.692336 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-7b9f48f6c8-rfj5g" event={"ID":"eb34a81f-663e-4027-bf2c-1d334bd06ba4","Type":"ContainerStarted","Data":"6716166864b9a3d7ff87e1f2467afa0779d076b8a7ef4978aa9a12328073e443"} Mar 16 16:53:21 crc kubenswrapper[5120]: I0316 16:53:21.692351 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"5e1c9d08-874f-40cb-9837-5cfd2509c352","Type":"ContainerDied","Data":"f314570a4d17cb896242fa890e6e2c5cde63f50249c5330dd067122e2196f485"} Mar 16 16:53:21 crc kubenswrapper[5120]: I0316 16:53:21.692369 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-f67b885f6-v4nhp" event={"ID":"133b5e0f-d834-4c59-932f-957221e1727b","Type":"ContainerStarted","Data":"6a4358b64f103dd33cfb807556544a60eeb87db20e6bbca1f4c32c75f2b20ff2"} Mar 16 16:53:21 crc kubenswrapper[5120]: I0316 16:53:21.692385 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"dda14ac9-f9b1-4927-a4a4-147c5435906c","Type":"ContainerDied","Data":"1a6bcc18858af7e864e387e78a9c5b12ab7f18a098d4e491c0abb014a5608ee5"} Mar 16 16:53:21 crc kubenswrapper[5120]: I0316 16:53:21.692398 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1a6bcc18858af7e864e387e78a9c5b12ab7f18a098d4e491c0abb014a5608ee5" Mar 16 16:53:21 crc kubenswrapper[5120]: I0316 16:53:21.692410 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"9c42ca14-5afb-4688-a2cf-ddf314020f18","Type":"ContainerDied","Data":"569b6997061d8e55b605d24f201f0495075733ef4ceb9693565c7b1a0e2c1a33"} Mar 16 16:53:21 crc kubenswrapper[5120]: I0316 16:53:21.692422 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="569b6997061d8e55b605d24f201f0495075733ef4ceb9693565c7b1a0e2c1a33" Mar 16 16:53:21 crc kubenswrapper[5120]: I0316 16:53:21.692433 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-5964c9d8c-plh78" event={"ID":"d6db354d-c48c-4497-a289-18edadffce47","Type":"ContainerDied","Data":"92292c523d4b4d250cef5eb000fa5d04e4e544218bdca4cbd993e7670963057a"} Mar 16 16:53:21 crc kubenswrapper[5120]: I0316 16:53:21.692562 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"b609e161-5c22-4699-9af9-7f972834422a","Type":"ContainerStarted","Data":"1c97e604f52abab9a8e368bf807db43802deda778f7fb4d78b276c6e7c88807b"} Mar 16 16:53:21 crc kubenswrapper[5120]: I0316 16:53:21.692590 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"a93918e6-bb45-4717-afef-978bad1c6612","Type":"ContainerStarted","Data":"408642aa74056e4f0d4e3fd2c296eecee33ccef0d3fe86859b2394c7792e32b8"} Mar 16 16:53:21 crc kubenswrapper[5120]: I0316 16:53:21.692608 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-f6bd6ffc7-nq4s9" event={"ID":"d59d2b2a-a98e-4f02-80f4-b6daa5b64d41","Type":"ContainerStarted","Data":"9975af6ade51cf2145c5a082d7b00acca8c73e57d42b7ba74cf83031980b8683"} Mar 16 16:53:21 crc kubenswrapper[5120]: I0316 16:53:21.692624 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"3267cb77-9a07-4d71-aaa4-e1e5e033a70d","Type":"ContainerStarted","Data":"ced459ec8d89e143997a50be3ffdcebfc98c9c89a44dec96cc00f40ef7252e43"} Mar 16 16:53:21 crc kubenswrapper[5120]: I0316 16:53:21.713444 5120 scope.go:117] "RemoveContainer" containerID="8255a8dd841a9b7e8d1b59806b937aaa4fdc84daf4b743c2df720b34b3c55d87" Mar 16 16:53:21 crc kubenswrapper[5120]: I0316 16:53:21.760496 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-5fd9d6b8f6-vq7wb" Mar 16 16:53:21 crc kubenswrapper[5120]: I0316 16:53:21.816255 5120 scope.go:117] "RemoveContainer" containerID="80e2bda6dda2c8ad05b4c7384f2d187b58b6cdc73a7dd75783a0030f0515db21" Mar 16 16:53:21 crc kubenswrapper[5120]: I0316 16:53:21.828788 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:53:21 crc kubenswrapper[5120]: I0316 16:53:21.888790 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:53:21 crc kubenswrapper[5120]: I0316 16:53:21.902450 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:53:21 crc kubenswrapper[5120]: I0316 16:53:21.916849 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/cb37f123-034b-4ccb-9f71-676a322e2a8b-internal-tls-certs\") pod \"cb37f123-034b-4ccb-9f71-676a322e2a8b\" (UID: \"cb37f123-034b-4ccb-9f71-676a322e2a8b\") " Mar 16 16:53:21 crc kubenswrapper[5120]: I0316 16:53:21.917080 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/dda14ac9-f9b1-4927-a4a4-147c5435906c-nova-novncproxy-tls-certs\") pod \"dda14ac9-f9b1-4927-a4a4-147c5435906c\" (UID: \"dda14ac9-f9b1-4927-a4a4-147c5435906c\") " Mar 16 16:53:21 crc kubenswrapper[5120]: I0316 16:53:21.917096 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/dda14ac9-f9b1-4927-a4a4-147c5435906c-vencrypt-tls-certs\") pod \"dda14ac9-f9b1-4927-a4a4-147c5435906c\" (UID: \"dda14ac9-f9b1-4927-a4a4-147c5435906c\") " Mar 16 16:53:21 crc kubenswrapper[5120]: I0316 16:53:21.917138 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dh6lz\" (UniqueName: \"kubernetes.io/projected/dda14ac9-f9b1-4927-a4a4-147c5435906c-kube-api-access-dh6lz\") pod \"dda14ac9-f9b1-4927-a4a4-147c5435906c\" (UID: \"dda14ac9-f9b1-4927-a4a4-147c5435906c\") " Mar 16 16:53:21 crc kubenswrapper[5120]: I0316 16:53:21.917210 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r4r95\" (UniqueName: \"kubernetes.io/projected/cb37f123-034b-4ccb-9f71-676a322e2a8b-kube-api-access-r4r95\") pod \"cb37f123-034b-4ccb-9f71-676a322e2a8b\" (UID: \"cb37f123-034b-4ccb-9f71-676a322e2a8b\") " Mar 16 16:53:21 crc kubenswrapper[5120]: I0316 16:53:21.917293 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cb37f123-034b-4ccb-9f71-676a322e2a8b-combined-ca-bundle\") pod \"cb37f123-034b-4ccb-9f71-676a322e2a8b\" (UID: \"cb37f123-034b-4ccb-9f71-676a322e2a8b\") " Mar 16 16:53:21 crc kubenswrapper[5120]: I0316 16:53:21.917468 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dda14ac9-f9b1-4927-a4a4-147c5435906c-config-data\") pod \"dda14ac9-f9b1-4927-a4a4-147c5435906c\" (UID: \"dda14ac9-f9b1-4927-a4a4-147c5435906c\") " Mar 16 16:53:21 crc kubenswrapper[5120]: I0316 16:53:21.917531 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cb37f123-034b-4ccb-9f71-676a322e2a8b-config-data\") pod \"cb37f123-034b-4ccb-9f71-676a322e2a8b\" (UID: \"cb37f123-034b-4ccb-9f71-676a322e2a8b\") " Mar 16 16:53:21 crc kubenswrapper[5120]: I0316 16:53:21.917578 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/cb37f123-034b-4ccb-9f71-676a322e2a8b-config-data-custom\") pod \"cb37f123-034b-4ccb-9f71-676a322e2a8b\" (UID: \"cb37f123-034b-4ccb-9f71-676a322e2a8b\") " Mar 16 16:53:21 crc kubenswrapper[5120]: I0316 16:53:21.921372 5120 scope.go:117] "RemoveContainer" containerID="b906fd70f36d377ce541811ff12a62e890d86300690ff722e603d902f637f772" Mar 16 16:53:21 crc kubenswrapper[5120]: I0316 16:53:21.928591 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:53:21 crc kubenswrapper[5120]: I0316 16:53:21.928875 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dda14ac9-f9b1-4927-a4a4-147c5435906c-combined-ca-bundle\") pod \"dda14ac9-f9b1-4927-a4a4-147c5435906c\" (UID: \"dda14ac9-f9b1-4927-a4a4-147c5435906c\") " Mar 16 16:53:21 crc kubenswrapper[5120]: I0316 16:53:21.929013 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/cb37f123-034b-4ccb-9f71-676a322e2a8b-logs\") pod \"cb37f123-034b-4ccb-9f71-676a322e2a8b\" (UID: \"cb37f123-034b-4ccb-9f71-676a322e2a8b\") " Mar 16 16:53:21 crc kubenswrapper[5120]: I0316 16:53:21.929131 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/cb37f123-034b-4ccb-9f71-676a322e2a8b-public-tls-certs\") pod \"cb37f123-034b-4ccb-9f71-676a322e2a8b\" (UID: \"cb37f123-034b-4ccb-9f71-676a322e2a8b\") " Mar 16 16:53:21 crc kubenswrapper[5120]: I0316 16:53:21.941199 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb37f123-034b-4ccb-9f71-676a322e2a8b-logs" (OuterVolumeSpecName: "logs") pod "cb37f123-034b-4ccb-9f71-676a322e2a8b" (UID: "cb37f123-034b-4ccb-9f71-676a322e2a8b"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:53:21 crc kubenswrapper[5120]: I0316 16:53:21.943054 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb37f123-034b-4ccb-9f71-676a322e2a8b-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "cb37f123-034b-4ccb-9f71-676a322e2a8b" (UID: "cb37f123-034b-4ccb-9f71-676a322e2a8b"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:21 crc kubenswrapper[5120]: I0316 16:53:21.948971 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dda14ac9-f9b1-4927-a4a4-147c5435906c-kube-api-access-dh6lz" (OuterVolumeSpecName: "kube-api-access-dh6lz") pod "dda14ac9-f9b1-4927-a4a4-147c5435906c" (UID: "dda14ac9-f9b1-4927-a4a4-147c5435906c"). InnerVolumeSpecName "kube-api-access-dh6lz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:53:21 crc kubenswrapper[5120]: I0316 16:53:21.949589 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb37f123-034b-4ccb-9f71-676a322e2a8b-kube-api-access-r4r95" (OuterVolumeSpecName: "kube-api-access-r4r95") pod "cb37f123-034b-4ccb-9f71-676a322e2a8b" (UID: "cb37f123-034b-4ccb-9f71-676a322e2a8b"). InnerVolumeSpecName "kube-api-access-r4r95". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:53:21 crc kubenswrapper[5120]: I0316 16:53:21.960453 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:53:21 crc kubenswrapper[5120]: I0316 16:53:21.984645 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:53:21 crc kubenswrapper[5120]: I0316 16:53:21.985976 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb37f123-034b-4ccb-9f71-676a322e2a8b" containerName="barbican-api" Mar 16 16:53:21 crc kubenswrapper[5120]: I0316 16:53:21.986003 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb37f123-034b-4ccb-9f71-676a322e2a8b" containerName="barbican-api" Mar 16 16:53:21 crc kubenswrapper[5120]: I0316 16:53:21.986037 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5c498e5-584c-4cdd-b008-c643b7bb1bc5" containerName="galera" Mar 16 16:53:21 crc kubenswrapper[5120]: I0316 16:53:21.986045 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5c498e5-584c-4cdd-b008-c643b7bb1bc5" containerName="galera" Mar 16 16:53:21 crc kubenswrapper[5120]: I0316 16:53:21.986070 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dda14ac9-f9b1-4927-a4a4-147c5435906c" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 16:53:21 crc kubenswrapper[5120]: I0316 16:53:21.986079 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="dda14ac9-f9b1-4927-a4a4-147c5435906c" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 16:53:21 crc kubenswrapper[5120]: I0316 16:53:21.986094 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c42ca14-5afb-4688-a2cf-ddf314020f18" containerName="nova-cell0-conductor-conductor" Mar 16 16:53:21 crc kubenswrapper[5120]: I0316 16:53:21.986101 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c42ca14-5afb-4688-a2cf-ddf314020f18" containerName="nova-cell0-conductor-conductor" Mar 16 16:53:21 crc kubenswrapper[5120]: I0316 16:53:21.986132 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5c498e5-584c-4cdd-b008-c643b7bb1bc5" containerName="mysql-bootstrap" Mar 16 16:53:21 crc kubenswrapper[5120]: I0316 16:53:21.986139 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5c498e5-584c-4cdd-b008-c643b7bb1bc5" containerName="mysql-bootstrap" Mar 16 16:53:21 crc kubenswrapper[5120]: I0316 16:53:21.986153 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb37f123-034b-4ccb-9f71-676a322e2a8b" containerName="barbican-api-log" Mar 16 16:53:21 crc kubenswrapper[5120]: I0316 16:53:21.986159 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb37f123-034b-4ccb-9f71-676a322e2a8b" containerName="barbican-api-log" Mar 16 16:53:21 crc kubenswrapper[5120]: I0316 16:53:21.986382 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="9c42ca14-5afb-4688-a2cf-ddf314020f18" containerName="nova-cell0-conductor-conductor" Mar 16 16:53:21 crc kubenswrapper[5120]: I0316 16:53:21.986401 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="dda14ac9-f9b1-4927-a4a4-147c5435906c" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 16:53:21 crc kubenswrapper[5120]: I0316 16:53:21.986425 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e5c498e5-584c-4cdd-b008-c643b7bb1bc5" containerName="galera" Mar 16 16:53:21 crc kubenswrapper[5120]: I0316 16:53:21.986438 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="cb37f123-034b-4ccb-9f71-676a322e2a8b" containerName="barbican-api-log" Mar 16 16:53:21 crc kubenswrapper[5120]: I0316 16:53:21.986452 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="cb37f123-034b-4ccb-9f71-676a322e2a8b" containerName="barbican-api" Mar 16 16:53:21 crc kubenswrapper[5120]: I0316 16:53:21.986702 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:53:21 crc kubenswrapper[5120]: I0316 16:53:21.993034 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="07523c84-c61c-42f5-9282-324e6cc37cf7" containerName="nova-cell1-conductor-conductor" Mar 16 16:53:21 crc kubenswrapper[5120]: I0316 16:53:21.993025 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dda14ac9-f9b1-4927-a4a4-147c5435906c-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "dda14ac9-f9b1-4927-a4a4-147c5435906c" (UID: "dda14ac9-f9b1-4927-a4a4-147c5435906c"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.001191 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07523c84-c61c-42f5-9282-324e6cc37cf7" containerName="nova-cell1-conductor-conductor" Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.001227 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="07523c84-c61c-42f5-9282-324e6cc37cf7" containerName="nova-cell1-conductor-conductor" Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.013151 5120 patch_prober.go:28] interesting pod/machine-config-daemon-7bf76 container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.013213 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.035542 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mdz95\" (UniqueName: \"kubernetes.io/projected/9c42ca14-5afb-4688-a2cf-ddf314020f18-kube-api-access-mdz95\") pod \"9c42ca14-5afb-4688-a2cf-ddf314020f18\" (UID: \"9c42ca14-5afb-4688-a2cf-ddf314020f18\") " Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.036004 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9c42ca14-5afb-4688-a2cf-ddf314020f18-combined-ca-bundle\") pod \"9c42ca14-5afb-4688-a2cf-ddf314020f18\" (UID: \"9c42ca14-5afb-4688-a2cf-ddf314020f18\") " Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.036032 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9c42ca14-5afb-4688-a2cf-ddf314020f18-config-data\") pod \"9c42ca14-5afb-4688-a2cf-ddf314020f18\" (UID: \"9c42ca14-5afb-4688-a2cf-ddf314020f18\") " Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.036932 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dh6lz\" (UniqueName: \"kubernetes.io/projected/dda14ac9-f9b1-4927-a4a4-147c5435906c-kube-api-access-dh6lz\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.036946 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r4r95\" (UniqueName: \"kubernetes.io/projected/cb37f123-034b-4ccb-9f71-676a322e2a8b-kube-api-access-r4r95\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.036955 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/cb37f123-034b-4ccb-9f71-676a322e2a8b-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.036966 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dda14ac9-f9b1-4927-a4a4-147c5435906c-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.036976 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/cb37f123-034b-4ccb-9f71-676a322e2a8b-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.044463 5120 scope.go:117] "RemoveContainer" containerID="b9b50e1abd0a98057d330e8c90a59f5a055779de61849723c628b054ab0cd288" Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.059928 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.059970 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.060056 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.065112 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ceilometer-internal-svc\"" Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.065202 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.068928 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.070383 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.078234 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.089352 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-5964c9d8c-plh78" Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.138610 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-647f8b964-49qkc" Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.139664 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ztvzr\" (UniqueName: \"kubernetes.io/projected/e5c498e5-584c-4cdd-b008-c643b7bb1bc5-kube-api-access-ztvzr\") pod \"e5c498e5-584c-4cdd-b008-c643b7bb1bc5\" (UID: \"e5c498e5-584c-4cdd-b008-c643b7bb1bc5\") " Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.148420 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dda14ac9-f9b1-4927-a4a4-147c5435906c-config-data" (OuterVolumeSpecName: "config-data") pod "dda14ac9-f9b1-4927-a4a4-147c5435906c" (UID: "dda14ac9-f9b1-4927-a4a4-147c5435906c"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.149690 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e5c498e5-584c-4cdd-b008-c643b7bb1bc5-combined-ca-bundle\") pod \"e5c498e5-584c-4cdd-b008-c643b7bb1bc5\" (UID: \"e5c498e5-584c-4cdd-b008-c643b7bb1bc5\") " Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.149750 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/e5c498e5-584c-4cdd-b008-c643b7bb1bc5-config-data-default\") pod \"e5c498e5-584c-4cdd-b008-c643b7bb1bc5\" (UID: \"e5c498e5-584c-4cdd-b008-c643b7bb1bc5\") " Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.149917 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e5c498e5-584c-4cdd-b008-c643b7bb1bc5-operator-scripts\") pod \"e5c498e5-584c-4cdd-b008-c643b7bb1bc5\" (UID: \"e5c498e5-584c-4cdd-b008-c643b7bb1bc5\") " Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.150040 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"mysql-db\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") pod \"e5c498e5-584c-4cdd-b008-c643b7bb1bc5\" (UID: \"e5c498e5-584c-4cdd-b008-c643b7bb1bc5\") " Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.150101 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ms4w5\" (UniqueName: \"kubernetes.io/projected/07523c84-c61c-42f5-9282-324e6cc37cf7-kube-api-access-ms4w5\") pod \"07523c84-c61c-42f5-9282-324e6cc37cf7\" (UID: \"07523c84-c61c-42f5-9282-324e6cc37cf7\") " Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.150128 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dda14ac9-f9b1-4927-a4a4-147c5435906c-config-data\") pod \"dda14ac9-f9b1-4927-a4a4-147c5435906c\" (UID: \"dda14ac9-f9b1-4927-a4a4-147c5435906c\") " Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.151334 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/e5c498e5-584c-4cdd-b008-c643b7bb1bc5-config-data-generated\") pod \"e5c498e5-584c-4cdd-b008-c643b7bb1bc5\" (UID: \"e5c498e5-584c-4cdd-b008-c643b7bb1bc5\") " Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.151426 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/07523c84-c61c-42f5-9282-324e6cc37cf7-combined-ca-bundle\") pod \"07523c84-c61c-42f5-9282-324e6cc37cf7\" (UID: \"07523c84-c61c-42f5-9282-324e6cc37cf7\") " Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.151510 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/e5c498e5-584c-4cdd-b008-c643b7bb1bc5-galera-tls-certs\") pod \"e5c498e5-584c-4cdd-b008-c643b7bb1bc5\" (UID: \"e5c498e5-584c-4cdd-b008-c643b7bb1bc5\") " Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.151710 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/e5c498e5-584c-4cdd-b008-c643b7bb1bc5-kolla-config\") pod \"e5c498e5-584c-4cdd-b008-c643b7bb1bc5\" (UID: \"e5c498e5-584c-4cdd-b008-c643b7bb1bc5\") " Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.151937 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/07523c84-c61c-42f5-9282-324e6cc37cf7-config-data\") pod \"07523c84-c61c-42f5-9282-324e6cc37cf7\" (UID: \"07523c84-c61c-42f5-9282-324e6cc37cf7\") " Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.158999 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5c498e5-584c-4cdd-b008-c643b7bb1bc5-config-data-generated" (OuterVolumeSpecName: "config-data-generated") pod "e5c498e5-584c-4cdd-b008-c643b7bb1bc5" (UID: "e5c498e5-584c-4cdd-b008-c643b7bb1bc5"). InnerVolumeSpecName "config-data-generated". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.160467 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e5c498e5-584c-4cdd-b008-c643b7bb1bc5-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "e5c498e5-584c-4cdd-b008-c643b7bb1bc5" (UID: "e5c498e5-584c-4cdd-b008-c643b7bb1bc5"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.164694 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e5c498e5-584c-4cdd-b008-c643b7bb1bc5-config-data-default" (OuterVolumeSpecName: "config-data-default") pod "e5c498e5-584c-4cdd-b008-c643b7bb1bc5" (UID: "e5c498e5-584c-4cdd-b008-c643b7bb1bc5"). InnerVolumeSpecName "config-data-default". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:53:22 crc kubenswrapper[5120]: W0316 16:53:22.164787 5120 empty_dir.go:511] Warning: Unmount skipped because path does not exist: /var/lib/kubelet/pods/dda14ac9-f9b1-4927-a4a4-147c5435906c/volumes/kubernetes.io~secret/config-data Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.164798 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dda14ac9-f9b1-4927-a4a4-147c5435906c-config-data" (OuterVolumeSpecName: "config-data") pod "dda14ac9-f9b1-4927-a4a4-147c5435906c" (UID: "dda14ac9-f9b1-4927-a4a4-147c5435906c"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.168607 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e5c498e5-584c-4cdd-b008-c643b7bb1bc5-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "e5c498e5-584c-4cdd-b008-c643b7bb1bc5" (UID: "e5c498e5-584c-4cdd-b008-c643b7bb1bc5"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.172270 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/e5c498e5-584c-4cdd-b008-c643b7bb1bc5-config-data-default\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.172327 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e5c498e5-584c-4cdd-b008-c643b7bb1bc5-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.172341 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dda14ac9-f9b1-4927-a4a4-147c5435906c-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.172351 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/e5c498e5-584c-4cdd-b008-c643b7bb1bc5-config-data-generated\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.172362 5120 reconciler_common.go:299] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/e5c498e5-584c-4cdd-b008-c643b7bb1bc5-kolla-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.259890 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-7bf49bf568-fbg2k" podUID="c846d2b2-0638-44bd-9ad0-6b6c76f8d16f" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.0.123:9311/healthcheck\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.275311 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-7bf49bf568-fbg2k" podUID="c846d2b2-0638-44bd-9ad0-6b6c76f8d16f" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.0.123:9311/healthcheck\": read tcp 10.217.0.2:54148->10.217.0.123:9311: read: connection reset by peer" Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.275470 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fzsf7\" (UniqueName: \"kubernetes.io/projected/5e1c9d08-874f-40cb-9837-5cfd2509c352-kube-api-access-fzsf7\") pod \"5e1c9d08-874f-40cb-9837-5cfd2509c352\" (UID: \"5e1c9d08-874f-40cb-9837-5cfd2509c352\") " Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.275506 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d6db354d-c48c-4497-a289-18edadffce47-logs\") pod \"d6db354d-c48c-4497-a289-18edadffce47\" (UID: \"d6db354d-c48c-4497-a289-18edadffce47\") " Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.275577 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5e1c9d08-874f-40cb-9837-5cfd2509c352-combined-ca-bundle\") pod \"5e1c9d08-874f-40cb-9837-5cfd2509c352\" (UID: \"5e1c9d08-874f-40cb-9837-5cfd2509c352\") " Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.275639 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/5e1c9d08-874f-40cb-9837-5cfd2509c352-config-data\") pod \"5e1c9d08-874f-40cb-9837-5cfd2509c352\" (UID: \"5e1c9d08-874f-40cb-9837-5cfd2509c352\") " Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.275672 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/bd162855-8210-41c5-9494-15a62edf991c-logs\") pod \"bd162855-8210-41c5-9494-15a62edf991c\" (UID: \"bd162855-8210-41c5-9494-15a62edf991c\") " Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.275703 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2n5xx\" (UniqueName: \"kubernetes.io/projected/d6db354d-c48c-4497-a289-18edadffce47-kube-api-access-2n5xx\") pod \"d6db354d-c48c-4497-a289-18edadffce47\" (UID: \"d6db354d-c48c-4497-a289-18edadffce47\") " Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.275865 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d6db354d-c48c-4497-a289-18edadffce47-combined-ca-bundle\") pod \"d6db354d-c48c-4497-a289-18edadffce47\" (UID: \"d6db354d-c48c-4497-a289-18edadffce47\") " Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.275893 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a5d3f7a6-64f6-47f9-a144-41a356078e4b-combined-ca-bundle\") pod \"a5d3f7a6-64f6-47f9-a144-41a356078e4b\" (UID: \"a5d3f7a6-64f6-47f9-a144-41a356078e4b\") " Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.275954 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/d6db354d-c48c-4497-a289-18edadffce47-config-data-custom\") pod \"d6db354d-c48c-4497-a289-18edadffce47\" (UID: \"d6db354d-c48c-4497-a289-18edadffce47\") " Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.276037 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a5d3f7a6-64f6-47f9-a144-41a356078e4b-config-data\") pod \"a5d3f7a6-64f6-47f9-a144-41a356078e4b\" (UID: \"a5d3f7a6-64f6-47f9-a144-41a356078e4b\") " Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.276065 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d6db354d-c48c-4497-a289-18edadffce47-config-data\") pod \"d6db354d-c48c-4497-a289-18edadffce47\" (UID: \"d6db354d-c48c-4497-a289-18edadffce47\") " Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.276158 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/a5d3f7a6-64f6-47f9-a144-41a356078e4b-internal-tls-certs\") pod \"a5d3f7a6-64f6-47f9-a144-41a356078e4b\" (UID: \"a5d3f7a6-64f6-47f9-a144-41a356078e4b\") " Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.276199 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bd162855-8210-41c5-9494-15a62edf991c-combined-ca-bundle\") pod \"bd162855-8210-41c5-9494-15a62edf991c\" (UID: \"bd162855-8210-41c5-9494-15a62edf991c\") " Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.276235 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/bd162855-8210-41c5-9494-15a62edf991c-internal-tls-certs\") pod \"bd162855-8210-41c5-9494-15a62edf991c\" (UID: \"bd162855-8210-41c5-9494-15a62edf991c\") " Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.276255 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/5e1c9d08-874f-40cb-9837-5cfd2509c352-memcached-tls-certs\") pod \"5e1c9d08-874f-40cb-9837-5cfd2509c352\" (UID: \"5e1c9d08-874f-40cb-9837-5cfd2509c352\") " Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.276519 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5pmd4\" (UniqueName: \"kubernetes.io/projected/bd162855-8210-41c5-9494-15a62edf991c-kube-api-access-5pmd4\") pod \"bd162855-8210-41c5-9494-15a62edf991c\" (UID: \"bd162855-8210-41c5-9494-15a62edf991c\") " Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.276587 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bd162855-8210-41c5-9494-15a62edf991c-config-data\") pod \"bd162855-8210-41c5-9494-15a62edf991c\" (UID: \"bd162855-8210-41c5-9494-15a62edf991c\") " Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.276612 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/a5d3f7a6-64f6-47f9-a144-41a356078e4b-public-tls-certs\") pod \"a5d3f7a6-64f6-47f9-a144-41a356078e4b\" (UID: \"a5d3f7a6-64f6-47f9-a144-41a356078e4b\") " Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.276690 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/bd162855-8210-41c5-9494-15a62edf991c-public-tls-certs\") pod \"bd162855-8210-41c5-9494-15a62edf991c\" (UID: \"bd162855-8210-41c5-9494-15a62edf991c\") " Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.276898 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/5e1c9d08-874f-40cb-9837-5cfd2509c352-kolla-config\") pod \"5e1c9d08-874f-40cb-9837-5cfd2509c352\" (UID: \"5e1c9d08-874f-40cb-9837-5cfd2509c352\") " Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.276943 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xcg7f\" (UniqueName: \"kubernetes.io/projected/a5d3f7a6-64f6-47f9-a144-41a356078e4b-kube-api-access-xcg7f\") pod \"a5d3f7a6-64f6-47f9-a144-41a356078e4b\" (UID: \"a5d3f7a6-64f6-47f9-a144-41a356078e4b\") " Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.276990 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/a5d3f7a6-64f6-47f9-a144-41a356078e4b-config-data-custom\") pod \"a5d3f7a6-64f6-47f9-a144-41a356078e4b\" (UID: \"a5d3f7a6-64f6-47f9-a144-41a356078e4b\") " Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.277011 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a5d3f7a6-64f6-47f9-a144-41a356078e4b-logs\") pod \"a5d3f7a6-64f6-47f9-a144-41a356078e4b\" (UID: \"a5d3f7a6-64f6-47f9-a144-41a356078e4b\") " Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.277222 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/9fb3c077-55b7-4693-af84-b981deb240da-log-httpd\") pod \"ceilometer-0\" (UID: \"9fb3c077-55b7-4693-af84-b981deb240da\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.277262 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfmbj\" (UniqueName: \"kubernetes.io/projected/9fb3c077-55b7-4693-af84-b981deb240da-kube-api-access-tfmbj\") pod \"ceilometer-0\" (UID: \"9fb3c077-55b7-4693-af84-b981deb240da\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.277313 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9fb3c077-55b7-4693-af84-b981deb240da-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"9fb3c077-55b7-4693-af84-b981deb240da\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.277360 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/9fb3c077-55b7-4693-af84-b981deb240da-run-httpd\") pod \"ceilometer-0\" (UID: \"9fb3c077-55b7-4693-af84-b981deb240da\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.277612 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9fb3c077-55b7-4693-af84-b981deb240da-scripts\") pod \"ceilometer-0\" (UID: \"9fb3c077-55b7-4693-af84-b981deb240da\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.277703 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/9fb3c077-55b7-4693-af84-b981deb240da-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"9fb3c077-55b7-4693-af84-b981deb240da\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.277874 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.278032 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"5e1c9d08-874f-40cb-9837-5cfd2509c352","Type":"ContainerDied","Data":"6af4dbdea93d2eb8d7714edbc826eca75252c54442fb425b5ab9ae208bdbcaa1"} Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.278852 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5e1c9d08-874f-40cb-9837-5cfd2509c352-config-data" (OuterVolumeSpecName: "config-data") pod "5e1c9d08-874f-40cb-9837-5cfd2509c352" (UID: "5e1c9d08-874f-40cb-9837-5cfd2509c352"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.279176 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9fb3c077-55b7-4693-af84-b981deb240da-config-data\") pod \"ceilometer-0\" (UID: \"9fb3c077-55b7-4693-af84-b981deb240da\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.279224 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/9fb3c077-55b7-4693-af84-b981deb240da-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"9fb3c077-55b7-4693-af84-b981deb240da\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.279299 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/5e1c9d08-874f-40cb-9837-5cfd2509c352-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.280145 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6db354d-c48c-4497-a289-18edadffce47-logs" (OuterVolumeSpecName: "logs") pod "d6db354d-c48c-4497-a289-18edadffce47" (UID: "d6db354d-c48c-4497-a289-18edadffce47"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.280738 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd162855-8210-41c5-9494-15a62edf991c-logs" (OuterVolumeSpecName: "logs") pod "bd162855-8210-41c5-9494-15a62edf991c" (UID: "bd162855-8210-41c5-9494-15a62edf991c"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.281098 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5e1c9d08-874f-40cb-9837-5cfd2509c352-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "5e1c9d08-874f-40cb-9837-5cfd2509c352" (UID: "5e1c9d08-874f-40cb-9837-5cfd2509c352"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.285285 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5d3f7a6-64f6-47f9-a144-41a356078e4b-logs" (OuterVolumeSpecName: "logs") pod "a5d3f7a6-64f6-47f9-a144-41a356078e4b" (UID: "a5d3f7a6-64f6-47f9-a144-41a356078e4b"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.285886 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-7bf49bf568-fbg2k" podUID="c846d2b2-0638-44bd-9ad0-6b6c76f8d16f" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.0.123:9311/healthcheck\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.286257 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-7bf49bf568-fbg2k" podUID="c846d2b2-0638-44bd-9ad0-6b6c76f8d16f" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.0.123:9311/healthcheck\": dial tcp 10.217.0.123:9311: connect: connection refused" Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.297526 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6db354d-c48c-4497-a289-18edadffce47-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "d6db354d-c48c-4497-a289-18edadffce47" (UID: "d6db354d-c48c-4497-a289-18edadffce47"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.308928 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5c498e5-584c-4cdd-b008-c643b7bb1bc5-kube-api-access-ztvzr" (OuterVolumeSpecName: "kube-api-access-ztvzr") pod "e5c498e5-584c-4cdd-b008-c643b7bb1bc5" (UID: "e5c498e5-584c-4cdd-b008-c643b7bb1bc5"). InnerVolumeSpecName "kube-api-access-ztvzr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.325753 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"e5c498e5-584c-4cdd-b008-c643b7bb1bc5","Type":"ContainerDied","Data":"8ad11216cee7d67fd4ad6baa240839fa389afe7496128def0dc5bd74133aa3e6"} Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.325875 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.328190 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c42ca14-5afb-4688-a2cf-ddf314020f18-kube-api-access-mdz95" (OuterVolumeSpecName: "kube-api-access-mdz95") pod "9c42ca14-5afb-4688-a2cf-ddf314020f18" (UID: "9c42ca14-5afb-4688-a2cf-ddf314020f18"). InnerVolumeSpecName "kube-api-access-mdz95". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.328376 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07523c84-c61c-42f5-9282-324e6cc37cf7-kube-api-access-ms4w5" (OuterVolumeSpecName: "kube-api-access-ms4w5") pod "07523c84-c61c-42f5-9282-324e6cc37cf7" (UID: "07523c84-c61c-42f5-9282-324e6cc37cf7"). InnerVolumeSpecName "kube-api-access-ms4w5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.332470 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-5964c9d8c-plh78" event={"ID":"d6db354d-c48c-4497-a289-18edadffce47","Type":"ContainerDied","Data":"950f4eeddc30179ddbd8a412891224574d9d1a599951b70fb7b9c7899af585db"} Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.332607 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-5964c9d8c-plh78" Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.339548 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-88757f4fd-w4kvr" event={"ID":"9fab4617-1011-48f5-90ae-5415fd9b91b4","Type":"ContainerStarted","Data":"6d2b0330b2064662c772ad1e4e9e348aa9c96a000542503ed0720adf02860f5f"} Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.345177 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"07523c84-c61c-42f5-9282-324e6cc37cf7","Type":"ContainerDied","Data":"822c8e6e6d134b675b07faab106cc3ce885e3689e9499fbfbda62fd42059acc7"} Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.345199 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.346777 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a5d3f7a6-64f6-47f9-a144-41a356078e4b-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "a5d3f7a6-64f6-47f9-a144-41a356078e4b" (UID: "a5d3f7a6-64f6-47f9-a144-41a356078e4b"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.347101 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6db354d-c48c-4497-a289-18edadffce47-kube-api-access-2n5xx" (OuterVolumeSpecName: "kube-api-access-2n5xx") pod "d6db354d-c48c-4497-a289-18edadffce47" (UID: "d6db354d-c48c-4497-a289-18edadffce47"). InnerVolumeSpecName "kube-api-access-2n5xx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.347531 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e1c9d08-874f-40cb-9837-5cfd2509c352-kube-api-access-fzsf7" (OuterVolumeSpecName: "kube-api-access-fzsf7") pod "5e1c9d08-874f-40cb-9837-5cfd2509c352" (UID: "5e1c9d08-874f-40cb-9837-5cfd2509c352"). InnerVolumeSpecName "kube-api-access-fzsf7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.347949 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5d3f7a6-64f6-47f9-a144-41a356078e4b-kube-api-access-xcg7f" (OuterVolumeSpecName: "kube-api-access-xcg7f") pod "a5d3f7a6-64f6-47f9-a144-41a356078e4b" (UID: "a5d3f7a6-64f6-47f9-a144-41a356078e4b"). InnerVolumeSpecName "kube-api-access-xcg7f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.348100 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd162855-8210-41c5-9494-15a62edf991c-kube-api-access-5pmd4" (OuterVolumeSpecName: "kube-api-access-5pmd4") pod "bd162855-8210-41c5-9494-15a62edf991c" (UID: "bd162855-8210-41c5-9494-15a62edf991c"). InnerVolumeSpecName "kube-api-access-5pmd4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.349398 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-647f8b964-49qkc" event={"ID":"a5d3f7a6-64f6-47f9-a144-41a356078e4b","Type":"ContainerDied","Data":"96358bb813e4ea51a42da5de9b5c9057c4e5124a128d0abfc9544b9ff7fb61e7"} Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.349516 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-647f8b964-49qkc" Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.359460 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage14-crc" (OuterVolumeSpecName: "mysql-db") pod "e5c498e5-584c-4cdd-b008-c643b7bb1bc5" (UID: "e5c498e5-584c-4cdd-b008-c643b7bb1bc5"). InnerVolumeSpecName "local-storage14-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.368003 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.368027 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"bd162855-8210-41c5-9494-15a62edf991c","Type":"ContainerDied","Data":"7eb2a6d797380f16288ad092be047651678618f7e7d6d15349e161a42fff2de3"} Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.368361 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.368397 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.368427 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-5fd9d6b8f6-vq7wb" Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.384104 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9fb3c077-55b7-4693-af84-b981deb240da-scripts\") pod \"ceilometer-0\" (UID: \"9fb3c077-55b7-4693-af84-b981deb240da\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.384255 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/9fb3c077-55b7-4693-af84-b981deb240da-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"9fb3c077-55b7-4693-af84-b981deb240da\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.384413 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9fb3c077-55b7-4693-af84-b981deb240da-config-data\") pod \"ceilometer-0\" (UID: \"9fb3c077-55b7-4693-af84-b981deb240da\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.384465 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/9fb3c077-55b7-4693-af84-b981deb240da-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"9fb3c077-55b7-4693-af84-b981deb240da\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.384633 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/9fb3c077-55b7-4693-af84-b981deb240da-log-httpd\") pod \"ceilometer-0\" (UID: \"9fb3c077-55b7-4693-af84-b981deb240da\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.384692 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tfmbj\" (UniqueName: \"kubernetes.io/projected/9fb3c077-55b7-4693-af84-b981deb240da-kube-api-access-tfmbj\") pod \"ceilometer-0\" (UID: \"9fb3c077-55b7-4693-af84-b981deb240da\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.384790 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9fb3c077-55b7-4693-af84-b981deb240da-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"9fb3c077-55b7-4693-af84-b981deb240da\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.384849 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/9fb3c077-55b7-4693-af84-b981deb240da-run-httpd\") pod \"ceilometer-0\" (UID: \"9fb3c077-55b7-4693-af84-b981deb240da\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.385131 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ms4w5\" (UniqueName: \"kubernetes.io/projected/07523c84-c61c-42f5-9282-324e6cc37cf7-kube-api-access-ms4w5\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.385151 5120 reconciler_common.go:299] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/5e1c9d08-874f-40cb-9837-5cfd2509c352-kolla-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.385161 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xcg7f\" (UniqueName: \"kubernetes.io/projected/a5d3f7a6-64f6-47f9-a144-41a356078e4b-kube-api-access-xcg7f\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.385171 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/a5d3f7a6-64f6-47f9-a144-41a356078e4b-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.385182 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a5d3f7a6-64f6-47f9-a144-41a356078e4b-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.385191 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fzsf7\" (UniqueName: \"kubernetes.io/projected/5e1c9d08-874f-40cb-9837-5cfd2509c352-kube-api-access-fzsf7\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.385203 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d6db354d-c48c-4497-a289-18edadffce47-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.385212 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/bd162855-8210-41c5-9494-15a62edf991c-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.385221 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2n5xx\" (UniqueName: \"kubernetes.io/projected/d6db354d-c48c-4497-a289-18edadffce47-kube-api-access-2n5xx\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.385230 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/d6db354d-c48c-4497-a289-18edadffce47-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.385242 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ztvzr\" (UniqueName: \"kubernetes.io/projected/e5c498e5-584c-4cdd-b008-c643b7bb1bc5-kube-api-access-ztvzr\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.385253 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mdz95\" (UniqueName: \"kubernetes.io/projected/9c42ca14-5afb-4688-a2cf-ddf314020f18-kube-api-access-mdz95\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.385262 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5pmd4\" (UniqueName: \"kubernetes.io/projected/bd162855-8210-41c5-9494-15a62edf991c-kube-api-access-5pmd4\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.385282 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") on node \"crc\" " Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.386617 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb37f123-034b-4ccb-9f71-676a322e2a8b-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "cb37f123-034b-4ccb-9f71-676a322e2a8b" (UID: "cb37f123-034b-4ccb-9f71-676a322e2a8b"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.387599 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/9fb3c077-55b7-4693-af84-b981deb240da-log-httpd\") pod \"ceilometer-0\" (UID: \"9fb3c077-55b7-4693-af84-b981deb240da\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.388265 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9fb3c077-55b7-4693-af84-b981deb240da-scripts\") pod \"ceilometer-0\" (UID: \"9fb3c077-55b7-4693-af84-b981deb240da\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.392983 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/9fb3c077-55b7-4693-af84-b981deb240da-run-httpd\") pod \"ceilometer-0\" (UID: \"9fb3c077-55b7-4693-af84-b981deb240da\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.396066 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/9fb3c077-55b7-4693-af84-b981deb240da-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"9fb3c077-55b7-4693-af84-b981deb240da\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.397926 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9fb3c077-55b7-4693-af84-b981deb240da-config-data\") pod \"ceilometer-0\" (UID: \"9fb3c077-55b7-4693-af84-b981deb240da\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.398647 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/9fb3c077-55b7-4693-af84-b981deb240da-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"9fb3c077-55b7-4693-af84-b981deb240da\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.404228 5120 scope.go:117] "RemoveContainer" containerID="eef8c8d8f98f45622b4eea759dfa1ab6270fda4adb6058f0408cabf7fcc9d269" Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.408174 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9fb3c077-55b7-4693-af84-b981deb240da-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"9fb3c077-55b7-4693-af84-b981deb240da\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.412013 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfmbj\" (UniqueName: \"kubernetes.io/projected/9fb3c077-55b7-4693-af84-b981deb240da-kube-api-access-tfmbj\") pod \"ceilometer-0\" (UID: \"9fb3c077-55b7-4693-af84-b981deb240da\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.464532 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.495742 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cb37f123-034b-4ccb-9f71-676a322e2a8b-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.715479 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="61483cf5-d3db-49de-afa4-66f0efecdd70" path="/var/lib/kubelet/pods/61483cf5-d3db-49de-afa4-66f0efecdd70/volumes" Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.746999 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="b91a9930-eec4-4af5-9aee-5d02dc78fabc" containerName="cinder-scheduler" probeResult="failure" output="Get \"http://10.217.0.137:8080/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 16:53:22 crc kubenswrapper[5120]: I0316 16:53:22.945353 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd162855-8210-41c5-9494-15a62edf991c-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "bd162855-8210-41c5-9494-15a62edf991c" (UID: "bd162855-8210-41c5-9494-15a62edf991c"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:23 crc kubenswrapper[5120]: I0316 16:53:23.032694 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bd162855-8210-41c5-9494-15a62edf991c-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:23 crc kubenswrapper[5120]: I0316 16:53:23.048110 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e1c9d08-874f-40cb-9837-5cfd2509c352-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "5e1c9d08-874f-40cb-9837-5cfd2509c352" (UID: "5e1c9d08-874f-40cb-9837-5cfd2509c352"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:23 crc kubenswrapper[5120]: I0316 16:53:23.094134 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage14-crc" (UniqueName: "kubernetes.io/local-volume/local-storage14-crc") on node "crc" Mar 16 16:53:23 crc kubenswrapper[5120]: I0316 16:53:23.136357 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:23 crc kubenswrapper[5120]: I0316 16:53:23.136673 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5e1c9d08-874f-40cb-9837-5cfd2509c352-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:23 crc kubenswrapper[5120]: I0316 16:53:23.280316 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9c42ca14-5afb-4688-a2cf-ddf314020f18-config-data" (OuterVolumeSpecName: "config-data") pod "9c42ca14-5afb-4688-a2cf-ddf314020f18" (UID: "9c42ca14-5afb-4688-a2cf-ddf314020f18"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:23 crc kubenswrapper[5120]: I0316 16:53:23.283536 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07523c84-c61c-42f5-9282-324e6cc37cf7-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "07523c84-c61c-42f5-9282-324e6cc37cf7" (UID: "07523c84-c61c-42f5-9282-324e6cc37cf7"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:23 crc kubenswrapper[5120]: I0316 16:53:23.290863 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dda14ac9-f9b1-4927-a4a4-147c5435906c-vencrypt-tls-certs" (OuterVolumeSpecName: "vencrypt-tls-certs") pod "dda14ac9-f9b1-4927-a4a4-147c5435906c" (UID: "dda14ac9-f9b1-4927-a4a4-147c5435906c"). InnerVolumeSpecName "vencrypt-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:23 crc kubenswrapper[5120]: I0316 16:53:23.300043 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9c42ca14-5afb-4688-a2cf-ddf314020f18-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "9c42ca14-5afb-4688-a2cf-ddf314020f18" (UID: "9c42ca14-5afb-4688-a2cf-ddf314020f18"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:23 crc kubenswrapper[5120]: I0316 16:53:23.337052 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6db354d-c48c-4497-a289-18edadffce47-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "d6db354d-c48c-4497-a289-18edadffce47" (UID: "d6db354d-c48c-4497-a289-18edadffce47"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:23 crc kubenswrapper[5120]: I0316 16:53:23.348176 5120 reconciler_common.go:299] "Volume detached for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/dda14ac9-f9b1-4927-a4a4-147c5435906c-vencrypt-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:23 crc kubenswrapper[5120]: I0316 16:53:23.348205 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/07523c84-c61c-42f5-9282-324e6cc37cf7-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:23 crc kubenswrapper[5120]: I0316 16:53:23.348217 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9c42ca14-5afb-4688-a2cf-ddf314020f18-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:23 crc kubenswrapper[5120]: I0316 16:53:23.348226 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9c42ca14-5afb-4688-a2cf-ddf314020f18-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:23 crc kubenswrapper[5120]: I0316 16:53:23.348237 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d6db354d-c48c-4497-a289-18edadffce47-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:23 crc kubenswrapper[5120]: I0316 16:53:23.357841 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6db354d-c48c-4497-a289-18edadffce47-config-data" (OuterVolumeSpecName: "config-data") pod "d6db354d-c48c-4497-a289-18edadffce47" (UID: "d6db354d-c48c-4497-a289-18edadffce47"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:23 crc kubenswrapper[5120]: I0316 16:53:23.372752 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a5d3f7a6-64f6-47f9-a144-41a356078e4b-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "a5d3f7a6-64f6-47f9-a144-41a356078e4b" (UID: "a5d3f7a6-64f6-47f9-a144-41a356078e4b"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:23 crc kubenswrapper[5120]: I0316 16:53:23.401655 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07523c84-c61c-42f5-9282-324e6cc37cf7-config-data" (OuterVolumeSpecName: "config-data") pod "07523c84-c61c-42f5-9282-324e6cc37cf7" (UID: "07523c84-c61c-42f5-9282-324e6cc37cf7"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:23 crc kubenswrapper[5120]: I0316 16:53:23.410051 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="ef964d2a-6681-47c5-9a3b-29fe733ee9f0" containerName="cinder-api-log" containerID="cri-o://50a7aad84014a1700b53fcc27f170796a9610d2fc144e609cb89c547825e3660" gracePeriod=30 Mar 16 16:53:23 crc kubenswrapper[5120]: I0316 16:53:23.410719 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="ef964d2a-6681-47c5-9a3b-29fe733ee9f0" containerName="cinder-api" containerID="cri-o://aa8ecc3060c9fc401b4f9011b46c8b75393fee354f0cf1a58a0bacc59f34f05d" gracePeriod=30 Mar 16 16:53:23 crc kubenswrapper[5120]: I0316 16:53:23.413865 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd162855-8210-41c5-9494-15a62edf991c-config-data" (OuterVolumeSpecName: "config-data") pod "bd162855-8210-41c5-9494-15a62edf991c" (UID: "bd162855-8210-41c5-9494-15a62edf991c"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:23 crc kubenswrapper[5120]: I0316 16:53:23.417699 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb37f123-034b-4ccb-9f71-676a322e2a8b-config-data" (OuterVolumeSpecName: "config-data") pod "cb37f123-034b-4ccb-9f71-676a322e2a8b" (UID: "cb37f123-034b-4ccb-9f71-676a322e2a8b"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:23 crc kubenswrapper[5120]: I0316 16:53:23.441213 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/placement-7f77bff94b-c5ng2" podUID="67c7567e-232d-4853-961c-dcc1799c7dae" containerName="placement-log" probeResult="failure" output="Get \"https://10.217.0.148:8778/\": net/http: TLS handshake timeout" Mar 16 16:53:23 crc kubenswrapper[5120]: I0316 16:53:23.453649 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cb37f123-034b-4ccb-9f71-676a322e2a8b-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:23 crc kubenswrapper[5120]: I0316 16:53:23.453681 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a5d3f7a6-64f6-47f9-a144-41a356078e4b-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:23 crc kubenswrapper[5120]: I0316 16:53:23.453692 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d6db354d-c48c-4497-a289-18edadffce47-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:23 crc kubenswrapper[5120]: I0316 16:53:23.453701 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/07523c84-c61c-42f5-9282-324e6cc37cf7-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:23 crc kubenswrapper[5120]: I0316 16:53:23.453710 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bd162855-8210-41c5-9494-15a62edf991c-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:23 crc kubenswrapper[5120]: I0316 16:53:23.456191 5120 generic.go:358] "Generic (PLEG): container finished" podID="e7bf94ef-c84b-45ee-a2d9-dd048b1172e3" containerID="3d66efb0074bfc58dbf37d2c67968a0934841f6612fefbd737bec2909aedd21a" exitCode=0 Mar 16 16:53:23 crc kubenswrapper[5120]: I0316 16:53:23.465266 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-api-0" podStartSLOduration=13.465250587 podStartE2EDuration="13.465250587s" podCreationTimestamp="2026-03-16 16:53:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:53:23.440618422 +0000 UTC m=+4905.594550079" watchObservedRunningTime="2026-03-16 16:53:23.465250587 +0000 UTC m=+4905.619182234" Mar 16 16:53:23 crc kubenswrapper[5120]: I0316 16:53:23.483524 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e1c9d08-874f-40cb-9837-5cfd2509c352-memcached-tls-certs" (OuterVolumeSpecName: "memcached-tls-certs") pod "5e1c9d08-874f-40cb-9837-5cfd2509c352" (UID: "5e1c9d08-874f-40cb-9837-5cfd2509c352"). InnerVolumeSpecName "memcached-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:23 crc kubenswrapper[5120]: I0316 16:53:23.488833 5120 generic.go:358] "Generic (PLEG): container finished" podID="c846d2b2-0638-44bd-9ad0-6b6c76f8d16f" containerID="c902dfb54f96d7888fe00f01304e3a2ce668c40edb25e8195bacffff26645501" exitCode=137 Mar 16 16:53:23 crc kubenswrapper[5120]: I0316 16:53:23.492424 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-6f698c8979-vxjjg" podUID="c1cda6a8-906f-4375-8909-a0548d69ecd6" containerName="barbican-worker-log" containerID="cri-o://8c318abdc8e7a1387979d48e25fa7864bc1adc1e661aaa39226b89b45ce5032f" gracePeriod=30 Mar 16 16:53:23 crc kubenswrapper[5120]: I0316 16:53:23.492630 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-6f698c8979-vxjjg" podUID="c1cda6a8-906f-4375-8909-a0548d69ecd6" containerName="barbican-worker" containerID="cri-o://b93e60d1b320f94842228ae4a6354fa698baf82d1f13db37760d540495830d96" gracePeriod=30 Mar 16 16:53:23 crc kubenswrapper[5120]: I0316 16:53:23.507890 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e5c498e5-584c-4cdd-b008-c643b7bb1bc5-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e5c498e5-584c-4cdd-b008-c643b7bb1bc5" (UID: "e5c498e5-584c-4cdd-b008-c643b7bb1bc5"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:23 crc kubenswrapper[5120]: I0316 16:53:23.512243 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovn-northd-0" podUID="7a0880a9-40d3-4b78-890b-b24bf32a92e7" containerName="ovn-northd" containerID="cri-o://a3458e09a4d71e0651e5fbec6a91c41fed3e7b1d960d3b333305b6f923b0096e" gracePeriod=30 Mar 16 16:53:23 crc kubenswrapper[5120]: I0316 16:53:23.512341 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovn-northd-0" podUID="7a0880a9-40d3-4b78-890b-b24bf32a92e7" containerName="openstack-network-exporter" containerID="cri-o://7213e8e9b799a96b6ff80514b1848fb42533aa0a7675eb0549aa13994cc33042" gracePeriod=30 Mar 16 16:53:23 crc kubenswrapper[5120]: I0316 16:53:23.554031 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-7f78b864cb-6dgjh" podUID="c06f24f9-95b0-4a92-ad3a-6075764151ed" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.0.133:9311/healthcheck\": read tcp 10.217.0.2:33228->10.217.0.133:9311: read: connection reset by peer" Mar 16 16:53:23 crc kubenswrapper[5120]: I0316 16:53:23.554524 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-7f78b864cb-6dgjh" podUID="c06f24f9-95b0-4a92-ad3a-6075764151ed" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.0.133:9311/healthcheck\": read tcp 10.217.0.2:33242->10.217.0.133:9311: read: connection reset by peer" Mar 16 16:53:23 crc kubenswrapper[5120]: I0316 16:53:23.561404 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-worker-6f698c8979-vxjjg" podStartSLOduration=11.561385647 podStartE2EDuration="11.561385647s" podCreationTimestamp="2026-03-16 16:53:12 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:53:23.519174972 +0000 UTC m=+4905.673106629" watchObservedRunningTime="2026-03-16 16:53:23.561385647 +0000 UTC m=+4905.715317304" Mar 16 16:53:23 crc kubenswrapper[5120]: I0316 16:53:23.562058 5120 reconciler_common.go:299] "Volume detached for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/5e1c9d08-874f-40cb-9837-5cfd2509c352-memcached-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:23 crc kubenswrapper[5120]: I0316 16:53:23.562078 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e5c498e5-584c-4cdd-b008-c643b7bb1bc5-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:23 crc kubenswrapper[5120]: I0316 16:53:23.580813 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd162855-8210-41c5-9494-15a62edf991c-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "bd162855-8210-41c5-9494-15a62edf991c" (UID: "bd162855-8210-41c5-9494-15a62edf991c"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:23 crc kubenswrapper[5120]: I0316 16:53:23.593396 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a5d3f7a6-64f6-47f9-a144-41a356078e4b-config-data" (OuterVolumeSpecName: "config-data") pod "a5d3f7a6-64f6-47f9-a144-41a356078e4b" (UID: "a5d3f7a6-64f6-47f9-a144-41a356078e4b"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:23 crc kubenswrapper[5120]: I0316 16:53:23.597974 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb37f123-034b-4ccb-9f71-676a322e2a8b-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "cb37f123-034b-4ccb-9f71-676a322e2a8b" (UID: "cb37f123-034b-4ccb-9f71-676a322e2a8b"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:23 crc kubenswrapper[5120]: I0316 16:53:23.618955 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb37f123-034b-4ccb-9f71-676a322e2a8b-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "cb37f123-034b-4ccb-9f71-676a322e2a8b" (UID: "cb37f123-034b-4ccb-9f71-676a322e2a8b"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:23 crc kubenswrapper[5120]: I0316 16:53:23.631953 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a5d3f7a6-64f6-47f9-a144-41a356078e4b-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "a5d3f7a6-64f6-47f9-a144-41a356078e4b" (UID: "a5d3f7a6-64f6-47f9-a144-41a356078e4b"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:23 crc kubenswrapper[5120]: I0316 16:53:23.634911 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e5c498e5-584c-4cdd-b008-c643b7bb1bc5-galera-tls-certs" (OuterVolumeSpecName: "galera-tls-certs") pod "e5c498e5-584c-4cdd-b008-c643b7bb1bc5" (UID: "e5c498e5-584c-4cdd-b008-c643b7bb1bc5"). InnerVolumeSpecName "galera-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:23 crc kubenswrapper[5120]: I0316 16:53:23.646037 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-f6bd6ffc7-nq4s9" podStartSLOduration=7.646010284 podStartE2EDuration="7.646010284s" podCreationTimestamp="2026-03-16 16:53:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:53:23.549026799 +0000 UTC m=+4905.702958456" watchObservedRunningTime="2026-03-16 16:53:23.646010284 +0000 UTC m=+4905.799941951" Mar 16 16:53:23 crc kubenswrapper[5120]: I0316 16:53:23.653134 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd162855-8210-41c5-9494-15a62edf991c-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "bd162855-8210-41c5-9494-15a62edf991c" (UID: "bd162855-8210-41c5-9494-15a62edf991c"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:23 crc kubenswrapper[5120]: I0316 16:53:23.659137 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovn-northd-0" podStartSLOduration=12.659115132 podStartE2EDuration="12.659115132s" podCreationTimestamp="2026-03-16 16:53:11 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:53:23.583472052 +0000 UTC m=+4905.737403699" watchObservedRunningTime="2026-03-16 16:53:23.659115132 +0000 UTC m=+4905.813046789" Mar 16 16:53:23 crc kubenswrapper[5120]: I0316 16:53:23.659717 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a5d3f7a6-64f6-47f9-a144-41a356078e4b-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "a5d3f7a6-64f6-47f9-a144-41a356078e4b" (UID: "a5d3f7a6-64f6-47f9-a144-41a356078e4b"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:23 crc kubenswrapper[5120]: I0316 16:53:23.659942 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dda14ac9-f9b1-4927-a4a4-147c5435906c-nova-novncproxy-tls-certs" (OuterVolumeSpecName: "nova-novncproxy-tls-certs") pod "dda14ac9-f9b1-4927-a4a4-147c5435906c" (UID: "dda14ac9-f9b1-4927-a4a4-147c5435906c"). InnerVolumeSpecName "nova-novncproxy-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:23 crc kubenswrapper[5120]: I0316 16:53:23.665205 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/a5d3f7a6-64f6-47f9-a144-41a356078e4b-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:23 crc kubenswrapper[5120]: I0316 16:53:23.665241 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/bd162855-8210-41c5-9494-15a62edf991c-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:23 crc kubenswrapper[5120]: I0316 16:53:23.665254 5120 reconciler_common.go:299] "Volume detached for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/dda14ac9-f9b1-4927-a4a4-147c5435906c-nova-novncproxy-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:23 crc kubenswrapper[5120]: I0316 16:53:23.665270 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/a5d3f7a6-64f6-47f9-a144-41a356078e4b-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:23 crc kubenswrapper[5120]: I0316 16:53:23.665281 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/bd162855-8210-41c5-9494-15a62edf991c-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:23 crc kubenswrapper[5120]: I0316 16:53:23.665295 5120 reconciler_common.go:299] "Volume detached for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/e5c498e5-584c-4cdd-b008-c643b7bb1bc5-galera-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:23 crc kubenswrapper[5120]: I0316 16:53:23.665306 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/cb37f123-034b-4ccb-9f71-676a322e2a8b-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:23 crc kubenswrapper[5120]: I0316 16:53:23.665318 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/cb37f123-034b-4ccb-9f71-676a322e2a8b-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:23 crc kubenswrapper[5120]: I0316 16:53:23.665330 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a5d3f7a6-64f6-47f9-a144-41a356078e4b-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:24 crc kubenswrapper[5120]: E0316 16:53:24.106192 5120 kubelet.go:2642] "Housekeeping took longer than expected" err="housekeeping took too long" expected="1s" actual="1.441s" Mar 16 16:53:24 crc kubenswrapper[5120]: I0316 16:53:24.106485 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-6cc74c8747-7pf27" event={"ID":"ae73ae1d-4056-43c2-addd-f08999a4a7f6","Type":"ContainerStarted","Data":"212ef64e26a8c2cc068193dc28ff446a67b88b3626597c06ecc57e0b01067724"} Mar 16 16:53:24 crc kubenswrapper[5120]: I0316 16:53:24.106589 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:53:24 crc kubenswrapper[5120]: I0316 16:53:24.106604 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"9fb3c077-55b7-4693-af84-b981deb240da","Type":"ContainerStarted","Data":"d91d83b70d44dac50bc5c6df966179b24d1b383bd576c0575089f528eb05a115"} Mar 16 16:53:24 crc kubenswrapper[5120]: I0316 16:53:24.106616 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:53:24 crc kubenswrapper[5120]: I0316 16:53:24.106629 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"ef964d2a-6681-47c5-9a3b-29fe733ee9f0","Type":"ContainerStarted","Data":"aa8ecc3060c9fc401b4f9011b46c8b75393fee354f0cf1a58a0bacc59f34f05d"} Mar 16 16:53:24 crc kubenswrapper[5120]: I0316 16:53:24.106639 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-9t866" event={"ID":"e7bf94ef-c84b-45ee-a2d9-dd048b1172e3","Type":"ContainerDied","Data":"3d66efb0074bfc58dbf37d2c67968a0934841f6612fefbd737bec2909aedd21a"} Mar 16 16:53:24 crc kubenswrapper[5120]: I0316 16:53:24.106657 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/keystone-f6bd6ffc7-nq4s9" Mar 16 16:53:24 crc kubenswrapper[5120]: I0316 16:53:24.106676 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"a93918e6-bb45-4717-afef-978bad1c6612","Type":"ContainerStarted","Data":"c4ab091d8190ff59f9706a7d7cca32fb7f33c854698ff5d165f5eb3990ee009d"} Mar 16 16:53:24 crc kubenswrapper[5120]: I0316 16:53:24.106690 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:53:24 crc kubenswrapper[5120]: I0316 16:53:24.106700 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-f6bd6ffc7-nq4s9" event={"ID":"d59d2b2a-a98e-4f02-80f4-b6daa5b64d41","Type":"ContainerStarted","Data":"fb93163f3db63a7bab64ee932655eb3d71444795fa8b3cccc2ec5463d55fb7d9"} Mar 16 16:53:24 crc kubenswrapper[5120]: I0316 16:53:24.106711 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"b3ff7a5c-9d60-4d20-9308-0b7d88d605f6","Type":"ContainerStarted","Data":"6c58d2b5148e4e817275d3711291f3d9a418744542a51bf5a8201925c1f9da25"} Mar 16 16:53:24 crc kubenswrapper[5120]: I0316 16:53:24.106724 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-7bf49bf568-fbg2k" event={"ID":"c846d2b2-0638-44bd-9ad0-6b6c76f8d16f","Type":"ContainerDied","Data":"c902dfb54f96d7888fe00f01304e3a2ce668c40edb25e8195bacffff26645501"} Mar 16 16:53:24 crc kubenswrapper[5120]: I0316 16:53:24.106738 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-7bf49bf568-fbg2k" event={"ID":"c846d2b2-0638-44bd-9ad0-6b6c76f8d16f","Type":"ContainerDied","Data":"901c6f74843665c442fb97ed1c0fc1f4acb387fbcca4ec3635f4769ff8daa9c0"} Mar 16 16:53:24 crc kubenswrapper[5120]: I0316 16:53:24.106756 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="901c6f74843665c442fb97ed1c0fc1f4acb387fbcca4ec3635f4769ff8daa9c0" Mar 16 16:53:24 crc kubenswrapper[5120]: I0316 16:53:24.106780 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-6f698c8979-vxjjg" event={"ID":"c1cda6a8-906f-4375-8909-a0548d69ecd6","Type":"ContainerStarted","Data":"b93e60d1b320f94842228ae4a6354fa698baf82d1f13db37760d540495830d96"} Mar 16 16:53:24 crc kubenswrapper[5120]: I0316 16:53:24.106789 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-584b8687b4-5c6lr" event={"ID":"cc4853a6-faf5-45dc-b6f4-aa0b65d0ca8d","Type":"ContainerStarted","Data":"0b2171cdca82691279cb21cfe02497161f4d3514e0d6f41e60432a13800d9a59"} Mar 16 16:53:24 crc kubenswrapper[5120]: I0316 16:53:24.106799 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"7a0880a9-40d3-4b78-890b-b24bf32a92e7","Type":"ContainerStarted","Data":"7213e8e9b799a96b6ff80514b1848fb42533aa0a7675eb0549aa13994cc33042"} Mar 16 16:53:24 crc kubenswrapper[5120]: I0316 16:53:24.195019 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-7bf49bf568-fbg2k" Mar 16 16:53:24 crc kubenswrapper[5120]: I0316 16:53:24.253950 5120 scope.go:117] "RemoveContainer" containerID="7e4afb4b4a40e2ae0676505302e76e0be75d2f157b59d02034c7d6f97f9ffdcf" Mar 16 16:53:24 crc kubenswrapper[5120]: I0316 16:53:24.299047 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c846d2b2-0638-44bd-9ad0-6b6c76f8d16f-config-data\") pod \"c846d2b2-0638-44bd-9ad0-6b6c76f8d16f\" (UID: \"c846d2b2-0638-44bd-9ad0-6b6c76f8d16f\") " Mar 16 16:53:24 crc kubenswrapper[5120]: I0316 16:53:24.299561 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c846d2b2-0638-44bd-9ad0-6b6c76f8d16f-combined-ca-bundle\") pod \"c846d2b2-0638-44bd-9ad0-6b6c76f8d16f\" (UID: \"c846d2b2-0638-44bd-9ad0-6b6c76f8d16f\") " Mar 16 16:53:24 crc kubenswrapper[5120]: I0316 16:53:24.299945 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k6cjz\" (UniqueName: \"kubernetes.io/projected/c846d2b2-0638-44bd-9ad0-6b6c76f8d16f-kube-api-access-k6cjz\") pod \"c846d2b2-0638-44bd-9ad0-6b6c76f8d16f\" (UID: \"c846d2b2-0638-44bd-9ad0-6b6c76f8d16f\") " Mar 16 16:53:24 crc kubenswrapper[5120]: I0316 16:53:24.300473 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/c846d2b2-0638-44bd-9ad0-6b6c76f8d16f-internal-tls-certs\") pod \"c846d2b2-0638-44bd-9ad0-6b6c76f8d16f\" (UID: \"c846d2b2-0638-44bd-9ad0-6b6c76f8d16f\") " Mar 16 16:53:24 crc kubenswrapper[5120]: I0316 16:53:24.300703 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/c846d2b2-0638-44bd-9ad0-6b6c76f8d16f-config-data-custom\") pod \"c846d2b2-0638-44bd-9ad0-6b6c76f8d16f\" (UID: \"c846d2b2-0638-44bd-9ad0-6b6c76f8d16f\") " Mar 16 16:53:24 crc kubenswrapper[5120]: I0316 16:53:24.300984 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c846d2b2-0638-44bd-9ad0-6b6c76f8d16f-logs\") pod \"c846d2b2-0638-44bd-9ad0-6b6c76f8d16f\" (UID: \"c846d2b2-0638-44bd-9ad0-6b6c76f8d16f\") " Mar 16 16:53:24 crc kubenswrapper[5120]: I0316 16:53:24.301255 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/c846d2b2-0638-44bd-9ad0-6b6c76f8d16f-public-tls-certs\") pod \"c846d2b2-0638-44bd-9ad0-6b6c76f8d16f\" (UID: \"c846d2b2-0638-44bd-9ad0-6b6c76f8d16f\") " Mar 16 16:53:24 crc kubenswrapper[5120]: I0316 16:53:24.302157 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c846d2b2-0638-44bd-9ad0-6b6c76f8d16f-logs" (OuterVolumeSpecName: "logs") pod "c846d2b2-0638-44bd-9ad0-6b6c76f8d16f" (UID: "c846d2b2-0638-44bd-9ad0-6b6c76f8d16f"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:53:24 crc kubenswrapper[5120]: I0316 16:53:24.323929 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c846d2b2-0638-44bd-9ad0-6b6c76f8d16f-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "c846d2b2-0638-44bd-9ad0-6b6c76f8d16f" (UID: "c846d2b2-0638-44bd-9ad0-6b6c76f8d16f"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:24 crc kubenswrapper[5120]: I0316 16:53:24.325028 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c846d2b2-0638-44bd-9ad0-6b6c76f8d16f-kube-api-access-k6cjz" (OuterVolumeSpecName: "kube-api-access-k6cjz") pod "c846d2b2-0638-44bd-9ad0-6b6c76f8d16f" (UID: "c846d2b2-0638-44bd-9ad0-6b6c76f8d16f"). InnerVolumeSpecName "kube-api-access-k6cjz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:53:24 crc kubenswrapper[5120]: I0316 16:53:24.406725 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/c846d2b2-0638-44bd-9ad0-6b6c76f8d16f-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:24 crc kubenswrapper[5120]: I0316 16:53:24.406779 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c846d2b2-0638-44bd-9ad0-6b6c76f8d16f-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:24 crc kubenswrapper[5120]: I0316 16:53:24.406792 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k6cjz\" (UniqueName: \"kubernetes.io/projected/c846d2b2-0638-44bd-9ad0-6b6c76f8d16f-kube-api-access-k6cjz\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:24 crc kubenswrapper[5120]: I0316 16:53:24.539937 5120 generic.go:358] "Generic (PLEG): container finished" podID="979d8a07-391d-483c-92d1-bb2d256edf99" containerID="e657edbdc4c1d1813bbd0fe5142cc396ab5f34be797282678df442f971bf15d2" exitCode=0 Mar 16 16:53:24 crc kubenswrapper[5120]: I0316 16:53:24.540106 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-6d764c69b8-sv9d2" event={"ID":"979d8a07-391d-483c-92d1-bb2d256edf99","Type":"ContainerDied","Data":"e657edbdc4c1d1813bbd0fe5142cc396ab5f34be797282678df442f971bf15d2"} Mar 16 16:53:24 crc kubenswrapper[5120]: I0316 16:53:24.540151 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-6d764c69b8-sv9d2" event={"ID":"979d8a07-391d-483c-92d1-bb2d256edf99","Type":"ContainerDied","Data":"71e8c5d1c05658340afa51a102ec0dab25f74c91c4253d1a1f1c2b12d31e015a"} Mar 16 16:53:24 crc kubenswrapper[5120]: I0316 16:53:24.540167 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="71e8c5d1c05658340afa51a102ec0dab25f74c91c4253d1a1f1c2b12d31e015a" Mar 16 16:53:24 crc kubenswrapper[5120]: I0316 16:53:24.543555 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-788658cdb6-tsr2b" event={"ID":"472a9d94-a155-4916-aab9-4672a3c6c18c","Type":"ContainerStarted","Data":"840093ee5a2a11cc1fdcd8dc97c9738e8f3927be0adf408e9af80e17042ee646"} Mar 16 16:53:24 crc kubenswrapper[5120]: I0316 16:53:24.559116 5120 generic.go:358] "Generic (PLEG): container finished" podID="c06f24f9-95b0-4a92-ad3a-6075764151ed" containerID="5ca55cb347519b4334c3c6b37c431e0953788ca2ed0f3ca9ee1c934857dba490" exitCode=0 Mar 16 16:53:24 crc kubenswrapper[5120]: I0316 16:53:24.559199 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-7f78b864cb-6dgjh" event={"ID":"c06f24f9-95b0-4a92-ad3a-6075764151ed","Type":"ContainerDied","Data":"5ca55cb347519b4334c3c6b37c431e0953788ca2ed0f3ca9ee1c934857dba490"} Mar 16 16:53:24 crc kubenswrapper[5120]: I0316 16:53:24.559241 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-7f78b864cb-6dgjh" event={"ID":"c06f24f9-95b0-4a92-ad3a-6075764151ed","Type":"ContainerDied","Data":"fb7386c55c78681a2e07341fb97c2dc48901c61c310c18f7f94e1c781a2a5a7f"} Mar 16 16:53:24 crc kubenswrapper[5120]: I0316 16:53:24.559252 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fb7386c55c78681a2e07341fb97c2dc48901c61c310c18f7f94e1c781a2a5a7f" Mar 16 16:53:24 crc kubenswrapper[5120]: I0316 16:53:24.561596 5120 generic.go:358] "Generic (PLEG): container finished" podID="c1cda6a8-906f-4375-8909-a0548d69ecd6" containerID="8c318abdc8e7a1387979d48e25fa7864bc1adc1e661aaa39226b89b45ce5032f" exitCode=143 Mar 16 16:53:24 crc kubenswrapper[5120]: I0316 16:53:24.561676 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-6f698c8979-vxjjg" event={"ID":"c1cda6a8-906f-4375-8909-a0548d69ecd6","Type":"ContainerDied","Data":"8c318abdc8e7a1387979d48e25fa7864bc1adc1e661aaa39226b89b45ce5032f"} Mar 16 16:53:24 crc kubenswrapper[5120]: I0316 16:53:24.577843 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-ccc65f956-nsglj" event={"ID":"cb10ccc3-03fc-4eb7-a637-c2bc721a9b69","Type":"ContainerStarted","Data":"5ff4bbba0105c7cefc7a6dc667024463e1d55d2bad64e496f008d23492e61d48"} Mar 16 16:53:24 crc kubenswrapper[5120]: I0316 16:53:24.577930 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-ccc65f956-nsglj" podUID="cb10ccc3-03fc-4eb7-a637-c2bc721a9b69" containerName="barbican-keystone-listener-log" containerID="cri-o://3ad9955eddb7852d5f0975d31c5bd54aa679fe305e10f6e084c39ef302c2e59b" gracePeriod=30 Mar 16 16:53:24 crc kubenswrapper[5120]: I0316 16:53:24.578053 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-ccc65f956-nsglj" podUID="cb10ccc3-03fc-4eb7-a637-c2bc721a9b69" containerName="barbican-keystone-listener" containerID="cri-o://5ff4bbba0105c7cefc7a6dc667024463e1d55d2bad64e496f008d23492e61d48" gracePeriod=30 Mar 16 16:53:24 crc kubenswrapper[5120]: I0316 16:53:24.587041 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c846d2b2-0638-44bd-9ad0-6b6c76f8d16f-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "c846d2b2-0638-44bd-9ad0-6b6c76f8d16f" (UID: "c846d2b2-0638-44bd-9ad0-6b6c76f8d16f"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:24 crc kubenswrapper[5120]: I0316 16:53:24.596447 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-7b9f48f6c8-rfj5g" event={"ID":"eb34a81f-663e-4027-bf2c-1d334bd06ba4","Type":"ContainerStarted","Data":"279aa838c1a848399cfdb1bb646b1ad052feb810283f58b9f2f00f5edd91dfee"} Mar 16 16:53:24 crc kubenswrapper[5120]: I0316 16:53:24.605352 5120 generic.go:358] "Generic (PLEG): container finished" podID="7a0880a9-40d3-4b78-890b-b24bf32a92e7" containerID="7213e8e9b799a96b6ff80514b1848fb42533aa0a7675eb0549aa13994cc33042" exitCode=2 Mar 16 16:53:24 crc kubenswrapper[5120]: I0316 16:53:24.605506 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"7a0880a9-40d3-4b78-890b-b24bf32a92e7","Type":"ContainerDied","Data":"7213e8e9b799a96b6ff80514b1848fb42533aa0a7675eb0549aa13994cc33042"} Mar 16 16:53:24 crc kubenswrapper[5120]: I0316 16:53:24.615665 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c846d2b2-0638-44bd-9ad0-6b6c76f8d16f-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:24 crc kubenswrapper[5120]: I0316 16:53:24.616093 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-keystone-listener-ccc65f956-nsglj" podStartSLOduration=12.616079555 podStartE2EDuration="12.616079555s" podCreationTimestamp="2026-03-16 16:53:12 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:53:24.593320062 +0000 UTC m=+4906.747251719" watchObservedRunningTime="2026-03-16 16:53:24.616079555 +0000 UTC m=+4906.770011212" Mar 16 16:53:24 crc kubenswrapper[5120]: I0316 16:53:24.616609 5120 generic.go:358] "Generic (PLEG): container finished" podID="fa4601ff-7ef6-4d2c-b0ca-b153763db12f" containerID="e7490c0e0d59a82483b2df6513e7e7eab4815275effa3bd260acd6d11c41af7d" exitCode=137 Mar 16 16:53:24 crc kubenswrapper[5120]: I0316 16:53:24.616723 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-646d48c554-kk5ms" event={"ID":"fa4601ff-7ef6-4d2c-b0ca-b153763db12f","Type":"ContainerDied","Data":"e7490c0e0d59a82483b2df6513e7e7eab4815275effa3bd260acd6d11c41af7d"} Mar 16 16:53:24 crc kubenswrapper[5120]: I0316 16:53:24.616906 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-646d48c554-kk5ms" event={"ID":"fa4601ff-7ef6-4d2c-b0ca-b153763db12f","Type":"ContainerDied","Data":"063de06c3cb529ad295ecfbc11d77cf09a22b566c6f152893e823def46ef38f4"} Mar 16 16:53:24 crc kubenswrapper[5120]: I0316 16:53:24.616936 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="063de06c3cb529ad295ecfbc11d77cf09a22b566c6f152893e823def46ef38f4" Mar 16 16:53:24 crc kubenswrapper[5120]: I0316 16:53:24.622007 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c846d2b2-0638-44bd-9ad0-6b6c76f8d16f-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "c846d2b2-0638-44bd-9ad0-6b6c76f8d16f" (UID: "c846d2b2-0638-44bd-9ad0-6b6c76f8d16f"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:24 crc kubenswrapper[5120]: I0316 16:53:24.622233 5120 generic.go:358] "Generic (PLEG): container finished" podID="ef964d2a-6681-47c5-9a3b-29fe733ee9f0" containerID="aa8ecc3060c9fc401b4f9011b46c8b75393fee354f0cf1a58a0bacc59f34f05d" exitCode=0 Mar 16 16:53:24 crc kubenswrapper[5120]: I0316 16:53:24.622264 5120 generic.go:358] "Generic (PLEG): container finished" podID="ef964d2a-6681-47c5-9a3b-29fe733ee9f0" containerID="50a7aad84014a1700b53fcc27f170796a9610d2fc144e609cb89c547825e3660" exitCode=143 Mar 16 16:53:24 crc kubenswrapper[5120]: I0316 16:53:24.622410 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"ef964d2a-6681-47c5-9a3b-29fe733ee9f0","Type":"ContainerDied","Data":"aa8ecc3060c9fc401b4f9011b46c8b75393fee354f0cf1a58a0bacc59f34f05d"} Mar 16 16:53:24 crc kubenswrapper[5120]: I0316 16:53:24.622449 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"ef964d2a-6681-47c5-9a3b-29fe733ee9f0","Type":"ContainerDied","Data":"50a7aad84014a1700b53fcc27f170796a9610d2fc144e609cb89c547825e3660"} Mar 16 16:53:24 crc kubenswrapper[5120]: I0316 16:53:24.649391 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-88757f4fd-w4kvr" event={"ID":"9fab4617-1011-48f5-90ae-5415fd9b91b4","Type":"ContainerStarted","Data":"eff074d953b8f8be8f090669ba89c0679cc2c30f766475fc75a1d50c65a8665f"} Mar 16 16:53:24 crc kubenswrapper[5120]: I0316 16:53:24.649497 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-88757f4fd-w4kvr" podUID="9fab4617-1011-48f5-90ae-5415fd9b91b4" containerName="placement-log" containerID="cri-o://6d2b0330b2064662c772ad1e4e9e348aa9c96a000542503ed0720adf02860f5f" gracePeriod=30 Mar 16 16:53:24 crc kubenswrapper[5120]: I0316 16:53:24.650056 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-88757f4fd-w4kvr" podUID="9fab4617-1011-48f5-90ae-5415fd9b91b4" containerName="placement-api" containerID="cri-o://eff074d953b8f8be8f090669ba89c0679cc2c30f766475fc75a1d50c65a8665f" gracePeriod=30 Mar 16 16:53:24 crc kubenswrapper[5120]: I0316 16:53:24.650339 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-7bf49bf568-fbg2k" Mar 16 16:53:24 crc kubenswrapper[5120]: I0316 16:53:24.649789 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-88757f4fd-w4kvr" Mar 16 16:53:24 crc kubenswrapper[5120]: I0316 16:53:24.650887 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-88757f4fd-w4kvr" Mar 16 16:53:24 crc kubenswrapper[5120]: I0316 16:53:24.660067 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c846d2b2-0638-44bd-9ad0-6b6c76f8d16f-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "c846d2b2-0638-44bd-9ad0-6b6c76f8d16f" (UID: "c846d2b2-0638-44bd-9ad0-6b6c76f8d16f"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:24 crc kubenswrapper[5120]: I0316 16:53:24.668365 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-88757f4fd-w4kvr" podStartSLOduration=12.668348886 podStartE2EDuration="12.668348886s" podCreationTimestamp="2026-03-16 16:53:12 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:53:24.666483134 +0000 UTC m=+4906.820414811" watchObservedRunningTime="2026-03-16 16:53:24.668348886 +0000 UTC m=+4906.822280543" Mar 16 16:53:24 crc kubenswrapper[5120]: I0316 16:53:24.711660 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c846d2b2-0638-44bd-9ad0-6b6c76f8d16f-config-data" (OuterVolumeSpecName: "config-data") pod "c846d2b2-0638-44bd-9ad0-6b6c76f8d16f" (UID: "c846d2b2-0638-44bd-9ad0-6b6c76f8d16f"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:24 crc kubenswrapper[5120]: I0316 16:53:24.718071 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/c846d2b2-0638-44bd-9ad0-6b6c76f8d16f-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:24 crc kubenswrapper[5120]: I0316 16:53:24.718119 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/c846d2b2-0638-44bd-9ad0-6b6c76f8d16f-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:24 crc kubenswrapper[5120]: I0316 16:53:24.718131 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c846d2b2-0638-44bd-9ad0-6b6c76f8d16f-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:24 crc kubenswrapper[5120]: I0316 16:53:24.904118 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-6d764c69b8-sv9d2" Mar 16 16:53:24 crc kubenswrapper[5120]: I0316 16:53:24.981667 5120 scope.go:117] "RemoveContainer" containerID="9dea7e07ec457522ac530558fa96a46af205c7f4f10ffce3f455074081c4bf97" Mar 16 16:53:24 crc kubenswrapper[5120]: I0316 16:53:24.987713 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-646d48c554-kk5ms" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.009538 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-7f78b864cb-6dgjh" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.024946 5120 scope.go:117] "RemoveContainer" containerID="f314570a4d17cb896242fa890e6e2c5cde63f50249c5330dd067122e2196f485" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.043165 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/979d8a07-391d-483c-92d1-bb2d256edf99-internal-tls-certs\") pod \"979d8a07-391d-483c-92d1-bb2d256edf99\" (UID: \"979d8a07-391d-483c-92d1-bb2d256edf99\") " Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.043299 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/979d8a07-391d-483c-92d1-bb2d256edf99-public-tls-certs\") pod \"979d8a07-391d-483c-92d1-bb2d256edf99\" (UID: \"979d8a07-391d-483c-92d1-bb2d256edf99\") " Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.043392 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/979d8a07-391d-483c-92d1-bb2d256edf99-credential-keys\") pod \"979d8a07-391d-483c-92d1-bb2d256edf99\" (UID: \"979d8a07-391d-483c-92d1-bb2d256edf99\") " Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.043553 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/979d8a07-391d-483c-92d1-bb2d256edf99-fernet-keys\") pod \"979d8a07-391d-483c-92d1-bb2d256edf99\" (UID: \"979d8a07-391d-483c-92d1-bb2d256edf99\") " Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.043675 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fzd6q\" (UniqueName: \"kubernetes.io/projected/979d8a07-391d-483c-92d1-bb2d256edf99-kube-api-access-fzd6q\") pod \"979d8a07-391d-483c-92d1-bb2d256edf99\" (UID: \"979d8a07-391d-483c-92d1-bb2d256edf99\") " Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.043716 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/979d8a07-391d-483c-92d1-bb2d256edf99-combined-ca-bundle\") pod \"979d8a07-391d-483c-92d1-bb2d256edf99\" (UID: \"979d8a07-391d-483c-92d1-bb2d256edf99\") " Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.044166 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/979d8a07-391d-483c-92d1-bb2d256edf99-config-data\") pod \"979d8a07-391d-483c-92d1-bb2d256edf99\" (UID: \"979d8a07-391d-483c-92d1-bb2d256edf99\") " Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.044364 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/979d8a07-391d-483c-92d1-bb2d256edf99-scripts\") pod \"979d8a07-391d-483c-92d1-bb2d256edf99\" (UID: \"979d8a07-391d-483c-92d1-bb2d256edf99\") " Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.058899 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/979d8a07-391d-483c-92d1-bb2d256edf99-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "979d8a07-391d-483c-92d1-bb2d256edf99" (UID: "979d8a07-391d-483c-92d1-bb2d256edf99"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.072128 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/979d8a07-391d-483c-92d1-bb2d256edf99-scripts" (OuterVolumeSpecName: "scripts") pod "979d8a07-391d-483c-92d1-bb2d256edf99" (UID: "979d8a07-391d-483c-92d1-bb2d256edf99"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.082914 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/979d8a07-391d-483c-92d1-bb2d256edf99-kube-api-access-fzd6q" (OuterVolumeSpecName: "kube-api-access-fzd6q") pod "979d8a07-391d-483c-92d1-bb2d256edf99" (UID: "979d8a07-391d-483c-92d1-bb2d256edf99"). InnerVolumeSpecName "kube-api-access-fzd6q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.100344 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/979d8a07-391d-483c-92d1-bb2d256edf99-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "979d8a07-391d-483c-92d1-bb2d256edf99" (UID: "979d8a07-391d-483c-92d1-bb2d256edf99"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.105975 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.143274 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.149678 5120 scope.go:117] "RemoveContainer" containerID="4f87e2ba79ef2ad55e9134e65028d8ffb56874b0a0b9cd57961496fea5e06a3b" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.154877 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/fa4601ff-7ef6-4d2c-b0ca-b153763db12f-logs\") pod \"fa4601ff-7ef6-4d2c-b0ca-b153763db12f\" (UID: \"fa4601ff-7ef6-4d2c-b0ca-b153763db12f\") " Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.154972 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/fa4601ff-7ef6-4d2c-b0ca-b153763db12f-config-data-custom\") pod \"fa4601ff-7ef6-4d2c-b0ca-b153763db12f\" (UID: \"fa4601ff-7ef6-4d2c-b0ca-b153763db12f\") " Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.155133 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c7dr8\" (UniqueName: \"kubernetes.io/projected/c06f24f9-95b0-4a92-ad3a-6075764151ed-kube-api-access-c7dr8\") pod \"c06f24f9-95b0-4a92-ad3a-6075764151ed\" (UID: \"c06f24f9-95b0-4a92-ad3a-6075764151ed\") " Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.155303 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/c06f24f9-95b0-4a92-ad3a-6075764151ed-config-data-custom\") pod \"c06f24f9-95b0-4a92-ad3a-6075764151ed\" (UID: \"c06f24f9-95b0-4a92-ad3a-6075764151ed\") " Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.155336 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fa4601ff-7ef6-4d2c-b0ca-b153763db12f-combined-ca-bundle\") pod \"fa4601ff-7ef6-4d2c-b0ca-b153763db12f\" (UID: \"fa4601ff-7ef6-4d2c-b0ca-b153763db12f\") " Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.155480 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c06f24f9-95b0-4a92-ad3a-6075764151ed-combined-ca-bundle\") pod \"c06f24f9-95b0-4a92-ad3a-6075764151ed\" (UID: \"c06f24f9-95b0-4a92-ad3a-6075764151ed\") " Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.155675 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fa4601ff-7ef6-4d2c-b0ca-b153763db12f-config-data\") pod \"fa4601ff-7ef6-4d2c-b0ca-b153763db12f\" (UID: \"fa4601ff-7ef6-4d2c-b0ca-b153763db12f\") " Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.155783 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c06f24f9-95b0-4a92-ad3a-6075764151ed-config-data\") pod \"c06f24f9-95b0-4a92-ad3a-6075764151ed\" (UID: \"c06f24f9-95b0-4a92-ad3a-6075764151ed\") " Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.155854 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/c06f24f9-95b0-4a92-ad3a-6075764151ed-public-tls-certs\") pod \"c06f24f9-95b0-4a92-ad3a-6075764151ed\" (UID: \"c06f24f9-95b0-4a92-ad3a-6075764151ed\") " Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.164689 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/c06f24f9-95b0-4a92-ad3a-6075764151ed-internal-tls-certs\") pod \"c06f24f9-95b0-4a92-ad3a-6075764151ed\" (UID: \"c06f24f9-95b0-4a92-ad3a-6075764151ed\") " Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.164730 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c06f24f9-95b0-4a92-ad3a-6075764151ed-logs\") pod \"c06f24f9-95b0-4a92-ad3a-6075764151ed\" (UID: \"c06f24f9-95b0-4a92-ad3a-6075764151ed\") " Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.164782 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sc4js\" (UniqueName: \"kubernetes.io/projected/fa4601ff-7ef6-4d2c-b0ca-b153763db12f-kube-api-access-sc4js\") pod \"fa4601ff-7ef6-4d2c-b0ca-b153763db12f\" (UID: \"fa4601ff-7ef6-4d2c-b0ca-b153763db12f\") " Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.165187 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa4601ff-7ef6-4d2c-b0ca-b153763db12f-logs" (OuterVolumeSpecName: "logs") pod "fa4601ff-7ef6-4d2c-b0ca-b153763db12f" (UID: "fa4601ff-7ef6-4d2c-b0ca-b153763db12f"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.165848 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c06f24f9-95b0-4a92-ad3a-6075764151ed-logs" (OuterVolumeSpecName: "logs") pod "c06f24f9-95b0-4a92-ad3a-6075764151ed" (UID: "c06f24f9-95b0-4a92-ad3a-6075764151ed"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.168158 5120 reconciler_common.go:299] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/979d8a07-391d-483c-92d1-bb2d256edf99-credential-keys\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.168194 5120 reconciler_common.go:299] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/979d8a07-391d-483c-92d1-bb2d256edf99-fernet-keys\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.168209 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fzd6q\" (UniqueName: \"kubernetes.io/projected/979d8a07-391d-483c-92d1-bb2d256edf99-kube-api-access-fzd6q\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.168223 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c06f24f9-95b0-4a92-ad3a-6075764151ed-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.168235 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/fa4601ff-7ef6-4d2c-b0ca-b153763db12f-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.168246 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/979d8a07-391d-483c-92d1-bb2d256edf99-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.192674 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.250872 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-5964c9d8c-plh78"] Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.263062 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c06f24f9-95b0-4a92-ad3a-6075764151ed-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "c06f24f9-95b0-4a92-ad3a-6075764151ed" (UID: "c06f24f9-95b0-4a92-ad3a-6075764151ed"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.263346 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c06f24f9-95b0-4a92-ad3a-6075764151ed-kube-api-access-c7dr8" (OuterVolumeSpecName: "kube-api-access-c7dr8") pod "c06f24f9-95b0-4a92-ad3a-6075764151ed" (UID: "c06f24f9-95b0-4a92-ad3a-6075764151ed"). InnerVolumeSpecName "kube-api-access-c7dr8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.263382 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa4601ff-7ef6-4d2c-b0ca-b153763db12f-kube-api-access-sc4js" (OuterVolumeSpecName: "kube-api-access-sc4js") pod "fa4601ff-7ef6-4d2c-b0ca-b153763db12f" (UID: "fa4601ff-7ef6-4d2c-b0ca-b153763db12f"). InnerVolumeSpecName "kube-api-access-sc4js". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.272609 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/ef964d2a-6681-47c5-9a3b-29fe733ee9f0-config-data-custom\") pod \"ef964d2a-6681-47c5-9a3b-29fe733ee9f0\" (UID: \"ef964d2a-6681-47c5-9a3b-29fe733ee9f0\") " Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.272831 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ef964d2a-6681-47c5-9a3b-29fe733ee9f0-logs\") pod \"ef964d2a-6681-47c5-9a3b-29fe733ee9f0\" (UID: \"ef964d2a-6681-47c5-9a3b-29fe733ee9f0\") " Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.273179 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/ef964d2a-6681-47c5-9a3b-29fe733ee9f0-internal-tls-certs\") pod \"ef964d2a-6681-47c5-9a3b-29fe733ee9f0\" (UID: \"ef964d2a-6681-47c5-9a3b-29fe733ee9f0\") " Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.273224 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ef964d2a-6681-47c5-9a3b-29fe733ee9f0-scripts\") pod \"ef964d2a-6681-47c5-9a3b-29fe733ee9f0\" (UID: \"ef964d2a-6681-47c5-9a3b-29fe733ee9f0\") " Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.273731 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef964d2a-6681-47c5-9a3b-29fe733ee9f0-logs" (OuterVolumeSpecName: "logs") pod "ef964d2a-6681-47c5-9a3b-29fe733ee9f0" (UID: "ef964d2a-6681-47c5-9a3b-29fe733ee9f0"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.273793 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ef964d2a-6681-47c5-9a3b-29fe733ee9f0-config-data\") pod \"ef964d2a-6681-47c5-9a3b-29fe733ee9f0\" (UID: \"ef964d2a-6681-47c5-9a3b-29fe733ee9f0\") " Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.274349 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qvkk5\" (UniqueName: \"kubernetes.io/projected/ef964d2a-6681-47c5-9a3b-29fe733ee9f0-kube-api-access-qvkk5\") pod \"ef964d2a-6681-47c5-9a3b-29fe733ee9f0\" (UID: \"ef964d2a-6681-47c5-9a3b-29fe733ee9f0\") " Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.274456 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ef964d2a-6681-47c5-9a3b-29fe733ee9f0-public-tls-certs\") pod \"ef964d2a-6681-47c5-9a3b-29fe733ee9f0\" (UID: \"ef964d2a-6681-47c5-9a3b-29fe733ee9f0\") " Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.274582 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/ef964d2a-6681-47c5-9a3b-29fe733ee9f0-etc-machine-id\") pod \"ef964d2a-6681-47c5-9a3b-29fe733ee9f0\" (UID: \"ef964d2a-6681-47c5-9a3b-29fe733ee9f0\") " Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.274625 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ef964d2a-6681-47c5-9a3b-29fe733ee9f0-combined-ca-bundle\") pod \"ef964d2a-6681-47c5-9a3b-29fe733ee9f0\" (UID: \"ef964d2a-6681-47c5-9a3b-29fe733ee9f0\") " Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.275788 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sc4js\" (UniqueName: \"kubernetes.io/projected/fa4601ff-7ef6-4d2c-b0ca-b153763db12f-kube-api-access-sc4js\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.275809 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c7dr8\" (UniqueName: \"kubernetes.io/projected/c06f24f9-95b0-4a92-ad3a-6075764151ed-kube-api-access-c7dr8\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.275821 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/c06f24f9-95b0-4a92-ad3a-6075764151ed-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.275830 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ef964d2a-6681-47c5-9a3b-29fe733ee9f0-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.277937 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.278603 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa4601ff-7ef6-4d2c-b0ca-b153763db12f-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "fa4601ff-7ef6-4d2c-b0ca-b153763db12f" (UID: "fa4601ff-7ef6-4d2c-b0ca-b153763db12f"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.284736 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/ef964d2a-6681-47c5-9a3b-29fe733ee9f0-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "ef964d2a-6681-47c5-9a3b-29fe733ee9f0" (UID: "ef964d2a-6681-47c5-9a3b-29fe733ee9f0"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.292535 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6db354d-c48c-4497-a289-18edadffce47" containerName="barbican-worker" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.292572 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6db354d-c48c-4497-a289-18edadffce47" containerName="barbican-worker" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.292588 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd162855-8210-41c5-9494-15a62edf991c" containerName="nova-api-api" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.292594 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd162855-8210-41c5-9494-15a62edf991c" containerName="nova-api-api" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.292604 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="979d8a07-391d-483c-92d1-bb2d256edf99" containerName="keystone-api" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.292610 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="979d8a07-391d-483c-92d1-bb2d256edf99" containerName="keystone-api" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.292625 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa4601ff-7ef6-4d2c-b0ca-b153763db12f" containerName="barbican-keystone-listener-log" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.292632 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa4601ff-7ef6-4d2c-b0ca-b153763db12f" containerName="barbican-keystone-listener-log" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.292647 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6db354d-c48c-4497-a289-18edadffce47" containerName="barbican-worker-log" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.292652 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6db354d-c48c-4497-a289-18edadffce47" containerName="barbican-worker-log" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.292677 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c846d2b2-0638-44bd-9ad0-6b6c76f8d16f" containerName="barbican-api" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.292682 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c846d2b2-0638-44bd-9ad0-6b6c76f8d16f" containerName="barbican-api" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.292699 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef964d2a-6681-47c5-9a3b-29fe733ee9f0" containerName="cinder-api-log" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.292705 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef964d2a-6681-47c5-9a3b-29fe733ee9f0" containerName="cinder-api-log" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.292716 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c06f24f9-95b0-4a92-ad3a-6075764151ed" containerName="barbican-api-log" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.292722 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c06f24f9-95b0-4a92-ad3a-6075764151ed" containerName="barbican-api-log" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.292745 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa4601ff-7ef6-4d2c-b0ca-b153763db12f" containerName="barbican-keystone-listener" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.292750 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa4601ff-7ef6-4d2c-b0ca-b153763db12f" containerName="barbican-keystone-listener" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.292771 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c06f24f9-95b0-4a92-ad3a-6075764151ed" containerName="barbican-api" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.292778 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c06f24f9-95b0-4a92-ad3a-6075764151ed" containerName="barbican-api" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.292791 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c846d2b2-0638-44bd-9ad0-6b6c76f8d16f" containerName="barbican-api-log" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.292796 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c846d2b2-0638-44bd-9ad0-6b6c76f8d16f" containerName="barbican-api-log" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.292806 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5d3f7a6-64f6-47f9-a144-41a356078e4b" containerName="barbican-api" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.292811 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5d3f7a6-64f6-47f9-a144-41a356078e4b" containerName="barbican-api" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.292824 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5d3f7a6-64f6-47f9-a144-41a356078e4b" containerName="barbican-api-log" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.292829 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5d3f7a6-64f6-47f9-a144-41a356078e4b" containerName="barbican-api-log" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.292847 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef964d2a-6681-47c5-9a3b-29fe733ee9f0" containerName="cinder-api" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.292852 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef964d2a-6681-47c5-9a3b-29fe733ee9f0" containerName="cinder-api" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.292868 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e1c9d08-874f-40cb-9837-5cfd2509c352" containerName="memcached" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.292874 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e1c9d08-874f-40cb-9837-5cfd2509c352" containerName="memcached" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.292894 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd162855-8210-41c5-9494-15a62edf991c" containerName="nova-api-log" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.292899 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd162855-8210-41c5-9494-15a62edf991c" containerName="nova-api-log" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.293194 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="fa4601ff-7ef6-4d2c-b0ca-b153763db12f" containerName="barbican-keystone-listener-log" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.293208 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="5e1c9d08-874f-40cb-9837-5cfd2509c352" containerName="memcached" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.293217 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="bd162855-8210-41c5-9494-15a62edf991c" containerName="nova-api-log" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.293225 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="979d8a07-391d-483c-92d1-bb2d256edf99" containerName="keystone-api" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.293232 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c846d2b2-0638-44bd-9ad0-6b6c76f8d16f" containerName="barbican-api-log" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.293241 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="a5d3f7a6-64f6-47f9-a144-41a356078e4b" containerName="barbican-api" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.293249 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ef964d2a-6681-47c5-9a3b-29fe733ee9f0" containerName="cinder-api-log" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.293261 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c846d2b2-0638-44bd-9ad0-6b6c76f8d16f" containerName="barbican-api" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.293270 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="fa4601ff-7ef6-4d2c-b0ca-b153763db12f" containerName="barbican-keystone-listener" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.293277 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ef964d2a-6681-47c5-9a3b-29fe733ee9f0" containerName="cinder-api" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.293284 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="d6db354d-c48c-4497-a289-18edadffce47" containerName="barbican-worker-log" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.293294 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="a5d3f7a6-64f6-47f9-a144-41a356078e4b" containerName="barbican-api-log" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.293302 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="d6db354d-c48c-4497-a289-18edadffce47" containerName="barbican-worker" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.293308 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c06f24f9-95b0-4a92-ad3a-6075764151ed" containerName="barbican-api" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.293316 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="bd162855-8210-41c5-9494-15a62edf991c" containerName="nova-api-api" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.293326 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c06f24f9-95b0-4a92-ad3a-6075764151ed" containerName="barbican-api-log" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.303329 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-worker-5964c9d8c-plh78"] Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.303487 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.308017 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-novncproxy-cell1-vencrypt\"" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.308056 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-novncproxy-cell1-public-svc\"" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.308249 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-novncproxy-config-data\"" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.316311 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.324458 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podUID="dda14ac9-f9b1-4927-a4a4-147c5435906c" containerName="nova-cell1-novncproxy-novncproxy" probeResult="failure" output="Get \"https://10.217.0.157:6080/vnc_lite.html\": context deadline exceeded" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.334547 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.342209 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef964d2a-6681-47c5-9a3b-29fe733ee9f0-kube-api-access-qvkk5" (OuterVolumeSpecName: "kube-api-access-qvkk5") pod "ef964d2a-6681-47c5-9a3b-29fe733ee9f0" (UID: "ef964d2a-6681-47c5-9a3b-29fe733ee9f0"). InnerVolumeSpecName "kube-api-access-qvkk5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.352157 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef964d2a-6681-47c5-9a3b-29fe733ee9f0-scripts" (OuterVolumeSpecName: "scripts") pod "ef964d2a-6681-47c5-9a3b-29fe733ee9f0" (UID: "ef964d2a-6681-47c5-9a3b-29fe733ee9f0"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.353078 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.362107 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.367808 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.367831 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef964d2a-6681-47c5-9a3b-29fe733ee9f0-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "ef964d2a-6681-47c5-9a3b-29fe733ee9f0" (UID: "ef964d2a-6681-47c5-9a3b-29fe733ee9f0"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.370478 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"memcached-memcached-dockercfg-njnwg\"" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.370803 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-memcached-svc\"" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.370971 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"memcached-config-data\"" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.377685 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1c6098ab-3f23-46bd-95ff-94cf96b88f3f-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"1c6098ab-3f23-46bd-95ff-94cf96b88f3f\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.378032 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/1c6098ab-3f23-46bd-95ff-94cf96b88f3f-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"1c6098ab-3f23-46bd-95ff-94cf96b88f3f\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.378092 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.378151 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/d8a5e446-6e3f-4c8c-b842-f800c1361957-memcached-tls-certs\") pod \"memcached-0\" (UID: \"d8a5e446-6e3f-4c8c-b842-f800c1361957\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.378530 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mz2pl\" (UniqueName: \"kubernetes.io/projected/1c6098ab-3f23-46bd-95ff-94cf96b88f3f-kube-api-access-mz2pl\") pod \"nova-cell1-novncproxy-0\" (UID: \"1c6098ab-3f23-46bd-95ff-94cf96b88f3f\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.378623 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1c6098ab-3f23-46bd-95ff-94cf96b88f3f-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"1c6098ab-3f23-46bd-95ff-94cf96b88f3f\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.378732 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d8a5e446-6e3f-4c8c-b842-f800c1361957-combined-ca-bundle\") pod \"memcached-0\" (UID: \"d8a5e446-6e3f-4c8c-b842-f800c1361957\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.378802 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/1c6098ab-3f23-46bd-95ff-94cf96b88f3f-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"1c6098ab-3f23-46bd-95ff-94cf96b88f3f\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.378829 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/d8a5e446-6e3f-4c8c-b842-f800c1361957-config-data\") pod \"memcached-0\" (UID: \"d8a5e446-6e3f-4c8c-b842-f800c1361957\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.390066 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hnk6d\" (UniqueName: \"kubernetes.io/projected/d8a5e446-6e3f-4c8c-b842-f800c1361957-kube-api-access-hnk6d\") pod \"memcached-0\" (UID: \"d8a5e446-6e3f-4c8c-b842-f800c1361957\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.390200 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/d8a5e446-6e3f-4c8c-b842-f800c1361957-kolla-config\") pod \"memcached-0\" (UID: \"d8a5e446-6e3f-4c8c-b842-f800c1361957\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.390379 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qvkk5\" (UniqueName: \"kubernetes.io/projected/ef964d2a-6681-47c5-9a3b-29fe733ee9f0-kube-api-access-qvkk5\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.390397 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/fa4601ff-7ef6-4d2c-b0ca-b153763db12f-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.390411 5120 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/ef964d2a-6681-47c5-9a3b-29fe733ee9f0-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.390424 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/ef964d2a-6681-47c5-9a3b-29fe733ee9f0-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.390436 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ef964d2a-6681-47c5-9a3b-29fe733ee9f0-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.393872 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.405963 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.430275 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.439921 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.451656 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.460523 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.463038 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.463399 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-conductor-config-data\"" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.476310 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.490538 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.492388 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znqvf\" (UniqueName: \"kubernetes.io/projected/802ef826-c6e7-4a1c-90a6-b419b9489007-kube-api-access-znqvf\") pod \"nova-cell0-conductor-0\" (UID: \"802ef826-c6e7-4a1c-90a6-b419b9489007\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.492453 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/1c6098ab-3f23-46bd-95ff-94cf96b88f3f-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"1c6098ab-3f23-46bd-95ff-94cf96b88f3f\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.492529 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/d8a5e446-6e3f-4c8c-b842-f800c1361957-memcached-tls-certs\") pod \"memcached-0\" (UID: \"d8a5e446-6e3f-4c8c-b842-f800c1361957\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.492713 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/802ef826-c6e7-4a1c-90a6-b419b9489007-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"802ef826-c6e7-4a1c-90a6-b419b9489007\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.492751 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mz2pl\" (UniqueName: \"kubernetes.io/projected/1c6098ab-3f23-46bd-95ff-94cf96b88f3f-kube-api-access-mz2pl\") pod \"nova-cell1-novncproxy-0\" (UID: \"1c6098ab-3f23-46bd-95ff-94cf96b88f3f\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.492890 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1c6098ab-3f23-46bd-95ff-94cf96b88f3f-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"1c6098ab-3f23-46bd-95ff-94cf96b88f3f\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.492957 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/802ef826-c6e7-4a1c-90a6-b419b9489007-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"802ef826-c6e7-4a1c-90a6-b419b9489007\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.493047 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d8a5e446-6e3f-4c8c-b842-f800c1361957-combined-ca-bundle\") pod \"memcached-0\" (UID: \"d8a5e446-6e3f-4c8c-b842-f800c1361957\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.493089 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/1c6098ab-3f23-46bd-95ff-94cf96b88f3f-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"1c6098ab-3f23-46bd-95ff-94cf96b88f3f\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.498253 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/d8a5e446-6e3f-4c8c-b842-f800c1361957-config-data\") pod \"memcached-0\" (UID: \"d8a5e446-6e3f-4c8c-b842-f800c1361957\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.498554 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hnk6d\" (UniqueName: \"kubernetes.io/projected/d8a5e446-6e3f-4c8c-b842-f800c1361957-kube-api-access-hnk6d\") pod \"memcached-0\" (UID: \"d8a5e446-6e3f-4c8c-b842-f800c1361957\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.498634 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/d8a5e446-6e3f-4c8c-b842-f800c1361957-kolla-config\") pod \"memcached-0\" (UID: \"d8a5e446-6e3f-4c8c-b842-f800c1361957\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.498752 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1c6098ab-3f23-46bd-95ff-94cf96b88f3f-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"1c6098ab-3f23-46bd-95ff-94cf96b88f3f\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.500824 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d8a5e446-6e3f-4c8c-b842-f800c1361957-combined-ca-bundle\") pod \"memcached-0\" (UID: \"d8a5e446-6e3f-4c8c-b842-f800c1361957\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.500871 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/d8a5e446-6e3f-4c8c-b842-f800c1361957-config-data\") pod \"memcached-0\" (UID: \"d8a5e446-6e3f-4c8c-b842-f800c1361957\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.503611 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.504476 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/d8a5e446-6e3f-4c8c-b842-f800c1361957-kolla-config\") pod \"memcached-0\" (UID: \"d8a5e446-6e3f-4c8c-b842-f800c1361957\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.514612 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mz2pl\" (UniqueName: \"kubernetes.io/projected/1c6098ab-3f23-46bd-95ff-94cf96b88f3f-kube-api-access-mz2pl\") pod \"nova-cell1-novncproxy-0\" (UID: \"1c6098ab-3f23-46bd-95ff-94cf96b88f3f\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.514738 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/1c6098ab-3f23-46bd-95ff-94cf96b88f3f-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"1c6098ab-3f23-46bd-95ff-94cf96b88f3f\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.518431 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1c6098ab-3f23-46bd-95ff-94cf96b88f3f-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"1c6098ab-3f23-46bd-95ff-94cf96b88f3f\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.525072 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/d8a5e446-6e3f-4c8c-b842-f800c1361957-memcached-tls-certs\") pod \"memcached-0\" (UID: \"d8a5e446-6e3f-4c8c-b842-f800c1361957\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.525081 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/1c6098ab-3f23-46bd-95ff-94cf96b88f3f-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"1c6098ab-3f23-46bd-95ff-94cf96b88f3f\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.525372 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.525600 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1c6098ab-3f23-46bd-95ff-94cf96b88f3f-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"1c6098ab-3f23-46bd-95ff-94cf96b88f3f\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.525772 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.530316 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-public-svc\"" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.530451 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/979d8a07-391d-483c-92d1-bb2d256edf99-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "979d8a07-391d-483c-92d1-bb2d256edf99" (UID: "979d8a07-391d-483c-92d1-bb2d256edf99"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.530635 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-internal-svc\"" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.531157 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-config-data\"" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.534968 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hnk6d\" (UniqueName: \"kubernetes.io/projected/d8a5e446-6e3f-4c8c-b842-f800c1361957-kube-api-access-hnk6d\") pod \"memcached-0\" (UID: \"d8a5e446-6e3f-4c8c-b842-f800c1361957\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.538393 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.538531 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.538562 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.540894 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-conductor-config-data\"" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.546379 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.559363 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.567921 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-647f8b964-49qkc"] Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.583090 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-api-647f8b964-49qkc"] Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.596348 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.623098 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-znqvf\" (UniqueName: \"kubernetes.io/projected/802ef826-c6e7-4a1c-90a6-b419b9489007-kube-api-access-znqvf\") pod \"nova-cell0-conductor-0\" (UID: \"802ef826-c6e7-4a1c-90a6-b419b9489007\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.623624 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/67ab3338-c88c-4faf-8d25-809c92d661d9-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"67ab3338-c88c-4faf-8d25-809c92d661d9\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.624034 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/68500e27-b83c-4571-9082-33e4d4ea3daa-internal-tls-certs\") pod \"nova-api-0\" (UID: \"68500e27-b83c-4571-9082-33e4d4ea3daa\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.624090 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/802ef826-c6e7-4a1c-90a6-b419b9489007-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"802ef826-c6e7-4a1c-90a6-b419b9489007\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.624184 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/802ef826-c6e7-4a1c-90a6-b419b9489007-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"802ef826-c6e7-4a1c-90a6-b419b9489007\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.624243 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/68500e27-b83c-4571-9082-33e4d4ea3daa-logs\") pod \"nova-api-0\" (UID: \"68500e27-b83c-4571-9082-33e4d4ea3daa\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.624462 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/68500e27-b83c-4571-9082-33e4d4ea3daa-public-tls-certs\") pod \"nova-api-0\" (UID: \"68500e27-b83c-4571-9082-33e4d4ea3daa\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.624488 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/68500e27-b83c-4571-9082-33e4d4ea3daa-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"68500e27-b83c-4571-9082-33e4d4ea3daa\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.624545 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mh4hs\" (UniqueName: \"kubernetes.io/projected/68500e27-b83c-4571-9082-33e4d4ea3daa-kube-api-access-mh4hs\") pod \"nova-api-0\" (UID: \"68500e27-b83c-4571-9082-33e4d4ea3daa\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.624774 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/67ab3338-c88c-4faf-8d25-809c92d661d9-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"67ab3338-c88c-4faf-8d25-809c92d661d9\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.624868 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/68500e27-b83c-4571-9082-33e4d4ea3daa-config-data\") pod \"nova-api-0\" (UID: \"68500e27-b83c-4571-9082-33e4d4ea3daa\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.624982 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxvsk\" (UniqueName: \"kubernetes.io/projected/67ab3338-c88c-4faf-8d25-809c92d661d9-kube-api-access-kxvsk\") pod \"nova-cell1-conductor-0\" (UID: \"67ab3338-c88c-4faf-8d25-809c92d661d9\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.625886 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/979d8a07-391d-483c-92d1-bb2d256edf99-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.635436 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.639026 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-cell1-config-data\"" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.639136 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-cell1-scripts\"" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.639234 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"galera-openstack-cell1-dockercfg-hwhs2\"" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.639380 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-galera-openstack-cell1-svc\"" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.671605 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/802ef826-c6e7-4a1c-90a6-b419b9489007-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"802ef826-c6e7-4a1c-90a6-b419b9489007\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.671674 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/802ef826-c6e7-4a1c-90a6-b419b9489007-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"802ef826-c6e7-4a1c-90a6-b419b9489007\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.673220 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-znqvf\" (UniqueName: \"kubernetes.io/projected/802ef826-c6e7-4a1c-90a6-b419b9489007-kube-api-access-znqvf\") pod \"nova-cell0-conductor-0\" (UID: \"802ef826-c6e7-4a1c-90a6-b419b9489007\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.683732 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.692373 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-f67b885f6-v4nhp" event={"ID":"133b5e0f-d834-4c59-932f-957221e1727b","Type":"ContainerStarted","Data":"89ebfc1c06cbadb9219937f0542021b840f18635622aee652874850137fa54e4"} Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.692585 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-f67b885f6-v4nhp" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.692670 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-f67b885f6-v4nhp" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.692372 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-f67b885f6-v4nhp" podUID="133b5e0f-d834-4c59-932f-957221e1727b" containerName="barbican-api-log" containerID="cri-o://6a4358b64f103dd33cfb807556544a60eeb87db20e6bbca1f4c32c75f2b20ff2" gracePeriod=30 Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.692978 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-f67b885f6-v4nhp" podUID="133b5e0f-d834-4c59-932f-957221e1727b" containerName="barbican-api" containerID="cri-o://89ebfc1c06cbadb9219937f0542021b840f18635622aee652874850137fa54e4" gracePeriod=30 Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.701740 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-6cc74c8747-7pf27" event={"ID":"ae73ae1d-4056-43c2-addd-f08999a4a7f6","Type":"ContainerStarted","Data":"ff3433af2fccaf4d6c733f603683176d9fec5eff2b5c90677ad2990469736892"} Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.713619 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"ef964d2a-6681-47c5-9a3b-29fe733ee9f0","Type":"ContainerDied","Data":"2446250998c6c251636b6dd4e3ec6efc10eb71eb35137cd20d2e1249fc052665"} Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.713750 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.727784 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/68500e27-b83c-4571-9082-33e4d4ea3daa-config-data\") pod \"nova-api-0\" (UID: \"68500e27-b83c-4571-9082-33e4d4ea3daa\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.727826 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/04afe1ee-a37b-4e44-91b4-7e15170bb03c-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"04afe1ee-a37b-4e44-91b4-7e15170bb03c\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.727890 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/04afe1ee-a37b-4e44-91b4-7e15170bb03c-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"04afe1ee-a37b-4e44-91b4-7e15170bb03c\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.727916 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kxvsk\" (UniqueName: \"kubernetes.io/projected/67ab3338-c88c-4faf-8d25-809c92d661d9-kube-api-access-kxvsk\") pod \"nova-cell1-conductor-0\" (UID: \"67ab3338-c88c-4faf-8d25-809c92d661d9\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.727954 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/04afe1ee-a37b-4e44-91b4-7e15170bb03c-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"04afe1ee-a37b-4e44-91b4-7e15170bb03c\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.728004 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/04afe1ee-a37b-4e44-91b4-7e15170bb03c-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"04afe1ee-a37b-4e44-91b4-7e15170bb03c\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.728162 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/67ab3338-c88c-4faf-8d25-809c92d661d9-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"67ab3338-c88c-4faf-8d25-809c92d661d9\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.728224 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/68500e27-b83c-4571-9082-33e4d4ea3daa-internal-tls-certs\") pod \"nova-api-0\" (UID: \"68500e27-b83c-4571-9082-33e4d4ea3daa\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.728381 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/68500e27-b83c-4571-9082-33e4d4ea3daa-logs\") pod \"nova-api-0\" (UID: \"68500e27-b83c-4571-9082-33e4d4ea3daa\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.728465 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/04afe1ee-a37b-4e44-91b4-7e15170bb03c-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"04afe1ee-a37b-4e44-91b4-7e15170bb03c\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.728529 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6k26d\" (UniqueName: \"kubernetes.io/projected/04afe1ee-a37b-4e44-91b4-7e15170bb03c-kube-api-access-6k26d\") pod \"openstack-cell1-galera-0\" (UID: \"04afe1ee-a37b-4e44-91b4-7e15170bb03c\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.728618 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/68500e27-b83c-4571-9082-33e4d4ea3daa-public-tls-certs\") pod \"nova-api-0\" (UID: \"68500e27-b83c-4571-9082-33e4d4ea3daa\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.728646 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/68500e27-b83c-4571-9082-33e4d4ea3daa-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"68500e27-b83c-4571-9082-33e4d4ea3daa\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.728687 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/04afe1ee-a37b-4e44-91b4-7e15170bb03c-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"04afe1ee-a37b-4e44-91b4-7e15170bb03c\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.729611 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mh4hs\" (UniqueName: \"kubernetes.io/projected/68500e27-b83c-4571-9082-33e4d4ea3daa-kube-api-access-mh4hs\") pod \"nova-api-0\" (UID: \"68500e27-b83c-4571-9082-33e4d4ea3daa\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.731631 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/68500e27-b83c-4571-9082-33e4d4ea3daa-logs\") pod \"nova-api-0\" (UID: \"68500e27-b83c-4571-9082-33e4d4ea3daa\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.732214 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/67ab3338-c88c-4faf-8d25-809c92d661d9-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"67ab3338-c88c-4faf-8d25-809c92d661d9\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.732253 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") pod \"openstack-cell1-galera-0\" (UID: \"04afe1ee-a37b-4e44-91b4-7e15170bb03c\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.759126 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-f67b885f6-v4nhp" podUID="133b5e0f-d834-4c59-932f-957221e1727b" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.0.172:9311/healthcheck\": EOF" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.759498 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/68500e27-b83c-4571-9082-33e4d4ea3daa-internal-tls-certs\") pod \"nova-api-0\" (UID: \"68500e27-b83c-4571-9082-33e4d4ea3daa\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.762499 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/68500e27-b83c-4571-9082-33e4d4ea3daa-config-data\") pod \"nova-api-0\" (UID: \"68500e27-b83c-4571-9082-33e4d4ea3daa\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.768614 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxvsk\" (UniqueName: \"kubernetes.io/projected/67ab3338-c88c-4faf-8d25-809c92d661d9-kube-api-access-kxvsk\") pod \"nova-cell1-conductor-0\" (UID: \"67ab3338-c88c-4faf-8d25-809c92d661d9\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.772463 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-9t866" event={"ID":"e7bf94ef-c84b-45ee-a2d9-dd048b1172e3","Type":"ContainerStarted","Data":"8181605dced90e54e79d2fb8146ad7ccea5081877322f388ef0f78faeeb0c001"} Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.773194 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/68500e27-b83c-4571-9082-33e4d4ea3daa-public-tls-certs\") pod \"nova-api-0\" (UID: \"68500e27-b83c-4571-9082-33e4d4ea3daa\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.790000 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/68500e27-b83c-4571-9082-33e4d4ea3daa-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"68500e27-b83c-4571-9082-33e4d4ea3daa\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.790008 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/67ab3338-c88c-4faf-8d25-809c92d661d9-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"67ab3338-c88c-4faf-8d25-809c92d661d9\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.789985 5120 generic.go:358] "Generic (PLEG): container finished" podID="9fab4617-1011-48f5-90ae-5415fd9b91b4" containerID="6d2b0330b2064662c772ad1e4e9e348aa9c96a000542503ed0720adf02860f5f" exitCode=143 Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.790100 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-88757f4fd-w4kvr" event={"ID":"9fab4617-1011-48f5-90ae-5415fd9b91b4","Type":"ContainerDied","Data":"6d2b0330b2064662c772ad1e4e9e348aa9c96a000542503ed0720adf02860f5f"} Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.792021 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/67ab3338-c88c-4faf-8d25-809c92d661d9-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"67ab3338-c88c-4faf-8d25-809c92d661d9\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.801629 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mh4hs\" (UniqueName: \"kubernetes.io/projected/68500e27-b83c-4571-9082-33e4d4ea3daa-kube-api-access-mh4hs\") pod \"nova-api-0\" (UID: \"68500e27-b83c-4571-9082-33e4d4ea3daa\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.816958 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"b609e161-5c22-4699-9af9-7f972834422a","Type":"ContainerStarted","Data":"22238b276b76d861d77fc31af6bce9e01d1c0750ab88ee13081b94e698df6c71"} Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.817201 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="b609e161-5c22-4699-9af9-7f972834422a" containerName="glance-log" containerID="cri-o://1c97e604f52abab9a8e368bf807db43802deda778f7fb4d78b276c6e7c88807b" gracePeriod=30 Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.818937 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-api-f67b885f6-v4nhp" podStartSLOduration=13.818915728 podStartE2EDuration="13.818915728s" podCreationTimestamp="2026-03-16 16:53:12 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:53:25.713683277 +0000 UTC m=+4907.867614934" watchObservedRunningTime="2026-03-16 16:53:25.818915728 +0000 UTC m=+4907.972847385" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.819204 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="b609e161-5c22-4699-9af9-7f972834422a" containerName="glance-httpd" containerID="cri-o://22238b276b76d861d77fc31af6bce9e01d1c0750ab88ee13081b94e698df6c71" gracePeriod=30 Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.834913 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/04afe1ee-a37b-4e44-91b4-7e15170bb03c-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"04afe1ee-a37b-4e44-91b4-7e15170bb03c\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.835630 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6k26d\" (UniqueName: \"kubernetes.io/projected/04afe1ee-a37b-4e44-91b4-7e15170bb03c-kube-api-access-6k26d\") pod \"openstack-cell1-galera-0\" (UID: \"04afe1ee-a37b-4e44-91b4-7e15170bb03c\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.836493 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/04afe1ee-a37b-4e44-91b4-7e15170bb03c-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"04afe1ee-a37b-4e44-91b4-7e15170bb03c\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.837365 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") pod \"openstack-cell1-galera-0\" (UID: \"04afe1ee-a37b-4e44-91b4-7e15170bb03c\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.837572 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/04afe1ee-a37b-4e44-91b4-7e15170bb03c-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"04afe1ee-a37b-4e44-91b4-7e15170bb03c\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.837730 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/04afe1ee-a37b-4e44-91b4-7e15170bb03c-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"04afe1ee-a37b-4e44-91b4-7e15170bb03c\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.839922 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/04afe1ee-a37b-4e44-91b4-7e15170bb03c-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"04afe1ee-a37b-4e44-91b4-7e15170bb03c\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.843191 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") pod \"openstack-cell1-galera-0\" (UID: \"04afe1ee-a37b-4e44-91b4-7e15170bb03c\") device mount path \"/mnt/openstack/pv14\"" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.852681 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/04afe1ee-a37b-4e44-91b4-7e15170bb03c-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"04afe1ee-a37b-4e44-91b4-7e15170bb03c\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.837292 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/04afe1ee-a37b-4e44-91b4-7e15170bb03c-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"04afe1ee-a37b-4e44-91b4-7e15170bb03c\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.834973 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"a93918e6-bb45-4717-afef-978bad1c6612","Type":"ContainerDied","Data":"c4ab091d8190ff59f9706a7d7cca32fb7f33c854698ff5d165f5eb3990ee009d"} Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.843466 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/04afe1ee-a37b-4e44-91b4-7e15170bb03c-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"04afe1ee-a37b-4e44-91b4-7e15170bb03c\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.851719 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/04afe1ee-a37b-4e44-91b4-7e15170bb03c-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"04afe1ee-a37b-4e44-91b4-7e15170bb03c\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.854017 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/04afe1ee-a37b-4e44-91b4-7e15170bb03c-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"04afe1ee-a37b-4e44-91b4-7e15170bb03c\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.834933 5120 generic.go:358] "Generic (PLEG): container finished" podID="a93918e6-bb45-4717-afef-978bad1c6612" containerID="c4ab091d8190ff59f9706a7d7cca32fb7f33c854698ff5d165f5eb3990ee009d" exitCode=0 Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.860169 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/04afe1ee-a37b-4e44-91b4-7e15170bb03c-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"04afe1ee-a37b-4e44-91b4-7e15170bb03c\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.861453 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.861946 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.863715 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-worker-6cc74c8747-7pf27" podStartSLOduration=11.863702114 podStartE2EDuration="11.863702114s" podCreationTimestamp="2026-03-16 16:53:14 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:53:25.735446563 +0000 UTC m=+4907.889378220" watchObservedRunningTime="2026-03-16 16:53:25.863702114 +0000 UTC m=+4908.017633771" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.867107 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"3267cb77-9a07-4d71-aaa4-e1e5e033a70d","Type":"ContainerStarted","Data":"d2a42d62f2fd2ddd455e436e93a4ce325a2404cdfb467be37ed3b03b99074a8c"} Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.867285 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="3267cb77-9a07-4d71-aaa4-e1e5e033a70d" containerName="glance-log" containerID="cri-o://ced459ec8d89e143997a50be3ffdcebfc98c9c89a44dec96cc00f40ef7252e43" gracePeriod=30 Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.867376 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="3267cb77-9a07-4d71-aaa4-e1e5e033a70d" containerName="glance-httpd" containerID="cri-o://d2a42d62f2fd2ddd455e436e93a4ce325a2404cdfb467be37ed3b03b99074a8c" gracePeriod=30 Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.880285 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-78dc5f4cb-mjvvc" event={"ID":"152925c6-48ae-4e8d-9a3f-68f01278fe95","Type":"ContainerStarted","Data":"f3ed28bfae2057c9814ffe1a00568ad048a0121320ce65449ff7b08c5990b871"} Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.891292 5120 generic.go:358] "Generic (PLEG): container finished" podID="cb10ccc3-03fc-4eb7-a637-c2bc721a9b69" containerID="3ad9955eddb7852d5f0975d31c5bd54aa679fe305e10f6e084c39ef302c2e59b" exitCode=143 Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.891411 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-ccc65f956-nsglj" event={"ID":"cb10ccc3-03fc-4eb7-a637-c2bc721a9b69","Type":"ContainerDied","Data":"3ad9955eddb7852d5f0975d31c5bd54aa679fe305e10f6e084c39ef302c2e59b"} Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.899310 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-7f78b864cb-6dgjh" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.900013 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-6d764c69b8-sv9d2" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.900318 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-646d48c554-kk5ms" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.900406 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6k26d\" (UniqueName: \"kubernetes.io/projected/04afe1ee-a37b-4e44-91b4-7e15170bb03c-kube-api-access-6k26d\") pod \"openstack-cell1-galera-0\" (UID: \"04afe1ee-a37b-4e44-91b4-7e15170bb03c\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.900545 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-584b8687b4-5c6lr" event={"ID":"cc4853a6-faf5-45dc-b6f4-aa0b65d0ca8d","Type":"ContainerStarted","Data":"e7b8cd725c509e7d568b9e3c1a5c9d000af853272261e60080aa852dbfe7cd70"} Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.900752 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-584b8687b4-5c6lr" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.900800 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-584b8687b4-5c6lr" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.905516 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/04afe1ee-a37b-4e44-91b4-7e15170bb03c-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"04afe1ee-a37b-4e44-91b4-7e15170bb03c\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.905588 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-5f687f46f5-qdrk5"] Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.905977 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-5f687f46f5-qdrk5" podUID="a5396fe3-454e-4707-b185-5ad652c091da" containerName="barbican-worker-log" containerID="cri-o://d527d53f1efda798a88fbbb030e0328a56d2926e6ca6e2916bd72f1280b74ff3" gracePeriod=30 Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.906030 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-5f687f46f5-qdrk5" podUID="a5396fe3-454e-4707-b185-5ad652c091da" containerName="barbican-worker" containerID="cri-o://316ceb783284a9aa1a89110aa909af4bccff62799441dd3c5d0c4df5b0b80c62" gracePeriod=30 Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.907043 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/certified-operators-9t866" podStartSLOduration=13.535028681 podStartE2EDuration="22.907027429s" podCreationTimestamp="2026-03-16 16:53:03 +0000 UTC" firstStartedPulling="2026-03-16 16:53:08.998532202 +0000 UTC m=+4891.152463859" lastFinishedPulling="2026-03-16 16:53:18.37053096 +0000 UTC m=+4900.524462607" observedRunningTime="2026-03-16 16:53:25.804037461 +0000 UTC m=+4907.957969118" watchObservedRunningTime="2026-03-16 16:53:25.907027429 +0000 UTC m=+4908.060959086" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.947009 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-external-api-0" podStartSLOduration=14.946987603 podStartE2EDuration="14.946987603s" podCreationTimestamp="2026-03-16 16:53:11 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:53:25.853878574 +0000 UTC m=+4908.007810231" watchObservedRunningTime="2026-03-16 16:53:25.946987603 +0000 UTC m=+4908.100919260" Mar 16 16:53:25 crc kubenswrapper[5120]: I0316 16:53:25.963967 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-internal-api-0" podStartSLOduration=14.963944547 podStartE2EDuration="14.963944547s" podCreationTimestamp="2026-03-16 16:53:11 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:53:25.917563458 +0000 UTC m=+4908.071495125" watchObservedRunningTime="2026-03-16 16:53:25.963944547 +0000 UTC m=+4908.117876204" Mar 16 16:53:26 crc kubenswrapper[5120]: I0316 16:53:26.001104 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-584b8687b4-5c6lr" podStartSLOduration=12.001082344 podStartE2EDuration="12.001082344s" podCreationTimestamp="2026-03-16 16:53:14 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:53:25.968361988 +0000 UTC m=+4908.122293665" watchObservedRunningTime="2026-03-16 16:53:26.001082344 +0000 UTC m=+4908.155014011" Mar 16 16:53:26 crc kubenswrapper[5120]: I0316 16:53:26.035256 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa4601ff-7ef6-4d2c-b0ca-b153763db12f-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "fa4601ff-7ef6-4d2c-b0ca-b153763db12f" (UID: "fa4601ff-7ef6-4d2c-b0ca-b153763db12f"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:26 crc kubenswrapper[5120]: I0316 16:53:26.061363 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fa4601ff-7ef6-4d2c-b0ca-b153763db12f-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:26 crc kubenswrapper[5120]: I0316 16:53:26.165873 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/979d8a07-391d-483c-92d1-bb2d256edf99-config-data" (OuterVolumeSpecName: "config-data") pod "979d8a07-391d-483c-92d1-bb2d256edf99" (UID: "979d8a07-391d-483c-92d1-bb2d256edf99"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:26 crc kubenswrapper[5120]: I0316 16:53:26.169075 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/979d8a07-391d-483c-92d1-bb2d256edf99-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:26 crc kubenswrapper[5120]: I0316 16:53:26.369932 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/memcached-0" podUID="5e1c9d08-874f-40cb-9837-5cfd2509c352" containerName="memcached" probeResult="failure" output="dial tcp 10.217.0.159:11211: i/o timeout" Mar 16 16:53:26 crc kubenswrapper[5120]: I0316 16:53:26.371612 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c06f24f9-95b0-4a92-ad3a-6075764151ed-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "c06f24f9-95b0-4a92-ad3a-6075764151ed" (UID: "c06f24f9-95b0-4a92-ad3a-6075764151ed"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:26 crc kubenswrapper[5120]: I0316 16:53:26.376594 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c06f24f9-95b0-4a92-ad3a-6075764151ed-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:26 crc kubenswrapper[5120]: I0316 16:53:26.499368 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef964d2a-6681-47c5-9a3b-29fe733ee9f0-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ef964d2a-6681-47c5-9a3b-29fe733ee9f0" (UID: "ef964d2a-6681-47c5-9a3b-29fe733ee9f0"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:26 crc kubenswrapper[5120]: I0316 16:53:26.592840 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ef964d2a-6681-47c5-9a3b-29fe733ee9f0-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:26 crc kubenswrapper[5120]: I0316 16:53:26.612026 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/979d8a07-391d-483c-92d1-bb2d256edf99-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "979d8a07-391d-483c-92d1-bb2d256edf99" (UID: "979d8a07-391d-483c-92d1-bb2d256edf99"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:26 crc kubenswrapper[5120]: I0316 16:53:26.681468 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="07523c84-c61c-42f5-9282-324e6cc37cf7" path="/var/lib/kubelet/pods/07523c84-c61c-42f5-9282-324e6cc37cf7/volumes" Mar 16 16:53:26 crc kubenswrapper[5120]: I0316 16:53:26.682044 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5e1c9d08-874f-40cb-9837-5cfd2509c352" path="/var/lib/kubelet/pods/5e1c9d08-874f-40cb-9837-5cfd2509c352/volumes" Mar 16 16:53:26 crc kubenswrapper[5120]: I0316 16:53:26.682525 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c42ca14-5afb-4688-a2cf-ddf314020f18" path="/var/lib/kubelet/pods/9c42ca14-5afb-4688-a2cf-ddf314020f18/volumes" Mar 16 16:53:26 crc kubenswrapper[5120]: I0316 16:53:26.687206 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a5d3f7a6-64f6-47f9-a144-41a356078e4b" path="/var/lib/kubelet/pods/a5d3f7a6-64f6-47f9-a144-41a356078e4b/volumes" Mar 16 16:53:26 crc kubenswrapper[5120]: I0316 16:53:26.688289 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bd162855-8210-41c5-9494-15a62edf991c" path="/var/lib/kubelet/pods/bd162855-8210-41c5-9494-15a62edf991c/volumes" Mar 16 16:53:26 crc kubenswrapper[5120]: I0316 16:53:26.688995 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d6db354d-c48c-4497-a289-18edadffce47" path="/var/lib/kubelet/pods/d6db354d-c48c-4497-a289-18edadffce47/volumes" Mar 16 16:53:26 crc kubenswrapper[5120]: I0316 16:53:26.690083 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dda14ac9-f9b1-4927-a4a4-147c5435906c" path="/var/lib/kubelet/pods/dda14ac9-f9b1-4927-a4a4-147c5435906c/volumes" Mar 16 16:53:26 crc kubenswrapper[5120]: I0316 16:53:26.690907 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e5c498e5-584c-4cdd-b008-c643b7bb1bc5" path="/var/lib/kubelet/pods/e5c498e5-584c-4cdd-b008-c643b7bb1bc5/volumes" Mar 16 16:53:26 crc kubenswrapper[5120]: I0316 16:53:26.695735 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/979d8a07-391d-483c-92d1-bb2d256edf99-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:26 crc kubenswrapper[5120]: I0316 16:53:26.834058 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c06f24f9-95b0-4a92-ad3a-6075764151ed-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "c06f24f9-95b0-4a92-ad3a-6075764151ed" (UID: "c06f24f9-95b0-4a92-ad3a-6075764151ed"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:26 crc kubenswrapper[5120]: I0316 16:53:26.908073 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") pod \"openstack-cell1-galera-0\" (UID: \"04afe1ee-a37b-4e44-91b4-7e15170bb03c\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:53:26 crc kubenswrapper[5120]: I0316 16:53:26.917563 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/c06f24f9-95b0-4a92-ad3a-6075764151ed-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:26 crc kubenswrapper[5120]: I0316 16:53:26.937933 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c06f24f9-95b0-4a92-ad3a-6075764151ed-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "c06f24f9-95b0-4a92-ad3a-6075764151ed" (UID: "c06f24f9-95b0-4a92-ad3a-6075764151ed"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:26 crc kubenswrapper[5120]: I0316 16:53:26.952124 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa4601ff-7ef6-4d2c-b0ca-b153763db12f-config-data" (OuterVolumeSpecName: "config-data") pod "fa4601ff-7ef6-4d2c-b0ca-b153763db12f" (UID: "fa4601ff-7ef6-4d2c-b0ca-b153763db12f"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:26 crc kubenswrapper[5120]: I0316 16:53:26.976970 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef964d2a-6681-47c5-9a3b-29fe733ee9f0-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "ef964d2a-6681-47c5-9a3b-29fe733ee9f0" (UID: "ef964d2a-6681-47c5-9a3b-29fe733ee9f0"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:26 crc kubenswrapper[5120]: I0316 16:53:26.982960 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/979d8a07-391d-483c-92d1-bb2d256edf99-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "979d8a07-391d-483c-92d1-bb2d256edf99" (UID: "979d8a07-391d-483c-92d1-bb2d256edf99"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:26 crc kubenswrapper[5120]: I0316 16:53:26.983061 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef964d2a-6681-47c5-9a3b-29fe733ee9f0-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "ef964d2a-6681-47c5-9a3b-29fe733ee9f0" (UID: "ef964d2a-6681-47c5-9a3b-29fe733ee9f0"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:27 crc kubenswrapper[5120]: I0316 16:53:27.050917 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef964d2a-6681-47c5-9a3b-29fe733ee9f0-config-data" (OuterVolumeSpecName: "config-data") pod "ef964d2a-6681-47c5-9a3b-29fe733ee9f0" (UID: "ef964d2a-6681-47c5-9a3b-29fe733ee9f0"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:27 crc kubenswrapper[5120]: I0316 16:53:27.103889 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ef964d2a-6681-47c5-9a3b-29fe733ee9f0-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:27 crc kubenswrapper[5120]: I0316 16:53:27.103933 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ef964d2a-6681-47c5-9a3b-29fe733ee9f0-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:27 crc kubenswrapper[5120]: I0316 16:53:27.103951 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/979d8a07-391d-483c-92d1-bb2d256edf99-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:27 crc kubenswrapper[5120]: I0316 16:53:27.103969 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/ef964d2a-6681-47c5-9a3b-29fe733ee9f0-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:27 crc kubenswrapper[5120]: I0316 16:53:27.103984 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fa4601ff-7ef6-4d2c-b0ca-b153763db12f-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:27 crc kubenswrapper[5120]: I0316 16:53:27.103996 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/c06f24f9-95b0-4a92-ad3a-6075764151ed-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:27 crc kubenswrapper[5120]: I0316 16:53:27.116473 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c06f24f9-95b0-4a92-ad3a-6075764151ed-config-data" (OuterVolumeSpecName: "config-data") pod "c06f24f9-95b0-4a92-ad3a-6075764151ed" (UID: "c06f24f9-95b0-4a92-ad3a-6075764151ed"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:27 crc kubenswrapper[5120]: I0316 16:53:27.121902 5120 generic.go:358] "Generic (PLEG): container finished" podID="a5396fe3-454e-4707-b185-5ad652c091da" containerID="d527d53f1efda798a88fbbb030e0328a56d2926e6ca6e2916bd72f1280b74ff3" exitCode=143 Mar 16 16:53:27 crc kubenswrapper[5120]: I0316 16:53:27.147719 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-keystone-listener-788658cdb6-tsr2b" podStartSLOduration=13.147695328 podStartE2EDuration="13.147695328s" podCreationTimestamp="2026-03-16 16:53:14 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:53:27.132367948 +0000 UTC m=+4909.286299615" watchObservedRunningTime="2026-03-16 16:53:27.147695328 +0000 UTC m=+4909.301626985" Mar 16 16:53:27 crc kubenswrapper[5120]: I0316 16:53:27.160963 5120 generic.go:358] "Generic (PLEG): container finished" podID="133b5e0f-d834-4c59-932f-957221e1727b" containerID="6a4358b64f103dd33cfb807556544a60eeb87db20e6bbca1f4c32c75f2b20ff2" exitCode=143 Mar 16 16:53:27 crc kubenswrapper[5120]: I0316 16:53:27.205471 5120 generic.go:358] "Generic (PLEG): container finished" podID="b609e161-5c22-4699-9af9-7f972834422a" containerID="22238b276b76d861d77fc31af6bce9e01d1c0750ab88ee13081b94e698df6c71" exitCode=143 Mar 16 16:53:27 crc kubenswrapper[5120]: I0316 16:53:27.205500 5120 generic.go:358] "Generic (PLEG): container finished" podID="b609e161-5c22-4699-9af9-7f972834422a" containerID="1c97e604f52abab9a8e368bf807db43802deda778f7fb4d78b276c6e7c88807b" exitCode=143 Mar 16 16:53:27 crc kubenswrapper[5120]: I0316 16:53:27.231489 5120 generic.go:358] "Generic (PLEG): container finished" podID="3267cb77-9a07-4d71-aaa4-e1e5e033a70d" containerID="d2a42d62f2fd2ddd455e436e93a4ce325a2404cdfb467be37ed3b03b99074a8c" exitCode=143 Mar 16 16:53:27 crc kubenswrapper[5120]: I0316 16:53:27.231730 5120 generic.go:358] "Generic (PLEG): container finished" podID="3267cb77-9a07-4d71-aaa4-e1e5e033a70d" containerID="ced459ec8d89e143997a50be3ffdcebfc98c9c89a44dec96cc00f40ef7252e43" exitCode=143 Mar 16 16:53:27 crc kubenswrapper[5120]: I0316 16:53:27.234416 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-7b9f48f6c8-rfj5g" podStartSLOduration=11.23439574 podStartE2EDuration="11.23439574s" podCreationTimestamp="2026-03-16 16:53:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:53:27.161780423 +0000 UTC m=+4909.315712100" watchObservedRunningTime="2026-03-16 16:53:27.23439574 +0000 UTC m=+4909.388327397" Mar 16 16:53:27 crc kubenswrapper[5120]: I0316 16:53:27.252857 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c06f24f9-95b0-4a92-ad3a-6075764151ed-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:27 crc kubenswrapper[5120]: I0316 16:53:27.427433 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-api-78dc5f4cb-mjvvc" podStartSLOduration=13.427410003 podStartE2EDuration="13.427410003s" podCreationTimestamp="2026-03-16 16:53:14 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:53:27.396116067 +0000 UTC m=+4909.550047724" watchObservedRunningTime="2026-03-16 16:53:27.427410003 +0000 UTC m=+4909.581341660" Mar 16 16:53:27 crc kubenswrapper[5120]: I0316 16:53:27.572826 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-788658cdb6-tsr2b" event={"ID":"472a9d94-a155-4916-aab9-4672a3c6c18c","Type":"ContainerStarted","Data":"17db717294296e1c93dabaa603512092c1b984d81ce2823579d06813201a2e33"} Mar 16 16:53:27 crc kubenswrapper[5120]: I0316 16:53:27.572907 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/neutron-7b9f48f6c8-rfj5g" Mar 16 16:53:27 crc kubenswrapper[5120]: I0316 16:53:27.572927 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-7b9f48f6c8-rfj5g" event={"ID":"eb34a81f-663e-4027-bf2c-1d334bd06ba4","Type":"ContainerStarted","Data":"5b230d20ea9d3d7833b271ff1a44a747ee3470f18fe1db783899778d4c9cb191"} Mar 16 16:53:27 crc kubenswrapper[5120]: I0316 16:53:27.573031 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-786c646546-49lhr"] Mar 16 16:53:27 crc kubenswrapper[5120]: I0316 16:53:27.573057 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-78dc5f4cb-mjvvc" Mar 16 16:53:27 crc kubenswrapper[5120]: I0316 16:53:27.573072 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-5f687f46f5-qdrk5" event={"ID":"a5396fe3-454e-4707-b185-5ad652c091da","Type":"ContainerDied","Data":"d527d53f1efda798a88fbbb030e0328a56d2926e6ca6e2916bd72f1280b74ff3"} Mar 16 16:53:27 crc kubenswrapper[5120]: I0316 16:53:27.573100 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-78dc5f4cb-mjvvc" Mar 16 16:53:27 crc kubenswrapper[5120]: I0316 16:53:27.573113 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-f67b885f6-v4nhp" event={"ID":"133b5e0f-d834-4c59-932f-957221e1727b","Type":"ContainerDied","Data":"6a4358b64f103dd33cfb807556544a60eeb87db20e6bbca1f4c32c75f2b20ff2"} Mar 16 16:53:27 crc kubenswrapper[5120]: I0316 16:53:27.573135 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"9fb3c077-55b7-4693-af84-b981deb240da","Type":"ContainerStarted","Data":"3ebb910b29446c7039a58d1fdfdb5ea8086cba8a3142a7103f3e20e30f3c7f4e"} Mar 16 16:53:27 crc kubenswrapper[5120]: I0316 16:53:27.573150 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"b609e161-5c22-4699-9af9-7f972834422a","Type":"ContainerDied","Data":"22238b276b76d861d77fc31af6bce9e01d1c0750ab88ee13081b94e698df6c71"} Mar 16 16:53:27 crc kubenswrapper[5120]: I0316 16:53:27.573167 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"b609e161-5c22-4699-9af9-7f972834422a","Type":"ContainerDied","Data":"1c97e604f52abab9a8e368bf807db43802deda778f7fb4d78b276c6e7c88807b"} Mar 16 16:53:27 crc kubenswrapper[5120]: I0316 16:53:27.573180 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"3267cb77-9a07-4d71-aaa4-e1e5e033a70d","Type":"ContainerDied","Data":"d2a42d62f2fd2ddd455e436e93a4ce325a2404cdfb467be37ed3b03b99074a8c"} Mar 16 16:53:27 crc kubenswrapper[5120]: I0316 16:53:27.573196 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"3267cb77-9a07-4d71-aaa4-e1e5e033a70d","Type":"ContainerDied","Data":"ced459ec8d89e143997a50be3ffdcebfc98c9c89a44dec96cc00f40ef7252e43"} Mar 16 16:53:27 crc kubenswrapper[5120]: I0316 16:53:27.573212 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"b3ff7a5c-9d60-4d20-9308-0b7d88d605f6","Type":"ContainerStarted","Data":"76c5f5136097b2b8e13a204ec73f3c4bfff9a3caf4e6a7039b057c002d9745c3"} Mar 16 16:53:27 crc kubenswrapper[5120]: I0316 16:53:27.579093 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-786c646546-49lhr" podUID="a7564ece-3e31-426b-a07b-1b9e12d76d01" containerName="barbican-keystone-listener-log" containerID="cri-o://a925b16bc707dd1b850ad386d8896edc36bd1221a6b55a9c743fc74aaec36eec" gracePeriod=30 Mar 16 16:53:27 crc kubenswrapper[5120]: I0316 16:53:27.579792 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-786c646546-49lhr" podUID="a7564ece-3e31-426b-a07b-1b9e12d76d01" containerName="barbican-keystone-listener" containerID="cri-o://90fa913e82e6a693d89c84435eb04f963c4d8b4c4ab762c7bcba095c8c48203e" gracePeriod=30 Mar 16 16:53:27 crc kubenswrapper[5120]: I0316 16:53:27.624856 5120 scope.go:117] "RemoveContainer" containerID="1dbf24b95c7a96d399be4139efd5db0f1cb6a5b7e36d9f234f65251fcfc81330" Mar 16 16:53:27 crc kubenswrapper[5120]: I0316 16:53:27.793058 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="b91a9930-eec4-4af5-9aee-5d02dc78fabc" containerName="cinder-scheduler" probeResult="failure" output="Get \"http://10.217.0.137:8080/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 16:53:27 crc kubenswrapper[5120]: I0316 16:53:27.921970 5120 scope.go:117] "RemoveContainer" containerID="92292c523d4b4d250cef5eb000fa5d04e4e544218bdca4cbd993e7670963057a" Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.025165 5120 scope.go:117] "RemoveContainer" containerID="97576e939ebce6bd9c9a57e020240747714a03086d075e2f102f522a8e9ab0ec" Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.042387 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.057208 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.075331 5120 scope.go:117] "RemoveContainer" containerID="a7a968e6d8db4b5312cb444cbccadb44d543d993578f1d5780def2a96ed57633" Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.080437 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-7bf49bf568-fbg2k"] Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.097824 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-api-7bf49bf568-fbg2k"] Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.118558 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.171728 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.173941 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.174999 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.177927 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.189978 5120 scope.go:117] "RemoveContainer" containerID="d7eef0307a62d5623eb48d8b895afed500f513ef1cfb23d17e6dc940cf05613f" Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.190121 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.211795 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-6d764c69b8-sv9d2"] Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.211837 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-6d764c69b8-sv9d2"] Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.211864 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.211974 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.214100 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-cinder-public-svc\"" Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.214745 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-cinder-internal-svc\"" Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.214779 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-api-config-data\"" Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.237059 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.247844 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-646d48c554-kk5ms"] Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.251771 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.262412 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-646d48c554-kk5ms"] Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.311443 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f4cbd2d6-e498-42bf-a100-bc0c6664e7ed-scripts\") pod \"cinder-api-0\" (UID: \"f4cbd2d6-e498-42bf-a100-bc0c6664e7ed\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.311999 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f4cbd2d6-e498-42bf-a100-bc0c6664e7ed-config-data\") pod \"cinder-api-0\" (UID: \"f4cbd2d6-e498-42bf-a100-bc0c6664e7ed\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.312981 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f4cbd2d6-e498-42bf-a100-bc0c6664e7ed-public-tls-certs\") pod \"cinder-api-0\" (UID: \"f4cbd2d6-e498-42bf-a100-bc0c6664e7ed\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.313098 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f4cbd2d6-e498-42bf-a100-bc0c6664e7ed-logs\") pod \"cinder-api-0\" (UID: \"f4cbd2d6-e498-42bf-a100-bc0c6664e7ed\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.313598 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f4cbd2d6-e498-42bf-a100-bc0c6664e7ed-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"f4cbd2d6-e498-42bf-a100-bc0c6664e7ed\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.317882 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvb26\" (UniqueName: \"kubernetes.io/projected/f4cbd2d6-e498-42bf-a100-bc0c6664e7ed-kube-api-access-qvb26\") pod \"cinder-api-0\" (UID: \"f4cbd2d6-e498-42bf-a100-bc0c6664e7ed\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.318149 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/f4cbd2d6-e498-42bf-a100-bc0c6664e7ed-config-data-custom\") pod \"cinder-api-0\" (UID: \"f4cbd2d6-e498-42bf-a100-bc0c6664e7ed\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.318428 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f4cbd2d6-e498-42bf-a100-bc0c6664e7ed-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"f4cbd2d6-e498-42bf-a100-bc0c6664e7ed\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.322116 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/f4cbd2d6-e498-42bf-a100-bc0c6664e7ed-etc-machine-id\") pod \"cinder-api-0\" (UID: \"f4cbd2d6-e498-42bf-a100-bc0c6664e7ed\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.335413 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.338131 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-7f77bff94b-c5ng2" Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.349641 5120 scope.go:117] "RemoveContainer" containerID="26bcb4771703f1b3befddf195c3f98963f2607b7b970751d8c680b603c3f68e7" Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.400912 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"b609e161-5c22-4699-9af9-7f972834422a","Type":"ContainerDied","Data":"ef05364b41a708623dbcdc6a42b0aad4de2efb624ee23dae0425b96da450d25a"} Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.401413 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.422126 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"a93918e6-bb45-4717-afef-978bad1c6612","Type":"ContainerStarted","Data":"436905bb29734cdaa5e693050d9fc764430449da20ac2627aebe69b1b8caf0f5"} Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.424106 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b609e161-5c22-4699-9af9-7f972834422a-combined-ca-bundle\") pod \"b609e161-5c22-4699-9af9-7f972834422a\" (UID: \"b609e161-5c22-4699-9af9-7f972834422a\") " Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.424198 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/b609e161-5c22-4699-9af9-7f972834422a-httpd-run\") pod \"b609e161-5c22-4699-9af9-7f972834422a\" (UID: \"b609e161-5c22-4699-9af9-7f972834422a\") " Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.424297 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b609e161-5c22-4699-9af9-7f972834422a-logs\") pod \"b609e161-5c22-4699-9af9-7f972834422a\" (UID: \"b609e161-5c22-4699-9af9-7f972834422a\") " Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.424418 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/b609e161-5c22-4699-9af9-7f972834422a-public-tls-certs\") pod \"b609e161-5c22-4699-9af9-7f972834422a\" (UID: \"b609e161-5c22-4699-9af9-7f972834422a\") " Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.424582 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jc8qg\" (UniqueName: \"kubernetes.io/projected/b609e161-5c22-4699-9af9-7f972834422a-kube-api-access-jc8qg\") pod \"b609e161-5c22-4699-9af9-7f972834422a\" (UID: \"b609e161-5c22-4699-9af9-7f972834422a\") " Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.424644 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b609e161-5c22-4699-9af9-7f972834422a-config-data\") pod \"b609e161-5c22-4699-9af9-7f972834422a\" (UID: \"b609e161-5c22-4699-9af9-7f972834422a\") " Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.425254 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b609e161-5c22-4699-9af9-7f972834422a-scripts\") pod \"b609e161-5c22-4699-9af9-7f972834422a\" (UID: \"b609e161-5c22-4699-9af9-7f972834422a\") " Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.425429 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"b609e161-5c22-4699-9af9-7f972834422a\" (UID: \"b609e161-5c22-4699-9af9-7f972834422a\") " Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.435282 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b609e161-5c22-4699-9af9-7f972834422a-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "b609e161-5c22-4699-9af9-7f972834422a" (UID: "b609e161-5c22-4699-9af9-7f972834422a"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.439572 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f4cbd2d6-e498-42bf-a100-bc0c6664e7ed-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"f4cbd2d6-e498-42bf-a100-bc0c6664e7ed\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.439745 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qvb26\" (UniqueName: \"kubernetes.io/projected/f4cbd2d6-e498-42bf-a100-bc0c6664e7ed-kube-api-access-qvb26\") pod \"cinder-api-0\" (UID: \"f4cbd2d6-e498-42bf-a100-bc0c6664e7ed\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.439822 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/f4cbd2d6-e498-42bf-a100-bc0c6664e7ed-config-data-custom\") pod \"cinder-api-0\" (UID: \"f4cbd2d6-e498-42bf-a100-bc0c6664e7ed\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.440056 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f4cbd2d6-e498-42bf-a100-bc0c6664e7ed-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"f4cbd2d6-e498-42bf-a100-bc0c6664e7ed\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.440189 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/f4cbd2d6-e498-42bf-a100-bc0c6664e7ed-etc-machine-id\") pod \"cinder-api-0\" (UID: \"f4cbd2d6-e498-42bf-a100-bc0c6664e7ed\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.440345 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f4cbd2d6-e498-42bf-a100-bc0c6664e7ed-scripts\") pod \"cinder-api-0\" (UID: \"f4cbd2d6-e498-42bf-a100-bc0c6664e7ed\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.440463 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f4cbd2d6-e498-42bf-a100-bc0c6664e7ed-config-data\") pod \"cinder-api-0\" (UID: \"f4cbd2d6-e498-42bf-a100-bc0c6664e7ed\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.440603 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f4cbd2d6-e498-42bf-a100-bc0c6664e7ed-public-tls-certs\") pod \"cinder-api-0\" (UID: \"f4cbd2d6-e498-42bf-a100-bc0c6664e7ed\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.440641 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f4cbd2d6-e498-42bf-a100-bc0c6664e7ed-logs\") pod \"cinder-api-0\" (UID: \"f4cbd2d6-e498-42bf-a100-bc0c6664e7ed\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.440983 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/b609e161-5c22-4699-9af9-7f972834422a-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.442979 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/f4cbd2d6-e498-42bf-a100-bc0c6664e7ed-etc-machine-id\") pod \"cinder-api-0\" (UID: \"f4cbd2d6-e498-42bf-a100-bc0c6664e7ed\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.447265 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f4cbd2d6-e498-42bf-a100-bc0c6664e7ed-logs\") pod \"cinder-api-0\" (UID: \"f4cbd2d6-e498-42bf-a100-bc0c6664e7ed\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.448007 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f4cbd2d6-e498-42bf-a100-bc0c6664e7ed-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"f4cbd2d6-e498-42bf-a100-bc0c6664e7ed\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.448099 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage02-crc" (OuterVolumeSpecName: "glance") pod "b609e161-5c22-4699-9af9-7f972834422a" (UID: "b609e161-5c22-4699-9af9-7f972834422a"). InnerVolumeSpecName "local-storage02-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.448399 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f4cbd2d6-e498-42bf-a100-bc0c6664e7ed-scripts\") pod \"cinder-api-0\" (UID: \"f4cbd2d6-e498-42bf-a100-bc0c6664e7ed\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.450926 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b609e161-5c22-4699-9af9-7f972834422a-logs" (OuterVolumeSpecName: "logs") pod "b609e161-5c22-4699-9af9-7f972834422a" (UID: "b609e161-5c22-4699-9af9-7f972834422a"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.454315 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/f4cbd2d6-e498-42bf-a100-bc0c6664e7ed-config-data-custom\") pod \"cinder-api-0\" (UID: \"f4cbd2d6-e498-42bf-a100-bc0c6664e7ed\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.455652 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f4cbd2d6-e498-42bf-a100-bc0c6664e7ed-public-tls-certs\") pod \"cinder-api-0\" (UID: \"f4cbd2d6-e498-42bf-a100-bc0c6664e7ed\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.456931 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f4cbd2d6-e498-42bf-a100-bc0c6664e7ed-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"f4cbd2d6-e498-42bf-a100-bc0c6664e7ed\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.464185 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b609e161-5c22-4699-9af9-7f972834422a-scripts" (OuterVolumeSpecName: "scripts") pod "b609e161-5c22-4699-9af9-7f972834422a" (UID: "b609e161-5c22-4699-9af9-7f972834422a"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.464586 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.468157 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b609e161-5c22-4699-9af9-7f972834422a-kube-api-access-jc8qg" (OuterVolumeSpecName: "kube-api-access-jc8qg") pod "b609e161-5c22-4699-9af9-7f972834422a" (UID: "b609e161-5c22-4699-9af9-7f972834422a"). InnerVolumeSpecName "kube-api-access-jc8qg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.465340 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"3267cb77-9a07-4d71-aaa4-e1e5e033a70d","Type":"ContainerDied","Data":"8b53db1e0bd79866eb6c0dda62518f82ffff38e483b8bfb3cf474001723a5bf2"} Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.474201 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstack-galera-0" podStartSLOduration=11.474179534 podStartE2EDuration="11.474179534s" podCreationTimestamp="2026-03-16 16:53:17 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:53:28.454232868 +0000 UTC m=+4910.608164526" watchObservedRunningTime="2026-03-16 16:53:28.474179534 +0000 UTC m=+4910.628111191" Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.488452 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f4cbd2d6-e498-42bf-a100-bc0c6664e7ed-config-data\") pod \"cinder-api-0\" (UID: \"f4cbd2d6-e498-42bf-a100-bc0c6664e7ed\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.509931 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvb26\" (UniqueName: \"kubernetes.io/projected/f4cbd2d6-e498-42bf-a100-bc0c6664e7ed-kube-api-access-qvb26\") pod \"cinder-api-0\" (UID: \"f4cbd2d6-e498-42bf-a100-bc0c6664e7ed\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.519164 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"b3ff7a5c-9d60-4d20-9308-0b7d88d605f6","Type":"ContainerStarted","Data":"eefe2c9b53c6bd8747cdce644a861bbc411bf663cd9a7b5171573eeb873ff874"} Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.529027 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-78dc5f4cb-mjvvc" event={"ID":"152925c6-48ae-4e8d-9a3f-68f01278fe95","Type":"ContainerStarted","Data":"03a3d3382bd92ee1061cb9a4c52c11007f361661aa271a81420c3f5463675e59"} Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.540066 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b609e161-5c22-4699-9af9-7f972834422a-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "b609e161-5c22-4699-9af9-7f972834422a" (UID: "b609e161-5c22-4699-9af9-7f972834422a"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.556440 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/67c7567e-232d-4853-961c-dcc1799c7dae-scripts\") pod \"67c7567e-232d-4853-961c-dcc1799c7dae\" (UID: \"67c7567e-232d-4853-961c-dcc1799c7dae\") " Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.556577 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/67c7567e-232d-4853-961c-dcc1799c7dae-public-tls-certs\") pod \"67c7567e-232d-4853-961c-dcc1799c7dae\" (UID: \"67c7567e-232d-4853-961c-dcc1799c7dae\") " Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.556643 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/67c7567e-232d-4853-961c-dcc1799c7dae-config-data\") pod \"67c7567e-232d-4853-961c-dcc1799c7dae\" (UID: \"67c7567e-232d-4853-961c-dcc1799c7dae\") " Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.556665 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/67c7567e-232d-4853-961c-dcc1799c7dae-internal-tls-certs\") pod \"67c7567e-232d-4853-961c-dcc1799c7dae\" (UID: \"67c7567e-232d-4853-961c-dcc1799c7dae\") " Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.556705 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/67c7567e-232d-4853-961c-dcc1799c7dae-combined-ca-bundle\") pod \"67c7567e-232d-4853-961c-dcc1799c7dae\" (UID: \"67c7567e-232d-4853-961c-dcc1799c7dae\") " Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.556779 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/3267cb77-9a07-4d71-aaa4-e1e5e033a70d-internal-tls-certs\") pod \"3267cb77-9a07-4d71-aaa4-e1e5e033a70d\" (UID: \"3267cb77-9a07-4d71-aaa4-e1e5e033a70d\") " Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.556888 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"3267cb77-9a07-4d71-aaa4-e1e5e033a70d\" (UID: \"3267cb77-9a07-4d71-aaa4-e1e5e033a70d\") " Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.556931 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/67c7567e-232d-4853-961c-dcc1799c7dae-logs\") pod \"67c7567e-232d-4853-961c-dcc1799c7dae\" (UID: \"67c7567e-232d-4853-961c-dcc1799c7dae\") " Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.556996 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8h2g5\" (UniqueName: \"kubernetes.io/projected/3267cb77-9a07-4d71-aaa4-e1e5e033a70d-kube-api-access-8h2g5\") pod \"3267cb77-9a07-4d71-aaa4-e1e5e033a70d\" (UID: \"3267cb77-9a07-4d71-aaa4-e1e5e033a70d\") " Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.557050 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3267cb77-9a07-4d71-aaa4-e1e5e033a70d-scripts\") pod \"3267cb77-9a07-4d71-aaa4-e1e5e033a70d\" (UID: \"3267cb77-9a07-4d71-aaa4-e1e5e033a70d\") " Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.557115 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3267cb77-9a07-4d71-aaa4-e1e5e033a70d-config-data\") pod \"3267cb77-9a07-4d71-aaa4-e1e5e033a70d\" (UID: \"3267cb77-9a07-4d71-aaa4-e1e5e033a70d\") " Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.557223 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3267cb77-9a07-4d71-aaa4-e1e5e033a70d-logs\") pod \"3267cb77-9a07-4d71-aaa4-e1e5e033a70d\" (UID: \"3267cb77-9a07-4d71-aaa4-e1e5e033a70d\") " Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.557394 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/3267cb77-9a07-4d71-aaa4-e1e5e033a70d-httpd-run\") pod \"3267cb77-9a07-4d71-aaa4-e1e5e033a70d\" (UID: \"3267cb77-9a07-4d71-aaa4-e1e5e033a70d\") " Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.557444 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3267cb77-9a07-4d71-aaa4-e1e5e033a70d-combined-ca-bundle\") pod \"3267cb77-9a07-4d71-aaa4-e1e5e033a70d\" (UID: \"3267cb77-9a07-4d71-aaa4-e1e5e033a70d\") " Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.557501 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wkjvs\" (UniqueName: \"kubernetes.io/projected/67c7567e-232d-4853-961c-dcc1799c7dae-kube-api-access-wkjvs\") pod \"67c7567e-232d-4853-961c-dcc1799c7dae\" (UID: \"67c7567e-232d-4853-961c-dcc1799c7dae\") " Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.560797 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jc8qg\" (UniqueName: \"kubernetes.io/projected/b609e161-5c22-4699-9af9-7f972834422a-kube-api-access-jc8qg\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.560834 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b609e161-5c22-4699-9af9-7f972834422a-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.560861 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") on node \"crc\" " Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.560875 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b609e161-5c22-4699-9af9-7f972834422a-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.560887 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b609e161-5c22-4699-9af9-7f972834422a-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.573910 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67c7567e-232d-4853-961c-dcc1799c7dae-logs" (OuterVolumeSpecName: "logs") pod "67c7567e-232d-4853-961c-dcc1799c7dae" (UID: "67c7567e-232d-4853-961c-dcc1799c7dae"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.573935 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3267cb77-9a07-4d71-aaa4-e1e5e033a70d-logs" (OuterVolumeSpecName: "logs") pod "3267cb77-9a07-4d71-aaa4-e1e5e033a70d" (UID: "3267cb77-9a07-4d71-aaa4-e1e5e033a70d"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.579206 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3267cb77-9a07-4d71-aaa4-e1e5e033a70d-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "3267cb77-9a07-4d71-aaa4-e1e5e033a70d" (UID: "3267cb77-9a07-4d71-aaa4-e1e5e033a70d"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.587115 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/67c7567e-232d-4853-961c-dcc1799c7dae-scripts" (OuterVolumeSpecName: "scripts") pod "67c7567e-232d-4853-961c-dcc1799c7dae" (UID: "67c7567e-232d-4853-961c-dcc1799c7dae"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.595071 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage01-crc" (OuterVolumeSpecName: "glance") pod "3267cb77-9a07-4d71-aaa4-e1e5e033a70d" (UID: "3267cb77-9a07-4d71-aaa4-e1e5e033a70d"). InnerVolumeSpecName "local-storage01-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.595087 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3267cb77-9a07-4d71-aaa4-e1e5e033a70d-scripts" (OuterVolumeSpecName: "scripts") pod "3267cb77-9a07-4d71-aaa4-e1e5e033a70d" (UID: "3267cb77-9a07-4d71-aaa4-e1e5e033a70d"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.595268 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67c7567e-232d-4853-961c-dcc1799c7dae-kube-api-access-wkjvs" (OuterVolumeSpecName: "kube-api-access-wkjvs") pod "67c7567e-232d-4853-961c-dcc1799c7dae" (UID: "67c7567e-232d-4853-961c-dcc1799c7dae"). InnerVolumeSpecName "kube-api-access-wkjvs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.610232 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3267cb77-9a07-4d71-aaa4-e1e5e033a70d-kube-api-access-8h2g5" (OuterVolumeSpecName: "kube-api-access-8h2g5") pod "3267cb77-9a07-4d71-aaa4-e1e5e033a70d" (UID: "3267cb77-9a07-4d71-aaa4-e1e5e033a70d"). InnerVolumeSpecName "kube-api-access-8h2g5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.638476 5120 generic.go:358] "Generic (PLEG): container finished" podID="a7564ece-3e31-426b-a07b-1b9e12d76d01" containerID="a925b16bc707dd1b850ad386d8896edc36bd1221a6b55a9c743fc74aaec36eec" exitCode=143 Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.638619 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-786c646546-49lhr" event={"ID":"a7564ece-3e31-426b-a07b-1b9e12d76d01","Type":"ContainerDied","Data":"a925b16bc707dd1b850ad386d8896edc36bd1221a6b55a9c743fc74aaec36eec"} Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.656654 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.678096 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3267cb77-9a07-4d71-aaa4-e1e5e033a70d-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "3267cb77-9a07-4d71-aaa4-e1e5e033a70d" (UID: "3267cb77-9a07-4d71-aaa4-e1e5e033a70d"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.678194 5120 scope.go:117] "RemoveContainer" containerID="fe3704d93cf9ed8fa0ca53adf27dda6cc128a01d21af312c28390e31e1f5577a" Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.683154 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/3267cb77-9a07-4d71-aaa4-e1e5e033a70d-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.683319 5120 generic.go:358] "Generic (PLEG): container finished" podID="67c7567e-232d-4853-961c-dcc1799c7dae" containerID="ca50e37e23a978feca05ae4a826e2b04ffb0b3d92fd61ca5f40ef219779adaee" exitCode=0 Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.683468 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wkjvs\" (UniqueName: \"kubernetes.io/projected/67c7567e-232d-4853-961c-dcc1799c7dae-kube-api-access-wkjvs\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.684995 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/67c7567e-232d-4853-961c-dcc1799c7dae-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.685114 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") on node \"crc\" " Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.685195 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/67c7567e-232d-4853-961c-dcc1799c7dae-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.685311 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8h2g5\" (UniqueName: \"kubernetes.io/projected/3267cb77-9a07-4d71-aaa4-e1e5e033a70d-kube-api-access-8h2g5\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.685389 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3267cb77-9a07-4d71-aaa4-e1e5e033a70d-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.685591 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3267cb77-9a07-4d71-aaa4-e1e5e033a70d-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.740270 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-7f77bff94b-c5ng2" Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.741020 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="979d8a07-391d-483c-92d1-bb2d256edf99" path="/var/lib/kubelet/pods/979d8a07-391d-483c-92d1-bb2d256edf99/volumes" Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.741741 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c846d2b2-0638-44bd-9ad0-6b6c76f8d16f" path="/var/lib/kubelet/pods/c846d2b2-0638-44bd-9ad0-6b6c76f8d16f/volumes" Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.742581 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef964d2a-6681-47c5-9a3b-29fe733ee9f0" path="/var/lib/kubelet/pods/ef964d2a-6681-47c5-9a3b-29fe733ee9f0/volumes" Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.744084 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fa4601ff-7ef6-4d2c-b0ca-b153763db12f" path="/var/lib/kubelet/pods/fa4601ff-7ef6-4d2c-b0ca-b153763db12f/volumes" Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.763871 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podStartSLOduration=9.763848273 podStartE2EDuration="9.763848273s" podCreationTimestamp="2026-03-16 16:53:19 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:53:28.554179534 +0000 UTC m=+4910.708111191" watchObservedRunningTime="2026-03-16 16:53:28.763848273 +0000 UTC m=+4910.917779930" Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.771023 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b609e161-5c22-4699-9af9-7f972834422a-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "b609e161-5c22-4699-9af9-7f972834422a" (UID: "b609e161-5c22-4699-9af9-7f972834422a"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.771637 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-7f77bff94b-c5ng2" event={"ID":"67c7567e-232d-4853-961c-dcc1799c7dae","Type":"ContainerDied","Data":"ca50e37e23a978feca05ae4a826e2b04ffb0b3d92fd61ca5f40ef219779adaee"} Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.771676 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-7f77bff94b-c5ng2" event={"ID":"67c7567e-232d-4853-961c-dcc1799c7dae","Type":"ContainerDied","Data":"56e362cb4fbcb771eb6d5aa2503e2ef1a11f7086f388039bf74abf8bf614cff2"} Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.771689 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"9fb3c077-55b7-4693-af84-b981deb240da","Type":"ContainerStarted","Data":"d6379599594c178393fbf1640c89d3239c76f0259578ec41f0162a979abfaeed"} Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.788075 5120 scope.go:117] "RemoveContainer" containerID="de5b56d392648f53e472ea3236bd1ceb79ed7862f164f660f14895f66976aaab" Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.792332 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/b609e161-5c22-4699-9af9-7f972834422a-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.792364 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3267cb77-9a07-4d71-aaa4-e1e5e033a70d-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.817259 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage01-crc" (UniqueName: "kubernetes.io/local-volume/local-storage01-crc") on node "crc" Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.847969 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage02-crc" (UniqueName: "kubernetes.io/local-volume/local-storage02-crc") on node "crc" Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.874373 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b609e161-5c22-4699-9af9-7f972834422a-config-data" (OuterVolumeSpecName: "config-data") pod "b609e161-5c22-4699-9af9-7f972834422a" (UID: "b609e161-5c22-4699-9af9-7f972834422a"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.887595 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/67c7567e-232d-4853-961c-dcc1799c7dae-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "67c7567e-232d-4853-961c-dcc1799c7dae" (UID: "67c7567e-232d-4853-961c-dcc1799c7dae"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.896033 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.896060 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/67c7567e-232d-4853-961c-dcc1799c7dae-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.896069 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b609e161-5c22-4699-9af9-7f972834422a-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.896079 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.897885 5120 scope.go:117] "RemoveContainer" containerID="aa8ecc3060c9fc401b4f9011b46c8b75393fee354f0cf1a58a0bacc59f34f05d" Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.921933 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3267cb77-9a07-4d71-aaa4-e1e5e033a70d-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "3267cb77-9a07-4d71-aaa4-e1e5e033a70d" (UID: "3267cb77-9a07-4d71-aaa4-e1e5e033a70d"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.945606 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3267cb77-9a07-4d71-aaa4-e1e5e033a70d-config-data" (OuterVolumeSpecName: "config-data") pod "3267cb77-9a07-4d71-aaa4-e1e5e033a70d" (UID: "3267cb77-9a07-4d71-aaa4-e1e5e033a70d"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:28 crc kubenswrapper[5120]: I0316 16:53:28.970402 5120 scope.go:117] "RemoveContainer" containerID="50a7aad84014a1700b53fcc27f170796a9610d2fc144e609cb89c547825e3660" Mar 16 16:53:29 crc kubenswrapper[5120]: I0316 16:53:28.998769 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/3267cb77-9a07-4d71-aaa4-e1e5e033a70d-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:29 crc kubenswrapper[5120]: I0316 16:53:28.998804 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3267cb77-9a07-4d71-aaa4-e1e5e033a70d-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:29 crc kubenswrapper[5120]: W0316 16:53:29.000299 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod68500e27_b83c_4571_9082_33e4d4ea3daa.slice/crio-e56e5e3cbe5826477177d9b0442f9931ba2185d71df3c478c6756295e2ea8fff WatchSource:0}: Error finding container e56e5e3cbe5826477177d9b0442f9931ba2185d71df3c478c6756295e2ea8fff: Status 404 returned error can't find the container with id e56e5e3cbe5826477177d9b0442f9931ba2185d71df3c478c6756295e2ea8fff Mar 16 16:53:29 crc kubenswrapper[5120]: I0316 16:53:29.004553 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:53:29 crc kubenswrapper[5120]: I0316 16:53:29.056507 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/67c7567e-232d-4853-961c-dcc1799c7dae-config-data" (OuterVolumeSpecName: "config-data") pod "67c7567e-232d-4853-961c-dcc1799c7dae" (UID: "67c7567e-232d-4853-961c-dcc1799c7dae"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:29 crc kubenswrapper[5120]: I0316 16:53:29.090989 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/67c7567e-232d-4853-961c-dcc1799c7dae-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "67c7567e-232d-4853-961c-dcc1799c7dae" (UID: "67c7567e-232d-4853-961c-dcc1799c7dae"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:29 crc kubenswrapper[5120]: I0316 16:53:29.104710 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/67c7567e-232d-4853-961c-dcc1799c7dae-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:29 crc kubenswrapper[5120]: I0316 16:53:29.104791 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/67c7567e-232d-4853-961c-dcc1799c7dae-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:29 crc kubenswrapper[5120]: I0316 16:53:29.204683 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 16:53:29 crc kubenswrapper[5120]: I0316 16:53:29.214518 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/67c7567e-232d-4853-961c-dcc1799c7dae-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "67c7567e-232d-4853-961c-dcc1799c7dae" (UID: "67c7567e-232d-4853-961c-dcc1799c7dae"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:29 crc kubenswrapper[5120]: W0316 16:53:29.241365 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd8a5e446_6e3f_4c8c_b842_f800c1361957.slice/crio-671886e146a24613029fd5ae155c490343cf70d61ea5a7ff91afda30bd0a1642 WatchSource:0}: Error finding container 671886e146a24613029fd5ae155c490343cf70d61ea5a7ff91afda30bd0a1642: Status 404 returned error can't find the container with id 671886e146a24613029fd5ae155c490343cf70d61ea5a7ff91afda30bd0a1642 Mar 16 16:53:29 crc kubenswrapper[5120]: I0316 16:53:29.324527 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/67c7567e-232d-4853-961c-dcc1799c7dae-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:29 crc kubenswrapper[5120]: I0316 16:53:29.379362 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:53:29 crc kubenswrapper[5120]: I0316 16:53:29.411357 5120 scope.go:117] "RemoveContainer" containerID="22238b276b76d861d77fc31af6bce9e01d1c0750ab88ee13081b94e698df6c71" Mar 16 16:53:29 crc kubenswrapper[5120]: I0316 16:53:29.414532 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:53:29 crc kubenswrapper[5120]: W0316 16:53:29.426031 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod802ef826_c6e7_4a1c_90a6_b419b9489007.slice/crio-1408b97c46ccdff82d9b2ca4f20753c74df3346d5cc0a09bde8e56bfebcd58c1 WatchSource:0}: Error finding container 1408b97c46ccdff82d9b2ca4f20753c74df3346d5cc0a09bde8e56bfebcd58c1: Status 404 returned error can't find the container with id 1408b97c46ccdff82d9b2ca4f20753c74df3346d5cc0a09bde8e56bfebcd58c1 Mar 16 16:53:29 crc kubenswrapper[5120]: I0316 16:53:29.440275 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:53:29 crc kubenswrapper[5120]: I0316 16:53:29.478264 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:53:29 crc kubenswrapper[5120]: I0316 16:53:29.479695 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67c7567e-232d-4853-961c-dcc1799c7dae" containerName="placement-api" Mar 16 16:53:29 crc kubenswrapper[5120]: I0316 16:53:29.479715 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="67c7567e-232d-4853-961c-dcc1799c7dae" containerName="placement-api" Mar 16 16:53:29 crc kubenswrapper[5120]: I0316 16:53:29.479727 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b609e161-5c22-4699-9af9-7f972834422a" containerName="glance-httpd" Mar 16 16:53:29 crc kubenswrapper[5120]: I0316 16:53:29.479736 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="b609e161-5c22-4699-9af9-7f972834422a" containerName="glance-httpd" Mar 16 16:53:29 crc kubenswrapper[5120]: I0316 16:53:29.480224 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b609e161-5c22-4699-9af9-7f972834422a" containerName="glance-log" Mar 16 16:53:29 crc kubenswrapper[5120]: I0316 16:53:29.480244 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="b609e161-5c22-4699-9af9-7f972834422a" containerName="glance-log" Mar 16 16:53:29 crc kubenswrapper[5120]: I0316 16:53:29.480274 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3267cb77-9a07-4d71-aaa4-e1e5e033a70d" containerName="glance-log" Mar 16 16:53:29 crc kubenswrapper[5120]: I0316 16:53:29.480281 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="3267cb77-9a07-4d71-aaa4-e1e5e033a70d" containerName="glance-log" Mar 16 16:53:29 crc kubenswrapper[5120]: I0316 16:53:29.480295 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3267cb77-9a07-4d71-aaa4-e1e5e033a70d" containerName="glance-httpd" Mar 16 16:53:29 crc kubenswrapper[5120]: I0316 16:53:29.480302 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="3267cb77-9a07-4d71-aaa4-e1e5e033a70d" containerName="glance-httpd" Mar 16 16:53:29 crc kubenswrapper[5120]: I0316 16:53:29.480323 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67c7567e-232d-4853-961c-dcc1799c7dae" containerName="placement-log" Mar 16 16:53:29 crc kubenswrapper[5120]: I0316 16:53:29.480330 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="67c7567e-232d-4853-961c-dcc1799c7dae" containerName="placement-log" Mar 16 16:53:29 crc kubenswrapper[5120]: I0316 16:53:29.480563 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="b609e161-5c22-4699-9af9-7f972834422a" containerName="glance-httpd" Mar 16 16:53:29 crc kubenswrapper[5120]: I0316 16:53:29.480585 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="67c7567e-232d-4853-961c-dcc1799c7dae" containerName="placement-api" Mar 16 16:53:29 crc kubenswrapper[5120]: I0316 16:53:29.480593 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="b609e161-5c22-4699-9af9-7f972834422a" containerName="glance-log" Mar 16 16:53:29 crc kubenswrapper[5120]: I0316 16:53:29.480607 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="3267cb77-9a07-4d71-aaa4-e1e5e033a70d" containerName="glance-httpd" Mar 16 16:53:29 crc kubenswrapper[5120]: I0316 16:53:29.480619 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="67c7567e-232d-4853-961c-dcc1799c7dae" containerName="placement-log" Mar 16 16:53:29 crc kubenswrapper[5120]: I0316 16:53:29.480636 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="3267cb77-9a07-4d71-aaa4-e1e5e033a70d" containerName="glance-log" Mar 16 16:53:29 crc kubenswrapper[5120]: I0316 16:53:29.513697 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:53:29 crc kubenswrapper[5120]: I0316 16:53:29.513894 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:53:29 crc kubenswrapper[5120]: I0316 16:53:29.516310 5120 scope.go:117] "RemoveContainer" containerID="1c97e604f52abab9a8e368bf807db43802deda778f7fb4d78b276c6e7c88807b" Mar 16 16:53:29 crc kubenswrapper[5120]: I0316 16:53:29.517007 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-external-config-data\"" Mar 16 16:53:29 crc kubenswrapper[5120]: I0316 16:53:29.517662 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-glance-dockercfg-6m2c9\"" Mar 16 16:53:29 crc kubenswrapper[5120]: I0316 16:53:29.517908 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-scripts\"" Mar 16 16:53:29 crc kubenswrapper[5120]: I0316 16:53:29.519670 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:53:29 crc kubenswrapper[5120]: I0316 16:53:29.529061 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-public-svc\"" Mar 16 16:53:29 crc kubenswrapper[5120]: I0316 16:53:29.570316 5120 scope.go:117] "RemoveContainer" containerID="d2a42d62f2fd2ddd455e436e93a4ce325a2404cdfb467be37ed3b03b99074a8c" Mar 16 16:53:29 crc kubenswrapper[5120]: I0316 16:53:29.577553 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:53:29 crc kubenswrapper[5120]: I0316 16:53:29.617981 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-7f77bff94b-c5ng2"] Mar 16 16:53:29 crc kubenswrapper[5120]: I0316 16:53:29.621551 5120 scope.go:117] "RemoveContainer" containerID="ced459ec8d89e143997a50be3ffdcebfc98c9c89a44dec96cc00f40ef7252e43" Mar 16 16:53:29 crc kubenswrapper[5120]: I0316 16:53:29.637189 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/641d2a6c-6871-488a-8ef3-5a2e693af389-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"641d2a6c-6871-488a-8ef3-5a2e693af389\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:53:29 crc kubenswrapper[5120]: I0316 16:53:29.637367 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/641d2a6c-6871-488a-8ef3-5a2e693af389-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"641d2a6c-6871-488a-8ef3-5a2e693af389\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:53:29 crc kubenswrapper[5120]: I0316 16:53:29.637466 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/641d2a6c-6871-488a-8ef3-5a2e693af389-logs\") pod \"glance-default-external-api-0\" (UID: \"641d2a6c-6871-488a-8ef3-5a2e693af389\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:53:29 crc kubenswrapper[5120]: I0316 16:53:29.637568 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/641d2a6c-6871-488a-8ef3-5a2e693af389-config-data\") pod \"glance-default-external-api-0\" (UID: \"641d2a6c-6871-488a-8ef3-5a2e693af389\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:53:29 crc kubenswrapper[5120]: I0316 16:53:29.637607 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nv9gd\" (UniqueName: \"kubernetes.io/projected/641d2a6c-6871-488a-8ef3-5a2e693af389-kube-api-access-nv9gd\") pod \"glance-default-external-api-0\" (UID: \"641d2a6c-6871-488a-8ef3-5a2e693af389\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:53:29 crc kubenswrapper[5120]: I0316 16:53:29.637813 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"glance-default-external-api-0\" (UID: \"641d2a6c-6871-488a-8ef3-5a2e693af389\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:53:29 crc kubenswrapper[5120]: I0316 16:53:29.638009 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/641d2a6c-6871-488a-8ef3-5a2e693af389-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"641d2a6c-6871-488a-8ef3-5a2e693af389\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:53:29 crc kubenswrapper[5120]: I0316 16:53:29.641031 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/641d2a6c-6871-488a-8ef3-5a2e693af389-scripts\") pod \"glance-default-external-api-0\" (UID: \"641d2a6c-6871-488a-8ef3-5a2e693af389\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:53:29 crc kubenswrapper[5120]: I0316 16:53:29.656944 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-7f77bff94b-c5ng2"] Mar 16 16:53:29 crc kubenswrapper[5120]: I0316 16:53:29.669752 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:53:29 crc kubenswrapper[5120]: I0316 16:53:29.746944 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:53:29 crc kubenswrapper[5120]: I0316 16:53:29.747032 5120 scope.go:117] "RemoveContainer" containerID="ca50e37e23a978feca05ae4a826e2b04ffb0b3d92fd61ca5f40ef219779adaee" Mar 16 16:53:29 crc kubenswrapper[5120]: I0316 16:53:29.747091 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:53:29 crc kubenswrapper[5120]: I0316 16:53:29.759583 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"glance-default-external-api-0\" (UID: \"641d2a6c-6871-488a-8ef3-5a2e693af389\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:53:29 crc kubenswrapper[5120]: I0316 16:53:29.759859 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/641d2a6c-6871-488a-8ef3-5a2e693af389-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"641d2a6c-6871-488a-8ef3-5a2e693af389\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:53:29 crc kubenswrapper[5120]: I0316 16:53:29.759955 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/641d2a6c-6871-488a-8ef3-5a2e693af389-scripts\") pod \"glance-default-external-api-0\" (UID: \"641d2a6c-6871-488a-8ef3-5a2e693af389\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:53:29 crc kubenswrapper[5120]: I0316 16:53:29.760046 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/641d2a6c-6871-488a-8ef3-5a2e693af389-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"641d2a6c-6871-488a-8ef3-5a2e693af389\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:53:29 crc kubenswrapper[5120]: I0316 16:53:29.760234 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/641d2a6c-6871-488a-8ef3-5a2e693af389-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"641d2a6c-6871-488a-8ef3-5a2e693af389\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:53:29 crc kubenswrapper[5120]: I0316 16:53:29.760371 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/641d2a6c-6871-488a-8ef3-5a2e693af389-logs\") pod \"glance-default-external-api-0\" (UID: \"641d2a6c-6871-488a-8ef3-5a2e693af389\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:53:29 crc kubenswrapper[5120]: I0316 16:53:29.760479 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/641d2a6c-6871-488a-8ef3-5a2e693af389-config-data\") pod \"glance-default-external-api-0\" (UID: \"641d2a6c-6871-488a-8ef3-5a2e693af389\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:53:29 crc kubenswrapper[5120]: I0316 16:53:29.760486 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/641d2a6c-6871-488a-8ef3-5a2e693af389-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"641d2a6c-6871-488a-8ef3-5a2e693af389\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:53:29 crc kubenswrapper[5120]: I0316 16:53:29.760690 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"glance-default-external-api-0\" (UID: \"641d2a6c-6871-488a-8ef3-5a2e693af389\") device mount path \"/mnt/openstack/pv02\"" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:53:29 crc kubenswrapper[5120]: I0316 16:53:29.760743 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-internal-svc\"" Mar 16 16:53:29 crc kubenswrapper[5120]: I0316 16:53:29.761017 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-internal-config-data\"" Mar 16 16:53:29 crc kubenswrapper[5120]: I0316 16:53:29.763200 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nv9gd\" (UniqueName: \"kubernetes.io/projected/641d2a6c-6871-488a-8ef3-5a2e693af389-kube-api-access-nv9gd\") pod \"glance-default-external-api-0\" (UID: \"641d2a6c-6871-488a-8ef3-5a2e693af389\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:53:29 crc kubenswrapper[5120]: I0316 16:53:29.763339 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/641d2a6c-6871-488a-8ef3-5a2e693af389-logs\") pod \"glance-default-external-api-0\" (UID: \"641d2a6c-6871-488a-8ef3-5a2e693af389\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:53:29 crc kubenswrapper[5120]: I0316 16:53:29.768807 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/641d2a6c-6871-488a-8ef3-5a2e693af389-scripts\") pod \"glance-default-external-api-0\" (UID: \"641d2a6c-6871-488a-8ef3-5a2e693af389\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:53:29 crc kubenswrapper[5120]: I0316 16:53:29.781056 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/641d2a6c-6871-488a-8ef3-5a2e693af389-config-data\") pod \"glance-default-external-api-0\" (UID: \"641d2a6c-6871-488a-8ef3-5a2e693af389\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:53:29 crc kubenswrapper[5120]: W0316 16:53:29.784214 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod04afe1ee_a37b_4e44_91b4_7e15170bb03c.slice/crio-45231e6d827baa098ea755eb285ff5d6db722573b41bac4f797f682636049acc WatchSource:0}: Error finding container 45231e6d827baa098ea755eb285ff5d6db722573b41bac4f797f682636049acc: Status 404 returned error can't find the container with id 45231e6d827baa098ea755eb285ff5d6db722573b41bac4f797f682636049acc Mar 16 16:53:29 crc kubenswrapper[5120]: I0316 16:53:29.787529 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/641d2a6c-6871-488a-8ef3-5a2e693af389-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"641d2a6c-6871-488a-8ef3-5a2e693af389\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:53:29 crc kubenswrapper[5120]: I0316 16:53:29.789034 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nv9gd\" (UniqueName: \"kubernetes.io/projected/641d2a6c-6871-488a-8ef3-5a2e693af389-kube-api-access-nv9gd\") pod \"glance-default-external-api-0\" (UID: \"641d2a6c-6871-488a-8ef3-5a2e693af389\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:53:29 crc kubenswrapper[5120]: I0316 16:53:29.790591 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/641d2a6c-6871-488a-8ef3-5a2e693af389-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"641d2a6c-6871-488a-8ef3-5a2e693af389\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:53:29 crc kubenswrapper[5120]: I0316 16:53:29.793539 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:53:29 crc kubenswrapper[5120]: I0316 16:53:29.814391 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 16:53:29 crc kubenswrapper[5120]: I0316 16:53:29.826217 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"802ef826-c6e7-4a1c-90a6-b419b9489007","Type":"ContainerStarted","Data":"1408b97c46ccdff82d9b2ca4f20753c74df3346d5cc0a09bde8e56bfebcd58c1"} Mar 16 16:53:29 crc kubenswrapper[5120]: I0316 16:53:29.840811 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 16:53:29 crc kubenswrapper[5120]: I0316 16:53:29.851788 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:53:29 crc kubenswrapper[5120]: I0316 16:53:29.852411 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"68500e27-b83c-4571-9082-33e4d4ea3daa","Type":"ContainerStarted","Data":"53a6aa2de43f8168ef62391d386a5d327dfda0a9256f9e9ab874619195e3c722"} Mar 16 16:53:29 crc kubenswrapper[5120]: I0316 16:53:29.852445 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"68500e27-b83c-4571-9082-33e4d4ea3daa","Type":"ContainerStarted","Data":"e56e5e3cbe5826477177d9b0442f9931ba2185d71df3c478c6756295e2ea8fff"} Mar 16 16:53:29 crc kubenswrapper[5120]: I0316 16:53:29.860407 5120 scope.go:117] "RemoveContainer" containerID="07bbe1168472f1c6963df0f4f0c99eef5b1a0f233ae4b737611b952de551752c" Mar 16 16:53:29 crc kubenswrapper[5120]: I0316 16:53:29.866689 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/75da64f9-4c43-4411-bd20-86c98536adce-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"75da64f9-4c43-4411-bd20-86c98536adce\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:53:29 crc kubenswrapper[5120]: I0316 16:53:29.866719 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/75da64f9-4c43-4411-bd20-86c98536adce-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"75da64f9-4c43-4411-bd20-86c98536adce\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:53:29 crc kubenswrapper[5120]: I0316 16:53:29.867716 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4w8tg\" (UniqueName: \"kubernetes.io/projected/75da64f9-4c43-4411-bd20-86c98536adce-kube-api-access-4w8tg\") pod \"glance-default-internal-api-0\" (UID: \"75da64f9-4c43-4411-bd20-86c98536adce\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:53:29 crc kubenswrapper[5120]: I0316 16:53:29.867874 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/75da64f9-4c43-4411-bd20-86c98536adce-scripts\") pod \"glance-default-internal-api-0\" (UID: \"75da64f9-4c43-4411-bd20-86c98536adce\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:53:29 crc kubenswrapper[5120]: I0316 16:53:29.867931 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"glance-default-internal-api-0\" (UID: \"75da64f9-4c43-4411-bd20-86c98536adce\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:53:29 crc kubenswrapper[5120]: I0316 16:53:29.867948 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/75da64f9-4c43-4411-bd20-86c98536adce-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"75da64f9-4c43-4411-bd20-86c98536adce\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:53:29 crc kubenswrapper[5120]: I0316 16:53:29.867973 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/75da64f9-4c43-4411-bd20-86c98536adce-logs\") pod \"glance-default-internal-api-0\" (UID: \"75da64f9-4c43-4411-bd20-86c98536adce\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:53:29 crc kubenswrapper[5120]: I0316 16:53:29.868016 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/75da64f9-4c43-4411-bd20-86c98536adce-config-data\") pod \"glance-default-internal-api-0\" (UID: \"75da64f9-4c43-4411-bd20-86c98536adce\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:53:29 crc kubenswrapper[5120]: I0316 16:53:29.868637 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"9fb3c077-55b7-4693-af84-b981deb240da","Type":"ContainerStarted","Data":"6637aa7a76d94bb0d5267dcacbb4a5b56c43ee66a97a2de4a60d2391feac7339"} Mar 16 16:53:29 crc kubenswrapper[5120]: I0316 16:53:29.868898 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"glance-default-external-api-0\" (UID: \"641d2a6c-6871-488a-8ef3-5a2e693af389\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:53:29 crc kubenswrapper[5120]: I0316 16:53:29.902085 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"d8a5e446-6e3f-4c8c-b842-f800c1361957","Type":"ContainerStarted","Data":"671886e146a24613029fd5ae155c490343cf70d61ea5a7ff91afda30bd0a1642"} Mar 16 16:53:29 crc kubenswrapper[5120]: I0316 16:53:29.910537 5120 scope.go:117] "RemoveContainer" containerID="ca50e37e23a978feca05ae4a826e2b04ffb0b3d92fd61ca5f40ef219779adaee" Mar 16 16:53:29 crc kubenswrapper[5120]: E0316 16:53:29.912084 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca50e37e23a978feca05ae4a826e2b04ffb0b3d92fd61ca5f40ef219779adaee\": container with ID starting with ca50e37e23a978feca05ae4a826e2b04ffb0b3d92fd61ca5f40ef219779adaee not found: ID does not exist" containerID="ca50e37e23a978feca05ae4a826e2b04ffb0b3d92fd61ca5f40ef219779adaee" Mar 16 16:53:29 crc kubenswrapper[5120]: I0316 16:53:29.912130 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca50e37e23a978feca05ae4a826e2b04ffb0b3d92fd61ca5f40ef219779adaee"} err="failed to get container status \"ca50e37e23a978feca05ae4a826e2b04ffb0b3d92fd61ca5f40ef219779adaee\": rpc error: code = NotFound desc = could not find container \"ca50e37e23a978feca05ae4a826e2b04ffb0b3d92fd61ca5f40ef219779adaee\": container with ID starting with ca50e37e23a978feca05ae4a826e2b04ffb0b3d92fd61ca5f40ef219779adaee not found: ID does not exist" Mar 16 16:53:29 crc kubenswrapper[5120]: I0316 16:53:29.912155 5120 scope.go:117] "RemoveContainer" containerID="07bbe1168472f1c6963df0f4f0c99eef5b1a0f233ae4b737611b952de551752c" Mar 16 16:53:29 crc kubenswrapper[5120]: E0316 16:53:29.912752 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"07bbe1168472f1c6963df0f4f0c99eef5b1a0f233ae4b737611b952de551752c\": container with ID starting with 07bbe1168472f1c6963df0f4f0c99eef5b1a0f233ae4b737611b952de551752c not found: ID does not exist" containerID="07bbe1168472f1c6963df0f4f0c99eef5b1a0f233ae4b737611b952de551752c" Mar 16 16:53:29 crc kubenswrapper[5120]: I0316 16:53:29.912825 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07bbe1168472f1c6963df0f4f0c99eef5b1a0f233ae4b737611b952de551752c"} err="failed to get container status \"07bbe1168472f1c6963df0f4f0c99eef5b1a0f233ae4b737611b952de551752c\": rpc error: code = NotFound desc = could not find container \"07bbe1168472f1c6963df0f4f0c99eef5b1a0f233ae4b737611b952de551752c\": container with ID starting with 07bbe1168472f1c6963df0f4f0c99eef5b1a0f233ae4b737611b952de551752c not found: ID does not exist" Mar 16 16:53:29 crc kubenswrapper[5120]: I0316 16:53:29.924404 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/neutron-d7c95f898-g5nln" podUID="ebceb235-ad03-49fd-9921-f5be8c1851be" containerName="neutron-httpd" probeResult="failure" output="Get \"https://10.217.0.126:9696/\": dial tcp 10.217.0.126:9696: connect: connection refused" Mar 16 16:53:29 crc kubenswrapper[5120]: I0316 16:53:29.970430 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/75da64f9-4c43-4411-bd20-86c98536adce-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"75da64f9-4c43-4411-bd20-86c98536adce\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:53:29 crc kubenswrapper[5120]: I0316 16:53:29.970609 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/75da64f9-4c43-4411-bd20-86c98536adce-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"75da64f9-4c43-4411-bd20-86c98536adce\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:53:29 crc kubenswrapper[5120]: I0316 16:53:29.970714 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4w8tg\" (UniqueName: \"kubernetes.io/projected/75da64f9-4c43-4411-bd20-86c98536adce-kube-api-access-4w8tg\") pod \"glance-default-internal-api-0\" (UID: \"75da64f9-4c43-4411-bd20-86c98536adce\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:53:29 crc kubenswrapper[5120]: I0316 16:53:29.970897 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/75da64f9-4c43-4411-bd20-86c98536adce-scripts\") pod \"glance-default-internal-api-0\" (UID: \"75da64f9-4c43-4411-bd20-86c98536adce\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:53:29 crc kubenswrapper[5120]: I0316 16:53:29.971386 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"glance-default-internal-api-0\" (UID: \"75da64f9-4c43-4411-bd20-86c98536adce\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:53:29 crc kubenswrapper[5120]: I0316 16:53:29.971414 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/75da64f9-4c43-4411-bd20-86c98536adce-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"75da64f9-4c43-4411-bd20-86c98536adce\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:53:29 crc kubenswrapper[5120]: I0316 16:53:29.971437 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/75da64f9-4c43-4411-bd20-86c98536adce-logs\") pod \"glance-default-internal-api-0\" (UID: \"75da64f9-4c43-4411-bd20-86c98536adce\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:53:29 crc kubenswrapper[5120]: I0316 16:53:29.971475 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/75da64f9-4c43-4411-bd20-86c98536adce-config-data\") pod \"glance-default-internal-api-0\" (UID: \"75da64f9-4c43-4411-bd20-86c98536adce\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:53:29 crc kubenswrapper[5120]: I0316 16:53:29.971326 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/75da64f9-4c43-4411-bd20-86c98536adce-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"75da64f9-4c43-4411-bd20-86c98536adce\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:53:29 crc kubenswrapper[5120]: I0316 16:53:29.972516 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"glance-default-internal-api-0\" (UID: \"75da64f9-4c43-4411-bd20-86c98536adce\") device mount path \"/mnt/openstack/pv01\"" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:53:29 crc kubenswrapper[5120]: I0316 16:53:29.976122 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/75da64f9-4c43-4411-bd20-86c98536adce-logs\") pod \"glance-default-internal-api-0\" (UID: \"75da64f9-4c43-4411-bd20-86c98536adce\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:53:29 crc kubenswrapper[5120]: I0316 16:53:29.977015 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/75da64f9-4c43-4411-bd20-86c98536adce-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"75da64f9-4c43-4411-bd20-86c98536adce\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:53:29 crc kubenswrapper[5120]: I0316 16:53:29.977840 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/75da64f9-4c43-4411-bd20-86c98536adce-scripts\") pod \"glance-default-internal-api-0\" (UID: \"75da64f9-4c43-4411-bd20-86c98536adce\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:53:29 crc kubenswrapper[5120]: I0316 16:53:29.980125 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/75da64f9-4c43-4411-bd20-86c98536adce-config-data\") pod \"glance-default-internal-api-0\" (UID: \"75da64f9-4c43-4411-bd20-86c98536adce\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:53:29 crc kubenswrapper[5120]: I0316 16:53:29.980369 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/75da64f9-4c43-4411-bd20-86c98536adce-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"75da64f9-4c43-4411-bd20-86c98536adce\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:53:29 crc kubenswrapper[5120]: I0316 16:53:29.992528 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4w8tg\" (UniqueName: \"kubernetes.io/projected/75da64f9-4c43-4411-bd20-86c98536adce-kube-api-access-4w8tg\") pod \"glance-default-internal-api-0\" (UID: \"75da64f9-4c43-4411-bd20-86c98536adce\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:53:30 crc kubenswrapper[5120]: I0316 16:53:30.040264 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"glance-default-internal-api-0\" (UID: \"75da64f9-4c43-4411-bd20-86c98536adce\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:53:30 crc kubenswrapper[5120]: I0316 16:53:30.095603 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:53:30 crc kubenswrapper[5120]: I0316 16:53:30.156138 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:53:30 crc kubenswrapper[5120]: I0316 16:53:30.322497 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:53:30 crc kubenswrapper[5120]: I0316 16:53:30.655464 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:53:30 crc kubenswrapper[5120]: I0316 16:53:30.655714 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:53:30 crc kubenswrapper[5120]: I0316 16:53:30.717483 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3267cb77-9a07-4d71-aaa4-e1e5e033a70d" path="/var/lib/kubelet/pods/3267cb77-9a07-4d71-aaa4-e1e5e033a70d/volumes" Mar 16 16:53:30 crc kubenswrapper[5120]: I0316 16:53:30.718519 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="67c7567e-232d-4853-961c-dcc1799c7dae" path="/var/lib/kubelet/pods/67c7567e-232d-4853-961c-dcc1799c7dae/volumes" Mar 16 16:53:30 crc kubenswrapper[5120]: I0316 16:53:30.719593 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b609e161-5c22-4699-9af9-7f972834422a" path="/var/lib/kubelet/pods/b609e161-5c22-4699-9af9-7f972834422a/volumes" Mar 16 16:53:30 crc kubenswrapper[5120]: W0316 16:53:30.736954 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod75da64f9_4c43_4411_bd20_86c98536adce.slice/crio-5469d3a83256213ec0d1a82b24e490e5570f2894631ac98f8792f3238ae2f085 WatchSource:0}: Error finding container 5469d3a83256213ec0d1a82b24e490e5570f2894631ac98f8792f3238ae2f085: Status 404 returned error can't find the container with id 5469d3a83256213ec0d1a82b24e490e5570f2894631ac98f8792f3238ae2f085 Mar 16 16:53:31 crc kubenswrapper[5120]: I0316 16:53:31.080222 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"d8a5e446-6e3f-4c8c-b842-f800c1361957","Type":"ContainerStarted","Data":"893cb1996f3cbb0a52fa448b20455a763e12fb23794ad15c478de373e3a247a9"} Mar 16 16:53:31 crc kubenswrapper[5120]: I0316 16:53:31.082281 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/memcached-0" Mar 16 16:53:31 crc kubenswrapper[5120]: I0316 16:53:31.089596 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"802ef826-c6e7-4a1c-90a6-b419b9489007","Type":"ContainerStarted","Data":"006619dc156e3113a33f6739dc105bba228aacbe283771f23e368cd7e533a9d3"} Mar 16 16:53:31 crc kubenswrapper[5120]: I0316 16:53:31.090497 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:53:31 crc kubenswrapper[5120]: I0316 16:53:31.138804 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/memcached-0" podStartSLOduration=6.138755566 podStartE2EDuration="6.138755566s" podCreationTimestamp="2026-03-16 16:53:25 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:53:31.098317319 +0000 UTC m=+4913.252248976" watchObservedRunningTime="2026-03-16 16:53:31.138755566 +0000 UTC m=+4913.292687223" Mar 16 16:53:31 crc kubenswrapper[5120]: I0316 16:53:31.163320 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"04afe1ee-a37b-4e44-91b4-7e15170bb03c","Type":"ContainerStarted","Data":"1cafd98684298b497a9a5dace1436cd49b4481686c9c7fc59d805c3f984d152e"} Mar 16 16:53:31 crc kubenswrapper[5120]: I0316 16:53:31.163385 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"04afe1ee-a37b-4e44-91b4-7e15170bb03c","Type":"ContainerStarted","Data":"45231e6d827baa098ea755eb285ff5d6db722573b41bac4f797f682636049acc"} Mar 16 16:53:31 crc kubenswrapper[5120]: I0316 16:53:31.177976 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"67ab3338-c88c-4faf-8d25-809c92d661d9","Type":"ContainerStarted","Data":"e4e558de3bd4fc49cb2832270b5576d955ed20a2c7b4521b173f218136893e23"} Mar 16 16:53:31 crc kubenswrapper[5120]: I0316 16:53:31.178024 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"67ab3338-c88c-4faf-8d25-809c92d661d9","Type":"ContainerStarted","Data":"b20944f9072fdd18758ac24dc83a2680b8a1706b9d7947283c4fc9ac8c128b09"} Mar 16 16:53:31 crc kubenswrapper[5120]: I0316 16:53:31.179258 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:53:31 crc kubenswrapper[5120]: I0316 16:53:31.188048 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"f4cbd2d6-e498-42bf-a100-bc0c6664e7ed","Type":"ContainerStarted","Data":"3527a250634cc4e39c95b681239568a45e4cc2be6bb8e00699dd0a549ca42e39"} Mar 16 16:53:31 crc kubenswrapper[5120]: I0316 16:53:31.217954 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podStartSLOduration=6.217927163 podStartE2EDuration="6.217927163s" podCreationTimestamp="2026-03-16 16:53:25 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:53:31.138322234 +0000 UTC m=+4913.292253901" watchObservedRunningTime="2026-03-16 16:53:31.217927163 +0000 UTC m=+4913.371858820" Mar 16 16:53:31 crc kubenswrapper[5120]: I0316 16:53:31.259524 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"68500e27-b83c-4571-9082-33e4d4ea3daa","Type":"ContainerStarted","Data":"b8c750b5630561dadd8fe003305591597e02831287265cd47e72211c29c25d34"} Mar 16 16:53:31 crc kubenswrapper[5120]: I0316 16:53:31.274095 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podStartSLOduration=6.274067739 podStartE2EDuration="6.274067739s" podCreationTimestamp="2026-03-16 16:53:25 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:53:31.222399125 +0000 UTC m=+4913.376330782" watchObservedRunningTime="2026-03-16 16:53:31.274067739 +0000 UTC m=+4913.427999396" Mar 16 16:53:31 crc kubenswrapper[5120]: I0316 16:53:31.287096 5120 generic.go:358] "Generic (PLEG): container finished" podID="20f74fa1-8357-4b18-928a-4ae91c38bafe" containerID="377eb38e724962e46bea949d6e0d9516f23c54581a6bf4678d880ce1bdeaddd8" exitCode=137 Mar 16 16:53:31 crc kubenswrapper[5120]: I0316 16:53:31.287251 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"20f74fa1-8357-4b18-928a-4ae91c38bafe","Type":"ContainerDied","Data":"377eb38e724962e46bea949d6e0d9516f23c54581a6bf4678d880ce1bdeaddd8"} Mar 16 16:53:31 crc kubenswrapper[5120]: I0316 16:53:31.306495 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"1c6098ab-3f23-46bd-95ff-94cf96b88f3f","Type":"ContainerStarted","Data":"6e9e6be4f80554429db8fb19a515898ddff3abe9d6e1a2671afc4c3fc09e832b"} Mar 16 16:53:31 crc kubenswrapper[5120]: I0316 16:53:31.306562 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"1c6098ab-3f23-46bd-95ff-94cf96b88f3f","Type":"ContainerStarted","Data":"9fb8b1767dad6291b182f15e84782dbe1547ecb04df88badb7ed5874975edcd5"} Mar 16 16:53:31 crc kubenswrapper[5120]: I0316 16:53:31.315864 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:53:31 crc kubenswrapper[5120]: I0316 16:53:31.316028 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=6.316006247 podStartE2EDuration="6.316006247s" podCreationTimestamp="2026-03-16 16:53:25 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:53:31.296882214 +0000 UTC m=+4913.450813881" watchObservedRunningTime="2026-03-16 16:53:31.316006247 +0000 UTC m=+4913.469937904" Mar 16 16:53:31 crc kubenswrapper[5120]: I0316 16:53:31.317214 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"75da64f9-4c43-4411-bd20-86c98536adce","Type":"ContainerStarted","Data":"5469d3a83256213ec0d1a82b24e490e5570f2894631ac98f8792f3238ae2f085"} Mar 16 16:53:31 crc kubenswrapper[5120]: I0316 16:53:31.322026 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:53:31 crc kubenswrapper[5120]: I0316 16:53:31.348566 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podStartSLOduration=6.348545728 podStartE2EDuration="6.348545728s" podCreationTimestamp="2026-03-16 16:53:25 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:53:31.330755701 +0000 UTC m=+4913.484687358" watchObservedRunningTime="2026-03-16 16:53:31.348545728 +0000 UTC m=+4913.502477375" Mar 16 16:53:31 crc kubenswrapper[5120]: I0316 16:53:31.375309 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-d7c95f898-g5nln_ebceb235-ad03-49fd-9921-f5be8c1851be/neutron-api/0.log" Mar 16 16:53:31 crc kubenswrapper[5120]: I0316 16:53:31.375376 5120 generic.go:358] "Generic (PLEG): container finished" podID="ebceb235-ad03-49fd-9921-f5be8c1851be" containerID="b24f04e9b859c0e1ed187c680ab8fe6ea7ce43f2fdccb344c3d429c318b3a988" exitCode=137 Mar 16 16:53:31 crc kubenswrapper[5120]: I0316 16:53:31.375600 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-d7c95f898-g5nln" event={"ID":"ebceb235-ad03-49fd-9921-f5be8c1851be","Type":"ContainerDied","Data":"b24f04e9b859c0e1ed187c680ab8fe6ea7ce43f2fdccb344c3d429c318b3a988"} Mar 16 16:53:31 crc kubenswrapper[5120]: I0316 16:53:31.452942 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:53:31 crc kubenswrapper[5120]: I0316 16:53:31.603430 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:53:31 crc kubenswrapper[5120]: I0316 16:53:31.631271 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-d7c95f898-g5nln_ebceb235-ad03-49fd-9921-f5be8c1851be/neutron-api/0.log" Mar 16 16:53:31 crc kubenswrapper[5120]: I0316 16:53:31.631371 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-d7c95f898-g5nln" Mar 16 16:53:31 crc kubenswrapper[5120]: I0316 16:53:31.765158 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/ebceb235-ad03-49fd-9921-f5be8c1851be-ovndb-tls-certs\") pod \"ebceb235-ad03-49fd-9921-f5be8c1851be\" (UID: \"ebceb235-ad03-49fd-9921-f5be8c1851be\") " Mar 16 16:53:31 crc kubenswrapper[5120]: I0316 16:53:31.765397 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ebceb235-ad03-49fd-9921-f5be8c1851be-public-tls-certs\") pod \"ebceb235-ad03-49fd-9921-f5be8c1851be\" (UID: \"ebceb235-ad03-49fd-9921-f5be8c1851be\") " Mar 16 16:53:31 crc kubenswrapper[5120]: I0316 16:53:31.765512 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ebceb235-ad03-49fd-9921-f5be8c1851be-combined-ca-bundle\") pod \"ebceb235-ad03-49fd-9921-f5be8c1851be\" (UID: \"ebceb235-ad03-49fd-9921-f5be8c1851be\") " Mar 16 16:53:31 crc kubenswrapper[5120]: I0316 16:53:31.765726 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7x7ml\" (UniqueName: \"kubernetes.io/projected/20f74fa1-8357-4b18-928a-4ae91c38bafe-kube-api-access-7x7ml\") pod \"20f74fa1-8357-4b18-928a-4ae91c38bafe\" (UID: \"20f74fa1-8357-4b18-928a-4ae91c38bafe\") " Mar 16 16:53:31 crc kubenswrapper[5120]: I0316 16:53:31.773065 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z7cdc\" (UniqueName: \"kubernetes.io/projected/ebceb235-ad03-49fd-9921-f5be8c1851be-kube-api-access-z7cdc\") pod \"ebceb235-ad03-49fd-9921-f5be8c1851be\" (UID: \"ebceb235-ad03-49fd-9921-f5be8c1851be\") " Mar 16 16:53:31 crc kubenswrapper[5120]: I0316 16:53:31.773253 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/ebceb235-ad03-49fd-9921-f5be8c1851be-internal-tls-certs\") pod \"ebceb235-ad03-49fd-9921-f5be8c1851be\" (UID: \"ebceb235-ad03-49fd-9921-f5be8c1851be\") " Mar 16 16:53:31 crc kubenswrapper[5120]: I0316 16:53:31.773375 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/20f74fa1-8357-4b18-928a-4ae91c38bafe-combined-ca-bundle\") pod \"20f74fa1-8357-4b18-928a-4ae91c38bafe\" (UID: \"20f74fa1-8357-4b18-928a-4ae91c38bafe\") " Mar 16 16:53:31 crc kubenswrapper[5120]: I0316 16:53:31.773932 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/ebceb235-ad03-49fd-9921-f5be8c1851be-httpd-config\") pod \"ebceb235-ad03-49fd-9921-f5be8c1851be\" (UID: \"ebceb235-ad03-49fd-9921-f5be8c1851be\") " Mar 16 16:53:31 crc kubenswrapper[5120]: I0316 16:53:31.774070 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ebceb235-ad03-49fd-9921-f5be8c1851be-config\") pod \"ebceb235-ad03-49fd-9921-f5be8c1851be\" (UID: \"ebceb235-ad03-49fd-9921-f5be8c1851be\") " Mar 16 16:53:31 crc kubenswrapper[5120]: I0316 16:53:31.774211 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/20f74fa1-8357-4b18-928a-4ae91c38bafe-config-data\") pod \"20f74fa1-8357-4b18-928a-4ae91c38bafe\" (UID: \"20f74fa1-8357-4b18-928a-4ae91c38bafe\") " Mar 16 16:53:31 crc kubenswrapper[5120]: I0316 16:53:31.788909 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ebceb235-ad03-49fd-9921-f5be8c1851be-httpd-config" (OuterVolumeSpecName: "httpd-config") pod "ebceb235-ad03-49fd-9921-f5be8c1851be" (UID: "ebceb235-ad03-49fd-9921-f5be8c1851be"). InnerVolumeSpecName "httpd-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:31 crc kubenswrapper[5120]: I0316 16:53:31.797437 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20f74fa1-8357-4b18-928a-4ae91c38bafe-kube-api-access-7x7ml" (OuterVolumeSpecName: "kube-api-access-7x7ml") pod "20f74fa1-8357-4b18-928a-4ae91c38bafe" (UID: "20f74fa1-8357-4b18-928a-4ae91c38bafe"). InnerVolumeSpecName "kube-api-access-7x7ml". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:53:31 crc kubenswrapper[5120]: I0316 16:53:31.807977 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ebceb235-ad03-49fd-9921-f5be8c1851be-kube-api-access-z7cdc" (OuterVolumeSpecName: "kube-api-access-z7cdc") pod "ebceb235-ad03-49fd-9921-f5be8c1851be" (UID: "ebceb235-ad03-49fd-9921-f5be8c1851be"). InnerVolumeSpecName "kube-api-access-z7cdc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:53:31 crc kubenswrapper[5120]: I0316 16:53:31.882732 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/ebceb235-ad03-49fd-9921-f5be8c1851be-httpd-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:31 crc kubenswrapper[5120]: I0316 16:53:31.882800 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7x7ml\" (UniqueName: \"kubernetes.io/projected/20f74fa1-8357-4b18-928a-4ae91c38bafe-kube-api-access-7x7ml\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:31 crc kubenswrapper[5120]: I0316 16:53:31.882820 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z7cdc\" (UniqueName: \"kubernetes.io/projected/ebceb235-ad03-49fd-9921-f5be8c1851be-kube-api-access-z7cdc\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:32 crc kubenswrapper[5120]: I0316 16:53:32.044174 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/20f74fa1-8357-4b18-928a-4ae91c38bafe-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "20f74fa1-8357-4b18-928a-4ae91c38bafe" (UID: "20f74fa1-8357-4b18-928a-4ae91c38bafe"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:32 crc kubenswrapper[5120]: I0316 16:53:32.044263 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/20f74fa1-8357-4b18-928a-4ae91c38bafe-config-data" (OuterVolumeSpecName: "config-data") pod "20f74fa1-8357-4b18-928a-4ae91c38bafe" (UID: "20f74fa1-8357-4b18-928a-4ae91c38bafe"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:32 crc kubenswrapper[5120]: I0316 16:53:32.067629 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/20f74fa1-8357-4b18-928a-4ae91c38bafe-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:32 crc kubenswrapper[5120]: I0316 16:53:32.067656 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/20f74fa1-8357-4b18-928a-4ae91c38bafe-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:32 crc kubenswrapper[5120]: I0316 16:53:32.099779 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ebceb235-ad03-49fd-9921-f5be8c1851be-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ebceb235-ad03-49fd-9921-f5be8c1851be" (UID: "ebceb235-ad03-49fd-9921-f5be8c1851be"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:32 crc kubenswrapper[5120]: I0316 16:53:32.142670 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ebceb235-ad03-49fd-9921-f5be8c1851be-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "ebceb235-ad03-49fd-9921-f5be8c1851be" (UID: "ebceb235-ad03-49fd-9921-f5be8c1851be"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:32 crc kubenswrapper[5120]: I0316 16:53:32.143197 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ebceb235-ad03-49fd-9921-f5be8c1851be-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "ebceb235-ad03-49fd-9921-f5be8c1851be" (UID: "ebceb235-ad03-49fd-9921-f5be8c1851be"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:32 crc kubenswrapper[5120]: I0316 16:53:32.161919 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ebceb235-ad03-49fd-9921-f5be8c1851be-config" (OuterVolumeSpecName: "config") pod "ebceb235-ad03-49fd-9921-f5be8c1851be" (UID: "ebceb235-ad03-49fd-9921-f5be8c1851be"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:32 crc kubenswrapper[5120]: I0316 16:53:32.187738 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/ebceb235-ad03-49fd-9921-f5be8c1851be-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:32 crc kubenswrapper[5120]: I0316 16:53:32.187789 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ebceb235-ad03-49fd-9921-f5be8c1851be-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:32 crc kubenswrapper[5120]: I0316 16:53:32.187803 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ebceb235-ad03-49fd-9921-f5be8c1851be-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:32 crc kubenswrapper[5120]: I0316 16:53:32.187815 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/ebceb235-ad03-49fd-9921-f5be8c1851be-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:32 crc kubenswrapper[5120]: I0316 16:53:32.267080 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ebceb235-ad03-49fd-9921-f5be8c1851be-ovndb-tls-certs" (OuterVolumeSpecName: "ovndb-tls-certs") pod "ebceb235-ad03-49fd-9921-f5be8c1851be" (UID: "ebceb235-ad03-49fd-9921-f5be8c1851be"). InnerVolumeSpecName "ovndb-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:32 crc kubenswrapper[5120]: I0316 16:53:32.299921 5120 reconciler_common.go:299] "Volume detached for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/ebceb235-ad03-49fd-9921-f5be8c1851be-ovndb-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:32 crc kubenswrapper[5120]: I0316 16:53:32.474807 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"641d2a6c-6871-488a-8ef3-5a2e693af389","Type":"ContainerStarted","Data":"56371b9fccc70fe0a8c507b046cef1ee741994945985f940015089be072bf75f"} Mar 16 16:53:32 crc kubenswrapper[5120]: I0316 16:53:32.479162 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"20f74fa1-8357-4b18-928a-4ae91c38bafe","Type":"ContainerDied","Data":"373f9b078574a0bf83fdff059f3e1b65042968f942e3950468d07634679a3f85"} Mar 16 16:53:32 crc kubenswrapper[5120]: I0316 16:53:32.479226 5120 scope.go:117] "RemoveContainer" containerID="377eb38e724962e46bea949d6e0d9516f23c54581a6bf4678d880ce1bdeaddd8" Mar 16 16:53:32 crc kubenswrapper[5120]: I0316 16:53:32.479175 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:53:32 crc kubenswrapper[5120]: I0316 16:53:32.497081 5120 generic.go:358] "Generic (PLEG): container finished" podID="3fd94d95-2cbb-4ec5-9413-1a2ddc6480c5" containerID="3aa559655b6f0b1f37412aa77a62ea4ba9bc14a1b72c18329bbf1a6ddbe914b3" exitCode=0 Mar 16 16:53:32 crc kubenswrapper[5120]: I0316 16:53:32.497938 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"3fd94d95-2cbb-4ec5-9413-1a2ddc6480c5","Type":"ContainerDied","Data":"3aa559655b6f0b1f37412aa77a62ea4ba9bc14a1b72c18329bbf1a6ddbe914b3"} Mar 16 16:53:32 crc kubenswrapper[5120]: I0316 16:53:32.510853 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-d7c95f898-g5nln_ebceb235-ad03-49fd-9921-f5be8c1851be/neutron-api/0.log" Mar 16 16:53:32 crc kubenswrapper[5120]: I0316 16:53:32.512292 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-d7c95f898-g5nln" Mar 16 16:53:32 crc kubenswrapper[5120]: I0316 16:53:32.519856 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-d7c95f898-g5nln" event={"ID":"ebceb235-ad03-49fd-9921-f5be8c1851be","Type":"ContainerDied","Data":"930d84eac7ee9769a915b1220e96a2bf962e2e5ee962c5e5cd7843c886ae0dce"} Mar 16 16:53:32 crc kubenswrapper[5120]: I0316 16:53:32.558913 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:53:32 crc kubenswrapper[5120]: I0316 16:53:32.577525 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:53:32 crc kubenswrapper[5120]: I0316 16:53:32.616109 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:53:32 crc kubenswrapper[5120]: I0316 16:53:32.626669 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ebceb235-ad03-49fd-9921-f5be8c1851be" containerName="neutron-httpd" Mar 16 16:53:32 crc kubenswrapper[5120]: I0316 16:53:32.626711 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ebceb235-ad03-49fd-9921-f5be8c1851be" containerName="neutron-httpd" Mar 16 16:53:32 crc kubenswrapper[5120]: I0316 16:53:32.626740 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ebceb235-ad03-49fd-9921-f5be8c1851be" containerName="neutron-api" Mar 16 16:53:32 crc kubenswrapper[5120]: I0316 16:53:32.626746 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ebceb235-ad03-49fd-9921-f5be8c1851be" containerName="neutron-api" Mar 16 16:53:32 crc kubenswrapper[5120]: I0316 16:53:32.626872 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20f74fa1-8357-4b18-928a-4ae91c38bafe" containerName="nova-scheduler-scheduler" Mar 16 16:53:32 crc kubenswrapper[5120]: I0316 16:53:32.626881 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="20f74fa1-8357-4b18-928a-4ae91c38bafe" containerName="nova-scheduler-scheduler" Mar 16 16:53:32 crc kubenswrapper[5120]: I0316 16:53:32.627241 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ebceb235-ad03-49fd-9921-f5be8c1851be" containerName="neutron-httpd" Mar 16 16:53:32 crc kubenswrapper[5120]: I0316 16:53:32.627362 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="20f74fa1-8357-4b18-928a-4ae91c38bafe" containerName="nova-scheduler-scheduler" Mar 16 16:53:32 crc kubenswrapper[5120]: I0316 16:53:32.627377 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ebceb235-ad03-49fd-9921-f5be8c1851be" containerName="neutron-api" Mar 16 16:53:32 crc kubenswrapper[5120]: I0316 16:53:32.641198 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:53:32 crc kubenswrapper[5120]: I0316 16:53:32.645326 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-scheduler-config-data\"" Mar 16 16:53:32 crc kubenswrapper[5120]: I0316 16:53:32.650457 5120 scope.go:117] "RemoveContainer" containerID="6dbf15fc5cb9e1dfb9f424295383c4a6610b03bef67f06b2717ffa77e0acef49" Mar 16 16:53:32 crc kubenswrapper[5120]: I0316 16:53:32.725330 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nk9vc\" (UniqueName: \"kubernetes.io/projected/de073433-40f2-40c4-ba26-ae8be3817e67-kube-api-access-nk9vc\") pod \"nova-scheduler-0\" (UID: \"de073433-40f2-40c4-ba26-ae8be3817e67\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:53:32 crc kubenswrapper[5120]: I0316 16:53:32.726514 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/de073433-40f2-40c4-ba26-ae8be3817e67-config-data\") pod \"nova-scheduler-0\" (UID: \"de073433-40f2-40c4-ba26-ae8be3817e67\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:53:32 crc kubenswrapper[5120]: I0316 16:53:32.726793 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/de073433-40f2-40c4-ba26-ae8be3817e67-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"de073433-40f2-40c4-ba26-ae8be3817e67\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:53:32 crc kubenswrapper[5120]: I0316 16:53:32.733835 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="20f74fa1-8357-4b18-928a-4ae91c38bafe" path="/var/lib/kubelet/pods/20f74fa1-8357-4b18-928a-4ae91c38bafe/volumes" Mar 16 16:53:32 crc kubenswrapper[5120]: I0316 16:53:32.734529 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:53:32 crc kubenswrapper[5120]: I0316 16:53:32.773682 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:53:32 crc kubenswrapper[5120]: I0316 16:53:32.794890 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="b91a9930-eec4-4af5-9aee-5d02dc78fabc" containerName="cinder-scheduler" probeResult="failure" output="Get \"http://10.217.0.137:8080/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 16:53:32 crc kubenswrapper[5120]: I0316 16:53:32.800342 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-d7c95f898-g5nln"] Mar 16 16:53:32 crc kubenswrapper[5120]: I0316 16:53:32.835315 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3fd94d95-2cbb-4ec5-9413-1a2ddc6480c5-config-data\") pod \"3fd94d95-2cbb-4ec5-9413-1a2ddc6480c5\" (UID: \"3fd94d95-2cbb-4ec5-9413-1a2ddc6480c5\") " Mar 16 16:53:32 crc kubenswrapper[5120]: I0316 16:53:32.835425 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-79m59\" (UniqueName: \"kubernetes.io/projected/3fd94d95-2cbb-4ec5-9413-1a2ddc6480c5-kube-api-access-79m59\") pod \"3fd94d95-2cbb-4ec5-9413-1a2ddc6480c5\" (UID: \"3fd94d95-2cbb-4ec5-9413-1a2ddc6480c5\") " Mar 16 16:53:32 crc kubenswrapper[5120]: I0316 16:53:32.835656 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3fd94d95-2cbb-4ec5-9413-1a2ddc6480c5-combined-ca-bundle\") pod \"3fd94d95-2cbb-4ec5-9413-1a2ddc6480c5\" (UID: \"3fd94d95-2cbb-4ec5-9413-1a2ddc6480c5\") " Mar 16 16:53:32 crc kubenswrapper[5120]: I0316 16:53:32.835723 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/3fd94d95-2cbb-4ec5-9413-1a2ddc6480c5-nova-metadata-tls-certs\") pod \"3fd94d95-2cbb-4ec5-9413-1a2ddc6480c5\" (UID: \"3fd94d95-2cbb-4ec5-9413-1a2ddc6480c5\") " Mar 16 16:53:32 crc kubenswrapper[5120]: I0316 16:53:32.835861 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3fd94d95-2cbb-4ec5-9413-1a2ddc6480c5-logs\") pod \"3fd94d95-2cbb-4ec5-9413-1a2ddc6480c5\" (UID: \"3fd94d95-2cbb-4ec5-9413-1a2ddc6480c5\") " Mar 16 16:53:32 crc kubenswrapper[5120]: I0316 16:53:32.836386 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/de073433-40f2-40c4-ba26-ae8be3817e67-config-data\") pod \"nova-scheduler-0\" (UID: \"de073433-40f2-40c4-ba26-ae8be3817e67\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:53:32 crc kubenswrapper[5120]: I0316 16:53:32.836503 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/de073433-40f2-40c4-ba26-ae8be3817e67-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"de073433-40f2-40c4-ba26-ae8be3817e67\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:53:32 crc kubenswrapper[5120]: I0316 16:53:32.836682 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nk9vc\" (UniqueName: \"kubernetes.io/projected/de073433-40f2-40c4-ba26-ae8be3817e67-kube-api-access-nk9vc\") pod \"nova-scheduler-0\" (UID: \"de073433-40f2-40c4-ba26-ae8be3817e67\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:53:32 crc kubenswrapper[5120]: I0316 16:53:32.841490 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fd94d95-2cbb-4ec5-9413-1a2ddc6480c5-logs" (OuterVolumeSpecName: "logs") pod "3fd94d95-2cbb-4ec5-9413-1a2ddc6480c5" (UID: "3fd94d95-2cbb-4ec5-9413-1a2ddc6480c5"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:53:32 crc kubenswrapper[5120]: I0316 16:53:32.863347 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/de073433-40f2-40c4-ba26-ae8be3817e67-config-data\") pod \"nova-scheduler-0\" (UID: \"de073433-40f2-40c4-ba26-ae8be3817e67\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:53:32 crc kubenswrapper[5120]: I0316 16:53:32.864270 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/de073433-40f2-40c4-ba26-ae8be3817e67-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"de073433-40f2-40c4-ba26-ae8be3817e67\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:53:32 crc kubenswrapper[5120]: I0316 16:53:32.872725 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3fd94d95-2cbb-4ec5-9413-1a2ddc6480c5-kube-api-access-79m59" (OuterVolumeSpecName: "kube-api-access-79m59") pod "3fd94d95-2cbb-4ec5-9413-1a2ddc6480c5" (UID: "3fd94d95-2cbb-4ec5-9413-1a2ddc6480c5"). InnerVolumeSpecName "kube-api-access-79m59". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:53:32 crc kubenswrapper[5120]: I0316 16:53:32.878206 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nk9vc\" (UniqueName: \"kubernetes.io/projected/de073433-40f2-40c4-ba26-ae8be3817e67-kube-api-access-nk9vc\") pod \"nova-scheduler-0\" (UID: \"de073433-40f2-40c4-ba26-ae8be3817e67\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:53:32 crc kubenswrapper[5120]: I0316 16:53:32.878296 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-d7c95f898-g5nln"] Mar 16 16:53:32 crc kubenswrapper[5120]: I0316 16:53:32.899235 5120 scope.go:117] "RemoveContainer" containerID="b24f04e9b859c0e1ed187c680ab8fe6ea7ce43f2fdccb344c3d429c318b3a988" Mar 16 16:53:32 crc kubenswrapper[5120]: I0316 16:53:32.939325 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3fd94d95-2cbb-4ec5-9413-1a2ddc6480c5-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:32 crc kubenswrapper[5120]: I0316 16:53:32.939363 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-79m59\" (UniqueName: \"kubernetes.io/projected/3fd94d95-2cbb-4ec5-9413-1a2ddc6480c5-kube-api-access-79m59\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:32 crc kubenswrapper[5120]: I0316 16:53:32.973736 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:53:33 crc kubenswrapper[5120]: I0316 16:53:33.102703 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3fd94d95-2cbb-4ec5-9413-1a2ddc6480c5-config-data" (OuterVolumeSpecName: "config-data") pod "3fd94d95-2cbb-4ec5-9413-1a2ddc6480c5" (UID: "3fd94d95-2cbb-4ec5-9413-1a2ddc6480c5"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:33 crc kubenswrapper[5120]: I0316 16:53:33.110213 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3fd94d95-2cbb-4ec5-9413-1a2ddc6480c5-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "3fd94d95-2cbb-4ec5-9413-1a2ddc6480c5" (UID: "3fd94d95-2cbb-4ec5-9413-1a2ddc6480c5"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:33 crc kubenswrapper[5120]: I0316 16:53:33.149197 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3fd94d95-2cbb-4ec5-9413-1a2ddc6480c5-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:33 crc kubenswrapper[5120]: I0316 16:53:33.150126 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3fd94d95-2cbb-4ec5-9413-1a2ddc6480c5-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:33 crc kubenswrapper[5120]: I0316 16:53:33.172230 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:53:33 crc kubenswrapper[5120]: I0316 16:53:33.215606 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3fd94d95-2cbb-4ec5-9413-1a2ddc6480c5-nova-metadata-tls-certs" (OuterVolumeSpecName: "nova-metadata-tls-certs") pod "3fd94d95-2cbb-4ec5-9413-1a2ddc6480c5" (UID: "3fd94d95-2cbb-4ec5-9413-1a2ddc6480c5"). InnerVolumeSpecName "nova-metadata-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:33 crc kubenswrapper[5120]: I0316 16:53:33.256342 5120 reconciler_common.go:299] "Volume detached for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/3fd94d95-2cbb-4ec5-9413-1a2ddc6480c5-nova-metadata-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:33 crc kubenswrapper[5120]: E0316 16:53:33.542217 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a3458e09a4d71e0651e5fbec6a91c41fed3e7b1d960d3b333305b6f923b0096e" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Mar 16 16:53:33 crc kubenswrapper[5120]: E0316 16:53:33.547929 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a3458e09a4d71e0651e5fbec6a91c41fed3e7b1d960d3b333305b6f923b0096e" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Mar 16 16:53:33 crc kubenswrapper[5120]: E0316 16:53:33.557217 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a3458e09a4d71e0651e5fbec6a91c41fed3e7b1d960d3b333305b6f923b0096e" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Mar 16 16:53:33 crc kubenswrapper[5120]: E0316 16:53:33.557282 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/ovn-northd-0" podUID="7a0880a9-40d3-4b78-890b-b24bf32a92e7" containerName="ovn-northd" probeResult="unknown" Mar 16 16:53:33 crc kubenswrapper[5120]: I0316 16:53:33.572793 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"f4cbd2d6-e498-42bf-a100-bc0c6664e7ed","Type":"ContainerStarted","Data":"40b9639555c32e6578c80a6d348c73edf56ceb2e946f1f8b6986f0d415d57bde"} Mar 16 16:53:33 crc kubenswrapper[5120]: I0316 16:53:33.586392 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"641d2a6c-6871-488a-8ef3-5a2e693af389","Type":"ContainerStarted","Data":"7176b5d9da33321180642ad022eb112218206fafae7d5f604b0312ae55cda4ee"} Mar 16 16:53:33 crc kubenswrapper[5120]: I0316 16:53:33.597794 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:53:33 crc kubenswrapper[5120]: I0316 16:53:33.598397 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"3fd94d95-2cbb-4ec5-9413-1a2ddc6480c5","Type":"ContainerDied","Data":"e489e838ccecb7288819a101ff332dc7e84a8c0684631af83eb9b9799a5f1841"} Mar 16 16:53:33 crc kubenswrapper[5120]: I0316 16:53:33.598498 5120 scope.go:117] "RemoveContainer" containerID="3aa559655b6f0b1f37412aa77a62ea4ba9bc14a1b72c18329bbf1a6ddbe914b3" Mar 16 16:53:33 crc kubenswrapper[5120]: I0316 16:53:33.605980 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"75da64f9-4c43-4411-bd20-86c98536adce","Type":"ContainerStarted","Data":"968f2c31370baabe38dba56e7264e516bb8706c445891678a7b239714c6d5115"} Mar 16 16:53:33 crc kubenswrapper[5120]: I0316 16:53:33.618724 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"9fb3c077-55b7-4693-af84-b981deb240da","Type":"ContainerStarted","Data":"249b8277425756d242d2d291ee93149d50812f92e3c309d8c713d118d0ee6ee8"} Mar 16 16:53:33 crc kubenswrapper[5120]: I0316 16:53:33.619600 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:53:33 crc kubenswrapper[5120]: I0316 16:53:33.622876 5120 generic.go:358] "Generic (PLEG): container finished" podID="802ef826-c6e7-4a1c-90a6-b419b9489007" containerID="006619dc156e3113a33f6739dc105bba228aacbe283771f23e368cd7e533a9d3" exitCode=1 Mar 16 16:53:33 crc kubenswrapper[5120]: I0316 16:53:33.624562 5120 scope.go:117] "RemoveContainer" containerID="006619dc156e3113a33f6739dc105bba228aacbe283771f23e368cd7e533a9d3" Mar 16 16:53:33 crc kubenswrapper[5120]: I0316 16:53:33.624950 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"802ef826-c6e7-4a1c-90a6-b419b9489007","Type":"ContainerDied","Data":"006619dc156e3113a33f6739dc105bba228aacbe283771f23e368cd7e533a9d3"} Mar 16 16:53:33 crc kubenswrapper[5120]: I0316 16:53:33.659213 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=3.464520167 podStartE2EDuration="12.659187551s" podCreationTimestamp="2026-03-16 16:53:21 +0000 UTC" firstStartedPulling="2026-03-16 16:53:23.094461968 +0000 UTC m=+4905.248393625" lastFinishedPulling="2026-03-16 16:53:32.289129352 +0000 UTC m=+4914.443061009" observedRunningTime="2026-03-16 16:53:33.648353445 +0000 UTC m=+4915.802285122" watchObservedRunningTime="2026-03-16 16:53:33.659187551 +0000 UTC m=+4915.813119208" Mar 16 16:53:33 crc kubenswrapper[5120]: I0316 16:53:33.683033 5120 scope.go:117] "RemoveContainer" containerID="689441178da2c3680f3bbafa950dbb9dffebf6514eab1e2411af50dc9130eb26" Mar 16 16:53:33 crc kubenswrapper[5120]: I0316 16:53:33.709903 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:53:33 crc kubenswrapper[5120]: I0316 16:53:33.738320 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:53:33 crc kubenswrapper[5120]: W0316 16:53:33.740322 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podde073433_40f2_40c4_ba26_ae8be3817e67.slice/crio-89de905e02c3bba7b47f74d8a67b0b725091b7073deb5b85af0d849c265297ee WatchSource:0}: Error finding container 89de905e02c3bba7b47f74d8a67b0b725091b7073deb5b85af0d849c265297ee: Status 404 returned error can't find the container with id 89de905e02c3bba7b47f74d8a67b0b725091b7073deb5b85af0d849c265297ee Mar 16 16:53:33 crc kubenswrapper[5120]: I0316 16:53:33.782187 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:53:33 crc kubenswrapper[5120]: I0316 16:53:33.802176 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:53:33 crc kubenswrapper[5120]: I0316 16:53:33.803889 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fd94d95-2cbb-4ec5-9413-1a2ddc6480c5" containerName="nova-metadata-metadata" Mar 16 16:53:33 crc kubenswrapper[5120]: I0316 16:53:33.803920 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fd94d95-2cbb-4ec5-9413-1a2ddc6480c5" containerName="nova-metadata-metadata" Mar 16 16:53:33 crc kubenswrapper[5120]: I0316 16:53:33.803964 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fd94d95-2cbb-4ec5-9413-1a2ddc6480c5" containerName="nova-metadata-log" Mar 16 16:53:33 crc kubenswrapper[5120]: I0316 16:53:33.803973 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fd94d95-2cbb-4ec5-9413-1a2ddc6480c5" containerName="nova-metadata-log" Mar 16 16:53:33 crc kubenswrapper[5120]: I0316 16:53:33.804263 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="3fd94d95-2cbb-4ec5-9413-1a2ddc6480c5" containerName="nova-metadata-metadata" Mar 16 16:53:33 crc kubenswrapper[5120]: I0316 16:53:33.804296 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="3fd94d95-2cbb-4ec5-9413-1a2ddc6480c5" containerName="nova-metadata-log" Mar 16 16:53:33 crc kubenswrapper[5120]: I0316 16:53:33.820025 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:53:33 crc kubenswrapper[5120]: I0316 16:53:33.820127 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:53:33 crc kubenswrapper[5120]: I0316 16:53:33.823733 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-metadata-internal-svc\"" Mar 16 16:53:33 crc kubenswrapper[5120]: I0316 16:53:33.824615 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-metadata-config-data\"" Mar 16 16:53:33 crc kubenswrapper[5120]: I0316 16:53:33.874279 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d8266cfd-9730-429f-8099-e47188d84aba-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"d8266cfd-9730-429f-8099-e47188d84aba\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:53:33 crc kubenswrapper[5120]: I0316 16:53:33.874623 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wbxb\" (UniqueName: \"kubernetes.io/projected/d8266cfd-9730-429f-8099-e47188d84aba-kube-api-access-7wbxb\") pod \"nova-metadata-0\" (UID: \"d8266cfd-9730-429f-8099-e47188d84aba\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:53:33 crc kubenswrapper[5120]: I0316 16:53:33.874662 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/d8266cfd-9730-429f-8099-e47188d84aba-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"d8266cfd-9730-429f-8099-e47188d84aba\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:53:33 crc kubenswrapper[5120]: I0316 16:53:33.874736 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d8266cfd-9730-429f-8099-e47188d84aba-config-data\") pod \"nova-metadata-0\" (UID: \"d8266cfd-9730-429f-8099-e47188d84aba\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:53:33 crc kubenswrapper[5120]: I0316 16:53:33.874791 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d8266cfd-9730-429f-8099-e47188d84aba-logs\") pod \"nova-metadata-0\" (UID: \"d8266cfd-9730-429f-8099-e47188d84aba\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:53:33 crc kubenswrapper[5120]: I0316 16:53:33.969111 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-marketplace/certified-operators-9t866" Mar 16 16:53:33 crc kubenswrapper[5120]: I0316 16:53:33.969172 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/certified-operators-9t866" Mar 16 16:53:33 crc kubenswrapper[5120]: I0316 16:53:33.977849 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d8266cfd-9730-429f-8099-e47188d84aba-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"d8266cfd-9730-429f-8099-e47188d84aba\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:53:33 crc kubenswrapper[5120]: I0316 16:53:33.977922 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7wbxb\" (UniqueName: \"kubernetes.io/projected/d8266cfd-9730-429f-8099-e47188d84aba-kube-api-access-7wbxb\") pod \"nova-metadata-0\" (UID: \"d8266cfd-9730-429f-8099-e47188d84aba\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:53:33 crc kubenswrapper[5120]: I0316 16:53:33.977965 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/d8266cfd-9730-429f-8099-e47188d84aba-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"d8266cfd-9730-429f-8099-e47188d84aba\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:53:33 crc kubenswrapper[5120]: I0316 16:53:33.978021 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d8266cfd-9730-429f-8099-e47188d84aba-config-data\") pod \"nova-metadata-0\" (UID: \"d8266cfd-9730-429f-8099-e47188d84aba\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:53:33 crc kubenswrapper[5120]: I0316 16:53:33.978068 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d8266cfd-9730-429f-8099-e47188d84aba-logs\") pod \"nova-metadata-0\" (UID: \"d8266cfd-9730-429f-8099-e47188d84aba\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:53:33 crc kubenswrapper[5120]: I0316 16:53:33.979069 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d8266cfd-9730-429f-8099-e47188d84aba-logs\") pod \"nova-metadata-0\" (UID: \"d8266cfd-9730-429f-8099-e47188d84aba\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:53:33 crc kubenswrapper[5120]: I0316 16:53:33.989603 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d8266cfd-9730-429f-8099-e47188d84aba-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"d8266cfd-9730-429f-8099-e47188d84aba\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:53:33 crc kubenswrapper[5120]: I0316 16:53:33.995237 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/d8266cfd-9730-429f-8099-e47188d84aba-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"d8266cfd-9730-429f-8099-e47188d84aba\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:53:34 crc kubenswrapper[5120]: I0316 16:53:34.000196 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d8266cfd-9730-429f-8099-e47188d84aba-config-data\") pod \"nova-metadata-0\" (UID: \"d8266cfd-9730-429f-8099-e47188d84aba\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:53:34 crc kubenswrapper[5120]: I0316 16:53:34.000540 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wbxb\" (UniqueName: \"kubernetes.io/projected/d8266cfd-9730-429f-8099-e47188d84aba-kube-api-access-7wbxb\") pod \"nova-metadata-0\" (UID: \"d8266cfd-9730-429f-8099-e47188d84aba\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:53:34 crc kubenswrapper[5120]: I0316 16:53:34.106230 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/certified-operators-9t866" Mar 16 16:53:34 crc kubenswrapper[5120]: I0316 16:53:34.150260 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:53:34 crc kubenswrapper[5120]: I0316 16:53:34.178928 5120 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:53:34 crc kubenswrapper[5120]: I0316 16:53:34.658714 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-northd-0_7a0880a9-40d3-4b78-890b-b24bf32a92e7/ovn-northd/0.log" Mar 16 16:53:34 crc kubenswrapper[5120]: I0316 16:53:34.659313 5120 generic.go:358] "Generic (PLEG): container finished" podID="7a0880a9-40d3-4b78-890b-b24bf32a92e7" containerID="a3458e09a4d71e0651e5fbec6a91c41fed3e7b1d960d3b333305b6f923b0096e" exitCode=139 Mar 16 16:53:34 crc kubenswrapper[5120]: I0316 16:53:34.659438 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"7a0880a9-40d3-4b78-890b-b24bf32a92e7","Type":"ContainerDied","Data":"a3458e09a4d71e0651e5fbec6a91c41fed3e7b1d960d3b333305b6f923b0096e"} Mar 16 16:53:34 crc kubenswrapper[5120]: I0316 16:53:34.708567 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3fd94d95-2cbb-4ec5-9413-1a2ddc6480c5" path="/var/lib/kubelet/pods/3fd94d95-2cbb-4ec5-9413-1a2ddc6480c5/volumes" Mar 16 16:53:34 crc kubenswrapper[5120]: I0316 16:53:34.710044 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ebceb235-ad03-49fd-9921-f5be8c1851be" path="/var/lib/kubelet/pods/ebceb235-ad03-49fd-9921-f5be8c1851be/volumes" Mar 16 16:53:34 crc kubenswrapper[5120]: I0316 16:53:34.711916 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:53:34 crc kubenswrapper[5120]: I0316 16:53:34.711954 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"de073433-40f2-40c4-ba26-ae8be3817e67","Type":"ContainerStarted","Data":"98f2961dcc312facfab09ff595793480ed2af349689afceae531c8d93b77cfb7"} Mar 16 16:53:34 crc kubenswrapper[5120]: I0316 16:53:34.711976 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"de073433-40f2-40c4-ba26-ae8be3817e67","Type":"ContainerStarted","Data":"89de905e02c3bba7b47f74d8a67b0b725091b7073deb5b85af0d849c265297ee"} Mar 16 16:53:34 crc kubenswrapper[5120]: I0316 16:53:34.712102 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"802ef826-c6e7-4a1c-90a6-b419b9489007","Type":"ContainerStarted","Data":"2d4d1dcb9934113a035d23ba21d07fb8336b9f2b0597239715eda669c9cb46b1"} Mar 16 16:53:34 crc kubenswrapper[5120]: I0316 16:53:34.713894 5120 generic.go:358] "Generic (PLEG): container finished" podID="04afe1ee-a37b-4e44-91b4-7e15170bb03c" containerID="1cafd98684298b497a9a5dace1436cd49b4481686c9c7fc59d805c3f984d152e" exitCode=0 Mar 16 16:53:34 crc kubenswrapper[5120]: I0316 16:53:34.714039 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"04afe1ee-a37b-4e44-91b4-7e15170bb03c","Type":"ContainerDied","Data":"1cafd98684298b497a9a5dace1436cd49b4481686c9c7fc59d805c3f984d152e"} Mar 16 16:53:34 crc kubenswrapper[5120]: I0316 16:53:34.727914 5120 generic.go:358] "Generic (PLEG): container finished" podID="67ab3338-c88c-4faf-8d25-809c92d661d9" containerID="e4e558de3bd4fc49cb2832270b5576d955ed20a2c7b4521b173f218136893e23" exitCode=1 Mar 16 16:53:34 crc kubenswrapper[5120]: I0316 16:53:34.728169 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"67ab3338-c88c-4faf-8d25-809c92d661d9","Type":"ContainerDied","Data":"e4e558de3bd4fc49cb2832270b5576d955ed20a2c7b4521b173f218136893e23"} Mar 16 16:53:34 crc kubenswrapper[5120]: I0316 16:53:34.728871 5120 scope.go:117] "RemoveContainer" containerID="e4e558de3bd4fc49cb2832270b5576d955ed20a2c7b4521b173f218136893e23" Mar 16 16:53:34 crc kubenswrapper[5120]: I0316 16:53:34.738876 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-scheduler-0" podStartSLOduration=2.7388510520000002 podStartE2EDuration="2.738851052s" podCreationTimestamp="2026-03-16 16:53:32 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:53:34.695306921 +0000 UTC m=+4916.849238578" watchObservedRunningTime="2026-03-16 16:53:34.738851052 +0000 UTC m=+4916.892782709" Mar 16 16:53:34 crc kubenswrapper[5120]: I0316 16:53:34.754979 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"f4cbd2d6-e498-42bf-a100-bc0c6664e7ed","Type":"ContainerStarted","Data":"e2e643c12f7cdcfb6338adb79128f619138495e8915b2e35a07baca76d0e267a"} Mar 16 16:53:34 crc kubenswrapper[5120]: I0316 16:53:34.755230 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:53:34 crc kubenswrapper[5120]: I0316 16:53:34.765366 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"641d2a6c-6871-488a-8ef3-5a2e693af389","Type":"ContainerStarted","Data":"826756ab0e9e22528f886e6b7834cb7cb7e3005ff151d8ffa65fc6935b62a2be"} Mar 16 16:53:34 crc kubenswrapper[5120]: I0316 16:53:34.872275 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:53:34 crc kubenswrapper[5120]: I0316 16:53:34.878502 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-external-api-0" podStartSLOduration=5.878483334 podStartE2EDuration="5.878483334s" podCreationTimestamp="2026-03-16 16:53:29 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:53:34.809699912 +0000 UTC m=+4916.963631589" watchObservedRunningTime="2026-03-16 16:53:34.878483334 +0000 UTC m=+4917.032414991" Mar 16 16:53:34 crc kubenswrapper[5120]: I0316 16:53:34.898158 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-api-0" podStartSLOduration=6.898129942 podStartE2EDuration="6.898129942s" podCreationTimestamp="2026-03-16 16:53:28 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:53:34.854338194 +0000 UTC m=+4917.008269851" watchObservedRunningTime="2026-03-16 16:53:34.898129942 +0000 UTC m=+4917.052061609" Mar 16 16:53:34 crc kubenswrapper[5120]: I0316 16:53:34.950920 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/certified-operators-9t866" Mar 16 16:53:35 crc kubenswrapper[5120]: I0316 16:53:35.067222 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-78dc5f4cb-mjvvc" podUID="152925c6-48ae-4e8d-9a3f-68f01278fe95" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.0.177:9311/healthcheck\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Mar 16 16:53:35 crc kubenswrapper[5120]: I0316 16:53:35.100586 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/certified-operators-9t866"] Mar 16 16:53:35 crc kubenswrapper[5120]: I0316 16:53:35.389229 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-northd-0_7a0880a9-40d3-4b78-890b-b24bf32a92e7/ovn-northd/0.log" Mar 16 16:53:35 crc kubenswrapper[5120]: I0316 16:53:35.389544 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:53:35 crc kubenswrapper[5120]: I0316 16:53:35.458740 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/7a0880a9-40d3-4b78-890b-b24bf32a92e7-scripts\") pod \"7a0880a9-40d3-4b78-890b-b24bf32a92e7\" (UID: \"7a0880a9-40d3-4b78-890b-b24bf32a92e7\") " Mar 16 16:53:35 crc kubenswrapper[5120]: I0316 16:53:35.459083 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7a0880a9-40d3-4b78-890b-b24bf32a92e7-combined-ca-bundle\") pod \"7a0880a9-40d3-4b78-890b-b24bf32a92e7\" (UID: \"7a0880a9-40d3-4b78-890b-b24bf32a92e7\") " Mar 16 16:53:35 crc kubenswrapper[5120]: I0316 16:53:35.459153 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/7a0880a9-40d3-4b78-890b-b24bf32a92e7-metrics-certs-tls-certs\") pod \"7a0880a9-40d3-4b78-890b-b24bf32a92e7\" (UID: \"7a0880a9-40d3-4b78-890b-b24bf32a92e7\") " Mar 16 16:53:35 crc kubenswrapper[5120]: I0316 16:53:35.459269 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/7a0880a9-40d3-4b78-890b-b24bf32a92e7-ovn-northd-tls-certs\") pod \"7a0880a9-40d3-4b78-890b-b24bf32a92e7\" (UID: \"7a0880a9-40d3-4b78-890b-b24bf32a92e7\") " Mar 16 16:53:35 crc kubenswrapper[5120]: I0316 16:53:35.459432 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/7a0880a9-40d3-4b78-890b-b24bf32a92e7-ovn-rundir\") pod \"7a0880a9-40d3-4b78-890b-b24bf32a92e7\" (UID: \"7a0880a9-40d3-4b78-890b-b24bf32a92e7\") " Mar 16 16:53:35 crc kubenswrapper[5120]: I0316 16:53:35.459475 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7a0880a9-40d3-4b78-890b-b24bf32a92e7-config\") pod \"7a0880a9-40d3-4b78-890b-b24bf32a92e7\" (UID: \"7a0880a9-40d3-4b78-890b-b24bf32a92e7\") " Mar 16 16:53:35 crc kubenswrapper[5120]: I0316 16:53:35.459752 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rxs8t\" (UniqueName: \"kubernetes.io/projected/7a0880a9-40d3-4b78-890b-b24bf32a92e7-kube-api-access-rxs8t\") pod \"7a0880a9-40d3-4b78-890b-b24bf32a92e7\" (UID: \"7a0880a9-40d3-4b78-890b-b24bf32a92e7\") " Mar 16 16:53:35 crc kubenswrapper[5120]: I0316 16:53:35.462727 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7a0880a9-40d3-4b78-890b-b24bf32a92e7-scripts" (OuterVolumeSpecName: "scripts") pod "7a0880a9-40d3-4b78-890b-b24bf32a92e7" (UID: "7a0880a9-40d3-4b78-890b-b24bf32a92e7"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:53:35 crc kubenswrapper[5120]: I0316 16:53:35.463145 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a0880a9-40d3-4b78-890b-b24bf32a92e7-ovn-rundir" (OuterVolumeSpecName: "ovn-rundir") pod "7a0880a9-40d3-4b78-890b-b24bf32a92e7" (UID: "7a0880a9-40d3-4b78-890b-b24bf32a92e7"). InnerVolumeSpecName "ovn-rundir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:53:35 crc kubenswrapper[5120]: I0316 16:53:35.463987 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7a0880a9-40d3-4b78-890b-b24bf32a92e7-config" (OuterVolumeSpecName: "config") pod "7a0880a9-40d3-4b78-890b-b24bf32a92e7" (UID: "7a0880a9-40d3-4b78-890b-b24bf32a92e7"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:53:35 crc kubenswrapper[5120]: I0316 16:53:35.488314 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a0880a9-40d3-4b78-890b-b24bf32a92e7-kube-api-access-rxs8t" (OuterVolumeSpecName: "kube-api-access-rxs8t") pod "7a0880a9-40d3-4b78-890b-b24bf32a92e7" (UID: "7a0880a9-40d3-4b78-890b-b24bf32a92e7"). InnerVolumeSpecName "kube-api-access-rxs8t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:53:35 crc kubenswrapper[5120]: I0316 16:53:35.523042 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7a0880a9-40d3-4b78-890b-b24bf32a92e7-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "7a0880a9-40d3-4b78-890b-b24bf32a92e7" (UID: "7a0880a9-40d3-4b78-890b-b24bf32a92e7"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:35 crc kubenswrapper[5120]: I0316 16:53:35.564127 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/7a0880a9-40d3-4b78-890b-b24bf32a92e7-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:35 crc kubenswrapper[5120]: I0316 16:53:35.564166 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7a0880a9-40d3-4b78-890b-b24bf32a92e7-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:35 crc kubenswrapper[5120]: I0316 16:53:35.564182 5120 reconciler_common.go:299] "Volume detached for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/7a0880a9-40d3-4b78-890b-b24bf32a92e7-ovn-rundir\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:35 crc kubenswrapper[5120]: I0316 16:53:35.564194 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7a0880a9-40d3-4b78-890b-b24bf32a92e7-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:35 crc kubenswrapper[5120]: I0316 16:53:35.564206 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rxs8t\" (UniqueName: \"kubernetes.io/projected/7a0880a9-40d3-4b78-890b-b24bf32a92e7-kube-api-access-rxs8t\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:35 crc kubenswrapper[5120]: I0316 16:53:35.603887 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7a0880a9-40d3-4b78-890b-b24bf32a92e7-ovn-northd-tls-certs" (OuterVolumeSpecName: "ovn-northd-tls-certs") pod "7a0880a9-40d3-4b78-890b-b24bf32a92e7" (UID: "7a0880a9-40d3-4b78-890b-b24bf32a92e7"). InnerVolumeSpecName "ovn-northd-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:35 crc kubenswrapper[5120]: I0316 16:53:35.611117 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7a0880a9-40d3-4b78-890b-b24bf32a92e7-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "7a0880a9-40d3-4b78-890b-b24bf32a92e7" (UID: "7a0880a9-40d3-4b78-890b-b24bf32a92e7"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:35 crc kubenswrapper[5120]: I0316 16:53:35.666955 5120 reconciler_common.go:299] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/7a0880a9-40d3-4b78-890b-b24bf32a92e7-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:35 crc kubenswrapper[5120]: I0316 16:53:35.667328 5120 reconciler_common.go:299] "Volume detached for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/7a0880a9-40d3-4b78-890b-b24bf32a92e7-ovn-northd-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:35 crc kubenswrapper[5120]: I0316 16:53:35.694206 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-f67b885f6-v4nhp" podUID="133b5e0f-d834-4c59-932f-957221e1727b" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.0.172:9311/healthcheck\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Mar 16 16:53:35 crc kubenswrapper[5120]: I0316 16:53:35.695198 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-f67b885f6-v4nhp" podUID="133b5e0f-d834-4c59-932f-957221e1727b" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.0.172:9311/healthcheck\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Mar 16 16:53:35 crc kubenswrapper[5120]: I0316 16:53:35.733137 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openstack-kuttl-tests/barbican-api-78dc5f4cb-mjvvc" podUID="152925c6-48ae-4e8d-9a3f-68f01278fe95" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.0.177:9311/healthcheck\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Mar 16 16:53:35 crc kubenswrapper[5120]: I0316 16:53:35.840163 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"d8266cfd-9730-429f-8099-e47188d84aba","Type":"ContainerStarted","Data":"42374085eaca804906c313aa98010944f07a179e2d3659eeaa28517e25559e00"} Mar 16 16:53:35 crc kubenswrapper[5120]: I0316 16:53:35.840206 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"d8266cfd-9730-429f-8099-e47188d84aba","Type":"ContainerStarted","Data":"973b2d4981e371f1cc5894f46a549c77f1c7936997a498bb3f11cd02c0d5db5f"} Mar 16 16:53:35 crc kubenswrapper[5120]: I0316 16:53:35.840218 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"d8266cfd-9730-429f-8099-e47188d84aba","Type":"ContainerStarted","Data":"51c425cf4357e6ecd42aee8389e8d6e5b075f40f3c562778920df4f48130c8fc"} Mar 16 16:53:35 crc kubenswrapper[5120]: I0316 16:53:35.847465 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-northd-0_7a0880a9-40d3-4b78-890b-b24bf32a92e7/ovn-northd/0.log" Mar 16 16:53:35 crc kubenswrapper[5120]: I0316 16:53:35.847626 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"7a0880a9-40d3-4b78-890b-b24bf32a92e7","Type":"ContainerDied","Data":"20dc51b68de4802c753ddbf5f24db10c06ec689312f518cc67372e818b0937d6"} Mar 16 16:53:35 crc kubenswrapper[5120]: I0316 16:53:35.847629 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:53:35 crc kubenswrapper[5120]: I0316 16:53:35.847667 5120 scope.go:117] "RemoveContainer" containerID="7213e8e9b799a96b6ff80514b1848fb42533aa0a7675eb0549aa13994cc33042" Mar 16 16:53:35 crc kubenswrapper[5120]: I0316 16:53:35.855783 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"75da64f9-4c43-4411-bd20-86c98536adce","Type":"ContainerStarted","Data":"604ac1b473e83981dc6e83e9cc0546a3e637ff7121dd9f429ddbfd0ea4f6823a"} Mar 16 16:53:35 crc kubenswrapper[5120]: I0316 16:53:35.870154 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=2.8701335759999997 podStartE2EDuration="2.870133576s" podCreationTimestamp="2026-03-16 16:53:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:53:35.864172033 +0000 UTC m=+4918.018103710" watchObservedRunningTime="2026-03-16 16:53:35.870133576 +0000 UTC m=+4918.024065233" Mar 16 16:53:35 crc kubenswrapper[5120]: I0316 16:53:35.874922 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"04afe1ee-a37b-4e44-91b4-7e15170bb03c","Type":"ContainerStarted","Data":"66c1f61e65b0dd0d9cb8fc1e91a6641115210d2e6e711f0e4a45b8424b0076ef"} Mar 16 16:53:35 crc kubenswrapper[5120]: I0316 16:53:35.887045 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"67ab3338-c88c-4faf-8d25-809c92d661d9","Type":"ContainerStarted","Data":"a6779b90220d6a446bba6efdb7cf0c284ae282978d42ec7fdb0283bc2a59e6a9"} Mar 16 16:53:35 crc kubenswrapper[5120]: I0316 16:53:35.890108 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:53:35 crc kubenswrapper[5120]: I0316 16:53:35.892592 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-internal-api-0" podStartSLOduration=6.89257688 podStartE2EDuration="6.89257688s" podCreationTimestamp="2026-03-16 16:53:29 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:53:35.890856603 +0000 UTC m=+4918.044788270" watchObservedRunningTime="2026-03-16 16:53:35.89257688 +0000 UTC m=+4918.046508537" Mar 16 16:53:35 crc kubenswrapper[5120]: I0316 16:53:35.910811 5120 scope.go:117] "RemoveContainer" containerID="a3458e09a4d71e0651e5fbec6a91c41fed3e7b1d960d3b333305b6f923b0096e" Mar 16 16:53:35 crc kubenswrapper[5120]: I0316 16:53:35.956801 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 16:53:35 crc kubenswrapper[5120]: I0316 16:53:35.986936 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 16:53:36 crc kubenswrapper[5120]: I0316 16:53:36.029118 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 16:53:36 crc kubenswrapper[5120]: I0316 16:53:36.030295 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a0880a9-40d3-4b78-890b-b24bf32a92e7" containerName="openstack-network-exporter" Mar 16 16:53:36 crc kubenswrapper[5120]: I0316 16:53:36.030316 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a0880a9-40d3-4b78-890b-b24bf32a92e7" containerName="openstack-network-exporter" Mar 16 16:53:36 crc kubenswrapper[5120]: I0316 16:53:36.030381 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a0880a9-40d3-4b78-890b-b24bf32a92e7" containerName="ovn-northd" Mar 16 16:53:36 crc kubenswrapper[5120]: I0316 16:53:36.030391 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a0880a9-40d3-4b78-890b-b24bf32a92e7" containerName="ovn-northd" Mar 16 16:53:36 crc kubenswrapper[5120]: I0316 16:53:36.030596 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7a0880a9-40d3-4b78-890b-b24bf32a92e7" containerName="openstack-network-exporter" Mar 16 16:53:36 crc kubenswrapper[5120]: I0316 16:53:36.030623 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7a0880a9-40d3-4b78-890b-b24bf32a92e7" containerName="ovn-northd" Mar 16 16:53:36 crc kubenswrapper[5120]: I0316 16:53:36.048339 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstack-cell1-galera-0" podStartSLOduration=11.048314332 podStartE2EDuration="11.048314332s" podCreationTimestamp="2026-03-16 16:53:25 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:53:35.974296597 +0000 UTC m=+4918.128228274" watchObservedRunningTime="2026-03-16 16:53:36.048314332 +0000 UTC m=+4918.202245989" Mar 16 16:53:36 crc kubenswrapper[5120]: I0316 16:53:36.053418 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 16:53:36 crc kubenswrapper[5120]: I0316 16:53:36.053554 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:53:36 crc kubenswrapper[5120]: I0316 16:53:36.056217 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ovnnorthd-ovndbs\"" Mar 16 16:53:36 crc kubenswrapper[5120]: I0316 16:53:36.056404 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovnnorthd-scripts\"" Mar 16 16:53:36 crc kubenswrapper[5120]: I0316 16:53:36.056536 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ovnnorthd-ovnnorthd-dockercfg-gxfx7\"" Mar 16 16:53:36 crc kubenswrapper[5120]: I0316 16:53:36.061365 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovnnorthd-config\"" Mar 16 16:53:36 crc kubenswrapper[5120]: I0316 16:53:36.098528 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/d2f6e14c-b704-4805-b5fa-33de25bc4f0f-scripts\") pod \"ovn-northd-0\" (UID: \"d2f6e14c-b704-4805-b5fa-33de25bc4f0f\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:53:36 crc kubenswrapper[5120]: I0316 16:53:36.098875 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/d2f6e14c-b704-4805-b5fa-33de25bc4f0f-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"d2f6e14c-b704-4805-b5fa-33de25bc4f0f\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:53:36 crc kubenswrapper[5120]: I0316 16:53:36.098981 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/d2f6e14c-b704-4805-b5fa-33de25bc4f0f-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"d2f6e14c-b704-4805-b5fa-33de25bc4f0f\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:53:36 crc kubenswrapper[5120]: I0316 16:53:36.099028 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d2f6e14c-b704-4805-b5fa-33de25bc4f0f-config\") pod \"ovn-northd-0\" (UID: \"d2f6e14c-b704-4805-b5fa-33de25bc4f0f\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:53:36 crc kubenswrapper[5120]: I0316 16:53:36.099107 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-px7h2\" (UniqueName: \"kubernetes.io/projected/d2f6e14c-b704-4805-b5fa-33de25bc4f0f-kube-api-access-px7h2\") pod \"ovn-northd-0\" (UID: \"d2f6e14c-b704-4805-b5fa-33de25bc4f0f\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:53:36 crc kubenswrapper[5120]: I0316 16:53:36.099403 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d2f6e14c-b704-4805-b5fa-33de25bc4f0f-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"d2f6e14c-b704-4805-b5fa-33de25bc4f0f\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:53:36 crc kubenswrapper[5120]: I0316 16:53:36.099535 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/d2f6e14c-b704-4805-b5fa-33de25bc4f0f-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"d2f6e14c-b704-4805-b5fa-33de25bc4f0f\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:53:36 crc kubenswrapper[5120]: I0316 16:53:36.202211 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/d2f6e14c-b704-4805-b5fa-33de25bc4f0f-scripts\") pod \"ovn-northd-0\" (UID: \"d2f6e14c-b704-4805-b5fa-33de25bc4f0f\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:53:36 crc kubenswrapper[5120]: I0316 16:53:36.202406 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/d2f6e14c-b704-4805-b5fa-33de25bc4f0f-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"d2f6e14c-b704-4805-b5fa-33de25bc4f0f\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:53:36 crc kubenswrapper[5120]: I0316 16:53:36.202491 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/d2f6e14c-b704-4805-b5fa-33de25bc4f0f-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"d2f6e14c-b704-4805-b5fa-33de25bc4f0f\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:53:36 crc kubenswrapper[5120]: I0316 16:53:36.202515 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d2f6e14c-b704-4805-b5fa-33de25bc4f0f-config\") pod \"ovn-northd-0\" (UID: \"d2f6e14c-b704-4805-b5fa-33de25bc4f0f\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:53:36 crc kubenswrapper[5120]: I0316 16:53:36.202539 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-px7h2\" (UniqueName: \"kubernetes.io/projected/d2f6e14c-b704-4805-b5fa-33de25bc4f0f-kube-api-access-px7h2\") pod \"ovn-northd-0\" (UID: \"d2f6e14c-b704-4805-b5fa-33de25bc4f0f\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:53:36 crc kubenswrapper[5120]: I0316 16:53:36.202888 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d2f6e14c-b704-4805-b5fa-33de25bc4f0f-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"d2f6e14c-b704-4805-b5fa-33de25bc4f0f\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:53:36 crc kubenswrapper[5120]: I0316 16:53:36.202998 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/d2f6e14c-b704-4805-b5fa-33de25bc4f0f-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"d2f6e14c-b704-4805-b5fa-33de25bc4f0f\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:53:36 crc kubenswrapper[5120]: I0316 16:53:36.203066 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/d2f6e14c-b704-4805-b5fa-33de25bc4f0f-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"d2f6e14c-b704-4805-b5fa-33de25bc4f0f\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:53:36 crc kubenswrapper[5120]: I0316 16:53:36.203337 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/d2f6e14c-b704-4805-b5fa-33de25bc4f0f-scripts\") pod \"ovn-northd-0\" (UID: \"d2f6e14c-b704-4805-b5fa-33de25bc4f0f\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:53:36 crc kubenswrapper[5120]: I0316 16:53:36.203546 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d2f6e14c-b704-4805-b5fa-33de25bc4f0f-config\") pod \"ovn-northd-0\" (UID: \"d2f6e14c-b704-4805-b5fa-33de25bc4f0f\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:53:36 crc kubenswrapper[5120]: I0316 16:53:36.209266 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/d2f6e14c-b704-4805-b5fa-33de25bc4f0f-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"d2f6e14c-b704-4805-b5fa-33de25bc4f0f\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:53:36 crc kubenswrapper[5120]: I0316 16:53:36.209636 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d2f6e14c-b704-4805-b5fa-33de25bc4f0f-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"d2f6e14c-b704-4805-b5fa-33de25bc4f0f\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:53:36 crc kubenswrapper[5120]: I0316 16:53:36.211440 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/d2f6e14c-b704-4805-b5fa-33de25bc4f0f-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"d2f6e14c-b704-4805-b5fa-33de25bc4f0f\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:53:36 crc kubenswrapper[5120]: I0316 16:53:36.223641 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-px7h2\" (UniqueName: \"kubernetes.io/projected/d2f6e14c-b704-4805-b5fa-33de25bc4f0f-kube-api-access-px7h2\") pod \"ovn-northd-0\" (UID: \"d2f6e14c-b704-4805-b5fa-33de25bc4f0f\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:53:36 crc kubenswrapper[5120]: I0316 16:53:36.378797 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:53:36 crc kubenswrapper[5120]: I0316 16:53:36.676238 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7a0880a9-40d3-4b78-890b-b24bf32a92e7" path="/var/lib/kubelet/pods/7a0880a9-40d3-4b78-890b-b24bf32a92e7/volumes" Mar 16 16:53:36 crc kubenswrapper[5120]: I0316 16:53:36.876918 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 16:53:36 crc kubenswrapper[5120]: W0316 16:53:36.880220 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd2f6e14c_b704_4805_b5fa_33de25bc4f0f.slice/crio-cb8977e4e013f9a8ad7b9c759468e03fb46f813c14e9512a43b067f8ad253bac WatchSource:0}: Error finding container cb8977e4e013f9a8ad7b9c759468e03fb46f813c14e9512a43b067f8ad253bac: Status 404 returned error can't find the container with id cb8977e4e013f9a8ad7b9c759468e03fb46f813c14e9512a43b067f8ad253bac Mar 16 16:53:36 crc kubenswrapper[5120]: I0316 16:53:36.904153 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"d2f6e14c-b704-4805-b5fa-33de25bc4f0f","Type":"ContainerStarted","Data":"cb8977e4e013f9a8ad7b9c759468e03fb46f813c14e9512a43b067f8ad253bac"} Mar 16 16:53:36 crc kubenswrapper[5120]: I0316 16:53:36.904582 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-marketplace/certified-operators-9t866" podUID="e7bf94ef-c84b-45ee-a2d9-dd048b1172e3" containerName="registry-server" containerID="cri-o://8181605dced90e54e79d2fb8146ad7ccea5081877322f388ef0f78faeeb0c001" gracePeriod=2 Mar 16 16:53:37 crc kubenswrapper[5120]: I0316 16:53:37.356015 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-9t866" Mar 16 16:53:37 crc kubenswrapper[5120]: I0316 16:53:37.440312 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/e7bf94ef-c84b-45ee-a2d9-dd048b1172e3-catalog-content\") pod \"e7bf94ef-c84b-45ee-a2d9-dd048b1172e3\" (UID: \"e7bf94ef-c84b-45ee-a2d9-dd048b1172e3\") " Mar 16 16:53:37 crc kubenswrapper[5120]: I0316 16:53:37.440819 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/e7bf94ef-c84b-45ee-a2d9-dd048b1172e3-utilities\") pod \"e7bf94ef-c84b-45ee-a2d9-dd048b1172e3\" (UID: \"e7bf94ef-c84b-45ee-a2d9-dd048b1172e3\") " Mar 16 16:53:37 crc kubenswrapper[5120]: I0316 16:53:37.440892 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vtmzv\" (UniqueName: \"kubernetes.io/projected/e7bf94ef-c84b-45ee-a2d9-dd048b1172e3-kube-api-access-vtmzv\") pod \"e7bf94ef-c84b-45ee-a2d9-dd048b1172e3\" (UID: \"e7bf94ef-c84b-45ee-a2d9-dd048b1172e3\") " Mar 16 16:53:37 crc kubenswrapper[5120]: I0316 16:53:37.441849 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7bf94ef-c84b-45ee-a2d9-dd048b1172e3-utilities" (OuterVolumeSpecName: "utilities") pod "e7bf94ef-c84b-45ee-a2d9-dd048b1172e3" (UID: "e7bf94ef-c84b-45ee-a2d9-dd048b1172e3"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:53:37 crc kubenswrapper[5120]: I0316 16:53:37.447077 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7bf94ef-c84b-45ee-a2d9-dd048b1172e3-kube-api-access-vtmzv" (OuterVolumeSpecName: "kube-api-access-vtmzv") pod "e7bf94ef-c84b-45ee-a2d9-dd048b1172e3" (UID: "e7bf94ef-c84b-45ee-a2d9-dd048b1172e3"). InnerVolumeSpecName "kube-api-access-vtmzv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:53:37 crc kubenswrapper[5120]: I0316 16:53:37.479986 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7bf94ef-c84b-45ee-a2d9-dd048b1172e3-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "e7bf94ef-c84b-45ee-a2d9-dd048b1172e3" (UID: "e7bf94ef-c84b-45ee-a2d9-dd048b1172e3"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:53:37 crc kubenswrapper[5120]: I0316 16:53:37.544714 5120 reconciler_common.go:299] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/e7bf94ef-c84b-45ee-a2d9-dd048b1172e3-utilities\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:37 crc kubenswrapper[5120]: I0316 16:53:37.544856 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vtmzv\" (UniqueName: \"kubernetes.io/projected/e7bf94ef-c84b-45ee-a2d9-dd048b1172e3-kube-api-access-vtmzv\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:37 crc kubenswrapper[5120]: I0316 16:53:37.544870 5120 reconciler_common.go:299] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/e7bf94ef-c84b-45ee-a2d9-dd048b1172e3-catalog-content\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:37 crc kubenswrapper[5120]: I0316 16:53:37.841395 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="b91a9930-eec4-4af5-9aee-5d02dc78fabc" containerName="cinder-scheduler" probeResult="failure" output="Get \"http://10.217.0.137:8080/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 16:53:37 crc kubenswrapper[5120]: I0316 16:53:37.945364 5120 generic.go:358] "Generic (PLEG): container finished" podID="e7bf94ef-c84b-45ee-a2d9-dd048b1172e3" containerID="8181605dced90e54e79d2fb8146ad7ccea5081877322f388ef0f78faeeb0c001" exitCode=0 Mar 16 16:53:37 crc kubenswrapper[5120]: I0316 16:53:37.945511 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-9t866" Mar 16 16:53:37 crc kubenswrapper[5120]: I0316 16:53:37.945549 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-9t866" event={"ID":"e7bf94ef-c84b-45ee-a2d9-dd048b1172e3","Type":"ContainerDied","Data":"8181605dced90e54e79d2fb8146ad7ccea5081877322f388ef0f78faeeb0c001"} Mar 16 16:53:37 crc kubenswrapper[5120]: I0316 16:53:37.945635 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-9t866" event={"ID":"e7bf94ef-c84b-45ee-a2d9-dd048b1172e3","Type":"ContainerDied","Data":"fc9446d25dc326bae63abeb98bb620dc50cfbf089e4c9935c8e1aa3f2cb86a9c"} Mar 16 16:53:37 crc kubenswrapper[5120]: I0316 16:53:37.945668 5120 scope.go:117] "RemoveContainer" containerID="8181605dced90e54e79d2fb8146ad7ccea5081877322f388ef0f78faeeb0c001" Mar 16 16:53:37 crc kubenswrapper[5120]: I0316 16:53:37.954954 5120 generic.go:358] "Generic (PLEG): container finished" podID="802ef826-c6e7-4a1c-90a6-b419b9489007" containerID="2d4d1dcb9934113a035d23ba21d07fb8336b9f2b0597239715eda669c9cb46b1" exitCode=1 Mar 16 16:53:37 crc kubenswrapper[5120]: I0316 16:53:37.955052 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"802ef826-c6e7-4a1c-90a6-b419b9489007","Type":"ContainerDied","Data":"2d4d1dcb9934113a035d23ba21d07fb8336b9f2b0597239715eda669c9cb46b1"} Mar 16 16:53:37 crc kubenswrapper[5120]: I0316 16:53:37.956006 5120 scope.go:117] "RemoveContainer" containerID="2d4d1dcb9934113a035d23ba21d07fb8336b9f2b0597239715eda669c9cb46b1" Mar 16 16:53:37 crc kubenswrapper[5120]: E0316 16:53:37.956552 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nova-cell0-conductor-conductor\" with CrashLoopBackOff: \"back-off 10s restarting failed container=nova-cell0-conductor-conductor pod=nova-cell0-conductor-0_openstack-kuttl-tests(802ef826-c6e7-4a1c-90a6-b419b9489007)\"" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="802ef826-c6e7-4a1c-90a6-b419b9489007" Mar 16 16:53:37 crc kubenswrapper[5120]: I0316 16:53:37.964395 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"d2f6e14c-b704-4805-b5fa-33de25bc4f0f","Type":"ContainerStarted","Data":"17ca7c826c304f51fb924754427aadc5afd13c084da739b85388c42c18fc61f1"} Mar 16 16:53:37 crc kubenswrapper[5120]: I0316 16:53:37.964440 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"d2f6e14c-b704-4805-b5fa-33de25bc4f0f","Type":"ContainerStarted","Data":"02d4b3980426703b64bb4594387bb6ec9a3bd1e0687735c81eacb5de5e3a1047"} Mar 16 16:53:37 crc kubenswrapper[5120]: I0316 16:53:37.965010 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:53:37 crc kubenswrapper[5120]: I0316 16:53:37.974483 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:53:38 crc kubenswrapper[5120]: I0316 16:53:38.017787 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovn-northd-0" podStartSLOduration=3.017743667 podStartE2EDuration="3.017743667s" podCreationTimestamp="2026-03-16 16:53:35 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:53:37.995088567 +0000 UTC m=+4920.149020234" watchObservedRunningTime="2026-03-16 16:53:38.017743667 +0000 UTC m=+4920.171675324" Mar 16 16:53:38 crc kubenswrapper[5120]: I0316 16:53:38.020138 5120 scope.go:117] "RemoveContainer" containerID="3d66efb0074bfc58dbf37d2c67968a0934841f6612fefbd737bec2909aedd21a" Mar 16 16:53:38 crc kubenswrapper[5120]: I0316 16:53:38.042307 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/certified-operators-9t866"] Mar 16 16:53:38 crc kubenswrapper[5120]: I0316 16:53:38.057297 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/certified-operators-9t866"] Mar 16 16:53:38 crc kubenswrapper[5120]: I0316 16:53:38.066573 5120 scope.go:117] "RemoveContainer" containerID="ca2994fb2295e6ee68175a99f1d2c7df1947a5932c1ee255c1044ea488131472" Mar 16 16:53:38 crc kubenswrapper[5120]: I0316 16:53:38.104954 5120 scope.go:117] "RemoveContainer" containerID="8181605dced90e54e79d2fb8146ad7ccea5081877322f388ef0f78faeeb0c001" Mar 16 16:53:38 crc kubenswrapper[5120]: E0316 16:53:38.106065 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8181605dced90e54e79d2fb8146ad7ccea5081877322f388ef0f78faeeb0c001\": container with ID starting with 8181605dced90e54e79d2fb8146ad7ccea5081877322f388ef0f78faeeb0c001 not found: ID does not exist" containerID="8181605dced90e54e79d2fb8146ad7ccea5081877322f388ef0f78faeeb0c001" Mar 16 16:53:38 crc kubenswrapper[5120]: I0316 16:53:38.106112 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8181605dced90e54e79d2fb8146ad7ccea5081877322f388ef0f78faeeb0c001"} err="failed to get container status \"8181605dced90e54e79d2fb8146ad7ccea5081877322f388ef0f78faeeb0c001\": rpc error: code = NotFound desc = could not find container \"8181605dced90e54e79d2fb8146ad7ccea5081877322f388ef0f78faeeb0c001\": container with ID starting with 8181605dced90e54e79d2fb8146ad7ccea5081877322f388ef0f78faeeb0c001 not found: ID does not exist" Mar 16 16:53:38 crc kubenswrapper[5120]: I0316 16:53:38.106137 5120 scope.go:117] "RemoveContainer" containerID="3d66efb0074bfc58dbf37d2c67968a0934841f6612fefbd737bec2909aedd21a" Mar 16 16:53:38 crc kubenswrapper[5120]: E0316 16:53:38.106536 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d66efb0074bfc58dbf37d2c67968a0934841f6612fefbd737bec2909aedd21a\": container with ID starting with 3d66efb0074bfc58dbf37d2c67968a0934841f6612fefbd737bec2909aedd21a not found: ID does not exist" containerID="3d66efb0074bfc58dbf37d2c67968a0934841f6612fefbd737bec2909aedd21a" Mar 16 16:53:38 crc kubenswrapper[5120]: I0316 16:53:38.106571 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d66efb0074bfc58dbf37d2c67968a0934841f6612fefbd737bec2909aedd21a"} err="failed to get container status \"3d66efb0074bfc58dbf37d2c67968a0934841f6612fefbd737bec2909aedd21a\": rpc error: code = NotFound desc = could not find container \"3d66efb0074bfc58dbf37d2c67968a0934841f6612fefbd737bec2909aedd21a\": container with ID starting with 3d66efb0074bfc58dbf37d2c67968a0934841f6612fefbd737bec2909aedd21a not found: ID does not exist" Mar 16 16:53:38 crc kubenswrapper[5120]: I0316 16:53:38.106589 5120 scope.go:117] "RemoveContainer" containerID="ca2994fb2295e6ee68175a99f1d2c7df1947a5932c1ee255c1044ea488131472" Mar 16 16:53:38 crc kubenswrapper[5120]: E0316 16:53:38.106945 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca2994fb2295e6ee68175a99f1d2c7df1947a5932c1ee255c1044ea488131472\": container with ID starting with ca2994fb2295e6ee68175a99f1d2c7df1947a5932c1ee255c1044ea488131472 not found: ID does not exist" containerID="ca2994fb2295e6ee68175a99f1d2c7df1947a5932c1ee255c1044ea488131472" Mar 16 16:53:38 crc kubenswrapper[5120]: I0316 16:53:38.106969 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca2994fb2295e6ee68175a99f1d2c7df1947a5932c1ee255c1044ea488131472"} err="failed to get container status \"ca2994fb2295e6ee68175a99f1d2c7df1947a5932c1ee255c1044ea488131472\": rpc error: code = NotFound desc = could not find container \"ca2994fb2295e6ee68175a99f1d2c7df1947a5932c1ee255c1044ea488131472\": container with ID starting with ca2994fb2295e6ee68175a99f1d2c7df1947a5932c1ee255c1044ea488131472 not found: ID does not exist" Mar 16 16:53:38 crc kubenswrapper[5120]: I0316 16:53:38.106986 5120 scope.go:117] "RemoveContainer" containerID="006619dc156e3113a33f6739dc105bba228aacbe283771f23e368cd7e533a9d3" Mar 16 16:53:38 crc kubenswrapper[5120]: I0316 16:53:38.173448 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:53:38 crc kubenswrapper[5120]: I0316 16:53:38.174123 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:53:38 crc kubenswrapper[5120]: I0316 16:53:38.174171 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:53:38 crc kubenswrapper[5120]: I0316 16:53:38.200337 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:53:38 crc kubenswrapper[5120]: I0316 16:53:38.237607 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:53:38 crc kubenswrapper[5120]: I0316 16:53:38.237660 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:53:38 crc kubenswrapper[5120]: I0316 16:53:38.319887 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:53:38 crc kubenswrapper[5120]: I0316 16:53:38.365621 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:53:38 crc kubenswrapper[5120]: I0316 16:53:38.365979 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:53:38 crc kubenswrapper[5120]: I0316 16:53:38.448793 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:53:38 crc kubenswrapper[5120]: I0316 16:53:38.635098 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/memcached-0" Mar 16 16:53:38 crc kubenswrapper[5120]: I0316 16:53:38.678910 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e7bf94ef-c84b-45ee-a2d9-dd048b1172e3" path="/var/lib/kubelet/pods/e7bf94ef-c84b-45ee-a2d9-dd048b1172e3/volumes" Mar 16 16:53:38 crc kubenswrapper[5120]: I0316 16:53:38.737025 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openstack-kuttl-tests/barbican-api-78dc5f4cb-mjvvc" podUID="152925c6-48ae-4e8d-9a3f-68f01278fe95" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.0.177:9311/healthcheck\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 16:53:38 crc kubenswrapper[5120]: I0316 16:53:38.982199 5120 generic.go:358] "Generic (PLEG): container finished" podID="67ab3338-c88c-4faf-8d25-809c92d661d9" containerID="a6779b90220d6a446bba6efdb7cf0c284ae282978d42ec7fdb0283bc2a59e6a9" exitCode=1 Mar 16 16:53:38 crc kubenswrapper[5120]: I0316 16:53:38.982324 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"67ab3338-c88c-4faf-8d25-809c92d661d9","Type":"ContainerDied","Data":"a6779b90220d6a446bba6efdb7cf0c284ae282978d42ec7fdb0283bc2a59e6a9"} Mar 16 16:53:38 crc kubenswrapper[5120]: I0316 16:53:38.982400 5120 scope.go:117] "RemoveContainer" containerID="e4e558de3bd4fc49cb2832270b5576d955ed20a2c7b4521b173f218136893e23" Mar 16 16:53:38 crc kubenswrapper[5120]: I0316 16:53:38.983215 5120 scope.go:117] "RemoveContainer" containerID="a6779b90220d6a446bba6efdb7cf0c284ae282978d42ec7fdb0283bc2a59e6a9" Mar 16 16:53:38 crc kubenswrapper[5120]: E0316 16:53:38.983939 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nova-cell1-conductor-conductor\" with CrashLoopBackOff: \"back-off 10s restarting failed container=nova-cell1-conductor-conductor pod=nova-cell1-conductor-0_openstack-kuttl-tests(67ab3338-c88c-4faf-8d25-809c92d661d9)\"" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="67ab3338-c88c-4faf-8d25-809c92d661d9" Mar 16 16:53:39 crc kubenswrapper[5120]: I0316 16:53:39.016914 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:53:39 crc kubenswrapper[5120]: I0316 16:53:39.148634 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:53:39 crc kubenswrapper[5120]: I0316 16:53:39.151122 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:53:39 crc kubenswrapper[5120]: I0316 16:53:39.181957 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="68500e27-b83c-4571-9082-33e4d4ea3daa" containerName="nova-api-api" probeResult="failure" output="Get \"https://10.217.0.186:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 16:53:39 crc kubenswrapper[5120]: I0316 16:53:39.181987 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="68500e27-b83c-4571-9082-33e4d4ea3daa" containerName="nova-api-log" probeResult="failure" output="Get \"https://10.217.0.186:8774/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Mar 16 16:53:39 crc kubenswrapper[5120]: I0316 16:53:39.190652 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-f67b885f6-v4nhp" podUID="133b5e0f-d834-4c59-932f-957221e1727b" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.0.172:9311/healthcheck\": read tcp 10.217.0.2:37376->10.217.0.172:9311: read: connection reset by peer" Mar 16 16:53:39 crc kubenswrapper[5120]: I0316 16:53:39.190681 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-f67b885f6-v4nhp" podUID="133b5e0f-d834-4c59-932f-957221e1727b" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.0.172:9311/healthcheck\": read tcp 10.217.0.2:37362->10.217.0.172:9311: read: connection reset by peer" Mar 16 16:53:39 crc kubenswrapper[5120]: I0316 16:53:39.688047 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-f67b885f6-v4nhp" Mar 16 16:53:39 crc kubenswrapper[5120]: I0316 16:53:39.731923 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/133b5e0f-d834-4c59-932f-957221e1727b-combined-ca-bundle\") pod \"133b5e0f-d834-4c59-932f-957221e1727b\" (UID: \"133b5e0f-d834-4c59-932f-957221e1727b\") " Mar 16 16:53:39 crc kubenswrapper[5120]: I0316 16:53:39.732025 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/133b5e0f-d834-4c59-932f-957221e1727b-internal-tls-certs\") pod \"133b5e0f-d834-4c59-932f-957221e1727b\" (UID: \"133b5e0f-d834-4c59-932f-957221e1727b\") " Mar 16 16:53:39 crc kubenswrapper[5120]: I0316 16:53:39.732186 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/133b5e0f-d834-4c59-932f-957221e1727b-config-data-custom\") pod \"133b5e0f-d834-4c59-932f-957221e1727b\" (UID: \"133b5e0f-d834-4c59-932f-957221e1727b\") " Mar 16 16:53:39 crc kubenswrapper[5120]: I0316 16:53:39.732231 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/133b5e0f-d834-4c59-932f-957221e1727b-public-tls-certs\") pod \"133b5e0f-d834-4c59-932f-957221e1727b\" (UID: \"133b5e0f-d834-4c59-932f-957221e1727b\") " Mar 16 16:53:39 crc kubenswrapper[5120]: I0316 16:53:39.732805 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/133b5e0f-d834-4c59-932f-957221e1727b-logs\") pod \"133b5e0f-d834-4c59-932f-957221e1727b\" (UID: \"133b5e0f-d834-4c59-932f-957221e1727b\") " Mar 16 16:53:39 crc kubenswrapper[5120]: I0316 16:53:39.732905 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/133b5e0f-d834-4c59-932f-957221e1727b-config-data\") pod \"133b5e0f-d834-4c59-932f-957221e1727b\" (UID: \"133b5e0f-d834-4c59-932f-957221e1727b\") " Mar 16 16:53:39 crc kubenswrapper[5120]: I0316 16:53:39.732985 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vbr7n\" (UniqueName: \"kubernetes.io/projected/133b5e0f-d834-4c59-932f-957221e1727b-kube-api-access-vbr7n\") pod \"133b5e0f-d834-4c59-932f-957221e1727b\" (UID: \"133b5e0f-d834-4c59-932f-957221e1727b\") " Mar 16 16:53:39 crc kubenswrapper[5120]: I0316 16:53:39.740692 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/133b5e0f-d834-4c59-932f-957221e1727b-logs" (OuterVolumeSpecName: "logs") pod "133b5e0f-d834-4c59-932f-957221e1727b" (UID: "133b5e0f-d834-4c59-932f-957221e1727b"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:53:39 crc kubenswrapper[5120]: I0316 16:53:39.746175 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/133b5e0f-d834-4c59-932f-957221e1727b-kube-api-access-vbr7n" (OuterVolumeSpecName: "kube-api-access-vbr7n") pod "133b5e0f-d834-4c59-932f-957221e1727b" (UID: "133b5e0f-d834-4c59-932f-957221e1727b"). InnerVolumeSpecName "kube-api-access-vbr7n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:53:39 crc kubenswrapper[5120]: I0316 16:53:39.748631 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/133b5e0f-d834-4c59-932f-957221e1727b-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "133b5e0f-d834-4c59-932f-957221e1727b" (UID: "133b5e0f-d834-4c59-932f-957221e1727b"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:39 crc kubenswrapper[5120]: I0316 16:53:39.772566 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/133b5e0f-d834-4c59-932f-957221e1727b-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "133b5e0f-d834-4c59-932f-957221e1727b" (UID: "133b5e0f-d834-4c59-932f-957221e1727b"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:39 crc kubenswrapper[5120]: I0316 16:53:39.813383 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/133b5e0f-d834-4c59-932f-957221e1727b-config-data" (OuterVolumeSpecName: "config-data") pod "133b5e0f-d834-4c59-932f-957221e1727b" (UID: "133b5e0f-d834-4c59-932f-957221e1727b"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:39 crc kubenswrapper[5120]: I0316 16:53:39.825940 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/133b5e0f-d834-4c59-932f-957221e1727b-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "133b5e0f-d834-4c59-932f-957221e1727b" (UID: "133b5e0f-d834-4c59-932f-957221e1727b"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:39 crc kubenswrapper[5120]: I0316 16:53:39.826817 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/133b5e0f-d834-4c59-932f-957221e1727b-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "133b5e0f-d834-4c59-932f-957221e1727b" (UID: "133b5e0f-d834-4c59-932f-957221e1727b"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:39 crc kubenswrapper[5120]: I0316 16:53:39.837355 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/133b5e0f-d834-4c59-932f-957221e1727b-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:39 crc kubenswrapper[5120]: I0316 16:53:39.837397 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/133b5e0f-d834-4c59-932f-957221e1727b-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:39 crc kubenswrapper[5120]: I0316 16:53:39.837411 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vbr7n\" (UniqueName: \"kubernetes.io/projected/133b5e0f-d834-4c59-932f-957221e1727b-kube-api-access-vbr7n\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:39 crc kubenswrapper[5120]: I0316 16:53:39.837423 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/133b5e0f-d834-4c59-932f-957221e1727b-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:39 crc kubenswrapper[5120]: I0316 16:53:39.837445 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/133b5e0f-d834-4c59-932f-957221e1727b-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:39 crc kubenswrapper[5120]: I0316 16:53:39.837456 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/133b5e0f-d834-4c59-932f-957221e1727b-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:39 crc kubenswrapper[5120]: I0316 16:53:39.837467 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/133b5e0f-d834-4c59-932f-957221e1727b-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:40 crc kubenswrapper[5120]: I0316 16:53:40.005205 5120 generic.go:358] "Generic (PLEG): container finished" podID="133b5e0f-d834-4c59-932f-957221e1727b" containerID="89ebfc1c06cbadb9219937f0542021b840f18635622aee652874850137fa54e4" exitCode=0 Mar 16 16:53:40 crc kubenswrapper[5120]: I0316 16:53:40.005292 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-f67b885f6-v4nhp" Mar 16 16:53:40 crc kubenswrapper[5120]: I0316 16:53:40.005299 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-f67b885f6-v4nhp" event={"ID":"133b5e0f-d834-4c59-932f-957221e1727b","Type":"ContainerDied","Data":"89ebfc1c06cbadb9219937f0542021b840f18635622aee652874850137fa54e4"} Mar 16 16:53:40 crc kubenswrapper[5120]: I0316 16:53:40.005352 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-f67b885f6-v4nhp" event={"ID":"133b5e0f-d834-4c59-932f-957221e1727b","Type":"ContainerDied","Data":"550a482710c28eab0491207e17c6a03a7948797a16de7ca95046c49632833e1e"} Mar 16 16:53:40 crc kubenswrapper[5120]: I0316 16:53:40.005375 5120 scope.go:117] "RemoveContainer" containerID="89ebfc1c06cbadb9219937f0542021b840f18635622aee652874850137fa54e4" Mar 16 16:53:40 crc kubenswrapper[5120]: I0316 16:53:40.063978 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-78dc5f4cb-mjvvc" podUID="152925c6-48ae-4e8d-9a3f-68f01278fe95" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.0.177:9311/healthcheck\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 16:53:40 crc kubenswrapper[5120]: I0316 16:53:40.075581 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-78dc5f4cb-mjvvc" podUID="152925c6-48ae-4e8d-9a3f-68f01278fe95" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.0.177:9311/healthcheck\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 16:53:40 crc kubenswrapper[5120]: I0316 16:53:40.096316 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:53:40 crc kubenswrapper[5120]: I0316 16:53:40.096373 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:53:40 crc kubenswrapper[5120]: I0316 16:53:40.101547 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-f67b885f6-v4nhp"] Mar 16 16:53:40 crc kubenswrapper[5120]: I0316 16:53:40.112734 5120 scope.go:117] "RemoveContainer" containerID="6a4358b64f103dd33cfb807556544a60eeb87db20e6bbca1f4c32c75f2b20ff2" Mar 16 16:53:40 crc kubenswrapper[5120]: I0316 16:53:40.116401 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-api-f67b885f6-v4nhp"] Mar 16 16:53:40 crc kubenswrapper[5120]: I0316 16:53:40.144182 5120 scope.go:117] "RemoveContainer" containerID="89ebfc1c06cbadb9219937f0542021b840f18635622aee652874850137fa54e4" Mar 16 16:53:40 crc kubenswrapper[5120]: E0316 16:53:40.144664 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"89ebfc1c06cbadb9219937f0542021b840f18635622aee652874850137fa54e4\": container with ID starting with 89ebfc1c06cbadb9219937f0542021b840f18635622aee652874850137fa54e4 not found: ID does not exist" containerID="89ebfc1c06cbadb9219937f0542021b840f18635622aee652874850137fa54e4" Mar 16 16:53:40 crc kubenswrapper[5120]: I0316 16:53:40.144696 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89ebfc1c06cbadb9219937f0542021b840f18635622aee652874850137fa54e4"} err="failed to get container status \"89ebfc1c06cbadb9219937f0542021b840f18635622aee652874850137fa54e4\": rpc error: code = NotFound desc = could not find container \"89ebfc1c06cbadb9219937f0542021b840f18635622aee652874850137fa54e4\": container with ID starting with 89ebfc1c06cbadb9219937f0542021b840f18635622aee652874850137fa54e4 not found: ID does not exist" Mar 16 16:53:40 crc kubenswrapper[5120]: I0316 16:53:40.144714 5120 scope.go:117] "RemoveContainer" containerID="6a4358b64f103dd33cfb807556544a60eeb87db20e6bbca1f4c32c75f2b20ff2" Mar 16 16:53:40 crc kubenswrapper[5120]: E0316 16:53:40.145057 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a4358b64f103dd33cfb807556544a60eeb87db20e6bbca1f4c32c75f2b20ff2\": container with ID starting with 6a4358b64f103dd33cfb807556544a60eeb87db20e6bbca1f4c32c75f2b20ff2 not found: ID does not exist" containerID="6a4358b64f103dd33cfb807556544a60eeb87db20e6bbca1f4c32c75f2b20ff2" Mar 16 16:53:40 crc kubenswrapper[5120]: I0316 16:53:40.145088 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a4358b64f103dd33cfb807556544a60eeb87db20e6bbca1f4c32c75f2b20ff2"} err="failed to get container status \"6a4358b64f103dd33cfb807556544a60eeb87db20e6bbca1f4c32c75f2b20ff2\": rpc error: code = NotFound desc = could not find container \"6a4358b64f103dd33cfb807556544a60eeb87db20e6bbca1f4c32c75f2b20ff2\": container with ID starting with 6a4358b64f103dd33cfb807556544a60eeb87db20e6bbca1f4c32c75f2b20ff2 not found: ID does not exist" Mar 16 16:53:40 crc kubenswrapper[5120]: I0316 16:53:40.153612 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:53:40 crc kubenswrapper[5120]: I0316 16:53:40.156987 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:53:40 crc kubenswrapper[5120]: I0316 16:53:40.157030 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:53:40 crc kubenswrapper[5120]: I0316 16:53:40.173338 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:53:40 crc kubenswrapper[5120]: I0316 16:53:40.180411 5120 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:53:40 crc kubenswrapper[5120]: I0316 16:53:40.181176 5120 scope.go:117] "RemoveContainer" containerID="2d4d1dcb9934113a035d23ba21d07fb8336b9f2b0597239715eda669c9cb46b1" Mar 16 16:53:40 crc kubenswrapper[5120]: E0316 16:53:40.181552 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nova-cell0-conductor-conductor\" with CrashLoopBackOff: \"back-off 10s restarting failed container=nova-cell0-conductor-conductor pod=nova-cell0-conductor-0_openstack-kuttl-tests(802ef826-c6e7-4a1c-90a6-b419b9489007)\"" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="802ef826-c6e7-4a1c-90a6-b419b9489007" Mar 16 16:53:40 crc kubenswrapper[5120]: I0316 16:53:40.191110 5120 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:53:40 crc kubenswrapper[5120]: I0316 16:53:40.191730 5120 scope.go:117] "RemoveContainer" containerID="a6779b90220d6a446bba6efdb7cf0c284ae282978d42ec7fdb0283bc2a59e6a9" Mar 16 16:53:40 crc kubenswrapper[5120]: E0316 16:53:40.192121 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nova-cell1-conductor-conductor\" with CrashLoopBackOff: \"back-off 10s restarting failed container=nova-cell1-conductor-conductor pod=nova-cell1-conductor-0_openstack-kuttl-tests(67ab3338-c88c-4faf-8d25-809c92d661d9)\"" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="67ab3338-c88c-4faf-8d25-809c92d661d9" Mar 16 16:53:40 crc kubenswrapper[5120]: I0316 16:53:40.198780 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:53:40 crc kubenswrapper[5120]: I0316 16:53:40.228227 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:53:40 crc kubenswrapper[5120]: I0316 16:53:40.525547 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-78dc5f4cb-mjvvc" Mar 16 16:53:40 crc kubenswrapper[5120]: I0316 16:53:40.674661 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="133b5e0f-d834-4c59-932f-957221e1727b" path="/var/lib/kubelet/pods/133b5e0f-d834-4c59-932f-957221e1727b/volumes" Mar 16 16:53:40 crc kubenswrapper[5120]: I0316 16:53:40.739988 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openstack-kuttl-tests/barbican-api-78dc5f4cb-mjvvc" podUID="152925c6-48ae-4e8d-9a3f-68f01278fe95" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.0.177:9311/healthcheck\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Mar 16 16:53:41 crc kubenswrapper[5120]: I0316 16:53:41.036587 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:53:41 crc kubenswrapper[5120]: I0316 16:53:41.037332 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:53:41 crc kubenswrapper[5120]: I0316 16:53:41.037348 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:53:41 crc kubenswrapper[5120]: I0316 16:53:41.037357 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:53:41 crc kubenswrapper[5120]: I0316 16:53:41.362838 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/neutron-84f95d87c8-s7s4d" podUID="3853023d-8cc5-42de-9f91-d0609e3fe565" containerName="neutron-httpd" probeResult="failure" output="HTTP probe failed with statuscode: 503" Mar 16 16:53:41 crc kubenswrapper[5120]: I0316 16:53:41.982500 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-84f95d87c8-s7s4d_3853023d-8cc5-42de-9f91-d0609e3fe565/neutron-httpd/0.log" Mar 16 16:53:41 crc kubenswrapper[5120]: I0316 16:53:41.983179 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-84f95d87c8-s7s4d_3853023d-8cc5-42de-9f91-d0609e3fe565/neutron-api/0.log" Mar 16 16:53:41 crc kubenswrapper[5120]: I0316 16:53:41.983252 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-84f95d87c8-s7s4d" Mar 16 16:53:42 crc kubenswrapper[5120]: I0316 16:53:42.025600 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/3853023d-8cc5-42de-9f91-d0609e3fe565-ovndb-tls-certs\") pod \"3853023d-8cc5-42de-9f91-d0609e3fe565\" (UID: \"3853023d-8cc5-42de-9f91-d0609e3fe565\") " Mar 16 16:53:42 crc kubenswrapper[5120]: I0316 16:53:42.047475 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/3853023d-8cc5-42de-9f91-d0609e3fe565-public-tls-certs\") pod \"3853023d-8cc5-42de-9f91-d0609e3fe565\" (UID: \"3853023d-8cc5-42de-9f91-d0609e3fe565\") " Mar 16 16:53:42 crc kubenswrapper[5120]: I0316 16:53:42.047608 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3853023d-8cc5-42de-9f91-d0609e3fe565-config\") pod \"3853023d-8cc5-42de-9f91-d0609e3fe565\" (UID: \"3853023d-8cc5-42de-9f91-d0609e3fe565\") " Mar 16 16:53:42 crc kubenswrapper[5120]: I0316 16:53:42.047663 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3853023d-8cc5-42de-9f91-d0609e3fe565-combined-ca-bundle\") pod \"3853023d-8cc5-42de-9f91-d0609e3fe565\" (UID: \"3853023d-8cc5-42de-9f91-d0609e3fe565\") " Mar 16 16:53:42 crc kubenswrapper[5120]: I0316 16:53:42.047905 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/3853023d-8cc5-42de-9f91-d0609e3fe565-httpd-config\") pod \"3853023d-8cc5-42de-9f91-d0609e3fe565\" (UID: \"3853023d-8cc5-42de-9f91-d0609e3fe565\") " Mar 16 16:53:42 crc kubenswrapper[5120]: I0316 16:53:42.048032 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/3853023d-8cc5-42de-9f91-d0609e3fe565-internal-tls-certs\") pod \"3853023d-8cc5-42de-9f91-d0609e3fe565\" (UID: \"3853023d-8cc5-42de-9f91-d0609e3fe565\") " Mar 16 16:53:42 crc kubenswrapper[5120]: I0316 16:53:42.048175 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g4pcj\" (UniqueName: \"kubernetes.io/projected/3853023d-8cc5-42de-9f91-d0609e3fe565-kube-api-access-g4pcj\") pod \"3853023d-8cc5-42de-9f91-d0609e3fe565\" (UID: \"3853023d-8cc5-42de-9f91-d0609e3fe565\") " Mar 16 16:53:42 crc kubenswrapper[5120]: I0316 16:53:42.088091 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3853023d-8cc5-42de-9f91-d0609e3fe565-kube-api-access-g4pcj" (OuterVolumeSpecName: "kube-api-access-g4pcj") pod "3853023d-8cc5-42de-9f91-d0609e3fe565" (UID: "3853023d-8cc5-42de-9f91-d0609e3fe565"). InnerVolumeSpecName "kube-api-access-g4pcj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:53:42 crc kubenswrapper[5120]: I0316 16:53:42.091424 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3853023d-8cc5-42de-9f91-d0609e3fe565-httpd-config" (OuterVolumeSpecName: "httpd-config") pod "3853023d-8cc5-42de-9f91-d0609e3fe565" (UID: "3853023d-8cc5-42de-9f91-d0609e3fe565"). InnerVolumeSpecName "httpd-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:42 crc kubenswrapper[5120]: I0316 16:53:42.151601 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/3853023d-8cc5-42de-9f91-d0609e3fe565-httpd-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:42 crc kubenswrapper[5120]: I0316 16:53:42.151633 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-84f95d87c8-s7s4d_3853023d-8cc5-42de-9f91-d0609e3fe565/neutron-httpd/0.log" Mar 16 16:53:42 crc kubenswrapper[5120]: I0316 16:53:42.151637 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g4pcj\" (UniqueName: \"kubernetes.io/projected/3853023d-8cc5-42de-9f91-d0609e3fe565-kube-api-access-g4pcj\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:42 crc kubenswrapper[5120]: I0316 16:53:42.152107 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-84f95d87c8-s7s4d_3853023d-8cc5-42de-9f91-d0609e3fe565/neutron-api/0.log" Mar 16 16:53:42 crc kubenswrapper[5120]: I0316 16:53:42.152135 5120 generic.go:358] "Generic (PLEG): container finished" podID="3853023d-8cc5-42de-9f91-d0609e3fe565" containerID="f3e936cde026930d40ab3b02ecb1037a34399b8de1a6ffd65c816093ed0720e7" exitCode=137 Mar 16 16:53:42 crc kubenswrapper[5120]: I0316 16:53:42.152148 5120 generic.go:358] "Generic (PLEG): container finished" podID="3853023d-8cc5-42de-9f91-d0609e3fe565" containerID="b9a2caba30341e48505a6ea01cdbdafc0cb59a73dd5f7b97f33e4a17575eabb8" exitCode=137 Mar 16 16:53:42 crc kubenswrapper[5120]: I0316 16:53:42.153597 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-84f95d87c8-s7s4d" event={"ID":"3853023d-8cc5-42de-9f91-d0609e3fe565","Type":"ContainerDied","Data":"f3e936cde026930d40ab3b02ecb1037a34399b8de1a6ffd65c816093ed0720e7"} Mar 16 16:53:42 crc kubenswrapper[5120]: I0316 16:53:42.153625 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-84f95d87c8-s7s4d" event={"ID":"3853023d-8cc5-42de-9f91-d0609e3fe565","Type":"ContainerDied","Data":"b9a2caba30341e48505a6ea01cdbdafc0cb59a73dd5f7b97f33e4a17575eabb8"} Mar 16 16:53:42 crc kubenswrapper[5120]: I0316 16:53:42.153636 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-84f95d87c8-s7s4d" event={"ID":"3853023d-8cc5-42de-9f91-d0609e3fe565","Type":"ContainerDied","Data":"8a3d67c798c34d7edc582c34b6def56cd2c18e2d3984706dd66fb4a5aa30323f"} Mar 16 16:53:42 crc kubenswrapper[5120]: I0316 16:53:42.153651 5120 scope.go:117] "RemoveContainer" containerID="f3e936cde026930d40ab3b02ecb1037a34399b8de1a6ffd65c816093ed0720e7" Mar 16 16:53:42 crc kubenswrapper[5120]: I0316 16:53:42.153918 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-84f95d87c8-s7s4d" Mar 16 16:53:42 crc kubenswrapper[5120]: I0316 16:53:42.179873 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3853023d-8cc5-42de-9f91-d0609e3fe565-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "3853023d-8cc5-42de-9f91-d0609e3fe565" (UID: "3853023d-8cc5-42de-9f91-d0609e3fe565"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:42 crc kubenswrapper[5120]: I0316 16:53:42.225501 5120 scope.go:117] "RemoveContainer" containerID="b9a2caba30341e48505a6ea01cdbdafc0cb59a73dd5f7b97f33e4a17575eabb8" Mar 16 16:53:42 crc kubenswrapper[5120]: I0316 16:53:42.236660 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3853023d-8cc5-42de-9f91-d0609e3fe565-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "3853023d-8cc5-42de-9f91-d0609e3fe565" (UID: "3853023d-8cc5-42de-9f91-d0609e3fe565"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:42 crc kubenswrapper[5120]: I0316 16:53:42.253063 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3853023d-8cc5-42de-9f91-d0609e3fe565-config" (OuterVolumeSpecName: "config") pod "3853023d-8cc5-42de-9f91-d0609e3fe565" (UID: "3853023d-8cc5-42de-9f91-d0609e3fe565"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:42 crc kubenswrapper[5120]: I0316 16:53:42.253790 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3853023d-8cc5-42de-9f91-d0609e3fe565-config\") pod \"3853023d-8cc5-42de-9f91-d0609e3fe565\" (UID: \"3853023d-8cc5-42de-9f91-d0609e3fe565\") " Mar 16 16:53:42 crc kubenswrapper[5120]: W0316 16:53:42.254219 5120 empty_dir.go:511] Warning: Unmount skipped because path does not exist: /var/lib/kubelet/pods/3853023d-8cc5-42de-9f91-d0609e3fe565/volumes/kubernetes.io~secret/config Mar 16 16:53:42 crc kubenswrapper[5120]: I0316 16:53:42.254300 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3853023d-8cc5-42de-9f91-d0609e3fe565-config" (OuterVolumeSpecName: "config") pod "3853023d-8cc5-42de-9f91-d0609e3fe565" (UID: "3853023d-8cc5-42de-9f91-d0609e3fe565"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:42 crc kubenswrapper[5120]: I0316 16:53:42.255170 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/3853023d-8cc5-42de-9f91-d0609e3fe565-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:42 crc kubenswrapper[5120]: I0316 16:53:42.255191 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3853023d-8cc5-42de-9f91-d0609e3fe565-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:42 crc kubenswrapper[5120]: I0316 16:53:42.255200 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/3853023d-8cc5-42de-9f91-d0609e3fe565-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:42 crc kubenswrapper[5120]: I0316 16:53:42.264552 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-78dc5f4cb-mjvvc" Mar 16 16:53:42 crc kubenswrapper[5120]: I0316 16:53:42.270629 5120 scope.go:117] "RemoveContainer" containerID="f3e936cde026930d40ab3b02ecb1037a34399b8de1a6ffd65c816093ed0720e7" Mar 16 16:53:42 crc kubenswrapper[5120]: I0316 16:53:42.271898 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3853023d-8cc5-42de-9f91-d0609e3fe565-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "3853023d-8cc5-42de-9f91-d0609e3fe565" (UID: "3853023d-8cc5-42de-9f91-d0609e3fe565"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:42 crc kubenswrapper[5120]: E0316 16:53:42.272972 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f3e936cde026930d40ab3b02ecb1037a34399b8de1a6ffd65c816093ed0720e7\": container with ID starting with f3e936cde026930d40ab3b02ecb1037a34399b8de1a6ffd65c816093ed0720e7 not found: ID does not exist" containerID="f3e936cde026930d40ab3b02ecb1037a34399b8de1a6ffd65c816093ed0720e7" Mar 16 16:53:42 crc kubenswrapper[5120]: I0316 16:53:42.273013 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3e936cde026930d40ab3b02ecb1037a34399b8de1a6ffd65c816093ed0720e7"} err="failed to get container status \"f3e936cde026930d40ab3b02ecb1037a34399b8de1a6ffd65c816093ed0720e7\": rpc error: code = NotFound desc = could not find container \"f3e936cde026930d40ab3b02ecb1037a34399b8de1a6ffd65c816093ed0720e7\": container with ID starting with f3e936cde026930d40ab3b02ecb1037a34399b8de1a6ffd65c816093ed0720e7 not found: ID does not exist" Mar 16 16:53:42 crc kubenswrapper[5120]: I0316 16:53:42.273033 5120 scope.go:117] "RemoveContainer" containerID="b9a2caba30341e48505a6ea01cdbdafc0cb59a73dd5f7b97f33e4a17575eabb8" Mar 16 16:53:42 crc kubenswrapper[5120]: E0316 16:53:42.273344 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b9a2caba30341e48505a6ea01cdbdafc0cb59a73dd5f7b97f33e4a17575eabb8\": container with ID starting with b9a2caba30341e48505a6ea01cdbdafc0cb59a73dd5f7b97f33e4a17575eabb8 not found: ID does not exist" containerID="b9a2caba30341e48505a6ea01cdbdafc0cb59a73dd5f7b97f33e4a17575eabb8" Mar 16 16:53:42 crc kubenswrapper[5120]: I0316 16:53:42.273380 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9a2caba30341e48505a6ea01cdbdafc0cb59a73dd5f7b97f33e4a17575eabb8"} err="failed to get container status \"b9a2caba30341e48505a6ea01cdbdafc0cb59a73dd5f7b97f33e4a17575eabb8\": rpc error: code = NotFound desc = could not find container \"b9a2caba30341e48505a6ea01cdbdafc0cb59a73dd5f7b97f33e4a17575eabb8\": container with ID starting with b9a2caba30341e48505a6ea01cdbdafc0cb59a73dd5f7b97f33e4a17575eabb8 not found: ID does not exist" Mar 16 16:53:42 crc kubenswrapper[5120]: I0316 16:53:42.273392 5120 scope.go:117] "RemoveContainer" containerID="f3e936cde026930d40ab3b02ecb1037a34399b8de1a6ffd65c816093ed0720e7" Mar 16 16:53:42 crc kubenswrapper[5120]: I0316 16:53:42.273644 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3e936cde026930d40ab3b02ecb1037a34399b8de1a6ffd65c816093ed0720e7"} err="failed to get container status \"f3e936cde026930d40ab3b02ecb1037a34399b8de1a6ffd65c816093ed0720e7\": rpc error: code = NotFound desc = could not find container \"f3e936cde026930d40ab3b02ecb1037a34399b8de1a6ffd65c816093ed0720e7\": container with ID starting with f3e936cde026930d40ab3b02ecb1037a34399b8de1a6ffd65c816093ed0720e7 not found: ID does not exist" Mar 16 16:53:42 crc kubenswrapper[5120]: I0316 16:53:42.273657 5120 scope.go:117] "RemoveContainer" containerID="b9a2caba30341e48505a6ea01cdbdafc0cb59a73dd5f7b97f33e4a17575eabb8" Mar 16 16:53:42 crc kubenswrapper[5120]: I0316 16:53:42.273925 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9a2caba30341e48505a6ea01cdbdafc0cb59a73dd5f7b97f33e4a17575eabb8"} err="failed to get container status \"b9a2caba30341e48505a6ea01cdbdafc0cb59a73dd5f7b97f33e4a17575eabb8\": rpc error: code = NotFound desc = could not find container \"b9a2caba30341e48505a6ea01cdbdafc0cb59a73dd5f7b97f33e4a17575eabb8\": container with ID starting with b9a2caba30341e48505a6ea01cdbdafc0cb59a73dd5f7b97f33e4a17575eabb8 not found: ID does not exist" Mar 16 16:53:42 crc kubenswrapper[5120]: I0316 16:53:42.308868 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3853023d-8cc5-42de-9f91-d0609e3fe565-ovndb-tls-certs" (OuterVolumeSpecName: "ovndb-tls-certs") pod "3853023d-8cc5-42de-9f91-d0609e3fe565" (UID: "3853023d-8cc5-42de-9f91-d0609e3fe565"). InnerVolumeSpecName "ovndb-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:42 crc kubenswrapper[5120]: I0316 16:53:42.357239 5120 reconciler_common.go:299] "Volume detached for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/3853023d-8cc5-42de-9f91-d0609e3fe565-ovndb-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:42 crc kubenswrapper[5120]: I0316 16:53:42.357279 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/3853023d-8cc5-42de-9f91-d0609e3fe565-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:42 crc kubenswrapper[5120]: I0316 16:53:42.357652 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-75647f6cb4-4jcdp"] Mar 16 16:53:42 crc kubenswrapper[5120]: I0316 16:53:42.357885 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-75647f6cb4-4jcdp" podUID="0e2f5941-c2dd-490a-a6f8-5fc6f7af568e" containerName="barbican-api-log" containerID="cri-o://dd7fe7ffe304ba89a5574b9d845f1b3cdb0da51bf7c22a04814b909af709fdba" gracePeriod=30 Mar 16 16:53:42 crc kubenswrapper[5120]: I0316 16:53:42.359556 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-75647f6cb4-4jcdp" podUID="0e2f5941-c2dd-490a-a6f8-5fc6f7af568e" containerName="barbican-api" containerID="cri-o://19cf3db62f08f61aa863610fbf6dc0bd5a259c611c8b79ce81173b436a47a9ba" gracePeriod=30 Mar 16 16:53:42 crc kubenswrapper[5120]: I0316 16:53:42.451372 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/neutron-c8fc658f4-sqwl6" podUID="34e6ded3-dd6f-46bb-9d23-fa8724b78ace" containerName="neutron-httpd" probeResult="failure" output="HTTP probe failed with statuscode: 503" Mar 16 16:53:42 crc kubenswrapper[5120]: I0316 16:53:42.504725 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/neutron-7555689c4b-84shq" podUID="e5acac7f-9646-4be1-ac22-31326296e4de" containerName="neutron-httpd" probeResult="failure" output="Get \"https://10.217.0.154:9696/\": read tcp 10.217.0.2:39198->10.217.0.154:9696: read: connection reset by peer" Mar 16 16:53:42 crc kubenswrapper[5120]: I0316 16:53:42.884966 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="b91a9930-eec4-4af5-9aee-5d02dc78fabc" containerName="cinder-scheduler" probeResult="failure" output="Get \"http://10.217.0.137:8080/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 16:53:42 crc kubenswrapper[5120]: I0316 16:53:42.975551 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:53:43 crc kubenswrapper[5120]: I0316 16:53:43.042747 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:53:43 crc kubenswrapper[5120]: I0316 16:53:43.151427 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-7555689c4b-84shq_e5acac7f-9646-4be1-ac22-31326296e4de/neutron-httpd/0.log" Mar 16 16:53:43 crc kubenswrapper[5120]: I0316 16:53:43.152456 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-7555689c4b-84shq_e5acac7f-9646-4be1-ac22-31326296e4de/neutron-api/0.log" Mar 16 16:53:43 crc kubenswrapper[5120]: I0316 16:53:43.152589 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-7555689c4b-84shq" Mar 16 16:53:43 crc kubenswrapper[5120]: I0316 16:53:43.168593 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-c8fc658f4-sqwl6_34e6ded3-dd6f-46bb-9d23-fa8724b78ace/neutron-httpd/0.log" Mar 16 16:53:43 crc kubenswrapper[5120]: I0316 16:53:43.170970 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-c8fc658f4-sqwl6_34e6ded3-dd6f-46bb-9d23-fa8724b78ace/neutron-api/0.log" Mar 16 16:53:43 crc kubenswrapper[5120]: I0316 16:53:43.171089 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-c8fc658f4-sqwl6" Mar 16 16:53:43 crc kubenswrapper[5120]: I0316 16:53:43.175228 5120 generic.go:358] "Generic (PLEG): container finished" podID="0e2f5941-c2dd-490a-a6f8-5fc6f7af568e" containerID="dd7fe7ffe304ba89a5574b9d845f1b3cdb0da51bf7c22a04814b909af709fdba" exitCode=143 Mar 16 16:53:43 crc kubenswrapper[5120]: I0316 16:53:43.175458 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-75647f6cb4-4jcdp" event={"ID":"0e2f5941-c2dd-490a-a6f8-5fc6f7af568e","Type":"ContainerDied","Data":"dd7fe7ffe304ba89a5574b9d845f1b3cdb0da51bf7c22a04814b909af709fdba"} Mar 16 16:53:43 crc kubenswrapper[5120]: I0316 16:53:43.201665 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-c8fc658f4-sqwl6_34e6ded3-dd6f-46bb-9d23-fa8724b78ace/neutron-httpd/0.log" Mar 16 16:53:43 crc kubenswrapper[5120]: I0316 16:53:43.202196 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-c8fc658f4-sqwl6_34e6ded3-dd6f-46bb-9d23-fa8724b78ace/neutron-api/0.log" Mar 16 16:53:43 crc kubenswrapper[5120]: I0316 16:53:43.202246 5120 generic.go:358] "Generic (PLEG): container finished" podID="34e6ded3-dd6f-46bb-9d23-fa8724b78ace" containerID="ba90d7d4271418c373258f2de19f2ceabbc3fe0f13f63bd5e630054ecae78152" exitCode=137 Mar 16 16:53:43 crc kubenswrapper[5120]: I0316 16:53:43.202267 5120 generic.go:358] "Generic (PLEG): container finished" podID="34e6ded3-dd6f-46bb-9d23-fa8724b78ace" containerID="41533c5d5556d3dc95717c5df3eb81b00a5d17695d07e9725bc580ce2a9acefb" exitCode=137 Mar 16 16:53:43 crc kubenswrapper[5120]: I0316 16:53:43.202613 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-c8fc658f4-sqwl6" event={"ID":"34e6ded3-dd6f-46bb-9d23-fa8724b78ace","Type":"ContainerDied","Data":"ba90d7d4271418c373258f2de19f2ceabbc3fe0f13f63bd5e630054ecae78152"} Mar 16 16:53:43 crc kubenswrapper[5120]: I0316 16:53:43.202657 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-c8fc658f4-sqwl6" event={"ID":"34e6ded3-dd6f-46bb-9d23-fa8724b78ace","Type":"ContainerDied","Data":"41533c5d5556d3dc95717c5df3eb81b00a5d17695d07e9725bc580ce2a9acefb"} Mar 16 16:53:43 crc kubenswrapper[5120]: I0316 16:53:43.202672 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-c8fc658f4-sqwl6" event={"ID":"34e6ded3-dd6f-46bb-9d23-fa8724b78ace","Type":"ContainerDied","Data":"12f22be8d9d792a80a93e43a38d6d62396ea6423e1fec7905bbcdafaa50b3aea"} Mar 16 16:53:43 crc kubenswrapper[5120]: I0316 16:53:43.202689 5120 scope.go:117] "RemoveContainer" containerID="ba90d7d4271418c373258f2de19f2ceabbc3fe0f13f63bd5e630054ecae78152" Mar 16 16:53:43 crc kubenswrapper[5120]: I0316 16:53:43.202909 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-c8fc658f4-sqwl6" Mar 16 16:53:43 crc kubenswrapper[5120]: I0316 16:53:43.209980 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-7555689c4b-84shq_e5acac7f-9646-4be1-ac22-31326296e4de/neutron-httpd/0.log" Mar 16 16:53:43 crc kubenswrapper[5120]: I0316 16:53:43.210451 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-7555689c4b-84shq_e5acac7f-9646-4be1-ac22-31326296e4de/neutron-api/0.log" Mar 16 16:53:43 crc kubenswrapper[5120]: I0316 16:53:43.210495 5120 generic.go:358] "Generic (PLEG): container finished" podID="e5acac7f-9646-4be1-ac22-31326296e4de" containerID="46c8ba259218ad0ae34a0926e382ef4fa4012a46c5f1102b8d5af7d0f2f25233" exitCode=137 Mar 16 16:53:43 crc kubenswrapper[5120]: I0316 16:53:43.210512 5120 generic.go:358] "Generic (PLEG): container finished" podID="e5acac7f-9646-4be1-ac22-31326296e4de" containerID="db52ff3476db6cd59c6777eccc858aa2bfbf71202ed0fd58d0a238530b9853c7" exitCode=137 Mar 16 16:53:43 crc kubenswrapper[5120]: I0316 16:53:43.210984 5120 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Mar 16 16:53:43 crc kubenswrapper[5120]: I0316 16:53:43.211000 5120 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Mar 16 16:53:43 crc kubenswrapper[5120]: I0316 16:53:43.212550 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-7555689c4b-84shq" event={"ID":"e5acac7f-9646-4be1-ac22-31326296e4de","Type":"ContainerDied","Data":"46c8ba259218ad0ae34a0926e382ef4fa4012a46c5f1102b8d5af7d0f2f25233"} Mar 16 16:53:43 crc kubenswrapper[5120]: I0316 16:53:43.212617 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-7555689c4b-84shq" event={"ID":"e5acac7f-9646-4be1-ac22-31326296e4de","Type":"ContainerDied","Data":"db52ff3476db6cd59c6777eccc858aa2bfbf71202ed0fd58d0a238530b9853c7"} Mar 16 16:53:43 crc kubenswrapper[5120]: I0316 16:53:43.212627 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-7555689c4b-84shq" event={"ID":"e5acac7f-9646-4be1-ac22-31326296e4de","Type":"ContainerDied","Data":"5f9c8405278c1d27f0bef96dc113ce4effb5e74800d43c882d0387946ecc5ec9"} Mar 16 16:53:43 crc kubenswrapper[5120]: I0316 16:53:43.212726 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-7555689c4b-84shq" Mar 16 16:53:43 crc kubenswrapper[5120]: I0316 16:53:43.213472 5120 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Mar 16 16:53:43 crc kubenswrapper[5120]: I0316 16:53:43.213481 5120 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Mar 16 16:53:43 crc kubenswrapper[5120]: I0316 16:53:43.261150 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:53:43 crc kubenswrapper[5120]: I0316 16:53:43.271258 5120 scope.go:117] "RemoveContainer" containerID="41533c5d5556d3dc95717c5df3eb81b00a5d17695d07e9725bc580ce2a9acefb" Mar 16 16:53:43 crc kubenswrapper[5120]: I0316 16:53:43.291157 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/34e6ded3-dd6f-46bb-9d23-fa8724b78ace-httpd-config\") pod \"34e6ded3-dd6f-46bb-9d23-fa8724b78ace\" (UID: \"34e6ded3-dd6f-46bb-9d23-fa8724b78ace\") " Mar 16 16:53:43 crc kubenswrapper[5120]: I0316 16:53:43.291390 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/34e6ded3-dd6f-46bb-9d23-fa8724b78ace-config\") pod \"34e6ded3-dd6f-46bb-9d23-fa8724b78ace\" (UID: \"34e6ded3-dd6f-46bb-9d23-fa8724b78ace\") " Mar 16 16:53:43 crc kubenswrapper[5120]: I0316 16:53:43.291495 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/34e6ded3-dd6f-46bb-9d23-fa8724b78ace-ovndb-tls-certs\") pod \"34e6ded3-dd6f-46bb-9d23-fa8724b78ace\" (UID: \"34e6ded3-dd6f-46bb-9d23-fa8724b78ace\") " Mar 16 16:53:43 crc kubenswrapper[5120]: I0316 16:53:43.291619 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e5acac7f-9646-4be1-ac22-31326296e4de-public-tls-certs\") pod \"e5acac7f-9646-4be1-ac22-31326296e4de\" (UID: \"e5acac7f-9646-4be1-ac22-31326296e4de\") " Mar 16 16:53:43 crc kubenswrapper[5120]: I0316 16:53:43.291778 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/34e6ded3-dd6f-46bb-9d23-fa8724b78ace-public-tls-certs\") pod \"34e6ded3-dd6f-46bb-9d23-fa8724b78ace\" (UID: \"34e6ded3-dd6f-46bb-9d23-fa8724b78ace\") " Mar 16 16:53:43 crc kubenswrapper[5120]: I0316 16:53:43.291832 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/34e6ded3-dd6f-46bb-9d23-fa8724b78ace-combined-ca-bundle\") pod \"34e6ded3-dd6f-46bb-9d23-fa8724b78ace\" (UID: \"34e6ded3-dd6f-46bb-9d23-fa8724b78ace\") " Mar 16 16:53:43 crc kubenswrapper[5120]: I0316 16:53:43.291923 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/e5acac7f-9646-4be1-ac22-31326296e4de-ovndb-tls-certs\") pod \"e5acac7f-9646-4be1-ac22-31326296e4de\" (UID: \"e5acac7f-9646-4be1-ac22-31326296e4de\") " Mar 16 16:53:43 crc kubenswrapper[5120]: I0316 16:53:43.292020 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2hrxh\" (UniqueName: \"kubernetes.io/projected/34e6ded3-dd6f-46bb-9d23-fa8724b78ace-kube-api-access-2hrxh\") pod \"34e6ded3-dd6f-46bb-9d23-fa8724b78ace\" (UID: \"34e6ded3-dd6f-46bb-9d23-fa8724b78ace\") " Mar 16 16:53:43 crc kubenswrapper[5120]: I0316 16:53:43.292138 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e5acac7f-9646-4be1-ac22-31326296e4de-internal-tls-certs\") pod \"e5acac7f-9646-4be1-ac22-31326296e4de\" (UID: \"e5acac7f-9646-4be1-ac22-31326296e4de\") " Mar 16 16:53:43 crc kubenswrapper[5120]: I0316 16:53:43.292182 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w7tbt\" (UniqueName: \"kubernetes.io/projected/e5acac7f-9646-4be1-ac22-31326296e4de-kube-api-access-w7tbt\") pod \"e5acac7f-9646-4be1-ac22-31326296e4de\" (UID: \"e5acac7f-9646-4be1-ac22-31326296e4de\") " Mar 16 16:53:43 crc kubenswrapper[5120]: I0316 16:53:43.292259 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e5acac7f-9646-4be1-ac22-31326296e4de-combined-ca-bundle\") pod \"e5acac7f-9646-4be1-ac22-31326296e4de\" (UID: \"e5acac7f-9646-4be1-ac22-31326296e4de\") " Mar 16 16:53:43 crc kubenswrapper[5120]: I0316 16:53:43.292369 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/e5acac7f-9646-4be1-ac22-31326296e4de-httpd-config\") pod \"e5acac7f-9646-4be1-ac22-31326296e4de\" (UID: \"e5acac7f-9646-4be1-ac22-31326296e4de\") " Mar 16 16:53:43 crc kubenswrapper[5120]: I0316 16:53:43.292408 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e5acac7f-9646-4be1-ac22-31326296e4de-config\") pod \"e5acac7f-9646-4be1-ac22-31326296e4de\" (UID: \"e5acac7f-9646-4be1-ac22-31326296e4de\") " Mar 16 16:53:43 crc kubenswrapper[5120]: I0316 16:53:43.292528 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/34e6ded3-dd6f-46bb-9d23-fa8724b78ace-internal-tls-certs\") pod \"34e6ded3-dd6f-46bb-9d23-fa8724b78ace\" (UID: \"34e6ded3-dd6f-46bb-9d23-fa8724b78ace\") " Mar 16 16:53:43 crc kubenswrapper[5120]: I0316 16:53:43.329190 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34e6ded3-dd6f-46bb-9d23-fa8724b78ace-kube-api-access-2hrxh" (OuterVolumeSpecName: "kube-api-access-2hrxh") pod "34e6ded3-dd6f-46bb-9d23-fa8724b78ace" (UID: "34e6ded3-dd6f-46bb-9d23-fa8724b78ace"). InnerVolumeSpecName "kube-api-access-2hrxh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:53:43 crc kubenswrapper[5120]: I0316 16:53:43.339896 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/34e6ded3-dd6f-46bb-9d23-fa8724b78ace-httpd-config" (OuterVolumeSpecName: "httpd-config") pod "34e6ded3-dd6f-46bb-9d23-fa8724b78ace" (UID: "34e6ded3-dd6f-46bb-9d23-fa8724b78ace"). InnerVolumeSpecName "httpd-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:43 crc kubenswrapper[5120]: I0316 16:53:43.343803 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5acac7f-9646-4be1-ac22-31326296e4de-kube-api-access-w7tbt" (OuterVolumeSpecName: "kube-api-access-w7tbt") pod "e5acac7f-9646-4be1-ac22-31326296e4de" (UID: "e5acac7f-9646-4be1-ac22-31326296e4de"). InnerVolumeSpecName "kube-api-access-w7tbt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:53:43 crc kubenswrapper[5120]: I0316 16:53:43.345460 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e5acac7f-9646-4be1-ac22-31326296e4de-httpd-config" (OuterVolumeSpecName: "httpd-config") pod "e5acac7f-9646-4be1-ac22-31326296e4de" (UID: "e5acac7f-9646-4be1-ac22-31326296e4de"). InnerVolumeSpecName "httpd-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:43 crc kubenswrapper[5120]: I0316 16:53:43.363950 5120 scope.go:117] "RemoveContainer" containerID="ba90d7d4271418c373258f2de19f2ceabbc3fe0f13f63bd5e630054ecae78152" Mar 16 16:53:43 crc kubenswrapper[5120]: E0316 16:53:43.364969 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba90d7d4271418c373258f2de19f2ceabbc3fe0f13f63bd5e630054ecae78152\": container with ID starting with ba90d7d4271418c373258f2de19f2ceabbc3fe0f13f63bd5e630054ecae78152 not found: ID does not exist" containerID="ba90d7d4271418c373258f2de19f2ceabbc3fe0f13f63bd5e630054ecae78152" Mar 16 16:53:43 crc kubenswrapper[5120]: I0316 16:53:43.365020 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba90d7d4271418c373258f2de19f2ceabbc3fe0f13f63bd5e630054ecae78152"} err="failed to get container status \"ba90d7d4271418c373258f2de19f2ceabbc3fe0f13f63bd5e630054ecae78152\": rpc error: code = NotFound desc = could not find container \"ba90d7d4271418c373258f2de19f2ceabbc3fe0f13f63bd5e630054ecae78152\": container with ID starting with ba90d7d4271418c373258f2de19f2ceabbc3fe0f13f63bd5e630054ecae78152 not found: ID does not exist" Mar 16 16:53:43 crc kubenswrapper[5120]: I0316 16:53:43.365048 5120 scope.go:117] "RemoveContainer" containerID="41533c5d5556d3dc95717c5df3eb81b00a5d17695d07e9725bc580ce2a9acefb" Mar 16 16:53:43 crc kubenswrapper[5120]: E0316 16:53:43.365390 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"41533c5d5556d3dc95717c5df3eb81b00a5d17695d07e9725bc580ce2a9acefb\": container with ID starting with 41533c5d5556d3dc95717c5df3eb81b00a5d17695d07e9725bc580ce2a9acefb not found: ID does not exist" containerID="41533c5d5556d3dc95717c5df3eb81b00a5d17695d07e9725bc580ce2a9acefb" Mar 16 16:53:43 crc kubenswrapper[5120]: I0316 16:53:43.365500 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41533c5d5556d3dc95717c5df3eb81b00a5d17695d07e9725bc580ce2a9acefb"} err="failed to get container status \"41533c5d5556d3dc95717c5df3eb81b00a5d17695d07e9725bc580ce2a9acefb\": rpc error: code = NotFound desc = could not find container \"41533c5d5556d3dc95717c5df3eb81b00a5d17695d07e9725bc580ce2a9acefb\": container with ID starting with 41533c5d5556d3dc95717c5df3eb81b00a5d17695d07e9725bc580ce2a9acefb not found: ID does not exist" Mar 16 16:53:43 crc kubenswrapper[5120]: I0316 16:53:43.365602 5120 scope.go:117] "RemoveContainer" containerID="ba90d7d4271418c373258f2de19f2ceabbc3fe0f13f63bd5e630054ecae78152" Mar 16 16:53:43 crc kubenswrapper[5120]: I0316 16:53:43.367494 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba90d7d4271418c373258f2de19f2ceabbc3fe0f13f63bd5e630054ecae78152"} err="failed to get container status \"ba90d7d4271418c373258f2de19f2ceabbc3fe0f13f63bd5e630054ecae78152\": rpc error: code = NotFound desc = could not find container \"ba90d7d4271418c373258f2de19f2ceabbc3fe0f13f63bd5e630054ecae78152\": container with ID starting with ba90d7d4271418c373258f2de19f2ceabbc3fe0f13f63bd5e630054ecae78152 not found: ID does not exist" Mar 16 16:53:43 crc kubenswrapper[5120]: I0316 16:53:43.367530 5120 scope.go:117] "RemoveContainer" containerID="41533c5d5556d3dc95717c5df3eb81b00a5d17695d07e9725bc580ce2a9acefb" Mar 16 16:53:43 crc kubenswrapper[5120]: I0316 16:53:43.368613 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41533c5d5556d3dc95717c5df3eb81b00a5d17695d07e9725bc580ce2a9acefb"} err="failed to get container status \"41533c5d5556d3dc95717c5df3eb81b00a5d17695d07e9725bc580ce2a9acefb\": rpc error: code = NotFound desc = could not find container \"41533c5d5556d3dc95717c5df3eb81b00a5d17695d07e9725bc580ce2a9acefb\": container with ID starting with 41533c5d5556d3dc95717c5df3eb81b00a5d17695d07e9725bc580ce2a9acefb not found: ID does not exist" Mar 16 16:53:43 crc kubenswrapper[5120]: I0316 16:53:43.368639 5120 scope.go:117] "RemoveContainer" containerID="46c8ba259218ad0ae34a0926e382ef4fa4012a46c5f1102b8d5af7d0f2f25233" Mar 16 16:53:43 crc kubenswrapper[5120]: I0316 16:53:43.408452 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/34e6ded3-dd6f-46bb-9d23-fa8724b78ace-httpd-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:43 crc kubenswrapper[5120]: I0316 16:53:43.408497 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2hrxh\" (UniqueName: \"kubernetes.io/projected/34e6ded3-dd6f-46bb-9d23-fa8724b78ace-kube-api-access-2hrxh\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:43 crc kubenswrapper[5120]: I0316 16:53:43.408512 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w7tbt\" (UniqueName: \"kubernetes.io/projected/e5acac7f-9646-4be1-ac22-31326296e4de-kube-api-access-w7tbt\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:43 crc kubenswrapper[5120]: I0316 16:53:43.408523 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/e5acac7f-9646-4be1-ac22-31326296e4de-httpd-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:43 crc kubenswrapper[5120]: I0316 16:53:43.423885 5120 scope.go:117] "RemoveContainer" containerID="db52ff3476db6cd59c6777eccc858aa2bfbf71202ed0fd58d0a238530b9853c7" Mar 16 16:53:43 crc kubenswrapper[5120]: I0316 16:53:43.424033 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e5acac7f-9646-4be1-ac22-31326296e4de-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e5acac7f-9646-4be1-ac22-31326296e4de" (UID: "e5acac7f-9646-4be1-ac22-31326296e4de"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:43 crc kubenswrapper[5120]: I0316 16:53:43.430918 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/34e6ded3-dd6f-46bb-9d23-fa8724b78ace-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "34e6ded3-dd6f-46bb-9d23-fa8724b78ace" (UID: "34e6ded3-dd6f-46bb-9d23-fa8724b78ace"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:43 crc kubenswrapper[5120]: I0316 16:53:43.459298 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e5acac7f-9646-4be1-ac22-31326296e4de-config" (OuterVolumeSpecName: "config") pod "e5acac7f-9646-4be1-ac22-31326296e4de" (UID: "e5acac7f-9646-4be1-ac22-31326296e4de"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:43 crc kubenswrapper[5120]: I0316 16:53:43.460699 5120 scope.go:117] "RemoveContainer" containerID="46c8ba259218ad0ae34a0926e382ef4fa4012a46c5f1102b8d5af7d0f2f25233" Mar 16 16:53:43 crc kubenswrapper[5120]: I0316 16:53:43.464814 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/34e6ded3-dd6f-46bb-9d23-fa8724b78ace-config" (OuterVolumeSpecName: "config") pod "34e6ded3-dd6f-46bb-9d23-fa8724b78ace" (UID: "34e6ded3-dd6f-46bb-9d23-fa8724b78ace"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:43 crc kubenswrapper[5120]: E0316 16:53:43.469544 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"46c8ba259218ad0ae34a0926e382ef4fa4012a46c5f1102b8d5af7d0f2f25233\": container with ID starting with 46c8ba259218ad0ae34a0926e382ef4fa4012a46c5f1102b8d5af7d0f2f25233 not found: ID does not exist" containerID="46c8ba259218ad0ae34a0926e382ef4fa4012a46c5f1102b8d5af7d0f2f25233" Mar 16 16:53:43 crc kubenswrapper[5120]: I0316 16:53:43.469615 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"46c8ba259218ad0ae34a0926e382ef4fa4012a46c5f1102b8d5af7d0f2f25233"} err="failed to get container status \"46c8ba259218ad0ae34a0926e382ef4fa4012a46c5f1102b8d5af7d0f2f25233\": rpc error: code = NotFound desc = could not find container \"46c8ba259218ad0ae34a0926e382ef4fa4012a46c5f1102b8d5af7d0f2f25233\": container with ID starting with 46c8ba259218ad0ae34a0926e382ef4fa4012a46c5f1102b8d5af7d0f2f25233 not found: ID does not exist" Mar 16 16:53:43 crc kubenswrapper[5120]: I0316 16:53:43.469652 5120 scope.go:117] "RemoveContainer" containerID="db52ff3476db6cd59c6777eccc858aa2bfbf71202ed0fd58d0a238530b9853c7" Mar 16 16:53:43 crc kubenswrapper[5120]: E0316 16:53:43.471544 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db52ff3476db6cd59c6777eccc858aa2bfbf71202ed0fd58d0a238530b9853c7\": container with ID starting with db52ff3476db6cd59c6777eccc858aa2bfbf71202ed0fd58d0a238530b9853c7 not found: ID does not exist" containerID="db52ff3476db6cd59c6777eccc858aa2bfbf71202ed0fd58d0a238530b9853c7" Mar 16 16:53:43 crc kubenswrapper[5120]: I0316 16:53:43.471588 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db52ff3476db6cd59c6777eccc858aa2bfbf71202ed0fd58d0a238530b9853c7"} err="failed to get container status \"db52ff3476db6cd59c6777eccc858aa2bfbf71202ed0fd58d0a238530b9853c7\": rpc error: code = NotFound desc = could not find container \"db52ff3476db6cd59c6777eccc858aa2bfbf71202ed0fd58d0a238530b9853c7\": container with ID starting with db52ff3476db6cd59c6777eccc858aa2bfbf71202ed0fd58d0a238530b9853c7 not found: ID does not exist" Mar 16 16:53:43 crc kubenswrapper[5120]: I0316 16:53:43.471619 5120 scope.go:117] "RemoveContainer" containerID="46c8ba259218ad0ae34a0926e382ef4fa4012a46c5f1102b8d5af7d0f2f25233" Mar 16 16:53:43 crc kubenswrapper[5120]: I0316 16:53:43.473156 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"46c8ba259218ad0ae34a0926e382ef4fa4012a46c5f1102b8d5af7d0f2f25233"} err="failed to get container status \"46c8ba259218ad0ae34a0926e382ef4fa4012a46c5f1102b8d5af7d0f2f25233\": rpc error: code = NotFound desc = could not find container \"46c8ba259218ad0ae34a0926e382ef4fa4012a46c5f1102b8d5af7d0f2f25233\": container with ID starting with 46c8ba259218ad0ae34a0926e382ef4fa4012a46c5f1102b8d5af7d0f2f25233 not found: ID does not exist" Mar 16 16:53:43 crc kubenswrapper[5120]: I0316 16:53:43.473185 5120 scope.go:117] "RemoveContainer" containerID="db52ff3476db6cd59c6777eccc858aa2bfbf71202ed0fd58d0a238530b9853c7" Mar 16 16:53:43 crc kubenswrapper[5120]: I0316 16:53:43.476421 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/34e6ded3-dd6f-46bb-9d23-fa8724b78ace-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "34e6ded3-dd6f-46bb-9d23-fa8724b78ace" (UID: "34e6ded3-dd6f-46bb-9d23-fa8724b78ace"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:43 crc kubenswrapper[5120]: I0316 16:53:43.480265 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db52ff3476db6cd59c6777eccc858aa2bfbf71202ed0fd58d0a238530b9853c7"} err="failed to get container status \"db52ff3476db6cd59c6777eccc858aa2bfbf71202ed0fd58d0a238530b9853c7\": rpc error: code = NotFound desc = could not find container \"db52ff3476db6cd59c6777eccc858aa2bfbf71202ed0fd58d0a238530b9853c7\": container with ID starting with db52ff3476db6cd59c6777eccc858aa2bfbf71202ed0fd58d0a238530b9853c7 not found: ID does not exist" Mar 16 16:53:43 crc kubenswrapper[5120]: I0316 16:53:43.498889 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e5acac7f-9646-4be1-ac22-31326296e4de-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "e5acac7f-9646-4be1-ac22-31326296e4de" (UID: "e5acac7f-9646-4be1-ac22-31326296e4de"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:43 crc kubenswrapper[5120]: I0316 16:53:43.511182 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/34e6ded3-dd6f-46bb-9d23-fa8724b78ace-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:43 crc kubenswrapper[5120]: I0316 16:53:43.511223 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e5acac7f-9646-4be1-ac22-31326296e4de-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:43 crc kubenswrapper[5120]: I0316 16:53:43.511237 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/34e6ded3-dd6f-46bb-9d23-fa8724b78ace-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:43 crc kubenswrapper[5120]: I0316 16:53:43.511251 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e5acac7f-9646-4be1-ac22-31326296e4de-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:43 crc kubenswrapper[5120]: I0316 16:53:43.511264 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/e5acac7f-9646-4be1-ac22-31326296e4de-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:43 crc kubenswrapper[5120]: I0316 16:53:43.511276 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/34e6ded3-dd6f-46bb-9d23-fa8724b78ace-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:43 crc kubenswrapper[5120]: I0316 16:53:43.512965 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/34e6ded3-dd6f-46bb-9d23-fa8724b78ace-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "34e6ded3-dd6f-46bb-9d23-fa8724b78ace" (UID: "34e6ded3-dd6f-46bb-9d23-fa8724b78ace"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:43 crc kubenswrapper[5120]: I0316 16:53:43.514902 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e5acac7f-9646-4be1-ac22-31326296e4de-ovndb-tls-certs" (OuterVolumeSpecName: "ovndb-tls-certs") pod "e5acac7f-9646-4be1-ac22-31326296e4de" (UID: "e5acac7f-9646-4be1-ac22-31326296e4de"). InnerVolumeSpecName "ovndb-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:43 crc kubenswrapper[5120]: I0316 16:53:43.531013 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e5acac7f-9646-4be1-ac22-31326296e4de-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "e5acac7f-9646-4be1-ac22-31326296e4de" (UID: "e5acac7f-9646-4be1-ac22-31326296e4de"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:43 crc kubenswrapper[5120]: I0316 16:53:43.554661 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/34e6ded3-dd6f-46bb-9d23-fa8724b78ace-ovndb-tls-certs" (OuterVolumeSpecName: "ovndb-tls-certs") pod "34e6ded3-dd6f-46bb-9d23-fa8724b78ace" (UID: "34e6ded3-dd6f-46bb-9d23-fa8724b78ace"). InnerVolumeSpecName "ovndb-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:43 crc kubenswrapper[5120]: I0316 16:53:43.614342 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/34e6ded3-dd6f-46bb-9d23-fa8724b78ace-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:43 crc kubenswrapper[5120]: I0316 16:53:43.614400 5120 reconciler_common.go:299] "Volume detached for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/e5acac7f-9646-4be1-ac22-31326296e4de-ovndb-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:43 crc kubenswrapper[5120]: I0316 16:53:43.614418 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e5acac7f-9646-4be1-ac22-31326296e4de-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:43 crc kubenswrapper[5120]: I0316 16:53:43.614432 5120 reconciler_common.go:299] "Volume detached for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/34e6ded3-dd6f-46bb-9d23-fa8724b78ace-ovndb-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:43 crc kubenswrapper[5120]: I0316 16:53:43.654349 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:53:43 crc kubenswrapper[5120]: I0316 16:53:43.654721 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="9fb3c077-55b7-4693-af84-b981deb240da" containerName="ceilometer-central-agent" containerID="cri-o://3ebb910b29446c7039a58d1fdfdb5ea8086cba8a3142a7103f3e20e30f3c7f4e" gracePeriod=30 Mar 16 16:53:43 crc kubenswrapper[5120]: I0316 16:53:43.654892 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="9fb3c077-55b7-4693-af84-b981deb240da" containerName="proxy-httpd" containerID="cri-o://249b8277425756d242d2d291ee93149d50812f92e3c309d8c713d118d0ee6ee8" gracePeriod=30 Mar 16 16:53:43 crc kubenswrapper[5120]: I0316 16:53:43.654953 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="9fb3c077-55b7-4693-af84-b981deb240da" containerName="sg-core" containerID="cri-o://6637aa7a76d94bb0d5267dcacbb4a5b56c43ee66a97a2de4a60d2391feac7339" gracePeriod=30 Mar 16 16:53:43 crc kubenswrapper[5120]: I0316 16:53:43.655012 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="9fb3c077-55b7-4693-af84-b981deb240da" containerName="ceilometer-notification-agent" containerID="cri-o://d6379599594c178393fbf1640c89d3239c76f0259578ec41f0162a979abfaeed" gracePeriod=30 Mar 16 16:53:43 crc kubenswrapper[5120]: I0316 16:53:43.673444 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/ceilometer-0" podUID="9fb3c077-55b7-4693-af84-b981deb240da" containerName="proxy-httpd" probeResult="failure" output="HTTP probe failed with statuscode: 503" Mar 16 16:53:43 crc kubenswrapper[5120]: I0316 16:53:43.838993 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:53:43 crc kubenswrapper[5120]: I0316 16:53:43.957060 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-c8fc658f4-sqwl6"] Mar 16 16:53:43 crc kubenswrapper[5120]: I0316 16:53:43.989270 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-c8fc658f4-sqwl6"] Mar 16 16:53:44 crc kubenswrapper[5120]: I0316 16:53:44.008564 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-7555689c4b-84shq"] Mar 16 16:53:44 crc kubenswrapper[5120]: I0316 16:53:44.020973 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-7555689c4b-84shq"] Mar 16 16:53:44 crc kubenswrapper[5120]: I0316 16:53:44.041295 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:53:44 crc kubenswrapper[5120]: I0316 16:53:44.100922 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:53:44 crc kubenswrapper[5120]: I0316 16:53:44.153223 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:53:44 crc kubenswrapper[5120]: I0316 16:53:44.153263 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:53:44 crc kubenswrapper[5120]: I0316 16:53:44.185654 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:53:44 crc kubenswrapper[5120]: I0316 16:53:44.228297 5120 generic.go:358] "Generic (PLEG): container finished" podID="9fb3c077-55b7-4693-af84-b981deb240da" containerID="249b8277425756d242d2d291ee93149d50812f92e3c309d8c713d118d0ee6ee8" exitCode=0 Mar 16 16:53:44 crc kubenswrapper[5120]: I0316 16:53:44.228331 5120 generic.go:358] "Generic (PLEG): container finished" podID="9fb3c077-55b7-4693-af84-b981deb240da" containerID="6637aa7a76d94bb0d5267dcacbb4a5b56c43ee66a97a2de4a60d2391feac7339" exitCode=2 Mar 16 16:53:44 crc kubenswrapper[5120]: I0316 16:53:44.228335 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"9fb3c077-55b7-4693-af84-b981deb240da","Type":"ContainerDied","Data":"249b8277425756d242d2d291ee93149d50812f92e3c309d8c713d118d0ee6ee8"} Mar 16 16:53:44 crc kubenswrapper[5120]: I0316 16:53:44.228394 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"9fb3c077-55b7-4693-af84-b981deb240da","Type":"ContainerDied","Data":"6637aa7a76d94bb0d5267dcacbb4a5b56c43ee66a97a2de4a60d2391feac7339"} Mar 16 16:53:44 crc kubenswrapper[5120]: I0316 16:53:44.231100 5120 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Mar 16 16:53:44 crc kubenswrapper[5120]: I0316 16:53:44.491348 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:53:44 crc kubenswrapper[5120]: I0316 16:53:44.682717 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="34e6ded3-dd6f-46bb-9d23-fa8724b78ace" path="/var/lib/kubelet/pods/34e6ded3-dd6f-46bb-9d23-fa8724b78ace/volumes" Mar 16 16:53:44 crc kubenswrapper[5120]: I0316 16:53:44.683681 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e5acac7f-9646-4be1-ac22-31326296e4de" path="/var/lib/kubelet/pods/e5acac7f-9646-4be1-ac22-31326296e4de/volumes" Mar 16 16:53:45 crc kubenswrapper[5120]: I0316 16:53:45.160067 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="d8266cfd-9730-429f-8099-e47188d84aba" containerName="nova-metadata-log" probeResult="failure" output="Get \"https://10.217.0.193:8775/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 16:53:45 crc kubenswrapper[5120]: I0316 16:53:45.160962 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="d8266cfd-9730-429f-8099-e47188d84aba" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"https://10.217.0.193:8775/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 16:53:45 crc kubenswrapper[5120]: I0316 16:53:45.246602 5120 generic.go:358] "Generic (PLEG): container finished" podID="9fb3c077-55b7-4693-af84-b981deb240da" containerID="3ebb910b29446c7039a58d1fdfdb5ea8086cba8a3142a7103f3e20e30f3c7f4e" exitCode=0 Mar 16 16:53:45 crc kubenswrapper[5120]: I0316 16:53:45.246683 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"9fb3c077-55b7-4693-af84-b981deb240da","Type":"ContainerDied","Data":"3ebb910b29446c7039a58d1fdfdb5ea8086cba8a3142a7103f3e20e30f3c7f4e"} Mar 16 16:53:45 crc kubenswrapper[5120]: I0316 16:53:45.524279 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-75647f6cb4-4jcdp" podUID="0e2f5941-c2dd-490a-a6f8-5fc6f7af568e" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.1.247:9311/healthcheck\": read tcp 10.217.0.2:34510->10.217.1.247:9311: read: connection reset by peer" Mar 16 16:53:46 crc kubenswrapper[5120]: I0316 16:53:46.038627 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-75647f6cb4-4jcdp" Mar 16 16:53:46 crc kubenswrapper[5120]: I0316 16:53:46.174094 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:53:46 crc kubenswrapper[5120]: I0316 16:53:46.174160 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:53:46 crc kubenswrapper[5120]: I0316 16:53:46.209971 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0e2f5941-c2dd-490a-a6f8-5fc6f7af568e-logs\") pod \"0e2f5941-c2dd-490a-a6f8-5fc6f7af568e\" (UID: \"0e2f5941-c2dd-490a-a6f8-5fc6f7af568e\") " Mar 16 16:53:46 crc kubenswrapper[5120]: I0316 16:53:46.210367 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/0e2f5941-c2dd-490a-a6f8-5fc6f7af568e-public-tls-certs\") pod \"0e2f5941-c2dd-490a-a6f8-5fc6f7af568e\" (UID: \"0e2f5941-c2dd-490a-a6f8-5fc6f7af568e\") " Mar 16 16:53:46 crc kubenswrapper[5120]: I0316 16:53:46.210489 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0e2f5941-c2dd-490a-a6f8-5fc6f7af568e-combined-ca-bundle\") pod \"0e2f5941-c2dd-490a-a6f8-5fc6f7af568e\" (UID: \"0e2f5941-c2dd-490a-a6f8-5fc6f7af568e\") " Mar 16 16:53:46 crc kubenswrapper[5120]: I0316 16:53:46.210581 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6wj4g\" (UniqueName: \"kubernetes.io/projected/0e2f5941-c2dd-490a-a6f8-5fc6f7af568e-kube-api-access-6wj4g\") pod \"0e2f5941-c2dd-490a-a6f8-5fc6f7af568e\" (UID: \"0e2f5941-c2dd-490a-a6f8-5fc6f7af568e\") " Mar 16 16:53:46 crc kubenswrapper[5120]: I0316 16:53:46.210528 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e2f5941-c2dd-490a-a6f8-5fc6f7af568e-logs" (OuterVolumeSpecName: "logs") pod "0e2f5941-c2dd-490a-a6f8-5fc6f7af568e" (UID: "0e2f5941-c2dd-490a-a6f8-5fc6f7af568e"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:53:46 crc kubenswrapper[5120]: I0316 16:53:46.210901 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/0e2f5941-c2dd-490a-a6f8-5fc6f7af568e-internal-tls-certs\") pod \"0e2f5941-c2dd-490a-a6f8-5fc6f7af568e\" (UID: \"0e2f5941-c2dd-490a-a6f8-5fc6f7af568e\") " Mar 16 16:53:46 crc kubenswrapper[5120]: I0316 16:53:46.211094 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/0e2f5941-c2dd-490a-a6f8-5fc6f7af568e-config-data-custom\") pod \"0e2f5941-c2dd-490a-a6f8-5fc6f7af568e\" (UID: \"0e2f5941-c2dd-490a-a6f8-5fc6f7af568e\") " Mar 16 16:53:46 crc kubenswrapper[5120]: I0316 16:53:46.211445 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0e2f5941-c2dd-490a-a6f8-5fc6f7af568e-config-data\") pod \"0e2f5941-c2dd-490a-a6f8-5fc6f7af568e\" (UID: \"0e2f5941-c2dd-490a-a6f8-5fc6f7af568e\") " Mar 16 16:53:46 crc kubenswrapper[5120]: I0316 16:53:46.212270 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0e2f5941-c2dd-490a-a6f8-5fc6f7af568e-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:46 crc kubenswrapper[5120]: I0316 16:53:46.232320 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e2f5941-c2dd-490a-a6f8-5fc6f7af568e-kube-api-access-6wj4g" (OuterVolumeSpecName: "kube-api-access-6wj4g") pod "0e2f5941-c2dd-490a-a6f8-5fc6f7af568e" (UID: "0e2f5941-c2dd-490a-a6f8-5fc6f7af568e"). InnerVolumeSpecName "kube-api-access-6wj4g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:53:46 crc kubenswrapper[5120]: I0316 16:53:46.236939 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e2f5941-c2dd-490a-a6f8-5fc6f7af568e-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "0e2f5941-c2dd-490a-a6f8-5fc6f7af568e" (UID: "0e2f5941-c2dd-490a-a6f8-5fc6f7af568e"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:46 crc kubenswrapper[5120]: I0316 16:53:46.249661 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e2f5941-c2dd-490a-a6f8-5fc6f7af568e-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "0e2f5941-c2dd-490a-a6f8-5fc6f7af568e" (UID: "0e2f5941-c2dd-490a-a6f8-5fc6f7af568e"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:46 crc kubenswrapper[5120]: I0316 16:53:46.266864 5120 generic.go:358] "Generic (PLEG): container finished" podID="0e2f5941-c2dd-490a-a6f8-5fc6f7af568e" containerID="19cf3db62f08f61aa863610fbf6dc0bd5a259c611c8b79ce81173b436a47a9ba" exitCode=0 Mar 16 16:53:46 crc kubenswrapper[5120]: I0316 16:53:46.266939 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-75647f6cb4-4jcdp" event={"ID":"0e2f5941-c2dd-490a-a6f8-5fc6f7af568e","Type":"ContainerDied","Data":"19cf3db62f08f61aa863610fbf6dc0bd5a259c611c8b79ce81173b436a47a9ba"} Mar 16 16:53:46 crc kubenswrapper[5120]: I0316 16:53:46.266975 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-75647f6cb4-4jcdp" event={"ID":"0e2f5941-c2dd-490a-a6f8-5fc6f7af568e","Type":"ContainerDied","Data":"d008b96930826b3ad4855ce77924c0f44db1b58741ce3fab411ab371dca65c12"} Mar 16 16:53:46 crc kubenswrapper[5120]: I0316 16:53:46.266999 5120 scope.go:117] "RemoveContainer" containerID="19cf3db62f08f61aa863610fbf6dc0bd5a259c611c8b79ce81173b436a47a9ba" Mar 16 16:53:46 crc kubenswrapper[5120]: I0316 16:53:46.267211 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-75647f6cb4-4jcdp" Mar 16 16:53:46 crc kubenswrapper[5120]: I0316 16:53:46.274407 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e2f5941-c2dd-490a-a6f8-5fc6f7af568e-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "0e2f5941-c2dd-490a-a6f8-5fc6f7af568e" (UID: "0e2f5941-c2dd-490a-a6f8-5fc6f7af568e"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:46 crc kubenswrapper[5120]: I0316 16:53:46.313126 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e2f5941-c2dd-490a-a6f8-5fc6f7af568e-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "0e2f5941-c2dd-490a-a6f8-5fc6f7af568e" (UID: "0e2f5941-c2dd-490a-a6f8-5fc6f7af568e"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:46 crc kubenswrapper[5120]: I0316 16:53:46.314284 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/0e2f5941-c2dd-490a-a6f8-5fc6f7af568e-internal-tls-certs\") pod \"0e2f5941-c2dd-490a-a6f8-5fc6f7af568e\" (UID: \"0e2f5941-c2dd-490a-a6f8-5fc6f7af568e\") " Mar 16 16:53:46 crc kubenswrapper[5120]: W0316 16:53:46.314420 5120 empty_dir.go:511] Warning: Unmount skipped because path does not exist: /var/lib/kubelet/pods/0e2f5941-c2dd-490a-a6f8-5fc6f7af568e/volumes/kubernetes.io~secret/internal-tls-certs Mar 16 16:53:46 crc kubenswrapper[5120]: I0316 16:53:46.314454 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e2f5941-c2dd-490a-a6f8-5fc6f7af568e-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "0e2f5941-c2dd-490a-a6f8-5fc6f7af568e" (UID: "0e2f5941-c2dd-490a-a6f8-5fc6f7af568e"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:46 crc kubenswrapper[5120]: I0316 16:53:46.315420 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/0e2f5941-c2dd-490a-a6f8-5fc6f7af568e-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:46 crc kubenswrapper[5120]: I0316 16:53:46.315441 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0e2f5941-c2dd-490a-a6f8-5fc6f7af568e-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:46 crc kubenswrapper[5120]: I0316 16:53:46.315450 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6wj4g\" (UniqueName: \"kubernetes.io/projected/0e2f5941-c2dd-490a-a6f8-5fc6f7af568e-kube-api-access-6wj4g\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:46 crc kubenswrapper[5120]: I0316 16:53:46.315460 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/0e2f5941-c2dd-490a-a6f8-5fc6f7af568e-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:46 crc kubenswrapper[5120]: I0316 16:53:46.315468 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/0e2f5941-c2dd-490a-a6f8-5fc6f7af568e-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:46 crc kubenswrapper[5120]: I0316 16:53:46.316233 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e2f5941-c2dd-490a-a6f8-5fc6f7af568e-config-data" (OuterVolumeSpecName: "config-data") pod "0e2f5941-c2dd-490a-a6f8-5fc6f7af568e" (UID: "0e2f5941-c2dd-490a-a6f8-5fc6f7af568e"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:46 crc kubenswrapper[5120]: I0316 16:53:46.369071 5120 scope.go:117] "RemoveContainer" containerID="dd7fe7ffe304ba89a5574b9d845f1b3cdb0da51bf7c22a04814b909af709fdba" Mar 16 16:53:46 crc kubenswrapper[5120]: I0316 16:53:46.407618 5120 scope.go:117] "RemoveContainer" containerID="19cf3db62f08f61aa863610fbf6dc0bd5a259c611c8b79ce81173b436a47a9ba" Mar 16 16:53:46 crc kubenswrapper[5120]: E0316 16:53:46.408485 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"19cf3db62f08f61aa863610fbf6dc0bd5a259c611c8b79ce81173b436a47a9ba\": container with ID starting with 19cf3db62f08f61aa863610fbf6dc0bd5a259c611c8b79ce81173b436a47a9ba not found: ID does not exist" containerID="19cf3db62f08f61aa863610fbf6dc0bd5a259c611c8b79ce81173b436a47a9ba" Mar 16 16:53:46 crc kubenswrapper[5120]: I0316 16:53:46.408526 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19cf3db62f08f61aa863610fbf6dc0bd5a259c611c8b79ce81173b436a47a9ba"} err="failed to get container status \"19cf3db62f08f61aa863610fbf6dc0bd5a259c611c8b79ce81173b436a47a9ba\": rpc error: code = NotFound desc = could not find container \"19cf3db62f08f61aa863610fbf6dc0bd5a259c611c8b79ce81173b436a47a9ba\": container with ID starting with 19cf3db62f08f61aa863610fbf6dc0bd5a259c611c8b79ce81173b436a47a9ba not found: ID does not exist" Mar 16 16:53:46 crc kubenswrapper[5120]: I0316 16:53:46.408560 5120 scope.go:117] "RemoveContainer" containerID="dd7fe7ffe304ba89a5574b9d845f1b3cdb0da51bf7c22a04814b909af709fdba" Mar 16 16:53:46 crc kubenswrapper[5120]: E0316 16:53:46.411114 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd7fe7ffe304ba89a5574b9d845f1b3cdb0da51bf7c22a04814b909af709fdba\": container with ID starting with dd7fe7ffe304ba89a5574b9d845f1b3cdb0da51bf7c22a04814b909af709fdba not found: ID does not exist" containerID="dd7fe7ffe304ba89a5574b9d845f1b3cdb0da51bf7c22a04814b909af709fdba" Mar 16 16:53:46 crc kubenswrapper[5120]: I0316 16:53:46.411147 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd7fe7ffe304ba89a5574b9d845f1b3cdb0da51bf7c22a04814b909af709fdba"} err="failed to get container status \"dd7fe7ffe304ba89a5574b9d845f1b3cdb0da51bf7c22a04814b909af709fdba\": rpc error: code = NotFound desc = could not find container \"dd7fe7ffe304ba89a5574b9d845f1b3cdb0da51bf7c22a04814b909af709fdba\": container with ID starting with dd7fe7ffe304ba89a5574b9d845f1b3cdb0da51bf7c22a04814b909af709fdba not found: ID does not exist" Mar 16 16:53:46 crc kubenswrapper[5120]: I0316 16:53:46.418286 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0e2f5941-c2dd-490a-a6f8-5fc6f7af568e-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:46 crc kubenswrapper[5120]: I0316 16:53:46.602756 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-75647f6cb4-4jcdp"] Mar 16 16:53:46 crc kubenswrapper[5120]: I0316 16:53:46.612107 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-api-75647f6cb4-4jcdp"] Mar 16 16:53:46 crc kubenswrapper[5120]: I0316 16:53:46.677003 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0e2f5941-c2dd-490a-a6f8-5fc6f7af568e" path="/var/lib/kubelet/pods/0e2f5941-c2dd-490a-a6f8-5fc6f7af568e/volumes" Mar 16 16:53:47 crc kubenswrapper[5120]: I0316 16:53:47.235077 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/neutron-f56965744-skhtb" podUID="4907839f-9071-4378-90f6-f92ced0b0bf0" containerName="neutron-httpd" probeResult="failure" output="Get \"https://10.217.0.156:9696/\": dial tcp 10.217.0.156:9696: connect: connection refused" Mar 16 16:53:47 crc kubenswrapper[5120]: I0316 16:53:47.772064 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-f56965744-skhtb_4907839f-9071-4378-90f6-f92ced0b0bf0/neutron-api/0.log" Mar 16 16:53:47 crc kubenswrapper[5120]: I0316 16:53:47.772410 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-f56965744-skhtb" Mar 16 16:53:47 crc kubenswrapper[5120]: I0316 16:53:47.885833 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="b91a9930-eec4-4af5-9aee-5d02dc78fabc" containerName="cinder-scheduler" probeResult="failure" output="Get \"http://10.217.0.137:8080/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 16:53:47 crc kubenswrapper[5120]: I0316 16:53:47.954661 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4907839f-9071-4378-90f6-f92ced0b0bf0-combined-ca-bundle\") pod \"4907839f-9071-4378-90f6-f92ced0b0bf0\" (UID: \"4907839f-9071-4378-90f6-f92ced0b0bf0\") " Mar 16 16:53:47 crc kubenswrapper[5120]: I0316 16:53:47.954978 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nlbdb\" (UniqueName: \"kubernetes.io/projected/4907839f-9071-4378-90f6-f92ced0b0bf0-kube-api-access-nlbdb\") pod \"4907839f-9071-4378-90f6-f92ced0b0bf0\" (UID: \"4907839f-9071-4378-90f6-f92ced0b0bf0\") " Mar 16 16:53:47 crc kubenswrapper[5120]: I0316 16:53:47.955310 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/4907839f-9071-4378-90f6-f92ced0b0bf0-ovndb-tls-certs\") pod \"4907839f-9071-4378-90f6-f92ced0b0bf0\" (UID: \"4907839f-9071-4378-90f6-f92ced0b0bf0\") " Mar 16 16:53:47 crc kubenswrapper[5120]: I0316 16:53:47.955360 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/4907839f-9071-4378-90f6-f92ced0b0bf0-public-tls-certs\") pod \"4907839f-9071-4378-90f6-f92ced0b0bf0\" (UID: \"4907839f-9071-4378-90f6-f92ced0b0bf0\") " Mar 16 16:53:47 crc kubenswrapper[5120]: I0316 16:53:47.955392 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/4907839f-9071-4378-90f6-f92ced0b0bf0-httpd-config\") pod \"4907839f-9071-4378-90f6-f92ced0b0bf0\" (UID: \"4907839f-9071-4378-90f6-f92ced0b0bf0\") " Mar 16 16:53:47 crc kubenswrapper[5120]: I0316 16:53:47.955463 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/4907839f-9071-4378-90f6-f92ced0b0bf0-internal-tls-certs\") pod \"4907839f-9071-4378-90f6-f92ced0b0bf0\" (UID: \"4907839f-9071-4378-90f6-f92ced0b0bf0\") " Mar 16 16:53:47 crc kubenswrapper[5120]: I0316 16:53:47.955567 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4907839f-9071-4378-90f6-f92ced0b0bf0-config\") pod \"4907839f-9071-4378-90f6-f92ced0b0bf0\" (UID: \"4907839f-9071-4378-90f6-f92ced0b0bf0\") " Mar 16 16:53:47 crc kubenswrapper[5120]: I0316 16:53:47.964070 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4907839f-9071-4378-90f6-f92ced0b0bf0-kube-api-access-nlbdb" (OuterVolumeSpecName: "kube-api-access-nlbdb") pod "4907839f-9071-4378-90f6-f92ced0b0bf0" (UID: "4907839f-9071-4378-90f6-f92ced0b0bf0"). InnerVolumeSpecName "kube-api-access-nlbdb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:53:47 crc kubenswrapper[5120]: I0316 16:53:47.966926 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4907839f-9071-4378-90f6-f92ced0b0bf0-httpd-config" (OuterVolumeSpecName: "httpd-config") pod "4907839f-9071-4378-90f6-f92ced0b0bf0" (UID: "4907839f-9071-4378-90f6-f92ced0b0bf0"). InnerVolumeSpecName "httpd-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.020703 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openstack-kuttl-tests/neutron-7b9f48f6c8-rfj5g" podUID="eb34a81f-663e-4027-bf2c-1d334bd06ba4" containerName="neutron-api" probeResult="failure" output="HTTP probe failed with statuscode: 503" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.022321 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openstack-kuttl-tests/neutron-7b9f48f6c8-rfj5g" podUID="eb34a81f-663e-4027-bf2c-1d334bd06ba4" containerName="neutron-httpd" probeResult="failure" output="HTTP probe failed with statuscode: 503" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.029384 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4907839f-9071-4378-90f6-f92ced0b0bf0-config" (OuterVolumeSpecName: "config") pod "4907839f-9071-4378-90f6-f92ced0b0bf0" (UID: "4907839f-9071-4378-90f6-f92ced0b0bf0"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.039005 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4907839f-9071-4378-90f6-f92ced0b0bf0-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "4907839f-9071-4378-90f6-f92ced0b0bf0" (UID: "4907839f-9071-4378-90f6-f92ced0b0bf0"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.041490 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4907839f-9071-4378-90f6-f92ced0b0bf0-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "4907839f-9071-4378-90f6-f92ced0b0bf0" (UID: "4907839f-9071-4378-90f6-f92ced0b0bf0"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.041928 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4907839f-9071-4378-90f6-f92ced0b0bf0-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "4907839f-9071-4378-90f6-f92ced0b0bf0" (UID: "4907839f-9071-4378-90f6-f92ced0b0bf0"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.053265 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4907839f-9071-4378-90f6-f92ced0b0bf0-ovndb-tls-certs" (OuterVolumeSpecName: "ovndb-tls-certs") pod "4907839f-9071-4378-90f6-f92ced0b0bf0" (UID: "4907839f-9071-4378-90f6-f92ced0b0bf0"). InnerVolumeSpecName "ovndb-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.059912 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/4907839f-9071-4378-90f6-f92ced0b0bf0-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.059954 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4907839f-9071-4378-90f6-f92ced0b0bf0-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.059991 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nlbdb\" (UniqueName: \"kubernetes.io/projected/4907839f-9071-4378-90f6-f92ced0b0bf0-kube-api-access-nlbdb\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.060007 5120 reconciler_common.go:299] "Volume detached for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/4907839f-9071-4378-90f6-f92ced0b0bf0-ovndb-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.060016 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/4907839f-9071-4378-90f6-f92ced0b0bf0-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.060027 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/4907839f-9071-4378-90f6-f92ced0b0bf0-httpd-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.060038 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/4907839f-9071-4378-90f6-f92ced0b0bf0-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.123232 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.181209 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.181869 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.197079 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.266424 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9fb3c077-55b7-4693-af84-b981deb240da-combined-ca-bundle\") pod \"9fb3c077-55b7-4693-af84-b981deb240da\" (UID: \"9fb3c077-55b7-4693-af84-b981deb240da\") " Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.266508 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tfmbj\" (UniqueName: \"kubernetes.io/projected/9fb3c077-55b7-4693-af84-b981deb240da-kube-api-access-tfmbj\") pod \"9fb3c077-55b7-4693-af84-b981deb240da\" (UID: \"9fb3c077-55b7-4693-af84-b981deb240da\") " Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.266687 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9fb3c077-55b7-4693-af84-b981deb240da-scripts\") pod \"9fb3c077-55b7-4693-af84-b981deb240da\" (UID: \"9fb3c077-55b7-4693-af84-b981deb240da\") " Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.266999 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/9fb3c077-55b7-4693-af84-b981deb240da-ceilometer-tls-certs\") pod \"9fb3c077-55b7-4693-af84-b981deb240da\" (UID: \"9fb3c077-55b7-4693-af84-b981deb240da\") " Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.267097 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/9fb3c077-55b7-4693-af84-b981deb240da-log-httpd\") pod \"9fb3c077-55b7-4693-af84-b981deb240da\" (UID: \"9fb3c077-55b7-4693-af84-b981deb240da\") " Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.267244 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/9fb3c077-55b7-4693-af84-b981deb240da-run-httpd\") pod \"9fb3c077-55b7-4693-af84-b981deb240da\" (UID: \"9fb3c077-55b7-4693-af84-b981deb240da\") " Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.267540 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/9fb3c077-55b7-4693-af84-b981deb240da-sg-core-conf-yaml\") pod \"9fb3c077-55b7-4693-af84-b981deb240da\" (UID: \"9fb3c077-55b7-4693-af84-b981deb240da\") " Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.267686 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9fb3c077-55b7-4693-af84-b981deb240da-config-data\") pod \"9fb3c077-55b7-4693-af84-b981deb240da\" (UID: \"9fb3c077-55b7-4693-af84-b981deb240da\") " Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.268184 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9fb3c077-55b7-4693-af84-b981deb240da-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "9fb3c077-55b7-4693-af84-b981deb240da" (UID: "9fb3c077-55b7-4693-af84-b981deb240da"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.268940 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9fb3c077-55b7-4693-af84-b981deb240da-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "9fb3c077-55b7-4693-af84-b981deb240da" (UID: "9fb3c077-55b7-4693-af84-b981deb240da"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.269694 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/9fb3c077-55b7-4693-af84-b981deb240da-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.269778 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/9fb3c077-55b7-4693-af84-b981deb240da-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.275391 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9fb3c077-55b7-4693-af84-b981deb240da-scripts" (OuterVolumeSpecName: "scripts") pod "9fb3c077-55b7-4693-af84-b981deb240da" (UID: "9fb3c077-55b7-4693-af84-b981deb240da"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.275478 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9fb3c077-55b7-4693-af84-b981deb240da-kube-api-access-tfmbj" (OuterVolumeSpecName: "kube-api-access-tfmbj") pod "9fb3c077-55b7-4693-af84-b981deb240da" (UID: "9fb3c077-55b7-4693-af84-b981deb240da"). InnerVolumeSpecName "kube-api-access-tfmbj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.294033 5120 generic.go:358] "Generic (PLEG): container finished" podID="9fb3c077-55b7-4693-af84-b981deb240da" containerID="d6379599594c178393fbf1640c89d3239c76f0259578ec41f0162a979abfaeed" exitCode=0 Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.294397 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"9fb3c077-55b7-4693-af84-b981deb240da","Type":"ContainerDied","Data":"d6379599594c178393fbf1640c89d3239c76f0259578ec41f0162a979abfaeed"} Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.294431 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"9fb3c077-55b7-4693-af84-b981deb240da","Type":"ContainerDied","Data":"d91d83b70d44dac50bc5c6df966179b24d1b383bd576c0575089f528eb05a115"} Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.294446 5120 scope.go:117] "RemoveContainer" containerID="249b8277425756d242d2d291ee93149d50812f92e3c309d8c713d118d0ee6ee8" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.294620 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.302020 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9fb3c077-55b7-4693-af84-b981deb240da-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "9fb3c077-55b7-4693-af84-b981deb240da" (UID: "9fb3c077-55b7-4693-af84-b981deb240da"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.309510 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-f56965744-skhtb_4907839f-9071-4378-90f6-f92ced0b0bf0/neutron-api/0.log" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.309575 5120 generic.go:358] "Generic (PLEG): container finished" podID="4907839f-9071-4378-90f6-f92ced0b0bf0" containerID="2dfd289344b424c2a731001caf2fb6357db8afaf4bd8fe7f4af4a4e540466d5d" exitCode=137 Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.310460 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-f56965744-skhtb" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.311109 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-f56965744-skhtb" event={"ID":"4907839f-9071-4378-90f6-f92ced0b0bf0","Type":"ContainerDied","Data":"2dfd289344b424c2a731001caf2fb6357db8afaf4bd8fe7f4af4a4e540466d5d"} Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.311175 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-f56965744-skhtb" event={"ID":"4907839f-9071-4378-90f6-f92ced0b0bf0","Type":"ContainerDied","Data":"b3360375cb2fa00eecf25a726dfb40c55dbbe6d258c3a93d1eec2c531c8e8559"} Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.329458 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.335488 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9fb3c077-55b7-4693-af84-b981deb240da-ceilometer-tls-certs" (OuterVolumeSpecName: "ceilometer-tls-certs") pod "9fb3c077-55b7-4693-af84-b981deb240da" (UID: "9fb3c077-55b7-4693-af84-b981deb240da"). InnerVolumeSpecName "ceilometer-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.352401 5120 scope.go:117] "RemoveContainer" containerID="6637aa7a76d94bb0d5267dcacbb4a5b56c43ee66a97a2de4a60d2391feac7339" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.374996 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/9fb3c077-55b7-4693-af84-b981deb240da-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.375041 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tfmbj\" (UniqueName: \"kubernetes.io/projected/9fb3c077-55b7-4693-af84-b981deb240da-kube-api-access-tfmbj\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.375053 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9fb3c077-55b7-4693-af84-b981deb240da-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.375062 5120 reconciler_common.go:299] "Volume detached for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/9fb3c077-55b7-4693-af84-b981deb240da-ceilometer-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.391059 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9fb3c077-55b7-4693-af84-b981deb240da-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "9fb3c077-55b7-4693-af84-b981deb240da" (UID: "9fb3c077-55b7-4693-af84-b981deb240da"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.392154 5120 scope.go:117] "RemoveContainer" containerID="d6379599594c178393fbf1640c89d3239c76f0259578ec41f0162a979abfaeed" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.408949 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-f56965744-skhtb"] Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.424721 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-f56965744-skhtb"] Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.426630 5120 scope.go:117] "RemoveContainer" containerID="3ebb910b29446c7039a58d1fdfdb5ea8086cba8a3142a7103f3e20e30f3c7f4e" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.455093 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9fb3c077-55b7-4693-af84-b981deb240da-config-data" (OuterVolumeSpecName: "config-data") pod "9fb3c077-55b7-4693-af84-b981deb240da" (UID: "9fb3c077-55b7-4693-af84-b981deb240da"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.461509 5120 scope.go:117] "RemoveContainer" containerID="249b8277425756d242d2d291ee93149d50812f92e3c309d8c713d118d0ee6ee8" Mar 16 16:53:48 crc kubenswrapper[5120]: E0316 16:53:48.462077 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"249b8277425756d242d2d291ee93149d50812f92e3c309d8c713d118d0ee6ee8\": container with ID starting with 249b8277425756d242d2d291ee93149d50812f92e3c309d8c713d118d0ee6ee8 not found: ID does not exist" containerID="249b8277425756d242d2d291ee93149d50812f92e3c309d8c713d118d0ee6ee8" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.462115 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"249b8277425756d242d2d291ee93149d50812f92e3c309d8c713d118d0ee6ee8"} err="failed to get container status \"249b8277425756d242d2d291ee93149d50812f92e3c309d8c713d118d0ee6ee8\": rpc error: code = NotFound desc = could not find container \"249b8277425756d242d2d291ee93149d50812f92e3c309d8c713d118d0ee6ee8\": container with ID starting with 249b8277425756d242d2d291ee93149d50812f92e3c309d8c713d118d0ee6ee8 not found: ID does not exist" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.462139 5120 scope.go:117] "RemoveContainer" containerID="6637aa7a76d94bb0d5267dcacbb4a5b56c43ee66a97a2de4a60d2391feac7339" Mar 16 16:53:48 crc kubenswrapper[5120]: E0316 16:53:48.462416 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6637aa7a76d94bb0d5267dcacbb4a5b56c43ee66a97a2de4a60d2391feac7339\": container with ID starting with 6637aa7a76d94bb0d5267dcacbb4a5b56c43ee66a97a2de4a60d2391feac7339 not found: ID does not exist" containerID="6637aa7a76d94bb0d5267dcacbb4a5b56c43ee66a97a2de4a60d2391feac7339" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.462503 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6637aa7a76d94bb0d5267dcacbb4a5b56c43ee66a97a2de4a60d2391feac7339"} err="failed to get container status \"6637aa7a76d94bb0d5267dcacbb4a5b56c43ee66a97a2de4a60d2391feac7339\": rpc error: code = NotFound desc = could not find container \"6637aa7a76d94bb0d5267dcacbb4a5b56c43ee66a97a2de4a60d2391feac7339\": container with ID starting with 6637aa7a76d94bb0d5267dcacbb4a5b56c43ee66a97a2de4a60d2391feac7339 not found: ID does not exist" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.462526 5120 scope.go:117] "RemoveContainer" containerID="d6379599594c178393fbf1640c89d3239c76f0259578ec41f0162a979abfaeed" Mar 16 16:53:48 crc kubenswrapper[5120]: E0316 16:53:48.462720 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d6379599594c178393fbf1640c89d3239c76f0259578ec41f0162a979abfaeed\": container with ID starting with d6379599594c178393fbf1640c89d3239c76f0259578ec41f0162a979abfaeed not found: ID does not exist" containerID="d6379599594c178393fbf1640c89d3239c76f0259578ec41f0162a979abfaeed" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.462744 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6379599594c178393fbf1640c89d3239c76f0259578ec41f0162a979abfaeed"} err="failed to get container status \"d6379599594c178393fbf1640c89d3239c76f0259578ec41f0162a979abfaeed\": rpc error: code = NotFound desc = could not find container \"d6379599594c178393fbf1640c89d3239c76f0259578ec41f0162a979abfaeed\": container with ID starting with d6379599594c178393fbf1640c89d3239c76f0259578ec41f0162a979abfaeed not found: ID does not exist" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.462771 5120 scope.go:117] "RemoveContainer" containerID="3ebb910b29446c7039a58d1fdfdb5ea8086cba8a3142a7103f3e20e30f3c7f4e" Mar 16 16:53:48 crc kubenswrapper[5120]: E0316 16:53:48.463014 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ebb910b29446c7039a58d1fdfdb5ea8086cba8a3142a7103f3e20e30f3c7f4e\": container with ID starting with 3ebb910b29446c7039a58d1fdfdb5ea8086cba8a3142a7103f3e20e30f3c7f4e not found: ID does not exist" containerID="3ebb910b29446c7039a58d1fdfdb5ea8086cba8a3142a7103f3e20e30f3c7f4e" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.463036 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ebb910b29446c7039a58d1fdfdb5ea8086cba8a3142a7103f3e20e30f3c7f4e"} err="failed to get container status \"3ebb910b29446c7039a58d1fdfdb5ea8086cba8a3142a7103f3e20e30f3c7f4e\": rpc error: code = NotFound desc = could not find container \"3ebb910b29446c7039a58d1fdfdb5ea8086cba8a3142a7103f3e20e30f3c7f4e\": container with ID starting with 3ebb910b29446c7039a58d1fdfdb5ea8086cba8a3142a7103f3e20e30f3c7f4e not found: ID does not exist" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.463049 5120 scope.go:117] "RemoveContainer" containerID="c015127c07a61c75b148a24b94cb58126066d557796401e4738fd413970294a5" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.477331 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9fb3c077-55b7-4693-af84-b981deb240da-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.477369 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9fb3c077-55b7-4693-af84-b981deb240da-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.483898 5120 scope.go:117] "RemoveContainer" containerID="2dfd289344b424c2a731001caf2fb6357db8afaf4bd8fe7f4af4a4e540466d5d" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.503583 5120 scope.go:117] "RemoveContainer" containerID="c015127c07a61c75b148a24b94cb58126066d557796401e4738fd413970294a5" Mar 16 16:53:48 crc kubenswrapper[5120]: E0316 16:53:48.504081 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c015127c07a61c75b148a24b94cb58126066d557796401e4738fd413970294a5\": container with ID starting with c015127c07a61c75b148a24b94cb58126066d557796401e4738fd413970294a5 not found: ID does not exist" containerID="c015127c07a61c75b148a24b94cb58126066d557796401e4738fd413970294a5" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.504194 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c015127c07a61c75b148a24b94cb58126066d557796401e4738fd413970294a5"} err="failed to get container status \"c015127c07a61c75b148a24b94cb58126066d557796401e4738fd413970294a5\": rpc error: code = NotFound desc = could not find container \"c015127c07a61c75b148a24b94cb58126066d557796401e4738fd413970294a5\": container with ID starting with c015127c07a61c75b148a24b94cb58126066d557796401e4738fd413970294a5 not found: ID does not exist" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.504274 5120 scope.go:117] "RemoveContainer" containerID="2dfd289344b424c2a731001caf2fb6357db8afaf4bd8fe7f4af4a4e540466d5d" Mar 16 16:53:48 crc kubenswrapper[5120]: E0316 16:53:48.504616 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2dfd289344b424c2a731001caf2fb6357db8afaf4bd8fe7f4af4a4e540466d5d\": container with ID starting with 2dfd289344b424c2a731001caf2fb6357db8afaf4bd8fe7f4af4a4e540466d5d not found: ID does not exist" containerID="2dfd289344b424c2a731001caf2fb6357db8afaf4bd8fe7f4af4a4e540466d5d" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.504650 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2dfd289344b424c2a731001caf2fb6357db8afaf4bd8fe7f4af4a4e540466d5d"} err="failed to get container status \"2dfd289344b424c2a731001caf2fb6357db8afaf4bd8fe7f4af4a4e540466d5d\": rpc error: code = NotFound desc = could not find container \"2dfd289344b424c2a731001caf2fb6357db8afaf4bd8fe7f4af4a4e540466d5d\": container with ID starting with 2dfd289344b424c2a731001caf2fb6357db8afaf4bd8fe7f4af4a4e540466d5d not found: ID does not exist" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.636064 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.648981 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.684343 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4907839f-9071-4378-90f6-f92ced0b0bf0" path="/var/lib/kubelet/pods/4907839f-9071-4378-90f6-f92ced0b0bf0/volumes" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.685128 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9fb3c077-55b7-4693-af84-b981deb240da" path="/var/lib/kubelet/pods/9fb3c077-55b7-4693-af84-b981deb240da/volumes" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.685909 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.687254 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9fb3c077-55b7-4693-af84-b981deb240da" containerName="proxy-httpd" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.687276 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9fb3c077-55b7-4693-af84-b981deb240da" containerName="proxy-httpd" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.687300 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9fb3c077-55b7-4693-af84-b981deb240da" containerName="ceilometer-central-agent" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.687307 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9fb3c077-55b7-4693-af84-b981deb240da" containerName="ceilometer-central-agent" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.687319 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e2f5941-c2dd-490a-a6f8-5fc6f7af568e" containerName="barbican-api" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.687324 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e2f5941-c2dd-490a-a6f8-5fc6f7af568e" containerName="barbican-api" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.687333 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7bf94ef-c84b-45ee-a2d9-dd048b1172e3" containerName="registry-server" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.687338 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7bf94ef-c84b-45ee-a2d9-dd048b1172e3" containerName="registry-server" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.687349 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5acac7f-9646-4be1-ac22-31326296e4de" containerName="neutron-api" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.687354 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5acac7f-9646-4be1-ac22-31326296e4de" containerName="neutron-api" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.687361 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3853023d-8cc5-42de-9f91-d0609e3fe565" containerName="neutron-httpd" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.687367 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="3853023d-8cc5-42de-9f91-d0609e3fe565" containerName="neutron-httpd" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.687383 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34e6ded3-dd6f-46bb-9d23-fa8724b78ace" containerName="neutron-api" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.687389 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="34e6ded3-dd6f-46bb-9d23-fa8724b78ace" containerName="neutron-api" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.687396 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9fb3c077-55b7-4693-af84-b981deb240da" containerName="sg-core" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.687401 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9fb3c077-55b7-4693-af84-b981deb240da" containerName="sg-core" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.687408 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4907839f-9071-4378-90f6-f92ced0b0bf0" containerName="neutron-api" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.687413 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="4907839f-9071-4378-90f6-f92ced0b0bf0" containerName="neutron-api" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.687423 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4907839f-9071-4378-90f6-f92ced0b0bf0" containerName="neutron-httpd" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.687430 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="4907839f-9071-4378-90f6-f92ced0b0bf0" containerName="neutron-httpd" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.687442 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5acac7f-9646-4be1-ac22-31326296e4de" containerName="neutron-httpd" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.687447 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5acac7f-9646-4be1-ac22-31326296e4de" containerName="neutron-httpd" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.687459 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7bf94ef-c84b-45ee-a2d9-dd048b1172e3" containerName="extract-utilities" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.687464 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7bf94ef-c84b-45ee-a2d9-dd048b1172e3" containerName="extract-utilities" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.687483 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9fb3c077-55b7-4693-af84-b981deb240da" containerName="ceilometer-notification-agent" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.687488 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9fb3c077-55b7-4693-af84-b981deb240da" containerName="ceilometer-notification-agent" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.687497 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="133b5e0f-d834-4c59-932f-957221e1727b" containerName="barbican-api-log" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.687502 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="133b5e0f-d834-4c59-932f-957221e1727b" containerName="barbican-api-log" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.687530 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e2f5941-c2dd-490a-a6f8-5fc6f7af568e" containerName="barbican-api-log" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.687537 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e2f5941-c2dd-490a-a6f8-5fc6f7af568e" containerName="barbican-api-log" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.687544 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34e6ded3-dd6f-46bb-9d23-fa8724b78ace" containerName="neutron-httpd" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.687550 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="34e6ded3-dd6f-46bb-9d23-fa8724b78ace" containerName="neutron-httpd" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.687558 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7bf94ef-c84b-45ee-a2d9-dd048b1172e3" containerName="extract-content" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.687565 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7bf94ef-c84b-45ee-a2d9-dd048b1172e3" containerName="extract-content" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.687576 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3853023d-8cc5-42de-9f91-d0609e3fe565" containerName="neutron-api" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.687581 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="3853023d-8cc5-42de-9f91-d0609e3fe565" containerName="neutron-api" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.687590 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="133b5e0f-d834-4c59-932f-957221e1727b" containerName="barbican-api" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.687595 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="133b5e0f-d834-4c59-932f-957221e1727b" containerName="barbican-api" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.687786 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="34e6ded3-dd6f-46bb-9d23-fa8724b78ace" containerName="neutron-api" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.687802 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="9fb3c077-55b7-4693-af84-b981deb240da" containerName="ceilometer-notification-agent" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.687814 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="34e6ded3-dd6f-46bb-9d23-fa8724b78ace" containerName="neutron-httpd" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.687829 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e7bf94ef-c84b-45ee-a2d9-dd048b1172e3" containerName="registry-server" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.687839 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="0e2f5941-c2dd-490a-a6f8-5fc6f7af568e" containerName="barbican-api" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.687854 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="0e2f5941-c2dd-490a-a6f8-5fc6f7af568e" containerName="barbican-api-log" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.687864 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="133b5e0f-d834-4c59-932f-957221e1727b" containerName="barbican-api-log" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.687879 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="9fb3c077-55b7-4693-af84-b981deb240da" containerName="proxy-httpd" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.687895 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e5acac7f-9646-4be1-ac22-31326296e4de" containerName="neutron-api" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.687910 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e5acac7f-9646-4be1-ac22-31326296e4de" containerName="neutron-httpd" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.687920 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="9fb3c077-55b7-4693-af84-b981deb240da" containerName="ceilometer-central-agent" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.687934 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="3853023d-8cc5-42de-9f91-d0609e3fe565" containerName="neutron-httpd" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.687946 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="3853023d-8cc5-42de-9f91-d0609e3fe565" containerName="neutron-api" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.687954 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="4907839f-9071-4378-90f6-f92ced0b0bf0" containerName="neutron-httpd" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.687966 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="9fb3c077-55b7-4693-af84-b981deb240da" containerName="sg-core" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.687975 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="133b5e0f-d834-4c59-932f-957221e1727b" containerName="barbican-api" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.687986 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="4907839f-9071-4378-90f6-f92ced0b0bf0" containerName="neutron-api" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.707457 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.707658 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.713599 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.713950 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.714641 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ceilometer-internal-svc\"" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.783549 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/e3bbdf40-3feb-46ae-a12d-152e88c1bccd-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"e3bbdf40-3feb-46ae-a12d-152e88c1bccd\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.783583 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e3bbdf40-3feb-46ae-a12d-152e88c1bccd-log-httpd\") pod \"ceilometer-0\" (UID: \"e3bbdf40-3feb-46ae-a12d-152e88c1bccd\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.783724 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/e3bbdf40-3feb-46ae-a12d-152e88c1bccd-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"e3bbdf40-3feb-46ae-a12d-152e88c1bccd\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.783773 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e3bbdf40-3feb-46ae-a12d-152e88c1bccd-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"e3bbdf40-3feb-46ae-a12d-152e88c1bccd\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.783990 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e3bbdf40-3feb-46ae-a12d-152e88c1bccd-config-data\") pod \"ceilometer-0\" (UID: \"e3bbdf40-3feb-46ae-a12d-152e88c1bccd\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.784227 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nppdh\" (UniqueName: \"kubernetes.io/projected/e3bbdf40-3feb-46ae-a12d-152e88c1bccd-kube-api-access-nppdh\") pod \"ceilometer-0\" (UID: \"e3bbdf40-3feb-46ae-a12d-152e88c1bccd\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.784307 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e3bbdf40-3feb-46ae-a12d-152e88c1bccd-scripts\") pod \"ceilometer-0\" (UID: \"e3bbdf40-3feb-46ae-a12d-152e88c1bccd\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.784337 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e3bbdf40-3feb-46ae-a12d-152e88c1bccd-run-httpd\") pod \"ceilometer-0\" (UID: \"e3bbdf40-3feb-46ae-a12d-152e88c1bccd\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.886652 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e3bbdf40-3feb-46ae-a12d-152e88c1bccd-scripts\") pod \"ceilometer-0\" (UID: \"e3bbdf40-3feb-46ae-a12d-152e88c1bccd\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.886700 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e3bbdf40-3feb-46ae-a12d-152e88c1bccd-run-httpd\") pod \"ceilometer-0\" (UID: \"e3bbdf40-3feb-46ae-a12d-152e88c1bccd\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.886825 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/e3bbdf40-3feb-46ae-a12d-152e88c1bccd-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"e3bbdf40-3feb-46ae-a12d-152e88c1bccd\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.886842 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e3bbdf40-3feb-46ae-a12d-152e88c1bccd-log-httpd\") pod \"ceilometer-0\" (UID: \"e3bbdf40-3feb-46ae-a12d-152e88c1bccd\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.886943 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/e3bbdf40-3feb-46ae-a12d-152e88c1bccd-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"e3bbdf40-3feb-46ae-a12d-152e88c1bccd\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.886974 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e3bbdf40-3feb-46ae-a12d-152e88c1bccd-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"e3bbdf40-3feb-46ae-a12d-152e88c1bccd\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.887040 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e3bbdf40-3feb-46ae-a12d-152e88c1bccd-config-data\") pod \"ceilometer-0\" (UID: \"e3bbdf40-3feb-46ae-a12d-152e88c1bccd\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.887126 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nppdh\" (UniqueName: \"kubernetes.io/projected/e3bbdf40-3feb-46ae-a12d-152e88c1bccd-kube-api-access-nppdh\") pod \"ceilometer-0\" (UID: \"e3bbdf40-3feb-46ae-a12d-152e88c1bccd\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.887388 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e3bbdf40-3feb-46ae-a12d-152e88c1bccd-run-httpd\") pod \"ceilometer-0\" (UID: \"e3bbdf40-3feb-46ae-a12d-152e88c1bccd\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.888222 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e3bbdf40-3feb-46ae-a12d-152e88c1bccd-log-httpd\") pod \"ceilometer-0\" (UID: \"e3bbdf40-3feb-46ae-a12d-152e88c1bccd\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.896506 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e3bbdf40-3feb-46ae-a12d-152e88c1bccd-config-data\") pod \"ceilometer-0\" (UID: \"e3bbdf40-3feb-46ae-a12d-152e88c1bccd\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.900478 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e3bbdf40-3feb-46ae-a12d-152e88c1bccd-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"e3bbdf40-3feb-46ae-a12d-152e88c1bccd\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.901141 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/e3bbdf40-3feb-46ae-a12d-152e88c1bccd-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"e3bbdf40-3feb-46ae-a12d-152e88c1bccd\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.901499 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e3bbdf40-3feb-46ae-a12d-152e88c1bccd-scripts\") pod \"ceilometer-0\" (UID: \"e3bbdf40-3feb-46ae-a12d-152e88c1bccd\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.905230 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/e3bbdf40-3feb-46ae-a12d-152e88c1bccd-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"e3bbdf40-3feb-46ae-a12d-152e88c1bccd\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.908547 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nppdh\" (UniqueName: \"kubernetes.io/projected/e3bbdf40-3feb-46ae-a12d-152e88c1bccd-kube-api-access-nppdh\") pod \"ceilometer-0\" (UID: \"e3bbdf40-3feb-46ae-a12d-152e88c1bccd\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.951818 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:53:48 crc kubenswrapper[5120]: I0316 16:53:48.995868 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:53:49 crc kubenswrapper[5120]: I0316 16:53:49.053203 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:53:49 crc kubenswrapper[5120]: I0316 16:53:49.088926 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:53:49 crc kubenswrapper[5120]: I0316 16:53:49.336620 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="b91a9930-eec4-4af5-9aee-5d02dc78fabc" containerName="cinder-scheduler" containerID="cri-o://424e31545d803d2327b8e14c4a5a0a88e6c5500c83a65260f104ea072002902b" gracePeriod=30 Mar 16 16:53:49 crc kubenswrapper[5120]: I0316 16:53:49.336730 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="b91a9930-eec4-4af5-9aee-5d02dc78fabc" containerName="probe" containerID="cri-o://9447a2fb9a0e4308274aa0d296a7cfd1a4423ed65d9e7c646f286f31ab7bd69e" gracePeriod=30 Mar 16 16:53:49 crc kubenswrapper[5120]: I0316 16:53:49.601309 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:53:49 crc kubenswrapper[5120]: I0316 16:53:49.702597 5120 pod_container_manager_linux.go:217] "Failed to delete cgroup paths" cgroupName=["kubepods","besteffort","pod6792b2c6-f5cf-454a-858a-cbd4159db76a"] err="unable to destroy cgroup paths for cgroup [kubepods besteffort pod6792b2c6-f5cf-454a-858a-cbd4159db76a] : Timed out while waiting for systemd to remove kubepods-besteffort-pod6792b2c6_f5cf_454a_858a_cbd4159db76a.slice" Mar 16 16:53:49 crc kubenswrapper[5120]: E0316 16:53:49.702660 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to delete cgroup paths for [kubepods besteffort pod6792b2c6-f5cf-454a-858a-cbd4159db76a] : unable to destroy cgroup paths for cgroup [kubepods besteffort pod6792b2c6-f5cf-454a-858a-cbd4159db76a] : Timed out while waiting for systemd to remove kubepods-besteffort-pod6792b2c6_f5cf_454a_858a_cbd4159db76a.slice" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podUID="6792b2c6-f5cf-454a-858a-cbd4159db76a" Mar 16 16:53:50 crc kubenswrapper[5120]: I0316 16:53:50.351116 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"e3bbdf40-3feb-46ae-a12d-152e88c1bccd","Type":"ContainerStarted","Data":"194dbfa47535d6e3afe8d5d2c51baf44b678417300e19ec2917840ee051fcc2c"} Mar 16 16:53:50 crc kubenswrapper[5120]: I0316 16:53:50.354528 5120 generic.go:358] "Generic (PLEG): container finished" podID="b91a9930-eec4-4af5-9aee-5d02dc78fabc" containerID="9447a2fb9a0e4308274aa0d296a7cfd1a4423ed65d9e7c646f286f31ab7bd69e" exitCode=0 Mar 16 16:53:50 crc kubenswrapper[5120]: I0316 16:53:50.354555 5120 generic.go:358] "Generic (PLEG): container finished" podID="b91a9930-eec4-4af5-9aee-5d02dc78fabc" containerID="424e31545d803d2327b8e14c4a5a0a88e6c5500c83a65260f104ea072002902b" exitCode=0 Mar 16 16:53:50 crc kubenswrapper[5120]: I0316 16:53:50.354827 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:53:50 crc kubenswrapper[5120]: I0316 16:53:50.355669 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"b91a9930-eec4-4af5-9aee-5d02dc78fabc","Type":"ContainerDied","Data":"9447a2fb9a0e4308274aa0d296a7cfd1a4423ed65d9e7c646f286f31ab7bd69e"} Mar 16 16:53:50 crc kubenswrapper[5120]: I0316 16:53:50.355700 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"b91a9930-eec4-4af5-9aee-5d02dc78fabc","Type":"ContainerDied","Data":"424e31545d803d2327b8e14c4a5a0a88e6c5500c83a65260f104ea072002902b"} Mar 16 16:53:50 crc kubenswrapper[5120]: I0316 16:53:50.412901 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 16:53:50 crc kubenswrapper[5120]: I0316 16:53:50.428496 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 16:53:50 crc kubenswrapper[5120]: I0316 16:53:50.443603 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 16:53:50 crc kubenswrapper[5120]: I0316 16:53:50.456338 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 16:53:50 crc kubenswrapper[5120]: I0316 16:53:50.456404 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:53:50 crc kubenswrapper[5120]: I0316 16:53:50.459263 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovndbcluster-sb-config\"" Mar 16 16:53:50 crc kubenswrapper[5120]: I0316 16:53:50.459853 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ovndbcluster-sb-ovndbs\"" Mar 16 16:53:50 crc kubenswrapper[5120]: I0316 16:53:50.460024 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ovncluster-ovndbcluster-sb-dockercfg-w4q4s\"" Mar 16 16:53:50 crc kubenswrapper[5120]: I0316 16:53:50.460208 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovndbcluster-sb-scripts\"" Mar 16 16:53:50 crc kubenswrapper[5120]: I0316 16:53:50.540517 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/d1960e17-5bd0-46f5-9155-8dd50410168f-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"d1960e17-5bd0-46f5-9155-8dd50410168f\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:53:50 crc kubenswrapper[5120]: I0316 16:53:50.540583 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d1960e17-5bd0-46f5-9155-8dd50410168f-config\") pod \"ovsdbserver-sb-0\" (UID: \"d1960e17-5bd0-46f5-9155-8dd50410168f\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:53:50 crc kubenswrapper[5120]: I0316 16:53:50.540669 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/d1960e17-5bd0-46f5-9155-8dd50410168f-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"d1960e17-5bd0-46f5-9155-8dd50410168f\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:53:50 crc kubenswrapper[5120]: I0316 16:53:50.541714 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/d1960e17-5bd0-46f5-9155-8dd50410168f-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"d1960e17-5bd0-46f5-9155-8dd50410168f\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:53:50 crc kubenswrapper[5120]: I0316 16:53:50.541773 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d1960e17-5bd0-46f5-9155-8dd50410168f-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"d1960e17-5bd0-46f5-9155-8dd50410168f\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:53:50 crc kubenswrapper[5120]: I0316 16:53:50.541864 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"ovsdbserver-sb-0\" (UID: \"d1960e17-5bd0-46f5-9155-8dd50410168f\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:53:50 crc kubenswrapper[5120]: I0316 16:53:50.542247 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/d1960e17-5bd0-46f5-9155-8dd50410168f-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"d1960e17-5bd0-46f5-9155-8dd50410168f\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:53:50 crc kubenswrapper[5120]: I0316 16:53:50.542351 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvkkq\" (UniqueName: \"kubernetes.io/projected/d1960e17-5bd0-46f5-9155-8dd50410168f-kube-api-access-nvkkq\") pod \"ovsdbserver-sb-0\" (UID: \"d1960e17-5bd0-46f5-9155-8dd50410168f\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:53:50 crc kubenswrapper[5120]: I0316 16:53:50.589965 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:53:50 crc kubenswrapper[5120]: I0316 16:53:50.643462 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/b91a9930-eec4-4af5-9aee-5d02dc78fabc-etc-machine-id\") pod \"b91a9930-eec4-4af5-9aee-5d02dc78fabc\" (UID: \"b91a9930-eec4-4af5-9aee-5d02dc78fabc\") " Mar 16 16:53:50 crc kubenswrapper[5120]: I0316 16:53:50.643577 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/b91a9930-eec4-4af5-9aee-5d02dc78fabc-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "b91a9930-eec4-4af5-9aee-5d02dc78fabc" (UID: "b91a9930-eec4-4af5-9aee-5d02dc78fabc"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 16:53:50 crc kubenswrapper[5120]: I0316 16:53:50.643725 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b91a9930-eec4-4af5-9aee-5d02dc78fabc-config-data\") pod \"b91a9930-eec4-4af5-9aee-5d02dc78fabc\" (UID: \"b91a9930-eec4-4af5-9aee-5d02dc78fabc\") " Mar 16 16:53:50 crc kubenswrapper[5120]: I0316 16:53:50.643777 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b91a9930-eec4-4af5-9aee-5d02dc78fabc-combined-ca-bundle\") pod \"b91a9930-eec4-4af5-9aee-5d02dc78fabc\" (UID: \"b91a9930-eec4-4af5-9aee-5d02dc78fabc\") " Mar 16 16:53:50 crc kubenswrapper[5120]: I0316 16:53:50.643946 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/b91a9930-eec4-4af5-9aee-5d02dc78fabc-config-data-custom\") pod \"b91a9930-eec4-4af5-9aee-5d02dc78fabc\" (UID: \"b91a9930-eec4-4af5-9aee-5d02dc78fabc\") " Mar 16 16:53:50 crc kubenswrapper[5120]: I0316 16:53:50.644300 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b91a9930-eec4-4af5-9aee-5d02dc78fabc-scripts\") pod \"b91a9930-eec4-4af5-9aee-5d02dc78fabc\" (UID: \"b91a9930-eec4-4af5-9aee-5d02dc78fabc\") " Mar 16 16:53:50 crc kubenswrapper[5120]: I0316 16:53:50.644470 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zvlwp\" (UniqueName: \"kubernetes.io/projected/b91a9930-eec4-4af5-9aee-5d02dc78fabc-kube-api-access-zvlwp\") pod \"b91a9930-eec4-4af5-9aee-5d02dc78fabc\" (UID: \"b91a9930-eec4-4af5-9aee-5d02dc78fabc\") " Mar 16 16:53:50 crc kubenswrapper[5120]: I0316 16:53:50.644879 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d1960e17-5bd0-46f5-9155-8dd50410168f-config\") pod \"ovsdbserver-sb-0\" (UID: \"d1960e17-5bd0-46f5-9155-8dd50410168f\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:53:50 crc kubenswrapper[5120]: I0316 16:53:50.645090 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/d1960e17-5bd0-46f5-9155-8dd50410168f-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"d1960e17-5bd0-46f5-9155-8dd50410168f\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:53:50 crc kubenswrapper[5120]: I0316 16:53:50.645179 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/d1960e17-5bd0-46f5-9155-8dd50410168f-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"d1960e17-5bd0-46f5-9155-8dd50410168f\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:53:50 crc kubenswrapper[5120]: I0316 16:53:50.645221 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d1960e17-5bd0-46f5-9155-8dd50410168f-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"d1960e17-5bd0-46f5-9155-8dd50410168f\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:53:50 crc kubenswrapper[5120]: I0316 16:53:50.645331 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"ovsdbserver-sb-0\" (UID: \"d1960e17-5bd0-46f5-9155-8dd50410168f\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:53:50 crc kubenswrapper[5120]: I0316 16:53:50.645479 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/d1960e17-5bd0-46f5-9155-8dd50410168f-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"d1960e17-5bd0-46f5-9155-8dd50410168f\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:53:50 crc kubenswrapper[5120]: I0316 16:53:50.645579 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nvkkq\" (UniqueName: \"kubernetes.io/projected/d1960e17-5bd0-46f5-9155-8dd50410168f-kube-api-access-nvkkq\") pod \"ovsdbserver-sb-0\" (UID: \"d1960e17-5bd0-46f5-9155-8dd50410168f\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:53:50 crc kubenswrapper[5120]: I0316 16:53:50.645929 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/d1960e17-5bd0-46f5-9155-8dd50410168f-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"d1960e17-5bd0-46f5-9155-8dd50410168f\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:53:50 crc kubenswrapper[5120]: I0316 16:53:50.646019 5120 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/b91a9930-eec4-4af5-9aee-5d02dc78fabc-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:50 crc kubenswrapper[5120]: I0316 16:53:50.647563 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d1960e17-5bd0-46f5-9155-8dd50410168f-config\") pod \"ovsdbserver-sb-0\" (UID: \"d1960e17-5bd0-46f5-9155-8dd50410168f\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:53:50 crc kubenswrapper[5120]: I0316 16:53:50.648048 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/d1960e17-5bd0-46f5-9155-8dd50410168f-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"d1960e17-5bd0-46f5-9155-8dd50410168f\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:53:50 crc kubenswrapper[5120]: I0316 16:53:50.648277 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"ovsdbserver-sb-0\" (UID: \"d1960e17-5bd0-46f5-9155-8dd50410168f\") device mount path \"/mnt/openstack/pv06\"" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:53:50 crc kubenswrapper[5120]: I0316 16:53:50.649512 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/d1960e17-5bd0-46f5-9155-8dd50410168f-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"d1960e17-5bd0-46f5-9155-8dd50410168f\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:53:50 crc kubenswrapper[5120]: I0316 16:53:50.654402 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b91a9930-eec4-4af5-9aee-5d02dc78fabc-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "b91a9930-eec4-4af5-9aee-5d02dc78fabc" (UID: "b91a9930-eec4-4af5-9aee-5d02dc78fabc"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:50 crc kubenswrapper[5120]: I0316 16:53:50.655917 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b91a9930-eec4-4af5-9aee-5d02dc78fabc-scripts" (OuterVolumeSpecName: "scripts") pod "b91a9930-eec4-4af5-9aee-5d02dc78fabc" (UID: "b91a9930-eec4-4af5-9aee-5d02dc78fabc"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:50 crc kubenswrapper[5120]: I0316 16:53:50.658299 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/d1960e17-5bd0-46f5-9155-8dd50410168f-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"d1960e17-5bd0-46f5-9155-8dd50410168f\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:53:50 crc kubenswrapper[5120]: I0316 16:53:50.660873 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b91a9930-eec4-4af5-9aee-5d02dc78fabc-kube-api-access-zvlwp" (OuterVolumeSpecName: "kube-api-access-zvlwp") pod "b91a9930-eec4-4af5-9aee-5d02dc78fabc" (UID: "b91a9930-eec4-4af5-9aee-5d02dc78fabc"). InnerVolumeSpecName "kube-api-access-zvlwp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:53:50 crc kubenswrapper[5120]: I0316 16:53:50.664019 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d1960e17-5bd0-46f5-9155-8dd50410168f-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"d1960e17-5bd0-46f5-9155-8dd50410168f\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:53:50 crc kubenswrapper[5120]: I0316 16:53:50.665373 5120 scope.go:117] "RemoveContainer" containerID="a6779b90220d6a446bba6efdb7cf0c284ae282978d42ec7fdb0283bc2a59e6a9" Mar 16 16:53:50 crc kubenswrapper[5120]: I0316 16:53:50.668024 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/d1960e17-5bd0-46f5-9155-8dd50410168f-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"d1960e17-5bd0-46f5-9155-8dd50410168f\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:53:50 crc kubenswrapper[5120]: I0316 16:53:50.668964 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvkkq\" (UniqueName: \"kubernetes.io/projected/d1960e17-5bd0-46f5-9155-8dd50410168f-kube-api-access-nvkkq\") pod \"ovsdbserver-sb-0\" (UID: \"d1960e17-5bd0-46f5-9155-8dd50410168f\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:53:50 crc kubenswrapper[5120]: I0316 16:53:50.677250 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6792b2c6-f5cf-454a-858a-cbd4159db76a" path="/var/lib/kubelet/pods/6792b2c6-f5cf-454a-858a-cbd4159db76a/volumes" Mar 16 16:53:50 crc kubenswrapper[5120]: I0316 16:53:50.733324 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"ovsdbserver-sb-0\" (UID: \"d1960e17-5bd0-46f5-9155-8dd50410168f\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:53:50 crc kubenswrapper[5120]: I0316 16:53:50.750191 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/b91a9930-eec4-4af5-9aee-5d02dc78fabc-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:50 crc kubenswrapper[5120]: I0316 16:53:50.750223 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b91a9930-eec4-4af5-9aee-5d02dc78fabc-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:50 crc kubenswrapper[5120]: I0316 16:53:50.750235 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zvlwp\" (UniqueName: \"kubernetes.io/projected/b91a9930-eec4-4af5-9aee-5d02dc78fabc-kube-api-access-zvlwp\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:50 crc kubenswrapper[5120]: I0316 16:53:50.778359 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b91a9930-eec4-4af5-9aee-5d02dc78fabc-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "b91a9930-eec4-4af5-9aee-5d02dc78fabc" (UID: "b91a9930-eec4-4af5-9aee-5d02dc78fabc"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:50 crc kubenswrapper[5120]: I0316 16:53:50.794406 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:53:50 crc kubenswrapper[5120]: I0316 16:53:50.846754 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b91a9930-eec4-4af5-9aee-5d02dc78fabc-config-data" (OuterVolumeSpecName: "config-data") pod "b91a9930-eec4-4af5-9aee-5d02dc78fabc" (UID: "b91a9930-eec4-4af5-9aee-5d02dc78fabc"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:50 crc kubenswrapper[5120]: I0316 16:53:50.853319 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b91a9930-eec4-4af5-9aee-5d02dc78fabc-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:50 crc kubenswrapper[5120]: I0316 16:53:50.853370 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b91a9930-eec4-4af5-9aee-5d02dc78fabc-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:51 crc kubenswrapper[5120]: I0316 16:53:51.265370 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 16:53:51 crc kubenswrapper[5120]: I0316 16:53:51.380992 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"e3bbdf40-3feb-46ae-a12d-152e88c1bccd","Type":"ContainerStarted","Data":"5523e5bfe537c21f58dd2396b51a688a7a7e02b72fba915bed95b8b93206e355"} Mar 16 16:53:51 crc kubenswrapper[5120]: I0316 16:53:51.381042 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"e3bbdf40-3feb-46ae-a12d-152e88c1bccd","Type":"ContainerStarted","Data":"6c1bd7806ab012b5b16af79d65b808832086d33a8024353ef14b25032736b665"} Mar 16 16:53:51 crc kubenswrapper[5120]: I0316 16:53:51.384594 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"d1960e17-5bd0-46f5-9155-8dd50410168f","Type":"ContainerStarted","Data":"9851d014f9993065c00cb86a3a73571ca82ca0e8ec36d871942841b4fc7f5424"} Mar 16 16:53:51 crc kubenswrapper[5120]: I0316 16:53:51.387729 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"67ab3338-c88c-4faf-8d25-809c92d661d9","Type":"ContainerStarted","Data":"a1c6c6eaee5b058049bbad3a58ced751fece0e218cfd6faf64607f644b0f5ef7"} Mar 16 16:53:51 crc kubenswrapper[5120]: I0316 16:53:51.387971 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:53:51 crc kubenswrapper[5120]: I0316 16:53:51.399521 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:53:51 crc kubenswrapper[5120]: I0316 16:53:51.399520 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"b91a9930-eec4-4af5-9aee-5d02dc78fabc","Type":"ContainerDied","Data":"06e2f505d2bd579b6df96b380bf3776387c478cd0e0a7fa427acf376d4656e87"} Mar 16 16:53:51 crc kubenswrapper[5120]: I0316 16:53:51.399672 5120 scope.go:117] "RemoveContainer" containerID="9447a2fb9a0e4308274aa0d296a7cfd1a4423ed65d9e7c646f286f31ab7bd69e" Mar 16 16:53:51 crc kubenswrapper[5120]: I0316 16:53:51.447486 5120 scope.go:117] "RemoveContainer" containerID="424e31545d803d2327b8e14c4a5a0a88e6c5500c83a65260f104ea072002902b" Mar 16 16:53:51 crc kubenswrapper[5120]: I0316 16:53:51.450152 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:53:51 crc kubenswrapper[5120]: I0316 16:53:51.474735 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:53:51 crc kubenswrapper[5120]: I0316 16:53:51.488460 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:53:51 crc kubenswrapper[5120]: I0316 16:53:51.490504 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b91a9930-eec4-4af5-9aee-5d02dc78fabc" containerName="cinder-scheduler" Mar 16 16:53:51 crc kubenswrapper[5120]: I0316 16:53:51.490526 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="b91a9930-eec4-4af5-9aee-5d02dc78fabc" containerName="cinder-scheduler" Mar 16 16:53:51 crc kubenswrapper[5120]: I0316 16:53:51.490576 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b91a9930-eec4-4af5-9aee-5d02dc78fabc" containerName="probe" Mar 16 16:53:51 crc kubenswrapper[5120]: I0316 16:53:51.490582 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="b91a9930-eec4-4af5-9aee-5d02dc78fabc" containerName="probe" Mar 16 16:53:51 crc kubenswrapper[5120]: I0316 16:53:51.490777 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="b91a9930-eec4-4af5-9aee-5d02dc78fabc" containerName="cinder-scheduler" Mar 16 16:53:51 crc kubenswrapper[5120]: I0316 16:53:51.490808 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="b91a9930-eec4-4af5-9aee-5d02dc78fabc" containerName="probe" Mar 16 16:53:51 crc kubenswrapper[5120]: I0316 16:53:51.503158 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:53:51 crc kubenswrapper[5120]: I0316 16:53:51.506726 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-scheduler-config-data\"" Mar 16 16:53:51 crc kubenswrapper[5120]: I0316 16:53:51.523233 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:53:51 crc kubenswrapper[5120]: I0316 16:53:51.584502 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/48f680c8-5737-416a-ab55-2c7fcf32c0e2-config-data\") pod \"cinder-scheduler-0\" (UID: \"48f680c8-5737-416a-ab55-2c7fcf32c0e2\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:53:51 crc kubenswrapper[5120]: I0316 16:53:51.584690 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/48f680c8-5737-416a-ab55-2c7fcf32c0e2-scripts\") pod \"cinder-scheduler-0\" (UID: \"48f680c8-5737-416a-ab55-2c7fcf32c0e2\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:53:51 crc kubenswrapper[5120]: I0316 16:53:51.584736 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/48f680c8-5737-416a-ab55-2c7fcf32c0e2-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"48f680c8-5737-416a-ab55-2c7fcf32c0e2\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:53:51 crc kubenswrapper[5120]: I0316 16:53:51.584930 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/48f680c8-5737-416a-ab55-2c7fcf32c0e2-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"48f680c8-5737-416a-ab55-2c7fcf32c0e2\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:53:51 crc kubenswrapper[5120]: I0316 16:53:51.585047 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qg52l\" (UniqueName: \"kubernetes.io/projected/48f680c8-5737-416a-ab55-2c7fcf32c0e2-kube-api-access-qg52l\") pod \"cinder-scheduler-0\" (UID: \"48f680c8-5737-416a-ab55-2c7fcf32c0e2\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:53:51 crc kubenswrapper[5120]: I0316 16:53:51.585288 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/48f680c8-5737-416a-ab55-2c7fcf32c0e2-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"48f680c8-5737-416a-ab55-2c7fcf32c0e2\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:53:51 crc kubenswrapper[5120]: I0316 16:53:51.666232 5120 scope.go:117] "RemoveContainer" containerID="2d4d1dcb9934113a035d23ba21d07fb8336b9f2b0597239715eda669c9cb46b1" Mar 16 16:53:51 crc kubenswrapper[5120]: I0316 16:53:51.689487 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/48f680c8-5737-416a-ab55-2c7fcf32c0e2-scripts\") pod \"cinder-scheduler-0\" (UID: \"48f680c8-5737-416a-ab55-2c7fcf32c0e2\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:53:51 crc kubenswrapper[5120]: I0316 16:53:51.689785 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/48f680c8-5737-416a-ab55-2c7fcf32c0e2-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"48f680c8-5737-416a-ab55-2c7fcf32c0e2\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:53:51 crc kubenswrapper[5120]: I0316 16:53:51.689913 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/48f680c8-5737-416a-ab55-2c7fcf32c0e2-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"48f680c8-5737-416a-ab55-2c7fcf32c0e2\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:53:51 crc kubenswrapper[5120]: I0316 16:53:51.689926 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/48f680c8-5737-416a-ab55-2c7fcf32c0e2-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"48f680c8-5737-416a-ab55-2c7fcf32c0e2\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:53:51 crc kubenswrapper[5120]: I0316 16:53:51.690255 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qg52l\" (UniqueName: \"kubernetes.io/projected/48f680c8-5737-416a-ab55-2c7fcf32c0e2-kube-api-access-qg52l\") pod \"cinder-scheduler-0\" (UID: \"48f680c8-5737-416a-ab55-2c7fcf32c0e2\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:53:51 crc kubenswrapper[5120]: I0316 16:53:51.690611 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/48f680c8-5737-416a-ab55-2c7fcf32c0e2-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"48f680c8-5737-416a-ab55-2c7fcf32c0e2\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:53:51 crc kubenswrapper[5120]: I0316 16:53:51.691210 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/48f680c8-5737-416a-ab55-2c7fcf32c0e2-config-data\") pod \"cinder-scheduler-0\" (UID: \"48f680c8-5737-416a-ab55-2c7fcf32c0e2\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:53:51 crc kubenswrapper[5120]: I0316 16:53:51.695061 5120 pod_container_manager_linux.go:217] "Failed to delete cgroup paths" cgroupName=["kubepods","besteffort","pod19792b24-d033-444c-85e4-6c61e15b3ef9"] err="unable to destroy cgroup paths for cgroup [kubepods besteffort pod19792b24-d033-444c-85e4-6c61e15b3ef9] : Timed out while waiting for systemd to remove kubepods-besteffort-pod19792b24_d033_444c_85e4_6c61e15b3ef9.slice" Mar 16 16:53:51 crc kubenswrapper[5120]: E0316 16:53:51.695132 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to delete cgroup paths for [kubepods besteffort pod19792b24-d033-444c-85e4-6c61e15b3ef9] : unable to destroy cgroup paths for cgroup [kubepods besteffort pod19792b24-d033-444c-85e4-6c61e15b3ef9] : Timed out while waiting for systemd to remove kubepods-besteffort-pod19792b24_d033_444c_85e4_6c61e15b3ef9.slice" pod="openstack-kuttl-tests/swift-storage-0" podUID="19792b24-d033-444c-85e4-6c61e15b3ef9" Mar 16 16:53:51 crc kubenswrapper[5120]: I0316 16:53:51.700490 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/48f680c8-5737-416a-ab55-2c7fcf32c0e2-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"48f680c8-5737-416a-ab55-2c7fcf32c0e2\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:53:51 crc kubenswrapper[5120]: I0316 16:53:51.701067 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/48f680c8-5737-416a-ab55-2c7fcf32c0e2-config-data\") pod \"cinder-scheduler-0\" (UID: \"48f680c8-5737-416a-ab55-2c7fcf32c0e2\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:53:51 crc kubenswrapper[5120]: I0316 16:53:51.701212 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/48f680c8-5737-416a-ab55-2c7fcf32c0e2-scripts\") pod \"cinder-scheduler-0\" (UID: \"48f680c8-5737-416a-ab55-2c7fcf32c0e2\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:53:51 crc kubenswrapper[5120]: I0316 16:53:51.713546 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/48f680c8-5737-416a-ab55-2c7fcf32c0e2-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"48f680c8-5737-416a-ab55-2c7fcf32c0e2\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:53:51 crc kubenswrapper[5120]: I0316 16:53:51.723635 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qg52l\" (UniqueName: \"kubernetes.io/projected/48f680c8-5737-416a-ab55-2c7fcf32c0e2-kube-api-access-qg52l\") pod \"cinder-scheduler-0\" (UID: \"48f680c8-5737-416a-ab55-2c7fcf32c0e2\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:53:51 crc kubenswrapper[5120]: I0316 16:53:51.827459 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:53:52 crc kubenswrapper[5120]: I0316 16:53:52.008171 5120 patch_prober.go:28] interesting pod/machine-config-daemon-7bf76 container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 16:53:52 crc kubenswrapper[5120]: I0316 16:53:52.008512 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 16:53:52 crc kubenswrapper[5120]: I0316 16:53:52.152043 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:53:52 crc kubenswrapper[5120]: I0316 16:53:52.153316 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:53:52 crc kubenswrapper[5120]: I0316 16:53:52.397144 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:53:52 crc kubenswrapper[5120]: I0316 16:53:52.446127 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"e3bbdf40-3feb-46ae-a12d-152e88c1bccd","Type":"ContainerStarted","Data":"caeb7b897b55fc95665a1bf7861c08e4cce273d594fed47d77ee3311a0d06d37"} Mar 16 16:53:52 crc kubenswrapper[5120]: I0316 16:53:52.449983 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"802ef826-c6e7-4a1c-90a6-b419b9489007","Type":"ContainerStarted","Data":"ee30dfd8af3af59f37f37ec99d41afa1ec85248596d20c9e31406083d8a749b1"} Mar 16 16:53:52 crc kubenswrapper[5120]: I0316 16:53:52.450869 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:53:52 crc kubenswrapper[5120]: I0316 16:53:52.454027 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"d1960e17-5bd0-46f5-9155-8dd50410168f","Type":"ContainerStarted","Data":"3f67575c174de4ec88325dae52c495fc5f7e8288f1f83576c731cc6677398a1b"} Mar 16 16:53:52 crc kubenswrapper[5120]: I0316 16:53:52.454065 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"d1960e17-5bd0-46f5-9155-8dd50410168f","Type":"ContainerStarted","Data":"2c1d127125047f30b595c38ecdb848f5a2764132632a382908881dde9b715eb6"} Mar 16 16:53:52 crc kubenswrapper[5120]: I0316 16:53:52.458699 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:53:52 crc kubenswrapper[5120]: I0316 16:53:52.591742 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 16:53:52 crc kubenswrapper[5120]: I0316 16:53:52.612047 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 16:53:52 crc kubenswrapper[5120]: I0316 16:53:52.617358 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podStartSLOduration=2.617340907 podStartE2EDuration="2.617340907s" podCreationTimestamp="2026-03-16 16:53:50 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:53:52.505330352 +0000 UTC m=+4934.659262019" watchObservedRunningTime="2026-03-16 16:53:52.617340907 +0000 UTC m=+4934.771272564" Mar 16 16:53:52 crc kubenswrapper[5120]: I0316 16:53:52.638386 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 16:53:52 crc kubenswrapper[5120]: I0316 16:53:52.656224 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 16:53:52 crc kubenswrapper[5120]: I0316 16:53:52.656443 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:53:52 crc kubenswrapper[5120]: I0316 16:53:52.658934 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"swift-storage-config-data\"" Mar 16 16:53:52 crc kubenswrapper[5120]: I0316 16:53:52.679102 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="19792b24-d033-444c-85e4-6c61e15b3ef9" path="/var/lib/kubelet/pods/19792b24-d033-444c-85e4-6c61e15b3ef9/volumes" Mar 16 16:53:52 crc kubenswrapper[5120]: I0316 16:53:52.681472 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b91a9930-eec4-4af5-9aee-5d02dc78fabc" path="/var/lib/kubelet/pods/b91a9930-eec4-4af5-9aee-5d02dc78fabc/volumes" Mar 16 16:53:52 crc kubenswrapper[5120]: I0316 16:53:52.767333 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"swift-storage-0\" (UID: \"bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:53:52 crc kubenswrapper[5120]: I0316 16:53:52.767499 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a-lock\") pod \"swift-storage-0\" (UID: \"bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:53:52 crc kubenswrapper[5120]: I0316 16:53:52.767592 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a-combined-ca-bundle\") pod \"swift-storage-0\" (UID: \"bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:53:52 crc kubenswrapper[5120]: I0316 16:53:52.767663 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a-cache\") pod \"swift-storage-0\" (UID: \"bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:53:52 crc kubenswrapper[5120]: I0316 16:53:52.768356 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmw6p\" (UniqueName: \"kubernetes.io/projected/bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a-kube-api-access-xmw6p\") pod \"swift-storage-0\" (UID: \"bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:53:52 crc kubenswrapper[5120]: I0316 16:53:52.768549 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a-etc-swift\") pod \"swift-storage-0\" (UID: \"bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:53:52 crc kubenswrapper[5120]: I0316 16:53:52.871207 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"swift-storage-0\" (UID: \"bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:53:52 crc kubenswrapper[5120]: I0316 16:53:52.871586 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a-lock\") pod \"swift-storage-0\" (UID: \"bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:53:52 crc kubenswrapper[5120]: I0316 16:53:52.871632 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a-combined-ca-bundle\") pod \"swift-storage-0\" (UID: \"bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:53:52 crc kubenswrapper[5120]: I0316 16:53:52.871662 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a-cache\") pod \"swift-storage-0\" (UID: \"bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:53:52 crc kubenswrapper[5120]: I0316 16:53:52.871878 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xmw6p\" (UniqueName: \"kubernetes.io/projected/bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a-kube-api-access-xmw6p\") pod \"swift-storage-0\" (UID: \"bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:53:52 crc kubenswrapper[5120]: I0316 16:53:52.871981 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a-etc-swift\") pod \"swift-storage-0\" (UID: \"bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:53:52 crc kubenswrapper[5120]: I0316 16:53:52.874157 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"swift-storage-0\" (UID: \"bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a\") device mount path \"/mnt/openstack/pv05\"" pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:53:52 crc kubenswrapper[5120]: I0316 16:53:52.885964 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a-lock\") pod \"swift-storage-0\" (UID: \"bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:53:52 crc kubenswrapper[5120]: I0316 16:53:52.887940 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a-cache\") pod \"swift-storage-0\" (UID: \"bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:53:52 crc kubenswrapper[5120]: I0316 16:53:52.890018 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a-etc-swift\") pod \"swift-storage-0\" (UID: \"bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:53:52 crc kubenswrapper[5120]: I0316 16:53:52.891700 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a-combined-ca-bundle\") pod \"swift-storage-0\" (UID: \"bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:53:52 crc kubenswrapper[5120]: I0316 16:53:52.906317 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmw6p\" (UniqueName: \"kubernetes.io/projected/bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a-kube-api-access-xmw6p\") pod \"swift-storage-0\" (UID: \"bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:53:52 crc kubenswrapper[5120]: I0316 16:53:52.969026 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"swift-storage-0\" (UID: \"bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:53:52 crc kubenswrapper[5120]: I0316 16:53:52.987060 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:53:53 crc kubenswrapper[5120]: I0316 16:53:53.519487 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-7b9f48f6c8-rfj5g_eb34a81f-663e-4027-bf2c-1d334bd06ba4/neutron-api/0.log" Mar 16 16:53:53 crc kubenswrapper[5120]: I0316 16:53:53.519973 5120 generic.go:358] "Generic (PLEG): container finished" podID="eb34a81f-663e-4027-bf2c-1d334bd06ba4" containerID="279aa838c1a848399cfdb1bb646b1ad052feb810283f58b9f2f00f5edd91dfee" exitCode=1 Mar 16 16:53:53 crc kubenswrapper[5120]: I0316 16:53:53.520101 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-7b9f48f6c8-rfj5g" event={"ID":"eb34a81f-663e-4027-bf2c-1d334bd06ba4","Type":"ContainerDied","Data":"279aa838c1a848399cfdb1bb646b1ad052feb810283f58b9f2f00f5edd91dfee"} Mar 16 16:53:53 crc kubenswrapper[5120]: I0316 16:53:53.520733 5120 scope.go:117] "RemoveContainer" containerID="279aa838c1a848399cfdb1bb646b1ad052feb810283f58b9f2f00f5edd91dfee" Mar 16 16:53:53 crc kubenswrapper[5120]: I0316 16:53:53.532988 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/neutron-7b9f48f6c8-rfj5g" podUID="eb34a81f-663e-4027-bf2c-1d334bd06ba4" containerName="neutron-httpd" probeResult="failure" output="HTTP probe failed with statuscode: 503" Mar 16 16:53:53 crc kubenswrapper[5120]: I0316 16:53:53.533121 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"48f680c8-5737-416a-ab55-2c7fcf32c0e2","Type":"ContainerStarted","Data":"1be054665a55eb640a7520c6ccc788bd4c6aba09dae7de9eeee45a6e2ef73e77"} Mar 16 16:53:53 crc kubenswrapper[5120]: I0316 16:53:53.533173 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"48f680c8-5737-416a-ab55-2c7fcf32c0e2","Type":"ContainerStarted","Data":"05cb46374642c72d50f296354dde53c6f00471d337ccdfebea73f5af1faae722"} Mar 16 16:53:53 crc kubenswrapper[5120]: I0316 16:53:53.596827 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 16:53:53 crc kubenswrapper[5120]: I0316 16:53:53.796594 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:53:53 crc kubenswrapper[5120]: I0316 16:53:53.998791 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-6f698c8979-vxjjg" Mar 16 16:53:54 crc kubenswrapper[5120]: I0316 16:53:54.028785 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c1cda6a8-906f-4375-8909-a0548d69ecd6-config-data\") pod \"c1cda6a8-906f-4375-8909-a0548d69ecd6\" (UID: \"c1cda6a8-906f-4375-8909-a0548d69ecd6\") " Mar 16 16:53:54 crc kubenswrapper[5120]: I0316 16:53:54.028965 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/c1cda6a8-906f-4375-8909-a0548d69ecd6-config-data-custom\") pod \"c1cda6a8-906f-4375-8909-a0548d69ecd6\" (UID: \"c1cda6a8-906f-4375-8909-a0548d69ecd6\") " Mar 16 16:53:54 crc kubenswrapper[5120]: I0316 16:53:54.029134 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c1cda6a8-906f-4375-8909-a0548d69ecd6-combined-ca-bundle\") pod \"c1cda6a8-906f-4375-8909-a0548d69ecd6\" (UID: \"c1cda6a8-906f-4375-8909-a0548d69ecd6\") " Mar 16 16:53:54 crc kubenswrapper[5120]: I0316 16:53:54.029199 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c1cda6a8-906f-4375-8909-a0548d69ecd6-logs\") pod \"c1cda6a8-906f-4375-8909-a0548d69ecd6\" (UID: \"c1cda6a8-906f-4375-8909-a0548d69ecd6\") " Mar 16 16:53:54 crc kubenswrapper[5120]: I0316 16:53:54.029242 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qzkh2\" (UniqueName: \"kubernetes.io/projected/c1cda6a8-906f-4375-8909-a0548d69ecd6-kube-api-access-qzkh2\") pod \"c1cda6a8-906f-4375-8909-a0548d69ecd6\" (UID: \"c1cda6a8-906f-4375-8909-a0548d69ecd6\") " Mar 16 16:53:54 crc kubenswrapper[5120]: I0316 16:53:54.030316 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1cda6a8-906f-4375-8909-a0548d69ecd6-logs" (OuterVolumeSpecName: "logs") pod "c1cda6a8-906f-4375-8909-a0548d69ecd6" (UID: "c1cda6a8-906f-4375-8909-a0548d69ecd6"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:53:54 crc kubenswrapper[5120]: I0316 16:53:54.046974 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1cda6a8-906f-4375-8909-a0548d69ecd6-kube-api-access-qzkh2" (OuterVolumeSpecName: "kube-api-access-qzkh2") pod "c1cda6a8-906f-4375-8909-a0548d69ecd6" (UID: "c1cda6a8-906f-4375-8909-a0548d69ecd6"). InnerVolumeSpecName "kube-api-access-qzkh2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:53:54 crc kubenswrapper[5120]: I0316 16:53:54.047922 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c1cda6a8-906f-4375-8909-a0548d69ecd6-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "c1cda6a8-906f-4375-8909-a0548d69ecd6" (UID: "c1cda6a8-906f-4375-8909-a0548d69ecd6"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:54 crc kubenswrapper[5120]: I0316 16:53:54.122695 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c1cda6a8-906f-4375-8909-a0548d69ecd6-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "c1cda6a8-906f-4375-8909-a0548d69ecd6" (UID: "c1cda6a8-906f-4375-8909-a0548d69ecd6"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:54 crc kubenswrapper[5120]: I0316 16:53:54.132386 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c1cda6a8-906f-4375-8909-a0548d69ecd6-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:54 crc kubenswrapper[5120]: I0316 16:53:54.132428 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qzkh2\" (UniqueName: \"kubernetes.io/projected/c1cda6a8-906f-4375-8909-a0548d69ecd6-kube-api-access-qzkh2\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:54 crc kubenswrapper[5120]: I0316 16:53:54.132440 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/c1cda6a8-906f-4375-8909-a0548d69ecd6-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:54 crc kubenswrapper[5120]: I0316 16:53:54.132448 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c1cda6a8-906f-4375-8909-a0548d69ecd6-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:54 crc kubenswrapper[5120]: I0316 16:53:54.169274 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:53:54 crc kubenswrapper[5120]: I0316 16:53:54.169389 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:53:54 crc kubenswrapper[5120]: I0316 16:53:54.183275 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:53:54 crc kubenswrapper[5120]: I0316 16:53:54.186700 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:53:54 crc kubenswrapper[5120]: I0316 16:53:54.191831 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c1cda6a8-906f-4375-8909-a0548d69ecd6-config-data" (OuterVolumeSpecName: "config-data") pod "c1cda6a8-906f-4375-8909-a0548d69ecd6" (UID: "c1cda6a8-906f-4375-8909-a0548d69ecd6"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:54 crc kubenswrapper[5120]: I0316 16:53:54.235564 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c1cda6a8-906f-4375-8909-a0548d69ecd6-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:54 crc kubenswrapper[5120]: I0316 16:53:54.561704 5120 generic.go:358] "Generic (PLEG): container finished" podID="c1cda6a8-906f-4375-8909-a0548d69ecd6" containerID="b93e60d1b320f94842228ae4a6354fa698baf82d1f13db37760d540495830d96" exitCode=137 Mar 16 16:53:54 crc kubenswrapper[5120]: I0316 16:53:54.562037 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-6f698c8979-vxjjg" event={"ID":"c1cda6a8-906f-4375-8909-a0548d69ecd6","Type":"ContainerDied","Data":"b93e60d1b320f94842228ae4a6354fa698baf82d1f13db37760d540495830d96"} Mar 16 16:53:54 crc kubenswrapper[5120]: I0316 16:53:54.562074 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-6f698c8979-vxjjg" event={"ID":"c1cda6a8-906f-4375-8909-a0548d69ecd6","Type":"ContainerDied","Data":"4f879c3bd9816eb1ce4735187ae9751d3a5026166a511bc26fa6a7f0eb953556"} Mar 16 16:53:54 crc kubenswrapper[5120]: I0316 16:53:54.562101 5120 scope.go:117] "RemoveContainer" containerID="b93e60d1b320f94842228ae4a6354fa698baf82d1f13db37760d540495830d96" Mar 16 16:53:54 crc kubenswrapper[5120]: I0316 16:53:54.562300 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-6f698c8979-vxjjg" Mar 16 16:53:54 crc kubenswrapper[5120]: I0316 16:53:54.580831 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-7b9f48f6c8-rfj5g_eb34a81f-663e-4027-bf2c-1d334bd06ba4/neutron-api/0.log" Mar 16 16:53:54 crc kubenswrapper[5120]: I0316 16:53:54.581041 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-7b9f48f6c8-rfj5g" event={"ID":"eb34a81f-663e-4027-bf2c-1d334bd06ba4","Type":"ContainerStarted","Data":"3d1f3be4762f17a030965d2baf23eb4d3d42161f1123f9faaab941f03ade7875"} Mar 16 16:53:54 crc kubenswrapper[5120]: I0316 16:53:54.598748 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/neutron-7b9f48f6c8-rfj5g" podUID="eb34a81f-663e-4027-bf2c-1d334bd06ba4" containerName="neutron-httpd" probeResult="failure" output="HTTP probe failed with statuscode: 503" Mar 16 16:53:54 crc kubenswrapper[5120]: I0316 16:53:54.599429 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"48f680c8-5737-416a-ab55-2c7fcf32c0e2","Type":"ContainerStarted","Data":"91cdc41498d52eadc713d48b44ce9200489f918206eab5cb8a8f23186b9a72fa"} Mar 16 16:53:54 crc kubenswrapper[5120]: I0316 16:53:54.610712 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"e3bbdf40-3feb-46ae-a12d-152e88c1bccd","Type":"ContainerStarted","Data":"c93587a6adf780fb486fc549a2b959fb20fcb325d0bd45e869e6926928b7d69e"} Mar 16 16:53:54 crc kubenswrapper[5120]: I0316 16:53:54.611950 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:53:54 crc kubenswrapper[5120]: I0316 16:53:54.625273 5120 scope.go:117] "RemoveContainer" containerID="8c318abdc8e7a1387979d48e25fa7864bc1adc1e661aaa39226b89b45ce5032f" Mar 16 16:53:54 crc kubenswrapper[5120]: I0316 16:53:54.626113 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a","Type":"ContainerStarted","Data":"f2f18037c204777302f8e785f799d372046706b80e5745c02575b4fd86dd582e"} Mar 16 16:53:54 crc kubenswrapper[5120]: I0316 16:53:54.626165 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a","Type":"ContainerStarted","Data":"fd7d7a93b6338f5f1cb87f0080e397a13c05990ec35fc7410c95850dd2ceddc0"} Mar 16 16:53:54 crc kubenswrapper[5120]: I0316 16:53:54.626186 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a","Type":"ContainerStarted","Data":"590c41b84ccf90757c27a886f3e174ee311c12b245dd7ea9430d9f980f313934"} Mar 16 16:53:54 crc kubenswrapper[5120]: I0316 16:53:54.641179 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-scheduler-0" podStartSLOduration=3.641158661 podStartE2EDuration="3.641158661s" podCreationTimestamp="2026-03-16 16:53:51 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:53:54.628830924 +0000 UTC m=+4936.782762601" watchObservedRunningTime="2026-03-16 16:53:54.641158661 +0000 UTC m=+4936.795090318" Mar 16 16:53:54 crc kubenswrapper[5120]: I0316 16:53:54.663642 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-6f698c8979-vxjjg"] Mar 16 16:53:54 crc kubenswrapper[5120]: I0316 16:53:54.682536 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.137640907 podStartE2EDuration="6.682517913s" podCreationTimestamp="2026-03-16 16:53:48 +0000 UTC" firstStartedPulling="2026-03-16 16:53:49.59922523 +0000 UTC m=+4931.753156887" lastFinishedPulling="2026-03-16 16:53:54.144102246 +0000 UTC m=+4936.298033893" observedRunningTime="2026-03-16 16:53:54.668992403 +0000 UTC m=+4936.822924060" watchObservedRunningTime="2026-03-16 16:53:54.682517913 +0000 UTC m=+4936.836449570" Mar 16 16:53:54 crc kubenswrapper[5120]: I0316 16:53:54.687551 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/placement-88757f4fd-w4kvr" podUID="9fab4617-1011-48f5-90ae-5415fd9b91b4" containerName="placement-log" probeResult="failure" output="Get \"https://10.217.0.173:8778/\": EOF" Mar 16 16:53:54 crc kubenswrapper[5120]: I0316 16:53:54.688020 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/placement-88757f4fd-w4kvr" podUID="9fab4617-1011-48f5-90ae-5415fd9b91b4" containerName="placement-api" probeResult="failure" output="Get \"https://10.217.0.173:8778/\": EOF" Mar 16 16:53:54 crc kubenswrapper[5120]: I0316 16:53:54.693602 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-worker-6f698c8979-vxjjg"] Mar 16 16:53:54 crc kubenswrapper[5120]: I0316 16:53:54.730956 5120 scope.go:117] "RemoveContainer" containerID="b93e60d1b320f94842228ae4a6354fa698baf82d1f13db37760d540495830d96" Mar 16 16:53:54 crc kubenswrapper[5120]: E0316 16:53:54.731484 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b93e60d1b320f94842228ae4a6354fa698baf82d1f13db37760d540495830d96\": container with ID starting with b93e60d1b320f94842228ae4a6354fa698baf82d1f13db37760d540495830d96 not found: ID does not exist" containerID="b93e60d1b320f94842228ae4a6354fa698baf82d1f13db37760d540495830d96" Mar 16 16:53:54 crc kubenswrapper[5120]: I0316 16:53:54.731515 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b93e60d1b320f94842228ae4a6354fa698baf82d1f13db37760d540495830d96"} err="failed to get container status \"b93e60d1b320f94842228ae4a6354fa698baf82d1f13db37760d540495830d96\": rpc error: code = NotFound desc = could not find container \"b93e60d1b320f94842228ae4a6354fa698baf82d1f13db37760d540495830d96\": container with ID starting with b93e60d1b320f94842228ae4a6354fa698baf82d1f13db37760d540495830d96 not found: ID does not exist" Mar 16 16:53:54 crc kubenswrapper[5120]: I0316 16:53:54.731533 5120 scope.go:117] "RemoveContainer" containerID="8c318abdc8e7a1387979d48e25fa7864bc1adc1e661aaa39226b89b45ce5032f" Mar 16 16:53:54 crc kubenswrapper[5120]: E0316 16:53:54.731697 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c318abdc8e7a1387979d48e25fa7864bc1adc1e661aaa39226b89b45ce5032f\": container with ID starting with 8c318abdc8e7a1387979d48e25fa7864bc1adc1e661aaa39226b89b45ce5032f not found: ID does not exist" containerID="8c318abdc8e7a1387979d48e25fa7864bc1adc1e661aaa39226b89b45ce5032f" Mar 16 16:53:54 crc kubenswrapper[5120]: I0316 16:53:54.731718 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c318abdc8e7a1387979d48e25fa7864bc1adc1e661aaa39226b89b45ce5032f"} err="failed to get container status \"8c318abdc8e7a1387979d48e25fa7864bc1adc1e661aaa39226b89b45ce5032f\": rpc error: code = NotFound desc = could not find container \"8c318abdc8e7a1387979d48e25fa7864bc1adc1e661aaa39226b89b45ce5032f\": container with ID starting with 8c318abdc8e7a1387979d48e25fa7864bc1adc1e661aaa39226b89b45ce5032f not found: ID does not exist" Mar 16 16:53:54 crc kubenswrapper[5120]: I0316 16:53:54.923595 5120 pod_container_manager_linux.go:217] "Failed to delete cgroup paths" cgroupName=["kubepods","besteffort","podcb37f123-034b-4ccb-9f71-676a322e2a8b"] err="unable to destroy cgroup paths for cgroup [kubepods besteffort podcb37f123-034b-4ccb-9f71-676a322e2a8b] : Timed out while waiting for systemd to remove kubepods-besteffort-podcb37f123_034b_4ccb_9f71_676a322e2a8b.slice" Mar 16 16:53:54 crc kubenswrapper[5120]: E0316 16:53:54.923648 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to delete cgroup paths for [kubepods besteffort podcb37f123-034b-4ccb-9f71-676a322e2a8b] : unable to destroy cgroup paths for cgroup [kubepods besteffort podcb37f123-034b-4ccb-9f71-676a322e2a8b] : Timed out while waiting for systemd to remove kubepods-besteffort-podcb37f123_034b_4ccb_9f71_676a322e2a8b.slice" pod="openstack-kuttl-tests/barbican-api-5fd9d6b8f6-vq7wb" podUID="cb37f123-034b-4ccb-9f71-676a322e2a8b" Mar 16 16:53:55 crc kubenswrapper[5120]: I0316 16:53:55.287274 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-ccc65f956-nsglj" Mar 16 16:53:55 crc kubenswrapper[5120]: I0316 16:53:55.389381 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cb10ccc3-03fc-4eb7-a637-c2bc721a9b69-combined-ca-bundle\") pod \"cb10ccc3-03fc-4eb7-a637-c2bc721a9b69\" (UID: \"cb10ccc3-03fc-4eb7-a637-c2bc721a9b69\") " Mar 16 16:53:55 crc kubenswrapper[5120]: I0316 16:53:55.389611 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8jg2z\" (UniqueName: \"kubernetes.io/projected/cb10ccc3-03fc-4eb7-a637-c2bc721a9b69-kube-api-access-8jg2z\") pod \"cb10ccc3-03fc-4eb7-a637-c2bc721a9b69\" (UID: \"cb10ccc3-03fc-4eb7-a637-c2bc721a9b69\") " Mar 16 16:53:55 crc kubenswrapper[5120]: I0316 16:53:55.389708 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/cb10ccc3-03fc-4eb7-a637-c2bc721a9b69-logs\") pod \"cb10ccc3-03fc-4eb7-a637-c2bc721a9b69\" (UID: \"cb10ccc3-03fc-4eb7-a637-c2bc721a9b69\") " Mar 16 16:53:55 crc kubenswrapper[5120]: I0316 16:53:55.389749 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/cb10ccc3-03fc-4eb7-a637-c2bc721a9b69-config-data-custom\") pod \"cb10ccc3-03fc-4eb7-a637-c2bc721a9b69\" (UID: \"cb10ccc3-03fc-4eb7-a637-c2bc721a9b69\") " Mar 16 16:53:55 crc kubenswrapper[5120]: I0316 16:53:55.389921 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cb10ccc3-03fc-4eb7-a637-c2bc721a9b69-config-data\") pod \"cb10ccc3-03fc-4eb7-a637-c2bc721a9b69\" (UID: \"cb10ccc3-03fc-4eb7-a637-c2bc721a9b69\") " Mar 16 16:53:55 crc kubenswrapper[5120]: I0316 16:53:55.390451 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb10ccc3-03fc-4eb7-a637-c2bc721a9b69-logs" (OuterVolumeSpecName: "logs") pod "cb10ccc3-03fc-4eb7-a637-c2bc721a9b69" (UID: "cb10ccc3-03fc-4eb7-a637-c2bc721a9b69"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:53:55 crc kubenswrapper[5120]: I0316 16:53:55.391187 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/cb10ccc3-03fc-4eb7-a637-c2bc721a9b69-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:55 crc kubenswrapper[5120]: I0316 16:53:55.395060 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb10ccc3-03fc-4eb7-a637-c2bc721a9b69-kube-api-access-8jg2z" (OuterVolumeSpecName: "kube-api-access-8jg2z") pod "cb10ccc3-03fc-4eb7-a637-c2bc721a9b69" (UID: "cb10ccc3-03fc-4eb7-a637-c2bc721a9b69"). InnerVolumeSpecName "kube-api-access-8jg2z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:53:55 crc kubenswrapper[5120]: I0316 16:53:55.398976 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb10ccc3-03fc-4eb7-a637-c2bc721a9b69-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "cb10ccc3-03fc-4eb7-a637-c2bc721a9b69" (UID: "cb10ccc3-03fc-4eb7-a637-c2bc721a9b69"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:55 crc kubenswrapper[5120]: I0316 16:53:55.407586 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-88757f4fd-w4kvr" Mar 16 16:53:55 crc kubenswrapper[5120]: I0316 16:53:55.436922 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb10ccc3-03fc-4eb7-a637-c2bc721a9b69-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "cb10ccc3-03fc-4eb7-a637-c2bc721a9b69" (UID: "cb10ccc3-03fc-4eb7-a637-c2bc721a9b69"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:55 crc kubenswrapper[5120]: I0316 16:53:55.477977 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb10ccc3-03fc-4eb7-a637-c2bc721a9b69-config-data" (OuterVolumeSpecName: "config-data") pod "cb10ccc3-03fc-4eb7-a637-c2bc721a9b69" (UID: "cb10ccc3-03fc-4eb7-a637-c2bc721a9b69"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:55 crc kubenswrapper[5120]: I0316 16:53:55.492165 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9fab4617-1011-48f5-90ae-5415fd9b91b4-scripts\") pod \"9fab4617-1011-48f5-90ae-5415fd9b91b4\" (UID: \"9fab4617-1011-48f5-90ae-5415fd9b91b4\") " Mar 16 16:53:55 crc kubenswrapper[5120]: I0316 16:53:55.492487 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bxfk7\" (UniqueName: \"kubernetes.io/projected/9fab4617-1011-48f5-90ae-5415fd9b91b4-kube-api-access-bxfk7\") pod \"9fab4617-1011-48f5-90ae-5415fd9b91b4\" (UID: \"9fab4617-1011-48f5-90ae-5415fd9b91b4\") " Mar 16 16:53:55 crc kubenswrapper[5120]: I0316 16:53:55.493180 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9fab4617-1011-48f5-90ae-5415fd9b91b4-combined-ca-bundle\") pod \"9fab4617-1011-48f5-90ae-5415fd9b91b4\" (UID: \"9fab4617-1011-48f5-90ae-5415fd9b91b4\") " Mar 16 16:53:55 crc kubenswrapper[5120]: I0316 16:53:55.493388 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9fab4617-1011-48f5-90ae-5415fd9b91b4-config-data\") pod \"9fab4617-1011-48f5-90ae-5415fd9b91b4\" (UID: \"9fab4617-1011-48f5-90ae-5415fd9b91b4\") " Mar 16 16:53:55 crc kubenswrapper[5120]: I0316 16:53:55.493781 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9fab4617-1011-48f5-90ae-5415fd9b91b4-logs\") pod \"9fab4617-1011-48f5-90ae-5415fd9b91b4\" (UID: \"9fab4617-1011-48f5-90ae-5415fd9b91b4\") " Mar 16 16:53:55 crc kubenswrapper[5120]: I0316 16:53:55.493914 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/9fab4617-1011-48f5-90ae-5415fd9b91b4-public-tls-certs\") pod \"9fab4617-1011-48f5-90ae-5415fd9b91b4\" (UID: \"9fab4617-1011-48f5-90ae-5415fd9b91b4\") " Mar 16 16:53:55 crc kubenswrapper[5120]: I0316 16:53:55.495220 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/9fab4617-1011-48f5-90ae-5415fd9b91b4-internal-tls-certs\") pod \"9fab4617-1011-48f5-90ae-5415fd9b91b4\" (UID: \"9fab4617-1011-48f5-90ae-5415fd9b91b4\") " Mar 16 16:53:55 crc kubenswrapper[5120]: I0316 16:53:55.498900 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9fab4617-1011-48f5-90ae-5415fd9b91b4-logs" (OuterVolumeSpecName: "logs") pod "9fab4617-1011-48f5-90ae-5415fd9b91b4" (UID: "9fab4617-1011-48f5-90ae-5415fd9b91b4"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:53:55 crc kubenswrapper[5120]: I0316 16:53:55.499044 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cb10ccc3-03fc-4eb7-a637-c2bc721a9b69-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:55 crc kubenswrapper[5120]: I0316 16:53:55.499076 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cb10ccc3-03fc-4eb7-a637-c2bc721a9b69-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:55 crc kubenswrapper[5120]: I0316 16:53:55.499087 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8jg2z\" (UniqueName: \"kubernetes.io/projected/cb10ccc3-03fc-4eb7-a637-c2bc721a9b69-kube-api-access-8jg2z\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:55 crc kubenswrapper[5120]: I0316 16:53:55.499097 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/cb10ccc3-03fc-4eb7-a637-c2bc721a9b69-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:55 crc kubenswrapper[5120]: I0316 16:53:55.504795 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9fab4617-1011-48f5-90ae-5415fd9b91b4-kube-api-access-bxfk7" (OuterVolumeSpecName: "kube-api-access-bxfk7") pod "9fab4617-1011-48f5-90ae-5415fd9b91b4" (UID: "9fab4617-1011-48f5-90ae-5415fd9b91b4"). InnerVolumeSpecName "kube-api-access-bxfk7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:53:55 crc kubenswrapper[5120]: I0316 16:53:55.514907 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9fab4617-1011-48f5-90ae-5415fd9b91b4-scripts" (OuterVolumeSpecName: "scripts") pod "9fab4617-1011-48f5-90ae-5415fd9b91b4" (UID: "9fab4617-1011-48f5-90ae-5415fd9b91b4"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:55 crc kubenswrapper[5120]: I0316 16:53:55.568755 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9fab4617-1011-48f5-90ae-5415fd9b91b4-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "9fab4617-1011-48f5-90ae-5415fd9b91b4" (UID: "9fab4617-1011-48f5-90ae-5415fd9b91b4"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:55 crc kubenswrapper[5120]: I0316 16:53:55.601641 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9fab4617-1011-48f5-90ae-5415fd9b91b4-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:55 crc kubenswrapper[5120]: I0316 16:53:55.601933 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9fab4617-1011-48f5-90ae-5415fd9b91b4-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:55 crc kubenswrapper[5120]: I0316 16:53:55.602049 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bxfk7\" (UniqueName: \"kubernetes.io/projected/9fab4617-1011-48f5-90ae-5415fd9b91b4-kube-api-access-bxfk7\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:55 crc kubenswrapper[5120]: I0316 16:53:55.602156 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9fab4617-1011-48f5-90ae-5415fd9b91b4-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:55 crc kubenswrapper[5120]: I0316 16:53:55.602916 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9fab4617-1011-48f5-90ae-5415fd9b91b4-config-data" (OuterVolumeSpecName: "config-data") pod "9fab4617-1011-48f5-90ae-5415fd9b91b4" (UID: "9fab4617-1011-48f5-90ae-5415fd9b91b4"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:55 crc kubenswrapper[5120]: I0316 16:53:55.657636 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a","Type":"ContainerStarted","Data":"749a177740837a342b9536a7af62a8f69e41d5084bf108b901c90c18c3dbe68d"} Mar 16 16:53:55 crc kubenswrapper[5120]: I0316 16:53:55.657923 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a","Type":"ContainerStarted","Data":"5824335e776fc051905fc3da3116a19441d8ccddf48562f51769a8e960b3094b"} Mar 16 16:53:55 crc kubenswrapper[5120]: I0316 16:53:55.658002 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a","Type":"ContainerStarted","Data":"5d46cbd0fdd4c39dd4e954ede4e74df9712ffe1d057d4db2ab6df41eb7838bfc"} Mar 16 16:53:55 crc kubenswrapper[5120]: I0316 16:53:55.667638 5120 generic.go:358] "Generic (PLEG): container finished" podID="9fab4617-1011-48f5-90ae-5415fd9b91b4" containerID="eff074d953b8f8be8f090669ba89c0679cc2c30f766475fc75a1d50c65a8665f" exitCode=137 Mar 16 16:53:55 crc kubenswrapper[5120]: I0316 16:53:55.667873 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-88757f4fd-w4kvr" Mar 16 16:53:55 crc kubenswrapper[5120]: I0316 16:53:55.667936 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-88757f4fd-w4kvr" event={"ID":"9fab4617-1011-48f5-90ae-5415fd9b91b4","Type":"ContainerDied","Data":"eff074d953b8f8be8f090669ba89c0679cc2c30f766475fc75a1d50c65a8665f"} Mar 16 16:53:55 crc kubenswrapper[5120]: I0316 16:53:55.667966 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-88757f4fd-w4kvr" event={"ID":"9fab4617-1011-48f5-90ae-5415fd9b91b4","Type":"ContainerDied","Data":"06c504195824359573d119aba30897b0a5f404723faa634855a3d726aa4c206f"} Mar 16 16:53:55 crc kubenswrapper[5120]: I0316 16:53:55.667982 5120 scope.go:117] "RemoveContainer" containerID="eff074d953b8f8be8f090669ba89c0679cc2c30f766475fc75a1d50c65a8665f" Mar 16 16:53:55 crc kubenswrapper[5120]: I0316 16:53:55.692051 5120 generic.go:358] "Generic (PLEG): container finished" podID="cb10ccc3-03fc-4eb7-a637-c2bc721a9b69" containerID="5ff4bbba0105c7cefc7a6dc667024463e1d55d2bad64e496f008d23492e61d48" exitCode=137 Mar 16 16:53:55 crc kubenswrapper[5120]: I0316 16:53:55.692323 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-ccc65f956-nsglj" event={"ID":"cb10ccc3-03fc-4eb7-a637-c2bc721a9b69","Type":"ContainerDied","Data":"5ff4bbba0105c7cefc7a6dc667024463e1d55d2bad64e496f008d23492e61d48"} Mar 16 16:53:55 crc kubenswrapper[5120]: I0316 16:53:55.692445 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-ccc65f956-nsglj" event={"ID":"cb10ccc3-03fc-4eb7-a637-c2bc721a9b69","Type":"ContainerDied","Data":"a29961f9d9be29682f336f87def6ba60877ce87e52ab36b59d592cfccb3b2498"} Mar 16 16:53:55 crc kubenswrapper[5120]: I0316 16:53:55.692470 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-5fd9d6b8f6-vq7wb" Mar 16 16:53:55 crc kubenswrapper[5120]: I0316 16:53:55.693099 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-ccc65f956-nsglj" Mar 16 16:53:55 crc kubenswrapper[5120]: I0316 16:53:55.703666 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9fab4617-1011-48f5-90ae-5415fd9b91b4-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "9fab4617-1011-48f5-90ae-5415fd9b91b4" (UID: "9fab4617-1011-48f5-90ae-5415fd9b91b4"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:55 crc kubenswrapper[5120]: I0316 16:53:55.705739 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/9fab4617-1011-48f5-90ae-5415fd9b91b4-internal-tls-certs\") pod \"9fab4617-1011-48f5-90ae-5415fd9b91b4\" (UID: \"9fab4617-1011-48f5-90ae-5415fd9b91b4\") " Mar 16 16:53:55 crc kubenswrapper[5120]: I0316 16:53:55.719507 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9fab4617-1011-48f5-90ae-5415fd9b91b4-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:55 crc kubenswrapper[5120]: I0316 16:53:55.710226 5120 scope.go:117] "RemoveContainer" containerID="6d2b0330b2064662c772ad1e4e9e348aa9c96a000542503ed0720adf02860f5f" Mar 16 16:53:55 crc kubenswrapper[5120]: W0316 16:53:55.705985 5120 empty_dir.go:511] Warning: Unmount skipped because path does not exist: /var/lib/kubelet/pods/9fab4617-1011-48f5-90ae-5415fd9b91b4/volumes/kubernetes.io~secret/internal-tls-certs Mar 16 16:53:55 crc kubenswrapper[5120]: I0316 16:53:55.720472 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9fab4617-1011-48f5-90ae-5415fd9b91b4-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "9fab4617-1011-48f5-90ae-5415fd9b91b4" (UID: "9fab4617-1011-48f5-90ae-5415fd9b91b4"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:55 crc kubenswrapper[5120]: I0316 16:53:55.737535 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-5fd9d6b8f6-vq7wb"] Mar 16 16:53:55 crc kubenswrapper[5120]: I0316 16:53:55.752397 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-api-5fd9d6b8f6-vq7wb"] Mar 16 16:53:55 crc kubenswrapper[5120]: I0316 16:53:55.803975 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:53:55 crc kubenswrapper[5120]: I0316 16:53:55.813163 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9fab4617-1011-48f5-90ae-5415fd9b91b4-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "9fab4617-1011-48f5-90ae-5415fd9b91b4" (UID: "9fab4617-1011-48f5-90ae-5415fd9b91b4"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:55 crc kubenswrapper[5120]: I0316 16:53:55.822298 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/9fab4617-1011-48f5-90ae-5415fd9b91b4-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:55 crc kubenswrapper[5120]: I0316 16:53:55.822344 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/9fab4617-1011-48f5-90ae-5415fd9b91b4-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:55 crc kubenswrapper[5120]: I0316 16:53:55.943440 5120 scope.go:117] "RemoveContainer" containerID="eff074d953b8f8be8f090669ba89c0679cc2c30f766475fc75a1d50c65a8665f" Mar 16 16:53:55 crc kubenswrapper[5120]: E0316 16:53:55.945084 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eff074d953b8f8be8f090669ba89c0679cc2c30f766475fc75a1d50c65a8665f\": container with ID starting with eff074d953b8f8be8f090669ba89c0679cc2c30f766475fc75a1d50c65a8665f not found: ID does not exist" containerID="eff074d953b8f8be8f090669ba89c0679cc2c30f766475fc75a1d50c65a8665f" Mar 16 16:53:55 crc kubenswrapper[5120]: I0316 16:53:55.945147 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eff074d953b8f8be8f090669ba89c0679cc2c30f766475fc75a1d50c65a8665f"} err="failed to get container status \"eff074d953b8f8be8f090669ba89c0679cc2c30f766475fc75a1d50c65a8665f\": rpc error: code = NotFound desc = could not find container \"eff074d953b8f8be8f090669ba89c0679cc2c30f766475fc75a1d50c65a8665f\": container with ID starting with eff074d953b8f8be8f090669ba89c0679cc2c30f766475fc75a1d50c65a8665f not found: ID does not exist" Mar 16 16:53:55 crc kubenswrapper[5120]: I0316 16:53:55.945179 5120 scope.go:117] "RemoveContainer" containerID="6d2b0330b2064662c772ad1e4e9e348aa9c96a000542503ed0720adf02860f5f" Mar 16 16:53:55 crc kubenswrapper[5120]: E0316 16:53:55.945734 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d2b0330b2064662c772ad1e4e9e348aa9c96a000542503ed0720adf02860f5f\": container with ID starting with 6d2b0330b2064662c772ad1e4e9e348aa9c96a000542503ed0720adf02860f5f not found: ID does not exist" containerID="6d2b0330b2064662c772ad1e4e9e348aa9c96a000542503ed0720adf02860f5f" Mar 16 16:53:55 crc kubenswrapper[5120]: I0316 16:53:55.945857 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d2b0330b2064662c772ad1e4e9e348aa9c96a000542503ed0720adf02860f5f"} err="failed to get container status \"6d2b0330b2064662c772ad1e4e9e348aa9c96a000542503ed0720adf02860f5f\": rpc error: code = NotFound desc = could not find container \"6d2b0330b2064662c772ad1e4e9e348aa9c96a000542503ed0720adf02860f5f\": container with ID starting with 6d2b0330b2064662c772ad1e4e9e348aa9c96a000542503ed0720adf02860f5f not found: ID does not exist" Mar 16 16:53:55 crc kubenswrapper[5120]: I0316 16:53:55.945880 5120 scope.go:117] "RemoveContainer" containerID="5ff4bbba0105c7cefc7a6dc667024463e1d55d2bad64e496f008d23492e61d48" Mar 16 16:53:55 crc kubenswrapper[5120]: I0316 16:53:55.963839 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-ccc65f956-nsglj"] Mar 16 16:53:56 crc kubenswrapper[5120]: I0316 16:53:56.003072 5120 scope.go:117] "RemoveContainer" containerID="3ad9955eddb7852d5f0975d31c5bd54aa679fe305e10f6e084c39ef302c2e59b" Mar 16 16:53:56 crc kubenswrapper[5120]: I0316 16:53:56.042890 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-ccc65f956-nsglj"] Mar 16 16:53:56 crc kubenswrapper[5120]: E0316 16:53:56.284264 5120 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod34e6ded3_dd6f_46bb_9d23_fa8724b78ace.slice/crio-41533c5d5556d3dc95717c5df3eb81b00a5d17695d07e9725bc580ce2a9acefb.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode5acac7f_9646_4be1_ac22_31326296e4de.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod34e6ded3_dd6f_46bb_9d23_fa8724b78ace.slice/crio-ba90d7d4271418c373258f2de19f2ceabbc3fe0f13f63bd5e630054ecae78152.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod34e6ded3_dd6f_46bb_9d23_fa8724b78ace.slice/crio-conmon-ba90d7d4271418c373258f2de19f2ceabbc3fe0f13f63bd5e630054ecae78152.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode5acac7f_9646_4be1_ac22_31326296e4de.slice/crio-46c8ba259218ad0ae34a0926e382ef4fa4012a46c5f1102b8d5af7d0f2f25233.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9fb3c077_55b7_4693_af84_b981deb240da.slice/crio-6637aa7a76d94bb0d5267dcacbb4a5b56c43ee66a97a2de4a60d2391feac7339.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode5acac7f_9646_4be1_ac22_31326296e4de.slice/crio-conmon-db52ff3476db6cd59c6777eccc858aa2bfbf71202ed0fd58d0a238530b9853c7.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3853023d_8cc5_42de_9f91_d0609e3fe565.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9fb3c077_55b7_4693_af84_b981deb240da.slice/crio-conmon-6637aa7a76d94bb0d5267dcacbb4a5b56c43ee66a97a2de4a60d2391feac7339.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod34e6ded3_dd6f_46bb_9d23_fa8724b78ace.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9fb3c077_55b7_4693_af84_b981deb240da.slice/crio-249b8277425756d242d2d291ee93149d50812f92e3c309d8c713d118d0ee6ee8.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3853023d_8cc5_42de_9f91_d0609e3fe565.slice/crio-8a3d67c798c34d7edc582c34b6def56cd2c18e2d3984706dd66fb4a5aa30323f\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod133b5e0f_d834_4c59_932f_957221e1727b.slice/crio-550a482710c28eab0491207e17c6a03a7948797a16de7ca95046c49632833e1e\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod34e6ded3_dd6f_46bb_9d23_fa8724b78ace.slice/crio-12f22be8d9d792a80a93e43a38d6d62396ea6423e1fec7905bbcdafaa50b3aea\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode5acac7f_9646_4be1_ac22_31326296e4de.slice/crio-db52ff3476db6cd59c6777eccc858aa2bfbf71202ed0fd58d0a238530b9853c7.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod34e6ded3_dd6f_46bb_9d23_fa8724b78ace.slice/crio-conmon-41533c5d5556d3dc95717c5df3eb81b00a5d17695d07e9725bc580ce2a9acefb.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode5acac7f_9646_4be1_ac22_31326296e4de.slice/crio-5f9c8405278c1d27f0bef96dc113ce4effb5e74800d43c882d0387946ecc5ec9\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode5acac7f_9646_4be1_ac22_31326296e4de.slice/crio-conmon-46c8ba259218ad0ae34a0926e382ef4fa4012a46c5f1102b8d5af7d0f2f25233.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9fb3c077_55b7_4693_af84_b981deb240da.slice/crio-conmon-249b8277425756d242d2d291ee93149d50812f92e3c309d8c713d118d0ee6ee8.scope\": RecentStats: unable to find data in memory cache]" Mar 16 16:53:56 crc kubenswrapper[5120]: I0316 16:53:56.301059 5120 scope.go:117] "RemoveContainer" containerID="5ff4bbba0105c7cefc7a6dc667024463e1d55d2bad64e496f008d23492e61d48" Mar 16 16:53:56 crc kubenswrapper[5120]: E0316 16:53:56.303108 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ff4bbba0105c7cefc7a6dc667024463e1d55d2bad64e496f008d23492e61d48\": container with ID starting with 5ff4bbba0105c7cefc7a6dc667024463e1d55d2bad64e496f008d23492e61d48 not found: ID does not exist" containerID="5ff4bbba0105c7cefc7a6dc667024463e1d55d2bad64e496f008d23492e61d48" Mar 16 16:53:56 crc kubenswrapper[5120]: I0316 16:53:56.303146 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ff4bbba0105c7cefc7a6dc667024463e1d55d2bad64e496f008d23492e61d48"} err="failed to get container status \"5ff4bbba0105c7cefc7a6dc667024463e1d55d2bad64e496f008d23492e61d48\": rpc error: code = NotFound desc = could not find container \"5ff4bbba0105c7cefc7a6dc667024463e1d55d2bad64e496f008d23492e61d48\": container with ID starting with 5ff4bbba0105c7cefc7a6dc667024463e1d55d2bad64e496f008d23492e61d48 not found: ID does not exist" Mar 16 16:53:56 crc kubenswrapper[5120]: I0316 16:53:56.303167 5120 scope.go:117] "RemoveContainer" containerID="3ad9955eddb7852d5f0975d31c5bd54aa679fe305e10f6e084c39ef302c2e59b" Mar 16 16:53:56 crc kubenswrapper[5120]: E0316 16:53:56.306976 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ad9955eddb7852d5f0975d31c5bd54aa679fe305e10f6e084c39ef302c2e59b\": container with ID starting with 3ad9955eddb7852d5f0975d31c5bd54aa679fe305e10f6e084c39ef302c2e59b not found: ID does not exist" containerID="3ad9955eddb7852d5f0975d31c5bd54aa679fe305e10f6e084c39ef302c2e59b" Mar 16 16:53:56 crc kubenswrapper[5120]: I0316 16:53:56.307021 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ad9955eddb7852d5f0975d31c5bd54aa679fe305e10f6e084c39ef302c2e59b"} err="failed to get container status \"3ad9955eddb7852d5f0975d31c5bd54aa679fe305e10f6e084c39ef302c2e59b\": rpc error: code = NotFound desc = could not find container \"3ad9955eddb7852d5f0975d31c5bd54aa679fe305e10f6e084c39ef302c2e59b\": container with ID starting with 3ad9955eddb7852d5f0975d31c5bd54aa679fe305e10f6e084c39ef302c2e59b not found: ID does not exist" Mar 16 16:53:56 crc kubenswrapper[5120]: I0316 16:53:56.329096 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-88757f4fd-w4kvr"] Mar 16 16:53:56 crc kubenswrapper[5120]: I0316 16:53:56.338738 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-88757f4fd-w4kvr"] Mar 16 16:53:56 crc kubenswrapper[5120]: I0316 16:53:56.417322 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-5f687f46f5-qdrk5" Mar 16 16:53:56 crc kubenswrapper[5120]: I0316 16:53:56.456644 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/a5396fe3-454e-4707-b185-5ad652c091da-config-data-custom\") pod \"a5396fe3-454e-4707-b185-5ad652c091da\" (UID: \"a5396fe3-454e-4707-b185-5ad652c091da\") " Mar 16 16:53:56 crc kubenswrapper[5120]: I0316 16:53:56.456884 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a5396fe3-454e-4707-b185-5ad652c091da-config-data\") pod \"a5396fe3-454e-4707-b185-5ad652c091da\" (UID: \"a5396fe3-454e-4707-b185-5ad652c091da\") " Mar 16 16:53:56 crc kubenswrapper[5120]: I0316 16:53:56.456937 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a5396fe3-454e-4707-b185-5ad652c091da-combined-ca-bundle\") pod \"a5396fe3-454e-4707-b185-5ad652c091da\" (UID: \"a5396fe3-454e-4707-b185-5ad652c091da\") " Mar 16 16:53:56 crc kubenswrapper[5120]: I0316 16:53:56.456983 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w2kpz\" (UniqueName: \"kubernetes.io/projected/a5396fe3-454e-4707-b185-5ad652c091da-kube-api-access-w2kpz\") pod \"a5396fe3-454e-4707-b185-5ad652c091da\" (UID: \"a5396fe3-454e-4707-b185-5ad652c091da\") " Mar 16 16:53:56 crc kubenswrapper[5120]: I0316 16:53:56.457005 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a5396fe3-454e-4707-b185-5ad652c091da-logs\") pod \"a5396fe3-454e-4707-b185-5ad652c091da\" (UID: \"a5396fe3-454e-4707-b185-5ad652c091da\") " Mar 16 16:53:56 crc kubenswrapper[5120]: I0316 16:53:56.468021 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5396fe3-454e-4707-b185-5ad652c091da-logs" (OuterVolumeSpecName: "logs") pod "a5396fe3-454e-4707-b185-5ad652c091da" (UID: "a5396fe3-454e-4707-b185-5ad652c091da"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:53:56 crc kubenswrapper[5120]: I0316 16:53:56.475293 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a5396fe3-454e-4707-b185-5ad652c091da-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "a5396fe3-454e-4707-b185-5ad652c091da" (UID: "a5396fe3-454e-4707-b185-5ad652c091da"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:56 crc kubenswrapper[5120]: I0316 16:53:56.479071 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5396fe3-454e-4707-b185-5ad652c091da-kube-api-access-w2kpz" (OuterVolumeSpecName: "kube-api-access-w2kpz") pod "a5396fe3-454e-4707-b185-5ad652c091da" (UID: "a5396fe3-454e-4707-b185-5ad652c091da"). InnerVolumeSpecName "kube-api-access-w2kpz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:53:56 crc kubenswrapper[5120]: I0316 16:53:56.533326 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a5396fe3-454e-4707-b185-5ad652c091da-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "a5396fe3-454e-4707-b185-5ad652c091da" (UID: "a5396fe3-454e-4707-b185-5ad652c091da"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:56 crc kubenswrapper[5120]: I0316 16:53:56.568342 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a5396fe3-454e-4707-b185-5ad652c091da-config-data" (OuterVolumeSpecName: "config-data") pod "a5396fe3-454e-4707-b185-5ad652c091da" (UID: "a5396fe3-454e-4707-b185-5ad652c091da"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:56 crc kubenswrapper[5120]: I0316 16:53:56.569117 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a5396fe3-454e-4707-b185-5ad652c091da-config-data\") pod \"a5396fe3-454e-4707-b185-5ad652c091da\" (UID: \"a5396fe3-454e-4707-b185-5ad652c091da\") " Mar 16 16:53:56 crc kubenswrapper[5120]: W0316 16:53:56.569251 5120 empty_dir.go:511] Warning: Unmount skipped because path does not exist: /var/lib/kubelet/pods/a5396fe3-454e-4707-b185-5ad652c091da/volumes/kubernetes.io~secret/config-data Mar 16 16:53:56 crc kubenswrapper[5120]: I0316 16:53:56.570844 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a5396fe3-454e-4707-b185-5ad652c091da-config-data" (OuterVolumeSpecName: "config-data") pod "a5396fe3-454e-4707-b185-5ad652c091da" (UID: "a5396fe3-454e-4707-b185-5ad652c091da"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:56 crc kubenswrapper[5120]: I0316 16:53:56.571801 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/a5396fe3-454e-4707-b185-5ad652c091da-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:56 crc kubenswrapper[5120]: I0316 16:53:56.571899 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a5396fe3-454e-4707-b185-5ad652c091da-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:56 crc kubenswrapper[5120]: I0316 16:53:56.571969 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a5396fe3-454e-4707-b185-5ad652c091da-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:56 crc kubenswrapper[5120]: I0316 16:53:56.572037 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w2kpz\" (UniqueName: \"kubernetes.io/projected/a5396fe3-454e-4707-b185-5ad652c091da-kube-api-access-w2kpz\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:56 crc kubenswrapper[5120]: I0316 16:53:56.572097 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a5396fe3-454e-4707-b185-5ad652c091da-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:56 crc kubenswrapper[5120]: E0316 16:53:56.631395 5120 fsHandler.go:119] failed to collect filesystem stats - rootDiskErr: could not stat "/var/lib/containers/storage/overlay/8e0c658ab2d8fb1d01d0bb82414e7dc909b10bfe623ef00ec8a56a8a6b85d88d/diff" to get inode usage: stat /var/lib/containers/storage/overlay/8e0c658ab2d8fb1d01d0bb82414e7dc909b10bfe623ef00ec8a56a8a6b85d88d/diff: no such file or directory, extraDiskErr: could not stat "/var/log/pods/openstack-kuttl-tests_cinder-scheduler-0_b91a9930-eec4-4af5-9aee-5d02dc78fabc/cinder-scheduler/0.log" to get inode usage: stat /var/log/pods/openstack-kuttl-tests_cinder-scheduler-0_b91a9930-eec4-4af5-9aee-5d02dc78fabc/cinder-scheduler/0.log: no such file or directory Mar 16 16:53:56 crc kubenswrapper[5120]: I0316 16:53:56.679012 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9fab4617-1011-48f5-90ae-5415fd9b91b4" path="/var/lib/kubelet/pods/9fab4617-1011-48f5-90ae-5415fd9b91b4/volumes" Mar 16 16:53:56 crc kubenswrapper[5120]: I0316 16:53:56.679707 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c1cda6a8-906f-4375-8909-a0548d69ecd6" path="/var/lib/kubelet/pods/c1cda6a8-906f-4375-8909-a0548d69ecd6/volumes" Mar 16 16:53:56 crc kubenswrapper[5120]: I0316 16:53:56.680417 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb10ccc3-03fc-4eb7-a637-c2bc721a9b69" path="/var/lib/kubelet/pods/cb10ccc3-03fc-4eb7-a637-c2bc721a9b69/volumes" Mar 16 16:53:56 crc kubenswrapper[5120]: I0316 16:53:56.681774 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb37f123-034b-4ccb-9f71-676a322e2a8b" path="/var/lib/kubelet/pods/cb37f123-034b-4ccb-9f71-676a322e2a8b/volumes" Mar 16 16:53:56 crc kubenswrapper[5120]: I0316 16:53:56.698595 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/keystone-f6bd6ffc7-nq4s9" Mar 16 16:53:56 crc kubenswrapper[5120]: I0316 16:53:56.710644 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a","Type":"ContainerStarted","Data":"2cfafdd940355b0c9ef3bd22588f683e31e9b9ae011f465bc5afd07315f80340"} Mar 16 16:53:56 crc kubenswrapper[5120]: I0316 16:53:56.710687 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a","Type":"ContainerStarted","Data":"49c026b13207a7e4d1fe5b1529024ced01e29f9e430a662852633085f308ba6d"} Mar 16 16:53:56 crc kubenswrapper[5120]: I0316 16:53:56.710697 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a","Type":"ContainerStarted","Data":"554f007f0035801c2403921329abc993a0f8616e35fd0592c4e77e8f5133ccb6"} Mar 16 16:53:56 crc kubenswrapper[5120]: I0316 16:53:56.710705 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a","Type":"ContainerStarted","Data":"49757f02afc4e3f6e201e4726f9a770efb96bca7046b78c5b0456df02c9b9973"} Mar 16 16:53:56 crc kubenswrapper[5120]: I0316 16:53:56.742699 5120 generic.go:358] "Generic (PLEG): container finished" podID="a5396fe3-454e-4707-b185-5ad652c091da" containerID="316ceb783284a9aa1a89110aa909af4bccff62799441dd3c5d0c4df5b0b80c62" exitCode=137 Mar 16 16:53:56 crc kubenswrapper[5120]: I0316 16:53:56.742993 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-5f687f46f5-qdrk5" event={"ID":"a5396fe3-454e-4707-b185-5ad652c091da","Type":"ContainerDied","Data":"316ceb783284a9aa1a89110aa909af4bccff62799441dd3c5d0c4df5b0b80c62"} Mar 16 16:53:56 crc kubenswrapper[5120]: I0316 16:53:56.743103 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-5f687f46f5-qdrk5" event={"ID":"a5396fe3-454e-4707-b185-5ad652c091da","Type":"ContainerDied","Data":"be7955c879196f7927192774b52896d6e3a3e49e67d75e0b1bbe507f4d08fbc9"} Mar 16 16:53:56 crc kubenswrapper[5120]: I0316 16:53:56.743191 5120 scope.go:117] "RemoveContainer" containerID="316ceb783284a9aa1a89110aa909af4bccff62799441dd3c5d0c4df5b0b80c62" Mar 16 16:53:56 crc kubenswrapper[5120]: I0316 16:53:56.743426 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-5f687f46f5-qdrk5" Mar 16 16:53:56 crc kubenswrapper[5120]: I0316 16:53:56.778200 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-74597bb8cb-kbqx7"] Mar 16 16:53:56 crc kubenswrapper[5120]: I0316 16:53:56.778431 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/keystone-74597bb8cb-kbqx7" podUID="c27e11d8-d691-4894-995b-b4855e61ab80" containerName="keystone-api" containerID="cri-o://94a0984603d5bdc59410680ea92bf614dd65b62b0534a0dff6970ab8a0e20e27" gracePeriod=30 Mar 16 16:53:56 crc kubenswrapper[5120]: I0316 16:53:56.817048 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-5f687f46f5-qdrk5"] Mar 16 16:53:56 crc kubenswrapper[5120]: I0316 16:53:56.827641 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-worker-5f687f46f5-qdrk5"] Mar 16 16:53:56 crc kubenswrapper[5120]: I0316 16:53:56.829870 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:53:56 crc kubenswrapper[5120]: I0316 16:53:56.844203 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:53:56 crc kubenswrapper[5120]: I0316 16:53:56.909473 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:53:56 crc kubenswrapper[5120]: I0316 16:53:56.910699 5120 scope.go:117] "RemoveContainer" containerID="d527d53f1efda798a88fbbb030e0328a56d2926e6ca6e2916bd72f1280b74ff3" Mar 16 16:53:56 crc kubenswrapper[5120]: I0316 16:53:56.950503 5120 scope.go:117] "RemoveContainer" containerID="316ceb783284a9aa1a89110aa909af4bccff62799441dd3c5d0c4df5b0b80c62" Mar 16 16:53:56 crc kubenswrapper[5120]: E0316 16:53:56.976260 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"316ceb783284a9aa1a89110aa909af4bccff62799441dd3c5d0c4df5b0b80c62\": container with ID starting with 316ceb783284a9aa1a89110aa909af4bccff62799441dd3c5d0c4df5b0b80c62 not found: ID does not exist" containerID="316ceb783284a9aa1a89110aa909af4bccff62799441dd3c5d0c4df5b0b80c62" Mar 16 16:53:56 crc kubenswrapper[5120]: I0316 16:53:56.976310 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"316ceb783284a9aa1a89110aa909af4bccff62799441dd3c5d0c4df5b0b80c62"} err="failed to get container status \"316ceb783284a9aa1a89110aa909af4bccff62799441dd3c5d0c4df5b0b80c62\": rpc error: code = NotFound desc = could not find container \"316ceb783284a9aa1a89110aa909af4bccff62799441dd3c5d0c4df5b0b80c62\": container with ID starting with 316ceb783284a9aa1a89110aa909af4bccff62799441dd3c5d0c4df5b0b80c62 not found: ID does not exist" Mar 16 16:53:56 crc kubenswrapper[5120]: I0316 16:53:56.976338 5120 scope.go:117] "RemoveContainer" containerID="d527d53f1efda798a88fbbb030e0328a56d2926e6ca6e2916bd72f1280b74ff3" Mar 16 16:53:56 crc kubenswrapper[5120]: E0316 16:53:56.977152 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d527d53f1efda798a88fbbb030e0328a56d2926e6ca6e2916bd72f1280b74ff3\": container with ID starting with d527d53f1efda798a88fbbb030e0328a56d2926e6ca6e2916bd72f1280b74ff3 not found: ID does not exist" containerID="d527d53f1efda798a88fbbb030e0328a56d2926e6ca6e2916bd72f1280b74ff3" Mar 16 16:53:56 crc kubenswrapper[5120]: I0316 16:53:56.977192 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d527d53f1efda798a88fbbb030e0328a56d2926e6ca6e2916bd72f1280b74ff3"} err="failed to get container status \"d527d53f1efda798a88fbbb030e0328a56d2926e6ca6e2916bd72f1280b74ff3\": rpc error: code = NotFound desc = could not find container \"d527d53f1efda798a88fbbb030e0328a56d2926e6ca6e2916bd72f1280b74ff3\": container with ID starting with d527d53f1efda798a88fbbb030e0328a56d2926e6ca6e2916bd72f1280b74ff3 not found: ID does not exist" Mar 16 16:53:57 crc kubenswrapper[5120]: I0316 16:53:57.027527 5120 scope.go:117] "RemoveContainer" containerID="9774a490e427b07efec3e6172a6590aa16e8a4591618ab0a2aabf66a6561a5cf" Mar 16 16:53:57 crc kubenswrapper[5120]: I0316 16:53:57.175348 5120 scope.go:117] "RemoveContainer" containerID="2b78df72dc64bdedfa363ecf3b5f81ebb031eb3a22bfb78605bf75def38398ba" Mar 16 16:53:57 crc kubenswrapper[5120]: I0316 16:53:57.208451 5120 scope.go:117] "RemoveContainer" containerID="62b12f4f75e2aae38db45282d142c8c9e3c9bde4fe29592bc1d89f41c324da4f" Mar 16 16:53:57 crc kubenswrapper[5120]: I0316 16:53:57.239502 5120 scope.go:117] "RemoveContainer" containerID="23ef435dbdc1bb1b210727961b8ddf2b9ade496127372a946c888f080a0bc5cf" Mar 16 16:53:57 crc kubenswrapper[5120]: I0316 16:53:57.263194 5120 scope.go:117] "RemoveContainer" containerID="372549177c4113b336f00bad35ad4176409adac22d868180f47a53d7795e9b25" Mar 16 16:53:57 crc kubenswrapper[5120]: I0316 16:53:57.296709 5120 scope.go:117] "RemoveContainer" containerID="d1fbb00b92463a21cf79b603f3caf860bedd78d33fda25f3945a9d8b45ac41e4" Mar 16 16:53:57 crc kubenswrapper[5120]: I0316 16:53:57.333558 5120 scope.go:117] "RemoveContainer" containerID="0133a2cd785424001989a4b5c72950fd6eb0e3bedabf2dd40ea720d83389adb9" Mar 16 16:53:57 crc kubenswrapper[5120]: I0316 16:53:57.377101 5120 scope.go:117] "RemoveContainer" containerID="1fee9192977e6d435dcca6fcd391ab5cfb489871c847ce736d44a559c0101a1a" Mar 16 16:53:57 crc kubenswrapper[5120]: I0316 16:53:57.377602 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/placement-584b8687b4-5c6lr" Mar 16 16:53:57 crc kubenswrapper[5120]: I0316 16:53:57.428254 5120 scope.go:117] "RemoveContainer" containerID="aa2bd836b9e31251f5d2c19ded112b6b2b88dec48badd74e3248328903d27c91" Mar 16 16:53:57 crc kubenswrapper[5120]: I0316 16:53:57.477567 5120 scope.go:117] "RemoveContainer" containerID="b56b840eff04c2ab9a162f3cdec5eebed9702876d18bf834243ab5cb9ff66aaa" Mar 16 16:53:57 crc kubenswrapper[5120]: I0316 16:53:57.498066 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:53:57 crc kubenswrapper[5120]: I0316 16:53:57.551354 5120 scope.go:117] "RemoveContainer" containerID="25a0f6ab9cd653f0d4ee96cd81c134f0a6c81ac1d4193f06a891df2ef4a46fec" Mar 16 16:53:57 crc kubenswrapper[5120]: I0316 16:53:57.583389 5120 scope.go:117] "RemoveContainer" containerID="77ec3053fe95ea6ad0e977f3a81112af3412e073e6957bf9bfca69061c9cf477" Mar 16 16:53:57 crc kubenswrapper[5120]: I0316 16:53:57.789673 5120 generic.go:358] "Generic (PLEG): container finished" podID="a7564ece-3e31-426b-a07b-1b9e12d76d01" containerID="90fa913e82e6a693d89c84435eb04f963c4d8b4c4ab762c7bcba095c8c48203e" exitCode=137 Mar 16 16:53:57 crc kubenswrapper[5120]: I0316 16:53:57.789800 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-786c646546-49lhr" event={"ID":"a7564ece-3e31-426b-a07b-1b9e12d76d01","Type":"ContainerDied","Data":"90fa913e82e6a693d89c84435eb04f963c4d8b4c4ab762c7bcba095c8c48203e"} Mar 16 16:53:57 crc kubenswrapper[5120]: I0316 16:53:57.875662 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a","Type":"ContainerStarted","Data":"2454d54900356215b328078c989b7ee2ba76bf00e907810455592dd0328d3607"} Mar 16 16:53:57 crc kubenswrapper[5120]: I0316 16:53:57.875708 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a","Type":"ContainerStarted","Data":"5aa2c642ff9b32cbd48cdd175341bc53df8e83fb47b3006102567a681eb9fe12"} Mar 16 16:53:57 crc kubenswrapper[5120]: I0316 16:53:57.875717 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a","Type":"ContainerStarted","Data":"8ae45574f24cf4187ebc4c1968f20b78b90badf1d3289e58e00075a12b7f4aaf"} Mar 16 16:53:58 crc kubenswrapper[5120]: I0316 16:53:58.005408 5120 pod_container_manager_linux.go:217] "Failed to delete cgroup paths" cgroupName=["kubepods","besteffort","podc06f24f9-95b0-4a92-ad3a-6075764151ed"] err="unable to destroy cgroup paths for cgroup [kubepods besteffort podc06f24f9-95b0-4a92-ad3a-6075764151ed] : Timed out while waiting for systemd to remove kubepods-besteffort-podc06f24f9_95b0_4a92_ad3a_6075764151ed.slice" Mar 16 16:53:58 crc kubenswrapper[5120]: E0316 16:53:58.005467 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to delete cgroup paths for [kubepods besteffort podc06f24f9-95b0-4a92-ad3a-6075764151ed] : unable to destroy cgroup paths for cgroup [kubepods besteffort podc06f24f9-95b0-4a92-ad3a-6075764151ed] : Timed out while waiting for systemd to remove kubepods-besteffort-podc06f24f9_95b0_4a92_ad3a_6075764151ed.slice" pod="openstack-kuttl-tests/barbican-api-7f78b864cb-6dgjh" podUID="c06f24f9-95b0-4a92-ad3a-6075764151ed" Mar 16 16:53:58 crc kubenswrapper[5120]: I0316 16:53:58.113444 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 16:53:58 crc kubenswrapper[5120]: I0316 16:53:58.113679 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/openstackclient" podUID="74ab0944-2f5c-4a9d-a848-8e2a8d17d9cd" containerName="openstackclient" containerID="cri-o://c66e427fd88f88ad048e67d49836dce5591eefc18c9879eaec88a4f93093cca2" gracePeriod=2 Mar 16 16:53:58 crc kubenswrapper[5120]: I0316 16:53:58.128741 5120 status_manager.go:895] "Failed to get status for pod" podUID="74ab0944-2f5c-4a9d-a848-8e2a8d17d9cd" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 16:53:58 crc kubenswrapper[5120]: I0316 16:53:58.156024 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 16:53:58 crc kubenswrapper[5120]: I0316 16:53:58.182268 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 16:53:58 crc kubenswrapper[5120]: I0316 16:53:58.184033 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb10ccc3-03fc-4eb7-a637-c2bc721a9b69" containerName="barbican-keystone-listener" Mar 16 16:53:58 crc kubenswrapper[5120]: I0316 16:53:58.184055 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb10ccc3-03fc-4eb7-a637-c2bc721a9b69" containerName="barbican-keystone-listener" Mar 16 16:53:58 crc kubenswrapper[5120]: I0316 16:53:58.184065 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5396fe3-454e-4707-b185-5ad652c091da" containerName="barbican-worker-log" Mar 16 16:53:58 crc kubenswrapper[5120]: I0316 16:53:58.184071 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5396fe3-454e-4707-b185-5ad652c091da" containerName="barbican-worker-log" Mar 16 16:53:58 crc kubenswrapper[5120]: I0316 16:53:58.184088 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9fab4617-1011-48f5-90ae-5415fd9b91b4" containerName="placement-log" Mar 16 16:53:58 crc kubenswrapper[5120]: I0316 16:53:58.184095 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9fab4617-1011-48f5-90ae-5415fd9b91b4" containerName="placement-log" Mar 16 16:53:58 crc kubenswrapper[5120]: I0316 16:53:58.184108 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74ab0944-2f5c-4a9d-a848-8e2a8d17d9cd" containerName="openstackclient" Mar 16 16:53:58 crc kubenswrapper[5120]: I0316 16:53:58.184113 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="74ab0944-2f5c-4a9d-a848-8e2a8d17d9cd" containerName="openstackclient" Mar 16 16:53:58 crc kubenswrapper[5120]: I0316 16:53:58.184121 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9fab4617-1011-48f5-90ae-5415fd9b91b4" containerName="placement-api" Mar 16 16:53:58 crc kubenswrapper[5120]: I0316 16:53:58.184129 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9fab4617-1011-48f5-90ae-5415fd9b91b4" containerName="placement-api" Mar 16 16:53:58 crc kubenswrapper[5120]: I0316 16:53:58.184146 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1cda6a8-906f-4375-8909-a0548d69ecd6" containerName="barbican-worker-log" Mar 16 16:53:58 crc kubenswrapper[5120]: I0316 16:53:58.184151 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1cda6a8-906f-4375-8909-a0548d69ecd6" containerName="barbican-worker-log" Mar 16 16:53:58 crc kubenswrapper[5120]: I0316 16:53:58.184159 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5396fe3-454e-4707-b185-5ad652c091da" containerName="barbican-worker" Mar 16 16:53:58 crc kubenswrapper[5120]: I0316 16:53:58.184164 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5396fe3-454e-4707-b185-5ad652c091da" containerName="barbican-worker" Mar 16 16:53:58 crc kubenswrapper[5120]: I0316 16:53:58.184183 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1cda6a8-906f-4375-8909-a0548d69ecd6" containerName="barbican-worker" Mar 16 16:53:58 crc kubenswrapper[5120]: I0316 16:53:58.184188 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1cda6a8-906f-4375-8909-a0548d69ecd6" containerName="barbican-worker" Mar 16 16:53:58 crc kubenswrapper[5120]: I0316 16:53:58.184207 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb10ccc3-03fc-4eb7-a637-c2bc721a9b69" containerName="barbican-keystone-listener-log" Mar 16 16:53:58 crc kubenswrapper[5120]: I0316 16:53:58.184214 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb10ccc3-03fc-4eb7-a637-c2bc721a9b69" containerName="barbican-keystone-listener-log" Mar 16 16:53:58 crc kubenswrapper[5120]: I0316 16:53:58.184372 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="74ab0944-2f5c-4a9d-a848-8e2a8d17d9cd" containerName="openstackclient" Mar 16 16:53:58 crc kubenswrapper[5120]: I0316 16:53:58.184389 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="9fab4617-1011-48f5-90ae-5415fd9b91b4" containerName="placement-api" Mar 16 16:53:58 crc kubenswrapper[5120]: I0316 16:53:58.184398 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="cb10ccc3-03fc-4eb7-a637-c2bc721a9b69" containerName="barbican-keystone-listener" Mar 16 16:53:58 crc kubenswrapper[5120]: I0316 16:53:58.184408 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c1cda6a8-906f-4375-8909-a0548d69ecd6" containerName="barbican-worker-log" Mar 16 16:53:58 crc kubenswrapper[5120]: I0316 16:53:58.184421 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="a5396fe3-454e-4707-b185-5ad652c091da" containerName="barbican-worker-log" Mar 16 16:53:58 crc kubenswrapper[5120]: I0316 16:53:58.184432 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c1cda6a8-906f-4375-8909-a0548d69ecd6" containerName="barbican-worker" Mar 16 16:53:58 crc kubenswrapper[5120]: I0316 16:53:58.184443 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="a5396fe3-454e-4707-b185-5ad652c091da" containerName="barbican-worker" Mar 16 16:53:58 crc kubenswrapper[5120]: I0316 16:53:58.184453 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="cb10ccc3-03fc-4eb7-a637-c2bc721a9b69" containerName="barbican-keystone-listener-log" Mar 16 16:53:58 crc kubenswrapper[5120]: I0316 16:53:58.184464 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="9fab4617-1011-48f5-90ae-5415fd9b91b4" containerName="placement-log" Mar 16 16:53:58 crc kubenswrapper[5120]: I0316 16:53:58.191816 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Mar 16 16:53:58 crc kubenswrapper[5120]: I0316 16:53:58.197429 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 16:53:58 crc kubenswrapper[5120]: I0316 16:53:58.206643 5120 status_manager.go:905] "Pod was deleted and then recreated, skipping status update" pod="openstack-kuttl-tests/openstackclient" oldPodUID="74ab0944-2f5c-4a9d-a848-8e2a8d17d9cd" podUID="52f09603-9dff-4c67-a4b9-7bb162cd4a40" Mar 16 16:53:58 crc kubenswrapper[5120]: I0316 16:53:58.258833 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-786c646546-49lhr" Mar 16 16:53:58 crc kubenswrapper[5120]: I0316 16:53:58.270203 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/52f09603-9dff-4c67-a4b9-7bb162cd4a40-openstack-config\") pod \"openstackclient\" (UID: \"52f09603-9dff-4c67-a4b9-7bb162cd4a40\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:53:58 crc kubenswrapper[5120]: I0316 16:53:58.270290 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/52f09603-9dff-4c67-a4b9-7bb162cd4a40-openstack-config-secret\") pod \"openstackclient\" (UID: \"52f09603-9dff-4c67-a4b9-7bb162cd4a40\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:53:58 crc kubenswrapper[5120]: I0316 16:53:58.270631 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9kcd7\" (UniqueName: \"kubernetes.io/projected/52f09603-9dff-4c67-a4b9-7bb162cd4a40-kube-api-access-9kcd7\") pod \"openstackclient\" (UID: \"52f09603-9dff-4c67-a4b9-7bb162cd4a40\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:53:58 crc kubenswrapper[5120]: I0316 16:53:58.270928 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/52f09603-9dff-4c67-a4b9-7bb162cd4a40-combined-ca-bundle\") pod \"openstackclient\" (UID: \"52f09603-9dff-4c67-a4b9-7bb162cd4a40\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:53:58 crc kubenswrapper[5120]: I0316 16:53:58.372633 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/a7564ece-3e31-426b-a07b-1b9e12d76d01-config-data-custom\") pod \"a7564ece-3e31-426b-a07b-1b9e12d76d01\" (UID: \"a7564ece-3e31-426b-a07b-1b9e12d76d01\") " Mar 16 16:53:58 crc kubenswrapper[5120]: I0316 16:53:58.372938 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a7564ece-3e31-426b-a07b-1b9e12d76d01-combined-ca-bundle\") pod \"a7564ece-3e31-426b-a07b-1b9e12d76d01\" (UID: \"a7564ece-3e31-426b-a07b-1b9e12d76d01\") " Mar 16 16:53:58 crc kubenswrapper[5120]: I0316 16:53:58.373064 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vxdkl\" (UniqueName: \"kubernetes.io/projected/a7564ece-3e31-426b-a07b-1b9e12d76d01-kube-api-access-vxdkl\") pod \"a7564ece-3e31-426b-a07b-1b9e12d76d01\" (UID: \"a7564ece-3e31-426b-a07b-1b9e12d76d01\") " Mar 16 16:53:58 crc kubenswrapper[5120]: I0316 16:53:58.373196 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a7564ece-3e31-426b-a07b-1b9e12d76d01-logs\") pod \"a7564ece-3e31-426b-a07b-1b9e12d76d01\" (UID: \"a7564ece-3e31-426b-a07b-1b9e12d76d01\") " Mar 16 16:53:58 crc kubenswrapper[5120]: I0316 16:53:58.373390 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a7564ece-3e31-426b-a07b-1b9e12d76d01-config-data\") pod \"a7564ece-3e31-426b-a07b-1b9e12d76d01\" (UID: \"a7564ece-3e31-426b-a07b-1b9e12d76d01\") " Mar 16 16:53:58 crc kubenswrapper[5120]: I0316 16:53:58.373574 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/52f09603-9dff-4c67-a4b9-7bb162cd4a40-openstack-config\") pod \"openstackclient\" (UID: \"52f09603-9dff-4c67-a4b9-7bb162cd4a40\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:53:58 crc kubenswrapper[5120]: I0316 16:53:58.373595 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/52f09603-9dff-4c67-a4b9-7bb162cd4a40-openstack-config-secret\") pod \"openstackclient\" (UID: \"52f09603-9dff-4c67-a4b9-7bb162cd4a40\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:53:58 crc kubenswrapper[5120]: I0316 16:53:58.373742 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9kcd7\" (UniqueName: \"kubernetes.io/projected/52f09603-9dff-4c67-a4b9-7bb162cd4a40-kube-api-access-9kcd7\") pod \"openstackclient\" (UID: \"52f09603-9dff-4c67-a4b9-7bb162cd4a40\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:53:58 crc kubenswrapper[5120]: I0316 16:53:58.373794 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/52f09603-9dff-4c67-a4b9-7bb162cd4a40-combined-ca-bundle\") pod \"openstackclient\" (UID: \"52f09603-9dff-4c67-a4b9-7bb162cd4a40\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:53:58 crc kubenswrapper[5120]: I0316 16:53:58.375866 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7564ece-3e31-426b-a07b-1b9e12d76d01-logs" (OuterVolumeSpecName: "logs") pod "a7564ece-3e31-426b-a07b-1b9e12d76d01" (UID: "a7564ece-3e31-426b-a07b-1b9e12d76d01"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:53:58 crc kubenswrapper[5120]: I0316 16:53:58.376840 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/52f09603-9dff-4c67-a4b9-7bb162cd4a40-openstack-config\") pod \"openstackclient\" (UID: \"52f09603-9dff-4c67-a4b9-7bb162cd4a40\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:53:58 crc kubenswrapper[5120]: I0316 16:53:58.383135 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7564ece-3e31-426b-a07b-1b9e12d76d01-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "a7564ece-3e31-426b-a07b-1b9e12d76d01" (UID: "a7564ece-3e31-426b-a07b-1b9e12d76d01"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:58 crc kubenswrapper[5120]: I0316 16:53:58.385966 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7564ece-3e31-426b-a07b-1b9e12d76d01-kube-api-access-vxdkl" (OuterVolumeSpecName: "kube-api-access-vxdkl") pod "a7564ece-3e31-426b-a07b-1b9e12d76d01" (UID: "a7564ece-3e31-426b-a07b-1b9e12d76d01"). InnerVolumeSpecName "kube-api-access-vxdkl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:53:58 crc kubenswrapper[5120]: I0316 16:53:58.386643 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/52f09603-9dff-4c67-a4b9-7bb162cd4a40-combined-ca-bundle\") pod \"openstackclient\" (UID: \"52f09603-9dff-4c67-a4b9-7bb162cd4a40\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:53:58 crc kubenswrapper[5120]: I0316 16:53:58.386875 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/52f09603-9dff-4c67-a4b9-7bb162cd4a40-openstack-config-secret\") pod \"openstackclient\" (UID: \"52f09603-9dff-4c67-a4b9-7bb162cd4a40\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:53:58 crc kubenswrapper[5120]: I0316 16:53:58.428985 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7564ece-3e31-426b-a07b-1b9e12d76d01-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "a7564ece-3e31-426b-a07b-1b9e12d76d01" (UID: "a7564ece-3e31-426b-a07b-1b9e12d76d01"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:58 crc kubenswrapper[5120]: I0316 16:53:58.453490 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9kcd7\" (UniqueName: \"kubernetes.io/projected/52f09603-9dff-4c67-a4b9-7bb162cd4a40-kube-api-access-9kcd7\") pod \"openstackclient\" (UID: \"52f09603-9dff-4c67-a4b9-7bb162cd4a40\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:53:58 crc kubenswrapper[5120]: I0316 16:53:58.484557 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a7564ece-3e31-426b-a07b-1b9e12d76d01-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:58 crc kubenswrapper[5120]: I0316 16:53:58.484600 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vxdkl\" (UniqueName: \"kubernetes.io/projected/a7564ece-3e31-426b-a07b-1b9e12d76d01-kube-api-access-vxdkl\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:58 crc kubenswrapper[5120]: I0316 16:53:58.484613 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a7564ece-3e31-426b-a07b-1b9e12d76d01-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:58 crc kubenswrapper[5120]: I0316 16:53:58.484625 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/a7564ece-3e31-426b-a07b-1b9e12d76d01-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:58 crc kubenswrapper[5120]: I0316 16:53:58.539415 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7564ece-3e31-426b-a07b-1b9e12d76d01-config-data" (OuterVolumeSpecName: "config-data") pod "a7564ece-3e31-426b-a07b-1b9e12d76d01" (UID: "a7564ece-3e31-426b-a07b-1b9e12d76d01"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:53:58 crc kubenswrapper[5120]: I0316 16:53:58.573322 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Mar 16 16:53:58 crc kubenswrapper[5120]: I0316 16:53:58.587465 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a7564ece-3e31-426b-a07b-1b9e12d76d01-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:53:58 crc kubenswrapper[5120]: I0316 16:53:58.710703 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a5396fe3-454e-4707-b185-5ad652c091da" path="/var/lib/kubelet/pods/a5396fe3-454e-4707-b185-5ad652c091da/volumes" Mar 16 16:53:58 crc kubenswrapper[5120]: I0316 16:53:58.711985 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:53:58 crc kubenswrapper[5120]: I0316 16:53:58.909056 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/placement-584b8687b4-5c6lr" Mar 16 16:53:58 crc kubenswrapper[5120]: I0316 16:53:58.917858 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-786c646546-49lhr" event={"ID":"a7564ece-3e31-426b-a07b-1b9e12d76d01","Type":"ContainerDied","Data":"e7a9453dd3686f237314323dbfa581ff64f6a12f3d9c911a9d967ff2c6214631"} Mar 16 16:53:58 crc kubenswrapper[5120]: I0316 16:53:58.917935 5120 scope.go:117] "RemoveContainer" containerID="90fa913e82e6a693d89c84435eb04f963c4d8b4c4ab762c7bcba095c8c48203e" Mar 16 16:53:58 crc kubenswrapper[5120]: I0316 16:53:58.917990 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-786c646546-49lhr" Mar 16 16:53:58 crc kubenswrapper[5120]: I0316 16:53:58.983000 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-7f78b864cb-6dgjh" Mar 16 16:53:58 crc kubenswrapper[5120]: I0316 16:53:58.985066 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a","Type":"ContainerStarted","Data":"bed82f9abe1ca53e6b5e475ed1549a3f0b682f1ae8442d502cbf08bcf4376794"} Mar 16 16:53:58 crc kubenswrapper[5120]: I0316 16:53:58.985106 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a","Type":"ContainerStarted","Data":"9654f347f34ca84be3b59cba15e0fac1abebc6019b67f4cedd8ccd90b36b6475"} Mar 16 16:53:58 crc kubenswrapper[5120]: I0316 16:53:58.985115 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a","Type":"ContainerStarted","Data":"f16bf633e499694d3f9b72799502d14d9077fcee087448051bbfe3c7ee1a846a"} Mar 16 16:53:58 crc kubenswrapper[5120]: I0316 16:53:58.998590 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-786c646546-49lhr"] Mar 16 16:53:59 crc kubenswrapper[5120]: I0316 16:53:59.012820 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-786c646546-49lhr"] Mar 16 16:53:59 crc kubenswrapper[5120]: I0316 16:53:59.036395 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-7d79f76d78-2wccd"] Mar 16 16:53:59 crc kubenswrapper[5120]: I0316 16:53:59.036943 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-7d79f76d78-2wccd" podUID="76725a9c-9344-4783-879a-a5ccfb8ba113" containerName="placement-log" containerID="cri-o://3c0d9b67b2189176f48613a02fe74c98727c6d53e854de247f7fef9df9ae9b9f" gracePeriod=30 Mar 16 16:53:59 crc kubenswrapper[5120]: I0316 16:53:59.036974 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-7d79f76d78-2wccd" podUID="76725a9c-9344-4783-879a-a5ccfb8ba113" containerName="placement-api" containerID="cri-o://cbad9909ed660642808dd41fc2eb57364913b31411887e63d5aa7e51bcfac5f2" gracePeriod=30 Mar 16 16:53:59 crc kubenswrapper[5120]: I0316 16:53:59.047796 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/swift-storage-0" podStartSLOduration=7.047777283 podStartE2EDuration="7.047777283s" podCreationTimestamp="2026-03-16 16:53:52 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:53:59.043169227 +0000 UTC m=+4941.197100894" watchObservedRunningTime="2026-03-16 16:53:59.047777283 +0000 UTC m=+4941.201708940" Mar 16 16:53:59 crc kubenswrapper[5120]: I0316 16:53:59.062135 5120 scope.go:117] "RemoveContainer" containerID="a925b16bc707dd1b850ad386d8896edc36bd1221a6b55a9c743fc74aaec36eec" Mar 16 16:53:59 crc kubenswrapper[5120]: I0316 16:53:59.111821 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-7f78b864cb-6dgjh"] Mar 16 16:53:59 crc kubenswrapper[5120]: I0316 16:53:59.130113 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-api-7f78b864cb-6dgjh"] Mar 16 16:53:59 crc kubenswrapper[5120]: I0316 16:53:59.269440 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-6cc498cb5c-zdb8r"] Mar 16 16:53:59 crc kubenswrapper[5120]: I0316 16:53:59.274960 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7564ece-3e31-426b-a07b-1b9e12d76d01" containerName="barbican-keystone-listener" Mar 16 16:53:59 crc kubenswrapper[5120]: I0316 16:53:59.274996 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7564ece-3e31-426b-a07b-1b9e12d76d01" containerName="barbican-keystone-listener" Mar 16 16:53:59 crc kubenswrapper[5120]: I0316 16:53:59.275081 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7564ece-3e31-426b-a07b-1b9e12d76d01" containerName="barbican-keystone-listener-log" Mar 16 16:53:59 crc kubenswrapper[5120]: I0316 16:53:59.275088 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7564ece-3e31-426b-a07b-1b9e12d76d01" containerName="barbican-keystone-listener-log" Mar 16 16:53:59 crc kubenswrapper[5120]: I0316 16:53:59.275840 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="a7564ece-3e31-426b-a07b-1b9e12d76d01" containerName="barbican-keystone-listener" Mar 16 16:53:59 crc kubenswrapper[5120]: I0316 16:53:59.275861 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="a7564ece-3e31-426b-a07b-1b9e12d76d01" containerName="barbican-keystone-listener-log" Mar 16 16:53:59 crc kubenswrapper[5120]: I0316 16:53:59.291957 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-6cc498cb5c-zdb8r"] Mar 16 16:53:59 crc kubenswrapper[5120]: I0316 16:53:59.292084 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6cc498cb5c-zdb8r" Mar 16 16:53:59 crc kubenswrapper[5120]: I0316 16:53:59.315799 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 16:53:59 crc kubenswrapper[5120]: W0316 16:53:59.316381 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod52f09603_9dff_4c67_a4b9_7bb162cd4a40.slice/crio-c4f324e42c0b81bd1e204585d79ead6b0e67a59f7cd24cb7c207ca50bd3d6066 WatchSource:0}: Error finding container c4f324e42c0b81bd1e204585d79ead6b0e67a59f7cd24cb7c207ca50bd3d6066: Status 404 returned error can't find the container with id c4f324e42c0b81bd1e204585d79ead6b0e67a59f7cd24cb7c207ca50bd3d6066 Mar 16 16:53:59 crc kubenswrapper[5120]: I0316 16:53:59.433702 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d20086a2-b461-4ca6-b442-f1c1782b833d-config\") pod \"dnsmasq-dnsmasq-6cc498cb5c-zdb8r\" (UID: \"d20086a2-b461-4ca6-b442-f1c1782b833d\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6cc498cb5c-zdb8r" Mar 16 16:53:59 crc kubenswrapper[5120]: I0316 16:53:59.434362 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9746c\" (UniqueName: \"kubernetes.io/projected/d20086a2-b461-4ca6-b442-f1c1782b833d-kube-api-access-9746c\") pod \"dnsmasq-dnsmasq-6cc498cb5c-zdb8r\" (UID: \"d20086a2-b461-4ca6-b442-f1c1782b833d\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6cc498cb5c-zdb8r" Mar 16 16:53:59 crc kubenswrapper[5120]: I0316 16:53:59.434398 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/d20086a2-b461-4ca6-b442-f1c1782b833d-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-6cc498cb5c-zdb8r\" (UID: \"d20086a2-b461-4ca6-b442-f1c1782b833d\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6cc498cb5c-zdb8r" Mar 16 16:53:59 crc kubenswrapper[5120]: I0316 16:53:59.434435 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/d20086a2-b461-4ca6-b442-f1c1782b833d-dns-swift-storage-0\") pod \"dnsmasq-dnsmasq-6cc498cb5c-zdb8r\" (UID: \"d20086a2-b461-4ca6-b442-f1c1782b833d\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6cc498cb5c-zdb8r" Mar 16 16:53:59 crc kubenswrapper[5120]: I0316 16:53:59.536599 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9746c\" (UniqueName: \"kubernetes.io/projected/d20086a2-b461-4ca6-b442-f1c1782b833d-kube-api-access-9746c\") pod \"dnsmasq-dnsmasq-6cc498cb5c-zdb8r\" (UID: \"d20086a2-b461-4ca6-b442-f1c1782b833d\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6cc498cb5c-zdb8r" Mar 16 16:53:59 crc kubenswrapper[5120]: I0316 16:53:59.537025 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/d20086a2-b461-4ca6-b442-f1c1782b833d-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-6cc498cb5c-zdb8r\" (UID: \"d20086a2-b461-4ca6-b442-f1c1782b833d\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6cc498cb5c-zdb8r" Mar 16 16:53:59 crc kubenswrapper[5120]: I0316 16:53:59.537912 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/d20086a2-b461-4ca6-b442-f1c1782b833d-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-6cc498cb5c-zdb8r\" (UID: \"d20086a2-b461-4ca6-b442-f1c1782b833d\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6cc498cb5c-zdb8r" Mar 16 16:53:59 crc kubenswrapper[5120]: I0316 16:53:59.538013 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/d20086a2-b461-4ca6-b442-f1c1782b833d-dns-swift-storage-0\") pod \"dnsmasq-dnsmasq-6cc498cb5c-zdb8r\" (UID: \"d20086a2-b461-4ca6-b442-f1c1782b833d\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6cc498cb5c-zdb8r" Mar 16 16:53:59 crc kubenswrapper[5120]: I0316 16:53:59.539197 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d20086a2-b461-4ca6-b442-f1c1782b833d-config\") pod \"dnsmasq-dnsmasq-6cc498cb5c-zdb8r\" (UID: \"d20086a2-b461-4ca6-b442-f1c1782b833d\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6cc498cb5c-zdb8r" Mar 16 16:53:59 crc kubenswrapper[5120]: I0316 16:53:59.539467 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/d20086a2-b461-4ca6-b442-f1c1782b833d-dns-swift-storage-0\") pod \"dnsmasq-dnsmasq-6cc498cb5c-zdb8r\" (UID: \"d20086a2-b461-4ca6-b442-f1c1782b833d\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6cc498cb5c-zdb8r" Mar 16 16:53:59 crc kubenswrapper[5120]: I0316 16:53:59.540050 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d20086a2-b461-4ca6-b442-f1c1782b833d-config\") pod \"dnsmasq-dnsmasq-6cc498cb5c-zdb8r\" (UID: \"d20086a2-b461-4ca6-b442-f1c1782b833d\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6cc498cb5c-zdb8r" Mar 16 16:53:59 crc kubenswrapper[5120]: I0316 16:53:59.557078 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9746c\" (UniqueName: \"kubernetes.io/projected/d20086a2-b461-4ca6-b442-f1c1782b833d-kube-api-access-9746c\") pod \"dnsmasq-dnsmasq-6cc498cb5c-zdb8r\" (UID: \"d20086a2-b461-4ca6-b442-f1c1782b833d\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6cc498cb5c-zdb8r" Mar 16 16:53:59 crc kubenswrapper[5120]: I0316 16:53:59.747971 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6cc498cb5c-zdb8r" Mar 16 16:53:59 crc kubenswrapper[5120]: I0316 16:53:59.995457 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstackclient" event={"ID":"52f09603-9dff-4c67-a4b9-7bb162cd4a40","Type":"ContainerStarted","Data":"5c97c398f0afe37fdf9742e5a29f3aceed602ae6a9ab68f801d5897d0ffcefea"} Mar 16 16:53:59 crc kubenswrapper[5120]: I0316 16:53:59.995514 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstackclient" event={"ID":"52f09603-9dff-4c67-a4b9-7bb162cd4a40","Type":"ContainerStarted","Data":"c4f324e42c0b81bd1e204585d79ead6b0e67a59f7cd24cb7c207ca50bd3d6066"} Mar 16 16:53:59 crc kubenswrapper[5120]: I0316 16:53:59.999498 5120 generic.go:358] "Generic (PLEG): container finished" podID="76725a9c-9344-4783-879a-a5ccfb8ba113" containerID="3c0d9b67b2189176f48613a02fe74c98727c6d53e854de247f7fef9df9ae9b9f" exitCode=143 Mar 16 16:53:59 crc kubenswrapper[5120]: I0316 16:53:59.999928 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-7d79f76d78-2wccd" event={"ID":"76725a9c-9344-4783-879a-a5ccfb8ba113","Type":"ContainerDied","Data":"3c0d9b67b2189176f48613a02fe74c98727c6d53e854de247f7fef9df9ae9b9f"} Mar 16 16:54:00 crc kubenswrapper[5120]: I0316 16:54:00.016019 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstackclient" podStartSLOduration=2.016002814 podStartE2EDuration="2.016002814s" podCreationTimestamp="2026-03-16 16:53:58 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:54:00.014215255 +0000 UTC m=+4942.168146922" watchObservedRunningTime="2026-03-16 16:54:00.016002814 +0000 UTC m=+4942.169934471" Mar 16 16:54:00 crc kubenswrapper[5120]: I0316 16:54:00.055803 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-marketplace-pcjdg"] Mar 16 16:54:00 crc kubenswrapper[5120]: I0316 16:54:00.067074 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-pcjdg"] Mar 16 16:54:00 crc kubenswrapper[5120]: I0316 16:54:00.075369 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-pcjdg" Mar 16 16:54:00 crc kubenswrapper[5120]: I0316 16:54:00.147589 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-infra/auto-csr-approver-29561334-bnxd6"] Mar 16 16:54:00 crc kubenswrapper[5120]: I0316 16:54:00.164581 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561334-bnxd6" Mar 16 16:54:00 crc kubenswrapper[5120]: I0316 16:54:00.165550 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/1bb10ee5-fec2-4258-a05c-d8d8d80b12b0-utilities\") pod \"redhat-marketplace-pcjdg\" (UID: \"1bb10ee5-fec2-4258-a05c-d8d8d80b12b0\") " pod="openshift-marketplace/redhat-marketplace-pcjdg" Mar 16 16:54:00 crc kubenswrapper[5120]: I0316 16:54:00.165963 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pggdh\" (UniqueName: \"kubernetes.io/projected/1bb10ee5-fec2-4258-a05c-d8d8d80b12b0-kube-api-access-pggdh\") pod \"redhat-marketplace-pcjdg\" (UID: \"1bb10ee5-fec2-4258-a05c-d8d8d80b12b0\") " pod="openshift-marketplace/redhat-marketplace-pcjdg" Mar 16 16:54:00 crc kubenswrapper[5120]: I0316 16:54:00.166110 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/1bb10ee5-fec2-4258-a05c-d8d8d80b12b0-catalog-content\") pod \"redhat-marketplace-pcjdg\" (UID: \"1bb10ee5-fec2-4258-a05c-d8d8d80b12b0\") " pod="openshift-marketplace/redhat-marketplace-pcjdg" Mar 16 16:54:00 crc kubenswrapper[5120]: I0316 16:54:00.168647 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-infra\"/\"csr-approver-sa-dockercfg-x2nsz\"" Mar 16 16:54:00 crc kubenswrapper[5120]: I0316 16:54:00.168930 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"kube-root-ca.crt\"" Mar 16 16:54:00 crc kubenswrapper[5120]: I0316 16:54:00.169148 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"openshift-service-ca.crt\"" Mar 16 16:54:00 crc kubenswrapper[5120]: I0316 16:54:00.172538 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561334-bnxd6"] Mar 16 16:54:00 crc kubenswrapper[5120]: W0316 16:54:00.253314 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd20086a2_b461_4ca6_b442_f1c1782b833d.slice/crio-a8987230d03694d6235677b29d5b9adf39deec54da8597a62c833b58c5ac92f7 WatchSource:0}: Error finding container a8987230d03694d6235677b29d5b9adf39deec54da8597a62c833b58c5ac92f7: Status 404 returned error can't find the container with id a8987230d03694d6235677b29d5b9adf39deec54da8597a62c833b58c5ac92f7 Mar 16 16:54:00 crc kubenswrapper[5120]: I0316 16:54:00.253652 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-6cc498cb5c-zdb8r"] Mar 16 16:54:00 crc kubenswrapper[5120]: I0316 16:54:00.272292 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pggdh\" (UniqueName: \"kubernetes.io/projected/1bb10ee5-fec2-4258-a05c-d8d8d80b12b0-kube-api-access-pggdh\") pod \"redhat-marketplace-pcjdg\" (UID: \"1bb10ee5-fec2-4258-a05c-d8d8d80b12b0\") " pod="openshift-marketplace/redhat-marketplace-pcjdg" Mar 16 16:54:00 crc kubenswrapper[5120]: I0316 16:54:00.272401 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/1bb10ee5-fec2-4258-a05c-d8d8d80b12b0-catalog-content\") pod \"redhat-marketplace-pcjdg\" (UID: \"1bb10ee5-fec2-4258-a05c-d8d8d80b12b0\") " pod="openshift-marketplace/redhat-marketplace-pcjdg" Mar 16 16:54:00 crc kubenswrapper[5120]: I0316 16:54:00.272536 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqzn7\" (UniqueName: \"kubernetes.io/projected/f5a15d20-fb3d-44d4-a5a6-287fc544f1a1-kube-api-access-sqzn7\") pod \"auto-csr-approver-29561334-bnxd6\" (UID: \"f5a15d20-fb3d-44d4-a5a6-287fc544f1a1\") " pod="openshift-infra/auto-csr-approver-29561334-bnxd6" Mar 16 16:54:00 crc kubenswrapper[5120]: I0316 16:54:00.272831 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/1bb10ee5-fec2-4258-a05c-d8d8d80b12b0-utilities\") pod \"redhat-marketplace-pcjdg\" (UID: \"1bb10ee5-fec2-4258-a05c-d8d8d80b12b0\") " pod="openshift-marketplace/redhat-marketplace-pcjdg" Mar 16 16:54:00 crc kubenswrapper[5120]: I0316 16:54:00.273396 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/1bb10ee5-fec2-4258-a05c-d8d8d80b12b0-utilities\") pod \"redhat-marketplace-pcjdg\" (UID: \"1bb10ee5-fec2-4258-a05c-d8d8d80b12b0\") " pod="openshift-marketplace/redhat-marketplace-pcjdg" Mar 16 16:54:00 crc kubenswrapper[5120]: I0316 16:54:00.273413 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/1bb10ee5-fec2-4258-a05c-d8d8d80b12b0-catalog-content\") pod \"redhat-marketplace-pcjdg\" (UID: \"1bb10ee5-fec2-4258-a05c-d8d8d80b12b0\") " pod="openshift-marketplace/redhat-marketplace-pcjdg" Mar 16 16:54:00 crc kubenswrapper[5120]: I0316 16:54:00.307822 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pggdh\" (UniqueName: \"kubernetes.io/projected/1bb10ee5-fec2-4258-a05c-d8d8d80b12b0-kube-api-access-pggdh\") pod \"redhat-marketplace-pcjdg\" (UID: \"1bb10ee5-fec2-4258-a05c-d8d8d80b12b0\") " pod="openshift-marketplace/redhat-marketplace-pcjdg" Mar 16 16:54:00 crc kubenswrapper[5120]: I0316 16:54:00.376430 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sqzn7\" (UniqueName: \"kubernetes.io/projected/f5a15d20-fb3d-44d4-a5a6-287fc544f1a1-kube-api-access-sqzn7\") pod \"auto-csr-approver-29561334-bnxd6\" (UID: \"f5a15d20-fb3d-44d4-a5a6-287fc544f1a1\") " pod="openshift-infra/auto-csr-approver-29561334-bnxd6" Mar 16 16:54:00 crc kubenswrapper[5120]: I0316 16:54:00.401695 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqzn7\" (UniqueName: \"kubernetes.io/projected/f5a15d20-fb3d-44d4-a5a6-287fc544f1a1-kube-api-access-sqzn7\") pod \"auto-csr-approver-29561334-bnxd6\" (UID: \"f5a15d20-fb3d-44d4-a5a6-287fc544f1a1\") " pod="openshift-infra/auto-csr-approver-29561334-bnxd6" Mar 16 16:54:00 crc kubenswrapper[5120]: I0316 16:54:00.411675 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561334-bnxd6" Mar 16 16:54:00 crc kubenswrapper[5120]: I0316 16:54:00.423645 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-pcjdg" Mar 16 16:54:00 crc kubenswrapper[5120]: I0316 16:54:00.563335 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Mar 16 16:54:00 crc kubenswrapper[5120]: I0316 16:54:00.568751 5120 status_manager.go:905] "Pod was deleted and then recreated, skipping status update" pod="openstack-kuttl-tests/openstackclient" oldPodUID="74ab0944-2f5c-4a9d-a848-8e2a8d17d9cd" podUID="52f09603-9dff-4c67-a4b9-7bb162cd4a40" Mar 16 16:54:00 crc kubenswrapper[5120]: I0316 16:54:00.582915 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/74ab0944-2f5c-4a9d-a848-8e2a8d17d9cd-openstack-config-secret\") pod \"74ab0944-2f5c-4a9d-a848-8e2a8d17d9cd\" (UID: \"74ab0944-2f5c-4a9d-a848-8e2a8d17d9cd\") " Mar 16 16:54:00 crc kubenswrapper[5120]: I0316 16:54:00.584427 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/74ab0944-2f5c-4a9d-a848-8e2a8d17d9cd-openstack-config\") pod \"74ab0944-2f5c-4a9d-a848-8e2a8d17d9cd\" (UID: \"74ab0944-2f5c-4a9d-a848-8e2a8d17d9cd\") " Mar 16 16:54:00 crc kubenswrapper[5120]: I0316 16:54:00.687856 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t6gg2\" (UniqueName: \"kubernetes.io/projected/74ab0944-2f5c-4a9d-a848-8e2a8d17d9cd-kube-api-access-t6gg2\") pod \"74ab0944-2f5c-4a9d-a848-8e2a8d17d9cd\" (UID: \"74ab0944-2f5c-4a9d-a848-8e2a8d17d9cd\") " Mar 16 16:54:00 crc kubenswrapper[5120]: I0316 16:54:00.687958 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/74ab0944-2f5c-4a9d-a848-8e2a8d17d9cd-combined-ca-bundle\") pod \"74ab0944-2f5c-4a9d-a848-8e2a8d17d9cd\" (UID: \"74ab0944-2f5c-4a9d-a848-8e2a8d17d9cd\") " Mar 16 16:54:00 crc kubenswrapper[5120]: I0316 16:54:00.728381 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74ab0944-2f5c-4a9d-a848-8e2a8d17d9cd-kube-api-access-t6gg2" (OuterVolumeSpecName: "kube-api-access-t6gg2") pod "74ab0944-2f5c-4a9d-a848-8e2a8d17d9cd" (UID: "74ab0944-2f5c-4a9d-a848-8e2a8d17d9cd"). InnerVolumeSpecName "kube-api-access-t6gg2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:54:00 crc kubenswrapper[5120]: I0316 16:54:00.793064 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t6gg2\" (UniqueName: \"kubernetes.io/projected/74ab0944-2f5c-4a9d-a848-8e2a8d17d9cd-kube-api-access-t6gg2\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:00 crc kubenswrapper[5120]: I0316 16:54:00.803065 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74ab0944-2f5c-4a9d-a848-8e2a8d17d9cd-openstack-config" (OuterVolumeSpecName: "openstack-config") pod "74ab0944-2f5c-4a9d-a848-8e2a8d17d9cd" (UID: "74ab0944-2f5c-4a9d-a848-8e2a8d17d9cd"). InnerVolumeSpecName "openstack-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:54:00 crc kubenswrapper[5120]: I0316 16:54:00.807993 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74ab0944-2f5c-4a9d-a848-8e2a8d17d9cd-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "74ab0944-2f5c-4a9d-a848-8e2a8d17d9cd" (UID: "74ab0944-2f5c-4a9d-a848-8e2a8d17d9cd"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:54:00 crc kubenswrapper[5120]: I0316 16:54:00.857384 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a7564ece-3e31-426b-a07b-1b9e12d76d01" path="/var/lib/kubelet/pods/a7564ece-3e31-426b-a07b-1b9e12d76d01/volumes" Mar 16 16:54:00 crc kubenswrapper[5120]: I0316 16:54:00.858099 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c06f24f9-95b0-4a92-ad3a-6075764151ed" path="/var/lib/kubelet/pods/c06f24f9-95b0-4a92-ad3a-6075764151ed/volumes" Mar 16 16:54:00 crc kubenswrapper[5120]: I0316 16:54:00.860379 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74ab0944-2f5c-4a9d-a848-8e2a8d17d9cd-openstack-config-secret" (OuterVolumeSpecName: "openstack-config-secret") pod "74ab0944-2f5c-4a9d-a848-8e2a8d17d9cd" (UID: "74ab0944-2f5c-4a9d-a848-8e2a8d17d9cd"). InnerVolumeSpecName "openstack-config-secret". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:54:00 crc kubenswrapper[5120]: I0316 16:54:00.901844 5120 reconciler_common.go:299] "Volume detached for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/74ab0944-2f5c-4a9d-a848-8e2a8d17d9cd-openstack-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:00 crc kubenswrapper[5120]: I0316 16:54:00.901879 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/74ab0944-2f5c-4a9d-a848-8e2a8d17d9cd-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:00 crc kubenswrapper[5120]: I0316 16:54:00.901888 5120 reconciler_common.go:299] "Volume detached for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/74ab0944-2f5c-4a9d-a848-8e2a8d17d9cd-openstack-config-secret\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:01 crc kubenswrapper[5120]: I0316 16:54:01.016509 5120 generic.go:358] "Generic (PLEG): container finished" podID="c27e11d8-d691-4894-995b-b4855e61ab80" containerID="94a0984603d5bdc59410680ea92bf614dd65b62b0534a0dff6970ab8a0e20e27" exitCode=0 Mar 16 16:54:01 crc kubenswrapper[5120]: I0316 16:54:01.023055 5120 generic.go:358] "Generic (PLEG): container finished" podID="74ab0944-2f5c-4a9d-a848-8e2a8d17d9cd" containerID="c66e427fd88f88ad048e67d49836dce5591eefc18c9879eaec88a4f93093cca2" exitCode=137 Mar 16 16:54:01 crc kubenswrapper[5120]: I0316 16:54:01.023288 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Mar 16 16:54:01 crc kubenswrapper[5120]: I0316 16:54:01.028101 5120 generic.go:358] "Generic (PLEG): container finished" podID="d20086a2-b461-4ca6-b442-f1c1782b833d" containerID="37f14533cd91db09de0ccb17ead0afa80075cb630a2238eadc581f683dd6e89e" exitCode=0 Mar 16 16:54:01 crc kubenswrapper[5120]: I0316 16:54:01.040934 5120 status_manager.go:905] "Pod was deleted and then recreated, skipping status update" pod="openstack-kuttl-tests/openstackclient" oldPodUID="74ab0944-2f5c-4a9d-a848-8e2a8d17d9cd" podUID="52f09603-9dff-4c67-a4b9-7bb162cd4a40" Mar 16 16:54:01 crc kubenswrapper[5120]: I0316 16:54:01.161444 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-74597bb8cb-kbqx7" event={"ID":"c27e11d8-d691-4894-995b-b4855e61ab80","Type":"ContainerDied","Data":"94a0984603d5bdc59410680ea92bf614dd65b62b0534a0dff6970ab8a0e20e27"} Mar 16 16:54:01 crc kubenswrapper[5120]: I0316 16:54:01.161813 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-74597bb8cb-kbqx7" event={"ID":"c27e11d8-d691-4894-995b-b4855e61ab80","Type":"ContainerDied","Data":"322cd78bae04fbbedc6bc5edcab8f12010b854ad044b9317282ee8705689df19"} Mar 16 16:54:01 crc kubenswrapper[5120]: I0316 16:54:01.162065 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="322cd78bae04fbbedc6bc5edcab8f12010b854ad044b9317282ee8705689df19" Mar 16 16:54:01 crc kubenswrapper[5120]: I0316 16:54:01.162139 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6cc498cb5c-zdb8r" event={"ID":"d20086a2-b461-4ca6-b442-f1c1782b833d","Type":"ContainerDied","Data":"37f14533cd91db09de0ccb17ead0afa80075cb630a2238eadc581f683dd6e89e"} Mar 16 16:54:01 crc kubenswrapper[5120]: I0316 16:54:01.162243 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6cc498cb5c-zdb8r" event={"ID":"d20086a2-b461-4ca6-b442-f1c1782b833d","Type":"ContainerStarted","Data":"a8987230d03694d6235677b29d5b9adf39deec54da8597a62c833b58c5ac92f7"} Mar 16 16:54:01 crc kubenswrapper[5120]: I0316 16:54:01.162491 5120 scope.go:117] "RemoveContainer" containerID="c66e427fd88f88ad048e67d49836dce5591eefc18c9879eaec88a4f93093cca2" Mar 16 16:54:01 crc kubenswrapper[5120]: I0316 16:54:01.183350 5120 status_manager.go:905] "Pod was deleted and then recreated, skipping status update" pod="openstack-kuttl-tests/openstackclient" oldPodUID="74ab0944-2f5c-4a9d-a848-8e2a8d17d9cd" podUID="52f09603-9dff-4c67-a4b9-7bb162cd4a40" Mar 16 16:54:01 crc kubenswrapper[5120]: I0316 16:54:01.200556 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-74597bb8cb-kbqx7" Mar 16 16:54:01 crc kubenswrapper[5120]: I0316 16:54:01.213888 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c27e11d8-d691-4894-995b-b4855e61ab80-scripts\") pod \"c27e11d8-d691-4894-995b-b4855e61ab80\" (UID: \"c27e11d8-d691-4894-995b-b4855e61ab80\") " Mar 16 16:54:01 crc kubenswrapper[5120]: I0316 16:54:01.213922 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/c27e11d8-d691-4894-995b-b4855e61ab80-fernet-keys\") pod \"c27e11d8-d691-4894-995b-b4855e61ab80\" (UID: \"c27e11d8-d691-4894-995b-b4855e61ab80\") " Mar 16 16:54:01 crc kubenswrapper[5120]: I0316 16:54:01.214037 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c27e11d8-d691-4894-995b-b4855e61ab80-config-data\") pod \"c27e11d8-d691-4894-995b-b4855e61ab80\" (UID: \"c27e11d8-d691-4894-995b-b4855e61ab80\") " Mar 16 16:54:01 crc kubenswrapper[5120]: I0316 16:54:01.214080 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/c27e11d8-d691-4894-995b-b4855e61ab80-public-tls-certs\") pod \"c27e11d8-d691-4894-995b-b4855e61ab80\" (UID: \"c27e11d8-d691-4894-995b-b4855e61ab80\") " Mar 16 16:54:01 crc kubenswrapper[5120]: I0316 16:54:01.231253 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c27e11d8-d691-4894-995b-b4855e61ab80-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "c27e11d8-d691-4894-995b-b4855e61ab80" (UID: "c27e11d8-d691-4894-995b-b4855e61ab80"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:54:01 crc kubenswrapper[5120]: I0316 16:54:01.234976 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c27e11d8-d691-4894-995b-b4855e61ab80-scripts" (OuterVolumeSpecName: "scripts") pod "c27e11d8-d691-4894-995b-b4855e61ab80" (UID: "c27e11d8-d691-4894-995b-b4855e61ab80"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:54:01 crc kubenswrapper[5120]: I0316 16:54:01.272068 5120 scope.go:117] "RemoveContainer" containerID="c66e427fd88f88ad048e67d49836dce5591eefc18c9879eaec88a4f93093cca2" Mar 16 16:54:01 crc kubenswrapper[5120]: E0316 16:54:01.272569 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c66e427fd88f88ad048e67d49836dce5591eefc18c9879eaec88a4f93093cca2\": container with ID starting with c66e427fd88f88ad048e67d49836dce5591eefc18c9879eaec88a4f93093cca2 not found: ID does not exist" containerID="c66e427fd88f88ad048e67d49836dce5591eefc18c9879eaec88a4f93093cca2" Mar 16 16:54:01 crc kubenswrapper[5120]: I0316 16:54:01.272608 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c66e427fd88f88ad048e67d49836dce5591eefc18c9879eaec88a4f93093cca2"} err="failed to get container status \"c66e427fd88f88ad048e67d49836dce5591eefc18c9879eaec88a4f93093cca2\": rpc error: code = NotFound desc = could not find container \"c66e427fd88f88ad048e67d49836dce5591eefc18c9879eaec88a4f93093cca2\": container with ID starting with c66e427fd88f88ad048e67d49836dce5591eefc18c9879eaec88a4f93093cca2 not found: ID does not exist" Mar 16 16:54:01 crc kubenswrapper[5120]: I0316 16:54:01.321727 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c27e11d8-d691-4894-995b-b4855e61ab80-combined-ca-bundle\") pod \"c27e11d8-d691-4894-995b-b4855e61ab80\" (UID: \"c27e11d8-d691-4894-995b-b4855e61ab80\") " Mar 16 16:54:01 crc kubenswrapper[5120]: I0316 16:54:01.321865 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/c27e11d8-d691-4894-995b-b4855e61ab80-credential-keys\") pod \"c27e11d8-d691-4894-995b-b4855e61ab80\" (UID: \"c27e11d8-d691-4894-995b-b4855e61ab80\") " Mar 16 16:54:01 crc kubenswrapper[5120]: I0316 16:54:01.321966 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/c27e11d8-d691-4894-995b-b4855e61ab80-internal-tls-certs\") pod \"c27e11d8-d691-4894-995b-b4855e61ab80\" (UID: \"c27e11d8-d691-4894-995b-b4855e61ab80\") " Mar 16 16:54:01 crc kubenswrapper[5120]: I0316 16:54:01.322005 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s7gcs\" (UniqueName: \"kubernetes.io/projected/c27e11d8-d691-4894-995b-b4855e61ab80-kube-api-access-s7gcs\") pod \"c27e11d8-d691-4894-995b-b4855e61ab80\" (UID: \"c27e11d8-d691-4894-995b-b4855e61ab80\") " Mar 16 16:54:01 crc kubenswrapper[5120]: I0316 16:54:01.323795 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c27e11d8-d691-4894-995b-b4855e61ab80-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:01 crc kubenswrapper[5120]: I0316 16:54:01.323824 5120 reconciler_common.go:299] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/c27e11d8-d691-4894-995b-b4855e61ab80-fernet-keys\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:01 crc kubenswrapper[5120]: I0316 16:54:01.324925 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-pcjdg"] Mar 16 16:54:01 crc kubenswrapper[5120]: I0316 16:54:01.331003 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c27e11d8-d691-4894-995b-b4855e61ab80-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "c27e11d8-d691-4894-995b-b4855e61ab80" (UID: "c27e11d8-d691-4894-995b-b4855e61ab80"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:54:01 crc kubenswrapper[5120]: I0316 16:54:01.332239 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c27e11d8-d691-4894-995b-b4855e61ab80-kube-api-access-s7gcs" (OuterVolumeSpecName: "kube-api-access-s7gcs") pod "c27e11d8-d691-4894-995b-b4855e61ab80" (UID: "c27e11d8-d691-4894-995b-b4855e61ab80"). InnerVolumeSpecName "kube-api-access-s7gcs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:54:01 crc kubenswrapper[5120]: I0316 16:54:01.343492 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561334-bnxd6"] Mar 16 16:54:01 crc kubenswrapper[5120]: I0316 16:54:01.377897 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c27e11d8-d691-4894-995b-b4855e61ab80-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "c27e11d8-d691-4894-995b-b4855e61ab80" (UID: "c27e11d8-d691-4894-995b-b4855e61ab80"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:54:01 crc kubenswrapper[5120]: I0316 16:54:01.391448 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c27e11d8-d691-4894-995b-b4855e61ab80-config-data" (OuterVolumeSpecName: "config-data") pod "c27e11d8-d691-4894-995b-b4855e61ab80" (UID: "c27e11d8-d691-4894-995b-b4855e61ab80"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:54:01 crc kubenswrapper[5120]: I0316 16:54:01.394973 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c27e11d8-d691-4894-995b-b4855e61ab80-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "c27e11d8-d691-4894-995b-b4855e61ab80" (UID: "c27e11d8-d691-4894-995b-b4855e61ab80"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:54:01 crc kubenswrapper[5120]: I0316 16:54:01.429931 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c27e11d8-d691-4894-995b-b4855e61ab80-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:01 crc kubenswrapper[5120]: I0316 16:54:01.429959 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/c27e11d8-d691-4894-995b-b4855e61ab80-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:01 crc kubenswrapper[5120]: I0316 16:54:01.429968 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c27e11d8-d691-4894-995b-b4855e61ab80-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:01 crc kubenswrapper[5120]: I0316 16:54:01.429978 5120 reconciler_common.go:299] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/c27e11d8-d691-4894-995b-b4855e61ab80-credential-keys\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:01 crc kubenswrapper[5120]: I0316 16:54:01.429987 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s7gcs\" (UniqueName: \"kubernetes.io/projected/c27e11d8-d691-4894-995b-b4855e61ab80-kube-api-access-s7gcs\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:01 crc kubenswrapper[5120]: I0316 16:54:01.435879 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c27e11d8-d691-4894-995b-b4855e61ab80-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "c27e11d8-d691-4894-995b-b4855e61ab80" (UID: "c27e11d8-d691-4894-995b-b4855e61ab80"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:54:01 crc kubenswrapper[5120]: I0316 16:54:01.532524 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/c27e11d8-d691-4894-995b-b4855e61ab80-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:02 crc kubenswrapper[5120]: I0316 16:54:02.045320 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6cc498cb5c-zdb8r" event={"ID":"d20086a2-b461-4ca6-b442-f1c1782b833d","Type":"ContainerStarted","Data":"0beab2129e4c6e5de483a10f0e3da05c1da16b9a83182d703c4ee6fda502697e"} Mar 16 16:54:02 crc kubenswrapper[5120]: I0316 16:54:02.046484 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6cc498cb5c-zdb8r" Mar 16 16:54:02 crc kubenswrapper[5120]: I0316 16:54:02.047889 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561334-bnxd6" event={"ID":"f5a15d20-fb3d-44d4-a5a6-287fc544f1a1","Type":"ContainerStarted","Data":"6a7bb51ed87cb3dc3f5cee299bf56d863645b30bc7c89e2d09514c9c43e45b24"} Mar 16 16:54:02 crc kubenswrapper[5120]: I0316 16:54:02.050293 5120 generic.go:358] "Generic (PLEG): container finished" podID="1bb10ee5-fec2-4258-a05c-d8d8d80b12b0" containerID="a7fc62a0946b9d5f9cbb8bfdfb055d47151f7a2dabdf1f86969084a4fcff0914" exitCode=0 Mar 16 16:54:02 crc kubenswrapper[5120]: I0316 16:54:02.050625 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-74597bb8cb-kbqx7" Mar 16 16:54:02 crc kubenswrapper[5120]: I0316 16:54:02.050863 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-pcjdg" event={"ID":"1bb10ee5-fec2-4258-a05c-d8d8d80b12b0","Type":"ContainerDied","Data":"a7fc62a0946b9d5f9cbb8bfdfb055d47151f7a2dabdf1f86969084a4fcff0914"} Mar 16 16:54:02 crc kubenswrapper[5120]: I0316 16:54:02.052166 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-pcjdg" event={"ID":"1bb10ee5-fec2-4258-a05c-d8d8d80b12b0","Type":"ContainerStarted","Data":"e2b28c340795cc4e66b8fc50da7880d2de020af09266f38c659fc7b08355e6a9"} Mar 16 16:54:02 crc kubenswrapper[5120]: I0316 16:54:02.084526 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:54:02 crc kubenswrapper[5120]: I0316 16:54:02.086743 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6cc498cb5c-zdb8r" podStartSLOduration=3.086719861 podStartE2EDuration="3.086719861s" podCreationTimestamp="2026-03-16 16:53:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:54:02.068362459 +0000 UTC m=+4944.222294116" watchObservedRunningTime="2026-03-16 16:54:02.086719861 +0000 UTC m=+4944.240651518" Mar 16 16:54:02 crc kubenswrapper[5120]: I0316 16:54:02.125525 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-74597bb8cb-kbqx7"] Mar 16 16:54:02 crc kubenswrapper[5120]: I0316 16:54:02.140298 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-74597bb8cb-kbqx7"] Mar 16 16:54:02 crc kubenswrapper[5120]: I0316 16:54:02.233477 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/placement-7d79f76d78-2wccd" podUID="76725a9c-9344-4783-879a-a5ccfb8ba113" containerName="placement-log" probeResult="failure" output="Get \"https://10.217.1.242:8778/\": read tcp 10.217.0.2:48882->10.217.1.242:8778: read: connection reset by peer" Mar 16 16:54:02 crc kubenswrapper[5120]: I0316 16:54:02.676141 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="74ab0944-2f5c-4a9d-a848-8e2a8d17d9cd" path="/var/lib/kubelet/pods/74ab0944-2f5c-4a9d-a848-8e2a8d17d9cd/volumes" Mar 16 16:54:02 crc kubenswrapper[5120]: I0316 16:54:02.676689 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c27e11d8-d691-4894-995b-b4855e61ab80" path="/var/lib/kubelet/pods/c27e11d8-d691-4894-995b-b4855e61ab80/volumes" Mar 16 16:54:02 crc kubenswrapper[5120]: I0316 16:54:02.767514 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-7d79f76d78-2wccd" Mar 16 16:54:02 crc kubenswrapper[5120]: I0316 16:54:02.865963 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/76725a9c-9344-4783-879a-a5ccfb8ba113-combined-ca-bundle\") pod \"76725a9c-9344-4783-879a-a5ccfb8ba113\" (UID: \"76725a9c-9344-4783-879a-a5ccfb8ba113\") " Mar 16 16:54:02 crc kubenswrapper[5120]: I0316 16:54:02.866006 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/76725a9c-9344-4783-879a-a5ccfb8ba113-public-tls-certs\") pod \"76725a9c-9344-4783-879a-a5ccfb8ba113\" (UID: \"76725a9c-9344-4783-879a-a5ccfb8ba113\") " Mar 16 16:54:02 crc kubenswrapper[5120]: I0316 16:54:02.866026 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/76725a9c-9344-4783-879a-a5ccfb8ba113-internal-tls-certs\") pod \"76725a9c-9344-4783-879a-a5ccfb8ba113\" (UID: \"76725a9c-9344-4783-879a-a5ccfb8ba113\") " Mar 16 16:54:02 crc kubenswrapper[5120]: I0316 16:54:02.866252 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/76725a9c-9344-4783-879a-a5ccfb8ba113-config-data\") pod \"76725a9c-9344-4783-879a-a5ccfb8ba113\" (UID: \"76725a9c-9344-4783-879a-a5ccfb8ba113\") " Mar 16 16:54:02 crc kubenswrapper[5120]: I0316 16:54:02.866313 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/76725a9c-9344-4783-879a-a5ccfb8ba113-logs\") pod \"76725a9c-9344-4783-879a-a5ccfb8ba113\" (UID: \"76725a9c-9344-4783-879a-a5ccfb8ba113\") " Mar 16 16:54:02 crc kubenswrapper[5120]: I0316 16:54:02.866782 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76725a9c-9344-4783-879a-a5ccfb8ba113-logs" (OuterVolumeSpecName: "logs") pod "76725a9c-9344-4783-879a-a5ccfb8ba113" (UID: "76725a9c-9344-4783-879a-a5ccfb8ba113"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:54:02 crc kubenswrapper[5120]: I0316 16:54:02.866845 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/76725a9c-9344-4783-879a-a5ccfb8ba113-scripts\") pod \"76725a9c-9344-4783-879a-a5ccfb8ba113\" (UID: \"76725a9c-9344-4783-879a-a5ccfb8ba113\") " Mar 16 16:54:02 crc kubenswrapper[5120]: I0316 16:54:02.867268 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-584mp\" (UniqueName: \"kubernetes.io/projected/76725a9c-9344-4783-879a-a5ccfb8ba113-kube-api-access-584mp\") pod \"76725a9c-9344-4783-879a-a5ccfb8ba113\" (UID: \"76725a9c-9344-4783-879a-a5ccfb8ba113\") " Mar 16 16:54:02 crc kubenswrapper[5120]: I0316 16:54:02.867895 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/76725a9c-9344-4783-879a-a5ccfb8ba113-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:02 crc kubenswrapper[5120]: I0316 16:54:02.887842 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/76725a9c-9344-4783-879a-a5ccfb8ba113-scripts" (OuterVolumeSpecName: "scripts") pod "76725a9c-9344-4783-879a-a5ccfb8ba113" (UID: "76725a9c-9344-4783-879a-a5ccfb8ba113"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:54:02 crc kubenswrapper[5120]: I0316 16:54:02.901753 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76725a9c-9344-4783-879a-a5ccfb8ba113-kube-api-access-584mp" (OuterVolumeSpecName: "kube-api-access-584mp") pod "76725a9c-9344-4783-879a-a5ccfb8ba113" (UID: "76725a9c-9344-4783-879a-a5ccfb8ba113"). InnerVolumeSpecName "kube-api-access-584mp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:54:02 crc kubenswrapper[5120]: I0316 16:54:02.970452 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/76725a9c-9344-4783-879a-a5ccfb8ba113-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:02 crc kubenswrapper[5120]: I0316 16:54:02.970496 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-584mp\" (UniqueName: \"kubernetes.io/projected/76725a9c-9344-4783-879a-a5ccfb8ba113-kube-api-access-584mp\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:02 crc kubenswrapper[5120]: I0316 16:54:02.973948 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/76725a9c-9344-4783-879a-a5ccfb8ba113-config-data" (OuterVolumeSpecName: "config-data") pod "76725a9c-9344-4783-879a-a5ccfb8ba113" (UID: "76725a9c-9344-4783-879a-a5ccfb8ba113"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:54:02 crc kubenswrapper[5120]: I0316 16:54:02.986729 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/76725a9c-9344-4783-879a-a5ccfb8ba113-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "76725a9c-9344-4783-879a-a5ccfb8ba113" (UID: "76725a9c-9344-4783-879a-a5ccfb8ba113"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:54:03 crc kubenswrapper[5120]: I0316 16:54:03.053368 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/76725a9c-9344-4783-879a-a5ccfb8ba113-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "76725a9c-9344-4783-879a-a5ccfb8ba113" (UID: "76725a9c-9344-4783-879a-a5ccfb8ba113"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:54:03 crc kubenswrapper[5120]: I0316 16:54:03.068023 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/76725a9c-9344-4783-879a-a5ccfb8ba113-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "76725a9c-9344-4783-879a-a5ccfb8ba113" (UID: "76725a9c-9344-4783-879a-a5ccfb8ba113"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:54:03 crc kubenswrapper[5120]: I0316 16:54:03.069204 5120 generic.go:358] "Generic (PLEG): container finished" podID="76725a9c-9344-4783-879a-a5ccfb8ba113" containerID="cbad9909ed660642808dd41fc2eb57364913b31411887e63d5aa7e51bcfac5f2" exitCode=0 Mar 16 16:54:03 crc kubenswrapper[5120]: I0316 16:54:03.069326 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-7d79f76d78-2wccd" Mar 16 16:54:03 crc kubenswrapper[5120]: I0316 16:54:03.071071 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-7d79f76d78-2wccd" event={"ID":"76725a9c-9344-4783-879a-a5ccfb8ba113","Type":"ContainerDied","Data":"cbad9909ed660642808dd41fc2eb57364913b31411887e63d5aa7e51bcfac5f2"} Mar 16 16:54:03 crc kubenswrapper[5120]: I0316 16:54:03.071112 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-7d79f76d78-2wccd" event={"ID":"76725a9c-9344-4783-879a-a5ccfb8ba113","Type":"ContainerDied","Data":"5f72c22d4be62bc31587692dcc838788d79e8c75db1a6a0ccc3277bae2fc488c"} Mar 16 16:54:03 crc kubenswrapper[5120]: I0316 16:54:03.071128 5120 scope.go:117] "RemoveContainer" containerID="cbad9909ed660642808dd41fc2eb57364913b31411887e63d5aa7e51bcfac5f2" Mar 16 16:54:03 crc kubenswrapper[5120]: I0316 16:54:03.072638 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/76725a9c-9344-4783-879a-a5ccfb8ba113-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:03 crc kubenswrapper[5120]: I0316 16:54:03.072669 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/76725a9c-9344-4783-879a-a5ccfb8ba113-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:03 crc kubenswrapper[5120]: I0316 16:54:03.072683 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/76725a9c-9344-4783-879a-a5ccfb8ba113-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:03 crc kubenswrapper[5120]: I0316 16:54:03.072696 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/76725a9c-9344-4783-879a-a5ccfb8ba113-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:03 crc kubenswrapper[5120]: I0316 16:54:03.183630 5120 scope.go:117] "RemoveContainer" containerID="3c0d9b67b2189176f48613a02fe74c98727c6d53e854de247f7fef9df9ae9b9f" Mar 16 16:54:03 crc kubenswrapper[5120]: I0316 16:54:03.188214 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-7d79f76d78-2wccd"] Mar 16 16:54:03 crc kubenswrapper[5120]: I0316 16:54:03.203395 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-7d79f76d78-2wccd"] Mar 16 16:54:03 crc kubenswrapper[5120]: I0316 16:54:03.216193 5120 scope.go:117] "RemoveContainer" containerID="cbad9909ed660642808dd41fc2eb57364913b31411887e63d5aa7e51bcfac5f2" Mar 16 16:54:03 crc kubenswrapper[5120]: E0316 16:54:03.217001 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cbad9909ed660642808dd41fc2eb57364913b31411887e63d5aa7e51bcfac5f2\": container with ID starting with cbad9909ed660642808dd41fc2eb57364913b31411887e63d5aa7e51bcfac5f2 not found: ID does not exist" containerID="cbad9909ed660642808dd41fc2eb57364913b31411887e63d5aa7e51bcfac5f2" Mar 16 16:54:03 crc kubenswrapper[5120]: I0316 16:54:03.217074 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cbad9909ed660642808dd41fc2eb57364913b31411887e63d5aa7e51bcfac5f2"} err="failed to get container status \"cbad9909ed660642808dd41fc2eb57364913b31411887e63d5aa7e51bcfac5f2\": rpc error: code = NotFound desc = could not find container \"cbad9909ed660642808dd41fc2eb57364913b31411887e63d5aa7e51bcfac5f2\": container with ID starting with cbad9909ed660642808dd41fc2eb57364913b31411887e63d5aa7e51bcfac5f2 not found: ID does not exist" Mar 16 16:54:03 crc kubenswrapper[5120]: I0316 16:54:03.217128 5120 scope.go:117] "RemoveContainer" containerID="3c0d9b67b2189176f48613a02fe74c98727c6d53e854de247f7fef9df9ae9b9f" Mar 16 16:54:03 crc kubenswrapper[5120]: E0316 16:54:03.217620 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3c0d9b67b2189176f48613a02fe74c98727c6d53e854de247f7fef9df9ae9b9f\": container with ID starting with 3c0d9b67b2189176f48613a02fe74c98727c6d53e854de247f7fef9df9ae9b9f not found: ID does not exist" containerID="3c0d9b67b2189176f48613a02fe74c98727c6d53e854de247f7fef9df9ae9b9f" Mar 16 16:54:03 crc kubenswrapper[5120]: I0316 16:54:03.217668 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c0d9b67b2189176f48613a02fe74c98727c6d53e854de247f7fef9df9ae9b9f"} err="failed to get container status \"3c0d9b67b2189176f48613a02fe74c98727c6d53e854de247f7fef9df9ae9b9f\": rpc error: code = NotFound desc = could not find container \"3c0d9b67b2189176f48613a02fe74c98727c6d53e854de247f7fef9df9ae9b9f\": container with ID starting with 3c0d9b67b2189176f48613a02fe74c98727c6d53e854de247f7fef9df9ae9b9f not found: ID does not exist" Mar 16 16:54:04 crc kubenswrapper[5120]: I0316 16:54:04.082833 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-pcjdg" event={"ID":"1bb10ee5-fec2-4258-a05c-d8d8d80b12b0","Type":"ContainerStarted","Data":"b6cd74ed07e8d78c2ea7d8ef8236109d404b57fa55a58013e98af69c64c34049"} Mar 16 16:54:04 crc kubenswrapper[5120]: I0316 16:54:04.677199 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="76725a9c-9344-4783-879a-a5ccfb8ba113" path="/var/lib/kubelet/pods/76725a9c-9344-4783-879a-a5ccfb8ba113/volumes" Mar 16 16:54:05 crc kubenswrapper[5120]: I0316 16:54:05.100290 5120 generic.go:358] "Generic (PLEG): container finished" podID="f5a15d20-fb3d-44d4-a5a6-287fc544f1a1" containerID="bfea2ccfeecd5668f548f56f9728d9652b77dcd3aa4937a75130937b9c0dfdc9" exitCode=0 Mar 16 16:54:05 crc kubenswrapper[5120]: I0316 16:54:05.100463 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561334-bnxd6" event={"ID":"f5a15d20-fb3d-44d4-a5a6-287fc544f1a1","Type":"ContainerDied","Data":"bfea2ccfeecd5668f548f56f9728d9652b77dcd3aa4937a75130937b9c0dfdc9"} Mar 16 16:54:05 crc kubenswrapper[5120]: I0316 16:54:05.103582 5120 generic.go:358] "Generic (PLEG): container finished" podID="1bb10ee5-fec2-4258-a05c-d8d8d80b12b0" containerID="b6cd74ed07e8d78c2ea7d8ef8236109d404b57fa55a58013e98af69c64c34049" exitCode=0 Mar 16 16:54:05 crc kubenswrapper[5120]: I0316 16:54:05.104083 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-pcjdg" event={"ID":"1bb10ee5-fec2-4258-a05c-d8d8d80b12b0","Type":"ContainerDied","Data":"b6cd74ed07e8d78c2ea7d8ef8236109d404b57fa55a58013e98af69c64c34049"} Mar 16 16:54:05 crc kubenswrapper[5120]: I0316 16:54:05.963272 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/swift-proxy-5d595646b6-w4dgd"] Mar 16 16:54:05 crc kubenswrapper[5120]: I0316 16:54:05.965115 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76725a9c-9344-4783-879a-a5ccfb8ba113" containerName="placement-log" Mar 16 16:54:05 crc kubenswrapper[5120]: I0316 16:54:05.965141 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="76725a9c-9344-4783-879a-a5ccfb8ba113" containerName="placement-log" Mar 16 16:54:05 crc kubenswrapper[5120]: I0316 16:54:05.965172 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c27e11d8-d691-4894-995b-b4855e61ab80" containerName="keystone-api" Mar 16 16:54:05 crc kubenswrapper[5120]: I0316 16:54:05.965179 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c27e11d8-d691-4894-995b-b4855e61ab80" containerName="keystone-api" Mar 16 16:54:05 crc kubenswrapper[5120]: I0316 16:54:05.965211 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76725a9c-9344-4783-879a-a5ccfb8ba113" containerName="placement-api" Mar 16 16:54:05 crc kubenswrapper[5120]: I0316 16:54:05.965217 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="76725a9c-9344-4783-879a-a5ccfb8ba113" containerName="placement-api" Mar 16 16:54:05 crc kubenswrapper[5120]: I0316 16:54:05.965389 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c27e11d8-d691-4894-995b-b4855e61ab80" containerName="keystone-api" Mar 16 16:54:05 crc kubenswrapper[5120]: I0316 16:54:05.965408 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="76725a9c-9344-4783-879a-a5ccfb8ba113" containerName="placement-log" Mar 16 16:54:05 crc kubenswrapper[5120]: I0316 16:54:05.965416 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="76725a9c-9344-4783-879a-a5ccfb8ba113" containerName="placement-api" Mar 16 16:54:05 crc kubenswrapper[5120]: I0316 16:54:05.976438 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-5d595646b6-w4dgd" Mar 16 16:54:05 crc kubenswrapper[5120]: I0316 16:54:05.978127 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-proxy-5d595646b6-w4dgd"] Mar 16 16:54:06 crc kubenswrapper[5120]: I0316 16:54:06.067019 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/689362fd-dae2-4d32-839f-c13ebc515c4c-combined-ca-bundle\") pod \"swift-proxy-5d595646b6-w4dgd\" (UID: \"689362fd-dae2-4d32-839f-c13ebc515c4c\") " pod="openstack-kuttl-tests/swift-proxy-5d595646b6-w4dgd" Mar 16 16:54:06 crc kubenswrapper[5120]: I0316 16:54:06.067142 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dc2pn\" (UniqueName: \"kubernetes.io/projected/689362fd-dae2-4d32-839f-c13ebc515c4c-kube-api-access-dc2pn\") pod \"swift-proxy-5d595646b6-w4dgd\" (UID: \"689362fd-dae2-4d32-839f-c13ebc515c4c\") " pod="openstack-kuttl-tests/swift-proxy-5d595646b6-w4dgd" Mar 16 16:54:06 crc kubenswrapper[5120]: I0316 16:54:06.067220 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/689362fd-dae2-4d32-839f-c13ebc515c4c-run-httpd\") pod \"swift-proxy-5d595646b6-w4dgd\" (UID: \"689362fd-dae2-4d32-839f-c13ebc515c4c\") " pod="openstack-kuttl-tests/swift-proxy-5d595646b6-w4dgd" Mar 16 16:54:06 crc kubenswrapper[5120]: I0316 16:54:06.067272 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/689362fd-dae2-4d32-839f-c13ebc515c4c-log-httpd\") pod \"swift-proxy-5d595646b6-w4dgd\" (UID: \"689362fd-dae2-4d32-839f-c13ebc515c4c\") " pod="openstack-kuttl-tests/swift-proxy-5d595646b6-w4dgd" Mar 16 16:54:06 crc kubenswrapper[5120]: I0316 16:54:06.067287 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/689362fd-dae2-4d32-839f-c13ebc515c4c-public-tls-certs\") pod \"swift-proxy-5d595646b6-w4dgd\" (UID: \"689362fd-dae2-4d32-839f-c13ebc515c4c\") " pod="openstack-kuttl-tests/swift-proxy-5d595646b6-w4dgd" Mar 16 16:54:06 crc kubenswrapper[5120]: I0316 16:54:06.067309 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/689362fd-dae2-4d32-839f-c13ebc515c4c-config-data\") pod \"swift-proxy-5d595646b6-w4dgd\" (UID: \"689362fd-dae2-4d32-839f-c13ebc515c4c\") " pod="openstack-kuttl-tests/swift-proxy-5d595646b6-w4dgd" Mar 16 16:54:06 crc kubenswrapper[5120]: I0316 16:54:06.067335 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/689362fd-dae2-4d32-839f-c13ebc515c4c-internal-tls-certs\") pod \"swift-proxy-5d595646b6-w4dgd\" (UID: \"689362fd-dae2-4d32-839f-c13ebc515c4c\") " pod="openstack-kuttl-tests/swift-proxy-5d595646b6-w4dgd" Mar 16 16:54:06 crc kubenswrapper[5120]: I0316 16:54:06.067419 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/689362fd-dae2-4d32-839f-c13ebc515c4c-etc-swift\") pod \"swift-proxy-5d595646b6-w4dgd\" (UID: \"689362fd-dae2-4d32-839f-c13ebc515c4c\") " pod="openstack-kuttl-tests/swift-proxy-5d595646b6-w4dgd" Mar 16 16:54:06 crc kubenswrapper[5120]: I0316 16:54:06.117749 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-pcjdg" event={"ID":"1bb10ee5-fec2-4258-a05c-d8d8d80b12b0","Type":"ContainerStarted","Data":"d2e4ba36fc0b31f8f69b11a7f1d01661d914d26ba867c3d7475136420c6836db"} Mar 16 16:54:06 crc kubenswrapper[5120]: I0316 16:54:06.139629 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/redhat-marketplace-pcjdg" podStartSLOduration=4.456627698 podStartE2EDuration="6.139612772s" podCreationTimestamp="2026-03-16 16:54:00 +0000 UTC" firstStartedPulling="2026-03-16 16:54:02.051818026 +0000 UTC m=+4944.205749683" lastFinishedPulling="2026-03-16 16:54:03.7348031 +0000 UTC m=+4945.888734757" observedRunningTime="2026-03-16 16:54:06.133280899 +0000 UTC m=+4948.287212556" watchObservedRunningTime="2026-03-16 16:54:06.139612772 +0000 UTC m=+4948.293544429" Mar 16 16:54:06 crc kubenswrapper[5120]: I0316 16:54:06.170044 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/689362fd-dae2-4d32-839f-c13ebc515c4c-run-httpd\") pod \"swift-proxy-5d595646b6-w4dgd\" (UID: \"689362fd-dae2-4d32-839f-c13ebc515c4c\") " pod="openstack-kuttl-tests/swift-proxy-5d595646b6-w4dgd" Mar 16 16:54:06 crc kubenswrapper[5120]: I0316 16:54:06.170127 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/689362fd-dae2-4d32-839f-c13ebc515c4c-log-httpd\") pod \"swift-proxy-5d595646b6-w4dgd\" (UID: \"689362fd-dae2-4d32-839f-c13ebc515c4c\") " pod="openstack-kuttl-tests/swift-proxy-5d595646b6-w4dgd" Mar 16 16:54:06 crc kubenswrapper[5120]: I0316 16:54:06.170152 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/689362fd-dae2-4d32-839f-c13ebc515c4c-public-tls-certs\") pod \"swift-proxy-5d595646b6-w4dgd\" (UID: \"689362fd-dae2-4d32-839f-c13ebc515c4c\") " pod="openstack-kuttl-tests/swift-proxy-5d595646b6-w4dgd" Mar 16 16:54:06 crc kubenswrapper[5120]: I0316 16:54:06.170179 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/689362fd-dae2-4d32-839f-c13ebc515c4c-config-data\") pod \"swift-proxy-5d595646b6-w4dgd\" (UID: \"689362fd-dae2-4d32-839f-c13ebc515c4c\") " pod="openstack-kuttl-tests/swift-proxy-5d595646b6-w4dgd" Mar 16 16:54:06 crc kubenswrapper[5120]: I0316 16:54:06.170217 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/689362fd-dae2-4d32-839f-c13ebc515c4c-internal-tls-certs\") pod \"swift-proxy-5d595646b6-w4dgd\" (UID: \"689362fd-dae2-4d32-839f-c13ebc515c4c\") " pod="openstack-kuttl-tests/swift-proxy-5d595646b6-w4dgd" Mar 16 16:54:06 crc kubenswrapper[5120]: I0316 16:54:06.170307 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/689362fd-dae2-4d32-839f-c13ebc515c4c-etc-swift\") pod \"swift-proxy-5d595646b6-w4dgd\" (UID: \"689362fd-dae2-4d32-839f-c13ebc515c4c\") " pod="openstack-kuttl-tests/swift-proxy-5d595646b6-w4dgd" Mar 16 16:54:06 crc kubenswrapper[5120]: I0316 16:54:06.170490 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/689362fd-dae2-4d32-839f-c13ebc515c4c-combined-ca-bundle\") pod \"swift-proxy-5d595646b6-w4dgd\" (UID: \"689362fd-dae2-4d32-839f-c13ebc515c4c\") " pod="openstack-kuttl-tests/swift-proxy-5d595646b6-w4dgd" Mar 16 16:54:06 crc kubenswrapper[5120]: I0316 16:54:06.170559 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dc2pn\" (UniqueName: \"kubernetes.io/projected/689362fd-dae2-4d32-839f-c13ebc515c4c-kube-api-access-dc2pn\") pod \"swift-proxy-5d595646b6-w4dgd\" (UID: \"689362fd-dae2-4d32-839f-c13ebc515c4c\") " pod="openstack-kuttl-tests/swift-proxy-5d595646b6-w4dgd" Mar 16 16:54:06 crc kubenswrapper[5120]: I0316 16:54:06.171505 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/689362fd-dae2-4d32-839f-c13ebc515c4c-run-httpd\") pod \"swift-proxy-5d595646b6-w4dgd\" (UID: \"689362fd-dae2-4d32-839f-c13ebc515c4c\") " pod="openstack-kuttl-tests/swift-proxy-5d595646b6-w4dgd" Mar 16 16:54:06 crc kubenswrapper[5120]: I0316 16:54:06.171881 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/689362fd-dae2-4d32-839f-c13ebc515c4c-log-httpd\") pod \"swift-proxy-5d595646b6-w4dgd\" (UID: \"689362fd-dae2-4d32-839f-c13ebc515c4c\") " pod="openstack-kuttl-tests/swift-proxy-5d595646b6-w4dgd" Mar 16 16:54:06 crc kubenswrapper[5120]: I0316 16:54:06.178981 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/689362fd-dae2-4d32-839f-c13ebc515c4c-public-tls-certs\") pod \"swift-proxy-5d595646b6-w4dgd\" (UID: \"689362fd-dae2-4d32-839f-c13ebc515c4c\") " pod="openstack-kuttl-tests/swift-proxy-5d595646b6-w4dgd" Mar 16 16:54:06 crc kubenswrapper[5120]: I0316 16:54:06.179870 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/689362fd-dae2-4d32-839f-c13ebc515c4c-etc-swift\") pod \"swift-proxy-5d595646b6-w4dgd\" (UID: \"689362fd-dae2-4d32-839f-c13ebc515c4c\") " pod="openstack-kuttl-tests/swift-proxy-5d595646b6-w4dgd" Mar 16 16:54:06 crc kubenswrapper[5120]: I0316 16:54:06.181999 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/689362fd-dae2-4d32-839f-c13ebc515c4c-config-data\") pod \"swift-proxy-5d595646b6-w4dgd\" (UID: \"689362fd-dae2-4d32-839f-c13ebc515c4c\") " pod="openstack-kuttl-tests/swift-proxy-5d595646b6-w4dgd" Mar 16 16:54:06 crc kubenswrapper[5120]: I0316 16:54:06.191906 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dc2pn\" (UniqueName: \"kubernetes.io/projected/689362fd-dae2-4d32-839f-c13ebc515c4c-kube-api-access-dc2pn\") pod \"swift-proxy-5d595646b6-w4dgd\" (UID: \"689362fd-dae2-4d32-839f-c13ebc515c4c\") " pod="openstack-kuttl-tests/swift-proxy-5d595646b6-w4dgd" Mar 16 16:54:06 crc kubenswrapper[5120]: I0316 16:54:06.200632 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/689362fd-dae2-4d32-839f-c13ebc515c4c-internal-tls-certs\") pod \"swift-proxy-5d595646b6-w4dgd\" (UID: \"689362fd-dae2-4d32-839f-c13ebc515c4c\") " pod="openstack-kuttl-tests/swift-proxy-5d595646b6-w4dgd" Mar 16 16:54:06 crc kubenswrapper[5120]: I0316 16:54:06.208615 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/689362fd-dae2-4d32-839f-c13ebc515c4c-combined-ca-bundle\") pod \"swift-proxy-5d595646b6-w4dgd\" (UID: \"689362fd-dae2-4d32-839f-c13ebc515c4c\") " pod="openstack-kuttl-tests/swift-proxy-5d595646b6-w4dgd" Mar 16 16:54:06 crc kubenswrapper[5120]: I0316 16:54:06.298417 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-5d595646b6-w4dgd" Mar 16 16:54:06 crc kubenswrapper[5120]: I0316 16:54:06.553414 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561334-bnxd6" Mar 16 16:54:06 crc kubenswrapper[5120]: I0316 16:54:06.684964 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sqzn7\" (UniqueName: \"kubernetes.io/projected/f5a15d20-fb3d-44d4-a5a6-287fc544f1a1-kube-api-access-sqzn7\") pod \"f5a15d20-fb3d-44d4-a5a6-287fc544f1a1\" (UID: \"f5a15d20-fb3d-44d4-a5a6-287fc544f1a1\") " Mar 16 16:54:06 crc kubenswrapper[5120]: I0316 16:54:06.690958 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5a15d20-fb3d-44d4-a5a6-287fc544f1a1-kube-api-access-sqzn7" (OuterVolumeSpecName: "kube-api-access-sqzn7") pod "f5a15d20-fb3d-44d4-a5a6-287fc544f1a1" (UID: "f5a15d20-fb3d-44d4-a5a6-287fc544f1a1"). InnerVolumeSpecName "kube-api-access-sqzn7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:54:06 crc kubenswrapper[5120]: I0316 16:54:06.790045 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sqzn7\" (UniqueName: \"kubernetes.io/projected/f5a15d20-fb3d-44d4-a5a6-287fc544f1a1-kube-api-access-sqzn7\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:06 crc kubenswrapper[5120]: W0316 16:54:06.854335 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod689362fd_dae2_4d32_839f_c13ebc515c4c.slice/crio-554e22aba604ea6e6dc3df86d74e7fe1c184cee63e2534a85f9fc2113ed13f71 WatchSource:0}: Error finding container 554e22aba604ea6e6dc3df86d74e7fe1c184cee63e2534a85f9fc2113ed13f71: Status 404 returned error can't find the container with id 554e22aba604ea6e6dc3df86d74e7fe1c184cee63e2534a85f9fc2113ed13f71 Mar 16 16:54:06 crc kubenswrapper[5120]: I0316 16:54:06.855062 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-proxy-5d595646b6-w4dgd"] Mar 16 16:54:07 crc kubenswrapper[5120]: I0316 16:54:07.133488 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561334-bnxd6" event={"ID":"f5a15d20-fb3d-44d4-a5a6-287fc544f1a1","Type":"ContainerDied","Data":"6a7bb51ed87cb3dc3f5cee299bf56d863645b30bc7c89e2d09514c9c43e45b24"} Mar 16 16:54:07 crc kubenswrapper[5120]: I0316 16:54:07.133900 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6a7bb51ed87cb3dc3f5cee299bf56d863645b30bc7c89e2d09514c9c43e45b24" Mar 16 16:54:07 crc kubenswrapper[5120]: I0316 16:54:07.133562 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561334-bnxd6" Mar 16 16:54:07 crc kubenswrapper[5120]: I0316 16:54:07.139903 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-5d595646b6-w4dgd" event={"ID":"689362fd-dae2-4d32-839f-c13ebc515c4c","Type":"ContainerStarted","Data":"9569cfb59832e14e0060f550d868c280dfe3ecac2ddf44052552f76ad15ad693"} Mar 16 16:54:07 crc kubenswrapper[5120]: I0316 16:54:07.139959 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-5d595646b6-w4dgd" event={"ID":"689362fd-dae2-4d32-839f-c13ebc515c4c","Type":"ContainerStarted","Data":"554e22aba604ea6e6dc3df86d74e7fe1c184cee63e2534a85f9fc2113ed13f71"} Mar 16 16:54:07 crc kubenswrapper[5120]: I0316 16:54:07.646573 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-infra/auto-csr-approver-29561328-2kz8m"] Mar 16 16:54:07 crc kubenswrapper[5120]: I0316 16:54:07.657266 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-infra/auto-csr-approver-29561328-2kz8m"] Mar 16 16:54:07 crc kubenswrapper[5120]: E0316 16:54:07.929771 5120 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod133b5e0f_d834_4c59_932f_957221e1727b.slice/crio-550a482710c28eab0491207e17c6a03a7948797a16de7ca95046c49632833e1e\": RecentStats: unable to find data in memory cache]" Mar 16 16:54:08 crc kubenswrapper[5120]: I0316 16:54:08.155557 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-5d595646b6-w4dgd" event={"ID":"689362fd-dae2-4d32-839f-c13ebc515c4c","Type":"ContainerStarted","Data":"513a25e97b4b98222e73c585010f0bf9a581e930c8688dc9f3f9370620baaaf5"} Mar 16 16:54:08 crc kubenswrapper[5120]: I0316 16:54:08.155710 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/swift-proxy-5d595646b6-w4dgd" Mar 16 16:54:08 crc kubenswrapper[5120]: I0316 16:54:08.155806 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/swift-proxy-5d595646b6-w4dgd" Mar 16 16:54:08 crc kubenswrapper[5120]: I0316 16:54:08.177778 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/swift-proxy-5d595646b6-w4dgd" podStartSLOduration=3.177738607 podStartE2EDuration="3.177738607s" podCreationTimestamp="2026-03-16 16:54:05 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:54:08.175788863 +0000 UTC m=+4950.329720530" watchObservedRunningTime="2026-03-16 16:54:08.177738607 +0000 UTC m=+4950.331670264" Mar 16 16:54:08 crc kubenswrapper[5120]: E0316 16:54:08.414209 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1920673 actualBytes=10240 Mar 16 16:54:08 crc kubenswrapper[5120]: I0316 16:54:08.674256 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f07b5400-a812-4bb9-82ee-516b11a3c655" path="/var/lib/kubelet/pods/f07b5400-a812-4bb9-82ee-516b11a3c655/volumes" Mar 16 16:54:09 crc kubenswrapper[5120]: I0316 16:54:09.086991 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6cc498cb5c-zdb8r" Mar 16 16:54:09 crc kubenswrapper[5120]: I0316 16:54:09.142693 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-65584897-gpm59"] Mar 16 16:54:09 crc kubenswrapper[5120]: I0316 16:54:09.142990 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-65584897-gpm59" podUID="6e679f0b-5939-456f-b116-1bf25a1029a7" containerName="dnsmasq-dns" containerID="cri-o://3666df42cfd33ba5ccafbed3b2aa94ce1282a8aeb78f91a46955d0241367b401" gracePeriod=10 Mar 16 16:54:09 crc kubenswrapper[5120]: I0316 16:54:09.590708 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-65584897-gpm59" Mar 16 16:54:09 crc kubenswrapper[5120]: I0316 16:54:09.772208 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6e679f0b-5939-456f-b116-1bf25a1029a7-config\") pod \"6e679f0b-5939-456f-b116-1bf25a1029a7\" (UID: \"6e679f0b-5939-456f-b116-1bf25a1029a7\") " Mar 16 16:54:09 crc kubenswrapper[5120]: I0316 16:54:09.772356 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5jqk9\" (UniqueName: \"kubernetes.io/projected/6e679f0b-5939-456f-b116-1bf25a1029a7-kube-api-access-5jqk9\") pod \"6e679f0b-5939-456f-b116-1bf25a1029a7\" (UID: \"6e679f0b-5939-456f-b116-1bf25a1029a7\") " Mar 16 16:54:09 crc kubenswrapper[5120]: I0316 16:54:09.772575 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/6e679f0b-5939-456f-b116-1bf25a1029a7-dns-swift-storage-0\") pod \"6e679f0b-5939-456f-b116-1bf25a1029a7\" (UID: \"6e679f0b-5939-456f-b116-1bf25a1029a7\") " Mar 16 16:54:09 crc kubenswrapper[5120]: I0316 16:54:09.772742 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/6e679f0b-5939-456f-b116-1bf25a1029a7-dnsmasq-svc\") pod \"6e679f0b-5939-456f-b116-1bf25a1029a7\" (UID: \"6e679f0b-5939-456f-b116-1bf25a1029a7\") " Mar 16 16:54:09 crc kubenswrapper[5120]: I0316 16:54:09.789212 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e679f0b-5939-456f-b116-1bf25a1029a7-kube-api-access-5jqk9" (OuterVolumeSpecName: "kube-api-access-5jqk9") pod "6e679f0b-5939-456f-b116-1bf25a1029a7" (UID: "6e679f0b-5939-456f-b116-1bf25a1029a7"). InnerVolumeSpecName "kube-api-access-5jqk9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:54:09 crc kubenswrapper[5120]: I0316 16:54:09.824408 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e679f0b-5939-456f-b116-1bf25a1029a7-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "6e679f0b-5939-456f-b116-1bf25a1029a7" (UID: "6e679f0b-5939-456f-b116-1bf25a1029a7"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:54:09 crc kubenswrapper[5120]: I0316 16:54:09.825165 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e679f0b-5939-456f-b116-1bf25a1029a7-config" (OuterVolumeSpecName: "config") pod "6e679f0b-5939-456f-b116-1bf25a1029a7" (UID: "6e679f0b-5939-456f-b116-1bf25a1029a7"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:54:09 crc kubenswrapper[5120]: I0316 16:54:09.832344 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e679f0b-5939-456f-b116-1bf25a1029a7-dns-swift-storage-0" (OuterVolumeSpecName: "dns-swift-storage-0") pod "6e679f0b-5939-456f-b116-1bf25a1029a7" (UID: "6e679f0b-5939-456f-b116-1bf25a1029a7"). InnerVolumeSpecName "dns-swift-storage-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:54:09 crc kubenswrapper[5120]: I0316 16:54:09.877306 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6e679f0b-5939-456f-b116-1bf25a1029a7-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:09 crc kubenswrapper[5120]: I0316 16:54:09.877351 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5jqk9\" (UniqueName: \"kubernetes.io/projected/6e679f0b-5939-456f-b116-1bf25a1029a7-kube-api-access-5jqk9\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:09 crc kubenswrapper[5120]: I0316 16:54:09.877363 5120 reconciler_common.go:299] "Volume detached for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/6e679f0b-5939-456f-b116-1bf25a1029a7-dns-swift-storage-0\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:09 crc kubenswrapper[5120]: I0316 16:54:09.877375 5120 reconciler_common.go:299] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/6e679f0b-5939-456f-b116-1bf25a1029a7-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:10 crc kubenswrapper[5120]: I0316 16:54:10.185679 5120 generic.go:358] "Generic (PLEG): container finished" podID="6e679f0b-5939-456f-b116-1bf25a1029a7" containerID="3666df42cfd33ba5ccafbed3b2aa94ce1282a8aeb78f91a46955d0241367b401" exitCode=0 Mar 16 16:54:10 crc kubenswrapper[5120]: I0316 16:54:10.185753 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-65584897-gpm59" Mar 16 16:54:10 crc kubenswrapper[5120]: I0316 16:54:10.186009 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-65584897-gpm59" event={"ID":"6e679f0b-5939-456f-b116-1bf25a1029a7","Type":"ContainerDied","Data":"3666df42cfd33ba5ccafbed3b2aa94ce1282a8aeb78f91a46955d0241367b401"} Mar 16 16:54:10 crc kubenswrapper[5120]: I0316 16:54:10.186041 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-65584897-gpm59" event={"ID":"6e679f0b-5939-456f-b116-1bf25a1029a7","Type":"ContainerDied","Data":"fea5fb52496b147906409567957a83553c916fe45aba57b1c764c1d5af2605d7"} Mar 16 16:54:10 crc kubenswrapper[5120]: I0316 16:54:10.186057 5120 scope.go:117] "RemoveContainer" containerID="3666df42cfd33ba5ccafbed3b2aa94ce1282a8aeb78f91a46955d0241367b401" Mar 16 16:54:10 crc kubenswrapper[5120]: I0316 16:54:10.222876 5120 scope.go:117] "RemoveContainer" containerID="9fc43a83420f295444fdce9392001102544228806680c9836de43947fcb96b0e" Mar 16 16:54:10 crc kubenswrapper[5120]: I0316 16:54:10.228197 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-65584897-gpm59"] Mar 16 16:54:10 crc kubenswrapper[5120]: I0316 16:54:10.237389 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-65584897-gpm59"] Mar 16 16:54:10 crc kubenswrapper[5120]: I0316 16:54:10.244583 5120 scope.go:117] "RemoveContainer" containerID="3666df42cfd33ba5ccafbed3b2aa94ce1282a8aeb78f91a46955d0241367b401" Mar 16 16:54:10 crc kubenswrapper[5120]: E0316 16:54:10.245132 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3666df42cfd33ba5ccafbed3b2aa94ce1282a8aeb78f91a46955d0241367b401\": container with ID starting with 3666df42cfd33ba5ccafbed3b2aa94ce1282a8aeb78f91a46955d0241367b401 not found: ID does not exist" containerID="3666df42cfd33ba5ccafbed3b2aa94ce1282a8aeb78f91a46955d0241367b401" Mar 16 16:54:10 crc kubenswrapper[5120]: I0316 16:54:10.245172 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3666df42cfd33ba5ccafbed3b2aa94ce1282a8aeb78f91a46955d0241367b401"} err="failed to get container status \"3666df42cfd33ba5ccafbed3b2aa94ce1282a8aeb78f91a46955d0241367b401\": rpc error: code = NotFound desc = could not find container \"3666df42cfd33ba5ccafbed3b2aa94ce1282a8aeb78f91a46955d0241367b401\": container with ID starting with 3666df42cfd33ba5ccafbed3b2aa94ce1282a8aeb78f91a46955d0241367b401 not found: ID does not exist" Mar 16 16:54:10 crc kubenswrapper[5120]: I0316 16:54:10.245197 5120 scope.go:117] "RemoveContainer" containerID="9fc43a83420f295444fdce9392001102544228806680c9836de43947fcb96b0e" Mar 16 16:54:10 crc kubenswrapper[5120]: E0316 16:54:10.245746 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9fc43a83420f295444fdce9392001102544228806680c9836de43947fcb96b0e\": container with ID starting with 9fc43a83420f295444fdce9392001102544228806680c9836de43947fcb96b0e not found: ID does not exist" containerID="9fc43a83420f295444fdce9392001102544228806680c9836de43947fcb96b0e" Mar 16 16:54:10 crc kubenswrapper[5120]: I0316 16:54:10.245804 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9fc43a83420f295444fdce9392001102544228806680c9836de43947fcb96b0e"} err="failed to get container status \"9fc43a83420f295444fdce9392001102544228806680c9836de43947fcb96b0e\": rpc error: code = NotFound desc = could not find container \"9fc43a83420f295444fdce9392001102544228806680c9836de43947fcb96b0e\": container with ID starting with 9fc43a83420f295444fdce9392001102544228806680c9836de43947fcb96b0e not found: ID does not exist" Mar 16 16:54:10 crc kubenswrapper[5120]: I0316 16:54:10.423800 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-marketplace-pcjdg" Mar 16 16:54:10 crc kubenswrapper[5120]: I0316 16:54:10.424114 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-marketplace/redhat-marketplace-pcjdg" Mar 16 16:54:10 crc kubenswrapper[5120]: I0316 16:54:10.468051 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-marketplace-pcjdg" Mar 16 16:54:10 crc kubenswrapper[5120]: I0316 16:54:10.677153 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6e679f0b-5939-456f-b116-1bf25a1029a7" path="/var/lib/kubelet/pods/6e679f0b-5939-456f-b116-1bf25a1029a7/volumes" Mar 16 16:54:11 crc kubenswrapper[5120]: I0316 16:54:11.271651 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-marketplace-pcjdg" Mar 16 16:54:11 crc kubenswrapper[5120]: I0316 16:54:11.327022 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-marketplace-pcjdg"] Mar 16 16:54:12 crc kubenswrapper[5120]: I0316 16:54:12.471474 5120 pod_container_manager_linux.go:217] "Failed to delete cgroup paths" cgroupName=["kubepods","besteffort","pod3853023d-8cc5-42de-9f91-d0609e3fe565"] err="unable to destroy cgroup paths for cgroup [kubepods besteffort pod3853023d-8cc5-42de-9f91-d0609e3fe565] : Timed out while waiting for systemd to remove kubepods-besteffort-pod3853023d_8cc5_42de_9f91_d0609e3fe565.slice" Mar 16 16:54:12 crc kubenswrapper[5120]: E0316 16:54:12.471529 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to delete cgroup paths for [kubepods besteffort pod3853023d-8cc5-42de-9f91-d0609e3fe565] : unable to destroy cgroup paths for cgroup [kubepods besteffort pod3853023d-8cc5-42de-9f91-d0609e3fe565] : Timed out while waiting for systemd to remove kubepods-besteffort-pod3853023d_8cc5_42de_9f91_d0609e3fe565.slice" pod="openstack-kuttl-tests/neutron-84f95d87c8-s7s4d" podUID="3853023d-8cc5-42de-9f91-d0609e3fe565" Mar 16 16:54:13 crc kubenswrapper[5120]: I0316 16:54:13.222380 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-marketplace/redhat-marketplace-pcjdg" podUID="1bb10ee5-fec2-4258-a05c-d8d8d80b12b0" containerName="registry-server" containerID="cri-o://d2e4ba36fc0b31f8f69b11a7f1d01661d914d26ba867c3d7475136420c6836db" gracePeriod=2 Mar 16 16:54:13 crc kubenswrapper[5120]: I0316 16:54:13.222551 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-84f95d87c8-s7s4d" Mar 16 16:54:13 crc kubenswrapper[5120]: I0316 16:54:13.276359 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-84f95d87c8-s7s4d"] Mar 16 16:54:13 crc kubenswrapper[5120]: I0316 16:54:13.312309 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-84f95d87c8-s7s4d"] Mar 16 16:54:13 crc kubenswrapper[5120]: I0316 16:54:13.782432 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-pcjdg" Mar 16 16:54:13 crc kubenswrapper[5120]: I0316 16:54:13.877518 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/1bb10ee5-fec2-4258-a05c-d8d8d80b12b0-catalog-content\") pod \"1bb10ee5-fec2-4258-a05c-d8d8d80b12b0\" (UID: \"1bb10ee5-fec2-4258-a05c-d8d8d80b12b0\") " Mar 16 16:54:13 crc kubenswrapper[5120]: I0316 16:54:13.877581 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pggdh\" (UniqueName: \"kubernetes.io/projected/1bb10ee5-fec2-4258-a05c-d8d8d80b12b0-kube-api-access-pggdh\") pod \"1bb10ee5-fec2-4258-a05c-d8d8d80b12b0\" (UID: \"1bb10ee5-fec2-4258-a05c-d8d8d80b12b0\") " Mar 16 16:54:13 crc kubenswrapper[5120]: I0316 16:54:13.877679 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/1bb10ee5-fec2-4258-a05c-d8d8d80b12b0-utilities\") pod \"1bb10ee5-fec2-4258-a05c-d8d8d80b12b0\" (UID: \"1bb10ee5-fec2-4258-a05c-d8d8d80b12b0\") " Mar 16 16:54:13 crc kubenswrapper[5120]: I0316 16:54:13.878379 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1bb10ee5-fec2-4258-a05c-d8d8d80b12b0-utilities" (OuterVolumeSpecName: "utilities") pod "1bb10ee5-fec2-4258-a05c-d8d8d80b12b0" (UID: "1bb10ee5-fec2-4258-a05c-d8d8d80b12b0"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:54:13 crc kubenswrapper[5120]: I0316 16:54:13.879079 5120 reconciler_common.go:299] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/1bb10ee5-fec2-4258-a05c-d8d8d80b12b0-utilities\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:13 crc kubenswrapper[5120]: I0316 16:54:13.885317 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1bb10ee5-fec2-4258-a05c-d8d8d80b12b0-kube-api-access-pggdh" (OuterVolumeSpecName: "kube-api-access-pggdh") pod "1bb10ee5-fec2-4258-a05c-d8d8d80b12b0" (UID: "1bb10ee5-fec2-4258-a05c-d8d8d80b12b0"). InnerVolumeSpecName "kube-api-access-pggdh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:54:13 crc kubenswrapper[5120]: I0316 16:54:13.894241 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1bb10ee5-fec2-4258-a05c-d8d8d80b12b0-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "1bb10ee5-fec2-4258-a05c-d8d8d80b12b0" (UID: "1bb10ee5-fec2-4258-a05c-d8d8d80b12b0"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:54:13 crc kubenswrapper[5120]: I0316 16:54:13.980878 5120 reconciler_common.go:299] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/1bb10ee5-fec2-4258-a05c-d8d8d80b12b0-catalog-content\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:13 crc kubenswrapper[5120]: I0316 16:54:13.980925 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pggdh\" (UniqueName: \"kubernetes.io/projected/1bb10ee5-fec2-4258-a05c-d8d8d80b12b0-kube-api-access-pggdh\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:14 crc kubenswrapper[5120]: I0316 16:54:14.180046 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/swift-proxy-5d595646b6-w4dgd" Mar 16 16:54:14 crc kubenswrapper[5120]: I0316 16:54:14.184021 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/swift-proxy-5d595646b6-w4dgd" Mar 16 16:54:14 crc kubenswrapper[5120]: I0316 16:54:14.245020 5120 generic.go:358] "Generic (PLEG): container finished" podID="1bb10ee5-fec2-4258-a05c-d8d8d80b12b0" containerID="d2e4ba36fc0b31f8f69b11a7f1d01661d914d26ba867c3d7475136420c6836db" exitCode=0 Mar 16 16:54:14 crc kubenswrapper[5120]: I0316 16:54:14.245300 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-pcjdg" Mar 16 16:54:14 crc kubenswrapper[5120]: I0316 16:54:14.245333 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-pcjdg" event={"ID":"1bb10ee5-fec2-4258-a05c-d8d8d80b12b0","Type":"ContainerDied","Data":"d2e4ba36fc0b31f8f69b11a7f1d01661d914d26ba867c3d7475136420c6836db"} Mar 16 16:54:14 crc kubenswrapper[5120]: I0316 16:54:14.247261 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-pcjdg" event={"ID":"1bb10ee5-fec2-4258-a05c-d8d8d80b12b0","Type":"ContainerDied","Data":"e2b28c340795cc4e66b8fc50da7880d2de020af09266f38c659fc7b08355e6a9"} Mar 16 16:54:14 crc kubenswrapper[5120]: I0316 16:54:14.247302 5120 scope.go:117] "RemoveContainer" containerID="d2e4ba36fc0b31f8f69b11a7f1d01661d914d26ba867c3d7475136420c6836db" Mar 16 16:54:14 crc kubenswrapper[5120]: I0316 16:54:14.295181 5120 scope.go:117] "RemoveContainer" containerID="b6cd74ed07e8d78c2ea7d8ef8236109d404b57fa55a58013e98af69c64c34049" Mar 16 16:54:14 crc kubenswrapper[5120]: I0316 16:54:14.308270 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-marketplace-pcjdg"] Mar 16 16:54:14 crc kubenswrapper[5120]: I0316 16:54:14.324276 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/redhat-marketplace-pcjdg"] Mar 16 16:54:14 crc kubenswrapper[5120]: I0316 16:54:14.337192 5120 scope.go:117] "RemoveContainer" containerID="a7fc62a0946b9d5f9cbb8bfdfb055d47151f7a2dabdf1f86969084a4fcff0914" Mar 16 16:54:14 crc kubenswrapper[5120]: I0316 16:54:14.344551 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-proxy-588bfd87d6-cq2c8"] Mar 16 16:54:14 crc kubenswrapper[5120]: I0316 16:54:14.344863 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-proxy-588bfd87d6-cq2c8" podUID="119df2a8-0cad-4926-9ad1-eced0db2037d" containerName="proxy-httpd" containerID="cri-o://b9b06f5bd596d4bdbcb9074a49c7fb274d36644b6129bce1b9dce24f5aae10eb" gracePeriod=30 Mar 16 16:54:14 crc kubenswrapper[5120]: I0316 16:54:14.345079 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-proxy-588bfd87d6-cq2c8" podUID="119df2a8-0cad-4926-9ad1-eced0db2037d" containerName="proxy-server" containerID="cri-o://07617e76b5d2c78f4060a6aa82a0449bb7e6be66b37fdf9f043fabc4528cb11c" gracePeriod=30 Mar 16 16:54:14 crc kubenswrapper[5120]: I0316 16:54:14.385267 5120 scope.go:117] "RemoveContainer" containerID="d2e4ba36fc0b31f8f69b11a7f1d01661d914d26ba867c3d7475136420c6836db" Mar 16 16:54:14 crc kubenswrapper[5120]: E0316 16:54:14.385696 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d2e4ba36fc0b31f8f69b11a7f1d01661d914d26ba867c3d7475136420c6836db\": container with ID starting with d2e4ba36fc0b31f8f69b11a7f1d01661d914d26ba867c3d7475136420c6836db not found: ID does not exist" containerID="d2e4ba36fc0b31f8f69b11a7f1d01661d914d26ba867c3d7475136420c6836db" Mar 16 16:54:14 crc kubenswrapper[5120]: I0316 16:54:14.385751 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2e4ba36fc0b31f8f69b11a7f1d01661d914d26ba867c3d7475136420c6836db"} err="failed to get container status \"d2e4ba36fc0b31f8f69b11a7f1d01661d914d26ba867c3d7475136420c6836db\": rpc error: code = NotFound desc = could not find container \"d2e4ba36fc0b31f8f69b11a7f1d01661d914d26ba867c3d7475136420c6836db\": container with ID starting with d2e4ba36fc0b31f8f69b11a7f1d01661d914d26ba867c3d7475136420c6836db not found: ID does not exist" Mar 16 16:54:14 crc kubenswrapper[5120]: I0316 16:54:14.385801 5120 scope.go:117] "RemoveContainer" containerID="b6cd74ed07e8d78c2ea7d8ef8236109d404b57fa55a58013e98af69c64c34049" Mar 16 16:54:14 crc kubenswrapper[5120]: E0316 16:54:14.386154 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b6cd74ed07e8d78c2ea7d8ef8236109d404b57fa55a58013e98af69c64c34049\": container with ID starting with b6cd74ed07e8d78c2ea7d8ef8236109d404b57fa55a58013e98af69c64c34049 not found: ID does not exist" containerID="b6cd74ed07e8d78c2ea7d8ef8236109d404b57fa55a58013e98af69c64c34049" Mar 16 16:54:14 crc kubenswrapper[5120]: I0316 16:54:14.386188 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6cd74ed07e8d78c2ea7d8ef8236109d404b57fa55a58013e98af69c64c34049"} err="failed to get container status \"b6cd74ed07e8d78c2ea7d8ef8236109d404b57fa55a58013e98af69c64c34049\": rpc error: code = NotFound desc = could not find container \"b6cd74ed07e8d78c2ea7d8ef8236109d404b57fa55a58013e98af69c64c34049\": container with ID starting with b6cd74ed07e8d78c2ea7d8ef8236109d404b57fa55a58013e98af69c64c34049 not found: ID does not exist" Mar 16 16:54:14 crc kubenswrapper[5120]: I0316 16:54:14.386205 5120 scope.go:117] "RemoveContainer" containerID="a7fc62a0946b9d5f9cbb8bfdfb055d47151f7a2dabdf1f86969084a4fcff0914" Mar 16 16:54:14 crc kubenswrapper[5120]: E0316 16:54:14.386492 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a7fc62a0946b9d5f9cbb8bfdfb055d47151f7a2dabdf1f86969084a4fcff0914\": container with ID starting with a7fc62a0946b9d5f9cbb8bfdfb055d47151f7a2dabdf1f86969084a4fcff0914 not found: ID does not exist" containerID="a7fc62a0946b9d5f9cbb8bfdfb055d47151f7a2dabdf1f86969084a4fcff0914" Mar 16 16:54:14 crc kubenswrapper[5120]: I0316 16:54:14.386534 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7fc62a0946b9d5f9cbb8bfdfb055d47151f7a2dabdf1f86969084a4fcff0914"} err="failed to get container status \"a7fc62a0946b9d5f9cbb8bfdfb055d47151f7a2dabdf1f86969084a4fcff0914\": rpc error: code = NotFound desc = could not find container \"a7fc62a0946b9d5f9cbb8bfdfb055d47151f7a2dabdf1f86969084a4fcff0914\": container with ID starting with a7fc62a0946b9d5f9cbb8bfdfb055d47151f7a2dabdf1f86969084a4fcff0914 not found: ID does not exist" Mar 16 16:54:14 crc kubenswrapper[5120]: I0316 16:54:14.675874 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1bb10ee5-fec2-4258-a05c-d8d8d80b12b0" path="/var/lib/kubelet/pods/1bb10ee5-fec2-4258-a05c-d8d8d80b12b0/volumes" Mar 16 16:54:14 crc kubenswrapper[5120]: I0316 16:54:14.676907 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3853023d-8cc5-42de-9f91-d0609e3fe565" path="/var/lib/kubelet/pods/3853023d-8cc5-42de-9f91-d0609e3fe565/volumes" Mar 16 16:54:15 crc kubenswrapper[5120]: I0316 16:54:15.263701 5120 generic.go:358] "Generic (PLEG): container finished" podID="119df2a8-0cad-4926-9ad1-eced0db2037d" containerID="07617e76b5d2c78f4060a6aa82a0449bb7e6be66b37fdf9f043fabc4528cb11c" exitCode=0 Mar 16 16:54:15 crc kubenswrapper[5120]: I0316 16:54:15.264232 5120 generic.go:358] "Generic (PLEG): container finished" podID="119df2a8-0cad-4926-9ad1-eced0db2037d" containerID="b9b06f5bd596d4bdbcb9074a49c7fb274d36644b6129bce1b9dce24f5aae10eb" exitCode=0 Mar 16 16:54:15 crc kubenswrapper[5120]: I0316 16:54:15.263784 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-588bfd87d6-cq2c8" event={"ID":"119df2a8-0cad-4926-9ad1-eced0db2037d","Type":"ContainerDied","Data":"07617e76b5d2c78f4060a6aa82a0449bb7e6be66b37fdf9f043fabc4528cb11c"} Mar 16 16:54:15 crc kubenswrapper[5120]: I0316 16:54:15.264379 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-588bfd87d6-cq2c8" event={"ID":"119df2a8-0cad-4926-9ad1-eced0db2037d","Type":"ContainerDied","Data":"b9b06f5bd596d4bdbcb9074a49c7fb274d36644b6129bce1b9dce24f5aae10eb"} Mar 16 16:54:15 crc kubenswrapper[5120]: I0316 16:54:15.355494 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-588bfd87d6-cq2c8" Mar 16 16:54:15 crc kubenswrapper[5120]: I0316 16:54:15.529292 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pkqn8\" (UniqueName: \"kubernetes.io/projected/119df2a8-0cad-4926-9ad1-eced0db2037d-kube-api-access-pkqn8\") pod \"119df2a8-0cad-4926-9ad1-eced0db2037d\" (UID: \"119df2a8-0cad-4926-9ad1-eced0db2037d\") " Mar 16 16:54:15 crc kubenswrapper[5120]: I0316 16:54:15.529382 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/119df2a8-0cad-4926-9ad1-eced0db2037d-combined-ca-bundle\") pod \"119df2a8-0cad-4926-9ad1-eced0db2037d\" (UID: \"119df2a8-0cad-4926-9ad1-eced0db2037d\") " Mar 16 16:54:15 crc kubenswrapper[5120]: I0316 16:54:15.529503 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/119df2a8-0cad-4926-9ad1-eced0db2037d-config-data\") pod \"119df2a8-0cad-4926-9ad1-eced0db2037d\" (UID: \"119df2a8-0cad-4926-9ad1-eced0db2037d\") " Mar 16 16:54:15 crc kubenswrapper[5120]: I0316 16:54:15.529565 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/119df2a8-0cad-4926-9ad1-eced0db2037d-internal-tls-certs\") pod \"119df2a8-0cad-4926-9ad1-eced0db2037d\" (UID: \"119df2a8-0cad-4926-9ad1-eced0db2037d\") " Mar 16 16:54:15 crc kubenswrapper[5120]: I0316 16:54:15.529624 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/119df2a8-0cad-4926-9ad1-eced0db2037d-log-httpd\") pod \"119df2a8-0cad-4926-9ad1-eced0db2037d\" (UID: \"119df2a8-0cad-4926-9ad1-eced0db2037d\") " Mar 16 16:54:15 crc kubenswrapper[5120]: I0316 16:54:15.529800 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/119df2a8-0cad-4926-9ad1-eced0db2037d-etc-swift\") pod \"119df2a8-0cad-4926-9ad1-eced0db2037d\" (UID: \"119df2a8-0cad-4926-9ad1-eced0db2037d\") " Mar 16 16:54:15 crc kubenswrapper[5120]: I0316 16:54:15.529988 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/119df2a8-0cad-4926-9ad1-eced0db2037d-run-httpd\") pod \"119df2a8-0cad-4926-9ad1-eced0db2037d\" (UID: \"119df2a8-0cad-4926-9ad1-eced0db2037d\") " Mar 16 16:54:15 crc kubenswrapper[5120]: I0316 16:54:15.530243 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/119df2a8-0cad-4926-9ad1-eced0db2037d-public-tls-certs\") pod \"119df2a8-0cad-4926-9ad1-eced0db2037d\" (UID: \"119df2a8-0cad-4926-9ad1-eced0db2037d\") " Mar 16 16:54:15 crc kubenswrapper[5120]: I0316 16:54:15.531072 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/119df2a8-0cad-4926-9ad1-eced0db2037d-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "119df2a8-0cad-4926-9ad1-eced0db2037d" (UID: "119df2a8-0cad-4926-9ad1-eced0db2037d"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:54:15 crc kubenswrapper[5120]: I0316 16:54:15.531359 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/119df2a8-0cad-4926-9ad1-eced0db2037d-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:15 crc kubenswrapper[5120]: I0316 16:54:15.531400 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/119df2a8-0cad-4926-9ad1-eced0db2037d-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "119df2a8-0cad-4926-9ad1-eced0db2037d" (UID: "119df2a8-0cad-4926-9ad1-eced0db2037d"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:54:15 crc kubenswrapper[5120]: I0316 16:54:15.548884 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/119df2a8-0cad-4926-9ad1-eced0db2037d-etc-swift" (OuterVolumeSpecName: "etc-swift") pod "119df2a8-0cad-4926-9ad1-eced0db2037d" (UID: "119df2a8-0cad-4926-9ad1-eced0db2037d"). InnerVolumeSpecName "etc-swift". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:54:15 crc kubenswrapper[5120]: I0316 16:54:15.548995 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/119df2a8-0cad-4926-9ad1-eced0db2037d-kube-api-access-pkqn8" (OuterVolumeSpecName: "kube-api-access-pkqn8") pod "119df2a8-0cad-4926-9ad1-eced0db2037d" (UID: "119df2a8-0cad-4926-9ad1-eced0db2037d"). InnerVolumeSpecName "kube-api-access-pkqn8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:54:15 crc kubenswrapper[5120]: I0316 16:54:15.602323 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/119df2a8-0cad-4926-9ad1-eced0db2037d-config-data" (OuterVolumeSpecName: "config-data") pod "119df2a8-0cad-4926-9ad1-eced0db2037d" (UID: "119df2a8-0cad-4926-9ad1-eced0db2037d"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:54:15 crc kubenswrapper[5120]: I0316 16:54:15.604035 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/119df2a8-0cad-4926-9ad1-eced0db2037d-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "119df2a8-0cad-4926-9ad1-eced0db2037d" (UID: "119df2a8-0cad-4926-9ad1-eced0db2037d"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:54:15 crc kubenswrapper[5120]: I0316 16:54:15.608803 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/119df2a8-0cad-4926-9ad1-eced0db2037d-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "119df2a8-0cad-4926-9ad1-eced0db2037d" (UID: "119df2a8-0cad-4926-9ad1-eced0db2037d"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:54:15 crc kubenswrapper[5120]: I0316 16:54:15.630169 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/119df2a8-0cad-4926-9ad1-eced0db2037d-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "119df2a8-0cad-4926-9ad1-eced0db2037d" (UID: "119df2a8-0cad-4926-9ad1-eced0db2037d"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:54:15 crc kubenswrapper[5120]: I0316 16:54:15.643931 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/119df2a8-0cad-4926-9ad1-eced0db2037d-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:15 crc kubenswrapper[5120]: I0316 16:54:15.643987 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pkqn8\" (UniqueName: \"kubernetes.io/projected/119df2a8-0cad-4926-9ad1-eced0db2037d-kube-api-access-pkqn8\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:15 crc kubenswrapper[5120]: I0316 16:54:15.644005 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/119df2a8-0cad-4926-9ad1-eced0db2037d-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:15 crc kubenswrapper[5120]: I0316 16:54:15.644018 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/119df2a8-0cad-4926-9ad1-eced0db2037d-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:15 crc kubenswrapper[5120]: I0316 16:54:15.644030 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/119df2a8-0cad-4926-9ad1-eced0db2037d-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:15 crc kubenswrapper[5120]: I0316 16:54:15.644053 5120 reconciler_common.go:299] "Volume detached for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/119df2a8-0cad-4926-9ad1-eced0db2037d-etc-swift\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:15 crc kubenswrapper[5120]: I0316 16:54:15.644066 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/119df2a8-0cad-4926-9ad1-eced0db2037d-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:16 crc kubenswrapper[5120]: I0316 16:54:16.279438 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-588bfd87d6-cq2c8" Mar 16 16:54:16 crc kubenswrapper[5120]: I0316 16:54:16.279473 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-588bfd87d6-cq2c8" event={"ID":"119df2a8-0cad-4926-9ad1-eced0db2037d","Type":"ContainerDied","Data":"a6e6bc3be1119c3cd3003876cd117df507bfa52033efb69aee2caaa223aa07f7"} Mar 16 16:54:16 crc kubenswrapper[5120]: I0316 16:54:16.279542 5120 scope.go:117] "RemoveContainer" containerID="07617e76b5d2c78f4060a6aa82a0449bb7e6be66b37fdf9f043fabc4528cb11c" Mar 16 16:54:16 crc kubenswrapper[5120]: I0316 16:54:16.318433 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-proxy-588bfd87d6-cq2c8"] Mar 16 16:54:16 crc kubenswrapper[5120]: I0316 16:54:16.321603 5120 scope.go:117] "RemoveContainer" containerID="b9b06f5bd596d4bdbcb9074a49c7fb274d36644b6129bce1b9dce24f5aae10eb" Mar 16 16:54:16 crc kubenswrapper[5120]: I0316 16:54:16.329425 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/swift-proxy-588bfd87d6-cq2c8"] Mar 16 16:54:16 crc kubenswrapper[5120]: I0316 16:54:16.679298 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="119df2a8-0cad-4926-9ad1-eced0db2037d" path="/var/lib/kubelet/pods/119df2a8-0cad-4926-9ad1-eced0db2037d/volumes" Mar 16 16:54:18 crc kubenswrapper[5120]: I0316 16:54:18.037606 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/root-account-create-update-pwkr9"] Mar 16 16:54:18 crc kubenswrapper[5120]: I0316 16:54:18.039038 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="119df2a8-0cad-4926-9ad1-eced0db2037d" containerName="proxy-httpd" Mar 16 16:54:18 crc kubenswrapper[5120]: I0316 16:54:18.039059 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="119df2a8-0cad-4926-9ad1-eced0db2037d" containerName="proxy-httpd" Mar 16 16:54:18 crc kubenswrapper[5120]: I0316 16:54:18.039070 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="119df2a8-0cad-4926-9ad1-eced0db2037d" containerName="proxy-server" Mar 16 16:54:18 crc kubenswrapper[5120]: I0316 16:54:18.039077 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="119df2a8-0cad-4926-9ad1-eced0db2037d" containerName="proxy-server" Mar 16 16:54:18 crc kubenswrapper[5120]: I0316 16:54:18.039100 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1bb10ee5-fec2-4258-a05c-d8d8d80b12b0" containerName="extract-content" Mar 16 16:54:18 crc kubenswrapper[5120]: I0316 16:54:18.039107 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1bb10ee5-fec2-4258-a05c-d8d8d80b12b0" containerName="extract-content" Mar 16 16:54:18 crc kubenswrapper[5120]: I0316 16:54:18.039122 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5a15d20-fb3d-44d4-a5a6-287fc544f1a1" containerName="oc" Mar 16 16:54:18 crc kubenswrapper[5120]: I0316 16:54:18.039127 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5a15d20-fb3d-44d4-a5a6-287fc544f1a1" containerName="oc" Mar 16 16:54:18 crc kubenswrapper[5120]: I0316 16:54:18.039156 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e679f0b-5939-456f-b116-1bf25a1029a7" containerName="init" Mar 16 16:54:18 crc kubenswrapper[5120]: I0316 16:54:18.039161 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e679f0b-5939-456f-b116-1bf25a1029a7" containerName="init" Mar 16 16:54:18 crc kubenswrapper[5120]: I0316 16:54:18.039171 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1bb10ee5-fec2-4258-a05c-d8d8d80b12b0" containerName="extract-utilities" Mar 16 16:54:18 crc kubenswrapper[5120]: I0316 16:54:18.039177 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1bb10ee5-fec2-4258-a05c-d8d8d80b12b0" containerName="extract-utilities" Mar 16 16:54:18 crc kubenswrapper[5120]: I0316 16:54:18.039190 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e679f0b-5939-456f-b116-1bf25a1029a7" containerName="dnsmasq-dns" Mar 16 16:54:18 crc kubenswrapper[5120]: I0316 16:54:18.039195 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e679f0b-5939-456f-b116-1bf25a1029a7" containerName="dnsmasq-dns" Mar 16 16:54:18 crc kubenswrapper[5120]: I0316 16:54:18.039207 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1bb10ee5-fec2-4258-a05c-d8d8d80b12b0" containerName="registry-server" Mar 16 16:54:18 crc kubenswrapper[5120]: I0316 16:54:18.039213 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1bb10ee5-fec2-4258-a05c-d8d8d80b12b0" containerName="registry-server" Mar 16 16:54:18 crc kubenswrapper[5120]: I0316 16:54:18.039373 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="119df2a8-0cad-4926-9ad1-eced0db2037d" containerName="proxy-server" Mar 16 16:54:18 crc kubenswrapper[5120]: I0316 16:54:18.039384 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="119df2a8-0cad-4926-9ad1-eced0db2037d" containerName="proxy-httpd" Mar 16 16:54:18 crc kubenswrapper[5120]: I0316 16:54:18.039392 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1bb10ee5-fec2-4258-a05c-d8d8d80b12b0" containerName="registry-server" Mar 16 16:54:18 crc kubenswrapper[5120]: I0316 16:54:18.039406 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f5a15d20-fb3d-44d4-a5a6-287fc544f1a1" containerName="oc" Mar 16 16:54:18 crc kubenswrapper[5120]: I0316 16:54:18.039423 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="6e679f0b-5939-456f-b116-1bf25a1029a7" containerName="dnsmasq-dns" Mar 16 16:54:18 crc kubenswrapper[5120]: I0316 16:54:18.046847 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-pwkr9" Mar 16 16:54:18 crc kubenswrapper[5120]: I0316 16:54:18.069361 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"openstack-mariadb-root-db-secret\"" Mar 16 16:54:18 crc kubenswrapper[5120]: I0316 16:54:18.081716 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-1de0-account-create-update-rqhj2"] Mar 16 16:54:18 crc kubenswrapper[5120]: I0316 16:54:18.124641 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kd29k\" (UniqueName: \"kubernetes.io/projected/bbbbc69c-1fe6-40ae-a88a-a470f3f564ed-kube-api-access-kd29k\") pod \"root-account-create-update-pwkr9\" (UID: \"bbbbc69c-1fe6-40ae-a88a-a470f3f564ed\") " pod="openstack-kuttl-tests/root-account-create-update-pwkr9" Mar 16 16:54:18 crc kubenswrapper[5120]: I0316 16:54:18.124827 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/bbbbc69c-1fe6-40ae-a88a-a470f3f564ed-operator-scripts\") pod \"root-account-create-update-pwkr9\" (UID: \"bbbbc69c-1fe6-40ae-a88a-a470f3f564ed\") " pod="openstack-kuttl-tests/root-account-create-update-pwkr9" Mar 16 16:54:18 crc kubenswrapper[5120]: I0316 16:54:18.138253 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-1de0-account-create-update-rqhj2" Mar 16 16:54:18 crc kubenswrapper[5120]: I0316 16:54:18.160614 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-db-secret\"" Mar 16 16:54:18 crc kubenswrapper[5120]: I0316 16:54:18.243274 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-pwkr9"] Mar 16 16:54:18 crc kubenswrapper[5120]: I0316 16:54:18.249825 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9dh2\" (UniqueName: \"kubernetes.io/projected/ffbba34f-0cbb-4345-931f-9c4c763847e1-kube-api-access-q9dh2\") pod \"barbican-1de0-account-create-update-rqhj2\" (UID: \"ffbba34f-0cbb-4345-931f-9c4c763847e1\") " pod="openstack-kuttl-tests/barbican-1de0-account-create-update-rqhj2" Mar 16 16:54:18 crc kubenswrapper[5120]: I0316 16:54:18.251285 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ffbba34f-0cbb-4345-931f-9c4c763847e1-operator-scripts\") pod \"barbican-1de0-account-create-update-rqhj2\" (UID: \"ffbba34f-0cbb-4345-931f-9c4c763847e1\") " pod="openstack-kuttl-tests/barbican-1de0-account-create-update-rqhj2" Mar 16 16:54:18 crc kubenswrapper[5120]: I0316 16:54:18.251395 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kd29k\" (UniqueName: \"kubernetes.io/projected/bbbbc69c-1fe6-40ae-a88a-a470f3f564ed-kube-api-access-kd29k\") pod \"root-account-create-update-pwkr9\" (UID: \"bbbbc69c-1fe6-40ae-a88a-a470f3f564ed\") " pod="openstack-kuttl-tests/root-account-create-update-pwkr9" Mar 16 16:54:18 crc kubenswrapper[5120]: I0316 16:54:18.251952 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/bbbbc69c-1fe6-40ae-a88a-a470f3f564ed-operator-scripts\") pod \"root-account-create-update-pwkr9\" (UID: \"bbbbc69c-1fe6-40ae-a88a-a470f3f564ed\") " pod="openstack-kuttl-tests/root-account-create-update-pwkr9" Mar 16 16:54:18 crc kubenswrapper[5120]: I0316 16:54:18.252775 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/bbbbc69c-1fe6-40ae-a88a-a470f3f564ed-operator-scripts\") pod \"root-account-create-update-pwkr9\" (UID: \"bbbbc69c-1fe6-40ae-a88a-a470f3f564ed\") " pod="openstack-kuttl-tests/root-account-create-update-pwkr9" Mar 16 16:54:18 crc kubenswrapper[5120]: I0316 16:54:18.336568 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kd29k\" (UniqueName: \"kubernetes.io/projected/bbbbc69c-1fe6-40ae-a88a-a470f3f564ed-kube-api-access-kd29k\") pod \"root-account-create-update-pwkr9\" (UID: \"bbbbc69c-1fe6-40ae-a88a-a470f3f564ed\") " pod="openstack-kuttl-tests/root-account-create-update-pwkr9" Mar 16 16:54:18 crc kubenswrapper[5120]: I0316 16:54:18.360032 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 16:54:18 crc kubenswrapper[5120]: I0316 16:54:18.366841 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q9dh2\" (UniqueName: \"kubernetes.io/projected/ffbba34f-0cbb-4345-931f-9c4c763847e1-kube-api-access-q9dh2\") pod \"barbican-1de0-account-create-update-rqhj2\" (UID: \"ffbba34f-0cbb-4345-931f-9c4c763847e1\") " pod="openstack-kuttl-tests/barbican-1de0-account-create-update-rqhj2" Mar 16 16:54:18 crc kubenswrapper[5120]: I0316 16:54:18.367123 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ffbba34f-0cbb-4345-931f-9c4c763847e1-operator-scripts\") pod \"barbican-1de0-account-create-update-rqhj2\" (UID: \"ffbba34f-0cbb-4345-931f-9c4c763847e1\") " pod="openstack-kuttl-tests/barbican-1de0-account-create-update-rqhj2" Mar 16 16:54:18 crc kubenswrapper[5120]: I0316 16:54:18.368448 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ffbba34f-0cbb-4345-931f-9c4c763847e1-operator-scripts\") pod \"barbican-1de0-account-create-update-rqhj2\" (UID: \"ffbba34f-0cbb-4345-931f-9c4c763847e1\") " pod="openstack-kuttl-tests/barbican-1de0-account-create-update-rqhj2" Mar 16 16:54:18 crc kubenswrapper[5120]: I0316 16:54:18.436218 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-1de0-account-create-update-rqhj2"] Mar 16 16:54:18 crc kubenswrapper[5120]: I0316 16:54:18.445591 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-pwkr9" Mar 16 16:54:18 crc kubenswrapper[5120]: I0316 16:54:18.454744 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9dh2\" (UniqueName: \"kubernetes.io/projected/ffbba34f-0cbb-4345-931f-9c4c763847e1-kube-api-access-q9dh2\") pod \"barbican-1de0-account-create-update-rqhj2\" (UID: \"ffbba34f-0cbb-4345-931f-9c4c763847e1\") " pod="openstack-kuttl-tests/barbican-1de0-account-create-update-rqhj2" Mar 16 16:54:18 crc kubenswrapper[5120]: I0316 16:54:18.476929 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-q5h5l"] Mar 16 16:54:18 crc kubenswrapper[5120]: I0316 16:54:18.491221 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-1de0-account-create-update-rqhj2" Mar 16 16:54:18 crc kubenswrapper[5120]: I0316 16:54:18.538136 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-q5h5l"] Mar 16 16:54:18 crc kubenswrapper[5120]: I0316 16:54:18.550841 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-1de0-account-create-update-p66v4"] Mar 16 16:54:18 crc kubenswrapper[5120]: I0316 16:54:18.574028 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-0ea4-account-create-update-tl2bd"] Mar 16 16:54:18 crc kubenswrapper[5120]: E0316 16:54:18.600021 5120 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod133b5e0f_d834_4c59_932f_957221e1727b.slice/crio-550a482710c28eab0491207e17c6a03a7948797a16de7ca95046c49632833e1e\": RecentStats: unable to find data in memory cache]" Mar 16 16:54:18 crc kubenswrapper[5120]: I0316 16:54:18.605176 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-0ea4-account-create-update-tl2bd" Mar 16 16:54:18 crc kubenswrapper[5120]: I0316 16:54:18.613002 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-db-secret\"" Mar 16 16:54:18 crc kubenswrapper[5120]: I0316 16:54:18.613022 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-1de0-account-create-update-p66v4"] Mar 16 16:54:18 crc kubenswrapper[5120]: I0316 16:54:18.667872 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-2845-account-create-update-2mnh7"] Mar 16 16:54:18 crc kubenswrapper[5120]: I0316 16:54:18.692121 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-2845-account-create-update-2mnh7" Mar 16 16:54:18 crc kubenswrapper[5120]: I0316 16:54:18.701732 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-db-secret\"" Mar 16 16:54:18 crc kubenswrapper[5120]: I0316 16:54:18.707606 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ct68\" (UniqueName: \"kubernetes.io/projected/fb775edc-5783-4ad6-a85e-ec4d71ac7f5c-kube-api-access-9ct68\") pod \"placement-0ea4-account-create-update-tl2bd\" (UID: \"fb775edc-5783-4ad6-a85e-ec4d71ac7f5c\") " pod="openstack-kuttl-tests/placement-0ea4-account-create-update-tl2bd" Mar 16 16:54:18 crc kubenswrapper[5120]: I0316 16:54:18.707676 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/fb775edc-5783-4ad6-a85e-ec4d71ac7f5c-operator-scripts\") pod \"placement-0ea4-account-create-update-tl2bd\" (UID: \"fb775edc-5783-4ad6-a85e-ec4d71ac7f5c\") " pod="openstack-kuttl-tests/placement-0ea4-account-create-update-tl2bd" Mar 16 16:54:18 crc kubenswrapper[5120]: I0316 16:54:18.760476 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="35e78e32-efae-42ac-b210-17cc868c1713" path="/var/lib/kubelet/pods/35e78e32-efae-42ac-b210-17cc868c1713/volumes" Mar 16 16:54:18 crc kubenswrapper[5120]: I0316 16:54:18.761088 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c5fb2bc-3128-4de7-acbe-430ae8cdafa7" path="/var/lib/kubelet/pods/7c5fb2bc-3128-4de7-acbe-430ae8cdafa7/volumes" Mar 16 16:54:18 crc kubenswrapper[5120]: I0316 16:54:18.761653 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-0ea4-account-create-update-tl2bd"] Mar 16 16:54:18 crc kubenswrapper[5120]: I0316 16:54:18.815791 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/bb4b3750-ad5c-4e9e-9824-caba853515cd-operator-scripts\") pod \"glance-2845-account-create-update-2mnh7\" (UID: \"bb4b3750-ad5c-4e9e-9824-caba853515cd\") " pod="openstack-kuttl-tests/glance-2845-account-create-update-2mnh7" Mar 16 16:54:18 crc kubenswrapper[5120]: I0316 16:54:18.816005 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9ct68\" (UniqueName: \"kubernetes.io/projected/fb775edc-5783-4ad6-a85e-ec4d71ac7f5c-kube-api-access-9ct68\") pod \"placement-0ea4-account-create-update-tl2bd\" (UID: \"fb775edc-5783-4ad6-a85e-ec4d71ac7f5c\") " pod="openstack-kuttl-tests/placement-0ea4-account-create-update-tl2bd" Mar 16 16:54:18 crc kubenswrapper[5120]: I0316 16:54:18.816037 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8pdbp\" (UniqueName: \"kubernetes.io/projected/bb4b3750-ad5c-4e9e-9824-caba853515cd-kube-api-access-8pdbp\") pod \"glance-2845-account-create-update-2mnh7\" (UID: \"bb4b3750-ad5c-4e9e-9824-caba853515cd\") " pod="openstack-kuttl-tests/glance-2845-account-create-update-2mnh7" Mar 16 16:54:18 crc kubenswrapper[5120]: I0316 16:54:18.816062 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/fb775edc-5783-4ad6-a85e-ec4d71ac7f5c-operator-scripts\") pod \"placement-0ea4-account-create-update-tl2bd\" (UID: \"fb775edc-5783-4ad6-a85e-ec4d71ac7f5c\") " pod="openstack-kuttl-tests/placement-0ea4-account-create-update-tl2bd" Mar 16 16:54:18 crc kubenswrapper[5120]: I0316 16:54:18.816876 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/fb775edc-5783-4ad6-a85e-ec4d71ac7f5c-operator-scripts\") pod \"placement-0ea4-account-create-update-tl2bd\" (UID: \"fb775edc-5783-4ad6-a85e-ec4d71ac7f5c\") " pod="openstack-kuttl-tests/placement-0ea4-account-create-update-tl2bd" Mar 16 16:54:18 crc kubenswrapper[5120]: I0316 16:54:18.822820 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 16:54:18 crc kubenswrapper[5120]: I0316 16:54:18.823134 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/openstackclient" podUID="52f09603-9dff-4c67-a4b9-7bb162cd4a40" containerName="openstackclient" containerID="cri-o://5c97c398f0afe37fdf9742e5a29f3aceed602ae6a9ab68f801d5897d0ffcefea" gracePeriod=2 Mar 16 16:54:18 crc kubenswrapper[5120]: I0316 16:54:18.831510 5120 status_manager.go:895] "Failed to get status for pod" podUID="52f09603-9dff-4c67-a4b9-7bb162cd4a40" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 16:54:18 crc kubenswrapper[5120]: I0316 16:54:18.887892 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ct68\" (UniqueName: \"kubernetes.io/projected/fb775edc-5783-4ad6-a85e-ec4d71ac7f5c-kube-api-access-9ct68\") pod \"placement-0ea4-account-create-update-tl2bd\" (UID: \"fb775edc-5783-4ad6-a85e-ec4d71ac7f5c\") " pod="openstack-kuttl-tests/placement-0ea4-account-create-update-tl2bd" Mar 16 16:54:18 crc kubenswrapper[5120]: I0316 16:54:18.910449 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 16:54:18 crc kubenswrapper[5120]: I0316 16:54:18.917818 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8pdbp\" (UniqueName: \"kubernetes.io/projected/bb4b3750-ad5c-4e9e-9824-caba853515cd-kube-api-access-8pdbp\") pod \"glance-2845-account-create-update-2mnh7\" (UID: \"bb4b3750-ad5c-4e9e-9824-caba853515cd\") " pod="openstack-kuttl-tests/glance-2845-account-create-update-2mnh7" Mar 16 16:54:18 crc kubenswrapper[5120]: I0316 16:54:18.921152 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/bb4b3750-ad5c-4e9e-9824-caba853515cd-operator-scripts\") pod \"glance-2845-account-create-update-2mnh7\" (UID: \"bb4b3750-ad5c-4e9e-9824-caba853515cd\") " pod="openstack-kuttl-tests/glance-2845-account-create-update-2mnh7" Mar 16 16:54:18 crc kubenswrapper[5120]: I0316 16:54:18.926822 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/bb4b3750-ad5c-4e9e-9824-caba853515cd-operator-scripts\") pod \"glance-2845-account-create-update-2mnh7\" (UID: \"bb4b3750-ad5c-4e9e-9824-caba853515cd\") " pod="openstack-kuttl-tests/glance-2845-account-create-update-2mnh7" Mar 16 16:54:18 crc kubenswrapper[5120]: I0316 16:54:18.942271 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-0ea4-account-create-update-tl2bd" Mar 16 16:54:18 crc kubenswrapper[5120]: I0316 16:54:18.964123 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-0ea4-account-create-update-gq8gc"] Mar 16 16:54:19 crc kubenswrapper[5120]: I0316 16:54:19.007057 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-0ea4-account-create-update-gq8gc"] Mar 16 16:54:19 crc kubenswrapper[5120]: I0316 16:54:19.028720 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8pdbp\" (UniqueName: \"kubernetes.io/projected/bb4b3750-ad5c-4e9e-9824-caba853515cd-kube-api-access-8pdbp\") pod \"glance-2845-account-create-update-2mnh7\" (UID: \"bb4b3750-ad5c-4e9e-9824-caba853515cd\") " pod="openstack-kuttl-tests/glance-2845-account-create-update-2mnh7" Mar 16 16:54:19 crc kubenswrapper[5120]: I0316 16:54:19.043132 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-2845-account-create-update-2mnh7"] Mar 16 16:54:19 crc kubenswrapper[5120]: I0316 16:54:19.082182 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-2845-account-create-update-9n4l2"] Mar 16 16:54:19 crc kubenswrapper[5120]: I0316 16:54:19.089459 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-2845-account-create-update-9n4l2"] Mar 16 16:54:19 crc kubenswrapper[5120]: I0316 16:54:19.104822 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-2845-account-create-update-2mnh7" Mar 16 16:54:19 crc kubenswrapper[5120]: I0316 16:54:19.194201 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-0869-account-create-update-c899g"] Mar 16 16:54:19 crc kubenswrapper[5120]: I0316 16:54:19.195474 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52f09603-9dff-4c67-a4b9-7bb162cd4a40" containerName="openstackclient" Mar 16 16:54:19 crc kubenswrapper[5120]: I0316 16:54:19.195494 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="52f09603-9dff-4c67-a4b9-7bb162cd4a40" containerName="openstackclient" Mar 16 16:54:19 crc kubenswrapper[5120]: I0316 16:54:19.195665 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="52f09603-9dff-4c67-a4b9-7bb162cd4a40" containerName="openstackclient" Mar 16 16:54:19 crc kubenswrapper[5120]: I0316 16:54:19.228956 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-0869-account-create-update-c899g" Mar 16 16:54:19 crc kubenswrapper[5120]: I0316 16:54:19.235042 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-0869-account-create-update-c899g"] Mar 16 16:54:19 crc kubenswrapper[5120]: I0316 16:54:19.239701 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-db-secret\"" Mar 16 16:54:19 crc kubenswrapper[5120]: I0316 16:54:19.258161 5120 status_manager.go:895] "Failed to get status for pod" podUID="52f09603-9dff-4c67-a4b9-7bb162cd4a40" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 16:54:19 crc kubenswrapper[5120]: I0316 16:54:19.271671 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-0869-account-create-update-vch67"] Mar 16 16:54:19 crc kubenswrapper[5120]: I0316 16:54:19.303414 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-0869-account-create-update-vch67"] Mar 16 16:54:19 crc kubenswrapper[5120]: I0316 16:54:19.331233 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 16:54:19 crc kubenswrapper[5120]: I0316 16:54:19.331966 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podUID="b3ff7a5c-9d60-4d20-9308-0b7d88d605f6" containerName="openstack-network-exporter" containerID="cri-o://eefe2c9b53c6bd8747cdce644a861bbc411bf663cd9a7b5171573eeb873ff874" gracePeriod=300 Mar 16 16:54:19 crc kubenswrapper[5120]: I0316 16:54:19.334418 5120 status_manager.go:895] "Failed to get status for pod" podUID="52f09603-9dff-4c67-a4b9-7bb162cd4a40" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 16:54:19 crc kubenswrapper[5120]: I0316 16:54:19.347917 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/df3f2e26-88e4-445e-a448-f05b062ff2b3-operator-scripts\") pod \"cinder-0869-account-create-update-c899g\" (UID: \"df3f2e26-88e4-445e-a448-f05b062ff2b3\") " pod="openstack-kuttl-tests/cinder-0869-account-create-update-c899g" Mar 16 16:54:19 crc kubenswrapper[5120]: I0316 16:54:19.348274 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vs8wt\" (UniqueName: \"kubernetes.io/projected/df3f2e26-88e4-445e-a448-f05b062ff2b3-kube-api-access-vs8wt\") pod \"cinder-0869-account-create-update-c899g\" (UID: \"df3f2e26-88e4-445e-a448-f05b062ff2b3\") " pod="openstack-kuttl-tests/cinder-0869-account-create-update-c899g" Mar 16 16:54:19 crc kubenswrapper[5120]: I0316 16:54:19.364498 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 16:54:19 crc kubenswrapper[5120]: I0316 16:54:19.369430 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podUID="d1960e17-5bd0-46f5-9155-8dd50410168f" containerName="openstack-network-exporter" containerID="cri-o://3f67575c174de4ec88325dae52c495fc5f7e8288f1f83576c731cc6677398a1b" gracePeriod=300 Mar 16 16:54:19 crc kubenswrapper[5120]: I0316 16:54:19.375039 5120 status_manager.go:895] "Failed to get status for pod" podUID="52f09603-9dff-4c67-a4b9-7bb162cd4a40" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 16:54:19 crc kubenswrapper[5120]: I0316 16:54:19.453050 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vs8wt\" (UniqueName: \"kubernetes.io/projected/df3f2e26-88e4-445e-a448-f05b062ff2b3-kube-api-access-vs8wt\") pod \"cinder-0869-account-create-update-c899g\" (UID: \"df3f2e26-88e4-445e-a448-f05b062ff2b3\") " pod="openstack-kuttl-tests/cinder-0869-account-create-update-c899g" Mar 16 16:54:19 crc kubenswrapper[5120]: I0316 16:54:19.453839 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/df3f2e26-88e4-445e-a448-f05b062ff2b3-operator-scripts\") pod \"cinder-0869-account-create-update-c899g\" (UID: \"df3f2e26-88e4-445e-a448-f05b062ff2b3\") " pod="openstack-kuttl-tests/cinder-0869-account-create-update-c899g" Mar 16 16:54:19 crc kubenswrapper[5120]: I0316 16:54:19.459901 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/df3f2e26-88e4-445e-a448-f05b062ff2b3-operator-scripts\") pod \"cinder-0869-account-create-update-c899g\" (UID: \"df3f2e26-88e4-445e-a448-f05b062ff2b3\") " pod="openstack-kuttl-tests/cinder-0869-account-create-update-c899g" Mar 16 16:54:19 crc kubenswrapper[5120]: I0316 16:54:19.463799 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-b06a-account-create-update-7v27d"] Mar 16 16:54:19 crc kubenswrapper[5120]: I0316 16:54:19.540092 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vs8wt\" (UniqueName: \"kubernetes.io/projected/df3f2e26-88e4-445e-a448-f05b062ff2b3-kube-api-access-vs8wt\") pod \"cinder-0869-account-create-update-c899g\" (UID: \"df3f2e26-88e4-445e-a448-f05b062ff2b3\") " pod="openstack-kuttl-tests/cinder-0869-account-create-update-c899g" Mar 16 16:54:19 crc kubenswrapper[5120]: I0316 16:54:19.543831 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podUID="b3ff7a5c-9d60-4d20-9308-0b7d88d605f6" containerName="ovsdbserver-nb" containerID="cri-o://76c5f5136097b2b8e13a204ec73f3c4bfff9a3caf4e6a7039b057c002d9745c3" gracePeriod=300 Mar 16 16:54:19 crc kubenswrapper[5120]: I0316 16:54:19.570481 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podUID="d1960e17-5bd0-46f5-9155-8dd50410168f" containerName="ovsdbserver-sb" containerID="cri-o://2c1d127125047f30b595c38ecdb848f5a2764132632a382908881dde9b715eb6" gracePeriod=300 Mar 16 16:54:19 crc kubenswrapper[5120]: I0316 16:54:19.597979 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-0869-account-create-update-c899g" Mar 16 16:54:19 crc kubenswrapper[5120]: I0316 16:54:19.604198 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-b06a-account-create-update-7v27d" Mar 16 16:54:19 crc kubenswrapper[5120]: I0316 16:54:19.618426 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-db-secret\"" Mar 16 16:54:19 crc kubenswrapper[5120]: I0316 16:54:19.646994 5120 status_manager.go:895] "Failed to get status for pod" podUID="52f09603-9dff-4c67-a4b9-7bb162cd4a40" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 16:54:19 crc kubenswrapper[5120]: I0316 16:54:19.670165 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-b06a-account-create-update-7v27d"] Mar 16 16:54:19 crc kubenswrapper[5120]: I0316 16:54:19.689922 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-774a-account-create-update-tkwhv"] Mar 16 16:54:19 crc kubenswrapper[5120]: I0316 16:54:19.696926 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-774a-account-create-update-tkwhv" Mar 16 16:54:19 crc kubenswrapper[5120]: I0316 16:54:19.701707 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-db-secret\"" Mar 16 16:54:19 crc kubenswrapper[5120]: I0316 16:54:19.703183 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkr7c\" (UniqueName: \"kubernetes.io/projected/5c8124f6-11f6-49fd-94a8-d931c557b6c4-kube-api-access-pkr7c\") pod \"neutron-b06a-account-create-update-7v27d\" (UID: \"5c8124f6-11f6-49fd-94a8-d931c557b6c4\") " pod="openstack-kuttl-tests/neutron-b06a-account-create-update-7v27d" Mar 16 16:54:19 crc kubenswrapper[5120]: I0316 16:54:19.703786 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5c8124f6-11f6-49fd-94a8-d931c557b6c4-operator-scripts\") pod \"neutron-b06a-account-create-update-7v27d\" (UID: \"5c8124f6-11f6-49fd-94a8-d931c557b6c4\") " pod="openstack-kuttl-tests/neutron-b06a-account-create-update-7v27d" Mar 16 16:54:19 crc kubenswrapper[5120]: I0316 16:54:19.736224 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-774a-account-create-update-tkwhv"] Mar 16 16:54:19 crc kubenswrapper[5120]: I0316 16:54:19.744238 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-b06a-account-create-update-ngkgs"] Mar 16 16:54:19 crc kubenswrapper[5120]: I0316 16:54:19.750280 5120 status_manager.go:895] "Failed to get status for pod" podUID="52f09603-9dff-4c67-a4b9-7bb162cd4a40" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 16:54:19 crc kubenswrapper[5120]: I0316 16:54:19.754625 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-b06a-account-create-update-ngkgs"] Mar 16 16:54:19 crc kubenswrapper[5120]: I0316 16:54:19.787812 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 16:54:19 crc kubenswrapper[5120]: I0316 16:54:19.788234 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovn-northd-0" podUID="d2f6e14c-b704-4805-b5fa-33de25bc4f0f" containerName="ovn-northd" containerID="cri-o://02d4b3980426703b64bb4594387bb6ec9a3bd1e0687735c81eacb5de5e3a1047" gracePeriod=30 Mar 16 16:54:19 crc kubenswrapper[5120]: I0316 16:54:19.788641 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovn-northd-0" podUID="d2f6e14c-b704-4805-b5fa-33de25bc4f0f" containerName="openstack-network-exporter" containerID="cri-o://17ca7c826c304f51fb924754427aadc5afd13c084da739b85388c42c18fc61f1" gracePeriod=30 Mar 16 16:54:19 crc kubenswrapper[5120]: I0316 16:54:19.806610 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5c8124f6-11f6-49fd-94a8-d931c557b6c4-operator-scripts\") pod \"neutron-b06a-account-create-update-7v27d\" (UID: \"5c8124f6-11f6-49fd-94a8-d931c557b6c4\") " pod="openstack-kuttl-tests/neutron-b06a-account-create-update-7v27d" Mar 16 16:54:19 crc kubenswrapper[5120]: I0316 16:54:19.806653 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/215bcff0-714b-427b-ab26-130a21366d15-operator-scripts\") pod \"nova-api-774a-account-create-update-tkwhv\" (UID: \"215bcff0-714b-427b-ab26-130a21366d15\") " pod="openstack-kuttl-tests/nova-api-774a-account-create-update-tkwhv" Mar 16 16:54:19 crc kubenswrapper[5120]: I0316 16:54:19.806731 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pkr7c\" (UniqueName: \"kubernetes.io/projected/5c8124f6-11f6-49fd-94a8-d931c557b6c4-kube-api-access-pkr7c\") pod \"neutron-b06a-account-create-update-7v27d\" (UID: \"5c8124f6-11f6-49fd-94a8-d931c557b6c4\") " pod="openstack-kuttl-tests/neutron-b06a-account-create-update-7v27d" Mar 16 16:54:19 crc kubenswrapper[5120]: I0316 16:54:19.807060 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7r8js\" (UniqueName: \"kubernetes.io/projected/215bcff0-714b-427b-ab26-130a21366d15-kube-api-access-7r8js\") pod \"nova-api-774a-account-create-update-tkwhv\" (UID: \"215bcff0-714b-427b-ab26-130a21366d15\") " pod="openstack-kuttl-tests/nova-api-774a-account-create-update-tkwhv" Mar 16 16:54:19 crc kubenswrapper[5120]: I0316 16:54:19.807594 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5c8124f6-11f6-49fd-94a8-d931c557b6c4-operator-scripts\") pod \"neutron-b06a-account-create-update-7v27d\" (UID: \"5c8124f6-11f6-49fd-94a8-d931c557b6c4\") " pod="openstack-kuttl-tests/neutron-b06a-account-create-update-7v27d" Mar 16 16:54:19 crc kubenswrapper[5120]: I0316 16:54:19.812201 5120 status_manager.go:895] "Failed to get status for pod" podUID="52f09603-9dff-4c67-a4b9-7bb162cd4a40" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 16:54:19 crc kubenswrapper[5120]: I0316 16:54:19.828344 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-774a-account-create-update-cvlrt"] Mar 16 16:54:19 crc kubenswrapper[5120]: I0316 16:54:19.853951 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkr7c\" (UniqueName: \"kubernetes.io/projected/5c8124f6-11f6-49fd-94a8-d931c557b6c4-kube-api-access-pkr7c\") pod \"neutron-b06a-account-create-update-7v27d\" (UID: \"5c8124f6-11f6-49fd-94a8-d931c557b6c4\") " pod="openstack-kuttl-tests/neutron-b06a-account-create-update-7v27d" Mar 16 16:54:19 crc kubenswrapper[5120]: I0316 16:54:19.863269 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-774a-account-create-update-cvlrt"] Mar 16 16:54:19 crc kubenswrapper[5120]: I0316 16:54:19.866574 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-b06a-account-create-update-7v27d" Mar 16 16:54:19 crc kubenswrapper[5120]: I0316 16:54:19.877928 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-6xnr6"] Mar 16 16:54:19 crc kubenswrapper[5120]: I0316 16:54:19.915882 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/215bcff0-714b-427b-ab26-130a21366d15-operator-scripts\") pod \"nova-api-774a-account-create-update-tkwhv\" (UID: \"215bcff0-714b-427b-ab26-130a21366d15\") " pod="openstack-kuttl-tests/nova-api-774a-account-create-update-tkwhv" Mar 16 16:54:19 crc kubenswrapper[5120]: I0316 16:54:19.916930 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7r8js\" (UniqueName: \"kubernetes.io/projected/215bcff0-714b-427b-ab26-130a21366d15-kube-api-access-7r8js\") pod \"nova-api-774a-account-create-update-tkwhv\" (UID: \"215bcff0-714b-427b-ab26-130a21366d15\") " pod="openstack-kuttl-tests/nova-api-774a-account-create-update-tkwhv" Mar 16 16:54:19 crc kubenswrapper[5120]: I0316 16:54:19.918259 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/215bcff0-714b-427b-ab26-130a21366d15-operator-scripts\") pod \"nova-api-774a-account-create-update-tkwhv\" (UID: \"215bcff0-714b-427b-ab26-130a21366d15\") " pod="openstack-kuttl-tests/nova-api-774a-account-create-update-tkwhv" Mar 16 16:54:19 crc kubenswrapper[5120]: I0316 16:54:19.979822 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-6xnr6"] Mar 16 16:54:19 crc kubenswrapper[5120]: I0316 16:54:19.995212 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7r8js\" (UniqueName: \"kubernetes.io/projected/215bcff0-714b-427b-ab26-130a21366d15-kube-api-access-7r8js\") pod \"nova-api-774a-account-create-update-tkwhv\" (UID: \"215bcff0-714b-427b-ab26-130a21366d15\") " pod="openstack-kuttl-tests/nova-api-774a-account-create-update-tkwhv" Mar 16 16:54:20 crc kubenswrapper[5120]: W0316 16:54:20.001492 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbbbbc69c_1fe6_40ae_a88a_a470f3f564ed.slice/crio-f584a339d8753576caeeb37e16b92edf4af09a9550e628a3dae90c8d6f8c2ef3 WatchSource:0}: Error finding container f584a339d8753576caeeb37e16b92edf4af09a9550e628a3dae90c8d6f8c2ef3: Status 404 returned error can't find the container with id f584a339d8753576caeeb37e16b92edf4af09a9550e628a3dae90c8d6f8c2ef3 Mar 16 16:54:20 crc kubenswrapper[5120]: I0316 16:54:20.003774 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-5a68-account-create-update-9nxpw"] Mar 16 16:54:20 crc kubenswrapper[5120]: I0316 16:54:20.022539 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-5a68-account-create-update-9nxpw"] Mar 16 16:54:20 crc kubenswrapper[5120]: I0316 16:54:20.022737 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-5a68-account-create-update-9nxpw" Mar 16 16:54:20 crc kubenswrapper[5120]: I0316 16:54:20.025752 5120 status_manager.go:895] "Failed to get status for pod" podUID="52f09603-9dff-4c67-a4b9-7bb162cd4a40" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 16:54:20 crc kubenswrapper[5120]: I0316 16:54:20.026352 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-db-secret\"" Mar 16 16:54:20 crc kubenswrapper[5120]: E0316 16:54:20.046969 5120 kuberuntime_manager.go:1358] "Unhandled Error" err=< Mar 16 16:54:20 crc kubenswrapper[5120]: container &Container{Name:mariadb-account-create-update,Image:quay.io/podified-antelope-centos9/openstack-mariadb@sha256:4caef2b55e01b9a7ee88a22bc69db1893521a91d95c7ad4c8e593f14f17a5f95,Command:[/bin/sh -c #!/bin/bash Mar 16 16:54:20 crc kubenswrapper[5120]: Mar 16 16:54:20 crc kubenswrapper[5120]: MYSQL_REMOTE_HOST="" source /var/lib/operator-scripts/mysql_root_auth.sh Mar 16 16:54:20 crc kubenswrapper[5120]: Mar 16 16:54:20 crc kubenswrapper[5120]: export DatabasePassword=${DatabasePassword:?"Please specify a DatabasePassword variable."} Mar 16 16:54:20 crc kubenswrapper[5120]: Mar 16 16:54:20 crc kubenswrapper[5120]: MYSQL_CMD="mysql -h -u root -P 3306" Mar 16 16:54:20 crc kubenswrapper[5120]: Mar 16 16:54:20 crc kubenswrapper[5120]: if [ -n "barbican" ]; then Mar 16 16:54:20 crc kubenswrapper[5120]: GRANT_DATABASE="barbican" Mar 16 16:54:20 crc kubenswrapper[5120]: else Mar 16 16:54:20 crc kubenswrapper[5120]: GRANT_DATABASE="*" Mar 16 16:54:20 crc kubenswrapper[5120]: fi Mar 16 16:54:20 crc kubenswrapper[5120]: Mar 16 16:54:20 crc kubenswrapper[5120]: # going for maximum compatibility here: Mar 16 16:54:20 crc kubenswrapper[5120]: # 1. MySQL 8 no longer allows implicit create user when GRANT is used Mar 16 16:54:20 crc kubenswrapper[5120]: # 2. MariaDB has "CREATE OR REPLACE", but MySQL does not Mar 16 16:54:20 crc kubenswrapper[5120]: # 3. create user with CREATE but then do all password and TLS with ALTER to Mar 16 16:54:20 crc kubenswrapper[5120]: # support updates Mar 16 16:54:20 crc kubenswrapper[5120]: Mar 16 16:54:20 crc kubenswrapper[5120]: $MYSQL_CMD < logger="UnhandledError" Mar 16 16:54:20 crc kubenswrapper[5120]: E0316 16:54:20.049941 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"mariadb-account-create-update\" with CreateContainerConfigError: \"secret \\\"barbican-db-secret\\\" not found\"" pod="openstack-kuttl-tests/barbican-1de0-account-create-update-rqhj2" podUID="ffbba34f-0cbb-4345-931f-9c4c763847e1" Mar 16 16:54:20 crc kubenswrapper[5120]: I0316 16:54:20.091908 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 16:54:20 crc kubenswrapper[5120]: I0316 16:54:20.126214 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-hvllz"] Mar 16 16:54:20 crc kubenswrapper[5120]: I0316 16:54:20.130099 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xprnd\" (UniqueName: \"kubernetes.io/projected/e1ae96f9-27a3-4c3f-a7d4-334875177194-kube-api-access-xprnd\") pod \"nova-cell0-5a68-account-create-update-9nxpw\" (UID: \"e1ae96f9-27a3-4c3f-a7d4-334875177194\") " pod="openstack-kuttl-tests/nova-cell0-5a68-account-create-update-9nxpw" Mar 16 16:54:20 crc kubenswrapper[5120]: E0316 16:54:20.130190 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Mar 16 16:54:20 crc kubenswrapper[5120]: I0316 16:54:20.130398 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e1ae96f9-27a3-4c3f-a7d4-334875177194-operator-scripts\") pod \"nova-cell0-5a68-account-create-update-9nxpw\" (UID: \"e1ae96f9-27a3-4c3f-a7d4-334875177194\") " pod="openstack-kuttl-tests/nova-cell0-5a68-account-create-update-9nxpw" Mar 16 16:54:20 crc kubenswrapper[5120]: E0316 16:54:20.130577 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/27ae46b8-fa26-48e8-a9bb-36bc910c3caf-config-data podName:27ae46b8-fa26-48e8-a9bb-36bc910c3caf nodeName:}" failed. No retries permitted until 2026-03-16 16:54:20.630557614 +0000 UTC m=+4962.784489271 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/27ae46b8-fa26-48e8-a9bb-36bc910c3caf-config-data") pod "rabbitmq-cell1-server-0" (UID: "27ae46b8-fa26-48e8-a9bb-36bc910c3caf") : configmap "rabbitmq-cell1-config-data" not found Mar 16 16:54:20 crc kubenswrapper[5120]: I0316 16:54:20.172004 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-hvllz"] Mar 16 16:54:20 crc kubenswrapper[5120]: I0316 16:54:20.183797 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-5a68-account-create-update-6nxhs"] Mar 16 16:54:20 crc kubenswrapper[5120]: I0316 16:54:20.200673 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-5a68-account-create-update-6nxhs"] Mar 16 16:54:20 crc kubenswrapper[5120]: I0316 16:54:20.230110 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-774a-account-create-update-tkwhv" Mar 16 16:54:20 crc kubenswrapper[5120]: I0316 16:54:20.238485 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e1ae96f9-27a3-4c3f-a7d4-334875177194-operator-scripts\") pod \"nova-cell0-5a68-account-create-update-9nxpw\" (UID: \"e1ae96f9-27a3-4c3f-a7d4-334875177194\") " pod="openstack-kuttl-tests/nova-cell0-5a68-account-create-update-9nxpw" Mar 16 16:54:20 crc kubenswrapper[5120]: I0316 16:54:20.240846 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e1ae96f9-27a3-4c3f-a7d4-334875177194-operator-scripts\") pod \"nova-cell0-5a68-account-create-update-9nxpw\" (UID: \"e1ae96f9-27a3-4c3f-a7d4-334875177194\") " pod="openstack-kuttl-tests/nova-cell0-5a68-account-create-update-9nxpw" Mar 16 16:54:20 crc kubenswrapper[5120]: I0316 16:54:20.244787 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xprnd\" (UniqueName: \"kubernetes.io/projected/e1ae96f9-27a3-4c3f-a7d4-334875177194-kube-api-access-xprnd\") pod \"nova-cell0-5a68-account-create-update-9nxpw\" (UID: \"e1ae96f9-27a3-4c3f-a7d4-334875177194\") " pod="openstack-kuttl-tests/nova-cell0-5a68-account-create-update-9nxpw" Mar 16 16:54:20 crc kubenswrapper[5120]: I0316 16:54:20.268963 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xprnd\" (UniqueName: \"kubernetes.io/projected/e1ae96f9-27a3-4c3f-a7d4-334875177194-kube-api-access-xprnd\") pod \"nova-cell0-5a68-account-create-update-9nxpw\" (UID: \"e1ae96f9-27a3-4c3f-a7d4-334875177194\") " pod="openstack-kuttl-tests/nova-cell0-5a68-account-create-update-9nxpw" Mar 16 16:54:20 crc kubenswrapper[5120]: I0316 16:54:20.269026 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-sc9c8"] Mar 16 16:54:20 crc kubenswrapper[5120]: I0316 16:54:20.276837 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-xw2hd"] Mar 16 16:54:20 crc kubenswrapper[5120]: I0316 16:54:20.285366 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-xw2hd"] Mar 16 16:54:20 crc kubenswrapper[5120]: I0316 16:54:20.303927 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-sc9c8"] Mar 16 16:54:20 crc kubenswrapper[5120]: I0316 16:54:20.313159 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-4d68-account-create-update-ps6wq"] Mar 16 16:54:20 crc kubenswrapper[5120]: I0316 16:54:20.336382 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-4d68-account-create-update-ps6wq"] Mar 16 16:54:20 crc kubenswrapper[5120]: I0316 16:54:20.351555 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 16:54:20 crc kubenswrapper[5120]: I0316 16:54:20.352156 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a" containerName="account-server" containerID="cri-o://fd7d7a93b6338f5f1cb87f0080e397a13c05990ec35fc7410c95850dd2ceddc0" gracePeriod=30 Mar 16 16:54:20 crc kubenswrapper[5120]: I0316 16:54:20.352462 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a" containerName="container-updater" containerID="cri-o://49c026b13207a7e4d1fe5b1529024ced01e29f9e430a662852633085f308ba6d" gracePeriod=30 Mar 16 16:54:20 crc kubenswrapper[5120]: I0316 16:54:20.352566 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a" containerName="swift-recon-cron" containerID="cri-o://bed82f9abe1ca53e6b5e475ed1549a3f0b682f1ae8442d502cbf08bcf4376794" gracePeriod=30 Mar 16 16:54:20 crc kubenswrapper[5120]: I0316 16:54:20.352626 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a" containerName="rsync" containerID="cri-o://9654f347f34ca84be3b59cba15e0fac1abebc6019b67f4cedd8ccd90b36b6475" gracePeriod=30 Mar 16 16:54:20 crc kubenswrapper[5120]: I0316 16:54:20.352669 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a" containerName="object-expirer" containerID="cri-o://f16bf633e499694d3f9b72799502d14d9077fcee087448051bbfe3c7ee1a846a" gracePeriod=30 Mar 16 16:54:20 crc kubenswrapper[5120]: I0316 16:54:20.352711 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a" containerName="object-updater" containerID="cri-o://2454d54900356215b328078c989b7ee2ba76bf00e907810455592dd0328d3607" gracePeriod=30 Mar 16 16:54:20 crc kubenswrapper[5120]: I0316 16:54:20.352779 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a" containerName="object-auditor" containerID="cri-o://5aa2c642ff9b32cbd48cdd175341bc53df8e83fb47b3006102567a681eb9fe12" gracePeriod=30 Mar 16 16:54:20 crc kubenswrapper[5120]: I0316 16:54:20.352798 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a" containerName="object-replicator" containerID="cri-o://8ae45574f24cf4187ebc4c1968f20b78b90badf1d3289e58e00075a12b7f4aaf" gracePeriod=30 Mar 16 16:54:20 crc kubenswrapper[5120]: I0316 16:54:20.352823 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a" containerName="object-server" containerID="cri-o://2cfafdd940355b0c9ef3bd22588f683e31e9b9ae011f465bc5afd07315f80340" gracePeriod=30 Mar 16 16:54:20 crc kubenswrapper[5120]: I0316 16:54:20.352865 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a" containerName="account-reaper" containerID="cri-o://5824335e776fc051905fc3da3116a19441d8ccddf48562f51769a8e960b3094b" gracePeriod=30 Mar 16 16:54:20 crc kubenswrapper[5120]: I0316 16:54:20.352866 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a" containerName="account-replicator" containerID="cri-o://f2f18037c204777302f8e785f799d372046706b80e5745c02575b4fd86dd582e" gracePeriod=30 Mar 16 16:54:20 crc kubenswrapper[5120]: I0316 16:54:20.352904 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a" containerName="container-replicator" containerID="cri-o://49757f02afc4e3f6e201e4726f9a770efb96bca7046b78c5b0456df02c9b9973" gracePeriod=30 Mar 16 16:54:20 crc kubenswrapper[5120]: I0316 16:54:20.352877 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a" containerName="account-auditor" containerID="cri-o://5d46cbd0fdd4c39dd4e954ede4e74df9712ffe1d057d4db2ab6df41eb7838bfc" gracePeriod=30 Mar 16 16:54:20 crc kubenswrapper[5120]: I0316 16:54:20.352950 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a" containerName="container-server" containerID="cri-o://749a177740837a342b9536a7af62a8f69e41d5084bf108b901c90c18c3dbe68d" gracePeriod=30 Mar 16 16:54:20 crc kubenswrapper[5120]: I0316 16:54:20.352936 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a" containerName="container-auditor" containerID="cri-o://554f007f0035801c2403921329abc993a0f8616e35fd0592c4e77e8f5133ccb6" gracePeriod=30 Mar 16 16:54:20 crc kubenswrapper[5120]: I0316 16:54:20.360395 5120 status_manager.go:895] "Failed to get status for pod" podUID="52f09603-9dff-4c67-a4b9-7bb162cd4a40" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 16:54:20 crc kubenswrapper[5120]: I0316 16:54:20.364376 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-lmn5g"] Mar 16 16:54:20 crc kubenswrapper[5120]: I0316 16:54:20.378725 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-lmn5g"] Mar 16 16:54:20 crc kubenswrapper[5120]: I0316 16:54:20.385029 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-5a68-account-create-update-9nxpw" Mar 16 16:54:20 crc kubenswrapper[5120]: I0316 16:54:20.416329 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-brpdk"] Mar 16 16:54:20 crc kubenswrapper[5120]: I0316 16:54:20.448437 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-brpdk"] Mar 16 16:54:20 crc kubenswrapper[5120]: I0316 16:54:20.491286 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-9d545"] Mar 16 16:54:20 crc kubenswrapper[5120]: I0316 16:54:20.539255 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-9d545"] Mar 16 16:54:20 crc kubenswrapper[5120]: I0316 16:54:20.539370 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-9d545" Mar 16 16:54:20 crc kubenswrapper[5120]: I0316 16:54:20.568977 5120 generic.go:358] "Generic (PLEG): container finished" podID="d2f6e14c-b704-4805-b5fa-33de25bc4f0f" containerID="17ca7c826c304f51fb924754427aadc5afd13c084da739b85388c42c18fc61f1" exitCode=2 Mar 16 16:54:20 crc kubenswrapper[5120]: I0316 16:54:20.569116 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"d2f6e14c-b704-4805-b5fa-33de25bc4f0f","Type":"ContainerDied","Data":"17ca7c826c304f51fb924754427aadc5afd13c084da739b85388c42c18fc61f1"} Mar 16 16:54:20 crc kubenswrapper[5120]: I0316 16:54:20.571934 5120 status_manager.go:895] "Failed to get status for pod" podUID="52f09603-9dff-4c67-a4b9-7bb162cd4a40" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 16:54:20 crc kubenswrapper[5120]: I0316 16:54:20.658895 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/0f95e292-0325-47f3-9767-d77bcc9e5884-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-79dcd846c5-9d545\" (UID: \"0f95e292-0325-47f3-9767-d77bcc9e5884\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-9d545" Mar 16 16:54:20 crc kubenswrapper[5120]: I0316 16:54:20.659008 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bgks\" (UniqueName: \"kubernetes.io/projected/0f95e292-0325-47f3-9767-d77bcc9e5884-kube-api-access-5bgks\") pod \"dnsmasq-dnsmasq-79dcd846c5-9d545\" (UID: \"0f95e292-0325-47f3-9767-d77bcc9e5884\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-9d545" Mar 16 16:54:20 crc kubenswrapper[5120]: I0316 16:54:20.659237 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0f95e292-0325-47f3-9767-d77bcc9e5884-config\") pod \"dnsmasq-dnsmasq-79dcd846c5-9d545\" (UID: \"0f95e292-0325-47f3-9767-d77bcc9e5884\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-9d545" Mar 16 16:54:20 crc kubenswrapper[5120]: E0316 16:54:20.659317 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Mar 16 16:54:20 crc kubenswrapper[5120]: E0316 16:54:20.659366 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/27ae46b8-fa26-48e8-a9bb-36bc910c3caf-config-data podName:27ae46b8-fa26-48e8-a9bb-36bc910c3caf nodeName:}" failed. No retries permitted until 2026-03-16 16:54:21.659348847 +0000 UTC m=+4963.813280504 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/27ae46b8-fa26-48e8-a9bb-36bc910c3caf-config-data") pod "rabbitmq-cell1-server-0" (UID: "27ae46b8-fa26-48e8-a9bb-36bc910c3caf") : configmap "rabbitmq-cell1-config-data" not found Mar 16 16:54:20 crc kubenswrapper[5120]: I0316 16:54:20.672393 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_b3ff7a5c-9d60-4d20-9308-0b7d88d605f6/ovsdbserver-nb/0.log" Mar 16 16:54:20 crc kubenswrapper[5120]: I0316 16:54:20.672446 5120 generic.go:358] "Generic (PLEG): container finished" podID="b3ff7a5c-9d60-4d20-9308-0b7d88d605f6" containerID="eefe2c9b53c6bd8747cdce644a861bbc411bf663cd9a7b5171573eeb873ff874" exitCode=2 Mar 16 16:54:20 crc kubenswrapper[5120]: I0316 16:54:20.672464 5120 generic.go:358] "Generic (PLEG): container finished" podID="b3ff7a5c-9d60-4d20-9308-0b7d88d605f6" containerID="76c5f5136097b2b8e13a204ec73f3c4bfff9a3caf4e6a7039b057c002d9745c3" exitCode=143 Mar 16 16:54:20 crc kubenswrapper[5120]: I0316 16:54:20.672660 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:54:20 crc kubenswrapper[5120]: I0316 16:54:20.672693 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"b3ff7a5c-9d60-4d20-9308-0b7d88d605f6","Type":"ContainerDied","Data":"eefe2c9b53c6bd8747cdce644a861bbc411bf663cd9a7b5171573eeb873ff874"} Mar 16 16:54:20 crc kubenswrapper[5120]: I0316 16:54:20.672713 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"b3ff7a5c-9d60-4d20-9308-0b7d88d605f6","Type":"ContainerDied","Data":"76c5f5136097b2b8e13a204ec73f3c4bfff9a3caf4e6a7039b057c002d9745c3"} Mar 16 16:54:20 crc kubenswrapper[5120]: I0316 16:54:20.672949 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="48f680c8-5737-416a-ab55-2c7fcf32c0e2" containerName="cinder-scheduler" containerID="cri-o://1be054665a55eb640a7520c6ccc788bd4c6aba09dae7de9eeee45a6e2ef73e77" gracePeriod=30 Mar 16 16:54:20 crc kubenswrapper[5120]: I0316 16:54:20.673358 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="48f680c8-5737-416a-ab55-2c7fcf32c0e2" containerName="probe" containerID="cri-o://91cdc41498d52eadc713d48b44ce9200489f918206eab5cb8a8f23186b9a72fa" gracePeriod=30 Mar 16 16:54:20 crc kubenswrapper[5120]: I0316 16:54:20.685082 5120 status_manager.go:895] "Failed to get status for pod" podUID="52f09603-9dff-4c67-a4b9-7bb162cd4a40" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 16:54:20 crc kubenswrapper[5120]: I0316 16:54:20.747350 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_d1960e17-5bd0-46f5-9155-8dd50410168f/ovsdbserver-sb/0.log" Mar 16 16:54:20 crc kubenswrapper[5120]: I0316 16:54:20.747391 5120 generic.go:358] "Generic (PLEG): container finished" podID="d1960e17-5bd0-46f5-9155-8dd50410168f" containerID="3f67575c174de4ec88325dae52c495fc5f7e8288f1f83576c731cc6677398a1b" exitCode=2 Mar 16 16:54:20 crc kubenswrapper[5120]: I0316 16:54:20.747405 5120 generic.go:358] "Generic (PLEG): container finished" podID="d1960e17-5bd0-46f5-9155-8dd50410168f" containerID="2c1d127125047f30b595c38ecdb848f5a2764132632a382908881dde9b715eb6" exitCode=143 Mar 16 16:54:20 crc kubenswrapper[5120]: I0316 16:54:20.750520 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ce2c5c2-e87f-4292-b355-6946ee7dbe58" path="/var/lib/kubelet/pods/0ce2c5c2-e87f-4292-b355-6946ee7dbe58/volumes" Mar 16 16:54:20 crc kubenswrapper[5120]: I0316 16:54:20.815577 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="18453fce-c82b-4afc-9968-e956f84798b4" path="/var/lib/kubelet/pods/18453fce-c82b-4afc-9968-e956f84798b4/volumes" Mar 16 16:54:20 crc kubenswrapper[5120]: I0316 16:54:20.819434 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2cdd13b1-c1ed-48c4-8be5-c4689765fafb" path="/var/lib/kubelet/pods/2cdd13b1-c1ed-48c4-8be5-c4689765fafb/volumes" Mar 16 16:54:20 crc kubenswrapper[5120]: E0316 16:54:20.822951 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-kube-state-metrics-svc: secret "cert-kube-state-metrics-svc" not found Mar 16 16:54:20 crc kubenswrapper[5120]: I0316 16:54:20.822966 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="35cf2836-2898-4b13-944c-e61b5b4c005b" path="/var/lib/kubelet/pods/35cf2836-2898-4b13-944c-e61b5b4c005b/volumes" Mar 16 16:54:20 crc kubenswrapper[5120]: I0316 16:54:20.822984 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0f95e292-0325-47f3-9767-d77bcc9e5884-config\") pod \"dnsmasq-dnsmasq-79dcd846c5-9d545\" (UID: \"0f95e292-0325-47f3-9767-d77bcc9e5884\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-9d545" Mar 16 16:54:20 crc kubenswrapper[5120]: E0316 16:54:20.823024 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70574728-2a53-4b17-941b-e437321d936c-kube-state-metrics-tls-certs podName:70574728-2a53-4b17-941b-e437321d936c nodeName:}" failed. No retries permitted until 2026-03-16 16:54:21.323001076 +0000 UTC m=+4963.476932733 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls-certs" (UniqueName: "kubernetes.io/secret/70574728-2a53-4b17-941b-e437321d936c-kube-state-metrics-tls-certs") pod "kube-state-metrics-0" (UID: "70574728-2a53-4b17-941b-e437321d936c") : secret "cert-kube-state-metrics-svc" not found Mar 16 16:54:20 crc kubenswrapper[5120]: E0316 16:54:20.823025 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 16:54:20 crc kubenswrapper[5120]: E0316 16:54:20.823069 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70574728-2a53-4b17-941b-e437321d936c-combined-ca-bundle podName:70574728-2a53-4b17-941b-e437321d936c nodeName:}" failed. No retries permitted until 2026-03-16 16:54:21.323059218 +0000 UTC m=+4963.476990875 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/70574728-2a53-4b17-941b-e437321d936c-combined-ca-bundle") pod "kube-state-metrics-0" (UID: "70574728-2a53-4b17-941b-e437321d936c") : secret "combined-ca-bundle" not found Mar 16 16:54:20 crc kubenswrapper[5120]: I0316 16:54:20.823342 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/0f95e292-0325-47f3-9767-d77bcc9e5884-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-79dcd846c5-9d545\" (UID: \"0f95e292-0325-47f3-9767-d77bcc9e5884\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-9d545" Mar 16 16:54:20 crc kubenswrapper[5120]: I0316 16:54:20.823544 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5bgks\" (UniqueName: \"kubernetes.io/projected/0f95e292-0325-47f3-9767-d77bcc9e5884-kube-api-access-5bgks\") pod \"dnsmasq-dnsmasq-79dcd846c5-9d545\" (UID: \"0f95e292-0325-47f3-9767-d77bcc9e5884\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-9d545" Mar 16 16:54:20 crc kubenswrapper[5120]: I0316 16:54:20.828392 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3fca6612-32d4-454a-aec8-3b8d03ef5b29" path="/var/lib/kubelet/pods/3fca6612-32d4-454a-aec8-3b8d03ef5b29/volumes" Mar 16 16:54:20 crc kubenswrapper[5120]: I0316 16:54:20.833206 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/0f95e292-0325-47f3-9767-d77bcc9e5884-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-79dcd846c5-9d545\" (UID: \"0f95e292-0325-47f3-9767-d77bcc9e5884\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-9d545" Mar 16 16:54:20 crc kubenswrapper[5120]: I0316 16:54:20.856842 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bgks\" (UniqueName: \"kubernetes.io/projected/0f95e292-0325-47f3-9767-d77bcc9e5884-kube-api-access-5bgks\") pod \"dnsmasq-dnsmasq-79dcd846c5-9d545\" (UID: \"0f95e292-0325-47f3-9767-d77bcc9e5884\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-9d545" Mar 16 16:54:20 crc kubenswrapper[5120]: I0316 16:54:20.882561 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0f95e292-0325-47f3-9767-d77bcc9e5884-config\") pod \"dnsmasq-dnsmasq-79dcd846c5-9d545\" (UID: \"0f95e292-0325-47f3-9767-d77bcc9e5884\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-9d545" Mar 16 16:54:20 crc kubenswrapper[5120]: I0316 16:54:20.884879 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4dc7fcb1-fcdc-40ec-9654-8cdc46e13e63" path="/var/lib/kubelet/pods/4dc7fcb1-fcdc-40ec-9654-8cdc46e13e63/volumes" Mar 16 16:54:20 crc kubenswrapper[5120]: I0316 16:54:20.885909 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="51ee86c6-3b72-4d15-81c7-48f44dfa71e1" path="/var/lib/kubelet/pods/51ee86c6-3b72-4d15-81c7-48f44dfa71e1/volumes" Mar 16 16:54:20 crc kubenswrapper[5120]: I0316 16:54:20.886598 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="60b0467f-dafd-4422-8a0c-fa3dd9ea3eb9" path="/var/lib/kubelet/pods/60b0467f-dafd-4422-8a0c-fa3dd9ea3eb9/volumes" Mar 16 16:54:20 crc kubenswrapper[5120]: I0316 16:54:20.888087 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6495cc54-9f66-446a-8e99-e2e6b7a95ddc" path="/var/lib/kubelet/pods/6495cc54-9f66-446a-8e99-e2e6b7a95ddc/volumes" Mar 16 16:54:20 crc kubenswrapper[5120]: I0316 16:54:20.888598 5120 scope.go:117] "RemoveContainer" containerID="4c6dbff97f054c414d193139a2f720efcf9ede8282e3a3736b9efe4508764051" Mar 16 16:54:20 crc kubenswrapper[5120]: I0316 16:54:20.895711 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="67f5aec7-8a45-4909-ae10-dcbdc979fb43" path="/var/lib/kubelet/pods/67f5aec7-8a45-4909-ae10-dcbdc979fb43/volumes" Mar 16 16:54:20 crc kubenswrapper[5120]: I0316 16:54:20.909164 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8b2bc00f-2d60-481e-803d-b4dbd39cdc4e" path="/var/lib/kubelet/pods/8b2bc00f-2d60-481e-803d-b4dbd39cdc4e/volumes" Mar 16 16:54:20 crc kubenswrapper[5120]: I0316 16:54:20.924708 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c4757645-5b79-4163-a7f8-f4380d7615e4" path="/var/lib/kubelet/pods/c4757645-5b79-4163-a7f8-f4380d7615e4/volumes" Mar 16 16:54:20 crc kubenswrapper[5120]: I0316 16:54:20.928787 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cd80c01f-91bc-4691-87be-a4d998cfc8ed" path="/var/lib/kubelet/pods/cd80c01f-91bc-4691-87be-a4d998cfc8ed/volumes" Mar 16 16:54:20 crc kubenswrapper[5120]: I0316 16:54:20.929454 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"d1960e17-5bd0-46f5-9155-8dd50410168f","Type":"ContainerDied","Data":"3f67575c174de4ec88325dae52c495fc5f7e8288f1f83576c731cc6677398a1b"} Mar 16 16:54:20 crc kubenswrapper[5120]: I0316 16:54:20.929495 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"d1960e17-5bd0-46f5-9155-8dd50410168f","Type":"ContainerDied","Data":"2c1d127125047f30b595c38ecdb848f5a2764132632a382908881dde9b715eb6"} Mar 16 16:54:20 crc kubenswrapper[5120]: I0316 16:54:20.929508 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-pwkr9" event={"ID":"bbbbc69c-1fe6-40ae-a88a-a470f3f564ed","Type":"ContainerStarted","Data":"4c6dbff97f054c414d193139a2f720efcf9ede8282e3a3736b9efe4508764051"} Mar 16 16:54:20 crc kubenswrapper[5120]: I0316 16:54:20.929517 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-pwkr9" event={"ID":"bbbbc69c-1fe6-40ae-a88a-a470f3f564ed","Type":"ContainerStarted","Data":"f584a339d8753576caeeb37e16b92edf4af09a9550e628a3dae90c8d6f8c2ef3"} Mar 16 16:54:20 crc kubenswrapper[5120]: I0316 16:54:20.929525 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-1de0-account-create-update-rqhj2" event={"ID":"ffbba34f-0cbb-4345-931f-9c4c763847e1","Type":"ContainerStarted","Data":"8f338671dea00d6409a7d754f463cdebb6eb76336ca22eb1d02172ad445972aa"} Mar 16 16:54:20 crc kubenswrapper[5120]: I0316 16:54:20.949659 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-584b8687b4-5c6lr"] Mar 16 16:54:20 crc kubenswrapper[5120]: I0316 16:54:20.955729 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-584b8687b4-5c6lr" podUID="cc4853a6-faf5-45dc-b6f4-aa0b65d0ca8d" containerName="placement-log" containerID="cri-o://0b2171cdca82691279cb21cfe02497161f4d3514e0d6f41e60432a13800d9a59" gracePeriod=30 Mar 16 16:54:20 crc kubenswrapper[5120]: I0316 16:54:20.956773 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-584b8687b4-5c6lr" podUID="cc4853a6-faf5-45dc-b6f4-aa0b65d0ca8d" containerName="placement-api" containerID="cri-o://e7b8cd725c509e7d568b9e3c1a5c9d000af853272261e60080aa852dbfe7cd70" gracePeriod=30 Mar 16 16:54:21 crc kubenswrapper[5120]: I0316 16:54:21.027152 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-pwkr9"] Mar 16 16:54:21 crc kubenswrapper[5120]: I0316 16:54:21.074410 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-dv2s7"] Mar 16 16:54:21 crc kubenswrapper[5120]: I0316 16:54:21.093262 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-dv2s7"] Mar 16 16:54:21 crc kubenswrapper[5120]: I0316 16:54:21.110475 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-1de0-account-create-update-rqhj2"] Mar 16 16:54:21 crc kubenswrapper[5120]: I0316 16:54:21.125627 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-hj5tn"] Mar 16 16:54:21 crc kubenswrapper[5120]: E0316 16:54:21.141097 5120 kuberuntime_manager.go:1358] "Unhandled Error" err=< Mar 16 16:54:21 crc kubenswrapper[5120]: container &Container{Name:mariadb-account-create-update,Image:quay.io/podified-antelope-centos9/openstack-mariadb@sha256:4caef2b55e01b9a7ee88a22bc69db1893521a91d95c7ad4c8e593f14f17a5f95,Command:[/bin/sh -c #!/bin/bash Mar 16 16:54:21 crc kubenswrapper[5120]: Mar 16 16:54:21 crc kubenswrapper[5120]: MYSQL_REMOTE_HOST="" source /var/lib/operator-scripts/mysql_root_auth.sh Mar 16 16:54:21 crc kubenswrapper[5120]: Mar 16 16:54:21 crc kubenswrapper[5120]: export DatabasePassword=${DatabasePassword:?"Please specify a DatabasePassword variable."} Mar 16 16:54:21 crc kubenswrapper[5120]: Mar 16 16:54:21 crc kubenswrapper[5120]: MYSQL_CMD="mysql -h -u root -P 3306" Mar 16 16:54:21 crc kubenswrapper[5120]: Mar 16 16:54:21 crc kubenswrapper[5120]: if [ -n "barbican" ]; then Mar 16 16:54:21 crc kubenswrapper[5120]: GRANT_DATABASE="barbican" Mar 16 16:54:21 crc kubenswrapper[5120]: else Mar 16 16:54:21 crc kubenswrapper[5120]: GRANT_DATABASE="*" Mar 16 16:54:21 crc kubenswrapper[5120]: fi Mar 16 16:54:21 crc kubenswrapper[5120]: Mar 16 16:54:21 crc kubenswrapper[5120]: # going for maximum compatibility here: Mar 16 16:54:21 crc kubenswrapper[5120]: # 1. MySQL 8 no longer allows implicit create user when GRANT is used Mar 16 16:54:21 crc kubenswrapper[5120]: # 2. MariaDB has "CREATE OR REPLACE", but MySQL does not Mar 16 16:54:21 crc kubenswrapper[5120]: # 3. create user with CREATE but then do all password and TLS with ALTER to Mar 16 16:54:21 crc kubenswrapper[5120]: # support updates Mar 16 16:54:21 crc kubenswrapper[5120]: Mar 16 16:54:21 crc kubenswrapper[5120]: $MYSQL_CMD < logger="UnhandledError" Mar 16 16:54:21 crc kubenswrapper[5120]: E0316 16:54:21.142429 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"mariadb-account-create-update\" with CreateContainerConfigError: \"secret \\\"barbican-db-secret\\\" not found\"" pod="openstack-kuttl-tests/barbican-1de0-account-create-update-rqhj2" podUID="ffbba34f-0cbb-4345-931f-9c4c763847e1" Mar 16 16:54:21 crc kubenswrapper[5120]: I0316 16:54:21.154805 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-hj5tn"] Mar 16 16:54:21 crc kubenswrapper[5120]: I0316 16:54:21.238957 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:54:21 crc kubenswrapper[5120]: I0316 16:54:21.239270 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="f4cbd2d6-e498-42bf-a100-bc0c6664e7ed" containerName="cinder-api-log" containerID="cri-o://40b9639555c32e6578c80a6d348c73edf56ceb2e946f1f8b6986f0d415d57bde" gracePeriod=30 Mar 16 16:54:21 crc kubenswrapper[5120]: I0316 16:54:21.240801 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="f4cbd2d6-e498-42bf-a100-bc0c6664e7ed" containerName="cinder-api" containerID="cri-o://e2e643c12f7cdcfb6338adb79128f619138495e8915b2e35a07baca76d0e267a" gracePeriod=30 Mar 16 16:54:21 crc kubenswrapper[5120]: I0316 16:54:21.257241 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:54:21 crc kubenswrapper[5120]: I0316 16:54:21.257472 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="641d2a6c-6871-488a-8ef3-5a2e693af389" containerName="glance-log" containerID="cri-o://7176b5d9da33321180642ad022eb112218206fafae7d5f604b0312ae55cda4ee" gracePeriod=30 Mar 16 16:54:21 crc kubenswrapper[5120]: I0316 16:54:21.261297 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="641d2a6c-6871-488a-8ef3-5a2e693af389" containerName="glance-httpd" containerID="cri-o://826756ab0e9e22528f886e6b7834cb7cb7e3005ff151d8ffa65fc6935b62a2be" gracePeriod=30 Mar 16 16:54:21 crc kubenswrapper[5120]: I0316 16:54:21.292860 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:54:21 crc kubenswrapper[5120]: I0316 16:54:21.293141 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="75da64f9-4c43-4411-bd20-86c98536adce" containerName="glance-log" containerID="cri-o://968f2c31370baabe38dba56e7264e516bb8706c445891678a7b239714c6d5115" gracePeriod=30 Mar 16 16:54:21 crc kubenswrapper[5120]: I0316 16:54:21.293564 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="75da64f9-4c43-4411-bd20-86c98536adce" containerName="glance-httpd" containerID="cri-o://604ac1b473e83981dc6e83e9cc0546a3e637ff7121dd9f429ddbfd0ea4f6823a" gracePeriod=30 Mar 16 16:54:21 crc kubenswrapper[5120]: I0316 16:54:21.308040 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-db-create-6rvwm"] Mar 16 16:54:21 crc kubenswrapper[5120]: I0316 16:54:21.319052 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-db-create-6rvwm"] Mar 16 16:54:21 crc kubenswrapper[5120]: I0316 16:54:21.330160 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-7b9f48f6c8-rfj5g"] Mar 16 16:54:21 crc kubenswrapper[5120]: I0316 16:54:21.330479 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-7b9f48f6c8-rfj5g" podUID="eb34a81f-663e-4027-bf2c-1d334bd06ba4" containerName="neutron-httpd" containerID="cri-o://5b230d20ea9d3d7833b271ff1a44a747ee3470f18fe1db783899778d4c9cb191" gracePeriod=30 Mar 16 16:54:21 crc kubenswrapper[5120]: I0316 16:54:21.335020 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-7b9f48f6c8-rfj5g" podUID="eb34a81f-663e-4027-bf2c-1d334bd06ba4" containerName="neutron-api" containerID="cri-o://3d1f3be4762f17a030965d2baf23eb4d3d42161f1123f9faaab941f03ade7875" gracePeriod=30 Mar 16 16:54:21 crc kubenswrapper[5120]: I0316 16:54:21.349867 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-0869-account-create-update-c899g"] Mar 16 16:54:21 crc kubenswrapper[5120]: I0316 16:54:21.349991 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/neutron-7b9f48f6c8-rfj5g" podUID="eb34a81f-663e-4027-bf2c-1d334bd06ba4" containerName="neutron-httpd" probeResult="failure" output="Get \"https://10.217.0.179:9696/\": EOF" Mar 16 16:54:21 crc kubenswrapper[5120]: I0316 16:54:21.381970 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-9f898f5b6-g9g57"] Mar 16 16:54:21 crc kubenswrapper[5120]: I0316 16:54:21.382226 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-9f898f5b6-g9g57" podUID="cdf5b2c0-4a53-4c60-a566-d18398c0c560" containerName="neutron-api" containerID="cri-o://7acf7b8f3d2c22d03c90e2cc9b9207ac80353b7bf126751bf2eff2f88c0697d8" gracePeriod=30 Mar 16 16:54:21 crc kubenswrapper[5120]: I0316 16:54:21.382389 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-9f898f5b6-g9g57" podUID="cdf5b2c0-4a53-4c60-a566-d18398c0c560" containerName="neutron-httpd" containerID="cri-o://365b620ab0a5f5b67686132db3d88ec20960fac4cc2e2d4565362ace99ba2a1d" gracePeriod=30 Mar 16 16:54:21 crc kubenswrapper[5120]: E0316 16:54:21.392008 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 16:54:21 crc kubenswrapper[5120]: E0316 16:54:21.392106 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70574728-2a53-4b17-941b-e437321d936c-combined-ca-bundle podName:70574728-2a53-4b17-941b-e437321d936c nodeName:}" failed. No retries permitted until 2026-03-16 16:54:22.392079243 +0000 UTC m=+4964.546010900 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/70574728-2a53-4b17-941b-e437321d936c-combined-ca-bundle") pod "kube-state-metrics-0" (UID: "70574728-2a53-4b17-941b-e437321d936c") : secret "combined-ca-bundle" not found Mar 16 16:54:21 crc kubenswrapper[5120]: E0316 16:54:21.392509 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-kube-state-metrics-svc: secret "cert-kube-state-metrics-svc" not found Mar 16 16:54:21 crc kubenswrapper[5120]: E0316 16:54:21.392567 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70574728-2a53-4b17-941b-e437321d936c-kube-state-metrics-tls-certs podName:70574728-2a53-4b17-941b-e437321d936c nodeName:}" failed. No retries permitted until 2026-03-16 16:54:22.392555096 +0000 UTC m=+4964.546486753 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls-certs" (UniqueName: "kubernetes.io/secret/70574728-2a53-4b17-941b-e437321d936c-kube-state-metrics-tls-certs") pod "kube-state-metrics-0" (UID: "70574728-2a53-4b17-941b-e437321d936c") : secret "cert-kube-state-metrics-svc" not found Mar 16 16:54:21 crc kubenswrapper[5120]: I0316 16:54:21.434296 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-0ea4-account-create-update-tl2bd"] Mar 16 16:54:21 crc kubenswrapper[5120]: I0316 16:54:21.453357 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-db-create-fh7p4"] Mar 16 16:54:21 crc kubenswrapper[5120]: E0316 16:54:21.454079 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 76c5f5136097b2b8e13a204ec73f3c4bfff9a3caf4e6a7039b057c002d9745c3 is running failed: container process not found" containerID="76c5f5136097b2b8e13a204ec73f3c4bfff9a3caf4e6a7039b057c002d9745c3" cmd=["/usr/bin/pidof","ovsdb-server"] Mar 16 16:54:21 crc kubenswrapper[5120]: E0316 16:54:21.454554 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 76c5f5136097b2b8e13a204ec73f3c4bfff9a3caf4e6a7039b057c002d9745c3 is running failed: container process not found" containerID="76c5f5136097b2b8e13a204ec73f3c4bfff9a3caf4e6a7039b057c002d9745c3" cmd=["/usr/bin/pidof","ovsdb-server"] Mar 16 16:54:21 crc kubenswrapper[5120]: E0316 16:54:21.454998 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 76c5f5136097b2b8e13a204ec73f3c4bfff9a3caf4e6a7039b057c002d9745c3 is running failed: container process not found" containerID="76c5f5136097b2b8e13a204ec73f3c4bfff9a3caf4e6a7039b057c002d9745c3" cmd=["/usr/bin/pidof","ovsdb-server"] Mar 16 16:54:21 crc kubenswrapper[5120]: E0316 16:54:21.455034 5120 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 76c5f5136097b2b8e13a204ec73f3c4bfff9a3caf4e6a7039b057c002d9745c3 is running failed: container process not found" probeType="Readiness" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podUID="b3ff7a5c-9d60-4d20-9308-0b7d88d605f6" containerName="ovsdbserver-nb" probeResult="unknown" Mar 16 16:54:21 crc kubenswrapper[5120]: I0316 16:54:21.487622 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-db-create-fh7p4"] Mar 16 16:54:21 crc kubenswrapper[5120]: I0316 16:54:21.515710 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-db-create-s475x"] Mar 16 16:54:21 crc kubenswrapper[5120]: I0316 16:54:21.537743 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-db-create-s475x"] Mar 16 16:54:21 crc kubenswrapper[5120]: I0316 16:54:21.549984 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-0ea4-account-create-update-tl2bd"] Mar 16 16:54:21 crc kubenswrapper[5120]: I0316 16:54:21.566406 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-1de0-account-create-update-rqhj2"] Mar 16 16:54:21 crc kubenswrapper[5120]: I0316 16:54:21.583872 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 16:54:21 crc kubenswrapper[5120]: I0316 16:54:21.598028 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-2845-account-create-update-2mnh7"] Mar 16 16:54:21 crc kubenswrapper[5120]: I0316 16:54:21.609875 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-db-create-r8jd4"] Mar 16 16:54:21 crc kubenswrapper[5120]: I0316 16:54:21.622082 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-db-create-r8jd4"] Mar 16 16:54:21 crc kubenswrapper[5120]: I0316 16:54:21.630552 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:54:21 crc kubenswrapper[5120]: I0316 16:54:21.630901 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="68500e27-b83c-4571-9082-33e4d4ea3daa" containerName="nova-api-log" containerID="cri-o://53a6aa2de43f8168ef62391d386a5d327dfda0a9256f9e9ab874619195e3c722" gracePeriod=30 Mar 16 16:54:21 crc kubenswrapper[5120]: I0316 16:54:21.631061 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="68500e27-b83c-4571-9082-33e4d4ea3daa" containerName="nova-api-api" containerID="cri-o://b8c750b5630561dadd8fe003305591597e02831287265cd47e72211c29c25d34" gracePeriod=30 Mar 16 16:54:21 crc kubenswrapper[5120]: I0316 16:54:21.642909 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-2845-account-create-update-2mnh7"] Mar 16 16:54:21 crc kubenswrapper[5120]: I0316 16:54:21.650365 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:54:21 crc kubenswrapper[5120]: I0316 16:54:21.650693 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="d8266cfd-9730-429f-8099-e47188d84aba" containerName="nova-metadata-log" containerID="cri-o://973b2d4981e371f1cc5894f46a549c77f1c7936997a498bb3f11cd02c0d5db5f" gracePeriod=30 Mar 16 16:54:21 crc kubenswrapper[5120]: I0316 16:54:21.651310 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="d8266cfd-9730-429f-8099-e47188d84aba" containerName="nova-metadata-metadata" containerID="cri-o://42374085eaca804906c313aa98010944f07a179e2d3659eeaa28517e25559e00" gracePeriod=30 Mar 16 16:54:21 crc kubenswrapper[5120]: I0316 16:54:21.683955 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/rabbitmq-server-0" podUID="c6ba454f-2263-4fc3-bd13-35f921464d24" containerName="rabbitmq" containerID="cri-o://d132e86febb95aaac349850de3398e5eb968a0b02b7fc9c1c262ba103110a6d5" gracePeriod=604800 Mar 16 16:54:21 crc kubenswrapper[5120]: I0316 16:54:21.692836 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-6cc74c8747-7pf27"] Mar 16 16:54:21 crc kubenswrapper[5120]: I0316 16:54:21.693180 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-6cc74c8747-7pf27" podUID="ae73ae1d-4056-43c2-addd-f08999a4a7f6" containerName="barbican-worker-log" containerID="cri-o://212ef64e26a8c2cc068193dc28ff446a67b88b3626597c06ecc57e0b01067724" gracePeriod=30 Mar 16 16:54:21 crc kubenswrapper[5120]: I0316 16:54:21.693414 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-6cc74c8747-7pf27" podUID="ae73ae1d-4056-43c2-addd-f08999a4a7f6" containerName="barbican-worker" containerID="cri-o://ff3433af2fccaf4d6c733f603683176d9fec5eff2b5c90677ad2990469736892" gracePeriod=30 Mar 16 16:54:21 crc kubenswrapper[5120]: I0316 16:54:21.718839 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-0869-account-create-update-c899g"] Mar 16 16:54:21 crc kubenswrapper[5120]: E0316 16:54:21.720979 5120 kuberuntime_manager.go:1358] "Unhandled Error" err=< Mar 16 16:54:21 crc kubenswrapper[5120]: container &Container{Name:mariadb-account-create-update,Image:quay.io/podified-antelope-centos9/openstack-mariadb@sha256:4caef2b55e01b9a7ee88a22bc69db1893521a91d95c7ad4c8e593f14f17a5f95,Command:[/bin/sh -c #!/bin/bash Mar 16 16:54:21 crc kubenswrapper[5120]: Mar 16 16:54:21 crc kubenswrapper[5120]: MYSQL_REMOTE_HOST="" source /var/lib/operator-scripts/mysql_root_auth.sh Mar 16 16:54:21 crc kubenswrapper[5120]: Mar 16 16:54:21 crc kubenswrapper[5120]: export DatabasePassword=${DatabasePassword:?"Please specify a DatabasePassword variable."} Mar 16 16:54:21 crc kubenswrapper[5120]: Mar 16 16:54:21 crc kubenswrapper[5120]: MYSQL_CMD="mysql -h -u root -P 3306" Mar 16 16:54:21 crc kubenswrapper[5120]: Mar 16 16:54:21 crc kubenswrapper[5120]: if [ -n "cinder" ]; then Mar 16 16:54:21 crc kubenswrapper[5120]: GRANT_DATABASE="cinder" Mar 16 16:54:21 crc kubenswrapper[5120]: else Mar 16 16:54:21 crc kubenswrapper[5120]: GRANT_DATABASE="*" Mar 16 16:54:21 crc kubenswrapper[5120]: fi Mar 16 16:54:21 crc kubenswrapper[5120]: Mar 16 16:54:21 crc kubenswrapper[5120]: # going for maximum compatibility here: Mar 16 16:54:21 crc kubenswrapper[5120]: # 1. MySQL 8 no longer allows implicit create user when GRANT is used Mar 16 16:54:21 crc kubenswrapper[5120]: # 2. MariaDB has "CREATE OR REPLACE", but MySQL does not Mar 16 16:54:21 crc kubenswrapper[5120]: # 3. create user with CREATE but then do all password and TLS with ALTER to Mar 16 16:54:21 crc kubenswrapper[5120]: # support updates Mar 16 16:54:21 crc kubenswrapper[5120]: Mar 16 16:54:21 crc kubenswrapper[5120]: $MYSQL_CMD < logger="UnhandledError" Mar 16 16:54:21 crc kubenswrapper[5120]: E0316 16:54:21.721035 5120 kuberuntime_manager.go:1358] "Unhandled Error" err=< Mar 16 16:54:21 crc kubenswrapper[5120]: container &Container{Name:mariadb-account-create-update,Image:quay.io/podified-antelope-centos9/openstack-mariadb@sha256:4caef2b55e01b9a7ee88a22bc69db1893521a91d95c7ad4c8e593f14f17a5f95,Command:[/bin/sh -c #!/bin/bash Mar 16 16:54:21 crc kubenswrapper[5120]: Mar 16 16:54:21 crc kubenswrapper[5120]: MYSQL_REMOTE_HOST="" source /var/lib/operator-scripts/mysql_root_auth.sh Mar 16 16:54:21 crc kubenswrapper[5120]: Mar 16 16:54:21 crc kubenswrapper[5120]: export DatabasePassword=${DatabasePassword:?"Please specify a DatabasePassword variable."} Mar 16 16:54:21 crc kubenswrapper[5120]: Mar 16 16:54:21 crc kubenswrapper[5120]: MYSQL_CMD="mysql -h -u root -P 3306" Mar 16 16:54:21 crc kubenswrapper[5120]: Mar 16 16:54:21 crc kubenswrapper[5120]: if [ -n "nova_api" ]; then Mar 16 16:54:21 crc kubenswrapper[5120]: GRANT_DATABASE="nova_api" Mar 16 16:54:21 crc kubenswrapper[5120]: else Mar 16 16:54:21 crc kubenswrapper[5120]: GRANT_DATABASE="*" Mar 16 16:54:21 crc kubenswrapper[5120]: fi Mar 16 16:54:21 crc kubenswrapper[5120]: Mar 16 16:54:21 crc kubenswrapper[5120]: # going for maximum compatibility here: Mar 16 16:54:21 crc kubenswrapper[5120]: # 1. MySQL 8 no longer allows implicit create user when GRANT is used Mar 16 16:54:21 crc kubenswrapper[5120]: # 2. MariaDB has "CREATE OR REPLACE", but MySQL does not Mar 16 16:54:21 crc kubenswrapper[5120]: # 3. create user with CREATE but then do all password and TLS with ALTER to Mar 16 16:54:21 crc kubenswrapper[5120]: # support updates Mar 16 16:54:21 crc kubenswrapper[5120]: Mar 16 16:54:21 crc kubenswrapper[5120]: $MYSQL_CMD < logger="UnhandledError" Mar 16 16:54:21 crc kubenswrapper[5120]: E0316 16:54:21.721130 5120 kuberuntime_manager.go:1358] "Unhandled Error" err=< Mar 16 16:54:21 crc kubenswrapper[5120]: container &Container{Name:mariadb-account-create-update,Image:quay.io/podified-antelope-centos9/openstack-mariadb@sha256:4caef2b55e01b9a7ee88a22bc69db1893521a91d95c7ad4c8e593f14f17a5f95,Command:[/bin/sh -c #!/bin/bash Mar 16 16:54:21 crc kubenswrapper[5120]: Mar 16 16:54:21 crc kubenswrapper[5120]: MYSQL_REMOTE_HOST="" source /var/lib/operator-scripts/mysql_root_auth.sh Mar 16 16:54:21 crc kubenswrapper[5120]: Mar 16 16:54:21 crc kubenswrapper[5120]: export DatabasePassword=${DatabasePassword:?"Please specify a DatabasePassword variable."} Mar 16 16:54:21 crc kubenswrapper[5120]: Mar 16 16:54:21 crc kubenswrapper[5120]: MYSQL_CMD="mysql -h -u root -P 3306" Mar 16 16:54:21 crc kubenswrapper[5120]: Mar 16 16:54:21 crc kubenswrapper[5120]: if [ -n "glance" ]; then Mar 16 16:54:21 crc kubenswrapper[5120]: GRANT_DATABASE="glance" Mar 16 16:54:21 crc kubenswrapper[5120]: else Mar 16 16:54:21 crc kubenswrapper[5120]: GRANT_DATABASE="*" Mar 16 16:54:21 crc kubenswrapper[5120]: fi Mar 16 16:54:21 crc kubenswrapper[5120]: Mar 16 16:54:21 crc kubenswrapper[5120]: # going for maximum compatibility here: Mar 16 16:54:21 crc kubenswrapper[5120]: # 1. MySQL 8 no longer allows implicit create user when GRANT is used Mar 16 16:54:21 crc kubenswrapper[5120]: # 2. MariaDB has "CREATE OR REPLACE", but MySQL does not Mar 16 16:54:21 crc kubenswrapper[5120]: # 3. create user with CREATE but then do all password and TLS with ALTER to Mar 16 16:54:21 crc kubenswrapper[5120]: # support updates Mar 16 16:54:21 crc kubenswrapper[5120]: Mar 16 16:54:21 crc kubenswrapper[5120]: $MYSQL_CMD < logger="UnhandledError" Mar 16 16:54:21 crc kubenswrapper[5120]: E0316 16:54:21.721660 5120 kuberuntime_manager.go:1358] "Unhandled Error" err=< Mar 16 16:54:21 crc kubenswrapper[5120]: container &Container{Name:mariadb-account-create-update,Image:quay.io/podified-antelope-centos9/openstack-mariadb@sha256:4caef2b55e01b9a7ee88a22bc69db1893521a91d95c7ad4c8e593f14f17a5f95,Command:[/bin/sh -c #!/bin/bash Mar 16 16:54:21 crc kubenswrapper[5120]: Mar 16 16:54:21 crc kubenswrapper[5120]: MYSQL_REMOTE_HOST="" source /var/lib/operator-scripts/mysql_root_auth.sh Mar 16 16:54:21 crc kubenswrapper[5120]: Mar 16 16:54:21 crc kubenswrapper[5120]: export DatabasePassword=${DatabasePassword:?"Please specify a DatabasePassword variable."} Mar 16 16:54:21 crc kubenswrapper[5120]: Mar 16 16:54:21 crc kubenswrapper[5120]: MYSQL_CMD="mysql -h -u root -P 3306" Mar 16 16:54:21 crc kubenswrapper[5120]: Mar 16 16:54:21 crc kubenswrapper[5120]: if [ -n "neutron" ]; then Mar 16 16:54:21 crc kubenswrapper[5120]: GRANT_DATABASE="neutron" Mar 16 16:54:21 crc kubenswrapper[5120]: else Mar 16 16:54:21 crc kubenswrapper[5120]: GRANT_DATABASE="*" Mar 16 16:54:21 crc kubenswrapper[5120]: fi Mar 16 16:54:21 crc kubenswrapper[5120]: Mar 16 16:54:21 crc kubenswrapper[5120]: # going for maximum compatibility here: Mar 16 16:54:21 crc kubenswrapper[5120]: # 1. MySQL 8 no longer allows implicit create user when GRANT is used Mar 16 16:54:21 crc kubenswrapper[5120]: # 2. MariaDB has "CREATE OR REPLACE", but MySQL does not Mar 16 16:54:21 crc kubenswrapper[5120]: # 3. create user with CREATE but then do all password and TLS with ALTER to Mar 16 16:54:21 crc kubenswrapper[5120]: # support updates Mar 16 16:54:21 crc kubenswrapper[5120]: Mar 16 16:54:21 crc kubenswrapper[5120]: $MYSQL_CMD < logger="UnhandledError" Mar 16 16:54:21 crc kubenswrapper[5120]: E0316 16:54:21.721769 5120 kuberuntime_manager.go:1358] "Unhandled Error" err=< Mar 16 16:54:21 crc kubenswrapper[5120]: container &Container{Name:mariadb-account-create-update,Image:quay.io/podified-antelope-centos9/openstack-mariadb@sha256:4caef2b55e01b9a7ee88a22bc69db1893521a91d95c7ad4c8e593f14f17a5f95,Command:[/bin/sh -c #!/bin/bash Mar 16 16:54:21 crc kubenswrapper[5120]: Mar 16 16:54:21 crc kubenswrapper[5120]: MYSQL_REMOTE_HOST="" source /var/lib/operator-scripts/mysql_root_auth.sh Mar 16 16:54:21 crc kubenswrapper[5120]: Mar 16 16:54:21 crc kubenswrapper[5120]: export DatabasePassword=${DatabasePassword:?"Please specify a DatabasePassword variable."} Mar 16 16:54:21 crc kubenswrapper[5120]: Mar 16 16:54:21 crc kubenswrapper[5120]: MYSQL_CMD="mysql -h -u root -P 3306" Mar 16 16:54:21 crc kubenswrapper[5120]: Mar 16 16:54:21 crc kubenswrapper[5120]: if [ -n "placement" ]; then Mar 16 16:54:21 crc kubenswrapper[5120]: GRANT_DATABASE="placement" Mar 16 16:54:21 crc kubenswrapper[5120]: else Mar 16 16:54:21 crc kubenswrapper[5120]: GRANT_DATABASE="*" Mar 16 16:54:21 crc kubenswrapper[5120]: fi Mar 16 16:54:21 crc kubenswrapper[5120]: Mar 16 16:54:21 crc kubenswrapper[5120]: # going for maximum compatibility here: Mar 16 16:54:21 crc kubenswrapper[5120]: # 1. MySQL 8 no longer allows implicit create user when GRANT is used Mar 16 16:54:21 crc kubenswrapper[5120]: # 2. MariaDB has "CREATE OR REPLACE", but MySQL does not Mar 16 16:54:21 crc kubenswrapper[5120]: # 3. create user with CREATE but then do all password and TLS with ALTER to Mar 16 16:54:21 crc kubenswrapper[5120]: # support updates Mar 16 16:54:21 crc kubenswrapper[5120]: Mar 16 16:54:21 crc kubenswrapper[5120]: $MYSQL_CMD < logger="UnhandledError" Mar 16 16:54:21 crc kubenswrapper[5120]: E0316 16:54:21.721824 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Mar 16 16:54:21 crc kubenswrapper[5120]: E0316 16:54:21.722468 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/27ae46b8-fa26-48e8-a9bb-36bc910c3caf-config-data podName:27ae46b8-fa26-48e8-a9bb-36bc910c3caf nodeName:}" failed. No retries permitted until 2026-03-16 16:54:23.72227592 +0000 UTC m=+4965.876207587 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/27ae46b8-fa26-48e8-a9bb-36bc910c3caf-config-data") pod "rabbitmq-cell1-server-0" (UID: "27ae46b8-fa26-48e8-a9bb-36bc910c3caf") : configmap "rabbitmq-cell1-config-data" not found Mar 16 16:54:21 crc kubenswrapper[5120]: E0316 16:54:21.723543 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"mariadb-account-create-update\" with CreateContainerConfigError: \"secret \\\"cinder-db-secret\\\" not found\"" pod="openstack-kuttl-tests/cinder-0869-account-create-update-c899g" podUID="df3f2e26-88e4-445e-a448-f05b062ff2b3" Mar 16 16:54:21 crc kubenswrapper[5120]: E0316 16:54:21.723371 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"mariadb-account-create-update\" with CreateContainerConfigError: \"secret \\\"glance-db-secret\\\" not found\"" pod="openstack-kuttl-tests/glance-2845-account-create-update-2mnh7" podUID="bb4b3750-ad5c-4e9e-9824-caba853515cd" Mar 16 16:54:21 crc kubenswrapper[5120]: E0316 16:54:21.723425 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"mariadb-account-create-update\" with CreateContainerConfigError: \"secret \\\"nova-api-db-secret\\\" not found\"" pod="openstack-kuttl-tests/nova-api-774a-account-create-update-tkwhv" podUID="215bcff0-714b-427b-ab26-130a21366d15" Mar 16 16:54:21 crc kubenswrapper[5120]: E0316 16:54:21.723483 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"mariadb-account-create-update\" with CreateContainerConfigError: \"secret \\\"neutron-db-secret\\\" not found\"" pod="openstack-kuttl-tests/neutron-b06a-account-create-update-7v27d" podUID="5c8124f6-11f6-49fd-94a8-d931c557b6c4" Mar 16 16:54:21 crc kubenswrapper[5120]: E0316 16:54:21.723069 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"mariadb-account-create-update\" with CreateContainerConfigError: \"secret \\\"placement-db-secret\\\" not found\"" pod="openstack-kuttl-tests/placement-0ea4-account-create-update-tl2bd" podUID="fb775edc-5783-4ad6-a85e-ec4d71ac7f5c" Mar 16 16:54:21 crc kubenswrapper[5120]: I0316 16:54:21.728035 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 16:54:21 crc kubenswrapper[5120]: I0316 16:54:21.747012 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-dq2mb"] Mar 16 16:54:21 crc kubenswrapper[5120]: I0316 16:54:21.755578 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-dq2mb"] Mar 16 16:54:21 crc kubenswrapper[5120]: I0316 16:54:21.761462 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-db-create-qtpxl"] Mar 16 16:54:21 crc kubenswrapper[5120]: I0316 16:54:21.770688 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-db-create-qtpxl"] Mar 16 16:54:21 crc kubenswrapper[5120]: I0316 16:54:21.778419 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-b06a-account-create-update-7v27d"] Mar 16 16:54:21 crc kubenswrapper[5120]: I0316 16:54:21.785329 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-788658cdb6-tsr2b"] Mar 16 16:54:21 crc kubenswrapper[5120]: I0316 16:54:21.785617 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-788658cdb6-tsr2b" podUID="472a9d94-a155-4916-aab9-4672a3c6c18c" containerName="barbican-keystone-listener-log" containerID="cri-o://840093ee5a2a11cc1fdcd8dc97c9738e8f3927be0adf408e9af80e17042ee646" gracePeriod=30 Mar 16 16:54:21 crc kubenswrapper[5120]: I0316 16:54:21.786055 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-788658cdb6-tsr2b" podUID="472a9d94-a155-4916-aab9-4672a3c6c18c" containerName="barbican-keystone-listener" containerID="cri-o://17db717294296e1c93dabaa603512092c1b984d81ce2823579d06813201a2e33" gracePeriod=30 Mar 16 16:54:21 crc kubenswrapper[5120]: I0316 16:54:21.822435 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-5k6v4"] Mar 16 16:54:21 crc kubenswrapper[5120]: I0316 16:54:21.847624 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-9d545" Mar 16 16:54:21 crc kubenswrapper[5120]: E0316 16:54:21.853681 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 2c1d127125047f30b595c38ecdb848f5a2764132632a382908881dde9b715eb6 is running failed: container process not found" containerID="2c1d127125047f30b595c38ecdb848f5a2764132632a382908881dde9b715eb6" cmd=["/usr/bin/pidof","ovsdb-server"] Mar 16 16:54:21 crc kubenswrapper[5120]: I0316 16:54:21.855987 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-5k6v4"] Mar 16 16:54:21 crc kubenswrapper[5120]: E0316 16:54:21.859507 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 2c1d127125047f30b595c38ecdb848f5a2764132632a382908881dde9b715eb6 is running failed: container process not found" containerID="2c1d127125047f30b595c38ecdb848f5a2764132632a382908881dde9b715eb6" cmd=["/usr/bin/pidof","ovsdb-server"] Mar 16 16:54:21 crc kubenswrapper[5120]: E0316 16:54:21.860045 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 2c1d127125047f30b595c38ecdb848f5a2764132632a382908881dde9b715eb6 is running failed: container process not found" containerID="2c1d127125047f30b595c38ecdb848f5a2764132632a382908881dde9b715eb6" cmd=["/usr/bin/pidof","ovsdb-server"] Mar 16 16:54:21 crc kubenswrapper[5120]: E0316 16:54:21.860074 5120 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 2c1d127125047f30b595c38ecdb848f5a2764132632a382908881dde9b715eb6 is running failed: container process not found" probeType="Readiness" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podUID="d1960e17-5bd0-46f5-9155-8dd50410168f" containerName="ovsdbserver-sb" probeResult="unknown" Mar 16 16:54:21 crc kubenswrapper[5120]: I0316 16:54:21.866939 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_b3ff7a5c-9d60-4d20-9308-0b7d88d605f6/ovsdbserver-nb/0.log" Mar 16 16:54:21 crc kubenswrapper[5120]: I0316 16:54:21.867554 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:54:21 crc kubenswrapper[5120]: I0316 16:54:21.870166 5120 generic.go:358] "Generic (PLEG): container finished" podID="f4cbd2d6-e498-42bf-a100-bc0c6664e7ed" containerID="40b9639555c32e6578c80a6d348c73edf56ceb2e946f1f8b6986f0d415d57bde" exitCode=143 Mar 16 16:54:21 crc kubenswrapper[5120]: I0316 16:54:21.870315 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"f4cbd2d6-e498-42bf-a100-bc0c6664e7ed","Type":"ContainerDied","Data":"40b9639555c32e6578c80a6d348c73edf56ceb2e946f1f8b6986f0d415d57bde"} Mar 16 16:54:21 crc kubenswrapper[5120]: I0316 16:54:21.946081 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-896cw"] Mar 16 16:54:21 crc kubenswrapper[5120]: I0316 16:54:21.951895 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_d1960e17-5bd0-46f5-9155-8dd50410168f/ovsdbserver-sb/0.log" Mar 16 16:54:21 crc kubenswrapper[5120]: I0316 16:54:21.952012 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:54:21 crc kubenswrapper[5120]: I0316 16:54:21.967922 5120 generic.go:358] "Generic (PLEG): container finished" podID="bbbbc69c-1fe6-40ae-a88a-a470f3f564ed" containerID="4c6dbff97f054c414d193139a2f720efcf9ede8282e3a3736b9efe4508764051" exitCode=1 Mar 16 16:54:21 crc kubenswrapper[5120]: I0316 16:54:21.968082 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-pwkr9" event={"ID":"bbbbc69c-1fe6-40ae-a88a-a470f3f564ed","Type":"ContainerDied","Data":"4c6dbff97f054c414d193139a2f720efcf9ede8282e3a3736b9efe4508764051"} Mar 16 16:54:21 crc kubenswrapper[5120]: I0316 16:54:21.986486 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-774a-account-create-update-tkwhv" event={"ID":"215bcff0-714b-427b-ab26-130a21366d15","Type":"ContainerStarted","Data":"2666b83fff0ec0c9249b7128e8b06ec8cd2ec7860a78d939b3390bce3c40d9fd"} Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.008961 5120 patch_prober.go:28] interesting pod/machine-config-daemon-7bf76 container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.009023 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.009076 5120 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.010035 5120 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="machine-config-daemon" containerStatusID={"Type":"cri-o","ID":"083f72646c8d47c9c0467b39be99ddfa9c2e5900ae0a29ad53d7b39b950274b4"} pod="openshift-machine-config-operator/machine-config-daemon-7bf76" containerMessage="Container machine-config-daemon failed liveness probe, will be restarted" Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.010101 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" containerID="cri-o://083f72646c8d47c9c0467b39be99ddfa9c2e5900ae0a29ad53d7b39b950274b4" gracePeriod=600 Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.014896 5120 generic.go:358] "Generic (PLEG): container finished" podID="d8266cfd-9730-429f-8099-e47188d84aba" containerID="973b2d4981e371f1cc5894f46a549c77f1c7936997a498bb3f11cd02c0d5db5f" exitCode=143 Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.015082 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"d8266cfd-9730-429f-8099-e47188d84aba","Type":"ContainerDied","Data":"973b2d4981e371f1cc5894f46a549c77f1c7936997a498bb3f11cd02c0d5db5f"} Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.024755 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-5a68-account-create-update-9nxpw"] Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.032122 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-7b9f48f6c8-rfj5g_eb34a81f-663e-4027-bf2c-1d334bd06ba4/neutron-api/0.log" Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.032186 5120 generic.go:358] "Generic (PLEG): container finished" podID="eb34a81f-663e-4027-bf2c-1d334bd06ba4" containerID="5b230d20ea9d3d7833b271ff1a44a747ee3470f18fe1db783899778d4c9cb191" exitCode=0 Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.032312 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-7b9f48f6c8-rfj5g" event={"ID":"eb34a81f-663e-4027-bf2c-1d334bd06ba4","Type":"ContainerDied","Data":"5b230d20ea9d3d7833b271ff1a44a747ee3470f18fe1db783899778d4c9cb191"} Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.045124 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/b3ff7a5c-9d60-4d20-9308-0b7d88d605f6-metrics-certs-tls-certs\") pod \"b3ff7a5c-9d60-4d20-9308-0b7d88d605f6\" (UID: \"b3ff7a5c-9d60-4d20-9308-0b7d88d605f6\") " Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.048824 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/b3ff7a5c-9d60-4d20-9308-0b7d88d605f6-ovsdb-rundir\") pod \"b3ff7a5c-9d60-4d20-9308-0b7d88d605f6\" (UID: \"b3ff7a5c-9d60-4d20-9308-0b7d88d605f6\") " Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.049073 5120 generic.go:358] "Generic (PLEG): container finished" podID="641d2a6c-6871-488a-8ef3-5a2e693af389" containerID="7176b5d9da33321180642ad022eb112218206fafae7d5f604b0312ae55cda4ee" exitCode=143 Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.049120 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/b3ff7a5c-9d60-4d20-9308-0b7d88d605f6-ovsdbserver-nb-tls-certs\") pod \"b3ff7a5c-9d60-4d20-9308-0b7d88d605f6\" (UID: \"b3ff7a5c-9d60-4d20-9308-0b7d88d605f6\") " Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.049294 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-42zrm\" (UniqueName: \"kubernetes.io/projected/b3ff7a5c-9d60-4d20-9308-0b7d88d605f6-kube-api-access-42zrm\") pod \"b3ff7a5c-9d60-4d20-9308-0b7d88d605f6\" (UID: \"b3ff7a5c-9d60-4d20-9308-0b7d88d605f6\") " Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.049312 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"641d2a6c-6871-488a-8ef3-5a2e693af389","Type":"ContainerDied","Data":"7176b5d9da33321180642ad022eb112218206fafae7d5f604b0312ae55cda4ee"} Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.049487 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b3ff7a5c-9d60-4d20-9308-0b7d88d605f6-combined-ca-bundle\") pod \"b3ff7a5c-9d60-4d20-9308-0b7d88d605f6\" (UID: \"b3ff7a5c-9d60-4d20-9308-0b7d88d605f6\") " Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.049641 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b3ff7a5c-9d60-4d20-9308-0b7d88d605f6-config\") pod \"b3ff7a5c-9d60-4d20-9308-0b7d88d605f6\" (UID: \"b3ff7a5c-9d60-4d20-9308-0b7d88d605f6\") " Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.049703 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovndbcluster-nb-etc-ovn\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") pod \"b3ff7a5c-9d60-4d20-9308-0b7d88d605f6\" (UID: \"b3ff7a5c-9d60-4d20-9308-0b7d88d605f6\") " Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.049843 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/b3ff7a5c-9d60-4d20-9308-0b7d88d605f6-scripts\") pod \"b3ff7a5c-9d60-4d20-9308-0b7d88d605f6\" (UID: \"b3ff7a5c-9d60-4d20-9308-0b7d88d605f6\") " Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.050044 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3ff7a5c-9d60-4d20-9308-0b7d88d605f6-ovsdb-rundir" (OuterVolumeSpecName: "ovsdb-rundir") pod "b3ff7a5c-9d60-4d20-9308-0b7d88d605f6" (UID: "b3ff7a5c-9d60-4d20-9308-0b7d88d605f6"). InnerVolumeSpecName "ovsdb-rundir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.052000 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b3ff7a5c-9d60-4d20-9308-0b7d88d605f6-scripts" (OuterVolumeSpecName: "scripts") pod "b3ff7a5c-9d60-4d20-9308-0b7d88d605f6" (UID: "b3ff7a5c-9d60-4d20-9308-0b7d88d605f6"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.056368 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b3ff7a5c-9d60-4d20-9308-0b7d88d605f6-config" (OuterVolumeSpecName: "config") pod "b3ff7a5c-9d60-4d20-9308-0b7d88d605f6" (UID: "b3ff7a5c-9d60-4d20-9308-0b7d88d605f6"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.059848 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-896cw"] Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.063515 5120 reconciler_common.go:299] "Volume detached for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/b3ff7a5c-9d60-4d20-9308-0b7d88d605f6-ovsdb-rundir\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.064147 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b3ff7a5c-9d60-4d20-9308-0b7d88d605f6-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.064612 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/b3ff7a5c-9d60-4d20-9308-0b7d88d605f6-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.066821 5120 generic.go:358] "Generic (PLEG): container finished" podID="cc4853a6-faf5-45dc-b6f4-aa0b65d0ca8d" containerID="0b2171cdca82691279cb21cfe02497161f4d3514e0d6f41e60432a13800d9a59" exitCode=143 Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.066912 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-584b8687b4-5c6lr" event={"ID":"cc4853a6-faf5-45dc-b6f4-aa0b65d0ca8d","Type":"ContainerDied","Data":"0b2171cdca82691279cb21cfe02497161f4d3514e0d6f41e60432a13800d9a59"} Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.071193 5120 generic.go:358] "Generic (PLEG): container finished" podID="68500e27-b83c-4571-9082-33e4d4ea3daa" containerID="53a6aa2de43f8168ef62391d386a5d327dfda0a9256f9e9ab874619195e3c722" exitCode=143 Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.071348 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"68500e27-b83c-4571-9082-33e4d4ea3daa","Type":"ContainerDied","Data":"53a6aa2de43f8168ef62391d386a5d327dfda0a9256f9e9ab874619195e3c722"} Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.077846 5120 generic.go:358] "Generic (PLEG): container finished" podID="48f680c8-5737-416a-ab55-2c7fcf32c0e2" containerID="91cdc41498d52eadc713d48b44ce9200489f918206eab5cb8a8f23186b9a72fa" exitCode=0 Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.078075 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"48f680c8-5737-416a-ab55-2c7fcf32c0e2","Type":"ContainerDied","Data":"91cdc41498d52eadc713d48b44ce9200489f918206eab5cb8a8f23186b9a72fa"} Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.095460 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-78dc5f4cb-mjvvc"] Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.095917 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-78dc5f4cb-mjvvc" podUID="152925c6-48ae-4e8d-9a3f-68f01278fe95" containerName="barbican-api-log" containerID="cri-o://f3ed28bfae2057c9814ffe1a00568ad048a0121320ce65449ff7b08c5990b871" gracePeriod=30 Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.096223 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-78dc5f4cb-mjvvc" podUID="152925c6-48ae-4e8d-9a3f-68f01278fe95" containerName="barbican-api" containerID="cri-o://03a3d3382bd92ee1061cb9a4c52c11007f361661aa271a81420c3f5463675e59" gracePeriod=30 Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.112482 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage17-crc" (OuterVolumeSpecName: "ovndbcluster-nb-etc-ovn") pod "b3ff7a5c-9d60-4d20-9308-0b7d88d605f6" (UID: "b3ff7a5c-9d60-4d20-9308-0b7d88d605f6"). InnerVolumeSpecName "local-storage17-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.113055 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3ff7a5c-9d60-4d20-9308-0b7d88d605f6-kube-api-access-42zrm" (OuterVolumeSpecName: "kube-api-access-42zrm") pod "b3ff7a5c-9d60-4d20-9308-0b7d88d605f6" (UID: "b3ff7a5c-9d60-4d20-9308-0b7d88d605f6"). InnerVolumeSpecName "kube-api-access-42zrm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.115054 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-774a-account-create-update-tkwhv"] Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.120539 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-b06a-account-create-update-7v27d" event={"ID":"5c8124f6-11f6-49fd-94a8-d931c557b6c4","Type":"ContainerStarted","Data":"36589f4662fea6e90b8065d3926a3ba02c4251a0723356502b5a00f6b636306e"} Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.158868 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.159505 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podUID="1c6098ab-3f23-46bd-95ff-94cf96b88f3f" containerName="nova-cell1-novncproxy-novncproxy" containerID="cri-o://6e9e6be4f80554429db8fb19a515898ddff3abe9d6e1a2671afc4c3fc09e832b" gracePeriod=30 Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.162008 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b3ff7a5c-9d60-4d20-9308-0b7d88d605f6-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "b3ff7a5c-9d60-4d20-9308-0b7d88d605f6" (UID: "b3ff7a5c-9d60-4d20-9308-0b7d88d605f6"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.167393 5120 generic.go:358] "Generic (PLEG): container finished" podID="75da64f9-4c43-4411-bd20-86c98536adce" containerID="968f2c31370baabe38dba56e7264e516bb8706c445891678a7b239714c6d5115" exitCode=143 Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.167793 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"75da64f9-4c43-4411-bd20-86c98536adce","Type":"ContainerDied","Data":"968f2c31370baabe38dba56e7264e516bb8706c445891678a7b239714c6d5115"} Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.177572 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/d1960e17-5bd0-46f5-9155-8dd50410168f-ovsdbserver-sb-tls-certs\") pod \"d1960e17-5bd0-46f5-9155-8dd50410168f\" (UID: \"d1960e17-5bd0-46f5-9155-8dd50410168f\") " Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.177862 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/d1960e17-5bd0-46f5-9155-8dd50410168f-scripts\") pod \"d1960e17-5bd0-46f5-9155-8dd50410168f\" (UID: \"d1960e17-5bd0-46f5-9155-8dd50410168f\") " Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.178194 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d1960e17-5bd0-46f5-9155-8dd50410168f-combined-ca-bundle\") pod \"d1960e17-5bd0-46f5-9155-8dd50410168f\" (UID: \"d1960e17-5bd0-46f5-9155-8dd50410168f\") " Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.179105 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d1960e17-5bd0-46f5-9155-8dd50410168f-scripts" (OuterVolumeSpecName: "scripts") pod "d1960e17-5bd0-46f5-9155-8dd50410168f" (UID: "d1960e17-5bd0-46f5-9155-8dd50410168f"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.179247 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nvkkq\" (UniqueName: \"kubernetes.io/projected/d1960e17-5bd0-46f5-9155-8dd50410168f-kube-api-access-nvkkq\") pod \"d1960e17-5bd0-46f5-9155-8dd50410168f\" (UID: \"d1960e17-5bd0-46f5-9155-8dd50410168f\") " Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.179335 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/d1960e17-5bd0-46f5-9155-8dd50410168f-ovsdb-rundir\") pod \"d1960e17-5bd0-46f5-9155-8dd50410168f\" (UID: \"d1960e17-5bd0-46f5-9155-8dd50410168f\") " Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.179448 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovndbcluster-sb-etc-ovn\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"d1960e17-5bd0-46f5-9155-8dd50410168f\" (UID: \"d1960e17-5bd0-46f5-9155-8dd50410168f\") " Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.179593 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/d1960e17-5bd0-46f5-9155-8dd50410168f-metrics-certs-tls-certs\") pod \"d1960e17-5bd0-46f5-9155-8dd50410168f\" (UID: \"d1960e17-5bd0-46f5-9155-8dd50410168f\") " Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.179822 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d1960e17-5bd0-46f5-9155-8dd50410168f-config\") pod \"d1960e17-5bd0-46f5-9155-8dd50410168f\" (UID: \"d1960e17-5bd0-46f5-9155-8dd50410168f\") " Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.183729 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1960e17-5bd0-46f5-9155-8dd50410168f-ovsdb-rundir" (OuterVolumeSpecName: "ovsdb-rundir") pod "d1960e17-5bd0-46f5-9155-8dd50410168f" (UID: "d1960e17-5bd0-46f5-9155-8dd50410168f"). InnerVolumeSpecName "ovsdb-rundir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.185054 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.187423 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d1960e17-5bd0-46f5-9155-8dd50410168f-config" (OuterVolumeSpecName: "config") pod "d1960e17-5bd0-46f5-9155-8dd50410168f" (UID: "d1960e17-5bd0-46f5-9155-8dd50410168f"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.189039 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/d1960e17-5bd0-46f5-9155-8dd50410168f-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.189183 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-42zrm\" (UniqueName: \"kubernetes.io/projected/b3ff7a5c-9d60-4d20-9308-0b7d88d605f6-kube-api-access-42zrm\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.189293 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b3ff7a5c-9d60-4d20-9308-0b7d88d605f6-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.189401 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") on node \"crc\" " Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.189474 5120 reconciler_common.go:299] "Volume detached for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/d1960e17-5bd0-46f5-9155-8dd50410168f-ovsdb-rundir\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.189585 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d1960e17-5bd0-46f5-9155-8dd50410168f-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.196475 5120 generic.go:358] "Generic (PLEG): container finished" podID="ae73ae1d-4056-43c2-addd-f08999a4a7f6" containerID="212ef64e26a8c2cc068193dc28ff446a67b88b3626597c06ecc57e0b01067724" exitCode=143 Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.196680 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-6cc74c8747-7pf27" event={"ID":"ae73ae1d-4056-43c2-addd-f08999a4a7f6","Type":"ContainerDied","Data":"212ef64e26a8c2cc068193dc28ff446a67b88b3626597c06ecc57e0b01067724"} Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.217479 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1960e17-5bd0-46f5-9155-8dd50410168f-kube-api-access-nvkkq" (OuterVolumeSpecName: "kube-api-access-nvkkq") pod "d1960e17-5bd0-46f5-9155-8dd50410168f" (UID: "d1960e17-5bd0-46f5-9155-8dd50410168f"). InnerVolumeSpecName "kube-api-access-nvkkq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.221838 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage06-crc" (OuterVolumeSpecName: "ovndbcluster-sb-etc-ovn") pod "d1960e17-5bd0-46f5-9155-8dd50410168f" (UID: "d1960e17-5bd0-46f5-9155-8dd50410168f"). InnerVolumeSpecName "local-storage06-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.255320 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-b06a-account-create-update-7v27d"] Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.270872 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-774a-account-create-update-tkwhv"] Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.280983 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-5a68-account-create-update-9nxpw"] Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.287988 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.288337 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="e3bbdf40-3feb-46ae-a12d-152e88c1bccd" containerName="ceilometer-central-agent" containerID="cri-o://6c1bd7806ab012b5b16af79d65b808832086d33a8024353ef14b25032736b665" gracePeriod=30 Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.288483 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="e3bbdf40-3feb-46ae-a12d-152e88c1bccd" containerName="proxy-httpd" containerID="cri-o://c93587a6adf780fb486fc549a2b959fb20fcb325d0bd45e869e6926928b7d69e" gracePeriod=30 Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.288531 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="e3bbdf40-3feb-46ae-a12d-152e88c1bccd" containerName="sg-core" containerID="cri-o://caeb7b897b55fc95665a1bf7861c08e4cce273d594fed47d77ee3311a0d06d37" gracePeriod=30 Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.288569 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="e3bbdf40-3feb-46ae-a12d-152e88c1bccd" containerName="ceilometer-notification-agent" containerID="cri-o://5523e5bfe537c21f58dd2396b51a688a7a7e02b72fba915bed95b8b93206e355" gracePeriod=30 Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.292843 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nvkkq\" (UniqueName: \"kubernetes.io/projected/d1960e17-5bd0-46f5-9155-8dd50410168f-kube-api-access-nvkkq\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.292890 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") on node \"crc\" " Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.303332 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/ceilometer-0" podUID="e3bbdf40-3feb-46ae-a12d-152e88c1bccd" containerName="proxy-httpd" probeResult="failure" output="Get \"https://10.217.0.195:3000/\": EOF" Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.297934 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" podUID="27ae46b8-fa26-48e8-a9bb-36bc910c3caf" containerName="rabbitmq" containerID="cri-o://67d364b2aaba2a401705ec4f2931d79fe5a55f4f1d2ab7387f8debc4e1e79018" gracePeriod=604800 Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.309564 5120 generic.go:358] "Generic (PLEG): container finished" podID="bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a" containerID="9654f347f34ca84be3b59cba15e0fac1abebc6019b67f4cedd8ccd90b36b6475" exitCode=0 Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.309627 5120 generic.go:358] "Generic (PLEG): container finished" podID="bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a" containerID="f16bf633e499694d3f9b72799502d14d9077fcee087448051bbfe3c7ee1a846a" exitCode=0 Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.309636 5120 generic.go:358] "Generic (PLEG): container finished" podID="bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a" containerID="2454d54900356215b328078c989b7ee2ba76bf00e907810455592dd0328d3607" exitCode=0 Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.309644 5120 generic.go:358] "Generic (PLEG): container finished" podID="bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a" containerID="5aa2c642ff9b32cbd48cdd175341bc53df8e83fb47b3006102567a681eb9fe12" exitCode=0 Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.309652 5120 generic.go:358] "Generic (PLEG): container finished" podID="bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a" containerID="8ae45574f24cf4187ebc4c1968f20b78b90badf1d3289e58e00075a12b7f4aaf" exitCode=0 Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.309680 5120 generic.go:358] "Generic (PLEG): container finished" podID="bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a" containerID="2cfafdd940355b0c9ef3bd22588f683e31e9b9ae011f465bc5afd07315f80340" exitCode=0 Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.309691 5120 generic.go:358] "Generic (PLEG): container finished" podID="bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a" containerID="49c026b13207a7e4d1fe5b1529024ced01e29f9e430a662852633085f308ba6d" exitCode=0 Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.309697 5120 generic.go:358] "Generic (PLEG): container finished" podID="bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a" containerID="554f007f0035801c2403921329abc993a0f8616e35fd0592c4e77e8f5133ccb6" exitCode=0 Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.309704 5120 generic.go:358] "Generic (PLEG): container finished" podID="bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a" containerID="49757f02afc4e3f6e201e4726f9a770efb96bca7046b78c5b0456df02c9b9973" exitCode=0 Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.309711 5120 generic.go:358] "Generic (PLEG): container finished" podID="bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a" containerID="749a177740837a342b9536a7af62a8f69e41d5084bf108b901c90c18c3dbe68d" exitCode=0 Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.309718 5120 generic.go:358] "Generic (PLEG): container finished" podID="bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a" containerID="5824335e776fc051905fc3da3116a19441d8ccddf48562f51769a8e960b3094b" exitCode=0 Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.309726 5120 generic.go:358] "Generic (PLEG): container finished" podID="bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a" containerID="5d46cbd0fdd4c39dd4e954ede4e74df9712ffe1d057d4db2ab6df41eb7838bfc" exitCode=0 Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.309733 5120 generic.go:358] "Generic (PLEG): container finished" podID="bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a" containerID="f2f18037c204777302f8e785f799d372046706b80e5745c02575b4fd86dd582e" exitCode=0 Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.309739 5120 generic.go:358] "Generic (PLEG): container finished" podID="bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a" containerID="fd7d7a93b6338f5f1cb87f0080e397a13c05990ec35fc7410c95850dd2ceddc0" exitCode=0 Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.310029 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a","Type":"ContainerDied","Data":"9654f347f34ca84be3b59cba15e0fac1abebc6019b67f4cedd8ccd90b36b6475"} Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.310063 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a","Type":"ContainerDied","Data":"f16bf633e499694d3f9b72799502d14d9077fcee087448051bbfe3c7ee1a846a"} Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.310074 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a","Type":"ContainerDied","Data":"2454d54900356215b328078c989b7ee2ba76bf00e907810455592dd0328d3607"} Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.310086 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a","Type":"ContainerDied","Data":"5aa2c642ff9b32cbd48cdd175341bc53df8e83fb47b3006102567a681eb9fe12"} Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.310096 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a","Type":"ContainerDied","Data":"8ae45574f24cf4187ebc4c1968f20b78b90badf1d3289e58e00075a12b7f4aaf"} Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.310106 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a","Type":"ContainerDied","Data":"2cfafdd940355b0c9ef3bd22588f683e31e9b9ae011f465bc5afd07315f80340"} Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.310117 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a","Type":"ContainerDied","Data":"49c026b13207a7e4d1fe5b1529024ced01e29f9e430a662852633085f308ba6d"} Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.310129 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a","Type":"ContainerDied","Data":"554f007f0035801c2403921329abc993a0f8616e35fd0592c4e77e8f5133ccb6"} Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.310142 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a","Type":"ContainerDied","Data":"49757f02afc4e3f6e201e4726f9a770efb96bca7046b78c5b0456df02c9b9973"} Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.310152 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a","Type":"ContainerDied","Data":"749a177740837a342b9536a7af62a8f69e41d5084bf108b901c90c18c3dbe68d"} Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.310163 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a","Type":"ContainerDied","Data":"5824335e776fc051905fc3da3116a19441d8ccddf48562f51769a8e960b3094b"} Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.310172 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a","Type":"ContainerDied","Data":"5d46cbd0fdd4c39dd4e954ede4e74df9712ffe1d057d4db2ab6df41eb7838bfc"} Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.310183 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a","Type":"ContainerDied","Data":"f2f18037c204777302f8e785f799d372046706b80e5745c02575b4fd86dd582e"} Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.310192 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a","Type":"ContainerDied","Data":"fd7d7a93b6338f5f1cb87f0080e397a13c05990ec35fc7410c95850dd2ceddc0"} Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.313858 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-2845-account-create-update-2mnh7" event={"ID":"bb4b3750-ad5c-4e9e-9824-caba853515cd","Type":"ContainerStarted","Data":"feb64c478e5e4a3f86623bf7b1af2d3f8e0dd72b95aeb44a8fcac5e602a16618"} Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.341940 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d1960e17-5bd0-46f5-9155-8dd50410168f-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "d1960e17-5bd0-46f5-9155-8dd50410168f" (UID: "d1960e17-5bd0-46f5-9155-8dd50410168f"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.347381 5120 generic.go:358] "Generic (PLEG): container finished" podID="cdf5b2c0-4a53-4c60-a566-d18398c0c560" containerID="365b620ab0a5f5b67686132db3d88ec20960fac4cc2e2d4565362ace99ba2a1d" exitCode=0 Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.347615 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-9f898f5b6-g9g57" event={"ID":"cdf5b2c0-4a53-4c60-a566-d18398c0c560","Type":"ContainerDied","Data":"365b620ab0a5f5b67686132db3d88ec20960fac4cc2e2d4565362ace99ba2a1d"} Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.352288 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage17-crc" (UniqueName: "kubernetes.io/local-volume/local-storage17-crc") on node "crc" Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.354394 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-0869-account-create-update-c899g" event={"ID":"df3f2e26-88e4-445e-a448-f05b062ff2b3","Type":"ContainerStarted","Data":"86229ada0eca04f834259033bb853bf2f0f4b80b020c3e6cb8a925981205b2df"} Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.354579 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.356591 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage06-crc" (UniqueName: "kubernetes.io/local-volume/local-storage06-crc") on node "crc" Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.369849 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/rabbitmq-server-0" podUID="c6ba454f-2263-4fc3-bd13-35f921464d24" containerName="rabbitmq" probeResult="failure" output="dial tcp 10.217.1.233:5671: connect: connection refused" Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.391980 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-proxy-5d595646b6-w4dgd"] Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.392406 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-proxy-5d595646b6-w4dgd" podUID="689362fd-dae2-4d32-839f-c13ebc515c4c" containerName="proxy-httpd" containerID="cri-o://9569cfb59832e14e0060f550d868c280dfe3ecac2ddf44052552f76ad15ad693" gracePeriod=30 Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.392970 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-proxy-5d595646b6-w4dgd" podUID="689362fd-dae2-4d32-839f-c13ebc515c4c" containerName="proxy-server" containerID="cri-o://513a25e97b4b98222e73c585010f0bf9a581e930c8688dc9f3f9370620baaaf5" gracePeriod=30 Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.393404 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-0ea4-account-create-update-tl2bd" event={"ID":"fb775edc-5783-4ad6-a85e-ec4d71ac7f5c","Type":"ContainerStarted","Data":"ce0f3bb6fa65c86ac9268af07e50f6888a30b46be649c8d5eed4c6fa7496e326"} Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.397609 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d1960e17-5bd0-46f5-9155-8dd50410168f-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:22 crc kubenswrapper[5120]: E0316 16:54:22.397612 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 16:54:22 crc kubenswrapper[5120]: E0316 16:54:22.397683 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-kube-state-metrics-svc: secret "cert-kube-state-metrics-svc" not found Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.397717 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:22 crc kubenswrapper[5120]: E0316 16:54:22.397884 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70574728-2a53-4b17-941b-e437321d936c-combined-ca-bundle podName:70574728-2a53-4b17-941b-e437321d936c nodeName:}" failed. No retries permitted until 2026-03-16 16:54:24.397821071 +0000 UTC m=+4966.551752728 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/70574728-2a53-4b17-941b-e437321d936c-combined-ca-bundle") pod "kube-state-metrics-0" (UID: "70574728-2a53-4b17-941b-e437321d936c") : secret "combined-ca-bundle" not found Mar 16 16:54:22 crc kubenswrapper[5120]: E0316 16:54:22.397906 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70574728-2a53-4b17-941b-e437321d936c-kube-state-metrics-tls-certs podName:70574728-2a53-4b17-941b-e437321d936c nodeName:}" failed. No retries permitted until 2026-03-16 16:54:24.397896853 +0000 UTC m=+4966.551828510 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls-certs" (UniqueName: "kubernetes.io/secret/70574728-2a53-4b17-941b-e437321d936c-kube-state-metrics-tls-certs") pod "kube-state-metrics-0" (UID: "70574728-2a53-4b17-941b-e437321d936c") : secret "cert-kube-state-metrics-svc" not found Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.397920 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.403575 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_b3ff7a5c-9d60-4d20-9308-0b7d88d605f6/ovsdbserver-nb/0.log" Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.403699 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"b3ff7a5c-9d60-4d20-9308-0b7d88d605f6","Type":"ContainerDied","Data":"6c58d2b5148e4e817275d3711291f3d9a418744542a51bf5a8201925c1f9da25"} Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.403737 5120 scope.go:117] "RemoveContainer" containerID="eefe2c9b53c6bd8747cdce644a861bbc411bf663cd9a7b5171573eeb873ff874" Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.404000 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.421528 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_d1960e17-5bd0-46f5-9155-8dd50410168f/ovsdbserver-sb/0.log" Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.421629 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"d1960e17-5bd0-46f5-9155-8dd50410168f","Type":"ContainerDied","Data":"9851d014f9993065c00cb86a3a73571ca82ca0e8ec36d871942841b4fc7f5424"} Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.421733 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.424466 5120 generic.go:358] "Generic (PLEG): container finished" podID="52f09603-9dff-4c67-a4b9-7bb162cd4a40" containerID="5c97c398f0afe37fdf9742e5a29f3aceed602ae6a9ab68f801d5897d0ffcefea" exitCode=137 Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.424953 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/kube-state-metrics-0" podUID="70574728-2a53-4b17-941b-e437321d936c" containerName="kube-state-metrics" containerID="cri-o://bad8f59b506232e4d0ac3673dae365123d4638c90ab2bc268e14c1ebf90f8454" gracePeriod=30 Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.463363 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b3ff7a5c-9d60-4d20-9308-0b7d88d605f6-ovsdbserver-nb-tls-certs" (OuterVolumeSpecName: "ovsdbserver-nb-tls-certs") pod "b3ff7a5c-9d60-4d20-9308-0b7d88d605f6" (UID: "b3ff7a5c-9d60-4d20-9308-0b7d88d605f6"). InnerVolumeSpecName "ovsdbserver-nb-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.475362 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b3ff7a5c-9d60-4d20-9308-0b7d88d605f6-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "b3ff7a5c-9d60-4d20-9308-0b7d88d605f6" (UID: "b3ff7a5c-9d60-4d20-9308-0b7d88d605f6"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.497499 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/openstack-cell1-galera-0" podUID="04afe1ee-a37b-4e44-91b4-7e15170bb03c" containerName="galera" containerID="cri-o://66c1f61e65b0dd0d9cb8fc1e91a6641115210d2e6e711f0e4a45b8424b0076ef" gracePeriod=30 Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.499015 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d1960e17-5bd0-46f5-9155-8dd50410168f-ovsdbserver-sb-tls-certs" (OuterVolumeSpecName: "ovsdbserver-sb-tls-certs") pod "d1960e17-5bd0-46f5-9155-8dd50410168f" (UID: "d1960e17-5bd0-46f5-9155-8dd50410168f"). InnerVolumeSpecName "ovsdbserver-sb-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.501129 5120 reconciler_common.go:299] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/b3ff7a5c-9d60-4d20-9308-0b7d88d605f6-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.501163 5120 reconciler_common.go:299] "Volume detached for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/b3ff7a5c-9d60-4d20-9308-0b7d88d605f6-ovsdbserver-nb-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.501172 5120 reconciler_common.go:299] "Volume detached for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/d1960e17-5bd0-46f5-9155-8dd50410168f-ovsdbserver-sb-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.535335 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d1960e17-5bd0-46f5-9155-8dd50410168f-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "d1960e17-5bd0-46f5-9155-8dd50410168f" (UID: "d1960e17-5bd0-46f5-9155-8dd50410168f"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.604167 5120 reconciler_common.go:299] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/d1960e17-5bd0-46f5-9155-8dd50410168f-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:22 crc kubenswrapper[5120]: E0316 16:54:22.639813 5120 kuberuntime_manager.go:1358] "Unhandled Error" err=< Mar 16 16:54:22 crc kubenswrapper[5120]: container &Container{Name:mariadb-account-create-update,Image:quay.io/podified-antelope-centos9/openstack-mariadb@sha256:4caef2b55e01b9a7ee88a22bc69db1893521a91d95c7ad4c8e593f14f17a5f95,Command:[/bin/sh -c #!/bin/bash Mar 16 16:54:22 crc kubenswrapper[5120]: Mar 16 16:54:22 crc kubenswrapper[5120]: MYSQL_REMOTE_HOST="" source /var/lib/operator-scripts/mysql_root_auth.sh Mar 16 16:54:22 crc kubenswrapper[5120]: Mar 16 16:54:22 crc kubenswrapper[5120]: export DatabasePassword=${DatabasePassword:?"Please specify a DatabasePassword variable."} Mar 16 16:54:22 crc kubenswrapper[5120]: Mar 16 16:54:22 crc kubenswrapper[5120]: MYSQL_CMD="mysql -h -u root -P 3306" Mar 16 16:54:22 crc kubenswrapper[5120]: Mar 16 16:54:22 crc kubenswrapper[5120]: if [ -n "nova_api" ]; then Mar 16 16:54:22 crc kubenswrapper[5120]: GRANT_DATABASE="nova_api" Mar 16 16:54:22 crc kubenswrapper[5120]: else Mar 16 16:54:22 crc kubenswrapper[5120]: GRANT_DATABASE="*" Mar 16 16:54:22 crc kubenswrapper[5120]: fi Mar 16 16:54:22 crc kubenswrapper[5120]: Mar 16 16:54:22 crc kubenswrapper[5120]: # going for maximum compatibility here: Mar 16 16:54:22 crc kubenswrapper[5120]: # 1. MySQL 8 no longer allows implicit create user when GRANT is used Mar 16 16:54:22 crc kubenswrapper[5120]: # 2. MariaDB has "CREATE OR REPLACE", but MySQL does not Mar 16 16:54:22 crc kubenswrapper[5120]: # 3. create user with CREATE but then do all password and TLS with ALTER to Mar 16 16:54:22 crc kubenswrapper[5120]: # support updates Mar 16 16:54:22 crc kubenswrapper[5120]: Mar 16 16:54:22 crc kubenswrapper[5120]: $MYSQL_CMD < logger="UnhandledError" Mar 16 16:54:22 crc kubenswrapper[5120]: E0316 16:54:22.640220 5120 kuberuntime_manager.go:1358] "Unhandled Error" err=< Mar 16 16:54:22 crc kubenswrapper[5120]: container &Container{Name:mariadb-account-create-update,Image:quay.io/podified-antelope-centos9/openstack-mariadb@sha256:4caef2b55e01b9a7ee88a22bc69db1893521a91d95c7ad4c8e593f14f17a5f95,Command:[/bin/sh -c #!/bin/bash Mar 16 16:54:22 crc kubenswrapper[5120]: Mar 16 16:54:22 crc kubenswrapper[5120]: MYSQL_REMOTE_HOST="" source /var/lib/operator-scripts/mysql_root_auth.sh Mar 16 16:54:22 crc kubenswrapper[5120]: Mar 16 16:54:22 crc kubenswrapper[5120]: export DatabasePassword=${DatabasePassword:?"Please specify a DatabasePassword variable."} Mar 16 16:54:22 crc kubenswrapper[5120]: Mar 16 16:54:22 crc kubenswrapper[5120]: MYSQL_CMD="mysql -h -u root -P 3306" Mar 16 16:54:22 crc kubenswrapper[5120]: Mar 16 16:54:22 crc kubenswrapper[5120]: if [ -n "barbican" ]; then Mar 16 16:54:22 crc kubenswrapper[5120]: GRANT_DATABASE="barbican" Mar 16 16:54:22 crc kubenswrapper[5120]: else Mar 16 16:54:22 crc kubenswrapper[5120]: GRANT_DATABASE="*" Mar 16 16:54:22 crc kubenswrapper[5120]: fi Mar 16 16:54:22 crc kubenswrapper[5120]: Mar 16 16:54:22 crc kubenswrapper[5120]: # going for maximum compatibility here: Mar 16 16:54:22 crc kubenswrapper[5120]: # 1. MySQL 8 no longer allows implicit create user when GRANT is used Mar 16 16:54:22 crc kubenswrapper[5120]: # 2. MariaDB has "CREATE OR REPLACE", but MySQL does not Mar 16 16:54:22 crc kubenswrapper[5120]: # 3. create user with CREATE but then do all password and TLS with ALTER to Mar 16 16:54:22 crc kubenswrapper[5120]: # support updates Mar 16 16:54:22 crc kubenswrapper[5120]: Mar 16 16:54:22 crc kubenswrapper[5120]: $MYSQL_CMD < logger="UnhandledError" Mar 16 16:54:22 crc kubenswrapper[5120]: E0316 16:54:22.640287 5120 kuberuntime_manager.go:1358] "Unhandled Error" err=< Mar 16 16:54:22 crc kubenswrapper[5120]: container &Container{Name:mariadb-account-create-update,Image:quay.io/podified-antelope-centos9/openstack-mariadb@sha256:4caef2b55e01b9a7ee88a22bc69db1893521a91d95c7ad4c8e593f14f17a5f95,Command:[/bin/sh -c #!/bin/bash Mar 16 16:54:22 crc kubenswrapper[5120]: Mar 16 16:54:22 crc kubenswrapper[5120]: MYSQL_REMOTE_HOST="" source /var/lib/operator-scripts/mysql_root_auth.sh Mar 16 16:54:22 crc kubenswrapper[5120]: Mar 16 16:54:22 crc kubenswrapper[5120]: export DatabasePassword=${DatabasePassword:?"Please specify a DatabasePassword variable."} Mar 16 16:54:22 crc kubenswrapper[5120]: Mar 16 16:54:22 crc kubenswrapper[5120]: MYSQL_CMD="mysql -h -u root -P 3306" Mar 16 16:54:22 crc kubenswrapper[5120]: Mar 16 16:54:22 crc kubenswrapper[5120]: if [ -n "neutron" ]; then Mar 16 16:54:22 crc kubenswrapper[5120]: GRANT_DATABASE="neutron" Mar 16 16:54:22 crc kubenswrapper[5120]: else Mar 16 16:54:22 crc kubenswrapper[5120]: GRANT_DATABASE="*" Mar 16 16:54:22 crc kubenswrapper[5120]: fi Mar 16 16:54:22 crc kubenswrapper[5120]: Mar 16 16:54:22 crc kubenswrapper[5120]: # going for maximum compatibility here: Mar 16 16:54:22 crc kubenswrapper[5120]: # 1. MySQL 8 no longer allows implicit create user when GRANT is used Mar 16 16:54:22 crc kubenswrapper[5120]: # 2. MariaDB has "CREATE OR REPLACE", but MySQL does not Mar 16 16:54:22 crc kubenswrapper[5120]: # 3. create user with CREATE but then do all password and TLS with ALTER to Mar 16 16:54:22 crc kubenswrapper[5120]: # support updates Mar 16 16:54:22 crc kubenswrapper[5120]: Mar 16 16:54:22 crc kubenswrapper[5120]: $MYSQL_CMD < logger="UnhandledError" Mar 16 16:54:22 crc kubenswrapper[5120]: E0316 16:54:22.640979 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"mariadb-account-create-update\" with CreateContainerConfigError: \"secret \\\"nova-api-db-secret\\\" not found\"" pod="openstack-kuttl-tests/nova-api-774a-account-create-update-tkwhv" podUID="215bcff0-714b-427b-ab26-130a21366d15" Mar 16 16:54:22 crc kubenswrapper[5120]: E0316 16:54:22.641202 5120 kuberuntime_manager.go:1358] "Unhandled Error" err=< Mar 16 16:54:22 crc kubenswrapper[5120]: container &Container{Name:mariadb-account-create-update,Image:quay.io/podified-antelope-centos9/openstack-mariadb@sha256:4caef2b55e01b9a7ee88a22bc69db1893521a91d95c7ad4c8e593f14f17a5f95,Command:[/bin/sh -c #!/bin/bash Mar 16 16:54:22 crc kubenswrapper[5120]: Mar 16 16:54:22 crc kubenswrapper[5120]: MYSQL_REMOTE_HOST="" source /var/lib/operator-scripts/mysql_root_auth.sh Mar 16 16:54:22 crc kubenswrapper[5120]: Mar 16 16:54:22 crc kubenswrapper[5120]: export DatabasePassword=${DatabasePassword:?"Please specify a DatabasePassword variable."} Mar 16 16:54:22 crc kubenswrapper[5120]: Mar 16 16:54:22 crc kubenswrapper[5120]: MYSQL_CMD="mysql -h -u root -P 3306" Mar 16 16:54:22 crc kubenswrapper[5120]: Mar 16 16:54:22 crc kubenswrapper[5120]: if [ -n "nova_cell0" ]; then Mar 16 16:54:22 crc kubenswrapper[5120]: GRANT_DATABASE="nova_cell0" Mar 16 16:54:22 crc kubenswrapper[5120]: else Mar 16 16:54:22 crc kubenswrapper[5120]: GRANT_DATABASE="*" Mar 16 16:54:22 crc kubenswrapper[5120]: fi Mar 16 16:54:22 crc kubenswrapper[5120]: Mar 16 16:54:22 crc kubenswrapper[5120]: # going for maximum compatibility here: Mar 16 16:54:22 crc kubenswrapper[5120]: # 1. MySQL 8 no longer allows implicit create user when GRANT is used Mar 16 16:54:22 crc kubenswrapper[5120]: # 2. MariaDB has "CREATE OR REPLACE", but MySQL does not Mar 16 16:54:22 crc kubenswrapper[5120]: # 3. create user with CREATE but then do all password and TLS with ALTER to Mar 16 16:54:22 crc kubenswrapper[5120]: # support updates Mar 16 16:54:22 crc kubenswrapper[5120]: Mar 16 16:54:22 crc kubenswrapper[5120]: $MYSQL_CMD < logger="UnhandledError" Mar 16 16:54:22 crc kubenswrapper[5120]: E0316 16:54:22.641380 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"mariadb-account-create-update\" with CreateContainerConfigError: \"secret \\\"neutron-db-secret\\\" not found\"" pod="openstack-kuttl-tests/neutron-b06a-account-create-update-7v27d" podUID="5c8124f6-11f6-49fd-94a8-d931c557b6c4" Mar 16 16:54:22 crc kubenswrapper[5120]: E0316 16:54:22.641489 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"mariadb-account-create-update\" with CreateContainerConfigError: \"secret \\\"barbican-db-secret\\\" not found\"" pod="openstack-kuttl-tests/barbican-1de0-account-create-update-rqhj2" podUID="ffbba34f-0cbb-4345-931f-9c4c763847e1" Mar 16 16:54:22 crc kubenswrapper[5120]: E0316 16:54:22.642518 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"mariadb-account-create-update\" with CreateContainerConfigError: \"secret \\\"nova-cell0-db-secret\\\" not found\"" pod="openstack-kuttl-tests/nova-cell0-5a68-account-create-update-9nxpw" podUID="e1ae96f9-27a3-4c3f-a7d4-334875177194" Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.703705 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0a7be161-7ccc-4927-9e5e-33da903689e3" path="/var/lib/kubelet/pods/0a7be161-7ccc-4927-9e5e-33da903689e3/volumes" Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.705185 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="13be48e8-1309-42ee-89fb-67d9cf4543aa" path="/var/lib/kubelet/pods/13be48e8-1309-42ee-89fb-67d9cf4543aa/volumes" Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.706506 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3e708073-b72b-4b18-bac4-ead3cc84ad4d" path="/var/lib/kubelet/pods/3e708073-b72b-4b18-bac4-ead3cc84ad4d/volumes" Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.709120 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="86bdc983-99ae-4f65-b8e0-37bef61cb70f" path="/var/lib/kubelet/pods/86bdc983-99ae-4f65-b8e0-37bef61cb70f/volumes" Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.709861 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8727c588-240e-4721-917b-80b50e413963" path="/var/lib/kubelet/pods/8727c588-240e-4721-917b-80b50e413963/volumes" Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.710525 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93bf3a3e-5820-451f-b1c4-6e302325b1b7" path="/var/lib/kubelet/pods/93bf3a3e-5820-451f-b1c4-6e302325b1b7/volumes" Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.711904 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b5d4194-8ea2-4088-b693-7417cdd004fb" path="/var/lib/kubelet/pods/9b5d4194-8ea2-4088-b693-7417cdd004fb/volumes" Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.715378 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a4f2ecaa-1975-4371-b2ed-ee48bac2ddfc" path="/var/lib/kubelet/pods/a4f2ecaa-1975-4371-b2ed-ee48bac2ddfc/volumes" Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.716983 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b40d62ac-8314-46a4-b602-531125454d07" path="/var/lib/kubelet/pods/b40d62ac-8314-46a4-b602-531125454d07/volumes" Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.718636 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dab6fe18-dcd9-476e-a0bc-866bff4864c8" path="/var/lib/kubelet/pods/dab6fe18-dcd9-476e-a0bc-866bff4864c8/volumes" Mar 16 16:54:22 crc kubenswrapper[5120]: E0316 16:54:22.745531 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.822535 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.829702 5120 scope.go:117] "RemoveContainer" containerID="76c5f5136097b2b8e13a204ec73f3c4bfff9a3caf4e6a7039b057c002d9745c3" Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.870950 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.889864 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.899477 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.909698 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.921747 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9kcd7\" (UniqueName: \"kubernetes.io/projected/52f09603-9dff-4c67-a4b9-7bb162cd4a40-kube-api-access-9kcd7\") pod \"52f09603-9dff-4c67-a4b9-7bb162cd4a40\" (UID: \"52f09603-9dff-4c67-a4b9-7bb162cd4a40\") " Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.921869 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/52f09603-9dff-4c67-a4b9-7bb162cd4a40-combined-ca-bundle\") pod \"52f09603-9dff-4c67-a4b9-7bb162cd4a40\" (UID: \"52f09603-9dff-4c67-a4b9-7bb162cd4a40\") " Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.922013 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/52f09603-9dff-4c67-a4b9-7bb162cd4a40-openstack-config\") pod \"52f09603-9dff-4c67-a4b9-7bb162cd4a40\" (UID: \"52f09603-9dff-4c67-a4b9-7bb162cd4a40\") " Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.922072 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/52f09603-9dff-4c67-a4b9-7bb162cd4a40-openstack-config-secret\") pod \"52f09603-9dff-4c67-a4b9-7bb162cd4a40\" (UID: \"52f09603-9dff-4c67-a4b9-7bb162cd4a40\") " Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.953296 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/52f09603-9dff-4c67-a4b9-7bb162cd4a40-openstack-config" (OuterVolumeSpecName: "openstack-config") pod "52f09603-9dff-4c67-a4b9-7bb162cd4a40" (UID: "52f09603-9dff-4c67-a4b9-7bb162cd4a40"). InnerVolumeSpecName "openstack-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:54:22 crc kubenswrapper[5120]: I0316 16:54:22.954026 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/52f09603-9dff-4c67-a4b9-7bb162cd4a40-kube-api-access-9kcd7" (OuterVolumeSpecName: "kube-api-access-9kcd7") pod "52f09603-9dff-4c67-a4b9-7bb162cd4a40" (UID: "52f09603-9dff-4c67-a4b9-7bb162cd4a40"). InnerVolumeSpecName "kube-api-access-9kcd7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:54:23 crc kubenswrapper[5120]: I0316 16:54:23.000136 5120 scope.go:117] "RemoveContainer" containerID="3f67575c174de4ec88325dae52c495fc5f7e8288f1f83576c731cc6677398a1b" Mar 16 16:54:23 crc kubenswrapper[5120]: I0316 16:54:23.017973 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/52f09603-9dff-4c67-a4b9-7bb162cd4a40-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "52f09603-9dff-4c67-a4b9-7bb162cd4a40" (UID: "52f09603-9dff-4c67-a4b9-7bb162cd4a40"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:54:23 crc kubenswrapper[5120]: I0316 16:54:23.027240 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9kcd7\" (UniqueName: \"kubernetes.io/projected/52f09603-9dff-4c67-a4b9-7bb162cd4a40-kube-api-access-9kcd7\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:23 crc kubenswrapper[5120]: I0316 16:54:23.027412 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/52f09603-9dff-4c67-a4b9-7bb162cd4a40-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:23 crc kubenswrapper[5120]: I0316 16:54:23.027506 5120 reconciler_common.go:299] "Volume detached for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/52f09603-9dff-4c67-a4b9-7bb162cd4a40-openstack-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:23 crc kubenswrapper[5120]: I0316 16:54:23.055482 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/52f09603-9dff-4c67-a4b9-7bb162cd4a40-openstack-config-secret" (OuterVolumeSpecName: "openstack-config-secret") pod "52f09603-9dff-4c67-a4b9-7bb162cd4a40" (UID: "52f09603-9dff-4c67-a4b9-7bb162cd4a40"). InnerVolumeSpecName "openstack-config-secret". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:54:23 crc kubenswrapper[5120]: I0316 16:54:23.130419 5120 reconciler_common.go:299] "Volume detached for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/52f09603-9dff-4c67-a4b9-7bb162cd4a40-openstack-config-secret\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:23 crc kubenswrapper[5120]: I0316 16:54:23.156511 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-0869-account-create-update-c899g" Mar 16 16:54:23 crc kubenswrapper[5120]: I0316 16:54:23.175854 5120 scope.go:117] "RemoveContainer" containerID="2c1d127125047f30b595c38ecdb848f5a2764132632a382908881dde9b715eb6" Mar 16 16:54:23 crc kubenswrapper[5120]: I0316 16:54:23.186953 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-0ea4-account-create-update-tl2bd" Mar 16 16:54:23 crc kubenswrapper[5120]: I0316 16:54:23.187533 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-2845-account-create-update-2mnh7" Mar 16 16:54:23 crc kubenswrapper[5120]: I0316 16:54:23.232656 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/bb4b3750-ad5c-4e9e-9824-caba853515cd-operator-scripts\") pod \"bb4b3750-ad5c-4e9e-9824-caba853515cd\" (UID: \"bb4b3750-ad5c-4e9e-9824-caba853515cd\") " Mar 16 16:54:23 crc kubenswrapper[5120]: I0316 16:54:23.232878 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8pdbp\" (UniqueName: \"kubernetes.io/projected/bb4b3750-ad5c-4e9e-9824-caba853515cd-kube-api-access-8pdbp\") pod \"bb4b3750-ad5c-4e9e-9824-caba853515cd\" (UID: \"bb4b3750-ad5c-4e9e-9824-caba853515cd\") " Mar 16 16:54:23 crc kubenswrapper[5120]: I0316 16:54:23.233141 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/fb775edc-5783-4ad6-a85e-ec4d71ac7f5c-operator-scripts\") pod \"fb775edc-5783-4ad6-a85e-ec4d71ac7f5c\" (UID: \"fb775edc-5783-4ad6-a85e-ec4d71ac7f5c\") " Mar 16 16:54:23 crc kubenswrapper[5120]: I0316 16:54:23.233908 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fb775edc-5783-4ad6-a85e-ec4d71ac7f5c-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "fb775edc-5783-4ad6-a85e-ec4d71ac7f5c" (UID: "fb775edc-5783-4ad6-a85e-ec4d71ac7f5c"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:54:23 crc kubenswrapper[5120]: I0316 16:54:23.233975 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bb4b3750-ad5c-4e9e-9824-caba853515cd-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "bb4b3750-ad5c-4e9e-9824-caba853515cd" (UID: "bb4b3750-ad5c-4e9e-9824-caba853515cd"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:54:23 crc kubenswrapper[5120]: I0316 16:54:23.234267 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vs8wt\" (UniqueName: \"kubernetes.io/projected/df3f2e26-88e4-445e-a448-f05b062ff2b3-kube-api-access-vs8wt\") pod \"df3f2e26-88e4-445e-a448-f05b062ff2b3\" (UID: \"df3f2e26-88e4-445e-a448-f05b062ff2b3\") " Mar 16 16:54:23 crc kubenswrapper[5120]: I0316 16:54:23.234353 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9ct68\" (UniqueName: \"kubernetes.io/projected/fb775edc-5783-4ad6-a85e-ec4d71ac7f5c-kube-api-access-9ct68\") pod \"fb775edc-5783-4ad6-a85e-ec4d71ac7f5c\" (UID: \"fb775edc-5783-4ad6-a85e-ec4d71ac7f5c\") " Mar 16 16:54:23 crc kubenswrapper[5120]: I0316 16:54:23.234389 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/df3f2e26-88e4-445e-a448-f05b062ff2b3-operator-scripts\") pod \"df3f2e26-88e4-445e-a448-f05b062ff2b3\" (UID: \"df3f2e26-88e4-445e-a448-f05b062ff2b3\") " Mar 16 16:54:23 crc kubenswrapper[5120]: I0316 16:54:23.235509 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/df3f2e26-88e4-445e-a448-f05b062ff2b3-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "df3f2e26-88e4-445e-a448-f05b062ff2b3" (UID: "df3f2e26-88e4-445e-a448-f05b062ff2b3"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:54:23 crc kubenswrapper[5120]: I0316 16:54:23.236065 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/df3f2e26-88e4-445e-a448-f05b062ff2b3-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:23 crc kubenswrapper[5120]: I0316 16:54:23.236085 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/bb4b3750-ad5c-4e9e-9824-caba853515cd-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:23 crc kubenswrapper[5120]: I0316 16:54:23.236095 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/fb775edc-5783-4ad6-a85e-ec4d71ac7f5c-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:23 crc kubenswrapper[5120]: I0316 16:54:23.240963 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb775edc-5783-4ad6-a85e-ec4d71ac7f5c-kube-api-access-9ct68" (OuterVolumeSpecName: "kube-api-access-9ct68") pod "fb775edc-5783-4ad6-a85e-ec4d71ac7f5c" (UID: "fb775edc-5783-4ad6-a85e-ec4d71ac7f5c"). InnerVolumeSpecName "kube-api-access-9ct68". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:54:23 crc kubenswrapper[5120]: I0316 16:54:23.241251 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df3f2e26-88e4-445e-a448-f05b062ff2b3-kube-api-access-vs8wt" (OuterVolumeSpecName: "kube-api-access-vs8wt") pod "df3f2e26-88e4-445e-a448-f05b062ff2b3" (UID: "df3f2e26-88e4-445e-a448-f05b062ff2b3"). InnerVolumeSpecName "kube-api-access-vs8wt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:54:23 crc kubenswrapper[5120]: I0316 16:54:23.248724 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb4b3750-ad5c-4e9e-9824-caba853515cd-kube-api-access-8pdbp" (OuterVolumeSpecName: "kube-api-access-8pdbp") pod "bb4b3750-ad5c-4e9e-9824-caba853515cd" (UID: "bb4b3750-ad5c-4e9e-9824-caba853515cd"). InnerVolumeSpecName "kube-api-access-8pdbp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:54:23 crc kubenswrapper[5120]: I0316 16:54:23.342413 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vs8wt\" (UniqueName: \"kubernetes.io/projected/df3f2e26-88e4-445e-a448-f05b062ff2b3-kube-api-access-vs8wt\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:23 crc kubenswrapper[5120]: I0316 16:54:23.342449 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9ct68\" (UniqueName: \"kubernetes.io/projected/fb775edc-5783-4ad6-a85e-ec4d71ac7f5c-kube-api-access-9ct68\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:23 crc kubenswrapper[5120]: I0316 16:54:23.342459 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8pdbp\" (UniqueName: \"kubernetes.io/projected/bb4b3750-ad5c-4e9e-9824-caba853515cd-kube-api-access-8pdbp\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:23 crc kubenswrapper[5120]: I0316 16:54:23.447042 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-0869-account-create-update-c899g" event={"ID":"df3f2e26-88e4-445e-a448-f05b062ff2b3","Type":"ContainerDied","Data":"86229ada0eca04f834259033bb853bf2f0f4b80b020c3e6cb8a925981205b2df"} Mar 16 16:54:23 crc kubenswrapper[5120]: I0316 16:54:23.447246 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-0869-account-create-update-c899g" Mar 16 16:54:23 crc kubenswrapper[5120]: I0316 16:54:23.456646 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-0ea4-account-create-update-tl2bd" Mar 16 16:54:23 crc kubenswrapper[5120]: I0316 16:54:23.456923 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-0ea4-account-create-update-tl2bd" event={"ID":"fb775edc-5783-4ad6-a85e-ec4d71ac7f5c","Type":"ContainerDied","Data":"ce0f3bb6fa65c86ac9268af07e50f6888a30b46be649c8d5eed4c6fa7496e326"} Mar 16 16:54:23 crc kubenswrapper[5120]: I0316 16:54:23.471824 5120 generic.go:358] "Generic (PLEG): container finished" podID="04afe1ee-a37b-4e44-91b4-7e15170bb03c" containerID="66c1f61e65b0dd0d9cb8fc1e91a6641115210d2e6e711f0e4a45b8424b0076ef" exitCode=0 Mar 16 16:54:23 crc kubenswrapper[5120]: I0316 16:54:23.472038 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"04afe1ee-a37b-4e44-91b4-7e15170bb03c","Type":"ContainerDied","Data":"66c1f61e65b0dd0d9cb8fc1e91a6641115210d2e6e711f0e4a45b8424b0076ef"} Mar 16 16:54:23 crc kubenswrapper[5120]: I0316 16:54:23.481661 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Mar 16 16:54:23 crc kubenswrapper[5120]: I0316 16:54:23.481720 5120 scope.go:117] "RemoveContainer" containerID="5c97c398f0afe37fdf9742e5a29f3aceed602ae6a9ab68f801d5897d0ffcefea" Mar 16 16:54:23 crc kubenswrapper[5120]: I0316 16:54:23.503714 5120 generic.go:358] "Generic (PLEG): container finished" podID="152925c6-48ae-4e8d-9a3f-68f01278fe95" containerID="f3ed28bfae2057c9814ffe1a00568ad048a0121320ce65449ff7b08c5990b871" exitCode=143 Mar 16 16:54:23 crc kubenswrapper[5120]: I0316 16:54:23.503872 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-78dc5f4cb-mjvvc" event={"ID":"152925c6-48ae-4e8d-9a3f-68f01278fe95","Type":"ContainerDied","Data":"f3ed28bfae2057c9814ffe1a00568ad048a0121320ce65449ff7b08c5990b871"} Mar 16 16:54:23 crc kubenswrapper[5120]: I0316 16:54:23.515802 5120 generic.go:358] "Generic (PLEG): container finished" podID="472a9d94-a155-4916-aab9-4672a3c6c18c" containerID="840093ee5a2a11cc1fdcd8dc97c9738e8f3927be0adf408e9af80e17042ee646" exitCode=143 Mar 16 16:54:23 crc kubenswrapper[5120]: I0316 16:54:23.516172 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-788658cdb6-tsr2b" event={"ID":"472a9d94-a155-4916-aab9-4672a3c6c18c","Type":"ContainerDied","Data":"840093ee5a2a11cc1fdcd8dc97c9738e8f3927be0adf408e9af80e17042ee646"} Mar 16 16:54:23 crc kubenswrapper[5120]: I0316 16:54:23.528973 5120 generic.go:358] "Generic (PLEG): container finished" podID="689362fd-dae2-4d32-839f-c13ebc515c4c" containerID="513a25e97b4b98222e73c585010f0bf9a581e930c8688dc9f3f9370620baaaf5" exitCode=0 Mar 16 16:54:23 crc kubenswrapper[5120]: I0316 16:54:23.532916 5120 generic.go:358] "Generic (PLEG): container finished" podID="689362fd-dae2-4d32-839f-c13ebc515c4c" containerID="9569cfb59832e14e0060f550d868c280dfe3ecac2ddf44052552f76ad15ad693" exitCode=0 Mar 16 16:54:23 crc kubenswrapper[5120]: I0316 16:54:23.537248 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-5d595646b6-w4dgd" event={"ID":"689362fd-dae2-4d32-839f-c13ebc515c4c","Type":"ContainerDied","Data":"513a25e97b4b98222e73c585010f0bf9a581e930c8688dc9f3f9370620baaaf5"} Mar 16 16:54:23 crc kubenswrapper[5120]: I0316 16:54:23.537398 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-5d595646b6-w4dgd" event={"ID":"689362fd-dae2-4d32-839f-c13ebc515c4c","Type":"ContainerDied","Data":"9569cfb59832e14e0060f550d868c280dfe3ecac2ddf44052552f76ad15ad693"} Mar 16 16:54:23 crc kubenswrapper[5120]: I0316 16:54:23.574517 5120 generic.go:358] "Generic (PLEG): container finished" podID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerID="083f72646c8d47c9c0467b39be99ddfa9c2e5900ae0a29ad53d7b39b950274b4" exitCode=0 Mar 16 16:54:23 crc kubenswrapper[5120]: I0316 16:54:23.574995 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" event={"ID":"e2275cb4-4905-4d66-a87e-8010120db2bd","Type":"ContainerDied","Data":"083f72646c8d47c9c0467b39be99ddfa9c2e5900ae0a29ad53d7b39b950274b4"} Mar 16 16:54:23 crc kubenswrapper[5120]: I0316 16:54:23.575847 5120 scope.go:117] "RemoveContainer" containerID="083f72646c8d47c9c0467b39be99ddfa9c2e5900ae0a29ad53d7b39b950274b4" Mar 16 16:54:23 crc kubenswrapper[5120]: E0316 16:54:23.576382 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:54:23 crc kubenswrapper[5120]: I0316 16:54:23.627039 5120 generic.go:358] "Generic (PLEG): container finished" podID="bbbbc69c-1fe6-40ae-a88a-a470f3f564ed" containerID="64cd75a51f48fbcd57a97c4367ae1ef7dd8a482c3d48ad0915c7e730e333715a" exitCode=1 Mar 16 16:54:23 crc kubenswrapper[5120]: I0316 16:54:23.627607 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-pwkr9" event={"ID":"bbbbc69c-1fe6-40ae-a88a-a470f3f564ed","Type":"ContainerDied","Data":"64cd75a51f48fbcd57a97c4367ae1ef7dd8a482c3d48ad0915c7e730e333715a"} Mar 16 16:54:23 crc kubenswrapper[5120]: I0316 16:54:23.632458 5120 generic.go:358] "Generic (PLEG): container finished" podID="1c6098ab-3f23-46bd-95ff-94cf96b88f3f" containerID="6e9e6be4f80554429db8fb19a515898ddff3abe9d6e1a2671afc4c3fc09e832b" exitCode=0 Mar 16 16:54:23 crc kubenswrapper[5120]: I0316 16:54:23.632679 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"1c6098ab-3f23-46bd-95ff-94cf96b88f3f","Type":"ContainerDied","Data":"6e9e6be4f80554429db8fb19a515898ddff3abe9d6e1a2671afc4c3fc09e832b"} Mar 16 16:54:23 crc kubenswrapper[5120]: I0316 16:54:23.802895 5120 scope.go:117] "RemoveContainer" containerID="64cd75a51f48fbcd57a97c4367ae1ef7dd8a482c3d48ad0915c7e730e333715a" Mar 16 16:54:23 crc kubenswrapper[5120]: E0316 16:54:23.803581 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"mariadb-account-create-update\" with CrashLoopBackOff: \"back-off 10s restarting failed container=mariadb-account-create-update pod=root-account-create-update-pwkr9_openstack-kuttl-tests(bbbbc69c-1fe6-40ae-a88a-a470f3f564ed)\"" pod="openstack-kuttl-tests/root-account-create-update-pwkr9" podUID="bbbbc69c-1fe6-40ae-a88a-a470f3f564ed" Mar 16 16:54:23 crc kubenswrapper[5120]: E0316 16:54:23.807985 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Mar 16 16:54:23 crc kubenswrapper[5120]: E0316 16:54:23.808207 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/27ae46b8-fa26-48e8-a9bb-36bc910c3caf-config-data podName:27ae46b8-fa26-48e8-a9bb-36bc910c3caf nodeName:}" failed. No retries permitted until 2026-03-16 16:54:27.808186053 +0000 UTC m=+4969.962117720 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/27ae46b8-fa26-48e8-a9bb-36bc910c3caf-config-data") pod "rabbitmq-cell1-server-0" (UID: "27ae46b8-fa26-48e8-a9bb-36bc910c3caf") : configmap "rabbitmq-cell1-config-data" not found Mar 16 16:54:23 crc kubenswrapper[5120]: I0316 16:54:23.827093 5120 scope.go:117] "RemoveContainer" containerID="d95ef19660110ac1115024184453586b03ae38594893e63ab9da89b1f1382ac4" Mar 16 16:54:23 crc kubenswrapper[5120]: I0316 16:54:23.853898 5120 generic.go:358] "Generic (PLEG): container finished" podID="e3bbdf40-3feb-46ae-a12d-152e88c1bccd" containerID="c93587a6adf780fb486fc549a2b959fb20fcb325d0bd45e869e6926928b7d69e" exitCode=0 Mar 16 16:54:23 crc kubenswrapper[5120]: I0316 16:54:23.854158 5120 generic.go:358] "Generic (PLEG): container finished" podID="e3bbdf40-3feb-46ae-a12d-152e88c1bccd" containerID="caeb7b897b55fc95665a1bf7861c08e4cce273d594fed47d77ee3311a0d06d37" exitCode=2 Mar 16 16:54:23 crc kubenswrapper[5120]: I0316 16:54:23.854215 5120 generic.go:358] "Generic (PLEG): container finished" podID="e3bbdf40-3feb-46ae-a12d-152e88c1bccd" containerID="6c1bd7806ab012b5b16af79d65b808832086d33a8024353ef14b25032736b665" exitCode=0 Mar 16 16:54:23 crc kubenswrapper[5120]: I0316 16:54:23.854537 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"e3bbdf40-3feb-46ae-a12d-152e88c1bccd","Type":"ContainerDied","Data":"c93587a6adf780fb486fc549a2b959fb20fcb325d0bd45e869e6926928b7d69e"} Mar 16 16:54:23 crc kubenswrapper[5120]: I0316 16:54:23.854631 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"e3bbdf40-3feb-46ae-a12d-152e88c1bccd","Type":"ContainerDied","Data":"caeb7b897b55fc95665a1bf7861c08e4cce273d594fed47d77ee3311a0d06d37"} Mar 16 16:54:23 crc kubenswrapper[5120]: I0316 16:54:23.854706 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"e3bbdf40-3feb-46ae-a12d-152e88c1bccd","Type":"ContainerDied","Data":"6c1bd7806ab012b5b16af79d65b808832086d33a8024353ef14b25032736b665"} Mar 16 16:54:23 crc kubenswrapper[5120]: I0316 16:54:23.891979 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:54:23 crc kubenswrapper[5120]: I0316 16:54:23.892209 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-2845-account-create-update-2mnh7" event={"ID":"bb4b3750-ad5c-4e9e-9824-caba853515cd","Type":"ContainerDied","Data":"feb64c478e5e4a3f86623bf7b1af2d3f8e0dd72b95aeb44a8fcac5e602a16618"} Mar 16 16:54:23 crc kubenswrapper[5120]: I0316 16:54:23.892285 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-2845-account-create-update-2mnh7" Mar 16 16:54:23 crc kubenswrapper[5120]: I0316 16:54:23.912000 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/70574728-2a53-4b17-941b-e437321d936c-combined-ca-bundle\") pod \"70574728-2a53-4b17-941b-e437321d936c\" (UID: \"70574728-2a53-4b17-941b-e437321d936c\") " Mar 16 16:54:23 crc kubenswrapper[5120]: I0316 16:54:23.912177 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/70574728-2a53-4b17-941b-e437321d936c-kube-state-metrics-tls-config\") pod \"70574728-2a53-4b17-941b-e437321d936c\" (UID: \"70574728-2a53-4b17-941b-e437321d936c\") " Mar 16 16:54:23 crc kubenswrapper[5120]: I0316 16:54:23.912263 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6pbsz\" (UniqueName: \"kubernetes.io/projected/70574728-2a53-4b17-941b-e437321d936c-kube-api-access-6pbsz\") pod \"70574728-2a53-4b17-941b-e437321d936c\" (UID: \"70574728-2a53-4b17-941b-e437321d936c\") " Mar 16 16:54:23 crc kubenswrapper[5120]: I0316 16:54:23.912473 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/70574728-2a53-4b17-941b-e437321d936c-kube-state-metrics-tls-certs\") pod \"70574728-2a53-4b17-941b-e437321d936c\" (UID: \"70574728-2a53-4b17-941b-e437321d936c\") " Mar 16 16:54:23 crc kubenswrapper[5120]: E0316 16:54:23.913053 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Mar 16 16:54:23 crc kubenswrapper[5120]: E0316 16:54:23.913111 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bbbbc69c-1fe6-40ae-a88a-a470f3f564ed-operator-scripts podName:bbbbc69c-1fe6-40ae-a88a-a470f3f564ed nodeName:}" failed. No retries permitted until 2026-03-16 16:54:24.413094954 +0000 UTC m=+4966.567026611 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/bbbbc69c-1fe6-40ae-a88a-a470f3f564ed-operator-scripts") pod "root-account-create-update-pwkr9" (UID: "bbbbc69c-1fe6-40ae-a88a-a470f3f564ed") : configmap "openstack-scripts" not found Mar 16 16:54:23 crc kubenswrapper[5120]: I0316 16:54:23.958528 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-ce7f-account-create-update-t2tvv"] Mar 16 16:54:23 crc kubenswrapper[5120]: I0316 16:54:23.996361 5120 generic.go:358] "Generic (PLEG): container finished" podID="70574728-2a53-4b17-941b-e437321d936c" containerID="bad8f59b506232e4d0ac3673dae365123d4638c90ab2bc268e14c1ebf90f8454" exitCode=2 Mar 16 16:54:23 crc kubenswrapper[5120]: I0316 16:54:23.996492 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"70574728-2a53-4b17-941b-e437321d936c","Type":"ContainerDied","Data":"bad8f59b506232e4d0ac3673dae365123d4638c90ab2bc268e14c1ebf90f8454"} Mar 16 16:54:23 crc kubenswrapper[5120]: I0316 16:54:23.996593 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:54:23 crc kubenswrapper[5120]: I0316 16:54:23.996659 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70574728-2a53-4b17-941b-e437321d936c-kube-api-access-6pbsz" (OuterVolumeSpecName: "kube-api-access-6pbsz") pod "70574728-2a53-4b17-941b-e437321d936c" (UID: "70574728-2a53-4b17-941b-e437321d936c"). InnerVolumeSpecName "kube-api-access-6pbsz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:54:23 crc kubenswrapper[5120]: I0316 16:54:23.996730 5120 scope.go:117] "RemoveContainer" containerID="4c6dbff97f054c414d193139a2f720efcf9ede8282e3a3736b9efe4508764051" Mar 16 16:54:24 crc kubenswrapper[5120]: I0316 16:54:24.018732 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-ce7f-account-create-update-t2tvv"] Mar 16 16:54:24 crc kubenswrapper[5120]: I0316 16:54:24.021175 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6pbsz\" (UniqueName: \"kubernetes.io/projected/70574728-2a53-4b17-941b-e437321d936c-kube-api-access-6pbsz\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:24 crc kubenswrapper[5120]: I0316 16:54:24.029159 5120 status_manager.go:895] "Failed to get status for pod" podUID="52f09603-9dff-4c67-a4b9-7bb162cd4a40" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 16:54:24 crc kubenswrapper[5120]: I0316 16:54:24.032508 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-ce7f-account-create-update-rnwmc"] Mar 16 16:54:24 crc kubenswrapper[5120]: I0316 16:54:24.046017 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70574728-2a53-4b17-941b-e437321d936c" containerName="kube-state-metrics" Mar 16 16:54:24 crc kubenswrapper[5120]: I0316 16:54:24.046062 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="70574728-2a53-4b17-941b-e437321d936c" containerName="kube-state-metrics" Mar 16 16:54:24 crc kubenswrapper[5120]: I0316 16:54:24.046112 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3ff7a5c-9d60-4d20-9308-0b7d88d605f6" containerName="openstack-network-exporter" Mar 16 16:54:24 crc kubenswrapper[5120]: I0316 16:54:24.046120 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3ff7a5c-9d60-4d20-9308-0b7d88d605f6" containerName="openstack-network-exporter" Mar 16 16:54:24 crc kubenswrapper[5120]: I0316 16:54:24.046176 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1960e17-5bd0-46f5-9155-8dd50410168f" containerName="openstack-network-exporter" Mar 16 16:54:24 crc kubenswrapper[5120]: I0316 16:54:24.046183 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1960e17-5bd0-46f5-9155-8dd50410168f" containerName="openstack-network-exporter" Mar 16 16:54:24 crc kubenswrapper[5120]: I0316 16:54:24.046227 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3ff7a5c-9d60-4d20-9308-0b7d88d605f6" containerName="ovsdbserver-nb" Mar 16 16:54:24 crc kubenswrapper[5120]: I0316 16:54:24.046237 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3ff7a5c-9d60-4d20-9308-0b7d88d605f6" containerName="ovsdbserver-nb" Mar 16 16:54:24 crc kubenswrapper[5120]: I0316 16:54:24.046246 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1960e17-5bd0-46f5-9155-8dd50410168f" containerName="ovsdbserver-sb" Mar 16 16:54:24 crc kubenswrapper[5120]: I0316 16:54:24.046252 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1960e17-5bd0-46f5-9155-8dd50410168f" containerName="ovsdbserver-sb" Mar 16 16:54:24 crc kubenswrapper[5120]: I0316 16:54:24.046615 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="b3ff7a5c-9d60-4d20-9308-0b7d88d605f6" containerName="ovsdbserver-nb" Mar 16 16:54:24 crc kubenswrapper[5120]: I0316 16:54:24.046640 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="d1960e17-5bd0-46f5-9155-8dd50410168f" containerName="ovsdbserver-sb" Mar 16 16:54:24 crc kubenswrapper[5120]: I0316 16:54:24.046657 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="70574728-2a53-4b17-941b-e437321d936c" containerName="kube-state-metrics" Mar 16 16:54:24 crc kubenswrapper[5120]: I0316 16:54:24.046673 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="d1960e17-5bd0-46f5-9155-8dd50410168f" containerName="openstack-network-exporter" Mar 16 16:54:24 crc kubenswrapper[5120]: I0316 16:54:24.046684 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="b3ff7a5c-9d60-4d20-9308-0b7d88d605f6" containerName="openstack-network-exporter" Mar 16 16:54:24 crc kubenswrapper[5120]: I0316 16:54:24.054326 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-5a68-account-create-update-9nxpw" event={"ID":"e1ae96f9-27a3-4c3f-a7d4-334875177194","Type":"ContainerStarted","Data":"94342d16df8bb9495f9fa4f848e1feb544d4810b2023fb5aa24b3182f0092d86"} Mar 16 16:54:24 crc kubenswrapper[5120]: I0316 16:54:24.055508 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-ce7f-account-create-update-rnwmc" Mar 16 16:54:24 crc kubenswrapper[5120]: I0316 16:54:24.060178 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-db-secret\"" Mar 16 16:54:24 crc kubenswrapper[5120]: I0316 16:54:24.094582 5120 status_manager.go:895] "Failed to get status for pod" podUID="52f09603-9dff-4c67-a4b9-7bb162cd4a40" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 16:54:24 crc kubenswrapper[5120]: I0316 16:54:24.123925 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-ce7f-account-create-update-rnwmc"] Mar 16 16:54:24 crc kubenswrapper[5120]: I0316 16:54:24.124964 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/70574728-2a53-4b17-941b-e437321d936c-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "70574728-2a53-4b17-941b-e437321d936c" (UID: "70574728-2a53-4b17-941b-e437321d936c"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:54:24 crc kubenswrapper[5120]: I0316 16:54:24.244998 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0fcb10f4-41ed-44a6-9b3b-3048e7f558cd-operator-scripts\") pod \"keystone-ce7f-account-create-update-rnwmc\" (UID: \"0fcb10f4-41ed-44a6-9b3b-3048e7f558cd\") " pod="openstack-kuttl-tests/keystone-ce7f-account-create-update-rnwmc" Mar 16 16:54:24 crc kubenswrapper[5120]: I0316 16:54:24.245290 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srrpm\" (UniqueName: \"kubernetes.io/projected/0fcb10f4-41ed-44a6-9b3b-3048e7f558cd-kube-api-access-srrpm\") pod \"keystone-ce7f-account-create-update-rnwmc\" (UID: \"0fcb10f4-41ed-44a6-9b3b-3048e7f558cd\") " pod="openstack-kuttl-tests/keystone-ce7f-account-create-update-rnwmc" Mar 16 16:54:24 crc kubenswrapper[5120]: I0316 16:54:24.245447 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/70574728-2a53-4b17-941b-e437321d936c-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:24 crc kubenswrapper[5120]: I0316 16:54:24.250562 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/70574728-2a53-4b17-941b-e437321d936c-kube-state-metrics-tls-certs" (OuterVolumeSpecName: "kube-state-metrics-tls-certs") pod "70574728-2a53-4b17-941b-e437321d936c" (UID: "70574728-2a53-4b17-941b-e437321d936c"). InnerVolumeSpecName "kube-state-metrics-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:54:24 crc kubenswrapper[5120]: I0316 16:54:24.251793 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-5pmhr"] Mar 16 16:54:24 crc kubenswrapper[5120]: I0316 16:54:24.254002 5120 scope.go:117] "RemoveContainer" containerID="bad8f59b506232e4d0ac3673dae365123d4638c90ab2bc268e14c1ebf90f8454" Mar 16 16:54:24 crc kubenswrapper[5120]: I0316 16:54:24.255005 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/70574728-2a53-4b17-941b-e437321d936c-kube-state-metrics-tls-config" (OuterVolumeSpecName: "kube-state-metrics-tls-config") pod "70574728-2a53-4b17-941b-e437321d936c" (UID: "70574728-2a53-4b17-941b-e437321d936c"). InnerVolumeSpecName "kube-state-metrics-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:54:24 crc kubenswrapper[5120]: I0316 16:54:24.353327 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0fcb10f4-41ed-44a6-9b3b-3048e7f558cd-operator-scripts\") pod \"keystone-ce7f-account-create-update-rnwmc\" (UID: \"0fcb10f4-41ed-44a6-9b3b-3048e7f558cd\") " pod="openstack-kuttl-tests/keystone-ce7f-account-create-update-rnwmc" Mar 16 16:54:24 crc kubenswrapper[5120]: I0316 16:54:24.353527 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-srrpm\" (UniqueName: \"kubernetes.io/projected/0fcb10f4-41ed-44a6-9b3b-3048e7f558cd-kube-api-access-srrpm\") pod \"keystone-ce7f-account-create-update-rnwmc\" (UID: \"0fcb10f4-41ed-44a6-9b3b-3048e7f558cd\") " pod="openstack-kuttl-tests/keystone-ce7f-account-create-update-rnwmc" Mar 16 16:54:24 crc kubenswrapper[5120]: E0316 16:54:24.353534 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Mar 16 16:54:24 crc kubenswrapper[5120]: E0316 16:54:24.353660 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0fcb10f4-41ed-44a6-9b3b-3048e7f558cd-operator-scripts podName:0fcb10f4-41ed-44a6-9b3b-3048e7f558cd nodeName:}" failed. No retries permitted until 2026-03-16 16:54:24.853633793 +0000 UTC m=+4967.007565450 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/0fcb10f4-41ed-44a6-9b3b-3048e7f558cd-operator-scripts") pod "keystone-ce7f-account-create-update-rnwmc" (UID: "0fcb10f4-41ed-44a6-9b3b-3048e7f558cd") : configmap "openstack-scripts" not found Mar 16 16:54:24 crc kubenswrapper[5120]: I0316 16:54:24.354308 5120 reconciler_common.go:299] "Volume detached for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/70574728-2a53-4b17-941b-e437321d936c-kube-state-metrics-tls-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:24 crc kubenswrapper[5120]: I0316 16:54:24.354339 5120 reconciler_common.go:299] "Volume detached for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/70574728-2a53-4b17-941b-e437321d936c-kube-state-metrics-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:24 crc kubenswrapper[5120]: E0316 16:54:24.364693 5120 projected.go:194] Error preparing data for projected volume kube-api-access-srrpm for pod openstack-kuttl-tests/keystone-ce7f-account-create-update-rnwmc: failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 16:54:24 crc kubenswrapper[5120]: E0316 16:54:24.364813 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0fcb10f4-41ed-44a6-9b3b-3048e7f558cd-kube-api-access-srrpm podName:0fcb10f4-41ed-44a6-9b3b-3048e7f558cd nodeName:}" failed. No retries permitted until 2026-03-16 16:54:24.864788308 +0000 UTC m=+4967.018719965 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-srrpm" (UniqueName: "kubernetes.io/projected/0fcb10f4-41ed-44a6-9b3b-3048e7f558cd-kube-api-access-srrpm") pod "keystone-ce7f-account-create-update-rnwmc" (UID: "0fcb10f4-41ed-44a6-9b3b-3048e7f558cd") : failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 16:54:24 crc kubenswrapper[5120]: I0316 16:54:24.368688 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-g9ds4"] Mar 16 16:54:24 crc kubenswrapper[5120]: I0316 16:54:24.400778 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-5pmhr"] Mar 16 16:54:24 crc kubenswrapper[5120]: I0316 16:54:24.424837 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-g9ds4"] Mar 16 16:54:24 crc kubenswrapper[5120]: E0316 16:54:24.460288 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Mar 16 16:54:24 crc kubenswrapper[5120]: E0316 16:54:24.460386 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bbbbc69c-1fe6-40ae-a88a-a470f3f564ed-operator-scripts podName:bbbbc69c-1fe6-40ae-a88a-a470f3f564ed nodeName:}" failed. No retries permitted until 2026-03-16 16:54:25.460364314 +0000 UTC m=+4967.614295971 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/bbbbc69c-1fe6-40ae-a88a-a470f3f564ed-operator-scripts") pod "root-account-create-update-pwkr9" (UID: "bbbbc69c-1fe6-40ae-a88a-a470f3f564ed") : configmap "openstack-scripts" not found Mar 16 16:54:24 crc kubenswrapper[5120]: I0316 16:54:24.465163 5120 status_manager.go:895] "Failed to get status for pod" podUID="52f09603-9dff-4c67-a4b9-7bb162cd4a40" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 16:54:24 crc kubenswrapper[5120]: I0316 16:54:24.482038 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-f6bd6ffc7-nq4s9"] Mar 16 16:54:24 crc kubenswrapper[5120]: I0316 16:54:24.482301 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/keystone-f6bd6ffc7-nq4s9" podUID="d59d2b2a-a98e-4f02-80f4-b6daa5b64d41" containerName="keystone-api" containerID="cri-o://fb93163f3db63a7bab64ee932655eb3d71444795fa8b3cccc2ec5463d55fb7d9" gracePeriod=30 Mar 16 16:54:24 crc kubenswrapper[5120]: I0316 16:54:24.496209 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 16:54:24 crc kubenswrapper[5120]: I0316 16:54:24.500409 5120 status_manager.go:895] "Failed to get status for pod" podUID="52f09603-9dff-4c67-a4b9-7bb162cd4a40" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 16:54:24 crc kubenswrapper[5120]: I0316 16:54:24.507156 5120 status_manager.go:895] "Failed to get status for pod" podUID="52f09603-9dff-4c67-a4b9-7bb162cd4a40" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 16:54:24 crc kubenswrapper[5120]: I0316 16:54:24.518024 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-db-create-jhvhm"] Mar 16 16:54:24 crc kubenswrapper[5120]: I0316 16:54:24.523920 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-ce7f-account-create-update-rnwmc"] Mar 16 16:54:24 crc kubenswrapper[5120]: I0316 16:54:24.525317 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" podUID="27ae46b8-fa26-48e8-a9bb-36bc910c3caf" containerName="rabbitmq" probeResult="failure" output="dial tcp 10.217.1.235:5671: connect: connection refused" Mar 16 16:54:24 crc kubenswrapper[5120]: I0316 16:54:24.532107 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-db-create-jhvhm"] Mar 16 16:54:24 crc kubenswrapper[5120]: I0316 16:54:24.546400 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-pwkr9"] Mar 16 16:54:24 crc kubenswrapper[5120]: I0316 16:54:24.553696 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-0ea4-account-create-update-tl2bd"] Mar 16 16:54:24 crc kubenswrapper[5120]: I0316 16:54:24.559474 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-0ea4-account-create-update-tl2bd"] Mar 16 16:54:24 crc kubenswrapper[5120]: I0316 16:54:24.577613 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-0869-account-create-update-c899g"] Mar 16 16:54:24 crc kubenswrapper[5120]: I0316 16:54:24.583318 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-0869-account-create-update-c899g"] Mar 16 16:54:24 crc kubenswrapper[5120]: I0316 16:54:24.599901 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-9d545"] Mar 16 16:54:24 crc kubenswrapper[5120]: I0316 16:54:24.683516 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="44595829-86f7-4eb9-b15d-a51f416a2b40" path="/var/lib/kubelet/pods/44595829-86f7-4eb9-b15d-a51f416a2b40/volumes" Mar 16 16:54:24 crc kubenswrapper[5120]: I0316 16:54:24.684424 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="48bd8a90-61bd-414f-99b7-532428fa5ff4" path="/var/lib/kubelet/pods/48bd8a90-61bd-414f-99b7-532428fa5ff4/volumes" Mar 16 16:54:24 crc kubenswrapper[5120]: I0316 16:54:24.693195 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="52f09603-9dff-4c67-a4b9-7bb162cd4a40" path="/var/lib/kubelet/pods/52f09603-9dff-4c67-a4b9-7bb162cd4a40/volumes" Mar 16 16:54:24 crc kubenswrapper[5120]: I0316 16:54:24.694002 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c3d1548-b3b4-4e52-9d2e-3e2939d2604d" path="/var/lib/kubelet/pods/9c3d1548-b3b4-4e52-9d2e-3e2939d2604d/volumes" Mar 16 16:54:24 crc kubenswrapper[5120]: I0316 16:54:24.694741 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b3ff7a5c-9d60-4d20-9308-0b7d88d605f6" path="/var/lib/kubelet/pods/b3ff7a5c-9d60-4d20-9308-0b7d88d605f6/volumes" Mar 16 16:54:24 crc kubenswrapper[5120]: I0316 16:54:24.696184 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d1960e17-5bd0-46f5-9155-8dd50410168f" path="/var/lib/kubelet/pods/d1960e17-5bd0-46f5-9155-8dd50410168f/volumes" Mar 16 16:54:24 crc kubenswrapper[5120]: I0316 16:54:24.698333 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="df3f2e26-88e4-445e-a448-f05b062ff2b3" path="/var/lib/kubelet/pods/df3f2e26-88e4-445e-a448-f05b062ff2b3/volumes" Mar 16 16:54:24 crc kubenswrapper[5120]: I0316 16:54:24.698865 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eab40383-182c-4760-80e0-652dc37d1e68" path="/var/lib/kubelet/pods/eab40383-182c-4760-80e0-652dc37d1e68/volumes" Mar 16 16:54:24 crc kubenswrapper[5120]: I0316 16:54:24.699533 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fb775edc-5783-4ad6-a85e-ec4d71ac7f5c" path="/var/lib/kubelet/pods/fb775edc-5783-4ad6-a85e-ec4d71ac7f5c/volumes" Mar 16 16:54:24 crc kubenswrapper[5120]: E0316 16:54:24.750714 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-srrpm operator-scripts], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openstack-kuttl-tests/keystone-ce7f-account-create-update-rnwmc" podUID="0fcb10f4-41ed-44a6-9b3b-3048e7f558cd" Mar 16 16:54:24 crc kubenswrapper[5120]: I0316 16:54:24.760200 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-2845-account-create-update-2mnh7"] Mar 16 16:54:24 crc kubenswrapper[5120]: I0316 16:54:24.779139 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-2845-account-create-update-2mnh7"] Mar 16 16:54:24 crc kubenswrapper[5120]: I0316 16:54:24.781064 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-5d595646b6-w4dgd" Mar 16 16:54:24 crc kubenswrapper[5120]: I0316 16:54:24.794290 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/openstack-galera-0" podUID="a93918e6-bb45-4717-afef-978bad1c6612" containerName="galera" containerID="cri-o://436905bb29734cdaa5e693050d9fc764430449da20ac2627aebe69b1b8caf0f5" gracePeriod=30 Mar 16 16:54:24 crc kubenswrapper[5120]: I0316 16:54:24.883677 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/689362fd-dae2-4d32-839f-c13ebc515c4c-run-httpd\") pod \"689362fd-dae2-4d32-839f-c13ebc515c4c\" (UID: \"689362fd-dae2-4d32-839f-c13ebc515c4c\") " Mar 16 16:54:24 crc kubenswrapper[5120]: I0316 16:54:24.883901 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/689362fd-dae2-4d32-839f-c13ebc515c4c-combined-ca-bundle\") pod \"689362fd-dae2-4d32-839f-c13ebc515c4c\" (UID: \"689362fd-dae2-4d32-839f-c13ebc515c4c\") " Mar 16 16:54:24 crc kubenswrapper[5120]: I0316 16:54:24.883947 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/689362fd-dae2-4d32-839f-c13ebc515c4c-log-httpd\") pod \"689362fd-dae2-4d32-839f-c13ebc515c4c\" (UID: \"689362fd-dae2-4d32-839f-c13ebc515c4c\") " Mar 16 16:54:24 crc kubenswrapper[5120]: I0316 16:54:24.884122 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/689362fd-dae2-4d32-839f-c13ebc515c4c-public-tls-certs\") pod \"689362fd-dae2-4d32-839f-c13ebc515c4c\" (UID: \"689362fd-dae2-4d32-839f-c13ebc515c4c\") " Mar 16 16:54:24 crc kubenswrapper[5120]: I0316 16:54:24.884235 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/689362fd-dae2-4d32-839f-c13ebc515c4c-internal-tls-certs\") pod \"689362fd-dae2-4d32-839f-c13ebc515c4c\" (UID: \"689362fd-dae2-4d32-839f-c13ebc515c4c\") " Mar 16 16:54:24 crc kubenswrapper[5120]: I0316 16:54:24.884300 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dc2pn\" (UniqueName: \"kubernetes.io/projected/689362fd-dae2-4d32-839f-c13ebc515c4c-kube-api-access-dc2pn\") pod \"689362fd-dae2-4d32-839f-c13ebc515c4c\" (UID: \"689362fd-dae2-4d32-839f-c13ebc515c4c\") " Mar 16 16:54:24 crc kubenswrapper[5120]: I0316 16:54:24.884355 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/689362fd-dae2-4d32-839f-c13ebc515c4c-config-data\") pod \"689362fd-dae2-4d32-839f-c13ebc515c4c\" (UID: \"689362fd-dae2-4d32-839f-c13ebc515c4c\") " Mar 16 16:54:24 crc kubenswrapper[5120]: I0316 16:54:24.884419 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/689362fd-dae2-4d32-839f-c13ebc515c4c-etc-swift\") pod \"689362fd-dae2-4d32-839f-c13ebc515c4c\" (UID: \"689362fd-dae2-4d32-839f-c13ebc515c4c\") " Mar 16 16:54:24 crc kubenswrapper[5120]: I0316 16:54:24.885045 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0fcb10f4-41ed-44a6-9b3b-3048e7f558cd-operator-scripts\") pod \"keystone-ce7f-account-create-update-rnwmc\" (UID: \"0fcb10f4-41ed-44a6-9b3b-3048e7f558cd\") " pod="openstack-kuttl-tests/keystone-ce7f-account-create-update-rnwmc" Mar 16 16:54:24 crc kubenswrapper[5120]: I0316 16:54:24.885091 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-srrpm\" (UniqueName: \"kubernetes.io/projected/0fcb10f4-41ed-44a6-9b3b-3048e7f558cd-kube-api-access-srrpm\") pod \"keystone-ce7f-account-create-update-rnwmc\" (UID: \"0fcb10f4-41ed-44a6-9b3b-3048e7f558cd\") " pod="openstack-kuttl-tests/keystone-ce7f-account-create-update-rnwmc" Mar 16 16:54:24 crc kubenswrapper[5120]: I0316 16:54:24.885539 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/689362fd-dae2-4d32-839f-c13ebc515c4c-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "689362fd-dae2-4d32-839f-c13ebc515c4c" (UID: "689362fd-dae2-4d32-839f-c13ebc515c4c"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:54:24 crc kubenswrapper[5120]: I0316 16:54:24.889169 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/689362fd-dae2-4d32-839f-c13ebc515c4c-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "689362fd-dae2-4d32-839f-c13ebc515c4c" (UID: "689362fd-dae2-4d32-839f-c13ebc515c4c"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:54:24 crc kubenswrapper[5120]: E0316 16:54:24.890239 5120 projected.go:194] Error preparing data for projected volume kube-api-access-srrpm for pod openstack-kuttl-tests/keystone-ce7f-account-create-update-rnwmc: failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 16:54:24 crc kubenswrapper[5120]: E0316 16:54:24.890299 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0fcb10f4-41ed-44a6-9b3b-3048e7f558cd-kube-api-access-srrpm podName:0fcb10f4-41ed-44a6-9b3b-3048e7f558cd nodeName:}" failed. No retries permitted until 2026-03-16 16:54:25.890282001 +0000 UTC m=+4968.044213658 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-srrpm" (UniqueName: "kubernetes.io/projected/0fcb10f4-41ed-44a6-9b3b-3048e7f558cd-kube-api-access-srrpm") pod "keystone-ce7f-account-create-update-rnwmc" (UID: "0fcb10f4-41ed-44a6-9b3b-3048e7f558cd") : failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 16:54:24 crc kubenswrapper[5120]: E0316 16:54:24.890749 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Mar 16 16:54:24 crc kubenswrapper[5120]: E0316 16:54:24.890851 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0fcb10f4-41ed-44a6-9b3b-3048e7f558cd-operator-scripts podName:0fcb10f4-41ed-44a6-9b3b-3048e7f558cd nodeName:}" failed. No retries permitted until 2026-03-16 16:54:25.890832005 +0000 UTC m=+4968.044763662 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/0fcb10f4-41ed-44a6-9b3b-3048e7f558cd-operator-scripts") pod "keystone-ce7f-account-create-update-rnwmc" (UID: "0fcb10f4-41ed-44a6-9b3b-3048e7f558cd") : configmap "openstack-scripts" not found Mar 16 16:54:24 crc kubenswrapper[5120]: I0316 16:54:24.902078 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/689362fd-dae2-4d32-839f-c13ebc515c4c-kube-api-access-dc2pn" (OuterVolumeSpecName: "kube-api-access-dc2pn") pod "689362fd-dae2-4d32-839f-c13ebc515c4c" (UID: "689362fd-dae2-4d32-839f-c13ebc515c4c"). InnerVolumeSpecName "kube-api-access-dc2pn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:54:24 crc kubenswrapper[5120]: I0316 16:54:24.902865 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/689362fd-dae2-4d32-839f-c13ebc515c4c-etc-swift" (OuterVolumeSpecName: "etc-swift") pod "689362fd-dae2-4d32-839f-c13ebc515c4c" (UID: "689362fd-dae2-4d32-839f-c13ebc515c4c"). InnerVolumeSpecName "etc-swift". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:54:24 crc kubenswrapper[5120]: I0316 16:54:24.961508 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/689362fd-dae2-4d32-839f-c13ebc515c4c-config-data" (OuterVolumeSpecName: "config-data") pod "689362fd-dae2-4d32-839f-c13ebc515c4c" (UID: "689362fd-dae2-4d32-839f-c13ebc515c4c"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:54:24 crc kubenswrapper[5120]: I0316 16:54:24.977061 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/689362fd-dae2-4d32-839f-c13ebc515c4c-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "689362fd-dae2-4d32-839f-c13ebc515c4c" (UID: "689362fd-dae2-4d32-839f-c13ebc515c4c"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:54:24 crc kubenswrapper[5120]: I0316 16:54:24.987886 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dc2pn\" (UniqueName: \"kubernetes.io/projected/689362fd-dae2-4d32-839f-c13ebc515c4c-kube-api-access-dc2pn\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:24 crc kubenswrapper[5120]: I0316 16:54:24.988174 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/689362fd-dae2-4d32-839f-c13ebc515c4c-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:24 crc kubenswrapper[5120]: I0316 16:54:24.988259 5120 reconciler_common.go:299] "Volume detached for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/689362fd-dae2-4d32-839f-c13ebc515c4c-etc-swift\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:24 crc kubenswrapper[5120]: I0316 16:54:24.988345 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/689362fd-dae2-4d32-839f-c13ebc515c4c-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:24 crc kubenswrapper[5120]: I0316 16:54:24.988444 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/689362fd-dae2-4d32-839f-c13ebc515c4c-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:24 crc kubenswrapper[5120]: I0316 16:54:24.988531 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/689362fd-dae2-4d32-839f-c13ebc515c4c-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:24 crc kubenswrapper[5120]: I0316 16:54:24.991206 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/689362fd-dae2-4d32-839f-c13ebc515c4c-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "689362fd-dae2-4d32-839f-c13ebc515c4c" (UID: "689362fd-dae2-4d32-839f-c13ebc515c4c"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:54:25 crc kubenswrapper[5120]: I0316 16:54:25.021827 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:54:25 crc kubenswrapper[5120]: I0316 16:54:25.026526 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/689362fd-dae2-4d32-839f-c13ebc515c4c-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "689362fd-dae2-4d32-839f-c13ebc515c4c" (UID: "689362fd-dae2-4d32-839f-c13ebc515c4c"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:54:25 crc kubenswrapper[5120]: I0316 16:54:25.072569 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:54:25 crc kubenswrapper[5120]: I0316 16:54:25.090820 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/1c6098ab-3f23-46bd-95ff-94cf96b88f3f-nova-novncproxy-tls-certs\") pod \"1c6098ab-3f23-46bd-95ff-94cf96b88f3f\" (UID: \"1c6098ab-3f23-46bd-95ff-94cf96b88f3f\") " Mar 16 16:54:25 crc kubenswrapper[5120]: I0316 16:54:25.091225 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1c6098ab-3f23-46bd-95ff-94cf96b88f3f-config-data\") pod \"1c6098ab-3f23-46bd-95ff-94cf96b88f3f\" (UID: \"1c6098ab-3f23-46bd-95ff-94cf96b88f3f\") " Mar 16 16:54:25 crc kubenswrapper[5120]: I0316 16:54:25.091547 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1c6098ab-3f23-46bd-95ff-94cf96b88f3f-combined-ca-bundle\") pod \"1c6098ab-3f23-46bd-95ff-94cf96b88f3f\" (UID: \"1c6098ab-3f23-46bd-95ff-94cf96b88f3f\") " Mar 16 16:54:25 crc kubenswrapper[5120]: I0316 16:54:25.091590 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mz2pl\" (UniqueName: \"kubernetes.io/projected/1c6098ab-3f23-46bd-95ff-94cf96b88f3f-kube-api-access-mz2pl\") pod \"1c6098ab-3f23-46bd-95ff-94cf96b88f3f\" (UID: \"1c6098ab-3f23-46bd-95ff-94cf96b88f3f\") " Mar 16 16:54:25 crc kubenswrapper[5120]: I0316 16:54:25.091656 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/1c6098ab-3f23-46bd-95ff-94cf96b88f3f-vencrypt-tls-certs\") pod \"1c6098ab-3f23-46bd-95ff-94cf96b88f3f\" (UID: \"1c6098ab-3f23-46bd-95ff-94cf96b88f3f\") " Mar 16 16:54:25 crc kubenswrapper[5120]: I0316 16:54:25.092491 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/689362fd-dae2-4d32-839f-c13ebc515c4c-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:25 crc kubenswrapper[5120]: I0316 16:54:25.092516 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/689362fd-dae2-4d32-839f-c13ebc515c4c-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:25 crc kubenswrapper[5120]: I0316 16:54:25.119043 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c6098ab-3f23-46bd-95ff-94cf96b88f3f-kube-api-access-mz2pl" (OuterVolumeSpecName: "kube-api-access-mz2pl") pod "1c6098ab-3f23-46bd-95ff-94cf96b88f3f" (UID: "1c6098ab-3f23-46bd-95ff-94cf96b88f3f"). InnerVolumeSpecName "kube-api-access-mz2pl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:54:25 crc kubenswrapper[5120]: I0316 16:54:25.120743 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"70574728-2a53-4b17-941b-e437321d936c","Type":"ContainerDied","Data":"aabc043f79852d74fd789cdb38394bef1b7d52d056cafc1583e41d9c1aa2610c"} Mar 16 16:54:25 crc kubenswrapper[5120]: I0316 16:54:25.128298 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"04afe1ee-a37b-4e44-91b4-7e15170bb03c","Type":"ContainerDied","Data":"45231e6d827baa098ea755eb285ff5d6db722573b41bac4f797f682636049acc"} Mar 16 16:54:25 crc kubenswrapper[5120]: I0316 16:54:25.128384 5120 scope.go:117] "RemoveContainer" containerID="66c1f61e65b0dd0d9cb8fc1e91a6641115210d2e6e711f0e4a45b8424b0076ef" Mar 16 16:54:25 crc kubenswrapper[5120]: I0316 16:54:25.128615 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:54:25 crc kubenswrapper[5120]: I0316 16:54:25.194191 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/04afe1ee-a37b-4e44-91b4-7e15170bb03c-operator-scripts\") pod \"04afe1ee-a37b-4e44-91b4-7e15170bb03c\" (UID: \"04afe1ee-a37b-4e44-91b4-7e15170bb03c\") " Mar 16 16:54:25 crc kubenswrapper[5120]: I0316 16:54:25.195699 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/04afe1ee-a37b-4e44-91b4-7e15170bb03c-galera-tls-certs\") pod \"04afe1ee-a37b-4e44-91b4-7e15170bb03c\" (UID: \"04afe1ee-a37b-4e44-91b4-7e15170bb03c\") " Mar 16 16:54:25 crc kubenswrapper[5120]: I0316 16:54:25.196077 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"mysql-db\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") pod \"04afe1ee-a37b-4e44-91b4-7e15170bb03c\" (UID: \"04afe1ee-a37b-4e44-91b4-7e15170bb03c\") " Mar 16 16:54:25 crc kubenswrapper[5120]: I0316 16:54:25.196307 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/04afe1ee-a37b-4e44-91b4-7e15170bb03c-config-data-default\") pod \"04afe1ee-a37b-4e44-91b4-7e15170bb03c\" (UID: \"04afe1ee-a37b-4e44-91b4-7e15170bb03c\") " Mar 16 16:54:25 crc kubenswrapper[5120]: I0316 16:54:25.196670 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/04afe1ee-a37b-4e44-91b4-7e15170bb03c-kolla-config\") pod \"04afe1ee-a37b-4e44-91b4-7e15170bb03c\" (UID: \"04afe1ee-a37b-4e44-91b4-7e15170bb03c\") " Mar 16 16:54:25 crc kubenswrapper[5120]: I0316 16:54:25.197040 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6k26d\" (UniqueName: \"kubernetes.io/projected/04afe1ee-a37b-4e44-91b4-7e15170bb03c-kube-api-access-6k26d\") pod \"04afe1ee-a37b-4e44-91b4-7e15170bb03c\" (UID: \"04afe1ee-a37b-4e44-91b4-7e15170bb03c\") " Mar 16 16:54:25 crc kubenswrapper[5120]: I0316 16:54:25.197193 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/04afe1ee-a37b-4e44-91b4-7e15170bb03c-config-data-generated\") pod \"04afe1ee-a37b-4e44-91b4-7e15170bb03c\" (UID: \"04afe1ee-a37b-4e44-91b4-7e15170bb03c\") " Mar 16 16:54:25 crc kubenswrapper[5120]: I0316 16:54:25.198937 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04afe1ee-a37b-4e44-91b4-7e15170bb03c-config-data-generated" (OuterVolumeSpecName: "config-data-generated") pod "04afe1ee-a37b-4e44-91b4-7e15170bb03c" (UID: "04afe1ee-a37b-4e44-91b4-7e15170bb03c"). InnerVolumeSpecName "config-data-generated". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:54:25 crc kubenswrapper[5120]: I0316 16:54:25.199366 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/04afe1ee-a37b-4e44-91b4-7e15170bb03c-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "04afe1ee-a37b-4e44-91b4-7e15170bb03c" (UID: "04afe1ee-a37b-4e44-91b4-7e15170bb03c"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:54:25 crc kubenswrapper[5120]: I0316 16:54:25.200547 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/04afe1ee-a37b-4e44-91b4-7e15170bb03c-config-data-default" (OuterVolumeSpecName: "config-data-default") pod "04afe1ee-a37b-4e44-91b4-7e15170bb03c" (UID: "04afe1ee-a37b-4e44-91b4-7e15170bb03c"). InnerVolumeSpecName "config-data-default". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:54:25 crc kubenswrapper[5120]: I0316 16:54:25.201153 5120 generic.go:358] "Generic (PLEG): container finished" podID="472a9d94-a155-4916-aab9-4672a3c6c18c" containerID="17db717294296e1c93dabaa603512092c1b984d81ce2823579d06813201a2e33" exitCode=0 Mar 16 16:54:25 crc kubenswrapper[5120]: I0316 16:54:25.201183 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-788658cdb6-tsr2b" event={"ID":"472a9d94-a155-4916-aab9-4672a3c6c18c","Type":"ContainerDied","Data":"17db717294296e1c93dabaa603512092c1b984d81ce2823579d06813201a2e33"} Mar 16 16:54:25 crc kubenswrapper[5120]: I0316 16:54:25.203907 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/04afe1ee-a37b-4e44-91b4-7e15170bb03c-combined-ca-bundle\") pod \"04afe1ee-a37b-4e44-91b4-7e15170bb03c\" (UID: \"04afe1ee-a37b-4e44-91b4-7e15170bb03c\") " Mar 16 16:54:25 crc kubenswrapper[5120]: I0316 16:54:25.205029 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/04afe1ee-a37b-4e44-91b4-7e15170bb03c-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "04afe1ee-a37b-4e44-91b4-7e15170bb03c" (UID: "04afe1ee-a37b-4e44-91b4-7e15170bb03c"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:54:25 crc kubenswrapper[5120]: I0316 16:54:25.205305 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/04afe1ee-a37b-4e44-91b4-7e15170bb03c-config-data-default\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:25 crc kubenswrapper[5120]: I0316 16:54:25.206254 5120 reconciler_common.go:299] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/04afe1ee-a37b-4e44-91b4-7e15170bb03c-kolla-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:25 crc kubenswrapper[5120]: I0316 16:54:25.206402 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/04afe1ee-a37b-4e44-91b4-7e15170bb03c-config-data-generated\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:25 crc kubenswrapper[5120]: I0316 16:54:25.207580 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mz2pl\" (UniqueName: \"kubernetes.io/projected/1c6098ab-3f23-46bd-95ff-94cf96b88f3f-kube-api-access-mz2pl\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:25 crc kubenswrapper[5120]: I0316 16:54:25.209087 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c6098ab-3f23-46bd-95ff-94cf96b88f3f-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "1c6098ab-3f23-46bd-95ff-94cf96b88f3f" (UID: "1c6098ab-3f23-46bd-95ff-94cf96b88f3f"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:54:25 crc kubenswrapper[5120]: I0316 16:54:25.209157 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04afe1ee-a37b-4e44-91b4-7e15170bb03c-kube-api-access-6k26d" (OuterVolumeSpecName: "kube-api-access-6k26d") pod "04afe1ee-a37b-4e44-91b4-7e15170bb03c" (UID: "04afe1ee-a37b-4e44-91b4-7e15170bb03c"). InnerVolumeSpecName "kube-api-access-6k26d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:54:25 crc kubenswrapper[5120]: I0316 16:54:25.214186 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-5d595646b6-w4dgd" event={"ID":"689362fd-dae2-4d32-839f-c13ebc515c4c","Type":"ContainerDied","Data":"554e22aba604ea6e6dc3df86d74e7fe1c184cee63e2534a85f9fc2113ed13f71"} Mar 16 16:54:25 crc kubenswrapper[5120]: I0316 16:54:25.214325 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-5d595646b6-w4dgd" Mar 16 16:54:25 crc kubenswrapper[5120]: I0316 16:54:25.264332 5120 generic.go:358] "Generic (PLEG): container finished" podID="f4cbd2d6-e498-42bf-a100-bc0c6664e7ed" containerID="e2e643c12f7cdcfb6338adb79128f619138495e8915b2e35a07baca76d0e267a" exitCode=0 Mar 16 16:54:25 crc kubenswrapper[5120]: I0316 16:54:25.264411 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"f4cbd2d6-e498-42bf-a100-bc0c6664e7ed","Type":"ContainerDied","Data":"e2e643c12f7cdcfb6338adb79128f619138495e8915b2e35a07baca76d0e267a"} Mar 16 16:54:25 crc kubenswrapper[5120]: I0316 16:54:25.269468 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c6098ab-3f23-46bd-95ff-94cf96b88f3f-vencrypt-tls-certs" (OuterVolumeSpecName: "vencrypt-tls-certs") pod "1c6098ab-3f23-46bd-95ff-94cf96b88f3f" (UID: "1c6098ab-3f23-46bd-95ff-94cf96b88f3f"). InnerVolumeSpecName "vencrypt-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:54:25 crc kubenswrapper[5120]: I0316 16:54:25.272229 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c6098ab-3f23-46bd-95ff-94cf96b88f3f-config-data" (OuterVolumeSpecName: "config-data") pod "1c6098ab-3f23-46bd-95ff-94cf96b88f3f" (UID: "1c6098ab-3f23-46bd-95ff-94cf96b88f3f"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:54:25 crc kubenswrapper[5120]: I0316 16:54:25.292426 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage14-crc" (OuterVolumeSpecName: "mysql-db") pod "04afe1ee-a37b-4e44-91b4-7e15170bb03c" (UID: "04afe1ee-a37b-4e44-91b4-7e15170bb03c"). InnerVolumeSpecName "local-storage14-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:54:25 crc kubenswrapper[5120]: I0316 16:54:25.297859 5120 kubelet_pods.go:1019] "Unable to retrieve pull secret, the image pull may not succeed." pod="openstack-kuttl-tests/root-account-create-update-pwkr9" secret="" err="secret \"galera-openstack-dockercfg-8xncx\" not found" Mar 16 16:54:25 crc kubenswrapper[5120]: I0316 16:54:25.298042 5120 scope.go:117] "RemoveContainer" containerID="64cd75a51f48fbcd57a97c4367ae1ef7dd8a482c3d48ad0915c7e730e333715a" Mar 16 16:54:25 crc kubenswrapper[5120]: E0316 16:54:25.298605 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"mariadb-account-create-update\" with CrashLoopBackOff: \"back-off 10s restarting failed container=mariadb-account-create-update pod=root-account-create-update-pwkr9_openstack-kuttl-tests(bbbbc69c-1fe6-40ae-a88a-a470f3f564ed)\"" pod="openstack-kuttl-tests/root-account-create-update-pwkr9" podUID="bbbbc69c-1fe6-40ae-a88a-a470f3f564ed" Mar 16 16:54:25 crc kubenswrapper[5120]: I0316 16:54:25.304973 5120 generic.go:358] "Generic (PLEG): container finished" podID="d8266cfd-9730-429f-8099-e47188d84aba" containerID="42374085eaca804906c313aa98010944f07a179e2d3659eeaa28517e25559e00" exitCode=0 Mar 16 16:54:25 crc kubenswrapper[5120]: I0316 16:54:25.305100 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"d8266cfd-9730-429f-8099-e47188d84aba","Type":"ContainerDied","Data":"42374085eaca804906c313aa98010944f07a179e2d3659eeaa28517e25559e00"} Mar 16 16:54:25 crc kubenswrapper[5120]: I0316 16:54:25.311845 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1c6098ab-3f23-46bd-95ff-94cf96b88f3f-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:25 crc kubenswrapper[5120]: I0316 16:54:25.311883 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6k26d\" (UniqueName: \"kubernetes.io/projected/04afe1ee-a37b-4e44-91b4-7e15170bb03c-kube-api-access-6k26d\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:25 crc kubenswrapper[5120]: I0316 16:54:25.311897 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1c6098ab-3f23-46bd-95ff-94cf96b88f3f-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:25 crc kubenswrapper[5120]: I0316 16:54:25.311910 5120 reconciler_common.go:299] "Volume detached for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/1c6098ab-3f23-46bd-95ff-94cf96b88f3f-vencrypt-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:25 crc kubenswrapper[5120]: I0316 16:54:25.311923 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/04afe1ee-a37b-4e44-91b4-7e15170bb03c-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:25 crc kubenswrapper[5120]: I0316 16:54:25.311950 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") on node \"crc\" " Mar 16 16:54:25 crc kubenswrapper[5120]: I0316 16:54:25.315000 5120 generic.go:358] "Generic (PLEG): container finished" podID="641d2a6c-6871-488a-8ef3-5a2e693af389" containerID="826756ab0e9e22528f886e6b7834cb7cb7e3005ff151d8ffa65fc6935b62a2be" exitCode=0 Mar 16 16:54:25 crc kubenswrapper[5120]: I0316 16:54:25.315112 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"641d2a6c-6871-488a-8ef3-5a2e693af389","Type":"ContainerDied","Data":"826756ab0e9e22528f886e6b7834cb7cb7e3005ff151d8ffa65fc6935b62a2be"} Mar 16 16:54:25 crc kubenswrapper[5120]: I0316 16:54:25.329603 5120 generic.go:358] "Generic (PLEG): container finished" podID="cc4853a6-faf5-45dc-b6f4-aa0b65d0ca8d" containerID="e7b8cd725c509e7d568b9e3c1a5c9d000af853272261e60080aa852dbfe7cd70" exitCode=0 Mar 16 16:54:25 crc kubenswrapper[5120]: I0316 16:54:25.329776 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-584b8687b4-5c6lr" event={"ID":"cc4853a6-faf5-45dc-b6f4-aa0b65d0ca8d","Type":"ContainerDied","Data":"e7b8cd725c509e7d568b9e3c1a5c9d000af853272261e60080aa852dbfe7cd70"} Mar 16 16:54:25 crc kubenswrapper[5120]: I0316 16:54:25.364778 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"1c6098ab-3f23-46bd-95ff-94cf96b88f3f","Type":"ContainerDied","Data":"9fb8b1767dad6291b182f15e84782dbe1547ecb04df88badb7ed5874975edcd5"} Mar 16 16:54:25 crc kubenswrapper[5120]: I0316 16:54:25.364877 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:54:25 crc kubenswrapper[5120]: I0316 16:54:25.370126 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-proxy-5d595646b6-w4dgd"] Mar 16 16:54:25 crc kubenswrapper[5120]: I0316 16:54:25.372918 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/04afe1ee-a37b-4e44-91b4-7e15170bb03c-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "04afe1ee-a37b-4e44-91b4-7e15170bb03c" (UID: "04afe1ee-a37b-4e44-91b4-7e15170bb03c"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:54:25 crc kubenswrapper[5120]: I0316 16:54:25.375470 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c6098ab-3f23-46bd-95ff-94cf96b88f3f-nova-novncproxy-tls-certs" (OuterVolumeSpecName: "nova-novncproxy-tls-certs") pod "1c6098ab-3f23-46bd-95ff-94cf96b88f3f" (UID: "1c6098ab-3f23-46bd-95ff-94cf96b88f3f"). InnerVolumeSpecName "nova-novncproxy-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:54:25 crc kubenswrapper[5120]: I0316 16:54:25.377598 5120 generic.go:358] "Generic (PLEG): container finished" podID="75da64f9-4c43-4411-bd20-86c98536adce" containerID="604ac1b473e83981dc6e83e9cc0546a3e637ff7121dd9f429ddbfd0ea4f6823a" exitCode=0 Mar 16 16:54:25 crc kubenswrapper[5120]: I0316 16:54:25.377794 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"75da64f9-4c43-4411-bd20-86c98536adce","Type":"ContainerDied","Data":"604ac1b473e83981dc6e83e9cc0546a3e637ff7121dd9f429ddbfd0ea4f6823a"} Mar 16 16:54:25 crc kubenswrapper[5120]: I0316 16:54:25.385119 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage14-crc" (UniqueName: "kubernetes.io/local-volume/local-storage14-crc") on node "crc" Mar 16 16:54:25 crc kubenswrapper[5120]: I0316 16:54:25.390231 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/swift-proxy-5d595646b6-w4dgd"] Mar 16 16:54:25 crc kubenswrapper[5120]: I0316 16:54:25.394510 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/04afe1ee-a37b-4e44-91b4-7e15170bb03c-galera-tls-certs" (OuterVolumeSpecName: "galera-tls-certs") pod "04afe1ee-a37b-4e44-91b4-7e15170bb03c" (UID: "04afe1ee-a37b-4e44-91b4-7e15170bb03c"). InnerVolumeSpecName "galera-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:54:25 crc kubenswrapper[5120]: I0316 16:54:25.397510 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-9d545" event={"ID":"0f95e292-0325-47f3-9767-d77bcc9e5884","Type":"ContainerStarted","Data":"29a317e146617038837cf27828daf48f025cc7140c8865314b54a7fe0c0ada40"} Mar 16 16:54:25 crc kubenswrapper[5120]: I0316 16:54:25.403883 5120 generic.go:358] "Generic (PLEG): container finished" podID="ae73ae1d-4056-43c2-addd-f08999a4a7f6" containerID="ff3433af2fccaf4d6c733f603683176d9fec5eff2b5c90677ad2990469736892" exitCode=0 Mar 16 16:54:25 crc kubenswrapper[5120]: I0316 16:54:25.403986 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-6cc74c8747-7pf27" event={"ID":"ae73ae1d-4056-43c2-addd-f08999a4a7f6","Type":"ContainerDied","Data":"ff3433af2fccaf4d6c733f603683176d9fec5eff2b5c90677ad2990469736892"} Mar 16 16:54:25 crc kubenswrapper[5120]: I0316 16:54:25.404128 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-ce7f-account-create-update-rnwmc" Mar 16 16:54:25 crc kubenswrapper[5120]: I0316 16:54:25.419482 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:25 crc kubenswrapper[5120]: I0316 16:54:25.419519 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/04afe1ee-a37b-4e44-91b4-7e15170bb03c-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:25 crc kubenswrapper[5120]: I0316 16:54:25.419533 5120 reconciler_common.go:299] "Volume detached for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/1c6098ab-3f23-46bd-95ff-94cf96b88f3f-nova-novncproxy-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:25 crc kubenswrapper[5120]: I0316 16:54:25.419545 5120 reconciler_common.go:299] "Volume detached for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/04afe1ee-a37b-4e44-91b4-7e15170bb03c-galera-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:25 crc kubenswrapper[5120]: I0316 16:54:25.434944 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-ce7f-account-create-update-rnwmc" Mar 16 16:54:25 crc kubenswrapper[5120]: I0316 16:54:25.480535 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-b06a-account-create-update-7v27d" Mar 16 16:54:25 crc kubenswrapper[5120]: I0316 16:54:25.586448 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 16:54:25 crc kubenswrapper[5120]: I0316 16:54:25.595784 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-5a68-account-create-update-9nxpw" Mar 16 16:54:25 crc kubenswrapper[5120]: E0316 16:54:25.597497 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Mar 16 16:54:25 crc kubenswrapper[5120]: I0316 16:54:25.599252 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 16:54:25 crc kubenswrapper[5120]: E0316 16:54:25.599962 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bbbbc69c-1fe6-40ae-a88a-a470f3f564ed-operator-scripts podName:bbbbc69c-1fe6-40ae-a88a-a470f3f564ed nodeName:}" failed. No retries permitted until 2026-03-16 16:54:27.599930915 +0000 UTC m=+4969.753862582 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/bbbbc69c-1fe6-40ae-a88a-a470f3f564ed-operator-scripts") pod "root-account-create-update-pwkr9" (UID: "bbbbc69c-1fe6-40ae-a88a-a470f3f564ed") : configmap "openstack-scripts" not found Mar 16 16:54:25 crc kubenswrapper[5120]: I0316 16:54:25.647890 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pkr7c\" (UniqueName: \"kubernetes.io/projected/5c8124f6-11f6-49fd-94a8-d931c557b6c4-kube-api-access-pkr7c\") pod \"5c8124f6-11f6-49fd-94a8-d931c557b6c4\" (UID: \"5c8124f6-11f6-49fd-94a8-d931c557b6c4\") " Mar 16 16:54:25 crc kubenswrapper[5120]: I0316 16:54:25.647991 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5c8124f6-11f6-49fd-94a8-d931c557b6c4-operator-scripts\") pod \"5c8124f6-11f6-49fd-94a8-d931c557b6c4\" (UID: \"5c8124f6-11f6-49fd-94a8-d931c557b6c4\") " Mar 16 16:54:25 crc kubenswrapper[5120]: I0316 16:54:25.658914 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c8124f6-11f6-49fd-94a8-d931c557b6c4-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "5c8124f6-11f6-49fd-94a8-d931c557b6c4" (UID: "5c8124f6-11f6-49fd-94a8-d931c557b6c4"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:54:25 crc kubenswrapper[5120]: I0316 16:54:25.661722 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5c8124f6-11f6-49fd-94a8-d931c557b6c4-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:25 crc kubenswrapper[5120]: I0316 16:54:25.678791 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-78dc5f4cb-mjvvc" podUID="152925c6-48ae-4e8d-9a3f-68f01278fe95" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.0.177:9311/healthcheck\": read tcp 10.217.0.2:51452->10.217.0.177:9311: read: connection reset by peer" Mar 16 16:54:25 crc kubenswrapper[5120]: I0316 16:54:25.678943 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-78dc5f4cb-mjvvc" podUID="152925c6-48ae-4e8d-9a3f-68f01278fe95" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.0.177:9311/healthcheck\": read tcp 10.217.0.2:51442->10.217.0.177:9311: read: connection reset by peer" Mar 16 16:54:25 crc kubenswrapper[5120]: I0316 16:54:25.678810 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c8124f6-11f6-49fd-94a8-d931c557b6c4-kube-api-access-pkr7c" (OuterVolumeSpecName: "kube-api-access-pkr7c") pod "5c8124f6-11f6-49fd-94a8-d931c557b6c4" (UID: "5c8124f6-11f6-49fd-94a8-d931c557b6c4"). InnerVolumeSpecName "kube-api-access-pkr7c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:54:25 crc kubenswrapper[5120]: I0316 16:54:25.739464 5120 scope.go:117] "RemoveContainer" containerID="1cafd98684298b497a9a5dace1436cd49b4481686c9c7fc59d805c3f984d152e" Mar 16 16:54:25 crc kubenswrapper[5120]: I0316 16:54:25.767308 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xprnd\" (UniqueName: \"kubernetes.io/projected/e1ae96f9-27a3-4c3f-a7d4-334875177194-kube-api-access-xprnd\") pod \"e1ae96f9-27a3-4c3f-a7d4-334875177194\" (UID: \"e1ae96f9-27a3-4c3f-a7d4-334875177194\") " Mar 16 16:54:25 crc kubenswrapper[5120]: I0316 16:54:25.767982 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e1ae96f9-27a3-4c3f-a7d4-334875177194-operator-scripts\") pod \"e1ae96f9-27a3-4c3f-a7d4-334875177194\" (UID: \"e1ae96f9-27a3-4c3f-a7d4-334875177194\") " Mar 16 16:54:25 crc kubenswrapper[5120]: I0316 16:54:25.769281 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e1ae96f9-27a3-4c3f-a7d4-334875177194-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "e1ae96f9-27a3-4c3f-a7d4-334875177194" (UID: "e1ae96f9-27a3-4c3f-a7d4-334875177194"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:54:25 crc kubenswrapper[5120]: I0316 16:54:25.769506 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e1ae96f9-27a3-4c3f-a7d4-334875177194-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:25 crc kubenswrapper[5120]: I0316 16:54:25.769539 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pkr7c\" (UniqueName: \"kubernetes.io/projected/5c8124f6-11f6-49fd-94a8-d931c557b6c4-kube-api-access-pkr7c\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:25 crc kubenswrapper[5120]: I0316 16:54:25.771265 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1ae96f9-27a3-4c3f-a7d4-334875177194-kube-api-access-xprnd" (OuterVolumeSpecName: "kube-api-access-xprnd") pod "e1ae96f9-27a3-4c3f-a7d4-334875177194" (UID: "e1ae96f9-27a3-4c3f-a7d4-334875177194"). InnerVolumeSpecName "kube-api-access-xprnd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:54:25 crc kubenswrapper[5120]: I0316 16:54:25.876557 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xprnd\" (UniqueName: \"kubernetes.io/projected/e1ae96f9-27a3-4c3f-a7d4-334875177194-kube-api-access-xprnd\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:25 crc kubenswrapper[5120]: I0316 16:54:25.896246 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-774a-account-create-update-tkwhv" Mar 16 16:54:25 crc kubenswrapper[5120]: I0316 16:54:25.928360 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:54:25 crc kubenswrapper[5120]: I0316 16:54:25.933187 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-1de0-account-create-update-rqhj2" Mar 16 16:54:25 crc kubenswrapper[5120]: I0316 16:54:25.941223 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:54:25 crc kubenswrapper[5120]: I0316 16:54:25.950017 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-788658cdb6-tsr2b" Mar 16 16:54:25 crc kubenswrapper[5120]: I0316 16:54:25.958433 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-584b8687b4-5c6lr" Mar 16 16:54:25 crc kubenswrapper[5120]: I0316 16:54:25.964418 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-6cc74c8747-7pf27" Mar 16 16:54:25 crc kubenswrapper[5120]: I0316 16:54:25.967524 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:54:25 crc kubenswrapper[5120]: I0316 16:54:25.972643 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:54:25 crc kubenswrapper[5120]: I0316 16:54:25.978255 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7r8js\" (UniqueName: \"kubernetes.io/projected/215bcff0-714b-427b-ab26-130a21366d15-kube-api-access-7r8js\") pod \"215bcff0-714b-427b-ab26-130a21366d15\" (UID: \"215bcff0-714b-427b-ab26-130a21366d15\") " Mar 16 16:54:25 crc kubenswrapper[5120]: I0316 16:54:25.978443 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/215bcff0-714b-427b-ab26-130a21366d15-operator-scripts\") pod \"215bcff0-714b-427b-ab26-130a21366d15\" (UID: \"215bcff0-714b-427b-ab26-130a21366d15\") " Mar 16 16:54:25 crc kubenswrapper[5120]: I0316 16:54:25.979088 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0fcb10f4-41ed-44a6-9b3b-3048e7f558cd-operator-scripts\") pod \"keystone-ce7f-account-create-update-rnwmc\" (UID: \"0fcb10f4-41ed-44a6-9b3b-3048e7f558cd\") " pod="openstack-kuttl-tests/keystone-ce7f-account-create-update-rnwmc" Mar 16 16:54:25 crc kubenswrapper[5120]: I0316 16:54:25.982076 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-srrpm\" (UniqueName: \"kubernetes.io/projected/0fcb10f4-41ed-44a6-9b3b-3048e7f558cd-kube-api-access-srrpm\") pod \"keystone-ce7f-account-create-update-rnwmc\" (UID: \"0fcb10f4-41ed-44a6-9b3b-3048e7f558cd\") " pod="openstack-kuttl-tests/keystone-ce7f-account-create-update-rnwmc" Mar 16 16:54:25 crc kubenswrapper[5120]: E0316 16:54:25.988264 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Mar 16 16:54:25 crc kubenswrapper[5120]: E0316 16:54:25.988360 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0fcb10f4-41ed-44a6-9b3b-3048e7f558cd-operator-scripts podName:0fcb10f4-41ed-44a6-9b3b-3048e7f558cd nodeName:}" failed. No retries permitted until 2026-03-16 16:54:27.988338485 +0000 UTC m=+4970.142270142 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/0fcb10f4-41ed-44a6-9b3b-3048e7f558cd-operator-scripts") pod "keystone-ce7f-account-create-update-rnwmc" (UID: "0fcb10f4-41ed-44a6-9b3b-3048e7f558cd") : configmap "openstack-scripts" not found Mar 16 16:54:25 crc kubenswrapper[5120]: I0316 16:54:25.989047 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/215bcff0-714b-427b-ab26-130a21366d15-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "215bcff0-714b-427b-ab26-130a21366d15" (UID: "215bcff0-714b-427b-ab26-130a21366d15"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:54:25 crc kubenswrapper[5120]: E0316 16:54:25.991056 5120 projected.go:194] Error preparing data for projected volume kube-api-access-srrpm for pod openstack-kuttl-tests/keystone-ce7f-account-create-update-rnwmc: failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 16:54:25 crc kubenswrapper[5120]: E0316 16:54:25.991143 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0fcb10f4-41ed-44a6-9b3b-3048e7f558cd-kube-api-access-srrpm podName:0fcb10f4-41ed-44a6-9b3b-3048e7f558cd nodeName:}" failed. No retries permitted until 2026-03-16 16:54:27.991123311 +0000 UTC m=+4970.145054968 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-srrpm" (UniqueName: "kubernetes.io/projected/0fcb10f4-41ed-44a6-9b3b-3048e7f558cd-kube-api-access-srrpm") pod "keystone-ce7f-account-create-update-rnwmc" (UID: "0fcb10f4-41ed-44a6-9b3b-3048e7f558cd") : failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 16:54:25 crc kubenswrapper[5120]: I0316 16:54:25.992020 5120 scope.go:117] "RemoveContainer" containerID="513a25e97b4b98222e73c585010f0bf9a581e930c8688dc9f3f9370620baaaf5" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.000410 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/215bcff0-714b-427b-ab26-130a21366d15-kube-api-access-7r8js" (OuterVolumeSpecName: "kube-api-access-7r8js") pod "215bcff0-714b-427b-ab26-130a21366d15" (UID: "215bcff0-714b-427b-ab26-130a21366d15"). InnerVolumeSpecName "kube-api-access-7r8js". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.014745 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.021258 5120 scope.go:117] "RemoveContainer" containerID="9569cfb59832e14e0060f550d868c280dfe3ecac2ddf44052552f76ad15ad693" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.060883 5120 scope.go:117] "RemoveContainer" containerID="6e9e6be4f80554429db8fb19a515898ddff3abe9d6e1a2671afc4c3fc09e832b" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.090730 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/cc4853a6-faf5-45dc-b6f4-aa0b65d0ca8d-internal-tls-certs\") pod \"cc4853a6-faf5-45dc-b6f4-aa0b65d0ca8d\" (UID: \"cc4853a6-faf5-45dc-b6f4-aa0b65d0ca8d\") " Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.090927 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/ae73ae1d-4056-43c2-addd-f08999a4a7f6-config-data-custom\") pod \"ae73ae1d-4056-43c2-addd-f08999a4a7f6\" (UID: \"ae73ae1d-4056-43c2-addd-f08999a4a7f6\") " Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.092260 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n6ttt\" (UniqueName: \"kubernetes.io/projected/cc4853a6-faf5-45dc-b6f4-aa0b65d0ca8d-kube-api-access-n6ttt\") pod \"cc4853a6-faf5-45dc-b6f4-aa0b65d0ca8d\" (UID: \"cc4853a6-faf5-45dc-b6f4-aa0b65d0ca8d\") " Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.092679 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/472a9d94-a155-4916-aab9-4672a3c6c18c-config-data\") pod \"472a9d94-a155-4916-aab9-4672a3c6c18c\" (UID: \"472a9d94-a155-4916-aab9-4672a3c6c18c\") " Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.092744 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f4cbd2d6-e498-42bf-a100-bc0c6664e7ed-public-tls-certs\") pod \"f4cbd2d6-e498-42bf-a100-bc0c6664e7ed\" (UID: \"f4cbd2d6-e498-42bf-a100-bc0c6664e7ed\") " Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.092958 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/641d2a6c-6871-488a-8ef3-5a2e693af389-config-data\") pod \"641d2a6c-6871-488a-8ef3-5a2e693af389\" (UID: \"641d2a6c-6871-488a-8ef3-5a2e693af389\") " Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.093586 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/472a9d94-a155-4916-aab9-4672a3c6c18c-logs\") pod \"472a9d94-a155-4916-aab9-4672a3c6c18c\" (UID: \"472a9d94-a155-4916-aab9-4672a3c6c18c\") " Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.093623 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/472a9d94-a155-4916-aab9-4672a3c6c18c-config-data-custom\") pod \"472a9d94-a155-4916-aab9-4672a3c6c18c\" (UID: \"472a9d94-a155-4916-aab9-4672a3c6c18c\") " Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.093664 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8dhz2\" (UniqueName: \"kubernetes.io/projected/ae73ae1d-4056-43c2-addd-f08999a4a7f6-kube-api-access-8dhz2\") pod \"ae73ae1d-4056-43c2-addd-f08999a4a7f6\" (UID: \"ae73ae1d-4056-43c2-addd-f08999a4a7f6\") " Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.093700 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ae73ae1d-4056-43c2-addd-f08999a4a7f6-logs\") pod \"ae73ae1d-4056-43c2-addd-f08999a4a7f6\" (UID: \"ae73ae1d-4056-43c2-addd-f08999a4a7f6\") " Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.093950 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cc4853a6-faf5-45dc-b6f4-aa0b65d0ca8d-config-data\") pod \"cc4853a6-faf5-45dc-b6f4-aa0b65d0ca8d\" (UID: \"cc4853a6-faf5-45dc-b6f4-aa0b65d0ca8d\") " Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.094039 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/641d2a6c-6871-488a-8ef3-5a2e693af389-scripts\") pod \"641d2a6c-6871-488a-8ef3-5a2e693af389\" (UID: \"641d2a6c-6871-488a-8ef3-5a2e693af389\") " Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.094108 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ffbba34f-0cbb-4345-931f-9c4c763847e1-operator-scripts\") pod \"ffbba34f-0cbb-4345-931f-9c4c763847e1\" (UID: \"ffbba34f-0cbb-4345-931f-9c4c763847e1\") " Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.094097 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/472a9d94-a155-4916-aab9-4672a3c6c18c-logs" (OuterVolumeSpecName: "logs") pod "472a9d94-a155-4916-aab9-4672a3c6c18c" (UID: "472a9d94-a155-4916-aab9-4672a3c6c18c"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.094162 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ae73ae1d-4056-43c2-addd-f08999a4a7f6-combined-ca-bundle\") pod \"ae73ae1d-4056-43c2-addd-f08999a4a7f6\" (UID: \"ae73ae1d-4056-43c2-addd-f08999a4a7f6\") " Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.094278 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/641d2a6c-6871-488a-8ef3-5a2e693af389-httpd-run\") pod \"641d2a6c-6871-488a-8ef3-5a2e693af389\" (UID: \"641d2a6c-6871-488a-8ef3-5a2e693af389\") " Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.094354 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/cc4853a6-faf5-45dc-b6f4-aa0b65d0ca8d-logs\") pod \"cc4853a6-faf5-45dc-b6f4-aa0b65d0ca8d\" (UID: \"cc4853a6-faf5-45dc-b6f4-aa0b65d0ca8d\") " Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.094466 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae73ae1d-4056-43c2-addd-f08999a4a7f6-logs" (OuterVolumeSpecName: "logs") pod "ae73ae1d-4056-43c2-addd-f08999a4a7f6" (UID: "ae73ae1d-4056-43c2-addd-f08999a4a7f6"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.094499 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f4cbd2d6-e498-42bf-a100-bc0c6664e7ed-logs\") pod \"f4cbd2d6-e498-42bf-a100-bc0c6664e7ed\" (UID: \"f4cbd2d6-e498-42bf-a100-bc0c6664e7ed\") " Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.094590 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cc4853a6-faf5-45dc-b6f4-aa0b65d0ca8d-combined-ca-bundle\") pod \"cc4853a6-faf5-45dc-b6f4-aa0b65d0ca8d\" (UID: \"cc4853a6-faf5-45dc-b6f4-aa0b65d0ca8d\") " Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.094618 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f4cbd2d6-e498-42bf-a100-bc0c6664e7ed-combined-ca-bundle\") pod \"f4cbd2d6-e498-42bf-a100-bc0c6664e7ed\" (UID: \"f4cbd2d6-e498-42bf-a100-bc0c6664e7ed\") " Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.094678 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/641d2a6c-6871-488a-8ef3-5a2e693af389-combined-ca-bundle\") pod \"641d2a6c-6871-488a-8ef3-5a2e693af389\" (UID: \"641d2a6c-6871-488a-8ef3-5a2e693af389\") " Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.095334 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f4cbd2d6-e498-42bf-a100-bc0c6664e7ed-config-data\") pod \"f4cbd2d6-e498-42bf-a100-bc0c6664e7ed\" (UID: \"f4cbd2d6-e498-42bf-a100-bc0c6664e7ed\") " Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.095372 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/f4cbd2d6-e498-42bf-a100-bc0c6664e7ed-config-data-custom\") pod \"f4cbd2d6-e498-42bf-a100-bc0c6664e7ed\" (UID: \"f4cbd2d6-e498-42bf-a100-bc0c6664e7ed\") " Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.095407 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nv9gd\" (UniqueName: \"kubernetes.io/projected/641d2a6c-6871-488a-8ef3-5a2e693af389-kube-api-access-nv9gd\") pod \"641d2a6c-6871-488a-8ef3-5a2e693af389\" (UID: \"641d2a6c-6871-488a-8ef3-5a2e693af389\") " Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.095436 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/472a9d94-a155-4916-aab9-4672a3c6c18c-combined-ca-bundle\") pod \"472a9d94-a155-4916-aab9-4672a3c6c18c\" (UID: \"472a9d94-a155-4916-aab9-4672a3c6c18c\") " Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.095464 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/f4cbd2d6-e498-42bf-a100-bc0c6664e7ed-etc-machine-id\") pod \"f4cbd2d6-e498-42bf-a100-bc0c6664e7ed\" (UID: \"f4cbd2d6-e498-42bf-a100-bc0c6664e7ed\") " Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.095541 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qvb26\" (UniqueName: \"kubernetes.io/projected/f4cbd2d6-e498-42bf-a100-bc0c6664e7ed-kube-api-access-qvb26\") pod \"f4cbd2d6-e498-42bf-a100-bc0c6664e7ed\" (UID: \"f4cbd2d6-e498-42bf-a100-bc0c6664e7ed\") " Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.095582 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/641d2a6c-6871-488a-8ef3-5a2e693af389-logs\") pod \"641d2a6c-6871-488a-8ef3-5a2e693af389\" (UID: \"641d2a6c-6871-488a-8ef3-5a2e693af389\") " Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.095652 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/cc4853a6-faf5-45dc-b6f4-aa0b65d0ca8d-scripts\") pod \"cc4853a6-faf5-45dc-b6f4-aa0b65d0ca8d\" (UID: \"cc4853a6-faf5-45dc-b6f4-aa0b65d0ca8d\") " Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.095711 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f4cbd2d6-e498-42bf-a100-bc0c6664e7ed-scripts\") pod \"f4cbd2d6-e498-42bf-a100-bc0c6664e7ed\" (UID: \"f4cbd2d6-e498-42bf-a100-bc0c6664e7ed\") " Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.095779 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f4cbd2d6-e498-42bf-a100-bc0c6664e7ed-internal-tls-certs\") pod \"f4cbd2d6-e498-42bf-a100-bc0c6664e7ed\" (UID: \"f4cbd2d6-e498-42bf-a100-bc0c6664e7ed\") " Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.095808 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ae73ae1d-4056-43c2-addd-f08999a4a7f6-config-data\") pod \"ae73ae1d-4056-43c2-addd-f08999a4a7f6\" (UID: \"ae73ae1d-4056-43c2-addd-f08999a4a7f6\") " Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.095895 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"641d2a6c-6871-488a-8ef3-5a2e693af389\" (UID: \"641d2a6c-6871-488a-8ef3-5a2e693af389\") " Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.095983 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/641d2a6c-6871-488a-8ef3-5a2e693af389-public-tls-certs\") pod \"641d2a6c-6871-488a-8ef3-5a2e693af389\" (UID: \"641d2a6c-6871-488a-8ef3-5a2e693af389\") " Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.096099 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q9dh2\" (UniqueName: \"kubernetes.io/projected/ffbba34f-0cbb-4345-931f-9c4c763847e1-kube-api-access-q9dh2\") pod \"ffbba34f-0cbb-4345-931f-9c4c763847e1\" (UID: \"ffbba34f-0cbb-4345-931f-9c4c763847e1\") " Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.096216 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4cbd2d6-e498-42bf-a100-bc0c6664e7ed-logs" (OuterVolumeSpecName: "logs") pod "f4cbd2d6-e498-42bf-a100-bc0c6664e7ed" (UID: "f4cbd2d6-e498-42bf-a100-bc0c6664e7ed"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.096370 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xlvvw\" (UniqueName: \"kubernetes.io/projected/472a9d94-a155-4916-aab9-4672a3c6c18c-kube-api-access-xlvvw\") pod \"472a9d94-a155-4916-aab9-4672a3c6c18c\" (UID: \"472a9d94-a155-4916-aab9-4672a3c6c18c\") " Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.096446 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/cc4853a6-faf5-45dc-b6f4-aa0b65d0ca8d-public-tls-certs\") pod \"cc4853a6-faf5-45dc-b6f4-aa0b65d0ca8d\" (UID: \"cc4853a6-faf5-45dc-b6f4-aa0b65d0ca8d\") " Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.096869 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae73ae1d-4056-43c2-addd-f08999a4a7f6-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "ae73ae1d-4056-43c2-addd-f08999a4a7f6" (UID: "ae73ae1d-4056-43c2-addd-f08999a4a7f6"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.098781 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/ae73ae1d-4056-43c2-addd-f08999a4a7f6-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.098810 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/472a9d94-a155-4916-aab9-4672a3c6c18c-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.098822 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ae73ae1d-4056-43c2-addd-f08999a4a7f6-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.098834 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f4cbd2d6-e498-42bf-a100-bc0c6664e7ed-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.098847 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7r8js\" (UniqueName: \"kubernetes.io/projected/215bcff0-714b-427b-ab26-130a21366d15-kube-api-access-7r8js\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.098861 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/215bcff0-714b-427b-ab26-130a21366d15-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.106307 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ffbba34f-0cbb-4345-931f-9c4c763847e1-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "ffbba34f-0cbb-4345-931f-9c4c763847e1" (UID: "ffbba34f-0cbb-4345-931f-9c4c763847e1"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.106352 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4cbd2d6-e498-42bf-a100-bc0c6664e7ed-kube-api-access-qvb26" (OuterVolumeSpecName: "kube-api-access-qvb26") pod "f4cbd2d6-e498-42bf-a100-bc0c6664e7ed" (UID: "f4cbd2d6-e498-42bf-a100-bc0c6664e7ed"). InnerVolumeSpecName "kube-api-access-qvb26". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.106509 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae73ae1d-4056-43c2-addd-f08999a4a7f6-kube-api-access-8dhz2" (OuterVolumeSpecName: "kube-api-access-8dhz2") pod "ae73ae1d-4056-43c2-addd-f08999a4a7f6" (UID: "ae73ae1d-4056-43c2-addd-f08999a4a7f6"). InnerVolumeSpecName "kube-api-access-8dhz2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.106558 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/641d2a6c-6871-488a-8ef3-5a2e693af389-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "641d2a6c-6871-488a-8ef3-5a2e693af389" (UID: "641d2a6c-6871-488a-8ef3-5a2e693af389"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.106928 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc4853a6-faf5-45dc-b6f4-aa0b65d0ca8d-logs" (OuterVolumeSpecName: "logs") pod "cc4853a6-faf5-45dc-b6f4-aa0b65d0ca8d" (UID: "cc4853a6-faf5-45dc-b6f4-aa0b65d0ca8d"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.106983 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/f4cbd2d6-e498-42bf-a100-bc0c6664e7ed-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "f4cbd2d6-e498-42bf-a100-bc0c6664e7ed" (UID: "f4cbd2d6-e498-42bf-a100-bc0c6664e7ed"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.107899 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc4853a6-faf5-45dc-b6f4-aa0b65d0ca8d-kube-api-access-n6ttt" (OuterVolumeSpecName: "kube-api-access-n6ttt") pod "cc4853a6-faf5-45dc-b6f4-aa0b65d0ca8d" (UID: "cc4853a6-faf5-45dc-b6f4-aa0b65d0ca8d"). InnerVolumeSpecName "kube-api-access-n6ttt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.119562 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/641d2a6c-6871-488a-8ef3-5a2e693af389-logs" (OuterVolumeSpecName: "logs") pod "641d2a6c-6871-488a-8ef3-5a2e693af389" (UID: "641d2a6c-6871-488a-8ef3-5a2e693af389"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.128158 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/472a9d94-a155-4916-aab9-4672a3c6c18c-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "472a9d94-a155-4916-aab9-4672a3c6c18c" (UID: "472a9d94-a155-4916-aab9-4672a3c6c18c"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.134780 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f4cbd2d6-e498-42bf-a100-bc0c6664e7ed-scripts" (OuterVolumeSpecName: "scripts") pod "f4cbd2d6-e498-42bf-a100-bc0c6664e7ed" (UID: "f4cbd2d6-e498-42bf-a100-bc0c6664e7ed"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.137576 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/641d2a6c-6871-488a-8ef3-5a2e693af389-kube-api-access-nv9gd" (OuterVolumeSpecName: "kube-api-access-nv9gd") pod "641d2a6c-6871-488a-8ef3-5a2e693af389" (UID: "641d2a6c-6871-488a-8ef3-5a2e693af389"). InnerVolumeSpecName "kube-api-access-nv9gd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.137823 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/641d2a6c-6871-488a-8ef3-5a2e693af389-scripts" (OuterVolumeSpecName: "scripts") pod "641d2a6c-6871-488a-8ef3-5a2e693af389" (UID: "641d2a6c-6871-488a-8ef3-5a2e693af389"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.143402 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage02-crc" (OuterVolumeSpecName: "glance") pod "641d2a6c-6871-488a-8ef3-5a2e693af389" (UID: "641d2a6c-6871-488a-8ef3-5a2e693af389"). InnerVolumeSpecName "local-storage02-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.147729 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f4cbd2d6-e498-42bf-a100-bc0c6664e7ed-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "f4cbd2d6-e498-42bf-a100-bc0c6664e7ed" (UID: "f4cbd2d6-e498-42bf-a100-bc0c6664e7ed"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.149890 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc4853a6-faf5-45dc-b6f4-aa0b65d0ca8d-scripts" (OuterVolumeSpecName: "scripts") pod "cc4853a6-faf5-45dc-b6f4-aa0b65d0ca8d" (UID: "cc4853a6-faf5-45dc-b6f4-aa0b65d0ca8d"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.162061 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/472a9d94-a155-4916-aab9-4672a3c6c18c-kube-api-access-xlvvw" (OuterVolumeSpecName: "kube-api-access-xlvvw") pod "472a9d94-a155-4916-aab9-4672a3c6c18c" (UID: "472a9d94-a155-4916-aab9-4672a3c6c18c"). InnerVolumeSpecName "kube-api-access-xlvvw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.200931 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/75da64f9-4c43-4411-bd20-86c98536adce-logs\") pod \"75da64f9-4c43-4411-bd20-86c98536adce\" (UID: \"75da64f9-4c43-4411-bd20-86c98536adce\") " Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.201053 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4w8tg\" (UniqueName: \"kubernetes.io/projected/75da64f9-4c43-4411-bd20-86c98536adce-kube-api-access-4w8tg\") pod \"75da64f9-4c43-4411-bd20-86c98536adce\" (UID: \"75da64f9-4c43-4411-bd20-86c98536adce\") " Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.201254 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/75da64f9-4c43-4411-bd20-86c98536adce-httpd-run\") pod \"75da64f9-4c43-4411-bd20-86c98536adce\" (UID: \"75da64f9-4c43-4411-bd20-86c98536adce\") " Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.201272 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/75da64f9-4c43-4411-bd20-86c98536adce-config-data\") pod \"75da64f9-4c43-4411-bd20-86c98536adce\" (UID: \"75da64f9-4c43-4411-bd20-86c98536adce\") " Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.201433 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/75da64f9-4c43-4411-bd20-86c98536adce-internal-tls-certs\") pod \"75da64f9-4c43-4411-bd20-86c98536adce\" (UID: \"75da64f9-4c43-4411-bd20-86c98536adce\") " Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.201459 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"75da64f9-4c43-4411-bd20-86c98536adce\" (UID: \"75da64f9-4c43-4411-bd20-86c98536adce\") " Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.201496 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/75da64f9-4c43-4411-bd20-86c98536adce-combined-ca-bundle\") pod \"75da64f9-4c43-4411-bd20-86c98536adce\" (UID: \"75da64f9-4c43-4411-bd20-86c98536adce\") " Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.201752 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/75da64f9-4c43-4411-bd20-86c98536adce-scripts\") pod \"75da64f9-4c43-4411-bd20-86c98536adce\" (UID: \"75da64f9-4c43-4411-bd20-86c98536adce\") " Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.202413 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qvb26\" (UniqueName: \"kubernetes.io/projected/f4cbd2d6-e498-42bf-a100-bc0c6664e7ed-kube-api-access-qvb26\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.202426 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/641d2a6c-6871-488a-8ef3-5a2e693af389-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.202438 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/cc4853a6-faf5-45dc-b6f4-aa0b65d0ca8d-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.202448 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f4cbd2d6-e498-42bf-a100-bc0c6664e7ed-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.202469 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") on node \"crc\" " Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.202483 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xlvvw\" (UniqueName: \"kubernetes.io/projected/472a9d94-a155-4916-aab9-4672a3c6c18c-kube-api-access-xlvvw\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.202493 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n6ttt\" (UniqueName: \"kubernetes.io/projected/cc4853a6-faf5-45dc-b6f4-aa0b65d0ca8d-kube-api-access-n6ttt\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.202502 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/472a9d94-a155-4916-aab9-4672a3c6c18c-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.202513 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8dhz2\" (UniqueName: \"kubernetes.io/projected/ae73ae1d-4056-43c2-addd-f08999a4a7f6-kube-api-access-8dhz2\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.202524 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/641d2a6c-6871-488a-8ef3-5a2e693af389-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.202535 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ffbba34f-0cbb-4345-931f-9c4c763847e1-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.202545 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/641d2a6c-6871-488a-8ef3-5a2e693af389-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.202557 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/cc4853a6-faf5-45dc-b6f4-aa0b65d0ca8d-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.202568 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/f4cbd2d6-e498-42bf-a100-bc0c6664e7ed-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.202579 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nv9gd\" (UniqueName: \"kubernetes.io/projected/641d2a6c-6871-488a-8ef3-5a2e693af389-kube-api-access-nv9gd\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.202590 5120 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/f4cbd2d6-e498-42bf-a100-bc0c6664e7ed-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.209461 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75da64f9-4c43-4411-bd20-86c98536adce-logs" (OuterVolumeSpecName: "logs") pod "75da64f9-4c43-4411-bd20-86c98536adce" (UID: "75da64f9-4c43-4411-bd20-86c98536adce"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.216414 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75da64f9-4c43-4411-bd20-86c98536adce-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "75da64f9-4c43-4411-bd20-86c98536adce" (UID: "75da64f9-4c43-4411-bd20-86c98536adce"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.231791 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ffbba34f-0cbb-4345-931f-9c4c763847e1-kube-api-access-q9dh2" (OuterVolumeSpecName: "kube-api-access-q9dh2") pod "ffbba34f-0cbb-4345-931f-9c4c763847e1" (UID: "ffbba34f-0cbb-4345-931f-9c4c763847e1"). InnerVolumeSpecName "kube-api-access-q9dh2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.263095 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75da64f9-4c43-4411-bd20-86c98536adce-kube-api-access-4w8tg" (OuterVolumeSpecName: "kube-api-access-4w8tg") pod "75da64f9-4c43-4411-bd20-86c98536adce" (UID: "75da64f9-4c43-4411-bd20-86c98536adce"). InnerVolumeSpecName "kube-api-access-4w8tg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.263871 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage01-crc" (OuterVolumeSpecName: "glance") pod "75da64f9-4c43-4411-bd20-86c98536adce" (UID: "75da64f9-4c43-4411-bd20-86c98536adce"). InnerVolumeSpecName "local-storage01-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.267989 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75da64f9-4c43-4411-bd20-86c98536adce-scripts" (OuterVolumeSpecName: "scripts") pod "75da64f9-4c43-4411-bd20-86c98536adce" (UID: "75da64f9-4c43-4411-bd20-86c98536adce"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.304639 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4w8tg\" (UniqueName: \"kubernetes.io/projected/75da64f9-4c43-4411-bd20-86c98536adce-kube-api-access-4w8tg\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.304669 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/75da64f9-4c43-4411-bd20-86c98536adce-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.304690 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") on node \"crc\" " Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.304701 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q9dh2\" (UniqueName: \"kubernetes.io/projected/ffbba34f-0cbb-4345-931f-9c4c763847e1-kube-api-access-q9dh2\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.304712 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/75da64f9-4c43-4411-bd20-86c98536adce-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.304720 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/75da64f9-4c43-4411-bd20-86c98536adce-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.361641 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage02-crc" (UniqueName: "kubernetes.io/local-volume/local-storage02-crc") on node "crc" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.389113 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.403187 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/472a9d94-a155-4916-aab9-4672a3c6c18c-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "472a9d94-a155-4916-aab9-4672a3c6c18c" (UID: "472a9d94-a155-4916-aab9-4672a3c6c18c"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.407923 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/472a9d94-a155-4916-aab9-4672a3c6c18c-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.407963 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.411514 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.436994 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae73ae1d-4056-43c2-addd-f08999a4a7f6-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ae73ae1d-4056-43c2-addd-f08999a4a7f6" (UID: "ae73ae1d-4056-43c2-addd-f08999a4a7f6"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.441266 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-5a68-account-create-update-9nxpw" event={"ID":"e1ae96f9-27a3-4c3f-a7d4-334875177194","Type":"ContainerDied","Data":"94342d16df8bb9495f9fa4f848e1feb544d4810b2023fb5aa24b3182f0092d86"} Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.441350 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-5a68-account-create-update-9nxpw" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.461450 5120 generic.go:358] "Generic (PLEG): container finished" podID="a93918e6-bb45-4717-afef-978bad1c6612" containerID="436905bb29734cdaa5e693050d9fc764430449da20ac2627aebe69b1b8caf0f5" exitCode=0 Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.461558 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.461560 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"a93918e6-bb45-4717-afef-978bad1c6612","Type":"ContainerDied","Data":"436905bb29734cdaa5e693050d9fc764430449da20ac2627aebe69b1b8caf0f5"} Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.461659 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"a93918e6-bb45-4717-afef-978bad1c6612","Type":"ContainerDied","Data":"408642aa74056e4f0d4e3fd2c296eecee33ccef0d3fe86859b2394c7792e32b8"} Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.461682 5120 scope.go:117] "RemoveContainer" containerID="436905bb29734cdaa5e693050d9fc764430449da20ac2627aebe69b1b8caf0f5" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.483598 5120 generic.go:358] "Generic (PLEG): container finished" podID="152925c6-48ae-4e8d-9a3f-68f01278fe95" containerID="03a3d3382bd92ee1061cb9a4c52c11007f361661aa271a81420c3f5463675e59" exitCode=0 Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.483808 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-78dc5f4cb-mjvvc" event={"ID":"152925c6-48ae-4e8d-9a3f-68f01278fe95","Type":"ContainerDied","Data":"03a3d3382bd92ee1061cb9a4c52c11007f361661aa271a81420c3f5463675e59"} Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.500149 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75da64f9-4c43-4411-bd20-86c98536adce-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "75da64f9-4c43-4411-bd20-86c98536adce" (UID: "75da64f9-4c43-4411-bd20-86c98536adce"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.507704 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage01-crc" (UniqueName: "kubernetes.io/local-volume/local-storage01-crc") on node "crc" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.508618 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/d8266cfd-9730-429f-8099-e47188d84aba-nova-metadata-tls-certs\") pod \"d8266cfd-9730-429f-8099-e47188d84aba\" (UID: \"d8266cfd-9730-429f-8099-e47188d84aba\") " Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.508685 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d8266cfd-9730-429f-8099-e47188d84aba-combined-ca-bundle\") pod \"d8266cfd-9730-429f-8099-e47188d84aba\" (UID: \"d8266cfd-9730-429f-8099-e47188d84aba\") " Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.508727 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a93918e6-bb45-4717-afef-978bad1c6612-operator-scripts\") pod \"a93918e6-bb45-4717-afef-978bad1c6612\" (UID: \"a93918e6-bb45-4717-afef-978bad1c6612\") " Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.508746 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d8266cfd-9730-429f-8099-e47188d84aba-logs\") pod \"d8266cfd-9730-429f-8099-e47188d84aba\" (UID: \"d8266cfd-9730-429f-8099-e47188d84aba\") " Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.508793 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a93918e6-bb45-4717-afef-978bad1c6612-combined-ca-bundle\") pod \"a93918e6-bb45-4717-afef-978bad1c6612\" (UID: \"a93918e6-bb45-4717-afef-978bad1c6612\") " Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.508873 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d8266cfd-9730-429f-8099-e47188d84aba-config-data\") pod \"d8266cfd-9730-429f-8099-e47188d84aba\" (UID: \"d8266cfd-9730-429f-8099-e47188d84aba\") " Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.508890 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/a93918e6-bb45-4717-afef-978bad1c6612-kolla-config\") pod \"a93918e6-bb45-4717-afef-978bad1c6612\" (UID: \"a93918e6-bb45-4717-afef-978bad1c6612\") " Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.509023 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/a93918e6-bb45-4717-afef-978bad1c6612-config-data-default\") pod \"a93918e6-bb45-4717-afef-978bad1c6612\" (UID: \"a93918e6-bb45-4717-afef-978bad1c6612\") " Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.509117 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/a93918e6-bb45-4717-afef-978bad1c6612-galera-tls-certs\") pod \"a93918e6-bb45-4717-afef-978bad1c6612\" (UID: \"a93918e6-bb45-4717-afef-978bad1c6612\") " Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.509216 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7wbxb\" (UniqueName: \"kubernetes.io/projected/d8266cfd-9730-429f-8099-e47188d84aba-kube-api-access-7wbxb\") pod \"d8266cfd-9730-429f-8099-e47188d84aba\" (UID: \"d8266cfd-9730-429f-8099-e47188d84aba\") " Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.509318 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/a93918e6-bb45-4717-afef-978bad1c6612-config-data-generated\") pod \"a93918e6-bb45-4717-afef-978bad1c6612\" (UID: \"a93918e6-bb45-4717-afef-978bad1c6612\") " Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.509338 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"mysql-db\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"a93918e6-bb45-4717-afef-978bad1c6612\" (UID: \"a93918e6-bb45-4717-afef-978bad1c6612\") " Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.509395 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7zf4d\" (UniqueName: \"kubernetes.io/projected/a93918e6-bb45-4717-afef-978bad1c6612-kube-api-access-7zf4d\") pod \"a93918e6-bb45-4717-afef-978bad1c6612\" (UID: \"a93918e6-bb45-4717-afef-978bad1c6612\") " Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.509956 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.509973 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/75da64f9-4c43-4411-bd20-86c98536adce-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.509984 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ae73ae1d-4056-43c2-addd-f08999a4a7f6-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.512068 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8266cfd-9730-429f-8099-e47188d84aba-logs" (OuterVolumeSpecName: "logs") pod "d8266cfd-9730-429f-8099-e47188d84aba" (UID: "d8266cfd-9730-429f-8099-e47188d84aba"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.512975 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a93918e6-bb45-4717-afef-978bad1c6612-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "a93918e6-bb45-4717-afef-978bad1c6612" (UID: "a93918e6-bb45-4717-afef-978bad1c6612"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.513641 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a93918e6-bb45-4717-afef-978bad1c6612-config-data-generated" (OuterVolumeSpecName: "config-data-generated") pod "a93918e6-bb45-4717-afef-978bad1c6612" (UID: "a93918e6-bb45-4717-afef-978bad1c6612"). InnerVolumeSpecName "config-data-generated". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.514273 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a93918e6-bb45-4717-afef-978bad1c6612-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "a93918e6-bb45-4717-afef-978bad1c6612" (UID: "a93918e6-bb45-4717-afef-978bad1c6612"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.515277 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a93918e6-bb45-4717-afef-978bad1c6612-config-data-default" (OuterVolumeSpecName: "config-data-default") pod "a93918e6-bb45-4717-afef-978bad1c6612" (UID: "a93918e6-bb45-4717-afef-978bad1c6612"). InnerVolumeSpecName "config-data-default". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.521119 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/472a9d94-a155-4916-aab9-4672a3c6c18c-config-data" (OuterVolumeSpecName: "config-data") pod "472a9d94-a155-4916-aab9-4672a3c6c18c" (UID: "472a9d94-a155-4916-aab9-4672a3c6c18c"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.528204 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a93918e6-bb45-4717-afef-978bad1c6612-kube-api-access-7zf4d" (OuterVolumeSpecName: "kube-api-access-7zf4d") pod "a93918e6-bb45-4717-afef-978bad1c6612" (UID: "a93918e6-bb45-4717-afef-978bad1c6612"). InnerVolumeSpecName "kube-api-access-7zf4d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.536532 5120 scope.go:117] "RemoveContainer" containerID="c4ab091d8190ff59f9706a7d7cca32fb7f33c854698ff5d165f5eb3990ee009d" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.536863 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-788658cdb6-tsr2b" event={"ID":"472a9d94-a155-4916-aab9-4672a3c6c18c","Type":"ContainerDied","Data":"eb3a9598f945aac4abc7230fbcc3f3d38d0857fb176b3a19f8a277b9766e0b82"} Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.536960 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-788658cdb6-tsr2b" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.560928 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"f4cbd2d6-e498-42bf-a100-bc0c6664e7ed","Type":"ContainerDied","Data":"3527a250634cc4e39c95b681239568a45e4cc2be6bb8e00699dd0a549ca42e39"} Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.561264 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.565624 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-774a-account-create-update-tkwhv" event={"ID":"215bcff0-714b-427b-ab26-130a21366d15","Type":"ContainerDied","Data":"2666b83fff0ec0c9249b7128e8b06ec8cd2ec7860a78d939b3390bce3c40d9fd"} Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.565698 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-774a-account-create-update-tkwhv" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.574518 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-5a68-account-create-update-9nxpw"] Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.582625 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8266cfd-9730-429f-8099-e47188d84aba-kube-api-access-7wbxb" (OuterVolumeSpecName: "kube-api-access-7wbxb") pod "d8266cfd-9730-429f-8099-e47188d84aba" (UID: "d8266cfd-9730-429f-8099-e47188d84aba"). InnerVolumeSpecName "kube-api-access-7wbxb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.582810 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"d8266cfd-9730-429f-8099-e47188d84aba","Type":"ContainerDied","Data":"51c425cf4357e6ecd42aee8389e8d6e5b075f40f3c562778920df4f48130c8fc"} Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.582888 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.582912 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f4cbd2d6-e498-42bf-a100-bc0c6664e7ed-config-data" (OuterVolumeSpecName: "config-data") pod "f4cbd2d6-e498-42bf-a100-bc0c6664e7ed" (UID: "f4cbd2d6-e498-42bf-a100-bc0c6664e7ed"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.589720 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"641d2a6c-6871-488a-8ef3-5a2e693af389","Type":"ContainerDied","Data":"56371b9fccc70fe0a8c507b046cef1ee741994945985f940015089be072bf75f"} Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.589927 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.597319 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-584b8687b4-5c6lr" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.597353 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-584b8687b4-5c6lr" event={"ID":"cc4853a6-faf5-45dc-b6f4-aa0b65d0ca8d","Type":"ContainerDied","Data":"17575fc058505aee56aec379125503a468dac2ec3f4907c4ea5ab5c272a02ef6"} Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.598094 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-5a68-account-create-update-9nxpw"] Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.604653 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-b06a-account-create-update-7v27d" event={"ID":"5c8124f6-11f6-49fd-94a8-d931c557b6c4","Type":"ContainerDied","Data":"36589f4662fea6e90b8065d3926a3ba02c4251a0723356502b5a00f6b636306e"} Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.604836 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-b06a-account-create-update-7v27d" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.607547 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage16-crc" (OuterVolumeSpecName: "mysql-db") pod "a93918e6-bb45-4717-afef-978bad1c6612" (UID: "a93918e6-bb45-4717-afef-978bad1c6612"). InnerVolumeSpecName "local-storage16-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.609029 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-1de0-account-create-update-rqhj2" event={"ID":"ffbba34f-0cbb-4345-931f-9c4c763847e1","Type":"ContainerDied","Data":"8f338671dea00d6409a7d754f463cdebb6eb76336ca22eb1d02172ad445972aa"} Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.609138 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-1de0-account-create-update-rqhj2" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.614031 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"75da64f9-4c43-4411-bd20-86c98536adce","Type":"ContainerDied","Data":"5469d3a83256213ec0d1a82b24e490e5570f2894631ac98f8792f3238ae2f085"} Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.614136 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.617947 5120 generic.go:358] "Generic (PLEG): container finished" podID="0f95e292-0325-47f3-9767-d77bcc9e5884" containerID="e089c113303c2d6e6711ace9a77290eb103a9e8b3166cbb484b15747ac6bed8a" exitCode=0 Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.618157 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-9d545" event={"ID":"0f95e292-0325-47f3-9767-d77bcc9e5884","Type":"ContainerDied","Data":"e089c113303c2d6e6711ace9a77290eb103a9e8b3166cbb484b15747ac6bed8a"} Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.623660 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-6cc74c8747-7pf27" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.623830 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-6cc74c8747-7pf27" event={"ID":"ae73ae1d-4056-43c2-addd-f08999a4a7f6","Type":"ContainerDied","Data":"a369ef2c2887ebfeeb749d5e1a9248058cb02b52a56c6abedde69851dbecd73c"} Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.624015 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-ce7f-account-create-update-rnwmc" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.632161 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/472a9d94-a155-4916-aab9-4672a3c6c18c-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.633296 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/a93918e6-bb45-4717-afef-978bad1c6612-config-data-generated\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.633966 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") on node \"crc\" " Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.634006 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7zf4d\" (UniqueName: \"kubernetes.io/projected/a93918e6-bb45-4717-afef-978bad1c6612-kube-api-access-7zf4d\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.634025 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a93918e6-bb45-4717-afef-978bad1c6612-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.634037 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d8266cfd-9730-429f-8099-e47188d84aba-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.634052 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f4cbd2d6-e498-42bf-a100-bc0c6664e7ed-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.634064 5120 reconciler_common.go:299] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/a93918e6-bb45-4717-afef-978bad1c6612-kolla-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.634076 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/a93918e6-bb45-4717-afef-978bad1c6612-config-data-default\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.634089 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7wbxb\" (UniqueName: \"kubernetes.io/projected/d8266cfd-9730-429f-8099-e47188d84aba-kube-api-access-7wbxb\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.641644 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f4cbd2d6-e498-42bf-a100-bc0c6664e7ed-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f4cbd2d6-e498-42bf-a100-bc0c6664e7ed" (UID: "f4cbd2d6-e498-42bf-a100-bc0c6664e7ed"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.675842 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="04afe1ee-a37b-4e44-91b4-7e15170bb03c" path="/var/lib/kubelet/pods/04afe1ee-a37b-4e44-91b4-7e15170bb03c/volumes" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.676419 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1c6098ab-3f23-46bd-95ff-94cf96b88f3f" path="/var/lib/kubelet/pods/1c6098ab-3f23-46bd-95ff-94cf96b88f3f/volumes" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.677033 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="689362fd-dae2-4d32-839f-c13ebc515c4c" path="/var/lib/kubelet/pods/689362fd-dae2-4d32-839f-c13ebc515c4c/volumes" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.678127 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bb4b3750-ad5c-4e9e-9824-caba853515cd" path="/var/lib/kubelet/pods/bb4b3750-ad5c-4e9e-9824-caba853515cd/volumes" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.678588 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e1ae96f9-27a3-4c3f-a7d4-334875177194" path="/var/lib/kubelet/pods/e1ae96f9-27a3-4c3f-a7d4-334875177194/volumes" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.694831 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d8266cfd-9730-429f-8099-e47188d84aba-config-data" (OuterVolumeSpecName: "config-data") pod "d8266cfd-9730-429f-8099-e47188d84aba" (UID: "d8266cfd-9730-429f-8099-e47188d84aba"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.696022 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage16-crc" (UniqueName: "kubernetes.io/local-volume/local-storage16-crc") on node "crc" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.726321 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f4cbd2d6-e498-42bf-a100-bc0c6664e7ed-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "f4cbd2d6-e498-42bf-a100-bc0c6664e7ed" (UID: "f4cbd2d6-e498-42bf-a100-bc0c6664e7ed"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.732176 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75da64f9-4c43-4411-bd20-86c98536adce-config-data" (OuterVolumeSpecName: "config-data") pod "75da64f9-4c43-4411-bd20-86c98536adce" (UID: "75da64f9-4c43-4411-bd20-86c98536adce"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.743451 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75da64f9-4c43-4411-bd20-86c98536adce-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "75da64f9-4c43-4411-bd20-86c98536adce" (UID: "75da64f9-4c43-4411-bd20-86c98536adce"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.751974 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.752008 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/75da64f9-4c43-4411-bd20-86c98536adce-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.752018 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f4cbd2d6-e498-42bf-a100-bc0c6664e7ed-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.752027 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/75da64f9-4c43-4411-bd20-86c98536adce-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.752037 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d8266cfd-9730-429f-8099-e47188d84aba-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.752045 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f4cbd2d6-e498-42bf-a100-bc0c6664e7ed-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.779153 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a93918e6-bb45-4717-afef-978bad1c6612-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "a93918e6-bb45-4717-afef-978bad1c6612" (UID: "a93918e6-bb45-4717-afef-978bad1c6612"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.785994 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/641d2a6c-6871-488a-8ef3-5a2e693af389-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "641d2a6c-6871-488a-8ef3-5a2e693af389" (UID: "641d2a6c-6871-488a-8ef3-5a2e693af389"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.790344 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/641d2a6c-6871-488a-8ef3-5a2e693af389-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "641d2a6c-6871-488a-8ef3-5a2e693af389" (UID: "641d2a6c-6871-488a-8ef3-5a2e693af389"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.801779 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc4853a6-faf5-45dc-b6f4-aa0b65d0ca8d-config-data" (OuterVolumeSpecName: "config-data") pod "cc4853a6-faf5-45dc-b6f4-aa0b65d0ca8d" (UID: "cc4853a6-faf5-45dc-b6f4-aa0b65d0ca8d"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.813182 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae73ae1d-4056-43c2-addd-f08999a4a7f6-config-data" (OuterVolumeSpecName: "config-data") pod "ae73ae1d-4056-43c2-addd-f08999a4a7f6" (UID: "ae73ae1d-4056-43c2-addd-f08999a4a7f6"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.813649 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/641d2a6c-6871-488a-8ef3-5a2e693af389-config-data" (OuterVolumeSpecName: "config-data") pod "641d2a6c-6871-488a-8ef3-5a2e693af389" (UID: "641d2a6c-6871-488a-8ef3-5a2e693af389"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.829459 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f4cbd2d6-e498-42bf-a100-bc0c6664e7ed-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "f4cbd2d6-e498-42bf-a100-bc0c6664e7ed" (UID: "f4cbd2d6-e498-42bf-a100-bc0c6664e7ed"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.831672 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc4853a6-faf5-45dc-b6f4-aa0b65d0ca8d-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "cc4853a6-faf5-45dc-b6f4-aa0b65d0ca8d" (UID: "cc4853a6-faf5-45dc-b6f4-aa0b65d0ca8d"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.837088 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d8266cfd-9730-429f-8099-e47188d84aba-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "d8266cfd-9730-429f-8099-e47188d84aba" (UID: "d8266cfd-9730-429f-8099-e47188d84aba"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.844344 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a93918e6-bb45-4717-afef-978bad1c6612-galera-tls-certs" (OuterVolumeSpecName: "galera-tls-certs") pod "a93918e6-bb45-4717-afef-978bad1c6612" (UID: "a93918e6-bb45-4717-afef-978bad1c6612"). InnerVolumeSpecName "galera-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.856157 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cc4853a6-faf5-45dc-b6f4-aa0b65d0ca8d-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.856194 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cc4853a6-faf5-45dc-b6f4-aa0b65d0ca8d-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.856206 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/641d2a6c-6871-488a-8ef3-5a2e693af389-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.856216 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d8266cfd-9730-429f-8099-e47188d84aba-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.856225 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a93918e6-bb45-4717-afef-978bad1c6612-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.856234 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f4cbd2d6-e498-42bf-a100-bc0c6664e7ed-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.856242 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ae73ae1d-4056-43c2-addd-f08999a4a7f6-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.856250 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/641d2a6c-6871-488a-8ef3-5a2e693af389-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.856260 5120 reconciler_common.go:299] "Volume detached for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/a93918e6-bb45-4717-afef-978bad1c6612-galera-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.856268 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/641d2a6c-6871-488a-8ef3-5a2e693af389-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.861319 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d8266cfd-9730-429f-8099-e47188d84aba-nova-metadata-tls-certs" (OuterVolumeSpecName: "nova-metadata-tls-certs") pod "d8266cfd-9730-429f-8099-e47188d84aba" (UID: "d8266cfd-9730-429f-8099-e47188d84aba"). InnerVolumeSpecName "nova-metadata-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.869427 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc4853a6-faf5-45dc-b6f4-aa0b65d0ca8d-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "cc4853a6-faf5-45dc-b6f4-aa0b65d0ca8d" (UID: "cc4853a6-faf5-45dc-b6f4-aa0b65d0ca8d"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.959625 5120 reconciler_common.go:299] "Volume detached for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/d8266cfd-9730-429f-8099-e47188d84aba-nova-metadata-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.960030 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/cc4853a6-faf5-45dc-b6f4-aa0b65d0ca8d-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.960434 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc4853a6-faf5-45dc-b6f4-aa0b65d0ca8d-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "cc4853a6-faf5-45dc-b6f4-aa0b65d0ca8d" (UID: "cc4853a6-faf5-45dc-b6f4-aa0b65d0ca8d"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:54:26 crc kubenswrapper[5120]: I0316 16:54:26.999412 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-78dc5f4cb-mjvvc" Mar 16 16:54:27 crc kubenswrapper[5120]: I0316 16:54:27.059719 5120 scope.go:117] "RemoveContainer" containerID="436905bb29734cdaa5e693050d9fc764430449da20ac2627aebe69b1b8caf0f5" Mar 16 16:54:27 crc kubenswrapper[5120]: E0316 16:54:27.061003 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"436905bb29734cdaa5e693050d9fc764430449da20ac2627aebe69b1b8caf0f5\": container with ID starting with 436905bb29734cdaa5e693050d9fc764430449da20ac2627aebe69b1b8caf0f5 not found: ID does not exist" containerID="436905bb29734cdaa5e693050d9fc764430449da20ac2627aebe69b1b8caf0f5" Mar 16 16:54:27 crc kubenswrapper[5120]: I0316 16:54:27.061052 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"436905bb29734cdaa5e693050d9fc764430449da20ac2627aebe69b1b8caf0f5"} err="failed to get container status \"436905bb29734cdaa5e693050d9fc764430449da20ac2627aebe69b1b8caf0f5\": rpc error: code = NotFound desc = could not find container \"436905bb29734cdaa5e693050d9fc764430449da20ac2627aebe69b1b8caf0f5\": container with ID starting with 436905bb29734cdaa5e693050d9fc764430449da20ac2627aebe69b1b8caf0f5 not found: ID does not exist" Mar 16 16:54:27 crc kubenswrapper[5120]: I0316 16:54:27.061076 5120 scope.go:117] "RemoveContainer" containerID="c4ab091d8190ff59f9706a7d7cca32fb7f33c854698ff5d165f5eb3990ee009d" Mar 16 16:54:27 crc kubenswrapper[5120]: I0316 16:54:27.061597 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/152925c6-48ae-4e8d-9a3f-68f01278fe95-public-tls-certs\") pod \"152925c6-48ae-4e8d-9a3f-68f01278fe95\" (UID: \"152925c6-48ae-4e8d-9a3f-68f01278fe95\") " Mar 16 16:54:27 crc kubenswrapper[5120]: I0316 16:54:27.061876 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/152925c6-48ae-4e8d-9a3f-68f01278fe95-config-data\") pod \"152925c6-48ae-4e8d-9a3f-68f01278fe95\" (UID: \"152925c6-48ae-4e8d-9a3f-68f01278fe95\") " Mar 16 16:54:27 crc kubenswrapper[5120]: I0316 16:54:27.062024 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/152925c6-48ae-4e8d-9a3f-68f01278fe95-internal-tls-certs\") pod \"152925c6-48ae-4e8d-9a3f-68f01278fe95\" (UID: \"152925c6-48ae-4e8d-9a3f-68f01278fe95\") " Mar 16 16:54:27 crc kubenswrapper[5120]: I0316 16:54:27.062073 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/152925c6-48ae-4e8d-9a3f-68f01278fe95-logs\") pod \"152925c6-48ae-4e8d-9a3f-68f01278fe95\" (UID: \"152925c6-48ae-4e8d-9a3f-68f01278fe95\") " Mar 16 16:54:27 crc kubenswrapper[5120]: I0316 16:54:27.062217 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/152925c6-48ae-4e8d-9a3f-68f01278fe95-config-data-custom\") pod \"152925c6-48ae-4e8d-9a3f-68f01278fe95\" (UID: \"152925c6-48ae-4e8d-9a3f-68f01278fe95\") " Mar 16 16:54:27 crc kubenswrapper[5120]: I0316 16:54:27.062317 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/152925c6-48ae-4e8d-9a3f-68f01278fe95-combined-ca-bundle\") pod \"152925c6-48ae-4e8d-9a3f-68f01278fe95\" (UID: \"152925c6-48ae-4e8d-9a3f-68f01278fe95\") " Mar 16 16:54:27 crc kubenswrapper[5120]: I0316 16:54:27.062344 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xntln\" (UniqueName: \"kubernetes.io/projected/152925c6-48ae-4e8d-9a3f-68f01278fe95-kube-api-access-xntln\") pod \"152925c6-48ae-4e8d-9a3f-68f01278fe95\" (UID: \"152925c6-48ae-4e8d-9a3f-68f01278fe95\") " Mar 16 16:54:27 crc kubenswrapper[5120]: E0316 16:54:27.062533 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c4ab091d8190ff59f9706a7d7cca32fb7f33c854698ff5d165f5eb3990ee009d\": container with ID starting with c4ab091d8190ff59f9706a7d7cca32fb7f33c854698ff5d165f5eb3990ee009d not found: ID does not exist" containerID="c4ab091d8190ff59f9706a7d7cca32fb7f33c854698ff5d165f5eb3990ee009d" Mar 16 16:54:27 crc kubenswrapper[5120]: I0316 16:54:27.062562 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4ab091d8190ff59f9706a7d7cca32fb7f33c854698ff5d165f5eb3990ee009d"} err="failed to get container status \"c4ab091d8190ff59f9706a7d7cca32fb7f33c854698ff5d165f5eb3990ee009d\": rpc error: code = NotFound desc = could not find container \"c4ab091d8190ff59f9706a7d7cca32fb7f33c854698ff5d165f5eb3990ee009d\": container with ID starting with c4ab091d8190ff59f9706a7d7cca32fb7f33c854698ff5d165f5eb3990ee009d not found: ID does not exist" Mar 16 16:54:27 crc kubenswrapper[5120]: I0316 16:54:27.062578 5120 scope.go:117] "RemoveContainer" containerID="17db717294296e1c93dabaa603512092c1b984d81ce2823579d06813201a2e33" Mar 16 16:54:27 crc kubenswrapper[5120]: I0316 16:54:27.064429 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/cc4853a6-faf5-45dc-b6f4-aa0b65d0ca8d-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:27 crc kubenswrapper[5120]: I0316 16:54:27.064414 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/152925c6-48ae-4e8d-9a3f-68f01278fe95-logs" (OuterVolumeSpecName: "logs") pod "152925c6-48ae-4e8d-9a3f-68f01278fe95" (UID: "152925c6-48ae-4e8d-9a3f-68f01278fe95"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:54:27 crc kubenswrapper[5120]: I0316 16:54:27.100466 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/152925c6-48ae-4e8d-9a3f-68f01278fe95-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "152925c6-48ae-4e8d-9a3f-68f01278fe95" (UID: "152925c6-48ae-4e8d-9a3f-68f01278fe95"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:54:27 crc kubenswrapper[5120]: I0316 16:54:27.100646 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/152925c6-48ae-4e8d-9a3f-68f01278fe95-kube-api-access-xntln" (OuterVolumeSpecName: "kube-api-access-xntln") pod "152925c6-48ae-4e8d-9a3f-68f01278fe95" (UID: "152925c6-48ae-4e8d-9a3f-68f01278fe95"). InnerVolumeSpecName "kube-api-access-xntln". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:54:27 crc kubenswrapper[5120]: I0316 16:54:27.109904 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-pwkr9" Mar 16 16:54:27 crc kubenswrapper[5120]: I0316 16:54:27.123276 5120 scope.go:117] "RemoveContainer" containerID="840093ee5a2a11cc1fdcd8dc97c9738e8f3927be0adf408e9af80e17042ee646" Mar 16 16:54:27 crc kubenswrapper[5120]: I0316 16:54:27.157665 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/152925c6-48ae-4e8d-9a3f-68f01278fe95-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "152925c6-48ae-4e8d-9a3f-68f01278fe95" (UID: "152925c6-48ae-4e8d-9a3f-68f01278fe95"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:54:27 crc kubenswrapper[5120]: I0316 16:54:27.160702 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/152925c6-48ae-4e8d-9a3f-68f01278fe95-config-data" (OuterVolumeSpecName: "config-data") pod "152925c6-48ae-4e8d-9a3f-68f01278fe95" (UID: "152925c6-48ae-4e8d-9a3f-68f01278fe95"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:54:27 crc kubenswrapper[5120]: I0316 16:54:27.165876 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/bbbbc69c-1fe6-40ae-a88a-a470f3f564ed-operator-scripts\") pod \"bbbbc69c-1fe6-40ae-a88a-a470f3f564ed\" (UID: \"bbbbc69c-1fe6-40ae-a88a-a470f3f564ed\") " Mar 16 16:54:27 crc kubenswrapper[5120]: I0316 16:54:27.165927 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kd29k\" (UniqueName: \"kubernetes.io/projected/bbbbc69c-1fe6-40ae-a88a-a470f3f564ed-kube-api-access-kd29k\") pod \"bbbbc69c-1fe6-40ae-a88a-a470f3f564ed\" (UID: \"bbbbc69c-1fe6-40ae-a88a-a470f3f564ed\") " Mar 16 16:54:27 crc kubenswrapper[5120]: I0316 16:54:27.166583 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bbbbc69c-1fe6-40ae-a88a-a470f3f564ed-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "bbbbc69c-1fe6-40ae-a88a-a470f3f564ed" (UID: "bbbbc69c-1fe6-40ae-a88a-a470f3f564ed"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:54:27 crc kubenswrapper[5120]: I0316 16:54:27.166660 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/152925c6-48ae-4e8d-9a3f-68f01278fe95-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:27 crc kubenswrapper[5120]: I0316 16:54:27.166686 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/152925c6-48ae-4e8d-9a3f-68f01278fe95-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:27 crc kubenswrapper[5120]: I0316 16:54:27.166699 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xntln\" (UniqueName: \"kubernetes.io/projected/152925c6-48ae-4e8d-9a3f-68f01278fe95-kube-api-access-xntln\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:27 crc kubenswrapper[5120]: I0316 16:54:27.166714 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/152925c6-48ae-4e8d-9a3f-68f01278fe95-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:27 crc kubenswrapper[5120]: I0316 16:54:27.166725 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/152925c6-48ae-4e8d-9a3f-68f01278fe95-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:27 crc kubenswrapper[5120]: I0316 16:54:27.169975 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bbbbc69c-1fe6-40ae-a88a-a470f3f564ed-kube-api-access-kd29k" (OuterVolumeSpecName: "kube-api-access-kd29k") pod "bbbbc69c-1fe6-40ae-a88a-a470f3f564ed" (UID: "bbbbc69c-1fe6-40ae-a88a-a470f3f564ed"). InnerVolumeSpecName "kube-api-access-kd29k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:54:27 crc kubenswrapper[5120]: I0316 16:54:27.186902 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/152925c6-48ae-4e8d-9a3f-68f01278fe95-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "152925c6-48ae-4e8d-9a3f-68f01278fe95" (UID: "152925c6-48ae-4e8d-9a3f-68f01278fe95"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:54:27 crc kubenswrapper[5120]: I0316 16:54:27.228301 5120 scope.go:117] "RemoveContainer" containerID="e2e643c12f7cdcfb6338adb79128f619138495e8915b2e35a07baca76d0e267a" Mar 16 16:54:27 crc kubenswrapper[5120]: I0316 16:54:27.238253 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/152925c6-48ae-4e8d-9a3f-68f01278fe95-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "152925c6-48ae-4e8d-9a3f-68f01278fe95" (UID: "152925c6-48ae-4e8d-9a3f-68f01278fe95"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:54:27 crc kubenswrapper[5120]: I0316 16:54:27.268649 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/152925c6-48ae-4e8d-9a3f-68f01278fe95-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:27 crc kubenswrapper[5120]: I0316 16:54:27.268818 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/bbbbc69c-1fe6-40ae-a88a-a470f3f564ed-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:27 crc kubenswrapper[5120]: I0316 16:54:27.268901 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kd29k\" (UniqueName: \"kubernetes.io/projected/bbbbc69c-1fe6-40ae-a88a-a470f3f564ed-kube-api-access-kd29k\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:27 crc kubenswrapper[5120]: I0316 16:54:27.268977 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/152925c6-48ae-4e8d-9a3f-68f01278fe95-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:27 crc kubenswrapper[5120]: I0316 16:54:27.278888 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:54:27 crc kubenswrapper[5120]: I0316 16:54:27.283383 5120 scope.go:117] "RemoveContainer" containerID="40b9639555c32e6578c80a6d348c73edf56ceb2e946f1f8b6986f0d415d57bde" Mar 16 16:54:27 crc kubenswrapper[5120]: I0316 16:54:27.292214 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:54:27 crc kubenswrapper[5120]: I0316 16:54:27.321342 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-b06a-account-create-update-7v27d"] Mar 16 16:54:27 crc kubenswrapper[5120]: I0316 16:54:27.327817 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-b06a-account-create-update-7v27d"] Mar 16 16:54:27 crc kubenswrapper[5120]: I0316 16:54:27.341129 5120 scope.go:117] "RemoveContainer" containerID="42374085eaca804906c313aa98010944f07a179e2d3659eeaa28517e25559e00" Mar 16 16:54:27 crc kubenswrapper[5120]: I0316 16:54:27.354124 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-ce7f-account-create-update-rnwmc"] Mar 16 16:54:27 crc kubenswrapper[5120]: I0316 16:54:27.360561 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-ce7f-account-create-update-rnwmc"] Mar 16 16:54:27 crc kubenswrapper[5120]: I0316 16:54:27.372396 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:54:27 crc kubenswrapper[5120]: I0316 16:54:27.390563 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:54:27 crc kubenswrapper[5120]: I0316 16:54:27.395616 5120 scope.go:117] "RemoveContainer" containerID="973b2d4981e371f1cc5894f46a549c77f1c7936997a498bb3f11cd02c0d5db5f" Mar 16 16:54:27 crc kubenswrapper[5120]: I0316 16:54:27.405799 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:54:27 crc kubenswrapper[5120]: I0316 16:54:27.411499 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:54:27 crc kubenswrapper[5120]: I0316 16:54:27.428696 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-774a-account-create-update-tkwhv"] Mar 16 16:54:27 crc kubenswrapper[5120]: I0316 16:54:27.439170 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-774a-account-create-update-tkwhv"] Mar 16 16:54:27 crc kubenswrapper[5120]: I0316 16:54:27.451711 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-788658cdb6-tsr2b"] Mar 16 16:54:27 crc kubenswrapper[5120]: I0316 16:54:27.464946 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-788658cdb6-tsr2b"] Mar 16 16:54:27 crc kubenswrapper[5120]: I0316 16:54:27.468534 5120 scope.go:117] "RemoveContainer" containerID="826756ab0e9e22528f886e6b7834cb7cb7e3005ff151d8ffa65fc6935b62a2be" Mar 16 16:54:27 crc kubenswrapper[5120]: I0316 16:54:27.472591 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:54:27 crc kubenswrapper[5120]: I0316 16:54:27.473319 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0fcb10f4-41ed-44a6-9b3b-3048e7f558cd-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:27 crc kubenswrapper[5120]: I0316 16:54:27.473347 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-srrpm\" (UniqueName: \"kubernetes.io/projected/0fcb10f4-41ed-44a6-9b3b-3048e7f558cd-kube-api-access-srrpm\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:27 crc kubenswrapper[5120]: I0316 16:54:27.479357 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:54:27 crc kubenswrapper[5120]: I0316 16:54:27.486504 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 16:54:27 crc kubenswrapper[5120]: I0316 16:54:27.492325 5120 scope.go:117] "RemoveContainer" containerID="7176b5d9da33321180642ad022eb112218206fafae7d5f604b0312ae55cda4ee" Mar 16 16:54:27 crc kubenswrapper[5120]: I0316 16:54:27.492471 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 16:54:27 crc kubenswrapper[5120]: I0316 16:54:27.499305 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-584b8687b4-5c6lr"] Mar 16 16:54:27 crc kubenswrapper[5120]: I0316 16:54:27.506032 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-584b8687b4-5c6lr"] Mar 16 16:54:27 crc kubenswrapper[5120]: I0316 16:54:27.513624 5120 scope.go:117] "RemoveContainer" containerID="e7b8cd725c509e7d568b9e3c1a5c9d000af853272261e60080aa852dbfe7cd70" Mar 16 16:54:27 crc kubenswrapper[5120]: I0316 16:54:27.514387 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-6cc74c8747-7pf27"] Mar 16 16:54:27 crc kubenswrapper[5120]: I0316 16:54:27.523637 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-worker-6cc74c8747-7pf27"] Mar 16 16:54:27 crc kubenswrapper[5120]: I0316 16:54:27.581520 5120 scope.go:117] "RemoveContainer" containerID="0b2171cdca82691279cb21cfe02497161f4d3514e0d6f41e60432a13800d9a59" Mar 16 16:54:27 crc kubenswrapper[5120]: I0316 16:54:27.603882 5120 scope.go:117] "RemoveContainer" containerID="604ac1b473e83981dc6e83e9cc0546a3e637ff7121dd9f429ddbfd0ea4f6823a" Mar 16 16:54:27 crc kubenswrapper[5120]: I0316 16:54:27.629593 5120 scope.go:117] "RemoveContainer" containerID="968f2c31370baabe38dba56e7264e516bb8706c445891678a7b239714c6d5115" Mar 16 16:54:27 crc kubenswrapper[5120]: I0316 16:54:27.642004 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-pwkr9" Mar 16 16:54:27 crc kubenswrapper[5120]: I0316 16:54:27.642092 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-pwkr9" event={"ID":"bbbbc69c-1fe6-40ae-a88a-a470f3f564ed","Type":"ContainerDied","Data":"f584a339d8753576caeeb37e16b92edf4af09a9550e628a3dae90c8d6f8c2ef3"} Mar 16 16:54:27 crc kubenswrapper[5120]: I0316 16:54:27.651305 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-9d545" event={"ID":"0f95e292-0325-47f3-9767-d77bcc9e5884","Type":"ContainerStarted","Data":"2aa1d440c20b1b3d572806485b0a43f3ac8ae34407b490f95faccd65488bfd65"} Mar 16 16:54:27 crc kubenswrapper[5120]: I0316 16:54:27.651581 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-9d545" Mar 16 16:54:27 crc kubenswrapper[5120]: I0316 16:54:27.658785 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-78dc5f4cb-mjvvc" event={"ID":"152925c6-48ae-4e8d-9a3f-68f01278fe95","Type":"ContainerDied","Data":"1b9f6c76fb4d2ac23917b7ad430fe49a16da79062075306d04eb4d5c963ab848"} Mar 16 16:54:27 crc kubenswrapper[5120]: I0316 16:54:27.658918 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-78dc5f4cb-mjvvc" Mar 16 16:54:27 crc kubenswrapper[5120]: I0316 16:54:27.675555 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-9d545" podStartSLOduration=8.675532905 podStartE2EDuration="8.675532905s" podCreationTimestamp="2026-03-16 16:54:19 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:54:27.666072825 +0000 UTC m=+4969.820004482" watchObservedRunningTime="2026-03-16 16:54:27.675532905 +0000 UTC m=+4969.829464562" Mar 16 16:54:27 crc kubenswrapper[5120]: I0316 16:54:27.688319 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/keystone-f6bd6ffc7-nq4s9" podUID="d59d2b2a-a98e-4f02-80f4-b6daa5b64d41" containerName="keystone-api" probeResult="failure" output="Get \"https://10.217.0.178:5000/v3\": read tcp 10.217.0.2:55342->10.217.0.178:5000: read: connection reset by peer" Mar 16 16:54:27 crc kubenswrapper[5120]: I0316 16:54:27.711229 5120 scope.go:117] "RemoveContainer" containerID="ff3433af2fccaf4d6c733f603683176d9fec5eff2b5c90677ad2990469736892" Mar 16 16:54:27 crc kubenswrapper[5120]: I0316 16:54:27.721059 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-pwkr9"] Mar 16 16:54:27 crc kubenswrapper[5120]: I0316 16:54:27.732183 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-pwkr9"] Mar 16 16:54:27 crc kubenswrapper[5120]: I0316 16:54:27.742677 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-78dc5f4cb-mjvvc"] Mar 16 16:54:27 crc kubenswrapper[5120]: I0316 16:54:27.764890 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-api-78dc5f4cb-mjvvc"] Mar 16 16:54:27 crc kubenswrapper[5120]: I0316 16:54:27.814011 5120 scope.go:117] "RemoveContainer" containerID="212ef64e26a8c2cc068193dc28ff446a67b88b3626597c06ecc57e0b01067724" Mar 16 16:54:27 crc kubenswrapper[5120]: I0316 16:54:27.844500 5120 scope.go:117] "RemoveContainer" containerID="64cd75a51f48fbcd57a97c4367ae1ef7dd8a482c3d48ad0915c7e730e333715a" Mar 16 16:54:27 crc kubenswrapper[5120]: E0316 16:54:27.883151 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Mar 16 16:54:27 crc kubenswrapper[5120]: E0316 16:54:27.883243 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/27ae46b8-fa26-48e8-a9bb-36bc910c3caf-config-data podName:27ae46b8-fa26-48e8-a9bb-36bc910c3caf nodeName:}" failed. No retries permitted until 2026-03-16 16:54:35.88322568 +0000 UTC m=+4978.037157337 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/27ae46b8-fa26-48e8-a9bb-36bc910c3caf-config-data") pod "rabbitmq-cell1-server-0" (UID: "27ae46b8-fa26-48e8-a9bb-36bc910c3caf") : configmap "rabbitmq-cell1-config-data" not found Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.030484 5120 scope.go:117] "RemoveContainer" containerID="03a3d3382bd92ee1061cb9a4c52c11007f361661aa271a81420c3f5463675e59" Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.068468 5120 scope.go:117] "RemoveContainer" containerID="f3ed28bfae2057c9814ffe1a00568ad048a0121320ce65449ff7b08c5990b871" Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.172510 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-f6bd6ffc7-nq4s9" Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.196232 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-northd-0_d2f6e14c-b704-4805-b5fa-33de25bc4f0f/ovn-northd/0.log" Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.196327 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.324630 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/d59d2b2a-a98e-4f02-80f4-b6daa5b64d41-internal-tls-certs\") pod \"d59d2b2a-a98e-4f02-80f4-b6daa5b64d41\" (UID: \"d59d2b2a-a98e-4f02-80f4-b6daa5b64d41\") " Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.324728 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d59d2b2a-a98e-4f02-80f4-b6daa5b64d41-config-data\") pod \"d59d2b2a-a98e-4f02-80f4-b6daa5b64d41\" (UID: \"d59d2b2a-a98e-4f02-80f4-b6daa5b64d41\") " Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.324747 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d2f6e14c-b704-4805-b5fa-33de25bc4f0f-combined-ca-bundle\") pod \"d2f6e14c-b704-4805-b5fa-33de25bc4f0f\" (UID: \"d2f6e14c-b704-4805-b5fa-33de25bc4f0f\") " Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.324794 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d59d2b2a-a98e-4f02-80f4-b6daa5b64d41-combined-ca-bundle\") pod \"d59d2b2a-a98e-4f02-80f4-b6daa5b64d41\" (UID: \"d59d2b2a-a98e-4f02-80f4-b6daa5b64d41\") " Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.324836 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lsvg4\" (UniqueName: \"kubernetes.io/projected/d59d2b2a-a98e-4f02-80f4-b6daa5b64d41-kube-api-access-lsvg4\") pod \"d59d2b2a-a98e-4f02-80f4-b6daa5b64d41\" (UID: \"d59d2b2a-a98e-4f02-80f4-b6daa5b64d41\") " Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.324858 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d2f6e14c-b704-4805-b5fa-33de25bc4f0f-config\") pod \"d2f6e14c-b704-4805-b5fa-33de25bc4f0f\" (UID: \"d2f6e14c-b704-4805-b5fa-33de25bc4f0f\") " Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.324995 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d59d2b2a-a98e-4f02-80f4-b6daa5b64d41-scripts\") pod \"d59d2b2a-a98e-4f02-80f4-b6daa5b64d41\" (UID: \"d59d2b2a-a98e-4f02-80f4-b6daa5b64d41\") " Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.325080 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-px7h2\" (UniqueName: \"kubernetes.io/projected/d2f6e14c-b704-4805-b5fa-33de25bc4f0f-kube-api-access-px7h2\") pod \"d2f6e14c-b704-4805-b5fa-33de25bc4f0f\" (UID: \"d2f6e14c-b704-4805-b5fa-33de25bc4f0f\") " Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.325096 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/d2f6e14c-b704-4805-b5fa-33de25bc4f0f-metrics-certs-tls-certs\") pod \"d2f6e14c-b704-4805-b5fa-33de25bc4f0f\" (UID: \"d2f6e14c-b704-4805-b5fa-33de25bc4f0f\") " Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.325132 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/d2f6e14c-b704-4805-b5fa-33de25bc4f0f-ovn-rundir\") pod \"d2f6e14c-b704-4805-b5fa-33de25bc4f0f\" (UID: \"d2f6e14c-b704-4805-b5fa-33de25bc4f0f\") " Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.325182 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/d59d2b2a-a98e-4f02-80f4-b6daa5b64d41-fernet-keys\") pod \"d59d2b2a-a98e-4f02-80f4-b6daa5b64d41\" (UID: \"d59d2b2a-a98e-4f02-80f4-b6daa5b64d41\") " Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.325287 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/d2f6e14c-b704-4805-b5fa-33de25bc4f0f-scripts\") pod \"d2f6e14c-b704-4805-b5fa-33de25bc4f0f\" (UID: \"d2f6e14c-b704-4805-b5fa-33de25bc4f0f\") " Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.325311 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/d59d2b2a-a98e-4f02-80f4-b6daa5b64d41-credential-keys\") pod \"d59d2b2a-a98e-4f02-80f4-b6daa5b64d41\" (UID: \"d59d2b2a-a98e-4f02-80f4-b6daa5b64d41\") " Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.325395 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/d59d2b2a-a98e-4f02-80f4-b6daa5b64d41-public-tls-certs\") pod \"d59d2b2a-a98e-4f02-80f4-b6daa5b64d41\" (UID: \"d59d2b2a-a98e-4f02-80f4-b6daa5b64d41\") " Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.325441 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/d2f6e14c-b704-4805-b5fa-33de25bc4f0f-ovn-northd-tls-certs\") pod \"d2f6e14c-b704-4805-b5fa-33de25bc4f0f\" (UID: \"d2f6e14c-b704-4805-b5fa-33de25bc4f0f\") " Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.332335 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2f6e14c-b704-4805-b5fa-33de25bc4f0f-ovn-rundir" (OuterVolumeSpecName: "ovn-rundir") pod "d2f6e14c-b704-4805-b5fa-33de25bc4f0f" (UID: "d2f6e14c-b704-4805-b5fa-33de25bc4f0f"). InnerVolumeSpecName "ovn-rundir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.332379 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2f6e14c-b704-4805-b5fa-33de25bc4f0f-scripts" (OuterVolumeSpecName: "scripts") pod "d2f6e14c-b704-4805-b5fa-33de25bc4f0f" (UID: "d2f6e14c-b704-4805-b5fa-33de25bc4f0f"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.332745 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2f6e14c-b704-4805-b5fa-33de25bc4f0f-config" (OuterVolumeSpecName: "config") pod "d2f6e14c-b704-4805-b5fa-33de25bc4f0f" (UID: "d2f6e14c-b704-4805-b5fa-33de25bc4f0f"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.336900 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d59d2b2a-a98e-4f02-80f4-b6daa5b64d41-scripts" (OuterVolumeSpecName: "scripts") pod "d59d2b2a-a98e-4f02-80f4-b6daa5b64d41" (UID: "d59d2b2a-a98e-4f02-80f4-b6daa5b64d41"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.337975 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.341907 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d59d2b2a-a98e-4f02-80f4-b6daa5b64d41-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "d59d2b2a-a98e-4f02-80f4-b6daa5b64d41" (UID: "d59d2b2a-a98e-4f02-80f4-b6daa5b64d41"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.351288 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d59d2b2a-a98e-4f02-80f4-b6daa5b64d41-kube-api-access-lsvg4" (OuterVolumeSpecName: "kube-api-access-lsvg4") pod "d59d2b2a-a98e-4f02-80f4-b6daa5b64d41" (UID: "d59d2b2a-a98e-4f02-80f4-b6daa5b64d41"). InnerVolumeSpecName "kube-api-access-lsvg4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.351734 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d59d2b2a-a98e-4f02-80f4-b6daa5b64d41-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "d59d2b2a-a98e-4f02-80f4-b6daa5b64d41" (UID: "d59d2b2a-a98e-4f02-80f4-b6daa5b64d41"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.356311 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2f6e14c-b704-4805-b5fa-33de25bc4f0f-kube-api-access-px7h2" (OuterVolumeSpecName: "kube-api-access-px7h2") pod "d2f6e14c-b704-4805-b5fa-33de25bc4f0f" (UID: "d2f6e14c-b704-4805-b5fa-33de25bc4f0f"). InnerVolumeSpecName "kube-api-access-px7h2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.366747 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d59d2b2a-a98e-4f02-80f4-b6daa5b64d41-config-data" (OuterVolumeSpecName: "config-data") pod "d59d2b2a-a98e-4f02-80f4-b6daa5b64d41" (UID: "d59d2b2a-a98e-4f02-80f4-b6daa5b64d41"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.366841 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d2f6e14c-b704-4805-b5fa-33de25bc4f0f-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "d2f6e14c-b704-4805-b5fa-33de25bc4f0f" (UID: "d2f6e14c-b704-4805-b5fa-33de25bc4f0f"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.389335 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d59d2b2a-a98e-4f02-80f4-b6daa5b64d41-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "d59d2b2a-a98e-4f02-80f4-b6daa5b64d41" (UID: "d59d2b2a-a98e-4f02-80f4-b6daa5b64d41"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.402939 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d59d2b2a-a98e-4f02-80f4-b6daa5b64d41-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "d59d2b2a-a98e-4f02-80f4-b6daa5b64d41" (UID: "d59d2b2a-a98e-4f02-80f4-b6daa5b64d41"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.412211 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/neutron-9f898f5b6-g9g57" podUID="cdf5b2c0-4a53-4c60-a566-d18398c0c560" containerName="neutron-httpd" probeResult="failure" output="Get \"https://10.217.1.244:9696/\": dial tcp 10.217.1.244:9696: connect: connection refused" Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.412272 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d59d2b2a-a98e-4f02-80f4-b6daa5b64d41-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "d59d2b2a-a98e-4f02-80f4-b6daa5b64d41" (UID: "d59d2b2a-a98e-4f02-80f4-b6daa5b64d41"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.427476 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/c6ba454f-2263-4fc3-bd13-35f921464d24-rabbitmq-plugins\") pod \"c6ba454f-2263-4fc3-bd13-35f921464d24\" (UID: \"c6ba454f-2263-4fc3-bd13-35f921464d24\") " Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.427595 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kpt4z\" (UniqueName: \"kubernetes.io/projected/c6ba454f-2263-4fc3-bd13-35f921464d24-kube-api-access-kpt4z\") pod \"c6ba454f-2263-4fc3-bd13-35f921464d24\" (UID: \"c6ba454f-2263-4fc3-bd13-35f921464d24\") " Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.427650 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/c6ba454f-2263-4fc3-bd13-35f921464d24-rabbitmq-erlang-cookie\") pod \"c6ba454f-2263-4fc3-bd13-35f921464d24\" (UID: \"c6ba454f-2263-4fc3-bd13-35f921464d24\") " Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.427686 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/c6ba454f-2263-4fc3-bd13-35f921464d24-pod-info\") pod \"c6ba454f-2263-4fc3-bd13-35f921464d24\" (UID: \"c6ba454f-2263-4fc3-bd13-35f921464d24\") " Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.427723 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/c6ba454f-2263-4fc3-bd13-35f921464d24-config-data\") pod \"c6ba454f-2263-4fc3-bd13-35f921464d24\" (UID: \"c6ba454f-2263-4fc3-bd13-35f921464d24\") " Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.427796 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/c6ba454f-2263-4fc3-bd13-35f921464d24-rabbitmq-tls\") pod \"c6ba454f-2263-4fc3-bd13-35f921464d24\" (UID: \"c6ba454f-2263-4fc3-bd13-35f921464d24\") " Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.427818 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/c6ba454f-2263-4fc3-bd13-35f921464d24-erlang-cookie-secret\") pod \"c6ba454f-2263-4fc3-bd13-35f921464d24\" (UID: \"c6ba454f-2263-4fc3-bd13-35f921464d24\") " Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.427839 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/c6ba454f-2263-4fc3-bd13-35f921464d24-server-conf\") pod \"c6ba454f-2263-4fc3-bd13-35f921464d24\" (UID: \"c6ba454f-2263-4fc3-bd13-35f921464d24\") " Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.427873 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/c6ba454f-2263-4fc3-bd13-35f921464d24-rabbitmq-confd\") pod \"c6ba454f-2263-4fc3-bd13-35f921464d24\" (UID: \"c6ba454f-2263-4fc3-bd13-35f921464d24\") " Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.428063 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6ba454f-2263-4fc3-bd13-35f921464d24-rabbitmq-plugins" (OuterVolumeSpecName: "rabbitmq-plugins") pod "c6ba454f-2263-4fc3-bd13-35f921464d24" (UID: "c6ba454f-2263-4fc3-bd13-35f921464d24"). InnerVolumeSpecName "rabbitmq-plugins". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.428111 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/c6ba454f-2263-4fc3-bd13-35f921464d24-plugins-conf\") pod \"c6ba454f-2263-4fc3-bd13-35f921464d24\" (UID: \"c6ba454f-2263-4fc3-bd13-35f921464d24\") " Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.428153 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"persistence\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") pod \"c6ba454f-2263-4fc3-bd13-35f921464d24\" (UID: \"c6ba454f-2263-4fc3-bd13-35f921464d24\") " Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.428689 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6ba454f-2263-4fc3-bd13-35f921464d24-rabbitmq-erlang-cookie" (OuterVolumeSpecName: "rabbitmq-erlang-cookie") pod "c6ba454f-2263-4fc3-bd13-35f921464d24" (UID: "c6ba454f-2263-4fc3-bd13-35f921464d24"). InnerVolumeSpecName "rabbitmq-erlang-cookie". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.428841 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d59d2b2a-a98e-4f02-80f4-b6daa5b64d41-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.428896 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d2f6e14c-b704-4805-b5fa-33de25bc4f0f-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.428908 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d59d2b2a-a98e-4f02-80f4-b6daa5b64d41-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.428920 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lsvg4\" (UniqueName: \"kubernetes.io/projected/d59d2b2a-a98e-4f02-80f4-b6daa5b64d41-kube-api-access-lsvg4\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.428930 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d2f6e14c-b704-4805-b5fa-33de25bc4f0f-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.428964 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d59d2b2a-a98e-4f02-80f4-b6daa5b64d41-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.428974 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-px7h2\" (UniqueName: \"kubernetes.io/projected/d2f6e14c-b704-4805-b5fa-33de25bc4f0f-kube-api-access-px7h2\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.428983 5120 reconciler_common.go:299] "Volume detached for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/d2f6e14c-b704-4805-b5fa-33de25bc4f0f-ovn-rundir\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.428991 5120 reconciler_common.go:299] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/d59d2b2a-a98e-4f02-80f4-b6daa5b64d41-fernet-keys\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.428999 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/d2f6e14c-b704-4805-b5fa-33de25bc4f0f-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.429007 5120 reconciler_common.go:299] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/d59d2b2a-a98e-4f02-80f4-b6daa5b64d41-credential-keys\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.429016 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/c6ba454f-2263-4fc3-bd13-35f921464d24-rabbitmq-plugins\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.429043 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/d59d2b2a-a98e-4f02-80f4-b6daa5b64d41-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.429053 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/c6ba454f-2263-4fc3-bd13-35f921464d24-rabbitmq-erlang-cookie\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.429061 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/d59d2b2a-a98e-4f02-80f4-b6daa5b64d41-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.429706 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c6ba454f-2263-4fc3-bd13-35f921464d24-plugins-conf" (OuterVolumeSpecName: "plugins-conf") pod "c6ba454f-2263-4fc3-bd13-35f921464d24" (UID: "c6ba454f-2263-4fc3-bd13-35f921464d24"). InnerVolumeSpecName "plugins-conf". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.432214 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage18-crc" (OuterVolumeSpecName: "persistence") pod "c6ba454f-2263-4fc3-bd13-35f921464d24" (UID: "c6ba454f-2263-4fc3-bd13-35f921464d24"). InnerVolumeSpecName "local-storage18-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.432276 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6ba454f-2263-4fc3-bd13-35f921464d24-kube-api-access-kpt4z" (OuterVolumeSpecName: "kube-api-access-kpt4z") pod "c6ba454f-2263-4fc3-bd13-35f921464d24" (UID: "c6ba454f-2263-4fc3-bd13-35f921464d24"). InnerVolumeSpecName "kube-api-access-kpt4z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.433089 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c6ba454f-2263-4fc3-bd13-35f921464d24-erlang-cookie-secret" (OuterVolumeSpecName: "erlang-cookie-secret") pod "c6ba454f-2263-4fc3-bd13-35f921464d24" (UID: "c6ba454f-2263-4fc3-bd13-35f921464d24"). InnerVolumeSpecName "erlang-cookie-secret". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.434538 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6ba454f-2263-4fc3-bd13-35f921464d24-rabbitmq-tls" (OuterVolumeSpecName: "rabbitmq-tls") pod "c6ba454f-2263-4fc3-bd13-35f921464d24" (UID: "c6ba454f-2263-4fc3-bd13-35f921464d24"). InnerVolumeSpecName "rabbitmq-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.443243 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c6ba454f-2263-4fc3-bd13-35f921464d24-pod-info" (OuterVolumeSpecName: "pod-info") pod "c6ba454f-2263-4fc3-bd13-35f921464d24" (UID: "c6ba454f-2263-4fc3-bd13-35f921464d24"). InnerVolumeSpecName "pod-info". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.449561 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d2f6e14c-b704-4805-b5fa-33de25bc4f0f-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "d2f6e14c-b704-4805-b5fa-33de25bc4f0f" (UID: "d2f6e14c-b704-4805-b5fa-33de25bc4f0f"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.450654 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d2f6e14c-b704-4805-b5fa-33de25bc4f0f-ovn-northd-tls-certs" (OuterVolumeSpecName: "ovn-northd-tls-certs") pod "d2f6e14c-b704-4805-b5fa-33de25bc4f0f" (UID: "d2f6e14c-b704-4805-b5fa-33de25bc4f0f"). InnerVolumeSpecName "ovn-northd-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.457556 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c6ba454f-2263-4fc3-bd13-35f921464d24-config-data" (OuterVolumeSpecName: "config-data") pod "c6ba454f-2263-4fc3-bd13-35f921464d24" (UID: "c6ba454f-2263-4fc3-bd13-35f921464d24"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.469979 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c6ba454f-2263-4fc3-bd13-35f921464d24-server-conf" (OuterVolumeSpecName: "server-conf") pod "c6ba454f-2263-4fc3-bd13-35f921464d24" (UID: "c6ba454f-2263-4fc3-bd13-35f921464d24"). InnerVolumeSpecName "server-conf". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.512433 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6ba454f-2263-4fc3-bd13-35f921464d24-rabbitmq-confd" (OuterVolumeSpecName: "rabbitmq-confd") pod "c6ba454f-2263-4fc3-bd13-35f921464d24" (UID: "c6ba454f-2263-4fc3-bd13-35f921464d24"). InnerVolumeSpecName "rabbitmq-confd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.537571 5120 reconciler_common.go:299] "Volume detached for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/d2f6e14c-b704-4805-b5fa-33de25bc4f0f-ovn-northd-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.537614 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kpt4z\" (UniqueName: \"kubernetes.io/projected/c6ba454f-2263-4fc3-bd13-35f921464d24-kube-api-access-kpt4z\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.537630 5120 reconciler_common.go:299] "Volume detached for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/c6ba454f-2263-4fc3-bd13-35f921464d24-pod-info\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.537643 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/c6ba454f-2263-4fc3-bd13-35f921464d24-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.537653 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/c6ba454f-2263-4fc3-bd13-35f921464d24-rabbitmq-tls\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.537667 5120 reconciler_common.go:299] "Volume detached for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/c6ba454f-2263-4fc3-bd13-35f921464d24-erlang-cookie-secret\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.537677 5120 reconciler_common.go:299] "Volume detached for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/c6ba454f-2263-4fc3-bd13-35f921464d24-server-conf\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.537688 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/c6ba454f-2263-4fc3-bd13-35f921464d24-rabbitmq-confd\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.537700 5120 reconciler_common.go:299] "Volume detached for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/c6ba454f-2263-4fc3-bd13-35f921464d24-plugins-conf\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.537711 5120 reconciler_common.go:299] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/d2f6e14c-b704-4805-b5fa-33de25bc4f0f-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.537736 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage18-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") on node \"crc\" " Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.554774 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage18-crc" (UniqueName: "kubernetes.io/local-volume/local-storage18-crc") on node "crc" Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.639908 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage18-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.683926 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0fcb10f4-41ed-44a6-9b3b-3048e7f558cd" path="/var/lib/kubelet/pods/0fcb10f4-41ed-44a6-9b3b-3048e7f558cd/volumes" Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.684602 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="152925c6-48ae-4e8d-9a3f-68f01278fe95" path="/var/lib/kubelet/pods/152925c6-48ae-4e8d-9a3f-68f01278fe95/volumes" Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.685240 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="215bcff0-714b-427b-ab26-130a21366d15" path="/var/lib/kubelet/pods/215bcff0-714b-427b-ab26-130a21366d15/volumes" Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.685592 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="472a9d94-a155-4916-aab9-4672a3c6c18c" path="/var/lib/kubelet/pods/472a9d94-a155-4916-aab9-4672a3c6c18c/volumes" Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.686639 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c8124f6-11f6-49fd-94a8-d931c557b6c4" path="/var/lib/kubelet/pods/5c8124f6-11f6-49fd-94a8-d931c557b6c4/volumes" Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.687093 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="641d2a6c-6871-488a-8ef3-5a2e693af389" path="/var/lib/kubelet/pods/641d2a6c-6871-488a-8ef3-5a2e693af389/volumes" Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.687715 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="75da64f9-4c43-4411-bd20-86c98536adce" path="/var/lib/kubelet/pods/75da64f9-4c43-4411-bd20-86c98536adce/volumes" Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.688886 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a93918e6-bb45-4717-afef-978bad1c6612" path="/var/lib/kubelet/pods/a93918e6-bb45-4717-afef-978bad1c6612/volumes" Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.689537 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ae73ae1d-4056-43c2-addd-f08999a4a7f6" path="/var/lib/kubelet/pods/ae73ae1d-4056-43c2-addd-f08999a4a7f6/volumes" Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.690610 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bbbbc69c-1fe6-40ae-a88a-a470f3f564ed" path="/var/lib/kubelet/pods/bbbbc69c-1fe6-40ae-a88a-a470f3f564ed/volumes" Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.691332 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc4853a6-faf5-45dc-b6f4-aa0b65d0ca8d" path="/var/lib/kubelet/pods/cc4853a6-faf5-45dc-b6f4-aa0b65d0ca8d/volumes" Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.692076 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d8266cfd-9730-429f-8099-e47188d84aba" path="/var/lib/kubelet/pods/d8266cfd-9730-429f-8099-e47188d84aba/volumes" Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.693334 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f4cbd2d6-e498-42bf-a100-bc0c6664e7ed" path="/var/lib/kubelet/pods/f4cbd2d6-e498-42bf-a100-bc0c6664e7ed/volumes" Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.696993 5120 generic.go:358] "Generic (PLEG): container finished" podID="27ae46b8-fa26-48e8-a9bb-36bc910c3caf" containerID="67d364b2aaba2a401705ec4f2931d79fe5a55f4f1d2ab7387f8debc4e1e79018" exitCode=0 Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.697929 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"27ae46b8-fa26-48e8-a9bb-36bc910c3caf","Type":"ContainerDied","Data":"67d364b2aaba2a401705ec4f2931d79fe5a55f4f1d2ab7387f8debc4e1e79018"} Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.700771 5120 generic.go:358] "Generic (PLEG): container finished" podID="d59d2b2a-a98e-4f02-80f4-b6daa5b64d41" containerID="fb93163f3db63a7bab64ee932655eb3d71444795fa8b3cccc2ec5463d55fb7d9" exitCode=0 Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.700885 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-f6bd6ffc7-nq4s9" event={"ID":"d59d2b2a-a98e-4f02-80f4-b6daa5b64d41","Type":"ContainerDied","Data":"fb93163f3db63a7bab64ee932655eb3d71444795fa8b3cccc2ec5463d55fb7d9"} Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.700916 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-f6bd6ffc7-nq4s9" event={"ID":"d59d2b2a-a98e-4f02-80f4-b6daa5b64d41","Type":"ContainerDied","Data":"9975af6ade51cf2145c5a082d7b00acca8c73e57d42b7ba74cf83031980b8683"} Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.700936 5120 scope.go:117] "RemoveContainer" containerID="fb93163f3db63a7bab64ee932655eb3d71444795fa8b3cccc2ec5463d55fb7d9" Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.701118 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-f6bd6ffc7-nq4s9" Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.710598 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-northd-0_d2f6e14c-b704-4805-b5fa-33de25bc4f0f/ovn-northd/0.log" Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.710644 5120 generic.go:358] "Generic (PLEG): container finished" podID="d2f6e14c-b704-4805-b5fa-33de25bc4f0f" containerID="02d4b3980426703b64bb4594387bb6ec9a3bd1e0687735c81eacb5de5e3a1047" exitCode=139 Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.710720 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"d2f6e14c-b704-4805-b5fa-33de25bc4f0f","Type":"ContainerDied","Data":"02d4b3980426703b64bb4594387bb6ec9a3bd1e0687735c81eacb5de5e3a1047"} Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.710820 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"d2f6e14c-b704-4805-b5fa-33de25bc4f0f","Type":"ContainerDied","Data":"cb8977e4e013f9a8ad7b9c759468e03fb46f813c14e9512a43b067f8ad253bac"} Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.711001 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.717106 5120 generic.go:358] "Generic (PLEG): container finished" podID="c6ba454f-2263-4fc3-bd13-35f921464d24" containerID="d132e86febb95aaac349850de3398e5eb968a0b02b7fc9c1c262ba103110a6d5" exitCode=0 Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.717173 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.717271 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"c6ba454f-2263-4fc3-bd13-35f921464d24","Type":"ContainerDied","Data":"d132e86febb95aaac349850de3398e5eb968a0b02b7fc9c1c262ba103110a6d5"} Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.717298 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"c6ba454f-2263-4fc3-bd13-35f921464d24","Type":"ContainerDied","Data":"92ba644b45ffa3cbdcf9578fc87c1f63031fa2914e80fb658b9360ede334b93a"} Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.755671 5120 scope.go:117] "RemoveContainer" containerID="fb93163f3db63a7bab64ee932655eb3d71444795fa8b3cccc2ec5463d55fb7d9" Mar 16 16:54:28 crc kubenswrapper[5120]: E0316 16:54:28.756383 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb93163f3db63a7bab64ee932655eb3d71444795fa8b3cccc2ec5463d55fb7d9\": container with ID starting with fb93163f3db63a7bab64ee932655eb3d71444795fa8b3cccc2ec5463d55fb7d9 not found: ID does not exist" containerID="fb93163f3db63a7bab64ee932655eb3d71444795fa8b3cccc2ec5463d55fb7d9" Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.757017 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb93163f3db63a7bab64ee932655eb3d71444795fa8b3cccc2ec5463d55fb7d9"} err="failed to get container status \"fb93163f3db63a7bab64ee932655eb3d71444795fa8b3cccc2ec5463d55fb7d9\": rpc error: code = NotFound desc = could not find container \"fb93163f3db63a7bab64ee932655eb3d71444795fa8b3cccc2ec5463d55fb7d9\": container with ID starting with fb93163f3db63a7bab64ee932655eb3d71444795fa8b3cccc2ec5463d55fb7d9 not found: ID does not exist" Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.760459 5120 scope.go:117] "RemoveContainer" containerID="17ca7c826c304f51fb924754427aadc5afd13c084da739b85388c42c18fc61f1" Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.783376 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-f6bd6ffc7-nq4s9"] Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.800142 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-f6bd6ffc7-nq4s9"] Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.801912 5120 scope.go:117] "RemoveContainer" containerID="02d4b3980426703b64bb4594387bb6ec9a3bd1e0687735c81eacb5de5e3a1047" Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.807108 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.813210 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.818851 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.824148 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.827157 5120 scope.go:117] "RemoveContainer" containerID="17ca7c826c304f51fb924754427aadc5afd13c084da739b85388c42c18fc61f1" Mar 16 16:54:28 crc kubenswrapper[5120]: E0316 16:54:28.827537 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"17ca7c826c304f51fb924754427aadc5afd13c084da739b85388c42c18fc61f1\": container with ID starting with 17ca7c826c304f51fb924754427aadc5afd13c084da739b85388c42c18fc61f1 not found: ID does not exist" containerID="17ca7c826c304f51fb924754427aadc5afd13c084da739b85388c42c18fc61f1" Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.827570 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17ca7c826c304f51fb924754427aadc5afd13c084da739b85388c42c18fc61f1"} err="failed to get container status \"17ca7c826c304f51fb924754427aadc5afd13c084da739b85388c42c18fc61f1\": rpc error: code = NotFound desc = could not find container \"17ca7c826c304f51fb924754427aadc5afd13c084da739b85388c42c18fc61f1\": container with ID starting with 17ca7c826c304f51fb924754427aadc5afd13c084da739b85388c42c18fc61f1 not found: ID does not exist" Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.827595 5120 scope.go:117] "RemoveContainer" containerID="02d4b3980426703b64bb4594387bb6ec9a3bd1e0687735c81eacb5de5e3a1047" Mar 16 16:54:28 crc kubenswrapper[5120]: E0316 16:54:28.827937 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"02d4b3980426703b64bb4594387bb6ec9a3bd1e0687735c81eacb5de5e3a1047\": container with ID starting with 02d4b3980426703b64bb4594387bb6ec9a3bd1e0687735c81eacb5de5e3a1047 not found: ID does not exist" containerID="02d4b3980426703b64bb4594387bb6ec9a3bd1e0687735c81eacb5de5e3a1047" Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.828028 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02d4b3980426703b64bb4594387bb6ec9a3bd1e0687735c81eacb5de5e3a1047"} err="failed to get container status \"02d4b3980426703b64bb4594387bb6ec9a3bd1e0687735c81eacb5de5e3a1047\": rpc error: code = NotFound desc = could not find container \"02d4b3980426703b64bb4594387bb6ec9a3bd1e0687735c81eacb5de5e3a1047\": container with ID starting with 02d4b3980426703b64bb4594387bb6ec9a3bd1e0687735c81eacb5de5e3a1047 not found: ID does not exist" Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.828103 5120 scope.go:117] "RemoveContainer" containerID="d132e86febb95aaac349850de3398e5eb968a0b02b7fc9c1c262ba103110a6d5" Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.846203 5120 scope.go:117] "RemoveContainer" containerID="b0b5305a6846284b79d23bdb4082f7f0f42d0d97115e9730ee20618a55daedc4" Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.873487 5120 scope.go:117] "RemoveContainer" containerID="d132e86febb95aaac349850de3398e5eb968a0b02b7fc9c1c262ba103110a6d5" Mar 16 16:54:28 crc kubenswrapper[5120]: E0316 16:54:28.874026 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d132e86febb95aaac349850de3398e5eb968a0b02b7fc9c1c262ba103110a6d5\": container with ID starting with d132e86febb95aaac349850de3398e5eb968a0b02b7fc9c1c262ba103110a6d5 not found: ID does not exist" containerID="d132e86febb95aaac349850de3398e5eb968a0b02b7fc9c1c262ba103110a6d5" Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.874141 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d132e86febb95aaac349850de3398e5eb968a0b02b7fc9c1c262ba103110a6d5"} err="failed to get container status \"d132e86febb95aaac349850de3398e5eb968a0b02b7fc9c1c262ba103110a6d5\": rpc error: code = NotFound desc = could not find container \"d132e86febb95aaac349850de3398e5eb968a0b02b7fc9c1c262ba103110a6d5\": container with ID starting with d132e86febb95aaac349850de3398e5eb968a0b02b7fc9c1c262ba103110a6d5 not found: ID does not exist" Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.874214 5120 scope.go:117] "RemoveContainer" containerID="b0b5305a6846284b79d23bdb4082f7f0f42d0d97115e9730ee20618a55daedc4" Mar 16 16:54:28 crc kubenswrapper[5120]: E0316 16:54:28.875120 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b0b5305a6846284b79d23bdb4082f7f0f42d0d97115e9730ee20618a55daedc4\": container with ID starting with b0b5305a6846284b79d23bdb4082f7f0f42d0d97115e9730ee20618a55daedc4 not found: ID does not exist" containerID="b0b5305a6846284b79d23bdb4082f7f0f42d0d97115e9730ee20618a55daedc4" Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.875178 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b0b5305a6846284b79d23bdb4082f7f0f42d0d97115e9730ee20618a55daedc4"} err="failed to get container status \"b0b5305a6846284b79d23bdb4082f7f0f42d0d97115e9730ee20618a55daedc4\": rpc error: code = NotFound desc = could not find container \"b0b5305a6846284b79d23bdb4082f7f0f42d0d97115e9730ee20618a55daedc4\": container with ID starting with b0b5305a6846284b79d23bdb4082f7f0f42d0d97115e9730ee20618a55daedc4 not found: ID does not exist" Mar 16 16:54:28 crc kubenswrapper[5120]: E0316 16:54:28.910920 5120 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd59d2b2a_a98e_4f02_80f4_b6daa5b64d41.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod133b5e0f_d834_4c59_932f_957221e1727b.slice/crio-550a482710c28eab0491207e17c6a03a7948797a16de7ca95046c49632833e1e\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6ba454f_2263_4fc3_bd13_35f921464d24.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd2f6e14c_b704_4805_b5fa_33de25bc4f0f.slice/crio-cb8977e4e013f9a8ad7b9c759468e03fb46f813c14e9512a43b067f8ad253bac\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6ba454f_2263_4fc3_bd13_35f921464d24.slice/crio-92ba644b45ffa3cbdcf9578fc87c1f63031fa2914e80fb658b9360ede334b93a\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd59d2b2a_a98e_4f02_80f4_b6daa5b64d41.slice/crio-9975af6ade51cf2145c5a082d7b00acca8c73e57d42b7ba74cf83031980b8683\": RecentStats: unable to find data in memory cache]" Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.961606 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:54:28 crc kubenswrapper[5120]: I0316 16:54:28.997218 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podUID="1c6098ab-3f23-46bd-95ff-94cf96b88f3f" containerName="nova-cell1-novncproxy-novncproxy" probeResult="failure" output="Get \"https://10.217.0.183:6080/vnc_lite.html\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Mar 16 16:54:29 crc kubenswrapper[5120]: I0316 16:54:29.059803 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/27ae46b8-fa26-48e8-a9bb-36bc910c3caf-plugins-conf\") pod \"27ae46b8-fa26-48e8-a9bb-36bc910c3caf\" (UID: \"27ae46b8-fa26-48e8-a9bb-36bc910c3caf\") " Mar 16 16:54:29 crc kubenswrapper[5120]: I0316 16:54:29.059894 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/27ae46b8-fa26-48e8-a9bb-36bc910c3caf-erlang-cookie-secret\") pod \"27ae46b8-fa26-48e8-a9bb-36bc910c3caf\" (UID: \"27ae46b8-fa26-48e8-a9bb-36bc910c3caf\") " Mar 16 16:54:29 crc kubenswrapper[5120]: I0316 16:54:29.059926 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/27ae46b8-fa26-48e8-a9bb-36bc910c3caf-pod-info\") pod \"27ae46b8-fa26-48e8-a9bb-36bc910c3caf\" (UID: \"27ae46b8-fa26-48e8-a9bb-36bc910c3caf\") " Mar 16 16:54:29 crc kubenswrapper[5120]: I0316 16:54:29.059977 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/27ae46b8-fa26-48e8-a9bb-36bc910c3caf-server-conf\") pod \"27ae46b8-fa26-48e8-a9bb-36bc910c3caf\" (UID: \"27ae46b8-fa26-48e8-a9bb-36bc910c3caf\") " Mar 16 16:54:29 crc kubenswrapper[5120]: I0316 16:54:29.060063 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/27ae46b8-fa26-48e8-a9bb-36bc910c3caf-rabbitmq-plugins\") pod \"27ae46b8-fa26-48e8-a9bb-36bc910c3caf\" (UID: \"27ae46b8-fa26-48e8-a9bb-36bc910c3caf\") " Mar 16 16:54:29 crc kubenswrapper[5120]: I0316 16:54:29.060213 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/27ae46b8-fa26-48e8-a9bb-36bc910c3caf-rabbitmq-confd\") pod \"27ae46b8-fa26-48e8-a9bb-36bc910c3caf\" (UID: \"27ae46b8-fa26-48e8-a9bb-36bc910c3caf\") " Mar 16 16:54:29 crc kubenswrapper[5120]: I0316 16:54:29.060325 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27ae46b8-fa26-48e8-a9bb-36bc910c3caf-plugins-conf" (OuterVolumeSpecName: "plugins-conf") pod "27ae46b8-fa26-48e8-a9bb-36bc910c3caf" (UID: "27ae46b8-fa26-48e8-a9bb-36bc910c3caf"). InnerVolumeSpecName "plugins-conf". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:54:29 crc kubenswrapper[5120]: I0316 16:54:29.060350 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/27ae46b8-fa26-48e8-a9bb-36bc910c3caf-rabbitmq-erlang-cookie\") pod \"27ae46b8-fa26-48e8-a9bb-36bc910c3caf\" (UID: \"27ae46b8-fa26-48e8-a9bb-36bc910c3caf\") " Mar 16 16:54:29 crc kubenswrapper[5120]: I0316 16:54:29.060530 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27ae46b8-fa26-48e8-a9bb-36bc910c3caf-rabbitmq-plugins" (OuterVolumeSpecName: "rabbitmq-plugins") pod "27ae46b8-fa26-48e8-a9bb-36bc910c3caf" (UID: "27ae46b8-fa26-48e8-a9bb-36bc910c3caf"). InnerVolumeSpecName "rabbitmq-plugins". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:54:29 crc kubenswrapper[5120]: I0316 16:54:29.060900 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27ae46b8-fa26-48e8-a9bb-36bc910c3caf-rabbitmq-erlang-cookie" (OuterVolumeSpecName: "rabbitmq-erlang-cookie") pod "27ae46b8-fa26-48e8-a9bb-36bc910c3caf" (UID: "27ae46b8-fa26-48e8-a9bb-36bc910c3caf"). InnerVolumeSpecName "rabbitmq-erlang-cookie". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:54:29 crc kubenswrapper[5120]: I0316 16:54:29.061002 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/27ae46b8-fa26-48e8-a9bb-36bc910c3caf-rabbitmq-tls\") pod \"27ae46b8-fa26-48e8-a9bb-36bc910c3caf\" (UID: \"27ae46b8-fa26-48e8-a9bb-36bc910c3caf\") " Mar 16 16:54:29 crc kubenswrapper[5120]: I0316 16:54:29.061132 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/27ae46b8-fa26-48e8-a9bb-36bc910c3caf-config-data\") pod \"27ae46b8-fa26-48e8-a9bb-36bc910c3caf\" (UID: \"27ae46b8-fa26-48e8-a9bb-36bc910c3caf\") " Mar 16 16:54:29 crc kubenswrapper[5120]: I0316 16:54:29.061180 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"persistence\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"27ae46b8-fa26-48e8-a9bb-36bc910c3caf\" (UID: \"27ae46b8-fa26-48e8-a9bb-36bc910c3caf\") " Mar 16 16:54:29 crc kubenswrapper[5120]: I0316 16:54:29.061219 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ndj8t\" (UniqueName: \"kubernetes.io/projected/27ae46b8-fa26-48e8-a9bb-36bc910c3caf-kube-api-access-ndj8t\") pod \"27ae46b8-fa26-48e8-a9bb-36bc910c3caf\" (UID: \"27ae46b8-fa26-48e8-a9bb-36bc910c3caf\") " Mar 16 16:54:29 crc kubenswrapper[5120]: I0316 16:54:29.062089 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/27ae46b8-fa26-48e8-a9bb-36bc910c3caf-rabbitmq-erlang-cookie\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:29 crc kubenswrapper[5120]: I0316 16:54:29.062112 5120 reconciler_common.go:299] "Volume detached for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/27ae46b8-fa26-48e8-a9bb-36bc910c3caf-plugins-conf\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:29 crc kubenswrapper[5120]: I0316 16:54:29.062125 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/27ae46b8-fa26-48e8-a9bb-36bc910c3caf-rabbitmq-plugins\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:29 crc kubenswrapper[5120]: I0316 16:54:29.065466 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/27ae46b8-fa26-48e8-a9bb-36bc910c3caf-pod-info" (OuterVolumeSpecName: "pod-info") pod "27ae46b8-fa26-48e8-a9bb-36bc910c3caf" (UID: "27ae46b8-fa26-48e8-a9bb-36bc910c3caf"). InnerVolumeSpecName "pod-info". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Mar 16 16:54:29 crc kubenswrapper[5120]: I0316 16:54:29.065768 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27ae46b8-fa26-48e8-a9bb-36bc910c3caf-erlang-cookie-secret" (OuterVolumeSpecName: "erlang-cookie-secret") pod "27ae46b8-fa26-48e8-a9bb-36bc910c3caf" (UID: "27ae46b8-fa26-48e8-a9bb-36bc910c3caf"). InnerVolumeSpecName "erlang-cookie-secret". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:54:29 crc kubenswrapper[5120]: I0316 16:54:29.065897 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage12-crc" (OuterVolumeSpecName: "persistence") pod "27ae46b8-fa26-48e8-a9bb-36bc910c3caf" (UID: "27ae46b8-fa26-48e8-a9bb-36bc910c3caf"). InnerVolumeSpecName "local-storage12-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:54:29 crc kubenswrapper[5120]: I0316 16:54:29.066426 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27ae46b8-fa26-48e8-a9bb-36bc910c3caf-rabbitmq-tls" (OuterVolumeSpecName: "rabbitmq-tls") pod "27ae46b8-fa26-48e8-a9bb-36bc910c3caf" (UID: "27ae46b8-fa26-48e8-a9bb-36bc910c3caf"). InnerVolumeSpecName "rabbitmq-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:54:29 crc kubenswrapper[5120]: I0316 16:54:29.066926 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27ae46b8-fa26-48e8-a9bb-36bc910c3caf-kube-api-access-ndj8t" (OuterVolumeSpecName: "kube-api-access-ndj8t") pod "27ae46b8-fa26-48e8-a9bb-36bc910c3caf" (UID: "27ae46b8-fa26-48e8-a9bb-36bc910c3caf"). InnerVolumeSpecName "kube-api-access-ndj8t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:54:29 crc kubenswrapper[5120]: I0316 16:54:29.080272 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27ae46b8-fa26-48e8-a9bb-36bc910c3caf-config-data" (OuterVolumeSpecName: "config-data") pod "27ae46b8-fa26-48e8-a9bb-36bc910c3caf" (UID: "27ae46b8-fa26-48e8-a9bb-36bc910c3caf"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:54:29 crc kubenswrapper[5120]: I0316 16:54:29.103316 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27ae46b8-fa26-48e8-a9bb-36bc910c3caf-server-conf" (OuterVolumeSpecName: "server-conf") pod "27ae46b8-fa26-48e8-a9bb-36bc910c3caf" (UID: "27ae46b8-fa26-48e8-a9bb-36bc910c3caf"). InnerVolumeSpecName "server-conf". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:54:29 crc kubenswrapper[5120]: I0316 16:54:29.151506 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27ae46b8-fa26-48e8-a9bb-36bc910c3caf-rabbitmq-confd" (OuterVolumeSpecName: "rabbitmq-confd") pod "27ae46b8-fa26-48e8-a9bb-36bc910c3caf" (UID: "27ae46b8-fa26-48e8-a9bb-36bc910c3caf"). InnerVolumeSpecName "rabbitmq-confd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:54:29 crc kubenswrapper[5120]: I0316 16:54:29.163838 5120 reconciler_common.go:299] "Volume detached for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/27ae46b8-fa26-48e8-a9bb-36bc910c3caf-erlang-cookie-secret\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:29 crc kubenswrapper[5120]: I0316 16:54:29.163955 5120 reconciler_common.go:299] "Volume detached for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/27ae46b8-fa26-48e8-a9bb-36bc910c3caf-pod-info\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:29 crc kubenswrapper[5120]: I0316 16:54:29.163964 5120 reconciler_common.go:299] "Volume detached for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/27ae46b8-fa26-48e8-a9bb-36bc910c3caf-server-conf\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:29 crc kubenswrapper[5120]: I0316 16:54:29.163972 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/27ae46b8-fa26-48e8-a9bb-36bc910c3caf-rabbitmq-confd\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:29 crc kubenswrapper[5120]: I0316 16:54:29.163981 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/27ae46b8-fa26-48e8-a9bb-36bc910c3caf-rabbitmq-tls\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:29 crc kubenswrapper[5120]: I0316 16:54:29.163989 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/27ae46b8-fa26-48e8-a9bb-36bc910c3caf-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:29 crc kubenswrapper[5120]: I0316 16:54:29.164019 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") on node \"crc\" " Mar 16 16:54:29 crc kubenswrapper[5120]: I0316 16:54:29.164030 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ndj8t\" (UniqueName: \"kubernetes.io/projected/27ae46b8-fa26-48e8-a9bb-36bc910c3caf-kube-api-access-ndj8t\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:29 crc kubenswrapper[5120]: I0316 16:54:29.179848 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage12-crc" (UniqueName: "kubernetes.io/local-volume/local-storage12-crc") on node "crc" Mar 16 16:54:29 crc kubenswrapper[5120]: I0316 16:54:29.255640 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/swift-proxy-5d595646b6-w4dgd" podUID="689362fd-dae2-4d32-839f-c13ebc515c4c" containerName="proxy-httpd" probeResult="failure" output="Get \"https://10.217.0.203:8080/healthcheck\": context deadline exceeded" Mar 16 16:54:29 crc kubenswrapper[5120]: I0316 16:54:29.264194 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/swift-proxy-5d595646b6-w4dgd" podUID="689362fd-dae2-4d32-839f-c13ebc515c4c" containerName="proxy-server" probeResult="failure" output="Get \"https://10.217.0.203:8080/healthcheck\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Mar 16 16:54:29 crc kubenswrapper[5120]: I0316 16:54:29.265954 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:29 crc kubenswrapper[5120]: I0316 16:54:29.742221 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"27ae46b8-fa26-48e8-a9bb-36bc910c3caf","Type":"ContainerDied","Data":"8b5327a45c28caa026704115816d96c025ee7d4b8061ce577a938f38ed2830da"} Mar 16 16:54:29 crc kubenswrapper[5120]: I0316 16:54:29.742282 5120 scope.go:117] "RemoveContainer" containerID="67d364b2aaba2a401705ec4f2931d79fe5a55f4f1d2ab7387f8debc4e1e79018" Mar 16 16:54:29 crc kubenswrapper[5120]: I0316 16:54:29.742275 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:54:29 crc kubenswrapper[5120]: I0316 16:54:29.769857 5120 scope.go:117] "RemoveContainer" containerID="449f83a213ae844b7d7517f9c8b501e0b09ea767c80cb2310babca43f16e2cf7" Mar 16 16:54:29 crc kubenswrapper[5120]: I0316 16:54:29.809480 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 16:54:29 crc kubenswrapper[5120]: I0316 16:54:29.817889 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 16:54:30 crc kubenswrapper[5120]: I0316 16:54:30.141087 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-kkvsb"] Mar 16 16:54:30 crc kubenswrapper[5120]: I0316 16:54:30.153102 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 16:54:30 crc kubenswrapper[5120]: I0316 16:54:30.153443 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="67ab3338-c88c-4faf-8d25-809c92d661d9" containerName="nova-cell1-conductor-conductor" containerID="cri-o://a1c6c6eaee5b058049bbad3a58ced751fece0e218cfd6faf64607f644b0f5ef7" gracePeriod=30 Mar 16 16:54:30 crc kubenswrapper[5120]: I0316 16:54:30.161169 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-kkvsb"] Mar 16 16:54:30 crc kubenswrapper[5120]: I0316 16:54:30.167124 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-cc9l2"] Mar 16 16:54:30 crc kubenswrapper[5120]: I0316 16:54:30.172996 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:54:30 crc kubenswrapper[5120]: I0316 16:54:30.173263 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="802ef826-c6e7-4a1c-90a6-b419b9489007" containerName="nova-cell0-conductor-conductor" containerID="cri-o://ee30dfd8af3af59f37f37ec99d41afa1ec85248596d20c9e31406083d8a749b1" gracePeriod=30 Mar 16 16:54:30 crc kubenswrapper[5120]: I0316 16:54:30.179517 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-cc9l2"] Mar 16 16:54:30 crc kubenswrapper[5120]: I0316 16:54:30.674900 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="27ae46b8-fa26-48e8-a9bb-36bc910c3caf" path="/var/lib/kubelet/pods/27ae46b8-fa26-48e8-a9bb-36bc910c3caf/volumes" Mar 16 16:54:30 crc kubenswrapper[5120]: I0316 16:54:30.676082 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b0efd462-99b7-4e0f-a098-4add05cf74a2" path="/var/lib/kubelet/pods/b0efd462-99b7-4e0f-a098-4add05cf74a2/volumes" Mar 16 16:54:30 crc kubenswrapper[5120]: I0316 16:54:30.676898 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c6ba454f-2263-4fc3-bd13-35f921464d24" path="/var/lib/kubelet/pods/c6ba454f-2263-4fc3-bd13-35f921464d24/volumes" Mar 16 16:54:30 crc kubenswrapper[5120]: I0316 16:54:30.678016 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d2f6e14c-b704-4805-b5fa-33de25bc4f0f" path="/var/lib/kubelet/pods/d2f6e14c-b704-4805-b5fa-33de25bc4f0f/volumes" Mar 16 16:54:30 crc kubenswrapper[5120]: I0316 16:54:30.678530 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d59d2b2a-a98e-4f02-80f4-b6daa5b64d41" path="/var/lib/kubelet/pods/d59d2b2a-a98e-4f02-80f4-b6daa5b64d41/volumes" Mar 16 16:54:30 crc kubenswrapper[5120]: I0316 16:54:30.679732 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fa2dd400-9a52-4610-b9db-83f796bab4a6" path="/var/lib/kubelet/pods/fa2dd400-9a52-4610-b9db-83f796bab4a6/volumes" Mar 16 16:54:30 crc kubenswrapper[5120]: I0316 16:54:30.889311 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/cinder-api-0" podUID="f4cbd2d6-e498-42bf-a100-bc0c6664e7ed" containerName="cinder-api" probeResult="failure" output="Get \"https://10.217.0.189:8776/healthcheck\": context deadline exceeded" Mar 16 16:54:31 crc kubenswrapper[5120]: I0316 16:54:31.106977 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 16:54:31 crc kubenswrapper[5120]: I0316 16:54:31.107197 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/memcached-0" podUID="d8a5e446-6e3f-4c8c-b842-f800c1361957" containerName="memcached" containerID="cri-o://893cb1996f3cbb0a52fa448b20455a763e12fb23794ad15c478de373e3a247a9" gracePeriod=30 Mar 16 16:54:31 crc kubenswrapper[5120]: I0316 16:54:31.131601 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:54:31 crc kubenswrapper[5120]: I0316 16:54:31.131837 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="de073433-40f2-40c4-ba26-ae8be3817e67" containerName="nova-scheduler-scheduler" containerID="cri-o://98f2961dcc312facfab09ff595793480ed2af349689afceae531c8d93b77cfb7" gracePeriod=30 Mar 16 16:54:31 crc kubenswrapper[5120]: I0316 16:54:31.782094 5120 generic.go:358] "Generic (PLEG): container finished" podID="d8a5e446-6e3f-4c8c-b842-f800c1361957" containerID="893cb1996f3cbb0a52fa448b20455a763e12fb23794ad15c478de373e3a247a9" exitCode=0 Mar 16 16:54:31 crc kubenswrapper[5120]: I0316 16:54:31.782202 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"d8a5e446-6e3f-4c8c-b842-f800c1361957","Type":"ContainerDied","Data":"893cb1996f3cbb0a52fa448b20455a763e12fb23794ad15c478de373e3a247a9"} Mar 16 16:54:32 crc kubenswrapper[5120]: I0316 16:54:32.094718 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Mar 16 16:54:32 crc kubenswrapper[5120]: I0316 16:54:32.238884 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d8a5e446-6e3f-4c8c-b842-f800c1361957-combined-ca-bundle\") pod \"d8a5e446-6e3f-4c8c-b842-f800c1361957\" (UID: \"d8a5e446-6e3f-4c8c-b842-f800c1361957\") " Mar 16 16:54:32 crc kubenswrapper[5120]: I0316 16:54:32.239011 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/d8a5e446-6e3f-4c8c-b842-f800c1361957-config-data\") pod \"d8a5e446-6e3f-4c8c-b842-f800c1361957\" (UID: \"d8a5e446-6e3f-4c8c-b842-f800c1361957\") " Mar 16 16:54:32 crc kubenswrapper[5120]: I0316 16:54:32.239300 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/d8a5e446-6e3f-4c8c-b842-f800c1361957-kolla-config\") pod \"d8a5e446-6e3f-4c8c-b842-f800c1361957\" (UID: \"d8a5e446-6e3f-4c8c-b842-f800c1361957\") " Mar 16 16:54:32 crc kubenswrapper[5120]: I0316 16:54:32.239593 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/d8a5e446-6e3f-4c8c-b842-f800c1361957-memcached-tls-certs\") pod \"d8a5e446-6e3f-4c8c-b842-f800c1361957\" (UID: \"d8a5e446-6e3f-4c8c-b842-f800c1361957\") " Mar 16 16:54:32 crc kubenswrapper[5120]: I0316 16:54:32.239832 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hnk6d\" (UniqueName: \"kubernetes.io/projected/d8a5e446-6e3f-4c8c-b842-f800c1361957-kube-api-access-hnk6d\") pod \"d8a5e446-6e3f-4c8c-b842-f800c1361957\" (UID: \"d8a5e446-6e3f-4c8c-b842-f800c1361957\") " Mar 16 16:54:32 crc kubenswrapper[5120]: I0316 16:54:32.240073 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d8a5e446-6e3f-4c8c-b842-f800c1361957-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "d8a5e446-6e3f-4c8c-b842-f800c1361957" (UID: "d8a5e446-6e3f-4c8c-b842-f800c1361957"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:54:32 crc kubenswrapper[5120]: I0316 16:54:32.240610 5120 reconciler_common.go:299] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/d8a5e446-6e3f-4c8c-b842-f800c1361957-kolla-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:32 crc kubenswrapper[5120]: I0316 16:54:32.241045 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d8a5e446-6e3f-4c8c-b842-f800c1361957-config-data" (OuterVolumeSpecName: "config-data") pod "d8a5e446-6e3f-4c8c-b842-f800c1361957" (UID: "d8a5e446-6e3f-4c8c-b842-f800c1361957"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:54:32 crc kubenswrapper[5120]: I0316 16:54:32.244438 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8a5e446-6e3f-4c8c-b842-f800c1361957-kube-api-access-hnk6d" (OuterVolumeSpecName: "kube-api-access-hnk6d") pod "d8a5e446-6e3f-4c8c-b842-f800c1361957" (UID: "d8a5e446-6e3f-4c8c-b842-f800c1361957"). InnerVolumeSpecName "kube-api-access-hnk6d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:54:32 crc kubenswrapper[5120]: I0316 16:54:32.274544 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d8a5e446-6e3f-4c8c-b842-f800c1361957-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "d8a5e446-6e3f-4c8c-b842-f800c1361957" (UID: "d8a5e446-6e3f-4c8c-b842-f800c1361957"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:54:32 crc kubenswrapper[5120]: I0316 16:54:32.287627 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d8a5e446-6e3f-4c8c-b842-f800c1361957-memcached-tls-certs" (OuterVolumeSpecName: "memcached-tls-certs") pod "d8a5e446-6e3f-4c8c-b842-f800c1361957" (UID: "d8a5e446-6e3f-4c8c-b842-f800c1361957"). InnerVolumeSpecName "memcached-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:54:32 crc kubenswrapper[5120]: I0316 16:54:32.342892 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d8a5e446-6e3f-4c8c-b842-f800c1361957-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:32 crc kubenswrapper[5120]: I0316 16:54:32.342928 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/d8a5e446-6e3f-4c8c-b842-f800c1361957-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:32 crc kubenswrapper[5120]: I0316 16:54:32.342938 5120 reconciler_common.go:299] "Volume detached for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/d8a5e446-6e3f-4c8c-b842-f800c1361957-memcached-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:32 crc kubenswrapper[5120]: I0316 16:54:32.342948 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hnk6d\" (UniqueName: \"kubernetes.io/projected/d8a5e446-6e3f-4c8c-b842-f800c1361957-kube-api-access-hnk6d\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:32 crc kubenswrapper[5120]: E0316 16:54:32.461046 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a1c6c6eaee5b058049bbad3a58ced751fece0e218cfd6faf64607f644b0f5ef7" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:54:32 crc kubenswrapper[5120]: E0316 16:54:32.462172 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a1c6c6eaee5b058049bbad3a58ced751fece0e218cfd6faf64607f644b0f5ef7" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:54:32 crc kubenswrapper[5120]: E0316 16:54:32.463411 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a1c6c6eaee5b058049bbad3a58ced751fece0e218cfd6faf64607f644b0f5ef7" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:54:32 crc kubenswrapper[5120]: E0316 16:54:32.463460 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="67ab3338-c88c-4faf-8d25-809c92d661d9" containerName="nova-cell1-conductor-conductor" probeResult="unknown" Mar 16 16:54:32 crc kubenswrapper[5120]: I0316 16:54:32.796249 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Mar 16 16:54:32 crc kubenswrapper[5120]: I0316 16:54:32.796337 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"d8a5e446-6e3f-4c8c-b842-f800c1361957","Type":"ContainerDied","Data":"671886e146a24613029fd5ae155c490343cf70d61ea5a7ff91afda30bd0a1642"} Mar 16 16:54:32 crc kubenswrapper[5120]: I0316 16:54:32.796398 5120 scope.go:117] "RemoveContainer" containerID="893cb1996f3cbb0a52fa448b20455a763e12fb23794ad15c478de373e3a247a9" Mar 16 16:54:32 crc kubenswrapper[5120]: I0316 16:54:32.827628 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 16:54:32 crc kubenswrapper[5120]: I0316 16:54:32.838243 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 16:54:33 crc kubenswrapper[5120]: E0316 16:54:33.217487 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="98f2961dcc312facfab09ff595793480ed2af349689afceae531c8d93b77cfb7" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:54:33 crc kubenswrapper[5120]: E0316 16:54:33.219162 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="98f2961dcc312facfab09ff595793480ed2af349689afceae531c8d93b77cfb7" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:54:33 crc kubenswrapper[5120]: E0316 16:54:33.221432 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="98f2961dcc312facfab09ff595793480ed2af349689afceae531c8d93b77cfb7" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:54:33 crc kubenswrapper[5120]: E0316 16:54:33.221498 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="de073433-40f2-40c4-ba26-ae8be3817e67" containerName="nova-scheduler-scheduler" probeResult="unknown" Mar 16 16:54:33 crc kubenswrapper[5120]: E0316 16:54:33.535681 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="ee30dfd8af3af59f37f37ec99d41afa1ec85248596d20c9e31406083d8a749b1" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:54:33 crc kubenswrapper[5120]: E0316 16:54:33.539833 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="ee30dfd8af3af59f37f37ec99d41afa1ec85248596d20c9e31406083d8a749b1" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:54:33 crc kubenswrapper[5120]: E0316 16:54:33.541485 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="ee30dfd8af3af59f37f37ec99d41afa1ec85248596d20c9e31406083d8a749b1" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:54:33 crc kubenswrapper[5120]: E0316 16:54:33.541532 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="802ef826-c6e7-4a1c-90a6-b419b9489007" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 16:54:33 crc kubenswrapper[5120]: I0316 16:54:33.727926 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-9d545" Mar 16 16:54:33 crc kubenswrapper[5120]: I0316 16:54:33.790589 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-6cc498cb5c-zdb8r"] Mar 16 16:54:33 crc kubenswrapper[5120]: I0316 16:54:33.790991 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6cc498cb5c-zdb8r" podUID="d20086a2-b461-4ca6-b442-f1c1782b833d" containerName="dnsmasq-dns" containerID="cri-o://0beab2129e4c6e5de483a10f0e3da05c1da16b9a83182d703c4ee6fda502697e" gracePeriod=10 Mar 16 16:54:34 crc kubenswrapper[5120]: I0316 16:54:34.296069 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/nova-api-0" podUID="68500e27-b83c-4571-9082-33e4d4ea3daa" containerName="nova-api-api" probeResult="failure" output="Get \"https://10.217.0.186:8774/\": net/http: TLS handshake timeout" Mar 16 16:54:34 crc kubenswrapper[5120]: I0316 16:54:34.347919 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6cc498cb5c-zdb8r" Mar 16 16:54:34 crc kubenswrapper[5120]: I0316 16:54:34.355062 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/nova-api-0" podUID="68500e27-b83c-4571-9082-33e4d4ea3daa" containerName="nova-api-log" probeResult="failure" output="Get \"https://10.217.0.186:8774/\": net/http: TLS handshake timeout" Mar 16 16:54:34 crc kubenswrapper[5120]: I0316 16:54:34.381411 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9746c\" (UniqueName: \"kubernetes.io/projected/d20086a2-b461-4ca6-b442-f1c1782b833d-kube-api-access-9746c\") pod \"d20086a2-b461-4ca6-b442-f1c1782b833d\" (UID: \"d20086a2-b461-4ca6-b442-f1c1782b833d\") " Mar 16 16:54:34 crc kubenswrapper[5120]: I0316 16:54:34.381545 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d20086a2-b461-4ca6-b442-f1c1782b833d-config\") pod \"d20086a2-b461-4ca6-b442-f1c1782b833d\" (UID: \"d20086a2-b461-4ca6-b442-f1c1782b833d\") " Mar 16 16:54:34 crc kubenswrapper[5120]: I0316 16:54:34.381669 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/d20086a2-b461-4ca6-b442-f1c1782b833d-dns-swift-storage-0\") pod \"d20086a2-b461-4ca6-b442-f1c1782b833d\" (UID: \"d20086a2-b461-4ca6-b442-f1c1782b833d\") " Mar 16 16:54:34 crc kubenswrapper[5120]: I0316 16:54:34.382319 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/d20086a2-b461-4ca6-b442-f1c1782b833d-dnsmasq-svc\") pod \"d20086a2-b461-4ca6-b442-f1c1782b833d\" (UID: \"d20086a2-b461-4ca6-b442-f1c1782b833d\") " Mar 16 16:54:34 crc kubenswrapper[5120]: I0316 16:54:34.397123 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d20086a2-b461-4ca6-b442-f1c1782b833d-kube-api-access-9746c" (OuterVolumeSpecName: "kube-api-access-9746c") pod "d20086a2-b461-4ca6-b442-f1c1782b833d" (UID: "d20086a2-b461-4ca6-b442-f1c1782b833d"). InnerVolumeSpecName "kube-api-access-9746c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:54:34 crc kubenswrapper[5120]: I0316 16:54:34.437882 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d20086a2-b461-4ca6-b442-f1c1782b833d-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "d20086a2-b461-4ca6-b442-f1c1782b833d" (UID: "d20086a2-b461-4ca6-b442-f1c1782b833d"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:54:34 crc kubenswrapper[5120]: I0316 16:54:34.452727 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d20086a2-b461-4ca6-b442-f1c1782b833d-dns-swift-storage-0" (OuterVolumeSpecName: "dns-swift-storage-0") pod "d20086a2-b461-4ca6-b442-f1c1782b833d" (UID: "d20086a2-b461-4ca6-b442-f1c1782b833d"). InnerVolumeSpecName "dns-swift-storage-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:54:34 crc kubenswrapper[5120]: I0316 16:54:34.456177 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d20086a2-b461-4ca6-b442-f1c1782b833d-config" (OuterVolumeSpecName: "config") pod "d20086a2-b461-4ca6-b442-f1c1782b833d" (UID: "d20086a2-b461-4ca6-b442-f1c1782b833d"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:54:34 crc kubenswrapper[5120]: I0316 16:54:34.485001 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d20086a2-b461-4ca6-b442-f1c1782b833d-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:34 crc kubenswrapper[5120]: I0316 16:54:34.485038 5120 reconciler_common.go:299] "Volume detached for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/d20086a2-b461-4ca6-b442-f1c1782b833d-dns-swift-storage-0\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:34 crc kubenswrapper[5120]: I0316 16:54:34.485053 5120 reconciler_common.go:299] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/d20086a2-b461-4ca6-b442-f1c1782b833d-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:34 crc kubenswrapper[5120]: I0316 16:54:34.485065 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9746c\" (UniqueName: \"kubernetes.io/projected/d20086a2-b461-4ca6-b442-f1c1782b833d-kube-api-access-9746c\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:34 crc kubenswrapper[5120]: I0316 16:54:34.675210 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d8a5e446-6e3f-4c8c-b842-f800c1361957" path="/var/lib/kubelet/pods/d8a5e446-6e3f-4c8c-b842-f800c1361957/volumes" Mar 16 16:54:34 crc kubenswrapper[5120]: I0316 16:54:34.829184 5120 generic.go:358] "Generic (PLEG): container finished" podID="d20086a2-b461-4ca6-b442-f1c1782b833d" containerID="0beab2129e4c6e5de483a10f0e3da05c1da16b9a83182d703c4ee6fda502697e" exitCode=0 Mar 16 16:54:34 crc kubenswrapper[5120]: I0316 16:54:34.829309 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6cc498cb5c-zdb8r" event={"ID":"d20086a2-b461-4ca6-b442-f1c1782b833d","Type":"ContainerDied","Data":"0beab2129e4c6e5de483a10f0e3da05c1da16b9a83182d703c4ee6fda502697e"} Mar 16 16:54:34 crc kubenswrapper[5120]: I0316 16:54:34.829336 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6cc498cb5c-zdb8r" event={"ID":"d20086a2-b461-4ca6-b442-f1c1782b833d","Type":"ContainerDied","Data":"a8987230d03694d6235677b29d5b9adf39deec54da8597a62c833b58c5ac92f7"} Mar 16 16:54:34 crc kubenswrapper[5120]: I0316 16:54:34.829353 5120 scope.go:117] "RemoveContainer" containerID="0beab2129e4c6e5de483a10f0e3da05c1da16b9a83182d703c4ee6fda502697e" Mar 16 16:54:34 crc kubenswrapper[5120]: I0316 16:54:34.829475 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6cc498cb5c-zdb8r" Mar 16 16:54:34 crc kubenswrapper[5120]: I0316 16:54:34.855733 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-6cc498cb5c-zdb8r"] Mar 16 16:54:34 crc kubenswrapper[5120]: I0316 16:54:34.862618 5120 scope.go:117] "RemoveContainer" containerID="37f14533cd91db09de0ccb17ead0afa80075cb630a2238eadc581f683dd6e89e" Mar 16 16:54:34 crc kubenswrapper[5120]: I0316 16:54:34.886881 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-6cc498cb5c-zdb8r"] Mar 16 16:54:34 crc kubenswrapper[5120]: I0316 16:54:34.886988 5120 scope.go:117] "RemoveContainer" containerID="0beab2129e4c6e5de483a10f0e3da05c1da16b9a83182d703c4ee6fda502697e" Mar 16 16:54:34 crc kubenswrapper[5120]: E0316 16:54:34.888042 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0beab2129e4c6e5de483a10f0e3da05c1da16b9a83182d703c4ee6fda502697e\": container with ID starting with 0beab2129e4c6e5de483a10f0e3da05c1da16b9a83182d703c4ee6fda502697e not found: ID does not exist" containerID="0beab2129e4c6e5de483a10f0e3da05c1da16b9a83182d703c4ee6fda502697e" Mar 16 16:54:34 crc kubenswrapper[5120]: I0316 16:54:34.888677 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0beab2129e4c6e5de483a10f0e3da05c1da16b9a83182d703c4ee6fda502697e"} err="failed to get container status \"0beab2129e4c6e5de483a10f0e3da05c1da16b9a83182d703c4ee6fda502697e\": rpc error: code = NotFound desc = could not find container \"0beab2129e4c6e5de483a10f0e3da05c1da16b9a83182d703c4ee6fda502697e\": container with ID starting with 0beab2129e4c6e5de483a10f0e3da05c1da16b9a83182d703c4ee6fda502697e not found: ID does not exist" Mar 16 16:54:34 crc kubenswrapper[5120]: I0316 16:54:34.888715 5120 scope.go:117] "RemoveContainer" containerID="37f14533cd91db09de0ccb17ead0afa80075cb630a2238eadc581f683dd6e89e" Mar 16 16:54:34 crc kubenswrapper[5120]: E0316 16:54:34.889218 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"37f14533cd91db09de0ccb17ead0afa80075cb630a2238eadc581f683dd6e89e\": container with ID starting with 37f14533cd91db09de0ccb17ead0afa80075cb630a2238eadc581f683dd6e89e not found: ID does not exist" containerID="37f14533cd91db09de0ccb17ead0afa80075cb630a2238eadc581f683dd6e89e" Mar 16 16:54:34 crc kubenswrapper[5120]: I0316 16:54:34.889283 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37f14533cd91db09de0ccb17ead0afa80075cb630a2238eadc581f683dd6e89e"} err="failed to get container status \"37f14533cd91db09de0ccb17ead0afa80075cb630a2238eadc581f683dd6e89e\": rpc error: code = NotFound desc = could not find container \"37f14533cd91db09de0ccb17ead0afa80075cb630a2238eadc581f683dd6e89e\": container with ID starting with 37f14533cd91db09de0ccb17ead0afa80075cb630a2238eadc581f683dd6e89e not found: ID does not exist" Mar 16 16:54:35 crc kubenswrapper[5120]: I0316 16:54:35.578316 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:54:35 crc kubenswrapper[5120]: I0316 16:54:35.606650 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mh4hs\" (UniqueName: \"kubernetes.io/projected/68500e27-b83c-4571-9082-33e4d4ea3daa-kube-api-access-mh4hs\") pod \"68500e27-b83c-4571-9082-33e4d4ea3daa\" (UID: \"68500e27-b83c-4571-9082-33e4d4ea3daa\") " Mar 16 16:54:35 crc kubenswrapper[5120]: I0316 16:54:35.606696 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/68500e27-b83c-4571-9082-33e4d4ea3daa-combined-ca-bundle\") pod \"68500e27-b83c-4571-9082-33e4d4ea3daa\" (UID: \"68500e27-b83c-4571-9082-33e4d4ea3daa\") " Mar 16 16:54:35 crc kubenswrapper[5120]: I0316 16:54:35.606732 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/68500e27-b83c-4571-9082-33e4d4ea3daa-internal-tls-certs\") pod \"68500e27-b83c-4571-9082-33e4d4ea3daa\" (UID: \"68500e27-b83c-4571-9082-33e4d4ea3daa\") " Mar 16 16:54:35 crc kubenswrapper[5120]: I0316 16:54:35.606769 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/68500e27-b83c-4571-9082-33e4d4ea3daa-config-data\") pod \"68500e27-b83c-4571-9082-33e4d4ea3daa\" (UID: \"68500e27-b83c-4571-9082-33e4d4ea3daa\") " Mar 16 16:54:35 crc kubenswrapper[5120]: I0316 16:54:35.606855 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/68500e27-b83c-4571-9082-33e4d4ea3daa-public-tls-certs\") pod \"68500e27-b83c-4571-9082-33e4d4ea3daa\" (UID: \"68500e27-b83c-4571-9082-33e4d4ea3daa\") " Mar 16 16:54:35 crc kubenswrapper[5120]: I0316 16:54:35.606927 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/68500e27-b83c-4571-9082-33e4d4ea3daa-logs\") pod \"68500e27-b83c-4571-9082-33e4d4ea3daa\" (UID: \"68500e27-b83c-4571-9082-33e4d4ea3daa\") " Mar 16 16:54:35 crc kubenswrapper[5120]: I0316 16:54:35.607744 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68500e27-b83c-4571-9082-33e4d4ea3daa-logs" (OuterVolumeSpecName: "logs") pod "68500e27-b83c-4571-9082-33e4d4ea3daa" (UID: "68500e27-b83c-4571-9082-33e4d4ea3daa"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:54:35 crc kubenswrapper[5120]: I0316 16:54:35.618685 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68500e27-b83c-4571-9082-33e4d4ea3daa-kube-api-access-mh4hs" (OuterVolumeSpecName: "kube-api-access-mh4hs") pod "68500e27-b83c-4571-9082-33e4d4ea3daa" (UID: "68500e27-b83c-4571-9082-33e4d4ea3daa"). InnerVolumeSpecName "kube-api-access-mh4hs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:54:35 crc kubenswrapper[5120]: I0316 16:54:35.638699 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68500e27-b83c-4571-9082-33e4d4ea3daa-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "68500e27-b83c-4571-9082-33e4d4ea3daa" (UID: "68500e27-b83c-4571-9082-33e4d4ea3daa"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:54:35 crc kubenswrapper[5120]: I0316 16:54:35.644924 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68500e27-b83c-4571-9082-33e4d4ea3daa-config-data" (OuterVolumeSpecName: "config-data") pod "68500e27-b83c-4571-9082-33e4d4ea3daa" (UID: "68500e27-b83c-4571-9082-33e4d4ea3daa"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:54:35 crc kubenswrapper[5120]: I0316 16:54:35.659305 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68500e27-b83c-4571-9082-33e4d4ea3daa-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "68500e27-b83c-4571-9082-33e4d4ea3daa" (UID: "68500e27-b83c-4571-9082-33e4d4ea3daa"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:54:35 crc kubenswrapper[5120]: I0316 16:54:35.659663 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68500e27-b83c-4571-9082-33e4d4ea3daa-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "68500e27-b83c-4571-9082-33e4d4ea3daa" (UID: "68500e27-b83c-4571-9082-33e4d4ea3daa"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:54:35 crc kubenswrapper[5120]: I0316 16:54:35.710217 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mh4hs\" (UniqueName: \"kubernetes.io/projected/68500e27-b83c-4571-9082-33e4d4ea3daa-kube-api-access-mh4hs\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:35 crc kubenswrapper[5120]: I0316 16:54:35.710268 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/68500e27-b83c-4571-9082-33e4d4ea3daa-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:35 crc kubenswrapper[5120]: I0316 16:54:35.710278 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/68500e27-b83c-4571-9082-33e4d4ea3daa-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:35 crc kubenswrapper[5120]: I0316 16:54:35.710287 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/68500e27-b83c-4571-9082-33e4d4ea3daa-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:35 crc kubenswrapper[5120]: I0316 16:54:35.710299 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/68500e27-b83c-4571-9082-33e4d4ea3daa-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:35 crc kubenswrapper[5120]: I0316 16:54:35.710310 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/68500e27-b83c-4571-9082-33e4d4ea3daa-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:35 crc kubenswrapper[5120]: I0316 16:54:35.846187 5120 generic.go:358] "Generic (PLEG): container finished" podID="68500e27-b83c-4571-9082-33e4d4ea3daa" containerID="b8c750b5630561dadd8fe003305591597e02831287265cd47e72211c29c25d34" exitCode=0 Mar 16 16:54:35 crc kubenswrapper[5120]: I0316 16:54:35.846260 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"68500e27-b83c-4571-9082-33e4d4ea3daa","Type":"ContainerDied","Data":"b8c750b5630561dadd8fe003305591597e02831287265cd47e72211c29c25d34"} Mar 16 16:54:35 crc kubenswrapper[5120]: I0316 16:54:35.846303 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:54:35 crc kubenswrapper[5120]: I0316 16:54:35.846329 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"68500e27-b83c-4571-9082-33e4d4ea3daa","Type":"ContainerDied","Data":"e56e5e3cbe5826477177d9b0442f9931ba2185d71df3c478c6756295e2ea8fff"} Mar 16 16:54:35 crc kubenswrapper[5120]: I0316 16:54:35.846356 5120 scope.go:117] "RemoveContainer" containerID="b8c750b5630561dadd8fe003305591597e02831287265cd47e72211c29c25d34" Mar 16 16:54:35 crc kubenswrapper[5120]: I0316 16:54:35.868284 5120 scope.go:117] "RemoveContainer" containerID="53a6aa2de43f8168ef62391d386a5d327dfda0a9256f9e9ab874619195e3c722" Mar 16 16:54:35 crc kubenswrapper[5120]: I0316 16:54:35.886934 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:54:35 crc kubenswrapper[5120]: I0316 16:54:35.896965 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:54:35 crc kubenswrapper[5120]: I0316 16:54:35.901385 5120 scope.go:117] "RemoveContainer" containerID="b8c750b5630561dadd8fe003305591597e02831287265cd47e72211c29c25d34" Mar 16 16:54:35 crc kubenswrapper[5120]: E0316 16:54:35.901950 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b8c750b5630561dadd8fe003305591597e02831287265cd47e72211c29c25d34\": container with ID starting with b8c750b5630561dadd8fe003305591597e02831287265cd47e72211c29c25d34 not found: ID does not exist" containerID="b8c750b5630561dadd8fe003305591597e02831287265cd47e72211c29c25d34" Mar 16 16:54:35 crc kubenswrapper[5120]: I0316 16:54:35.901994 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8c750b5630561dadd8fe003305591597e02831287265cd47e72211c29c25d34"} err="failed to get container status \"b8c750b5630561dadd8fe003305591597e02831287265cd47e72211c29c25d34\": rpc error: code = NotFound desc = could not find container \"b8c750b5630561dadd8fe003305591597e02831287265cd47e72211c29c25d34\": container with ID starting with b8c750b5630561dadd8fe003305591597e02831287265cd47e72211c29c25d34 not found: ID does not exist" Mar 16 16:54:35 crc kubenswrapper[5120]: I0316 16:54:35.902022 5120 scope.go:117] "RemoveContainer" containerID="53a6aa2de43f8168ef62391d386a5d327dfda0a9256f9e9ab874619195e3c722" Mar 16 16:54:35 crc kubenswrapper[5120]: E0316 16:54:35.902853 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"53a6aa2de43f8168ef62391d386a5d327dfda0a9256f9e9ab874619195e3c722\": container with ID starting with 53a6aa2de43f8168ef62391d386a5d327dfda0a9256f9e9ab874619195e3c722 not found: ID does not exist" containerID="53a6aa2de43f8168ef62391d386a5d327dfda0a9256f9e9ab874619195e3c722" Mar 16 16:54:35 crc kubenswrapper[5120]: I0316 16:54:35.902896 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53a6aa2de43f8168ef62391d386a5d327dfda0a9256f9e9ab874619195e3c722"} err="failed to get container status \"53a6aa2de43f8168ef62391d386a5d327dfda0a9256f9e9ab874619195e3c722\": rpc error: code = NotFound desc = could not find container \"53a6aa2de43f8168ef62391d386a5d327dfda0a9256f9e9ab874619195e3c722\": container with ID starting with 53a6aa2de43f8168ef62391d386a5d327dfda0a9256f9e9ab874619195e3c722 not found: ID does not exist" Mar 16 16:54:36 crc kubenswrapper[5120]: I0316 16:54:36.677674 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="68500e27-b83c-4571-9082-33e4d4ea3daa" path="/var/lib/kubelet/pods/68500e27-b83c-4571-9082-33e4d4ea3daa/volumes" Mar 16 16:54:36 crc kubenswrapper[5120]: I0316 16:54:36.679133 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d20086a2-b461-4ca6-b442-f1c1782b833d" path="/var/lib/kubelet/pods/d20086a2-b461-4ca6-b442-f1c1782b833d/volumes" Mar 16 16:54:37 crc kubenswrapper[5120]: E0316 16:54:37.460534 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a1c6c6eaee5b058049bbad3a58ced751fece0e218cfd6faf64607f644b0f5ef7" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:54:37 crc kubenswrapper[5120]: E0316 16:54:37.462338 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a1c6c6eaee5b058049bbad3a58ced751fece0e218cfd6faf64607f644b0f5ef7" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:54:37 crc kubenswrapper[5120]: E0316 16:54:37.463738 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a1c6c6eaee5b058049bbad3a58ced751fece0e218cfd6faf64607f644b0f5ef7" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:54:37 crc kubenswrapper[5120]: E0316 16:54:37.463829 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="67ab3338-c88c-4faf-8d25-809c92d661d9" containerName="nova-cell1-conductor-conductor" probeResult="unknown" Mar 16 16:54:37 crc kubenswrapper[5120]: I0316 16:54:37.664001 5120 scope.go:117] "RemoveContainer" containerID="083f72646c8d47c9c0467b39be99ddfa9c2e5900ae0a29ad53d7b39b950274b4" Mar 16 16:54:37 crc kubenswrapper[5120]: E0316 16:54:37.664237 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:54:38 crc kubenswrapper[5120]: E0316 16:54:38.217009 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="98f2961dcc312facfab09ff595793480ed2af349689afceae531c8d93b77cfb7" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:54:38 crc kubenswrapper[5120]: E0316 16:54:38.218435 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="98f2961dcc312facfab09ff595793480ed2af349689afceae531c8d93b77cfb7" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:54:38 crc kubenswrapper[5120]: E0316 16:54:38.220062 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="98f2961dcc312facfab09ff595793480ed2af349689afceae531c8d93b77cfb7" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:54:38 crc kubenswrapper[5120]: E0316 16:54:38.220105 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="de073433-40f2-40c4-ba26-ae8be3817e67" containerName="nova-scheduler-scheduler" probeResult="unknown" Mar 16 16:54:38 crc kubenswrapper[5120]: E0316 16:54:38.535396 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="ee30dfd8af3af59f37f37ec99d41afa1ec85248596d20c9e31406083d8a749b1" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:54:38 crc kubenswrapper[5120]: E0316 16:54:38.536890 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="ee30dfd8af3af59f37f37ec99d41afa1ec85248596d20c9e31406083d8a749b1" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:54:38 crc kubenswrapper[5120]: E0316 16:54:38.539183 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="ee30dfd8af3af59f37f37ec99d41afa1ec85248596d20c9e31406083d8a749b1" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:54:38 crc kubenswrapper[5120]: E0316 16:54:38.539253 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="802ef826-c6e7-4a1c-90a6-b419b9489007" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 16:54:39 crc kubenswrapper[5120]: I0316 16:54:39.086562 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6cc498cb5c-zdb8r" podUID="d20086a2-b461-4ca6-b442-f1c1782b833d" containerName="dnsmasq-dns" probeResult="failure" output="dial tcp 10.217.0.200:5353: i/o timeout" Mar 16 16:54:42 crc kubenswrapper[5120]: E0316 16:54:42.465278 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a1c6c6eaee5b058049bbad3a58ced751fece0e218cfd6faf64607f644b0f5ef7" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:54:42 crc kubenswrapper[5120]: E0316 16:54:42.468245 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a1c6c6eaee5b058049bbad3a58ced751fece0e218cfd6faf64607f644b0f5ef7" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:54:42 crc kubenswrapper[5120]: E0316 16:54:42.469969 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a1c6c6eaee5b058049bbad3a58ced751fece0e218cfd6faf64607f644b0f5ef7" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:54:42 crc kubenswrapper[5120]: E0316 16:54:42.470032 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="67ab3338-c88c-4faf-8d25-809c92d661d9" containerName="nova-cell1-conductor-conductor" probeResult="unknown" Mar 16 16:54:43 crc kubenswrapper[5120]: E0316 16:54:43.218018 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="98f2961dcc312facfab09ff595793480ed2af349689afceae531c8d93b77cfb7" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:54:43 crc kubenswrapper[5120]: E0316 16:54:43.220622 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="98f2961dcc312facfab09ff595793480ed2af349689afceae531c8d93b77cfb7" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:54:43 crc kubenswrapper[5120]: E0316 16:54:43.222236 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="98f2961dcc312facfab09ff595793480ed2af349689afceae531c8d93b77cfb7" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:54:43 crc kubenswrapper[5120]: E0316 16:54:43.222373 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="de073433-40f2-40c4-ba26-ae8be3817e67" containerName="nova-scheduler-scheduler" probeResult="unknown" Mar 16 16:54:43 crc kubenswrapper[5120]: E0316 16:54:43.536886 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="ee30dfd8af3af59f37f37ec99d41afa1ec85248596d20c9e31406083d8a749b1" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:54:43 crc kubenswrapper[5120]: E0316 16:54:43.538292 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="ee30dfd8af3af59f37f37ec99d41afa1ec85248596d20c9e31406083d8a749b1" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:54:43 crc kubenswrapper[5120]: E0316 16:54:43.539709 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="ee30dfd8af3af59f37f37ec99d41afa1ec85248596d20c9e31406083d8a749b1" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:54:43 crc kubenswrapper[5120]: E0316 16:54:43.540175 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="802ef826-c6e7-4a1c-90a6-b419b9489007" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 16:54:47 crc kubenswrapper[5120]: E0316 16:54:47.460755 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a1c6c6eaee5b058049bbad3a58ced751fece0e218cfd6faf64607f644b0f5ef7" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:54:47 crc kubenswrapper[5120]: E0316 16:54:47.463409 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a1c6c6eaee5b058049bbad3a58ced751fece0e218cfd6faf64607f644b0f5ef7" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:54:47 crc kubenswrapper[5120]: E0316 16:54:47.465389 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a1c6c6eaee5b058049bbad3a58ced751fece0e218cfd6faf64607f644b0f5ef7" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:54:47 crc kubenswrapper[5120]: E0316 16:54:47.465455 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="67ab3338-c88c-4faf-8d25-809c92d661d9" containerName="nova-cell1-conductor-conductor" probeResult="unknown" Mar 16 16:54:48 crc kubenswrapper[5120]: E0316 16:54:48.216602 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="98f2961dcc312facfab09ff595793480ed2af349689afceae531c8d93b77cfb7" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:54:48 crc kubenswrapper[5120]: E0316 16:54:48.219032 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="98f2961dcc312facfab09ff595793480ed2af349689afceae531c8d93b77cfb7" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:54:48 crc kubenswrapper[5120]: E0316 16:54:48.220697 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="98f2961dcc312facfab09ff595793480ed2af349689afceae531c8d93b77cfb7" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:54:48 crc kubenswrapper[5120]: E0316 16:54:48.220889 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="de073433-40f2-40c4-ba26-ae8be3817e67" containerName="nova-scheduler-scheduler" probeResult="unknown" Mar 16 16:54:48 crc kubenswrapper[5120]: E0316 16:54:48.535399 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="ee30dfd8af3af59f37f37ec99d41afa1ec85248596d20c9e31406083d8a749b1" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:54:48 crc kubenswrapper[5120]: E0316 16:54:48.539312 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="ee30dfd8af3af59f37f37ec99d41afa1ec85248596d20c9e31406083d8a749b1" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:54:48 crc kubenswrapper[5120]: E0316 16:54:48.541225 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="ee30dfd8af3af59f37f37ec99d41afa1ec85248596d20c9e31406083d8a749b1" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:54:48 crc kubenswrapper[5120]: E0316 16:54:48.541458 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="802ef826-c6e7-4a1c-90a6-b419b9489007" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 16:54:50 crc kubenswrapper[5120]: I0316 16:54:50.666325 5120 scope.go:117] "RemoveContainer" containerID="083f72646c8d47c9c0467b39be99ddfa9c2e5900ae0a29ad53d7b39b950274b4" Mar 16 16:54:50 crc kubenswrapper[5120]: E0316 16:54:50.666997 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:54:50 crc kubenswrapper[5120]: I0316 16:54:50.857282 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:54:50 crc kubenswrapper[5120]: I0316 16:54:50.883901 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xmw6p\" (UniqueName: \"kubernetes.io/projected/bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a-kube-api-access-xmw6p\") pod \"bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a\" (UID: \"bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a\") " Mar 16 16:54:50 crc kubenswrapper[5120]: I0316 16:54:50.883968 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a-lock\") pod \"bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a\" (UID: \"bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a\") " Mar 16 16:54:50 crc kubenswrapper[5120]: I0316 16:54:50.884007 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"swift\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a\" (UID: \"bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a\") " Mar 16 16:54:50 crc kubenswrapper[5120]: I0316 16:54:50.884058 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a-cache\") pod \"bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a\" (UID: \"bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a\") " Mar 16 16:54:50 crc kubenswrapper[5120]: I0316 16:54:50.884118 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a-etc-swift\") pod \"bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a\" (UID: \"bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a\") " Mar 16 16:54:50 crc kubenswrapper[5120]: I0316 16:54:50.884246 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a-combined-ca-bundle\") pod \"bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a\" (UID: \"bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a\") " Mar 16 16:54:50 crc kubenswrapper[5120]: I0316 16:54:50.884855 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a-lock" (OuterVolumeSpecName: "lock") pod "bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a" (UID: "bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a"). InnerVolumeSpecName "lock". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:54:50 crc kubenswrapper[5120]: I0316 16:54:50.885069 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a-cache" (OuterVolumeSpecName: "cache") pod "bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a" (UID: "bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a"). InnerVolumeSpecName "cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:54:50 crc kubenswrapper[5120]: I0316 16:54:50.901142 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage05-crc" (OuterVolumeSpecName: "swift") pod "bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a" (UID: "bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a"). InnerVolumeSpecName "local-storage05-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:54:50 crc kubenswrapper[5120]: I0316 16:54:50.921539 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a-kube-api-access-xmw6p" (OuterVolumeSpecName: "kube-api-access-xmw6p") pod "bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a" (UID: "bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a"). InnerVolumeSpecName "kube-api-access-xmw6p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:54:50 crc kubenswrapper[5120]: I0316 16:54:50.921597 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a-etc-swift" (OuterVolumeSpecName: "etc-swift") pod "bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a" (UID: "bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a"). InnerVolumeSpecName "etc-swift". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:54:50 crc kubenswrapper[5120]: I0316 16:54:50.986998 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xmw6p\" (UniqueName: \"kubernetes.io/projected/bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a-kube-api-access-xmw6p\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:50 crc kubenswrapper[5120]: I0316 16:54:50.987082 5120 reconciler_common.go:299] "Volume detached for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a-lock\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:50 crc kubenswrapper[5120]: I0316 16:54:50.987128 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") on node \"crc\" " Mar 16 16:54:50 crc kubenswrapper[5120]: I0316 16:54:50.987142 5120 reconciler_common.go:299] "Volume detached for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a-cache\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:50 crc kubenswrapper[5120]: I0316 16:54:50.987154 5120 reconciler_common.go:299] "Volume detached for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a-etc-swift\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:51 crc kubenswrapper[5120]: I0316 16:54:51.007370 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage05-crc" (UniqueName: "kubernetes.io/local-volume/local-storage05-crc") on node "crc" Mar 16 16:54:51 crc kubenswrapper[5120]: I0316 16:54:51.014927 5120 generic.go:358] "Generic (PLEG): container finished" podID="48f680c8-5737-416a-ab55-2c7fcf32c0e2" containerID="1be054665a55eb640a7520c6ccc788bd4c6aba09dae7de9eeee45a6e2ef73e77" exitCode=137 Mar 16 16:54:51 crc kubenswrapper[5120]: I0316 16:54:51.015111 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"48f680c8-5737-416a-ab55-2c7fcf32c0e2","Type":"ContainerDied","Data":"1be054665a55eb640a7520c6ccc788bd4c6aba09dae7de9eeee45a6e2ef73e77"} Mar 16 16:54:51 crc kubenswrapper[5120]: I0316 16:54:51.020319 5120 generic.go:358] "Generic (PLEG): container finished" podID="bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a" containerID="bed82f9abe1ca53e6b5e475ed1549a3f0b682f1ae8442d502cbf08bcf4376794" exitCode=137 Mar 16 16:54:51 crc kubenswrapper[5120]: I0316 16:54:51.020791 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a","Type":"ContainerDied","Data":"bed82f9abe1ca53e6b5e475ed1549a3f0b682f1ae8442d502cbf08bcf4376794"} Mar 16 16:54:51 crc kubenswrapper[5120]: I0316 16:54:51.020831 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a","Type":"ContainerDied","Data":"590c41b84ccf90757c27a886f3e174ee311c12b245dd7ea9430d9f980f313934"} Mar 16 16:54:51 crc kubenswrapper[5120]: I0316 16:54:51.020849 5120 scope.go:117] "RemoveContainer" containerID="bed82f9abe1ca53e6b5e475ed1549a3f0b682f1ae8442d502cbf08bcf4376794" Mar 16 16:54:51 crc kubenswrapper[5120]: I0316 16:54:51.021071 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:54:51 crc kubenswrapper[5120]: I0316 16:54:51.054750 5120 scope.go:117] "RemoveContainer" containerID="9654f347f34ca84be3b59cba15e0fac1abebc6019b67f4cedd8ccd90b36b6475" Mar 16 16:54:51 crc kubenswrapper[5120]: I0316 16:54:51.085943 5120 scope.go:117] "RemoveContainer" containerID="f16bf633e499694d3f9b72799502d14d9077fcee087448051bbfe3c7ee1a846a" Mar 16 16:54:51 crc kubenswrapper[5120]: I0316 16:54:51.090255 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:51 crc kubenswrapper[5120]: I0316 16:54:51.126064 5120 scope.go:117] "RemoveContainer" containerID="2454d54900356215b328078c989b7ee2ba76bf00e907810455592dd0328d3607" Mar 16 16:54:51 crc kubenswrapper[5120]: I0316 16:54:51.170696 5120 scope.go:117] "RemoveContainer" containerID="5aa2c642ff9b32cbd48cdd175341bc53df8e83fb47b3006102567a681eb9fe12" Mar 16 16:54:51 crc kubenswrapper[5120]: I0316 16:54:51.212263 5120 scope.go:117] "RemoveContainer" containerID="8ae45574f24cf4187ebc4c1968f20b78b90badf1d3289e58e00075a12b7f4aaf" Mar 16 16:54:51 crc kubenswrapper[5120]: I0316 16:54:51.234313 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:54:51 crc kubenswrapper[5120]: I0316 16:54:51.245052 5120 scope.go:117] "RemoveContainer" containerID="2cfafdd940355b0c9ef3bd22588f683e31e9b9ae011f465bc5afd07315f80340" Mar 16 16:54:51 crc kubenswrapper[5120]: I0316 16:54:51.274325 5120 scope.go:117] "RemoveContainer" containerID="49c026b13207a7e4d1fe5b1529024ced01e29f9e430a662852633085f308ba6d" Mar 16 16:54:51 crc kubenswrapper[5120]: I0316 16:54:51.294726 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/48f680c8-5737-416a-ab55-2c7fcf32c0e2-config-data-custom\") pod \"48f680c8-5737-416a-ab55-2c7fcf32c0e2\" (UID: \"48f680c8-5737-416a-ab55-2c7fcf32c0e2\") " Mar 16 16:54:51 crc kubenswrapper[5120]: I0316 16:54:51.295654 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/48f680c8-5737-416a-ab55-2c7fcf32c0e2-config-data\") pod \"48f680c8-5737-416a-ab55-2c7fcf32c0e2\" (UID: \"48f680c8-5737-416a-ab55-2c7fcf32c0e2\") " Mar 16 16:54:51 crc kubenswrapper[5120]: I0316 16:54:51.300294 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48f680c8-5737-416a-ab55-2c7fcf32c0e2-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "48f680c8-5737-416a-ab55-2c7fcf32c0e2" (UID: "48f680c8-5737-416a-ab55-2c7fcf32c0e2"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:54:51 crc kubenswrapper[5120]: I0316 16:54:51.300381 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a" (UID: "bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:54:51 crc kubenswrapper[5120]: I0316 16:54:51.301127 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/48f680c8-5737-416a-ab55-2c7fcf32c0e2-etc-machine-id\") pod \"48f680c8-5737-416a-ab55-2c7fcf32c0e2\" (UID: \"48f680c8-5737-416a-ab55-2c7fcf32c0e2\") " Mar 16 16:54:51 crc kubenswrapper[5120]: I0316 16:54:51.301252 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/48f680c8-5737-416a-ab55-2c7fcf32c0e2-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "48f680c8-5737-416a-ab55-2c7fcf32c0e2" (UID: "48f680c8-5737-416a-ab55-2c7fcf32c0e2"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 16:54:51 crc kubenswrapper[5120]: I0316 16:54:51.301347 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a-combined-ca-bundle\") pod \"bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a\" (UID: \"bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a\") " Mar 16 16:54:51 crc kubenswrapper[5120]: I0316 16:54:51.301398 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/48f680c8-5737-416a-ab55-2c7fcf32c0e2-combined-ca-bundle\") pod \"48f680c8-5737-416a-ab55-2c7fcf32c0e2\" (UID: \"48f680c8-5737-416a-ab55-2c7fcf32c0e2\") " Mar 16 16:54:51 crc kubenswrapper[5120]: I0316 16:54:51.301463 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/48f680c8-5737-416a-ab55-2c7fcf32c0e2-scripts\") pod \"48f680c8-5737-416a-ab55-2c7fcf32c0e2\" (UID: \"48f680c8-5737-416a-ab55-2c7fcf32c0e2\") " Mar 16 16:54:51 crc kubenswrapper[5120]: I0316 16:54:51.301606 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qg52l\" (UniqueName: \"kubernetes.io/projected/48f680c8-5737-416a-ab55-2c7fcf32c0e2-kube-api-access-qg52l\") pod \"48f680c8-5737-416a-ab55-2c7fcf32c0e2\" (UID: \"48f680c8-5737-416a-ab55-2c7fcf32c0e2\") " Mar 16 16:54:51 crc kubenswrapper[5120]: I0316 16:54:51.302932 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/48f680c8-5737-416a-ab55-2c7fcf32c0e2-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:51 crc kubenswrapper[5120]: I0316 16:54:51.302979 5120 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/48f680c8-5737-416a-ab55-2c7fcf32c0e2-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:51 crc kubenswrapper[5120]: I0316 16:54:51.306362 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48f680c8-5737-416a-ab55-2c7fcf32c0e2-kube-api-access-qg52l" (OuterVolumeSpecName: "kube-api-access-qg52l") pod "48f680c8-5737-416a-ab55-2c7fcf32c0e2" (UID: "48f680c8-5737-416a-ab55-2c7fcf32c0e2"). InnerVolumeSpecName "kube-api-access-qg52l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:54:51 crc kubenswrapper[5120]: W0316 16:54:51.306806 5120 empty_dir.go:511] Warning: Unmount skipped because path does not exist: /var/lib/kubelet/pods/bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a/volumes/kubernetes.io~secret/combined-ca-bundle Mar 16 16:54:51 crc kubenswrapper[5120]: I0316 16:54:51.306836 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a" (UID: "bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:54:51 crc kubenswrapper[5120]: I0316 16:54:51.306928 5120 scope.go:117] "RemoveContainer" containerID="554f007f0035801c2403921329abc993a0f8616e35fd0592c4e77e8f5133ccb6" Mar 16 16:54:51 crc kubenswrapper[5120]: I0316 16:54:51.310066 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48f680c8-5737-416a-ab55-2c7fcf32c0e2-scripts" (OuterVolumeSpecName: "scripts") pod "48f680c8-5737-416a-ab55-2c7fcf32c0e2" (UID: "48f680c8-5737-416a-ab55-2c7fcf32c0e2"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:54:51 crc kubenswrapper[5120]: I0316 16:54:51.327856 5120 scope.go:117] "RemoveContainer" containerID="49757f02afc4e3f6e201e4726f9a770efb96bca7046b78c5b0456df02c9b9973" Mar 16 16:54:51 crc kubenswrapper[5120]: I0316 16:54:51.336023 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/neutron-7b9f48f6c8-rfj5g" podUID="eb34a81f-663e-4027-bf2c-1d334bd06ba4" containerName="neutron-httpd" probeResult="failure" output="Get \"https://10.217.0.179:9696/\": dial tcp 10.217.0.179:9696: connect: connection refused" Mar 16 16:54:51 crc kubenswrapper[5120]: I0316 16:54:51.359792 5120 scope.go:117] "RemoveContainer" containerID="749a177740837a342b9536a7af62a8f69e41d5084bf108b901c90c18c3dbe68d" Mar 16 16:54:51 crc kubenswrapper[5120]: I0316 16:54:51.364156 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 16:54:51 crc kubenswrapper[5120]: I0316 16:54:51.370632 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48f680c8-5737-416a-ab55-2c7fcf32c0e2-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "48f680c8-5737-416a-ab55-2c7fcf32c0e2" (UID: "48f680c8-5737-416a-ab55-2c7fcf32c0e2"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:54:51 crc kubenswrapper[5120]: I0316 16:54:51.371714 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 16:54:51 crc kubenswrapper[5120]: I0316 16:54:51.389317 5120 scope.go:117] "RemoveContainer" containerID="5824335e776fc051905fc3da3116a19441d8ccddf48562f51769a8e960b3094b" Mar 16 16:54:51 crc kubenswrapper[5120]: I0316 16:54:51.396743 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48f680c8-5737-416a-ab55-2c7fcf32c0e2-config-data" (OuterVolumeSpecName: "config-data") pod "48f680c8-5737-416a-ab55-2c7fcf32c0e2" (UID: "48f680c8-5737-416a-ab55-2c7fcf32c0e2"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:54:51 crc kubenswrapper[5120]: I0316 16:54:51.404888 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:51 crc kubenswrapper[5120]: I0316 16:54:51.404921 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/48f680c8-5737-416a-ab55-2c7fcf32c0e2-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:51 crc kubenswrapper[5120]: I0316 16:54:51.404932 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/48f680c8-5737-416a-ab55-2c7fcf32c0e2-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:51 crc kubenswrapper[5120]: I0316 16:54:51.404941 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qg52l\" (UniqueName: \"kubernetes.io/projected/48f680c8-5737-416a-ab55-2c7fcf32c0e2-kube-api-access-qg52l\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:51 crc kubenswrapper[5120]: I0316 16:54:51.404951 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/48f680c8-5737-416a-ab55-2c7fcf32c0e2-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:51 crc kubenswrapper[5120]: I0316 16:54:51.411621 5120 scope.go:117] "RemoveContainer" containerID="5d46cbd0fdd4c39dd4e954ede4e74df9712ffe1d057d4db2ab6df41eb7838bfc" Mar 16 16:54:51 crc kubenswrapper[5120]: I0316 16:54:51.678602 5120 scope.go:117] "RemoveContainer" containerID="f2f18037c204777302f8e785f799d372046706b80e5745c02575b4fd86dd582e" Mar 16 16:54:51 crc kubenswrapper[5120]: I0316 16:54:51.712811 5120 scope.go:117] "RemoveContainer" containerID="fd7d7a93b6338f5f1cb87f0080e397a13c05990ec35fc7410c95850dd2ceddc0" Mar 16 16:54:51 crc kubenswrapper[5120]: I0316 16:54:51.742147 5120 scope.go:117] "RemoveContainer" containerID="bed82f9abe1ca53e6b5e475ed1549a3f0b682f1ae8442d502cbf08bcf4376794" Mar 16 16:54:51 crc kubenswrapper[5120]: E0316 16:54:51.742777 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bed82f9abe1ca53e6b5e475ed1549a3f0b682f1ae8442d502cbf08bcf4376794\": container with ID starting with bed82f9abe1ca53e6b5e475ed1549a3f0b682f1ae8442d502cbf08bcf4376794 not found: ID does not exist" containerID="bed82f9abe1ca53e6b5e475ed1549a3f0b682f1ae8442d502cbf08bcf4376794" Mar 16 16:54:51 crc kubenswrapper[5120]: I0316 16:54:51.742811 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bed82f9abe1ca53e6b5e475ed1549a3f0b682f1ae8442d502cbf08bcf4376794"} err="failed to get container status \"bed82f9abe1ca53e6b5e475ed1549a3f0b682f1ae8442d502cbf08bcf4376794\": rpc error: code = NotFound desc = could not find container \"bed82f9abe1ca53e6b5e475ed1549a3f0b682f1ae8442d502cbf08bcf4376794\": container with ID starting with bed82f9abe1ca53e6b5e475ed1549a3f0b682f1ae8442d502cbf08bcf4376794 not found: ID does not exist" Mar 16 16:54:51 crc kubenswrapper[5120]: I0316 16:54:51.742832 5120 scope.go:117] "RemoveContainer" containerID="9654f347f34ca84be3b59cba15e0fac1abebc6019b67f4cedd8ccd90b36b6475" Mar 16 16:54:51 crc kubenswrapper[5120]: E0316 16:54:51.743206 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9654f347f34ca84be3b59cba15e0fac1abebc6019b67f4cedd8ccd90b36b6475\": container with ID starting with 9654f347f34ca84be3b59cba15e0fac1abebc6019b67f4cedd8ccd90b36b6475 not found: ID does not exist" containerID="9654f347f34ca84be3b59cba15e0fac1abebc6019b67f4cedd8ccd90b36b6475" Mar 16 16:54:51 crc kubenswrapper[5120]: I0316 16:54:51.743247 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9654f347f34ca84be3b59cba15e0fac1abebc6019b67f4cedd8ccd90b36b6475"} err="failed to get container status \"9654f347f34ca84be3b59cba15e0fac1abebc6019b67f4cedd8ccd90b36b6475\": rpc error: code = NotFound desc = could not find container \"9654f347f34ca84be3b59cba15e0fac1abebc6019b67f4cedd8ccd90b36b6475\": container with ID starting with 9654f347f34ca84be3b59cba15e0fac1abebc6019b67f4cedd8ccd90b36b6475 not found: ID does not exist" Mar 16 16:54:51 crc kubenswrapper[5120]: I0316 16:54:51.743265 5120 scope.go:117] "RemoveContainer" containerID="f16bf633e499694d3f9b72799502d14d9077fcee087448051bbfe3c7ee1a846a" Mar 16 16:54:51 crc kubenswrapper[5120]: E0316 16:54:51.743467 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f16bf633e499694d3f9b72799502d14d9077fcee087448051bbfe3c7ee1a846a\": container with ID starting with f16bf633e499694d3f9b72799502d14d9077fcee087448051bbfe3c7ee1a846a not found: ID does not exist" containerID="f16bf633e499694d3f9b72799502d14d9077fcee087448051bbfe3c7ee1a846a" Mar 16 16:54:51 crc kubenswrapper[5120]: I0316 16:54:51.743491 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f16bf633e499694d3f9b72799502d14d9077fcee087448051bbfe3c7ee1a846a"} err="failed to get container status \"f16bf633e499694d3f9b72799502d14d9077fcee087448051bbfe3c7ee1a846a\": rpc error: code = NotFound desc = could not find container \"f16bf633e499694d3f9b72799502d14d9077fcee087448051bbfe3c7ee1a846a\": container with ID starting with f16bf633e499694d3f9b72799502d14d9077fcee087448051bbfe3c7ee1a846a not found: ID does not exist" Mar 16 16:54:51 crc kubenswrapper[5120]: I0316 16:54:51.743503 5120 scope.go:117] "RemoveContainer" containerID="2454d54900356215b328078c989b7ee2ba76bf00e907810455592dd0328d3607" Mar 16 16:54:51 crc kubenswrapper[5120]: E0316 16:54:51.743785 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2454d54900356215b328078c989b7ee2ba76bf00e907810455592dd0328d3607\": container with ID starting with 2454d54900356215b328078c989b7ee2ba76bf00e907810455592dd0328d3607 not found: ID does not exist" containerID="2454d54900356215b328078c989b7ee2ba76bf00e907810455592dd0328d3607" Mar 16 16:54:51 crc kubenswrapper[5120]: I0316 16:54:51.743806 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2454d54900356215b328078c989b7ee2ba76bf00e907810455592dd0328d3607"} err="failed to get container status \"2454d54900356215b328078c989b7ee2ba76bf00e907810455592dd0328d3607\": rpc error: code = NotFound desc = could not find container \"2454d54900356215b328078c989b7ee2ba76bf00e907810455592dd0328d3607\": container with ID starting with 2454d54900356215b328078c989b7ee2ba76bf00e907810455592dd0328d3607 not found: ID does not exist" Mar 16 16:54:51 crc kubenswrapper[5120]: I0316 16:54:51.743817 5120 scope.go:117] "RemoveContainer" containerID="5aa2c642ff9b32cbd48cdd175341bc53df8e83fb47b3006102567a681eb9fe12" Mar 16 16:54:51 crc kubenswrapper[5120]: E0316 16:54:51.744263 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5aa2c642ff9b32cbd48cdd175341bc53df8e83fb47b3006102567a681eb9fe12\": container with ID starting with 5aa2c642ff9b32cbd48cdd175341bc53df8e83fb47b3006102567a681eb9fe12 not found: ID does not exist" containerID="5aa2c642ff9b32cbd48cdd175341bc53df8e83fb47b3006102567a681eb9fe12" Mar 16 16:54:51 crc kubenswrapper[5120]: I0316 16:54:51.744301 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5aa2c642ff9b32cbd48cdd175341bc53df8e83fb47b3006102567a681eb9fe12"} err="failed to get container status \"5aa2c642ff9b32cbd48cdd175341bc53df8e83fb47b3006102567a681eb9fe12\": rpc error: code = NotFound desc = could not find container \"5aa2c642ff9b32cbd48cdd175341bc53df8e83fb47b3006102567a681eb9fe12\": container with ID starting with 5aa2c642ff9b32cbd48cdd175341bc53df8e83fb47b3006102567a681eb9fe12 not found: ID does not exist" Mar 16 16:54:51 crc kubenswrapper[5120]: I0316 16:54:51.744319 5120 scope.go:117] "RemoveContainer" containerID="8ae45574f24cf4187ebc4c1968f20b78b90badf1d3289e58e00075a12b7f4aaf" Mar 16 16:54:51 crc kubenswrapper[5120]: E0316 16:54:51.744700 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ae45574f24cf4187ebc4c1968f20b78b90badf1d3289e58e00075a12b7f4aaf\": container with ID starting with 8ae45574f24cf4187ebc4c1968f20b78b90badf1d3289e58e00075a12b7f4aaf not found: ID does not exist" containerID="8ae45574f24cf4187ebc4c1968f20b78b90badf1d3289e58e00075a12b7f4aaf" Mar 16 16:54:51 crc kubenswrapper[5120]: I0316 16:54:51.744731 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ae45574f24cf4187ebc4c1968f20b78b90badf1d3289e58e00075a12b7f4aaf"} err="failed to get container status \"8ae45574f24cf4187ebc4c1968f20b78b90badf1d3289e58e00075a12b7f4aaf\": rpc error: code = NotFound desc = could not find container \"8ae45574f24cf4187ebc4c1968f20b78b90badf1d3289e58e00075a12b7f4aaf\": container with ID starting with 8ae45574f24cf4187ebc4c1968f20b78b90badf1d3289e58e00075a12b7f4aaf not found: ID does not exist" Mar 16 16:54:51 crc kubenswrapper[5120]: I0316 16:54:51.744747 5120 scope.go:117] "RemoveContainer" containerID="2cfafdd940355b0c9ef3bd22588f683e31e9b9ae011f465bc5afd07315f80340" Mar 16 16:54:51 crc kubenswrapper[5120]: E0316 16:54:51.745017 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2cfafdd940355b0c9ef3bd22588f683e31e9b9ae011f465bc5afd07315f80340\": container with ID starting with 2cfafdd940355b0c9ef3bd22588f683e31e9b9ae011f465bc5afd07315f80340 not found: ID does not exist" containerID="2cfafdd940355b0c9ef3bd22588f683e31e9b9ae011f465bc5afd07315f80340" Mar 16 16:54:51 crc kubenswrapper[5120]: I0316 16:54:51.745039 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2cfafdd940355b0c9ef3bd22588f683e31e9b9ae011f465bc5afd07315f80340"} err="failed to get container status \"2cfafdd940355b0c9ef3bd22588f683e31e9b9ae011f465bc5afd07315f80340\": rpc error: code = NotFound desc = could not find container \"2cfafdd940355b0c9ef3bd22588f683e31e9b9ae011f465bc5afd07315f80340\": container with ID starting with 2cfafdd940355b0c9ef3bd22588f683e31e9b9ae011f465bc5afd07315f80340 not found: ID does not exist" Mar 16 16:54:51 crc kubenswrapper[5120]: I0316 16:54:51.745058 5120 scope.go:117] "RemoveContainer" containerID="49c026b13207a7e4d1fe5b1529024ced01e29f9e430a662852633085f308ba6d" Mar 16 16:54:51 crc kubenswrapper[5120]: E0316 16:54:51.745313 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"49c026b13207a7e4d1fe5b1529024ced01e29f9e430a662852633085f308ba6d\": container with ID starting with 49c026b13207a7e4d1fe5b1529024ced01e29f9e430a662852633085f308ba6d not found: ID does not exist" containerID="49c026b13207a7e4d1fe5b1529024ced01e29f9e430a662852633085f308ba6d" Mar 16 16:54:51 crc kubenswrapper[5120]: I0316 16:54:51.745328 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49c026b13207a7e4d1fe5b1529024ced01e29f9e430a662852633085f308ba6d"} err="failed to get container status \"49c026b13207a7e4d1fe5b1529024ced01e29f9e430a662852633085f308ba6d\": rpc error: code = NotFound desc = could not find container \"49c026b13207a7e4d1fe5b1529024ced01e29f9e430a662852633085f308ba6d\": container with ID starting with 49c026b13207a7e4d1fe5b1529024ced01e29f9e430a662852633085f308ba6d not found: ID does not exist" Mar 16 16:54:51 crc kubenswrapper[5120]: I0316 16:54:51.745340 5120 scope.go:117] "RemoveContainer" containerID="554f007f0035801c2403921329abc993a0f8616e35fd0592c4e77e8f5133ccb6" Mar 16 16:54:51 crc kubenswrapper[5120]: E0316 16:54:51.745592 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"554f007f0035801c2403921329abc993a0f8616e35fd0592c4e77e8f5133ccb6\": container with ID starting with 554f007f0035801c2403921329abc993a0f8616e35fd0592c4e77e8f5133ccb6 not found: ID does not exist" containerID="554f007f0035801c2403921329abc993a0f8616e35fd0592c4e77e8f5133ccb6" Mar 16 16:54:51 crc kubenswrapper[5120]: I0316 16:54:51.745611 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"554f007f0035801c2403921329abc993a0f8616e35fd0592c4e77e8f5133ccb6"} err="failed to get container status \"554f007f0035801c2403921329abc993a0f8616e35fd0592c4e77e8f5133ccb6\": rpc error: code = NotFound desc = could not find container \"554f007f0035801c2403921329abc993a0f8616e35fd0592c4e77e8f5133ccb6\": container with ID starting with 554f007f0035801c2403921329abc993a0f8616e35fd0592c4e77e8f5133ccb6 not found: ID does not exist" Mar 16 16:54:51 crc kubenswrapper[5120]: I0316 16:54:51.745622 5120 scope.go:117] "RemoveContainer" containerID="49757f02afc4e3f6e201e4726f9a770efb96bca7046b78c5b0456df02c9b9973" Mar 16 16:54:51 crc kubenswrapper[5120]: E0316 16:54:51.745901 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"49757f02afc4e3f6e201e4726f9a770efb96bca7046b78c5b0456df02c9b9973\": container with ID starting with 49757f02afc4e3f6e201e4726f9a770efb96bca7046b78c5b0456df02c9b9973 not found: ID does not exist" containerID="49757f02afc4e3f6e201e4726f9a770efb96bca7046b78c5b0456df02c9b9973" Mar 16 16:54:51 crc kubenswrapper[5120]: I0316 16:54:51.745933 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49757f02afc4e3f6e201e4726f9a770efb96bca7046b78c5b0456df02c9b9973"} err="failed to get container status \"49757f02afc4e3f6e201e4726f9a770efb96bca7046b78c5b0456df02c9b9973\": rpc error: code = NotFound desc = could not find container \"49757f02afc4e3f6e201e4726f9a770efb96bca7046b78c5b0456df02c9b9973\": container with ID starting with 49757f02afc4e3f6e201e4726f9a770efb96bca7046b78c5b0456df02c9b9973 not found: ID does not exist" Mar 16 16:54:51 crc kubenswrapper[5120]: I0316 16:54:51.745954 5120 scope.go:117] "RemoveContainer" containerID="749a177740837a342b9536a7af62a8f69e41d5084bf108b901c90c18c3dbe68d" Mar 16 16:54:51 crc kubenswrapper[5120]: E0316 16:54:51.746240 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"749a177740837a342b9536a7af62a8f69e41d5084bf108b901c90c18c3dbe68d\": container with ID starting with 749a177740837a342b9536a7af62a8f69e41d5084bf108b901c90c18c3dbe68d not found: ID does not exist" containerID="749a177740837a342b9536a7af62a8f69e41d5084bf108b901c90c18c3dbe68d" Mar 16 16:54:51 crc kubenswrapper[5120]: I0316 16:54:51.746261 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"749a177740837a342b9536a7af62a8f69e41d5084bf108b901c90c18c3dbe68d"} err="failed to get container status \"749a177740837a342b9536a7af62a8f69e41d5084bf108b901c90c18c3dbe68d\": rpc error: code = NotFound desc = could not find container \"749a177740837a342b9536a7af62a8f69e41d5084bf108b901c90c18c3dbe68d\": container with ID starting with 749a177740837a342b9536a7af62a8f69e41d5084bf108b901c90c18c3dbe68d not found: ID does not exist" Mar 16 16:54:51 crc kubenswrapper[5120]: I0316 16:54:51.746275 5120 scope.go:117] "RemoveContainer" containerID="5824335e776fc051905fc3da3116a19441d8ccddf48562f51769a8e960b3094b" Mar 16 16:54:51 crc kubenswrapper[5120]: E0316 16:54:51.746489 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5824335e776fc051905fc3da3116a19441d8ccddf48562f51769a8e960b3094b\": container with ID starting with 5824335e776fc051905fc3da3116a19441d8ccddf48562f51769a8e960b3094b not found: ID does not exist" containerID="5824335e776fc051905fc3da3116a19441d8ccddf48562f51769a8e960b3094b" Mar 16 16:54:51 crc kubenswrapper[5120]: I0316 16:54:51.746511 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5824335e776fc051905fc3da3116a19441d8ccddf48562f51769a8e960b3094b"} err="failed to get container status \"5824335e776fc051905fc3da3116a19441d8ccddf48562f51769a8e960b3094b\": rpc error: code = NotFound desc = could not find container \"5824335e776fc051905fc3da3116a19441d8ccddf48562f51769a8e960b3094b\": container with ID starting with 5824335e776fc051905fc3da3116a19441d8ccddf48562f51769a8e960b3094b not found: ID does not exist" Mar 16 16:54:51 crc kubenswrapper[5120]: I0316 16:54:51.746523 5120 scope.go:117] "RemoveContainer" containerID="5d46cbd0fdd4c39dd4e954ede4e74df9712ffe1d057d4db2ab6df41eb7838bfc" Mar 16 16:54:51 crc kubenswrapper[5120]: E0316 16:54:51.746783 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d46cbd0fdd4c39dd4e954ede4e74df9712ffe1d057d4db2ab6df41eb7838bfc\": container with ID starting with 5d46cbd0fdd4c39dd4e954ede4e74df9712ffe1d057d4db2ab6df41eb7838bfc not found: ID does not exist" containerID="5d46cbd0fdd4c39dd4e954ede4e74df9712ffe1d057d4db2ab6df41eb7838bfc" Mar 16 16:54:51 crc kubenswrapper[5120]: I0316 16:54:51.746804 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d46cbd0fdd4c39dd4e954ede4e74df9712ffe1d057d4db2ab6df41eb7838bfc"} err="failed to get container status \"5d46cbd0fdd4c39dd4e954ede4e74df9712ffe1d057d4db2ab6df41eb7838bfc\": rpc error: code = NotFound desc = could not find container \"5d46cbd0fdd4c39dd4e954ede4e74df9712ffe1d057d4db2ab6df41eb7838bfc\": container with ID starting with 5d46cbd0fdd4c39dd4e954ede4e74df9712ffe1d057d4db2ab6df41eb7838bfc not found: ID does not exist" Mar 16 16:54:51 crc kubenswrapper[5120]: I0316 16:54:51.746818 5120 scope.go:117] "RemoveContainer" containerID="f2f18037c204777302f8e785f799d372046706b80e5745c02575b4fd86dd582e" Mar 16 16:54:51 crc kubenswrapper[5120]: E0316 16:54:51.747103 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f2f18037c204777302f8e785f799d372046706b80e5745c02575b4fd86dd582e\": container with ID starting with f2f18037c204777302f8e785f799d372046706b80e5745c02575b4fd86dd582e not found: ID does not exist" containerID="f2f18037c204777302f8e785f799d372046706b80e5745c02575b4fd86dd582e" Mar 16 16:54:51 crc kubenswrapper[5120]: I0316 16:54:51.747123 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2f18037c204777302f8e785f799d372046706b80e5745c02575b4fd86dd582e"} err="failed to get container status \"f2f18037c204777302f8e785f799d372046706b80e5745c02575b4fd86dd582e\": rpc error: code = NotFound desc = could not find container \"f2f18037c204777302f8e785f799d372046706b80e5745c02575b4fd86dd582e\": container with ID starting with f2f18037c204777302f8e785f799d372046706b80e5745c02575b4fd86dd582e not found: ID does not exist" Mar 16 16:54:51 crc kubenswrapper[5120]: I0316 16:54:51.747136 5120 scope.go:117] "RemoveContainer" containerID="fd7d7a93b6338f5f1cb87f0080e397a13c05990ec35fc7410c95850dd2ceddc0" Mar 16 16:54:51 crc kubenswrapper[5120]: E0316 16:54:51.747399 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fd7d7a93b6338f5f1cb87f0080e397a13c05990ec35fc7410c95850dd2ceddc0\": container with ID starting with fd7d7a93b6338f5f1cb87f0080e397a13c05990ec35fc7410c95850dd2ceddc0 not found: ID does not exist" containerID="fd7d7a93b6338f5f1cb87f0080e397a13c05990ec35fc7410c95850dd2ceddc0" Mar 16 16:54:51 crc kubenswrapper[5120]: I0316 16:54:51.747420 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd7d7a93b6338f5f1cb87f0080e397a13c05990ec35fc7410c95850dd2ceddc0"} err="failed to get container status \"fd7d7a93b6338f5f1cb87f0080e397a13c05990ec35fc7410c95850dd2ceddc0\": rpc error: code = NotFound desc = could not find container \"fd7d7a93b6338f5f1cb87f0080e397a13c05990ec35fc7410c95850dd2ceddc0\": container with ID starting with fd7d7a93b6338f5f1cb87f0080e397a13c05990ec35fc7410c95850dd2ceddc0 not found: ID does not exist" Mar 16 16:54:51 crc kubenswrapper[5120]: I0316 16:54:51.874154 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-7b9f48f6c8-rfj5g_eb34a81f-663e-4027-bf2c-1d334bd06ba4/neutron-api/1.log" Mar 16 16:54:51 crc kubenswrapper[5120]: I0316 16:54:51.875367 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-7b9f48f6c8-rfj5g_eb34a81f-663e-4027-bf2c-1d334bd06ba4/neutron-api/0.log" Mar 16 16:54:51 crc kubenswrapper[5120]: I0316 16:54:51.875470 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-7b9f48f6c8-rfj5g" Mar 16 16:54:51 crc kubenswrapper[5120]: I0316 16:54:51.881256 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-9f898f5b6-g9g57_cdf5b2c0-4a53-4c60-a566-d18398c0c560/neutron-api/0.log" Mar 16 16:54:51 crc kubenswrapper[5120]: I0316 16:54:51.881325 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-9f898f5b6-g9g57" Mar 16 16:54:52 crc kubenswrapper[5120]: I0316 16:54:52.017816 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/cdf5b2c0-4a53-4c60-a566-d18398c0c560-config\") pod \"cdf5b2c0-4a53-4c60-a566-d18398c0c560\" (UID: \"cdf5b2c0-4a53-4c60-a566-d18398c0c560\") " Mar 16 16:54:52 crc kubenswrapper[5120]: I0316 16:54:52.017875 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/eb34a81f-663e-4027-bf2c-1d334bd06ba4-config\") pod \"eb34a81f-663e-4027-bf2c-1d334bd06ba4\" (UID: \"eb34a81f-663e-4027-bf2c-1d334bd06ba4\") " Mar 16 16:54:52 crc kubenswrapper[5120]: I0316 16:54:52.017925 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/cdf5b2c0-4a53-4c60-a566-d18398c0c560-internal-tls-certs\") pod \"cdf5b2c0-4a53-4c60-a566-d18398c0c560\" (UID: \"cdf5b2c0-4a53-4c60-a566-d18398c0c560\") " Mar 16 16:54:52 crc kubenswrapper[5120]: I0316 16:54:52.018023 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wm5j9\" (UniqueName: \"kubernetes.io/projected/eb34a81f-663e-4027-bf2c-1d334bd06ba4-kube-api-access-wm5j9\") pod \"eb34a81f-663e-4027-bf2c-1d334bd06ba4\" (UID: \"eb34a81f-663e-4027-bf2c-1d334bd06ba4\") " Mar 16 16:54:52 crc kubenswrapper[5120]: I0316 16:54:52.018101 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/cdf5b2c0-4a53-4c60-a566-d18398c0c560-httpd-config\") pod \"cdf5b2c0-4a53-4c60-a566-d18398c0c560\" (UID: \"cdf5b2c0-4a53-4c60-a566-d18398c0c560\") " Mar 16 16:54:52 crc kubenswrapper[5120]: I0316 16:54:52.018159 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cdf5b2c0-4a53-4c60-a566-d18398c0c560-combined-ca-bundle\") pod \"cdf5b2c0-4a53-4c60-a566-d18398c0c560\" (UID: \"cdf5b2c0-4a53-4c60-a566-d18398c0c560\") " Mar 16 16:54:52 crc kubenswrapper[5120]: I0316 16:54:52.018283 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/eb34a81f-663e-4027-bf2c-1d334bd06ba4-internal-tls-certs\") pod \"eb34a81f-663e-4027-bf2c-1d334bd06ba4\" (UID: \"eb34a81f-663e-4027-bf2c-1d334bd06ba4\") " Mar 16 16:54:52 crc kubenswrapper[5120]: I0316 16:54:52.018322 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6p9s6\" (UniqueName: \"kubernetes.io/projected/cdf5b2c0-4a53-4c60-a566-d18398c0c560-kube-api-access-6p9s6\") pod \"cdf5b2c0-4a53-4c60-a566-d18398c0c560\" (UID: \"cdf5b2c0-4a53-4c60-a566-d18398c0c560\") " Mar 16 16:54:52 crc kubenswrapper[5120]: I0316 16:54:52.018376 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/eb34a81f-663e-4027-bf2c-1d334bd06ba4-ovndb-tls-certs\") pod \"eb34a81f-663e-4027-bf2c-1d334bd06ba4\" (UID: \"eb34a81f-663e-4027-bf2c-1d334bd06ba4\") " Mar 16 16:54:52 crc kubenswrapper[5120]: I0316 16:54:52.018981 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/eb34a81f-663e-4027-bf2c-1d334bd06ba4-public-tls-certs\") pod \"eb34a81f-663e-4027-bf2c-1d334bd06ba4\" (UID: \"eb34a81f-663e-4027-bf2c-1d334bd06ba4\") " Mar 16 16:54:52 crc kubenswrapper[5120]: I0316 16:54:52.019100 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/cdf5b2c0-4a53-4c60-a566-d18398c0c560-ovndb-tls-certs\") pod \"cdf5b2c0-4a53-4c60-a566-d18398c0c560\" (UID: \"cdf5b2c0-4a53-4c60-a566-d18398c0c560\") " Mar 16 16:54:52 crc kubenswrapper[5120]: I0316 16:54:52.019159 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eb34a81f-663e-4027-bf2c-1d334bd06ba4-combined-ca-bundle\") pod \"eb34a81f-663e-4027-bf2c-1d334bd06ba4\" (UID: \"eb34a81f-663e-4027-bf2c-1d334bd06ba4\") " Mar 16 16:54:52 crc kubenswrapper[5120]: I0316 16:54:52.019220 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/cdf5b2c0-4a53-4c60-a566-d18398c0c560-public-tls-certs\") pod \"cdf5b2c0-4a53-4c60-a566-d18398c0c560\" (UID: \"cdf5b2c0-4a53-4c60-a566-d18398c0c560\") " Mar 16 16:54:52 crc kubenswrapper[5120]: I0316 16:54:52.019306 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/eb34a81f-663e-4027-bf2c-1d334bd06ba4-httpd-config\") pod \"eb34a81f-663e-4027-bf2c-1d334bd06ba4\" (UID: \"eb34a81f-663e-4027-bf2c-1d334bd06ba4\") " Mar 16 16:54:52 crc kubenswrapper[5120]: I0316 16:54:52.023861 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb34a81f-663e-4027-bf2c-1d334bd06ba4-kube-api-access-wm5j9" (OuterVolumeSpecName: "kube-api-access-wm5j9") pod "eb34a81f-663e-4027-bf2c-1d334bd06ba4" (UID: "eb34a81f-663e-4027-bf2c-1d334bd06ba4"). InnerVolumeSpecName "kube-api-access-wm5j9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:54:52 crc kubenswrapper[5120]: I0316 16:54:52.035568 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cdf5b2c0-4a53-4c60-a566-d18398c0c560-kube-api-access-6p9s6" (OuterVolumeSpecName: "kube-api-access-6p9s6") pod "cdf5b2c0-4a53-4c60-a566-d18398c0c560" (UID: "cdf5b2c0-4a53-4c60-a566-d18398c0c560"). InnerVolumeSpecName "kube-api-access-6p9s6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:54:52 crc kubenswrapper[5120]: I0316 16:54:52.035677 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cdf5b2c0-4a53-4c60-a566-d18398c0c560-httpd-config" (OuterVolumeSpecName: "httpd-config") pod "cdf5b2c0-4a53-4c60-a566-d18398c0c560" (UID: "cdf5b2c0-4a53-4c60-a566-d18398c0c560"). InnerVolumeSpecName "httpd-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:54:52 crc kubenswrapper[5120]: I0316 16:54:52.043436 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eb34a81f-663e-4027-bf2c-1d334bd06ba4-httpd-config" (OuterVolumeSpecName: "httpd-config") pod "eb34a81f-663e-4027-bf2c-1d334bd06ba4" (UID: "eb34a81f-663e-4027-bf2c-1d334bd06ba4"). InnerVolumeSpecName "httpd-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:54:52 crc kubenswrapper[5120]: I0316 16:54:52.056427 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-9f898f5b6-g9g57_cdf5b2c0-4a53-4c60-a566-d18398c0c560/neutron-api/0.log" Mar 16 16:54:52 crc kubenswrapper[5120]: I0316 16:54:52.056491 5120 generic.go:358] "Generic (PLEG): container finished" podID="cdf5b2c0-4a53-4c60-a566-d18398c0c560" containerID="7acf7b8f3d2c22d03c90e2cc9b9207ac80353b7bf126751bf2eff2f88c0697d8" exitCode=137 Mar 16 16:54:52 crc kubenswrapper[5120]: I0316 16:54:52.056566 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-9f898f5b6-g9g57" Mar 16 16:54:52 crc kubenswrapper[5120]: I0316 16:54:52.057152 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-9f898f5b6-g9g57" event={"ID":"cdf5b2c0-4a53-4c60-a566-d18398c0c560","Type":"ContainerDied","Data":"7acf7b8f3d2c22d03c90e2cc9b9207ac80353b7bf126751bf2eff2f88c0697d8"} Mar 16 16:54:52 crc kubenswrapper[5120]: I0316 16:54:52.057190 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-9f898f5b6-g9g57" event={"ID":"cdf5b2c0-4a53-4c60-a566-d18398c0c560","Type":"ContainerDied","Data":"df898b0de10922feb7b36fd60f394f8e931174b83857c581c6ff95197175f244"} Mar 16 16:54:52 crc kubenswrapper[5120]: I0316 16:54:52.057215 5120 scope.go:117] "RemoveContainer" containerID="365b620ab0a5f5b67686132db3d88ec20960fac4cc2e2d4565362ace99ba2a1d" Mar 16 16:54:52 crc kubenswrapper[5120]: I0316 16:54:52.062061 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-7b9f48f6c8-rfj5g_eb34a81f-663e-4027-bf2c-1d334bd06ba4/neutron-api/1.log" Mar 16 16:54:52 crc kubenswrapper[5120]: I0316 16:54:52.063044 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-7b9f48f6c8-rfj5g_eb34a81f-663e-4027-bf2c-1d334bd06ba4/neutron-api/0.log" Mar 16 16:54:52 crc kubenswrapper[5120]: I0316 16:54:52.063087 5120 generic.go:358] "Generic (PLEG): container finished" podID="eb34a81f-663e-4027-bf2c-1d334bd06ba4" containerID="3d1f3be4762f17a030965d2baf23eb4d3d42161f1123f9faaab941f03ade7875" exitCode=137 Mar 16 16:54:52 crc kubenswrapper[5120]: I0316 16:54:52.063266 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-7b9f48f6c8-rfj5g" event={"ID":"eb34a81f-663e-4027-bf2c-1d334bd06ba4","Type":"ContainerDied","Data":"3d1f3be4762f17a030965d2baf23eb4d3d42161f1123f9faaab941f03ade7875"} Mar 16 16:54:52 crc kubenswrapper[5120]: I0316 16:54:52.063307 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-7b9f48f6c8-rfj5g" event={"ID":"eb34a81f-663e-4027-bf2c-1d334bd06ba4","Type":"ContainerDied","Data":"6716166864b9a3d7ff87e1f2467afa0779d076b8a7ef4978aa9a12328073e443"} Mar 16 16:54:52 crc kubenswrapper[5120]: I0316 16:54:52.063386 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-7b9f48f6c8-rfj5g" Mar 16 16:54:52 crc kubenswrapper[5120]: I0316 16:54:52.067163 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cdf5b2c0-4a53-4c60-a566-d18398c0c560-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "cdf5b2c0-4a53-4c60-a566-d18398c0c560" (UID: "cdf5b2c0-4a53-4c60-a566-d18398c0c560"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:54:52 crc kubenswrapper[5120]: I0316 16:54:52.067969 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:54:52 crc kubenswrapper[5120]: I0316 16:54:52.067995 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"48f680c8-5737-416a-ab55-2c7fcf32c0e2","Type":"ContainerDied","Data":"05cb46374642c72d50f296354dde53c6f00471d337ccdfebea73f5af1faae722"} Mar 16 16:54:52 crc kubenswrapper[5120]: I0316 16:54:52.079623 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eb34a81f-663e-4027-bf2c-1d334bd06ba4-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "eb34a81f-663e-4027-bf2c-1d334bd06ba4" (UID: "eb34a81f-663e-4027-bf2c-1d334bd06ba4"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:54:52 crc kubenswrapper[5120]: I0316 16:54:52.082190 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cdf5b2c0-4a53-4c60-a566-d18398c0c560-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "cdf5b2c0-4a53-4c60-a566-d18398c0c560" (UID: "cdf5b2c0-4a53-4c60-a566-d18398c0c560"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:54:52 crc kubenswrapper[5120]: I0316 16:54:52.083649 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eb34a81f-663e-4027-bf2c-1d334bd06ba4-config" (OuterVolumeSpecName: "config") pod "eb34a81f-663e-4027-bf2c-1d334bd06ba4" (UID: "eb34a81f-663e-4027-bf2c-1d334bd06ba4"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:54:52 crc kubenswrapper[5120]: I0316 16:54:52.084681 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cdf5b2c0-4a53-4c60-a566-d18398c0c560-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "cdf5b2c0-4a53-4c60-a566-d18398c0c560" (UID: "cdf5b2c0-4a53-4c60-a566-d18398c0c560"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:54:52 crc kubenswrapper[5120]: I0316 16:54:52.086271 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eb34a81f-663e-4027-bf2c-1d334bd06ba4-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "eb34a81f-663e-4027-bf2c-1d334bd06ba4" (UID: "eb34a81f-663e-4027-bf2c-1d334bd06ba4"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:54:52 crc kubenswrapper[5120]: I0316 16:54:52.092486 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cdf5b2c0-4a53-4c60-a566-d18398c0c560-config" (OuterVolumeSpecName: "config") pod "cdf5b2c0-4a53-4c60-a566-d18398c0c560" (UID: "cdf5b2c0-4a53-4c60-a566-d18398c0c560"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:54:52 crc kubenswrapper[5120]: I0316 16:54:52.094825 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eb34a81f-663e-4027-bf2c-1d334bd06ba4-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "eb34a81f-663e-4027-bf2c-1d334bd06ba4" (UID: "eb34a81f-663e-4027-bf2c-1d334bd06ba4"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:54:52 crc kubenswrapper[5120]: I0316 16:54:52.103957 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eb34a81f-663e-4027-bf2c-1d334bd06ba4-ovndb-tls-certs" (OuterVolumeSpecName: "ovndb-tls-certs") pod "eb34a81f-663e-4027-bf2c-1d334bd06ba4" (UID: "eb34a81f-663e-4027-bf2c-1d334bd06ba4"). InnerVolumeSpecName "ovndb-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:54:52 crc kubenswrapper[5120]: I0316 16:54:52.127102 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/cdf5b2c0-4a53-4c60-a566-d18398c0c560-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:52 crc kubenswrapper[5120]: I0316 16:54:52.127141 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/eb34a81f-663e-4027-bf2c-1d334bd06ba4-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:52 crc kubenswrapper[5120]: I0316 16:54:52.127159 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/cdf5b2c0-4a53-4c60-a566-d18398c0c560-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:52 crc kubenswrapper[5120]: I0316 16:54:52.127171 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wm5j9\" (UniqueName: \"kubernetes.io/projected/eb34a81f-663e-4027-bf2c-1d334bd06ba4-kube-api-access-wm5j9\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:52 crc kubenswrapper[5120]: I0316 16:54:52.127180 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/cdf5b2c0-4a53-4c60-a566-d18398c0c560-httpd-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:52 crc kubenswrapper[5120]: I0316 16:54:52.127190 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cdf5b2c0-4a53-4c60-a566-d18398c0c560-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:52 crc kubenswrapper[5120]: I0316 16:54:52.127199 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/eb34a81f-663e-4027-bf2c-1d334bd06ba4-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:52 crc kubenswrapper[5120]: I0316 16:54:52.127209 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6p9s6\" (UniqueName: \"kubernetes.io/projected/cdf5b2c0-4a53-4c60-a566-d18398c0c560-kube-api-access-6p9s6\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:52 crc kubenswrapper[5120]: I0316 16:54:52.127219 5120 reconciler_common.go:299] "Volume detached for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/eb34a81f-663e-4027-bf2c-1d334bd06ba4-ovndb-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:52 crc kubenswrapper[5120]: I0316 16:54:52.127228 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/eb34a81f-663e-4027-bf2c-1d334bd06ba4-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:52 crc kubenswrapper[5120]: I0316 16:54:52.127237 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eb34a81f-663e-4027-bf2c-1d334bd06ba4-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:52 crc kubenswrapper[5120]: I0316 16:54:52.127245 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/cdf5b2c0-4a53-4c60-a566-d18398c0c560-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:52 crc kubenswrapper[5120]: I0316 16:54:52.127255 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/eb34a81f-663e-4027-bf2c-1d334bd06ba4-httpd-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:52 crc kubenswrapper[5120]: I0316 16:54:52.128705 5120 scope.go:117] "RemoveContainer" containerID="7acf7b8f3d2c22d03c90e2cc9b9207ac80353b7bf126751bf2eff2f88c0697d8" Mar 16 16:54:52 crc kubenswrapper[5120]: I0316 16:54:52.129366 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:54:52 crc kubenswrapper[5120]: I0316 16:54:52.130886 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cdf5b2c0-4a53-4c60-a566-d18398c0c560-ovndb-tls-certs" (OuterVolumeSpecName: "ovndb-tls-certs") pod "cdf5b2c0-4a53-4c60-a566-d18398c0c560" (UID: "cdf5b2c0-4a53-4c60-a566-d18398c0c560"). InnerVolumeSpecName "ovndb-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:54:52 crc kubenswrapper[5120]: I0316 16:54:52.136487 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:54:52 crc kubenswrapper[5120]: I0316 16:54:52.147952 5120 scope.go:117] "RemoveContainer" containerID="365b620ab0a5f5b67686132db3d88ec20960fac4cc2e2d4565362ace99ba2a1d" Mar 16 16:54:52 crc kubenswrapper[5120]: E0316 16:54:52.148425 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"365b620ab0a5f5b67686132db3d88ec20960fac4cc2e2d4565362ace99ba2a1d\": container with ID starting with 365b620ab0a5f5b67686132db3d88ec20960fac4cc2e2d4565362ace99ba2a1d not found: ID does not exist" containerID="365b620ab0a5f5b67686132db3d88ec20960fac4cc2e2d4565362ace99ba2a1d" Mar 16 16:54:52 crc kubenswrapper[5120]: I0316 16:54:52.148472 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"365b620ab0a5f5b67686132db3d88ec20960fac4cc2e2d4565362ace99ba2a1d"} err="failed to get container status \"365b620ab0a5f5b67686132db3d88ec20960fac4cc2e2d4565362ace99ba2a1d\": rpc error: code = NotFound desc = could not find container \"365b620ab0a5f5b67686132db3d88ec20960fac4cc2e2d4565362ace99ba2a1d\": container with ID starting with 365b620ab0a5f5b67686132db3d88ec20960fac4cc2e2d4565362ace99ba2a1d not found: ID does not exist" Mar 16 16:54:52 crc kubenswrapper[5120]: I0316 16:54:52.148499 5120 scope.go:117] "RemoveContainer" containerID="7acf7b8f3d2c22d03c90e2cc9b9207ac80353b7bf126751bf2eff2f88c0697d8" Mar 16 16:54:52 crc kubenswrapper[5120]: E0316 16:54:52.149114 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7acf7b8f3d2c22d03c90e2cc9b9207ac80353b7bf126751bf2eff2f88c0697d8\": container with ID starting with 7acf7b8f3d2c22d03c90e2cc9b9207ac80353b7bf126751bf2eff2f88c0697d8 not found: ID does not exist" containerID="7acf7b8f3d2c22d03c90e2cc9b9207ac80353b7bf126751bf2eff2f88c0697d8" Mar 16 16:54:52 crc kubenswrapper[5120]: I0316 16:54:52.149160 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7acf7b8f3d2c22d03c90e2cc9b9207ac80353b7bf126751bf2eff2f88c0697d8"} err="failed to get container status \"7acf7b8f3d2c22d03c90e2cc9b9207ac80353b7bf126751bf2eff2f88c0697d8\": rpc error: code = NotFound desc = could not find container \"7acf7b8f3d2c22d03c90e2cc9b9207ac80353b7bf126751bf2eff2f88c0697d8\": container with ID starting with 7acf7b8f3d2c22d03c90e2cc9b9207ac80353b7bf126751bf2eff2f88c0697d8 not found: ID does not exist" Mar 16 16:54:52 crc kubenswrapper[5120]: I0316 16:54:52.149186 5120 scope.go:117] "RemoveContainer" containerID="3d1f3be4762f17a030965d2baf23eb4d3d42161f1123f9faaab941f03ade7875" Mar 16 16:54:52 crc kubenswrapper[5120]: I0316 16:54:52.169423 5120 scope.go:117] "RemoveContainer" containerID="5b230d20ea9d3d7833b271ff1a44a747ee3470f18fe1db783899778d4c9cb191" Mar 16 16:54:52 crc kubenswrapper[5120]: I0316 16:54:52.190804 5120 scope.go:117] "RemoveContainer" containerID="279aa838c1a848399cfdb1bb646b1ad052feb810283f58b9f2f00f5edd91dfee" Mar 16 16:54:52 crc kubenswrapper[5120]: I0316 16:54:52.229399 5120 reconciler_common.go:299] "Volume detached for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/cdf5b2c0-4a53-4c60-a566-d18398c0c560-ovndb-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:52 crc kubenswrapper[5120]: I0316 16:54:52.248986 5120 scope.go:117] "RemoveContainer" containerID="3d1f3be4762f17a030965d2baf23eb4d3d42161f1123f9faaab941f03ade7875" Mar 16 16:54:52 crc kubenswrapper[5120]: E0316 16:54:52.249208 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d1f3be4762f17a030965d2baf23eb4d3d42161f1123f9faaab941f03ade7875\": container with ID starting with 3d1f3be4762f17a030965d2baf23eb4d3d42161f1123f9faaab941f03ade7875 not found: ID does not exist" containerID="3d1f3be4762f17a030965d2baf23eb4d3d42161f1123f9faaab941f03ade7875" Mar 16 16:54:52 crc kubenswrapper[5120]: I0316 16:54:52.249237 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d1f3be4762f17a030965d2baf23eb4d3d42161f1123f9faaab941f03ade7875"} err="failed to get container status \"3d1f3be4762f17a030965d2baf23eb4d3d42161f1123f9faaab941f03ade7875\": rpc error: code = NotFound desc = could not find container \"3d1f3be4762f17a030965d2baf23eb4d3d42161f1123f9faaab941f03ade7875\": container with ID starting with 3d1f3be4762f17a030965d2baf23eb4d3d42161f1123f9faaab941f03ade7875 not found: ID does not exist" Mar 16 16:54:52 crc kubenswrapper[5120]: I0316 16:54:52.249257 5120 scope.go:117] "RemoveContainer" containerID="5b230d20ea9d3d7833b271ff1a44a747ee3470f18fe1db783899778d4c9cb191" Mar 16 16:54:52 crc kubenswrapper[5120]: E0316 16:54:52.249479 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b230d20ea9d3d7833b271ff1a44a747ee3470f18fe1db783899778d4c9cb191\": container with ID starting with 5b230d20ea9d3d7833b271ff1a44a747ee3470f18fe1db783899778d4c9cb191 not found: ID does not exist" containerID="5b230d20ea9d3d7833b271ff1a44a747ee3470f18fe1db783899778d4c9cb191" Mar 16 16:54:52 crc kubenswrapper[5120]: I0316 16:54:52.249516 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b230d20ea9d3d7833b271ff1a44a747ee3470f18fe1db783899778d4c9cb191"} err="failed to get container status \"5b230d20ea9d3d7833b271ff1a44a747ee3470f18fe1db783899778d4c9cb191\": rpc error: code = NotFound desc = could not find container \"5b230d20ea9d3d7833b271ff1a44a747ee3470f18fe1db783899778d4c9cb191\": container with ID starting with 5b230d20ea9d3d7833b271ff1a44a747ee3470f18fe1db783899778d4c9cb191 not found: ID does not exist" Mar 16 16:54:52 crc kubenswrapper[5120]: I0316 16:54:52.249539 5120 scope.go:117] "RemoveContainer" containerID="279aa838c1a848399cfdb1bb646b1ad052feb810283f58b9f2f00f5edd91dfee" Mar 16 16:54:52 crc kubenswrapper[5120]: E0316 16:54:52.250004 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"279aa838c1a848399cfdb1bb646b1ad052feb810283f58b9f2f00f5edd91dfee\": container with ID starting with 279aa838c1a848399cfdb1bb646b1ad052feb810283f58b9f2f00f5edd91dfee not found: ID does not exist" containerID="279aa838c1a848399cfdb1bb646b1ad052feb810283f58b9f2f00f5edd91dfee" Mar 16 16:54:52 crc kubenswrapper[5120]: I0316 16:54:52.250027 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"279aa838c1a848399cfdb1bb646b1ad052feb810283f58b9f2f00f5edd91dfee"} err="failed to get container status \"279aa838c1a848399cfdb1bb646b1ad052feb810283f58b9f2f00f5edd91dfee\": rpc error: code = NotFound desc = could not find container \"279aa838c1a848399cfdb1bb646b1ad052feb810283f58b9f2f00f5edd91dfee\": container with ID starting with 279aa838c1a848399cfdb1bb646b1ad052feb810283f58b9f2f00f5edd91dfee not found: ID does not exist" Mar 16 16:54:52 crc kubenswrapper[5120]: I0316 16:54:52.250042 5120 scope.go:117] "RemoveContainer" containerID="91cdc41498d52eadc713d48b44ce9200489f918206eab5cb8a8f23186b9a72fa" Mar 16 16:54:52 crc kubenswrapper[5120]: I0316 16:54:52.273961 5120 scope.go:117] "RemoveContainer" containerID="1be054665a55eb640a7520c6ccc788bd4c6aba09dae7de9eeee45a6e2ef73e77" Mar 16 16:54:52 crc kubenswrapper[5120]: I0316 16:54:52.290567 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/ceilometer-0" podUID="e3bbdf40-3feb-46ae-a12d-152e88c1bccd" containerName="proxy-httpd" probeResult="failure" output="Get \"https://10.217.0.195:3000/\": dial tcp 10.217.0.195:3000: connect: connection refused" Mar 16 16:54:52 crc kubenswrapper[5120]: I0316 16:54:52.423165 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-7b9f48f6c8-rfj5g"] Mar 16 16:54:52 crc kubenswrapper[5120]: I0316 16:54:52.429596 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-7b9f48f6c8-rfj5g"] Mar 16 16:54:52 crc kubenswrapper[5120]: I0316 16:54:52.435324 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-9f898f5b6-g9g57"] Mar 16 16:54:52 crc kubenswrapper[5120]: I0316 16:54:52.440931 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-9f898f5b6-g9g57"] Mar 16 16:54:52 crc kubenswrapper[5120]: E0316 16:54:52.461388 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a1c6c6eaee5b058049bbad3a58ced751fece0e218cfd6faf64607f644b0f5ef7" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:54:52 crc kubenswrapper[5120]: E0316 16:54:52.462933 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a1c6c6eaee5b058049bbad3a58ced751fece0e218cfd6faf64607f644b0f5ef7" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:54:52 crc kubenswrapper[5120]: E0316 16:54:52.464234 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a1c6c6eaee5b058049bbad3a58ced751fece0e218cfd6faf64607f644b0f5ef7" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:54:52 crc kubenswrapper[5120]: E0316 16:54:52.464275 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="67ab3338-c88c-4faf-8d25-809c92d661d9" containerName="nova-cell1-conductor-conductor" probeResult="unknown" Mar 16 16:54:52 crc kubenswrapper[5120]: I0316 16:54:52.658628 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:54:52 crc kubenswrapper[5120]: I0316 16:54:52.671851 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="48f680c8-5737-416a-ab55-2c7fcf32c0e2" path="/var/lib/kubelet/pods/48f680c8-5737-416a-ab55-2c7fcf32c0e2/volumes" Mar 16 16:54:52 crc kubenswrapper[5120]: I0316 16:54:52.672645 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a" path="/var/lib/kubelet/pods/bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a/volumes" Mar 16 16:54:52 crc kubenswrapper[5120]: I0316 16:54:52.674709 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cdf5b2c0-4a53-4c60-a566-d18398c0c560" path="/var/lib/kubelet/pods/cdf5b2c0-4a53-4c60-a566-d18398c0c560/volumes" Mar 16 16:54:52 crc kubenswrapper[5120]: I0316 16:54:52.675301 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eb34a81f-663e-4027-bf2c-1d334bd06ba4" path="/var/lib/kubelet/pods/eb34a81f-663e-4027-bf2c-1d334bd06ba4/volumes" Mar 16 16:54:52 crc kubenswrapper[5120]: I0316 16:54:52.738846 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e3bbdf40-3feb-46ae-a12d-152e88c1bccd-log-httpd\") pod \"e3bbdf40-3feb-46ae-a12d-152e88c1bccd\" (UID: \"e3bbdf40-3feb-46ae-a12d-152e88c1bccd\") " Mar 16 16:54:52 crc kubenswrapper[5120]: I0316 16:54:52.739051 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nppdh\" (UniqueName: \"kubernetes.io/projected/e3bbdf40-3feb-46ae-a12d-152e88c1bccd-kube-api-access-nppdh\") pod \"e3bbdf40-3feb-46ae-a12d-152e88c1bccd\" (UID: \"e3bbdf40-3feb-46ae-a12d-152e88c1bccd\") " Mar 16 16:54:52 crc kubenswrapper[5120]: I0316 16:54:52.739167 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/e3bbdf40-3feb-46ae-a12d-152e88c1bccd-sg-core-conf-yaml\") pod \"e3bbdf40-3feb-46ae-a12d-152e88c1bccd\" (UID: \"e3bbdf40-3feb-46ae-a12d-152e88c1bccd\") " Mar 16 16:54:52 crc kubenswrapper[5120]: I0316 16:54:52.739319 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e3bbdf40-3feb-46ae-a12d-152e88c1bccd-run-httpd\") pod \"e3bbdf40-3feb-46ae-a12d-152e88c1bccd\" (UID: \"e3bbdf40-3feb-46ae-a12d-152e88c1bccd\") " Mar 16 16:54:52 crc kubenswrapper[5120]: I0316 16:54:52.739356 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/e3bbdf40-3feb-46ae-a12d-152e88c1bccd-ceilometer-tls-certs\") pod \"e3bbdf40-3feb-46ae-a12d-152e88c1bccd\" (UID: \"e3bbdf40-3feb-46ae-a12d-152e88c1bccd\") " Mar 16 16:54:52 crc kubenswrapper[5120]: I0316 16:54:52.739422 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e3bbdf40-3feb-46ae-a12d-152e88c1bccd-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "e3bbdf40-3feb-46ae-a12d-152e88c1bccd" (UID: "e3bbdf40-3feb-46ae-a12d-152e88c1bccd"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:54:52 crc kubenswrapper[5120]: I0316 16:54:52.739439 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e3bbdf40-3feb-46ae-a12d-152e88c1bccd-combined-ca-bundle\") pod \"e3bbdf40-3feb-46ae-a12d-152e88c1bccd\" (UID: \"e3bbdf40-3feb-46ae-a12d-152e88c1bccd\") " Mar 16 16:54:52 crc kubenswrapper[5120]: I0316 16:54:52.739525 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e3bbdf40-3feb-46ae-a12d-152e88c1bccd-config-data\") pod \"e3bbdf40-3feb-46ae-a12d-152e88c1bccd\" (UID: \"e3bbdf40-3feb-46ae-a12d-152e88c1bccd\") " Mar 16 16:54:52 crc kubenswrapper[5120]: I0316 16:54:52.739559 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e3bbdf40-3feb-46ae-a12d-152e88c1bccd-scripts\") pod \"e3bbdf40-3feb-46ae-a12d-152e88c1bccd\" (UID: \"e3bbdf40-3feb-46ae-a12d-152e88c1bccd\") " Mar 16 16:54:52 crc kubenswrapper[5120]: I0316 16:54:52.739610 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e3bbdf40-3feb-46ae-a12d-152e88c1bccd-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "e3bbdf40-3feb-46ae-a12d-152e88c1bccd" (UID: "e3bbdf40-3feb-46ae-a12d-152e88c1bccd"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:54:52 crc kubenswrapper[5120]: I0316 16:54:52.740215 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e3bbdf40-3feb-46ae-a12d-152e88c1bccd-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:52 crc kubenswrapper[5120]: I0316 16:54:52.740240 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e3bbdf40-3feb-46ae-a12d-152e88c1bccd-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:52 crc kubenswrapper[5120]: I0316 16:54:52.742872 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3bbdf40-3feb-46ae-a12d-152e88c1bccd-scripts" (OuterVolumeSpecName: "scripts") pod "e3bbdf40-3feb-46ae-a12d-152e88c1bccd" (UID: "e3bbdf40-3feb-46ae-a12d-152e88c1bccd"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:54:52 crc kubenswrapper[5120]: I0316 16:54:52.743424 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3bbdf40-3feb-46ae-a12d-152e88c1bccd-kube-api-access-nppdh" (OuterVolumeSpecName: "kube-api-access-nppdh") pod "e3bbdf40-3feb-46ae-a12d-152e88c1bccd" (UID: "e3bbdf40-3feb-46ae-a12d-152e88c1bccd"). InnerVolumeSpecName "kube-api-access-nppdh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:54:52 crc kubenswrapper[5120]: I0316 16:54:52.760551 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3bbdf40-3feb-46ae-a12d-152e88c1bccd-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "e3bbdf40-3feb-46ae-a12d-152e88c1bccd" (UID: "e3bbdf40-3feb-46ae-a12d-152e88c1bccd"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:54:52 crc kubenswrapper[5120]: I0316 16:54:52.792682 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3bbdf40-3feb-46ae-a12d-152e88c1bccd-ceilometer-tls-certs" (OuterVolumeSpecName: "ceilometer-tls-certs") pod "e3bbdf40-3feb-46ae-a12d-152e88c1bccd" (UID: "e3bbdf40-3feb-46ae-a12d-152e88c1bccd"). InnerVolumeSpecName "ceilometer-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:54:52 crc kubenswrapper[5120]: I0316 16:54:52.804191 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3bbdf40-3feb-46ae-a12d-152e88c1bccd-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e3bbdf40-3feb-46ae-a12d-152e88c1bccd" (UID: "e3bbdf40-3feb-46ae-a12d-152e88c1bccd"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:54:52 crc kubenswrapper[5120]: I0316 16:54:52.819257 5120 pod_container_manager_linux.go:217] "Failed to delete cgroup paths" cgroupName=["kubepods","besteffort","podd1960e17-5bd0-46f5-9155-8dd50410168f"] err="unable to destroy cgroup paths for cgroup [kubepods besteffort podd1960e17-5bd0-46f5-9155-8dd50410168f] : Timed out while waiting for systemd to remove kubepods-besteffort-podd1960e17_5bd0_46f5_9155_8dd50410168f.slice" Mar 16 16:54:52 crc kubenswrapper[5120]: I0316 16:54:52.833112 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3bbdf40-3feb-46ae-a12d-152e88c1bccd-config-data" (OuterVolumeSpecName: "config-data") pod "e3bbdf40-3feb-46ae-a12d-152e88c1bccd" (UID: "e3bbdf40-3feb-46ae-a12d-152e88c1bccd"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:54:52 crc kubenswrapper[5120]: I0316 16:54:52.842736 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e3bbdf40-3feb-46ae-a12d-152e88c1bccd-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:52 crc kubenswrapper[5120]: I0316 16:54:52.842810 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e3bbdf40-3feb-46ae-a12d-152e88c1bccd-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:52 crc kubenswrapper[5120]: I0316 16:54:52.842823 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e3bbdf40-3feb-46ae-a12d-152e88c1bccd-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:52 crc kubenswrapper[5120]: I0316 16:54:52.842837 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nppdh\" (UniqueName: \"kubernetes.io/projected/e3bbdf40-3feb-46ae-a12d-152e88c1bccd-kube-api-access-nppdh\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:52 crc kubenswrapper[5120]: I0316 16:54:52.842853 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/e3bbdf40-3feb-46ae-a12d-152e88c1bccd-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:52 crc kubenswrapper[5120]: I0316 16:54:52.842872 5120 reconciler_common.go:299] "Volume detached for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/e3bbdf40-3feb-46ae-a12d-152e88c1bccd-ceilometer-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:54:53 crc kubenswrapper[5120]: I0316 16:54:53.083566 5120 generic.go:358] "Generic (PLEG): container finished" podID="e3bbdf40-3feb-46ae-a12d-152e88c1bccd" containerID="5523e5bfe537c21f58dd2396b51a688a7a7e02b72fba915bed95b8b93206e355" exitCode=137 Mar 16 16:54:53 crc kubenswrapper[5120]: I0316 16:54:53.083674 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:54:53 crc kubenswrapper[5120]: I0316 16:54:53.083679 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"e3bbdf40-3feb-46ae-a12d-152e88c1bccd","Type":"ContainerDied","Data":"5523e5bfe537c21f58dd2396b51a688a7a7e02b72fba915bed95b8b93206e355"} Mar 16 16:54:53 crc kubenswrapper[5120]: I0316 16:54:53.083733 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"e3bbdf40-3feb-46ae-a12d-152e88c1bccd","Type":"ContainerDied","Data":"194dbfa47535d6e3afe8d5d2c51baf44b678417300e19ec2917840ee051fcc2c"} Mar 16 16:54:53 crc kubenswrapper[5120]: I0316 16:54:53.083755 5120 scope.go:117] "RemoveContainer" containerID="c93587a6adf780fb486fc549a2b959fb20fcb325d0bd45e869e6926928b7d69e" Mar 16 16:54:53 crc kubenswrapper[5120]: I0316 16:54:53.112961 5120 scope.go:117] "RemoveContainer" containerID="caeb7b897b55fc95665a1bf7861c08e4cce273d594fed47d77ee3311a0d06d37" Mar 16 16:54:53 crc kubenswrapper[5120]: I0316 16:54:53.125636 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:54:53 crc kubenswrapper[5120]: I0316 16:54:53.131171 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:54:53 crc kubenswrapper[5120]: I0316 16:54:53.135571 5120 scope.go:117] "RemoveContainer" containerID="5523e5bfe537c21f58dd2396b51a688a7a7e02b72fba915bed95b8b93206e355" Mar 16 16:54:53 crc kubenswrapper[5120]: I0316 16:54:53.154803 5120 scope.go:117] "RemoveContainer" containerID="6c1bd7806ab012b5b16af79d65b808832086d33a8024353ef14b25032736b665" Mar 16 16:54:53 crc kubenswrapper[5120]: I0316 16:54:53.174228 5120 scope.go:117] "RemoveContainer" containerID="c93587a6adf780fb486fc549a2b959fb20fcb325d0bd45e869e6926928b7d69e" Mar 16 16:54:53 crc kubenswrapper[5120]: E0316 16:54:53.174734 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c93587a6adf780fb486fc549a2b959fb20fcb325d0bd45e869e6926928b7d69e\": container with ID starting with c93587a6adf780fb486fc549a2b959fb20fcb325d0bd45e869e6926928b7d69e not found: ID does not exist" containerID="c93587a6adf780fb486fc549a2b959fb20fcb325d0bd45e869e6926928b7d69e" Mar 16 16:54:53 crc kubenswrapper[5120]: I0316 16:54:53.174843 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c93587a6adf780fb486fc549a2b959fb20fcb325d0bd45e869e6926928b7d69e"} err="failed to get container status \"c93587a6adf780fb486fc549a2b959fb20fcb325d0bd45e869e6926928b7d69e\": rpc error: code = NotFound desc = could not find container \"c93587a6adf780fb486fc549a2b959fb20fcb325d0bd45e869e6926928b7d69e\": container with ID starting with c93587a6adf780fb486fc549a2b959fb20fcb325d0bd45e869e6926928b7d69e not found: ID does not exist" Mar 16 16:54:53 crc kubenswrapper[5120]: I0316 16:54:53.174869 5120 scope.go:117] "RemoveContainer" containerID="caeb7b897b55fc95665a1bf7861c08e4cce273d594fed47d77ee3311a0d06d37" Mar 16 16:54:53 crc kubenswrapper[5120]: E0316 16:54:53.175244 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"caeb7b897b55fc95665a1bf7861c08e4cce273d594fed47d77ee3311a0d06d37\": container with ID starting with caeb7b897b55fc95665a1bf7861c08e4cce273d594fed47d77ee3311a0d06d37 not found: ID does not exist" containerID="caeb7b897b55fc95665a1bf7861c08e4cce273d594fed47d77ee3311a0d06d37" Mar 16 16:54:53 crc kubenswrapper[5120]: I0316 16:54:53.175280 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"caeb7b897b55fc95665a1bf7861c08e4cce273d594fed47d77ee3311a0d06d37"} err="failed to get container status \"caeb7b897b55fc95665a1bf7861c08e4cce273d594fed47d77ee3311a0d06d37\": rpc error: code = NotFound desc = could not find container \"caeb7b897b55fc95665a1bf7861c08e4cce273d594fed47d77ee3311a0d06d37\": container with ID starting with caeb7b897b55fc95665a1bf7861c08e4cce273d594fed47d77ee3311a0d06d37 not found: ID does not exist" Mar 16 16:54:53 crc kubenswrapper[5120]: I0316 16:54:53.175299 5120 scope.go:117] "RemoveContainer" containerID="5523e5bfe537c21f58dd2396b51a688a7a7e02b72fba915bed95b8b93206e355" Mar 16 16:54:53 crc kubenswrapper[5120]: E0316 16:54:53.175549 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5523e5bfe537c21f58dd2396b51a688a7a7e02b72fba915bed95b8b93206e355\": container with ID starting with 5523e5bfe537c21f58dd2396b51a688a7a7e02b72fba915bed95b8b93206e355 not found: ID does not exist" containerID="5523e5bfe537c21f58dd2396b51a688a7a7e02b72fba915bed95b8b93206e355" Mar 16 16:54:53 crc kubenswrapper[5120]: I0316 16:54:53.175613 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5523e5bfe537c21f58dd2396b51a688a7a7e02b72fba915bed95b8b93206e355"} err="failed to get container status \"5523e5bfe537c21f58dd2396b51a688a7a7e02b72fba915bed95b8b93206e355\": rpc error: code = NotFound desc = could not find container \"5523e5bfe537c21f58dd2396b51a688a7a7e02b72fba915bed95b8b93206e355\": container with ID starting with 5523e5bfe537c21f58dd2396b51a688a7a7e02b72fba915bed95b8b93206e355 not found: ID does not exist" Mar 16 16:54:53 crc kubenswrapper[5120]: I0316 16:54:53.175668 5120 scope.go:117] "RemoveContainer" containerID="6c1bd7806ab012b5b16af79d65b808832086d33a8024353ef14b25032736b665" Mar 16 16:54:53 crc kubenswrapper[5120]: E0316 16:54:53.175958 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c1bd7806ab012b5b16af79d65b808832086d33a8024353ef14b25032736b665\": container with ID starting with 6c1bd7806ab012b5b16af79d65b808832086d33a8024353ef14b25032736b665 not found: ID does not exist" containerID="6c1bd7806ab012b5b16af79d65b808832086d33a8024353ef14b25032736b665" Mar 16 16:54:53 crc kubenswrapper[5120]: I0316 16:54:53.175986 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c1bd7806ab012b5b16af79d65b808832086d33a8024353ef14b25032736b665"} err="failed to get container status \"6c1bd7806ab012b5b16af79d65b808832086d33a8024353ef14b25032736b665\": rpc error: code = NotFound desc = could not find container \"6c1bd7806ab012b5b16af79d65b808832086d33a8024353ef14b25032736b665\": container with ID starting with 6c1bd7806ab012b5b16af79d65b808832086d33a8024353ef14b25032736b665 not found: ID does not exist" Mar 16 16:54:53 crc kubenswrapper[5120]: E0316 16:54:53.217284 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="98f2961dcc312facfab09ff595793480ed2af349689afceae531c8d93b77cfb7" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:54:53 crc kubenswrapper[5120]: E0316 16:54:53.219221 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="98f2961dcc312facfab09ff595793480ed2af349689afceae531c8d93b77cfb7" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:54:53 crc kubenswrapper[5120]: E0316 16:54:53.220376 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="98f2961dcc312facfab09ff595793480ed2af349689afceae531c8d93b77cfb7" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:54:53 crc kubenswrapper[5120]: E0316 16:54:53.220416 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="de073433-40f2-40c4-ba26-ae8be3817e67" containerName="nova-scheduler-scheduler" probeResult="unknown" Mar 16 16:54:53 crc kubenswrapper[5120]: E0316 16:54:53.535780 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="ee30dfd8af3af59f37f37ec99d41afa1ec85248596d20c9e31406083d8a749b1" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:54:53 crc kubenswrapper[5120]: E0316 16:54:53.537484 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="ee30dfd8af3af59f37f37ec99d41afa1ec85248596d20c9e31406083d8a749b1" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:54:53 crc kubenswrapper[5120]: E0316 16:54:53.538964 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="ee30dfd8af3af59f37f37ec99d41afa1ec85248596d20c9e31406083d8a749b1" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:54:53 crc kubenswrapper[5120]: E0316 16:54:53.539059 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="802ef826-c6e7-4a1c-90a6-b419b9489007" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 16:54:54 crc kubenswrapper[5120]: I0316 16:54:54.673043 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e3bbdf40-3feb-46ae-a12d-152e88c1bccd" path="/var/lib/kubelet/pods/e3bbdf40-3feb-46ae-a12d-152e88c1bccd/volumes" Mar 16 16:54:54 crc kubenswrapper[5120]: I0316 16:54:54.748180 5120 pod_container_manager_linux.go:217] "Failed to delete cgroup paths" cgroupName=["kubepods","besteffort","pod70574728-2a53-4b17-941b-e437321d936c"] err="unable to destroy cgroup paths for cgroup [kubepods besteffort pod70574728-2a53-4b17-941b-e437321d936c] : Timed out while waiting for systemd to remove kubepods-besteffort-pod70574728_2a53_4b17_941b_e437321d936c.slice" Mar 16 16:54:54 crc kubenswrapper[5120]: E0316 16:54:54.748225 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to delete cgroup paths for [kubepods besteffort pod70574728-2a53-4b17-941b-e437321d936c] : unable to destroy cgroup paths for cgroup [kubepods besteffort pod70574728-2a53-4b17-941b-e437321d936c] : Timed out while waiting for systemd to remove kubepods-besteffort-pod70574728_2a53_4b17_941b_e437321d936c.slice" pod="openstack-kuttl-tests/kube-state-metrics-0" podUID="70574728-2a53-4b17-941b-e437321d936c" Mar 16 16:54:55 crc kubenswrapper[5120]: I0316 16:54:55.108229 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:54:55 crc kubenswrapper[5120]: I0316 16:54:55.127229 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 16:54:55 crc kubenswrapper[5120]: I0316 16:54:55.135902 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 16:54:56 crc kubenswrapper[5120]: I0316 16:54:56.677144 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="70574728-2a53-4b17-941b-e437321d936c" path="/var/lib/kubelet/pods/70574728-2a53-4b17-941b-e437321d936c/volumes" Mar 16 16:54:57 crc kubenswrapper[5120]: I0316 16:54:57.201499 5120 pod_container_manager_linux.go:217] "Failed to delete cgroup paths" cgroupName=["kubepods","besteffort","podffbba34f-0cbb-4345-931f-9c4c763847e1"] err="unable to destroy cgroup paths for cgroup [kubepods besteffort podffbba34f-0cbb-4345-931f-9c4c763847e1] : Timed out while waiting for systemd to remove kubepods-besteffort-podffbba34f_0cbb_4345_931f_9c4c763847e1.slice" Mar 16 16:54:57 crc kubenswrapper[5120]: E0316 16:54:57.201710 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to delete cgroup paths for [kubepods besteffort podffbba34f-0cbb-4345-931f-9c4c763847e1] : unable to destroy cgroup paths for cgroup [kubepods besteffort podffbba34f-0cbb-4345-931f-9c4c763847e1] : Timed out while waiting for systemd to remove kubepods-besteffort-podffbba34f_0cbb_4345_931f_9c4c763847e1.slice" pod="openstack-kuttl-tests/barbican-1de0-account-create-update-rqhj2" podUID="ffbba34f-0cbb-4345-931f-9c4c763847e1" Mar 16 16:54:57 crc kubenswrapper[5120]: E0316 16:54:57.460336 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a1c6c6eaee5b058049bbad3a58ced751fece0e218cfd6faf64607f644b0f5ef7" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:54:57 crc kubenswrapper[5120]: E0316 16:54:57.461581 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a1c6c6eaee5b058049bbad3a58ced751fece0e218cfd6faf64607f644b0f5ef7" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:54:57 crc kubenswrapper[5120]: E0316 16:54:57.463509 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a1c6c6eaee5b058049bbad3a58ced751fece0e218cfd6faf64607f644b0f5ef7" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:54:57 crc kubenswrapper[5120]: E0316 16:54:57.463614 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="67ab3338-c88c-4faf-8d25-809c92d661d9" containerName="nova-cell1-conductor-conductor" probeResult="unknown" Mar 16 16:54:58 crc kubenswrapper[5120]: I0316 16:54:58.142828 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-1de0-account-create-update-rqhj2" Mar 16 16:54:58 crc kubenswrapper[5120]: I0316 16:54:58.187104 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-1de0-account-create-update-rqhj2"] Mar 16 16:54:58 crc kubenswrapper[5120]: I0316 16:54:58.195092 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-1de0-account-create-update-rqhj2"] Mar 16 16:54:58 crc kubenswrapper[5120]: E0316 16:54:58.218014 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="98f2961dcc312facfab09ff595793480ed2af349689afceae531c8d93b77cfb7" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:54:58 crc kubenswrapper[5120]: E0316 16:54:58.219868 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="98f2961dcc312facfab09ff595793480ed2af349689afceae531c8d93b77cfb7" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:54:58 crc kubenswrapper[5120]: E0316 16:54:58.221886 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="98f2961dcc312facfab09ff595793480ed2af349689afceae531c8d93b77cfb7" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:54:58 crc kubenswrapper[5120]: E0316 16:54:58.221930 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="de073433-40f2-40c4-ba26-ae8be3817e67" containerName="nova-scheduler-scheduler" probeResult="unknown" Mar 16 16:54:58 crc kubenswrapper[5120]: E0316 16:54:58.535684 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="ee30dfd8af3af59f37f37ec99d41afa1ec85248596d20c9e31406083d8a749b1" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:54:58 crc kubenswrapper[5120]: E0316 16:54:58.537307 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="ee30dfd8af3af59f37f37ec99d41afa1ec85248596d20c9e31406083d8a749b1" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:54:58 crc kubenswrapper[5120]: E0316 16:54:58.538670 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="ee30dfd8af3af59f37f37ec99d41afa1ec85248596d20c9e31406083d8a749b1" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 16:54:58 crc kubenswrapper[5120]: E0316 16:54:58.538806 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="802ef826-c6e7-4a1c-90a6-b419b9489007" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 16:54:58 crc kubenswrapper[5120]: I0316 16:54:58.674725 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ffbba34f-0cbb-4345-931f-9c4c763847e1" path="/var/lib/kubelet/pods/ffbba34f-0cbb-4345-931f-9c4c763847e1/volumes" Mar 16 16:54:59 crc kubenswrapper[5120]: I0316 16:54:59.619025 5120 scope.go:117] "RemoveContainer" containerID="e320e939f4be1457bc589639d9ed3c38aa64fb2533774ea309fdacd36ba48287" Mar 16 16:54:59 crc kubenswrapper[5120]: I0316 16:54:59.641419 5120 scope.go:117] "RemoveContainer" containerID="4920281ee670b327c53844dc3011a1263a41a89d76b77f9b9e465904154b74af" Mar 16 16:54:59 crc kubenswrapper[5120]: I0316 16:54:59.677311 5120 scope.go:117] "RemoveContainer" containerID="11ff6b164b7790c582fa06c50b6f9af90dcba54a31ca96543288b5f9c2f7a9a4" Mar 16 16:54:59 crc kubenswrapper[5120]: I0316 16:54:59.700788 5120 scope.go:117] "RemoveContainer" containerID="cd5ef61388c2e24d085fe1734d4a14ad2b13fbe029e9b8fa9d1cf7bf87e7dea4" Mar 16 16:54:59 crc kubenswrapper[5120]: I0316 16:54:59.845174 5120 scope.go:117] "RemoveContainer" containerID="b83e6960608ec3a74807b3518f907e9c9af22e76f08fe8a879983eb26ec16ce1" Mar 16 16:54:59 crc kubenswrapper[5120]: I0316 16:54:59.864931 5120 scope.go:117] "RemoveContainer" containerID="9b8f5f687f3848ddd999d88a2c20bfc3bc7ac68fe731ddb054d06d138c8313e4" Mar 16 16:54:59 crc kubenswrapper[5120]: I0316 16:54:59.892470 5120 scope.go:117] "RemoveContainer" containerID="765b2fb99593c126008bdd8a3191c1144a0861f214b619c08ceb37602641664b" Mar 16 16:55:00 crc kubenswrapper[5120]: I0316 16:55:00.051222 5120 scope.go:117] "RemoveContainer" containerID="81527ce47d56655c208352a5bd34dcd551faa271463f7acafa5ae8865ad6812f" Mar 16 16:55:00 crc kubenswrapper[5120]: I0316 16:55:00.071286 5120 scope.go:117] "RemoveContainer" containerID="2b532f991da0367328f2fb4572b52398bdb803df0c8f63311aa996276464de2a" Mar 16 16:55:00 crc kubenswrapper[5120]: I0316 16:55:00.089728 5120 scope.go:117] "RemoveContainer" containerID="d16d8b561d29194b70bd7462a92933c5a49972813766602967563ef931d51af3" Mar 16 16:55:00 crc kubenswrapper[5120]: I0316 16:55:00.109814 5120 scope.go:117] "RemoveContainer" containerID="e395c97f46524d2be4c3f22c7dd5e308856748f9b69a0197842a05ba44953ce8" Mar 16 16:55:00 crc kubenswrapper[5120]: I0316 16:55:00.128996 5120 scope.go:117] "RemoveContainer" containerID="2a9c5587c8fe02a6f22d38cec648003ce298ea78b8e8e16f3602da1d675de4c6" Mar 16 16:55:00 crc kubenswrapper[5120]: I0316 16:55:00.162742 5120 scope.go:117] "RemoveContainer" containerID="0cf4bef158dd114153ad706a5f5a58700444bcb26541c0d6c3f9cb7df814b032" Mar 16 16:55:00 crc kubenswrapper[5120]: I0316 16:55:00.210158 5120 scope.go:117] "RemoveContainer" containerID="a1342b28e33d351be9c4dcf0a337be7231153eb4a15daff492d2ab2085cab787" Mar 16 16:55:00 crc kubenswrapper[5120]: I0316 16:55:00.346442 5120 scope.go:117] "RemoveContainer" containerID="49198fce7eb3bdcdb7ccf2288ad18d982d0e75faee4130ae433591d9a4ebd092" Mar 16 16:55:00 crc kubenswrapper[5120]: I0316 16:55:00.411416 5120 scope.go:117] "RemoveContainer" containerID="b5635d2ec11446bea39b1a5733a1d2aef8b62952bbe76432eaa12ecad82b272d" Mar 16 16:55:00 crc kubenswrapper[5120]: I0316 16:55:00.453703 5120 scope.go:117] "RemoveContainer" containerID="40f557084e3a2ecf12fdf7c3b4721912bfc34ca2bde7e8746a886d139da7e9c3" Mar 16 16:55:00 crc kubenswrapper[5120]: I0316 16:55:00.477616 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:55:00 crc kubenswrapper[5120]: I0316 16:55:00.479892 5120 scope.go:117] "RemoveContainer" containerID="a206f277f6d8961656366e86484996a06d8e3091f3c7991768bd7db49f033cfd" Mar 16 16:55:00 crc kubenswrapper[5120]: I0316 16:55:00.501178 5120 scope.go:117] "RemoveContainer" containerID="8545e866e6324656e644369b883757a78552dd6dc832000c5479316762a3c706" Mar 16 16:55:00 crc kubenswrapper[5120]: I0316 16:55:00.542324 5120 scope.go:117] "RemoveContainer" containerID="063b1966e4dba8c302e52881e24f4aff432340c0be948bd52137842ad7554c94" Mar 16 16:55:00 crc kubenswrapper[5120]: I0316 16:55:00.556611 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:55:00 crc kubenswrapper[5120]: I0316 16:55:00.585939 5120 scope.go:117] "RemoveContainer" containerID="c3a9838bfe4533a414f719c7b53e4921a42f7f481b365a0f877b79263e932018" Mar 16 16:55:00 crc kubenswrapper[5120]: I0316 16:55:00.608236 5120 scope.go:117] "RemoveContainer" containerID="84402998ec5dc95878258815ff6c436722b11de13d52212e9d338beef3cb5c72" Mar 16 16:55:00 crc kubenswrapper[5120]: I0316 16:55:00.617290 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kxvsk\" (UniqueName: \"kubernetes.io/projected/67ab3338-c88c-4faf-8d25-809c92d661d9-kube-api-access-kxvsk\") pod \"67ab3338-c88c-4faf-8d25-809c92d661d9\" (UID: \"67ab3338-c88c-4faf-8d25-809c92d661d9\") " Mar 16 16:55:00 crc kubenswrapper[5120]: I0316 16:55:00.617370 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/67ab3338-c88c-4faf-8d25-809c92d661d9-combined-ca-bundle\") pod \"67ab3338-c88c-4faf-8d25-809c92d661d9\" (UID: \"67ab3338-c88c-4faf-8d25-809c92d661d9\") " Mar 16 16:55:00 crc kubenswrapper[5120]: I0316 16:55:00.617545 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/67ab3338-c88c-4faf-8d25-809c92d661d9-config-data\") pod \"67ab3338-c88c-4faf-8d25-809c92d661d9\" (UID: \"67ab3338-c88c-4faf-8d25-809c92d661d9\") " Mar 16 16:55:00 crc kubenswrapper[5120]: I0316 16:55:00.623260 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67ab3338-c88c-4faf-8d25-809c92d661d9-kube-api-access-kxvsk" (OuterVolumeSpecName: "kube-api-access-kxvsk") pod "67ab3338-c88c-4faf-8d25-809c92d661d9" (UID: "67ab3338-c88c-4faf-8d25-809c92d661d9"). InnerVolumeSpecName "kube-api-access-kxvsk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:55:00 crc kubenswrapper[5120]: I0316 16:55:00.641118 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/67ab3338-c88c-4faf-8d25-809c92d661d9-config-data" (OuterVolumeSpecName: "config-data") pod "67ab3338-c88c-4faf-8d25-809c92d661d9" (UID: "67ab3338-c88c-4faf-8d25-809c92d661d9"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:55:00 crc kubenswrapper[5120]: I0316 16:55:00.645219 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/67ab3338-c88c-4faf-8d25-809c92d661d9-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "67ab3338-c88c-4faf-8d25-809c92d661d9" (UID: "67ab3338-c88c-4faf-8d25-809c92d661d9"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:55:00 crc kubenswrapper[5120]: I0316 16:55:00.691456 5120 scope.go:117] "RemoveContainer" containerID="56a8ebbbbbff235c01b61f95471e8f8102370f89a7873cb32553e5333a7da92e" Mar 16 16:55:00 crc kubenswrapper[5120]: I0316 16:55:00.719275 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/802ef826-c6e7-4a1c-90a6-b419b9489007-combined-ca-bundle\") pod \"802ef826-c6e7-4a1c-90a6-b419b9489007\" (UID: \"802ef826-c6e7-4a1c-90a6-b419b9489007\") " Mar 16 16:55:00 crc kubenswrapper[5120]: I0316 16:55:00.719386 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/802ef826-c6e7-4a1c-90a6-b419b9489007-config-data\") pod \"802ef826-c6e7-4a1c-90a6-b419b9489007\" (UID: \"802ef826-c6e7-4a1c-90a6-b419b9489007\") " Mar 16 16:55:00 crc kubenswrapper[5120]: I0316 16:55:00.719505 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-znqvf\" (UniqueName: \"kubernetes.io/projected/802ef826-c6e7-4a1c-90a6-b419b9489007-kube-api-access-znqvf\") pod \"802ef826-c6e7-4a1c-90a6-b419b9489007\" (UID: \"802ef826-c6e7-4a1c-90a6-b419b9489007\") " Mar 16 16:55:00 crc kubenswrapper[5120]: I0316 16:55:00.720330 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/67ab3338-c88c-4faf-8d25-809c92d661d9-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:55:00 crc kubenswrapper[5120]: I0316 16:55:00.720379 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kxvsk\" (UniqueName: \"kubernetes.io/projected/67ab3338-c88c-4faf-8d25-809c92d661d9-kube-api-access-kxvsk\") on node \"crc\" DevicePath \"\"" Mar 16 16:55:00 crc kubenswrapper[5120]: I0316 16:55:00.720395 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/67ab3338-c88c-4faf-8d25-809c92d661d9-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:55:00 crc kubenswrapper[5120]: I0316 16:55:00.723965 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/802ef826-c6e7-4a1c-90a6-b419b9489007-kube-api-access-znqvf" (OuterVolumeSpecName: "kube-api-access-znqvf") pod "802ef826-c6e7-4a1c-90a6-b419b9489007" (UID: "802ef826-c6e7-4a1c-90a6-b419b9489007"). InnerVolumeSpecName "kube-api-access-znqvf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:55:00 crc kubenswrapper[5120]: I0316 16:55:00.727077 5120 scope.go:117] "RemoveContainer" containerID="4f5b8eb8ad5405e72b5100c937572a066ecca0841f65b758f88635db29ceb2a5" Mar 16 16:55:00 crc kubenswrapper[5120]: I0316 16:55:00.744013 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/802ef826-c6e7-4a1c-90a6-b419b9489007-config-data" (OuterVolumeSpecName: "config-data") pod "802ef826-c6e7-4a1c-90a6-b419b9489007" (UID: "802ef826-c6e7-4a1c-90a6-b419b9489007"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:55:00 crc kubenswrapper[5120]: I0316 16:55:00.744337 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/802ef826-c6e7-4a1c-90a6-b419b9489007-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "802ef826-c6e7-4a1c-90a6-b419b9489007" (UID: "802ef826-c6e7-4a1c-90a6-b419b9489007"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:55:00 crc kubenswrapper[5120]: I0316 16:55:00.822723 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/802ef826-c6e7-4a1c-90a6-b419b9489007-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:55:00 crc kubenswrapper[5120]: I0316 16:55:00.822804 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-znqvf\" (UniqueName: \"kubernetes.io/projected/802ef826-c6e7-4a1c-90a6-b419b9489007-kube-api-access-znqvf\") on node \"crc\" DevicePath \"\"" Mar 16 16:55:00 crc kubenswrapper[5120]: I0316 16:55:00.822820 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/802ef826-c6e7-4a1c-90a6-b419b9489007-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:55:00 crc kubenswrapper[5120]: I0316 16:55:00.841648 5120 scope.go:117] "RemoveContainer" containerID="762c5b88c62dde33564710bf074b979a14758a820e0cf7d361b4d935db707a79" Mar 16 16:55:00 crc kubenswrapper[5120]: I0316 16:55:00.861740 5120 scope.go:117] "RemoveContainer" containerID="d17cf45d44fd0f7109ecc7964d349d5aabdbd98c2cf6e83625584ad4f70ee890" Mar 16 16:55:00 crc kubenswrapper[5120]: I0316 16:55:00.880361 5120 scope.go:117] "RemoveContainer" containerID="11335ab8141c3248a219fa01fb20182d45cfb2b3308ae2564459e0e802361bf5" Mar 16 16:55:00 crc kubenswrapper[5120]: I0316 16:55:00.899419 5120 scope.go:117] "RemoveContainer" containerID="ee76de54b5123c4dfd41f8ebbde4df9133509c49a4031078292d09bed98358e3" Mar 16 16:55:00 crc kubenswrapper[5120]: I0316 16:55:00.917537 5120 scope.go:117] "RemoveContainer" containerID="b3af81ac38c305699d6393872a740e0f8879c3c011320542e001b9c18d88e2d6" Mar 16 16:55:00 crc kubenswrapper[5120]: I0316 16:55:00.940477 5120 scope.go:117] "RemoveContainer" containerID="fbef3263cab9fddad0669adf17acaca7c922ac91b4f2b66f8eb1173ea6b04bf3" Mar 16 16:55:00 crc kubenswrapper[5120]: I0316 16:55:00.964919 5120 scope.go:117] "RemoveContainer" containerID="99f4e0fddd3bd83c3b372377993a97c3a112e1e6892657f44e0402569984fed6" Mar 16 16:55:01 crc kubenswrapper[5120]: I0316 16:55:01.004965 5120 scope.go:117] "RemoveContainer" containerID="f3d77c9fbe50994018fa2c0f804675a9e28cc1a9053d5f233017c151b839b925" Mar 16 16:55:01 crc kubenswrapper[5120]: I0316 16:55:01.033181 5120 scope.go:117] "RemoveContainer" containerID="8a0aa6771ff67781c6bea0b6706cc83f48802783eabac82a07c3459709fb9563" Mar 16 16:55:01 crc kubenswrapper[5120]: I0316 16:55:01.058917 5120 scope.go:117] "RemoveContainer" containerID="e0178eee63ecdd93c95b03663f9f5ef05132c3b00ea101b8726d6886daac3925" Mar 16 16:55:01 crc kubenswrapper[5120]: I0316 16:55:01.230242 5120 generic.go:358] "Generic (PLEG): container finished" podID="de073433-40f2-40c4-ba26-ae8be3817e67" containerID="98f2961dcc312facfab09ff595793480ed2af349689afceae531c8d93b77cfb7" exitCode=137 Mar 16 16:55:01 crc kubenswrapper[5120]: I0316 16:55:01.230321 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"de073433-40f2-40c4-ba26-ae8be3817e67","Type":"ContainerDied","Data":"98f2961dcc312facfab09ff595793480ed2af349689afceae531c8d93b77cfb7"} Mar 16 16:55:01 crc kubenswrapper[5120]: I0316 16:55:01.244714 5120 generic.go:358] "Generic (PLEG): container finished" podID="802ef826-c6e7-4a1c-90a6-b419b9489007" containerID="ee30dfd8af3af59f37f37ec99d41afa1ec85248596d20c9e31406083d8a749b1" exitCode=137 Mar 16 16:55:01 crc kubenswrapper[5120]: I0316 16:55:01.244809 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:55:01 crc kubenswrapper[5120]: I0316 16:55:01.244800 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"802ef826-c6e7-4a1c-90a6-b419b9489007","Type":"ContainerDied","Data":"ee30dfd8af3af59f37f37ec99d41afa1ec85248596d20c9e31406083d8a749b1"} Mar 16 16:55:01 crc kubenswrapper[5120]: I0316 16:55:01.244875 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"802ef826-c6e7-4a1c-90a6-b419b9489007","Type":"ContainerDied","Data":"1408b97c46ccdff82d9b2ca4f20753c74df3346d5cc0a09bde8e56bfebcd58c1"} Mar 16 16:55:01 crc kubenswrapper[5120]: I0316 16:55:01.244913 5120 scope.go:117] "RemoveContainer" containerID="ee30dfd8af3af59f37f37ec99d41afa1ec85248596d20c9e31406083d8a749b1" Mar 16 16:55:01 crc kubenswrapper[5120]: I0316 16:55:01.253957 5120 generic.go:358] "Generic (PLEG): container finished" podID="67ab3338-c88c-4faf-8d25-809c92d661d9" containerID="a1c6c6eaee5b058049bbad3a58ced751fece0e218cfd6faf64607f644b0f5ef7" exitCode=137 Mar 16 16:55:01 crc kubenswrapper[5120]: I0316 16:55:01.254019 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"67ab3338-c88c-4faf-8d25-809c92d661d9","Type":"ContainerDied","Data":"a1c6c6eaee5b058049bbad3a58ced751fece0e218cfd6faf64607f644b0f5ef7"} Mar 16 16:55:01 crc kubenswrapper[5120]: I0316 16:55:01.254076 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"67ab3338-c88c-4faf-8d25-809c92d661d9","Type":"ContainerDied","Data":"b20944f9072fdd18758ac24dc83a2680b8a1706b9d7947283c4fc9ac8c128b09"} Mar 16 16:55:01 crc kubenswrapper[5120]: I0316 16:55:01.254078 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:55:01 crc kubenswrapper[5120]: I0316 16:55:01.281906 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 16:55:01 crc kubenswrapper[5120]: I0316 16:55:01.289157 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 16:55:01 crc kubenswrapper[5120]: I0316 16:55:01.292086 5120 scope.go:117] "RemoveContainer" containerID="2d4d1dcb9934113a035d23ba21d07fb8336b9f2b0597239715eda669c9cb46b1" Mar 16 16:55:01 crc kubenswrapper[5120]: I0316 16:55:01.294514 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:55:01 crc kubenswrapper[5120]: I0316 16:55:01.300773 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:55:01 crc kubenswrapper[5120]: I0316 16:55:01.343500 5120 scope.go:117] "RemoveContainer" containerID="ee30dfd8af3af59f37f37ec99d41afa1ec85248596d20c9e31406083d8a749b1" Mar 16 16:55:01 crc kubenswrapper[5120]: E0316 16:55:01.343962 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee30dfd8af3af59f37f37ec99d41afa1ec85248596d20c9e31406083d8a749b1\": container with ID starting with ee30dfd8af3af59f37f37ec99d41afa1ec85248596d20c9e31406083d8a749b1 not found: ID does not exist" containerID="ee30dfd8af3af59f37f37ec99d41afa1ec85248596d20c9e31406083d8a749b1" Mar 16 16:55:01 crc kubenswrapper[5120]: I0316 16:55:01.343997 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee30dfd8af3af59f37f37ec99d41afa1ec85248596d20c9e31406083d8a749b1"} err="failed to get container status \"ee30dfd8af3af59f37f37ec99d41afa1ec85248596d20c9e31406083d8a749b1\": rpc error: code = NotFound desc = could not find container \"ee30dfd8af3af59f37f37ec99d41afa1ec85248596d20c9e31406083d8a749b1\": container with ID starting with ee30dfd8af3af59f37f37ec99d41afa1ec85248596d20c9e31406083d8a749b1 not found: ID does not exist" Mar 16 16:55:01 crc kubenswrapper[5120]: I0316 16:55:01.344017 5120 scope.go:117] "RemoveContainer" containerID="2d4d1dcb9934113a035d23ba21d07fb8336b9f2b0597239715eda669c9cb46b1" Mar 16 16:55:01 crc kubenswrapper[5120]: E0316 16:55:01.344200 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d4d1dcb9934113a035d23ba21d07fb8336b9f2b0597239715eda669c9cb46b1\": container with ID starting with 2d4d1dcb9934113a035d23ba21d07fb8336b9f2b0597239715eda669c9cb46b1 not found: ID does not exist" containerID="2d4d1dcb9934113a035d23ba21d07fb8336b9f2b0597239715eda669c9cb46b1" Mar 16 16:55:01 crc kubenswrapper[5120]: I0316 16:55:01.344227 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d4d1dcb9934113a035d23ba21d07fb8336b9f2b0597239715eda669c9cb46b1"} err="failed to get container status \"2d4d1dcb9934113a035d23ba21d07fb8336b9f2b0597239715eda669c9cb46b1\": rpc error: code = NotFound desc = could not find container \"2d4d1dcb9934113a035d23ba21d07fb8336b9f2b0597239715eda669c9cb46b1\": container with ID starting with 2d4d1dcb9934113a035d23ba21d07fb8336b9f2b0597239715eda669c9cb46b1 not found: ID does not exist" Mar 16 16:55:01 crc kubenswrapper[5120]: I0316 16:55:01.344240 5120 scope.go:117] "RemoveContainer" containerID="a1c6c6eaee5b058049bbad3a58ced751fece0e218cfd6faf64607f644b0f5ef7" Mar 16 16:55:01 crc kubenswrapper[5120]: I0316 16:55:01.371022 5120 scope.go:117] "RemoveContainer" containerID="a6779b90220d6a446bba6efdb7cf0c284ae282978d42ec7fdb0283bc2a59e6a9" Mar 16 16:55:01 crc kubenswrapper[5120]: I0316 16:55:01.425823 5120 scope.go:117] "RemoveContainer" containerID="a1c6c6eaee5b058049bbad3a58ced751fece0e218cfd6faf64607f644b0f5ef7" Mar 16 16:55:01 crc kubenswrapper[5120]: E0316 16:55:01.426997 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a1c6c6eaee5b058049bbad3a58ced751fece0e218cfd6faf64607f644b0f5ef7\": container with ID starting with a1c6c6eaee5b058049bbad3a58ced751fece0e218cfd6faf64607f644b0f5ef7 not found: ID does not exist" containerID="a1c6c6eaee5b058049bbad3a58ced751fece0e218cfd6faf64607f644b0f5ef7" Mar 16 16:55:01 crc kubenswrapper[5120]: I0316 16:55:01.427038 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1c6c6eaee5b058049bbad3a58ced751fece0e218cfd6faf64607f644b0f5ef7"} err="failed to get container status \"a1c6c6eaee5b058049bbad3a58ced751fece0e218cfd6faf64607f644b0f5ef7\": rpc error: code = NotFound desc = could not find container \"a1c6c6eaee5b058049bbad3a58ced751fece0e218cfd6faf64607f644b0f5ef7\": container with ID starting with a1c6c6eaee5b058049bbad3a58ced751fece0e218cfd6faf64607f644b0f5ef7 not found: ID does not exist" Mar 16 16:55:01 crc kubenswrapper[5120]: I0316 16:55:01.427065 5120 scope.go:117] "RemoveContainer" containerID="a6779b90220d6a446bba6efdb7cf0c284ae282978d42ec7fdb0283bc2a59e6a9" Mar 16 16:55:01 crc kubenswrapper[5120]: E0316 16:55:01.427300 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a6779b90220d6a446bba6efdb7cf0c284ae282978d42ec7fdb0283bc2a59e6a9\": container with ID starting with a6779b90220d6a446bba6efdb7cf0c284ae282978d42ec7fdb0283bc2a59e6a9 not found: ID does not exist" containerID="a6779b90220d6a446bba6efdb7cf0c284ae282978d42ec7fdb0283bc2a59e6a9" Mar 16 16:55:01 crc kubenswrapper[5120]: I0316 16:55:01.427327 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6779b90220d6a446bba6efdb7cf0c284ae282978d42ec7fdb0283bc2a59e6a9"} err="failed to get container status \"a6779b90220d6a446bba6efdb7cf0c284ae282978d42ec7fdb0283bc2a59e6a9\": rpc error: code = NotFound desc = could not find container \"a6779b90220d6a446bba6efdb7cf0c284ae282978d42ec7fdb0283bc2a59e6a9\": container with ID starting with a6779b90220d6a446bba6efdb7cf0c284ae282978d42ec7fdb0283bc2a59e6a9 not found: ID does not exist" Mar 16 16:55:01 crc kubenswrapper[5120]: I0316 16:55:01.449386 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:55:01 crc kubenswrapper[5120]: I0316 16:55:01.532887 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nk9vc\" (UniqueName: \"kubernetes.io/projected/de073433-40f2-40c4-ba26-ae8be3817e67-kube-api-access-nk9vc\") pod \"de073433-40f2-40c4-ba26-ae8be3817e67\" (UID: \"de073433-40f2-40c4-ba26-ae8be3817e67\") " Mar 16 16:55:01 crc kubenswrapper[5120]: I0316 16:55:01.533380 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/de073433-40f2-40c4-ba26-ae8be3817e67-combined-ca-bundle\") pod \"de073433-40f2-40c4-ba26-ae8be3817e67\" (UID: \"de073433-40f2-40c4-ba26-ae8be3817e67\") " Mar 16 16:55:01 crc kubenswrapper[5120]: I0316 16:55:01.533595 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/de073433-40f2-40c4-ba26-ae8be3817e67-config-data\") pod \"de073433-40f2-40c4-ba26-ae8be3817e67\" (UID: \"de073433-40f2-40c4-ba26-ae8be3817e67\") " Mar 16 16:55:01 crc kubenswrapper[5120]: I0316 16:55:01.537740 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de073433-40f2-40c4-ba26-ae8be3817e67-kube-api-access-nk9vc" (OuterVolumeSpecName: "kube-api-access-nk9vc") pod "de073433-40f2-40c4-ba26-ae8be3817e67" (UID: "de073433-40f2-40c4-ba26-ae8be3817e67"). InnerVolumeSpecName "kube-api-access-nk9vc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:55:01 crc kubenswrapper[5120]: I0316 16:55:01.553214 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de073433-40f2-40c4-ba26-ae8be3817e67-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "de073433-40f2-40c4-ba26-ae8be3817e67" (UID: "de073433-40f2-40c4-ba26-ae8be3817e67"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:55:01 crc kubenswrapper[5120]: I0316 16:55:01.553413 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de073433-40f2-40c4-ba26-ae8be3817e67-config-data" (OuterVolumeSpecName: "config-data") pod "de073433-40f2-40c4-ba26-ae8be3817e67" (UID: "de073433-40f2-40c4-ba26-ae8be3817e67"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:55:01 crc kubenswrapper[5120]: I0316 16:55:01.636532 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/de073433-40f2-40c4-ba26-ae8be3817e67-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:55:01 crc kubenswrapper[5120]: I0316 16:55:01.636560 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/de073433-40f2-40c4-ba26-ae8be3817e67-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:55:01 crc kubenswrapper[5120]: I0316 16:55:01.636571 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nk9vc\" (UniqueName: \"kubernetes.io/projected/de073433-40f2-40c4-ba26-ae8be3817e67-kube-api-access-nk9vc\") on node \"crc\" DevicePath \"\"" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.294560 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.294585 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"de073433-40f2-40c4-ba26-ae8be3817e67","Type":"ContainerDied","Data":"89de905e02c3bba7b47f74d8a67b0b725091b7073deb5b85af0d849c265297ee"} Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.295046 5120 scope.go:117] "RemoveContainer" containerID="98f2961dcc312facfab09ff595793480ed2af349689afceae531c8d93b77cfb7" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.326406 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.331843 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.674526 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="67ab3338-c88c-4faf-8d25-809c92d661d9" path="/var/lib/kubelet/pods/67ab3338-c88c-4faf-8d25-809c92d661d9/volumes" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.675100 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="802ef826-c6e7-4a1c-90a6-b419b9489007" path="/var/lib/kubelet/pods/802ef826-c6e7-4a1c-90a6-b419b9489007/volumes" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.675732 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="de073433-40f2-40c4-ba26-ae8be3817e67" path="/var/lib/kubelet/pods/de073433-40f2-40c4-ba26-ae8be3817e67/volumes" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.788809 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["crc-storage/crc-storage-crc-fkjzn"] Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.795306 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["crc-storage/crc-storage-crc-fkjzn"] Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.913506 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["crc-storage/crc-storage-crc-dng2x"] Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.914533 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="472a9d94-a155-4916-aab9-4672a3c6c18c" containerName="barbican-keystone-listener" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.914557 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="472a9d94-a155-4916-aab9-4672a3c6c18c" containerName="barbican-keystone-listener" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.914583 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="152925c6-48ae-4e8d-9a3f-68f01278fe95" containerName="barbican-api-log" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.914590 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="152925c6-48ae-4e8d-9a3f-68f01278fe95" containerName="barbican-api-log" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.914600 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a" containerName="account-reaper" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.914606 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a" containerName="account-reaper" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.914620 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a" containerName="swift-recon-cron" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.914626 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a" containerName="swift-recon-cron" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.914633 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="802ef826-c6e7-4a1c-90a6-b419b9489007" containerName="nova-cell0-conductor-conductor" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.914640 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="802ef826-c6e7-4a1c-90a6-b419b9489007" containerName="nova-cell0-conductor-conductor" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.914650 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3bbdf40-3feb-46ae-a12d-152e88c1bccd" containerName="ceilometer-notification-agent" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.914657 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3bbdf40-3feb-46ae-a12d-152e88c1bccd" containerName="ceilometer-notification-agent" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.914668 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="802ef826-c6e7-4a1c-90a6-b419b9489007" containerName="nova-cell0-conductor-conductor" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.914674 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="802ef826-c6e7-4a1c-90a6-b419b9489007" containerName="nova-cell0-conductor-conductor" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.914682 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27ae46b8-fa26-48e8-a9bb-36bc910c3caf" containerName="setup-container" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.914689 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="27ae46b8-fa26-48e8-a9bb-36bc910c3caf" containerName="setup-container" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.914699 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27ae46b8-fa26-48e8-a9bb-36bc910c3caf" containerName="rabbitmq" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.914704 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="27ae46b8-fa26-48e8-a9bb-36bc910c3caf" containerName="rabbitmq" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.914713 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a" containerName="container-auditor" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.914719 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a" containerName="container-auditor" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.914730 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc4853a6-faf5-45dc-b6f4-aa0b65d0ca8d" containerName="placement-api" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.914736 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc4853a6-faf5-45dc-b6f4-aa0b65d0ca8d" containerName="placement-api" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.914745 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="641d2a6c-6871-488a-8ef3-5a2e693af389" containerName="glance-httpd" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.914751 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="641d2a6c-6871-488a-8ef3-5a2e693af389" containerName="glance-httpd" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.914780 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6ba454f-2263-4fc3-bd13-35f921464d24" containerName="rabbitmq" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.914788 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6ba454f-2263-4fc3-bd13-35f921464d24" containerName="rabbitmq" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.914795 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75da64f9-4c43-4411-bd20-86c98536adce" containerName="glance-log" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.914801 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="75da64f9-4c43-4411-bd20-86c98536adce" containerName="glance-log" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.914809 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a" containerName="account-server" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.914815 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a" containerName="account-server" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.914827 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a" containerName="account-replicator" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.914832 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a" containerName="account-replicator" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.914839 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a" containerName="object-server" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.914845 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a" containerName="object-server" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.914853 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d20086a2-b461-4ca6-b442-f1c1782b833d" containerName="init" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.914860 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="d20086a2-b461-4ca6-b442-f1c1782b833d" containerName="init" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.914875 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6ba454f-2263-4fc3-bd13-35f921464d24" containerName="setup-container" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.914882 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6ba454f-2263-4fc3-bd13-35f921464d24" containerName="setup-container" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.914888 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="152925c6-48ae-4e8d-9a3f-68f01278fe95" containerName="barbican-api" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.914893 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="152925c6-48ae-4e8d-9a3f-68f01278fe95" containerName="barbican-api" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.914902 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a" containerName="object-expirer" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.914907 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a" containerName="object-expirer" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.914917 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a" containerName="account-auditor" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.914922 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a" containerName="account-auditor" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.914930 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb34a81f-663e-4027-bf2c-1d334bd06ba4" containerName="neutron-httpd" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.914935 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb34a81f-663e-4027-bf2c-1d334bd06ba4" containerName="neutron-httpd" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.914944 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="641d2a6c-6871-488a-8ef3-5a2e693af389" containerName="glance-log" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.914949 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="641d2a6c-6871-488a-8ef3-5a2e693af389" containerName="glance-log" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.914956 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8266cfd-9730-429f-8099-e47188d84aba" containerName="nova-metadata-metadata" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.914962 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8266cfd-9730-429f-8099-e47188d84aba" containerName="nova-metadata-metadata" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.914971 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3bbdf40-3feb-46ae-a12d-152e88c1bccd" containerName="sg-core" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.914977 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3bbdf40-3feb-46ae-a12d-152e88c1bccd" containerName="sg-core" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.914984 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d59d2b2a-a98e-4f02-80f4-b6daa5b64d41" containerName="keystone-api" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.914990 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="d59d2b2a-a98e-4f02-80f4-b6daa5b64d41" containerName="keystone-api" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.914998 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04afe1ee-a37b-4e44-91b4-7e15170bb03c" containerName="galera" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.915004 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="04afe1ee-a37b-4e44-91b4-7e15170bb03c" containerName="galera" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.915014 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d20086a2-b461-4ca6-b442-f1c1782b833d" containerName="dnsmasq-dns" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.915021 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="d20086a2-b461-4ca6-b442-f1c1782b833d" containerName="dnsmasq-dns" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.915084 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3bbdf40-3feb-46ae-a12d-152e88c1bccd" containerName="ceilometer-central-agent" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.915093 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3bbdf40-3feb-46ae-a12d-152e88c1bccd" containerName="ceilometer-central-agent" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.915102 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc4853a6-faf5-45dc-b6f4-aa0b65d0ca8d" containerName="placement-log" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.915108 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc4853a6-faf5-45dc-b6f4-aa0b65d0ca8d" containerName="placement-log" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.915117 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae73ae1d-4056-43c2-addd-f08999a4a7f6" containerName="barbican-worker" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.915145 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae73ae1d-4056-43c2-addd-f08999a4a7f6" containerName="barbican-worker" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.915155 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a" containerName="container-server" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.915163 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a" containerName="container-server" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.915175 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cdf5b2c0-4a53-4c60-a566-d18398c0c560" containerName="neutron-api" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.915182 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="cdf5b2c0-4a53-4c60-a566-d18398c0c560" containerName="neutron-api" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.915197 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8a5e446-6e3f-4c8c-b842-f800c1361957" containerName="memcached" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.915204 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8a5e446-6e3f-4c8c-b842-f800c1361957" containerName="memcached" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.915211 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48f680c8-5737-416a-ab55-2c7fcf32c0e2" containerName="probe" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.915218 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="48f680c8-5737-416a-ab55-2c7fcf32c0e2" containerName="probe" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.915237 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a" containerName="object-replicator" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.915243 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a" containerName="object-replicator" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.915253 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4cbd2d6-e498-42bf-a100-bc0c6664e7ed" containerName="cinder-api" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.915257 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4cbd2d6-e498-42bf-a100-bc0c6664e7ed" containerName="cinder-api" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.915269 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67ab3338-c88c-4faf-8d25-809c92d661d9" containerName="nova-cell1-conductor-conductor" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.915276 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="67ab3338-c88c-4faf-8d25-809c92d661d9" containerName="nova-cell1-conductor-conductor" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.915284 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c6098ab-3f23-46bd-95ff-94cf96b88f3f" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.915290 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c6098ab-3f23-46bd-95ff-94cf96b88f3f" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.915299 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48f680c8-5737-416a-ab55-2c7fcf32c0e2" containerName="cinder-scheduler" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.915304 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="48f680c8-5737-416a-ab55-2c7fcf32c0e2" containerName="cinder-scheduler" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.915313 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bbbbc69c-1fe6-40ae-a88a-a470f3f564ed" containerName="mariadb-account-create-update" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.915319 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="bbbbc69c-1fe6-40ae-a88a-a470f3f564ed" containerName="mariadb-account-create-update" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.915328 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67ab3338-c88c-4faf-8d25-809c92d661d9" containerName="nova-cell1-conductor-conductor" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.915333 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="67ab3338-c88c-4faf-8d25-809c92d661d9" containerName="nova-cell1-conductor-conductor" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.915345 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cdf5b2c0-4a53-4c60-a566-d18398c0c560" containerName="neutron-httpd" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.915351 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="cdf5b2c0-4a53-4c60-a566-d18398c0c560" containerName="neutron-httpd" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.915358 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bbbbc69c-1fe6-40ae-a88a-a470f3f564ed" containerName="mariadb-account-create-update" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.915365 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="bbbbc69c-1fe6-40ae-a88a-a470f3f564ed" containerName="mariadb-account-create-update" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.915373 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68500e27-b83c-4571-9082-33e4d4ea3daa" containerName="nova-api-log" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.915379 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="68500e27-b83c-4571-9082-33e4d4ea3daa" containerName="nova-api-log" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.915388 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68500e27-b83c-4571-9082-33e4d4ea3daa" containerName="nova-api-api" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.915393 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="68500e27-b83c-4571-9082-33e4d4ea3daa" containerName="nova-api-api" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.915402 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2f6e14c-b704-4805-b5fa-33de25bc4f0f" containerName="openstack-network-exporter" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.915409 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2f6e14c-b704-4805-b5fa-33de25bc4f0f" containerName="openstack-network-exporter" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.915418 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="689362fd-dae2-4d32-839f-c13ebc515c4c" containerName="proxy-httpd" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.915423 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="689362fd-dae2-4d32-839f-c13ebc515c4c" containerName="proxy-httpd" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.915430 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3bbdf40-3feb-46ae-a12d-152e88c1bccd" containerName="proxy-httpd" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.915436 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3bbdf40-3feb-46ae-a12d-152e88c1bccd" containerName="proxy-httpd" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.915445 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="472a9d94-a155-4916-aab9-4672a3c6c18c" containerName="barbican-keystone-listener-log" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.915450 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="472a9d94-a155-4916-aab9-4672a3c6c18c" containerName="barbican-keystone-listener-log" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.915459 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a" containerName="object-auditor" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.915465 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a" containerName="object-auditor" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.915473 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb34a81f-663e-4027-bf2c-1d334bd06ba4" containerName="neutron-api" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.915479 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb34a81f-663e-4027-bf2c-1d334bd06ba4" containerName="neutron-api" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.915491 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a" containerName="rsync" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.915497 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a" containerName="rsync" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.915505 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2f6e14c-b704-4805-b5fa-33de25bc4f0f" containerName="ovn-northd" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.915510 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2f6e14c-b704-4805-b5fa-33de25bc4f0f" containerName="ovn-northd" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.915521 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae73ae1d-4056-43c2-addd-f08999a4a7f6" containerName="barbican-worker-log" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.915526 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae73ae1d-4056-43c2-addd-f08999a4a7f6" containerName="barbican-worker-log" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.915533 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04afe1ee-a37b-4e44-91b4-7e15170bb03c" containerName="mysql-bootstrap" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.915538 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="04afe1ee-a37b-4e44-91b4-7e15170bb03c" containerName="mysql-bootstrap" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.915546 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de073433-40f2-40c4-ba26-ae8be3817e67" containerName="nova-scheduler-scheduler" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.915551 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="de073433-40f2-40c4-ba26-ae8be3817e67" containerName="nova-scheduler-scheduler" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.915558 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4cbd2d6-e498-42bf-a100-bc0c6664e7ed" containerName="cinder-api-log" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.915563 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4cbd2d6-e498-42bf-a100-bc0c6664e7ed" containerName="cinder-api-log" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.915572 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a93918e6-bb45-4717-afef-978bad1c6612" containerName="galera" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.915578 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a93918e6-bb45-4717-afef-978bad1c6612" containerName="galera" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.915585 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75da64f9-4c43-4411-bd20-86c98536adce" containerName="glance-httpd" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.915590 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="75da64f9-4c43-4411-bd20-86c98536adce" containerName="glance-httpd" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.915599 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a" containerName="container-replicator" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.915604 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a" containerName="container-replicator" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.915612 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="689362fd-dae2-4d32-839f-c13ebc515c4c" containerName="proxy-server" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.915618 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="689362fd-dae2-4d32-839f-c13ebc515c4c" containerName="proxy-server" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.915627 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8266cfd-9730-429f-8099-e47188d84aba" containerName="nova-metadata-log" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.915632 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8266cfd-9730-429f-8099-e47188d84aba" containerName="nova-metadata-log" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.915638 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb34a81f-663e-4027-bf2c-1d334bd06ba4" containerName="neutron-api" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.915643 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb34a81f-663e-4027-bf2c-1d334bd06ba4" containerName="neutron-api" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.915651 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a" containerName="container-updater" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.915656 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a" containerName="container-updater" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.915665 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a93918e6-bb45-4717-afef-978bad1c6612" containerName="mysql-bootstrap" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.915670 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a93918e6-bb45-4717-afef-978bad1c6612" containerName="mysql-bootstrap" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.915678 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a" containerName="object-updater" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.915684 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a" containerName="object-updater" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.915856 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a" containerName="object-server" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.915865 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="472a9d94-a155-4916-aab9-4672a3c6c18c" containerName="barbican-keystone-listener" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.915872 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="75da64f9-4c43-4411-bd20-86c98536adce" containerName="glance-log" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.915879 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e3bbdf40-3feb-46ae-a12d-152e88c1bccd" containerName="ceilometer-central-agent" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.915885 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a" containerName="container-server" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.915892 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="27ae46b8-fa26-48e8-a9bb-36bc910c3caf" containerName="rabbitmq" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.915900 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f4cbd2d6-e498-42bf-a100-bc0c6664e7ed" containerName="cinder-api" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.915906 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a" containerName="account-reaper" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.915951 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ae73ae1d-4056-43c2-addd-f08999a4a7f6" containerName="barbican-worker-log" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.915959 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="641d2a6c-6871-488a-8ef3-5a2e693af389" containerName="glance-log" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.915967 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="bbbbc69c-1fe6-40ae-a88a-a470f3f564ed" containerName="mariadb-account-create-update" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.915974 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="68500e27-b83c-4571-9082-33e4d4ea3daa" containerName="nova-api-log" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.915982 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="d8a5e446-6e3f-4c8c-b842-f800c1361957" containerName="memcached" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.915992 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="689362fd-dae2-4d32-839f-c13ebc515c4c" containerName="proxy-httpd" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.916000 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="a93918e6-bb45-4717-afef-978bad1c6612" containerName="galera" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.916006 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a" containerName="object-updater" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.916014 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a" containerName="account-replicator" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.916021 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="68500e27-b83c-4571-9082-33e4d4ea3daa" containerName="nova-api-api" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.916028 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="d8266cfd-9730-429f-8099-e47188d84aba" containerName="nova-metadata-log" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.916034 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="689362fd-dae2-4d32-839f-c13ebc515c4c" containerName="proxy-server" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.916040 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="67ab3338-c88c-4faf-8d25-809c92d661d9" containerName="nova-cell1-conductor-conductor" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.916048 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a" containerName="swift-recon-cron" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.916055 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="bbbbc69c-1fe6-40ae-a88a-a470f3f564ed" containerName="mariadb-account-create-update" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.916064 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e3bbdf40-3feb-46ae-a12d-152e88c1bccd" containerName="proxy-httpd" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.916070 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="152925c6-48ae-4e8d-9a3f-68f01278fe95" containerName="barbican-api-log" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.916079 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f4cbd2d6-e498-42bf-a100-bc0c6664e7ed" containerName="cinder-api-log" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.916087 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="d2f6e14c-b704-4805-b5fa-33de25bc4f0f" containerName="ovn-northd" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.916093 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="04afe1ee-a37b-4e44-91b4-7e15170bb03c" containerName="galera" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.916100 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="67ab3338-c88c-4faf-8d25-809c92d661d9" containerName="nova-cell1-conductor-conductor" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.916107 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a" containerName="object-replicator" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.916116 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="cc4853a6-faf5-45dc-b6f4-aa0b65d0ca8d" containerName="placement-log" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.916123 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="eb34a81f-663e-4027-bf2c-1d334bd06ba4" containerName="neutron-api" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.916130 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="cdf5b2c0-4a53-4c60-a566-d18398c0c560" containerName="neutron-api" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.916139 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="67ab3338-c88c-4faf-8d25-809c92d661d9" containerName="nova-cell1-conductor-conductor" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.916149 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a" containerName="rsync" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.916156 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="de073433-40f2-40c4-ba26-ae8be3817e67" containerName="nova-scheduler-scheduler" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.916162 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a" containerName="container-auditor" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.916172 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="802ef826-c6e7-4a1c-90a6-b419b9489007" containerName="nova-cell0-conductor-conductor" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.916179 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="48f680c8-5737-416a-ab55-2c7fcf32c0e2" containerName="cinder-scheduler" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.916185 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c6ba454f-2263-4fc3-bd13-35f921464d24" containerName="rabbitmq" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.916193 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a" containerName="container-replicator" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.916201 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="75da64f9-4c43-4411-bd20-86c98536adce" containerName="glance-httpd" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.916210 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e3bbdf40-3feb-46ae-a12d-152e88c1bccd" containerName="sg-core" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.916217 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1c6098ab-3f23-46bd-95ff-94cf96b88f3f" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.916224 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="cdf5b2c0-4a53-4c60-a566-d18398c0c560" containerName="neutron-httpd" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.916231 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a" containerName="object-auditor" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.916238 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="d20086a2-b461-4ca6-b442-f1c1782b833d" containerName="dnsmasq-dns" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.916247 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="d8266cfd-9730-429f-8099-e47188d84aba" containerName="nova-metadata-metadata" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.916255 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="472a9d94-a155-4916-aab9-4672a3c6c18c" containerName="barbican-keystone-listener-log" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.916262 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a" containerName="account-auditor" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.916271 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a" containerName="object-expirer" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.916280 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e3bbdf40-3feb-46ae-a12d-152e88c1bccd" containerName="ceilometer-notification-agent" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.916289 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="d2f6e14c-b704-4805-b5fa-33de25bc4f0f" containerName="openstack-network-exporter" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.916298 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a" containerName="account-server" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.916304 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="d59d2b2a-a98e-4f02-80f4-b6daa5b64d41" containerName="keystone-api" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.916311 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="48f680c8-5737-416a-ab55-2c7fcf32c0e2" containerName="probe" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.916319 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="bd4ebfe8-826f-4d1c-9b58-1f9d2d7d666a" containerName="container-updater" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.916325 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="cc4853a6-faf5-45dc-b6f4-aa0b65d0ca8d" containerName="placement-api" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.916332 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="152925c6-48ae-4e8d-9a3f-68f01278fe95" containerName="barbican-api" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.916341 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ae73ae1d-4056-43c2-addd-f08999a4a7f6" containerName="barbican-worker" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.916348 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="802ef826-c6e7-4a1c-90a6-b419b9489007" containerName="nova-cell0-conductor-conductor" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.916355 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="eb34a81f-663e-4027-bf2c-1d334bd06ba4" containerName="neutron-httpd" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.916361 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="802ef826-c6e7-4a1c-90a6-b419b9489007" containerName="nova-cell0-conductor-conductor" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.916368 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="641d2a6c-6871-488a-8ef3-5a2e693af389" containerName="glance-httpd" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.946352 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-dng2x"] Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.946454 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-dng2x" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.950028 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"crc-storage\"" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.950320 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"openshift-service-ca.crt\"" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.950557 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"kube-root-ca.crt\"" Mar 16 16:55:02 crc kubenswrapper[5120]: I0316 16:55:02.950725 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"crc-storage\"/\"crc-storage-dockercfg-s2tht\"" Mar 16 16:55:03 crc kubenswrapper[5120]: I0316 16:55:03.064511 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/e0899dcf-1471-46f5-9a83-9ba9d10484ee-crc-storage\") pod \"crc-storage-crc-dng2x\" (UID: \"e0899dcf-1471-46f5-9a83-9ba9d10484ee\") " pod="crc-storage/crc-storage-crc-dng2x" Mar 16 16:55:03 crc kubenswrapper[5120]: I0316 16:55:03.064692 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78f2x\" (UniqueName: \"kubernetes.io/projected/e0899dcf-1471-46f5-9a83-9ba9d10484ee-kube-api-access-78f2x\") pod \"crc-storage-crc-dng2x\" (UID: \"e0899dcf-1471-46f5-9a83-9ba9d10484ee\") " pod="crc-storage/crc-storage-crc-dng2x" Mar 16 16:55:03 crc kubenswrapper[5120]: I0316 16:55:03.065065 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/e0899dcf-1471-46f5-9a83-9ba9d10484ee-node-mnt\") pod \"crc-storage-crc-dng2x\" (UID: \"e0899dcf-1471-46f5-9a83-9ba9d10484ee\") " pod="crc-storage/crc-storage-crc-dng2x" Mar 16 16:55:03 crc kubenswrapper[5120]: I0316 16:55:03.166905 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/e0899dcf-1471-46f5-9a83-9ba9d10484ee-node-mnt\") pod \"crc-storage-crc-dng2x\" (UID: \"e0899dcf-1471-46f5-9a83-9ba9d10484ee\") " pod="crc-storage/crc-storage-crc-dng2x" Mar 16 16:55:03 crc kubenswrapper[5120]: I0316 16:55:03.167049 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/e0899dcf-1471-46f5-9a83-9ba9d10484ee-crc-storage\") pod \"crc-storage-crc-dng2x\" (UID: \"e0899dcf-1471-46f5-9a83-9ba9d10484ee\") " pod="crc-storage/crc-storage-crc-dng2x" Mar 16 16:55:03 crc kubenswrapper[5120]: I0316 16:55:03.167114 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-78f2x\" (UniqueName: \"kubernetes.io/projected/e0899dcf-1471-46f5-9a83-9ba9d10484ee-kube-api-access-78f2x\") pod \"crc-storage-crc-dng2x\" (UID: \"e0899dcf-1471-46f5-9a83-9ba9d10484ee\") " pod="crc-storage/crc-storage-crc-dng2x" Mar 16 16:55:03 crc kubenswrapper[5120]: I0316 16:55:03.167209 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/e0899dcf-1471-46f5-9a83-9ba9d10484ee-node-mnt\") pod \"crc-storage-crc-dng2x\" (UID: \"e0899dcf-1471-46f5-9a83-9ba9d10484ee\") " pod="crc-storage/crc-storage-crc-dng2x" Mar 16 16:55:03 crc kubenswrapper[5120]: I0316 16:55:03.167943 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/e0899dcf-1471-46f5-9a83-9ba9d10484ee-crc-storage\") pod \"crc-storage-crc-dng2x\" (UID: \"e0899dcf-1471-46f5-9a83-9ba9d10484ee\") " pod="crc-storage/crc-storage-crc-dng2x" Mar 16 16:55:03 crc kubenswrapper[5120]: I0316 16:55:03.185451 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-78f2x\" (UniqueName: \"kubernetes.io/projected/e0899dcf-1471-46f5-9a83-9ba9d10484ee-kube-api-access-78f2x\") pod \"crc-storage-crc-dng2x\" (UID: \"e0899dcf-1471-46f5-9a83-9ba9d10484ee\") " pod="crc-storage/crc-storage-crc-dng2x" Mar 16 16:55:03 crc kubenswrapper[5120]: I0316 16:55:03.266652 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-dng2x" Mar 16 16:55:03 crc kubenswrapper[5120]: I0316 16:55:03.665235 5120 scope.go:117] "RemoveContainer" containerID="083f72646c8d47c9c0467b39be99ddfa9c2e5900ae0a29ad53d7b39b950274b4" Mar 16 16:55:03 crc kubenswrapper[5120]: E0316 16:55:03.665890 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:55:03 crc kubenswrapper[5120]: I0316 16:55:03.673576 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-dng2x"] Mar 16 16:55:03 crc kubenswrapper[5120]: W0316 16:55:03.677186 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode0899dcf_1471_46f5_9a83_9ba9d10484ee.slice/crio-912a17e30aac5ce59f9b7a5a11d82c7190a3c2f0c731e20b90bc65d78ce5793f WatchSource:0}: Error finding container 912a17e30aac5ce59f9b7a5a11d82c7190a3c2f0c731e20b90bc65d78ce5793f: Status 404 returned error can't find the container with id 912a17e30aac5ce59f9b7a5a11d82c7190a3c2f0c731e20b90bc65d78ce5793f Mar 16 16:55:03 crc kubenswrapper[5120]: I0316 16:55:03.679577 5120 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Mar 16 16:55:04 crc kubenswrapper[5120]: I0316 16:55:04.317599 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-dng2x" event={"ID":"e0899dcf-1471-46f5-9a83-9ba9d10484ee","Type":"ContainerStarted","Data":"912a17e30aac5ce59f9b7a5a11d82c7190a3c2f0c731e20b90bc65d78ce5793f"} Mar 16 16:55:04 crc kubenswrapper[5120]: I0316 16:55:04.680942 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bf798994-fe12-4c49-a38f-dc353c7432eb" path="/var/lib/kubelet/pods/bf798994-fe12-4c49-a38f-dc353c7432eb/volumes" Mar 16 16:55:05 crc kubenswrapper[5120]: I0316 16:55:05.330654 5120 generic.go:358] "Generic (PLEG): container finished" podID="e0899dcf-1471-46f5-9a83-9ba9d10484ee" containerID="28b9a50d02777d9bada17a7deaf883b3a5c44bf2b1edfc4884e2c9ba176b9986" exitCode=0 Mar 16 16:55:05 crc kubenswrapper[5120]: I0316 16:55:05.330803 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-dng2x" event={"ID":"e0899dcf-1471-46f5-9a83-9ba9d10484ee","Type":"ContainerDied","Data":"28b9a50d02777d9bada17a7deaf883b3a5c44bf2b1edfc4884e2c9ba176b9986"} Mar 16 16:55:06 crc kubenswrapper[5120]: I0316 16:55:06.662231 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-dng2x" Mar 16 16:55:06 crc kubenswrapper[5120]: I0316 16:55:06.741657 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-78f2x\" (UniqueName: \"kubernetes.io/projected/e0899dcf-1471-46f5-9a83-9ba9d10484ee-kube-api-access-78f2x\") pod \"e0899dcf-1471-46f5-9a83-9ba9d10484ee\" (UID: \"e0899dcf-1471-46f5-9a83-9ba9d10484ee\") " Mar 16 16:55:06 crc kubenswrapper[5120]: I0316 16:55:06.743138 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/e0899dcf-1471-46f5-9a83-9ba9d10484ee-crc-storage\") pod \"e0899dcf-1471-46f5-9a83-9ba9d10484ee\" (UID: \"e0899dcf-1471-46f5-9a83-9ba9d10484ee\") " Mar 16 16:55:06 crc kubenswrapper[5120]: I0316 16:55:06.743392 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/e0899dcf-1471-46f5-9a83-9ba9d10484ee-node-mnt\") pod \"e0899dcf-1471-46f5-9a83-9ba9d10484ee\" (UID: \"e0899dcf-1471-46f5-9a83-9ba9d10484ee\") " Mar 16 16:55:06 crc kubenswrapper[5120]: I0316 16:55:06.743514 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/e0899dcf-1471-46f5-9a83-9ba9d10484ee-node-mnt" (OuterVolumeSpecName: "node-mnt") pod "e0899dcf-1471-46f5-9a83-9ba9d10484ee" (UID: "e0899dcf-1471-46f5-9a83-9ba9d10484ee"). InnerVolumeSpecName "node-mnt". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 16:55:06 crc kubenswrapper[5120]: I0316 16:55:06.744653 5120 reconciler_common.go:299] "Volume detached for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/e0899dcf-1471-46f5-9a83-9ba9d10484ee-node-mnt\") on node \"crc\" DevicePath \"\"" Mar 16 16:55:06 crc kubenswrapper[5120]: I0316 16:55:06.748198 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0899dcf-1471-46f5-9a83-9ba9d10484ee-kube-api-access-78f2x" (OuterVolumeSpecName: "kube-api-access-78f2x") pod "e0899dcf-1471-46f5-9a83-9ba9d10484ee" (UID: "e0899dcf-1471-46f5-9a83-9ba9d10484ee"). InnerVolumeSpecName "kube-api-access-78f2x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:55:06 crc kubenswrapper[5120]: I0316 16:55:06.760474 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0899dcf-1471-46f5-9a83-9ba9d10484ee-crc-storage" (OuterVolumeSpecName: "crc-storage") pod "e0899dcf-1471-46f5-9a83-9ba9d10484ee" (UID: "e0899dcf-1471-46f5-9a83-9ba9d10484ee"). InnerVolumeSpecName "crc-storage". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:55:06 crc kubenswrapper[5120]: I0316 16:55:06.846509 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-78f2x\" (UniqueName: \"kubernetes.io/projected/e0899dcf-1471-46f5-9a83-9ba9d10484ee-kube-api-access-78f2x\") on node \"crc\" DevicePath \"\"" Mar 16 16:55:06 crc kubenswrapper[5120]: I0316 16:55:06.846544 5120 reconciler_common.go:299] "Volume detached for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/e0899dcf-1471-46f5-9a83-9ba9d10484ee-crc-storage\") on node \"crc\" DevicePath \"\"" Mar 16 16:55:07 crc kubenswrapper[5120]: I0316 16:55:07.350980 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-dng2x" Mar 16 16:55:07 crc kubenswrapper[5120]: I0316 16:55:07.351261 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-dng2x" event={"ID":"e0899dcf-1471-46f5-9a83-9ba9d10484ee","Type":"ContainerDied","Data":"912a17e30aac5ce59f9b7a5a11d82c7190a3c2f0c731e20b90bc65d78ce5793f"} Mar 16 16:55:07 crc kubenswrapper[5120]: I0316 16:55:07.351305 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="912a17e30aac5ce59f9b7a5a11d82c7190a3c2f0c731e20b90bc65d78ce5793f" Mar 16 16:55:07 crc kubenswrapper[5120]: E0316 16:55:07.510573 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1306227 actualBytes=10240 Mar 16 16:55:10 crc kubenswrapper[5120]: I0316 16:55:10.006222 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["crc-storage/crc-storage-crc-dng2x"] Mar 16 16:55:10 crc kubenswrapper[5120]: I0316 16:55:10.011601 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["crc-storage/crc-storage-crc-dng2x"] Mar 16 16:55:10 crc kubenswrapper[5120]: I0316 16:55:10.125457 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["crc-storage/crc-storage-crc-j7v5h"] Mar 16 16:55:10 crc kubenswrapper[5120]: I0316 16:55:10.127046 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="802ef826-c6e7-4a1c-90a6-b419b9489007" containerName="nova-cell0-conductor-conductor" Mar 16 16:55:10 crc kubenswrapper[5120]: I0316 16:55:10.127075 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="802ef826-c6e7-4a1c-90a6-b419b9489007" containerName="nova-cell0-conductor-conductor" Mar 16 16:55:10 crc kubenswrapper[5120]: I0316 16:55:10.127127 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0899dcf-1471-46f5-9a83-9ba9d10484ee" containerName="storage" Mar 16 16:55:10 crc kubenswrapper[5120]: I0316 16:55:10.127137 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0899dcf-1471-46f5-9a83-9ba9d10484ee" containerName="storage" Mar 16 16:55:10 crc kubenswrapper[5120]: I0316 16:55:10.127146 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67ab3338-c88c-4faf-8d25-809c92d661d9" containerName="nova-cell1-conductor-conductor" Mar 16 16:55:10 crc kubenswrapper[5120]: I0316 16:55:10.127153 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="67ab3338-c88c-4faf-8d25-809c92d661d9" containerName="nova-cell1-conductor-conductor" Mar 16 16:55:10 crc kubenswrapper[5120]: I0316 16:55:10.127320 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e0899dcf-1471-46f5-9a83-9ba9d10484ee" containerName="storage" Mar 16 16:55:10 crc kubenswrapper[5120]: I0316 16:55:10.127342 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="eb34a81f-663e-4027-bf2c-1d334bd06ba4" containerName="neutron-api" Mar 16 16:55:10 crc kubenswrapper[5120]: I0316 16:55:10.132576 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-j7v5h" Mar 16 16:55:10 crc kubenswrapper[5120]: I0316 16:55:10.135587 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"crc-storage\"" Mar 16 16:55:10 crc kubenswrapper[5120]: I0316 16:55:10.135977 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"crc-storage\"/\"crc-storage-dockercfg-s2tht\"" Mar 16 16:55:10 crc kubenswrapper[5120]: I0316 16:55:10.136035 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"kube-root-ca.crt\"" Mar 16 16:55:10 crc kubenswrapper[5120]: I0316 16:55:10.138628 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"openshift-service-ca.crt\"" Mar 16 16:55:10 crc kubenswrapper[5120]: I0316 16:55:10.141243 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-j7v5h"] Mar 16 16:55:10 crc kubenswrapper[5120]: I0316 16:55:10.218419 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/2951275c-5d51-4ae9-9641-0bd37442e8a1-crc-storage\") pod \"crc-storage-crc-j7v5h\" (UID: \"2951275c-5d51-4ae9-9641-0bd37442e8a1\") " pod="crc-storage/crc-storage-crc-j7v5h" Mar 16 16:55:10 crc kubenswrapper[5120]: I0316 16:55:10.218857 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/2951275c-5d51-4ae9-9641-0bd37442e8a1-node-mnt\") pod \"crc-storage-crc-j7v5h\" (UID: \"2951275c-5d51-4ae9-9641-0bd37442e8a1\") " pod="crc-storage/crc-storage-crc-j7v5h" Mar 16 16:55:10 crc kubenswrapper[5120]: I0316 16:55:10.218918 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpt5x\" (UniqueName: \"kubernetes.io/projected/2951275c-5d51-4ae9-9641-0bd37442e8a1-kube-api-access-cpt5x\") pod \"crc-storage-crc-j7v5h\" (UID: \"2951275c-5d51-4ae9-9641-0bd37442e8a1\") " pod="crc-storage/crc-storage-crc-j7v5h" Mar 16 16:55:10 crc kubenswrapper[5120]: I0316 16:55:10.321343 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/2951275c-5d51-4ae9-9641-0bd37442e8a1-crc-storage\") pod \"crc-storage-crc-j7v5h\" (UID: \"2951275c-5d51-4ae9-9641-0bd37442e8a1\") " pod="crc-storage/crc-storage-crc-j7v5h" Mar 16 16:55:10 crc kubenswrapper[5120]: I0316 16:55:10.321646 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/2951275c-5d51-4ae9-9641-0bd37442e8a1-node-mnt\") pod \"crc-storage-crc-j7v5h\" (UID: \"2951275c-5d51-4ae9-9641-0bd37442e8a1\") " pod="crc-storage/crc-storage-crc-j7v5h" Mar 16 16:55:10 crc kubenswrapper[5120]: I0316 16:55:10.321851 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cpt5x\" (UniqueName: \"kubernetes.io/projected/2951275c-5d51-4ae9-9641-0bd37442e8a1-kube-api-access-cpt5x\") pod \"crc-storage-crc-j7v5h\" (UID: \"2951275c-5d51-4ae9-9641-0bd37442e8a1\") " pod="crc-storage/crc-storage-crc-j7v5h" Mar 16 16:55:10 crc kubenswrapper[5120]: I0316 16:55:10.321994 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/2951275c-5d51-4ae9-9641-0bd37442e8a1-node-mnt\") pod \"crc-storage-crc-j7v5h\" (UID: \"2951275c-5d51-4ae9-9641-0bd37442e8a1\") " pod="crc-storage/crc-storage-crc-j7v5h" Mar 16 16:55:10 crc kubenswrapper[5120]: I0316 16:55:10.322285 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/2951275c-5d51-4ae9-9641-0bd37442e8a1-crc-storage\") pod \"crc-storage-crc-j7v5h\" (UID: \"2951275c-5d51-4ae9-9641-0bd37442e8a1\") " pod="crc-storage/crc-storage-crc-j7v5h" Mar 16 16:55:10 crc kubenswrapper[5120]: I0316 16:55:10.346141 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpt5x\" (UniqueName: \"kubernetes.io/projected/2951275c-5d51-4ae9-9641-0bd37442e8a1-kube-api-access-cpt5x\") pod \"crc-storage-crc-j7v5h\" (UID: \"2951275c-5d51-4ae9-9641-0bd37442e8a1\") " pod="crc-storage/crc-storage-crc-j7v5h" Mar 16 16:55:10 crc kubenswrapper[5120]: I0316 16:55:10.452005 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-j7v5h" Mar 16 16:55:10 crc kubenswrapper[5120]: I0316 16:55:10.674428 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e0899dcf-1471-46f5-9a83-9ba9d10484ee" path="/var/lib/kubelet/pods/e0899dcf-1471-46f5-9a83-9ba9d10484ee/volumes" Mar 16 16:55:10 crc kubenswrapper[5120]: I0316 16:55:10.905638 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-j7v5h"] Mar 16 16:55:11 crc kubenswrapper[5120]: I0316 16:55:11.387987 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-j7v5h" event={"ID":"2951275c-5d51-4ae9-9641-0bd37442e8a1","Type":"ContainerStarted","Data":"e7f8fb13b9743fc743a25a40afd5c9455fcb02a044223ba483981234760b9d70"} Mar 16 16:55:12 crc kubenswrapper[5120]: I0316 16:55:12.399691 5120 generic.go:358] "Generic (PLEG): container finished" podID="2951275c-5d51-4ae9-9641-0bd37442e8a1" containerID="cb5b099e8c1325832f7d541bdef7d9c5ee362bf6d7ee63b77d215da30a14184e" exitCode=0 Mar 16 16:55:12 crc kubenswrapper[5120]: I0316 16:55:12.399795 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-j7v5h" event={"ID":"2951275c-5d51-4ae9-9641-0bd37442e8a1","Type":"ContainerDied","Data":"cb5b099e8c1325832f7d541bdef7d9c5ee362bf6d7ee63b77d215da30a14184e"} Mar 16 16:55:13 crc kubenswrapper[5120]: I0316 16:55:13.665095 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-j7v5h" Mar 16 16:55:13 crc kubenswrapper[5120]: I0316 16:55:13.801331 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cpt5x\" (UniqueName: \"kubernetes.io/projected/2951275c-5d51-4ae9-9641-0bd37442e8a1-kube-api-access-cpt5x\") pod \"2951275c-5d51-4ae9-9641-0bd37442e8a1\" (UID: \"2951275c-5d51-4ae9-9641-0bd37442e8a1\") " Mar 16 16:55:13 crc kubenswrapper[5120]: I0316 16:55:13.801442 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/2951275c-5d51-4ae9-9641-0bd37442e8a1-crc-storage\") pod \"2951275c-5d51-4ae9-9641-0bd37442e8a1\" (UID: \"2951275c-5d51-4ae9-9641-0bd37442e8a1\") " Mar 16 16:55:13 crc kubenswrapper[5120]: I0316 16:55:13.801717 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/2951275c-5d51-4ae9-9641-0bd37442e8a1-node-mnt\") pod \"2951275c-5d51-4ae9-9641-0bd37442e8a1\" (UID: \"2951275c-5d51-4ae9-9641-0bd37442e8a1\") " Mar 16 16:55:13 crc kubenswrapper[5120]: I0316 16:55:13.801936 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/2951275c-5d51-4ae9-9641-0bd37442e8a1-node-mnt" (OuterVolumeSpecName: "node-mnt") pod "2951275c-5d51-4ae9-9641-0bd37442e8a1" (UID: "2951275c-5d51-4ae9-9641-0bd37442e8a1"). InnerVolumeSpecName "node-mnt". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 16:55:13 crc kubenswrapper[5120]: I0316 16:55:13.802317 5120 reconciler_common.go:299] "Volume detached for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/2951275c-5d51-4ae9-9641-0bd37442e8a1-node-mnt\") on node \"crc\" DevicePath \"\"" Mar 16 16:55:13 crc kubenswrapper[5120]: I0316 16:55:13.808146 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2951275c-5d51-4ae9-9641-0bd37442e8a1-kube-api-access-cpt5x" (OuterVolumeSpecName: "kube-api-access-cpt5x") pod "2951275c-5d51-4ae9-9641-0bd37442e8a1" (UID: "2951275c-5d51-4ae9-9641-0bd37442e8a1"). InnerVolumeSpecName "kube-api-access-cpt5x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:55:13 crc kubenswrapper[5120]: I0316 16:55:13.826268 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2951275c-5d51-4ae9-9641-0bd37442e8a1-crc-storage" (OuterVolumeSpecName: "crc-storage") pod "2951275c-5d51-4ae9-9641-0bd37442e8a1" (UID: "2951275c-5d51-4ae9-9641-0bd37442e8a1"). InnerVolumeSpecName "crc-storage". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:55:13 crc kubenswrapper[5120]: I0316 16:55:13.903415 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cpt5x\" (UniqueName: \"kubernetes.io/projected/2951275c-5d51-4ae9-9641-0bd37442e8a1-kube-api-access-cpt5x\") on node \"crc\" DevicePath \"\"" Mar 16 16:55:13 crc kubenswrapper[5120]: I0316 16:55:13.903450 5120 reconciler_common.go:299] "Volume detached for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/2951275c-5d51-4ae9-9641-0bd37442e8a1-crc-storage\") on node \"crc\" DevicePath \"\"" Mar 16 16:55:14 crc kubenswrapper[5120]: I0316 16:55:14.422209 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-j7v5h" Mar 16 16:55:14 crc kubenswrapper[5120]: I0316 16:55:14.422582 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-j7v5h" event={"ID":"2951275c-5d51-4ae9-9641-0bd37442e8a1","Type":"ContainerDied","Data":"e7f8fb13b9743fc743a25a40afd5c9455fcb02a044223ba483981234760b9d70"} Mar 16 16:55:14 crc kubenswrapper[5120]: I0316 16:55:14.422635 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e7f8fb13b9743fc743a25a40afd5c9455fcb02a044223ba483981234760b9d70" Mar 16 16:55:15 crc kubenswrapper[5120]: I0316 16:55:15.664504 5120 scope.go:117] "RemoveContainer" containerID="083f72646c8d47c9c0467b39be99ddfa9c2e5900ae0a29ad53d7b39b950274b4" Mar 16 16:55:15 crc kubenswrapper[5120]: E0316 16:55:15.665202 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:55:27 crc kubenswrapper[5120]: I0316 16:55:27.087740 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 16:55:27 crc kubenswrapper[5120]: I0316 16:55:27.089118 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2951275c-5d51-4ae9-9641-0bd37442e8a1" containerName="storage" Mar 16 16:55:27 crc kubenswrapper[5120]: I0316 16:55:27.089132 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="2951275c-5d51-4ae9-9641-0bd37442e8a1" containerName="storage" Mar 16 16:55:27 crc kubenswrapper[5120]: I0316 16:55:27.089625 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="2951275c-5d51-4ae9-9641-0bd37442e8a1" containerName="storage" Mar 16 16:55:27 crc kubenswrapper[5120]: I0316 16:55:27.100538 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 16:55:27 crc kubenswrapper[5120]: I0316 16:55:27.100676 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:55:27 crc kubenswrapper[5120]: I0316 16:55:27.103395 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-server-dockercfg-9jxtg\"" Mar 16 16:55:27 crc kubenswrapper[5120]: I0316 16:55:27.103520 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-rabbitmq-svc\"" Mar 16 16:55:27 crc kubenswrapper[5120]: I0316 16:55:27.103582 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-config-data\"" Mar 16 16:55:27 crc kubenswrapper[5120]: I0316 16:55:27.103740 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-plugins-conf\"" Mar 16 16:55:27 crc kubenswrapper[5120]: I0316 16:55:27.103798 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-default-user\"" Mar 16 16:55:27 crc kubenswrapper[5120]: I0316 16:55:27.104396 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-erlang-cookie\"" Mar 16 16:55:27 crc kubenswrapper[5120]: I0316 16:55:27.104668 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-server-conf\"" Mar 16 16:55:27 crc kubenswrapper[5120]: I0316 16:55:27.142475 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/4ed551c0-3f37-4af6-b682-b9e35fd5fa42-server-conf\") pod \"rabbitmq-server-0\" (UID: \"4ed551c0-3f37-4af6-b682-b9e35fd5fa42\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:55:27 crc kubenswrapper[5120]: I0316 16:55:27.142535 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/4ed551c0-3f37-4af6-b682-b9e35fd5fa42-config-data\") pod \"rabbitmq-server-0\" (UID: \"4ed551c0-3f37-4af6-b682-b9e35fd5fa42\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:55:27 crc kubenswrapper[5120]: I0316 16:55:27.142709 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/4ed551c0-3f37-4af6-b682-b9e35fd5fa42-pod-info\") pod \"rabbitmq-server-0\" (UID: \"4ed551c0-3f37-4af6-b682-b9e35fd5fa42\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:55:27 crc kubenswrapper[5120]: I0316 16:55:27.142784 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/4ed551c0-3f37-4af6-b682-b9e35fd5fa42-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"4ed551c0-3f37-4af6-b682-b9e35fd5fa42\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:55:27 crc kubenswrapper[5120]: I0316 16:55:27.142828 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkn8j\" (UniqueName: \"kubernetes.io/projected/4ed551c0-3f37-4af6-b682-b9e35fd5fa42-kube-api-access-nkn8j\") pod \"rabbitmq-server-0\" (UID: \"4ed551c0-3f37-4af6-b682-b9e35fd5fa42\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:55:27 crc kubenswrapper[5120]: I0316 16:55:27.142875 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/4ed551c0-3f37-4af6-b682-b9e35fd5fa42-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"4ed551c0-3f37-4af6-b682-b9e35fd5fa42\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:55:27 crc kubenswrapper[5120]: I0316 16:55:27.142990 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/4ed551c0-3f37-4af6-b682-b9e35fd5fa42-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"4ed551c0-3f37-4af6-b682-b9e35fd5fa42\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:55:27 crc kubenswrapper[5120]: I0316 16:55:27.143116 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/4ed551c0-3f37-4af6-b682-b9e35fd5fa42-rabbitmq-tls\") pod \"rabbitmq-server-0\" (UID: \"4ed551c0-3f37-4af6-b682-b9e35fd5fa42\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:55:27 crc kubenswrapper[5120]: I0316 16:55:27.143336 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/4ed551c0-3f37-4af6-b682-b9e35fd5fa42-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"4ed551c0-3f37-4af6-b682-b9e35fd5fa42\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:55:27 crc kubenswrapper[5120]: I0316 16:55:27.143503 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/4ed551c0-3f37-4af6-b682-b9e35fd5fa42-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"4ed551c0-3f37-4af6-b682-b9e35fd5fa42\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:55:27 crc kubenswrapper[5120]: I0316 16:55:27.143545 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") pod \"rabbitmq-server-0\" (UID: \"4ed551c0-3f37-4af6-b682-b9e35fd5fa42\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:55:27 crc kubenswrapper[5120]: I0316 16:55:27.245057 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/4ed551c0-3f37-4af6-b682-b9e35fd5fa42-server-conf\") pod \"rabbitmq-server-0\" (UID: \"4ed551c0-3f37-4af6-b682-b9e35fd5fa42\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:55:27 crc kubenswrapper[5120]: I0316 16:55:27.245112 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/4ed551c0-3f37-4af6-b682-b9e35fd5fa42-config-data\") pod \"rabbitmq-server-0\" (UID: \"4ed551c0-3f37-4af6-b682-b9e35fd5fa42\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:55:27 crc kubenswrapper[5120]: I0316 16:55:27.245167 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/4ed551c0-3f37-4af6-b682-b9e35fd5fa42-pod-info\") pod \"rabbitmq-server-0\" (UID: \"4ed551c0-3f37-4af6-b682-b9e35fd5fa42\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:55:27 crc kubenswrapper[5120]: I0316 16:55:27.245190 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/4ed551c0-3f37-4af6-b682-b9e35fd5fa42-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"4ed551c0-3f37-4af6-b682-b9e35fd5fa42\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:55:27 crc kubenswrapper[5120]: I0316 16:55:27.245218 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nkn8j\" (UniqueName: \"kubernetes.io/projected/4ed551c0-3f37-4af6-b682-b9e35fd5fa42-kube-api-access-nkn8j\") pod \"rabbitmq-server-0\" (UID: \"4ed551c0-3f37-4af6-b682-b9e35fd5fa42\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:55:27 crc kubenswrapper[5120]: I0316 16:55:27.245239 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/4ed551c0-3f37-4af6-b682-b9e35fd5fa42-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"4ed551c0-3f37-4af6-b682-b9e35fd5fa42\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:55:27 crc kubenswrapper[5120]: I0316 16:55:27.245266 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/4ed551c0-3f37-4af6-b682-b9e35fd5fa42-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"4ed551c0-3f37-4af6-b682-b9e35fd5fa42\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:55:27 crc kubenswrapper[5120]: I0316 16:55:27.245319 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/4ed551c0-3f37-4af6-b682-b9e35fd5fa42-rabbitmq-tls\") pod \"rabbitmq-server-0\" (UID: \"4ed551c0-3f37-4af6-b682-b9e35fd5fa42\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:55:27 crc kubenswrapper[5120]: I0316 16:55:27.245395 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/4ed551c0-3f37-4af6-b682-b9e35fd5fa42-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"4ed551c0-3f37-4af6-b682-b9e35fd5fa42\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:55:27 crc kubenswrapper[5120]: I0316 16:55:27.245453 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/4ed551c0-3f37-4af6-b682-b9e35fd5fa42-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"4ed551c0-3f37-4af6-b682-b9e35fd5fa42\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:55:27 crc kubenswrapper[5120]: I0316 16:55:27.245473 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") pod \"rabbitmq-server-0\" (UID: \"4ed551c0-3f37-4af6-b682-b9e35fd5fa42\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:55:27 crc kubenswrapper[5120]: I0316 16:55:27.245864 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") pod \"rabbitmq-server-0\" (UID: \"4ed551c0-3f37-4af6-b682-b9e35fd5fa42\") device mount path \"/mnt/openstack/pv17\"" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:55:27 crc kubenswrapper[5120]: I0316 16:55:27.246394 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/4ed551c0-3f37-4af6-b682-b9e35fd5fa42-server-conf\") pod \"rabbitmq-server-0\" (UID: \"4ed551c0-3f37-4af6-b682-b9e35fd5fa42\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:55:27 crc kubenswrapper[5120]: I0316 16:55:27.246604 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/4ed551c0-3f37-4af6-b682-b9e35fd5fa42-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"4ed551c0-3f37-4af6-b682-b9e35fd5fa42\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:55:27 crc kubenswrapper[5120]: I0316 16:55:27.246669 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/4ed551c0-3f37-4af6-b682-b9e35fd5fa42-config-data\") pod \"rabbitmq-server-0\" (UID: \"4ed551c0-3f37-4af6-b682-b9e35fd5fa42\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:55:27 crc kubenswrapper[5120]: I0316 16:55:27.246721 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/4ed551c0-3f37-4af6-b682-b9e35fd5fa42-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"4ed551c0-3f37-4af6-b682-b9e35fd5fa42\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:55:27 crc kubenswrapper[5120]: I0316 16:55:27.247053 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/4ed551c0-3f37-4af6-b682-b9e35fd5fa42-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"4ed551c0-3f37-4af6-b682-b9e35fd5fa42\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:55:27 crc kubenswrapper[5120]: I0316 16:55:27.251933 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/4ed551c0-3f37-4af6-b682-b9e35fd5fa42-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"4ed551c0-3f37-4af6-b682-b9e35fd5fa42\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:55:27 crc kubenswrapper[5120]: I0316 16:55:27.252098 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/4ed551c0-3f37-4af6-b682-b9e35fd5fa42-rabbitmq-tls\") pod \"rabbitmq-server-0\" (UID: \"4ed551c0-3f37-4af6-b682-b9e35fd5fa42\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:55:27 crc kubenswrapper[5120]: I0316 16:55:27.253375 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/4ed551c0-3f37-4af6-b682-b9e35fd5fa42-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"4ed551c0-3f37-4af6-b682-b9e35fd5fa42\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:55:27 crc kubenswrapper[5120]: I0316 16:55:27.262396 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/4ed551c0-3f37-4af6-b682-b9e35fd5fa42-pod-info\") pod \"rabbitmq-server-0\" (UID: \"4ed551c0-3f37-4af6-b682-b9e35fd5fa42\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:55:27 crc kubenswrapper[5120]: I0316 16:55:27.265201 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkn8j\" (UniqueName: \"kubernetes.io/projected/4ed551c0-3f37-4af6-b682-b9e35fd5fa42-kube-api-access-nkn8j\") pod \"rabbitmq-server-0\" (UID: \"4ed551c0-3f37-4af6-b682-b9e35fd5fa42\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:55:27 crc kubenswrapper[5120]: I0316 16:55:27.267518 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") pod \"rabbitmq-server-0\" (UID: \"4ed551c0-3f37-4af6-b682-b9e35fd5fa42\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:55:27 crc kubenswrapper[5120]: I0316 16:55:27.356647 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 16:55:27 crc kubenswrapper[5120]: I0316 16:55:27.364725 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:55:27 crc kubenswrapper[5120]: I0316 16:55:27.368912 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-rabbitmq-cell1-svc\"" Mar 16 16:55:27 crc kubenswrapper[5120]: I0316 16:55:27.368991 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-cell1-plugins-conf\"" Mar 16 16:55:27 crc kubenswrapper[5120]: I0316 16:55:27.369079 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-cell1-config-data\"" Mar 16 16:55:27 crc kubenswrapper[5120]: I0316 16:55:27.369272 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-cell1-server-conf\"" Mar 16 16:55:27 crc kubenswrapper[5120]: I0316 16:55:27.369347 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-cell1-default-user\"" Mar 16 16:55:27 crc kubenswrapper[5120]: I0316 16:55:27.369498 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-cell1-erlang-cookie\"" Mar 16 16:55:27 crc kubenswrapper[5120]: I0316 16:55:27.369744 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-cell1-server-dockercfg-7hsfg\"" Mar 16 16:55:27 crc kubenswrapper[5120]: I0316 16:55:27.371778 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 16:55:27 crc kubenswrapper[5120]: I0316 16:55:27.422485 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:55:27 crc kubenswrapper[5120]: I0316 16:55:27.450083 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/279c3e84-623c-4c5f-ae15-d7d8c439c4dc-rabbitmq-confd\") pod \"rabbitmq-cell1-server-0\" (UID: \"279c3e84-623c-4c5f-ae15-d7d8c439c4dc\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:55:27 crc kubenswrapper[5120]: I0316 16:55:27.450161 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/279c3e84-623c-4c5f-ae15-d7d8c439c4dc-config-data\") pod \"rabbitmq-cell1-server-0\" (UID: \"279c3e84-623c-4c5f-ae15-d7d8c439c4dc\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:55:27 crc kubenswrapper[5120]: I0316 16:55:27.450318 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/279c3e84-623c-4c5f-ae15-d7d8c439c4dc-rabbitmq-tls\") pod \"rabbitmq-cell1-server-0\" (UID: \"279c3e84-623c-4c5f-ae15-d7d8c439c4dc\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:55:27 crc kubenswrapper[5120]: I0316 16:55:27.450352 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/279c3e84-623c-4c5f-ae15-d7d8c439c4dc-rabbitmq-plugins\") pod \"rabbitmq-cell1-server-0\" (UID: \"279c3e84-623c-4c5f-ae15-d7d8c439c4dc\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:55:27 crc kubenswrapper[5120]: I0316 16:55:27.450400 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/279c3e84-623c-4c5f-ae15-d7d8c439c4dc-pod-info\") pod \"rabbitmq-cell1-server-0\" (UID: \"279c3e84-623c-4c5f-ae15-d7d8c439c4dc\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:55:27 crc kubenswrapper[5120]: I0316 16:55:27.450595 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"279c3e84-623c-4c5f-ae15-d7d8c439c4dc\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:55:27 crc kubenswrapper[5120]: I0316 16:55:27.450729 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/279c3e84-623c-4c5f-ae15-d7d8c439c4dc-server-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"279c3e84-623c-4c5f-ae15-d7d8c439c4dc\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:55:27 crc kubenswrapper[5120]: I0316 16:55:27.450812 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/279c3e84-623c-4c5f-ae15-d7d8c439c4dc-rabbitmq-erlang-cookie\") pod \"rabbitmq-cell1-server-0\" (UID: \"279c3e84-623c-4c5f-ae15-d7d8c439c4dc\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:55:27 crc kubenswrapper[5120]: I0316 16:55:27.450838 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/279c3e84-623c-4c5f-ae15-d7d8c439c4dc-erlang-cookie-secret\") pod \"rabbitmq-cell1-server-0\" (UID: \"279c3e84-623c-4c5f-ae15-d7d8c439c4dc\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:55:27 crc kubenswrapper[5120]: I0316 16:55:27.450866 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/279c3e84-623c-4c5f-ae15-d7d8c439c4dc-plugins-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"279c3e84-623c-4c5f-ae15-d7d8c439c4dc\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:55:27 crc kubenswrapper[5120]: I0316 16:55:27.450952 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jq5rg\" (UniqueName: \"kubernetes.io/projected/279c3e84-623c-4c5f-ae15-d7d8c439c4dc-kube-api-access-jq5rg\") pod \"rabbitmq-cell1-server-0\" (UID: \"279c3e84-623c-4c5f-ae15-d7d8c439c4dc\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:55:27 crc kubenswrapper[5120]: I0316 16:55:27.557604 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/279c3e84-623c-4c5f-ae15-d7d8c439c4dc-server-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"279c3e84-623c-4c5f-ae15-d7d8c439c4dc\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:55:27 crc kubenswrapper[5120]: I0316 16:55:27.560973 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/279c3e84-623c-4c5f-ae15-d7d8c439c4dc-rabbitmq-erlang-cookie\") pod \"rabbitmq-cell1-server-0\" (UID: \"279c3e84-623c-4c5f-ae15-d7d8c439c4dc\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:55:27 crc kubenswrapper[5120]: I0316 16:55:27.561018 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/279c3e84-623c-4c5f-ae15-d7d8c439c4dc-erlang-cookie-secret\") pod \"rabbitmq-cell1-server-0\" (UID: \"279c3e84-623c-4c5f-ae15-d7d8c439c4dc\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:55:27 crc kubenswrapper[5120]: I0316 16:55:27.561052 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/279c3e84-623c-4c5f-ae15-d7d8c439c4dc-plugins-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"279c3e84-623c-4c5f-ae15-d7d8c439c4dc\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:55:27 crc kubenswrapper[5120]: I0316 16:55:27.561140 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jq5rg\" (UniqueName: \"kubernetes.io/projected/279c3e84-623c-4c5f-ae15-d7d8c439c4dc-kube-api-access-jq5rg\") pod \"rabbitmq-cell1-server-0\" (UID: \"279c3e84-623c-4c5f-ae15-d7d8c439c4dc\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:55:27 crc kubenswrapper[5120]: I0316 16:55:27.561291 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/279c3e84-623c-4c5f-ae15-d7d8c439c4dc-rabbitmq-confd\") pod \"rabbitmq-cell1-server-0\" (UID: \"279c3e84-623c-4c5f-ae15-d7d8c439c4dc\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:55:27 crc kubenswrapper[5120]: I0316 16:55:27.561353 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/279c3e84-623c-4c5f-ae15-d7d8c439c4dc-config-data\") pod \"rabbitmq-cell1-server-0\" (UID: \"279c3e84-623c-4c5f-ae15-d7d8c439c4dc\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:55:27 crc kubenswrapper[5120]: I0316 16:55:27.561417 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/279c3e84-623c-4c5f-ae15-d7d8c439c4dc-server-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"279c3e84-623c-4c5f-ae15-d7d8c439c4dc\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:55:27 crc kubenswrapper[5120]: I0316 16:55:27.561478 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/279c3e84-623c-4c5f-ae15-d7d8c439c4dc-rabbitmq-tls\") pod \"rabbitmq-cell1-server-0\" (UID: \"279c3e84-623c-4c5f-ae15-d7d8c439c4dc\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:55:27 crc kubenswrapper[5120]: I0316 16:55:27.561551 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/279c3e84-623c-4c5f-ae15-d7d8c439c4dc-rabbitmq-plugins\") pod \"rabbitmq-cell1-server-0\" (UID: \"279c3e84-623c-4c5f-ae15-d7d8c439c4dc\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:55:27 crc kubenswrapper[5120]: I0316 16:55:27.561598 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/279c3e84-623c-4c5f-ae15-d7d8c439c4dc-pod-info\") pod \"rabbitmq-cell1-server-0\" (UID: \"279c3e84-623c-4c5f-ae15-d7d8c439c4dc\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:55:27 crc kubenswrapper[5120]: I0316 16:55:27.561781 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"279c3e84-623c-4c5f-ae15-d7d8c439c4dc\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:55:27 crc kubenswrapper[5120]: I0316 16:55:27.563104 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"279c3e84-623c-4c5f-ae15-d7d8c439c4dc\") device mount path \"/mnt/openstack/pv02\"" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:55:27 crc kubenswrapper[5120]: I0316 16:55:27.563288 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/279c3e84-623c-4c5f-ae15-d7d8c439c4dc-rabbitmq-erlang-cookie\") pod \"rabbitmq-cell1-server-0\" (UID: \"279c3e84-623c-4c5f-ae15-d7d8c439c4dc\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:55:27 crc kubenswrapper[5120]: I0316 16:55:27.564643 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/279c3e84-623c-4c5f-ae15-d7d8c439c4dc-plugins-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"279c3e84-623c-4c5f-ae15-d7d8c439c4dc\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:55:27 crc kubenswrapper[5120]: I0316 16:55:27.564941 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/279c3e84-623c-4c5f-ae15-d7d8c439c4dc-rabbitmq-plugins\") pod \"rabbitmq-cell1-server-0\" (UID: \"279c3e84-623c-4c5f-ae15-d7d8c439c4dc\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:55:27 crc kubenswrapper[5120]: I0316 16:55:27.567093 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/279c3e84-623c-4c5f-ae15-d7d8c439c4dc-config-data\") pod \"rabbitmq-cell1-server-0\" (UID: \"279c3e84-623c-4c5f-ae15-d7d8c439c4dc\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:55:27 crc kubenswrapper[5120]: I0316 16:55:27.569464 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/279c3e84-623c-4c5f-ae15-d7d8c439c4dc-rabbitmq-tls\") pod \"rabbitmq-cell1-server-0\" (UID: \"279c3e84-623c-4c5f-ae15-d7d8c439c4dc\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:55:27 crc kubenswrapper[5120]: I0316 16:55:27.581153 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/279c3e84-623c-4c5f-ae15-d7d8c439c4dc-rabbitmq-confd\") pod \"rabbitmq-cell1-server-0\" (UID: \"279c3e84-623c-4c5f-ae15-d7d8c439c4dc\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:55:27 crc kubenswrapper[5120]: I0316 16:55:27.581433 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/279c3e84-623c-4c5f-ae15-d7d8c439c4dc-pod-info\") pod \"rabbitmq-cell1-server-0\" (UID: \"279c3e84-623c-4c5f-ae15-d7d8c439c4dc\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:55:27 crc kubenswrapper[5120]: I0316 16:55:27.586648 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/279c3e84-623c-4c5f-ae15-d7d8c439c4dc-erlang-cookie-secret\") pod \"rabbitmq-cell1-server-0\" (UID: \"279c3e84-623c-4c5f-ae15-d7d8c439c4dc\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:55:27 crc kubenswrapper[5120]: I0316 16:55:27.593120 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jq5rg\" (UniqueName: \"kubernetes.io/projected/279c3e84-623c-4c5f-ae15-d7d8c439c4dc-kube-api-access-jq5rg\") pod \"rabbitmq-cell1-server-0\" (UID: \"279c3e84-623c-4c5f-ae15-d7d8c439c4dc\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:55:27 crc kubenswrapper[5120]: I0316 16:55:27.601795 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"279c3e84-623c-4c5f-ae15-d7d8c439c4dc\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:55:27 crc kubenswrapper[5120]: I0316 16:55:27.696528 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:55:27 crc kubenswrapper[5120]: I0316 16:55:27.912933 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 16:55:28 crc kubenswrapper[5120]: I0316 16:55:28.184475 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 16:55:28 crc kubenswrapper[5120]: I0316 16:55:28.565508 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"279c3e84-623c-4c5f-ae15-d7d8c439c4dc","Type":"ContainerStarted","Data":"84776e61ff8397ceb9581ef5900d3e9c875d0757323432043de6ed5e713e754a"} Mar 16 16:55:28 crc kubenswrapper[5120]: I0316 16:55:28.568525 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"4ed551c0-3f37-4af6-b682-b9e35fd5fa42","Type":"ContainerStarted","Data":"e70aa7007beb1a5d940df9eae92f9093ba19419f9e918a6c0f5be0453ea4a777"} Mar 16 16:55:28 crc kubenswrapper[5120]: I0316 16:55:28.887725 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 16:55:28 crc kubenswrapper[5120]: I0316 16:55:28.894135 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:55:28 crc kubenswrapper[5120]: I0316 16:55:28.897706 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-galera-openstack-svc\"" Mar 16 16:55:28 crc kubenswrapper[5120]: I0316 16:55:28.897735 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"galera-openstack-dockercfg-428w9\"" Mar 16 16:55:28 crc kubenswrapper[5120]: I0316 16:55:28.897875 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-config-data\"" Mar 16 16:55:28 crc kubenswrapper[5120]: I0316 16:55:28.898700 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-scripts\"" Mar 16 16:55:28 crc kubenswrapper[5120]: I0316 16:55:28.905464 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"combined-ca-bundle\"" Mar 16 16:55:28 crc kubenswrapper[5120]: I0316 16:55:28.906276 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 16:55:29 crc kubenswrapper[5120]: I0316 16:55:29.004523 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/a4a9af83-10ac-4d5d-b8e3-e2d4d62c5a0d-config-data-default\") pod \"openstack-galera-0\" (UID: \"a4a9af83-10ac-4d5d-b8e3-e2d4d62c5a0d\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:55:29 crc kubenswrapper[5120]: I0316 16:55:29.004606 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a4a9af83-10ac-4d5d-b8e3-e2d4d62c5a0d-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"a4a9af83-10ac-4d5d-b8e3-e2d4d62c5a0d\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:55:29 crc kubenswrapper[5120]: I0316 16:55:29.004641 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"openstack-galera-0\" (UID: \"a4a9af83-10ac-4d5d-b8e3-e2d4d62c5a0d\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:55:29 crc kubenswrapper[5120]: I0316 16:55:29.004708 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/a4a9af83-10ac-4d5d-b8e3-e2d4d62c5a0d-kolla-config\") pod \"openstack-galera-0\" (UID: \"a4a9af83-10ac-4d5d-b8e3-e2d4d62c5a0d\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:55:29 crc kubenswrapper[5120]: I0316 16:55:29.004733 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czkkq\" (UniqueName: \"kubernetes.io/projected/a4a9af83-10ac-4d5d-b8e3-e2d4d62c5a0d-kube-api-access-czkkq\") pod \"openstack-galera-0\" (UID: \"a4a9af83-10ac-4d5d-b8e3-e2d4d62c5a0d\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:55:29 crc kubenswrapper[5120]: I0316 16:55:29.004845 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/a4a9af83-10ac-4d5d-b8e3-e2d4d62c5a0d-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"a4a9af83-10ac-4d5d-b8e3-e2d4d62c5a0d\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:55:29 crc kubenswrapper[5120]: I0316 16:55:29.004960 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a4a9af83-10ac-4d5d-b8e3-e2d4d62c5a0d-operator-scripts\") pod \"openstack-galera-0\" (UID: \"a4a9af83-10ac-4d5d-b8e3-e2d4d62c5a0d\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:55:29 crc kubenswrapper[5120]: I0316 16:55:29.005128 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/a4a9af83-10ac-4d5d-b8e3-e2d4d62c5a0d-config-data-generated\") pod \"openstack-galera-0\" (UID: \"a4a9af83-10ac-4d5d-b8e3-e2d4d62c5a0d\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:55:29 crc kubenswrapper[5120]: I0316 16:55:29.107577 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/a4a9af83-10ac-4d5d-b8e3-e2d4d62c5a0d-config-data-generated\") pod \"openstack-galera-0\" (UID: \"a4a9af83-10ac-4d5d-b8e3-e2d4d62c5a0d\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:55:29 crc kubenswrapper[5120]: I0316 16:55:29.107669 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/a4a9af83-10ac-4d5d-b8e3-e2d4d62c5a0d-config-data-default\") pod \"openstack-galera-0\" (UID: \"a4a9af83-10ac-4d5d-b8e3-e2d4d62c5a0d\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:55:29 crc kubenswrapper[5120]: I0316 16:55:29.107722 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a4a9af83-10ac-4d5d-b8e3-e2d4d62c5a0d-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"a4a9af83-10ac-4d5d-b8e3-e2d4d62c5a0d\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:55:29 crc kubenswrapper[5120]: I0316 16:55:29.107754 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"openstack-galera-0\" (UID: \"a4a9af83-10ac-4d5d-b8e3-e2d4d62c5a0d\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:55:29 crc kubenswrapper[5120]: I0316 16:55:29.107820 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/a4a9af83-10ac-4d5d-b8e3-e2d4d62c5a0d-kolla-config\") pod \"openstack-galera-0\" (UID: \"a4a9af83-10ac-4d5d-b8e3-e2d4d62c5a0d\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:55:29 crc kubenswrapper[5120]: I0316 16:55:29.107857 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-czkkq\" (UniqueName: \"kubernetes.io/projected/a4a9af83-10ac-4d5d-b8e3-e2d4d62c5a0d-kube-api-access-czkkq\") pod \"openstack-galera-0\" (UID: \"a4a9af83-10ac-4d5d-b8e3-e2d4d62c5a0d\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:55:29 crc kubenswrapper[5120]: I0316 16:55:29.107935 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/a4a9af83-10ac-4d5d-b8e3-e2d4d62c5a0d-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"a4a9af83-10ac-4d5d-b8e3-e2d4d62c5a0d\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:55:29 crc kubenswrapper[5120]: I0316 16:55:29.108030 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a4a9af83-10ac-4d5d-b8e3-e2d4d62c5a0d-operator-scripts\") pod \"openstack-galera-0\" (UID: \"a4a9af83-10ac-4d5d-b8e3-e2d4d62c5a0d\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:55:29 crc kubenswrapper[5120]: I0316 16:55:29.108194 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/a4a9af83-10ac-4d5d-b8e3-e2d4d62c5a0d-config-data-generated\") pod \"openstack-galera-0\" (UID: \"a4a9af83-10ac-4d5d-b8e3-e2d4d62c5a0d\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:55:29 crc kubenswrapper[5120]: I0316 16:55:29.108523 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"openstack-galera-0\" (UID: \"a4a9af83-10ac-4d5d-b8e3-e2d4d62c5a0d\") device mount path \"/mnt/openstack/pv20\"" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:55:29 crc kubenswrapper[5120]: I0316 16:55:29.109014 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/a4a9af83-10ac-4d5d-b8e3-e2d4d62c5a0d-kolla-config\") pod \"openstack-galera-0\" (UID: \"a4a9af83-10ac-4d5d-b8e3-e2d4d62c5a0d\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:55:29 crc kubenswrapper[5120]: I0316 16:55:29.109279 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/a4a9af83-10ac-4d5d-b8e3-e2d4d62c5a0d-config-data-default\") pod \"openstack-galera-0\" (UID: \"a4a9af83-10ac-4d5d-b8e3-e2d4d62c5a0d\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:55:29 crc kubenswrapper[5120]: I0316 16:55:29.109632 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a4a9af83-10ac-4d5d-b8e3-e2d4d62c5a0d-operator-scripts\") pod \"openstack-galera-0\" (UID: \"a4a9af83-10ac-4d5d-b8e3-e2d4d62c5a0d\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:55:29 crc kubenswrapper[5120]: I0316 16:55:29.119369 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/a4a9af83-10ac-4d5d-b8e3-e2d4d62c5a0d-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"a4a9af83-10ac-4d5d-b8e3-e2d4d62c5a0d\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:55:29 crc kubenswrapper[5120]: I0316 16:55:29.119569 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a4a9af83-10ac-4d5d-b8e3-e2d4d62c5a0d-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"a4a9af83-10ac-4d5d-b8e3-e2d4d62c5a0d\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:55:29 crc kubenswrapper[5120]: I0316 16:55:29.133677 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-czkkq\" (UniqueName: \"kubernetes.io/projected/a4a9af83-10ac-4d5d-b8e3-e2d4d62c5a0d-kube-api-access-czkkq\") pod \"openstack-galera-0\" (UID: \"a4a9af83-10ac-4d5d-b8e3-e2d4d62c5a0d\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:55:29 crc kubenswrapper[5120]: I0316 16:55:29.149837 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"openstack-galera-0\" (UID: \"a4a9af83-10ac-4d5d-b8e3-e2d4d62c5a0d\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:55:29 crc kubenswrapper[5120]: I0316 16:55:29.213082 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:55:29 crc kubenswrapper[5120]: I0316 16:55:29.579434 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"4ed551c0-3f37-4af6-b682-b9e35fd5fa42","Type":"ContainerStarted","Data":"8712049419d751647f539cb23ec36107f7d405f68b95c688cf65f2c616a2aee4"} Mar 16 16:55:29 crc kubenswrapper[5120]: I0316 16:55:29.581799 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"279c3e84-623c-4c5f-ae15-d7d8c439c4dc","Type":"ContainerStarted","Data":"06c0c12d3e7e9a7aecfc7d72f564006daf6123f028c14aa026bced0fe656dd6e"} Mar 16 16:55:29 crc kubenswrapper[5120]: I0316 16:55:29.685666 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 16:55:29 crc kubenswrapper[5120]: W0316 16:55:29.688468 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda4a9af83_10ac_4d5d_b8e3_e2d4d62c5a0d.slice/crio-4e7826ece75122749723f8d12e04f7f3f3ce1811e3aa2a1230db4ab8187997b4 WatchSource:0}: Error finding container 4e7826ece75122749723f8d12e04f7f3f3ce1811e3aa2a1230db4ab8187997b4: Status 404 returned error can't find the container with id 4e7826ece75122749723f8d12e04f7f3f3ce1811e3aa2a1230db4ab8187997b4 Mar 16 16:55:30 crc kubenswrapper[5120]: I0316 16:55:30.285557 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 16:55:30 crc kubenswrapper[5120]: I0316 16:55:30.292184 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:55:30 crc kubenswrapper[5120]: I0316 16:55:30.298645 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 16:55:30 crc kubenswrapper[5120]: I0316 16:55:30.300829 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-cell1-scripts\"" Mar 16 16:55:30 crc kubenswrapper[5120]: I0316 16:55:30.301080 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-cell1-config-data\"" Mar 16 16:55:30 crc kubenswrapper[5120]: I0316 16:55:30.301318 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-galera-openstack-cell1-svc\"" Mar 16 16:55:30 crc kubenswrapper[5120]: I0316 16:55:30.302120 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"galera-openstack-cell1-dockercfg-zjhx5\"" Mar 16 16:55:30 crc kubenswrapper[5120]: I0316 16:55:30.332745 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"openstack-cell1-galera-0\" (UID: \"93611c0a-e049-4bce-a55f-64d6423031b7\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:55:30 crc kubenswrapper[5120]: I0316 16:55:30.333240 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/93611c0a-e049-4bce-a55f-64d6423031b7-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"93611c0a-e049-4bce-a55f-64d6423031b7\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:55:30 crc kubenswrapper[5120]: I0316 16:55:30.333268 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/93611c0a-e049-4bce-a55f-64d6423031b7-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"93611c0a-e049-4bce-a55f-64d6423031b7\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:55:30 crc kubenswrapper[5120]: I0316 16:55:30.333291 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dpm2x\" (UniqueName: \"kubernetes.io/projected/93611c0a-e049-4bce-a55f-64d6423031b7-kube-api-access-dpm2x\") pod \"openstack-cell1-galera-0\" (UID: \"93611c0a-e049-4bce-a55f-64d6423031b7\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:55:30 crc kubenswrapper[5120]: I0316 16:55:30.333484 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/93611c0a-e049-4bce-a55f-64d6423031b7-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"93611c0a-e049-4bce-a55f-64d6423031b7\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:55:30 crc kubenswrapper[5120]: I0316 16:55:30.333549 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/93611c0a-e049-4bce-a55f-64d6423031b7-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"93611c0a-e049-4bce-a55f-64d6423031b7\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:55:30 crc kubenswrapper[5120]: I0316 16:55:30.333602 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/93611c0a-e049-4bce-a55f-64d6423031b7-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"93611c0a-e049-4bce-a55f-64d6423031b7\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:55:30 crc kubenswrapper[5120]: I0316 16:55:30.333719 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/93611c0a-e049-4bce-a55f-64d6423031b7-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"93611c0a-e049-4bce-a55f-64d6423031b7\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:55:30 crc kubenswrapper[5120]: I0316 16:55:30.435840 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"openstack-cell1-galera-0\" (UID: \"93611c0a-e049-4bce-a55f-64d6423031b7\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:55:30 crc kubenswrapper[5120]: I0316 16:55:30.435937 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/93611c0a-e049-4bce-a55f-64d6423031b7-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"93611c0a-e049-4bce-a55f-64d6423031b7\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:55:30 crc kubenswrapper[5120]: I0316 16:55:30.435966 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/93611c0a-e049-4bce-a55f-64d6423031b7-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"93611c0a-e049-4bce-a55f-64d6423031b7\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:55:30 crc kubenswrapper[5120]: I0316 16:55:30.435995 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dpm2x\" (UniqueName: \"kubernetes.io/projected/93611c0a-e049-4bce-a55f-64d6423031b7-kube-api-access-dpm2x\") pod \"openstack-cell1-galera-0\" (UID: \"93611c0a-e049-4bce-a55f-64d6423031b7\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:55:30 crc kubenswrapper[5120]: I0316 16:55:30.436031 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/93611c0a-e049-4bce-a55f-64d6423031b7-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"93611c0a-e049-4bce-a55f-64d6423031b7\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:55:30 crc kubenswrapper[5120]: I0316 16:55:30.436066 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/93611c0a-e049-4bce-a55f-64d6423031b7-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"93611c0a-e049-4bce-a55f-64d6423031b7\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:55:30 crc kubenswrapper[5120]: I0316 16:55:30.436104 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/93611c0a-e049-4bce-a55f-64d6423031b7-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"93611c0a-e049-4bce-a55f-64d6423031b7\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:55:30 crc kubenswrapper[5120]: I0316 16:55:30.436226 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/93611c0a-e049-4bce-a55f-64d6423031b7-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"93611c0a-e049-4bce-a55f-64d6423031b7\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:55:30 crc kubenswrapper[5120]: I0316 16:55:30.437087 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/93611c0a-e049-4bce-a55f-64d6423031b7-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"93611c0a-e049-4bce-a55f-64d6423031b7\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:55:30 crc kubenswrapper[5120]: I0316 16:55:30.437397 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/93611c0a-e049-4bce-a55f-64d6423031b7-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"93611c0a-e049-4bce-a55f-64d6423031b7\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:55:30 crc kubenswrapper[5120]: I0316 16:55:30.437641 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/93611c0a-e049-4bce-a55f-64d6423031b7-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"93611c0a-e049-4bce-a55f-64d6423031b7\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:55:30 crc kubenswrapper[5120]: I0316 16:55:30.437765 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"openstack-cell1-galera-0\" (UID: \"93611c0a-e049-4bce-a55f-64d6423031b7\") device mount path \"/mnt/openstack/pv04\"" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:55:30 crc kubenswrapper[5120]: I0316 16:55:30.438323 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/93611c0a-e049-4bce-a55f-64d6423031b7-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"93611c0a-e049-4bce-a55f-64d6423031b7\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:55:30 crc kubenswrapper[5120]: I0316 16:55:30.453719 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/93611c0a-e049-4bce-a55f-64d6423031b7-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"93611c0a-e049-4bce-a55f-64d6423031b7\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:55:30 crc kubenswrapper[5120]: I0316 16:55:30.454105 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/93611c0a-e049-4bce-a55f-64d6423031b7-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"93611c0a-e049-4bce-a55f-64d6423031b7\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:55:30 crc kubenswrapper[5120]: I0316 16:55:30.464765 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dpm2x\" (UniqueName: \"kubernetes.io/projected/93611c0a-e049-4bce-a55f-64d6423031b7-kube-api-access-dpm2x\") pod \"openstack-cell1-galera-0\" (UID: \"93611c0a-e049-4bce-a55f-64d6423031b7\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:55:30 crc kubenswrapper[5120]: I0316 16:55:30.470011 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"openstack-cell1-galera-0\" (UID: \"93611c0a-e049-4bce-a55f-64d6423031b7\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:55:30 crc kubenswrapper[5120]: I0316 16:55:30.531598 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 16:55:30 crc kubenswrapper[5120]: I0316 16:55:30.538056 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Mar 16 16:55:30 crc kubenswrapper[5120]: I0316 16:55:30.541976 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"memcached-memcached-dockercfg-s2pts\"" Mar 16 16:55:30 crc kubenswrapper[5120]: I0316 16:55:30.545843 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-memcached-svc\"" Mar 16 16:55:30 crc kubenswrapper[5120]: I0316 16:55:30.546067 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"memcached-config-data\"" Mar 16 16:55:30 crc kubenswrapper[5120]: I0316 16:55:30.553368 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 16:55:30 crc kubenswrapper[5120]: I0316 16:55:30.596489 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"a4a9af83-10ac-4d5d-b8e3-e2d4d62c5a0d","Type":"ContainerStarted","Data":"c46863cc69557f873cd0ae7f6573cff48bbb59a55b1517a22a96eb9510e7faa1"} Mar 16 16:55:30 crc kubenswrapper[5120]: I0316 16:55:30.596535 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"a4a9af83-10ac-4d5d-b8e3-e2d4d62c5a0d","Type":"ContainerStarted","Data":"4e7826ece75122749723f8d12e04f7f3f3ce1811e3aa2a1230db4ab8187997b4"} Mar 16 16:55:30 crc kubenswrapper[5120]: I0316 16:55:30.615872 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:55:30 crc kubenswrapper[5120]: I0316 16:55:30.668162 5120 scope.go:117] "RemoveContainer" containerID="083f72646c8d47c9c0467b39be99ddfa9c2e5900ae0a29ad53d7b39b950274b4" Mar 16 16:55:30 crc kubenswrapper[5120]: E0316 16:55:30.668567 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:55:30 crc kubenswrapper[5120]: I0316 16:55:30.745515 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xrzx\" (UniqueName: \"kubernetes.io/projected/621d9d31-f819-4547-886c-a670fffe27d2-kube-api-access-6xrzx\") pod \"memcached-0\" (UID: \"621d9d31-f819-4547-886c-a670fffe27d2\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:55:30 crc kubenswrapper[5120]: I0316 16:55:30.746310 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/621d9d31-f819-4547-886c-a670fffe27d2-config-data\") pod \"memcached-0\" (UID: \"621d9d31-f819-4547-886c-a670fffe27d2\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:55:30 crc kubenswrapper[5120]: I0316 16:55:30.746411 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/621d9d31-f819-4547-886c-a670fffe27d2-memcached-tls-certs\") pod \"memcached-0\" (UID: \"621d9d31-f819-4547-886c-a670fffe27d2\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:55:30 crc kubenswrapper[5120]: I0316 16:55:30.746511 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/621d9d31-f819-4547-886c-a670fffe27d2-kolla-config\") pod \"memcached-0\" (UID: \"621d9d31-f819-4547-886c-a670fffe27d2\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:55:30 crc kubenswrapper[5120]: I0316 16:55:30.746743 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/621d9d31-f819-4547-886c-a670fffe27d2-combined-ca-bundle\") pod \"memcached-0\" (UID: \"621d9d31-f819-4547-886c-a670fffe27d2\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:55:30 crc kubenswrapper[5120]: I0316 16:55:30.848705 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/621d9d31-f819-4547-886c-a670fffe27d2-kolla-config\") pod \"memcached-0\" (UID: \"621d9d31-f819-4547-886c-a670fffe27d2\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:55:30 crc kubenswrapper[5120]: I0316 16:55:30.848894 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/621d9d31-f819-4547-886c-a670fffe27d2-combined-ca-bundle\") pod \"memcached-0\" (UID: \"621d9d31-f819-4547-886c-a670fffe27d2\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:55:30 crc kubenswrapper[5120]: I0316 16:55:30.848976 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6xrzx\" (UniqueName: \"kubernetes.io/projected/621d9d31-f819-4547-886c-a670fffe27d2-kube-api-access-6xrzx\") pod \"memcached-0\" (UID: \"621d9d31-f819-4547-886c-a670fffe27d2\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:55:30 crc kubenswrapper[5120]: I0316 16:55:30.849338 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/621d9d31-f819-4547-886c-a670fffe27d2-config-data\") pod \"memcached-0\" (UID: \"621d9d31-f819-4547-886c-a670fffe27d2\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:55:30 crc kubenswrapper[5120]: I0316 16:55:30.849445 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/621d9d31-f819-4547-886c-a670fffe27d2-memcached-tls-certs\") pod \"memcached-0\" (UID: \"621d9d31-f819-4547-886c-a670fffe27d2\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:55:30 crc kubenswrapper[5120]: I0316 16:55:30.849658 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/621d9d31-f819-4547-886c-a670fffe27d2-kolla-config\") pod \"memcached-0\" (UID: \"621d9d31-f819-4547-886c-a670fffe27d2\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:55:30 crc kubenswrapper[5120]: I0316 16:55:30.851039 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/621d9d31-f819-4547-886c-a670fffe27d2-config-data\") pod \"memcached-0\" (UID: \"621d9d31-f819-4547-886c-a670fffe27d2\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:55:30 crc kubenswrapper[5120]: I0316 16:55:30.855469 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/621d9d31-f819-4547-886c-a670fffe27d2-combined-ca-bundle\") pod \"memcached-0\" (UID: \"621d9d31-f819-4547-886c-a670fffe27d2\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:55:30 crc kubenswrapper[5120]: I0316 16:55:30.856624 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/621d9d31-f819-4547-886c-a670fffe27d2-memcached-tls-certs\") pod \"memcached-0\" (UID: \"621d9d31-f819-4547-886c-a670fffe27d2\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:55:30 crc kubenswrapper[5120]: I0316 16:55:30.869371 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xrzx\" (UniqueName: \"kubernetes.io/projected/621d9d31-f819-4547-886c-a670fffe27d2-kube-api-access-6xrzx\") pod \"memcached-0\" (UID: \"621d9d31-f819-4547-886c-a670fffe27d2\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 16:55:30 crc kubenswrapper[5120]: I0316 16:55:30.876822 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Mar 16 16:55:31 crc kubenswrapper[5120]: W0316 16:55:31.063888 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod93611c0a_e049_4bce_a55f_64d6423031b7.slice/crio-2c23fc866155c6bd351236f52496fda66c9bb5478f1bc8722a7471372b0b4571 WatchSource:0}: Error finding container 2c23fc866155c6bd351236f52496fda66c9bb5478f1bc8722a7471372b0b4571: Status 404 returned error can't find the container with id 2c23fc866155c6bd351236f52496fda66c9bb5478f1bc8722a7471372b0b4571 Mar 16 16:55:31 crc kubenswrapper[5120]: I0316 16:55:31.064682 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 16:55:31 crc kubenswrapper[5120]: I0316 16:55:31.300978 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 16:55:31 crc kubenswrapper[5120]: W0316 16:55:31.303353 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod621d9d31_f819_4547_886c_a670fffe27d2.slice/crio-76bce893a2627a31e8e7bb58b0cac973e7440bbee4f3a64ffdc0714a1e81c737 WatchSource:0}: Error finding container 76bce893a2627a31e8e7bb58b0cac973e7440bbee4f3a64ffdc0714a1e81c737: Status 404 returned error can't find the container with id 76bce893a2627a31e8e7bb58b0cac973e7440bbee4f3a64ffdc0714a1e81c737 Mar 16 16:55:31 crc kubenswrapper[5120]: I0316 16:55:31.606841 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"621d9d31-f819-4547-886c-a670fffe27d2","Type":"ContainerStarted","Data":"8540f49324d3df592da58fc21c9e5656816887a0eb7b5b0f14a8577287f722e8"} Mar 16 16:55:31 crc kubenswrapper[5120]: I0316 16:55:31.607837 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"621d9d31-f819-4547-886c-a670fffe27d2","Type":"ContainerStarted","Data":"76bce893a2627a31e8e7bb58b0cac973e7440bbee4f3a64ffdc0714a1e81c737"} Mar 16 16:55:31 crc kubenswrapper[5120]: I0316 16:55:31.607890 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/memcached-0" Mar 16 16:55:31 crc kubenswrapper[5120]: I0316 16:55:31.610517 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"93611c0a-e049-4bce-a55f-64d6423031b7","Type":"ContainerStarted","Data":"cc0bc3cba86a9366be662b6e3ce9146f449f7008accda8f663835a30d82d9c50"} Mar 16 16:55:31 crc kubenswrapper[5120]: I0316 16:55:31.610551 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"93611c0a-e049-4bce-a55f-64d6423031b7","Type":"ContainerStarted","Data":"2c23fc866155c6bd351236f52496fda66c9bb5478f1bc8722a7471372b0b4571"} Mar 16 16:55:31 crc kubenswrapper[5120]: I0316 16:55:31.632435 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/memcached-0" podStartSLOduration=1.632413397 podStartE2EDuration="1.632413397s" podCreationTimestamp="2026-03-16 16:55:30 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:55:31.62813927 +0000 UTC m=+5033.782070927" watchObservedRunningTime="2026-03-16 16:55:31.632413397 +0000 UTC m=+5033.786345054" Mar 16 16:55:32 crc kubenswrapper[5120]: I0316 16:55:32.654596 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 16:55:32 crc kubenswrapper[5120]: I0316 16:55:32.659391 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:55:32 crc kubenswrapper[5120]: I0316 16:55:32.661681 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"telemetry-ceilometer-dockercfg-6gh2z\"" Mar 16 16:55:32 crc kubenswrapper[5120]: I0316 16:55:32.673476 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 16:55:32 crc kubenswrapper[5120]: I0316 16:55:32.692701 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2n2q4\" (UniqueName: \"kubernetes.io/projected/60437041-a599-472d-8c74-8fd64b18636d-kube-api-access-2n2q4\") pod \"kube-state-metrics-0\" (UID: \"60437041-a599-472d-8c74-8fd64b18636d\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:55:32 crc kubenswrapper[5120]: I0316 16:55:32.795381 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2n2q4\" (UniqueName: \"kubernetes.io/projected/60437041-a599-472d-8c74-8fd64b18636d-kube-api-access-2n2q4\") pod \"kube-state-metrics-0\" (UID: \"60437041-a599-472d-8c74-8fd64b18636d\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:55:32 crc kubenswrapper[5120]: I0316 16:55:32.831314 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2n2q4\" (UniqueName: \"kubernetes.io/projected/60437041-a599-472d-8c74-8fd64b18636d-kube-api-access-2n2q4\") pod \"kube-state-metrics-0\" (UID: \"60437041-a599-472d-8c74-8fd64b18636d\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:55:32 crc kubenswrapper[5120]: I0316 16:55:32.979537 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:55:33 crc kubenswrapper[5120]: I0316 16:55:33.417892 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 16:55:33 crc kubenswrapper[5120]: I0316 16:55:33.627671 5120 generic.go:358] "Generic (PLEG): container finished" podID="a4a9af83-10ac-4d5d-b8e3-e2d4d62c5a0d" containerID="c46863cc69557f873cd0ae7f6573cff48bbb59a55b1517a22a96eb9510e7faa1" exitCode=0 Mar 16 16:55:33 crc kubenswrapper[5120]: I0316 16:55:33.627784 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"a4a9af83-10ac-4d5d-b8e3-e2d4d62c5a0d","Type":"ContainerDied","Data":"c46863cc69557f873cd0ae7f6573cff48bbb59a55b1517a22a96eb9510e7faa1"} Mar 16 16:55:33 crc kubenswrapper[5120]: I0316 16:55:33.629724 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"60437041-a599-472d-8c74-8fd64b18636d","Type":"ContainerStarted","Data":"39144854ddbd74a2824ba19c43035f0d8ad435cf002f9cd58b25317ffe8ae822"} Mar 16 16:55:34 crc kubenswrapper[5120]: I0316 16:55:34.640823 5120 generic.go:358] "Generic (PLEG): container finished" podID="93611c0a-e049-4bce-a55f-64d6423031b7" containerID="cc0bc3cba86a9366be662b6e3ce9146f449f7008accda8f663835a30d82d9c50" exitCode=0 Mar 16 16:55:34 crc kubenswrapper[5120]: I0316 16:55:34.640876 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"93611c0a-e049-4bce-a55f-64d6423031b7","Type":"ContainerDied","Data":"cc0bc3cba86a9366be662b6e3ce9146f449f7008accda8f663835a30d82d9c50"} Mar 16 16:55:34 crc kubenswrapper[5120]: I0316 16:55:34.643323 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"a4a9af83-10ac-4d5d-b8e3-e2d4d62c5a0d","Type":"ContainerStarted","Data":"75ba7a23ede7125ea74861aacb5d597bf3d7dc9e677e82329e1b5682f729b68b"} Mar 16 16:55:34 crc kubenswrapper[5120]: I0316 16:55:34.701118 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstack-galera-0" podStartSLOduration=7.701098809 podStartE2EDuration="7.701098809s" podCreationTimestamp="2026-03-16 16:55:27 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:55:34.693413918 +0000 UTC m=+5036.847345575" watchObservedRunningTime="2026-03-16 16:55:34.701098809 +0000 UTC m=+5036.855030466" Mar 16 16:55:35 crc kubenswrapper[5120]: I0316 16:55:35.107640 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 16:55:35 crc kubenswrapper[5120]: I0316 16:55:35.113511 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:55:35 crc kubenswrapper[5120]: I0316 16:55:35.119167 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ovndbcluster-nb-ovndbs\"" Mar 16 16:55:35 crc kubenswrapper[5120]: I0316 16:55:35.119537 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ovn-metrics\"" Mar 16 16:55:35 crc kubenswrapper[5120]: I0316 16:55:35.119596 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovndbcluster-nb-config\"" Mar 16 16:55:35 crc kubenswrapper[5120]: I0316 16:55:35.119618 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovndbcluster-nb-scripts\"" Mar 16 16:55:35 crc kubenswrapper[5120]: I0316 16:55:35.120745 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ovncluster-ovndbcluster-nb-dockercfg-8zd6v\"" Mar 16 16:55:35 crc kubenswrapper[5120]: I0316 16:55:35.122674 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 16:55:35 crc kubenswrapper[5120]: I0316 16:55:35.248358 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/030b8d76-31d4-45e0-8be6-3d946e372b0e-config\") pod \"ovsdbserver-nb-0\" (UID: \"030b8d76-31d4-45e0-8be6-3d946e372b0e\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:55:35 crc kubenswrapper[5120]: I0316 16:55:35.248402 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/030b8d76-31d4-45e0-8be6-3d946e372b0e-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"030b8d76-31d4-45e0-8be6-3d946e372b0e\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:55:35 crc kubenswrapper[5120]: I0316 16:55:35.248617 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/030b8d76-31d4-45e0-8be6-3d946e372b0e-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"030b8d76-31d4-45e0-8be6-3d946e372b0e\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:55:35 crc kubenswrapper[5120]: I0316 16:55:35.248747 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vrf4\" (UniqueName: \"kubernetes.io/projected/030b8d76-31d4-45e0-8be6-3d946e372b0e-kube-api-access-6vrf4\") pod \"ovsdbserver-nb-0\" (UID: \"030b8d76-31d4-45e0-8be6-3d946e372b0e\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:55:35 crc kubenswrapper[5120]: I0316 16:55:35.249031 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/030b8d76-31d4-45e0-8be6-3d946e372b0e-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"030b8d76-31d4-45e0-8be6-3d946e372b0e\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:55:35 crc kubenswrapper[5120]: I0316 16:55:35.249162 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"ovsdbserver-nb-0\" (UID: \"030b8d76-31d4-45e0-8be6-3d946e372b0e\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:55:35 crc kubenswrapper[5120]: I0316 16:55:35.249325 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/030b8d76-31d4-45e0-8be6-3d946e372b0e-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"030b8d76-31d4-45e0-8be6-3d946e372b0e\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:55:35 crc kubenswrapper[5120]: I0316 16:55:35.249426 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/030b8d76-31d4-45e0-8be6-3d946e372b0e-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"030b8d76-31d4-45e0-8be6-3d946e372b0e\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:55:35 crc kubenswrapper[5120]: I0316 16:55:35.351348 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/030b8d76-31d4-45e0-8be6-3d946e372b0e-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"030b8d76-31d4-45e0-8be6-3d946e372b0e\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:55:35 crc kubenswrapper[5120]: I0316 16:55:35.351434 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"ovsdbserver-nb-0\" (UID: \"030b8d76-31d4-45e0-8be6-3d946e372b0e\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:55:35 crc kubenswrapper[5120]: I0316 16:55:35.351482 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/030b8d76-31d4-45e0-8be6-3d946e372b0e-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"030b8d76-31d4-45e0-8be6-3d946e372b0e\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:55:35 crc kubenswrapper[5120]: I0316 16:55:35.351511 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/030b8d76-31d4-45e0-8be6-3d946e372b0e-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"030b8d76-31d4-45e0-8be6-3d946e372b0e\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:55:35 crc kubenswrapper[5120]: I0316 16:55:35.351721 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/030b8d76-31d4-45e0-8be6-3d946e372b0e-config\") pod \"ovsdbserver-nb-0\" (UID: \"030b8d76-31d4-45e0-8be6-3d946e372b0e\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:55:35 crc kubenswrapper[5120]: I0316 16:55:35.351750 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/030b8d76-31d4-45e0-8be6-3d946e372b0e-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"030b8d76-31d4-45e0-8be6-3d946e372b0e\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:55:35 crc kubenswrapper[5120]: I0316 16:55:35.351857 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/030b8d76-31d4-45e0-8be6-3d946e372b0e-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"030b8d76-31d4-45e0-8be6-3d946e372b0e\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:55:35 crc kubenswrapper[5120]: I0316 16:55:35.351912 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6vrf4\" (UniqueName: \"kubernetes.io/projected/030b8d76-31d4-45e0-8be6-3d946e372b0e-kube-api-access-6vrf4\") pod \"ovsdbserver-nb-0\" (UID: \"030b8d76-31d4-45e0-8be6-3d946e372b0e\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:55:35 crc kubenswrapper[5120]: I0316 16:55:35.353177 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"ovsdbserver-nb-0\" (UID: \"030b8d76-31d4-45e0-8be6-3d946e372b0e\") device mount path \"/mnt/openstack/pv08\"" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:55:35 crc kubenswrapper[5120]: I0316 16:55:35.353464 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/030b8d76-31d4-45e0-8be6-3d946e372b0e-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"030b8d76-31d4-45e0-8be6-3d946e372b0e\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:55:35 crc kubenswrapper[5120]: I0316 16:55:35.353824 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/030b8d76-31d4-45e0-8be6-3d946e372b0e-config\") pod \"ovsdbserver-nb-0\" (UID: \"030b8d76-31d4-45e0-8be6-3d946e372b0e\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:55:35 crc kubenswrapper[5120]: I0316 16:55:35.354005 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/030b8d76-31d4-45e0-8be6-3d946e372b0e-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"030b8d76-31d4-45e0-8be6-3d946e372b0e\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:55:35 crc kubenswrapper[5120]: I0316 16:55:35.357696 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/030b8d76-31d4-45e0-8be6-3d946e372b0e-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"030b8d76-31d4-45e0-8be6-3d946e372b0e\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:55:35 crc kubenswrapper[5120]: I0316 16:55:35.357897 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/030b8d76-31d4-45e0-8be6-3d946e372b0e-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"030b8d76-31d4-45e0-8be6-3d946e372b0e\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:55:35 crc kubenswrapper[5120]: I0316 16:55:35.360434 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/030b8d76-31d4-45e0-8be6-3d946e372b0e-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"030b8d76-31d4-45e0-8be6-3d946e372b0e\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:55:35 crc kubenswrapper[5120]: I0316 16:55:35.388204 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"ovsdbserver-nb-0\" (UID: \"030b8d76-31d4-45e0-8be6-3d946e372b0e\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:55:35 crc kubenswrapper[5120]: I0316 16:55:35.395931 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vrf4\" (UniqueName: \"kubernetes.io/projected/030b8d76-31d4-45e0-8be6-3d946e372b0e-kube-api-access-6vrf4\") pod \"ovsdbserver-nb-0\" (UID: \"030b8d76-31d4-45e0-8be6-3d946e372b0e\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:55:35 crc kubenswrapper[5120]: I0316 16:55:35.457098 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:55:35 crc kubenswrapper[5120]: I0316 16:55:35.654042 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"60437041-a599-472d-8c74-8fd64b18636d","Type":"ContainerStarted","Data":"03717a903946f9041458d6f8898702f3c49380d7a9ed2c2a5b8d9a2071e2bc97"} Mar 16 16:55:35 crc kubenswrapper[5120]: I0316 16:55:35.654620 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:55:35 crc kubenswrapper[5120]: I0316 16:55:35.657340 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"93611c0a-e049-4bce-a55f-64d6423031b7","Type":"ContainerStarted","Data":"0cc45018c0393bdbfa1f4fb52f48a73635f3a9667559d189a5957b03ec095cfc"} Mar 16 16:55:35 crc kubenswrapper[5120]: I0316 16:55:35.672470 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/kube-state-metrics-0" podStartSLOduration=2.430366978 podStartE2EDuration="3.672452135s" podCreationTimestamp="2026-03-16 16:55:32 +0000 UTC" firstStartedPulling="2026-03-16 16:55:33.436872596 +0000 UTC m=+5035.590804253" lastFinishedPulling="2026-03-16 16:55:34.678957753 +0000 UTC m=+5036.832889410" observedRunningTime="2026-03-16 16:55:35.666919364 +0000 UTC m=+5037.820851021" watchObservedRunningTime="2026-03-16 16:55:35.672452135 +0000 UTC m=+5037.826383792" Mar 16 16:55:35 crc kubenswrapper[5120]: I0316 16:55:35.697775 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstack-cell1-galera-0" podStartSLOduration=6.697746388 podStartE2EDuration="6.697746388s" podCreationTimestamp="2026-03-16 16:55:29 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:55:35.69307073 +0000 UTC m=+5037.847002387" watchObservedRunningTime="2026-03-16 16:55:35.697746388 +0000 UTC m=+5037.851678045" Mar 16 16:55:35 crc kubenswrapper[5120]: I0316 16:55:35.887627 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 16:55:35 crc kubenswrapper[5120]: W0316 16:55:35.906223 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod030b8d76_31d4_45e0_8be6_3d946e372b0e.slice/crio-cb9f9041b25ce239bd2c7a3f251bc4d69106e70f2cccdd5b0f03a65de35438a1 WatchSource:0}: Error finding container cb9f9041b25ce239bd2c7a3f251bc4d69106e70f2cccdd5b0f03a65de35438a1: Status 404 returned error can't find the container with id cb9f9041b25ce239bd2c7a3f251bc4d69106e70f2cccdd5b0f03a65de35438a1 Mar 16 16:55:36 crc kubenswrapper[5120]: I0316 16:55:36.675597 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"030b8d76-31d4-45e0-8be6-3d946e372b0e","Type":"ContainerStarted","Data":"f94bcfa431812ba604d23cd37383a05f200c37f02394f6a653384916c3ebed2f"} Mar 16 16:55:36 crc kubenswrapper[5120]: I0316 16:55:36.675934 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"030b8d76-31d4-45e0-8be6-3d946e372b0e","Type":"ContainerStarted","Data":"cd6c384064abb1937ac187a4baf4248f69fd3cc6839f07e61fb7096814d0b5bd"} Mar 16 16:55:36 crc kubenswrapper[5120]: I0316 16:55:36.675946 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"030b8d76-31d4-45e0-8be6-3d946e372b0e","Type":"ContainerStarted","Data":"cb9f9041b25ce239bd2c7a3f251bc4d69106e70f2cccdd5b0f03a65de35438a1"} Mar 16 16:55:36 crc kubenswrapper[5120]: I0316 16:55:36.695570 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podStartSLOduration=2.695549198 podStartE2EDuration="2.695549198s" podCreationTimestamp="2026-03-16 16:55:34 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:55:36.692853374 +0000 UTC m=+5038.846785041" watchObservedRunningTime="2026-03-16 16:55:36.695549198 +0000 UTC m=+5038.849480855" Mar 16 16:55:38 crc kubenswrapper[5120]: I0316 16:55:38.190627 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 16:55:38 crc kubenswrapper[5120]: I0316 16:55:38.196062 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:55:38 crc kubenswrapper[5120]: I0316 16:55:38.200960 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovndbcluster-sb-config\"" Mar 16 16:55:38 crc kubenswrapper[5120]: I0316 16:55:38.201223 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ovncluster-ovndbcluster-sb-dockercfg-scdkb\"" Mar 16 16:55:38 crc kubenswrapper[5120]: I0316 16:55:38.202061 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ovndbcluster-sb-ovndbs\"" Mar 16 16:55:38 crc kubenswrapper[5120]: I0316 16:55:38.202329 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovndbcluster-sb-scripts\"" Mar 16 16:55:38 crc kubenswrapper[5120]: I0316 16:55:38.210160 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 16:55:38 crc kubenswrapper[5120]: I0316 16:55:38.317665 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5bmd\" (UniqueName: \"kubernetes.io/projected/3c26be62-517d-41f5-bb6f-2c75cf93c96a-kube-api-access-s5bmd\") pod \"ovsdbserver-sb-0\" (UID: \"3c26be62-517d-41f5-bb6f-2c75cf93c96a\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:55:38 crc kubenswrapper[5120]: I0316 16:55:38.317714 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/3c26be62-517d-41f5-bb6f-2c75cf93c96a-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"3c26be62-517d-41f5-bb6f-2c75cf93c96a\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:55:38 crc kubenswrapper[5120]: I0316 16:55:38.317828 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"ovsdbserver-sb-0\" (UID: \"3c26be62-517d-41f5-bb6f-2c75cf93c96a\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:55:38 crc kubenswrapper[5120]: I0316 16:55:38.317990 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/3c26be62-517d-41f5-bb6f-2c75cf93c96a-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"3c26be62-517d-41f5-bb6f-2c75cf93c96a\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:55:38 crc kubenswrapper[5120]: I0316 16:55:38.318077 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3c26be62-517d-41f5-bb6f-2c75cf93c96a-config\") pod \"ovsdbserver-sb-0\" (UID: \"3c26be62-517d-41f5-bb6f-2c75cf93c96a\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:55:38 crc kubenswrapper[5120]: I0316 16:55:38.318224 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/3c26be62-517d-41f5-bb6f-2c75cf93c96a-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"3c26be62-517d-41f5-bb6f-2c75cf93c96a\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:55:38 crc kubenswrapper[5120]: I0316 16:55:38.318268 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/3c26be62-517d-41f5-bb6f-2c75cf93c96a-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"3c26be62-517d-41f5-bb6f-2c75cf93c96a\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:55:38 crc kubenswrapper[5120]: I0316 16:55:38.318319 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3c26be62-517d-41f5-bb6f-2c75cf93c96a-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"3c26be62-517d-41f5-bb6f-2c75cf93c96a\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:55:38 crc kubenswrapper[5120]: I0316 16:55:38.420121 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/3c26be62-517d-41f5-bb6f-2c75cf93c96a-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"3c26be62-517d-41f5-bb6f-2c75cf93c96a\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:55:38 crc kubenswrapper[5120]: I0316 16:55:38.420174 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/3c26be62-517d-41f5-bb6f-2c75cf93c96a-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"3c26be62-517d-41f5-bb6f-2c75cf93c96a\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:55:38 crc kubenswrapper[5120]: I0316 16:55:38.420226 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3c26be62-517d-41f5-bb6f-2c75cf93c96a-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"3c26be62-517d-41f5-bb6f-2c75cf93c96a\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:55:38 crc kubenswrapper[5120]: I0316 16:55:38.420289 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s5bmd\" (UniqueName: \"kubernetes.io/projected/3c26be62-517d-41f5-bb6f-2c75cf93c96a-kube-api-access-s5bmd\") pod \"ovsdbserver-sb-0\" (UID: \"3c26be62-517d-41f5-bb6f-2c75cf93c96a\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:55:38 crc kubenswrapper[5120]: I0316 16:55:38.420319 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/3c26be62-517d-41f5-bb6f-2c75cf93c96a-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"3c26be62-517d-41f5-bb6f-2c75cf93c96a\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:55:38 crc kubenswrapper[5120]: I0316 16:55:38.420375 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"ovsdbserver-sb-0\" (UID: \"3c26be62-517d-41f5-bb6f-2c75cf93c96a\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:55:38 crc kubenswrapper[5120]: I0316 16:55:38.420484 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/3c26be62-517d-41f5-bb6f-2c75cf93c96a-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"3c26be62-517d-41f5-bb6f-2c75cf93c96a\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:55:38 crc kubenswrapper[5120]: I0316 16:55:38.420564 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3c26be62-517d-41f5-bb6f-2c75cf93c96a-config\") pod \"ovsdbserver-sb-0\" (UID: \"3c26be62-517d-41f5-bb6f-2c75cf93c96a\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:55:38 crc kubenswrapper[5120]: I0316 16:55:38.420841 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"ovsdbserver-sb-0\" (UID: \"3c26be62-517d-41f5-bb6f-2c75cf93c96a\") device mount path \"/mnt/openstack/pv01\"" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:55:38 crc kubenswrapper[5120]: I0316 16:55:38.421102 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/3c26be62-517d-41f5-bb6f-2c75cf93c96a-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"3c26be62-517d-41f5-bb6f-2c75cf93c96a\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:55:38 crc kubenswrapper[5120]: I0316 16:55:38.421463 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3c26be62-517d-41f5-bb6f-2c75cf93c96a-config\") pod \"ovsdbserver-sb-0\" (UID: \"3c26be62-517d-41f5-bb6f-2c75cf93c96a\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:55:38 crc kubenswrapper[5120]: I0316 16:55:38.421596 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/3c26be62-517d-41f5-bb6f-2c75cf93c96a-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"3c26be62-517d-41f5-bb6f-2c75cf93c96a\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:55:38 crc kubenswrapper[5120]: I0316 16:55:38.427436 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/3c26be62-517d-41f5-bb6f-2c75cf93c96a-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"3c26be62-517d-41f5-bb6f-2c75cf93c96a\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:55:38 crc kubenswrapper[5120]: I0316 16:55:38.427573 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3c26be62-517d-41f5-bb6f-2c75cf93c96a-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"3c26be62-517d-41f5-bb6f-2c75cf93c96a\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:55:38 crc kubenswrapper[5120]: I0316 16:55:38.427633 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/3c26be62-517d-41f5-bb6f-2c75cf93c96a-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"3c26be62-517d-41f5-bb6f-2c75cf93c96a\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:55:38 crc kubenswrapper[5120]: I0316 16:55:38.442502 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5bmd\" (UniqueName: \"kubernetes.io/projected/3c26be62-517d-41f5-bb6f-2c75cf93c96a-kube-api-access-s5bmd\") pod \"ovsdbserver-sb-0\" (UID: \"3c26be62-517d-41f5-bb6f-2c75cf93c96a\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:55:38 crc kubenswrapper[5120]: I0316 16:55:38.445146 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"ovsdbserver-sb-0\" (UID: \"3c26be62-517d-41f5-bb6f-2c75cf93c96a\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:55:38 crc kubenswrapper[5120]: I0316 16:55:38.457746 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:55:38 crc kubenswrapper[5120]: I0316 16:55:38.513467 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:55:38 crc kubenswrapper[5120]: I0316 16:55:38.630921 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/memcached-0" Mar 16 16:55:38 crc kubenswrapper[5120]: I0316 16:55:38.988969 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 16:55:39 crc kubenswrapper[5120]: W0316 16:55:39.007050 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3c26be62_517d_41f5_bb6f_2c75cf93c96a.slice/crio-6e2e3f835329316e695061295382253d63be5168cf312ebab682060a6d233005 WatchSource:0}: Error finding container 6e2e3f835329316e695061295382253d63be5168cf312ebab682060a6d233005: Status 404 returned error can't find the container with id 6e2e3f835329316e695061295382253d63be5168cf312ebab682060a6d233005 Mar 16 16:55:39 crc kubenswrapper[5120]: I0316 16:55:39.215041 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:55:39 crc kubenswrapper[5120]: I0316 16:55:39.215079 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:55:39 crc kubenswrapper[5120]: I0316 16:55:39.704426 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"3c26be62-517d-41f5-bb6f-2c75cf93c96a","Type":"ContainerStarted","Data":"0c5a2135fb60242e596a2bc08da044df6460929a10d8be846b4883f1540ead45"} Mar 16 16:55:39 crc kubenswrapper[5120]: I0316 16:55:39.704786 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"3c26be62-517d-41f5-bb6f-2c75cf93c96a","Type":"ContainerStarted","Data":"1aaf59914fc1561cebdf52d0de00dcac1dd1c216925d669b493f5a808b6e98f8"} Mar 16 16:55:39 crc kubenswrapper[5120]: I0316 16:55:39.704805 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"3c26be62-517d-41f5-bb6f-2c75cf93c96a","Type":"ContainerStarted","Data":"6e2e3f835329316e695061295382253d63be5168cf312ebab682060a6d233005"} Mar 16 16:55:39 crc kubenswrapper[5120]: I0316 16:55:39.748141 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podStartSLOduration=2.748118469 podStartE2EDuration="2.748118469s" podCreationTimestamp="2026-03-16 16:55:37 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:55:39.73316975 +0000 UTC m=+5041.887101417" watchObservedRunningTime="2026-03-16 16:55:39.748118469 +0000 UTC m=+5041.902050126" Mar 16 16:55:40 crc kubenswrapper[5120]: I0316 16:55:40.457525 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:55:40 crc kubenswrapper[5120]: I0316 16:55:40.616332 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:55:40 crc kubenswrapper[5120]: I0316 16:55:40.616487 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:55:41 crc kubenswrapper[5120]: I0316 16:55:41.494910 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:55:41 crc kubenswrapper[5120]: I0316 16:55:41.506702 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:55:41 crc kubenswrapper[5120]: I0316 16:55:41.514222 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:55:41 crc kubenswrapper[5120]: I0316 16:55:41.544111 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 16:55:41 crc kubenswrapper[5120]: I0316 16:55:41.664366 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 16:55:41 crc kubenswrapper[5120]: I0316 16:55:41.866534 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-db-create-cc255"] Mar 16 16:55:41 crc kubenswrapper[5120]: I0316 16:55:41.871418 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-create-cc255" Mar 16 16:55:41 crc kubenswrapper[5120]: I0316 16:55:41.877837 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-db-create-cc255"] Mar 16 16:55:41 crc kubenswrapper[5120]: I0316 16:55:41.992447 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-f9be-account-create-update-6nsvb"] Mar 16 16:55:41 crc kubenswrapper[5120]: I0316 16:55:41.996940 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-f9be-account-create-update-6nsvb" Mar 16 16:55:41 crc kubenswrapper[5120]: I0316 16:55:41.998873 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-db-secret\"" Mar 16 16:55:42 crc kubenswrapper[5120]: I0316 16:55:42.010200 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-f9be-account-create-update-6nsvb"] Mar 16 16:55:42 crc kubenswrapper[5120]: I0316 16:55:42.014629 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jcwd9\" (UniqueName: \"kubernetes.io/projected/3aa0bfe3-37d2-4600-a567-a69ce1cf4f03-kube-api-access-jcwd9\") pod \"keystone-db-create-cc255\" (UID: \"3aa0bfe3-37d2-4600-a567-a69ce1cf4f03\") " pod="openstack-kuttl-tests/keystone-db-create-cc255" Mar 16 16:55:42 crc kubenswrapper[5120]: I0316 16:55:42.014962 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3aa0bfe3-37d2-4600-a567-a69ce1cf4f03-operator-scripts\") pod \"keystone-db-create-cc255\" (UID: \"3aa0bfe3-37d2-4600-a567-a69ce1cf4f03\") " pod="openstack-kuttl-tests/keystone-db-create-cc255" Mar 16 16:55:42 crc kubenswrapper[5120]: I0316 16:55:42.084081 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-db-create-fnhgt"] Mar 16 16:55:42 crc kubenswrapper[5120]: I0316 16:55:42.089170 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-create-fnhgt" Mar 16 16:55:42 crc kubenswrapper[5120]: I0316 16:55:42.093904 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-db-create-fnhgt"] Mar 16 16:55:42 crc kubenswrapper[5120]: I0316 16:55:42.117368 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/1f940646-0e62-4646-899e-8e2f28a62167-operator-scripts\") pod \"keystone-f9be-account-create-update-6nsvb\" (UID: \"1f940646-0e62-4646-899e-8e2f28a62167\") " pod="openstack-kuttl-tests/keystone-f9be-account-create-update-6nsvb" Mar 16 16:55:42 crc kubenswrapper[5120]: I0316 16:55:42.117487 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3aa0bfe3-37d2-4600-a567-a69ce1cf4f03-operator-scripts\") pod \"keystone-db-create-cc255\" (UID: \"3aa0bfe3-37d2-4600-a567-a69ce1cf4f03\") " pod="openstack-kuttl-tests/keystone-db-create-cc255" Mar 16 16:55:42 crc kubenswrapper[5120]: I0316 16:55:42.117568 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29vkl\" (UniqueName: \"kubernetes.io/projected/1f940646-0e62-4646-899e-8e2f28a62167-kube-api-access-29vkl\") pod \"keystone-f9be-account-create-update-6nsvb\" (UID: \"1f940646-0e62-4646-899e-8e2f28a62167\") " pod="openstack-kuttl-tests/keystone-f9be-account-create-update-6nsvb" Mar 16 16:55:42 crc kubenswrapper[5120]: I0316 16:55:42.117666 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jcwd9\" (UniqueName: \"kubernetes.io/projected/3aa0bfe3-37d2-4600-a567-a69ce1cf4f03-kube-api-access-jcwd9\") pod \"keystone-db-create-cc255\" (UID: \"3aa0bfe3-37d2-4600-a567-a69ce1cf4f03\") " pod="openstack-kuttl-tests/keystone-db-create-cc255" Mar 16 16:55:42 crc kubenswrapper[5120]: I0316 16:55:42.118571 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3aa0bfe3-37d2-4600-a567-a69ce1cf4f03-operator-scripts\") pod \"keystone-db-create-cc255\" (UID: \"3aa0bfe3-37d2-4600-a567-a69ce1cf4f03\") " pod="openstack-kuttl-tests/keystone-db-create-cc255" Mar 16 16:55:42 crc kubenswrapper[5120]: I0316 16:55:42.137162 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jcwd9\" (UniqueName: \"kubernetes.io/projected/3aa0bfe3-37d2-4600-a567-a69ce1cf4f03-kube-api-access-jcwd9\") pod \"keystone-db-create-cc255\" (UID: \"3aa0bfe3-37d2-4600-a567-a69ce1cf4f03\") " pod="openstack-kuttl-tests/keystone-db-create-cc255" Mar 16 16:55:42 crc kubenswrapper[5120]: I0316 16:55:42.194081 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-create-cc255" Mar 16 16:55:42 crc kubenswrapper[5120]: I0316 16:55:42.196229 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-94e3-account-create-update-n4td2"] Mar 16 16:55:42 crc kubenswrapper[5120]: I0316 16:55:42.218291 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-94e3-account-create-update-n4td2"] Mar 16 16:55:42 crc kubenswrapper[5120]: I0316 16:55:42.218445 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-94e3-account-create-update-n4td2" Mar 16 16:55:42 crc kubenswrapper[5120]: I0316 16:55:42.219711 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/1f940646-0e62-4646-899e-8e2f28a62167-operator-scripts\") pod \"keystone-f9be-account-create-update-6nsvb\" (UID: \"1f940646-0e62-4646-899e-8e2f28a62167\") " pod="openstack-kuttl-tests/keystone-f9be-account-create-update-6nsvb" Mar 16 16:55:42 crc kubenswrapper[5120]: I0316 16:55:42.219846 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6n6dz\" (UniqueName: \"kubernetes.io/projected/a31afdf7-9949-4903-bc96-02df17647b63-kube-api-access-6n6dz\") pod \"placement-db-create-fnhgt\" (UID: \"a31afdf7-9949-4903-bc96-02df17647b63\") " pod="openstack-kuttl-tests/placement-db-create-fnhgt" Mar 16 16:55:42 crc kubenswrapper[5120]: I0316 16:55:42.219893 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-29vkl\" (UniqueName: \"kubernetes.io/projected/1f940646-0e62-4646-899e-8e2f28a62167-kube-api-access-29vkl\") pod \"keystone-f9be-account-create-update-6nsvb\" (UID: \"1f940646-0e62-4646-899e-8e2f28a62167\") " pod="openstack-kuttl-tests/keystone-f9be-account-create-update-6nsvb" Mar 16 16:55:42 crc kubenswrapper[5120]: I0316 16:55:42.219926 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a31afdf7-9949-4903-bc96-02df17647b63-operator-scripts\") pod \"placement-db-create-fnhgt\" (UID: \"a31afdf7-9949-4903-bc96-02df17647b63\") " pod="openstack-kuttl-tests/placement-db-create-fnhgt" Mar 16 16:55:42 crc kubenswrapper[5120]: I0316 16:55:42.220433 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/1f940646-0e62-4646-899e-8e2f28a62167-operator-scripts\") pod \"keystone-f9be-account-create-update-6nsvb\" (UID: \"1f940646-0e62-4646-899e-8e2f28a62167\") " pod="openstack-kuttl-tests/keystone-f9be-account-create-update-6nsvb" Mar 16 16:55:42 crc kubenswrapper[5120]: I0316 16:55:42.222230 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-db-secret\"" Mar 16 16:55:42 crc kubenswrapper[5120]: I0316 16:55:42.240741 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-29vkl\" (UniqueName: \"kubernetes.io/projected/1f940646-0e62-4646-899e-8e2f28a62167-kube-api-access-29vkl\") pod \"keystone-f9be-account-create-update-6nsvb\" (UID: \"1f940646-0e62-4646-899e-8e2f28a62167\") " pod="openstack-kuttl-tests/keystone-f9be-account-create-update-6nsvb" Mar 16 16:55:42 crc kubenswrapper[5120]: I0316 16:55:42.320667 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-f9be-account-create-update-6nsvb" Mar 16 16:55:42 crc kubenswrapper[5120]: I0316 16:55:42.321674 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m97vb\" (UniqueName: \"kubernetes.io/projected/a9cf5cd8-0677-420a-95b9-931325ffe4d2-kube-api-access-m97vb\") pod \"placement-94e3-account-create-update-n4td2\" (UID: \"a9cf5cd8-0677-420a-95b9-931325ffe4d2\") " pod="openstack-kuttl-tests/placement-94e3-account-create-update-n4td2" Mar 16 16:55:42 crc kubenswrapper[5120]: I0316 16:55:42.321871 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6n6dz\" (UniqueName: \"kubernetes.io/projected/a31afdf7-9949-4903-bc96-02df17647b63-kube-api-access-6n6dz\") pod \"placement-db-create-fnhgt\" (UID: \"a31afdf7-9949-4903-bc96-02df17647b63\") " pod="openstack-kuttl-tests/placement-db-create-fnhgt" Mar 16 16:55:42 crc kubenswrapper[5120]: I0316 16:55:42.321929 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a9cf5cd8-0677-420a-95b9-931325ffe4d2-operator-scripts\") pod \"placement-94e3-account-create-update-n4td2\" (UID: \"a9cf5cd8-0677-420a-95b9-931325ffe4d2\") " pod="openstack-kuttl-tests/placement-94e3-account-create-update-n4td2" Mar 16 16:55:42 crc kubenswrapper[5120]: I0316 16:55:42.321974 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a31afdf7-9949-4903-bc96-02df17647b63-operator-scripts\") pod \"placement-db-create-fnhgt\" (UID: \"a31afdf7-9949-4903-bc96-02df17647b63\") " pod="openstack-kuttl-tests/placement-db-create-fnhgt" Mar 16 16:55:42 crc kubenswrapper[5120]: I0316 16:55:42.322590 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a31afdf7-9949-4903-bc96-02df17647b63-operator-scripts\") pod \"placement-db-create-fnhgt\" (UID: \"a31afdf7-9949-4903-bc96-02df17647b63\") " pod="openstack-kuttl-tests/placement-db-create-fnhgt" Mar 16 16:55:42 crc kubenswrapper[5120]: I0316 16:55:42.340434 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6n6dz\" (UniqueName: \"kubernetes.io/projected/a31afdf7-9949-4903-bc96-02df17647b63-kube-api-access-6n6dz\") pod \"placement-db-create-fnhgt\" (UID: \"a31afdf7-9949-4903-bc96-02df17647b63\") " pod="openstack-kuttl-tests/placement-db-create-fnhgt" Mar 16 16:55:42 crc kubenswrapper[5120]: I0316 16:55:42.406256 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-create-fnhgt" Mar 16 16:55:42 crc kubenswrapper[5120]: I0316 16:55:42.424108 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a9cf5cd8-0677-420a-95b9-931325ffe4d2-operator-scripts\") pod \"placement-94e3-account-create-update-n4td2\" (UID: \"a9cf5cd8-0677-420a-95b9-931325ffe4d2\") " pod="openstack-kuttl-tests/placement-94e3-account-create-update-n4td2" Mar 16 16:55:42 crc kubenswrapper[5120]: I0316 16:55:42.424351 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m97vb\" (UniqueName: \"kubernetes.io/projected/a9cf5cd8-0677-420a-95b9-931325ffe4d2-kube-api-access-m97vb\") pod \"placement-94e3-account-create-update-n4td2\" (UID: \"a9cf5cd8-0677-420a-95b9-931325ffe4d2\") " pod="openstack-kuttl-tests/placement-94e3-account-create-update-n4td2" Mar 16 16:55:42 crc kubenswrapper[5120]: I0316 16:55:42.425517 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a9cf5cd8-0677-420a-95b9-931325ffe4d2-operator-scripts\") pod \"placement-94e3-account-create-update-n4td2\" (UID: \"a9cf5cd8-0677-420a-95b9-931325ffe4d2\") " pod="openstack-kuttl-tests/placement-94e3-account-create-update-n4td2" Mar 16 16:55:42 crc kubenswrapper[5120]: I0316 16:55:42.447791 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m97vb\" (UniqueName: \"kubernetes.io/projected/a9cf5cd8-0677-420a-95b9-931325ffe4d2-kube-api-access-m97vb\") pod \"placement-94e3-account-create-update-n4td2\" (UID: \"a9cf5cd8-0677-420a-95b9-931325ffe4d2\") " pod="openstack-kuttl-tests/placement-94e3-account-create-update-n4td2" Mar 16 16:55:42 crc kubenswrapper[5120]: I0316 16:55:42.597109 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-94e3-account-create-update-n4td2" Mar 16 16:55:42 crc kubenswrapper[5120]: I0316 16:55:42.661584 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-db-create-cc255"] Mar 16 16:55:42 crc kubenswrapper[5120]: I0316 16:55:42.663404 5120 scope.go:117] "RemoveContainer" containerID="083f72646c8d47c9c0467b39be99ddfa9c2e5900ae0a29ad53d7b39b950274b4" Mar 16 16:55:42 crc kubenswrapper[5120]: E0316 16:55:42.663669 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:55:42 crc kubenswrapper[5120]: W0316 16:55:42.704301 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3aa0bfe3_37d2_4600_a567_a69ce1cf4f03.slice/crio-e033944b9ccc50dc9ecb17ac8fbcfadae7c1e175b401c510483e540417da5354 WatchSource:0}: Error finding container e033944b9ccc50dc9ecb17ac8fbcfadae7c1e175b401c510483e540417da5354: Status 404 returned error can't find the container with id e033944b9ccc50dc9ecb17ac8fbcfadae7c1e175b401c510483e540417da5354 Mar 16 16:55:42 crc kubenswrapper[5120]: I0316 16:55:42.744841 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-create-cc255" event={"ID":"3aa0bfe3-37d2-4600-a567-a69ce1cf4f03","Type":"ContainerStarted","Data":"e033944b9ccc50dc9ecb17ac8fbcfadae7c1e175b401c510483e540417da5354"} Mar 16 16:55:42 crc kubenswrapper[5120]: I0316 16:55:42.793284 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-f9be-account-create-update-6nsvb"] Mar 16 16:55:42 crc kubenswrapper[5120]: I0316 16:55:42.895799 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-db-create-fnhgt"] Mar 16 16:55:42 crc kubenswrapper[5120]: W0316 16:55:42.913870 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda31afdf7_9949_4903_bc96_02df17647b63.slice/crio-27115357d1ca439df48a7dbc6163bdb29c4d918af44306fe1b10506ffe0f27c5 WatchSource:0}: Error finding container 27115357d1ca439df48a7dbc6163bdb29c4d918af44306fe1b10506ffe0f27c5: Status 404 returned error can't find the container with id 27115357d1ca439df48a7dbc6163bdb29c4d918af44306fe1b10506ffe0f27c5 Mar 16 16:55:42 crc kubenswrapper[5120]: I0316 16:55:42.940886 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:55:43 crc kubenswrapper[5120]: I0316 16:55:43.076932 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 16:55:43 crc kubenswrapper[5120]: I0316 16:55:43.090125 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-94e3-account-create-update-n4td2"] Mar 16 16:55:43 crc kubenswrapper[5120]: I0316 16:55:43.513855 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:55:43 crc kubenswrapper[5120]: I0316 16:55:43.755666 5120 generic.go:358] "Generic (PLEG): container finished" podID="1f940646-0e62-4646-899e-8e2f28a62167" containerID="b4ca7f201ba67359898e0f960da69c67ca6c46c934c27a9d0dcc34085b0182a0" exitCode=0 Mar 16 16:55:43 crc kubenswrapper[5120]: I0316 16:55:43.755793 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-f9be-account-create-update-6nsvb" event={"ID":"1f940646-0e62-4646-899e-8e2f28a62167","Type":"ContainerDied","Data":"b4ca7f201ba67359898e0f960da69c67ca6c46c934c27a9d0dcc34085b0182a0"} Mar 16 16:55:43 crc kubenswrapper[5120]: I0316 16:55:43.755833 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-f9be-account-create-update-6nsvb" event={"ID":"1f940646-0e62-4646-899e-8e2f28a62167","Type":"ContainerStarted","Data":"31fd60a77d7d5d8b97a4b8ce2cd3520972dfb8592bf762479a14b08d4f0faafc"} Mar 16 16:55:43 crc kubenswrapper[5120]: I0316 16:55:43.757728 5120 generic.go:358] "Generic (PLEG): container finished" podID="3aa0bfe3-37d2-4600-a567-a69ce1cf4f03" containerID="b975633145eda0f8448b1545826e6b8e31333016168f9b81f1ceaee40959dda8" exitCode=0 Mar 16 16:55:43 crc kubenswrapper[5120]: I0316 16:55:43.757829 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-create-cc255" event={"ID":"3aa0bfe3-37d2-4600-a567-a69ce1cf4f03","Type":"ContainerDied","Data":"b975633145eda0f8448b1545826e6b8e31333016168f9b81f1ceaee40959dda8"} Mar 16 16:55:43 crc kubenswrapper[5120]: I0316 16:55:43.759142 5120 generic.go:358] "Generic (PLEG): container finished" podID="a9cf5cd8-0677-420a-95b9-931325ffe4d2" containerID="d18ae45a7bd16b2475a636f555a606b5940bcadadeed5617f54d6d4c6a6b469f" exitCode=0 Mar 16 16:55:43 crc kubenswrapper[5120]: I0316 16:55:43.759180 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-94e3-account-create-update-n4td2" event={"ID":"a9cf5cd8-0677-420a-95b9-931325ffe4d2","Type":"ContainerDied","Data":"d18ae45a7bd16b2475a636f555a606b5940bcadadeed5617f54d6d4c6a6b469f"} Mar 16 16:55:43 crc kubenswrapper[5120]: I0316 16:55:43.759205 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-94e3-account-create-update-n4td2" event={"ID":"a9cf5cd8-0677-420a-95b9-931325ffe4d2","Type":"ContainerStarted","Data":"766bfbb107ac820366826176fbe2d469f8694035381ff8bcd11d9d3d27f8e6a5"} Mar 16 16:55:43 crc kubenswrapper[5120]: I0316 16:55:43.760523 5120 generic.go:358] "Generic (PLEG): container finished" podID="a31afdf7-9949-4903-bc96-02df17647b63" containerID="9ac3921838bb561759659bd1773fd3f8b082e010a21c94cdd332cda5e7d02964" exitCode=0 Mar 16 16:55:43 crc kubenswrapper[5120]: I0316 16:55:43.760613 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-create-fnhgt" event={"ID":"a31afdf7-9949-4903-bc96-02df17647b63","Type":"ContainerDied","Data":"9ac3921838bb561759659bd1773fd3f8b082e010a21c94cdd332cda5e7d02964"} Mar 16 16:55:43 crc kubenswrapper[5120]: I0316 16:55:43.760648 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-create-fnhgt" event={"ID":"a31afdf7-9949-4903-bc96-02df17647b63","Type":"ContainerStarted","Data":"27115357d1ca439df48a7dbc6163bdb29c4d918af44306fe1b10506ffe0f27c5"} Mar 16 16:55:44 crc kubenswrapper[5120]: I0316 16:55:44.065276 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 16:55:44 crc kubenswrapper[5120]: I0316 16:55:44.075063 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:55:44 crc kubenswrapper[5120]: I0316 16:55:44.077598 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"swift-ring-files\"" Mar 16 16:55:44 crc kubenswrapper[5120]: I0316 16:55:44.078484 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"swift-conf\"" Mar 16 16:55:44 crc kubenswrapper[5120]: I0316 16:55:44.078684 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"swift-swift-dockercfg-hx4dn\"" Mar 16 16:55:44 crc kubenswrapper[5120]: I0316 16:55:44.079439 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"swift-storage-config-data\"" Mar 16 16:55:44 crc kubenswrapper[5120]: I0316 16:55:44.090180 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 16:55:44 crc kubenswrapper[5120]: I0316 16:55:44.173343 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/1f6975fd-67a9-4ce2-87b0-7318d7345a80-cache\") pod \"swift-storage-0\" (UID: \"1f6975fd-67a9-4ce2-87b0-7318d7345a80\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:55:44 crc kubenswrapper[5120]: I0316 16:55:44.173440 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwbvs\" (UniqueName: \"kubernetes.io/projected/1f6975fd-67a9-4ce2-87b0-7318d7345a80-kube-api-access-xwbvs\") pod \"swift-storage-0\" (UID: \"1f6975fd-67a9-4ce2-87b0-7318d7345a80\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:55:44 crc kubenswrapper[5120]: I0316 16:55:44.173472 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/1f6975fd-67a9-4ce2-87b0-7318d7345a80-lock\") pod \"swift-storage-0\" (UID: \"1f6975fd-67a9-4ce2-87b0-7318d7345a80\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:55:44 crc kubenswrapper[5120]: I0316 16:55:44.173538 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/1f6975fd-67a9-4ce2-87b0-7318d7345a80-etc-swift\") pod \"swift-storage-0\" (UID: \"1f6975fd-67a9-4ce2-87b0-7318d7345a80\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:55:44 crc kubenswrapper[5120]: I0316 16:55:44.173626 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1f6975fd-67a9-4ce2-87b0-7318d7345a80-combined-ca-bundle\") pod \"swift-storage-0\" (UID: \"1f6975fd-67a9-4ce2-87b0-7318d7345a80\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:55:44 crc kubenswrapper[5120]: I0316 16:55:44.173741 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"swift-storage-0\" (UID: \"1f6975fd-67a9-4ce2-87b0-7318d7345a80\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:55:44 crc kubenswrapper[5120]: I0316 16:55:44.275093 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1f6975fd-67a9-4ce2-87b0-7318d7345a80-combined-ca-bundle\") pod \"swift-storage-0\" (UID: \"1f6975fd-67a9-4ce2-87b0-7318d7345a80\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:55:44 crc kubenswrapper[5120]: I0316 16:55:44.275432 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"swift-storage-0\" (UID: \"1f6975fd-67a9-4ce2-87b0-7318d7345a80\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:55:44 crc kubenswrapper[5120]: I0316 16:55:44.275618 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/1f6975fd-67a9-4ce2-87b0-7318d7345a80-cache\") pod \"swift-storage-0\" (UID: \"1f6975fd-67a9-4ce2-87b0-7318d7345a80\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:55:44 crc kubenswrapper[5120]: I0316 16:55:44.275745 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xwbvs\" (UniqueName: \"kubernetes.io/projected/1f6975fd-67a9-4ce2-87b0-7318d7345a80-kube-api-access-xwbvs\") pod \"swift-storage-0\" (UID: \"1f6975fd-67a9-4ce2-87b0-7318d7345a80\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:55:44 crc kubenswrapper[5120]: I0316 16:55:44.275862 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/1f6975fd-67a9-4ce2-87b0-7318d7345a80-lock\") pod \"swift-storage-0\" (UID: \"1f6975fd-67a9-4ce2-87b0-7318d7345a80\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:55:44 crc kubenswrapper[5120]: I0316 16:55:44.275971 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/1f6975fd-67a9-4ce2-87b0-7318d7345a80-etc-swift\") pod \"swift-storage-0\" (UID: \"1f6975fd-67a9-4ce2-87b0-7318d7345a80\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:55:44 crc kubenswrapper[5120]: E0316 16:55:44.276165 5120 projected.go:289] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Mar 16 16:55:44 crc kubenswrapper[5120]: E0316 16:55:44.276231 5120 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Mar 16 16:55:44 crc kubenswrapper[5120]: E0316 16:55:44.276331 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1f6975fd-67a9-4ce2-87b0-7318d7345a80-etc-swift podName:1f6975fd-67a9-4ce2-87b0-7318d7345a80 nodeName:}" failed. No retries permitted until 2026-03-16 16:55:44.776314089 +0000 UTC m=+5046.930245746 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/1f6975fd-67a9-4ce2-87b0-7318d7345a80-etc-swift") pod "swift-storage-0" (UID: "1f6975fd-67a9-4ce2-87b0-7318d7345a80") : configmap "swift-ring-files" not found Mar 16 16:55:44 crc kubenswrapper[5120]: I0316 16:55:44.277850 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/1f6975fd-67a9-4ce2-87b0-7318d7345a80-lock\") pod \"swift-storage-0\" (UID: \"1f6975fd-67a9-4ce2-87b0-7318d7345a80\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:55:44 crc kubenswrapper[5120]: I0316 16:55:44.277882 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"swift-storage-0\" (UID: \"1f6975fd-67a9-4ce2-87b0-7318d7345a80\") device mount path \"/mnt/openstack/pv03\"" pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:55:44 crc kubenswrapper[5120]: I0316 16:55:44.277955 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/1f6975fd-67a9-4ce2-87b0-7318d7345a80-cache\") pod \"swift-storage-0\" (UID: \"1f6975fd-67a9-4ce2-87b0-7318d7345a80\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:55:44 crc kubenswrapper[5120]: I0316 16:55:44.284059 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1f6975fd-67a9-4ce2-87b0-7318d7345a80-combined-ca-bundle\") pod \"swift-storage-0\" (UID: \"1f6975fd-67a9-4ce2-87b0-7318d7345a80\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:55:44 crc kubenswrapper[5120]: I0316 16:55:44.293704 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwbvs\" (UniqueName: \"kubernetes.io/projected/1f6975fd-67a9-4ce2-87b0-7318d7345a80-kube-api-access-xwbvs\") pod \"swift-storage-0\" (UID: \"1f6975fd-67a9-4ce2-87b0-7318d7345a80\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:55:44 crc kubenswrapper[5120]: I0316 16:55:44.299549 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"swift-storage-0\" (UID: \"1f6975fd-67a9-4ce2-87b0-7318d7345a80\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:55:44 crc kubenswrapper[5120]: I0316 16:55:44.549363 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:55:44 crc kubenswrapper[5120]: I0316 16:55:44.584364 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 16:55:44 crc kubenswrapper[5120]: I0316 16:55:44.790136 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/1f6975fd-67a9-4ce2-87b0-7318d7345a80-etc-swift\") pod \"swift-storage-0\" (UID: \"1f6975fd-67a9-4ce2-87b0-7318d7345a80\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:55:44 crc kubenswrapper[5120]: E0316 16:55:44.790444 5120 projected.go:289] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Mar 16 16:55:44 crc kubenswrapper[5120]: E0316 16:55:44.790460 5120 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Mar 16 16:55:44 crc kubenswrapper[5120]: E0316 16:55:44.790511 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1f6975fd-67a9-4ce2-87b0-7318d7345a80-etc-swift podName:1f6975fd-67a9-4ce2-87b0-7318d7345a80 nodeName:}" failed. No retries permitted until 2026-03-16 16:55:45.790495213 +0000 UTC m=+5047.944426860 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/1f6975fd-67a9-4ce2-87b0-7318d7345a80-etc-swift") pod "swift-storage-0" (UID: "1f6975fd-67a9-4ce2-87b0-7318d7345a80") : configmap "swift-ring-files" not found Mar 16 16:55:44 crc kubenswrapper[5120]: I0316 16:55:44.804873 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 16:55:44 crc kubenswrapper[5120]: I0316 16:55:44.832647 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 16:55:44 crc kubenswrapper[5120]: I0316 16:55:44.832793 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:55:44 crc kubenswrapper[5120]: I0316 16:55:44.835555 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ovnnorthd-ovndbs\"" Mar 16 16:55:44 crc kubenswrapper[5120]: I0316 16:55:44.835647 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ovnnorthd-ovnnorthd-dockercfg-swqbh\"" Mar 16 16:55:44 crc kubenswrapper[5120]: I0316 16:55:44.835884 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovnnorthd-scripts\"" Mar 16 16:55:44 crc kubenswrapper[5120]: I0316 16:55:44.835939 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovnnorthd-config\"" Mar 16 16:55:44 crc kubenswrapper[5120]: I0316 16:55:44.994815 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b0790e22-4129-49de-b1d6-25c9288301f0-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"b0790e22-4129-49de-b1d6-25c9288301f0\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:55:44 crc kubenswrapper[5120]: I0316 16:55:44.994885 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s29qb\" (UniqueName: \"kubernetes.io/projected/b0790e22-4129-49de-b1d6-25c9288301f0-kube-api-access-s29qb\") pod \"ovn-northd-0\" (UID: \"b0790e22-4129-49de-b1d6-25c9288301f0\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:55:44 crc kubenswrapper[5120]: I0316 16:55:44.995240 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b0790e22-4129-49de-b1d6-25c9288301f0-config\") pod \"ovn-northd-0\" (UID: \"b0790e22-4129-49de-b1d6-25c9288301f0\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:55:44 crc kubenswrapper[5120]: I0316 16:55:44.995296 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/b0790e22-4129-49de-b1d6-25c9288301f0-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"b0790e22-4129-49de-b1d6-25c9288301f0\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:55:44 crc kubenswrapper[5120]: I0316 16:55:44.995456 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/b0790e22-4129-49de-b1d6-25c9288301f0-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"b0790e22-4129-49de-b1d6-25c9288301f0\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:55:44 crc kubenswrapper[5120]: I0316 16:55:44.995521 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/b0790e22-4129-49de-b1d6-25c9288301f0-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"b0790e22-4129-49de-b1d6-25c9288301f0\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:55:44 crc kubenswrapper[5120]: I0316 16:55:44.995632 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/b0790e22-4129-49de-b1d6-25c9288301f0-scripts\") pod \"ovn-northd-0\" (UID: \"b0790e22-4129-49de-b1d6-25c9288301f0\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:55:45 crc kubenswrapper[5120]: I0316 16:55:45.097479 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b0790e22-4129-49de-b1d6-25c9288301f0-config\") pod \"ovn-northd-0\" (UID: \"b0790e22-4129-49de-b1d6-25c9288301f0\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:55:45 crc kubenswrapper[5120]: I0316 16:55:45.097523 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/b0790e22-4129-49de-b1d6-25c9288301f0-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"b0790e22-4129-49de-b1d6-25c9288301f0\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:55:45 crc kubenswrapper[5120]: I0316 16:55:45.097573 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/b0790e22-4129-49de-b1d6-25c9288301f0-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"b0790e22-4129-49de-b1d6-25c9288301f0\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:55:45 crc kubenswrapper[5120]: I0316 16:55:45.097601 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/b0790e22-4129-49de-b1d6-25c9288301f0-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"b0790e22-4129-49de-b1d6-25c9288301f0\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:55:45 crc kubenswrapper[5120]: I0316 16:55:45.097649 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/b0790e22-4129-49de-b1d6-25c9288301f0-scripts\") pod \"ovn-northd-0\" (UID: \"b0790e22-4129-49de-b1d6-25c9288301f0\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:55:45 crc kubenswrapper[5120]: I0316 16:55:45.097826 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b0790e22-4129-49de-b1d6-25c9288301f0-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"b0790e22-4129-49de-b1d6-25c9288301f0\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:55:45 crc kubenswrapper[5120]: I0316 16:55:45.097861 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s29qb\" (UniqueName: \"kubernetes.io/projected/b0790e22-4129-49de-b1d6-25c9288301f0-kube-api-access-s29qb\") pod \"ovn-northd-0\" (UID: \"b0790e22-4129-49de-b1d6-25c9288301f0\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:55:45 crc kubenswrapper[5120]: I0316 16:55:45.098639 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b0790e22-4129-49de-b1d6-25c9288301f0-config\") pod \"ovn-northd-0\" (UID: \"b0790e22-4129-49de-b1d6-25c9288301f0\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:55:45 crc kubenswrapper[5120]: I0316 16:55:45.099003 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/b0790e22-4129-49de-b1d6-25c9288301f0-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"b0790e22-4129-49de-b1d6-25c9288301f0\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:55:45 crc kubenswrapper[5120]: I0316 16:55:45.100716 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/b0790e22-4129-49de-b1d6-25c9288301f0-scripts\") pod \"ovn-northd-0\" (UID: \"b0790e22-4129-49de-b1d6-25c9288301f0\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:55:45 crc kubenswrapper[5120]: I0316 16:55:45.109688 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b0790e22-4129-49de-b1d6-25c9288301f0-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"b0790e22-4129-49de-b1d6-25c9288301f0\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:55:45 crc kubenswrapper[5120]: I0316 16:55:45.119319 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s29qb\" (UniqueName: \"kubernetes.io/projected/b0790e22-4129-49de-b1d6-25c9288301f0-kube-api-access-s29qb\") pod \"ovn-northd-0\" (UID: \"b0790e22-4129-49de-b1d6-25c9288301f0\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:55:45 crc kubenswrapper[5120]: I0316 16:55:45.120529 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/b0790e22-4129-49de-b1d6-25c9288301f0-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"b0790e22-4129-49de-b1d6-25c9288301f0\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:55:45 crc kubenswrapper[5120]: I0316 16:55:45.130328 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/b0790e22-4129-49de-b1d6-25c9288301f0-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"b0790e22-4129-49de-b1d6-25c9288301f0\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:55:45 crc kubenswrapper[5120]: I0316 16:55:45.158486 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:55:45 crc kubenswrapper[5120]: I0316 16:55:45.248183 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-f9be-account-create-update-6nsvb" Mar 16 16:55:45 crc kubenswrapper[5120]: I0316 16:55:45.306755 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f940646-0e62-4646-899e-8e2f28a62167-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "1f940646-0e62-4646-899e-8e2f28a62167" (UID: "1f940646-0e62-4646-899e-8e2f28a62167"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:55:45 crc kubenswrapper[5120]: I0316 16:55:45.306816 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/1f940646-0e62-4646-899e-8e2f28a62167-operator-scripts\") pod \"1f940646-0e62-4646-899e-8e2f28a62167\" (UID: \"1f940646-0e62-4646-899e-8e2f28a62167\") " Mar 16 16:55:45 crc kubenswrapper[5120]: I0316 16:55:45.306970 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-29vkl\" (UniqueName: \"kubernetes.io/projected/1f940646-0e62-4646-899e-8e2f28a62167-kube-api-access-29vkl\") pod \"1f940646-0e62-4646-899e-8e2f28a62167\" (UID: \"1f940646-0e62-4646-899e-8e2f28a62167\") " Mar 16 16:55:45 crc kubenswrapper[5120]: I0316 16:55:45.307425 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/1f940646-0e62-4646-899e-8e2f28a62167-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:55:45 crc kubenswrapper[5120]: I0316 16:55:45.318283 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f940646-0e62-4646-899e-8e2f28a62167-kube-api-access-29vkl" (OuterVolumeSpecName: "kube-api-access-29vkl") pod "1f940646-0e62-4646-899e-8e2f28a62167" (UID: "1f940646-0e62-4646-899e-8e2f28a62167"). InnerVolumeSpecName "kube-api-access-29vkl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:55:45 crc kubenswrapper[5120]: I0316 16:55:45.410301 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-29vkl\" (UniqueName: \"kubernetes.io/projected/1f940646-0e62-4646-899e-8e2f28a62167-kube-api-access-29vkl\") on node \"crc\" DevicePath \"\"" Mar 16 16:55:45 crc kubenswrapper[5120]: I0316 16:55:45.474270 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-94e3-account-create-update-n4td2" Mar 16 16:55:45 crc kubenswrapper[5120]: I0316 16:55:45.482097 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-create-fnhgt" Mar 16 16:55:45 crc kubenswrapper[5120]: I0316 16:55:45.500037 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-create-cc255" Mar 16 16:55:45 crc kubenswrapper[5120]: I0316 16:55:45.616956 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3aa0bfe3-37d2-4600-a567-a69ce1cf4f03-operator-scripts\") pod \"3aa0bfe3-37d2-4600-a567-a69ce1cf4f03\" (UID: \"3aa0bfe3-37d2-4600-a567-a69ce1cf4f03\") " Mar 16 16:55:45 crc kubenswrapper[5120]: I0316 16:55:45.617063 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a9cf5cd8-0677-420a-95b9-931325ffe4d2-operator-scripts\") pod \"a9cf5cd8-0677-420a-95b9-931325ffe4d2\" (UID: \"a9cf5cd8-0677-420a-95b9-931325ffe4d2\") " Mar 16 16:55:45 crc kubenswrapper[5120]: I0316 16:55:45.617181 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m97vb\" (UniqueName: \"kubernetes.io/projected/a9cf5cd8-0677-420a-95b9-931325ffe4d2-kube-api-access-m97vb\") pod \"a9cf5cd8-0677-420a-95b9-931325ffe4d2\" (UID: \"a9cf5cd8-0677-420a-95b9-931325ffe4d2\") " Mar 16 16:55:45 crc kubenswrapper[5120]: I0316 16:55:45.617449 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jcwd9\" (UniqueName: \"kubernetes.io/projected/3aa0bfe3-37d2-4600-a567-a69ce1cf4f03-kube-api-access-jcwd9\") pod \"3aa0bfe3-37d2-4600-a567-a69ce1cf4f03\" (UID: \"3aa0bfe3-37d2-4600-a567-a69ce1cf4f03\") " Mar 16 16:55:45 crc kubenswrapper[5120]: I0316 16:55:45.617529 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a31afdf7-9949-4903-bc96-02df17647b63-operator-scripts\") pod \"a31afdf7-9949-4903-bc96-02df17647b63\" (UID: \"a31afdf7-9949-4903-bc96-02df17647b63\") " Mar 16 16:55:45 crc kubenswrapper[5120]: I0316 16:55:45.617560 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3aa0bfe3-37d2-4600-a567-a69ce1cf4f03-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "3aa0bfe3-37d2-4600-a567-a69ce1cf4f03" (UID: "3aa0bfe3-37d2-4600-a567-a69ce1cf4f03"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:55:45 crc kubenswrapper[5120]: I0316 16:55:45.618158 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a9cf5cd8-0677-420a-95b9-931325ffe4d2-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "a9cf5cd8-0677-420a-95b9-931325ffe4d2" (UID: "a9cf5cd8-0677-420a-95b9-931325ffe4d2"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:55:45 crc kubenswrapper[5120]: I0316 16:55:45.618268 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a31afdf7-9949-4903-bc96-02df17647b63-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "a31afdf7-9949-4903-bc96-02df17647b63" (UID: "a31afdf7-9949-4903-bc96-02df17647b63"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:55:45 crc kubenswrapper[5120]: I0316 16:55:45.617578 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6n6dz\" (UniqueName: \"kubernetes.io/projected/a31afdf7-9949-4903-bc96-02df17647b63-kube-api-access-6n6dz\") pod \"a31afdf7-9949-4903-bc96-02df17647b63\" (UID: \"a31afdf7-9949-4903-bc96-02df17647b63\") " Mar 16 16:55:45 crc kubenswrapper[5120]: I0316 16:55:45.619351 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a9cf5cd8-0677-420a-95b9-931325ffe4d2-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:55:45 crc kubenswrapper[5120]: I0316 16:55:45.619373 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a31afdf7-9949-4903-bc96-02df17647b63-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:55:45 crc kubenswrapper[5120]: I0316 16:55:45.619383 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3aa0bfe3-37d2-4600-a567-a69ce1cf4f03-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:55:45 crc kubenswrapper[5120]: I0316 16:55:45.622510 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3aa0bfe3-37d2-4600-a567-a69ce1cf4f03-kube-api-access-jcwd9" (OuterVolumeSpecName: "kube-api-access-jcwd9") pod "3aa0bfe3-37d2-4600-a567-a69ce1cf4f03" (UID: "3aa0bfe3-37d2-4600-a567-a69ce1cf4f03"). InnerVolumeSpecName "kube-api-access-jcwd9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:55:45 crc kubenswrapper[5120]: I0316 16:55:45.622611 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a9cf5cd8-0677-420a-95b9-931325ffe4d2-kube-api-access-m97vb" (OuterVolumeSpecName: "kube-api-access-m97vb") pod "a9cf5cd8-0677-420a-95b9-931325ffe4d2" (UID: "a9cf5cd8-0677-420a-95b9-931325ffe4d2"). InnerVolumeSpecName "kube-api-access-m97vb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:55:45 crc kubenswrapper[5120]: I0316 16:55:45.622581 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a31afdf7-9949-4903-bc96-02df17647b63-kube-api-access-6n6dz" (OuterVolumeSpecName: "kube-api-access-6n6dz") pod "a31afdf7-9949-4903-bc96-02df17647b63" (UID: "a31afdf7-9949-4903-bc96-02df17647b63"). InnerVolumeSpecName "kube-api-access-6n6dz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:55:45 crc kubenswrapper[5120]: I0316 16:55:45.680474 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 16:55:45 crc kubenswrapper[5120]: W0316 16:55:45.686688 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb0790e22_4129_49de_b1d6_25c9288301f0.slice/crio-1a34afdfb40e55068a874c665fa9417a3a0f138f37b8b4fe545eec99aaa2bf78 WatchSource:0}: Error finding container 1a34afdfb40e55068a874c665fa9417a3a0f138f37b8b4fe545eec99aaa2bf78: Status 404 returned error can't find the container with id 1a34afdfb40e55068a874c665fa9417a3a0f138f37b8b4fe545eec99aaa2bf78 Mar 16 16:55:45 crc kubenswrapper[5120]: I0316 16:55:45.721998 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jcwd9\" (UniqueName: \"kubernetes.io/projected/3aa0bfe3-37d2-4600-a567-a69ce1cf4f03-kube-api-access-jcwd9\") on node \"crc\" DevicePath \"\"" Mar 16 16:55:45 crc kubenswrapper[5120]: I0316 16:55:45.722033 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6n6dz\" (UniqueName: \"kubernetes.io/projected/a31afdf7-9949-4903-bc96-02df17647b63-kube-api-access-6n6dz\") on node \"crc\" DevicePath \"\"" Mar 16 16:55:45 crc kubenswrapper[5120]: I0316 16:55:45.722046 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m97vb\" (UniqueName: \"kubernetes.io/projected/a9cf5cd8-0677-420a-95b9-931325ffe4d2-kube-api-access-m97vb\") on node \"crc\" DevicePath \"\"" Mar 16 16:55:45 crc kubenswrapper[5120]: I0316 16:55:45.788477 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"b0790e22-4129-49de-b1d6-25c9288301f0","Type":"ContainerStarted","Data":"1a34afdfb40e55068a874c665fa9417a3a0f138f37b8b4fe545eec99aaa2bf78"} Mar 16 16:55:45 crc kubenswrapper[5120]: I0316 16:55:45.790734 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-f9be-account-create-update-6nsvb" event={"ID":"1f940646-0e62-4646-899e-8e2f28a62167","Type":"ContainerDied","Data":"31fd60a77d7d5d8b97a4b8ce2cd3520972dfb8592bf762479a14b08d4f0faafc"} Mar 16 16:55:45 crc kubenswrapper[5120]: I0316 16:55:45.790782 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="31fd60a77d7d5d8b97a4b8ce2cd3520972dfb8592bf762479a14b08d4f0faafc" Mar 16 16:55:45 crc kubenswrapper[5120]: I0316 16:55:45.792499 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-f9be-account-create-update-6nsvb" Mar 16 16:55:45 crc kubenswrapper[5120]: I0316 16:55:45.792794 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-create-cc255" event={"ID":"3aa0bfe3-37d2-4600-a567-a69ce1cf4f03","Type":"ContainerDied","Data":"e033944b9ccc50dc9ecb17ac8fbcfadae7c1e175b401c510483e540417da5354"} Mar 16 16:55:45 crc kubenswrapper[5120]: I0316 16:55:45.792841 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e033944b9ccc50dc9ecb17ac8fbcfadae7c1e175b401c510483e540417da5354" Mar 16 16:55:45 crc kubenswrapper[5120]: I0316 16:55:45.792963 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-create-cc255" Mar 16 16:55:45 crc kubenswrapper[5120]: I0316 16:55:45.795002 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-94e3-account-create-update-n4td2" Mar 16 16:55:45 crc kubenswrapper[5120]: I0316 16:55:45.795090 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-94e3-account-create-update-n4td2" event={"ID":"a9cf5cd8-0677-420a-95b9-931325ffe4d2","Type":"ContainerDied","Data":"766bfbb107ac820366826176fbe2d469f8694035381ff8bcd11d9d3d27f8e6a5"} Mar 16 16:55:45 crc kubenswrapper[5120]: I0316 16:55:45.795127 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="766bfbb107ac820366826176fbe2d469f8694035381ff8bcd11d9d3d27f8e6a5" Mar 16 16:55:45 crc kubenswrapper[5120]: I0316 16:55:45.797252 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-create-fnhgt" event={"ID":"a31afdf7-9949-4903-bc96-02df17647b63","Type":"ContainerDied","Data":"27115357d1ca439df48a7dbc6163bdb29c4d918af44306fe1b10506ffe0f27c5"} Mar 16 16:55:45 crc kubenswrapper[5120]: I0316 16:55:45.797278 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="27115357d1ca439df48a7dbc6163bdb29c4d918af44306fe1b10506ffe0f27c5" Mar 16 16:55:45 crc kubenswrapper[5120]: I0316 16:55:45.797366 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-create-fnhgt" Mar 16 16:55:45 crc kubenswrapper[5120]: I0316 16:55:45.827294 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/1f6975fd-67a9-4ce2-87b0-7318d7345a80-etc-swift\") pod \"swift-storage-0\" (UID: \"1f6975fd-67a9-4ce2-87b0-7318d7345a80\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:55:45 crc kubenswrapper[5120]: E0316 16:55:45.827482 5120 projected.go:289] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Mar 16 16:55:45 crc kubenswrapper[5120]: E0316 16:55:45.827509 5120 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Mar 16 16:55:45 crc kubenswrapper[5120]: E0316 16:55:45.827575 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1f6975fd-67a9-4ce2-87b0-7318d7345a80-etc-swift podName:1f6975fd-67a9-4ce2-87b0-7318d7345a80 nodeName:}" failed. No retries permitted until 2026-03-16 16:55:47.827557078 +0000 UTC m=+5049.981488735 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/1f6975fd-67a9-4ce2-87b0-7318d7345a80-etc-swift") pod "swift-storage-0" (UID: "1f6975fd-67a9-4ce2-87b0-7318d7345a80") : configmap "swift-ring-files" not found Mar 16 16:55:46 crc kubenswrapper[5120]: I0316 16:55:46.674914 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:55:46 crc kubenswrapper[5120]: I0316 16:55:46.809898 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"b0790e22-4129-49de-b1d6-25c9288301f0","Type":"ContainerStarted","Data":"ea563bcfceca9858a012e2116c5b84a6aa7066ee3bdd5115c54f7a2c5841ad96"} Mar 16 16:55:46 crc kubenswrapper[5120]: I0316 16:55:46.809944 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"b0790e22-4129-49de-b1d6-25c9288301f0","Type":"ContainerStarted","Data":"25452cdb3754529b9172640423ac8e022a547938c3c8e33217454a9176746833"} Mar 16 16:55:46 crc kubenswrapper[5120]: I0316 16:55:46.810269 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:55:47 crc kubenswrapper[5120]: I0316 16:55:47.273105 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovn-northd-0" podStartSLOduration=3.27296612 podStartE2EDuration="3.27296612s" podCreationTimestamp="2026-03-16 16:55:44 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:55:46.844836652 +0000 UTC m=+5048.998768329" watchObservedRunningTime="2026-03-16 16:55:47.27296612 +0000 UTC m=+5049.426897797" Mar 16 16:55:47 crc kubenswrapper[5120]: I0316 16:55:47.273443 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/community-operators-ljct4"] Mar 16 16:55:47 crc kubenswrapper[5120]: I0316 16:55:47.274436 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a31afdf7-9949-4903-bc96-02df17647b63" containerName="mariadb-database-create" Mar 16 16:55:47 crc kubenswrapper[5120]: I0316 16:55:47.274462 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a31afdf7-9949-4903-bc96-02df17647b63" containerName="mariadb-database-create" Mar 16 16:55:47 crc kubenswrapper[5120]: I0316 16:55:47.274473 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f940646-0e62-4646-899e-8e2f28a62167" containerName="mariadb-account-create-update" Mar 16 16:55:47 crc kubenswrapper[5120]: I0316 16:55:47.274482 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f940646-0e62-4646-899e-8e2f28a62167" containerName="mariadb-account-create-update" Mar 16 16:55:47 crc kubenswrapper[5120]: I0316 16:55:47.274494 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3aa0bfe3-37d2-4600-a567-a69ce1cf4f03" containerName="mariadb-database-create" Mar 16 16:55:47 crc kubenswrapper[5120]: I0316 16:55:47.274501 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="3aa0bfe3-37d2-4600-a567-a69ce1cf4f03" containerName="mariadb-database-create" Mar 16 16:55:47 crc kubenswrapper[5120]: I0316 16:55:47.274523 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9cf5cd8-0677-420a-95b9-931325ffe4d2" containerName="mariadb-account-create-update" Mar 16 16:55:47 crc kubenswrapper[5120]: I0316 16:55:47.274528 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9cf5cd8-0677-420a-95b9-931325ffe4d2" containerName="mariadb-account-create-update" Mar 16 16:55:47 crc kubenswrapper[5120]: I0316 16:55:47.274681 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1f940646-0e62-4646-899e-8e2f28a62167" containerName="mariadb-account-create-update" Mar 16 16:55:47 crc kubenswrapper[5120]: I0316 16:55:47.274703 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="a31afdf7-9949-4903-bc96-02df17647b63" containerName="mariadb-database-create" Mar 16 16:55:47 crc kubenswrapper[5120]: I0316 16:55:47.274718 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="3aa0bfe3-37d2-4600-a567-a69ce1cf4f03" containerName="mariadb-database-create" Mar 16 16:55:47 crc kubenswrapper[5120]: I0316 16:55:47.274727 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="a9cf5cd8-0677-420a-95b9-931325ffe4d2" containerName="mariadb-account-create-update" Mar 16 16:55:47 crc kubenswrapper[5120]: I0316 16:55:47.284271 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-ljct4" Mar 16 16:55:47 crc kubenswrapper[5120]: I0316 16:55:47.287356 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/community-operators-ljct4"] Mar 16 16:55:47 crc kubenswrapper[5120]: I0316 16:55:47.460275 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/931f5e13-4fc0-4007-beb8-a617915a97ca-catalog-content\") pod \"community-operators-ljct4\" (UID: \"931f5e13-4fc0-4007-beb8-a617915a97ca\") " pod="openshift-marketplace/community-operators-ljct4" Mar 16 16:55:47 crc kubenswrapper[5120]: I0316 16:55:47.460716 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8rqf\" (UniqueName: \"kubernetes.io/projected/931f5e13-4fc0-4007-beb8-a617915a97ca-kube-api-access-q8rqf\") pod \"community-operators-ljct4\" (UID: \"931f5e13-4fc0-4007-beb8-a617915a97ca\") " pod="openshift-marketplace/community-operators-ljct4" Mar 16 16:55:47 crc kubenswrapper[5120]: I0316 16:55:47.460826 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/931f5e13-4fc0-4007-beb8-a617915a97ca-utilities\") pod \"community-operators-ljct4\" (UID: \"931f5e13-4fc0-4007-beb8-a617915a97ca\") " pod="openshift-marketplace/community-operators-ljct4" Mar 16 16:55:47 crc kubenswrapper[5120]: I0316 16:55:47.562153 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/931f5e13-4fc0-4007-beb8-a617915a97ca-catalog-content\") pod \"community-operators-ljct4\" (UID: \"931f5e13-4fc0-4007-beb8-a617915a97ca\") " pod="openshift-marketplace/community-operators-ljct4" Mar 16 16:55:47 crc kubenswrapper[5120]: I0316 16:55:47.562347 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q8rqf\" (UniqueName: \"kubernetes.io/projected/931f5e13-4fc0-4007-beb8-a617915a97ca-kube-api-access-q8rqf\") pod \"community-operators-ljct4\" (UID: \"931f5e13-4fc0-4007-beb8-a617915a97ca\") " pod="openshift-marketplace/community-operators-ljct4" Mar 16 16:55:47 crc kubenswrapper[5120]: I0316 16:55:47.562412 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/931f5e13-4fc0-4007-beb8-a617915a97ca-utilities\") pod \"community-operators-ljct4\" (UID: \"931f5e13-4fc0-4007-beb8-a617915a97ca\") " pod="openshift-marketplace/community-operators-ljct4" Mar 16 16:55:47 crc kubenswrapper[5120]: I0316 16:55:47.562700 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/931f5e13-4fc0-4007-beb8-a617915a97ca-catalog-content\") pod \"community-operators-ljct4\" (UID: \"931f5e13-4fc0-4007-beb8-a617915a97ca\") " pod="openshift-marketplace/community-operators-ljct4" Mar 16 16:55:47 crc kubenswrapper[5120]: I0316 16:55:47.563085 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/931f5e13-4fc0-4007-beb8-a617915a97ca-utilities\") pod \"community-operators-ljct4\" (UID: \"931f5e13-4fc0-4007-beb8-a617915a97ca\") " pod="openshift-marketplace/community-operators-ljct4" Mar 16 16:55:47 crc kubenswrapper[5120]: I0316 16:55:47.582134 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8rqf\" (UniqueName: \"kubernetes.io/projected/931f5e13-4fc0-4007-beb8-a617915a97ca-kube-api-access-q8rqf\") pod \"community-operators-ljct4\" (UID: \"931f5e13-4fc0-4007-beb8-a617915a97ca\") " pod="openshift-marketplace/community-operators-ljct4" Mar 16 16:55:47 crc kubenswrapper[5120]: I0316 16:55:47.602363 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-ljct4" Mar 16 16:55:47 crc kubenswrapper[5120]: I0316 16:55:47.864054 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/root-account-create-update-wkxj5"] Mar 16 16:55:47 crc kubenswrapper[5120]: I0316 16:55:47.868869 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/1f6975fd-67a9-4ce2-87b0-7318d7345a80-etc-swift\") pod \"swift-storage-0\" (UID: \"1f6975fd-67a9-4ce2-87b0-7318d7345a80\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:55:47 crc kubenswrapper[5120]: E0316 16:55:47.869199 5120 projected.go:289] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Mar 16 16:55:47 crc kubenswrapper[5120]: E0316 16:55:47.869248 5120 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Mar 16 16:55:47 crc kubenswrapper[5120]: E0316 16:55:47.869304 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1f6975fd-67a9-4ce2-87b0-7318d7345a80-etc-swift podName:1f6975fd-67a9-4ce2-87b0-7318d7345a80 nodeName:}" failed. No retries permitted until 2026-03-16 16:55:51.869288192 +0000 UTC m=+5054.023219849 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/1f6975fd-67a9-4ce2-87b0-7318d7345a80-etc-swift") pod "swift-storage-0" (UID: "1f6975fd-67a9-4ce2-87b0-7318d7345a80") : configmap "swift-ring-files" not found Mar 16 16:55:47 crc kubenswrapper[5120]: I0316 16:55:47.879710 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-wkxj5"] Mar 16 16:55:47 crc kubenswrapper[5120]: I0316 16:55:47.879795 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-wkxj5" Mar 16 16:55:47 crc kubenswrapper[5120]: I0316 16:55:47.882246 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"openstack-mariadb-root-db-secret\"" Mar 16 16:55:47 crc kubenswrapper[5120]: I0316 16:55:47.931953 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-qdvhv"] Mar 16 16:55:47 crc kubenswrapper[5120]: I0316 16:55:47.937507 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-qdvhv" Mar 16 16:55:47 crc kubenswrapper[5120]: I0316 16:55:47.941659 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"swift-proxy-config-data\"" Mar 16 16:55:47 crc kubenswrapper[5120]: I0316 16:55:47.942050 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"swift-ring-config-data\"" Mar 16 16:55:47 crc kubenswrapper[5120]: I0316 16:55:47.944185 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"swift-ring-scripts\"" Mar 16 16:55:47 crc kubenswrapper[5120]: I0316 16:55:47.945299 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-qdvhv"] Mar 16 16:55:47 crc kubenswrapper[5120]: I0316 16:55:47.970689 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5cnkx\" (UniqueName: \"kubernetes.io/projected/3d3b9ffa-3c51-4376-a7b4-d15071491824-kube-api-access-5cnkx\") pod \"root-account-create-update-wkxj5\" (UID: \"3d3b9ffa-3c51-4376-a7b4-d15071491824\") " pod="openstack-kuttl-tests/root-account-create-update-wkxj5" Mar 16 16:55:47 crc kubenswrapper[5120]: I0316 16:55:47.970817 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3d3b9ffa-3c51-4376-a7b4-d15071491824-operator-scripts\") pod \"root-account-create-update-wkxj5\" (UID: \"3d3b9ffa-3c51-4376-a7b4-d15071491824\") " pod="openstack-kuttl-tests/root-account-create-update-wkxj5" Mar 16 16:55:48 crc kubenswrapper[5120]: I0316 16:55:48.064581 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/community-operators-ljct4"] Mar 16 16:55:48 crc kubenswrapper[5120]: I0316 16:55:48.072269 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5cnkx\" (UniqueName: \"kubernetes.io/projected/3d3b9ffa-3c51-4376-a7b4-d15071491824-kube-api-access-5cnkx\") pod \"root-account-create-update-wkxj5\" (UID: \"3d3b9ffa-3c51-4376-a7b4-d15071491824\") " pod="openstack-kuttl-tests/root-account-create-update-wkxj5" Mar 16 16:55:48 crc kubenswrapper[5120]: I0316 16:55:48.072331 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ba4a73ee-a532-452e-bc3f-9126f54017f0-combined-ca-bundle\") pod \"swift-ring-rebalance-qdvhv\" (UID: \"ba4a73ee-a532-452e-bc3f-9126f54017f0\") " pod="openstack-kuttl-tests/swift-ring-rebalance-qdvhv" Mar 16 16:55:48 crc kubenswrapper[5120]: I0316 16:55:48.072400 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/ba4a73ee-a532-452e-bc3f-9126f54017f0-scripts\") pod \"swift-ring-rebalance-qdvhv\" (UID: \"ba4a73ee-a532-452e-bc3f-9126f54017f0\") " pod="openstack-kuttl-tests/swift-ring-rebalance-qdvhv" Mar 16 16:55:48 crc kubenswrapper[5120]: I0316 16:55:48.072515 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3d3b9ffa-3c51-4376-a7b4-d15071491824-operator-scripts\") pod \"root-account-create-update-wkxj5\" (UID: \"3d3b9ffa-3c51-4376-a7b4-d15071491824\") " pod="openstack-kuttl-tests/root-account-create-update-wkxj5" Mar 16 16:55:48 crc kubenswrapper[5120]: I0316 16:55:48.072733 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/ba4a73ee-a532-452e-bc3f-9126f54017f0-etc-swift\") pod \"swift-ring-rebalance-qdvhv\" (UID: \"ba4a73ee-a532-452e-bc3f-9126f54017f0\") " pod="openstack-kuttl-tests/swift-ring-rebalance-qdvhv" Mar 16 16:55:48 crc kubenswrapper[5120]: I0316 16:55:48.072825 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/ba4a73ee-a532-452e-bc3f-9126f54017f0-swiftconf\") pod \"swift-ring-rebalance-qdvhv\" (UID: \"ba4a73ee-a532-452e-bc3f-9126f54017f0\") " pod="openstack-kuttl-tests/swift-ring-rebalance-qdvhv" Mar 16 16:55:48 crc kubenswrapper[5120]: I0316 16:55:48.072872 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/ba4a73ee-a532-452e-bc3f-9126f54017f0-dispersionconf\") pod \"swift-ring-rebalance-qdvhv\" (UID: \"ba4a73ee-a532-452e-bc3f-9126f54017f0\") " pod="openstack-kuttl-tests/swift-ring-rebalance-qdvhv" Mar 16 16:55:48 crc kubenswrapper[5120]: I0316 16:55:48.072914 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/ba4a73ee-a532-452e-bc3f-9126f54017f0-ring-data-devices\") pod \"swift-ring-rebalance-qdvhv\" (UID: \"ba4a73ee-a532-452e-bc3f-9126f54017f0\") " pod="openstack-kuttl-tests/swift-ring-rebalance-qdvhv" Mar 16 16:55:48 crc kubenswrapper[5120]: I0316 16:55:48.073032 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bs2mp\" (UniqueName: \"kubernetes.io/projected/ba4a73ee-a532-452e-bc3f-9126f54017f0-kube-api-access-bs2mp\") pod \"swift-ring-rebalance-qdvhv\" (UID: \"ba4a73ee-a532-452e-bc3f-9126f54017f0\") " pod="openstack-kuttl-tests/swift-ring-rebalance-qdvhv" Mar 16 16:55:48 crc kubenswrapper[5120]: I0316 16:55:48.073263 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3d3b9ffa-3c51-4376-a7b4-d15071491824-operator-scripts\") pod \"root-account-create-update-wkxj5\" (UID: \"3d3b9ffa-3c51-4376-a7b4-d15071491824\") " pod="openstack-kuttl-tests/root-account-create-update-wkxj5" Mar 16 16:55:48 crc kubenswrapper[5120]: I0316 16:55:48.093068 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5cnkx\" (UniqueName: \"kubernetes.io/projected/3d3b9ffa-3c51-4376-a7b4-d15071491824-kube-api-access-5cnkx\") pod \"root-account-create-update-wkxj5\" (UID: \"3d3b9ffa-3c51-4376-a7b4-d15071491824\") " pod="openstack-kuttl-tests/root-account-create-update-wkxj5" Mar 16 16:55:48 crc kubenswrapper[5120]: I0316 16:55:48.175283 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ba4a73ee-a532-452e-bc3f-9126f54017f0-combined-ca-bundle\") pod \"swift-ring-rebalance-qdvhv\" (UID: \"ba4a73ee-a532-452e-bc3f-9126f54017f0\") " pod="openstack-kuttl-tests/swift-ring-rebalance-qdvhv" Mar 16 16:55:48 crc kubenswrapper[5120]: I0316 16:55:48.175400 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/ba4a73ee-a532-452e-bc3f-9126f54017f0-scripts\") pod \"swift-ring-rebalance-qdvhv\" (UID: \"ba4a73ee-a532-452e-bc3f-9126f54017f0\") " pod="openstack-kuttl-tests/swift-ring-rebalance-qdvhv" Mar 16 16:55:48 crc kubenswrapper[5120]: I0316 16:55:48.175531 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/ba4a73ee-a532-452e-bc3f-9126f54017f0-etc-swift\") pod \"swift-ring-rebalance-qdvhv\" (UID: \"ba4a73ee-a532-452e-bc3f-9126f54017f0\") " pod="openstack-kuttl-tests/swift-ring-rebalance-qdvhv" Mar 16 16:55:48 crc kubenswrapper[5120]: I0316 16:55:48.175587 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/ba4a73ee-a532-452e-bc3f-9126f54017f0-swiftconf\") pod \"swift-ring-rebalance-qdvhv\" (UID: \"ba4a73ee-a532-452e-bc3f-9126f54017f0\") " pod="openstack-kuttl-tests/swift-ring-rebalance-qdvhv" Mar 16 16:55:48 crc kubenswrapper[5120]: I0316 16:55:48.175621 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/ba4a73ee-a532-452e-bc3f-9126f54017f0-dispersionconf\") pod \"swift-ring-rebalance-qdvhv\" (UID: \"ba4a73ee-a532-452e-bc3f-9126f54017f0\") " pod="openstack-kuttl-tests/swift-ring-rebalance-qdvhv" Mar 16 16:55:48 crc kubenswrapper[5120]: I0316 16:55:48.175649 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/ba4a73ee-a532-452e-bc3f-9126f54017f0-ring-data-devices\") pod \"swift-ring-rebalance-qdvhv\" (UID: \"ba4a73ee-a532-452e-bc3f-9126f54017f0\") " pod="openstack-kuttl-tests/swift-ring-rebalance-qdvhv" Mar 16 16:55:48 crc kubenswrapper[5120]: I0316 16:55:48.175716 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bs2mp\" (UniqueName: \"kubernetes.io/projected/ba4a73ee-a532-452e-bc3f-9126f54017f0-kube-api-access-bs2mp\") pod \"swift-ring-rebalance-qdvhv\" (UID: \"ba4a73ee-a532-452e-bc3f-9126f54017f0\") " pod="openstack-kuttl-tests/swift-ring-rebalance-qdvhv" Mar 16 16:55:48 crc kubenswrapper[5120]: I0316 16:55:48.176102 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/ba4a73ee-a532-452e-bc3f-9126f54017f0-etc-swift\") pod \"swift-ring-rebalance-qdvhv\" (UID: \"ba4a73ee-a532-452e-bc3f-9126f54017f0\") " pod="openstack-kuttl-tests/swift-ring-rebalance-qdvhv" Mar 16 16:55:48 crc kubenswrapper[5120]: I0316 16:55:48.176193 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/ba4a73ee-a532-452e-bc3f-9126f54017f0-scripts\") pod \"swift-ring-rebalance-qdvhv\" (UID: \"ba4a73ee-a532-452e-bc3f-9126f54017f0\") " pod="openstack-kuttl-tests/swift-ring-rebalance-qdvhv" Mar 16 16:55:48 crc kubenswrapper[5120]: I0316 16:55:48.176451 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/ba4a73ee-a532-452e-bc3f-9126f54017f0-ring-data-devices\") pod \"swift-ring-rebalance-qdvhv\" (UID: \"ba4a73ee-a532-452e-bc3f-9126f54017f0\") " pod="openstack-kuttl-tests/swift-ring-rebalance-qdvhv" Mar 16 16:55:48 crc kubenswrapper[5120]: I0316 16:55:48.179161 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/ba4a73ee-a532-452e-bc3f-9126f54017f0-dispersionconf\") pod \"swift-ring-rebalance-qdvhv\" (UID: \"ba4a73ee-a532-452e-bc3f-9126f54017f0\") " pod="openstack-kuttl-tests/swift-ring-rebalance-qdvhv" Mar 16 16:55:48 crc kubenswrapper[5120]: I0316 16:55:48.179259 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ba4a73ee-a532-452e-bc3f-9126f54017f0-combined-ca-bundle\") pod \"swift-ring-rebalance-qdvhv\" (UID: \"ba4a73ee-a532-452e-bc3f-9126f54017f0\") " pod="openstack-kuttl-tests/swift-ring-rebalance-qdvhv" Mar 16 16:55:48 crc kubenswrapper[5120]: I0316 16:55:48.180074 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/ba4a73ee-a532-452e-bc3f-9126f54017f0-swiftconf\") pod \"swift-ring-rebalance-qdvhv\" (UID: \"ba4a73ee-a532-452e-bc3f-9126f54017f0\") " pod="openstack-kuttl-tests/swift-ring-rebalance-qdvhv" Mar 16 16:55:48 crc kubenswrapper[5120]: I0316 16:55:48.193366 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bs2mp\" (UniqueName: \"kubernetes.io/projected/ba4a73ee-a532-452e-bc3f-9126f54017f0-kube-api-access-bs2mp\") pod \"swift-ring-rebalance-qdvhv\" (UID: \"ba4a73ee-a532-452e-bc3f-9126f54017f0\") " pod="openstack-kuttl-tests/swift-ring-rebalance-qdvhv" Mar 16 16:55:48 crc kubenswrapper[5120]: I0316 16:55:48.206713 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-wkxj5" Mar 16 16:55:48 crc kubenswrapper[5120]: I0316 16:55:48.266207 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-qdvhv" Mar 16 16:55:48 crc kubenswrapper[5120]: I0316 16:55:48.745350 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-wkxj5"] Mar 16 16:55:48 crc kubenswrapper[5120]: I0316 16:55:48.790958 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-qdvhv"] Mar 16 16:55:48 crc kubenswrapper[5120]: W0316 16:55:48.794319 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podba4a73ee_a532_452e_bc3f_9126f54017f0.slice/crio-b756336e6e2d0bb9486150dd68cea8801cc6aac2e8387b2f6ed3177921b275e4 WatchSource:0}: Error finding container b756336e6e2d0bb9486150dd68cea8801cc6aac2e8387b2f6ed3177921b275e4: Status 404 returned error can't find the container with id b756336e6e2d0bb9486150dd68cea8801cc6aac2e8387b2f6ed3177921b275e4 Mar 16 16:55:48 crc kubenswrapper[5120]: I0316 16:55:48.797137 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-db-create-mzrns"] Mar 16 16:55:48 crc kubenswrapper[5120]: I0316 16:55:48.803864 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-create-mzrns" Mar 16 16:55:48 crc kubenswrapper[5120]: I0316 16:55:48.819318 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-db-create-mzrns"] Mar 16 16:55:48 crc kubenswrapper[5120]: I0316 16:55:48.840518 5120 generic.go:358] "Generic (PLEG): container finished" podID="931f5e13-4fc0-4007-beb8-a617915a97ca" containerID="e8aabb5c8b97b74d18728637c12890fb39dcaa418852db12f209fb2aa513f458" exitCode=0 Mar 16 16:55:48 crc kubenswrapper[5120]: I0316 16:55:48.840640 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-ljct4" event={"ID":"931f5e13-4fc0-4007-beb8-a617915a97ca","Type":"ContainerDied","Data":"e8aabb5c8b97b74d18728637c12890fb39dcaa418852db12f209fb2aa513f458"} Mar 16 16:55:48 crc kubenswrapper[5120]: I0316 16:55:48.840670 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-ljct4" event={"ID":"931f5e13-4fc0-4007-beb8-a617915a97ca","Type":"ContainerStarted","Data":"8c3d817ca5d91c6aa5b84e9ee170de4bf54adf094399d2aabff2406bccc56d24"} Mar 16 16:55:48 crc kubenswrapper[5120]: I0316 16:55:48.843353 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-wkxj5" event={"ID":"3d3b9ffa-3c51-4376-a7b4-d15071491824","Type":"ContainerStarted","Data":"724b86b3c4d7b5154958604e47bfc942818a0f957578569f793fb9cee99177ed"} Mar 16 16:55:48 crc kubenswrapper[5120]: I0316 16:55:48.846274 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-qdvhv" event={"ID":"ba4a73ee-a532-452e-bc3f-9126f54017f0","Type":"ContainerStarted","Data":"b756336e6e2d0bb9486150dd68cea8801cc6aac2e8387b2f6ed3177921b275e4"} Mar 16 16:55:48 crc kubenswrapper[5120]: I0316 16:55:48.908368 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-d34e-account-create-update-ptq99"] Mar 16 16:55:48 crc kubenswrapper[5120]: I0316 16:55:48.925781 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-d34e-account-create-update-ptq99"] Mar 16 16:55:48 crc kubenswrapper[5120]: I0316 16:55:48.925908 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-d34e-account-create-update-ptq99" Mar 16 16:55:48 crc kubenswrapper[5120]: I0316 16:55:48.929372 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-db-secret\"" Mar 16 16:55:48 crc kubenswrapper[5120]: I0316 16:55:48.994329 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/bd8e2b8b-c48c-47f7-bd40-fdd658d1cdea-operator-scripts\") pod \"glance-db-create-mzrns\" (UID: \"bd8e2b8b-c48c-47f7-bd40-fdd658d1cdea\") " pod="openstack-kuttl-tests/glance-db-create-mzrns" Mar 16 16:55:48 crc kubenswrapper[5120]: I0316 16:55:48.994388 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hb8z9\" (UniqueName: \"kubernetes.io/projected/bd8e2b8b-c48c-47f7-bd40-fdd658d1cdea-kube-api-access-hb8z9\") pod \"glance-db-create-mzrns\" (UID: \"bd8e2b8b-c48c-47f7-bd40-fdd658d1cdea\") " pod="openstack-kuttl-tests/glance-db-create-mzrns" Mar 16 16:55:49 crc kubenswrapper[5120]: I0316 16:55:49.096272 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/aae566ec-d4cb-4062-a390-c236ce58dd62-operator-scripts\") pod \"glance-d34e-account-create-update-ptq99\" (UID: \"aae566ec-d4cb-4062-a390-c236ce58dd62\") " pod="openstack-kuttl-tests/glance-d34e-account-create-update-ptq99" Mar 16 16:55:49 crc kubenswrapper[5120]: I0316 16:55:49.096787 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/bd8e2b8b-c48c-47f7-bd40-fdd658d1cdea-operator-scripts\") pod \"glance-db-create-mzrns\" (UID: \"bd8e2b8b-c48c-47f7-bd40-fdd658d1cdea\") " pod="openstack-kuttl-tests/glance-db-create-mzrns" Mar 16 16:55:49 crc kubenswrapper[5120]: I0316 16:55:49.096816 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hb8z9\" (UniqueName: \"kubernetes.io/projected/bd8e2b8b-c48c-47f7-bd40-fdd658d1cdea-kube-api-access-hb8z9\") pod \"glance-db-create-mzrns\" (UID: \"bd8e2b8b-c48c-47f7-bd40-fdd658d1cdea\") " pod="openstack-kuttl-tests/glance-db-create-mzrns" Mar 16 16:55:49 crc kubenswrapper[5120]: I0316 16:55:49.096968 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jw89\" (UniqueName: \"kubernetes.io/projected/aae566ec-d4cb-4062-a390-c236ce58dd62-kube-api-access-2jw89\") pod \"glance-d34e-account-create-update-ptq99\" (UID: \"aae566ec-d4cb-4062-a390-c236ce58dd62\") " pod="openstack-kuttl-tests/glance-d34e-account-create-update-ptq99" Mar 16 16:55:49 crc kubenswrapper[5120]: I0316 16:55:49.097834 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/bd8e2b8b-c48c-47f7-bd40-fdd658d1cdea-operator-scripts\") pod \"glance-db-create-mzrns\" (UID: \"bd8e2b8b-c48c-47f7-bd40-fdd658d1cdea\") " pod="openstack-kuttl-tests/glance-db-create-mzrns" Mar 16 16:55:49 crc kubenswrapper[5120]: I0316 16:55:49.114473 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hb8z9\" (UniqueName: \"kubernetes.io/projected/bd8e2b8b-c48c-47f7-bd40-fdd658d1cdea-kube-api-access-hb8z9\") pod \"glance-db-create-mzrns\" (UID: \"bd8e2b8b-c48c-47f7-bd40-fdd658d1cdea\") " pod="openstack-kuttl-tests/glance-db-create-mzrns" Mar 16 16:55:49 crc kubenswrapper[5120]: I0316 16:55:49.198276 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/aae566ec-d4cb-4062-a390-c236ce58dd62-operator-scripts\") pod \"glance-d34e-account-create-update-ptq99\" (UID: \"aae566ec-d4cb-4062-a390-c236ce58dd62\") " pod="openstack-kuttl-tests/glance-d34e-account-create-update-ptq99" Mar 16 16:55:49 crc kubenswrapper[5120]: I0316 16:55:49.198479 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2jw89\" (UniqueName: \"kubernetes.io/projected/aae566ec-d4cb-4062-a390-c236ce58dd62-kube-api-access-2jw89\") pod \"glance-d34e-account-create-update-ptq99\" (UID: \"aae566ec-d4cb-4062-a390-c236ce58dd62\") " pod="openstack-kuttl-tests/glance-d34e-account-create-update-ptq99" Mar 16 16:55:49 crc kubenswrapper[5120]: I0316 16:55:49.199021 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/aae566ec-d4cb-4062-a390-c236ce58dd62-operator-scripts\") pod \"glance-d34e-account-create-update-ptq99\" (UID: \"aae566ec-d4cb-4062-a390-c236ce58dd62\") " pod="openstack-kuttl-tests/glance-d34e-account-create-update-ptq99" Mar 16 16:55:49 crc kubenswrapper[5120]: I0316 16:55:49.218534 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jw89\" (UniqueName: \"kubernetes.io/projected/aae566ec-d4cb-4062-a390-c236ce58dd62-kube-api-access-2jw89\") pod \"glance-d34e-account-create-update-ptq99\" (UID: \"aae566ec-d4cb-4062-a390-c236ce58dd62\") " pod="openstack-kuttl-tests/glance-d34e-account-create-update-ptq99" Mar 16 16:55:49 crc kubenswrapper[5120]: I0316 16:55:49.222191 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-create-mzrns" Mar 16 16:55:49 crc kubenswrapper[5120]: I0316 16:55:49.244650 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-d34e-account-create-update-ptq99" Mar 16 16:55:49 crc kubenswrapper[5120]: I0316 16:55:49.730962 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-db-create-mzrns"] Mar 16 16:55:49 crc kubenswrapper[5120]: I0316 16:55:49.815499 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-d34e-account-create-update-ptq99"] Mar 16 16:55:49 crc kubenswrapper[5120]: I0316 16:55:49.918231 5120 generic.go:358] "Generic (PLEG): container finished" podID="3d3b9ffa-3c51-4376-a7b4-d15071491824" containerID="da4e14c0ef027b329c77ef62b6ff40907a0fbb23df124dacb6638f85fd17bb1e" exitCode=0 Mar 16 16:55:49 crc kubenswrapper[5120]: I0316 16:55:49.918494 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-wkxj5" event={"ID":"3d3b9ffa-3c51-4376-a7b4-d15071491824","Type":"ContainerDied","Data":"da4e14c0ef027b329c77ef62b6ff40907a0fbb23df124dacb6638f85fd17bb1e"} Mar 16 16:55:49 crc kubenswrapper[5120]: I0316 16:55:49.941523 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-d34e-account-create-update-ptq99" event={"ID":"aae566ec-d4cb-4062-a390-c236ce58dd62","Type":"ContainerStarted","Data":"66309f62d757109a4da8df785011f5572ae370806ca0087ddd9c3f4efb3796b2"} Mar 16 16:55:49 crc kubenswrapper[5120]: I0316 16:55:49.978080 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-create-mzrns" event={"ID":"bd8e2b8b-c48c-47f7-bd40-fdd658d1cdea","Type":"ContainerStarted","Data":"ddb7b252a8a8abb40d04cbdaee101d95eabeb16d8e249c4790b8a9d1964b41a5"} Mar 16 16:55:49 crc kubenswrapper[5120]: I0316 16:55:49.994602 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-qdvhv" event={"ID":"ba4a73ee-a532-452e-bc3f-9126f54017f0","Type":"ContainerStarted","Data":"d47416d19c007d5e7463c5d7c2361ba15d54663b2f0d53a6f0405c998c85ed69"} Mar 16 16:55:50 crc kubenswrapper[5120]: I0316 16:55:50.023512 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/swift-ring-rebalance-qdvhv" podStartSLOduration=3.023487293 podStartE2EDuration="3.023487293s" podCreationTimestamp="2026-03-16 16:55:47 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:55:50.013348756 +0000 UTC m=+5052.167280423" watchObservedRunningTime="2026-03-16 16:55:50.023487293 +0000 UTC m=+5052.177418950" Mar 16 16:55:50 crc kubenswrapper[5120]: E0316 16:55:50.450707 5120 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaae566ec_d4cb_4062_a390_c236ce58dd62.slice/crio-conmon-f82629f3f06f61f322716632ababb5b1f77b592bcd127329124905e46f3cd013.scope\": RecentStats: unable to find data in memory cache]" Mar 16 16:55:51 crc kubenswrapper[5120]: I0316 16:55:51.007614 5120 generic.go:358] "Generic (PLEG): container finished" podID="aae566ec-d4cb-4062-a390-c236ce58dd62" containerID="f82629f3f06f61f322716632ababb5b1f77b592bcd127329124905e46f3cd013" exitCode=0 Mar 16 16:55:51 crc kubenswrapper[5120]: I0316 16:55:51.008228 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-d34e-account-create-update-ptq99" event={"ID":"aae566ec-d4cb-4062-a390-c236ce58dd62","Type":"ContainerDied","Data":"f82629f3f06f61f322716632ababb5b1f77b592bcd127329124905e46f3cd013"} Mar 16 16:55:51 crc kubenswrapper[5120]: I0316 16:55:51.023880 5120 generic.go:358] "Generic (PLEG): container finished" podID="bd8e2b8b-c48c-47f7-bd40-fdd658d1cdea" containerID="c2b21dd36b7e60c7557d1e47d96a5e15f4ffc92ec5cf76f7d08cce5248e92878" exitCode=0 Mar 16 16:55:51 crc kubenswrapper[5120]: I0316 16:55:51.023975 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-create-mzrns" event={"ID":"bd8e2b8b-c48c-47f7-bd40-fdd658d1cdea","Type":"ContainerDied","Data":"c2b21dd36b7e60c7557d1e47d96a5e15f4ffc92ec5cf76f7d08cce5248e92878"} Mar 16 16:55:51 crc kubenswrapper[5120]: I0316 16:55:51.373864 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-wkxj5" Mar 16 16:55:51 crc kubenswrapper[5120]: I0316 16:55:51.461737 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5cnkx\" (UniqueName: \"kubernetes.io/projected/3d3b9ffa-3c51-4376-a7b4-d15071491824-kube-api-access-5cnkx\") pod \"3d3b9ffa-3c51-4376-a7b4-d15071491824\" (UID: \"3d3b9ffa-3c51-4376-a7b4-d15071491824\") " Mar 16 16:55:51 crc kubenswrapper[5120]: I0316 16:55:51.461915 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3d3b9ffa-3c51-4376-a7b4-d15071491824-operator-scripts\") pod \"3d3b9ffa-3c51-4376-a7b4-d15071491824\" (UID: \"3d3b9ffa-3c51-4376-a7b4-d15071491824\") " Mar 16 16:55:51 crc kubenswrapper[5120]: I0316 16:55:51.462457 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d3b9ffa-3c51-4376-a7b4-d15071491824-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "3d3b9ffa-3c51-4376-a7b4-d15071491824" (UID: "3d3b9ffa-3c51-4376-a7b4-d15071491824"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:55:51 crc kubenswrapper[5120]: I0316 16:55:51.463260 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3d3b9ffa-3c51-4376-a7b4-d15071491824-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:55:51 crc kubenswrapper[5120]: I0316 16:55:51.467752 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d3b9ffa-3c51-4376-a7b4-d15071491824-kube-api-access-5cnkx" (OuterVolumeSpecName: "kube-api-access-5cnkx") pod "3d3b9ffa-3c51-4376-a7b4-d15071491824" (UID: "3d3b9ffa-3c51-4376-a7b4-d15071491824"). InnerVolumeSpecName "kube-api-access-5cnkx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:55:51 crc kubenswrapper[5120]: I0316 16:55:51.565432 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5cnkx\" (UniqueName: \"kubernetes.io/projected/3d3b9ffa-3c51-4376-a7b4-d15071491824-kube-api-access-5cnkx\") on node \"crc\" DevicePath \"\"" Mar 16 16:55:51 crc kubenswrapper[5120]: I0316 16:55:51.872412 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/1f6975fd-67a9-4ce2-87b0-7318d7345a80-etc-swift\") pod \"swift-storage-0\" (UID: \"1f6975fd-67a9-4ce2-87b0-7318d7345a80\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:55:51 crc kubenswrapper[5120]: E0316 16:55:51.872638 5120 projected.go:289] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Mar 16 16:55:51 crc kubenswrapper[5120]: E0316 16:55:51.872936 5120 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Mar 16 16:55:51 crc kubenswrapper[5120]: E0316 16:55:51.873013 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1f6975fd-67a9-4ce2-87b0-7318d7345a80-etc-swift podName:1f6975fd-67a9-4ce2-87b0-7318d7345a80 nodeName:}" failed. No retries permitted until 2026-03-16 16:55:59.872992306 +0000 UTC m=+5062.026923963 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/1f6975fd-67a9-4ce2-87b0-7318d7345a80-etc-swift") pod "swift-storage-0" (UID: "1f6975fd-67a9-4ce2-87b0-7318d7345a80") : configmap "swift-ring-files" not found Mar 16 16:55:52 crc kubenswrapper[5120]: I0316 16:55:52.036497 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-wkxj5" Mar 16 16:55:52 crc kubenswrapper[5120]: I0316 16:55:52.036543 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-wkxj5" event={"ID":"3d3b9ffa-3c51-4376-a7b4-d15071491824","Type":"ContainerDied","Data":"724b86b3c4d7b5154958604e47bfc942818a0f957578569f793fb9cee99177ed"} Mar 16 16:55:52 crc kubenswrapper[5120]: I0316 16:55:52.036578 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="724b86b3c4d7b5154958604e47bfc942818a0f957578569f793fb9cee99177ed" Mar 16 16:55:53 crc kubenswrapper[5120]: I0316 16:55:53.211273 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-d34e-account-create-update-ptq99" Mar 16 16:55:53 crc kubenswrapper[5120]: I0316 16:55:53.220895 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-create-mzrns" Mar 16 16:55:53 crc kubenswrapper[5120]: I0316 16:55:53.306220 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hb8z9\" (UniqueName: \"kubernetes.io/projected/bd8e2b8b-c48c-47f7-bd40-fdd658d1cdea-kube-api-access-hb8z9\") pod \"bd8e2b8b-c48c-47f7-bd40-fdd658d1cdea\" (UID: \"bd8e2b8b-c48c-47f7-bd40-fdd658d1cdea\") " Mar 16 16:55:53 crc kubenswrapper[5120]: I0316 16:55:53.306262 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/bd8e2b8b-c48c-47f7-bd40-fdd658d1cdea-operator-scripts\") pod \"bd8e2b8b-c48c-47f7-bd40-fdd658d1cdea\" (UID: \"bd8e2b8b-c48c-47f7-bd40-fdd658d1cdea\") " Mar 16 16:55:53 crc kubenswrapper[5120]: I0316 16:55:53.306300 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2jw89\" (UniqueName: \"kubernetes.io/projected/aae566ec-d4cb-4062-a390-c236ce58dd62-kube-api-access-2jw89\") pod \"aae566ec-d4cb-4062-a390-c236ce58dd62\" (UID: \"aae566ec-d4cb-4062-a390-c236ce58dd62\") " Mar 16 16:55:53 crc kubenswrapper[5120]: I0316 16:55:53.306366 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/aae566ec-d4cb-4062-a390-c236ce58dd62-operator-scripts\") pod \"aae566ec-d4cb-4062-a390-c236ce58dd62\" (UID: \"aae566ec-d4cb-4062-a390-c236ce58dd62\") " Mar 16 16:55:53 crc kubenswrapper[5120]: I0316 16:55:53.307947 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aae566ec-d4cb-4062-a390-c236ce58dd62-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "aae566ec-d4cb-4062-a390-c236ce58dd62" (UID: "aae566ec-d4cb-4062-a390-c236ce58dd62"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:55:53 crc kubenswrapper[5120]: I0316 16:55:53.308744 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd8e2b8b-c48c-47f7-bd40-fdd658d1cdea-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "bd8e2b8b-c48c-47f7-bd40-fdd658d1cdea" (UID: "bd8e2b8b-c48c-47f7-bd40-fdd658d1cdea"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:55:53 crc kubenswrapper[5120]: I0316 16:55:53.313415 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aae566ec-d4cb-4062-a390-c236ce58dd62-kube-api-access-2jw89" (OuterVolumeSpecName: "kube-api-access-2jw89") pod "aae566ec-d4cb-4062-a390-c236ce58dd62" (UID: "aae566ec-d4cb-4062-a390-c236ce58dd62"). InnerVolumeSpecName "kube-api-access-2jw89". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:55:53 crc kubenswrapper[5120]: I0316 16:55:53.313493 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd8e2b8b-c48c-47f7-bd40-fdd658d1cdea-kube-api-access-hb8z9" (OuterVolumeSpecName: "kube-api-access-hb8z9") pod "bd8e2b8b-c48c-47f7-bd40-fdd658d1cdea" (UID: "bd8e2b8b-c48c-47f7-bd40-fdd658d1cdea"). InnerVolumeSpecName "kube-api-access-hb8z9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:55:53 crc kubenswrapper[5120]: I0316 16:55:53.409741 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hb8z9\" (UniqueName: \"kubernetes.io/projected/bd8e2b8b-c48c-47f7-bd40-fdd658d1cdea-kube-api-access-hb8z9\") on node \"crc\" DevicePath \"\"" Mar 16 16:55:53 crc kubenswrapper[5120]: I0316 16:55:53.409787 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/bd8e2b8b-c48c-47f7-bd40-fdd658d1cdea-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:55:53 crc kubenswrapper[5120]: I0316 16:55:53.409797 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2jw89\" (UniqueName: \"kubernetes.io/projected/aae566ec-d4cb-4062-a390-c236ce58dd62-kube-api-access-2jw89\") on node \"crc\" DevicePath \"\"" Mar 16 16:55:53 crc kubenswrapper[5120]: I0316 16:55:53.409805 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/aae566ec-d4cb-4062-a390-c236ce58dd62-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:55:53 crc kubenswrapper[5120]: I0316 16:55:53.664867 5120 scope.go:117] "RemoveContainer" containerID="083f72646c8d47c9c0467b39be99ddfa9c2e5900ae0a29ad53d7b39b950274b4" Mar 16 16:55:53 crc kubenswrapper[5120]: E0316 16:55:53.665618 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:55:54 crc kubenswrapper[5120]: I0316 16:55:54.055825 5120 generic.go:358] "Generic (PLEG): container finished" podID="931f5e13-4fc0-4007-beb8-a617915a97ca" containerID="6add4d3ba52c8a84338b74597755b0b39724d4d67a8f87712695315ac4ca9789" exitCode=0 Mar 16 16:55:54 crc kubenswrapper[5120]: I0316 16:55:54.055939 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-ljct4" event={"ID":"931f5e13-4fc0-4007-beb8-a617915a97ca","Type":"ContainerDied","Data":"6add4d3ba52c8a84338b74597755b0b39724d4d67a8f87712695315ac4ca9789"} Mar 16 16:55:54 crc kubenswrapper[5120]: I0316 16:55:54.058846 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-d34e-account-create-update-ptq99" Mar 16 16:55:54 crc kubenswrapper[5120]: I0316 16:55:54.059130 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-d34e-account-create-update-ptq99" event={"ID":"aae566ec-d4cb-4062-a390-c236ce58dd62","Type":"ContainerDied","Data":"66309f62d757109a4da8df785011f5572ae370806ca0087ddd9c3f4efb3796b2"} Mar 16 16:55:54 crc kubenswrapper[5120]: I0316 16:55:54.059189 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="66309f62d757109a4da8df785011f5572ae370806ca0087ddd9c3f4efb3796b2" Mar 16 16:55:54 crc kubenswrapper[5120]: I0316 16:55:54.061714 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-create-mzrns" Mar 16 16:55:54 crc kubenswrapper[5120]: I0316 16:55:54.061818 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-create-mzrns" event={"ID":"bd8e2b8b-c48c-47f7-bd40-fdd658d1cdea","Type":"ContainerDied","Data":"ddb7b252a8a8abb40d04cbdaee101d95eabeb16d8e249c4790b8a9d1964b41a5"} Mar 16 16:55:54 crc kubenswrapper[5120]: I0316 16:55:54.061918 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ddb7b252a8a8abb40d04cbdaee101d95eabeb16d8e249c4790b8a9d1964b41a5" Mar 16 16:55:54 crc kubenswrapper[5120]: I0316 16:55:54.253200 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-wkxj5"] Mar 16 16:55:54 crc kubenswrapper[5120]: I0316 16:55:54.264188 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-wkxj5"] Mar 16 16:55:54 crc kubenswrapper[5120]: I0316 16:55:54.675549 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d3b9ffa-3c51-4376-a7b4-d15071491824" path="/var/lib/kubelet/pods/3d3b9ffa-3c51-4376-a7b4-d15071491824/volumes" Mar 16 16:55:55 crc kubenswrapper[5120]: I0316 16:55:55.073023 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-ljct4" event={"ID":"931f5e13-4fc0-4007-beb8-a617915a97ca","Type":"ContainerStarted","Data":"ac30de68f92dd569bb2d25c316213e1cf911869e277f1fb98d930eafecdba86d"} Mar 16 16:55:56 crc kubenswrapper[5120]: I0316 16:55:56.085689 5120 generic.go:358] "Generic (PLEG): container finished" podID="ba4a73ee-a532-452e-bc3f-9126f54017f0" containerID="d47416d19c007d5e7463c5d7c2361ba15d54663b2f0d53a6f0405c998c85ed69" exitCode=0 Mar 16 16:55:56 crc kubenswrapper[5120]: I0316 16:55:56.086198 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-qdvhv" event={"ID":"ba4a73ee-a532-452e-bc3f-9126f54017f0","Type":"ContainerDied","Data":"d47416d19c007d5e7463c5d7c2361ba15d54663b2f0d53a6f0405c998c85ed69"} Mar 16 16:55:56 crc kubenswrapper[5120]: I0316 16:55:56.108027 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/community-operators-ljct4" podStartSLOduration=4.757536986 podStartE2EDuration="9.108004371s" podCreationTimestamp="2026-03-16 16:55:47 +0000 UTC" firstStartedPulling="2026-03-16 16:55:48.841700677 +0000 UTC m=+5050.995632334" lastFinishedPulling="2026-03-16 16:55:53.192168062 +0000 UTC m=+5055.346099719" observedRunningTime="2026-03-16 16:55:55.094944213 +0000 UTC m=+5057.248875870" watchObservedRunningTime="2026-03-16 16:55:56.108004371 +0000 UTC m=+5058.261936028" Mar 16 16:55:57 crc kubenswrapper[5120]: I0316 16:55:57.471994 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-qdvhv" Mar 16 16:55:57 crc kubenswrapper[5120]: I0316 16:55:57.599888 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/ba4a73ee-a532-452e-bc3f-9126f54017f0-dispersionconf\") pod \"ba4a73ee-a532-452e-bc3f-9126f54017f0\" (UID: \"ba4a73ee-a532-452e-bc3f-9126f54017f0\") " Mar 16 16:55:57 crc kubenswrapper[5120]: I0316 16:55:57.600277 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/ba4a73ee-a532-452e-bc3f-9126f54017f0-swiftconf\") pod \"ba4a73ee-a532-452e-bc3f-9126f54017f0\" (UID: \"ba4a73ee-a532-452e-bc3f-9126f54017f0\") " Mar 16 16:55:57 crc kubenswrapper[5120]: I0316 16:55:57.600327 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/ba4a73ee-a532-452e-bc3f-9126f54017f0-etc-swift\") pod \"ba4a73ee-a532-452e-bc3f-9126f54017f0\" (UID: \"ba4a73ee-a532-452e-bc3f-9126f54017f0\") " Mar 16 16:55:57 crc kubenswrapper[5120]: I0316 16:55:57.600546 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ba4a73ee-a532-452e-bc3f-9126f54017f0-combined-ca-bundle\") pod \"ba4a73ee-a532-452e-bc3f-9126f54017f0\" (UID: \"ba4a73ee-a532-452e-bc3f-9126f54017f0\") " Mar 16 16:55:57 crc kubenswrapper[5120]: I0316 16:55:57.600612 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/ba4a73ee-a532-452e-bc3f-9126f54017f0-scripts\") pod \"ba4a73ee-a532-452e-bc3f-9126f54017f0\" (UID: \"ba4a73ee-a532-452e-bc3f-9126f54017f0\") " Mar 16 16:55:57 crc kubenswrapper[5120]: I0316 16:55:57.600773 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/ba4a73ee-a532-452e-bc3f-9126f54017f0-ring-data-devices\") pod \"ba4a73ee-a532-452e-bc3f-9126f54017f0\" (UID: \"ba4a73ee-a532-452e-bc3f-9126f54017f0\") " Mar 16 16:55:57 crc kubenswrapper[5120]: I0316 16:55:57.600808 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bs2mp\" (UniqueName: \"kubernetes.io/projected/ba4a73ee-a532-452e-bc3f-9126f54017f0-kube-api-access-bs2mp\") pod \"ba4a73ee-a532-452e-bc3f-9126f54017f0\" (UID: \"ba4a73ee-a532-452e-bc3f-9126f54017f0\") " Mar 16 16:55:57 crc kubenswrapper[5120]: I0316 16:55:57.601464 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba4a73ee-a532-452e-bc3f-9126f54017f0-ring-data-devices" (OuterVolumeSpecName: "ring-data-devices") pod "ba4a73ee-a532-452e-bc3f-9126f54017f0" (UID: "ba4a73ee-a532-452e-bc3f-9126f54017f0"). InnerVolumeSpecName "ring-data-devices". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:55:57 crc kubenswrapper[5120]: I0316 16:55:57.601715 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba4a73ee-a532-452e-bc3f-9126f54017f0-etc-swift" (OuterVolumeSpecName: "etc-swift") pod "ba4a73ee-a532-452e-bc3f-9126f54017f0" (UID: "ba4a73ee-a532-452e-bc3f-9126f54017f0"). InnerVolumeSpecName "etc-swift". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:55:57 crc kubenswrapper[5120]: I0316 16:55:57.602545 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-marketplace/community-operators-ljct4" Mar 16 16:55:57 crc kubenswrapper[5120]: I0316 16:55:57.602723 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/community-operators-ljct4" Mar 16 16:55:57 crc kubenswrapper[5120]: I0316 16:55:57.605578 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba4a73ee-a532-452e-bc3f-9126f54017f0-kube-api-access-bs2mp" (OuterVolumeSpecName: "kube-api-access-bs2mp") pod "ba4a73ee-a532-452e-bc3f-9126f54017f0" (UID: "ba4a73ee-a532-452e-bc3f-9126f54017f0"). InnerVolumeSpecName "kube-api-access-bs2mp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:55:57 crc kubenswrapper[5120]: I0316 16:55:57.608509 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba4a73ee-a532-452e-bc3f-9126f54017f0-dispersionconf" (OuterVolumeSpecName: "dispersionconf") pod "ba4a73ee-a532-452e-bc3f-9126f54017f0" (UID: "ba4a73ee-a532-452e-bc3f-9126f54017f0"). InnerVolumeSpecName "dispersionconf". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:55:57 crc kubenswrapper[5120]: I0316 16:55:57.620392 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba4a73ee-a532-452e-bc3f-9126f54017f0-scripts" (OuterVolumeSpecName: "scripts") pod "ba4a73ee-a532-452e-bc3f-9126f54017f0" (UID: "ba4a73ee-a532-452e-bc3f-9126f54017f0"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:55:57 crc kubenswrapper[5120]: I0316 16:55:57.623111 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba4a73ee-a532-452e-bc3f-9126f54017f0-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ba4a73ee-a532-452e-bc3f-9126f54017f0" (UID: "ba4a73ee-a532-452e-bc3f-9126f54017f0"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:55:57 crc kubenswrapper[5120]: I0316 16:55:57.633919 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba4a73ee-a532-452e-bc3f-9126f54017f0-swiftconf" (OuterVolumeSpecName: "swiftconf") pod "ba4a73ee-a532-452e-bc3f-9126f54017f0" (UID: "ba4a73ee-a532-452e-bc3f-9126f54017f0"). InnerVolumeSpecName "swiftconf". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:55:57 crc kubenswrapper[5120]: I0316 16:55:57.643676 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/community-operators-ljct4" Mar 16 16:55:57 crc kubenswrapper[5120]: I0316 16:55:57.702941 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ba4a73ee-a532-452e-bc3f-9126f54017f0-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:55:57 crc kubenswrapper[5120]: I0316 16:55:57.702967 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/ba4a73ee-a532-452e-bc3f-9126f54017f0-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:55:57 crc kubenswrapper[5120]: I0316 16:55:57.702978 5120 reconciler_common.go:299] "Volume detached for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/ba4a73ee-a532-452e-bc3f-9126f54017f0-ring-data-devices\") on node \"crc\" DevicePath \"\"" Mar 16 16:55:57 crc kubenswrapper[5120]: I0316 16:55:57.702991 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bs2mp\" (UniqueName: \"kubernetes.io/projected/ba4a73ee-a532-452e-bc3f-9126f54017f0-kube-api-access-bs2mp\") on node \"crc\" DevicePath \"\"" Mar 16 16:55:57 crc kubenswrapper[5120]: I0316 16:55:57.702999 5120 reconciler_common.go:299] "Volume detached for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/ba4a73ee-a532-452e-bc3f-9126f54017f0-dispersionconf\") on node \"crc\" DevicePath \"\"" Mar 16 16:55:57 crc kubenswrapper[5120]: I0316 16:55:57.703015 5120 reconciler_common.go:299] "Volume detached for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/ba4a73ee-a532-452e-bc3f-9126f54017f0-swiftconf\") on node \"crc\" DevicePath \"\"" Mar 16 16:55:57 crc kubenswrapper[5120]: I0316 16:55:57.703023 5120 reconciler_common.go:299] "Volume detached for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/ba4a73ee-a532-452e-bc3f-9126f54017f0-etc-swift\") on node \"crc\" DevicePath \"\"" Mar 16 16:55:57 crc kubenswrapper[5120]: I0316 16:55:57.877752 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 16:55:58 crc kubenswrapper[5120]: I0316 16:55:58.110252 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-qdvhv" Mar 16 16:55:58 crc kubenswrapper[5120]: I0316 16:55:58.110297 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-qdvhv" event={"ID":"ba4a73ee-a532-452e-bc3f-9126f54017f0","Type":"ContainerDied","Data":"b756336e6e2d0bb9486150dd68cea8801cc6aac2e8387b2f6ed3177921b275e4"} Mar 16 16:55:58 crc kubenswrapper[5120]: I0316 16:55:58.110338 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b756336e6e2d0bb9486150dd68cea8801cc6aac2e8387b2f6ed3177921b275e4" Mar 16 16:55:59 crc kubenswrapper[5120]: I0316 16:55:59.064818 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-db-sync-hm7fn"] Mar 16 16:55:59 crc kubenswrapper[5120]: I0316 16:55:59.066344 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d3b9ffa-3c51-4376-a7b4-d15071491824" containerName="mariadb-account-create-update" Mar 16 16:55:59 crc kubenswrapper[5120]: I0316 16:55:59.066367 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d3b9ffa-3c51-4376-a7b4-d15071491824" containerName="mariadb-account-create-update" Mar 16 16:55:59 crc kubenswrapper[5120]: I0316 16:55:59.066423 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba4a73ee-a532-452e-bc3f-9126f54017f0" containerName="swift-ring-rebalance" Mar 16 16:55:59 crc kubenswrapper[5120]: I0316 16:55:59.066429 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba4a73ee-a532-452e-bc3f-9126f54017f0" containerName="swift-ring-rebalance" Mar 16 16:55:59 crc kubenswrapper[5120]: I0316 16:55:59.066461 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aae566ec-d4cb-4062-a390-c236ce58dd62" containerName="mariadb-account-create-update" Mar 16 16:55:59 crc kubenswrapper[5120]: I0316 16:55:59.066468 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="aae566ec-d4cb-4062-a390-c236ce58dd62" containerName="mariadb-account-create-update" Mar 16 16:55:59 crc kubenswrapper[5120]: I0316 16:55:59.066516 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd8e2b8b-c48c-47f7-bd40-fdd658d1cdea" containerName="mariadb-database-create" Mar 16 16:55:59 crc kubenswrapper[5120]: I0316 16:55:59.066523 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd8e2b8b-c48c-47f7-bd40-fdd658d1cdea" containerName="mariadb-database-create" Mar 16 16:55:59 crc kubenswrapper[5120]: I0316 16:55:59.066960 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="bd8e2b8b-c48c-47f7-bd40-fdd658d1cdea" containerName="mariadb-database-create" Mar 16 16:55:59 crc kubenswrapper[5120]: I0316 16:55:59.066983 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="aae566ec-d4cb-4062-a390-c236ce58dd62" containerName="mariadb-account-create-update" Mar 16 16:55:59 crc kubenswrapper[5120]: I0316 16:55:59.066993 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="3d3b9ffa-3c51-4376-a7b4-d15071491824" containerName="mariadb-account-create-update" Mar 16 16:55:59 crc kubenswrapper[5120]: I0316 16:55:59.067017 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ba4a73ee-a532-452e-bc3f-9126f54017f0" containerName="swift-ring-rebalance" Mar 16 16:55:59 crc kubenswrapper[5120]: I0316 16:55:59.141470 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-hm7fn"] Mar 16 16:55:59 crc kubenswrapper[5120]: I0316 16:55:59.141729 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-hm7fn" Mar 16 16:55:59 crc kubenswrapper[5120]: I0316 16:55:59.143612 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-glance-dockercfg-tgms4\"" Mar 16 16:55:59 crc kubenswrapper[5120]: I0316 16:55:59.146841 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-config-data\"" Mar 16 16:55:59 crc kubenswrapper[5120]: I0316 16:55:59.184189 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/community-operators-ljct4" Mar 16 16:55:59 crc kubenswrapper[5120]: I0316 16:55:59.237113 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8ab6544e-3675-4473-8f87-b60b7a3783ca-combined-ca-bundle\") pod \"glance-db-sync-hm7fn\" (UID: \"8ab6544e-3675-4473-8f87-b60b7a3783ca\") " pod="openstack-kuttl-tests/glance-db-sync-hm7fn" Mar 16 16:55:59 crc kubenswrapper[5120]: I0316 16:55:59.237235 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6stz\" (UniqueName: \"kubernetes.io/projected/8ab6544e-3675-4473-8f87-b60b7a3783ca-kube-api-access-g6stz\") pod \"glance-db-sync-hm7fn\" (UID: \"8ab6544e-3675-4473-8f87-b60b7a3783ca\") " pod="openstack-kuttl-tests/glance-db-sync-hm7fn" Mar 16 16:55:59 crc kubenswrapper[5120]: I0316 16:55:59.237445 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8ab6544e-3675-4473-8f87-b60b7a3783ca-config-data\") pod \"glance-db-sync-hm7fn\" (UID: \"8ab6544e-3675-4473-8f87-b60b7a3783ca\") " pod="openstack-kuttl-tests/glance-db-sync-hm7fn" Mar 16 16:55:59 crc kubenswrapper[5120]: I0316 16:55:59.237502 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/8ab6544e-3675-4473-8f87-b60b7a3783ca-db-sync-config-data\") pod \"glance-db-sync-hm7fn\" (UID: \"8ab6544e-3675-4473-8f87-b60b7a3783ca\") " pod="openstack-kuttl-tests/glance-db-sync-hm7fn" Mar 16 16:55:59 crc kubenswrapper[5120]: I0316 16:55:59.246709 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/community-operators-ljct4"] Mar 16 16:55:59 crc kubenswrapper[5120]: I0316 16:55:59.283246 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/community-operators-dvmlk"] Mar 16 16:55:59 crc kubenswrapper[5120]: I0316 16:55:59.283604 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-marketplace/community-operators-dvmlk" podUID="6361fbfb-238f-4535-8dd1-ddd18fd99309" containerName="registry-server" containerID="cri-o://2be04411104f1b6505b440d62d7d25aac319db5302fead2c25f351e832ca4b2f" gracePeriod=2 Mar 16 16:55:59 crc kubenswrapper[5120]: I0316 16:55:59.328930 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/root-account-create-update-psx4m"] Mar 16 16:55:59 crc kubenswrapper[5120]: I0316 16:55:59.339195 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8ab6544e-3675-4473-8f87-b60b7a3783ca-config-data\") pod \"glance-db-sync-hm7fn\" (UID: \"8ab6544e-3675-4473-8f87-b60b7a3783ca\") " pod="openstack-kuttl-tests/glance-db-sync-hm7fn" Mar 16 16:55:59 crc kubenswrapper[5120]: I0316 16:55:59.339548 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/8ab6544e-3675-4473-8f87-b60b7a3783ca-db-sync-config-data\") pod \"glance-db-sync-hm7fn\" (UID: \"8ab6544e-3675-4473-8f87-b60b7a3783ca\") " pod="openstack-kuttl-tests/glance-db-sync-hm7fn" Mar 16 16:55:59 crc kubenswrapper[5120]: I0316 16:55:59.339781 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8ab6544e-3675-4473-8f87-b60b7a3783ca-combined-ca-bundle\") pod \"glance-db-sync-hm7fn\" (UID: \"8ab6544e-3675-4473-8f87-b60b7a3783ca\") " pod="openstack-kuttl-tests/glance-db-sync-hm7fn" Mar 16 16:55:59 crc kubenswrapper[5120]: I0316 16:55:59.339981 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g6stz\" (UniqueName: \"kubernetes.io/projected/8ab6544e-3675-4473-8f87-b60b7a3783ca-kube-api-access-g6stz\") pod \"glance-db-sync-hm7fn\" (UID: \"8ab6544e-3675-4473-8f87-b60b7a3783ca\") " pod="openstack-kuttl-tests/glance-db-sync-hm7fn" Mar 16 16:55:59 crc kubenswrapper[5120]: I0316 16:55:59.340317 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-psx4m"] Mar 16 16:55:59 crc kubenswrapper[5120]: I0316 16:55:59.340455 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-psx4m" Mar 16 16:55:59 crc kubenswrapper[5120]: I0316 16:55:59.348218 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"openstack-cell1-mariadb-root-db-secret\"" Mar 16 16:55:59 crc kubenswrapper[5120]: I0316 16:55:59.351118 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/8ab6544e-3675-4473-8f87-b60b7a3783ca-db-sync-config-data\") pod \"glance-db-sync-hm7fn\" (UID: \"8ab6544e-3675-4473-8f87-b60b7a3783ca\") " pod="openstack-kuttl-tests/glance-db-sync-hm7fn" Mar 16 16:55:59 crc kubenswrapper[5120]: I0316 16:55:59.351228 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8ab6544e-3675-4473-8f87-b60b7a3783ca-config-data\") pod \"glance-db-sync-hm7fn\" (UID: \"8ab6544e-3675-4473-8f87-b60b7a3783ca\") " pod="openstack-kuttl-tests/glance-db-sync-hm7fn" Mar 16 16:55:59 crc kubenswrapper[5120]: I0316 16:55:59.364378 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8ab6544e-3675-4473-8f87-b60b7a3783ca-combined-ca-bundle\") pod \"glance-db-sync-hm7fn\" (UID: \"8ab6544e-3675-4473-8f87-b60b7a3783ca\") " pod="openstack-kuttl-tests/glance-db-sync-hm7fn" Mar 16 16:55:59 crc kubenswrapper[5120]: I0316 16:55:59.364398 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6stz\" (UniqueName: \"kubernetes.io/projected/8ab6544e-3675-4473-8f87-b60b7a3783ca-kube-api-access-g6stz\") pod \"glance-db-sync-hm7fn\" (UID: \"8ab6544e-3675-4473-8f87-b60b7a3783ca\") " pod="openstack-kuttl-tests/glance-db-sync-hm7fn" Mar 16 16:55:59 crc kubenswrapper[5120]: I0316 16:55:59.441526 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ksddb\" (UniqueName: \"kubernetes.io/projected/254f7ef3-eca3-448d-a697-5dbbccfd578c-kube-api-access-ksddb\") pod \"root-account-create-update-psx4m\" (UID: \"254f7ef3-eca3-448d-a697-5dbbccfd578c\") " pod="openstack-kuttl-tests/root-account-create-update-psx4m" Mar 16 16:55:59 crc kubenswrapper[5120]: I0316 16:55:59.441701 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/254f7ef3-eca3-448d-a697-5dbbccfd578c-operator-scripts\") pod \"root-account-create-update-psx4m\" (UID: \"254f7ef3-eca3-448d-a697-5dbbccfd578c\") " pod="openstack-kuttl-tests/root-account-create-update-psx4m" Mar 16 16:55:59 crc kubenswrapper[5120]: I0316 16:55:59.461128 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-hm7fn" Mar 16 16:55:59 crc kubenswrapper[5120]: I0316 16:55:59.544420 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ksddb\" (UniqueName: \"kubernetes.io/projected/254f7ef3-eca3-448d-a697-5dbbccfd578c-kube-api-access-ksddb\") pod \"root-account-create-update-psx4m\" (UID: \"254f7ef3-eca3-448d-a697-5dbbccfd578c\") " pod="openstack-kuttl-tests/root-account-create-update-psx4m" Mar 16 16:55:59 crc kubenswrapper[5120]: I0316 16:55:59.544858 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/254f7ef3-eca3-448d-a697-5dbbccfd578c-operator-scripts\") pod \"root-account-create-update-psx4m\" (UID: \"254f7ef3-eca3-448d-a697-5dbbccfd578c\") " pod="openstack-kuttl-tests/root-account-create-update-psx4m" Mar 16 16:55:59 crc kubenswrapper[5120]: I0316 16:55:59.546069 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/254f7ef3-eca3-448d-a697-5dbbccfd578c-operator-scripts\") pod \"root-account-create-update-psx4m\" (UID: \"254f7ef3-eca3-448d-a697-5dbbccfd578c\") " pod="openstack-kuttl-tests/root-account-create-update-psx4m" Mar 16 16:55:59 crc kubenswrapper[5120]: I0316 16:55:59.565241 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ksddb\" (UniqueName: \"kubernetes.io/projected/254f7ef3-eca3-448d-a697-5dbbccfd578c-kube-api-access-ksddb\") pod \"root-account-create-update-psx4m\" (UID: \"254f7ef3-eca3-448d-a697-5dbbccfd578c\") " pod="openstack-kuttl-tests/root-account-create-update-psx4m" Mar 16 16:55:59 crc kubenswrapper[5120]: I0316 16:55:59.767518 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-psx4m" Mar 16 16:55:59 crc kubenswrapper[5120]: I0316 16:55:59.956071 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/1f6975fd-67a9-4ce2-87b0-7318d7345a80-etc-swift\") pod \"swift-storage-0\" (UID: \"1f6975fd-67a9-4ce2-87b0-7318d7345a80\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:55:59 crc kubenswrapper[5120]: I0316 16:55:59.963952 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/1f6975fd-67a9-4ce2-87b0-7318d7345a80-etc-swift\") pod \"swift-storage-0\" (UID: \"1f6975fd-67a9-4ce2-87b0-7318d7345a80\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:55:59 crc kubenswrapper[5120]: I0316 16:55:59.994562 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Mar 16 16:56:00 crc kubenswrapper[5120]: I0316 16:56:00.018444 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-hm7fn"] Mar 16 16:56:00 crc kubenswrapper[5120]: W0316 16:56:00.030960 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8ab6544e_3675_4473_8f87_b60b7a3783ca.slice/crio-465d86615fb2064481c730fe7290064b4223b853ed62a46c99bd37d77a53d899 WatchSource:0}: Error finding container 465d86615fb2064481c730fe7290064b4223b853ed62a46c99bd37d77a53d899: Status 404 returned error can't find the container with id 465d86615fb2064481c730fe7290064b4223b853ed62a46c99bd37d77a53d899 Mar 16 16:56:00 crc kubenswrapper[5120]: I0316 16:56:00.072501 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-psx4m"] Mar 16 16:56:00 crc kubenswrapper[5120]: I0316 16:56:00.143220 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-infra/auto-csr-approver-29561336-7cbfn"] Mar 16 16:56:00 crc kubenswrapper[5120]: I0316 16:56:00.157494 5120 generic.go:358] "Generic (PLEG): container finished" podID="6361fbfb-238f-4535-8dd1-ddd18fd99309" containerID="2be04411104f1b6505b440d62d7d25aac319db5302fead2c25f351e832ca4b2f" exitCode=0 Mar 16 16:56:00 crc kubenswrapper[5120]: I0316 16:56:00.276146 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561336-7cbfn"] Mar 16 16:56:00 crc kubenswrapper[5120]: I0316 16:56:00.276183 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-hm7fn" event={"ID":"8ab6544e-3675-4473-8f87-b60b7a3783ca","Type":"ContainerStarted","Data":"465d86615fb2064481c730fe7290064b4223b853ed62a46c99bd37d77a53d899"} Mar 16 16:56:00 crc kubenswrapper[5120]: I0316 16:56:00.276229 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-psx4m" event={"ID":"254f7ef3-eca3-448d-a697-5dbbccfd578c","Type":"ContainerStarted","Data":"b2f614f01a0ca66829d0963c8436d894aa6cef92776ee5f4491f746e3dacb96a"} Mar 16 16:56:00 crc kubenswrapper[5120]: I0316 16:56:00.276247 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-dvmlk" event={"ID":"6361fbfb-238f-4535-8dd1-ddd18fd99309","Type":"ContainerDied","Data":"2be04411104f1b6505b440d62d7d25aac319db5302fead2c25f351e832ca4b2f"} Mar 16 16:56:00 crc kubenswrapper[5120]: I0316 16:56:00.276365 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561336-7cbfn" Mar 16 16:56:00 crc kubenswrapper[5120]: I0316 16:56:00.282239 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-infra\"/\"csr-approver-sa-dockercfg-x2nsz\"" Mar 16 16:56:00 crc kubenswrapper[5120]: I0316 16:56:00.282926 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"openshift-service-ca.crt\"" Mar 16 16:56:00 crc kubenswrapper[5120]: I0316 16:56:00.283266 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"kube-root-ca.crt\"" Mar 16 16:56:00 crc kubenswrapper[5120]: I0316 16:56:00.367598 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8fcsh\" (UniqueName: \"kubernetes.io/projected/78e8efc3-678e-4afe-91ff-45758c8ddf5e-kube-api-access-8fcsh\") pod \"auto-csr-approver-29561336-7cbfn\" (UID: \"78e8efc3-678e-4afe-91ff-45758c8ddf5e\") " pod="openshift-infra/auto-csr-approver-29561336-7cbfn" Mar 16 16:56:00 crc kubenswrapper[5120]: I0316 16:56:00.469770 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8fcsh\" (UniqueName: \"kubernetes.io/projected/78e8efc3-678e-4afe-91ff-45758c8ddf5e-kube-api-access-8fcsh\") pod \"auto-csr-approver-29561336-7cbfn\" (UID: \"78e8efc3-678e-4afe-91ff-45758c8ddf5e\") " pod="openshift-infra/auto-csr-approver-29561336-7cbfn" Mar 16 16:56:00 crc kubenswrapper[5120]: I0316 16:56:00.512785 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fcsh\" (UniqueName: \"kubernetes.io/projected/78e8efc3-678e-4afe-91ff-45758c8ddf5e-kube-api-access-8fcsh\") pod \"auto-csr-approver-29561336-7cbfn\" (UID: \"78e8efc3-678e-4afe-91ff-45758c8ddf5e\") " pod="openshift-infra/auto-csr-approver-29561336-7cbfn" Mar 16 16:56:00 crc kubenswrapper[5120]: I0316 16:56:00.533875 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 16:56:00 crc kubenswrapper[5120]: E0316 16:56:00.584028 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 2be04411104f1b6505b440d62d7d25aac319db5302fead2c25f351e832ca4b2f is running failed: container process not found" containerID="2be04411104f1b6505b440d62d7d25aac319db5302fead2c25f351e832ca4b2f" cmd=["grpc_health_probe","-addr=:50051"] Mar 16 16:56:00 crc kubenswrapper[5120]: E0316 16:56:00.586389 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 2be04411104f1b6505b440d62d7d25aac319db5302fead2c25f351e832ca4b2f is running failed: container process not found" containerID="2be04411104f1b6505b440d62d7d25aac319db5302fead2c25f351e832ca4b2f" cmd=["grpc_health_probe","-addr=:50051"] Mar 16 16:56:00 crc kubenswrapper[5120]: E0316 16:56:00.587735 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 2be04411104f1b6505b440d62d7d25aac319db5302fead2c25f351e832ca4b2f is running failed: container process not found" containerID="2be04411104f1b6505b440d62d7d25aac319db5302fead2c25f351e832ca4b2f" cmd=["grpc_health_probe","-addr=:50051"] Mar 16 16:56:00 crc kubenswrapper[5120]: E0316 16:56:00.587909 5120 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 2be04411104f1b6505b440d62d7d25aac319db5302fead2c25f351e832ca4b2f is running failed: container process not found" probeType="Readiness" pod="openshift-marketplace/community-operators-dvmlk" podUID="6361fbfb-238f-4535-8dd1-ddd18fd99309" containerName="registry-server" probeResult="unknown" Mar 16 16:56:00 crc kubenswrapper[5120]: I0316 16:56:00.606128 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561336-7cbfn" Mar 16 16:56:00 crc kubenswrapper[5120]: I0316 16:56:00.825299 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-dvmlk" Mar 16 16:56:00 crc kubenswrapper[5120]: I0316 16:56:00.880916 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/6361fbfb-238f-4535-8dd1-ddd18fd99309-utilities\") pod \"6361fbfb-238f-4535-8dd1-ddd18fd99309\" (UID: \"6361fbfb-238f-4535-8dd1-ddd18fd99309\") " Mar 16 16:56:00 crc kubenswrapper[5120]: I0316 16:56:00.881242 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d46bx\" (UniqueName: \"kubernetes.io/projected/6361fbfb-238f-4535-8dd1-ddd18fd99309-kube-api-access-d46bx\") pod \"6361fbfb-238f-4535-8dd1-ddd18fd99309\" (UID: \"6361fbfb-238f-4535-8dd1-ddd18fd99309\") " Mar 16 16:56:00 crc kubenswrapper[5120]: I0316 16:56:00.881424 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/6361fbfb-238f-4535-8dd1-ddd18fd99309-catalog-content\") pod \"6361fbfb-238f-4535-8dd1-ddd18fd99309\" (UID: \"6361fbfb-238f-4535-8dd1-ddd18fd99309\") " Mar 16 16:56:00 crc kubenswrapper[5120]: I0316 16:56:00.882524 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6361fbfb-238f-4535-8dd1-ddd18fd99309-utilities" (OuterVolumeSpecName: "utilities") pod "6361fbfb-238f-4535-8dd1-ddd18fd99309" (UID: "6361fbfb-238f-4535-8dd1-ddd18fd99309"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:56:00 crc kubenswrapper[5120]: I0316 16:56:00.897302 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6361fbfb-238f-4535-8dd1-ddd18fd99309-kube-api-access-d46bx" (OuterVolumeSpecName: "kube-api-access-d46bx") pod "6361fbfb-238f-4535-8dd1-ddd18fd99309" (UID: "6361fbfb-238f-4535-8dd1-ddd18fd99309"). InnerVolumeSpecName "kube-api-access-d46bx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:56:00 crc kubenswrapper[5120]: I0316 16:56:00.941061 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6361fbfb-238f-4535-8dd1-ddd18fd99309-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "6361fbfb-238f-4535-8dd1-ddd18fd99309" (UID: "6361fbfb-238f-4535-8dd1-ddd18fd99309"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:56:00 crc kubenswrapper[5120]: I0316 16:56:00.984349 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d46bx\" (UniqueName: \"kubernetes.io/projected/6361fbfb-238f-4535-8dd1-ddd18fd99309-kube-api-access-d46bx\") on node \"crc\" DevicePath \"\"" Mar 16 16:56:00 crc kubenswrapper[5120]: I0316 16:56:00.984386 5120 reconciler_common.go:299] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/6361fbfb-238f-4535-8dd1-ddd18fd99309-catalog-content\") on node \"crc\" DevicePath \"\"" Mar 16 16:56:00 crc kubenswrapper[5120]: I0316 16:56:00.984399 5120 reconciler_common.go:299] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/6361fbfb-238f-4535-8dd1-ddd18fd99309-utilities\") on node \"crc\" DevicePath \"\"" Mar 16 16:56:01 crc kubenswrapper[5120]: I0316 16:56:01.171956 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-hm7fn" event={"ID":"8ab6544e-3675-4473-8f87-b60b7a3783ca","Type":"ContainerStarted","Data":"7db690f4e8657183593f140a6de766cbf0ca9328b7cddc3663a1eba439f6b653"} Mar 16 16:56:01 crc kubenswrapper[5120]: I0316 16:56:01.174853 5120 generic.go:358] "Generic (PLEG): container finished" podID="4ed551c0-3f37-4af6-b682-b9e35fd5fa42" containerID="8712049419d751647f539cb23ec36107f7d405f68b95c688cf65f2c616a2aee4" exitCode=0 Mar 16 16:56:01 crc kubenswrapper[5120]: I0316 16:56:01.175005 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"4ed551c0-3f37-4af6-b682-b9e35fd5fa42","Type":"ContainerDied","Data":"8712049419d751647f539cb23ec36107f7d405f68b95c688cf65f2c616a2aee4"} Mar 16 16:56:01 crc kubenswrapper[5120]: I0316 16:56:01.182517 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"1f6975fd-67a9-4ce2-87b0-7318d7345a80","Type":"ContainerStarted","Data":"5bbe509850c00dbbb70f25ebabb5a6428197bfd27e4e15d3720d24f733d47545"} Mar 16 16:56:01 crc kubenswrapper[5120]: I0316 16:56:01.182597 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"1f6975fd-67a9-4ce2-87b0-7318d7345a80","Type":"ContainerStarted","Data":"72f9999debf34e244f550c3b73907da465311d85efec9f87ac95ad99743671d3"} Mar 16 16:56:01 crc kubenswrapper[5120]: I0316 16:56:01.184625 5120 generic.go:358] "Generic (PLEG): container finished" podID="254f7ef3-eca3-448d-a697-5dbbccfd578c" containerID="70df15c29e7e18770997e7713428c52391954f52d73580a598f904dce87cf1c4" exitCode=0 Mar 16 16:56:01 crc kubenswrapper[5120]: I0316 16:56:01.185677 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-psx4m" event={"ID":"254f7ef3-eca3-448d-a697-5dbbccfd578c","Type":"ContainerDied","Data":"70df15c29e7e18770997e7713428c52391954f52d73580a598f904dce87cf1c4"} Mar 16 16:56:01 crc kubenswrapper[5120]: I0316 16:56:01.192270 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-dvmlk" event={"ID":"6361fbfb-238f-4535-8dd1-ddd18fd99309","Type":"ContainerDied","Data":"8b9c3abe7595b0a48b1028427bd2c011c7f68a2bc697f0be36d628c4179abb14"} Mar 16 16:56:01 crc kubenswrapper[5120]: I0316 16:56:01.192383 5120 scope.go:117] "RemoveContainer" containerID="2be04411104f1b6505b440d62d7d25aac319db5302fead2c25f351e832ca4b2f" Mar 16 16:56:01 crc kubenswrapper[5120]: I0316 16:56:01.192675 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-dvmlk" Mar 16 16:56:01 crc kubenswrapper[5120]: I0316 16:56:01.195018 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-db-sync-hm7fn" podStartSLOduration=2.194997525 podStartE2EDuration="2.194997525s" podCreationTimestamp="2026-03-16 16:55:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:56:01.192031454 +0000 UTC m=+5063.345963131" watchObservedRunningTime="2026-03-16 16:56:01.194997525 +0000 UTC m=+5063.348929182" Mar 16 16:56:01 crc kubenswrapper[5120]: I0316 16:56:01.221587 5120 scope.go:117] "RemoveContainer" containerID="5d8d21dacdc84c4bde4965fce4deaad991145a49c61cc9d866afbf4286e4ea24" Mar 16 16:56:01 crc kubenswrapper[5120]: I0316 16:56:01.262454 5120 scope.go:117] "RemoveContainer" containerID="d9b0722103b595733ea772878aa172b1adce4c91ffa70452f615c6cef3c1a1c6" Mar 16 16:56:01 crc kubenswrapper[5120]: I0316 16:56:01.265720 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561336-7cbfn"] Mar 16 16:56:01 crc kubenswrapper[5120]: I0316 16:56:01.339339 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/community-operators-dvmlk"] Mar 16 16:56:01 crc kubenswrapper[5120]: I0316 16:56:01.355603 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/community-operators-dvmlk"] Mar 16 16:56:02 crc kubenswrapper[5120]: I0316 16:56:02.206339 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561336-7cbfn" event={"ID":"78e8efc3-678e-4afe-91ff-45758c8ddf5e","Type":"ContainerStarted","Data":"7152ada4967d89043df24c282a8bd2f1b57dccb01817405d7ddd759b4b5a1bd6"} Mar 16 16:56:02 crc kubenswrapper[5120]: I0316 16:56:02.215278 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"4ed551c0-3f37-4af6-b682-b9e35fd5fa42","Type":"ContainerStarted","Data":"b8bbcdffc34685e533b2e078ab9d7cc67872998017fd038f8b682e3c4a20dda7"} Mar 16 16:56:02 crc kubenswrapper[5120]: I0316 16:56:02.215596 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:56:02 crc kubenswrapper[5120]: I0316 16:56:02.217590 5120 scope.go:117] "RemoveContainer" containerID="ec32cc84b26792cf3f462f2ecea3511e822e6d2b6a22dd05e66d641afe8dfac1" Mar 16 16:56:02 crc kubenswrapper[5120]: I0316 16:56:02.219611 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"1f6975fd-67a9-4ce2-87b0-7318d7345a80","Type":"ContainerStarted","Data":"2d33a82773827d3fc5dd80071dc63c0443a8e527afa994c6317d12be137c1056"} Mar 16 16:56:02 crc kubenswrapper[5120]: I0316 16:56:02.219689 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"1f6975fd-67a9-4ce2-87b0-7318d7345a80","Type":"ContainerStarted","Data":"3283eed1799cc5cf220c4d4610b8ff792b9e5f3e4e9b924171c4e3139945654e"} Mar 16 16:56:02 crc kubenswrapper[5120]: I0316 16:56:02.219704 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"1f6975fd-67a9-4ce2-87b0-7318d7345a80","Type":"ContainerStarted","Data":"42849e2776cea701e33065bdd6a04004ebe1c46b7b15be851b9968528ea41270"} Mar 16 16:56:02 crc kubenswrapper[5120]: I0316 16:56:02.219713 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"1f6975fd-67a9-4ce2-87b0-7318d7345a80","Type":"ContainerStarted","Data":"d9ba57534506b9295f26e2c084a6001d61593b940fe5c320a291c95cbf236766"} Mar 16 16:56:02 crc kubenswrapper[5120]: I0316 16:56:02.219721 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"1f6975fd-67a9-4ce2-87b0-7318d7345a80","Type":"ContainerStarted","Data":"b238bb89bbe2b3c43c7a92f158ccc80fa8bc740d10604a58081cf0dbc80ad67e"} Mar 16 16:56:02 crc kubenswrapper[5120]: I0316 16:56:02.223637 5120 generic.go:358] "Generic (PLEG): container finished" podID="279c3e84-623c-4c5f-ae15-d7d8c439c4dc" containerID="06c0c12d3e7e9a7aecfc7d72f564006daf6123f028c14aa026bced0fe656dd6e" exitCode=0 Mar 16 16:56:02 crc kubenswrapper[5120]: I0316 16:56:02.224176 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"279c3e84-623c-4c5f-ae15-d7d8c439c4dc","Type":"ContainerDied","Data":"06c0c12d3e7e9a7aecfc7d72f564006daf6123f028c14aa026bced0fe656dd6e"} Mar 16 16:56:02 crc kubenswrapper[5120]: I0316 16:56:02.254252 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/rabbitmq-server-0" podStartSLOduration=36.254228076 podStartE2EDuration="36.254228076s" podCreationTimestamp="2026-03-16 16:55:26 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:56:02.244983823 +0000 UTC m=+5064.398915490" watchObservedRunningTime="2026-03-16 16:56:02.254228076 +0000 UTC m=+5064.408159733" Mar 16 16:56:02 crc kubenswrapper[5120]: I0316 16:56:02.260920 5120 scope.go:117] "RemoveContainer" containerID="7df173ac73cf5e36a6f13cc1a0ed41c6457fd5b2890bc60acb47c3b5135ca48b" Mar 16 16:56:02 crc kubenswrapper[5120]: I0316 16:56:02.296981 5120 scope.go:117] "RemoveContainer" containerID="9ce74e3e7c03671f217a90ecc54371da22afef7549bf1a2fab8103a986ef97ef" Mar 16 16:56:02 crc kubenswrapper[5120]: I0316 16:56:02.346976 5120 scope.go:117] "RemoveContainer" containerID="1d0ccd154a7c0690b5a9fdd694f4ee68fe8dec94bc1b4bbc45efa9cae8b6c9b8" Mar 16 16:56:02 crc kubenswrapper[5120]: I0316 16:56:02.497066 5120 scope.go:117] "RemoveContainer" containerID="994a5a64c6e8bfa1489bcf220f2bea0b606e14b2ee9f634800fe3f596ce39925" Mar 16 16:56:02 crc kubenswrapper[5120]: I0316 16:56:02.608258 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-psx4m" Mar 16 16:56:02 crc kubenswrapper[5120]: I0316 16:56:02.615459 5120 scope.go:117] "RemoveContainer" containerID="a97f96ac1cd87cba0b55ec8ed7b5a54af5f9292e24a69dab7c862eddcfb9017d" Mar 16 16:56:02 crc kubenswrapper[5120]: I0316 16:56:02.637351 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ksddb\" (UniqueName: \"kubernetes.io/projected/254f7ef3-eca3-448d-a697-5dbbccfd578c-kube-api-access-ksddb\") pod \"254f7ef3-eca3-448d-a697-5dbbccfd578c\" (UID: \"254f7ef3-eca3-448d-a697-5dbbccfd578c\") " Mar 16 16:56:02 crc kubenswrapper[5120]: I0316 16:56:02.637909 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/254f7ef3-eca3-448d-a697-5dbbccfd578c-operator-scripts\") pod \"254f7ef3-eca3-448d-a697-5dbbccfd578c\" (UID: \"254f7ef3-eca3-448d-a697-5dbbccfd578c\") " Mar 16 16:56:02 crc kubenswrapper[5120]: I0316 16:56:02.639357 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/254f7ef3-eca3-448d-a697-5dbbccfd578c-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "254f7ef3-eca3-448d-a697-5dbbccfd578c" (UID: "254f7ef3-eca3-448d-a697-5dbbccfd578c"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:56:02 crc kubenswrapper[5120]: I0316 16:56:02.648968 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/254f7ef3-eca3-448d-a697-5dbbccfd578c-kube-api-access-ksddb" (OuterVolumeSpecName: "kube-api-access-ksddb") pod "254f7ef3-eca3-448d-a697-5dbbccfd578c" (UID: "254f7ef3-eca3-448d-a697-5dbbccfd578c"). InnerVolumeSpecName "kube-api-access-ksddb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:56:02 crc kubenswrapper[5120]: I0316 16:56:02.698283 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6361fbfb-238f-4535-8dd1-ddd18fd99309" path="/var/lib/kubelet/pods/6361fbfb-238f-4535-8dd1-ddd18fd99309/volumes" Mar 16 16:56:02 crc kubenswrapper[5120]: I0316 16:56:02.737255 5120 scope.go:117] "RemoveContainer" containerID="253c53bba99c38e72727f99679b1008d2ae517e9eefdcfc28a8327f9fd2df9dd" Mar 16 16:56:02 crc kubenswrapper[5120]: I0316 16:56:02.741650 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/254f7ef3-eca3-448d-a697-5dbbccfd578c-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:56:02 crc kubenswrapper[5120]: I0316 16:56:02.741693 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ksddb\" (UniqueName: \"kubernetes.io/projected/254f7ef3-eca3-448d-a697-5dbbccfd578c-kube-api-access-ksddb\") on node \"crc\" DevicePath \"\"" Mar 16 16:56:03 crc kubenswrapper[5120]: I0316 16:56:03.235965 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561336-7cbfn" event={"ID":"78e8efc3-678e-4afe-91ff-45758c8ddf5e","Type":"ContainerStarted","Data":"7154b5d6a06ae5d00b3ae356df0053f9e57a21e683e816164febe3789fe1d5ef"} Mar 16 16:56:03 crc kubenswrapper[5120]: I0316 16:56:03.245037 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"1f6975fd-67a9-4ce2-87b0-7318d7345a80","Type":"ContainerStarted","Data":"1d2089103eb63f1bcee2dbea95910e480727a3907ba19bd2a3fd5b82c3ef8a0e"} Mar 16 16:56:03 crc kubenswrapper[5120]: I0316 16:56:03.245093 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"1f6975fd-67a9-4ce2-87b0-7318d7345a80","Type":"ContainerStarted","Data":"0ec73f2c6eba913a4bcd3d808e105a68bc2427f897a4d87db565f924c91ef3ac"} Mar 16 16:56:03 crc kubenswrapper[5120]: I0316 16:56:03.245106 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"1f6975fd-67a9-4ce2-87b0-7318d7345a80","Type":"ContainerStarted","Data":"556839845d225aff65b5ca07364c6f9f9b4d50587a636e047429ac5ade952de4"} Mar 16 16:56:03 crc kubenswrapper[5120]: I0316 16:56:03.245117 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"1f6975fd-67a9-4ce2-87b0-7318d7345a80","Type":"ContainerStarted","Data":"2ceda8ed6affc59d31db4f2f07d3a8ebf040b3bc7d71f407b104748fbaeb5108"} Mar 16 16:56:03 crc kubenswrapper[5120]: I0316 16:56:03.247736 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-psx4m" event={"ID":"254f7ef3-eca3-448d-a697-5dbbccfd578c","Type":"ContainerDied","Data":"b2f614f01a0ca66829d0963c8436d894aa6cef92776ee5f4491f746e3dacb96a"} Mar 16 16:56:03 crc kubenswrapper[5120]: I0316 16:56:03.247793 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b2f614f01a0ca66829d0963c8436d894aa6cef92776ee5f4491f746e3dacb96a" Mar 16 16:56:03 crc kubenswrapper[5120]: I0316 16:56:03.247863 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-psx4m" Mar 16 16:56:03 crc kubenswrapper[5120]: I0316 16:56:03.258680 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"279c3e84-623c-4c5f-ae15-d7d8c439c4dc","Type":"ContainerStarted","Data":"f74ecc023217184e5ac69eafc7250f1064a8b35dbd565a66ef8fc760056c5822"} Mar 16 16:56:03 crc kubenswrapper[5120]: I0316 16:56:03.259116 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-infra/auto-csr-approver-29561336-7cbfn" podStartSLOduration=2.2754081360000002 podStartE2EDuration="3.25909475s" podCreationTimestamp="2026-03-16 16:56:00 +0000 UTC" firstStartedPulling="2026-03-16 16:56:01.276732652 +0000 UTC m=+5063.430664309" lastFinishedPulling="2026-03-16 16:56:02.260419276 +0000 UTC m=+5064.414350923" observedRunningTime="2026-03-16 16:56:03.252075458 +0000 UTC m=+5065.406007115" watchObservedRunningTime="2026-03-16 16:56:03.25909475 +0000 UTC m=+5065.413026397" Mar 16 16:56:03 crc kubenswrapper[5120]: I0316 16:56:03.259467 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:56:03 crc kubenswrapper[5120]: I0316 16:56:03.281506 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" podStartSLOduration=37.281486173 podStartE2EDuration="37.281486173s" podCreationTimestamp="2026-03-16 16:55:26 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:56:03.278801759 +0000 UTC m=+5065.432733426" watchObservedRunningTime="2026-03-16 16:56:03.281486173 +0000 UTC m=+5065.435417830" Mar 16 16:56:04 crc kubenswrapper[5120]: I0316 16:56:04.270540 5120 generic.go:358] "Generic (PLEG): container finished" podID="78e8efc3-678e-4afe-91ff-45758c8ddf5e" containerID="7154b5d6a06ae5d00b3ae356df0053f9e57a21e683e816164febe3789fe1d5ef" exitCode=0 Mar 16 16:56:04 crc kubenswrapper[5120]: I0316 16:56:04.270621 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561336-7cbfn" event={"ID":"78e8efc3-678e-4afe-91ff-45758c8ddf5e","Type":"ContainerDied","Data":"7154b5d6a06ae5d00b3ae356df0053f9e57a21e683e816164febe3789fe1d5ef"} Mar 16 16:56:04 crc kubenswrapper[5120]: I0316 16:56:04.278467 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"1f6975fd-67a9-4ce2-87b0-7318d7345a80","Type":"ContainerStarted","Data":"a13b02076f983681a11b54a1569f95dfe4808752321801358ab0264bcf250454"} Mar 16 16:56:04 crc kubenswrapper[5120]: I0316 16:56:04.278517 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"1f6975fd-67a9-4ce2-87b0-7318d7345a80","Type":"ContainerStarted","Data":"ea0a58d085e77e9f2e80fb3abe6830d44085c6de8bbc41d01e3ce40efd201333"} Mar 16 16:56:04 crc kubenswrapper[5120]: I0316 16:56:04.278541 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"1f6975fd-67a9-4ce2-87b0-7318d7345a80","Type":"ContainerStarted","Data":"0d6f935c1c526a5f0534fe1c16af647e381d75b15f387ea4fe7dccbef914de3c"} Mar 16 16:56:04 crc kubenswrapper[5120]: I0316 16:56:04.278552 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"1f6975fd-67a9-4ce2-87b0-7318d7345a80","Type":"ContainerStarted","Data":"0e0c5f231603ea1e00da8c71a3719c91517ffbef85631d7b15f8ddffae3fc859"} Mar 16 16:56:04 crc kubenswrapper[5120]: I0316 16:56:04.278563 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"1f6975fd-67a9-4ce2-87b0-7318d7345a80","Type":"ContainerStarted","Data":"8fcc879ae0f691fdfd5cd0fe4b16ffe3d232c975df243d8f32fa92fd036127e7"} Mar 16 16:56:04 crc kubenswrapper[5120]: I0316 16:56:04.354418 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/swift-storage-0" podStartSLOduration=21.354394399 podStartE2EDuration="21.354394399s" podCreationTimestamp="2026-03-16 16:55:43 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:56:04.347514151 +0000 UTC m=+5066.501445838" watchObservedRunningTime="2026-03-16 16:56:04.354394399 +0000 UTC m=+5066.508326106" Mar 16 16:56:04 crc kubenswrapper[5120]: I0316 16:56:04.497938 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-58df95f9c7-sclzx"] Mar 16 16:56:04 crc kubenswrapper[5120]: I0316 16:56:04.499066 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6361fbfb-238f-4535-8dd1-ddd18fd99309" containerName="registry-server" Mar 16 16:56:04 crc kubenswrapper[5120]: I0316 16:56:04.499090 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="6361fbfb-238f-4535-8dd1-ddd18fd99309" containerName="registry-server" Mar 16 16:56:04 crc kubenswrapper[5120]: I0316 16:56:04.499120 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="254f7ef3-eca3-448d-a697-5dbbccfd578c" containerName="mariadb-account-create-update" Mar 16 16:56:04 crc kubenswrapper[5120]: I0316 16:56:04.499127 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="254f7ef3-eca3-448d-a697-5dbbccfd578c" containerName="mariadb-account-create-update" Mar 16 16:56:04 crc kubenswrapper[5120]: I0316 16:56:04.499143 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6361fbfb-238f-4535-8dd1-ddd18fd99309" containerName="extract-content" Mar 16 16:56:04 crc kubenswrapper[5120]: I0316 16:56:04.499148 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="6361fbfb-238f-4535-8dd1-ddd18fd99309" containerName="extract-content" Mar 16 16:56:04 crc kubenswrapper[5120]: I0316 16:56:04.499184 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6361fbfb-238f-4535-8dd1-ddd18fd99309" containerName="extract-utilities" Mar 16 16:56:04 crc kubenswrapper[5120]: I0316 16:56:04.499189 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="6361fbfb-238f-4535-8dd1-ddd18fd99309" containerName="extract-utilities" Mar 16 16:56:04 crc kubenswrapper[5120]: I0316 16:56:04.499441 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="254f7ef3-eca3-448d-a697-5dbbccfd578c" containerName="mariadb-account-create-update" Mar 16 16:56:04 crc kubenswrapper[5120]: I0316 16:56:04.499454 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="6361fbfb-238f-4535-8dd1-ddd18fd99309" containerName="registry-server" Mar 16 16:56:04 crc kubenswrapper[5120]: I0316 16:56:04.505846 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58df95f9c7-sclzx" Mar 16 16:56:04 crc kubenswrapper[5120]: I0316 16:56:04.512095 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"dns-swift-storage-0\"" Mar 16 16:56:04 crc kubenswrapper[5120]: I0316 16:56:04.513563 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-58df95f9c7-sclzx"] Mar 16 16:56:04 crc kubenswrapper[5120]: I0316 16:56:04.589280 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqbdz\" (UniqueName: \"kubernetes.io/projected/dc73e417-3a3e-4cda-9a94-b927abd6ca0d-kube-api-access-nqbdz\") pod \"dnsmasq-dnsmasq-58df95f9c7-sclzx\" (UID: \"dc73e417-3a3e-4cda-9a94-b927abd6ca0d\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58df95f9c7-sclzx" Mar 16 16:56:04 crc kubenswrapper[5120]: I0316 16:56:04.589576 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/dc73e417-3a3e-4cda-9a94-b927abd6ca0d-config\") pod \"dnsmasq-dnsmasq-58df95f9c7-sclzx\" (UID: \"dc73e417-3a3e-4cda-9a94-b927abd6ca0d\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58df95f9c7-sclzx" Mar 16 16:56:04 crc kubenswrapper[5120]: I0316 16:56:04.589692 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/dc73e417-3a3e-4cda-9a94-b927abd6ca0d-dns-swift-storage-0\") pod \"dnsmasq-dnsmasq-58df95f9c7-sclzx\" (UID: \"dc73e417-3a3e-4cda-9a94-b927abd6ca0d\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58df95f9c7-sclzx" Mar 16 16:56:04 crc kubenswrapper[5120]: I0316 16:56:04.589926 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/dc73e417-3a3e-4cda-9a94-b927abd6ca0d-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-58df95f9c7-sclzx\" (UID: \"dc73e417-3a3e-4cda-9a94-b927abd6ca0d\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58df95f9c7-sclzx" Mar 16 16:56:04 crc kubenswrapper[5120]: I0316 16:56:04.692401 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/dc73e417-3a3e-4cda-9a94-b927abd6ca0d-config\") pod \"dnsmasq-dnsmasq-58df95f9c7-sclzx\" (UID: \"dc73e417-3a3e-4cda-9a94-b927abd6ca0d\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58df95f9c7-sclzx" Mar 16 16:56:04 crc kubenswrapper[5120]: I0316 16:56:04.692505 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/dc73e417-3a3e-4cda-9a94-b927abd6ca0d-dns-swift-storage-0\") pod \"dnsmasq-dnsmasq-58df95f9c7-sclzx\" (UID: \"dc73e417-3a3e-4cda-9a94-b927abd6ca0d\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58df95f9c7-sclzx" Mar 16 16:56:04 crc kubenswrapper[5120]: I0316 16:56:04.692650 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/dc73e417-3a3e-4cda-9a94-b927abd6ca0d-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-58df95f9c7-sclzx\" (UID: \"dc73e417-3a3e-4cda-9a94-b927abd6ca0d\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58df95f9c7-sclzx" Mar 16 16:56:04 crc kubenswrapper[5120]: I0316 16:56:04.692777 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nqbdz\" (UniqueName: \"kubernetes.io/projected/dc73e417-3a3e-4cda-9a94-b927abd6ca0d-kube-api-access-nqbdz\") pod \"dnsmasq-dnsmasq-58df95f9c7-sclzx\" (UID: \"dc73e417-3a3e-4cda-9a94-b927abd6ca0d\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58df95f9c7-sclzx" Mar 16 16:56:04 crc kubenswrapper[5120]: I0316 16:56:04.693217 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/dc73e417-3a3e-4cda-9a94-b927abd6ca0d-config\") pod \"dnsmasq-dnsmasq-58df95f9c7-sclzx\" (UID: \"dc73e417-3a3e-4cda-9a94-b927abd6ca0d\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58df95f9c7-sclzx" Mar 16 16:56:04 crc kubenswrapper[5120]: I0316 16:56:04.694066 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/dc73e417-3a3e-4cda-9a94-b927abd6ca0d-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-58df95f9c7-sclzx\" (UID: \"dc73e417-3a3e-4cda-9a94-b927abd6ca0d\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58df95f9c7-sclzx" Mar 16 16:56:04 crc kubenswrapper[5120]: I0316 16:56:04.694192 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/dc73e417-3a3e-4cda-9a94-b927abd6ca0d-dns-swift-storage-0\") pod \"dnsmasq-dnsmasq-58df95f9c7-sclzx\" (UID: \"dc73e417-3a3e-4cda-9a94-b927abd6ca0d\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58df95f9c7-sclzx" Mar 16 16:56:04 crc kubenswrapper[5120]: I0316 16:56:04.717884 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqbdz\" (UniqueName: \"kubernetes.io/projected/dc73e417-3a3e-4cda-9a94-b927abd6ca0d-kube-api-access-nqbdz\") pod \"dnsmasq-dnsmasq-58df95f9c7-sclzx\" (UID: \"dc73e417-3a3e-4cda-9a94-b927abd6ca0d\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58df95f9c7-sclzx" Mar 16 16:56:04 crc kubenswrapper[5120]: I0316 16:56:04.823397 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58df95f9c7-sclzx" Mar 16 16:56:05 crc kubenswrapper[5120]: I0316 16:56:05.335437 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-58df95f9c7-sclzx"] Mar 16 16:56:05 crc kubenswrapper[5120]: I0316 16:56:05.729070 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561336-7cbfn" Mar 16 16:56:05 crc kubenswrapper[5120]: I0316 16:56:05.830289 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8fcsh\" (UniqueName: \"kubernetes.io/projected/78e8efc3-678e-4afe-91ff-45758c8ddf5e-kube-api-access-8fcsh\") pod \"78e8efc3-678e-4afe-91ff-45758c8ddf5e\" (UID: \"78e8efc3-678e-4afe-91ff-45758c8ddf5e\") " Mar 16 16:56:05 crc kubenswrapper[5120]: I0316 16:56:05.835073 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/78e8efc3-678e-4afe-91ff-45758c8ddf5e-kube-api-access-8fcsh" (OuterVolumeSpecName: "kube-api-access-8fcsh") pod "78e8efc3-678e-4afe-91ff-45758c8ddf5e" (UID: "78e8efc3-678e-4afe-91ff-45758c8ddf5e"). InnerVolumeSpecName "kube-api-access-8fcsh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:56:05 crc kubenswrapper[5120]: I0316 16:56:05.933915 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8fcsh\" (UniqueName: \"kubernetes.io/projected/78e8efc3-678e-4afe-91ff-45758c8ddf5e-kube-api-access-8fcsh\") on node \"crc\" DevicePath \"\"" Mar 16 16:56:06 crc kubenswrapper[5120]: I0316 16:56:06.306809 5120 generic.go:358] "Generic (PLEG): container finished" podID="dc73e417-3a3e-4cda-9a94-b927abd6ca0d" containerID="8ff51b8401bc2fb8dec6c6ed8f87ef0bbe339528463a2c823569c3dd0996f08e" exitCode=0 Mar 16 16:56:06 crc kubenswrapper[5120]: I0316 16:56:06.306980 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58df95f9c7-sclzx" event={"ID":"dc73e417-3a3e-4cda-9a94-b927abd6ca0d","Type":"ContainerDied","Data":"8ff51b8401bc2fb8dec6c6ed8f87ef0bbe339528463a2c823569c3dd0996f08e"} Mar 16 16:56:06 crc kubenswrapper[5120]: I0316 16:56:06.307019 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58df95f9c7-sclzx" event={"ID":"dc73e417-3a3e-4cda-9a94-b927abd6ca0d","Type":"ContainerStarted","Data":"af38ee8bb5b5aa6a332753340c94cb3180fdc2f443daa029e19898c3b02a1d72"} Mar 16 16:56:06 crc kubenswrapper[5120]: I0316 16:56:06.310735 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561336-7cbfn" event={"ID":"78e8efc3-678e-4afe-91ff-45758c8ddf5e","Type":"ContainerDied","Data":"7152ada4967d89043df24c282a8bd2f1b57dccb01817405d7ddd759b4b5a1bd6"} Mar 16 16:56:06 crc kubenswrapper[5120]: I0316 16:56:06.310800 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7152ada4967d89043df24c282a8bd2f1b57dccb01817405d7ddd759b4b5a1bd6" Mar 16 16:56:06 crc kubenswrapper[5120]: I0316 16:56:06.310859 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561336-7cbfn" Mar 16 16:56:06 crc kubenswrapper[5120]: I0316 16:56:06.318932 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-infra/auto-csr-approver-29561330-mwqvz"] Mar 16 16:56:06 crc kubenswrapper[5120]: I0316 16:56:06.339421 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-infra/auto-csr-approver-29561330-mwqvz"] Mar 16 16:56:06 crc kubenswrapper[5120]: I0316 16:56:06.673886 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="207d2e98-cd6e-4019-9deb-240e09d44bb7" path="/var/lib/kubelet/pods/207d2e98-cd6e-4019-9deb-240e09d44bb7/volumes" Mar 16 16:56:07 crc kubenswrapper[5120]: I0316 16:56:07.321978 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58df95f9c7-sclzx" event={"ID":"dc73e417-3a3e-4cda-9a94-b927abd6ca0d","Type":"ContainerStarted","Data":"aabeb580e30961c2013c280e0704642ac871d74a031bfb5816b71ac9a86e572a"} Mar 16 16:56:07 crc kubenswrapper[5120]: I0316 16:56:07.322125 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58df95f9c7-sclzx" Mar 16 16:56:07 crc kubenswrapper[5120]: I0316 16:56:07.350118 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58df95f9c7-sclzx" podStartSLOduration=3.350099853 podStartE2EDuration="3.350099853s" podCreationTimestamp="2026-03-16 16:56:04 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:56:07.342131635 +0000 UTC m=+5069.496063302" watchObservedRunningTime="2026-03-16 16:56:07.350099853 +0000 UTC m=+5069.504031510" Mar 16 16:56:07 crc kubenswrapper[5120]: I0316 16:56:07.663794 5120 scope.go:117] "RemoveContainer" containerID="083f72646c8d47c9c0467b39be99ddfa9c2e5900ae0a29ad53d7b39b950274b4" Mar 16 16:56:07 crc kubenswrapper[5120]: E0316 16:56:07.664479 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:56:07 crc kubenswrapper[5120]: E0316 16:56:07.664787 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1556945 actualBytes=10240 Mar 16 16:56:08 crc kubenswrapper[5120]: I0316 16:56:08.334188 5120 generic.go:358] "Generic (PLEG): container finished" podID="8ab6544e-3675-4473-8f87-b60b7a3783ca" containerID="7db690f4e8657183593f140a6de766cbf0ca9328b7cddc3663a1eba439f6b653" exitCode=0 Mar 16 16:56:08 crc kubenswrapper[5120]: I0316 16:56:08.334351 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-hm7fn" event={"ID":"8ab6544e-3675-4473-8f87-b60b7a3783ca","Type":"ContainerDied","Data":"7db690f4e8657183593f140a6de766cbf0ca9328b7cddc3663a1eba439f6b653"} Mar 16 16:56:09 crc kubenswrapper[5120]: I0316 16:56:09.702623 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-hm7fn" Mar 16 16:56:09 crc kubenswrapper[5120]: I0316 16:56:09.773088 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8ab6544e-3675-4473-8f87-b60b7a3783ca-config-data\") pod \"8ab6544e-3675-4473-8f87-b60b7a3783ca\" (UID: \"8ab6544e-3675-4473-8f87-b60b7a3783ca\") " Mar 16 16:56:09 crc kubenswrapper[5120]: I0316 16:56:09.773600 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8ab6544e-3675-4473-8f87-b60b7a3783ca-combined-ca-bundle\") pod \"8ab6544e-3675-4473-8f87-b60b7a3783ca\" (UID: \"8ab6544e-3675-4473-8f87-b60b7a3783ca\") " Mar 16 16:56:09 crc kubenswrapper[5120]: I0316 16:56:09.773824 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/8ab6544e-3675-4473-8f87-b60b7a3783ca-db-sync-config-data\") pod \"8ab6544e-3675-4473-8f87-b60b7a3783ca\" (UID: \"8ab6544e-3675-4473-8f87-b60b7a3783ca\") " Mar 16 16:56:09 crc kubenswrapper[5120]: I0316 16:56:09.774526 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g6stz\" (UniqueName: \"kubernetes.io/projected/8ab6544e-3675-4473-8f87-b60b7a3783ca-kube-api-access-g6stz\") pod \"8ab6544e-3675-4473-8f87-b60b7a3783ca\" (UID: \"8ab6544e-3675-4473-8f87-b60b7a3783ca\") " Mar 16 16:56:09 crc kubenswrapper[5120]: I0316 16:56:09.779637 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ab6544e-3675-4473-8f87-b60b7a3783ca-kube-api-access-g6stz" (OuterVolumeSpecName: "kube-api-access-g6stz") pod "8ab6544e-3675-4473-8f87-b60b7a3783ca" (UID: "8ab6544e-3675-4473-8f87-b60b7a3783ca"). InnerVolumeSpecName "kube-api-access-g6stz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:56:09 crc kubenswrapper[5120]: I0316 16:56:09.780510 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ab6544e-3675-4473-8f87-b60b7a3783ca-db-sync-config-data" (OuterVolumeSpecName: "db-sync-config-data") pod "8ab6544e-3675-4473-8f87-b60b7a3783ca" (UID: "8ab6544e-3675-4473-8f87-b60b7a3783ca"). InnerVolumeSpecName "db-sync-config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:56:09 crc kubenswrapper[5120]: I0316 16:56:09.801073 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ab6544e-3675-4473-8f87-b60b7a3783ca-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "8ab6544e-3675-4473-8f87-b60b7a3783ca" (UID: "8ab6544e-3675-4473-8f87-b60b7a3783ca"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:56:09 crc kubenswrapper[5120]: I0316 16:56:09.818272 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ab6544e-3675-4473-8f87-b60b7a3783ca-config-data" (OuterVolumeSpecName: "config-data") pod "8ab6544e-3675-4473-8f87-b60b7a3783ca" (UID: "8ab6544e-3675-4473-8f87-b60b7a3783ca"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:56:09 crc kubenswrapper[5120]: I0316 16:56:09.877517 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8ab6544e-3675-4473-8f87-b60b7a3783ca-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:56:09 crc kubenswrapper[5120]: I0316 16:56:09.877706 5120 reconciler_common.go:299] "Volume detached for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/8ab6544e-3675-4473-8f87-b60b7a3783ca-db-sync-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:56:09 crc kubenswrapper[5120]: I0316 16:56:09.877721 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g6stz\" (UniqueName: \"kubernetes.io/projected/8ab6544e-3675-4473-8f87-b60b7a3783ca-kube-api-access-g6stz\") on node \"crc\" DevicePath \"\"" Mar 16 16:56:09 crc kubenswrapper[5120]: I0316 16:56:09.877733 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8ab6544e-3675-4473-8f87-b60b7a3783ca-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:56:10 crc kubenswrapper[5120]: I0316 16:56:10.352108 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-hm7fn" event={"ID":"8ab6544e-3675-4473-8f87-b60b7a3783ca","Type":"ContainerDied","Data":"465d86615fb2064481c730fe7290064b4223b853ed62a46c99bd37d77a53d899"} Mar 16 16:56:10 crc kubenswrapper[5120]: I0316 16:56:10.352147 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="465d86615fb2064481c730fe7290064b4223b853ed62a46c99bd37d77a53d899" Mar 16 16:56:10 crc kubenswrapper[5120]: I0316 16:56:10.352122 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-hm7fn" Mar 16 16:56:13 crc kubenswrapper[5120]: I0316 16:56:13.262907 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 16:56:13 crc kubenswrapper[5120]: I0316 16:56:13.335944 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58df95f9c7-sclzx" Mar 16 16:56:13 crc kubenswrapper[5120]: I0316 16:56:13.400888 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-9d545"] Mar 16 16:56:13 crc kubenswrapper[5120]: I0316 16:56:13.401302 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-9d545" podUID="0f95e292-0325-47f3-9767-d77bcc9e5884" containerName="dnsmasq-dns" containerID="cri-o://2aa1d440c20b1b3d572806485b0a43f3ac8ae34407b490f95faccd65488bfd65" gracePeriod=10 Mar 16 16:56:13 crc kubenswrapper[5120]: I0316 16:56:13.726958 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-9d545" podUID="0f95e292-0325-47f3-9767-d77bcc9e5884" containerName="dnsmasq-dns" probeResult="failure" output="dial tcp 10.217.0.212:5353: connect: connection refused" Mar 16 16:56:13 crc kubenswrapper[5120]: I0316 16:56:13.851714 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-db-create-r5jqt"] Mar 16 16:56:13 crc kubenswrapper[5120]: I0316 16:56:13.860003 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ab6544e-3675-4473-8f87-b60b7a3783ca" containerName="glance-db-sync" Mar 16 16:56:13 crc kubenswrapper[5120]: I0316 16:56:13.860047 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ab6544e-3675-4473-8f87-b60b7a3783ca" containerName="glance-db-sync" Mar 16 16:56:13 crc kubenswrapper[5120]: I0316 16:56:13.860089 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78e8efc3-678e-4afe-91ff-45758c8ddf5e" containerName="oc" Mar 16 16:56:13 crc kubenswrapper[5120]: I0316 16:56:13.860097 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="78e8efc3-678e-4afe-91ff-45758c8ddf5e" containerName="oc" Mar 16 16:56:13 crc kubenswrapper[5120]: I0316 16:56:13.860272 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="8ab6544e-3675-4473-8f87-b60b7a3783ca" containerName="glance-db-sync" Mar 16 16:56:13 crc kubenswrapper[5120]: I0316 16:56:13.860288 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="78e8efc3-678e-4afe-91ff-45758c8ddf5e" containerName="oc" Mar 16 16:56:13 crc kubenswrapper[5120]: I0316 16:56:13.872746 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-create-r5jqt" Mar 16 16:56:13 crc kubenswrapper[5120]: I0316 16:56:13.872776 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-db-create-r5jqt"] Mar 16 16:56:13 crc kubenswrapper[5120]: I0316 16:56:13.909749 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-8706-account-create-update-7kshs"] Mar 16 16:56:13 crc kubenswrapper[5120]: I0316 16:56:13.926394 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-8706-account-create-update-7kshs" Mar 16 16:56:13 crc kubenswrapper[5120]: I0316 16:56:13.935268 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-db-secret\"" Mar 16 16:56:13 crc kubenswrapper[5120]: I0316 16:56:13.975457 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-8706-account-create-update-7kshs"] Mar 16 16:56:13 crc kubenswrapper[5120]: I0316 16:56:13.984385 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z59cr\" (UniqueName: \"kubernetes.io/projected/a51b0e1a-a3bb-498f-96e4-b1aa631e68c2-kube-api-access-z59cr\") pod \"cinder-db-create-r5jqt\" (UID: \"a51b0e1a-a3bb-498f-96e4-b1aa631e68c2\") " pod="openstack-kuttl-tests/cinder-db-create-r5jqt" Mar 16 16:56:13 crc kubenswrapper[5120]: I0316 16:56:13.984546 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a51b0e1a-a3bb-498f-96e4-b1aa631e68c2-operator-scripts\") pod \"cinder-db-create-r5jqt\" (UID: \"a51b0e1a-a3bb-498f-96e4-b1aa631e68c2\") " pod="openstack-kuttl-tests/cinder-db-create-r5jqt" Mar 16 16:56:13 crc kubenswrapper[5120]: I0316 16:56:13.982869 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-db-create-k56b6"] Mar 16 16:56:14 crc kubenswrapper[5120]: I0316 16:56:14.007197 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-db-create-k56b6"] Mar 16 16:56:14 crc kubenswrapper[5120]: I0316 16:56:14.007352 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-create-k56b6" Mar 16 16:56:14 crc kubenswrapper[5120]: I0316 16:56:14.099067 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ebbee40a-c6ba-4288-852d-acdc58f27e41-operator-scripts\") pod \"neutron-8706-account-create-update-7kshs\" (UID: \"ebbee40a-c6ba-4288-852d-acdc58f27e41\") " pod="openstack-kuttl-tests/neutron-8706-account-create-update-7kshs" Mar 16 16:56:14 crc kubenswrapper[5120]: I0316 16:56:14.099132 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z59cr\" (UniqueName: \"kubernetes.io/projected/a51b0e1a-a3bb-498f-96e4-b1aa631e68c2-kube-api-access-z59cr\") pod \"cinder-db-create-r5jqt\" (UID: \"a51b0e1a-a3bb-498f-96e4-b1aa631e68c2\") " pod="openstack-kuttl-tests/cinder-db-create-r5jqt" Mar 16 16:56:14 crc kubenswrapper[5120]: I0316 16:56:14.099163 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ngd9j\" (UniqueName: \"kubernetes.io/projected/ebbee40a-c6ba-4288-852d-acdc58f27e41-kube-api-access-ngd9j\") pod \"neutron-8706-account-create-update-7kshs\" (UID: \"ebbee40a-c6ba-4288-852d-acdc58f27e41\") " pod="openstack-kuttl-tests/neutron-8706-account-create-update-7kshs" Mar 16 16:56:14 crc kubenswrapper[5120]: I0316 16:56:14.099286 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/cb9960d8-4a8c-4a7e-88d5-de6c5e46e72f-operator-scripts\") pod \"neutron-db-create-k56b6\" (UID: \"cb9960d8-4a8c-4a7e-88d5-de6c5e46e72f\") " pod="openstack-kuttl-tests/neutron-db-create-k56b6" Mar 16 16:56:14 crc kubenswrapper[5120]: I0316 16:56:14.099346 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a51b0e1a-a3bb-498f-96e4-b1aa631e68c2-operator-scripts\") pod \"cinder-db-create-r5jqt\" (UID: \"a51b0e1a-a3bb-498f-96e4-b1aa631e68c2\") " pod="openstack-kuttl-tests/cinder-db-create-r5jqt" Mar 16 16:56:14 crc kubenswrapper[5120]: I0316 16:56:14.100119 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zv7k\" (UniqueName: \"kubernetes.io/projected/cb9960d8-4a8c-4a7e-88d5-de6c5e46e72f-kube-api-access-9zv7k\") pod \"neutron-db-create-k56b6\" (UID: \"cb9960d8-4a8c-4a7e-88d5-de6c5e46e72f\") " pod="openstack-kuttl-tests/neutron-db-create-k56b6" Mar 16 16:56:14 crc kubenswrapper[5120]: I0316 16:56:14.100222 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a51b0e1a-a3bb-498f-96e4-b1aa631e68c2-operator-scripts\") pod \"cinder-db-create-r5jqt\" (UID: \"a51b0e1a-a3bb-498f-96e4-b1aa631e68c2\") " pod="openstack-kuttl-tests/cinder-db-create-r5jqt" Mar 16 16:56:14 crc kubenswrapper[5120]: I0316 16:56:14.146286 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-db-create-95bsl"] Mar 16 16:56:14 crc kubenswrapper[5120]: I0316 16:56:14.147191 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z59cr\" (UniqueName: \"kubernetes.io/projected/a51b0e1a-a3bb-498f-96e4-b1aa631e68c2-kube-api-access-z59cr\") pod \"cinder-db-create-r5jqt\" (UID: \"a51b0e1a-a3bb-498f-96e4-b1aa631e68c2\") " pod="openstack-kuttl-tests/cinder-db-create-r5jqt" Mar 16 16:56:14 crc kubenswrapper[5120]: I0316 16:56:14.155423 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-create-95bsl" Mar 16 16:56:14 crc kubenswrapper[5120]: I0316 16:56:14.167913 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-4aec-account-create-update-qxxcv"] Mar 16 16:56:14 crc kubenswrapper[5120]: I0316 16:56:14.179377 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-4aec-account-create-update-qxxcv" Mar 16 16:56:14 crc kubenswrapper[5120]: I0316 16:56:14.186823 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-db-create-95bsl"] Mar 16 16:56:14 crc kubenswrapper[5120]: I0316 16:56:14.191052 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-db-secret\"" Mar 16 16:56:14 crc kubenswrapper[5120]: I0316 16:56:14.202828 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9zv7k\" (UniqueName: \"kubernetes.io/projected/cb9960d8-4a8c-4a7e-88d5-de6c5e46e72f-kube-api-access-9zv7k\") pod \"neutron-db-create-k56b6\" (UID: \"cb9960d8-4a8c-4a7e-88d5-de6c5e46e72f\") " pod="openstack-kuttl-tests/neutron-db-create-k56b6" Mar 16 16:56:14 crc kubenswrapper[5120]: I0316 16:56:14.202998 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ebbee40a-c6ba-4288-852d-acdc58f27e41-operator-scripts\") pod \"neutron-8706-account-create-update-7kshs\" (UID: \"ebbee40a-c6ba-4288-852d-acdc58f27e41\") " pod="openstack-kuttl-tests/neutron-8706-account-create-update-7kshs" Mar 16 16:56:14 crc kubenswrapper[5120]: I0316 16:56:14.203032 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ngd9j\" (UniqueName: \"kubernetes.io/projected/ebbee40a-c6ba-4288-852d-acdc58f27e41-kube-api-access-ngd9j\") pod \"neutron-8706-account-create-update-7kshs\" (UID: \"ebbee40a-c6ba-4288-852d-acdc58f27e41\") " pod="openstack-kuttl-tests/neutron-8706-account-create-update-7kshs" Mar 16 16:56:14 crc kubenswrapper[5120]: I0316 16:56:14.203105 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/cb9960d8-4a8c-4a7e-88d5-de6c5e46e72f-operator-scripts\") pod \"neutron-db-create-k56b6\" (UID: \"cb9960d8-4a8c-4a7e-88d5-de6c5e46e72f\") " pod="openstack-kuttl-tests/neutron-db-create-k56b6" Mar 16 16:56:14 crc kubenswrapper[5120]: I0316 16:56:14.203895 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ebbee40a-c6ba-4288-852d-acdc58f27e41-operator-scripts\") pod \"neutron-8706-account-create-update-7kshs\" (UID: \"ebbee40a-c6ba-4288-852d-acdc58f27e41\") " pod="openstack-kuttl-tests/neutron-8706-account-create-update-7kshs" Mar 16 16:56:14 crc kubenswrapper[5120]: I0316 16:56:14.204303 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/cb9960d8-4a8c-4a7e-88d5-de6c5e46e72f-operator-scripts\") pod \"neutron-db-create-k56b6\" (UID: \"cb9960d8-4a8c-4a7e-88d5-de6c5e46e72f\") " pod="openstack-kuttl-tests/neutron-db-create-k56b6" Mar 16 16:56:14 crc kubenswrapper[5120]: I0316 16:56:14.212408 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-create-r5jqt" Mar 16 16:56:14 crc kubenswrapper[5120]: I0316 16:56:14.224170 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-4aec-account-create-update-qxxcv"] Mar 16 16:56:14 crc kubenswrapper[5120]: I0316 16:56:14.231995 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-9d545" Mar 16 16:56:14 crc kubenswrapper[5120]: I0316 16:56:14.236277 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zv7k\" (UniqueName: \"kubernetes.io/projected/cb9960d8-4a8c-4a7e-88d5-de6c5e46e72f-kube-api-access-9zv7k\") pod \"neutron-db-create-k56b6\" (UID: \"cb9960d8-4a8c-4a7e-88d5-de6c5e46e72f\") " pod="openstack-kuttl-tests/neutron-db-create-k56b6" Mar 16 16:56:14 crc kubenswrapper[5120]: I0316 16:56:14.238402 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ngd9j\" (UniqueName: \"kubernetes.io/projected/ebbee40a-c6ba-4288-852d-acdc58f27e41-kube-api-access-ngd9j\") pod \"neutron-8706-account-create-update-7kshs\" (UID: \"ebbee40a-c6ba-4288-852d-acdc58f27e41\") " pod="openstack-kuttl-tests/neutron-8706-account-create-update-7kshs" Mar 16 16:56:14 crc kubenswrapper[5120]: I0316 16:56:14.268051 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-8706-account-create-update-7kshs" Mar 16 16:56:14 crc kubenswrapper[5120]: I0316 16:56:14.277511 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-8mvwt"] Mar 16 16:56:14 crc kubenswrapper[5120]: I0316 16:56:14.278751 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f95e292-0325-47f3-9767-d77bcc9e5884" containerName="dnsmasq-dns" Mar 16 16:56:14 crc kubenswrapper[5120]: I0316 16:56:14.278787 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f95e292-0325-47f3-9767-d77bcc9e5884" containerName="dnsmasq-dns" Mar 16 16:56:14 crc kubenswrapper[5120]: I0316 16:56:14.278818 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f95e292-0325-47f3-9767-d77bcc9e5884" containerName="init" Mar 16 16:56:14 crc kubenswrapper[5120]: I0316 16:56:14.278825 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f95e292-0325-47f3-9767-d77bcc9e5884" containerName="init" Mar 16 16:56:14 crc kubenswrapper[5120]: I0316 16:56:14.278993 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="0f95e292-0325-47f3-9767-d77bcc9e5884" containerName="dnsmasq-dns" Mar 16 16:56:14 crc kubenswrapper[5120]: I0316 16:56:14.292315 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 16:56:14 crc kubenswrapper[5120]: I0316 16:56:14.293147 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-8mvwt" Mar 16 16:56:14 crc kubenswrapper[5120]: I0316 16:56:14.301523 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-keystone-dockercfg-5mpsq\"" Mar 16 16:56:14 crc kubenswrapper[5120]: I0316 16:56:14.301865 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-scripts\"" Mar 16 16:56:14 crc kubenswrapper[5120]: I0316 16:56:14.301893 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-config-data\"" Mar 16 16:56:14 crc kubenswrapper[5120]: I0316 16:56:14.301930 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-8mvwt"] Mar 16 16:56:14 crc kubenswrapper[5120]: I0316 16:56:14.303132 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone\"" Mar 16 16:56:14 crc kubenswrapper[5120]: I0316 16:56:14.304474 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88r9k\" (UniqueName: \"kubernetes.io/projected/72db1931-19ed-4989-bf2b-01fca6434989-kube-api-access-88r9k\") pod \"cinder-4aec-account-create-update-qxxcv\" (UID: \"72db1931-19ed-4989-bf2b-01fca6434989\") " pod="openstack-kuttl-tests/cinder-4aec-account-create-update-qxxcv" Mar 16 16:56:14 crc kubenswrapper[5120]: I0316 16:56:14.305880 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5w88q\" (UniqueName: \"kubernetes.io/projected/33aaf037-e50b-4983-94bd-46874d5aa9db-kube-api-access-5w88q\") pod \"barbican-db-create-95bsl\" (UID: \"33aaf037-e50b-4983-94bd-46874d5aa9db\") " pod="openstack-kuttl-tests/barbican-db-create-95bsl" Mar 16 16:56:14 crc kubenswrapper[5120]: I0316 16:56:14.305996 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/72db1931-19ed-4989-bf2b-01fca6434989-operator-scripts\") pod \"cinder-4aec-account-create-update-qxxcv\" (UID: \"72db1931-19ed-4989-bf2b-01fca6434989\") " pod="openstack-kuttl-tests/cinder-4aec-account-create-update-qxxcv" Mar 16 16:56:14 crc kubenswrapper[5120]: I0316 16:56:14.306338 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/33aaf037-e50b-4983-94bd-46874d5aa9db-operator-scripts\") pod \"barbican-db-create-95bsl\" (UID: \"33aaf037-e50b-4983-94bd-46874d5aa9db\") " pod="openstack-kuttl-tests/barbican-db-create-95bsl" Mar 16 16:56:14 crc kubenswrapper[5120]: I0316 16:56:14.325901 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-create-k56b6" Mar 16 16:56:14 crc kubenswrapper[5120]: I0316 16:56:14.412449 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/0f95e292-0325-47f3-9767-d77bcc9e5884-dnsmasq-svc\") pod \"0f95e292-0325-47f3-9767-d77bcc9e5884\" (UID: \"0f95e292-0325-47f3-9767-d77bcc9e5884\") " Mar 16 16:56:14 crc kubenswrapper[5120]: I0316 16:56:14.412986 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5bgks\" (UniqueName: \"kubernetes.io/projected/0f95e292-0325-47f3-9767-d77bcc9e5884-kube-api-access-5bgks\") pod \"0f95e292-0325-47f3-9767-d77bcc9e5884\" (UID: \"0f95e292-0325-47f3-9767-d77bcc9e5884\") " Mar 16 16:56:14 crc kubenswrapper[5120]: I0316 16:56:14.413109 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0f95e292-0325-47f3-9767-d77bcc9e5884-config\") pod \"0f95e292-0325-47f3-9767-d77bcc9e5884\" (UID: \"0f95e292-0325-47f3-9767-d77bcc9e5884\") " Mar 16 16:56:14 crc kubenswrapper[5120]: I0316 16:56:14.413862 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-88r9k\" (UniqueName: \"kubernetes.io/projected/72db1931-19ed-4989-bf2b-01fca6434989-kube-api-access-88r9k\") pod \"cinder-4aec-account-create-update-qxxcv\" (UID: \"72db1931-19ed-4989-bf2b-01fca6434989\") " pod="openstack-kuttl-tests/cinder-4aec-account-create-update-qxxcv" Mar 16 16:56:14 crc kubenswrapper[5120]: I0316 16:56:14.413934 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5w88q\" (UniqueName: \"kubernetes.io/projected/33aaf037-e50b-4983-94bd-46874d5aa9db-kube-api-access-5w88q\") pod \"barbican-db-create-95bsl\" (UID: \"33aaf037-e50b-4983-94bd-46874d5aa9db\") " pod="openstack-kuttl-tests/barbican-db-create-95bsl" Mar 16 16:56:14 crc kubenswrapper[5120]: I0316 16:56:14.414004 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/72db1931-19ed-4989-bf2b-01fca6434989-operator-scripts\") pod \"cinder-4aec-account-create-update-qxxcv\" (UID: \"72db1931-19ed-4989-bf2b-01fca6434989\") " pod="openstack-kuttl-tests/cinder-4aec-account-create-update-qxxcv" Mar 16 16:56:14 crc kubenswrapper[5120]: I0316 16:56:14.414126 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6z6r2\" (UniqueName: \"kubernetes.io/projected/9cc0093b-f3a8-45cc-8df7-9d0ae312c41e-kube-api-access-6z6r2\") pod \"keystone-db-sync-8mvwt\" (UID: \"9cc0093b-f3a8-45cc-8df7-9d0ae312c41e\") " pod="openstack-kuttl-tests/keystone-db-sync-8mvwt" Mar 16 16:56:14 crc kubenswrapper[5120]: I0316 16:56:14.414211 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9cc0093b-f3a8-45cc-8df7-9d0ae312c41e-config-data\") pod \"keystone-db-sync-8mvwt\" (UID: \"9cc0093b-f3a8-45cc-8df7-9d0ae312c41e\") " pod="openstack-kuttl-tests/keystone-db-sync-8mvwt" Mar 16 16:56:14 crc kubenswrapper[5120]: I0316 16:56:14.414267 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9cc0093b-f3a8-45cc-8df7-9d0ae312c41e-combined-ca-bundle\") pod \"keystone-db-sync-8mvwt\" (UID: \"9cc0093b-f3a8-45cc-8df7-9d0ae312c41e\") " pod="openstack-kuttl-tests/keystone-db-sync-8mvwt" Mar 16 16:56:14 crc kubenswrapper[5120]: I0316 16:56:14.414344 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/33aaf037-e50b-4983-94bd-46874d5aa9db-operator-scripts\") pod \"barbican-db-create-95bsl\" (UID: \"33aaf037-e50b-4983-94bd-46874d5aa9db\") " pod="openstack-kuttl-tests/barbican-db-create-95bsl" Mar 16 16:56:14 crc kubenswrapper[5120]: I0316 16:56:14.421513 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/72db1931-19ed-4989-bf2b-01fca6434989-operator-scripts\") pod \"cinder-4aec-account-create-update-qxxcv\" (UID: \"72db1931-19ed-4989-bf2b-01fca6434989\") " pod="openstack-kuttl-tests/cinder-4aec-account-create-update-qxxcv" Mar 16 16:56:14 crc kubenswrapper[5120]: I0316 16:56:14.423410 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-cd46-account-create-update-9454l"] Mar 16 16:56:14 crc kubenswrapper[5120]: I0316 16:56:14.435497 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f95e292-0325-47f3-9767-d77bcc9e5884-kube-api-access-5bgks" (OuterVolumeSpecName: "kube-api-access-5bgks") pod "0f95e292-0325-47f3-9767-d77bcc9e5884" (UID: "0f95e292-0325-47f3-9767-d77bcc9e5884"). InnerVolumeSpecName "kube-api-access-5bgks". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:56:14 crc kubenswrapper[5120]: I0316 16:56:14.438695 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/33aaf037-e50b-4983-94bd-46874d5aa9db-operator-scripts\") pod \"barbican-db-create-95bsl\" (UID: \"33aaf037-e50b-4983-94bd-46874d5aa9db\") " pod="openstack-kuttl-tests/barbican-db-create-95bsl" Mar 16 16:56:14 crc kubenswrapper[5120]: I0316 16:56:14.466330 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-cd46-account-create-update-9454l"] Mar 16 16:56:14 crc kubenswrapper[5120]: I0316 16:56:14.466556 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-cd46-account-create-update-9454l" Mar 16 16:56:14 crc kubenswrapper[5120]: I0316 16:56:14.471895 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-db-secret\"" Mar 16 16:56:14 crc kubenswrapper[5120]: I0316 16:56:14.478634 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-88r9k\" (UniqueName: \"kubernetes.io/projected/72db1931-19ed-4989-bf2b-01fca6434989-kube-api-access-88r9k\") pod \"cinder-4aec-account-create-update-qxxcv\" (UID: \"72db1931-19ed-4989-bf2b-01fca6434989\") " pod="openstack-kuttl-tests/cinder-4aec-account-create-update-qxxcv" Mar 16 16:56:14 crc kubenswrapper[5120]: I0316 16:56:14.480586 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5w88q\" (UniqueName: \"kubernetes.io/projected/33aaf037-e50b-4983-94bd-46874d5aa9db-kube-api-access-5w88q\") pod \"barbican-db-create-95bsl\" (UID: \"33aaf037-e50b-4983-94bd-46874d5aa9db\") " pod="openstack-kuttl-tests/barbican-db-create-95bsl" Mar 16 16:56:14 crc kubenswrapper[5120]: I0316 16:56:14.505246 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f95e292-0325-47f3-9767-d77bcc9e5884-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "0f95e292-0325-47f3-9767-d77bcc9e5884" (UID: "0f95e292-0325-47f3-9767-d77bcc9e5884"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:56:14 crc kubenswrapper[5120]: I0316 16:56:14.556587 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f95e292-0325-47f3-9767-d77bcc9e5884-config" (OuterVolumeSpecName: "config") pod "0f95e292-0325-47f3-9767-d77bcc9e5884" (UID: "0f95e292-0325-47f3-9767-d77bcc9e5884"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:56:14 crc kubenswrapper[5120]: I0316 16:56:14.566954 5120 generic.go:358] "Generic (PLEG): container finished" podID="0f95e292-0325-47f3-9767-d77bcc9e5884" containerID="2aa1d440c20b1b3d572806485b0a43f3ac8ae34407b490f95faccd65488bfd65" exitCode=0 Mar 16 16:56:14 crc kubenswrapper[5120]: I0316 16:56:14.567054 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-9d545" event={"ID":"0f95e292-0325-47f3-9767-d77bcc9e5884","Type":"ContainerDied","Data":"2aa1d440c20b1b3d572806485b0a43f3ac8ae34407b490f95faccd65488bfd65"} Mar 16 16:56:14 crc kubenswrapper[5120]: I0316 16:56:14.567094 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-9d545" event={"ID":"0f95e292-0325-47f3-9767-d77bcc9e5884","Type":"ContainerDied","Data":"29a317e146617038837cf27828daf48f025cc7140c8865314b54a7fe0c0ada40"} Mar 16 16:56:14 crc kubenswrapper[5120]: I0316 16:56:14.567113 5120 scope.go:117] "RemoveContainer" containerID="2aa1d440c20b1b3d572806485b0a43f3ac8ae34407b490f95faccd65488bfd65" Mar 16 16:56:14 crc kubenswrapper[5120]: I0316 16:56:14.567297 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-9d545" Mar 16 16:56:14 crc kubenswrapper[5120]: I0316 16:56:14.573144 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0f95e292-0325-47f3-9767-d77bcc9e5884-config\") pod \"0f95e292-0325-47f3-9767-d77bcc9e5884\" (UID: \"0f95e292-0325-47f3-9767-d77bcc9e5884\") " Mar 16 16:56:14 crc kubenswrapper[5120]: I0316 16:56:14.573812 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6z6r2\" (UniqueName: \"kubernetes.io/projected/9cc0093b-f3a8-45cc-8df7-9d0ae312c41e-kube-api-access-6z6r2\") pod \"keystone-db-sync-8mvwt\" (UID: \"9cc0093b-f3a8-45cc-8df7-9d0ae312c41e\") " pod="openstack-kuttl-tests/keystone-db-sync-8mvwt" Mar 16 16:56:14 crc kubenswrapper[5120]: I0316 16:56:14.573913 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9cc0093b-f3a8-45cc-8df7-9d0ae312c41e-config-data\") pod \"keystone-db-sync-8mvwt\" (UID: \"9cc0093b-f3a8-45cc-8df7-9d0ae312c41e\") " pod="openstack-kuttl-tests/keystone-db-sync-8mvwt" Mar 16 16:56:14 crc kubenswrapper[5120]: I0316 16:56:14.573954 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9cc0093b-f3a8-45cc-8df7-9d0ae312c41e-combined-ca-bundle\") pod \"keystone-db-sync-8mvwt\" (UID: \"9cc0093b-f3a8-45cc-8df7-9d0ae312c41e\") " pod="openstack-kuttl-tests/keystone-db-sync-8mvwt" Mar 16 16:56:14 crc kubenswrapper[5120]: I0316 16:56:14.574106 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5bgks\" (UniqueName: \"kubernetes.io/projected/0f95e292-0325-47f3-9767-d77bcc9e5884-kube-api-access-5bgks\") on node \"crc\" DevicePath \"\"" Mar 16 16:56:14 crc kubenswrapper[5120]: I0316 16:56:14.574121 5120 reconciler_common.go:299] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/0f95e292-0325-47f3-9767-d77bcc9e5884-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Mar 16 16:56:14 crc kubenswrapper[5120]: W0316 16:56:14.578929 5120 empty_dir.go:511] Warning: Unmount skipped because path does not exist: /var/lib/kubelet/pods/0f95e292-0325-47f3-9767-d77bcc9e5884/volumes/kubernetes.io~configmap/config Mar 16 16:56:14 crc kubenswrapper[5120]: I0316 16:56:14.578952 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f95e292-0325-47f3-9767-d77bcc9e5884-config" (OuterVolumeSpecName: "config") pod "0f95e292-0325-47f3-9767-d77bcc9e5884" (UID: "0f95e292-0325-47f3-9767-d77bcc9e5884"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:56:14 crc kubenswrapper[5120]: I0316 16:56:14.581412 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-create-95bsl" Mar 16 16:56:14 crc kubenswrapper[5120]: I0316 16:56:14.588487 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9cc0093b-f3a8-45cc-8df7-9d0ae312c41e-combined-ca-bundle\") pod \"keystone-db-sync-8mvwt\" (UID: \"9cc0093b-f3a8-45cc-8df7-9d0ae312c41e\") " pod="openstack-kuttl-tests/keystone-db-sync-8mvwt" Mar 16 16:56:14 crc kubenswrapper[5120]: I0316 16:56:14.596022 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9cc0093b-f3a8-45cc-8df7-9d0ae312c41e-config-data\") pod \"keystone-db-sync-8mvwt\" (UID: \"9cc0093b-f3a8-45cc-8df7-9d0ae312c41e\") " pod="openstack-kuttl-tests/keystone-db-sync-8mvwt" Mar 16 16:56:14 crc kubenswrapper[5120]: I0316 16:56:14.605487 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6z6r2\" (UniqueName: \"kubernetes.io/projected/9cc0093b-f3a8-45cc-8df7-9d0ae312c41e-kube-api-access-6z6r2\") pod \"keystone-db-sync-8mvwt\" (UID: \"9cc0093b-f3a8-45cc-8df7-9d0ae312c41e\") " pod="openstack-kuttl-tests/keystone-db-sync-8mvwt" Mar 16 16:56:14 crc kubenswrapper[5120]: I0316 16:56:14.612840 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-4aec-account-create-update-qxxcv" Mar 16 16:56:14 crc kubenswrapper[5120]: I0316 16:56:14.658073 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-8mvwt" Mar 16 16:56:14 crc kubenswrapper[5120]: I0316 16:56:14.676667 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a4d34b4f-907c-4c67-a386-73e726afa874-operator-scripts\") pod \"barbican-cd46-account-create-update-9454l\" (UID: \"a4d34b4f-907c-4c67-a386-73e726afa874\") " pod="openstack-kuttl-tests/barbican-cd46-account-create-update-9454l" Mar 16 16:56:14 crc kubenswrapper[5120]: I0316 16:56:14.676812 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwzdl\" (UniqueName: \"kubernetes.io/projected/a4d34b4f-907c-4c67-a386-73e726afa874-kube-api-access-wwzdl\") pod \"barbican-cd46-account-create-update-9454l\" (UID: \"a4d34b4f-907c-4c67-a386-73e726afa874\") " pod="openstack-kuttl-tests/barbican-cd46-account-create-update-9454l" Mar 16 16:56:14 crc kubenswrapper[5120]: I0316 16:56:14.677031 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0f95e292-0325-47f3-9767-d77bcc9e5884-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:56:14 crc kubenswrapper[5120]: I0316 16:56:14.712411 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-db-create-r5jqt"] Mar 16 16:56:14 crc kubenswrapper[5120]: I0316 16:56:14.779063 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a4d34b4f-907c-4c67-a386-73e726afa874-operator-scripts\") pod \"barbican-cd46-account-create-update-9454l\" (UID: \"a4d34b4f-907c-4c67-a386-73e726afa874\") " pod="openstack-kuttl-tests/barbican-cd46-account-create-update-9454l" Mar 16 16:56:14 crc kubenswrapper[5120]: I0316 16:56:14.779514 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wwzdl\" (UniqueName: \"kubernetes.io/projected/a4d34b4f-907c-4c67-a386-73e726afa874-kube-api-access-wwzdl\") pod \"barbican-cd46-account-create-update-9454l\" (UID: \"a4d34b4f-907c-4c67-a386-73e726afa874\") " pod="openstack-kuttl-tests/barbican-cd46-account-create-update-9454l" Mar 16 16:56:14 crc kubenswrapper[5120]: I0316 16:56:14.783141 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a4d34b4f-907c-4c67-a386-73e726afa874-operator-scripts\") pod \"barbican-cd46-account-create-update-9454l\" (UID: \"a4d34b4f-907c-4c67-a386-73e726afa874\") " pod="openstack-kuttl-tests/barbican-cd46-account-create-update-9454l" Mar 16 16:56:14 crc kubenswrapper[5120]: I0316 16:56:14.793549 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-9d545"] Mar 16 16:56:14 crc kubenswrapper[5120]: I0316 16:56:14.802540 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-9d545"] Mar 16 16:56:14 crc kubenswrapper[5120]: I0316 16:56:14.814803 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwzdl\" (UniqueName: \"kubernetes.io/projected/a4d34b4f-907c-4c67-a386-73e726afa874-kube-api-access-wwzdl\") pod \"barbican-cd46-account-create-update-9454l\" (UID: \"a4d34b4f-907c-4c67-a386-73e726afa874\") " pod="openstack-kuttl-tests/barbican-cd46-account-create-update-9454l" Mar 16 16:56:14 crc kubenswrapper[5120]: I0316 16:56:14.880618 5120 scope.go:117] "RemoveContainer" containerID="e089c113303c2d6e6711ace9a77290eb103a9e8b3166cbb484b15747ac6bed8a" Mar 16 16:56:14 crc kubenswrapper[5120]: I0316 16:56:14.926265 5120 scope.go:117] "RemoveContainer" containerID="2aa1d440c20b1b3d572806485b0a43f3ac8ae34407b490f95faccd65488bfd65" Mar 16 16:56:14 crc kubenswrapper[5120]: E0316 16:56:14.926815 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2aa1d440c20b1b3d572806485b0a43f3ac8ae34407b490f95faccd65488bfd65\": container with ID starting with 2aa1d440c20b1b3d572806485b0a43f3ac8ae34407b490f95faccd65488bfd65 not found: ID does not exist" containerID="2aa1d440c20b1b3d572806485b0a43f3ac8ae34407b490f95faccd65488bfd65" Mar 16 16:56:14 crc kubenswrapper[5120]: I0316 16:56:14.926885 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2aa1d440c20b1b3d572806485b0a43f3ac8ae34407b490f95faccd65488bfd65"} err="failed to get container status \"2aa1d440c20b1b3d572806485b0a43f3ac8ae34407b490f95faccd65488bfd65\": rpc error: code = NotFound desc = could not find container \"2aa1d440c20b1b3d572806485b0a43f3ac8ae34407b490f95faccd65488bfd65\": container with ID starting with 2aa1d440c20b1b3d572806485b0a43f3ac8ae34407b490f95faccd65488bfd65 not found: ID does not exist" Mar 16 16:56:14 crc kubenswrapper[5120]: I0316 16:56:14.926913 5120 scope.go:117] "RemoveContainer" containerID="e089c113303c2d6e6711ace9a77290eb103a9e8b3166cbb484b15747ac6bed8a" Mar 16 16:56:14 crc kubenswrapper[5120]: E0316 16:56:14.927338 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e089c113303c2d6e6711ace9a77290eb103a9e8b3166cbb484b15747ac6bed8a\": container with ID starting with e089c113303c2d6e6711ace9a77290eb103a9e8b3166cbb484b15747ac6bed8a not found: ID does not exist" containerID="e089c113303c2d6e6711ace9a77290eb103a9e8b3166cbb484b15747ac6bed8a" Mar 16 16:56:14 crc kubenswrapper[5120]: I0316 16:56:14.927409 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e089c113303c2d6e6711ace9a77290eb103a9e8b3166cbb484b15747ac6bed8a"} err="failed to get container status \"e089c113303c2d6e6711ace9a77290eb103a9e8b3166cbb484b15747ac6bed8a\": rpc error: code = NotFound desc = could not find container \"e089c113303c2d6e6711ace9a77290eb103a9e8b3166cbb484b15747ac6bed8a\": container with ID starting with e089c113303c2d6e6711ace9a77290eb103a9e8b3166cbb484b15747ac6bed8a not found: ID does not exist" Mar 16 16:56:15 crc kubenswrapper[5120]: I0316 16:56:15.000145 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-8706-account-create-update-7kshs"] Mar 16 16:56:15 crc kubenswrapper[5120]: I0316 16:56:15.090224 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-db-create-k56b6"] Mar 16 16:56:15 crc kubenswrapper[5120]: I0316 16:56:15.093976 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-cd46-account-create-update-9454l" Mar 16 16:56:15 crc kubenswrapper[5120]: W0316 16:56:15.103557 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcb9960d8_4a8c_4a7e_88d5_de6c5e46e72f.slice/crio-1b3e3de6951f9dda0987148cbccf428edf1d93519de663db0c5203648a45e5af WatchSource:0}: Error finding container 1b3e3de6951f9dda0987148cbccf428edf1d93519de663db0c5203648a45e5af: Status 404 returned error can't find the container with id 1b3e3de6951f9dda0987148cbccf428edf1d93519de663db0c5203648a45e5af Mar 16 16:56:15 crc kubenswrapper[5120]: I0316 16:56:15.274990 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-db-create-95bsl"] Mar 16 16:56:15 crc kubenswrapper[5120]: W0316 16:56:15.300302 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod33aaf037_e50b_4983_94bd_46874d5aa9db.slice/crio-9e2d91674df785ab6ca3efb058ff7eb825b59da0ad5207510f052dd7b9fb0a74 WatchSource:0}: Error finding container 9e2d91674df785ab6ca3efb058ff7eb825b59da0ad5207510f052dd7b9fb0a74: Status 404 returned error can't find the container with id 9e2d91674df785ab6ca3efb058ff7eb825b59da0ad5207510f052dd7b9fb0a74 Mar 16 16:56:15 crc kubenswrapper[5120]: I0316 16:56:15.366091 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-8mvwt"] Mar 16 16:56:15 crc kubenswrapper[5120]: W0316 16:56:15.384115 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod72db1931_19ed_4989_bf2b_01fca6434989.slice/crio-2ac6efd97819e29a3f4f6f4873bd07b735a55a95ba5b2e1135c144070aebcd72 WatchSource:0}: Error finding container 2ac6efd97819e29a3f4f6f4873bd07b735a55a95ba5b2e1135c144070aebcd72: Status 404 returned error can't find the container with id 2ac6efd97819e29a3f4f6f4873bd07b735a55a95ba5b2e1135c144070aebcd72 Mar 16 16:56:15 crc kubenswrapper[5120]: I0316 16:56:15.401943 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-4aec-account-create-update-qxxcv"] Mar 16 16:56:15 crc kubenswrapper[5120]: I0316 16:56:15.509598 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-operators-7mhml"] Mar 16 16:56:15 crc kubenswrapper[5120]: I0316 16:56:15.535255 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-7mhml"] Mar 16 16:56:15 crc kubenswrapper[5120]: I0316 16:56:15.535408 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-7mhml" Mar 16 16:56:15 crc kubenswrapper[5120]: I0316 16:56:15.614508 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-8mvwt" event={"ID":"9cc0093b-f3a8-45cc-8df7-9d0ae312c41e","Type":"ContainerStarted","Data":"35108531e185b5b5690c6f250e1a7e52196d269047cd50373277014913f5dfda"} Mar 16 16:56:15 crc kubenswrapper[5120]: I0316 16:56:15.619951 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-8706-account-create-update-7kshs" event={"ID":"ebbee40a-c6ba-4288-852d-acdc58f27e41","Type":"ContainerStarted","Data":"d68fde987d845f07c8612dff8547b520bbcb4c17c138b2e4f5426a89fc2faaf5"} Mar 16 16:56:15 crc kubenswrapper[5120]: I0316 16:56:15.620005 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-8706-account-create-update-7kshs" event={"ID":"ebbee40a-c6ba-4288-852d-acdc58f27e41","Type":"ContainerStarted","Data":"24d4ffd3693f5aa9c393c2a9ebb8c5f3e552677a5d6be222f40a2ea88d3564e2"} Mar 16 16:56:15 crc kubenswrapper[5120]: I0316 16:56:15.621518 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-create-k56b6" event={"ID":"cb9960d8-4a8c-4a7e-88d5-de6c5e46e72f","Type":"ContainerStarted","Data":"1b3e3de6951f9dda0987148cbccf428edf1d93519de663db0c5203648a45e5af"} Mar 16 16:56:15 crc kubenswrapper[5120]: I0316 16:56:15.622952 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-create-95bsl" event={"ID":"33aaf037-e50b-4983-94bd-46874d5aa9db","Type":"ContainerStarted","Data":"9e2d91674df785ab6ca3efb058ff7eb825b59da0ad5207510f052dd7b9fb0a74"} Mar 16 16:56:15 crc kubenswrapper[5120]: I0316 16:56:15.624198 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-4aec-account-create-update-qxxcv" event={"ID":"72db1931-19ed-4989-bf2b-01fca6434989","Type":"ContainerStarted","Data":"2ac6efd97819e29a3f4f6f4873bd07b735a55a95ba5b2e1135c144070aebcd72"} Mar 16 16:56:15 crc kubenswrapper[5120]: I0316 16:56:15.626568 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-create-r5jqt" event={"ID":"a51b0e1a-a3bb-498f-96e4-b1aa631e68c2","Type":"ContainerStarted","Data":"83be31383715b564797084ccaaeed9a369f6e39621cebb5bc24a90110996ed25"} Mar 16 16:56:15 crc kubenswrapper[5120]: I0316 16:56:15.626599 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-create-r5jqt" event={"ID":"a51b0e1a-a3bb-498f-96e4-b1aa631e68c2","Type":"ContainerStarted","Data":"162adca6bc76a527f399cbff888fba987db09c8c2742995c15aeed518a8f3157"} Mar 16 16:56:15 crc kubenswrapper[5120]: I0316 16:56:15.662388 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-8706-account-create-update-7kshs" podStartSLOduration=2.6623618860000002 podStartE2EDuration="2.662361886s" podCreationTimestamp="2026-03-16 16:56:13 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:56:15.652241408 +0000 UTC m=+5077.806173065" watchObservedRunningTime="2026-03-16 16:56:15.662361886 +0000 UTC m=+5077.816293543" Mar 16 16:56:15 crc kubenswrapper[5120]: I0316 16:56:15.706612 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/3209b0ef-38f4-4ab3-9594-6f4c18d592ec-utilities\") pod \"redhat-operators-7mhml\" (UID: \"3209b0ef-38f4-4ab3-9594-6f4c18d592ec\") " pod="openshift-marketplace/redhat-operators-7mhml" Mar 16 16:56:15 crc kubenswrapper[5120]: I0316 16:56:15.706667 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/3209b0ef-38f4-4ab3-9594-6f4c18d592ec-catalog-content\") pod \"redhat-operators-7mhml\" (UID: \"3209b0ef-38f4-4ab3-9594-6f4c18d592ec\") " pod="openshift-marketplace/redhat-operators-7mhml" Mar 16 16:56:15 crc kubenswrapper[5120]: I0316 16:56:15.707466 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4tcv5\" (UniqueName: \"kubernetes.io/projected/3209b0ef-38f4-4ab3-9594-6f4c18d592ec-kube-api-access-4tcv5\") pod \"redhat-operators-7mhml\" (UID: \"3209b0ef-38f4-4ab3-9594-6f4c18d592ec\") " pod="openshift-marketplace/redhat-operators-7mhml" Mar 16 16:56:15 crc kubenswrapper[5120]: I0316 16:56:15.782472 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-cd46-account-create-update-9454l"] Mar 16 16:56:15 crc kubenswrapper[5120]: I0316 16:56:15.810182 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/3209b0ef-38f4-4ab3-9594-6f4c18d592ec-utilities\") pod \"redhat-operators-7mhml\" (UID: \"3209b0ef-38f4-4ab3-9594-6f4c18d592ec\") " pod="openshift-marketplace/redhat-operators-7mhml" Mar 16 16:56:15 crc kubenswrapper[5120]: I0316 16:56:15.810222 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/3209b0ef-38f4-4ab3-9594-6f4c18d592ec-catalog-content\") pod \"redhat-operators-7mhml\" (UID: \"3209b0ef-38f4-4ab3-9594-6f4c18d592ec\") " pod="openshift-marketplace/redhat-operators-7mhml" Mar 16 16:56:15 crc kubenswrapper[5120]: I0316 16:56:15.810399 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4tcv5\" (UniqueName: \"kubernetes.io/projected/3209b0ef-38f4-4ab3-9594-6f4c18d592ec-kube-api-access-4tcv5\") pod \"redhat-operators-7mhml\" (UID: \"3209b0ef-38f4-4ab3-9594-6f4c18d592ec\") " pod="openshift-marketplace/redhat-operators-7mhml" Mar 16 16:56:15 crc kubenswrapper[5120]: I0316 16:56:15.811552 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/3209b0ef-38f4-4ab3-9594-6f4c18d592ec-utilities\") pod \"redhat-operators-7mhml\" (UID: \"3209b0ef-38f4-4ab3-9594-6f4c18d592ec\") " pod="openshift-marketplace/redhat-operators-7mhml" Mar 16 16:56:15 crc kubenswrapper[5120]: I0316 16:56:15.811885 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/3209b0ef-38f4-4ab3-9594-6f4c18d592ec-catalog-content\") pod \"redhat-operators-7mhml\" (UID: \"3209b0ef-38f4-4ab3-9594-6f4c18d592ec\") " pod="openshift-marketplace/redhat-operators-7mhml" Mar 16 16:56:15 crc kubenswrapper[5120]: I0316 16:56:15.832946 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4tcv5\" (UniqueName: \"kubernetes.io/projected/3209b0ef-38f4-4ab3-9594-6f4c18d592ec-kube-api-access-4tcv5\") pod \"redhat-operators-7mhml\" (UID: \"3209b0ef-38f4-4ab3-9594-6f4c18d592ec\") " pod="openshift-marketplace/redhat-operators-7mhml" Mar 16 16:56:16 crc kubenswrapper[5120]: I0316 16:56:16.025033 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-7mhml" Mar 16 16:56:16 crc kubenswrapper[5120]: I0316 16:56:16.344485 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-7mhml"] Mar 16 16:56:16 crc kubenswrapper[5120]: I0316 16:56:16.651467 5120 generic.go:358] "Generic (PLEG): container finished" podID="a51b0e1a-a3bb-498f-96e4-b1aa631e68c2" containerID="83be31383715b564797084ccaaeed9a369f6e39621cebb5bc24a90110996ed25" exitCode=0 Mar 16 16:56:16 crc kubenswrapper[5120]: I0316 16:56:16.652063 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-create-r5jqt" event={"ID":"a51b0e1a-a3bb-498f-96e4-b1aa631e68c2","Type":"ContainerDied","Data":"83be31383715b564797084ccaaeed9a369f6e39621cebb5bc24a90110996ed25"} Mar 16 16:56:16 crc kubenswrapper[5120]: I0316 16:56:16.655202 5120 generic.go:358] "Generic (PLEG): container finished" podID="3209b0ef-38f4-4ab3-9594-6f4c18d592ec" containerID="8929037a1162c6bec3c3641fcd561b5ac5a23c336b067c0204443924bd5fd615" exitCode=0 Mar 16 16:56:16 crc kubenswrapper[5120]: I0316 16:56:16.656006 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-7mhml" event={"ID":"3209b0ef-38f4-4ab3-9594-6f4c18d592ec","Type":"ContainerDied","Data":"8929037a1162c6bec3c3641fcd561b5ac5a23c336b067c0204443924bd5fd615"} Mar 16 16:56:16 crc kubenswrapper[5120]: I0316 16:56:16.656082 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-7mhml" event={"ID":"3209b0ef-38f4-4ab3-9594-6f4c18d592ec","Type":"ContainerStarted","Data":"aac956b8419c6aa769644e9b65c17b91b25b0615a76574969e653cdbc973468a"} Mar 16 16:56:16 crc kubenswrapper[5120]: I0316 16:56:16.658788 5120 generic.go:358] "Generic (PLEG): container finished" podID="a4d34b4f-907c-4c67-a386-73e726afa874" containerID="f383084e950ec66f2be11165fb0d97fda3fc931351dce751484c16b2cba1669c" exitCode=0 Mar 16 16:56:16 crc kubenswrapper[5120]: I0316 16:56:16.658934 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-cd46-account-create-update-9454l" event={"ID":"a4d34b4f-907c-4c67-a386-73e726afa874","Type":"ContainerDied","Data":"f383084e950ec66f2be11165fb0d97fda3fc931351dce751484c16b2cba1669c"} Mar 16 16:56:16 crc kubenswrapper[5120]: I0316 16:56:16.658968 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-cd46-account-create-update-9454l" event={"ID":"a4d34b4f-907c-4c67-a386-73e726afa874","Type":"ContainerStarted","Data":"974409c3c1e8e3b7be658779d2417a59f92abbf117d28a0f3288ab300dbf4285"} Mar 16 16:56:16 crc kubenswrapper[5120]: I0316 16:56:16.668259 5120 generic.go:358] "Generic (PLEG): container finished" podID="ebbee40a-c6ba-4288-852d-acdc58f27e41" containerID="d68fde987d845f07c8612dff8547b520bbcb4c17c138b2e4f5426a89fc2faaf5" exitCode=0 Mar 16 16:56:16 crc kubenswrapper[5120]: I0316 16:56:16.679830 5120 generic.go:358] "Generic (PLEG): container finished" podID="cb9960d8-4a8c-4a7e-88d5-de6c5e46e72f" containerID="3ff61502c356dc3d615d648d16c140bb610668b7068eebfd905e384b7c405294" exitCode=0 Mar 16 16:56:16 crc kubenswrapper[5120]: I0316 16:56:16.685028 5120 generic.go:358] "Generic (PLEG): container finished" podID="33aaf037-e50b-4983-94bd-46874d5aa9db" containerID="89ed989b8115df3758641743f9e6a6179864cce17534df40660f0f8eea65c204" exitCode=0 Mar 16 16:56:16 crc kubenswrapper[5120]: I0316 16:56:16.685693 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0f95e292-0325-47f3-9767-d77bcc9e5884" path="/var/lib/kubelet/pods/0f95e292-0325-47f3-9767-d77bcc9e5884/volumes" Mar 16 16:56:16 crc kubenswrapper[5120]: I0316 16:56:16.686711 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-8mvwt" event={"ID":"9cc0093b-f3a8-45cc-8df7-9d0ae312c41e","Type":"ContainerStarted","Data":"5bfafc526ad62699465630e81855b22eac1443b21d006f8f97fa8fa451d24f35"} Mar 16 16:56:16 crc kubenswrapper[5120]: I0316 16:56:16.686775 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-8706-account-create-update-7kshs" event={"ID":"ebbee40a-c6ba-4288-852d-acdc58f27e41","Type":"ContainerDied","Data":"d68fde987d845f07c8612dff8547b520bbcb4c17c138b2e4f5426a89fc2faaf5"} Mar 16 16:56:16 crc kubenswrapper[5120]: I0316 16:56:16.686795 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-create-k56b6" event={"ID":"cb9960d8-4a8c-4a7e-88d5-de6c5e46e72f","Type":"ContainerDied","Data":"3ff61502c356dc3d615d648d16c140bb610668b7068eebfd905e384b7c405294"} Mar 16 16:56:16 crc kubenswrapper[5120]: I0316 16:56:16.686810 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-create-95bsl" event={"ID":"33aaf037-e50b-4983-94bd-46874d5aa9db","Type":"ContainerDied","Data":"89ed989b8115df3758641743f9e6a6179864cce17534df40660f0f8eea65c204"} Mar 16 16:56:16 crc kubenswrapper[5120]: I0316 16:56:16.695488 5120 generic.go:358] "Generic (PLEG): container finished" podID="72db1931-19ed-4989-bf2b-01fca6434989" containerID="c57ec37635360e149652c410437ff8f09f649f6a0a2557273d9df336db8b2879" exitCode=0 Mar 16 16:56:16 crc kubenswrapper[5120]: I0316 16:56:16.695559 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-4aec-account-create-update-qxxcv" event={"ID":"72db1931-19ed-4989-bf2b-01fca6434989","Type":"ContainerDied","Data":"c57ec37635360e149652c410437ff8f09f649f6a0a2557273d9df336db8b2879"} Mar 16 16:56:16 crc kubenswrapper[5120]: I0316 16:56:16.704628 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-db-sync-8mvwt" podStartSLOduration=2.704607062 podStartE2EDuration="2.704607062s" podCreationTimestamp="2026-03-16 16:56:14 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:56:16.690553828 +0000 UTC m=+5078.844485485" watchObservedRunningTime="2026-03-16 16:56:16.704607062 +0000 UTC m=+5078.858538719" Mar 16 16:56:17 crc kubenswrapper[5120]: I0316 16:56:17.067262 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-create-r5jqt" Mar 16 16:56:17 crc kubenswrapper[5120]: I0316 16:56:17.246753 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a51b0e1a-a3bb-498f-96e4-b1aa631e68c2-operator-scripts\") pod \"a51b0e1a-a3bb-498f-96e4-b1aa631e68c2\" (UID: \"a51b0e1a-a3bb-498f-96e4-b1aa631e68c2\") " Mar 16 16:56:17 crc kubenswrapper[5120]: I0316 16:56:17.247186 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z59cr\" (UniqueName: \"kubernetes.io/projected/a51b0e1a-a3bb-498f-96e4-b1aa631e68c2-kube-api-access-z59cr\") pod \"a51b0e1a-a3bb-498f-96e4-b1aa631e68c2\" (UID: \"a51b0e1a-a3bb-498f-96e4-b1aa631e68c2\") " Mar 16 16:56:17 crc kubenswrapper[5120]: I0316 16:56:17.247365 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a51b0e1a-a3bb-498f-96e4-b1aa631e68c2-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "a51b0e1a-a3bb-498f-96e4-b1aa631e68c2" (UID: "a51b0e1a-a3bb-498f-96e4-b1aa631e68c2"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:56:17 crc kubenswrapper[5120]: I0316 16:56:17.248349 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a51b0e1a-a3bb-498f-96e4-b1aa631e68c2-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:56:17 crc kubenswrapper[5120]: I0316 16:56:17.273610 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a51b0e1a-a3bb-498f-96e4-b1aa631e68c2-kube-api-access-z59cr" (OuterVolumeSpecName: "kube-api-access-z59cr") pod "a51b0e1a-a3bb-498f-96e4-b1aa631e68c2" (UID: "a51b0e1a-a3bb-498f-96e4-b1aa631e68c2"). InnerVolumeSpecName "kube-api-access-z59cr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:56:17 crc kubenswrapper[5120]: I0316 16:56:17.350399 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z59cr\" (UniqueName: \"kubernetes.io/projected/a51b0e1a-a3bb-498f-96e4-b1aa631e68c2-kube-api-access-z59cr\") on node \"crc\" DevicePath \"\"" Mar 16 16:56:17 crc kubenswrapper[5120]: I0316 16:56:17.709754 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-create-r5jqt" Mar 16 16:56:17 crc kubenswrapper[5120]: I0316 16:56:17.710416 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-create-r5jqt" event={"ID":"a51b0e1a-a3bb-498f-96e4-b1aa631e68c2","Type":"ContainerDied","Data":"162adca6bc76a527f399cbff888fba987db09c8c2742995c15aeed518a8f3157"} Mar 16 16:56:17 crc kubenswrapper[5120]: I0316 16:56:17.710466 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="162adca6bc76a527f399cbff888fba987db09c8c2742995c15aeed518a8f3157" Mar 16 16:56:18 crc kubenswrapper[5120]: I0316 16:56:18.136463 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-8706-account-create-update-7kshs" Mar 16 16:56:18 crc kubenswrapper[5120]: I0316 16:56:18.270247 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-4aec-account-create-update-qxxcv" Mar 16 16:56:18 crc kubenswrapper[5120]: I0316 16:56:18.271021 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ngd9j\" (UniqueName: \"kubernetes.io/projected/ebbee40a-c6ba-4288-852d-acdc58f27e41-kube-api-access-ngd9j\") pod \"ebbee40a-c6ba-4288-852d-acdc58f27e41\" (UID: \"ebbee40a-c6ba-4288-852d-acdc58f27e41\") " Mar 16 16:56:18 crc kubenswrapper[5120]: I0316 16:56:18.271439 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ebbee40a-c6ba-4288-852d-acdc58f27e41-operator-scripts\") pod \"ebbee40a-c6ba-4288-852d-acdc58f27e41\" (UID: \"ebbee40a-c6ba-4288-852d-acdc58f27e41\") " Mar 16 16:56:18 crc kubenswrapper[5120]: I0316 16:56:18.275867 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ebbee40a-c6ba-4288-852d-acdc58f27e41-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "ebbee40a-c6ba-4288-852d-acdc58f27e41" (UID: "ebbee40a-c6ba-4288-852d-acdc58f27e41"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:56:18 crc kubenswrapper[5120]: I0316 16:56:18.285380 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ebbee40a-c6ba-4288-852d-acdc58f27e41-kube-api-access-ngd9j" (OuterVolumeSpecName: "kube-api-access-ngd9j") pod "ebbee40a-c6ba-4288-852d-acdc58f27e41" (UID: "ebbee40a-c6ba-4288-852d-acdc58f27e41"). InnerVolumeSpecName "kube-api-access-ngd9j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:56:18 crc kubenswrapper[5120]: I0316 16:56:18.294558 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-create-k56b6" Mar 16 16:56:18 crc kubenswrapper[5120]: I0316 16:56:18.309645 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-create-95bsl" Mar 16 16:56:18 crc kubenswrapper[5120]: I0316 16:56:18.311491 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-cd46-account-create-update-9454l" Mar 16 16:56:18 crc kubenswrapper[5120]: I0316 16:56:18.373140 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/72db1931-19ed-4989-bf2b-01fca6434989-operator-scripts\") pod \"72db1931-19ed-4989-bf2b-01fca6434989\" (UID: \"72db1931-19ed-4989-bf2b-01fca6434989\") " Mar 16 16:56:18 crc kubenswrapper[5120]: I0316 16:56:18.373687 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-88r9k\" (UniqueName: \"kubernetes.io/projected/72db1931-19ed-4989-bf2b-01fca6434989-kube-api-access-88r9k\") pod \"72db1931-19ed-4989-bf2b-01fca6434989\" (UID: \"72db1931-19ed-4989-bf2b-01fca6434989\") " Mar 16 16:56:18 crc kubenswrapper[5120]: I0316 16:56:18.374350 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ebbee40a-c6ba-4288-852d-acdc58f27e41-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:56:18 crc kubenswrapper[5120]: I0316 16:56:18.374372 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ngd9j\" (UniqueName: \"kubernetes.io/projected/ebbee40a-c6ba-4288-852d-acdc58f27e41-kube-api-access-ngd9j\") on node \"crc\" DevicePath \"\"" Mar 16 16:56:18 crc kubenswrapper[5120]: I0316 16:56:18.375122 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/72db1931-19ed-4989-bf2b-01fca6434989-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "72db1931-19ed-4989-bf2b-01fca6434989" (UID: "72db1931-19ed-4989-bf2b-01fca6434989"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:56:18 crc kubenswrapper[5120]: I0316 16:56:18.382346 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72db1931-19ed-4989-bf2b-01fca6434989-kube-api-access-88r9k" (OuterVolumeSpecName: "kube-api-access-88r9k") pod "72db1931-19ed-4989-bf2b-01fca6434989" (UID: "72db1931-19ed-4989-bf2b-01fca6434989"). InnerVolumeSpecName "kube-api-access-88r9k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:56:18 crc kubenswrapper[5120]: I0316 16:56:18.475654 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5w88q\" (UniqueName: \"kubernetes.io/projected/33aaf037-e50b-4983-94bd-46874d5aa9db-kube-api-access-5w88q\") pod \"33aaf037-e50b-4983-94bd-46874d5aa9db\" (UID: \"33aaf037-e50b-4983-94bd-46874d5aa9db\") " Mar 16 16:56:18 crc kubenswrapper[5120]: I0316 16:56:18.476214 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a4d34b4f-907c-4c67-a386-73e726afa874-operator-scripts\") pod \"a4d34b4f-907c-4c67-a386-73e726afa874\" (UID: \"a4d34b4f-907c-4c67-a386-73e726afa874\") " Mar 16 16:56:18 crc kubenswrapper[5120]: I0316 16:56:18.476392 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/cb9960d8-4a8c-4a7e-88d5-de6c5e46e72f-operator-scripts\") pod \"cb9960d8-4a8c-4a7e-88d5-de6c5e46e72f\" (UID: \"cb9960d8-4a8c-4a7e-88d5-de6c5e46e72f\") " Mar 16 16:56:18 crc kubenswrapper[5120]: I0316 16:56:18.476515 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/33aaf037-e50b-4983-94bd-46874d5aa9db-operator-scripts\") pod \"33aaf037-e50b-4983-94bd-46874d5aa9db\" (UID: \"33aaf037-e50b-4983-94bd-46874d5aa9db\") " Mar 16 16:56:18 crc kubenswrapper[5120]: I0316 16:56:18.476649 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9zv7k\" (UniqueName: \"kubernetes.io/projected/cb9960d8-4a8c-4a7e-88d5-de6c5e46e72f-kube-api-access-9zv7k\") pod \"cb9960d8-4a8c-4a7e-88d5-de6c5e46e72f\" (UID: \"cb9960d8-4a8c-4a7e-88d5-de6c5e46e72f\") " Mar 16 16:56:18 crc kubenswrapper[5120]: I0316 16:56:18.477007 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wwzdl\" (UniqueName: \"kubernetes.io/projected/a4d34b4f-907c-4c67-a386-73e726afa874-kube-api-access-wwzdl\") pod \"a4d34b4f-907c-4c67-a386-73e726afa874\" (UID: \"a4d34b4f-907c-4c67-a386-73e726afa874\") " Mar 16 16:56:18 crc kubenswrapper[5120]: I0316 16:56:18.477287 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a4d34b4f-907c-4c67-a386-73e726afa874-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "a4d34b4f-907c-4c67-a386-73e726afa874" (UID: "a4d34b4f-907c-4c67-a386-73e726afa874"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:56:18 crc kubenswrapper[5120]: I0316 16:56:18.477466 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/33aaf037-e50b-4983-94bd-46874d5aa9db-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "33aaf037-e50b-4983-94bd-46874d5aa9db" (UID: "33aaf037-e50b-4983-94bd-46874d5aa9db"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:56:18 crc kubenswrapper[5120]: I0316 16:56:18.477815 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cb9960d8-4a8c-4a7e-88d5-de6c5e46e72f-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "cb9960d8-4a8c-4a7e-88d5-de6c5e46e72f" (UID: "cb9960d8-4a8c-4a7e-88d5-de6c5e46e72f"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:56:18 crc kubenswrapper[5120]: I0316 16:56:18.478472 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a4d34b4f-907c-4c67-a386-73e726afa874-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:56:18 crc kubenswrapper[5120]: I0316 16:56:18.478633 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/cb9960d8-4a8c-4a7e-88d5-de6c5e46e72f-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:56:18 crc kubenswrapper[5120]: I0316 16:56:18.478730 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/33aaf037-e50b-4983-94bd-46874d5aa9db-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:56:18 crc kubenswrapper[5120]: I0316 16:56:18.479034 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-88r9k\" (UniqueName: \"kubernetes.io/projected/72db1931-19ed-4989-bf2b-01fca6434989-kube-api-access-88r9k\") on node \"crc\" DevicePath \"\"" Mar 16 16:56:18 crc kubenswrapper[5120]: I0316 16:56:18.479257 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/72db1931-19ed-4989-bf2b-01fca6434989-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:56:18 crc kubenswrapper[5120]: I0316 16:56:18.480139 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33aaf037-e50b-4983-94bd-46874d5aa9db-kube-api-access-5w88q" (OuterVolumeSpecName: "kube-api-access-5w88q") pod "33aaf037-e50b-4983-94bd-46874d5aa9db" (UID: "33aaf037-e50b-4983-94bd-46874d5aa9db"). InnerVolumeSpecName "kube-api-access-5w88q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:56:18 crc kubenswrapper[5120]: I0316 16:56:18.480529 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb9960d8-4a8c-4a7e-88d5-de6c5e46e72f-kube-api-access-9zv7k" (OuterVolumeSpecName: "kube-api-access-9zv7k") pod "cb9960d8-4a8c-4a7e-88d5-de6c5e46e72f" (UID: "cb9960d8-4a8c-4a7e-88d5-de6c5e46e72f"). InnerVolumeSpecName "kube-api-access-9zv7k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:56:18 crc kubenswrapper[5120]: I0316 16:56:18.483731 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a4d34b4f-907c-4c67-a386-73e726afa874-kube-api-access-wwzdl" (OuterVolumeSpecName: "kube-api-access-wwzdl") pod "a4d34b4f-907c-4c67-a386-73e726afa874" (UID: "a4d34b4f-907c-4c67-a386-73e726afa874"). InnerVolumeSpecName "kube-api-access-wwzdl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:56:18 crc kubenswrapper[5120]: I0316 16:56:18.581615 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5w88q\" (UniqueName: \"kubernetes.io/projected/33aaf037-e50b-4983-94bd-46874d5aa9db-kube-api-access-5w88q\") on node \"crc\" DevicePath \"\"" Mar 16 16:56:18 crc kubenswrapper[5120]: I0316 16:56:18.582469 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9zv7k\" (UniqueName: \"kubernetes.io/projected/cb9960d8-4a8c-4a7e-88d5-de6c5e46e72f-kube-api-access-9zv7k\") on node \"crc\" DevicePath \"\"" Mar 16 16:56:18 crc kubenswrapper[5120]: I0316 16:56:18.582600 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wwzdl\" (UniqueName: \"kubernetes.io/projected/a4d34b4f-907c-4c67-a386-73e726afa874-kube-api-access-wwzdl\") on node \"crc\" DevicePath \"\"" Mar 16 16:56:18 crc kubenswrapper[5120]: I0316 16:56:18.720597 5120 generic.go:358] "Generic (PLEG): container finished" podID="3209b0ef-38f4-4ab3-9594-6f4c18d592ec" containerID="4743e24a9346c662c8975c8c56816faac6818c53b765b8d123f8527defd5a082" exitCode=0 Mar 16 16:56:18 crc kubenswrapper[5120]: I0316 16:56:18.720641 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-7mhml" event={"ID":"3209b0ef-38f4-4ab3-9594-6f4c18d592ec","Type":"ContainerDied","Data":"4743e24a9346c662c8975c8c56816faac6818c53b765b8d123f8527defd5a082"} Mar 16 16:56:18 crc kubenswrapper[5120]: I0316 16:56:18.722508 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-cd46-account-create-update-9454l" event={"ID":"a4d34b4f-907c-4c67-a386-73e726afa874","Type":"ContainerDied","Data":"974409c3c1e8e3b7be658779d2417a59f92abbf117d28a0f3288ab300dbf4285"} Mar 16 16:56:18 crc kubenswrapper[5120]: I0316 16:56:18.722532 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="974409c3c1e8e3b7be658779d2417a59f92abbf117d28a0f3288ab300dbf4285" Mar 16 16:56:18 crc kubenswrapper[5120]: I0316 16:56:18.722600 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-cd46-account-create-update-9454l" Mar 16 16:56:18 crc kubenswrapper[5120]: I0316 16:56:18.725513 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-8706-account-create-update-7kshs" Mar 16 16:56:18 crc kubenswrapper[5120]: I0316 16:56:18.725906 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-8706-account-create-update-7kshs" event={"ID":"ebbee40a-c6ba-4288-852d-acdc58f27e41","Type":"ContainerDied","Data":"24d4ffd3693f5aa9c393c2a9ebb8c5f3e552677a5d6be222f40a2ea88d3564e2"} Mar 16 16:56:18 crc kubenswrapper[5120]: I0316 16:56:18.725933 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="24d4ffd3693f5aa9c393c2a9ebb8c5f3e552677a5d6be222f40a2ea88d3564e2" Mar 16 16:56:18 crc kubenswrapper[5120]: I0316 16:56:18.729704 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-create-k56b6" event={"ID":"cb9960d8-4a8c-4a7e-88d5-de6c5e46e72f","Type":"ContainerDied","Data":"1b3e3de6951f9dda0987148cbccf428edf1d93519de663db0c5203648a45e5af"} Mar 16 16:56:18 crc kubenswrapper[5120]: I0316 16:56:18.729728 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1b3e3de6951f9dda0987148cbccf428edf1d93519de663db0c5203648a45e5af" Mar 16 16:56:18 crc kubenswrapper[5120]: I0316 16:56:18.729781 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-create-k56b6" Mar 16 16:56:18 crc kubenswrapper[5120]: I0316 16:56:18.732244 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-create-95bsl" Mar 16 16:56:18 crc kubenswrapper[5120]: I0316 16:56:18.732256 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-create-95bsl" event={"ID":"33aaf037-e50b-4983-94bd-46874d5aa9db","Type":"ContainerDied","Data":"9e2d91674df785ab6ca3efb058ff7eb825b59da0ad5207510f052dd7b9fb0a74"} Mar 16 16:56:18 crc kubenswrapper[5120]: I0316 16:56:18.732462 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9e2d91674df785ab6ca3efb058ff7eb825b59da0ad5207510f052dd7b9fb0a74" Mar 16 16:56:18 crc kubenswrapper[5120]: I0316 16:56:18.733521 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-4aec-account-create-update-qxxcv" event={"ID":"72db1931-19ed-4989-bf2b-01fca6434989","Type":"ContainerDied","Data":"2ac6efd97819e29a3f4f6f4873bd07b735a55a95ba5b2e1135c144070aebcd72"} Mar 16 16:56:18 crc kubenswrapper[5120]: I0316 16:56:18.733551 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-4aec-account-create-update-qxxcv" Mar 16 16:56:18 crc kubenswrapper[5120]: I0316 16:56:18.733554 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2ac6efd97819e29a3f4f6f4873bd07b735a55a95ba5b2e1135c144070aebcd72" Mar 16 16:56:19 crc kubenswrapper[5120]: I0316 16:56:19.747242 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-7mhml" event={"ID":"3209b0ef-38f4-4ab3-9594-6f4c18d592ec","Type":"ContainerStarted","Data":"2eadc6dbc7f01160dc9a3b9cbe42655a685b5eefde4463cd3ee26fd2426910ed"} Mar 16 16:56:19 crc kubenswrapper[5120]: I0316 16:56:19.750212 5120 generic.go:358] "Generic (PLEG): container finished" podID="9cc0093b-f3a8-45cc-8df7-9d0ae312c41e" containerID="5bfafc526ad62699465630e81855b22eac1443b21d006f8f97fa8fa451d24f35" exitCode=0 Mar 16 16:56:19 crc kubenswrapper[5120]: I0316 16:56:19.750300 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-8mvwt" event={"ID":"9cc0093b-f3a8-45cc-8df7-9d0ae312c41e","Type":"ContainerDied","Data":"5bfafc526ad62699465630e81855b22eac1443b21d006f8f97fa8fa451d24f35"} Mar 16 16:56:19 crc kubenswrapper[5120]: I0316 16:56:19.766291 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/redhat-operators-7mhml" podStartSLOduration=3.838091717 podStartE2EDuration="4.766278773s" podCreationTimestamp="2026-03-16 16:56:15 +0000 UTC" firstStartedPulling="2026-03-16 16:56:16.656960038 +0000 UTC m=+5078.810891695" lastFinishedPulling="2026-03-16 16:56:17.585147084 +0000 UTC m=+5079.739078751" observedRunningTime="2026-03-16 16:56:19.764960377 +0000 UTC m=+5081.918892044" watchObservedRunningTime="2026-03-16 16:56:19.766278773 +0000 UTC m=+5081.920210430" Mar 16 16:56:21 crc kubenswrapper[5120]: I0316 16:56:21.104012 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-8mvwt" Mar 16 16:56:21 crc kubenswrapper[5120]: I0316 16:56:21.134699 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9cc0093b-f3a8-45cc-8df7-9d0ae312c41e-config-data\") pod \"9cc0093b-f3a8-45cc-8df7-9d0ae312c41e\" (UID: \"9cc0093b-f3a8-45cc-8df7-9d0ae312c41e\") " Mar 16 16:56:21 crc kubenswrapper[5120]: I0316 16:56:21.134804 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9cc0093b-f3a8-45cc-8df7-9d0ae312c41e-combined-ca-bundle\") pod \"9cc0093b-f3a8-45cc-8df7-9d0ae312c41e\" (UID: \"9cc0093b-f3a8-45cc-8df7-9d0ae312c41e\") " Mar 16 16:56:21 crc kubenswrapper[5120]: I0316 16:56:21.135073 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6z6r2\" (UniqueName: \"kubernetes.io/projected/9cc0093b-f3a8-45cc-8df7-9d0ae312c41e-kube-api-access-6z6r2\") pod \"9cc0093b-f3a8-45cc-8df7-9d0ae312c41e\" (UID: \"9cc0093b-f3a8-45cc-8df7-9d0ae312c41e\") " Mar 16 16:56:21 crc kubenswrapper[5120]: I0316 16:56:21.148451 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9cc0093b-f3a8-45cc-8df7-9d0ae312c41e-kube-api-access-6z6r2" (OuterVolumeSpecName: "kube-api-access-6z6r2") pod "9cc0093b-f3a8-45cc-8df7-9d0ae312c41e" (UID: "9cc0093b-f3a8-45cc-8df7-9d0ae312c41e"). InnerVolumeSpecName "kube-api-access-6z6r2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:56:21 crc kubenswrapper[5120]: I0316 16:56:21.179571 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9cc0093b-f3a8-45cc-8df7-9d0ae312c41e-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "9cc0093b-f3a8-45cc-8df7-9d0ae312c41e" (UID: "9cc0093b-f3a8-45cc-8df7-9d0ae312c41e"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:56:21 crc kubenswrapper[5120]: I0316 16:56:21.186110 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9cc0093b-f3a8-45cc-8df7-9d0ae312c41e-config-data" (OuterVolumeSpecName: "config-data") pod "9cc0093b-f3a8-45cc-8df7-9d0ae312c41e" (UID: "9cc0093b-f3a8-45cc-8df7-9d0ae312c41e"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:56:21 crc kubenswrapper[5120]: I0316 16:56:21.237126 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9cc0093b-f3a8-45cc-8df7-9d0ae312c41e-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:56:21 crc kubenswrapper[5120]: I0316 16:56:21.237165 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9cc0093b-f3a8-45cc-8df7-9d0ae312c41e-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:56:21 crc kubenswrapper[5120]: I0316 16:56:21.237178 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6z6r2\" (UniqueName: \"kubernetes.io/projected/9cc0093b-f3a8-45cc-8df7-9d0ae312c41e-kube-api-access-6z6r2\") on node \"crc\" DevicePath \"\"" Mar 16 16:56:21 crc kubenswrapper[5120]: I0316 16:56:21.664060 5120 scope.go:117] "RemoveContainer" containerID="083f72646c8d47c9c0467b39be99ddfa9c2e5900ae0a29ad53d7b39b950274b4" Mar 16 16:56:21 crc kubenswrapper[5120]: E0316 16:56:21.664410 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:56:21 crc kubenswrapper[5120]: I0316 16:56:21.770696 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-8mvwt" Mar 16 16:56:21 crc kubenswrapper[5120]: I0316 16:56:21.770766 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-8mvwt" event={"ID":"9cc0093b-f3a8-45cc-8df7-9d0ae312c41e","Type":"ContainerDied","Data":"35108531e185b5b5690c6f250e1a7e52196d269047cd50373277014913f5dfda"} Mar 16 16:56:21 crc kubenswrapper[5120]: I0316 16:56:21.770801 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="35108531e185b5b5690c6f250e1a7e52196d269047cd50373277014913f5dfda" Mar 16 16:56:22 crc kubenswrapper[5120]: I0316 16:56:22.043243 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-kc6pl"] Mar 16 16:56:22 crc kubenswrapper[5120]: I0316 16:56:22.044829 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33aaf037-e50b-4983-94bd-46874d5aa9db" containerName="mariadb-database-create" Mar 16 16:56:22 crc kubenswrapper[5120]: I0316 16:56:22.044851 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="33aaf037-e50b-4983-94bd-46874d5aa9db" containerName="mariadb-database-create" Mar 16 16:56:22 crc kubenswrapper[5120]: I0316 16:56:22.044871 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb9960d8-4a8c-4a7e-88d5-de6c5e46e72f" containerName="mariadb-database-create" Mar 16 16:56:22 crc kubenswrapper[5120]: I0316 16:56:22.044878 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb9960d8-4a8c-4a7e-88d5-de6c5e46e72f" containerName="mariadb-database-create" Mar 16 16:56:22 crc kubenswrapper[5120]: I0316 16:56:22.044888 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4d34b4f-907c-4c67-a386-73e726afa874" containerName="mariadb-account-create-update" Mar 16 16:56:22 crc kubenswrapper[5120]: I0316 16:56:22.044897 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4d34b4f-907c-4c67-a386-73e726afa874" containerName="mariadb-account-create-update" Mar 16 16:56:22 crc kubenswrapper[5120]: I0316 16:56:22.044910 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ebbee40a-c6ba-4288-852d-acdc58f27e41" containerName="mariadb-account-create-update" Mar 16 16:56:22 crc kubenswrapper[5120]: I0316 16:56:22.044916 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ebbee40a-c6ba-4288-852d-acdc58f27e41" containerName="mariadb-account-create-update" Mar 16 16:56:22 crc kubenswrapper[5120]: I0316 16:56:22.044930 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72db1931-19ed-4989-bf2b-01fca6434989" containerName="mariadb-account-create-update" Mar 16 16:56:22 crc kubenswrapper[5120]: I0316 16:56:22.044936 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="72db1931-19ed-4989-bf2b-01fca6434989" containerName="mariadb-account-create-update" Mar 16 16:56:22 crc kubenswrapper[5120]: I0316 16:56:22.044962 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a51b0e1a-a3bb-498f-96e4-b1aa631e68c2" containerName="mariadb-database-create" Mar 16 16:56:22 crc kubenswrapper[5120]: I0316 16:56:22.044971 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a51b0e1a-a3bb-498f-96e4-b1aa631e68c2" containerName="mariadb-database-create" Mar 16 16:56:22 crc kubenswrapper[5120]: I0316 16:56:22.044995 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9cc0093b-f3a8-45cc-8df7-9d0ae312c41e" containerName="keystone-db-sync" Mar 16 16:56:22 crc kubenswrapper[5120]: I0316 16:56:22.045002 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9cc0093b-f3a8-45cc-8df7-9d0ae312c41e" containerName="keystone-db-sync" Mar 16 16:56:22 crc kubenswrapper[5120]: I0316 16:56:22.045231 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ebbee40a-c6ba-4288-852d-acdc58f27e41" containerName="mariadb-account-create-update" Mar 16 16:56:22 crc kubenswrapper[5120]: I0316 16:56:22.045250 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="a51b0e1a-a3bb-498f-96e4-b1aa631e68c2" containerName="mariadb-database-create" Mar 16 16:56:22 crc kubenswrapper[5120]: I0316 16:56:22.045265 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="a4d34b4f-907c-4c67-a386-73e726afa874" containerName="mariadb-account-create-update" Mar 16 16:56:22 crc kubenswrapper[5120]: I0316 16:56:22.045278 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="9cc0093b-f3a8-45cc-8df7-9d0ae312c41e" containerName="keystone-db-sync" Mar 16 16:56:22 crc kubenswrapper[5120]: I0316 16:56:22.045285 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="33aaf037-e50b-4983-94bd-46874d5aa9db" containerName="mariadb-database-create" Mar 16 16:56:22 crc kubenswrapper[5120]: I0316 16:56:22.045293 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="cb9960d8-4a8c-4a7e-88d5-de6c5e46e72f" containerName="mariadb-database-create" Mar 16 16:56:22 crc kubenswrapper[5120]: I0316 16:56:22.045308 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="72db1931-19ed-4989-bf2b-01fca6434989" containerName="mariadb-account-create-update" Mar 16 16:56:22 crc kubenswrapper[5120]: I0316 16:56:22.084609 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-kc6pl"] Mar 16 16:56:22 crc kubenswrapper[5120]: I0316 16:56:22.084783 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-kc6pl" Mar 16 16:56:22 crc kubenswrapper[5120]: I0316 16:56:22.088465 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-scripts\"" Mar 16 16:56:22 crc kubenswrapper[5120]: I0316 16:56:22.088506 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-keystone-dockercfg-5mpsq\"" Mar 16 16:56:22 crc kubenswrapper[5120]: I0316 16:56:22.088802 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-config-data\"" Mar 16 16:56:22 crc kubenswrapper[5120]: I0316 16:56:22.088858 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone\"" Mar 16 16:56:22 crc kubenswrapper[5120]: I0316 16:56:22.090436 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"osp-secret\"" Mar 16 16:56:22 crc kubenswrapper[5120]: I0316 16:56:22.157710 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4cb6be6a-67ac-4e35-aacf-d1df8c5c9c11-config-data\") pod \"keystone-bootstrap-kc6pl\" (UID: \"4cb6be6a-67ac-4e35-aacf-d1df8c5c9c11\") " pod="openstack-kuttl-tests/keystone-bootstrap-kc6pl" Mar 16 16:56:22 crc kubenswrapper[5120]: I0316 16:56:22.157800 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4cb6be6a-67ac-4e35-aacf-d1df8c5c9c11-combined-ca-bundle\") pod \"keystone-bootstrap-kc6pl\" (UID: \"4cb6be6a-67ac-4e35-aacf-d1df8c5c9c11\") " pod="openstack-kuttl-tests/keystone-bootstrap-kc6pl" Mar 16 16:56:22 crc kubenswrapper[5120]: I0316 16:56:22.157891 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4cb6be6a-67ac-4e35-aacf-d1df8c5c9c11-scripts\") pod \"keystone-bootstrap-kc6pl\" (UID: \"4cb6be6a-67ac-4e35-aacf-d1df8c5c9c11\") " pod="openstack-kuttl-tests/keystone-bootstrap-kc6pl" Mar 16 16:56:22 crc kubenswrapper[5120]: I0316 16:56:22.158011 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/4cb6be6a-67ac-4e35-aacf-d1df8c5c9c11-credential-keys\") pod \"keystone-bootstrap-kc6pl\" (UID: \"4cb6be6a-67ac-4e35-aacf-d1df8c5c9c11\") " pod="openstack-kuttl-tests/keystone-bootstrap-kc6pl" Mar 16 16:56:22 crc kubenswrapper[5120]: I0316 16:56:22.158231 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jv7k9\" (UniqueName: \"kubernetes.io/projected/4cb6be6a-67ac-4e35-aacf-d1df8c5c9c11-kube-api-access-jv7k9\") pod \"keystone-bootstrap-kc6pl\" (UID: \"4cb6be6a-67ac-4e35-aacf-d1df8c5c9c11\") " pod="openstack-kuttl-tests/keystone-bootstrap-kc6pl" Mar 16 16:56:22 crc kubenswrapper[5120]: I0316 16:56:22.158282 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/4cb6be6a-67ac-4e35-aacf-d1df8c5c9c11-fernet-keys\") pod \"keystone-bootstrap-kc6pl\" (UID: \"4cb6be6a-67ac-4e35-aacf-d1df8c5c9c11\") " pod="openstack-kuttl-tests/keystone-bootstrap-kc6pl" Mar 16 16:56:22 crc kubenswrapper[5120]: I0316 16:56:22.259937 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4cb6be6a-67ac-4e35-aacf-d1df8c5c9c11-config-data\") pod \"keystone-bootstrap-kc6pl\" (UID: \"4cb6be6a-67ac-4e35-aacf-d1df8c5c9c11\") " pod="openstack-kuttl-tests/keystone-bootstrap-kc6pl" Mar 16 16:56:22 crc kubenswrapper[5120]: I0316 16:56:22.260002 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4cb6be6a-67ac-4e35-aacf-d1df8c5c9c11-combined-ca-bundle\") pod \"keystone-bootstrap-kc6pl\" (UID: \"4cb6be6a-67ac-4e35-aacf-d1df8c5c9c11\") " pod="openstack-kuttl-tests/keystone-bootstrap-kc6pl" Mar 16 16:56:22 crc kubenswrapper[5120]: I0316 16:56:22.260058 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4cb6be6a-67ac-4e35-aacf-d1df8c5c9c11-scripts\") pod \"keystone-bootstrap-kc6pl\" (UID: \"4cb6be6a-67ac-4e35-aacf-d1df8c5c9c11\") " pod="openstack-kuttl-tests/keystone-bootstrap-kc6pl" Mar 16 16:56:22 crc kubenswrapper[5120]: I0316 16:56:22.260416 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/4cb6be6a-67ac-4e35-aacf-d1df8c5c9c11-credential-keys\") pod \"keystone-bootstrap-kc6pl\" (UID: \"4cb6be6a-67ac-4e35-aacf-d1df8c5c9c11\") " pod="openstack-kuttl-tests/keystone-bootstrap-kc6pl" Mar 16 16:56:22 crc kubenswrapper[5120]: I0316 16:56:22.260803 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jv7k9\" (UniqueName: \"kubernetes.io/projected/4cb6be6a-67ac-4e35-aacf-d1df8c5c9c11-kube-api-access-jv7k9\") pod \"keystone-bootstrap-kc6pl\" (UID: \"4cb6be6a-67ac-4e35-aacf-d1df8c5c9c11\") " pod="openstack-kuttl-tests/keystone-bootstrap-kc6pl" Mar 16 16:56:22 crc kubenswrapper[5120]: I0316 16:56:22.261215 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/4cb6be6a-67ac-4e35-aacf-d1df8c5c9c11-fernet-keys\") pod \"keystone-bootstrap-kc6pl\" (UID: \"4cb6be6a-67ac-4e35-aacf-d1df8c5c9c11\") " pod="openstack-kuttl-tests/keystone-bootstrap-kc6pl" Mar 16 16:56:22 crc kubenswrapper[5120]: I0316 16:56:22.265527 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4cb6be6a-67ac-4e35-aacf-d1df8c5c9c11-scripts\") pod \"keystone-bootstrap-kc6pl\" (UID: \"4cb6be6a-67ac-4e35-aacf-d1df8c5c9c11\") " pod="openstack-kuttl-tests/keystone-bootstrap-kc6pl" Mar 16 16:56:22 crc kubenswrapper[5120]: I0316 16:56:22.265556 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4cb6be6a-67ac-4e35-aacf-d1df8c5c9c11-combined-ca-bundle\") pod \"keystone-bootstrap-kc6pl\" (UID: \"4cb6be6a-67ac-4e35-aacf-d1df8c5c9c11\") " pod="openstack-kuttl-tests/keystone-bootstrap-kc6pl" Mar 16 16:56:22 crc kubenswrapper[5120]: I0316 16:56:22.277398 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/4cb6be6a-67ac-4e35-aacf-d1df8c5c9c11-credential-keys\") pod \"keystone-bootstrap-kc6pl\" (UID: \"4cb6be6a-67ac-4e35-aacf-d1df8c5c9c11\") " pod="openstack-kuttl-tests/keystone-bootstrap-kc6pl" Mar 16 16:56:22 crc kubenswrapper[5120]: I0316 16:56:22.296467 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4cb6be6a-67ac-4e35-aacf-d1df8c5c9c11-config-data\") pod \"keystone-bootstrap-kc6pl\" (UID: \"4cb6be6a-67ac-4e35-aacf-d1df8c5c9c11\") " pod="openstack-kuttl-tests/keystone-bootstrap-kc6pl" Mar 16 16:56:22 crc kubenswrapper[5120]: I0316 16:56:22.308510 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/4cb6be6a-67ac-4e35-aacf-d1df8c5c9c11-fernet-keys\") pod \"keystone-bootstrap-kc6pl\" (UID: \"4cb6be6a-67ac-4e35-aacf-d1df8c5c9c11\") " pod="openstack-kuttl-tests/keystone-bootstrap-kc6pl" Mar 16 16:56:22 crc kubenswrapper[5120]: I0316 16:56:22.316416 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jv7k9\" (UniqueName: \"kubernetes.io/projected/4cb6be6a-67ac-4e35-aacf-d1df8c5c9c11-kube-api-access-jv7k9\") pod \"keystone-bootstrap-kc6pl\" (UID: \"4cb6be6a-67ac-4e35-aacf-d1df8c5c9c11\") " pod="openstack-kuttl-tests/keystone-bootstrap-kc6pl" Mar 16 16:56:22 crc kubenswrapper[5120]: I0316 16:56:22.350296 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-db-sync-np5jg"] Mar 16 16:56:22 crc kubenswrapper[5120]: I0316 16:56:22.394097 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-np5jg"] Mar 16 16:56:22 crc kubenswrapper[5120]: I0316 16:56:22.394136 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:56:22 crc kubenswrapper[5120]: I0316 16:56:22.395964 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-np5jg" Mar 16 16:56:22 crc kubenswrapper[5120]: I0316 16:56:22.402407 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-scripts\"" Mar 16 16:56:22 crc kubenswrapper[5120]: I0316 16:56:22.402588 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-config-data\"" Mar 16 16:56:22 crc kubenswrapper[5120]: I0316 16:56:22.402710 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-placement-dockercfg-plb5j\"" Mar 16 16:56:22 crc kubenswrapper[5120]: I0316 16:56:22.402790 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:56:22 crc kubenswrapper[5120]: I0316 16:56:22.402961 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:56:22 crc kubenswrapper[5120]: I0316 16:56:22.404730 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-kc6pl" Mar 16 16:56:22 crc kubenswrapper[5120]: I0316 16:56:22.405713 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 16:56:22 crc kubenswrapper[5120]: I0316 16:56:22.406266 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 16:56:22 crc kubenswrapper[5120]: I0316 16:56:22.465087 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9d8t\" (UniqueName: \"kubernetes.io/projected/519f2986-0498-4f41-b63e-3137e48794e8-kube-api-access-n9d8t\") pod \"ceilometer-0\" (UID: \"519f2986-0498-4f41-b63e-3137e48794e8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:56:22 crc kubenswrapper[5120]: I0316 16:56:22.465120 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/519f2986-0498-4f41-b63e-3137e48794e8-scripts\") pod \"ceilometer-0\" (UID: \"519f2986-0498-4f41-b63e-3137e48794e8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:56:22 crc kubenswrapper[5120]: I0316 16:56:22.465139 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/519f2986-0498-4f41-b63e-3137e48794e8-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"519f2986-0498-4f41-b63e-3137e48794e8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:56:22 crc kubenswrapper[5120]: I0316 16:56:22.465207 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5g8x\" (UniqueName: \"kubernetes.io/projected/c336b7b3-c896-4066-a40a-ca516ed7c2c1-kube-api-access-z5g8x\") pod \"placement-db-sync-np5jg\" (UID: \"c336b7b3-c896-4066-a40a-ca516ed7c2c1\") " pod="openstack-kuttl-tests/placement-db-sync-np5jg" Mar 16 16:56:22 crc kubenswrapper[5120]: I0316 16:56:22.465267 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c336b7b3-c896-4066-a40a-ca516ed7c2c1-combined-ca-bundle\") pod \"placement-db-sync-np5jg\" (UID: \"c336b7b3-c896-4066-a40a-ca516ed7c2c1\") " pod="openstack-kuttl-tests/placement-db-sync-np5jg" Mar 16 16:56:22 crc kubenswrapper[5120]: I0316 16:56:22.465289 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/519f2986-0498-4f41-b63e-3137e48794e8-config-data\") pod \"ceilometer-0\" (UID: \"519f2986-0498-4f41-b63e-3137e48794e8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:56:22 crc kubenswrapper[5120]: I0316 16:56:22.465336 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c336b7b3-c896-4066-a40a-ca516ed7c2c1-config-data\") pod \"placement-db-sync-np5jg\" (UID: \"c336b7b3-c896-4066-a40a-ca516ed7c2c1\") " pod="openstack-kuttl-tests/placement-db-sync-np5jg" Mar 16 16:56:22 crc kubenswrapper[5120]: I0316 16:56:22.465349 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c336b7b3-c896-4066-a40a-ca516ed7c2c1-logs\") pod \"placement-db-sync-np5jg\" (UID: \"c336b7b3-c896-4066-a40a-ca516ed7c2c1\") " pod="openstack-kuttl-tests/placement-db-sync-np5jg" Mar 16 16:56:22 crc kubenswrapper[5120]: I0316 16:56:22.465375 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/519f2986-0498-4f41-b63e-3137e48794e8-log-httpd\") pod \"ceilometer-0\" (UID: \"519f2986-0498-4f41-b63e-3137e48794e8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:56:22 crc kubenswrapper[5120]: I0316 16:56:22.465479 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c336b7b3-c896-4066-a40a-ca516ed7c2c1-scripts\") pod \"placement-db-sync-np5jg\" (UID: \"c336b7b3-c896-4066-a40a-ca516ed7c2c1\") " pod="openstack-kuttl-tests/placement-db-sync-np5jg" Mar 16 16:56:22 crc kubenswrapper[5120]: I0316 16:56:22.465534 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/519f2986-0498-4f41-b63e-3137e48794e8-run-httpd\") pod \"ceilometer-0\" (UID: \"519f2986-0498-4f41-b63e-3137e48794e8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:56:22 crc kubenswrapper[5120]: I0316 16:56:22.465555 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/519f2986-0498-4f41-b63e-3137e48794e8-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"519f2986-0498-4f41-b63e-3137e48794e8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:56:22 crc kubenswrapper[5120]: I0316 16:56:22.568006 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n9d8t\" (UniqueName: \"kubernetes.io/projected/519f2986-0498-4f41-b63e-3137e48794e8-kube-api-access-n9d8t\") pod \"ceilometer-0\" (UID: \"519f2986-0498-4f41-b63e-3137e48794e8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:56:22 crc kubenswrapper[5120]: I0316 16:56:22.568348 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/519f2986-0498-4f41-b63e-3137e48794e8-scripts\") pod \"ceilometer-0\" (UID: \"519f2986-0498-4f41-b63e-3137e48794e8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:56:22 crc kubenswrapper[5120]: I0316 16:56:22.568469 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/519f2986-0498-4f41-b63e-3137e48794e8-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"519f2986-0498-4f41-b63e-3137e48794e8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:56:22 crc kubenswrapper[5120]: I0316 16:56:22.568640 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z5g8x\" (UniqueName: \"kubernetes.io/projected/c336b7b3-c896-4066-a40a-ca516ed7c2c1-kube-api-access-z5g8x\") pod \"placement-db-sync-np5jg\" (UID: \"c336b7b3-c896-4066-a40a-ca516ed7c2c1\") " pod="openstack-kuttl-tests/placement-db-sync-np5jg" Mar 16 16:56:22 crc kubenswrapper[5120]: I0316 16:56:22.568843 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c336b7b3-c896-4066-a40a-ca516ed7c2c1-combined-ca-bundle\") pod \"placement-db-sync-np5jg\" (UID: \"c336b7b3-c896-4066-a40a-ca516ed7c2c1\") " pod="openstack-kuttl-tests/placement-db-sync-np5jg" Mar 16 16:56:22 crc kubenswrapper[5120]: I0316 16:56:22.568973 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/519f2986-0498-4f41-b63e-3137e48794e8-config-data\") pod \"ceilometer-0\" (UID: \"519f2986-0498-4f41-b63e-3137e48794e8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:56:22 crc kubenswrapper[5120]: I0316 16:56:22.569127 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c336b7b3-c896-4066-a40a-ca516ed7c2c1-config-data\") pod \"placement-db-sync-np5jg\" (UID: \"c336b7b3-c896-4066-a40a-ca516ed7c2c1\") " pod="openstack-kuttl-tests/placement-db-sync-np5jg" Mar 16 16:56:22 crc kubenswrapper[5120]: I0316 16:56:22.569220 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c336b7b3-c896-4066-a40a-ca516ed7c2c1-logs\") pod \"placement-db-sync-np5jg\" (UID: \"c336b7b3-c896-4066-a40a-ca516ed7c2c1\") " pod="openstack-kuttl-tests/placement-db-sync-np5jg" Mar 16 16:56:22 crc kubenswrapper[5120]: I0316 16:56:22.569336 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/519f2986-0498-4f41-b63e-3137e48794e8-log-httpd\") pod \"ceilometer-0\" (UID: \"519f2986-0498-4f41-b63e-3137e48794e8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:56:22 crc kubenswrapper[5120]: I0316 16:56:22.569574 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c336b7b3-c896-4066-a40a-ca516ed7c2c1-scripts\") pod \"placement-db-sync-np5jg\" (UID: \"c336b7b3-c896-4066-a40a-ca516ed7c2c1\") " pod="openstack-kuttl-tests/placement-db-sync-np5jg" Mar 16 16:56:22 crc kubenswrapper[5120]: I0316 16:56:22.569717 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/519f2986-0498-4f41-b63e-3137e48794e8-run-httpd\") pod \"ceilometer-0\" (UID: \"519f2986-0498-4f41-b63e-3137e48794e8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:56:22 crc kubenswrapper[5120]: I0316 16:56:22.569857 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/519f2986-0498-4f41-b63e-3137e48794e8-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"519f2986-0498-4f41-b63e-3137e48794e8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:56:22 crc kubenswrapper[5120]: I0316 16:56:22.571213 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/519f2986-0498-4f41-b63e-3137e48794e8-log-httpd\") pod \"ceilometer-0\" (UID: \"519f2986-0498-4f41-b63e-3137e48794e8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:56:22 crc kubenswrapper[5120]: I0316 16:56:22.573803 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/519f2986-0498-4f41-b63e-3137e48794e8-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"519f2986-0498-4f41-b63e-3137e48794e8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:56:22 crc kubenswrapper[5120]: I0316 16:56:22.573961 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/519f2986-0498-4f41-b63e-3137e48794e8-config-data\") pod \"ceilometer-0\" (UID: \"519f2986-0498-4f41-b63e-3137e48794e8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:56:22 crc kubenswrapper[5120]: I0316 16:56:22.574227 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c336b7b3-c896-4066-a40a-ca516ed7c2c1-config-data\") pod \"placement-db-sync-np5jg\" (UID: \"c336b7b3-c896-4066-a40a-ca516ed7c2c1\") " pod="openstack-kuttl-tests/placement-db-sync-np5jg" Mar 16 16:56:22 crc kubenswrapper[5120]: I0316 16:56:22.574345 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/519f2986-0498-4f41-b63e-3137e48794e8-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"519f2986-0498-4f41-b63e-3137e48794e8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:56:22 crc kubenswrapper[5120]: I0316 16:56:22.574609 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c336b7b3-c896-4066-a40a-ca516ed7c2c1-logs\") pod \"placement-db-sync-np5jg\" (UID: \"c336b7b3-c896-4066-a40a-ca516ed7c2c1\") " pod="openstack-kuttl-tests/placement-db-sync-np5jg" Mar 16 16:56:22 crc kubenswrapper[5120]: I0316 16:56:22.574810 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/519f2986-0498-4f41-b63e-3137e48794e8-run-httpd\") pod \"ceilometer-0\" (UID: \"519f2986-0498-4f41-b63e-3137e48794e8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:56:22 crc kubenswrapper[5120]: I0316 16:56:22.576055 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/519f2986-0498-4f41-b63e-3137e48794e8-scripts\") pod \"ceilometer-0\" (UID: \"519f2986-0498-4f41-b63e-3137e48794e8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:56:22 crc kubenswrapper[5120]: I0316 16:56:22.576550 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c336b7b3-c896-4066-a40a-ca516ed7c2c1-scripts\") pod \"placement-db-sync-np5jg\" (UID: \"c336b7b3-c896-4066-a40a-ca516ed7c2c1\") " pod="openstack-kuttl-tests/placement-db-sync-np5jg" Mar 16 16:56:22 crc kubenswrapper[5120]: I0316 16:56:22.578547 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c336b7b3-c896-4066-a40a-ca516ed7c2c1-combined-ca-bundle\") pod \"placement-db-sync-np5jg\" (UID: \"c336b7b3-c896-4066-a40a-ca516ed7c2c1\") " pod="openstack-kuttl-tests/placement-db-sync-np5jg" Mar 16 16:56:22 crc kubenswrapper[5120]: I0316 16:56:22.595320 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5g8x\" (UniqueName: \"kubernetes.io/projected/c336b7b3-c896-4066-a40a-ca516ed7c2c1-kube-api-access-z5g8x\") pod \"placement-db-sync-np5jg\" (UID: \"c336b7b3-c896-4066-a40a-ca516ed7c2c1\") " pod="openstack-kuttl-tests/placement-db-sync-np5jg" Mar 16 16:56:22 crc kubenswrapper[5120]: I0316 16:56:22.596981 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9d8t\" (UniqueName: \"kubernetes.io/projected/519f2986-0498-4f41-b63e-3137e48794e8-kube-api-access-n9d8t\") pod \"ceilometer-0\" (UID: \"519f2986-0498-4f41-b63e-3137e48794e8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:56:22 crc kubenswrapper[5120]: I0316 16:56:22.739283 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-np5jg" Mar 16 16:56:22 crc kubenswrapper[5120]: I0316 16:56:22.852427 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:56:22 crc kubenswrapper[5120]: I0316 16:56:22.980330 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-kc6pl"] Mar 16 16:56:23 crc kubenswrapper[5120]: I0316 16:56:23.172021 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:56:23 crc kubenswrapper[5120]: I0316 16:56:23.199060 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:56:23 crc kubenswrapper[5120]: I0316 16:56:23.203995 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-glance-dockercfg-tgms4\"" Mar 16 16:56:23 crc kubenswrapper[5120]: I0316 16:56:23.204344 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-public-svc\"" Mar 16 16:56:23 crc kubenswrapper[5120]: I0316 16:56:23.204596 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-scripts\"" Mar 16 16:56:23 crc kubenswrapper[5120]: I0316 16:56:23.205313 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-external-config-data\"" Mar 16 16:56:23 crc kubenswrapper[5120]: I0316 16:56:23.239077 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:56:23 crc kubenswrapper[5120]: I0316 16:56:23.266515 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:56:23 crc kubenswrapper[5120]: I0316 16:56:23.280400 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:56:23 crc kubenswrapper[5120]: I0316 16:56:23.289837 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j99d5\" (UniqueName: \"kubernetes.io/projected/87a87799-b746-468e-876e-d5a5f7f006ca-kube-api-access-j99d5\") pod \"glance-default-external-api-0\" (UID: \"87a87799-b746-468e-876e-d5a5f7f006ca\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:56:23 crc kubenswrapper[5120]: I0316 16:56:23.290010 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/87a87799-b746-468e-876e-d5a5f7f006ca-scripts\") pod \"glance-default-external-api-0\" (UID: \"87a87799-b746-468e-876e-d5a5f7f006ca\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:56:23 crc kubenswrapper[5120]: I0316 16:56:23.290346 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/87a87799-b746-468e-876e-d5a5f7f006ca-config-data\") pod \"glance-default-external-api-0\" (UID: \"87a87799-b746-468e-876e-d5a5f7f006ca\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:56:23 crc kubenswrapper[5120]: I0316 16:56:23.290391 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/87a87799-b746-468e-876e-d5a5f7f006ca-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"87a87799-b746-468e-876e-d5a5f7f006ca\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:56:23 crc kubenswrapper[5120]: I0316 16:56:23.290468 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/87a87799-b746-468e-876e-d5a5f7f006ca-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"87a87799-b746-468e-876e-d5a5f7f006ca\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:56:23 crc kubenswrapper[5120]: I0316 16:56:23.290506 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/87a87799-b746-468e-876e-d5a5f7f006ca-logs\") pod \"glance-default-external-api-0\" (UID: \"87a87799-b746-468e-876e-d5a5f7f006ca\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:56:23 crc kubenswrapper[5120]: I0316 16:56:23.290526 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/87a87799-b746-468e-876e-d5a5f7f006ca-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"87a87799-b746-468e-876e-d5a5f7f006ca\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:56:23 crc kubenswrapper[5120]: I0316 16:56:23.290888 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"glance-default-external-api-0\" (UID: \"87a87799-b746-468e-876e-d5a5f7f006ca\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:56:23 crc kubenswrapper[5120]: I0316 16:56:23.317170 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-np5jg"] Mar 16 16:56:23 crc kubenswrapper[5120]: I0316 16:56:23.317203 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:56:23 crc kubenswrapper[5120]: I0316 16:56:23.317301 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:56:23 crc kubenswrapper[5120]: I0316 16:56:23.320146 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-internal-svc\"" Mar 16 16:56:23 crc kubenswrapper[5120]: I0316 16:56:23.321357 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-internal-config-data\"" Mar 16 16:56:23 crc kubenswrapper[5120]: I0316 16:56:23.393876 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ab8eb1e5-5cec-4ca4-a92d-4da46f3d6f9e-logs\") pod \"glance-default-internal-api-0\" (UID: \"ab8eb1e5-5cec-4ca4-a92d-4da46f3d6f9e\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:56:23 crc kubenswrapper[5120]: I0316 16:56:23.393924 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ab8eb1e5-5cec-4ca4-a92d-4da46f3d6f9e-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"ab8eb1e5-5cec-4ca4-a92d-4da46f3d6f9e\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:56:23 crc kubenswrapper[5120]: I0316 16:56:23.393961 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"glance-default-external-api-0\" (UID: \"87a87799-b746-468e-876e-d5a5f7f006ca\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:56:23 crc kubenswrapper[5120]: I0316 16:56:23.394034 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j99d5\" (UniqueName: \"kubernetes.io/projected/87a87799-b746-468e-876e-d5a5f7f006ca-kube-api-access-j99d5\") pod \"glance-default-external-api-0\" (UID: \"87a87799-b746-468e-876e-d5a5f7f006ca\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:56:23 crc kubenswrapper[5120]: I0316 16:56:23.394375 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/87a87799-b746-468e-876e-d5a5f7f006ca-scripts\") pod \"glance-default-external-api-0\" (UID: \"87a87799-b746-468e-876e-d5a5f7f006ca\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:56:23 crc kubenswrapper[5120]: I0316 16:56:23.394438 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"glance-default-internal-api-0\" (UID: \"ab8eb1e5-5cec-4ca4-a92d-4da46f3d6f9e\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:56:23 crc kubenswrapper[5120]: I0316 16:56:23.394467 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ab8eb1e5-5cec-4ca4-a92d-4da46f3d6f9e-config-data\") pod \"glance-default-internal-api-0\" (UID: \"ab8eb1e5-5cec-4ca4-a92d-4da46f3d6f9e\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:56:23 crc kubenswrapper[5120]: I0316 16:56:23.394541 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/ab8eb1e5-5cec-4ca4-a92d-4da46f3d6f9e-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"ab8eb1e5-5cec-4ca4-a92d-4da46f3d6f9e\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:56:23 crc kubenswrapper[5120]: I0316 16:56:23.394593 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/87a87799-b746-468e-876e-d5a5f7f006ca-config-data\") pod \"glance-default-external-api-0\" (UID: \"87a87799-b746-468e-876e-d5a5f7f006ca\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:56:23 crc kubenswrapper[5120]: I0316 16:56:23.394612 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ab8eb1e5-5cec-4ca4-a92d-4da46f3d6f9e-scripts\") pod \"glance-default-internal-api-0\" (UID: \"ab8eb1e5-5cec-4ca4-a92d-4da46f3d6f9e\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:56:23 crc kubenswrapper[5120]: I0316 16:56:23.394628 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pptqt\" (UniqueName: \"kubernetes.io/projected/ab8eb1e5-5cec-4ca4-a92d-4da46f3d6f9e-kube-api-access-pptqt\") pod \"glance-default-internal-api-0\" (UID: \"ab8eb1e5-5cec-4ca4-a92d-4da46f3d6f9e\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:56:23 crc kubenswrapper[5120]: I0316 16:56:23.394645 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/87a87799-b746-468e-876e-d5a5f7f006ca-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"87a87799-b746-468e-876e-d5a5f7f006ca\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:56:23 crc kubenswrapper[5120]: I0316 16:56:23.394671 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/87a87799-b746-468e-876e-d5a5f7f006ca-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"87a87799-b746-468e-876e-d5a5f7f006ca\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:56:23 crc kubenswrapper[5120]: I0316 16:56:23.394697 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/87a87799-b746-468e-876e-d5a5f7f006ca-logs\") pod \"glance-default-external-api-0\" (UID: \"87a87799-b746-468e-876e-d5a5f7f006ca\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:56:23 crc kubenswrapper[5120]: I0316 16:56:23.395057 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/87a87799-b746-468e-876e-d5a5f7f006ca-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"87a87799-b746-468e-876e-d5a5f7f006ca\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:56:23 crc kubenswrapper[5120]: I0316 16:56:23.395101 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/ab8eb1e5-5cec-4ca4-a92d-4da46f3d6f9e-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"ab8eb1e5-5cec-4ca4-a92d-4da46f3d6f9e\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:56:23 crc kubenswrapper[5120]: I0316 16:56:23.395196 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"glance-default-external-api-0\" (UID: \"87a87799-b746-468e-876e-d5a5f7f006ca\") device mount path \"/mnt/openstack/pv05\"" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:56:23 crc kubenswrapper[5120]: I0316 16:56:23.397175 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/87a87799-b746-468e-876e-d5a5f7f006ca-logs\") pod \"glance-default-external-api-0\" (UID: \"87a87799-b746-468e-876e-d5a5f7f006ca\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:56:23 crc kubenswrapper[5120]: I0316 16:56:23.397212 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/87a87799-b746-468e-876e-d5a5f7f006ca-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"87a87799-b746-468e-876e-d5a5f7f006ca\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:56:23 crc kubenswrapper[5120]: I0316 16:56:23.402607 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/87a87799-b746-468e-876e-d5a5f7f006ca-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"87a87799-b746-468e-876e-d5a5f7f006ca\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:56:23 crc kubenswrapper[5120]: I0316 16:56:23.404529 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/87a87799-b746-468e-876e-d5a5f7f006ca-config-data\") pod \"glance-default-external-api-0\" (UID: \"87a87799-b746-468e-876e-d5a5f7f006ca\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:56:23 crc kubenswrapper[5120]: I0316 16:56:23.410175 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/87a87799-b746-468e-876e-d5a5f7f006ca-scripts\") pod \"glance-default-external-api-0\" (UID: \"87a87799-b746-468e-876e-d5a5f7f006ca\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:56:23 crc kubenswrapper[5120]: I0316 16:56:23.410591 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/87a87799-b746-468e-876e-d5a5f7f006ca-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"87a87799-b746-468e-876e-d5a5f7f006ca\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:56:23 crc kubenswrapper[5120]: I0316 16:56:23.414870 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j99d5\" (UniqueName: \"kubernetes.io/projected/87a87799-b746-468e-876e-d5a5f7f006ca-kube-api-access-j99d5\") pod \"glance-default-external-api-0\" (UID: \"87a87799-b746-468e-876e-d5a5f7f006ca\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:56:23 crc kubenswrapper[5120]: I0316 16:56:23.436636 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"glance-default-external-api-0\" (UID: \"87a87799-b746-468e-876e-d5a5f7f006ca\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:56:23 crc kubenswrapper[5120]: I0316 16:56:23.480200 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:56:23 crc kubenswrapper[5120]: I0316 16:56:23.497647 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"glance-default-internal-api-0\" (UID: \"ab8eb1e5-5cec-4ca4-a92d-4da46f3d6f9e\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:56:23 crc kubenswrapper[5120]: I0316 16:56:23.497712 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ab8eb1e5-5cec-4ca4-a92d-4da46f3d6f9e-config-data\") pod \"glance-default-internal-api-0\" (UID: \"ab8eb1e5-5cec-4ca4-a92d-4da46f3d6f9e\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:56:23 crc kubenswrapper[5120]: I0316 16:56:23.497813 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/ab8eb1e5-5cec-4ca4-a92d-4da46f3d6f9e-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"ab8eb1e5-5cec-4ca4-a92d-4da46f3d6f9e\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:56:23 crc kubenswrapper[5120]: I0316 16:56:23.497896 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ab8eb1e5-5cec-4ca4-a92d-4da46f3d6f9e-scripts\") pod \"glance-default-internal-api-0\" (UID: \"ab8eb1e5-5cec-4ca4-a92d-4da46f3d6f9e\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:56:23 crc kubenswrapper[5120]: I0316 16:56:23.497948 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pptqt\" (UniqueName: \"kubernetes.io/projected/ab8eb1e5-5cec-4ca4-a92d-4da46f3d6f9e-kube-api-access-pptqt\") pod \"glance-default-internal-api-0\" (UID: \"ab8eb1e5-5cec-4ca4-a92d-4da46f3d6f9e\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:56:23 crc kubenswrapper[5120]: I0316 16:56:23.498013 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/ab8eb1e5-5cec-4ca4-a92d-4da46f3d6f9e-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"ab8eb1e5-5cec-4ca4-a92d-4da46f3d6f9e\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:56:23 crc kubenswrapper[5120]: I0316 16:56:23.498138 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ab8eb1e5-5cec-4ca4-a92d-4da46f3d6f9e-logs\") pod \"glance-default-internal-api-0\" (UID: \"ab8eb1e5-5cec-4ca4-a92d-4da46f3d6f9e\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:56:23 crc kubenswrapper[5120]: I0316 16:56:23.498171 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ab8eb1e5-5cec-4ca4-a92d-4da46f3d6f9e-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"ab8eb1e5-5cec-4ca4-a92d-4da46f3d6f9e\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:56:23 crc kubenswrapper[5120]: I0316 16:56:23.502706 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ab8eb1e5-5cec-4ca4-a92d-4da46f3d6f9e-logs\") pod \"glance-default-internal-api-0\" (UID: \"ab8eb1e5-5cec-4ca4-a92d-4da46f3d6f9e\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:56:23 crc kubenswrapper[5120]: I0316 16:56:23.502800 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"glance-default-internal-api-0\" (UID: \"ab8eb1e5-5cec-4ca4-a92d-4da46f3d6f9e\") device mount path \"/mnt/openstack/pv06\"" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:56:23 crc kubenswrapper[5120]: I0316 16:56:23.503050 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/ab8eb1e5-5cec-4ca4-a92d-4da46f3d6f9e-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"ab8eb1e5-5cec-4ca4-a92d-4da46f3d6f9e\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:56:23 crc kubenswrapper[5120]: I0316 16:56:23.520972 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ab8eb1e5-5cec-4ca4-a92d-4da46f3d6f9e-scripts\") pod \"glance-default-internal-api-0\" (UID: \"ab8eb1e5-5cec-4ca4-a92d-4da46f3d6f9e\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:56:23 crc kubenswrapper[5120]: I0316 16:56:23.544415 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ab8eb1e5-5cec-4ca4-a92d-4da46f3d6f9e-config-data\") pod \"glance-default-internal-api-0\" (UID: \"ab8eb1e5-5cec-4ca4-a92d-4da46f3d6f9e\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:56:23 crc kubenswrapper[5120]: I0316 16:56:23.545492 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/ab8eb1e5-5cec-4ca4-a92d-4da46f3d6f9e-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"ab8eb1e5-5cec-4ca4-a92d-4da46f3d6f9e\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:56:23 crc kubenswrapper[5120]: I0316 16:56:23.546715 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ab8eb1e5-5cec-4ca4-a92d-4da46f3d6f9e-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"ab8eb1e5-5cec-4ca4-a92d-4da46f3d6f9e\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:56:23 crc kubenswrapper[5120]: I0316 16:56:23.546931 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pptqt\" (UniqueName: \"kubernetes.io/projected/ab8eb1e5-5cec-4ca4-a92d-4da46f3d6f9e-kube-api-access-pptqt\") pod \"glance-default-internal-api-0\" (UID: \"ab8eb1e5-5cec-4ca4-a92d-4da46f3d6f9e\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:56:23 crc kubenswrapper[5120]: I0316 16:56:23.581136 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"glance-default-internal-api-0\" (UID: \"ab8eb1e5-5cec-4ca4-a92d-4da46f3d6f9e\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:56:23 crc kubenswrapper[5120]: I0316 16:56:23.591778 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:56:23 crc kubenswrapper[5120]: I0316 16:56:23.831473 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"519f2986-0498-4f41-b63e-3137e48794e8","Type":"ContainerStarted","Data":"152cfe7403123f9da435171204df4c87db69c002faffa96dfcbdd0bcb511f7ab"} Mar 16 16:56:23 crc kubenswrapper[5120]: I0316 16:56:23.841711 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-kc6pl" event={"ID":"4cb6be6a-67ac-4e35-aacf-d1df8c5c9c11","Type":"ContainerStarted","Data":"c3734c1f7a2516f61c2ebf8d78d0ed774a324bcc7d1d3f325ed904393918d581"} Mar 16 16:56:23 crc kubenswrapper[5120]: I0316 16:56:23.841791 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-kc6pl" event={"ID":"4cb6be6a-67ac-4e35-aacf-d1df8c5c9c11","Type":"ContainerStarted","Data":"d4d3f81b4ef99496da18abfc9aa79421efd3a5f54c8893d9b6525a389f882aee"} Mar 16 16:56:23 crc kubenswrapper[5120]: I0316 16:56:23.845627 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-np5jg" event={"ID":"c336b7b3-c896-4066-a40a-ca516ed7c2c1","Type":"ContainerStarted","Data":"7b5294ca5bc91805a1a9b36d87be84b93cad56915950107a1c221f00497c2fb6"} Mar 16 16:56:23 crc kubenswrapper[5120]: I0316 16:56:23.845682 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-np5jg" event={"ID":"c336b7b3-c896-4066-a40a-ca516ed7c2c1","Type":"ContainerStarted","Data":"9587a7efd36df9601a96de358fe1b446c74c9e6284bbcc82da884733fabf8fb4"} Mar 16 16:56:23 crc kubenswrapper[5120]: I0316 16:56:23.903523 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-bootstrap-kc6pl" podStartSLOduration=1.903495621 podStartE2EDuration="1.903495621s" podCreationTimestamp="2026-03-16 16:56:22 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:56:23.86948763 +0000 UTC m=+5086.023419297" watchObservedRunningTime="2026-03-16 16:56:23.903495621 +0000 UTC m=+5086.057427288" Mar 16 16:56:23 crc kubenswrapper[5120]: I0316 16:56:23.908869 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-db-sync-np5jg" podStartSLOduration=1.9088428670000002 podStartE2EDuration="1.908842867s" podCreationTimestamp="2026-03-16 16:56:22 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:56:23.896002506 +0000 UTC m=+5086.049934163" watchObservedRunningTime="2026-03-16 16:56:23.908842867 +0000 UTC m=+5086.062774534" Mar 16 16:56:24 crc kubenswrapper[5120]: I0316 16:56:24.069771 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:56:24 crc kubenswrapper[5120]: I0316 16:56:24.223638 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:56:24 crc kubenswrapper[5120]: I0316 16:56:24.247240 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-2nkb5"] Mar 16 16:56:24 crc kubenswrapper[5120]: I0316 16:56:24.258221 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-2nkb5" Mar 16 16:56:24 crc kubenswrapper[5120]: I0316 16:56:24.261636 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-httpd-config\"" Mar 16 16:56:24 crc kubenswrapper[5120]: I0316 16:56:24.262907 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-neutron-dockercfg-xnqrd\"" Mar 16 16:56:24 crc kubenswrapper[5120]: I0316 16:56:24.263041 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-config\"" Mar 16 16:56:24 crc kubenswrapper[5120]: I0316 16:56:24.286003 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-2nkb5"] Mar 16 16:56:24 crc kubenswrapper[5120]: I0316 16:56:24.329395 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2cc34ac9-c7e0-4a0b-9984-a571c4f1c80d-config\") pod \"neutron-db-sync-2nkb5\" (UID: \"2cc34ac9-c7e0-4a0b-9984-a571c4f1c80d\") " pod="openstack-kuttl-tests/neutron-db-sync-2nkb5" Mar 16 16:56:24 crc kubenswrapper[5120]: I0316 16:56:24.336718 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clsxd\" (UniqueName: \"kubernetes.io/projected/2cc34ac9-c7e0-4a0b-9984-a571c4f1c80d-kube-api-access-clsxd\") pod \"neutron-db-sync-2nkb5\" (UID: \"2cc34ac9-c7e0-4a0b-9984-a571c4f1c80d\") " pod="openstack-kuttl-tests/neutron-db-sync-2nkb5" Mar 16 16:56:24 crc kubenswrapper[5120]: I0316 16:56:24.337069 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2cc34ac9-c7e0-4a0b-9984-a571c4f1c80d-combined-ca-bundle\") pod \"neutron-db-sync-2nkb5\" (UID: \"2cc34ac9-c7e0-4a0b-9984-a571c4f1c80d\") " pod="openstack-kuttl-tests/neutron-db-sync-2nkb5" Mar 16 16:56:24 crc kubenswrapper[5120]: I0316 16:56:24.440270 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2cc34ac9-c7e0-4a0b-9984-a571c4f1c80d-config\") pod \"neutron-db-sync-2nkb5\" (UID: \"2cc34ac9-c7e0-4a0b-9984-a571c4f1c80d\") " pod="openstack-kuttl-tests/neutron-db-sync-2nkb5" Mar 16 16:56:24 crc kubenswrapper[5120]: I0316 16:56:24.440524 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-clsxd\" (UniqueName: \"kubernetes.io/projected/2cc34ac9-c7e0-4a0b-9984-a571c4f1c80d-kube-api-access-clsxd\") pod \"neutron-db-sync-2nkb5\" (UID: \"2cc34ac9-c7e0-4a0b-9984-a571c4f1c80d\") " pod="openstack-kuttl-tests/neutron-db-sync-2nkb5" Mar 16 16:56:24 crc kubenswrapper[5120]: I0316 16:56:24.440701 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2cc34ac9-c7e0-4a0b-9984-a571c4f1c80d-combined-ca-bundle\") pod \"neutron-db-sync-2nkb5\" (UID: \"2cc34ac9-c7e0-4a0b-9984-a571c4f1c80d\") " pod="openstack-kuttl-tests/neutron-db-sync-2nkb5" Mar 16 16:56:24 crc kubenswrapper[5120]: I0316 16:56:24.450282 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-q2bn4"] Mar 16 16:56:24 crc kubenswrapper[5120]: I0316 16:56:24.462630 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2cc34ac9-c7e0-4a0b-9984-a571c4f1c80d-combined-ca-bundle\") pod \"neutron-db-sync-2nkb5\" (UID: \"2cc34ac9-c7e0-4a0b-9984-a571c4f1c80d\") " pod="openstack-kuttl-tests/neutron-db-sync-2nkb5" Mar 16 16:56:24 crc kubenswrapper[5120]: I0316 16:56:24.470645 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-q2bn4" Mar 16 16:56:24 crc kubenswrapper[5120]: I0316 16:56:24.473248 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-cinder-dockercfg-z2rp2\"" Mar 16 16:56:24 crc kubenswrapper[5120]: I0316 16:56:24.473351 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-scripts\"" Mar 16 16:56:24 crc kubenswrapper[5120]: I0316 16:56:24.479143 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-config-data\"" Mar 16 16:56:24 crc kubenswrapper[5120]: I0316 16:56:24.479397 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-clsxd\" (UniqueName: \"kubernetes.io/projected/2cc34ac9-c7e0-4a0b-9984-a571c4f1c80d-kube-api-access-clsxd\") pod \"neutron-db-sync-2nkb5\" (UID: \"2cc34ac9-c7e0-4a0b-9984-a571c4f1c80d\") " pod="openstack-kuttl-tests/neutron-db-sync-2nkb5" Mar 16 16:56:24 crc kubenswrapper[5120]: I0316 16:56:24.509585 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/2cc34ac9-c7e0-4a0b-9984-a571c4f1c80d-config\") pod \"neutron-db-sync-2nkb5\" (UID: \"2cc34ac9-c7e0-4a0b-9984-a571c4f1c80d\") " pod="openstack-kuttl-tests/neutron-db-sync-2nkb5" Mar 16 16:56:24 crc kubenswrapper[5120]: I0316 16:56:24.521867 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-q2bn4"] Mar 16 16:56:24 crc kubenswrapper[5120]: I0316 16:56:24.544877 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e199c216-19d8-4055-9a2b-3d65e13116a2-config-data\") pod \"cinder-db-sync-q2bn4\" (UID: \"e199c216-19d8-4055-9a2b-3d65e13116a2\") " pod="openstack-kuttl-tests/cinder-db-sync-q2bn4" Mar 16 16:56:24 crc kubenswrapper[5120]: I0316 16:56:24.545084 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fdvq\" (UniqueName: \"kubernetes.io/projected/e199c216-19d8-4055-9a2b-3d65e13116a2-kube-api-access-6fdvq\") pod \"cinder-db-sync-q2bn4\" (UID: \"e199c216-19d8-4055-9a2b-3d65e13116a2\") " pod="openstack-kuttl-tests/cinder-db-sync-q2bn4" Mar 16 16:56:24 crc kubenswrapper[5120]: I0316 16:56:24.545359 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e199c216-19d8-4055-9a2b-3d65e13116a2-scripts\") pod \"cinder-db-sync-q2bn4\" (UID: \"e199c216-19d8-4055-9a2b-3d65e13116a2\") " pod="openstack-kuttl-tests/cinder-db-sync-q2bn4" Mar 16 16:56:24 crc kubenswrapper[5120]: I0316 16:56:24.545501 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/e199c216-19d8-4055-9a2b-3d65e13116a2-etc-machine-id\") pod \"cinder-db-sync-q2bn4\" (UID: \"e199c216-19d8-4055-9a2b-3d65e13116a2\") " pod="openstack-kuttl-tests/cinder-db-sync-q2bn4" Mar 16 16:56:24 crc kubenswrapper[5120]: I0316 16:56:24.545538 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/e199c216-19d8-4055-9a2b-3d65e13116a2-db-sync-config-data\") pod \"cinder-db-sync-q2bn4\" (UID: \"e199c216-19d8-4055-9a2b-3d65e13116a2\") " pod="openstack-kuttl-tests/cinder-db-sync-q2bn4" Mar 16 16:56:24 crc kubenswrapper[5120]: I0316 16:56:24.545669 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e199c216-19d8-4055-9a2b-3d65e13116a2-combined-ca-bundle\") pod \"cinder-db-sync-q2bn4\" (UID: \"e199c216-19d8-4055-9a2b-3d65e13116a2\") " pod="openstack-kuttl-tests/cinder-db-sync-q2bn4" Mar 16 16:56:24 crc kubenswrapper[5120]: I0316 16:56:24.559249 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-zmwzp"] Mar 16 16:56:24 crc kubenswrapper[5120]: I0316 16:56:24.597352 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-zmwzp"] Mar 16 16:56:24 crc kubenswrapper[5120]: I0316 16:56:24.597504 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-zmwzp" Mar 16 16:56:24 crc kubenswrapper[5120]: I0316 16:56:24.602799 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-config-data\"" Mar 16 16:56:24 crc kubenswrapper[5120]: I0316 16:56:24.603312 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-barbican-dockercfg-72rxd\"" Mar 16 16:56:24 crc kubenswrapper[5120]: I0316 16:56:24.647582 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f38ba03a-736c-4963-9059-d50f52f0bbf5-combined-ca-bundle\") pod \"barbican-db-sync-zmwzp\" (UID: \"f38ba03a-736c-4963-9059-d50f52f0bbf5\") " pod="openstack-kuttl-tests/barbican-db-sync-zmwzp" Mar 16 16:56:24 crc kubenswrapper[5120]: I0316 16:56:24.647633 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/e199c216-19d8-4055-9a2b-3d65e13116a2-etc-machine-id\") pod \"cinder-db-sync-q2bn4\" (UID: \"e199c216-19d8-4055-9a2b-3d65e13116a2\") " pod="openstack-kuttl-tests/cinder-db-sync-q2bn4" Mar 16 16:56:24 crc kubenswrapper[5120]: I0316 16:56:24.647661 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/e199c216-19d8-4055-9a2b-3d65e13116a2-db-sync-config-data\") pod \"cinder-db-sync-q2bn4\" (UID: \"e199c216-19d8-4055-9a2b-3d65e13116a2\") " pod="openstack-kuttl-tests/cinder-db-sync-q2bn4" Mar 16 16:56:24 crc kubenswrapper[5120]: I0316 16:56:24.647698 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e199c216-19d8-4055-9a2b-3d65e13116a2-combined-ca-bundle\") pod \"cinder-db-sync-q2bn4\" (UID: \"e199c216-19d8-4055-9a2b-3d65e13116a2\") " pod="openstack-kuttl-tests/cinder-db-sync-q2bn4" Mar 16 16:56:24 crc kubenswrapper[5120]: I0316 16:56:24.647753 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggtzq\" (UniqueName: \"kubernetes.io/projected/f38ba03a-736c-4963-9059-d50f52f0bbf5-kube-api-access-ggtzq\") pod \"barbican-db-sync-zmwzp\" (UID: \"f38ba03a-736c-4963-9059-d50f52f0bbf5\") " pod="openstack-kuttl-tests/barbican-db-sync-zmwzp" Mar 16 16:56:24 crc kubenswrapper[5120]: I0316 16:56:24.647809 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/f38ba03a-736c-4963-9059-d50f52f0bbf5-db-sync-config-data\") pod \"barbican-db-sync-zmwzp\" (UID: \"f38ba03a-736c-4963-9059-d50f52f0bbf5\") " pod="openstack-kuttl-tests/barbican-db-sync-zmwzp" Mar 16 16:56:24 crc kubenswrapper[5120]: I0316 16:56:24.647908 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e199c216-19d8-4055-9a2b-3d65e13116a2-config-data\") pod \"cinder-db-sync-q2bn4\" (UID: \"e199c216-19d8-4055-9a2b-3d65e13116a2\") " pod="openstack-kuttl-tests/cinder-db-sync-q2bn4" Mar 16 16:56:24 crc kubenswrapper[5120]: I0316 16:56:24.648127 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6fdvq\" (UniqueName: \"kubernetes.io/projected/e199c216-19d8-4055-9a2b-3d65e13116a2-kube-api-access-6fdvq\") pod \"cinder-db-sync-q2bn4\" (UID: \"e199c216-19d8-4055-9a2b-3d65e13116a2\") " pod="openstack-kuttl-tests/cinder-db-sync-q2bn4" Mar 16 16:56:24 crc kubenswrapper[5120]: I0316 16:56:24.648172 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e199c216-19d8-4055-9a2b-3d65e13116a2-scripts\") pod \"cinder-db-sync-q2bn4\" (UID: \"e199c216-19d8-4055-9a2b-3d65e13116a2\") " pod="openstack-kuttl-tests/cinder-db-sync-q2bn4" Mar 16 16:56:24 crc kubenswrapper[5120]: I0316 16:56:24.648449 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/e199c216-19d8-4055-9a2b-3d65e13116a2-etc-machine-id\") pod \"cinder-db-sync-q2bn4\" (UID: \"e199c216-19d8-4055-9a2b-3d65e13116a2\") " pod="openstack-kuttl-tests/cinder-db-sync-q2bn4" Mar 16 16:56:24 crc kubenswrapper[5120]: I0316 16:56:24.652608 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/e199c216-19d8-4055-9a2b-3d65e13116a2-db-sync-config-data\") pod \"cinder-db-sync-q2bn4\" (UID: \"e199c216-19d8-4055-9a2b-3d65e13116a2\") " pod="openstack-kuttl-tests/cinder-db-sync-q2bn4" Mar 16 16:56:24 crc kubenswrapper[5120]: I0316 16:56:24.653003 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-2nkb5" Mar 16 16:56:24 crc kubenswrapper[5120]: I0316 16:56:24.655268 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e199c216-19d8-4055-9a2b-3d65e13116a2-config-data\") pod \"cinder-db-sync-q2bn4\" (UID: \"e199c216-19d8-4055-9a2b-3d65e13116a2\") " pod="openstack-kuttl-tests/cinder-db-sync-q2bn4" Mar 16 16:56:24 crc kubenswrapper[5120]: I0316 16:56:24.656479 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e199c216-19d8-4055-9a2b-3d65e13116a2-combined-ca-bundle\") pod \"cinder-db-sync-q2bn4\" (UID: \"e199c216-19d8-4055-9a2b-3d65e13116a2\") " pod="openstack-kuttl-tests/cinder-db-sync-q2bn4" Mar 16 16:56:24 crc kubenswrapper[5120]: I0316 16:56:24.657602 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e199c216-19d8-4055-9a2b-3d65e13116a2-scripts\") pod \"cinder-db-sync-q2bn4\" (UID: \"e199c216-19d8-4055-9a2b-3d65e13116a2\") " pod="openstack-kuttl-tests/cinder-db-sync-q2bn4" Mar 16 16:56:24 crc kubenswrapper[5120]: I0316 16:56:24.669106 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fdvq\" (UniqueName: \"kubernetes.io/projected/e199c216-19d8-4055-9a2b-3d65e13116a2-kube-api-access-6fdvq\") pod \"cinder-db-sync-q2bn4\" (UID: \"e199c216-19d8-4055-9a2b-3d65e13116a2\") " pod="openstack-kuttl-tests/cinder-db-sync-q2bn4" Mar 16 16:56:24 crc kubenswrapper[5120]: I0316 16:56:24.750271 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f38ba03a-736c-4963-9059-d50f52f0bbf5-combined-ca-bundle\") pod \"barbican-db-sync-zmwzp\" (UID: \"f38ba03a-736c-4963-9059-d50f52f0bbf5\") " pod="openstack-kuttl-tests/barbican-db-sync-zmwzp" Mar 16 16:56:24 crc kubenswrapper[5120]: I0316 16:56:24.750493 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ggtzq\" (UniqueName: \"kubernetes.io/projected/f38ba03a-736c-4963-9059-d50f52f0bbf5-kube-api-access-ggtzq\") pod \"barbican-db-sync-zmwzp\" (UID: \"f38ba03a-736c-4963-9059-d50f52f0bbf5\") " pod="openstack-kuttl-tests/barbican-db-sync-zmwzp" Mar 16 16:56:24 crc kubenswrapper[5120]: I0316 16:56:24.750562 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/f38ba03a-736c-4963-9059-d50f52f0bbf5-db-sync-config-data\") pod \"barbican-db-sync-zmwzp\" (UID: \"f38ba03a-736c-4963-9059-d50f52f0bbf5\") " pod="openstack-kuttl-tests/barbican-db-sync-zmwzp" Mar 16 16:56:24 crc kubenswrapper[5120]: I0316 16:56:24.757784 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/f38ba03a-736c-4963-9059-d50f52f0bbf5-db-sync-config-data\") pod \"barbican-db-sync-zmwzp\" (UID: \"f38ba03a-736c-4963-9059-d50f52f0bbf5\") " pod="openstack-kuttl-tests/barbican-db-sync-zmwzp" Mar 16 16:56:24 crc kubenswrapper[5120]: I0316 16:56:24.758890 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f38ba03a-736c-4963-9059-d50f52f0bbf5-combined-ca-bundle\") pod \"barbican-db-sync-zmwzp\" (UID: \"f38ba03a-736c-4963-9059-d50f52f0bbf5\") " pod="openstack-kuttl-tests/barbican-db-sync-zmwzp" Mar 16 16:56:24 crc kubenswrapper[5120]: I0316 16:56:24.767653 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggtzq\" (UniqueName: \"kubernetes.io/projected/f38ba03a-736c-4963-9059-d50f52f0bbf5-kube-api-access-ggtzq\") pod \"barbican-db-sync-zmwzp\" (UID: \"f38ba03a-736c-4963-9059-d50f52f0bbf5\") " pod="openstack-kuttl-tests/barbican-db-sync-zmwzp" Mar 16 16:56:24 crc kubenswrapper[5120]: I0316 16:56:24.908795 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"519f2986-0498-4f41-b63e-3137e48794e8","Type":"ContainerStarted","Data":"341eb31c49d6a423406aff4c3e064cbb989dc5a7a58334293a86e5c48040d861"} Mar 16 16:56:24 crc kubenswrapper[5120]: I0316 16:56:24.929246 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"ab8eb1e5-5cec-4ca4-a92d-4da46f3d6f9e","Type":"ContainerStarted","Data":"8dfac9a408bdea393172756309f24a7a26fa7d151533415084b78976f848701d"} Mar 16 16:56:24 crc kubenswrapper[5120]: I0316 16:56:24.934819 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"87a87799-b746-468e-876e-d5a5f7f006ca","Type":"ContainerStarted","Data":"24b4a5e74177a31d3c24cc79bda46845ad7b619ecd4339ea1e0006685df476c1"} Mar 16 16:56:24 crc kubenswrapper[5120]: I0316 16:56:24.938982 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-q2bn4" Mar 16 16:56:24 crc kubenswrapper[5120]: I0316 16:56:24.947787 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-zmwzp" Mar 16 16:56:25 crc kubenswrapper[5120]: I0316 16:56:25.165123 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:56:25 crc kubenswrapper[5120]: I0316 16:56:25.200674 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:56:25 crc kubenswrapper[5120]: I0316 16:56:25.219606 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:56:25 crc kubenswrapper[5120]: I0316 16:56:25.227532 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-2nkb5"] Mar 16 16:56:25 crc kubenswrapper[5120]: I0316 16:56:25.731000 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-zmwzp"] Mar 16 16:56:25 crc kubenswrapper[5120]: I0316 16:56:25.849341 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-q2bn4"] Mar 16 16:56:26 crc kubenswrapper[5120]: I0316 16:56:26.025679 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-operators-7mhml" Mar 16 16:56:26 crc kubenswrapper[5120]: I0316 16:56:26.026986 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-marketplace/redhat-operators-7mhml" Mar 16 16:56:26 crc kubenswrapper[5120]: I0316 16:56:26.115589 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"87a87799-b746-468e-876e-d5a5f7f006ca","Type":"ContainerStarted","Data":"fdc16eade7a606828263443b5621476cd36dfd25ade092d009b50a6a4700d14e"} Mar 16 16:56:26 crc kubenswrapper[5120]: I0316 16:56:26.129972 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-operators-7mhml" Mar 16 16:56:26 crc kubenswrapper[5120]: I0316 16:56:26.130795 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-q2bn4" event={"ID":"e199c216-19d8-4055-9a2b-3d65e13116a2","Type":"ContainerStarted","Data":"41005bb9787bc7a4afdcfcb49f205bf805e223064326f8dad1afad2c2c041ccc"} Mar 16 16:56:26 crc kubenswrapper[5120]: I0316 16:56:26.143450 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"519f2986-0498-4f41-b63e-3137e48794e8","Type":"ContainerStarted","Data":"8c88d9913acb46c6812b4fe61151c0facb34b3f867c5a3857e239ee42fa7857a"} Mar 16 16:56:26 crc kubenswrapper[5120]: I0316 16:56:26.154252 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"ab8eb1e5-5cec-4ca4-a92d-4da46f3d6f9e","Type":"ContainerStarted","Data":"0f7585a48866f60806539a589ca22016d43d972a661b4c8032c72fd34921def4"} Mar 16 16:56:26 crc kubenswrapper[5120]: I0316 16:56:26.170133 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-zmwzp" event={"ID":"f38ba03a-736c-4963-9059-d50f52f0bbf5","Type":"ContainerStarted","Data":"ae7a7ad7d281fddc6e15b59cf9f9c079fd1354ea99ee688f03520ee496fdfcb5"} Mar 16 16:56:26 crc kubenswrapper[5120]: I0316 16:56:26.187328 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-2nkb5" event={"ID":"2cc34ac9-c7e0-4a0b-9984-a571c4f1c80d","Type":"ContainerStarted","Data":"3c07d8e4cbd4126b42dc13d408ca198bcbd6f0c92b3ecb09696c4f6a41f38f11"} Mar 16 16:56:26 crc kubenswrapper[5120]: I0316 16:56:26.187396 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-2nkb5" event={"ID":"2cc34ac9-c7e0-4a0b-9984-a571c4f1c80d","Type":"ContainerStarted","Data":"ff1e16f595d111297d4cc9826cf0b94d9da5387c0384aea7cd38d5049f20dee5"} Mar 16 16:56:26 crc kubenswrapper[5120]: I0316 16:56:26.231929 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-db-sync-2nkb5" podStartSLOduration=2.231737696 podStartE2EDuration="2.231737696s" podCreationTimestamp="2026-03-16 16:56:24 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:56:26.213379844 +0000 UTC m=+5088.367311541" watchObservedRunningTime="2026-03-16 16:56:26.231737696 +0000 UTC m=+5088.385669353" Mar 16 16:56:27 crc kubenswrapper[5120]: I0316 16:56:27.257166 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"519f2986-0498-4f41-b63e-3137e48794e8","Type":"ContainerStarted","Data":"0631a64af2d97849fd447322863197a1f71b6367f2a0bbfc14fd56c98a346078"} Mar 16 16:56:27 crc kubenswrapper[5120]: I0316 16:56:27.276408 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-zmwzp" event={"ID":"f38ba03a-736c-4963-9059-d50f52f0bbf5","Type":"ContainerStarted","Data":"8db8e6076fafae9ba6b0baeae22182d94990be75ab4568d643d967c6e11582d6"} Mar 16 16:56:27 crc kubenswrapper[5120]: I0316 16:56:27.296945 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-db-sync-zmwzp" podStartSLOduration=3.296920481 podStartE2EDuration="3.296920481s" podCreationTimestamp="2026-03-16 16:56:24 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:56:27.289357115 +0000 UTC m=+5089.443288772" watchObservedRunningTime="2026-03-16 16:56:27.296920481 +0000 UTC m=+5089.450852138" Mar 16 16:56:27 crc kubenswrapper[5120]: I0316 16:56:27.307608 5120 generic.go:358] "Generic (PLEG): container finished" podID="c336b7b3-c896-4066-a40a-ca516ed7c2c1" containerID="7b5294ca5bc91805a1a9b36d87be84b93cad56915950107a1c221f00497c2fb6" exitCode=0 Mar 16 16:56:27 crc kubenswrapper[5120]: I0316 16:56:27.308018 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-np5jg" event={"ID":"c336b7b3-c896-4066-a40a-ca516ed7c2c1","Type":"ContainerDied","Data":"7b5294ca5bc91805a1a9b36d87be84b93cad56915950107a1c221f00497c2fb6"} Mar 16 16:56:27 crc kubenswrapper[5120]: I0316 16:56:27.335993 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="87a87799-b746-468e-876e-d5a5f7f006ca" containerName="glance-log" containerID="cri-o://fdc16eade7a606828263443b5621476cd36dfd25ade092d009b50a6a4700d14e" gracePeriod=30 Mar 16 16:56:27 crc kubenswrapper[5120]: I0316 16:56:27.336323 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"87a87799-b746-468e-876e-d5a5f7f006ca","Type":"ContainerStarted","Data":"8b7292c4057ffeb9ca93934dec67997dd823993a561eb7629108cd51f653c07a"} Mar 16 16:56:27 crc kubenswrapper[5120]: I0316 16:56:27.336936 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="87a87799-b746-468e-876e-d5a5f7f006ca" containerName="glance-httpd" containerID="cri-o://8b7292c4057ffeb9ca93934dec67997dd823993a561eb7629108cd51f653c07a" gracePeriod=30 Mar 16 16:56:27 crc kubenswrapper[5120]: I0316 16:56:27.447745 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-operators-7mhml" Mar 16 16:56:27 crc kubenswrapper[5120]: I0316 16:56:27.474651 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-external-api-0" podStartSLOduration=5.474626955 podStartE2EDuration="5.474626955s" podCreationTimestamp="2026-03-16 16:56:22 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:56:27.370157387 +0000 UTC m=+5089.524089044" watchObservedRunningTime="2026-03-16 16:56:27.474626955 +0000 UTC m=+5089.628558602" Mar 16 16:56:28 crc kubenswrapper[5120]: I0316 16:56:28.264876 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:56:28 crc kubenswrapper[5120]: I0316 16:56:28.351120 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"ab8eb1e5-5cec-4ca4-a92d-4da46f3d6f9e","Type":"ContainerStarted","Data":"9abc83411da1674d8cb950d0402a72a77430425444b66a865bdd10797ba3720e"} Mar 16 16:56:28 crc kubenswrapper[5120]: I0316 16:56:28.351173 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="ab8eb1e5-5cec-4ca4-a92d-4da46f3d6f9e" containerName="glance-log" containerID="cri-o://0f7585a48866f60806539a589ca22016d43d972a661b4c8032c72fd34921def4" gracePeriod=30 Mar 16 16:56:28 crc kubenswrapper[5120]: I0316 16:56:28.351210 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="ab8eb1e5-5cec-4ca4-a92d-4da46f3d6f9e" containerName="glance-httpd" containerID="cri-o://9abc83411da1674d8cb950d0402a72a77430425444b66a865bdd10797ba3720e" gracePeriod=30 Mar 16 16:56:28 crc kubenswrapper[5120]: I0316 16:56:28.354652 5120 generic.go:358] "Generic (PLEG): container finished" podID="87a87799-b746-468e-876e-d5a5f7f006ca" containerID="8b7292c4057ffeb9ca93934dec67997dd823993a561eb7629108cd51f653c07a" exitCode=0 Mar 16 16:56:28 crc kubenswrapper[5120]: I0316 16:56:28.354677 5120 generic.go:358] "Generic (PLEG): container finished" podID="87a87799-b746-468e-876e-d5a5f7f006ca" containerID="fdc16eade7a606828263443b5621476cd36dfd25ade092d009b50a6a4700d14e" exitCode=143 Mar 16 16:56:28 crc kubenswrapper[5120]: I0316 16:56:28.354801 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"87a87799-b746-468e-876e-d5a5f7f006ca","Type":"ContainerDied","Data":"8b7292c4057ffeb9ca93934dec67997dd823993a561eb7629108cd51f653c07a"} Mar 16 16:56:28 crc kubenswrapper[5120]: I0316 16:56:28.355611 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"87a87799-b746-468e-876e-d5a5f7f006ca","Type":"ContainerDied","Data":"fdc16eade7a606828263443b5621476cd36dfd25ade092d009b50a6a4700d14e"} Mar 16 16:56:28 crc kubenswrapper[5120]: I0316 16:56:28.355634 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"87a87799-b746-468e-876e-d5a5f7f006ca","Type":"ContainerDied","Data":"24b4a5e74177a31d3c24cc79bda46845ad7b619ecd4339ea1e0006685df476c1"} Mar 16 16:56:28 crc kubenswrapper[5120]: I0316 16:56:28.355651 5120 scope.go:117] "RemoveContainer" containerID="8b7292c4057ffeb9ca93934dec67997dd823993a561eb7629108cd51f653c07a" Mar 16 16:56:28 crc kubenswrapper[5120]: I0316 16:56:28.355829 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:56:28 crc kubenswrapper[5120]: I0316 16:56:28.367128 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-q2bn4" event={"ID":"e199c216-19d8-4055-9a2b-3d65e13116a2","Type":"ContainerStarted","Data":"7a0e860743d15f4f4b72328ec610b6dc439ff5bf46e14ab6366068df1d13ca98"} Mar 16 16:56:28 crc kubenswrapper[5120]: I0316 16:56:28.393198 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-internal-api-0" podStartSLOduration=6.393170246 podStartE2EDuration="6.393170246s" podCreationTimestamp="2026-03-16 16:56:22 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:56:28.369756285 +0000 UTC m=+5090.523687952" watchObservedRunningTime="2026-03-16 16:56:28.393170246 +0000 UTC m=+5090.547101903" Mar 16 16:56:28 crc kubenswrapper[5120]: I0316 16:56:28.397689 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/87a87799-b746-468e-876e-d5a5f7f006ca-public-tls-certs\") pod \"87a87799-b746-468e-876e-d5a5f7f006ca\" (UID: \"87a87799-b746-468e-876e-d5a5f7f006ca\") " Mar 16 16:56:28 crc kubenswrapper[5120]: I0316 16:56:28.397774 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/87a87799-b746-468e-876e-d5a5f7f006ca-config-data\") pod \"87a87799-b746-468e-876e-d5a5f7f006ca\" (UID: \"87a87799-b746-468e-876e-d5a5f7f006ca\") " Mar 16 16:56:28 crc kubenswrapper[5120]: I0316 16:56:28.397824 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j99d5\" (UniqueName: \"kubernetes.io/projected/87a87799-b746-468e-876e-d5a5f7f006ca-kube-api-access-j99d5\") pod \"87a87799-b746-468e-876e-d5a5f7f006ca\" (UID: \"87a87799-b746-468e-876e-d5a5f7f006ca\") " Mar 16 16:56:28 crc kubenswrapper[5120]: I0316 16:56:28.397919 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/87a87799-b746-468e-876e-d5a5f7f006ca-scripts\") pod \"87a87799-b746-468e-876e-d5a5f7f006ca\" (UID: \"87a87799-b746-468e-876e-d5a5f7f006ca\") " Mar 16 16:56:28 crc kubenswrapper[5120]: I0316 16:56:28.398035 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/87a87799-b746-468e-876e-d5a5f7f006ca-httpd-run\") pod \"87a87799-b746-468e-876e-d5a5f7f006ca\" (UID: \"87a87799-b746-468e-876e-d5a5f7f006ca\") " Mar 16 16:56:28 crc kubenswrapper[5120]: I0316 16:56:28.398054 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/87a87799-b746-468e-876e-d5a5f7f006ca-logs\") pod \"87a87799-b746-468e-876e-d5a5f7f006ca\" (UID: \"87a87799-b746-468e-876e-d5a5f7f006ca\") " Mar 16 16:56:28 crc kubenswrapper[5120]: I0316 16:56:28.398127 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/87a87799-b746-468e-876e-d5a5f7f006ca-combined-ca-bundle\") pod \"87a87799-b746-468e-876e-d5a5f7f006ca\" (UID: \"87a87799-b746-468e-876e-d5a5f7f006ca\") " Mar 16 16:56:28 crc kubenswrapper[5120]: I0316 16:56:28.398425 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"87a87799-b746-468e-876e-d5a5f7f006ca\" (UID: \"87a87799-b746-468e-876e-d5a5f7f006ca\") " Mar 16 16:56:28 crc kubenswrapper[5120]: I0316 16:56:28.399459 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87a87799-b746-468e-876e-d5a5f7f006ca-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "87a87799-b746-468e-876e-d5a5f7f006ca" (UID: "87a87799-b746-468e-876e-d5a5f7f006ca"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:56:28 crc kubenswrapper[5120]: I0316 16:56:28.400733 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87a87799-b746-468e-876e-d5a5f7f006ca-logs" (OuterVolumeSpecName: "logs") pod "87a87799-b746-468e-876e-d5a5f7f006ca" (UID: "87a87799-b746-468e-876e-d5a5f7f006ca"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:56:28 crc kubenswrapper[5120]: I0316 16:56:28.408385 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage05-crc" (OuterVolumeSpecName: "glance") pod "87a87799-b746-468e-876e-d5a5f7f006ca" (UID: "87a87799-b746-468e-876e-d5a5f7f006ca"). InnerVolumeSpecName "local-storage05-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:56:28 crc kubenswrapper[5120]: I0316 16:56:28.412443 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87a87799-b746-468e-876e-d5a5f7f006ca-kube-api-access-j99d5" (OuterVolumeSpecName: "kube-api-access-j99d5") pod "87a87799-b746-468e-876e-d5a5f7f006ca" (UID: "87a87799-b746-468e-876e-d5a5f7f006ca"). InnerVolumeSpecName "kube-api-access-j99d5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:56:28 crc kubenswrapper[5120]: I0316 16:56:28.420095 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/87a87799-b746-468e-876e-d5a5f7f006ca-scripts" (OuterVolumeSpecName: "scripts") pod "87a87799-b746-468e-876e-d5a5f7f006ca" (UID: "87a87799-b746-468e-876e-d5a5f7f006ca"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:56:28 crc kubenswrapper[5120]: I0316 16:56:28.427361 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-db-sync-q2bn4" podStartSLOduration=4.427335912 podStartE2EDuration="4.427335912s" podCreationTimestamp="2026-03-16 16:56:24 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:56:28.404342422 +0000 UTC m=+5090.558274069" watchObservedRunningTime="2026-03-16 16:56:28.427335912 +0000 UTC m=+5090.581267589" Mar 16 16:56:28 crc kubenswrapper[5120]: I0316 16:56:28.447211 5120 scope.go:117] "RemoveContainer" containerID="fdc16eade7a606828263443b5621476cd36dfd25ade092d009b50a6a4700d14e" Mar 16 16:56:28 crc kubenswrapper[5120]: I0316 16:56:28.481552 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/87a87799-b746-468e-876e-d5a5f7f006ca-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "87a87799-b746-468e-876e-d5a5f7f006ca" (UID: "87a87799-b746-468e-876e-d5a5f7f006ca"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:56:28 crc kubenswrapper[5120]: I0316 16:56:28.501324 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") on node \"crc\" " Mar 16 16:56:28 crc kubenswrapper[5120]: I0316 16:56:28.501357 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j99d5\" (UniqueName: \"kubernetes.io/projected/87a87799-b746-468e-876e-d5a5f7f006ca-kube-api-access-j99d5\") on node \"crc\" DevicePath \"\"" Mar 16 16:56:28 crc kubenswrapper[5120]: I0316 16:56:28.501368 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/87a87799-b746-468e-876e-d5a5f7f006ca-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:56:28 crc kubenswrapper[5120]: I0316 16:56:28.501380 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/87a87799-b746-468e-876e-d5a5f7f006ca-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 16:56:28 crc kubenswrapper[5120]: I0316 16:56:28.501405 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/87a87799-b746-468e-876e-d5a5f7f006ca-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:56:28 crc kubenswrapper[5120]: I0316 16:56:28.501415 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/87a87799-b746-468e-876e-d5a5f7f006ca-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:56:28 crc kubenswrapper[5120]: I0316 16:56:28.514538 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/87a87799-b746-468e-876e-d5a5f7f006ca-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "87a87799-b746-468e-876e-d5a5f7f006ca" (UID: "87a87799-b746-468e-876e-d5a5f7f006ca"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:56:28 crc kubenswrapper[5120]: I0316 16:56:28.524593 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/87a87799-b746-468e-876e-d5a5f7f006ca-config-data" (OuterVolumeSpecName: "config-data") pod "87a87799-b746-468e-876e-d5a5f7f006ca" (UID: "87a87799-b746-468e-876e-d5a5f7f006ca"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:56:28 crc kubenswrapper[5120]: I0316 16:56:28.537020 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage05-crc" (UniqueName: "kubernetes.io/local-volume/local-storage05-crc") on node "crc" Mar 16 16:56:28 crc kubenswrapper[5120]: I0316 16:56:28.605303 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:56:28 crc kubenswrapper[5120]: I0316 16:56:28.605732 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/87a87799-b746-468e-876e-d5a5f7f006ca-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:56:28 crc kubenswrapper[5120]: I0316 16:56:28.605797 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/87a87799-b746-468e-876e-d5a5f7f006ca-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:56:28 crc kubenswrapper[5120]: I0316 16:56:28.809538 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:56:28 crc kubenswrapper[5120]: I0316 16:56:28.821713 5120 scope.go:117] "RemoveContainer" containerID="8b7292c4057ffeb9ca93934dec67997dd823993a561eb7629108cd51f653c07a" Mar 16 16:56:28 crc kubenswrapper[5120]: I0316 16:56:28.835662 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:56:28 crc kubenswrapper[5120]: E0316 16:56:28.836744 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b7292c4057ffeb9ca93934dec67997dd823993a561eb7629108cd51f653c07a\": container with ID starting with 8b7292c4057ffeb9ca93934dec67997dd823993a561eb7629108cd51f653c07a not found: ID does not exist" containerID="8b7292c4057ffeb9ca93934dec67997dd823993a561eb7629108cd51f653c07a" Mar 16 16:56:28 crc kubenswrapper[5120]: I0316 16:56:28.838638 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b7292c4057ffeb9ca93934dec67997dd823993a561eb7629108cd51f653c07a"} err="failed to get container status \"8b7292c4057ffeb9ca93934dec67997dd823993a561eb7629108cd51f653c07a\": rpc error: code = NotFound desc = could not find container \"8b7292c4057ffeb9ca93934dec67997dd823993a561eb7629108cd51f653c07a\": container with ID starting with 8b7292c4057ffeb9ca93934dec67997dd823993a561eb7629108cd51f653c07a not found: ID does not exist" Mar 16 16:56:28 crc kubenswrapper[5120]: I0316 16:56:28.838847 5120 scope.go:117] "RemoveContainer" containerID="fdc16eade7a606828263443b5621476cd36dfd25ade092d009b50a6a4700d14e" Mar 16 16:56:28 crc kubenswrapper[5120]: E0316 16:56:28.840231 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fdc16eade7a606828263443b5621476cd36dfd25ade092d009b50a6a4700d14e\": container with ID starting with fdc16eade7a606828263443b5621476cd36dfd25ade092d009b50a6a4700d14e not found: ID does not exist" containerID="fdc16eade7a606828263443b5621476cd36dfd25ade092d009b50a6a4700d14e" Mar 16 16:56:28 crc kubenswrapper[5120]: I0316 16:56:28.840322 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fdc16eade7a606828263443b5621476cd36dfd25ade092d009b50a6a4700d14e"} err="failed to get container status \"fdc16eade7a606828263443b5621476cd36dfd25ade092d009b50a6a4700d14e\": rpc error: code = NotFound desc = could not find container \"fdc16eade7a606828263443b5621476cd36dfd25ade092d009b50a6a4700d14e\": container with ID starting with fdc16eade7a606828263443b5621476cd36dfd25ade092d009b50a6a4700d14e not found: ID does not exist" Mar 16 16:56:28 crc kubenswrapper[5120]: I0316 16:56:28.840348 5120 scope.go:117] "RemoveContainer" containerID="8b7292c4057ffeb9ca93934dec67997dd823993a561eb7629108cd51f653c07a" Mar 16 16:56:28 crc kubenswrapper[5120]: I0316 16:56:28.844132 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b7292c4057ffeb9ca93934dec67997dd823993a561eb7629108cd51f653c07a"} err="failed to get container status \"8b7292c4057ffeb9ca93934dec67997dd823993a561eb7629108cd51f653c07a\": rpc error: code = NotFound desc = could not find container \"8b7292c4057ffeb9ca93934dec67997dd823993a561eb7629108cd51f653c07a\": container with ID starting with 8b7292c4057ffeb9ca93934dec67997dd823993a561eb7629108cd51f653c07a not found: ID does not exist" Mar 16 16:56:28 crc kubenswrapper[5120]: I0316 16:56:28.844182 5120 scope.go:117] "RemoveContainer" containerID="fdc16eade7a606828263443b5621476cd36dfd25ade092d009b50a6a4700d14e" Mar 16 16:56:28 crc kubenswrapper[5120]: I0316 16:56:28.855936 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fdc16eade7a606828263443b5621476cd36dfd25ade092d009b50a6a4700d14e"} err="failed to get container status \"fdc16eade7a606828263443b5621476cd36dfd25ade092d009b50a6a4700d14e\": rpc error: code = NotFound desc = could not find container \"fdc16eade7a606828263443b5621476cd36dfd25ade092d009b50a6a4700d14e\": container with ID starting with fdc16eade7a606828263443b5621476cd36dfd25ade092d009b50a6a4700d14e not found: ID does not exist" Mar 16 16:56:28 crc kubenswrapper[5120]: I0316 16:56:28.900431 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:56:28 crc kubenswrapper[5120]: I0316 16:56:28.904522 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87a87799-b746-468e-876e-d5a5f7f006ca" containerName="glance-httpd" Mar 16 16:56:28 crc kubenswrapper[5120]: I0316 16:56:28.904552 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="87a87799-b746-468e-876e-d5a5f7f006ca" containerName="glance-httpd" Mar 16 16:56:28 crc kubenswrapper[5120]: I0316 16:56:28.904574 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87a87799-b746-468e-876e-d5a5f7f006ca" containerName="glance-log" Mar 16 16:56:28 crc kubenswrapper[5120]: I0316 16:56:28.904580 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="87a87799-b746-468e-876e-d5a5f7f006ca" containerName="glance-log" Mar 16 16:56:28 crc kubenswrapper[5120]: I0316 16:56:28.906343 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="87a87799-b746-468e-876e-d5a5f7f006ca" containerName="glance-httpd" Mar 16 16:56:28 crc kubenswrapper[5120]: I0316 16:56:28.906368 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="87a87799-b746-468e-876e-d5a5f7f006ca" containerName="glance-log" Mar 16 16:56:28 crc kubenswrapper[5120]: I0316 16:56:28.908234 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-np5jg" Mar 16 16:56:28 crc kubenswrapper[5120]: I0316 16:56:28.925649 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c336b7b3-c896-4066-a40a-ca516ed7c2c1-config-data\") pod \"c336b7b3-c896-4066-a40a-ca516ed7c2c1\" (UID: \"c336b7b3-c896-4066-a40a-ca516ed7c2c1\") " Mar 16 16:56:28 crc kubenswrapper[5120]: I0316 16:56:28.926049 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c336b7b3-c896-4066-a40a-ca516ed7c2c1-scripts\") pod \"c336b7b3-c896-4066-a40a-ca516ed7c2c1\" (UID: \"c336b7b3-c896-4066-a40a-ca516ed7c2c1\") " Mar 16 16:56:28 crc kubenswrapper[5120]: I0316 16:56:28.926247 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c336b7b3-c896-4066-a40a-ca516ed7c2c1-logs\") pod \"c336b7b3-c896-4066-a40a-ca516ed7c2c1\" (UID: \"c336b7b3-c896-4066-a40a-ca516ed7c2c1\") " Mar 16 16:56:28 crc kubenswrapper[5120]: I0316 16:56:28.926596 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c336b7b3-c896-4066-a40a-ca516ed7c2c1-logs" (OuterVolumeSpecName: "logs") pod "c336b7b3-c896-4066-a40a-ca516ed7c2c1" (UID: "c336b7b3-c896-4066-a40a-ca516ed7c2c1"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:56:28 crc kubenswrapper[5120]: I0316 16:56:28.926719 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z5g8x\" (UniqueName: \"kubernetes.io/projected/c336b7b3-c896-4066-a40a-ca516ed7c2c1-kube-api-access-z5g8x\") pod \"c336b7b3-c896-4066-a40a-ca516ed7c2c1\" (UID: \"c336b7b3-c896-4066-a40a-ca516ed7c2c1\") " Mar 16 16:56:28 crc kubenswrapper[5120]: I0316 16:56:28.926992 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c336b7b3-c896-4066-a40a-ca516ed7c2c1-combined-ca-bundle\") pod \"c336b7b3-c896-4066-a40a-ca516ed7c2c1\" (UID: \"c336b7b3-c896-4066-a40a-ca516ed7c2c1\") " Mar 16 16:56:28 crc kubenswrapper[5120]: I0316 16:56:28.927851 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c336b7b3-c896-4066-a40a-ca516ed7c2c1-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:56:28 crc kubenswrapper[5120]: I0316 16:56:28.934392 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c336b7b3-c896-4066-a40a-ca516ed7c2c1-kube-api-access-z5g8x" (OuterVolumeSpecName: "kube-api-access-z5g8x") pod "c336b7b3-c896-4066-a40a-ca516ed7c2c1" (UID: "c336b7b3-c896-4066-a40a-ca516ed7c2c1"). InnerVolumeSpecName "kube-api-access-z5g8x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:56:28 crc kubenswrapper[5120]: I0316 16:56:28.942254 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c336b7b3-c896-4066-a40a-ca516ed7c2c1-scripts" (OuterVolumeSpecName: "scripts") pod "c336b7b3-c896-4066-a40a-ca516ed7c2c1" (UID: "c336b7b3-c896-4066-a40a-ca516ed7c2c1"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:56:28 crc kubenswrapper[5120]: I0316 16:56:28.957717 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c336b7b3-c896-4066-a40a-ca516ed7c2c1-config-data" (OuterVolumeSpecName: "config-data") pod "c336b7b3-c896-4066-a40a-ca516ed7c2c1" (UID: "c336b7b3-c896-4066-a40a-ca516ed7c2c1"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:56:28 crc kubenswrapper[5120]: I0316 16:56:28.961004 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c336b7b3-c896-4066-a40a-ca516ed7c2c1-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "c336b7b3-c896-4066-a40a-ca516ed7c2c1" (UID: "c336b7b3-c896-4066-a40a-ca516ed7c2c1"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:56:28 crc kubenswrapper[5120]: I0316 16:56:28.968093 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:56:28 crc kubenswrapper[5120]: I0316 16:56:28.968273 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:56:28 crc kubenswrapper[5120]: I0316 16:56:28.972729 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-external-config-data\"" Mar 16 16:56:28 crc kubenswrapper[5120]: I0316 16:56:28.973511 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-public-svc\"" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.030999 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/dc34c11e-3278-4e46-94e1-7cb991fe4591-logs\") pod \"glance-default-external-api-0\" (UID: \"dc34c11e-3278-4e46-94e1-7cb991fe4591\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.031382 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/dc34c11e-3278-4e46-94e1-7cb991fe4591-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"dc34c11e-3278-4e46-94e1-7cb991fe4591\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.031533 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"glance-default-external-api-0\" (UID: \"dc34c11e-3278-4e46-94e1-7cb991fe4591\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.031725 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tnsfj\" (UniqueName: \"kubernetes.io/projected/dc34c11e-3278-4e46-94e1-7cb991fe4591-kube-api-access-tnsfj\") pod \"glance-default-external-api-0\" (UID: \"dc34c11e-3278-4e46-94e1-7cb991fe4591\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.031778 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/dc34c11e-3278-4e46-94e1-7cb991fe4591-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"dc34c11e-3278-4e46-94e1-7cb991fe4591\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.031926 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dc34c11e-3278-4e46-94e1-7cb991fe4591-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"dc34c11e-3278-4e46-94e1-7cb991fe4591\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.031984 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dc34c11e-3278-4e46-94e1-7cb991fe4591-config-data\") pod \"glance-default-external-api-0\" (UID: \"dc34c11e-3278-4e46-94e1-7cb991fe4591\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.032013 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/dc34c11e-3278-4e46-94e1-7cb991fe4591-scripts\") pod \"glance-default-external-api-0\" (UID: \"dc34c11e-3278-4e46-94e1-7cb991fe4591\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.032134 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c336b7b3-c896-4066-a40a-ca516ed7c2c1-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.032145 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c336b7b3-c896-4066-a40a-ca516ed7c2c1-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.032154 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c336b7b3-c896-4066-a40a-ca516ed7c2c1-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.032163 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z5g8x\" (UniqueName: \"kubernetes.io/projected/c336b7b3-c896-4066-a40a-ca516ed7c2c1-kube-api-access-z5g8x\") on node \"crc\" DevicePath \"\"" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.123834 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.134838 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ab8eb1e5-5cec-4ca4-a92d-4da46f3d6f9e-config-data\") pod \"ab8eb1e5-5cec-4ca4-a92d-4da46f3d6f9e\" (UID: \"ab8eb1e5-5cec-4ca4-a92d-4da46f3d6f9e\") " Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.134909 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pptqt\" (UniqueName: \"kubernetes.io/projected/ab8eb1e5-5cec-4ca4-a92d-4da46f3d6f9e-kube-api-access-pptqt\") pod \"ab8eb1e5-5cec-4ca4-a92d-4da46f3d6f9e\" (UID: \"ab8eb1e5-5cec-4ca4-a92d-4da46f3d6f9e\") " Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.135784 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"ab8eb1e5-5cec-4ca4-a92d-4da46f3d6f9e\" (UID: \"ab8eb1e5-5cec-4ca4-a92d-4da46f3d6f9e\") " Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.135966 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ab8eb1e5-5cec-4ca4-a92d-4da46f3d6f9e-logs\") pod \"ab8eb1e5-5cec-4ca4-a92d-4da46f3d6f9e\" (UID: \"ab8eb1e5-5cec-4ca4-a92d-4da46f3d6f9e\") " Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.136619 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/ab8eb1e5-5cec-4ca4-a92d-4da46f3d6f9e-httpd-run\") pod \"ab8eb1e5-5cec-4ca4-a92d-4da46f3d6f9e\" (UID: \"ab8eb1e5-5cec-4ca4-a92d-4da46f3d6f9e\") " Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.136723 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/ab8eb1e5-5cec-4ca4-a92d-4da46f3d6f9e-internal-tls-certs\") pod \"ab8eb1e5-5cec-4ca4-a92d-4da46f3d6f9e\" (UID: \"ab8eb1e5-5cec-4ca4-a92d-4da46f3d6f9e\") " Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.136826 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ab8eb1e5-5cec-4ca4-a92d-4da46f3d6f9e-combined-ca-bundle\") pod \"ab8eb1e5-5cec-4ca4-a92d-4da46f3d6f9e\" (UID: \"ab8eb1e5-5cec-4ca4-a92d-4da46f3d6f9e\") " Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.136981 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ab8eb1e5-5cec-4ca4-a92d-4da46f3d6f9e-scripts\") pod \"ab8eb1e5-5cec-4ca4-a92d-4da46f3d6f9e\" (UID: \"ab8eb1e5-5cec-4ca4-a92d-4da46f3d6f9e\") " Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.137003 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab8eb1e5-5cec-4ca4-a92d-4da46f3d6f9e-logs" (OuterVolumeSpecName: "logs") pod "ab8eb1e5-5cec-4ca4-a92d-4da46f3d6f9e" (UID: "ab8eb1e5-5cec-4ca4-a92d-4da46f3d6f9e"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.137122 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab8eb1e5-5cec-4ca4-a92d-4da46f3d6f9e-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "ab8eb1e5-5cec-4ca4-a92d-4da46f3d6f9e" (UID: "ab8eb1e5-5cec-4ca4-a92d-4da46f3d6f9e"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.138193 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/dc34c11e-3278-4e46-94e1-7cb991fe4591-logs\") pod \"glance-default-external-api-0\" (UID: \"dc34c11e-3278-4e46-94e1-7cb991fe4591\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.138252 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/dc34c11e-3278-4e46-94e1-7cb991fe4591-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"dc34c11e-3278-4e46-94e1-7cb991fe4591\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.138367 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"glance-default-external-api-0\" (UID: \"dc34c11e-3278-4e46-94e1-7cb991fe4591\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.138641 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tnsfj\" (UniqueName: \"kubernetes.io/projected/dc34c11e-3278-4e46-94e1-7cb991fe4591-kube-api-access-tnsfj\") pod \"glance-default-external-api-0\" (UID: \"dc34c11e-3278-4e46-94e1-7cb991fe4591\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.138675 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/dc34c11e-3278-4e46-94e1-7cb991fe4591-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"dc34c11e-3278-4e46-94e1-7cb991fe4591\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.138858 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/dc34c11e-3278-4e46-94e1-7cb991fe4591-logs\") pod \"glance-default-external-api-0\" (UID: \"dc34c11e-3278-4e46-94e1-7cb991fe4591\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.138933 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dc34c11e-3278-4e46-94e1-7cb991fe4591-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"dc34c11e-3278-4e46-94e1-7cb991fe4591\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.139082 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dc34c11e-3278-4e46-94e1-7cb991fe4591-config-data\") pod \"glance-default-external-api-0\" (UID: \"dc34c11e-3278-4e46-94e1-7cb991fe4591\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.139141 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/dc34c11e-3278-4e46-94e1-7cb991fe4591-scripts\") pod \"glance-default-external-api-0\" (UID: \"dc34c11e-3278-4e46-94e1-7cb991fe4591\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.139135 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"glance-default-external-api-0\" (UID: \"dc34c11e-3278-4e46-94e1-7cb991fe4591\") device mount path \"/mnt/openstack/pv05\"" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.139198 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/dc34c11e-3278-4e46-94e1-7cb991fe4591-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"dc34c11e-3278-4e46-94e1-7cb991fe4591\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.141828 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/ab8eb1e5-5cec-4ca4-a92d-4da46f3d6f9e-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.141877 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ab8eb1e5-5cec-4ca4-a92d-4da46f3d6f9e-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.152088 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/dc34c11e-3278-4e46-94e1-7cb991fe4591-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"dc34c11e-3278-4e46-94e1-7cb991fe4591\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.152334 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ab8eb1e5-5cec-4ca4-a92d-4da46f3d6f9e-scripts" (OuterVolumeSpecName: "scripts") pod "ab8eb1e5-5cec-4ca4-a92d-4da46f3d6f9e" (UID: "ab8eb1e5-5cec-4ca4-a92d-4da46f3d6f9e"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.157728 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dc34c11e-3278-4e46-94e1-7cb991fe4591-config-data\") pod \"glance-default-external-api-0\" (UID: \"dc34c11e-3278-4e46-94e1-7cb991fe4591\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.161166 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/dc34c11e-3278-4e46-94e1-7cb991fe4591-scripts\") pod \"glance-default-external-api-0\" (UID: \"dc34c11e-3278-4e46-94e1-7cb991fe4591\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.161246 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab8eb1e5-5cec-4ca4-a92d-4da46f3d6f9e-kube-api-access-pptqt" (OuterVolumeSpecName: "kube-api-access-pptqt") pod "ab8eb1e5-5cec-4ca4-a92d-4da46f3d6f9e" (UID: "ab8eb1e5-5cec-4ca4-a92d-4da46f3d6f9e"). InnerVolumeSpecName "kube-api-access-pptqt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.176784 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage06-crc" (OuterVolumeSpecName: "glance") pod "ab8eb1e5-5cec-4ca4-a92d-4da46f3d6f9e" (UID: "ab8eb1e5-5cec-4ca4-a92d-4da46f3d6f9e"). InnerVolumeSpecName "local-storage06-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.177329 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dc34c11e-3278-4e46-94e1-7cb991fe4591-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"dc34c11e-3278-4e46-94e1-7cb991fe4591\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.188878 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tnsfj\" (UniqueName: \"kubernetes.io/projected/dc34c11e-3278-4e46-94e1-7cb991fe4591-kube-api-access-tnsfj\") pod \"glance-default-external-api-0\" (UID: \"dc34c11e-3278-4e46-94e1-7cb991fe4591\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.212610 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"glance-default-external-api-0\" (UID: \"dc34c11e-3278-4e46-94e1-7cb991fe4591\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.213056 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ab8eb1e5-5cec-4ca4-a92d-4da46f3d6f9e-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ab8eb1e5-5cec-4ca4-a92d-4da46f3d6f9e" (UID: "ab8eb1e5-5cec-4ca4-a92d-4da46f3d6f9e"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.236702 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ab8eb1e5-5cec-4ca4-a92d-4da46f3d6f9e-config-data" (OuterVolumeSpecName: "config-data") pod "ab8eb1e5-5cec-4ca4-a92d-4da46f3d6f9e" (UID: "ab8eb1e5-5cec-4ca4-a92d-4da46f3d6f9e"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.245829 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") on node \"crc\" " Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.245877 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ab8eb1e5-5cec-4ca4-a92d-4da46f3d6f9e-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.245896 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ab8eb1e5-5cec-4ca4-a92d-4da46f3d6f9e-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.245907 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ab8eb1e5-5cec-4ca4-a92d-4da46f3d6f9e-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.245919 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pptqt\" (UniqueName: \"kubernetes.io/projected/ab8eb1e5-5cec-4ca4-a92d-4da46f3d6f9e-kube-api-access-pptqt\") on node \"crc\" DevicePath \"\"" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.261182 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ab8eb1e5-5cec-4ca4-a92d-4da46f3d6f9e-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "ab8eb1e5-5cec-4ca4-a92d-4da46f3d6f9e" (UID: "ab8eb1e5-5cec-4ca4-a92d-4da46f3d6f9e"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.272377 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage06-crc" (UniqueName: "kubernetes.io/local-volume/local-storage06-crc") on node "crc" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.307490 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.347868 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/ab8eb1e5-5cec-4ca4-a92d-4da46f3d6f9e-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.348209 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.408111 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-np5jg" event={"ID":"c336b7b3-c896-4066-a40a-ca516ed7c2c1","Type":"ContainerDied","Data":"9587a7efd36df9601a96de358fe1b446c74c9e6284bbcc82da884733fabf8fb4"} Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.408155 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9587a7efd36df9601a96de358fe1b446c74c9e6284bbcc82da884733fabf8fb4" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.408355 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-np5jg" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.446800 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"519f2986-0498-4f41-b63e-3137e48794e8","Type":"ContainerStarted","Data":"da28df4d2b4d7297db4747135d2d4c7a4bf8b654939a2ac3233c1bb7ec133e16"} Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.447062 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="519f2986-0498-4f41-b63e-3137e48794e8" containerName="ceilometer-central-agent" containerID="cri-o://341eb31c49d6a423406aff4c3e064cbb989dc5a7a58334293a86e5c48040d861" gracePeriod=30 Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.447280 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="519f2986-0498-4f41-b63e-3137e48794e8" containerName="proxy-httpd" containerID="cri-o://da28df4d2b4d7297db4747135d2d4c7a4bf8b654939a2ac3233c1bb7ec133e16" gracePeriod=30 Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.447312 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.447378 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="519f2986-0498-4f41-b63e-3137e48794e8" containerName="ceilometer-notification-agent" containerID="cri-o://8c88d9913acb46c6812b4fe61151c0facb34b3f867c5a3857e239ee42fa7857a" gracePeriod=30 Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.447610 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="519f2986-0498-4f41-b63e-3137e48794e8" containerName="sg-core" containerID="cri-o://0631a64af2d97849fd447322863197a1f71b6367f2a0bbfc14fd56c98a346078" gracePeriod=30 Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.466221 5120 generic.go:358] "Generic (PLEG): container finished" podID="ab8eb1e5-5cec-4ca4-a92d-4da46f3d6f9e" containerID="9abc83411da1674d8cb950d0402a72a77430425444b66a865bdd10797ba3720e" exitCode=0 Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.466253 5120 generic.go:358] "Generic (PLEG): container finished" podID="ab8eb1e5-5cec-4ca4-a92d-4da46f3d6f9e" containerID="0f7585a48866f60806539a589ca22016d43d972a661b4c8032c72fd34921def4" exitCode=143 Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.467873 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.468089 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"ab8eb1e5-5cec-4ca4-a92d-4da46f3d6f9e","Type":"ContainerDied","Data":"9abc83411da1674d8cb950d0402a72a77430425444b66a865bdd10797ba3720e"} Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.468151 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"ab8eb1e5-5cec-4ca4-a92d-4da46f3d6f9e","Type":"ContainerDied","Data":"0f7585a48866f60806539a589ca22016d43d972a661b4c8032c72fd34921def4"} Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.468160 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"ab8eb1e5-5cec-4ca4-a92d-4da46f3d6f9e","Type":"ContainerDied","Data":"8dfac9a408bdea393172756309f24a7a26fa7d151533415084b78976f848701d"} Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.468175 5120 scope.go:117] "RemoveContainer" containerID="9abc83411da1674d8cb950d0402a72a77430425444b66a865bdd10797ba3720e" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.491623 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-operators-7mhml"] Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.511990 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-6dbf47b8f6-ghhnl"] Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.513358 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c336b7b3-c896-4066-a40a-ca516ed7c2c1" containerName="placement-db-sync" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.513382 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c336b7b3-c896-4066-a40a-ca516ed7c2c1" containerName="placement-db-sync" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.513400 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab8eb1e5-5cec-4ca4-a92d-4da46f3d6f9e" containerName="glance-httpd" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.513408 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab8eb1e5-5cec-4ca4-a92d-4da46f3d6f9e" containerName="glance-httpd" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.513458 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab8eb1e5-5cec-4ca4-a92d-4da46f3d6f9e" containerName="glance-log" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.513466 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab8eb1e5-5cec-4ca4-a92d-4da46f3d6f9e" containerName="glance-log" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.513691 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ab8eb1e5-5cec-4ca4-a92d-4da46f3d6f9e" containerName="glance-httpd" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.513712 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c336b7b3-c896-4066-a40a-ca516ed7c2c1" containerName="placement-db-sync" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.513723 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ab8eb1e5-5cec-4ca4-a92d-4da46f3d6f9e" containerName="glance-log" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.534089 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=1.731826753 podStartE2EDuration="7.534069324s" podCreationTimestamp="2026-03-16 16:56:22 +0000 UTC" firstStartedPulling="2026-03-16 16:56:23.210493853 +0000 UTC m=+5085.364425511" lastFinishedPulling="2026-03-16 16:56:29.012736425 +0000 UTC m=+5091.166668082" observedRunningTime="2026-03-16 16:56:29.489163085 +0000 UTC m=+5091.643094752" watchObservedRunningTime="2026-03-16 16:56:29.534069324 +0000 UTC m=+5091.688000981" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.546294 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-6dbf47b8f6-ghhnl"] Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.546471 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-6dbf47b8f6-ghhnl" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.548926 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-config-data\"" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.549374 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-scripts\"" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.550191 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-placement-internal-svc\"" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.550355 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-placement-dockercfg-plb5j\"" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.550290 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-placement-public-svc\"" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.593603 5120 scope.go:117] "RemoveContainer" containerID="0f7585a48866f60806539a589ca22016d43d972a661b4c8032c72fd34921def4" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.599945 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.607671 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.657930 5120 scope.go:117] "RemoveContainer" containerID="9abc83411da1674d8cb950d0402a72a77430425444b66a865bdd10797ba3720e" Mar 16 16:56:29 crc kubenswrapper[5120]: E0316 16:56:29.658556 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9abc83411da1674d8cb950d0402a72a77430425444b66a865bdd10797ba3720e\": container with ID starting with 9abc83411da1674d8cb950d0402a72a77430425444b66a865bdd10797ba3720e not found: ID does not exist" containerID="9abc83411da1674d8cb950d0402a72a77430425444b66a865bdd10797ba3720e" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.658612 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9abc83411da1674d8cb950d0402a72a77430425444b66a865bdd10797ba3720e"} err="failed to get container status \"9abc83411da1674d8cb950d0402a72a77430425444b66a865bdd10797ba3720e\": rpc error: code = NotFound desc = could not find container \"9abc83411da1674d8cb950d0402a72a77430425444b66a865bdd10797ba3720e\": container with ID starting with 9abc83411da1674d8cb950d0402a72a77430425444b66a865bdd10797ba3720e not found: ID does not exist" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.658645 5120 scope.go:117] "RemoveContainer" containerID="0f7585a48866f60806539a589ca22016d43d972a661b4c8032c72fd34921def4" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.658961 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.660972 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/c9783c3d-ba3f-42b1-b0ae-545df719e28f-internal-tls-certs\") pod \"placement-6dbf47b8f6-ghhnl\" (UID: \"c9783c3d-ba3f-42b1-b0ae-545df719e28f\") " pod="openstack-kuttl-tests/placement-6dbf47b8f6-ghhnl" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.661058 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c9783c3d-ba3f-42b1-b0ae-545df719e28f-combined-ca-bundle\") pod \"placement-6dbf47b8f6-ghhnl\" (UID: \"c9783c3d-ba3f-42b1-b0ae-545df719e28f\") " pod="openstack-kuttl-tests/placement-6dbf47b8f6-ghhnl" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.661366 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c9783c3d-ba3f-42b1-b0ae-545df719e28f-scripts\") pod \"placement-6dbf47b8f6-ghhnl\" (UID: \"c9783c3d-ba3f-42b1-b0ae-545df719e28f\") " pod="openstack-kuttl-tests/placement-6dbf47b8f6-ghhnl" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.661407 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtzh7\" (UniqueName: \"kubernetes.io/projected/c9783c3d-ba3f-42b1-b0ae-545df719e28f-kube-api-access-wtzh7\") pod \"placement-6dbf47b8f6-ghhnl\" (UID: \"c9783c3d-ba3f-42b1-b0ae-545df719e28f\") " pod="openstack-kuttl-tests/placement-6dbf47b8f6-ghhnl" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.661487 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c9783c3d-ba3f-42b1-b0ae-545df719e28f-config-data\") pod \"placement-6dbf47b8f6-ghhnl\" (UID: \"c9783c3d-ba3f-42b1-b0ae-545df719e28f\") " pod="openstack-kuttl-tests/placement-6dbf47b8f6-ghhnl" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.661566 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c9783c3d-ba3f-42b1-b0ae-545df719e28f-logs\") pod \"placement-6dbf47b8f6-ghhnl\" (UID: \"c9783c3d-ba3f-42b1-b0ae-545df719e28f\") " pod="openstack-kuttl-tests/placement-6dbf47b8f6-ghhnl" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.661626 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/c9783c3d-ba3f-42b1-b0ae-545df719e28f-public-tls-certs\") pod \"placement-6dbf47b8f6-ghhnl\" (UID: \"c9783c3d-ba3f-42b1-b0ae-545df719e28f\") " pod="openstack-kuttl-tests/placement-6dbf47b8f6-ghhnl" Mar 16 16:56:29 crc kubenswrapper[5120]: E0316 16:56:29.662501 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f7585a48866f60806539a589ca22016d43d972a661b4c8032c72fd34921def4\": container with ID starting with 0f7585a48866f60806539a589ca22016d43d972a661b4c8032c72fd34921def4 not found: ID does not exist" containerID="0f7585a48866f60806539a589ca22016d43d972a661b4c8032c72fd34921def4" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.662587 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f7585a48866f60806539a589ca22016d43d972a661b4c8032c72fd34921def4"} err="failed to get container status \"0f7585a48866f60806539a589ca22016d43d972a661b4c8032c72fd34921def4\": rpc error: code = NotFound desc = could not find container \"0f7585a48866f60806539a589ca22016d43d972a661b4c8032c72fd34921def4\": container with ID starting with 0f7585a48866f60806539a589ca22016d43d972a661b4c8032c72fd34921def4 not found: ID does not exist" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.662618 5120 scope.go:117] "RemoveContainer" containerID="9abc83411da1674d8cb950d0402a72a77430425444b66a865bdd10797ba3720e" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.665893 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9abc83411da1674d8cb950d0402a72a77430425444b66a865bdd10797ba3720e"} err="failed to get container status \"9abc83411da1674d8cb950d0402a72a77430425444b66a865bdd10797ba3720e\": rpc error: code = NotFound desc = could not find container \"9abc83411da1674d8cb950d0402a72a77430425444b66a865bdd10797ba3720e\": container with ID starting with 9abc83411da1674d8cb950d0402a72a77430425444b66a865bdd10797ba3720e not found: ID does not exist" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.665931 5120 scope.go:117] "RemoveContainer" containerID="0f7585a48866f60806539a589ca22016d43d972a661b4c8032c72fd34921def4" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.684972 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f7585a48866f60806539a589ca22016d43d972a661b4c8032c72fd34921def4"} err="failed to get container status \"0f7585a48866f60806539a589ca22016d43d972a661b4c8032c72fd34921def4\": rpc error: code = NotFound desc = could not find container \"0f7585a48866f60806539a589ca22016d43d972a661b4c8032c72fd34921def4\": container with ID starting with 0f7585a48866f60806539a589ca22016d43d972a661b4c8032c72fd34921def4 not found: ID does not exist" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.689299 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.690284 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.692178 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-internal-svc\"" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.692427 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-internal-config-data\"" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.763998 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"glance-default-internal-api-0\" (UID: \"7870ec2c-0344-4cfe-bc6d-4bca0c11ba52\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.764081 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtrg7\" (UniqueName: \"kubernetes.io/projected/7870ec2c-0344-4cfe-bc6d-4bca0c11ba52-kube-api-access-jtrg7\") pod \"glance-default-internal-api-0\" (UID: \"7870ec2c-0344-4cfe-bc6d-4bca0c11ba52\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.764343 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/c9783c3d-ba3f-42b1-b0ae-545df719e28f-internal-tls-certs\") pod \"placement-6dbf47b8f6-ghhnl\" (UID: \"c9783c3d-ba3f-42b1-b0ae-545df719e28f\") " pod="openstack-kuttl-tests/placement-6dbf47b8f6-ghhnl" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.764385 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/7870ec2c-0344-4cfe-bc6d-4bca0c11ba52-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"7870ec2c-0344-4cfe-bc6d-4bca0c11ba52\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.764415 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c9783c3d-ba3f-42b1-b0ae-545df719e28f-combined-ca-bundle\") pod \"placement-6dbf47b8f6-ghhnl\" (UID: \"c9783c3d-ba3f-42b1-b0ae-545df719e28f\") " pod="openstack-kuttl-tests/placement-6dbf47b8f6-ghhnl" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.764446 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7870ec2c-0344-4cfe-bc6d-4bca0c11ba52-logs\") pod \"glance-default-internal-api-0\" (UID: \"7870ec2c-0344-4cfe-bc6d-4bca0c11ba52\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.764754 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c9783c3d-ba3f-42b1-b0ae-545df719e28f-scripts\") pod \"placement-6dbf47b8f6-ghhnl\" (UID: \"c9783c3d-ba3f-42b1-b0ae-545df719e28f\") " pod="openstack-kuttl-tests/placement-6dbf47b8f6-ghhnl" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.765133 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wtzh7\" (UniqueName: \"kubernetes.io/projected/c9783c3d-ba3f-42b1-b0ae-545df719e28f-kube-api-access-wtzh7\") pod \"placement-6dbf47b8f6-ghhnl\" (UID: \"c9783c3d-ba3f-42b1-b0ae-545df719e28f\") " pod="openstack-kuttl-tests/placement-6dbf47b8f6-ghhnl" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.765485 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7870ec2c-0344-4cfe-bc6d-4bca0c11ba52-scripts\") pod \"glance-default-internal-api-0\" (UID: \"7870ec2c-0344-4cfe-bc6d-4bca0c11ba52\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.765659 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c9783c3d-ba3f-42b1-b0ae-545df719e28f-config-data\") pod \"placement-6dbf47b8f6-ghhnl\" (UID: \"c9783c3d-ba3f-42b1-b0ae-545df719e28f\") " pod="openstack-kuttl-tests/placement-6dbf47b8f6-ghhnl" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.765792 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/7870ec2c-0344-4cfe-bc6d-4bca0c11ba52-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"7870ec2c-0344-4cfe-bc6d-4bca0c11ba52\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.765959 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c9783c3d-ba3f-42b1-b0ae-545df719e28f-logs\") pod \"placement-6dbf47b8f6-ghhnl\" (UID: \"c9783c3d-ba3f-42b1-b0ae-545df719e28f\") " pod="openstack-kuttl-tests/placement-6dbf47b8f6-ghhnl" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.766131 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7870ec2c-0344-4cfe-bc6d-4bca0c11ba52-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"7870ec2c-0344-4cfe-bc6d-4bca0c11ba52\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.766239 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/c9783c3d-ba3f-42b1-b0ae-545df719e28f-public-tls-certs\") pod \"placement-6dbf47b8f6-ghhnl\" (UID: \"c9783c3d-ba3f-42b1-b0ae-545df719e28f\") " pod="openstack-kuttl-tests/placement-6dbf47b8f6-ghhnl" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.766392 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7870ec2c-0344-4cfe-bc6d-4bca0c11ba52-config-data\") pod \"glance-default-internal-api-0\" (UID: \"7870ec2c-0344-4cfe-bc6d-4bca0c11ba52\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.767287 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c9783c3d-ba3f-42b1-b0ae-545df719e28f-logs\") pod \"placement-6dbf47b8f6-ghhnl\" (UID: \"c9783c3d-ba3f-42b1-b0ae-545df719e28f\") " pod="openstack-kuttl-tests/placement-6dbf47b8f6-ghhnl" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.770244 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/c9783c3d-ba3f-42b1-b0ae-545df719e28f-internal-tls-certs\") pod \"placement-6dbf47b8f6-ghhnl\" (UID: \"c9783c3d-ba3f-42b1-b0ae-545df719e28f\") " pod="openstack-kuttl-tests/placement-6dbf47b8f6-ghhnl" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.770921 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c9783c3d-ba3f-42b1-b0ae-545df719e28f-config-data\") pod \"placement-6dbf47b8f6-ghhnl\" (UID: \"c9783c3d-ba3f-42b1-b0ae-545df719e28f\") " pod="openstack-kuttl-tests/placement-6dbf47b8f6-ghhnl" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.780389 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c9783c3d-ba3f-42b1-b0ae-545df719e28f-scripts\") pod \"placement-6dbf47b8f6-ghhnl\" (UID: \"c9783c3d-ba3f-42b1-b0ae-545df719e28f\") " pod="openstack-kuttl-tests/placement-6dbf47b8f6-ghhnl" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.780730 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c9783c3d-ba3f-42b1-b0ae-545df719e28f-combined-ca-bundle\") pod \"placement-6dbf47b8f6-ghhnl\" (UID: \"c9783c3d-ba3f-42b1-b0ae-545df719e28f\") " pod="openstack-kuttl-tests/placement-6dbf47b8f6-ghhnl" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.785399 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtzh7\" (UniqueName: \"kubernetes.io/projected/c9783c3d-ba3f-42b1-b0ae-545df719e28f-kube-api-access-wtzh7\") pod \"placement-6dbf47b8f6-ghhnl\" (UID: \"c9783c3d-ba3f-42b1-b0ae-545df719e28f\") " pod="openstack-kuttl-tests/placement-6dbf47b8f6-ghhnl" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.791049 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/c9783c3d-ba3f-42b1-b0ae-545df719e28f-public-tls-certs\") pod \"placement-6dbf47b8f6-ghhnl\" (UID: \"c9783c3d-ba3f-42b1-b0ae-545df719e28f\") " pod="openstack-kuttl-tests/placement-6dbf47b8f6-ghhnl" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.830209 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.870796 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"glance-default-internal-api-0\" (UID: \"7870ec2c-0344-4cfe-bc6d-4bca0c11ba52\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.870917 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jtrg7\" (UniqueName: \"kubernetes.io/projected/7870ec2c-0344-4cfe-bc6d-4bca0c11ba52-kube-api-access-jtrg7\") pod \"glance-default-internal-api-0\" (UID: \"7870ec2c-0344-4cfe-bc6d-4bca0c11ba52\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.871127 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/7870ec2c-0344-4cfe-bc6d-4bca0c11ba52-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"7870ec2c-0344-4cfe-bc6d-4bca0c11ba52\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.871177 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7870ec2c-0344-4cfe-bc6d-4bca0c11ba52-logs\") pod \"glance-default-internal-api-0\" (UID: \"7870ec2c-0344-4cfe-bc6d-4bca0c11ba52\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.871272 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7870ec2c-0344-4cfe-bc6d-4bca0c11ba52-scripts\") pod \"glance-default-internal-api-0\" (UID: \"7870ec2c-0344-4cfe-bc6d-4bca0c11ba52\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.871331 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/7870ec2c-0344-4cfe-bc6d-4bca0c11ba52-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"7870ec2c-0344-4cfe-bc6d-4bca0c11ba52\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.871447 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7870ec2c-0344-4cfe-bc6d-4bca0c11ba52-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"7870ec2c-0344-4cfe-bc6d-4bca0c11ba52\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.871572 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7870ec2c-0344-4cfe-bc6d-4bca0c11ba52-config-data\") pod \"glance-default-internal-api-0\" (UID: \"7870ec2c-0344-4cfe-bc6d-4bca0c11ba52\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.871693 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"glance-default-internal-api-0\" (UID: \"7870ec2c-0344-4cfe-bc6d-4bca0c11ba52\") device mount path \"/mnt/openstack/pv06\"" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.872297 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/7870ec2c-0344-4cfe-bc6d-4bca0c11ba52-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"7870ec2c-0344-4cfe-bc6d-4bca0c11ba52\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.873551 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7870ec2c-0344-4cfe-bc6d-4bca0c11ba52-logs\") pod \"glance-default-internal-api-0\" (UID: \"7870ec2c-0344-4cfe-bc6d-4bca0c11ba52\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.875208 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-6dbf47b8f6-ghhnl" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.877506 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7870ec2c-0344-4cfe-bc6d-4bca0c11ba52-scripts\") pod \"glance-default-internal-api-0\" (UID: \"7870ec2c-0344-4cfe-bc6d-4bca0c11ba52\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.887225 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7870ec2c-0344-4cfe-bc6d-4bca0c11ba52-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"7870ec2c-0344-4cfe-bc6d-4bca0c11ba52\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.889584 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7870ec2c-0344-4cfe-bc6d-4bca0c11ba52-config-data\") pod \"glance-default-internal-api-0\" (UID: \"7870ec2c-0344-4cfe-bc6d-4bca0c11ba52\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.890912 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/7870ec2c-0344-4cfe-bc6d-4bca0c11ba52-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"7870ec2c-0344-4cfe-bc6d-4bca0c11ba52\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.894251 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtrg7\" (UniqueName: \"kubernetes.io/projected/7870ec2c-0344-4cfe-bc6d-4bca0c11ba52-kube-api-access-jtrg7\") pod \"glance-default-internal-api-0\" (UID: \"7870ec2c-0344-4cfe-bc6d-4bca0c11ba52\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:56:29 crc kubenswrapper[5120]: I0316 16:56:29.923900 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"glance-default-internal-api-0\" (UID: \"7870ec2c-0344-4cfe-bc6d-4bca0c11ba52\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:56:30 crc kubenswrapper[5120]: I0316 16:56:30.027483 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:56:30 crc kubenswrapper[5120]: I0316 16:56:30.328987 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:56:30 crc kubenswrapper[5120]: I0316 16:56:30.381736 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/519f2986-0498-4f41-b63e-3137e48794e8-sg-core-conf-yaml\") pod \"519f2986-0498-4f41-b63e-3137e48794e8\" (UID: \"519f2986-0498-4f41-b63e-3137e48794e8\") " Mar 16 16:56:30 crc kubenswrapper[5120]: I0316 16:56:30.382159 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/519f2986-0498-4f41-b63e-3137e48794e8-scripts\") pod \"519f2986-0498-4f41-b63e-3137e48794e8\" (UID: \"519f2986-0498-4f41-b63e-3137e48794e8\") " Mar 16 16:56:30 crc kubenswrapper[5120]: I0316 16:56:30.382280 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/519f2986-0498-4f41-b63e-3137e48794e8-run-httpd\") pod \"519f2986-0498-4f41-b63e-3137e48794e8\" (UID: \"519f2986-0498-4f41-b63e-3137e48794e8\") " Mar 16 16:56:30 crc kubenswrapper[5120]: I0316 16:56:30.382333 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n9d8t\" (UniqueName: \"kubernetes.io/projected/519f2986-0498-4f41-b63e-3137e48794e8-kube-api-access-n9d8t\") pod \"519f2986-0498-4f41-b63e-3137e48794e8\" (UID: \"519f2986-0498-4f41-b63e-3137e48794e8\") " Mar 16 16:56:30 crc kubenswrapper[5120]: I0316 16:56:30.382569 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/519f2986-0498-4f41-b63e-3137e48794e8-combined-ca-bundle\") pod \"519f2986-0498-4f41-b63e-3137e48794e8\" (UID: \"519f2986-0498-4f41-b63e-3137e48794e8\") " Mar 16 16:56:30 crc kubenswrapper[5120]: I0316 16:56:30.382665 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/519f2986-0498-4f41-b63e-3137e48794e8-config-data\") pod \"519f2986-0498-4f41-b63e-3137e48794e8\" (UID: \"519f2986-0498-4f41-b63e-3137e48794e8\") " Mar 16 16:56:30 crc kubenswrapper[5120]: I0316 16:56:30.382807 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/519f2986-0498-4f41-b63e-3137e48794e8-log-httpd\") pod \"519f2986-0498-4f41-b63e-3137e48794e8\" (UID: \"519f2986-0498-4f41-b63e-3137e48794e8\") " Mar 16 16:56:30 crc kubenswrapper[5120]: I0316 16:56:30.383071 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/519f2986-0498-4f41-b63e-3137e48794e8-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "519f2986-0498-4f41-b63e-3137e48794e8" (UID: "519f2986-0498-4f41-b63e-3137e48794e8"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:56:30 crc kubenswrapper[5120]: I0316 16:56:30.383876 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/519f2986-0498-4f41-b63e-3137e48794e8-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "519f2986-0498-4f41-b63e-3137e48794e8" (UID: "519f2986-0498-4f41-b63e-3137e48794e8"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:56:30 crc kubenswrapper[5120]: I0316 16:56:30.384134 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/519f2986-0498-4f41-b63e-3137e48794e8-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:56:30 crc kubenswrapper[5120]: I0316 16:56:30.384156 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/519f2986-0498-4f41-b63e-3137e48794e8-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:56:30 crc kubenswrapper[5120]: I0316 16:56:30.388630 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/519f2986-0498-4f41-b63e-3137e48794e8-scripts" (OuterVolumeSpecName: "scripts") pod "519f2986-0498-4f41-b63e-3137e48794e8" (UID: "519f2986-0498-4f41-b63e-3137e48794e8"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:56:30 crc kubenswrapper[5120]: I0316 16:56:30.388678 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/519f2986-0498-4f41-b63e-3137e48794e8-kube-api-access-n9d8t" (OuterVolumeSpecName: "kube-api-access-n9d8t") pod "519f2986-0498-4f41-b63e-3137e48794e8" (UID: "519f2986-0498-4f41-b63e-3137e48794e8"). InnerVolumeSpecName "kube-api-access-n9d8t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:56:30 crc kubenswrapper[5120]: I0316 16:56:30.413367 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/519f2986-0498-4f41-b63e-3137e48794e8-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "519f2986-0498-4f41-b63e-3137e48794e8" (UID: "519f2986-0498-4f41-b63e-3137e48794e8"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:56:30 crc kubenswrapper[5120]: I0316 16:56:30.489596 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"dc34c11e-3278-4e46-94e1-7cb991fe4591","Type":"ContainerStarted","Data":"bed6ecf73bd8e2438e112768e701642686b27000a502df975bda33f9cefc79d7"} Mar 16 16:56:30 crc kubenswrapper[5120]: I0316 16:56:30.496033 5120 generic.go:358] "Generic (PLEG): container finished" podID="519f2986-0498-4f41-b63e-3137e48794e8" containerID="da28df4d2b4d7297db4747135d2d4c7a4bf8b654939a2ac3233c1bb7ec133e16" exitCode=0 Mar 16 16:56:30 crc kubenswrapper[5120]: I0316 16:56:30.496066 5120 generic.go:358] "Generic (PLEG): container finished" podID="519f2986-0498-4f41-b63e-3137e48794e8" containerID="0631a64af2d97849fd447322863197a1f71b6367f2a0bbfc14fd56c98a346078" exitCode=2 Mar 16 16:56:30 crc kubenswrapper[5120]: I0316 16:56:30.496074 5120 generic.go:358] "Generic (PLEG): container finished" podID="519f2986-0498-4f41-b63e-3137e48794e8" containerID="8c88d9913acb46c6812b4fe61151c0facb34b3f867c5a3857e239ee42fa7857a" exitCode=0 Mar 16 16:56:30 crc kubenswrapper[5120]: I0316 16:56:30.496082 5120 generic.go:358] "Generic (PLEG): container finished" podID="519f2986-0498-4f41-b63e-3137e48794e8" containerID="341eb31c49d6a423406aff4c3e064cbb989dc5a7a58334293a86e5c48040d861" exitCode=0 Mar 16 16:56:30 crc kubenswrapper[5120]: I0316 16:56:30.496198 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"519f2986-0498-4f41-b63e-3137e48794e8","Type":"ContainerDied","Data":"da28df4d2b4d7297db4747135d2d4c7a4bf8b654939a2ac3233c1bb7ec133e16"} Mar 16 16:56:30 crc kubenswrapper[5120]: I0316 16:56:30.496230 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"519f2986-0498-4f41-b63e-3137e48794e8","Type":"ContainerDied","Data":"0631a64af2d97849fd447322863197a1f71b6367f2a0bbfc14fd56c98a346078"} Mar 16 16:56:30 crc kubenswrapper[5120]: I0316 16:56:30.496244 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"519f2986-0498-4f41-b63e-3137e48794e8","Type":"ContainerDied","Data":"8c88d9913acb46c6812b4fe61151c0facb34b3f867c5a3857e239ee42fa7857a"} Mar 16 16:56:30 crc kubenswrapper[5120]: I0316 16:56:30.496256 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"519f2986-0498-4f41-b63e-3137e48794e8","Type":"ContainerDied","Data":"341eb31c49d6a423406aff4c3e064cbb989dc5a7a58334293a86e5c48040d861"} Mar 16 16:56:30 crc kubenswrapper[5120]: I0316 16:56:30.496268 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"519f2986-0498-4f41-b63e-3137e48794e8","Type":"ContainerDied","Data":"152cfe7403123f9da435171204df4c87db69c002faffa96dfcbdd0bcb511f7ab"} Mar 16 16:56:30 crc kubenswrapper[5120]: I0316 16:56:30.496284 5120 scope.go:117] "RemoveContainer" containerID="da28df4d2b4d7297db4747135d2d4c7a4bf8b654939a2ac3233c1bb7ec133e16" Mar 16 16:56:30 crc kubenswrapper[5120]: I0316 16:56:30.496440 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:56:30 crc kubenswrapper[5120]: I0316 16:56:30.503597 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-marketplace/redhat-operators-7mhml" podUID="3209b0ef-38f4-4ab3-9594-6f4c18d592ec" containerName="registry-server" containerID="cri-o://2eadc6dbc7f01160dc9a3b9cbe42655a685b5eefde4463cd3ee26fd2426910ed" gracePeriod=2 Mar 16 16:56:30 crc kubenswrapper[5120]: I0316 16:56:30.508950 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/519f2986-0498-4f41-b63e-3137e48794e8-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 16:56:30 crc kubenswrapper[5120]: I0316 16:56:30.509006 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/519f2986-0498-4f41-b63e-3137e48794e8-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:56:30 crc kubenswrapper[5120]: I0316 16:56:30.509022 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n9d8t\" (UniqueName: \"kubernetes.io/projected/519f2986-0498-4f41-b63e-3137e48794e8-kube-api-access-n9d8t\") on node \"crc\" DevicePath \"\"" Mar 16 16:56:30 crc kubenswrapper[5120]: I0316 16:56:30.515829 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-6dbf47b8f6-ghhnl"] Mar 16 16:56:30 crc kubenswrapper[5120]: I0316 16:56:30.526043 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/519f2986-0498-4f41-b63e-3137e48794e8-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "519f2986-0498-4f41-b63e-3137e48794e8" (UID: "519f2986-0498-4f41-b63e-3137e48794e8"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:56:30 crc kubenswrapper[5120]: I0316 16:56:30.539977 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/519f2986-0498-4f41-b63e-3137e48794e8-config-data" (OuterVolumeSpecName: "config-data") pod "519f2986-0498-4f41-b63e-3137e48794e8" (UID: "519f2986-0498-4f41-b63e-3137e48794e8"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:56:30 crc kubenswrapper[5120]: I0316 16:56:30.615016 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/519f2986-0498-4f41-b63e-3137e48794e8-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:56:30 crc kubenswrapper[5120]: I0316 16:56:30.615066 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/519f2986-0498-4f41-b63e-3137e48794e8-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:56:30 crc kubenswrapper[5120]: I0316 16:56:30.638919 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:56:30 crc kubenswrapper[5120]: W0316 16:56:30.652467 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7870ec2c_0344_4cfe_bc6d_4bca0c11ba52.slice/crio-d3882c03cfdfb341872e930e52c528f309fd5430ec14aced426bd629db7c3fec WatchSource:0}: Error finding container d3882c03cfdfb341872e930e52c528f309fd5430ec14aced426bd629db7c3fec: Status 404 returned error can't find the container with id d3882c03cfdfb341872e930e52c528f309fd5430ec14aced426bd629db7c3fec Mar 16 16:56:30 crc kubenswrapper[5120]: I0316 16:56:30.678317 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="87a87799-b746-468e-876e-d5a5f7f006ca" path="/var/lib/kubelet/pods/87a87799-b746-468e-876e-d5a5f7f006ca/volumes" Mar 16 16:56:30 crc kubenswrapper[5120]: I0316 16:56:30.679334 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ab8eb1e5-5cec-4ca4-a92d-4da46f3d6f9e" path="/var/lib/kubelet/pods/ab8eb1e5-5cec-4ca4-a92d-4da46f3d6f9e/volumes" Mar 16 16:56:30 crc kubenswrapper[5120]: I0316 16:56:30.809807 5120 scope.go:117] "RemoveContainer" containerID="0631a64af2d97849fd447322863197a1f71b6367f2a0bbfc14fd56c98a346078" Mar 16 16:56:30 crc kubenswrapper[5120]: I0316 16:56:30.861084 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:56:30 crc kubenswrapper[5120]: I0316 16:56:30.868028 5120 scope.go:117] "RemoveContainer" containerID="8c88d9913acb46c6812b4fe61151c0facb34b3f867c5a3857e239ee42fa7857a" Mar 16 16:56:30 crc kubenswrapper[5120]: I0316 16:56:30.914808 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:56:30 crc kubenswrapper[5120]: I0316 16:56:30.925094 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:56:30 crc kubenswrapper[5120]: I0316 16:56:30.928598 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="519f2986-0498-4f41-b63e-3137e48794e8" containerName="sg-core" Mar 16 16:56:30 crc kubenswrapper[5120]: I0316 16:56:30.928625 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="519f2986-0498-4f41-b63e-3137e48794e8" containerName="sg-core" Mar 16 16:56:30 crc kubenswrapper[5120]: I0316 16:56:30.928637 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="519f2986-0498-4f41-b63e-3137e48794e8" containerName="ceilometer-notification-agent" Mar 16 16:56:30 crc kubenswrapper[5120]: I0316 16:56:30.928644 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="519f2986-0498-4f41-b63e-3137e48794e8" containerName="ceilometer-notification-agent" Mar 16 16:56:30 crc kubenswrapper[5120]: I0316 16:56:30.928669 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="519f2986-0498-4f41-b63e-3137e48794e8" containerName="proxy-httpd" Mar 16 16:56:30 crc kubenswrapper[5120]: I0316 16:56:30.928675 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="519f2986-0498-4f41-b63e-3137e48794e8" containerName="proxy-httpd" Mar 16 16:56:30 crc kubenswrapper[5120]: I0316 16:56:30.928692 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="519f2986-0498-4f41-b63e-3137e48794e8" containerName="ceilometer-central-agent" Mar 16 16:56:30 crc kubenswrapper[5120]: I0316 16:56:30.928697 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="519f2986-0498-4f41-b63e-3137e48794e8" containerName="ceilometer-central-agent" Mar 16 16:56:30 crc kubenswrapper[5120]: I0316 16:56:30.928880 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="519f2986-0498-4f41-b63e-3137e48794e8" containerName="ceilometer-notification-agent" Mar 16 16:56:30 crc kubenswrapper[5120]: I0316 16:56:30.928889 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="519f2986-0498-4f41-b63e-3137e48794e8" containerName="sg-core" Mar 16 16:56:30 crc kubenswrapper[5120]: I0316 16:56:30.928901 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="519f2986-0498-4f41-b63e-3137e48794e8" containerName="ceilometer-central-agent" Mar 16 16:56:30 crc kubenswrapper[5120]: I0316 16:56:30.928920 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="519f2986-0498-4f41-b63e-3137e48794e8" containerName="proxy-httpd" Mar 16 16:56:30 crc kubenswrapper[5120]: I0316 16:56:30.940058 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:56:30 crc kubenswrapper[5120]: I0316 16:56:30.941304 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:56:30 crc kubenswrapper[5120]: I0316 16:56:30.947901 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 16:56:30 crc kubenswrapper[5120]: I0316 16:56:30.948075 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 16:56:30 crc kubenswrapper[5120]: I0316 16:56:30.959114 5120 scope.go:117] "RemoveContainer" containerID="341eb31c49d6a423406aff4c3e064cbb989dc5a7a58334293a86e5c48040d861" Mar 16 16:56:30 crc kubenswrapper[5120]: I0316 16:56:30.993168 5120 scope.go:117] "RemoveContainer" containerID="da28df4d2b4d7297db4747135d2d4c7a4bf8b654939a2ac3233c1bb7ec133e16" Mar 16 16:56:31 crc kubenswrapper[5120]: E0316 16:56:31.001029 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da28df4d2b4d7297db4747135d2d4c7a4bf8b654939a2ac3233c1bb7ec133e16\": container with ID starting with da28df4d2b4d7297db4747135d2d4c7a4bf8b654939a2ac3233c1bb7ec133e16 not found: ID does not exist" containerID="da28df4d2b4d7297db4747135d2d4c7a4bf8b654939a2ac3233c1bb7ec133e16" Mar 16 16:56:31 crc kubenswrapper[5120]: I0316 16:56:31.001081 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da28df4d2b4d7297db4747135d2d4c7a4bf8b654939a2ac3233c1bb7ec133e16"} err="failed to get container status \"da28df4d2b4d7297db4747135d2d4c7a4bf8b654939a2ac3233c1bb7ec133e16\": rpc error: code = NotFound desc = could not find container \"da28df4d2b4d7297db4747135d2d4c7a4bf8b654939a2ac3233c1bb7ec133e16\": container with ID starting with da28df4d2b4d7297db4747135d2d4c7a4bf8b654939a2ac3233c1bb7ec133e16 not found: ID does not exist" Mar 16 16:56:31 crc kubenswrapper[5120]: I0316 16:56:31.001115 5120 scope.go:117] "RemoveContainer" containerID="0631a64af2d97849fd447322863197a1f71b6367f2a0bbfc14fd56c98a346078" Mar 16 16:56:31 crc kubenswrapper[5120]: E0316 16:56:31.003514 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0631a64af2d97849fd447322863197a1f71b6367f2a0bbfc14fd56c98a346078\": container with ID starting with 0631a64af2d97849fd447322863197a1f71b6367f2a0bbfc14fd56c98a346078 not found: ID does not exist" containerID="0631a64af2d97849fd447322863197a1f71b6367f2a0bbfc14fd56c98a346078" Mar 16 16:56:31 crc kubenswrapper[5120]: I0316 16:56:31.003552 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0631a64af2d97849fd447322863197a1f71b6367f2a0bbfc14fd56c98a346078"} err="failed to get container status \"0631a64af2d97849fd447322863197a1f71b6367f2a0bbfc14fd56c98a346078\": rpc error: code = NotFound desc = could not find container \"0631a64af2d97849fd447322863197a1f71b6367f2a0bbfc14fd56c98a346078\": container with ID starting with 0631a64af2d97849fd447322863197a1f71b6367f2a0bbfc14fd56c98a346078 not found: ID does not exist" Mar 16 16:56:31 crc kubenswrapper[5120]: I0316 16:56:31.003573 5120 scope.go:117] "RemoveContainer" containerID="8c88d9913acb46c6812b4fe61151c0facb34b3f867c5a3857e239ee42fa7857a" Mar 16 16:56:31 crc kubenswrapper[5120]: E0316 16:56:31.004507 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c88d9913acb46c6812b4fe61151c0facb34b3f867c5a3857e239ee42fa7857a\": container with ID starting with 8c88d9913acb46c6812b4fe61151c0facb34b3f867c5a3857e239ee42fa7857a not found: ID does not exist" containerID="8c88d9913acb46c6812b4fe61151c0facb34b3f867c5a3857e239ee42fa7857a" Mar 16 16:56:31 crc kubenswrapper[5120]: I0316 16:56:31.004546 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c88d9913acb46c6812b4fe61151c0facb34b3f867c5a3857e239ee42fa7857a"} err="failed to get container status \"8c88d9913acb46c6812b4fe61151c0facb34b3f867c5a3857e239ee42fa7857a\": rpc error: code = NotFound desc = could not find container \"8c88d9913acb46c6812b4fe61151c0facb34b3f867c5a3857e239ee42fa7857a\": container with ID starting with 8c88d9913acb46c6812b4fe61151c0facb34b3f867c5a3857e239ee42fa7857a not found: ID does not exist" Mar 16 16:56:31 crc kubenswrapper[5120]: I0316 16:56:31.004571 5120 scope.go:117] "RemoveContainer" containerID="341eb31c49d6a423406aff4c3e064cbb989dc5a7a58334293a86e5c48040d861" Mar 16 16:56:31 crc kubenswrapper[5120]: E0316 16:56:31.005322 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"341eb31c49d6a423406aff4c3e064cbb989dc5a7a58334293a86e5c48040d861\": container with ID starting with 341eb31c49d6a423406aff4c3e064cbb989dc5a7a58334293a86e5c48040d861 not found: ID does not exist" containerID="341eb31c49d6a423406aff4c3e064cbb989dc5a7a58334293a86e5c48040d861" Mar 16 16:56:31 crc kubenswrapper[5120]: I0316 16:56:31.005359 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"341eb31c49d6a423406aff4c3e064cbb989dc5a7a58334293a86e5c48040d861"} err="failed to get container status \"341eb31c49d6a423406aff4c3e064cbb989dc5a7a58334293a86e5c48040d861\": rpc error: code = NotFound desc = could not find container \"341eb31c49d6a423406aff4c3e064cbb989dc5a7a58334293a86e5c48040d861\": container with ID starting with 341eb31c49d6a423406aff4c3e064cbb989dc5a7a58334293a86e5c48040d861 not found: ID does not exist" Mar 16 16:56:31 crc kubenswrapper[5120]: I0316 16:56:31.005380 5120 scope.go:117] "RemoveContainer" containerID="da28df4d2b4d7297db4747135d2d4c7a4bf8b654939a2ac3233c1bb7ec133e16" Mar 16 16:56:31 crc kubenswrapper[5120]: I0316 16:56:31.006309 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da28df4d2b4d7297db4747135d2d4c7a4bf8b654939a2ac3233c1bb7ec133e16"} err="failed to get container status \"da28df4d2b4d7297db4747135d2d4c7a4bf8b654939a2ac3233c1bb7ec133e16\": rpc error: code = NotFound desc = could not find container \"da28df4d2b4d7297db4747135d2d4c7a4bf8b654939a2ac3233c1bb7ec133e16\": container with ID starting with da28df4d2b4d7297db4747135d2d4c7a4bf8b654939a2ac3233c1bb7ec133e16 not found: ID does not exist" Mar 16 16:56:31 crc kubenswrapper[5120]: I0316 16:56:31.006334 5120 scope.go:117] "RemoveContainer" containerID="0631a64af2d97849fd447322863197a1f71b6367f2a0bbfc14fd56c98a346078" Mar 16 16:56:31 crc kubenswrapper[5120]: I0316 16:56:31.007359 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0631a64af2d97849fd447322863197a1f71b6367f2a0bbfc14fd56c98a346078"} err="failed to get container status \"0631a64af2d97849fd447322863197a1f71b6367f2a0bbfc14fd56c98a346078\": rpc error: code = NotFound desc = could not find container \"0631a64af2d97849fd447322863197a1f71b6367f2a0bbfc14fd56c98a346078\": container with ID starting with 0631a64af2d97849fd447322863197a1f71b6367f2a0bbfc14fd56c98a346078 not found: ID does not exist" Mar 16 16:56:31 crc kubenswrapper[5120]: I0316 16:56:31.007387 5120 scope.go:117] "RemoveContainer" containerID="8c88d9913acb46c6812b4fe61151c0facb34b3f867c5a3857e239ee42fa7857a" Mar 16 16:56:31 crc kubenswrapper[5120]: I0316 16:56:31.008079 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c88d9913acb46c6812b4fe61151c0facb34b3f867c5a3857e239ee42fa7857a"} err="failed to get container status \"8c88d9913acb46c6812b4fe61151c0facb34b3f867c5a3857e239ee42fa7857a\": rpc error: code = NotFound desc = could not find container \"8c88d9913acb46c6812b4fe61151c0facb34b3f867c5a3857e239ee42fa7857a\": container with ID starting with 8c88d9913acb46c6812b4fe61151c0facb34b3f867c5a3857e239ee42fa7857a not found: ID does not exist" Mar 16 16:56:31 crc kubenswrapper[5120]: I0316 16:56:31.008133 5120 scope.go:117] "RemoveContainer" containerID="341eb31c49d6a423406aff4c3e064cbb989dc5a7a58334293a86e5c48040d861" Mar 16 16:56:31 crc kubenswrapper[5120]: I0316 16:56:31.008360 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"341eb31c49d6a423406aff4c3e064cbb989dc5a7a58334293a86e5c48040d861"} err="failed to get container status \"341eb31c49d6a423406aff4c3e064cbb989dc5a7a58334293a86e5c48040d861\": rpc error: code = NotFound desc = could not find container \"341eb31c49d6a423406aff4c3e064cbb989dc5a7a58334293a86e5c48040d861\": container with ID starting with 341eb31c49d6a423406aff4c3e064cbb989dc5a7a58334293a86e5c48040d861 not found: ID does not exist" Mar 16 16:56:31 crc kubenswrapper[5120]: I0316 16:56:31.008390 5120 scope.go:117] "RemoveContainer" containerID="da28df4d2b4d7297db4747135d2d4c7a4bf8b654939a2ac3233c1bb7ec133e16" Mar 16 16:56:31 crc kubenswrapper[5120]: I0316 16:56:31.008683 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da28df4d2b4d7297db4747135d2d4c7a4bf8b654939a2ac3233c1bb7ec133e16"} err="failed to get container status \"da28df4d2b4d7297db4747135d2d4c7a4bf8b654939a2ac3233c1bb7ec133e16\": rpc error: code = NotFound desc = could not find container \"da28df4d2b4d7297db4747135d2d4c7a4bf8b654939a2ac3233c1bb7ec133e16\": container with ID starting with da28df4d2b4d7297db4747135d2d4c7a4bf8b654939a2ac3233c1bb7ec133e16 not found: ID does not exist" Mar 16 16:56:31 crc kubenswrapper[5120]: I0316 16:56:31.008749 5120 scope.go:117] "RemoveContainer" containerID="0631a64af2d97849fd447322863197a1f71b6367f2a0bbfc14fd56c98a346078" Mar 16 16:56:31 crc kubenswrapper[5120]: I0316 16:56:31.009325 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0631a64af2d97849fd447322863197a1f71b6367f2a0bbfc14fd56c98a346078"} err="failed to get container status \"0631a64af2d97849fd447322863197a1f71b6367f2a0bbfc14fd56c98a346078\": rpc error: code = NotFound desc = could not find container \"0631a64af2d97849fd447322863197a1f71b6367f2a0bbfc14fd56c98a346078\": container with ID starting with 0631a64af2d97849fd447322863197a1f71b6367f2a0bbfc14fd56c98a346078 not found: ID does not exist" Mar 16 16:56:31 crc kubenswrapper[5120]: I0316 16:56:31.009350 5120 scope.go:117] "RemoveContainer" containerID="8c88d9913acb46c6812b4fe61151c0facb34b3f867c5a3857e239ee42fa7857a" Mar 16 16:56:31 crc kubenswrapper[5120]: I0316 16:56:31.031010 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/9975f854-d1d5-4fda-9475-8a93c6d69b1f-log-httpd\") pod \"ceilometer-0\" (UID: \"9975f854-d1d5-4fda-9475-8a93c6d69b1f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:56:31 crc kubenswrapper[5120]: I0316 16:56:31.031342 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9975f854-d1d5-4fda-9475-8a93c6d69b1f-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"9975f854-d1d5-4fda-9475-8a93c6d69b1f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:56:31 crc kubenswrapper[5120]: I0316 16:56:31.031401 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9975f854-d1d5-4fda-9475-8a93c6d69b1f-config-data\") pod \"ceilometer-0\" (UID: \"9975f854-d1d5-4fda-9475-8a93c6d69b1f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:56:31 crc kubenswrapper[5120]: I0316 16:56:31.031450 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/9975f854-d1d5-4fda-9475-8a93c6d69b1f-run-httpd\") pod \"ceilometer-0\" (UID: \"9975f854-d1d5-4fda-9475-8a93c6d69b1f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:56:31 crc kubenswrapper[5120]: I0316 16:56:31.031469 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9975f854-d1d5-4fda-9475-8a93c6d69b1f-scripts\") pod \"ceilometer-0\" (UID: \"9975f854-d1d5-4fda-9475-8a93c6d69b1f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:56:31 crc kubenswrapper[5120]: I0316 16:56:31.031491 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/9975f854-d1d5-4fda-9475-8a93c6d69b1f-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"9975f854-d1d5-4fda-9475-8a93c6d69b1f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:56:31 crc kubenswrapper[5120]: I0316 16:56:31.031545 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4kx8\" (UniqueName: \"kubernetes.io/projected/9975f854-d1d5-4fda-9475-8a93c6d69b1f-kube-api-access-b4kx8\") pod \"ceilometer-0\" (UID: \"9975f854-d1d5-4fda-9475-8a93c6d69b1f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:56:31 crc kubenswrapper[5120]: I0316 16:56:31.032161 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c88d9913acb46c6812b4fe61151c0facb34b3f867c5a3857e239ee42fa7857a"} err="failed to get container status \"8c88d9913acb46c6812b4fe61151c0facb34b3f867c5a3857e239ee42fa7857a\": rpc error: code = NotFound desc = could not find container \"8c88d9913acb46c6812b4fe61151c0facb34b3f867c5a3857e239ee42fa7857a\": container with ID starting with 8c88d9913acb46c6812b4fe61151c0facb34b3f867c5a3857e239ee42fa7857a not found: ID does not exist" Mar 16 16:56:31 crc kubenswrapper[5120]: I0316 16:56:31.032347 5120 scope.go:117] "RemoveContainer" containerID="341eb31c49d6a423406aff4c3e064cbb989dc5a7a58334293a86e5c48040d861" Mar 16 16:56:31 crc kubenswrapper[5120]: I0316 16:56:31.035320 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"341eb31c49d6a423406aff4c3e064cbb989dc5a7a58334293a86e5c48040d861"} err="failed to get container status \"341eb31c49d6a423406aff4c3e064cbb989dc5a7a58334293a86e5c48040d861\": rpc error: code = NotFound desc = could not find container \"341eb31c49d6a423406aff4c3e064cbb989dc5a7a58334293a86e5c48040d861\": container with ID starting with 341eb31c49d6a423406aff4c3e064cbb989dc5a7a58334293a86e5c48040d861 not found: ID does not exist" Mar 16 16:56:31 crc kubenswrapper[5120]: I0316 16:56:31.035396 5120 scope.go:117] "RemoveContainer" containerID="da28df4d2b4d7297db4747135d2d4c7a4bf8b654939a2ac3233c1bb7ec133e16" Mar 16 16:56:31 crc kubenswrapper[5120]: I0316 16:56:31.038424 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da28df4d2b4d7297db4747135d2d4c7a4bf8b654939a2ac3233c1bb7ec133e16"} err="failed to get container status \"da28df4d2b4d7297db4747135d2d4c7a4bf8b654939a2ac3233c1bb7ec133e16\": rpc error: code = NotFound desc = could not find container \"da28df4d2b4d7297db4747135d2d4c7a4bf8b654939a2ac3233c1bb7ec133e16\": container with ID starting with da28df4d2b4d7297db4747135d2d4c7a4bf8b654939a2ac3233c1bb7ec133e16 not found: ID does not exist" Mar 16 16:56:31 crc kubenswrapper[5120]: I0316 16:56:31.038452 5120 scope.go:117] "RemoveContainer" containerID="0631a64af2d97849fd447322863197a1f71b6367f2a0bbfc14fd56c98a346078" Mar 16 16:56:31 crc kubenswrapper[5120]: I0316 16:56:31.041004 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0631a64af2d97849fd447322863197a1f71b6367f2a0bbfc14fd56c98a346078"} err="failed to get container status \"0631a64af2d97849fd447322863197a1f71b6367f2a0bbfc14fd56c98a346078\": rpc error: code = NotFound desc = could not find container \"0631a64af2d97849fd447322863197a1f71b6367f2a0bbfc14fd56c98a346078\": container with ID starting with 0631a64af2d97849fd447322863197a1f71b6367f2a0bbfc14fd56c98a346078 not found: ID does not exist" Mar 16 16:56:31 crc kubenswrapper[5120]: I0316 16:56:31.041058 5120 scope.go:117] "RemoveContainer" containerID="8c88d9913acb46c6812b4fe61151c0facb34b3f867c5a3857e239ee42fa7857a" Mar 16 16:56:31 crc kubenswrapper[5120]: I0316 16:56:31.044216 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c88d9913acb46c6812b4fe61151c0facb34b3f867c5a3857e239ee42fa7857a"} err="failed to get container status \"8c88d9913acb46c6812b4fe61151c0facb34b3f867c5a3857e239ee42fa7857a\": rpc error: code = NotFound desc = could not find container \"8c88d9913acb46c6812b4fe61151c0facb34b3f867c5a3857e239ee42fa7857a\": container with ID starting with 8c88d9913acb46c6812b4fe61151c0facb34b3f867c5a3857e239ee42fa7857a not found: ID does not exist" Mar 16 16:56:31 crc kubenswrapper[5120]: I0316 16:56:31.044295 5120 scope.go:117] "RemoveContainer" containerID="341eb31c49d6a423406aff4c3e064cbb989dc5a7a58334293a86e5c48040d861" Mar 16 16:56:31 crc kubenswrapper[5120]: I0316 16:56:31.045473 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"341eb31c49d6a423406aff4c3e064cbb989dc5a7a58334293a86e5c48040d861"} err="failed to get container status \"341eb31c49d6a423406aff4c3e064cbb989dc5a7a58334293a86e5c48040d861\": rpc error: code = NotFound desc = could not find container \"341eb31c49d6a423406aff4c3e064cbb989dc5a7a58334293a86e5c48040d861\": container with ID starting with 341eb31c49d6a423406aff4c3e064cbb989dc5a7a58334293a86e5c48040d861 not found: ID does not exist" Mar 16 16:56:31 crc kubenswrapper[5120]: I0316 16:56:31.113327 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-7mhml" Mar 16 16:56:31 crc kubenswrapper[5120]: I0316 16:56:31.141841 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9975f854-d1d5-4fda-9475-8a93c6d69b1f-config-data\") pod \"ceilometer-0\" (UID: \"9975f854-d1d5-4fda-9475-8a93c6d69b1f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:56:31 crc kubenswrapper[5120]: I0316 16:56:31.141951 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/9975f854-d1d5-4fda-9475-8a93c6d69b1f-run-httpd\") pod \"ceilometer-0\" (UID: \"9975f854-d1d5-4fda-9475-8a93c6d69b1f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:56:31 crc kubenswrapper[5120]: I0316 16:56:31.141974 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9975f854-d1d5-4fda-9475-8a93c6d69b1f-scripts\") pod \"ceilometer-0\" (UID: \"9975f854-d1d5-4fda-9475-8a93c6d69b1f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:56:31 crc kubenswrapper[5120]: I0316 16:56:31.142000 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/9975f854-d1d5-4fda-9475-8a93c6d69b1f-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"9975f854-d1d5-4fda-9475-8a93c6d69b1f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:56:31 crc kubenswrapper[5120]: I0316 16:56:31.142079 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b4kx8\" (UniqueName: \"kubernetes.io/projected/9975f854-d1d5-4fda-9475-8a93c6d69b1f-kube-api-access-b4kx8\") pod \"ceilometer-0\" (UID: \"9975f854-d1d5-4fda-9475-8a93c6d69b1f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:56:31 crc kubenswrapper[5120]: I0316 16:56:31.142330 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/9975f854-d1d5-4fda-9475-8a93c6d69b1f-log-httpd\") pod \"ceilometer-0\" (UID: \"9975f854-d1d5-4fda-9475-8a93c6d69b1f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:56:31 crc kubenswrapper[5120]: I0316 16:56:31.142386 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9975f854-d1d5-4fda-9475-8a93c6d69b1f-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"9975f854-d1d5-4fda-9475-8a93c6d69b1f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:56:31 crc kubenswrapper[5120]: I0316 16:56:31.147464 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9975f854-d1d5-4fda-9475-8a93c6d69b1f-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"9975f854-d1d5-4fda-9475-8a93c6d69b1f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:56:31 crc kubenswrapper[5120]: I0316 16:56:31.147739 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/9975f854-d1d5-4fda-9475-8a93c6d69b1f-log-httpd\") pod \"ceilometer-0\" (UID: \"9975f854-d1d5-4fda-9475-8a93c6d69b1f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:56:31 crc kubenswrapper[5120]: I0316 16:56:31.150009 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/9975f854-d1d5-4fda-9475-8a93c6d69b1f-run-httpd\") pod \"ceilometer-0\" (UID: \"9975f854-d1d5-4fda-9475-8a93c6d69b1f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:56:31 crc kubenswrapper[5120]: I0316 16:56:31.152191 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/9975f854-d1d5-4fda-9475-8a93c6d69b1f-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"9975f854-d1d5-4fda-9475-8a93c6d69b1f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:56:31 crc kubenswrapper[5120]: I0316 16:56:31.154523 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9975f854-d1d5-4fda-9475-8a93c6d69b1f-config-data\") pod \"ceilometer-0\" (UID: \"9975f854-d1d5-4fda-9475-8a93c6d69b1f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:56:31 crc kubenswrapper[5120]: I0316 16:56:31.155723 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9975f854-d1d5-4fda-9475-8a93c6d69b1f-scripts\") pod \"ceilometer-0\" (UID: \"9975f854-d1d5-4fda-9475-8a93c6d69b1f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:56:31 crc kubenswrapper[5120]: I0316 16:56:31.166177 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4kx8\" (UniqueName: \"kubernetes.io/projected/9975f854-d1d5-4fda-9475-8a93c6d69b1f-kube-api-access-b4kx8\") pod \"ceilometer-0\" (UID: \"9975f854-d1d5-4fda-9475-8a93c6d69b1f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:56:31 crc kubenswrapper[5120]: I0316 16:56:31.245066 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/3209b0ef-38f4-4ab3-9594-6f4c18d592ec-utilities\") pod \"3209b0ef-38f4-4ab3-9594-6f4c18d592ec\" (UID: \"3209b0ef-38f4-4ab3-9594-6f4c18d592ec\") " Mar 16 16:56:31 crc kubenswrapper[5120]: I0316 16:56:31.246110 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3209b0ef-38f4-4ab3-9594-6f4c18d592ec-utilities" (OuterVolumeSpecName: "utilities") pod "3209b0ef-38f4-4ab3-9594-6f4c18d592ec" (UID: "3209b0ef-38f4-4ab3-9594-6f4c18d592ec"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:56:31 crc kubenswrapper[5120]: I0316 16:56:31.247119 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/3209b0ef-38f4-4ab3-9594-6f4c18d592ec-catalog-content\") pod \"3209b0ef-38f4-4ab3-9594-6f4c18d592ec\" (UID: \"3209b0ef-38f4-4ab3-9594-6f4c18d592ec\") " Mar 16 16:56:31 crc kubenswrapper[5120]: I0316 16:56:31.247439 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4tcv5\" (UniqueName: \"kubernetes.io/projected/3209b0ef-38f4-4ab3-9594-6f4c18d592ec-kube-api-access-4tcv5\") pod \"3209b0ef-38f4-4ab3-9594-6f4c18d592ec\" (UID: \"3209b0ef-38f4-4ab3-9594-6f4c18d592ec\") " Mar 16 16:56:31 crc kubenswrapper[5120]: I0316 16:56:31.250538 5120 reconciler_common.go:299] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/3209b0ef-38f4-4ab3-9594-6f4c18d592ec-utilities\") on node \"crc\" DevicePath \"\"" Mar 16 16:56:31 crc kubenswrapper[5120]: I0316 16:56:31.252594 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3209b0ef-38f4-4ab3-9594-6f4c18d592ec-kube-api-access-4tcv5" (OuterVolumeSpecName: "kube-api-access-4tcv5") pod "3209b0ef-38f4-4ab3-9594-6f4c18d592ec" (UID: "3209b0ef-38f4-4ab3-9594-6f4c18d592ec"). InnerVolumeSpecName "kube-api-access-4tcv5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:56:31 crc kubenswrapper[5120]: I0316 16:56:31.271703 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:56:31 crc kubenswrapper[5120]: I0316 16:56:31.353470 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4tcv5\" (UniqueName: \"kubernetes.io/projected/3209b0ef-38f4-4ab3-9594-6f4c18d592ec-kube-api-access-4tcv5\") on node \"crc\" DevicePath \"\"" Mar 16 16:56:31 crc kubenswrapper[5120]: I0316 16:56:31.435565 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3209b0ef-38f4-4ab3-9594-6f4c18d592ec-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "3209b0ef-38f4-4ab3-9594-6f4c18d592ec" (UID: "3209b0ef-38f4-4ab3-9594-6f4c18d592ec"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:56:31 crc kubenswrapper[5120]: I0316 16:56:31.457929 5120 reconciler_common.go:299] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/3209b0ef-38f4-4ab3-9594-6f4c18d592ec-catalog-content\") on node \"crc\" DevicePath \"\"" Mar 16 16:56:31 crc kubenswrapper[5120]: E0316 16:56:31.559941 5120 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf38ba03a_736c_4963_9059_d50f52f0bbf5.slice/crio-8db8e6076fafae9ba6b0baeae22182d94990be75ab4568d643d967c6e11582d6.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf38ba03a_736c_4963_9059_d50f52f0bbf5.slice/crio-conmon-8db8e6076fafae9ba6b0baeae22182d94990be75ab4568d643d967c6e11582d6.scope\": RecentStats: unable to find data in memory cache]" Mar 16 16:56:31 crc kubenswrapper[5120]: I0316 16:56:31.563947 5120 generic.go:358] "Generic (PLEG): container finished" podID="3209b0ef-38f4-4ab3-9594-6f4c18d592ec" containerID="2eadc6dbc7f01160dc9a3b9cbe42655a685b5eefde4463cd3ee26fd2426910ed" exitCode=0 Mar 16 16:56:31 crc kubenswrapper[5120]: I0316 16:56:31.564043 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-7mhml" Mar 16 16:56:31 crc kubenswrapper[5120]: I0316 16:56:31.564058 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-7mhml" event={"ID":"3209b0ef-38f4-4ab3-9594-6f4c18d592ec","Type":"ContainerDied","Data":"2eadc6dbc7f01160dc9a3b9cbe42655a685b5eefde4463cd3ee26fd2426910ed"} Mar 16 16:56:31 crc kubenswrapper[5120]: I0316 16:56:31.564084 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-7mhml" event={"ID":"3209b0ef-38f4-4ab3-9594-6f4c18d592ec","Type":"ContainerDied","Data":"aac956b8419c6aa769644e9b65c17b91b25b0615a76574969e653cdbc973468a"} Mar 16 16:56:31 crc kubenswrapper[5120]: I0316 16:56:31.564101 5120 scope.go:117] "RemoveContainer" containerID="2eadc6dbc7f01160dc9a3b9cbe42655a685b5eefde4463cd3ee26fd2426910ed" Mar 16 16:56:31 crc kubenswrapper[5120]: I0316 16:56:31.571371 5120 generic.go:358] "Generic (PLEG): container finished" podID="4cb6be6a-67ac-4e35-aacf-d1df8c5c9c11" containerID="c3734c1f7a2516f61c2ebf8d78d0ed774a324bcc7d1d3f325ed904393918d581" exitCode=0 Mar 16 16:56:31 crc kubenswrapper[5120]: I0316 16:56:31.571465 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-kc6pl" event={"ID":"4cb6be6a-67ac-4e35-aacf-d1df8c5c9c11","Type":"ContainerDied","Data":"c3734c1f7a2516f61c2ebf8d78d0ed774a324bcc7d1d3f325ed904393918d581"} Mar 16 16:56:31 crc kubenswrapper[5120]: I0316 16:56:31.590822 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-6dbf47b8f6-ghhnl" event={"ID":"c9783c3d-ba3f-42b1-b0ae-545df719e28f","Type":"ContainerStarted","Data":"27eecfdd7df59b056a470f18ec3dd2498184d0c45b54db440dac16a788d56cc3"} Mar 16 16:56:31 crc kubenswrapper[5120]: I0316 16:56:31.590896 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-6dbf47b8f6-ghhnl" event={"ID":"c9783c3d-ba3f-42b1-b0ae-545df719e28f","Type":"ContainerStarted","Data":"273d6b735d7fe80ae2d0779a3166c2fbf04d5f969d78b2a06ffa583b0cc60fa6"} Mar 16 16:56:31 crc kubenswrapper[5120]: I0316 16:56:31.590912 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-6dbf47b8f6-ghhnl" event={"ID":"c9783c3d-ba3f-42b1-b0ae-545df719e28f","Type":"ContainerStarted","Data":"a1c10ddf3c1f54656aca1bf0a0a1db06f368738599dc9806bbb9f15d999a08fb"} Mar 16 16:56:31 crc kubenswrapper[5120]: I0316 16:56:31.591230 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-6dbf47b8f6-ghhnl" Mar 16 16:56:31 crc kubenswrapper[5120]: I0316 16:56:31.591292 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-6dbf47b8f6-ghhnl" Mar 16 16:56:31 crc kubenswrapper[5120]: I0316 16:56:31.607323 5120 generic.go:358] "Generic (PLEG): container finished" podID="f38ba03a-736c-4963-9059-d50f52f0bbf5" containerID="8db8e6076fafae9ba6b0baeae22182d94990be75ab4568d643d967c6e11582d6" exitCode=0 Mar 16 16:56:31 crc kubenswrapper[5120]: I0316 16:56:31.607420 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-zmwzp" event={"ID":"f38ba03a-736c-4963-9059-d50f52f0bbf5","Type":"ContainerDied","Data":"8db8e6076fafae9ba6b0baeae22182d94990be75ab4568d643d967c6e11582d6"} Mar 16 16:56:31 crc kubenswrapper[5120]: I0316 16:56:31.621843 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"dc34c11e-3278-4e46-94e1-7cb991fe4591","Type":"ContainerStarted","Data":"17763fbc1635305808da4653863a6755805a59c624d1ef4581274852d4eff119"} Mar 16 16:56:31 crc kubenswrapper[5120]: I0316 16:56:31.640917 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"7870ec2c-0344-4cfe-bc6d-4bca0c11ba52","Type":"ContainerStarted","Data":"eb3962f919d594f5a3959a34cacc52d4dc41c8dc91044b096eab14d5a2f0033b"} Mar 16 16:56:31 crc kubenswrapper[5120]: I0316 16:56:31.640962 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"7870ec2c-0344-4cfe-bc6d-4bca0c11ba52","Type":"ContainerStarted","Data":"d3882c03cfdfb341872e930e52c528f309fd5430ec14aced426bd629db7c3fec"} Mar 16 16:56:31 crc kubenswrapper[5120]: I0316 16:56:31.641810 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-6dbf47b8f6-ghhnl" podStartSLOduration=2.641784113 podStartE2EDuration="2.641784113s" podCreationTimestamp="2026-03-16 16:56:29 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:56:31.624401398 +0000 UTC m=+5093.778333075" watchObservedRunningTime="2026-03-16 16:56:31.641784113 +0000 UTC m=+5093.795715770" Mar 16 16:56:31 crc kubenswrapper[5120]: I0316 16:56:31.666233 5120 scope.go:117] "RemoveContainer" containerID="4743e24a9346c662c8975c8c56816faac6818c53b765b8d123f8527defd5a082" Mar 16 16:56:31 crc kubenswrapper[5120]: I0316 16:56:31.686712 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-operators-7mhml"] Mar 16 16:56:31 crc kubenswrapper[5120]: I0316 16:56:31.695544 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/redhat-operators-7mhml"] Mar 16 16:56:31 crc kubenswrapper[5120]: I0316 16:56:31.740384 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:56:31 crc kubenswrapper[5120]: I0316 16:56:31.795620 5120 scope.go:117] "RemoveContainer" containerID="8929037a1162c6bec3c3641fcd561b5ac5a23c336b067c0204443924bd5fd615" Mar 16 16:56:31 crc kubenswrapper[5120]: I0316 16:56:31.873904 5120 scope.go:117] "RemoveContainer" containerID="2eadc6dbc7f01160dc9a3b9cbe42655a685b5eefde4463cd3ee26fd2426910ed" Mar 16 16:56:31 crc kubenswrapper[5120]: E0316 16:56:31.875839 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2eadc6dbc7f01160dc9a3b9cbe42655a685b5eefde4463cd3ee26fd2426910ed\": container with ID starting with 2eadc6dbc7f01160dc9a3b9cbe42655a685b5eefde4463cd3ee26fd2426910ed not found: ID does not exist" containerID="2eadc6dbc7f01160dc9a3b9cbe42655a685b5eefde4463cd3ee26fd2426910ed" Mar 16 16:56:31 crc kubenswrapper[5120]: I0316 16:56:31.875884 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2eadc6dbc7f01160dc9a3b9cbe42655a685b5eefde4463cd3ee26fd2426910ed"} err="failed to get container status \"2eadc6dbc7f01160dc9a3b9cbe42655a685b5eefde4463cd3ee26fd2426910ed\": rpc error: code = NotFound desc = could not find container \"2eadc6dbc7f01160dc9a3b9cbe42655a685b5eefde4463cd3ee26fd2426910ed\": container with ID starting with 2eadc6dbc7f01160dc9a3b9cbe42655a685b5eefde4463cd3ee26fd2426910ed not found: ID does not exist" Mar 16 16:56:31 crc kubenswrapper[5120]: I0316 16:56:31.875910 5120 scope.go:117] "RemoveContainer" containerID="4743e24a9346c662c8975c8c56816faac6818c53b765b8d123f8527defd5a082" Mar 16 16:56:31 crc kubenswrapper[5120]: E0316 16:56:31.876625 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4743e24a9346c662c8975c8c56816faac6818c53b765b8d123f8527defd5a082\": container with ID starting with 4743e24a9346c662c8975c8c56816faac6818c53b765b8d123f8527defd5a082 not found: ID does not exist" containerID="4743e24a9346c662c8975c8c56816faac6818c53b765b8d123f8527defd5a082" Mar 16 16:56:31 crc kubenswrapper[5120]: I0316 16:56:31.876658 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4743e24a9346c662c8975c8c56816faac6818c53b765b8d123f8527defd5a082"} err="failed to get container status \"4743e24a9346c662c8975c8c56816faac6818c53b765b8d123f8527defd5a082\": rpc error: code = NotFound desc = could not find container \"4743e24a9346c662c8975c8c56816faac6818c53b765b8d123f8527defd5a082\": container with ID starting with 4743e24a9346c662c8975c8c56816faac6818c53b765b8d123f8527defd5a082 not found: ID does not exist" Mar 16 16:56:31 crc kubenswrapper[5120]: I0316 16:56:31.876677 5120 scope.go:117] "RemoveContainer" containerID="8929037a1162c6bec3c3641fcd561b5ac5a23c336b067c0204443924bd5fd615" Mar 16 16:56:31 crc kubenswrapper[5120]: E0316 16:56:31.877242 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8929037a1162c6bec3c3641fcd561b5ac5a23c336b067c0204443924bd5fd615\": container with ID starting with 8929037a1162c6bec3c3641fcd561b5ac5a23c336b067c0204443924bd5fd615 not found: ID does not exist" containerID="8929037a1162c6bec3c3641fcd561b5ac5a23c336b067c0204443924bd5fd615" Mar 16 16:56:31 crc kubenswrapper[5120]: I0316 16:56:31.877267 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8929037a1162c6bec3c3641fcd561b5ac5a23c336b067c0204443924bd5fd615"} err="failed to get container status \"8929037a1162c6bec3c3641fcd561b5ac5a23c336b067c0204443924bd5fd615\": rpc error: code = NotFound desc = could not find container \"8929037a1162c6bec3c3641fcd561b5ac5a23c336b067c0204443924bd5fd615\": container with ID starting with 8929037a1162c6bec3c3641fcd561b5ac5a23c336b067c0204443924bd5fd615 not found: ID does not exist" Mar 16 16:56:32 crc kubenswrapper[5120]: I0316 16:56:32.656834 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"9975f854-d1d5-4fda-9475-8a93c6d69b1f","Type":"ContainerStarted","Data":"c18d7c16ebd97731379d7f465628571d626faf2bbd200863e8b62e422d3333c7"} Mar 16 16:56:32 crc kubenswrapper[5120]: I0316 16:56:32.657162 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"9975f854-d1d5-4fda-9475-8a93c6d69b1f","Type":"ContainerStarted","Data":"bfda90aacf5db90162bb71706999ae75a07616147c96e28eb13699514ec41a14"} Mar 16 16:56:32 crc kubenswrapper[5120]: I0316 16:56:32.662527 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"dc34c11e-3278-4e46-94e1-7cb991fe4591","Type":"ContainerStarted","Data":"f57ddc1df89510055bf60fee4e330d3b0cbae6904f52d3fd95410be509faa91c"} Mar 16 16:56:32 crc kubenswrapper[5120]: I0316 16:56:32.663419 5120 scope.go:117] "RemoveContainer" containerID="083f72646c8d47c9c0467b39be99ddfa9c2e5900ae0a29ad53d7b39b950274b4" Mar 16 16:56:32 crc kubenswrapper[5120]: E0316 16:56:32.663768 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:56:32 crc kubenswrapper[5120]: I0316 16:56:32.706488 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3209b0ef-38f4-4ab3-9594-6f4c18d592ec" path="/var/lib/kubelet/pods/3209b0ef-38f4-4ab3-9594-6f4c18d592ec/volumes" Mar 16 16:56:32 crc kubenswrapper[5120]: I0316 16:56:32.708222 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="519f2986-0498-4f41-b63e-3137e48794e8" path="/var/lib/kubelet/pods/519f2986-0498-4f41-b63e-3137e48794e8/volumes" Mar 16 16:56:32 crc kubenswrapper[5120]: I0316 16:56:32.709034 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"7870ec2c-0344-4cfe-bc6d-4bca0c11ba52","Type":"ContainerStarted","Data":"2b0e138b699773308041579cd1e212fad18c455eefe44c13b906ab063bee536b"} Mar 16 16:56:32 crc kubenswrapper[5120]: I0316 16:56:32.712096 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-external-api-0" podStartSLOduration=4.712070798 podStartE2EDuration="4.712070798s" podCreationTimestamp="2026-03-16 16:56:28 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:56:32.703270197 +0000 UTC m=+5094.857201854" watchObservedRunningTime="2026-03-16 16:56:32.712070798 +0000 UTC m=+5094.866002465" Mar 16 16:56:33 crc kubenswrapper[5120]: I0316 16:56:33.174251 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-zmwzp" Mar 16 16:56:33 crc kubenswrapper[5120]: I0316 16:56:33.181582 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-kc6pl" Mar 16 16:56:33 crc kubenswrapper[5120]: I0316 16:56:33.194706 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-internal-api-0" podStartSLOduration=4.194687727 podStartE2EDuration="4.194687727s" podCreationTimestamp="2026-03-16 16:56:29 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:56:32.729371291 +0000 UTC m=+5094.883302938" watchObservedRunningTime="2026-03-16 16:56:33.194687727 +0000 UTC m=+5095.348619384" Mar 16 16:56:33 crc kubenswrapper[5120]: I0316 16:56:33.315618 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4cb6be6a-67ac-4e35-aacf-d1df8c5c9c11-config-data\") pod \"4cb6be6a-67ac-4e35-aacf-d1df8c5c9c11\" (UID: \"4cb6be6a-67ac-4e35-aacf-d1df8c5c9c11\") " Mar 16 16:56:33 crc kubenswrapper[5120]: I0316 16:56:33.315781 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f38ba03a-736c-4963-9059-d50f52f0bbf5-combined-ca-bundle\") pod \"f38ba03a-736c-4963-9059-d50f52f0bbf5\" (UID: \"f38ba03a-736c-4963-9059-d50f52f0bbf5\") " Mar 16 16:56:33 crc kubenswrapper[5120]: I0316 16:56:33.315850 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4cb6be6a-67ac-4e35-aacf-d1df8c5c9c11-scripts\") pod \"4cb6be6a-67ac-4e35-aacf-d1df8c5c9c11\" (UID: \"4cb6be6a-67ac-4e35-aacf-d1df8c5c9c11\") " Mar 16 16:56:33 crc kubenswrapper[5120]: I0316 16:56:33.315908 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/f38ba03a-736c-4963-9059-d50f52f0bbf5-db-sync-config-data\") pod \"f38ba03a-736c-4963-9059-d50f52f0bbf5\" (UID: \"f38ba03a-736c-4963-9059-d50f52f0bbf5\") " Mar 16 16:56:33 crc kubenswrapper[5120]: I0316 16:56:33.316012 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4cb6be6a-67ac-4e35-aacf-d1df8c5c9c11-combined-ca-bundle\") pod \"4cb6be6a-67ac-4e35-aacf-d1df8c5c9c11\" (UID: \"4cb6be6a-67ac-4e35-aacf-d1df8c5c9c11\") " Mar 16 16:56:33 crc kubenswrapper[5120]: I0316 16:56:33.316062 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/4cb6be6a-67ac-4e35-aacf-d1df8c5c9c11-fernet-keys\") pod \"4cb6be6a-67ac-4e35-aacf-d1df8c5c9c11\" (UID: \"4cb6be6a-67ac-4e35-aacf-d1df8c5c9c11\") " Mar 16 16:56:33 crc kubenswrapper[5120]: I0316 16:56:33.316107 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jv7k9\" (UniqueName: \"kubernetes.io/projected/4cb6be6a-67ac-4e35-aacf-d1df8c5c9c11-kube-api-access-jv7k9\") pod \"4cb6be6a-67ac-4e35-aacf-d1df8c5c9c11\" (UID: \"4cb6be6a-67ac-4e35-aacf-d1df8c5c9c11\") " Mar 16 16:56:33 crc kubenswrapper[5120]: I0316 16:56:33.316137 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ggtzq\" (UniqueName: \"kubernetes.io/projected/f38ba03a-736c-4963-9059-d50f52f0bbf5-kube-api-access-ggtzq\") pod \"f38ba03a-736c-4963-9059-d50f52f0bbf5\" (UID: \"f38ba03a-736c-4963-9059-d50f52f0bbf5\") " Mar 16 16:56:33 crc kubenswrapper[5120]: I0316 16:56:33.316377 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/4cb6be6a-67ac-4e35-aacf-d1df8c5c9c11-credential-keys\") pod \"4cb6be6a-67ac-4e35-aacf-d1df8c5c9c11\" (UID: \"4cb6be6a-67ac-4e35-aacf-d1df8c5c9c11\") " Mar 16 16:56:33 crc kubenswrapper[5120]: I0316 16:56:33.321773 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f38ba03a-736c-4963-9059-d50f52f0bbf5-db-sync-config-data" (OuterVolumeSpecName: "db-sync-config-data") pod "f38ba03a-736c-4963-9059-d50f52f0bbf5" (UID: "f38ba03a-736c-4963-9059-d50f52f0bbf5"). InnerVolumeSpecName "db-sync-config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:56:33 crc kubenswrapper[5120]: I0316 16:56:33.321706 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4cb6be6a-67ac-4e35-aacf-d1df8c5c9c11-scripts" (OuterVolumeSpecName: "scripts") pod "4cb6be6a-67ac-4e35-aacf-d1df8c5c9c11" (UID: "4cb6be6a-67ac-4e35-aacf-d1df8c5c9c11"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:56:33 crc kubenswrapper[5120]: I0316 16:56:33.322039 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4cb6be6a-67ac-4e35-aacf-d1df8c5c9c11-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "4cb6be6a-67ac-4e35-aacf-d1df8c5c9c11" (UID: "4cb6be6a-67ac-4e35-aacf-d1df8c5c9c11"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:56:33 crc kubenswrapper[5120]: I0316 16:56:33.323979 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4cb6be6a-67ac-4e35-aacf-d1df8c5c9c11-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "4cb6be6a-67ac-4e35-aacf-d1df8c5c9c11" (UID: "4cb6be6a-67ac-4e35-aacf-d1df8c5c9c11"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:56:33 crc kubenswrapper[5120]: I0316 16:56:33.325399 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4cb6be6a-67ac-4e35-aacf-d1df8c5c9c11-kube-api-access-jv7k9" (OuterVolumeSpecName: "kube-api-access-jv7k9") pod "4cb6be6a-67ac-4e35-aacf-d1df8c5c9c11" (UID: "4cb6be6a-67ac-4e35-aacf-d1df8c5c9c11"). InnerVolumeSpecName "kube-api-access-jv7k9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:56:33 crc kubenswrapper[5120]: I0316 16:56:33.329425 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f38ba03a-736c-4963-9059-d50f52f0bbf5-kube-api-access-ggtzq" (OuterVolumeSpecName: "kube-api-access-ggtzq") pod "f38ba03a-736c-4963-9059-d50f52f0bbf5" (UID: "f38ba03a-736c-4963-9059-d50f52f0bbf5"). InnerVolumeSpecName "kube-api-access-ggtzq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:56:33 crc kubenswrapper[5120]: I0316 16:56:33.343475 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f38ba03a-736c-4963-9059-d50f52f0bbf5-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f38ba03a-736c-4963-9059-d50f52f0bbf5" (UID: "f38ba03a-736c-4963-9059-d50f52f0bbf5"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:56:33 crc kubenswrapper[5120]: I0316 16:56:33.343598 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4cb6be6a-67ac-4e35-aacf-d1df8c5c9c11-config-data" (OuterVolumeSpecName: "config-data") pod "4cb6be6a-67ac-4e35-aacf-d1df8c5c9c11" (UID: "4cb6be6a-67ac-4e35-aacf-d1df8c5c9c11"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:56:33 crc kubenswrapper[5120]: I0316 16:56:33.351446 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4cb6be6a-67ac-4e35-aacf-d1df8c5c9c11-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "4cb6be6a-67ac-4e35-aacf-d1df8c5c9c11" (UID: "4cb6be6a-67ac-4e35-aacf-d1df8c5c9c11"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:56:33 crc kubenswrapper[5120]: I0316 16:56:33.419467 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jv7k9\" (UniqueName: \"kubernetes.io/projected/4cb6be6a-67ac-4e35-aacf-d1df8c5c9c11-kube-api-access-jv7k9\") on node \"crc\" DevicePath \"\"" Mar 16 16:56:33 crc kubenswrapper[5120]: I0316 16:56:33.419507 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ggtzq\" (UniqueName: \"kubernetes.io/projected/f38ba03a-736c-4963-9059-d50f52f0bbf5-kube-api-access-ggtzq\") on node \"crc\" DevicePath \"\"" Mar 16 16:56:33 crc kubenswrapper[5120]: I0316 16:56:33.419517 5120 reconciler_common.go:299] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/4cb6be6a-67ac-4e35-aacf-d1df8c5c9c11-credential-keys\") on node \"crc\" DevicePath \"\"" Mar 16 16:56:33 crc kubenswrapper[5120]: I0316 16:56:33.419527 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4cb6be6a-67ac-4e35-aacf-d1df8c5c9c11-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:56:33 crc kubenswrapper[5120]: I0316 16:56:33.419536 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f38ba03a-736c-4963-9059-d50f52f0bbf5-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:56:33 crc kubenswrapper[5120]: I0316 16:56:33.419545 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4cb6be6a-67ac-4e35-aacf-d1df8c5c9c11-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:56:33 crc kubenswrapper[5120]: I0316 16:56:33.419554 5120 reconciler_common.go:299] "Volume detached for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/f38ba03a-736c-4963-9059-d50f52f0bbf5-db-sync-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:56:33 crc kubenswrapper[5120]: I0316 16:56:33.419564 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4cb6be6a-67ac-4e35-aacf-d1df8c5c9c11-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:56:33 crc kubenswrapper[5120]: I0316 16:56:33.419572 5120 reconciler_common.go:299] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/4cb6be6a-67ac-4e35-aacf-d1df8c5c9c11-fernet-keys\") on node \"crc\" DevicePath \"\"" Mar 16 16:56:33 crc kubenswrapper[5120]: I0316 16:56:33.664344 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-kc6pl"] Mar 16 16:56:33 crc kubenswrapper[5120]: I0316 16:56:33.679543 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"9975f854-d1d5-4fda-9475-8a93c6d69b1f","Type":"ContainerStarted","Data":"9706cac6e8aa256c76986f00277c2e94be9b5dc3822fe9d8158dc9d2358d75f4"} Mar 16 16:56:33 crc kubenswrapper[5120]: I0316 16:56:33.680225 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-kc6pl"] Mar 16 16:56:33 crc kubenswrapper[5120]: I0316 16:56:33.681568 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-kc6pl" Mar 16 16:56:33 crc kubenswrapper[5120]: I0316 16:56:33.681634 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d4d3f81b4ef99496da18abfc9aa79421efd3a5f54c8893d9b6525a389f882aee" Mar 16 16:56:33 crc kubenswrapper[5120]: I0316 16:56:33.683782 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-zmwzp" event={"ID":"f38ba03a-736c-4963-9059-d50f52f0bbf5","Type":"ContainerDied","Data":"ae7a7ad7d281fddc6e15b59cf9f9c079fd1354ea99ee688f03520ee496fdfcb5"} Mar 16 16:56:33 crc kubenswrapper[5120]: I0316 16:56:33.683832 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ae7a7ad7d281fddc6e15b59cf9f9c079fd1354ea99ee688f03520ee496fdfcb5" Mar 16 16:56:33 crc kubenswrapper[5120]: I0316 16:56:33.683853 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-zmwzp" Mar 16 16:56:33 crc kubenswrapper[5120]: I0316 16:56:33.700284 5120 status_manager.go:895] "Failed to get status for pod" podUID="4cb6be6a-67ac-4e35-aacf-d1df8c5c9c11" pod="openstack-kuttl-tests/keystone-bootstrap-kc6pl" err="pods \"keystone-bootstrap-kc6pl\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 16:56:33 crc kubenswrapper[5120]: I0316 16:56:33.707298 5120 status_manager.go:895] "Failed to get status for pod" podUID="4cb6be6a-67ac-4e35-aacf-d1df8c5c9c11" pod="openstack-kuttl-tests/keystone-bootstrap-kc6pl" err="pods \"keystone-bootstrap-kc6pl\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 16:56:33 crc kubenswrapper[5120]: I0316 16:56:33.761885 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-86x58"] Mar 16 16:56:33 crc kubenswrapper[5120]: I0316 16:56:33.768437 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f38ba03a-736c-4963-9059-d50f52f0bbf5" containerName="barbican-db-sync" Mar 16 16:56:33 crc kubenswrapper[5120]: I0316 16:56:33.768480 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f38ba03a-736c-4963-9059-d50f52f0bbf5" containerName="barbican-db-sync" Mar 16 16:56:33 crc kubenswrapper[5120]: I0316 16:56:33.768508 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4cb6be6a-67ac-4e35-aacf-d1df8c5c9c11" containerName="keystone-bootstrap" Mar 16 16:56:33 crc kubenswrapper[5120]: I0316 16:56:33.768517 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="4cb6be6a-67ac-4e35-aacf-d1df8c5c9c11" containerName="keystone-bootstrap" Mar 16 16:56:33 crc kubenswrapper[5120]: I0316 16:56:33.768548 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3209b0ef-38f4-4ab3-9594-6f4c18d592ec" containerName="extract-utilities" Mar 16 16:56:33 crc kubenswrapper[5120]: I0316 16:56:33.768558 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="3209b0ef-38f4-4ab3-9594-6f4c18d592ec" containerName="extract-utilities" Mar 16 16:56:33 crc kubenswrapper[5120]: I0316 16:56:33.768582 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3209b0ef-38f4-4ab3-9594-6f4c18d592ec" containerName="extract-content" Mar 16 16:56:33 crc kubenswrapper[5120]: I0316 16:56:33.768589 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="3209b0ef-38f4-4ab3-9594-6f4c18d592ec" containerName="extract-content" Mar 16 16:56:33 crc kubenswrapper[5120]: I0316 16:56:33.768610 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3209b0ef-38f4-4ab3-9594-6f4c18d592ec" containerName="registry-server" Mar 16 16:56:33 crc kubenswrapper[5120]: I0316 16:56:33.768617 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="3209b0ef-38f4-4ab3-9594-6f4c18d592ec" containerName="registry-server" Mar 16 16:56:33 crc kubenswrapper[5120]: I0316 16:56:33.768849 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f38ba03a-736c-4963-9059-d50f52f0bbf5" containerName="barbican-db-sync" Mar 16 16:56:33 crc kubenswrapper[5120]: I0316 16:56:33.768869 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="4cb6be6a-67ac-4e35-aacf-d1df8c5c9c11" containerName="keystone-bootstrap" Mar 16 16:56:33 crc kubenswrapper[5120]: I0316 16:56:33.768880 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="3209b0ef-38f4-4ab3-9594-6f4c18d592ec" containerName="registry-server" Mar 16 16:56:33 crc kubenswrapper[5120]: I0316 16:56:33.773697 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-86x58" Mar 16 16:56:33 crc kubenswrapper[5120]: I0316 16:56:33.776690 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-config-data\"" Mar 16 16:56:33 crc kubenswrapper[5120]: I0316 16:56:33.777009 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-keystone-dockercfg-5mpsq\"" Mar 16 16:56:33 crc kubenswrapper[5120]: I0316 16:56:33.777199 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-scripts\"" Mar 16 16:56:33 crc kubenswrapper[5120]: I0316 16:56:33.777989 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"osp-secret\"" Mar 16 16:56:33 crc kubenswrapper[5120]: I0316 16:56:33.779129 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-86x58"] Mar 16 16:56:33 crc kubenswrapper[5120]: I0316 16:56:33.781704 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone\"" Mar 16 16:56:33 crc kubenswrapper[5120]: I0316 16:56:33.846039 5120 status_manager.go:895] "Failed to get status for pod" podUID="4cb6be6a-67ac-4e35-aacf-d1df8c5c9c11" pod="openstack-kuttl-tests/keystone-bootstrap-kc6pl" err="pods \"keystone-bootstrap-kc6pl\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 16:56:33 crc kubenswrapper[5120]: I0316 16:56:33.911003 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-78774f5dfb-bzqjl"] Mar 16 16:56:33 crc kubenswrapper[5120]: I0316 16:56:33.920413 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-78774f5dfb-bzqjl" Mar 16 16:56:33 crc kubenswrapper[5120]: I0316 16:56:33.931778 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-keystone-listener-config-data\"" Mar 16 16:56:33 crc kubenswrapper[5120]: I0316 16:56:33.931839 5120 status_manager.go:895] "Failed to get status for pod" podUID="4cb6be6a-67ac-4e35-aacf-d1df8c5c9c11" pod="openstack-kuttl-tests/keystone-bootstrap-kc6pl" err="pods \"keystone-bootstrap-kc6pl\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 16:56:33 crc kubenswrapper[5120]: I0316 16:56:33.931912 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-barbican-dockercfg-72rxd\"" Mar 16 16:56:33 crc kubenswrapper[5120]: I0316 16:56:33.932367 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-78774f5dfb-bzqjl"] Mar 16 16:56:33 crc kubenswrapper[5120]: I0316 16:56:33.932417 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-config-data\"" Mar 16 16:56:33 crc kubenswrapper[5120]: I0316 16:56:33.944833 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/28a7df09-48d2-4fae-ad59-a333d87354fd-config-data\") pod \"keystone-bootstrap-86x58\" (UID: \"28a7df09-48d2-4fae-ad59-a333d87354fd\") " pod="openstack-kuttl-tests/keystone-bootstrap-86x58" Mar 16 16:56:33 crc kubenswrapper[5120]: I0316 16:56:33.944888 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/28a7df09-48d2-4fae-ad59-a333d87354fd-combined-ca-bundle\") pod \"keystone-bootstrap-86x58\" (UID: \"28a7df09-48d2-4fae-ad59-a333d87354fd\") " pod="openstack-kuttl-tests/keystone-bootstrap-86x58" Mar 16 16:56:33 crc kubenswrapper[5120]: I0316 16:56:33.945002 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6t8v\" (UniqueName: \"kubernetes.io/projected/28a7df09-48d2-4fae-ad59-a333d87354fd-kube-api-access-z6t8v\") pod \"keystone-bootstrap-86x58\" (UID: \"28a7df09-48d2-4fae-ad59-a333d87354fd\") " pod="openstack-kuttl-tests/keystone-bootstrap-86x58" Mar 16 16:56:33 crc kubenswrapper[5120]: I0316 16:56:33.945070 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/28a7df09-48d2-4fae-ad59-a333d87354fd-fernet-keys\") pod \"keystone-bootstrap-86x58\" (UID: \"28a7df09-48d2-4fae-ad59-a333d87354fd\") " pod="openstack-kuttl-tests/keystone-bootstrap-86x58" Mar 16 16:56:33 crc kubenswrapper[5120]: I0316 16:56:33.945152 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/28a7df09-48d2-4fae-ad59-a333d87354fd-scripts\") pod \"keystone-bootstrap-86x58\" (UID: \"28a7df09-48d2-4fae-ad59-a333d87354fd\") " pod="openstack-kuttl-tests/keystone-bootstrap-86x58" Mar 16 16:56:33 crc kubenswrapper[5120]: I0316 16:56:33.945411 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/28a7df09-48d2-4fae-ad59-a333d87354fd-credential-keys\") pod \"keystone-bootstrap-86x58\" (UID: \"28a7df09-48d2-4fae-ad59-a333d87354fd\") " pod="openstack-kuttl-tests/keystone-bootstrap-86x58" Mar 16 16:56:33 crc kubenswrapper[5120]: I0316 16:56:33.962845 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-worker-6fc74764d9-qrphb"] Mar 16 16:56:33 crc kubenswrapper[5120]: I0316 16:56:33.982979 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-6fc74764d9-qrphb"] Mar 16 16:56:33 crc kubenswrapper[5120]: I0316 16:56:33.983155 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-6fc74764d9-qrphb" Mar 16 16:56:33 crc kubenswrapper[5120]: I0316 16:56:33.990093 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-worker-config-data\"" Mar 16 16:56:34 crc kubenswrapper[5120]: I0316 16:56:34.022293 5120 status_manager.go:895] "Failed to get status for pod" podUID="4cb6be6a-67ac-4e35-aacf-d1df8c5c9c11" pod="openstack-kuttl-tests/keystone-bootstrap-kc6pl" err="pods \"keystone-bootstrap-kc6pl\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 16:56:34 crc kubenswrapper[5120]: I0316 16:56:34.025242 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-api-6fc7988ff4-wrbrq"] Mar 16 16:56:34 crc kubenswrapper[5120]: I0316 16:56:34.035585 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-6fc7988ff4-wrbrq" Mar 16 16:56:34 crc kubenswrapper[5120]: I0316 16:56:34.038354 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-api-config-data\"" Mar 16 16:56:34 crc kubenswrapper[5120]: I0316 16:56:34.038571 5120 status_manager.go:895] "Failed to get status for pod" podUID="4cb6be6a-67ac-4e35-aacf-d1df8c5c9c11" pod="openstack-kuttl-tests/keystone-bootstrap-kc6pl" err="pods \"keystone-bootstrap-kc6pl\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 16:56:34 crc kubenswrapper[5120]: I0316 16:56:34.047928 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/28a7df09-48d2-4fae-ad59-a333d87354fd-credential-keys\") pod \"keystone-bootstrap-86x58\" (UID: \"28a7df09-48d2-4fae-ad59-a333d87354fd\") " pod="openstack-kuttl-tests/keystone-bootstrap-86x58" Mar 16 16:56:34 crc kubenswrapper[5120]: I0316 16:56:34.047998 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5cd891e1-77ba-42cb-ad3f-6d37f1782101-combined-ca-bundle\") pod \"barbican-keystone-listener-78774f5dfb-bzqjl\" (UID: \"5cd891e1-77ba-42cb-ad3f-6d37f1782101\") " pod="openstack-kuttl-tests/barbican-keystone-listener-78774f5dfb-bzqjl" Mar 16 16:56:34 crc kubenswrapper[5120]: I0316 16:56:34.048044 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5cd891e1-77ba-42cb-ad3f-6d37f1782101-logs\") pod \"barbican-keystone-listener-78774f5dfb-bzqjl\" (UID: \"5cd891e1-77ba-42cb-ad3f-6d37f1782101\") " pod="openstack-kuttl-tests/barbican-keystone-listener-78774f5dfb-bzqjl" Mar 16 16:56:34 crc kubenswrapper[5120]: I0316 16:56:34.048115 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/5cd891e1-77ba-42cb-ad3f-6d37f1782101-config-data-custom\") pod \"barbican-keystone-listener-78774f5dfb-bzqjl\" (UID: \"5cd891e1-77ba-42cb-ad3f-6d37f1782101\") " pod="openstack-kuttl-tests/barbican-keystone-listener-78774f5dfb-bzqjl" Mar 16 16:56:34 crc kubenswrapper[5120]: I0316 16:56:34.048235 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/28a7df09-48d2-4fae-ad59-a333d87354fd-config-data\") pod \"keystone-bootstrap-86x58\" (UID: \"28a7df09-48d2-4fae-ad59-a333d87354fd\") " pod="openstack-kuttl-tests/keystone-bootstrap-86x58" Mar 16 16:56:34 crc kubenswrapper[5120]: I0316 16:56:34.048268 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/28a7df09-48d2-4fae-ad59-a333d87354fd-combined-ca-bundle\") pod \"keystone-bootstrap-86x58\" (UID: \"28a7df09-48d2-4fae-ad59-a333d87354fd\") " pod="openstack-kuttl-tests/keystone-bootstrap-86x58" Mar 16 16:56:34 crc kubenswrapper[5120]: I0316 16:56:34.048478 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5cd891e1-77ba-42cb-ad3f-6d37f1782101-config-data\") pod \"barbican-keystone-listener-78774f5dfb-bzqjl\" (UID: \"5cd891e1-77ba-42cb-ad3f-6d37f1782101\") " pod="openstack-kuttl-tests/barbican-keystone-listener-78774f5dfb-bzqjl" Mar 16 16:56:34 crc kubenswrapper[5120]: I0316 16:56:34.048636 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z6t8v\" (UniqueName: \"kubernetes.io/projected/28a7df09-48d2-4fae-ad59-a333d87354fd-kube-api-access-z6t8v\") pod \"keystone-bootstrap-86x58\" (UID: \"28a7df09-48d2-4fae-ad59-a333d87354fd\") " pod="openstack-kuttl-tests/keystone-bootstrap-86x58" Mar 16 16:56:34 crc kubenswrapper[5120]: I0316 16:56:34.048738 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/28a7df09-48d2-4fae-ad59-a333d87354fd-fernet-keys\") pod \"keystone-bootstrap-86x58\" (UID: \"28a7df09-48d2-4fae-ad59-a333d87354fd\") " pod="openstack-kuttl-tests/keystone-bootstrap-86x58" Mar 16 16:56:34 crc kubenswrapper[5120]: I0316 16:56:34.048828 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4q86\" (UniqueName: \"kubernetes.io/projected/5cd891e1-77ba-42cb-ad3f-6d37f1782101-kube-api-access-r4q86\") pod \"barbican-keystone-listener-78774f5dfb-bzqjl\" (UID: \"5cd891e1-77ba-42cb-ad3f-6d37f1782101\") " pod="openstack-kuttl-tests/barbican-keystone-listener-78774f5dfb-bzqjl" Mar 16 16:56:34 crc kubenswrapper[5120]: I0316 16:56:34.048858 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/28a7df09-48d2-4fae-ad59-a333d87354fd-scripts\") pod \"keystone-bootstrap-86x58\" (UID: \"28a7df09-48d2-4fae-ad59-a333d87354fd\") " pod="openstack-kuttl-tests/keystone-bootstrap-86x58" Mar 16 16:56:34 crc kubenswrapper[5120]: I0316 16:56:34.054471 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/28a7df09-48d2-4fae-ad59-a333d87354fd-config-data\") pod \"keystone-bootstrap-86x58\" (UID: \"28a7df09-48d2-4fae-ad59-a333d87354fd\") " pod="openstack-kuttl-tests/keystone-bootstrap-86x58" Mar 16 16:56:34 crc kubenswrapper[5120]: I0316 16:56:34.056419 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/28a7df09-48d2-4fae-ad59-a333d87354fd-scripts\") pod \"keystone-bootstrap-86x58\" (UID: \"28a7df09-48d2-4fae-ad59-a333d87354fd\") " pod="openstack-kuttl-tests/keystone-bootstrap-86x58" Mar 16 16:56:34 crc kubenswrapper[5120]: I0316 16:56:34.061689 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/28a7df09-48d2-4fae-ad59-a333d87354fd-fernet-keys\") pod \"keystone-bootstrap-86x58\" (UID: \"28a7df09-48d2-4fae-ad59-a333d87354fd\") " pod="openstack-kuttl-tests/keystone-bootstrap-86x58" Mar 16 16:56:34 crc kubenswrapper[5120]: I0316 16:56:34.061689 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/28a7df09-48d2-4fae-ad59-a333d87354fd-credential-keys\") pod \"keystone-bootstrap-86x58\" (UID: \"28a7df09-48d2-4fae-ad59-a333d87354fd\") " pod="openstack-kuttl-tests/keystone-bootstrap-86x58" Mar 16 16:56:34 crc kubenswrapper[5120]: I0316 16:56:34.062228 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/28a7df09-48d2-4fae-ad59-a333d87354fd-combined-ca-bundle\") pod \"keystone-bootstrap-86x58\" (UID: \"28a7df09-48d2-4fae-ad59-a333d87354fd\") " pod="openstack-kuttl-tests/keystone-bootstrap-86x58" Mar 16 16:56:34 crc kubenswrapper[5120]: I0316 16:56:34.081619 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6t8v\" (UniqueName: \"kubernetes.io/projected/28a7df09-48d2-4fae-ad59-a333d87354fd-kube-api-access-z6t8v\") pod \"keystone-bootstrap-86x58\" (UID: \"28a7df09-48d2-4fae-ad59-a333d87354fd\") " pod="openstack-kuttl-tests/keystone-bootstrap-86x58" Mar 16 16:56:34 crc kubenswrapper[5120]: I0316 16:56:34.090959 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-6fc7988ff4-wrbrq"] Mar 16 16:56:34 crc kubenswrapper[5120]: I0316 16:56:34.120952 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-86x58" Mar 16 16:56:34 crc kubenswrapper[5120]: I0316 16:56:34.153273 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5cd891e1-77ba-42cb-ad3f-6d37f1782101-config-data\") pod \"barbican-keystone-listener-78774f5dfb-bzqjl\" (UID: \"5cd891e1-77ba-42cb-ad3f-6d37f1782101\") " pod="openstack-kuttl-tests/barbican-keystone-listener-78774f5dfb-bzqjl" Mar 16 16:56:34 crc kubenswrapper[5120]: I0316 16:56:34.153386 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4691e9c1-c324-494d-98da-d1436447f6ac-logs\") pod \"barbican-api-6fc7988ff4-wrbrq\" (UID: \"4691e9c1-c324-494d-98da-d1436447f6ac\") " pod="openstack-kuttl-tests/barbican-api-6fc7988ff4-wrbrq" Mar 16 16:56:34 crc kubenswrapper[5120]: I0316 16:56:34.153493 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r4q86\" (UniqueName: \"kubernetes.io/projected/5cd891e1-77ba-42cb-ad3f-6d37f1782101-kube-api-access-r4q86\") pod \"barbican-keystone-listener-78774f5dfb-bzqjl\" (UID: \"5cd891e1-77ba-42cb-ad3f-6d37f1782101\") " pod="openstack-kuttl-tests/barbican-keystone-listener-78774f5dfb-bzqjl" Mar 16 16:56:34 crc kubenswrapper[5120]: I0316 16:56:34.153579 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmrmt\" (UniqueName: \"kubernetes.io/projected/e23fbd51-1180-4d93-9937-9c89abacf10b-kube-api-access-cmrmt\") pod \"barbican-worker-6fc74764d9-qrphb\" (UID: \"e23fbd51-1180-4d93-9937-9c89abacf10b\") " pod="openstack-kuttl-tests/barbican-worker-6fc74764d9-qrphb" Mar 16 16:56:34 crc kubenswrapper[5120]: I0316 16:56:34.153661 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frx4f\" (UniqueName: \"kubernetes.io/projected/4691e9c1-c324-494d-98da-d1436447f6ac-kube-api-access-frx4f\") pod \"barbican-api-6fc7988ff4-wrbrq\" (UID: \"4691e9c1-c324-494d-98da-d1436447f6ac\") " pod="openstack-kuttl-tests/barbican-api-6fc7988ff4-wrbrq" Mar 16 16:56:34 crc kubenswrapper[5120]: I0316 16:56:34.153695 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4691e9c1-c324-494d-98da-d1436447f6ac-config-data\") pod \"barbican-api-6fc7988ff4-wrbrq\" (UID: \"4691e9c1-c324-494d-98da-d1436447f6ac\") " pod="openstack-kuttl-tests/barbican-api-6fc7988ff4-wrbrq" Mar 16 16:56:34 crc kubenswrapper[5120]: I0316 16:56:34.153735 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e23fbd51-1180-4d93-9937-9c89abacf10b-combined-ca-bundle\") pod \"barbican-worker-6fc74764d9-qrphb\" (UID: \"e23fbd51-1180-4d93-9937-9c89abacf10b\") " pod="openstack-kuttl-tests/barbican-worker-6fc74764d9-qrphb" Mar 16 16:56:34 crc kubenswrapper[5120]: I0316 16:56:34.153835 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/e23fbd51-1180-4d93-9937-9c89abacf10b-config-data-custom\") pod \"barbican-worker-6fc74764d9-qrphb\" (UID: \"e23fbd51-1180-4d93-9937-9c89abacf10b\") " pod="openstack-kuttl-tests/barbican-worker-6fc74764d9-qrphb" Mar 16 16:56:34 crc kubenswrapper[5120]: I0316 16:56:34.154027 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5cd891e1-77ba-42cb-ad3f-6d37f1782101-combined-ca-bundle\") pod \"barbican-keystone-listener-78774f5dfb-bzqjl\" (UID: \"5cd891e1-77ba-42cb-ad3f-6d37f1782101\") " pod="openstack-kuttl-tests/barbican-keystone-listener-78774f5dfb-bzqjl" Mar 16 16:56:34 crc kubenswrapper[5120]: I0316 16:56:34.154069 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e23fbd51-1180-4d93-9937-9c89abacf10b-logs\") pod \"barbican-worker-6fc74764d9-qrphb\" (UID: \"e23fbd51-1180-4d93-9937-9c89abacf10b\") " pod="openstack-kuttl-tests/barbican-worker-6fc74764d9-qrphb" Mar 16 16:56:34 crc kubenswrapper[5120]: I0316 16:56:34.154099 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5cd891e1-77ba-42cb-ad3f-6d37f1782101-logs\") pod \"barbican-keystone-listener-78774f5dfb-bzqjl\" (UID: \"5cd891e1-77ba-42cb-ad3f-6d37f1782101\") " pod="openstack-kuttl-tests/barbican-keystone-listener-78774f5dfb-bzqjl" Mar 16 16:56:34 crc kubenswrapper[5120]: I0316 16:56:34.154114 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e23fbd51-1180-4d93-9937-9c89abacf10b-config-data\") pod \"barbican-worker-6fc74764d9-qrphb\" (UID: \"e23fbd51-1180-4d93-9937-9c89abacf10b\") " pod="openstack-kuttl-tests/barbican-worker-6fc74764d9-qrphb" Mar 16 16:56:34 crc kubenswrapper[5120]: I0316 16:56:34.154147 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/5cd891e1-77ba-42cb-ad3f-6d37f1782101-config-data-custom\") pod \"barbican-keystone-listener-78774f5dfb-bzqjl\" (UID: \"5cd891e1-77ba-42cb-ad3f-6d37f1782101\") " pod="openstack-kuttl-tests/barbican-keystone-listener-78774f5dfb-bzqjl" Mar 16 16:56:34 crc kubenswrapper[5120]: I0316 16:56:34.154189 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4691e9c1-c324-494d-98da-d1436447f6ac-combined-ca-bundle\") pod \"barbican-api-6fc7988ff4-wrbrq\" (UID: \"4691e9c1-c324-494d-98da-d1436447f6ac\") " pod="openstack-kuttl-tests/barbican-api-6fc7988ff4-wrbrq" Mar 16 16:56:34 crc kubenswrapper[5120]: I0316 16:56:34.154258 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/4691e9c1-c324-494d-98da-d1436447f6ac-config-data-custom\") pod \"barbican-api-6fc7988ff4-wrbrq\" (UID: \"4691e9c1-c324-494d-98da-d1436447f6ac\") " pod="openstack-kuttl-tests/barbican-api-6fc7988ff4-wrbrq" Mar 16 16:56:34 crc kubenswrapper[5120]: I0316 16:56:34.157694 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/5cd891e1-77ba-42cb-ad3f-6d37f1782101-config-data-custom\") pod \"barbican-keystone-listener-78774f5dfb-bzqjl\" (UID: \"5cd891e1-77ba-42cb-ad3f-6d37f1782101\") " pod="openstack-kuttl-tests/barbican-keystone-listener-78774f5dfb-bzqjl" Mar 16 16:56:34 crc kubenswrapper[5120]: I0316 16:56:34.159415 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5cd891e1-77ba-42cb-ad3f-6d37f1782101-config-data\") pod \"barbican-keystone-listener-78774f5dfb-bzqjl\" (UID: \"5cd891e1-77ba-42cb-ad3f-6d37f1782101\") " pod="openstack-kuttl-tests/barbican-keystone-listener-78774f5dfb-bzqjl" Mar 16 16:56:34 crc kubenswrapper[5120]: I0316 16:56:34.159488 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5cd891e1-77ba-42cb-ad3f-6d37f1782101-combined-ca-bundle\") pod \"barbican-keystone-listener-78774f5dfb-bzqjl\" (UID: \"5cd891e1-77ba-42cb-ad3f-6d37f1782101\") " pod="openstack-kuttl-tests/barbican-keystone-listener-78774f5dfb-bzqjl" Mar 16 16:56:34 crc kubenswrapper[5120]: I0316 16:56:34.159840 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5cd891e1-77ba-42cb-ad3f-6d37f1782101-logs\") pod \"barbican-keystone-listener-78774f5dfb-bzqjl\" (UID: \"5cd891e1-77ba-42cb-ad3f-6d37f1782101\") " pod="openstack-kuttl-tests/barbican-keystone-listener-78774f5dfb-bzqjl" Mar 16 16:56:34 crc kubenswrapper[5120]: I0316 16:56:34.179430 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4q86\" (UniqueName: \"kubernetes.io/projected/5cd891e1-77ba-42cb-ad3f-6d37f1782101-kube-api-access-r4q86\") pod \"barbican-keystone-listener-78774f5dfb-bzqjl\" (UID: \"5cd891e1-77ba-42cb-ad3f-6d37f1782101\") " pod="openstack-kuttl-tests/barbican-keystone-listener-78774f5dfb-bzqjl" Mar 16 16:56:34 crc kubenswrapper[5120]: I0316 16:56:34.243848 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-78774f5dfb-bzqjl" Mar 16 16:56:34 crc kubenswrapper[5120]: I0316 16:56:34.257996 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cmrmt\" (UniqueName: \"kubernetes.io/projected/e23fbd51-1180-4d93-9937-9c89abacf10b-kube-api-access-cmrmt\") pod \"barbican-worker-6fc74764d9-qrphb\" (UID: \"e23fbd51-1180-4d93-9937-9c89abacf10b\") " pod="openstack-kuttl-tests/barbican-worker-6fc74764d9-qrphb" Mar 16 16:56:34 crc kubenswrapper[5120]: I0316 16:56:34.258088 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-frx4f\" (UniqueName: \"kubernetes.io/projected/4691e9c1-c324-494d-98da-d1436447f6ac-kube-api-access-frx4f\") pod \"barbican-api-6fc7988ff4-wrbrq\" (UID: \"4691e9c1-c324-494d-98da-d1436447f6ac\") " pod="openstack-kuttl-tests/barbican-api-6fc7988ff4-wrbrq" Mar 16 16:56:34 crc kubenswrapper[5120]: I0316 16:56:34.258138 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4691e9c1-c324-494d-98da-d1436447f6ac-config-data\") pod \"barbican-api-6fc7988ff4-wrbrq\" (UID: \"4691e9c1-c324-494d-98da-d1436447f6ac\") " pod="openstack-kuttl-tests/barbican-api-6fc7988ff4-wrbrq" Mar 16 16:56:34 crc kubenswrapper[5120]: I0316 16:56:34.258186 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e23fbd51-1180-4d93-9937-9c89abacf10b-combined-ca-bundle\") pod \"barbican-worker-6fc74764d9-qrphb\" (UID: \"e23fbd51-1180-4d93-9937-9c89abacf10b\") " pod="openstack-kuttl-tests/barbican-worker-6fc74764d9-qrphb" Mar 16 16:56:34 crc kubenswrapper[5120]: I0316 16:56:34.258235 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/e23fbd51-1180-4d93-9937-9c89abacf10b-config-data-custom\") pod \"barbican-worker-6fc74764d9-qrphb\" (UID: \"e23fbd51-1180-4d93-9937-9c89abacf10b\") " pod="openstack-kuttl-tests/barbican-worker-6fc74764d9-qrphb" Mar 16 16:56:34 crc kubenswrapper[5120]: I0316 16:56:34.258330 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e23fbd51-1180-4d93-9937-9c89abacf10b-logs\") pod \"barbican-worker-6fc74764d9-qrphb\" (UID: \"e23fbd51-1180-4d93-9937-9c89abacf10b\") " pod="openstack-kuttl-tests/barbican-worker-6fc74764d9-qrphb" Mar 16 16:56:34 crc kubenswrapper[5120]: I0316 16:56:34.258363 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e23fbd51-1180-4d93-9937-9c89abacf10b-config-data\") pod \"barbican-worker-6fc74764d9-qrphb\" (UID: \"e23fbd51-1180-4d93-9937-9c89abacf10b\") " pod="openstack-kuttl-tests/barbican-worker-6fc74764d9-qrphb" Mar 16 16:56:34 crc kubenswrapper[5120]: I0316 16:56:34.258412 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4691e9c1-c324-494d-98da-d1436447f6ac-combined-ca-bundle\") pod \"barbican-api-6fc7988ff4-wrbrq\" (UID: \"4691e9c1-c324-494d-98da-d1436447f6ac\") " pod="openstack-kuttl-tests/barbican-api-6fc7988ff4-wrbrq" Mar 16 16:56:34 crc kubenswrapper[5120]: I0316 16:56:34.258470 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/4691e9c1-c324-494d-98da-d1436447f6ac-config-data-custom\") pod \"barbican-api-6fc7988ff4-wrbrq\" (UID: \"4691e9c1-c324-494d-98da-d1436447f6ac\") " pod="openstack-kuttl-tests/barbican-api-6fc7988ff4-wrbrq" Mar 16 16:56:34 crc kubenswrapper[5120]: I0316 16:56:34.258593 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4691e9c1-c324-494d-98da-d1436447f6ac-logs\") pod \"barbican-api-6fc7988ff4-wrbrq\" (UID: \"4691e9c1-c324-494d-98da-d1436447f6ac\") " pod="openstack-kuttl-tests/barbican-api-6fc7988ff4-wrbrq" Mar 16 16:56:34 crc kubenswrapper[5120]: I0316 16:56:34.259848 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4691e9c1-c324-494d-98da-d1436447f6ac-logs\") pod \"barbican-api-6fc7988ff4-wrbrq\" (UID: \"4691e9c1-c324-494d-98da-d1436447f6ac\") " pod="openstack-kuttl-tests/barbican-api-6fc7988ff4-wrbrq" Mar 16 16:56:34 crc kubenswrapper[5120]: I0316 16:56:34.261184 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e23fbd51-1180-4d93-9937-9c89abacf10b-logs\") pod \"barbican-worker-6fc74764d9-qrphb\" (UID: \"e23fbd51-1180-4d93-9937-9c89abacf10b\") " pod="openstack-kuttl-tests/barbican-worker-6fc74764d9-qrphb" Mar 16 16:56:34 crc kubenswrapper[5120]: I0316 16:56:34.270351 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e23fbd51-1180-4d93-9937-9c89abacf10b-combined-ca-bundle\") pod \"barbican-worker-6fc74764d9-qrphb\" (UID: \"e23fbd51-1180-4d93-9937-9c89abacf10b\") " pod="openstack-kuttl-tests/barbican-worker-6fc74764d9-qrphb" Mar 16 16:56:34 crc kubenswrapper[5120]: I0316 16:56:34.270860 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e23fbd51-1180-4d93-9937-9c89abacf10b-config-data\") pod \"barbican-worker-6fc74764d9-qrphb\" (UID: \"e23fbd51-1180-4d93-9937-9c89abacf10b\") " pod="openstack-kuttl-tests/barbican-worker-6fc74764d9-qrphb" Mar 16 16:56:34 crc kubenswrapper[5120]: I0316 16:56:34.272155 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/e23fbd51-1180-4d93-9937-9c89abacf10b-config-data-custom\") pod \"barbican-worker-6fc74764d9-qrphb\" (UID: \"e23fbd51-1180-4d93-9937-9c89abacf10b\") " pod="openstack-kuttl-tests/barbican-worker-6fc74764d9-qrphb" Mar 16 16:56:34 crc kubenswrapper[5120]: I0316 16:56:34.272859 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4691e9c1-c324-494d-98da-d1436447f6ac-config-data\") pod \"barbican-api-6fc7988ff4-wrbrq\" (UID: \"4691e9c1-c324-494d-98da-d1436447f6ac\") " pod="openstack-kuttl-tests/barbican-api-6fc7988ff4-wrbrq" Mar 16 16:56:34 crc kubenswrapper[5120]: I0316 16:56:34.275328 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/4691e9c1-c324-494d-98da-d1436447f6ac-config-data-custom\") pod \"barbican-api-6fc7988ff4-wrbrq\" (UID: \"4691e9c1-c324-494d-98da-d1436447f6ac\") " pod="openstack-kuttl-tests/barbican-api-6fc7988ff4-wrbrq" Mar 16 16:56:34 crc kubenswrapper[5120]: I0316 16:56:34.275654 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4691e9c1-c324-494d-98da-d1436447f6ac-combined-ca-bundle\") pod \"barbican-api-6fc7988ff4-wrbrq\" (UID: \"4691e9c1-c324-494d-98da-d1436447f6ac\") " pod="openstack-kuttl-tests/barbican-api-6fc7988ff4-wrbrq" Mar 16 16:56:34 crc kubenswrapper[5120]: I0316 16:56:34.283189 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-frx4f\" (UniqueName: \"kubernetes.io/projected/4691e9c1-c324-494d-98da-d1436447f6ac-kube-api-access-frx4f\") pod \"barbican-api-6fc7988ff4-wrbrq\" (UID: \"4691e9c1-c324-494d-98da-d1436447f6ac\") " pod="openstack-kuttl-tests/barbican-api-6fc7988ff4-wrbrq" Mar 16 16:56:34 crc kubenswrapper[5120]: I0316 16:56:34.288585 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmrmt\" (UniqueName: \"kubernetes.io/projected/e23fbd51-1180-4d93-9937-9c89abacf10b-kube-api-access-cmrmt\") pod \"barbican-worker-6fc74764d9-qrphb\" (UID: \"e23fbd51-1180-4d93-9937-9c89abacf10b\") " pod="openstack-kuttl-tests/barbican-worker-6fc74764d9-qrphb" Mar 16 16:56:34 crc kubenswrapper[5120]: I0316 16:56:34.378542 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-6fc74764d9-qrphb" Mar 16 16:56:34 crc kubenswrapper[5120]: I0316 16:56:34.423624 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-6fc7988ff4-wrbrq" Mar 16 16:56:34 crc kubenswrapper[5120]: I0316 16:56:34.634065 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-86x58"] Mar 16 16:56:34 crc kubenswrapper[5120]: W0316 16:56:34.642712 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod28a7df09_48d2_4fae_ad59_a333d87354fd.slice/crio-0d795728ab3b0726a980e4b258b09ec848ac215905eb35fd542d2552ec9b7b2f WatchSource:0}: Error finding container 0d795728ab3b0726a980e4b258b09ec848ac215905eb35fd542d2552ec9b7b2f: Status 404 returned error can't find the container with id 0d795728ab3b0726a980e4b258b09ec848ac215905eb35fd542d2552ec9b7b2f Mar 16 16:56:34 crc kubenswrapper[5120]: I0316 16:56:34.690775 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4cb6be6a-67ac-4e35-aacf-d1df8c5c9c11" path="/var/lib/kubelet/pods/4cb6be6a-67ac-4e35-aacf-d1df8c5c9c11/volumes" Mar 16 16:56:34 crc kubenswrapper[5120]: I0316 16:56:34.707800 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-86x58" event={"ID":"28a7df09-48d2-4fae-ad59-a333d87354fd","Type":"ContainerStarted","Data":"0d795728ab3b0726a980e4b258b09ec848ac215905eb35fd542d2552ec9b7b2f"} Mar 16 16:56:34 crc kubenswrapper[5120]: I0316 16:56:34.729432 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"9975f854-d1d5-4fda-9475-8a93c6d69b1f","Type":"ContainerStarted","Data":"860c91e4e126c0b6559f31e25eeb54807d237cb30ce7327a0658498a6c862fbd"} Mar 16 16:56:34 crc kubenswrapper[5120]: I0316 16:56:34.821463 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-78774f5dfb-bzqjl"] Mar 16 16:56:34 crc kubenswrapper[5120]: I0316 16:56:34.987300 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-6fc74764d9-qrphb"] Mar 16 16:56:34 crc kubenswrapper[5120]: W0316 16:56:34.992461 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode23fbd51_1180_4d93_9937_9c89abacf10b.slice/crio-56a9182c06c229cd9499ea36a4018d2ce0291a2a255ced66964d650136faddcb WatchSource:0}: Error finding container 56a9182c06c229cd9499ea36a4018d2ce0291a2a255ced66964d650136faddcb: Status 404 returned error can't find the container with id 56a9182c06c229cd9499ea36a4018d2ce0291a2a255ced66964d650136faddcb Mar 16 16:56:35 crc kubenswrapper[5120]: W0316 16:56:35.114637 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4691e9c1_c324_494d_98da_d1436447f6ac.slice/crio-691d76de507030735d50edea35f943d16ac768a831104a855ecddd4e31a26ab2 WatchSource:0}: Error finding container 691d76de507030735d50edea35f943d16ac768a831104a855ecddd4e31a26ab2: Status 404 returned error can't find the container with id 691d76de507030735d50edea35f943d16ac768a831104a855ecddd4e31a26ab2 Mar 16 16:56:35 crc kubenswrapper[5120]: I0316 16:56:35.118902 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-6fc7988ff4-wrbrq"] Mar 16 16:56:35 crc kubenswrapper[5120]: I0316 16:56:35.785843 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-78774f5dfb-bzqjl" event={"ID":"5cd891e1-77ba-42cb-ad3f-6d37f1782101","Type":"ContainerStarted","Data":"1c0532af6887b54949e7a3d1f4b7df5559fe73378c2e57f4d96e8714c36b3ce5"} Mar 16 16:56:35 crc kubenswrapper[5120]: I0316 16:56:35.786103 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-78774f5dfb-bzqjl" event={"ID":"5cd891e1-77ba-42cb-ad3f-6d37f1782101","Type":"ContainerStarted","Data":"09cfdb14369a3d8b0e09908d23e65e9b0ccb85b37183e947137f6faf3cca1ab8"} Mar 16 16:56:35 crc kubenswrapper[5120]: I0316 16:56:35.786125 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-78774f5dfb-bzqjl" event={"ID":"5cd891e1-77ba-42cb-ad3f-6d37f1782101","Type":"ContainerStarted","Data":"69edfb33b8753bce94b35b5807c22e2a457d4eaafc697d7a5b79c696cdab3daf"} Mar 16 16:56:35 crc kubenswrapper[5120]: I0316 16:56:35.788888 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-6fc7988ff4-wrbrq" event={"ID":"4691e9c1-c324-494d-98da-d1436447f6ac","Type":"ContainerStarted","Data":"65c36e21df554a7fcfdfd1f7c91b2b92654c429ab3cf0102defeffb108301415"} Mar 16 16:56:35 crc kubenswrapper[5120]: I0316 16:56:35.788933 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-6fc7988ff4-wrbrq" event={"ID":"4691e9c1-c324-494d-98da-d1436447f6ac","Type":"ContainerStarted","Data":"010145a51f511ba5cc819e966ffb6af5a2127030416d479cd168a89c288f59e3"} Mar 16 16:56:35 crc kubenswrapper[5120]: I0316 16:56:35.788944 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-6fc7988ff4-wrbrq" event={"ID":"4691e9c1-c324-494d-98da-d1436447f6ac","Type":"ContainerStarted","Data":"691d76de507030735d50edea35f943d16ac768a831104a855ecddd4e31a26ab2"} Mar 16 16:56:35 crc kubenswrapper[5120]: I0316 16:56:35.789548 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-6fc7988ff4-wrbrq" Mar 16 16:56:35 crc kubenswrapper[5120]: I0316 16:56:35.789586 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-6fc7988ff4-wrbrq" Mar 16 16:56:35 crc kubenswrapper[5120]: I0316 16:56:35.794863 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-6fc74764d9-qrphb" event={"ID":"e23fbd51-1180-4d93-9937-9c89abacf10b","Type":"ContainerStarted","Data":"405d808b1ecf10f9d0e6b8c571f57ba0ec934190882191e9b3e0c60956202e92"} Mar 16 16:56:35 crc kubenswrapper[5120]: I0316 16:56:35.794919 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-6fc74764d9-qrphb" event={"ID":"e23fbd51-1180-4d93-9937-9c89abacf10b","Type":"ContainerStarted","Data":"9a7b06878e2ba8775823c827847ca1ac79df41547ebfcef15cedd04c3195885c"} Mar 16 16:56:35 crc kubenswrapper[5120]: I0316 16:56:35.794932 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-6fc74764d9-qrphb" event={"ID":"e23fbd51-1180-4d93-9937-9c89abacf10b","Type":"ContainerStarted","Data":"56a9182c06c229cd9499ea36a4018d2ce0291a2a255ced66964d650136faddcb"} Mar 16 16:56:35 crc kubenswrapper[5120]: I0316 16:56:35.812061 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-keystone-listener-78774f5dfb-bzqjl" podStartSLOduration=2.812045196 podStartE2EDuration="2.812045196s" podCreationTimestamp="2026-03-16 16:56:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:56:35.809330172 +0000 UTC m=+5097.963261829" watchObservedRunningTime="2026-03-16 16:56:35.812045196 +0000 UTC m=+5097.965976843" Mar 16 16:56:35 crc kubenswrapper[5120]: I0316 16:56:35.823634 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-86x58" event={"ID":"28a7df09-48d2-4fae-ad59-a333d87354fd","Type":"ContainerStarted","Data":"e79bec4774f6a6e576ce22646b1f0afd4a6a10b83b113f6a415debac6c55cba5"} Mar 16 16:56:35 crc kubenswrapper[5120]: I0316 16:56:35.834876 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-api-6fc7988ff4-wrbrq" podStartSLOduration=2.83485328 podStartE2EDuration="2.83485328s" podCreationTimestamp="2026-03-16 16:56:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:56:35.832774544 +0000 UTC m=+5097.986706191" watchObservedRunningTime="2026-03-16 16:56:35.83485328 +0000 UTC m=+5097.988784937" Mar 16 16:56:35 crc kubenswrapper[5120]: I0316 16:56:35.871168 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-worker-6fc74764d9-qrphb" podStartSLOduration=2.8711492339999998 podStartE2EDuration="2.871149234s" podCreationTimestamp="2026-03-16 16:56:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:56:35.869059537 +0000 UTC m=+5098.022991194" watchObservedRunningTime="2026-03-16 16:56:35.871149234 +0000 UTC m=+5098.025080891" Mar 16 16:56:35 crc kubenswrapper[5120]: I0316 16:56:35.917198 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-bootstrap-86x58" podStartSLOduration=2.917176944 podStartE2EDuration="2.917176944s" podCreationTimestamp="2026-03-16 16:56:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:56:35.895711637 +0000 UTC m=+5098.049643294" watchObservedRunningTime="2026-03-16 16:56:35.917176944 +0000 UTC m=+5098.071108601" Mar 16 16:56:36 crc kubenswrapper[5120]: I0316 16:56:36.836750 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"9975f854-d1d5-4fda-9475-8a93c6d69b1f","Type":"ContainerStarted","Data":"d1f023d03a0bf83d4287bd4a6b6089e489a71411f5750e0d74de488d09efb7df"} Mar 16 16:56:36 crc kubenswrapper[5120]: I0316 16:56:36.836855 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:56:36 crc kubenswrapper[5120]: I0316 16:56:36.839505 5120 generic.go:358] "Generic (PLEG): container finished" podID="e199c216-19d8-4055-9a2b-3d65e13116a2" containerID="7a0e860743d15f4f4b72328ec610b6dc439ff5bf46e14ab6366068df1d13ca98" exitCode=0 Mar 16 16:56:36 crc kubenswrapper[5120]: I0316 16:56:36.839657 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-q2bn4" event={"ID":"e199c216-19d8-4055-9a2b-3d65e13116a2","Type":"ContainerDied","Data":"7a0e860743d15f4f4b72328ec610b6dc439ff5bf46e14ab6366068df1d13ca98"} Mar 16 16:56:36 crc kubenswrapper[5120]: I0316 16:56:36.860189 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.664808255 podStartE2EDuration="6.860169404s" podCreationTimestamp="2026-03-16 16:56:30 +0000 UTC" firstStartedPulling="2026-03-16 16:56:31.813025551 +0000 UTC m=+5093.966957208" lastFinishedPulling="2026-03-16 16:56:36.0083867 +0000 UTC m=+5098.162318357" observedRunningTime="2026-03-16 16:56:36.854640833 +0000 UTC m=+5099.008572490" watchObservedRunningTime="2026-03-16 16:56:36.860169404 +0000 UTC m=+5099.014101071" Mar 16 16:56:37 crc kubenswrapper[5120]: I0316 16:56:37.468448 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-api-856c7c8dd4-vsqd7"] Mar 16 16:56:37 crc kubenswrapper[5120]: I0316 16:56:37.476940 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-856c7c8dd4-vsqd7" Mar 16 16:56:37 crc kubenswrapper[5120]: I0316 16:56:37.481309 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-barbican-internal-svc\"" Mar 16 16:56:37 crc kubenswrapper[5120]: I0316 16:56:37.481358 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-barbican-public-svc\"" Mar 16 16:56:37 crc kubenswrapper[5120]: I0316 16:56:37.484005 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-856c7c8dd4-vsqd7"] Mar 16 16:56:37 crc kubenswrapper[5120]: I0316 16:56:37.578222 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2cf93ef3-c7e7-45dd-9639-e40bce42a900-combined-ca-bundle\") pod \"barbican-api-856c7c8dd4-vsqd7\" (UID: \"2cf93ef3-c7e7-45dd-9639-e40bce42a900\") " pod="openstack-kuttl-tests/barbican-api-856c7c8dd4-vsqd7" Mar 16 16:56:37 crc kubenswrapper[5120]: I0316 16:56:37.578288 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86wrr\" (UniqueName: \"kubernetes.io/projected/2cf93ef3-c7e7-45dd-9639-e40bce42a900-kube-api-access-86wrr\") pod \"barbican-api-856c7c8dd4-vsqd7\" (UID: \"2cf93ef3-c7e7-45dd-9639-e40bce42a900\") " pod="openstack-kuttl-tests/barbican-api-856c7c8dd4-vsqd7" Mar 16 16:56:37 crc kubenswrapper[5120]: I0316 16:56:37.578389 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/2cf93ef3-c7e7-45dd-9639-e40bce42a900-internal-tls-certs\") pod \"barbican-api-856c7c8dd4-vsqd7\" (UID: \"2cf93ef3-c7e7-45dd-9639-e40bce42a900\") " pod="openstack-kuttl-tests/barbican-api-856c7c8dd4-vsqd7" Mar 16 16:56:37 crc kubenswrapper[5120]: I0316 16:56:37.578495 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/2cf93ef3-c7e7-45dd-9639-e40bce42a900-public-tls-certs\") pod \"barbican-api-856c7c8dd4-vsqd7\" (UID: \"2cf93ef3-c7e7-45dd-9639-e40bce42a900\") " pod="openstack-kuttl-tests/barbican-api-856c7c8dd4-vsqd7" Mar 16 16:56:37 crc kubenswrapper[5120]: I0316 16:56:37.578687 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2cf93ef3-c7e7-45dd-9639-e40bce42a900-logs\") pod \"barbican-api-856c7c8dd4-vsqd7\" (UID: \"2cf93ef3-c7e7-45dd-9639-e40bce42a900\") " pod="openstack-kuttl-tests/barbican-api-856c7c8dd4-vsqd7" Mar 16 16:56:37 crc kubenswrapper[5120]: I0316 16:56:37.579070 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/2cf93ef3-c7e7-45dd-9639-e40bce42a900-config-data-custom\") pod \"barbican-api-856c7c8dd4-vsqd7\" (UID: \"2cf93ef3-c7e7-45dd-9639-e40bce42a900\") " pod="openstack-kuttl-tests/barbican-api-856c7c8dd4-vsqd7" Mar 16 16:56:37 crc kubenswrapper[5120]: I0316 16:56:37.579426 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2cf93ef3-c7e7-45dd-9639-e40bce42a900-config-data\") pod \"barbican-api-856c7c8dd4-vsqd7\" (UID: \"2cf93ef3-c7e7-45dd-9639-e40bce42a900\") " pod="openstack-kuttl-tests/barbican-api-856c7c8dd4-vsqd7" Mar 16 16:56:37 crc kubenswrapper[5120]: I0316 16:56:37.681466 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/2cf93ef3-c7e7-45dd-9639-e40bce42a900-internal-tls-certs\") pod \"barbican-api-856c7c8dd4-vsqd7\" (UID: \"2cf93ef3-c7e7-45dd-9639-e40bce42a900\") " pod="openstack-kuttl-tests/barbican-api-856c7c8dd4-vsqd7" Mar 16 16:56:37 crc kubenswrapper[5120]: I0316 16:56:37.681528 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/2cf93ef3-c7e7-45dd-9639-e40bce42a900-public-tls-certs\") pod \"barbican-api-856c7c8dd4-vsqd7\" (UID: \"2cf93ef3-c7e7-45dd-9639-e40bce42a900\") " pod="openstack-kuttl-tests/barbican-api-856c7c8dd4-vsqd7" Mar 16 16:56:37 crc kubenswrapper[5120]: I0316 16:56:37.681601 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2cf93ef3-c7e7-45dd-9639-e40bce42a900-logs\") pod \"barbican-api-856c7c8dd4-vsqd7\" (UID: \"2cf93ef3-c7e7-45dd-9639-e40bce42a900\") " pod="openstack-kuttl-tests/barbican-api-856c7c8dd4-vsqd7" Mar 16 16:56:37 crc kubenswrapper[5120]: I0316 16:56:37.681714 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/2cf93ef3-c7e7-45dd-9639-e40bce42a900-config-data-custom\") pod \"barbican-api-856c7c8dd4-vsqd7\" (UID: \"2cf93ef3-c7e7-45dd-9639-e40bce42a900\") " pod="openstack-kuttl-tests/barbican-api-856c7c8dd4-vsqd7" Mar 16 16:56:37 crc kubenswrapper[5120]: I0316 16:56:37.681878 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2cf93ef3-c7e7-45dd-9639-e40bce42a900-config-data\") pod \"barbican-api-856c7c8dd4-vsqd7\" (UID: \"2cf93ef3-c7e7-45dd-9639-e40bce42a900\") " pod="openstack-kuttl-tests/barbican-api-856c7c8dd4-vsqd7" Mar 16 16:56:37 crc kubenswrapper[5120]: I0316 16:56:37.681949 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2cf93ef3-c7e7-45dd-9639-e40bce42a900-combined-ca-bundle\") pod \"barbican-api-856c7c8dd4-vsqd7\" (UID: \"2cf93ef3-c7e7-45dd-9639-e40bce42a900\") " pod="openstack-kuttl-tests/barbican-api-856c7c8dd4-vsqd7" Mar 16 16:56:37 crc kubenswrapper[5120]: I0316 16:56:37.681986 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-86wrr\" (UniqueName: \"kubernetes.io/projected/2cf93ef3-c7e7-45dd-9639-e40bce42a900-kube-api-access-86wrr\") pod \"barbican-api-856c7c8dd4-vsqd7\" (UID: \"2cf93ef3-c7e7-45dd-9639-e40bce42a900\") " pod="openstack-kuttl-tests/barbican-api-856c7c8dd4-vsqd7" Mar 16 16:56:37 crc kubenswrapper[5120]: I0316 16:56:37.683034 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2cf93ef3-c7e7-45dd-9639-e40bce42a900-logs\") pod \"barbican-api-856c7c8dd4-vsqd7\" (UID: \"2cf93ef3-c7e7-45dd-9639-e40bce42a900\") " pod="openstack-kuttl-tests/barbican-api-856c7c8dd4-vsqd7" Mar 16 16:56:37 crc kubenswrapper[5120]: I0316 16:56:37.688175 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/2cf93ef3-c7e7-45dd-9639-e40bce42a900-config-data-custom\") pod \"barbican-api-856c7c8dd4-vsqd7\" (UID: \"2cf93ef3-c7e7-45dd-9639-e40bce42a900\") " pod="openstack-kuttl-tests/barbican-api-856c7c8dd4-vsqd7" Mar 16 16:56:37 crc kubenswrapper[5120]: I0316 16:56:37.688594 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2cf93ef3-c7e7-45dd-9639-e40bce42a900-config-data\") pod \"barbican-api-856c7c8dd4-vsqd7\" (UID: \"2cf93ef3-c7e7-45dd-9639-e40bce42a900\") " pod="openstack-kuttl-tests/barbican-api-856c7c8dd4-vsqd7" Mar 16 16:56:37 crc kubenswrapper[5120]: I0316 16:56:37.689107 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2cf93ef3-c7e7-45dd-9639-e40bce42a900-combined-ca-bundle\") pod \"barbican-api-856c7c8dd4-vsqd7\" (UID: \"2cf93ef3-c7e7-45dd-9639-e40bce42a900\") " pod="openstack-kuttl-tests/barbican-api-856c7c8dd4-vsqd7" Mar 16 16:56:37 crc kubenswrapper[5120]: I0316 16:56:37.689149 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/2cf93ef3-c7e7-45dd-9639-e40bce42a900-public-tls-certs\") pod \"barbican-api-856c7c8dd4-vsqd7\" (UID: \"2cf93ef3-c7e7-45dd-9639-e40bce42a900\") " pod="openstack-kuttl-tests/barbican-api-856c7c8dd4-vsqd7" Mar 16 16:56:37 crc kubenswrapper[5120]: I0316 16:56:37.689811 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/2cf93ef3-c7e7-45dd-9639-e40bce42a900-internal-tls-certs\") pod \"barbican-api-856c7c8dd4-vsqd7\" (UID: \"2cf93ef3-c7e7-45dd-9639-e40bce42a900\") " pod="openstack-kuttl-tests/barbican-api-856c7c8dd4-vsqd7" Mar 16 16:56:37 crc kubenswrapper[5120]: I0316 16:56:37.703503 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-86wrr\" (UniqueName: \"kubernetes.io/projected/2cf93ef3-c7e7-45dd-9639-e40bce42a900-kube-api-access-86wrr\") pod \"barbican-api-856c7c8dd4-vsqd7\" (UID: \"2cf93ef3-c7e7-45dd-9639-e40bce42a900\") " pod="openstack-kuttl-tests/barbican-api-856c7c8dd4-vsqd7" Mar 16 16:56:37 crc kubenswrapper[5120]: I0316 16:56:37.799089 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-856c7c8dd4-vsqd7" Mar 16 16:56:38 crc kubenswrapper[5120]: I0316 16:56:38.375227 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-856c7c8dd4-vsqd7"] Mar 16 16:56:38 crc kubenswrapper[5120]: W0316 16:56:38.382276 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2cf93ef3_c7e7_45dd_9639_e40bce42a900.slice/crio-729b5e7b1103c4e99f5dd76797f59c8a61c54dafb8892916e946ad92b3e998a3 WatchSource:0}: Error finding container 729b5e7b1103c4e99f5dd76797f59c8a61c54dafb8892916e946ad92b3e998a3: Status 404 returned error can't find the container with id 729b5e7b1103c4e99f5dd76797f59c8a61c54dafb8892916e946ad92b3e998a3 Mar 16 16:56:38 crc kubenswrapper[5120]: I0316 16:56:38.385043 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-q2bn4" Mar 16 16:56:38 crc kubenswrapper[5120]: I0316 16:56:38.501431 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e199c216-19d8-4055-9a2b-3d65e13116a2-config-data\") pod \"e199c216-19d8-4055-9a2b-3d65e13116a2\" (UID: \"e199c216-19d8-4055-9a2b-3d65e13116a2\") " Mar 16 16:56:38 crc kubenswrapper[5120]: I0316 16:56:38.501512 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/e199c216-19d8-4055-9a2b-3d65e13116a2-etc-machine-id\") pod \"e199c216-19d8-4055-9a2b-3d65e13116a2\" (UID: \"e199c216-19d8-4055-9a2b-3d65e13116a2\") " Mar 16 16:56:38 crc kubenswrapper[5120]: I0316 16:56:38.501628 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6fdvq\" (UniqueName: \"kubernetes.io/projected/e199c216-19d8-4055-9a2b-3d65e13116a2-kube-api-access-6fdvq\") pod \"e199c216-19d8-4055-9a2b-3d65e13116a2\" (UID: \"e199c216-19d8-4055-9a2b-3d65e13116a2\") " Mar 16 16:56:38 crc kubenswrapper[5120]: I0316 16:56:38.501842 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/e199c216-19d8-4055-9a2b-3d65e13116a2-db-sync-config-data\") pod \"e199c216-19d8-4055-9a2b-3d65e13116a2\" (UID: \"e199c216-19d8-4055-9a2b-3d65e13116a2\") " Mar 16 16:56:38 crc kubenswrapper[5120]: I0316 16:56:38.501975 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e199c216-19d8-4055-9a2b-3d65e13116a2-combined-ca-bundle\") pod \"e199c216-19d8-4055-9a2b-3d65e13116a2\" (UID: \"e199c216-19d8-4055-9a2b-3d65e13116a2\") " Mar 16 16:56:38 crc kubenswrapper[5120]: I0316 16:56:38.502257 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e199c216-19d8-4055-9a2b-3d65e13116a2-scripts\") pod \"e199c216-19d8-4055-9a2b-3d65e13116a2\" (UID: \"e199c216-19d8-4055-9a2b-3d65e13116a2\") " Mar 16 16:56:38 crc kubenswrapper[5120]: I0316 16:56:38.503133 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/e199c216-19d8-4055-9a2b-3d65e13116a2-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "e199c216-19d8-4055-9a2b-3d65e13116a2" (UID: "e199c216-19d8-4055-9a2b-3d65e13116a2"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 16:56:38 crc kubenswrapper[5120]: I0316 16:56:38.509201 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e199c216-19d8-4055-9a2b-3d65e13116a2-db-sync-config-data" (OuterVolumeSpecName: "db-sync-config-data") pod "e199c216-19d8-4055-9a2b-3d65e13116a2" (UID: "e199c216-19d8-4055-9a2b-3d65e13116a2"). InnerVolumeSpecName "db-sync-config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:56:38 crc kubenswrapper[5120]: I0316 16:56:38.509861 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e199c216-19d8-4055-9a2b-3d65e13116a2-scripts" (OuterVolumeSpecName: "scripts") pod "e199c216-19d8-4055-9a2b-3d65e13116a2" (UID: "e199c216-19d8-4055-9a2b-3d65e13116a2"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:56:38 crc kubenswrapper[5120]: I0316 16:56:38.510400 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e199c216-19d8-4055-9a2b-3d65e13116a2-kube-api-access-6fdvq" (OuterVolumeSpecName: "kube-api-access-6fdvq") pod "e199c216-19d8-4055-9a2b-3d65e13116a2" (UID: "e199c216-19d8-4055-9a2b-3d65e13116a2"). InnerVolumeSpecName "kube-api-access-6fdvq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:56:38 crc kubenswrapper[5120]: I0316 16:56:38.553039 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e199c216-19d8-4055-9a2b-3d65e13116a2-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e199c216-19d8-4055-9a2b-3d65e13116a2" (UID: "e199c216-19d8-4055-9a2b-3d65e13116a2"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:56:38 crc kubenswrapper[5120]: I0316 16:56:38.555152 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e199c216-19d8-4055-9a2b-3d65e13116a2-config-data" (OuterVolumeSpecName: "config-data") pod "e199c216-19d8-4055-9a2b-3d65e13116a2" (UID: "e199c216-19d8-4055-9a2b-3d65e13116a2"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:56:38 crc kubenswrapper[5120]: I0316 16:56:38.619907 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e199c216-19d8-4055-9a2b-3d65e13116a2-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:56:38 crc kubenswrapper[5120]: I0316 16:56:38.619952 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e199c216-19d8-4055-9a2b-3d65e13116a2-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:56:38 crc kubenswrapper[5120]: I0316 16:56:38.619962 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e199c216-19d8-4055-9a2b-3d65e13116a2-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:56:38 crc kubenswrapper[5120]: I0316 16:56:38.619970 5120 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/e199c216-19d8-4055-9a2b-3d65e13116a2-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 16:56:38 crc kubenswrapper[5120]: I0316 16:56:38.619980 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6fdvq\" (UniqueName: \"kubernetes.io/projected/e199c216-19d8-4055-9a2b-3d65e13116a2-kube-api-access-6fdvq\") on node \"crc\" DevicePath \"\"" Mar 16 16:56:38 crc kubenswrapper[5120]: I0316 16:56:38.619992 5120 reconciler_common.go:299] "Volume detached for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/e199c216-19d8-4055-9a2b-3d65e13116a2-db-sync-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:56:38 crc kubenswrapper[5120]: I0316 16:56:38.906585 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-856c7c8dd4-vsqd7" event={"ID":"2cf93ef3-c7e7-45dd-9639-e40bce42a900","Type":"ContainerStarted","Data":"61644943603f36bcbbb1c3e4504d927426de1097045e937e92209490f6b2f699"} Mar 16 16:56:38 crc kubenswrapper[5120]: I0316 16:56:38.906893 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-856c7c8dd4-vsqd7" event={"ID":"2cf93ef3-c7e7-45dd-9639-e40bce42a900","Type":"ContainerStarted","Data":"29615c6b15ac113f99ca1bd009163b4eb6330a8a13133b8006178be01abb44bb"} Mar 16 16:56:38 crc kubenswrapper[5120]: I0316 16:56:38.906987 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-856c7c8dd4-vsqd7" Mar 16 16:56:38 crc kubenswrapper[5120]: I0316 16:56:38.907071 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-856c7c8dd4-vsqd7" event={"ID":"2cf93ef3-c7e7-45dd-9639-e40bce42a900","Type":"ContainerStarted","Data":"729b5e7b1103c4e99f5dd76797f59c8a61c54dafb8892916e946ad92b3e998a3"} Mar 16 16:56:38 crc kubenswrapper[5120]: I0316 16:56:38.907167 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-856c7c8dd4-vsqd7" Mar 16 16:56:38 crc kubenswrapper[5120]: I0316 16:56:38.908755 5120 generic.go:358] "Generic (PLEG): container finished" podID="28a7df09-48d2-4fae-ad59-a333d87354fd" containerID="e79bec4774f6a6e576ce22646b1f0afd4a6a10b83b113f6a415debac6c55cba5" exitCode=0 Mar 16 16:56:38 crc kubenswrapper[5120]: I0316 16:56:38.908810 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-86x58" event={"ID":"28a7df09-48d2-4fae-ad59-a333d87354fd","Type":"ContainerDied","Data":"e79bec4774f6a6e576ce22646b1f0afd4a6a10b83b113f6a415debac6c55cba5"} Mar 16 16:56:38 crc kubenswrapper[5120]: I0316 16:56:38.915321 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-q2bn4" event={"ID":"e199c216-19d8-4055-9a2b-3d65e13116a2","Type":"ContainerDied","Data":"41005bb9787bc7a4afdcfcb49f205bf805e223064326f8dad1afad2c2c041ccc"} Mar 16 16:56:38 crc kubenswrapper[5120]: I0316 16:56:38.915365 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="41005bb9787bc7a4afdcfcb49f205bf805e223064326f8dad1afad2c2c041ccc" Mar 16 16:56:38 crc kubenswrapper[5120]: I0316 16:56:38.915459 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-q2bn4" Mar 16 16:56:38 crc kubenswrapper[5120]: I0316 16:56:38.955421 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-api-856c7c8dd4-vsqd7" podStartSLOduration=1.9553959920000001 podStartE2EDuration="1.955395992s" podCreationTimestamp="2026-03-16 16:56:37 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:56:38.944041532 +0000 UTC m=+5101.097973189" watchObservedRunningTime="2026-03-16 16:56:38.955395992 +0000 UTC m=+5101.109327659" Mar 16 16:56:39 crc kubenswrapper[5120]: I0316 16:56:39.094967 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:56:39 crc kubenswrapper[5120]: I0316 16:56:39.096532 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e199c216-19d8-4055-9a2b-3d65e13116a2" containerName="cinder-db-sync" Mar 16 16:56:39 crc kubenswrapper[5120]: I0316 16:56:39.096560 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e199c216-19d8-4055-9a2b-3d65e13116a2" containerName="cinder-db-sync" Mar 16 16:56:39 crc kubenswrapper[5120]: I0316 16:56:39.096889 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e199c216-19d8-4055-9a2b-3d65e13116a2" containerName="cinder-db-sync" Mar 16 16:56:39 crc kubenswrapper[5120]: I0316 16:56:39.103569 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:56:39 crc kubenswrapper[5120]: I0316 16:56:39.113443 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-config-data\"" Mar 16 16:56:39 crc kubenswrapper[5120]: I0316 16:56:39.113732 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-scripts\"" Mar 16 16:56:39 crc kubenswrapper[5120]: I0316 16:56:39.114233 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-cinder-dockercfg-z2rp2\"" Mar 16 16:56:39 crc kubenswrapper[5120]: I0316 16:56:39.117051 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-scheduler-config-data\"" Mar 16 16:56:39 crc kubenswrapper[5120]: I0316 16:56:39.125671 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:56:39 crc kubenswrapper[5120]: I0316 16:56:39.246169 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxscs\" (UniqueName: \"kubernetes.io/projected/3264bd71-ad28-4b8e-a7e7-91508c6a6f25-kube-api-access-wxscs\") pod \"cinder-scheduler-0\" (UID: \"3264bd71-ad28-4b8e-a7e7-91508c6a6f25\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:56:39 crc kubenswrapper[5120]: I0316 16:56:39.246336 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3264bd71-ad28-4b8e-a7e7-91508c6a6f25-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"3264bd71-ad28-4b8e-a7e7-91508c6a6f25\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:56:39 crc kubenswrapper[5120]: I0316 16:56:39.246406 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/3264bd71-ad28-4b8e-a7e7-91508c6a6f25-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"3264bd71-ad28-4b8e-a7e7-91508c6a6f25\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:56:39 crc kubenswrapper[5120]: I0316 16:56:39.246644 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/3264bd71-ad28-4b8e-a7e7-91508c6a6f25-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"3264bd71-ad28-4b8e-a7e7-91508c6a6f25\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:56:39 crc kubenswrapper[5120]: I0316 16:56:39.246681 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3264bd71-ad28-4b8e-a7e7-91508c6a6f25-scripts\") pod \"cinder-scheduler-0\" (UID: \"3264bd71-ad28-4b8e-a7e7-91508c6a6f25\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:56:39 crc kubenswrapper[5120]: I0316 16:56:39.246697 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3264bd71-ad28-4b8e-a7e7-91508c6a6f25-config-data\") pod \"cinder-scheduler-0\" (UID: \"3264bd71-ad28-4b8e-a7e7-91508c6a6f25\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:56:39 crc kubenswrapper[5120]: I0316 16:56:39.301541 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:56:39 crc kubenswrapper[5120]: I0316 16:56:39.307948 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:56:39 crc kubenswrapper[5120]: I0316 16:56:39.307982 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:56:39 crc kubenswrapper[5120]: I0316 16:56:39.308253 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:56:39 crc kubenswrapper[5120]: I0316 16:56:39.311476 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-api-config-data\"" Mar 16 16:56:39 crc kubenswrapper[5120]: I0316 16:56:39.321492 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:56:39 crc kubenswrapper[5120]: I0316 16:56:39.352045 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wxscs\" (UniqueName: \"kubernetes.io/projected/3264bd71-ad28-4b8e-a7e7-91508c6a6f25-kube-api-access-wxscs\") pod \"cinder-scheduler-0\" (UID: \"3264bd71-ad28-4b8e-a7e7-91508c6a6f25\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:56:39 crc kubenswrapper[5120]: I0316 16:56:39.352195 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3264bd71-ad28-4b8e-a7e7-91508c6a6f25-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"3264bd71-ad28-4b8e-a7e7-91508c6a6f25\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:56:39 crc kubenswrapper[5120]: I0316 16:56:39.352253 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/3264bd71-ad28-4b8e-a7e7-91508c6a6f25-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"3264bd71-ad28-4b8e-a7e7-91508c6a6f25\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:56:39 crc kubenswrapper[5120]: I0316 16:56:39.352327 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/3264bd71-ad28-4b8e-a7e7-91508c6a6f25-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"3264bd71-ad28-4b8e-a7e7-91508c6a6f25\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:56:39 crc kubenswrapper[5120]: I0316 16:56:39.352348 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3264bd71-ad28-4b8e-a7e7-91508c6a6f25-scripts\") pod \"cinder-scheduler-0\" (UID: \"3264bd71-ad28-4b8e-a7e7-91508c6a6f25\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:56:39 crc kubenswrapper[5120]: I0316 16:56:39.352365 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3264bd71-ad28-4b8e-a7e7-91508c6a6f25-config-data\") pod \"cinder-scheduler-0\" (UID: \"3264bd71-ad28-4b8e-a7e7-91508c6a6f25\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:56:39 crc kubenswrapper[5120]: I0316 16:56:39.356187 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/3264bd71-ad28-4b8e-a7e7-91508c6a6f25-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"3264bd71-ad28-4b8e-a7e7-91508c6a6f25\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:56:39 crc kubenswrapper[5120]: I0316 16:56:39.360186 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:56:39 crc kubenswrapper[5120]: I0316 16:56:39.362561 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/3264bd71-ad28-4b8e-a7e7-91508c6a6f25-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"3264bd71-ad28-4b8e-a7e7-91508c6a6f25\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:56:39 crc kubenswrapper[5120]: I0316 16:56:39.367651 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3264bd71-ad28-4b8e-a7e7-91508c6a6f25-scripts\") pod \"cinder-scheduler-0\" (UID: \"3264bd71-ad28-4b8e-a7e7-91508c6a6f25\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:56:39 crc kubenswrapper[5120]: I0316 16:56:39.368993 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:56:39 crc kubenswrapper[5120]: I0316 16:56:39.371343 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3264bd71-ad28-4b8e-a7e7-91508c6a6f25-config-data\") pod \"cinder-scheduler-0\" (UID: \"3264bd71-ad28-4b8e-a7e7-91508c6a6f25\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:56:39 crc kubenswrapper[5120]: I0316 16:56:39.377538 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3264bd71-ad28-4b8e-a7e7-91508c6a6f25-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"3264bd71-ad28-4b8e-a7e7-91508c6a6f25\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:56:39 crc kubenswrapper[5120]: I0316 16:56:39.384275 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxscs\" (UniqueName: \"kubernetes.io/projected/3264bd71-ad28-4b8e-a7e7-91508c6a6f25-kube-api-access-wxscs\") pod \"cinder-scheduler-0\" (UID: \"3264bd71-ad28-4b8e-a7e7-91508c6a6f25\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:56:39 crc kubenswrapper[5120]: I0316 16:56:39.429717 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:56:39 crc kubenswrapper[5120]: I0316 16:56:39.454453 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ed94831a-9c6a-4d66-8246-6b3613972756-scripts\") pod \"cinder-api-0\" (UID: \"ed94831a-9c6a-4d66-8246-6b3613972756\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:56:39 crc kubenswrapper[5120]: I0316 16:56:39.454736 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdbks\" (UniqueName: \"kubernetes.io/projected/ed94831a-9c6a-4d66-8246-6b3613972756-kube-api-access-tdbks\") pod \"cinder-api-0\" (UID: \"ed94831a-9c6a-4d66-8246-6b3613972756\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:56:39 crc kubenswrapper[5120]: I0316 16:56:39.454890 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ed94831a-9c6a-4d66-8246-6b3613972756-config-data\") pod \"cinder-api-0\" (UID: \"ed94831a-9c6a-4d66-8246-6b3613972756\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:56:39 crc kubenswrapper[5120]: I0316 16:56:39.455179 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/ed94831a-9c6a-4d66-8246-6b3613972756-config-data-custom\") pod \"cinder-api-0\" (UID: \"ed94831a-9c6a-4d66-8246-6b3613972756\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:56:39 crc kubenswrapper[5120]: I0316 16:56:39.455744 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ed94831a-9c6a-4d66-8246-6b3613972756-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"ed94831a-9c6a-4d66-8246-6b3613972756\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:56:39 crc kubenswrapper[5120]: I0316 16:56:39.455811 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/ed94831a-9c6a-4d66-8246-6b3613972756-etc-machine-id\") pod \"cinder-api-0\" (UID: \"ed94831a-9c6a-4d66-8246-6b3613972756\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:56:39 crc kubenswrapper[5120]: I0316 16:56:39.456105 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ed94831a-9c6a-4d66-8246-6b3613972756-logs\") pod \"cinder-api-0\" (UID: \"ed94831a-9c6a-4d66-8246-6b3613972756\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:56:39 crc kubenswrapper[5120]: I0316 16:56:39.557659 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/ed94831a-9c6a-4d66-8246-6b3613972756-config-data-custom\") pod \"cinder-api-0\" (UID: \"ed94831a-9c6a-4d66-8246-6b3613972756\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:56:39 crc kubenswrapper[5120]: I0316 16:56:39.557752 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ed94831a-9c6a-4d66-8246-6b3613972756-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"ed94831a-9c6a-4d66-8246-6b3613972756\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:56:39 crc kubenswrapper[5120]: I0316 16:56:39.557811 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/ed94831a-9c6a-4d66-8246-6b3613972756-etc-machine-id\") pod \"cinder-api-0\" (UID: \"ed94831a-9c6a-4d66-8246-6b3613972756\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:56:39 crc kubenswrapper[5120]: I0316 16:56:39.557902 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ed94831a-9c6a-4d66-8246-6b3613972756-logs\") pod \"cinder-api-0\" (UID: \"ed94831a-9c6a-4d66-8246-6b3613972756\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:56:39 crc kubenswrapper[5120]: I0316 16:56:39.557936 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ed94831a-9c6a-4d66-8246-6b3613972756-scripts\") pod \"cinder-api-0\" (UID: \"ed94831a-9c6a-4d66-8246-6b3613972756\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:56:39 crc kubenswrapper[5120]: I0316 16:56:39.557954 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tdbks\" (UniqueName: \"kubernetes.io/projected/ed94831a-9c6a-4d66-8246-6b3613972756-kube-api-access-tdbks\") pod \"cinder-api-0\" (UID: \"ed94831a-9c6a-4d66-8246-6b3613972756\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:56:39 crc kubenswrapper[5120]: I0316 16:56:39.557988 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ed94831a-9c6a-4d66-8246-6b3613972756-config-data\") pod \"cinder-api-0\" (UID: \"ed94831a-9c6a-4d66-8246-6b3613972756\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:56:39 crc kubenswrapper[5120]: I0316 16:56:39.558998 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/ed94831a-9c6a-4d66-8246-6b3613972756-etc-machine-id\") pod \"cinder-api-0\" (UID: \"ed94831a-9c6a-4d66-8246-6b3613972756\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:56:39 crc kubenswrapper[5120]: I0316 16:56:39.559923 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ed94831a-9c6a-4d66-8246-6b3613972756-logs\") pod \"cinder-api-0\" (UID: \"ed94831a-9c6a-4d66-8246-6b3613972756\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:56:39 crc kubenswrapper[5120]: I0316 16:56:39.564121 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ed94831a-9c6a-4d66-8246-6b3613972756-config-data\") pod \"cinder-api-0\" (UID: \"ed94831a-9c6a-4d66-8246-6b3613972756\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:56:39 crc kubenswrapper[5120]: I0316 16:56:39.564123 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ed94831a-9c6a-4d66-8246-6b3613972756-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"ed94831a-9c6a-4d66-8246-6b3613972756\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:56:39 crc kubenswrapper[5120]: I0316 16:56:39.564449 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ed94831a-9c6a-4d66-8246-6b3613972756-scripts\") pod \"cinder-api-0\" (UID: \"ed94831a-9c6a-4d66-8246-6b3613972756\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:56:39 crc kubenswrapper[5120]: I0316 16:56:39.566489 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/ed94831a-9c6a-4d66-8246-6b3613972756-config-data-custom\") pod \"cinder-api-0\" (UID: \"ed94831a-9c6a-4d66-8246-6b3613972756\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:56:39 crc kubenswrapper[5120]: I0316 16:56:39.587482 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdbks\" (UniqueName: \"kubernetes.io/projected/ed94831a-9c6a-4d66-8246-6b3613972756-kube-api-access-tdbks\") pod \"cinder-api-0\" (UID: \"ed94831a-9c6a-4d66-8246-6b3613972756\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:56:39 crc kubenswrapper[5120]: I0316 16:56:39.631490 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:56:39 crc kubenswrapper[5120]: I0316 16:56:39.874092 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:56:39 crc kubenswrapper[5120]: W0316 16:56:39.882108 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3264bd71_ad28_4b8e_a7e7_91508c6a6f25.slice/crio-8c33f13da7b0ae65d3a820e3586e3fb17ff57995b1610769bc71820e1cc1ad4c WatchSource:0}: Error finding container 8c33f13da7b0ae65d3a820e3586e3fb17ff57995b1610769bc71820e1cc1ad4c: Status 404 returned error can't find the container with id 8c33f13da7b0ae65d3a820e3586e3fb17ff57995b1610769bc71820e1cc1ad4c Mar 16 16:56:39 crc kubenswrapper[5120]: I0316 16:56:39.937474 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"3264bd71-ad28-4b8e-a7e7-91508c6a6f25","Type":"ContainerStarted","Data":"8c33f13da7b0ae65d3a820e3586e3fb17ff57995b1610769bc71820e1cc1ad4c"} Mar 16 16:56:39 crc kubenswrapper[5120]: I0316 16:56:39.943391 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:56:39 crc kubenswrapper[5120]: I0316 16:56:39.943441 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:56:40 crc kubenswrapper[5120]: I0316 16:56:40.028945 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:56:40 crc kubenswrapper[5120]: I0316 16:56:40.028989 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:56:40 crc kubenswrapper[5120]: I0316 16:56:40.080900 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:56:40 crc kubenswrapper[5120]: I0316 16:56:40.101522 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:56:40 crc kubenswrapper[5120]: I0316 16:56:40.119616 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:56:40 crc kubenswrapper[5120]: I0316 16:56:40.327494 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-86x58" Mar 16 16:56:40 crc kubenswrapper[5120]: I0316 16:56:40.489659 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/28a7df09-48d2-4fae-ad59-a333d87354fd-fernet-keys\") pod \"28a7df09-48d2-4fae-ad59-a333d87354fd\" (UID: \"28a7df09-48d2-4fae-ad59-a333d87354fd\") " Mar 16 16:56:40 crc kubenswrapper[5120]: I0316 16:56:40.490023 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/28a7df09-48d2-4fae-ad59-a333d87354fd-credential-keys\") pod \"28a7df09-48d2-4fae-ad59-a333d87354fd\" (UID: \"28a7df09-48d2-4fae-ad59-a333d87354fd\") " Mar 16 16:56:40 crc kubenswrapper[5120]: I0316 16:56:40.490236 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/28a7df09-48d2-4fae-ad59-a333d87354fd-config-data\") pod \"28a7df09-48d2-4fae-ad59-a333d87354fd\" (UID: \"28a7df09-48d2-4fae-ad59-a333d87354fd\") " Mar 16 16:56:40 crc kubenswrapper[5120]: I0316 16:56:40.490438 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/28a7df09-48d2-4fae-ad59-a333d87354fd-combined-ca-bundle\") pod \"28a7df09-48d2-4fae-ad59-a333d87354fd\" (UID: \"28a7df09-48d2-4fae-ad59-a333d87354fd\") " Mar 16 16:56:40 crc kubenswrapper[5120]: I0316 16:56:40.490477 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z6t8v\" (UniqueName: \"kubernetes.io/projected/28a7df09-48d2-4fae-ad59-a333d87354fd-kube-api-access-z6t8v\") pod \"28a7df09-48d2-4fae-ad59-a333d87354fd\" (UID: \"28a7df09-48d2-4fae-ad59-a333d87354fd\") " Mar 16 16:56:40 crc kubenswrapper[5120]: I0316 16:56:40.490649 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/28a7df09-48d2-4fae-ad59-a333d87354fd-scripts\") pod \"28a7df09-48d2-4fae-ad59-a333d87354fd\" (UID: \"28a7df09-48d2-4fae-ad59-a333d87354fd\") " Mar 16 16:56:40 crc kubenswrapper[5120]: I0316 16:56:40.505978 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/28a7df09-48d2-4fae-ad59-a333d87354fd-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "28a7df09-48d2-4fae-ad59-a333d87354fd" (UID: "28a7df09-48d2-4fae-ad59-a333d87354fd"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:56:40 crc kubenswrapper[5120]: I0316 16:56:40.506032 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/28a7df09-48d2-4fae-ad59-a333d87354fd-scripts" (OuterVolumeSpecName: "scripts") pod "28a7df09-48d2-4fae-ad59-a333d87354fd" (UID: "28a7df09-48d2-4fae-ad59-a333d87354fd"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:56:40 crc kubenswrapper[5120]: I0316 16:56:40.517716 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28a7df09-48d2-4fae-ad59-a333d87354fd-kube-api-access-z6t8v" (OuterVolumeSpecName: "kube-api-access-z6t8v") pod "28a7df09-48d2-4fae-ad59-a333d87354fd" (UID: "28a7df09-48d2-4fae-ad59-a333d87354fd"). InnerVolumeSpecName "kube-api-access-z6t8v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:56:40 crc kubenswrapper[5120]: I0316 16:56:40.521267 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/28a7df09-48d2-4fae-ad59-a333d87354fd-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "28a7df09-48d2-4fae-ad59-a333d87354fd" (UID: "28a7df09-48d2-4fae-ad59-a333d87354fd"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:56:40 crc kubenswrapper[5120]: I0316 16:56:40.538985 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/28a7df09-48d2-4fae-ad59-a333d87354fd-config-data" (OuterVolumeSpecName: "config-data") pod "28a7df09-48d2-4fae-ad59-a333d87354fd" (UID: "28a7df09-48d2-4fae-ad59-a333d87354fd"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:56:40 crc kubenswrapper[5120]: I0316 16:56:40.546105 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/28a7df09-48d2-4fae-ad59-a333d87354fd-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "28a7df09-48d2-4fae-ad59-a333d87354fd" (UID: "28a7df09-48d2-4fae-ad59-a333d87354fd"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:56:40 crc kubenswrapper[5120]: I0316 16:56:40.594836 5120 reconciler_common.go:299] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/28a7df09-48d2-4fae-ad59-a333d87354fd-fernet-keys\") on node \"crc\" DevicePath \"\"" Mar 16 16:56:40 crc kubenswrapper[5120]: I0316 16:56:40.594902 5120 reconciler_common.go:299] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/28a7df09-48d2-4fae-ad59-a333d87354fd-credential-keys\") on node \"crc\" DevicePath \"\"" Mar 16 16:56:40 crc kubenswrapper[5120]: I0316 16:56:40.594916 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/28a7df09-48d2-4fae-ad59-a333d87354fd-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:56:40 crc kubenswrapper[5120]: I0316 16:56:40.594926 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/28a7df09-48d2-4fae-ad59-a333d87354fd-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:56:40 crc kubenswrapper[5120]: I0316 16:56:40.594937 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z6t8v\" (UniqueName: \"kubernetes.io/projected/28a7df09-48d2-4fae-ad59-a333d87354fd-kube-api-access-z6t8v\") on node \"crc\" DevicePath \"\"" Mar 16 16:56:40 crc kubenswrapper[5120]: I0316 16:56:40.594947 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/28a7df09-48d2-4fae-ad59-a333d87354fd-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:56:40 crc kubenswrapper[5120]: I0316 16:56:40.971557 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"ed94831a-9c6a-4d66-8246-6b3613972756","Type":"ContainerStarted","Data":"8cc13a7b7bbbb3b67bcd67055083af6d4841ca8da08b725a33d9d459d2670642"} Mar 16 16:56:40 crc kubenswrapper[5120]: I0316 16:56:40.992055 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-86x58" event={"ID":"28a7df09-48d2-4fae-ad59-a333d87354fd","Type":"ContainerDied","Data":"0d795728ab3b0726a980e4b258b09ec848ac215905eb35fd542d2552ec9b7b2f"} Mar 16 16:56:40 crc kubenswrapper[5120]: I0316 16:56:40.992152 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0d795728ab3b0726a980e4b258b09ec848ac215905eb35fd542d2552ec9b7b2f" Mar 16 16:56:40 crc kubenswrapper[5120]: I0316 16:56:40.992236 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-86x58" Mar 16 16:56:41 crc kubenswrapper[5120]: I0316 16:56:41.020329 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"3264bd71-ad28-4b8e-a7e7-91508c6a6f25","Type":"ContainerStarted","Data":"b583abe5db9352e6c81bea08f9819a58ef3fc82fe7a4428c2aaef72b3a4710b4"} Mar 16 16:56:41 crc kubenswrapper[5120]: I0316 16:56:41.020367 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:56:41 crc kubenswrapper[5120]: I0316 16:56:41.020946 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:56:41 crc kubenswrapper[5120]: I0316 16:56:41.178142 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-ddf666799-df45b"] Mar 16 16:56:41 crc kubenswrapper[5120]: I0316 16:56:41.180472 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28a7df09-48d2-4fae-ad59-a333d87354fd" containerName="keystone-bootstrap" Mar 16 16:56:41 crc kubenswrapper[5120]: I0316 16:56:41.180560 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="28a7df09-48d2-4fae-ad59-a333d87354fd" containerName="keystone-bootstrap" Mar 16 16:56:41 crc kubenswrapper[5120]: I0316 16:56:41.180884 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="28a7df09-48d2-4fae-ad59-a333d87354fd" containerName="keystone-bootstrap" Mar 16 16:56:41 crc kubenswrapper[5120]: I0316 16:56:41.185209 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-ddf666799-df45b" Mar 16 16:56:41 crc kubenswrapper[5120]: I0316 16:56:41.188356 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-ddf666799-df45b"] Mar 16 16:56:41 crc kubenswrapper[5120]: I0316 16:56:41.192632 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-scripts\"" Mar 16 16:56:41 crc kubenswrapper[5120]: I0316 16:56:41.193089 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-config-data\"" Mar 16 16:56:41 crc kubenswrapper[5120]: I0316 16:56:41.193349 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-keystone-dockercfg-5mpsq\"" Mar 16 16:56:41 crc kubenswrapper[5120]: I0316 16:56:41.193608 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-keystone-internal-svc\"" Mar 16 16:56:41 crc kubenswrapper[5120]: I0316 16:56:41.195586 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone\"" Mar 16 16:56:41 crc kubenswrapper[5120]: I0316 16:56:41.195857 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-keystone-public-svc\"" Mar 16 16:56:41 crc kubenswrapper[5120]: I0316 16:56:41.317088 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8m44v\" (UniqueName: \"kubernetes.io/projected/aa20bbc5-67eb-41b6-83f9-a6dd3e1d9754-kube-api-access-8m44v\") pod \"keystone-ddf666799-df45b\" (UID: \"aa20bbc5-67eb-41b6-83f9-a6dd3e1d9754\") " pod="openstack-kuttl-tests/keystone-ddf666799-df45b" Mar 16 16:56:41 crc kubenswrapper[5120]: I0316 16:56:41.317161 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/aa20bbc5-67eb-41b6-83f9-a6dd3e1d9754-combined-ca-bundle\") pod \"keystone-ddf666799-df45b\" (UID: \"aa20bbc5-67eb-41b6-83f9-a6dd3e1d9754\") " pod="openstack-kuttl-tests/keystone-ddf666799-df45b" Mar 16 16:56:41 crc kubenswrapper[5120]: I0316 16:56:41.317249 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/aa20bbc5-67eb-41b6-83f9-a6dd3e1d9754-public-tls-certs\") pod \"keystone-ddf666799-df45b\" (UID: \"aa20bbc5-67eb-41b6-83f9-a6dd3e1d9754\") " pod="openstack-kuttl-tests/keystone-ddf666799-df45b" Mar 16 16:56:41 crc kubenswrapper[5120]: I0316 16:56:41.317284 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/aa20bbc5-67eb-41b6-83f9-a6dd3e1d9754-fernet-keys\") pod \"keystone-ddf666799-df45b\" (UID: \"aa20bbc5-67eb-41b6-83f9-a6dd3e1d9754\") " pod="openstack-kuttl-tests/keystone-ddf666799-df45b" Mar 16 16:56:41 crc kubenswrapper[5120]: I0316 16:56:41.317302 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/aa20bbc5-67eb-41b6-83f9-a6dd3e1d9754-credential-keys\") pod \"keystone-ddf666799-df45b\" (UID: \"aa20bbc5-67eb-41b6-83f9-a6dd3e1d9754\") " pod="openstack-kuttl-tests/keystone-ddf666799-df45b" Mar 16 16:56:41 crc kubenswrapper[5120]: I0316 16:56:41.317368 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/aa20bbc5-67eb-41b6-83f9-a6dd3e1d9754-internal-tls-certs\") pod \"keystone-ddf666799-df45b\" (UID: \"aa20bbc5-67eb-41b6-83f9-a6dd3e1d9754\") " pod="openstack-kuttl-tests/keystone-ddf666799-df45b" Mar 16 16:56:41 crc kubenswrapper[5120]: I0316 16:56:41.317409 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/aa20bbc5-67eb-41b6-83f9-a6dd3e1d9754-config-data\") pod \"keystone-ddf666799-df45b\" (UID: \"aa20bbc5-67eb-41b6-83f9-a6dd3e1d9754\") " pod="openstack-kuttl-tests/keystone-ddf666799-df45b" Mar 16 16:56:41 crc kubenswrapper[5120]: I0316 16:56:41.317484 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/aa20bbc5-67eb-41b6-83f9-a6dd3e1d9754-scripts\") pod \"keystone-ddf666799-df45b\" (UID: \"aa20bbc5-67eb-41b6-83f9-a6dd3e1d9754\") " pod="openstack-kuttl-tests/keystone-ddf666799-df45b" Mar 16 16:56:41 crc kubenswrapper[5120]: I0316 16:56:41.419453 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8m44v\" (UniqueName: \"kubernetes.io/projected/aa20bbc5-67eb-41b6-83f9-a6dd3e1d9754-kube-api-access-8m44v\") pod \"keystone-ddf666799-df45b\" (UID: \"aa20bbc5-67eb-41b6-83f9-a6dd3e1d9754\") " pod="openstack-kuttl-tests/keystone-ddf666799-df45b" Mar 16 16:56:41 crc kubenswrapper[5120]: I0316 16:56:41.419546 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/aa20bbc5-67eb-41b6-83f9-a6dd3e1d9754-combined-ca-bundle\") pod \"keystone-ddf666799-df45b\" (UID: \"aa20bbc5-67eb-41b6-83f9-a6dd3e1d9754\") " pod="openstack-kuttl-tests/keystone-ddf666799-df45b" Mar 16 16:56:41 crc kubenswrapper[5120]: I0316 16:56:41.419630 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/aa20bbc5-67eb-41b6-83f9-a6dd3e1d9754-public-tls-certs\") pod \"keystone-ddf666799-df45b\" (UID: \"aa20bbc5-67eb-41b6-83f9-a6dd3e1d9754\") " pod="openstack-kuttl-tests/keystone-ddf666799-df45b" Mar 16 16:56:41 crc kubenswrapper[5120]: I0316 16:56:41.419663 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/aa20bbc5-67eb-41b6-83f9-a6dd3e1d9754-fernet-keys\") pod \"keystone-ddf666799-df45b\" (UID: \"aa20bbc5-67eb-41b6-83f9-a6dd3e1d9754\") " pod="openstack-kuttl-tests/keystone-ddf666799-df45b" Mar 16 16:56:41 crc kubenswrapper[5120]: I0316 16:56:41.419684 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/aa20bbc5-67eb-41b6-83f9-a6dd3e1d9754-credential-keys\") pod \"keystone-ddf666799-df45b\" (UID: \"aa20bbc5-67eb-41b6-83f9-a6dd3e1d9754\") " pod="openstack-kuttl-tests/keystone-ddf666799-df45b" Mar 16 16:56:41 crc kubenswrapper[5120]: I0316 16:56:41.419817 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/aa20bbc5-67eb-41b6-83f9-a6dd3e1d9754-internal-tls-certs\") pod \"keystone-ddf666799-df45b\" (UID: \"aa20bbc5-67eb-41b6-83f9-a6dd3e1d9754\") " pod="openstack-kuttl-tests/keystone-ddf666799-df45b" Mar 16 16:56:41 crc kubenswrapper[5120]: I0316 16:56:41.419863 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/aa20bbc5-67eb-41b6-83f9-a6dd3e1d9754-config-data\") pod \"keystone-ddf666799-df45b\" (UID: \"aa20bbc5-67eb-41b6-83f9-a6dd3e1d9754\") " pod="openstack-kuttl-tests/keystone-ddf666799-df45b" Mar 16 16:56:41 crc kubenswrapper[5120]: I0316 16:56:41.419937 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/aa20bbc5-67eb-41b6-83f9-a6dd3e1d9754-scripts\") pod \"keystone-ddf666799-df45b\" (UID: \"aa20bbc5-67eb-41b6-83f9-a6dd3e1d9754\") " pod="openstack-kuttl-tests/keystone-ddf666799-df45b" Mar 16 16:56:41 crc kubenswrapper[5120]: I0316 16:56:41.432254 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/aa20bbc5-67eb-41b6-83f9-a6dd3e1d9754-scripts\") pod \"keystone-ddf666799-df45b\" (UID: \"aa20bbc5-67eb-41b6-83f9-a6dd3e1d9754\") " pod="openstack-kuttl-tests/keystone-ddf666799-df45b" Mar 16 16:56:41 crc kubenswrapper[5120]: I0316 16:56:41.445786 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/aa20bbc5-67eb-41b6-83f9-a6dd3e1d9754-internal-tls-certs\") pod \"keystone-ddf666799-df45b\" (UID: \"aa20bbc5-67eb-41b6-83f9-a6dd3e1d9754\") " pod="openstack-kuttl-tests/keystone-ddf666799-df45b" Mar 16 16:56:41 crc kubenswrapper[5120]: I0316 16:56:41.448893 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8m44v\" (UniqueName: \"kubernetes.io/projected/aa20bbc5-67eb-41b6-83f9-a6dd3e1d9754-kube-api-access-8m44v\") pod \"keystone-ddf666799-df45b\" (UID: \"aa20bbc5-67eb-41b6-83f9-a6dd3e1d9754\") " pod="openstack-kuttl-tests/keystone-ddf666799-df45b" Mar 16 16:56:41 crc kubenswrapper[5120]: I0316 16:56:41.449457 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/aa20bbc5-67eb-41b6-83f9-a6dd3e1d9754-public-tls-certs\") pod \"keystone-ddf666799-df45b\" (UID: \"aa20bbc5-67eb-41b6-83f9-a6dd3e1d9754\") " pod="openstack-kuttl-tests/keystone-ddf666799-df45b" Mar 16 16:56:41 crc kubenswrapper[5120]: I0316 16:56:41.449557 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/aa20bbc5-67eb-41b6-83f9-a6dd3e1d9754-credential-keys\") pod \"keystone-ddf666799-df45b\" (UID: \"aa20bbc5-67eb-41b6-83f9-a6dd3e1d9754\") " pod="openstack-kuttl-tests/keystone-ddf666799-df45b" Mar 16 16:56:41 crc kubenswrapper[5120]: I0316 16:56:41.451631 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/aa20bbc5-67eb-41b6-83f9-a6dd3e1d9754-combined-ca-bundle\") pod \"keystone-ddf666799-df45b\" (UID: \"aa20bbc5-67eb-41b6-83f9-a6dd3e1d9754\") " pod="openstack-kuttl-tests/keystone-ddf666799-df45b" Mar 16 16:56:41 crc kubenswrapper[5120]: I0316 16:56:41.463383 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/aa20bbc5-67eb-41b6-83f9-a6dd3e1d9754-config-data\") pod \"keystone-ddf666799-df45b\" (UID: \"aa20bbc5-67eb-41b6-83f9-a6dd3e1d9754\") " pod="openstack-kuttl-tests/keystone-ddf666799-df45b" Mar 16 16:56:41 crc kubenswrapper[5120]: I0316 16:56:41.480785 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/aa20bbc5-67eb-41b6-83f9-a6dd3e1d9754-fernet-keys\") pod \"keystone-ddf666799-df45b\" (UID: \"aa20bbc5-67eb-41b6-83f9-a6dd3e1d9754\") " pod="openstack-kuttl-tests/keystone-ddf666799-df45b" Mar 16 16:56:41 crc kubenswrapper[5120]: I0316 16:56:41.559667 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-ddf666799-df45b" Mar 16 16:56:41 crc kubenswrapper[5120]: I0316 16:56:41.879022 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:56:41 crc kubenswrapper[5120]: I0316 16:56:41.981038 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:56:41 crc kubenswrapper[5120]: I0316 16:56:41.981331 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="9975f854-d1d5-4fda-9475-8a93c6d69b1f" containerName="ceilometer-central-agent" containerID="cri-o://c18d7c16ebd97731379d7f465628571d626faf2bbd200863e8b62e422d3333c7" gracePeriod=30 Mar 16 16:56:41 crc kubenswrapper[5120]: I0316 16:56:41.982180 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="9975f854-d1d5-4fda-9475-8a93c6d69b1f" containerName="proxy-httpd" containerID="cri-o://d1f023d03a0bf83d4287bd4a6b6089e489a71411f5750e0d74de488d09efb7df" gracePeriod=30 Mar 16 16:56:41 crc kubenswrapper[5120]: I0316 16:56:41.982347 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="9975f854-d1d5-4fda-9475-8a93c6d69b1f" containerName="ceilometer-notification-agent" containerID="cri-o://9706cac6e8aa256c76986f00277c2e94be9b5dc3822fe9d8158dc9d2358d75f4" gracePeriod=30 Mar 16 16:56:41 crc kubenswrapper[5120]: I0316 16:56:41.982389 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="9975f854-d1d5-4fda-9475-8a93c6d69b1f" containerName="sg-core" containerID="cri-o://860c91e4e126c0b6559f31e25eeb54807d237cb30ce7327a0658498a6c862fbd" gracePeriod=30 Mar 16 16:56:42 crc kubenswrapper[5120]: I0316 16:56:42.139876 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"ed94831a-9c6a-4d66-8246-6b3613972756","Type":"ContainerStarted","Data":"0fca96548b4701de1eb0ac3ad92fc8a55ce43d3fa1da645d96ab4272c99593a1"} Mar 16 16:56:42 crc kubenswrapper[5120]: I0316 16:56:42.172993 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-ddf666799-df45b"] Mar 16 16:56:42 crc kubenswrapper[5120]: W0316 16:56:42.183968 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaa20bbc5_67eb_41b6_83f9_a6dd3e1d9754.slice/crio-e877c6ca7abec18321954a81b70d60912631ff785a9519a7fe31d566cfef36db WatchSource:0}: Error finding container e877c6ca7abec18321954a81b70d60912631ff785a9519a7fe31d566cfef36db: Status 404 returned error can't find the container with id e877c6ca7abec18321954a81b70d60912631ff785a9519a7fe31d566cfef36db Mar 16 16:56:43 crc kubenswrapper[5120]: I0316 16:56:43.119172 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:56:43 crc kubenswrapper[5120]: I0316 16:56:43.182574 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-ddf666799-df45b" event={"ID":"aa20bbc5-67eb-41b6-83f9-a6dd3e1d9754","Type":"ContainerStarted","Data":"7a0d02df021e34ba46af8468db125c17a6955a8df67524d59d149786c4b8bccd"} Mar 16 16:56:43 crc kubenswrapper[5120]: I0316 16:56:43.183659 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/keystone-ddf666799-df45b" Mar 16 16:56:43 crc kubenswrapper[5120]: I0316 16:56:43.183680 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-ddf666799-df45b" event={"ID":"aa20bbc5-67eb-41b6-83f9-a6dd3e1d9754","Type":"ContainerStarted","Data":"e877c6ca7abec18321954a81b70d60912631ff785a9519a7fe31d566cfef36db"} Mar 16 16:56:43 crc kubenswrapper[5120]: I0316 16:56:43.204204 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9975f854-d1d5-4fda-9475-8a93c6d69b1f-combined-ca-bundle\") pod \"9975f854-d1d5-4fda-9475-8a93c6d69b1f\" (UID: \"9975f854-d1d5-4fda-9475-8a93c6d69b1f\") " Mar 16 16:56:43 crc kubenswrapper[5120]: I0316 16:56:43.204300 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9975f854-d1d5-4fda-9475-8a93c6d69b1f-scripts\") pod \"9975f854-d1d5-4fda-9475-8a93c6d69b1f\" (UID: \"9975f854-d1d5-4fda-9475-8a93c6d69b1f\") " Mar 16 16:56:43 crc kubenswrapper[5120]: I0316 16:56:43.204351 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/9975f854-d1d5-4fda-9475-8a93c6d69b1f-log-httpd\") pod \"9975f854-d1d5-4fda-9475-8a93c6d69b1f\" (UID: \"9975f854-d1d5-4fda-9475-8a93c6d69b1f\") " Mar 16 16:56:43 crc kubenswrapper[5120]: I0316 16:56:43.204468 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/9975f854-d1d5-4fda-9475-8a93c6d69b1f-run-httpd\") pod \"9975f854-d1d5-4fda-9475-8a93c6d69b1f\" (UID: \"9975f854-d1d5-4fda-9475-8a93c6d69b1f\") " Mar 16 16:56:43 crc kubenswrapper[5120]: I0316 16:56:43.204649 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/9975f854-d1d5-4fda-9475-8a93c6d69b1f-sg-core-conf-yaml\") pod \"9975f854-d1d5-4fda-9475-8a93c6d69b1f\" (UID: \"9975f854-d1d5-4fda-9475-8a93c6d69b1f\") " Mar 16 16:56:43 crc kubenswrapper[5120]: I0316 16:56:43.205061 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b4kx8\" (UniqueName: \"kubernetes.io/projected/9975f854-d1d5-4fda-9475-8a93c6d69b1f-kube-api-access-b4kx8\") pod \"9975f854-d1d5-4fda-9475-8a93c6d69b1f\" (UID: \"9975f854-d1d5-4fda-9475-8a93c6d69b1f\") " Mar 16 16:56:43 crc kubenswrapper[5120]: I0316 16:56:43.205939 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-ddf666799-df45b" podStartSLOduration=2.205928303 podStartE2EDuration="2.205928303s" podCreationTimestamp="2026-03-16 16:56:41 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:56:43.204125583 +0000 UTC m=+5105.358057250" watchObservedRunningTime="2026-03-16 16:56:43.205928303 +0000 UTC m=+5105.359859960" Mar 16 16:56:43 crc kubenswrapper[5120]: I0316 16:56:43.206931 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9975f854-d1d5-4fda-9475-8a93c6d69b1f-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "9975f854-d1d5-4fda-9475-8a93c6d69b1f" (UID: "9975f854-d1d5-4fda-9475-8a93c6d69b1f"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:56:43 crc kubenswrapper[5120]: I0316 16:56:43.207542 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9975f854-d1d5-4fda-9475-8a93c6d69b1f-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "9975f854-d1d5-4fda-9475-8a93c6d69b1f" (UID: "9975f854-d1d5-4fda-9475-8a93c6d69b1f"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:56:43 crc kubenswrapper[5120]: I0316 16:56:43.207698 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9975f854-d1d5-4fda-9475-8a93c6d69b1f-config-data\") pod \"9975f854-d1d5-4fda-9475-8a93c6d69b1f\" (UID: \"9975f854-d1d5-4fda-9475-8a93c6d69b1f\") " Mar 16 16:56:43 crc kubenswrapper[5120]: I0316 16:56:43.208586 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"3264bd71-ad28-4b8e-a7e7-91508c6a6f25","Type":"ContainerStarted","Data":"5d21bea438f7664e4ebd23ffae013cadaff70d8624489dcdd5d88a35e2abae0c"} Mar 16 16:56:43 crc kubenswrapper[5120]: I0316 16:56:43.214415 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/9975f854-d1d5-4fda-9475-8a93c6d69b1f-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:56:43 crc kubenswrapper[5120]: I0316 16:56:43.214441 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/9975f854-d1d5-4fda-9475-8a93c6d69b1f-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:56:43 crc kubenswrapper[5120]: I0316 16:56:43.245420 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9975f854-d1d5-4fda-9475-8a93c6d69b1f-scripts" (OuterVolumeSpecName: "scripts") pod "9975f854-d1d5-4fda-9475-8a93c6d69b1f" (UID: "9975f854-d1d5-4fda-9475-8a93c6d69b1f"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:56:43 crc kubenswrapper[5120]: I0316 16:56:43.245939 5120 generic.go:358] "Generic (PLEG): container finished" podID="9975f854-d1d5-4fda-9475-8a93c6d69b1f" containerID="d1f023d03a0bf83d4287bd4a6b6089e489a71411f5750e0d74de488d09efb7df" exitCode=0 Mar 16 16:56:43 crc kubenswrapper[5120]: I0316 16:56:43.246080 5120 generic.go:358] "Generic (PLEG): container finished" podID="9975f854-d1d5-4fda-9475-8a93c6d69b1f" containerID="860c91e4e126c0b6559f31e25eeb54807d237cb30ce7327a0658498a6c862fbd" exitCode=2 Mar 16 16:56:43 crc kubenswrapper[5120]: I0316 16:56:43.246162 5120 generic.go:358] "Generic (PLEG): container finished" podID="9975f854-d1d5-4fda-9475-8a93c6d69b1f" containerID="9706cac6e8aa256c76986f00277c2e94be9b5dc3822fe9d8158dc9d2358d75f4" exitCode=0 Mar 16 16:56:43 crc kubenswrapper[5120]: I0316 16:56:43.246235 5120 generic.go:358] "Generic (PLEG): container finished" podID="9975f854-d1d5-4fda-9475-8a93c6d69b1f" containerID="c18d7c16ebd97731379d7f465628571d626faf2bbd200863e8b62e422d3333c7" exitCode=0 Mar 16 16:56:43 crc kubenswrapper[5120]: I0316 16:56:43.246426 5120 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Mar 16 16:56:43 crc kubenswrapper[5120]: I0316 16:56:43.246518 5120 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Mar 16 16:56:43 crc kubenswrapper[5120]: I0316 16:56:43.246888 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:56:43 crc kubenswrapper[5120]: I0316 16:56:43.246974 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"9975f854-d1d5-4fda-9475-8a93c6d69b1f","Type":"ContainerDied","Data":"d1f023d03a0bf83d4287bd4a6b6089e489a71411f5750e0d74de488d09efb7df"} Mar 16 16:56:43 crc kubenswrapper[5120]: I0316 16:56:43.247033 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"9975f854-d1d5-4fda-9475-8a93c6d69b1f","Type":"ContainerDied","Data":"860c91e4e126c0b6559f31e25eeb54807d237cb30ce7327a0658498a6c862fbd"} Mar 16 16:56:43 crc kubenswrapper[5120]: I0316 16:56:43.247052 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"9975f854-d1d5-4fda-9475-8a93c6d69b1f","Type":"ContainerDied","Data":"9706cac6e8aa256c76986f00277c2e94be9b5dc3822fe9d8158dc9d2358d75f4"} Mar 16 16:56:43 crc kubenswrapper[5120]: I0316 16:56:43.247064 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"9975f854-d1d5-4fda-9475-8a93c6d69b1f","Type":"ContainerDied","Data":"c18d7c16ebd97731379d7f465628571d626faf2bbd200863e8b62e422d3333c7"} Mar 16 16:56:43 crc kubenswrapper[5120]: I0316 16:56:43.247076 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"9975f854-d1d5-4fda-9475-8a93c6d69b1f","Type":"ContainerDied","Data":"bfda90aacf5db90162bb71706999ae75a07616147c96e28eb13699514ec41a14"} Mar 16 16:56:43 crc kubenswrapper[5120]: I0316 16:56:43.247095 5120 scope.go:117] "RemoveContainer" containerID="d1f023d03a0bf83d4287bd4a6b6089e489a71411f5750e0d74de488d09efb7df" Mar 16 16:56:43 crc kubenswrapper[5120]: I0316 16:56:43.261977 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9975f854-d1d5-4fda-9475-8a93c6d69b1f-kube-api-access-b4kx8" (OuterVolumeSpecName: "kube-api-access-b4kx8") pod "9975f854-d1d5-4fda-9475-8a93c6d69b1f" (UID: "9975f854-d1d5-4fda-9475-8a93c6d69b1f"). InnerVolumeSpecName "kube-api-access-b4kx8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:56:43 crc kubenswrapper[5120]: I0316 16:56:43.266909 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-scheduler-0" podStartSLOduration=4.266885872 podStartE2EDuration="4.266885872s" podCreationTimestamp="2026-03-16 16:56:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:56:43.243359317 +0000 UTC m=+5105.397290974" watchObservedRunningTime="2026-03-16 16:56:43.266885872 +0000 UTC m=+5105.420817539" Mar 16 16:56:43 crc kubenswrapper[5120]: I0316 16:56:43.320582 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9975f854-d1d5-4fda-9475-8a93c6d69b1f-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:56:43 crc kubenswrapper[5120]: I0316 16:56:43.320863 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b4kx8\" (UniqueName: \"kubernetes.io/projected/9975f854-d1d5-4fda-9475-8a93c6d69b1f-kube-api-access-b4kx8\") on node \"crc\" DevicePath \"\"" Mar 16 16:56:43 crc kubenswrapper[5120]: I0316 16:56:43.339407 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9975f854-d1d5-4fda-9475-8a93c6d69b1f-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "9975f854-d1d5-4fda-9475-8a93c6d69b1f" (UID: "9975f854-d1d5-4fda-9475-8a93c6d69b1f"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:56:43 crc kubenswrapper[5120]: I0316 16:56:43.418077 5120 scope.go:117] "RemoveContainer" containerID="860c91e4e126c0b6559f31e25eeb54807d237cb30ce7327a0658498a6c862fbd" Mar 16 16:56:43 crc kubenswrapper[5120]: I0316 16:56:43.422483 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/9975f854-d1d5-4fda-9475-8a93c6d69b1f-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 16:56:43 crc kubenswrapper[5120]: I0316 16:56:43.432512 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9975f854-d1d5-4fda-9475-8a93c6d69b1f-config-data" (OuterVolumeSpecName: "config-data") pod "9975f854-d1d5-4fda-9475-8a93c6d69b1f" (UID: "9975f854-d1d5-4fda-9475-8a93c6d69b1f"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:56:43 crc kubenswrapper[5120]: I0316 16:56:43.433249 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:56:43 crc kubenswrapper[5120]: I0316 16:56:43.433356 5120 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Mar 16 16:56:43 crc kubenswrapper[5120]: I0316 16:56:43.437689 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:56:43 crc kubenswrapper[5120]: I0316 16:56:43.476160 5120 scope.go:117] "RemoveContainer" containerID="9706cac6e8aa256c76986f00277c2e94be9b5dc3822fe9d8158dc9d2358d75f4" Mar 16 16:56:43 crc kubenswrapper[5120]: I0316 16:56:43.554282 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9975f854-d1d5-4fda-9475-8a93c6d69b1f-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:56:43 crc kubenswrapper[5120]: I0316 16:56:43.576512 5120 scope.go:117] "RemoveContainer" containerID="c18d7c16ebd97731379d7f465628571d626faf2bbd200863e8b62e422d3333c7" Mar 16 16:56:43 crc kubenswrapper[5120]: I0316 16:56:43.586187 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9975f854-d1d5-4fda-9475-8a93c6d69b1f-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "9975f854-d1d5-4fda-9475-8a93c6d69b1f" (UID: "9975f854-d1d5-4fda-9475-8a93c6d69b1f"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:56:43 crc kubenswrapper[5120]: I0316 16:56:43.617575 5120 scope.go:117] "RemoveContainer" containerID="d1f023d03a0bf83d4287bd4a6b6089e489a71411f5750e0d74de488d09efb7df" Mar 16 16:56:43 crc kubenswrapper[5120]: E0316 16:56:43.618795 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d1f023d03a0bf83d4287bd4a6b6089e489a71411f5750e0d74de488d09efb7df\": container with ID starting with d1f023d03a0bf83d4287bd4a6b6089e489a71411f5750e0d74de488d09efb7df not found: ID does not exist" containerID="d1f023d03a0bf83d4287bd4a6b6089e489a71411f5750e0d74de488d09efb7df" Mar 16 16:56:43 crc kubenswrapper[5120]: I0316 16:56:43.618845 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1f023d03a0bf83d4287bd4a6b6089e489a71411f5750e0d74de488d09efb7df"} err="failed to get container status \"d1f023d03a0bf83d4287bd4a6b6089e489a71411f5750e0d74de488d09efb7df\": rpc error: code = NotFound desc = could not find container \"d1f023d03a0bf83d4287bd4a6b6089e489a71411f5750e0d74de488d09efb7df\": container with ID starting with d1f023d03a0bf83d4287bd4a6b6089e489a71411f5750e0d74de488d09efb7df not found: ID does not exist" Mar 16 16:56:43 crc kubenswrapper[5120]: I0316 16:56:43.618872 5120 scope.go:117] "RemoveContainer" containerID="860c91e4e126c0b6559f31e25eeb54807d237cb30ce7327a0658498a6c862fbd" Mar 16 16:56:43 crc kubenswrapper[5120]: E0316 16:56:43.619535 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"860c91e4e126c0b6559f31e25eeb54807d237cb30ce7327a0658498a6c862fbd\": container with ID starting with 860c91e4e126c0b6559f31e25eeb54807d237cb30ce7327a0658498a6c862fbd not found: ID does not exist" containerID="860c91e4e126c0b6559f31e25eeb54807d237cb30ce7327a0658498a6c862fbd" Mar 16 16:56:43 crc kubenswrapper[5120]: I0316 16:56:43.619588 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"860c91e4e126c0b6559f31e25eeb54807d237cb30ce7327a0658498a6c862fbd"} err="failed to get container status \"860c91e4e126c0b6559f31e25eeb54807d237cb30ce7327a0658498a6c862fbd\": rpc error: code = NotFound desc = could not find container \"860c91e4e126c0b6559f31e25eeb54807d237cb30ce7327a0658498a6c862fbd\": container with ID starting with 860c91e4e126c0b6559f31e25eeb54807d237cb30ce7327a0658498a6c862fbd not found: ID does not exist" Mar 16 16:56:43 crc kubenswrapper[5120]: I0316 16:56:43.619613 5120 scope.go:117] "RemoveContainer" containerID="9706cac6e8aa256c76986f00277c2e94be9b5dc3822fe9d8158dc9d2358d75f4" Mar 16 16:56:43 crc kubenswrapper[5120]: E0316 16:56:43.623536 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9706cac6e8aa256c76986f00277c2e94be9b5dc3822fe9d8158dc9d2358d75f4\": container with ID starting with 9706cac6e8aa256c76986f00277c2e94be9b5dc3822fe9d8158dc9d2358d75f4 not found: ID does not exist" containerID="9706cac6e8aa256c76986f00277c2e94be9b5dc3822fe9d8158dc9d2358d75f4" Mar 16 16:56:43 crc kubenswrapper[5120]: I0316 16:56:43.623567 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9706cac6e8aa256c76986f00277c2e94be9b5dc3822fe9d8158dc9d2358d75f4"} err="failed to get container status \"9706cac6e8aa256c76986f00277c2e94be9b5dc3822fe9d8158dc9d2358d75f4\": rpc error: code = NotFound desc = could not find container \"9706cac6e8aa256c76986f00277c2e94be9b5dc3822fe9d8158dc9d2358d75f4\": container with ID starting with 9706cac6e8aa256c76986f00277c2e94be9b5dc3822fe9d8158dc9d2358d75f4 not found: ID does not exist" Mar 16 16:56:43 crc kubenswrapper[5120]: I0316 16:56:43.623591 5120 scope.go:117] "RemoveContainer" containerID="c18d7c16ebd97731379d7f465628571d626faf2bbd200863e8b62e422d3333c7" Mar 16 16:56:43 crc kubenswrapper[5120]: E0316 16:56:43.625528 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c18d7c16ebd97731379d7f465628571d626faf2bbd200863e8b62e422d3333c7\": container with ID starting with c18d7c16ebd97731379d7f465628571d626faf2bbd200863e8b62e422d3333c7 not found: ID does not exist" containerID="c18d7c16ebd97731379d7f465628571d626faf2bbd200863e8b62e422d3333c7" Mar 16 16:56:43 crc kubenswrapper[5120]: I0316 16:56:43.625550 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c18d7c16ebd97731379d7f465628571d626faf2bbd200863e8b62e422d3333c7"} err="failed to get container status \"c18d7c16ebd97731379d7f465628571d626faf2bbd200863e8b62e422d3333c7\": rpc error: code = NotFound desc = could not find container \"c18d7c16ebd97731379d7f465628571d626faf2bbd200863e8b62e422d3333c7\": container with ID starting with c18d7c16ebd97731379d7f465628571d626faf2bbd200863e8b62e422d3333c7 not found: ID does not exist" Mar 16 16:56:43 crc kubenswrapper[5120]: I0316 16:56:43.625564 5120 scope.go:117] "RemoveContainer" containerID="d1f023d03a0bf83d4287bd4a6b6089e489a71411f5750e0d74de488d09efb7df" Mar 16 16:56:43 crc kubenswrapper[5120]: I0316 16:56:43.625888 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1f023d03a0bf83d4287bd4a6b6089e489a71411f5750e0d74de488d09efb7df"} err="failed to get container status \"d1f023d03a0bf83d4287bd4a6b6089e489a71411f5750e0d74de488d09efb7df\": rpc error: code = NotFound desc = could not find container \"d1f023d03a0bf83d4287bd4a6b6089e489a71411f5750e0d74de488d09efb7df\": container with ID starting with d1f023d03a0bf83d4287bd4a6b6089e489a71411f5750e0d74de488d09efb7df not found: ID does not exist" Mar 16 16:56:43 crc kubenswrapper[5120]: I0316 16:56:43.625926 5120 scope.go:117] "RemoveContainer" containerID="860c91e4e126c0b6559f31e25eeb54807d237cb30ce7327a0658498a6c862fbd" Mar 16 16:56:43 crc kubenswrapper[5120]: I0316 16:56:43.626302 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"860c91e4e126c0b6559f31e25eeb54807d237cb30ce7327a0658498a6c862fbd"} err="failed to get container status \"860c91e4e126c0b6559f31e25eeb54807d237cb30ce7327a0658498a6c862fbd\": rpc error: code = NotFound desc = could not find container \"860c91e4e126c0b6559f31e25eeb54807d237cb30ce7327a0658498a6c862fbd\": container with ID starting with 860c91e4e126c0b6559f31e25eeb54807d237cb30ce7327a0658498a6c862fbd not found: ID does not exist" Mar 16 16:56:43 crc kubenswrapper[5120]: I0316 16:56:43.626323 5120 scope.go:117] "RemoveContainer" containerID="9706cac6e8aa256c76986f00277c2e94be9b5dc3822fe9d8158dc9d2358d75f4" Mar 16 16:56:43 crc kubenswrapper[5120]: I0316 16:56:43.626666 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9706cac6e8aa256c76986f00277c2e94be9b5dc3822fe9d8158dc9d2358d75f4"} err="failed to get container status \"9706cac6e8aa256c76986f00277c2e94be9b5dc3822fe9d8158dc9d2358d75f4\": rpc error: code = NotFound desc = could not find container \"9706cac6e8aa256c76986f00277c2e94be9b5dc3822fe9d8158dc9d2358d75f4\": container with ID starting with 9706cac6e8aa256c76986f00277c2e94be9b5dc3822fe9d8158dc9d2358d75f4 not found: ID does not exist" Mar 16 16:56:43 crc kubenswrapper[5120]: I0316 16:56:43.626714 5120 scope.go:117] "RemoveContainer" containerID="c18d7c16ebd97731379d7f465628571d626faf2bbd200863e8b62e422d3333c7" Mar 16 16:56:43 crc kubenswrapper[5120]: I0316 16:56:43.627350 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c18d7c16ebd97731379d7f465628571d626faf2bbd200863e8b62e422d3333c7"} err="failed to get container status \"c18d7c16ebd97731379d7f465628571d626faf2bbd200863e8b62e422d3333c7\": rpc error: code = NotFound desc = could not find container \"c18d7c16ebd97731379d7f465628571d626faf2bbd200863e8b62e422d3333c7\": container with ID starting with c18d7c16ebd97731379d7f465628571d626faf2bbd200863e8b62e422d3333c7 not found: ID does not exist" Mar 16 16:56:43 crc kubenswrapper[5120]: I0316 16:56:43.627373 5120 scope.go:117] "RemoveContainer" containerID="d1f023d03a0bf83d4287bd4a6b6089e489a71411f5750e0d74de488d09efb7df" Mar 16 16:56:43 crc kubenswrapper[5120]: I0316 16:56:43.630701 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1f023d03a0bf83d4287bd4a6b6089e489a71411f5750e0d74de488d09efb7df"} err="failed to get container status \"d1f023d03a0bf83d4287bd4a6b6089e489a71411f5750e0d74de488d09efb7df\": rpc error: code = NotFound desc = could not find container \"d1f023d03a0bf83d4287bd4a6b6089e489a71411f5750e0d74de488d09efb7df\": container with ID starting with d1f023d03a0bf83d4287bd4a6b6089e489a71411f5750e0d74de488d09efb7df not found: ID does not exist" Mar 16 16:56:43 crc kubenswrapper[5120]: I0316 16:56:43.630786 5120 scope.go:117] "RemoveContainer" containerID="860c91e4e126c0b6559f31e25eeb54807d237cb30ce7327a0658498a6c862fbd" Mar 16 16:56:43 crc kubenswrapper[5120]: I0316 16:56:43.631052 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"860c91e4e126c0b6559f31e25eeb54807d237cb30ce7327a0658498a6c862fbd"} err="failed to get container status \"860c91e4e126c0b6559f31e25eeb54807d237cb30ce7327a0658498a6c862fbd\": rpc error: code = NotFound desc = could not find container \"860c91e4e126c0b6559f31e25eeb54807d237cb30ce7327a0658498a6c862fbd\": container with ID starting with 860c91e4e126c0b6559f31e25eeb54807d237cb30ce7327a0658498a6c862fbd not found: ID does not exist" Mar 16 16:56:43 crc kubenswrapper[5120]: I0316 16:56:43.631078 5120 scope.go:117] "RemoveContainer" containerID="9706cac6e8aa256c76986f00277c2e94be9b5dc3822fe9d8158dc9d2358d75f4" Mar 16 16:56:43 crc kubenswrapper[5120]: I0316 16:56:43.635040 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9706cac6e8aa256c76986f00277c2e94be9b5dc3822fe9d8158dc9d2358d75f4"} err="failed to get container status \"9706cac6e8aa256c76986f00277c2e94be9b5dc3822fe9d8158dc9d2358d75f4\": rpc error: code = NotFound desc = could not find container \"9706cac6e8aa256c76986f00277c2e94be9b5dc3822fe9d8158dc9d2358d75f4\": container with ID starting with 9706cac6e8aa256c76986f00277c2e94be9b5dc3822fe9d8158dc9d2358d75f4 not found: ID does not exist" Mar 16 16:56:43 crc kubenswrapper[5120]: I0316 16:56:43.635088 5120 scope.go:117] "RemoveContainer" containerID="c18d7c16ebd97731379d7f465628571d626faf2bbd200863e8b62e422d3333c7" Mar 16 16:56:43 crc kubenswrapper[5120]: I0316 16:56:43.637180 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c18d7c16ebd97731379d7f465628571d626faf2bbd200863e8b62e422d3333c7"} err="failed to get container status \"c18d7c16ebd97731379d7f465628571d626faf2bbd200863e8b62e422d3333c7\": rpc error: code = NotFound desc = could not find container \"c18d7c16ebd97731379d7f465628571d626faf2bbd200863e8b62e422d3333c7\": container with ID starting with c18d7c16ebd97731379d7f465628571d626faf2bbd200863e8b62e422d3333c7 not found: ID does not exist" Mar 16 16:56:43 crc kubenswrapper[5120]: I0316 16:56:43.637215 5120 scope.go:117] "RemoveContainer" containerID="d1f023d03a0bf83d4287bd4a6b6089e489a71411f5750e0d74de488d09efb7df" Mar 16 16:56:43 crc kubenswrapper[5120]: I0316 16:56:43.637482 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1f023d03a0bf83d4287bd4a6b6089e489a71411f5750e0d74de488d09efb7df"} err="failed to get container status \"d1f023d03a0bf83d4287bd4a6b6089e489a71411f5750e0d74de488d09efb7df\": rpc error: code = NotFound desc = could not find container \"d1f023d03a0bf83d4287bd4a6b6089e489a71411f5750e0d74de488d09efb7df\": container with ID starting with d1f023d03a0bf83d4287bd4a6b6089e489a71411f5750e0d74de488d09efb7df not found: ID does not exist" Mar 16 16:56:43 crc kubenswrapper[5120]: I0316 16:56:43.637506 5120 scope.go:117] "RemoveContainer" containerID="860c91e4e126c0b6559f31e25eeb54807d237cb30ce7327a0658498a6c862fbd" Mar 16 16:56:43 crc kubenswrapper[5120]: I0316 16:56:43.637781 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"860c91e4e126c0b6559f31e25eeb54807d237cb30ce7327a0658498a6c862fbd"} err="failed to get container status \"860c91e4e126c0b6559f31e25eeb54807d237cb30ce7327a0658498a6c862fbd\": rpc error: code = NotFound desc = could not find container \"860c91e4e126c0b6559f31e25eeb54807d237cb30ce7327a0658498a6c862fbd\": container with ID starting with 860c91e4e126c0b6559f31e25eeb54807d237cb30ce7327a0658498a6c862fbd not found: ID does not exist" Mar 16 16:56:43 crc kubenswrapper[5120]: I0316 16:56:43.637804 5120 scope.go:117] "RemoveContainer" containerID="9706cac6e8aa256c76986f00277c2e94be9b5dc3822fe9d8158dc9d2358d75f4" Mar 16 16:56:43 crc kubenswrapper[5120]: I0316 16:56:43.638102 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9706cac6e8aa256c76986f00277c2e94be9b5dc3822fe9d8158dc9d2358d75f4"} err="failed to get container status \"9706cac6e8aa256c76986f00277c2e94be9b5dc3822fe9d8158dc9d2358d75f4\": rpc error: code = NotFound desc = could not find container \"9706cac6e8aa256c76986f00277c2e94be9b5dc3822fe9d8158dc9d2358d75f4\": container with ID starting with 9706cac6e8aa256c76986f00277c2e94be9b5dc3822fe9d8158dc9d2358d75f4 not found: ID does not exist" Mar 16 16:56:43 crc kubenswrapper[5120]: I0316 16:56:43.638118 5120 scope.go:117] "RemoveContainer" containerID="c18d7c16ebd97731379d7f465628571d626faf2bbd200863e8b62e422d3333c7" Mar 16 16:56:43 crc kubenswrapper[5120]: I0316 16:56:43.638429 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c18d7c16ebd97731379d7f465628571d626faf2bbd200863e8b62e422d3333c7"} err="failed to get container status \"c18d7c16ebd97731379d7f465628571d626faf2bbd200863e8b62e422d3333c7\": rpc error: code = NotFound desc = could not find container \"c18d7c16ebd97731379d7f465628571d626faf2bbd200863e8b62e422d3333c7\": container with ID starting with c18d7c16ebd97731379d7f465628571d626faf2bbd200863e8b62e422d3333c7 not found: ID does not exist" Mar 16 16:56:43 crc kubenswrapper[5120]: I0316 16:56:43.656218 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9975f854-d1d5-4fda-9475-8a93c6d69b1f-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:56:43 crc kubenswrapper[5120]: I0316 16:56:43.909989 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:56:43 crc kubenswrapper[5120]: I0316 16:56:43.925736 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:56:43 crc kubenswrapper[5120]: I0316 16:56:43.935861 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:56:43 crc kubenswrapper[5120]: I0316 16:56:43.936999 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9975f854-d1d5-4fda-9475-8a93c6d69b1f" containerName="ceilometer-central-agent" Mar 16 16:56:43 crc kubenswrapper[5120]: I0316 16:56:43.937019 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9975f854-d1d5-4fda-9475-8a93c6d69b1f" containerName="ceilometer-central-agent" Mar 16 16:56:43 crc kubenswrapper[5120]: I0316 16:56:43.937075 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9975f854-d1d5-4fda-9475-8a93c6d69b1f" containerName="sg-core" Mar 16 16:56:43 crc kubenswrapper[5120]: I0316 16:56:43.937085 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9975f854-d1d5-4fda-9475-8a93c6d69b1f" containerName="sg-core" Mar 16 16:56:43 crc kubenswrapper[5120]: I0316 16:56:43.937106 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9975f854-d1d5-4fda-9475-8a93c6d69b1f" containerName="proxy-httpd" Mar 16 16:56:43 crc kubenswrapper[5120]: I0316 16:56:43.937113 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9975f854-d1d5-4fda-9475-8a93c6d69b1f" containerName="proxy-httpd" Mar 16 16:56:43 crc kubenswrapper[5120]: I0316 16:56:43.937155 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9975f854-d1d5-4fda-9475-8a93c6d69b1f" containerName="ceilometer-notification-agent" Mar 16 16:56:43 crc kubenswrapper[5120]: I0316 16:56:43.937164 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9975f854-d1d5-4fda-9475-8a93c6d69b1f" containerName="ceilometer-notification-agent" Mar 16 16:56:43 crc kubenswrapper[5120]: I0316 16:56:43.937338 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="9975f854-d1d5-4fda-9475-8a93c6d69b1f" containerName="proxy-httpd" Mar 16 16:56:43 crc kubenswrapper[5120]: I0316 16:56:43.937354 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="9975f854-d1d5-4fda-9475-8a93c6d69b1f" containerName="ceilometer-notification-agent" Mar 16 16:56:43 crc kubenswrapper[5120]: I0316 16:56:43.937373 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="9975f854-d1d5-4fda-9475-8a93c6d69b1f" containerName="ceilometer-central-agent" Mar 16 16:56:43 crc kubenswrapper[5120]: I0316 16:56:43.937383 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="9975f854-d1d5-4fda-9475-8a93c6d69b1f" containerName="sg-core" Mar 16 16:56:43 crc kubenswrapper[5120]: I0316 16:56:43.980290 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:56:43 crc kubenswrapper[5120]: I0316 16:56:43.985510 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:56:43 crc kubenswrapper[5120]: I0316 16:56:43.992595 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 16:56:43 crc kubenswrapper[5120]: I0316 16:56:43.993247 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 16:56:44 crc kubenswrapper[5120]: I0316 16:56:44.065004 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d0a971ac-2056-4ef1-abc7-8592e58f8114-scripts\") pod \"ceilometer-0\" (UID: \"d0a971ac-2056-4ef1-abc7-8592e58f8114\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:56:44 crc kubenswrapper[5120]: I0316 16:56:44.065193 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d0a971ac-2056-4ef1-abc7-8592e58f8114-config-data\") pod \"ceilometer-0\" (UID: \"d0a971ac-2056-4ef1-abc7-8592e58f8114\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:56:44 crc kubenswrapper[5120]: I0316 16:56:44.065240 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/d0a971ac-2056-4ef1-abc7-8592e58f8114-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"d0a971ac-2056-4ef1-abc7-8592e58f8114\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:56:44 crc kubenswrapper[5120]: I0316 16:56:44.065461 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4b6z4\" (UniqueName: \"kubernetes.io/projected/d0a971ac-2056-4ef1-abc7-8592e58f8114-kube-api-access-4b6z4\") pod \"ceilometer-0\" (UID: \"d0a971ac-2056-4ef1-abc7-8592e58f8114\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:56:44 crc kubenswrapper[5120]: I0316 16:56:44.065572 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/d0a971ac-2056-4ef1-abc7-8592e58f8114-log-httpd\") pod \"ceilometer-0\" (UID: \"d0a971ac-2056-4ef1-abc7-8592e58f8114\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:56:44 crc kubenswrapper[5120]: I0316 16:56:44.065710 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/d0a971ac-2056-4ef1-abc7-8592e58f8114-run-httpd\") pod \"ceilometer-0\" (UID: \"d0a971ac-2056-4ef1-abc7-8592e58f8114\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:56:44 crc kubenswrapper[5120]: I0316 16:56:44.066604 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d0a971ac-2056-4ef1-abc7-8592e58f8114-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"d0a971ac-2056-4ef1-abc7-8592e58f8114\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:56:44 crc kubenswrapper[5120]: I0316 16:56:44.169861 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d0a971ac-2056-4ef1-abc7-8592e58f8114-scripts\") pod \"ceilometer-0\" (UID: \"d0a971ac-2056-4ef1-abc7-8592e58f8114\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:56:44 crc kubenswrapper[5120]: I0316 16:56:44.169999 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d0a971ac-2056-4ef1-abc7-8592e58f8114-config-data\") pod \"ceilometer-0\" (UID: \"d0a971ac-2056-4ef1-abc7-8592e58f8114\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:56:44 crc kubenswrapper[5120]: I0316 16:56:44.170030 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/d0a971ac-2056-4ef1-abc7-8592e58f8114-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"d0a971ac-2056-4ef1-abc7-8592e58f8114\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:56:44 crc kubenswrapper[5120]: I0316 16:56:44.170132 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4b6z4\" (UniqueName: \"kubernetes.io/projected/d0a971ac-2056-4ef1-abc7-8592e58f8114-kube-api-access-4b6z4\") pod \"ceilometer-0\" (UID: \"d0a971ac-2056-4ef1-abc7-8592e58f8114\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:56:44 crc kubenswrapper[5120]: I0316 16:56:44.170162 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/d0a971ac-2056-4ef1-abc7-8592e58f8114-log-httpd\") pod \"ceilometer-0\" (UID: \"d0a971ac-2056-4ef1-abc7-8592e58f8114\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:56:44 crc kubenswrapper[5120]: I0316 16:56:44.170222 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/d0a971ac-2056-4ef1-abc7-8592e58f8114-run-httpd\") pod \"ceilometer-0\" (UID: \"d0a971ac-2056-4ef1-abc7-8592e58f8114\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:56:44 crc kubenswrapper[5120]: I0316 16:56:44.170517 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d0a971ac-2056-4ef1-abc7-8592e58f8114-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"d0a971ac-2056-4ef1-abc7-8592e58f8114\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:56:44 crc kubenswrapper[5120]: I0316 16:56:44.171092 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/d0a971ac-2056-4ef1-abc7-8592e58f8114-log-httpd\") pod \"ceilometer-0\" (UID: \"d0a971ac-2056-4ef1-abc7-8592e58f8114\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:56:44 crc kubenswrapper[5120]: I0316 16:56:44.171170 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/d0a971ac-2056-4ef1-abc7-8592e58f8114-run-httpd\") pod \"ceilometer-0\" (UID: \"d0a971ac-2056-4ef1-abc7-8592e58f8114\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:56:44 crc kubenswrapper[5120]: I0316 16:56:44.176437 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d0a971ac-2056-4ef1-abc7-8592e58f8114-config-data\") pod \"ceilometer-0\" (UID: \"d0a971ac-2056-4ef1-abc7-8592e58f8114\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:56:44 crc kubenswrapper[5120]: I0316 16:56:44.177520 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d0a971ac-2056-4ef1-abc7-8592e58f8114-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"d0a971ac-2056-4ef1-abc7-8592e58f8114\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:56:44 crc kubenswrapper[5120]: I0316 16:56:44.177950 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/d0a971ac-2056-4ef1-abc7-8592e58f8114-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"d0a971ac-2056-4ef1-abc7-8592e58f8114\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:56:44 crc kubenswrapper[5120]: I0316 16:56:44.180672 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d0a971ac-2056-4ef1-abc7-8592e58f8114-scripts\") pod \"ceilometer-0\" (UID: \"d0a971ac-2056-4ef1-abc7-8592e58f8114\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:56:44 crc kubenswrapper[5120]: I0316 16:56:44.197556 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4b6z4\" (UniqueName: \"kubernetes.io/projected/d0a971ac-2056-4ef1-abc7-8592e58f8114-kube-api-access-4b6z4\") pod \"ceilometer-0\" (UID: \"d0a971ac-2056-4ef1-abc7-8592e58f8114\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:56:44 crc kubenswrapper[5120]: I0316 16:56:44.259652 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"ed94831a-9c6a-4d66-8246-6b3613972756","Type":"ContainerStarted","Data":"6fd0ad414f338bd27ff51b201991e8229037a2677e00ced7b72775f5752d42f6"} Mar 16 16:56:44 crc kubenswrapper[5120]: I0316 16:56:44.259674 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="ed94831a-9c6a-4d66-8246-6b3613972756" containerName="cinder-api-log" containerID="cri-o://0fca96548b4701de1eb0ac3ad92fc8a55ce43d3fa1da645d96ab4272c99593a1" gracePeriod=30 Mar 16 16:56:44 crc kubenswrapper[5120]: I0316 16:56:44.260048 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="ed94831a-9c6a-4d66-8246-6b3613972756" containerName="cinder-api" containerID="cri-o://6fd0ad414f338bd27ff51b201991e8229037a2677e00ced7b72775f5752d42f6" gracePeriod=30 Mar 16 16:56:44 crc kubenswrapper[5120]: I0316 16:56:44.260123 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:56:44 crc kubenswrapper[5120]: I0316 16:56:44.300493 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-api-0" podStartSLOduration=5.300468971 podStartE2EDuration="5.300468971s" podCreationTimestamp="2026-03-16 16:56:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:56:44.287194648 +0000 UTC m=+5106.441126315" watchObservedRunningTime="2026-03-16 16:56:44.300468971 +0000 UTC m=+5106.454400628" Mar 16 16:56:44 crc kubenswrapper[5120]: I0316 16:56:44.337579 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:56:44 crc kubenswrapper[5120]: I0316 16:56:44.432613 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:56:44 crc kubenswrapper[5120]: I0316 16:56:44.569385 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:56:44 crc kubenswrapper[5120]: I0316 16:56:44.569861 5120 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Mar 16 16:56:44 crc kubenswrapper[5120]: I0316 16:56:44.570684 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:56:44 crc kubenswrapper[5120]: I0316 16:56:44.664191 5120 scope.go:117] "RemoveContainer" containerID="083f72646c8d47c9c0467b39be99ddfa9c2e5900ae0a29ad53d7b39b950274b4" Mar 16 16:56:44 crc kubenswrapper[5120]: E0316 16:56:44.666772 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:56:44 crc kubenswrapper[5120]: I0316 16:56:44.690604 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9975f854-d1d5-4fda-9475-8a93c6d69b1f" path="/var/lib/kubelet/pods/9975f854-d1d5-4fda-9475-8a93c6d69b1f/volumes" Mar 16 16:56:44 crc kubenswrapper[5120]: I0316 16:56:44.910280 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:56:45 crc kubenswrapper[5120]: I0316 16:56:45.299162 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"d0a971ac-2056-4ef1-abc7-8592e58f8114","Type":"ContainerStarted","Data":"28ad22e69774497638eafa35572c6a2d2384968a0554c3fa6a1360a0da50d17e"} Mar 16 16:56:45 crc kubenswrapper[5120]: I0316 16:56:45.309429 5120 generic.go:358] "Generic (PLEG): container finished" podID="ed94831a-9c6a-4d66-8246-6b3613972756" containerID="6fd0ad414f338bd27ff51b201991e8229037a2677e00ced7b72775f5752d42f6" exitCode=0 Mar 16 16:56:45 crc kubenswrapper[5120]: I0316 16:56:45.309468 5120 generic.go:358] "Generic (PLEG): container finished" podID="ed94831a-9c6a-4d66-8246-6b3613972756" containerID="0fca96548b4701de1eb0ac3ad92fc8a55ce43d3fa1da645d96ab4272c99593a1" exitCode=143 Mar 16 16:56:45 crc kubenswrapper[5120]: I0316 16:56:45.309681 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"ed94831a-9c6a-4d66-8246-6b3613972756","Type":"ContainerDied","Data":"6fd0ad414f338bd27ff51b201991e8229037a2677e00ced7b72775f5752d42f6"} Mar 16 16:56:45 crc kubenswrapper[5120]: I0316 16:56:45.309754 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"ed94831a-9c6a-4d66-8246-6b3613972756","Type":"ContainerDied","Data":"0fca96548b4701de1eb0ac3ad92fc8a55ce43d3fa1da645d96ab4272c99593a1"} Mar 16 16:56:45 crc kubenswrapper[5120]: I0316 16:56:45.371650 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:56:45 crc kubenswrapper[5120]: I0316 16:56:45.435586 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tdbks\" (UniqueName: \"kubernetes.io/projected/ed94831a-9c6a-4d66-8246-6b3613972756-kube-api-access-tdbks\") pod \"ed94831a-9c6a-4d66-8246-6b3613972756\" (UID: \"ed94831a-9c6a-4d66-8246-6b3613972756\") " Mar 16 16:56:45 crc kubenswrapper[5120]: I0316 16:56:45.435746 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ed94831a-9c6a-4d66-8246-6b3613972756-config-data\") pod \"ed94831a-9c6a-4d66-8246-6b3613972756\" (UID: \"ed94831a-9c6a-4d66-8246-6b3613972756\") " Mar 16 16:56:45 crc kubenswrapper[5120]: I0316 16:56:45.435981 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ed94831a-9c6a-4d66-8246-6b3613972756-logs\") pod \"ed94831a-9c6a-4d66-8246-6b3613972756\" (UID: \"ed94831a-9c6a-4d66-8246-6b3613972756\") " Mar 16 16:56:45 crc kubenswrapper[5120]: I0316 16:56:45.436062 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/ed94831a-9c6a-4d66-8246-6b3613972756-config-data-custom\") pod \"ed94831a-9c6a-4d66-8246-6b3613972756\" (UID: \"ed94831a-9c6a-4d66-8246-6b3613972756\") " Mar 16 16:56:45 crc kubenswrapper[5120]: I0316 16:56:45.436127 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ed94831a-9c6a-4d66-8246-6b3613972756-scripts\") pod \"ed94831a-9c6a-4d66-8246-6b3613972756\" (UID: \"ed94831a-9c6a-4d66-8246-6b3613972756\") " Mar 16 16:56:45 crc kubenswrapper[5120]: I0316 16:56:45.436141 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/ed94831a-9c6a-4d66-8246-6b3613972756-etc-machine-id\") pod \"ed94831a-9c6a-4d66-8246-6b3613972756\" (UID: \"ed94831a-9c6a-4d66-8246-6b3613972756\") " Mar 16 16:56:45 crc kubenswrapper[5120]: I0316 16:56:45.436246 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ed94831a-9c6a-4d66-8246-6b3613972756-combined-ca-bundle\") pod \"ed94831a-9c6a-4d66-8246-6b3613972756\" (UID: \"ed94831a-9c6a-4d66-8246-6b3613972756\") " Mar 16 16:56:45 crc kubenswrapper[5120]: I0316 16:56:45.447819 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed94831a-9c6a-4d66-8246-6b3613972756-logs" (OuterVolumeSpecName: "logs") pod "ed94831a-9c6a-4d66-8246-6b3613972756" (UID: "ed94831a-9c6a-4d66-8246-6b3613972756"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:56:45 crc kubenswrapper[5120]: I0316 16:56:45.448153 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/ed94831a-9c6a-4d66-8246-6b3613972756-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "ed94831a-9c6a-4d66-8246-6b3613972756" (UID: "ed94831a-9c6a-4d66-8246-6b3613972756"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 16:56:45 crc kubenswrapper[5120]: I0316 16:56:45.448944 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed94831a-9c6a-4d66-8246-6b3613972756-kube-api-access-tdbks" (OuterVolumeSpecName: "kube-api-access-tdbks") pod "ed94831a-9c6a-4d66-8246-6b3613972756" (UID: "ed94831a-9c6a-4d66-8246-6b3613972756"). InnerVolumeSpecName "kube-api-access-tdbks". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:56:45 crc kubenswrapper[5120]: I0316 16:56:45.461494 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed94831a-9c6a-4d66-8246-6b3613972756-scripts" (OuterVolumeSpecName: "scripts") pod "ed94831a-9c6a-4d66-8246-6b3613972756" (UID: "ed94831a-9c6a-4d66-8246-6b3613972756"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:56:45 crc kubenswrapper[5120]: I0316 16:56:45.476120 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed94831a-9c6a-4d66-8246-6b3613972756-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "ed94831a-9c6a-4d66-8246-6b3613972756" (UID: "ed94831a-9c6a-4d66-8246-6b3613972756"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:56:45 crc kubenswrapper[5120]: I0316 16:56:45.500494 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed94831a-9c6a-4d66-8246-6b3613972756-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ed94831a-9c6a-4d66-8246-6b3613972756" (UID: "ed94831a-9c6a-4d66-8246-6b3613972756"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:56:45 crc kubenswrapper[5120]: I0316 16:56:45.540143 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed94831a-9c6a-4d66-8246-6b3613972756-config-data" (OuterVolumeSpecName: "config-data") pod "ed94831a-9c6a-4d66-8246-6b3613972756" (UID: "ed94831a-9c6a-4d66-8246-6b3613972756"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:56:45 crc kubenswrapper[5120]: I0316 16:56:45.540830 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ed94831a-9c6a-4d66-8246-6b3613972756-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:56:45 crc kubenswrapper[5120]: I0316 16:56:45.540871 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/ed94831a-9c6a-4d66-8246-6b3613972756-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:56:45 crc kubenswrapper[5120]: I0316 16:56:45.540884 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ed94831a-9c6a-4d66-8246-6b3613972756-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:56:45 crc kubenswrapper[5120]: I0316 16:56:45.540895 5120 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/ed94831a-9c6a-4d66-8246-6b3613972756-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 16:56:45 crc kubenswrapper[5120]: I0316 16:56:45.540907 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ed94831a-9c6a-4d66-8246-6b3613972756-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:56:45 crc kubenswrapper[5120]: I0316 16:56:45.540919 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tdbks\" (UniqueName: \"kubernetes.io/projected/ed94831a-9c6a-4d66-8246-6b3613972756-kube-api-access-tdbks\") on node \"crc\" DevicePath \"\"" Mar 16 16:56:45 crc kubenswrapper[5120]: I0316 16:56:45.540929 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ed94831a-9c6a-4d66-8246-6b3613972756-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:56:45 crc kubenswrapper[5120]: I0316 16:56:45.920228 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-6fc7988ff4-wrbrq" Mar 16 16:56:46 crc kubenswrapper[5120]: I0316 16:56:46.135870 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-6fc7988ff4-wrbrq" Mar 16 16:56:46 crc kubenswrapper[5120]: I0316 16:56:46.340500 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:56:46 crc kubenswrapper[5120]: I0316 16:56:46.346883 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"ed94831a-9c6a-4d66-8246-6b3613972756","Type":"ContainerDied","Data":"8cc13a7b7bbbb3b67bcd67055083af6d4841ca8da08b725a33d9d459d2670642"} Mar 16 16:56:46 crc kubenswrapper[5120]: I0316 16:56:46.346951 5120 scope.go:117] "RemoveContainer" containerID="6fd0ad414f338bd27ff51b201991e8229037a2677e00ced7b72775f5752d42f6" Mar 16 16:56:46 crc kubenswrapper[5120]: I0316 16:56:46.380055 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-v822j_ac55471d-4e42-475f-a082-50f611571482/kube-multus/0.log" Mar 16 16:56:46 crc kubenswrapper[5120]: I0316 16:56:46.386286 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-5d8cb95448-4wwn9"] Mar 16 16:56:46 crc kubenswrapper[5120]: I0316 16:56:46.409348 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed94831a-9c6a-4d66-8246-6b3613972756" containerName="cinder-api-log" Mar 16 16:56:46 crc kubenswrapper[5120]: I0316 16:56:46.409381 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed94831a-9c6a-4d66-8246-6b3613972756" containerName="cinder-api-log" Mar 16 16:56:46 crc kubenswrapper[5120]: I0316 16:56:46.409449 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed94831a-9c6a-4d66-8246-6b3613972756" containerName="cinder-api" Mar 16 16:56:46 crc kubenswrapper[5120]: I0316 16:56:46.409457 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed94831a-9c6a-4d66-8246-6b3613972756" containerName="cinder-api" Mar 16 16:56:46 crc kubenswrapper[5120]: I0316 16:56:46.409734 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ed94831a-9c6a-4d66-8246-6b3613972756" containerName="cinder-api" Mar 16 16:56:46 crc kubenswrapper[5120]: I0316 16:56:46.409786 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ed94831a-9c6a-4d66-8246-6b3613972756" containerName="cinder-api-log" Mar 16 16:56:46 crc kubenswrapper[5120]: I0316 16:56:46.455837 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-crc_9f0bc7fcb0822a2c13eb2d22cd8c0641/kube-controller-manager/0.log" Mar 16 16:56:46 crc kubenswrapper[5120]: I0316 16:56:46.474928 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-worker-7dcbb9bcc5-6bd78"] Mar 16 16:56:46 crc kubenswrapper[5120]: I0316 16:56:46.479258 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-5d8cb95448-4wwn9" Mar 16 16:56:46 crc kubenswrapper[5120]: I0316 16:56:46.492800 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"d0a971ac-2056-4ef1-abc7-8592e58f8114","Type":"ContainerStarted","Data":"866cf66d583c8c223eb1d918bd4e3b618bfb5c046797631f4ebfaa81e562d5c4"} Mar 16 16:56:46 crc kubenswrapper[5120]: I0316 16:56:46.492849 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-5d8cb95448-4wwn9"] Mar 16 16:56:46 crc kubenswrapper[5120]: I0316 16:56:46.492971 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-7dcbb9bcc5-6bd78" Mar 16 16:56:46 crc kubenswrapper[5120]: I0316 16:56:46.498992 5120 scope.go:117] "RemoveContainer" containerID="0fca96548b4701de1eb0ac3ad92fc8a55ce43d3fa1da645d96ab4272c99593a1" Mar 16 16:56:46 crc kubenswrapper[5120]: I0316 16:56:46.520042 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-7dcbb9bcc5-6bd78"] Mar 16 16:56:46 crc kubenswrapper[5120]: I0316 16:56:46.547971 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-856c7c8dd4-vsqd7"] Mar 16 16:56:46 crc kubenswrapper[5120]: I0316 16:56:46.549207 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-856c7c8dd4-vsqd7" podUID="2cf93ef3-c7e7-45dd-9639-e40bce42a900" containerName="barbican-api" containerID="cri-o://61644943603f36bcbbb1c3e4504d927426de1097045e937e92209490f6b2f699" gracePeriod=30 Mar 16 16:56:46 crc kubenswrapper[5120]: I0316 16:56:46.551899 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-856c7c8dd4-vsqd7" podUID="2cf93ef3-c7e7-45dd-9639-e40bce42a900" containerName="barbican-api-log" containerID="cri-o://29615c6b15ac113f99ca1bd009163b4eb6330a8a13133b8006178be01abb44bb" gracePeriod=30 Mar 16 16:56:46 crc kubenswrapper[5120]: I0316 16:56:46.569211 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openstack-kuttl-tests/barbican-api-856c7c8dd4-vsqd7" podUID="2cf93ef3-c7e7-45dd-9639-e40bce42a900" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.1.7:9311/healthcheck\": EOF" Mar 16 16:56:46 crc kubenswrapper[5120]: I0316 16:56:46.569656 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-856c7c8dd4-vsqd7" podUID="2cf93ef3-c7e7-45dd-9639-e40bce42a900" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.1.7:9311/healthcheck\": EOF" Mar 16 16:56:46 crc kubenswrapper[5120]: I0316 16:56:46.570403 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-856c7c8dd4-vsqd7" podUID="2cf93ef3-c7e7-45dd-9639-e40bce42a900" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.1.7:9311/healthcheck\": EOF" Mar 16 16:56:46 crc kubenswrapper[5120]: I0316 16:56:46.572165 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d4c74a5c-86a6-4bcf-b660-10a42c6a2be1-combined-ca-bundle\") pod \"barbican-keystone-listener-5d8cb95448-4wwn9\" (UID: \"d4c74a5c-86a6-4bcf-b660-10a42c6a2be1\") " pod="openstack-kuttl-tests/barbican-keystone-listener-5d8cb95448-4wwn9" Mar 16 16:56:46 crc kubenswrapper[5120]: I0316 16:56:46.572216 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/d4c74a5c-86a6-4bcf-b660-10a42c6a2be1-config-data-custom\") pod \"barbican-keystone-listener-5d8cb95448-4wwn9\" (UID: \"d4c74a5c-86a6-4bcf-b660-10a42c6a2be1\") " pod="openstack-kuttl-tests/barbican-keystone-listener-5d8cb95448-4wwn9" Mar 16 16:56:46 crc kubenswrapper[5120]: I0316 16:56:46.572240 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5r6f\" (UniqueName: \"kubernetes.io/projected/d4c74a5c-86a6-4bcf-b660-10a42c6a2be1-kube-api-access-p5r6f\") pod \"barbican-keystone-listener-5d8cb95448-4wwn9\" (UID: \"d4c74a5c-86a6-4bcf-b660-10a42c6a2be1\") " pod="openstack-kuttl-tests/barbican-keystone-listener-5d8cb95448-4wwn9" Mar 16 16:56:46 crc kubenswrapper[5120]: I0316 16:56:46.572260 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e956ba16-b745-4928-b574-a942ab68fd58-logs\") pod \"barbican-worker-7dcbb9bcc5-6bd78\" (UID: \"e956ba16-b745-4928-b574-a942ab68fd58\") " pod="openstack-kuttl-tests/barbican-worker-7dcbb9bcc5-6bd78" Mar 16 16:56:46 crc kubenswrapper[5120]: I0316 16:56:46.572298 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e956ba16-b745-4928-b574-a942ab68fd58-combined-ca-bundle\") pod \"barbican-worker-7dcbb9bcc5-6bd78\" (UID: \"e956ba16-b745-4928-b574-a942ab68fd58\") " pod="openstack-kuttl-tests/barbican-worker-7dcbb9bcc5-6bd78" Mar 16 16:56:46 crc kubenswrapper[5120]: I0316 16:56:46.572340 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d4c74a5c-86a6-4bcf-b660-10a42c6a2be1-config-data\") pod \"barbican-keystone-listener-5d8cb95448-4wwn9\" (UID: \"d4c74a5c-86a6-4bcf-b660-10a42c6a2be1\") " pod="openstack-kuttl-tests/barbican-keystone-listener-5d8cb95448-4wwn9" Mar 16 16:56:46 crc kubenswrapper[5120]: I0316 16:56:46.572400 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d4c74a5c-86a6-4bcf-b660-10a42c6a2be1-logs\") pod \"barbican-keystone-listener-5d8cb95448-4wwn9\" (UID: \"d4c74a5c-86a6-4bcf-b660-10a42c6a2be1\") " pod="openstack-kuttl-tests/barbican-keystone-listener-5d8cb95448-4wwn9" Mar 16 16:56:46 crc kubenswrapper[5120]: I0316 16:56:46.572463 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/e956ba16-b745-4928-b574-a942ab68fd58-config-data-custom\") pod \"barbican-worker-7dcbb9bcc5-6bd78\" (UID: \"e956ba16-b745-4928-b574-a942ab68fd58\") " pod="openstack-kuttl-tests/barbican-worker-7dcbb9bcc5-6bd78" Mar 16 16:56:46 crc kubenswrapper[5120]: I0316 16:56:46.572730 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5z58m\" (UniqueName: \"kubernetes.io/projected/e956ba16-b745-4928-b574-a942ab68fd58-kube-api-access-5z58m\") pod \"barbican-worker-7dcbb9bcc5-6bd78\" (UID: \"e956ba16-b745-4928-b574-a942ab68fd58\") " pod="openstack-kuttl-tests/barbican-worker-7dcbb9bcc5-6bd78" Mar 16 16:56:46 crc kubenswrapper[5120]: I0316 16:56:46.601469 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e956ba16-b745-4928-b574-a942ab68fd58-config-data\") pod \"barbican-worker-7dcbb9bcc5-6bd78\" (UID: \"e956ba16-b745-4928-b574-a942ab68fd58\") " pod="openstack-kuttl-tests/barbican-worker-7dcbb9bcc5-6bd78" Mar 16 16:56:46 crc kubenswrapper[5120]: I0316 16:56:46.701863 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-api-774bd9565b-8dqvz"] Mar 16 16:56:46 crc kubenswrapper[5120]: I0316 16:56:46.706888 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5z58m\" (UniqueName: \"kubernetes.io/projected/e956ba16-b745-4928-b574-a942ab68fd58-kube-api-access-5z58m\") pod \"barbican-worker-7dcbb9bcc5-6bd78\" (UID: \"e956ba16-b745-4928-b574-a942ab68fd58\") " pod="openstack-kuttl-tests/barbican-worker-7dcbb9bcc5-6bd78" Mar 16 16:56:46 crc kubenswrapper[5120]: I0316 16:56:46.706962 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e956ba16-b745-4928-b574-a942ab68fd58-config-data\") pod \"barbican-worker-7dcbb9bcc5-6bd78\" (UID: \"e956ba16-b745-4928-b574-a942ab68fd58\") " pod="openstack-kuttl-tests/barbican-worker-7dcbb9bcc5-6bd78" Mar 16 16:56:46 crc kubenswrapper[5120]: I0316 16:56:46.707002 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d4c74a5c-86a6-4bcf-b660-10a42c6a2be1-combined-ca-bundle\") pod \"barbican-keystone-listener-5d8cb95448-4wwn9\" (UID: \"d4c74a5c-86a6-4bcf-b660-10a42c6a2be1\") " pod="openstack-kuttl-tests/barbican-keystone-listener-5d8cb95448-4wwn9" Mar 16 16:56:46 crc kubenswrapper[5120]: I0316 16:56:46.707052 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/d4c74a5c-86a6-4bcf-b660-10a42c6a2be1-config-data-custom\") pod \"barbican-keystone-listener-5d8cb95448-4wwn9\" (UID: \"d4c74a5c-86a6-4bcf-b660-10a42c6a2be1\") " pod="openstack-kuttl-tests/barbican-keystone-listener-5d8cb95448-4wwn9" Mar 16 16:56:46 crc kubenswrapper[5120]: I0316 16:56:46.707082 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p5r6f\" (UniqueName: \"kubernetes.io/projected/d4c74a5c-86a6-4bcf-b660-10a42c6a2be1-kube-api-access-p5r6f\") pod \"barbican-keystone-listener-5d8cb95448-4wwn9\" (UID: \"d4c74a5c-86a6-4bcf-b660-10a42c6a2be1\") " pod="openstack-kuttl-tests/barbican-keystone-listener-5d8cb95448-4wwn9" Mar 16 16:56:46 crc kubenswrapper[5120]: I0316 16:56:46.707103 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e956ba16-b745-4928-b574-a942ab68fd58-logs\") pod \"barbican-worker-7dcbb9bcc5-6bd78\" (UID: \"e956ba16-b745-4928-b574-a942ab68fd58\") " pod="openstack-kuttl-tests/barbican-worker-7dcbb9bcc5-6bd78" Mar 16 16:56:46 crc kubenswrapper[5120]: I0316 16:56:46.707159 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e956ba16-b745-4928-b574-a942ab68fd58-combined-ca-bundle\") pod \"barbican-worker-7dcbb9bcc5-6bd78\" (UID: \"e956ba16-b745-4928-b574-a942ab68fd58\") " pod="openstack-kuttl-tests/barbican-worker-7dcbb9bcc5-6bd78" Mar 16 16:56:46 crc kubenswrapper[5120]: I0316 16:56:46.707221 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d4c74a5c-86a6-4bcf-b660-10a42c6a2be1-config-data\") pod \"barbican-keystone-listener-5d8cb95448-4wwn9\" (UID: \"d4c74a5c-86a6-4bcf-b660-10a42c6a2be1\") " pod="openstack-kuttl-tests/barbican-keystone-listener-5d8cb95448-4wwn9" Mar 16 16:56:46 crc kubenswrapper[5120]: I0316 16:56:46.707283 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d4c74a5c-86a6-4bcf-b660-10a42c6a2be1-logs\") pod \"barbican-keystone-listener-5d8cb95448-4wwn9\" (UID: \"d4c74a5c-86a6-4bcf-b660-10a42c6a2be1\") " pod="openstack-kuttl-tests/barbican-keystone-listener-5d8cb95448-4wwn9" Mar 16 16:56:46 crc kubenswrapper[5120]: I0316 16:56:46.707425 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/e956ba16-b745-4928-b574-a942ab68fd58-config-data-custom\") pod \"barbican-worker-7dcbb9bcc5-6bd78\" (UID: \"e956ba16-b745-4928-b574-a942ab68fd58\") " pod="openstack-kuttl-tests/barbican-worker-7dcbb9bcc5-6bd78" Mar 16 16:56:46 crc kubenswrapper[5120]: I0316 16:56:46.712815 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/e956ba16-b745-4928-b574-a942ab68fd58-config-data-custom\") pod \"barbican-worker-7dcbb9bcc5-6bd78\" (UID: \"e956ba16-b745-4928-b574-a942ab68fd58\") " pod="openstack-kuttl-tests/barbican-worker-7dcbb9bcc5-6bd78" Mar 16 16:56:46 crc kubenswrapper[5120]: I0316 16:56:46.715186 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d4c74a5c-86a6-4bcf-b660-10a42c6a2be1-logs\") pod \"barbican-keystone-listener-5d8cb95448-4wwn9\" (UID: \"d4c74a5c-86a6-4bcf-b660-10a42c6a2be1\") " pod="openstack-kuttl-tests/barbican-keystone-listener-5d8cb95448-4wwn9" Mar 16 16:56:46 crc kubenswrapper[5120]: I0316 16:56:46.715500 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e956ba16-b745-4928-b574-a942ab68fd58-logs\") pod \"barbican-worker-7dcbb9bcc5-6bd78\" (UID: \"e956ba16-b745-4928-b574-a942ab68fd58\") " pod="openstack-kuttl-tests/barbican-worker-7dcbb9bcc5-6bd78" Mar 16 16:56:46 crc kubenswrapper[5120]: I0316 16:56:46.716094 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e956ba16-b745-4928-b574-a942ab68fd58-combined-ca-bundle\") pod \"barbican-worker-7dcbb9bcc5-6bd78\" (UID: \"e956ba16-b745-4928-b574-a942ab68fd58\") " pod="openstack-kuttl-tests/barbican-worker-7dcbb9bcc5-6bd78" Mar 16 16:56:46 crc kubenswrapper[5120]: I0316 16:56:46.716645 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d4c74a5c-86a6-4bcf-b660-10a42c6a2be1-combined-ca-bundle\") pod \"barbican-keystone-listener-5d8cb95448-4wwn9\" (UID: \"d4c74a5c-86a6-4bcf-b660-10a42c6a2be1\") " pod="openstack-kuttl-tests/barbican-keystone-listener-5d8cb95448-4wwn9" Mar 16 16:56:46 crc kubenswrapper[5120]: I0316 16:56:46.723054 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e956ba16-b745-4928-b574-a942ab68fd58-config-data\") pod \"barbican-worker-7dcbb9bcc5-6bd78\" (UID: \"e956ba16-b745-4928-b574-a942ab68fd58\") " pod="openstack-kuttl-tests/barbican-worker-7dcbb9bcc5-6bd78" Mar 16 16:56:46 crc kubenswrapper[5120]: I0316 16:56:46.735368 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5z58m\" (UniqueName: \"kubernetes.io/projected/e956ba16-b745-4928-b574-a942ab68fd58-kube-api-access-5z58m\") pod \"barbican-worker-7dcbb9bcc5-6bd78\" (UID: \"e956ba16-b745-4928-b574-a942ab68fd58\") " pod="openstack-kuttl-tests/barbican-worker-7dcbb9bcc5-6bd78" Mar 16 16:56:46 crc kubenswrapper[5120]: I0316 16:56:46.742776 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-774bd9565b-8dqvz"] Mar 16 16:56:46 crc kubenswrapper[5120]: I0316 16:56:46.743248 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-774bd9565b-8dqvz" Mar 16 16:56:46 crc kubenswrapper[5120]: I0316 16:56:46.746511 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5r6f\" (UniqueName: \"kubernetes.io/projected/d4c74a5c-86a6-4bcf-b660-10a42c6a2be1-kube-api-access-p5r6f\") pod \"barbican-keystone-listener-5d8cb95448-4wwn9\" (UID: \"d4c74a5c-86a6-4bcf-b660-10a42c6a2be1\") " pod="openstack-kuttl-tests/barbican-keystone-listener-5d8cb95448-4wwn9" Mar 16 16:56:46 crc kubenswrapper[5120]: I0316 16:56:46.778134 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d4c74a5c-86a6-4bcf-b660-10a42c6a2be1-config-data\") pod \"barbican-keystone-listener-5d8cb95448-4wwn9\" (UID: \"d4c74a5c-86a6-4bcf-b660-10a42c6a2be1\") " pod="openstack-kuttl-tests/barbican-keystone-listener-5d8cb95448-4wwn9" Mar 16 16:56:46 crc kubenswrapper[5120]: I0316 16:56:46.790361 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:56:46 crc kubenswrapper[5120]: I0316 16:56:46.790569 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-v822j_ac55471d-4e42-475f-a082-50f611571482/kube-multus/0.log" Mar 16 16:56:46 crc kubenswrapper[5120]: I0316 16:56:46.802551 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-crc_9f0bc7fcb0822a2c13eb2d22cd8c0641/kube-controller-manager/0.log" Mar 16 16:56:46 crc kubenswrapper[5120]: I0316 16:56:46.809445 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/92194734-7636-4b3f-a75a-2343b3d58c71-public-tls-certs\") pod \"barbican-api-774bd9565b-8dqvz\" (UID: \"92194734-7636-4b3f-a75a-2343b3d58c71\") " pod="openstack-kuttl-tests/barbican-api-774bd9565b-8dqvz" Mar 16 16:56:46 crc kubenswrapper[5120]: I0316 16:56:46.809632 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/92194734-7636-4b3f-a75a-2343b3d58c71-config-data\") pod \"barbican-api-774bd9565b-8dqvz\" (UID: \"92194734-7636-4b3f-a75a-2343b3d58c71\") " pod="openstack-kuttl-tests/barbican-api-774bd9565b-8dqvz" Mar 16 16:56:46 crc kubenswrapper[5120]: I0316 16:56:46.809905 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/92194734-7636-4b3f-a75a-2343b3d58c71-logs\") pod \"barbican-api-774bd9565b-8dqvz\" (UID: \"92194734-7636-4b3f-a75a-2343b3d58c71\") " pod="openstack-kuttl-tests/barbican-api-774bd9565b-8dqvz" Mar 16 16:56:46 crc kubenswrapper[5120]: I0316 16:56:46.810511 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/92194734-7636-4b3f-a75a-2343b3d58c71-combined-ca-bundle\") pod \"barbican-api-774bd9565b-8dqvz\" (UID: \"92194734-7636-4b3f-a75a-2343b3d58c71\") " pod="openstack-kuttl-tests/barbican-api-774bd9565b-8dqvz" Mar 16 16:56:46 crc kubenswrapper[5120]: I0316 16:56:46.810600 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mv7v4\" (UniqueName: \"kubernetes.io/projected/92194734-7636-4b3f-a75a-2343b3d58c71-kube-api-access-mv7v4\") pod \"barbican-api-774bd9565b-8dqvz\" (UID: \"92194734-7636-4b3f-a75a-2343b3d58c71\") " pod="openstack-kuttl-tests/barbican-api-774bd9565b-8dqvz" Mar 16 16:56:46 crc kubenswrapper[5120]: I0316 16:56:46.810621 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/92194734-7636-4b3f-a75a-2343b3d58c71-config-data-custom\") pod \"barbican-api-774bd9565b-8dqvz\" (UID: \"92194734-7636-4b3f-a75a-2343b3d58c71\") " pod="openstack-kuttl-tests/barbican-api-774bd9565b-8dqvz" Mar 16 16:56:46 crc kubenswrapper[5120]: I0316 16:56:46.810860 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/92194734-7636-4b3f-a75a-2343b3d58c71-internal-tls-certs\") pod \"barbican-api-774bd9565b-8dqvz\" (UID: \"92194734-7636-4b3f-a75a-2343b3d58c71\") " pod="openstack-kuttl-tests/barbican-api-774bd9565b-8dqvz" Mar 16 16:56:46 crc kubenswrapper[5120]: I0316 16:56:46.825731 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:56:46 crc kubenswrapper[5120]: I0316 16:56:46.830885 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/d4c74a5c-86a6-4bcf-b660-10a42c6a2be1-config-data-custom\") pod \"barbican-keystone-listener-5d8cb95448-4wwn9\" (UID: \"d4c74a5c-86a6-4bcf-b660-10a42c6a2be1\") " pod="openstack-kuttl-tests/barbican-keystone-listener-5d8cb95448-4wwn9" Mar 16 16:56:46 crc kubenswrapper[5120]: I0316 16:56:46.840075 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-5d8cb95448-4wwn9" Mar 16 16:56:46 crc kubenswrapper[5120]: I0316 16:56:46.844930 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:56:46 crc kubenswrapper[5120]: I0316 16:56:46.852449 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:56:46 crc kubenswrapper[5120]: I0316 16:56:46.855713 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-cinder-public-svc\"" Mar 16 16:56:46 crc kubenswrapper[5120]: I0316 16:56:46.856326 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-cinder-internal-svc\"" Mar 16 16:56:46 crc kubenswrapper[5120]: I0316 16:56:46.856775 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-api-config-data\"" Mar 16 16:56:46 crc kubenswrapper[5120]: I0316 16:56:46.857370 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-7dcbb9bcc5-6bd78" Mar 16 16:56:46 crc kubenswrapper[5120]: I0316 16:56:46.870383 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:56:46 crc kubenswrapper[5120]: I0316 16:56:46.918025 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/8ac9683b-983c-44fd-a877-d2ae1cc5ae93-etc-machine-id\") pod \"cinder-api-0\" (UID: \"8ac9683b-983c-44fd-a877-d2ae1cc5ae93\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:56:46 crc kubenswrapper[5120]: I0316 16:56:46.918381 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8ac9683b-983c-44fd-a877-d2ae1cc5ae93-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"8ac9683b-983c-44fd-a877-d2ae1cc5ae93\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:56:46 crc kubenswrapper[5120]: I0316 16:56:46.918581 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8ac9683b-983c-44fd-a877-d2ae1cc5ae93-config-data\") pod \"cinder-api-0\" (UID: \"8ac9683b-983c-44fd-a877-d2ae1cc5ae93\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:56:46 crc kubenswrapper[5120]: I0316 16:56:46.918863 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/8ac9683b-983c-44fd-a877-d2ae1cc5ae93-public-tls-certs\") pod \"cinder-api-0\" (UID: \"8ac9683b-983c-44fd-a877-d2ae1cc5ae93\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:56:46 crc kubenswrapper[5120]: I0316 16:56:46.919042 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/92194734-7636-4b3f-a75a-2343b3d58c71-public-tls-certs\") pod \"barbican-api-774bd9565b-8dqvz\" (UID: \"92194734-7636-4b3f-a75a-2343b3d58c71\") " pod="openstack-kuttl-tests/barbican-api-774bd9565b-8dqvz" Mar 16 16:56:46 crc kubenswrapper[5120]: I0316 16:56:46.919899 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/92194734-7636-4b3f-a75a-2343b3d58c71-config-data\") pod \"barbican-api-774bd9565b-8dqvz\" (UID: \"92194734-7636-4b3f-a75a-2343b3d58c71\") " pod="openstack-kuttl-tests/barbican-api-774bd9565b-8dqvz" Mar 16 16:56:46 crc kubenswrapper[5120]: I0316 16:56:46.922522 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8ac9683b-983c-44fd-a877-d2ae1cc5ae93-logs\") pod \"cinder-api-0\" (UID: \"8ac9683b-983c-44fd-a877-d2ae1cc5ae93\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:56:46 crc kubenswrapper[5120]: I0316 16:56:46.923443 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/8ac9683b-983c-44fd-a877-d2ae1cc5ae93-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"8ac9683b-983c-44fd-a877-d2ae1cc5ae93\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:56:46 crc kubenswrapper[5120]: I0316 16:56:46.923652 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/92194734-7636-4b3f-a75a-2343b3d58c71-logs\") pod \"barbican-api-774bd9565b-8dqvz\" (UID: \"92194734-7636-4b3f-a75a-2343b3d58c71\") " pod="openstack-kuttl-tests/barbican-api-774bd9565b-8dqvz" Mar 16 16:56:46 crc kubenswrapper[5120]: I0316 16:56:46.923830 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/92194734-7636-4b3f-a75a-2343b3d58c71-combined-ca-bundle\") pod \"barbican-api-774bd9565b-8dqvz\" (UID: \"92194734-7636-4b3f-a75a-2343b3d58c71\") " pod="openstack-kuttl-tests/barbican-api-774bd9565b-8dqvz" Mar 16 16:56:46 crc kubenswrapper[5120]: I0316 16:56:46.924039 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mv7v4\" (UniqueName: \"kubernetes.io/projected/92194734-7636-4b3f-a75a-2343b3d58c71-kube-api-access-mv7v4\") pod \"barbican-api-774bd9565b-8dqvz\" (UID: \"92194734-7636-4b3f-a75a-2343b3d58c71\") " pod="openstack-kuttl-tests/barbican-api-774bd9565b-8dqvz" Mar 16 16:56:46 crc kubenswrapper[5120]: I0316 16:56:46.924206 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/92194734-7636-4b3f-a75a-2343b3d58c71-config-data-custom\") pod \"barbican-api-774bd9565b-8dqvz\" (UID: \"92194734-7636-4b3f-a75a-2343b3d58c71\") " pod="openstack-kuttl-tests/barbican-api-774bd9565b-8dqvz" Mar 16 16:56:46 crc kubenswrapper[5120]: I0316 16:56:46.924405 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8ac9683b-983c-44fd-a877-d2ae1cc5ae93-scripts\") pod \"cinder-api-0\" (UID: \"8ac9683b-983c-44fd-a877-d2ae1cc5ae93\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:56:46 crc kubenswrapper[5120]: I0316 16:56:46.924574 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4cx6\" (UniqueName: \"kubernetes.io/projected/8ac9683b-983c-44fd-a877-d2ae1cc5ae93-kube-api-access-t4cx6\") pod \"cinder-api-0\" (UID: \"8ac9683b-983c-44fd-a877-d2ae1cc5ae93\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:56:46 crc kubenswrapper[5120]: I0316 16:56:46.924741 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/8ac9683b-983c-44fd-a877-d2ae1cc5ae93-config-data-custom\") pod \"cinder-api-0\" (UID: \"8ac9683b-983c-44fd-a877-d2ae1cc5ae93\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:56:46 crc kubenswrapper[5120]: I0316 16:56:46.925009 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/92194734-7636-4b3f-a75a-2343b3d58c71-internal-tls-certs\") pod \"barbican-api-774bd9565b-8dqvz\" (UID: \"92194734-7636-4b3f-a75a-2343b3d58c71\") " pod="openstack-kuttl-tests/barbican-api-774bd9565b-8dqvz" Mar 16 16:56:46 crc kubenswrapper[5120]: I0316 16:56:46.926660 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/92194734-7636-4b3f-a75a-2343b3d58c71-public-tls-certs\") pod \"barbican-api-774bd9565b-8dqvz\" (UID: \"92194734-7636-4b3f-a75a-2343b3d58c71\") " pod="openstack-kuttl-tests/barbican-api-774bd9565b-8dqvz" Mar 16 16:56:46 crc kubenswrapper[5120]: I0316 16:56:46.927790 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/92194734-7636-4b3f-a75a-2343b3d58c71-logs\") pod \"barbican-api-774bd9565b-8dqvz\" (UID: \"92194734-7636-4b3f-a75a-2343b3d58c71\") " pod="openstack-kuttl-tests/barbican-api-774bd9565b-8dqvz" Mar 16 16:56:46 crc kubenswrapper[5120]: I0316 16:56:46.932342 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/92194734-7636-4b3f-a75a-2343b3d58c71-config-data-custom\") pod \"barbican-api-774bd9565b-8dqvz\" (UID: \"92194734-7636-4b3f-a75a-2343b3d58c71\") " pod="openstack-kuttl-tests/barbican-api-774bd9565b-8dqvz" Mar 16 16:56:46 crc kubenswrapper[5120]: I0316 16:56:46.936251 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/92194734-7636-4b3f-a75a-2343b3d58c71-config-data\") pod \"barbican-api-774bd9565b-8dqvz\" (UID: \"92194734-7636-4b3f-a75a-2343b3d58c71\") " pod="openstack-kuttl-tests/barbican-api-774bd9565b-8dqvz" Mar 16 16:56:46 crc kubenswrapper[5120]: I0316 16:56:46.942332 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/92194734-7636-4b3f-a75a-2343b3d58c71-combined-ca-bundle\") pod \"barbican-api-774bd9565b-8dqvz\" (UID: \"92194734-7636-4b3f-a75a-2343b3d58c71\") " pod="openstack-kuttl-tests/barbican-api-774bd9565b-8dqvz" Mar 16 16:56:46 crc kubenswrapper[5120]: I0316 16:56:46.952341 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/92194734-7636-4b3f-a75a-2343b3d58c71-internal-tls-certs\") pod \"barbican-api-774bd9565b-8dqvz\" (UID: \"92194734-7636-4b3f-a75a-2343b3d58c71\") " pod="openstack-kuttl-tests/barbican-api-774bd9565b-8dqvz" Mar 16 16:56:46 crc kubenswrapper[5120]: I0316 16:56:46.952471 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mv7v4\" (UniqueName: \"kubernetes.io/projected/92194734-7636-4b3f-a75a-2343b3d58c71-kube-api-access-mv7v4\") pod \"barbican-api-774bd9565b-8dqvz\" (UID: \"92194734-7636-4b3f-a75a-2343b3d58c71\") " pod="openstack-kuttl-tests/barbican-api-774bd9565b-8dqvz" Mar 16 16:56:47 crc kubenswrapper[5120]: I0316 16:56:47.027923 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8ac9683b-983c-44fd-a877-d2ae1cc5ae93-logs\") pod \"cinder-api-0\" (UID: \"8ac9683b-983c-44fd-a877-d2ae1cc5ae93\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:56:47 crc kubenswrapper[5120]: I0316 16:56:47.028021 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/8ac9683b-983c-44fd-a877-d2ae1cc5ae93-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"8ac9683b-983c-44fd-a877-d2ae1cc5ae93\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:56:47 crc kubenswrapper[5120]: I0316 16:56:47.028185 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8ac9683b-983c-44fd-a877-d2ae1cc5ae93-scripts\") pod \"cinder-api-0\" (UID: \"8ac9683b-983c-44fd-a877-d2ae1cc5ae93\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:56:47 crc kubenswrapper[5120]: I0316 16:56:47.028222 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t4cx6\" (UniqueName: \"kubernetes.io/projected/8ac9683b-983c-44fd-a877-d2ae1cc5ae93-kube-api-access-t4cx6\") pod \"cinder-api-0\" (UID: \"8ac9683b-983c-44fd-a877-d2ae1cc5ae93\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:56:47 crc kubenswrapper[5120]: I0316 16:56:47.028260 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/8ac9683b-983c-44fd-a877-d2ae1cc5ae93-config-data-custom\") pod \"cinder-api-0\" (UID: \"8ac9683b-983c-44fd-a877-d2ae1cc5ae93\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:56:47 crc kubenswrapper[5120]: I0316 16:56:47.028328 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/8ac9683b-983c-44fd-a877-d2ae1cc5ae93-etc-machine-id\") pod \"cinder-api-0\" (UID: \"8ac9683b-983c-44fd-a877-d2ae1cc5ae93\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:56:47 crc kubenswrapper[5120]: I0316 16:56:47.028357 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8ac9683b-983c-44fd-a877-d2ae1cc5ae93-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"8ac9683b-983c-44fd-a877-d2ae1cc5ae93\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:56:47 crc kubenswrapper[5120]: I0316 16:56:47.028393 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8ac9683b-983c-44fd-a877-d2ae1cc5ae93-config-data\") pod \"cinder-api-0\" (UID: \"8ac9683b-983c-44fd-a877-d2ae1cc5ae93\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:56:47 crc kubenswrapper[5120]: I0316 16:56:47.028429 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/8ac9683b-983c-44fd-a877-d2ae1cc5ae93-public-tls-certs\") pod \"cinder-api-0\" (UID: \"8ac9683b-983c-44fd-a877-d2ae1cc5ae93\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:56:47 crc kubenswrapper[5120]: I0316 16:56:47.028668 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/8ac9683b-983c-44fd-a877-d2ae1cc5ae93-etc-machine-id\") pod \"cinder-api-0\" (UID: \"8ac9683b-983c-44fd-a877-d2ae1cc5ae93\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:56:47 crc kubenswrapper[5120]: I0316 16:56:47.033281 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/8ac9683b-983c-44fd-a877-d2ae1cc5ae93-config-data-custom\") pod \"cinder-api-0\" (UID: \"8ac9683b-983c-44fd-a877-d2ae1cc5ae93\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:56:47 crc kubenswrapper[5120]: I0316 16:56:47.034876 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8ac9683b-983c-44fd-a877-d2ae1cc5ae93-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"8ac9683b-983c-44fd-a877-d2ae1cc5ae93\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:56:47 crc kubenswrapper[5120]: I0316 16:56:47.035887 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8ac9683b-983c-44fd-a877-d2ae1cc5ae93-logs\") pod \"cinder-api-0\" (UID: \"8ac9683b-983c-44fd-a877-d2ae1cc5ae93\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:56:47 crc kubenswrapper[5120]: I0316 16:56:47.036380 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/8ac9683b-983c-44fd-a877-d2ae1cc5ae93-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"8ac9683b-983c-44fd-a877-d2ae1cc5ae93\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:56:47 crc kubenswrapper[5120]: I0316 16:56:47.043489 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/8ac9683b-983c-44fd-a877-d2ae1cc5ae93-public-tls-certs\") pod \"cinder-api-0\" (UID: \"8ac9683b-983c-44fd-a877-d2ae1cc5ae93\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:56:47 crc kubenswrapper[5120]: I0316 16:56:47.043637 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8ac9683b-983c-44fd-a877-d2ae1cc5ae93-scripts\") pod \"cinder-api-0\" (UID: \"8ac9683b-983c-44fd-a877-d2ae1cc5ae93\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:56:47 crc kubenswrapper[5120]: I0316 16:56:47.044046 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8ac9683b-983c-44fd-a877-d2ae1cc5ae93-config-data\") pod \"cinder-api-0\" (UID: \"8ac9683b-983c-44fd-a877-d2ae1cc5ae93\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:56:47 crc kubenswrapper[5120]: I0316 16:56:47.048372 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4cx6\" (UniqueName: \"kubernetes.io/projected/8ac9683b-983c-44fd-a877-d2ae1cc5ae93-kube-api-access-t4cx6\") pod \"cinder-api-0\" (UID: \"8ac9683b-983c-44fd-a877-d2ae1cc5ae93\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:56:47 crc kubenswrapper[5120]: I0316 16:56:47.195294 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-774bd9565b-8dqvz" Mar 16 16:56:47 crc kubenswrapper[5120]: I0316 16:56:47.208287 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:56:47 crc kubenswrapper[5120]: I0316 16:56:47.425181 5120 generic.go:358] "Generic (PLEG): container finished" podID="2cf93ef3-c7e7-45dd-9639-e40bce42a900" containerID="29615c6b15ac113f99ca1bd009163b4eb6330a8a13133b8006178be01abb44bb" exitCode=143 Mar 16 16:56:47 crc kubenswrapper[5120]: I0316 16:56:47.425254 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-856c7c8dd4-vsqd7" event={"ID":"2cf93ef3-c7e7-45dd-9639-e40bce42a900","Type":"ContainerDied","Data":"29615c6b15ac113f99ca1bd009163b4eb6330a8a13133b8006178be01abb44bb"} Mar 16 16:56:47 crc kubenswrapper[5120]: I0316 16:56:47.429864 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"d0a971ac-2056-4ef1-abc7-8592e58f8114","Type":"ContainerStarted","Data":"de1bdbf465858d6b2216989617f3d1ba223727e4a7c0a9007afc6c332456ebbc"} Mar 16 16:56:47 crc kubenswrapper[5120]: I0316 16:56:47.511703 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-5d8cb95448-4wwn9"] Mar 16 16:56:47 crc kubenswrapper[5120]: I0316 16:56:47.624843 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-7dcbb9bcc5-6bd78"] Mar 16 16:56:47 crc kubenswrapper[5120]: I0316 16:56:47.844303 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-774bd9565b-8dqvz"] Mar 16 16:56:48 crc kubenswrapper[5120]: I0316 16:56:48.075467 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 16:56:48 crc kubenswrapper[5120]: I0316 16:56:48.454750 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-774bd9565b-8dqvz" event={"ID":"92194734-7636-4b3f-a75a-2343b3d58c71","Type":"ContainerStarted","Data":"684dcbf0d0e2d99b5464c64c981678afc1a2620d2ac3e69244d731b2c452354a"} Mar 16 16:56:48 crc kubenswrapper[5120]: I0316 16:56:48.455127 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-774bd9565b-8dqvz" event={"ID":"92194734-7636-4b3f-a75a-2343b3d58c71","Type":"ContainerStarted","Data":"6b72fa070d2d8ff0d23f0d6b17e72459acdad3050db6aaf053383ffe5a1b32ff"} Mar 16 16:56:48 crc kubenswrapper[5120]: I0316 16:56:48.461243 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"8ac9683b-983c-44fd-a877-d2ae1cc5ae93","Type":"ContainerStarted","Data":"9f848221a21d45f1f6bac6dd3682835f6c9ce1a9dfbc2eb7d0b80883a0b79d94"} Mar 16 16:56:48 crc kubenswrapper[5120]: I0316 16:56:48.471220 5120 generic.go:358] "Generic (PLEG): container finished" podID="2cc34ac9-c7e0-4a0b-9984-a571c4f1c80d" containerID="3c07d8e4cbd4126b42dc13d408ca198bcbd6f0c92b3ecb09696c4f6a41f38f11" exitCode=0 Mar 16 16:56:48 crc kubenswrapper[5120]: I0316 16:56:48.471393 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-2nkb5" event={"ID":"2cc34ac9-c7e0-4a0b-9984-a571c4f1c80d","Type":"ContainerDied","Data":"3c07d8e4cbd4126b42dc13d408ca198bcbd6f0c92b3ecb09696c4f6a41f38f11"} Mar 16 16:56:48 crc kubenswrapper[5120]: I0316 16:56:48.477122 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-5d8cb95448-4wwn9" event={"ID":"d4c74a5c-86a6-4bcf-b660-10a42c6a2be1","Type":"ContainerStarted","Data":"6de8bdd5fb2544346e3cbeb0ae90bbd7bd95389cd023b6a97824529be2e5589f"} Mar 16 16:56:48 crc kubenswrapper[5120]: I0316 16:56:48.477185 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-5d8cb95448-4wwn9" event={"ID":"d4c74a5c-86a6-4bcf-b660-10a42c6a2be1","Type":"ContainerStarted","Data":"98a6bb7bcbdb1c9b868828021b7f938892232a44d9a2e07cc46cefbe5ca3da85"} Mar 16 16:56:48 crc kubenswrapper[5120]: I0316 16:56:48.477197 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-5d8cb95448-4wwn9" event={"ID":"d4c74a5c-86a6-4bcf-b660-10a42c6a2be1","Type":"ContainerStarted","Data":"2710f4dfdcbdb771a876100486788487345062da688ddbf35a48c4e196b1e95a"} Mar 16 16:56:48 crc kubenswrapper[5120]: I0316 16:56:48.481331 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"d0a971ac-2056-4ef1-abc7-8592e58f8114","Type":"ContainerStarted","Data":"130a994cbf3ac7c6b65be1696e5aad19604e92374f087c17b37cee6ddd1190dc"} Mar 16 16:56:48 crc kubenswrapper[5120]: I0316 16:56:48.493711 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-7dcbb9bcc5-6bd78" event={"ID":"e956ba16-b745-4928-b574-a942ab68fd58","Type":"ContainerStarted","Data":"7cedd4f074f018190db9d89f7269449dd1c5b8a2dd44584e7e8fefcf284b2d18"} Mar 16 16:56:48 crc kubenswrapper[5120]: I0316 16:56:48.493780 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-7dcbb9bcc5-6bd78" event={"ID":"e956ba16-b745-4928-b574-a942ab68fd58","Type":"ContainerStarted","Data":"190c300742841bbd5e9c6e0af99eef15ed79cfe6ad0596b1173acce50cbf6430"} Mar 16 16:56:48 crc kubenswrapper[5120]: I0316 16:56:48.493795 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-7dcbb9bcc5-6bd78" event={"ID":"e956ba16-b745-4928-b574-a942ab68fd58","Type":"ContainerStarted","Data":"98d03f3990c308ab154fb822cfcf79d1654a2f6cee0bd521075d48c26af32d8d"} Mar 16 16:56:48 crc kubenswrapper[5120]: I0316 16:56:48.513410 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-keystone-listener-5d8cb95448-4wwn9" podStartSLOduration=2.513389492 podStartE2EDuration="2.513389492s" podCreationTimestamp="2026-03-16 16:56:46 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:56:48.51110218 +0000 UTC m=+5110.665033837" watchObservedRunningTime="2026-03-16 16:56:48.513389492 +0000 UTC m=+5110.667321149" Mar 16 16:56:48 crc kubenswrapper[5120]: I0316 16:56:48.534388 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-worker-7dcbb9bcc5-6bd78" podStartSLOduration=2.534346865 podStartE2EDuration="2.534346865s" podCreationTimestamp="2026-03-16 16:56:46 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:56:48.528538757 +0000 UTC m=+5110.682470414" watchObservedRunningTime="2026-03-16 16:56:48.534346865 +0000 UTC m=+5110.688278522" Mar 16 16:56:48 crc kubenswrapper[5120]: I0316 16:56:48.567167 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-78774f5dfb-bzqjl"] Mar 16 16:56:48 crc kubenswrapper[5120]: I0316 16:56:48.571221 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-78774f5dfb-bzqjl" podUID="5cd891e1-77ba-42cb-ad3f-6d37f1782101" containerName="barbican-keystone-listener-log" containerID="cri-o://09cfdb14369a3d8b0e09908d23e65e9b0ccb85b37183e947137f6faf3cca1ab8" gracePeriod=30 Mar 16 16:56:48 crc kubenswrapper[5120]: I0316 16:56:48.571865 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-78774f5dfb-bzqjl" podUID="5cd891e1-77ba-42cb-ad3f-6d37f1782101" containerName="barbican-keystone-listener" containerID="cri-o://1c0532af6887b54949e7a3d1f4b7df5559fe73378c2e57f4d96e8714c36b3ce5" gracePeriod=30 Mar 16 16:56:48 crc kubenswrapper[5120]: I0316 16:56:48.583949 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-6fc74764d9-qrphb"] Mar 16 16:56:48 crc kubenswrapper[5120]: I0316 16:56:48.584235 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-6fc74764d9-qrphb" podUID="e23fbd51-1180-4d93-9937-9c89abacf10b" containerName="barbican-worker-log" containerID="cri-o://9a7b06878e2ba8775823c827847ca1ac79df41547ebfcef15cedd04c3195885c" gracePeriod=30 Mar 16 16:56:48 crc kubenswrapper[5120]: I0316 16:56:48.584682 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-6fc74764d9-qrphb" podUID="e23fbd51-1180-4d93-9937-9c89abacf10b" containerName="barbican-worker" containerID="cri-o://405d808b1ecf10f9d0e6b8c571f57ba0ec934190882191e9b3e0c60956202e92" gracePeriod=30 Mar 16 16:56:48 crc kubenswrapper[5120]: I0316 16:56:48.680639 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed94831a-9c6a-4d66-8246-6b3613972756" path="/var/lib/kubelet/pods/ed94831a-9c6a-4d66-8246-6b3613972756/volumes" Mar 16 16:56:49 crc kubenswrapper[5120]: I0316 16:56:49.528358 5120 generic.go:358] "Generic (PLEG): container finished" podID="e23fbd51-1180-4d93-9937-9c89abacf10b" containerID="9a7b06878e2ba8775823c827847ca1ac79df41547ebfcef15cedd04c3195885c" exitCode=143 Mar 16 16:56:49 crc kubenswrapper[5120]: I0316 16:56:49.528708 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-6fc74764d9-qrphb" event={"ID":"e23fbd51-1180-4d93-9937-9c89abacf10b","Type":"ContainerDied","Data":"9a7b06878e2ba8775823c827847ca1ac79df41547ebfcef15cedd04c3195885c"} Mar 16 16:56:49 crc kubenswrapper[5120]: I0316 16:56:49.534875 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-774bd9565b-8dqvz" event={"ID":"92194734-7636-4b3f-a75a-2343b3d58c71","Type":"ContainerStarted","Data":"0bc3676ee6500c4bb61bbac4704a4548780da105ebd8c4dee57f19a3e5d2abe2"} Mar 16 16:56:49 crc kubenswrapper[5120]: I0316 16:56:49.536238 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-774bd9565b-8dqvz" Mar 16 16:56:49 crc kubenswrapper[5120]: I0316 16:56:49.536270 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-774bd9565b-8dqvz" Mar 16 16:56:49 crc kubenswrapper[5120]: I0316 16:56:49.539464 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"8ac9683b-983c-44fd-a877-d2ae1cc5ae93","Type":"ContainerStarted","Data":"6a153038229a3e0ad4ede09650ddb823d2b4cb2b19320b55217a3a9dab56c573"} Mar 16 16:56:49 crc kubenswrapper[5120]: I0316 16:56:49.543853 5120 generic.go:358] "Generic (PLEG): container finished" podID="5cd891e1-77ba-42cb-ad3f-6d37f1782101" containerID="09cfdb14369a3d8b0e09908d23e65e9b0ccb85b37183e947137f6faf3cca1ab8" exitCode=143 Mar 16 16:56:49 crc kubenswrapper[5120]: I0316 16:56:49.544890 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-78774f5dfb-bzqjl" event={"ID":"5cd891e1-77ba-42cb-ad3f-6d37f1782101","Type":"ContainerDied","Data":"09cfdb14369a3d8b0e09908d23e65e9b0ccb85b37183e947137f6faf3cca1ab8"} Mar 16 16:56:49 crc kubenswrapper[5120]: I0316 16:56:49.568842 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-api-774bd9565b-8dqvz" podStartSLOduration=3.56882392 podStartE2EDuration="3.56882392s" podCreationTimestamp="2026-03-16 16:56:46 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:56:49.553088959 +0000 UTC m=+5111.707020606" watchObservedRunningTime="2026-03-16 16:56:49.56882392 +0000 UTC m=+5111.722755577" Mar 16 16:56:49 crc kubenswrapper[5120]: I0316 16:56:49.706552 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:56:49 crc kubenswrapper[5120]: I0316 16:56:49.786787 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:56:50 crc kubenswrapper[5120]: I0316 16:56:50.019101 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-2nkb5" Mar 16 16:56:50 crc kubenswrapper[5120]: I0316 16:56:50.067357 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2cc34ac9-c7e0-4a0b-9984-a571c4f1c80d-config\") pod \"2cc34ac9-c7e0-4a0b-9984-a571c4f1c80d\" (UID: \"2cc34ac9-c7e0-4a0b-9984-a571c4f1c80d\") " Mar 16 16:56:50 crc kubenswrapper[5120]: I0316 16:56:50.067822 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-clsxd\" (UniqueName: \"kubernetes.io/projected/2cc34ac9-c7e0-4a0b-9984-a571c4f1c80d-kube-api-access-clsxd\") pod \"2cc34ac9-c7e0-4a0b-9984-a571c4f1c80d\" (UID: \"2cc34ac9-c7e0-4a0b-9984-a571c4f1c80d\") " Mar 16 16:56:50 crc kubenswrapper[5120]: I0316 16:56:50.067847 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2cc34ac9-c7e0-4a0b-9984-a571c4f1c80d-combined-ca-bundle\") pod \"2cc34ac9-c7e0-4a0b-9984-a571c4f1c80d\" (UID: \"2cc34ac9-c7e0-4a0b-9984-a571c4f1c80d\") " Mar 16 16:56:50 crc kubenswrapper[5120]: I0316 16:56:50.079144 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2cc34ac9-c7e0-4a0b-9984-a571c4f1c80d-kube-api-access-clsxd" (OuterVolumeSpecName: "kube-api-access-clsxd") pod "2cc34ac9-c7e0-4a0b-9984-a571c4f1c80d" (UID: "2cc34ac9-c7e0-4a0b-9984-a571c4f1c80d"). InnerVolumeSpecName "kube-api-access-clsxd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:56:50 crc kubenswrapper[5120]: I0316 16:56:50.102929 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2cc34ac9-c7e0-4a0b-9984-a571c4f1c80d-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "2cc34ac9-c7e0-4a0b-9984-a571c4f1c80d" (UID: "2cc34ac9-c7e0-4a0b-9984-a571c4f1c80d"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:56:50 crc kubenswrapper[5120]: I0316 16:56:50.114686 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2cc34ac9-c7e0-4a0b-9984-a571c4f1c80d-config" (OuterVolumeSpecName: "config") pod "2cc34ac9-c7e0-4a0b-9984-a571c4f1c80d" (UID: "2cc34ac9-c7e0-4a0b-9984-a571c4f1c80d"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:56:50 crc kubenswrapper[5120]: I0316 16:56:50.171204 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-clsxd\" (UniqueName: \"kubernetes.io/projected/2cc34ac9-c7e0-4a0b-9984-a571c4f1c80d-kube-api-access-clsxd\") on node \"crc\" DevicePath \"\"" Mar 16 16:56:50 crc kubenswrapper[5120]: I0316 16:56:50.171248 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2cc34ac9-c7e0-4a0b-9984-a571c4f1c80d-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:56:50 crc kubenswrapper[5120]: I0316 16:56:50.171257 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/2cc34ac9-c7e0-4a0b-9984-a571c4f1c80d-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:56:50 crc kubenswrapper[5120]: I0316 16:56:50.563422 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"8ac9683b-983c-44fd-a877-d2ae1cc5ae93","Type":"ContainerStarted","Data":"b06817a6b7e865eb89cf033595c6aa097eb8d2fe72c72a808c6bea7f30f1fbec"} Mar 16 16:56:50 crc kubenswrapper[5120]: I0316 16:56:50.563559 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:56:50 crc kubenswrapper[5120]: I0316 16:56:50.566204 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-2nkb5" Mar 16 16:56:50 crc kubenswrapper[5120]: I0316 16:56:50.566222 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-2nkb5" event={"ID":"2cc34ac9-c7e0-4a0b-9984-a571c4f1c80d","Type":"ContainerDied","Data":"ff1e16f595d111297d4cc9826cf0b94d9da5387c0384aea7cd38d5049f20dee5"} Mar 16 16:56:50 crc kubenswrapper[5120]: I0316 16:56:50.566266 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ff1e16f595d111297d4cc9826cf0b94d9da5387c0384aea7cd38d5049f20dee5" Mar 16 16:56:50 crc kubenswrapper[5120]: I0316 16:56:50.571635 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="3264bd71-ad28-4b8e-a7e7-91508c6a6f25" containerName="cinder-scheduler" containerID="cri-o://b583abe5db9352e6c81bea08f9819a58ef3fc82fe7a4428c2aaef72b3a4710b4" gracePeriod=30 Mar 16 16:56:50 crc kubenswrapper[5120]: I0316 16:56:50.571772 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"d0a971ac-2056-4ef1-abc7-8592e58f8114","Type":"ContainerStarted","Data":"f30d4a1f3259510b9eb8c318c8b222d3d03ddf9cf7ad7d4ed5dee9dc18b20854"} Mar 16 16:56:50 crc kubenswrapper[5120]: I0316 16:56:50.571838 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="3264bd71-ad28-4b8e-a7e7-91508c6a6f25" containerName="probe" containerID="cri-o://5d21bea438f7664e4ebd23ffae013cadaff70d8624489dcdd5d88a35e2abae0c" gracePeriod=30 Mar 16 16:56:50 crc kubenswrapper[5120]: I0316 16:56:50.572583 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:56:50 crc kubenswrapper[5120]: I0316 16:56:50.589958 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-api-0" podStartSLOduration=4.589931408 podStartE2EDuration="4.589931408s" podCreationTimestamp="2026-03-16 16:56:46 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:56:50.584694505 +0000 UTC m=+5112.738626182" watchObservedRunningTime="2026-03-16 16:56:50.589931408 +0000 UTC m=+5112.743863065" Mar 16 16:56:50 crc kubenswrapper[5120]: I0316 16:56:50.629418 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=3.057839022 podStartE2EDuration="7.629374258s" podCreationTimestamp="2026-03-16 16:56:43 +0000 UTC" firstStartedPulling="2026-03-16 16:56:44.919039082 +0000 UTC m=+5107.072970739" lastFinishedPulling="2026-03-16 16:56:49.490574318 +0000 UTC m=+5111.644505975" observedRunningTime="2026-03-16 16:56:50.627324012 +0000 UTC m=+5112.781255679" watchObservedRunningTime="2026-03-16 16:56:50.629374258 +0000 UTC m=+5112.783305915" Mar 16 16:56:50 crc kubenswrapper[5120]: I0316 16:56:50.713519 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-69697bd7fc-vk7rp"] Mar 16 16:56:50 crc kubenswrapper[5120]: I0316 16:56:50.714426 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2cc34ac9-c7e0-4a0b-9984-a571c4f1c80d" containerName="neutron-db-sync" Mar 16 16:56:50 crc kubenswrapper[5120]: I0316 16:56:50.714443 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="2cc34ac9-c7e0-4a0b-9984-a571c4f1c80d" containerName="neutron-db-sync" Mar 16 16:56:50 crc kubenswrapper[5120]: I0316 16:56:50.714621 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="2cc34ac9-c7e0-4a0b-9984-a571c4f1c80d" containerName="neutron-db-sync" Mar 16 16:56:50 crc kubenswrapper[5120]: I0316 16:56:50.729433 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-69697bd7fc-vk7rp"] Mar 16 16:56:50 crc kubenswrapper[5120]: I0316 16:56:50.729588 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-69697bd7fc-vk7rp" Mar 16 16:56:50 crc kubenswrapper[5120]: I0316 16:56:50.732648 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-config\"" Mar 16 16:56:50 crc kubenswrapper[5120]: I0316 16:56:50.733510 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-httpd-config\"" Mar 16 16:56:50 crc kubenswrapper[5120]: I0316 16:56:50.733790 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-neutron-dockercfg-xnqrd\"" Mar 16 16:56:50 crc kubenswrapper[5120]: I0316 16:56:50.735474 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-neutron-ovndbs\"" Mar 16 16:56:50 crc kubenswrapper[5120]: I0316 16:56:50.791951 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8f0581f7-6963-41b0-8725-fc9e15013e45-combined-ca-bundle\") pod \"neutron-69697bd7fc-vk7rp\" (UID: \"8f0581f7-6963-41b0-8725-fc9e15013e45\") " pod="openstack-kuttl-tests/neutron-69697bd7fc-vk7rp" Mar 16 16:56:50 crc kubenswrapper[5120]: I0316 16:56:50.791996 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6sfr8\" (UniqueName: \"kubernetes.io/projected/8f0581f7-6963-41b0-8725-fc9e15013e45-kube-api-access-6sfr8\") pod \"neutron-69697bd7fc-vk7rp\" (UID: \"8f0581f7-6963-41b0-8725-fc9e15013e45\") " pod="openstack-kuttl-tests/neutron-69697bd7fc-vk7rp" Mar 16 16:56:50 crc kubenswrapper[5120]: I0316 16:56:50.792141 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/8f0581f7-6963-41b0-8725-fc9e15013e45-httpd-config\") pod \"neutron-69697bd7fc-vk7rp\" (UID: \"8f0581f7-6963-41b0-8725-fc9e15013e45\") " pod="openstack-kuttl-tests/neutron-69697bd7fc-vk7rp" Mar 16 16:56:50 crc kubenswrapper[5120]: I0316 16:56:50.792278 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/8f0581f7-6963-41b0-8725-fc9e15013e45-ovndb-tls-certs\") pod \"neutron-69697bd7fc-vk7rp\" (UID: \"8f0581f7-6963-41b0-8725-fc9e15013e45\") " pod="openstack-kuttl-tests/neutron-69697bd7fc-vk7rp" Mar 16 16:56:50 crc kubenswrapper[5120]: I0316 16:56:50.792471 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8f0581f7-6963-41b0-8725-fc9e15013e45-config\") pod \"neutron-69697bd7fc-vk7rp\" (UID: \"8f0581f7-6963-41b0-8725-fc9e15013e45\") " pod="openstack-kuttl-tests/neutron-69697bd7fc-vk7rp" Mar 16 16:56:50 crc kubenswrapper[5120]: I0316 16:56:50.895533 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/8f0581f7-6963-41b0-8725-fc9e15013e45-httpd-config\") pod \"neutron-69697bd7fc-vk7rp\" (UID: \"8f0581f7-6963-41b0-8725-fc9e15013e45\") " pod="openstack-kuttl-tests/neutron-69697bd7fc-vk7rp" Mar 16 16:56:50 crc kubenswrapper[5120]: I0316 16:56:50.896082 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/8f0581f7-6963-41b0-8725-fc9e15013e45-ovndb-tls-certs\") pod \"neutron-69697bd7fc-vk7rp\" (UID: \"8f0581f7-6963-41b0-8725-fc9e15013e45\") " pod="openstack-kuttl-tests/neutron-69697bd7fc-vk7rp" Mar 16 16:56:50 crc kubenswrapper[5120]: I0316 16:56:50.896303 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8f0581f7-6963-41b0-8725-fc9e15013e45-config\") pod \"neutron-69697bd7fc-vk7rp\" (UID: \"8f0581f7-6963-41b0-8725-fc9e15013e45\") " pod="openstack-kuttl-tests/neutron-69697bd7fc-vk7rp" Mar 16 16:56:50 crc kubenswrapper[5120]: I0316 16:56:50.896497 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8f0581f7-6963-41b0-8725-fc9e15013e45-combined-ca-bundle\") pod \"neutron-69697bd7fc-vk7rp\" (UID: \"8f0581f7-6963-41b0-8725-fc9e15013e45\") " pod="openstack-kuttl-tests/neutron-69697bd7fc-vk7rp" Mar 16 16:56:50 crc kubenswrapper[5120]: I0316 16:56:50.896535 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6sfr8\" (UniqueName: \"kubernetes.io/projected/8f0581f7-6963-41b0-8725-fc9e15013e45-kube-api-access-6sfr8\") pod \"neutron-69697bd7fc-vk7rp\" (UID: \"8f0581f7-6963-41b0-8725-fc9e15013e45\") " pod="openstack-kuttl-tests/neutron-69697bd7fc-vk7rp" Mar 16 16:56:50 crc kubenswrapper[5120]: I0316 16:56:50.903712 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/8f0581f7-6963-41b0-8725-fc9e15013e45-httpd-config\") pod \"neutron-69697bd7fc-vk7rp\" (UID: \"8f0581f7-6963-41b0-8725-fc9e15013e45\") " pod="openstack-kuttl-tests/neutron-69697bd7fc-vk7rp" Mar 16 16:56:50 crc kubenswrapper[5120]: I0316 16:56:50.904585 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/8f0581f7-6963-41b0-8725-fc9e15013e45-config\") pod \"neutron-69697bd7fc-vk7rp\" (UID: \"8f0581f7-6963-41b0-8725-fc9e15013e45\") " pod="openstack-kuttl-tests/neutron-69697bd7fc-vk7rp" Mar 16 16:56:50 crc kubenswrapper[5120]: I0316 16:56:50.905588 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/8f0581f7-6963-41b0-8725-fc9e15013e45-ovndb-tls-certs\") pod \"neutron-69697bd7fc-vk7rp\" (UID: \"8f0581f7-6963-41b0-8725-fc9e15013e45\") " pod="openstack-kuttl-tests/neutron-69697bd7fc-vk7rp" Mar 16 16:56:50 crc kubenswrapper[5120]: I0316 16:56:50.910007 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8f0581f7-6963-41b0-8725-fc9e15013e45-combined-ca-bundle\") pod \"neutron-69697bd7fc-vk7rp\" (UID: \"8f0581f7-6963-41b0-8725-fc9e15013e45\") " pod="openstack-kuttl-tests/neutron-69697bd7fc-vk7rp" Mar 16 16:56:50 crc kubenswrapper[5120]: I0316 16:56:50.924419 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6sfr8\" (UniqueName: \"kubernetes.io/projected/8f0581f7-6963-41b0-8725-fc9e15013e45-kube-api-access-6sfr8\") pod \"neutron-69697bd7fc-vk7rp\" (UID: \"8f0581f7-6963-41b0-8725-fc9e15013e45\") " pod="openstack-kuttl-tests/neutron-69697bd7fc-vk7rp" Mar 16 16:56:51 crc kubenswrapper[5120]: I0316 16:56:51.063666 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-69697bd7fc-vk7rp" Mar 16 16:56:51 crc kubenswrapper[5120]: I0316 16:56:51.362320 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-6fc74764d9-qrphb" Mar 16 16:56:51 crc kubenswrapper[5120]: I0316 16:56:51.511031 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e23fbd51-1180-4d93-9937-9c89abacf10b-combined-ca-bundle\") pod \"e23fbd51-1180-4d93-9937-9c89abacf10b\" (UID: \"e23fbd51-1180-4d93-9937-9c89abacf10b\") " Mar 16 16:56:51 crc kubenswrapper[5120]: I0316 16:56:51.511075 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/e23fbd51-1180-4d93-9937-9c89abacf10b-config-data-custom\") pod \"e23fbd51-1180-4d93-9937-9c89abacf10b\" (UID: \"e23fbd51-1180-4d93-9937-9c89abacf10b\") " Mar 16 16:56:51 crc kubenswrapper[5120]: I0316 16:56:51.511332 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e23fbd51-1180-4d93-9937-9c89abacf10b-config-data\") pod \"e23fbd51-1180-4d93-9937-9c89abacf10b\" (UID: \"e23fbd51-1180-4d93-9937-9c89abacf10b\") " Mar 16 16:56:51 crc kubenswrapper[5120]: I0316 16:56:51.511472 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e23fbd51-1180-4d93-9937-9c89abacf10b-logs\") pod \"e23fbd51-1180-4d93-9937-9c89abacf10b\" (UID: \"e23fbd51-1180-4d93-9937-9c89abacf10b\") " Mar 16 16:56:51 crc kubenswrapper[5120]: I0316 16:56:51.511529 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cmrmt\" (UniqueName: \"kubernetes.io/projected/e23fbd51-1180-4d93-9937-9c89abacf10b-kube-api-access-cmrmt\") pod \"e23fbd51-1180-4d93-9937-9c89abacf10b\" (UID: \"e23fbd51-1180-4d93-9937-9c89abacf10b\") " Mar 16 16:56:51 crc kubenswrapper[5120]: I0316 16:56:51.511970 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e23fbd51-1180-4d93-9937-9c89abacf10b-logs" (OuterVolumeSpecName: "logs") pod "e23fbd51-1180-4d93-9937-9c89abacf10b" (UID: "e23fbd51-1180-4d93-9937-9c89abacf10b"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:56:51 crc kubenswrapper[5120]: I0316 16:56:51.512623 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e23fbd51-1180-4d93-9937-9c89abacf10b-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:56:51 crc kubenswrapper[5120]: I0316 16:56:51.516236 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e23fbd51-1180-4d93-9937-9c89abacf10b-kube-api-access-cmrmt" (OuterVolumeSpecName: "kube-api-access-cmrmt") pod "e23fbd51-1180-4d93-9937-9c89abacf10b" (UID: "e23fbd51-1180-4d93-9937-9c89abacf10b"). InnerVolumeSpecName "kube-api-access-cmrmt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:56:51 crc kubenswrapper[5120]: I0316 16:56:51.517330 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e23fbd51-1180-4d93-9937-9c89abacf10b-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "e23fbd51-1180-4d93-9937-9c89abacf10b" (UID: "e23fbd51-1180-4d93-9937-9c89abacf10b"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:56:51 crc kubenswrapper[5120]: I0316 16:56:51.541386 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e23fbd51-1180-4d93-9937-9c89abacf10b-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e23fbd51-1180-4d93-9937-9c89abacf10b" (UID: "e23fbd51-1180-4d93-9937-9c89abacf10b"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:56:51 crc kubenswrapper[5120]: I0316 16:56:51.561093 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e23fbd51-1180-4d93-9937-9c89abacf10b-config-data" (OuterVolumeSpecName: "config-data") pod "e23fbd51-1180-4d93-9937-9c89abacf10b" (UID: "e23fbd51-1180-4d93-9937-9c89abacf10b"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:56:51 crc kubenswrapper[5120]: I0316 16:56:51.570481 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-856c7c8dd4-vsqd7" podUID="2cf93ef3-c7e7-45dd-9639-e40bce42a900" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.1.7:9311/healthcheck\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Mar 16 16:56:51 crc kubenswrapper[5120]: I0316 16:56:51.570501 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-856c7c8dd4-vsqd7" podUID="2cf93ef3-c7e7-45dd-9639-e40bce42a900" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.1.7:9311/healthcheck\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Mar 16 16:56:51 crc kubenswrapper[5120]: I0316 16:56:51.584312 5120 generic.go:358] "Generic (PLEG): container finished" podID="e23fbd51-1180-4d93-9937-9c89abacf10b" containerID="405d808b1ecf10f9d0e6b8c571f57ba0ec934190882191e9b3e0c60956202e92" exitCode=0 Mar 16 16:56:51 crc kubenswrapper[5120]: I0316 16:56:51.584409 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-6fc74764d9-qrphb" Mar 16 16:56:51 crc kubenswrapper[5120]: I0316 16:56:51.584424 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-6fc74764d9-qrphb" event={"ID":"e23fbd51-1180-4d93-9937-9c89abacf10b","Type":"ContainerDied","Data":"405d808b1ecf10f9d0e6b8c571f57ba0ec934190882191e9b3e0c60956202e92"} Mar 16 16:56:51 crc kubenswrapper[5120]: I0316 16:56:51.584474 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-6fc74764d9-qrphb" event={"ID":"e23fbd51-1180-4d93-9937-9c89abacf10b","Type":"ContainerDied","Data":"56a9182c06c229cd9499ea36a4018d2ce0291a2a255ced66964d650136faddcb"} Mar 16 16:56:51 crc kubenswrapper[5120]: I0316 16:56:51.584508 5120 scope.go:117] "RemoveContainer" containerID="405d808b1ecf10f9d0e6b8c571f57ba0ec934190882191e9b3e0c60956202e92" Mar 16 16:56:51 crc kubenswrapper[5120]: I0316 16:56:51.588405 5120 generic.go:358] "Generic (PLEG): container finished" podID="3264bd71-ad28-4b8e-a7e7-91508c6a6f25" containerID="5d21bea438f7664e4ebd23ffae013cadaff70d8624489dcdd5d88a35e2abae0c" exitCode=0 Mar 16 16:56:51 crc kubenswrapper[5120]: I0316 16:56:51.588443 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"3264bd71-ad28-4b8e-a7e7-91508c6a6f25","Type":"ContainerDied","Data":"5d21bea438f7664e4ebd23ffae013cadaff70d8624489dcdd5d88a35e2abae0c"} Mar 16 16:56:51 crc kubenswrapper[5120]: I0316 16:56:51.608963 5120 scope.go:117] "RemoveContainer" containerID="9a7b06878e2ba8775823c827847ca1ac79df41547ebfcef15cedd04c3195885c" Mar 16 16:56:51 crc kubenswrapper[5120]: I0316 16:56:51.629387 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e23fbd51-1180-4d93-9937-9c89abacf10b-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:56:51 crc kubenswrapper[5120]: I0316 16:56:51.629436 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/e23fbd51-1180-4d93-9937-9c89abacf10b-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:56:51 crc kubenswrapper[5120]: I0316 16:56:51.629449 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e23fbd51-1180-4d93-9937-9c89abacf10b-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:56:51 crc kubenswrapper[5120]: I0316 16:56:51.629463 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cmrmt\" (UniqueName: \"kubernetes.io/projected/e23fbd51-1180-4d93-9937-9c89abacf10b-kube-api-access-cmrmt\") on node \"crc\" DevicePath \"\"" Mar 16 16:56:51 crc kubenswrapper[5120]: I0316 16:56:51.632018 5120 scope.go:117] "RemoveContainer" containerID="405d808b1ecf10f9d0e6b8c571f57ba0ec934190882191e9b3e0c60956202e92" Mar 16 16:56:51 crc kubenswrapper[5120]: E0316 16:56:51.632461 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"405d808b1ecf10f9d0e6b8c571f57ba0ec934190882191e9b3e0c60956202e92\": container with ID starting with 405d808b1ecf10f9d0e6b8c571f57ba0ec934190882191e9b3e0c60956202e92 not found: ID does not exist" containerID="405d808b1ecf10f9d0e6b8c571f57ba0ec934190882191e9b3e0c60956202e92" Mar 16 16:56:51 crc kubenswrapper[5120]: I0316 16:56:51.632498 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"405d808b1ecf10f9d0e6b8c571f57ba0ec934190882191e9b3e0c60956202e92"} err="failed to get container status \"405d808b1ecf10f9d0e6b8c571f57ba0ec934190882191e9b3e0c60956202e92\": rpc error: code = NotFound desc = could not find container \"405d808b1ecf10f9d0e6b8c571f57ba0ec934190882191e9b3e0c60956202e92\": container with ID starting with 405d808b1ecf10f9d0e6b8c571f57ba0ec934190882191e9b3e0c60956202e92 not found: ID does not exist" Mar 16 16:56:51 crc kubenswrapper[5120]: I0316 16:56:51.632521 5120 scope.go:117] "RemoveContainer" containerID="9a7b06878e2ba8775823c827847ca1ac79df41547ebfcef15cedd04c3195885c" Mar 16 16:56:51 crc kubenswrapper[5120]: E0316 16:56:51.632718 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a7b06878e2ba8775823c827847ca1ac79df41547ebfcef15cedd04c3195885c\": container with ID starting with 9a7b06878e2ba8775823c827847ca1ac79df41547ebfcef15cedd04c3195885c not found: ID does not exist" containerID="9a7b06878e2ba8775823c827847ca1ac79df41547ebfcef15cedd04c3195885c" Mar 16 16:56:51 crc kubenswrapper[5120]: I0316 16:56:51.632746 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a7b06878e2ba8775823c827847ca1ac79df41547ebfcef15cedd04c3195885c"} err="failed to get container status \"9a7b06878e2ba8775823c827847ca1ac79df41547ebfcef15cedd04c3195885c\": rpc error: code = NotFound desc = could not find container \"9a7b06878e2ba8775823c827847ca1ac79df41547ebfcef15cedd04c3195885c\": container with ID starting with 9a7b06878e2ba8775823c827847ca1ac79df41547ebfcef15cedd04c3195885c not found: ID does not exist" Mar 16 16:56:51 crc kubenswrapper[5120]: I0316 16:56:51.633093 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-6fc74764d9-qrphb"] Mar 16 16:56:51 crc kubenswrapper[5120]: I0316 16:56:51.643989 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-worker-6fc74764d9-qrphb"] Mar 16 16:56:51 crc kubenswrapper[5120]: W0316 16:56:51.646268 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8f0581f7_6963_41b0_8725_fc9e15013e45.slice/crio-660ff278af75bb1d162244574361a82a272c9f65d51b0388349e1963bad553cc WatchSource:0}: Error finding container 660ff278af75bb1d162244574361a82a272c9f65d51b0388349e1963bad553cc: Status 404 returned error can't find the container with id 660ff278af75bb1d162244574361a82a272c9f65d51b0388349e1963bad553cc Mar 16 16:56:51 crc kubenswrapper[5120]: I0316 16:56:51.653977 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-69697bd7fc-vk7rp"] Mar 16 16:56:52 crc kubenswrapper[5120]: I0316 16:56:52.372963 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-78774f5dfb-bzqjl" Mar 16 16:56:52 crc kubenswrapper[5120]: I0316 16:56:52.474417 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/5cd891e1-77ba-42cb-ad3f-6d37f1782101-config-data-custom\") pod \"5cd891e1-77ba-42cb-ad3f-6d37f1782101\" (UID: \"5cd891e1-77ba-42cb-ad3f-6d37f1782101\") " Mar 16 16:56:52 crc kubenswrapper[5120]: I0316 16:56:52.474692 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5cd891e1-77ba-42cb-ad3f-6d37f1782101-logs\") pod \"5cd891e1-77ba-42cb-ad3f-6d37f1782101\" (UID: \"5cd891e1-77ba-42cb-ad3f-6d37f1782101\") " Mar 16 16:56:52 crc kubenswrapper[5120]: I0316 16:56:52.482390 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5cd891e1-77ba-42cb-ad3f-6d37f1782101-logs" (OuterVolumeSpecName: "logs") pod "5cd891e1-77ba-42cb-ad3f-6d37f1782101" (UID: "5cd891e1-77ba-42cb-ad3f-6d37f1782101"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:56:52 crc kubenswrapper[5120]: I0316 16:56:52.491221 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5cd891e1-77ba-42cb-ad3f-6d37f1782101-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "5cd891e1-77ba-42cb-ad3f-6d37f1782101" (UID: "5cd891e1-77ba-42cb-ad3f-6d37f1782101"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:56:52 crc kubenswrapper[5120]: I0316 16:56:52.577211 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5cd891e1-77ba-42cb-ad3f-6d37f1782101-config-data\") pod \"5cd891e1-77ba-42cb-ad3f-6d37f1782101\" (UID: \"5cd891e1-77ba-42cb-ad3f-6d37f1782101\") " Mar 16 16:56:52 crc kubenswrapper[5120]: I0316 16:56:52.577485 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r4q86\" (UniqueName: \"kubernetes.io/projected/5cd891e1-77ba-42cb-ad3f-6d37f1782101-kube-api-access-r4q86\") pod \"5cd891e1-77ba-42cb-ad3f-6d37f1782101\" (UID: \"5cd891e1-77ba-42cb-ad3f-6d37f1782101\") " Mar 16 16:56:52 crc kubenswrapper[5120]: I0316 16:56:52.577871 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5cd891e1-77ba-42cb-ad3f-6d37f1782101-combined-ca-bundle\") pod \"5cd891e1-77ba-42cb-ad3f-6d37f1782101\" (UID: \"5cd891e1-77ba-42cb-ad3f-6d37f1782101\") " Mar 16 16:56:52 crc kubenswrapper[5120]: I0316 16:56:52.578699 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/5cd891e1-77ba-42cb-ad3f-6d37f1782101-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:56:52 crc kubenswrapper[5120]: I0316 16:56:52.578726 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5cd891e1-77ba-42cb-ad3f-6d37f1782101-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:56:52 crc kubenswrapper[5120]: I0316 16:56:52.582977 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5cd891e1-77ba-42cb-ad3f-6d37f1782101-kube-api-access-r4q86" (OuterVolumeSpecName: "kube-api-access-r4q86") pod "5cd891e1-77ba-42cb-ad3f-6d37f1782101" (UID: "5cd891e1-77ba-42cb-ad3f-6d37f1782101"). InnerVolumeSpecName "kube-api-access-r4q86". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:56:52 crc kubenswrapper[5120]: I0316 16:56:52.600274 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-69697bd7fc-vk7rp" event={"ID":"8f0581f7-6963-41b0-8725-fc9e15013e45","Type":"ContainerStarted","Data":"c2f8b725846999666c2adf76377f2bba3b35b761392291c5e12b4fd9642de7e1"} Mar 16 16:56:52 crc kubenswrapper[5120]: I0316 16:56:52.600319 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-69697bd7fc-vk7rp" event={"ID":"8f0581f7-6963-41b0-8725-fc9e15013e45","Type":"ContainerStarted","Data":"3dfcc69393dccb8f4d7cf68198d3934da02c48498d64b13e41b4c66b9ee2c8b6"} Mar 16 16:56:52 crc kubenswrapper[5120]: I0316 16:56:52.600328 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-69697bd7fc-vk7rp" event={"ID":"8f0581f7-6963-41b0-8725-fc9e15013e45","Type":"ContainerStarted","Data":"660ff278af75bb1d162244574361a82a272c9f65d51b0388349e1963bad553cc"} Mar 16 16:56:52 crc kubenswrapper[5120]: I0316 16:56:52.601427 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/neutron-69697bd7fc-vk7rp" Mar 16 16:56:52 crc kubenswrapper[5120]: I0316 16:56:52.608065 5120 generic.go:358] "Generic (PLEG): container finished" podID="5cd891e1-77ba-42cb-ad3f-6d37f1782101" containerID="1c0532af6887b54949e7a3d1f4b7df5559fe73378c2e57f4d96e8714c36b3ce5" exitCode=0 Mar 16 16:56:52 crc kubenswrapper[5120]: I0316 16:56:52.608182 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-78774f5dfb-bzqjl" Mar 16 16:56:52 crc kubenswrapper[5120]: I0316 16:56:52.608308 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-78774f5dfb-bzqjl" event={"ID":"5cd891e1-77ba-42cb-ad3f-6d37f1782101","Type":"ContainerDied","Data":"1c0532af6887b54949e7a3d1f4b7df5559fe73378c2e57f4d96e8714c36b3ce5"} Mar 16 16:56:52 crc kubenswrapper[5120]: I0316 16:56:52.609305 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-78774f5dfb-bzqjl" event={"ID":"5cd891e1-77ba-42cb-ad3f-6d37f1782101","Type":"ContainerDied","Data":"69edfb33b8753bce94b35b5807c22e2a457d4eaafc697d7a5b79c696cdab3daf"} Mar 16 16:56:52 crc kubenswrapper[5120]: I0316 16:56:52.609375 5120 scope.go:117] "RemoveContainer" containerID="1c0532af6887b54949e7a3d1f4b7df5559fe73378c2e57f4d96e8714c36b3ce5" Mar 16 16:56:52 crc kubenswrapper[5120]: I0316 16:56:52.616105 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5cd891e1-77ba-42cb-ad3f-6d37f1782101-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "5cd891e1-77ba-42cb-ad3f-6d37f1782101" (UID: "5cd891e1-77ba-42cb-ad3f-6d37f1782101"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:56:52 crc kubenswrapper[5120]: I0316 16:56:52.622154 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-69697bd7fc-vk7rp" podStartSLOduration=2.622132781 podStartE2EDuration="2.622132781s" podCreationTimestamp="2026-03-16 16:56:50 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:56:52.619663883 +0000 UTC m=+5114.773595540" watchObservedRunningTime="2026-03-16 16:56:52.622132781 +0000 UTC m=+5114.776064438" Mar 16 16:56:52 crc kubenswrapper[5120]: I0316 16:56:52.650309 5120 scope.go:117] "RemoveContainer" containerID="09cfdb14369a3d8b0e09908d23e65e9b0ccb85b37183e947137f6faf3cca1ab8" Mar 16 16:56:52 crc kubenswrapper[5120]: I0316 16:56:52.659034 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5cd891e1-77ba-42cb-ad3f-6d37f1782101-config-data" (OuterVolumeSpecName: "config-data") pod "5cd891e1-77ba-42cb-ad3f-6d37f1782101" (UID: "5cd891e1-77ba-42cb-ad3f-6d37f1782101"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:56:52 crc kubenswrapper[5120]: I0316 16:56:52.680442 5120 scope.go:117] "RemoveContainer" containerID="1c0532af6887b54949e7a3d1f4b7df5559fe73378c2e57f4d96e8714c36b3ce5" Mar 16 16:56:52 crc kubenswrapper[5120]: E0316 16:56:52.681451 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c0532af6887b54949e7a3d1f4b7df5559fe73378c2e57f4d96e8714c36b3ce5\": container with ID starting with 1c0532af6887b54949e7a3d1f4b7df5559fe73378c2e57f4d96e8714c36b3ce5 not found: ID does not exist" containerID="1c0532af6887b54949e7a3d1f4b7df5559fe73378c2e57f4d96e8714c36b3ce5" Mar 16 16:56:52 crc kubenswrapper[5120]: I0316 16:56:52.681480 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c0532af6887b54949e7a3d1f4b7df5559fe73378c2e57f4d96e8714c36b3ce5"} err="failed to get container status \"1c0532af6887b54949e7a3d1f4b7df5559fe73378c2e57f4d96e8714c36b3ce5\": rpc error: code = NotFound desc = could not find container \"1c0532af6887b54949e7a3d1f4b7df5559fe73378c2e57f4d96e8714c36b3ce5\": container with ID starting with 1c0532af6887b54949e7a3d1f4b7df5559fe73378c2e57f4d96e8714c36b3ce5 not found: ID does not exist" Mar 16 16:56:52 crc kubenswrapper[5120]: I0316 16:56:52.681534 5120 scope.go:117] "RemoveContainer" containerID="09cfdb14369a3d8b0e09908d23e65e9b0ccb85b37183e947137f6faf3cca1ab8" Mar 16 16:56:52 crc kubenswrapper[5120]: E0316 16:56:52.682001 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"09cfdb14369a3d8b0e09908d23e65e9b0ccb85b37183e947137f6faf3cca1ab8\": container with ID starting with 09cfdb14369a3d8b0e09908d23e65e9b0ccb85b37183e947137f6faf3cca1ab8 not found: ID does not exist" containerID="09cfdb14369a3d8b0e09908d23e65e9b0ccb85b37183e947137f6faf3cca1ab8" Mar 16 16:56:52 crc kubenswrapper[5120]: I0316 16:56:52.682062 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09cfdb14369a3d8b0e09908d23e65e9b0ccb85b37183e947137f6faf3cca1ab8"} err="failed to get container status \"09cfdb14369a3d8b0e09908d23e65e9b0ccb85b37183e947137f6faf3cca1ab8\": rpc error: code = NotFound desc = could not find container \"09cfdb14369a3d8b0e09908d23e65e9b0ccb85b37183e947137f6faf3cca1ab8\": container with ID starting with 09cfdb14369a3d8b0e09908d23e65e9b0ccb85b37183e947137f6faf3cca1ab8 not found: ID does not exist" Mar 16 16:56:52 crc kubenswrapper[5120]: I0316 16:56:52.686744 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r4q86\" (UniqueName: \"kubernetes.io/projected/5cd891e1-77ba-42cb-ad3f-6d37f1782101-kube-api-access-r4q86\") on node \"crc\" DevicePath \"\"" Mar 16 16:56:52 crc kubenswrapper[5120]: I0316 16:56:52.689619 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5cd891e1-77ba-42cb-ad3f-6d37f1782101-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:56:52 crc kubenswrapper[5120]: I0316 16:56:52.689726 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5cd891e1-77ba-42cb-ad3f-6d37f1782101-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:56:52 crc kubenswrapper[5120]: I0316 16:56:52.704550 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e23fbd51-1180-4d93-9937-9c89abacf10b" path="/var/lib/kubelet/pods/e23fbd51-1180-4d93-9937-9c89abacf10b/volumes" Mar 16 16:56:52 crc kubenswrapper[5120]: I0316 16:56:52.934040 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-78774f5dfb-bzqjl"] Mar 16 16:56:52 crc kubenswrapper[5120]: I0316 16:56:52.942449 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-78774f5dfb-bzqjl"] Mar 16 16:56:53 crc kubenswrapper[5120]: I0316 16:56:53.020598 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-856c7c8dd4-vsqd7" podUID="2cf93ef3-c7e7-45dd-9639-e40bce42a900" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.1.7:9311/healthcheck\": read tcp 10.217.0.2:36250->10.217.1.7:9311: read: connection reset by peer" Mar 16 16:56:53 crc kubenswrapper[5120]: I0316 16:56:53.021172 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-856c7c8dd4-vsqd7" podUID="2cf93ef3-c7e7-45dd-9639-e40bce42a900" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.1.7:9311/healthcheck\": read tcp 10.217.0.2:36236->10.217.1.7:9311: read: connection reset by peer" Mar 16 16:56:53 crc kubenswrapper[5120]: I0316 16:56:53.468892 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-856c7c8dd4-vsqd7" Mar 16 16:56:53 crc kubenswrapper[5120]: I0316 16:56:53.508769 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2cf93ef3-c7e7-45dd-9639-e40bce42a900-combined-ca-bundle\") pod \"2cf93ef3-c7e7-45dd-9639-e40bce42a900\" (UID: \"2cf93ef3-c7e7-45dd-9639-e40bce42a900\") " Mar 16 16:56:53 crc kubenswrapper[5120]: I0316 16:56:53.508912 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/2cf93ef3-c7e7-45dd-9639-e40bce42a900-public-tls-certs\") pod \"2cf93ef3-c7e7-45dd-9639-e40bce42a900\" (UID: \"2cf93ef3-c7e7-45dd-9639-e40bce42a900\") " Mar 16 16:56:53 crc kubenswrapper[5120]: I0316 16:56:53.508957 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2cf93ef3-c7e7-45dd-9639-e40bce42a900-config-data\") pod \"2cf93ef3-c7e7-45dd-9639-e40bce42a900\" (UID: \"2cf93ef3-c7e7-45dd-9639-e40bce42a900\") " Mar 16 16:56:53 crc kubenswrapper[5120]: I0316 16:56:53.509280 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/2cf93ef3-c7e7-45dd-9639-e40bce42a900-internal-tls-certs\") pod \"2cf93ef3-c7e7-45dd-9639-e40bce42a900\" (UID: \"2cf93ef3-c7e7-45dd-9639-e40bce42a900\") " Mar 16 16:56:53 crc kubenswrapper[5120]: I0316 16:56:53.509316 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/2cf93ef3-c7e7-45dd-9639-e40bce42a900-config-data-custom\") pod \"2cf93ef3-c7e7-45dd-9639-e40bce42a900\" (UID: \"2cf93ef3-c7e7-45dd-9639-e40bce42a900\") " Mar 16 16:56:53 crc kubenswrapper[5120]: I0316 16:56:53.509472 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-86wrr\" (UniqueName: \"kubernetes.io/projected/2cf93ef3-c7e7-45dd-9639-e40bce42a900-kube-api-access-86wrr\") pod \"2cf93ef3-c7e7-45dd-9639-e40bce42a900\" (UID: \"2cf93ef3-c7e7-45dd-9639-e40bce42a900\") " Mar 16 16:56:53 crc kubenswrapper[5120]: I0316 16:56:53.509655 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2cf93ef3-c7e7-45dd-9639-e40bce42a900-logs\") pod \"2cf93ef3-c7e7-45dd-9639-e40bce42a900\" (UID: \"2cf93ef3-c7e7-45dd-9639-e40bce42a900\") " Mar 16 16:56:53 crc kubenswrapper[5120]: I0316 16:56:53.511370 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2cf93ef3-c7e7-45dd-9639-e40bce42a900-logs" (OuterVolumeSpecName: "logs") pod "2cf93ef3-c7e7-45dd-9639-e40bce42a900" (UID: "2cf93ef3-c7e7-45dd-9639-e40bce42a900"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:56:53 crc kubenswrapper[5120]: I0316 16:56:53.521552 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2cf93ef3-c7e7-45dd-9639-e40bce42a900-kube-api-access-86wrr" (OuterVolumeSpecName: "kube-api-access-86wrr") pod "2cf93ef3-c7e7-45dd-9639-e40bce42a900" (UID: "2cf93ef3-c7e7-45dd-9639-e40bce42a900"). InnerVolumeSpecName "kube-api-access-86wrr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:56:53 crc kubenswrapper[5120]: I0316 16:56:53.521799 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2cf93ef3-c7e7-45dd-9639-e40bce42a900-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "2cf93ef3-c7e7-45dd-9639-e40bce42a900" (UID: "2cf93ef3-c7e7-45dd-9639-e40bce42a900"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:56:53 crc kubenswrapper[5120]: I0316 16:56:53.576724 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2cf93ef3-c7e7-45dd-9639-e40bce42a900-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "2cf93ef3-c7e7-45dd-9639-e40bce42a900" (UID: "2cf93ef3-c7e7-45dd-9639-e40bce42a900"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:56:53 crc kubenswrapper[5120]: I0316 16:56:53.578515 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2cf93ef3-c7e7-45dd-9639-e40bce42a900-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "2cf93ef3-c7e7-45dd-9639-e40bce42a900" (UID: "2cf93ef3-c7e7-45dd-9639-e40bce42a900"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:56:53 crc kubenswrapper[5120]: I0316 16:56:53.602700 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2cf93ef3-c7e7-45dd-9639-e40bce42a900-config-data" (OuterVolumeSpecName: "config-data") pod "2cf93ef3-c7e7-45dd-9639-e40bce42a900" (UID: "2cf93ef3-c7e7-45dd-9639-e40bce42a900"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:56:53 crc kubenswrapper[5120]: I0316 16:56:53.613957 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/2cf93ef3-c7e7-45dd-9639-e40bce42a900-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:56:53 crc kubenswrapper[5120]: I0316 16:56:53.614000 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-86wrr\" (UniqueName: \"kubernetes.io/projected/2cf93ef3-c7e7-45dd-9639-e40bce42a900-kube-api-access-86wrr\") on node \"crc\" DevicePath \"\"" Mar 16 16:56:53 crc kubenswrapper[5120]: I0316 16:56:53.614017 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2cf93ef3-c7e7-45dd-9639-e40bce42a900-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:56:53 crc kubenswrapper[5120]: I0316 16:56:53.614029 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2cf93ef3-c7e7-45dd-9639-e40bce42a900-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:56:53 crc kubenswrapper[5120]: I0316 16:56:53.614040 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/2cf93ef3-c7e7-45dd-9639-e40bce42a900-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:56:53 crc kubenswrapper[5120]: I0316 16:56:53.614051 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2cf93ef3-c7e7-45dd-9639-e40bce42a900-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:56:53 crc kubenswrapper[5120]: I0316 16:56:53.615654 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2cf93ef3-c7e7-45dd-9639-e40bce42a900-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "2cf93ef3-c7e7-45dd-9639-e40bce42a900" (UID: "2cf93ef3-c7e7-45dd-9639-e40bce42a900"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:56:53 crc kubenswrapper[5120]: I0316 16:56:53.632809 5120 generic.go:358] "Generic (PLEG): container finished" podID="2cf93ef3-c7e7-45dd-9639-e40bce42a900" containerID="61644943603f36bcbbb1c3e4504d927426de1097045e937e92209490f6b2f699" exitCode=0 Mar 16 16:56:53 crc kubenswrapper[5120]: I0316 16:56:53.633269 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-856c7c8dd4-vsqd7" event={"ID":"2cf93ef3-c7e7-45dd-9639-e40bce42a900","Type":"ContainerDied","Data":"61644943603f36bcbbb1c3e4504d927426de1097045e937e92209490f6b2f699"} Mar 16 16:56:53 crc kubenswrapper[5120]: I0316 16:56:53.633370 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-856c7c8dd4-vsqd7" event={"ID":"2cf93ef3-c7e7-45dd-9639-e40bce42a900","Type":"ContainerDied","Data":"729b5e7b1103c4e99f5dd76797f59c8a61c54dafb8892916e946ad92b3e998a3"} Mar 16 16:56:53 crc kubenswrapper[5120]: I0316 16:56:53.633445 5120 scope.go:117] "RemoveContainer" containerID="61644943603f36bcbbb1c3e4504d927426de1097045e937e92209490f6b2f699" Mar 16 16:56:53 crc kubenswrapper[5120]: I0316 16:56:53.633532 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-856c7c8dd4-vsqd7" Mar 16 16:56:53 crc kubenswrapper[5120]: I0316 16:56:53.682091 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-856c7c8dd4-vsqd7"] Mar 16 16:56:53 crc kubenswrapper[5120]: I0316 16:56:53.682487 5120 scope.go:117] "RemoveContainer" containerID="29615c6b15ac113f99ca1bd009163b4eb6330a8a13133b8006178be01abb44bb" Mar 16 16:56:53 crc kubenswrapper[5120]: I0316 16:56:53.689436 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-api-856c7c8dd4-vsqd7"] Mar 16 16:56:53 crc kubenswrapper[5120]: I0316 16:56:53.707541 5120 scope.go:117] "RemoveContainer" containerID="61644943603f36bcbbb1c3e4504d927426de1097045e937e92209490f6b2f699" Mar 16 16:56:53 crc kubenswrapper[5120]: E0316 16:56:53.708419 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"61644943603f36bcbbb1c3e4504d927426de1097045e937e92209490f6b2f699\": container with ID starting with 61644943603f36bcbbb1c3e4504d927426de1097045e937e92209490f6b2f699 not found: ID does not exist" containerID="61644943603f36bcbbb1c3e4504d927426de1097045e937e92209490f6b2f699" Mar 16 16:56:53 crc kubenswrapper[5120]: I0316 16:56:53.708479 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61644943603f36bcbbb1c3e4504d927426de1097045e937e92209490f6b2f699"} err="failed to get container status \"61644943603f36bcbbb1c3e4504d927426de1097045e937e92209490f6b2f699\": rpc error: code = NotFound desc = could not find container \"61644943603f36bcbbb1c3e4504d927426de1097045e937e92209490f6b2f699\": container with ID starting with 61644943603f36bcbbb1c3e4504d927426de1097045e937e92209490f6b2f699 not found: ID does not exist" Mar 16 16:56:53 crc kubenswrapper[5120]: I0316 16:56:53.708525 5120 scope.go:117] "RemoveContainer" containerID="29615c6b15ac113f99ca1bd009163b4eb6330a8a13133b8006178be01abb44bb" Mar 16 16:56:53 crc kubenswrapper[5120]: E0316 16:56:53.708933 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"29615c6b15ac113f99ca1bd009163b4eb6330a8a13133b8006178be01abb44bb\": container with ID starting with 29615c6b15ac113f99ca1bd009163b4eb6330a8a13133b8006178be01abb44bb not found: ID does not exist" containerID="29615c6b15ac113f99ca1bd009163b4eb6330a8a13133b8006178be01abb44bb" Mar 16 16:56:53 crc kubenswrapper[5120]: I0316 16:56:53.708965 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29615c6b15ac113f99ca1bd009163b4eb6330a8a13133b8006178be01abb44bb"} err="failed to get container status \"29615c6b15ac113f99ca1bd009163b4eb6330a8a13133b8006178be01abb44bb\": rpc error: code = NotFound desc = could not find container \"29615c6b15ac113f99ca1bd009163b4eb6330a8a13133b8006178be01abb44bb\": container with ID starting with 29615c6b15ac113f99ca1bd009163b4eb6330a8a13133b8006178be01abb44bb not found: ID does not exist" Mar 16 16:56:53 crc kubenswrapper[5120]: I0316 16:56:53.718470 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/2cf93ef3-c7e7-45dd-9639-e40bce42a900-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:56:54 crc kubenswrapper[5120]: I0316 16:56:54.652011 5120 generic.go:358] "Generic (PLEG): container finished" podID="3264bd71-ad28-4b8e-a7e7-91508c6a6f25" containerID="b583abe5db9352e6c81bea08f9819a58ef3fc82fe7a4428c2aaef72b3a4710b4" exitCode=0 Mar 16 16:56:54 crc kubenswrapper[5120]: I0316 16:56:54.652278 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"3264bd71-ad28-4b8e-a7e7-91508c6a6f25","Type":"ContainerDied","Data":"b583abe5db9352e6c81bea08f9819a58ef3fc82fe7a4428c2aaef72b3a4710b4"} Mar 16 16:56:54 crc kubenswrapper[5120]: I0316 16:56:54.687026 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2cf93ef3-c7e7-45dd-9639-e40bce42a900" path="/var/lib/kubelet/pods/2cf93ef3-c7e7-45dd-9639-e40bce42a900/volumes" Mar 16 16:56:54 crc kubenswrapper[5120]: I0316 16:56:54.690544 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5cd891e1-77ba-42cb-ad3f-6d37f1782101" path="/var/lib/kubelet/pods/5cd891e1-77ba-42cb-ad3f-6d37f1782101/volumes" Mar 16 16:56:54 crc kubenswrapper[5120]: I0316 16:56:54.820690 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-8bf9bfcb4-2674f"] Mar 16 16:56:54 crc kubenswrapper[5120]: I0316 16:56:54.821867 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2cf93ef3-c7e7-45dd-9639-e40bce42a900" containerName="barbican-api" Mar 16 16:56:54 crc kubenswrapper[5120]: I0316 16:56:54.821888 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="2cf93ef3-c7e7-45dd-9639-e40bce42a900" containerName="barbican-api" Mar 16 16:56:54 crc kubenswrapper[5120]: I0316 16:56:54.821910 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e23fbd51-1180-4d93-9937-9c89abacf10b" containerName="barbican-worker-log" Mar 16 16:56:54 crc kubenswrapper[5120]: I0316 16:56:54.821917 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e23fbd51-1180-4d93-9937-9c89abacf10b" containerName="barbican-worker-log" Mar 16 16:56:54 crc kubenswrapper[5120]: I0316 16:56:54.821930 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2cf93ef3-c7e7-45dd-9639-e40bce42a900" containerName="barbican-api-log" Mar 16 16:56:54 crc kubenswrapper[5120]: I0316 16:56:54.821936 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="2cf93ef3-c7e7-45dd-9639-e40bce42a900" containerName="barbican-api-log" Mar 16 16:56:54 crc kubenswrapper[5120]: I0316 16:56:54.821948 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5cd891e1-77ba-42cb-ad3f-6d37f1782101" containerName="barbican-keystone-listener" Mar 16 16:56:54 crc kubenswrapper[5120]: I0316 16:56:54.821953 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="5cd891e1-77ba-42cb-ad3f-6d37f1782101" containerName="barbican-keystone-listener" Mar 16 16:56:54 crc kubenswrapper[5120]: I0316 16:56:54.821969 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5cd891e1-77ba-42cb-ad3f-6d37f1782101" containerName="barbican-keystone-listener-log" Mar 16 16:56:54 crc kubenswrapper[5120]: I0316 16:56:54.821975 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="5cd891e1-77ba-42cb-ad3f-6d37f1782101" containerName="barbican-keystone-listener-log" Mar 16 16:56:54 crc kubenswrapper[5120]: I0316 16:56:54.821993 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e23fbd51-1180-4d93-9937-9c89abacf10b" containerName="barbican-worker" Mar 16 16:56:54 crc kubenswrapper[5120]: I0316 16:56:54.821998 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e23fbd51-1180-4d93-9937-9c89abacf10b" containerName="barbican-worker" Mar 16 16:56:54 crc kubenswrapper[5120]: I0316 16:56:54.822168 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e23fbd51-1180-4d93-9937-9c89abacf10b" containerName="barbican-worker-log" Mar 16 16:56:54 crc kubenswrapper[5120]: I0316 16:56:54.822187 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="5cd891e1-77ba-42cb-ad3f-6d37f1782101" containerName="barbican-keystone-listener" Mar 16 16:56:54 crc kubenswrapper[5120]: I0316 16:56:54.822197 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="5cd891e1-77ba-42cb-ad3f-6d37f1782101" containerName="barbican-keystone-listener-log" Mar 16 16:56:54 crc kubenswrapper[5120]: I0316 16:56:54.822211 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e23fbd51-1180-4d93-9937-9c89abacf10b" containerName="barbican-worker" Mar 16 16:56:54 crc kubenswrapper[5120]: I0316 16:56:54.822220 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="2cf93ef3-c7e7-45dd-9639-e40bce42a900" containerName="barbican-api" Mar 16 16:56:54 crc kubenswrapper[5120]: I0316 16:56:54.822230 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="2cf93ef3-c7e7-45dd-9639-e40bce42a900" containerName="barbican-api-log" Mar 16 16:56:54 crc kubenswrapper[5120]: I0316 16:56:54.849957 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-8bf9bfcb4-2674f" Mar 16 16:56:54 crc kubenswrapper[5120]: I0316 16:56:54.854224 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-neutron-internal-svc\"" Mar 16 16:56:54 crc kubenswrapper[5120]: I0316 16:56:54.854488 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-neutron-public-svc\"" Mar 16 16:56:54 crc kubenswrapper[5120]: I0316 16:56:54.876592 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-8bf9bfcb4-2674f"] Mar 16 16:56:54 crc kubenswrapper[5120]: I0316 16:56:54.944874 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:56:54 crc kubenswrapper[5120]: I0316 16:56:54.957063 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/95dbfc71-6afe-4106-b073-5a1edcc8788f-internal-tls-certs\") pod \"neutron-8bf9bfcb4-2674f\" (UID: \"95dbfc71-6afe-4106-b073-5a1edcc8788f\") " pod="openstack-kuttl-tests/neutron-8bf9bfcb4-2674f" Mar 16 16:56:54 crc kubenswrapper[5120]: I0316 16:56:54.957157 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnp4p\" (UniqueName: \"kubernetes.io/projected/95dbfc71-6afe-4106-b073-5a1edcc8788f-kube-api-access-wnp4p\") pod \"neutron-8bf9bfcb4-2674f\" (UID: \"95dbfc71-6afe-4106-b073-5a1edcc8788f\") " pod="openstack-kuttl-tests/neutron-8bf9bfcb4-2674f" Mar 16 16:56:54 crc kubenswrapper[5120]: I0316 16:56:54.957290 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/95dbfc71-6afe-4106-b073-5a1edcc8788f-combined-ca-bundle\") pod \"neutron-8bf9bfcb4-2674f\" (UID: \"95dbfc71-6afe-4106-b073-5a1edcc8788f\") " pod="openstack-kuttl-tests/neutron-8bf9bfcb4-2674f" Mar 16 16:56:54 crc kubenswrapper[5120]: I0316 16:56:54.957320 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/95dbfc71-6afe-4106-b073-5a1edcc8788f-public-tls-certs\") pod \"neutron-8bf9bfcb4-2674f\" (UID: \"95dbfc71-6afe-4106-b073-5a1edcc8788f\") " pod="openstack-kuttl-tests/neutron-8bf9bfcb4-2674f" Mar 16 16:56:54 crc kubenswrapper[5120]: I0316 16:56:54.957384 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/95dbfc71-6afe-4106-b073-5a1edcc8788f-httpd-config\") pod \"neutron-8bf9bfcb4-2674f\" (UID: \"95dbfc71-6afe-4106-b073-5a1edcc8788f\") " pod="openstack-kuttl-tests/neutron-8bf9bfcb4-2674f" Mar 16 16:56:54 crc kubenswrapper[5120]: I0316 16:56:54.957601 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/95dbfc71-6afe-4106-b073-5a1edcc8788f-config\") pod \"neutron-8bf9bfcb4-2674f\" (UID: \"95dbfc71-6afe-4106-b073-5a1edcc8788f\") " pod="openstack-kuttl-tests/neutron-8bf9bfcb4-2674f" Mar 16 16:56:54 crc kubenswrapper[5120]: I0316 16:56:54.957777 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/95dbfc71-6afe-4106-b073-5a1edcc8788f-ovndb-tls-certs\") pod \"neutron-8bf9bfcb4-2674f\" (UID: \"95dbfc71-6afe-4106-b073-5a1edcc8788f\") " pod="openstack-kuttl-tests/neutron-8bf9bfcb4-2674f" Mar 16 16:56:55 crc kubenswrapper[5120]: I0316 16:56:55.059651 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3264bd71-ad28-4b8e-a7e7-91508c6a6f25-scripts\") pod \"3264bd71-ad28-4b8e-a7e7-91508c6a6f25\" (UID: \"3264bd71-ad28-4b8e-a7e7-91508c6a6f25\") " Mar 16 16:56:55 crc kubenswrapper[5120]: I0316 16:56:55.059890 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3264bd71-ad28-4b8e-a7e7-91508c6a6f25-combined-ca-bundle\") pod \"3264bd71-ad28-4b8e-a7e7-91508c6a6f25\" (UID: \"3264bd71-ad28-4b8e-a7e7-91508c6a6f25\") " Mar 16 16:56:55 crc kubenswrapper[5120]: I0316 16:56:55.060058 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/3264bd71-ad28-4b8e-a7e7-91508c6a6f25-etc-machine-id\") pod \"3264bd71-ad28-4b8e-a7e7-91508c6a6f25\" (UID: \"3264bd71-ad28-4b8e-a7e7-91508c6a6f25\") " Mar 16 16:56:55 crc kubenswrapper[5120]: I0316 16:56:55.060215 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3264bd71-ad28-4b8e-a7e7-91508c6a6f25-config-data\") pod \"3264bd71-ad28-4b8e-a7e7-91508c6a6f25\" (UID: \"3264bd71-ad28-4b8e-a7e7-91508c6a6f25\") " Mar 16 16:56:55 crc kubenswrapper[5120]: I0316 16:56:55.060430 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/3264bd71-ad28-4b8e-a7e7-91508c6a6f25-config-data-custom\") pod \"3264bd71-ad28-4b8e-a7e7-91508c6a6f25\" (UID: \"3264bd71-ad28-4b8e-a7e7-91508c6a6f25\") " Mar 16 16:56:55 crc kubenswrapper[5120]: I0316 16:56:55.060583 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wxscs\" (UniqueName: \"kubernetes.io/projected/3264bd71-ad28-4b8e-a7e7-91508c6a6f25-kube-api-access-wxscs\") pod \"3264bd71-ad28-4b8e-a7e7-91508c6a6f25\" (UID: \"3264bd71-ad28-4b8e-a7e7-91508c6a6f25\") " Mar 16 16:56:55 crc kubenswrapper[5120]: I0316 16:56:55.060872 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/95dbfc71-6afe-4106-b073-5a1edcc8788f-internal-tls-certs\") pod \"neutron-8bf9bfcb4-2674f\" (UID: \"95dbfc71-6afe-4106-b073-5a1edcc8788f\") " pod="openstack-kuttl-tests/neutron-8bf9bfcb4-2674f" Mar 16 16:56:55 crc kubenswrapper[5120]: I0316 16:56:55.060937 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wnp4p\" (UniqueName: \"kubernetes.io/projected/95dbfc71-6afe-4106-b073-5a1edcc8788f-kube-api-access-wnp4p\") pod \"neutron-8bf9bfcb4-2674f\" (UID: \"95dbfc71-6afe-4106-b073-5a1edcc8788f\") " pod="openstack-kuttl-tests/neutron-8bf9bfcb4-2674f" Mar 16 16:56:55 crc kubenswrapper[5120]: I0316 16:56:55.061106 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/95dbfc71-6afe-4106-b073-5a1edcc8788f-combined-ca-bundle\") pod \"neutron-8bf9bfcb4-2674f\" (UID: \"95dbfc71-6afe-4106-b073-5a1edcc8788f\") " pod="openstack-kuttl-tests/neutron-8bf9bfcb4-2674f" Mar 16 16:56:55 crc kubenswrapper[5120]: I0316 16:56:55.061147 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/95dbfc71-6afe-4106-b073-5a1edcc8788f-public-tls-certs\") pod \"neutron-8bf9bfcb4-2674f\" (UID: \"95dbfc71-6afe-4106-b073-5a1edcc8788f\") " pod="openstack-kuttl-tests/neutron-8bf9bfcb4-2674f" Mar 16 16:56:55 crc kubenswrapper[5120]: I0316 16:56:55.061222 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/95dbfc71-6afe-4106-b073-5a1edcc8788f-httpd-config\") pod \"neutron-8bf9bfcb4-2674f\" (UID: \"95dbfc71-6afe-4106-b073-5a1edcc8788f\") " pod="openstack-kuttl-tests/neutron-8bf9bfcb4-2674f" Mar 16 16:56:55 crc kubenswrapper[5120]: I0316 16:56:55.061386 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/95dbfc71-6afe-4106-b073-5a1edcc8788f-config\") pod \"neutron-8bf9bfcb4-2674f\" (UID: \"95dbfc71-6afe-4106-b073-5a1edcc8788f\") " pod="openstack-kuttl-tests/neutron-8bf9bfcb4-2674f" Mar 16 16:56:55 crc kubenswrapper[5120]: I0316 16:56:55.061576 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/95dbfc71-6afe-4106-b073-5a1edcc8788f-ovndb-tls-certs\") pod \"neutron-8bf9bfcb4-2674f\" (UID: \"95dbfc71-6afe-4106-b073-5a1edcc8788f\") " pod="openstack-kuttl-tests/neutron-8bf9bfcb4-2674f" Mar 16 16:56:55 crc kubenswrapper[5120]: I0316 16:56:55.063687 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/3264bd71-ad28-4b8e-a7e7-91508c6a6f25-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "3264bd71-ad28-4b8e-a7e7-91508c6a6f25" (UID: "3264bd71-ad28-4b8e-a7e7-91508c6a6f25"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 16:56:55 crc kubenswrapper[5120]: I0316 16:56:55.067813 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/95dbfc71-6afe-4106-b073-5a1edcc8788f-public-tls-certs\") pod \"neutron-8bf9bfcb4-2674f\" (UID: \"95dbfc71-6afe-4106-b073-5a1edcc8788f\") " pod="openstack-kuttl-tests/neutron-8bf9bfcb4-2674f" Mar 16 16:56:55 crc kubenswrapper[5120]: I0316 16:56:55.068835 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/95dbfc71-6afe-4106-b073-5a1edcc8788f-ovndb-tls-certs\") pod \"neutron-8bf9bfcb4-2674f\" (UID: \"95dbfc71-6afe-4106-b073-5a1edcc8788f\") " pod="openstack-kuttl-tests/neutron-8bf9bfcb4-2674f" Mar 16 16:56:55 crc kubenswrapper[5120]: I0316 16:56:55.068956 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/95dbfc71-6afe-4106-b073-5a1edcc8788f-httpd-config\") pod \"neutron-8bf9bfcb4-2674f\" (UID: \"95dbfc71-6afe-4106-b073-5a1edcc8788f\") " pod="openstack-kuttl-tests/neutron-8bf9bfcb4-2674f" Mar 16 16:56:55 crc kubenswrapper[5120]: I0316 16:56:55.069000 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3264bd71-ad28-4b8e-a7e7-91508c6a6f25-scripts" (OuterVolumeSpecName: "scripts") pod "3264bd71-ad28-4b8e-a7e7-91508c6a6f25" (UID: "3264bd71-ad28-4b8e-a7e7-91508c6a6f25"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:56:55 crc kubenswrapper[5120]: I0316 16:56:55.069219 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3264bd71-ad28-4b8e-a7e7-91508c6a6f25-kube-api-access-wxscs" (OuterVolumeSpecName: "kube-api-access-wxscs") pod "3264bd71-ad28-4b8e-a7e7-91508c6a6f25" (UID: "3264bd71-ad28-4b8e-a7e7-91508c6a6f25"). InnerVolumeSpecName "kube-api-access-wxscs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:56:55 crc kubenswrapper[5120]: I0316 16:56:55.070647 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/95dbfc71-6afe-4106-b073-5a1edcc8788f-combined-ca-bundle\") pod \"neutron-8bf9bfcb4-2674f\" (UID: \"95dbfc71-6afe-4106-b073-5a1edcc8788f\") " pod="openstack-kuttl-tests/neutron-8bf9bfcb4-2674f" Mar 16 16:56:55 crc kubenswrapper[5120]: I0316 16:56:55.070783 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3264bd71-ad28-4b8e-a7e7-91508c6a6f25-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "3264bd71-ad28-4b8e-a7e7-91508c6a6f25" (UID: "3264bd71-ad28-4b8e-a7e7-91508c6a6f25"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:56:55 crc kubenswrapper[5120]: I0316 16:56:55.085794 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/95dbfc71-6afe-4106-b073-5a1edcc8788f-internal-tls-certs\") pod \"neutron-8bf9bfcb4-2674f\" (UID: \"95dbfc71-6afe-4106-b073-5a1edcc8788f\") " pod="openstack-kuttl-tests/neutron-8bf9bfcb4-2674f" Mar 16 16:56:55 crc kubenswrapper[5120]: I0316 16:56:55.085995 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/95dbfc71-6afe-4106-b073-5a1edcc8788f-config\") pod \"neutron-8bf9bfcb4-2674f\" (UID: \"95dbfc71-6afe-4106-b073-5a1edcc8788f\") " pod="openstack-kuttl-tests/neutron-8bf9bfcb4-2674f" Mar 16 16:56:55 crc kubenswrapper[5120]: I0316 16:56:55.090067 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnp4p\" (UniqueName: \"kubernetes.io/projected/95dbfc71-6afe-4106-b073-5a1edcc8788f-kube-api-access-wnp4p\") pod \"neutron-8bf9bfcb4-2674f\" (UID: \"95dbfc71-6afe-4106-b073-5a1edcc8788f\") " pod="openstack-kuttl-tests/neutron-8bf9bfcb4-2674f" Mar 16 16:56:55 crc kubenswrapper[5120]: I0316 16:56:55.121657 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3264bd71-ad28-4b8e-a7e7-91508c6a6f25-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "3264bd71-ad28-4b8e-a7e7-91508c6a6f25" (UID: "3264bd71-ad28-4b8e-a7e7-91508c6a6f25"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:56:55 crc kubenswrapper[5120]: I0316 16:56:55.164013 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3264bd71-ad28-4b8e-a7e7-91508c6a6f25-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:56:55 crc kubenswrapper[5120]: I0316 16:56:55.164052 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3264bd71-ad28-4b8e-a7e7-91508c6a6f25-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:56:55 crc kubenswrapper[5120]: I0316 16:56:55.164063 5120 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/3264bd71-ad28-4b8e-a7e7-91508c6a6f25-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 16:56:55 crc kubenswrapper[5120]: I0316 16:56:55.164072 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/3264bd71-ad28-4b8e-a7e7-91508c6a6f25-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:56:55 crc kubenswrapper[5120]: I0316 16:56:55.164081 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wxscs\" (UniqueName: \"kubernetes.io/projected/3264bd71-ad28-4b8e-a7e7-91508c6a6f25-kube-api-access-wxscs\") on node \"crc\" DevicePath \"\"" Mar 16 16:56:55 crc kubenswrapper[5120]: I0316 16:56:55.171232 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3264bd71-ad28-4b8e-a7e7-91508c6a6f25-config-data" (OuterVolumeSpecName: "config-data") pod "3264bd71-ad28-4b8e-a7e7-91508c6a6f25" (UID: "3264bd71-ad28-4b8e-a7e7-91508c6a6f25"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:56:55 crc kubenswrapper[5120]: I0316 16:56:55.236885 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-8bf9bfcb4-2674f" Mar 16 16:56:55 crc kubenswrapper[5120]: I0316 16:56:55.266319 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3264bd71-ad28-4b8e-a7e7-91508c6a6f25-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:56:55 crc kubenswrapper[5120]: I0316 16:56:55.673287 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:56:55 crc kubenswrapper[5120]: I0316 16:56:55.673275 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"3264bd71-ad28-4b8e-a7e7-91508c6a6f25","Type":"ContainerDied","Data":"8c33f13da7b0ae65d3a820e3586e3fb17ff57995b1610769bc71820e1cc1ad4c"} Mar 16 16:56:55 crc kubenswrapper[5120]: I0316 16:56:55.674415 5120 scope.go:117] "RemoveContainer" containerID="5d21bea438f7664e4ebd23ffae013cadaff70d8624489dcdd5d88a35e2abae0c" Mar 16 16:56:55 crc kubenswrapper[5120]: I0316 16:56:55.698706 5120 scope.go:117] "RemoveContainer" containerID="b583abe5db9352e6c81bea08f9819a58ef3fc82fe7a4428c2aaef72b3a4710b4" Mar 16 16:56:55 crc kubenswrapper[5120]: I0316 16:56:55.741499 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-8bf9bfcb4-2674f"] Mar 16 16:56:55 crc kubenswrapper[5120]: I0316 16:56:55.760908 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:56:55 crc kubenswrapper[5120]: I0316 16:56:55.778211 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:56:55 crc kubenswrapper[5120]: I0316 16:56:55.797649 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:56:55 crc kubenswrapper[5120]: I0316 16:56:55.799823 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3264bd71-ad28-4b8e-a7e7-91508c6a6f25" containerName="probe" Mar 16 16:56:55 crc kubenswrapper[5120]: I0316 16:56:55.799847 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="3264bd71-ad28-4b8e-a7e7-91508c6a6f25" containerName="probe" Mar 16 16:56:55 crc kubenswrapper[5120]: I0316 16:56:55.799908 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3264bd71-ad28-4b8e-a7e7-91508c6a6f25" containerName="cinder-scheduler" Mar 16 16:56:55 crc kubenswrapper[5120]: I0316 16:56:55.799915 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="3264bd71-ad28-4b8e-a7e7-91508c6a6f25" containerName="cinder-scheduler" Mar 16 16:56:55 crc kubenswrapper[5120]: I0316 16:56:55.800278 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="3264bd71-ad28-4b8e-a7e7-91508c6a6f25" containerName="probe" Mar 16 16:56:55 crc kubenswrapper[5120]: I0316 16:56:55.800310 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="3264bd71-ad28-4b8e-a7e7-91508c6a6f25" containerName="cinder-scheduler" Mar 16 16:56:55 crc kubenswrapper[5120]: I0316 16:56:55.813063 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:56:55 crc kubenswrapper[5120]: I0316 16:56:55.813203 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:56:55 crc kubenswrapper[5120]: I0316 16:56:55.817524 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-scheduler-config-data\"" Mar 16 16:56:55 crc kubenswrapper[5120]: I0316 16:56:55.895392 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/d82f3b2b-c672-46ff-8fc8-afc5b33e8252-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"d82f3b2b-c672-46ff-8fc8-afc5b33e8252\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:56:55 crc kubenswrapper[5120]: I0316 16:56:55.895829 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d82f3b2b-c672-46ff-8fc8-afc5b33e8252-config-data\") pod \"cinder-scheduler-0\" (UID: \"d82f3b2b-c672-46ff-8fc8-afc5b33e8252\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:56:55 crc kubenswrapper[5120]: I0316 16:56:55.896101 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d82f3b2b-c672-46ff-8fc8-afc5b33e8252-scripts\") pod \"cinder-scheduler-0\" (UID: \"d82f3b2b-c672-46ff-8fc8-afc5b33e8252\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:56:55 crc kubenswrapper[5120]: I0316 16:56:55.896507 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d82f3b2b-c672-46ff-8fc8-afc5b33e8252-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"d82f3b2b-c672-46ff-8fc8-afc5b33e8252\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:56:55 crc kubenswrapper[5120]: I0316 16:56:55.896617 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/d82f3b2b-c672-46ff-8fc8-afc5b33e8252-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"d82f3b2b-c672-46ff-8fc8-afc5b33e8252\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:56:55 crc kubenswrapper[5120]: I0316 16:56:55.896876 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlrn8\" (UniqueName: \"kubernetes.io/projected/d82f3b2b-c672-46ff-8fc8-afc5b33e8252-kube-api-access-wlrn8\") pod \"cinder-scheduler-0\" (UID: \"d82f3b2b-c672-46ff-8fc8-afc5b33e8252\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:56:55 crc kubenswrapper[5120]: I0316 16:56:55.999701 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/d82f3b2b-c672-46ff-8fc8-afc5b33e8252-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"d82f3b2b-c672-46ff-8fc8-afc5b33e8252\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:56:55 crc kubenswrapper[5120]: I0316 16:56:55.999780 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d82f3b2b-c672-46ff-8fc8-afc5b33e8252-config-data\") pod \"cinder-scheduler-0\" (UID: \"d82f3b2b-c672-46ff-8fc8-afc5b33e8252\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:56:55 crc kubenswrapper[5120]: I0316 16:56:55.999910 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d82f3b2b-c672-46ff-8fc8-afc5b33e8252-scripts\") pod \"cinder-scheduler-0\" (UID: \"d82f3b2b-c672-46ff-8fc8-afc5b33e8252\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:56:56 crc kubenswrapper[5120]: I0316 16:56:56.000110 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d82f3b2b-c672-46ff-8fc8-afc5b33e8252-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"d82f3b2b-c672-46ff-8fc8-afc5b33e8252\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:56:56 crc kubenswrapper[5120]: I0316 16:56:56.000142 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/d82f3b2b-c672-46ff-8fc8-afc5b33e8252-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"d82f3b2b-c672-46ff-8fc8-afc5b33e8252\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:56:56 crc kubenswrapper[5120]: I0316 16:56:56.000205 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wlrn8\" (UniqueName: \"kubernetes.io/projected/d82f3b2b-c672-46ff-8fc8-afc5b33e8252-kube-api-access-wlrn8\") pod \"cinder-scheduler-0\" (UID: \"d82f3b2b-c672-46ff-8fc8-afc5b33e8252\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:56:56 crc kubenswrapper[5120]: I0316 16:56:56.000663 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/d82f3b2b-c672-46ff-8fc8-afc5b33e8252-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"d82f3b2b-c672-46ff-8fc8-afc5b33e8252\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:56:56 crc kubenswrapper[5120]: I0316 16:56:56.005347 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d82f3b2b-c672-46ff-8fc8-afc5b33e8252-scripts\") pod \"cinder-scheduler-0\" (UID: \"d82f3b2b-c672-46ff-8fc8-afc5b33e8252\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:56:56 crc kubenswrapper[5120]: I0316 16:56:56.005820 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/d82f3b2b-c672-46ff-8fc8-afc5b33e8252-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"d82f3b2b-c672-46ff-8fc8-afc5b33e8252\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:56:56 crc kubenswrapper[5120]: I0316 16:56:56.006107 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d82f3b2b-c672-46ff-8fc8-afc5b33e8252-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"d82f3b2b-c672-46ff-8fc8-afc5b33e8252\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:56:56 crc kubenswrapper[5120]: I0316 16:56:56.006183 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d82f3b2b-c672-46ff-8fc8-afc5b33e8252-config-data\") pod \"cinder-scheduler-0\" (UID: \"d82f3b2b-c672-46ff-8fc8-afc5b33e8252\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:56:56 crc kubenswrapper[5120]: I0316 16:56:56.017279 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlrn8\" (UniqueName: \"kubernetes.io/projected/d82f3b2b-c672-46ff-8fc8-afc5b33e8252-kube-api-access-wlrn8\") pod \"cinder-scheduler-0\" (UID: \"d82f3b2b-c672-46ff-8fc8-afc5b33e8252\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:56:56 crc kubenswrapper[5120]: I0316 16:56:56.143047 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:56:56 crc kubenswrapper[5120]: I0316 16:56:56.664346 5120 scope.go:117] "RemoveContainer" containerID="083f72646c8d47c9c0467b39be99ddfa9c2e5900ae0a29ad53d7b39b950274b4" Mar 16 16:56:56 crc kubenswrapper[5120]: E0316 16:56:56.664779 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:56:56 crc kubenswrapper[5120]: I0316 16:56:56.681375 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3264bd71-ad28-4b8e-a7e7-91508c6a6f25" path="/var/lib/kubelet/pods/3264bd71-ad28-4b8e-a7e7-91508c6a6f25/volumes" Mar 16 16:56:56 crc kubenswrapper[5120]: I0316 16:56:56.696132 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-8bf9bfcb4-2674f" event={"ID":"95dbfc71-6afe-4106-b073-5a1edcc8788f","Type":"ContainerStarted","Data":"43e6ee80bea5ccacd6e9cadc35391850863b090665249e7bb5dc73470649ce9d"} Mar 16 16:56:56 crc kubenswrapper[5120]: I0316 16:56:56.696179 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-8bf9bfcb4-2674f" event={"ID":"95dbfc71-6afe-4106-b073-5a1edcc8788f","Type":"ContainerStarted","Data":"5710a825d9e4076d2f3ae7a10f79b432da7ef32f643953fd0702e760bcea2f0a"} Mar 16 16:56:56 crc kubenswrapper[5120]: I0316 16:56:56.696188 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-8bf9bfcb4-2674f" event={"ID":"95dbfc71-6afe-4106-b073-5a1edcc8788f","Type":"ContainerStarted","Data":"07b36da95c63b12da12f2880154c3d89e00fdbc5f6e3f1b478785dc4a210a94f"} Mar 16 16:56:56 crc kubenswrapper[5120]: I0316 16:56:56.697922 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 16:56:56 crc kubenswrapper[5120]: I0316 16:56:56.698136 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/neutron-8bf9bfcb4-2674f" Mar 16 16:56:56 crc kubenswrapper[5120]: I0316 16:56:56.740716 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-8bf9bfcb4-2674f" podStartSLOduration=2.740693829 podStartE2EDuration="2.740693829s" podCreationTimestamp="2026-03-16 16:56:54 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:56:56.731468497 +0000 UTC m=+5118.885400154" watchObservedRunningTime="2026-03-16 16:56:56.740693829 +0000 UTC m=+5118.894625486" Mar 16 16:56:57 crc kubenswrapper[5120]: I0316 16:56:57.729360 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"d82f3b2b-c672-46ff-8fc8-afc5b33e8252","Type":"ContainerStarted","Data":"7feb79b771d86b2c75df62e3a6f170b8f26b31b6c9b737ba8b03de06cf953429"} Mar 16 16:56:57 crc kubenswrapper[5120]: I0316 16:56:57.730433 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"d82f3b2b-c672-46ff-8fc8-afc5b33e8252","Type":"ContainerStarted","Data":"1b2b16cda7068251a7f7f7c9fb939821dc436b883deecf9a44b1d5bb6ff93586"} Mar 16 16:56:58 crc kubenswrapper[5120]: I0316 16:56:58.255120 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-774bd9565b-8dqvz" Mar 16 16:56:58 crc kubenswrapper[5120]: I0316 16:56:58.696064 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-774bd9565b-8dqvz" Mar 16 16:56:58 crc kubenswrapper[5120]: I0316 16:56:58.744439 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"d82f3b2b-c672-46ff-8fc8-afc5b33e8252","Type":"ContainerStarted","Data":"28657cd9914973413b6f6e9aeaea403f0c4337248a7147ff00ed46ba9a535468"} Mar 16 16:56:58 crc kubenswrapper[5120]: I0316 16:56:58.763694 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-6fc7988ff4-wrbrq"] Mar 16 16:56:58 crc kubenswrapper[5120]: I0316 16:56:58.763982 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-6fc7988ff4-wrbrq" podUID="4691e9c1-c324-494d-98da-d1436447f6ac" containerName="barbican-api-log" containerID="cri-o://010145a51f511ba5cc819e966ffb6af5a2127030416d479cd168a89c288f59e3" gracePeriod=30 Mar 16 16:56:58 crc kubenswrapper[5120]: I0316 16:56:58.765166 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-6fc7988ff4-wrbrq" podUID="4691e9c1-c324-494d-98da-d1436447f6ac" containerName="barbican-api" containerID="cri-o://65c36e21df554a7fcfdfd1f7c91b2b92654c429ab3cf0102defeffb108301415" gracePeriod=30 Mar 16 16:56:58 crc kubenswrapper[5120]: I0316 16:56:58.790509 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-scheduler-0" podStartSLOduration=3.790483043 podStartE2EDuration="3.790483043s" podCreationTimestamp="2026-03-16 16:56:55 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:56:58.774248859 +0000 UTC m=+5120.928180516" watchObservedRunningTime="2026-03-16 16:56:58.790483043 +0000 UTC m=+5120.944414720" Mar 16 16:56:59 crc kubenswrapper[5120]: I0316 16:56:59.028111 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 16:56:59 crc kubenswrapper[5120]: I0316 16:56:59.757545 5120 generic.go:358] "Generic (PLEG): container finished" podID="4691e9c1-c324-494d-98da-d1436447f6ac" containerID="010145a51f511ba5cc819e966ffb6af5a2127030416d479cd168a89c288f59e3" exitCode=143 Mar 16 16:56:59 crc kubenswrapper[5120]: I0316 16:56:59.757624 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-6fc7988ff4-wrbrq" event={"ID":"4691e9c1-c324-494d-98da-d1436447f6ac","Type":"ContainerDied","Data":"010145a51f511ba5cc819e966ffb6af5a2127030416d479cd168a89c288f59e3"} Mar 16 16:57:01 crc kubenswrapper[5120]: I0316 16:57:01.143420 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:57:01 crc kubenswrapper[5120]: I0316 16:57:01.989589 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-6fc7988ff4-wrbrq" podUID="4691e9c1-c324-494d-98da-d1436447f6ac" containerName="barbican-api" probeResult="failure" output="Get \"http://10.217.1.6:9311/healthcheck\": read tcp 10.217.0.2:52460->10.217.1.6:9311: read: connection reset by peer" Mar 16 16:57:02 crc kubenswrapper[5120]: I0316 16:57:02.450815 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-6fc7988ff4-wrbrq" Mar 16 16:57:02 crc kubenswrapper[5120]: I0316 16:57:02.595475 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-frx4f\" (UniqueName: \"kubernetes.io/projected/4691e9c1-c324-494d-98da-d1436447f6ac-kube-api-access-frx4f\") pod \"4691e9c1-c324-494d-98da-d1436447f6ac\" (UID: \"4691e9c1-c324-494d-98da-d1436447f6ac\") " Mar 16 16:57:02 crc kubenswrapper[5120]: I0316 16:57:02.595999 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4691e9c1-c324-494d-98da-d1436447f6ac-combined-ca-bundle\") pod \"4691e9c1-c324-494d-98da-d1436447f6ac\" (UID: \"4691e9c1-c324-494d-98da-d1436447f6ac\") " Mar 16 16:57:02 crc kubenswrapper[5120]: I0316 16:57:02.596317 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4691e9c1-c324-494d-98da-d1436447f6ac-config-data\") pod \"4691e9c1-c324-494d-98da-d1436447f6ac\" (UID: \"4691e9c1-c324-494d-98da-d1436447f6ac\") " Mar 16 16:57:02 crc kubenswrapper[5120]: I0316 16:57:02.596520 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/4691e9c1-c324-494d-98da-d1436447f6ac-config-data-custom\") pod \"4691e9c1-c324-494d-98da-d1436447f6ac\" (UID: \"4691e9c1-c324-494d-98da-d1436447f6ac\") " Mar 16 16:57:02 crc kubenswrapper[5120]: I0316 16:57:02.596566 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4691e9c1-c324-494d-98da-d1436447f6ac-logs\") pod \"4691e9c1-c324-494d-98da-d1436447f6ac\" (UID: \"4691e9c1-c324-494d-98da-d1436447f6ac\") " Mar 16 16:57:02 crc kubenswrapper[5120]: I0316 16:57:02.597142 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4691e9c1-c324-494d-98da-d1436447f6ac-logs" (OuterVolumeSpecName: "logs") pod "4691e9c1-c324-494d-98da-d1436447f6ac" (UID: "4691e9c1-c324-494d-98da-d1436447f6ac"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:57:02 crc kubenswrapper[5120]: I0316 16:57:02.597639 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4691e9c1-c324-494d-98da-d1436447f6ac-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:57:02 crc kubenswrapper[5120]: I0316 16:57:02.601550 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4691e9c1-c324-494d-98da-d1436447f6ac-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "4691e9c1-c324-494d-98da-d1436447f6ac" (UID: "4691e9c1-c324-494d-98da-d1436447f6ac"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:57:02 crc kubenswrapper[5120]: I0316 16:57:02.604554 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4691e9c1-c324-494d-98da-d1436447f6ac-kube-api-access-frx4f" (OuterVolumeSpecName: "kube-api-access-frx4f") pod "4691e9c1-c324-494d-98da-d1436447f6ac" (UID: "4691e9c1-c324-494d-98da-d1436447f6ac"). InnerVolumeSpecName "kube-api-access-frx4f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:57:02 crc kubenswrapper[5120]: I0316 16:57:02.625358 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4691e9c1-c324-494d-98da-d1436447f6ac-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "4691e9c1-c324-494d-98da-d1436447f6ac" (UID: "4691e9c1-c324-494d-98da-d1436447f6ac"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:57:02 crc kubenswrapper[5120]: I0316 16:57:02.647437 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4691e9c1-c324-494d-98da-d1436447f6ac-config-data" (OuterVolumeSpecName: "config-data") pod "4691e9c1-c324-494d-98da-d1436447f6ac" (UID: "4691e9c1-c324-494d-98da-d1436447f6ac"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:57:02 crc kubenswrapper[5120]: I0316 16:57:02.681645 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/placement-6dbf47b8f6-ghhnl" Mar 16 16:57:02 crc kubenswrapper[5120]: I0316 16:57:02.700616 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/4691e9c1-c324-494d-98da-d1436447f6ac-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 16:57:02 crc kubenswrapper[5120]: I0316 16:57:02.700683 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-frx4f\" (UniqueName: \"kubernetes.io/projected/4691e9c1-c324-494d-98da-d1436447f6ac-kube-api-access-frx4f\") on node \"crc\" DevicePath \"\"" Mar 16 16:57:02 crc kubenswrapper[5120]: I0316 16:57:02.700699 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4691e9c1-c324-494d-98da-d1436447f6ac-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:57:02 crc kubenswrapper[5120]: I0316 16:57:02.700711 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4691e9c1-c324-494d-98da-d1436447f6ac-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:57:02 crc kubenswrapper[5120]: I0316 16:57:02.796697 5120 generic.go:358] "Generic (PLEG): container finished" podID="4691e9c1-c324-494d-98da-d1436447f6ac" containerID="65c36e21df554a7fcfdfd1f7c91b2b92654c429ab3cf0102defeffb108301415" exitCode=0 Mar 16 16:57:02 crc kubenswrapper[5120]: I0316 16:57:02.796808 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-6fc7988ff4-wrbrq" event={"ID":"4691e9c1-c324-494d-98da-d1436447f6ac","Type":"ContainerDied","Data":"65c36e21df554a7fcfdfd1f7c91b2b92654c429ab3cf0102defeffb108301415"} Mar 16 16:57:02 crc kubenswrapper[5120]: I0316 16:57:02.796882 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-6fc7988ff4-wrbrq" event={"ID":"4691e9c1-c324-494d-98da-d1436447f6ac","Type":"ContainerDied","Data":"691d76de507030735d50edea35f943d16ac768a831104a855ecddd4e31a26ab2"} Mar 16 16:57:02 crc kubenswrapper[5120]: I0316 16:57:02.796914 5120 scope.go:117] "RemoveContainer" containerID="65c36e21df554a7fcfdfd1f7c91b2b92654c429ab3cf0102defeffb108301415" Mar 16 16:57:02 crc kubenswrapper[5120]: I0316 16:57:02.796827 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-6fc7988ff4-wrbrq" Mar 16 16:57:02 crc kubenswrapper[5120]: I0316 16:57:02.827497 5120 scope.go:117] "RemoveContainer" containerID="010145a51f511ba5cc819e966ffb6af5a2127030416d479cd168a89c288f59e3" Mar 16 16:57:02 crc kubenswrapper[5120]: I0316 16:57:02.837001 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-6fc7988ff4-wrbrq"] Mar 16 16:57:02 crc kubenswrapper[5120]: I0316 16:57:02.858587 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-api-6fc7988ff4-wrbrq"] Mar 16 16:57:02 crc kubenswrapper[5120]: I0316 16:57:02.865727 5120 scope.go:117] "RemoveContainer" containerID="65c36e21df554a7fcfdfd1f7c91b2b92654c429ab3cf0102defeffb108301415" Mar 16 16:57:02 crc kubenswrapper[5120]: E0316 16:57:02.866125 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"65c36e21df554a7fcfdfd1f7c91b2b92654c429ab3cf0102defeffb108301415\": container with ID starting with 65c36e21df554a7fcfdfd1f7c91b2b92654c429ab3cf0102defeffb108301415 not found: ID does not exist" containerID="65c36e21df554a7fcfdfd1f7c91b2b92654c429ab3cf0102defeffb108301415" Mar 16 16:57:02 crc kubenswrapper[5120]: I0316 16:57:02.866172 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65c36e21df554a7fcfdfd1f7c91b2b92654c429ab3cf0102defeffb108301415"} err="failed to get container status \"65c36e21df554a7fcfdfd1f7c91b2b92654c429ab3cf0102defeffb108301415\": rpc error: code = NotFound desc = could not find container \"65c36e21df554a7fcfdfd1f7c91b2b92654c429ab3cf0102defeffb108301415\": container with ID starting with 65c36e21df554a7fcfdfd1f7c91b2b92654c429ab3cf0102defeffb108301415 not found: ID does not exist" Mar 16 16:57:02 crc kubenswrapper[5120]: I0316 16:57:02.866199 5120 scope.go:117] "RemoveContainer" containerID="010145a51f511ba5cc819e966ffb6af5a2127030416d479cd168a89c288f59e3" Mar 16 16:57:02 crc kubenswrapper[5120]: E0316 16:57:02.866444 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"010145a51f511ba5cc819e966ffb6af5a2127030416d479cd168a89c288f59e3\": container with ID starting with 010145a51f511ba5cc819e966ffb6af5a2127030416d479cd168a89c288f59e3 not found: ID does not exist" containerID="010145a51f511ba5cc819e966ffb6af5a2127030416d479cd168a89c288f59e3" Mar 16 16:57:02 crc kubenswrapper[5120]: I0316 16:57:02.866484 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"010145a51f511ba5cc819e966ffb6af5a2127030416d479cd168a89c288f59e3"} err="failed to get container status \"010145a51f511ba5cc819e966ffb6af5a2127030416d479cd168a89c288f59e3\": rpc error: code = NotFound desc = could not find container \"010145a51f511ba5cc819e966ffb6af5a2127030416d479cd168a89c288f59e3\": container with ID starting with 010145a51f511ba5cc819e966ffb6af5a2127030416d479cd168a89c288f59e3 not found: ID does not exist" Mar 16 16:57:02 crc kubenswrapper[5120]: I0316 16:57:02.976688 5120 scope.go:117] "RemoveContainer" containerID="5e5f592520f6ae20d5410c39304d3dbb7bd389193db5398803d4448db4514bde" Mar 16 16:57:03 crc kubenswrapper[5120]: I0316 16:57:03.001545 5120 scope.go:117] "RemoveContainer" containerID="85bedc1e29ce36a378b928f6e74a20a0006ccd5ad43cd648a09420884822acca" Mar 16 16:57:03 crc kubenswrapper[5120]: I0316 16:57:03.024050 5120 scope.go:117] "RemoveContainer" containerID="33a337777a56380f0a0d97bc5d689d730f9a15c8b90423ac83df28cd5f72cdea" Mar 16 16:57:03 crc kubenswrapper[5120]: I0316 16:57:03.045985 5120 scope.go:117] "RemoveContainer" containerID="94a0984603d5bdc59410680ea92bf614dd65b62b0534a0dff6970ab8a0e20e27" Mar 16 16:57:03 crc kubenswrapper[5120]: I0316 16:57:03.071144 5120 scope.go:117] "RemoveContainer" containerID="3be70b5ff49ff4f874dd20f28a1aaeef0ab75a3db9f4663ccf26dfa635bec36b" Mar 16 16:57:03 crc kubenswrapper[5120]: I0316 16:57:03.114373 5120 scope.go:117] "RemoveContainer" containerID="68f47c2138680932b56661bcd6125ef7eb13f546e55f20736f67e86ae78c7591" Mar 16 16:57:03 crc kubenswrapper[5120]: I0316 16:57:03.132533 5120 scope.go:117] "RemoveContainer" containerID="8cc66f619e52f2e843057161cb5972bf36695b3db04d91d03e4a9faa46d328b4" Mar 16 16:57:03 crc kubenswrapper[5120]: I0316 16:57:03.154320 5120 scope.go:117] "RemoveContainer" containerID="411356d69e314d94388d3be8985c1067e90f4cda6e4f2ae2f79448189fdd7603" Mar 16 16:57:03 crc kubenswrapper[5120]: I0316 16:57:03.192207 5120 scope.go:117] "RemoveContainer" containerID="b46421efcad9d5cfce98cb45e238d48b28afe72553a9d24bf1fc722eba0f8bf5" Mar 16 16:57:03 crc kubenswrapper[5120]: I0316 16:57:03.219002 5120 scope.go:117] "RemoveContainer" containerID="16aa9a28ba8e4dfebe20955c9aebe595a6848afaa458a5d1ccfd1c56d8bb2aed" Mar 16 16:57:03 crc kubenswrapper[5120]: I0316 16:57:03.240504 5120 scope.go:117] "RemoveContainer" containerID="9e58c6ff88801705f86e0adf1fbca075d147a3be9b63d9898ff8495fa9308987" Mar 16 16:57:03 crc kubenswrapper[5120]: I0316 16:57:03.261436 5120 scope.go:117] "RemoveContainer" containerID="3fa997bc814940b3b4080dddc58219038b0c096a73b18c1d1e89cd5769c6c049" Mar 16 16:57:03 crc kubenswrapper[5120]: I0316 16:57:03.309540 5120 scope.go:117] "RemoveContainer" containerID="83ccc49abbdcaf8fb197ccdc51e709384e13c3e5791c4949a472ee766ad078a7" Mar 16 16:57:03 crc kubenswrapper[5120]: I0316 16:57:03.334037 5120 scope.go:117] "RemoveContainer" containerID="0a7fb2f116993d3fda220b555e207a0d8e8a050b2888a15593419d4b03e68e4b" Mar 16 16:57:03 crc kubenswrapper[5120]: I0316 16:57:03.354730 5120 scope.go:117] "RemoveContainer" containerID="020f44c3cf6c107e17a170eb3a7361b1a565b2597ea573ccf12fb50dd79f6013" Mar 16 16:57:03 crc kubenswrapper[5120]: I0316 16:57:03.376869 5120 scope.go:117] "RemoveContainer" containerID="a50f502dcf9ac9ec39a46fcdfb0987499d1691d3eab94d676808ebf31f0e2a68" Mar 16 16:57:03 crc kubenswrapper[5120]: I0316 16:57:03.398075 5120 scope.go:117] "RemoveContainer" containerID="c46f9e15772d39f116270252a3295bca3e89cde74acfa2086206c3d0706abd66" Mar 16 16:57:03 crc kubenswrapper[5120]: I0316 16:57:03.491149 5120 scope.go:117] "RemoveContainer" containerID="f662ae8c35ca1f96dfff51a14c8bfa217d6d3c3615aefcfaf4fbaab8e0e3c8ff" Mar 16 16:57:03 crc kubenswrapper[5120]: I0316 16:57:03.513621 5120 scope.go:117] "RemoveContainer" containerID="5b3e8c00b8713699d929b1a7c050c59f2a7f5613beb583159b969397e1462736" Mar 16 16:57:03 crc kubenswrapper[5120]: I0316 16:57:03.537576 5120 scope.go:117] "RemoveContainer" containerID="d5ead9fcc8dbfab3297040cbfe1f71aefa0dbbb8a01a88712ffdf35d5d7ddb5a" Mar 16 16:57:03 crc kubenswrapper[5120]: I0316 16:57:03.715243 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/placement-6dbf47b8f6-ghhnl" Mar 16 16:57:03 crc kubenswrapper[5120]: I0316 16:57:03.945786 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-6c74bfb4f8-b872h"] Mar 16 16:57:03 crc kubenswrapper[5120]: I0316 16:57:03.947581 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4691e9c1-c324-494d-98da-d1436447f6ac" containerName="barbican-api" Mar 16 16:57:03 crc kubenswrapper[5120]: I0316 16:57:03.947748 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="4691e9c1-c324-494d-98da-d1436447f6ac" containerName="barbican-api" Mar 16 16:57:03 crc kubenswrapper[5120]: I0316 16:57:03.947868 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4691e9c1-c324-494d-98da-d1436447f6ac" containerName="barbican-api-log" Mar 16 16:57:03 crc kubenswrapper[5120]: I0316 16:57:03.947945 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="4691e9c1-c324-494d-98da-d1436447f6ac" containerName="barbican-api-log" Mar 16 16:57:03 crc kubenswrapper[5120]: I0316 16:57:03.948247 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="4691e9c1-c324-494d-98da-d1436447f6ac" containerName="barbican-api-log" Mar 16 16:57:03 crc kubenswrapper[5120]: I0316 16:57:03.948348 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="4691e9c1-c324-494d-98da-d1436447f6ac" containerName="barbican-api" Mar 16 16:57:03 crc kubenswrapper[5120]: I0316 16:57:03.955806 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-6c74bfb4f8-b872h" Mar 16 16:57:03 crc kubenswrapper[5120]: I0316 16:57:03.964317 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-6c74bfb4f8-b872h"] Mar 16 16:57:04 crc kubenswrapper[5120]: I0316 16:57:04.137400 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qn89\" (UniqueName: \"kubernetes.io/projected/36d5b175-81c4-4fc3-bb05-93958f9a7a63-kube-api-access-2qn89\") pod \"placement-6c74bfb4f8-b872h\" (UID: \"36d5b175-81c4-4fc3-bb05-93958f9a7a63\") " pod="openstack-kuttl-tests/placement-6c74bfb4f8-b872h" Mar 16 16:57:04 crc kubenswrapper[5120]: I0316 16:57:04.137638 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/36d5b175-81c4-4fc3-bb05-93958f9a7a63-config-data\") pod \"placement-6c74bfb4f8-b872h\" (UID: \"36d5b175-81c4-4fc3-bb05-93958f9a7a63\") " pod="openstack-kuttl-tests/placement-6c74bfb4f8-b872h" Mar 16 16:57:04 crc kubenswrapper[5120]: I0316 16:57:04.137812 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/36d5b175-81c4-4fc3-bb05-93958f9a7a63-logs\") pod \"placement-6c74bfb4f8-b872h\" (UID: \"36d5b175-81c4-4fc3-bb05-93958f9a7a63\") " pod="openstack-kuttl-tests/placement-6c74bfb4f8-b872h" Mar 16 16:57:04 crc kubenswrapper[5120]: I0316 16:57:04.138151 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/36d5b175-81c4-4fc3-bb05-93958f9a7a63-internal-tls-certs\") pod \"placement-6c74bfb4f8-b872h\" (UID: \"36d5b175-81c4-4fc3-bb05-93958f9a7a63\") " pod="openstack-kuttl-tests/placement-6c74bfb4f8-b872h" Mar 16 16:57:04 crc kubenswrapper[5120]: I0316 16:57:04.138207 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/36d5b175-81c4-4fc3-bb05-93958f9a7a63-scripts\") pod \"placement-6c74bfb4f8-b872h\" (UID: \"36d5b175-81c4-4fc3-bb05-93958f9a7a63\") " pod="openstack-kuttl-tests/placement-6c74bfb4f8-b872h" Mar 16 16:57:04 crc kubenswrapper[5120]: I0316 16:57:04.138241 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/36d5b175-81c4-4fc3-bb05-93958f9a7a63-public-tls-certs\") pod \"placement-6c74bfb4f8-b872h\" (UID: \"36d5b175-81c4-4fc3-bb05-93958f9a7a63\") " pod="openstack-kuttl-tests/placement-6c74bfb4f8-b872h" Mar 16 16:57:04 crc kubenswrapper[5120]: I0316 16:57:04.138274 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/36d5b175-81c4-4fc3-bb05-93958f9a7a63-combined-ca-bundle\") pod \"placement-6c74bfb4f8-b872h\" (UID: \"36d5b175-81c4-4fc3-bb05-93958f9a7a63\") " pod="openstack-kuttl-tests/placement-6c74bfb4f8-b872h" Mar 16 16:57:04 crc kubenswrapper[5120]: I0316 16:57:04.240618 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/36d5b175-81c4-4fc3-bb05-93958f9a7a63-internal-tls-certs\") pod \"placement-6c74bfb4f8-b872h\" (UID: \"36d5b175-81c4-4fc3-bb05-93958f9a7a63\") " pod="openstack-kuttl-tests/placement-6c74bfb4f8-b872h" Mar 16 16:57:04 crc kubenswrapper[5120]: I0316 16:57:04.240691 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/36d5b175-81c4-4fc3-bb05-93958f9a7a63-scripts\") pod \"placement-6c74bfb4f8-b872h\" (UID: \"36d5b175-81c4-4fc3-bb05-93958f9a7a63\") " pod="openstack-kuttl-tests/placement-6c74bfb4f8-b872h" Mar 16 16:57:04 crc kubenswrapper[5120]: I0316 16:57:04.240727 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/36d5b175-81c4-4fc3-bb05-93958f9a7a63-public-tls-certs\") pod \"placement-6c74bfb4f8-b872h\" (UID: \"36d5b175-81c4-4fc3-bb05-93958f9a7a63\") " pod="openstack-kuttl-tests/placement-6c74bfb4f8-b872h" Mar 16 16:57:04 crc kubenswrapper[5120]: I0316 16:57:04.240796 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/36d5b175-81c4-4fc3-bb05-93958f9a7a63-combined-ca-bundle\") pod \"placement-6c74bfb4f8-b872h\" (UID: \"36d5b175-81c4-4fc3-bb05-93958f9a7a63\") " pod="openstack-kuttl-tests/placement-6c74bfb4f8-b872h" Mar 16 16:57:04 crc kubenswrapper[5120]: I0316 16:57:04.240838 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2qn89\" (UniqueName: \"kubernetes.io/projected/36d5b175-81c4-4fc3-bb05-93958f9a7a63-kube-api-access-2qn89\") pod \"placement-6c74bfb4f8-b872h\" (UID: \"36d5b175-81c4-4fc3-bb05-93958f9a7a63\") " pod="openstack-kuttl-tests/placement-6c74bfb4f8-b872h" Mar 16 16:57:04 crc kubenswrapper[5120]: I0316 16:57:04.241027 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/36d5b175-81c4-4fc3-bb05-93958f9a7a63-config-data\") pod \"placement-6c74bfb4f8-b872h\" (UID: \"36d5b175-81c4-4fc3-bb05-93958f9a7a63\") " pod="openstack-kuttl-tests/placement-6c74bfb4f8-b872h" Mar 16 16:57:04 crc kubenswrapper[5120]: I0316 16:57:04.241107 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/36d5b175-81c4-4fc3-bb05-93958f9a7a63-logs\") pod \"placement-6c74bfb4f8-b872h\" (UID: \"36d5b175-81c4-4fc3-bb05-93958f9a7a63\") " pod="openstack-kuttl-tests/placement-6c74bfb4f8-b872h" Mar 16 16:57:04 crc kubenswrapper[5120]: I0316 16:57:04.241590 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/36d5b175-81c4-4fc3-bb05-93958f9a7a63-logs\") pod \"placement-6c74bfb4f8-b872h\" (UID: \"36d5b175-81c4-4fc3-bb05-93958f9a7a63\") " pod="openstack-kuttl-tests/placement-6c74bfb4f8-b872h" Mar 16 16:57:04 crc kubenswrapper[5120]: I0316 16:57:04.246464 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/36d5b175-81c4-4fc3-bb05-93958f9a7a63-public-tls-certs\") pod \"placement-6c74bfb4f8-b872h\" (UID: \"36d5b175-81c4-4fc3-bb05-93958f9a7a63\") " pod="openstack-kuttl-tests/placement-6c74bfb4f8-b872h" Mar 16 16:57:04 crc kubenswrapper[5120]: I0316 16:57:04.247467 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/36d5b175-81c4-4fc3-bb05-93958f9a7a63-internal-tls-certs\") pod \"placement-6c74bfb4f8-b872h\" (UID: \"36d5b175-81c4-4fc3-bb05-93958f9a7a63\") " pod="openstack-kuttl-tests/placement-6c74bfb4f8-b872h" Mar 16 16:57:04 crc kubenswrapper[5120]: I0316 16:57:04.250015 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/36d5b175-81c4-4fc3-bb05-93958f9a7a63-scripts\") pod \"placement-6c74bfb4f8-b872h\" (UID: \"36d5b175-81c4-4fc3-bb05-93958f9a7a63\") " pod="openstack-kuttl-tests/placement-6c74bfb4f8-b872h" Mar 16 16:57:04 crc kubenswrapper[5120]: I0316 16:57:04.250551 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/36d5b175-81c4-4fc3-bb05-93958f9a7a63-config-data\") pod \"placement-6c74bfb4f8-b872h\" (UID: \"36d5b175-81c4-4fc3-bb05-93958f9a7a63\") " pod="openstack-kuttl-tests/placement-6c74bfb4f8-b872h" Mar 16 16:57:04 crc kubenswrapper[5120]: I0316 16:57:04.254089 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/36d5b175-81c4-4fc3-bb05-93958f9a7a63-combined-ca-bundle\") pod \"placement-6c74bfb4f8-b872h\" (UID: \"36d5b175-81c4-4fc3-bb05-93958f9a7a63\") " pod="openstack-kuttl-tests/placement-6c74bfb4f8-b872h" Mar 16 16:57:04 crc kubenswrapper[5120]: I0316 16:57:04.263084 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qn89\" (UniqueName: \"kubernetes.io/projected/36d5b175-81c4-4fc3-bb05-93958f9a7a63-kube-api-access-2qn89\") pod \"placement-6c74bfb4f8-b872h\" (UID: \"36d5b175-81c4-4fc3-bb05-93958f9a7a63\") " pod="openstack-kuttl-tests/placement-6c74bfb4f8-b872h" Mar 16 16:57:04 crc kubenswrapper[5120]: I0316 16:57:04.323819 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-6c74bfb4f8-b872h" Mar 16 16:57:04 crc kubenswrapper[5120]: I0316 16:57:04.676222 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4691e9c1-c324-494d-98da-d1436447f6ac" path="/var/lib/kubelet/pods/4691e9c1-c324-494d-98da-d1436447f6ac/volumes" Mar 16 16:57:04 crc kubenswrapper[5120]: I0316 16:57:04.809951 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-6c74bfb4f8-b872h"] Mar 16 16:57:04 crc kubenswrapper[5120]: I0316 16:57:04.828440 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-6c74bfb4f8-b872h" event={"ID":"36d5b175-81c4-4fc3-bb05-93958f9a7a63","Type":"ContainerStarted","Data":"71584312a0bfafefaa393d016fa22d8339471a52aa59324fcd436f69dddfdd7e"} Mar 16 16:57:05 crc kubenswrapper[5120]: I0316 16:57:05.843792 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-6c74bfb4f8-b872h" event={"ID":"36d5b175-81c4-4fc3-bb05-93958f9a7a63","Type":"ContainerStarted","Data":"8812397f25a9f06ef21604757ef3678aa38f877a48b96f6e0806db2574b5a4f0"} Mar 16 16:57:05 crc kubenswrapper[5120]: I0316 16:57:05.844131 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-6c74bfb4f8-b872h" Mar 16 16:57:05 crc kubenswrapper[5120]: I0316 16:57:05.844141 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-6c74bfb4f8-b872h" event={"ID":"36d5b175-81c4-4fc3-bb05-93958f9a7a63","Type":"ContainerStarted","Data":"832a8bcafed4ed903d1874bc594e8c2a7491491a52387cf20fe3009e35d7fe3f"} Mar 16 16:57:05 crc kubenswrapper[5120]: I0316 16:57:05.844151 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-6c74bfb4f8-b872h" Mar 16 16:57:05 crc kubenswrapper[5120]: I0316 16:57:05.872552 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-6c74bfb4f8-b872h" podStartSLOduration=2.8725341330000003 podStartE2EDuration="2.872534133s" podCreationTimestamp="2026-03-16 16:57:03 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:57:05.864488114 +0000 UTC m=+5128.018419771" watchObservedRunningTime="2026-03-16 16:57:05.872534133 +0000 UTC m=+5128.026465790" Mar 16 16:57:06 crc kubenswrapper[5120]: I0316 16:57:06.345906 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 16:57:08 crc kubenswrapper[5120]: E0316 16:57:08.054175 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1756312 actualBytes=10240 Mar 16 16:57:09 crc kubenswrapper[5120]: I0316 16:57:09.664768 5120 scope.go:117] "RemoveContainer" containerID="083f72646c8d47c9c0467b39be99ddfa9c2e5900ae0a29ad53d7b39b950274b4" Mar 16 16:57:09 crc kubenswrapper[5120]: E0316 16:57:09.665233 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:57:15 crc kubenswrapper[5120]: I0316 16:57:15.698051 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/keystone-ddf666799-df45b" Mar 16 16:57:17 crc kubenswrapper[5120]: I0316 16:57:17.284515 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 16:57:17 crc kubenswrapper[5120]: I0316 16:57:17.294786 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 16:57:17 crc kubenswrapper[5120]: I0316 16:57:17.294912 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Mar 16 16:57:17 crc kubenswrapper[5120]: I0316 16:57:17.299491 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"openstack-config-secret\"" Mar 16 16:57:17 crc kubenswrapper[5120]: I0316 16:57:17.299790 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-config\"" Mar 16 16:57:17 crc kubenswrapper[5120]: I0316 16:57:17.299958 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"openstackclient-openstackclient-dockercfg-ft8t6\"" Mar 16 16:57:17 crc kubenswrapper[5120]: I0316 16:57:17.413052 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9f4vd\" (UniqueName: \"kubernetes.io/projected/9d03800d-df43-4040-ac63-25536b89a363-kube-api-access-9f4vd\") pod \"openstackclient\" (UID: \"9d03800d-df43-4040-ac63-25536b89a363\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:57:17 crc kubenswrapper[5120]: I0316 16:57:17.413401 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9d03800d-df43-4040-ac63-25536b89a363-combined-ca-bundle\") pod \"openstackclient\" (UID: \"9d03800d-df43-4040-ac63-25536b89a363\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:57:17 crc kubenswrapper[5120]: I0316 16:57:17.413637 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/9d03800d-df43-4040-ac63-25536b89a363-openstack-config-secret\") pod \"openstackclient\" (UID: \"9d03800d-df43-4040-ac63-25536b89a363\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:57:17 crc kubenswrapper[5120]: I0316 16:57:17.413826 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/9d03800d-df43-4040-ac63-25536b89a363-openstack-config\") pod \"openstackclient\" (UID: \"9d03800d-df43-4040-ac63-25536b89a363\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:57:17 crc kubenswrapper[5120]: I0316 16:57:17.515655 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/9d03800d-df43-4040-ac63-25536b89a363-openstack-config\") pod \"openstackclient\" (UID: \"9d03800d-df43-4040-ac63-25536b89a363\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:57:17 crc kubenswrapper[5120]: I0316 16:57:17.516059 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9f4vd\" (UniqueName: \"kubernetes.io/projected/9d03800d-df43-4040-ac63-25536b89a363-kube-api-access-9f4vd\") pod \"openstackclient\" (UID: \"9d03800d-df43-4040-ac63-25536b89a363\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:57:17 crc kubenswrapper[5120]: I0316 16:57:17.516298 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9d03800d-df43-4040-ac63-25536b89a363-combined-ca-bundle\") pod \"openstackclient\" (UID: \"9d03800d-df43-4040-ac63-25536b89a363\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:57:17 crc kubenswrapper[5120]: I0316 16:57:17.516610 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/9d03800d-df43-4040-ac63-25536b89a363-openstack-config\") pod \"openstackclient\" (UID: \"9d03800d-df43-4040-ac63-25536b89a363\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:57:17 crc kubenswrapper[5120]: I0316 16:57:17.517251 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/9d03800d-df43-4040-ac63-25536b89a363-openstack-config-secret\") pod \"openstackclient\" (UID: \"9d03800d-df43-4040-ac63-25536b89a363\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:57:17 crc kubenswrapper[5120]: I0316 16:57:17.524445 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/9d03800d-df43-4040-ac63-25536b89a363-openstack-config-secret\") pod \"openstackclient\" (UID: \"9d03800d-df43-4040-ac63-25536b89a363\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:57:17 crc kubenswrapper[5120]: I0316 16:57:17.524543 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9d03800d-df43-4040-ac63-25536b89a363-combined-ca-bundle\") pod \"openstackclient\" (UID: \"9d03800d-df43-4040-ac63-25536b89a363\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:57:17 crc kubenswrapper[5120]: I0316 16:57:17.536235 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9f4vd\" (UniqueName: \"kubernetes.io/projected/9d03800d-df43-4040-ac63-25536b89a363-kube-api-access-9f4vd\") pod \"openstackclient\" (UID: \"9d03800d-df43-4040-ac63-25536b89a363\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 16:57:17 crc kubenswrapper[5120]: I0316 16:57:17.615485 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Mar 16 16:57:18 crc kubenswrapper[5120]: I0316 16:57:18.071601 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 16:57:18 crc kubenswrapper[5120]: I0316 16:57:18.975595 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstackclient" event={"ID":"9d03800d-df43-4040-ac63-25536b89a363","Type":"ContainerStarted","Data":"9c0dde63dded6fd7508da4b2be9ec12aa6b98bc4b44fdae1db73beace60a9ad0"} Mar 16 16:57:18 crc kubenswrapper[5120]: I0316 16:57:18.976292 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstackclient" event={"ID":"9d03800d-df43-4040-ac63-25536b89a363","Type":"ContainerStarted","Data":"a3cfdc922ed2581482bb58cb18a4a34190a47081d124a368eec6ebf243a5dec3"} Mar 16 16:57:19 crc kubenswrapper[5120]: I0316 16:57:19.004603 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstackclient" podStartSLOduration=2.004572104 podStartE2EDuration="2.004572104s" podCreationTimestamp="2026-03-16 16:57:17 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:57:18.998451157 +0000 UTC m=+5141.152382814" watchObservedRunningTime="2026-03-16 16:57:19.004572104 +0000 UTC m=+5141.158503781" Mar 16 16:57:20 crc kubenswrapper[5120]: I0316 16:57:20.890171 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/swift-proxy-5f4bc687f4-xcf5c"] Mar 16 16:57:20 crc kubenswrapper[5120]: I0316 16:57:20.901154 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-5f4bc687f4-xcf5c" Mar 16 16:57:20 crc kubenswrapper[5120]: I0316 16:57:20.906481 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-swift-internal-svc\"" Mar 16 16:57:20 crc kubenswrapper[5120]: I0316 16:57:20.906991 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"swift-proxy-config-data\"" Mar 16 16:57:20 crc kubenswrapper[5120]: I0316 16:57:20.908989 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-proxy-5f4bc687f4-xcf5c"] Mar 16 16:57:20 crc kubenswrapper[5120]: I0316 16:57:20.911061 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-swift-public-svc\"" Mar 16 16:57:21 crc kubenswrapper[5120]: I0316 16:57:21.004367 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/21a5384d-c9cf-429c-9e7e-cc9fb2a825b9-log-httpd\") pod \"swift-proxy-5f4bc687f4-xcf5c\" (UID: \"21a5384d-c9cf-429c-9e7e-cc9fb2a825b9\") " pod="openstack-kuttl-tests/swift-proxy-5f4bc687f4-xcf5c" Mar 16 16:57:21 crc kubenswrapper[5120]: I0316 16:57:21.004466 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/21a5384d-c9cf-429c-9e7e-cc9fb2a825b9-public-tls-certs\") pod \"swift-proxy-5f4bc687f4-xcf5c\" (UID: \"21a5384d-c9cf-429c-9e7e-cc9fb2a825b9\") " pod="openstack-kuttl-tests/swift-proxy-5f4bc687f4-xcf5c" Mar 16 16:57:21 crc kubenswrapper[5120]: I0316 16:57:21.004729 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/21a5384d-c9cf-429c-9e7e-cc9fb2a825b9-combined-ca-bundle\") pod \"swift-proxy-5f4bc687f4-xcf5c\" (UID: \"21a5384d-c9cf-429c-9e7e-cc9fb2a825b9\") " pod="openstack-kuttl-tests/swift-proxy-5f4bc687f4-xcf5c" Mar 16 16:57:21 crc kubenswrapper[5120]: I0316 16:57:21.005089 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/21a5384d-c9cf-429c-9e7e-cc9fb2a825b9-internal-tls-certs\") pod \"swift-proxy-5f4bc687f4-xcf5c\" (UID: \"21a5384d-c9cf-429c-9e7e-cc9fb2a825b9\") " pod="openstack-kuttl-tests/swift-proxy-5f4bc687f4-xcf5c" Mar 16 16:57:21 crc kubenswrapper[5120]: I0316 16:57:21.005255 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/21a5384d-c9cf-429c-9e7e-cc9fb2a825b9-etc-swift\") pod \"swift-proxy-5f4bc687f4-xcf5c\" (UID: \"21a5384d-c9cf-429c-9e7e-cc9fb2a825b9\") " pod="openstack-kuttl-tests/swift-proxy-5f4bc687f4-xcf5c" Mar 16 16:57:21 crc kubenswrapper[5120]: I0316 16:57:21.005341 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rgmw4\" (UniqueName: \"kubernetes.io/projected/21a5384d-c9cf-429c-9e7e-cc9fb2a825b9-kube-api-access-rgmw4\") pod \"swift-proxy-5f4bc687f4-xcf5c\" (UID: \"21a5384d-c9cf-429c-9e7e-cc9fb2a825b9\") " pod="openstack-kuttl-tests/swift-proxy-5f4bc687f4-xcf5c" Mar 16 16:57:21 crc kubenswrapper[5120]: I0316 16:57:21.005375 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/21a5384d-c9cf-429c-9e7e-cc9fb2a825b9-config-data\") pod \"swift-proxy-5f4bc687f4-xcf5c\" (UID: \"21a5384d-c9cf-429c-9e7e-cc9fb2a825b9\") " pod="openstack-kuttl-tests/swift-proxy-5f4bc687f4-xcf5c" Mar 16 16:57:21 crc kubenswrapper[5120]: I0316 16:57:21.005459 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/21a5384d-c9cf-429c-9e7e-cc9fb2a825b9-run-httpd\") pod \"swift-proxy-5f4bc687f4-xcf5c\" (UID: \"21a5384d-c9cf-429c-9e7e-cc9fb2a825b9\") " pod="openstack-kuttl-tests/swift-proxy-5f4bc687f4-xcf5c" Mar 16 16:57:21 crc kubenswrapper[5120]: I0316 16:57:21.107143 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/21a5384d-c9cf-429c-9e7e-cc9fb2a825b9-run-httpd\") pod \"swift-proxy-5f4bc687f4-xcf5c\" (UID: \"21a5384d-c9cf-429c-9e7e-cc9fb2a825b9\") " pod="openstack-kuttl-tests/swift-proxy-5f4bc687f4-xcf5c" Mar 16 16:57:21 crc kubenswrapper[5120]: I0316 16:57:21.107486 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/21a5384d-c9cf-429c-9e7e-cc9fb2a825b9-log-httpd\") pod \"swift-proxy-5f4bc687f4-xcf5c\" (UID: \"21a5384d-c9cf-429c-9e7e-cc9fb2a825b9\") " pod="openstack-kuttl-tests/swift-proxy-5f4bc687f4-xcf5c" Mar 16 16:57:21 crc kubenswrapper[5120]: I0316 16:57:21.107524 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/21a5384d-c9cf-429c-9e7e-cc9fb2a825b9-public-tls-certs\") pod \"swift-proxy-5f4bc687f4-xcf5c\" (UID: \"21a5384d-c9cf-429c-9e7e-cc9fb2a825b9\") " pod="openstack-kuttl-tests/swift-proxy-5f4bc687f4-xcf5c" Mar 16 16:57:21 crc kubenswrapper[5120]: I0316 16:57:21.107592 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/21a5384d-c9cf-429c-9e7e-cc9fb2a825b9-combined-ca-bundle\") pod \"swift-proxy-5f4bc687f4-xcf5c\" (UID: \"21a5384d-c9cf-429c-9e7e-cc9fb2a825b9\") " pod="openstack-kuttl-tests/swift-proxy-5f4bc687f4-xcf5c" Mar 16 16:57:21 crc kubenswrapper[5120]: I0316 16:57:21.107796 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/21a5384d-c9cf-429c-9e7e-cc9fb2a825b9-internal-tls-certs\") pod \"swift-proxy-5f4bc687f4-xcf5c\" (UID: \"21a5384d-c9cf-429c-9e7e-cc9fb2a825b9\") " pod="openstack-kuttl-tests/swift-proxy-5f4bc687f4-xcf5c" Mar 16 16:57:21 crc kubenswrapper[5120]: I0316 16:57:21.107752 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/21a5384d-c9cf-429c-9e7e-cc9fb2a825b9-run-httpd\") pod \"swift-proxy-5f4bc687f4-xcf5c\" (UID: \"21a5384d-c9cf-429c-9e7e-cc9fb2a825b9\") " pod="openstack-kuttl-tests/swift-proxy-5f4bc687f4-xcf5c" Mar 16 16:57:21 crc kubenswrapper[5120]: I0316 16:57:21.108032 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/21a5384d-c9cf-429c-9e7e-cc9fb2a825b9-etc-swift\") pod \"swift-proxy-5f4bc687f4-xcf5c\" (UID: \"21a5384d-c9cf-429c-9e7e-cc9fb2a825b9\") " pod="openstack-kuttl-tests/swift-proxy-5f4bc687f4-xcf5c" Mar 16 16:57:21 crc kubenswrapper[5120]: I0316 16:57:21.108053 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/21a5384d-c9cf-429c-9e7e-cc9fb2a825b9-log-httpd\") pod \"swift-proxy-5f4bc687f4-xcf5c\" (UID: \"21a5384d-c9cf-429c-9e7e-cc9fb2a825b9\") " pod="openstack-kuttl-tests/swift-proxy-5f4bc687f4-xcf5c" Mar 16 16:57:21 crc kubenswrapper[5120]: I0316 16:57:21.108163 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rgmw4\" (UniqueName: \"kubernetes.io/projected/21a5384d-c9cf-429c-9e7e-cc9fb2a825b9-kube-api-access-rgmw4\") pod \"swift-proxy-5f4bc687f4-xcf5c\" (UID: \"21a5384d-c9cf-429c-9e7e-cc9fb2a825b9\") " pod="openstack-kuttl-tests/swift-proxy-5f4bc687f4-xcf5c" Mar 16 16:57:21 crc kubenswrapper[5120]: I0316 16:57:21.108193 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/21a5384d-c9cf-429c-9e7e-cc9fb2a825b9-config-data\") pod \"swift-proxy-5f4bc687f4-xcf5c\" (UID: \"21a5384d-c9cf-429c-9e7e-cc9fb2a825b9\") " pod="openstack-kuttl-tests/swift-proxy-5f4bc687f4-xcf5c" Mar 16 16:57:21 crc kubenswrapper[5120]: I0316 16:57:21.114290 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/21a5384d-c9cf-429c-9e7e-cc9fb2a825b9-public-tls-certs\") pod \"swift-proxy-5f4bc687f4-xcf5c\" (UID: \"21a5384d-c9cf-429c-9e7e-cc9fb2a825b9\") " pod="openstack-kuttl-tests/swift-proxy-5f4bc687f4-xcf5c" Mar 16 16:57:21 crc kubenswrapper[5120]: I0316 16:57:21.114803 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/21a5384d-c9cf-429c-9e7e-cc9fb2a825b9-internal-tls-certs\") pod \"swift-proxy-5f4bc687f4-xcf5c\" (UID: \"21a5384d-c9cf-429c-9e7e-cc9fb2a825b9\") " pod="openstack-kuttl-tests/swift-proxy-5f4bc687f4-xcf5c" Mar 16 16:57:21 crc kubenswrapper[5120]: I0316 16:57:21.115045 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/21a5384d-c9cf-429c-9e7e-cc9fb2a825b9-combined-ca-bundle\") pod \"swift-proxy-5f4bc687f4-xcf5c\" (UID: \"21a5384d-c9cf-429c-9e7e-cc9fb2a825b9\") " pod="openstack-kuttl-tests/swift-proxy-5f4bc687f4-xcf5c" Mar 16 16:57:21 crc kubenswrapper[5120]: I0316 16:57:21.115928 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/21a5384d-c9cf-429c-9e7e-cc9fb2a825b9-config-data\") pod \"swift-proxy-5f4bc687f4-xcf5c\" (UID: \"21a5384d-c9cf-429c-9e7e-cc9fb2a825b9\") " pod="openstack-kuttl-tests/swift-proxy-5f4bc687f4-xcf5c" Mar 16 16:57:21 crc kubenswrapper[5120]: I0316 16:57:21.116838 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/21a5384d-c9cf-429c-9e7e-cc9fb2a825b9-etc-swift\") pod \"swift-proxy-5f4bc687f4-xcf5c\" (UID: \"21a5384d-c9cf-429c-9e7e-cc9fb2a825b9\") " pod="openstack-kuttl-tests/swift-proxy-5f4bc687f4-xcf5c" Mar 16 16:57:21 crc kubenswrapper[5120]: I0316 16:57:21.129310 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rgmw4\" (UniqueName: \"kubernetes.io/projected/21a5384d-c9cf-429c-9e7e-cc9fb2a825b9-kube-api-access-rgmw4\") pod \"swift-proxy-5f4bc687f4-xcf5c\" (UID: \"21a5384d-c9cf-429c-9e7e-cc9fb2a825b9\") " pod="openstack-kuttl-tests/swift-proxy-5f4bc687f4-xcf5c" Mar 16 16:57:21 crc kubenswrapper[5120]: I0316 16:57:21.237997 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-5f4bc687f4-xcf5c" Mar 16 16:57:21 crc kubenswrapper[5120]: I0316 16:57:21.663509 5120 scope.go:117] "RemoveContainer" containerID="083f72646c8d47c9c0467b39be99ddfa9c2e5900ae0a29ad53d7b39b950274b4" Mar 16 16:57:21 crc kubenswrapper[5120]: E0316 16:57:21.664305 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:57:21 crc kubenswrapper[5120]: I0316 16:57:21.734618 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-proxy-5f4bc687f4-xcf5c"] Mar 16 16:57:22 crc kubenswrapper[5120]: I0316 16:57:22.004149 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-5f4bc687f4-xcf5c" event={"ID":"21a5384d-c9cf-429c-9e7e-cc9fb2a825b9","Type":"ContainerStarted","Data":"e79959f71ab0d91a6dfd6500e6c23a90e3f5f472b910457be6bb1444ceb92626"} Mar 16 16:57:22 crc kubenswrapper[5120]: I0316 16:57:22.004550 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-5f4bc687f4-xcf5c" event={"ID":"21a5384d-c9cf-429c-9e7e-cc9fb2a825b9","Type":"ContainerStarted","Data":"a5c8c069d9991734fb054c96469979823968f3de7ae2ab4be6034a4f07480e86"} Mar 16 16:57:22 crc kubenswrapper[5120]: I0316 16:57:22.618220 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:57:23 crc kubenswrapper[5120]: I0316 16:57:23.014991 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-5f4bc687f4-xcf5c" event={"ID":"21a5384d-c9cf-429c-9e7e-cc9fb2a825b9","Type":"ContainerStarted","Data":"3f7bb0f2d95b2604000e3cb06726dffeed7a15b51fc59eb520f23068db328b43"} Mar 16 16:57:23 crc kubenswrapper[5120]: I0316 16:57:23.016467 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/swift-proxy-5f4bc687f4-xcf5c" Mar 16 16:57:23 crc kubenswrapper[5120]: I0316 16:57:23.016495 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/swift-proxy-5f4bc687f4-xcf5c" Mar 16 16:57:23 crc kubenswrapper[5120]: I0316 16:57:23.036121 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/swift-proxy-5f4bc687f4-xcf5c" podStartSLOduration=3.03609677 podStartE2EDuration="3.03609677s" podCreationTimestamp="2026-03-16 16:57:20 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:57:23.031802123 +0000 UTC m=+5145.185733780" watchObservedRunningTime="2026-03-16 16:57:23.03609677 +0000 UTC m=+5145.190028427" Mar 16 16:57:23 crc kubenswrapper[5120]: I0316 16:57:23.979966 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:57:23 crc kubenswrapper[5120]: I0316 16:57:23.980211 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="d0a971ac-2056-4ef1-abc7-8592e58f8114" containerName="ceilometer-central-agent" containerID="cri-o://866cf66d583c8c223eb1d918bd4e3b618bfb5c046797631f4ebfaa81e562d5c4" gracePeriod=30 Mar 16 16:57:23 crc kubenswrapper[5120]: I0316 16:57:23.980313 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="d0a971ac-2056-4ef1-abc7-8592e58f8114" containerName="sg-core" containerID="cri-o://130a994cbf3ac7c6b65be1696e5aad19604e92374f087c17b37cee6ddd1190dc" gracePeriod=30 Mar 16 16:57:23 crc kubenswrapper[5120]: I0316 16:57:23.980465 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="d0a971ac-2056-4ef1-abc7-8592e58f8114" containerName="proxy-httpd" containerID="cri-o://f30d4a1f3259510b9eb8c318c8b222d3d03ddf9cf7ad7d4ed5dee9dc18b20854" gracePeriod=30 Mar 16 16:57:23 crc kubenswrapper[5120]: I0316 16:57:23.980375 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="d0a971ac-2056-4ef1-abc7-8592e58f8114" containerName="ceilometer-notification-agent" containerID="cri-o://de1bdbf465858d6b2216989617f3d1ba223727e4a7c0a9007afc6c332456ebbc" gracePeriod=30 Mar 16 16:57:24 crc kubenswrapper[5120]: I0316 16:57:24.678959 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/neutron-69697bd7fc-vk7rp" Mar 16 16:57:24 crc kubenswrapper[5120]: I0316 16:57:24.898976 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.027927 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/d0a971ac-2056-4ef1-abc7-8592e58f8114-sg-core-conf-yaml\") pod \"d0a971ac-2056-4ef1-abc7-8592e58f8114\" (UID: \"d0a971ac-2056-4ef1-abc7-8592e58f8114\") " Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.028201 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d0a971ac-2056-4ef1-abc7-8592e58f8114-config-data\") pod \"d0a971ac-2056-4ef1-abc7-8592e58f8114\" (UID: \"d0a971ac-2056-4ef1-abc7-8592e58f8114\") " Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.028425 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d0a971ac-2056-4ef1-abc7-8592e58f8114-combined-ca-bundle\") pod \"d0a971ac-2056-4ef1-abc7-8592e58f8114\" (UID: \"d0a971ac-2056-4ef1-abc7-8592e58f8114\") " Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.028744 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d0a971ac-2056-4ef1-abc7-8592e58f8114-scripts\") pod \"d0a971ac-2056-4ef1-abc7-8592e58f8114\" (UID: \"d0a971ac-2056-4ef1-abc7-8592e58f8114\") " Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.028819 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4b6z4\" (UniqueName: \"kubernetes.io/projected/d0a971ac-2056-4ef1-abc7-8592e58f8114-kube-api-access-4b6z4\") pod \"d0a971ac-2056-4ef1-abc7-8592e58f8114\" (UID: \"d0a971ac-2056-4ef1-abc7-8592e58f8114\") " Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.029041 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/d0a971ac-2056-4ef1-abc7-8592e58f8114-log-httpd\") pod \"d0a971ac-2056-4ef1-abc7-8592e58f8114\" (UID: \"d0a971ac-2056-4ef1-abc7-8592e58f8114\") " Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.029181 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/d0a971ac-2056-4ef1-abc7-8592e58f8114-run-httpd\") pod \"d0a971ac-2056-4ef1-abc7-8592e58f8114\" (UID: \"d0a971ac-2056-4ef1-abc7-8592e58f8114\") " Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.029727 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0a971ac-2056-4ef1-abc7-8592e58f8114-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "d0a971ac-2056-4ef1-abc7-8592e58f8114" (UID: "d0a971ac-2056-4ef1-abc7-8592e58f8114"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.029912 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0a971ac-2056-4ef1-abc7-8592e58f8114-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "d0a971ac-2056-4ef1-abc7-8592e58f8114" (UID: "d0a971ac-2056-4ef1-abc7-8592e58f8114"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.030674 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/d0a971ac-2056-4ef1-abc7-8592e58f8114-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.030705 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/d0a971ac-2056-4ef1-abc7-8592e58f8114-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.036491 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0a971ac-2056-4ef1-abc7-8592e58f8114-scripts" (OuterVolumeSpecName: "scripts") pod "d0a971ac-2056-4ef1-abc7-8592e58f8114" (UID: "d0a971ac-2056-4ef1-abc7-8592e58f8114"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.036858 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0a971ac-2056-4ef1-abc7-8592e58f8114-kube-api-access-4b6z4" (OuterVolumeSpecName: "kube-api-access-4b6z4") pod "d0a971ac-2056-4ef1-abc7-8592e58f8114" (UID: "d0a971ac-2056-4ef1-abc7-8592e58f8114"). InnerVolumeSpecName "kube-api-access-4b6z4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.039470 5120 generic.go:358] "Generic (PLEG): container finished" podID="d0a971ac-2056-4ef1-abc7-8592e58f8114" containerID="f30d4a1f3259510b9eb8c318c8b222d3d03ddf9cf7ad7d4ed5dee9dc18b20854" exitCode=0 Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.039502 5120 generic.go:358] "Generic (PLEG): container finished" podID="d0a971ac-2056-4ef1-abc7-8592e58f8114" containerID="130a994cbf3ac7c6b65be1696e5aad19604e92374f087c17b37cee6ddd1190dc" exitCode=2 Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.039510 5120 generic.go:358] "Generic (PLEG): container finished" podID="d0a971ac-2056-4ef1-abc7-8592e58f8114" containerID="de1bdbf465858d6b2216989617f3d1ba223727e4a7c0a9007afc6c332456ebbc" exitCode=0 Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.039516 5120 generic.go:358] "Generic (PLEG): container finished" podID="d0a971ac-2056-4ef1-abc7-8592e58f8114" containerID="866cf66d583c8c223eb1d918bd4e3b618bfb5c046797631f4ebfaa81e562d5c4" exitCode=0 Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.039569 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"d0a971ac-2056-4ef1-abc7-8592e58f8114","Type":"ContainerDied","Data":"f30d4a1f3259510b9eb8c318c8b222d3d03ddf9cf7ad7d4ed5dee9dc18b20854"} Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.039602 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.039627 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"d0a971ac-2056-4ef1-abc7-8592e58f8114","Type":"ContainerDied","Data":"130a994cbf3ac7c6b65be1696e5aad19604e92374f087c17b37cee6ddd1190dc"} Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.039641 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"d0a971ac-2056-4ef1-abc7-8592e58f8114","Type":"ContainerDied","Data":"de1bdbf465858d6b2216989617f3d1ba223727e4a7c0a9007afc6c332456ebbc"} Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.039650 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"d0a971ac-2056-4ef1-abc7-8592e58f8114","Type":"ContainerDied","Data":"866cf66d583c8c223eb1d918bd4e3b618bfb5c046797631f4ebfaa81e562d5c4"} Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.039659 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"d0a971ac-2056-4ef1-abc7-8592e58f8114","Type":"ContainerDied","Data":"28ad22e69774497638eafa35572c6a2d2384968a0554c3fa6a1360a0da50d17e"} Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.039676 5120 scope.go:117] "RemoveContainer" containerID="f30d4a1f3259510b9eb8c318c8b222d3d03ddf9cf7ad7d4ed5dee9dc18b20854" Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.071588 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0a971ac-2056-4ef1-abc7-8592e58f8114-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "d0a971ac-2056-4ef1-abc7-8592e58f8114" (UID: "d0a971ac-2056-4ef1-abc7-8592e58f8114"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.106454 5120 scope.go:117] "RemoveContainer" containerID="130a994cbf3ac7c6b65be1696e5aad19604e92374f087c17b37cee6ddd1190dc" Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.133784 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d0a971ac-2056-4ef1-abc7-8592e58f8114-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.133822 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4b6z4\" (UniqueName: \"kubernetes.io/projected/d0a971ac-2056-4ef1-abc7-8592e58f8114-kube-api-access-4b6z4\") on node \"crc\" DevicePath \"\"" Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.133837 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/d0a971ac-2056-4ef1-abc7-8592e58f8114-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.146959 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0a971ac-2056-4ef1-abc7-8592e58f8114-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "d0a971ac-2056-4ef1-abc7-8592e58f8114" (UID: "d0a971ac-2056-4ef1-abc7-8592e58f8114"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.171520 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0a971ac-2056-4ef1-abc7-8592e58f8114-config-data" (OuterVolumeSpecName: "config-data") pod "d0a971ac-2056-4ef1-abc7-8592e58f8114" (UID: "d0a971ac-2056-4ef1-abc7-8592e58f8114"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.237236 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d0a971ac-2056-4ef1-abc7-8592e58f8114-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.237284 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d0a971ac-2056-4ef1-abc7-8592e58f8114-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.244867 5120 scope.go:117] "RemoveContainer" containerID="de1bdbf465858d6b2216989617f3d1ba223727e4a7c0a9007afc6c332456ebbc" Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.268202 5120 scope.go:117] "RemoveContainer" containerID="866cf66d583c8c223eb1d918bd4e3b618bfb5c046797631f4ebfaa81e562d5c4" Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.303630 5120 scope.go:117] "RemoveContainer" containerID="f30d4a1f3259510b9eb8c318c8b222d3d03ddf9cf7ad7d4ed5dee9dc18b20854" Mar 16 16:57:25 crc kubenswrapper[5120]: E0316 16:57:25.304084 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f30d4a1f3259510b9eb8c318c8b222d3d03ddf9cf7ad7d4ed5dee9dc18b20854\": container with ID starting with f30d4a1f3259510b9eb8c318c8b222d3d03ddf9cf7ad7d4ed5dee9dc18b20854 not found: ID does not exist" containerID="f30d4a1f3259510b9eb8c318c8b222d3d03ddf9cf7ad7d4ed5dee9dc18b20854" Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.304127 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f30d4a1f3259510b9eb8c318c8b222d3d03ddf9cf7ad7d4ed5dee9dc18b20854"} err="failed to get container status \"f30d4a1f3259510b9eb8c318c8b222d3d03ddf9cf7ad7d4ed5dee9dc18b20854\": rpc error: code = NotFound desc = could not find container \"f30d4a1f3259510b9eb8c318c8b222d3d03ddf9cf7ad7d4ed5dee9dc18b20854\": container with ID starting with f30d4a1f3259510b9eb8c318c8b222d3d03ddf9cf7ad7d4ed5dee9dc18b20854 not found: ID does not exist" Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.304147 5120 scope.go:117] "RemoveContainer" containerID="130a994cbf3ac7c6b65be1696e5aad19604e92374f087c17b37cee6ddd1190dc" Mar 16 16:57:25 crc kubenswrapper[5120]: E0316 16:57:25.304383 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"130a994cbf3ac7c6b65be1696e5aad19604e92374f087c17b37cee6ddd1190dc\": container with ID starting with 130a994cbf3ac7c6b65be1696e5aad19604e92374f087c17b37cee6ddd1190dc not found: ID does not exist" containerID="130a994cbf3ac7c6b65be1696e5aad19604e92374f087c17b37cee6ddd1190dc" Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.304426 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"130a994cbf3ac7c6b65be1696e5aad19604e92374f087c17b37cee6ddd1190dc"} err="failed to get container status \"130a994cbf3ac7c6b65be1696e5aad19604e92374f087c17b37cee6ddd1190dc\": rpc error: code = NotFound desc = could not find container \"130a994cbf3ac7c6b65be1696e5aad19604e92374f087c17b37cee6ddd1190dc\": container with ID starting with 130a994cbf3ac7c6b65be1696e5aad19604e92374f087c17b37cee6ddd1190dc not found: ID does not exist" Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.304453 5120 scope.go:117] "RemoveContainer" containerID="de1bdbf465858d6b2216989617f3d1ba223727e4a7c0a9007afc6c332456ebbc" Mar 16 16:57:25 crc kubenswrapper[5120]: E0316 16:57:25.304678 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de1bdbf465858d6b2216989617f3d1ba223727e4a7c0a9007afc6c332456ebbc\": container with ID starting with de1bdbf465858d6b2216989617f3d1ba223727e4a7c0a9007afc6c332456ebbc not found: ID does not exist" containerID="de1bdbf465858d6b2216989617f3d1ba223727e4a7c0a9007afc6c332456ebbc" Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.304702 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de1bdbf465858d6b2216989617f3d1ba223727e4a7c0a9007afc6c332456ebbc"} err="failed to get container status \"de1bdbf465858d6b2216989617f3d1ba223727e4a7c0a9007afc6c332456ebbc\": rpc error: code = NotFound desc = could not find container \"de1bdbf465858d6b2216989617f3d1ba223727e4a7c0a9007afc6c332456ebbc\": container with ID starting with de1bdbf465858d6b2216989617f3d1ba223727e4a7c0a9007afc6c332456ebbc not found: ID does not exist" Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.304717 5120 scope.go:117] "RemoveContainer" containerID="866cf66d583c8c223eb1d918bd4e3b618bfb5c046797631f4ebfaa81e562d5c4" Mar 16 16:57:25 crc kubenswrapper[5120]: E0316 16:57:25.305044 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"866cf66d583c8c223eb1d918bd4e3b618bfb5c046797631f4ebfaa81e562d5c4\": container with ID starting with 866cf66d583c8c223eb1d918bd4e3b618bfb5c046797631f4ebfaa81e562d5c4 not found: ID does not exist" containerID="866cf66d583c8c223eb1d918bd4e3b618bfb5c046797631f4ebfaa81e562d5c4" Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.305076 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"866cf66d583c8c223eb1d918bd4e3b618bfb5c046797631f4ebfaa81e562d5c4"} err="failed to get container status \"866cf66d583c8c223eb1d918bd4e3b618bfb5c046797631f4ebfaa81e562d5c4\": rpc error: code = NotFound desc = could not find container \"866cf66d583c8c223eb1d918bd4e3b618bfb5c046797631f4ebfaa81e562d5c4\": container with ID starting with 866cf66d583c8c223eb1d918bd4e3b618bfb5c046797631f4ebfaa81e562d5c4 not found: ID does not exist" Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.305091 5120 scope.go:117] "RemoveContainer" containerID="f30d4a1f3259510b9eb8c318c8b222d3d03ddf9cf7ad7d4ed5dee9dc18b20854" Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.305357 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f30d4a1f3259510b9eb8c318c8b222d3d03ddf9cf7ad7d4ed5dee9dc18b20854"} err="failed to get container status \"f30d4a1f3259510b9eb8c318c8b222d3d03ddf9cf7ad7d4ed5dee9dc18b20854\": rpc error: code = NotFound desc = could not find container \"f30d4a1f3259510b9eb8c318c8b222d3d03ddf9cf7ad7d4ed5dee9dc18b20854\": container with ID starting with f30d4a1f3259510b9eb8c318c8b222d3d03ddf9cf7ad7d4ed5dee9dc18b20854 not found: ID does not exist" Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.305377 5120 scope.go:117] "RemoveContainer" containerID="130a994cbf3ac7c6b65be1696e5aad19604e92374f087c17b37cee6ddd1190dc" Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.305565 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"130a994cbf3ac7c6b65be1696e5aad19604e92374f087c17b37cee6ddd1190dc"} err="failed to get container status \"130a994cbf3ac7c6b65be1696e5aad19604e92374f087c17b37cee6ddd1190dc\": rpc error: code = NotFound desc = could not find container \"130a994cbf3ac7c6b65be1696e5aad19604e92374f087c17b37cee6ddd1190dc\": container with ID starting with 130a994cbf3ac7c6b65be1696e5aad19604e92374f087c17b37cee6ddd1190dc not found: ID does not exist" Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.305584 5120 scope.go:117] "RemoveContainer" containerID="de1bdbf465858d6b2216989617f3d1ba223727e4a7c0a9007afc6c332456ebbc" Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.305746 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de1bdbf465858d6b2216989617f3d1ba223727e4a7c0a9007afc6c332456ebbc"} err="failed to get container status \"de1bdbf465858d6b2216989617f3d1ba223727e4a7c0a9007afc6c332456ebbc\": rpc error: code = NotFound desc = could not find container \"de1bdbf465858d6b2216989617f3d1ba223727e4a7c0a9007afc6c332456ebbc\": container with ID starting with de1bdbf465858d6b2216989617f3d1ba223727e4a7c0a9007afc6c332456ebbc not found: ID does not exist" Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.305777 5120 scope.go:117] "RemoveContainer" containerID="866cf66d583c8c223eb1d918bd4e3b618bfb5c046797631f4ebfaa81e562d5c4" Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.305948 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"866cf66d583c8c223eb1d918bd4e3b618bfb5c046797631f4ebfaa81e562d5c4"} err="failed to get container status \"866cf66d583c8c223eb1d918bd4e3b618bfb5c046797631f4ebfaa81e562d5c4\": rpc error: code = NotFound desc = could not find container \"866cf66d583c8c223eb1d918bd4e3b618bfb5c046797631f4ebfaa81e562d5c4\": container with ID starting with 866cf66d583c8c223eb1d918bd4e3b618bfb5c046797631f4ebfaa81e562d5c4 not found: ID does not exist" Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.305967 5120 scope.go:117] "RemoveContainer" containerID="f30d4a1f3259510b9eb8c318c8b222d3d03ddf9cf7ad7d4ed5dee9dc18b20854" Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.306212 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f30d4a1f3259510b9eb8c318c8b222d3d03ddf9cf7ad7d4ed5dee9dc18b20854"} err="failed to get container status \"f30d4a1f3259510b9eb8c318c8b222d3d03ddf9cf7ad7d4ed5dee9dc18b20854\": rpc error: code = NotFound desc = could not find container \"f30d4a1f3259510b9eb8c318c8b222d3d03ddf9cf7ad7d4ed5dee9dc18b20854\": container with ID starting with f30d4a1f3259510b9eb8c318c8b222d3d03ddf9cf7ad7d4ed5dee9dc18b20854 not found: ID does not exist" Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.306231 5120 scope.go:117] "RemoveContainer" containerID="130a994cbf3ac7c6b65be1696e5aad19604e92374f087c17b37cee6ddd1190dc" Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.306432 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"130a994cbf3ac7c6b65be1696e5aad19604e92374f087c17b37cee6ddd1190dc"} err="failed to get container status \"130a994cbf3ac7c6b65be1696e5aad19604e92374f087c17b37cee6ddd1190dc\": rpc error: code = NotFound desc = could not find container \"130a994cbf3ac7c6b65be1696e5aad19604e92374f087c17b37cee6ddd1190dc\": container with ID starting with 130a994cbf3ac7c6b65be1696e5aad19604e92374f087c17b37cee6ddd1190dc not found: ID does not exist" Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.306460 5120 scope.go:117] "RemoveContainer" containerID="de1bdbf465858d6b2216989617f3d1ba223727e4a7c0a9007afc6c332456ebbc" Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.306648 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de1bdbf465858d6b2216989617f3d1ba223727e4a7c0a9007afc6c332456ebbc"} err="failed to get container status \"de1bdbf465858d6b2216989617f3d1ba223727e4a7c0a9007afc6c332456ebbc\": rpc error: code = NotFound desc = could not find container \"de1bdbf465858d6b2216989617f3d1ba223727e4a7c0a9007afc6c332456ebbc\": container with ID starting with de1bdbf465858d6b2216989617f3d1ba223727e4a7c0a9007afc6c332456ebbc not found: ID does not exist" Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.306672 5120 scope.go:117] "RemoveContainer" containerID="866cf66d583c8c223eb1d918bd4e3b618bfb5c046797631f4ebfaa81e562d5c4" Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.306919 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"866cf66d583c8c223eb1d918bd4e3b618bfb5c046797631f4ebfaa81e562d5c4"} err="failed to get container status \"866cf66d583c8c223eb1d918bd4e3b618bfb5c046797631f4ebfaa81e562d5c4\": rpc error: code = NotFound desc = could not find container \"866cf66d583c8c223eb1d918bd4e3b618bfb5c046797631f4ebfaa81e562d5c4\": container with ID starting with 866cf66d583c8c223eb1d918bd4e3b618bfb5c046797631f4ebfaa81e562d5c4 not found: ID does not exist" Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.306942 5120 scope.go:117] "RemoveContainer" containerID="f30d4a1f3259510b9eb8c318c8b222d3d03ddf9cf7ad7d4ed5dee9dc18b20854" Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.307148 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f30d4a1f3259510b9eb8c318c8b222d3d03ddf9cf7ad7d4ed5dee9dc18b20854"} err="failed to get container status \"f30d4a1f3259510b9eb8c318c8b222d3d03ddf9cf7ad7d4ed5dee9dc18b20854\": rpc error: code = NotFound desc = could not find container \"f30d4a1f3259510b9eb8c318c8b222d3d03ddf9cf7ad7d4ed5dee9dc18b20854\": container with ID starting with f30d4a1f3259510b9eb8c318c8b222d3d03ddf9cf7ad7d4ed5dee9dc18b20854 not found: ID does not exist" Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.307175 5120 scope.go:117] "RemoveContainer" containerID="130a994cbf3ac7c6b65be1696e5aad19604e92374f087c17b37cee6ddd1190dc" Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.307413 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"130a994cbf3ac7c6b65be1696e5aad19604e92374f087c17b37cee6ddd1190dc"} err="failed to get container status \"130a994cbf3ac7c6b65be1696e5aad19604e92374f087c17b37cee6ddd1190dc\": rpc error: code = NotFound desc = could not find container \"130a994cbf3ac7c6b65be1696e5aad19604e92374f087c17b37cee6ddd1190dc\": container with ID starting with 130a994cbf3ac7c6b65be1696e5aad19604e92374f087c17b37cee6ddd1190dc not found: ID does not exist" Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.307440 5120 scope.go:117] "RemoveContainer" containerID="de1bdbf465858d6b2216989617f3d1ba223727e4a7c0a9007afc6c332456ebbc" Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.307691 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de1bdbf465858d6b2216989617f3d1ba223727e4a7c0a9007afc6c332456ebbc"} err="failed to get container status \"de1bdbf465858d6b2216989617f3d1ba223727e4a7c0a9007afc6c332456ebbc\": rpc error: code = NotFound desc = could not find container \"de1bdbf465858d6b2216989617f3d1ba223727e4a7c0a9007afc6c332456ebbc\": container with ID starting with de1bdbf465858d6b2216989617f3d1ba223727e4a7c0a9007afc6c332456ebbc not found: ID does not exist" Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.307712 5120 scope.go:117] "RemoveContainer" containerID="866cf66d583c8c223eb1d918bd4e3b618bfb5c046797631f4ebfaa81e562d5c4" Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.308838 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"866cf66d583c8c223eb1d918bd4e3b618bfb5c046797631f4ebfaa81e562d5c4"} err="failed to get container status \"866cf66d583c8c223eb1d918bd4e3b618bfb5c046797631f4ebfaa81e562d5c4\": rpc error: code = NotFound desc = could not find container \"866cf66d583c8c223eb1d918bd4e3b618bfb5c046797631f4ebfaa81e562d5c4\": container with ID starting with 866cf66d583c8c223eb1d918bd4e3b618bfb5c046797631f4ebfaa81e562d5c4 not found: ID does not exist" Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.378357 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.390530 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.407838 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.410200 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0a971ac-2056-4ef1-abc7-8592e58f8114" containerName="ceilometer-central-agent" Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.410231 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0a971ac-2056-4ef1-abc7-8592e58f8114" containerName="ceilometer-central-agent" Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.410244 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0a971ac-2056-4ef1-abc7-8592e58f8114" containerName="ceilometer-notification-agent" Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.410252 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0a971ac-2056-4ef1-abc7-8592e58f8114" containerName="ceilometer-notification-agent" Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.410271 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0a971ac-2056-4ef1-abc7-8592e58f8114" containerName="proxy-httpd" Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.410278 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0a971ac-2056-4ef1-abc7-8592e58f8114" containerName="proxy-httpd" Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.410317 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0a971ac-2056-4ef1-abc7-8592e58f8114" containerName="sg-core" Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.410326 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0a971ac-2056-4ef1-abc7-8592e58f8114" containerName="sg-core" Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.410620 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="d0a971ac-2056-4ef1-abc7-8592e58f8114" containerName="ceilometer-central-agent" Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.410641 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="d0a971ac-2056-4ef1-abc7-8592e58f8114" containerName="ceilometer-notification-agent" Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.410650 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="d0a971ac-2056-4ef1-abc7-8592e58f8114" containerName="sg-core" Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.410660 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="d0a971ac-2056-4ef1-abc7-8592e58f8114" containerName="proxy-httpd" Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.471989 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.472169 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.474752 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.474851 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.530815 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-fqkvr"] Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.548069 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1e65f09e-1d21-4f6c-b431-5e1675a8cff3-scripts\") pod \"ceilometer-0\" (UID: \"1e65f09e-1d21-4f6c-b431-5e1675a8cff3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.548151 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1e65f09e-1d21-4f6c-b431-5e1675a8cff3-config-data\") pod \"ceilometer-0\" (UID: \"1e65f09e-1d21-4f6c-b431-5e1675a8cff3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.548288 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1e65f09e-1d21-4f6c-b431-5e1675a8cff3-run-httpd\") pod \"ceilometer-0\" (UID: \"1e65f09e-1d21-4f6c-b431-5e1675a8cff3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.548349 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1e65f09e-1d21-4f6c-b431-5e1675a8cff3-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"1e65f09e-1d21-4f6c-b431-5e1675a8cff3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.548386 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wsjg7\" (UniqueName: \"kubernetes.io/projected/1e65f09e-1d21-4f6c-b431-5e1675a8cff3-kube-api-access-wsjg7\") pod \"ceilometer-0\" (UID: \"1e65f09e-1d21-4f6c-b431-5e1675a8cff3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.548430 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1e65f09e-1d21-4f6c-b431-5e1675a8cff3-log-httpd\") pod \"ceilometer-0\" (UID: \"1e65f09e-1d21-4f6c-b431-5e1675a8cff3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.548544 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/1e65f09e-1d21-4f6c-b431-5e1675a8cff3-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"1e65f09e-1d21-4f6c-b431-5e1675a8cff3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.555346 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-fqkvr"] Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.555508 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-db-create-fqkvr" Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.616406 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-wbxjt"] Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.643623 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-db-create-wbxjt" Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.653363 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1e65f09e-1d21-4f6c-b431-5e1675a8cff3-scripts\") pod \"ceilometer-0\" (UID: \"1e65f09e-1d21-4f6c-b431-5e1675a8cff3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.653460 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1e65f09e-1d21-4f6c-b431-5e1675a8cff3-config-data\") pod \"ceilometer-0\" (UID: \"1e65f09e-1d21-4f6c-b431-5e1675a8cff3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.653667 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1e65f09e-1d21-4f6c-b431-5e1675a8cff3-run-httpd\") pod \"ceilometer-0\" (UID: \"1e65f09e-1d21-4f6c-b431-5e1675a8cff3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.653814 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1e65f09e-1d21-4f6c-b431-5e1675a8cff3-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"1e65f09e-1d21-4f6c-b431-5e1675a8cff3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.653850 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qp5sd\" (UniqueName: \"kubernetes.io/projected/40d27067-1463-46fe-aef7-9d45c77c74c8-kube-api-access-qp5sd\") pod \"nova-api-db-create-fqkvr\" (UID: \"40d27067-1463-46fe-aef7-9d45c77c74c8\") " pod="openstack-kuttl-tests/nova-api-db-create-fqkvr" Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.653898 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wsjg7\" (UniqueName: \"kubernetes.io/projected/1e65f09e-1d21-4f6c-b431-5e1675a8cff3-kube-api-access-wsjg7\") pod \"ceilometer-0\" (UID: \"1e65f09e-1d21-4f6c-b431-5e1675a8cff3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.653943 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1e65f09e-1d21-4f6c-b431-5e1675a8cff3-log-httpd\") pod \"ceilometer-0\" (UID: \"1e65f09e-1d21-4f6c-b431-5e1675a8cff3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.654108 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/1e65f09e-1d21-4f6c-b431-5e1675a8cff3-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"1e65f09e-1d21-4f6c-b431-5e1675a8cff3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.654151 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/40d27067-1463-46fe-aef7-9d45c77c74c8-operator-scripts\") pod \"nova-api-db-create-fqkvr\" (UID: \"40d27067-1463-46fe-aef7-9d45c77c74c8\") " pod="openstack-kuttl-tests/nova-api-db-create-fqkvr" Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.655017 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1e65f09e-1d21-4f6c-b431-5e1675a8cff3-run-httpd\") pod \"ceilometer-0\" (UID: \"1e65f09e-1d21-4f6c-b431-5e1675a8cff3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.656128 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1e65f09e-1d21-4f6c-b431-5e1675a8cff3-log-httpd\") pod \"ceilometer-0\" (UID: \"1e65f09e-1d21-4f6c-b431-5e1675a8cff3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.662698 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1e65f09e-1d21-4f6c-b431-5e1675a8cff3-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"1e65f09e-1d21-4f6c-b431-5e1675a8cff3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.663694 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1e65f09e-1d21-4f6c-b431-5e1675a8cff3-scripts\") pod \"ceilometer-0\" (UID: \"1e65f09e-1d21-4f6c-b431-5e1675a8cff3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.664501 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/1e65f09e-1d21-4f6c-b431-5e1675a8cff3-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"1e65f09e-1d21-4f6c-b431-5e1675a8cff3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.671146 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1e65f09e-1d21-4f6c-b431-5e1675a8cff3-config-data\") pod \"ceilometer-0\" (UID: \"1e65f09e-1d21-4f6c-b431-5e1675a8cff3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.676677 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wsjg7\" (UniqueName: \"kubernetes.io/projected/1e65f09e-1d21-4f6c-b431-5e1675a8cff3-kube-api-access-wsjg7\") pod \"ceilometer-0\" (UID: \"1e65f09e-1d21-4f6c-b431-5e1675a8cff3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.676753 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-wbxjt"] Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.698891 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-1add-account-create-update-xxkxp"] Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.729570 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-1add-account-create-update-xxkxp"] Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.729698 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-1add-account-create-update-xxkxp" Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.734916 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-db-secret\"" Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.756192 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/40d27067-1463-46fe-aef7-9d45c77c74c8-operator-scripts\") pod \"nova-api-db-create-fqkvr\" (UID: \"40d27067-1463-46fe-aef7-9d45c77c74c8\") " pod="openstack-kuttl-tests/nova-api-db-create-fqkvr" Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.756461 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8nn9\" (UniqueName: \"kubernetes.io/projected/b07886c3-349e-4172-8f68-077ceaf8711d-kube-api-access-p8nn9\") pod \"nova-cell0-db-create-wbxjt\" (UID: \"b07886c3-349e-4172-8f68-077ceaf8711d\") " pod="openstack-kuttl-tests/nova-cell0-db-create-wbxjt" Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.756666 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b07886c3-349e-4172-8f68-077ceaf8711d-operator-scripts\") pod \"nova-cell0-db-create-wbxjt\" (UID: \"b07886c3-349e-4172-8f68-077ceaf8711d\") " pod="openstack-kuttl-tests/nova-cell0-db-create-wbxjt" Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.756857 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qp5sd\" (UniqueName: \"kubernetes.io/projected/40d27067-1463-46fe-aef7-9d45c77c74c8-kube-api-access-qp5sd\") pod \"nova-api-db-create-fqkvr\" (UID: \"40d27067-1463-46fe-aef7-9d45c77c74c8\") " pod="openstack-kuttl-tests/nova-api-db-create-fqkvr" Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.757702 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/40d27067-1463-46fe-aef7-9d45c77c74c8-operator-scripts\") pod \"nova-api-db-create-fqkvr\" (UID: \"40d27067-1463-46fe-aef7-9d45c77c74c8\") " pod="openstack-kuttl-tests/nova-api-db-create-fqkvr" Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.777404 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qp5sd\" (UniqueName: \"kubernetes.io/projected/40d27067-1463-46fe-aef7-9d45c77c74c8-kube-api-access-qp5sd\") pod \"nova-api-db-create-fqkvr\" (UID: \"40d27067-1463-46fe-aef7-9d45c77c74c8\") " pod="openstack-kuttl-tests/nova-api-db-create-fqkvr" Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.794528 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.824961 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-nn7ww"] Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.835026 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-db-create-nn7ww" Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.849173 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-e0b3-account-create-update-22hwc"] Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.856579 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-e0b3-account-create-update-22hwc" Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.859060 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b07886c3-349e-4172-8f68-077ceaf8711d-operator-scripts\") pod \"nova-cell0-db-create-wbxjt\" (UID: \"b07886c3-349e-4172-8f68-077ceaf8711d\") " pod="openstack-kuttl-tests/nova-cell0-db-create-wbxjt" Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.859502 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frbgn\" (UniqueName: \"kubernetes.io/projected/38dbe21c-3c67-4241-b83d-0de332345bb9-kube-api-access-frbgn\") pod \"nova-api-1add-account-create-update-xxkxp\" (UID: \"38dbe21c-3c67-4241-b83d-0de332345bb9\") " pod="openstack-kuttl-tests/nova-api-1add-account-create-update-xxkxp" Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.859959 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/38dbe21c-3c67-4241-b83d-0de332345bb9-operator-scripts\") pod \"nova-api-1add-account-create-update-xxkxp\" (UID: \"38dbe21c-3c67-4241-b83d-0de332345bb9\") " pod="openstack-kuttl-tests/nova-api-1add-account-create-update-xxkxp" Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.860201 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p8nn9\" (UniqueName: \"kubernetes.io/projected/b07886c3-349e-4172-8f68-077ceaf8711d-kube-api-access-p8nn9\") pod \"nova-cell0-db-create-wbxjt\" (UID: \"b07886c3-349e-4172-8f68-077ceaf8711d\") " pod="openstack-kuttl-tests/nova-cell0-db-create-wbxjt" Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.860442 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b07886c3-349e-4172-8f68-077ceaf8711d-operator-scripts\") pod \"nova-cell0-db-create-wbxjt\" (UID: \"b07886c3-349e-4172-8f68-077ceaf8711d\") " pod="openstack-kuttl-tests/nova-cell0-db-create-wbxjt" Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.860814 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-db-secret\"" Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.869142 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-nn7ww"] Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.876152 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-db-create-fqkvr" Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.878302 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-e0b3-account-create-update-22hwc"] Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.885512 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8nn9\" (UniqueName: \"kubernetes.io/projected/b07886c3-349e-4172-8f68-077ceaf8711d-kube-api-access-p8nn9\") pod \"nova-cell0-db-create-wbxjt\" (UID: \"b07886c3-349e-4172-8f68-077ceaf8711d\") " pod="openstack-kuttl-tests/nova-cell0-db-create-wbxjt" Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.962331 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-frbgn\" (UniqueName: \"kubernetes.io/projected/38dbe21c-3c67-4241-b83d-0de332345bb9-kube-api-access-frbgn\") pod \"nova-api-1add-account-create-update-xxkxp\" (UID: \"38dbe21c-3c67-4241-b83d-0de332345bb9\") " pod="openstack-kuttl-tests/nova-api-1add-account-create-update-xxkxp" Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.962391 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/90a64bb3-08ab-478c-812b-d673e0772e88-operator-scripts\") pod \"nova-cell1-db-create-nn7ww\" (UID: \"90a64bb3-08ab-478c-812b-d673e0772e88\") " pod="openstack-kuttl-tests/nova-cell1-db-create-nn7ww" Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.962728 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9zjn\" (UniqueName: \"kubernetes.io/projected/90a64bb3-08ab-478c-812b-d673e0772e88-kube-api-access-k9zjn\") pod \"nova-cell1-db-create-nn7ww\" (UID: \"90a64bb3-08ab-478c-812b-d673e0772e88\") " pod="openstack-kuttl-tests/nova-cell1-db-create-nn7ww" Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.962898 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4bh6g\" (UniqueName: \"kubernetes.io/projected/d4bdf21c-03be-41af-bd5b-e07309d9129e-kube-api-access-4bh6g\") pod \"nova-cell0-e0b3-account-create-update-22hwc\" (UID: \"d4bdf21c-03be-41af-bd5b-e07309d9129e\") " pod="openstack-kuttl-tests/nova-cell0-e0b3-account-create-update-22hwc" Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.962944 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/38dbe21c-3c67-4241-b83d-0de332345bb9-operator-scripts\") pod \"nova-api-1add-account-create-update-xxkxp\" (UID: \"38dbe21c-3c67-4241-b83d-0de332345bb9\") " pod="openstack-kuttl-tests/nova-api-1add-account-create-update-xxkxp" Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.964625 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/38dbe21c-3c67-4241-b83d-0de332345bb9-operator-scripts\") pod \"nova-api-1add-account-create-update-xxkxp\" (UID: \"38dbe21c-3c67-4241-b83d-0de332345bb9\") " pod="openstack-kuttl-tests/nova-api-1add-account-create-update-xxkxp" Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.964995 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d4bdf21c-03be-41af-bd5b-e07309d9129e-operator-scripts\") pod \"nova-cell0-e0b3-account-create-update-22hwc\" (UID: \"d4bdf21c-03be-41af-bd5b-e07309d9129e\") " pod="openstack-kuttl-tests/nova-cell0-e0b3-account-create-update-22hwc" Mar 16 16:57:25 crc kubenswrapper[5120]: I0316 16:57:25.992386 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-frbgn\" (UniqueName: \"kubernetes.io/projected/38dbe21c-3c67-4241-b83d-0de332345bb9-kube-api-access-frbgn\") pod \"nova-api-1add-account-create-update-xxkxp\" (UID: \"38dbe21c-3c67-4241-b83d-0de332345bb9\") " pod="openstack-kuttl-tests/nova-api-1add-account-create-update-xxkxp" Mar 16 16:57:26 crc kubenswrapper[5120]: I0316 16:57:26.027472 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-db-create-wbxjt" Mar 16 16:57:26 crc kubenswrapper[5120]: I0316 16:57:26.032066 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-ff09-account-create-update-2k6sp"] Mar 16 16:57:26 crc kubenswrapper[5120]: I0316 16:57:26.047408 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-ff09-account-create-update-2k6sp" Mar 16 16:57:26 crc kubenswrapper[5120]: I0316 16:57:26.054750 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-1add-account-create-update-xxkxp" Mar 16 16:57:26 crc kubenswrapper[5120]: I0316 16:57:26.057176 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-ff09-account-create-update-2k6sp"] Mar 16 16:57:26 crc kubenswrapper[5120]: I0316 16:57:26.059492 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-db-secret\"" Mar 16 16:57:26 crc kubenswrapper[5120]: I0316 16:57:26.071368 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/90a64bb3-08ab-478c-812b-d673e0772e88-operator-scripts\") pod \"nova-cell1-db-create-nn7ww\" (UID: \"90a64bb3-08ab-478c-812b-d673e0772e88\") " pod="openstack-kuttl-tests/nova-cell1-db-create-nn7ww" Mar 16 16:57:26 crc kubenswrapper[5120]: I0316 16:57:26.071470 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k9zjn\" (UniqueName: \"kubernetes.io/projected/90a64bb3-08ab-478c-812b-d673e0772e88-kube-api-access-k9zjn\") pod \"nova-cell1-db-create-nn7ww\" (UID: \"90a64bb3-08ab-478c-812b-d673e0772e88\") " pod="openstack-kuttl-tests/nova-cell1-db-create-nn7ww" Mar 16 16:57:26 crc kubenswrapper[5120]: I0316 16:57:26.071560 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4bh6g\" (UniqueName: \"kubernetes.io/projected/d4bdf21c-03be-41af-bd5b-e07309d9129e-kube-api-access-4bh6g\") pod \"nova-cell0-e0b3-account-create-update-22hwc\" (UID: \"d4bdf21c-03be-41af-bd5b-e07309d9129e\") " pod="openstack-kuttl-tests/nova-cell0-e0b3-account-create-update-22hwc" Mar 16 16:57:26 crc kubenswrapper[5120]: I0316 16:57:26.071707 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d4bdf21c-03be-41af-bd5b-e07309d9129e-operator-scripts\") pod \"nova-cell0-e0b3-account-create-update-22hwc\" (UID: \"d4bdf21c-03be-41af-bd5b-e07309d9129e\") " pod="openstack-kuttl-tests/nova-cell0-e0b3-account-create-update-22hwc" Mar 16 16:57:26 crc kubenswrapper[5120]: I0316 16:57:26.072556 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d4bdf21c-03be-41af-bd5b-e07309d9129e-operator-scripts\") pod \"nova-cell0-e0b3-account-create-update-22hwc\" (UID: \"d4bdf21c-03be-41af-bd5b-e07309d9129e\") " pod="openstack-kuttl-tests/nova-cell0-e0b3-account-create-update-22hwc" Mar 16 16:57:26 crc kubenswrapper[5120]: I0316 16:57:26.074163 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/90a64bb3-08ab-478c-812b-d673e0772e88-operator-scripts\") pod \"nova-cell1-db-create-nn7ww\" (UID: \"90a64bb3-08ab-478c-812b-d673e0772e88\") " pod="openstack-kuttl-tests/nova-cell1-db-create-nn7ww" Mar 16 16:57:26 crc kubenswrapper[5120]: I0316 16:57:26.093887 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bh6g\" (UniqueName: \"kubernetes.io/projected/d4bdf21c-03be-41af-bd5b-e07309d9129e-kube-api-access-4bh6g\") pod \"nova-cell0-e0b3-account-create-update-22hwc\" (UID: \"d4bdf21c-03be-41af-bd5b-e07309d9129e\") " pod="openstack-kuttl-tests/nova-cell0-e0b3-account-create-update-22hwc" Mar 16 16:57:26 crc kubenswrapper[5120]: I0316 16:57:26.094620 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9zjn\" (UniqueName: \"kubernetes.io/projected/90a64bb3-08ab-478c-812b-d673e0772e88-kube-api-access-k9zjn\") pod \"nova-cell1-db-create-nn7ww\" (UID: \"90a64bb3-08ab-478c-812b-d673e0772e88\") " pod="openstack-kuttl-tests/nova-cell1-db-create-nn7ww" Mar 16 16:57:26 crc kubenswrapper[5120]: I0316 16:57:26.156971 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-db-create-nn7ww" Mar 16 16:57:26 crc kubenswrapper[5120]: I0316 16:57:26.174269 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tf6bm\" (UniqueName: \"kubernetes.io/projected/feb1fe6d-59b3-482e-8dce-41b7d0ef4771-kube-api-access-tf6bm\") pod \"nova-cell1-ff09-account-create-update-2k6sp\" (UID: \"feb1fe6d-59b3-482e-8dce-41b7d0ef4771\") " pod="openstack-kuttl-tests/nova-cell1-ff09-account-create-update-2k6sp" Mar 16 16:57:26 crc kubenswrapper[5120]: I0316 16:57:26.174632 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/feb1fe6d-59b3-482e-8dce-41b7d0ef4771-operator-scripts\") pod \"nova-cell1-ff09-account-create-update-2k6sp\" (UID: \"feb1fe6d-59b3-482e-8dce-41b7d0ef4771\") " pod="openstack-kuttl-tests/nova-cell1-ff09-account-create-update-2k6sp" Mar 16 16:57:26 crc kubenswrapper[5120]: I0316 16:57:26.199573 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-e0b3-account-create-update-22hwc" Mar 16 16:57:26 crc kubenswrapper[5120]: I0316 16:57:26.279529 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/feb1fe6d-59b3-482e-8dce-41b7d0ef4771-operator-scripts\") pod \"nova-cell1-ff09-account-create-update-2k6sp\" (UID: \"feb1fe6d-59b3-482e-8dce-41b7d0ef4771\") " pod="openstack-kuttl-tests/nova-cell1-ff09-account-create-update-2k6sp" Mar 16 16:57:26 crc kubenswrapper[5120]: I0316 16:57:26.281004 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/feb1fe6d-59b3-482e-8dce-41b7d0ef4771-operator-scripts\") pod \"nova-cell1-ff09-account-create-update-2k6sp\" (UID: \"feb1fe6d-59b3-482e-8dce-41b7d0ef4771\") " pod="openstack-kuttl-tests/nova-cell1-ff09-account-create-update-2k6sp" Mar 16 16:57:26 crc kubenswrapper[5120]: I0316 16:57:26.281553 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tf6bm\" (UniqueName: \"kubernetes.io/projected/feb1fe6d-59b3-482e-8dce-41b7d0ef4771-kube-api-access-tf6bm\") pod \"nova-cell1-ff09-account-create-update-2k6sp\" (UID: \"feb1fe6d-59b3-482e-8dce-41b7d0ef4771\") " pod="openstack-kuttl-tests/nova-cell1-ff09-account-create-update-2k6sp" Mar 16 16:57:26 crc kubenswrapper[5120]: I0316 16:57:26.301688 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tf6bm\" (UniqueName: \"kubernetes.io/projected/feb1fe6d-59b3-482e-8dce-41b7d0ef4771-kube-api-access-tf6bm\") pod \"nova-cell1-ff09-account-create-update-2k6sp\" (UID: \"feb1fe6d-59b3-482e-8dce-41b7d0ef4771\") " pod="openstack-kuttl-tests/nova-cell1-ff09-account-create-update-2k6sp" Mar 16 16:57:26 crc kubenswrapper[5120]: I0316 16:57:26.352805 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:57:26 crc kubenswrapper[5120]: I0316 16:57:26.384090 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-ff09-account-create-update-2k6sp" Mar 16 16:57:26 crc kubenswrapper[5120]: I0316 16:57:26.502327 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 16:57:26 crc kubenswrapper[5120]: I0316 16:57:26.502619 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/kube-state-metrics-0" podUID="60437041-a599-472d-8c74-8fd64b18636d" containerName="kube-state-metrics" containerID="cri-o://03717a903946f9041458d6f8898702f3c49380d7a9ed2c2a5b8d9a2071e2bc97" gracePeriod=30 Mar 16 16:57:26 crc kubenswrapper[5120]: I0316 16:57:26.534281 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-fqkvr"] Mar 16 16:57:26 crc kubenswrapper[5120]: I0316 16:57:26.683136 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/kube-state-metrics-0" podUID="60437041-a599-472d-8c74-8fd64b18636d" containerName="kube-state-metrics" probeResult="failure" output="Get \"http://10.217.0.221:8081/readyz\": dial tcp 10.217.0.221:8081: connect: connection refused" Mar 16 16:57:26 crc kubenswrapper[5120]: I0316 16:57:26.702441 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d0a971ac-2056-4ef1-abc7-8592e58f8114" path="/var/lib/kubelet/pods/d0a971ac-2056-4ef1-abc7-8592e58f8114/volumes" Mar 16 16:57:26 crc kubenswrapper[5120]: I0316 16:57:26.704089 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-wbxjt"] Mar 16 16:57:26 crc kubenswrapper[5120]: I0316 16:57:26.736629 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-1add-account-create-update-xxkxp"] Mar 16 16:57:27 crc kubenswrapper[5120]: I0316 16:57:27.102204 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1e65f09e-1d21-4f6c-b431-5e1675a8cff3","Type":"ContainerStarted","Data":"13d5d5a3d22221840b3e53854a99e972e22a4c6e6d9206b930cb0f4960b78696"} Mar 16 16:57:27 crc kubenswrapper[5120]: I0316 16:57:27.111435 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-db-create-fqkvr" event={"ID":"40d27067-1463-46fe-aef7-9d45c77c74c8","Type":"ContainerStarted","Data":"6a271e5eda0bab7e1bc390ba06ddcc271ea45963e9ec7be7e8b9e1a45b064854"} Mar 16 16:57:27 crc kubenswrapper[5120]: I0316 16:57:27.111502 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-db-create-fqkvr" event={"ID":"40d27067-1463-46fe-aef7-9d45c77c74c8","Type":"ContainerStarted","Data":"c55937155ed5f31ecfb0fba3c89da3e947d12deae8d125b5ac4c38a303193cfa"} Mar 16 16:57:27 crc kubenswrapper[5120]: I0316 16:57:27.137695 5120 generic.go:358] "Generic (PLEG): container finished" podID="60437041-a599-472d-8c74-8fd64b18636d" containerID="03717a903946f9041458d6f8898702f3c49380d7a9ed2c2a5b8d9a2071e2bc97" exitCode=2 Mar 16 16:57:27 crc kubenswrapper[5120]: I0316 16:57:27.138064 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"60437041-a599-472d-8c74-8fd64b18636d","Type":"ContainerDied","Data":"03717a903946f9041458d6f8898702f3c49380d7a9ed2c2a5b8d9a2071e2bc97"} Mar 16 16:57:27 crc kubenswrapper[5120]: I0316 16:57:27.144282 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-1add-account-create-update-xxkxp" event={"ID":"38dbe21c-3c67-4241-b83d-0de332345bb9","Type":"ContainerStarted","Data":"1b393fcb605979a7f06391fe5103518a7689554356343956c6189482a5f9e84b"} Mar 16 16:57:27 crc kubenswrapper[5120]: I0316 16:57:27.144327 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-1add-account-create-update-xxkxp" event={"ID":"38dbe21c-3c67-4241-b83d-0de332345bb9","Type":"ContainerStarted","Data":"d9adcc5da167af0a9a8dd223d8ad92a6b0fb6f736bcd13e6dfdd976d919424e5"} Mar 16 16:57:27 crc kubenswrapper[5120]: I0316 16:57:27.147203 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-db-create-wbxjt" event={"ID":"b07886c3-349e-4172-8f68-077ceaf8711d","Type":"ContainerStarted","Data":"a7f6467cdcb3317973a736b263e03c8df1085bea9b0eddb39d5647f94fe9343b"} Mar 16 16:57:27 crc kubenswrapper[5120]: I0316 16:57:27.147386 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-db-create-wbxjt" event={"ID":"b07886c3-349e-4172-8f68-077ceaf8711d","Type":"ContainerStarted","Data":"74d0699e1e152fc4d27ce9a6a019c0a76f73bf0e43d0b5725bf18c2b88510e6f"} Mar 16 16:57:27 crc kubenswrapper[5120]: I0316 16:57:27.162838 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-e0b3-account-create-update-22hwc"] Mar 16 16:57:27 crc kubenswrapper[5120]: I0316 16:57:27.176664 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-nn7ww"] Mar 16 16:57:27 crc kubenswrapper[5120]: I0316 16:57:27.181357 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-db-create-fqkvr" podStartSLOduration=2.181323768 podStartE2EDuration="2.181323768s" podCreationTimestamp="2026-03-16 16:57:25 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:57:27.15214837 +0000 UTC m=+5149.306080027" watchObservedRunningTime="2026-03-16 16:57:27.181323768 +0000 UTC m=+5149.335255425" Mar 16 16:57:27 crc kubenswrapper[5120]: I0316 16:57:27.203175 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-1add-account-create-update-xxkxp" podStartSLOduration=2.203140485 podStartE2EDuration="2.203140485s" podCreationTimestamp="2026-03-16 16:57:25 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:57:27.172080455 +0000 UTC m=+5149.326012122" watchObservedRunningTime="2026-03-16 16:57:27.203140485 +0000 UTC m=+5149.357072142" Mar 16 16:57:27 crc kubenswrapper[5120]: I0316 16:57:27.209844 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-db-create-wbxjt" podStartSLOduration=2.209808898 podStartE2EDuration="2.209808898s" podCreationTimestamp="2026-03-16 16:57:25 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:57:27.191017933 +0000 UTC m=+5149.344949600" watchObservedRunningTime="2026-03-16 16:57:27.209808898 +0000 UTC m=+5149.363740565" Mar 16 16:57:27 crc kubenswrapper[5120]: I0316 16:57:27.238146 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-ff09-account-create-update-2k6sp"] Mar 16 16:57:27 crc kubenswrapper[5120]: W0316 16:57:27.285040 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfeb1fe6d_59b3_482e_8dce_41b7d0ef4771.slice/crio-1a1dd08e3d256d9bbbe1c620b56171cea0ceb9db8f1670301c371296e94c8877 WatchSource:0}: Error finding container 1a1dd08e3d256d9bbbe1c620b56171cea0ceb9db8f1670301c371296e94c8877: Status 404 returned error can't find the container with id 1a1dd08e3d256d9bbbe1c620b56171cea0ceb9db8f1670301c371296e94c8877 Mar 16 16:57:27 crc kubenswrapper[5120]: I0316 16:57:27.601772 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:57:27 crc kubenswrapper[5120]: I0316 16:57:27.643675 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2n2q4\" (UniqueName: \"kubernetes.io/projected/60437041-a599-472d-8c74-8fd64b18636d-kube-api-access-2n2q4\") pod \"60437041-a599-472d-8c74-8fd64b18636d\" (UID: \"60437041-a599-472d-8c74-8fd64b18636d\") " Mar 16 16:57:27 crc kubenswrapper[5120]: I0316 16:57:27.661018 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60437041-a599-472d-8c74-8fd64b18636d-kube-api-access-2n2q4" (OuterVolumeSpecName: "kube-api-access-2n2q4") pod "60437041-a599-472d-8c74-8fd64b18636d" (UID: "60437041-a599-472d-8c74-8fd64b18636d"). InnerVolumeSpecName "kube-api-access-2n2q4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:57:27 crc kubenswrapper[5120]: I0316 16:57:27.747825 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2n2q4\" (UniqueName: \"kubernetes.io/projected/60437041-a599-472d-8c74-8fd64b18636d-kube-api-access-2n2q4\") on node \"crc\" DevicePath \"\"" Mar 16 16:57:28 crc kubenswrapper[5120]: I0316 16:57:28.161422 5120 generic.go:358] "Generic (PLEG): container finished" podID="40d27067-1463-46fe-aef7-9d45c77c74c8" containerID="6a271e5eda0bab7e1bc390ba06ddcc271ea45963e9ec7be7e8b9e1a45b064854" exitCode=0 Mar 16 16:57:28 crc kubenswrapper[5120]: I0316 16:57:28.162091 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-db-create-fqkvr" event={"ID":"40d27067-1463-46fe-aef7-9d45c77c74c8","Type":"ContainerDied","Data":"6a271e5eda0bab7e1bc390ba06ddcc271ea45963e9ec7be7e8b9e1a45b064854"} Mar 16 16:57:28 crc kubenswrapper[5120]: I0316 16:57:28.170975 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:57:28 crc kubenswrapper[5120]: I0316 16:57:28.171046 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"60437041-a599-472d-8c74-8fd64b18636d","Type":"ContainerDied","Data":"39144854ddbd74a2824ba19c43035f0d8ad435cf002f9cd58b25317ffe8ae822"} Mar 16 16:57:28 crc kubenswrapper[5120]: I0316 16:57:28.171133 5120 scope.go:117] "RemoveContainer" containerID="03717a903946f9041458d6f8898702f3c49380d7a9ed2c2a5b8d9a2071e2bc97" Mar 16 16:57:28 crc kubenswrapper[5120]: I0316 16:57:28.180477 5120 generic.go:358] "Generic (PLEG): container finished" podID="90a64bb3-08ab-478c-812b-d673e0772e88" containerID="30900d147a28421fa41bcb63b053adb219f28881d1c2de138bcd335a68106800" exitCode=0 Mar 16 16:57:28 crc kubenswrapper[5120]: I0316 16:57:28.180860 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-db-create-nn7ww" event={"ID":"90a64bb3-08ab-478c-812b-d673e0772e88","Type":"ContainerDied","Data":"30900d147a28421fa41bcb63b053adb219f28881d1c2de138bcd335a68106800"} Mar 16 16:57:28 crc kubenswrapper[5120]: I0316 16:57:28.180984 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-db-create-nn7ww" event={"ID":"90a64bb3-08ab-478c-812b-d673e0772e88","Type":"ContainerStarted","Data":"1d009aea9dfaef145276e182377b1239a6c917527df175f8649b9e72da0f7db6"} Mar 16 16:57:28 crc kubenswrapper[5120]: I0316 16:57:28.185453 5120 generic.go:358] "Generic (PLEG): container finished" podID="d4bdf21c-03be-41af-bd5b-e07309d9129e" containerID="944c2852f2412c9d950f56ca2ba9379432e3e19c19474fcade16e4aef26d008b" exitCode=0 Mar 16 16:57:28 crc kubenswrapper[5120]: I0316 16:57:28.185637 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-e0b3-account-create-update-22hwc" event={"ID":"d4bdf21c-03be-41af-bd5b-e07309d9129e","Type":"ContainerDied","Data":"944c2852f2412c9d950f56ca2ba9379432e3e19c19474fcade16e4aef26d008b"} Mar 16 16:57:28 crc kubenswrapper[5120]: I0316 16:57:28.185677 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-e0b3-account-create-update-22hwc" event={"ID":"d4bdf21c-03be-41af-bd5b-e07309d9129e","Type":"ContainerStarted","Data":"cc9ba7613f6f3e44f6da57d6fd0b0ce1307dab5a7bd0aefb4c43c8f6225f4079"} Mar 16 16:57:28 crc kubenswrapper[5120]: I0316 16:57:28.194150 5120 generic.go:358] "Generic (PLEG): container finished" podID="38dbe21c-3c67-4241-b83d-0de332345bb9" containerID="1b393fcb605979a7f06391fe5103518a7689554356343956c6189482a5f9e84b" exitCode=0 Mar 16 16:57:28 crc kubenswrapper[5120]: I0316 16:57:28.194216 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-1add-account-create-update-xxkxp" event={"ID":"38dbe21c-3c67-4241-b83d-0de332345bb9","Type":"ContainerDied","Data":"1b393fcb605979a7f06391fe5103518a7689554356343956c6189482a5f9e84b"} Mar 16 16:57:28 crc kubenswrapper[5120]: I0316 16:57:28.197752 5120 generic.go:358] "Generic (PLEG): container finished" podID="b07886c3-349e-4172-8f68-077ceaf8711d" containerID="a7f6467cdcb3317973a736b263e03c8df1085bea9b0eddb39d5647f94fe9343b" exitCode=0 Mar 16 16:57:28 crc kubenswrapper[5120]: I0316 16:57:28.198366 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-db-create-wbxjt" event={"ID":"b07886c3-349e-4172-8f68-077ceaf8711d","Type":"ContainerDied","Data":"a7f6467cdcb3317973a736b263e03c8df1085bea9b0eddb39d5647f94fe9343b"} Mar 16 16:57:28 crc kubenswrapper[5120]: I0316 16:57:28.205882 5120 generic.go:358] "Generic (PLEG): container finished" podID="feb1fe6d-59b3-482e-8dce-41b7d0ef4771" containerID="89e994443283c3b0c455666b21ea5448adcc79f46926d6b06e778b67c67d16fd" exitCode=0 Mar 16 16:57:28 crc kubenswrapper[5120]: I0316 16:57:28.206067 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-ff09-account-create-update-2k6sp" event={"ID":"feb1fe6d-59b3-482e-8dce-41b7d0ef4771","Type":"ContainerDied","Data":"89e994443283c3b0c455666b21ea5448adcc79f46926d6b06e778b67c67d16fd"} Mar 16 16:57:28 crc kubenswrapper[5120]: I0316 16:57:28.206098 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-ff09-account-create-update-2k6sp" event={"ID":"feb1fe6d-59b3-482e-8dce-41b7d0ef4771","Type":"ContainerStarted","Data":"1a1dd08e3d256d9bbbe1c620b56171cea0ceb9db8f1670301c371296e94c8877"} Mar 16 16:57:28 crc kubenswrapper[5120]: I0316 16:57:28.248464 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 16:57:28 crc kubenswrapper[5120]: I0316 16:57:28.259709 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 16:57:28 crc kubenswrapper[5120]: I0316 16:57:28.269630 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 16:57:28 crc kubenswrapper[5120]: I0316 16:57:28.271631 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60437041-a599-472d-8c74-8fd64b18636d" containerName="kube-state-metrics" Mar 16 16:57:28 crc kubenswrapper[5120]: I0316 16:57:28.271657 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="60437041-a599-472d-8c74-8fd64b18636d" containerName="kube-state-metrics" Mar 16 16:57:28 crc kubenswrapper[5120]: I0316 16:57:28.271889 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="60437041-a599-472d-8c74-8fd64b18636d" containerName="kube-state-metrics" Mar 16 16:57:28 crc kubenswrapper[5120]: I0316 16:57:28.276794 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:57:28 crc kubenswrapper[5120]: I0316 16:57:28.279229 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"kube-state-metrics-tls-config\"" Mar 16 16:57:28 crc kubenswrapper[5120]: I0316 16:57:28.279487 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-kube-state-metrics-svc\"" Mar 16 16:57:28 crc kubenswrapper[5120]: I0316 16:57:28.309664 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 16:57:28 crc kubenswrapper[5120]: I0316 16:57:28.361338 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dfe6d730-dd04-4759-a360-e9a2e8f88dab-combined-ca-bundle\") pod \"kube-state-metrics-0\" (UID: \"dfe6d730-dd04-4759-a360-e9a2e8f88dab\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:57:28 crc kubenswrapper[5120]: I0316 16:57:28.361482 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8pb8\" (UniqueName: \"kubernetes.io/projected/dfe6d730-dd04-4759-a360-e9a2e8f88dab-kube-api-access-c8pb8\") pod \"kube-state-metrics-0\" (UID: \"dfe6d730-dd04-4759-a360-e9a2e8f88dab\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:57:28 crc kubenswrapper[5120]: I0316 16:57:28.361571 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/dfe6d730-dd04-4759-a360-e9a2e8f88dab-kube-state-metrics-tls-certs\") pod \"kube-state-metrics-0\" (UID: \"dfe6d730-dd04-4759-a360-e9a2e8f88dab\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:57:28 crc kubenswrapper[5120]: I0316 16:57:28.362034 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/dfe6d730-dd04-4759-a360-e9a2e8f88dab-kube-state-metrics-tls-config\") pod \"kube-state-metrics-0\" (UID: \"dfe6d730-dd04-4759-a360-e9a2e8f88dab\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:57:28 crc kubenswrapper[5120]: I0316 16:57:28.464466 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dfe6d730-dd04-4759-a360-e9a2e8f88dab-combined-ca-bundle\") pod \"kube-state-metrics-0\" (UID: \"dfe6d730-dd04-4759-a360-e9a2e8f88dab\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:57:28 crc kubenswrapper[5120]: I0316 16:57:28.464629 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c8pb8\" (UniqueName: \"kubernetes.io/projected/dfe6d730-dd04-4759-a360-e9a2e8f88dab-kube-api-access-c8pb8\") pod \"kube-state-metrics-0\" (UID: \"dfe6d730-dd04-4759-a360-e9a2e8f88dab\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:57:28 crc kubenswrapper[5120]: I0316 16:57:28.464714 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/dfe6d730-dd04-4759-a360-e9a2e8f88dab-kube-state-metrics-tls-certs\") pod \"kube-state-metrics-0\" (UID: \"dfe6d730-dd04-4759-a360-e9a2e8f88dab\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:57:28 crc kubenswrapper[5120]: I0316 16:57:28.464894 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/dfe6d730-dd04-4759-a360-e9a2e8f88dab-kube-state-metrics-tls-config\") pod \"kube-state-metrics-0\" (UID: \"dfe6d730-dd04-4759-a360-e9a2e8f88dab\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:57:28 crc kubenswrapper[5120]: I0316 16:57:28.472159 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dfe6d730-dd04-4759-a360-e9a2e8f88dab-combined-ca-bundle\") pod \"kube-state-metrics-0\" (UID: \"dfe6d730-dd04-4759-a360-e9a2e8f88dab\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:57:28 crc kubenswrapper[5120]: I0316 16:57:28.477705 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/dfe6d730-dd04-4759-a360-e9a2e8f88dab-kube-state-metrics-tls-config\") pod \"kube-state-metrics-0\" (UID: \"dfe6d730-dd04-4759-a360-e9a2e8f88dab\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:57:28 crc kubenswrapper[5120]: I0316 16:57:28.479742 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/dfe6d730-dd04-4759-a360-e9a2e8f88dab-kube-state-metrics-tls-certs\") pod \"kube-state-metrics-0\" (UID: \"dfe6d730-dd04-4759-a360-e9a2e8f88dab\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:57:28 crc kubenswrapper[5120]: I0316 16:57:28.484057 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8pb8\" (UniqueName: \"kubernetes.io/projected/dfe6d730-dd04-4759-a360-e9a2e8f88dab-kube-api-access-c8pb8\") pod \"kube-state-metrics-0\" (UID: \"dfe6d730-dd04-4759-a360-e9a2e8f88dab\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:57:28 crc kubenswrapper[5120]: I0316 16:57:28.597421 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:57:28 crc kubenswrapper[5120]: I0316 16:57:28.600126 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:57:28 crc kubenswrapper[5120]: I0316 16:57:28.690448 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="60437041-a599-472d-8c74-8fd64b18636d" path="/var/lib/kubelet/pods/60437041-a599-472d-8c74-8fd64b18636d/volumes" Mar 16 16:57:28 crc kubenswrapper[5120]: I0316 16:57:28.758215 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/neutron-8bf9bfcb4-2674f" Mar 16 16:57:28 crc kubenswrapper[5120]: I0316 16:57:28.827213 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-69697bd7fc-vk7rp"] Mar 16 16:57:28 crc kubenswrapper[5120]: I0316 16:57:28.827544 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-69697bd7fc-vk7rp" podUID="8f0581f7-6963-41b0-8725-fc9e15013e45" containerName="neutron-api" containerID="cri-o://3dfcc69393dccb8f4d7cf68198d3934da02c48498d64b13e41b4c66b9ee2c8b6" gracePeriod=30 Mar 16 16:57:28 crc kubenswrapper[5120]: I0316 16:57:28.827930 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-69697bd7fc-vk7rp" podUID="8f0581f7-6963-41b0-8725-fc9e15013e45" containerName="neutron-httpd" containerID="cri-o://c2f8b725846999666c2adf76377f2bba3b35b761392291c5e12b4fd9642de7e1" gracePeriod=30 Mar 16 16:57:29 crc kubenswrapper[5120]: I0316 16:57:29.116493 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 16:57:29 crc kubenswrapper[5120]: W0316 16:57:29.124461 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddfe6d730_dd04_4759_a360_e9a2e8f88dab.slice/crio-bec823beebc858b748241a14a7256d823af5245bb0cc02feed2e26c049d8c677 WatchSource:0}: Error finding container bec823beebc858b748241a14a7256d823af5245bb0cc02feed2e26c049d8c677: Status 404 returned error can't find the container with id bec823beebc858b748241a14a7256d823af5245bb0cc02feed2e26c049d8c677 Mar 16 16:57:29 crc kubenswrapper[5120]: I0316 16:57:29.222488 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"dfe6d730-dd04-4759-a360-e9a2e8f88dab","Type":"ContainerStarted","Data":"bec823beebc858b748241a14a7256d823af5245bb0cc02feed2e26c049d8c677"} Mar 16 16:57:29 crc kubenswrapper[5120]: I0316 16:57:29.225374 5120 generic.go:358] "Generic (PLEG): container finished" podID="8f0581f7-6963-41b0-8725-fc9e15013e45" containerID="c2f8b725846999666c2adf76377f2bba3b35b761392291c5e12b4fd9642de7e1" exitCode=0 Mar 16 16:57:29 crc kubenswrapper[5120]: I0316 16:57:29.225811 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-69697bd7fc-vk7rp" event={"ID":"8f0581f7-6963-41b0-8725-fc9e15013e45","Type":"ContainerDied","Data":"c2f8b725846999666c2adf76377f2bba3b35b761392291c5e12b4fd9642de7e1"} Mar 16 16:57:29 crc kubenswrapper[5120]: I0316 16:57:29.768284 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-db-create-fqkvr" Mar 16 16:57:29 crc kubenswrapper[5120]: I0316 16:57:29.856643 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-db-create-wbxjt" Mar 16 16:57:29 crc kubenswrapper[5120]: I0316 16:57:29.942560 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qp5sd\" (UniqueName: \"kubernetes.io/projected/40d27067-1463-46fe-aef7-9d45c77c74c8-kube-api-access-qp5sd\") pod \"40d27067-1463-46fe-aef7-9d45c77c74c8\" (UID: \"40d27067-1463-46fe-aef7-9d45c77c74c8\") " Mar 16 16:57:29 crc kubenswrapper[5120]: I0316 16:57:29.942635 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p8nn9\" (UniqueName: \"kubernetes.io/projected/b07886c3-349e-4172-8f68-077ceaf8711d-kube-api-access-p8nn9\") pod \"b07886c3-349e-4172-8f68-077ceaf8711d\" (UID: \"b07886c3-349e-4172-8f68-077ceaf8711d\") " Mar 16 16:57:29 crc kubenswrapper[5120]: I0316 16:57:29.944372 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b07886c3-349e-4172-8f68-077ceaf8711d-operator-scripts\") pod \"b07886c3-349e-4172-8f68-077ceaf8711d\" (UID: \"b07886c3-349e-4172-8f68-077ceaf8711d\") " Mar 16 16:57:29 crc kubenswrapper[5120]: I0316 16:57:29.944559 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/40d27067-1463-46fe-aef7-9d45c77c74c8-operator-scripts\") pod \"40d27067-1463-46fe-aef7-9d45c77c74c8\" (UID: \"40d27067-1463-46fe-aef7-9d45c77c74c8\") " Mar 16 16:57:29 crc kubenswrapper[5120]: I0316 16:57:29.944809 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-ff09-account-create-update-2k6sp" Mar 16 16:57:29 crc kubenswrapper[5120]: I0316 16:57:29.945335 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b07886c3-349e-4172-8f68-077ceaf8711d-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "b07886c3-349e-4172-8f68-077ceaf8711d" (UID: "b07886c3-349e-4172-8f68-077ceaf8711d"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:57:29 crc kubenswrapper[5120]: I0316 16:57:29.959081 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/40d27067-1463-46fe-aef7-9d45c77c74c8-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "40d27067-1463-46fe-aef7-9d45c77c74c8" (UID: "40d27067-1463-46fe-aef7-9d45c77c74c8"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:57:29 crc kubenswrapper[5120]: I0316 16:57:29.959236 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40d27067-1463-46fe-aef7-9d45c77c74c8-kube-api-access-qp5sd" (OuterVolumeSpecName: "kube-api-access-qp5sd") pod "40d27067-1463-46fe-aef7-9d45c77c74c8" (UID: "40d27067-1463-46fe-aef7-9d45c77c74c8"). InnerVolumeSpecName "kube-api-access-qp5sd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:57:29 crc kubenswrapper[5120]: I0316 16:57:29.966139 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b07886c3-349e-4172-8f68-077ceaf8711d-kube-api-access-p8nn9" (OuterVolumeSpecName: "kube-api-access-p8nn9") pod "b07886c3-349e-4172-8f68-077ceaf8711d" (UID: "b07886c3-349e-4172-8f68-077ceaf8711d"). InnerVolumeSpecName "kube-api-access-p8nn9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:57:29 crc kubenswrapper[5120]: I0316 16:57:29.969976 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/40d27067-1463-46fe-aef7-9d45c77c74c8-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:57:29 crc kubenswrapper[5120]: I0316 16:57:29.970013 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qp5sd\" (UniqueName: \"kubernetes.io/projected/40d27067-1463-46fe-aef7-9d45c77c74c8-kube-api-access-qp5sd\") on node \"crc\" DevicePath \"\"" Mar 16 16:57:29 crc kubenswrapper[5120]: I0316 16:57:29.970031 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p8nn9\" (UniqueName: \"kubernetes.io/projected/b07886c3-349e-4172-8f68-077ceaf8711d-kube-api-access-p8nn9\") on node \"crc\" DevicePath \"\"" Mar 16 16:57:29 crc kubenswrapper[5120]: I0316 16:57:29.970043 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b07886c3-349e-4172-8f68-077ceaf8711d-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:57:29 crc kubenswrapper[5120]: I0316 16:57:29.976392 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-1add-account-create-update-xxkxp" Mar 16 16:57:30 crc kubenswrapper[5120]: I0316 16:57:30.001454 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-db-create-nn7ww" Mar 16 16:57:30 crc kubenswrapper[5120]: I0316 16:57:30.013444 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-e0b3-account-create-update-22hwc" Mar 16 16:57:30 crc kubenswrapper[5120]: I0316 16:57:30.057065 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/swift-proxy-5f4bc687f4-xcf5c" Mar 16 16:57:30 crc kubenswrapper[5120]: I0316 16:57:30.057869 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/swift-proxy-5f4bc687f4-xcf5c" Mar 16 16:57:30 crc kubenswrapper[5120]: I0316 16:57:30.071737 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/feb1fe6d-59b3-482e-8dce-41b7d0ef4771-operator-scripts\") pod \"feb1fe6d-59b3-482e-8dce-41b7d0ef4771\" (UID: \"feb1fe6d-59b3-482e-8dce-41b7d0ef4771\") " Mar 16 16:57:30 crc kubenswrapper[5120]: I0316 16:57:30.071878 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tf6bm\" (UniqueName: \"kubernetes.io/projected/feb1fe6d-59b3-482e-8dce-41b7d0ef4771-kube-api-access-tf6bm\") pod \"feb1fe6d-59b3-482e-8dce-41b7d0ef4771\" (UID: \"feb1fe6d-59b3-482e-8dce-41b7d0ef4771\") " Mar 16 16:57:30 crc kubenswrapper[5120]: I0316 16:57:30.075799 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/feb1fe6d-59b3-482e-8dce-41b7d0ef4771-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "feb1fe6d-59b3-482e-8dce-41b7d0ef4771" (UID: "feb1fe6d-59b3-482e-8dce-41b7d0ef4771"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:57:30 crc kubenswrapper[5120]: I0316 16:57:30.080026 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/feb1fe6d-59b3-482e-8dce-41b7d0ef4771-kube-api-access-tf6bm" (OuterVolumeSpecName: "kube-api-access-tf6bm") pod "feb1fe6d-59b3-482e-8dce-41b7d0ef4771" (UID: "feb1fe6d-59b3-482e-8dce-41b7d0ef4771"). InnerVolumeSpecName "kube-api-access-tf6bm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:57:30 crc kubenswrapper[5120]: I0316 16:57:30.178643 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/38dbe21c-3c67-4241-b83d-0de332345bb9-operator-scripts\") pod \"38dbe21c-3c67-4241-b83d-0de332345bb9\" (UID: \"38dbe21c-3c67-4241-b83d-0de332345bb9\") " Mar 16 16:57:30 crc kubenswrapper[5120]: I0316 16:57:30.179255 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4bh6g\" (UniqueName: \"kubernetes.io/projected/d4bdf21c-03be-41af-bd5b-e07309d9129e-kube-api-access-4bh6g\") pod \"d4bdf21c-03be-41af-bd5b-e07309d9129e\" (UID: \"d4bdf21c-03be-41af-bd5b-e07309d9129e\") " Mar 16 16:57:30 crc kubenswrapper[5120]: I0316 16:57:30.179550 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/90a64bb3-08ab-478c-812b-d673e0772e88-operator-scripts\") pod \"90a64bb3-08ab-478c-812b-d673e0772e88\" (UID: \"90a64bb3-08ab-478c-812b-d673e0772e88\") " Mar 16 16:57:30 crc kubenswrapper[5120]: I0316 16:57:30.179791 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d4bdf21c-03be-41af-bd5b-e07309d9129e-operator-scripts\") pod \"d4bdf21c-03be-41af-bd5b-e07309d9129e\" (UID: \"d4bdf21c-03be-41af-bd5b-e07309d9129e\") " Mar 16 16:57:30 crc kubenswrapper[5120]: I0316 16:57:30.180060 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-frbgn\" (UniqueName: \"kubernetes.io/projected/38dbe21c-3c67-4241-b83d-0de332345bb9-kube-api-access-frbgn\") pod \"38dbe21c-3c67-4241-b83d-0de332345bb9\" (UID: \"38dbe21c-3c67-4241-b83d-0de332345bb9\") " Mar 16 16:57:30 crc kubenswrapper[5120]: I0316 16:57:30.180235 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k9zjn\" (UniqueName: \"kubernetes.io/projected/90a64bb3-08ab-478c-812b-d673e0772e88-kube-api-access-k9zjn\") pod \"90a64bb3-08ab-478c-812b-d673e0772e88\" (UID: \"90a64bb3-08ab-478c-812b-d673e0772e88\") " Mar 16 16:57:30 crc kubenswrapper[5120]: I0316 16:57:30.181518 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/38dbe21c-3c67-4241-b83d-0de332345bb9-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "38dbe21c-3c67-4241-b83d-0de332345bb9" (UID: "38dbe21c-3c67-4241-b83d-0de332345bb9"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:57:30 crc kubenswrapper[5120]: I0316 16:57:30.181609 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/feb1fe6d-59b3-482e-8dce-41b7d0ef4771-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:57:30 crc kubenswrapper[5120]: I0316 16:57:30.181671 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tf6bm\" (UniqueName: \"kubernetes.io/projected/feb1fe6d-59b3-482e-8dce-41b7d0ef4771-kube-api-access-tf6bm\") on node \"crc\" DevicePath \"\"" Mar 16 16:57:30 crc kubenswrapper[5120]: I0316 16:57:30.181821 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/90a64bb3-08ab-478c-812b-d673e0772e88-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "90a64bb3-08ab-478c-812b-d673e0772e88" (UID: "90a64bb3-08ab-478c-812b-d673e0772e88"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:57:30 crc kubenswrapper[5120]: I0316 16:57:30.182069 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4bdf21c-03be-41af-bd5b-e07309d9129e-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "d4bdf21c-03be-41af-bd5b-e07309d9129e" (UID: "d4bdf21c-03be-41af-bd5b-e07309d9129e"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 16:57:30 crc kubenswrapper[5120]: I0316 16:57:30.186971 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38dbe21c-3c67-4241-b83d-0de332345bb9-kube-api-access-frbgn" (OuterVolumeSpecName: "kube-api-access-frbgn") pod "38dbe21c-3c67-4241-b83d-0de332345bb9" (UID: "38dbe21c-3c67-4241-b83d-0de332345bb9"). InnerVolumeSpecName "kube-api-access-frbgn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:57:30 crc kubenswrapper[5120]: I0316 16:57:30.213716 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4bdf21c-03be-41af-bd5b-e07309d9129e-kube-api-access-4bh6g" (OuterVolumeSpecName: "kube-api-access-4bh6g") pod "d4bdf21c-03be-41af-bd5b-e07309d9129e" (UID: "d4bdf21c-03be-41af-bd5b-e07309d9129e"). InnerVolumeSpecName "kube-api-access-4bh6g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:57:30 crc kubenswrapper[5120]: I0316 16:57:30.219033 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90a64bb3-08ab-478c-812b-d673e0772e88-kube-api-access-k9zjn" (OuterVolumeSpecName: "kube-api-access-k9zjn") pod "90a64bb3-08ab-478c-812b-d673e0772e88" (UID: "90a64bb3-08ab-478c-812b-d673e0772e88"). InnerVolumeSpecName "kube-api-access-k9zjn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:57:30 crc kubenswrapper[5120]: I0316 16:57:30.264477 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-db-create-fqkvr" event={"ID":"40d27067-1463-46fe-aef7-9d45c77c74c8","Type":"ContainerDied","Data":"c55937155ed5f31ecfb0fba3c89da3e947d12deae8d125b5ac4c38a303193cfa"} Mar 16 16:57:30 crc kubenswrapper[5120]: I0316 16:57:30.264693 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c55937155ed5f31ecfb0fba3c89da3e947d12deae8d125b5ac4c38a303193cfa" Mar 16 16:57:30 crc kubenswrapper[5120]: I0316 16:57:30.264879 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-db-create-fqkvr" Mar 16 16:57:30 crc kubenswrapper[5120]: I0316 16:57:30.273597 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"dfe6d730-dd04-4759-a360-e9a2e8f88dab","Type":"ContainerStarted","Data":"1fff1e33966ca1ffdcce7becb84f51ce0c07a0ab94db1170d3919627c2cd57ed"} Mar 16 16:57:30 crc kubenswrapper[5120]: I0316 16:57:30.274001 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:57:30 crc kubenswrapper[5120]: I0316 16:57:30.276178 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-db-create-nn7ww" event={"ID":"90a64bb3-08ab-478c-812b-d673e0772e88","Type":"ContainerDied","Data":"1d009aea9dfaef145276e182377b1239a6c917527df175f8649b9e72da0f7db6"} Mar 16 16:57:30 crc kubenswrapper[5120]: I0316 16:57:30.276221 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1d009aea9dfaef145276e182377b1239a6c917527df175f8649b9e72da0f7db6" Mar 16 16:57:30 crc kubenswrapper[5120]: I0316 16:57:30.276176 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-db-create-nn7ww" Mar 16 16:57:30 crc kubenswrapper[5120]: I0316 16:57:30.280032 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-e0b3-account-create-update-22hwc" event={"ID":"d4bdf21c-03be-41af-bd5b-e07309d9129e","Type":"ContainerDied","Data":"cc9ba7613f6f3e44f6da57d6fd0b0ce1307dab5a7bd0aefb4c43c8f6225f4079"} Mar 16 16:57:30 crc kubenswrapper[5120]: I0316 16:57:30.280137 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cc9ba7613f6f3e44f6da57d6fd0b0ce1307dab5a7bd0aefb4c43c8f6225f4079" Mar 16 16:57:30 crc kubenswrapper[5120]: I0316 16:57:30.280139 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-e0b3-account-create-update-22hwc" Mar 16 16:57:30 crc kubenswrapper[5120]: I0316 16:57:30.284112 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-1add-account-create-update-xxkxp" event={"ID":"38dbe21c-3c67-4241-b83d-0de332345bb9","Type":"ContainerDied","Data":"d9adcc5da167af0a9a8dd223d8ad92a6b0fb6f736bcd13e6dfdd976d919424e5"} Mar 16 16:57:30 crc kubenswrapper[5120]: I0316 16:57:30.284226 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-1add-account-create-update-xxkxp" Mar 16 16:57:30 crc kubenswrapper[5120]: I0316 16:57:30.284234 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d4bdf21c-03be-41af-bd5b-e07309d9129e-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:57:30 crc kubenswrapper[5120]: I0316 16:57:30.284260 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-frbgn\" (UniqueName: \"kubernetes.io/projected/38dbe21c-3c67-4241-b83d-0de332345bb9-kube-api-access-frbgn\") on node \"crc\" DevicePath \"\"" Mar 16 16:57:30 crc kubenswrapper[5120]: I0316 16:57:30.284259 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d9adcc5da167af0a9a8dd223d8ad92a6b0fb6f736bcd13e6dfdd976d919424e5" Mar 16 16:57:30 crc kubenswrapper[5120]: I0316 16:57:30.284281 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k9zjn\" (UniqueName: \"kubernetes.io/projected/90a64bb3-08ab-478c-812b-d673e0772e88-kube-api-access-k9zjn\") on node \"crc\" DevicePath \"\"" Mar 16 16:57:30 crc kubenswrapper[5120]: I0316 16:57:30.284292 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/38dbe21c-3c67-4241-b83d-0de332345bb9-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:57:30 crc kubenswrapper[5120]: I0316 16:57:30.284302 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4bh6g\" (UniqueName: \"kubernetes.io/projected/d4bdf21c-03be-41af-bd5b-e07309d9129e-kube-api-access-4bh6g\") on node \"crc\" DevicePath \"\"" Mar 16 16:57:30 crc kubenswrapper[5120]: I0316 16:57:30.284313 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/90a64bb3-08ab-478c-812b-d673e0772e88-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:57:30 crc kubenswrapper[5120]: I0316 16:57:30.301710 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/kube-state-metrics-0" podStartSLOduration=1.900100942 podStartE2EDuration="2.301678954s" podCreationTimestamp="2026-03-16 16:57:28 +0000 UTC" firstStartedPulling="2026-03-16 16:57:29.128724289 +0000 UTC m=+5151.282655946" lastFinishedPulling="2026-03-16 16:57:29.530302301 +0000 UTC m=+5151.684233958" observedRunningTime="2026-03-16 16:57:30.293388897 +0000 UTC m=+5152.447320554" watchObservedRunningTime="2026-03-16 16:57:30.301678954 +0000 UTC m=+5152.455610611" Mar 16 16:57:30 crc kubenswrapper[5120]: I0316 16:57:30.302855 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-db-create-wbxjt" event={"ID":"b07886c3-349e-4172-8f68-077ceaf8711d","Type":"ContainerDied","Data":"74d0699e1e152fc4d27ce9a6a019c0a76f73bf0e43d0b5725bf18c2b88510e6f"} Mar 16 16:57:30 crc kubenswrapper[5120]: I0316 16:57:30.303147 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="74d0699e1e152fc4d27ce9a6a019c0a76f73bf0e43d0b5725bf18c2b88510e6f" Mar 16 16:57:30 crc kubenswrapper[5120]: I0316 16:57:30.302882 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-db-create-wbxjt" Mar 16 16:57:30 crc kubenswrapper[5120]: I0316 16:57:30.311705 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-ff09-account-create-update-2k6sp" Mar 16 16:57:30 crc kubenswrapper[5120]: I0316 16:57:30.312619 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-ff09-account-create-update-2k6sp" event={"ID":"feb1fe6d-59b3-482e-8dce-41b7d0ef4771","Type":"ContainerDied","Data":"1a1dd08e3d256d9bbbe1c620b56171cea0ceb9db8f1670301c371296e94c8877"} Mar 16 16:57:30 crc kubenswrapper[5120]: I0316 16:57:30.312668 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1a1dd08e3d256d9bbbe1c620b56171cea0ceb9db8f1670301c371296e94c8877" Mar 16 16:57:31 crc kubenswrapper[5120]: I0316 16:57:31.339214 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1e65f09e-1d21-4f6c-b431-5e1675a8cff3","Type":"ContainerStarted","Data":"c3cc30d1da1f028db2b5e776e794d21c383b4ad08ae7b54e9bc6c7c7625b165c"} Mar 16 16:57:32 crc kubenswrapper[5120]: I0316 16:57:32.351707 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1e65f09e-1d21-4f6c-b431-5e1675a8cff3","Type":"ContainerStarted","Data":"de2ffa7d20b9381db814eb23f5a1eae0b4fafd9d3d42dd9884986ad52f5d98c8"} Mar 16 16:57:33 crc kubenswrapper[5120]: I0316 16:57:33.364606 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1e65f09e-1d21-4f6c-b431-5e1675a8cff3","Type":"ContainerStarted","Data":"845eb637dd190a1a9b2fdd87847f9b6124bca6b2162ffc768c01f32d7c8e6f24"} Mar 16 16:57:34 crc kubenswrapper[5120]: I0316 16:57:34.670854 5120 scope.go:117] "RemoveContainer" containerID="083f72646c8d47c9c0467b39be99ddfa9c2e5900ae0a29ad53d7b39b950274b4" Mar 16 16:57:34 crc kubenswrapper[5120]: E0316 16:57:34.671448 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:57:35 crc kubenswrapper[5120]: I0316 16:57:35.414649 5120 generic.go:358] "Generic (PLEG): container finished" podID="8f0581f7-6963-41b0-8725-fc9e15013e45" containerID="3dfcc69393dccb8f4d7cf68198d3934da02c48498d64b13e41b4c66b9ee2c8b6" exitCode=0 Mar 16 16:57:35 crc kubenswrapper[5120]: I0316 16:57:35.415195 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-69697bd7fc-vk7rp" event={"ID":"8f0581f7-6963-41b0-8725-fc9e15013e45","Type":"ContainerDied","Data":"3dfcc69393dccb8f4d7cf68198d3934da02c48498d64b13e41b4c66b9ee2c8b6"} Mar 16 16:57:35 crc kubenswrapper[5120]: I0316 16:57:35.552843 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-69697bd7fc-vk7rp" Mar 16 16:57:35 crc kubenswrapper[5120]: I0316 16:57:35.626504 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/8f0581f7-6963-41b0-8725-fc9e15013e45-httpd-config\") pod \"8f0581f7-6963-41b0-8725-fc9e15013e45\" (UID: \"8f0581f7-6963-41b0-8725-fc9e15013e45\") " Mar 16 16:57:35 crc kubenswrapper[5120]: I0316 16:57:35.626832 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6sfr8\" (UniqueName: \"kubernetes.io/projected/8f0581f7-6963-41b0-8725-fc9e15013e45-kube-api-access-6sfr8\") pod \"8f0581f7-6963-41b0-8725-fc9e15013e45\" (UID: \"8f0581f7-6963-41b0-8725-fc9e15013e45\") " Mar 16 16:57:35 crc kubenswrapper[5120]: I0316 16:57:35.626882 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8f0581f7-6963-41b0-8725-fc9e15013e45-combined-ca-bundle\") pod \"8f0581f7-6963-41b0-8725-fc9e15013e45\" (UID: \"8f0581f7-6963-41b0-8725-fc9e15013e45\") " Mar 16 16:57:35 crc kubenswrapper[5120]: I0316 16:57:35.627282 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/8f0581f7-6963-41b0-8725-fc9e15013e45-ovndb-tls-certs\") pod \"8f0581f7-6963-41b0-8725-fc9e15013e45\" (UID: \"8f0581f7-6963-41b0-8725-fc9e15013e45\") " Mar 16 16:57:35 crc kubenswrapper[5120]: I0316 16:57:35.627401 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8f0581f7-6963-41b0-8725-fc9e15013e45-config\") pod \"8f0581f7-6963-41b0-8725-fc9e15013e45\" (UID: \"8f0581f7-6963-41b0-8725-fc9e15013e45\") " Mar 16 16:57:35 crc kubenswrapper[5120]: I0316 16:57:35.634195 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f0581f7-6963-41b0-8725-fc9e15013e45-kube-api-access-6sfr8" (OuterVolumeSpecName: "kube-api-access-6sfr8") pod "8f0581f7-6963-41b0-8725-fc9e15013e45" (UID: "8f0581f7-6963-41b0-8725-fc9e15013e45"). InnerVolumeSpecName "kube-api-access-6sfr8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:57:35 crc kubenswrapper[5120]: I0316 16:57:35.635399 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f0581f7-6963-41b0-8725-fc9e15013e45-httpd-config" (OuterVolumeSpecName: "httpd-config") pod "8f0581f7-6963-41b0-8725-fc9e15013e45" (UID: "8f0581f7-6963-41b0-8725-fc9e15013e45"). InnerVolumeSpecName "httpd-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:57:35 crc kubenswrapper[5120]: I0316 16:57:35.681935 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f0581f7-6963-41b0-8725-fc9e15013e45-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "8f0581f7-6963-41b0-8725-fc9e15013e45" (UID: "8f0581f7-6963-41b0-8725-fc9e15013e45"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:57:35 crc kubenswrapper[5120]: I0316 16:57:35.684298 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f0581f7-6963-41b0-8725-fc9e15013e45-config" (OuterVolumeSpecName: "config") pod "8f0581f7-6963-41b0-8725-fc9e15013e45" (UID: "8f0581f7-6963-41b0-8725-fc9e15013e45"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:57:35 crc kubenswrapper[5120]: I0316 16:57:35.720010 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f0581f7-6963-41b0-8725-fc9e15013e45-ovndb-tls-certs" (OuterVolumeSpecName: "ovndb-tls-certs") pod "8f0581f7-6963-41b0-8725-fc9e15013e45" (UID: "8f0581f7-6963-41b0-8725-fc9e15013e45"). InnerVolumeSpecName "ovndb-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:57:35 crc kubenswrapper[5120]: I0316 16:57:35.731006 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8f0581f7-6963-41b0-8725-fc9e15013e45-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:57:35 crc kubenswrapper[5120]: I0316 16:57:35.731043 5120 reconciler_common.go:299] "Volume detached for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/8f0581f7-6963-41b0-8725-fc9e15013e45-ovndb-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:57:35 crc kubenswrapper[5120]: I0316 16:57:35.731055 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/8f0581f7-6963-41b0-8725-fc9e15013e45-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:57:35 crc kubenswrapper[5120]: I0316 16:57:35.731069 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/8f0581f7-6963-41b0-8725-fc9e15013e45-httpd-config\") on node \"crc\" DevicePath \"\"" Mar 16 16:57:35 crc kubenswrapper[5120]: I0316 16:57:35.731078 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6sfr8\" (UniqueName: \"kubernetes.io/projected/8f0581f7-6963-41b0-8725-fc9e15013e45-kube-api-access-6sfr8\") on node \"crc\" DevicePath \"\"" Mar 16 16:57:36 crc kubenswrapper[5120]: I0316 16:57:36.162356 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-7cmgm"] Mar 16 16:57:36 crc kubenswrapper[5120]: I0316 16:57:36.163797 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f0581f7-6963-41b0-8725-fc9e15013e45" containerName="neutron-api" Mar 16 16:57:36 crc kubenswrapper[5120]: I0316 16:57:36.163821 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f0581f7-6963-41b0-8725-fc9e15013e45" containerName="neutron-api" Mar 16 16:57:36 crc kubenswrapper[5120]: I0316 16:57:36.163841 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f0581f7-6963-41b0-8725-fc9e15013e45" containerName="neutron-httpd" Mar 16 16:57:36 crc kubenswrapper[5120]: I0316 16:57:36.163850 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f0581f7-6963-41b0-8725-fc9e15013e45" containerName="neutron-httpd" Mar 16 16:57:36 crc kubenswrapper[5120]: I0316 16:57:36.163867 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90a64bb3-08ab-478c-812b-d673e0772e88" containerName="mariadb-database-create" Mar 16 16:57:36 crc kubenswrapper[5120]: I0316 16:57:36.163875 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="90a64bb3-08ab-478c-812b-d673e0772e88" containerName="mariadb-database-create" Mar 16 16:57:36 crc kubenswrapper[5120]: I0316 16:57:36.163902 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="feb1fe6d-59b3-482e-8dce-41b7d0ef4771" containerName="mariadb-account-create-update" Mar 16 16:57:36 crc kubenswrapper[5120]: I0316 16:57:36.163911 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="feb1fe6d-59b3-482e-8dce-41b7d0ef4771" containerName="mariadb-account-create-update" Mar 16 16:57:36 crc kubenswrapper[5120]: I0316 16:57:36.163926 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38dbe21c-3c67-4241-b83d-0de332345bb9" containerName="mariadb-account-create-update" Mar 16 16:57:36 crc kubenswrapper[5120]: I0316 16:57:36.163934 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="38dbe21c-3c67-4241-b83d-0de332345bb9" containerName="mariadb-account-create-update" Mar 16 16:57:36 crc kubenswrapper[5120]: I0316 16:57:36.163951 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40d27067-1463-46fe-aef7-9d45c77c74c8" containerName="mariadb-database-create" Mar 16 16:57:36 crc kubenswrapper[5120]: I0316 16:57:36.163959 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="40d27067-1463-46fe-aef7-9d45c77c74c8" containerName="mariadb-database-create" Mar 16 16:57:36 crc kubenswrapper[5120]: I0316 16:57:36.163976 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b07886c3-349e-4172-8f68-077ceaf8711d" containerName="mariadb-database-create" Mar 16 16:57:36 crc kubenswrapper[5120]: I0316 16:57:36.163983 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="b07886c3-349e-4172-8f68-077ceaf8711d" containerName="mariadb-database-create" Mar 16 16:57:36 crc kubenswrapper[5120]: I0316 16:57:36.163994 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4bdf21c-03be-41af-bd5b-e07309d9129e" containerName="mariadb-account-create-update" Mar 16 16:57:36 crc kubenswrapper[5120]: I0316 16:57:36.164002 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4bdf21c-03be-41af-bd5b-e07309d9129e" containerName="mariadb-account-create-update" Mar 16 16:57:36 crc kubenswrapper[5120]: I0316 16:57:36.164356 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="40d27067-1463-46fe-aef7-9d45c77c74c8" containerName="mariadb-database-create" Mar 16 16:57:36 crc kubenswrapper[5120]: I0316 16:57:36.164374 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="90a64bb3-08ab-478c-812b-d673e0772e88" containerName="mariadb-database-create" Mar 16 16:57:36 crc kubenswrapper[5120]: I0316 16:57:36.164388 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="d4bdf21c-03be-41af-bd5b-e07309d9129e" containerName="mariadb-account-create-update" Mar 16 16:57:36 crc kubenswrapper[5120]: I0316 16:57:36.164398 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="38dbe21c-3c67-4241-b83d-0de332345bb9" containerName="mariadb-account-create-update" Mar 16 16:57:36 crc kubenswrapper[5120]: I0316 16:57:36.164411 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="8f0581f7-6963-41b0-8725-fc9e15013e45" containerName="neutron-api" Mar 16 16:57:36 crc kubenswrapper[5120]: I0316 16:57:36.164422 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="feb1fe6d-59b3-482e-8dce-41b7d0ef4771" containerName="mariadb-account-create-update" Mar 16 16:57:36 crc kubenswrapper[5120]: I0316 16:57:36.164435 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="b07886c3-349e-4172-8f68-077ceaf8711d" containerName="mariadb-database-create" Mar 16 16:57:36 crc kubenswrapper[5120]: I0316 16:57:36.164455 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="8f0581f7-6963-41b0-8725-fc9e15013e45" containerName="neutron-httpd" Mar 16 16:57:36 crc kubenswrapper[5120]: I0316 16:57:36.177103 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-7cmgm"] Mar 16 16:57:36 crc kubenswrapper[5120]: I0316 16:57:36.177292 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-7cmgm" Mar 16 16:57:36 crc kubenswrapper[5120]: I0316 16:57:36.179631 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-nova-dockercfg-mhbr5\"" Mar 16 16:57:36 crc kubenswrapper[5120]: I0316 16:57:36.180125 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-conductor-scripts\"" Mar 16 16:57:36 crc kubenswrapper[5120]: I0316 16:57:36.180153 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-conductor-config-data\"" Mar 16 16:57:36 crc kubenswrapper[5120]: I0316 16:57:36.357136 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/60725840-493f-4af4-97f6-ba67ec495e7d-scripts\") pod \"nova-cell0-conductor-db-sync-7cmgm\" (UID: \"60725840-493f-4af4-97f6-ba67ec495e7d\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-7cmgm" Mar 16 16:57:36 crc kubenswrapper[5120]: I0316 16:57:36.357787 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/60725840-493f-4af4-97f6-ba67ec495e7d-combined-ca-bundle\") pod \"nova-cell0-conductor-db-sync-7cmgm\" (UID: \"60725840-493f-4af4-97f6-ba67ec495e7d\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-7cmgm" Mar 16 16:57:36 crc kubenswrapper[5120]: I0316 16:57:36.357884 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92l9d\" (UniqueName: \"kubernetes.io/projected/60725840-493f-4af4-97f6-ba67ec495e7d-kube-api-access-92l9d\") pod \"nova-cell0-conductor-db-sync-7cmgm\" (UID: \"60725840-493f-4af4-97f6-ba67ec495e7d\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-7cmgm" Mar 16 16:57:36 crc kubenswrapper[5120]: I0316 16:57:36.358069 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/60725840-493f-4af4-97f6-ba67ec495e7d-config-data\") pod \"nova-cell0-conductor-db-sync-7cmgm\" (UID: \"60725840-493f-4af4-97f6-ba67ec495e7d\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-7cmgm" Mar 16 16:57:36 crc kubenswrapper[5120]: I0316 16:57:36.433302 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1e65f09e-1d21-4f6c-b431-5e1675a8cff3","Type":"ContainerStarted","Data":"3950c29ed1e2e38236c8e719312741796837ed961af11c302371079d3d943826"} Mar 16 16:57:36 crc kubenswrapper[5120]: I0316 16:57:36.433361 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="1e65f09e-1d21-4f6c-b431-5e1675a8cff3" containerName="ceilometer-central-agent" containerID="cri-o://c3cc30d1da1f028db2b5e776e794d21c383b4ad08ae7b54e9bc6c7c7625b165c" gracePeriod=30 Mar 16 16:57:36 crc kubenswrapper[5120]: I0316 16:57:36.433381 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:57:36 crc kubenswrapper[5120]: I0316 16:57:36.433435 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="1e65f09e-1d21-4f6c-b431-5e1675a8cff3" containerName="ceilometer-notification-agent" containerID="cri-o://de2ffa7d20b9381db814eb23f5a1eae0b4fafd9d3d42dd9884986ad52f5d98c8" gracePeriod=30 Mar 16 16:57:36 crc kubenswrapper[5120]: I0316 16:57:36.433584 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="1e65f09e-1d21-4f6c-b431-5e1675a8cff3" containerName="proxy-httpd" containerID="cri-o://3950c29ed1e2e38236c8e719312741796837ed961af11c302371079d3d943826" gracePeriod=30 Mar 16 16:57:36 crc kubenswrapper[5120]: I0316 16:57:36.433672 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="1e65f09e-1d21-4f6c-b431-5e1675a8cff3" containerName="sg-core" containerID="cri-o://845eb637dd190a1a9b2fdd87847f9b6124bca6b2162ffc768c01f32d7c8e6f24" gracePeriod=30 Mar 16 16:57:36 crc kubenswrapper[5120]: I0316 16:57:36.440862 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-69697bd7fc-vk7rp" event={"ID":"8f0581f7-6963-41b0-8725-fc9e15013e45","Type":"ContainerDied","Data":"660ff278af75bb1d162244574361a82a272c9f65d51b0388349e1963bad553cc"} Mar 16 16:57:36 crc kubenswrapper[5120]: I0316 16:57:36.441090 5120 scope.go:117] "RemoveContainer" containerID="c2f8b725846999666c2adf76377f2bba3b35b761392291c5e12b4fd9642de7e1" Mar 16 16:57:36 crc kubenswrapper[5120]: I0316 16:57:36.440898 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-69697bd7fc-vk7rp" Mar 16 16:57:36 crc kubenswrapper[5120]: I0316 16:57:36.460530 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/60725840-493f-4af4-97f6-ba67ec495e7d-scripts\") pod \"nova-cell0-conductor-db-sync-7cmgm\" (UID: \"60725840-493f-4af4-97f6-ba67ec495e7d\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-7cmgm" Mar 16 16:57:36 crc kubenswrapper[5120]: I0316 16:57:36.460942 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/60725840-493f-4af4-97f6-ba67ec495e7d-combined-ca-bundle\") pod \"nova-cell0-conductor-db-sync-7cmgm\" (UID: \"60725840-493f-4af4-97f6-ba67ec495e7d\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-7cmgm" Mar 16 16:57:36 crc kubenswrapper[5120]: I0316 16:57:36.461053 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-92l9d\" (UniqueName: \"kubernetes.io/projected/60725840-493f-4af4-97f6-ba67ec495e7d-kube-api-access-92l9d\") pod \"nova-cell0-conductor-db-sync-7cmgm\" (UID: \"60725840-493f-4af4-97f6-ba67ec495e7d\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-7cmgm" Mar 16 16:57:36 crc kubenswrapper[5120]: I0316 16:57:36.462062 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/60725840-493f-4af4-97f6-ba67ec495e7d-config-data\") pod \"nova-cell0-conductor-db-sync-7cmgm\" (UID: \"60725840-493f-4af4-97f6-ba67ec495e7d\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-7cmgm" Mar 16 16:57:36 crc kubenswrapper[5120]: I0316 16:57:36.466694 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/60725840-493f-4af4-97f6-ba67ec495e7d-scripts\") pod \"nova-cell0-conductor-db-sync-7cmgm\" (UID: \"60725840-493f-4af4-97f6-ba67ec495e7d\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-7cmgm" Mar 16 16:57:36 crc kubenswrapper[5120]: I0316 16:57:36.468299 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/60725840-493f-4af4-97f6-ba67ec495e7d-config-data\") pod \"nova-cell0-conductor-db-sync-7cmgm\" (UID: \"60725840-493f-4af4-97f6-ba67ec495e7d\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-7cmgm" Mar 16 16:57:36 crc kubenswrapper[5120]: I0316 16:57:36.468825 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/60725840-493f-4af4-97f6-ba67ec495e7d-combined-ca-bundle\") pod \"nova-cell0-conductor-db-sync-7cmgm\" (UID: \"60725840-493f-4af4-97f6-ba67ec495e7d\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-7cmgm" Mar 16 16:57:36 crc kubenswrapper[5120]: I0316 16:57:36.474139 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.636603109 podStartE2EDuration="11.474118888s" podCreationTimestamp="2026-03-16 16:57:25 +0000 UTC" firstStartedPulling="2026-03-16 16:57:26.37541851 +0000 UTC m=+5148.529350167" lastFinishedPulling="2026-03-16 16:57:35.212934289 +0000 UTC m=+5157.366865946" observedRunningTime="2026-03-16 16:57:36.468787383 +0000 UTC m=+5158.622719040" watchObservedRunningTime="2026-03-16 16:57:36.474118888 +0000 UTC m=+5158.628050535" Mar 16 16:57:36 crc kubenswrapper[5120]: I0316 16:57:36.478147 5120 scope.go:117] "RemoveContainer" containerID="3dfcc69393dccb8f4d7cf68198d3934da02c48498d64b13e41b4c66b9ee2c8b6" Mar 16 16:57:36 crc kubenswrapper[5120]: I0316 16:57:36.516476 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-92l9d\" (UniqueName: \"kubernetes.io/projected/60725840-493f-4af4-97f6-ba67ec495e7d-kube-api-access-92l9d\") pod \"nova-cell0-conductor-db-sync-7cmgm\" (UID: \"60725840-493f-4af4-97f6-ba67ec495e7d\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-7cmgm" Mar 16 16:57:36 crc kubenswrapper[5120]: I0316 16:57:36.523179 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-69697bd7fc-vk7rp"] Mar 16 16:57:36 crc kubenswrapper[5120]: I0316 16:57:36.532955 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-69697bd7fc-vk7rp"] Mar 16 16:57:36 crc kubenswrapper[5120]: I0316 16:57:36.550095 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-7cmgm" Mar 16 16:57:36 crc kubenswrapper[5120]: I0316 16:57:36.696885 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8f0581f7-6963-41b0-8725-fc9e15013e45" path="/var/lib/kubelet/pods/8f0581f7-6963-41b0-8725-fc9e15013e45/volumes" Mar 16 16:57:36 crc kubenswrapper[5120]: I0316 16:57:36.873011 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/placement-6c74bfb4f8-b872h" Mar 16 16:57:37 crc kubenswrapper[5120]: I0316 16:57:37.053119 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-7cmgm"] Mar 16 16:57:37 crc kubenswrapper[5120]: W0316 16:57:37.055822 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod60725840_493f_4af4_97f6_ba67ec495e7d.slice/crio-401ee7f5538f364872d5c8d10bd9d70f159e95baeb90348419212dfd661f3aa5 WatchSource:0}: Error finding container 401ee7f5538f364872d5c8d10bd9d70f159e95baeb90348419212dfd661f3aa5: Status 404 returned error can't find the container with id 401ee7f5538f364872d5c8d10bd9d70f159e95baeb90348419212dfd661f3aa5 Mar 16 16:57:37 crc kubenswrapper[5120]: I0316 16:57:37.451822 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-7cmgm" event={"ID":"60725840-493f-4af4-97f6-ba67ec495e7d","Type":"ContainerStarted","Data":"192dc6632db5d07e0f36b0240e4f98e1b355edf0c9ef9c79a3cde5f3a6bb487a"} Mar 16 16:57:37 crc kubenswrapper[5120]: I0316 16:57:37.452179 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-7cmgm" event={"ID":"60725840-493f-4af4-97f6-ba67ec495e7d","Type":"ContainerStarted","Data":"401ee7f5538f364872d5c8d10bd9d70f159e95baeb90348419212dfd661f3aa5"} Mar 16 16:57:37 crc kubenswrapper[5120]: I0316 16:57:37.457071 5120 generic.go:358] "Generic (PLEG): container finished" podID="1e65f09e-1d21-4f6c-b431-5e1675a8cff3" containerID="3950c29ed1e2e38236c8e719312741796837ed961af11c302371079d3d943826" exitCode=0 Mar 16 16:57:37 crc kubenswrapper[5120]: I0316 16:57:37.457100 5120 generic.go:358] "Generic (PLEG): container finished" podID="1e65f09e-1d21-4f6c-b431-5e1675a8cff3" containerID="845eb637dd190a1a9b2fdd87847f9b6124bca6b2162ffc768c01f32d7c8e6f24" exitCode=2 Mar 16 16:57:37 crc kubenswrapper[5120]: I0316 16:57:37.457110 5120 generic.go:358] "Generic (PLEG): container finished" podID="1e65f09e-1d21-4f6c-b431-5e1675a8cff3" containerID="de2ffa7d20b9381db814eb23f5a1eae0b4fafd9d3d42dd9884986ad52f5d98c8" exitCode=0 Mar 16 16:57:37 crc kubenswrapper[5120]: I0316 16:57:37.457120 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1e65f09e-1d21-4f6c-b431-5e1675a8cff3","Type":"ContainerDied","Data":"3950c29ed1e2e38236c8e719312741796837ed961af11c302371079d3d943826"} Mar 16 16:57:37 crc kubenswrapper[5120]: I0316 16:57:37.457153 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1e65f09e-1d21-4f6c-b431-5e1675a8cff3","Type":"ContainerDied","Data":"845eb637dd190a1a9b2fdd87847f9b6124bca6b2162ffc768c01f32d7c8e6f24"} Mar 16 16:57:37 crc kubenswrapper[5120]: I0316 16:57:37.457166 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1e65f09e-1d21-4f6c-b431-5e1675a8cff3","Type":"ContainerDied","Data":"de2ffa7d20b9381db814eb23f5a1eae0b4fafd9d3d42dd9884986ad52f5d98c8"} Mar 16 16:57:37 crc kubenswrapper[5120]: I0316 16:57:37.479904 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-7cmgm" podStartSLOduration=1.479879677 podStartE2EDuration="1.479879677s" podCreationTimestamp="2026-03-16 16:57:36 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:57:37.468990258 +0000 UTC m=+5159.622921915" watchObservedRunningTime="2026-03-16 16:57:37.479879677 +0000 UTC m=+5159.633811354" Mar 16 16:57:37 crc kubenswrapper[5120]: I0316 16:57:37.968501 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/placement-6c74bfb4f8-b872h" Mar 16 16:57:38 crc kubenswrapper[5120]: I0316 16:57:38.064266 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-6dbf47b8f6-ghhnl"] Mar 16 16:57:38 crc kubenswrapper[5120]: I0316 16:57:38.064847 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-6dbf47b8f6-ghhnl" podUID="c9783c3d-ba3f-42b1-b0ae-545df719e28f" containerName="placement-log" containerID="cri-o://273d6b735d7fe80ae2d0779a3166c2fbf04d5f969d78b2a06ffa583b0cc60fa6" gracePeriod=30 Mar 16 16:57:38 crc kubenswrapper[5120]: I0316 16:57:38.065384 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-6dbf47b8f6-ghhnl" podUID="c9783c3d-ba3f-42b1-b0ae-545df719e28f" containerName="placement-api" containerID="cri-o://27eecfdd7df59b056a470f18ec3dd2498184d0c45b54db440dac16a788d56cc3" gracePeriod=30 Mar 16 16:57:38 crc kubenswrapper[5120]: I0316 16:57:38.469634 5120 generic.go:358] "Generic (PLEG): container finished" podID="c9783c3d-ba3f-42b1-b0ae-545df719e28f" containerID="273d6b735d7fe80ae2d0779a3166c2fbf04d5f969d78b2a06ffa583b0cc60fa6" exitCode=143 Mar 16 16:57:38 crc kubenswrapper[5120]: I0316 16:57:38.470516 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-6dbf47b8f6-ghhnl" event={"ID":"c9783c3d-ba3f-42b1-b0ae-545df719e28f","Type":"ContainerDied","Data":"273d6b735d7fe80ae2d0779a3166c2fbf04d5f969d78b2a06ffa583b0cc60fa6"} Mar 16 16:57:39 crc kubenswrapper[5120]: I0316 16:57:39.308323 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:57:39 crc kubenswrapper[5120]: I0316 16:57:39.373697 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wsjg7\" (UniqueName: \"kubernetes.io/projected/1e65f09e-1d21-4f6c-b431-5e1675a8cff3-kube-api-access-wsjg7\") pod \"1e65f09e-1d21-4f6c-b431-5e1675a8cff3\" (UID: \"1e65f09e-1d21-4f6c-b431-5e1675a8cff3\") " Mar 16 16:57:39 crc kubenswrapper[5120]: I0316 16:57:39.373920 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1e65f09e-1d21-4f6c-b431-5e1675a8cff3-run-httpd\") pod \"1e65f09e-1d21-4f6c-b431-5e1675a8cff3\" (UID: \"1e65f09e-1d21-4f6c-b431-5e1675a8cff3\") " Mar 16 16:57:39 crc kubenswrapper[5120]: I0316 16:57:39.374075 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1e65f09e-1d21-4f6c-b431-5e1675a8cff3-scripts\") pod \"1e65f09e-1d21-4f6c-b431-5e1675a8cff3\" (UID: \"1e65f09e-1d21-4f6c-b431-5e1675a8cff3\") " Mar 16 16:57:39 crc kubenswrapper[5120]: I0316 16:57:39.374132 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/1e65f09e-1d21-4f6c-b431-5e1675a8cff3-sg-core-conf-yaml\") pod \"1e65f09e-1d21-4f6c-b431-5e1675a8cff3\" (UID: \"1e65f09e-1d21-4f6c-b431-5e1675a8cff3\") " Mar 16 16:57:39 crc kubenswrapper[5120]: I0316 16:57:39.374454 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1e65f09e-1d21-4f6c-b431-5e1675a8cff3-combined-ca-bundle\") pod \"1e65f09e-1d21-4f6c-b431-5e1675a8cff3\" (UID: \"1e65f09e-1d21-4f6c-b431-5e1675a8cff3\") " Mar 16 16:57:39 crc kubenswrapper[5120]: I0316 16:57:39.374562 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1e65f09e-1d21-4f6c-b431-5e1675a8cff3-config-data\") pod \"1e65f09e-1d21-4f6c-b431-5e1675a8cff3\" (UID: \"1e65f09e-1d21-4f6c-b431-5e1675a8cff3\") " Mar 16 16:57:39 crc kubenswrapper[5120]: I0316 16:57:39.374596 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1e65f09e-1d21-4f6c-b431-5e1675a8cff3-log-httpd\") pod \"1e65f09e-1d21-4f6c-b431-5e1675a8cff3\" (UID: \"1e65f09e-1d21-4f6c-b431-5e1675a8cff3\") " Mar 16 16:57:39 crc kubenswrapper[5120]: I0316 16:57:39.376753 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e65f09e-1d21-4f6c-b431-5e1675a8cff3-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "1e65f09e-1d21-4f6c-b431-5e1675a8cff3" (UID: "1e65f09e-1d21-4f6c-b431-5e1675a8cff3"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:57:39 crc kubenswrapper[5120]: I0316 16:57:39.382250 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e65f09e-1d21-4f6c-b431-5e1675a8cff3-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "1e65f09e-1d21-4f6c-b431-5e1675a8cff3" (UID: "1e65f09e-1d21-4f6c-b431-5e1675a8cff3"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:57:39 crc kubenswrapper[5120]: I0316 16:57:39.391006 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1e65f09e-1d21-4f6c-b431-5e1675a8cff3-scripts" (OuterVolumeSpecName: "scripts") pod "1e65f09e-1d21-4f6c-b431-5e1675a8cff3" (UID: "1e65f09e-1d21-4f6c-b431-5e1675a8cff3"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:57:39 crc kubenswrapper[5120]: I0316 16:57:39.408987 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e65f09e-1d21-4f6c-b431-5e1675a8cff3-kube-api-access-wsjg7" (OuterVolumeSpecName: "kube-api-access-wsjg7") pod "1e65f09e-1d21-4f6c-b431-5e1675a8cff3" (UID: "1e65f09e-1d21-4f6c-b431-5e1675a8cff3"). InnerVolumeSpecName "kube-api-access-wsjg7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:57:39 crc kubenswrapper[5120]: I0316 16:57:39.478480 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1e65f09e-1d21-4f6c-b431-5e1675a8cff3-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:57:39 crc kubenswrapper[5120]: I0316 16:57:39.478784 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wsjg7\" (UniqueName: \"kubernetes.io/projected/1e65f09e-1d21-4f6c-b431-5e1675a8cff3-kube-api-access-wsjg7\") on node \"crc\" DevicePath \"\"" Mar 16 16:57:39 crc kubenswrapper[5120]: I0316 16:57:39.478796 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1e65f09e-1d21-4f6c-b431-5e1675a8cff3-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:57:39 crc kubenswrapper[5120]: I0316 16:57:39.478806 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1e65f09e-1d21-4f6c-b431-5e1675a8cff3-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:57:39 crc kubenswrapper[5120]: I0316 16:57:39.515008 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1e65f09e-1d21-4f6c-b431-5e1675a8cff3-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "1e65f09e-1d21-4f6c-b431-5e1675a8cff3" (UID: "1e65f09e-1d21-4f6c-b431-5e1675a8cff3"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:57:39 crc kubenswrapper[5120]: I0316 16:57:39.532486 5120 generic.go:358] "Generic (PLEG): container finished" podID="1e65f09e-1d21-4f6c-b431-5e1675a8cff3" containerID="c3cc30d1da1f028db2b5e776e794d21c383b4ad08ae7b54e9bc6c7c7625b165c" exitCode=0 Mar 16 16:57:39 crc kubenswrapper[5120]: I0316 16:57:39.533365 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1e65f09e-1d21-4f6c-b431-5e1675a8cff3","Type":"ContainerDied","Data":"c3cc30d1da1f028db2b5e776e794d21c383b4ad08ae7b54e9bc6c7c7625b165c"} Mar 16 16:57:39 crc kubenswrapper[5120]: I0316 16:57:39.533414 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1e65f09e-1d21-4f6c-b431-5e1675a8cff3","Type":"ContainerDied","Data":"13d5d5a3d22221840b3e53854a99e972e22a4c6e6d9206b930cb0f4960b78696"} Mar 16 16:57:39 crc kubenswrapper[5120]: I0316 16:57:39.533442 5120 scope.go:117] "RemoveContainer" containerID="3950c29ed1e2e38236c8e719312741796837ed961af11c302371079d3d943826" Mar 16 16:57:39 crc kubenswrapper[5120]: I0316 16:57:39.533664 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:57:39 crc kubenswrapper[5120]: I0316 16:57:39.564730 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1e65f09e-1d21-4f6c-b431-5e1675a8cff3-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "1e65f09e-1d21-4f6c-b431-5e1675a8cff3" (UID: "1e65f09e-1d21-4f6c-b431-5e1675a8cff3"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:57:39 crc kubenswrapper[5120]: I0316 16:57:39.580951 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/1e65f09e-1d21-4f6c-b431-5e1675a8cff3-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 16:57:39 crc kubenswrapper[5120]: I0316 16:57:39.581261 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1e65f09e-1d21-4f6c-b431-5e1675a8cff3-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:57:39 crc kubenswrapper[5120]: I0316 16:57:39.583994 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1e65f09e-1d21-4f6c-b431-5e1675a8cff3-config-data" (OuterVolumeSpecName: "config-data") pod "1e65f09e-1d21-4f6c-b431-5e1675a8cff3" (UID: "1e65f09e-1d21-4f6c-b431-5e1675a8cff3"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:57:39 crc kubenswrapper[5120]: I0316 16:57:39.604238 5120 scope.go:117] "RemoveContainer" containerID="845eb637dd190a1a9b2fdd87847f9b6124bca6b2162ffc768c01f32d7c8e6f24" Mar 16 16:57:39 crc kubenswrapper[5120]: I0316 16:57:39.631396 5120 scope.go:117] "RemoveContainer" containerID="de2ffa7d20b9381db814eb23f5a1eae0b4fafd9d3d42dd9884986ad52f5d98c8" Mar 16 16:57:39 crc kubenswrapper[5120]: I0316 16:57:39.668300 5120 scope.go:117] "RemoveContainer" containerID="c3cc30d1da1f028db2b5e776e794d21c383b4ad08ae7b54e9bc6c7c7625b165c" Mar 16 16:57:39 crc kubenswrapper[5120]: I0316 16:57:39.683888 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1e65f09e-1d21-4f6c-b431-5e1675a8cff3-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:57:39 crc kubenswrapper[5120]: I0316 16:57:39.694717 5120 scope.go:117] "RemoveContainer" containerID="3950c29ed1e2e38236c8e719312741796837ed961af11c302371079d3d943826" Mar 16 16:57:39 crc kubenswrapper[5120]: E0316 16:57:39.696481 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3950c29ed1e2e38236c8e719312741796837ed961af11c302371079d3d943826\": container with ID starting with 3950c29ed1e2e38236c8e719312741796837ed961af11c302371079d3d943826 not found: ID does not exist" containerID="3950c29ed1e2e38236c8e719312741796837ed961af11c302371079d3d943826" Mar 16 16:57:39 crc kubenswrapper[5120]: I0316 16:57:39.696538 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3950c29ed1e2e38236c8e719312741796837ed961af11c302371079d3d943826"} err="failed to get container status \"3950c29ed1e2e38236c8e719312741796837ed961af11c302371079d3d943826\": rpc error: code = NotFound desc = could not find container \"3950c29ed1e2e38236c8e719312741796837ed961af11c302371079d3d943826\": container with ID starting with 3950c29ed1e2e38236c8e719312741796837ed961af11c302371079d3d943826 not found: ID does not exist" Mar 16 16:57:39 crc kubenswrapper[5120]: I0316 16:57:39.696564 5120 scope.go:117] "RemoveContainer" containerID="845eb637dd190a1a9b2fdd87847f9b6124bca6b2162ffc768c01f32d7c8e6f24" Mar 16 16:57:39 crc kubenswrapper[5120]: E0316 16:57:39.697126 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"845eb637dd190a1a9b2fdd87847f9b6124bca6b2162ffc768c01f32d7c8e6f24\": container with ID starting with 845eb637dd190a1a9b2fdd87847f9b6124bca6b2162ffc768c01f32d7c8e6f24 not found: ID does not exist" containerID="845eb637dd190a1a9b2fdd87847f9b6124bca6b2162ffc768c01f32d7c8e6f24" Mar 16 16:57:39 crc kubenswrapper[5120]: I0316 16:57:39.697198 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"845eb637dd190a1a9b2fdd87847f9b6124bca6b2162ffc768c01f32d7c8e6f24"} err="failed to get container status \"845eb637dd190a1a9b2fdd87847f9b6124bca6b2162ffc768c01f32d7c8e6f24\": rpc error: code = NotFound desc = could not find container \"845eb637dd190a1a9b2fdd87847f9b6124bca6b2162ffc768c01f32d7c8e6f24\": container with ID starting with 845eb637dd190a1a9b2fdd87847f9b6124bca6b2162ffc768c01f32d7c8e6f24 not found: ID does not exist" Mar 16 16:57:39 crc kubenswrapper[5120]: I0316 16:57:39.697241 5120 scope.go:117] "RemoveContainer" containerID="de2ffa7d20b9381db814eb23f5a1eae0b4fafd9d3d42dd9884986ad52f5d98c8" Mar 16 16:57:39 crc kubenswrapper[5120]: E0316 16:57:39.697596 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de2ffa7d20b9381db814eb23f5a1eae0b4fafd9d3d42dd9884986ad52f5d98c8\": container with ID starting with de2ffa7d20b9381db814eb23f5a1eae0b4fafd9d3d42dd9884986ad52f5d98c8 not found: ID does not exist" containerID="de2ffa7d20b9381db814eb23f5a1eae0b4fafd9d3d42dd9884986ad52f5d98c8" Mar 16 16:57:39 crc kubenswrapper[5120]: I0316 16:57:39.697630 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de2ffa7d20b9381db814eb23f5a1eae0b4fafd9d3d42dd9884986ad52f5d98c8"} err="failed to get container status \"de2ffa7d20b9381db814eb23f5a1eae0b4fafd9d3d42dd9884986ad52f5d98c8\": rpc error: code = NotFound desc = could not find container \"de2ffa7d20b9381db814eb23f5a1eae0b4fafd9d3d42dd9884986ad52f5d98c8\": container with ID starting with de2ffa7d20b9381db814eb23f5a1eae0b4fafd9d3d42dd9884986ad52f5d98c8 not found: ID does not exist" Mar 16 16:57:39 crc kubenswrapper[5120]: I0316 16:57:39.697648 5120 scope.go:117] "RemoveContainer" containerID="c3cc30d1da1f028db2b5e776e794d21c383b4ad08ae7b54e9bc6c7c7625b165c" Mar 16 16:57:39 crc kubenswrapper[5120]: E0316 16:57:39.698041 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c3cc30d1da1f028db2b5e776e794d21c383b4ad08ae7b54e9bc6c7c7625b165c\": container with ID starting with c3cc30d1da1f028db2b5e776e794d21c383b4ad08ae7b54e9bc6c7c7625b165c not found: ID does not exist" containerID="c3cc30d1da1f028db2b5e776e794d21c383b4ad08ae7b54e9bc6c7c7625b165c" Mar 16 16:57:39 crc kubenswrapper[5120]: I0316 16:57:39.698091 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3cc30d1da1f028db2b5e776e794d21c383b4ad08ae7b54e9bc6c7c7625b165c"} err="failed to get container status \"c3cc30d1da1f028db2b5e776e794d21c383b4ad08ae7b54e9bc6c7c7625b165c\": rpc error: code = NotFound desc = could not find container \"c3cc30d1da1f028db2b5e776e794d21c383b4ad08ae7b54e9bc6c7c7625b165c\": container with ID starting with c3cc30d1da1f028db2b5e776e794d21c383b4ad08ae7b54e9bc6c7c7625b165c not found: ID does not exist" Mar 16 16:57:39 crc kubenswrapper[5120]: I0316 16:57:39.871929 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:57:39 crc kubenswrapper[5120]: I0316 16:57:39.883274 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:57:39 crc kubenswrapper[5120]: I0316 16:57:39.899463 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:57:39 crc kubenswrapper[5120]: I0316 16:57:39.900686 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e65f09e-1d21-4f6c-b431-5e1675a8cff3" containerName="sg-core" Mar 16 16:57:39 crc kubenswrapper[5120]: I0316 16:57:39.900710 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e65f09e-1d21-4f6c-b431-5e1675a8cff3" containerName="sg-core" Mar 16 16:57:39 crc kubenswrapper[5120]: I0316 16:57:39.900794 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e65f09e-1d21-4f6c-b431-5e1675a8cff3" containerName="ceilometer-notification-agent" Mar 16 16:57:39 crc kubenswrapper[5120]: I0316 16:57:39.900806 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e65f09e-1d21-4f6c-b431-5e1675a8cff3" containerName="ceilometer-notification-agent" Mar 16 16:57:39 crc kubenswrapper[5120]: I0316 16:57:39.900824 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e65f09e-1d21-4f6c-b431-5e1675a8cff3" containerName="ceilometer-central-agent" Mar 16 16:57:39 crc kubenswrapper[5120]: I0316 16:57:39.900834 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e65f09e-1d21-4f6c-b431-5e1675a8cff3" containerName="ceilometer-central-agent" Mar 16 16:57:39 crc kubenswrapper[5120]: I0316 16:57:39.900857 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e65f09e-1d21-4f6c-b431-5e1675a8cff3" containerName="proxy-httpd" Mar 16 16:57:39 crc kubenswrapper[5120]: I0316 16:57:39.900865 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e65f09e-1d21-4f6c-b431-5e1675a8cff3" containerName="proxy-httpd" Mar 16 16:57:39 crc kubenswrapper[5120]: I0316 16:57:39.901049 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1e65f09e-1d21-4f6c-b431-5e1675a8cff3" containerName="ceilometer-central-agent" Mar 16 16:57:39 crc kubenswrapper[5120]: I0316 16:57:39.901073 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1e65f09e-1d21-4f6c-b431-5e1675a8cff3" containerName="proxy-httpd" Mar 16 16:57:39 crc kubenswrapper[5120]: I0316 16:57:39.901084 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1e65f09e-1d21-4f6c-b431-5e1675a8cff3" containerName="ceilometer-notification-agent" Mar 16 16:57:39 crc kubenswrapper[5120]: I0316 16:57:39.901095 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1e65f09e-1d21-4f6c-b431-5e1675a8cff3" containerName="sg-core" Mar 16 16:57:39 crc kubenswrapper[5120]: I0316 16:57:39.906498 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:57:39 crc kubenswrapper[5120]: I0316 16:57:39.909576 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 16:57:39 crc kubenswrapper[5120]: I0316 16:57:39.909979 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 16:57:39 crc kubenswrapper[5120]: I0316 16:57:39.910582 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ceilometer-internal-svc\"" Mar 16 16:57:39 crc kubenswrapper[5120]: I0316 16:57:39.925191 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:57:39 crc kubenswrapper[5120]: I0316 16:57:39.992264 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c74d3951-cd09-4371-9984-c1e3f863c826-log-httpd\") pod \"ceilometer-0\" (UID: \"c74d3951-cd09-4371-9984-c1e3f863c826\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:57:39 crc kubenswrapper[5120]: I0316 16:57:39.992336 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c74d3951-cd09-4371-9984-c1e3f863c826-scripts\") pod \"ceilometer-0\" (UID: \"c74d3951-cd09-4371-9984-c1e3f863c826\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:57:39 crc kubenswrapper[5120]: I0316 16:57:39.992361 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c74d3951-cd09-4371-9984-c1e3f863c826-run-httpd\") pod \"ceilometer-0\" (UID: \"c74d3951-cd09-4371-9984-c1e3f863c826\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:57:39 crc kubenswrapper[5120]: I0316 16:57:39.992538 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c74d3951-cd09-4371-9984-c1e3f863c826-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"c74d3951-cd09-4371-9984-c1e3f863c826\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:57:39 crc kubenswrapper[5120]: I0316 16:57:39.992614 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppsdf\" (UniqueName: \"kubernetes.io/projected/c74d3951-cd09-4371-9984-c1e3f863c826-kube-api-access-ppsdf\") pod \"ceilometer-0\" (UID: \"c74d3951-cd09-4371-9984-c1e3f863c826\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:57:39 crc kubenswrapper[5120]: I0316 16:57:39.992685 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/c74d3951-cd09-4371-9984-c1e3f863c826-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"c74d3951-cd09-4371-9984-c1e3f863c826\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:57:39 crc kubenswrapper[5120]: I0316 16:57:39.992855 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c74d3951-cd09-4371-9984-c1e3f863c826-config-data\") pod \"ceilometer-0\" (UID: \"c74d3951-cd09-4371-9984-c1e3f863c826\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:57:39 crc kubenswrapper[5120]: I0316 16:57:39.992959 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/c74d3951-cd09-4371-9984-c1e3f863c826-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"c74d3951-cd09-4371-9984-c1e3f863c826\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:57:40 crc kubenswrapper[5120]: I0316 16:57:40.095166 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c74d3951-cd09-4371-9984-c1e3f863c826-log-httpd\") pod \"ceilometer-0\" (UID: \"c74d3951-cd09-4371-9984-c1e3f863c826\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:57:40 crc kubenswrapper[5120]: I0316 16:57:40.095267 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c74d3951-cd09-4371-9984-c1e3f863c826-scripts\") pod \"ceilometer-0\" (UID: \"c74d3951-cd09-4371-9984-c1e3f863c826\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:57:40 crc kubenswrapper[5120]: I0316 16:57:40.095301 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c74d3951-cd09-4371-9984-c1e3f863c826-run-httpd\") pod \"ceilometer-0\" (UID: \"c74d3951-cd09-4371-9984-c1e3f863c826\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:57:40 crc kubenswrapper[5120]: I0316 16:57:40.095422 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c74d3951-cd09-4371-9984-c1e3f863c826-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"c74d3951-cd09-4371-9984-c1e3f863c826\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:57:40 crc kubenswrapper[5120]: I0316 16:57:40.095508 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ppsdf\" (UniqueName: \"kubernetes.io/projected/c74d3951-cd09-4371-9984-c1e3f863c826-kube-api-access-ppsdf\") pod \"ceilometer-0\" (UID: \"c74d3951-cd09-4371-9984-c1e3f863c826\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:57:40 crc kubenswrapper[5120]: I0316 16:57:40.095549 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/c74d3951-cd09-4371-9984-c1e3f863c826-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"c74d3951-cd09-4371-9984-c1e3f863c826\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:57:40 crc kubenswrapper[5120]: I0316 16:57:40.095689 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c74d3951-cd09-4371-9984-c1e3f863c826-config-data\") pod \"ceilometer-0\" (UID: \"c74d3951-cd09-4371-9984-c1e3f863c826\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:57:40 crc kubenswrapper[5120]: I0316 16:57:40.095823 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/c74d3951-cd09-4371-9984-c1e3f863c826-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"c74d3951-cd09-4371-9984-c1e3f863c826\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:57:40 crc kubenswrapper[5120]: I0316 16:57:40.097086 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c74d3951-cd09-4371-9984-c1e3f863c826-run-httpd\") pod \"ceilometer-0\" (UID: \"c74d3951-cd09-4371-9984-c1e3f863c826\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:57:40 crc kubenswrapper[5120]: I0316 16:57:40.097149 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c74d3951-cd09-4371-9984-c1e3f863c826-log-httpd\") pod \"ceilometer-0\" (UID: \"c74d3951-cd09-4371-9984-c1e3f863c826\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:57:40 crc kubenswrapper[5120]: I0316 16:57:40.102620 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/c74d3951-cd09-4371-9984-c1e3f863c826-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"c74d3951-cd09-4371-9984-c1e3f863c826\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:57:40 crc kubenswrapper[5120]: I0316 16:57:40.102863 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c74d3951-cd09-4371-9984-c1e3f863c826-config-data\") pod \"ceilometer-0\" (UID: \"c74d3951-cd09-4371-9984-c1e3f863c826\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:57:40 crc kubenswrapper[5120]: I0316 16:57:40.102643 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c74d3951-cd09-4371-9984-c1e3f863c826-scripts\") pod \"ceilometer-0\" (UID: \"c74d3951-cd09-4371-9984-c1e3f863c826\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:57:40 crc kubenswrapper[5120]: I0316 16:57:40.103658 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/c74d3951-cd09-4371-9984-c1e3f863c826-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"c74d3951-cd09-4371-9984-c1e3f863c826\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:57:40 crc kubenswrapper[5120]: I0316 16:57:40.103863 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c74d3951-cd09-4371-9984-c1e3f863c826-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"c74d3951-cd09-4371-9984-c1e3f863c826\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:57:40 crc kubenswrapper[5120]: I0316 16:57:40.113097 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppsdf\" (UniqueName: \"kubernetes.io/projected/c74d3951-cd09-4371-9984-c1e3f863c826-kube-api-access-ppsdf\") pod \"ceilometer-0\" (UID: \"c74d3951-cd09-4371-9984-c1e3f863c826\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:57:40 crc kubenswrapper[5120]: I0316 16:57:40.225346 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:57:40 crc kubenswrapper[5120]: I0316 16:57:40.679922 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1e65f09e-1d21-4f6c-b431-5e1675a8cff3" path="/var/lib/kubelet/pods/1e65f09e-1d21-4f6c-b431-5e1675a8cff3/volumes" Mar 16 16:57:40 crc kubenswrapper[5120]: I0316 16:57:40.681349 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:57:40 crc kubenswrapper[5120]: I0316 16:57:40.899323 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:57:41 crc kubenswrapper[5120]: I0316 16:57:41.346076 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 16:57:41 crc kubenswrapper[5120]: I0316 16:57:41.590135 5120 generic.go:358] "Generic (PLEG): container finished" podID="c9783c3d-ba3f-42b1-b0ae-545df719e28f" containerID="27eecfdd7df59b056a470f18ec3dd2498184d0c45b54db440dac16a788d56cc3" exitCode=0 Mar 16 16:57:41 crc kubenswrapper[5120]: I0316 16:57:41.590301 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-6dbf47b8f6-ghhnl" event={"ID":"c9783c3d-ba3f-42b1-b0ae-545df719e28f","Type":"ContainerDied","Data":"27eecfdd7df59b056a470f18ec3dd2498184d0c45b54db440dac16a788d56cc3"} Mar 16 16:57:41 crc kubenswrapper[5120]: I0316 16:57:41.602986 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"c74d3951-cd09-4371-9984-c1e3f863c826","Type":"ContainerStarted","Data":"3e2443291e10702296c37f638ac8ab3f469acd150c1cdcbefa6c3ffa7e0adee6"} Mar 16 16:57:41 crc kubenswrapper[5120]: I0316 16:57:41.782146 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-6dbf47b8f6-ghhnl" Mar 16 16:57:41 crc kubenswrapper[5120]: I0316 16:57:41.945553 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/c9783c3d-ba3f-42b1-b0ae-545df719e28f-public-tls-certs\") pod \"c9783c3d-ba3f-42b1-b0ae-545df719e28f\" (UID: \"c9783c3d-ba3f-42b1-b0ae-545df719e28f\") " Mar 16 16:57:41 crc kubenswrapper[5120]: I0316 16:57:41.945601 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c9783c3d-ba3f-42b1-b0ae-545df719e28f-combined-ca-bundle\") pod \"c9783c3d-ba3f-42b1-b0ae-545df719e28f\" (UID: \"c9783c3d-ba3f-42b1-b0ae-545df719e28f\") " Mar 16 16:57:41 crc kubenswrapper[5120]: I0316 16:57:41.945644 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c9783c3d-ba3f-42b1-b0ae-545df719e28f-logs\") pod \"c9783c3d-ba3f-42b1-b0ae-545df719e28f\" (UID: \"c9783c3d-ba3f-42b1-b0ae-545df719e28f\") " Mar 16 16:57:41 crc kubenswrapper[5120]: I0316 16:57:41.945805 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wtzh7\" (UniqueName: \"kubernetes.io/projected/c9783c3d-ba3f-42b1-b0ae-545df719e28f-kube-api-access-wtzh7\") pod \"c9783c3d-ba3f-42b1-b0ae-545df719e28f\" (UID: \"c9783c3d-ba3f-42b1-b0ae-545df719e28f\") " Mar 16 16:57:41 crc kubenswrapper[5120]: I0316 16:57:41.946139 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c9783c3d-ba3f-42b1-b0ae-545df719e28f-scripts\") pod \"c9783c3d-ba3f-42b1-b0ae-545df719e28f\" (UID: \"c9783c3d-ba3f-42b1-b0ae-545df719e28f\") " Mar 16 16:57:41 crc kubenswrapper[5120]: I0316 16:57:41.946175 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c9783c3d-ba3f-42b1-b0ae-545df719e28f-config-data\") pod \"c9783c3d-ba3f-42b1-b0ae-545df719e28f\" (UID: \"c9783c3d-ba3f-42b1-b0ae-545df719e28f\") " Mar 16 16:57:41 crc kubenswrapper[5120]: I0316 16:57:41.946255 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/c9783c3d-ba3f-42b1-b0ae-545df719e28f-internal-tls-certs\") pod \"c9783c3d-ba3f-42b1-b0ae-545df719e28f\" (UID: \"c9783c3d-ba3f-42b1-b0ae-545df719e28f\") " Mar 16 16:57:41 crc kubenswrapper[5120]: I0316 16:57:41.946335 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9783c3d-ba3f-42b1-b0ae-545df719e28f-logs" (OuterVolumeSpecName: "logs") pod "c9783c3d-ba3f-42b1-b0ae-545df719e28f" (UID: "c9783c3d-ba3f-42b1-b0ae-545df719e28f"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:57:41 crc kubenswrapper[5120]: I0316 16:57:41.946936 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c9783c3d-ba3f-42b1-b0ae-545df719e28f-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:57:41 crc kubenswrapper[5120]: I0316 16:57:41.955117 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9783c3d-ba3f-42b1-b0ae-545df719e28f-kube-api-access-wtzh7" (OuterVolumeSpecName: "kube-api-access-wtzh7") pod "c9783c3d-ba3f-42b1-b0ae-545df719e28f" (UID: "c9783c3d-ba3f-42b1-b0ae-545df719e28f"). InnerVolumeSpecName "kube-api-access-wtzh7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:57:41 crc kubenswrapper[5120]: I0316 16:57:41.956807 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c9783c3d-ba3f-42b1-b0ae-545df719e28f-scripts" (OuterVolumeSpecName: "scripts") pod "c9783c3d-ba3f-42b1-b0ae-545df719e28f" (UID: "c9783c3d-ba3f-42b1-b0ae-545df719e28f"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:57:42 crc kubenswrapper[5120]: I0316 16:57:42.005255 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c9783c3d-ba3f-42b1-b0ae-545df719e28f-config-data" (OuterVolumeSpecName: "config-data") pod "c9783c3d-ba3f-42b1-b0ae-545df719e28f" (UID: "c9783c3d-ba3f-42b1-b0ae-545df719e28f"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:57:42 crc kubenswrapper[5120]: I0316 16:57:42.018963 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c9783c3d-ba3f-42b1-b0ae-545df719e28f-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "c9783c3d-ba3f-42b1-b0ae-545df719e28f" (UID: "c9783c3d-ba3f-42b1-b0ae-545df719e28f"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:57:42 crc kubenswrapper[5120]: I0316 16:57:42.051140 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c9783c3d-ba3f-42b1-b0ae-545df719e28f-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:57:42 crc kubenswrapper[5120]: I0316 16:57:42.051188 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c9783c3d-ba3f-42b1-b0ae-545df719e28f-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:57:42 crc kubenswrapper[5120]: I0316 16:57:42.051201 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c9783c3d-ba3f-42b1-b0ae-545df719e28f-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:57:42 crc kubenswrapper[5120]: I0316 16:57:42.051214 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wtzh7\" (UniqueName: \"kubernetes.io/projected/c9783c3d-ba3f-42b1-b0ae-545df719e28f-kube-api-access-wtzh7\") on node \"crc\" DevicePath \"\"" Mar 16 16:57:42 crc kubenswrapper[5120]: I0316 16:57:42.059736 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c9783c3d-ba3f-42b1-b0ae-545df719e28f-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "c9783c3d-ba3f-42b1-b0ae-545df719e28f" (UID: "c9783c3d-ba3f-42b1-b0ae-545df719e28f"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:57:42 crc kubenswrapper[5120]: I0316 16:57:42.065351 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c9783c3d-ba3f-42b1-b0ae-545df719e28f-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "c9783c3d-ba3f-42b1-b0ae-545df719e28f" (UID: "c9783c3d-ba3f-42b1-b0ae-545df719e28f"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:57:42 crc kubenswrapper[5120]: I0316 16:57:42.153551 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/c9783c3d-ba3f-42b1-b0ae-545df719e28f-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:57:42 crc kubenswrapper[5120]: I0316 16:57:42.153590 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/c9783c3d-ba3f-42b1-b0ae-545df719e28f-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:57:42 crc kubenswrapper[5120]: I0316 16:57:42.621621 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"c74d3951-cd09-4371-9984-c1e3f863c826","Type":"ContainerStarted","Data":"d58458049831b0118a792984131bfd9ce2aaabb224a23571e31dd75d3357c502"} Mar 16 16:57:42 crc kubenswrapper[5120]: I0316 16:57:42.625980 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-6dbf47b8f6-ghhnl" event={"ID":"c9783c3d-ba3f-42b1-b0ae-545df719e28f","Type":"ContainerDied","Data":"a1c10ddf3c1f54656aca1bf0a0a1db06f368738599dc9806bbb9f15d999a08fb"} Mar 16 16:57:42 crc kubenswrapper[5120]: I0316 16:57:42.626041 5120 scope.go:117] "RemoveContainer" containerID="27eecfdd7df59b056a470f18ec3dd2498184d0c45b54db440dac16a788d56cc3" Mar 16 16:57:42 crc kubenswrapper[5120]: I0316 16:57:42.626253 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-6dbf47b8f6-ghhnl" Mar 16 16:57:42 crc kubenswrapper[5120]: I0316 16:57:42.667489 5120 scope.go:117] "RemoveContainer" containerID="273d6b735d7fe80ae2d0779a3166c2fbf04d5f969d78b2a06ffa583b0cc60fa6" Mar 16 16:57:42 crc kubenswrapper[5120]: I0316 16:57:42.677300 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-6dbf47b8f6-ghhnl"] Mar 16 16:57:42 crc kubenswrapper[5120]: I0316 16:57:42.691372 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-6dbf47b8f6-ghhnl"] Mar 16 16:57:43 crc kubenswrapper[5120]: I0316 16:57:43.639201 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"c74d3951-cd09-4371-9984-c1e3f863c826","Type":"ContainerStarted","Data":"19017a08e8303b155aca1ad52e1d214868ff7c87ba86215486d7d71861c0ba4c"} Mar 16 16:57:43 crc kubenswrapper[5120]: I0316 16:57:43.639533 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"c74d3951-cd09-4371-9984-c1e3f863c826","Type":"ContainerStarted","Data":"536ac9829d05f55217292db62329933db52db68078e969e8e56c87357cfeee75"} Mar 16 16:57:44 crc kubenswrapper[5120]: I0316 16:57:44.674458 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c9783c3d-ba3f-42b1-b0ae-545df719e28f" path="/var/lib/kubelet/pods/c9783c3d-ba3f-42b1-b0ae-545df719e28f/volumes" Mar 16 16:57:45 crc kubenswrapper[5120]: I0316 16:57:45.961388 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:57:45 crc kubenswrapper[5120]: I0316 16:57:45.962011 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="dc34c11e-3278-4e46-94e1-7cb991fe4591" containerName="glance-log" containerID="cri-o://17763fbc1635305808da4653863a6755805a59c624d1ef4581274852d4eff119" gracePeriod=30 Mar 16 16:57:45 crc kubenswrapper[5120]: I0316 16:57:45.962108 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="dc34c11e-3278-4e46-94e1-7cb991fe4591" containerName="glance-httpd" containerID="cri-o://f57ddc1df89510055bf60fee4e330d3b0cbae6904f52d3fd95410be509faa91c" gracePeriod=30 Mar 16 16:57:46 crc kubenswrapper[5120]: I0316 16:57:46.664202 5120 scope.go:117] "RemoveContainer" containerID="083f72646c8d47c9c0467b39be99ddfa9c2e5900ae0a29ad53d7b39b950274b4" Mar 16 16:57:46 crc kubenswrapper[5120]: E0316 16:57:46.664879 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:57:46 crc kubenswrapper[5120]: I0316 16:57:46.675340 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="c74d3951-cd09-4371-9984-c1e3f863c826" containerName="ceilometer-central-agent" containerID="cri-o://d58458049831b0118a792984131bfd9ce2aaabb224a23571e31dd75d3357c502" gracePeriod=30 Mar 16 16:57:46 crc kubenswrapper[5120]: I0316 16:57:46.675370 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="c74d3951-cd09-4371-9984-c1e3f863c826" containerName="proxy-httpd" containerID="cri-o://718fc975ef6e3bdd08e304cbdb49697f544fc322b571dfe40e3f243a0642a65b" gracePeriod=30 Mar 16 16:57:46 crc kubenswrapper[5120]: I0316 16:57:46.675435 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="c74d3951-cd09-4371-9984-c1e3f863c826" containerName="sg-core" containerID="cri-o://536ac9829d05f55217292db62329933db52db68078e969e8e56c87357cfeee75" gracePeriod=30 Mar 16 16:57:46 crc kubenswrapper[5120]: I0316 16:57:46.675729 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="c74d3951-cd09-4371-9984-c1e3f863c826" containerName="ceilometer-notification-agent" containerID="cri-o://19017a08e8303b155aca1ad52e1d214868ff7c87ba86215486d7d71861c0ba4c" gracePeriod=30 Mar 16 16:57:46 crc kubenswrapper[5120]: I0316 16:57:46.678278 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:57:46 crc kubenswrapper[5120]: I0316 16:57:46.678307 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"c74d3951-cd09-4371-9984-c1e3f863c826","Type":"ContainerStarted","Data":"718fc975ef6e3bdd08e304cbdb49697f544fc322b571dfe40e3f243a0642a65b"} Mar 16 16:57:46 crc kubenswrapper[5120]: I0316 16:57:46.680433 5120 generic.go:358] "Generic (PLEG): container finished" podID="dc34c11e-3278-4e46-94e1-7cb991fe4591" containerID="17763fbc1635305808da4653863a6755805a59c624d1ef4581274852d4eff119" exitCode=143 Mar 16 16:57:46 crc kubenswrapper[5120]: I0316 16:57:46.680597 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"dc34c11e-3278-4e46-94e1-7cb991fe4591","Type":"ContainerDied","Data":"17763fbc1635305808da4653863a6755805a59c624d1ef4581274852d4eff119"} Mar 16 16:57:46 crc kubenswrapper[5120]: I0316 16:57:46.704105 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.915125593 podStartE2EDuration="7.704080019s" podCreationTimestamp="2026-03-16 16:57:39 +0000 UTC" firstStartedPulling="2026-03-16 16:57:40.689081225 +0000 UTC m=+5162.843012882" lastFinishedPulling="2026-03-16 16:57:45.478035651 +0000 UTC m=+5167.631967308" observedRunningTime="2026-03-16 16:57:46.699625878 +0000 UTC m=+5168.853557535" watchObservedRunningTime="2026-03-16 16:57:46.704080019 +0000 UTC m=+5168.858011676" Mar 16 16:57:47 crc kubenswrapper[5120]: I0316 16:57:47.736298 5120 generic.go:358] "Generic (PLEG): container finished" podID="c74d3951-cd09-4371-9984-c1e3f863c826" containerID="718fc975ef6e3bdd08e304cbdb49697f544fc322b571dfe40e3f243a0642a65b" exitCode=0 Mar 16 16:57:47 crc kubenswrapper[5120]: I0316 16:57:47.738251 5120 generic.go:358] "Generic (PLEG): container finished" podID="c74d3951-cd09-4371-9984-c1e3f863c826" containerID="536ac9829d05f55217292db62329933db52db68078e969e8e56c87357cfeee75" exitCode=2 Mar 16 16:57:47 crc kubenswrapper[5120]: I0316 16:57:47.738341 5120 generic.go:358] "Generic (PLEG): container finished" podID="c74d3951-cd09-4371-9984-c1e3f863c826" containerID="19017a08e8303b155aca1ad52e1d214868ff7c87ba86215486d7d71861c0ba4c" exitCode=0 Mar 16 16:57:47 crc kubenswrapper[5120]: I0316 16:57:47.736370 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"c74d3951-cd09-4371-9984-c1e3f863c826","Type":"ContainerDied","Data":"718fc975ef6e3bdd08e304cbdb49697f544fc322b571dfe40e3f243a0642a65b"} Mar 16 16:57:47 crc kubenswrapper[5120]: I0316 16:57:47.739087 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"c74d3951-cd09-4371-9984-c1e3f863c826","Type":"ContainerDied","Data":"536ac9829d05f55217292db62329933db52db68078e969e8e56c87357cfeee75"} Mar 16 16:57:47 crc kubenswrapper[5120]: I0316 16:57:47.739194 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"c74d3951-cd09-4371-9984-c1e3f863c826","Type":"ContainerDied","Data":"19017a08e8303b155aca1ad52e1d214868ff7c87ba86215486d7d71861c0ba4c"} Mar 16 16:57:48 crc kubenswrapper[5120]: I0316 16:57:48.751840 5120 generic.go:358] "Generic (PLEG): container finished" podID="60725840-493f-4af4-97f6-ba67ec495e7d" containerID="192dc6632db5d07e0f36b0240e4f98e1b355edf0c9ef9c79a3cde5f3a6bb487a" exitCode=0 Mar 16 16:57:48 crc kubenswrapper[5120]: I0316 16:57:48.751925 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-7cmgm" event={"ID":"60725840-493f-4af4-97f6-ba67ec495e7d","Type":"ContainerDied","Data":"192dc6632db5d07e0f36b0240e4f98e1b355edf0c9ef9c79a3cde5f3a6bb487a"} Mar 16 16:57:48 crc kubenswrapper[5120]: I0316 16:57:48.919344 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:57:48 crc kubenswrapper[5120]: I0316 16:57:48.919708 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="7870ec2c-0344-4cfe-bc6d-4bca0c11ba52" containerName="glance-log" containerID="cri-o://eb3962f919d594f5a3959a34cacc52d4dc41c8dc91044b096eab14d5a2f0033b" gracePeriod=30 Mar 16 16:57:48 crc kubenswrapper[5120]: I0316 16:57:48.919846 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="7870ec2c-0344-4cfe-bc6d-4bca0c11ba52" containerName="glance-httpd" containerID="cri-o://2b0e138b699773308041579cd1e212fad18c455eefe44c13b906ab063bee536b" gracePeriod=30 Mar 16 16:57:49 crc kubenswrapper[5120]: I0316 16:57:49.781499 5120 generic.go:358] "Generic (PLEG): container finished" podID="c74d3951-cd09-4371-9984-c1e3f863c826" containerID="d58458049831b0118a792984131bfd9ce2aaabb224a23571e31dd75d3357c502" exitCode=0 Mar 16 16:57:49 crc kubenswrapper[5120]: I0316 16:57:49.782201 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"c74d3951-cd09-4371-9984-c1e3f863c826","Type":"ContainerDied","Data":"d58458049831b0118a792984131bfd9ce2aaabb224a23571e31dd75d3357c502"} Mar 16 16:57:49 crc kubenswrapper[5120]: I0316 16:57:49.782244 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"c74d3951-cd09-4371-9984-c1e3f863c826","Type":"ContainerDied","Data":"3e2443291e10702296c37f638ac8ab3f469acd150c1cdcbefa6c3ffa7e0adee6"} Mar 16 16:57:49 crc kubenswrapper[5120]: I0316 16:57:49.782263 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3e2443291e10702296c37f638ac8ab3f469acd150c1cdcbefa6c3ffa7e0adee6" Mar 16 16:57:49 crc kubenswrapper[5120]: I0316 16:57:49.783839 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:57:49 crc kubenswrapper[5120]: I0316 16:57:49.785436 5120 generic.go:358] "Generic (PLEG): container finished" podID="dc34c11e-3278-4e46-94e1-7cb991fe4591" containerID="f57ddc1df89510055bf60fee4e330d3b0cbae6904f52d3fd95410be509faa91c" exitCode=0 Mar 16 16:57:49 crc kubenswrapper[5120]: I0316 16:57:49.785540 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"dc34c11e-3278-4e46-94e1-7cb991fe4591","Type":"ContainerDied","Data":"f57ddc1df89510055bf60fee4e330d3b0cbae6904f52d3fd95410be509faa91c"} Mar 16 16:57:49 crc kubenswrapper[5120]: I0316 16:57:49.785559 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"dc34c11e-3278-4e46-94e1-7cb991fe4591","Type":"ContainerDied","Data":"bed6ecf73bd8e2438e112768e701642686b27000a502df975bda33f9cefc79d7"} Mar 16 16:57:49 crc kubenswrapper[5120]: I0316 16:57:49.785576 5120 scope.go:117] "RemoveContainer" containerID="f57ddc1df89510055bf60fee4e330d3b0cbae6904f52d3fd95410be509faa91c" Mar 16 16:57:49 crc kubenswrapper[5120]: I0316 16:57:49.789796 5120 generic.go:358] "Generic (PLEG): container finished" podID="7870ec2c-0344-4cfe-bc6d-4bca0c11ba52" containerID="eb3962f919d594f5a3959a34cacc52d4dc41c8dc91044b096eab14d5a2f0033b" exitCode=143 Mar 16 16:57:49 crc kubenswrapper[5120]: I0316 16:57:49.790031 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"7870ec2c-0344-4cfe-bc6d-4bca0c11ba52","Type":"ContainerDied","Data":"eb3962f919d594f5a3959a34cacc52d4dc41c8dc91044b096eab14d5a2f0033b"} Mar 16 16:57:49 crc kubenswrapper[5120]: I0316 16:57:49.802854 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:57:49 crc kubenswrapper[5120]: I0316 16:57:49.827450 5120 scope.go:117] "RemoveContainer" containerID="17763fbc1635305808da4653863a6755805a59c624d1ef4581274852d4eff119" Mar 16 16:57:49 crc kubenswrapper[5120]: I0316 16:57:49.872907 5120 scope.go:117] "RemoveContainer" containerID="f57ddc1df89510055bf60fee4e330d3b0cbae6904f52d3fd95410be509faa91c" Mar 16 16:57:49 crc kubenswrapper[5120]: E0316 16:57:49.873350 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f57ddc1df89510055bf60fee4e330d3b0cbae6904f52d3fd95410be509faa91c\": container with ID starting with f57ddc1df89510055bf60fee4e330d3b0cbae6904f52d3fd95410be509faa91c not found: ID does not exist" containerID="f57ddc1df89510055bf60fee4e330d3b0cbae6904f52d3fd95410be509faa91c" Mar 16 16:57:49 crc kubenswrapper[5120]: I0316 16:57:49.873386 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f57ddc1df89510055bf60fee4e330d3b0cbae6904f52d3fd95410be509faa91c"} err="failed to get container status \"f57ddc1df89510055bf60fee4e330d3b0cbae6904f52d3fd95410be509faa91c\": rpc error: code = NotFound desc = could not find container \"f57ddc1df89510055bf60fee4e330d3b0cbae6904f52d3fd95410be509faa91c\": container with ID starting with f57ddc1df89510055bf60fee4e330d3b0cbae6904f52d3fd95410be509faa91c not found: ID does not exist" Mar 16 16:57:49 crc kubenswrapper[5120]: I0316 16:57:49.873407 5120 scope.go:117] "RemoveContainer" containerID="17763fbc1635305808da4653863a6755805a59c624d1ef4581274852d4eff119" Mar 16 16:57:49 crc kubenswrapper[5120]: E0316 16:57:49.873619 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"17763fbc1635305808da4653863a6755805a59c624d1ef4581274852d4eff119\": container with ID starting with 17763fbc1635305808da4653863a6755805a59c624d1ef4581274852d4eff119 not found: ID does not exist" containerID="17763fbc1635305808da4653863a6755805a59c624d1ef4581274852d4eff119" Mar 16 16:57:49 crc kubenswrapper[5120]: I0316 16:57:49.873642 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17763fbc1635305808da4653863a6755805a59c624d1ef4581274852d4eff119"} err="failed to get container status \"17763fbc1635305808da4653863a6755805a59c624d1ef4581274852d4eff119\": rpc error: code = NotFound desc = could not find container \"17763fbc1635305808da4653863a6755805a59c624d1ef4581274852d4eff119\": container with ID starting with 17763fbc1635305808da4653863a6755805a59c624d1ef4581274852d4eff119 not found: ID does not exist" Mar 16 16:57:49 crc kubenswrapper[5120]: I0316 16:57:49.881863 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ppsdf\" (UniqueName: \"kubernetes.io/projected/c74d3951-cd09-4371-9984-c1e3f863c826-kube-api-access-ppsdf\") pod \"c74d3951-cd09-4371-9984-c1e3f863c826\" (UID: \"c74d3951-cd09-4371-9984-c1e3f863c826\") " Mar 16 16:57:49 crc kubenswrapper[5120]: I0316 16:57:49.881912 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c74d3951-cd09-4371-9984-c1e3f863c826-config-data\") pod \"c74d3951-cd09-4371-9984-c1e3f863c826\" (UID: \"c74d3951-cd09-4371-9984-c1e3f863c826\") " Mar 16 16:57:49 crc kubenswrapper[5120]: I0316 16:57:49.882029 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/dc34c11e-3278-4e46-94e1-7cb991fe4591-httpd-run\") pod \"dc34c11e-3278-4e46-94e1-7cb991fe4591\" (UID: \"dc34c11e-3278-4e46-94e1-7cb991fe4591\") " Mar 16 16:57:49 crc kubenswrapper[5120]: I0316 16:57:49.882078 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c74d3951-cd09-4371-9984-c1e3f863c826-run-httpd\") pod \"c74d3951-cd09-4371-9984-c1e3f863c826\" (UID: \"c74d3951-cd09-4371-9984-c1e3f863c826\") " Mar 16 16:57:49 crc kubenswrapper[5120]: I0316 16:57:49.882117 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c74d3951-cd09-4371-9984-c1e3f863c826-log-httpd\") pod \"c74d3951-cd09-4371-9984-c1e3f863c826\" (UID: \"c74d3951-cd09-4371-9984-c1e3f863c826\") " Mar 16 16:57:49 crc kubenswrapper[5120]: I0316 16:57:49.882173 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/dc34c11e-3278-4e46-94e1-7cb991fe4591-public-tls-certs\") pod \"dc34c11e-3278-4e46-94e1-7cb991fe4591\" (UID: \"dc34c11e-3278-4e46-94e1-7cb991fe4591\") " Mar 16 16:57:49 crc kubenswrapper[5120]: I0316 16:57:49.882199 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"dc34c11e-3278-4e46-94e1-7cb991fe4591\" (UID: \"dc34c11e-3278-4e46-94e1-7cb991fe4591\") " Mar 16 16:57:49 crc kubenswrapper[5120]: I0316 16:57:49.882245 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dc34c11e-3278-4e46-94e1-7cb991fe4591-config-data\") pod \"dc34c11e-3278-4e46-94e1-7cb991fe4591\" (UID: \"dc34c11e-3278-4e46-94e1-7cb991fe4591\") " Mar 16 16:57:49 crc kubenswrapper[5120]: I0316 16:57:49.882290 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c74d3951-cd09-4371-9984-c1e3f863c826-scripts\") pod \"c74d3951-cd09-4371-9984-c1e3f863c826\" (UID: \"c74d3951-cd09-4371-9984-c1e3f863c826\") " Mar 16 16:57:49 crc kubenswrapper[5120]: I0316 16:57:49.882336 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c74d3951-cd09-4371-9984-c1e3f863c826-combined-ca-bundle\") pod \"c74d3951-cd09-4371-9984-c1e3f863c826\" (UID: \"c74d3951-cd09-4371-9984-c1e3f863c826\") " Mar 16 16:57:49 crc kubenswrapper[5120]: I0316 16:57:49.882439 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/c74d3951-cd09-4371-9984-c1e3f863c826-sg-core-conf-yaml\") pod \"c74d3951-cd09-4371-9984-c1e3f863c826\" (UID: \"c74d3951-cd09-4371-9984-c1e3f863c826\") " Mar 16 16:57:49 crc kubenswrapper[5120]: I0316 16:57:49.882465 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dc34c11e-3278-4e46-94e1-7cb991fe4591-combined-ca-bundle\") pod \"dc34c11e-3278-4e46-94e1-7cb991fe4591\" (UID: \"dc34c11e-3278-4e46-94e1-7cb991fe4591\") " Mar 16 16:57:49 crc kubenswrapper[5120]: I0316 16:57:49.882530 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/dc34c11e-3278-4e46-94e1-7cb991fe4591-logs\") pod \"dc34c11e-3278-4e46-94e1-7cb991fe4591\" (UID: \"dc34c11e-3278-4e46-94e1-7cb991fe4591\") " Mar 16 16:57:49 crc kubenswrapper[5120]: I0316 16:57:49.882598 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tnsfj\" (UniqueName: \"kubernetes.io/projected/dc34c11e-3278-4e46-94e1-7cb991fe4591-kube-api-access-tnsfj\") pod \"dc34c11e-3278-4e46-94e1-7cb991fe4591\" (UID: \"dc34c11e-3278-4e46-94e1-7cb991fe4591\") " Mar 16 16:57:49 crc kubenswrapper[5120]: I0316 16:57:49.883830 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/dc34c11e-3278-4e46-94e1-7cb991fe4591-scripts\") pod \"dc34c11e-3278-4e46-94e1-7cb991fe4591\" (UID: \"dc34c11e-3278-4e46-94e1-7cb991fe4591\") " Mar 16 16:57:49 crc kubenswrapper[5120]: I0316 16:57:49.883866 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/c74d3951-cd09-4371-9984-c1e3f863c826-ceilometer-tls-certs\") pod \"c74d3951-cd09-4371-9984-c1e3f863c826\" (UID: \"c74d3951-cd09-4371-9984-c1e3f863c826\") " Mar 16 16:57:49 crc kubenswrapper[5120]: I0316 16:57:49.891127 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc34c11e-3278-4e46-94e1-7cb991fe4591-logs" (OuterVolumeSpecName: "logs") pod "dc34c11e-3278-4e46-94e1-7cb991fe4591" (UID: "dc34c11e-3278-4e46-94e1-7cb991fe4591"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:57:49 crc kubenswrapper[5120]: I0316 16:57:49.895860 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc34c11e-3278-4e46-94e1-7cb991fe4591-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "dc34c11e-3278-4e46-94e1-7cb991fe4591" (UID: "dc34c11e-3278-4e46-94e1-7cb991fe4591"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:57:49 crc kubenswrapper[5120]: I0316 16:57:49.896182 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c74d3951-cd09-4371-9984-c1e3f863c826-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "c74d3951-cd09-4371-9984-c1e3f863c826" (UID: "c74d3951-cd09-4371-9984-c1e3f863c826"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:57:49 crc kubenswrapper[5120]: I0316 16:57:49.896460 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c74d3951-cd09-4371-9984-c1e3f863c826-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "c74d3951-cd09-4371-9984-c1e3f863c826" (UID: "c74d3951-cd09-4371-9984-c1e3f863c826"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:57:49 crc kubenswrapper[5120]: I0316 16:57:49.901688 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c74d3951-cd09-4371-9984-c1e3f863c826-scripts" (OuterVolumeSpecName: "scripts") pod "c74d3951-cd09-4371-9984-c1e3f863c826" (UID: "c74d3951-cd09-4371-9984-c1e3f863c826"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:57:49 crc kubenswrapper[5120]: I0316 16:57:49.907469 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc34c11e-3278-4e46-94e1-7cb991fe4591-scripts" (OuterVolumeSpecName: "scripts") pod "dc34c11e-3278-4e46-94e1-7cb991fe4591" (UID: "dc34c11e-3278-4e46-94e1-7cb991fe4591"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:57:49 crc kubenswrapper[5120]: I0316 16:57:49.908177 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c74d3951-cd09-4371-9984-c1e3f863c826-kube-api-access-ppsdf" (OuterVolumeSpecName: "kube-api-access-ppsdf") pod "c74d3951-cd09-4371-9984-c1e3f863c826" (UID: "c74d3951-cd09-4371-9984-c1e3f863c826"). InnerVolumeSpecName "kube-api-access-ppsdf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:57:49 crc kubenswrapper[5120]: I0316 16:57:49.910436 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage05-crc" (OuterVolumeSpecName: "glance") pod "dc34c11e-3278-4e46-94e1-7cb991fe4591" (UID: "dc34c11e-3278-4e46-94e1-7cb991fe4591"). InnerVolumeSpecName "local-storage05-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:57:49 crc kubenswrapper[5120]: I0316 16:57:49.910630 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc34c11e-3278-4e46-94e1-7cb991fe4591-kube-api-access-tnsfj" (OuterVolumeSpecName: "kube-api-access-tnsfj") pod "dc34c11e-3278-4e46-94e1-7cb991fe4591" (UID: "dc34c11e-3278-4e46-94e1-7cb991fe4591"). InnerVolumeSpecName "kube-api-access-tnsfj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:57:49 crc kubenswrapper[5120]: I0316 16:57:49.941737 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c74d3951-cd09-4371-9984-c1e3f863c826-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "c74d3951-cd09-4371-9984-c1e3f863c826" (UID: "c74d3951-cd09-4371-9984-c1e3f863c826"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:57:49 crc kubenswrapper[5120]: I0316 16:57:49.954723 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc34c11e-3278-4e46-94e1-7cb991fe4591-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "dc34c11e-3278-4e46-94e1-7cb991fe4591" (UID: "dc34c11e-3278-4e46-94e1-7cb991fe4591"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:57:49 crc kubenswrapper[5120]: I0316 16:57:49.980261 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc34c11e-3278-4e46-94e1-7cb991fe4591-config-data" (OuterVolumeSpecName: "config-data") pod "dc34c11e-3278-4e46-94e1-7cb991fe4591" (UID: "dc34c11e-3278-4e46-94e1-7cb991fe4591"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:57:49 crc kubenswrapper[5120]: I0316 16:57:49.987484 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") on node \"crc\" " Mar 16 16:57:49 crc kubenswrapper[5120]: I0316 16:57:49.987529 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dc34c11e-3278-4e46-94e1-7cb991fe4591-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:57:49 crc kubenswrapper[5120]: I0316 16:57:49.987543 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c74d3951-cd09-4371-9984-c1e3f863c826-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:57:49 crc kubenswrapper[5120]: I0316 16:57:49.987553 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/c74d3951-cd09-4371-9984-c1e3f863c826-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 16:57:49 crc kubenswrapper[5120]: I0316 16:57:49.987567 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dc34c11e-3278-4e46-94e1-7cb991fe4591-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:57:49 crc kubenswrapper[5120]: I0316 16:57:49.987579 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/dc34c11e-3278-4e46-94e1-7cb991fe4591-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:57:49 crc kubenswrapper[5120]: I0316 16:57:49.987588 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tnsfj\" (UniqueName: \"kubernetes.io/projected/dc34c11e-3278-4e46-94e1-7cb991fe4591-kube-api-access-tnsfj\") on node \"crc\" DevicePath \"\"" Mar 16 16:57:49 crc kubenswrapper[5120]: I0316 16:57:49.987599 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/dc34c11e-3278-4e46-94e1-7cb991fe4591-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:57:49 crc kubenswrapper[5120]: I0316 16:57:49.987607 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ppsdf\" (UniqueName: \"kubernetes.io/projected/c74d3951-cd09-4371-9984-c1e3f863c826-kube-api-access-ppsdf\") on node \"crc\" DevicePath \"\"" Mar 16 16:57:49 crc kubenswrapper[5120]: I0316 16:57:49.987617 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/dc34c11e-3278-4e46-94e1-7cb991fe4591-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 16:57:49 crc kubenswrapper[5120]: I0316 16:57:49.987625 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c74d3951-cd09-4371-9984-c1e3f863c826-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:57:49 crc kubenswrapper[5120]: I0316 16:57:49.987635 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c74d3951-cd09-4371-9984-c1e3f863c826-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:57:49 crc kubenswrapper[5120]: I0316 16:57:49.995475 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc34c11e-3278-4e46-94e1-7cb991fe4591-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "dc34c11e-3278-4e46-94e1-7cb991fe4591" (UID: "dc34c11e-3278-4e46-94e1-7cb991fe4591"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:57:49 crc kubenswrapper[5120]: I0316 16:57:49.997268 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c74d3951-cd09-4371-9984-c1e3f863c826-ceilometer-tls-certs" (OuterVolumeSpecName: "ceilometer-tls-certs") pod "c74d3951-cd09-4371-9984-c1e3f863c826" (UID: "c74d3951-cd09-4371-9984-c1e3f863c826"). InnerVolumeSpecName "ceilometer-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:57:50 crc kubenswrapper[5120]: I0316 16:57:50.025660 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage05-crc" (UniqueName: "kubernetes.io/local-volume/local-storage05-crc") on node "crc" Mar 16 16:57:50 crc kubenswrapper[5120]: I0316 16:57:50.039559 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c74d3951-cd09-4371-9984-c1e3f863c826-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "c74d3951-cd09-4371-9984-c1e3f863c826" (UID: "c74d3951-cd09-4371-9984-c1e3f863c826"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:57:50 crc kubenswrapper[5120]: I0316 16:57:50.084885 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c74d3951-cd09-4371-9984-c1e3f863c826-config-data" (OuterVolumeSpecName: "config-data") pod "c74d3951-cd09-4371-9984-c1e3f863c826" (UID: "c74d3951-cd09-4371-9984-c1e3f863c826"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:57:50 crc kubenswrapper[5120]: I0316 16:57:50.090199 5120 reconciler_common.go:299] "Volume detached for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/c74d3951-cd09-4371-9984-c1e3f863c826-ceilometer-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:57:50 crc kubenswrapper[5120]: I0316 16:57:50.090256 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c74d3951-cd09-4371-9984-c1e3f863c826-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:57:50 crc kubenswrapper[5120]: I0316 16:57:50.090270 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/dc34c11e-3278-4e46-94e1-7cb991fe4591-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:57:50 crc kubenswrapper[5120]: I0316 16:57:50.090280 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:57:50 crc kubenswrapper[5120]: I0316 16:57:50.090288 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c74d3951-cd09-4371-9984-c1e3f863c826-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:57:50 crc kubenswrapper[5120]: I0316 16:57:50.206738 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-7cmgm" Mar 16 16:57:50 crc kubenswrapper[5120]: I0316 16:57:50.294529 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/60725840-493f-4af4-97f6-ba67ec495e7d-combined-ca-bundle\") pod \"60725840-493f-4af4-97f6-ba67ec495e7d\" (UID: \"60725840-493f-4af4-97f6-ba67ec495e7d\") " Mar 16 16:57:50 crc kubenswrapper[5120]: I0316 16:57:50.294896 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/60725840-493f-4af4-97f6-ba67ec495e7d-scripts\") pod \"60725840-493f-4af4-97f6-ba67ec495e7d\" (UID: \"60725840-493f-4af4-97f6-ba67ec495e7d\") " Mar 16 16:57:50 crc kubenswrapper[5120]: I0316 16:57:50.295069 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-92l9d\" (UniqueName: \"kubernetes.io/projected/60725840-493f-4af4-97f6-ba67ec495e7d-kube-api-access-92l9d\") pod \"60725840-493f-4af4-97f6-ba67ec495e7d\" (UID: \"60725840-493f-4af4-97f6-ba67ec495e7d\") " Mar 16 16:57:50 crc kubenswrapper[5120]: I0316 16:57:50.295115 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/60725840-493f-4af4-97f6-ba67ec495e7d-config-data\") pod \"60725840-493f-4af4-97f6-ba67ec495e7d\" (UID: \"60725840-493f-4af4-97f6-ba67ec495e7d\") " Mar 16 16:57:50 crc kubenswrapper[5120]: I0316 16:57:50.301503 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/60725840-493f-4af4-97f6-ba67ec495e7d-scripts" (OuterVolumeSpecName: "scripts") pod "60725840-493f-4af4-97f6-ba67ec495e7d" (UID: "60725840-493f-4af4-97f6-ba67ec495e7d"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:57:50 crc kubenswrapper[5120]: I0316 16:57:50.307938 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60725840-493f-4af4-97f6-ba67ec495e7d-kube-api-access-92l9d" (OuterVolumeSpecName: "kube-api-access-92l9d") pod "60725840-493f-4af4-97f6-ba67ec495e7d" (UID: "60725840-493f-4af4-97f6-ba67ec495e7d"). InnerVolumeSpecName "kube-api-access-92l9d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:57:50 crc kubenswrapper[5120]: I0316 16:57:50.323800 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/60725840-493f-4af4-97f6-ba67ec495e7d-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "60725840-493f-4af4-97f6-ba67ec495e7d" (UID: "60725840-493f-4af4-97f6-ba67ec495e7d"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:57:50 crc kubenswrapper[5120]: I0316 16:57:50.326922 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/60725840-493f-4af4-97f6-ba67ec495e7d-config-data" (OuterVolumeSpecName: "config-data") pod "60725840-493f-4af4-97f6-ba67ec495e7d" (UID: "60725840-493f-4af4-97f6-ba67ec495e7d"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:57:50 crc kubenswrapper[5120]: I0316 16:57:50.399675 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/60725840-493f-4af4-97f6-ba67ec495e7d-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:57:50 crc kubenswrapper[5120]: I0316 16:57:50.399717 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/60725840-493f-4af4-97f6-ba67ec495e7d-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:57:50 crc kubenswrapper[5120]: I0316 16:57:50.399729 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-92l9d\" (UniqueName: \"kubernetes.io/projected/60725840-493f-4af4-97f6-ba67ec495e7d-kube-api-access-92l9d\") on node \"crc\" DevicePath \"\"" Mar 16 16:57:50 crc kubenswrapper[5120]: I0316 16:57:50.399741 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/60725840-493f-4af4-97f6-ba67ec495e7d-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:57:50 crc kubenswrapper[5120]: I0316 16:57:50.807479 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-7cmgm" Mar 16 16:57:50 crc kubenswrapper[5120]: I0316 16:57:50.807532 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-7cmgm" event={"ID":"60725840-493f-4af4-97f6-ba67ec495e7d","Type":"ContainerDied","Data":"401ee7f5538f364872d5c8d10bd9d70f159e95baeb90348419212dfd661f3aa5"} Mar 16 16:57:50 crc kubenswrapper[5120]: I0316 16:57:50.808055 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="401ee7f5538f364872d5c8d10bd9d70f159e95baeb90348419212dfd661f3aa5" Mar 16 16:57:50 crc kubenswrapper[5120]: I0316 16:57:50.809245 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:57:50 crc kubenswrapper[5120]: I0316 16:57:50.809728 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:57:50 crc kubenswrapper[5120]: I0316 16:57:50.845066 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:57:50 crc kubenswrapper[5120]: I0316 16:57:50.859126 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:57:50 crc kubenswrapper[5120]: I0316 16:57:50.870150 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:57:50 crc kubenswrapper[5120]: I0316 16:57:50.871598 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c74d3951-cd09-4371-9984-c1e3f863c826" containerName="proxy-httpd" Mar 16 16:57:50 crc kubenswrapper[5120]: I0316 16:57:50.871622 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c74d3951-cd09-4371-9984-c1e3f863c826" containerName="proxy-httpd" Mar 16 16:57:50 crc kubenswrapper[5120]: I0316 16:57:50.871640 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60725840-493f-4af4-97f6-ba67ec495e7d" containerName="nova-cell0-conductor-db-sync" Mar 16 16:57:50 crc kubenswrapper[5120]: I0316 16:57:50.871649 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="60725840-493f-4af4-97f6-ba67ec495e7d" containerName="nova-cell0-conductor-db-sync" Mar 16 16:57:50 crc kubenswrapper[5120]: I0316 16:57:50.871667 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9783c3d-ba3f-42b1-b0ae-545df719e28f" containerName="placement-api" Mar 16 16:57:50 crc kubenswrapper[5120]: I0316 16:57:50.871675 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9783c3d-ba3f-42b1-b0ae-545df719e28f" containerName="placement-api" Mar 16 16:57:50 crc kubenswrapper[5120]: I0316 16:57:50.871694 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c74d3951-cd09-4371-9984-c1e3f863c826" containerName="ceilometer-notification-agent" Mar 16 16:57:50 crc kubenswrapper[5120]: I0316 16:57:50.871704 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c74d3951-cd09-4371-9984-c1e3f863c826" containerName="ceilometer-notification-agent" Mar 16 16:57:50 crc kubenswrapper[5120]: I0316 16:57:50.871733 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc34c11e-3278-4e46-94e1-7cb991fe4591" containerName="glance-httpd" Mar 16 16:57:50 crc kubenswrapper[5120]: I0316 16:57:50.871741 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc34c11e-3278-4e46-94e1-7cb991fe4591" containerName="glance-httpd" Mar 16 16:57:50 crc kubenswrapper[5120]: I0316 16:57:50.871856 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc34c11e-3278-4e46-94e1-7cb991fe4591" containerName="glance-log" Mar 16 16:57:50 crc kubenswrapper[5120]: I0316 16:57:50.871865 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc34c11e-3278-4e46-94e1-7cb991fe4591" containerName="glance-log" Mar 16 16:57:50 crc kubenswrapper[5120]: I0316 16:57:50.871890 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c74d3951-cd09-4371-9984-c1e3f863c826" containerName="sg-core" Mar 16 16:57:50 crc kubenswrapper[5120]: I0316 16:57:50.871896 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c74d3951-cd09-4371-9984-c1e3f863c826" containerName="sg-core" Mar 16 16:57:50 crc kubenswrapper[5120]: I0316 16:57:50.871919 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c74d3951-cd09-4371-9984-c1e3f863c826" containerName="ceilometer-central-agent" Mar 16 16:57:50 crc kubenswrapper[5120]: I0316 16:57:50.871930 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c74d3951-cd09-4371-9984-c1e3f863c826" containerName="ceilometer-central-agent" Mar 16 16:57:50 crc kubenswrapper[5120]: I0316 16:57:50.871963 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9783c3d-ba3f-42b1-b0ae-545df719e28f" containerName="placement-log" Mar 16 16:57:50 crc kubenswrapper[5120]: I0316 16:57:50.871972 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9783c3d-ba3f-42b1-b0ae-545df719e28f" containerName="placement-log" Mar 16 16:57:50 crc kubenswrapper[5120]: I0316 16:57:50.872162 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c9783c3d-ba3f-42b1-b0ae-545df719e28f" containerName="placement-api" Mar 16 16:57:50 crc kubenswrapper[5120]: I0316 16:57:50.872184 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="dc34c11e-3278-4e46-94e1-7cb991fe4591" containerName="glance-httpd" Mar 16 16:57:50 crc kubenswrapper[5120]: I0316 16:57:50.872202 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c74d3951-cd09-4371-9984-c1e3f863c826" containerName="ceilometer-central-agent" Mar 16 16:57:50 crc kubenswrapper[5120]: I0316 16:57:50.872216 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c74d3951-cd09-4371-9984-c1e3f863c826" containerName="sg-core" Mar 16 16:57:50 crc kubenswrapper[5120]: I0316 16:57:50.872225 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c74d3951-cd09-4371-9984-c1e3f863c826" containerName="ceilometer-notification-agent" Mar 16 16:57:50 crc kubenswrapper[5120]: I0316 16:57:50.872237 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c74d3951-cd09-4371-9984-c1e3f863c826" containerName="proxy-httpd" Mar 16 16:57:50 crc kubenswrapper[5120]: I0316 16:57:50.872249 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="dc34c11e-3278-4e46-94e1-7cb991fe4591" containerName="glance-log" Mar 16 16:57:50 crc kubenswrapper[5120]: I0316 16:57:50.872259 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="60725840-493f-4af4-97f6-ba67ec495e7d" containerName="nova-cell0-conductor-db-sync" Mar 16 16:57:50 crc kubenswrapper[5120]: I0316 16:57:50.872270 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c9783c3d-ba3f-42b1-b0ae-545df719e28f" containerName="placement-log" Mar 16 16:57:50 crc kubenswrapper[5120]: I0316 16:57:50.884502 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:57:50 crc kubenswrapper[5120]: I0316 16:57:50.884532 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:57:50 crc kubenswrapper[5120]: I0316 16:57:50.897446 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:57:50 crc kubenswrapper[5120]: I0316 16:57:50.900963 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-nova-dockercfg-mhbr5\"" Mar 16 16:57:50 crc kubenswrapper[5120]: I0316 16:57:50.901446 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-conductor-config-data\"" Mar 16 16:57:50 crc kubenswrapper[5120]: I0316 16:57:50.905003 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:57:50 crc kubenswrapper[5120]: I0316 16:57:50.916949 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:57:50 crc kubenswrapper[5120]: I0316 16:57:50.933968 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:57:50 crc kubenswrapper[5120]: I0316 16:57:50.937746 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:57:50 crc kubenswrapper[5120]: I0316 16:57:50.940884 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:57:50 crc kubenswrapper[5120]: I0316 16:57:50.941615 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-external-config-data\"" Mar 16 16:57:50 crc kubenswrapper[5120]: I0316 16:57:50.945099 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:57:50 crc kubenswrapper[5120]: I0316 16:57:50.946012 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-public-svc\"" Mar 16 16:57:50 crc kubenswrapper[5120]: I0316 16:57:50.946805 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 16:57:50 crc kubenswrapper[5120]: I0316 16:57:50.947058 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ceilometer-internal-svc\"" Mar 16 16:57:50 crc kubenswrapper[5120]: I0316 16:57:50.947238 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 16:57:50 crc kubenswrapper[5120]: I0316 16:57:50.960199 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:57:51 crc kubenswrapper[5120]: I0316 16:57:51.017790 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7348dc0f-ed89-470c-97ec-da62dc768f28-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"7348dc0f-ed89-470c-97ec-da62dc768f28\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:57:51 crc kubenswrapper[5120]: I0316 16:57:51.017952 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/7348dc0f-ed89-470c-97ec-da62dc768f28-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"7348dc0f-ed89-470c-97ec-da62dc768f28\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:57:51 crc kubenswrapper[5120]: I0316 16:57:51.018002 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bc3dbeed-0812-4ece-b805-7408a7868f94-config-data\") pod \"glance-default-external-api-0\" (UID: \"bc3dbeed-0812-4ece-b805-7408a7868f94\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:57:51 crc kubenswrapper[5120]: I0316 16:57:51.018056 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7712130b-a000-4541-a1b1-7442adb622f7-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"7712130b-a000-4541-a1b1-7442adb622f7\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:57:51 crc kubenswrapper[5120]: I0316 16:57:51.018160 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/bc3dbeed-0812-4ece-b805-7408a7868f94-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"bc3dbeed-0812-4ece-b805-7408a7868f94\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:57:51 crc kubenswrapper[5120]: I0316 16:57:51.018190 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/bc3dbeed-0812-4ece-b805-7408a7868f94-scripts\") pod \"glance-default-external-api-0\" (UID: \"bc3dbeed-0812-4ece-b805-7408a7868f94\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:57:51 crc kubenswrapper[5120]: I0316 16:57:51.018226 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tncdv\" (UniqueName: \"kubernetes.io/projected/bc3dbeed-0812-4ece-b805-7408a7868f94-kube-api-access-tncdv\") pod \"glance-default-external-api-0\" (UID: \"bc3dbeed-0812-4ece-b805-7408a7868f94\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:57:51 crc kubenswrapper[5120]: I0316 16:57:51.018358 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5f7k\" (UniqueName: \"kubernetes.io/projected/7348dc0f-ed89-470c-97ec-da62dc768f28-kube-api-access-g5f7k\") pod \"ceilometer-0\" (UID: \"7348dc0f-ed89-470c-97ec-da62dc768f28\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:57:51 crc kubenswrapper[5120]: I0316 16:57:51.018490 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xg44\" (UniqueName: \"kubernetes.io/projected/7712130b-a000-4541-a1b1-7442adb622f7-kube-api-access-9xg44\") pod \"nova-cell0-conductor-0\" (UID: \"7712130b-a000-4541-a1b1-7442adb622f7\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:57:51 crc kubenswrapper[5120]: I0316 16:57:51.018525 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/bc3dbeed-0812-4ece-b805-7408a7868f94-logs\") pod \"glance-default-external-api-0\" (UID: \"bc3dbeed-0812-4ece-b805-7408a7868f94\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:57:51 crc kubenswrapper[5120]: I0316 16:57:51.018555 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7348dc0f-ed89-470c-97ec-da62dc768f28-config-data\") pod \"ceilometer-0\" (UID: \"7348dc0f-ed89-470c-97ec-da62dc768f28\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:57:51 crc kubenswrapper[5120]: I0316 16:57:51.018581 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bc3dbeed-0812-4ece-b805-7408a7868f94-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"bc3dbeed-0812-4ece-b805-7408a7868f94\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:57:51 crc kubenswrapper[5120]: I0316 16:57:51.018637 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7712130b-a000-4541-a1b1-7442adb622f7-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"7712130b-a000-4541-a1b1-7442adb622f7\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:57:51 crc kubenswrapper[5120]: I0316 16:57:51.018669 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7348dc0f-ed89-470c-97ec-da62dc768f28-run-httpd\") pod \"ceilometer-0\" (UID: \"7348dc0f-ed89-470c-97ec-da62dc768f28\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:57:51 crc kubenswrapper[5120]: I0316 16:57:51.018693 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/7348dc0f-ed89-470c-97ec-da62dc768f28-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"7348dc0f-ed89-470c-97ec-da62dc768f28\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:57:51 crc kubenswrapper[5120]: I0316 16:57:51.018722 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"glance-default-external-api-0\" (UID: \"bc3dbeed-0812-4ece-b805-7408a7868f94\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:57:51 crc kubenswrapper[5120]: I0316 16:57:51.018754 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7348dc0f-ed89-470c-97ec-da62dc768f28-log-httpd\") pod \"ceilometer-0\" (UID: \"7348dc0f-ed89-470c-97ec-da62dc768f28\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:57:51 crc kubenswrapper[5120]: I0316 16:57:51.018833 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/bc3dbeed-0812-4ece-b805-7408a7868f94-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"bc3dbeed-0812-4ece-b805-7408a7868f94\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:57:51 crc kubenswrapper[5120]: I0316 16:57:51.018902 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7348dc0f-ed89-470c-97ec-da62dc768f28-scripts\") pod \"ceilometer-0\" (UID: \"7348dc0f-ed89-470c-97ec-da62dc768f28\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:57:51 crc kubenswrapper[5120]: I0316 16:57:51.120573 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/bc3dbeed-0812-4ece-b805-7408a7868f94-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"bc3dbeed-0812-4ece-b805-7408a7868f94\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:57:51 crc kubenswrapper[5120]: I0316 16:57:51.120642 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7348dc0f-ed89-470c-97ec-da62dc768f28-scripts\") pod \"ceilometer-0\" (UID: \"7348dc0f-ed89-470c-97ec-da62dc768f28\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:57:51 crc kubenswrapper[5120]: I0316 16:57:51.120705 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7348dc0f-ed89-470c-97ec-da62dc768f28-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"7348dc0f-ed89-470c-97ec-da62dc768f28\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:57:51 crc kubenswrapper[5120]: I0316 16:57:51.121372 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/7348dc0f-ed89-470c-97ec-da62dc768f28-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"7348dc0f-ed89-470c-97ec-da62dc768f28\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:57:51 crc kubenswrapper[5120]: I0316 16:57:51.121398 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bc3dbeed-0812-4ece-b805-7408a7868f94-config-data\") pod \"glance-default-external-api-0\" (UID: \"bc3dbeed-0812-4ece-b805-7408a7868f94\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:57:51 crc kubenswrapper[5120]: I0316 16:57:51.121433 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7712130b-a000-4541-a1b1-7442adb622f7-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"7712130b-a000-4541-a1b1-7442adb622f7\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:57:51 crc kubenswrapper[5120]: I0316 16:57:51.121497 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/bc3dbeed-0812-4ece-b805-7408a7868f94-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"bc3dbeed-0812-4ece-b805-7408a7868f94\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:57:51 crc kubenswrapper[5120]: I0316 16:57:51.121521 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/bc3dbeed-0812-4ece-b805-7408a7868f94-scripts\") pod \"glance-default-external-api-0\" (UID: \"bc3dbeed-0812-4ece-b805-7408a7868f94\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:57:51 crc kubenswrapper[5120]: I0316 16:57:51.121550 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tncdv\" (UniqueName: \"kubernetes.io/projected/bc3dbeed-0812-4ece-b805-7408a7868f94-kube-api-access-tncdv\") pod \"glance-default-external-api-0\" (UID: \"bc3dbeed-0812-4ece-b805-7408a7868f94\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:57:51 crc kubenswrapper[5120]: I0316 16:57:51.121667 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g5f7k\" (UniqueName: \"kubernetes.io/projected/7348dc0f-ed89-470c-97ec-da62dc768f28-kube-api-access-g5f7k\") pod \"ceilometer-0\" (UID: \"7348dc0f-ed89-470c-97ec-da62dc768f28\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:57:51 crc kubenswrapper[5120]: I0316 16:57:51.121784 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9xg44\" (UniqueName: \"kubernetes.io/projected/7712130b-a000-4541-a1b1-7442adb622f7-kube-api-access-9xg44\") pod \"nova-cell0-conductor-0\" (UID: \"7712130b-a000-4541-a1b1-7442adb622f7\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:57:51 crc kubenswrapper[5120]: I0316 16:57:51.121820 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/bc3dbeed-0812-4ece-b805-7408a7868f94-logs\") pod \"glance-default-external-api-0\" (UID: \"bc3dbeed-0812-4ece-b805-7408a7868f94\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:57:51 crc kubenswrapper[5120]: I0316 16:57:51.121845 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7348dc0f-ed89-470c-97ec-da62dc768f28-config-data\") pod \"ceilometer-0\" (UID: \"7348dc0f-ed89-470c-97ec-da62dc768f28\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:57:51 crc kubenswrapper[5120]: I0316 16:57:51.121870 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bc3dbeed-0812-4ece-b805-7408a7868f94-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"bc3dbeed-0812-4ece-b805-7408a7868f94\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:57:51 crc kubenswrapper[5120]: I0316 16:57:51.121915 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7712130b-a000-4541-a1b1-7442adb622f7-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"7712130b-a000-4541-a1b1-7442adb622f7\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:57:51 crc kubenswrapper[5120]: I0316 16:57:51.121942 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7348dc0f-ed89-470c-97ec-da62dc768f28-run-httpd\") pod \"ceilometer-0\" (UID: \"7348dc0f-ed89-470c-97ec-da62dc768f28\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:57:51 crc kubenswrapper[5120]: I0316 16:57:51.121964 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/7348dc0f-ed89-470c-97ec-da62dc768f28-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"7348dc0f-ed89-470c-97ec-da62dc768f28\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:57:51 crc kubenswrapper[5120]: I0316 16:57:51.121989 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"glance-default-external-api-0\" (UID: \"bc3dbeed-0812-4ece-b805-7408a7868f94\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:57:51 crc kubenswrapper[5120]: I0316 16:57:51.122012 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7348dc0f-ed89-470c-97ec-da62dc768f28-log-httpd\") pod \"ceilometer-0\" (UID: \"7348dc0f-ed89-470c-97ec-da62dc768f28\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:57:51 crc kubenswrapper[5120]: I0316 16:57:51.122459 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7348dc0f-ed89-470c-97ec-da62dc768f28-log-httpd\") pod \"ceilometer-0\" (UID: \"7348dc0f-ed89-470c-97ec-da62dc768f28\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:57:51 crc kubenswrapper[5120]: I0316 16:57:51.122482 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/bc3dbeed-0812-4ece-b805-7408a7868f94-logs\") pod \"glance-default-external-api-0\" (UID: \"bc3dbeed-0812-4ece-b805-7408a7868f94\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:57:51 crc kubenswrapper[5120]: I0316 16:57:51.122733 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7348dc0f-ed89-470c-97ec-da62dc768f28-run-httpd\") pod \"ceilometer-0\" (UID: \"7348dc0f-ed89-470c-97ec-da62dc768f28\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:57:51 crc kubenswrapper[5120]: I0316 16:57:51.123189 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/bc3dbeed-0812-4ece-b805-7408a7868f94-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"bc3dbeed-0812-4ece-b805-7408a7868f94\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:57:51 crc kubenswrapper[5120]: I0316 16:57:51.124281 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"glance-default-external-api-0\" (UID: \"bc3dbeed-0812-4ece-b805-7408a7868f94\") device mount path \"/mnt/openstack/pv05\"" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:57:51 crc kubenswrapper[5120]: I0316 16:57:51.126054 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/7348dc0f-ed89-470c-97ec-da62dc768f28-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"7348dc0f-ed89-470c-97ec-da62dc768f28\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:57:51 crc kubenswrapper[5120]: I0316 16:57:51.127590 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/bc3dbeed-0812-4ece-b805-7408a7868f94-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"bc3dbeed-0812-4ece-b805-7408a7868f94\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:57:51 crc kubenswrapper[5120]: I0316 16:57:51.127793 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bc3dbeed-0812-4ece-b805-7408a7868f94-config-data\") pod \"glance-default-external-api-0\" (UID: \"bc3dbeed-0812-4ece-b805-7408a7868f94\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:57:51 crc kubenswrapper[5120]: I0316 16:57:51.127988 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/7348dc0f-ed89-470c-97ec-da62dc768f28-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"7348dc0f-ed89-470c-97ec-da62dc768f28\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:57:51 crc kubenswrapper[5120]: I0316 16:57:51.129371 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/bc3dbeed-0812-4ece-b805-7408a7868f94-scripts\") pod \"glance-default-external-api-0\" (UID: \"bc3dbeed-0812-4ece-b805-7408a7868f94\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:57:51 crc kubenswrapper[5120]: I0316 16:57:51.131250 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7348dc0f-ed89-470c-97ec-da62dc768f28-scripts\") pod \"ceilometer-0\" (UID: \"7348dc0f-ed89-470c-97ec-da62dc768f28\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:57:51 crc kubenswrapper[5120]: I0316 16:57:51.131608 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bc3dbeed-0812-4ece-b805-7408a7868f94-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"bc3dbeed-0812-4ece-b805-7408a7868f94\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:57:51 crc kubenswrapper[5120]: I0316 16:57:51.132870 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7712130b-a000-4541-a1b1-7442adb622f7-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"7712130b-a000-4541-a1b1-7442adb622f7\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:57:51 crc kubenswrapper[5120]: I0316 16:57:51.138090 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7348dc0f-ed89-470c-97ec-da62dc768f28-config-data\") pod \"ceilometer-0\" (UID: \"7348dc0f-ed89-470c-97ec-da62dc768f28\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:57:51 crc kubenswrapper[5120]: I0316 16:57:51.142732 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7712130b-a000-4541-a1b1-7442adb622f7-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"7712130b-a000-4541-a1b1-7442adb622f7\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:57:51 crc kubenswrapper[5120]: I0316 16:57:51.143306 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5f7k\" (UniqueName: \"kubernetes.io/projected/7348dc0f-ed89-470c-97ec-da62dc768f28-kube-api-access-g5f7k\") pod \"ceilometer-0\" (UID: \"7348dc0f-ed89-470c-97ec-da62dc768f28\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:57:51 crc kubenswrapper[5120]: I0316 16:57:51.144999 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7348dc0f-ed89-470c-97ec-da62dc768f28-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"7348dc0f-ed89-470c-97ec-da62dc768f28\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:57:51 crc kubenswrapper[5120]: I0316 16:57:51.150688 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tncdv\" (UniqueName: \"kubernetes.io/projected/bc3dbeed-0812-4ece-b805-7408a7868f94-kube-api-access-tncdv\") pod \"glance-default-external-api-0\" (UID: \"bc3dbeed-0812-4ece-b805-7408a7868f94\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:57:51 crc kubenswrapper[5120]: I0316 16:57:51.152887 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xg44\" (UniqueName: \"kubernetes.io/projected/7712130b-a000-4541-a1b1-7442adb622f7-kube-api-access-9xg44\") pod \"nova-cell0-conductor-0\" (UID: \"7712130b-a000-4541-a1b1-7442adb622f7\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:57:51 crc kubenswrapper[5120]: I0316 16:57:51.170863 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"glance-default-external-api-0\" (UID: \"bc3dbeed-0812-4ece-b805-7408a7868f94\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:57:51 crc kubenswrapper[5120]: I0316 16:57:51.224680 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:57:51 crc kubenswrapper[5120]: I0316 16:57:51.272339 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:57:51 crc kubenswrapper[5120]: I0316 16:57:51.289715 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:57:51 crc kubenswrapper[5120]: I0316 16:57:51.735427 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 16:57:51 crc kubenswrapper[5120]: W0316 16:57:51.740727 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7712130b_a000_4541_a1b1_7442adb622f7.slice/crio-9cbdaa981208594d3f444bc5686c9714e130e99226ae4db00aa1bc722af7dcbf WatchSource:0}: Error finding container 9cbdaa981208594d3f444bc5686c9714e130e99226ae4db00aa1bc722af7dcbf: Status 404 returned error can't find the container with id 9cbdaa981208594d3f444bc5686c9714e130e99226ae4db00aa1bc722af7dcbf Mar 16 16:57:51 crc kubenswrapper[5120]: I0316 16:57:51.822801 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 16:57:51 crc kubenswrapper[5120]: I0316 16:57:51.824330 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"7712130b-a000-4541-a1b1-7442adb622f7","Type":"ContainerStarted","Data":"9cbdaa981208594d3f444bc5686c9714e130e99226ae4db00aa1bc722af7dcbf"} Mar 16 16:57:51 crc kubenswrapper[5120]: W0316 16:57:51.829294 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbc3dbeed_0812_4ece_b805_7408a7868f94.slice/crio-6e6d885ee712bc9f5b3d14aa2236c8c0c3aab39726b6de818a72eca6ce303939 WatchSource:0}: Error finding container 6e6d885ee712bc9f5b3d14aa2236c8c0c3aab39726b6de818a72eca6ce303939: Status 404 returned error can't find the container with id 6e6d885ee712bc9f5b3d14aa2236c8c0c3aab39726b6de818a72eca6ce303939 Mar 16 16:57:51 crc kubenswrapper[5120]: I0316 16:57:51.916290 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:57:51 crc kubenswrapper[5120]: W0316 16:57:51.919164 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7348dc0f_ed89_470c_97ec_da62dc768f28.slice/crio-b45843e5b34623ddf1a04c24acbb31c2665b23f3134775492a49e7e6c3448c83 WatchSource:0}: Error finding container b45843e5b34623ddf1a04c24acbb31c2665b23f3134775492a49e7e6c3448c83: Status 404 returned error can't find the container with id b45843e5b34623ddf1a04c24acbb31c2665b23f3134775492a49e7e6c3448c83 Mar 16 16:57:52 crc kubenswrapper[5120]: I0316 16:57:52.677565 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c74d3951-cd09-4371-9984-c1e3f863c826" path="/var/lib/kubelet/pods/c74d3951-cd09-4371-9984-c1e3f863c826/volumes" Mar 16 16:57:52 crc kubenswrapper[5120]: I0316 16:57:52.679226 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc34c11e-3278-4e46-94e1-7cb991fe4591" path="/var/lib/kubelet/pods/dc34c11e-3278-4e46-94e1-7cb991fe4591/volumes" Mar 16 16:57:52 crc kubenswrapper[5120]: I0316 16:57:52.751251 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:57:52 crc kubenswrapper[5120]: I0316 16:57:52.863442 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"bc3dbeed-0812-4ece-b805-7408a7868f94","Type":"ContainerStarted","Data":"397ff88ea2eae604377585921ebbaff09e18274622110377c820fff687461187"} Mar 16 16:57:52 crc kubenswrapper[5120]: I0316 16:57:52.863518 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"bc3dbeed-0812-4ece-b805-7408a7868f94","Type":"ContainerStarted","Data":"6e6d885ee712bc9f5b3d14aa2236c8c0c3aab39726b6de818a72eca6ce303939"} Mar 16 16:57:52 crc kubenswrapper[5120]: I0316 16:57:52.866719 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"7712130b-a000-4541-a1b1-7442adb622f7","Type":"ContainerStarted","Data":"b42f7912bd0af5cc7eea7bbb672d44c2af34ef4c9686f59f00ea55d40951315a"} Mar 16 16:57:52 crc kubenswrapper[5120]: I0316 16:57:52.866842 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:57:52 crc kubenswrapper[5120]: I0316 16:57:52.880393 5120 generic.go:358] "Generic (PLEG): container finished" podID="7870ec2c-0344-4cfe-bc6d-4bca0c11ba52" containerID="2b0e138b699773308041579cd1e212fad18c455eefe44c13b906ab063bee536b" exitCode=0 Mar 16 16:57:52 crc kubenswrapper[5120]: I0316 16:57:52.880710 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"7870ec2c-0344-4cfe-bc6d-4bca0c11ba52","Type":"ContainerDied","Data":"2b0e138b699773308041579cd1e212fad18c455eefe44c13b906ab063bee536b"} Mar 16 16:57:52 crc kubenswrapper[5120]: I0316 16:57:52.880753 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"7870ec2c-0344-4cfe-bc6d-4bca0c11ba52","Type":"ContainerDied","Data":"d3882c03cfdfb341872e930e52c528f309fd5430ec14aced426bd629db7c3fec"} Mar 16 16:57:52 crc kubenswrapper[5120]: I0316 16:57:52.880799 5120 scope.go:117] "RemoveContainer" containerID="2b0e138b699773308041579cd1e212fad18c455eefe44c13b906ab063bee536b" Mar 16 16:57:52 crc kubenswrapper[5120]: I0316 16:57:52.881048 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:57:52 crc kubenswrapper[5120]: I0316 16:57:52.884044 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7870ec2c-0344-4cfe-bc6d-4bca0c11ba52-config-data\") pod \"7870ec2c-0344-4cfe-bc6d-4bca0c11ba52\" (UID: \"7870ec2c-0344-4cfe-bc6d-4bca0c11ba52\") " Mar 16 16:57:52 crc kubenswrapper[5120]: I0316 16:57:52.884566 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7870ec2c-0344-4cfe-bc6d-4bca0c11ba52-logs\") pod \"7870ec2c-0344-4cfe-bc6d-4bca0c11ba52\" (UID: \"7870ec2c-0344-4cfe-bc6d-4bca0c11ba52\") " Mar 16 16:57:52 crc kubenswrapper[5120]: I0316 16:57:52.884611 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7870ec2c-0344-4cfe-bc6d-4bca0c11ba52-combined-ca-bundle\") pod \"7870ec2c-0344-4cfe-bc6d-4bca0c11ba52\" (UID: \"7870ec2c-0344-4cfe-bc6d-4bca0c11ba52\") " Mar 16 16:57:52 crc kubenswrapper[5120]: I0316 16:57:52.884793 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"7870ec2c-0344-4cfe-bc6d-4bca0c11ba52\" (UID: \"7870ec2c-0344-4cfe-bc6d-4bca0c11ba52\") " Mar 16 16:57:52 crc kubenswrapper[5120]: I0316 16:57:52.884976 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/7870ec2c-0344-4cfe-bc6d-4bca0c11ba52-internal-tls-certs\") pod \"7870ec2c-0344-4cfe-bc6d-4bca0c11ba52\" (UID: \"7870ec2c-0344-4cfe-bc6d-4bca0c11ba52\") " Mar 16 16:57:52 crc kubenswrapper[5120]: I0316 16:57:52.885220 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/7870ec2c-0344-4cfe-bc6d-4bca0c11ba52-httpd-run\") pod \"7870ec2c-0344-4cfe-bc6d-4bca0c11ba52\" (UID: \"7870ec2c-0344-4cfe-bc6d-4bca0c11ba52\") " Mar 16 16:57:52 crc kubenswrapper[5120]: I0316 16:57:52.885281 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7870ec2c-0344-4cfe-bc6d-4bca0c11ba52-scripts\") pod \"7870ec2c-0344-4cfe-bc6d-4bca0c11ba52\" (UID: \"7870ec2c-0344-4cfe-bc6d-4bca0c11ba52\") " Mar 16 16:57:52 crc kubenswrapper[5120]: I0316 16:57:52.885367 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jtrg7\" (UniqueName: \"kubernetes.io/projected/7870ec2c-0344-4cfe-bc6d-4bca0c11ba52-kube-api-access-jtrg7\") pod \"7870ec2c-0344-4cfe-bc6d-4bca0c11ba52\" (UID: \"7870ec2c-0344-4cfe-bc6d-4bca0c11ba52\") " Mar 16 16:57:52 crc kubenswrapper[5120]: I0316 16:57:52.886174 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7870ec2c-0344-4cfe-bc6d-4bca0c11ba52-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "7870ec2c-0344-4cfe-bc6d-4bca0c11ba52" (UID: "7870ec2c-0344-4cfe-bc6d-4bca0c11ba52"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:57:52 crc kubenswrapper[5120]: I0316 16:57:52.886668 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7870ec2c-0344-4cfe-bc6d-4bca0c11ba52-logs" (OuterVolumeSpecName: "logs") pod "7870ec2c-0344-4cfe-bc6d-4bca0c11ba52" (UID: "7870ec2c-0344-4cfe-bc6d-4bca0c11ba52"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:57:52 crc kubenswrapper[5120]: I0316 16:57:52.890464 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/7870ec2c-0344-4cfe-bc6d-4bca0c11ba52-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 16:57:52 crc kubenswrapper[5120]: I0316 16:57:52.890518 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7870ec2c-0344-4cfe-bc6d-4bca0c11ba52-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:57:52 crc kubenswrapper[5120]: I0316 16:57:52.890607 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podStartSLOduration=2.890589288 podStartE2EDuration="2.890589288s" podCreationTimestamp="2026-03-16 16:57:50 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:57:52.889310033 +0000 UTC m=+5175.043241690" watchObservedRunningTime="2026-03-16 16:57:52.890589288 +0000 UTC m=+5175.044520955" Mar 16 16:57:52 crc kubenswrapper[5120]: I0316 16:57:52.900246 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7870ec2c-0344-4cfe-bc6d-4bca0c11ba52-scripts" (OuterVolumeSpecName: "scripts") pod "7870ec2c-0344-4cfe-bc6d-4bca0c11ba52" (UID: "7870ec2c-0344-4cfe-bc6d-4bca0c11ba52"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:57:52 crc kubenswrapper[5120]: I0316 16:57:52.901148 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage06-crc" (OuterVolumeSpecName: "glance") pod "7870ec2c-0344-4cfe-bc6d-4bca0c11ba52" (UID: "7870ec2c-0344-4cfe-bc6d-4bca0c11ba52"). InnerVolumeSpecName "local-storage06-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 16:57:52 crc kubenswrapper[5120]: I0316 16:57:52.901266 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7348dc0f-ed89-470c-97ec-da62dc768f28","Type":"ContainerStarted","Data":"b45843e5b34623ddf1a04c24acbb31c2665b23f3134775492a49e7e6c3448c83"} Mar 16 16:57:52 crc kubenswrapper[5120]: I0316 16:57:52.912141 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7870ec2c-0344-4cfe-bc6d-4bca0c11ba52-kube-api-access-jtrg7" (OuterVolumeSpecName: "kube-api-access-jtrg7") pod "7870ec2c-0344-4cfe-bc6d-4bca0c11ba52" (UID: "7870ec2c-0344-4cfe-bc6d-4bca0c11ba52"). InnerVolumeSpecName "kube-api-access-jtrg7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:57:52 crc kubenswrapper[5120]: I0316 16:57:52.932367 5120 scope.go:117] "RemoveContainer" containerID="eb3962f919d594f5a3959a34cacc52d4dc41c8dc91044b096eab14d5a2f0033b" Mar 16 16:57:52 crc kubenswrapper[5120]: I0316 16:57:52.932512 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7870ec2c-0344-4cfe-bc6d-4bca0c11ba52-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "7870ec2c-0344-4cfe-bc6d-4bca0c11ba52" (UID: "7870ec2c-0344-4cfe-bc6d-4bca0c11ba52"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:57:52 crc kubenswrapper[5120]: I0316 16:57:52.961031 5120 scope.go:117] "RemoveContainer" containerID="2b0e138b699773308041579cd1e212fad18c455eefe44c13b906ab063bee536b" Mar 16 16:57:52 crc kubenswrapper[5120]: E0316 16:57:52.962180 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b0e138b699773308041579cd1e212fad18c455eefe44c13b906ab063bee536b\": container with ID starting with 2b0e138b699773308041579cd1e212fad18c455eefe44c13b906ab063bee536b not found: ID does not exist" containerID="2b0e138b699773308041579cd1e212fad18c455eefe44c13b906ab063bee536b" Mar 16 16:57:52 crc kubenswrapper[5120]: I0316 16:57:52.962240 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b0e138b699773308041579cd1e212fad18c455eefe44c13b906ab063bee536b"} err="failed to get container status \"2b0e138b699773308041579cd1e212fad18c455eefe44c13b906ab063bee536b\": rpc error: code = NotFound desc = could not find container \"2b0e138b699773308041579cd1e212fad18c455eefe44c13b906ab063bee536b\": container with ID starting with 2b0e138b699773308041579cd1e212fad18c455eefe44c13b906ab063bee536b not found: ID does not exist" Mar 16 16:57:52 crc kubenswrapper[5120]: I0316 16:57:52.962270 5120 scope.go:117] "RemoveContainer" containerID="eb3962f919d594f5a3959a34cacc52d4dc41c8dc91044b096eab14d5a2f0033b" Mar 16 16:57:52 crc kubenswrapper[5120]: E0316 16:57:52.963307 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb3962f919d594f5a3959a34cacc52d4dc41c8dc91044b096eab14d5a2f0033b\": container with ID starting with eb3962f919d594f5a3959a34cacc52d4dc41c8dc91044b096eab14d5a2f0033b not found: ID does not exist" containerID="eb3962f919d594f5a3959a34cacc52d4dc41c8dc91044b096eab14d5a2f0033b" Mar 16 16:57:52 crc kubenswrapper[5120]: I0316 16:57:52.963355 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb3962f919d594f5a3959a34cacc52d4dc41c8dc91044b096eab14d5a2f0033b"} err="failed to get container status \"eb3962f919d594f5a3959a34cacc52d4dc41c8dc91044b096eab14d5a2f0033b\": rpc error: code = NotFound desc = could not find container \"eb3962f919d594f5a3959a34cacc52d4dc41c8dc91044b096eab14d5a2f0033b\": container with ID starting with eb3962f919d594f5a3959a34cacc52d4dc41c8dc91044b096eab14d5a2f0033b not found: ID does not exist" Mar 16 16:57:52 crc kubenswrapper[5120]: I0316 16:57:52.963921 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7870ec2c-0344-4cfe-bc6d-4bca0c11ba52-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "7870ec2c-0344-4cfe-bc6d-4bca0c11ba52" (UID: "7870ec2c-0344-4cfe-bc6d-4bca0c11ba52"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:57:52 crc kubenswrapper[5120]: I0316 16:57:52.971960 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7870ec2c-0344-4cfe-bc6d-4bca0c11ba52-config-data" (OuterVolumeSpecName: "config-data") pod "7870ec2c-0344-4cfe-bc6d-4bca0c11ba52" (UID: "7870ec2c-0344-4cfe-bc6d-4bca0c11ba52"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:57:52 crc kubenswrapper[5120]: I0316 16:57:52.995437 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7870ec2c-0344-4cfe-bc6d-4bca0c11ba52-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:57:52 crc kubenswrapper[5120]: I0316 16:57:52.995500 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") on node \"crc\" " Mar 16 16:57:52 crc kubenswrapper[5120]: I0316 16:57:52.996362 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/7870ec2c-0344-4cfe-bc6d-4bca0c11ba52-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:57:52 crc kubenswrapper[5120]: I0316 16:57:52.996405 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7870ec2c-0344-4cfe-bc6d-4bca0c11ba52-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:57:52 crc kubenswrapper[5120]: I0316 16:57:52.996422 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jtrg7\" (UniqueName: \"kubernetes.io/projected/7870ec2c-0344-4cfe-bc6d-4bca0c11ba52-kube-api-access-jtrg7\") on node \"crc\" DevicePath \"\"" Mar 16 16:57:52 crc kubenswrapper[5120]: I0316 16:57:52.996436 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7870ec2c-0344-4cfe-bc6d-4bca0c11ba52-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:57:53 crc kubenswrapper[5120]: I0316 16:57:53.026112 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage06-crc" (UniqueName: "kubernetes.io/local-volume/local-storage06-crc") on node "crc" Mar 16 16:57:53 crc kubenswrapper[5120]: I0316 16:57:53.099688 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") on node \"crc\" DevicePath \"\"" Mar 16 16:57:53 crc kubenswrapper[5120]: I0316 16:57:53.274136 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:57:53 crc kubenswrapper[5120]: I0316 16:57:53.284314 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:57:53 crc kubenswrapper[5120]: I0316 16:57:53.302805 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:57:53 crc kubenswrapper[5120]: I0316 16:57:53.303943 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7870ec2c-0344-4cfe-bc6d-4bca0c11ba52" containerName="glance-httpd" Mar 16 16:57:53 crc kubenswrapper[5120]: I0316 16:57:53.303968 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7870ec2c-0344-4cfe-bc6d-4bca0c11ba52" containerName="glance-httpd" Mar 16 16:57:53 crc kubenswrapper[5120]: I0316 16:57:53.304019 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7870ec2c-0344-4cfe-bc6d-4bca0c11ba52" containerName="glance-log" Mar 16 16:57:53 crc kubenswrapper[5120]: I0316 16:57:53.304028 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7870ec2c-0344-4cfe-bc6d-4bca0c11ba52" containerName="glance-log" Mar 16 16:57:53 crc kubenswrapper[5120]: I0316 16:57:53.304257 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7870ec2c-0344-4cfe-bc6d-4bca0c11ba52" containerName="glance-httpd" Mar 16 16:57:53 crc kubenswrapper[5120]: I0316 16:57:53.304285 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7870ec2c-0344-4cfe-bc6d-4bca0c11ba52" containerName="glance-log" Mar 16 16:57:53 crc kubenswrapper[5120]: I0316 16:57:53.315620 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:57:53 crc kubenswrapper[5120]: I0316 16:57:53.321416 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-internal-config-data\"" Mar 16 16:57:53 crc kubenswrapper[5120]: I0316 16:57:53.321591 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-internal-svc\"" Mar 16 16:57:53 crc kubenswrapper[5120]: I0316 16:57:53.326390 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:57:53 crc kubenswrapper[5120]: I0316 16:57:53.406804 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/532eee6f-6605-4581-80a2-d8c6061bf84a-scripts\") pod \"glance-default-internal-api-0\" (UID: \"532eee6f-6605-4581-80a2-d8c6061bf84a\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:57:53 crc kubenswrapper[5120]: I0316 16:57:53.406909 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"glance-default-internal-api-0\" (UID: \"532eee6f-6605-4581-80a2-d8c6061bf84a\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:57:53 crc kubenswrapper[5120]: I0316 16:57:53.407221 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/532eee6f-6605-4581-80a2-d8c6061bf84a-config-data\") pod \"glance-default-internal-api-0\" (UID: \"532eee6f-6605-4581-80a2-d8c6061bf84a\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:57:53 crc kubenswrapper[5120]: I0316 16:57:53.407268 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/532eee6f-6605-4581-80a2-d8c6061bf84a-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"532eee6f-6605-4581-80a2-d8c6061bf84a\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:57:53 crc kubenswrapper[5120]: I0316 16:57:53.407478 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/532eee6f-6605-4581-80a2-d8c6061bf84a-logs\") pod \"glance-default-internal-api-0\" (UID: \"532eee6f-6605-4581-80a2-d8c6061bf84a\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:57:53 crc kubenswrapper[5120]: I0316 16:57:53.407579 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/532eee6f-6605-4581-80a2-d8c6061bf84a-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"532eee6f-6605-4581-80a2-d8c6061bf84a\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:57:53 crc kubenswrapper[5120]: I0316 16:57:53.407627 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/532eee6f-6605-4581-80a2-d8c6061bf84a-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"532eee6f-6605-4581-80a2-d8c6061bf84a\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:57:53 crc kubenswrapper[5120]: I0316 16:57:53.407711 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdtn2\" (UniqueName: \"kubernetes.io/projected/532eee6f-6605-4581-80a2-d8c6061bf84a-kube-api-access-kdtn2\") pod \"glance-default-internal-api-0\" (UID: \"532eee6f-6605-4581-80a2-d8c6061bf84a\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:57:53 crc kubenswrapper[5120]: I0316 16:57:53.510152 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/532eee6f-6605-4581-80a2-d8c6061bf84a-config-data\") pod \"glance-default-internal-api-0\" (UID: \"532eee6f-6605-4581-80a2-d8c6061bf84a\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:57:53 crc kubenswrapper[5120]: I0316 16:57:53.510489 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/532eee6f-6605-4581-80a2-d8c6061bf84a-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"532eee6f-6605-4581-80a2-d8c6061bf84a\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:57:53 crc kubenswrapper[5120]: I0316 16:57:53.510606 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/532eee6f-6605-4581-80a2-d8c6061bf84a-logs\") pod \"glance-default-internal-api-0\" (UID: \"532eee6f-6605-4581-80a2-d8c6061bf84a\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:57:53 crc kubenswrapper[5120]: I0316 16:57:53.510673 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/532eee6f-6605-4581-80a2-d8c6061bf84a-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"532eee6f-6605-4581-80a2-d8c6061bf84a\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:57:53 crc kubenswrapper[5120]: I0316 16:57:53.510915 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/532eee6f-6605-4581-80a2-d8c6061bf84a-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"532eee6f-6605-4581-80a2-d8c6061bf84a\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:57:53 crc kubenswrapper[5120]: I0316 16:57:53.511025 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kdtn2\" (UniqueName: \"kubernetes.io/projected/532eee6f-6605-4581-80a2-d8c6061bf84a-kube-api-access-kdtn2\") pod \"glance-default-internal-api-0\" (UID: \"532eee6f-6605-4581-80a2-d8c6061bf84a\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:57:53 crc kubenswrapper[5120]: I0316 16:57:53.511157 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/532eee6f-6605-4581-80a2-d8c6061bf84a-scripts\") pod \"glance-default-internal-api-0\" (UID: \"532eee6f-6605-4581-80a2-d8c6061bf84a\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:57:53 crc kubenswrapper[5120]: I0316 16:57:53.511263 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"glance-default-internal-api-0\" (UID: \"532eee6f-6605-4581-80a2-d8c6061bf84a\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:57:53 crc kubenswrapper[5120]: I0316 16:57:53.511687 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/532eee6f-6605-4581-80a2-d8c6061bf84a-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"532eee6f-6605-4581-80a2-d8c6061bf84a\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:57:53 crc kubenswrapper[5120]: I0316 16:57:53.511964 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/532eee6f-6605-4581-80a2-d8c6061bf84a-logs\") pod \"glance-default-internal-api-0\" (UID: \"532eee6f-6605-4581-80a2-d8c6061bf84a\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:57:53 crc kubenswrapper[5120]: I0316 16:57:53.513564 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"glance-default-internal-api-0\" (UID: \"532eee6f-6605-4581-80a2-d8c6061bf84a\") device mount path \"/mnt/openstack/pv06\"" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:57:53 crc kubenswrapper[5120]: I0316 16:57:53.516579 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/532eee6f-6605-4581-80a2-d8c6061bf84a-scripts\") pod \"glance-default-internal-api-0\" (UID: \"532eee6f-6605-4581-80a2-d8c6061bf84a\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:57:53 crc kubenswrapper[5120]: I0316 16:57:53.517825 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/532eee6f-6605-4581-80a2-d8c6061bf84a-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"532eee6f-6605-4581-80a2-d8c6061bf84a\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:57:53 crc kubenswrapper[5120]: I0316 16:57:53.525590 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/532eee6f-6605-4581-80a2-d8c6061bf84a-config-data\") pod \"glance-default-internal-api-0\" (UID: \"532eee6f-6605-4581-80a2-d8c6061bf84a\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:57:53 crc kubenswrapper[5120]: I0316 16:57:53.527844 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/532eee6f-6605-4581-80a2-d8c6061bf84a-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"532eee6f-6605-4581-80a2-d8c6061bf84a\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:57:53 crc kubenswrapper[5120]: I0316 16:57:53.528731 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdtn2\" (UniqueName: \"kubernetes.io/projected/532eee6f-6605-4581-80a2-d8c6061bf84a-kube-api-access-kdtn2\") pod \"glance-default-internal-api-0\" (UID: \"532eee6f-6605-4581-80a2-d8c6061bf84a\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:57:53 crc kubenswrapper[5120]: I0316 16:57:53.563996 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"glance-default-internal-api-0\" (UID: \"532eee6f-6605-4581-80a2-d8c6061bf84a\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:57:53 crc kubenswrapper[5120]: I0316 16:57:53.651148 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:57:53 crc kubenswrapper[5120]: I0316 16:57:53.923737 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7348dc0f-ed89-470c-97ec-da62dc768f28","Type":"ContainerStarted","Data":"641130851f0b0c5f171466524ed9034bf6b465af28f758759338907cdda785bb"} Mar 16 16:57:53 crc kubenswrapper[5120]: I0316 16:57:53.924320 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7348dc0f-ed89-470c-97ec-da62dc768f28","Type":"ContainerStarted","Data":"ea44b41e8ca11eb5672204294dd5323ea44d0127d140ef370b6812f4428d16d0"} Mar 16 16:57:53 crc kubenswrapper[5120]: I0316 16:57:53.928263 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"bc3dbeed-0812-4ece-b805-7408a7868f94","Type":"ContainerStarted","Data":"da6751457801480c486418b96b45b4721dffdf69ace0d9d360a1f4dc4bc9ab5d"} Mar 16 16:57:53 crc kubenswrapper[5120]: I0316 16:57:53.955701 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-external-api-0" podStartSLOduration=3.955679311 podStartE2EDuration="3.955679311s" podCreationTimestamp="2026-03-16 16:57:50 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:57:53.949495532 +0000 UTC m=+5176.103427209" watchObservedRunningTime="2026-03-16 16:57:53.955679311 +0000 UTC m=+5176.109610968" Mar 16 16:57:54 crc kubenswrapper[5120]: I0316 16:57:54.118500 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 16:57:54 crc kubenswrapper[5120]: W0316 16:57:54.118809 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod532eee6f_6605_4581_80a2_d8c6061bf84a.slice/crio-3e98f77e907cb64682260c90ea81a1a04105aae8c4e77884f21cac47128e776e WatchSource:0}: Error finding container 3e98f77e907cb64682260c90ea81a1a04105aae8c4e77884f21cac47128e776e: Status 404 returned error can't find the container with id 3e98f77e907cb64682260c90ea81a1a04105aae8c4e77884f21cac47128e776e Mar 16 16:57:54 crc kubenswrapper[5120]: I0316 16:57:54.673874 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7870ec2c-0344-4cfe-bc6d-4bca0c11ba52" path="/var/lib/kubelet/pods/7870ec2c-0344-4cfe-bc6d-4bca0c11ba52/volumes" Mar 16 16:57:54 crc kubenswrapper[5120]: I0316 16:57:54.942668 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7348dc0f-ed89-470c-97ec-da62dc768f28","Type":"ContainerStarted","Data":"622f134c3a00e3c1f2e6f3832a2a2850dde6f581c1096f0b6008a1415dc2abf5"} Mar 16 16:57:54 crc kubenswrapper[5120]: I0316 16:57:54.947135 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"532eee6f-6605-4581-80a2-d8c6061bf84a","Type":"ContainerStarted","Data":"19d677cabef5c32207ea90684cf888f271b1d4ce284d04a3263cec9573a4201a"} Mar 16 16:57:54 crc kubenswrapper[5120]: I0316 16:57:54.947220 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"532eee6f-6605-4581-80a2-d8c6061bf84a","Type":"ContainerStarted","Data":"3e98f77e907cb64682260c90ea81a1a04105aae8c4e77884f21cac47128e776e"} Mar 16 16:57:55 crc kubenswrapper[5120]: I0316 16:57:55.960084 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"532eee6f-6605-4581-80a2-d8c6061bf84a","Type":"ContainerStarted","Data":"ebd80c70407524a39e410e1783924d3bd9a4f9eeab19b26208422ea92da963b3"} Mar 16 16:57:55 crc kubenswrapper[5120]: I0316 16:57:55.989582 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-internal-api-0" podStartSLOduration=2.98955978 podStartE2EDuration="2.98955978s" podCreationTimestamp="2026-03-16 16:57:53 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:57:55.980183143 +0000 UTC m=+5178.134114810" watchObservedRunningTime="2026-03-16 16:57:55.98955978 +0000 UTC m=+5178.143491437" Mar 16 16:57:56 crc kubenswrapper[5120]: I0316 16:57:56.971222 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7348dc0f-ed89-470c-97ec-da62dc768f28","Type":"ContainerStarted","Data":"bdfafeacf4801305d93baa38662ee145caa7a4e6d8fc31d0d47569a7b4588276"} Mar 16 16:57:56 crc kubenswrapper[5120]: I0316 16:57:56.971567 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:57:57 crc kubenswrapper[5120]: I0316 16:57:57.003286 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.535881921 podStartE2EDuration="7.003267956s" podCreationTimestamp="2026-03-16 16:57:50 +0000 UTC" firstStartedPulling="2026-03-16 16:57:51.922124561 +0000 UTC m=+5174.076056218" lastFinishedPulling="2026-03-16 16:57:56.389510596 +0000 UTC m=+5178.543442253" observedRunningTime="2026-03-16 16:57:56.994530446 +0000 UTC m=+5179.148462103" watchObservedRunningTime="2026-03-16 16:57:57.003267956 +0000 UTC m=+5179.157199613" Mar 16 16:57:57 crc kubenswrapper[5120]: I0316 16:57:57.663954 5120 scope.go:117] "RemoveContainer" containerID="083f72646c8d47c9c0467b39be99ddfa9c2e5900ae0a29ad53d7b39b950274b4" Mar 16 16:57:57 crc kubenswrapper[5120]: E0316 16:57:57.664548 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:57:58 crc kubenswrapper[5120]: I0316 16:57:58.961366 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 16:57:59 crc kubenswrapper[5120]: I0316 16:57:59.401273 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-gz7fl"] Mar 16 16:57:59 crc kubenswrapper[5120]: I0316 16:57:59.429702 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-gz7fl"] Mar 16 16:57:59 crc kubenswrapper[5120]: I0316 16:57:59.431020 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-gz7fl" Mar 16 16:57:59 crc kubenswrapper[5120]: I0316 16:57:59.442531 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-manage-config-data\"" Mar 16 16:57:59 crc kubenswrapper[5120]: I0316 16:57:59.443254 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-manage-scripts\"" Mar 16 16:57:59 crc kubenswrapper[5120]: I0316 16:57:59.475821 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ffde2e4f-11b6-4b41-8953-bca4be87a2bd-scripts\") pod \"nova-cell0-cell-mapping-gz7fl\" (UID: \"ffde2e4f-11b6-4b41-8953-bca4be87a2bd\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-gz7fl" Mar 16 16:57:59 crc kubenswrapper[5120]: I0316 16:57:59.475963 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ffde2e4f-11b6-4b41-8953-bca4be87a2bd-combined-ca-bundle\") pod \"nova-cell0-cell-mapping-gz7fl\" (UID: \"ffde2e4f-11b6-4b41-8953-bca4be87a2bd\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-gz7fl" Mar 16 16:57:59 crc kubenswrapper[5120]: I0316 16:57:59.476235 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ffde2e4f-11b6-4b41-8953-bca4be87a2bd-config-data\") pod \"nova-cell0-cell-mapping-gz7fl\" (UID: \"ffde2e4f-11b6-4b41-8953-bca4be87a2bd\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-gz7fl" Mar 16 16:57:59 crc kubenswrapper[5120]: I0316 16:57:59.476362 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q96fd\" (UniqueName: \"kubernetes.io/projected/ffde2e4f-11b6-4b41-8953-bca4be87a2bd-kube-api-access-q96fd\") pod \"nova-cell0-cell-mapping-gz7fl\" (UID: \"ffde2e4f-11b6-4b41-8953-bca4be87a2bd\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-gz7fl" Mar 16 16:57:59 crc kubenswrapper[5120]: I0316 16:57:59.587789 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q96fd\" (UniqueName: \"kubernetes.io/projected/ffde2e4f-11b6-4b41-8953-bca4be87a2bd-kube-api-access-q96fd\") pod \"nova-cell0-cell-mapping-gz7fl\" (UID: \"ffde2e4f-11b6-4b41-8953-bca4be87a2bd\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-gz7fl" Mar 16 16:57:59 crc kubenswrapper[5120]: I0316 16:57:59.587958 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ffde2e4f-11b6-4b41-8953-bca4be87a2bd-scripts\") pod \"nova-cell0-cell-mapping-gz7fl\" (UID: \"ffde2e4f-11b6-4b41-8953-bca4be87a2bd\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-gz7fl" Mar 16 16:57:59 crc kubenswrapper[5120]: I0316 16:57:59.588050 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ffde2e4f-11b6-4b41-8953-bca4be87a2bd-combined-ca-bundle\") pod \"nova-cell0-cell-mapping-gz7fl\" (UID: \"ffde2e4f-11b6-4b41-8953-bca4be87a2bd\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-gz7fl" Mar 16 16:57:59 crc kubenswrapper[5120]: I0316 16:57:59.588160 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ffde2e4f-11b6-4b41-8953-bca4be87a2bd-config-data\") pod \"nova-cell0-cell-mapping-gz7fl\" (UID: \"ffde2e4f-11b6-4b41-8953-bca4be87a2bd\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-gz7fl" Mar 16 16:57:59 crc kubenswrapper[5120]: I0316 16:57:59.596058 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ffde2e4f-11b6-4b41-8953-bca4be87a2bd-scripts\") pod \"nova-cell0-cell-mapping-gz7fl\" (UID: \"ffde2e4f-11b6-4b41-8953-bca4be87a2bd\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-gz7fl" Mar 16 16:57:59 crc kubenswrapper[5120]: I0316 16:57:59.604464 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ffde2e4f-11b6-4b41-8953-bca4be87a2bd-config-data\") pod \"nova-cell0-cell-mapping-gz7fl\" (UID: \"ffde2e4f-11b6-4b41-8953-bca4be87a2bd\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-gz7fl" Mar 16 16:57:59 crc kubenswrapper[5120]: I0316 16:57:59.606107 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ffde2e4f-11b6-4b41-8953-bca4be87a2bd-combined-ca-bundle\") pod \"nova-cell0-cell-mapping-gz7fl\" (UID: \"ffde2e4f-11b6-4b41-8953-bca4be87a2bd\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-gz7fl" Mar 16 16:57:59 crc kubenswrapper[5120]: I0316 16:57:59.606369 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:57:59 crc kubenswrapper[5120]: I0316 16:57:59.616678 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:57:59 crc kubenswrapper[5120]: I0316 16:57:59.616811 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:57:59 crc kubenswrapper[5120]: I0316 16:57:59.624123 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-config-data\"" Mar 16 16:57:59 crc kubenswrapper[5120]: I0316 16:57:59.633065 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q96fd\" (UniqueName: \"kubernetes.io/projected/ffde2e4f-11b6-4b41-8953-bca4be87a2bd-kube-api-access-q96fd\") pod \"nova-cell0-cell-mapping-gz7fl\" (UID: \"ffde2e4f-11b6-4b41-8953-bca4be87a2bd\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-gz7fl" Mar 16 16:57:59 crc kubenswrapper[5120]: I0316 16:57:59.684799 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:57:59 crc kubenswrapper[5120]: I0316 16:57:59.689898 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/34a2f9f7-4b7e-49e2-9e12-55da2fd226f1-logs\") pod \"nova-api-0\" (UID: \"34a2f9f7-4b7e-49e2-9e12-55da2fd226f1\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:57:59 crc kubenswrapper[5120]: I0316 16:57:59.690131 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4n5l8\" (UniqueName: \"kubernetes.io/projected/34a2f9f7-4b7e-49e2-9e12-55da2fd226f1-kube-api-access-4n5l8\") pod \"nova-api-0\" (UID: \"34a2f9f7-4b7e-49e2-9e12-55da2fd226f1\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:57:59 crc kubenswrapper[5120]: I0316 16:57:59.690239 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/34a2f9f7-4b7e-49e2-9e12-55da2fd226f1-config-data\") pod \"nova-api-0\" (UID: \"34a2f9f7-4b7e-49e2-9e12-55da2fd226f1\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:57:59 crc kubenswrapper[5120]: I0316 16:57:59.690268 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:57:59 crc kubenswrapper[5120]: I0316 16:57:59.690279 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/34a2f9f7-4b7e-49e2-9e12-55da2fd226f1-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"34a2f9f7-4b7e-49e2-9e12-55da2fd226f1\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:57:59 crc kubenswrapper[5120]: I0316 16:57:59.701112 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-novncproxy-config-data\"" Mar 16 16:57:59 crc kubenswrapper[5120]: I0316 16:57:59.719843 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:57:59 crc kubenswrapper[5120]: I0316 16:57:59.725527 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:57:59 crc kubenswrapper[5120]: I0316 16:57:59.732894 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-scheduler-config-data\"" Mar 16 16:57:59 crc kubenswrapper[5120]: I0316 16:57:59.753516 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:57:59 crc kubenswrapper[5120]: I0316 16:57:59.765242 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-gz7fl" Mar 16 16:57:59 crc kubenswrapper[5120]: I0316 16:57:59.771204 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:57:59 crc kubenswrapper[5120]: I0316 16:57:59.795130 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4n5l8\" (UniqueName: \"kubernetes.io/projected/34a2f9f7-4b7e-49e2-9e12-55da2fd226f1-kube-api-access-4n5l8\") pod \"nova-api-0\" (UID: \"34a2f9f7-4b7e-49e2-9e12-55da2fd226f1\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:57:59 crc kubenswrapper[5120]: I0316 16:57:59.795192 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/139e9c25-c27f-45e6-827d-0a7db4571231-config-data\") pod \"nova-scheduler-0\" (UID: \"139e9c25-c27f-45e6-827d-0a7db4571231\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:57:59 crc kubenswrapper[5120]: I0316 16:57:59.795296 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/34a2f9f7-4b7e-49e2-9e12-55da2fd226f1-config-data\") pod \"nova-api-0\" (UID: \"34a2f9f7-4b7e-49e2-9e12-55da2fd226f1\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:57:59 crc kubenswrapper[5120]: I0316 16:57:59.795318 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9c6f52a6-cb22-4ee1-a051-ce4a87ed1f39-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"9c6f52a6-cb22-4ee1-a051-ce4a87ed1f39\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:57:59 crc kubenswrapper[5120]: I0316 16:57:59.795349 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/34a2f9f7-4b7e-49e2-9e12-55da2fd226f1-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"34a2f9f7-4b7e-49e2-9e12-55da2fd226f1\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:57:59 crc kubenswrapper[5120]: I0316 16:57:59.795386 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28p46\" (UniqueName: \"kubernetes.io/projected/139e9c25-c27f-45e6-827d-0a7db4571231-kube-api-access-28p46\") pod \"nova-scheduler-0\" (UID: \"139e9c25-c27f-45e6-827d-0a7db4571231\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:57:59 crc kubenswrapper[5120]: I0316 16:57:59.795427 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9c6f52a6-cb22-4ee1-a051-ce4a87ed1f39-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"9c6f52a6-cb22-4ee1-a051-ce4a87ed1f39\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:57:59 crc kubenswrapper[5120]: I0316 16:57:59.795456 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/139e9c25-c27f-45e6-827d-0a7db4571231-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"139e9c25-c27f-45e6-827d-0a7db4571231\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:57:59 crc kubenswrapper[5120]: I0316 16:57:59.795556 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/34a2f9f7-4b7e-49e2-9e12-55da2fd226f1-logs\") pod \"nova-api-0\" (UID: \"34a2f9f7-4b7e-49e2-9e12-55da2fd226f1\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:57:59 crc kubenswrapper[5120]: I0316 16:57:59.795726 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8w4rs\" (UniqueName: \"kubernetes.io/projected/9c6f52a6-cb22-4ee1-a051-ce4a87ed1f39-kube-api-access-8w4rs\") pod \"nova-cell1-novncproxy-0\" (UID: \"9c6f52a6-cb22-4ee1-a051-ce4a87ed1f39\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:57:59 crc kubenswrapper[5120]: I0316 16:57:59.798299 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/34a2f9f7-4b7e-49e2-9e12-55da2fd226f1-logs\") pod \"nova-api-0\" (UID: \"34a2f9f7-4b7e-49e2-9e12-55da2fd226f1\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:57:59 crc kubenswrapper[5120]: I0316 16:57:59.821723 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/34a2f9f7-4b7e-49e2-9e12-55da2fd226f1-config-data\") pod \"nova-api-0\" (UID: \"34a2f9f7-4b7e-49e2-9e12-55da2fd226f1\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:57:59 crc kubenswrapper[5120]: I0316 16:57:59.823873 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4n5l8\" (UniqueName: \"kubernetes.io/projected/34a2f9f7-4b7e-49e2-9e12-55da2fd226f1-kube-api-access-4n5l8\") pod \"nova-api-0\" (UID: \"34a2f9f7-4b7e-49e2-9e12-55da2fd226f1\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:57:59 crc kubenswrapper[5120]: I0316 16:57:59.823960 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:57:59 crc kubenswrapper[5120]: I0316 16:57:59.847839 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/34a2f9f7-4b7e-49e2-9e12-55da2fd226f1-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"34a2f9f7-4b7e-49e2-9e12-55da2fd226f1\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:57:59 crc kubenswrapper[5120]: I0316 16:57:59.888031 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:57:59 crc kubenswrapper[5120]: I0316 16:57:59.888234 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:57:59 crc kubenswrapper[5120]: I0316 16:57:59.891223 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-metadata-config-data\"" Mar 16 16:57:59 crc kubenswrapper[5120]: I0316 16:57:59.898466 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-28p46\" (UniqueName: \"kubernetes.io/projected/139e9c25-c27f-45e6-827d-0a7db4571231-kube-api-access-28p46\") pod \"nova-scheduler-0\" (UID: \"139e9c25-c27f-45e6-827d-0a7db4571231\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:57:59 crc kubenswrapper[5120]: I0316 16:57:59.898857 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9c6f52a6-cb22-4ee1-a051-ce4a87ed1f39-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"9c6f52a6-cb22-4ee1-a051-ce4a87ed1f39\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:57:59 crc kubenswrapper[5120]: I0316 16:57:59.899001 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/139e9c25-c27f-45e6-827d-0a7db4571231-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"139e9c25-c27f-45e6-827d-0a7db4571231\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:57:59 crc kubenswrapper[5120]: I0316 16:57:59.899369 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8w4rs\" (UniqueName: \"kubernetes.io/projected/9c6f52a6-cb22-4ee1-a051-ce4a87ed1f39-kube-api-access-8w4rs\") pod \"nova-cell1-novncproxy-0\" (UID: \"9c6f52a6-cb22-4ee1-a051-ce4a87ed1f39\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:57:59 crc kubenswrapper[5120]: I0316 16:57:59.899623 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/139e9c25-c27f-45e6-827d-0a7db4571231-config-data\") pod \"nova-scheduler-0\" (UID: \"139e9c25-c27f-45e6-827d-0a7db4571231\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:57:59 crc kubenswrapper[5120]: I0316 16:57:59.899857 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9c6f52a6-cb22-4ee1-a051-ce4a87ed1f39-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"9c6f52a6-cb22-4ee1-a051-ce4a87ed1f39\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:57:59 crc kubenswrapper[5120]: I0316 16:57:59.903985 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9c6f52a6-cb22-4ee1-a051-ce4a87ed1f39-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"9c6f52a6-cb22-4ee1-a051-ce4a87ed1f39\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:57:59 crc kubenswrapper[5120]: I0316 16:57:59.915022 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/139e9c25-c27f-45e6-827d-0a7db4571231-config-data\") pod \"nova-scheduler-0\" (UID: \"139e9c25-c27f-45e6-827d-0a7db4571231\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:57:59 crc kubenswrapper[5120]: I0316 16:57:59.923786 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9c6f52a6-cb22-4ee1-a051-ce4a87ed1f39-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"9c6f52a6-cb22-4ee1-a051-ce4a87ed1f39\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:57:59 crc kubenswrapper[5120]: I0316 16:57:59.931751 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-28p46\" (UniqueName: \"kubernetes.io/projected/139e9c25-c27f-45e6-827d-0a7db4571231-kube-api-access-28p46\") pod \"nova-scheduler-0\" (UID: \"139e9c25-c27f-45e6-827d-0a7db4571231\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:57:59 crc kubenswrapper[5120]: I0316 16:57:59.933960 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8w4rs\" (UniqueName: \"kubernetes.io/projected/9c6f52a6-cb22-4ee1-a051-ce4a87ed1f39-kube-api-access-8w4rs\") pod \"nova-cell1-novncproxy-0\" (UID: \"9c6f52a6-cb22-4ee1-a051-ce4a87ed1f39\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:57:59 crc kubenswrapper[5120]: I0316 16:57:59.935498 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/139e9c25-c27f-45e6-827d-0a7db4571231-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"139e9c25-c27f-45e6-827d-0a7db4571231\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:58:00 crc kubenswrapper[5120]: I0316 16:58:00.001537 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/640a62ab-055c-4ac1-b815-cb5e856b962c-logs\") pod \"nova-metadata-0\" (UID: \"640a62ab-055c-4ac1-b815-cb5e856b962c\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:58:00 crc kubenswrapper[5120]: I0316 16:58:00.001721 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8mhj\" (UniqueName: \"kubernetes.io/projected/640a62ab-055c-4ac1-b815-cb5e856b962c-kube-api-access-r8mhj\") pod \"nova-metadata-0\" (UID: \"640a62ab-055c-4ac1-b815-cb5e856b962c\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:58:00 crc kubenswrapper[5120]: I0316 16:58:00.001877 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/640a62ab-055c-4ac1-b815-cb5e856b962c-config-data\") pod \"nova-metadata-0\" (UID: \"640a62ab-055c-4ac1-b815-cb5e856b962c\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:58:00 crc kubenswrapper[5120]: I0316 16:58:00.001943 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/640a62ab-055c-4ac1-b815-cb5e856b962c-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"640a62ab-055c-4ac1-b815-cb5e856b962c\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:58:00 crc kubenswrapper[5120]: I0316 16:58:00.042011 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:58:00 crc kubenswrapper[5120]: I0316 16:58:00.060032 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:58:00 crc kubenswrapper[5120]: I0316 16:58:00.085161 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:58:00 crc kubenswrapper[5120]: I0316 16:58:00.105342 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r8mhj\" (UniqueName: \"kubernetes.io/projected/640a62ab-055c-4ac1-b815-cb5e856b962c-kube-api-access-r8mhj\") pod \"nova-metadata-0\" (UID: \"640a62ab-055c-4ac1-b815-cb5e856b962c\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:58:00 crc kubenswrapper[5120]: I0316 16:58:00.105508 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/640a62ab-055c-4ac1-b815-cb5e856b962c-config-data\") pod \"nova-metadata-0\" (UID: \"640a62ab-055c-4ac1-b815-cb5e856b962c\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:58:00 crc kubenswrapper[5120]: I0316 16:58:00.105573 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/640a62ab-055c-4ac1-b815-cb5e856b962c-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"640a62ab-055c-4ac1-b815-cb5e856b962c\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:58:00 crc kubenswrapper[5120]: I0316 16:58:00.105638 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/640a62ab-055c-4ac1-b815-cb5e856b962c-logs\") pod \"nova-metadata-0\" (UID: \"640a62ab-055c-4ac1-b815-cb5e856b962c\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:58:00 crc kubenswrapper[5120]: I0316 16:58:00.106130 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/640a62ab-055c-4ac1-b815-cb5e856b962c-logs\") pod \"nova-metadata-0\" (UID: \"640a62ab-055c-4ac1-b815-cb5e856b962c\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:58:00 crc kubenswrapper[5120]: I0316 16:58:00.131937 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/640a62ab-055c-4ac1-b815-cb5e856b962c-config-data\") pod \"nova-metadata-0\" (UID: \"640a62ab-055c-4ac1-b815-cb5e856b962c\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:58:00 crc kubenswrapper[5120]: I0316 16:58:00.132388 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/640a62ab-055c-4ac1-b815-cb5e856b962c-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"640a62ab-055c-4ac1-b815-cb5e856b962c\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:58:00 crc kubenswrapper[5120]: I0316 16:58:00.143516 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8mhj\" (UniqueName: \"kubernetes.io/projected/640a62ab-055c-4ac1-b815-cb5e856b962c-kube-api-access-r8mhj\") pod \"nova-metadata-0\" (UID: \"640a62ab-055c-4ac1-b815-cb5e856b962c\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:58:00 crc kubenswrapper[5120]: I0316 16:58:00.182327 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-infra/auto-csr-approver-29561338-cpxpc"] Mar 16 16:58:00 crc kubenswrapper[5120]: I0316 16:58:00.209089 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561338-cpxpc"] Mar 16 16:58:00 crc kubenswrapper[5120]: I0316 16:58:00.209244 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561338-cpxpc" Mar 16 16:58:00 crc kubenswrapper[5120]: I0316 16:58:00.220167 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"openshift-service-ca.crt\"" Mar 16 16:58:00 crc kubenswrapper[5120]: I0316 16:58:00.220232 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-infra\"/\"csr-approver-sa-dockercfg-x2nsz\"" Mar 16 16:58:00 crc kubenswrapper[5120]: I0316 16:58:00.220442 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"kube-root-ca.crt\"" Mar 16 16:58:00 crc kubenswrapper[5120]: I0316 16:58:00.313313 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:58:00 crc kubenswrapper[5120]: I0316 16:58:00.314346 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxkdt\" (UniqueName: \"kubernetes.io/projected/3bcb4bc8-ad9d-40a6-a44b-2f174a1993cd-kube-api-access-wxkdt\") pod \"auto-csr-approver-29561338-cpxpc\" (UID: \"3bcb4bc8-ad9d-40a6-a44b-2f174a1993cd\") " pod="openshift-infra/auto-csr-approver-29561338-cpxpc" Mar 16 16:58:00 crc kubenswrapper[5120]: I0316 16:58:00.417238 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wxkdt\" (UniqueName: \"kubernetes.io/projected/3bcb4bc8-ad9d-40a6-a44b-2f174a1993cd-kube-api-access-wxkdt\") pod \"auto-csr-approver-29561338-cpxpc\" (UID: \"3bcb4bc8-ad9d-40a6-a44b-2f174a1993cd\") " pod="openshift-infra/auto-csr-approver-29561338-cpxpc" Mar 16 16:58:00 crc kubenswrapper[5120]: I0316 16:58:00.443464 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxkdt\" (UniqueName: \"kubernetes.io/projected/3bcb4bc8-ad9d-40a6-a44b-2f174a1993cd-kube-api-access-wxkdt\") pod \"auto-csr-approver-29561338-cpxpc\" (UID: \"3bcb4bc8-ad9d-40a6-a44b-2f174a1993cd\") " pod="openshift-infra/auto-csr-approver-29561338-cpxpc" Mar 16 16:58:00 crc kubenswrapper[5120]: I0316 16:58:00.546178 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-gz7fl"] Mar 16 16:58:00 crc kubenswrapper[5120]: I0316 16:58:00.600161 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561338-cpxpc" Mar 16 16:58:00 crc kubenswrapper[5120]: I0316 16:58:00.855599 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:58:00 crc kubenswrapper[5120]: I0316 16:58:00.883168 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-ttt9d"] Mar 16 16:58:00 crc kubenswrapper[5120]: I0316 16:58:00.893905 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-ttt9d" Mar 16 16:58:00 crc kubenswrapper[5120]: I0316 16:58:00.899265 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-conductor-config-data\"" Mar 16 16:58:00 crc kubenswrapper[5120]: I0316 16:58:00.899424 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-conductor-scripts\"" Mar 16 16:58:00 crc kubenswrapper[5120]: I0316 16:58:00.906159 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-ttt9d"] Mar 16 16:58:00 crc kubenswrapper[5120]: I0316 16:58:00.943030 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/bcf6a825-1206-447b-937b-3bd88fb293a1-scripts\") pod \"nova-cell1-conductor-db-sync-ttt9d\" (UID: \"bcf6a825-1206-447b-937b-3bd88fb293a1\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-ttt9d" Mar 16 16:58:00 crc kubenswrapper[5120]: I0316 16:58:00.943209 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bcf6a825-1206-447b-937b-3bd88fb293a1-combined-ca-bundle\") pod \"nova-cell1-conductor-db-sync-ttt9d\" (UID: \"bcf6a825-1206-447b-937b-3bd88fb293a1\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-ttt9d" Mar 16 16:58:00 crc kubenswrapper[5120]: I0316 16:58:00.943257 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kj87m\" (UniqueName: \"kubernetes.io/projected/bcf6a825-1206-447b-937b-3bd88fb293a1-kube-api-access-kj87m\") pod \"nova-cell1-conductor-db-sync-ttt9d\" (UID: \"bcf6a825-1206-447b-937b-3bd88fb293a1\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-ttt9d" Mar 16 16:58:00 crc kubenswrapper[5120]: I0316 16:58:00.943475 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bcf6a825-1206-447b-937b-3bd88fb293a1-config-data\") pod \"nova-cell1-conductor-db-sync-ttt9d\" (UID: \"bcf6a825-1206-447b-937b-3bd88fb293a1\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-ttt9d" Mar 16 16:58:01 crc kubenswrapper[5120]: I0316 16:58:01.023862 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:58:01 crc kubenswrapper[5120]: W0316 16:58:01.036013 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod640a62ab_055c_4ac1_b815_cb5e856b962c.slice/crio-2359f4b587d9e28ba298b1507a57c5f6d19670e1676d9cac19b32ee5a7503af9 WatchSource:0}: Error finding container 2359f4b587d9e28ba298b1507a57c5f6d19670e1676d9cac19b32ee5a7503af9: Status 404 returned error can't find the container with id 2359f4b587d9e28ba298b1507a57c5f6d19670e1676d9cac19b32ee5a7503af9 Mar 16 16:58:01 crc kubenswrapper[5120]: I0316 16:58:01.046931 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:58:01 crc kubenswrapper[5120]: I0316 16:58:01.049125 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bcf6a825-1206-447b-937b-3bd88fb293a1-combined-ca-bundle\") pod \"nova-cell1-conductor-db-sync-ttt9d\" (UID: \"bcf6a825-1206-447b-937b-3bd88fb293a1\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-ttt9d" Mar 16 16:58:01 crc kubenswrapper[5120]: I0316 16:58:01.050107 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kj87m\" (UniqueName: \"kubernetes.io/projected/bcf6a825-1206-447b-937b-3bd88fb293a1-kube-api-access-kj87m\") pod \"nova-cell1-conductor-db-sync-ttt9d\" (UID: \"bcf6a825-1206-447b-937b-3bd88fb293a1\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-ttt9d" Mar 16 16:58:01 crc kubenswrapper[5120]: I0316 16:58:01.050476 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bcf6a825-1206-447b-937b-3bd88fb293a1-config-data\") pod \"nova-cell1-conductor-db-sync-ttt9d\" (UID: \"bcf6a825-1206-447b-937b-3bd88fb293a1\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-ttt9d" Mar 16 16:58:01 crc kubenswrapper[5120]: I0316 16:58:01.050678 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/bcf6a825-1206-447b-937b-3bd88fb293a1-scripts\") pod \"nova-cell1-conductor-db-sync-ttt9d\" (UID: \"bcf6a825-1206-447b-937b-3bd88fb293a1\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-ttt9d" Mar 16 16:58:01 crc kubenswrapper[5120]: I0316 16:58:01.052465 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-gz7fl" event={"ID":"ffde2e4f-11b6-4b41-8953-bca4be87a2bd","Type":"ContainerStarted","Data":"f91a4b2e9fe8a6d44d4a6012135d11c44cd439b0ddcf5d1bbd47766a7ef85abb"} Mar 16 16:58:01 crc kubenswrapper[5120]: W0316 16:58:01.054843 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod139e9c25_c27f_45e6_827d_0a7db4571231.slice/crio-d90c1dcb5ebcfd9b1ea2f5a278bcd7e24ceffbac948a72e03ff2c02a3db21109 WatchSource:0}: Error finding container d90c1dcb5ebcfd9b1ea2f5a278bcd7e24ceffbac948a72e03ff2c02a3db21109: Status 404 returned error can't find the container with id d90c1dcb5ebcfd9b1ea2f5a278bcd7e24ceffbac948a72e03ff2c02a3db21109 Mar 16 16:58:01 crc kubenswrapper[5120]: I0316 16:58:01.056903 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bcf6a825-1206-447b-937b-3bd88fb293a1-config-data\") pod \"nova-cell1-conductor-db-sync-ttt9d\" (UID: \"bcf6a825-1206-447b-937b-3bd88fb293a1\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-ttt9d" Mar 16 16:58:01 crc kubenswrapper[5120]: I0316 16:58:01.057724 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bcf6a825-1206-447b-937b-3bd88fb293a1-combined-ca-bundle\") pod \"nova-cell1-conductor-db-sync-ttt9d\" (UID: \"bcf6a825-1206-447b-937b-3bd88fb293a1\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-ttt9d" Mar 16 16:58:01 crc kubenswrapper[5120]: I0316 16:58:01.061200 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/bcf6a825-1206-447b-937b-3bd88fb293a1-scripts\") pod \"nova-cell1-conductor-db-sync-ttt9d\" (UID: \"bcf6a825-1206-447b-937b-3bd88fb293a1\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-ttt9d" Mar 16 16:58:01 crc kubenswrapper[5120]: W0316 16:58:01.061278 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9c6f52a6_cb22_4ee1_a051_ce4a87ed1f39.slice/crio-dcd063c37ee6c01ca55a326e6f9a1f9e6c8ce1a1c858ef5084c4fa769833d9ab WatchSource:0}: Error finding container dcd063c37ee6c01ca55a326e6f9a1f9e6c8ce1a1c858ef5084c4fa769833d9ab: Status 404 returned error can't find the container with id dcd063c37ee6c01ca55a326e6f9a1f9e6c8ce1a1c858ef5084c4fa769833d9ab Mar 16 16:58:01 crc kubenswrapper[5120]: I0316 16:58:01.061359 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"34a2f9f7-4b7e-49e2-9e12-55da2fd226f1","Type":"ContainerStarted","Data":"d02fed9c651020d9519d9253902d3d1f4206eb131aefca62c97d82e1f9447af9"} Mar 16 16:58:01 crc kubenswrapper[5120]: I0316 16:58:01.071298 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:58:01 crc kubenswrapper[5120]: I0316 16:58:01.074261 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kj87m\" (UniqueName: \"kubernetes.io/projected/bcf6a825-1206-447b-937b-3bd88fb293a1-kube-api-access-kj87m\") pod \"nova-cell1-conductor-db-sync-ttt9d\" (UID: \"bcf6a825-1206-447b-937b-3bd88fb293a1\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-ttt9d" Mar 16 16:58:01 crc kubenswrapper[5120]: I0316 16:58:01.239822 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-ttt9d" Mar 16 16:58:01 crc kubenswrapper[5120]: I0316 16:58:01.249469 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561338-cpxpc"] Mar 16 16:58:01 crc kubenswrapper[5120]: W0316 16:58:01.271818 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3bcb4bc8_ad9d_40a6_a44b_2f174a1993cd.slice/crio-4266b0fab6ad601df1eeb5782659049d4f852f5fa2bf3b4075736dfa29655e0f WatchSource:0}: Error finding container 4266b0fab6ad601df1eeb5782659049d4f852f5fa2bf3b4075736dfa29655e0f: Status 404 returned error can't find the container with id 4266b0fab6ad601df1eeb5782659049d4f852f5fa2bf3b4075736dfa29655e0f Mar 16 16:58:01 crc kubenswrapper[5120]: I0316 16:58:01.272483 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:58:01 crc kubenswrapper[5120]: I0316 16:58:01.272815 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:58:01 crc kubenswrapper[5120]: I0316 16:58:01.324112 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:58:01 crc kubenswrapper[5120]: I0316 16:58:01.372163 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:58:01 crc kubenswrapper[5120]: I0316 16:58:01.792564 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-ttt9d"] Mar 16 16:58:02 crc kubenswrapper[5120]: I0316 16:58:02.074797 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-ttt9d" event={"ID":"bcf6a825-1206-447b-937b-3bd88fb293a1","Type":"ContainerStarted","Data":"7f4b6ccac11d75b0188041fa8380457b3874c5ef963e069e90d3afcdf1d82922"} Mar 16 16:58:02 crc kubenswrapper[5120]: I0316 16:58:02.075719 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-ttt9d" event={"ID":"bcf6a825-1206-447b-937b-3bd88fb293a1","Type":"ContainerStarted","Data":"53547a3aba2a7847dadf82aeeb6d94ebcfbdd82125b3abb3c0f08ac93ea0f9af"} Mar 16 16:58:02 crc kubenswrapper[5120]: I0316 16:58:02.076696 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-gz7fl" event={"ID":"ffde2e4f-11b6-4b41-8953-bca4be87a2bd","Type":"ContainerStarted","Data":"3979f5b2c8f3e27e58c3bf66a809beac256cccdeb07924610ae962d31618914f"} Mar 16 16:58:02 crc kubenswrapper[5120]: I0316 16:58:02.079264 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"139e9c25-c27f-45e6-827d-0a7db4571231","Type":"ContainerStarted","Data":"6fb269f040842e226a04e6be81fe19f6845252a119d3d659b7fe25791c18119d"} Mar 16 16:58:02 crc kubenswrapper[5120]: I0316 16:58:02.079301 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"139e9c25-c27f-45e6-827d-0a7db4571231","Type":"ContainerStarted","Data":"d90c1dcb5ebcfd9b1ea2f5a278bcd7e24ceffbac948a72e03ff2c02a3db21109"} Mar 16 16:58:02 crc kubenswrapper[5120]: I0316 16:58:02.082655 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"34a2f9f7-4b7e-49e2-9e12-55da2fd226f1","Type":"ContainerStarted","Data":"189a5dba567741ba61350190e1a3715b503cd56bec49680e14299325f3154841"} Mar 16 16:58:02 crc kubenswrapper[5120]: I0316 16:58:02.082692 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"34a2f9f7-4b7e-49e2-9e12-55da2fd226f1","Type":"ContainerStarted","Data":"d71b0b7c7f865e9051c971df04a01437d271dc18a9e7504f5ad43601c4461daa"} Mar 16 16:58:02 crc kubenswrapper[5120]: I0316 16:58:02.084181 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561338-cpxpc" event={"ID":"3bcb4bc8-ad9d-40a6-a44b-2f174a1993cd","Type":"ContainerStarted","Data":"4266b0fab6ad601df1eeb5782659049d4f852f5fa2bf3b4075736dfa29655e0f"} Mar 16 16:58:02 crc kubenswrapper[5120]: I0316 16:58:02.087124 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"9c6f52a6-cb22-4ee1-a051-ce4a87ed1f39","Type":"ContainerStarted","Data":"6d1ce05c5ef9ad351e1f766a7017b5459624f1eb146ff5e0b07852633f794fee"} Mar 16 16:58:02 crc kubenswrapper[5120]: I0316 16:58:02.087164 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"9c6f52a6-cb22-4ee1-a051-ce4a87ed1f39","Type":"ContainerStarted","Data":"dcd063c37ee6c01ca55a326e6f9a1f9e6c8ce1a1c858ef5084c4fa769833d9ab"} Mar 16 16:58:02 crc kubenswrapper[5120]: I0316 16:58:02.095280 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"640a62ab-055c-4ac1-b815-cb5e856b962c","Type":"ContainerStarted","Data":"b18d90728d022bbcaa14df1710a46676d6cebac145ec16afe27fc2234f0bbe51"} Mar 16 16:58:02 crc kubenswrapper[5120]: I0316 16:58:02.095362 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"640a62ab-055c-4ac1-b815-cb5e856b962c","Type":"ContainerStarted","Data":"a98cafccb2324ae85a0d2f83b3b86bea8823687bcb67ee76e3da471e860de462"} Mar 16 16:58:02 crc kubenswrapper[5120]: I0316 16:58:02.095388 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:58:02 crc kubenswrapper[5120]: I0316 16:58:02.095403 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"640a62ab-055c-4ac1-b815-cb5e856b962c","Type":"ContainerStarted","Data":"2359f4b587d9e28ba298b1507a57c5f6d19670e1676d9cac19b32ee5a7503af9"} Mar 16 16:58:02 crc kubenswrapper[5120]: I0316 16:58:02.095946 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:58:02 crc kubenswrapper[5120]: I0316 16:58:02.103215 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-ttt9d" podStartSLOduration=2.103197374 podStartE2EDuration="2.103197374s" podCreationTimestamp="2026-03-16 16:58:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:58:02.092779969 +0000 UTC m=+5184.246711626" watchObservedRunningTime="2026-03-16 16:58:02.103197374 +0000 UTC m=+5184.257129031" Mar 16 16:58:02 crc kubenswrapper[5120]: I0316 16:58:02.122274 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=3.122252026 podStartE2EDuration="3.122252026s" podCreationTimestamp="2026-03-16 16:57:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:58:02.11802057 +0000 UTC m=+5184.271952227" watchObservedRunningTime="2026-03-16 16:58:02.122252026 +0000 UTC m=+5184.276183683" Mar 16 16:58:02 crc kubenswrapper[5120]: I0316 16:58:02.172996 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podStartSLOduration=3.172968033 podStartE2EDuration="3.172968033s" podCreationTimestamp="2026-03-16 16:57:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:58:02.153142081 +0000 UTC m=+5184.307073738" watchObservedRunningTime="2026-03-16 16:58:02.172968033 +0000 UTC m=+5184.326899690" Mar 16 16:58:02 crc kubenswrapper[5120]: I0316 16:58:02.215203 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-scheduler-0" podStartSLOduration=3.215182409 podStartE2EDuration="3.215182409s" podCreationTimestamp="2026-03-16 16:57:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:58:02.182158765 +0000 UTC m=+5184.336090422" watchObservedRunningTime="2026-03-16 16:58:02.215182409 +0000 UTC m=+5184.369114056" Mar 16 16:58:02 crc kubenswrapper[5120]: I0316 16:58:02.229462 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-gz7fl" podStartSLOduration=3.229439349 podStartE2EDuration="3.229439349s" podCreationTimestamp="2026-03-16 16:57:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:58:02.201430722 +0000 UTC m=+5184.355362389" watchObservedRunningTime="2026-03-16 16:58:02.229439349 +0000 UTC m=+5184.383371006" Mar 16 16:58:02 crc kubenswrapper[5120]: I0316 16:58:02.230750 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=3.230745275 podStartE2EDuration="3.230745275s" podCreationTimestamp="2026-03-16 16:57:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:58:02.226450077 +0000 UTC m=+5184.380381734" watchObservedRunningTime="2026-03-16 16:58:02.230745275 +0000 UTC m=+5184.384676932" Mar 16 16:58:03 crc kubenswrapper[5120]: I0316 16:58:03.107453 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561338-cpxpc" event={"ID":"3bcb4bc8-ad9d-40a6-a44b-2f174a1993cd","Type":"ContainerStarted","Data":"0d0a5b84c395fb30badadf14a48e15a5bf036ad2f750fcc8859c8cd2ab121bbb"} Mar 16 16:58:03 crc kubenswrapper[5120]: I0316 16:58:03.124470 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-infra/auto-csr-approver-29561338-cpxpc" podStartSLOduration=2.112771445 podStartE2EDuration="3.124442795s" podCreationTimestamp="2026-03-16 16:58:00 +0000 UTC" firstStartedPulling="2026-03-16 16:58:01.273927916 +0000 UTC m=+5183.427859573" lastFinishedPulling="2026-03-16 16:58:02.285599266 +0000 UTC m=+5184.439530923" observedRunningTime="2026-03-16 16:58:03.12054717 +0000 UTC m=+5185.274478827" watchObservedRunningTime="2026-03-16 16:58:03.124442795 +0000 UTC m=+5185.278374452" Mar 16 16:58:03 crc kubenswrapper[5120]: I0316 16:58:03.643936 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:58:03 crc kubenswrapper[5120]: I0316 16:58:03.651682 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:58:03 crc kubenswrapper[5120]: I0316 16:58:03.651738 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:58:03 crc kubenswrapper[5120]: I0316 16:58:03.656770 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:58:03 crc kubenswrapper[5120]: I0316 16:58:03.686848 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:58:03 crc kubenswrapper[5120]: I0316 16:58:03.702407 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:58:03 crc kubenswrapper[5120]: I0316 16:58:03.906351 5120 scope.go:117] "RemoveContainer" containerID="35987799f969f71c82b912431ea13f98b634d539c89a2bd6ce077420efb8f161" Mar 16 16:58:03 crc kubenswrapper[5120]: I0316 16:58:03.934919 5120 scope.go:117] "RemoveContainer" containerID="0970df69e7dcb99e02e2b51ae8385d57de92fa7a1df72fa7d9dc8321b67d814b" Mar 16 16:58:03 crc kubenswrapper[5120]: I0316 16:58:03.978928 5120 scope.go:117] "RemoveContainer" containerID="7bc686e799420528fff50623d35b3694e51b9c28e0c49dd111e1d529654399c2" Mar 16 16:58:04 crc kubenswrapper[5120]: I0316 16:58:04.050547 5120 scope.go:117] "RemoveContainer" containerID="0b2132e2ff271b061aeedada07b1b4b7222370b28d5b9e6d518cdc82cd879170" Mar 16 16:58:04 crc kubenswrapper[5120]: I0316 16:58:04.077655 5120 scope.go:117] "RemoveContainer" containerID="2f86dbe111359426e7c3145a6535162eda586f161b335551970a0c38fcb780ec" Mar 16 16:58:04 crc kubenswrapper[5120]: I0316 16:58:04.121202 5120 scope.go:117] "RemoveContainer" containerID="b1398616db52eed8170c4625ae054d108d6793d99ce5ec107004afe72c8bcb39" Mar 16 16:58:04 crc kubenswrapper[5120]: I0316 16:58:04.134320 5120 generic.go:358] "Generic (PLEG): container finished" podID="3bcb4bc8-ad9d-40a6-a44b-2f174a1993cd" containerID="0d0a5b84c395fb30badadf14a48e15a5bf036ad2f750fcc8859c8cd2ab121bbb" exitCode=0 Mar 16 16:58:04 crc kubenswrapper[5120]: I0316 16:58:04.134387 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561338-cpxpc" event={"ID":"3bcb4bc8-ad9d-40a6-a44b-2f174a1993cd","Type":"ContainerDied","Data":"0d0a5b84c395fb30badadf14a48e15a5bf036ad2f750fcc8859c8cd2ab121bbb"} Mar 16 16:58:04 crc kubenswrapper[5120]: I0316 16:58:04.138984 5120 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Mar 16 16:58:04 crc kubenswrapper[5120]: I0316 16:58:04.139015 5120 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Mar 16 16:58:04 crc kubenswrapper[5120]: I0316 16:58:04.139746 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:58:04 crc kubenswrapper[5120]: I0316 16:58:04.139810 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:58:04 crc kubenswrapper[5120]: I0316 16:58:04.139985 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="640a62ab-055c-4ac1-b815-cb5e856b962c" containerName="nova-metadata-log" containerID="cri-o://a98cafccb2324ae85a0d2f83b3b86bea8823687bcb67ee76e3da471e860de462" gracePeriod=30 Mar 16 16:58:04 crc kubenswrapper[5120]: I0316 16:58:04.140145 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="640a62ab-055c-4ac1-b815-cb5e856b962c" containerName="nova-metadata-metadata" containerID="cri-o://b18d90728d022bbcaa14df1710a46676d6cebac145ec16afe27fc2234f0bbe51" gracePeriod=30 Mar 16 16:58:04 crc kubenswrapper[5120]: I0316 16:58:04.140197 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podUID="9c6f52a6-cb22-4ee1-a051-ce4a87ed1f39" containerName="nova-cell1-novncproxy-novncproxy" containerID="cri-o://6d1ce05c5ef9ad351e1f766a7017b5459624f1eb146ff5e0b07852633f794fee" gracePeriod=30 Mar 16 16:58:04 crc kubenswrapper[5120]: I0316 16:58:04.169991 5120 scope.go:117] "RemoveContainer" containerID="0d81c2b074c35c712a28eea449678c1bb236db51f5c95f1df01bdf619672c22d" Mar 16 16:58:04 crc kubenswrapper[5120]: I0316 16:58:04.564912 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:58:05 crc kubenswrapper[5120]: I0316 16:58:05.751174 5120 patch_prober.go:28] interesting pod/frr-k8s-webhook-server-bc5694f79-47fjz container/frr-k8s-webhook-server namespace/openshift-frr-k8s: Liveness probe status=failure output="Get \"https://192.168.126.11:9123/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" start-of-body= Mar 16 16:58:05 crc kubenswrapper[5120]: I0316 16:58:05.751452 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-frr-k8s/frr-k8s-webhook-server-bc5694f79-47fjz" podUID="a80f41a5-51f7-4d5d-a264-947ef736b918" containerName="frr-k8s-webhook-server" probeResult="failure" output="Get \"https://192.168.126.11:9123/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Mar 16 16:58:06 crc kubenswrapper[5120]: I0316 16:58:06.027140 5120 generic.go:358] "Generic (PLEG): container finished" podID="640a62ab-055c-4ac1-b815-cb5e856b962c" containerID="b18d90728d022bbcaa14df1710a46676d6cebac145ec16afe27fc2234f0bbe51" exitCode=0 Mar 16 16:58:06 crc kubenswrapper[5120]: I0316 16:58:06.027165 5120 generic.go:358] "Generic (PLEG): container finished" podID="640a62ab-055c-4ac1-b815-cb5e856b962c" containerID="a98cafccb2324ae85a0d2f83b3b86bea8823687bcb67ee76e3da471e860de462" exitCode=143 Mar 16 16:58:06 crc kubenswrapper[5120]: E0316 16:58:06.036507 5120 kubelet.go:2642] "Housekeeping took longer than expected" err="housekeeping took too long" expected="1s" actual="1.373s" Mar 16 16:58:06 crc kubenswrapper[5120]: I0316 16:58:06.036610 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:58:06 crc kubenswrapper[5120]: I0316 16:58:06.036627 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:58:06 crc kubenswrapper[5120]: I0316 16:58:06.036642 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 16:58:06 crc kubenswrapper[5120]: I0316 16:58:06.036656 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"640a62ab-055c-4ac1-b815-cb5e856b962c","Type":"ContainerDied","Data":"b18d90728d022bbcaa14df1710a46676d6cebac145ec16afe27fc2234f0bbe51"} Mar 16 16:58:06 crc kubenswrapper[5120]: I0316 16:58:06.037289 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"640a62ab-055c-4ac1-b815-cb5e856b962c","Type":"ContainerDied","Data":"a98cafccb2324ae85a0d2f83b3b86bea8823687bcb67ee76e3da471e860de462"} Mar 16 16:58:06 crc kubenswrapper[5120]: I0316 16:58:06.451420 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:58:06 crc kubenswrapper[5120]: I0316 16:58:06.511773 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/640a62ab-055c-4ac1-b815-cb5e856b962c-logs\") pod \"640a62ab-055c-4ac1-b815-cb5e856b962c\" (UID: \"640a62ab-055c-4ac1-b815-cb5e856b962c\") " Mar 16 16:58:06 crc kubenswrapper[5120]: I0316 16:58:06.511843 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r8mhj\" (UniqueName: \"kubernetes.io/projected/640a62ab-055c-4ac1-b815-cb5e856b962c-kube-api-access-r8mhj\") pod \"640a62ab-055c-4ac1-b815-cb5e856b962c\" (UID: \"640a62ab-055c-4ac1-b815-cb5e856b962c\") " Mar 16 16:58:06 crc kubenswrapper[5120]: I0316 16:58:06.512038 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/640a62ab-055c-4ac1-b815-cb5e856b962c-config-data\") pod \"640a62ab-055c-4ac1-b815-cb5e856b962c\" (UID: \"640a62ab-055c-4ac1-b815-cb5e856b962c\") " Mar 16 16:58:06 crc kubenswrapper[5120]: I0316 16:58:06.512065 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/640a62ab-055c-4ac1-b815-cb5e856b962c-combined-ca-bundle\") pod \"640a62ab-055c-4ac1-b815-cb5e856b962c\" (UID: \"640a62ab-055c-4ac1-b815-cb5e856b962c\") " Mar 16 16:58:06 crc kubenswrapper[5120]: I0316 16:58:06.512147 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/640a62ab-055c-4ac1-b815-cb5e856b962c-logs" (OuterVolumeSpecName: "logs") pod "640a62ab-055c-4ac1-b815-cb5e856b962c" (UID: "640a62ab-055c-4ac1-b815-cb5e856b962c"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:58:06 crc kubenswrapper[5120]: I0316 16:58:06.513985 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/640a62ab-055c-4ac1-b815-cb5e856b962c-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:58:06 crc kubenswrapper[5120]: I0316 16:58:06.517966 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/640a62ab-055c-4ac1-b815-cb5e856b962c-kube-api-access-r8mhj" (OuterVolumeSpecName: "kube-api-access-r8mhj") pod "640a62ab-055c-4ac1-b815-cb5e856b962c" (UID: "640a62ab-055c-4ac1-b815-cb5e856b962c"). InnerVolumeSpecName "kube-api-access-r8mhj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:58:06 crc kubenswrapper[5120]: I0316 16:58:06.550074 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/640a62ab-055c-4ac1-b815-cb5e856b962c-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "640a62ab-055c-4ac1-b815-cb5e856b962c" (UID: "640a62ab-055c-4ac1-b815-cb5e856b962c"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:58:06 crc kubenswrapper[5120]: I0316 16:58:06.552199 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/640a62ab-055c-4ac1-b815-cb5e856b962c-config-data" (OuterVolumeSpecName: "config-data") pod "640a62ab-055c-4ac1-b815-cb5e856b962c" (UID: "640a62ab-055c-4ac1-b815-cb5e856b962c"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:58:06 crc kubenswrapper[5120]: I0316 16:58:06.616961 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r8mhj\" (UniqueName: \"kubernetes.io/projected/640a62ab-055c-4ac1-b815-cb5e856b962c-kube-api-access-r8mhj\") on node \"crc\" DevicePath \"\"" Mar 16 16:58:06 crc kubenswrapper[5120]: I0316 16:58:06.617236 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/640a62ab-055c-4ac1-b815-cb5e856b962c-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:58:06 crc kubenswrapper[5120]: I0316 16:58:06.617246 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/640a62ab-055c-4ac1-b815-cb5e856b962c-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:58:06 crc kubenswrapper[5120]: I0316 16:58:06.660613 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561338-cpxpc" Mar 16 16:58:06 crc kubenswrapper[5120]: I0316 16:58:06.672105 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:58:06 crc kubenswrapper[5120]: I0316 16:58:06.718904 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8w4rs\" (UniqueName: \"kubernetes.io/projected/9c6f52a6-cb22-4ee1-a051-ce4a87ed1f39-kube-api-access-8w4rs\") pod \"9c6f52a6-cb22-4ee1-a051-ce4a87ed1f39\" (UID: \"9c6f52a6-cb22-4ee1-a051-ce4a87ed1f39\") " Mar 16 16:58:06 crc kubenswrapper[5120]: I0316 16:58:06.719091 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9c6f52a6-cb22-4ee1-a051-ce4a87ed1f39-config-data\") pod \"9c6f52a6-cb22-4ee1-a051-ce4a87ed1f39\" (UID: \"9c6f52a6-cb22-4ee1-a051-ce4a87ed1f39\") " Mar 16 16:58:06 crc kubenswrapper[5120]: I0316 16:58:06.719229 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wxkdt\" (UniqueName: \"kubernetes.io/projected/3bcb4bc8-ad9d-40a6-a44b-2f174a1993cd-kube-api-access-wxkdt\") pod \"3bcb4bc8-ad9d-40a6-a44b-2f174a1993cd\" (UID: \"3bcb4bc8-ad9d-40a6-a44b-2f174a1993cd\") " Mar 16 16:58:06 crc kubenswrapper[5120]: I0316 16:58:06.719735 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9c6f52a6-cb22-4ee1-a051-ce4a87ed1f39-combined-ca-bundle\") pod \"9c6f52a6-cb22-4ee1-a051-ce4a87ed1f39\" (UID: \"9c6f52a6-cb22-4ee1-a051-ce4a87ed1f39\") " Mar 16 16:58:06 crc kubenswrapper[5120]: I0316 16:58:06.732516 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3bcb4bc8-ad9d-40a6-a44b-2f174a1993cd-kube-api-access-wxkdt" (OuterVolumeSpecName: "kube-api-access-wxkdt") pod "3bcb4bc8-ad9d-40a6-a44b-2f174a1993cd" (UID: "3bcb4bc8-ad9d-40a6-a44b-2f174a1993cd"). InnerVolumeSpecName "kube-api-access-wxkdt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:58:06 crc kubenswrapper[5120]: I0316 16:58:06.739277 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c6f52a6-cb22-4ee1-a051-ce4a87ed1f39-kube-api-access-8w4rs" (OuterVolumeSpecName: "kube-api-access-8w4rs") pod "9c6f52a6-cb22-4ee1-a051-ce4a87ed1f39" (UID: "9c6f52a6-cb22-4ee1-a051-ce4a87ed1f39"). InnerVolumeSpecName "kube-api-access-8w4rs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:58:06 crc kubenswrapper[5120]: I0316 16:58:06.774904 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9c6f52a6-cb22-4ee1-a051-ce4a87ed1f39-config-data" (OuterVolumeSpecName: "config-data") pod "9c6f52a6-cb22-4ee1-a051-ce4a87ed1f39" (UID: "9c6f52a6-cb22-4ee1-a051-ce4a87ed1f39"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:58:06 crc kubenswrapper[5120]: I0316 16:58:06.802223 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9c6f52a6-cb22-4ee1-a051-ce4a87ed1f39-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "9c6f52a6-cb22-4ee1-a051-ce4a87ed1f39" (UID: "9c6f52a6-cb22-4ee1-a051-ce4a87ed1f39"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:58:06 crc kubenswrapper[5120]: I0316 16:58:06.827260 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9c6f52a6-cb22-4ee1-a051-ce4a87ed1f39-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:58:06 crc kubenswrapper[5120]: I0316 16:58:06.827298 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8w4rs\" (UniqueName: \"kubernetes.io/projected/9c6f52a6-cb22-4ee1-a051-ce4a87ed1f39-kube-api-access-8w4rs\") on node \"crc\" DevicePath \"\"" Mar 16 16:58:06 crc kubenswrapper[5120]: I0316 16:58:06.827313 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9c6f52a6-cb22-4ee1-a051-ce4a87ed1f39-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:58:06 crc kubenswrapper[5120]: I0316 16:58:06.827342 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wxkdt\" (UniqueName: \"kubernetes.io/projected/3bcb4bc8-ad9d-40a6-a44b-2f174a1993cd-kube-api-access-wxkdt\") on node \"crc\" DevicePath \"\"" Mar 16 16:58:07 crc kubenswrapper[5120]: I0316 16:58:07.043807 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561338-cpxpc" Mar 16 16:58:07 crc kubenswrapper[5120]: I0316 16:58:07.043807 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561338-cpxpc" event={"ID":"3bcb4bc8-ad9d-40a6-a44b-2f174a1993cd","Type":"ContainerDied","Data":"4266b0fab6ad601df1eeb5782659049d4f852f5fa2bf3b4075736dfa29655e0f"} Mar 16 16:58:07 crc kubenswrapper[5120]: I0316 16:58:07.044242 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4266b0fab6ad601df1eeb5782659049d4f852f5fa2bf3b4075736dfa29655e0f" Mar 16 16:58:07 crc kubenswrapper[5120]: I0316 16:58:07.047127 5120 generic.go:358] "Generic (PLEG): container finished" podID="9c6f52a6-cb22-4ee1-a051-ce4a87ed1f39" containerID="6d1ce05c5ef9ad351e1f766a7017b5459624f1eb146ff5e0b07852633f794fee" exitCode=0 Mar 16 16:58:07 crc kubenswrapper[5120]: I0316 16:58:07.047720 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"9c6f52a6-cb22-4ee1-a051-ce4a87ed1f39","Type":"ContainerDied","Data":"6d1ce05c5ef9ad351e1f766a7017b5459624f1eb146ff5e0b07852633f794fee"} Mar 16 16:58:07 crc kubenswrapper[5120]: I0316 16:58:07.047803 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"9c6f52a6-cb22-4ee1-a051-ce4a87ed1f39","Type":"ContainerDied","Data":"dcd063c37ee6c01ca55a326e6f9a1f9e6c8ce1a1c858ef5084c4fa769833d9ab"} Mar 16 16:58:07 crc kubenswrapper[5120]: I0316 16:58:07.047827 5120 scope.go:117] "RemoveContainer" containerID="6d1ce05c5ef9ad351e1f766a7017b5459624f1eb146ff5e0b07852633f794fee" Mar 16 16:58:07 crc kubenswrapper[5120]: I0316 16:58:07.048174 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:58:07 crc kubenswrapper[5120]: I0316 16:58:07.070314 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:58:07 crc kubenswrapper[5120]: I0316 16:58:07.070655 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"640a62ab-055c-4ac1-b815-cb5e856b962c","Type":"ContainerDied","Data":"2359f4b587d9e28ba298b1507a57c5f6d19670e1676d9cac19b32ee5a7503af9"} Mar 16 16:58:07 crc kubenswrapper[5120]: I0316 16:58:07.163086 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:58:07 crc kubenswrapper[5120]: I0316 16:58:07.175231 5120 scope.go:117] "RemoveContainer" containerID="6d1ce05c5ef9ad351e1f766a7017b5459624f1eb146ff5e0b07852633f794fee" Mar 16 16:58:07 crc kubenswrapper[5120]: E0316 16:58:07.176360 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d1ce05c5ef9ad351e1f766a7017b5459624f1eb146ff5e0b07852633f794fee\": container with ID starting with 6d1ce05c5ef9ad351e1f766a7017b5459624f1eb146ff5e0b07852633f794fee not found: ID does not exist" containerID="6d1ce05c5ef9ad351e1f766a7017b5459624f1eb146ff5e0b07852633f794fee" Mar 16 16:58:07 crc kubenswrapper[5120]: I0316 16:58:07.176407 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d1ce05c5ef9ad351e1f766a7017b5459624f1eb146ff5e0b07852633f794fee"} err="failed to get container status \"6d1ce05c5ef9ad351e1f766a7017b5459624f1eb146ff5e0b07852633f794fee\": rpc error: code = NotFound desc = could not find container \"6d1ce05c5ef9ad351e1f766a7017b5459624f1eb146ff5e0b07852633f794fee\": container with ID starting with 6d1ce05c5ef9ad351e1f766a7017b5459624f1eb146ff5e0b07852633f794fee not found: ID does not exist" Mar 16 16:58:07 crc kubenswrapper[5120]: I0316 16:58:07.176426 5120 scope.go:117] "RemoveContainer" containerID="b18d90728d022bbcaa14df1710a46676d6cebac145ec16afe27fc2234f0bbe51" Mar 16 16:58:07 crc kubenswrapper[5120]: I0316 16:58:07.190715 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:58:07 crc kubenswrapper[5120]: I0316 16:58:07.209161 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:58:07 crc kubenswrapper[5120]: I0316 16:58:07.233300 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:58:07 crc kubenswrapper[5120]: I0316 16:58:07.241218 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:58:07 crc kubenswrapper[5120]: I0316 16:58:07.242313 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="640a62ab-055c-4ac1-b815-cb5e856b962c" containerName="nova-metadata-metadata" Mar 16 16:58:07 crc kubenswrapper[5120]: I0316 16:58:07.242331 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="640a62ab-055c-4ac1-b815-cb5e856b962c" containerName="nova-metadata-metadata" Mar 16 16:58:07 crc kubenswrapper[5120]: I0316 16:58:07.242378 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c6f52a6-cb22-4ee1-a051-ce4a87ed1f39" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 16:58:07 crc kubenswrapper[5120]: I0316 16:58:07.242386 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c6f52a6-cb22-4ee1-a051-ce4a87ed1f39" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 16:58:07 crc kubenswrapper[5120]: I0316 16:58:07.242401 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="640a62ab-055c-4ac1-b815-cb5e856b962c" containerName="nova-metadata-log" Mar 16 16:58:07 crc kubenswrapper[5120]: I0316 16:58:07.242407 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="640a62ab-055c-4ac1-b815-cb5e856b962c" containerName="nova-metadata-log" Mar 16 16:58:07 crc kubenswrapper[5120]: I0316 16:58:07.242430 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3bcb4bc8-ad9d-40a6-a44b-2f174a1993cd" containerName="oc" Mar 16 16:58:07 crc kubenswrapper[5120]: I0316 16:58:07.242436 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="3bcb4bc8-ad9d-40a6-a44b-2f174a1993cd" containerName="oc" Mar 16 16:58:07 crc kubenswrapper[5120]: I0316 16:58:07.242611 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="3bcb4bc8-ad9d-40a6-a44b-2f174a1993cd" containerName="oc" Mar 16 16:58:07 crc kubenswrapper[5120]: I0316 16:58:07.242629 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="640a62ab-055c-4ac1-b815-cb5e856b962c" containerName="nova-metadata-metadata" Mar 16 16:58:07 crc kubenswrapper[5120]: I0316 16:58:07.242638 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="9c6f52a6-cb22-4ee1-a051-ce4a87ed1f39" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 16:58:07 crc kubenswrapper[5120]: I0316 16:58:07.242649 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="640a62ab-055c-4ac1-b815-cb5e856b962c" containerName="nova-metadata-log" Mar 16 16:58:07 crc kubenswrapper[5120]: I0316 16:58:07.282895 5120 scope.go:117] "RemoveContainer" containerID="a98cafccb2324ae85a0d2f83b3b86bea8823687bcb67ee76e3da471e860de462" Mar 16 16:58:07 crc kubenswrapper[5120]: I0316 16:58:07.372411 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:58:07 crc kubenswrapper[5120]: I0316 16:58:07.372450 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:58:07 crc kubenswrapper[5120]: I0316 16:58:07.372814 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:58:07 crc kubenswrapper[5120]: I0316 16:58:07.374972 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-novncproxy-config-data\"" Mar 16 16:58:07 crc kubenswrapper[5120]: I0316 16:58:07.375260 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-novncproxy-cell1-vencrypt\"" Mar 16 16:58:07 crc kubenswrapper[5120]: I0316 16:58:07.375492 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-novncproxy-cell1-public-svc\"" Mar 16 16:58:07 crc kubenswrapper[5120]: I0316 16:58:07.385392 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:58:07 crc kubenswrapper[5120]: I0316 16:58:07.385538 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:58:07 crc kubenswrapper[5120]: I0316 16:58:07.388083 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-metadata-internal-svc\"" Mar 16 16:58:07 crc kubenswrapper[5120]: I0316 16:58:07.388482 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-metadata-config-data\"" Mar 16 16:58:07 crc kubenswrapper[5120]: I0316 16:58:07.445228 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ff7f7a87-78b8-4ffa-96fb-5529ad39883f-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"ff7f7a87-78b8-4ffa-96fb-5529ad39883f\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:58:07 crc kubenswrapper[5120]: I0316 16:58:07.445357 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/ff7f7a87-78b8-4ffa-96fb-5529ad39883f-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"ff7f7a87-78b8-4ffa-96fb-5529ad39883f\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:58:07 crc kubenswrapper[5120]: I0316 16:58:07.445470 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2d8b5cfc-1bea-48c4-a219-8be0877aae7a-config-data\") pod \"nova-metadata-0\" (UID: \"2d8b5cfc-1bea-48c4-a219-8be0877aae7a\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:58:07 crc kubenswrapper[5120]: I0316 16:58:07.445553 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vswt9\" (UniqueName: \"kubernetes.io/projected/ff7f7a87-78b8-4ffa-96fb-5529ad39883f-kube-api-access-vswt9\") pod \"nova-cell1-novncproxy-0\" (UID: \"ff7f7a87-78b8-4ffa-96fb-5529ad39883f\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:58:07 crc kubenswrapper[5120]: I0316 16:58:07.445866 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/2d8b5cfc-1bea-48c4-a219-8be0877aae7a-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"2d8b5cfc-1bea-48c4-a219-8be0877aae7a\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:58:07 crc kubenswrapper[5120]: I0316 16:58:07.446025 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ff7f7a87-78b8-4ffa-96fb-5529ad39883f-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"ff7f7a87-78b8-4ffa-96fb-5529ad39883f\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:58:07 crc kubenswrapper[5120]: I0316 16:58:07.446377 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2d86z\" (UniqueName: \"kubernetes.io/projected/2d8b5cfc-1bea-48c4-a219-8be0877aae7a-kube-api-access-2d86z\") pod \"nova-metadata-0\" (UID: \"2d8b5cfc-1bea-48c4-a219-8be0877aae7a\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:58:07 crc kubenswrapper[5120]: I0316 16:58:07.446475 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2d8b5cfc-1bea-48c4-a219-8be0877aae7a-logs\") pod \"nova-metadata-0\" (UID: \"2d8b5cfc-1bea-48c4-a219-8be0877aae7a\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:58:07 crc kubenswrapper[5120]: I0316 16:58:07.446529 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/ff7f7a87-78b8-4ffa-96fb-5529ad39883f-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"ff7f7a87-78b8-4ffa-96fb-5529ad39883f\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:58:07 crc kubenswrapper[5120]: I0316 16:58:07.446606 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2d8b5cfc-1bea-48c4-a219-8be0877aae7a-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"2d8b5cfc-1bea-48c4-a219-8be0877aae7a\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:58:07 crc kubenswrapper[5120]: I0316 16:58:07.454736 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:58:07 crc kubenswrapper[5120]: I0316 16:58:07.454881 5120 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Mar 16 16:58:07 crc kubenswrapper[5120]: I0316 16:58:07.548962 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2d8b5cfc-1bea-48c4-a219-8be0877aae7a-logs\") pod \"nova-metadata-0\" (UID: \"2d8b5cfc-1bea-48c4-a219-8be0877aae7a\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:58:07 crc kubenswrapper[5120]: I0316 16:58:07.549142 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/ff7f7a87-78b8-4ffa-96fb-5529ad39883f-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"ff7f7a87-78b8-4ffa-96fb-5529ad39883f\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:58:07 crc kubenswrapper[5120]: I0316 16:58:07.549193 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2d8b5cfc-1bea-48c4-a219-8be0877aae7a-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"2d8b5cfc-1bea-48c4-a219-8be0877aae7a\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:58:07 crc kubenswrapper[5120]: I0316 16:58:07.549254 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ff7f7a87-78b8-4ffa-96fb-5529ad39883f-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"ff7f7a87-78b8-4ffa-96fb-5529ad39883f\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:58:07 crc kubenswrapper[5120]: I0316 16:58:07.549346 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/ff7f7a87-78b8-4ffa-96fb-5529ad39883f-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"ff7f7a87-78b8-4ffa-96fb-5529ad39883f\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:58:07 crc kubenswrapper[5120]: I0316 16:58:07.549402 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2d8b5cfc-1bea-48c4-a219-8be0877aae7a-config-data\") pod \"nova-metadata-0\" (UID: \"2d8b5cfc-1bea-48c4-a219-8be0877aae7a\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:58:07 crc kubenswrapper[5120]: I0316 16:58:07.549530 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vswt9\" (UniqueName: \"kubernetes.io/projected/ff7f7a87-78b8-4ffa-96fb-5529ad39883f-kube-api-access-vswt9\") pod \"nova-cell1-novncproxy-0\" (UID: \"ff7f7a87-78b8-4ffa-96fb-5529ad39883f\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:58:07 crc kubenswrapper[5120]: I0316 16:58:07.549709 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/2d8b5cfc-1bea-48c4-a219-8be0877aae7a-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"2d8b5cfc-1bea-48c4-a219-8be0877aae7a\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:58:07 crc kubenswrapper[5120]: I0316 16:58:07.549888 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ff7f7a87-78b8-4ffa-96fb-5529ad39883f-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"ff7f7a87-78b8-4ffa-96fb-5529ad39883f\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:58:07 crc kubenswrapper[5120]: I0316 16:58:07.550252 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2d8b5cfc-1bea-48c4-a219-8be0877aae7a-logs\") pod \"nova-metadata-0\" (UID: \"2d8b5cfc-1bea-48c4-a219-8be0877aae7a\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:58:07 crc kubenswrapper[5120]: I0316 16:58:07.551674 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2d86z\" (UniqueName: \"kubernetes.io/projected/2d8b5cfc-1bea-48c4-a219-8be0877aae7a-kube-api-access-2d86z\") pod \"nova-metadata-0\" (UID: \"2d8b5cfc-1bea-48c4-a219-8be0877aae7a\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:58:07 crc kubenswrapper[5120]: I0316 16:58:07.566495 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/ff7f7a87-78b8-4ffa-96fb-5529ad39883f-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"ff7f7a87-78b8-4ffa-96fb-5529ad39883f\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:58:07 crc kubenswrapper[5120]: I0316 16:58:07.566626 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2d8b5cfc-1bea-48c4-a219-8be0877aae7a-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"2d8b5cfc-1bea-48c4-a219-8be0877aae7a\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:58:07 crc kubenswrapper[5120]: I0316 16:58:07.566672 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2d8b5cfc-1bea-48c4-a219-8be0877aae7a-config-data\") pod \"nova-metadata-0\" (UID: \"2d8b5cfc-1bea-48c4-a219-8be0877aae7a\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:58:07 crc kubenswrapper[5120]: I0316 16:58:07.567849 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/2d8b5cfc-1bea-48c4-a219-8be0877aae7a-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"2d8b5cfc-1bea-48c4-a219-8be0877aae7a\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:58:07 crc kubenswrapper[5120]: I0316 16:58:07.572466 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2d86z\" (UniqueName: \"kubernetes.io/projected/2d8b5cfc-1bea-48c4-a219-8be0877aae7a-kube-api-access-2d86z\") pod \"nova-metadata-0\" (UID: \"2d8b5cfc-1bea-48c4-a219-8be0877aae7a\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:58:07 crc kubenswrapper[5120]: I0316 16:58:07.574257 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ff7f7a87-78b8-4ffa-96fb-5529ad39883f-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"ff7f7a87-78b8-4ffa-96fb-5529ad39883f\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:58:07 crc kubenswrapper[5120]: I0316 16:58:07.574377 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vswt9\" (UniqueName: \"kubernetes.io/projected/ff7f7a87-78b8-4ffa-96fb-5529ad39883f-kube-api-access-vswt9\") pod \"nova-cell1-novncproxy-0\" (UID: \"ff7f7a87-78b8-4ffa-96fb-5529ad39883f\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:58:07 crc kubenswrapper[5120]: I0316 16:58:07.574437 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/ff7f7a87-78b8-4ffa-96fb-5529ad39883f-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"ff7f7a87-78b8-4ffa-96fb-5529ad39883f\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:58:07 crc kubenswrapper[5120]: I0316 16:58:07.574444 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ff7f7a87-78b8-4ffa-96fb-5529ad39883f-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"ff7f7a87-78b8-4ffa-96fb-5529ad39883f\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:58:07 crc kubenswrapper[5120]: I0316 16:58:07.666484 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 16:58:07 crc kubenswrapper[5120]: I0316 16:58:07.710265 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:58:07 crc kubenswrapper[5120]: I0316 16:58:07.727704 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:58:07 crc kubenswrapper[5120]: I0316 16:58:07.781071 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-infra/auto-csr-approver-29561332-xz4qr"] Mar 16 16:58:07 crc kubenswrapper[5120]: I0316 16:58:07.799732 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-infra/auto-csr-approver-29561332-xz4qr"] Mar 16 16:58:08 crc kubenswrapper[5120]: I0316 16:58:08.245014 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 16:58:08 crc kubenswrapper[5120]: I0316 16:58:08.432682 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:58:08 crc kubenswrapper[5120]: I0316 16:58:08.675682 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="12dbee04-52e9-4d27-970f-3d0c46ee809f" path="/var/lib/kubelet/pods/12dbee04-52e9-4d27-970f-3d0c46ee809f/volumes" Mar 16 16:58:08 crc kubenswrapper[5120]: I0316 16:58:08.676430 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="640a62ab-055c-4ac1-b815-cb5e856b962c" path="/var/lib/kubelet/pods/640a62ab-055c-4ac1-b815-cb5e856b962c/volumes" Mar 16 16:58:08 crc kubenswrapper[5120]: I0316 16:58:08.677014 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c6f52a6-cb22-4ee1-a051-ce4a87ed1f39" path="/var/lib/kubelet/pods/9c6f52a6-cb22-4ee1-a051-ce4a87ed1f39/volumes" Mar 16 16:58:08 crc kubenswrapper[5120]: E0316 16:58:08.870854 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1867500 actualBytes=10240 Mar 16 16:58:09 crc kubenswrapper[5120]: I0316 16:58:09.112295 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"ff7f7a87-78b8-4ffa-96fb-5529ad39883f","Type":"ContainerStarted","Data":"0239c4536046b2029b813fee0ba4d8528cbc6b8b4a900df7ee3237f20798effc"} Mar 16 16:58:09 crc kubenswrapper[5120]: I0316 16:58:09.112369 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"ff7f7a87-78b8-4ffa-96fb-5529ad39883f","Type":"ContainerStarted","Data":"bcd33fa20e0f291442bff20e27871bc87eed4351511d0237c8b4132dbca75849"} Mar 16 16:58:09 crc kubenswrapper[5120]: I0316 16:58:09.114621 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"2d8b5cfc-1bea-48c4-a219-8be0877aae7a","Type":"ContainerStarted","Data":"529d8103d008dc6c98c6dc93546c05ed389558973427ddfaa7ec2661e167c4e9"} Mar 16 16:58:09 crc kubenswrapper[5120]: I0316 16:58:09.114674 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"2d8b5cfc-1bea-48c4-a219-8be0877aae7a","Type":"ContainerStarted","Data":"baf08f814f238a9d263438ee3864576cd3f04947c6955fce0b07ab5c371bbe9e"} Mar 16 16:58:09 crc kubenswrapper[5120]: I0316 16:58:09.114687 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"2d8b5cfc-1bea-48c4-a219-8be0877aae7a","Type":"ContainerStarted","Data":"c8a722cb895e9acfd5dbbcaa8db78a7df1e05e4b138028d3874ac8dd689f4417"} Mar 16 16:58:09 crc kubenswrapper[5120]: I0316 16:58:09.141826 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podStartSLOduration=2.141801395 podStartE2EDuration="2.141801395s" podCreationTimestamp="2026-03-16 16:58:07 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:58:09.131964546 +0000 UTC m=+5191.285896213" watchObservedRunningTime="2026-03-16 16:58:09.141801395 +0000 UTC m=+5191.295733052" Mar 16 16:58:10 crc kubenswrapper[5120]: I0316 16:58:10.042927 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:58:10 crc kubenswrapper[5120]: I0316 16:58:10.043389 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:58:10 crc kubenswrapper[5120]: I0316 16:58:10.086953 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:58:10 crc kubenswrapper[5120]: I0316 16:58:10.116691 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:58:10 crc kubenswrapper[5120]: I0316 16:58:10.125852 5120 generic.go:358] "Generic (PLEG): container finished" podID="ffde2e4f-11b6-4b41-8953-bca4be87a2bd" containerID="3979f5b2c8f3e27e58c3bf66a809beac256cccdeb07924610ae962d31618914f" exitCode=0 Mar 16 16:58:10 crc kubenswrapper[5120]: I0316 16:58:10.125936 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-gz7fl" event={"ID":"ffde2e4f-11b6-4b41-8953-bca4be87a2bd","Type":"ContainerDied","Data":"3979f5b2c8f3e27e58c3bf66a809beac256cccdeb07924610ae962d31618914f"} Mar 16 16:58:10 crc kubenswrapper[5120]: I0316 16:58:10.139557 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=3.139537214 podStartE2EDuration="3.139537214s" podCreationTimestamp="2026-03-16 16:58:07 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:58:09.159066878 +0000 UTC m=+5191.312998545" watchObservedRunningTime="2026-03-16 16:58:10.139537214 +0000 UTC m=+5192.293468871" Mar 16 16:58:10 crc kubenswrapper[5120]: I0316 16:58:10.158946 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:58:11 crc kubenswrapper[5120]: I0316 16:58:11.084039 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="34a2f9f7-4b7e-49e2-9e12-55da2fd226f1" containerName="nova-api-log" probeResult="failure" output="Get \"http://10.217.1.42:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 16:58:11 crc kubenswrapper[5120]: I0316 16:58:11.089019 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="34a2f9f7-4b7e-49e2-9e12-55da2fd226f1" containerName="nova-api-api" probeResult="failure" output="Get \"http://10.217.1.42:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 16:58:11 crc kubenswrapper[5120]: I0316 16:58:11.489870 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-gz7fl" Mar 16 16:58:11 crc kubenswrapper[5120]: I0316 16:58:11.565949 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ffde2e4f-11b6-4b41-8953-bca4be87a2bd-config-data\") pod \"ffde2e4f-11b6-4b41-8953-bca4be87a2bd\" (UID: \"ffde2e4f-11b6-4b41-8953-bca4be87a2bd\") " Mar 16 16:58:11 crc kubenswrapper[5120]: I0316 16:58:11.566137 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q96fd\" (UniqueName: \"kubernetes.io/projected/ffde2e4f-11b6-4b41-8953-bca4be87a2bd-kube-api-access-q96fd\") pod \"ffde2e4f-11b6-4b41-8953-bca4be87a2bd\" (UID: \"ffde2e4f-11b6-4b41-8953-bca4be87a2bd\") " Mar 16 16:58:11 crc kubenswrapper[5120]: I0316 16:58:11.566171 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ffde2e4f-11b6-4b41-8953-bca4be87a2bd-scripts\") pod \"ffde2e4f-11b6-4b41-8953-bca4be87a2bd\" (UID: \"ffde2e4f-11b6-4b41-8953-bca4be87a2bd\") " Mar 16 16:58:11 crc kubenswrapper[5120]: I0316 16:58:11.566377 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ffde2e4f-11b6-4b41-8953-bca4be87a2bd-combined-ca-bundle\") pod \"ffde2e4f-11b6-4b41-8953-bca4be87a2bd\" (UID: \"ffde2e4f-11b6-4b41-8953-bca4be87a2bd\") " Mar 16 16:58:11 crc kubenswrapper[5120]: I0316 16:58:11.582047 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ffde2e4f-11b6-4b41-8953-bca4be87a2bd-scripts" (OuterVolumeSpecName: "scripts") pod "ffde2e4f-11b6-4b41-8953-bca4be87a2bd" (UID: "ffde2e4f-11b6-4b41-8953-bca4be87a2bd"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:58:11 crc kubenswrapper[5120]: I0316 16:58:11.582113 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ffde2e4f-11b6-4b41-8953-bca4be87a2bd-kube-api-access-q96fd" (OuterVolumeSpecName: "kube-api-access-q96fd") pod "ffde2e4f-11b6-4b41-8953-bca4be87a2bd" (UID: "ffde2e4f-11b6-4b41-8953-bca4be87a2bd"). InnerVolumeSpecName "kube-api-access-q96fd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:58:11 crc kubenswrapper[5120]: I0316 16:58:11.594140 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ffde2e4f-11b6-4b41-8953-bca4be87a2bd-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ffde2e4f-11b6-4b41-8953-bca4be87a2bd" (UID: "ffde2e4f-11b6-4b41-8953-bca4be87a2bd"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:58:11 crc kubenswrapper[5120]: I0316 16:58:11.594377 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ffde2e4f-11b6-4b41-8953-bca4be87a2bd-config-data" (OuterVolumeSpecName: "config-data") pod "ffde2e4f-11b6-4b41-8953-bca4be87a2bd" (UID: "ffde2e4f-11b6-4b41-8953-bca4be87a2bd"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:58:11 crc kubenswrapper[5120]: I0316 16:58:11.669403 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ffde2e4f-11b6-4b41-8953-bca4be87a2bd-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:58:11 crc kubenswrapper[5120]: I0316 16:58:11.669448 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q96fd\" (UniqueName: \"kubernetes.io/projected/ffde2e4f-11b6-4b41-8953-bca4be87a2bd-kube-api-access-q96fd\") on node \"crc\" DevicePath \"\"" Mar 16 16:58:11 crc kubenswrapper[5120]: I0316 16:58:11.669459 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ffde2e4f-11b6-4b41-8953-bca4be87a2bd-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:58:11 crc kubenswrapper[5120]: I0316 16:58:11.669467 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ffde2e4f-11b6-4b41-8953-bca4be87a2bd-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:58:12 crc kubenswrapper[5120]: I0316 16:58:12.146668 5120 generic.go:358] "Generic (PLEG): container finished" podID="bcf6a825-1206-447b-937b-3bd88fb293a1" containerID="7f4b6ccac11d75b0188041fa8380457b3874c5ef963e069e90d3afcdf1d82922" exitCode=0 Mar 16 16:58:12 crc kubenswrapper[5120]: I0316 16:58:12.146813 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-ttt9d" event={"ID":"bcf6a825-1206-447b-937b-3bd88fb293a1","Type":"ContainerDied","Data":"7f4b6ccac11d75b0188041fa8380457b3874c5ef963e069e90d3afcdf1d82922"} Mar 16 16:58:12 crc kubenswrapper[5120]: I0316 16:58:12.148603 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-gz7fl" Mar 16 16:58:12 crc kubenswrapper[5120]: I0316 16:58:12.148701 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-gz7fl" event={"ID":"ffde2e4f-11b6-4b41-8953-bca4be87a2bd","Type":"ContainerDied","Data":"f91a4b2e9fe8a6d44d4a6012135d11c44cd439b0ddcf5d1bbd47766a7ef85abb"} Mar 16 16:58:12 crc kubenswrapper[5120]: I0316 16:58:12.148792 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f91a4b2e9fe8a6d44d4a6012135d11c44cd439b0ddcf5d1bbd47766a7ef85abb" Mar 16 16:58:12 crc kubenswrapper[5120]: I0316 16:58:12.334721 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:58:12 crc kubenswrapper[5120]: I0316 16:58:12.335256 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="34a2f9f7-4b7e-49e2-9e12-55da2fd226f1" containerName="nova-api-log" containerID="cri-o://d71b0b7c7f865e9051c971df04a01437d271dc18a9e7504f5ad43601c4461daa" gracePeriod=30 Mar 16 16:58:12 crc kubenswrapper[5120]: I0316 16:58:12.335306 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="34a2f9f7-4b7e-49e2-9e12-55da2fd226f1" containerName="nova-api-api" containerID="cri-o://189a5dba567741ba61350190e1a3715b503cd56bec49680e14299325f3154841" gracePeriod=30 Mar 16 16:58:12 crc kubenswrapper[5120]: I0316 16:58:12.349856 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:58:12 crc kubenswrapper[5120]: I0316 16:58:12.350132 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="139e9c25-c27f-45e6-827d-0a7db4571231" containerName="nova-scheduler-scheduler" containerID="cri-o://6fb269f040842e226a04e6be81fe19f6845252a119d3d659b7fe25791c18119d" gracePeriod=30 Mar 16 16:58:12 crc kubenswrapper[5120]: I0316 16:58:12.358956 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:58:12 crc kubenswrapper[5120]: I0316 16:58:12.359180 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="2d8b5cfc-1bea-48c4-a219-8be0877aae7a" containerName="nova-metadata-log" containerID="cri-o://baf08f814f238a9d263438ee3864576cd3f04947c6955fce0b07ab5c371bbe9e" gracePeriod=30 Mar 16 16:58:12 crc kubenswrapper[5120]: I0316 16:58:12.359686 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="2d8b5cfc-1bea-48c4-a219-8be0877aae7a" containerName="nova-metadata-metadata" containerID="cri-o://529d8103d008dc6c98c6dc93546c05ed389558973427ddfaa7ec2661e167c4e9" gracePeriod=30 Mar 16 16:58:12 crc kubenswrapper[5120]: I0316 16:58:12.665296 5120 scope.go:117] "RemoveContainer" containerID="083f72646c8d47c9c0467b39be99ddfa9c2e5900ae0a29ad53d7b39b950274b4" Mar 16 16:58:12 crc kubenswrapper[5120]: E0316 16:58:12.665619 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:58:12 crc kubenswrapper[5120]: I0316 16:58:12.714269 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:58:12 crc kubenswrapper[5120]: I0316 16:58:12.999320 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:58:13 crc kubenswrapper[5120]: I0316 16:58:13.112496 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2d86z\" (UniqueName: \"kubernetes.io/projected/2d8b5cfc-1bea-48c4-a219-8be0877aae7a-kube-api-access-2d86z\") pod \"2d8b5cfc-1bea-48c4-a219-8be0877aae7a\" (UID: \"2d8b5cfc-1bea-48c4-a219-8be0877aae7a\") " Mar 16 16:58:13 crc kubenswrapper[5120]: I0316 16:58:13.112782 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2d8b5cfc-1bea-48c4-a219-8be0877aae7a-combined-ca-bundle\") pod \"2d8b5cfc-1bea-48c4-a219-8be0877aae7a\" (UID: \"2d8b5cfc-1bea-48c4-a219-8be0877aae7a\") " Mar 16 16:58:13 crc kubenswrapper[5120]: I0316 16:58:13.112846 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2d8b5cfc-1bea-48c4-a219-8be0877aae7a-config-data\") pod \"2d8b5cfc-1bea-48c4-a219-8be0877aae7a\" (UID: \"2d8b5cfc-1bea-48c4-a219-8be0877aae7a\") " Mar 16 16:58:13 crc kubenswrapper[5120]: I0316 16:58:13.112914 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2d8b5cfc-1bea-48c4-a219-8be0877aae7a-logs\") pod \"2d8b5cfc-1bea-48c4-a219-8be0877aae7a\" (UID: \"2d8b5cfc-1bea-48c4-a219-8be0877aae7a\") " Mar 16 16:58:13 crc kubenswrapper[5120]: I0316 16:58:13.113152 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/2d8b5cfc-1bea-48c4-a219-8be0877aae7a-nova-metadata-tls-certs\") pod \"2d8b5cfc-1bea-48c4-a219-8be0877aae7a\" (UID: \"2d8b5cfc-1bea-48c4-a219-8be0877aae7a\") " Mar 16 16:58:13 crc kubenswrapper[5120]: I0316 16:58:13.113850 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d8b5cfc-1bea-48c4-a219-8be0877aae7a-logs" (OuterVolumeSpecName: "logs") pod "2d8b5cfc-1bea-48c4-a219-8be0877aae7a" (UID: "2d8b5cfc-1bea-48c4-a219-8be0877aae7a"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:58:13 crc kubenswrapper[5120]: I0316 16:58:13.119936 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d8b5cfc-1bea-48c4-a219-8be0877aae7a-kube-api-access-2d86z" (OuterVolumeSpecName: "kube-api-access-2d86z") pod "2d8b5cfc-1bea-48c4-a219-8be0877aae7a" (UID: "2d8b5cfc-1bea-48c4-a219-8be0877aae7a"). InnerVolumeSpecName "kube-api-access-2d86z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:58:13 crc kubenswrapper[5120]: I0316 16:58:13.146015 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2d8b5cfc-1bea-48c4-a219-8be0877aae7a-config-data" (OuterVolumeSpecName: "config-data") pod "2d8b5cfc-1bea-48c4-a219-8be0877aae7a" (UID: "2d8b5cfc-1bea-48c4-a219-8be0877aae7a"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:58:13 crc kubenswrapper[5120]: I0316 16:58:13.152582 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2d8b5cfc-1bea-48c4-a219-8be0877aae7a-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "2d8b5cfc-1bea-48c4-a219-8be0877aae7a" (UID: "2d8b5cfc-1bea-48c4-a219-8be0877aae7a"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:58:13 crc kubenswrapper[5120]: I0316 16:58:13.161559 5120 generic.go:358] "Generic (PLEG): container finished" podID="34a2f9f7-4b7e-49e2-9e12-55da2fd226f1" containerID="d71b0b7c7f865e9051c971df04a01437d271dc18a9e7504f5ad43601c4461daa" exitCode=143 Mar 16 16:58:13 crc kubenswrapper[5120]: I0316 16:58:13.161618 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"34a2f9f7-4b7e-49e2-9e12-55da2fd226f1","Type":"ContainerDied","Data":"d71b0b7c7f865e9051c971df04a01437d271dc18a9e7504f5ad43601c4461daa"} Mar 16 16:58:13 crc kubenswrapper[5120]: I0316 16:58:13.163467 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:58:13 crc kubenswrapper[5120]: I0316 16:58:13.163984 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"2d8b5cfc-1bea-48c4-a219-8be0877aae7a","Type":"ContainerDied","Data":"529d8103d008dc6c98c6dc93546c05ed389558973427ddfaa7ec2661e167c4e9"} Mar 16 16:58:13 crc kubenswrapper[5120]: I0316 16:58:13.164064 5120 scope.go:117] "RemoveContainer" containerID="529d8103d008dc6c98c6dc93546c05ed389558973427ddfaa7ec2661e167c4e9" Mar 16 16:58:13 crc kubenswrapper[5120]: I0316 16:58:13.163333 5120 generic.go:358] "Generic (PLEG): container finished" podID="2d8b5cfc-1bea-48c4-a219-8be0877aae7a" containerID="529d8103d008dc6c98c6dc93546c05ed389558973427ddfaa7ec2661e167c4e9" exitCode=0 Mar 16 16:58:13 crc kubenswrapper[5120]: I0316 16:58:13.164440 5120 generic.go:358] "Generic (PLEG): container finished" podID="2d8b5cfc-1bea-48c4-a219-8be0877aae7a" containerID="baf08f814f238a9d263438ee3864576cd3f04947c6955fce0b07ab5c371bbe9e" exitCode=143 Mar 16 16:58:13 crc kubenswrapper[5120]: I0316 16:58:13.164589 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"2d8b5cfc-1bea-48c4-a219-8be0877aae7a","Type":"ContainerDied","Data":"baf08f814f238a9d263438ee3864576cd3f04947c6955fce0b07ab5c371bbe9e"} Mar 16 16:58:13 crc kubenswrapper[5120]: I0316 16:58:13.164620 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"2d8b5cfc-1bea-48c4-a219-8be0877aae7a","Type":"ContainerDied","Data":"c8a722cb895e9acfd5dbbcaa8db78a7df1e05e4b138028d3874ac8dd689f4417"} Mar 16 16:58:13 crc kubenswrapper[5120]: I0316 16:58:13.176323 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2d8b5cfc-1bea-48c4-a219-8be0877aae7a-nova-metadata-tls-certs" (OuterVolumeSpecName: "nova-metadata-tls-certs") pod "2d8b5cfc-1bea-48c4-a219-8be0877aae7a" (UID: "2d8b5cfc-1bea-48c4-a219-8be0877aae7a"). InnerVolumeSpecName "nova-metadata-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:58:13 crc kubenswrapper[5120]: I0316 16:58:13.198052 5120 scope.go:117] "RemoveContainer" containerID="baf08f814f238a9d263438ee3864576cd3f04947c6955fce0b07ab5c371bbe9e" Mar 16 16:58:13 crc kubenswrapper[5120]: I0316 16:58:13.218463 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2d86z\" (UniqueName: \"kubernetes.io/projected/2d8b5cfc-1bea-48c4-a219-8be0877aae7a-kube-api-access-2d86z\") on node \"crc\" DevicePath \"\"" Mar 16 16:58:13 crc kubenswrapper[5120]: I0316 16:58:13.218512 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2d8b5cfc-1bea-48c4-a219-8be0877aae7a-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:58:13 crc kubenswrapper[5120]: I0316 16:58:13.218526 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2d8b5cfc-1bea-48c4-a219-8be0877aae7a-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:58:13 crc kubenswrapper[5120]: I0316 16:58:13.218540 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2d8b5cfc-1bea-48c4-a219-8be0877aae7a-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:58:13 crc kubenswrapper[5120]: I0316 16:58:13.218555 5120 reconciler_common.go:299] "Volume detached for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/2d8b5cfc-1bea-48c4-a219-8be0877aae7a-nova-metadata-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:58:13 crc kubenswrapper[5120]: I0316 16:58:13.219074 5120 scope.go:117] "RemoveContainer" containerID="529d8103d008dc6c98c6dc93546c05ed389558973427ddfaa7ec2661e167c4e9" Mar 16 16:58:13 crc kubenswrapper[5120]: E0316 16:58:13.219724 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"529d8103d008dc6c98c6dc93546c05ed389558973427ddfaa7ec2661e167c4e9\": container with ID starting with 529d8103d008dc6c98c6dc93546c05ed389558973427ddfaa7ec2661e167c4e9 not found: ID does not exist" containerID="529d8103d008dc6c98c6dc93546c05ed389558973427ddfaa7ec2661e167c4e9" Mar 16 16:58:13 crc kubenswrapper[5120]: I0316 16:58:13.219840 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"529d8103d008dc6c98c6dc93546c05ed389558973427ddfaa7ec2661e167c4e9"} err="failed to get container status \"529d8103d008dc6c98c6dc93546c05ed389558973427ddfaa7ec2661e167c4e9\": rpc error: code = NotFound desc = could not find container \"529d8103d008dc6c98c6dc93546c05ed389558973427ddfaa7ec2661e167c4e9\": container with ID starting with 529d8103d008dc6c98c6dc93546c05ed389558973427ddfaa7ec2661e167c4e9 not found: ID does not exist" Mar 16 16:58:13 crc kubenswrapper[5120]: I0316 16:58:13.219879 5120 scope.go:117] "RemoveContainer" containerID="baf08f814f238a9d263438ee3864576cd3f04947c6955fce0b07ab5c371bbe9e" Mar 16 16:58:13 crc kubenswrapper[5120]: E0316 16:58:13.220342 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"baf08f814f238a9d263438ee3864576cd3f04947c6955fce0b07ab5c371bbe9e\": container with ID starting with baf08f814f238a9d263438ee3864576cd3f04947c6955fce0b07ab5c371bbe9e not found: ID does not exist" containerID="baf08f814f238a9d263438ee3864576cd3f04947c6955fce0b07ab5c371bbe9e" Mar 16 16:58:13 crc kubenswrapper[5120]: I0316 16:58:13.220451 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"baf08f814f238a9d263438ee3864576cd3f04947c6955fce0b07ab5c371bbe9e"} err="failed to get container status \"baf08f814f238a9d263438ee3864576cd3f04947c6955fce0b07ab5c371bbe9e\": rpc error: code = NotFound desc = could not find container \"baf08f814f238a9d263438ee3864576cd3f04947c6955fce0b07ab5c371bbe9e\": container with ID starting with baf08f814f238a9d263438ee3864576cd3f04947c6955fce0b07ab5c371bbe9e not found: ID does not exist" Mar 16 16:58:13 crc kubenswrapper[5120]: I0316 16:58:13.220559 5120 scope.go:117] "RemoveContainer" containerID="529d8103d008dc6c98c6dc93546c05ed389558973427ddfaa7ec2661e167c4e9" Mar 16 16:58:13 crc kubenswrapper[5120]: I0316 16:58:13.220907 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"529d8103d008dc6c98c6dc93546c05ed389558973427ddfaa7ec2661e167c4e9"} err="failed to get container status \"529d8103d008dc6c98c6dc93546c05ed389558973427ddfaa7ec2661e167c4e9\": rpc error: code = NotFound desc = could not find container \"529d8103d008dc6c98c6dc93546c05ed389558973427ddfaa7ec2661e167c4e9\": container with ID starting with 529d8103d008dc6c98c6dc93546c05ed389558973427ddfaa7ec2661e167c4e9 not found: ID does not exist" Mar 16 16:58:13 crc kubenswrapper[5120]: I0316 16:58:13.220951 5120 scope.go:117] "RemoveContainer" containerID="baf08f814f238a9d263438ee3864576cd3f04947c6955fce0b07ab5c371bbe9e" Mar 16 16:58:13 crc kubenswrapper[5120]: I0316 16:58:13.221204 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"baf08f814f238a9d263438ee3864576cd3f04947c6955fce0b07ab5c371bbe9e"} err="failed to get container status \"baf08f814f238a9d263438ee3864576cd3f04947c6955fce0b07ab5c371bbe9e\": rpc error: code = NotFound desc = could not find container \"baf08f814f238a9d263438ee3864576cd3f04947c6955fce0b07ab5c371bbe9e\": container with ID starting with baf08f814f238a9d263438ee3864576cd3f04947c6955fce0b07ab5c371bbe9e not found: ID does not exist" Mar 16 16:58:13 crc kubenswrapper[5120]: I0316 16:58:13.558802 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-ttt9d" Mar 16 16:58:13 crc kubenswrapper[5120]: I0316 16:58:13.573129 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:58:13 crc kubenswrapper[5120]: I0316 16:58:13.585055 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:58:13 crc kubenswrapper[5120]: I0316 16:58:13.610397 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:58:13 crc kubenswrapper[5120]: I0316 16:58:13.612151 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ffde2e4f-11b6-4b41-8953-bca4be87a2bd" containerName="nova-manage" Mar 16 16:58:13 crc kubenswrapper[5120]: I0316 16:58:13.612179 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ffde2e4f-11b6-4b41-8953-bca4be87a2bd" containerName="nova-manage" Mar 16 16:58:13 crc kubenswrapper[5120]: I0316 16:58:13.612244 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bcf6a825-1206-447b-937b-3bd88fb293a1" containerName="nova-cell1-conductor-db-sync" Mar 16 16:58:13 crc kubenswrapper[5120]: I0316 16:58:13.612254 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="bcf6a825-1206-447b-937b-3bd88fb293a1" containerName="nova-cell1-conductor-db-sync" Mar 16 16:58:13 crc kubenswrapper[5120]: I0316 16:58:13.612266 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d8b5cfc-1bea-48c4-a219-8be0877aae7a" containerName="nova-metadata-metadata" Mar 16 16:58:13 crc kubenswrapper[5120]: I0316 16:58:13.612273 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d8b5cfc-1bea-48c4-a219-8be0877aae7a" containerName="nova-metadata-metadata" Mar 16 16:58:13 crc kubenswrapper[5120]: I0316 16:58:13.612332 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d8b5cfc-1bea-48c4-a219-8be0877aae7a" containerName="nova-metadata-log" Mar 16 16:58:13 crc kubenswrapper[5120]: I0316 16:58:13.612342 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d8b5cfc-1bea-48c4-a219-8be0877aae7a" containerName="nova-metadata-log" Mar 16 16:58:13 crc kubenswrapper[5120]: I0316 16:58:13.612666 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="2d8b5cfc-1bea-48c4-a219-8be0877aae7a" containerName="nova-metadata-log" Mar 16 16:58:13 crc kubenswrapper[5120]: I0316 16:58:13.612689 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ffde2e4f-11b6-4b41-8953-bca4be87a2bd" containerName="nova-manage" Mar 16 16:58:13 crc kubenswrapper[5120]: I0316 16:58:13.612706 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="bcf6a825-1206-447b-937b-3bd88fb293a1" containerName="nova-cell1-conductor-db-sync" Mar 16 16:58:13 crc kubenswrapper[5120]: I0316 16:58:13.612750 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="2d8b5cfc-1bea-48c4-a219-8be0877aae7a" containerName="nova-metadata-metadata" Mar 16 16:58:13 crc kubenswrapper[5120]: I0316 16:58:13.624601 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:58:13 crc kubenswrapper[5120]: I0316 16:58:13.624803 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:58:13 crc kubenswrapper[5120]: I0316 16:58:13.627348 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-metadata-config-data\"" Mar 16 16:58:13 crc kubenswrapper[5120]: I0316 16:58:13.627558 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-metadata-internal-svc\"" Mar 16 16:58:13 crc kubenswrapper[5120]: I0316 16:58:13.731089 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kj87m\" (UniqueName: \"kubernetes.io/projected/bcf6a825-1206-447b-937b-3bd88fb293a1-kube-api-access-kj87m\") pod \"bcf6a825-1206-447b-937b-3bd88fb293a1\" (UID: \"bcf6a825-1206-447b-937b-3bd88fb293a1\") " Mar 16 16:58:13 crc kubenswrapper[5120]: I0316 16:58:13.731393 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bcf6a825-1206-447b-937b-3bd88fb293a1-config-data\") pod \"bcf6a825-1206-447b-937b-3bd88fb293a1\" (UID: \"bcf6a825-1206-447b-937b-3bd88fb293a1\") " Mar 16 16:58:13 crc kubenswrapper[5120]: I0316 16:58:13.731710 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/bcf6a825-1206-447b-937b-3bd88fb293a1-scripts\") pod \"bcf6a825-1206-447b-937b-3bd88fb293a1\" (UID: \"bcf6a825-1206-447b-937b-3bd88fb293a1\") " Mar 16 16:58:13 crc kubenswrapper[5120]: I0316 16:58:13.731816 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bcf6a825-1206-447b-937b-3bd88fb293a1-combined-ca-bundle\") pod \"bcf6a825-1206-447b-937b-3bd88fb293a1\" (UID: \"bcf6a825-1206-447b-937b-3bd88fb293a1\") " Mar 16 16:58:13 crc kubenswrapper[5120]: I0316 16:58:13.732106 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/1d64f64b-2324-4bc9-a7ea-808defe6ded7-logs\") pod \"nova-metadata-0\" (UID: \"1d64f64b-2324-4bc9-a7ea-808defe6ded7\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:58:13 crc kubenswrapper[5120]: I0316 16:58:13.732180 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/1d64f64b-2324-4bc9-a7ea-808defe6ded7-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"1d64f64b-2324-4bc9-a7ea-808defe6ded7\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:58:13 crc kubenswrapper[5120]: I0316 16:58:13.732237 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1d64f64b-2324-4bc9-a7ea-808defe6ded7-config-data\") pod \"nova-metadata-0\" (UID: \"1d64f64b-2324-4bc9-a7ea-808defe6ded7\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:58:13 crc kubenswrapper[5120]: I0316 16:58:13.732473 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1d64f64b-2324-4bc9-a7ea-808defe6ded7-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"1d64f64b-2324-4bc9-a7ea-808defe6ded7\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:58:13 crc kubenswrapper[5120]: I0316 16:58:13.732909 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdt5f\" (UniqueName: \"kubernetes.io/projected/1d64f64b-2324-4bc9-a7ea-808defe6ded7-kube-api-access-mdt5f\") pod \"nova-metadata-0\" (UID: \"1d64f64b-2324-4bc9-a7ea-808defe6ded7\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:58:13 crc kubenswrapper[5120]: I0316 16:58:13.735282 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bcf6a825-1206-447b-937b-3bd88fb293a1-scripts" (OuterVolumeSpecName: "scripts") pod "bcf6a825-1206-447b-937b-3bd88fb293a1" (UID: "bcf6a825-1206-447b-937b-3bd88fb293a1"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:58:13 crc kubenswrapper[5120]: I0316 16:58:13.735868 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bcf6a825-1206-447b-937b-3bd88fb293a1-kube-api-access-kj87m" (OuterVolumeSpecName: "kube-api-access-kj87m") pod "bcf6a825-1206-447b-937b-3bd88fb293a1" (UID: "bcf6a825-1206-447b-937b-3bd88fb293a1"). InnerVolumeSpecName "kube-api-access-kj87m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:58:13 crc kubenswrapper[5120]: I0316 16:58:13.761287 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bcf6a825-1206-447b-937b-3bd88fb293a1-config-data" (OuterVolumeSpecName: "config-data") pod "bcf6a825-1206-447b-937b-3bd88fb293a1" (UID: "bcf6a825-1206-447b-937b-3bd88fb293a1"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:58:13 crc kubenswrapper[5120]: I0316 16:58:13.765370 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bcf6a825-1206-447b-937b-3bd88fb293a1-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "bcf6a825-1206-447b-937b-3bd88fb293a1" (UID: "bcf6a825-1206-447b-937b-3bd88fb293a1"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:58:13 crc kubenswrapper[5120]: I0316 16:58:13.836899 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/1d64f64b-2324-4bc9-a7ea-808defe6ded7-logs\") pod \"nova-metadata-0\" (UID: \"1d64f64b-2324-4bc9-a7ea-808defe6ded7\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:58:13 crc kubenswrapper[5120]: I0316 16:58:13.837296 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/1d64f64b-2324-4bc9-a7ea-808defe6ded7-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"1d64f64b-2324-4bc9-a7ea-808defe6ded7\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:58:13 crc kubenswrapper[5120]: I0316 16:58:13.837313 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/1d64f64b-2324-4bc9-a7ea-808defe6ded7-logs\") pod \"nova-metadata-0\" (UID: \"1d64f64b-2324-4bc9-a7ea-808defe6ded7\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:58:13 crc kubenswrapper[5120]: I0316 16:58:13.838749 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1d64f64b-2324-4bc9-a7ea-808defe6ded7-config-data\") pod \"nova-metadata-0\" (UID: \"1d64f64b-2324-4bc9-a7ea-808defe6ded7\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:58:13 crc kubenswrapper[5120]: I0316 16:58:13.839109 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1d64f64b-2324-4bc9-a7ea-808defe6ded7-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"1d64f64b-2324-4bc9-a7ea-808defe6ded7\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:58:13 crc kubenswrapper[5120]: I0316 16:58:13.839405 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mdt5f\" (UniqueName: \"kubernetes.io/projected/1d64f64b-2324-4bc9-a7ea-808defe6ded7-kube-api-access-mdt5f\") pod \"nova-metadata-0\" (UID: \"1d64f64b-2324-4bc9-a7ea-808defe6ded7\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:58:13 crc kubenswrapper[5120]: I0316 16:58:13.839780 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/bcf6a825-1206-447b-937b-3bd88fb293a1-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:58:13 crc kubenswrapper[5120]: I0316 16:58:13.839812 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bcf6a825-1206-447b-937b-3bd88fb293a1-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:58:13 crc kubenswrapper[5120]: I0316 16:58:13.839825 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kj87m\" (UniqueName: \"kubernetes.io/projected/bcf6a825-1206-447b-937b-3bd88fb293a1-kube-api-access-kj87m\") on node \"crc\" DevicePath \"\"" Mar 16 16:58:13 crc kubenswrapper[5120]: I0316 16:58:13.839835 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bcf6a825-1206-447b-937b-3bd88fb293a1-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:58:13 crc kubenswrapper[5120]: I0316 16:58:13.841281 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/1d64f64b-2324-4bc9-a7ea-808defe6ded7-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"1d64f64b-2324-4bc9-a7ea-808defe6ded7\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:58:13 crc kubenswrapper[5120]: I0316 16:58:13.844875 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1d64f64b-2324-4bc9-a7ea-808defe6ded7-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"1d64f64b-2324-4bc9-a7ea-808defe6ded7\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:58:13 crc kubenswrapper[5120]: I0316 16:58:13.846657 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1d64f64b-2324-4bc9-a7ea-808defe6ded7-config-data\") pod \"nova-metadata-0\" (UID: \"1d64f64b-2324-4bc9-a7ea-808defe6ded7\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:58:13 crc kubenswrapper[5120]: I0316 16:58:13.856930 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdt5f\" (UniqueName: \"kubernetes.io/projected/1d64f64b-2324-4bc9-a7ea-808defe6ded7-kube-api-access-mdt5f\") pod \"nova-metadata-0\" (UID: \"1d64f64b-2324-4bc9-a7ea-808defe6ded7\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:58:13 crc kubenswrapper[5120]: I0316 16:58:13.946225 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:58:14 crc kubenswrapper[5120]: I0316 16:58:14.206942 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-ttt9d" event={"ID":"bcf6a825-1206-447b-937b-3bd88fb293a1","Type":"ContainerDied","Data":"53547a3aba2a7847dadf82aeeb6d94ebcfbdd82125b3abb3c0f08ac93ea0f9af"} Mar 16 16:58:14 crc kubenswrapper[5120]: I0316 16:58:14.206982 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="53547a3aba2a7847dadf82aeeb6d94ebcfbdd82125b3abb3c0f08ac93ea0f9af" Mar 16 16:58:14 crc kubenswrapper[5120]: I0316 16:58:14.207057 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-ttt9d" Mar 16 16:58:14 crc kubenswrapper[5120]: I0316 16:58:14.209277 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:58:14 crc kubenswrapper[5120]: I0316 16:58:14.243992 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 16:58:14 crc kubenswrapper[5120]: I0316 16:58:14.253069 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:58:14 crc kubenswrapper[5120]: I0316 16:58:14.256232 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-conductor-config-data\"" Mar 16 16:58:14 crc kubenswrapper[5120]: I0316 16:58:14.256780 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 16:58:14 crc kubenswrapper[5120]: I0316 16:58:14.352873 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e8abcb6e-3312-4c62-8931-b9ad85725e5b-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"e8abcb6e-3312-4c62-8931-b9ad85725e5b\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:58:14 crc kubenswrapper[5120]: I0316 16:58:14.352973 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bcx7r\" (UniqueName: \"kubernetes.io/projected/e8abcb6e-3312-4c62-8931-b9ad85725e5b-kube-api-access-bcx7r\") pod \"nova-cell1-conductor-0\" (UID: \"e8abcb6e-3312-4c62-8931-b9ad85725e5b\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:58:14 crc kubenswrapper[5120]: I0316 16:58:14.353099 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e8abcb6e-3312-4c62-8931-b9ad85725e5b-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"e8abcb6e-3312-4c62-8931-b9ad85725e5b\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:58:14 crc kubenswrapper[5120]: I0316 16:58:14.465179 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e8abcb6e-3312-4c62-8931-b9ad85725e5b-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"e8abcb6e-3312-4c62-8931-b9ad85725e5b\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:58:14 crc kubenswrapper[5120]: I0316 16:58:14.465656 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bcx7r\" (UniqueName: \"kubernetes.io/projected/e8abcb6e-3312-4c62-8931-b9ad85725e5b-kube-api-access-bcx7r\") pod \"nova-cell1-conductor-0\" (UID: \"e8abcb6e-3312-4c62-8931-b9ad85725e5b\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:58:14 crc kubenswrapper[5120]: I0316 16:58:14.466139 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e8abcb6e-3312-4c62-8931-b9ad85725e5b-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"e8abcb6e-3312-4c62-8931-b9ad85725e5b\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:58:14 crc kubenswrapper[5120]: I0316 16:58:14.470977 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e8abcb6e-3312-4c62-8931-b9ad85725e5b-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"e8abcb6e-3312-4c62-8931-b9ad85725e5b\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:58:14 crc kubenswrapper[5120]: I0316 16:58:14.471201 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e8abcb6e-3312-4c62-8931-b9ad85725e5b-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"e8abcb6e-3312-4c62-8931-b9ad85725e5b\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:58:14 crc kubenswrapper[5120]: I0316 16:58:14.483073 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bcx7r\" (UniqueName: \"kubernetes.io/projected/e8abcb6e-3312-4c62-8931-b9ad85725e5b-kube-api-access-bcx7r\") pod \"nova-cell1-conductor-0\" (UID: \"e8abcb6e-3312-4c62-8931-b9ad85725e5b\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:58:14 crc kubenswrapper[5120]: I0316 16:58:14.581793 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:58:14 crc kubenswrapper[5120]: I0316 16:58:14.684640 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2d8b5cfc-1bea-48c4-a219-8be0877aae7a" path="/var/lib/kubelet/pods/2d8b5cfc-1bea-48c4-a219-8be0877aae7a/volumes" Mar 16 16:58:15 crc kubenswrapper[5120]: I0316 16:58:15.040220 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 16:58:15 crc kubenswrapper[5120]: W0316 16:58:15.051003 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode8abcb6e_3312_4c62_8931_b9ad85725e5b.slice/crio-4c59faf2c76d18cd4b8b9f33f5b7d6ccc0e69be3fe75e13a713621ae4725c72a WatchSource:0}: Error finding container 4c59faf2c76d18cd4b8b9f33f5b7d6ccc0e69be3fe75e13a713621ae4725c72a: Status 404 returned error can't find the container with id 4c59faf2c76d18cd4b8b9f33f5b7d6ccc0e69be3fe75e13a713621ae4725c72a Mar 16 16:58:15 crc kubenswrapper[5120]: E0316 16:58:15.129013 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 6fb269f040842e226a04e6be81fe19f6845252a119d3d659b7fe25791c18119d is running failed: container process not found" containerID="6fb269f040842e226a04e6be81fe19f6845252a119d3d659b7fe25791c18119d" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:58:15 crc kubenswrapper[5120]: E0316 16:58:15.130681 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 6fb269f040842e226a04e6be81fe19f6845252a119d3d659b7fe25791c18119d is running failed: container process not found" containerID="6fb269f040842e226a04e6be81fe19f6845252a119d3d659b7fe25791c18119d" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:58:15 crc kubenswrapper[5120]: E0316 16:58:15.132293 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 6fb269f040842e226a04e6be81fe19f6845252a119d3d659b7fe25791c18119d is running failed: container process not found" containerID="6fb269f040842e226a04e6be81fe19f6845252a119d3d659b7fe25791c18119d" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:58:15 crc kubenswrapper[5120]: E0316 16:58:15.132369 5120 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 6fb269f040842e226a04e6be81fe19f6845252a119d3d659b7fe25791c18119d is running failed: container process not found" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="139e9c25-c27f-45e6-827d-0a7db4571231" containerName="nova-scheduler-scheduler" probeResult="unknown" Mar 16 16:58:15 crc kubenswrapper[5120]: I0316 16:58:15.233492 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"1d64f64b-2324-4bc9-a7ea-808defe6ded7","Type":"ContainerStarted","Data":"3e20032c5d98a5d264101bb17b2284e66b72b09d341377119d43855b8f9d410b"} Mar 16 16:58:15 crc kubenswrapper[5120]: I0316 16:58:15.233537 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"1d64f64b-2324-4bc9-a7ea-808defe6ded7","Type":"ContainerStarted","Data":"e9233709e8767380d34c4871bcf2ecb0d69042131434ddf51deb4bf3c87bf77f"} Mar 16 16:58:15 crc kubenswrapper[5120]: I0316 16:58:15.233548 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"1d64f64b-2324-4bc9-a7ea-808defe6ded7","Type":"ContainerStarted","Data":"c7410724818c90378dca8df13f86186cfcbde7511c420257b8694ecefa875043"} Mar 16 16:58:15 crc kubenswrapper[5120]: I0316 16:58:15.237062 5120 generic.go:358] "Generic (PLEG): container finished" podID="139e9c25-c27f-45e6-827d-0a7db4571231" containerID="6fb269f040842e226a04e6be81fe19f6845252a119d3d659b7fe25791c18119d" exitCode=0 Mar 16 16:58:15 crc kubenswrapper[5120]: I0316 16:58:15.237122 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"139e9c25-c27f-45e6-827d-0a7db4571231","Type":"ContainerDied","Data":"6fb269f040842e226a04e6be81fe19f6845252a119d3d659b7fe25791c18119d"} Mar 16 16:58:15 crc kubenswrapper[5120]: I0316 16:58:15.244209 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"e8abcb6e-3312-4c62-8931-b9ad85725e5b","Type":"ContainerStarted","Data":"4c59faf2c76d18cd4b8b9f33f5b7d6ccc0e69be3fe75e13a713621ae4725c72a"} Mar 16 16:58:15 crc kubenswrapper[5120]: I0316 16:58:15.258669 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=2.258648378 podStartE2EDuration="2.258648378s" podCreationTimestamp="2026-03-16 16:58:13 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:58:15.250066293 +0000 UTC m=+5197.403997950" watchObservedRunningTime="2026-03-16 16:58:15.258648378 +0000 UTC m=+5197.412580035" Mar 16 16:58:15 crc kubenswrapper[5120]: I0316 16:58:15.276506 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:58:15 crc kubenswrapper[5120]: I0316 16:58:15.391237 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/139e9c25-c27f-45e6-827d-0a7db4571231-combined-ca-bundle\") pod \"139e9c25-c27f-45e6-827d-0a7db4571231\" (UID: \"139e9c25-c27f-45e6-827d-0a7db4571231\") " Mar 16 16:58:15 crc kubenswrapper[5120]: I0316 16:58:15.391747 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-28p46\" (UniqueName: \"kubernetes.io/projected/139e9c25-c27f-45e6-827d-0a7db4571231-kube-api-access-28p46\") pod \"139e9c25-c27f-45e6-827d-0a7db4571231\" (UID: \"139e9c25-c27f-45e6-827d-0a7db4571231\") " Mar 16 16:58:15 crc kubenswrapper[5120]: I0316 16:58:15.392027 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/139e9c25-c27f-45e6-827d-0a7db4571231-config-data\") pod \"139e9c25-c27f-45e6-827d-0a7db4571231\" (UID: \"139e9c25-c27f-45e6-827d-0a7db4571231\") " Mar 16 16:58:15 crc kubenswrapper[5120]: I0316 16:58:15.397122 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/139e9c25-c27f-45e6-827d-0a7db4571231-kube-api-access-28p46" (OuterVolumeSpecName: "kube-api-access-28p46") pod "139e9c25-c27f-45e6-827d-0a7db4571231" (UID: "139e9c25-c27f-45e6-827d-0a7db4571231"). InnerVolumeSpecName "kube-api-access-28p46". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:58:15 crc kubenswrapper[5120]: I0316 16:58:15.429640 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/139e9c25-c27f-45e6-827d-0a7db4571231-config-data" (OuterVolumeSpecName: "config-data") pod "139e9c25-c27f-45e6-827d-0a7db4571231" (UID: "139e9c25-c27f-45e6-827d-0a7db4571231"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:58:15 crc kubenswrapper[5120]: I0316 16:58:15.430733 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/139e9c25-c27f-45e6-827d-0a7db4571231-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "139e9c25-c27f-45e6-827d-0a7db4571231" (UID: "139e9c25-c27f-45e6-827d-0a7db4571231"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:58:15 crc kubenswrapper[5120]: I0316 16:58:15.496044 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/139e9c25-c27f-45e6-827d-0a7db4571231-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:58:15 crc kubenswrapper[5120]: I0316 16:58:15.496081 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-28p46\" (UniqueName: \"kubernetes.io/projected/139e9c25-c27f-45e6-827d-0a7db4571231-kube-api-access-28p46\") on node \"crc\" DevicePath \"\"" Mar 16 16:58:15 crc kubenswrapper[5120]: I0316 16:58:15.496092 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/139e9c25-c27f-45e6-827d-0a7db4571231-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:58:16 crc kubenswrapper[5120]: I0316 16:58:16.256125 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:58:16 crc kubenswrapper[5120]: I0316 16:58:16.256148 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"139e9c25-c27f-45e6-827d-0a7db4571231","Type":"ContainerDied","Data":"d90c1dcb5ebcfd9b1ea2f5a278bcd7e24ceffbac948a72e03ff2c02a3db21109"} Mar 16 16:58:16 crc kubenswrapper[5120]: I0316 16:58:16.256204 5120 scope.go:117] "RemoveContainer" containerID="6fb269f040842e226a04e6be81fe19f6845252a119d3d659b7fe25791c18119d" Mar 16 16:58:16 crc kubenswrapper[5120]: I0316 16:58:16.261340 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"e8abcb6e-3312-4c62-8931-b9ad85725e5b","Type":"ContainerStarted","Data":"a1d23aa6e5afd485101028f0d3443a4dce5fef13ef6cd029e16a3912f04ce04d"} Mar 16 16:58:16 crc kubenswrapper[5120]: I0316 16:58:16.261380 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:58:16 crc kubenswrapper[5120]: I0316 16:58:16.287268 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podStartSLOduration=2.287245731 podStartE2EDuration="2.287245731s" podCreationTimestamp="2026-03-16 16:58:14 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:58:16.27624181 +0000 UTC m=+5198.430173487" watchObservedRunningTime="2026-03-16 16:58:16.287245731 +0000 UTC m=+5198.441177388" Mar 16 16:58:16 crc kubenswrapper[5120]: I0316 16:58:16.308566 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:58:16 crc kubenswrapper[5120]: I0316 16:58:16.362507 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:58:16 crc kubenswrapper[5120]: I0316 16:58:16.370625 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:58:16 crc kubenswrapper[5120]: I0316 16:58:16.372266 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="139e9c25-c27f-45e6-827d-0a7db4571231" containerName="nova-scheduler-scheduler" Mar 16 16:58:16 crc kubenswrapper[5120]: I0316 16:58:16.372311 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="139e9c25-c27f-45e6-827d-0a7db4571231" containerName="nova-scheduler-scheduler" Mar 16 16:58:16 crc kubenswrapper[5120]: I0316 16:58:16.372542 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="139e9c25-c27f-45e6-827d-0a7db4571231" containerName="nova-scheduler-scheduler" Mar 16 16:58:16 crc kubenswrapper[5120]: I0316 16:58:16.382201 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:58:16 crc kubenswrapper[5120]: I0316 16:58:16.383552 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:58:16 crc kubenswrapper[5120]: I0316 16:58:16.384823 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-scheduler-config-data\"" Mar 16 16:58:16 crc kubenswrapper[5120]: I0316 16:58:16.421472 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f768632e-f85f-472e-b56c-5a65b507b24a-config-data\") pod \"nova-scheduler-0\" (UID: \"f768632e-f85f-472e-b56c-5a65b507b24a\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:58:16 crc kubenswrapper[5120]: I0316 16:58:16.422038 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tmw7\" (UniqueName: \"kubernetes.io/projected/f768632e-f85f-472e-b56c-5a65b507b24a-kube-api-access-5tmw7\") pod \"nova-scheduler-0\" (UID: \"f768632e-f85f-472e-b56c-5a65b507b24a\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:58:16 crc kubenswrapper[5120]: I0316 16:58:16.422492 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f768632e-f85f-472e-b56c-5a65b507b24a-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"f768632e-f85f-472e-b56c-5a65b507b24a\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:58:16 crc kubenswrapper[5120]: I0316 16:58:16.524917 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f768632e-f85f-472e-b56c-5a65b507b24a-config-data\") pod \"nova-scheduler-0\" (UID: \"f768632e-f85f-472e-b56c-5a65b507b24a\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:58:16 crc kubenswrapper[5120]: I0316 16:58:16.525062 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5tmw7\" (UniqueName: \"kubernetes.io/projected/f768632e-f85f-472e-b56c-5a65b507b24a-kube-api-access-5tmw7\") pod \"nova-scheduler-0\" (UID: \"f768632e-f85f-472e-b56c-5a65b507b24a\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:58:16 crc kubenswrapper[5120]: I0316 16:58:16.525324 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f768632e-f85f-472e-b56c-5a65b507b24a-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"f768632e-f85f-472e-b56c-5a65b507b24a\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:58:16 crc kubenswrapper[5120]: I0316 16:58:16.530067 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f768632e-f85f-472e-b56c-5a65b507b24a-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"f768632e-f85f-472e-b56c-5a65b507b24a\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:58:16 crc kubenswrapper[5120]: I0316 16:58:16.530484 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f768632e-f85f-472e-b56c-5a65b507b24a-config-data\") pod \"nova-scheduler-0\" (UID: \"f768632e-f85f-472e-b56c-5a65b507b24a\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:58:16 crc kubenswrapper[5120]: I0316 16:58:16.546169 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tmw7\" (UniqueName: \"kubernetes.io/projected/f768632e-f85f-472e-b56c-5a65b507b24a-kube-api-access-5tmw7\") pod \"nova-scheduler-0\" (UID: \"f768632e-f85f-472e-b56c-5a65b507b24a\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:58:16 crc kubenswrapper[5120]: I0316 16:58:16.674026 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="139e9c25-c27f-45e6-827d-0a7db4571231" path="/var/lib/kubelet/pods/139e9c25-c27f-45e6-827d-0a7db4571231/volumes" Mar 16 16:58:16 crc kubenswrapper[5120]: I0316 16:58:16.717661 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:58:17 crc kubenswrapper[5120]: I0316 16:58:17.155359 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:58:17 crc kubenswrapper[5120]: W0316 16:58:17.157194 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf768632e_f85f_472e_b56c_5a65b507b24a.slice/crio-3428da9acc31b8ca2102666ef6444bd6609a4243ec7498427ec6811caf293af3 WatchSource:0}: Error finding container 3428da9acc31b8ca2102666ef6444bd6609a4243ec7498427ec6811caf293af3: Status 404 returned error can't find the container with id 3428da9acc31b8ca2102666ef6444bd6609a4243ec7498427ec6811caf293af3 Mar 16 16:58:17 crc kubenswrapper[5120]: I0316 16:58:17.192718 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:58:17 crc kubenswrapper[5120]: I0316 16:58:17.243866 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/34a2f9f7-4b7e-49e2-9e12-55da2fd226f1-combined-ca-bundle\") pod \"34a2f9f7-4b7e-49e2-9e12-55da2fd226f1\" (UID: \"34a2f9f7-4b7e-49e2-9e12-55da2fd226f1\") " Mar 16 16:58:17 crc kubenswrapper[5120]: I0316 16:58:17.244304 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4n5l8\" (UniqueName: \"kubernetes.io/projected/34a2f9f7-4b7e-49e2-9e12-55da2fd226f1-kube-api-access-4n5l8\") pod \"34a2f9f7-4b7e-49e2-9e12-55da2fd226f1\" (UID: \"34a2f9f7-4b7e-49e2-9e12-55da2fd226f1\") " Mar 16 16:58:17 crc kubenswrapper[5120]: I0316 16:58:17.244403 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/34a2f9f7-4b7e-49e2-9e12-55da2fd226f1-logs\") pod \"34a2f9f7-4b7e-49e2-9e12-55da2fd226f1\" (UID: \"34a2f9f7-4b7e-49e2-9e12-55da2fd226f1\") " Mar 16 16:58:17 crc kubenswrapper[5120]: I0316 16:58:17.244591 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/34a2f9f7-4b7e-49e2-9e12-55da2fd226f1-config-data\") pod \"34a2f9f7-4b7e-49e2-9e12-55da2fd226f1\" (UID: \"34a2f9f7-4b7e-49e2-9e12-55da2fd226f1\") " Mar 16 16:58:17 crc kubenswrapper[5120]: I0316 16:58:17.249031 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34a2f9f7-4b7e-49e2-9e12-55da2fd226f1-logs" (OuterVolumeSpecName: "logs") pod "34a2f9f7-4b7e-49e2-9e12-55da2fd226f1" (UID: "34a2f9f7-4b7e-49e2-9e12-55da2fd226f1"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:58:17 crc kubenswrapper[5120]: I0316 16:58:17.250309 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34a2f9f7-4b7e-49e2-9e12-55da2fd226f1-kube-api-access-4n5l8" (OuterVolumeSpecName: "kube-api-access-4n5l8") pod "34a2f9f7-4b7e-49e2-9e12-55da2fd226f1" (UID: "34a2f9f7-4b7e-49e2-9e12-55da2fd226f1"). InnerVolumeSpecName "kube-api-access-4n5l8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:58:17 crc kubenswrapper[5120]: I0316 16:58:17.269971 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/34a2f9f7-4b7e-49e2-9e12-55da2fd226f1-config-data" (OuterVolumeSpecName: "config-data") pod "34a2f9f7-4b7e-49e2-9e12-55da2fd226f1" (UID: "34a2f9f7-4b7e-49e2-9e12-55da2fd226f1"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:58:17 crc kubenswrapper[5120]: I0316 16:58:17.277305 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/34a2f9f7-4b7e-49e2-9e12-55da2fd226f1-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "34a2f9f7-4b7e-49e2-9e12-55da2fd226f1" (UID: "34a2f9f7-4b7e-49e2-9e12-55da2fd226f1"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:58:17 crc kubenswrapper[5120]: I0316 16:58:17.279696 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"f768632e-f85f-472e-b56c-5a65b507b24a","Type":"ContainerStarted","Data":"3428da9acc31b8ca2102666ef6444bd6609a4243ec7498427ec6811caf293af3"} Mar 16 16:58:17 crc kubenswrapper[5120]: I0316 16:58:17.285708 5120 generic.go:358] "Generic (PLEG): container finished" podID="34a2f9f7-4b7e-49e2-9e12-55da2fd226f1" containerID="189a5dba567741ba61350190e1a3715b503cd56bec49680e14299325f3154841" exitCode=0 Mar 16 16:58:17 crc kubenswrapper[5120]: I0316 16:58:17.285828 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:58:17 crc kubenswrapper[5120]: I0316 16:58:17.285835 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"34a2f9f7-4b7e-49e2-9e12-55da2fd226f1","Type":"ContainerDied","Data":"189a5dba567741ba61350190e1a3715b503cd56bec49680e14299325f3154841"} Mar 16 16:58:17 crc kubenswrapper[5120]: I0316 16:58:17.285913 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"34a2f9f7-4b7e-49e2-9e12-55da2fd226f1","Type":"ContainerDied","Data":"d02fed9c651020d9519d9253902d3d1f4206eb131aefca62c97d82e1f9447af9"} Mar 16 16:58:17 crc kubenswrapper[5120]: I0316 16:58:17.285940 5120 scope.go:117] "RemoveContainer" containerID="189a5dba567741ba61350190e1a3715b503cd56bec49680e14299325f3154841" Mar 16 16:58:17 crc kubenswrapper[5120]: I0316 16:58:17.324473 5120 scope.go:117] "RemoveContainer" containerID="d71b0b7c7f865e9051c971df04a01437d271dc18a9e7504f5ad43601c4461daa" Mar 16 16:58:17 crc kubenswrapper[5120]: I0316 16:58:17.343995 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:58:17 crc kubenswrapper[5120]: I0316 16:58:17.353049 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/34a2f9f7-4b7e-49e2-9e12-55da2fd226f1-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:58:17 crc kubenswrapper[5120]: I0316 16:58:17.354900 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4n5l8\" (UniqueName: \"kubernetes.io/projected/34a2f9f7-4b7e-49e2-9e12-55da2fd226f1-kube-api-access-4n5l8\") on node \"crc\" DevicePath \"\"" Mar 16 16:58:17 crc kubenswrapper[5120]: I0316 16:58:17.355008 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/34a2f9f7-4b7e-49e2-9e12-55da2fd226f1-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:58:17 crc kubenswrapper[5120]: I0316 16:58:17.355072 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/34a2f9f7-4b7e-49e2-9e12-55da2fd226f1-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:58:17 crc kubenswrapper[5120]: I0316 16:58:17.357794 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:58:17 crc kubenswrapper[5120]: I0316 16:58:17.373888 5120 scope.go:117] "RemoveContainer" containerID="189a5dba567741ba61350190e1a3715b503cd56bec49680e14299325f3154841" Mar 16 16:58:17 crc kubenswrapper[5120]: E0316 16:58:17.377760 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"189a5dba567741ba61350190e1a3715b503cd56bec49680e14299325f3154841\": container with ID starting with 189a5dba567741ba61350190e1a3715b503cd56bec49680e14299325f3154841 not found: ID does not exist" containerID="189a5dba567741ba61350190e1a3715b503cd56bec49680e14299325f3154841" Mar 16 16:58:17 crc kubenswrapper[5120]: I0316 16:58:17.377819 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"189a5dba567741ba61350190e1a3715b503cd56bec49680e14299325f3154841"} err="failed to get container status \"189a5dba567741ba61350190e1a3715b503cd56bec49680e14299325f3154841\": rpc error: code = NotFound desc = could not find container \"189a5dba567741ba61350190e1a3715b503cd56bec49680e14299325f3154841\": container with ID starting with 189a5dba567741ba61350190e1a3715b503cd56bec49680e14299325f3154841 not found: ID does not exist" Mar 16 16:58:17 crc kubenswrapper[5120]: I0316 16:58:17.377844 5120 scope.go:117] "RemoveContainer" containerID="d71b0b7c7f865e9051c971df04a01437d271dc18a9e7504f5ad43601c4461daa" Mar 16 16:58:17 crc kubenswrapper[5120]: E0316 16:58:17.378250 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d71b0b7c7f865e9051c971df04a01437d271dc18a9e7504f5ad43601c4461daa\": container with ID starting with d71b0b7c7f865e9051c971df04a01437d271dc18a9e7504f5ad43601c4461daa not found: ID does not exist" containerID="d71b0b7c7f865e9051c971df04a01437d271dc18a9e7504f5ad43601c4461daa" Mar 16 16:58:17 crc kubenswrapper[5120]: I0316 16:58:17.378283 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d71b0b7c7f865e9051c971df04a01437d271dc18a9e7504f5ad43601c4461daa"} err="failed to get container status \"d71b0b7c7f865e9051c971df04a01437d271dc18a9e7504f5ad43601c4461daa\": rpc error: code = NotFound desc = could not find container \"d71b0b7c7f865e9051c971df04a01437d271dc18a9e7504f5ad43601c4461daa\": container with ID starting with d71b0b7c7f865e9051c971df04a01437d271dc18a9e7504f5ad43601c4461daa not found: ID does not exist" Mar 16 16:58:17 crc kubenswrapper[5120]: I0316 16:58:17.381576 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:58:17 crc kubenswrapper[5120]: I0316 16:58:17.383086 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34a2f9f7-4b7e-49e2-9e12-55da2fd226f1" containerName="nova-api-log" Mar 16 16:58:17 crc kubenswrapper[5120]: I0316 16:58:17.383668 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="34a2f9f7-4b7e-49e2-9e12-55da2fd226f1" containerName="nova-api-log" Mar 16 16:58:17 crc kubenswrapper[5120]: I0316 16:58:17.383889 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34a2f9f7-4b7e-49e2-9e12-55da2fd226f1" containerName="nova-api-api" Mar 16 16:58:17 crc kubenswrapper[5120]: I0316 16:58:17.383993 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="34a2f9f7-4b7e-49e2-9e12-55da2fd226f1" containerName="nova-api-api" Mar 16 16:58:17 crc kubenswrapper[5120]: I0316 16:58:17.384327 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="34a2f9f7-4b7e-49e2-9e12-55da2fd226f1" containerName="nova-api-log" Mar 16 16:58:17 crc kubenswrapper[5120]: I0316 16:58:17.384424 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="34a2f9f7-4b7e-49e2-9e12-55da2fd226f1" containerName="nova-api-api" Mar 16 16:58:17 crc kubenswrapper[5120]: I0316 16:58:17.389988 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:58:17 crc kubenswrapper[5120]: I0316 16:58:17.391487 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:58:17 crc kubenswrapper[5120]: I0316 16:58:17.392182 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-config-data\"" Mar 16 16:58:17 crc kubenswrapper[5120]: I0316 16:58:17.456885 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0924d0b9-6720-4d30-8970-2a071f509d93-config-data\") pod \"nova-api-0\" (UID: \"0924d0b9-6720-4d30-8970-2a071f509d93\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:58:17 crc kubenswrapper[5120]: I0316 16:58:17.457607 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtp67\" (UniqueName: \"kubernetes.io/projected/0924d0b9-6720-4d30-8970-2a071f509d93-kube-api-access-wtp67\") pod \"nova-api-0\" (UID: \"0924d0b9-6720-4d30-8970-2a071f509d93\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:58:17 crc kubenswrapper[5120]: I0316 16:58:17.457833 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0924d0b9-6720-4d30-8970-2a071f509d93-logs\") pod \"nova-api-0\" (UID: \"0924d0b9-6720-4d30-8970-2a071f509d93\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:58:17 crc kubenswrapper[5120]: I0316 16:58:17.457901 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0924d0b9-6720-4d30-8970-2a071f509d93-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"0924d0b9-6720-4d30-8970-2a071f509d93\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:58:17 crc kubenswrapper[5120]: I0316 16:58:17.560679 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0924d0b9-6720-4d30-8970-2a071f509d93-config-data\") pod \"nova-api-0\" (UID: \"0924d0b9-6720-4d30-8970-2a071f509d93\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:58:17 crc kubenswrapper[5120]: I0316 16:58:17.561143 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wtp67\" (UniqueName: \"kubernetes.io/projected/0924d0b9-6720-4d30-8970-2a071f509d93-kube-api-access-wtp67\") pod \"nova-api-0\" (UID: \"0924d0b9-6720-4d30-8970-2a071f509d93\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:58:17 crc kubenswrapper[5120]: I0316 16:58:17.561257 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0924d0b9-6720-4d30-8970-2a071f509d93-logs\") pod \"nova-api-0\" (UID: \"0924d0b9-6720-4d30-8970-2a071f509d93\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:58:17 crc kubenswrapper[5120]: I0316 16:58:17.561293 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0924d0b9-6720-4d30-8970-2a071f509d93-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"0924d0b9-6720-4d30-8970-2a071f509d93\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:58:17 crc kubenswrapper[5120]: I0316 16:58:17.562012 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0924d0b9-6720-4d30-8970-2a071f509d93-logs\") pod \"nova-api-0\" (UID: \"0924d0b9-6720-4d30-8970-2a071f509d93\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:58:17 crc kubenswrapper[5120]: I0316 16:58:17.565789 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0924d0b9-6720-4d30-8970-2a071f509d93-config-data\") pod \"nova-api-0\" (UID: \"0924d0b9-6720-4d30-8970-2a071f509d93\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:58:17 crc kubenswrapper[5120]: I0316 16:58:17.569645 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0924d0b9-6720-4d30-8970-2a071f509d93-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"0924d0b9-6720-4d30-8970-2a071f509d93\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:58:17 crc kubenswrapper[5120]: I0316 16:58:17.578116 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtp67\" (UniqueName: \"kubernetes.io/projected/0924d0b9-6720-4d30-8970-2a071f509d93-kube-api-access-wtp67\") pod \"nova-api-0\" (UID: \"0924d0b9-6720-4d30-8970-2a071f509d93\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:58:17 crc kubenswrapper[5120]: I0316 16:58:17.709211 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:58:17 crc kubenswrapper[5120]: I0316 16:58:17.714933 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:58:17 crc kubenswrapper[5120]: I0316 16:58:17.741309 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:58:18 crc kubenswrapper[5120]: W0316 16:58:18.153214 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0924d0b9_6720_4d30_8970_2a071f509d93.slice/crio-793c01a4f86a1afb13c5395f97794e3b99ef5a2780024cae1e35f5970d027fa6 WatchSource:0}: Error finding container 793c01a4f86a1afb13c5395f97794e3b99ef5a2780024cae1e35f5970d027fa6: Status 404 returned error can't find the container with id 793c01a4f86a1afb13c5395f97794e3b99ef5a2780024cae1e35f5970d027fa6 Mar 16 16:58:18 crc kubenswrapper[5120]: I0316 16:58:18.153888 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:58:18 crc kubenswrapper[5120]: I0316 16:58:18.298334 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"f768632e-f85f-472e-b56c-5a65b507b24a","Type":"ContainerStarted","Data":"243fd3cb3dcc6b5c7c11fd530e237db83fdeba7b1930f6468eba59d197b696c9"} Mar 16 16:58:18 crc kubenswrapper[5120]: I0316 16:58:18.305038 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"0924d0b9-6720-4d30-8970-2a071f509d93","Type":"ContainerStarted","Data":"793c01a4f86a1afb13c5395f97794e3b99ef5a2780024cae1e35f5970d027fa6"} Mar 16 16:58:18 crc kubenswrapper[5120]: I0316 16:58:18.319229 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-scheduler-0" podStartSLOduration=2.319204477 podStartE2EDuration="2.319204477s" podCreationTimestamp="2026-03-16 16:58:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:58:18.317995074 +0000 UTC m=+5200.471926741" watchObservedRunningTime="2026-03-16 16:58:18.319204477 +0000 UTC m=+5200.473136134" Mar 16 16:58:18 crc kubenswrapper[5120]: I0316 16:58:18.327802 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 16:58:18 crc kubenswrapper[5120]: I0316 16:58:18.678193 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="34a2f9f7-4b7e-49e2-9e12-55da2fd226f1" path="/var/lib/kubelet/pods/34a2f9f7-4b7e-49e2-9e12-55da2fd226f1/volumes" Mar 16 16:58:19 crc kubenswrapper[5120]: I0316 16:58:19.319185 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"0924d0b9-6720-4d30-8970-2a071f509d93","Type":"ContainerStarted","Data":"3542802f49ce966490552f07582d6d39588d2a337a7d77b1663886203069bdc7"} Mar 16 16:58:19 crc kubenswrapper[5120]: I0316 16:58:19.319238 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"0924d0b9-6720-4d30-8970-2a071f509d93","Type":"ContainerStarted","Data":"efb268580558da6acf7b93b07fce77b0af5f76032d478530cf491d9529fb6a84"} Mar 16 16:58:19 crc kubenswrapper[5120]: I0316 16:58:19.349479 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=2.349461596 podStartE2EDuration="2.349461596s" podCreationTimestamp="2026-03-16 16:58:17 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:58:19.345361784 +0000 UTC m=+5201.499293441" watchObservedRunningTime="2026-03-16 16:58:19.349461596 +0000 UTC m=+5201.503393253" Mar 16 16:58:21 crc kubenswrapper[5120]: I0316 16:58:21.718330 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:58:22 crc kubenswrapper[5120]: I0316 16:58:22.324419 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 16:58:22 crc kubenswrapper[5120]: I0316 16:58:22.814330 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-dcndl"] Mar 16 16:58:22 crc kubenswrapper[5120]: I0316 16:58:22.821963 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-dcndl" Mar 16 16:58:22 crc kubenswrapper[5120]: I0316 16:58:22.824596 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-manage-scripts\"" Mar 16 16:58:22 crc kubenswrapper[5120]: I0316 16:58:22.825715 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-manage-config-data\"" Mar 16 16:58:22 crc kubenswrapper[5120]: I0316 16:58:22.829803 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-dcndl"] Mar 16 16:58:23 crc kubenswrapper[5120]: I0316 16:58:23.003154 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rsnht\" (UniqueName: \"kubernetes.io/projected/d90484fe-04d6-4cf9-a940-0356b2df189d-kube-api-access-rsnht\") pod \"nova-cell1-cell-mapping-dcndl\" (UID: \"d90484fe-04d6-4cf9-a940-0356b2df189d\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-dcndl" Mar 16 16:58:23 crc kubenswrapper[5120]: I0316 16:58:23.003649 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d90484fe-04d6-4cf9-a940-0356b2df189d-config-data\") pod \"nova-cell1-cell-mapping-dcndl\" (UID: \"d90484fe-04d6-4cf9-a940-0356b2df189d\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-dcndl" Mar 16 16:58:23 crc kubenswrapper[5120]: I0316 16:58:23.003720 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d90484fe-04d6-4cf9-a940-0356b2df189d-scripts\") pod \"nova-cell1-cell-mapping-dcndl\" (UID: \"d90484fe-04d6-4cf9-a940-0356b2df189d\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-dcndl" Mar 16 16:58:23 crc kubenswrapper[5120]: I0316 16:58:23.004047 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d90484fe-04d6-4cf9-a940-0356b2df189d-combined-ca-bundle\") pod \"nova-cell1-cell-mapping-dcndl\" (UID: \"d90484fe-04d6-4cf9-a940-0356b2df189d\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-dcndl" Mar 16 16:58:23 crc kubenswrapper[5120]: I0316 16:58:23.105979 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d90484fe-04d6-4cf9-a940-0356b2df189d-scripts\") pod \"nova-cell1-cell-mapping-dcndl\" (UID: \"d90484fe-04d6-4cf9-a940-0356b2df189d\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-dcndl" Mar 16 16:58:23 crc kubenswrapper[5120]: I0316 16:58:23.106202 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d90484fe-04d6-4cf9-a940-0356b2df189d-combined-ca-bundle\") pod \"nova-cell1-cell-mapping-dcndl\" (UID: \"d90484fe-04d6-4cf9-a940-0356b2df189d\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-dcndl" Mar 16 16:58:23 crc kubenswrapper[5120]: I0316 16:58:23.106287 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rsnht\" (UniqueName: \"kubernetes.io/projected/d90484fe-04d6-4cf9-a940-0356b2df189d-kube-api-access-rsnht\") pod \"nova-cell1-cell-mapping-dcndl\" (UID: \"d90484fe-04d6-4cf9-a940-0356b2df189d\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-dcndl" Mar 16 16:58:23 crc kubenswrapper[5120]: I0316 16:58:23.106392 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d90484fe-04d6-4cf9-a940-0356b2df189d-config-data\") pod \"nova-cell1-cell-mapping-dcndl\" (UID: \"d90484fe-04d6-4cf9-a940-0356b2df189d\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-dcndl" Mar 16 16:58:23 crc kubenswrapper[5120]: I0316 16:58:23.113087 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d90484fe-04d6-4cf9-a940-0356b2df189d-scripts\") pod \"nova-cell1-cell-mapping-dcndl\" (UID: \"d90484fe-04d6-4cf9-a940-0356b2df189d\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-dcndl" Mar 16 16:58:23 crc kubenswrapper[5120]: I0316 16:58:23.115540 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d90484fe-04d6-4cf9-a940-0356b2df189d-combined-ca-bundle\") pod \"nova-cell1-cell-mapping-dcndl\" (UID: \"d90484fe-04d6-4cf9-a940-0356b2df189d\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-dcndl" Mar 16 16:58:23 crc kubenswrapper[5120]: I0316 16:58:23.117054 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d90484fe-04d6-4cf9-a940-0356b2df189d-config-data\") pod \"nova-cell1-cell-mapping-dcndl\" (UID: \"d90484fe-04d6-4cf9-a940-0356b2df189d\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-dcndl" Mar 16 16:58:23 crc kubenswrapper[5120]: I0316 16:58:23.125387 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rsnht\" (UniqueName: \"kubernetes.io/projected/d90484fe-04d6-4cf9-a940-0356b2df189d-kube-api-access-rsnht\") pod \"nova-cell1-cell-mapping-dcndl\" (UID: \"d90484fe-04d6-4cf9-a940-0356b2df189d\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-dcndl" Mar 16 16:58:23 crc kubenswrapper[5120]: I0316 16:58:23.151964 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-dcndl" Mar 16 16:58:23 crc kubenswrapper[5120]: I0316 16:58:23.603370 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-dcndl"] Mar 16 16:58:23 crc kubenswrapper[5120]: W0316 16:58:23.607871 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd90484fe_04d6_4cf9_a940_0356b2df189d.slice/crio-de565c671308a61fd20477e26b3bfd489b39a0ddaf3da880a39b68805e7bda22 WatchSource:0}: Error finding container de565c671308a61fd20477e26b3bfd489b39a0ddaf3da880a39b68805e7bda22: Status 404 returned error can't find the container with id de565c671308a61fd20477e26b3bfd489b39a0ddaf3da880a39b68805e7bda22 Mar 16 16:58:23 crc kubenswrapper[5120]: I0316 16:58:23.947276 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:58:23 crc kubenswrapper[5120]: I0316 16:58:23.947578 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:58:24 crc kubenswrapper[5120]: I0316 16:58:24.383333 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-dcndl" event={"ID":"d90484fe-04d6-4cf9-a940-0356b2df189d","Type":"ContainerStarted","Data":"1159dc9696ac2804dca778a04dee66734e301f35d4b9418fde5cf1e34d65610d"} Mar 16 16:58:24 crc kubenswrapper[5120]: I0316 16:58:24.383381 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-dcndl" event={"ID":"d90484fe-04d6-4cf9-a940-0356b2df189d","Type":"ContainerStarted","Data":"de565c671308a61fd20477e26b3bfd489b39a0ddaf3da880a39b68805e7bda22"} Mar 16 16:58:24 crc kubenswrapper[5120]: I0316 16:58:24.400936 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-dcndl" podStartSLOduration=2.4009175369999998 podStartE2EDuration="2.400917537s" podCreationTimestamp="2026-03-16 16:58:22 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:58:24.400097256 +0000 UTC m=+5206.554028943" watchObservedRunningTime="2026-03-16 16:58:24.400917537 +0000 UTC m=+5206.554849194" Mar 16 16:58:24 crc kubenswrapper[5120]: I0316 16:58:24.953084 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="1d64f64b-2324-4bc9-a7ea-808defe6ded7" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"https://10.217.1.50:8775/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 16:58:24 crc kubenswrapper[5120]: I0316 16:58:24.953872 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="1d64f64b-2324-4bc9-a7ea-808defe6ded7" containerName="nova-metadata-log" probeResult="failure" output="Get \"https://10.217.1.50:8775/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 16:58:25 crc kubenswrapper[5120]: I0316 16:58:25.664044 5120 scope.go:117] "RemoveContainer" containerID="083f72646c8d47c9c0467b39be99ddfa9c2e5900ae0a29ad53d7b39b950274b4" Mar 16 16:58:25 crc kubenswrapper[5120]: E0316 16:58:25.664365 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:58:26 crc kubenswrapper[5120]: I0316 16:58:26.718064 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:58:26 crc kubenswrapper[5120]: I0316 16:58:26.745587 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:58:27 crc kubenswrapper[5120]: I0316 16:58:27.441927 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:58:27 crc kubenswrapper[5120]: I0316 16:58:27.710273 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:58:27 crc kubenswrapper[5120]: I0316 16:58:27.712124 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:58:27 crc kubenswrapper[5120]: I0316 16:58:27.988487 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:58:28 crc kubenswrapper[5120]: I0316 16:58:28.422429 5120 generic.go:358] "Generic (PLEG): container finished" podID="d90484fe-04d6-4cf9-a940-0356b2df189d" containerID="1159dc9696ac2804dca778a04dee66734e301f35d4b9418fde5cf1e34d65610d" exitCode=0 Mar 16 16:58:28 crc kubenswrapper[5120]: I0316 16:58:28.423461 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-dcndl" event={"ID":"d90484fe-04d6-4cf9-a940-0356b2df189d","Type":"ContainerDied","Data":"1159dc9696ac2804dca778a04dee66734e301f35d4b9418fde5cf1e34d65610d"} Mar 16 16:58:28 crc kubenswrapper[5120]: I0316 16:58:28.750977 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="0924d0b9-6720-4d30-8970-2a071f509d93" containerName="nova-api-log" probeResult="failure" output="Get \"http://10.217.1.53:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 16:58:28 crc kubenswrapper[5120]: I0316 16:58:28.752899 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="0924d0b9-6720-4d30-8970-2a071f509d93" containerName="nova-api-api" probeResult="failure" output="Get \"http://10.217.1.53:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 16:58:29 crc kubenswrapper[5120]: I0316 16:58:29.854576 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-dcndl" Mar 16 16:58:30 crc kubenswrapper[5120]: I0316 16:58:30.005732 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d90484fe-04d6-4cf9-a940-0356b2df189d-config-data\") pod \"d90484fe-04d6-4cf9-a940-0356b2df189d\" (UID: \"d90484fe-04d6-4cf9-a940-0356b2df189d\") " Mar 16 16:58:30 crc kubenswrapper[5120]: I0316 16:58:30.005954 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d90484fe-04d6-4cf9-a940-0356b2df189d-combined-ca-bundle\") pod \"d90484fe-04d6-4cf9-a940-0356b2df189d\" (UID: \"d90484fe-04d6-4cf9-a940-0356b2df189d\") " Mar 16 16:58:30 crc kubenswrapper[5120]: I0316 16:58:30.006203 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d90484fe-04d6-4cf9-a940-0356b2df189d-scripts\") pod \"d90484fe-04d6-4cf9-a940-0356b2df189d\" (UID: \"d90484fe-04d6-4cf9-a940-0356b2df189d\") " Mar 16 16:58:30 crc kubenswrapper[5120]: I0316 16:58:30.006254 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rsnht\" (UniqueName: \"kubernetes.io/projected/d90484fe-04d6-4cf9-a940-0356b2df189d-kube-api-access-rsnht\") pod \"d90484fe-04d6-4cf9-a940-0356b2df189d\" (UID: \"d90484fe-04d6-4cf9-a940-0356b2df189d\") " Mar 16 16:58:30 crc kubenswrapper[5120]: I0316 16:58:30.016538 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d90484fe-04d6-4cf9-a940-0356b2df189d-scripts" (OuterVolumeSpecName: "scripts") pod "d90484fe-04d6-4cf9-a940-0356b2df189d" (UID: "d90484fe-04d6-4cf9-a940-0356b2df189d"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:58:30 crc kubenswrapper[5120]: I0316 16:58:30.017000 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d90484fe-04d6-4cf9-a940-0356b2df189d-kube-api-access-rsnht" (OuterVolumeSpecName: "kube-api-access-rsnht") pod "d90484fe-04d6-4cf9-a940-0356b2df189d" (UID: "d90484fe-04d6-4cf9-a940-0356b2df189d"). InnerVolumeSpecName "kube-api-access-rsnht". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:58:30 crc kubenswrapper[5120]: I0316 16:58:30.050850 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d90484fe-04d6-4cf9-a940-0356b2df189d-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "d90484fe-04d6-4cf9-a940-0356b2df189d" (UID: "d90484fe-04d6-4cf9-a940-0356b2df189d"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:58:30 crc kubenswrapper[5120]: I0316 16:58:30.057302 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d90484fe-04d6-4cf9-a940-0356b2df189d-config-data" (OuterVolumeSpecName: "config-data") pod "d90484fe-04d6-4cf9-a940-0356b2df189d" (UID: "d90484fe-04d6-4cf9-a940-0356b2df189d"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:58:30 crc kubenswrapper[5120]: I0316 16:58:30.109380 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d90484fe-04d6-4cf9-a940-0356b2df189d-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:58:30 crc kubenswrapper[5120]: I0316 16:58:30.109428 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rsnht\" (UniqueName: \"kubernetes.io/projected/d90484fe-04d6-4cf9-a940-0356b2df189d-kube-api-access-rsnht\") on node \"crc\" DevicePath \"\"" Mar 16 16:58:30 crc kubenswrapper[5120]: I0316 16:58:30.109441 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d90484fe-04d6-4cf9-a940-0356b2df189d-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:58:30 crc kubenswrapper[5120]: I0316 16:58:30.109452 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d90484fe-04d6-4cf9-a940-0356b2df189d-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:58:30 crc kubenswrapper[5120]: I0316 16:58:30.444892 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-dcndl" Mar 16 16:58:30 crc kubenswrapper[5120]: I0316 16:58:30.444952 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-dcndl" event={"ID":"d90484fe-04d6-4cf9-a940-0356b2df189d","Type":"ContainerDied","Data":"de565c671308a61fd20477e26b3bfd489b39a0ddaf3da880a39b68805e7bda22"} Mar 16 16:58:30 crc kubenswrapper[5120]: I0316 16:58:30.445312 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="de565c671308a61fd20477e26b3bfd489b39a0ddaf3da880a39b68805e7bda22" Mar 16 16:58:30 crc kubenswrapper[5120]: I0316 16:58:30.548982 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:58:30 crc kubenswrapper[5120]: I0316 16:58:30.549256 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="0924d0b9-6720-4d30-8970-2a071f509d93" containerName="nova-api-log" containerID="cri-o://efb268580558da6acf7b93b07fce77b0af5f76032d478530cf491d9529fb6a84" gracePeriod=30 Mar 16 16:58:30 crc kubenswrapper[5120]: I0316 16:58:30.549331 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="0924d0b9-6720-4d30-8970-2a071f509d93" containerName="nova-api-api" containerID="cri-o://3542802f49ce966490552f07582d6d39588d2a337a7d77b1663886203069bdc7" gracePeriod=30 Mar 16 16:58:30 crc kubenswrapper[5120]: I0316 16:58:30.568614 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:58:30 crc kubenswrapper[5120]: I0316 16:58:30.570755 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="f768632e-f85f-472e-b56c-5a65b507b24a" containerName="nova-scheduler-scheduler" containerID="cri-o://243fd3cb3dcc6b5c7c11fd530e237db83fdeba7b1930f6468eba59d197b696c9" gracePeriod=30 Mar 16 16:58:30 crc kubenswrapper[5120]: I0316 16:58:30.655125 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:58:30 crc kubenswrapper[5120]: I0316 16:58:30.655449 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="1d64f64b-2324-4bc9-a7ea-808defe6ded7" containerName="nova-metadata-log" containerID="cri-o://e9233709e8767380d34c4871bcf2ecb0d69042131434ddf51deb4bf3c87bf77f" gracePeriod=30 Mar 16 16:58:30 crc kubenswrapper[5120]: I0316 16:58:30.655538 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="1d64f64b-2324-4bc9-a7ea-808defe6ded7" containerName="nova-metadata-metadata" containerID="cri-o://3e20032c5d98a5d264101bb17b2284e66b72b09d341377119d43855b8f9d410b" gracePeriod=30 Mar 16 16:58:31 crc kubenswrapper[5120]: I0316 16:58:31.455236 5120 generic.go:358] "Generic (PLEG): container finished" podID="0924d0b9-6720-4d30-8970-2a071f509d93" containerID="efb268580558da6acf7b93b07fce77b0af5f76032d478530cf491d9529fb6a84" exitCode=143 Mar 16 16:58:31 crc kubenswrapper[5120]: I0316 16:58:31.455590 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"0924d0b9-6720-4d30-8970-2a071f509d93","Type":"ContainerDied","Data":"efb268580558da6acf7b93b07fce77b0af5f76032d478530cf491d9529fb6a84"} Mar 16 16:58:31 crc kubenswrapper[5120]: I0316 16:58:31.457473 5120 generic.go:358] "Generic (PLEG): container finished" podID="1d64f64b-2324-4bc9-a7ea-808defe6ded7" containerID="e9233709e8767380d34c4871bcf2ecb0d69042131434ddf51deb4bf3c87bf77f" exitCode=143 Mar 16 16:58:31 crc kubenswrapper[5120]: I0316 16:58:31.457515 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"1d64f64b-2324-4bc9-a7ea-808defe6ded7","Type":"ContainerDied","Data":"e9233709e8767380d34c4871bcf2ecb0d69042131434ddf51deb4bf3c87bf77f"} Mar 16 16:58:31 crc kubenswrapper[5120]: I0316 16:58:31.946663 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:58:31 crc kubenswrapper[5120]: I0316 16:58:31.946717 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:58:32 crc kubenswrapper[5120]: E0316 16:58:32.414317 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="243fd3cb3dcc6b5c7c11fd530e237db83fdeba7b1930f6468eba59d197b696c9" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:58:32 crc kubenswrapper[5120]: E0316 16:58:32.415723 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="243fd3cb3dcc6b5c7c11fd530e237db83fdeba7b1930f6468eba59d197b696c9" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:58:32 crc kubenswrapper[5120]: E0316 16:58:32.416835 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="243fd3cb3dcc6b5c7c11fd530e237db83fdeba7b1930f6468eba59d197b696c9" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 16:58:32 crc kubenswrapper[5120]: E0316 16:58:32.416865 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="f768632e-f85f-472e-b56c-5a65b507b24a" containerName="nova-scheduler-scheduler" probeResult="unknown" Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.073453 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.156729 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.213255 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0924d0b9-6720-4d30-8970-2a071f509d93-logs\") pod \"0924d0b9-6720-4d30-8970-2a071f509d93\" (UID: \"0924d0b9-6720-4d30-8970-2a071f509d93\") " Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.213724 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wtp67\" (UniqueName: \"kubernetes.io/projected/0924d0b9-6720-4d30-8970-2a071f509d93-kube-api-access-wtp67\") pod \"0924d0b9-6720-4d30-8970-2a071f509d93\" (UID: \"0924d0b9-6720-4d30-8970-2a071f509d93\") " Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.213895 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0924d0b9-6720-4d30-8970-2a071f509d93-config-data\") pod \"0924d0b9-6720-4d30-8970-2a071f509d93\" (UID: \"0924d0b9-6720-4d30-8970-2a071f509d93\") " Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.213969 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0924d0b9-6720-4d30-8970-2a071f509d93-combined-ca-bundle\") pod \"0924d0b9-6720-4d30-8970-2a071f509d93\" (UID: \"0924d0b9-6720-4d30-8970-2a071f509d93\") " Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.214165 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0924d0b9-6720-4d30-8970-2a071f509d93-logs" (OuterVolumeSpecName: "logs") pod "0924d0b9-6720-4d30-8970-2a071f509d93" (UID: "0924d0b9-6720-4d30-8970-2a071f509d93"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.215968 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0924d0b9-6720-4d30-8970-2a071f509d93-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.220591 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0924d0b9-6720-4d30-8970-2a071f509d93-kube-api-access-wtp67" (OuterVolumeSpecName: "kube-api-access-wtp67") pod "0924d0b9-6720-4d30-8970-2a071f509d93" (UID: "0924d0b9-6720-4d30-8970-2a071f509d93"). InnerVolumeSpecName "kube-api-access-wtp67". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.229464 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.247005 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0924d0b9-6720-4d30-8970-2a071f509d93-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "0924d0b9-6720-4d30-8970-2a071f509d93" (UID: "0924d0b9-6720-4d30-8970-2a071f509d93"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.248412 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0924d0b9-6720-4d30-8970-2a071f509d93-config-data" (OuterVolumeSpecName: "config-data") pod "0924d0b9-6720-4d30-8970-2a071f509d93" (UID: "0924d0b9-6720-4d30-8970-2a071f509d93"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.317679 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f768632e-f85f-472e-b56c-5a65b507b24a-config-data\") pod \"f768632e-f85f-472e-b56c-5a65b507b24a\" (UID: \"f768632e-f85f-472e-b56c-5a65b507b24a\") " Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.317814 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/1d64f64b-2324-4bc9-a7ea-808defe6ded7-logs\") pod \"1d64f64b-2324-4bc9-a7ea-808defe6ded7\" (UID: \"1d64f64b-2324-4bc9-a7ea-808defe6ded7\") " Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.317913 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f768632e-f85f-472e-b56c-5a65b507b24a-combined-ca-bundle\") pod \"f768632e-f85f-472e-b56c-5a65b507b24a\" (UID: \"f768632e-f85f-472e-b56c-5a65b507b24a\") " Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.317979 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/1d64f64b-2324-4bc9-a7ea-808defe6ded7-nova-metadata-tls-certs\") pod \"1d64f64b-2324-4bc9-a7ea-808defe6ded7\" (UID: \"1d64f64b-2324-4bc9-a7ea-808defe6ded7\") " Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.318150 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5tmw7\" (UniqueName: \"kubernetes.io/projected/f768632e-f85f-472e-b56c-5a65b507b24a-kube-api-access-5tmw7\") pod \"f768632e-f85f-472e-b56c-5a65b507b24a\" (UID: \"f768632e-f85f-472e-b56c-5a65b507b24a\") " Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.318248 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1d64f64b-2324-4bc9-a7ea-808defe6ded7-combined-ca-bundle\") pod \"1d64f64b-2324-4bc9-a7ea-808defe6ded7\" (UID: \"1d64f64b-2324-4bc9-a7ea-808defe6ded7\") " Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.318619 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mdt5f\" (UniqueName: \"kubernetes.io/projected/1d64f64b-2324-4bc9-a7ea-808defe6ded7-kube-api-access-mdt5f\") pod \"1d64f64b-2324-4bc9-a7ea-808defe6ded7\" (UID: \"1d64f64b-2324-4bc9-a7ea-808defe6ded7\") " Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.318888 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1d64f64b-2324-4bc9-a7ea-808defe6ded7-config-data\") pod \"1d64f64b-2324-4bc9-a7ea-808defe6ded7\" (UID: \"1d64f64b-2324-4bc9-a7ea-808defe6ded7\") " Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.319792 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d64f64b-2324-4bc9-a7ea-808defe6ded7-logs" (OuterVolumeSpecName: "logs") pod "1d64f64b-2324-4bc9-a7ea-808defe6ded7" (UID: "1d64f64b-2324-4bc9-a7ea-808defe6ded7"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.320274 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/1d64f64b-2324-4bc9-a7ea-808defe6ded7-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.320303 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wtp67\" (UniqueName: \"kubernetes.io/projected/0924d0b9-6720-4d30-8970-2a071f509d93-kube-api-access-wtp67\") on node \"crc\" DevicePath \"\"" Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.320319 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0924d0b9-6720-4d30-8970-2a071f509d93-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.320359 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0924d0b9-6720-4d30-8970-2a071f509d93-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.325071 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d64f64b-2324-4bc9-a7ea-808defe6ded7-kube-api-access-mdt5f" (OuterVolumeSpecName: "kube-api-access-mdt5f") pod "1d64f64b-2324-4bc9-a7ea-808defe6ded7" (UID: "1d64f64b-2324-4bc9-a7ea-808defe6ded7"). InnerVolumeSpecName "kube-api-access-mdt5f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.325240 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f768632e-f85f-472e-b56c-5a65b507b24a-kube-api-access-5tmw7" (OuterVolumeSpecName: "kube-api-access-5tmw7") pod "f768632e-f85f-472e-b56c-5a65b507b24a" (UID: "f768632e-f85f-472e-b56c-5a65b507b24a"). InnerVolumeSpecName "kube-api-access-5tmw7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.351409 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1d64f64b-2324-4bc9-a7ea-808defe6ded7-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "1d64f64b-2324-4bc9-a7ea-808defe6ded7" (UID: "1d64f64b-2324-4bc9-a7ea-808defe6ded7"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.354300 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f768632e-f85f-472e-b56c-5a65b507b24a-config-data" (OuterVolumeSpecName: "config-data") pod "f768632e-f85f-472e-b56c-5a65b507b24a" (UID: "f768632e-f85f-472e-b56c-5a65b507b24a"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.358743 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f768632e-f85f-472e-b56c-5a65b507b24a-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f768632e-f85f-472e-b56c-5a65b507b24a" (UID: "f768632e-f85f-472e-b56c-5a65b507b24a"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.374961 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1d64f64b-2324-4bc9-a7ea-808defe6ded7-config-data" (OuterVolumeSpecName: "config-data") pod "1d64f64b-2324-4bc9-a7ea-808defe6ded7" (UID: "1d64f64b-2324-4bc9-a7ea-808defe6ded7"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.382278 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1d64f64b-2324-4bc9-a7ea-808defe6ded7-nova-metadata-tls-certs" (OuterVolumeSpecName: "nova-metadata-tls-certs") pod "1d64f64b-2324-4bc9-a7ea-808defe6ded7" (UID: "1d64f64b-2324-4bc9-a7ea-808defe6ded7"). InnerVolumeSpecName "nova-metadata-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.422586 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1d64f64b-2324-4bc9-a7ea-808defe6ded7-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.422633 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f768632e-f85f-472e-b56c-5a65b507b24a-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.422648 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f768632e-f85f-472e-b56c-5a65b507b24a-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.422661 5120 reconciler_common.go:299] "Volume detached for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/1d64f64b-2324-4bc9-a7ea-808defe6ded7-nova-metadata-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.422675 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5tmw7\" (UniqueName: \"kubernetes.io/projected/f768632e-f85f-472e-b56c-5a65b507b24a-kube-api-access-5tmw7\") on node \"crc\" DevicePath \"\"" Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.422687 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1d64f64b-2324-4bc9-a7ea-808defe6ded7-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.422697 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mdt5f\" (UniqueName: \"kubernetes.io/projected/1d64f64b-2324-4bc9-a7ea-808defe6ded7-kube-api-access-mdt5f\") on node \"crc\" DevicePath \"\"" Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.492103 5120 generic.go:358] "Generic (PLEG): container finished" podID="0924d0b9-6720-4d30-8970-2a071f509d93" containerID="3542802f49ce966490552f07582d6d39588d2a337a7d77b1663886203069bdc7" exitCode=0 Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.492519 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.492541 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"0924d0b9-6720-4d30-8970-2a071f509d93","Type":"ContainerDied","Data":"3542802f49ce966490552f07582d6d39588d2a337a7d77b1663886203069bdc7"} Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.492597 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"0924d0b9-6720-4d30-8970-2a071f509d93","Type":"ContainerDied","Data":"793c01a4f86a1afb13c5395f97794e3b99ef5a2780024cae1e35f5970d027fa6"} Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.492682 5120 scope.go:117] "RemoveContainer" containerID="3542802f49ce966490552f07582d6d39588d2a337a7d77b1663886203069bdc7" Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.497368 5120 generic.go:358] "Generic (PLEG): container finished" podID="f768632e-f85f-472e-b56c-5a65b507b24a" containerID="243fd3cb3dcc6b5c7c11fd530e237db83fdeba7b1930f6468eba59d197b696c9" exitCode=0 Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.497421 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.497436 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"f768632e-f85f-472e-b56c-5a65b507b24a","Type":"ContainerDied","Data":"243fd3cb3dcc6b5c7c11fd530e237db83fdeba7b1930f6468eba59d197b696c9"} Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.497490 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"f768632e-f85f-472e-b56c-5a65b507b24a","Type":"ContainerDied","Data":"3428da9acc31b8ca2102666ef6444bd6609a4243ec7498427ec6811caf293af3"} Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.504916 5120 generic.go:358] "Generic (PLEG): container finished" podID="1d64f64b-2324-4bc9-a7ea-808defe6ded7" containerID="3e20032c5d98a5d264101bb17b2284e66b72b09d341377119d43855b8f9d410b" exitCode=0 Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.505089 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"1d64f64b-2324-4bc9-a7ea-808defe6ded7","Type":"ContainerDied","Data":"3e20032c5d98a5d264101bb17b2284e66b72b09d341377119d43855b8f9d410b"} Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.505121 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"1d64f64b-2324-4bc9-a7ea-808defe6ded7","Type":"ContainerDied","Data":"c7410724818c90378dca8df13f86186cfcbde7511c420257b8694ecefa875043"} Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.505155 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.538839 5120 scope.go:117] "RemoveContainer" containerID="efb268580558da6acf7b93b07fce77b0af5f76032d478530cf491d9529fb6a84" Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.574973 5120 scope.go:117] "RemoveContainer" containerID="3542802f49ce966490552f07582d6d39588d2a337a7d77b1663886203069bdc7" Mar 16 16:58:34 crc kubenswrapper[5120]: E0316 16:58:34.575492 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3542802f49ce966490552f07582d6d39588d2a337a7d77b1663886203069bdc7\": container with ID starting with 3542802f49ce966490552f07582d6d39588d2a337a7d77b1663886203069bdc7 not found: ID does not exist" containerID="3542802f49ce966490552f07582d6d39588d2a337a7d77b1663886203069bdc7" Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.575543 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3542802f49ce966490552f07582d6d39588d2a337a7d77b1663886203069bdc7"} err="failed to get container status \"3542802f49ce966490552f07582d6d39588d2a337a7d77b1663886203069bdc7\": rpc error: code = NotFound desc = could not find container \"3542802f49ce966490552f07582d6d39588d2a337a7d77b1663886203069bdc7\": container with ID starting with 3542802f49ce966490552f07582d6d39588d2a337a7d77b1663886203069bdc7 not found: ID does not exist" Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.575568 5120 scope.go:117] "RemoveContainer" containerID="efb268580558da6acf7b93b07fce77b0af5f76032d478530cf491d9529fb6a84" Mar 16 16:58:34 crc kubenswrapper[5120]: E0316 16:58:34.576040 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"efb268580558da6acf7b93b07fce77b0af5f76032d478530cf491d9529fb6a84\": container with ID starting with efb268580558da6acf7b93b07fce77b0af5f76032d478530cf491d9529fb6a84 not found: ID does not exist" containerID="efb268580558da6acf7b93b07fce77b0af5f76032d478530cf491d9529fb6a84" Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.576077 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"efb268580558da6acf7b93b07fce77b0af5f76032d478530cf491d9529fb6a84"} err="failed to get container status \"efb268580558da6acf7b93b07fce77b0af5f76032d478530cf491d9529fb6a84\": rpc error: code = NotFound desc = could not find container \"efb268580558da6acf7b93b07fce77b0af5f76032d478530cf491d9529fb6a84\": container with ID starting with efb268580558da6acf7b93b07fce77b0af5f76032d478530cf491d9529fb6a84 not found: ID does not exist" Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.576096 5120 scope.go:117] "RemoveContainer" containerID="243fd3cb3dcc6b5c7c11fd530e237db83fdeba7b1930f6468eba59d197b696c9" Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.582372 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.613861 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.631503 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.642957 5120 scope.go:117] "RemoveContainer" containerID="243fd3cb3dcc6b5c7c11fd530e237db83fdeba7b1930f6468eba59d197b696c9" Mar 16 16:58:34 crc kubenswrapper[5120]: E0316 16:58:34.643396 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"243fd3cb3dcc6b5c7c11fd530e237db83fdeba7b1930f6468eba59d197b696c9\": container with ID starting with 243fd3cb3dcc6b5c7c11fd530e237db83fdeba7b1930f6468eba59d197b696c9 not found: ID does not exist" containerID="243fd3cb3dcc6b5c7c11fd530e237db83fdeba7b1930f6468eba59d197b696c9" Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.643427 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"243fd3cb3dcc6b5c7c11fd530e237db83fdeba7b1930f6468eba59d197b696c9"} err="failed to get container status \"243fd3cb3dcc6b5c7c11fd530e237db83fdeba7b1930f6468eba59d197b696c9\": rpc error: code = NotFound desc = could not find container \"243fd3cb3dcc6b5c7c11fd530e237db83fdeba7b1930f6468eba59d197b696c9\": container with ID starting with 243fd3cb3dcc6b5c7c11fd530e237db83fdeba7b1930f6468eba59d197b696c9 not found: ID does not exist" Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.643449 5120 scope.go:117] "RemoveContainer" containerID="3e20032c5d98a5d264101bb17b2284e66b72b09d341377119d43855b8f9d410b" Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.644193 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.656992 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.658382 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0924d0b9-6720-4d30-8970-2a071f509d93" containerName="nova-api-log" Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.658499 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="0924d0b9-6720-4d30-8970-2a071f509d93" containerName="nova-api-log" Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.658571 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0924d0b9-6720-4d30-8970-2a071f509d93" containerName="nova-api-api" Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.658633 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="0924d0b9-6720-4d30-8970-2a071f509d93" containerName="nova-api-api" Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.658712 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d64f64b-2324-4bc9-a7ea-808defe6ded7" containerName="nova-metadata-metadata" Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.658793 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d64f64b-2324-4bc9-a7ea-808defe6ded7" containerName="nova-metadata-metadata" Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.658871 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d90484fe-04d6-4cf9-a940-0356b2df189d" containerName="nova-manage" Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.658937 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="d90484fe-04d6-4cf9-a940-0356b2df189d" containerName="nova-manage" Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.659010 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d64f64b-2324-4bc9-a7ea-808defe6ded7" containerName="nova-metadata-log" Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.659114 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d64f64b-2324-4bc9-a7ea-808defe6ded7" containerName="nova-metadata-log" Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.659241 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f768632e-f85f-472e-b56c-5a65b507b24a" containerName="nova-scheduler-scheduler" Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.659325 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f768632e-f85f-472e-b56c-5a65b507b24a" containerName="nova-scheduler-scheduler" Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.659688 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f768632e-f85f-472e-b56c-5a65b507b24a" containerName="nova-scheduler-scheduler" Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.659825 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="0924d0b9-6720-4d30-8970-2a071f509d93" containerName="nova-api-log" Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.659915 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1d64f64b-2324-4bc9-a7ea-808defe6ded7" containerName="nova-metadata-log" Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.659995 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1d64f64b-2324-4bc9-a7ea-808defe6ded7" containerName="nova-metadata-metadata" Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.660080 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="0924d0b9-6720-4d30-8970-2a071f509d93" containerName="nova-api-api" Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.660154 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="d90484fe-04d6-4cf9-a940-0356b2df189d" containerName="nova-manage" Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.668230 5120 scope.go:117] "RemoveContainer" containerID="e9233709e8767380d34c4871bcf2ecb0d69042131434ddf51deb4bf3c87bf77f" Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.672159 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.672353 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.678212 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-config-data\"" Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.691889 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0924d0b9-6720-4d30-8970-2a071f509d93" path="/var/lib/kubelet/pods/0924d0b9-6720-4d30-8970-2a071f509d93/volumes" Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.692801 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f768632e-f85f-472e-b56c-5a65b507b24a" path="/var/lib/kubelet/pods/f768632e-f85f-472e-b56c-5a65b507b24a/volumes" Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.693511 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.693541 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.697255 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.704179 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.705221 5120 scope.go:117] "RemoveContainer" containerID="3e20032c5d98a5d264101bb17b2284e66b72b09d341377119d43855b8f9d410b" Mar 16 16:58:34 crc kubenswrapper[5120]: E0316 16:58:34.706179 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e20032c5d98a5d264101bb17b2284e66b72b09d341377119d43855b8f9d410b\": container with ID starting with 3e20032c5d98a5d264101bb17b2284e66b72b09d341377119d43855b8f9d410b not found: ID does not exist" containerID="3e20032c5d98a5d264101bb17b2284e66b72b09d341377119d43855b8f9d410b" Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.706211 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e20032c5d98a5d264101bb17b2284e66b72b09d341377119d43855b8f9d410b"} err="failed to get container status \"3e20032c5d98a5d264101bb17b2284e66b72b09d341377119d43855b8f9d410b\": rpc error: code = NotFound desc = could not find container \"3e20032c5d98a5d264101bb17b2284e66b72b09d341377119d43855b8f9d410b\": container with ID starting with 3e20032c5d98a5d264101bb17b2284e66b72b09d341377119d43855b8f9d410b not found: ID does not exist" Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.706232 5120 scope.go:117] "RemoveContainer" containerID="e9233709e8767380d34c4871bcf2ecb0d69042131434ddf51deb4bf3c87bf77f" Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.706265 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-scheduler-config-data\"" Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.707058 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:58:34 crc kubenswrapper[5120]: E0316 16:58:34.708111 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e9233709e8767380d34c4871bcf2ecb0d69042131434ddf51deb4bf3c87bf77f\": container with ID starting with e9233709e8767380d34c4871bcf2ecb0d69042131434ddf51deb4bf3c87bf77f not found: ID does not exist" containerID="e9233709e8767380d34c4871bcf2ecb0d69042131434ddf51deb4bf3c87bf77f" Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.708144 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9233709e8767380d34c4871bcf2ecb0d69042131434ddf51deb4bf3c87bf77f"} err="failed to get container status \"e9233709e8767380d34c4871bcf2ecb0d69042131434ddf51deb4bf3c87bf77f\": rpc error: code = NotFound desc = could not find container \"e9233709e8767380d34c4871bcf2ecb0d69042131434ddf51deb4bf3c87bf77f\": container with ID starting with e9233709e8767380d34c4871bcf2ecb0d69042131434ddf51deb4bf3c87bf77f not found: ID does not exist" Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.713093 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.725902 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-metadata-internal-svc\"" Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.728590 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.730554 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-metadata-config-data\"" Mar 16 16:58:34 crc kubenswrapper[5120]: E0316 16:58:34.751311 5120 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1d64f64b_2324_4bc9_a7ea_808defe6ded7.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0924d0b9_6720_4d30_8970_2a071f509d93.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf768632e_f85f_472e_b56c_5a65b507b24a.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1d64f64b_2324_4bc9_a7ea_808defe6ded7.slice/crio-c7410724818c90378dca8df13f86186cfcbde7511c420257b8694ecefa875043\": RecentStats: unable to find data in memory cache]" Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.751462 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.848565 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bd098877-cdbc-4903-a92d-b22a3150a9d2-config-data\") pod \"nova-api-0\" (UID: \"bd098877-cdbc-4903-a92d-b22a3150a9d2\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.848718 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bd098877-cdbc-4903-a92d-b22a3150a9d2-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"bd098877-cdbc-4903-a92d-b22a3150a9d2\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.848949 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a19b5964-8116-49bd-9181-8eb2fe61703e-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"a19b5964-8116-49bd-9181-8eb2fe61703e\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.849065 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e2ad712e-f6f5-4942-94b9-635bbc53da15-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"e2ad712e-f6f5-4942-94b9-635bbc53da15\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.849144 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/e2ad712e-f6f5-4942-94b9-635bbc53da15-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"e2ad712e-f6f5-4942-94b9-635bbc53da15\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.849255 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a19b5964-8116-49bd-9181-8eb2fe61703e-config-data\") pod \"nova-scheduler-0\" (UID: \"a19b5964-8116-49bd-9181-8eb2fe61703e\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.849310 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtkkq\" (UniqueName: \"kubernetes.io/projected/a19b5964-8116-49bd-9181-8eb2fe61703e-kube-api-access-rtkkq\") pod \"nova-scheduler-0\" (UID: \"a19b5964-8116-49bd-9181-8eb2fe61703e\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.849387 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dsdm\" (UniqueName: \"kubernetes.io/projected/bd098877-cdbc-4903-a92d-b22a3150a9d2-kube-api-access-6dsdm\") pod \"nova-api-0\" (UID: \"bd098877-cdbc-4903-a92d-b22a3150a9d2\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.849495 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/bd098877-cdbc-4903-a92d-b22a3150a9d2-logs\") pod \"nova-api-0\" (UID: \"bd098877-cdbc-4903-a92d-b22a3150a9d2\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.849574 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e2ad712e-f6f5-4942-94b9-635bbc53da15-config-data\") pod \"nova-metadata-0\" (UID: \"e2ad712e-f6f5-4942-94b9-635bbc53da15\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.850116 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sh4dz\" (UniqueName: \"kubernetes.io/projected/e2ad712e-f6f5-4942-94b9-635bbc53da15-kube-api-access-sh4dz\") pod \"nova-metadata-0\" (UID: \"e2ad712e-f6f5-4942-94b9-635bbc53da15\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.850168 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e2ad712e-f6f5-4942-94b9-635bbc53da15-logs\") pod \"nova-metadata-0\" (UID: \"e2ad712e-f6f5-4942-94b9-635bbc53da15\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.952680 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6dsdm\" (UniqueName: \"kubernetes.io/projected/bd098877-cdbc-4903-a92d-b22a3150a9d2-kube-api-access-6dsdm\") pod \"nova-api-0\" (UID: \"bd098877-cdbc-4903-a92d-b22a3150a9d2\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.952820 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/bd098877-cdbc-4903-a92d-b22a3150a9d2-logs\") pod \"nova-api-0\" (UID: \"bd098877-cdbc-4903-a92d-b22a3150a9d2\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.953035 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e2ad712e-f6f5-4942-94b9-635bbc53da15-config-data\") pod \"nova-metadata-0\" (UID: \"e2ad712e-f6f5-4942-94b9-635bbc53da15\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.953284 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/bd098877-cdbc-4903-a92d-b22a3150a9d2-logs\") pod \"nova-api-0\" (UID: \"bd098877-cdbc-4903-a92d-b22a3150a9d2\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.953322 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sh4dz\" (UniqueName: \"kubernetes.io/projected/e2ad712e-f6f5-4942-94b9-635bbc53da15-kube-api-access-sh4dz\") pod \"nova-metadata-0\" (UID: \"e2ad712e-f6f5-4942-94b9-635bbc53da15\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.953373 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e2ad712e-f6f5-4942-94b9-635bbc53da15-logs\") pod \"nova-metadata-0\" (UID: \"e2ad712e-f6f5-4942-94b9-635bbc53da15\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.953581 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bd098877-cdbc-4903-a92d-b22a3150a9d2-config-data\") pod \"nova-api-0\" (UID: \"bd098877-cdbc-4903-a92d-b22a3150a9d2\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.953648 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bd098877-cdbc-4903-a92d-b22a3150a9d2-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"bd098877-cdbc-4903-a92d-b22a3150a9d2\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.953747 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a19b5964-8116-49bd-9181-8eb2fe61703e-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"a19b5964-8116-49bd-9181-8eb2fe61703e\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.953776 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e2ad712e-f6f5-4942-94b9-635bbc53da15-logs\") pod \"nova-metadata-0\" (UID: \"e2ad712e-f6f5-4942-94b9-635bbc53da15\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.953835 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e2ad712e-f6f5-4942-94b9-635bbc53da15-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"e2ad712e-f6f5-4942-94b9-635bbc53da15\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.953909 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/e2ad712e-f6f5-4942-94b9-635bbc53da15-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"e2ad712e-f6f5-4942-94b9-635bbc53da15\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.953968 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a19b5964-8116-49bd-9181-8eb2fe61703e-config-data\") pod \"nova-scheduler-0\" (UID: \"a19b5964-8116-49bd-9181-8eb2fe61703e\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.954007 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rtkkq\" (UniqueName: \"kubernetes.io/projected/a19b5964-8116-49bd-9181-8eb2fe61703e-kube-api-access-rtkkq\") pod \"nova-scheduler-0\" (UID: \"a19b5964-8116-49bd-9181-8eb2fe61703e\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.958996 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e2ad712e-f6f5-4942-94b9-635bbc53da15-config-data\") pod \"nova-metadata-0\" (UID: \"e2ad712e-f6f5-4942-94b9-635bbc53da15\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.959296 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e2ad712e-f6f5-4942-94b9-635bbc53da15-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"e2ad712e-f6f5-4942-94b9-635bbc53da15\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.966295 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a19b5964-8116-49bd-9181-8eb2fe61703e-config-data\") pod \"nova-scheduler-0\" (UID: \"a19b5964-8116-49bd-9181-8eb2fe61703e\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.970442 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/e2ad712e-f6f5-4942-94b9-635bbc53da15-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"e2ad712e-f6f5-4942-94b9-635bbc53da15\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.970702 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a19b5964-8116-49bd-9181-8eb2fe61703e-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"a19b5964-8116-49bd-9181-8eb2fe61703e\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.972096 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bd098877-cdbc-4903-a92d-b22a3150a9d2-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"bd098877-cdbc-4903-a92d-b22a3150a9d2\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.972285 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bd098877-cdbc-4903-a92d-b22a3150a9d2-config-data\") pod \"nova-api-0\" (UID: \"bd098877-cdbc-4903-a92d-b22a3150a9d2\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.973877 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtkkq\" (UniqueName: \"kubernetes.io/projected/a19b5964-8116-49bd-9181-8eb2fe61703e-kube-api-access-rtkkq\") pod \"nova-scheduler-0\" (UID: \"a19b5964-8116-49bd-9181-8eb2fe61703e\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.974451 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dsdm\" (UniqueName: \"kubernetes.io/projected/bd098877-cdbc-4903-a92d-b22a3150a9d2-kube-api-access-6dsdm\") pod \"nova-api-0\" (UID: \"bd098877-cdbc-4903-a92d-b22a3150a9d2\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.974554 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sh4dz\" (UniqueName: \"kubernetes.io/projected/e2ad712e-f6f5-4942-94b9-635bbc53da15-kube-api-access-sh4dz\") pod \"nova-metadata-0\" (UID: \"e2ad712e-f6f5-4942-94b9-635bbc53da15\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:58:34 crc kubenswrapper[5120]: I0316 16:58:34.995984 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:58:35 crc kubenswrapper[5120]: I0316 16:58:35.035167 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:58:35 crc kubenswrapper[5120]: I0316 16:58:35.045506 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:58:35 crc kubenswrapper[5120]: I0316 16:58:35.451730 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:58:35 crc kubenswrapper[5120]: W0316 16:58:35.460723 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbd098877_cdbc_4903_a92d_b22a3150a9d2.slice/crio-5eabc01ac62a615671106de32d234fc0fafe20902a99420382d4783446a5975f WatchSource:0}: Error finding container 5eabc01ac62a615671106de32d234fc0fafe20902a99420382d4783446a5975f: Status 404 returned error can't find the container with id 5eabc01ac62a615671106de32d234fc0fafe20902a99420382d4783446a5975f Mar 16 16:58:35 crc kubenswrapper[5120]: I0316 16:58:35.520479 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"bd098877-cdbc-4903-a92d-b22a3150a9d2","Type":"ContainerStarted","Data":"5eabc01ac62a615671106de32d234fc0fafe20902a99420382d4783446a5975f"} Mar 16 16:58:35 crc kubenswrapper[5120]: I0316 16:58:35.559072 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 16:58:35 crc kubenswrapper[5120]: W0316 16:58:35.632456 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode2ad712e_f6f5_4942_94b9_635bbc53da15.slice/crio-6eeca64cdc0450d522b21e780cf3056cf61557866656b4afb8bfe1f30f050674 WatchSource:0}: Error finding container 6eeca64cdc0450d522b21e780cf3056cf61557866656b4afb8bfe1f30f050674: Status 404 returned error can't find the container with id 6eeca64cdc0450d522b21e780cf3056cf61557866656b4afb8bfe1f30f050674 Mar 16 16:58:35 crc kubenswrapper[5120]: I0316 16:58:35.633257 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 16:58:36 crc kubenswrapper[5120]: I0316 16:58:36.535809 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"a19b5964-8116-49bd-9181-8eb2fe61703e","Type":"ContainerStarted","Data":"31aa48ae9a695364d87a26a4847032706a8126fc6a90204e85b5a9a0b0bde237"} Mar 16 16:58:36 crc kubenswrapper[5120]: I0316 16:58:36.536156 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"a19b5964-8116-49bd-9181-8eb2fe61703e","Type":"ContainerStarted","Data":"1ee9f725def2526b0bade2ce22c6c3b693cef85bec133f921e757c77db5af54f"} Mar 16 16:58:36 crc kubenswrapper[5120]: I0316 16:58:36.539218 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"e2ad712e-f6f5-4942-94b9-635bbc53da15","Type":"ContainerStarted","Data":"76410021abc023713496ae0953fc6f1147e2f5232e4ad8b48fce68f89aa80c38"} Mar 16 16:58:36 crc kubenswrapper[5120]: I0316 16:58:36.539243 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"e2ad712e-f6f5-4942-94b9-635bbc53da15","Type":"ContainerStarted","Data":"a50bcb7bcd40881ab5aeb26896fa0bf1d2d92d9720a9cc6da29240635d7ae72b"} Mar 16 16:58:36 crc kubenswrapper[5120]: I0316 16:58:36.539252 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"e2ad712e-f6f5-4942-94b9-635bbc53da15","Type":"ContainerStarted","Data":"6eeca64cdc0450d522b21e780cf3056cf61557866656b4afb8bfe1f30f050674"} Mar 16 16:58:36 crc kubenswrapper[5120]: I0316 16:58:36.541467 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"bd098877-cdbc-4903-a92d-b22a3150a9d2","Type":"ContainerStarted","Data":"ef84b77de9d03439e0af66f86787b74e1d96f048b0a2c794d950480194769ebe"} Mar 16 16:58:36 crc kubenswrapper[5120]: I0316 16:58:36.541509 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"bd098877-cdbc-4903-a92d-b22a3150a9d2","Type":"ContainerStarted","Data":"ffef21520e9911a1bee367fbf5ca3cbeb81ce8c726b6ac3a85eb8cda9be89fd3"} Mar 16 16:58:36 crc kubenswrapper[5120]: I0316 16:58:36.560395 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-scheduler-0" podStartSLOduration=2.56036952 podStartE2EDuration="2.56036952s" podCreationTimestamp="2026-03-16 16:58:34 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:58:36.55194161 +0000 UTC m=+5218.705873287" watchObservedRunningTime="2026-03-16 16:58:36.56036952 +0000 UTC m=+5218.714301177" Mar 16 16:58:36 crc kubenswrapper[5120]: I0316 16:58:36.586436 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=2.586411322 podStartE2EDuration="2.586411322s" podCreationTimestamp="2026-03-16 16:58:34 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:58:36.578252079 +0000 UTC m=+5218.732183736" watchObservedRunningTime="2026-03-16 16:58:36.586411322 +0000 UTC m=+5218.740342979" Mar 16 16:58:36 crc kubenswrapper[5120]: I0316 16:58:36.596016 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=2.596001595 podStartE2EDuration="2.596001595s" podCreationTimestamp="2026-03-16 16:58:34 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:58:36.594916645 +0000 UTC m=+5218.748848302" watchObservedRunningTime="2026-03-16 16:58:36.596001595 +0000 UTC m=+5218.749933252" Mar 16 16:58:36 crc kubenswrapper[5120]: I0316 16:58:36.663838 5120 scope.go:117] "RemoveContainer" containerID="083f72646c8d47c9c0467b39be99ddfa9c2e5900ae0a29ad53d7b39b950274b4" Mar 16 16:58:36 crc kubenswrapper[5120]: E0316 16:58:36.664222 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:58:36 crc kubenswrapper[5120]: I0316 16:58:36.673640 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1d64f64b-2324-4bc9-a7ea-808defe6ded7" path="/var/lib/kubelet/pods/1d64f64b-2324-4bc9-a7ea-808defe6ded7/volumes" Mar 16 16:58:40 crc kubenswrapper[5120]: I0316 16:58:40.035567 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:58:44 crc kubenswrapper[5120]: I0316 16:58:44.996276 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:58:44 crc kubenswrapper[5120]: I0316 16:58:44.996636 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:58:45 crc kubenswrapper[5120]: I0316 16:58:45.035594 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:58:45 crc kubenswrapper[5120]: I0316 16:58:45.046930 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:58:45 crc kubenswrapper[5120]: I0316 16:58:45.047971 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:58:45 crc kubenswrapper[5120]: I0316 16:58:45.067090 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:58:45 crc kubenswrapper[5120]: I0316 16:58:45.679873 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 16:58:46 crc kubenswrapper[5120]: I0316 16:58:46.037094 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="bd098877-cdbc-4903-a92d-b22a3150a9d2" containerName="nova-api-api" probeResult="failure" output="Get \"http://10.217.1.55:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 16:58:46 crc kubenswrapper[5120]: I0316 16:58:46.037942 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="bd098877-cdbc-4903-a92d-b22a3150a9d2" containerName="nova-api-log" probeResult="failure" output="Get \"http://10.217.1.55:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 16:58:46 crc kubenswrapper[5120]: I0316 16:58:46.052955 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="e2ad712e-f6f5-4942-94b9-635bbc53da15" containerName="nova-metadata-log" probeResult="failure" output="Get \"https://10.217.1.57:8775/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Mar 16 16:58:46 crc kubenswrapper[5120]: I0316 16:58:46.054015 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="e2ad712e-f6f5-4942-94b9-635bbc53da15" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"https://10.217.1.57:8775/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 16:58:48 crc kubenswrapper[5120]: I0316 16:58:48.675487 5120 scope.go:117] "RemoveContainer" containerID="083f72646c8d47c9c0467b39be99ddfa9c2e5900ae0a29ad53d7b39b950274b4" Mar 16 16:58:48 crc kubenswrapper[5120]: E0316 16:58:48.676207 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:58:52 crc kubenswrapper[5120]: I0316 16:58:52.996738 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:58:52 crc kubenswrapper[5120]: I0316 16:58:52.997640 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:58:53 crc kubenswrapper[5120]: I0316 16:58:53.046082 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:58:53 crc kubenswrapper[5120]: I0316 16:58:53.046195 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:58:55 crc kubenswrapper[5120]: I0316 16:58:55.000847 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:58:55 crc kubenswrapper[5120]: I0316 16:58:55.001720 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:58:55 crc kubenswrapper[5120]: I0316 16:58:55.005243 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:58:55 crc kubenswrapper[5120]: I0316 16:58:55.056962 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:58:55 crc kubenswrapper[5120]: I0316 16:58:55.057456 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:58:55 crc kubenswrapper[5120]: I0316 16:58:55.066556 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:58:55 crc kubenswrapper[5120]: I0316 16:58:55.066847 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 16:58:55 crc kubenswrapper[5120]: I0316 16:58:55.755861 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:58:57 crc kubenswrapper[5120]: I0316 16:58:57.988732 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:58:57 crc kubenswrapper[5120]: I0316 16:58:57.989368 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="7348dc0f-ed89-470c-97ec-da62dc768f28" containerName="ceilometer-central-agent" containerID="cri-o://ea44b41e8ca11eb5672204294dd5323ea44d0127d140ef370b6812f4428d16d0" gracePeriod=30 Mar 16 16:58:57 crc kubenswrapper[5120]: I0316 16:58:57.989446 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="7348dc0f-ed89-470c-97ec-da62dc768f28" containerName="sg-core" containerID="cri-o://622f134c3a00e3c1f2e6f3832a2a2850dde6f581c1096f0b6008a1415dc2abf5" gracePeriod=30 Mar 16 16:58:57 crc kubenswrapper[5120]: I0316 16:58:57.989466 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="7348dc0f-ed89-470c-97ec-da62dc768f28" containerName="ceilometer-notification-agent" containerID="cri-o://641130851f0b0c5f171466524ed9034bf6b465af28f758759338907cdda785bb" gracePeriod=30 Mar 16 16:58:57 crc kubenswrapper[5120]: I0316 16:58:57.989471 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="7348dc0f-ed89-470c-97ec-da62dc768f28" containerName="proxy-httpd" containerID="cri-o://bdfafeacf4801305d93baa38662ee145caa7a4e6d8fc31d0d47569a7b4588276" gracePeriod=30 Mar 16 16:58:58 crc kubenswrapper[5120]: I0316 16:58:58.531066 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:58:58 crc kubenswrapper[5120]: I0316 16:58:58.784110 5120 generic.go:358] "Generic (PLEG): container finished" podID="7348dc0f-ed89-470c-97ec-da62dc768f28" containerID="bdfafeacf4801305d93baa38662ee145caa7a4e6d8fc31d0d47569a7b4588276" exitCode=0 Mar 16 16:58:58 crc kubenswrapper[5120]: I0316 16:58:58.784145 5120 generic.go:358] "Generic (PLEG): container finished" podID="7348dc0f-ed89-470c-97ec-da62dc768f28" containerID="622f134c3a00e3c1f2e6f3832a2a2850dde6f581c1096f0b6008a1415dc2abf5" exitCode=2 Mar 16 16:58:58 crc kubenswrapper[5120]: I0316 16:58:58.784153 5120 generic.go:358] "Generic (PLEG): container finished" podID="7348dc0f-ed89-470c-97ec-da62dc768f28" containerID="ea44b41e8ca11eb5672204294dd5323ea44d0127d140ef370b6812f4428d16d0" exitCode=0 Mar 16 16:58:58 crc kubenswrapper[5120]: I0316 16:58:58.784184 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7348dc0f-ed89-470c-97ec-da62dc768f28","Type":"ContainerDied","Data":"bdfafeacf4801305d93baa38662ee145caa7a4e6d8fc31d0d47569a7b4588276"} Mar 16 16:58:58 crc kubenswrapper[5120]: I0316 16:58:58.784224 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7348dc0f-ed89-470c-97ec-da62dc768f28","Type":"ContainerDied","Data":"622f134c3a00e3c1f2e6f3832a2a2850dde6f581c1096f0b6008a1415dc2abf5"} Mar 16 16:58:58 crc kubenswrapper[5120]: I0316 16:58:58.784235 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7348dc0f-ed89-470c-97ec-da62dc768f28","Type":"ContainerDied","Data":"ea44b41e8ca11eb5672204294dd5323ea44d0127d140ef370b6812f4428d16d0"} Mar 16 16:58:58 crc kubenswrapper[5120]: I0316 16:58:58.784693 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="bd098877-cdbc-4903-a92d-b22a3150a9d2" containerName="nova-api-log" containerID="cri-o://ffef21520e9911a1bee367fbf5ca3cbeb81ce8c726b6ac3a85eb8cda9be89fd3" gracePeriod=30 Mar 16 16:58:58 crc kubenswrapper[5120]: I0316 16:58:58.784836 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="bd098877-cdbc-4903-a92d-b22a3150a9d2" containerName="nova-api-api" containerID="cri-o://ef84b77de9d03439e0af66f86787b74e1d96f048b0a2c794d950480194769ebe" gracePeriod=30 Mar 16 16:58:59 crc kubenswrapper[5120]: I0316 16:58:59.696894 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:58:59 crc kubenswrapper[5120]: I0316 16:58:59.721239 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7348dc0f-ed89-470c-97ec-da62dc768f28-combined-ca-bundle\") pod \"7348dc0f-ed89-470c-97ec-da62dc768f28\" (UID: \"7348dc0f-ed89-470c-97ec-da62dc768f28\") " Mar 16 16:58:59 crc kubenswrapper[5120]: I0316 16:58:59.721514 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7348dc0f-ed89-470c-97ec-da62dc768f28-scripts\") pod \"7348dc0f-ed89-470c-97ec-da62dc768f28\" (UID: \"7348dc0f-ed89-470c-97ec-da62dc768f28\") " Mar 16 16:58:59 crc kubenswrapper[5120]: I0316 16:58:59.721701 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/7348dc0f-ed89-470c-97ec-da62dc768f28-ceilometer-tls-certs\") pod \"7348dc0f-ed89-470c-97ec-da62dc768f28\" (UID: \"7348dc0f-ed89-470c-97ec-da62dc768f28\") " Mar 16 16:58:59 crc kubenswrapper[5120]: I0316 16:58:59.721746 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7348dc0f-ed89-470c-97ec-da62dc768f28-log-httpd\") pod \"7348dc0f-ed89-470c-97ec-da62dc768f28\" (UID: \"7348dc0f-ed89-470c-97ec-da62dc768f28\") " Mar 16 16:58:59 crc kubenswrapper[5120]: I0316 16:58:59.721834 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7348dc0f-ed89-470c-97ec-da62dc768f28-config-data\") pod \"7348dc0f-ed89-470c-97ec-da62dc768f28\" (UID: \"7348dc0f-ed89-470c-97ec-da62dc768f28\") " Mar 16 16:58:59 crc kubenswrapper[5120]: I0316 16:58:59.721972 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g5f7k\" (UniqueName: \"kubernetes.io/projected/7348dc0f-ed89-470c-97ec-da62dc768f28-kube-api-access-g5f7k\") pod \"7348dc0f-ed89-470c-97ec-da62dc768f28\" (UID: \"7348dc0f-ed89-470c-97ec-da62dc768f28\") " Mar 16 16:58:59 crc kubenswrapper[5120]: I0316 16:58:59.722115 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/7348dc0f-ed89-470c-97ec-da62dc768f28-sg-core-conf-yaml\") pod \"7348dc0f-ed89-470c-97ec-da62dc768f28\" (UID: \"7348dc0f-ed89-470c-97ec-da62dc768f28\") " Mar 16 16:58:59 crc kubenswrapper[5120]: I0316 16:58:59.722176 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7348dc0f-ed89-470c-97ec-da62dc768f28-run-httpd\") pod \"7348dc0f-ed89-470c-97ec-da62dc768f28\" (UID: \"7348dc0f-ed89-470c-97ec-da62dc768f28\") " Mar 16 16:58:59 crc kubenswrapper[5120]: I0316 16:58:59.722265 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7348dc0f-ed89-470c-97ec-da62dc768f28-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "7348dc0f-ed89-470c-97ec-da62dc768f28" (UID: "7348dc0f-ed89-470c-97ec-da62dc768f28"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:58:59 crc kubenswrapper[5120]: I0316 16:58:59.722820 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7348dc0f-ed89-470c-97ec-da62dc768f28-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:58:59 crc kubenswrapper[5120]: I0316 16:58:59.722822 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7348dc0f-ed89-470c-97ec-da62dc768f28-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "7348dc0f-ed89-470c-97ec-da62dc768f28" (UID: "7348dc0f-ed89-470c-97ec-da62dc768f28"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:58:59 crc kubenswrapper[5120]: I0316 16:58:59.744006 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7348dc0f-ed89-470c-97ec-da62dc768f28-scripts" (OuterVolumeSpecName: "scripts") pod "7348dc0f-ed89-470c-97ec-da62dc768f28" (UID: "7348dc0f-ed89-470c-97ec-da62dc768f28"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:58:59 crc kubenswrapper[5120]: I0316 16:58:59.744145 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7348dc0f-ed89-470c-97ec-da62dc768f28-kube-api-access-g5f7k" (OuterVolumeSpecName: "kube-api-access-g5f7k") pod "7348dc0f-ed89-470c-97ec-da62dc768f28" (UID: "7348dc0f-ed89-470c-97ec-da62dc768f28"). InnerVolumeSpecName "kube-api-access-g5f7k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:58:59 crc kubenswrapper[5120]: I0316 16:58:59.773474 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7348dc0f-ed89-470c-97ec-da62dc768f28-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "7348dc0f-ed89-470c-97ec-da62dc768f28" (UID: "7348dc0f-ed89-470c-97ec-da62dc768f28"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:58:59 crc kubenswrapper[5120]: I0316 16:58:59.810999 5120 generic.go:358] "Generic (PLEG): container finished" podID="7348dc0f-ed89-470c-97ec-da62dc768f28" containerID="641130851f0b0c5f171466524ed9034bf6b465af28f758759338907cdda785bb" exitCode=0 Mar 16 16:58:59 crc kubenswrapper[5120]: I0316 16:58:59.811748 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7348dc0f-ed89-470c-97ec-da62dc768f28","Type":"ContainerDied","Data":"641130851f0b0c5f171466524ed9034bf6b465af28f758759338907cdda785bb"} Mar 16 16:58:59 crc kubenswrapper[5120]: I0316 16:58:59.814213 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7348dc0f-ed89-470c-97ec-da62dc768f28","Type":"ContainerDied","Data":"b45843e5b34623ddf1a04c24acbb31c2665b23f3134775492a49e7e6c3448c83"} Mar 16 16:58:59 crc kubenswrapper[5120]: I0316 16:58:59.812648 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7348dc0f-ed89-470c-97ec-da62dc768f28-ceilometer-tls-certs" (OuterVolumeSpecName: "ceilometer-tls-certs") pod "7348dc0f-ed89-470c-97ec-da62dc768f28" (UID: "7348dc0f-ed89-470c-97ec-da62dc768f28"). InnerVolumeSpecName "ceilometer-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:58:59 crc kubenswrapper[5120]: I0316 16:58:59.811995 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:58:59 crc kubenswrapper[5120]: I0316 16:58:59.815983 5120 scope.go:117] "RemoveContainer" containerID="bdfafeacf4801305d93baa38662ee145caa7a4e6d8fc31d0d47569a7b4588276" Mar 16 16:58:59 crc kubenswrapper[5120]: I0316 16:58:59.820603 5120 generic.go:358] "Generic (PLEG): container finished" podID="bd098877-cdbc-4903-a92d-b22a3150a9d2" containerID="ffef21520e9911a1bee367fbf5ca3cbeb81ce8c726b6ac3a85eb8cda9be89fd3" exitCode=143 Mar 16 16:58:59 crc kubenswrapper[5120]: I0316 16:58:59.821165 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"bd098877-cdbc-4903-a92d-b22a3150a9d2","Type":"ContainerDied","Data":"ffef21520e9911a1bee367fbf5ca3cbeb81ce8c726b6ac3a85eb8cda9be89fd3"} Mar 16 16:58:59 crc kubenswrapper[5120]: I0316 16:58:59.826720 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7348dc0f-ed89-470c-97ec-da62dc768f28-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 16:58:59 crc kubenswrapper[5120]: I0316 16:58:59.826747 5120 reconciler_common.go:299] "Volume detached for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/7348dc0f-ed89-470c-97ec-da62dc768f28-ceilometer-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 16:58:59 crc kubenswrapper[5120]: I0316 16:58:59.826761 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g5f7k\" (UniqueName: \"kubernetes.io/projected/7348dc0f-ed89-470c-97ec-da62dc768f28-kube-api-access-g5f7k\") on node \"crc\" DevicePath \"\"" Mar 16 16:58:59 crc kubenswrapper[5120]: I0316 16:58:59.826859 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/7348dc0f-ed89-470c-97ec-da62dc768f28-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 16:58:59 crc kubenswrapper[5120]: I0316 16:58:59.826886 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7348dc0f-ed89-470c-97ec-da62dc768f28-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 16:58:59 crc kubenswrapper[5120]: I0316 16:58:59.856656 5120 scope.go:117] "RemoveContainer" containerID="622f134c3a00e3c1f2e6f3832a2a2850dde6f581c1096f0b6008a1415dc2abf5" Mar 16 16:58:59 crc kubenswrapper[5120]: I0316 16:58:59.872819 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7348dc0f-ed89-470c-97ec-da62dc768f28-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "7348dc0f-ed89-470c-97ec-da62dc768f28" (UID: "7348dc0f-ed89-470c-97ec-da62dc768f28"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:58:59 crc kubenswrapper[5120]: I0316 16:58:59.887819 5120 scope.go:117] "RemoveContainer" containerID="641130851f0b0c5f171466524ed9034bf6b465af28f758759338907cdda785bb" Mar 16 16:58:59 crc kubenswrapper[5120]: I0316 16:58:59.895177 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7348dc0f-ed89-470c-97ec-da62dc768f28-config-data" (OuterVolumeSpecName: "config-data") pod "7348dc0f-ed89-470c-97ec-da62dc768f28" (UID: "7348dc0f-ed89-470c-97ec-da62dc768f28"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:58:59 crc kubenswrapper[5120]: I0316 16:58:59.919582 5120 scope.go:117] "RemoveContainer" containerID="ea44b41e8ca11eb5672204294dd5323ea44d0127d140ef370b6812f4428d16d0" Mar 16 16:58:59 crc kubenswrapper[5120]: I0316 16:58:59.930646 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7348dc0f-ed89-470c-97ec-da62dc768f28-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:58:59 crc kubenswrapper[5120]: I0316 16:58:59.930697 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7348dc0f-ed89-470c-97ec-da62dc768f28-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:58:59 crc kubenswrapper[5120]: I0316 16:58:59.963562 5120 scope.go:117] "RemoveContainer" containerID="bdfafeacf4801305d93baa38662ee145caa7a4e6d8fc31d0d47569a7b4588276" Mar 16 16:58:59 crc kubenswrapper[5120]: E0316 16:58:59.964084 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bdfafeacf4801305d93baa38662ee145caa7a4e6d8fc31d0d47569a7b4588276\": container with ID starting with bdfafeacf4801305d93baa38662ee145caa7a4e6d8fc31d0d47569a7b4588276 not found: ID does not exist" containerID="bdfafeacf4801305d93baa38662ee145caa7a4e6d8fc31d0d47569a7b4588276" Mar 16 16:58:59 crc kubenswrapper[5120]: I0316 16:58:59.964135 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bdfafeacf4801305d93baa38662ee145caa7a4e6d8fc31d0d47569a7b4588276"} err="failed to get container status \"bdfafeacf4801305d93baa38662ee145caa7a4e6d8fc31d0d47569a7b4588276\": rpc error: code = NotFound desc = could not find container \"bdfafeacf4801305d93baa38662ee145caa7a4e6d8fc31d0d47569a7b4588276\": container with ID starting with bdfafeacf4801305d93baa38662ee145caa7a4e6d8fc31d0d47569a7b4588276 not found: ID does not exist" Mar 16 16:58:59 crc kubenswrapper[5120]: I0316 16:58:59.964161 5120 scope.go:117] "RemoveContainer" containerID="622f134c3a00e3c1f2e6f3832a2a2850dde6f581c1096f0b6008a1415dc2abf5" Mar 16 16:58:59 crc kubenswrapper[5120]: E0316 16:58:59.964723 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"622f134c3a00e3c1f2e6f3832a2a2850dde6f581c1096f0b6008a1415dc2abf5\": container with ID starting with 622f134c3a00e3c1f2e6f3832a2a2850dde6f581c1096f0b6008a1415dc2abf5 not found: ID does not exist" containerID="622f134c3a00e3c1f2e6f3832a2a2850dde6f581c1096f0b6008a1415dc2abf5" Mar 16 16:58:59 crc kubenswrapper[5120]: I0316 16:58:59.964776 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"622f134c3a00e3c1f2e6f3832a2a2850dde6f581c1096f0b6008a1415dc2abf5"} err="failed to get container status \"622f134c3a00e3c1f2e6f3832a2a2850dde6f581c1096f0b6008a1415dc2abf5\": rpc error: code = NotFound desc = could not find container \"622f134c3a00e3c1f2e6f3832a2a2850dde6f581c1096f0b6008a1415dc2abf5\": container with ID starting with 622f134c3a00e3c1f2e6f3832a2a2850dde6f581c1096f0b6008a1415dc2abf5 not found: ID does not exist" Mar 16 16:58:59 crc kubenswrapper[5120]: I0316 16:58:59.964790 5120 scope.go:117] "RemoveContainer" containerID="641130851f0b0c5f171466524ed9034bf6b465af28f758759338907cdda785bb" Mar 16 16:58:59 crc kubenswrapper[5120]: E0316 16:58:59.965025 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"641130851f0b0c5f171466524ed9034bf6b465af28f758759338907cdda785bb\": container with ID starting with 641130851f0b0c5f171466524ed9034bf6b465af28f758759338907cdda785bb not found: ID does not exist" containerID="641130851f0b0c5f171466524ed9034bf6b465af28f758759338907cdda785bb" Mar 16 16:58:59 crc kubenswrapper[5120]: I0316 16:58:59.965063 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"641130851f0b0c5f171466524ed9034bf6b465af28f758759338907cdda785bb"} err="failed to get container status \"641130851f0b0c5f171466524ed9034bf6b465af28f758759338907cdda785bb\": rpc error: code = NotFound desc = could not find container \"641130851f0b0c5f171466524ed9034bf6b465af28f758759338907cdda785bb\": container with ID starting with 641130851f0b0c5f171466524ed9034bf6b465af28f758759338907cdda785bb not found: ID does not exist" Mar 16 16:58:59 crc kubenswrapper[5120]: I0316 16:58:59.965084 5120 scope.go:117] "RemoveContainer" containerID="ea44b41e8ca11eb5672204294dd5323ea44d0127d140ef370b6812f4428d16d0" Mar 16 16:58:59 crc kubenswrapper[5120]: E0316 16:58:59.965376 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea44b41e8ca11eb5672204294dd5323ea44d0127d140ef370b6812f4428d16d0\": container with ID starting with ea44b41e8ca11eb5672204294dd5323ea44d0127d140ef370b6812f4428d16d0 not found: ID does not exist" containerID="ea44b41e8ca11eb5672204294dd5323ea44d0127d140ef370b6812f4428d16d0" Mar 16 16:58:59 crc kubenswrapper[5120]: I0316 16:58:59.965413 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea44b41e8ca11eb5672204294dd5323ea44d0127d140ef370b6812f4428d16d0"} err="failed to get container status \"ea44b41e8ca11eb5672204294dd5323ea44d0127d140ef370b6812f4428d16d0\": rpc error: code = NotFound desc = could not find container \"ea44b41e8ca11eb5672204294dd5323ea44d0127d140ef370b6812f4428d16d0\": container with ID starting with ea44b41e8ca11eb5672204294dd5323ea44d0127d140ef370b6812f4428d16d0 not found: ID does not exist" Mar 16 16:59:00 crc kubenswrapper[5120]: I0316 16:59:00.159181 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:59:00 crc kubenswrapper[5120]: I0316 16:59:00.169876 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:59:00 crc kubenswrapper[5120]: I0316 16:59:00.201335 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:59:00 crc kubenswrapper[5120]: I0316 16:59:00.202629 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7348dc0f-ed89-470c-97ec-da62dc768f28" containerName="ceilometer-notification-agent" Mar 16 16:59:00 crc kubenswrapper[5120]: I0316 16:59:00.202654 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7348dc0f-ed89-470c-97ec-da62dc768f28" containerName="ceilometer-notification-agent" Mar 16 16:59:00 crc kubenswrapper[5120]: I0316 16:59:00.202680 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7348dc0f-ed89-470c-97ec-da62dc768f28" containerName="proxy-httpd" Mar 16 16:59:00 crc kubenswrapper[5120]: I0316 16:59:00.202686 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7348dc0f-ed89-470c-97ec-da62dc768f28" containerName="proxy-httpd" Mar 16 16:59:00 crc kubenswrapper[5120]: I0316 16:59:00.202709 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7348dc0f-ed89-470c-97ec-da62dc768f28" containerName="ceilometer-central-agent" Mar 16 16:59:00 crc kubenswrapper[5120]: I0316 16:59:00.202714 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7348dc0f-ed89-470c-97ec-da62dc768f28" containerName="ceilometer-central-agent" Mar 16 16:59:00 crc kubenswrapper[5120]: I0316 16:59:00.202740 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7348dc0f-ed89-470c-97ec-da62dc768f28" containerName="sg-core" Mar 16 16:59:00 crc kubenswrapper[5120]: I0316 16:59:00.202745 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7348dc0f-ed89-470c-97ec-da62dc768f28" containerName="sg-core" Mar 16 16:59:00 crc kubenswrapper[5120]: I0316 16:59:00.202945 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7348dc0f-ed89-470c-97ec-da62dc768f28" containerName="ceilometer-notification-agent" Mar 16 16:59:00 crc kubenswrapper[5120]: I0316 16:59:00.202970 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7348dc0f-ed89-470c-97ec-da62dc768f28" containerName="ceilometer-central-agent" Mar 16 16:59:00 crc kubenswrapper[5120]: I0316 16:59:00.202977 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7348dc0f-ed89-470c-97ec-da62dc768f28" containerName="sg-core" Mar 16 16:59:00 crc kubenswrapper[5120]: I0316 16:59:00.202989 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7348dc0f-ed89-470c-97ec-da62dc768f28" containerName="proxy-httpd" Mar 16 16:59:00 crc kubenswrapper[5120]: I0316 16:59:00.213728 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:59:00 crc kubenswrapper[5120]: I0316 16:59:00.216880 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ceilometer-internal-svc\"" Mar 16 16:59:00 crc kubenswrapper[5120]: I0316 16:59:00.217114 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 16:59:00 crc kubenswrapper[5120]: I0316 16:59:00.221135 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:59:00 crc kubenswrapper[5120]: I0316 16:59:00.223363 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 16:59:00 crc kubenswrapper[5120]: I0316 16:59:00.343563 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/8564c4e1-fb50-4cb4-8df5-d95dd3374db3-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"8564c4e1-fb50-4cb4-8df5-d95dd3374db3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:59:00 crc kubenswrapper[5120]: I0316 16:59:00.343686 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/8564c4e1-fb50-4cb4-8df5-d95dd3374db3-log-httpd\") pod \"ceilometer-0\" (UID: \"8564c4e1-fb50-4cb4-8df5-d95dd3374db3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:59:00 crc kubenswrapper[5120]: I0316 16:59:00.343732 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/8564c4e1-fb50-4cb4-8df5-d95dd3374db3-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"8564c4e1-fb50-4cb4-8df5-d95dd3374db3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:59:00 crc kubenswrapper[5120]: I0316 16:59:00.343910 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8564c4e1-fb50-4cb4-8df5-d95dd3374db3-config-data\") pod \"ceilometer-0\" (UID: \"8564c4e1-fb50-4cb4-8df5-d95dd3374db3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:59:00 crc kubenswrapper[5120]: I0316 16:59:00.344009 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/8564c4e1-fb50-4cb4-8df5-d95dd3374db3-run-httpd\") pod \"ceilometer-0\" (UID: \"8564c4e1-fb50-4cb4-8df5-d95dd3374db3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:59:00 crc kubenswrapper[5120]: I0316 16:59:00.344042 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkjtq\" (UniqueName: \"kubernetes.io/projected/8564c4e1-fb50-4cb4-8df5-d95dd3374db3-kube-api-access-rkjtq\") pod \"ceilometer-0\" (UID: \"8564c4e1-fb50-4cb4-8df5-d95dd3374db3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:59:00 crc kubenswrapper[5120]: I0316 16:59:00.344201 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8564c4e1-fb50-4cb4-8df5-d95dd3374db3-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"8564c4e1-fb50-4cb4-8df5-d95dd3374db3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:59:00 crc kubenswrapper[5120]: I0316 16:59:00.344277 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8564c4e1-fb50-4cb4-8df5-d95dd3374db3-scripts\") pod \"ceilometer-0\" (UID: \"8564c4e1-fb50-4cb4-8df5-d95dd3374db3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:59:00 crc kubenswrapper[5120]: I0316 16:59:00.447385 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/8564c4e1-fb50-4cb4-8df5-d95dd3374db3-log-httpd\") pod \"ceilometer-0\" (UID: \"8564c4e1-fb50-4cb4-8df5-d95dd3374db3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:59:00 crc kubenswrapper[5120]: I0316 16:59:00.447496 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/8564c4e1-fb50-4cb4-8df5-d95dd3374db3-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"8564c4e1-fb50-4cb4-8df5-d95dd3374db3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:59:00 crc kubenswrapper[5120]: I0316 16:59:00.447680 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8564c4e1-fb50-4cb4-8df5-d95dd3374db3-config-data\") pod \"ceilometer-0\" (UID: \"8564c4e1-fb50-4cb4-8df5-d95dd3374db3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:59:00 crc kubenswrapper[5120]: I0316 16:59:00.447787 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/8564c4e1-fb50-4cb4-8df5-d95dd3374db3-run-httpd\") pod \"ceilometer-0\" (UID: \"8564c4e1-fb50-4cb4-8df5-d95dd3374db3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:59:00 crc kubenswrapper[5120]: I0316 16:59:00.447818 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rkjtq\" (UniqueName: \"kubernetes.io/projected/8564c4e1-fb50-4cb4-8df5-d95dd3374db3-kube-api-access-rkjtq\") pod \"ceilometer-0\" (UID: \"8564c4e1-fb50-4cb4-8df5-d95dd3374db3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:59:00 crc kubenswrapper[5120]: I0316 16:59:00.447986 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8564c4e1-fb50-4cb4-8df5-d95dd3374db3-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"8564c4e1-fb50-4cb4-8df5-d95dd3374db3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:59:00 crc kubenswrapper[5120]: I0316 16:59:00.448083 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8564c4e1-fb50-4cb4-8df5-d95dd3374db3-scripts\") pod \"ceilometer-0\" (UID: \"8564c4e1-fb50-4cb4-8df5-d95dd3374db3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:59:00 crc kubenswrapper[5120]: I0316 16:59:00.448207 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/8564c4e1-fb50-4cb4-8df5-d95dd3374db3-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"8564c4e1-fb50-4cb4-8df5-d95dd3374db3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:59:00 crc kubenswrapper[5120]: I0316 16:59:00.449070 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/8564c4e1-fb50-4cb4-8df5-d95dd3374db3-run-httpd\") pod \"ceilometer-0\" (UID: \"8564c4e1-fb50-4cb4-8df5-d95dd3374db3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:59:00 crc kubenswrapper[5120]: I0316 16:59:00.449865 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/8564c4e1-fb50-4cb4-8df5-d95dd3374db3-log-httpd\") pod \"ceilometer-0\" (UID: \"8564c4e1-fb50-4cb4-8df5-d95dd3374db3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:59:00 crc kubenswrapper[5120]: I0316 16:59:00.462435 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8564c4e1-fb50-4cb4-8df5-d95dd3374db3-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"8564c4e1-fb50-4cb4-8df5-d95dd3374db3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:59:00 crc kubenswrapper[5120]: I0316 16:59:00.462462 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/8564c4e1-fb50-4cb4-8df5-d95dd3374db3-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"8564c4e1-fb50-4cb4-8df5-d95dd3374db3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:59:00 crc kubenswrapper[5120]: I0316 16:59:00.462732 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/8564c4e1-fb50-4cb4-8df5-d95dd3374db3-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"8564c4e1-fb50-4cb4-8df5-d95dd3374db3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:59:00 crc kubenswrapper[5120]: I0316 16:59:00.462989 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8564c4e1-fb50-4cb4-8df5-d95dd3374db3-config-data\") pod \"ceilometer-0\" (UID: \"8564c4e1-fb50-4cb4-8df5-d95dd3374db3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:59:00 crc kubenswrapper[5120]: I0316 16:59:00.465583 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkjtq\" (UniqueName: \"kubernetes.io/projected/8564c4e1-fb50-4cb4-8df5-d95dd3374db3-kube-api-access-rkjtq\") pod \"ceilometer-0\" (UID: \"8564c4e1-fb50-4cb4-8df5-d95dd3374db3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:59:00 crc kubenswrapper[5120]: I0316 16:59:00.468481 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8564c4e1-fb50-4cb4-8df5-d95dd3374db3-scripts\") pod \"ceilometer-0\" (UID: \"8564c4e1-fb50-4cb4-8df5-d95dd3374db3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:59:00 crc kubenswrapper[5120]: I0316 16:59:00.539628 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:59:00 crc kubenswrapper[5120]: I0316 16:59:00.676048 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7348dc0f-ed89-470c-97ec-da62dc768f28" path="/var/lib/kubelet/pods/7348dc0f-ed89-470c-97ec-da62dc768f28/volumes" Mar 16 16:59:00 crc kubenswrapper[5120]: I0316 16:59:00.984403 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 16:59:01 crc kubenswrapper[5120]: I0316 16:59:01.846794 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"8564c4e1-fb50-4cb4-8df5-d95dd3374db3","Type":"ContainerStarted","Data":"72ce6e63c6af240dbdaf4cfec1280154a8488b58f4057d2f278d8823fe4673f0"} Mar 16 16:59:01 crc kubenswrapper[5120]: I0316 16:59:01.847103 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"8564c4e1-fb50-4cb4-8df5-d95dd3374db3","Type":"ContainerStarted","Data":"a77a41620985ba045f3524637beb84990710d57c82c7e0a4dc0660622970688a"} Mar 16 16:59:02 crc kubenswrapper[5120]: I0316 16:59:02.302299 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:59:02 crc kubenswrapper[5120]: I0316 16:59:02.401590 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bd098877-cdbc-4903-a92d-b22a3150a9d2-combined-ca-bundle\") pod \"bd098877-cdbc-4903-a92d-b22a3150a9d2\" (UID: \"bd098877-cdbc-4903-a92d-b22a3150a9d2\") " Mar 16 16:59:02 crc kubenswrapper[5120]: I0316 16:59:02.401650 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/bd098877-cdbc-4903-a92d-b22a3150a9d2-logs\") pod \"bd098877-cdbc-4903-a92d-b22a3150a9d2\" (UID: \"bd098877-cdbc-4903-a92d-b22a3150a9d2\") " Mar 16 16:59:02 crc kubenswrapper[5120]: I0316 16:59:02.402072 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6dsdm\" (UniqueName: \"kubernetes.io/projected/bd098877-cdbc-4903-a92d-b22a3150a9d2-kube-api-access-6dsdm\") pod \"bd098877-cdbc-4903-a92d-b22a3150a9d2\" (UID: \"bd098877-cdbc-4903-a92d-b22a3150a9d2\") " Mar 16 16:59:02 crc kubenswrapper[5120]: I0316 16:59:02.402323 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bd098877-cdbc-4903-a92d-b22a3150a9d2-config-data\") pod \"bd098877-cdbc-4903-a92d-b22a3150a9d2\" (UID: \"bd098877-cdbc-4903-a92d-b22a3150a9d2\") " Mar 16 16:59:02 crc kubenswrapper[5120]: I0316 16:59:02.405285 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd098877-cdbc-4903-a92d-b22a3150a9d2-logs" (OuterVolumeSpecName: "logs") pod "bd098877-cdbc-4903-a92d-b22a3150a9d2" (UID: "bd098877-cdbc-4903-a92d-b22a3150a9d2"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 16:59:02 crc kubenswrapper[5120]: I0316 16:59:02.408327 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd098877-cdbc-4903-a92d-b22a3150a9d2-kube-api-access-6dsdm" (OuterVolumeSpecName: "kube-api-access-6dsdm") pod "bd098877-cdbc-4903-a92d-b22a3150a9d2" (UID: "bd098877-cdbc-4903-a92d-b22a3150a9d2"). InnerVolumeSpecName "kube-api-access-6dsdm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 16:59:02 crc kubenswrapper[5120]: I0316 16:59:02.439019 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd098877-cdbc-4903-a92d-b22a3150a9d2-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "bd098877-cdbc-4903-a92d-b22a3150a9d2" (UID: "bd098877-cdbc-4903-a92d-b22a3150a9d2"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:59:02 crc kubenswrapper[5120]: I0316 16:59:02.440034 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd098877-cdbc-4903-a92d-b22a3150a9d2-config-data" (OuterVolumeSpecName: "config-data") pod "bd098877-cdbc-4903-a92d-b22a3150a9d2" (UID: "bd098877-cdbc-4903-a92d-b22a3150a9d2"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 16:59:02 crc kubenswrapper[5120]: I0316 16:59:02.505616 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6dsdm\" (UniqueName: \"kubernetes.io/projected/bd098877-cdbc-4903-a92d-b22a3150a9d2-kube-api-access-6dsdm\") on node \"crc\" DevicePath \"\"" Mar 16 16:59:02 crc kubenswrapper[5120]: I0316 16:59:02.505661 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bd098877-cdbc-4903-a92d-b22a3150a9d2-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 16:59:02 crc kubenswrapper[5120]: I0316 16:59:02.505671 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bd098877-cdbc-4903-a92d-b22a3150a9d2-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 16:59:02 crc kubenswrapper[5120]: I0316 16:59:02.505689 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/bd098877-cdbc-4903-a92d-b22a3150a9d2-logs\") on node \"crc\" DevicePath \"\"" Mar 16 16:59:02 crc kubenswrapper[5120]: I0316 16:59:02.664399 5120 scope.go:117] "RemoveContainer" containerID="083f72646c8d47c9c0467b39be99ddfa9c2e5900ae0a29ad53d7b39b950274b4" Mar 16 16:59:02 crc kubenswrapper[5120]: E0316 16:59:02.664930 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:59:02 crc kubenswrapper[5120]: I0316 16:59:02.865998 5120 generic.go:358] "Generic (PLEG): container finished" podID="bd098877-cdbc-4903-a92d-b22a3150a9d2" containerID="ef84b77de9d03439e0af66f86787b74e1d96f048b0a2c794d950480194769ebe" exitCode=0 Mar 16 16:59:02 crc kubenswrapper[5120]: I0316 16:59:02.866231 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"bd098877-cdbc-4903-a92d-b22a3150a9d2","Type":"ContainerDied","Data":"ef84b77de9d03439e0af66f86787b74e1d96f048b0a2c794d950480194769ebe"} Mar 16 16:59:02 crc kubenswrapper[5120]: I0316 16:59:02.866516 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"bd098877-cdbc-4903-a92d-b22a3150a9d2","Type":"ContainerDied","Data":"5eabc01ac62a615671106de32d234fc0fafe20902a99420382d4783446a5975f"} Mar 16 16:59:02 crc kubenswrapper[5120]: I0316 16:59:02.866566 5120 scope.go:117] "RemoveContainer" containerID="ef84b77de9d03439e0af66f86787b74e1d96f048b0a2c794d950480194769ebe" Mar 16 16:59:02 crc kubenswrapper[5120]: I0316 16:59:02.866338 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:59:02 crc kubenswrapper[5120]: I0316 16:59:02.874189 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"8564c4e1-fb50-4cb4-8df5-d95dd3374db3","Type":"ContainerStarted","Data":"dd31307d5a4292328381cfc5aa70b4423f771b369bbe29ff3930835491de7e1e"} Mar 16 16:59:02 crc kubenswrapper[5120]: I0316 16:59:02.902495 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:59:02 crc kubenswrapper[5120]: I0316 16:59:02.913534 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:59:02 crc kubenswrapper[5120]: I0316 16:59:02.920196 5120 scope.go:117] "RemoveContainer" containerID="ffef21520e9911a1bee367fbf5ca3cbeb81ce8c726b6ac3a85eb8cda9be89fd3" Mar 16 16:59:02 crc kubenswrapper[5120]: I0316 16:59:02.925160 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:59:02 crc kubenswrapper[5120]: I0316 16:59:02.926542 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd098877-cdbc-4903-a92d-b22a3150a9d2" containerName="nova-api-api" Mar 16 16:59:02 crc kubenswrapper[5120]: I0316 16:59:02.926572 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd098877-cdbc-4903-a92d-b22a3150a9d2" containerName="nova-api-api" Mar 16 16:59:02 crc kubenswrapper[5120]: I0316 16:59:02.926639 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd098877-cdbc-4903-a92d-b22a3150a9d2" containerName="nova-api-log" Mar 16 16:59:02 crc kubenswrapper[5120]: I0316 16:59:02.926648 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd098877-cdbc-4903-a92d-b22a3150a9d2" containerName="nova-api-log" Mar 16 16:59:02 crc kubenswrapper[5120]: I0316 16:59:02.926892 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="bd098877-cdbc-4903-a92d-b22a3150a9d2" containerName="nova-api-log" Mar 16 16:59:02 crc kubenswrapper[5120]: I0316 16:59:02.926931 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="bd098877-cdbc-4903-a92d-b22a3150a9d2" containerName="nova-api-api" Mar 16 16:59:02 crc kubenswrapper[5120]: I0316 16:59:02.937582 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:59:02 crc kubenswrapper[5120]: I0316 16:59:02.941714 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-public-svc\"" Mar 16 16:59:02 crc kubenswrapper[5120]: I0316 16:59:02.942651 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-config-data\"" Mar 16 16:59:02 crc kubenswrapper[5120]: I0316 16:59:02.942710 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-internal-svc\"" Mar 16 16:59:02 crc kubenswrapper[5120]: I0316 16:59:02.957230 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:59:02 crc kubenswrapper[5120]: I0316 16:59:02.970992 5120 scope.go:117] "RemoveContainer" containerID="ef84b77de9d03439e0af66f86787b74e1d96f048b0a2c794d950480194769ebe" Mar 16 16:59:02 crc kubenswrapper[5120]: E0316 16:59:02.973311 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ef84b77de9d03439e0af66f86787b74e1d96f048b0a2c794d950480194769ebe\": container with ID starting with ef84b77de9d03439e0af66f86787b74e1d96f048b0a2c794d950480194769ebe not found: ID does not exist" containerID="ef84b77de9d03439e0af66f86787b74e1d96f048b0a2c794d950480194769ebe" Mar 16 16:59:02 crc kubenswrapper[5120]: I0316 16:59:02.973363 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef84b77de9d03439e0af66f86787b74e1d96f048b0a2c794d950480194769ebe"} err="failed to get container status \"ef84b77de9d03439e0af66f86787b74e1d96f048b0a2c794d950480194769ebe\": rpc error: code = NotFound desc = could not find container \"ef84b77de9d03439e0af66f86787b74e1d96f048b0a2c794d950480194769ebe\": container with ID starting with ef84b77de9d03439e0af66f86787b74e1d96f048b0a2c794d950480194769ebe not found: ID does not exist" Mar 16 16:59:02 crc kubenswrapper[5120]: I0316 16:59:02.973390 5120 scope.go:117] "RemoveContainer" containerID="ffef21520e9911a1bee367fbf5ca3cbeb81ce8c726b6ac3a85eb8cda9be89fd3" Mar 16 16:59:02 crc kubenswrapper[5120]: E0316 16:59:02.973893 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ffef21520e9911a1bee367fbf5ca3cbeb81ce8c726b6ac3a85eb8cda9be89fd3\": container with ID starting with ffef21520e9911a1bee367fbf5ca3cbeb81ce8c726b6ac3a85eb8cda9be89fd3 not found: ID does not exist" containerID="ffef21520e9911a1bee367fbf5ca3cbeb81ce8c726b6ac3a85eb8cda9be89fd3" Mar 16 16:59:02 crc kubenswrapper[5120]: I0316 16:59:02.973937 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ffef21520e9911a1bee367fbf5ca3cbeb81ce8c726b6ac3a85eb8cda9be89fd3"} err="failed to get container status \"ffef21520e9911a1bee367fbf5ca3cbeb81ce8c726b6ac3a85eb8cda9be89fd3\": rpc error: code = NotFound desc = could not find container \"ffef21520e9911a1bee367fbf5ca3cbeb81ce8c726b6ac3a85eb8cda9be89fd3\": container with ID starting with ffef21520e9911a1bee367fbf5ca3cbeb81ce8c726b6ac3a85eb8cda9be89fd3 not found: ID does not exist" Mar 16 16:59:03 crc kubenswrapper[5120]: I0316 16:59:03.021902 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0e6277f8-02ed-4429-af86-af38266195cd-logs\") pod \"nova-api-0\" (UID: \"0e6277f8-02ed-4429-af86-af38266195cd\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:59:03 crc kubenswrapper[5120]: I0316 16:59:03.021996 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0e6277f8-02ed-4429-af86-af38266195cd-config-data\") pod \"nova-api-0\" (UID: \"0e6277f8-02ed-4429-af86-af38266195cd\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:59:03 crc kubenswrapper[5120]: I0316 16:59:03.022209 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0e6277f8-02ed-4429-af86-af38266195cd-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"0e6277f8-02ed-4429-af86-af38266195cd\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:59:03 crc kubenswrapper[5120]: I0316 16:59:03.022954 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8n9kb\" (UniqueName: \"kubernetes.io/projected/0e6277f8-02ed-4429-af86-af38266195cd-kube-api-access-8n9kb\") pod \"nova-api-0\" (UID: \"0e6277f8-02ed-4429-af86-af38266195cd\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:59:03 crc kubenswrapper[5120]: I0316 16:59:03.023041 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/0e6277f8-02ed-4429-af86-af38266195cd-public-tls-certs\") pod \"nova-api-0\" (UID: \"0e6277f8-02ed-4429-af86-af38266195cd\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:59:03 crc kubenswrapper[5120]: I0316 16:59:03.023137 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/0e6277f8-02ed-4429-af86-af38266195cd-internal-tls-certs\") pod \"nova-api-0\" (UID: \"0e6277f8-02ed-4429-af86-af38266195cd\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:59:03 crc kubenswrapper[5120]: I0316 16:59:03.125209 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0e6277f8-02ed-4429-af86-af38266195cd-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"0e6277f8-02ed-4429-af86-af38266195cd\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:59:03 crc kubenswrapper[5120]: I0316 16:59:03.125450 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8n9kb\" (UniqueName: \"kubernetes.io/projected/0e6277f8-02ed-4429-af86-af38266195cd-kube-api-access-8n9kb\") pod \"nova-api-0\" (UID: \"0e6277f8-02ed-4429-af86-af38266195cd\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:59:03 crc kubenswrapper[5120]: I0316 16:59:03.125499 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/0e6277f8-02ed-4429-af86-af38266195cd-public-tls-certs\") pod \"nova-api-0\" (UID: \"0e6277f8-02ed-4429-af86-af38266195cd\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:59:03 crc kubenswrapper[5120]: I0316 16:59:03.125540 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/0e6277f8-02ed-4429-af86-af38266195cd-internal-tls-certs\") pod \"nova-api-0\" (UID: \"0e6277f8-02ed-4429-af86-af38266195cd\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:59:03 crc kubenswrapper[5120]: I0316 16:59:03.125587 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0e6277f8-02ed-4429-af86-af38266195cd-logs\") pod \"nova-api-0\" (UID: \"0e6277f8-02ed-4429-af86-af38266195cd\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:59:03 crc kubenswrapper[5120]: I0316 16:59:03.125638 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0e6277f8-02ed-4429-af86-af38266195cd-config-data\") pod \"nova-api-0\" (UID: \"0e6277f8-02ed-4429-af86-af38266195cd\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:59:03 crc kubenswrapper[5120]: I0316 16:59:03.126495 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0e6277f8-02ed-4429-af86-af38266195cd-logs\") pod \"nova-api-0\" (UID: \"0e6277f8-02ed-4429-af86-af38266195cd\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:59:03 crc kubenswrapper[5120]: I0316 16:59:03.131330 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0e6277f8-02ed-4429-af86-af38266195cd-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"0e6277f8-02ed-4429-af86-af38266195cd\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:59:03 crc kubenswrapper[5120]: I0316 16:59:03.131490 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0e6277f8-02ed-4429-af86-af38266195cd-config-data\") pod \"nova-api-0\" (UID: \"0e6277f8-02ed-4429-af86-af38266195cd\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:59:03 crc kubenswrapper[5120]: I0316 16:59:03.131877 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/0e6277f8-02ed-4429-af86-af38266195cd-public-tls-certs\") pod \"nova-api-0\" (UID: \"0e6277f8-02ed-4429-af86-af38266195cd\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:59:03 crc kubenswrapper[5120]: I0316 16:59:03.140466 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/0e6277f8-02ed-4429-af86-af38266195cd-internal-tls-certs\") pod \"nova-api-0\" (UID: \"0e6277f8-02ed-4429-af86-af38266195cd\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:59:03 crc kubenswrapper[5120]: I0316 16:59:03.145442 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8n9kb\" (UniqueName: \"kubernetes.io/projected/0e6277f8-02ed-4429-af86-af38266195cd-kube-api-access-8n9kb\") pod \"nova-api-0\" (UID: \"0e6277f8-02ed-4429-af86-af38266195cd\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:59:03 crc kubenswrapper[5120]: I0316 16:59:03.277539 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:59:03 crc kubenswrapper[5120]: W0316 16:59:03.738134 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0e6277f8_02ed_4429_af86_af38266195cd.slice/crio-4a693d5b0a72585a56714f23f52f8767f937be6c8c804223fc0f495509e0676a WatchSource:0}: Error finding container 4a693d5b0a72585a56714f23f52f8767f937be6c8c804223fc0f495509e0676a: Status 404 returned error can't find the container with id 4a693d5b0a72585a56714f23f52f8767f937be6c8c804223fc0f495509e0676a Mar 16 16:59:03 crc kubenswrapper[5120]: I0316 16:59:03.738160 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 16:59:03 crc kubenswrapper[5120]: I0316 16:59:03.888792 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"0e6277f8-02ed-4429-af86-af38266195cd","Type":"ContainerStarted","Data":"4a693d5b0a72585a56714f23f52f8767f937be6c8c804223fc0f495509e0676a"} Mar 16 16:59:03 crc kubenswrapper[5120]: I0316 16:59:03.892322 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"8564c4e1-fb50-4cb4-8df5-d95dd3374db3","Type":"ContainerStarted","Data":"c7cb3d1980b59b00ba89f7913c562983800a3ee24502b6c02fda5df995aca749"} Mar 16 16:59:04 crc kubenswrapper[5120]: I0316 16:59:04.534956 5120 scope.go:117] "RemoveContainer" containerID="426729983f303ba8a51519f9cd7d552cb66105e64258abc8aac0b8ea4920460e" Mar 16 16:59:04 crc kubenswrapper[5120]: I0316 16:59:04.564100 5120 scope.go:117] "RemoveContainer" containerID="c902dfb54f96d7888fe00f01304e3a2ce668c40edb25e8195bacffff26645501" Mar 16 16:59:04 crc kubenswrapper[5120]: I0316 16:59:04.590342 5120 scope.go:117] "RemoveContainer" containerID="eb2716296f9c5287a1ca3bce2395180fac10d428f3a9c4a1dd20632f18669519" Mar 16 16:59:04 crc kubenswrapper[5120]: I0316 16:59:04.615382 5120 scope.go:117] "RemoveContainer" containerID="e84a6ccec0bb33bc2cd454d4394c28b18bc68551ef47c224ec6f142319f3040e" Mar 16 16:59:04 crc kubenswrapper[5120]: I0316 16:59:04.638545 5120 scope.go:117] "RemoveContainer" containerID="c37bdc03a053afc82ef80c0a8a9c3c36b8cbfaa6885189827254366781339f42" Mar 16 16:59:04 crc kubenswrapper[5120]: I0316 16:59:04.663353 5120 scope.go:117] "RemoveContainer" containerID="c1dd20bf9d5fa639b2879a8a31ac5f271715ba78f8066f88de902d4b35a4ff21" Mar 16 16:59:04 crc kubenswrapper[5120]: I0316 16:59:04.676933 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bd098877-cdbc-4903-a92d-b22a3150a9d2" path="/var/lib/kubelet/pods/bd098877-cdbc-4903-a92d-b22a3150a9d2/volumes" Mar 16 16:59:04 crc kubenswrapper[5120]: I0316 16:59:04.691433 5120 scope.go:117] "RemoveContainer" containerID="d6bea12055370a1dc7acd4f390291dbab688f64eab6591ce209d3b4f27519cf2" Mar 16 16:59:04 crc kubenswrapper[5120]: I0316 16:59:04.715193 5120 scope.go:117] "RemoveContainer" containerID="e7490c0e0d59a82483b2df6513e7e7eab4815275effa3bd260acd6d11c41af7d" Mar 16 16:59:04 crc kubenswrapper[5120]: I0316 16:59:04.748594 5120 scope.go:117] "RemoveContainer" containerID="e657edbdc4c1d1813bbd0fe5142cc396ab5f34be797282678df442f971bf15d2" Mar 16 16:59:04 crc kubenswrapper[5120]: I0316 16:59:04.775341 5120 scope.go:117] "RemoveContainer" containerID="ce0287d83103e9544ee024f8b7ebcd28fe5e9a66b2efe0735defa49ab4a63b75" Mar 16 16:59:04 crc kubenswrapper[5120]: I0316 16:59:04.800018 5120 scope.go:117] "RemoveContainer" containerID="09f299b5d93c37d9587b3d1ab480436df43aab9b13b697336b90e9551005ece5" Mar 16 16:59:04 crc kubenswrapper[5120]: I0316 16:59:04.829564 5120 scope.go:117] "RemoveContainer" containerID="d2eb4e21ebfbf4c48740f681aa1f4c14b01ac6e6ac567636f37191d3ba9131bb" Mar 16 16:59:04 crc kubenswrapper[5120]: I0316 16:59:04.856042 5120 scope.go:117] "RemoveContainer" containerID="3e4d1b60e2bb40708ca0eb86088645db7b9870e10296a1eff67cb5ce00260ed7" Mar 16 16:59:04 crc kubenswrapper[5120]: I0316 16:59:04.877573 5120 scope.go:117] "RemoveContainer" containerID="7bbf1614038d4b969b640c6c4529cfbe2dbb4d18e62926c0ea76ab02c22db36b" Mar 16 16:59:04 crc kubenswrapper[5120]: I0316 16:59:04.898368 5120 scope.go:117] "RemoveContainer" containerID="39ef33895c134d0ed936fb426895f0c7eb3288074422326f288eccff008d3774" Mar 16 16:59:04 crc kubenswrapper[5120]: I0316 16:59:04.915773 5120 scope.go:117] "RemoveContainer" containerID="230653dbcfd778943f6ddd417a12dd48b5680b4e4b96b18fd7d3385ba610e6c3" Mar 16 16:59:04 crc kubenswrapper[5120]: I0316 16:59:04.917801 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"0e6277f8-02ed-4429-af86-af38266195cd","Type":"ContainerStarted","Data":"e33012e656c2cd8d2e08efcbaefc5187f1c017846cac5c2b21e89bb0c4991a80"} Mar 16 16:59:04 crc kubenswrapper[5120]: I0316 16:59:04.917834 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"0e6277f8-02ed-4429-af86-af38266195cd","Type":"ContainerStarted","Data":"df644605668cb6409e0b440fc58164a055f8c2e58033000e364530db958fe591"} Mar 16 16:59:04 crc kubenswrapper[5120]: I0316 16:59:04.944711 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=2.944688937 podStartE2EDuration="2.944688937s" podCreationTimestamp="2026-03-16 16:59:02 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 16:59:04.940837952 +0000 UTC m=+5247.094769609" watchObservedRunningTime="2026-03-16 16:59:04.944688937 +0000 UTC m=+5247.098620594" Mar 16 16:59:04 crc kubenswrapper[5120]: I0316 16:59:04.951870 5120 scope.go:117] "RemoveContainer" containerID="cf30bf858ee3854358c96c7f21db6e3d78dc11544569687a33f15adb8935dbe6" Mar 16 16:59:04 crc kubenswrapper[5120]: I0316 16:59:04.973190 5120 scope.go:117] "RemoveContainer" containerID="5ca55cb347519b4334c3c6b37c431e0953788ca2ed0f3ca9ee1c934857dba490" Mar 16 16:59:04 crc kubenswrapper[5120]: I0316 16:59:04.999432 5120 scope.go:117] "RemoveContainer" containerID="423900fcfc665a7c0642a3969b0d45a290a37855935f76532dcda5ffb9c954cc" Mar 16 16:59:05 crc kubenswrapper[5120]: I0316 16:59:05.023121 5120 scope.go:117] "RemoveContainer" containerID="ca5a9a1a02d3db75901ec82f4c35e00a5d690aea3a401a915e06cc5e40282eea" Mar 16 16:59:05 crc kubenswrapper[5120]: I0316 16:59:05.041648 5120 scope.go:117] "RemoveContainer" containerID="dff05d001161dd73ee301824319b7393ecaf3fe56d375faa6a317018e3fee33b" Mar 16 16:59:05 crc kubenswrapper[5120]: I0316 16:59:05.069747 5120 scope.go:117] "RemoveContainer" containerID="94f0f9d5ef7a9a1aa550cca1ce3c48dbb4ad2a4bfe3df33e0e300fede864cd03" Mar 16 16:59:05 crc kubenswrapper[5120]: I0316 16:59:05.089772 5120 scope.go:117] "RemoveContainer" containerID="685540b4d7b41517ec9bca45f9216630bb3f86d3740942c5bd283fb216943915" Mar 16 16:59:05 crc kubenswrapper[5120]: I0316 16:59:05.938423 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"8564c4e1-fb50-4cb4-8df5-d95dd3374db3","Type":"ContainerStarted","Data":"8cf1dc8b90b00f8364bb374e93b9ee78f0ff1723ac6cdf01d8ce8b7c975ac0b2"} Mar 16 16:59:05 crc kubenswrapper[5120]: I0316 16:59:05.938920 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:59:05 crc kubenswrapper[5120]: I0316 16:59:05.957308 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=1.3701430989999999 podStartE2EDuration="5.957291383s" podCreationTimestamp="2026-03-16 16:59:00 +0000 UTC" firstStartedPulling="2026-03-16 16:59:00.98544419 +0000 UTC m=+5243.139375847" lastFinishedPulling="2026-03-16 16:59:05.572592474 +0000 UTC m=+5247.726524131" observedRunningTime="2026-03-16 16:59:05.956239835 +0000 UTC m=+5248.110171522" watchObservedRunningTime="2026-03-16 16:59:05.957291383 +0000 UTC m=+5248.111223040" Mar 16 16:59:08 crc kubenswrapper[5120]: E0316 16:59:08.395714 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1873681 actualBytes=10240 Mar 16 16:59:13 crc kubenswrapper[5120]: I0316 16:59:13.278812 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:59:13 crc kubenswrapper[5120]: I0316 16:59:13.279313 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:59:14 crc kubenswrapper[5120]: I0316 16:59:14.284918 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="0e6277f8-02ed-4429-af86-af38266195cd" containerName="nova-api-log" probeResult="failure" output="Get \"https://10.217.1.59:8774/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Mar 16 16:59:14 crc kubenswrapper[5120]: I0316 16:59:14.286021 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="0e6277f8-02ed-4429-af86-af38266195cd" containerName="nova-api-api" probeResult="failure" output="Get \"https://10.217.1.59:8774/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Mar 16 16:59:14 crc kubenswrapper[5120]: I0316 16:59:14.663932 5120 scope.go:117] "RemoveContainer" containerID="083f72646c8d47c9c0467b39be99ddfa9c2e5900ae0a29ad53d7b39b950274b4" Mar 16 16:59:14 crc kubenswrapper[5120]: E0316 16:59:14.665870 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 16:59:21 crc kubenswrapper[5120]: I0316 16:59:21.278375 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:59:21 crc kubenswrapper[5120]: I0316 16:59:21.280986 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:59:23 crc kubenswrapper[5120]: I0316 16:59:23.286500 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:59:23 crc kubenswrapper[5120]: I0316 16:59:23.287487 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:59:23 crc kubenswrapper[5120]: I0316 16:59:23.295003 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:59:24 crc kubenswrapper[5120]: I0316 16:59:24.126314 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 16:59:29 crc kubenswrapper[5120]: I0316 16:59:29.664133 5120 scope.go:117] "RemoveContainer" containerID="083f72646c8d47c9c0467b39be99ddfa9c2e5900ae0a29ad53d7b39b950274b4" Mar 16 16:59:30 crc kubenswrapper[5120]: I0316 16:59:30.183522 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" event={"ID":"e2275cb4-4905-4d66-a87e-8010120db2bd","Type":"ContainerStarted","Data":"1a8491415f508d1d670b146ede741f345c7a12252caa1b80c34ffc970e7850f6"} Mar 16 16:59:36 crc kubenswrapper[5120]: I0316 16:59:36.994217 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 16:59:58 crc kubenswrapper[5120]: E0316 16:59:58.785486 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-placement-public-svc: secret "cert-placement-public-svc" not found Mar 16 16:59:58 crc kubenswrapper[5120]: E0316 16:59:58.785517 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-placement-internal-svc: secret "cert-placement-internal-svc" not found Mar 16 16:59:58 crc kubenswrapper[5120]: E0316 16:59:58.786236 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36d5b175-81c4-4fc3-bb05-93958f9a7a63-public-tls-certs podName:36d5b175-81c4-4fc3-bb05-93958f9a7a63 nodeName:}" failed. No retries permitted until 2026-03-16 16:59:59.286206203 +0000 UTC m=+5301.440137860 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/36d5b175-81c4-4fc3-bb05-93958f9a7a63-public-tls-certs") pod "placement-6c74bfb4f8-b872h" (UID: "36d5b175-81c4-4fc3-bb05-93958f9a7a63") : secret "cert-placement-public-svc" not found Mar 16 16:59:58 crc kubenswrapper[5120]: E0316 16:59:58.786319 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36d5b175-81c4-4fc3-bb05-93958f9a7a63-internal-tls-certs podName:36d5b175-81c4-4fc3-bb05-93958f9a7a63 nodeName:}" failed. No retries permitted until 2026-03-16 16:59:59.286292825 +0000 UTC m=+5301.440224482 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/36d5b175-81c4-4fc3-bb05-93958f9a7a63-internal-tls-certs") pod "placement-6c74bfb4f8-b872h" (UID: "36d5b175-81c4-4fc3-bb05-93958f9a7a63") : secret "cert-placement-internal-svc" not found Mar 16 16:59:59 crc kubenswrapper[5120]: E0316 16:59:59.297525 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-placement-internal-svc: secret "cert-placement-internal-svc" not found Mar 16 16:59:59 crc kubenswrapper[5120]: E0316 16:59:59.297598 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-placement-public-svc: secret "cert-placement-public-svc" not found Mar 16 16:59:59 crc kubenswrapper[5120]: E0316 16:59:59.297614 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36d5b175-81c4-4fc3-bb05-93958f9a7a63-internal-tls-certs podName:36d5b175-81c4-4fc3-bb05-93958f9a7a63 nodeName:}" failed. No retries permitted until 2026-03-16 17:00:00.29759288 +0000 UTC m=+5302.451524537 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/36d5b175-81c4-4fc3-bb05-93958f9a7a63-internal-tls-certs") pod "placement-6c74bfb4f8-b872h" (UID: "36d5b175-81c4-4fc3-bb05-93958f9a7a63") : secret "cert-placement-internal-svc" not found Mar 16 16:59:59 crc kubenswrapper[5120]: E0316 16:59:59.297683 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36d5b175-81c4-4fc3-bb05-93958f9a7a63-public-tls-certs podName:36d5b175-81c4-4fc3-bb05-93958f9a7a63 nodeName:}" failed. No retries permitted until 2026-03-16 17:00:00.297663722 +0000 UTC m=+5302.451595459 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/36d5b175-81c4-4fc3-bb05-93958f9a7a63-public-tls-certs") pod "placement-6c74bfb4f8-b872h" (UID: "36d5b175-81c4-4fc3-bb05-93958f9a7a63") : secret "cert-placement-public-svc" not found Mar 16 17:00:00 crc kubenswrapper[5120]: I0316 17:00:00.136524 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29561340-pfsc2"] Mar 16 17:00:00 crc kubenswrapper[5120]: I0316 17:00:00.145512 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29561340-pfsc2" Mar 16 17:00:00 crc kubenswrapper[5120]: I0316 17:00:00.147084 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29561340-pfsc2"] Mar 16 17:00:00 crc kubenswrapper[5120]: I0316 17:00:00.147435 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operator-lifecycle-manager\"/\"collect-profiles-config\"" Mar 16 17:00:00 crc kubenswrapper[5120]: I0316 17:00:00.147550 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operator-lifecycle-manager\"/\"collect-profiles-dockercfg-vfqp6\"" Mar 16 17:00:00 crc kubenswrapper[5120]: I0316 17:00:00.218981 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/11e62c55-441b-466b-b13f-dd20b1647590-secret-volume\") pod \"collect-profiles-29561340-pfsc2\" (UID: \"11e62c55-441b-466b-b13f-dd20b1647590\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561340-pfsc2" Mar 16 17:00:00 crc kubenswrapper[5120]: I0316 17:00:00.219637 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvqn6\" (UniqueName: \"kubernetes.io/projected/11e62c55-441b-466b-b13f-dd20b1647590-kube-api-access-lvqn6\") pod \"collect-profiles-29561340-pfsc2\" (UID: \"11e62c55-441b-466b-b13f-dd20b1647590\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561340-pfsc2" Mar 16 17:00:00 crc kubenswrapper[5120]: I0316 17:00:00.219993 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/11e62c55-441b-466b-b13f-dd20b1647590-config-volume\") pod \"collect-profiles-29561340-pfsc2\" (UID: \"11e62c55-441b-466b-b13f-dd20b1647590\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561340-pfsc2" Mar 16 17:00:00 crc kubenswrapper[5120]: I0316 17:00:00.236249 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-infra/auto-csr-approver-29561340-lqcpp"] Mar 16 17:00:00 crc kubenswrapper[5120]: I0316 17:00:00.244559 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561340-lqcpp" Mar 16 17:00:00 crc kubenswrapper[5120]: I0316 17:00:00.246566 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561340-lqcpp"] Mar 16 17:00:00 crc kubenswrapper[5120]: I0316 17:00:00.252425 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-infra\"/\"csr-approver-sa-dockercfg-x2nsz\"" Mar 16 17:00:00 crc kubenswrapper[5120]: I0316 17:00:00.252639 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"kube-root-ca.crt\"" Mar 16 17:00:00 crc kubenswrapper[5120]: I0316 17:00:00.252699 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"openshift-service-ca.crt\"" Mar 16 17:00:00 crc kubenswrapper[5120]: I0316 17:00:00.322539 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lvqn6\" (UniqueName: \"kubernetes.io/projected/11e62c55-441b-466b-b13f-dd20b1647590-kube-api-access-lvqn6\") pod \"collect-profiles-29561340-pfsc2\" (UID: \"11e62c55-441b-466b-b13f-dd20b1647590\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561340-pfsc2" Mar 16 17:00:00 crc kubenswrapper[5120]: E0316 17:00:00.322719 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-placement-public-svc: secret "cert-placement-public-svc" not found Mar 16 17:00:00 crc kubenswrapper[5120]: I0316 17:00:00.322770 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/11e62c55-441b-466b-b13f-dd20b1647590-config-volume\") pod \"collect-profiles-29561340-pfsc2\" (UID: \"11e62c55-441b-466b-b13f-dd20b1647590\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561340-pfsc2" Mar 16 17:00:00 crc kubenswrapper[5120]: E0316 17:00:00.322841 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36d5b175-81c4-4fc3-bb05-93958f9a7a63-public-tls-certs podName:36d5b175-81c4-4fc3-bb05-93958f9a7a63 nodeName:}" failed. No retries permitted until 2026-03-16 17:00:02.322818611 +0000 UTC m=+5304.476750278 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/36d5b175-81c4-4fc3-bb05-93958f9a7a63-public-tls-certs") pod "placement-6c74bfb4f8-b872h" (UID: "36d5b175-81c4-4fc3-bb05-93958f9a7a63") : secret "cert-placement-public-svc" not found Mar 16 17:00:00 crc kubenswrapper[5120]: I0316 17:00:00.322917 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vt7cm\" (UniqueName: \"kubernetes.io/projected/ad8c715f-c9c8-4ab6-8b01-dc9a8dd3eda2-kube-api-access-vt7cm\") pod \"auto-csr-approver-29561340-lqcpp\" (UID: \"ad8c715f-c9c8-4ab6-8b01-dc9a8dd3eda2\") " pod="openshift-infra/auto-csr-approver-29561340-lqcpp" Mar 16 17:00:00 crc kubenswrapper[5120]: E0316 17:00:00.323104 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-placement-internal-svc: secret "cert-placement-internal-svc" not found Mar 16 17:00:00 crc kubenswrapper[5120]: E0316 17:00:00.323175 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36d5b175-81c4-4fc3-bb05-93958f9a7a63-internal-tls-certs podName:36d5b175-81c4-4fc3-bb05-93958f9a7a63 nodeName:}" failed. No retries permitted until 2026-03-16 17:00:02.32315488 +0000 UTC m=+5304.477086537 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/36d5b175-81c4-4fc3-bb05-93958f9a7a63-internal-tls-certs") pod "placement-6c74bfb4f8-b872h" (UID: "36d5b175-81c4-4fc3-bb05-93958f9a7a63") : secret "cert-placement-internal-svc" not found Mar 16 17:00:00 crc kubenswrapper[5120]: I0316 17:00:00.323329 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/11e62c55-441b-466b-b13f-dd20b1647590-secret-volume\") pod \"collect-profiles-29561340-pfsc2\" (UID: \"11e62c55-441b-466b-b13f-dd20b1647590\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561340-pfsc2" Mar 16 17:00:00 crc kubenswrapper[5120]: I0316 17:00:00.323864 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/11e62c55-441b-466b-b13f-dd20b1647590-config-volume\") pod \"collect-profiles-29561340-pfsc2\" (UID: \"11e62c55-441b-466b-b13f-dd20b1647590\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561340-pfsc2" Mar 16 17:00:00 crc kubenswrapper[5120]: I0316 17:00:00.336817 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/11e62c55-441b-466b-b13f-dd20b1647590-secret-volume\") pod \"collect-profiles-29561340-pfsc2\" (UID: \"11e62c55-441b-466b-b13f-dd20b1647590\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561340-pfsc2" Mar 16 17:00:00 crc kubenswrapper[5120]: I0316 17:00:00.340921 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvqn6\" (UniqueName: \"kubernetes.io/projected/11e62c55-441b-466b-b13f-dd20b1647590-kube-api-access-lvqn6\") pod \"collect-profiles-29561340-pfsc2\" (UID: \"11e62c55-441b-466b-b13f-dd20b1647590\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561340-pfsc2" Mar 16 17:00:00 crc kubenswrapper[5120]: I0316 17:00:00.426712 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vt7cm\" (UniqueName: \"kubernetes.io/projected/ad8c715f-c9c8-4ab6-8b01-dc9a8dd3eda2-kube-api-access-vt7cm\") pod \"auto-csr-approver-29561340-lqcpp\" (UID: \"ad8c715f-c9c8-4ab6-8b01-dc9a8dd3eda2\") " pod="openshift-infra/auto-csr-approver-29561340-lqcpp" Mar 16 17:00:00 crc kubenswrapper[5120]: I0316 17:00:00.449570 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vt7cm\" (UniqueName: \"kubernetes.io/projected/ad8c715f-c9c8-4ab6-8b01-dc9a8dd3eda2-kube-api-access-vt7cm\") pod \"auto-csr-approver-29561340-lqcpp\" (UID: \"ad8c715f-c9c8-4ab6-8b01-dc9a8dd3eda2\") " pod="openshift-infra/auto-csr-approver-29561340-lqcpp" Mar 16 17:00:00 crc kubenswrapper[5120]: I0316 17:00:00.472440 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29561340-pfsc2" Mar 16 17:00:00 crc kubenswrapper[5120]: I0316 17:00:00.571877 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561340-lqcpp" Mar 16 17:00:00 crc kubenswrapper[5120]: I0316 17:00:00.979738 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29561340-pfsc2"] Mar 16 17:00:01 crc kubenswrapper[5120]: I0316 17:00:01.093188 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561340-lqcpp"] Mar 16 17:00:01 crc kubenswrapper[5120]: W0316 17:00:01.103155 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podad8c715f_c9c8_4ab6_8b01_dc9a8dd3eda2.slice/crio-e05b84dcf10ee9dce13a9c70cc0ac5db3805484befca84183d045049940f9616 WatchSource:0}: Error finding container e05b84dcf10ee9dce13a9c70cc0ac5db3805484befca84183d045049940f9616: Status 404 returned error can't find the container with id e05b84dcf10ee9dce13a9c70cc0ac5db3805484befca84183d045049940f9616 Mar 16 17:00:01 crc kubenswrapper[5120]: I0316 17:00:01.525197 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561340-lqcpp" event={"ID":"ad8c715f-c9c8-4ab6-8b01-dc9a8dd3eda2","Type":"ContainerStarted","Data":"e05b84dcf10ee9dce13a9c70cc0ac5db3805484befca84183d045049940f9616"} Mar 16 17:00:01 crc kubenswrapper[5120]: I0316 17:00:01.527508 5120 generic.go:358] "Generic (PLEG): container finished" podID="11e62c55-441b-466b-b13f-dd20b1647590" containerID="a0c26ca852d3d5939c82d134ac059f34b6117582f303b5435c5595739c238271" exitCode=0 Mar 16 17:00:01 crc kubenswrapper[5120]: I0316 17:00:01.527557 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/collect-profiles-29561340-pfsc2" event={"ID":"11e62c55-441b-466b-b13f-dd20b1647590","Type":"ContainerDied","Data":"a0c26ca852d3d5939c82d134ac059f34b6117582f303b5435c5595739c238271"} Mar 16 17:00:01 crc kubenswrapper[5120]: I0316 17:00:01.527575 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/collect-profiles-29561340-pfsc2" event={"ID":"11e62c55-441b-466b-b13f-dd20b1647590","Type":"ContainerStarted","Data":"ab6e7032fabee52a2439d5ed6ed56778c67bd3e0d82c2b41a6380cf02c86c6e1"} Mar 16 17:00:02 crc kubenswrapper[5120]: E0316 17:00:02.380212 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-placement-internal-svc: secret "cert-placement-internal-svc" not found Mar 16 17:00:02 crc kubenswrapper[5120]: E0316 17:00:02.380605 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36d5b175-81c4-4fc3-bb05-93958f9a7a63-internal-tls-certs podName:36d5b175-81c4-4fc3-bb05-93958f9a7a63 nodeName:}" failed. No retries permitted until 2026-03-16 17:00:06.380583084 +0000 UTC m=+5308.534514741 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/36d5b175-81c4-4fc3-bb05-93958f9a7a63-internal-tls-certs") pod "placement-6c74bfb4f8-b872h" (UID: "36d5b175-81c4-4fc3-bb05-93958f9a7a63") : secret "cert-placement-internal-svc" not found Mar 16 17:00:02 crc kubenswrapper[5120]: E0316 17:00:02.380286 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-placement-public-svc: secret "cert-placement-public-svc" not found Mar 16 17:00:02 crc kubenswrapper[5120]: E0316 17:00:02.380692 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36d5b175-81c4-4fc3-bb05-93958f9a7a63-public-tls-certs podName:36d5b175-81c4-4fc3-bb05-93958f9a7a63 nodeName:}" failed. No retries permitted until 2026-03-16 17:00:06.380676696 +0000 UTC m=+5308.534608353 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/36d5b175-81c4-4fc3-bb05-93958f9a7a63-public-tls-certs") pod "placement-6c74bfb4f8-b872h" (UID: "36d5b175-81c4-4fc3-bb05-93958f9a7a63") : secret "cert-placement-public-svc" not found Mar 16 17:00:02 crc kubenswrapper[5120]: I0316 17:00:02.925729 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29561340-pfsc2" Mar 16 17:00:03 crc kubenswrapper[5120]: I0316 17:00:03.096992 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/11e62c55-441b-466b-b13f-dd20b1647590-config-volume\") pod \"11e62c55-441b-466b-b13f-dd20b1647590\" (UID: \"11e62c55-441b-466b-b13f-dd20b1647590\") " Mar 16 17:00:03 crc kubenswrapper[5120]: I0316 17:00:03.097958 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/11e62c55-441b-466b-b13f-dd20b1647590-secret-volume\") pod \"11e62c55-441b-466b-b13f-dd20b1647590\" (UID: \"11e62c55-441b-466b-b13f-dd20b1647590\") " Mar 16 17:00:03 crc kubenswrapper[5120]: I0316 17:00:03.097972 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11e62c55-441b-466b-b13f-dd20b1647590-config-volume" (OuterVolumeSpecName: "config-volume") pod "11e62c55-441b-466b-b13f-dd20b1647590" (UID: "11e62c55-441b-466b-b13f-dd20b1647590"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:00:03 crc kubenswrapper[5120]: I0316 17:00:03.098148 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lvqn6\" (UniqueName: \"kubernetes.io/projected/11e62c55-441b-466b-b13f-dd20b1647590-kube-api-access-lvqn6\") pod \"11e62c55-441b-466b-b13f-dd20b1647590\" (UID: \"11e62c55-441b-466b-b13f-dd20b1647590\") " Mar 16 17:00:03 crc kubenswrapper[5120]: I0316 17:00:03.099021 5120 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/11e62c55-441b-466b-b13f-dd20b1647590-config-volume\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:03 crc kubenswrapper[5120]: I0316 17:00:03.105037 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11e62c55-441b-466b-b13f-dd20b1647590-kube-api-access-lvqn6" (OuterVolumeSpecName: "kube-api-access-lvqn6") pod "11e62c55-441b-466b-b13f-dd20b1647590" (UID: "11e62c55-441b-466b-b13f-dd20b1647590"). InnerVolumeSpecName "kube-api-access-lvqn6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:00:03 crc kubenswrapper[5120]: I0316 17:00:03.116256 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11e62c55-441b-466b-b13f-dd20b1647590-secret-volume" (OuterVolumeSpecName: "secret-volume") pod "11e62c55-441b-466b-b13f-dd20b1647590" (UID: "11e62c55-441b-466b-b13f-dd20b1647590"). InnerVolumeSpecName "secret-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:03 crc kubenswrapper[5120]: I0316 17:00:03.200872 5120 reconciler_common.go:299] "Volume detached for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/11e62c55-441b-466b-b13f-dd20b1647590-secret-volume\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:03 crc kubenswrapper[5120]: I0316 17:00:03.200918 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lvqn6\" (UniqueName: \"kubernetes.io/projected/11e62c55-441b-466b-b13f-dd20b1647590-kube-api-access-lvqn6\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:03 crc kubenswrapper[5120]: I0316 17:00:03.432105 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 17:00:03 crc kubenswrapper[5120]: I0316 17:00:03.518421 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 17:00:03 crc kubenswrapper[5120]: I0316 17:00:03.549574 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/collect-profiles-29561340-pfsc2" event={"ID":"11e62c55-441b-466b-b13f-dd20b1647590","Type":"ContainerDied","Data":"ab6e7032fabee52a2439d5ed6ed56778c67bd3e0d82c2b41a6380cf02c86c6e1"} Mar 16 17:00:03 crc kubenswrapper[5120]: I0316 17:00:03.549633 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ab6e7032fabee52a2439d5ed6ed56778c67bd3e0d82c2b41a6380cf02c86c6e1" Mar 16 17:00:03 crc kubenswrapper[5120]: I0316 17:00:03.549747 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29561340-pfsc2" Mar 16 17:00:03 crc kubenswrapper[5120]: I0316 17:00:03.600099 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/openstack-cell1-galera-0" podUID="93611c0a-e049-4bce-a55f-64d6423031b7" containerName="galera" containerID="cri-o://0cc45018c0393bdbfa1f4fb52f48a73635f3a9667559d189a5957b03ec095cfc" gracePeriod=30 Mar 16 17:00:03 crc kubenswrapper[5120]: I0316 17:00:03.655246 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/openstack-galera-0" podUID="a4a9af83-10ac-4d5d-b8e3-e2d4d62c5a0d" containerName="galera" containerID="cri-o://75ba7a23ede7125ea74861aacb5d597bf3d7dc9e677e82329e1b5682f729b68b" gracePeriod=30 Mar 16 17:00:03 crc kubenswrapper[5120]: E0316 17:00:03.818136 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-swift-internal-svc: secret "cert-swift-internal-svc" not found Mar 16 17:00:03 crc kubenswrapper[5120]: E0316 17:00:03.818443 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21a5384d-c9cf-429c-9e7e-cc9fb2a825b9-internal-tls-certs podName:21a5384d-c9cf-429c-9e7e-cc9fb2a825b9 nodeName:}" failed. No retries permitted until 2026-03-16 17:00:04.318419037 +0000 UTC m=+5306.472350684 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/21a5384d-c9cf-429c-9e7e-cc9fb2a825b9-internal-tls-certs") pod "swift-proxy-5f4bc687f4-xcf5c" (UID: "21a5384d-c9cf-429c-9e7e-cc9fb2a825b9") : secret "cert-swift-internal-svc" not found Mar 16 17:00:03 crc kubenswrapper[5120]: E0316 17:00:03.822996 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-swift-public-svc: secret "cert-swift-public-svc" not found Mar 16 17:00:03 crc kubenswrapper[5120]: E0316 17:00:03.823069 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21a5384d-c9cf-429c-9e7e-cc9fb2a825b9-public-tls-certs podName:21a5384d-c9cf-429c-9e7e-cc9fb2a825b9 nodeName:}" failed. No retries permitted until 2026-03-16 17:00:04.323051705 +0000 UTC m=+5306.476983362 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/21a5384d-c9cf-429c-9e7e-cc9fb2a825b9-public-tls-certs") pod "swift-proxy-5f4bc687f4-xcf5c" (UID: "21a5384d-c9cf-429c-9e7e-cc9fb2a825b9") : secret "cert-swift-public-svc" not found Mar 16 17:00:04 crc kubenswrapper[5120]: I0316 17:00:04.003573 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29561295-hlmm9"] Mar 16 17:00:04 crc kubenswrapper[5120]: I0316 17:00:04.014454 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29561295-hlmm9"] Mar 16 17:00:04 crc kubenswrapper[5120]: E0316 17:00:04.337364 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-swift-public-svc: secret "cert-swift-public-svc" not found Mar 16 17:00:04 crc kubenswrapper[5120]: E0316 17:00:04.337684 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21a5384d-c9cf-429c-9e7e-cc9fb2a825b9-public-tls-certs podName:21a5384d-c9cf-429c-9e7e-cc9fb2a825b9 nodeName:}" failed. No retries permitted until 2026-03-16 17:00:05.3376596 +0000 UTC m=+5307.491591257 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/21a5384d-c9cf-429c-9e7e-cc9fb2a825b9-public-tls-certs") pod "swift-proxy-5f4bc687f4-xcf5c" (UID: "21a5384d-c9cf-429c-9e7e-cc9fb2a825b9") : secret "cert-swift-public-svc" not found Mar 16 17:00:04 crc kubenswrapper[5120]: E0316 17:00:04.338189 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-swift-internal-svc: secret "cert-swift-internal-svc" not found Mar 16 17:00:04 crc kubenswrapper[5120]: E0316 17:00:04.338234 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21a5384d-c9cf-429c-9e7e-cc9fb2a825b9-internal-tls-certs podName:21a5384d-c9cf-429c-9e7e-cc9fb2a825b9 nodeName:}" failed. No retries permitted until 2026-03-16 17:00:05.338222806 +0000 UTC m=+5307.492154453 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/21a5384d-c9cf-429c-9e7e-cc9fb2a825b9-internal-tls-certs") pod "swift-proxy-5f4bc687f4-xcf5c" (UID: "21a5384d-c9cf-429c-9e7e-cc9fb2a825b9") : secret "cert-swift-internal-svc" not found Mar 16 17:00:04 crc kubenswrapper[5120]: I0316 17:00:04.566145 5120 generic.go:358] "Generic (PLEG): container finished" podID="93611c0a-e049-4bce-a55f-64d6423031b7" containerID="0cc45018c0393bdbfa1f4fb52f48a73635f3a9667559d189a5957b03ec095cfc" exitCode=0 Mar 16 17:00:04 crc kubenswrapper[5120]: I0316 17:00:04.566752 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"93611c0a-e049-4bce-a55f-64d6423031b7","Type":"ContainerDied","Data":"0cc45018c0393bdbfa1f4fb52f48a73635f3a9667559d189a5957b03ec095cfc"} Mar 16 17:00:04 crc kubenswrapper[5120]: I0316 17:00:04.677058 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f2d980ac-9267-4c28-a842-ecf2e778a4f1" path="/var/lib/kubelet/pods/f2d980ac-9267-4c28-a842-ecf2e778a4f1/volumes" Mar 16 17:00:04 crc kubenswrapper[5120]: I0316 17:00:04.690378 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:00:04 crc kubenswrapper[5120]: I0316 17:00:04.752869 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dpm2x\" (UniqueName: \"kubernetes.io/projected/93611c0a-e049-4bce-a55f-64d6423031b7-kube-api-access-dpm2x\") pod \"93611c0a-e049-4bce-a55f-64d6423031b7\" (UID: \"93611c0a-e049-4bce-a55f-64d6423031b7\") " Mar 16 17:00:04 crc kubenswrapper[5120]: I0316 17:00:04.753272 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"mysql-db\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"93611c0a-e049-4bce-a55f-64d6423031b7\" (UID: \"93611c0a-e049-4bce-a55f-64d6423031b7\") " Mar 16 17:00:04 crc kubenswrapper[5120]: I0316 17:00:04.753422 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/93611c0a-e049-4bce-a55f-64d6423031b7-kolla-config\") pod \"93611c0a-e049-4bce-a55f-64d6423031b7\" (UID: \"93611c0a-e049-4bce-a55f-64d6423031b7\") " Mar 16 17:00:04 crc kubenswrapper[5120]: I0316 17:00:04.753549 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/93611c0a-e049-4bce-a55f-64d6423031b7-config-data-default\") pod \"93611c0a-e049-4bce-a55f-64d6423031b7\" (UID: \"93611c0a-e049-4bce-a55f-64d6423031b7\") " Mar 16 17:00:04 crc kubenswrapper[5120]: I0316 17:00:04.753883 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/93611c0a-e049-4bce-a55f-64d6423031b7-galera-tls-certs\") pod \"93611c0a-e049-4bce-a55f-64d6423031b7\" (UID: \"93611c0a-e049-4bce-a55f-64d6423031b7\") " Mar 16 17:00:04 crc kubenswrapper[5120]: I0316 17:00:04.753974 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/93611c0a-e049-4bce-a55f-64d6423031b7-config-data-generated\") pod \"93611c0a-e049-4bce-a55f-64d6423031b7\" (UID: \"93611c0a-e049-4bce-a55f-64d6423031b7\") " Mar 16 17:00:04 crc kubenswrapper[5120]: I0316 17:00:04.754033 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/93611c0a-e049-4bce-a55f-64d6423031b7-operator-scripts\") pod \"93611c0a-e049-4bce-a55f-64d6423031b7\" (UID: \"93611c0a-e049-4bce-a55f-64d6423031b7\") " Mar 16 17:00:04 crc kubenswrapper[5120]: I0316 17:00:04.754092 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/93611c0a-e049-4bce-a55f-64d6423031b7-combined-ca-bundle\") pod \"93611c0a-e049-4bce-a55f-64d6423031b7\" (UID: \"93611c0a-e049-4bce-a55f-64d6423031b7\") " Mar 16 17:00:04 crc kubenswrapper[5120]: I0316 17:00:04.754898 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93611c0a-e049-4bce-a55f-64d6423031b7-config-data-generated" (OuterVolumeSpecName: "config-data-generated") pod "93611c0a-e049-4bce-a55f-64d6423031b7" (UID: "93611c0a-e049-4bce-a55f-64d6423031b7"). InnerVolumeSpecName "config-data-generated". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:00:04 crc kubenswrapper[5120]: I0316 17:00:04.755179 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/93611c0a-e049-4bce-a55f-64d6423031b7-config-data-generated\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:04 crc kubenswrapper[5120]: I0316 17:00:04.755418 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/93611c0a-e049-4bce-a55f-64d6423031b7-config-data-default" (OuterVolumeSpecName: "config-data-default") pod "93611c0a-e049-4bce-a55f-64d6423031b7" (UID: "93611c0a-e049-4bce-a55f-64d6423031b7"). InnerVolumeSpecName "config-data-default". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:00:04 crc kubenswrapper[5120]: I0316 17:00:04.756117 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/93611c0a-e049-4bce-a55f-64d6423031b7-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "93611c0a-e049-4bce-a55f-64d6423031b7" (UID: "93611c0a-e049-4bce-a55f-64d6423031b7"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:00:04 crc kubenswrapper[5120]: I0316 17:00:04.756659 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/93611c0a-e049-4bce-a55f-64d6423031b7-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "93611c0a-e049-4bce-a55f-64d6423031b7" (UID: "93611c0a-e049-4bce-a55f-64d6423031b7"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:00:04 crc kubenswrapper[5120]: I0316 17:00:04.763824 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93611c0a-e049-4bce-a55f-64d6423031b7-kube-api-access-dpm2x" (OuterVolumeSpecName: "kube-api-access-dpm2x") pod "93611c0a-e049-4bce-a55f-64d6423031b7" (UID: "93611c0a-e049-4bce-a55f-64d6423031b7"). InnerVolumeSpecName "kube-api-access-dpm2x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:00:04 crc kubenswrapper[5120]: I0316 17:00:04.781906 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage04-crc" (OuterVolumeSpecName: "mysql-db") pod "93611c0a-e049-4bce-a55f-64d6423031b7" (UID: "93611c0a-e049-4bce-a55f-64d6423031b7"). InnerVolumeSpecName "local-storage04-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 17:00:04 crc kubenswrapper[5120]: I0316 17:00:04.797589 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93611c0a-e049-4bce-a55f-64d6423031b7-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "93611c0a-e049-4bce-a55f-64d6423031b7" (UID: "93611c0a-e049-4bce-a55f-64d6423031b7"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:04 crc kubenswrapper[5120]: I0316 17:00:04.840953 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93611c0a-e049-4bce-a55f-64d6423031b7-galera-tls-certs" (OuterVolumeSpecName: "galera-tls-certs") pod "93611c0a-e049-4bce-a55f-64d6423031b7" (UID: "93611c0a-e049-4bce-a55f-64d6423031b7"). InnerVolumeSpecName "galera-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:04 crc kubenswrapper[5120]: I0316 17:00:04.858245 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dpm2x\" (UniqueName: \"kubernetes.io/projected/93611c0a-e049-4bce-a55f-64d6423031b7-kube-api-access-dpm2x\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:04 crc kubenswrapper[5120]: I0316 17:00:04.858305 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") on node \"crc\" " Mar 16 17:00:04 crc kubenswrapper[5120]: I0316 17:00:04.858319 5120 reconciler_common.go:299] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/93611c0a-e049-4bce-a55f-64d6423031b7-kolla-config\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:04 crc kubenswrapper[5120]: I0316 17:00:04.858331 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/93611c0a-e049-4bce-a55f-64d6423031b7-config-data-default\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:04 crc kubenswrapper[5120]: I0316 17:00:04.858343 5120 reconciler_common.go:299] "Volume detached for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/93611c0a-e049-4bce-a55f-64d6423031b7-galera-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:04 crc kubenswrapper[5120]: I0316 17:00:04.858354 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/93611c0a-e049-4bce-a55f-64d6423031b7-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:04 crc kubenswrapper[5120]: I0316 17:00:04.858366 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/93611c0a-e049-4bce-a55f-64d6423031b7-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:04 crc kubenswrapper[5120]: I0316 17:00:04.885311 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage04-crc" (UniqueName: "kubernetes.io/local-volume/local-storage04-crc") on node "crc" Mar 16 17:00:04 crc kubenswrapper[5120]: I0316 17:00:04.961452 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:05 crc kubenswrapper[5120]: I0316 17:00:05.191768 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="d82f3b2b-c672-46ff-8fc8-afc5b33e8252" containerName="cinder-scheduler" probeResult="failure" output="HTTP probe failed with statuscode: 500" Mar 16 17:00:05 crc kubenswrapper[5120]: E0316 17:00:05.372651 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-swift-public-svc: secret "cert-swift-public-svc" not found Mar 16 17:00:05 crc kubenswrapper[5120]: E0316 17:00:05.372775 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21a5384d-c9cf-429c-9e7e-cc9fb2a825b9-public-tls-certs podName:21a5384d-c9cf-429c-9e7e-cc9fb2a825b9 nodeName:}" failed. No retries permitted until 2026-03-16 17:00:07.372736671 +0000 UTC m=+5309.526668328 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/21a5384d-c9cf-429c-9e7e-cc9fb2a825b9-public-tls-certs") pod "swift-proxy-5f4bc687f4-xcf5c" (UID: "21a5384d-c9cf-429c-9e7e-cc9fb2a825b9") : secret "cert-swift-public-svc" not found Mar 16 17:00:05 crc kubenswrapper[5120]: E0316 17:00:05.373184 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-swift-internal-svc: secret "cert-swift-internal-svc" not found Mar 16 17:00:05 crc kubenswrapper[5120]: E0316 17:00:05.373225 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21a5384d-c9cf-429c-9e7e-cc9fb2a825b9-internal-tls-certs podName:21a5384d-c9cf-429c-9e7e-cc9fb2a825b9 nodeName:}" failed. No retries permitted until 2026-03-16 17:00:07.373216974 +0000 UTC m=+5309.527148631 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/21a5384d-c9cf-429c-9e7e-cc9fb2a825b9-internal-tls-certs") pod "swift-proxy-5f4bc687f4-xcf5c" (UID: "21a5384d-c9cf-429c-9e7e-cc9fb2a825b9") : secret "cert-swift-internal-svc" not found Mar 16 17:00:05 crc kubenswrapper[5120]: I0316 17:00:05.582376 5120 generic.go:358] "Generic (PLEG): container finished" podID="ad8c715f-c9c8-4ab6-8b01-dc9a8dd3eda2" containerID="412a89ff4eb28302a6a1e3be4668598f262e22d05cebaa7d38b522757af048f9" exitCode=0 Mar 16 17:00:05 crc kubenswrapper[5120]: I0316 17:00:05.582996 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561340-lqcpp" event={"ID":"ad8c715f-c9c8-4ab6-8b01-dc9a8dd3eda2","Type":"ContainerDied","Data":"412a89ff4eb28302a6a1e3be4668598f262e22d05cebaa7d38b522757af048f9"} Mar 16 17:00:05 crc kubenswrapper[5120]: I0316 17:00:05.587150 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"93611c0a-e049-4bce-a55f-64d6423031b7","Type":"ContainerDied","Data":"2c23fc866155c6bd351236f52496fda66c9bb5478f1bc8722a7471372b0b4571"} Mar 16 17:00:05 crc kubenswrapper[5120]: I0316 17:00:05.587206 5120 scope.go:117] "RemoveContainer" containerID="0cc45018c0393bdbfa1f4fb52f48a73635f3a9667559d189a5957b03ec095cfc" Mar 16 17:00:05 crc kubenswrapper[5120]: I0316 17:00:05.587388 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:00:05 crc kubenswrapper[5120]: I0316 17:00:05.605727 5120 generic.go:358] "Generic (PLEG): container finished" podID="a4a9af83-10ac-4d5d-b8e3-e2d4d62c5a0d" containerID="75ba7a23ede7125ea74861aacb5d597bf3d7dc9e677e82329e1b5682f729b68b" exitCode=0 Mar 16 17:00:05 crc kubenswrapper[5120]: I0316 17:00:05.605865 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"a4a9af83-10ac-4d5d-b8e3-e2d4d62c5a0d","Type":"ContainerDied","Data":"75ba7a23ede7125ea74861aacb5d597bf3d7dc9e677e82329e1b5682f729b68b"} Mar 16 17:00:05 crc kubenswrapper[5120]: I0316 17:00:05.635063 5120 scope.go:117] "RemoveContainer" containerID="cc0bc3cba86a9366be662b6e3ce9146f449f7008accda8f663835a30d82d9c50" Mar 16 17:00:05 crc kubenswrapper[5120]: I0316 17:00:05.643294 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 17:00:05 crc kubenswrapper[5120]: I0316 17:00:05.651126 5120 scope.go:117] "RemoveContainer" containerID="053113b17b02d421627a8e291f395e1cfd1afc02c65e30954739fd56da975ac8" Mar 16 17:00:05 crc kubenswrapper[5120]: I0316 17:00:05.662138 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 17:00:05 crc kubenswrapper[5120]: I0316 17:00:05.676599 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 17:00:05 crc kubenswrapper[5120]: I0316 17:00:05.682066 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93611c0a-e049-4bce-a55f-64d6423031b7" containerName="mysql-bootstrap" Mar 16 17:00:05 crc kubenswrapper[5120]: I0316 17:00:05.682103 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="93611c0a-e049-4bce-a55f-64d6423031b7" containerName="mysql-bootstrap" Mar 16 17:00:05 crc kubenswrapper[5120]: I0316 17:00:05.682151 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93611c0a-e049-4bce-a55f-64d6423031b7" containerName="galera" Mar 16 17:00:05 crc kubenswrapper[5120]: I0316 17:00:05.682157 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="93611c0a-e049-4bce-a55f-64d6423031b7" containerName="galera" Mar 16 17:00:05 crc kubenswrapper[5120]: I0316 17:00:05.682214 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11e62c55-441b-466b-b13f-dd20b1647590" containerName="collect-profiles" Mar 16 17:00:05 crc kubenswrapper[5120]: I0316 17:00:05.682221 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="11e62c55-441b-466b-b13f-dd20b1647590" containerName="collect-profiles" Mar 16 17:00:05 crc kubenswrapper[5120]: I0316 17:00:05.682431 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="11e62c55-441b-466b-b13f-dd20b1647590" containerName="collect-profiles" Mar 16 17:00:05 crc kubenswrapper[5120]: I0316 17:00:05.682449 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="93611c0a-e049-4bce-a55f-64d6423031b7" containerName="galera" Mar 16 17:00:05 crc kubenswrapper[5120]: I0316 17:00:05.708253 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 17:00:05 crc kubenswrapper[5120]: I0316 17:00:05.708389 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:00:05 crc kubenswrapper[5120]: I0316 17:00:05.712086 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"galera-openstack-cell1-dockercfg-zjhx5\"" Mar 16 17:00:05 crc kubenswrapper[5120]: I0316 17:00:05.712344 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-galera-openstack-cell1-svc\"" Mar 16 17:00:05 crc kubenswrapper[5120]: I0316 17:00:05.712881 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-cell1-scripts\"" Mar 16 17:00:05 crc kubenswrapper[5120]: I0316 17:00:05.713043 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-cell1-config-data\"" Mar 16 17:00:05 crc kubenswrapper[5120]: I0316 17:00:05.783604 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/39da7446-acba-4bbb-b813-1a3e2c89ebcd-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"39da7446-acba-4bbb-b813-1a3e2c89ebcd\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:00:05 crc kubenswrapper[5120]: I0316 17:00:05.783752 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/39da7446-acba-4bbb-b813-1a3e2c89ebcd-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"39da7446-acba-4bbb-b813-1a3e2c89ebcd\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:00:05 crc kubenswrapper[5120]: I0316 17:00:05.783842 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"openstack-cell1-galera-0\" (UID: \"39da7446-acba-4bbb-b813-1a3e2c89ebcd\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:00:05 crc kubenswrapper[5120]: I0316 17:00:05.783879 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/39da7446-acba-4bbb-b813-1a3e2c89ebcd-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"39da7446-acba-4bbb-b813-1a3e2c89ebcd\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:00:05 crc kubenswrapper[5120]: I0316 17:00:05.784208 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/39da7446-acba-4bbb-b813-1a3e2c89ebcd-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"39da7446-acba-4bbb-b813-1a3e2c89ebcd\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:00:05 crc kubenswrapper[5120]: I0316 17:00:05.784447 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvhc5\" (UniqueName: \"kubernetes.io/projected/39da7446-acba-4bbb-b813-1a3e2c89ebcd-kube-api-access-tvhc5\") pod \"openstack-cell1-galera-0\" (UID: \"39da7446-acba-4bbb-b813-1a3e2c89ebcd\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:00:05 crc kubenswrapper[5120]: I0316 17:00:05.784520 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/39da7446-acba-4bbb-b813-1a3e2c89ebcd-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"39da7446-acba-4bbb-b813-1a3e2c89ebcd\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:00:05 crc kubenswrapper[5120]: I0316 17:00:05.784689 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/39da7446-acba-4bbb-b813-1a3e2c89ebcd-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"39da7446-acba-4bbb-b813-1a3e2c89ebcd\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:00:05 crc kubenswrapper[5120]: I0316 17:00:05.788132 5120 scope.go:117] "RemoveContainer" containerID="3d1fa3f05cf04af9cd4ade7a65089fa1f8351ed405ba76f965c47bc010d6ef00" Mar 16 17:00:05 crc kubenswrapper[5120]: I0316 17:00:05.884327 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:00:05 crc kubenswrapper[5120]: I0316 17:00:05.886218 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/39da7446-acba-4bbb-b813-1a3e2c89ebcd-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"39da7446-acba-4bbb-b813-1a3e2c89ebcd\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:00:05 crc kubenswrapper[5120]: I0316 17:00:05.886294 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/39da7446-acba-4bbb-b813-1a3e2c89ebcd-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"39da7446-acba-4bbb-b813-1a3e2c89ebcd\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:00:05 crc kubenswrapper[5120]: I0316 17:00:05.886570 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/39da7446-acba-4bbb-b813-1a3e2c89ebcd-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"39da7446-acba-4bbb-b813-1a3e2c89ebcd\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:00:05 crc kubenswrapper[5120]: I0316 17:00:05.886625 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"openstack-cell1-galera-0\" (UID: \"39da7446-acba-4bbb-b813-1a3e2c89ebcd\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:00:05 crc kubenswrapper[5120]: I0316 17:00:05.886656 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/39da7446-acba-4bbb-b813-1a3e2c89ebcd-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"39da7446-acba-4bbb-b813-1a3e2c89ebcd\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:00:05 crc kubenswrapper[5120]: I0316 17:00:05.886738 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/39da7446-acba-4bbb-b813-1a3e2c89ebcd-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"39da7446-acba-4bbb-b813-1a3e2c89ebcd\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:00:05 crc kubenswrapper[5120]: I0316 17:00:05.886861 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tvhc5\" (UniqueName: \"kubernetes.io/projected/39da7446-acba-4bbb-b813-1a3e2c89ebcd-kube-api-access-tvhc5\") pod \"openstack-cell1-galera-0\" (UID: \"39da7446-acba-4bbb-b813-1a3e2c89ebcd\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:00:05 crc kubenswrapper[5120]: I0316 17:00:05.886903 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/39da7446-acba-4bbb-b813-1a3e2c89ebcd-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"39da7446-acba-4bbb-b813-1a3e2c89ebcd\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:00:05 crc kubenswrapper[5120]: I0316 17:00:05.887257 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"openstack-cell1-galera-0\" (UID: \"39da7446-acba-4bbb-b813-1a3e2c89ebcd\") device mount path \"/mnt/openstack/pv04\"" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:00:05 crc kubenswrapper[5120]: I0316 17:00:05.887350 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/39da7446-acba-4bbb-b813-1a3e2c89ebcd-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"39da7446-acba-4bbb-b813-1a3e2c89ebcd\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:00:05 crc kubenswrapper[5120]: I0316 17:00:05.887936 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/39da7446-acba-4bbb-b813-1a3e2c89ebcd-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"39da7446-acba-4bbb-b813-1a3e2c89ebcd\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:00:05 crc kubenswrapper[5120]: I0316 17:00:05.888189 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/39da7446-acba-4bbb-b813-1a3e2c89ebcd-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"39da7446-acba-4bbb-b813-1a3e2c89ebcd\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:00:05 crc kubenswrapper[5120]: I0316 17:00:05.889291 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/39da7446-acba-4bbb-b813-1a3e2c89ebcd-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"39da7446-acba-4bbb-b813-1a3e2c89ebcd\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:00:05 crc kubenswrapper[5120]: I0316 17:00:05.897434 5120 scope.go:117] "RemoveContainer" containerID="855d81c54b5a73dfb6e48b74a4cf1924e34cc373893fb720b9f3701b667bd089" Mar 16 17:00:05 crc kubenswrapper[5120]: I0316 17:00:05.917348 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvhc5\" (UniqueName: \"kubernetes.io/projected/39da7446-acba-4bbb-b813-1a3e2c89ebcd-kube-api-access-tvhc5\") pod \"openstack-cell1-galera-0\" (UID: \"39da7446-acba-4bbb-b813-1a3e2c89ebcd\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:00:05 crc kubenswrapper[5120]: I0316 17:00:05.928505 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"openstack-cell1-galera-0\" (UID: \"39da7446-acba-4bbb-b813-1a3e2c89ebcd\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:00:05 crc kubenswrapper[5120]: I0316 17:00:05.987871 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/a4a9af83-10ac-4d5d-b8e3-e2d4d62c5a0d-config-data-generated\") pod \"a4a9af83-10ac-4d5d-b8e3-e2d4d62c5a0d\" (UID: \"a4a9af83-10ac-4d5d-b8e3-e2d4d62c5a0d\") " Mar 16 17:00:05 crc kubenswrapper[5120]: I0316 17:00:05.988068 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-czkkq\" (UniqueName: \"kubernetes.io/projected/a4a9af83-10ac-4d5d-b8e3-e2d4d62c5a0d-kube-api-access-czkkq\") pod \"a4a9af83-10ac-4d5d-b8e3-e2d4d62c5a0d\" (UID: \"a4a9af83-10ac-4d5d-b8e3-e2d4d62c5a0d\") " Mar 16 17:00:05 crc kubenswrapper[5120]: I0316 17:00:05.988267 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/a4a9af83-10ac-4d5d-b8e3-e2d4d62c5a0d-galera-tls-certs\") pod \"a4a9af83-10ac-4d5d-b8e3-e2d4d62c5a0d\" (UID: \"a4a9af83-10ac-4d5d-b8e3-e2d4d62c5a0d\") " Mar 16 17:00:05 crc kubenswrapper[5120]: I0316 17:00:05.988379 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a4a9af83-10ac-4d5d-b8e3-e2d4d62c5a0d-operator-scripts\") pod \"a4a9af83-10ac-4d5d-b8e3-e2d4d62c5a0d\" (UID: \"a4a9af83-10ac-4d5d-b8e3-e2d4d62c5a0d\") " Mar 16 17:00:05 crc kubenswrapper[5120]: I0316 17:00:05.988455 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a4a9af83-10ac-4d5d-b8e3-e2d4d62c5a0d-config-data-generated" (OuterVolumeSpecName: "config-data-generated") pod "a4a9af83-10ac-4d5d-b8e3-e2d4d62c5a0d" (UID: "a4a9af83-10ac-4d5d-b8e3-e2d4d62c5a0d"). InnerVolumeSpecName "config-data-generated". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:00:05 crc kubenswrapper[5120]: I0316 17:00:05.988483 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/a4a9af83-10ac-4d5d-b8e3-e2d4d62c5a0d-kolla-config\") pod \"a4a9af83-10ac-4d5d-b8e3-e2d4d62c5a0d\" (UID: \"a4a9af83-10ac-4d5d-b8e3-e2d4d62c5a0d\") " Mar 16 17:00:05 crc kubenswrapper[5120]: I0316 17:00:05.988510 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a4a9af83-10ac-4d5d-b8e3-e2d4d62c5a0d-combined-ca-bundle\") pod \"a4a9af83-10ac-4d5d-b8e3-e2d4d62c5a0d\" (UID: \"a4a9af83-10ac-4d5d-b8e3-e2d4d62c5a0d\") " Mar 16 17:00:05 crc kubenswrapper[5120]: I0316 17:00:05.988575 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"mysql-db\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"a4a9af83-10ac-4d5d-b8e3-e2d4d62c5a0d\" (UID: \"a4a9af83-10ac-4d5d-b8e3-e2d4d62c5a0d\") " Mar 16 17:00:05 crc kubenswrapper[5120]: I0316 17:00:05.988595 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/a4a9af83-10ac-4d5d-b8e3-e2d4d62c5a0d-config-data-default\") pod \"a4a9af83-10ac-4d5d-b8e3-e2d4d62c5a0d\" (UID: \"a4a9af83-10ac-4d5d-b8e3-e2d4d62c5a0d\") " Mar 16 17:00:05 crc kubenswrapper[5120]: I0316 17:00:05.989156 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a4a9af83-10ac-4d5d-b8e3-e2d4d62c5a0d-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "a4a9af83-10ac-4d5d-b8e3-e2d4d62c5a0d" (UID: "a4a9af83-10ac-4d5d-b8e3-e2d4d62c5a0d"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:00:05 crc kubenswrapper[5120]: I0316 17:00:05.989260 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a4a9af83-10ac-4d5d-b8e3-e2d4d62c5a0d-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "a4a9af83-10ac-4d5d-b8e3-e2d4d62c5a0d" (UID: "a4a9af83-10ac-4d5d-b8e3-e2d4d62c5a0d"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:00:05 crc kubenswrapper[5120]: I0316 17:00:05.989282 5120 reconciler_common.go:299] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/a4a9af83-10ac-4d5d-b8e3-e2d4d62c5a0d-kolla-config\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:05 crc kubenswrapper[5120]: I0316 17:00:05.989443 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/a4a9af83-10ac-4d5d-b8e3-e2d4d62c5a0d-config-data-generated\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:05 crc kubenswrapper[5120]: I0316 17:00:05.989498 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a4a9af83-10ac-4d5d-b8e3-e2d4d62c5a0d-config-data-default" (OuterVolumeSpecName: "config-data-default") pod "a4a9af83-10ac-4d5d-b8e3-e2d4d62c5a0d" (UID: "a4a9af83-10ac-4d5d-b8e3-e2d4d62c5a0d"). InnerVolumeSpecName "config-data-default". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:00:06 crc kubenswrapper[5120]: I0316 17:00:06.067544 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/39da7446-acba-4bbb-b813-1a3e2c89ebcd-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"39da7446-acba-4bbb-b813-1a3e2c89ebcd\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:00:06 crc kubenswrapper[5120]: I0316 17:00:06.069565 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/39da7446-acba-4bbb-b813-1a3e2c89ebcd-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"39da7446-acba-4bbb-b813-1a3e2c89ebcd\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:00:06 crc kubenswrapper[5120]: I0316 17:00:06.071306 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a4a9af83-10ac-4d5d-b8e3-e2d4d62c5a0d-kube-api-access-czkkq" (OuterVolumeSpecName: "kube-api-access-czkkq") pod "a4a9af83-10ac-4d5d-b8e3-e2d4d62c5a0d" (UID: "a4a9af83-10ac-4d5d-b8e3-e2d4d62c5a0d"). InnerVolumeSpecName "kube-api-access-czkkq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:00:06 crc kubenswrapper[5120]: I0316 17:00:06.073942 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a4a9af83-10ac-4d5d-b8e3-e2d4d62c5a0d-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "a4a9af83-10ac-4d5d-b8e3-e2d4d62c5a0d" (UID: "a4a9af83-10ac-4d5d-b8e3-e2d4d62c5a0d"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:06 crc kubenswrapper[5120]: I0316 17:00:06.075384 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage20-crc" (OuterVolumeSpecName: "mysql-db") pod "a4a9af83-10ac-4d5d-b8e3-e2d4d62c5a0d" (UID: "a4a9af83-10ac-4d5d-b8e3-e2d4d62c5a0d"). InnerVolumeSpecName "local-storage20-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 17:00:06 crc kubenswrapper[5120]: I0316 17:00:06.092082 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-czkkq\" (UniqueName: \"kubernetes.io/projected/a4a9af83-10ac-4d5d-b8e3-e2d4d62c5a0d-kube-api-access-czkkq\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:06 crc kubenswrapper[5120]: I0316 17:00:06.092388 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a4a9af83-10ac-4d5d-b8e3-e2d4d62c5a0d-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:06 crc kubenswrapper[5120]: I0316 17:00:06.092510 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a4a9af83-10ac-4d5d-b8e3-e2d4d62c5a0d-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:06 crc kubenswrapper[5120]: I0316 17:00:06.092618 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") on node \"crc\" " Mar 16 17:00:06 crc kubenswrapper[5120]: I0316 17:00:06.092712 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/a4a9af83-10ac-4d5d-b8e3-e2d4d62c5a0d-config-data-default\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:06 crc kubenswrapper[5120]: I0316 17:00:06.100144 5120 scope.go:117] "RemoveContainer" containerID="e7988bbd4e370c1b3b8d66ef4078a84ae01eef1bd0c914a902ac15140a2da83a" Mar 16 17:00:06 crc kubenswrapper[5120]: I0316 17:00:06.105788 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a4a9af83-10ac-4d5d-b8e3-e2d4d62c5a0d-galera-tls-certs" (OuterVolumeSpecName: "galera-tls-certs") pod "a4a9af83-10ac-4d5d-b8e3-e2d4d62c5a0d" (UID: "a4a9af83-10ac-4d5d-b8e3-e2d4d62c5a0d"). InnerVolumeSpecName "galera-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:06 crc kubenswrapper[5120]: I0316 17:00:06.127133 5120 scope.go:117] "RemoveContainer" containerID="969c0fee6f5e50a4c085ce67514e02e7f86d5f620047b6f219929078b3e9bf5e" Mar 16 17:00:06 crc kubenswrapper[5120]: I0316 17:00:06.130391 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage20-crc" (UniqueName: "kubernetes.io/local-volume/local-storage20-crc") on node "crc" Mar 16 17:00:06 crc kubenswrapper[5120]: I0316 17:00:06.194972 5120 reconciler_common.go:299] "Volume detached for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/a4a9af83-10ac-4d5d-b8e3-e2d4d62c5a0d-galera-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:06 crc kubenswrapper[5120]: I0316 17:00:06.195003 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:06 crc kubenswrapper[5120]: I0316 17:00:06.348915 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:00:06 crc kubenswrapper[5120]: E0316 17:00:06.406892 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-placement-public-svc: secret "cert-placement-public-svc" not found Mar 16 17:00:06 crc kubenswrapper[5120]: E0316 17:00:06.406981 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36d5b175-81c4-4fc3-bb05-93958f9a7a63-public-tls-certs podName:36d5b175-81c4-4fc3-bb05-93958f9a7a63 nodeName:}" failed. No retries permitted until 2026-03-16 17:00:14.406961388 +0000 UTC m=+5316.560893045 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/36d5b175-81c4-4fc3-bb05-93958f9a7a63-public-tls-certs") pod "placement-6c74bfb4f8-b872h" (UID: "36d5b175-81c4-4fc3-bb05-93958f9a7a63") : secret "cert-placement-public-svc" not found Mar 16 17:00:06 crc kubenswrapper[5120]: E0316 17:00:06.407009 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-placement-internal-svc: secret "cert-placement-internal-svc" not found Mar 16 17:00:06 crc kubenswrapper[5120]: E0316 17:00:06.407057 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36d5b175-81c4-4fc3-bb05-93958f9a7a63-internal-tls-certs podName:36d5b175-81c4-4fc3-bb05-93958f9a7a63 nodeName:}" failed. No retries permitted until 2026-03-16 17:00:14.40704346 +0000 UTC m=+5316.560975117 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/36d5b175-81c4-4fc3-bb05-93958f9a7a63-internal-tls-certs") pod "placement-6c74bfb4f8-b872h" (UID: "36d5b175-81c4-4fc3-bb05-93958f9a7a63") : secret "cert-placement-internal-svc" not found Mar 16 17:00:06 crc kubenswrapper[5120]: I0316 17:00:06.617428 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:00:06 crc kubenswrapper[5120]: I0316 17:00:06.617459 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"a4a9af83-10ac-4d5d-b8e3-e2d4d62c5a0d","Type":"ContainerDied","Data":"4e7826ece75122749723f8d12e04f7f3f3ce1811e3aa2a1230db4ab8187997b4"} Mar 16 17:00:06 crc kubenswrapper[5120]: I0316 17:00:06.617824 5120 scope.go:117] "RemoveContainer" containerID="75ba7a23ede7125ea74861aacb5d597bf3d7dc9e677e82329e1b5682f729b68b" Mar 16 17:00:06 crc kubenswrapper[5120]: I0316 17:00:06.664640 5120 scope.go:117] "RemoveContainer" containerID="c46863cc69557f873cd0ae7f6573cff48bbb59a55b1517a22a96eb9510e7faa1" Mar 16 17:00:06 crc kubenswrapper[5120]: I0316 17:00:06.681094 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93611c0a-e049-4bce-a55f-64d6423031b7" path="/var/lib/kubelet/pods/93611c0a-e049-4bce-a55f-64d6423031b7/volumes" Mar 16 17:00:06 crc kubenswrapper[5120]: I0316 17:00:06.683146 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 17:00:06 crc kubenswrapper[5120]: I0316 17:00:06.687785 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 17:00:06 crc kubenswrapper[5120]: I0316 17:00:06.703072 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 17:00:06 crc kubenswrapper[5120]: I0316 17:00:06.704646 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4a9af83-10ac-4d5d-b8e3-e2d4d62c5a0d" containerName="galera" Mar 16 17:00:06 crc kubenswrapper[5120]: I0316 17:00:06.704681 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4a9af83-10ac-4d5d-b8e3-e2d4d62c5a0d" containerName="galera" Mar 16 17:00:06 crc kubenswrapper[5120]: I0316 17:00:06.704709 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4a9af83-10ac-4d5d-b8e3-e2d4d62c5a0d" containerName="mysql-bootstrap" Mar 16 17:00:06 crc kubenswrapper[5120]: I0316 17:00:06.704719 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4a9af83-10ac-4d5d-b8e3-e2d4d62c5a0d" containerName="mysql-bootstrap" Mar 16 17:00:06 crc kubenswrapper[5120]: I0316 17:00:06.704988 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="a4a9af83-10ac-4d5d-b8e3-e2d4d62c5a0d" containerName="galera" Mar 16 17:00:06 crc kubenswrapper[5120]: I0316 17:00:06.722594 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:00:06 crc kubenswrapper[5120]: I0316 17:00:06.724536 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 17:00:06 crc kubenswrapper[5120]: I0316 17:00:06.730415 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"galera-openstack-dockercfg-428w9\"" Mar 16 17:00:06 crc kubenswrapper[5120]: I0316 17:00:06.730650 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-galera-openstack-svc\"" Mar 16 17:00:06 crc kubenswrapper[5120]: I0316 17:00:06.731276 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-config-data\"" Mar 16 17:00:06 crc kubenswrapper[5120]: I0316 17:00:06.731432 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-scripts\"" Mar 16 17:00:06 crc kubenswrapper[5120]: I0316 17:00:06.822548 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 17:00:06 crc kubenswrapper[5120]: I0316 17:00:06.829561 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/330c02d7-ea4c-47d3-bc2e-529f9b27b2a4-config-data-generated\") pod \"openstack-galera-0\" (UID: \"330c02d7-ea4c-47d3-bc2e-529f9b27b2a4\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:00:06 crc kubenswrapper[5120]: I0316 17:00:06.830019 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/330c02d7-ea4c-47d3-bc2e-529f9b27b2a4-kolla-config\") pod \"openstack-galera-0\" (UID: \"330c02d7-ea4c-47d3-bc2e-529f9b27b2a4\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:00:06 crc kubenswrapper[5120]: I0316 17:00:06.830175 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/330c02d7-ea4c-47d3-bc2e-529f9b27b2a4-config-data-default\") pod \"openstack-galera-0\" (UID: \"330c02d7-ea4c-47d3-bc2e-529f9b27b2a4\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:00:06 crc kubenswrapper[5120]: I0316 17:00:06.830206 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/330c02d7-ea4c-47d3-bc2e-529f9b27b2a4-operator-scripts\") pod \"openstack-galera-0\" (UID: \"330c02d7-ea4c-47d3-bc2e-529f9b27b2a4\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:00:06 crc kubenswrapper[5120]: I0316 17:00:06.830306 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/330c02d7-ea4c-47d3-bc2e-529f9b27b2a4-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"330c02d7-ea4c-47d3-bc2e-529f9b27b2a4\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:00:06 crc kubenswrapper[5120]: I0316 17:00:06.830323 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ck5r4\" (UniqueName: \"kubernetes.io/projected/330c02d7-ea4c-47d3-bc2e-529f9b27b2a4-kube-api-access-ck5r4\") pod \"openstack-galera-0\" (UID: \"330c02d7-ea4c-47d3-bc2e-529f9b27b2a4\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:00:06 crc kubenswrapper[5120]: I0316 17:00:06.830380 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"openstack-galera-0\" (UID: \"330c02d7-ea4c-47d3-bc2e-529f9b27b2a4\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:00:06 crc kubenswrapper[5120]: I0316 17:00:06.830422 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/330c02d7-ea4c-47d3-bc2e-529f9b27b2a4-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"330c02d7-ea4c-47d3-bc2e-529f9b27b2a4\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:00:06 crc kubenswrapper[5120]: W0316 17:00:06.835320 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod39da7446_acba_4bbb_b813_1a3e2c89ebcd.slice/crio-ca1d68086bd2a83cc28d2a6eb90891df500fbecdd5ff64704bc7f6b7f0c8e5f7 WatchSource:0}: Error finding container ca1d68086bd2a83cc28d2a6eb90891df500fbecdd5ff64704bc7f6b7f0c8e5f7: Status 404 returned error can't find the container with id ca1d68086bd2a83cc28d2a6eb90891df500fbecdd5ff64704bc7f6b7f0c8e5f7 Mar 16 17:00:06 crc kubenswrapper[5120]: I0316 17:00:06.854077 5120 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Mar 16 17:00:06 crc kubenswrapper[5120]: I0316 17:00:06.933663 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/330c02d7-ea4c-47d3-bc2e-529f9b27b2a4-config-data-generated\") pod \"openstack-galera-0\" (UID: \"330c02d7-ea4c-47d3-bc2e-529f9b27b2a4\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:00:06 crc kubenswrapper[5120]: I0316 17:00:06.933933 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/330c02d7-ea4c-47d3-bc2e-529f9b27b2a4-kolla-config\") pod \"openstack-galera-0\" (UID: \"330c02d7-ea4c-47d3-bc2e-529f9b27b2a4\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:00:06 crc kubenswrapper[5120]: I0316 17:00:06.934049 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/330c02d7-ea4c-47d3-bc2e-529f9b27b2a4-config-data-default\") pod \"openstack-galera-0\" (UID: \"330c02d7-ea4c-47d3-bc2e-529f9b27b2a4\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:00:06 crc kubenswrapper[5120]: I0316 17:00:06.934081 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/330c02d7-ea4c-47d3-bc2e-529f9b27b2a4-operator-scripts\") pod \"openstack-galera-0\" (UID: \"330c02d7-ea4c-47d3-bc2e-529f9b27b2a4\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:00:06 crc kubenswrapper[5120]: I0316 17:00:06.934237 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/330c02d7-ea4c-47d3-bc2e-529f9b27b2a4-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"330c02d7-ea4c-47d3-bc2e-529f9b27b2a4\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:00:06 crc kubenswrapper[5120]: I0316 17:00:06.934265 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ck5r4\" (UniqueName: \"kubernetes.io/projected/330c02d7-ea4c-47d3-bc2e-529f9b27b2a4-kube-api-access-ck5r4\") pod \"openstack-galera-0\" (UID: \"330c02d7-ea4c-47d3-bc2e-529f9b27b2a4\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:00:06 crc kubenswrapper[5120]: I0316 17:00:06.934359 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"openstack-galera-0\" (UID: \"330c02d7-ea4c-47d3-bc2e-529f9b27b2a4\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:00:06 crc kubenswrapper[5120]: I0316 17:00:06.934435 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/330c02d7-ea4c-47d3-bc2e-529f9b27b2a4-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"330c02d7-ea4c-47d3-bc2e-529f9b27b2a4\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:00:06 crc kubenswrapper[5120]: I0316 17:00:06.937487 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/330c02d7-ea4c-47d3-bc2e-529f9b27b2a4-config-data-generated\") pod \"openstack-galera-0\" (UID: \"330c02d7-ea4c-47d3-bc2e-529f9b27b2a4\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:00:06 crc kubenswrapper[5120]: I0316 17:00:06.937639 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"openstack-galera-0\" (UID: \"330c02d7-ea4c-47d3-bc2e-529f9b27b2a4\") device mount path \"/mnt/openstack/pv20\"" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:00:06 crc kubenswrapper[5120]: I0316 17:00:06.937945 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/330c02d7-ea4c-47d3-bc2e-529f9b27b2a4-kolla-config\") pod \"openstack-galera-0\" (UID: \"330c02d7-ea4c-47d3-bc2e-529f9b27b2a4\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:00:06 crc kubenswrapper[5120]: I0316 17:00:06.938353 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/330c02d7-ea4c-47d3-bc2e-529f9b27b2a4-config-data-default\") pod \"openstack-galera-0\" (UID: \"330c02d7-ea4c-47d3-bc2e-529f9b27b2a4\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:00:06 crc kubenswrapper[5120]: I0316 17:00:06.938776 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/330c02d7-ea4c-47d3-bc2e-529f9b27b2a4-operator-scripts\") pod \"openstack-galera-0\" (UID: \"330c02d7-ea4c-47d3-bc2e-529f9b27b2a4\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:00:06 crc kubenswrapper[5120]: I0316 17:00:06.940688 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/330c02d7-ea4c-47d3-bc2e-529f9b27b2a4-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"330c02d7-ea4c-47d3-bc2e-529f9b27b2a4\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:00:06 crc kubenswrapper[5120]: I0316 17:00:06.949664 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/330c02d7-ea4c-47d3-bc2e-529f9b27b2a4-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"330c02d7-ea4c-47d3-bc2e-529f9b27b2a4\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:00:06 crc kubenswrapper[5120]: I0316 17:00:06.959477 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ck5r4\" (UniqueName: \"kubernetes.io/projected/330c02d7-ea4c-47d3-bc2e-529f9b27b2a4-kube-api-access-ck5r4\") pod \"openstack-galera-0\" (UID: \"330c02d7-ea4c-47d3-bc2e-529f9b27b2a4\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:00:06 crc kubenswrapper[5120]: I0316 17:00:06.979496 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"openstack-galera-0\" (UID: \"330c02d7-ea4c-47d3-bc2e-529f9b27b2a4\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:00:06 crc kubenswrapper[5120]: I0316 17:00:06.983559 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561340-lqcpp" Mar 16 17:00:07 crc kubenswrapper[5120]: I0316 17:00:07.036711 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vt7cm\" (UniqueName: \"kubernetes.io/projected/ad8c715f-c9c8-4ab6-8b01-dc9a8dd3eda2-kube-api-access-vt7cm\") pod \"ad8c715f-c9c8-4ab6-8b01-dc9a8dd3eda2\" (UID: \"ad8c715f-c9c8-4ab6-8b01-dc9a8dd3eda2\") " Mar 16 17:00:07 crc kubenswrapper[5120]: I0316 17:00:07.040372 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad8c715f-c9c8-4ab6-8b01-dc9a8dd3eda2-kube-api-access-vt7cm" (OuterVolumeSpecName: "kube-api-access-vt7cm") pod "ad8c715f-c9c8-4ab6-8b01-dc9a8dd3eda2" (UID: "ad8c715f-c9c8-4ab6-8b01-dc9a8dd3eda2"). InnerVolumeSpecName "kube-api-access-vt7cm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:00:07 crc kubenswrapper[5120]: I0316 17:00:07.082298 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:00:07 crc kubenswrapper[5120]: I0316 17:00:07.140946 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vt7cm\" (UniqueName: \"kubernetes.io/projected/ad8c715f-c9c8-4ab6-8b01-dc9a8dd3eda2-kube-api-access-vt7cm\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:07 crc kubenswrapper[5120]: E0316 17:00:07.447528 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-swift-public-svc: secret "cert-swift-public-svc" not found Mar 16 17:00:07 crc kubenswrapper[5120]: E0316 17:00:07.447867 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-swift-internal-svc: secret "cert-swift-internal-svc" not found Mar 16 17:00:07 crc kubenswrapper[5120]: E0316 17:00:07.448011 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21a5384d-c9cf-429c-9e7e-cc9fb2a825b9-public-tls-certs podName:21a5384d-c9cf-429c-9e7e-cc9fb2a825b9 nodeName:}" failed. No retries permitted until 2026-03-16 17:00:11.447983472 +0000 UTC m=+5313.601915129 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/21a5384d-c9cf-429c-9e7e-cc9fb2a825b9-public-tls-certs") pod "swift-proxy-5f4bc687f4-xcf5c" (UID: "21a5384d-c9cf-429c-9e7e-cc9fb2a825b9") : secret "cert-swift-public-svc" not found Mar 16 17:00:07 crc kubenswrapper[5120]: E0316 17:00:07.448051 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21a5384d-c9cf-429c-9e7e-cc9fb2a825b9-internal-tls-certs podName:21a5384d-c9cf-429c-9e7e-cc9fb2a825b9 nodeName:}" failed. No retries permitted until 2026-03-16 17:00:11.448032413 +0000 UTC m=+5313.601964070 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/21a5384d-c9cf-429c-9e7e-cc9fb2a825b9-internal-tls-certs") pod "swift-proxy-5f4bc687f4-xcf5c" (UID: "21a5384d-c9cf-429c-9e7e-cc9fb2a825b9") : secret "cert-swift-internal-svc" not found Mar 16 17:00:07 crc kubenswrapper[5120]: W0316 17:00:07.542802 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod330c02d7_ea4c_47d3_bc2e_529f9b27b2a4.slice/crio-638eec3ef2de84b930bb4c71211946c7a9bb944ee959679817e9208f938e41f5 WatchSource:0}: Error finding container 638eec3ef2de84b930bb4c71211946c7a9bb944ee959679817e9208f938e41f5: Status 404 returned error can't find the container with id 638eec3ef2de84b930bb4c71211946c7a9bb944ee959679817e9208f938e41f5 Mar 16 17:00:07 crc kubenswrapper[5120]: I0316 17:00:07.551458 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 17:00:07 crc kubenswrapper[5120]: I0316 17:00:07.636932 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561340-lqcpp" Mar 16 17:00:07 crc kubenswrapper[5120]: I0316 17:00:07.636934 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561340-lqcpp" event={"ID":"ad8c715f-c9c8-4ab6-8b01-dc9a8dd3eda2","Type":"ContainerDied","Data":"e05b84dcf10ee9dce13a9c70cc0ac5db3805484befca84183d045049940f9616"} Mar 16 17:00:07 crc kubenswrapper[5120]: I0316 17:00:07.637049 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e05b84dcf10ee9dce13a9c70cc0ac5db3805484befca84183d045049940f9616" Mar 16 17:00:07 crc kubenswrapper[5120]: I0316 17:00:07.639780 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"330c02d7-ea4c-47d3-bc2e-529f9b27b2a4","Type":"ContainerStarted","Data":"638eec3ef2de84b930bb4c71211946c7a9bb944ee959679817e9208f938e41f5"} Mar 16 17:00:07 crc kubenswrapper[5120]: I0316 17:00:07.642836 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"39da7446-acba-4bbb-b813-1a3e2c89ebcd","Type":"ContainerStarted","Data":"39019e1d54d9812f3ac3e601ff87d3b2deb317247e2373de978d0f90ce4a6afb"} Mar 16 17:00:07 crc kubenswrapper[5120]: I0316 17:00:07.642888 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"39da7446-acba-4bbb-b813-1a3e2c89ebcd","Type":"ContainerStarted","Data":"ca1d68086bd2a83cc28d2a6eb90891df500fbecdd5ff64704bc7f6b7f0c8e5f7"} Mar 16 17:00:07 crc kubenswrapper[5120]: E0316 17:00:07.758259 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-neutron-internal-svc: secret "cert-neutron-internal-svc" not found Mar 16 17:00:07 crc kubenswrapper[5120]: E0316 17:00:07.758402 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95dbfc71-6afe-4106-b073-5a1edcc8788f-internal-tls-certs podName:95dbfc71-6afe-4106-b073-5a1edcc8788f nodeName:}" failed. No retries permitted until 2026-03-16 17:00:08.258369787 +0000 UTC m=+5310.412301624 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/95dbfc71-6afe-4106-b073-5a1edcc8788f-internal-tls-certs") pod "neutron-8bf9bfcb4-2674f" (UID: "95dbfc71-6afe-4106-b073-5a1edcc8788f") : secret "cert-neutron-internal-svc" not found Mar 16 17:00:07 crc kubenswrapper[5120]: E0316 17:00:07.758294 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-neutron-ovndbs: secret "cert-neutron-ovndbs" not found Mar 16 17:00:07 crc kubenswrapper[5120]: E0316 17:00:07.759867 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-neutron-public-svc: secret "cert-neutron-public-svc" not found Mar 16 17:00:07 crc kubenswrapper[5120]: E0316 17:00:07.759940 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95dbfc71-6afe-4106-b073-5a1edcc8788f-public-tls-certs podName:95dbfc71-6afe-4106-b073-5a1edcc8788f nodeName:}" failed. No retries permitted until 2026-03-16 17:00:08.259912909 +0000 UTC m=+5310.413844566 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/95dbfc71-6afe-4106-b073-5a1edcc8788f-public-tls-certs") pod "neutron-8bf9bfcb4-2674f" (UID: "95dbfc71-6afe-4106-b073-5a1edcc8788f") : secret "cert-neutron-public-svc" not found Mar 16 17:00:07 crc kubenswrapper[5120]: E0316 17:00:07.759981 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95dbfc71-6afe-4106-b073-5a1edcc8788f-ovndb-tls-certs podName:95dbfc71-6afe-4106-b073-5a1edcc8788f nodeName:}" failed. No retries permitted until 2026-03-16 17:00:08.259973641 +0000 UTC m=+5310.413905298 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ovndb-tls-certs" (UniqueName: "kubernetes.io/secret/95dbfc71-6afe-4106-b073-5a1edcc8788f-ovndb-tls-certs") pod "neutron-8bf9bfcb4-2674f" (UID: "95dbfc71-6afe-4106-b073-5a1edcc8788f") : secret "cert-neutron-ovndbs" not found Mar 16 17:00:08 crc kubenswrapper[5120]: I0316 17:00:08.048141 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-infra/auto-csr-approver-29561334-bnxd6"] Mar 16 17:00:08 crc kubenswrapper[5120]: I0316 17:00:08.060171 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-infra/auto-csr-approver-29561334-bnxd6"] Mar 16 17:00:08 crc kubenswrapper[5120]: I0316 17:00:08.171605 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="d82f3b2b-c672-46ff-8fc8-afc5b33e8252" containerName="cinder-scheduler" probeResult="failure" output="HTTP probe failed with statuscode: 500" Mar 16 17:00:08 crc kubenswrapper[5120]: E0316 17:00:08.275813 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-neutron-ovndbs: secret "cert-neutron-ovndbs" not found Mar 16 17:00:08 crc kubenswrapper[5120]: E0316 17:00:08.275893 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95dbfc71-6afe-4106-b073-5a1edcc8788f-ovndb-tls-certs podName:95dbfc71-6afe-4106-b073-5a1edcc8788f nodeName:}" failed. No retries permitted until 2026-03-16 17:00:09.275876671 +0000 UTC m=+5311.429808318 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "ovndb-tls-certs" (UniqueName: "kubernetes.io/secret/95dbfc71-6afe-4106-b073-5a1edcc8788f-ovndb-tls-certs") pod "neutron-8bf9bfcb4-2674f" (UID: "95dbfc71-6afe-4106-b073-5a1edcc8788f") : secret "cert-neutron-ovndbs" not found Mar 16 17:00:08 crc kubenswrapper[5120]: E0316 17:00:08.275969 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-neutron-internal-svc: secret "cert-neutron-internal-svc" not found Mar 16 17:00:08 crc kubenswrapper[5120]: E0316 17:00:08.276057 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95dbfc71-6afe-4106-b073-5a1edcc8788f-internal-tls-certs podName:95dbfc71-6afe-4106-b073-5a1edcc8788f nodeName:}" failed. No retries permitted until 2026-03-16 17:00:09.276040766 +0000 UTC m=+5311.429972423 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/95dbfc71-6afe-4106-b073-5a1edcc8788f-internal-tls-certs") pod "neutron-8bf9bfcb4-2674f" (UID: "95dbfc71-6afe-4106-b073-5a1edcc8788f") : secret "cert-neutron-internal-svc" not found Mar 16 17:00:08 crc kubenswrapper[5120]: E0316 17:00:08.276069 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-neutron-public-svc: secret "cert-neutron-public-svc" not found Mar 16 17:00:08 crc kubenswrapper[5120]: E0316 17:00:08.276095 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95dbfc71-6afe-4106-b073-5a1edcc8788f-public-tls-certs podName:95dbfc71-6afe-4106-b073-5a1edcc8788f nodeName:}" failed. No retries permitted until 2026-03-16 17:00:09.276086417 +0000 UTC m=+5311.430018074 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/95dbfc71-6afe-4106-b073-5a1edcc8788f-public-tls-certs") pod "neutron-8bf9bfcb4-2674f" (UID: "95dbfc71-6afe-4106-b073-5a1edcc8788f") : secret "cert-neutron-public-svc" not found Mar 16 17:00:08 crc kubenswrapper[5120]: E0316 17:00:08.528535 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1872662 actualBytes=10240 Mar 16 17:00:08 crc kubenswrapper[5120]: I0316 17:00:08.661996 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"330c02d7-ea4c-47d3-bc2e-529f9b27b2a4","Type":"ContainerStarted","Data":"712abafe835b278bb412b2351660de03a42a32112f74bd71143224f932d3850b"} Mar 16 17:00:08 crc kubenswrapper[5120]: I0316 17:00:08.677199 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a4a9af83-10ac-4d5d-b8e3-e2d4d62c5a0d" path="/var/lib/kubelet/pods/a4a9af83-10ac-4d5d-b8e3-e2d4d62c5a0d/volumes" Mar 16 17:00:08 crc kubenswrapper[5120]: I0316 17:00:08.677920 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f5a15d20-fb3d-44d4-a5a6-287fc544f1a1" path="/var/lib/kubelet/pods/f5a15d20-fb3d-44d4-a5a6-287fc544f1a1/volumes" Mar 16 17:00:09 crc kubenswrapper[5120]: E0316 17:00:09.302094 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-neutron-public-svc: secret "cert-neutron-public-svc" not found Mar 16 17:00:09 crc kubenswrapper[5120]: E0316 17:00:09.302501 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-neutron-internal-svc: secret "cert-neutron-internal-svc" not found Mar 16 17:00:09 crc kubenswrapper[5120]: E0316 17:00:09.302612 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-neutron-ovndbs: secret "cert-neutron-ovndbs" not found Mar 16 17:00:09 crc kubenswrapper[5120]: E0316 17:00:09.302510 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95dbfc71-6afe-4106-b073-5a1edcc8788f-public-tls-certs podName:95dbfc71-6afe-4106-b073-5a1edcc8788f nodeName:}" failed. No retries permitted until 2026-03-16 17:00:11.30248503 +0000 UTC m=+5313.456416747 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/95dbfc71-6afe-4106-b073-5a1edcc8788f-public-tls-certs") pod "neutron-8bf9bfcb4-2674f" (UID: "95dbfc71-6afe-4106-b073-5a1edcc8788f") : secret "cert-neutron-public-svc" not found Mar 16 17:00:09 crc kubenswrapper[5120]: E0316 17:00:09.302659 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95dbfc71-6afe-4106-b073-5a1edcc8788f-internal-tls-certs podName:95dbfc71-6afe-4106-b073-5a1edcc8788f nodeName:}" failed. No retries permitted until 2026-03-16 17:00:11.302639724 +0000 UTC m=+5313.456571421 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/95dbfc71-6afe-4106-b073-5a1edcc8788f-internal-tls-certs") pod "neutron-8bf9bfcb4-2674f" (UID: "95dbfc71-6afe-4106-b073-5a1edcc8788f") : secret "cert-neutron-internal-svc" not found Mar 16 17:00:09 crc kubenswrapper[5120]: E0316 17:00:09.302674 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95dbfc71-6afe-4106-b073-5a1edcc8788f-ovndb-tls-certs podName:95dbfc71-6afe-4106-b073-5a1edcc8788f nodeName:}" failed. No retries permitted until 2026-03-16 17:00:11.302667635 +0000 UTC m=+5313.456599392 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "ovndb-tls-certs" (UniqueName: "kubernetes.io/secret/95dbfc71-6afe-4106-b073-5a1edcc8788f-ovndb-tls-certs") pod "neutron-8bf9bfcb4-2674f" (UID: "95dbfc71-6afe-4106-b073-5a1edcc8788f") : secret "cert-neutron-ovndbs" not found Mar 16 17:00:09 crc kubenswrapper[5120]: I0316 17:00:09.676173 5120 generic.go:358] "Generic (PLEG): container finished" podID="39da7446-acba-4bbb-b813-1a3e2c89ebcd" containerID="39019e1d54d9812f3ac3e601ff87d3b2deb317247e2373de978d0f90ce4a6afb" exitCode=0 Mar 16 17:00:09 crc kubenswrapper[5120]: I0316 17:00:09.677358 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"39da7446-acba-4bbb-b813-1a3e2c89ebcd","Type":"ContainerDied","Data":"39019e1d54d9812f3ac3e601ff87d3b2deb317247e2373de978d0f90ce4a6afb"} Mar 16 17:00:10 crc kubenswrapper[5120]: I0316 17:00:10.687253 5120 generic.go:358] "Generic (PLEG): container finished" podID="330c02d7-ea4c-47d3-bc2e-529f9b27b2a4" containerID="712abafe835b278bb412b2351660de03a42a32112f74bd71143224f932d3850b" exitCode=0 Mar 16 17:00:10 crc kubenswrapper[5120]: I0316 17:00:10.687373 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"330c02d7-ea4c-47d3-bc2e-529f9b27b2a4","Type":"ContainerDied","Data":"712abafe835b278bb412b2351660de03a42a32112f74bd71143224f932d3850b"} Mar 16 17:00:10 crc kubenswrapper[5120]: I0316 17:00:10.690281 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"39da7446-acba-4bbb-b813-1a3e2c89ebcd","Type":"ContainerStarted","Data":"9f10ab7f240e18dc5d0dc1c428ee6fb6885c1a2a7b2d3b49049debfc1e5289c0"} Mar 16 17:00:10 crc kubenswrapper[5120]: I0316 17:00:10.750169 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstack-cell1-galera-0" podStartSLOduration=5.750145494 podStartE2EDuration="5.750145494s" podCreationTimestamp="2026-03-16 17:00:05 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:00:10.736860961 +0000 UTC m=+5312.890792628" watchObservedRunningTime="2026-03-16 17:00:10.750145494 +0000 UTC m=+5312.904077151" Mar 16 17:00:11 crc kubenswrapper[5120]: E0316 17:00:11.000295 5120 upgradeaware.go:427] Error proxying data from client to backend: readfrom tcp 38.102.83.119:43510->38.102.83.119:44311: write tcp 38.102.83.119:43510->38.102.83.119:44311: write: broken pipe Mar 16 17:00:11 crc kubenswrapper[5120]: I0316 17:00:11.163859 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="d82f3b2b-c672-46ff-8fc8-afc5b33e8252" containerName="cinder-scheduler" probeResult="failure" output="HTTP probe failed with statuscode: 500" Mar 16 17:00:11 crc kubenswrapper[5120]: I0316 17:00:11.163954 5120 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:00:11 crc kubenswrapper[5120]: I0316 17:00:11.164680 5120 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="cinder-scheduler" containerStatusID={"Type":"cri-o","ID":"7feb79b771d86b2c75df62e3a6f170b8f26b31b6c9b737ba8b03de06cf953429"} pod="openstack-kuttl-tests/cinder-scheduler-0" containerMessage="Container cinder-scheduler failed liveness probe, will be restarted" Mar 16 17:00:11 crc kubenswrapper[5120]: I0316 17:00:11.164789 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="d82f3b2b-c672-46ff-8fc8-afc5b33e8252" containerName="cinder-scheduler" containerID="cri-o://7feb79b771d86b2c75df62e3a6f170b8f26b31b6c9b737ba8b03de06cf953429" gracePeriod=30 Mar 16 17:00:11 crc kubenswrapper[5120]: E0316 17:00:11.359199 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-neutron-ovndbs: secret "cert-neutron-ovndbs" not found Mar 16 17:00:11 crc kubenswrapper[5120]: E0316 17:00:11.359277 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-neutron-internal-svc: secret "cert-neutron-internal-svc" not found Mar 16 17:00:11 crc kubenswrapper[5120]: E0316 17:00:11.359459 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-neutron-public-svc: secret "cert-neutron-public-svc" not found Mar 16 17:00:11 crc kubenswrapper[5120]: E0316 17:00:11.359602 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95dbfc71-6afe-4106-b073-5a1edcc8788f-ovndb-tls-certs podName:95dbfc71-6afe-4106-b073-5a1edcc8788f nodeName:}" failed. No retries permitted until 2026-03-16 17:00:15.359570324 +0000 UTC m=+5317.513501981 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "ovndb-tls-certs" (UniqueName: "kubernetes.io/secret/95dbfc71-6afe-4106-b073-5a1edcc8788f-ovndb-tls-certs") pod "neutron-8bf9bfcb4-2674f" (UID: "95dbfc71-6afe-4106-b073-5a1edcc8788f") : secret "cert-neutron-ovndbs" not found Mar 16 17:00:11 crc kubenswrapper[5120]: E0316 17:00:11.359712 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95dbfc71-6afe-4106-b073-5a1edcc8788f-internal-tls-certs podName:95dbfc71-6afe-4106-b073-5a1edcc8788f nodeName:}" failed. No retries permitted until 2026-03-16 17:00:15.359702448 +0000 UTC m=+5317.513634095 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/95dbfc71-6afe-4106-b073-5a1edcc8788f-internal-tls-certs") pod "neutron-8bf9bfcb4-2674f" (UID: "95dbfc71-6afe-4106-b073-5a1edcc8788f") : secret "cert-neutron-internal-svc" not found Mar 16 17:00:11 crc kubenswrapper[5120]: E0316 17:00:11.359891 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95dbfc71-6afe-4106-b073-5a1edcc8788f-public-tls-certs podName:95dbfc71-6afe-4106-b073-5a1edcc8788f nodeName:}" failed. No retries permitted until 2026-03-16 17:00:15.359881253 +0000 UTC m=+5317.513812910 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/95dbfc71-6afe-4106-b073-5a1edcc8788f-public-tls-certs") pod "neutron-8bf9bfcb4-2674f" (UID: "95dbfc71-6afe-4106-b073-5a1edcc8788f") : secret "cert-neutron-public-svc" not found Mar 16 17:00:11 crc kubenswrapper[5120]: E0316 17:00:11.461957 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-swift-internal-svc: secret "cert-swift-internal-svc" not found Mar 16 17:00:11 crc kubenswrapper[5120]: E0316 17:00:11.462259 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21a5384d-c9cf-429c-9e7e-cc9fb2a825b9-internal-tls-certs podName:21a5384d-c9cf-429c-9e7e-cc9fb2a825b9 nodeName:}" failed. No retries permitted until 2026-03-16 17:00:19.462240875 +0000 UTC m=+5321.616172532 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/21a5384d-c9cf-429c-9e7e-cc9fb2a825b9-internal-tls-certs") pod "swift-proxy-5f4bc687f4-xcf5c" (UID: "21a5384d-c9cf-429c-9e7e-cc9fb2a825b9") : secret "cert-swift-internal-svc" not found Mar 16 17:00:11 crc kubenswrapper[5120]: E0316 17:00:11.462137 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-swift-public-svc: secret "cert-swift-public-svc" not found Mar 16 17:00:11 crc kubenswrapper[5120]: E0316 17:00:11.462449 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21a5384d-c9cf-429c-9e7e-cc9fb2a825b9-public-tls-certs podName:21a5384d-c9cf-429c-9e7e-cc9fb2a825b9 nodeName:}" failed. No retries permitted until 2026-03-16 17:00:19.46243884 +0000 UTC m=+5321.616370497 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/21a5384d-c9cf-429c-9e7e-cc9fb2a825b9-public-tls-certs") pod "swift-proxy-5f4bc687f4-xcf5c" (UID: "21a5384d-c9cf-429c-9e7e-cc9fb2a825b9") : secret "cert-swift-public-svc" not found Mar 16 17:00:11 crc kubenswrapper[5120]: I0316 17:00:11.546668 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:00:11 crc kubenswrapper[5120]: I0316 17:00:11.547042 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="8564c4e1-fb50-4cb4-8df5-d95dd3374db3" containerName="ceilometer-central-agent" containerID="cri-o://72ce6e63c6af240dbdaf4cfec1280154a8488b58f4057d2f278d8823fe4673f0" gracePeriod=30 Mar 16 17:00:11 crc kubenswrapper[5120]: I0316 17:00:11.547586 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="8564c4e1-fb50-4cb4-8df5-d95dd3374db3" containerName="proxy-httpd" containerID="cri-o://8cf1dc8b90b00f8364bb374e93b9ee78f0ff1723ac6cdf01d8ce8b7c975ac0b2" gracePeriod=30 Mar 16 17:00:11 crc kubenswrapper[5120]: I0316 17:00:11.547638 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="8564c4e1-fb50-4cb4-8df5-d95dd3374db3" containerName="sg-core" containerID="cri-o://c7cb3d1980b59b00ba89f7913c562983800a3ee24502b6c02fda5df995aca749" gracePeriod=30 Mar 16 17:00:11 crc kubenswrapper[5120]: I0316 17:00:11.547673 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="8564c4e1-fb50-4cb4-8df5-d95dd3374db3" containerName="ceilometer-notification-agent" containerID="cri-o://dd31307d5a4292328381cfc5aa70b4423f771b369bbe29ff3930835491de7e1e" gracePeriod=30 Mar 16 17:00:11 crc kubenswrapper[5120]: I0316 17:00:11.719685 5120 generic.go:358] "Generic (PLEG): container finished" podID="8564c4e1-fb50-4cb4-8df5-d95dd3374db3" containerID="8cf1dc8b90b00f8364bb374e93b9ee78f0ff1723ac6cdf01d8ce8b7c975ac0b2" exitCode=0 Mar 16 17:00:11 crc kubenswrapper[5120]: I0316 17:00:11.720060 5120 generic.go:358] "Generic (PLEG): container finished" podID="8564c4e1-fb50-4cb4-8df5-d95dd3374db3" containerID="c7cb3d1980b59b00ba89f7913c562983800a3ee24502b6c02fda5df995aca749" exitCode=2 Mar 16 17:00:11 crc kubenswrapper[5120]: I0316 17:00:11.719794 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"8564c4e1-fb50-4cb4-8df5-d95dd3374db3","Type":"ContainerDied","Data":"8cf1dc8b90b00f8364bb374e93b9ee78f0ff1723ac6cdf01d8ce8b7c975ac0b2"} Mar 16 17:00:11 crc kubenswrapper[5120]: I0316 17:00:11.720378 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"8564c4e1-fb50-4cb4-8df5-d95dd3374db3","Type":"ContainerDied","Data":"c7cb3d1980b59b00ba89f7913c562983800a3ee24502b6c02fda5df995aca749"} Mar 16 17:00:11 crc kubenswrapper[5120]: I0316 17:00:11.722743 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"330c02d7-ea4c-47d3-bc2e-529f9b27b2a4","Type":"ContainerStarted","Data":"0c04394e8329ca282f6aec00fd61c8a448833782b4dc1a23dcf01dfbde2cad08"} Mar 16 17:00:11 crc kubenswrapper[5120]: I0316 17:00:11.751091 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstack-galera-0" podStartSLOduration=5.75106834 podStartE2EDuration="5.75106834s" podCreationTimestamp="2026-03-16 17:00:06 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:00:11.741859887 +0000 UTC m=+5313.895791554" watchObservedRunningTime="2026-03-16 17:00:11.75106834 +0000 UTC m=+5313.904999997" Mar 16 17:00:12 crc kubenswrapper[5120]: I0316 17:00:12.736686 5120 generic.go:358] "Generic (PLEG): container finished" podID="8564c4e1-fb50-4cb4-8df5-d95dd3374db3" containerID="72ce6e63c6af240dbdaf4cfec1280154a8488b58f4057d2f278d8823fe4673f0" exitCode=0 Mar 16 17:00:12 crc kubenswrapper[5120]: I0316 17:00:12.736806 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"8564c4e1-fb50-4cb4-8df5-d95dd3374db3","Type":"ContainerDied","Data":"72ce6e63c6af240dbdaf4cfec1280154a8488b58f4057d2f278d8823fe4673f0"} Mar 16 17:00:13 crc kubenswrapper[5120]: I0316 17:00:13.469496 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 17:00:13 crc kubenswrapper[5120]: I0316 17:00:13.470015 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/memcached-0" podUID="621d9d31-f819-4547-886c-a670fffe27d2" containerName="memcached" containerID="cri-o://8540f49324d3df592da58fc21c9e5656816887a0eb7b5b0f14a8577287f722e8" gracePeriod=30 Mar 16 17:00:13 crc kubenswrapper[5120]: I0316 17:00:13.504565 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 17:00:13 crc kubenswrapper[5120]: I0316 17:00:13.504899 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="bc3dbeed-0812-4ece-b805-7408a7868f94" containerName="glance-log" containerID="cri-o://397ff88ea2eae604377585921ebbaff09e18274622110377c820fff687461187" gracePeriod=30 Mar 16 17:00:13 crc kubenswrapper[5120]: I0316 17:00:13.504954 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="bc3dbeed-0812-4ece-b805-7408a7868f94" containerName="glance-httpd" containerID="cri-o://da6751457801480c486418b96b45b4721dffdf69ace0d9d360a1f4dc4bc9ab5d" gracePeriod=30 Mar 16 17:00:13 crc kubenswrapper[5120]: I0316 17:00:13.624816 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 17:00:13 crc kubenswrapper[5120]: I0316 17:00:13.625138 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="532eee6f-6605-4581-80a2-d8c6061bf84a" containerName="glance-log" containerID="cri-o://19d677cabef5c32207ea90684cf888f271b1d4ce284d04a3263cec9573a4201a" gracePeriod=30 Mar 16 17:00:13 crc kubenswrapper[5120]: I0316 17:00:13.625736 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="532eee6f-6605-4581-80a2-d8c6061bf84a" containerName="glance-httpd" containerID="cri-o://ebd80c70407524a39e410e1783924d3bd9a4f9eeab19b26208422ea92da963b3" gracePeriod=30 Mar 16 17:00:13 crc kubenswrapper[5120]: I0316 17:00:13.722107 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-556c5fbd95-b6tt9"] Mar 16 17:00:13 crc kubenswrapper[5120]: I0316 17:00:13.723649 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad8c715f-c9c8-4ab6-8b01-dc9a8dd3eda2" containerName="oc" Mar 16 17:00:13 crc kubenswrapper[5120]: I0316 17:00:13.723780 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad8c715f-c9c8-4ab6-8b01-dc9a8dd3eda2" containerName="oc" Mar 16 17:00:13 crc kubenswrapper[5120]: I0316 17:00:13.724081 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ad8c715f-c9c8-4ab6-8b01-dc9a8dd3eda2" containerName="oc" Mar 16 17:00:13 crc kubenswrapper[5120]: I0316 17:00:13.730563 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-556c5fbd95-b6tt9" Mar 16 17:00:13 crc kubenswrapper[5120]: I0316 17:00:13.746105 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-556c5fbd95-b6tt9"] Mar 16 17:00:13 crc kubenswrapper[5120]: I0316 17:00:13.767781 5120 generic.go:358] "Generic (PLEG): container finished" podID="bc3dbeed-0812-4ece-b805-7408a7868f94" containerID="397ff88ea2eae604377585921ebbaff09e18274622110377c820fff687461187" exitCode=143 Mar 16 17:00:13 crc kubenswrapper[5120]: I0316 17:00:13.767876 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"bc3dbeed-0812-4ece-b805-7408a7868f94","Type":"ContainerDied","Data":"397ff88ea2eae604377585921ebbaff09e18274622110377c820fff687461187"} Mar 16 17:00:13 crc kubenswrapper[5120]: I0316 17:00:13.824296 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/37a14538-41b4-4840-9f98-8e652da86950-internal-tls-certs\") pod \"keystone-556c5fbd95-b6tt9\" (UID: \"37a14538-41b4-4840-9f98-8e652da86950\") " pod="openstack-kuttl-tests/keystone-556c5fbd95-b6tt9" Mar 16 17:00:13 crc kubenswrapper[5120]: I0316 17:00:13.824842 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/37a14538-41b4-4840-9f98-8e652da86950-fernet-keys\") pod \"keystone-556c5fbd95-b6tt9\" (UID: \"37a14538-41b4-4840-9f98-8e652da86950\") " pod="openstack-kuttl-tests/keystone-556c5fbd95-b6tt9" Mar 16 17:00:13 crc kubenswrapper[5120]: I0316 17:00:13.825224 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/37a14538-41b4-4840-9f98-8e652da86950-combined-ca-bundle\") pod \"keystone-556c5fbd95-b6tt9\" (UID: \"37a14538-41b4-4840-9f98-8e652da86950\") " pod="openstack-kuttl-tests/keystone-556c5fbd95-b6tt9" Mar 16 17:00:13 crc kubenswrapper[5120]: I0316 17:00:13.825386 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/37a14538-41b4-4840-9f98-8e652da86950-public-tls-certs\") pod \"keystone-556c5fbd95-b6tt9\" (UID: \"37a14538-41b4-4840-9f98-8e652da86950\") " pod="openstack-kuttl-tests/keystone-556c5fbd95-b6tt9" Mar 16 17:00:13 crc kubenswrapper[5120]: I0316 17:00:13.825502 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/37a14538-41b4-4840-9f98-8e652da86950-credential-keys\") pod \"keystone-556c5fbd95-b6tt9\" (UID: \"37a14538-41b4-4840-9f98-8e652da86950\") " pod="openstack-kuttl-tests/keystone-556c5fbd95-b6tt9" Mar 16 17:00:13 crc kubenswrapper[5120]: I0316 17:00:13.825928 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/37a14538-41b4-4840-9f98-8e652da86950-scripts\") pod \"keystone-556c5fbd95-b6tt9\" (UID: \"37a14538-41b4-4840-9f98-8e652da86950\") " pod="openstack-kuttl-tests/keystone-556c5fbd95-b6tt9" Mar 16 17:00:13 crc kubenswrapper[5120]: I0316 17:00:13.826065 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/37a14538-41b4-4840-9f98-8e652da86950-config-data\") pod \"keystone-556c5fbd95-b6tt9\" (UID: \"37a14538-41b4-4840-9f98-8e652da86950\") " pod="openstack-kuttl-tests/keystone-556c5fbd95-b6tt9" Mar 16 17:00:13 crc kubenswrapper[5120]: I0316 17:00:13.826190 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfcjw\" (UniqueName: \"kubernetes.io/projected/37a14538-41b4-4840-9f98-8e652da86950-kube-api-access-vfcjw\") pod \"keystone-556c5fbd95-b6tt9\" (UID: \"37a14538-41b4-4840-9f98-8e652da86950\") " pod="openstack-kuttl-tests/keystone-556c5fbd95-b6tt9" Mar 16 17:00:13 crc kubenswrapper[5120]: I0316 17:00:13.928885 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/37a14538-41b4-4840-9f98-8e652da86950-fernet-keys\") pod \"keystone-556c5fbd95-b6tt9\" (UID: \"37a14538-41b4-4840-9f98-8e652da86950\") " pod="openstack-kuttl-tests/keystone-556c5fbd95-b6tt9" Mar 16 17:00:13 crc kubenswrapper[5120]: I0316 17:00:13.929028 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/37a14538-41b4-4840-9f98-8e652da86950-combined-ca-bundle\") pod \"keystone-556c5fbd95-b6tt9\" (UID: \"37a14538-41b4-4840-9f98-8e652da86950\") " pod="openstack-kuttl-tests/keystone-556c5fbd95-b6tt9" Mar 16 17:00:13 crc kubenswrapper[5120]: I0316 17:00:13.929075 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/37a14538-41b4-4840-9f98-8e652da86950-public-tls-certs\") pod \"keystone-556c5fbd95-b6tt9\" (UID: \"37a14538-41b4-4840-9f98-8e652da86950\") " pod="openstack-kuttl-tests/keystone-556c5fbd95-b6tt9" Mar 16 17:00:13 crc kubenswrapper[5120]: I0316 17:00:13.929093 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/37a14538-41b4-4840-9f98-8e652da86950-credential-keys\") pod \"keystone-556c5fbd95-b6tt9\" (UID: \"37a14538-41b4-4840-9f98-8e652da86950\") " pod="openstack-kuttl-tests/keystone-556c5fbd95-b6tt9" Mar 16 17:00:13 crc kubenswrapper[5120]: I0316 17:00:13.929260 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/37a14538-41b4-4840-9f98-8e652da86950-scripts\") pod \"keystone-556c5fbd95-b6tt9\" (UID: \"37a14538-41b4-4840-9f98-8e652da86950\") " pod="openstack-kuttl-tests/keystone-556c5fbd95-b6tt9" Mar 16 17:00:13 crc kubenswrapper[5120]: I0316 17:00:13.929315 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/37a14538-41b4-4840-9f98-8e652da86950-config-data\") pod \"keystone-556c5fbd95-b6tt9\" (UID: \"37a14538-41b4-4840-9f98-8e652da86950\") " pod="openstack-kuttl-tests/keystone-556c5fbd95-b6tt9" Mar 16 17:00:13 crc kubenswrapper[5120]: I0316 17:00:13.929364 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vfcjw\" (UniqueName: \"kubernetes.io/projected/37a14538-41b4-4840-9f98-8e652da86950-kube-api-access-vfcjw\") pod \"keystone-556c5fbd95-b6tt9\" (UID: \"37a14538-41b4-4840-9f98-8e652da86950\") " pod="openstack-kuttl-tests/keystone-556c5fbd95-b6tt9" Mar 16 17:00:13 crc kubenswrapper[5120]: I0316 17:00:13.929389 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/37a14538-41b4-4840-9f98-8e652da86950-internal-tls-certs\") pod \"keystone-556c5fbd95-b6tt9\" (UID: \"37a14538-41b4-4840-9f98-8e652da86950\") " pod="openstack-kuttl-tests/keystone-556c5fbd95-b6tt9" Mar 16 17:00:13 crc kubenswrapper[5120]: I0316 17:00:13.936708 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/37a14538-41b4-4840-9f98-8e652da86950-combined-ca-bundle\") pod \"keystone-556c5fbd95-b6tt9\" (UID: \"37a14538-41b4-4840-9f98-8e652da86950\") " pod="openstack-kuttl-tests/keystone-556c5fbd95-b6tt9" Mar 16 17:00:13 crc kubenswrapper[5120]: I0316 17:00:13.937076 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/37a14538-41b4-4840-9f98-8e652da86950-scripts\") pod \"keystone-556c5fbd95-b6tt9\" (UID: \"37a14538-41b4-4840-9f98-8e652da86950\") " pod="openstack-kuttl-tests/keystone-556c5fbd95-b6tt9" Mar 16 17:00:13 crc kubenswrapper[5120]: I0316 17:00:13.937245 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/37a14538-41b4-4840-9f98-8e652da86950-fernet-keys\") pod \"keystone-556c5fbd95-b6tt9\" (UID: \"37a14538-41b4-4840-9f98-8e652da86950\") " pod="openstack-kuttl-tests/keystone-556c5fbd95-b6tt9" Mar 16 17:00:13 crc kubenswrapper[5120]: I0316 17:00:13.937794 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/37a14538-41b4-4840-9f98-8e652da86950-config-data\") pod \"keystone-556c5fbd95-b6tt9\" (UID: \"37a14538-41b4-4840-9f98-8e652da86950\") " pod="openstack-kuttl-tests/keystone-556c5fbd95-b6tt9" Mar 16 17:00:13 crc kubenswrapper[5120]: I0316 17:00:13.937921 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/37a14538-41b4-4840-9f98-8e652da86950-internal-tls-certs\") pod \"keystone-556c5fbd95-b6tt9\" (UID: \"37a14538-41b4-4840-9f98-8e652da86950\") " pod="openstack-kuttl-tests/keystone-556c5fbd95-b6tt9" Mar 16 17:00:13 crc kubenswrapper[5120]: I0316 17:00:13.939745 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/37a14538-41b4-4840-9f98-8e652da86950-public-tls-certs\") pod \"keystone-556c5fbd95-b6tt9\" (UID: \"37a14538-41b4-4840-9f98-8e652da86950\") " pod="openstack-kuttl-tests/keystone-556c5fbd95-b6tt9" Mar 16 17:00:13 crc kubenswrapper[5120]: I0316 17:00:13.944154 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/37a14538-41b4-4840-9f98-8e652da86950-credential-keys\") pod \"keystone-556c5fbd95-b6tt9\" (UID: \"37a14538-41b4-4840-9f98-8e652da86950\") " pod="openstack-kuttl-tests/keystone-556c5fbd95-b6tt9" Mar 16 17:00:13 crc kubenswrapper[5120]: I0316 17:00:13.951156 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfcjw\" (UniqueName: \"kubernetes.io/projected/37a14538-41b4-4840-9f98-8e652da86950-kube-api-access-vfcjw\") pod \"keystone-556c5fbd95-b6tt9\" (UID: \"37a14538-41b4-4840-9f98-8e652da86950\") " pod="openstack-kuttl-tests/keystone-556c5fbd95-b6tt9" Mar 16 17:00:14 crc kubenswrapper[5120]: I0316 17:00:14.065268 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-556c5fbd95-b6tt9" Mar 16 17:00:14 crc kubenswrapper[5120]: E0316 17:00:14.452110 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-placement-internal-svc: secret "cert-placement-internal-svc" not found Mar 16 17:00:14 crc kubenswrapper[5120]: E0316 17:00:14.452214 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36d5b175-81c4-4fc3-bb05-93958f9a7a63-internal-tls-certs podName:36d5b175-81c4-4fc3-bb05-93958f9a7a63 nodeName:}" failed. No retries permitted until 2026-03-16 17:00:30.452192621 +0000 UTC m=+5332.606124278 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/36d5b175-81c4-4fc3-bb05-93958f9a7a63-internal-tls-certs") pod "placement-6c74bfb4f8-b872h" (UID: "36d5b175-81c4-4fc3-bb05-93958f9a7a63") : secret "cert-placement-internal-svc" not found Mar 16 17:00:14 crc kubenswrapper[5120]: E0316 17:00:14.452217 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-placement-public-svc: secret "cert-placement-public-svc" not found Mar 16 17:00:14 crc kubenswrapper[5120]: E0316 17:00:14.452323 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36d5b175-81c4-4fc3-bb05-93958f9a7a63-public-tls-certs podName:36d5b175-81c4-4fc3-bb05-93958f9a7a63 nodeName:}" failed. No retries permitted until 2026-03-16 17:00:30.452295324 +0000 UTC m=+5332.606227031 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/36d5b175-81c4-4fc3-bb05-93958f9a7a63-public-tls-certs") pod "placement-6c74bfb4f8-b872h" (UID: "36d5b175-81c4-4fc3-bb05-93958f9a7a63") : secret "cert-placement-public-svc" not found Mar 16 17:00:14 crc kubenswrapper[5120]: I0316 17:00:14.525527 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Mar 16 17:00:14 crc kubenswrapper[5120]: I0316 17:00:14.527727 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-556c5fbd95-b6tt9"] Mar 16 17:00:14 crc kubenswrapper[5120]: W0316 17:00:14.535856 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod37a14538_41b4_4840_9f98_8e652da86950.slice/crio-c09f6b1669f31ac12e5745f5686aa5e5a77112007acc3e19b80c62182636f77f WatchSource:0}: Error finding container c09f6b1669f31ac12e5745f5686aa5e5a77112007acc3e19b80c62182636f77f: Status 404 returned error can't find the container with id c09f6b1669f31ac12e5745f5686aa5e5a77112007acc3e19b80c62182636f77f Mar 16 17:00:14 crc kubenswrapper[5120]: I0316 17:00:14.553525 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/621d9d31-f819-4547-886c-a670fffe27d2-config-data\") pod \"621d9d31-f819-4547-886c-a670fffe27d2\" (UID: \"621d9d31-f819-4547-886c-a670fffe27d2\") " Mar 16 17:00:14 crc kubenswrapper[5120]: I0316 17:00:14.553867 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6xrzx\" (UniqueName: \"kubernetes.io/projected/621d9d31-f819-4547-886c-a670fffe27d2-kube-api-access-6xrzx\") pod \"621d9d31-f819-4547-886c-a670fffe27d2\" (UID: \"621d9d31-f819-4547-886c-a670fffe27d2\") " Mar 16 17:00:14 crc kubenswrapper[5120]: I0316 17:00:14.553991 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/621d9d31-f819-4547-886c-a670fffe27d2-kolla-config\") pod \"621d9d31-f819-4547-886c-a670fffe27d2\" (UID: \"621d9d31-f819-4547-886c-a670fffe27d2\") " Mar 16 17:00:14 crc kubenswrapper[5120]: I0316 17:00:14.554098 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/621d9d31-f819-4547-886c-a670fffe27d2-combined-ca-bundle\") pod \"621d9d31-f819-4547-886c-a670fffe27d2\" (UID: \"621d9d31-f819-4547-886c-a670fffe27d2\") " Mar 16 17:00:14 crc kubenswrapper[5120]: I0316 17:00:14.554273 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/621d9d31-f819-4547-886c-a670fffe27d2-memcached-tls-certs\") pod \"621d9d31-f819-4547-886c-a670fffe27d2\" (UID: \"621d9d31-f819-4547-886c-a670fffe27d2\") " Mar 16 17:00:14 crc kubenswrapper[5120]: I0316 17:00:14.556040 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/621d9d31-f819-4547-886c-a670fffe27d2-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "621d9d31-f819-4547-886c-a670fffe27d2" (UID: "621d9d31-f819-4547-886c-a670fffe27d2"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:00:14 crc kubenswrapper[5120]: I0316 17:00:14.556481 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/621d9d31-f819-4547-886c-a670fffe27d2-config-data" (OuterVolumeSpecName: "config-data") pod "621d9d31-f819-4547-886c-a670fffe27d2" (UID: "621d9d31-f819-4547-886c-a670fffe27d2"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:00:14 crc kubenswrapper[5120]: I0316 17:00:14.561530 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/621d9d31-f819-4547-886c-a670fffe27d2-kube-api-access-6xrzx" (OuterVolumeSpecName: "kube-api-access-6xrzx") pod "621d9d31-f819-4547-886c-a670fffe27d2" (UID: "621d9d31-f819-4547-886c-a670fffe27d2"). InnerVolumeSpecName "kube-api-access-6xrzx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:00:14 crc kubenswrapper[5120]: I0316 17:00:14.609843 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/621d9d31-f819-4547-886c-a670fffe27d2-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "621d9d31-f819-4547-886c-a670fffe27d2" (UID: "621d9d31-f819-4547-886c-a670fffe27d2"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:14 crc kubenswrapper[5120]: I0316 17:00:14.657788 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/621d9d31-f819-4547-886c-a670fffe27d2-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:14 crc kubenswrapper[5120]: I0316 17:00:14.657826 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/621d9d31-f819-4547-886c-a670fffe27d2-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:14 crc kubenswrapper[5120]: I0316 17:00:14.657836 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6xrzx\" (UniqueName: \"kubernetes.io/projected/621d9d31-f819-4547-886c-a670fffe27d2-kube-api-access-6xrzx\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:14 crc kubenswrapper[5120]: I0316 17:00:14.657845 5120 reconciler_common.go:299] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/621d9d31-f819-4547-886c-a670fffe27d2-kolla-config\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:14 crc kubenswrapper[5120]: I0316 17:00:14.679898 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/621d9d31-f819-4547-886c-a670fffe27d2-memcached-tls-certs" (OuterVolumeSpecName: "memcached-tls-certs") pod "621d9d31-f819-4547-886c-a670fffe27d2" (UID: "621d9d31-f819-4547-886c-a670fffe27d2"). InnerVolumeSpecName "memcached-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:14 crc kubenswrapper[5120]: I0316 17:00:14.760036 5120 reconciler_common.go:299] "Volume detached for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/621d9d31-f819-4547-886c-a670fffe27d2-memcached-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:14 crc kubenswrapper[5120]: I0316 17:00:14.778521 5120 generic.go:358] "Generic (PLEG): container finished" podID="621d9d31-f819-4547-886c-a670fffe27d2" containerID="8540f49324d3df592da58fc21c9e5656816887a0eb7b5b0f14a8577287f722e8" exitCode=0 Mar 16 17:00:14 crc kubenswrapper[5120]: I0316 17:00:14.778655 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Mar 16 17:00:14 crc kubenswrapper[5120]: I0316 17:00:14.781946 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"621d9d31-f819-4547-886c-a670fffe27d2","Type":"ContainerDied","Data":"8540f49324d3df592da58fc21c9e5656816887a0eb7b5b0f14a8577287f722e8"} Mar 16 17:00:14 crc kubenswrapper[5120]: I0316 17:00:14.781992 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"621d9d31-f819-4547-886c-a670fffe27d2","Type":"ContainerDied","Data":"76bce893a2627a31e8e7bb58b0cac973e7440bbee4f3a64ffdc0714a1e81c737"} Mar 16 17:00:14 crc kubenswrapper[5120]: I0316 17:00:14.782015 5120 scope.go:117] "RemoveContainer" containerID="8540f49324d3df592da58fc21c9e5656816887a0eb7b5b0f14a8577287f722e8" Mar 16 17:00:14 crc kubenswrapper[5120]: I0316 17:00:14.784929 5120 generic.go:358] "Generic (PLEG): container finished" podID="532eee6f-6605-4581-80a2-d8c6061bf84a" containerID="19d677cabef5c32207ea90684cf888f271b1d4ce284d04a3263cec9573a4201a" exitCode=143 Mar 16 17:00:14 crc kubenswrapper[5120]: I0316 17:00:14.785023 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"532eee6f-6605-4581-80a2-d8c6061bf84a","Type":"ContainerDied","Data":"19d677cabef5c32207ea90684cf888f271b1d4ce284d04a3263cec9573a4201a"} Mar 16 17:00:14 crc kubenswrapper[5120]: I0316 17:00:14.787121 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-556c5fbd95-b6tt9" event={"ID":"37a14538-41b4-4840-9f98-8e652da86950","Type":"ContainerStarted","Data":"c09f6b1669f31ac12e5745f5686aa5e5a77112007acc3e19b80c62182636f77f"} Mar 16 17:00:14 crc kubenswrapper[5120]: I0316 17:00:14.840239 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 17:00:14 crc kubenswrapper[5120]: I0316 17:00:14.841981 5120 scope.go:117] "RemoveContainer" containerID="8540f49324d3df592da58fc21c9e5656816887a0eb7b5b0f14a8577287f722e8" Mar 16 17:00:14 crc kubenswrapper[5120]: E0316 17:00:14.842619 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8540f49324d3df592da58fc21c9e5656816887a0eb7b5b0f14a8577287f722e8\": container with ID starting with 8540f49324d3df592da58fc21c9e5656816887a0eb7b5b0f14a8577287f722e8 not found: ID does not exist" containerID="8540f49324d3df592da58fc21c9e5656816887a0eb7b5b0f14a8577287f722e8" Mar 16 17:00:14 crc kubenswrapper[5120]: I0316 17:00:14.842686 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8540f49324d3df592da58fc21c9e5656816887a0eb7b5b0f14a8577287f722e8"} err="failed to get container status \"8540f49324d3df592da58fc21c9e5656816887a0eb7b5b0f14a8577287f722e8\": rpc error: code = NotFound desc = could not find container \"8540f49324d3df592da58fc21c9e5656816887a0eb7b5b0f14a8577287f722e8\": container with ID starting with 8540f49324d3df592da58fc21c9e5656816887a0eb7b5b0f14a8577287f722e8 not found: ID does not exist" Mar 16 17:00:14 crc kubenswrapper[5120]: I0316 17:00:14.851580 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 17:00:14 crc kubenswrapper[5120]: I0316 17:00:14.863175 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 17:00:14 crc kubenswrapper[5120]: I0316 17:00:14.864238 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="621d9d31-f819-4547-886c-a670fffe27d2" containerName="memcached" Mar 16 17:00:14 crc kubenswrapper[5120]: I0316 17:00:14.864258 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="621d9d31-f819-4547-886c-a670fffe27d2" containerName="memcached" Mar 16 17:00:14 crc kubenswrapper[5120]: I0316 17:00:14.864561 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="621d9d31-f819-4547-886c-a670fffe27d2" containerName="memcached" Mar 16 17:00:14 crc kubenswrapper[5120]: I0316 17:00:14.872135 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Mar 16 17:00:14 crc kubenswrapper[5120]: I0316 17:00:14.874338 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 17:00:14 crc kubenswrapper[5120]: I0316 17:00:14.875814 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"memcached-memcached-dockercfg-s2pts\"" Mar 16 17:00:14 crc kubenswrapper[5120]: I0316 17:00:14.879012 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"memcached-config-data\"" Mar 16 17:00:14 crc kubenswrapper[5120]: I0316 17:00:14.879390 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-memcached-svc\"" Mar 16 17:00:14 crc kubenswrapper[5120]: I0316 17:00:14.964840 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/727aa42a-e1c1-427b-9912-f64504161039-memcached-tls-certs\") pod \"memcached-0\" (UID: \"727aa42a-e1c1-427b-9912-f64504161039\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 17:00:14 crc kubenswrapper[5120]: I0316 17:00:14.965140 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9cccn\" (UniqueName: \"kubernetes.io/projected/727aa42a-e1c1-427b-9912-f64504161039-kube-api-access-9cccn\") pod \"memcached-0\" (UID: \"727aa42a-e1c1-427b-9912-f64504161039\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 17:00:14 crc kubenswrapper[5120]: I0316 17:00:14.965301 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/727aa42a-e1c1-427b-9912-f64504161039-config-data\") pod \"memcached-0\" (UID: \"727aa42a-e1c1-427b-9912-f64504161039\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 17:00:14 crc kubenswrapper[5120]: I0316 17:00:14.965339 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/727aa42a-e1c1-427b-9912-f64504161039-combined-ca-bundle\") pod \"memcached-0\" (UID: \"727aa42a-e1c1-427b-9912-f64504161039\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 17:00:14 crc kubenswrapper[5120]: I0316 17:00:14.965355 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/727aa42a-e1c1-427b-9912-f64504161039-kolla-config\") pod \"memcached-0\" (UID: \"727aa42a-e1c1-427b-9912-f64504161039\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 17:00:15 crc kubenswrapper[5120]: I0316 17:00:15.067783 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/727aa42a-e1c1-427b-9912-f64504161039-config-data\") pod \"memcached-0\" (UID: \"727aa42a-e1c1-427b-9912-f64504161039\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 17:00:15 crc kubenswrapper[5120]: I0316 17:00:15.067887 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/727aa42a-e1c1-427b-9912-f64504161039-combined-ca-bundle\") pod \"memcached-0\" (UID: \"727aa42a-e1c1-427b-9912-f64504161039\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 17:00:15 crc kubenswrapper[5120]: I0316 17:00:15.067913 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/727aa42a-e1c1-427b-9912-f64504161039-kolla-config\") pod \"memcached-0\" (UID: \"727aa42a-e1c1-427b-9912-f64504161039\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 17:00:15 crc kubenswrapper[5120]: I0316 17:00:15.068163 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/727aa42a-e1c1-427b-9912-f64504161039-memcached-tls-certs\") pod \"memcached-0\" (UID: \"727aa42a-e1c1-427b-9912-f64504161039\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 17:00:15 crc kubenswrapper[5120]: I0316 17:00:15.068773 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9cccn\" (UniqueName: \"kubernetes.io/projected/727aa42a-e1c1-427b-9912-f64504161039-kube-api-access-9cccn\") pod \"memcached-0\" (UID: \"727aa42a-e1c1-427b-9912-f64504161039\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 17:00:15 crc kubenswrapper[5120]: I0316 17:00:15.069033 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/727aa42a-e1c1-427b-9912-f64504161039-config-data\") pod \"memcached-0\" (UID: \"727aa42a-e1c1-427b-9912-f64504161039\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 17:00:15 crc kubenswrapper[5120]: I0316 17:00:15.069098 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/727aa42a-e1c1-427b-9912-f64504161039-kolla-config\") pod \"memcached-0\" (UID: \"727aa42a-e1c1-427b-9912-f64504161039\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 17:00:15 crc kubenswrapper[5120]: I0316 17:00:15.072661 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/727aa42a-e1c1-427b-9912-f64504161039-combined-ca-bundle\") pod \"memcached-0\" (UID: \"727aa42a-e1c1-427b-9912-f64504161039\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 17:00:15 crc kubenswrapper[5120]: I0316 17:00:15.077380 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/727aa42a-e1c1-427b-9912-f64504161039-memcached-tls-certs\") pod \"memcached-0\" (UID: \"727aa42a-e1c1-427b-9912-f64504161039\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 17:00:15 crc kubenswrapper[5120]: I0316 17:00:15.085217 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9cccn\" (UniqueName: \"kubernetes.io/projected/727aa42a-e1c1-427b-9912-f64504161039-kube-api-access-9cccn\") pod \"memcached-0\" (UID: \"727aa42a-e1c1-427b-9912-f64504161039\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 17:00:15 crc kubenswrapper[5120]: I0316 17:00:15.201977 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Mar 16 17:00:15 crc kubenswrapper[5120]: E0316 17:00:15.377896 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-neutron-public-svc: secret "cert-neutron-public-svc" not found Mar 16 17:00:15 crc kubenswrapper[5120]: E0316 17:00:15.378237 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95dbfc71-6afe-4106-b073-5a1edcc8788f-public-tls-certs podName:95dbfc71-6afe-4106-b073-5a1edcc8788f nodeName:}" failed. No retries permitted until 2026-03-16 17:00:23.378222068 +0000 UTC m=+5325.532153725 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/95dbfc71-6afe-4106-b073-5a1edcc8788f-public-tls-certs") pod "neutron-8bf9bfcb4-2674f" (UID: "95dbfc71-6afe-4106-b073-5a1edcc8788f") : secret "cert-neutron-public-svc" not found Mar 16 17:00:15 crc kubenswrapper[5120]: I0316 17:00:15.701989 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 17:00:15 crc kubenswrapper[5120]: I0316 17:00:15.798812 5120 generic.go:358] "Generic (PLEG): container finished" podID="d82f3b2b-c672-46ff-8fc8-afc5b33e8252" containerID="7feb79b771d86b2c75df62e3a6f170b8f26b31b6c9b737ba8b03de06cf953429" exitCode=0 Mar 16 17:00:15 crc kubenswrapper[5120]: I0316 17:00:15.798982 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"d82f3b2b-c672-46ff-8fc8-afc5b33e8252","Type":"ContainerDied","Data":"7feb79b771d86b2c75df62e3a6f170b8f26b31b6c9b737ba8b03de06cf953429"} Mar 16 17:00:15 crc kubenswrapper[5120]: I0316 17:00:15.801062 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-556c5fbd95-b6tt9" event={"ID":"37a14538-41b4-4840-9f98-8e652da86950","Type":"ContainerStarted","Data":"37f46cae89751e61473cf75d604d271349a611787e527b84be5fb9bfab6bafd4"} Mar 16 17:00:15 crc kubenswrapper[5120]: I0316 17:00:15.802855 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/keystone-556c5fbd95-b6tt9" Mar 16 17:00:15 crc kubenswrapper[5120]: I0316 17:00:15.812241 5120 generic.go:358] "Generic (PLEG): container finished" podID="8564c4e1-fb50-4cb4-8df5-d95dd3374db3" containerID="dd31307d5a4292328381cfc5aa70b4423f771b369bbe29ff3930835491de7e1e" exitCode=0 Mar 16 17:00:15 crc kubenswrapper[5120]: I0316 17:00:15.812303 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"8564c4e1-fb50-4cb4-8df5-d95dd3374db3","Type":"ContainerDied","Data":"dd31307d5a4292328381cfc5aa70b4423f771b369bbe29ff3930835491de7e1e"} Mar 16 17:00:15 crc kubenswrapper[5120]: I0316 17:00:15.822402 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-556c5fbd95-b6tt9" podStartSLOduration=2.822378685 podStartE2EDuration="2.822378685s" podCreationTimestamp="2026-03-16 17:00:13 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:00:15.816167294 +0000 UTC m=+5317.970098941" watchObservedRunningTime="2026-03-16 17:00:15.822378685 +0000 UTC m=+5317.976310342" Mar 16 17:00:16 crc kubenswrapper[5120]: I0316 17:00:16.030082 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:00:16 crc kubenswrapper[5120]: I0316 17:00:16.110412 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/8564c4e1-fb50-4cb4-8df5-d95dd3374db3-sg-core-conf-yaml\") pod \"8564c4e1-fb50-4cb4-8df5-d95dd3374db3\" (UID: \"8564c4e1-fb50-4cb4-8df5-d95dd3374db3\") " Mar 16 17:00:16 crc kubenswrapper[5120]: I0316 17:00:16.110985 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8564c4e1-fb50-4cb4-8df5-d95dd3374db3-combined-ca-bundle\") pod \"8564c4e1-fb50-4cb4-8df5-d95dd3374db3\" (UID: \"8564c4e1-fb50-4cb4-8df5-d95dd3374db3\") " Mar 16 17:00:16 crc kubenswrapper[5120]: I0316 17:00:16.111077 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8564c4e1-fb50-4cb4-8df5-d95dd3374db3-config-data\") pod \"8564c4e1-fb50-4cb4-8df5-d95dd3374db3\" (UID: \"8564c4e1-fb50-4cb4-8df5-d95dd3374db3\") " Mar 16 17:00:16 crc kubenswrapper[5120]: I0316 17:00:16.111099 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8564c4e1-fb50-4cb4-8df5-d95dd3374db3-scripts\") pod \"8564c4e1-fb50-4cb4-8df5-d95dd3374db3\" (UID: \"8564c4e1-fb50-4cb4-8df5-d95dd3374db3\") " Mar 16 17:00:16 crc kubenswrapper[5120]: I0316 17:00:16.111188 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rkjtq\" (UniqueName: \"kubernetes.io/projected/8564c4e1-fb50-4cb4-8df5-d95dd3374db3-kube-api-access-rkjtq\") pod \"8564c4e1-fb50-4cb4-8df5-d95dd3374db3\" (UID: \"8564c4e1-fb50-4cb4-8df5-d95dd3374db3\") " Mar 16 17:00:16 crc kubenswrapper[5120]: I0316 17:00:16.111396 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/8564c4e1-fb50-4cb4-8df5-d95dd3374db3-log-httpd\") pod \"8564c4e1-fb50-4cb4-8df5-d95dd3374db3\" (UID: \"8564c4e1-fb50-4cb4-8df5-d95dd3374db3\") " Mar 16 17:00:16 crc kubenswrapper[5120]: I0316 17:00:16.111494 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/8564c4e1-fb50-4cb4-8df5-d95dd3374db3-run-httpd\") pod \"8564c4e1-fb50-4cb4-8df5-d95dd3374db3\" (UID: \"8564c4e1-fb50-4cb4-8df5-d95dd3374db3\") " Mar 16 17:00:16 crc kubenswrapper[5120]: I0316 17:00:16.111603 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/8564c4e1-fb50-4cb4-8df5-d95dd3374db3-ceilometer-tls-certs\") pod \"8564c4e1-fb50-4cb4-8df5-d95dd3374db3\" (UID: \"8564c4e1-fb50-4cb4-8df5-d95dd3374db3\") " Mar 16 17:00:16 crc kubenswrapper[5120]: I0316 17:00:16.124708 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8564c4e1-fb50-4cb4-8df5-d95dd3374db3-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "8564c4e1-fb50-4cb4-8df5-d95dd3374db3" (UID: "8564c4e1-fb50-4cb4-8df5-d95dd3374db3"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:00:16 crc kubenswrapper[5120]: I0316 17:00:16.125735 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8564c4e1-fb50-4cb4-8df5-d95dd3374db3-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "8564c4e1-fb50-4cb4-8df5-d95dd3374db3" (UID: "8564c4e1-fb50-4cb4-8df5-d95dd3374db3"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:00:16 crc kubenswrapper[5120]: I0316 17:00:16.140485 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8564c4e1-fb50-4cb4-8df5-d95dd3374db3-scripts" (OuterVolumeSpecName: "scripts") pod "8564c4e1-fb50-4cb4-8df5-d95dd3374db3" (UID: "8564c4e1-fb50-4cb4-8df5-d95dd3374db3"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:16 crc kubenswrapper[5120]: I0316 17:00:16.167864 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8564c4e1-fb50-4cb4-8df5-d95dd3374db3-kube-api-access-rkjtq" (OuterVolumeSpecName: "kube-api-access-rkjtq") pod "8564c4e1-fb50-4cb4-8df5-d95dd3374db3" (UID: "8564c4e1-fb50-4cb4-8df5-d95dd3374db3"). InnerVolumeSpecName "kube-api-access-rkjtq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:00:16 crc kubenswrapper[5120]: I0316 17:00:16.181798 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8564c4e1-fb50-4cb4-8df5-d95dd3374db3-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "8564c4e1-fb50-4cb4-8df5-d95dd3374db3" (UID: "8564c4e1-fb50-4cb4-8df5-d95dd3374db3"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:16 crc kubenswrapper[5120]: I0316 17:00:16.217556 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/8564c4e1-fb50-4cb4-8df5-d95dd3374db3-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:16 crc kubenswrapper[5120]: I0316 17:00:16.217583 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/8564c4e1-fb50-4cb4-8df5-d95dd3374db3-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:16 crc kubenswrapper[5120]: I0316 17:00:16.217596 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8564c4e1-fb50-4cb4-8df5-d95dd3374db3-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:16 crc kubenswrapper[5120]: I0316 17:00:16.217605 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rkjtq\" (UniqueName: \"kubernetes.io/projected/8564c4e1-fb50-4cb4-8df5-d95dd3374db3-kube-api-access-rkjtq\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:16 crc kubenswrapper[5120]: I0316 17:00:16.217615 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/8564c4e1-fb50-4cb4-8df5-d95dd3374db3-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:16 crc kubenswrapper[5120]: I0316 17:00:16.245694 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8564c4e1-fb50-4cb4-8df5-d95dd3374db3-ceilometer-tls-certs" (OuterVolumeSpecName: "ceilometer-tls-certs") pod "8564c4e1-fb50-4cb4-8df5-d95dd3374db3" (UID: "8564c4e1-fb50-4cb4-8df5-d95dd3374db3"). InnerVolumeSpecName "ceilometer-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:16 crc kubenswrapper[5120]: I0316 17:00:16.268856 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8564c4e1-fb50-4cb4-8df5-d95dd3374db3-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "8564c4e1-fb50-4cb4-8df5-d95dd3374db3" (UID: "8564c4e1-fb50-4cb4-8df5-d95dd3374db3"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:16 crc kubenswrapper[5120]: I0316 17:00:16.296408 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8564c4e1-fb50-4cb4-8df5-d95dd3374db3-config-data" (OuterVolumeSpecName: "config-data") pod "8564c4e1-fb50-4cb4-8df5-d95dd3374db3" (UID: "8564c4e1-fb50-4cb4-8df5-d95dd3374db3"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:16 crc kubenswrapper[5120]: I0316 17:00:16.321355 5120 reconciler_common.go:299] "Volume detached for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/8564c4e1-fb50-4cb4-8df5-d95dd3374db3-ceilometer-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:16 crc kubenswrapper[5120]: I0316 17:00:16.321397 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8564c4e1-fb50-4cb4-8df5-d95dd3374db3-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:16 crc kubenswrapper[5120]: I0316 17:00:16.321410 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8564c4e1-fb50-4cb4-8df5-d95dd3374db3-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:16 crc kubenswrapper[5120]: I0316 17:00:16.349672 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:00:16 crc kubenswrapper[5120]: I0316 17:00:16.351678 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:00:16 crc kubenswrapper[5120]: I0316 17:00:16.446428 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:00:16 crc kubenswrapper[5120]: I0316 17:00:16.678183 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="621d9d31-f819-4547-886c-a670fffe27d2" path="/var/lib/kubelet/pods/621d9d31-f819-4547-886c-a670fffe27d2/volumes" Mar 16 17:00:16 crc kubenswrapper[5120]: I0316 17:00:16.827538 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:00:16 crc kubenswrapper[5120]: I0316 17:00:16.827575 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"8564c4e1-fb50-4cb4-8df5-d95dd3374db3","Type":"ContainerDied","Data":"a77a41620985ba045f3524637beb84990710d57c82c7e0a4dc0660622970688a"} Mar 16 17:00:16 crc kubenswrapper[5120]: I0316 17:00:16.827647 5120 scope.go:117] "RemoveContainer" containerID="8cf1dc8b90b00f8364bb374e93b9ee78f0ff1723ac6cdf01d8ce8b7c975ac0b2" Mar 16 17:00:16 crc kubenswrapper[5120]: I0316 17:00:16.832192 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"727aa42a-e1c1-427b-9912-f64504161039","Type":"ContainerStarted","Data":"812f81a16c905368276223ee5005d10bd26af5275ab04c2e07d4bf28eecfa6cb"} Mar 16 17:00:16 crc kubenswrapper[5120]: I0316 17:00:16.832547 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"727aa42a-e1c1-427b-9912-f64504161039","Type":"ContainerStarted","Data":"72cebf28e12d5f955cc6b919c4af9b90196860b5518fde261ed7c8327b6e21c2"} Mar 16 17:00:16 crc kubenswrapper[5120]: I0316 17:00:16.834027 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/memcached-0" Mar 16 17:00:16 crc kubenswrapper[5120]: I0316 17:00:16.859663 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/memcached-0" podStartSLOduration=2.859643355 podStartE2EDuration="2.859643355s" podCreationTimestamp="2026-03-16 17:00:14 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:00:16.857056264 +0000 UTC m=+5319.010987921" watchObservedRunningTime="2026-03-16 17:00:16.859643355 +0000 UTC m=+5319.013575012" Mar 16 17:00:16 crc kubenswrapper[5120]: I0316 17:00:16.869535 5120 scope.go:117] "RemoveContainer" containerID="c7cb3d1980b59b00ba89f7913c562983800a3ee24502b6c02fda5df995aca749" Mar 16 17:00:16 crc kubenswrapper[5120]: I0316 17:00:16.886474 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:00:16 crc kubenswrapper[5120]: I0316 17:00:16.908313 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:00:16 crc kubenswrapper[5120]: I0316 17:00:16.909680 5120 scope.go:117] "RemoveContainer" containerID="dd31307d5a4292328381cfc5aa70b4423f771b369bbe29ff3930835491de7e1e" Mar 16 17:00:16 crc kubenswrapper[5120]: I0316 17:00:16.927442 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:00:16 crc kubenswrapper[5120]: I0316 17:00:16.929058 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8564c4e1-fb50-4cb4-8df5-d95dd3374db3" containerName="ceilometer-central-agent" Mar 16 17:00:16 crc kubenswrapper[5120]: I0316 17:00:16.929088 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8564c4e1-fb50-4cb4-8df5-d95dd3374db3" containerName="ceilometer-central-agent" Mar 16 17:00:16 crc kubenswrapper[5120]: I0316 17:00:16.929125 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8564c4e1-fb50-4cb4-8df5-d95dd3374db3" containerName="ceilometer-notification-agent" Mar 16 17:00:16 crc kubenswrapper[5120]: I0316 17:00:16.929133 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8564c4e1-fb50-4cb4-8df5-d95dd3374db3" containerName="ceilometer-notification-agent" Mar 16 17:00:16 crc kubenswrapper[5120]: I0316 17:00:16.929188 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8564c4e1-fb50-4cb4-8df5-d95dd3374db3" containerName="sg-core" Mar 16 17:00:16 crc kubenswrapper[5120]: I0316 17:00:16.929195 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8564c4e1-fb50-4cb4-8df5-d95dd3374db3" containerName="sg-core" Mar 16 17:00:16 crc kubenswrapper[5120]: I0316 17:00:16.929207 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8564c4e1-fb50-4cb4-8df5-d95dd3374db3" containerName="proxy-httpd" Mar 16 17:00:16 crc kubenswrapper[5120]: I0316 17:00:16.929215 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8564c4e1-fb50-4cb4-8df5-d95dd3374db3" containerName="proxy-httpd" Mar 16 17:00:16 crc kubenswrapper[5120]: I0316 17:00:16.929467 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="8564c4e1-fb50-4cb4-8df5-d95dd3374db3" containerName="ceilometer-central-agent" Mar 16 17:00:16 crc kubenswrapper[5120]: I0316 17:00:16.929489 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="8564c4e1-fb50-4cb4-8df5-d95dd3374db3" containerName="proxy-httpd" Mar 16 17:00:16 crc kubenswrapper[5120]: I0316 17:00:16.929503 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="8564c4e1-fb50-4cb4-8df5-d95dd3374db3" containerName="ceilometer-notification-agent" Mar 16 17:00:16 crc kubenswrapper[5120]: I0316 17:00:16.929550 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="8564c4e1-fb50-4cb4-8df5-d95dd3374db3" containerName="sg-core" Mar 16 17:00:16 crc kubenswrapper[5120]: I0316 17:00:16.939911 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:00:16 crc kubenswrapper[5120]: I0316 17:00:16.947428 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ceilometer-internal-svc\"" Mar 16 17:00:16 crc kubenswrapper[5120]: I0316 17:00:16.947451 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 17:00:16 crc kubenswrapper[5120]: I0316 17:00:16.948471 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:00:16 crc kubenswrapper[5120]: I0316 17:00:16.952234 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 17:00:16 crc kubenswrapper[5120]: I0316 17:00:16.991109 5120 scope.go:117] "RemoveContainer" containerID="72ce6e63c6af240dbdaf4cfec1280154a8488b58f4057d2f278d8823fe4673f0" Mar 16 17:00:17 crc kubenswrapper[5120]: I0316 17:00:17.009576 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:00:17 crc kubenswrapper[5120]: I0316 17:00:17.069708 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/07433ec1-a6dc-48a4-8374-8260c23db816-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"07433ec1-a6dc-48a4-8374-8260c23db816\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:00:17 crc kubenswrapper[5120]: I0316 17:00:17.069874 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2jl5\" (UniqueName: \"kubernetes.io/projected/07433ec1-a6dc-48a4-8374-8260c23db816-kube-api-access-f2jl5\") pod \"ceilometer-0\" (UID: \"07433ec1-a6dc-48a4-8374-8260c23db816\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:00:17 crc kubenswrapper[5120]: I0316 17:00:17.069932 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/07433ec1-a6dc-48a4-8374-8260c23db816-log-httpd\") pod \"ceilometer-0\" (UID: \"07433ec1-a6dc-48a4-8374-8260c23db816\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:00:17 crc kubenswrapper[5120]: I0316 17:00:17.069989 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/07433ec1-a6dc-48a4-8374-8260c23db816-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"07433ec1-a6dc-48a4-8374-8260c23db816\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:00:17 crc kubenswrapper[5120]: I0316 17:00:17.070273 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/07433ec1-a6dc-48a4-8374-8260c23db816-run-httpd\") pod \"ceilometer-0\" (UID: \"07433ec1-a6dc-48a4-8374-8260c23db816\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:00:17 crc kubenswrapper[5120]: I0316 17:00:17.070457 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/07433ec1-a6dc-48a4-8374-8260c23db816-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"07433ec1-a6dc-48a4-8374-8260c23db816\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:00:17 crc kubenswrapper[5120]: I0316 17:00:17.070501 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/07433ec1-a6dc-48a4-8374-8260c23db816-scripts\") pod \"ceilometer-0\" (UID: \"07433ec1-a6dc-48a4-8374-8260c23db816\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:00:17 crc kubenswrapper[5120]: I0316 17:00:17.070553 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/07433ec1-a6dc-48a4-8374-8260c23db816-config-data\") pod \"ceilometer-0\" (UID: \"07433ec1-a6dc-48a4-8374-8260c23db816\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:00:17 crc kubenswrapper[5120]: I0316 17:00:17.082796 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:00:17 crc kubenswrapper[5120]: I0316 17:00:17.083340 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:00:17 crc kubenswrapper[5120]: I0316 17:00:17.175479 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/07433ec1-a6dc-48a4-8374-8260c23db816-run-httpd\") pod \"ceilometer-0\" (UID: \"07433ec1-a6dc-48a4-8374-8260c23db816\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:00:17 crc kubenswrapper[5120]: I0316 17:00:17.175774 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/07433ec1-a6dc-48a4-8374-8260c23db816-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"07433ec1-a6dc-48a4-8374-8260c23db816\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:00:17 crc kubenswrapper[5120]: I0316 17:00:17.175836 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/07433ec1-a6dc-48a4-8374-8260c23db816-scripts\") pod \"ceilometer-0\" (UID: \"07433ec1-a6dc-48a4-8374-8260c23db816\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:00:17 crc kubenswrapper[5120]: I0316 17:00:17.175926 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/07433ec1-a6dc-48a4-8374-8260c23db816-config-data\") pod \"ceilometer-0\" (UID: \"07433ec1-a6dc-48a4-8374-8260c23db816\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:00:17 crc kubenswrapper[5120]: I0316 17:00:17.176133 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/07433ec1-a6dc-48a4-8374-8260c23db816-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"07433ec1-a6dc-48a4-8374-8260c23db816\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:00:17 crc kubenswrapper[5120]: I0316 17:00:17.176301 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f2jl5\" (UniqueName: \"kubernetes.io/projected/07433ec1-a6dc-48a4-8374-8260c23db816-kube-api-access-f2jl5\") pod \"ceilometer-0\" (UID: \"07433ec1-a6dc-48a4-8374-8260c23db816\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:00:17 crc kubenswrapper[5120]: I0316 17:00:17.176380 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/07433ec1-a6dc-48a4-8374-8260c23db816-log-httpd\") pod \"ceilometer-0\" (UID: \"07433ec1-a6dc-48a4-8374-8260c23db816\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:00:17 crc kubenswrapper[5120]: I0316 17:00:17.176462 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/07433ec1-a6dc-48a4-8374-8260c23db816-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"07433ec1-a6dc-48a4-8374-8260c23db816\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:00:17 crc kubenswrapper[5120]: I0316 17:00:17.176879 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/07433ec1-a6dc-48a4-8374-8260c23db816-run-httpd\") pod \"ceilometer-0\" (UID: \"07433ec1-a6dc-48a4-8374-8260c23db816\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:00:17 crc kubenswrapper[5120]: I0316 17:00:17.178444 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/07433ec1-a6dc-48a4-8374-8260c23db816-log-httpd\") pod \"ceilometer-0\" (UID: \"07433ec1-a6dc-48a4-8374-8260c23db816\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:00:17 crc kubenswrapper[5120]: I0316 17:00:17.184550 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/07433ec1-a6dc-48a4-8374-8260c23db816-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"07433ec1-a6dc-48a4-8374-8260c23db816\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:00:17 crc kubenswrapper[5120]: I0316 17:00:17.184716 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/07433ec1-a6dc-48a4-8374-8260c23db816-config-data\") pod \"ceilometer-0\" (UID: \"07433ec1-a6dc-48a4-8374-8260c23db816\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:00:17 crc kubenswrapper[5120]: I0316 17:00:17.185726 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/07433ec1-a6dc-48a4-8374-8260c23db816-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"07433ec1-a6dc-48a4-8374-8260c23db816\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:00:17 crc kubenswrapper[5120]: I0316 17:00:17.193779 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/07433ec1-a6dc-48a4-8374-8260c23db816-scripts\") pod \"ceilometer-0\" (UID: \"07433ec1-a6dc-48a4-8374-8260c23db816\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:00:17 crc kubenswrapper[5120]: I0316 17:00:17.212827 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:00:17 crc kubenswrapper[5120]: I0316 17:00:17.214961 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2jl5\" (UniqueName: \"kubernetes.io/projected/07433ec1-a6dc-48a4-8374-8260c23db816-kube-api-access-f2jl5\") pod \"ceilometer-0\" (UID: \"07433ec1-a6dc-48a4-8374-8260c23db816\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:00:17 crc kubenswrapper[5120]: I0316 17:00:17.219851 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/07433ec1-a6dc-48a4-8374-8260c23db816-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"07433ec1-a6dc-48a4-8374-8260c23db816\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:00:17 crc kubenswrapper[5120]: I0316 17:00:17.312440 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:00:17 crc kubenswrapper[5120]: E0316 17:00:17.365948 5120 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod532eee6f_6605_4581_80a2_d8c6061bf84a.slice/crio-ebd80c70407524a39e410e1783924d3bd9a4f9eeab19b26208422ea92da963b3.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod532eee6f_6605_4581_80a2_d8c6061bf84a.slice/crio-conmon-ebd80c70407524a39e410e1783924d3bd9a4f9eeab19b26208422ea92da963b3.scope\": RecentStats: unable to find data in memory cache]" Mar 16 17:00:17 crc kubenswrapper[5120]: I0316 17:00:17.465479 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:00:17 crc kubenswrapper[5120]: I0316 17:00:17.586712 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/bc3dbeed-0812-4ece-b805-7408a7868f94-httpd-run\") pod \"bc3dbeed-0812-4ece-b805-7408a7868f94\" (UID: \"bc3dbeed-0812-4ece-b805-7408a7868f94\") " Mar 16 17:00:17 crc kubenswrapper[5120]: I0316 17:00:17.587349 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/bc3dbeed-0812-4ece-b805-7408a7868f94-scripts\") pod \"bc3dbeed-0812-4ece-b805-7408a7868f94\" (UID: \"bc3dbeed-0812-4ece-b805-7408a7868f94\") " Mar 16 17:00:17 crc kubenswrapper[5120]: I0316 17:00:17.587266 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc3dbeed-0812-4ece-b805-7408a7868f94-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "bc3dbeed-0812-4ece-b805-7408a7868f94" (UID: "bc3dbeed-0812-4ece-b805-7408a7868f94"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:00:17 crc kubenswrapper[5120]: I0316 17:00:17.587515 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bc3dbeed-0812-4ece-b805-7408a7868f94-combined-ca-bundle\") pod \"bc3dbeed-0812-4ece-b805-7408a7868f94\" (UID: \"bc3dbeed-0812-4ece-b805-7408a7868f94\") " Mar 16 17:00:17 crc kubenswrapper[5120]: I0316 17:00:17.587569 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/bc3dbeed-0812-4ece-b805-7408a7868f94-public-tls-certs\") pod \"bc3dbeed-0812-4ece-b805-7408a7868f94\" (UID: \"bc3dbeed-0812-4ece-b805-7408a7868f94\") " Mar 16 17:00:17 crc kubenswrapper[5120]: I0316 17:00:17.587656 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/bc3dbeed-0812-4ece-b805-7408a7868f94-logs\") pod \"bc3dbeed-0812-4ece-b805-7408a7868f94\" (UID: \"bc3dbeed-0812-4ece-b805-7408a7868f94\") " Mar 16 17:00:17 crc kubenswrapper[5120]: I0316 17:00:17.588063 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc3dbeed-0812-4ece-b805-7408a7868f94-logs" (OuterVolumeSpecName: "logs") pod "bc3dbeed-0812-4ece-b805-7408a7868f94" (UID: "bc3dbeed-0812-4ece-b805-7408a7868f94"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:00:17 crc kubenswrapper[5120]: I0316 17:00:17.587686 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"bc3dbeed-0812-4ece-b805-7408a7868f94\" (UID: \"bc3dbeed-0812-4ece-b805-7408a7868f94\") " Mar 16 17:00:17 crc kubenswrapper[5120]: I0316 17:00:17.588957 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bc3dbeed-0812-4ece-b805-7408a7868f94-config-data\") pod \"bc3dbeed-0812-4ece-b805-7408a7868f94\" (UID: \"bc3dbeed-0812-4ece-b805-7408a7868f94\") " Mar 16 17:00:17 crc kubenswrapper[5120]: I0316 17:00:17.589494 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tncdv\" (UniqueName: \"kubernetes.io/projected/bc3dbeed-0812-4ece-b805-7408a7868f94-kube-api-access-tncdv\") pod \"bc3dbeed-0812-4ece-b805-7408a7868f94\" (UID: \"bc3dbeed-0812-4ece-b805-7408a7868f94\") " Mar 16 17:00:17 crc kubenswrapper[5120]: I0316 17:00:17.591482 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/bc3dbeed-0812-4ece-b805-7408a7868f94-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:17 crc kubenswrapper[5120]: I0316 17:00:17.591517 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/bc3dbeed-0812-4ece-b805-7408a7868f94-logs\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:17 crc kubenswrapper[5120]: I0316 17:00:17.597224 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bc3dbeed-0812-4ece-b805-7408a7868f94-scripts" (OuterVolumeSpecName: "scripts") pod "bc3dbeed-0812-4ece-b805-7408a7868f94" (UID: "bc3dbeed-0812-4ece-b805-7408a7868f94"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:17 crc kubenswrapper[5120]: I0316 17:00:17.604828 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc3dbeed-0812-4ece-b805-7408a7868f94-kube-api-access-tncdv" (OuterVolumeSpecName: "kube-api-access-tncdv") pod "bc3dbeed-0812-4ece-b805-7408a7868f94" (UID: "bc3dbeed-0812-4ece-b805-7408a7868f94"). InnerVolumeSpecName "kube-api-access-tncdv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:00:17 crc kubenswrapper[5120]: I0316 17:00:17.620105 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage05-crc" (OuterVolumeSpecName: "glance") pod "bc3dbeed-0812-4ece-b805-7408a7868f94" (UID: "bc3dbeed-0812-4ece-b805-7408a7868f94"). InnerVolumeSpecName "local-storage05-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 17:00:17 crc kubenswrapper[5120]: I0316 17:00:17.681090 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bc3dbeed-0812-4ece-b805-7408a7868f94-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "bc3dbeed-0812-4ece-b805-7408a7868f94" (UID: "bc3dbeed-0812-4ece-b805-7408a7868f94"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:17 crc kubenswrapper[5120]: I0316 17:00:17.690884 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bc3dbeed-0812-4ece-b805-7408a7868f94-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "bc3dbeed-0812-4ece-b805-7408a7868f94" (UID: "bc3dbeed-0812-4ece-b805-7408a7868f94"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:17 crc kubenswrapper[5120]: I0316 17:00:17.694265 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/bc3dbeed-0812-4ece-b805-7408a7868f94-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:17 crc kubenswrapper[5120]: I0316 17:00:17.694299 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bc3dbeed-0812-4ece-b805-7408a7868f94-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:17 crc kubenswrapper[5120]: I0316 17:00:17.694308 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/bc3dbeed-0812-4ece-b805-7408a7868f94-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:17 crc kubenswrapper[5120]: I0316 17:00:17.694337 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") on node \"crc\" " Mar 16 17:00:17 crc kubenswrapper[5120]: I0316 17:00:17.694350 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tncdv\" (UniqueName: \"kubernetes.io/projected/bc3dbeed-0812-4ece-b805-7408a7868f94-kube-api-access-tncdv\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:17 crc kubenswrapper[5120]: I0316 17:00:17.699987 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bc3dbeed-0812-4ece-b805-7408a7868f94-config-data" (OuterVolumeSpecName: "config-data") pod "bc3dbeed-0812-4ece-b805-7408a7868f94" (UID: "bc3dbeed-0812-4ece-b805-7408a7868f94"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:17 crc kubenswrapper[5120]: I0316 17:00:17.734362 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage05-crc" (UniqueName: "kubernetes.io/local-volume/local-storage05-crc") on node "crc" Mar 16 17:00:17 crc kubenswrapper[5120]: I0316 17:00:17.793119 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:00:17 crc kubenswrapper[5120]: I0316 17:00:17.797471 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bc3dbeed-0812-4ece-b805-7408a7868f94-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:17 crc kubenswrapper[5120]: I0316 17:00:17.797499 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:17 crc kubenswrapper[5120]: I0316 17:00:17.849288 5120 generic.go:358] "Generic (PLEG): container finished" podID="532eee6f-6605-4581-80a2-d8c6061bf84a" containerID="ebd80c70407524a39e410e1783924d3bd9a4f9eeab19b26208422ea92da963b3" exitCode=0 Mar 16 17:00:17 crc kubenswrapper[5120]: I0316 17:00:17.849412 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"532eee6f-6605-4581-80a2-d8c6061bf84a","Type":"ContainerDied","Data":"ebd80c70407524a39e410e1783924d3bd9a4f9eeab19b26208422ea92da963b3"} Mar 16 17:00:17 crc kubenswrapper[5120]: I0316 17:00:17.849418 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:00:17 crc kubenswrapper[5120]: I0316 17:00:17.849450 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"532eee6f-6605-4581-80a2-d8c6061bf84a","Type":"ContainerDied","Data":"3e98f77e907cb64682260c90ea81a1a04105aae8c4e77884f21cac47128e776e"} Mar 16 17:00:17 crc kubenswrapper[5120]: I0316 17:00:17.849500 5120 scope.go:117] "RemoveContainer" containerID="ebd80c70407524a39e410e1783924d3bd9a4f9eeab19b26208422ea92da963b3" Mar 16 17:00:17 crc kubenswrapper[5120]: I0316 17:00:17.852997 5120 generic.go:358] "Generic (PLEG): container finished" podID="bc3dbeed-0812-4ece-b805-7408a7868f94" containerID="da6751457801480c486418b96b45b4721dffdf69ace0d9d360a1f4dc4bc9ab5d" exitCode=0 Mar 16 17:00:17 crc kubenswrapper[5120]: I0316 17:00:17.853108 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:00:17 crc kubenswrapper[5120]: I0316 17:00:17.853124 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"bc3dbeed-0812-4ece-b805-7408a7868f94","Type":"ContainerDied","Data":"da6751457801480c486418b96b45b4721dffdf69ace0d9d360a1f4dc4bc9ab5d"} Mar 16 17:00:17 crc kubenswrapper[5120]: I0316 17:00:17.853198 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"bc3dbeed-0812-4ece-b805-7408a7868f94","Type":"ContainerDied","Data":"6e6d885ee712bc9f5b3d14aa2236c8c0c3aab39726b6de818a72eca6ce303939"} Mar 16 17:00:17 crc kubenswrapper[5120]: I0316 17:00:17.872952 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"d82f3b2b-c672-46ff-8fc8-afc5b33e8252","Type":"ContainerStarted","Data":"498a641ae78ee7e529f010dee7dcbf81ff0ff8d58d98aecf53ad28696be667d1"} Mar 16 17:00:17 crc kubenswrapper[5120]: I0316 17:00:17.899214 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/532eee6f-6605-4581-80a2-d8c6061bf84a-httpd-run\") pod \"532eee6f-6605-4581-80a2-d8c6061bf84a\" (UID: \"532eee6f-6605-4581-80a2-d8c6061bf84a\") " Mar 16 17:00:17 crc kubenswrapper[5120]: I0316 17:00:17.899474 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/532eee6f-6605-4581-80a2-d8c6061bf84a-logs\") pod \"532eee6f-6605-4581-80a2-d8c6061bf84a\" (UID: \"532eee6f-6605-4581-80a2-d8c6061bf84a\") " Mar 16 17:00:17 crc kubenswrapper[5120]: I0316 17:00:17.899597 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/532eee6f-6605-4581-80a2-d8c6061bf84a-combined-ca-bundle\") pod \"532eee6f-6605-4581-80a2-d8c6061bf84a\" (UID: \"532eee6f-6605-4581-80a2-d8c6061bf84a\") " Mar 16 17:00:17 crc kubenswrapper[5120]: I0316 17:00:17.899648 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/532eee6f-6605-4581-80a2-d8c6061bf84a-internal-tls-certs\") pod \"532eee6f-6605-4581-80a2-d8c6061bf84a\" (UID: \"532eee6f-6605-4581-80a2-d8c6061bf84a\") " Mar 16 17:00:17 crc kubenswrapper[5120]: I0316 17:00:17.899734 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/532eee6f-6605-4581-80a2-d8c6061bf84a-scripts\") pod \"532eee6f-6605-4581-80a2-d8c6061bf84a\" (UID: \"532eee6f-6605-4581-80a2-d8c6061bf84a\") " Mar 16 17:00:17 crc kubenswrapper[5120]: I0316 17:00:17.899869 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"532eee6f-6605-4581-80a2-d8c6061bf84a\" (UID: \"532eee6f-6605-4581-80a2-d8c6061bf84a\") " Mar 16 17:00:17 crc kubenswrapper[5120]: I0316 17:00:17.900025 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kdtn2\" (UniqueName: \"kubernetes.io/projected/532eee6f-6605-4581-80a2-d8c6061bf84a-kube-api-access-kdtn2\") pod \"532eee6f-6605-4581-80a2-d8c6061bf84a\" (UID: \"532eee6f-6605-4581-80a2-d8c6061bf84a\") " Mar 16 17:00:17 crc kubenswrapper[5120]: I0316 17:00:17.900249 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/532eee6f-6605-4581-80a2-d8c6061bf84a-config-data\") pod \"532eee6f-6605-4581-80a2-d8c6061bf84a\" (UID: \"532eee6f-6605-4581-80a2-d8c6061bf84a\") " Mar 16 17:00:17 crc kubenswrapper[5120]: I0316 17:00:17.902797 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/532eee6f-6605-4581-80a2-d8c6061bf84a-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "532eee6f-6605-4581-80a2-d8c6061bf84a" (UID: "532eee6f-6605-4581-80a2-d8c6061bf84a"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:00:17 crc kubenswrapper[5120]: I0316 17:00:17.905998 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/532eee6f-6605-4581-80a2-d8c6061bf84a-logs" (OuterVolumeSpecName: "logs") pod "532eee6f-6605-4581-80a2-d8c6061bf84a" (UID: "532eee6f-6605-4581-80a2-d8c6061bf84a"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:00:17 crc kubenswrapper[5120]: I0316 17:00:17.906924 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/532eee6f-6605-4581-80a2-d8c6061bf84a-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:17 crc kubenswrapper[5120]: I0316 17:00:17.906964 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/532eee6f-6605-4581-80a2-d8c6061bf84a-logs\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:17 crc kubenswrapper[5120]: I0316 17:00:17.909981 5120 scope.go:117] "RemoveContainer" containerID="19d677cabef5c32207ea90684cf888f271b1d4ce284d04a3263cec9573a4201a" Mar 16 17:00:17 crc kubenswrapper[5120]: I0316 17:00:17.913669 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 17:00:17 crc kubenswrapper[5120]: I0316 17:00:17.936048 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/532eee6f-6605-4581-80a2-d8c6061bf84a-scripts" (OuterVolumeSpecName: "scripts") pod "532eee6f-6605-4581-80a2-d8c6061bf84a" (UID: "532eee6f-6605-4581-80a2-d8c6061bf84a"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:17 crc kubenswrapper[5120]: I0316 17:00:17.936223 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage06-crc" (OuterVolumeSpecName: "glance") pod "532eee6f-6605-4581-80a2-d8c6061bf84a" (UID: "532eee6f-6605-4581-80a2-d8c6061bf84a"). InnerVolumeSpecName "local-storage06-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 17:00:17 crc kubenswrapper[5120]: I0316 17:00:17.937806 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/532eee6f-6605-4581-80a2-d8c6061bf84a-kube-api-access-kdtn2" (OuterVolumeSpecName: "kube-api-access-kdtn2") pod "532eee6f-6605-4581-80a2-d8c6061bf84a" (UID: "532eee6f-6605-4581-80a2-d8c6061bf84a"). InnerVolumeSpecName "kube-api-access-kdtn2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:00:17 crc kubenswrapper[5120]: I0316 17:00:17.971996 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/532eee6f-6605-4581-80a2-d8c6061bf84a-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "532eee6f-6605-4581-80a2-d8c6061bf84a" (UID: "532eee6f-6605-4581-80a2-d8c6061bf84a"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:17 crc kubenswrapper[5120]: I0316 17:00:17.972070 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 17:00:17 crc kubenswrapper[5120]: I0316 17:00:17.986667 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 17:00:17 crc kubenswrapper[5120]: I0316 17:00:17.988000 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc3dbeed-0812-4ece-b805-7408a7868f94" containerName="glance-log" Mar 16 17:00:17 crc kubenswrapper[5120]: I0316 17:00:17.988020 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc3dbeed-0812-4ece-b805-7408a7868f94" containerName="glance-log" Mar 16 17:00:17 crc kubenswrapper[5120]: I0316 17:00:17.988071 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc3dbeed-0812-4ece-b805-7408a7868f94" containerName="glance-httpd" Mar 16 17:00:17 crc kubenswrapper[5120]: I0316 17:00:17.988081 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc3dbeed-0812-4ece-b805-7408a7868f94" containerName="glance-httpd" Mar 16 17:00:17 crc kubenswrapper[5120]: I0316 17:00:17.988124 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="532eee6f-6605-4581-80a2-d8c6061bf84a" containerName="glance-httpd" Mar 16 17:00:17 crc kubenswrapper[5120]: I0316 17:00:17.988130 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="532eee6f-6605-4581-80a2-d8c6061bf84a" containerName="glance-httpd" Mar 16 17:00:17 crc kubenswrapper[5120]: I0316 17:00:17.988144 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="532eee6f-6605-4581-80a2-d8c6061bf84a" containerName="glance-log" Mar 16 17:00:17 crc kubenswrapper[5120]: I0316 17:00:17.988152 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="532eee6f-6605-4581-80a2-d8c6061bf84a" containerName="glance-log" Mar 16 17:00:17 crc kubenswrapper[5120]: I0316 17:00:17.988309 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="bc3dbeed-0812-4ece-b805-7408a7868f94" containerName="glance-httpd" Mar 16 17:00:17 crc kubenswrapper[5120]: I0316 17:00:17.988324 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="532eee6f-6605-4581-80a2-d8c6061bf84a" containerName="glance-log" Mar 16 17:00:17 crc kubenswrapper[5120]: I0316 17:00:17.988330 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="532eee6f-6605-4581-80a2-d8c6061bf84a" containerName="glance-httpd" Mar 16 17:00:17 crc kubenswrapper[5120]: I0316 17:00:17.988338 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="bc3dbeed-0812-4ece-b805-7408a7868f94" containerName="glance-log" Mar 16 17:00:18 crc kubenswrapper[5120]: I0316 17:00:18.000950 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:00:18 crc kubenswrapper[5120]: I0316 17:00:18.013029 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-external-config-data\"" Mar 16 17:00:18 crc kubenswrapper[5120]: I0316 17:00:18.013333 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-public-svc\"" Mar 16 17:00:18 crc kubenswrapper[5120]: I0316 17:00:18.026800 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/532eee6f-6605-4581-80a2-d8c6061bf84a-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:18 crc kubenswrapper[5120]: I0316 17:00:18.026852 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/532eee6f-6605-4581-80a2-d8c6061bf84a-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:18 crc kubenswrapper[5120]: I0316 17:00:18.026887 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") on node \"crc\" " Mar 16 17:00:18 crc kubenswrapper[5120]: I0316 17:00:18.026903 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kdtn2\" (UniqueName: \"kubernetes.io/projected/532eee6f-6605-4581-80a2-d8c6061bf84a-kube-api-access-kdtn2\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:18 crc kubenswrapper[5120]: I0316 17:00:18.038419 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:00:18 crc kubenswrapper[5120]: I0316 17:00:18.041361 5120 scope.go:117] "RemoveContainer" containerID="ebd80c70407524a39e410e1783924d3bd9a4f9eeab19b26208422ea92da963b3" Mar 16 17:00:18 crc kubenswrapper[5120]: E0316 17:00:18.042432 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ebd80c70407524a39e410e1783924d3bd9a4f9eeab19b26208422ea92da963b3\": container with ID starting with ebd80c70407524a39e410e1783924d3bd9a4f9eeab19b26208422ea92da963b3 not found: ID does not exist" containerID="ebd80c70407524a39e410e1783924d3bd9a4f9eeab19b26208422ea92da963b3" Mar 16 17:00:18 crc kubenswrapper[5120]: I0316 17:00:18.042560 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ebd80c70407524a39e410e1783924d3bd9a4f9eeab19b26208422ea92da963b3"} err="failed to get container status \"ebd80c70407524a39e410e1783924d3bd9a4f9eeab19b26208422ea92da963b3\": rpc error: code = NotFound desc = could not find container \"ebd80c70407524a39e410e1783924d3bd9a4f9eeab19b26208422ea92da963b3\": container with ID starting with ebd80c70407524a39e410e1783924d3bd9a4f9eeab19b26208422ea92da963b3 not found: ID does not exist" Mar 16 17:00:18 crc kubenswrapper[5120]: I0316 17:00:18.042728 5120 scope.go:117] "RemoveContainer" containerID="19d677cabef5c32207ea90684cf888f271b1d4ce284d04a3263cec9573a4201a" Mar 16 17:00:18 crc kubenswrapper[5120]: E0316 17:00:18.046659 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"19d677cabef5c32207ea90684cf888f271b1d4ce284d04a3263cec9573a4201a\": container with ID starting with 19d677cabef5c32207ea90684cf888f271b1d4ce284d04a3263cec9573a4201a not found: ID does not exist" containerID="19d677cabef5c32207ea90684cf888f271b1d4ce284d04a3263cec9573a4201a" Mar 16 17:00:18 crc kubenswrapper[5120]: I0316 17:00:18.046738 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19d677cabef5c32207ea90684cf888f271b1d4ce284d04a3263cec9573a4201a"} err="failed to get container status \"19d677cabef5c32207ea90684cf888f271b1d4ce284d04a3263cec9573a4201a\": rpc error: code = NotFound desc = could not find container \"19d677cabef5c32207ea90684cf888f271b1d4ce284d04a3263cec9573a4201a\": container with ID starting with 19d677cabef5c32207ea90684cf888f271b1d4ce284d04a3263cec9573a4201a not found: ID does not exist" Mar 16 17:00:18 crc kubenswrapper[5120]: I0316 17:00:18.046799 5120 scope.go:117] "RemoveContainer" containerID="da6751457801480c486418b96b45b4721dffdf69ace0d9d360a1f4dc4bc9ab5d" Mar 16 17:00:18 crc kubenswrapper[5120]: I0316 17:00:18.066711 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/532eee6f-6605-4581-80a2-d8c6061bf84a-config-data" (OuterVolumeSpecName: "config-data") pod "532eee6f-6605-4581-80a2-d8c6061bf84a" (UID: "532eee6f-6605-4581-80a2-d8c6061bf84a"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:18 crc kubenswrapper[5120]: I0316 17:00:18.073534 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/532eee6f-6605-4581-80a2-d8c6061bf84a-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "532eee6f-6605-4581-80a2-d8c6061bf84a" (UID: "532eee6f-6605-4581-80a2-d8c6061bf84a"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:18 crc kubenswrapper[5120]: I0316 17:00:18.073657 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 17:00:18 crc kubenswrapper[5120]: I0316 17:00:18.094631 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:00:18 crc kubenswrapper[5120]: I0316 17:00:18.094676 5120 scope.go:117] "RemoveContainer" containerID="397ff88ea2eae604377585921ebbaff09e18274622110377c820fff687461187" Mar 16 17:00:18 crc kubenswrapper[5120]: I0316 17:00:18.128670 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/447b243b-6b80-4883-9844-f49d3f2f4a22-logs\") pod \"glance-default-external-api-0\" (UID: \"447b243b-6b80-4883-9844-f49d3f2f4a22\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:00:18 crc kubenswrapper[5120]: I0316 17:00:18.128750 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/447b243b-6b80-4883-9844-f49d3f2f4a22-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"447b243b-6b80-4883-9844-f49d3f2f4a22\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:00:18 crc kubenswrapper[5120]: I0316 17:00:18.129186 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/447b243b-6b80-4883-9844-f49d3f2f4a22-config-data\") pod \"glance-default-external-api-0\" (UID: \"447b243b-6b80-4883-9844-f49d3f2f4a22\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:00:18 crc kubenswrapper[5120]: I0316 17:00:18.129245 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/447b243b-6b80-4883-9844-f49d3f2f4a22-scripts\") pod \"glance-default-external-api-0\" (UID: \"447b243b-6b80-4883-9844-f49d3f2f4a22\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:00:18 crc kubenswrapper[5120]: I0316 17:00:18.129378 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/447b243b-6b80-4883-9844-f49d3f2f4a22-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"447b243b-6b80-4883-9844-f49d3f2f4a22\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:00:18 crc kubenswrapper[5120]: I0316 17:00:18.129450 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"glance-default-external-api-0\" (UID: \"447b243b-6b80-4883-9844-f49d3f2f4a22\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:00:18 crc kubenswrapper[5120]: I0316 17:00:18.129518 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/447b243b-6b80-4883-9844-f49d3f2f4a22-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"447b243b-6b80-4883-9844-f49d3f2f4a22\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:00:18 crc kubenswrapper[5120]: I0316 17:00:18.129568 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v24kv\" (UniqueName: \"kubernetes.io/projected/447b243b-6b80-4883-9844-f49d3f2f4a22-kube-api-access-v24kv\") pod \"glance-default-external-api-0\" (UID: \"447b243b-6b80-4883-9844-f49d3f2f4a22\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:00:18 crc kubenswrapper[5120]: I0316 17:00:18.129593 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage06-crc" (UniqueName: "kubernetes.io/local-volume/local-storage06-crc") on node "crc" Mar 16 17:00:18 crc kubenswrapper[5120]: I0316 17:00:18.129933 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:18 crc kubenswrapper[5120]: I0316 17:00:18.129957 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/532eee6f-6605-4581-80a2-d8c6061bf84a-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:18 crc kubenswrapper[5120]: I0316 17:00:18.129971 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/532eee6f-6605-4581-80a2-d8c6061bf84a-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:18 crc kubenswrapper[5120]: I0316 17:00:18.144061 5120 scope.go:117] "RemoveContainer" containerID="da6751457801480c486418b96b45b4721dffdf69ace0d9d360a1f4dc4bc9ab5d" Mar 16 17:00:18 crc kubenswrapper[5120]: E0316 17:00:18.144552 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da6751457801480c486418b96b45b4721dffdf69ace0d9d360a1f4dc4bc9ab5d\": container with ID starting with da6751457801480c486418b96b45b4721dffdf69ace0d9d360a1f4dc4bc9ab5d not found: ID does not exist" containerID="da6751457801480c486418b96b45b4721dffdf69ace0d9d360a1f4dc4bc9ab5d" Mar 16 17:00:18 crc kubenswrapper[5120]: I0316 17:00:18.144635 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da6751457801480c486418b96b45b4721dffdf69ace0d9d360a1f4dc4bc9ab5d"} err="failed to get container status \"da6751457801480c486418b96b45b4721dffdf69ace0d9d360a1f4dc4bc9ab5d\": rpc error: code = NotFound desc = could not find container \"da6751457801480c486418b96b45b4721dffdf69ace0d9d360a1f4dc4bc9ab5d\": container with ID starting with da6751457801480c486418b96b45b4721dffdf69ace0d9d360a1f4dc4bc9ab5d not found: ID does not exist" Mar 16 17:00:18 crc kubenswrapper[5120]: I0316 17:00:18.144694 5120 scope.go:117] "RemoveContainer" containerID="397ff88ea2eae604377585921ebbaff09e18274622110377c820fff687461187" Mar 16 17:00:18 crc kubenswrapper[5120]: E0316 17:00:18.148548 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"397ff88ea2eae604377585921ebbaff09e18274622110377c820fff687461187\": container with ID starting with 397ff88ea2eae604377585921ebbaff09e18274622110377c820fff687461187 not found: ID does not exist" containerID="397ff88ea2eae604377585921ebbaff09e18274622110377c820fff687461187" Mar 16 17:00:18 crc kubenswrapper[5120]: I0316 17:00:18.148584 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"397ff88ea2eae604377585921ebbaff09e18274622110377c820fff687461187"} err="failed to get container status \"397ff88ea2eae604377585921ebbaff09e18274622110377c820fff687461187\": rpc error: code = NotFound desc = could not find container \"397ff88ea2eae604377585921ebbaff09e18274622110377c820fff687461187\": container with ID starting with 397ff88ea2eae604377585921ebbaff09e18274622110377c820fff687461187 not found: ID does not exist" Mar 16 17:00:18 crc kubenswrapper[5120]: I0316 17:00:18.191390 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 17:00:18 crc kubenswrapper[5120]: I0316 17:00:18.215364 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 17:00:18 crc kubenswrapper[5120]: I0316 17:00:18.226179 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 17:00:18 crc kubenswrapper[5120]: I0316 17:00:18.232219 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/447b243b-6b80-4883-9844-f49d3f2f4a22-config-data\") pod \"glance-default-external-api-0\" (UID: \"447b243b-6b80-4883-9844-f49d3f2f4a22\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:00:18 crc kubenswrapper[5120]: I0316 17:00:18.232303 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/447b243b-6b80-4883-9844-f49d3f2f4a22-scripts\") pod \"glance-default-external-api-0\" (UID: \"447b243b-6b80-4883-9844-f49d3f2f4a22\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:00:18 crc kubenswrapper[5120]: I0316 17:00:18.232417 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/447b243b-6b80-4883-9844-f49d3f2f4a22-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"447b243b-6b80-4883-9844-f49d3f2f4a22\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:00:18 crc kubenswrapper[5120]: I0316 17:00:18.232479 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"glance-default-external-api-0\" (UID: \"447b243b-6b80-4883-9844-f49d3f2f4a22\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:00:18 crc kubenswrapper[5120]: I0316 17:00:18.232538 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/447b243b-6b80-4883-9844-f49d3f2f4a22-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"447b243b-6b80-4883-9844-f49d3f2f4a22\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:00:18 crc kubenswrapper[5120]: I0316 17:00:18.232583 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v24kv\" (UniqueName: \"kubernetes.io/projected/447b243b-6b80-4883-9844-f49d3f2f4a22-kube-api-access-v24kv\") pod \"glance-default-external-api-0\" (UID: \"447b243b-6b80-4883-9844-f49d3f2f4a22\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:00:18 crc kubenswrapper[5120]: I0316 17:00:18.232694 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/447b243b-6b80-4883-9844-f49d3f2f4a22-logs\") pod \"glance-default-external-api-0\" (UID: \"447b243b-6b80-4883-9844-f49d3f2f4a22\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:00:18 crc kubenswrapper[5120]: I0316 17:00:18.232734 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/447b243b-6b80-4883-9844-f49d3f2f4a22-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"447b243b-6b80-4883-9844-f49d3f2f4a22\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:00:18 crc kubenswrapper[5120]: I0316 17:00:18.233096 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"glance-default-external-api-0\" (UID: \"447b243b-6b80-4883-9844-f49d3f2f4a22\") device mount path \"/mnt/openstack/pv05\"" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:00:18 crc kubenswrapper[5120]: I0316 17:00:18.233997 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:00:18 crc kubenswrapper[5120]: I0316 17:00:18.238800 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-internal-config-data\"" Mar 16 17:00:18 crc kubenswrapper[5120]: I0316 17:00:18.239053 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-internal-svc\"" Mar 16 17:00:18 crc kubenswrapper[5120]: I0316 17:00:18.240098 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/447b243b-6b80-4883-9844-f49d3f2f4a22-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"447b243b-6b80-4883-9844-f49d3f2f4a22\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:00:18 crc kubenswrapper[5120]: I0316 17:00:18.240635 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/447b243b-6b80-4883-9844-f49d3f2f4a22-logs\") pod \"glance-default-external-api-0\" (UID: \"447b243b-6b80-4883-9844-f49d3f2f4a22\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:00:18 crc kubenswrapper[5120]: I0316 17:00:18.238942 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/447b243b-6b80-4883-9844-f49d3f2f4a22-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"447b243b-6b80-4883-9844-f49d3f2f4a22\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:00:18 crc kubenswrapper[5120]: I0316 17:00:18.245873 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/447b243b-6b80-4883-9844-f49d3f2f4a22-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"447b243b-6b80-4883-9844-f49d3f2f4a22\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:00:18 crc kubenswrapper[5120]: I0316 17:00:18.251715 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/447b243b-6b80-4883-9844-f49d3f2f4a22-scripts\") pod \"glance-default-external-api-0\" (UID: \"447b243b-6b80-4883-9844-f49d3f2f4a22\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:00:18 crc kubenswrapper[5120]: I0316 17:00:18.251913 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/447b243b-6b80-4883-9844-f49d3f2f4a22-config-data\") pod \"glance-default-external-api-0\" (UID: \"447b243b-6b80-4883-9844-f49d3f2f4a22\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:00:18 crc kubenswrapper[5120]: I0316 17:00:18.259525 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v24kv\" (UniqueName: \"kubernetes.io/projected/447b243b-6b80-4883-9844-f49d3f2f4a22-kube-api-access-v24kv\") pod \"glance-default-external-api-0\" (UID: \"447b243b-6b80-4883-9844-f49d3f2f4a22\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:00:18 crc kubenswrapper[5120]: I0316 17:00:18.271079 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 17:00:18 crc kubenswrapper[5120]: I0316 17:00:18.291746 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"glance-default-external-api-0\" (UID: \"447b243b-6b80-4883-9844-f49d3f2f4a22\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:00:18 crc kubenswrapper[5120]: I0316 17:00:18.335075 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/55f7f374-c6b2-422b-90bd-a7dcc936e74f-config-data\") pod \"glance-default-internal-api-0\" (UID: \"55f7f374-c6b2-422b-90bd-a7dcc936e74f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:00:18 crc kubenswrapper[5120]: I0316 17:00:18.336205 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/55f7f374-c6b2-422b-90bd-a7dcc936e74f-scripts\") pod \"glance-default-internal-api-0\" (UID: \"55f7f374-c6b2-422b-90bd-a7dcc936e74f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:00:18 crc kubenswrapper[5120]: I0316 17:00:18.336369 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/55f7f374-c6b2-422b-90bd-a7dcc936e74f-logs\") pod \"glance-default-internal-api-0\" (UID: \"55f7f374-c6b2-422b-90bd-a7dcc936e74f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:00:18 crc kubenswrapper[5120]: I0316 17:00:18.336553 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"glance-default-internal-api-0\" (UID: \"55f7f374-c6b2-422b-90bd-a7dcc936e74f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:00:18 crc kubenswrapper[5120]: I0316 17:00:18.336658 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/55f7f374-c6b2-422b-90bd-a7dcc936e74f-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"55f7f374-c6b2-422b-90bd-a7dcc936e74f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:00:18 crc kubenswrapper[5120]: I0316 17:00:18.336707 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/55f7f374-c6b2-422b-90bd-a7dcc936e74f-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"55f7f374-c6b2-422b-90bd-a7dcc936e74f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:00:18 crc kubenswrapper[5120]: I0316 17:00:18.336999 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/55f7f374-c6b2-422b-90bd-a7dcc936e74f-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"55f7f374-c6b2-422b-90bd-a7dcc936e74f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:00:18 crc kubenswrapper[5120]: I0316 17:00:18.337033 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vm2nn\" (UniqueName: \"kubernetes.io/projected/55f7f374-c6b2-422b-90bd-a7dcc936e74f-kube-api-access-vm2nn\") pod \"glance-default-internal-api-0\" (UID: \"55f7f374-c6b2-422b-90bd-a7dcc936e74f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:00:18 crc kubenswrapper[5120]: I0316 17:00:18.341671 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:00:18 crc kubenswrapper[5120]: I0316 17:00:18.439383 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/55f7f374-c6b2-422b-90bd-a7dcc936e74f-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"55f7f374-c6b2-422b-90bd-a7dcc936e74f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:00:18 crc kubenswrapper[5120]: I0316 17:00:18.439441 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vm2nn\" (UniqueName: \"kubernetes.io/projected/55f7f374-c6b2-422b-90bd-a7dcc936e74f-kube-api-access-vm2nn\") pod \"glance-default-internal-api-0\" (UID: \"55f7f374-c6b2-422b-90bd-a7dcc936e74f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:00:18 crc kubenswrapper[5120]: I0316 17:00:18.439545 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/55f7f374-c6b2-422b-90bd-a7dcc936e74f-config-data\") pod \"glance-default-internal-api-0\" (UID: \"55f7f374-c6b2-422b-90bd-a7dcc936e74f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:00:18 crc kubenswrapper[5120]: I0316 17:00:18.439633 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/55f7f374-c6b2-422b-90bd-a7dcc936e74f-scripts\") pod \"glance-default-internal-api-0\" (UID: \"55f7f374-c6b2-422b-90bd-a7dcc936e74f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:00:18 crc kubenswrapper[5120]: I0316 17:00:18.439711 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/55f7f374-c6b2-422b-90bd-a7dcc936e74f-logs\") pod \"glance-default-internal-api-0\" (UID: \"55f7f374-c6b2-422b-90bd-a7dcc936e74f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:00:18 crc kubenswrapper[5120]: I0316 17:00:18.439831 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"glance-default-internal-api-0\" (UID: \"55f7f374-c6b2-422b-90bd-a7dcc936e74f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:00:18 crc kubenswrapper[5120]: I0316 17:00:18.439915 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/55f7f374-c6b2-422b-90bd-a7dcc936e74f-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"55f7f374-c6b2-422b-90bd-a7dcc936e74f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:00:18 crc kubenswrapper[5120]: I0316 17:00:18.439926 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/55f7f374-c6b2-422b-90bd-a7dcc936e74f-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"55f7f374-c6b2-422b-90bd-a7dcc936e74f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:00:18 crc kubenswrapper[5120]: I0316 17:00:18.440076 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"glance-default-internal-api-0\" (UID: \"55f7f374-c6b2-422b-90bd-a7dcc936e74f\") device mount path \"/mnt/openstack/pv06\"" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:00:18 crc kubenswrapper[5120]: I0316 17:00:18.440113 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/55f7f374-c6b2-422b-90bd-a7dcc936e74f-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"55f7f374-c6b2-422b-90bd-a7dcc936e74f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:00:18 crc kubenswrapper[5120]: I0316 17:00:18.443921 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/55f7f374-c6b2-422b-90bd-a7dcc936e74f-logs\") pod \"glance-default-internal-api-0\" (UID: \"55f7f374-c6b2-422b-90bd-a7dcc936e74f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:00:18 crc kubenswrapper[5120]: I0316 17:00:18.445337 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/55f7f374-c6b2-422b-90bd-a7dcc936e74f-config-data\") pod \"glance-default-internal-api-0\" (UID: \"55f7f374-c6b2-422b-90bd-a7dcc936e74f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:00:18 crc kubenswrapper[5120]: I0316 17:00:18.454470 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/55f7f374-c6b2-422b-90bd-a7dcc936e74f-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"55f7f374-c6b2-422b-90bd-a7dcc936e74f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:00:18 crc kubenswrapper[5120]: I0316 17:00:18.454642 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/55f7f374-c6b2-422b-90bd-a7dcc936e74f-scripts\") pod \"glance-default-internal-api-0\" (UID: \"55f7f374-c6b2-422b-90bd-a7dcc936e74f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:00:18 crc kubenswrapper[5120]: I0316 17:00:18.455315 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/55f7f374-c6b2-422b-90bd-a7dcc936e74f-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"55f7f374-c6b2-422b-90bd-a7dcc936e74f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:00:18 crc kubenswrapper[5120]: I0316 17:00:18.459408 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vm2nn\" (UniqueName: \"kubernetes.io/projected/55f7f374-c6b2-422b-90bd-a7dcc936e74f-kube-api-access-vm2nn\") pod \"glance-default-internal-api-0\" (UID: \"55f7f374-c6b2-422b-90bd-a7dcc936e74f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:00:18 crc kubenswrapper[5120]: I0316 17:00:18.470575 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"glance-default-internal-api-0\" (UID: \"55f7f374-c6b2-422b-90bd-a7dcc936e74f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:00:18 crc kubenswrapper[5120]: I0316 17:00:18.575062 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:00:18 crc kubenswrapper[5120]: I0316 17:00:18.686627 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="532eee6f-6605-4581-80a2-d8c6061bf84a" path="/var/lib/kubelet/pods/532eee6f-6605-4581-80a2-d8c6061bf84a/volumes" Mar 16 17:00:18 crc kubenswrapper[5120]: I0316 17:00:18.687611 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8564c4e1-fb50-4cb4-8df5-d95dd3374db3" path="/var/lib/kubelet/pods/8564c4e1-fb50-4cb4-8df5-d95dd3374db3/volumes" Mar 16 17:00:18 crc kubenswrapper[5120]: I0316 17:00:18.690022 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc3dbeed-0812-4ece-b805-7408a7868f94" path="/var/lib/kubelet/pods/bc3dbeed-0812-4ece-b805-7408a7868f94/volumes" Mar 16 17:00:18 crc kubenswrapper[5120]: I0316 17:00:18.836782 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 17:00:18 crc kubenswrapper[5120]: I0316 17:00:18.899746 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"07433ec1-a6dc-48a4-8374-8260c23db816","Type":"ContainerStarted","Data":"0e84cc975c1578089f18cfc79c7d2767659b11c27e73a227e46f4578fb381522"} Mar 16 17:00:18 crc kubenswrapper[5120]: I0316 17:00:18.909281 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"447b243b-6b80-4883-9844-f49d3f2f4a22","Type":"ContainerStarted","Data":"e803538312a212485fe3e1cd0f6d0c8e1b682adb11e1ccc6978acbc806e44071"} Mar 16 17:00:19 crc kubenswrapper[5120]: I0316 17:00:19.126175 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 17:00:19 crc kubenswrapper[5120]: W0316 17:00:19.134676 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod55f7f374_c6b2_422b_90bd_a7dcc936e74f.slice/crio-09bbf68572dda98d0eba8758d9ca27ed1d096829ca22317239ce3b4204cf1485 WatchSource:0}: Error finding container 09bbf68572dda98d0eba8758d9ca27ed1d096829ca22317239ce3b4204cf1485: Status 404 returned error can't find the container with id 09bbf68572dda98d0eba8758d9ca27ed1d096829ca22317239ce3b4204cf1485 Mar 16 17:00:19 crc kubenswrapper[5120]: E0316 17:00:19.486648 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-swift-public-svc: secret "cert-swift-public-svc" not found Mar 16 17:00:19 crc kubenswrapper[5120]: E0316 17:00:19.487060 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21a5384d-c9cf-429c-9e7e-cc9fb2a825b9-public-tls-certs podName:21a5384d-c9cf-429c-9e7e-cc9fb2a825b9 nodeName:}" failed. No retries permitted until 2026-03-16 17:00:35.487038949 +0000 UTC m=+5337.640970606 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/21a5384d-c9cf-429c-9e7e-cc9fb2a825b9-public-tls-certs") pod "swift-proxy-5f4bc687f4-xcf5c" (UID: "21a5384d-c9cf-429c-9e7e-cc9fb2a825b9") : secret "cert-swift-public-svc" not found Mar 16 17:00:19 crc kubenswrapper[5120]: E0316 17:00:19.487885 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-swift-internal-svc: secret "cert-swift-internal-svc" not found Mar 16 17:00:19 crc kubenswrapper[5120]: E0316 17:00:19.487960 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21a5384d-c9cf-429c-9e7e-cc9fb2a825b9-internal-tls-certs podName:21a5384d-c9cf-429c-9e7e-cc9fb2a825b9 nodeName:}" failed. No retries permitted until 2026-03-16 17:00:35.487941034 +0000 UTC m=+5337.641872691 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/21a5384d-c9cf-429c-9e7e-cc9fb2a825b9-internal-tls-certs") pod "swift-proxy-5f4bc687f4-xcf5c" (UID: "21a5384d-c9cf-429c-9e7e-cc9fb2a825b9") : secret "cert-swift-internal-svc" not found Mar 16 17:00:19 crc kubenswrapper[5120]: I0316 17:00:19.932347 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"55f7f374-c6b2-422b-90bd-a7dcc936e74f","Type":"ContainerStarted","Data":"3a8540189ac4b61cc8961e4e6f1bd0b50460a59e9a3da28c3f5cb5d2109ddf3f"} Mar 16 17:00:19 crc kubenswrapper[5120]: I0316 17:00:19.932644 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"55f7f374-c6b2-422b-90bd-a7dcc936e74f","Type":"ContainerStarted","Data":"09bbf68572dda98d0eba8758d9ca27ed1d096829ca22317239ce3b4204cf1485"} Mar 16 17:00:19 crc kubenswrapper[5120]: I0316 17:00:19.938563 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"447b243b-6b80-4883-9844-f49d3f2f4a22","Type":"ContainerStarted","Data":"9ffb7d4c0f767f982e7526ce10b289cd90603393d82c612888bce9bf3709ecce"} Mar 16 17:00:19 crc kubenswrapper[5120]: I0316 17:00:19.944747 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"07433ec1-a6dc-48a4-8374-8260c23db816","Type":"ContainerStarted","Data":"c2c1a9748e9ea2942668489224606d646bc848231e5d479039bf6c1c2906c46c"} Mar 16 17:00:19 crc kubenswrapper[5120]: I0316 17:00:19.944816 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"07433ec1-a6dc-48a4-8374-8260c23db816","Type":"ContainerStarted","Data":"b7185365438c501fea659d44b0265e1ac0ff2a84cf85471c746ee7f483aa0b4e"} Mar 16 17:00:20 crc kubenswrapper[5120]: I0316 17:00:20.978196 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"55f7f374-c6b2-422b-90bd-a7dcc936e74f","Type":"ContainerStarted","Data":"7c8283b18df5600672951ca55dfc7a2133e3c633c2c87ee077597e69c0583de6"} Mar 16 17:00:20 crc kubenswrapper[5120]: I0316 17:00:20.983056 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"447b243b-6b80-4883-9844-f49d3f2f4a22","Type":"ContainerStarted","Data":"5af1b89049fce0d163cf34818a7156ce0fb2fde2aea842a3668857248b70d770"} Mar 16 17:00:20 crc kubenswrapper[5120]: I0316 17:00:20.986949 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"07433ec1-a6dc-48a4-8374-8260c23db816","Type":"ContainerStarted","Data":"7b707ffbba30ff002e830acdf2190ce1b9f026c0222d528d2f44fc799f718492"} Mar 16 17:00:21 crc kubenswrapper[5120]: I0316 17:00:21.029545 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-internal-api-0" podStartSLOduration=3.029521678 podStartE2EDuration="3.029521678s" podCreationTimestamp="2026-03-16 17:00:18 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:00:21.002898849 +0000 UTC m=+5323.156830516" watchObservedRunningTime="2026-03-16 17:00:21.029521678 +0000 UTC m=+5323.183453335" Mar 16 17:00:21 crc kubenswrapper[5120]: I0316 17:00:21.043854 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-external-api-0" podStartSLOduration=4.043833799 podStartE2EDuration="4.043833799s" podCreationTimestamp="2026-03-16 17:00:17 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:00:21.025525208 +0000 UTC m=+5323.179456875" watchObservedRunningTime="2026-03-16 17:00:21.043833799 +0000 UTC m=+5323.197765456" Mar 16 17:00:21 crc kubenswrapper[5120]: I0316 17:00:21.143665 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:00:21 crc kubenswrapper[5120]: I0316 17:00:21.163584 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:00:21 crc kubenswrapper[5120]: I0316 17:00:21.318741 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:00:21 crc kubenswrapper[5120]: E0316 17:00:21.758702 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-ovndbcluster-sb-ovndbs: secret "cert-ovndbcluster-sb-ovndbs" not found Mar 16 17:00:21 crc kubenswrapper[5120]: E0316 17:00:21.759045 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c26be62-517d-41f5-bb6f-2c75cf93c96a-ovsdbserver-sb-tls-certs podName:3c26be62-517d-41f5-bb6f-2c75cf93c96a nodeName:}" failed. No retries permitted until 2026-03-16 17:00:22.259028645 +0000 UTC m=+5324.412960302 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ovsdbserver-sb-tls-certs" (UniqueName: "kubernetes.io/secret/3c26be62-517d-41f5-bb6f-2c75cf93c96a-ovsdbserver-sb-tls-certs") pod "ovsdbserver-sb-0" (UID: "3c26be62-517d-41f5-bb6f-2c75cf93c96a") : secret "cert-ovndbcluster-sb-ovndbs" not found Mar 16 17:00:21 crc kubenswrapper[5120]: I0316 17:00:21.904963 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 17:00:21 crc kubenswrapper[5120]: I0316 17:00:21.907034 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podUID="030b8d76-31d4-45e0-8be6-3d946e372b0e" containerName="openstack-network-exporter" containerID="cri-o://f94bcfa431812ba604d23cd37383a05f200c37f02394f6a653384916c3ebed2f" gracePeriod=300 Mar 16 17:00:21 crc kubenswrapper[5120]: I0316 17:00:21.962498 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podUID="030b8d76-31d4-45e0-8be6-3d946e372b0e" containerName="ovsdbserver-nb" containerID="cri-o://cd6c384064abb1937ac187a4baf4248f69fd3cc6839f07e61fb7096814d0b5bd" gracePeriod=300 Mar 16 17:00:22 crc kubenswrapper[5120]: E0316 17:00:22.277784 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-ovndbcluster-sb-ovndbs: secret "cert-ovndbcluster-sb-ovndbs" not found Mar 16 17:00:22 crc kubenswrapper[5120]: E0316 17:00:22.278245 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c26be62-517d-41f5-bb6f-2c75cf93c96a-ovsdbserver-sb-tls-certs podName:3c26be62-517d-41f5-bb6f-2c75cf93c96a nodeName:}" failed. No retries permitted until 2026-03-16 17:00:23.278221156 +0000 UTC m=+5325.432152813 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "ovsdbserver-sb-tls-certs" (UniqueName: "kubernetes.io/secret/3c26be62-517d-41f5-bb6f-2c75cf93c96a-ovsdbserver-sb-tls-certs") pod "ovsdbserver-sb-0" (UID: "3c26be62-517d-41f5-bb6f-2c75cf93c96a") : secret "cert-ovndbcluster-sb-ovndbs" not found Mar 16 17:00:22 crc kubenswrapper[5120]: I0316 17:00:22.447924 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_030b8d76-31d4-45e0-8be6-3d946e372b0e/ovsdbserver-nb/0.log" Mar 16 17:00:22 crc kubenswrapper[5120]: I0316 17:00:22.447996 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:00:22 crc kubenswrapper[5120]: I0316 17:00:22.481454 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/030b8d76-31d4-45e0-8be6-3d946e372b0e-ovsdbserver-nb-tls-certs\") pod \"030b8d76-31d4-45e0-8be6-3d946e372b0e\" (UID: \"030b8d76-31d4-45e0-8be6-3d946e372b0e\") " Mar 16 17:00:22 crc kubenswrapper[5120]: I0316 17:00:22.481507 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/030b8d76-31d4-45e0-8be6-3d946e372b0e-ovsdb-rundir\") pod \"030b8d76-31d4-45e0-8be6-3d946e372b0e\" (UID: \"030b8d76-31d4-45e0-8be6-3d946e372b0e\") " Mar 16 17:00:22 crc kubenswrapper[5120]: I0316 17:00:22.482277 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/030b8d76-31d4-45e0-8be6-3d946e372b0e-ovsdb-rundir" (OuterVolumeSpecName: "ovsdb-rundir") pod "030b8d76-31d4-45e0-8be6-3d946e372b0e" (UID: "030b8d76-31d4-45e0-8be6-3d946e372b0e"). InnerVolumeSpecName "ovsdb-rundir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:00:22 crc kubenswrapper[5120]: I0316 17:00:22.481643 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/030b8d76-31d4-45e0-8be6-3d946e372b0e-config\") pod \"030b8d76-31d4-45e0-8be6-3d946e372b0e\" (UID: \"030b8d76-31d4-45e0-8be6-3d946e372b0e\") " Mar 16 17:00:22 crc kubenswrapper[5120]: I0316 17:00:22.482380 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovndbcluster-nb-etc-ovn\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"030b8d76-31d4-45e0-8be6-3d946e372b0e\" (UID: \"030b8d76-31d4-45e0-8be6-3d946e372b0e\") " Mar 16 17:00:22 crc kubenswrapper[5120]: I0316 17:00:22.483264 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/030b8d76-31d4-45e0-8be6-3d946e372b0e-combined-ca-bundle\") pod \"030b8d76-31d4-45e0-8be6-3d946e372b0e\" (UID: \"030b8d76-31d4-45e0-8be6-3d946e372b0e\") " Mar 16 17:00:22 crc kubenswrapper[5120]: I0316 17:00:22.483473 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/030b8d76-31d4-45e0-8be6-3d946e372b0e-scripts\") pod \"030b8d76-31d4-45e0-8be6-3d946e372b0e\" (UID: \"030b8d76-31d4-45e0-8be6-3d946e372b0e\") " Mar 16 17:00:22 crc kubenswrapper[5120]: I0316 17:00:22.483952 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/030b8d76-31d4-45e0-8be6-3d946e372b0e-config" (OuterVolumeSpecName: "config") pod "030b8d76-31d4-45e0-8be6-3d946e372b0e" (UID: "030b8d76-31d4-45e0-8be6-3d946e372b0e"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:00:22 crc kubenswrapper[5120]: I0316 17:00:22.484525 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/030b8d76-31d4-45e0-8be6-3d946e372b0e-scripts" (OuterVolumeSpecName: "scripts") pod "030b8d76-31d4-45e0-8be6-3d946e372b0e" (UID: "030b8d76-31d4-45e0-8be6-3d946e372b0e"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:00:22 crc kubenswrapper[5120]: I0316 17:00:22.484967 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/030b8d76-31d4-45e0-8be6-3d946e372b0e-metrics-certs-tls-certs\") pod \"030b8d76-31d4-45e0-8be6-3d946e372b0e\" (UID: \"030b8d76-31d4-45e0-8be6-3d946e372b0e\") " Mar 16 17:00:22 crc kubenswrapper[5120]: I0316 17:00:22.485059 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6vrf4\" (UniqueName: \"kubernetes.io/projected/030b8d76-31d4-45e0-8be6-3d946e372b0e-kube-api-access-6vrf4\") pod \"030b8d76-31d4-45e0-8be6-3d946e372b0e\" (UID: \"030b8d76-31d4-45e0-8be6-3d946e372b0e\") " Mar 16 17:00:22 crc kubenswrapper[5120]: I0316 17:00:22.512410 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/030b8d76-31d4-45e0-8be6-3d946e372b0e-kube-api-access-6vrf4" (OuterVolumeSpecName: "kube-api-access-6vrf4") pod "030b8d76-31d4-45e0-8be6-3d946e372b0e" (UID: "030b8d76-31d4-45e0-8be6-3d946e372b0e"). InnerVolumeSpecName "kube-api-access-6vrf4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:00:22 crc kubenswrapper[5120]: I0316 17:00:22.520601 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage08-crc" (OuterVolumeSpecName: "ovndbcluster-nb-etc-ovn") pod "030b8d76-31d4-45e0-8be6-3d946e372b0e" (UID: "030b8d76-31d4-45e0-8be6-3d946e372b0e"). InnerVolumeSpecName "local-storage08-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 17:00:22 crc kubenswrapper[5120]: I0316 17:00:22.521267 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/030b8d76-31d4-45e0-8be6-3d946e372b0e-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:22 crc kubenswrapper[5120]: I0316 17:00:22.521289 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6vrf4\" (UniqueName: \"kubernetes.io/projected/030b8d76-31d4-45e0-8be6-3d946e372b0e-kube-api-access-6vrf4\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:22 crc kubenswrapper[5120]: I0316 17:00:22.521299 5120 reconciler_common.go:299] "Volume detached for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/030b8d76-31d4-45e0-8be6-3d946e372b0e-ovsdb-rundir\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:22 crc kubenswrapper[5120]: I0316 17:00:22.521309 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/030b8d76-31d4-45e0-8be6-3d946e372b0e-config\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:22 crc kubenswrapper[5120]: I0316 17:00:22.521329 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") on node \"crc\" " Mar 16 17:00:22 crc kubenswrapper[5120]: I0316 17:00:22.558043 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/030b8d76-31d4-45e0-8be6-3d946e372b0e-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "030b8d76-31d4-45e0-8be6-3d946e372b0e" (UID: "030b8d76-31d4-45e0-8be6-3d946e372b0e"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:22 crc kubenswrapper[5120]: I0316 17:00:22.579093 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage08-crc" (UniqueName: "kubernetes.io/local-volume/local-storage08-crc") on node "crc" Mar 16 17:00:22 crc kubenswrapper[5120]: I0316 17:00:22.620886 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/030b8d76-31d4-45e0-8be6-3d946e372b0e-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "030b8d76-31d4-45e0-8be6-3d946e372b0e" (UID: "030b8d76-31d4-45e0-8be6-3d946e372b0e"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:22 crc kubenswrapper[5120]: I0316 17:00:22.624539 5120 reconciler_common.go:299] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/030b8d76-31d4-45e0-8be6-3d946e372b0e-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:22 crc kubenswrapper[5120]: I0316 17:00:22.624583 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:22 crc kubenswrapper[5120]: I0316 17:00:22.624623 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/030b8d76-31d4-45e0-8be6-3d946e372b0e-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:22 crc kubenswrapper[5120]: I0316 17:00:22.650029 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/030b8d76-31d4-45e0-8be6-3d946e372b0e-ovsdbserver-nb-tls-certs" (OuterVolumeSpecName: "ovsdbserver-nb-tls-certs") pod "030b8d76-31d4-45e0-8be6-3d946e372b0e" (UID: "030b8d76-31d4-45e0-8be6-3d946e372b0e"). InnerVolumeSpecName "ovsdbserver-nb-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:22 crc kubenswrapper[5120]: I0316 17:00:22.727731 5120 reconciler_common.go:299] "Volume detached for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/030b8d76-31d4-45e0-8be6-3d946e372b0e-ovsdbserver-nb-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:23 crc kubenswrapper[5120]: I0316 17:00:23.010855 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_030b8d76-31d4-45e0-8be6-3d946e372b0e/ovsdbserver-nb/0.log" Mar 16 17:00:23 crc kubenswrapper[5120]: I0316 17:00:23.011158 5120 generic.go:358] "Generic (PLEG): container finished" podID="030b8d76-31d4-45e0-8be6-3d946e372b0e" containerID="f94bcfa431812ba604d23cd37383a05f200c37f02394f6a653384916c3ebed2f" exitCode=2 Mar 16 17:00:23 crc kubenswrapper[5120]: I0316 17:00:23.011174 5120 generic.go:358] "Generic (PLEG): container finished" podID="030b8d76-31d4-45e0-8be6-3d946e372b0e" containerID="cd6c384064abb1937ac187a4baf4248f69fd3cc6839f07e61fb7096814d0b5bd" exitCode=143 Mar 16 17:00:23 crc kubenswrapper[5120]: I0316 17:00:23.011327 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:00:23 crc kubenswrapper[5120]: I0316 17:00:23.011329 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"030b8d76-31d4-45e0-8be6-3d946e372b0e","Type":"ContainerDied","Data":"f94bcfa431812ba604d23cd37383a05f200c37f02394f6a653384916c3ebed2f"} Mar 16 17:00:23 crc kubenswrapper[5120]: I0316 17:00:23.011398 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"030b8d76-31d4-45e0-8be6-3d946e372b0e","Type":"ContainerDied","Data":"cd6c384064abb1937ac187a4baf4248f69fd3cc6839f07e61fb7096814d0b5bd"} Mar 16 17:00:23 crc kubenswrapper[5120]: I0316 17:00:23.011414 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"030b8d76-31d4-45e0-8be6-3d946e372b0e","Type":"ContainerDied","Data":"cb9f9041b25ce239bd2c7a3f251bc4d69106e70f2cccdd5b0f03a65de35438a1"} Mar 16 17:00:23 crc kubenswrapper[5120]: I0316 17:00:23.011437 5120 scope.go:117] "RemoveContainer" containerID="f94bcfa431812ba604d23cd37383a05f200c37f02394f6a653384916c3ebed2f" Mar 16 17:00:23 crc kubenswrapper[5120]: I0316 17:00:23.037537 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 17:00:23 crc kubenswrapper[5120]: I0316 17:00:23.046870 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 17:00:23 crc kubenswrapper[5120]: I0316 17:00:23.047347 5120 scope.go:117] "RemoveContainer" containerID="cd6c384064abb1937ac187a4baf4248f69fd3cc6839f07e61fb7096814d0b5bd" Mar 16 17:00:23 crc kubenswrapper[5120]: I0316 17:00:23.072004 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 17:00:23 crc kubenswrapper[5120]: I0316 17:00:23.073551 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="030b8d76-31d4-45e0-8be6-3d946e372b0e" containerName="openstack-network-exporter" Mar 16 17:00:23 crc kubenswrapper[5120]: I0316 17:00:23.073581 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="030b8d76-31d4-45e0-8be6-3d946e372b0e" containerName="openstack-network-exporter" Mar 16 17:00:23 crc kubenswrapper[5120]: I0316 17:00:23.073679 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="030b8d76-31d4-45e0-8be6-3d946e372b0e" containerName="ovsdbserver-nb" Mar 16 17:00:23 crc kubenswrapper[5120]: I0316 17:00:23.073691 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="030b8d76-31d4-45e0-8be6-3d946e372b0e" containerName="ovsdbserver-nb" Mar 16 17:00:23 crc kubenswrapper[5120]: I0316 17:00:23.073935 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="030b8d76-31d4-45e0-8be6-3d946e372b0e" containerName="ovsdbserver-nb" Mar 16 17:00:23 crc kubenswrapper[5120]: I0316 17:00:23.073982 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="030b8d76-31d4-45e0-8be6-3d946e372b0e" containerName="openstack-network-exporter" Mar 16 17:00:23 crc kubenswrapper[5120]: I0316 17:00:23.112324 5120 scope.go:117] "RemoveContainer" containerID="f94bcfa431812ba604d23cd37383a05f200c37f02394f6a653384916c3ebed2f" Mar 16 17:00:23 crc kubenswrapper[5120]: E0316 17:00:23.115978 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f94bcfa431812ba604d23cd37383a05f200c37f02394f6a653384916c3ebed2f\": container with ID starting with f94bcfa431812ba604d23cd37383a05f200c37f02394f6a653384916c3ebed2f not found: ID does not exist" containerID="f94bcfa431812ba604d23cd37383a05f200c37f02394f6a653384916c3ebed2f" Mar 16 17:00:23 crc kubenswrapper[5120]: I0316 17:00:23.116042 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f94bcfa431812ba604d23cd37383a05f200c37f02394f6a653384916c3ebed2f"} err="failed to get container status \"f94bcfa431812ba604d23cd37383a05f200c37f02394f6a653384916c3ebed2f\": rpc error: code = NotFound desc = could not find container \"f94bcfa431812ba604d23cd37383a05f200c37f02394f6a653384916c3ebed2f\": container with ID starting with f94bcfa431812ba604d23cd37383a05f200c37f02394f6a653384916c3ebed2f not found: ID does not exist" Mar 16 17:00:23 crc kubenswrapper[5120]: I0316 17:00:23.116076 5120 scope.go:117] "RemoveContainer" containerID="cd6c384064abb1937ac187a4baf4248f69fd3cc6839f07e61fb7096814d0b5bd" Mar 16 17:00:23 crc kubenswrapper[5120]: E0316 17:00:23.116451 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd6c384064abb1937ac187a4baf4248f69fd3cc6839f07e61fb7096814d0b5bd\": container with ID starting with cd6c384064abb1937ac187a4baf4248f69fd3cc6839f07e61fb7096814d0b5bd not found: ID does not exist" containerID="cd6c384064abb1937ac187a4baf4248f69fd3cc6839f07e61fb7096814d0b5bd" Mar 16 17:00:23 crc kubenswrapper[5120]: I0316 17:00:23.116504 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd6c384064abb1937ac187a4baf4248f69fd3cc6839f07e61fb7096814d0b5bd"} err="failed to get container status \"cd6c384064abb1937ac187a4baf4248f69fd3cc6839f07e61fb7096814d0b5bd\": rpc error: code = NotFound desc = could not find container \"cd6c384064abb1937ac187a4baf4248f69fd3cc6839f07e61fb7096814d0b5bd\": container with ID starting with cd6c384064abb1937ac187a4baf4248f69fd3cc6839f07e61fb7096814d0b5bd not found: ID does not exist" Mar 16 17:00:23 crc kubenswrapper[5120]: I0316 17:00:23.116541 5120 scope.go:117] "RemoveContainer" containerID="f94bcfa431812ba604d23cd37383a05f200c37f02394f6a653384916c3ebed2f" Mar 16 17:00:23 crc kubenswrapper[5120]: I0316 17:00:23.117053 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f94bcfa431812ba604d23cd37383a05f200c37f02394f6a653384916c3ebed2f"} err="failed to get container status \"f94bcfa431812ba604d23cd37383a05f200c37f02394f6a653384916c3ebed2f\": rpc error: code = NotFound desc = could not find container \"f94bcfa431812ba604d23cd37383a05f200c37f02394f6a653384916c3ebed2f\": container with ID starting with f94bcfa431812ba604d23cd37383a05f200c37f02394f6a653384916c3ebed2f not found: ID does not exist" Mar 16 17:00:23 crc kubenswrapper[5120]: I0316 17:00:23.117078 5120 scope.go:117] "RemoveContainer" containerID="cd6c384064abb1937ac187a4baf4248f69fd3cc6839f07e61fb7096814d0b5bd" Mar 16 17:00:23 crc kubenswrapper[5120]: I0316 17:00:23.117318 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd6c384064abb1937ac187a4baf4248f69fd3cc6839f07e61fb7096814d0b5bd"} err="failed to get container status \"cd6c384064abb1937ac187a4baf4248f69fd3cc6839f07e61fb7096814d0b5bd\": rpc error: code = NotFound desc = could not find container \"cd6c384064abb1937ac187a4baf4248f69fd3cc6839f07e61fb7096814d0b5bd\": container with ID starting with cd6c384064abb1937ac187a4baf4248f69fd3cc6839f07e61fb7096814d0b5bd not found: ID does not exist" Mar 16 17:00:23 crc kubenswrapper[5120]: I0316 17:00:23.172943 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 17:00:23 crc kubenswrapper[5120]: I0316 17:00:23.173079 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:00:23 crc kubenswrapper[5120]: I0316 17:00:23.175397 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ovndbcluster-nb-ovndbs\"" Mar 16 17:00:23 crc kubenswrapper[5120]: I0316 17:00:23.175945 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovndbcluster-nb-config\"" Mar 16 17:00:23 crc kubenswrapper[5120]: I0316 17:00:23.176031 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ovncluster-ovndbcluster-nb-dockercfg-8zd6v\"" Mar 16 17:00:23 crc kubenswrapper[5120]: I0316 17:00:23.176246 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovndbcluster-nb-scripts\"" Mar 16 17:00:23 crc kubenswrapper[5120]: I0316 17:00:23.241788 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4ae0ee71-cb7b-4458-9176-1a941416c653-config\") pod \"ovsdbserver-nb-0\" (UID: \"4ae0ee71-cb7b-4458-9176-1a941416c653\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:00:23 crc kubenswrapper[5120]: I0316 17:00:23.241967 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4ae0ee71-cb7b-4458-9176-1a941416c653-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"4ae0ee71-cb7b-4458-9176-1a941416c653\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:00:23 crc kubenswrapper[5120]: I0316 17:00:23.242028 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/4ae0ee71-cb7b-4458-9176-1a941416c653-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"4ae0ee71-cb7b-4458-9176-1a941416c653\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:00:23 crc kubenswrapper[5120]: I0316 17:00:23.242124 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/4ae0ee71-cb7b-4458-9176-1a941416c653-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"4ae0ee71-cb7b-4458-9176-1a941416c653\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:00:23 crc kubenswrapper[5120]: I0316 17:00:23.242204 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"ovsdbserver-nb-0\" (UID: \"4ae0ee71-cb7b-4458-9176-1a941416c653\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:00:23 crc kubenswrapper[5120]: I0316 17:00:23.242236 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/4ae0ee71-cb7b-4458-9176-1a941416c653-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"4ae0ee71-cb7b-4458-9176-1a941416c653\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:00:23 crc kubenswrapper[5120]: I0316 17:00:23.242268 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/4ae0ee71-cb7b-4458-9176-1a941416c653-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"4ae0ee71-cb7b-4458-9176-1a941416c653\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:00:23 crc kubenswrapper[5120]: I0316 17:00:23.242319 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzxhj\" (UniqueName: \"kubernetes.io/projected/4ae0ee71-cb7b-4458-9176-1a941416c653-kube-api-access-dzxhj\") pod \"ovsdbserver-nb-0\" (UID: \"4ae0ee71-cb7b-4458-9176-1a941416c653\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:00:23 crc kubenswrapper[5120]: I0316 17:00:23.344707 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"ovsdbserver-nb-0\" (UID: \"4ae0ee71-cb7b-4458-9176-1a941416c653\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:00:23 crc kubenswrapper[5120]: I0316 17:00:23.344798 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/4ae0ee71-cb7b-4458-9176-1a941416c653-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"4ae0ee71-cb7b-4458-9176-1a941416c653\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:00:23 crc kubenswrapper[5120]: I0316 17:00:23.344839 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/4ae0ee71-cb7b-4458-9176-1a941416c653-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"4ae0ee71-cb7b-4458-9176-1a941416c653\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:00:23 crc kubenswrapper[5120]: I0316 17:00:23.344902 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dzxhj\" (UniqueName: \"kubernetes.io/projected/4ae0ee71-cb7b-4458-9176-1a941416c653-kube-api-access-dzxhj\") pod \"ovsdbserver-nb-0\" (UID: \"4ae0ee71-cb7b-4458-9176-1a941416c653\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:00:23 crc kubenswrapper[5120]: I0316 17:00:23.345037 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4ae0ee71-cb7b-4458-9176-1a941416c653-config\") pod \"ovsdbserver-nb-0\" (UID: \"4ae0ee71-cb7b-4458-9176-1a941416c653\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:00:23 crc kubenswrapper[5120]: I0316 17:00:23.345149 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"ovsdbserver-nb-0\" (UID: \"4ae0ee71-cb7b-4458-9176-1a941416c653\") device mount path \"/mnt/openstack/pv08\"" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:00:23 crc kubenswrapper[5120]: I0316 17:00:23.345176 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4ae0ee71-cb7b-4458-9176-1a941416c653-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"4ae0ee71-cb7b-4458-9176-1a941416c653\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:00:23 crc kubenswrapper[5120]: I0316 17:00:23.345237 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/4ae0ee71-cb7b-4458-9176-1a941416c653-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"4ae0ee71-cb7b-4458-9176-1a941416c653\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:00:23 crc kubenswrapper[5120]: I0316 17:00:23.345348 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/4ae0ee71-cb7b-4458-9176-1a941416c653-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"4ae0ee71-cb7b-4458-9176-1a941416c653\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:00:23 crc kubenswrapper[5120]: E0316 17:00:23.345632 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-ovndbcluster-sb-ovndbs: secret "cert-ovndbcluster-sb-ovndbs" not found Mar 16 17:00:23 crc kubenswrapper[5120]: E0316 17:00:23.345720 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c26be62-517d-41f5-bb6f-2c75cf93c96a-ovsdbserver-sb-tls-certs podName:3c26be62-517d-41f5-bb6f-2c75cf93c96a nodeName:}" failed. No retries permitted until 2026-03-16 17:00:25.345697643 +0000 UTC m=+5327.499629300 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "ovsdbserver-sb-tls-certs" (UniqueName: "kubernetes.io/secret/3c26be62-517d-41f5-bb6f-2c75cf93c96a-ovsdbserver-sb-tls-certs") pod "ovsdbserver-sb-0" (UID: "3c26be62-517d-41f5-bb6f-2c75cf93c96a") : secret "cert-ovndbcluster-sb-ovndbs" not found Mar 16 17:00:23 crc kubenswrapper[5120]: I0316 17:00:23.345749 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4ae0ee71-cb7b-4458-9176-1a941416c653-config\") pod \"ovsdbserver-nb-0\" (UID: \"4ae0ee71-cb7b-4458-9176-1a941416c653\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:00:23 crc kubenswrapper[5120]: I0316 17:00:23.345988 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/4ae0ee71-cb7b-4458-9176-1a941416c653-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"4ae0ee71-cb7b-4458-9176-1a941416c653\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:00:23 crc kubenswrapper[5120]: I0316 17:00:23.346082 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/4ae0ee71-cb7b-4458-9176-1a941416c653-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"4ae0ee71-cb7b-4458-9176-1a941416c653\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:00:23 crc kubenswrapper[5120]: I0316 17:00:23.350751 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4ae0ee71-cb7b-4458-9176-1a941416c653-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"4ae0ee71-cb7b-4458-9176-1a941416c653\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:00:23 crc kubenswrapper[5120]: I0316 17:00:23.353971 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/4ae0ee71-cb7b-4458-9176-1a941416c653-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"4ae0ee71-cb7b-4458-9176-1a941416c653\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:00:23 crc kubenswrapper[5120]: I0316 17:00:23.359738 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/4ae0ee71-cb7b-4458-9176-1a941416c653-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"4ae0ee71-cb7b-4458-9176-1a941416c653\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:00:23 crc kubenswrapper[5120]: I0316 17:00:23.367585 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzxhj\" (UniqueName: \"kubernetes.io/projected/4ae0ee71-cb7b-4458-9176-1a941416c653-kube-api-access-dzxhj\") pod \"ovsdbserver-nb-0\" (UID: \"4ae0ee71-cb7b-4458-9176-1a941416c653\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:00:23 crc kubenswrapper[5120]: I0316 17:00:23.379858 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"ovsdbserver-nb-0\" (UID: \"4ae0ee71-cb7b-4458-9176-1a941416c653\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:00:23 crc kubenswrapper[5120]: I0316 17:00:23.493505 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:00:23 crc kubenswrapper[5120]: I0316 17:00:23.761484 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 17:00:23 crc kubenswrapper[5120]: I0316 17:00:23.762309 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podUID="3c26be62-517d-41f5-bb6f-2c75cf93c96a" containerName="openstack-network-exporter" containerID="cri-o://0c5a2135fb60242e596a2bc08da044df6460929a10d8be846b4883f1540ead45" gracePeriod=300 Mar 16 17:00:23 crc kubenswrapper[5120]: I0316 17:00:23.825215 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podUID="3c26be62-517d-41f5-bb6f-2c75cf93c96a" containerName="ovsdbserver-sb" containerID="cri-o://1aaf59914fc1561cebdf52d0de00dcac1dd1c216925d669b493f5a808b6e98f8" gracePeriod=300 Mar 16 17:00:23 crc kubenswrapper[5120]: I0316 17:00:23.912963 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/memcached-0" Mar 16 17:00:23 crc kubenswrapper[5120]: W0316 17:00:23.979166 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4ae0ee71_cb7b_4458_9176_1a941416c653.slice/crio-222ff7565ff2ea851a55d8addae5c28034ed18c8500a809c938a61566ef88ace WatchSource:0}: Error finding container 222ff7565ff2ea851a55d8addae5c28034ed18c8500a809c938a61566ef88ace: Status 404 returned error can't find the container with id 222ff7565ff2ea851a55d8addae5c28034ed18c8500a809c938a61566ef88ace Mar 16 17:00:24 crc kubenswrapper[5120]: I0316 17:00:24.002661 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 17:00:24 crc kubenswrapper[5120]: I0316 17:00:24.046259 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_3c26be62-517d-41f5-bb6f-2c75cf93c96a/ovsdbserver-sb/0.log" Mar 16 17:00:24 crc kubenswrapper[5120]: I0316 17:00:24.046321 5120 generic.go:358] "Generic (PLEG): container finished" podID="3c26be62-517d-41f5-bb6f-2c75cf93c96a" containerID="0c5a2135fb60242e596a2bc08da044df6460929a10d8be846b4883f1540ead45" exitCode=2 Mar 16 17:00:24 crc kubenswrapper[5120]: I0316 17:00:24.046344 5120 generic.go:358] "Generic (PLEG): container finished" podID="3c26be62-517d-41f5-bb6f-2c75cf93c96a" containerID="1aaf59914fc1561cebdf52d0de00dcac1dd1c216925d669b493f5a808b6e98f8" exitCode=143 Mar 16 17:00:24 crc kubenswrapper[5120]: I0316 17:00:24.046707 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"3c26be62-517d-41f5-bb6f-2c75cf93c96a","Type":"ContainerDied","Data":"0c5a2135fb60242e596a2bc08da044df6460929a10d8be846b4883f1540ead45"} Mar 16 17:00:24 crc kubenswrapper[5120]: I0316 17:00:24.046747 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"3c26be62-517d-41f5-bb6f-2c75cf93c96a","Type":"ContainerDied","Data":"1aaf59914fc1561cebdf52d0de00dcac1dd1c216925d669b493f5a808b6e98f8"} Mar 16 17:00:24 crc kubenswrapper[5120]: I0316 17:00:24.050481 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"4ae0ee71-cb7b-4458-9176-1a941416c653","Type":"ContainerStarted","Data":"222ff7565ff2ea851a55d8addae5c28034ed18c8500a809c938a61566ef88ace"} Mar 16 17:00:24 crc kubenswrapper[5120]: I0316 17:00:24.059149 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"07433ec1-a6dc-48a4-8374-8260c23db816","Type":"ContainerStarted","Data":"e2e1bc3fa454ce2aaa626ec44d02991c8621e7f7302023f4b23a970d86c6d80a"} Mar 16 17:00:24 crc kubenswrapper[5120]: I0316 17:00:24.059361 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="07433ec1-a6dc-48a4-8374-8260c23db816" containerName="ceilometer-central-agent" containerID="cri-o://b7185365438c501fea659d44b0265e1ac0ff2a84cf85471c746ee7f483aa0b4e" gracePeriod=30 Mar 16 17:00:24 crc kubenswrapper[5120]: I0316 17:00:24.059670 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:00:24 crc kubenswrapper[5120]: I0316 17:00:24.060050 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="07433ec1-a6dc-48a4-8374-8260c23db816" containerName="proxy-httpd" containerID="cri-o://e2e1bc3fa454ce2aaa626ec44d02991c8621e7f7302023f4b23a970d86c6d80a" gracePeriod=30 Mar 16 17:00:24 crc kubenswrapper[5120]: I0316 17:00:24.060104 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="07433ec1-a6dc-48a4-8374-8260c23db816" containerName="sg-core" containerID="cri-o://7b707ffbba30ff002e830acdf2190ce1b9f026c0222d528d2f44fc799f718492" gracePeriod=30 Mar 16 17:00:24 crc kubenswrapper[5120]: I0316 17:00:24.060140 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="07433ec1-a6dc-48a4-8374-8260c23db816" containerName="ceilometer-notification-agent" containerID="cri-o://c2c1a9748e9ea2942668489224606d646bc848231e5d479039bf6c1c2906c46c" gracePeriod=30 Mar 16 17:00:24 crc kubenswrapper[5120]: I0316 17:00:24.094078 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 17:00:24 crc kubenswrapper[5120]: I0316 17:00:24.094359 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podUID="ff7f7a87-78b8-4ffa-96fb-5529ad39883f" containerName="nova-cell1-novncproxy-novncproxy" containerID="cri-o://0239c4536046b2029b813fee0ba4d8528cbc6b8b4a900df7ee3237f20798effc" gracePeriod=30 Mar 16 17:00:24 crc kubenswrapper[5120]: I0316 17:00:24.108478 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 17:00:24 crc kubenswrapper[5120]: I0316 17:00:24.109081 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="0e6277f8-02ed-4429-af86-af38266195cd" containerName="nova-api-log" containerID="cri-o://df644605668cb6409e0b440fc58164a055f8c2e58033000e364530db958fe591" gracePeriod=30 Mar 16 17:00:24 crc kubenswrapper[5120]: I0316 17:00:24.109344 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="0e6277f8-02ed-4429-af86-af38266195cd" containerName="nova-api-api" containerID="cri-o://e33012e656c2cd8d2e08efcbaefc5187f1c017846cac5c2b21e89bb0c4991a80" gracePeriod=30 Mar 16 17:00:24 crc kubenswrapper[5120]: I0316 17:00:24.120167 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.874796141 podStartE2EDuration="8.119952045s" podCreationTimestamp="2026-03-16 17:00:16 +0000 UTC" firstStartedPulling="2026-03-16 17:00:17.989073658 +0000 UTC m=+5320.143005315" lastFinishedPulling="2026-03-16 17:00:23.234229562 +0000 UTC m=+5325.388161219" observedRunningTime="2026-03-16 17:00:24.110429734 +0000 UTC m=+5326.264361411" watchObservedRunningTime="2026-03-16 17:00:24.119952045 +0000 UTC m=+5326.273883702" Mar 16 17:00:24 crc kubenswrapper[5120]: I0316 17:00:24.291424 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-6f846b8bfd-w69px"] Mar 16 17:00:24 crc kubenswrapper[5120]: I0316 17:00:24.318925 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-6f846b8bfd-w69px"] Mar 16 17:00:24 crc kubenswrapper[5120]: I0316 17:00:24.319049 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-6f846b8bfd-w69px" Mar 16 17:00:24 crc kubenswrapper[5120]: I0316 17:00:24.394690 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/e3143a49-62b5-408a-8dca-d723f7a31619-ovndb-tls-certs\") pod \"neutron-6f846b8bfd-w69px\" (UID: \"e3143a49-62b5-408a-8dca-d723f7a31619\") " pod="openstack-kuttl-tests/neutron-6f846b8bfd-w69px" Mar 16 17:00:24 crc kubenswrapper[5120]: I0316 17:00:24.394797 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e3143a49-62b5-408a-8dca-d723f7a31619-combined-ca-bundle\") pod \"neutron-6f846b8bfd-w69px\" (UID: \"e3143a49-62b5-408a-8dca-d723f7a31619\") " pod="openstack-kuttl-tests/neutron-6f846b8bfd-w69px" Mar 16 17:00:24 crc kubenswrapper[5120]: I0316 17:00:24.394903 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e3143a49-62b5-408a-8dca-d723f7a31619-public-tls-certs\") pod \"neutron-6f846b8bfd-w69px\" (UID: \"e3143a49-62b5-408a-8dca-d723f7a31619\") " pod="openstack-kuttl-tests/neutron-6f846b8bfd-w69px" Mar 16 17:00:24 crc kubenswrapper[5120]: I0316 17:00:24.394936 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/e3143a49-62b5-408a-8dca-d723f7a31619-httpd-config\") pod \"neutron-6f846b8bfd-w69px\" (UID: \"e3143a49-62b5-408a-8dca-d723f7a31619\") " pod="openstack-kuttl-tests/neutron-6f846b8bfd-w69px" Mar 16 17:00:24 crc kubenswrapper[5120]: I0316 17:00:24.395072 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e3143a49-62b5-408a-8dca-d723f7a31619-config\") pod \"neutron-6f846b8bfd-w69px\" (UID: \"e3143a49-62b5-408a-8dca-d723f7a31619\") " pod="openstack-kuttl-tests/neutron-6f846b8bfd-w69px" Mar 16 17:00:24 crc kubenswrapper[5120]: I0316 17:00:24.395170 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfnnr\" (UniqueName: \"kubernetes.io/projected/e3143a49-62b5-408a-8dca-d723f7a31619-kube-api-access-hfnnr\") pod \"neutron-6f846b8bfd-w69px\" (UID: \"e3143a49-62b5-408a-8dca-d723f7a31619\") " pod="openstack-kuttl-tests/neutron-6f846b8bfd-w69px" Mar 16 17:00:24 crc kubenswrapper[5120]: I0316 17:00:24.395523 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e3143a49-62b5-408a-8dca-d723f7a31619-internal-tls-certs\") pod \"neutron-6f846b8bfd-w69px\" (UID: \"e3143a49-62b5-408a-8dca-d723f7a31619\") " pod="openstack-kuttl-tests/neutron-6f846b8bfd-w69px" Mar 16 17:00:24 crc kubenswrapper[5120]: I0316 17:00:24.470789 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_3c26be62-517d-41f5-bb6f-2c75cf93c96a/ovsdbserver-sb/0.log" Mar 16 17:00:24 crc kubenswrapper[5120]: I0316 17:00:24.470874 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:00:24 crc kubenswrapper[5120]: I0316 17:00:24.497686 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hfnnr\" (UniqueName: \"kubernetes.io/projected/e3143a49-62b5-408a-8dca-d723f7a31619-kube-api-access-hfnnr\") pod \"neutron-6f846b8bfd-w69px\" (UID: \"e3143a49-62b5-408a-8dca-d723f7a31619\") " pod="openstack-kuttl-tests/neutron-6f846b8bfd-w69px" Mar 16 17:00:24 crc kubenswrapper[5120]: I0316 17:00:24.497921 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e3143a49-62b5-408a-8dca-d723f7a31619-internal-tls-certs\") pod \"neutron-6f846b8bfd-w69px\" (UID: \"e3143a49-62b5-408a-8dca-d723f7a31619\") " pod="openstack-kuttl-tests/neutron-6f846b8bfd-w69px" Mar 16 17:00:24 crc kubenswrapper[5120]: I0316 17:00:24.498142 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/e3143a49-62b5-408a-8dca-d723f7a31619-ovndb-tls-certs\") pod \"neutron-6f846b8bfd-w69px\" (UID: \"e3143a49-62b5-408a-8dca-d723f7a31619\") " pod="openstack-kuttl-tests/neutron-6f846b8bfd-w69px" Mar 16 17:00:24 crc kubenswrapper[5120]: I0316 17:00:24.498201 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e3143a49-62b5-408a-8dca-d723f7a31619-combined-ca-bundle\") pod \"neutron-6f846b8bfd-w69px\" (UID: \"e3143a49-62b5-408a-8dca-d723f7a31619\") " pod="openstack-kuttl-tests/neutron-6f846b8bfd-w69px" Mar 16 17:00:24 crc kubenswrapper[5120]: I0316 17:00:24.498292 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e3143a49-62b5-408a-8dca-d723f7a31619-public-tls-certs\") pod \"neutron-6f846b8bfd-w69px\" (UID: \"e3143a49-62b5-408a-8dca-d723f7a31619\") " pod="openstack-kuttl-tests/neutron-6f846b8bfd-w69px" Mar 16 17:00:24 crc kubenswrapper[5120]: I0316 17:00:24.498330 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/e3143a49-62b5-408a-8dca-d723f7a31619-httpd-config\") pod \"neutron-6f846b8bfd-w69px\" (UID: \"e3143a49-62b5-408a-8dca-d723f7a31619\") " pod="openstack-kuttl-tests/neutron-6f846b8bfd-w69px" Mar 16 17:00:24 crc kubenswrapper[5120]: I0316 17:00:24.498478 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e3143a49-62b5-408a-8dca-d723f7a31619-config\") pod \"neutron-6f846b8bfd-w69px\" (UID: \"e3143a49-62b5-408a-8dca-d723f7a31619\") " pod="openstack-kuttl-tests/neutron-6f846b8bfd-w69px" Mar 16 17:00:24 crc kubenswrapper[5120]: I0316 17:00:24.503124 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/e3143a49-62b5-408a-8dca-d723f7a31619-config\") pod \"neutron-6f846b8bfd-w69px\" (UID: \"e3143a49-62b5-408a-8dca-d723f7a31619\") " pod="openstack-kuttl-tests/neutron-6f846b8bfd-w69px" Mar 16 17:00:24 crc kubenswrapper[5120]: I0316 17:00:24.520884 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e3143a49-62b5-408a-8dca-d723f7a31619-public-tls-certs\") pod \"neutron-6f846b8bfd-w69px\" (UID: \"e3143a49-62b5-408a-8dca-d723f7a31619\") " pod="openstack-kuttl-tests/neutron-6f846b8bfd-w69px" Mar 16 17:00:24 crc kubenswrapper[5120]: I0316 17:00:24.524171 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e3143a49-62b5-408a-8dca-d723f7a31619-combined-ca-bundle\") pod \"neutron-6f846b8bfd-w69px\" (UID: \"e3143a49-62b5-408a-8dca-d723f7a31619\") " pod="openstack-kuttl-tests/neutron-6f846b8bfd-w69px" Mar 16 17:00:24 crc kubenswrapper[5120]: I0316 17:00:24.525332 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/e3143a49-62b5-408a-8dca-d723f7a31619-ovndb-tls-certs\") pod \"neutron-6f846b8bfd-w69px\" (UID: \"e3143a49-62b5-408a-8dca-d723f7a31619\") " pod="openstack-kuttl-tests/neutron-6f846b8bfd-w69px" Mar 16 17:00:24 crc kubenswrapper[5120]: I0316 17:00:24.542634 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/e3143a49-62b5-408a-8dca-d723f7a31619-httpd-config\") pod \"neutron-6f846b8bfd-w69px\" (UID: \"e3143a49-62b5-408a-8dca-d723f7a31619\") " pod="openstack-kuttl-tests/neutron-6f846b8bfd-w69px" Mar 16 17:00:24 crc kubenswrapper[5120]: I0316 17:00:24.550966 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfnnr\" (UniqueName: \"kubernetes.io/projected/e3143a49-62b5-408a-8dca-d723f7a31619-kube-api-access-hfnnr\") pod \"neutron-6f846b8bfd-w69px\" (UID: \"e3143a49-62b5-408a-8dca-d723f7a31619\") " pod="openstack-kuttl-tests/neutron-6f846b8bfd-w69px" Mar 16 17:00:24 crc kubenswrapper[5120]: I0316 17:00:24.551711 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e3143a49-62b5-408a-8dca-d723f7a31619-internal-tls-certs\") pod \"neutron-6f846b8bfd-w69px\" (UID: \"e3143a49-62b5-408a-8dca-d723f7a31619\") " pod="openstack-kuttl-tests/neutron-6f846b8bfd-w69px" Mar 16 17:00:24 crc kubenswrapper[5120]: I0316 17:00:24.599816 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/3c26be62-517d-41f5-bb6f-2c75cf93c96a-scripts\") pod \"3c26be62-517d-41f5-bb6f-2c75cf93c96a\" (UID: \"3c26be62-517d-41f5-bb6f-2c75cf93c96a\") " Mar 16 17:00:24 crc kubenswrapper[5120]: I0316 17:00:24.600048 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/3c26be62-517d-41f5-bb6f-2c75cf93c96a-ovsdbserver-sb-tls-certs\") pod \"3c26be62-517d-41f5-bb6f-2c75cf93c96a\" (UID: \"3c26be62-517d-41f5-bb6f-2c75cf93c96a\") " Mar 16 17:00:24 crc kubenswrapper[5120]: I0316 17:00:24.600084 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/3c26be62-517d-41f5-bb6f-2c75cf93c96a-metrics-certs-tls-certs\") pod \"3c26be62-517d-41f5-bb6f-2c75cf93c96a\" (UID: \"3c26be62-517d-41f5-bb6f-2c75cf93c96a\") " Mar 16 17:00:24 crc kubenswrapper[5120]: I0316 17:00:24.600176 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3c26be62-517d-41f5-bb6f-2c75cf93c96a-config\") pod \"3c26be62-517d-41f5-bb6f-2c75cf93c96a\" (UID: \"3c26be62-517d-41f5-bb6f-2c75cf93c96a\") " Mar 16 17:00:24 crc kubenswrapper[5120]: I0316 17:00:24.600199 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3c26be62-517d-41f5-bb6f-2c75cf93c96a-combined-ca-bundle\") pod \"3c26be62-517d-41f5-bb6f-2c75cf93c96a\" (UID: \"3c26be62-517d-41f5-bb6f-2c75cf93c96a\") " Mar 16 17:00:24 crc kubenswrapper[5120]: I0316 17:00:24.600345 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/3c26be62-517d-41f5-bb6f-2c75cf93c96a-ovsdb-rundir\") pod \"3c26be62-517d-41f5-bb6f-2c75cf93c96a\" (UID: \"3c26be62-517d-41f5-bb6f-2c75cf93c96a\") " Mar 16 17:00:24 crc kubenswrapper[5120]: I0316 17:00:24.600536 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s5bmd\" (UniqueName: \"kubernetes.io/projected/3c26be62-517d-41f5-bb6f-2c75cf93c96a-kube-api-access-s5bmd\") pod \"3c26be62-517d-41f5-bb6f-2c75cf93c96a\" (UID: \"3c26be62-517d-41f5-bb6f-2c75cf93c96a\") " Mar 16 17:00:24 crc kubenswrapper[5120]: I0316 17:00:24.600945 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovndbcluster-sb-etc-ovn\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"3c26be62-517d-41f5-bb6f-2c75cf93c96a\" (UID: \"3c26be62-517d-41f5-bb6f-2c75cf93c96a\") " Mar 16 17:00:24 crc kubenswrapper[5120]: I0316 17:00:24.606226 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c26be62-517d-41f5-bb6f-2c75cf93c96a-config" (OuterVolumeSpecName: "config") pod "3c26be62-517d-41f5-bb6f-2c75cf93c96a" (UID: "3c26be62-517d-41f5-bb6f-2c75cf93c96a"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:00:24 crc kubenswrapper[5120]: I0316 17:00:24.606835 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c26be62-517d-41f5-bb6f-2c75cf93c96a-scripts" (OuterVolumeSpecName: "scripts") pod "3c26be62-517d-41f5-bb6f-2c75cf93c96a" (UID: "3c26be62-517d-41f5-bb6f-2c75cf93c96a"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:00:24 crc kubenswrapper[5120]: I0316 17:00:24.607860 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c26be62-517d-41f5-bb6f-2c75cf93c96a-ovsdb-rundir" (OuterVolumeSpecName: "ovsdb-rundir") pod "3c26be62-517d-41f5-bb6f-2c75cf93c96a" (UID: "3c26be62-517d-41f5-bb6f-2c75cf93c96a"). InnerVolumeSpecName "ovsdb-rundir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:00:24 crc kubenswrapper[5120]: I0316 17:00:24.615973 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage01-crc" (OuterVolumeSpecName: "ovndbcluster-sb-etc-ovn") pod "3c26be62-517d-41f5-bb6f-2c75cf93c96a" (UID: "3c26be62-517d-41f5-bb6f-2c75cf93c96a"). InnerVolumeSpecName "local-storage01-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 17:00:24 crc kubenswrapper[5120]: I0316 17:00:24.626160 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c26be62-517d-41f5-bb6f-2c75cf93c96a-kube-api-access-s5bmd" (OuterVolumeSpecName: "kube-api-access-s5bmd") pod "3c26be62-517d-41f5-bb6f-2c75cf93c96a" (UID: "3c26be62-517d-41f5-bb6f-2c75cf93c96a"). InnerVolumeSpecName "kube-api-access-s5bmd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:00:24 crc kubenswrapper[5120]: I0316 17:00:24.679195 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="030b8d76-31d4-45e0-8be6-3d946e372b0e" path="/var/lib/kubelet/pods/030b8d76-31d4-45e0-8be6-3d946e372b0e/volumes" Mar 16 17:00:24 crc kubenswrapper[5120]: I0316 17:00:24.684301 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-6f846b8bfd-w69px" Mar 16 17:00:24 crc kubenswrapper[5120]: I0316 17:00:24.702400 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c26be62-517d-41f5-bb6f-2c75cf93c96a-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "3c26be62-517d-41f5-bb6f-2c75cf93c96a" (UID: "3c26be62-517d-41f5-bb6f-2c75cf93c96a"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:24 crc kubenswrapper[5120]: I0316 17:00:24.708492 5120 reconciler_common.go:299] "Volume detached for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/3c26be62-517d-41f5-bb6f-2c75cf93c96a-ovsdb-rundir\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:24 crc kubenswrapper[5120]: I0316 17:00:24.708537 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s5bmd\" (UniqueName: \"kubernetes.io/projected/3c26be62-517d-41f5-bb6f-2c75cf93c96a-kube-api-access-s5bmd\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:24 crc kubenswrapper[5120]: I0316 17:00:24.708563 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") on node \"crc\" " Mar 16 17:00:24 crc kubenswrapper[5120]: I0316 17:00:24.708573 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/3c26be62-517d-41f5-bb6f-2c75cf93c96a-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:24 crc kubenswrapper[5120]: I0316 17:00:24.708585 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3c26be62-517d-41f5-bb6f-2c75cf93c96a-config\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:24 crc kubenswrapper[5120]: I0316 17:00:24.708596 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3c26be62-517d-41f5-bb6f-2c75cf93c96a-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:24 crc kubenswrapper[5120]: I0316 17:00:24.736058 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage01-crc" (UniqueName: "kubernetes.io/local-volume/local-storage01-crc") on node "crc" Mar 16 17:00:24 crc kubenswrapper[5120]: I0316 17:00:24.736981 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c26be62-517d-41f5-bb6f-2c75cf93c96a-ovsdbserver-sb-tls-certs" (OuterVolumeSpecName: "ovsdbserver-sb-tls-certs") pod "3c26be62-517d-41f5-bb6f-2c75cf93c96a" (UID: "3c26be62-517d-41f5-bb6f-2c75cf93c96a"). InnerVolumeSpecName "ovsdbserver-sb-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:24 crc kubenswrapper[5120]: I0316 17:00:24.758977 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c26be62-517d-41f5-bb6f-2c75cf93c96a-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "3c26be62-517d-41f5-bb6f-2c75cf93c96a" (UID: "3c26be62-517d-41f5-bb6f-2c75cf93c96a"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:24 crc kubenswrapper[5120]: I0316 17:00:24.799793 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 17:00:24 crc kubenswrapper[5120]: I0316 17:00:24.800240 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovn-northd-0" podUID="b0790e22-4129-49de-b1d6-25c9288301f0" containerName="ovn-northd" containerID="cri-o://25452cdb3754529b9172640423ac8e022a547938c3c8e33217454a9176746833" gracePeriod=30 Mar 16 17:00:24 crc kubenswrapper[5120]: I0316 17:00:24.800712 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovn-northd-0" podUID="b0790e22-4129-49de-b1d6-25c9288301f0" containerName="openstack-network-exporter" containerID="cri-o://ea563bcfceca9858a012e2116c5b84a6aa7066ee3bdd5115c54f7a2c5841ad96" gracePeriod=30 Mar 16 17:00:24 crc kubenswrapper[5120]: I0316 17:00:24.813076 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:24 crc kubenswrapper[5120]: I0316 17:00:24.813112 5120 reconciler_common.go:299] "Volume detached for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/3c26be62-517d-41f5-bb6f-2c75cf93c96a-ovsdbserver-sb-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:24 crc kubenswrapper[5120]: I0316 17:00:24.813131 5120 reconciler_common.go:299] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/3c26be62-517d-41f5-bb6f-2c75cf93c96a-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:25 crc kubenswrapper[5120]: I0316 17:00:25.077186 5120 generic.go:358] "Generic (PLEG): container finished" podID="b0790e22-4129-49de-b1d6-25c9288301f0" containerID="ea563bcfceca9858a012e2116c5b84a6aa7066ee3bdd5115c54f7a2c5841ad96" exitCode=2 Mar 16 17:00:25 crc kubenswrapper[5120]: I0316 17:00:25.077290 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"b0790e22-4129-49de-b1d6-25c9288301f0","Type":"ContainerDied","Data":"ea563bcfceca9858a012e2116c5b84a6aa7066ee3bdd5115c54f7a2c5841ad96"} Mar 16 17:00:25 crc kubenswrapper[5120]: I0316 17:00:25.094205 5120 generic.go:358] "Generic (PLEG): container finished" podID="0e6277f8-02ed-4429-af86-af38266195cd" containerID="df644605668cb6409e0b440fc58164a055f8c2e58033000e364530db958fe591" exitCode=143 Mar 16 17:00:25 crc kubenswrapper[5120]: I0316 17:00:25.094369 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"0e6277f8-02ed-4429-af86-af38266195cd","Type":"ContainerDied","Data":"df644605668cb6409e0b440fc58164a055f8c2e58033000e364530db958fe591"} Mar 16 17:00:25 crc kubenswrapper[5120]: I0316 17:00:25.112045 5120 generic.go:358] "Generic (PLEG): container finished" podID="07433ec1-a6dc-48a4-8374-8260c23db816" containerID="e2e1bc3fa454ce2aaa626ec44d02991c8621e7f7302023f4b23a970d86c6d80a" exitCode=0 Mar 16 17:00:25 crc kubenswrapper[5120]: I0316 17:00:25.112074 5120 generic.go:358] "Generic (PLEG): container finished" podID="07433ec1-a6dc-48a4-8374-8260c23db816" containerID="7b707ffbba30ff002e830acdf2190ce1b9f026c0222d528d2f44fc799f718492" exitCode=2 Mar 16 17:00:25 crc kubenswrapper[5120]: I0316 17:00:25.112080 5120 generic.go:358] "Generic (PLEG): container finished" podID="07433ec1-a6dc-48a4-8374-8260c23db816" containerID="c2c1a9748e9ea2942668489224606d646bc848231e5d479039bf6c1c2906c46c" exitCode=0 Mar 16 17:00:25 crc kubenswrapper[5120]: I0316 17:00:25.112241 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"07433ec1-a6dc-48a4-8374-8260c23db816","Type":"ContainerDied","Data":"e2e1bc3fa454ce2aaa626ec44d02991c8621e7f7302023f4b23a970d86c6d80a"} Mar 16 17:00:25 crc kubenswrapper[5120]: I0316 17:00:25.112270 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"07433ec1-a6dc-48a4-8374-8260c23db816","Type":"ContainerDied","Data":"7b707ffbba30ff002e830acdf2190ce1b9f026c0222d528d2f44fc799f718492"} Mar 16 17:00:25 crc kubenswrapper[5120]: I0316 17:00:25.112279 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"07433ec1-a6dc-48a4-8374-8260c23db816","Type":"ContainerDied","Data":"c2c1a9748e9ea2942668489224606d646bc848231e5d479039bf6c1c2906c46c"} Mar 16 17:00:25 crc kubenswrapper[5120]: I0316 17:00:25.115280 5120 generic.go:358] "Generic (PLEG): container finished" podID="ff7f7a87-78b8-4ffa-96fb-5529ad39883f" containerID="0239c4536046b2029b813fee0ba4d8528cbc6b8b4a900df7ee3237f20798effc" exitCode=0 Mar 16 17:00:25 crc kubenswrapper[5120]: I0316 17:00:25.115401 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"ff7f7a87-78b8-4ffa-96fb-5529ad39883f","Type":"ContainerDied","Data":"0239c4536046b2029b813fee0ba4d8528cbc6b8b4a900df7ee3237f20798effc"} Mar 16 17:00:25 crc kubenswrapper[5120]: I0316 17:00:25.125006 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_3c26be62-517d-41f5-bb6f-2c75cf93c96a/ovsdbserver-sb/0.log" Mar 16 17:00:25 crc kubenswrapper[5120]: I0316 17:00:25.125202 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:00:25 crc kubenswrapper[5120]: I0316 17:00:25.125302 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"3c26be62-517d-41f5-bb6f-2c75cf93c96a","Type":"ContainerDied","Data":"6e2e3f835329316e695061295382253d63be5168cf312ebab682060a6d233005"} Mar 16 17:00:25 crc kubenswrapper[5120]: I0316 17:00:25.125350 5120 scope.go:117] "RemoveContainer" containerID="0c5a2135fb60242e596a2bc08da044df6460929a10d8be846b4883f1540ead45" Mar 16 17:00:25 crc kubenswrapper[5120]: I0316 17:00:25.152353 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"4ae0ee71-cb7b-4458-9176-1a941416c653","Type":"ContainerStarted","Data":"58dfb8f6f45a99d10e362ec0532e93b658925573a2fd7ebc9291f9e8266f5a1e"} Mar 16 17:00:25 crc kubenswrapper[5120]: I0316 17:00:25.152426 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"4ae0ee71-cb7b-4458-9176-1a941416c653","Type":"ContainerStarted","Data":"2aaf683507989a8fa9876cc1505c80fb8c145455029fa196d10039ad20b5e5a7"} Mar 16 17:00:25 crc kubenswrapper[5120]: I0316 17:00:25.190896 5120 scope.go:117] "RemoveContainer" containerID="1aaf59914fc1561cebdf52d0de00dcac1dd1c216925d669b493f5a808b6e98f8" Mar 16 17:00:25 crc kubenswrapper[5120]: I0316 17:00:25.201482 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podStartSLOduration=2.201455276 podStartE2EDuration="2.201455276s" podCreationTimestamp="2026-03-16 17:00:23 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:00:25.193511819 +0000 UTC m=+5327.347443476" watchObservedRunningTime="2026-03-16 17:00:25.201455276 +0000 UTC m=+5327.355386943" Mar 16 17:00:25 crc kubenswrapper[5120]: I0316 17:00:25.229397 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-6f846b8bfd-w69px"] Mar 16 17:00:25 crc kubenswrapper[5120]: I0316 17:00:25.284379 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 17:00:25 crc kubenswrapper[5120]: I0316 17:00:25.349118 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 17:00:25 crc kubenswrapper[5120]: I0316 17:00:25.385292 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 17:00:25 crc kubenswrapper[5120]: I0316 17:00:25.386746 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c26be62-517d-41f5-bb6f-2c75cf93c96a" containerName="ovsdbserver-sb" Mar 16 17:00:25 crc kubenswrapper[5120]: I0316 17:00:25.386834 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c26be62-517d-41f5-bb6f-2c75cf93c96a" containerName="ovsdbserver-sb" Mar 16 17:00:25 crc kubenswrapper[5120]: I0316 17:00:25.386875 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c26be62-517d-41f5-bb6f-2c75cf93c96a" containerName="openstack-network-exporter" Mar 16 17:00:25 crc kubenswrapper[5120]: I0316 17:00:25.386882 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c26be62-517d-41f5-bb6f-2c75cf93c96a" containerName="openstack-network-exporter" Mar 16 17:00:25 crc kubenswrapper[5120]: I0316 17:00:25.387205 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="3c26be62-517d-41f5-bb6f-2c75cf93c96a" containerName="ovsdbserver-sb" Mar 16 17:00:25 crc kubenswrapper[5120]: I0316 17:00:25.387253 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="3c26be62-517d-41f5-bb6f-2c75cf93c96a" containerName="openstack-network-exporter" Mar 16 17:00:25 crc kubenswrapper[5120]: I0316 17:00:25.402597 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:00:25 crc kubenswrapper[5120]: I0316 17:00:25.410536 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovndbcluster-sb-config\"" Mar 16 17:00:25 crc kubenswrapper[5120]: I0316 17:00:25.410918 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ovndbcluster-sb-ovndbs\"" Mar 16 17:00:25 crc kubenswrapper[5120]: I0316 17:00:25.411168 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovndbcluster-sb-scripts\"" Mar 16 17:00:25 crc kubenswrapper[5120]: I0316 17:00:25.411428 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ovncluster-ovndbcluster-sb-dockercfg-scdkb\"" Mar 16 17:00:25 crc kubenswrapper[5120]: I0316 17:00:25.412492 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 17:00:25 crc kubenswrapper[5120]: I0316 17:00:25.464103 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4phr\" (UniqueName: \"kubernetes.io/projected/07f2b57d-24dd-44a8-9399-3d3df8cd1a86-kube-api-access-b4phr\") pod \"ovsdbserver-sb-0\" (UID: \"07f2b57d-24dd-44a8-9399-3d3df8cd1a86\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:00:25 crc kubenswrapper[5120]: I0316 17:00:25.464173 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"ovsdbserver-sb-0\" (UID: \"07f2b57d-24dd-44a8-9399-3d3df8cd1a86\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:00:25 crc kubenswrapper[5120]: I0316 17:00:25.464444 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/07f2b57d-24dd-44a8-9399-3d3df8cd1a86-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"07f2b57d-24dd-44a8-9399-3d3df8cd1a86\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:00:25 crc kubenswrapper[5120]: I0316 17:00:25.464471 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/07f2b57d-24dd-44a8-9399-3d3df8cd1a86-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"07f2b57d-24dd-44a8-9399-3d3df8cd1a86\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:00:25 crc kubenswrapper[5120]: I0316 17:00:25.464563 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/07f2b57d-24dd-44a8-9399-3d3df8cd1a86-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"07f2b57d-24dd-44a8-9399-3d3df8cd1a86\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:00:25 crc kubenswrapper[5120]: I0316 17:00:25.464661 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/07f2b57d-24dd-44a8-9399-3d3df8cd1a86-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"07f2b57d-24dd-44a8-9399-3d3df8cd1a86\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:00:25 crc kubenswrapper[5120]: I0316 17:00:25.464708 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/07f2b57d-24dd-44a8-9399-3d3df8cd1a86-config\") pod \"ovsdbserver-sb-0\" (UID: \"07f2b57d-24dd-44a8-9399-3d3df8cd1a86\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:00:25 crc kubenswrapper[5120]: I0316 17:00:25.464738 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/07f2b57d-24dd-44a8-9399-3d3df8cd1a86-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"07f2b57d-24dd-44a8-9399-3d3df8cd1a86\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:00:25 crc kubenswrapper[5120]: I0316 17:00:25.466379 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:00:25 crc kubenswrapper[5120]: I0316 17:00:25.567332 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/07f2b57d-24dd-44a8-9399-3d3df8cd1a86-config\") pod \"ovsdbserver-sb-0\" (UID: \"07f2b57d-24dd-44a8-9399-3d3df8cd1a86\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:00:25 crc kubenswrapper[5120]: I0316 17:00:25.567427 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/07f2b57d-24dd-44a8-9399-3d3df8cd1a86-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"07f2b57d-24dd-44a8-9399-3d3df8cd1a86\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:00:25 crc kubenswrapper[5120]: I0316 17:00:25.567600 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b4phr\" (UniqueName: \"kubernetes.io/projected/07f2b57d-24dd-44a8-9399-3d3df8cd1a86-kube-api-access-b4phr\") pod \"ovsdbserver-sb-0\" (UID: \"07f2b57d-24dd-44a8-9399-3d3df8cd1a86\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:00:25 crc kubenswrapper[5120]: I0316 17:00:25.567756 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"ovsdbserver-sb-0\" (UID: \"07f2b57d-24dd-44a8-9399-3d3df8cd1a86\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:00:25 crc kubenswrapper[5120]: I0316 17:00:25.568281 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"ovsdbserver-sb-0\" (UID: \"07f2b57d-24dd-44a8-9399-3d3df8cd1a86\") device mount path \"/mnt/openstack/pv01\"" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:00:25 crc kubenswrapper[5120]: I0316 17:00:25.568822 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/07f2b57d-24dd-44a8-9399-3d3df8cd1a86-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"07f2b57d-24dd-44a8-9399-3d3df8cd1a86\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:00:25 crc kubenswrapper[5120]: I0316 17:00:25.568863 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/07f2b57d-24dd-44a8-9399-3d3df8cd1a86-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"07f2b57d-24dd-44a8-9399-3d3df8cd1a86\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:00:25 crc kubenswrapper[5120]: I0316 17:00:25.568972 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/07f2b57d-24dd-44a8-9399-3d3df8cd1a86-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"07f2b57d-24dd-44a8-9399-3d3df8cd1a86\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:00:25 crc kubenswrapper[5120]: I0316 17:00:25.569092 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/07f2b57d-24dd-44a8-9399-3d3df8cd1a86-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"07f2b57d-24dd-44a8-9399-3d3df8cd1a86\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:00:25 crc kubenswrapper[5120]: I0316 17:00:25.569317 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/07f2b57d-24dd-44a8-9399-3d3df8cd1a86-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"07f2b57d-24dd-44a8-9399-3d3df8cd1a86\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:00:25 crc kubenswrapper[5120]: I0316 17:00:25.569384 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/07f2b57d-24dd-44a8-9399-3d3df8cd1a86-config\") pod \"ovsdbserver-sb-0\" (UID: \"07f2b57d-24dd-44a8-9399-3d3df8cd1a86\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:00:25 crc kubenswrapper[5120]: I0316 17:00:25.570406 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/07f2b57d-24dd-44a8-9399-3d3df8cd1a86-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"07f2b57d-24dd-44a8-9399-3d3df8cd1a86\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:00:25 crc kubenswrapper[5120]: I0316 17:00:25.578635 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/07f2b57d-24dd-44a8-9399-3d3df8cd1a86-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"07f2b57d-24dd-44a8-9399-3d3df8cd1a86\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:00:25 crc kubenswrapper[5120]: I0316 17:00:25.582699 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/07f2b57d-24dd-44a8-9399-3d3df8cd1a86-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"07f2b57d-24dd-44a8-9399-3d3df8cd1a86\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:00:25 crc kubenswrapper[5120]: I0316 17:00:25.585009 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/07f2b57d-24dd-44a8-9399-3d3df8cd1a86-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"07f2b57d-24dd-44a8-9399-3d3df8cd1a86\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:00:25 crc kubenswrapper[5120]: I0316 17:00:25.586011 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4phr\" (UniqueName: \"kubernetes.io/projected/07f2b57d-24dd-44a8-9399-3d3df8cd1a86-kube-api-access-b4phr\") pod \"ovsdbserver-sb-0\" (UID: \"07f2b57d-24dd-44a8-9399-3d3df8cd1a86\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:00:25 crc kubenswrapper[5120]: I0316 17:00:25.627236 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"ovsdbserver-sb-0\" (UID: \"07f2b57d-24dd-44a8-9399-3d3df8cd1a86\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:00:25 crc kubenswrapper[5120]: I0316 17:00:25.670802 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vswt9\" (UniqueName: \"kubernetes.io/projected/ff7f7a87-78b8-4ffa-96fb-5529ad39883f-kube-api-access-vswt9\") pod \"ff7f7a87-78b8-4ffa-96fb-5529ad39883f\" (UID: \"ff7f7a87-78b8-4ffa-96fb-5529ad39883f\") " Mar 16 17:00:25 crc kubenswrapper[5120]: I0316 17:00:25.671250 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/ff7f7a87-78b8-4ffa-96fb-5529ad39883f-nova-novncproxy-tls-certs\") pod \"ff7f7a87-78b8-4ffa-96fb-5529ad39883f\" (UID: \"ff7f7a87-78b8-4ffa-96fb-5529ad39883f\") " Mar 16 17:00:25 crc kubenswrapper[5120]: I0316 17:00:25.671421 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/ff7f7a87-78b8-4ffa-96fb-5529ad39883f-vencrypt-tls-certs\") pod \"ff7f7a87-78b8-4ffa-96fb-5529ad39883f\" (UID: \"ff7f7a87-78b8-4ffa-96fb-5529ad39883f\") " Mar 16 17:00:25 crc kubenswrapper[5120]: I0316 17:00:25.671445 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ff7f7a87-78b8-4ffa-96fb-5529ad39883f-combined-ca-bundle\") pod \"ff7f7a87-78b8-4ffa-96fb-5529ad39883f\" (UID: \"ff7f7a87-78b8-4ffa-96fb-5529ad39883f\") " Mar 16 17:00:25 crc kubenswrapper[5120]: I0316 17:00:25.671511 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ff7f7a87-78b8-4ffa-96fb-5529ad39883f-config-data\") pod \"ff7f7a87-78b8-4ffa-96fb-5529ad39883f\" (UID: \"ff7f7a87-78b8-4ffa-96fb-5529ad39883f\") " Mar 16 17:00:25 crc kubenswrapper[5120]: I0316 17:00:25.679516 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff7f7a87-78b8-4ffa-96fb-5529ad39883f-kube-api-access-vswt9" (OuterVolumeSpecName: "kube-api-access-vswt9") pod "ff7f7a87-78b8-4ffa-96fb-5529ad39883f" (UID: "ff7f7a87-78b8-4ffa-96fb-5529ad39883f"). InnerVolumeSpecName "kube-api-access-vswt9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:00:25 crc kubenswrapper[5120]: I0316 17:00:25.704883 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff7f7a87-78b8-4ffa-96fb-5529ad39883f-config-data" (OuterVolumeSpecName: "config-data") pod "ff7f7a87-78b8-4ffa-96fb-5529ad39883f" (UID: "ff7f7a87-78b8-4ffa-96fb-5529ad39883f"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:25 crc kubenswrapper[5120]: I0316 17:00:25.707405 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff7f7a87-78b8-4ffa-96fb-5529ad39883f-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ff7f7a87-78b8-4ffa-96fb-5529ad39883f" (UID: "ff7f7a87-78b8-4ffa-96fb-5529ad39883f"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:25 crc kubenswrapper[5120]: I0316 17:00:25.727956 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff7f7a87-78b8-4ffa-96fb-5529ad39883f-vencrypt-tls-certs" (OuterVolumeSpecName: "vencrypt-tls-certs") pod "ff7f7a87-78b8-4ffa-96fb-5529ad39883f" (UID: "ff7f7a87-78b8-4ffa-96fb-5529ad39883f"). InnerVolumeSpecName "vencrypt-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:25 crc kubenswrapper[5120]: I0316 17:00:25.738737 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff7f7a87-78b8-4ffa-96fb-5529ad39883f-nova-novncproxy-tls-certs" (OuterVolumeSpecName: "nova-novncproxy-tls-certs") pod "ff7f7a87-78b8-4ffa-96fb-5529ad39883f" (UID: "ff7f7a87-78b8-4ffa-96fb-5529ad39883f"). InnerVolumeSpecName "nova-novncproxy-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:25 crc kubenswrapper[5120]: I0316 17:00:25.774920 5120 reconciler_common.go:299] "Volume detached for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/ff7f7a87-78b8-4ffa-96fb-5529ad39883f-vencrypt-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:25 crc kubenswrapper[5120]: I0316 17:00:25.775223 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ff7f7a87-78b8-4ffa-96fb-5529ad39883f-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:25 crc kubenswrapper[5120]: I0316 17:00:25.775233 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ff7f7a87-78b8-4ffa-96fb-5529ad39883f-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:25 crc kubenswrapper[5120]: I0316 17:00:25.775242 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vswt9\" (UniqueName: \"kubernetes.io/projected/ff7f7a87-78b8-4ffa-96fb-5529ad39883f-kube-api-access-vswt9\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:25 crc kubenswrapper[5120]: I0316 17:00:25.775253 5120 reconciler_common.go:299] "Volume detached for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/ff7f7a87-78b8-4ffa-96fb-5529ad39883f-nova-novncproxy-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:25 crc kubenswrapper[5120]: I0316 17:00:25.819733 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:00:26 crc kubenswrapper[5120]: I0316 17:00:26.189479 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"ff7f7a87-78b8-4ffa-96fb-5529ad39883f","Type":"ContainerDied","Data":"bcd33fa20e0f291442bff20e27871bc87eed4351511d0237c8b4132dbca75849"} Mar 16 17:00:26 crc kubenswrapper[5120]: I0316 17:00:26.190602 5120 scope.go:117] "RemoveContainer" containerID="0239c4536046b2029b813fee0ba4d8528cbc6b8b4a900df7ee3237f20798effc" Mar 16 17:00:26 crc kubenswrapper[5120]: I0316 17:00:26.189857 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:00:26 crc kubenswrapper[5120]: I0316 17:00:26.203410 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-6f846b8bfd-w69px" event={"ID":"e3143a49-62b5-408a-8dca-d723f7a31619","Type":"ContainerStarted","Data":"f8c1c5109f6bdbd96450c7a23d67c1a63f13b173010194ecf69b1864ecf069cd"} Mar 16 17:00:26 crc kubenswrapper[5120]: I0316 17:00:26.205532 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/neutron-6f846b8bfd-w69px" Mar 16 17:00:26 crc kubenswrapper[5120]: I0316 17:00:26.205553 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-6f846b8bfd-w69px" event={"ID":"e3143a49-62b5-408a-8dca-d723f7a31619","Type":"ContainerStarted","Data":"1ba29d334446e91abdcb11e44fde235c795515796425914cd3ff6f4f69019510"} Mar 16 17:00:26 crc kubenswrapper[5120]: I0316 17:00:26.205563 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-6f846b8bfd-w69px" event={"ID":"e3143a49-62b5-408a-8dca-d723f7a31619","Type":"ContainerStarted","Data":"67efb27c447aaa8da521a63173f57591760fe73067f0d9d4541153a4568020db"} Mar 16 17:00:26 crc kubenswrapper[5120]: I0316 17:00:26.253034 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-6f846b8bfd-w69px" podStartSLOduration=2.253014948 podStartE2EDuration="2.253014948s" podCreationTimestamp="2026-03-16 17:00:24 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:00:26.24063624 +0000 UTC m=+5328.394567897" watchObservedRunningTime="2026-03-16 17:00:26.253014948 +0000 UTC m=+5328.406946605" Mar 16 17:00:26 crc kubenswrapper[5120]: I0316 17:00:26.381391 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 17:00:26 crc kubenswrapper[5120]: I0316 17:00:26.395821 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 17:00:26 crc kubenswrapper[5120]: I0316 17:00:26.410416 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 17:00:26 crc kubenswrapper[5120]: I0316 17:00:26.411888 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff7f7a87-78b8-4ffa-96fb-5529ad39883f" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 17:00:26 crc kubenswrapper[5120]: I0316 17:00:26.411910 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff7f7a87-78b8-4ffa-96fb-5529ad39883f" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 17:00:26 crc kubenswrapper[5120]: I0316 17:00:26.412132 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ff7f7a87-78b8-4ffa-96fb-5529ad39883f" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 17:00:26 crc kubenswrapper[5120]: I0316 17:00:26.426370 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 17:00:26 crc kubenswrapper[5120]: I0316 17:00:26.426544 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:00:26 crc kubenswrapper[5120]: I0316 17:00:26.431273 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-novncproxy-config-data\"" Mar 16 17:00:26 crc kubenswrapper[5120]: I0316 17:00:26.431564 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-novncproxy-cell1-public-svc\"" Mar 16 17:00:26 crc kubenswrapper[5120]: I0316 17:00:26.431805 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-novncproxy-cell1-vencrypt\"" Mar 16 17:00:26 crc kubenswrapper[5120]: I0316 17:00:26.486126 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-5b9b97df74-9rl5z"] Mar 16 17:00:26 crc kubenswrapper[5120]: I0316 17:00:26.502711 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:00:26 crc kubenswrapper[5120]: I0316 17:00:26.502891 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-5b9b97df74-9rl5z" Mar 16 17:00:26 crc kubenswrapper[5120]: I0316 17:00:26.538247 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-5b9b97df74-9rl5z"] Mar 16 17:00:26 crc kubenswrapper[5120]: I0316 17:00:26.591367 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 17:00:26 crc kubenswrapper[5120]: I0316 17:00:26.614336 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9c429916-2d70-42f0-a572-90ab8aafafbe-logs\") pod \"placement-5b9b97df74-9rl5z\" (UID: \"9c429916-2d70-42f0-a572-90ab8aafafbe\") " pod="openstack-kuttl-tests/placement-5b9b97df74-9rl5z" Mar 16 17:00:26 crc kubenswrapper[5120]: I0316 17:00:26.615483 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/9c429916-2d70-42f0-a572-90ab8aafafbe-public-tls-certs\") pod \"placement-5b9b97df74-9rl5z\" (UID: \"9c429916-2d70-42f0-a572-90ab8aafafbe\") " pod="openstack-kuttl-tests/placement-5b9b97df74-9rl5z" Mar 16 17:00:26 crc kubenswrapper[5120]: I0316 17:00:26.615646 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpzrs\" (UniqueName: \"kubernetes.io/projected/6fdf4b26-c833-4319-954a-7ebaaedb71e5-kube-api-access-xpzrs\") pod \"nova-cell1-novncproxy-0\" (UID: \"6fdf4b26-c833-4319-954a-7ebaaedb71e5\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:00:26 crc kubenswrapper[5120]: I0316 17:00:26.615751 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9c429916-2d70-42f0-a572-90ab8aafafbe-combined-ca-bundle\") pod \"placement-5b9b97df74-9rl5z\" (UID: \"9c429916-2d70-42f0-a572-90ab8aafafbe\") " pod="openstack-kuttl-tests/placement-5b9b97df74-9rl5z" Mar 16 17:00:26 crc kubenswrapper[5120]: I0316 17:00:26.615872 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xx7jk\" (UniqueName: \"kubernetes.io/projected/9c429916-2d70-42f0-a572-90ab8aafafbe-kube-api-access-xx7jk\") pod \"placement-5b9b97df74-9rl5z\" (UID: \"9c429916-2d70-42f0-a572-90ab8aafafbe\") " pod="openstack-kuttl-tests/placement-5b9b97df74-9rl5z" Mar 16 17:00:26 crc kubenswrapper[5120]: I0316 17:00:26.616026 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9c429916-2d70-42f0-a572-90ab8aafafbe-config-data\") pod \"placement-5b9b97df74-9rl5z\" (UID: \"9c429916-2d70-42f0-a572-90ab8aafafbe\") " pod="openstack-kuttl-tests/placement-5b9b97df74-9rl5z" Mar 16 17:00:26 crc kubenswrapper[5120]: I0316 17:00:26.616166 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/6fdf4b26-c833-4319-954a-7ebaaedb71e5-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"6fdf4b26-c833-4319-954a-7ebaaedb71e5\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:00:26 crc kubenswrapper[5120]: I0316 17:00:26.616581 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/6fdf4b26-c833-4319-954a-7ebaaedb71e5-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"6fdf4b26-c833-4319-954a-7ebaaedb71e5\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:00:26 crc kubenswrapper[5120]: I0316 17:00:26.616693 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6fdf4b26-c833-4319-954a-7ebaaedb71e5-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"6fdf4b26-c833-4319-954a-7ebaaedb71e5\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:00:26 crc kubenswrapper[5120]: I0316 17:00:26.616846 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/9c429916-2d70-42f0-a572-90ab8aafafbe-internal-tls-certs\") pod \"placement-5b9b97df74-9rl5z\" (UID: \"9c429916-2d70-42f0-a572-90ab8aafafbe\") " pod="openstack-kuttl-tests/placement-5b9b97df74-9rl5z" Mar 16 17:00:26 crc kubenswrapper[5120]: I0316 17:00:26.617656 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6fdf4b26-c833-4319-954a-7ebaaedb71e5-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"6fdf4b26-c833-4319-954a-7ebaaedb71e5\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:00:26 crc kubenswrapper[5120]: I0316 17:00:26.618025 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9c429916-2d70-42f0-a572-90ab8aafafbe-scripts\") pod \"placement-5b9b97df74-9rl5z\" (UID: \"9c429916-2d70-42f0-a572-90ab8aafafbe\") " pod="openstack-kuttl-tests/placement-5b9b97df74-9rl5z" Mar 16 17:00:26 crc kubenswrapper[5120]: I0316 17:00:26.681451 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c26be62-517d-41f5-bb6f-2c75cf93c96a" path="/var/lib/kubelet/pods/3c26be62-517d-41f5-bb6f-2c75cf93c96a/volumes" Mar 16 17:00:26 crc kubenswrapper[5120]: I0316 17:00:26.682462 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ff7f7a87-78b8-4ffa-96fb-5529ad39883f" path="/var/lib/kubelet/pods/ff7f7a87-78b8-4ffa-96fb-5529ad39883f/volumes" Mar 16 17:00:26 crc kubenswrapper[5120]: I0316 17:00:26.724698 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/6fdf4b26-c833-4319-954a-7ebaaedb71e5-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"6fdf4b26-c833-4319-954a-7ebaaedb71e5\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:00:26 crc kubenswrapper[5120]: I0316 17:00:26.724781 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6fdf4b26-c833-4319-954a-7ebaaedb71e5-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"6fdf4b26-c833-4319-954a-7ebaaedb71e5\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:00:26 crc kubenswrapper[5120]: I0316 17:00:26.724858 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/9c429916-2d70-42f0-a572-90ab8aafafbe-internal-tls-certs\") pod \"placement-5b9b97df74-9rl5z\" (UID: \"9c429916-2d70-42f0-a572-90ab8aafafbe\") " pod="openstack-kuttl-tests/placement-5b9b97df74-9rl5z" Mar 16 17:00:26 crc kubenswrapper[5120]: I0316 17:00:26.724932 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6fdf4b26-c833-4319-954a-7ebaaedb71e5-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"6fdf4b26-c833-4319-954a-7ebaaedb71e5\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:00:26 crc kubenswrapper[5120]: I0316 17:00:26.725021 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9c429916-2d70-42f0-a572-90ab8aafafbe-scripts\") pod \"placement-5b9b97df74-9rl5z\" (UID: \"9c429916-2d70-42f0-a572-90ab8aafafbe\") " pod="openstack-kuttl-tests/placement-5b9b97df74-9rl5z" Mar 16 17:00:26 crc kubenswrapper[5120]: I0316 17:00:26.725166 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9c429916-2d70-42f0-a572-90ab8aafafbe-logs\") pod \"placement-5b9b97df74-9rl5z\" (UID: \"9c429916-2d70-42f0-a572-90ab8aafafbe\") " pod="openstack-kuttl-tests/placement-5b9b97df74-9rl5z" Mar 16 17:00:26 crc kubenswrapper[5120]: I0316 17:00:26.725602 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9c429916-2d70-42f0-a572-90ab8aafafbe-logs\") pod \"placement-5b9b97df74-9rl5z\" (UID: \"9c429916-2d70-42f0-a572-90ab8aafafbe\") " pod="openstack-kuttl-tests/placement-5b9b97df74-9rl5z" Mar 16 17:00:26 crc kubenswrapper[5120]: I0316 17:00:26.729026 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/9c429916-2d70-42f0-a572-90ab8aafafbe-public-tls-certs\") pod \"placement-5b9b97df74-9rl5z\" (UID: \"9c429916-2d70-42f0-a572-90ab8aafafbe\") " pod="openstack-kuttl-tests/placement-5b9b97df74-9rl5z" Mar 16 17:00:26 crc kubenswrapper[5120]: I0316 17:00:26.729085 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xpzrs\" (UniqueName: \"kubernetes.io/projected/6fdf4b26-c833-4319-954a-7ebaaedb71e5-kube-api-access-xpzrs\") pod \"nova-cell1-novncproxy-0\" (UID: \"6fdf4b26-c833-4319-954a-7ebaaedb71e5\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:00:26 crc kubenswrapper[5120]: I0316 17:00:26.729104 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9c429916-2d70-42f0-a572-90ab8aafafbe-combined-ca-bundle\") pod \"placement-5b9b97df74-9rl5z\" (UID: \"9c429916-2d70-42f0-a572-90ab8aafafbe\") " pod="openstack-kuttl-tests/placement-5b9b97df74-9rl5z" Mar 16 17:00:26 crc kubenswrapper[5120]: I0316 17:00:26.729121 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xx7jk\" (UniqueName: \"kubernetes.io/projected/9c429916-2d70-42f0-a572-90ab8aafafbe-kube-api-access-xx7jk\") pod \"placement-5b9b97df74-9rl5z\" (UID: \"9c429916-2d70-42f0-a572-90ab8aafafbe\") " pod="openstack-kuttl-tests/placement-5b9b97df74-9rl5z" Mar 16 17:00:26 crc kubenswrapper[5120]: I0316 17:00:26.729195 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9c429916-2d70-42f0-a572-90ab8aafafbe-config-data\") pod \"placement-5b9b97df74-9rl5z\" (UID: \"9c429916-2d70-42f0-a572-90ab8aafafbe\") " pod="openstack-kuttl-tests/placement-5b9b97df74-9rl5z" Mar 16 17:00:26 crc kubenswrapper[5120]: I0316 17:00:26.729229 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/6fdf4b26-c833-4319-954a-7ebaaedb71e5-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"6fdf4b26-c833-4319-954a-7ebaaedb71e5\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:00:26 crc kubenswrapper[5120]: I0316 17:00:26.733786 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9c429916-2d70-42f0-a572-90ab8aafafbe-combined-ca-bundle\") pod \"placement-5b9b97df74-9rl5z\" (UID: \"9c429916-2d70-42f0-a572-90ab8aafafbe\") " pod="openstack-kuttl-tests/placement-5b9b97df74-9rl5z" Mar 16 17:00:26 crc kubenswrapper[5120]: I0316 17:00:26.737083 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/6fdf4b26-c833-4319-954a-7ebaaedb71e5-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"6fdf4b26-c833-4319-954a-7ebaaedb71e5\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:00:26 crc kubenswrapper[5120]: I0316 17:00:26.738446 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9c429916-2d70-42f0-a572-90ab8aafafbe-config-data\") pod \"placement-5b9b97df74-9rl5z\" (UID: \"9c429916-2d70-42f0-a572-90ab8aafafbe\") " pod="openstack-kuttl-tests/placement-5b9b97df74-9rl5z" Mar 16 17:00:26 crc kubenswrapper[5120]: I0316 17:00:26.742591 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6fdf4b26-c833-4319-954a-7ebaaedb71e5-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"6fdf4b26-c833-4319-954a-7ebaaedb71e5\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:00:26 crc kubenswrapper[5120]: I0316 17:00:26.742992 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/6fdf4b26-c833-4319-954a-7ebaaedb71e5-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"6fdf4b26-c833-4319-954a-7ebaaedb71e5\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:00:26 crc kubenswrapper[5120]: I0316 17:00:26.744060 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9c429916-2d70-42f0-a572-90ab8aafafbe-scripts\") pod \"placement-5b9b97df74-9rl5z\" (UID: \"9c429916-2d70-42f0-a572-90ab8aafafbe\") " pod="openstack-kuttl-tests/placement-5b9b97df74-9rl5z" Mar 16 17:00:26 crc kubenswrapper[5120]: I0316 17:00:26.746299 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/9c429916-2d70-42f0-a572-90ab8aafafbe-internal-tls-certs\") pod \"placement-5b9b97df74-9rl5z\" (UID: \"9c429916-2d70-42f0-a572-90ab8aafafbe\") " pod="openstack-kuttl-tests/placement-5b9b97df74-9rl5z" Mar 16 17:00:26 crc kubenswrapper[5120]: I0316 17:00:26.749045 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6fdf4b26-c833-4319-954a-7ebaaedb71e5-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"6fdf4b26-c833-4319-954a-7ebaaedb71e5\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:00:26 crc kubenswrapper[5120]: I0316 17:00:26.752730 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/9c429916-2d70-42f0-a572-90ab8aafafbe-public-tls-certs\") pod \"placement-5b9b97df74-9rl5z\" (UID: \"9c429916-2d70-42f0-a572-90ab8aafafbe\") " pod="openstack-kuttl-tests/placement-5b9b97df74-9rl5z" Mar 16 17:00:26 crc kubenswrapper[5120]: I0316 17:00:26.756651 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xx7jk\" (UniqueName: \"kubernetes.io/projected/9c429916-2d70-42f0-a572-90ab8aafafbe-kube-api-access-xx7jk\") pod \"placement-5b9b97df74-9rl5z\" (UID: \"9c429916-2d70-42f0-a572-90ab8aafafbe\") " pod="openstack-kuttl-tests/placement-5b9b97df74-9rl5z" Mar 16 17:00:26 crc kubenswrapper[5120]: I0316 17:00:26.766521 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpzrs\" (UniqueName: \"kubernetes.io/projected/6fdf4b26-c833-4319-954a-7ebaaedb71e5-kube-api-access-xpzrs\") pod \"nova-cell1-novncproxy-0\" (UID: \"6fdf4b26-c833-4319-954a-7ebaaedb71e5\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:00:26 crc kubenswrapper[5120]: I0316 17:00:26.853888 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-5b9b97df74-9rl5z" Mar 16 17:00:27 crc kubenswrapper[5120]: I0316 17:00:27.057928 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:00:27 crc kubenswrapper[5120]: I0316 17:00:27.302142 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"07f2b57d-24dd-44a8-9399-3d3df8cd1a86","Type":"ContainerStarted","Data":"82559c94402956204e6c0ed603726a5ace776e97196e0de5c9afcf91e3a1161b"} Mar 16 17:00:27 crc kubenswrapper[5120]: I0316 17:00:27.302462 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"07f2b57d-24dd-44a8-9399-3d3df8cd1a86","Type":"ContainerStarted","Data":"cc3dcdb1265699fdbedb2921119937ef9d8f0d38f35e3694813c0b97b57789f0"} Mar 16 17:00:27 crc kubenswrapper[5120]: I0316 17:00:27.302476 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"07f2b57d-24dd-44a8-9399-3d3df8cd1a86","Type":"ContainerStarted","Data":"9e5e0f0ffd00a38902db29705075b61f5bb6e6ef7d1b86376f1a8bf2a7201b46"} Mar 16 17:00:27 crc kubenswrapper[5120]: I0316 17:00:27.333363 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podStartSLOduration=2.333341637 podStartE2EDuration="2.333341637s" podCreationTimestamp="2026-03-16 17:00:25 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:00:27.325319538 +0000 UTC m=+5329.479251205" watchObservedRunningTime="2026-03-16 17:00:27.333341637 +0000 UTC m=+5329.487273294" Mar 16 17:00:27 crc kubenswrapper[5120]: I0316 17:00:27.383352 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-5b9b97df74-9rl5z"] Mar 16 17:00:27 crc kubenswrapper[5120]: W0316 17:00:27.699828 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6fdf4b26_c833_4319_954a_7ebaaedb71e5.slice/crio-d57fa08f95a6cfcfd09827365e075bbb88ead4151737bba2848bcdf78f8d733f WatchSource:0}: Error finding container d57fa08f95a6cfcfd09827365e075bbb88ead4151737bba2848bcdf78f8d733f: Status 404 returned error can't find the container with id d57fa08f95a6cfcfd09827365e075bbb88ead4151737bba2848bcdf78f8d733f Mar 16 17:00:27 crc kubenswrapper[5120]: I0316 17:00:27.701582 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 17:00:27 crc kubenswrapper[5120]: E0316 17:00:27.727468 5120 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0e6277f8_02ed_4429_af86_af38266195cd.slice/crio-conmon-e33012e656c2cd8d2e08efcbaefc5187f1c017846cac5c2b21e89bb0c4991a80.scope\": RecentStats: unable to find data in memory cache]" Mar 16 17:00:27 crc kubenswrapper[5120]: E0316 17:00:27.831083 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="25452cdb3754529b9172640423ac8e022a547938c3c8e33217454a9176746833" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Mar 16 17:00:27 crc kubenswrapper[5120]: E0316 17:00:27.834106 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="25452cdb3754529b9172640423ac8e022a547938c3c8e33217454a9176746833" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Mar 16 17:00:27 crc kubenswrapper[5120]: E0316 17:00:27.864537 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="25452cdb3754529b9172640423ac8e022a547938c3c8e33217454a9176746833" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Mar 16 17:00:27 crc kubenswrapper[5120]: E0316 17:00:27.864616 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/ovn-northd-0" podUID="b0790e22-4129-49de-b1d6-25c9288301f0" containerName="ovn-northd" probeResult="unknown" Mar 16 17:00:28 crc kubenswrapper[5120]: I0316 17:00:28.052177 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:00:28 crc kubenswrapper[5120]: I0316 17:00:28.100659 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0e6277f8-02ed-4429-af86-af38266195cd-combined-ca-bundle\") pod \"0e6277f8-02ed-4429-af86-af38266195cd\" (UID: \"0e6277f8-02ed-4429-af86-af38266195cd\") " Mar 16 17:00:28 crc kubenswrapper[5120]: I0316 17:00:28.100831 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/0e6277f8-02ed-4429-af86-af38266195cd-public-tls-certs\") pod \"0e6277f8-02ed-4429-af86-af38266195cd\" (UID: \"0e6277f8-02ed-4429-af86-af38266195cd\") " Mar 16 17:00:28 crc kubenswrapper[5120]: I0316 17:00:28.100861 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8n9kb\" (UniqueName: \"kubernetes.io/projected/0e6277f8-02ed-4429-af86-af38266195cd-kube-api-access-8n9kb\") pod \"0e6277f8-02ed-4429-af86-af38266195cd\" (UID: \"0e6277f8-02ed-4429-af86-af38266195cd\") " Mar 16 17:00:28 crc kubenswrapper[5120]: I0316 17:00:28.100989 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/0e6277f8-02ed-4429-af86-af38266195cd-internal-tls-certs\") pod \"0e6277f8-02ed-4429-af86-af38266195cd\" (UID: \"0e6277f8-02ed-4429-af86-af38266195cd\") " Mar 16 17:00:28 crc kubenswrapper[5120]: I0316 17:00:28.101199 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0e6277f8-02ed-4429-af86-af38266195cd-config-data\") pod \"0e6277f8-02ed-4429-af86-af38266195cd\" (UID: \"0e6277f8-02ed-4429-af86-af38266195cd\") " Mar 16 17:00:28 crc kubenswrapper[5120]: I0316 17:00:28.101368 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0e6277f8-02ed-4429-af86-af38266195cd-logs\") pod \"0e6277f8-02ed-4429-af86-af38266195cd\" (UID: \"0e6277f8-02ed-4429-af86-af38266195cd\") " Mar 16 17:00:28 crc kubenswrapper[5120]: I0316 17:00:28.102793 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e6277f8-02ed-4429-af86-af38266195cd-logs" (OuterVolumeSpecName: "logs") pod "0e6277f8-02ed-4429-af86-af38266195cd" (UID: "0e6277f8-02ed-4429-af86-af38266195cd"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:00:28 crc kubenswrapper[5120]: I0316 17:00:28.108959 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e6277f8-02ed-4429-af86-af38266195cd-kube-api-access-8n9kb" (OuterVolumeSpecName: "kube-api-access-8n9kb") pod "0e6277f8-02ed-4429-af86-af38266195cd" (UID: "0e6277f8-02ed-4429-af86-af38266195cd"). InnerVolumeSpecName "kube-api-access-8n9kb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:00:28 crc kubenswrapper[5120]: I0316 17:00:28.139203 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e6277f8-02ed-4429-af86-af38266195cd-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "0e6277f8-02ed-4429-af86-af38266195cd" (UID: "0e6277f8-02ed-4429-af86-af38266195cd"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:28 crc kubenswrapper[5120]: I0316 17:00:28.166111 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e6277f8-02ed-4429-af86-af38266195cd-config-data" (OuterVolumeSpecName: "config-data") pod "0e6277f8-02ed-4429-af86-af38266195cd" (UID: "0e6277f8-02ed-4429-af86-af38266195cd"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:28 crc kubenswrapper[5120]: I0316 17:00:28.186246 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e6277f8-02ed-4429-af86-af38266195cd-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "0e6277f8-02ed-4429-af86-af38266195cd" (UID: "0e6277f8-02ed-4429-af86-af38266195cd"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:28 crc kubenswrapper[5120]: I0316 17:00:28.192776 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e6277f8-02ed-4429-af86-af38266195cd-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "0e6277f8-02ed-4429-af86-af38266195cd" (UID: "0e6277f8-02ed-4429-af86-af38266195cd"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:28 crc kubenswrapper[5120]: I0316 17:00:28.204867 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0e6277f8-02ed-4429-af86-af38266195cd-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:28 crc kubenswrapper[5120]: I0316 17:00:28.204913 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0e6277f8-02ed-4429-af86-af38266195cd-logs\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:28 crc kubenswrapper[5120]: I0316 17:00:28.204929 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0e6277f8-02ed-4429-af86-af38266195cd-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:28 crc kubenswrapper[5120]: I0316 17:00:28.204945 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/0e6277f8-02ed-4429-af86-af38266195cd-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:28 crc kubenswrapper[5120]: I0316 17:00:28.204960 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8n9kb\" (UniqueName: \"kubernetes.io/projected/0e6277f8-02ed-4429-af86-af38266195cd-kube-api-access-8n9kb\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:28 crc kubenswrapper[5120]: I0316 17:00:28.204972 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/0e6277f8-02ed-4429-af86-af38266195cd-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:28 crc kubenswrapper[5120]: I0316 17:00:28.317920 5120 generic.go:358] "Generic (PLEG): container finished" podID="0e6277f8-02ed-4429-af86-af38266195cd" containerID="e33012e656c2cd8d2e08efcbaefc5187f1c017846cac5c2b21e89bb0c4991a80" exitCode=0 Mar 16 17:00:28 crc kubenswrapper[5120]: I0316 17:00:28.318081 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"0e6277f8-02ed-4429-af86-af38266195cd","Type":"ContainerDied","Data":"e33012e656c2cd8d2e08efcbaefc5187f1c017846cac5c2b21e89bb0c4991a80"} Mar 16 17:00:28 crc kubenswrapper[5120]: I0316 17:00:28.318113 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"0e6277f8-02ed-4429-af86-af38266195cd","Type":"ContainerDied","Data":"4a693d5b0a72585a56714f23f52f8767f937be6c8c804223fc0f495509e0676a"} Mar 16 17:00:28 crc kubenswrapper[5120]: I0316 17:00:28.318133 5120 scope.go:117] "RemoveContainer" containerID="e33012e656c2cd8d2e08efcbaefc5187f1c017846cac5c2b21e89bb0c4991a80" Mar 16 17:00:28 crc kubenswrapper[5120]: I0316 17:00:28.318317 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:00:28 crc kubenswrapper[5120]: I0316 17:00:28.329055 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-5b9b97df74-9rl5z" event={"ID":"9c429916-2d70-42f0-a572-90ab8aafafbe","Type":"ContainerStarted","Data":"8c3e9f0e4cad0fda0af2b317f990769cd6b26ce52d37356ab5cfcec66dfb8757"} Mar 16 17:00:28 crc kubenswrapper[5120]: I0316 17:00:28.329100 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-5b9b97df74-9rl5z" event={"ID":"9c429916-2d70-42f0-a572-90ab8aafafbe","Type":"ContainerStarted","Data":"8bbb4b9ac5e73a3c5982e6e3cb81df81774ea281b4ed6d95df533b9469474139"} Mar 16 17:00:28 crc kubenswrapper[5120]: I0316 17:00:28.333728 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"6fdf4b26-c833-4319-954a-7ebaaedb71e5","Type":"ContainerStarted","Data":"3655ac4348732f181824d8b56c72c7de7b64844e0300e8e4f1f18a838415654b"} Mar 16 17:00:28 crc kubenswrapper[5120]: I0316 17:00:28.333788 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"6fdf4b26-c833-4319-954a-7ebaaedb71e5","Type":"ContainerStarted","Data":"d57fa08f95a6cfcfd09827365e075bbb88ead4151737bba2848bcdf78f8d733f"} Mar 16 17:00:28 crc kubenswrapper[5120]: I0316 17:00:28.342309 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:00:28 crc kubenswrapper[5120]: I0316 17:00:28.342364 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:00:28 crc kubenswrapper[5120]: I0316 17:00:28.359046 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podStartSLOduration=2.359023321 podStartE2EDuration="2.359023321s" podCreationTimestamp="2026-03-16 17:00:26 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:00:28.349722627 +0000 UTC m=+5330.503654294" watchObservedRunningTime="2026-03-16 17:00:28.359023321 +0000 UTC m=+5330.512954998" Mar 16 17:00:28 crc kubenswrapper[5120]: I0316 17:00:28.373032 5120 scope.go:117] "RemoveContainer" containerID="df644605668cb6409e0b440fc58164a055f8c2e58033000e364530db958fe591" Mar 16 17:00:28 crc kubenswrapper[5120]: I0316 17:00:28.379010 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 17:00:28 crc kubenswrapper[5120]: I0316 17:00:28.392012 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 17:00:28 crc kubenswrapper[5120]: I0316 17:00:28.401198 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 17:00:28 crc kubenswrapper[5120]: I0316 17:00:28.402259 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e6277f8-02ed-4429-af86-af38266195cd" containerName="nova-api-log" Mar 16 17:00:28 crc kubenswrapper[5120]: I0316 17:00:28.402279 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e6277f8-02ed-4429-af86-af38266195cd" containerName="nova-api-log" Mar 16 17:00:28 crc kubenswrapper[5120]: I0316 17:00:28.402328 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e6277f8-02ed-4429-af86-af38266195cd" containerName="nova-api-api" Mar 16 17:00:28 crc kubenswrapper[5120]: I0316 17:00:28.402334 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e6277f8-02ed-4429-af86-af38266195cd" containerName="nova-api-api" Mar 16 17:00:28 crc kubenswrapper[5120]: I0316 17:00:28.402523 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="0e6277f8-02ed-4429-af86-af38266195cd" containerName="nova-api-log" Mar 16 17:00:28 crc kubenswrapper[5120]: I0316 17:00:28.402535 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="0e6277f8-02ed-4429-af86-af38266195cd" containerName="nova-api-api" Mar 16 17:00:28 crc kubenswrapper[5120]: I0316 17:00:28.420379 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:00:28 crc kubenswrapper[5120]: I0316 17:00:28.420427 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 17:00:28 crc kubenswrapper[5120]: I0316 17:00:28.420477 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:00:28 crc kubenswrapper[5120]: I0316 17:00:28.427197 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:00:28 crc kubenswrapper[5120]: I0316 17:00:28.427513 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-internal-svc\"" Mar 16 17:00:28 crc kubenswrapper[5120]: I0316 17:00:28.427675 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-public-svc\"" Mar 16 17:00:28 crc kubenswrapper[5120]: I0316 17:00:28.428085 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-config-data\"" Mar 16 17:00:28 crc kubenswrapper[5120]: I0316 17:00:28.454879 5120 scope.go:117] "RemoveContainer" containerID="e33012e656c2cd8d2e08efcbaefc5187f1c017846cac5c2b21e89bb0c4991a80" Mar 16 17:00:28 crc kubenswrapper[5120]: E0316 17:00:28.457087 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e33012e656c2cd8d2e08efcbaefc5187f1c017846cac5c2b21e89bb0c4991a80\": container with ID starting with e33012e656c2cd8d2e08efcbaefc5187f1c017846cac5c2b21e89bb0c4991a80 not found: ID does not exist" containerID="e33012e656c2cd8d2e08efcbaefc5187f1c017846cac5c2b21e89bb0c4991a80" Mar 16 17:00:28 crc kubenswrapper[5120]: I0316 17:00:28.457131 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e33012e656c2cd8d2e08efcbaefc5187f1c017846cac5c2b21e89bb0c4991a80"} err="failed to get container status \"e33012e656c2cd8d2e08efcbaefc5187f1c017846cac5c2b21e89bb0c4991a80\": rpc error: code = NotFound desc = could not find container \"e33012e656c2cd8d2e08efcbaefc5187f1c017846cac5c2b21e89bb0c4991a80\": container with ID starting with e33012e656c2cd8d2e08efcbaefc5187f1c017846cac5c2b21e89bb0c4991a80 not found: ID does not exist" Mar 16 17:00:28 crc kubenswrapper[5120]: I0316 17:00:28.457155 5120 scope.go:117] "RemoveContainer" containerID="df644605668cb6409e0b440fc58164a055f8c2e58033000e364530db958fe591" Mar 16 17:00:28 crc kubenswrapper[5120]: E0316 17:00:28.457671 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df644605668cb6409e0b440fc58164a055f8c2e58033000e364530db958fe591\": container with ID starting with df644605668cb6409e0b440fc58164a055f8c2e58033000e364530db958fe591 not found: ID does not exist" containerID="df644605668cb6409e0b440fc58164a055f8c2e58033000e364530db958fe591" Mar 16 17:00:28 crc kubenswrapper[5120]: I0316 17:00:28.457717 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df644605668cb6409e0b440fc58164a055f8c2e58033000e364530db958fe591"} err="failed to get container status \"df644605668cb6409e0b440fc58164a055f8c2e58033000e364530db958fe591\": rpc error: code = NotFound desc = could not find container \"df644605668cb6409e0b440fc58164a055f8c2e58033000e364530db958fe591\": container with ID starting with df644605668cb6409e0b440fc58164a055f8c2e58033000e364530db958fe591 not found: ID does not exist" Mar 16 17:00:28 crc kubenswrapper[5120]: I0316 17:00:28.494519 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:00:28 crc kubenswrapper[5120]: I0316 17:00:28.575587 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:00:28 crc kubenswrapper[5120]: I0316 17:00:28.585192 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:00:28 crc kubenswrapper[5120]: I0316 17:00:28.617637 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5e3627d3-225e-4cd9-b5fb-9a27c888e1e1-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"5e3627d3-225e-4cd9-b5fb-9a27c888e1e1\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:00:28 crc kubenswrapper[5120]: I0316 17:00:28.617989 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5e3627d3-225e-4cd9-b5fb-9a27c888e1e1-config-data\") pod \"nova-api-0\" (UID: \"5e3627d3-225e-4cd9-b5fb-9a27c888e1e1\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:00:28 crc kubenswrapper[5120]: I0316 17:00:28.618039 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/5e3627d3-225e-4cd9-b5fb-9a27c888e1e1-internal-tls-certs\") pod \"nova-api-0\" (UID: \"5e3627d3-225e-4cd9-b5fb-9a27c888e1e1\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:00:28 crc kubenswrapper[5120]: I0316 17:00:28.619861 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlzf4\" (UniqueName: \"kubernetes.io/projected/5e3627d3-225e-4cd9-b5fb-9a27c888e1e1-kube-api-access-jlzf4\") pod \"nova-api-0\" (UID: \"5e3627d3-225e-4cd9-b5fb-9a27c888e1e1\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:00:28 crc kubenswrapper[5120]: I0316 17:00:28.619990 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5e3627d3-225e-4cd9-b5fb-9a27c888e1e1-logs\") pod \"nova-api-0\" (UID: \"5e3627d3-225e-4cd9-b5fb-9a27c888e1e1\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:00:28 crc kubenswrapper[5120]: I0316 17:00:28.620248 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/5e3627d3-225e-4cd9-b5fb-9a27c888e1e1-public-tls-certs\") pod \"nova-api-0\" (UID: \"5e3627d3-225e-4cd9-b5fb-9a27c888e1e1\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:00:28 crc kubenswrapper[5120]: I0316 17:00:28.631447 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:00:28 crc kubenswrapper[5120]: I0316 17:00:28.635474 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:00:28 crc kubenswrapper[5120]: I0316 17:00:28.694314 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0e6277f8-02ed-4429-af86-af38266195cd" path="/var/lib/kubelet/pods/0e6277f8-02ed-4429-af86-af38266195cd/volumes" Mar 16 17:00:28 crc kubenswrapper[5120]: I0316 17:00:28.725141 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5e3627d3-225e-4cd9-b5fb-9a27c888e1e1-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"5e3627d3-225e-4cd9-b5fb-9a27c888e1e1\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:00:28 crc kubenswrapper[5120]: I0316 17:00:28.725304 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5e3627d3-225e-4cd9-b5fb-9a27c888e1e1-config-data\") pod \"nova-api-0\" (UID: \"5e3627d3-225e-4cd9-b5fb-9a27c888e1e1\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:00:28 crc kubenswrapper[5120]: I0316 17:00:28.725344 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/5e3627d3-225e-4cd9-b5fb-9a27c888e1e1-internal-tls-certs\") pod \"nova-api-0\" (UID: \"5e3627d3-225e-4cd9-b5fb-9a27c888e1e1\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:00:28 crc kubenswrapper[5120]: I0316 17:00:28.725423 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jlzf4\" (UniqueName: \"kubernetes.io/projected/5e3627d3-225e-4cd9-b5fb-9a27c888e1e1-kube-api-access-jlzf4\") pod \"nova-api-0\" (UID: \"5e3627d3-225e-4cd9-b5fb-9a27c888e1e1\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:00:28 crc kubenswrapper[5120]: I0316 17:00:28.725501 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5e3627d3-225e-4cd9-b5fb-9a27c888e1e1-logs\") pod \"nova-api-0\" (UID: \"5e3627d3-225e-4cd9-b5fb-9a27c888e1e1\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:00:28 crc kubenswrapper[5120]: I0316 17:00:28.725641 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/5e3627d3-225e-4cd9-b5fb-9a27c888e1e1-public-tls-certs\") pod \"nova-api-0\" (UID: \"5e3627d3-225e-4cd9-b5fb-9a27c888e1e1\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:00:28 crc kubenswrapper[5120]: I0316 17:00:28.730681 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5e3627d3-225e-4cd9-b5fb-9a27c888e1e1-logs\") pod \"nova-api-0\" (UID: \"5e3627d3-225e-4cd9-b5fb-9a27c888e1e1\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:00:28 crc kubenswrapper[5120]: I0316 17:00:28.739363 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/5e3627d3-225e-4cd9-b5fb-9a27c888e1e1-internal-tls-certs\") pod \"nova-api-0\" (UID: \"5e3627d3-225e-4cd9-b5fb-9a27c888e1e1\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:00:28 crc kubenswrapper[5120]: I0316 17:00:28.745556 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5e3627d3-225e-4cd9-b5fb-9a27c888e1e1-config-data\") pod \"nova-api-0\" (UID: \"5e3627d3-225e-4cd9-b5fb-9a27c888e1e1\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:00:28 crc kubenswrapper[5120]: I0316 17:00:28.746542 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5e3627d3-225e-4cd9-b5fb-9a27c888e1e1-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"5e3627d3-225e-4cd9-b5fb-9a27c888e1e1\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:00:28 crc kubenswrapper[5120]: I0316 17:00:28.753530 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/5e3627d3-225e-4cd9-b5fb-9a27c888e1e1-public-tls-certs\") pod \"nova-api-0\" (UID: \"5e3627d3-225e-4cd9-b5fb-9a27c888e1e1\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:00:28 crc kubenswrapper[5120]: I0316 17:00:28.806888 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlzf4\" (UniqueName: \"kubernetes.io/projected/5e3627d3-225e-4cd9-b5fb-9a27c888e1e1-kube-api-access-jlzf4\") pod \"nova-api-0\" (UID: \"5e3627d3-225e-4cd9-b5fb-9a27c888e1e1\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:00:28 crc kubenswrapper[5120]: I0316 17:00:28.807974 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:00:28 crc kubenswrapper[5120]: I0316 17:00:28.838289 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:00:29 crc kubenswrapper[5120]: I0316 17:00:29.329793 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 17:00:29 crc kubenswrapper[5120]: I0316 17:00:29.353875 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-5b9b97df74-9rl5z" event={"ID":"9c429916-2d70-42f0-a572-90ab8aafafbe","Type":"ContainerStarted","Data":"3ece0d70ebee943dfa6da07bcdd8a9f1af493f5fb471bb0e8264cf34758995a3"} Mar 16 17:00:29 crc kubenswrapper[5120]: I0316 17:00:29.355376 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-5b9b97df74-9rl5z" Mar 16 17:00:29 crc kubenswrapper[5120]: I0316 17:00:29.355415 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-5b9b97df74-9rl5z" Mar 16 17:00:29 crc kubenswrapper[5120]: I0316 17:00:29.368470 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"5e3627d3-225e-4cd9-b5fb-9a27c888e1e1","Type":"ContainerStarted","Data":"a47757cfe1af456415267ec12f56235a1268ca8872a59bd8521881d1fa130202"} Mar 16 17:00:29 crc kubenswrapper[5120]: I0316 17:00:29.370855 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:00:29 crc kubenswrapper[5120]: I0316 17:00:29.370937 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:00:29 crc kubenswrapper[5120]: I0316 17:00:29.370952 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:00:29 crc kubenswrapper[5120]: I0316 17:00:29.370964 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:00:29 crc kubenswrapper[5120]: I0316 17:00:29.379425 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-5b9b97df74-9rl5z" podStartSLOduration=3.379401799 podStartE2EDuration="3.379401799s" podCreationTimestamp="2026-03-16 17:00:26 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:00:29.376638704 +0000 UTC m=+5331.530570361" watchObservedRunningTime="2026-03-16 17:00:29.379401799 +0000 UTC m=+5331.533333486" Mar 16 17:00:29 crc kubenswrapper[5120]: I0316 17:00:29.546255 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:00:29 crc kubenswrapper[5120]: I0316 17:00:29.617055 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:00:29 crc kubenswrapper[5120]: I0316 17:00:29.846955 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 17:00:29 crc kubenswrapper[5120]: I0316 17:00:29.847222 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="8ac9683b-983c-44fd-a877-d2ae1cc5ae93" containerName="cinder-api-log" containerID="cri-o://6a153038229a3e0ad4ede09650ddb823d2b4cb2b19320b55217a3a9dab56c573" gracePeriod=30 Mar 16 17:00:29 crc kubenswrapper[5120]: I0316 17:00:29.847342 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="8ac9683b-983c-44fd-a877-d2ae1cc5ae93" containerName="cinder-api" containerID="cri-o://b06817a6b7e865eb89cf033595c6aa097eb8d2fe72c72a808c6bea7f30f1fbec" gracePeriod=30 Mar 16 17:00:30 crc kubenswrapper[5120]: I0316 17:00:30.072419 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-api-5b7968964b-sgwq2"] Mar 16 17:00:30 crc kubenswrapper[5120]: I0316 17:00:30.138992 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-5b7968964b-sgwq2"] Mar 16 17:00:30 crc kubenswrapper[5120]: I0316 17:00:30.139139 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-5b7968964b-sgwq2" Mar 16 17:00:30 crc kubenswrapper[5120]: I0316 17:00:30.247351 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e78c00c6-8a77-403d-a9f1-49d34962c3f7-public-tls-certs\") pod \"barbican-api-5b7968964b-sgwq2\" (UID: \"e78c00c6-8a77-403d-a9f1-49d34962c3f7\") " pod="openstack-kuttl-tests/barbican-api-5b7968964b-sgwq2" Mar 16 17:00:30 crc kubenswrapper[5120]: I0316 17:00:30.247698 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e78c00c6-8a77-403d-a9f1-49d34962c3f7-logs\") pod \"barbican-api-5b7968964b-sgwq2\" (UID: \"e78c00c6-8a77-403d-a9f1-49d34962c3f7\") " pod="openstack-kuttl-tests/barbican-api-5b7968964b-sgwq2" Mar 16 17:00:30 crc kubenswrapper[5120]: I0316 17:00:30.247975 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/e78c00c6-8a77-403d-a9f1-49d34962c3f7-config-data-custom\") pod \"barbican-api-5b7968964b-sgwq2\" (UID: \"e78c00c6-8a77-403d-a9f1-49d34962c3f7\") " pod="openstack-kuttl-tests/barbican-api-5b7968964b-sgwq2" Mar 16 17:00:30 crc kubenswrapper[5120]: I0316 17:00:30.248053 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9wqh\" (UniqueName: \"kubernetes.io/projected/e78c00c6-8a77-403d-a9f1-49d34962c3f7-kube-api-access-t9wqh\") pod \"barbican-api-5b7968964b-sgwq2\" (UID: \"e78c00c6-8a77-403d-a9f1-49d34962c3f7\") " pod="openstack-kuttl-tests/barbican-api-5b7968964b-sgwq2" Mar 16 17:00:30 crc kubenswrapper[5120]: I0316 17:00:30.248473 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e78c00c6-8a77-403d-a9f1-49d34962c3f7-config-data\") pod \"barbican-api-5b7968964b-sgwq2\" (UID: \"e78c00c6-8a77-403d-a9f1-49d34962c3f7\") " pod="openstack-kuttl-tests/barbican-api-5b7968964b-sgwq2" Mar 16 17:00:30 crc kubenswrapper[5120]: I0316 17:00:30.248554 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e78c00c6-8a77-403d-a9f1-49d34962c3f7-internal-tls-certs\") pod \"barbican-api-5b7968964b-sgwq2\" (UID: \"e78c00c6-8a77-403d-a9f1-49d34962c3f7\") " pod="openstack-kuttl-tests/barbican-api-5b7968964b-sgwq2" Mar 16 17:00:30 crc kubenswrapper[5120]: I0316 17:00:30.248939 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e78c00c6-8a77-403d-a9f1-49d34962c3f7-combined-ca-bundle\") pod \"barbican-api-5b7968964b-sgwq2\" (UID: \"e78c00c6-8a77-403d-a9f1-49d34962c3f7\") " pod="openstack-kuttl-tests/barbican-api-5b7968964b-sgwq2" Mar 16 17:00:30 crc kubenswrapper[5120]: I0316 17:00:30.354279 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e78c00c6-8a77-403d-a9f1-49d34962c3f7-combined-ca-bundle\") pod \"barbican-api-5b7968964b-sgwq2\" (UID: \"e78c00c6-8a77-403d-a9f1-49d34962c3f7\") " pod="openstack-kuttl-tests/barbican-api-5b7968964b-sgwq2" Mar 16 17:00:30 crc kubenswrapper[5120]: I0316 17:00:30.355215 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e78c00c6-8a77-403d-a9f1-49d34962c3f7-public-tls-certs\") pod \"barbican-api-5b7968964b-sgwq2\" (UID: \"e78c00c6-8a77-403d-a9f1-49d34962c3f7\") " pod="openstack-kuttl-tests/barbican-api-5b7968964b-sgwq2" Mar 16 17:00:30 crc kubenswrapper[5120]: I0316 17:00:30.355265 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e78c00c6-8a77-403d-a9f1-49d34962c3f7-logs\") pod \"barbican-api-5b7968964b-sgwq2\" (UID: \"e78c00c6-8a77-403d-a9f1-49d34962c3f7\") " pod="openstack-kuttl-tests/barbican-api-5b7968964b-sgwq2" Mar 16 17:00:30 crc kubenswrapper[5120]: I0316 17:00:30.355441 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/e78c00c6-8a77-403d-a9f1-49d34962c3f7-config-data-custom\") pod \"barbican-api-5b7968964b-sgwq2\" (UID: \"e78c00c6-8a77-403d-a9f1-49d34962c3f7\") " pod="openstack-kuttl-tests/barbican-api-5b7968964b-sgwq2" Mar 16 17:00:30 crc kubenswrapper[5120]: I0316 17:00:30.355507 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t9wqh\" (UniqueName: \"kubernetes.io/projected/e78c00c6-8a77-403d-a9f1-49d34962c3f7-kube-api-access-t9wqh\") pod \"barbican-api-5b7968964b-sgwq2\" (UID: \"e78c00c6-8a77-403d-a9f1-49d34962c3f7\") " pod="openstack-kuttl-tests/barbican-api-5b7968964b-sgwq2" Mar 16 17:00:30 crc kubenswrapper[5120]: I0316 17:00:30.355583 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e78c00c6-8a77-403d-a9f1-49d34962c3f7-config-data\") pod \"barbican-api-5b7968964b-sgwq2\" (UID: \"e78c00c6-8a77-403d-a9f1-49d34962c3f7\") " pod="openstack-kuttl-tests/barbican-api-5b7968964b-sgwq2" Mar 16 17:00:30 crc kubenswrapper[5120]: I0316 17:00:30.355621 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e78c00c6-8a77-403d-a9f1-49d34962c3f7-internal-tls-certs\") pod \"barbican-api-5b7968964b-sgwq2\" (UID: \"e78c00c6-8a77-403d-a9f1-49d34962c3f7\") " pod="openstack-kuttl-tests/barbican-api-5b7968964b-sgwq2" Mar 16 17:00:30 crc kubenswrapper[5120]: I0316 17:00:30.360325 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e78c00c6-8a77-403d-a9f1-49d34962c3f7-logs\") pod \"barbican-api-5b7968964b-sgwq2\" (UID: \"e78c00c6-8a77-403d-a9f1-49d34962c3f7\") " pod="openstack-kuttl-tests/barbican-api-5b7968964b-sgwq2" Mar 16 17:00:30 crc kubenswrapper[5120]: I0316 17:00:30.361285 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e78c00c6-8a77-403d-a9f1-49d34962c3f7-internal-tls-certs\") pod \"barbican-api-5b7968964b-sgwq2\" (UID: \"e78c00c6-8a77-403d-a9f1-49d34962c3f7\") " pod="openstack-kuttl-tests/barbican-api-5b7968964b-sgwq2" Mar 16 17:00:30 crc kubenswrapper[5120]: I0316 17:00:30.362007 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e78c00c6-8a77-403d-a9f1-49d34962c3f7-combined-ca-bundle\") pod \"barbican-api-5b7968964b-sgwq2\" (UID: \"e78c00c6-8a77-403d-a9f1-49d34962c3f7\") " pod="openstack-kuttl-tests/barbican-api-5b7968964b-sgwq2" Mar 16 17:00:30 crc kubenswrapper[5120]: I0316 17:00:30.364401 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e78c00c6-8a77-403d-a9f1-49d34962c3f7-public-tls-certs\") pod \"barbican-api-5b7968964b-sgwq2\" (UID: \"e78c00c6-8a77-403d-a9f1-49d34962c3f7\") " pod="openstack-kuttl-tests/barbican-api-5b7968964b-sgwq2" Mar 16 17:00:30 crc kubenswrapper[5120]: I0316 17:00:30.365780 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e78c00c6-8a77-403d-a9f1-49d34962c3f7-config-data\") pod \"barbican-api-5b7968964b-sgwq2\" (UID: \"e78c00c6-8a77-403d-a9f1-49d34962c3f7\") " pod="openstack-kuttl-tests/barbican-api-5b7968964b-sgwq2" Mar 16 17:00:30 crc kubenswrapper[5120]: I0316 17:00:30.366293 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/e78c00c6-8a77-403d-a9f1-49d34962c3f7-config-data-custom\") pod \"barbican-api-5b7968964b-sgwq2\" (UID: \"e78c00c6-8a77-403d-a9f1-49d34962c3f7\") " pod="openstack-kuttl-tests/barbican-api-5b7968964b-sgwq2" Mar 16 17:00:30 crc kubenswrapper[5120]: I0316 17:00:30.379390 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9wqh\" (UniqueName: \"kubernetes.io/projected/e78c00c6-8a77-403d-a9f1-49d34962c3f7-kube-api-access-t9wqh\") pod \"barbican-api-5b7968964b-sgwq2\" (UID: \"e78c00c6-8a77-403d-a9f1-49d34962c3f7\") " pod="openstack-kuttl-tests/barbican-api-5b7968964b-sgwq2" Mar 16 17:00:30 crc kubenswrapper[5120]: I0316 17:00:30.391199 5120 generic.go:358] "Generic (PLEG): container finished" podID="8ac9683b-983c-44fd-a877-d2ae1cc5ae93" containerID="6a153038229a3e0ad4ede09650ddb823d2b4cb2b19320b55217a3a9dab56c573" exitCode=143 Mar 16 17:00:30 crc kubenswrapper[5120]: I0316 17:00:30.391335 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"8ac9683b-983c-44fd-a877-d2ae1cc5ae93","Type":"ContainerDied","Data":"6a153038229a3e0ad4ede09650ddb823d2b4cb2b19320b55217a3a9dab56c573"} Mar 16 17:00:30 crc kubenswrapper[5120]: I0316 17:00:30.419130 5120 generic.go:358] "Generic (PLEG): container finished" podID="07433ec1-a6dc-48a4-8374-8260c23db816" containerID="b7185365438c501fea659d44b0265e1ac0ff2a84cf85471c746ee7f483aa0b4e" exitCode=0 Mar 16 17:00:30 crc kubenswrapper[5120]: I0316 17:00:30.419208 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"07433ec1-a6dc-48a4-8374-8260c23db816","Type":"ContainerDied","Data":"b7185365438c501fea659d44b0265e1ac0ff2a84cf85471c746ee7f483aa0b4e"} Mar 16 17:00:30 crc kubenswrapper[5120]: I0316 17:00:30.420110 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"07433ec1-a6dc-48a4-8374-8260c23db816","Type":"ContainerDied","Data":"0e84cc975c1578089f18cfc79c7d2767659b11c27e73a227e46f4578fb381522"} Mar 16 17:00:30 crc kubenswrapper[5120]: I0316 17:00:30.420123 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0e84cc975c1578089f18cfc79c7d2767659b11c27e73a227e46f4578fb381522" Mar 16 17:00:30 crc kubenswrapper[5120]: I0316 17:00:30.429434 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"5e3627d3-225e-4cd9-b5fb-9a27c888e1e1","Type":"ContainerStarted","Data":"6706e0144fa060f50b0e39d25b8522795d2fe95416f82712ad1b24882f9fff1a"} Mar 16 17:00:30 crc kubenswrapper[5120]: I0316 17:00:30.429570 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"5e3627d3-225e-4cd9-b5fb-9a27c888e1e1","Type":"ContainerStarted","Data":"c0ab31c9aab17588366733825ad14e257d3b43a783281ffa0077f78647ed983a"} Mar 16 17:00:30 crc kubenswrapper[5120]: I0316 17:00:30.463123 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=2.463097391 podStartE2EDuration="2.463097391s" podCreationTimestamp="2026-03-16 17:00:28 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:00:30.453821067 +0000 UTC m=+5332.607752714" watchObservedRunningTime="2026-03-16 17:00:30.463097391 +0000 UTC m=+5332.617029048" Mar 16 17:00:30 crc kubenswrapper[5120]: I0316 17:00:30.479183 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-5b7968964b-sgwq2" Mar 16 17:00:30 crc kubenswrapper[5120]: I0316 17:00:30.533641 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:00:30 crc kubenswrapper[5120]: I0316 17:00:30.566900 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/07433ec1-a6dc-48a4-8374-8260c23db816-scripts\") pod \"07433ec1-a6dc-48a4-8374-8260c23db816\" (UID: \"07433ec1-a6dc-48a4-8374-8260c23db816\") " Mar 16 17:00:30 crc kubenswrapper[5120]: I0316 17:00:30.568068 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/07433ec1-a6dc-48a4-8374-8260c23db816-sg-core-conf-yaml\") pod \"07433ec1-a6dc-48a4-8374-8260c23db816\" (UID: \"07433ec1-a6dc-48a4-8374-8260c23db816\") " Mar 16 17:00:30 crc kubenswrapper[5120]: I0316 17:00:30.568450 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/07433ec1-a6dc-48a4-8374-8260c23db816-log-httpd\") pod \"07433ec1-a6dc-48a4-8374-8260c23db816\" (UID: \"07433ec1-a6dc-48a4-8374-8260c23db816\") " Mar 16 17:00:30 crc kubenswrapper[5120]: I0316 17:00:30.568740 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/07433ec1-a6dc-48a4-8374-8260c23db816-run-httpd\") pod \"07433ec1-a6dc-48a4-8374-8260c23db816\" (UID: \"07433ec1-a6dc-48a4-8374-8260c23db816\") " Mar 16 17:00:30 crc kubenswrapper[5120]: I0316 17:00:30.568925 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/07433ec1-a6dc-48a4-8374-8260c23db816-combined-ca-bundle\") pod \"07433ec1-a6dc-48a4-8374-8260c23db816\" (UID: \"07433ec1-a6dc-48a4-8374-8260c23db816\") " Mar 16 17:00:30 crc kubenswrapper[5120]: I0316 17:00:30.568986 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/07433ec1-a6dc-48a4-8374-8260c23db816-config-data\") pod \"07433ec1-a6dc-48a4-8374-8260c23db816\" (UID: \"07433ec1-a6dc-48a4-8374-8260c23db816\") " Mar 16 17:00:30 crc kubenswrapper[5120]: I0316 17:00:30.569408 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f2jl5\" (UniqueName: \"kubernetes.io/projected/07433ec1-a6dc-48a4-8374-8260c23db816-kube-api-access-f2jl5\") pod \"07433ec1-a6dc-48a4-8374-8260c23db816\" (UID: \"07433ec1-a6dc-48a4-8374-8260c23db816\") " Mar 16 17:00:30 crc kubenswrapper[5120]: I0316 17:00:30.569463 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/07433ec1-a6dc-48a4-8374-8260c23db816-ceilometer-tls-certs\") pod \"07433ec1-a6dc-48a4-8374-8260c23db816\" (UID: \"07433ec1-a6dc-48a4-8374-8260c23db816\") " Mar 16 17:00:30 crc kubenswrapper[5120]: I0316 17:00:30.574037 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07433ec1-a6dc-48a4-8374-8260c23db816-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "07433ec1-a6dc-48a4-8374-8260c23db816" (UID: "07433ec1-a6dc-48a4-8374-8260c23db816"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:00:30 crc kubenswrapper[5120]: I0316 17:00:30.584345 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07433ec1-a6dc-48a4-8374-8260c23db816-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "07433ec1-a6dc-48a4-8374-8260c23db816" (UID: "07433ec1-a6dc-48a4-8374-8260c23db816"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:00:30 crc kubenswrapper[5120]: I0316 17:00:30.610187 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07433ec1-a6dc-48a4-8374-8260c23db816-scripts" (OuterVolumeSpecName: "scripts") pod "07433ec1-a6dc-48a4-8374-8260c23db816" (UID: "07433ec1-a6dc-48a4-8374-8260c23db816"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:30 crc kubenswrapper[5120]: I0316 17:00:30.610555 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07433ec1-a6dc-48a4-8374-8260c23db816-kube-api-access-f2jl5" (OuterVolumeSpecName: "kube-api-access-f2jl5") pod "07433ec1-a6dc-48a4-8374-8260c23db816" (UID: "07433ec1-a6dc-48a4-8374-8260c23db816"). InnerVolumeSpecName "kube-api-access-f2jl5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:00:30 crc kubenswrapper[5120]: I0316 17:00:30.676902 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/07433ec1-a6dc-48a4-8374-8260c23db816-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:30 crc kubenswrapper[5120]: I0316 17:00:30.676944 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/07433ec1-a6dc-48a4-8374-8260c23db816-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:30 crc kubenswrapper[5120]: I0316 17:00:30.676958 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f2jl5\" (UniqueName: \"kubernetes.io/projected/07433ec1-a6dc-48a4-8374-8260c23db816-kube-api-access-f2jl5\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:30 crc kubenswrapper[5120]: I0316 17:00:30.676973 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/07433ec1-a6dc-48a4-8374-8260c23db816-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:30 crc kubenswrapper[5120]: I0316 17:00:30.703547 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07433ec1-a6dc-48a4-8374-8260c23db816-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "07433ec1-a6dc-48a4-8374-8260c23db816" (UID: "07433ec1-a6dc-48a4-8374-8260c23db816"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:30 crc kubenswrapper[5120]: I0316 17:00:30.717050 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07433ec1-a6dc-48a4-8374-8260c23db816-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "07433ec1-a6dc-48a4-8374-8260c23db816" (UID: "07433ec1-a6dc-48a4-8374-8260c23db816"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:30 crc kubenswrapper[5120]: I0316 17:00:30.750216 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07433ec1-a6dc-48a4-8374-8260c23db816-ceilometer-tls-certs" (OuterVolumeSpecName: "ceilometer-tls-certs") pod "07433ec1-a6dc-48a4-8374-8260c23db816" (UID: "07433ec1-a6dc-48a4-8374-8260c23db816"). InnerVolumeSpecName "ceilometer-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:30 crc kubenswrapper[5120]: I0316 17:00:30.752229 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07433ec1-a6dc-48a4-8374-8260c23db816-config-data" (OuterVolumeSpecName: "config-data") pod "07433ec1-a6dc-48a4-8374-8260c23db816" (UID: "07433ec1-a6dc-48a4-8374-8260c23db816"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:30 crc kubenswrapper[5120]: I0316 17:00:30.779608 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/07433ec1-a6dc-48a4-8374-8260c23db816-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:30 crc kubenswrapper[5120]: I0316 17:00:30.779649 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/07433ec1-a6dc-48a4-8374-8260c23db816-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:30 crc kubenswrapper[5120]: I0316 17:00:30.779659 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/07433ec1-a6dc-48a4-8374-8260c23db816-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:30 crc kubenswrapper[5120]: I0316 17:00:30.779667 5120 reconciler_common.go:299] "Volume detached for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/07433ec1-a6dc-48a4-8374-8260c23db816-ceilometer-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:30 crc kubenswrapper[5120]: I0316 17:00:30.821022 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:00:31 crc kubenswrapper[5120]: I0316 17:00:31.122443 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-5b7968964b-sgwq2"] Mar 16 17:00:31 crc kubenswrapper[5120]: I0316 17:00:31.383436 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-northd-0_b0790e22-4129-49de-b1d6-25c9288301f0/ovn-northd/0.log" Mar 16 17:00:31 crc kubenswrapper[5120]: I0316 17:00:31.383556 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:00:31 crc kubenswrapper[5120]: I0316 17:00:31.448251 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-5b7968964b-sgwq2" event={"ID":"e78c00c6-8a77-403d-a9f1-49d34962c3f7","Type":"ContainerStarted","Data":"02ba749f49d9fa91a059285655a4e950537e9843a2d24092f2d772aeea3b5575"} Mar 16 17:00:31 crc kubenswrapper[5120]: I0316 17:00:31.456501 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-northd-0_b0790e22-4129-49de-b1d6-25c9288301f0/ovn-northd/0.log" Mar 16 17:00:31 crc kubenswrapper[5120]: I0316 17:00:31.456549 5120 generic.go:358] "Generic (PLEG): container finished" podID="b0790e22-4129-49de-b1d6-25c9288301f0" containerID="25452cdb3754529b9172640423ac8e022a547938c3c8e33217454a9176746833" exitCode=139 Mar 16 17:00:31 crc kubenswrapper[5120]: I0316 17:00:31.456840 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"b0790e22-4129-49de-b1d6-25c9288301f0","Type":"ContainerDied","Data":"25452cdb3754529b9172640423ac8e022a547938c3c8e33217454a9176746833"} Mar 16 17:00:31 crc kubenswrapper[5120]: I0316 17:00:31.456902 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"b0790e22-4129-49de-b1d6-25c9288301f0","Type":"ContainerDied","Data":"1a34afdfb40e55068a874c665fa9417a3a0f138f37b8b4fe545eec99aaa2bf78"} Mar 16 17:00:31 crc kubenswrapper[5120]: I0316 17:00:31.456926 5120 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Mar 16 17:00:31 crc kubenswrapper[5120]: I0316 17:00:31.456921 5120 scope.go:117] "RemoveContainer" containerID="ea563bcfceca9858a012e2116c5b84a6aa7066ee3bdd5115c54f7a2c5841ad96" Mar 16 17:00:31 crc kubenswrapper[5120]: I0316 17:00:31.456950 5120 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Mar 16 17:00:31 crc kubenswrapper[5120]: I0316 17:00:31.457163 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:00:31 crc kubenswrapper[5120]: I0316 17:00:31.457393 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:00:31 crc kubenswrapper[5120]: I0316 17:00:31.502975 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:00:31 crc kubenswrapper[5120]: I0316 17:00:31.511551 5120 scope.go:117] "RemoveContainer" containerID="25452cdb3754529b9172640423ac8e022a547938c3c8e33217454a9176746833" Mar 16 17:00:31 crc kubenswrapper[5120]: I0316 17:00:31.512532 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b0790e22-4129-49de-b1d6-25c9288301f0-combined-ca-bundle\") pod \"b0790e22-4129-49de-b1d6-25c9288301f0\" (UID: \"b0790e22-4129-49de-b1d6-25c9288301f0\") " Mar 16 17:00:31 crc kubenswrapper[5120]: I0316 17:00:31.512650 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/b0790e22-4129-49de-b1d6-25c9288301f0-metrics-certs-tls-certs\") pod \"b0790e22-4129-49de-b1d6-25c9288301f0\" (UID: \"b0790e22-4129-49de-b1d6-25c9288301f0\") " Mar 16 17:00:31 crc kubenswrapper[5120]: I0316 17:00:31.512705 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b0790e22-4129-49de-b1d6-25c9288301f0-config\") pod \"b0790e22-4129-49de-b1d6-25c9288301f0\" (UID: \"b0790e22-4129-49de-b1d6-25c9288301f0\") " Mar 16 17:00:31 crc kubenswrapper[5120]: I0316 17:00:31.512727 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/b0790e22-4129-49de-b1d6-25c9288301f0-ovn-rundir\") pod \"b0790e22-4129-49de-b1d6-25c9288301f0\" (UID: \"b0790e22-4129-49de-b1d6-25c9288301f0\") " Mar 16 17:00:31 crc kubenswrapper[5120]: I0316 17:00:31.512808 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s29qb\" (UniqueName: \"kubernetes.io/projected/b0790e22-4129-49de-b1d6-25c9288301f0-kube-api-access-s29qb\") pod \"b0790e22-4129-49de-b1d6-25c9288301f0\" (UID: \"b0790e22-4129-49de-b1d6-25c9288301f0\") " Mar 16 17:00:31 crc kubenswrapper[5120]: I0316 17:00:31.512881 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/b0790e22-4129-49de-b1d6-25c9288301f0-scripts\") pod \"b0790e22-4129-49de-b1d6-25c9288301f0\" (UID: \"b0790e22-4129-49de-b1d6-25c9288301f0\") " Mar 16 17:00:31 crc kubenswrapper[5120]: I0316 17:00:31.513353 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:00:31 crc kubenswrapper[5120]: I0316 17:00:31.513477 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/b0790e22-4129-49de-b1d6-25c9288301f0-ovn-northd-tls-certs\") pod \"b0790e22-4129-49de-b1d6-25c9288301f0\" (UID: \"b0790e22-4129-49de-b1d6-25c9288301f0\") " Mar 16 17:00:31 crc kubenswrapper[5120]: I0316 17:00:31.514436 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0790e22-4129-49de-b1d6-25c9288301f0-ovn-rundir" (OuterVolumeSpecName: "ovn-rundir") pod "b0790e22-4129-49de-b1d6-25c9288301f0" (UID: "b0790e22-4129-49de-b1d6-25c9288301f0"). InnerVolumeSpecName "ovn-rundir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:00:31 crc kubenswrapper[5120]: I0316 17:00:31.515238 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b0790e22-4129-49de-b1d6-25c9288301f0-scripts" (OuterVolumeSpecName: "scripts") pod "b0790e22-4129-49de-b1d6-25c9288301f0" (UID: "b0790e22-4129-49de-b1d6-25c9288301f0"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:00:31 crc kubenswrapper[5120]: I0316 17:00:31.521449 5120 reconciler_common.go:299] "Volume detached for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/b0790e22-4129-49de-b1d6-25c9288301f0-ovn-rundir\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:31 crc kubenswrapper[5120]: I0316 17:00:31.521488 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/b0790e22-4129-49de-b1d6-25c9288301f0-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:31 crc kubenswrapper[5120]: I0316 17:00:31.529958 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0790e22-4129-49de-b1d6-25c9288301f0-kube-api-access-s29qb" (OuterVolumeSpecName: "kube-api-access-s29qb") pod "b0790e22-4129-49de-b1d6-25c9288301f0" (UID: "b0790e22-4129-49de-b1d6-25c9288301f0"). InnerVolumeSpecName "kube-api-access-s29qb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:00:31 crc kubenswrapper[5120]: I0316 17:00:31.538853 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b0790e22-4129-49de-b1d6-25c9288301f0-config" (OuterVolumeSpecName: "config") pod "b0790e22-4129-49de-b1d6-25c9288301f0" (UID: "b0790e22-4129-49de-b1d6-25c9288301f0"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:00:31 crc kubenswrapper[5120]: I0316 17:00:31.570740 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b0790e22-4129-49de-b1d6-25c9288301f0-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "b0790e22-4129-49de-b1d6-25c9288301f0" (UID: "b0790e22-4129-49de-b1d6-25c9288301f0"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:31 crc kubenswrapper[5120]: I0316 17:00:31.575261 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:00:31 crc kubenswrapper[5120]: I0316 17:00:31.576268 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07433ec1-a6dc-48a4-8374-8260c23db816" containerName="proxy-httpd" Mar 16 17:00:31 crc kubenswrapper[5120]: I0316 17:00:31.576285 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="07433ec1-a6dc-48a4-8374-8260c23db816" containerName="proxy-httpd" Mar 16 17:00:31 crc kubenswrapper[5120]: I0316 17:00:31.576300 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0790e22-4129-49de-b1d6-25c9288301f0" containerName="ovn-northd" Mar 16 17:00:31 crc kubenswrapper[5120]: I0316 17:00:31.576305 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0790e22-4129-49de-b1d6-25c9288301f0" containerName="ovn-northd" Mar 16 17:00:31 crc kubenswrapper[5120]: I0316 17:00:31.576322 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0790e22-4129-49de-b1d6-25c9288301f0" containerName="openstack-network-exporter" Mar 16 17:00:31 crc kubenswrapper[5120]: I0316 17:00:31.576328 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0790e22-4129-49de-b1d6-25c9288301f0" containerName="openstack-network-exporter" Mar 16 17:00:31 crc kubenswrapper[5120]: I0316 17:00:31.576343 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07433ec1-a6dc-48a4-8374-8260c23db816" containerName="sg-core" Mar 16 17:00:31 crc kubenswrapper[5120]: I0316 17:00:31.576349 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="07433ec1-a6dc-48a4-8374-8260c23db816" containerName="sg-core" Mar 16 17:00:31 crc kubenswrapper[5120]: I0316 17:00:31.576369 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07433ec1-a6dc-48a4-8374-8260c23db816" containerName="ceilometer-notification-agent" Mar 16 17:00:31 crc kubenswrapper[5120]: I0316 17:00:31.576376 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="07433ec1-a6dc-48a4-8374-8260c23db816" containerName="ceilometer-notification-agent" Mar 16 17:00:31 crc kubenswrapper[5120]: I0316 17:00:31.576399 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07433ec1-a6dc-48a4-8374-8260c23db816" containerName="ceilometer-central-agent" Mar 16 17:00:31 crc kubenswrapper[5120]: I0316 17:00:31.576405 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="07433ec1-a6dc-48a4-8374-8260c23db816" containerName="ceilometer-central-agent" Mar 16 17:00:31 crc kubenswrapper[5120]: I0316 17:00:31.576566 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="07433ec1-a6dc-48a4-8374-8260c23db816" containerName="sg-core" Mar 16 17:00:31 crc kubenswrapper[5120]: I0316 17:00:31.576585 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="07433ec1-a6dc-48a4-8374-8260c23db816" containerName="ceilometer-notification-agent" Mar 16 17:00:31 crc kubenswrapper[5120]: I0316 17:00:31.576594 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="07433ec1-a6dc-48a4-8374-8260c23db816" containerName="ceilometer-central-agent" Mar 16 17:00:31 crc kubenswrapper[5120]: I0316 17:00:31.576603 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="b0790e22-4129-49de-b1d6-25c9288301f0" containerName="openstack-network-exporter" Mar 16 17:00:31 crc kubenswrapper[5120]: I0316 17:00:31.576614 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="07433ec1-a6dc-48a4-8374-8260c23db816" containerName="proxy-httpd" Mar 16 17:00:31 crc kubenswrapper[5120]: I0316 17:00:31.576623 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="b0790e22-4129-49de-b1d6-25c9288301f0" containerName="ovn-northd" Mar 16 17:00:31 crc kubenswrapper[5120]: I0316 17:00:31.581242 5120 scope.go:117] "RemoveContainer" containerID="ea563bcfceca9858a012e2116c5b84a6aa7066ee3bdd5115c54f7a2c5841ad96" Mar 16 17:00:31 crc kubenswrapper[5120]: E0316 17:00:31.581677 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea563bcfceca9858a012e2116c5b84a6aa7066ee3bdd5115c54f7a2c5841ad96\": container with ID starting with ea563bcfceca9858a012e2116c5b84a6aa7066ee3bdd5115c54f7a2c5841ad96 not found: ID does not exist" containerID="ea563bcfceca9858a012e2116c5b84a6aa7066ee3bdd5115c54f7a2c5841ad96" Mar 16 17:00:31 crc kubenswrapper[5120]: I0316 17:00:31.581801 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea563bcfceca9858a012e2116c5b84a6aa7066ee3bdd5115c54f7a2c5841ad96"} err="failed to get container status \"ea563bcfceca9858a012e2116c5b84a6aa7066ee3bdd5115c54f7a2c5841ad96\": rpc error: code = NotFound desc = could not find container \"ea563bcfceca9858a012e2116c5b84a6aa7066ee3bdd5115c54f7a2c5841ad96\": container with ID starting with ea563bcfceca9858a012e2116c5b84a6aa7066ee3bdd5115c54f7a2c5841ad96 not found: ID does not exist" Mar 16 17:00:31 crc kubenswrapper[5120]: I0316 17:00:31.581915 5120 scope.go:117] "RemoveContainer" containerID="25452cdb3754529b9172640423ac8e022a547938c3c8e33217454a9176746833" Mar 16 17:00:31 crc kubenswrapper[5120]: E0316 17:00:31.582165 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"25452cdb3754529b9172640423ac8e022a547938c3c8e33217454a9176746833\": container with ID starting with 25452cdb3754529b9172640423ac8e022a547938c3c8e33217454a9176746833 not found: ID does not exist" containerID="25452cdb3754529b9172640423ac8e022a547938c3c8e33217454a9176746833" Mar 16 17:00:31 crc kubenswrapper[5120]: I0316 17:00:31.582253 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25452cdb3754529b9172640423ac8e022a547938c3c8e33217454a9176746833"} err="failed to get container status \"25452cdb3754529b9172640423ac8e022a547938c3c8e33217454a9176746833\": rpc error: code = NotFound desc = could not find container \"25452cdb3754529b9172640423ac8e022a547938c3c8e33217454a9176746833\": container with ID starting with 25452cdb3754529b9172640423ac8e022a547938c3c8e33217454a9176746833 not found: ID does not exist" Mar 16 17:00:31 crc kubenswrapper[5120]: I0316 17:00:31.590385 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:00:31 crc kubenswrapper[5120]: I0316 17:00:31.590526 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:00:31 crc kubenswrapper[5120]: I0316 17:00:31.593281 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 17:00:31 crc kubenswrapper[5120]: I0316 17:00:31.593593 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ceilometer-internal-svc\"" Mar 16 17:00:31 crc kubenswrapper[5120]: I0316 17:00:31.595109 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 17:00:31 crc kubenswrapper[5120]: I0316 17:00:31.622871 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b0790e22-4129-49de-b1d6-25c9288301f0-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "b0790e22-4129-49de-b1d6-25c9288301f0" (UID: "b0790e22-4129-49de-b1d6-25c9288301f0"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:31 crc kubenswrapper[5120]: I0316 17:00:31.624650 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b0790e22-4129-49de-b1d6-25c9288301f0-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:31 crc kubenswrapper[5120]: I0316 17:00:31.624670 5120 reconciler_common.go:299] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/b0790e22-4129-49de-b1d6-25c9288301f0-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:31 crc kubenswrapper[5120]: I0316 17:00:31.624681 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b0790e22-4129-49de-b1d6-25c9288301f0-config\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:31 crc kubenswrapper[5120]: I0316 17:00:31.624710 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s29qb\" (UniqueName: \"kubernetes.io/projected/b0790e22-4129-49de-b1d6-25c9288301f0-kube-api-access-s29qb\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:31 crc kubenswrapper[5120]: I0316 17:00:31.635851 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b0790e22-4129-49de-b1d6-25c9288301f0-ovn-northd-tls-certs" (OuterVolumeSpecName: "ovn-northd-tls-certs") pod "b0790e22-4129-49de-b1d6-25c9288301f0" (UID: "b0790e22-4129-49de-b1d6-25c9288301f0"). InnerVolumeSpecName "ovn-northd-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:31 crc kubenswrapper[5120]: I0316 17:00:31.727107 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bcvgz\" (UniqueName: \"kubernetes.io/projected/30bfa4fc-b416-4f16-b673-158d4a8c552a-kube-api-access-bcvgz\") pod \"ceilometer-0\" (UID: \"30bfa4fc-b416-4f16-b673-158d4a8c552a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:00:31 crc kubenswrapper[5120]: I0316 17:00:31.727501 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/30bfa4fc-b416-4f16-b673-158d4a8c552a-config-data\") pod \"ceilometer-0\" (UID: \"30bfa4fc-b416-4f16-b673-158d4a8c552a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:00:31 crc kubenswrapper[5120]: I0316 17:00:31.727867 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/30bfa4fc-b416-4f16-b673-158d4a8c552a-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"30bfa4fc-b416-4f16-b673-158d4a8c552a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:00:31 crc kubenswrapper[5120]: I0316 17:00:31.728085 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/30bfa4fc-b416-4f16-b673-158d4a8c552a-scripts\") pod \"ceilometer-0\" (UID: \"30bfa4fc-b416-4f16-b673-158d4a8c552a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:00:31 crc kubenswrapper[5120]: I0316 17:00:31.728304 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/30bfa4fc-b416-4f16-b673-158d4a8c552a-log-httpd\") pod \"ceilometer-0\" (UID: \"30bfa4fc-b416-4f16-b673-158d4a8c552a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:00:31 crc kubenswrapper[5120]: I0316 17:00:31.728463 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/30bfa4fc-b416-4f16-b673-158d4a8c552a-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"30bfa4fc-b416-4f16-b673-158d4a8c552a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:00:31 crc kubenswrapper[5120]: I0316 17:00:31.728750 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/30bfa4fc-b416-4f16-b673-158d4a8c552a-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"30bfa4fc-b416-4f16-b673-158d4a8c552a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:00:31 crc kubenswrapper[5120]: I0316 17:00:31.729087 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/30bfa4fc-b416-4f16-b673-158d4a8c552a-run-httpd\") pod \"ceilometer-0\" (UID: \"30bfa4fc-b416-4f16-b673-158d4a8c552a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:00:31 crc kubenswrapper[5120]: I0316 17:00:31.729411 5120 reconciler_common.go:299] "Volume detached for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/b0790e22-4129-49de-b1d6-25c9288301f0-ovn-northd-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:31 crc kubenswrapper[5120]: I0316 17:00:31.802803 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 17:00:31 crc kubenswrapper[5120]: I0316 17:00:31.821738 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 17:00:31 crc kubenswrapper[5120]: I0316 17:00:31.833548 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/30bfa4fc-b416-4f16-b673-158d4a8c552a-config-data\") pod \"ceilometer-0\" (UID: \"30bfa4fc-b416-4f16-b673-158d4a8c552a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:00:31 crc kubenswrapper[5120]: I0316 17:00:31.833637 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/30bfa4fc-b416-4f16-b673-158d4a8c552a-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"30bfa4fc-b416-4f16-b673-158d4a8c552a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:00:31 crc kubenswrapper[5120]: I0316 17:00:31.833691 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/30bfa4fc-b416-4f16-b673-158d4a8c552a-scripts\") pod \"ceilometer-0\" (UID: \"30bfa4fc-b416-4f16-b673-158d4a8c552a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:00:31 crc kubenswrapper[5120]: I0316 17:00:31.833739 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/30bfa4fc-b416-4f16-b673-158d4a8c552a-log-httpd\") pod \"ceilometer-0\" (UID: \"30bfa4fc-b416-4f16-b673-158d4a8c552a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:00:31 crc kubenswrapper[5120]: I0316 17:00:31.833788 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/30bfa4fc-b416-4f16-b673-158d4a8c552a-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"30bfa4fc-b416-4f16-b673-158d4a8c552a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:00:31 crc kubenswrapper[5120]: I0316 17:00:31.833855 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/30bfa4fc-b416-4f16-b673-158d4a8c552a-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"30bfa4fc-b416-4f16-b673-158d4a8c552a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:00:31 crc kubenswrapper[5120]: I0316 17:00:31.833950 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/30bfa4fc-b416-4f16-b673-158d4a8c552a-run-httpd\") pod \"ceilometer-0\" (UID: \"30bfa4fc-b416-4f16-b673-158d4a8c552a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:00:31 crc kubenswrapper[5120]: I0316 17:00:31.834023 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bcvgz\" (UniqueName: \"kubernetes.io/projected/30bfa4fc-b416-4f16-b673-158d4a8c552a-kube-api-access-bcvgz\") pod \"ceilometer-0\" (UID: \"30bfa4fc-b416-4f16-b673-158d4a8c552a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:00:31 crc kubenswrapper[5120]: I0316 17:00:31.834700 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/30bfa4fc-b416-4f16-b673-158d4a8c552a-log-httpd\") pod \"ceilometer-0\" (UID: \"30bfa4fc-b416-4f16-b673-158d4a8c552a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:00:31 crc kubenswrapper[5120]: I0316 17:00:31.835636 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/30bfa4fc-b416-4f16-b673-158d4a8c552a-run-httpd\") pod \"ceilometer-0\" (UID: \"30bfa4fc-b416-4f16-b673-158d4a8c552a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:00:31 crc kubenswrapper[5120]: I0316 17:00:31.838248 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/30bfa4fc-b416-4f16-b673-158d4a8c552a-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"30bfa4fc-b416-4f16-b673-158d4a8c552a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:00:31 crc kubenswrapper[5120]: I0316 17:00:31.839260 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/30bfa4fc-b416-4f16-b673-158d4a8c552a-config-data\") pod \"ceilometer-0\" (UID: \"30bfa4fc-b416-4f16-b673-158d4a8c552a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:00:31 crc kubenswrapper[5120]: I0316 17:00:31.839457 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/30bfa4fc-b416-4f16-b673-158d4a8c552a-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"30bfa4fc-b416-4f16-b673-158d4a8c552a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:00:31 crc kubenswrapper[5120]: I0316 17:00:31.842741 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/30bfa4fc-b416-4f16-b673-158d4a8c552a-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"30bfa4fc-b416-4f16-b673-158d4a8c552a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:00:31 crc kubenswrapper[5120]: I0316 17:00:31.842746 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/30bfa4fc-b416-4f16-b673-158d4a8c552a-scripts\") pod \"ceilometer-0\" (UID: \"30bfa4fc-b416-4f16-b673-158d4a8c552a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:00:31 crc kubenswrapper[5120]: I0316 17:00:31.858415 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bcvgz\" (UniqueName: \"kubernetes.io/projected/30bfa4fc-b416-4f16-b673-158d4a8c552a-kube-api-access-bcvgz\") pod \"ceilometer-0\" (UID: \"30bfa4fc-b416-4f16-b673-158d4a8c552a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:00:31 crc kubenswrapper[5120]: I0316 17:00:31.877024 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:00:31 crc kubenswrapper[5120]: I0316 17:00:31.881520 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 17:00:31 crc kubenswrapper[5120]: I0316 17:00:31.895995 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:00:31 crc kubenswrapper[5120]: I0316 17:00:31.905350 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovnnorthd-scripts\"" Mar 16 17:00:31 crc kubenswrapper[5120]: I0316 17:00:31.907013 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ovnnorthd-ovnnorthd-dockercfg-swqbh\"" Mar 16 17:00:31 crc kubenswrapper[5120]: I0316 17:00:31.907536 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ovnnorthd-ovndbs\"" Mar 16 17:00:31 crc kubenswrapper[5120]: I0316 17:00:31.907855 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovnnorthd-config\"" Mar 16 17:00:31 crc kubenswrapper[5120]: I0316 17:00:31.916837 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 17:00:31 crc kubenswrapper[5120]: I0316 17:00:31.935542 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:00:31 crc kubenswrapper[5120]: I0316 17:00:31.937661 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:00:31 crc kubenswrapper[5120]: I0316 17:00:31.971149 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:00:32 crc kubenswrapper[5120]: I0316 17:00:32.040790 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qq7vc\" (UniqueName: \"kubernetes.io/projected/a519f6d6-0bc7-43f3-9ad7-98a44f627488-kube-api-access-qq7vc\") pod \"ovn-northd-0\" (UID: \"a519f6d6-0bc7-43f3-9ad7-98a44f627488\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:00:32 crc kubenswrapper[5120]: I0316 17:00:32.040901 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/a519f6d6-0bc7-43f3-9ad7-98a44f627488-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"a519f6d6-0bc7-43f3-9ad7-98a44f627488\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:00:32 crc kubenswrapper[5120]: I0316 17:00:32.040969 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a519f6d6-0bc7-43f3-9ad7-98a44f627488-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"a519f6d6-0bc7-43f3-9ad7-98a44f627488\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:00:32 crc kubenswrapper[5120]: I0316 17:00:32.041185 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/a519f6d6-0bc7-43f3-9ad7-98a44f627488-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"a519f6d6-0bc7-43f3-9ad7-98a44f627488\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:00:32 crc kubenswrapper[5120]: I0316 17:00:32.041277 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/a519f6d6-0bc7-43f3-9ad7-98a44f627488-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"a519f6d6-0bc7-43f3-9ad7-98a44f627488\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:00:32 crc kubenswrapper[5120]: I0316 17:00:32.041464 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/a519f6d6-0bc7-43f3-9ad7-98a44f627488-scripts\") pod \"ovn-northd-0\" (UID: \"a519f6d6-0bc7-43f3-9ad7-98a44f627488\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:00:32 crc kubenswrapper[5120]: I0316 17:00:32.041720 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a519f6d6-0bc7-43f3-9ad7-98a44f627488-config\") pod \"ovn-northd-0\" (UID: \"a519f6d6-0bc7-43f3-9ad7-98a44f627488\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:00:32 crc kubenswrapper[5120]: I0316 17:00:32.061547 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:00:32 crc kubenswrapper[5120]: I0316 17:00:32.144412 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:00:32 crc kubenswrapper[5120]: I0316 17:00:32.147181 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a519f6d6-0bc7-43f3-9ad7-98a44f627488-config\") pod \"ovn-northd-0\" (UID: \"a519f6d6-0bc7-43f3-9ad7-98a44f627488\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:00:32 crc kubenswrapper[5120]: I0316 17:00:32.147411 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qq7vc\" (UniqueName: \"kubernetes.io/projected/a519f6d6-0bc7-43f3-9ad7-98a44f627488-kube-api-access-qq7vc\") pod \"ovn-northd-0\" (UID: \"a519f6d6-0bc7-43f3-9ad7-98a44f627488\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:00:32 crc kubenswrapper[5120]: I0316 17:00:32.147561 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/a519f6d6-0bc7-43f3-9ad7-98a44f627488-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"a519f6d6-0bc7-43f3-9ad7-98a44f627488\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:00:32 crc kubenswrapper[5120]: I0316 17:00:32.147659 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a519f6d6-0bc7-43f3-9ad7-98a44f627488-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"a519f6d6-0bc7-43f3-9ad7-98a44f627488\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:00:32 crc kubenswrapper[5120]: I0316 17:00:32.152836 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/a519f6d6-0bc7-43f3-9ad7-98a44f627488-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"a519f6d6-0bc7-43f3-9ad7-98a44f627488\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:00:32 crc kubenswrapper[5120]: I0316 17:00:32.152937 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/a519f6d6-0bc7-43f3-9ad7-98a44f627488-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"a519f6d6-0bc7-43f3-9ad7-98a44f627488\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:00:32 crc kubenswrapper[5120]: I0316 17:00:32.153098 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/a519f6d6-0bc7-43f3-9ad7-98a44f627488-scripts\") pod \"ovn-northd-0\" (UID: \"a519f6d6-0bc7-43f3-9ad7-98a44f627488\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:00:32 crc kubenswrapper[5120]: I0316 17:00:32.153838 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/a519f6d6-0bc7-43f3-9ad7-98a44f627488-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"a519f6d6-0bc7-43f3-9ad7-98a44f627488\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:00:32 crc kubenswrapper[5120]: I0316 17:00:32.154584 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/a519f6d6-0bc7-43f3-9ad7-98a44f627488-scripts\") pod \"ovn-northd-0\" (UID: \"a519f6d6-0bc7-43f3-9ad7-98a44f627488\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:00:32 crc kubenswrapper[5120]: I0316 17:00:32.155544 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a519f6d6-0bc7-43f3-9ad7-98a44f627488-config\") pod \"ovn-northd-0\" (UID: \"a519f6d6-0bc7-43f3-9ad7-98a44f627488\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:00:32 crc kubenswrapper[5120]: I0316 17:00:32.167500 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/a519f6d6-0bc7-43f3-9ad7-98a44f627488-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"a519f6d6-0bc7-43f3-9ad7-98a44f627488\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:00:32 crc kubenswrapper[5120]: I0316 17:00:32.169565 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a519f6d6-0bc7-43f3-9ad7-98a44f627488-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"a519f6d6-0bc7-43f3-9ad7-98a44f627488\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:00:32 crc kubenswrapper[5120]: I0316 17:00:32.170799 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/a519f6d6-0bc7-43f3-9ad7-98a44f627488-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"a519f6d6-0bc7-43f3-9ad7-98a44f627488\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:00:32 crc kubenswrapper[5120]: I0316 17:00:32.196906 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qq7vc\" (UniqueName: \"kubernetes.io/projected/a519f6d6-0bc7-43f3-9ad7-98a44f627488-kube-api-access-qq7vc\") pod \"ovn-northd-0\" (UID: \"a519f6d6-0bc7-43f3-9ad7-98a44f627488\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:00:32 crc kubenswrapper[5120]: I0316 17:00:32.241727 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:00:32 crc kubenswrapper[5120]: I0316 17:00:32.241806 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:00:32 crc kubenswrapper[5120]: I0316 17:00:32.243569 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:00:32 crc kubenswrapper[5120]: I0316 17:00:32.489455 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-5b7968964b-sgwq2" event={"ID":"e78c00c6-8a77-403d-a9f1-49d34962c3f7","Type":"ContainerStarted","Data":"94e1102e08240e0ac6ddeb805485b6575f608c17fcfd298c5170b5fd7e295206"} Mar 16 17:00:32 crc kubenswrapper[5120]: I0316 17:00:32.489834 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-5b7968964b-sgwq2" event={"ID":"e78c00c6-8a77-403d-a9f1-49d34962c3f7","Type":"ContainerStarted","Data":"5bdcd7fe3db4704f6e4591adfb538eaadb322c191c3a867ec1f159e1cecab7f2"} Mar 16 17:00:32 crc kubenswrapper[5120]: I0316 17:00:32.490955 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-5b7968964b-sgwq2" Mar 16 17:00:32 crc kubenswrapper[5120]: I0316 17:00:32.490977 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-5b7968964b-sgwq2" Mar 16 17:00:32 crc kubenswrapper[5120]: I0316 17:00:32.516563 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-api-5b7968964b-sgwq2" podStartSLOduration=3.516543645 podStartE2EDuration="3.516543645s" podCreationTimestamp="2026-03-16 17:00:29 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:00:32.512531675 +0000 UTC m=+5334.666463332" watchObservedRunningTime="2026-03-16 17:00:32.516543645 +0000 UTC m=+5334.670475302" Mar 16 17:00:32 crc kubenswrapper[5120]: I0316 17:00:32.681468 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="07433ec1-a6dc-48a4-8374-8260c23db816" path="/var/lib/kubelet/pods/07433ec1-a6dc-48a4-8374-8260c23db816/volumes" Mar 16 17:00:32 crc kubenswrapper[5120]: I0316 17:00:32.682508 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b0790e22-4129-49de-b1d6-25c9288301f0" path="/var/lib/kubelet/pods/b0790e22-4129-49de-b1d6-25c9288301f0/volumes" Mar 16 17:00:32 crc kubenswrapper[5120]: I0316 17:00:32.705129 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:00:32 crc kubenswrapper[5120]: I0316 17:00:32.825645 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 17:00:32 crc kubenswrapper[5120]: W0316 17:00:32.827957 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda519f6d6_0bc7_43f3_9ad7_98a44f627488.slice/crio-571e7f0c18b291c7d5c1562db49213b97052bb128e00699ce545a1842afeda13 WatchSource:0}: Error finding container 571e7f0c18b291c7d5c1562db49213b97052bb128e00699ce545a1842afeda13: Status 404 returned error can't find the container with id 571e7f0c18b291c7d5c1562db49213b97052bb128e00699ce545a1842afeda13 Mar 16 17:00:33 crc kubenswrapper[5120]: I0316 17:00:33.302482 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/cinder-api-0" podUID="8ac9683b-983c-44fd-a877-d2ae1cc5ae93" containerName="cinder-api" probeResult="failure" output="Get \"https://10.217.1.15:8776/healthcheck\": read tcp 10.217.0.2:53862->10.217.1.15:8776: read: connection reset by peer" Mar 16 17:00:33 crc kubenswrapper[5120]: I0316 17:00:33.516312 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"30bfa4fc-b416-4f16-b673-158d4a8c552a","Type":"ContainerStarted","Data":"de3ab1da21486e864021f0e8b93032ef66588bc2b8c3bfb0aeb0666a984fcf6a"} Mar 16 17:00:33 crc kubenswrapper[5120]: I0316 17:00:33.524234 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"a519f6d6-0bc7-43f3-9ad7-98a44f627488","Type":"ContainerStarted","Data":"35ca9562e24968de8b31ef801a1f01d23ff0204af1a566b33c7aeeb79c0016fa"} Mar 16 17:00:33 crc kubenswrapper[5120]: I0316 17:00:33.524282 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"a519f6d6-0bc7-43f3-9ad7-98a44f627488","Type":"ContainerStarted","Data":"667c0b4c5c210d8d2e00d4c0137f5f162ac03573aade3cb4dcbc340cb9470ded"} Mar 16 17:00:33 crc kubenswrapper[5120]: I0316 17:00:33.524299 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"a519f6d6-0bc7-43f3-9ad7-98a44f627488","Type":"ContainerStarted","Data":"571e7f0c18b291c7d5c1562db49213b97052bb128e00699ce545a1842afeda13"} Mar 16 17:00:33 crc kubenswrapper[5120]: I0316 17:00:33.524421 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:00:33 crc kubenswrapper[5120]: I0316 17:00:33.526041 5120 generic.go:358] "Generic (PLEG): container finished" podID="8ac9683b-983c-44fd-a877-d2ae1cc5ae93" containerID="b06817a6b7e865eb89cf033595c6aa097eb8d2fe72c72a808c6bea7f30f1fbec" exitCode=0 Mar 16 17:00:33 crc kubenswrapper[5120]: I0316 17:00:33.527261 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"8ac9683b-983c-44fd-a877-d2ae1cc5ae93","Type":"ContainerDied","Data":"b06817a6b7e865eb89cf033595c6aa097eb8d2fe72c72a808c6bea7f30f1fbec"} Mar 16 17:00:33 crc kubenswrapper[5120]: I0316 17:00:33.548914 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovn-northd-0" podStartSLOduration=2.548894261 podStartE2EDuration="2.548894261s" podCreationTimestamp="2026-03-16 17:00:31 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:00:33.541693834 +0000 UTC m=+5335.695625491" watchObservedRunningTime="2026-03-16 17:00:33.548894261 +0000 UTC m=+5335.702825918" Mar 16 17:00:33 crc kubenswrapper[5120]: I0316 17:00:33.882353 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:00:33 crc kubenswrapper[5120]: I0316 17:00:33.933895 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8ac9683b-983c-44fd-a877-d2ae1cc5ae93-combined-ca-bundle\") pod \"8ac9683b-983c-44fd-a877-d2ae1cc5ae93\" (UID: \"8ac9683b-983c-44fd-a877-d2ae1cc5ae93\") " Mar 16 17:00:33 crc kubenswrapper[5120]: I0316 17:00:33.934071 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/8ac9683b-983c-44fd-a877-d2ae1cc5ae93-config-data-custom\") pod \"8ac9683b-983c-44fd-a877-d2ae1cc5ae93\" (UID: \"8ac9683b-983c-44fd-a877-d2ae1cc5ae93\") " Mar 16 17:00:33 crc kubenswrapper[5120]: I0316 17:00:33.934134 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/8ac9683b-983c-44fd-a877-d2ae1cc5ae93-internal-tls-certs\") pod \"8ac9683b-983c-44fd-a877-d2ae1cc5ae93\" (UID: \"8ac9683b-983c-44fd-a877-d2ae1cc5ae93\") " Mar 16 17:00:33 crc kubenswrapper[5120]: I0316 17:00:33.934201 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/8ac9683b-983c-44fd-a877-d2ae1cc5ae93-etc-machine-id\") pod \"8ac9683b-983c-44fd-a877-d2ae1cc5ae93\" (UID: \"8ac9683b-983c-44fd-a877-d2ae1cc5ae93\") " Mar 16 17:00:33 crc kubenswrapper[5120]: I0316 17:00:33.934239 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8ac9683b-983c-44fd-a877-d2ae1cc5ae93-logs\") pod \"8ac9683b-983c-44fd-a877-d2ae1cc5ae93\" (UID: \"8ac9683b-983c-44fd-a877-d2ae1cc5ae93\") " Mar 16 17:00:33 crc kubenswrapper[5120]: I0316 17:00:33.934376 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8ac9683b-983c-44fd-a877-d2ae1cc5ae93-scripts\") pod \"8ac9683b-983c-44fd-a877-d2ae1cc5ae93\" (UID: \"8ac9683b-983c-44fd-a877-d2ae1cc5ae93\") " Mar 16 17:00:33 crc kubenswrapper[5120]: I0316 17:00:33.934416 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/8ac9683b-983c-44fd-a877-d2ae1cc5ae93-public-tls-certs\") pod \"8ac9683b-983c-44fd-a877-d2ae1cc5ae93\" (UID: \"8ac9683b-983c-44fd-a877-d2ae1cc5ae93\") " Mar 16 17:00:33 crc kubenswrapper[5120]: I0316 17:00:33.934525 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8ac9683b-983c-44fd-a877-d2ae1cc5ae93-config-data\") pod \"8ac9683b-983c-44fd-a877-d2ae1cc5ae93\" (UID: \"8ac9683b-983c-44fd-a877-d2ae1cc5ae93\") " Mar 16 17:00:33 crc kubenswrapper[5120]: I0316 17:00:33.934584 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t4cx6\" (UniqueName: \"kubernetes.io/projected/8ac9683b-983c-44fd-a877-d2ae1cc5ae93-kube-api-access-t4cx6\") pod \"8ac9683b-983c-44fd-a877-d2ae1cc5ae93\" (UID: \"8ac9683b-983c-44fd-a877-d2ae1cc5ae93\") " Mar 16 17:00:33 crc kubenswrapper[5120]: I0316 17:00:33.935003 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ac9683b-983c-44fd-a877-d2ae1cc5ae93-logs" (OuterVolumeSpecName: "logs") pod "8ac9683b-983c-44fd-a877-d2ae1cc5ae93" (UID: "8ac9683b-983c-44fd-a877-d2ae1cc5ae93"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:00:33 crc kubenswrapper[5120]: I0316 17:00:33.935218 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8ac9683b-983c-44fd-a877-d2ae1cc5ae93-logs\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:33 crc kubenswrapper[5120]: I0316 17:00:33.935869 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/8ac9683b-983c-44fd-a877-d2ae1cc5ae93-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "8ac9683b-983c-44fd-a877-d2ae1cc5ae93" (UID: "8ac9683b-983c-44fd-a877-d2ae1cc5ae93"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 17:00:33 crc kubenswrapper[5120]: I0316 17:00:33.943323 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ac9683b-983c-44fd-a877-d2ae1cc5ae93-scripts" (OuterVolumeSpecName: "scripts") pod "8ac9683b-983c-44fd-a877-d2ae1cc5ae93" (UID: "8ac9683b-983c-44fd-a877-d2ae1cc5ae93"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:33 crc kubenswrapper[5120]: I0316 17:00:33.945995 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ac9683b-983c-44fd-a877-d2ae1cc5ae93-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "8ac9683b-983c-44fd-a877-d2ae1cc5ae93" (UID: "8ac9683b-983c-44fd-a877-d2ae1cc5ae93"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:33 crc kubenswrapper[5120]: I0316 17:00:33.946158 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ac9683b-983c-44fd-a877-d2ae1cc5ae93-kube-api-access-t4cx6" (OuterVolumeSpecName: "kube-api-access-t4cx6") pod "8ac9683b-983c-44fd-a877-d2ae1cc5ae93" (UID: "8ac9683b-983c-44fd-a877-d2ae1cc5ae93"). InnerVolumeSpecName "kube-api-access-t4cx6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:00:33 crc kubenswrapper[5120]: I0316 17:00:33.980615 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ac9683b-983c-44fd-a877-d2ae1cc5ae93-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "8ac9683b-983c-44fd-a877-d2ae1cc5ae93" (UID: "8ac9683b-983c-44fd-a877-d2ae1cc5ae93"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:34 crc kubenswrapper[5120]: I0316 17:00:34.014018 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ac9683b-983c-44fd-a877-d2ae1cc5ae93-config-data" (OuterVolumeSpecName: "config-data") pod "8ac9683b-983c-44fd-a877-d2ae1cc5ae93" (UID: "8ac9683b-983c-44fd-a877-d2ae1cc5ae93"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:34 crc kubenswrapper[5120]: I0316 17:00:34.023628 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ac9683b-983c-44fd-a877-d2ae1cc5ae93-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "8ac9683b-983c-44fd-a877-d2ae1cc5ae93" (UID: "8ac9683b-983c-44fd-a877-d2ae1cc5ae93"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:34 crc kubenswrapper[5120]: I0316 17:00:34.038024 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8ac9683b-983c-44fd-a877-d2ae1cc5ae93-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:34 crc kubenswrapper[5120]: I0316 17:00:34.038063 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t4cx6\" (UniqueName: \"kubernetes.io/projected/8ac9683b-983c-44fd-a877-d2ae1cc5ae93-kube-api-access-t4cx6\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:34 crc kubenswrapper[5120]: I0316 17:00:34.038075 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8ac9683b-983c-44fd-a877-d2ae1cc5ae93-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:34 crc kubenswrapper[5120]: I0316 17:00:34.038105 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/8ac9683b-983c-44fd-a877-d2ae1cc5ae93-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:34 crc kubenswrapper[5120]: I0316 17:00:34.038114 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/8ac9683b-983c-44fd-a877-d2ae1cc5ae93-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:34 crc kubenswrapper[5120]: I0316 17:00:34.038122 5120 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/8ac9683b-983c-44fd-a877-d2ae1cc5ae93-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:34 crc kubenswrapper[5120]: I0316 17:00:34.038130 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8ac9683b-983c-44fd-a877-d2ae1cc5ae93-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:34 crc kubenswrapper[5120]: I0316 17:00:34.044505 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ac9683b-983c-44fd-a877-d2ae1cc5ae93-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "8ac9683b-983c-44fd-a877-d2ae1cc5ae93" (UID: "8ac9683b-983c-44fd-a877-d2ae1cc5ae93"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:34 crc kubenswrapper[5120]: I0316 17:00:34.141425 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/8ac9683b-983c-44fd-a877-d2ae1cc5ae93-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:34 crc kubenswrapper[5120]: I0316 17:00:34.538251 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"8ac9683b-983c-44fd-a877-d2ae1cc5ae93","Type":"ContainerDied","Data":"9f848221a21d45f1f6bac6dd3682835f6c9ce1a9dfbc2eb7d0b80883a0b79d94"} Mar 16 17:00:34 crc kubenswrapper[5120]: I0316 17:00:34.538258 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:00:34 crc kubenswrapper[5120]: I0316 17:00:34.538559 5120 scope.go:117] "RemoveContainer" containerID="b06817a6b7e865eb89cf033595c6aa097eb8d2fe72c72a808c6bea7f30f1fbec" Mar 16 17:00:34 crc kubenswrapper[5120]: I0316 17:00:34.541567 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"30bfa4fc-b416-4f16-b673-158d4a8c552a","Type":"ContainerStarted","Data":"df8b5c31f6424cfe5184b05fc53b3787de9354c9c0022f3d3a4c534d5104986b"} Mar 16 17:00:34 crc kubenswrapper[5120]: I0316 17:00:34.579026 5120 scope.go:117] "RemoveContainer" containerID="6a153038229a3e0ad4ede09650ddb823d2b4cb2b19320b55217a3a9dab56c573" Mar 16 17:00:34 crc kubenswrapper[5120]: I0316 17:00:34.641042 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 17:00:34 crc kubenswrapper[5120]: I0316 17:00:34.655423 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 17:00:34 crc kubenswrapper[5120]: I0316 17:00:34.683185 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ac9683b-983c-44fd-a877-d2ae1cc5ae93" path="/var/lib/kubelet/pods/8ac9683b-983c-44fd-a877-d2ae1cc5ae93/volumes" Mar 16 17:00:34 crc kubenswrapper[5120]: I0316 17:00:34.683922 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 17:00:34 crc kubenswrapper[5120]: I0316 17:00:34.685931 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ac9683b-983c-44fd-a877-d2ae1cc5ae93" containerName="cinder-api-log" Mar 16 17:00:34 crc kubenswrapper[5120]: I0316 17:00:34.685952 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ac9683b-983c-44fd-a877-d2ae1cc5ae93" containerName="cinder-api-log" Mar 16 17:00:34 crc kubenswrapper[5120]: I0316 17:00:34.685988 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ac9683b-983c-44fd-a877-d2ae1cc5ae93" containerName="cinder-api" Mar 16 17:00:34 crc kubenswrapper[5120]: I0316 17:00:34.685995 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ac9683b-983c-44fd-a877-d2ae1cc5ae93" containerName="cinder-api" Mar 16 17:00:34 crc kubenswrapper[5120]: I0316 17:00:34.686189 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="8ac9683b-983c-44fd-a877-d2ae1cc5ae93" containerName="cinder-api-log" Mar 16 17:00:34 crc kubenswrapper[5120]: I0316 17:00:34.686220 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="8ac9683b-983c-44fd-a877-d2ae1cc5ae93" containerName="cinder-api" Mar 16 17:00:34 crc kubenswrapper[5120]: I0316 17:00:34.691889 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 17:00:34 crc kubenswrapper[5120]: I0316 17:00:34.692034 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:00:34 crc kubenswrapper[5120]: I0316 17:00:34.694169 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-cinder-internal-svc\"" Mar 16 17:00:34 crc kubenswrapper[5120]: I0316 17:00:34.695154 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-api-config-data\"" Mar 16 17:00:34 crc kubenswrapper[5120]: I0316 17:00:34.697539 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-cinder-public-svc\"" Mar 16 17:00:34 crc kubenswrapper[5120]: I0316 17:00:34.758664 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/b7434cde-890e-42d9-9b5c-bbd60a188517-config-data-custom\") pod \"cinder-api-0\" (UID: \"b7434cde-890e-42d9-9b5c-bbd60a188517\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:00:34 crc kubenswrapper[5120]: I0316 17:00:34.758933 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b7434cde-890e-42d9-9b5c-bbd60a188517-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"b7434cde-890e-42d9-9b5c-bbd60a188517\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:00:34 crc kubenswrapper[5120]: I0316 17:00:34.759168 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b7434cde-890e-42d9-9b5c-bbd60a188517-logs\") pod \"cinder-api-0\" (UID: \"b7434cde-890e-42d9-9b5c-bbd60a188517\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:00:34 crc kubenswrapper[5120]: I0316 17:00:34.759500 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/b7434cde-890e-42d9-9b5c-bbd60a188517-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"b7434cde-890e-42d9-9b5c-bbd60a188517\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:00:34 crc kubenswrapper[5120]: I0316 17:00:34.760116 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b7434cde-890e-42d9-9b5c-bbd60a188517-scripts\") pod \"cinder-api-0\" (UID: \"b7434cde-890e-42d9-9b5c-bbd60a188517\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:00:34 crc kubenswrapper[5120]: I0316 17:00:34.760146 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b7434cde-890e-42d9-9b5c-bbd60a188517-config-data\") pod \"cinder-api-0\" (UID: \"b7434cde-890e-42d9-9b5c-bbd60a188517\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:00:34 crc kubenswrapper[5120]: I0316 17:00:34.760332 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/b7434cde-890e-42d9-9b5c-bbd60a188517-public-tls-certs\") pod \"cinder-api-0\" (UID: \"b7434cde-890e-42d9-9b5c-bbd60a188517\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:00:34 crc kubenswrapper[5120]: I0316 17:00:34.760366 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/b7434cde-890e-42d9-9b5c-bbd60a188517-etc-machine-id\") pod \"cinder-api-0\" (UID: \"b7434cde-890e-42d9-9b5c-bbd60a188517\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:00:34 crc kubenswrapper[5120]: I0316 17:00:34.760395 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hgp22\" (UniqueName: \"kubernetes.io/projected/b7434cde-890e-42d9-9b5c-bbd60a188517-kube-api-access-hgp22\") pod \"cinder-api-0\" (UID: \"b7434cde-890e-42d9-9b5c-bbd60a188517\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:00:34 crc kubenswrapper[5120]: I0316 17:00:34.862392 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b7434cde-890e-42d9-9b5c-bbd60a188517-scripts\") pod \"cinder-api-0\" (UID: \"b7434cde-890e-42d9-9b5c-bbd60a188517\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:00:34 crc kubenswrapper[5120]: I0316 17:00:34.862665 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b7434cde-890e-42d9-9b5c-bbd60a188517-config-data\") pod \"cinder-api-0\" (UID: \"b7434cde-890e-42d9-9b5c-bbd60a188517\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:00:34 crc kubenswrapper[5120]: I0316 17:00:34.862879 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/b7434cde-890e-42d9-9b5c-bbd60a188517-public-tls-certs\") pod \"cinder-api-0\" (UID: \"b7434cde-890e-42d9-9b5c-bbd60a188517\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:00:34 crc kubenswrapper[5120]: I0316 17:00:34.862975 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/b7434cde-890e-42d9-9b5c-bbd60a188517-etc-machine-id\") pod \"cinder-api-0\" (UID: \"b7434cde-890e-42d9-9b5c-bbd60a188517\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:00:34 crc kubenswrapper[5120]: I0316 17:00:34.863057 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hgp22\" (UniqueName: \"kubernetes.io/projected/b7434cde-890e-42d9-9b5c-bbd60a188517-kube-api-access-hgp22\") pod \"cinder-api-0\" (UID: \"b7434cde-890e-42d9-9b5c-bbd60a188517\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:00:34 crc kubenswrapper[5120]: I0316 17:00:34.863165 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/b7434cde-890e-42d9-9b5c-bbd60a188517-config-data-custom\") pod \"cinder-api-0\" (UID: \"b7434cde-890e-42d9-9b5c-bbd60a188517\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:00:34 crc kubenswrapper[5120]: I0316 17:00:34.863302 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b7434cde-890e-42d9-9b5c-bbd60a188517-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"b7434cde-890e-42d9-9b5c-bbd60a188517\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:00:34 crc kubenswrapper[5120]: I0316 17:00:34.863441 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b7434cde-890e-42d9-9b5c-bbd60a188517-logs\") pod \"cinder-api-0\" (UID: \"b7434cde-890e-42d9-9b5c-bbd60a188517\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:00:34 crc kubenswrapper[5120]: I0316 17:00:34.863642 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/b7434cde-890e-42d9-9b5c-bbd60a188517-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"b7434cde-890e-42d9-9b5c-bbd60a188517\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:00:34 crc kubenswrapper[5120]: I0316 17:00:34.865208 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/b7434cde-890e-42d9-9b5c-bbd60a188517-etc-machine-id\") pod \"cinder-api-0\" (UID: \"b7434cde-890e-42d9-9b5c-bbd60a188517\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:00:34 crc kubenswrapper[5120]: I0316 17:00:34.865481 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b7434cde-890e-42d9-9b5c-bbd60a188517-logs\") pod \"cinder-api-0\" (UID: \"b7434cde-890e-42d9-9b5c-bbd60a188517\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:00:34 crc kubenswrapper[5120]: I0316 17:00:34.870710 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/b7434cde-890e-42d9-9b5c-bbd60a188517-public-tls-certs\") pod \"cinder-api-0\" (UID: \"b7434cde-890e-42d9-9b5c-bbd60a188517\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:00:34 crc kubenswrapper[5120]: I0316 17:00:34.870752 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b7434cde-890e-42d9-9b5c-bbd60a188517-scripts\") pod \"cinder-api-0\" (UID: \"b7434cde-890e-42d9-9b5c-bbd60a188517\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:00:34 crc kubenswrapper[5120]: I0316 17:00:34.871264 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b7434cde-890e-42d9-9b5c-bbd60a188517-config-data\") pod \"cinder-api-0\" (UID: \"b7434cde-890e-42d9-9b5c-bbd60a188517\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:00:34 crc kubenswrapper[5120]: I0316 17:00:34.871911 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/b7434cde-890e-42d9-9b5c-bbd60a188517-config-data-custom\") pod \"cinder-api-0\" (UID: \"b7434cde-890e-42d9-9b5c-bbd60a188517\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:00:34 crc kubenswrapper[5120]: I0316 17:00:34.873850 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/b7434cde-890e-42d9-9b5c-bbd60a188517-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"b7434cde-890e-42d9-9b5c-bbd60a188517\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:00:34 crc kubenswrapper[5120]: I0316 17:00:34.878742 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b7434cde-890e-42d9-9b5c-bbd60a188517-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"b7434cde-890e-42d9-9b5c-bbd60a188517\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:00:34 crc kubenswrapper[5120]: I0316 17:00:34.883837 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hgp22\" (UniqueName: \"kubernetes.io/projected/b7434cde-890e-42d9-9b5c-bbd60a188517-kube-api-access-hgp22\") pod \"cinder-api-0\" (UID: \"b7434cde-890e-42d9-9b5c-bbd60a188517\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:00:35 crc kubenswrapper[5120]: I0316 17:00:35.038407 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:00:35 crc kubenswrapper[5120]: I0316 17:00:35.517295 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 17:00:35 crc kubenswrapper[5120]: W0316 17:00:35.522768 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb7434cde_890e_42d9_9b5c_bbd60a188517.slice/crio-525b14dde01f4ae8a7cd21cc0e4590787326b4e2ae2d92833391b7fa9e943dae WatchSource:0}: Error finding container 525b14dde01f4ae8a7cd21cc0e4590787326b4e2ae2d92833391b7fa9e943dae: Status 404 returned error can't find the container with id 525b14dde01f4ae8a7cd21cc0e4590787326b4e2ae2d92833391b7fa9e943dae Mar 16 17:00:35 crc kubenswrapper[5120]: I0316 17:00:35.578298 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"30bfa4fc-b416-4f16-b673-158d4a8c552a","Type":"ContainerStarted","Data":"99635dda3eea0d4e53ecc0eb0ea3b6a04905af4d37311147fd10c24ffbd66ca8"} Mar 16 17:00:35 crc kubenswrapper[5120]: I0316 17:00:35.578350 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"30bfa4fc-b416-4f16-b673-158d4a8c552a","Type":"ContainerStarted","Data":"8a2a241180e8498f806434023245a7cf96892a004e496f210c200d2c05c4951c"} Mar 16 17:00:35 crc kubenswrapper[5120]: I0316 17:00:35.583994 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"b7434cde-890e-42d9-9b5c-bbd60a188517","Type":"ContainerStarted","Data":"525b14dde01f4ae8a7cd21cc0e4590787326b4e2ae2d92833391b7fa9e943dae"} Mar 16 17:00:35 crc kubenswrapper[5120]: I0316 17:00:35.767481 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-6b9b487fd6-hdw75"] Mar 16 17:00:35 crc kubenswrapper[5120]: I0316 17:00:35.776190 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-6b9b487fd6-hdw75" Mar 16 17:00:35 crc kubenswrapper[5120]: I0316 17:00:35.835815 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 17:00:35 crc kubenswrapper[5120]: I0316 17:00:35.836102 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/memcached-0" podUID="727aa42a-e1c1-427b-9912-f64504161039" containerName="memcached" containerID="cri-o://812f81a16c905368276223ee5005d10bd26af5275ab04c2e07d4bf28eecfa6cb" gracePeriod=30 Mar 16 17:00:35 crc kubenswrapper[5120]: I0316 17:00:35.861380 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 17:00:35 crc kubenswrapper[5120]: I0316 17:00:35.861712 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="e2ad712e-f6f5-4942-94b9-635bbc53da15" containerName="nova-metadata-log" containerID="cri-o://a50bcb7bcd40881ab5aeb26896fa0bf1d2d92d9720a9cc6da29240635d7ae72b" gracePeriod=30 Mar 16 17:00:35 crc kubenswrapper[5120]: I0316 17:00:35.862187 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="e2ad712e-f6f5-4942-94b9-635bbc53da15" containerName="nova-metadata-metadata" containerID="cri-o://76410021abc023713496ae0953fc6f1147e2f5232e4ad8b48fce68f89aa80c38" gracePeriod=30 Mar 16 17:00:35 crc kubenswrapper[5120]: I0316 17:00:35.878265 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-6b9b487fd6-hdw75"] Mar 16 17:00:35 crc kubenswrapper[5120]: I0316 17:00:35.895307 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/20dac7f8-f03f-40f8-93f1-5ba59f5471b8-logs\") pod \"barbican-keystone-listener-6b9b487fd6-hdw75\" (UID: \"20dac7f8-f03f-40f8-93f1-5ba59f5471b8\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6b9b487fd6-hdw75" Mar 16 17:00:35 crc kubenswrapper[5120]: I0316 17:00:35.895502 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/20dac7f8-f03f-40f8-93f1-5ba59f5471b8-combined-ca-bundle\") pod \"barbican-keystone-listener-6b9b487fd6-hdw75\" (UID: \"20dac7f8-f03f-40f8-93f1-5ba59f5471b8\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6b9b487fd6-hdw75" Mar 16 17:00:35 crc kubenswrapper[5120]: I0316 17:00:35.895643 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/20dac7f8-f03f-40f8-93f1-5ba59f5471b8-config-data-custom\") pod \"barbican-keystone-listener-6b9b487fd6-hdw75\" (UID: \"20dac7f8-f03f-40f8-93f1-5ba59f5471b8\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6b9b487fd6-hdw75" Mar 16 17:00:35 crc kubenswrapper[5120]: I0316 17:00:35.895683 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhhc4\" (UniqueName: \"kubernetes.io/projected/20dac7f8-f03f-40f8-93f1-5ba59f5471b8-kube-api-access-rhhc4\") pod \"barbican-keystone-listener-6b9b487fd6-hdw75\" (UID: \"20dac7f8-f03f-40f8-93f1-5ba59f5471b8\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6b9b487fd6-hdw75" Mar 16 17:00:35 crc kubenswrapper[5120]: I0316 17:00:35.895740 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/20dac7f8-f03f-40f8-93f1-5ba59f5471b8-config-data\") pod \"barbican-keystone-listener-6b9b487fd6-hdw75\" (UID: \"20dac7f8-f03f-40f8-93f1-5ba59f5471b8\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6b9b487fd6-hdw75" Mar 16 17:00:35 crc kubenswrapper[5120]: I0316 17:00:35.910829 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-worker-6f96bb5df9-spfxv"] Mar 16 17:00:35 crc kubenswrapper[5120]: I0316 17:00:35.946923 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-6f96bb5df9-spfxv" Mar 16 17:00:35 crc kubenswrapper[5120]: I0316 17:00:35.998878 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/20dac7f8-f03f-40f8-93f1-5ba59f5471b8-config-data-custom\") pod \"barbican-keystone-listener-6b9b487fd6-hdw75\" (UID: \"20dac7f8-f03f-40f8-93f1-5ba59f5471b8\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6b9b487fd6-hdw75" Mar 16 17:00:35 crc kubenswrapper[5120]: I0316 17:00:35.998957 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rhhc4\" (UniqueName: \"kubernetes.io/projected/20dac7f8-f03f-40f8-93f1-5ba59f5471b8-kube-api-access-rhhc4\") pod \"barbican-keystone-listener-6b9b487fd6-hdw75\" (UID: \"20dac7f8-f03f-40f8-93f1-5ba59f5471b8\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6b9b487fd6-hdw75" Mar 16 17:00:35 crc kubenswrapper[5120]: I0316 17:00:35.999023 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/20dac7f8-f03f-40f8-93f1-5ba59f5471b8-config-data\") pod \"barbican-keystone-listener-6b9b487fd6-hdw75\" (UID: \"20dac7f8-f03f-40f8-93f1-5ba59f5471b8\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6b9b487fd6-hdw75" Mar 16 17:00:35 crc kubenswrapper[5120]: I0316 17:00:35.999181 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/20dac7f8-f03f-40f8-93f1-5ba59f5471b8-logs\") pod \"barbican-keystone-listener-6b9b487fd6-hdw75\" (UID: \"20dac7f8-f03f-40f8-93f1-5ba59f5471b8\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6b9b487fd6-hdw75" Mar 16 17:00:35 crc kubenswrapper[5120]: I0316 17:00:35.999311 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/20dac7f8-f03f-40f8-93f1-5ba59f5471b8-combined-ca-bundle\") pod \"barbican-keystone-listener-6b9b487fd6-hdw75\" (UID: \"20dac7f8-f03f-40f8-93f1-5ba59f5471b8\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6b9b487fd6-hdw75" Mar 16 17:00:36 crc kubenswrapper[5120]: I0316 17:00:36.009006 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 17:00:36 crc kubenswrapper[5120]: I0316 17:00:36.009533 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/20dac7f8-f03f-40f8-93f1-5ba59f5471b8-logs\") pod \"barbican-keystone-listener-6b9b487fd6-hdw75\" (UID: \"20dac7f8-f03f-40f8-93f1-5ba59f5471b8\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6b9b487fd6-hdw75" Mar 16 17:00:36 crc kubenswrapper[5120]: I0316 17:00:36.009335 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovn-northd-0" podUID="a519f6d6-0bc7-43f3-9ad7-98a44f627488" containerName="ovn-northd" containerID="cri-o://667c0b4c5c210d8d2e00d4c0137f5f162ac03573aade3cb4dcbc340cb9470ded" gracePeriod=30 Mar 16 17:00:36 crc kubenswrapper[5120]: I0316 17:00:36.010262 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovn-northd-0" podUID="a519f6d6-0bc7-43f3-9ad7-98a44f627488" containerName="openstack-network-exporter" containerID="cri-o://35ca9562e24968de8b31ef801a1f01d23ff0204af1a566b33c7aeeb79c0016fa" gracePeriod=30 Mar 16 17:00:36 crc kubenswrapper[5120]: I0316 17:00:36.042171 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 17:00:36 crc kubenswrapper[5120]: I0316 17:00:36.042717 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="447b243b-6b80-4883-9844-f49d3f2f4a22" containerName="glance-log" containerID="cri-o://9ffb7d4c0f767f982e7526ce10b289cd90603393d82c612888bce9bf3709ecce" gracePeriod=30 Mar 16 17:00:36 crc kubenswrapper[5120]: I0316 17:00:36.043576 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="447b243b-6b80-4883-9844-f49d3f2f4a22" containerName="glance-httpd" containerID="cri-o://5af1b89049fce0d163cf34818a7156ce0fb2fde2aea842a3668857248b70d770" gracePeriod=30 Mar 16 17:00:36 crc kubenswrapper[5120]: I0316 17:00:36.044795 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/20dac7f8-f03f-40f8-93f1-5ba59f5471b8-config-data-custom\") pod \"barbican-keystone-listener-6b9b487fd6-hdw75\" (UID: \"20dac7f8-f03f-40f8-93f1-5ba59f5471b8\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6b9b487fd6-hdw75" Mar 16 17:00:36 crc kubenswrapper[5120]: I0316 17:00:36.089928 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/20dac7f8-f03f-40f8-93f1-5ba59f5471b8-config-data\") pod \"barbican-keystone-listener-6b9b487fd6-hdw75\" (UID: \"20dac7f8-f03f-40f8-93f1-5ba59f5471b8\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6b9b487fd6-hdw75" Mar 16 17:00:36 crc kubenswrapper[5120]: I0316 17:00:36.091906 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/20dac7f8-f03f-40f8-93f1-5ba59f5471b8-combined-ca-bundle\") pod \"barbican-keystone-listener-6b9b487fd6-hdw75\" (UID: \"20dac7f8-f03f-40f8-93f1-5ba59f5471b8\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6b9b487fd6-hdw75" Mar 16 17:00:36 crc kubenswrapper[5120]: I0316 17:00:36.099259 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhhc4\" (UniqueName: \"kubernetes.io/projected/20dac7f8-f03f-40f8-93f1-5ba59f5471b8-kube-api-access-rhhc4\") pod \"barbican-keystone-listener-6b9b487fd6-hdw75\" (UID: \"20dac7f8-f03f-40f8-93f1-5ba59f5471b8\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6b9b487fd6-hdw75" Mar 16 17:00:36 crc kubenswrapper[5120]: I0316 17:00:36.101582 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htrkw\" (UniqueName: \"kubernetes.io/projected/fb7a2068-5a18-4c7b-92d0-364f371d59df-kube-api-access-htrkw\") pod \"barbican-worker-6f96bb5df9-spfxv\" (UID: \"fb7a2068-5a18-4c7b-92d0-364f371d59df\") " pod="openstack-kuttl-tests/barbican-worker-6f96bb5df9-spfxv" Mar 16 17:00:36 crc kubenswrapper[5120]: I0316 17:00:36.101654 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/fb7a2068-5a18-4c7b-92d0-364f371d59df-config-data-custom\") pod \"barbican-worker-6f96bb5df9-spfxv\" (UID: \"fb7a2068-5a18-4c7b-92d0-364f371d59df\") " pod="openstack-kuttl-tests/barbican-worker-6f96bb5df9-spfxv" Mar 16 17:00:36 crc kubenswrapper[5120]: I0316 17:00:36.101963 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fb7a2068-5a18-4c7b-92d0-364f371d59df-combined-ca-bundle\") pod \"barbican-worker-6f96bb5df9-spfxv\" (UID: \"fb7a2068-5a18-4c7b-92d0-364f371d59df\") " pod="openstack-kuttl-tests/barbican-worker-6f96bb5df9-spfxv" Mar 16 17:00:36 crc kubenswrapper[5120]: I0316 17:00:36.102098 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fb7a2068-5a18-4c7b-92d0-364f371d59df-config-data\") pod \"barbican-worker-6f96bb5df9-spfxv\" (UID: \"fb7a2068-5a18-4c7b-92d0-364f371d59df\") " pod="openstack-kuttl-tests/barbican-worker-6f96bb5df9-spfxv" Mar 16 17:00:36 crc kubenswrapper[5120]: I0316 17:00:36.102232 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/fb7a2068-5a18-4c7b-92d0-364f371d59df-logs\") pod \"barbican-worker-6f96bb5df9-spfxv\" (UID: \"fb7a2068-5a18-4c7b-92d0-364f371d59df\") " pod="openstack-kuttl-tests/barbican-worker-6f96bb5df9-spfxv" Mar 16 17:00:36 crc kubenswrapper[5120]: I0316 17:00:36.111163 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-6b9b487fd6-hdw75" Mar 16 17:00:36 crc kubenswrapper[5120]: I0316 17:00:36.145934 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 17:00:36 crc kubenswrapper[5120]: I0316 17:00:36.146697 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podUID="4ae0ee71-cb7b-4458-9176-1a941416c653" containerName="openstack-network-exporter" containerID="cri-o://58dfb8f6f45a99d10e362ec0532e93b658925573a2fd7ebc9291f9e8266f5a1e" gracePeriod=300 Mar 16 17:00:36 crc kubenswrapper[5120]: I0316 17:00:36.175492 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-6f96bb5df9-spfxv"] Mar 16 17:00:36 crc kubenswrapper[5120]: I0316 17:00:36.206799 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/fb7a2068-5a18-4c7b-92d0-364f371d59df-config-data-custom\") pod \"barbican-worker-6f96bb5df9-spfxv\" (UID: \"fb7a2068-5a18-4c7b-92d0-364f371d59df\") " pod="openstack-kuttl-tests/barbican-worker-6f96bb5df9-spfxv" Mar 16 17:00:36 crc kubenswrapper[5120]: I0316 17:00:36.207031 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fb7a2068-5a18-4c7b-92d0-364f371d59df-combined-ca-bundle\") pod \"barbican-worker-6f96bb5df9-spfxv\" (UID: \"fb7a2068-5a18-4c7b-92d0-364f371d59df\") " pod="openstack-kuttl-tests/barbican-worker-6f96bb5df9-spfxv" Mar 16 17:00:36 crc kubenswrapper[5120]: I0316 17:00:36.207097 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fb7a2068-5a18-4c7b-92d0-364f371d59df-config-data\") pod \"barbican-worker-6f96bb5df9-spfxv\" (UID: \"fb7a2068-5a18-4c7b-92d0-364f371d59df\") " pod="openstack-kuttl-tests/barbican-worker-6f96bb5df9-spfxv" Mar 16 17:00:36 crc kubenswrapper[5120]: I0316 17:00:36.207171 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/fb7a2068-5a18-4c7b-92d0-364f371d59df-logs\") pod \"barbican-worker-6f96bb5df9-spfxv\" (UID: \"fb7a2068-5a18-4c7b-92d0-364f371d59df\") " pod="openstack-kuttl-tests/barbican-worker-6f96bb5df9-spfxv" Mar 16 17:00:36 crc kubenswrapper[5120]: I0316 17:00:36.207291 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-htrkw\" (UniqueName: \"kubernetes.io/projected/fb7a2068-5a18-4c7b-92d0-364f371d59df-kube-api-access-htrkw\") pod \"barbican-worker-6f96bb5df9-spfxv\" (UID: \"fb7a2068-5a18-4c7b-92d0-364f371d59df\") " pod="openstack-kuttl-tests/barbican-worker-6f96bb5df9-spfxv" Mar 16 17:00:36 crc kubenswrapper[5120]: I0316 17:00:36.208785 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/fb7a2068-5a18-4c7b-92d0-364f371d59df-logs\") pod \"barbican-worker-6f96bb5df9-spfxv\" (UID: \"fb7a2068-5a18-4c7b-92d0-364f371d59df\") " pod="openstack-kuttl-tests/barbican-worker-6f96bb5df9-spfxv" Mar 16 17:00:36 crc kubenswrapper[5120]: I0316 17:00:36.235086 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fb7a2068-5a18-4c7b-92d0-364f371d59df-config-data\") pod \"barbican-worker-6f96bb5df9-spfxv\" (UID: \"fb7a2068-5a18-4c7b-92d0-364f371d59df\") " pod="openstack-kuttl-tests/barbican-worker-6f96bb5df9-spfxv" Mar 16 17:00:36 crc kubenswrapper[5120]: I0316 17:00:36.240428 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/fb7a2068-5a18-4c7b-92d0-364f371d59df-config-data-custom\") pod \"barbican-worker-6f96bb5df9-spfxv\" (UID: \"fb7a2068-5a18-4c7b-92d0-364f371d59df\") " pod="openstack-kuttl-tests/barbican-worker-6f96bb5df9-spfxv" Mar 16 17:00:36 crc kubenswrapper[5120]: I0316 17:00:36.252020 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 17:00:36 crc kubenswrapper[5120]: I0316 17:00:36.252340 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="5e3627d3-225e-4cd9-b5fb-9a27c888e1e1" containerName="nova-api-log" containerID="cri-o://c0ab31c9aab17588366733825ad14e257d3b43a783281ffa0077f78647ed983a" gracePeriod=30 Mar 16 17:00:36 crc kubenswrapper[5120]: I0316 17:00:36.252844 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="5e3627d3-225e-4cd9-b5fb-9a27c888e1e1" containerName="nova-api-api" containerID="cri-o://6706e0144fa060f50b0e39d25b8522795d2fe95416f82712ad1b24882f9fff1a" gracePeriod=30 Mar 16 17:00:36 crc kubenswrapper[5120]: I0316 17:00:36.255442 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fb7a2068-5a18-4c7b-92d0-364f371d59df-combined-ca-bundle\") pod \"barbican-worker-6f96bb5df9-spfxv\" (UID: \"fb7a2068-5a18-4c7b-92d0-364f371d59df\") " pod="openstack-kuttl-tests/barbican-worker-6f96bb5df9-spfxv" Mar 16 17:00:36 crc kubenswrapper[5120]: I0316 17:00:36.304827 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 17:00:36 crc kubenswrapper[5120]: I0316 17:00:36.305088 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="a19b5964-8116-49bd-9181-8eb2fe61703e" containerName="nova-scheduler-scheduler" containerID="cri-o://31aa48ae9a695364d87a26a4847032706a8126fc6a90204e85b5a9a0b0bde237" gracePeriod=30 Mar 16 17:00:36 crc kubenswrapper[5120]: I0316 17:00:36.317437 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-htrkw\" (UniqueName: \"kubernetes.io/projected/fb7a2068-5a18-4c7b-92d0-364f371d59df-kube-api-access-htrkw\") pod \"barbican-worker-6f96bb5df9-spfxv\" (UID: \"fb7a2068-5a18-4c7b-92d0-364f371d59df\") " pod="openstack-kuttl-tests/barbican-worker-6f96bb5df9-spfxv" Mar 16 17:00:36 crc kubenswrapper[5120]: I0316 17:00:36.416214 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 17:00:36 crc kubenswrapper[5120]: I0316 17:00:36.416516 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="d82f3b2b-c672-46ff-8fc8-afc5b33e8252" containerName="probe" containerID="cri-o://28657cd9914973413b6f6e9aeaea403f0c4337248a7147ff00ed46ba9a535468" gracePeriod=30 Mar 16 17:00:36 crc kubenswrapper[5120]: I0316 17:00:36.417028 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="d82f3b2b-c672-46ff-8fc8-afc5b33e8252" containerName="cinder-scheduler" containerID="cri-o://498a641ae78ee7e529f010dee7dcbf81ff0ff8d58d98aecf53ad28696be667d1" gracePeriod=30 Mar 16 17:00:36 crc kubenswrapper[5120]: I0316 17:00:36.484609 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 17:00:36 crc kubenswrapper[5120]: I0316 17:00:36.484890 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="e8abcb6e-3312-4c62-8931-b9ad85725e5b" containerName="nova-cell1-conductor-conductor" containerID="cri-o://a1d23aa6e5afd485101028f0d3443a4dce5fef13ef6cd029e16a3912f04ce04d" gracePeriod=30 Mar 16 17:00:36 crc kubenswrapper[5120]: I0316 17:00:36.508732 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 17:00:36 crc kubenswrapper[5120]: I0316 17:00:36.523813 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-5b7968964b-sgwq2"] Mar 16 17:00:36 crc kubenswrapper[5120]: I0316 17:00:36.524415 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-5b7968964b-sgwq2" podUID="e78c00c6-8a77-403d-a9f1-49d34962c3f7" containerName="barbican-api-log" containerID="cri-o://5bdcd7fe3db4704f6e4591adfb538eaadb322c191c3a867ec1f159e1cecab7f2" gracePeriod=30 Mar 16 17:00:36 crc kubenswrapper[5120]: I0316 17:00:36.524885 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-5b7968964b-sgwq2" podUID="e78c00c6-8a77-403d-a9f1-49d34962c3f7" containerName="barbican-api" containerID="cri-o://94e1102e08240e0ac6ddeb805485b6575f608c17fcfd298c5170b5fd7e295206" gracePeriod=30 Mar 16 17:00:36 crc kubenswrapper[5120]: I0316 17:00:36.553004 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openstack-kuttl-tests/barbican-api-5b7968964b-sgwq2" podUID="e78c00c6-8a77-403d-a9f1-49d34962c3f7" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.1.76:9311/healthcheck\": EOF" Mar 16 17:00:36 crc kubenswrapper[5120]: I0316 17:00:36.563421 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-5b7968964b-sgwq2" podUID="e78c00c6-8a77-403d-a9f1-49d34962c3f7" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.1.76:9311/healthcheck\": EOF" Mar 16 17:00:36 crc kubenswrapper[5120]: I0316 17:00:36.563555 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-5b7968964b-sgwq2" podUID="e78c00c6-8a77-403d-a9f1-49d34962c3f7" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.1.76:9311/healthcheck\": EOF" Mar 16 17:00:36 crc kubenswrapper[5120]: I0316 17:00:36.563704 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openstack-kuttl-tests/barbican-api-5b7968964b-sgwq2" podUID="e78c00c6-8a77-403d-a9f1-49d34962c3f7" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.1.76:9311/healthcheck\": EOF" Mar 16 17:00:36 crc kubenswrapper[5120]: I0316 17:00:36.563882 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podUID="4ae0ee71-cb7b-4458-9176-1a941416c653" containerName="ovsdbserver-nb" containerID="cri-o://2aaf683507989a8fa9876cc1505c80fb8c145455029fa196d10039ad20b5e5a7" gracePeriod=300 Mar 16 17:00:36 crc kubenswrapper[5120]: I0316 17:00:36.596840 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-5b9b97df74-9rl5z"] Mar 16 17:00:36 crc kubenswrapper[5120]: I0316 17:00:36.597121 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-5b9b97df74-9rl5z" podUID="9c429916-2d70-42f0-a572-90ab8aafafbe" containerName="placement-log" containerID="cri-o://8c3e9f0e4cad0fda0af2b317f990769cd6b26ce52d37356ab5cfcec66dfb8757" gracePeriod=30 Mar 16 17:00:36 crc kubenswrapper[5120]: I0316 17:00:36.608949 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-5b9b97df74-9rl5z" podUID="9c429916-2d70-42f0-a572-90ab8aafafbe" containerName="placement-api" containerID="cri-o://3ece0d70ebee943dfa6da07bcdd8a9f1af493f5fb471bb0e8264cf34758995a3" gracePeriod=30 Mar 16 17:00:36 crc kubenswrapper[5120]: I0316 17:00:36.610235 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-6f96bb5df9-spfxv" Mar 16 17:00:36 crc kubenswrapper[5120]: I0316 17:00:36.799398 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/placement-5b9b97df74-9rl5z" podUID="9c429916-2d70-42f0-a572-90ab8aafafbe" containerName="placement-api" probeResult="failure" output="Get \"https://10.217.1.74:8778/\": EOF" Mar 16 17:00:36 crc kubenswrapper[5120]: I0316 17:00:36.845112 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 17:00:36 crc kubenswrapper[5120]: I0316 17:00:36.845411 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 17:00:36 crc kubenswrapper[5120]: I0316 17:00:36.845478 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 17:00:36 crc kubenswrapper[5120]: I0316 17:00:36.846375 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="55f7f374-c6b2-422b-90bd-a7dcc936e74f" containerName="glance-log" containerID="cri-o://3a8540189ac4b61cc8961e4e6f1bd0b50460a59e9a3da28c3f5cb5d2109ddf3f" gracePeriod=30 Mar 16 17:00:36 crc kubenswrapper[5120]: I0316 17:00:36.846611 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="55f7f374-c6b2-422b-90bd-a7dcc936e74f" containerName="glance-httpd" containerID="cri-o://7c8283b18df5600672951ca55dfc7a2133e3c633c2c87ee077597e69c0583de6" gracePeriod=30 Mar 16 17:00:36 crc kubenswrapper[5120]: I0316 17:00:36.846901 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="1f6975fd-67a9-4ce2-87b0-7318d7345a80" containerName="account-server" containerID="cri-o://5bbe509850c00dbbb70f25ebabb5a6428197bfd27e4e15d3720d24f733d47545" gracePeriod=30 Mar 16 17:00:36 crc kubenswrapper[5120]: I0316 17:00:36.847072 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="1f6975fd-67a9-4ce2-87b0-7318d7345a80" containerName="swift-recon-cron" containerID="cri-o://a13b02076f983681a11b54a1569f95dfe4808752321801358ab0264bcf250454" gracePeriod=30 Mar 16 17:00:36 crc kubenswrapper[5120]: I0316 17:00:36.847144 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="1f6975fd-67a9-4ce2-87b0-7318d7345a80" containerName="rsync" containerID="cri-o://ea0a58d085e77e9f2e80fb3abe6830d44085c6de8bbc41d01e3ce40efd201333" gracePeriod=30 Mar 16 17:00:36 crc kubenswrapper[5120]: I0316 17:00:36.847179 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="1f6975fd-67a9-4ce2-87b0-7318d7345a80" containerName="object-expirer" containerID="cri-o://0d6f935c1c526a5f0534fe1c16af647e381d75b15f387ea4fe7dccbef914de3c" gracePeriod=30 Mar 16 17:00:36 crc kubenswrapper[5120]: I0316 17:00:36.847211 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="1f6975fd-67a9-4ce2-87b0-7318d7345a80" containerName="object-updater" containerID="cri-o://0e0c5f231603ea1e00da8c71a3719c91517ffbef85631d7b15f8ddffae3fc859" gracePeriod=30 Mar 16 17:00:36 crc kubenswrapper[5120]: I0316 17:00:36.847269 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="1f6975fd-67a9-4ce2-87b0-7318d7345a80" containerName="object-auditor" containerID="cri-o://8fcc879ae0f691fdfd5cd0fe4b16ffe3d232c975df243d8f32fa92fd036127e7" gracePeriod=30 Mar 16 17:00:36 crc kubenswrapper[5120]: I0316 17:00:36.847311 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="1f6975fd-67a9-4ce2-87b0-7318d7345a80" containerName="object-replicator" containerID="cri-o://1d2089103eb63f1bcee2dbea95910e480727a3907ba19bd2a3fd5b82c3ef8a0e" gracePeriod=30 Mar 16 17:00:36 crc kubenswrapper[5120]: I0316 17:00:36.847345 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="1f6975fd-67a9-4ce2-87b0-7318d7345a80" containerName="object-server" containerID="cri-o://0ec73f2c6eba913a4bcd3d808e105a68bc2427f897a4d87db565f924c91ef3ac" gracePeriod=30 Mar 16 17:00:36 crc kubenswrapper[5120]: I0316 17:00:36.847374 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="1f6975fd-67a9-4ce2-87b0-7318d7345a80" containerName="container-updater" containerID="cri-o://556839845d225aff65b5ca07364c6f9f9b4d50587a636e047429ac5ade952de4" gracePeriod=30 Mar 16 17:00:36 crc kubenswrapper[5120]: I0316 17:00:36.847415 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="1f6975fd-67a9-4ce2-87b0-7318d7345a80" containerName="container-auditor" containerID="cri-o://2ceda8ed6affc59d31db4f2f07d3a8ebf040b3bc7d71f407b104748fbaeb5108" gracePeriod=30 Mar 16 17:00:36 crc kubenswrapper[5120]: I0316 17:00:36.847449 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="1f6975fd-67a9-4ce2-87b0-7318d7345a80" containerName="container-replicator" containerID="cri-o://2d33a82773827d3fc5dd80071dc63c0443a8e527afa994c6317d12be137c1056" gracePeriod=30 Mar 16 17:00:36 crc kubenswrapper[5120]: I0316 17:00:36.847487 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="1f6975fd-67a9-4ce2-87b0-7318d7345a80" containerName="container-server" containerID="cri-o://3283eed1799cc5cf220c4d4610b8ff792b9e5f3e4e9b924171c4e3139945654e" gracePeriod=30 Mar 16 17:00:36 crc kubenswrapper[5120]: I0316 17:00:36.847530 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="1f6975fd-67a9-4ce2-87b0-7318d7345a80" containerName="account-reaper" containerID="cri-o://42849e2776cea701e33065bdd6a04004ebe1c46b7b15be851b9968528ea41270" gracePeriod=30 Mar 16 17:00:36 crc kubenswrapper[5120]: I0316 17:00:36.847571 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="1f6975fd-67a9-4ce2-87b0-7318d7345a80" containerName="account-auditor" containerID="cri-o://d9ba57534506b9295f26e2c084a6001d61593b940fe5c320a291c95cbf236766" gracePeriod=30 Mar 16 17:00:36 crc kubenswrapper[5120]: I0316 17:00:36.847604 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="1f6975fd-67a9-4ce2-87b0-7318d7345a80" containerName="account-replicator" containerID="cri-o://b238bb89bbe2b3c43c7a92f158ccc80fa8bc740d10604a58081cf0dbc80ad67e" gracePeriod=30 Mar 16 17:00:36 crc kubenswrapper[5120]: I0316 17:00:36.855279 5120 generic.go:358] "Generic (PLEG): container finished" podID="4ae0ee71-cb7b-4458-9176-1a941416c653" containerID="58dfb8f6f45a99d10e362ec0532e93b658925573a2fd7ebc9291f9e8266f5a1e" exitCode=2 Mar 16 17:00:36 crc kubenswrapper[5120]: I0316 17:00:36.855454 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"4ae0ee71-cb7b-4458-9176-1a941416c653","Type":"ContainerDied","Data":"58dfb8f6f45a99d10e362ec0532e93b658925573a2fd7ebc9291f9e8266f5a1e"} Mar 16 17:00:36 crc kubenswrapper[5120]: I0316 17:00:36.879845 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 17:00:36 crc kubenswrapper[5120]: I0316 17:00:36.880192 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podUID="6fdf4b26-c833-4319-954a-7ebaaedb71e5" containerName="nova-cell1-novncproxy-novncproxy" containerID="cri-o://3655ac4348732f181824d8b56c72c7de7b64844e0300e8e4f1f18a838415654b" gracePeriod=30 Mar 16 17:00:36 crc kubenswrapper[5120]: I0316 17:00:36.932080 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-57589895fd-84tvt"] Mar 16 17:00:36 crc kubenswrapper[5120]: I0316 17:00:36.955894 5120 generic.go:358] "Generic (PLEG): container finished" podID="447b243b-6b80-4883-9844-f49d3f2f4a22" containerID="9ffb7d4c0f767f982e7526ce10b289cd90603393d82c612888bce9bf3709ecce" exitCode=143 Mar 16 17:00:36 crc kubenswrapper[5120]: I0316 17:00:36.969771 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/placement-5b9b97df74-9rl5z" podUID="9c429916-2d70-42f0-a572-90ab8aafafbe" containerName="placement-log" probeResult="failure" output="Get \"https://10.217.1.74:8778/\": read tcp 10.217.0.2:54602->10.217.1.74:8778: read: connection reset by peer" Mar 16 17:00:36 crc kubenswrapper[5120]: I0316 17:00:36.972366 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"447b243b-6b80-4883-9844-f49d3f2f4a22","Type":"ContainerDied","Data":"9ffb7d4c0f767f982e7526ce10b289cd90603393d82c612888bce9bf3709ecce"} Mar 16 17:00:36 crc kubenswrapper[5120]: I0316 17:00:36.972516 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-57589895fd-84tvt" Mar 16 17:00:36 crc kubenswrapper[5120]: I0316 17:00:36.979038 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/08933bb0-40b0-4b92-b9d1-af46cdcc8aad-scripts\") pod \"placement-57589895fd-84tvt\" (UID: \"08933bb0-40b0-4b92-b9d1-af46cdcc8aad\") " pod="openstack-kuttl-tests/placement-57589895fd-84tvt" Mar 16 17:00:36 crc kubenswrapper[5120]: I0316 17:00:36.979176 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2vsk\" (UniqueName: \"kubernetes.io/projected/08933bb0-40b0-4b92-b9d1-af46cdcc8aad-kube-api-access-d2vsk\") pod \"placement-57589895fd-84tvt\" (UID: \"08933bb0-40b0-4b92-b9d1-af46cdcc8aad\") " pod="openstack-kuttl-tests/placement-57589895fd-84tvt" Mar 16 17:00:36 crc kubenswrapper[5120]: I0316 17:00:36.979211 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/08933bb0-40b0-4b92-b9d1-af46cdcc8aad-internal-tls-certs\") pod \"placement-57589895fd-84tvt\" (UID: \"08933bb0-40b0-4b92-b9d1-af46cdcc8aad\") " pod="openstack-kuttl-tests/placement-57589895fd-84tvt" Mar 16 17:00:36 crc kubenswrapper[5120]: I0316 17:00:36.984271 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/08933bb0-40b0-4b92-b9d1-af46cdcc8aad-public-tls-certs\") pod \"placement-57589895fd-84tvt\" (UID: \"08933bb0-40b0-4b92-b9d1-af46cdcc8aad\") " pod="openstack-kuttl-tests/placement-57589895fd-84tvt" Mar 16 17:00:36 crc kubenswrapper[5120]: I0316 17:00:36.984467 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/08933bb0-40b0-4b92-b9d1-af46cdcc8aad-combined-ca-bundle\") pod \"placement-57589895fd-84tvt\" (UID: \"08933bb0-40b0-4b92-b9d1-af46cdcc8aad\") " pod="openstack-kuttl-tests/placement-57589895fd-84tvt" Mar 16 17:00:36 crc kubenswrapper[5120]: I0316 17:00:36.984577 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/08933bb0-40b0-4b92-b9d1-af46cdcc8aad-config-data\") pod \"placement-57589895fd-84tvt\" (UID: \"08933bb0-40b0-4b92-b9d1-af46cdcc8aad\") " pod="openstack-kuttl-tests/placement-57589895fd-84tvt" Mar 16 17:00:36 crc kubenswrapper[5120]: I0316 17:00:36.984737 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/08933bb0-40b0-4b92-b9d1-af46cdcc8aad-logs\") pod \"placement-57589895fd-84tvt\" (UID: \"08933bb0-40b0-4b92-b9d1-af46cdcc8aad\") " pod="openstack-kuttl-tests/placement-57589895fd-84tvt" Mar 16 17:00:36 crc kubenswrapper[5120]: I0316 17:00:36.988074 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-api-8579c6748-8wfdq"] Mar 16 17:00:37 crc kubenswrapper[5120]: I0316 17:00:37.035810 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-8579c6748-8wfdq" Mar 16 17:00:37 crc kubenswrapper[5120]: I0316 17:00:37.042016 5120 generic.go:358] "Generic (PLEG): container finished" podID="e2ad712e-f6f5-4942-94b9-635bbc53da15" containerID="a50bcb7bcd40881ab5aeb26896fa0bf1d2d92d9720a9cc6da29240635d7ae72b" exitCode=143 Mar 16 17:00:37 crc kubenswrapper[5120]: I0316 17:00:37.042127 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"e2ad712e-f6f5-4942-94b9-635bbc53da15","Type":"ContainerDied","Data":"a50bcb7bcd40881ab5aeb26896fa0bf1d2d92d9720a9cc6da29240635d7ae72b"} Mar 16 17:00:37 crc kubenswrapper[5120]: I0316 17:00:37.069923 5120 generic.go:358] "Generic (PLEG): container finished" podID="a519f6d6-0bc7-43f3-9ad7-98a44f627488" containerID="35ca9562e24968de8b31ef801a1f01d23ff0204af1a566b33c7aeeb79c0016fa" exitCode=2 Mar 16 17:00:37 crc kubenswrapper[5120]: I0316 17:00:37.070173 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-57589895fd-84tvt"] Mar 16 17:00:37 crc kubenswrapper[5120]: I0316 17:00:37.070203 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"a519f6d6-0bc7-43f3-9ad7-98a44f627488","Type":"ContainerDied","Data":"35ca9562e24968de8b31ef801a1f01d23ff0204af1a566b33c7aeeb79c0016fa"} Mar 16 17:00:37 crc kubenswrapper[5120]: I0316 17:00:37.087349 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/08933bb0-40b0-4b92-b9d1-af46cdcc8aad-public-tls-certs\") pod \"placement-57589895fd-84tvt\" (UID: \"08933bb0-40b0-4b92-b9d1-af46cdcc8aad\") " pod="openstack-kuttl-tests/placement-57589895fd-84tvt" Mar 16 17:00:37 crc kubenswrapper[5120]: I0316 17:00:37.087397 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6f3cdac2-9246-455c-b05a-347b4db60b7f-public-tls-certs\") pod \"barbican-api-8579c6748-8wfdq\" (UID: \"6f3cdac2-9246-455c-b05a-347b4db60b7f\") " pod="openstack-kuttl-tests/barbican-api-8579c6748-8wfdq" Mar 16 17:00:37 crc kubenswrapper[5120]: I0316 17:00:37.087440 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/08933bb0-40b0-4b92-b9d1-af46cdcc8aad-combined-ca-bundle\") pod \"placement-57589895fd-84tvt\" (UID: \"08933bb0-40b0-4b92-b9d1-af46cdcc8aad\") " pod="openstack-kuttl-tests/placement-57589895fd-84tvt" Mar 16 17:00:37 crc kubenswrapper[5120]: I0316 17:00:37.087466 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/08933bb0-40b0-4b92-b9d1-af46cdcc8aad-config-data\") pod \"placement-57589895fd-84tvt\" (UID: \"08933bb0-40b0-4b92-b9d1-af46cdcc8aad\") " pod="openstack-kuttl-tests/placement-57589895fd-84tvt" Mar 16 17:00:37 crc kubenswrapper[5120]: I0316 17:00:37.087522 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/08933bb0-40b0-4b92-b9d1-af46cdcc8aad-logs\") pod \"placement-57589895fd-84tvt\" (UID: \"08933bb0-40b0-4b92-b9d1-af46cdcc8aad\") " pod="openstack-kuttl-tests/placement-57589895fd-84tvt" Mar 16 17:00:37 crc kubenswrapper[5120]: I0316 17:00:37.087543 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/6f3cdac2-9246-455c-b05a-347b4db60b7f-config-data-custom\") pod \"barbican-api-8579c6748-8wfdq\" (UID: \"6f3cdac2-9246-455c-b05a-347b4db60b7f\") " pod="openstack-kuttl-tests/barbican-api-8579c6748-8wfdq" Mar 16 17:00:37 crc kubenswrapper[5120]: I0316 17:00:37.087576 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdlhf\" (UniqueName: \"kubernetes.io/projected/6f3cdac2-9246-455c-b05a-347b4db60b7f-kube-api-access-vdlhf\") pod \"barbican-api-8579c6748-8wfdq\" (UID: \"6f3cdac2-9246-455c-b05a-347b4db60b7f\") " pod="openstack-kuttl-tests/barbican-api-8579c6748-8wfdq" Mar 16 17:00:37 crc kubenswrapper[5120]: I0316 17:00:37.087678 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6f3cdac2-9246-455c-b05a-347b4db60b7f-config-data\") pod \"barbican-api-8579c6748-8wfdq\" (UID: \"6f3cdac2-9246-455c-b05a-347b4db60b7f\") " pod="openstack-kuttl-tests/barbican-api-8579c6748-8wfdq" Mar 16 17:00:37 crc kubenswrapper[5120]: I0316 17:00:37.087702 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6f3cdac2-9246-455c-b05a-347b4db60b7f-combined-ca-bundle\") pod \"barbican-api-8579c6748-8wfdq\" (UID: \"6f3cdac2-9246-455c-b05a-347b4db60b7f\") " pod="openstack-kuttl-tests/barbican-api-8579c6748-8wfdq" Mar 16 17:00:37 crc kubenswrapper[5120]: I0316 17:00:37.087752 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6f3cdac2-9246-455c-b05a-347b4db60b7f-logs\") pod \"barbican-api-8579c6748-8wfdq\" (UID: \"6f3cdac2-9246-455c-b05a-347b4db60b7f\") " pod="openstack-kuttl-tests/barbican-api-8579c6748-8wfdq" Mar 16 17:00:37 crc kubenswrapper[5120]: I0316 17:00:37.087789 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6f3cdac2-9246-455c-b05a-347b4db60b7f-internal-tls-certs\") pod \"barbican-api-8579c6748-8wfdq\" (UID: \"6f3cdac2-9246-455c-b05a-347b4db60b7f\") " pod="openstack-kuttl-tests/barbican-api-8579c6748-8wfdq" Mar 16 17:00:37 crc kubenswrapper[5120]: I0316 17:00:37.087877 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/08933bb0-40b0-4b92-b9d1-af46cdcc8aad-scripts\") pod \"placement-57589895fd-84tvt\" (UID: \"08933bb0-40b0-4b92-b9d1-af46cdcc8aad\") " pod="openstack-kuttl-tests/placement-57589895fd-84tvt" Mar 16 17:00:37 crc kubenswrapper[5120]: I0316 17:00:37.087924 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d2vsk\" (UniqueName: \"kubernetes.io/projected/08933bb0-40b0-4b92-b9d1-af46cdcc8aad-kube-api-access-d2vsk\") pod \"placement-57589895fd-84tvt\" (UID: \"08933bb0-40b0-4b92-b9d1-af46cdcc8aad\") " pod="openstack-kuttl-tests/placement-57589895fd-84tvt" Mar 16 17:00:37 crc kubenswrapper[5120]: I0316 17:00:37.087946 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/08933bb0-40b0-4b92-b9d1-af46cdcc8aad-internal-tls-certs\") pod \"placement-57589895fd-84tvt\" (UID: \"08933bb0-40b0-4b92-b9d1-af46cdcc8aad\") " pod="openstack-kuttl-tests/placement-57589895fd-84tvt" Mar 16 17:00:37 crc kubenswrapper[5120]: I0316 17:00:37.098170 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/08933bb0-40b0-4b92-b9d1-af46cdcc8aad-internal-tls-certs\") pod \"placement-57589895fd-84tvt\" (UID: \"08933bb0-40b0-4b92-b9d1-af46cdcc8aad\") " pod="openstack-kuttl-tests/placement-57589895fd-84tvt" Mar 16 17:00:37 crc kubenswrapper[5120]: I0316 17:00:37.098494 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/08933bb0-40b0-4b92-b9d1-af46cdcc8aad-logs\") pod \"placement-57589895fd-84tvt\" (UID: \"08933bb0-40b0-4b92-b9d1-af46cdcc8aad\") " pod="openstack-kuttl-tests/placement-57589895fd-84tvt" Mar 16 17:00:37 crc kubenswrapper[5120]: I0316 17:00:37.108432 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/08933bb0-40b0-4b92-b9d1-af46cdcc8aad-public-tls-certs\") pod \"placement-57589895fd-84tvt\" (UID: \"08933bb0-40b0-4b92-b9d1-af46cdcc8aad\") " pod="openstack-kuttl-tests/placement-57589895fd-84tvt" Mar 16 17:00:37 crc kubenswrapper[5120]: I0316 17:00:37.110884 5120 generic.go:358] "Generic (PLEG): container finished" podID="5e3627d3-225e-4cd9-b5fb-9a27c888e1e1" containerID="c0ab31c9aab17588366733825ad14e257d3b43a783281ffa0077f78647ed983a" exitCode=143 Mar 16 17:00:37 crc kubenswrapper[5120]: I0316 17:00:37.111126 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/08933bb0-40b0-4b92-b9d1-af46cdcc8aad-scripts\") pod \"placement-57589895fd-84tvt\" (UID: \"08933bb0-40b0-4b92-b9d1-af46cdcc8aad\") " pod="openstack-kuttl-tests/placement-57589895fd-84tvt" Mar 16 17:00:37 crc kubenswrapper[5120]: I0316 17:00:37.111212 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"5e3627d3-225e-4cd9-b5fb-9a27c888e1e1","Type":"ContainerDied","Data":"c0ab31c9aab17588366733825ad14e257d3b43a783281ffa0077f78647ed983a"} Mar 16 17:00:37 crc kubenswrapper[5120]: I0316 17:00:37.118705 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/08933bb0-40b0-4b92-b9d1-af46cdcc8aad-combined-ca-bundle\") pod \"placement-57589895fd-84tvt\" (UID: \"08933bb0-40b0-4b92-b9d1-af46cdcc8aad\") " pod="openstack-kuttl-tests/placement-57589895fd-84tvt" Mar 16 17:00:37 crc kubenswrapper[5120]: I0316 17:00:37.120587 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/08933bb0-40b0-4b92-b9d1-af46cdcc8aad-config-data\") pod \"placement-57589895fd-84tvt\" (UID: \"08933bb0-40b0-4b92-b9d1-af46cdcc8aad\") " pod="openstack-kuttl-tests/placement-57589895fd-84tvt" Mar 16 17:00:37 crc kubenswrapper[5120]: I0316 17:00:37.120621 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 17:00:37 crc kubenswrapper[5120]: I0316 17:00:37.120886 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="7712130b-a000-4541-a1b1-7442adb622f7" containerName="nova-cell0-conductor-conductor" containerID="cri-o://b42f7912bd0af5cc7eea7bbb672d44c2af34ef4c9686f59f00ea55d40951315a" gracePeriod=30 Mar 16 17:00:37 crc kubenswrapper[5120]: I0316 17:00:37.168505 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-8579c6748-8wfdq"] Mar 16 17:00:37 crc kubenswrapper[5120]: I0316 17:00:37.170912 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2vsk\" (UniqueName: \"kubernetes.io/projected/08933bb0-40b0-4b92-b9d1-af46cdcc8aad-kube-api-access-d2vsk\") pod \"placement-57589895fd-84tvt\" (UID: \"08933bb0-40b0-4b92-b9d1-af46cdcc8aad\") " pod="openstack-kuttl-tests/placement-57589895fd-84tvt" Mar 16 17:00:37 crc kubenswrapper[5120]: I0316 17:00:37.195568 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6f3cdac2-9246-455c-b05a-347b4db60b7f-public-tls-certs\") pod \"barbican-api-8579c6748-8wfdq\" (UID: \"6f3cdac2-9246-455c-b05a-347b4db60b7f\") " pod="openstack-kuttl-tests/barbican-api-8579c6748-8wfdq" Mar 16 17:00:37 crc kubenswrapper[5120]: I0316 17:00:37.195734 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/6f3cdac2-9246-455c-b05a-347b4db60b7f-config-data-custom\") pod \"barbican-api-8579c6748-8wfdq\" (UID: \"6f3cdac2-9246-455c-b05a-347b4db60b7f\") " pod="openstack-kuttl-tests/barbican-api-8579c6748-8wfdq" Mar 16 17:00:37 crc kubenswrapper[5120]: I0316 17:00:37.195798 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vdlhf\" (UniqueName: \"kubernetes.io/projected/6f3cdac2-9246-455c-b05a-347b4db60b7f-kube-api-access-vdlhf\") pod \"barbican-api-8579c6748-8wfdq\" (UID: \"6f3cdac2-9246-455c-b05a-347b4db60b7f\") " pod="openstack-kuttl-tests/barbican-api-8579c6748-8wfdq" Mar 16 17:00:37 crc kubenswrapper[5120]: I0316 17:00:37.195957 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6f3cdac2-9246-455c-b05a-347b4db60b7f-config-data\") pod \"barbican-api-8579c6748-8wfdq\" (UID: \"6f3cdac2-9246-455c-b05a-347b4db60b7f\") " pod="openstack-kuttl-tests/barbican-api-8579c6748-8wfdq" Mar 16 17:00:37 crc kubenswrapper[5120]: I0316 17:00:37.195989 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6f3cdac2-9246-455c-b05a-347b4db60b7f-combined-ca-bundle\") pod \"barbican-api-8579c6748-8wfdq\" (UID: \"6f3cdac2-9246-455c-b05a-347b4db60b7f\") " pod="openstack-kuttl-tests/barbican-api-8579c6748-8wfdq" Mar 16 17:00:37 crc kubenswrapper[5120]: I0316 17:00:37.196089 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6f3cdac2-9246-455c-b05a-347b4db60b7f-logs\") pod \"barbican-api-8579c6748-8wfdq\" (UID: \"6f3cdac2-9246-455c-b05a-347b4db60b7f\") " pod="openstack-kuttl-tests/barbican-api-8579c6748-8wfdq" Mar 16 17:00:37 crc kubenswrapper[5120]: I0316 17:00:37.196118 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6f3cdac2-9246-455c-b05a-347b4db60b7f-internal-tls-certs\") pod \"barbican-api-8579c6748-8wfdq\" (UID: \"6f3cdac2-9246-455c-b05a-347b4db60b7f\") " pod="openstack-kuttl-tests/barbican-api-8579c6748-8wfdq" Mar 16 17:00:37 crc kubenswrapper[5120]: I0316 17:00:37.201697 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6f3cdac2-9246-455c-b05a-347b4db60b7f-public-tls-certs\") pod \"barbican-api-8579c6748-8wfdq\" (UID: \"6f3cdac2-9246-455c-b05a-347b4db60b7f\") " pod="openstack-kuttl-tests/barbican-api-8579c6748-8wfdq" Mar 16 17:00:37 crc kubenswrapper[5120]: I0316 17:00:37.206261 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6f3cdac2-9246-455c-b05a-347b4db60b7f-logs\") pod \"barbican-api-8579c6748-8wfdq\" (UID: \"6f3cdac2-9246-455c-b05a-347b4db60b7f\") " pod="openstack-kuttl-tests/barbican-api-8579c6748-8wfdq" Mar 16 17:00:37 crc kubenswrapper[5120]: I0316 17:00:37.209251 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6f3cdac2-9246-455c-b05a-347b4db60b7f-internal-tls-certs\") pod \"barbican-api-8579c6748-8wfdq\" (UID: \"6f3cdac2-9246-455c-b05a-347b4db60b7f\") " pod="openstack-kuttl-tests/barbican-api-8579c6748-8wfdq" Mar 16 17:00:37 crc kubenswrapper[5120]: I0316 17:00:37.210729 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/6f3cdac2-9246-455c-b05a-347b4db60b7f-config-data-custom\") pod \"barbican-api-8579c6748-8wfdq\" (UID: \"6f3cdac2-9246-455c-b05a-347b4db60b7f\") " pod="openstack-kuttl-tests/barbican-api-8579c6748-8wfdq" Mar 16 17:00:37 crc kubenswrapper[5120]: I0316 17:00:37.228991 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 17:00:37 crc kubenswrapper[5120]: I0316 17:00:37.229704 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podUID="07f2b57d-24dd-44a8-9399-3d3df8cd1a86" containerName="openstack-network-exporter" containerID="cri-o://82559c94402956204e6c0ed603726a5ace776e97196e0de5c9afcf91e3a1161b" gracePeriod=300 Mar 16 17:00:37 crc kubenswrapper[5120]: I0316 17:00:37.231845 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6f3cdac2-9246-455c-b05a-347b4db60b7f-config-data\") pod \"barbican-api-8579c6748-8wfdq\" (UID: \"6f3cdac2-9246-455c-b05a-347b4db60b7f\") " pod="openstack-kuttl-tests/barbican-api-8579c6748-8wfdq" Mar 16 17:00:37 crc kubenswrapper[5120]: I0316 17:00:37.244566 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6f3cdac2-9246-455c-b05a-347b4db60b7f-combined-ca-bundle\") pod \"barbican-api-8579c6748-8wfdq\" (UID: \"6f3cdac2-9246-455c-b05a-347b4db60b7f\") " pod="openstack-kuttl-tests/barbican-api-8579c6748-8wfdq" Mar 16 17:00:37 crc kubenswrapper[5120]: I0316 17:00:37.254631 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdlhf\" (UniqueName: \"kubernetes.io/projected/6f3cdac2-9246-455c-b05a-347b4db60b7f-kube-api-access-vdlhf\") pod \"barbican-api-8579c6748-8wfdq\" (UID: \"6f3cdac2-9246-455c-b05a-347b4db60b7f\") " pod="openstack-kuttl-tests/barbican-api-8579c6748-8wfdq" Mar 16 17:00:37 crc kubenswrapper[5120]: I0316 17:00:37.306837 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-556c5fbd95-b6tt9"] Mar 16 17:00:37 crc kubenswrapper[5120]: I0316 17:00:37.307313 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/keystone-556c5fbd95-b6tt9" podUID="37a14538-41b4-4840-9f98-8e652da86950" containerName="keystone-api" containerID="cri-o://37f46cae89751e61473cf75d604d271349a611787e527b84be5fb9bfab6bafd4" gracePeriod=30 Mar 16 17:00:37 crc kubenswrapper[5120]: I0316 17:00:37.316826 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 17:00:37 crc kubenswrapper[5120]: E0316 17:00:37.326528 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a1d23aa6e5afd485101028f0d3443a4dce5fef13ef6cd029e16a3912f04ce04d" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 17:00:37 crc kubenswrapper[5120]: I0316 17:00:37.339108 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/keystone-556c5fbd95-b6tt9" podUID="37a14538-41b4-4840-9f98-8e652da86950" containerName="keystone-api" probeResult="failure" output="Get \"https://10.217.1.64:5000/v3\": EOF" Mar 16 17:00:37 crc kubenswrapper[5120]: I0316 17:00:37.339396 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-5f9fc84dc4-7nfss"] Mar 16 17:00:37 crc kubenswrapper[5120]: I0316 17:00:37.344575 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-5f9fc84dc4-7nfss" Mar 16 17:00:37 crc kubenswrapper[5120]: I0316 17:00:37.359825 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-5f9fc84dc4-7nfss"] Mar 16 17:00:37 crc kubenswrapper[5120]: E0316 17:00:37.388820 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a1d23aa6e5afd485101028f0d3443a4dce5fef13ef6cd029e16a3912f04ce04d" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 17:00:37 crc kubenswrapper[5120]: I0316 17:00:37.402162 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-6f846b8bfd-w69px"] Mar 16 17:00:37 crc kubenswrapper[5120]: I0316 17:00:37.402492 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-6f846b8bfd-w69px" podUID="e3143a49-62b5-408a-8dca-d723f7a31619" containerName="neutron-api" containerID="cri-o://1ba29d334446e91abdcb11e44fde235c795515796425914cd3ff6f4f69019510" gracePeriod=30 Mar 16 17:00:37 crc kubenswrapper[5120]: I0316 17:00:37.403348 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-6f846b8bfd-w69px" podUID="e3143a49-62b5-408a-8dca-d723f7a31619" containerName="neutron-httpd" containerID="cri-o://f8c1c5109f6bdbd96450c7a23d67c1a63f13b173010194ecf69b1864ecf069cd" gracePeriod=30 Mar 16 17:00:37 crc kubenswrapper[5120]: I0316 17:00:37.403606 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/openstack-galera-0" podUID="330c02d7-ea4c-47d3-bc2e-529f9b27b2a4" containerName="galera" containerID="cri-o://0c04394e8329ca282f6aec00fd61c8a448833782b4dc1a23dcf01dfbde2cad08" gracePeriod=30 Mar 16 17:00:37 crc kubenswrapper[5120]: I0316 17:00:37.405952 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/bdbf2033-4671-473e-9ede-ce2611d51fac-internal-tls-certs\") pod \"keystone-5f9fc84dc4-7nfss\" (UID: \"bdbf2033-4671-473e-9ede-ce2611d51fac\") " pod="openstack-kuttl-tests/keystone-5f9fc84dc4-7nfss" Mar 16 17:00:37 crc kubenswrapper[5120]: I0316 17:00:37.406080 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/bdbf2033-4671-473e-9ede-ce2611d51fac-public-tls-certs\") pod \"keystone-5f9fc84dc4-7nfss\" (UID: \"bdbf2033-4671-473e-9ede-ce2611d51fac\") " pod="openstack-kuttl-tests/keystone-5f9fc84dc4-7nfss" Mar 16 17:00:37 crc kubenswrapper[5120]: I0316 17:00:37.406456 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/bdbf2033-4671-473e-9ede-ce2611d51fac-scripts\") pod \"keystone-5f9fc84dc4-7nfss\" (UID: \"bdbf2033-4671-473e-9ede-ce2611d51fac\") " pod="openstack-kuttl-tests/keystone-5f9fc84dc4-7nfss" Mar 16 17:00:37 crc kubenswrapper[5120]: I0316 17:00:37.406506 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bdbf2033-4671-473e-9ede-ce2611d51fac-config-data\") pod \"keystone-5f9fc84dc4-7nfss\" (UID: \"bdbf2033-4671-473e-9ede-ce2611d51fac\") " pod="openstack-kuttl-tests/keystone-5f9fc84dc4-7nfss" Mar 16 17:00:37 crc kubenswrapper[5120]: I0316 17:00:37.406524 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ms7pw\" (UniqueName: \"kubernetes.io/projected/bdbf2033-4671-473e-9ede-ce2611d51fac-kube-api-access-ms7pw\") pod \"keystone-5f9fc84dc4-7nfss\" (UID: \"bdbf2033-4671-473e-9ede-ce2611d51fac\") " pod="openstack-kuttl-tests/keystone-5f9fc84dc4-7nfss" Mar 16 17:00:37 crc kubenswrapper[5120]: I0316 17:00:37.406660 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bdbf2033-4671-473e-9ede-ce2611d51fac-combined-ca-bundle\") pod \"keystone-5f9fc84dc4-7nfss\" (UID: \"bdbf2033-4671-473e-9ede-ce2611d51fac\") " pod="openstack-kuttl-tests/keystone-5f9fc84dc4-7nfss" Mar 16 17:00:37 crc kubenswrapper[5120]: I0316 17:00:37.406735 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/bdbf2033-4671-473e-9ede-ce2611d51fac-credential-keys\") pod \"keystone-5f9fc84dc4-7nfss\" (UID: \"bdbf2033-4671-473e-9ede-ce2611d51fac\") " pod="openstack-kuttl-tests/keystone-5f9fc84dc4-7nfss" Mar 16 17:00:37 crc kubenswrapper[5120]: I0316 17:00:37.406892 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/bdbf2033-4671-473e-9ede-ce2611d51fac-fernet-keys\") pod \"keystone-5f9fc84dc4-7nfss\" (UID: \"bdbf2033-4671-473e-9ede-ce2611d51fac\") " pod="openstack-kuttl-tests/keystone-5f9fc84dc4-7nfss" Mar 16 17:00:37 crc kubenswrapper[5120]: E0316 17:00:37.410976 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a1d23aa6e5afd485101028f0d3443a4dce5fef13ef6cd029e16a3912f04ce04d" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 17:00:37 crc kubenswrapper[5120]: E0316 17:00:37.411056 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="e8abcb6e-3312-4c62-8931-b9ad85725e5b" containerName="nova-cell1-conductor-conductor" probeResult="unknown" Mar 16 17:00:37 crc kubenswrapper[5120]: I0316 17:00:37.422355 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/neutron-6f846b8bfd-w69px" podUID="e3143a49-62b5-408a-8dca-d723f7a31619" containerName="neutron-httpd" probeResult="failure" output="Get \"https://10.217.1.71:9696/\": read tcp 10.217.0.2:35652->10.217.1.71:9696: read: connection reset by peer" Mar 16 17:00:37 crc kubenswrapper[5120]: I0316 17:00:37.432723 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-765bfffb44-jrj28"] Mar 16 17:00:37 crc kubenswrapper[5120]: I0316 17:00:37.452453 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-765bfffb44-jrj28" Mar 16 17:00:37 crc kubenswrapper[5120]: I0316 17:00:37.454958 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-765bfffb44-jrj28"] Mar 16 17:00:37 crc kubenswrapper[5120]: I0316 17:00:37.515053 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/bdbf2033-4671-473e-9ede-ce2611d51fac-fernet-keys\") pod \"keystone-5f9fc84dc4-7nfss\" (UID: \"bdbf2033-4671-473e-9ede-ce2611d51fac\") " pod="openstack-kuttl-tests/keystone-5f9fc84dc4-7nfss" Mar 16 17:00:37 crc kubenswrapper[5120]: I0316 17:00:37.515267 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801-ovndb-tls-certs\") pod \"neutron-765bfffb44-jrj28\" (UID: \"ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801\") " pod="openstack-kuttl-tests/neutron-765bfffb44-jrj28" Mar 16 17:00:37 crc kubenswrapper[5120]: I0316 17:00:37.515337 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/bdbf2033-4671-473e-9ede-ce2611d51fac-internal-tls-certs\") pod \"keystone-5f9fc84dc4-7nfss\" (UID: \"bdbf2033-4671-473e-9ede-ce2611d51fac\") " pod="openstack-kuttl-tests/keystone-5f9fc84dc4-7nfss" Mar 16 17:00:37 crc kubenswrapper[5120]: I0316 17:00:37.515369 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9c7q5\" (UniqueName: \"kubernetes.io/projected/ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801-kube-api-access-9c7q5\") pod \"neutron-765bfffb44-jrj28\" (UID: \"ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801\") " pod="openstack-kuttl-tests/neutron-765bfffb44-jrj28" Mar 16 17:00:37 crc kubenswrapper[5120]: I0316 17:00:37.515412 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801-public-tls-certs\") pod \"neutron-765bfffb44-jrj28\" (UID: \"ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801\") " pod="openstack-kuttl-tests/neutron-765bfffb44-jrj28" Mar 16 17:00:37 crc kubenswrapper[5120]: I0316 17:00:37.515500 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801-config\") pod \"neutron-765bfffb44-jrj28\" (UID: \"ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801\") " pod="openstack-kuttl-tests/neutron-765bfffb44-jrj28" Mar 16 17:00:37 crc kubenswrapper[5120]: I0316 17:00:37.515554 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/bdbf2033-4671-473e-9ede-ce2611d51fac-public-tls-certs\") pod \"keystone-5f9fc84dc4-7nfss\" (UID: \"bdbf2033-4671-473e-9ede-ce2611d51fac\") " pod="openstack-kuttl-tests/keystone-5f9fc84dc4-7nfss" Mar 16 17:00:37 crc kubenswrapper[5120]: I0316 17:00:37.515608 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801-combined-ca-bundle\") pod \"neutron-765bfffb44-jrj28\" (UID: \"ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801\") " pod="openstack-kuttl-tests/neutron-765bfffb44-jrj28" Mar 16 17:00:37 crc kubenswrapper[5120]: I0316 17:00:37.515777 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/bdbf2033-4671-473e-9ede-ce2611d51fac-scripts\") pod \"keystone-5f9fc84dc4-7nfss\" (UID: \"bdbf2033-4671-473e-9ede-ce2611d51fac\") " pod="openstack-kuttl-tests/keystone-5f9fc84dc4-7nfss" Mar 16 17:00:37 crc kubenswrapper[5120]: I0316 17:00:37.515815 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bdbf2033-4671-473e-9ede-ce2611d51fac-config-data\") pod \"keystone-5f9fc84dc4-7nfss\" (UID: \"bdbf2033-4671-473e-9ede-ce2611d51fac\") " pod="openstack-kuttl-tests/keystone-5f9fc84dc4-7nfss" Mar 16 17:00:37 crc kubenswrapper[5120]: I0316 17:00:37.515841 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ms7pw\" (UniqueName: \"kubernetes.io/projected/bdbf2033-4671-473e-9ede-ce2611d51fac-kube-api-access-ms7pw\") pod \"keystone-5f9fc84dc4-7nfss\" (UID: \"bdbf2033-4671-473e-9ede-ce2611d51fac\") " pod="openstack-kuttl-tests/keystone-5f9fc84dc4-7nfss" Mar 16 17:00:37 crc kubenswrapper[5120]: I0316 17:00:37.515870 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801-httpd-config\") pod \"neutron-765bfffb44-jrj28\" (UID: \"ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801\") " pod="openstack-kuttl-tests/neutron-765bfffb44-jrj28" Mar 16 17:00:37 crc kubenswrapper[5120]: I0316 17:00:37.515896 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bdbf2033-4671-473e-9ede-ce2611d51fac-combined-ca-bundle\") pod \"keystone-5f9fc84dc4-7nfss\" (UID: \"bdbf2033-4671-473e-9ede-ce2611d51fac\") " pod="openstack-kuttl-tests/keystone-5f9fc84dc4-7nfss" Mar 16 17:00:37 crc kubenswrapper[5120]: I0316 17:00:37.515929 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801-internal-tls-certs\") pod \"neutron-765bfffb44-jrj28\" (UID: \"ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801\") " pod="openstack-kuttl-tests/neutron-765bfffb44-jrj28" Mar 16 17:00:37 crc kubenswrapper[5120]: I0316 17:00:37.515974 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/bdbf2033-4671-473e-9ede-ce2611d51fac-credential-keys\") pod \"keystone-5f9fc84dc4-7nfss\" (UID: \"bdbf2033-4671-473e-9ede-ce2611d51fac\") " pod="openstack-kuttl-tests/keystone-5f9fc84dc4-7nfss" Mar 16 17:00:37 crc kubenswrapper[5120]: I0316 17:00:37.520619 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/bdbf2033-4671-473e-9ede-ce2611d51fac-fernet-keys\") pod \"keystone-5f9fc84dc4-7nfss\" (UID: \"bdbf2033-4671-473e-9ede-ce2611d51fac\") " pod="openstack-kuttl-tests/keystone-5f9fc84dc4-7nfss" Mar 16 17:00:37 crc kubenswrapper[5120]: I0316 17:00:37.525009 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/bdbf2033-4671-473e-9ede-ce2611d51fac-public-tls-certs\") pod \"keystone-5f9fc84dc4-7nfss\" (UID: \"bdbf2033-4671-473e-9ede-ce2611d51fac\") " pod="openstack-kuttl-tests/keystone-5f9fc84dc4-7nfss" Mar 16 17:00:37 crc kubenswrapper[5120]: I0316 17:00:37.528344 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/bdbf2033-4671-473e-9ede-ce2611d51fac-internal-tls-certs\") pod \"keystone-5f9fc84dc4-7nfss\" (UID: \"bdbf2033-4671-473e-9ede-ce2611d51fac\") " pod="openstack-kuttl-tests/keystone-5f9fc84dc4-7nfss" Mar 16 17:00:37 crc kubenswrapper[5120]: I0316 17:00:37.537484 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bdbf2033-4671-473e-9ede-ce2611d51fac-combined-ca-bundle\") pod \"keystone-5f9fc84dc4-7nfss\" (UID: \"bdbf2033-4671-473e-9ede-ce2611d51fac\") " pod="openstack-kuttl-tests/keystone-5f9fc84dc4-7nfss" Mar 16 17:00:37 crc kubenswrapper[5120]: I0316 17:00:37.545532 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/bdbf2033-4671-473e-9ede-ce2611d51fac-credential-keys\") pod \"keystone-5f9fc84dc4-7nfss\" (UID: \"bdbf2033-4671-473e-9ede-ce2611d51fac\") " pod="openstack-kuttl-tests/keystone-5f9fc84dc4-7nfss" Mar 16 17:00:37 crc kubenswrapper[5120]: I0316 17:00:37.545824 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/bdbf2033-4671-473e-9ede-ce2611d51fac-scripts\") pod \"keystone-5f9fc84dc4-7nfss\" (UID: \"bdbf2033-4671-473e-9ede-ce2611d51fac\") " pod="openstack-kuttl-tests/keystone-5f9fc84dc4-7nfss" Mar 16 17:00:37 crc kubenswrapper[5120]: I0316 17:00:37.551022 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bdbf2033-4671-473e-9ede-ce2611d51fac-config-data\") pod \"keystone-5f9fc84dc4-7nfss\" (UID: \"bdbf2033-4671-473e-9ede-ce2611d51fac\") " pod="openstack-kuttl-tests/keystone-5f9fc84dc4-7nfss" Mar 16 17:00:37 crc kubenswrapper[5120]: I0316 17:00:37.583561 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ms7pw\" (UniqueName: \"kubernetes.io/projected/bdbf2033-4671-473e-9ede-ce2611d51fac-kube-api-access-ms7pw\") pod \"keystone-5f9fc84dc4-7nfss\" (UID: \"bdbf2033-4671-473e-9ede-ce2611d51fac\") " pod="openstack-kuttl-tests/keystone-5f9fc84dc4-7nfss" Mar 16 17:00:37 crc kubenswrapper[5120]: I0316 17:00:37.600705 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-6b9b487fd6-hdw75"] Mar 16 17:00:37 crc kubenswrapper[5120]: I0316 17:00:37.619836 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801-config\") pod \"neutron-765bfffb44-jrj28\" (UID: \"ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801\") " pod="openstack-kuttl-tests/neutron-765bfffb44-jrj28" Mar 16 17:00:37 crc kubenswrapper[5120]: I0316 17:00:37.619944 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801-combined-ca-bundle\") pod \"neutron-765bfffb44-jrj28\" (UID: \"ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801\") " pod="openstack-kuttl-tests/neutron-765bfffb44-jrj28" Mar 16 17:00:37 crc kubenswrapper[5120]: I0316 17:00:37.620094 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801-httpd-config\") pod \"neutron-765bfffb44-jrj28\" (UID: \"ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801\") " pod="openstack-kuttl-tests/neutron-765bfffb44-jrj28" Mar 16 17:00:37 crc kubenswrapper[5120]: I0316 17:00:37.620133 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801-internal-tls-certs\") pod \"neutron-765bfffb44-jrj28\" (UID: \"ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801\") " pod="openstack-kuttl-tests/neutron-765bfffb44-jrj28" Mar 16 17:00:37 crc kubenswrapper[5120]: I0316 17:00:37.620362 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801-ovndb-tls-certs\") pod \"neutron-765bfffb44-jrj28\" (UID: \"ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801\") " pod="openstack-kuttl-tests/neutron-765bfffb44-jrj28" Mar 16 17:00:37 crc kubenswrapper[5120]: I0316 17:00:37.620424 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9c7q5\" (UniqueName: \"kubernetes.io/projected/ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801-kube-api-access-9c7q5\") pod \"neutron-765bfffb44-jrj28\" (UID: \"ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801\") " pod="openstack-kuttl-tests/neutron-765bfffb44-jrj28" Mar 16 17:00:37 crc kubenswrapper[5120]: I0316 17:00:37.620455 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801-public-tls-certs\") pod \"neutron-765bfffb44-jrj28\" (UID: \"ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801\") " pod="openstack-kuttl-tests/neutron-765bfffb44-jrj28" Mar 16 17:00:37 crc kubenswrapper[5120]: I0316 17:00:37.628748 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801-internal-tls-certs\") pod \"neutron-765bfffb44-jrj28\" (UID: \"ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801\") " pod="openstack-kuttl-tests/neutron-765bfffb44-jrj28" Mar 16 17:00:37 crc kubenswrapper[5120]: I0316 17:00:37.632402 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801-config\") pod \"neutron-765bfffb44-jrj28\" (UID: \"ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801\") " pod="openstack-kuttl-tests/neutron-765bfffb44-jrj28" Mar 16 17:00:37 crc kubenswrapper[5120]: I0316 17:00:37.650547 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801-ovndb-tls-certs\") pod \"neutron-765bfffb44-jrj28\" (UID: \"ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801\") " pod="openstack-kuttl-tests/neutron-765bfffb44-jrj28" Mar 16 17:00:37 crc kubenswrapper[5120]: I0316 17:00:37.651256 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801-httpd-config\") pod \"neutron-765bfffb44-jrj28\" (UID: \"ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801\") " pod="openstack-kuttl-tests/neutron-765bfffb44-jrj28" Mar 16 17:00:37 crc kubenswrapper[5120]: I0316 17:00:37.664846 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801-combined-ca-bundle\") pod \"neutron-765bfffb44-jrj28\" (UID: \"ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801\") " pod="openstack-kuttl-tests/neutron-765bfffb44-jrj28" Mar 16 17:00:37 crc kubenswrapper[5120]: I0316 17:00:37.665195 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9c7q5\" (UniqueName: \"kubernetes.io/projected/ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801-kube-api-access-9c7q5\") pod \"neutron-765bfffb44-jrj28\" (UID: \"ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801\") " pod="openstack-kuttl-tests/neutron-765bfffb44-jrj28" Mar 16 17:00:37 crc kubenswrapper[5120]: I0316 17:00:37.684454 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801-public-tls-certs\") pod \"neutron-765bfffb44-jrj28\" (UID: \"ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801\") " pod="openstack-kuttl-tests/neutron-765bfffb44-jrj28" Mar 16 17:00:37 crc kubenswrapper[5120]: E0316 17:00:37.904590 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="0c04394e8329ca282f6aec00fd61c8a448833782b4dc1a23dcf01dfbde2cad08" cmd=["/bin/bash","/var/lib/operator-scripts/mysql_probe.sh","readiness"] Mar 16 17:00:37 crc kubenswrapper[5120]: E0316 17:00:37.944436 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="0c04394e8329ca282f6aec00fd61c8a448833782b4dc1a23dcf01dfbde2cad08" cmd=["/bin/bash","/var/lib/operator-scripts/mysql_probe.sh","readiness"] Mar 16 17:00:37 crc kubenswrapper[5120]: E0316 17:00:37.950892 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="0c04394e8329ca282f6aec00fd61c8a448833782b4dc1a23dcf01dfbde2cad08" cmd=["/bin/bash","/var/lib/operator-scripts/mysql_probe.sh","readiness"] Mar 16 17:00:37 crc kubenswrapper[5120]: E0316 17:00:37.950967 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/openstack-galera-0" podUID="330c02d7-ea4c-47d3-bc2e-529f9b27b2a4" containerName="galera" probeResult="unknown" Mar 16 17:00:38 crc kubenswrapper[5120]: I0316 17:00:38.025493 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:00:38 crc kubenswrapper[5120]: I0316 17:00:38.310188 5120 generic.go:358] "Generic (PLEG): container finished" podID="1f6975fd-67a9-4ce2-87b0-7318d7345a80" containerID="0d6f935c1c526a5f0534fe1c16af647e381d75b15f387ea4fe7dccbef914de3c" exitCode=0 Mar 16 17:00:38 crc kubenswrapper[5120]: I0316 17:00:38.310218 5120 generic.go:358] "Generic (PLEG): container finished" podID="1f6975fd-67a9-4ce2-87b0-7318d7345a80" containerID="0e0c5f231603ea1e00da8c71a3719c91517ffbef85631d7b15f8ddffae3fc859" exitCode=0 Mar 16 17:00:38 crc kubenswrapper[5120]: I0316 17:00:38.310228 5120 generic.go:358] "Generic (PLEG): container finished" podID="1f6975fd-67a9-4ce2-87b0-7318d7345a80" containerID="8fcc879ae0f691fdfd5cd0fe4b16ffe3d232c975df243d8f32fa92fd036127e7" exitCode=0 Mar 16 17:00:38 crc kubenswrapper[5120]: I0316 17:00:38.310242 5120 generic.go:358] "Generic (PLEG): container finished" podID="1f6975fd-67a9-4ce2-87b0-7318d7345a80" containerID="1d2089103eb63f1bcee2dbea95910e480727a3907ba19bd2a3fd5b82c3ef8a0e" exitCode=0 Mar 16 17:00:38 crc kubenswrapper[5120]: I0316 17:00:38.310249 5120 generic.go:358] "Generic (PLEG): container finished" podID="1f6975fd-67a9-4ce2-87b0-7318d7345a80" containerID="0ec73f2c6eba913a4bcd3d808e105a68bc2427f897a4d87db565f924c91ef3ac" exitCode=0 Mar 16 17:00:38 crc kubenswrapper[5120]: I0316 17:00:38.310256 5120 generic.go:358] "Generic (PLEG): container finished" podID="1f6975fd-67a9-4ce2-87b0-7318d7345a80" containerID="556839845d225aff65b5ca07364c6f9f9b4d50587a636e047429ac5ade952de4" exitCode=0 Mar 16 17:00:38 crc kubenswrapper[5120]: I0316 17:00:38.310262 5120 generic.go:358] "Generic (PLEG): container finished" podID="1f6975fd-67a9-4ce2-87b0-7318d7345a80" containerID="2ceda8ed6affc59d31db4f2f07d3a8ebf040b3bc7d71f407b104748fbaeb5108" exitCode=0 Mar 16 17:00:38 crc kubenswrapper[5120]: I0316 17:00:38.310269 5120 generic.go:358] "Generic (PLEG): container finished" podID="1f6975fd-67a9-4ce2-87b0-7318d7345a80" containerID="2d33a82773827d3fc5dd80071dc63c0443a8e527afa994c6317d12be137c1056" exitCode=0 Mar 16 17:00:38 crc kubenswrapper[5120]: I0316 17:00:38.310275 5120 generic.go:358] "Generic (PLEG): container finished" podID="1f6975fd-67a9-4ce2-87b0-7318d7345a80" containerID="3283eed1799cc5cf220c4d4610b8ff792b9e5f3e4e9b924171c4e3139945654e" exitCode=0 Mar 16 17:00:38 crc kubenswrapper[5120]: I0316 17:00:38.310281 5120 generic.go:358] "Generic (PLEG): container finished" podID="1f6975fd-67a9-4ce2-87b0-7318d7345a80" containerID="42849e2776cea701e33065bdd6a04004ebe1c46b7b15be851b9968528ea41270" exitCode=0 Mar 16 17:00:38 crc kubenswrapper[5120]: I0316 17:00:38.310289 5120 generic.go:358] "Generic (PLEG): container finished" podID="1f6975fd-67a9-4ce2-87b0-7318d7345a80" containerID="d9ba57534506b9295f26e2c084a6001d61593b940fe5c320a291c95cbf236766" exitCode=0 Mar 16 17:00:38 crc kubenswrapper[5120]: I0316 17:00:38.310295 5120 generic.go:358] "Generic (PLEG): container finished" podID="1f6975fd-67a9-4ce2-87b0-7318d7345a80" containerID="b238bb89bbe2b3c43c7a92f158ccc80fa8bc740d10604a58081cf0dbc80ad67e" exitCode=0 Mar 16 17:00:38 crc kubenswrapper[5120]: I0316 17:00:38.310302 5120 generic.go:358] "Generic (PLEG): container finished" podID="1f6975fd-67a9-4ce2-87b0-7318d7345a80" containerID="5bbe509850c00dbbb70f25ebabb5a6428197bfd27e4e15d3720d24f733d47545" exitCode=0 Mar 16 17:00:38 crc kubenswrapper[5120]: I0316 17:00:38.310389 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"1f6975fd-67a9-4ce2-87b0-7318d7345a80","Type":"ContainerDied","Data":"0d6f935c1c526a5f0534fe1c16af647e381d75b15f387ea4fe7dccbef914de3c"} Mar 16 17:00:38 crc kubenswrapper[5120]: I0316 17:00:38.310421 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"1f6975fd-67a9-4ce2-87b0-7318d7345a80","Type":"ContainerDied","Data":"0e0c5f231603ea1e00da8c71a3719c91517ffbef85631d7b15f8ddffae3fc859"} Mar 16 17:00:38 crc kubenswrapper[5120]: I0316 17:00:38.310435 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"1f6975fd-67a9-4ce2-87b0-7318d7345a80","Type":"ContainerDied","Data":"8fcc879ae0f691fdfd5cd0fe4b16ffe3d232c975df243d8f32fa92fd036127e7"} Mar 16 17:00:38 crc kubenswrapper[5120]: I0316 17:00:38.310445 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"1f6975fd-67a9-4ce2-87b0-7318d7345a80","Type":"ContainerDied","Data":"1d2089103eb63f1bcee2dbea95910e480727a3907ba19bd2a3fd5b82c3ef8a0e"} Mar 16 17:00:38 crc kubenswrapper[5120]: I0316 17:00:38.310457 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"1f6975fd-67a9-4ce2-87b0-7318d7345a80","Type":"ContainerDied","Data":"0ec73f2c6eba913a4bcd3d808e105a68bc2427f897a4d87db565f924c91ef3ac"} Mar 16 17:00:38 crc kubenswrapper[5120]: I0316 17:00:38.310467 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"1f6975fd-67a9-4ce2-87b0-7318d7345a80","Type":"ContainerDied","Data":"556839845d225aff65b5ca07364c6f9f9b4d50587a636e047429ac5ade952de4"} Mar 16 17:00:38 crc kubenswrapper[5120]: I0316 17:00:38.310479 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"1f6975fd-67a9-4ce2-87b0-7318d7345a80","Type":"ContainerDied","Data":"2ceda8ed6affc59d31db4f2f07d3a8ebf040b3bc7d71f407b104748fbaeb5108"} Mar 16 17:00:38 crc kubenswrapper[5120]: I0316 17:00:38.310490 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"1f6975fd-67a9-4ce2-87b0-7318d7345a80","Type":"ContainerDied","Data":"2d33a82773827d3fc5dd80071dc63c0443a8e527afa994c6317d12be137c1056"} Mar 16 17:00:38 crc kubenswrapper[5120]: I0316 17:00:38.310500 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"1f6975fd-67a9-4ce2-87b0-7318d7345a80","Type":"ContainerDied","Data":"3283eed1799cc5cf220c4d4610b8ff792b9e5f3e4e9b924171c4e3139945654e"} Mar 16 17:00:38 crc kubenswrapper[5120]: I0316 17:00:38.310512 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"1f6975fd-67a9-4ce2-87b0-7318d7345a80","Type":"ContainerDied","Data":"42849e2776cea701e33065bdd6a04004ebe1c46b7b15be851b9968528ea41270"} Mar 16 17:00:38 crc kubenswrapper[5120]: I0316 17:00:38.310522 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"1f6975fd-67a9-4ce2-87b0-7318d7345a80","Type":"ContainerDied","Data":"d9ba57534506b9295f26e2c084a6001d61593b940fe5c320a291c95cbf236766"} Mar 16 17:00:38 crc kubenswrapper[5120]: I0316 17:00:38.310531 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"1f6975fd-67a9-4ce2-87b0-7318d7345a80","Type":"ContainerDied","Data":"b238bb89bbe2b3c43c7a92f158ccc80fa8bc740d10604a58081cf0dbc80ad67e"} Mar 16 17:00:38 crc kubenswrapper[5120]: I0316 17:00:38.310542 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"1f6975fd-67a9-4ce2-87b0-7318d7345a80","Type":"ContainerDied","Data":"5bbe509850c00dbbb70f25ebabb5a6428197bfd27e4e15d3720d24f733d47545"} Mar 16 17:00:38 crc kubenswrapper[5120]: I0316 17:00:38.364210 5120 generic.go:358] "Generic (PLEG): container finished" podID="55f7f374-c6b2-422b-90bd-a7dcc936e74f" containerID="3a8540189ac4b61cc8961e4e6f1bd0b50460a59e9a3da28c3f5cb5d2109ddf3f" exitCode=143 Mar 16 17:00:38 crc kubenswrapper[5120]: I0316 17:00:38.364631 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"55f7f374-c6b2-422b-90bd-a7dcc936e74f","Type":"ContainerDied","Data":"3a8540189ac4b61cc8961e4e6f1bd0b50460a59e9a3da28c3f5cb5d2109ddf3f"} Mar 16 17:00:38 crc kubenswrapper[5120]: I0316 17:00:38.459523 5120 generic.go:358] "Generic (PLEG): container finished" podID="727aa42a-e1c1-427b-9912-f64504161039" containerID="812f81a16c905368276223ee5005d10bd26af5275ab04c2e07d4bf28eecfa6cb" exitCode=0 Mar 16 17:00:38 crc kubenswrapper[5120]: I0316 17:00:38.459668 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"727aa42a-e1c1-427b-9912-f64504161039","Type":"ContainerDied","Data":"812f81a16c905368276223ee5005d10bd26af5275ab04c2e07d4bf28eecfa6cb"} Mar 16 17:00:38 crc kubenswrapper[5120]: I0316 17:00:38.467422 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podUID="07f2b57d-24dd-44a8-9399-3d3df8cd1a86" containerName="ovsdbserver-sb" containerID="cri-o://cc3dcdb1265699fdbedb2921119937ef9d8f0d38f35e3694813c0b97b57789f0" gracePeriod=299 Mar 16 17:00:38 crc kubenswrapper[5120]: I0316 17:00:38.565079 5120 generic.go:358] "Generic (PLEG): container finished" podID="e78c00c6-8a77-403d-a9f1-49d34962c3f7" containerID="5bdcd7fe3db4704f6e4591adfb538eaadb322c191c3a867ec1f159e1cecab7f2" exitCode=143 Mar 16 17:00:38 crc kubenswrapper[5120]: I0316 17:00:38.565248 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-5b7968964b-sgwq2" event={"ID":"e78c00c6-8a77-403d-a9f1-49d34962c3f7","Type":"ContainerDied","Data":"5bdcd7fe3db4704f6e4591adfb538eaadb322c191c3a867ec1f159e1cecab7f2"} Mar 16 17:00:38 crc kubenswrapper[5120]: I0316 17:00:38.576343 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_4ae0ee71-cb7b-4458-9176-1a941416c653/ovsdbserver-nb/0.log" Mar 16 17:00:38 crc kubenswrapper[5120]: I0316 17:00:38.576401 5120 generic.go:358] "Generic (PLEG): container finished" podID="4ae0ee71-cb7b-4458-9176-1a941416c653" containerID="2aaf683507989a8fa9876cc1505c80fb8c145455029fa196d10039ad20b5e5a7" exitCode=143 Mar 16 17:00:38 crc kubenswrapper[5120]: I0316 17:00:38.576591 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"4ae0ee71-cb7b-4458-9176-1a941416c653","Type":"ContainerDied","Data":"2aaf683507989a8fa9876cc1505c80fb8c145455029fa196d10039ad20b5e5a7"} Mar 16 17:00:38 crc kubenswrapper[5120]: I0316 17:00:38.576615 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"4ae0ee71-cb7b-4458-9176-1a941416c653","Type":"ContainerDied","Data":"222ff7565ff2ea851a55d8addae5c28034ed18c8500a809c938a61566ef88ace"} Mar 16 17:00:38 crc kubenswrapper[5120]: I0316 17:00:38.576625 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="222ff7565ff2ea851a55d8addae5c28034ed18c8500a809c938a61566ef88ace" Mar 16 17:00:38 crc kubenswrapper[5120]: I0316 17:00:38.609118 5120 generic.go:358] "Generic (PLEG): container finished" podID="07f2b57d-24dd-44a8-9399-3d3df8cd1a86" containerID="82559c94402956204e6c0ed603726a5ace776e97196e0de5c9afcf91e3a1161b" exitCode=2 Mar 16 17:00:38 crc kubenswrapper[5120]: I0316 17:00:38.609282 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"07f2b57d-24dd-44a8-9399-3d3df8cd1a86","Type":"ContainerDied","Data":"82559c94402956204e6c0ed603726a5ace776e97196e0de5c9afcf91e3a1161b"} Mar 16 17:00:38 crc kubenswrapper[5120]: I0316 17:00:38.645632 5120 generic.go:358] "Generic (PLEG): container finished" podID="9c429916-2d70-42f0-a572-90ab8aafafbe" containerID="8c3e9f0e4cad0fda0af2b317f990769cd6b26ce52d37356ab5cfcec66dfb8757" exitCode=143 Mar 16 17:00:38 crc kubenswrapper[5120]: I0316 17:00:38.646138 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-5b9b97df74-9rl5z" event={"ID":"9c429916-2d70-42f0-a572-90ab8aafafbe","Type":"ContainerDied","Data":"8c3e9f0e4cad0fda0af2b317f990769cd6b26ce52d37356ab5cfcec66dfb8757"} Mar 16 17:00:38 crc kubenswrapper[5120]: I0316 17:00:38.779919 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/openstack-cell1-galera-0" podUID="39da7446-acba-4bbb-b813-1a3e2c89ebcd" containerName="galera" containerID="cri-o://9f10ab7f240e18dc5d0dc1c428ee6fb6885c1a2a7b2d3b49049debfc1e5289c0" gracePeriod=29 Mar 16 17:00:38 crc kubenswrapper[5120]: I0316 17:00:38.800234 5120 generic.go:358] "Generic (PLEG): container finished" podID="5e3627d3-225e-4cd9-b5fb-9a27c888e1e1" containerID="6706e0144fa060f50b0e39d25b8522795d2fe95416f82712ad1b24882f9fff1a" exitCode=0 Mar 16 17:00:38 crc kubenswrapper[5120]: I0316 17:00:38.800493 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"5e3627d3-225e-4cd9-b5fb-9a27c888e1e1","Type":"ContainerDied","Data":"6706e0144fa060f50b0e39d25b8522795d2fe95416f82712ad1b24882f9fff1a"} Mar 16 17:00:38 crc kubenswrapper[5120]: I0316 17:00:38.800532 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"5e3627d3-225e-4cd9-b5fb-9a27c888e1e1","Type":"ContainerDied","Data":"a47757cfe1af456415267ec12f56235a1268ca8872a59bd8521881d1fa130202"} Mar 16 17:00:38 crc kubenswrapper[5120]: I0316 17:00:38.800546 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a47757cfe1af456415267ec12f56235a1268ca8872a59bd8521881d1fa130202" Mar 16 17:00:38 crc kubenswrapper[5120]: I0316 17:00:38.894265 5120 generic.go:358] "Generic (PLEG): container finished" podID="e3143a49-62b5-408a-8dca-d723f7a31619" containerID="f8c1c5109f6bdbd96450c7a23d67c1a63f13b173010194ecf69b1864ecf069cd" exitCode=0 Mar 16 17:00:38 crc kubenswrapper[5120]: I0316 17:00:38.894439 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-6f846b8bfd-w69px" event={"ID":"e3143a49-62b5-408a-8dca-d723f7a31619","Type":"ContainerDied","Data":"f8c1c5109f6bdbd96450c7a23d67c1a63f13b173010194ecf69b1864ecf069cd"} Mar 16 17:00:38 crc kubenswrapper[5120]: E0316 17:00:38.956448 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="b42f7912bd0af5cc7eea7bbb672d44c2af34ef4c9686f59f00ea55d40951315a" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 17:00:38 crc kubenswrapper[5120]: E0316 17:00:38.965018 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="b42f7912bd0af5cc7eea7bbb672d44c2af34ef4c9686f59f00ea55d40951315a" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 17:00:38 crc kubenswrapper[5120]: E0316 17:00:38.971033 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="b42f7912bd0af5cc7eea7bbb672d44c2af34ef4c9686f59f00ea55d40951315a" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 17:00:38 crc kubenswrapper[5120]: E0316 17:00:38.971116 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="7712130b-a000-4541-a1b1-7442adb622f7" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 17:00:39 crc kubenswrapper[5120]: E0316 17:00:39.309296 5120 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode8abcb6e_3312_4c62_8931_b9ad85725e5b.slice/crio-a1d23aa6e5afd485101028f0d3443a4dce5fef13ef6cd029e16a3912f04ce04d.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6fdf4b26_c833_4319_954a_7ebaaedb71e5.slice/crio-3655ac4348732f181824d8b56c72c7de7b64844e0300e8e4f1f18a838415654b.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6fdf4b26_c833_4319_954a_7ebaaedb71e5.slice/crio-conmon-3655ac4348732f181824d8b56c72c7de7b64844e0300e8e4f1f18a838415654b.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1f6975fd_67a9_4ce2_87b0_7318d7345a80.slice/crio-conmon-d9ba57534506b9295f26e2c084a6001d61593b940fe5c320a291c95cbf236766.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1f6975fd_67a9_4ce2_87b0_7318d7345a80.slice/crio-5bbe509850c00dbbb70f25ebabb5a6428197bfd27e4e15d3720d24f733d47545.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod07f2b57d_24dd_44a8_9399_3d3df8cd1a86.slice/crio-cc3dcdb1265699fdbedb2921119937ef9d8f0d38f35e3694813c0b97b57789f0.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod330c02d7_ea4c_47d3_bc2e_529f9b27b2a4.slice/crio-conmon-0c04394e8329ca282f6aec00fd61c8a448833782b4dc1a23dcf01dfbde2cad08.scope\": RecentStats: unable to find data in memory cache]" Mar 16 17:00:39 crc kubenswrapper[5120]: E0316 17:00:39.578868 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 2aaf683507989a8fa9876cc1505c80fb8c145455029fa196d10039ad20b5e5a7 is running failed: container process not found" containerID="2aaf683507989a8fa9876cc1505c80fb8c145455029fa196d10039ad20b5e5a7" cmd=["/usr/bin/pidof","ovsdb-server"] Mar 16 17:00:39 crc kubenswrapper[5120]: E0316 17:00:39.588176 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 2aaf683507989a8fa9876cc1505c80fb8c145455029fa196d10039ad20b5e5a7 is running failed: container process not found" containerID="2aaf683507989a8fa9876cc1505c80fb8c145455029fa196d10039ad20b5e5a7" cmd=["/usr/bin/pidof","ovsdb-server"] Mar 16 17:00:39 crc kubenswrapper[5120]: E0316 17:00:39.596915 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 2aaf683507989a8fa9876cc1505c80fb8c145455029fa196d10039ad20b5e5a7 is running failed: container process not found" containerID="2aaf683507989a8fa9876cc1505c80fb8c145455029fa196d10039ad20b5e5a7" cmd=["/usr/bin/pidof","ovsdb-server"] Mar 16 17:00:39 crc kubenswrapper[5120]: E0316 17:00:39.596991 5120 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 2aaf683507989a8fa9876cc1505c80fb8c145455029fa196d10039ad20b5e5a7 is running failed: container process not found" probeType="Readiness" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podUID="4ae0ee71-cb7b-4458-9176-1a941416c653" containerName="ovsdbserver-nb" probeResult="unknown" Mar 16 17:00:39 crc kubenswrapper[5120]: I0316 17:00:39.649255 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-6f96bb5df9-spfxv"] Mar 16 17:00:39 crc kubenswrapper[5120]: I0316 17:00:39.858585 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-57589895fd-84tvt" Mar 16 17:00:39 crc kubenswrapper[5120]: I0316 17:00:39.906174 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-8579c6748-8wfdq" Mar 16 17:00:39 crc kubenswrapper[5120]: I0316 17:00:39.919387 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-5f9fc84dc4-7nfss" Mar 16 17:00:39 crc kubenswrapper[5120]: I0316 17:00:39.940563 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-765bfffb44-jrj28" Mar 16 17:00:39 crc kubenswrapper[5120]: I0316 17:00:39.949469 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:00:39 crc kubenswrapper[5120]: I0316 17:00:39.951778 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_07f2b57d-24dd-44a8-9399-3d3df8cd1a86/ovsdbserver-sb/0.log" Mar 16 17:00:39 crc kubenswrapper[5120]: I0316 17:00:39.951948 5120 generic.go:358] "Generic (PLEG): container finished" podID="07f2b57d-24dd-44a8-9399-3d3df8cd1a86" containerID="cc3dcdb1265699fdbedb2921119937ef9d8f0d38f35e3694813c0b97b57789f0" exitCode=143 Mar 16 17:00:39 crc kubenswrapper[5120]: I0316 17:00:39.952298 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"07f2b57d-24dd-44a8-9399-3d3df8cd1a86","Type":"ContainerDied","Data":"cc3dcdb1265699fdbedb2921119937ef9d8f0d38f35e3694813c0b97b57789f0"} Mar 16 17:00:39 crc kubenswrapper[5120]: I0316 17:00:39.952387 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"07f2b57d-24dd-44a8-9399-3d3df8cd1a86","Type":"ContainerDied","Data":"9e5e0f0ffd00a38902db29705075b61f5bb6e6ef7d1b86376f1a8bf2a7201b46"} Mar 16 17:00:39 crc kubenswrapper[5120]: I0316 17:00:39.952474 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9e5e0f0ffd00a38902db29705075b61f5bb6e6ef7d1b86376f1a8bf2a7201b46" Mar 16 17:00:39 crc kubenswrapper[5120]: I0316 17:00:39.958525 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_4ae0ee71-cb7b-4458-9176-1a941416c653/ovsdbserver-nb/0.log" Mar 16 17:00:39 crc kubenswrapper[5120]: I0316 17:00:39.958717 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:00:39 crc kubenswrapper[5120]: I0316 17:00:39.964900 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-6b9b487fd6-hdw75" event={"ID":"20dac7f8-f03f-40f8-93f1-5ba59f5471b8","Type":"ContainerStarted","Data":"7436e41de3cb3eac0e6285a92be1d8f34cd78b933021e54cbe68b6462712154b"} Mar 16 17:00:39 crc kubenswrapper[5120]: I0316 17:00:39.972993 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-6f96bb5df9-spfxv" event={"ID":"fb7a2068-5a18-4c7b-92d0-364f371d59df","Type":"ContainerStarted","Data":"bb4f2020b4cf1c075336e44a312cfee2c0c3a80e3fc6ec031e9744eca9de1bbb"} Mar 16 17:00:39 crc kubenswrapper[5120]: I0316 17:00:39.974543 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5e3627d3-225e-4cd9-b5fb-9a27c888e1e1-logs\") pod \"5e3627d3-225e-4cd9-b5fb-9a27c888e1e1\" (UID: \"5e3627d3-225e-4cd9-b5fb-9a27c888e1e1\") " Mar 16 17:00:39 crc kubenswrapper[5120]: I0316 17:00:39.974631 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jlzf4\" (UniqueName: \"kubernetes.io/projected/5e3627d3-225e-4cd9-b5fb-9a27c888e1e1-kube-api-access-jlzf4\") pod \"5e3627d3-225e-4cd9-b5fb-9a27c888e1e1\" (UID: \"5e3627d3-225e-4cd9-b5fb-9a27c888e1e1\") " Mar 16 17:00:39 crc kubenswrapper[5120]: I0316 17:00:39.976399 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e3627d3-225e-4cd9-b5fb-9a27c888e1e1-logs" (OuterVolumeSpecName: "logs") pod "5e3627d3-225e-4cd9-b5fb-9a27c888e1e1" (UID: "5e3627d3-225e-4cd9-b5fb-9a27c888e1e1"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:00:39 crc kubenswrapper[5120]: I0316 17:00:39.976817 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5e3627d3-225e-4cd9-b5fb-9a27c888e1e1-combined-ca-bundle\") pod \"5e3627d3-225e-4cd9-b5fb-9a27c888e1e1\" (UID: \"5e3627d3-225e-4cd9-b5fb-9a27c888e1e1\") " Mar 16 17:00:39 crc kubenswrapper[5120]: I0316 17:00:39.978509 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5e3627d3-225e-4cd9-b5fb-9a27c888e1e1-config-data\") pod \"5e3627d3-225e-4cd9-b5fb-9a27c888e1e1\" (UID: \"5e3627d3-225e-4cd9-b5fb-9a27c888e1e1\") " Mar 16 17:00:39 crc kubenswrapper[5120]: I0316 17:00:39.978549 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/5e3627d3-225e-4cd9-b5fb-9a27c888e1e1-public-tls-certs\") pod \"5e3627d3-225e-4cd9-b5fb-9a27c888e1e1\" (UID: \"5e3627d3-225e-4cd9-b5fb-9a27c888e1e1\") " Mar 16 17:00:39 crc kubenswrapper[5120]: I0316 17:00:39.978607 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/5e3627d3-225e-4cd9-b5fb-9a27c888e1e1-internal-tls-certs\") pod \"5e3627d3-225e-4cd9-b5fb-9a27c888e1e1\" (UID: \"5e3627d3-225e-4cd9-b5fb-9a27c888e1e1\") " Mar 16 17:00:39 crc kubenswrapper[5120]: I0316 17:00:39.981676 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5e3627d3-225e-4cd9-b5fb-9a27c888e1e1-logs\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.001517 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e3627d3-225e-4cd9-b5fb-9a27c888e1e1-kube-api-access-jlzf4" (OuterVolumeSpecName: "kube-api-access-jlzf4") pod "5e3627d3-225e-4cd9-b5fb-9a27c888e1e1" (UID: "5e3627d3-225e-4cd9-b5fb-9a27c888e1e1"). InnerVolumeSpecName "kube-api-access-jlzf4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.002549 5120 generic.go:358] "Generic (PLEG): container finished" podID="330c02d7-ea4c-47d3-bc2e-529f9b27b2a4" containerID="0c04394e8329ca282f6aec00fd61c8a448833782b4dc1a23dcf01dfbde2cad08" exitCode=0 Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.002644 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"330c02d7-ea4c-47d3-bc2e-529f9b27b2a4","Type":"ContainerDied","Data":"0c04394e8329ca282f6aec00fd61c8a448833782b4dc1a23dcf01dfbde2cad08"} Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.002670 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"330c02d7-ea4c-47d3-bc2e-529f9b27b2a4","Type":"ContainerDied","Data":"638eec3ef2de84b930bb4c71211946c7a9bb944ee959679817e9208f938e41f5"} Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.002681 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="638eec3ef2de84b930bb4c71211946c7a9bb944ee959679817e9208f938e41f5" Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.007095 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.061093 5120 generic.go:358] "Generic (PLEG): container finished" podID="e8abcb6e-3312-4c62-8931-b9ad85725e5b" containerID="a1d23aa6e5afd485101028f0d3443a4dce5fef13ef6cd029e16a3912f04ce04d" exitCode=0 Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.061246 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"e8abcb6e-3312-4c62-8931-b9ad85725e5b","Type":"ContainerDied","Data":"a1d23aa6e5afd485101028f0d3443a4dce5fef13ef6cd029e16a3912f04ce04d"} Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.061277 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"e8abcb6e-3312-4c62-8931-b9ad85725e5b","Type":"ContainerDied","Data":"4c59faf2c76d18cd4b8b9f33f5b7d6ccc0e69be3fe75e13a713621ae4725c72a"} Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.061289 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4c59faf2c76d18cd4b8b9f33f5b7d6ccc0e69be3fe75e13a713621ae4725c72a" Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.064503 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.083211 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/727aa42a-e1c1-427b-9912-f64504161039-kolla-config\") pod \"727aa42a-e1c1-427b-9912-f64504161039\" (UID: \"727aa42a-e1c1-427b-9912-f64504161039\") " Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.083327 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dzxhj\" (UniqueName: \"kubernetes.io/projected/4ae0ee71-cb7b-4458-9176-1a941416c653-kube-api-access-dzxhj\") pod \"4ae0ee71-cb7b-4458-9176-1a941416c653\" (UID: \"4ae0ee71-cb7b-4458-9176-1a941416c653\") " Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.083495 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/4ae0ee71-cb7b-4458-9176-1a941416c653-metrics-certs-tls-certs\") pod \"4ae0ee71-cb7b-4458-9176-1a941416c653\" (UID: \"4ae0ee71-cb7b-4458-9176-1a941416c653\") " Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.083638 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4ae0ee71-cb7b-4458-9176-1a941416c653-combined-ca-bundle\") pod \"4ae0ee71-cb7b-4458-9176-1a941416c653\" (UID: \"4ae0ee71-cb7b-4458-9176-1a941416c653\") " Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.083687 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovndbcluster-nb-etc-ovn\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"4ae0ee71-cb7b-4458-9176-1a941416c653\" (UID: \"4ae0ee71-cb7b-4458-9176-1a941416c653\") " Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.083711 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9cccn\" (UniqueName: \"kubernetes.io/projected/727aa42a-e1c1-427b-9912-f64504161039-kube-api-access-9cccn\") pod \"727aa42a-e1c1-427b-9912-f64504161039\" (UID: \"727aa42a-e1c1-427b-9912-f64504161039\") " Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.083809 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/4ae0ee71-cb7b-4458-9176-1a941416c653-ovsdbserver-nb-tls-certs\") pod \"4ae0ee71-cb7b-4458-9176-1a941416c653\" (UID: \"4ae0ee71-cb7b-4458-9176-1a941416c653\") " Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.083875 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/727aa42a-e1c1-427b-9912-f64504161039-config-data\") pod \"727aa42a-e1c1-427b-9912-f64504161039\" (UID: \"727aa42a-e1c1-427b-9912-f64504161039\") " Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.083933 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/727aa42a-e1c1-427b-9912-f64504161039-combined-ca-bundle\") pod \"727aa42a-e1c1-427b-9912-f64504161039\" (UID: \"727aa42a-e1c1-427b-9912-f64504161039\") " Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.083990 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/4ae0ee71-cb7b-4458-9176-1a941416c653-scripts\") pod \"4ae0ee71-cb7b-4458-9176-1a941416c653\" (UID: \"4ae0ee71-cb7b-4458-9176-1a941416c653\") " Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.084038 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/4ae0ee71-cb7b-4458-9176-1a941416c653-ovsdb-rundir\") pod \"4ae0ee71-cb7b-4458-9176-1a941416c653\" (UID: \"4ae0ee71-cb7b-4458-9176-1a941416c653\") " Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.084146 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4ae0ee71-cb7b-4458-9176-1a941416c653-config\") pod \"4ae0ee71-cb7b-4458-9176-1a941416c653\" (UID: \"4ae0ee71-cb7b-4458-9176-1a941416c653\") " Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.084307 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/727aa42a-e1c1-427b-9912-f64504161039-memcached-tls-certs\") pod \"727aa42a-e1c1-427b-9912-f64504161039\" (UID: \"727aa42a-e1c1-427b-9912-f64504161039\") " Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.085213 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jlzf4\" (UniqueName: \"kubernetes.io/projected/5e3627d3-225e-4cd9-b5fb-9a27c888e1e1-kube-api-access-jlzf4\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.102347 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/727aa42a-e1c1-427b-9912-f64504161039-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "727aa42a-e1c1-427b-9912-f64504161039" (UID: "727aa42a-e1c1-427b-9912-f64504161039"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.114646 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ae0ee71-cb7b-4458-9176-1a941416c653-scripts" (OuterVolumeSpecName: "scripts") pod "4ae0ee71-cb7b-4458-9176-1a941416c653" (UID: "4ae0ee71-cb7b-4458-9176-1a941416c653"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.114910 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/727aa42a-e1c1-427b-9912-f64504161039-config-data" (OuterVolumeSpecName: "config-data") pod "727aa42a-e1c1-427b-9912-f64504161039" (UID: "727aa42a-e1c1-427b-9912-f64504161039"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.116217 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ae0ee71-cb7b-4458-9176-1a941416c653-ovsdb-rundir" (OuterVolumeSpecName: "ovsdb-rundir") pod "4ae0ee71-cb7b-4458-9176-1a941416c653" (UID: "4ae0ee71-cb7b-4458-9176-1a941416c653"). InnerVolumeSpecName "ovsdb-rundir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.116624 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ae0ee71-cb7b-4458-9176-1a941416c653-config" (OuterVolumeSpecName: "config") pod "4ae0ee71-cb7b-4458-9176-1a941416c653" (UID: "4ae0ee71-cb7b-4458-9176-1a941416c653"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.126942 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_07f2b57d-24dd-44a8-9399-3d3df8cd1a86/ovsdbserver-sb/0.log" Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.127228 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.128009 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.188620 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage08-crc" (OuterVolumeSpecName: "ovndbcluster-nb-etc-ovn") pod "4ae0ee71-cb7b-4458-9176-1a941416c653" (UID: "4ae0ee71-cb7b-4458-9176-1a941416c653"). InnerVolumeSpecName "local-storage08-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.189089 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ae0ee71-cb7b-4458-9176-1a941416c653-kube-api-access-dzxhj" (OuterVolumeSpecName: "kube-api-access-dzxhj") pod "4ae0ee71-cb7b-4458-9176-1a941416c653" (UID: "4ae0ee71-cb7b-4458-9176-1a941416c653"). InnerVolumeSpecName "kube-api-access-dzxhj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.189201 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/727aa42a-e1c1-427b-9912-f64504161039-kube-api-access-9cccn" (OuterVolumeSpecName: "kube-api-access-9cccn") pod "727aa42a-e1c1-427b-9912-f64504161039" (UID: "727aa42a-e1c1-427b-9912-f64504161039"). InnerVolumeSpecName "kube-api-access-9cccn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.193226 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xpzrs\" (UniqueName: \"kubernetes.io/projected/6fdf4b26-c833-4319-954a-7ebaaedb71e5-kube-api-access-xpzrs\") pod \"6fdf4b26-c833-4319-954a-7ebaaedb71e5\" (UID: \"6fdf4b26-c833-4319-954a-7ebaaedb71e5\") " Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.193469 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/07f2b57d-24dd-44a8-9399-3d3df8cd1a86-ovsdbserver-sb-tls-certs\") pod \"07f2b57d-24dd-44a8-9399-3d3df8cd1a86\" (UID: \"07f2b57d-24dd-44a8-9399-3d3df8cd1a86\") " Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.193577 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6fdf4b26-c833-4319-954a-7ebaaedb71e5-config-data\") pod \"6fdf4b26-c833-4319-954a-7ebaaedb71e5\" (UID: \"6fdf4b26-c833-4319-954a-7ebaaedb71e5\") " Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.193735 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovndbcluster-sb-etc-ovn\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"07f2b57d-24dd-44a8-9399-3d3df8cd1a86\" (UID: \"07f2b57d-24dd-44a8-9399-3d3df8cd1a86\") " Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.194071 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/330c02d7-ea4c-47d3-bc2e-529f9b27b2a4-galera-tls-certs\") pod \"330c02d7-ea4c-47d3-bc2e-529f9b27b2a4\" (UID: \"330c02d7-ea4c-47d3-bc2e-529f9b27b2a4\") " Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.194410 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b4phr\" (UniqueName: \"kubernetes.io/projected/07f2b57d-24dd-44a8-9399-3d3df8cd1a86-kube-api-access-b4phr\") pod \"07f2b57d-24dd-44a8-9399-3d3df8cd1a86\" (UID: \"07f2b57d-24dd-44a8-9399-3d3df8cd1a86\") " Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.194546 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/07f2b57d-24dd-44a8-9399-3d3df8cd1a86-scripts\") pod \"07f2b57d-24dd-44a8-9399-3d3df8cd1a86\" (UID: \"07f2b57d-24dd-44a8-9399-3d3df8cd1a86\") " Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.194740 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/330c02d7-ea4c-47d3-bc2e-529f9b27b2a4-kolla-config\") pod \"330c02d7-ea4c-47d3-bc2e-529f9b27b2a4\" (UID: \"330c02d7-ea4c-47d3-bc2e-529f9b27b2a4\") " Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.195355 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/6fdf4b26-c833-4319-954a-7ebaaedb71e5-vencrypt-tls-certs\") pod \"6fdf4b26-c833-4319-954a-7ebaaedb71e5\" (UID: \"6fdf4b26-c833-4319-954a-7ebaaedb71e5\") " Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.195903 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ck5r4\" (UniqueName: \"kubernetes.io/projected/330c02d7-ea4c-47d3-bc2e-529f9b27b2a4-kube-api-access-ck5r4\") pod \"330c02d7-ea4c-47d3-bc2e-529f9b27b2a4\" (UID: \"330c02d7-ea4c-47d3-bc2e-529f9b27b2a4\") " Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.196266 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/07f2b57d-24dd-44a8-9399-3d3df8cd1a86-combined-ca-bundle\") pod \"07f2b57d-24dd-44a8-9399-3d3df8cd1a86\" (UID: \"07f2b57d-24dd-44a8-9399-3d3df8cd1a86\") " Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.196403 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/330c02d7-ea4c-47d3-bc2e-529f9b27b2a4-combined-ca-bundle\") pod \"330c02d7-ea4c-47d3-bc2e-529f9b27b2a4\" (UID: \"330c02d7-ea4c-47d3-bc2e-529f9b27b2a4\") " Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.196524 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/330c02d7-ea4c-47d3-bc2e-529f9b27b2a4-config-data-generated\") pod \"330c02d7-ea4c-47d3-bc2e-529f9b27b2a4\" (UID: \"330c02d7-ea4c-47d3-bc2e-529f9b27b2a4\") " Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.196670 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/330c02d7-ea4c-47d3-bc2e-529f9b27b2a4-operator-scripts\") pod \"330c02d7-ea4c-47d3-bc2e-529f9b27b2a4\" (UID: \"330c02d7-ea4c-47d3-bc2e-529f9b27b2a4\") " Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.197009 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"mysql-db\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"330c02d7-ea4c-47d3-bc2e-529f9b27b2a4\" (UID: \"330c02d7-ea4c-47d3-bc2e-529f9b27b2a4\") " Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.197244 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/07f2b57d-24dd-44a8-9399-3d3df8cd1a86-ovsdb-rundir\") pod \"07f2b57d-24dd-44a8-9399-3d3df8cd1a86\" (UID: \"07f2b57d-24dd-44a8-9399-3d3df8cd1a86\") " Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.197494 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/6fdf4b26-c833-4319-954a-7ebaaedb71e5-nova-novncproxy-tls-certs\") pod \"6fdf4b26-c833-4319-954a-7ebaaedb71e5\" (UID: \"6fdf4b26-c833-4319-954a-7ebaaedb71e5\") " Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.197743 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/07f2b57d-24dd-44a8-9399-3d3df8cd1a86-metrics-certs-tls-certs\") pod \"07f2b57d-24dd-44a8-9399-3d3df8cd1a86\" (UID: \"07f2b57d-24dd-44a8-9399-3d3df8cd1a86\") " Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.198106 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/330c02d7-ea4c-47d3-bc2e-529f9b27b2a4-config-data-default\") pod \"330c02d7-ea4c-47d3-bc2e-529f9b27b2a4\" (UID: \"330c02d7-ea4c-47d3-bc2e-529f9b27b2a4\") " Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.198229 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/07f2b57d-24dd-44a8-9399-3d3df8cd1a86-config\") pod \"07f2b57d-24dd-44a8-9399-3d3df8cd1a86\" (UID: \"07f2b57d-24dd-44a8-9399-3d3df8cd1a86\") " Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.198547 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6fdf4b26-c833-4319-954a-7ebaaedb71e5-combined-ca-bundle\") pod \"6fdf4b26-c833-4319-954a-7ebaaedb71e5\" (UID: \"6fdf4b26-c833-4319-954a-7ebaaedb71e5\") " Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.200053 5120 reconciler_common.go:299] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/727aa42a-e1c1-427b-9912-f64504161039-kolla-config\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.200180 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dzxhj\" (UniqueName: \"kubernetes.io/projected/4ae0ee71-cb7b-4458-9176-1a941416c653-kube-api-access-dzxhj\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.200279 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") on node \"crc\" " Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.200362 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9cccn\" (UniqueName: \"kubernetes.io/projected/727aa42a-e1c1-427b-9912-f64504161039-kube-api-access-9cccn\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.200488 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/727aa42a-e1c1-427b-9912-f64504161039-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.200631 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/4ae0ee71-cb7b-4458-9176-1a941416c653-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.200747 5120 reconciler_common.go:299] "Volume detached for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/4ae0ee71-cb7b-4458-9176-1a941416c653-ovsdb-rundir\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.200902 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4ae0ee71-cb7b-4458-9176-1a941416c653-config\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.195196 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/07f2b57d-24dd-44a8-9399-3d3df8cd1a86-scripts" (OuterVolumeSpecName: "scripts") pod "07f2b57d-24dd-44a8-9399-3d3df8cd1a86" (UID: "07f2b57d-24dd-44a8-9399-3d3df8cd1a86"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.195210 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e3627d3-225e-4cd9-b5fb-9a27c888e1e1-config-data" (OuterVolumeSpecName: "config-data") pod "5e3627d3-225e-4cd9-b5fb-9a27c888e1e1" (UID: "5e3627d3-225e-4cd9-b5fb-9a27c888e1e1"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.195290 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/330c02d7-ea4c-47d3-bc2e-529f9b27b2a4-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "330c02d7-ea4c-47d3-bc2e-529f9b27b2a4" (UID: "330c02d7-ea4c-47d3-bc2e-529f9b27b2a4"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.197743 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/330c02d7-ea4c-47d3-bc2e-529f9b27b2a4-config-data-generated" (OuterVolumeSpecName: "config-data-generated") pod "330c02d7-ea4c-47d3-bc2e-529f9b27b2a4" (UID: "330c02d7-ea4c-47d3-bc2e-529f9b27b2a4"). InnerVolumeSpecName "config-data-generated". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.223307 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6fdf4b26-c833-4319-954a-7ebaaedb71e5-kube-api-access-xpzrs" (OuterVolumeSpecName: "kube-api-access-xpzrs") pod "6fdf4b26-c833-4319-954a-7ebaaedb71e5" (UID: "6fdf4b26-c833-4319-954a-7ebaaedb71e5"). InnerVolumeSpecName "kube-api-access-xpzrs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.238190 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07f2b57d-24dd-44a8-9399-3d3df8cd1a86-ovsdb-rundir" (OuterVolumeSpecName: "ovsdb-rundir") pod "07f2b57d-24dd-44a8-9399-3d3df8cd1a86" (UID: "07f2b57d-24dd-44a8-9399-3d3df8cd1a86"). InnerVolumeSpecName "ovsdb-rundir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.239196 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.239730 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/330c02d7-ea4c-47d3-bc2e-529f9b27b2a4-config-data-default" (OuterVolumeSpecName: "config-data-default") pod "330c02d7-ea4c-47d3-bc2e-529f9b27b2a4" (UID: "330c02d7-ea4c-47d3-bc2e-529f9b27b2a4"). InnerVolumeSpecName "config-data-default". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.243955 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/07f2b57d-24dd-44a8-9399-3d3df8cd1a86-config" (OuterVolumeSpecName: "config") pod "07f2b57d-24dd-44a8-9399-3d3df8cd1a86" (UID: "07f2b57d-24dd-44a8-9399-3d3df8cd1a86"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.246273 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/330c02d7-ea4c-47d3-bc2e-529f9b27b2a4-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "330c02d7-ea4c-47d3-bc2e-529f9b27b2a4" (UID: "330c02d7-ea4c-47d3-bc2e-529f9b27b2a4"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.248578 5120 generic.go:358] "Generic (PLEG): container finished" podID="1f6975fd-67a9-4ce2-87b0-7318d7345a80" containerID="ea0a58d085e77e9f2e80fb3abe6830d44085c6de8bbc41d01e3ce40efd201333" exitCode=0 Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.249300 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"1f6975fd-67a9-4ce2-87b0-7318d7345a80","Type":"ContainerDied","Data":"ea0a58d085e77e9f2e80fb3abe6830d44085c6de8bbc41d01e3ce40efd201333"} Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.250243 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage01-crc" (OuterVolumeSpecName: "ovndbcluster-sb-etc-ovn") pod "07f2b57d-24dd-44a8-9399-3d3df8cd1a86" (UID: "07f2b57d-24dd-44a8-9399-3d3df8cd1a86"). InnerVolumeSpecName "local-storage01-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.260874 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07f2b57d-24dd-44a8-9399-3d3df8cd1a86-kube-api-access-b4phr" (OuterVolumeSpecName: "kube-api-access-b4phr") pod "07f2b57d-24dd-44a8-9399-3d3df8cd1a86" (UID: "07f2b57d-24dd-44a8-9399-3d3df8cd1a86"). InnerVolumeSpecName "kube-api-access-b4phr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.271695 5120 generic.go:358] "Generic (PLEG): container finished" podID="d82f3b2b-c672-46ff-8fc8-afc5b33e8252" containerID="498a641ae78ee7e529f010dee7dcbf81ff0ff8d58d98aecf53ad28696be667d1" exitCode=0 Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.271722 5120 generic.go:358] "Generic (PLEG): container finished" podID="d82f3b2b-c672-46ff-8fc8-afc5b33e8252" containerID="28657cd9914973413b6f6e9aeaea403f0c4337248a7147ff00ed46ba9a535468" exitCode=0 Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.276411 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"d82f3b2b-c672-46ff-8fc8-afc5b33e8252","Type":"ContainerDied","Data":"498a641ae78ee7e529f010dee7dcbf81ff0ff8d58d98aecf53ad28696be667d1"} Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.276456 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"d82f3b2b-c672-46ff-8fc8-afc5b33e8252","Type":"ContainerDied","Data":"28657cd9914973413b6f6e9aeaea403f0c4337248a7147ff00ed46ba9a535468"} Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.276478 5120 scope.go:117] "RemoveContainer" containerID="7feb79b771d86b2c75df62e3a6f170b8f26b31b6c9b737ba8b03de06cf953429" Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.284291 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/330c02d7-ea4c-47d3-bc2e-529f9b27b2a4-kube-api-access-ck5r4" (OuterVolumeSpecName: "kube-api-access-ck5r4") pod "330c02d7-ea4c-47d3-bc2e-529f9b27b2a4" (UID: "330c02d7-ea4c-47d3-bc2e-529f9b27b2a4"). InnerVolumeSpecName "kube-api-access-ck5r4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.290513 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e3627d3-225e-4cd9-b5fb-9a27c888e1e1-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "5e3627d3-225e-4cd9-b5fb-9a27c888e1e1" (UID: "5e3627d3-225e-4cd9-b5fb-9a27c888e1e1"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.300399 5120 generic.go:358] "Generic (PLEG): container finished" podID="39da7446-acba-4bbb-b813-1a3e2c89ebcd" containerID="9f10ab7f240e18dc5d0dc1c428ee6fb6885c1a2a7b2d3b49049debfc1e5289c0" exitCode=0 Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.300530 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"39da7446-acba-4bbb-b813-1a3e2c89ebcd","Type":"ContainerDied","Data":"9f10ab7f240e18dc5d0dc1c428ee6fb6885c1a2a7b2d3b49049debfc1e5289c0"} Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.301746 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bcx7r\" (UniqueName: \"kubernetes.io/projected/e8abcb6e-3312-4c62-8931-b9ad85725e5b-kube-api-access-bcx7r\") pod \"e8abcb6e-3312-4c62-8931-b9ad85725e5b\" (UID: \"e8abcb6e-3312-4c62-8931-b9ad85725e5b\") " Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.302204 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e8abcb6e-3312-4c62-8931-b9ad85725e5b-config-data\") pod \"e8abcb6e-3312-4c62-8931-b9ad85725e5b\" (UID: \"e8abcb6e-3312-4c62-8931-b9ad85725e5b\") " Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.302384 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e8abcb6e-3312-4c62-8931-b9ad85725e5b-combined-ca-bundle\") pod \"e8abcb6e-3312-4c62-8931-b9ad85725e5b\" (UID: \"e8abcb6e-3312-4c62-8931-b9ad85725e5b\") " Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.304234 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b4phr\" (UniqueName: \"kubernetes.io/projected/07f2b57d-24dd-44a8-9399-3d3df8cd1a86-kube-api-access-b4phr\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.304266 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/07f2b57d-24dd-44a8-9399-3d3df8cd1a86-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.304280 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5e3627d3-225e-4cd9-b5fb-9a27c888e1e1-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.304324 5120 reconciler_common.go:299] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/330c02d7-ea4c-47d3-bc2e-529f9b27b2a4-kolla-config\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.304339 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ck5r4\" (UniqueName: \"kubernetes.io/projected/330c02d7-ea4c-47d3-bc2e-529f9b27b2a4-kube-api-access-ck5r4\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.304351 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/330c02d7-ea4c-47d3-bc2e-529f9b27b2a4-config-data-generated\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.304362 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/330c02d7-ea4c-47d3-bc2e-529f9b27b2a4-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.304394 5120 reconciler_common.go:299] "Volume detached for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/07f2b57d-24dd-44a8-9399-3d3df8cd1a86-ovsdb-rundir\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.304403 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/330c02d7-ea4c-47d3-bc2e-529f9b27b2a4-config-data-default\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.304412 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/07f2b57d-24dd-44a8-9399-3d3df8cd1a86-config\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.304422 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xpzrs\" (UniqueName: \"kubernetes.io/projected/6fdf4b26-c833-4319-954a-7ebaaedb71e5-kube-api-access-xpzrs\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.304432 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5e3627d3-225e-4cd9-b5fb-9a27c888e1e1-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.304474 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") on node \"crc\" " Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.338180 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e3627d3-225e-4cd9-b5fb-9a27c888e1e1-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "5e3627d3-225e-4cd9-b5fb-9a27c888e1e1" (UID: "5e3627d3-225e-4cd9-b5fb-9a27c888e1e1"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.338497 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"727aa42a-e1c1-427b-9912-f64504161039","Type":"ContainerDied","Data":"72cebf28e12d5f955cc6b919c4af9b90196860b5518fde261ed7c8327b6e21c2"} Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.338587 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.346021 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8abcb6e-3312-4c62-8931-b9ad85725e5b-kube-api-access-bcx7r" (OuterVolumeSpecName: "kube-api-access-bcx7r") pod "e8abcb6e-3312-4c62-8931-b9ad85725e5b" (UID: "e8abcb6e-3312-4c62-8931-b9ad85725e5b"). InnerVolumeSpecName "kube-api-access-bcx7r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.348679 5120 generic.go:358] "Generic (PLEG): container finished" podID="6fdf4b26-c833-4319-954a-7ebaaedb71e5" containerID="3655ac4348732f181824d8b56c72c7de7b64844e0300e8e4f1f18a838415654b" exitCode=0 Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.348893 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"6fdf4b26-c833-4319-954a-7ebaaedb71e5","Type":"ContainerDied","Data":"3655ac4348732f181824d8b56c72c7de7b64844e0300e8e4f1f18a838415654b"} Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.348919 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"6fdf4b26-c833-4319-954a-7ebaaedb71e5","Type":"ContainerDied","Data":"d57fa08f95a6cfcfd09827365e075bbb88ead4151737bba2848bcdf78f8d733f"} Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.348995 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.370929 5120 generic.go:358] "Generic (PLEG): container finished" podID="447b243b-6b80-4883-9844-f49d3f2f4a22" containerID="5af1b89049fce0d163cf34818a7156ce0fb2fde2aea842a3668857248b70d770" exitCode=0 Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.371002 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"447b243b-6b80-4883-9844-f49d3f2f4a22","Type":"ContainerDied","Data":"5af1b89049fce0d163cf34818a7156ce0fb2fde2aea842a3668857248b70d770"} Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.371353 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/330c02d7-ea4c-47d3-bc2e-529f9b27b2a4-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "330c02d7-ea4c-47d3-bc2e-529f9b27b2a4" (UID: "330c02d7-ea4c-47d3-bc2e-529f9b27b2a4"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.378250 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage20-crc" (OuterVolumeSpecName: "mysql-db") pod "330c02d7-ea4c-47d3-bc2e-529f9b27b2a4" (UID: "330c02d7-ea4c-47d3-bc2e-529f9b27b2a4"). InnerVolumeSpecName "local-storage20-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.426055 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bcx7r\" (UniqueName: \"kubernetes.io/projected/e8abcb6e-3312-4c62-8931-b9ad85725e5b-kube-api-access-bcx7r\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.426365 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/5e3627d3-225e-4cd9-b5fb-9a27c888e1e1-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.426376 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/330c02d7-ea4c-47d3-bc2e-529f9b27b2a4-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.426402 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") on node \"crc\" " Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.516753 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/727aa42a-e1c1-427b-9912-f64504161039-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "727aa42a-e1c1-427b-9912-f64504161039" (UID: "727aa42a-e1c1-427b-9912-f64504161039"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.541865 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/727aa42a-e1c1-427b-9912-f64504161039-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.553091 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage08-crc" (UniqueName: "kubernetes.io/local-volume/local-storage08-crc") on node "crc" Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.606912 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e3627d3-225e-4cd9-b5fb-9a27c888e1e1-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "5e3627d3-225e-4cd9-b5fb-9a27c888e1e1" (UID: "5e3627d3-225e-4cd9-b5fb-9a27c888e1e1"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.639929 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage01-crc" (UniqueName: "kubernetes.io/local-volume/local-storage01-crc") on node "crc" Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.658800 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/5e3627d3-225e-4cd9-b5fb-9a27c888e1e1-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.658852 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.658864 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:40 crc kubenswrapper[5120]: E0316 17:00:40.681602 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="31aa48ae9a695364d87a26a4847032706a8126fc6a90204e85b5a9a0b0bde237" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 17:00:40 crc kubenswrapper[5120]: E0316 17:00:40.689310 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="31aa48ae9a695364d87a26a4847032706a8126fc6a90204e85b5a9a0b0bde237" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 17:00:40 crc kubenswrapper[5120]: E0316 17:00:40.703830 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="31aa48ae9a695364d87a26a4847032706a8126fc6a90204e85b5a9a0b0bde237" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 17:00:40 crc kubenswrapper[5120]: E0316 17:00:40.703947 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="a19b5964-8116-49bd-9181-8eb2fe61703e" containerName="nova-scheduler-scheduler" probeResult="unknown" Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.705013 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6fdf4b26-c833-4319-954a-7ebaaedb71e5-config-data" (OuterVolumeSpecName: "config-data") pod "6fdf4b26-c833-4319-954a-7ebaaedb71e5" (UID: "6fdf4b26-c833-4319-954a-7ebaaedb71e5"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.765798 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6fdf4b26-c833-4319-954a-7ebaaedb71e5-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.791146 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage20-crc" (UniqueName: "kubernetes.io/local-volume/local-storage20-crc") on node "crc" Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.825051 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07f2b57d-24dd-44a8-9399-3d3df8cd1a86-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "07f2b57d-24dd-44a8-9399-3d3df8cd1a86" (UID: "07f2b57d-24dd-44a8-9399-3d3df8cd1a86"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.863955 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07f2b57d-24dd-44a8-9399-3d3df8cd1a86-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "07f2b57d-24dd-44a8-9399-3d3df8cd1a86" (UID: "07f2b57d-24dd-44a8-9399-3d3df8cd1a86"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.868605 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/07f2b57d-24dd-44a8-9399-3d3df8cd1a86-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.868922 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.868989 5120 reconciler_common.go:299] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/07f2b57d-24dd-44a8-9399-3d3df8cd1a86-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.885579 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/330c02d7-ea4c-47d3-bc2e-529f9b27b2a4-galera-tls-certs" (OuterVolumeSpecName: "galera-tls-certs") pod "330c02d7-ea4c-47d3-bc2e-529f9b27b2a4" (UID: "330c02d7-ea4c-47d3-bc2e-529f9b27b2a4"). InnerVolumeSpecName "galera-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.906168 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8abcb6e-3312-4c62-8931-b9ad85725e5b-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e8abcb6e-3312-4c62-8931-b9ad85725e5b" (UID: "e8abcb6e-3312-4c62-8931-b9ad85725e5b"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.916690 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8abcb6e-3312-4c62-8931-b9ad85725e5b-config-data" (OuterVolumeSpecName: "config-data") pod "e8abcb6e-3312-4c62-8931-b9ad85725e5b" (UID: "e8abcb6e-3312-4c62-8931-b9ad85725e5b"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.958316 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6fdf4b26-c833-4319-954a-7ebaaedb71e5-vencrypt-tls-certs" (OuterVolumeSpecName: "vencrypt-tls-certs") pod "6fdf4b26-c833-4319-954a-7ebaaedb71e5" (UID: "6fdf4b26-c833-4319-954a-7ebaaedb71e5"). InnerVolumeSpecName "vencrypt-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.963569 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ae0ee71-cb7b-4458-9176-1a941416c653-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "4ae0ee71-cb7b-4458-9176-1a941416c653" (UID: "4ae0ee71-cb7b-4458-9176-1a941416c653"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.965951 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ae0ee71-cb7b-4458-9176-1a941416c653-ovsdbserver-nb-tls-certs" (OuterVolumeSpecName: "ovsdbserver-nb-tls-certs") pod "4ae0ee71-cb7b-4458-9176-1a941416c653" (UID: "4ae0ee71-cb7b-4458-9176-1a941416c653"). InnerVolumeSpecName "ovsdbserver-nb-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.969416 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07f2b57d-24dd-44a8-9399-3d3df8cd1a86-ovsdbserver-sb-tls-certs" (OuterVolumeSpecName: "ovsdbserver-sb-tls-certs") pod "07f2b57d-24dd-44a8-9399-3d3df8cd1a86" (UID: "07f2b57d-24dd-44a8-9399-3d3df8cd1a86"). InnerVolumeSpecName "ovsdbserver-sb-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.988485 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4ae0ee71-cb7b-4458-9176-1a941416c653-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.988530 5120 reconciler_common.go:299] "Volume detached for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/4ae0ee71-cb7b-4458-9176-1a941416c653-ovsdbserver-nb-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.988548 5120 reconciler_common.go:299] "Volume detached for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/07f2b57d-24dd-44a8-9399-3d3df8cd1a86-ovsdbserver-sb-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.988562 5120 reconciler_common.go:299] "Volume detached for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/330c02d7-ea4c-47d3-bc2e-529f9b27b2a4-galera-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.988578 5120 reconciler_common.go:299] "Volume detached for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/6fdf4b26-c833-4319-954a-7ebaaedb71e5-vencrypt-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.988588 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e8abcb6e-3312-4c62-8931-b9ad85725e5b-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:40 crc kubenswrapper[5120]: I0316 17:00:40.988599 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e8abcb6e-3312-4c62-8931-b9ad85725e5b-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:41 crc kubenswrapper[5120]: I0316 17:00:41.007710 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6fdf4b26-c833-4319-954a-7ebaaedb71e5-nova-novncproxy-tls-certs" (OuterVolumeSpecName: "nova-novncproxy-tls-certs") pod "6fdf4b26-c833-4319-954a-7ebaaedb71e5" (UID: "6fdf4b26-c833-4319-954a-7ebaaedb71e5"). InnerVolumeSpecName "nova-novncproxy-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:41 crc kubenswrapper[5120]: I0316 17:00:41.075966 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ae0ee71-cb7b-4458-9176-1a941416c653-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "4ae0ee71-cb7b-4458-9176-1a941416c653" (UID: "4ae0ee71-cb7b-4458-9176-1a941416c653"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:41 crc kubenswrapper[5120]: I0316 17:00:41.087996 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6fdf4b26-c833-4319-954a-7ebaaedb71e5-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "6fdf4b26-c833-4319-954a-7ebaaedb71e5" (UID: "6fdf4b26-c833-4319-954a-7ebaaedb71e5"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:41 crc kubenswrapper[5120]: I0316 17:00:41.092563 5120 reconciler_common.go:299] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/4ae0ee71-cb7b-4458-9176-1a941416c653-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:41 crc kubenswrapper[5120]: I0316 17:00:41.092598 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6fdf4b26-c833-4319-954a-7ebaaedb71e5-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:41 crc kubenswrapper[5120]: I0316 17:00:41.092611 5120 reconciler_common.go:299] "Volume detached for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/6fdf4b26-c833-4319-954a-7ebaaedb71e5-nova-novncproxy-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:41 crc kubenswrapper[5120]: I0316 17:00:41.107800 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/727aa42a-e1c1-427b-9912-f64504161039-memcached-tls-certs" (OuterVolumeSpecName: "memcached-tls-certs") pod "727aa42a-e1c1-427b-9912-f64504161039" (UID: "727aa42a-e1c1-427b-9912-f64504161039"). InnerVolumeSpecName "memcached-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:41 crc kubenswrapper[5120]: I0316 17:00:41.197479 5120 reconciler_common.go:299] "Volume detached for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/727aa42a-e1c1-427b-9912-f64504161039-memcached-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:41 crc kubenswrapper[5120]: I0316 17:00:41.254885 5120 scope.go:117] "RemoveContainer" containerID="812f81a16c905368276223ee5005d10bd26af5275ab04c2e07d4bf28eecfa6cb" Mar 16 17:00:41 crc kubenswrapper[5120]: I0316 17:00:41.262595 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:00:41 crc kubenswrapper[5120]: I0316 17:00:41.300503 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/d82f3b2b-c672-46ff-8fc8-afc5b33e8252-etc-machine-id\") pod \"d82f3b2b-c672-46ff-8fc8-afc5b33e8252\" (UID: \"d82f3b2b-c672-46ff-8fc8-afc5b33e8252\") " Mar 16 17:00:41 crc kubenswrapper[5120]: I0316 17:00:41.300623 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wlrn8\" (UniqueName: \"kubernetes.io/projected/d82f3b2b-c672-46ff-8fc8-afc5b33e8252-kube-api-access-wlrn8\") pod \"d82f3b2b-c672-46ff-8fc8-afc5b33e8252\" (UID: \"d82f3b2b-c672-46ff-8fc8-afc5b33e8252\") " Mar 16 17:00:41 crc kubenswrapper[5120]: I0316 17:00:41.300688 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d82f3b2b-c672-46ff-8fc8-afc5b33e8252-config-data\") pod \"d82f3b2b-c672-46ff-8fc8-afc5b33e8252\" (UID: \"d82f3b2b-c672-46ff-8fc8-afc5b33e8252\") " Mar 16 17:00:41 crc kubenswrapper[5120]: I0316 17:00:41.300835 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d82f3b2b-c672-46ff-8fc8-afc5b33e8252-scripts\") pod \"d82f3b2b-c672-46ff-8fc8-afc5b33e8252\" (UID: \"d82f3b2b-c672-46ff-8fc8-afc5b33e8252\") " Mar 16 17:00:41 crc kubenswrapper[5120]: I0316 17:00:41.301198 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/d82f3b2b-c672-46ff-8fc8-afc5b33e8252-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "d82f3b2b-c672-46ff-8fc8-afc5b33e8252" (UID: "d82f3b2b-c672-46ff-8fc8-afc5b33e8252"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 17:00:41 crc kubenswrapper[5120]: I0316 17:00:41.301449 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/d82f3b2b-c672-46ff-8fc8-afc5b33e8252-config-data-custom\") pod \"d82f3b2b-c672-46ff-8fc8-afc5b33e8252\" (UID: \"d82f3b2b-c672-46ff-8fc8-afc5b33e8252\") " Mar 16 17:00:41 crc kubenswrapper[5120]: I0316 17:00:41.301952 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d82f3b2b-c672-46ff-8fc8-afc5b33e8252-combined-ca-bundle\") pod \"d82f3b2b-c672-46ff-8fc8-afc5b33e8252\" (UID: \"d82f3b2b-c672-46ff-8fc8-afc5b33e8252\") " Mar 16 17:00:41 crc kubenswrapper[5120]: I0316 17:00:41.303548 5120 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/d82f3b2b-c672-46ff-8fc8-afc5b33e8252-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:41 crc kubenswrapper[5120]: I0316 17:00:41.321752 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d82f3b2b-c672-46ff-8fc8-afc5b33e8252-kube-api-access-wlrn8" (OuterVolumeSpecName: "kube-api-access-wlrn8") pod "d82f3b2b-c672-46ff-8fc8-afc5b33e8252" (UID: "d82f3b2b-c672-46ff-8fc8-afc5b33e8252"). InnerVolumeSpecName "kube-api-access-wlrn8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:00:41 crc kubenswrapper[5120]: I0316 17:00:41.324054 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d82f3b2b-c672-46ff-8fc8-afc5b33e8252-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "d82f3b2b-c672-46ff-8fc8-afc5b33e8252" (UID: "d82f3b2b-c672-46ff-8fc8-afc5b33e8252"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:41 crc kubenswrapper[5120]: I0316 17:00:41.331096 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d82f3b2b-c672-46ff-8fc8-afc5b33e8252-scripts" (OuterVolumeSpecName: "scripts") pod "d82f3b2b-c672-46ff-8fc8-afc5b33e8252" (UID: "d82f3b2b-c672-46ff-8fc8-afc5b33e8252"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:41 crc kubenswrapper[5120]: I0316 17:00:41.390111 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d82f3b2b-c672-46ff-8fc8-afc5b33e8252-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "d82f3b2b-c672-46ff-8fc8-afc5b33e8252" (UID: "d82f3b2b-c672-46ff-8fc8-afc5b33e8252"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:41 crc kubenswrapper[5120]: I0316 17:00:41.421418 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/d82f3b2b-c672-46ff-8fc8-afc5b33e8252-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:41 crc kubenswrapper[5120]: I0316 17:00:41.422772 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d82f3b2b-c672-46ff-8fc8-afc5b33e8252-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:41 crc kubenswrapper[5120]: I0316 17:00:41.422801 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wlrn8\" (UniqueName: \"kubernetes.io/projected/d82f3b2b-c672-46ff-8fc8-afc5b33e8252-kube-api-access-wlrn8\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:41 crc kubenswrapper[5120]: I0316 17:00:41.422894 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d82f3b2b-c672-46ff-8fc8-afc5b33e8252-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:41 crc kubenswrapper[5120]: I0316 17:00:41.429957 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"d82f3b2b-c672-46ff-8fc8-afc5b33e8252","Type":"ContainerDied","Data":"1b2b16cda7068251a7f7f7c9fb939821dc436b883deecf9a44b1d5bb6ff93586"} Mar 16 17:00:41 crc kubenswrapper[5120]: I0316 17:00:41.430079 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:00:41 crc kubenswrapper[5120]: I0316 17:00:41.435318 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"39da7446-acba-4bbb-b813-1a3e2c89ebcd","Type":"ContainerDied","Data":"ca1d68086bd2a83cc28d2a6eb90891df500fbecdd5ff64704bc7f6b7f0c8e5f7"} Mar 16 17:00:41 crc kubenswrapper[5120]: I0316 17:00:41.435355 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ca1d68086bd2a83cc28d2a6eb90891df500fbecdd5ff64704bc7f6b7f0c8e5f7" Mar 16 17:00:41 crc kubenswrapper[5120]: I0316 17:00:41.439410 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"447b243b-6b80-4883-9844-f49d3f2f4a22","Type":"ContainerDied","Data":"e803538312a212485fe3e1cd0f6d0c8e1b682adb11e1ccc6978acbc806e44071"} Mar 16 17:00:41 crc kubenswrapper[5120]: I0316 17:00:41.439447 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e803538312a212485fe3e1cd0f6d0c8e1b682adb11e1ccc6978acbc806e44071" Mar 16 17:00:41 crc kubenswrapper[5120]: I0316 17:00:41.441922 5120 generic.go:358] "Generic (PLEG): container finished" podID="e2ad712e-f6f5-4942-94b9-635bbc53da15" containerID="76410021abc023713496ae0953fc6f1147e2f5232e4ad8b48fce68f89aa80c38" exitCode=0 Mar 16 17:00:41 crc kubenswrapper[5120]: I0316 17:00:41.442050 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"e2ad712e-f6f5-4942-94b9-635bbc53da15","Type":"ContainerDied","Data":"76410021abc023713496ae0953fc6f1147e2f5232e4ad8b48fce68f89aa80c38"} Mar 16 17:00:41 crc kubenswrapper[5120]: I0316 17:00:41.442078 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"e2ad712e-f6f5-4942-94b9-635bbc53da15","Type":"ContainerDied","Data":"6eeca64cdc0450d522b21e780cf3056cf61557866656b4afb8bfe1f30f050674"} Mar 16 17:00:41 crc kubenswrapper[5120]: I0316 17:00:41.442090 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6eeca64cdc0450d522b21e780cf3056cf61557866656b4afb8bfe1f30f050674" Mar 16 17:00:41 crc kubenswrapper[5120]: I0316 17:00:41.447851 5120 generic.go:358] "Generic (PLEG): container finished" podID="7712130b-a000-4541-a1b1-7442adb622f7" containerID="b42f7912bd0af5cc7eea7bbb672d44c2af34ef4c9686f59f00ea55d40951315a" exitCode=0 Mar 16 17:00:41 crc kubenswrapper[5120]: I0316 17:00:41.448191 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"7712130b-a000-4541-a1b1-7442adb622f7","Type":"ContainerDied","Data":"b42f7912bd0af5cc7eea7bbb672d44c2af34ef4c9686f59f00ea55d40951315a"} Mar 16 17:00:41 crc kubenswrapper[5120]: I0316 17:00:41.460060 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-6b9b487fd6-hdw75" event={"ID":"20dac7f8-f03f-40f8-93f1-5ba59f5471b8","Type":"ContainerStarted","Data":"d14ac2dba32d1f9dc4677dff3df7613d2465c455461e222dedd3cc507f276a58"} Mar 16 17:00:41 crc kubenswrapper[5120]: I0316 17:00:41.483854 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"30bfa4fc-b416-4f16-b673-158d4a8c552a","Type":"ContainerStarted","Data":"127be2cd9a418019067d28df39c8a22a07e067915f84e992cceebd4cedb161d5"} Mar 16 17:00:41 crc kubenswrapper[5120]: I0316 17:00:41.485103 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:00:41 crc kubenswrapper[5120]: I0316 17:00:41.485973 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:00:41 crc kubenswrapper[5120]: I0316 17:00:41.486302 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:00:41 crc kubenswrapper[5120]: I0316 17:00:41.486935 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:00:41 crc kubenswrapper[5120]: I0316 17:00:41.486944 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="30bfa4fc-b416-4f16-b673-158d4a8c552a" containerName="sg-core" containerID="cri-o://99635dda3eea0d4e53ecc0eb0ea3b6a04905af4d37311147fd10c24ffbd66ca8" gracePeriod=30 Mar 16 17:00:41 crc kubenswrapper[5120]: I0316 17:00:41.486971 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="30bfa4fc-b416-4f16-b673-158d4a8c552a" containerName="proxy-httpd" containerID="cri-o://127be2cd9a418019067d28df39c8a22a07e067915f84e992cceebd4cedb161d5" gracePeriod=30 Mar 16 17:00:41 crc kubenswrapper[5120]: I0316 17:00:41.487063 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="30bfa4fc-b416-4f16-b673-158d4a8c552a" containerName="ceilometer-notification-agent" containerID="cri-o://8a2a241180e8498f806434023245a7cf96892a004e496f210c200d2c05c4951c" gracePeriod=30 Mar 16 17:00:41 crc kubenswrapper[5120]: I0316 17:00:41.487076 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:00:41 crc kubenswrapper[5120]: I0316 17:00:41.490474 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="30bfa4fc-b416-4f16-b673-158d4a8c552a" containerName="ceilometer-central-agent" containerID="cri-o://df8b5c31f6424cfe5184b05fc53b3787de9354c9c0022f3d3a4c534d5104986b" gracePeriod=30 Mar 16 17:00:41 crc kubenswrapper[5120]: I0316 17:00:41.491412 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 17:00:41 crc kubenswrapper[5120]: I0316 17:00:41.515393 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d82f3b2b-c672-46ff-8fc8-afc5b33e8252-config-data" (OuterVolumeSpecName: "config-data") pod "d82f3b2b-c672-46ff-8fc8-afc5b33e8252" (UID: "d82f3b2b-c672-46ff-8fc8-afc5b33e8252"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:41 crc kubenswrapper[5120]: I0316 17:00:41.525176 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d82f3b2b-c672-46ff-8fc8-afc5b33e8252-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:41 crc kubenswrapper[5120]: I0316 17:00:41.540418 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=4.755471737 podStartE2EDuration="10.540378784s" podCreationTimestamp="2026-03-16 17:00:31 +0000 UTC" firstStartedPulling="2026-03-16 17:00:32.710261647 +0000 UTC m=+5334.864193304" lastFinishedPulling="2026-03-16 17:00:38.495168704 +0000 UTC m=+5340.649100351" observedRunningTime="2026-03-16 17:00:41.538325707 +0000 UTC m=+5343.692257374" watchObservedRunningTime="2026-03-16 17:00:41.540378784 +0000 UTC m=+5343.694310441" Mar 16 17:00:41 crc kubenswrapper[5120]: I0316 17:00:41.640411 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-57589895fd-84tvt"] Mar 16 17:00:41 crc kubenswrapper[5120]: I0316 17:00:41.702167 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-5f9fc84dc4-7nfss"] Mar 16 17:00:41 crc kubenswrapper[5120]: I0316 17:00:41.750737 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-765bfffb44-jrj28"] Mar 16 17:00:41 crc kubenswrapper[5120]: I0316 17:00:41.756452 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:00:41 crc kubenswrapper[5120]: I0316 17:00:41.789046 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:00:41 crc kubenswrapper[5120]: I0316 17:00:41.844772 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/447b243b-6b80-4883-9844-f49d3f2f4a22-public-tls-certs\") pod \"447b243b-6b80-4883-9844-f49d3f2f4a22\" (UID: \"447b243b-6b80-4883-9844-f49d3f2f4a22\") " Mar 16 17:00:41 crc kubenswrapper[5120]: I0316 17:00:41.844888 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/447b243b-6b80-4883-9844-f49d3f2f4a22-logs\") pod \"447b243b-6b80-4883-9844-f49d3f2f4a22\" (UID: \"447b243b-6b80-4883-9844-f49d3f2f4a22\") " Mar 16 17:00:41 crc kubenswrapper[5120]: I0316 17:00:41.844928 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/39da7446-acba-4bbb-b813-1a3e2c89ebcd-config-data-default\") pod \"39da7446-acba-4bbb-b813-1a3e2c89ebcd\" (UID: \"39da7446-acba-4bbb-b813-1a3e2c89ebcd\") " Mar 16 17:00:41 crc kubenswrapper[5120]: I0316 17:00:41.844980 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v24kv\" (UniqueName: \"kubernetes.io/projected/447b243b-6b80-4883-9844-f49d3f2f4a22-kube-api-access-v24kv\") pod \"447b243b-6b80-4883-9844-f49d3f2f4a22\" (UID: \"447b243b-6b80-4883-9844-f49d3f2f4a22\") " Mar 16 17:00:41 crc kubenswrapper[5120]: I0316 17:00:41.845029 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"447b243b-6b80-4883-9844-f49d3f2f4a22\" (UID: \"447b243b-6b80-4883-9844-f49d3f2f4a22\") " Mar 16 17:00:41 crc kubenswrapper[5120]: I0316 17:00:41.845062 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"mysql-db\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"39da7446-acba-4bbb-b813-1a3e2c89ebcd\" (UID: \"39da7446-acba-4bbb-b813-1a3e2c89ebcd\") " Mar 16 17:00:41 crc kubenswrapper[5120]: I0316 17:00:41.845132 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/447b243b-6b80-4883-9844-f49d3f2f4a22-config-data\") pod \"447b243b-6b80-4883-9844-f49d3f2f4a22\" (UID: \"447b243b-6b80-4883-9844-f49d3f2f4a22\") " Mar 16 17:00:41 crc kubenswrapper[5120]: I0316 17:00:41.845166 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/39da7446-acba-4bbb-b813-1a3e2c89ebcd-kolla-config\") pod \"39da7446-acba-4bbb-b813-1a3e2c89ebcd\" (UID: \"39da7446-acba-4bbb-b813-1a3e2c89ebcd\") " Mar 16 17:00:41 crc kubenswrapper[5120]: I0316 17:00:41.845217 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/447b243b-6b80-4883-9844-f49d3f2f4a22-combined-ca-bundle\") pod \"447b243b-6b80-4883-9844-f49d3f2f4a22\" (UID: \"447b243b-6b80-4883-9844-f49d3f2f4a22\") " Mar 16 17:00:41 crc kubenswrapper[5120]: I0316 17:00:41.845387 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/39da7446-acba-4bbb-b813-1a3e2c89ebcd-combined-ca-bundle\") pod \"39da7446-acba-4bbb-b813-1a3e2c89ebcd\" (UID: \"39da7446-acba-4bbb-b813-1a3e2c89ebcd\") " Mar 16 17:00:41 crc kubenswrapper[5120]: I0316 17:00:41.845458 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/447b243b-6b80-4883-9844-f49d3f2f4a22-scripts\") pod \"447b243b-6b80-4883-9844-f49d3f2f4a22\" (UID: \"447b243b-6b80-4883-9844-f49d3f2f4a22\") " Mar 16 17:00:41 crc kubenswrapper[5120]: I0316 17:00:41.845577 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/39da7446-acba-4bbb-b813-1a3e2c89ebcd-galera-tls-certs\") pod \"39da7446-acba-4bbb-b813-1a3e2c89ebcd\" (UID: \"39da7446-acba-4bbb-b813-1a3e2c89ebcd\") " Mar 16 17:00:41 crc kubenswrapper[5120]: I0316 17:00:41.845872 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/447b243b-6b80-4883-9844-f49d3f2f4a22-httpd-run\") pod \"447b243b-6b80-4883-9844-f49d3f2f4a22\" (UID: \"447b243b-6b80-4883-9844-f49d3f2f4a22\") " Mar 16 17:00:41 crc kubenswrapper[5120]: I0316 17:00:41.847250 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39da7446-acba-4bbb-b813-1a3e2c89ebcd-config-data-default" (OuterVolumeSpecName: "config-data-default") pod "39da7446-acba-4bbb-b813-1a3e2c89ebcd" (UID: "39da7446-acba-4bbb-b813-1a3e2c89ebcd"). InnerVolumeSpecName "config-data-default". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:00:41 crc kubenswrapper[5120]: I0316 17:00:41.848418 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/39da7446-acba-4bbb-b813-1a3e2c89ebcd-operator-scripts\") pod \"39da7446-acba-4bbb-b813-1a3e2c89ebcd\" (UID: \"39da7446-acba-4bbb-b813-1a3e2c89ebcd\") " Mar 16 17:00:41 crc kubenswrapper[5120]: I0316 17:00:41.848457 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tvhc5\" (UniqueName: \"kubernetes.io/projected/39da7446-acba-4bbb-b813-1a3e2c89ebcd-kube-api-access-tvhc5\") pod \"39da7446-acba-4bbb-b813-1a3e2c89ebcd\" (UID: \"39da7446-acba-4bbb-b813-1a3e2c89ebcd\") " Mar 16 17:00:41 crc kubenswrapper[5120]: I0316 17:00:41.848731 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/39da7446-acba-4bbb-b813-1a3e2c89ebcd-config-data-generated\") pod \"39da7446-acba-4bbb-b813-1a3e2c89ebcd\" (UID: \"39da7446-acba-4bbb-b813-1a3e2c89ebcd\") " Mar 16 17:00:41 crc kubenswrapper[5120]: I0316 17:00:41.849923 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/447b243b-6b80-4883-9844-f49d3f2f4a22-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "447b243b-6b80-4883-9844-f49d3f2f4a22" (UID: "447b243b-6b80-4883-9844-f49d3f2f4a22"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:00:41 crc kubenswrapper[5120]: I0316 17:00:41.851390 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/447b243b-6b80-4883-9844-f49d3f2f4a22-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:41 crc kubenswrapper[5120]: I0316 17:00:41.851419 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/39da7446-acba-4bbb-b813-1a3e2c89ebcd-config-data-default\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:41 crc kubenswrapper[5120]: I0316 17:00:41.854040 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/447b243b-6b80-4883-9844-f49d3f2f4a22-logs" (OuterVolumeSpecName: "logs") pod "447b243b-6b80-4883-9844-f49d3f2f4a22" (UID: "447b243b-6b80-4883-9844-f49d3f2f4a22"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:00:41 crc kubenswrapper[5120]: I0316 17:00:41.861637 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39da7446-acba-4bbb-b813-1a3e2c89ebcd-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "39da7446-acba-4bbb-b813-1a3e2c89ebcd" (UID: "39da7446-acba-4bbb-b813-1a3e2c89ebcd"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:00:41 crc kubenswrapper[5120]: I0316 17:00:41.862608 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39da7446-acba-4bbb-b813-1a3e2c89ebcd-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "39da7446-acba-4bbb-b813-1a3e2c89ebcd" (UID: "39da7446-acba-4bbb-b813-1a3e2c89ebcd"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:00:41 crc kubenswrapper[5120]: I0316 17:00:41.862818 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:00:41 crc kubenswrapper[5120]: I0316 17:00:41.863293 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39da7446-acba-4bbb-b813-1a3e2c89ebcd-config-data-generated" (OuterVolumeSpecName: "config-data-generated") pod "39da7446-acba-4bbb-b813-1a3e2c89ebcd" (UID: "39da7446-acba-4bbb-b813-1a3e2c89ebcd"). InnerVolumeSpecName "config-data-generated". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:00:41 crc kubenswrapper[5120]: I0316 17:00:41.867730 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/447b243b-6b80-4883-9844-f49d3f2f4a22-scripts" (OuterVolumeSpecName: "scripts") pod "447b243b-6b80-4883-9844-f49d3f2f4a22" (UID: "447b243b-6b80-4883-9844-f49d3f2f4a22"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:41 crc kubenswrapper[5120]: I0316 17:00:41.868170 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 17:00:41 crc kubenswrapper[5120]: I0316 17:00:41.871961 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/447b243b-6b80-4883-9844-f49d3f2f4a22-kube-api-access-v24kv" (OuterVolumeSpecName: "kube-api-access-v24kv") pod "447b243b-6b80-4883-9844-f49d3f2f4a22" (UID: "447b243b-6b80-4883-9844-f49d3f2f4a22"). InnerVolumeSpecName "kube-api-access-v24kv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:00:41 crc kubenswrapper[5120]: I0316 17:00:41.892748 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39da7446-acba-4bbb-b813-1a3e2c89ebcd-kube-api-access-tvhc5" (OuterVolumeSpecName: "kube-api-access-tvhc5") pod "39da7446-acba-4bbb-b813-1a3e2c89ebcd" (UID: "39da7446-acba-4bbb-b813-1a3e2c89ebcd"). InnerVolumeSpecName "kube-api-access-tvhc5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:00:41 crc kubenswrapper[5120]: I0316 17:00:41.902160 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage05-crc" (OuterVolumeSpecName: "glance") pod "447b243b-6b80-4883-9844-f49d3f2f4a22" (UID: "447b243b-6b80-4883-9844-f49d3f2f4a22"). InnerVolumeSpecName "local-storage05-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 17:00:41 crc kubenswrapper[5120]: I0316 17:00:41.935056 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage04-crc" (OuterVolumeSpecName: "mysql-db") pod "39da7446-acba-4bbb-b813-1a3e2c89ebcd" (UID: "39da7446-acba-4bbb-b813-1a3e2c89ebcd"). InnerVolumeSpecName "local-storage04-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 17:00:41 crc kubenswrapper[5120]: I0316 17:00:41.956338 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7712130b-a000-4541-a1b1-7442adb622f7-combined-ca-bundle\") pod \"7712130b-a000-4541-a1b1-7442adb622f7\" (UID: \"7712130b-a000-4541-a1b1-7442adb622f7\") " Mar 16 17:00:41 crc kubenswrapper[5120]: I0316 17:00:41.956382 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7712130b-a000-4541-a1b1-7442adb622f7-config-data\") pod \"7712130b-a000-4541-a1b1-7442adb622f7\" (UID: \"7712130b-a000-4541-a1b1-7442adb622f7\") " Mar 16 17:00:41 crc kubenswrapper[5120]: I0316 17:00:41.956491 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e2ad712e-f6f5-4942-94b9-635bbc53da15-config-data\") pod \"e2ad712e-f6f5-4942-94b9-635bbc53da15\" (UID: \"e2ad712e-f6f5-4942-94b9-635bbc53da15\") " Mar 16 17:00:41 crc kubenswrapper[5120]: I0316 17:00:41.956566 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e2ad712e-f6f5-4942-94b9-635bbc53da15-combined-ca-bundle\") pod \"e2ad712e-f6f5-4942-94b9-635bbc53da15\" (UID: \"e2ad712e-f6f5-4942-94b9-635bbc53da15\") " Mar 16 17:00:41 crc kubenswrapper[5120]: I0316 17:00:41.956774 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9xg44\" (UniqueName: \"kubernetes.io/projected/7712130b-a000-4541-a1b1-7442adb622f7-kube-api-access-9xg44\") pod \"7712130b-a000-4541-a1b1-7442adb622f7\" (UID: \"7712130b-a000-4541-a1b1-7442adb622f7\") " Mar 16 17:00:41 crc kubenswrapper[5120]: I0316 17:00:41.956838 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e2ad712e-f6f5-4942-94b9-635bbc53da15-logs\") pod \"e2ad712e-f6f5-4942-94b9-635bbc53da15\" (UID: \"e2ad712e-f6f5-4942-94b9-635bbc53da15\") " Mar 16 17:00:41 crc kubenswrapper[5120]: I0316 17:00:41.956886 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/e2ad712e-f6f5-4942-94b9-635bbc53da15-nova-metadata-tls-certs\") pod \"e2ad712e-f6f5-4942-94b9-635bbc53da15\" (UID: \"e2ad712e-f6f5-4942-94b9-635bbc53da15\") " Mar 16 17:00:41 crc kubenswrapper[5120]: I0316 17:00:41.956923 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sh4dz\" (UniqueName: \"kubernetes.io/projected/e2ad712e-f6f5-4942-94b9-635bbc53da15-kube-api-access-sh4dz\") pod \"e2ad712e-f6f5-4942-94b9-635bbc53da15\" (UID: \"e2ad712e-f6f5-4942-94b9-635bbc53da15\") " Mar 16 17:00:41 crc kubenswrapper[5120]: I0316 17:00:41.957693 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/39da7446-acba-4bbb-b813-1a3e2c89ebcd-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:41 crc kubenswrapper[5120]: I0316 17:00:41.957710 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tvhc5\" (UniqueName: \"kubernetes.io/projected/39da7446-acba-4bbb-b813-1a3e2c89ebcd-kube-api-access-tvhc5\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:41 crc kubenswrapper[5120]: I0316 17:00:41.957719 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/39da7446-acba-4bbb-b813-1a3e2c89ebcd-config-data-generated\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:41 crc kubenswrapper[5120]: I0316 17:00:41.957728 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/447b243b-6b80-4883-9844-f49d3f2f4a22-logs\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:41 crc kubenswrapper[5120]: I0316 17:00:41.957737 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v24kv\" (UniqueName: \"kubernetes.io/projected/447b243b-6b80-4883-9844-f49d3f2f4a22-kube-api-access-v24kv\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:41 crc kubenswrapper[5120]: I0316 17:00:41.957807 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") on node \"crc\" " Mar 16 17:00:41 crc kubenswrapper[5120]: I0316 17:00:41.957828 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") on node \"crc\" " Mar 16 17:00:41 crc kubenswrapper[5120]: I0316 17:00:41.957838 5120 reconciler_common.go:299] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/39da7446-acba-4bbb-b813-1a3e2c89ebcd-kolla-config\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:41 crc kubenswrapper[5120]: I0316 17:00:41.957846 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/447b243b-6b80-4883-9844-f49d3f2f4a22-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:41 crc kubenswrapper[5120]: I0316 17:00:41.962859 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2ad712e-f6f5-4942-94b9-635bbc53da15-logs" (OuterVolumeSpecName: "logs") pod "e2ad712e-f6f5-4942-94b9-635bbc53da15" (UID: "e2ad712e-f6f5-4942-94b9-635bbc53da15"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:00:41 crc kubenswrapper[5120]: I0316 17:00:41.965011 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-8579c6748-8wfdq"] Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.004581 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2ad712e-f6f5-4942-94b9-635bbc53da15-kube-api-access-sh4dz" (OuterVolumeSpecName: "kube-api-access-sh4dz") pod "e2ad712e-f6f5-4942-94b9-635bbc53da15" (UID: "e2ad712e-f6f5-4942-94b9-635bbc53da15"). InnerVolumeSpecName "kube-api-access-sh4dz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.005160 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/447b243b-6b80-4883-9844-f49d3f2f4a22-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "447b243b-6b80-4883-9844-f49d3f2f4a22" (UID: "447b243b-6b80-4883-9844-f49d3f2f4a22"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.019717 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.023736 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7712130b-a000-4541-a1b1-7442adb622f7-kube-api-access-9xg44" (OuterVolumeSpecName: "kube-api-access-9xg44") pod "7712130b-a000-4541-a1b1-7442adb622f7" (UID: "7712130b-a000-4541-a1b1-7442adb622f7"). InnerVolumeSpecName "kube-api-access-9xg44". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.047324 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.058227 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.060626 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9xg44\" (UniqueName: \"kubernetes.io/projected/7712130b-a000-4541-a1b1-7442adb622f7-kube-api-access-9xg44\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.060808 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e2ad712e-f6f5-4942-94b9-635bbc53da15-logs\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.060895 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sh4dz\" (UniqueName: \"kubernetes.io/projected/e2ad712e-f6f5-4942-94b9-635bbc53da15-kube-api-access-sh4dz\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.061298 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/447b243b-6b80-4883-9844-f49d3f2f4a22-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.070588 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.101383 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.117003 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.119373 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8abcb6e-3312-4c62-8931-b9ad85725e5b" containerName="nova-cell1-conductor-conductor" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.119550 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8abcb6e-3312-4c62-8931-b9ad85725e5b" containerName="nova-cell1-conductor-conductor" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.119643 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7712130b-a000-4541-a1b1-7442adb622f7" containerName="nova-cell0-conductor-conductor" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.119720 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7712130b-a000-4541-a1b1-7442adb622f7" containerName="nova-cell0-conductor-conductor" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.119838 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2ad712e-f6f5-4942-94b9-635bbc53da15" containerName="nova-metadata-metadata" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.119917 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2ad712e-f6f5-4942-94b9-635bbc53da15" containerName="nova-metadata-metadata" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.120638 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d82f3b2b-c672-46ff-8fc8-afc5b33e8252" containerName="cinder-scheduler" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.120737 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="d82f3b2b-c672-46ff-8fc8-afc5b33e8252" containerName="cinder-scheduler" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.121821 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07f2b57d-24dd-44a8-9399-3d3df8cd1a86" containerName="openstack-network-exporter" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.121936 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="07f2b57d-24dd-44a8-9399-3d3df8cd1a86" containerName="openstack-network-exporter" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.122106 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="727aa42a-e1c1-427b-9912-f64504161039" containerName="memcached" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.122247 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="727aa42a-e1c1-427b-9912-f64504161039" containerName="memcached" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.122338 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ae0ee71-cb7b-4458-9176-1a941416c653" containerName="ovsdbserver-nb" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.122416 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ae0ee71-cb7b-4458-9176-1a941416c653" containerName="ovsdbserver-nb" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.122507 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2ad712e-f6f5-4942-94b9-635bbc53da15" containerName="nova-metadata-log" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.122585 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2ad712e-f6f5-4942-94b9-635bbc53da15" containerName="nova-metadata-log" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.122733 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="330c02d7-ea4c-47d3-bc2e-529f9b27b2a4" containerName="mysql-bootstrap" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.122842 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="330c02d7-ea4c-47d3-bc2e-529f9b27b2a4" containerName="mysql-bootstrap" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.122954 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e3627d3-225e-4cd9-b5fb-9a27c888e1e1" containerName="nova-api-log" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.123051 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e3627d3-225e-4cd9-b5fb-9a27c888e1e1" containerName="nova-api-log" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.123116 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39da7446-acba-4bbb-b813-1a3e2c89ebcd" containerName="mysql-bootstrap" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.123200 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="39da7446-acba-4bbb-b813-1a3e2c89ebcd" containerName="mysql-bootstrap" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.123256 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e3627d3-225e-4cd9-b5fb-9a27c888e1e1" containerName="nova-api-api" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.123315 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e3627d3-225e-4cd9-b5fb-9a27c888e1e1" containerName="nova-api-api" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.123423 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6fdf4b26-c833-4319-954a-7ebaaedb71e5" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.123478 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="6fdf4b26-c833-4319-954a-7ebaaedb71e5" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.123544 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ae0ee71-cb7b-4458-9176-1a941416c653" containerName="openstack-network-exporter" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.123609 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ae0ee71-cb7b-4458-9176-1a941416c653" containerName="openstack-network-exporter" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.123665 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39da7446-acba-4bbb-b813-1a3e2c89ebcd" containerName="galera" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.123716 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="39da7446-acba-4bbb-b813-1a3e2c89ebcd" containerName="galera" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.123802 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d82f3b2b-c672-46ff-8fc8-afc5b33e8252" containerName="cinder-scheduler" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.123867 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="d82f3b2b-c672-46ff-8fc8-afc5b33e8252" containerName="cinder-scheduler" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.123940 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d82f3b2b-c672-46ff-8fc8-afc5b33e8252" containerName="probe" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.123996 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="d82f3b2b-c672-46ff-8fc8-afc5b33e8252" containerName="probe" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.124079 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07f2b57d-24dd-44a8-9399-3d3df8cd1a86" containerName="ovsdbserver-sb" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.124132 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="07f2b57d-24dd-44a8-9399-3d3df8cd1a86" containerName="ovsdbserver-sb" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.124202 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="447b243b-6b80-4883-9844-f49d3f2f4a22" containerName="glance-httpd" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.124256 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="447b243b-6b80-4883-9844-f49d3f2f4a22" containerName="glance-httpd" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.124320 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="330c02d7-ea4c-47d3-bc2e-529f9b27b2a4" containerName="galera" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.124462 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="330c02d7-ea4c-47d3-bc2e-529f9b27b2a4" containerName="galera" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.124538 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="447b243b-6b80-4883-9844-f49d3f2f4a22" containerName="glance-log" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.124593 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="447b243b-6b80-4883-9844-f49d3f2f4a22" containerName="glance-log" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.124964 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="4ae0ee71-cb7b-4458-9176-1a941416c653" containerName="openstack-network-exporter" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.125038 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="5e3627d3-225e-4cd9-b5fb-9a27c888e1e1" containerName="nova-api-log" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.125098 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e2ad712e-f6f5-4942-94b9-635bbc53da15" containerName="nova-metadata-metadata" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.125153 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="727aa42a-e1c1-427b-9912-f64504161039" containerName="memcached" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.125222 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="39da7446-acba-4bbb-b813-1a3e2c89ebcd" containerName="galera" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.125280 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="330c02d7-ea4c-47d3-bc2e-529f9b27b2a4" containerName="galera" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.125347 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="6fdf4b26-c833-4319-954a-7ebaaedb71e5" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.125407 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="07f2b57d-24dd-44a8-9399-3d3df8cd1a86" containerName="ovsdbserver-sb" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.125465 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="d82f3b2b-c672-46ff-8fc8-afc5b33e8252" containerName="cinder-scheduler" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.125528 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="5e3627d3-225e-4cd9-b5fb-9a27c888e1e1" containerName="nova-api-api" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.125586 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e8abcb6e-3312-4c62-8931-b9ad85725e5b" containerName="nova-cell1-conductor-conductor" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.125648 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="d82f3b2b-c672-46ff-8fc8-afc5b33e8252" containerName="cinder-scheduler" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.125714 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="07f2b57d-24dd-44a8-9399-3d3df8cd1a86" containerName="openstack-network-exporter" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.125796 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="4ae0ee71-cb7b-4458-9176-1a941416c653" containerName="ovsdbserver-nb" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.125855 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="447b243b-6b80-4883-9844-f49d3f2f4a22" containerName="glance-httpd" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.125909 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="447b243b-6b80-4883-9844-f49d3f2f4a22" containerName="glance-log" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.125961 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e2ad712e-f6f5-4942-94b9-635bbc53da15" containerName="nova-metadata-log" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.126016 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="d82f3b2b-c672-46ff-8fc8-afc5b33e8252" containerName="probe" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.126071 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7712130b-a000-4541-a1b1-7442adb622f7" containerName="nova-cell0-conductor-conductor" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.135498 5120 scope.go:117] "RemoveContainer" containerID="3655ac4348732f181824d8b56c72c7de7b64844e0300e8e4f1f18a838415654b" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.150892 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.151141 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.168157 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"memcached-config-data\"" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.168420 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-memcached-svc\"" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.168484 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"memcached-memcached-dockercfg-s2pts\"" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.176447 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.179492 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-scheduler-config-data\"" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.180408 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.223164 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.239502 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.243190 5120 scope.go:117] "RemoveContainer" containerID="3655ac4348732f181824d8b56c72c7de7b64844e0300e8e4f1f18a838415654b" Mar 16 17:00:42 crc kubenswrapper[5120]: E0316 17:00:42.243638 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3655ac4348732f181824d8b56c72c7de7b64844e0300e8e4f1f18a838415654b\": container with ID starting with 3655ac4348732f181824d8b56c72c7de7b64844e0300e8e4f1f18a838415654b not found: ID does not exist" containerID="3655ac4348732f181824d8b56c72c7de7b64844e0300e8e4f1f18a838415654b" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.243666 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3655ac4348732f181824d8b56c72c7de7b64844e0300e8e4f1f18a838415654b"} err="failed to get container status \"3655ac4348732f181824d8b56c72c7de7b64844e0300e8e4f1f18a838415654b\": rpc error: code = NotFound desc = could not find container \"3655ac4348732f181824d8b56c72c7de7b64844e0300e8e4f1f18a838415654b\": container with ID starting with 3655ac4348732f181824d8b56c72c7de7b64844e0300e8e4f1f18a838415654b not found: ID does not exist" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.243685 5120 scope.go:117] "RemoveContainer" containerID="498a641ae78ee7e529f010dee7dcbf81ff0ff8d58d98aecf53ad28696be667d1" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.272732 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/d0bd5c73-646f-42e2-885f-25fc4835ee47-memcached-tls-certs\") pod \"memcached-0\" (UID: \"d0bd5c73-646f-42e2-885f-25fc4835ee47\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.272834 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/2cadcb9e-2a3b-4c14-8fcc-39939326678f-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"2cadcb9e-2a3b-4c14-8fcc-39939326678f\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.272895 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zl7d\" (UniqueName: \"kubernetes.io/projected/d0bd5c73-646f-42e2-885f-25fc4835ee47-kube-api-access-5zl7d\") pod \"memcached-0\" (UID: \"d0bd5c73-646f-42e2-885f-25fc4835ee47\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.272956 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d0bd5c73-646f-42e2-885f-25fc4835ee47-combined-ca-bundle\") pod \"memcached-0\" (UID: \"d0bd5c73-646f-42e2-885f-25fc4835ee47\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.272979 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2cadcb9e-2a3b-4c14-8fcc-39939326678f-config-data\") pod \"cinder-scheduler-0\" (UID: \"2cadcb9e-2a3b-4c14-8fcc-39939326678f\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.273051 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/d0bd5c73-646f-42e2-885f-25fc4835ee47-config-data\") pod \"memcached-0\" (UID: \"d0bd5c73-646f-42e2-885f-25fc4835ee47\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.273073 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgb9t\" (UniqueName: \"kubernetes.io/projected/2cadcb9e-2a3b-4c14-8fcc-39939326678f-kube-api-access-kgb9t\") pod \"cinder-scheduler-0\" (UID: \"2cadcb9e-2a3b-4c14-8fcc-39939326678f\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.273104 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.273161 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2cadcb9e-2a3b-4c14-8fcc-39939326678f-scripts\") pod \"cinder-scheduler-0\" (UID: \"2cadcb9e-2a3b-4c14-8fcc-39939326678f\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.273195 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/2cadcb9e-2a3b-4c14-8fcc-39939326678f-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"2cadcb9e-2a3b-4c14-8fcc-39939326678f\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.273223 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/d0bd5c73-646f-42e2-885f-25fc4835ee47-kolla-config\") pod \"memcached-0\" (UID: \"d0bd5c73-646f-42e2-885f-25fc4835ee47\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.273278 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2cadcb9e-2a3b-4c14-8fcc-39939326678f-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"2cadcb9e-2a3b-4c14-8fcc-39939326678f\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.288098 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.298315 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.314702 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.314867 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.317058 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-conductor-config-data\"" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.318252 5120 scope.go:117] "RemoveContainer" containerID="28657cd9914973413b6f6e9aeaea403f0c4337248a7147ff00ed46ba9a535468" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.328599 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.375960 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2cadcb9e-2a3b-4c14-8fcc-39939326678f-scripts\") pod \"cinder-scheduler-0\" (UID: \"2cadcb9e-2a3b-4c14-8fcc-39939326678f\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.376023 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/61d14db6-7d33-4e5f-8252-844441e519d7-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"61d14db6-7d33-4e5f-8252-844441e519d7\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.376055 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/2cadcb9e-2a3b-4c14-8fcc-39939326678f-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"2cadcb9e-2a3b-4c14-8fcc-39939326678f\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.376084 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/d0bd5c73-646f-42e2-885f-25fc4835ee47-kolla-config\") pod \"memcached-0\" (UID: \"d0bd5c73-646f-42e2-885f-25fc4835ee47\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.376146 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2cadcb9e-2a3b-4c14-8fcc-39939326678f-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"2cadcb9e-2a3b-4c14-8fcc-39939326678f\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.376273 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czgrr\" (UniqueName: \"kubernetes.io/projected/61d14db6-7d33-4e5f-8252-844441e519d7-kube-api-access-czgrr\") pod \"nova-cell1-conductor-0\" (UID: \"61d14db6-7d33-4e5f-8252-844441e519d7\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.376311 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/d0bd5c73-646f-42e2-885f-25fc4835ee47-memcached-tls-certs\") pod \"memcached-0\" (UID: \"d0bd5c73-646f-42e2-885f-25fc4835ee47\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.376351 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/2cadcb9e-2a3b-4c14-8fcc-39939326678f-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"2cadcb9e-2a3b-4c14-8fcc-39939326678f\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.376414 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5zl7d\" (UniqueName: \"kubernetes.io/projected/d0bd5c73-646f-42e2-885f-25fc4835ee47-kube-api-access-5zl7d\") pod \"memcached-0\" (UID: \"d0bd5c73-646f-42e2-885f-25fc4835ee47\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.376884 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/61d14db6-7d33-4e5f-8252-844441e519d7-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"61d14db6-7d33-4e5f-8252-844441e519d7\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.376936 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d0bd5c73-646f-42e2-885f-25fc4835ee47-combined-ca-bundle\") pod \"memcached-0\" (UID: \"d0bd5c73-646f-42e2-885f-25fc4835ee47\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.376963 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2cadcb9e-2a3b-4c14-8fcc-39939326678f-config-data\") pod \"cinder-scheduler-0\" (UID: \"2cadcb9e-2a3b-4c14-8fcc-39939326678f\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.377057 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/d0bd5c73-646f-42e2-885f-25fc4835ee47-config-data\") pod \"memcached-0\" (UID: \"d0bd5c73-646f-42e2-885f-25fc4835ee47\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.377086 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kgb9t\" (UniqueName: \"kubernetes.io/projected/2cadcb9e-2a3b-4c14-8fcc-39939326678f-kube-api-access-kgb9t\") pod \"cinder-scheduler-0\" (UID: \"2cadcb9e-2a3b-4c14-8fcc-39939326678f\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.377675 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/d0bd5c73-646f-42e2-885f-25fc4835ee47-kolla-config\") pod \"memcached-0\" (UID: \"d0bd5c73-646f-42e2-885f-25fc4835ee47\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.378428 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/2cadcb9e-2a3b-4c14-8fcc-39939326678f-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"2cadcb9e-2a3b-4c14-8fcc-39939326678f\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.395891 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/d0bd5c73-646f-42e2-885f-25fc4835ee47-config-data\") pod \"memcached-0\" (UID: \"d0bd5c73-646f-42e2-885f-25fc4835ee47\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.396244 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.403530 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgb9t\" (UniqueName: \"kubernetes.io/projected/2cadcb9e-2a3b-4c14-8fcc-39939326678f-kube-api-access-kgb9t\") pod \"cinder-scheduler-0\" (UID: \"2cadcb9e-2a3b-4c14-8fcc-39939326678f\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.404452 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/2cadcb9e-2a3b-4c14-8fcc-39939326678f-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"2cadcb9e-2a3b-4c14-8fcc-39939326678f\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.407271 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zl7d\" (UniqueName: \"kubernetes.io/projected/d0bd5c73-646f-42e2-885f-25fc4835ee47-kube-api-access-5zl7d\") pod \"memcached-0\" (UID: \"d0bd5c73-646f-42e2-885f-25fc4835ee47\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.408180 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2cadcb9e-2a3b-4c14-8fcc-39939326678f-scripts\") pod \"cinder-scheduler-0\" (UID: \"2cadcb9e-2a3b-4c14-8fcc-39939326678f\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.408374 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2cadcb9e-2a3b-4c14-8fcc-39939326678f-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"2cadcb9e-2a3b-4c14-8fcc-39939326678f\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.408548 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2cadcb9e-2a3b-4c14-8fcc-39939326678f-config-data\") pod \"cinder-scheduler-0\" (UID: \"2cadcb9e-2a3b-4c14-8fcc-39939326678f\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.409611 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d0bd5c73-646f-42e2-885f-25fc4835ee47-combined-ca-bundle\") pod \"memcached-0\" (UID: \"d0bd5c73-646f-42e2-885f-25fc4835ee47\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.410269 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/d0bd5c73-646f-42e2-885f-25fc4835ee47-memcached-tls-certs\") pod \"memcached-0\" (UID: \"d0bd5c73-646f-42e2-885f-25fc4835ee47\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.428050 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.433011 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.440421 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-novncproxy-cell1-vencrypt\"" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.440501 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-novncproxy-cell1-public-svc\"" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.440674 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-novncproxy-config-data\"" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.445180 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.448722 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-galera-openstack-svc\"" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.449618 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-config-data\"" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.452556 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"galera-openstack-dockercfg-428w9\"" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.457085 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.463749 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-scripts\"" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.469466 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.480236 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.482237 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-czgrr\" (UniqueName: \"kubernetes.io/projected/61d14db6-7d33-4e5f-8252-844441e519d7-kube-api-access-czgrr\") pod \"nova-cell1-conductor-0\" (UID: \"61d14db6-7d33-4e5f-8252-844441e519d7\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.482299 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/9a5a470f-6027-43b1-aa7b-74626f464c7c-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"9a5a470f-6027-43b1-aa7b-74626f464c7c\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.482369 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/9a5a470f-6027-43b1-aa7b-74626f464c7c-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"9a5a470f-6027-43b1-aa7b-74626f464c7c\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.482414 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/61d14db6-7d33-4e5f-8252-844441e519d7-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"61d14db6-7d33-4e5f-8252-844441e519d7\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.482474 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9a5a470f-6027-43b1-aa7b-74626f464c7c-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"9a5a470f-6027-43b1-aa7b-74626f464c7c\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.482577 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9a5a470f-6027-43b1-aa7b-74626f464c7c-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"9a5a470f-6027-43b1-aa7b-74626f464c7c\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.482665 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/61d14db6-7d33-4e5f-8252-844441e519d7-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"61d14db6-7d33-4e5f-8252-844441e519d7\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.482807 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zd9l\" (UniqueName: \"kubernetes.io/projected/9a5a470f-6027-43b1-aa7b-74626f464c7c-kube-api-access-9zd9l\") pod \"nova-cell1-novncproxy-0\" (UID: \"9a5a470f-6027-43b1-aa7b-74626f464c7c\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.494670 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage04-crc" (UniqueName: "kubernetes.io/local-volume/local-storage04-crc") on node "crc" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.496025 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.498579 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.506687 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-czgrr\" (UniqueName: \"kubernetes.io/projected/61d14db6-7d33-4e5f-8252-844441e519d7-kube-api-access-czgrr\") pod \"nova-cell1-conductor-0\" (UID: \"61d14db6-7d33-4e5f-8252-844441e519d7\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.525009 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.537487 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/61d14db6-7d33-4e5f-8252-844441e519d7-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"61d14db6-7d33-4e5f-8252-844441e519d7\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.544501 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.558863 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"7712130b-a000-4541-a1b1-7442adb622f7","Type":"ContainerDied","Data":"9cbdaa981208594d3f444bc5686c9714e130e99226ae4db00aa1bc722af7dcbf"} Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.559136 5120 scope.go:117] "RemoveContainer" containerID="b42f7912bd0af5cc7eea7bbb672d44c2af34ef4c9686f59f00ea55d40951315a" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.559340 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.562465 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-765bfffb44-jrj28" event={"ID":"ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801","Type":"ContainerStarted","Data":"79df03a33585a1dbc7a97113d7983976a5afa997d7c7f5f744441ea7082e2046"} Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.565604 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/39da7446-acba-4bbb-b813-1a3e2c89ebcd-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "39da7446-acba-4bbb-b813-1a3e2c89ebcd" (UID: "39da7446-acba-4bbb-b813-1a3e2c89ebcd"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.575638 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-6b9b487fd6-hdw75" event={"ID":"20dac7f8-f03f-40f8-93f1-5ba59f5471b8","Type":"ContainerStarted","Data":"66f4292cc65d6c8fdd967ff988b50c682f3d1dd97a48df06d9e5a314aa95e2f0"} Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.593114 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9zd9l\" (UniqueName: \"kubernetes.io/projected/9a5a470f-6027-43b1-aa7b-74626f464c7c-kube-api-access-9zd9l\") pod \"nova-cell1-novncproxy-0\" (UID: \"9a5a470f-6027-43b1-aa7b-74626f464c7c\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.597186 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ab76f235-6a48-4935-a2d5-5a79806c416c-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"ab76f235-6a48-4935-a2d5-5a79806c416c\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.593433 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-5f9fc84dc4-7nfss" event={"ID":"bdbf2033-4671-473e-9ede-ce2611d51fac","Type":"ContainerStarted","Data":"6a9fd81ac5ab6d6384a09d8f12c8b03f6ccc15b49c065de4a42bd18b0f1b5e27"} Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.597727 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-8579c6748-8wfdq" event={"ID":"6f3cdac2-9246-455c-b05a-347b4db60b7f","Type":"ContainerStarted","Data":"4963e870a7941975a5ebfdb82b7de24ce3c15dd67e1a939a43d4fd784d3166b2"} Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.597698 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/9a5a470f-6027-43b1-aa7b-74626f464c7c-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"9a5a470f-6027-43b1-aa7b-74626f464c7c\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.598735 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/ab76f235-6a48-4935-a2d5-5a79806c416c-kolla-config\") pod \"openstack-galera-0\" (UID: \"ab76f235-6a48-4935-a2d5-5a79806c416c\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.598456 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/61d14db6-7d33-4e5f-8252-844441e519d7-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"61d14db6-7d33-4e5f-8252-844441e519d7\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.598792 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/ab76f235-6a48-4935-a2d5-5a79806c416c-config-data-generated\") pod \"openstack-galera-0\" (UID: \"ab76f235-6a48-4935-a2d5-5a79806c416c\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.599316 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/ab76f235-6a48-4935-a2d5-5a79806c416c-config-data-default\") pod \"openstack-galera-0\" (UID: \"ab76f235-6a48-4935-a2d5-5a79806c416c\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.599732 5120 generic.go:358] "Generic (PLEG): container finished" podID="30bfa4fc-b416-4f16-b673-158d4a8c552a" containerID="127be2cd9a418019067d28df39c8a22a07e067915f84e992cceebd4cedb161d5" exitCode=0 Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.599778 5120 generic.go:358] "Generic (PLEG): container finished" podID="30bfa4fc-b416-4f16-b673-158d4a8c552a" containerID="99635dda3eea0d4e53ecc0eb0ea3b6a04905af4d37311147fd10c24ffbd66ca8" exitCode=2 Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.599787 5120 generic.go:358] "Generic (PLEG): container finished" podID="30bfa4fc-b416-4f16-b673-158d4a8c552a" containerID="8a2a241180e8498f806434023245a7cf96892a004e496f210c200d2c05c4951c" exitCode=0 Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.599848 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"30bfa4fc-b416-4f16-b673-158d4a8c552a","Type":"ContainerDied","Data":"127be2cd9a418019067d28df39c8a22a07e067915f84e992cceebd4cedb161d5"} Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.599865 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"30bfa4fc-b416-4f16-b673-158d4a8c552a","Type":"ContainerDied","Data":"99635dda3eea0d4e53ecc0eb0ea3b6a04905af4d37311147fd10c24ffbd66ca8"} Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.599874 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"30bfa4fc-b416-4f16-b673-158d4a8c552a","Type":"ContainerDied","Data":"8a2a241180e8498f806434023245a7cf96892a004e496f210c200d2c05c4951c"} Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.599977 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/9a5a470f-6027-43b1-aa7b-74626f464c7c-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"9a5a470f-6027-43b1-aa7b-74626f464c7c\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.600131 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9a5a470f-6027-43b1-aa7b-74626f464c7c-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"9a5a470f-6027-43b1-aa7b-74626f464c7c\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.600622 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ab76f235-6a48-4935-a2d5-5a79806c416c-operator-scripts\") pod \"openstack-galera-0\" (UID: \"ab76f235-6a48-4935-a2d5-5a79806c416c\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.601471 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9a5a470f-6027-43b1-aa7b-74626f464c7c-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"9a5a470f-6027-43b1-aa7b-74626f464c7c\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.601636 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vg2zm\" (UniqueName: \"kubernetes.io/projected/ab76f235-6a48-4935-a2d5-5a79806c416c-kube-api-access-vg2zm\") pod \"openstack-galera-0\" (UID: \"ab76f235-6a48-4935-a2d5-5a79806c416c\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.601780 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/ab76f235-6a48-4935-a2d5-5a79806c416c-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"ab76f235-6a48-4935-a2d5-5a79806c416c\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.601810 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"openstack-galera-0\" (UID: \"ab76f235-6a48-4935-a2d5-5a79806c416c\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.602087 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/39da7446-acba-4bbb-b813-1a3e2c89ebcd-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.602776 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.603835 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7712130b-a000-4541-a1b1-7442adb622f7-config-data" (OuterVolumeSpecName: "config-data") pod "7712130b-a000-4541-a1b1-7442adb622f7" (UID: "7712130b-a000-4541-a1b1-7442adb622f7"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.604848 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-6f96bb5df9-spfxv" event={"ID":"fb7a2068-5a18-4c7b-92d0-364f371d59df","Type":"ContainerStarted","Data":"97410dc76f412387b08b4c4b9c619dfcb470a14033e5445e72e531bacfce7fe0"} Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.609206 5120 generic.go:358] "Generic (PLEG): container finished" podID="55f7f374-c6b2-422b-90bd-a7dcc936e74f" containerID="7c8283b18df5600672951ca55dfc7a2133e3c633c2c87ee077597e69c0583de6" exitCode=0 Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.609313 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"55f7f374-c6b2-422b-90bd-a7dcc936e74f","Type":"ContainerDied","Data":"7c8283b18df5600672951ca55dfc7a2133e3c633c2c87ee077597e69c0583de6"} Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.609344 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"55f7f374-c6b2-422b-90bd-a7dcc936e74f","Type":"ContainerDied","Data":"09bbf68572dda98d0eba8758d9ca27ed1d096829ca22317239ce3b4204cf1485"} Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.609358 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="09bbf68572dda98d0eba8758d9ca27ed1d096829ca22317239ce3b4204cf1485" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.611691 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.626002 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e2ad712e-f6f5-4942-94b9-635bbc53da15-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e2ad712e-f6f5-4942-94b9-635bbc53da15" (UID: "e2ad712e-f6f5-4942-94b9-635bbc53da15"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.637082 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/9a5a470f-6027-43b1-aa7b-74626f464c7c-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"9a5a470f-6027-43b1-aa7b-74626f464c7c\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.644272 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9a5a470f-6027-43b1-aa7b-74626f464c7c-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"9a5a470f-6027-43b1-aa7b-74626f464c7c\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.647801 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/9a5a470f-6027-43b1-aa7b-74626f464c7c-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"9a5a470f-6027-43b1-aa7b-74626f464c7c\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.650584 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.651996 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.652687 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9a5a470f-6027-43b1-aa7b-74626f464c7c-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"9a5a470f-6027-43b1-aa7b-74626f464c7c\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.652722 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-57589895fd-84tvt" event={"ID":"08933bb0-40b0-4b92-b9d1-af46cdcc8aad","Type":"ContainerStarted","Data":"d230fd9d0d090bd7f661fe53df8e714c7e59a18e5e08381b929cb2f2365f2e1c"} Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.652809 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.652816 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.657374 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.669483 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.670076 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zd9l\" (UniqueName: \"kubernetes.io/projected/9a5a470f-6027-43b1-aa7b-74626f464c7c-kube-api-access-9zd9l\") pod \"nova-cell1-novncproxy-0\" (UID: \"9a5a470f-6027-43b1-aa7b-74626f464c7c\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.679063 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovndbcluster-nb-config\"" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.680823 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ovncluster-ovndbcluster-nb-dockercfg-8zd6v\"" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.681288 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ovndbcluster-nb-ovndbs\"" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.681469 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovndbcluster-nb-scripts\"" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.681843 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="330c02d7-ea4c-47d3-bc2e-529f9b27b2a4" path="/var/lib/kubelet/pods/330c02d7-ea4c-47d3-bc2e-529f9b27b2a4/volumes" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.682602 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4ae0ee71-cb7b-4458-9176-1a941416c653" path="/var/lib/kubelet/pods/4ae0ee71-cb7b-4458-9176-1a941416c653/volumes" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.683272 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6fdf4b26-c833-4319-954a-7ebaaedb71e5" path="/var/lib/kubelet/pods/6fdf4b26-c833-4319-954a-7ebaaedb71e5/volumes" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.684545 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="727aa42a-e1c1-427b-9912-f64504161039" path="/var/lib/kubelet/pods/727aa42a-e1c1-427b-9912-f64504161039/volumes" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.685168 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d82f3b2b-c672-46ff-8fc8-afc5b33e8252" path="/var/lib/kubelet/pods/d82f3b2b-c672-46ff-8fc8-afc5b33e8252/volumes" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.685970 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e8abcb6e-3312-4c62-8931-b9ad85725e5b" path="/var/lib/kubelet/pods/e8abcb6e-3312-4c62-8931-b9ad85725e5b/volumes" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.703982 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e2ad712e-f6f5-4942-94b9-635bbc53da15-nova-metadata-tls-certs" (OuterVolumeSpecName: "nova-metadata-tls-certs") pod "e2ad712e-f6f5-4942-94b9-635bbc53da15" (UID: "e2ad712e-f6f5-4942-94b9-635bbc53da15"). InnerVolumeSpecName "nova-metadata-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.710288 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/e2ad712e-f6f5-4942-94b9-635bbc53da15-nova-metadata-tls-certs\") pod \"e2ad712e-f6f5-4942-94b9-635bbc53da15\" (UID: \"e2ad712e-f6f5-4942-94b9-635bbc53da15\") " Mar 16 17:00:42 crc kubenswrapper[5120]: W0316 17:00:42.711740 5120 empty_dir.go:511] Warning: Unmount skipped because path does not exist: /var/lib/kubelet/pods/e2ad712e-f6f5-4942-94b9-635bbc53da15/volumes/kubernetes.io~secret/nova-metadata-tls-certs Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.711779 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e2ad712e-f6f5-4942-94b9-635bbc53da15-nova-metadata-tls-certs" (OuterVolumeSpecName: "nova-metadata-tls-certs") pod "e2ad712e-f6f5-4942-94b9-635bbc53da15" (UID: "e2ad712e-f6f5-4942-94b9-635bbc53da15"). InnerVolumeSpecName "nova-metadata-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.711843 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/ab76f235-6a48-4935-a2d5-5a79806c416c-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"ab76f235-6a48-4935-a2d5-5a79806c416c\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.712001 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"openstack-galera-0\" (UID: \"ab76f235-6a48-4935-a2d5-5a79806c416c\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.712318 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ab76f235-6a48-4935-a2d5-5a79806c416c-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"ab76f235-6a48-4935-a2d5-5a79806c416c\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.712498 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/ab76f235-6a48-4935-a2d5-5a79806c416c-kolla-config\") pod \"openstack-galera-0\" (UID: \"ab76f235-6a48-4935-a2d5-5a79806c416c\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.712539 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/ab76f235-6a48-4935-a2d5-5a79806c416c-config-data-generated\") pod \"openstack-galera-0\" (UID: \"ab76f235-6a48-4935-a2d5-5a79806c416c\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.712595 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/ab76f235-6a48-4935-a2d5-5a79806c416c-config-data-default\") pod \"openstack-galera-0\" (UID: \"ab76f235-6a48-4935-a2d5-5a79806c416c\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.712847 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ab76f235-6a48-4935-a2d5-5a79806c416c-operator-scripts\") pod \"openstack-galera-0\" (UID: \"ab76f235-6a48-4935-a2d5-5a79806c416c\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.713980 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vg2zm\" (UniqueName: \"kubernetes.io/projected/ab76f235-6a48-4935-a2d5-5a79806c416c-kube-api-access-vg2zm\") pod \"openstack-galera-0\" (UID: \"ab76f235-6a48-4935-a2d5-5a79806c416c\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.714100 5120 reconciler_common.go:299] "Volume detached for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/e2ad712e-f6f5-4942-94b9-635bbc53da15-nova-metadata-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.714122 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7712130b-a000-4541-a1b1-7442adb622f7-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.714134 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e2ad712e-f6f5-4942-94b9-635bbc53da15-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.715350 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/ab76f235-6a48-4935-a2d5-5a79806c416c-kolla-config\") pod \"openstack-galera-0\" (UID: \"ab76f235-6a48-4935-a2d5-5a79806c416c\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.715449 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/ab76f235-6a48-4935-a2d5-5a79806c416c-config-data-generated\") pod \"openstack-galera-0\" (UID: \"ab76f235-6a48-4935-a2d5-5a79806c416c\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.715873 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/ab76f235-6a48-4935-a2d5-5a79806c416c-config-data-default\") pod \"openstack-galera-0\" (UID: \"ab76f235-6a48-4935-a2d5-5a79806c416c\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.715892 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"openstack-galera-0\" (UID: \"ab76f235-6a48-4935-a2d5-5a79806c416c\") device mount path \"/mnt/openstack/pv20\"" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.720771 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ab76f235-6a48-4935-a2d5-5a79806c416c-operator-scripts\") pod \"openstack-galera-0\" (UID: \"ab76f235-6a48-4935-a2d5-5a79806c416c\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.736889 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vg2zm\" (UniqueName: \"kubernetes.io/projected/ab76f235-6a48-4935-a2d5-5a79806c416c-kube-api-access-vg2zm\") pod \"openstack-galera-0\" (UID: \"ab76f235-6a48-4935-a2d5-5a79806c416c\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.745787 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ab76f235-6a48-4935-a2d5-5a79806c416c-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"ab76f235-6a48-4935-a2d5-5a79806c416c\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.754967 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e2ad712e-f6f5-4942-94b9-635bbc53da15-config-data" (OuterVolumeSpecName: "config-data") pod "e2ad712e-f6f5-4942-94b9-635bbc53da15" (UID: "e2ad712e-f6f5-4942-94b9-635bbc53da15"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.756170 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/ab76f235-6a48-4935-a2d5-5a79806c416c-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"ab76f235-6a48-4935-a2d5-5a79806c416c\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.823176 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e5f68c9e-894a-4eac-90fc-be12f8c49913-config\") pod \"ovsdbserver-nb-0\" (UID: \"e5f68c9e-894a-4eac-90fc-be12f8c49913\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.823270 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e5f68c9e-894a-4eac-90fc-be12f8c49913-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"e5f68c9e-894a-4eac-90fc-be12f8c49913\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.823366 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/e5f68c9e-894a-4eac-90fc-be12f8c49913-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"e5f68c9e-894a-4eac-90fc-be12f8c49913\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.823425 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7szz\" (UniqueName: \"kubernetes.io/projected/e5f68c9e-894a-4eac-90fc-be12f8c49913-kube-api-access-q7szz\") pod \"ovsdbserver-nb-0\" (UID: \"e5f68c9e-894a-4eac-90fc-be12f8c49913\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.823552 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/e5f68c9e-894a-4eac-90fc-be12f8c49913-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"e5f68c9e-894a-4eac-90fc-be12f8c49913\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.823630 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"ovsdbserver-nb-0\" (UID: \"e5f68c9e-894a-4eac-90fc-be12f8c49913\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.823884 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/e5f68c9e-894a-4eac-90fc-be12f8c49913-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"e5f68c9e-894a-4eac-90fc-be12f8c49913\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.823937 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/e5f68c9e-894a-4eac-90fc-be12f8c49913-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"e5f68c9e-894a-4eac-90fc-be12f8c49913\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.824010 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e2ad712e-f6f5-4942-94b9-635bbc53da15-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.854708 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage05-crc" (UniqueName: "kubernetes.io/local-volume/local-storage05-crc") on node "crc" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.872630 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/447b243b-6b80-4883-9844-f49d3f2f4a22-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "447b243b-6b80-4883-9844-f49d3f2f4a22" (UID: "447b243b-6b80-4883-9844-f49d3f2f4a22"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.903486 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7712130b-a000-4541-a1b1-7442adb622f7-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "7712130b-a000-4541-a1b1-7442adb622f7" (UID: "7712130b-a000-4541-a1b1-7442adb622f7"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.922676 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/447b243b-6b80-4883-9844-f49d3f2f4a22-config-data" (OuterVolumeSpecName: "config-data") pod "447b243b-6b80-4883-9844-f49d3f2f4a22" (UID: "447b243b-6b80-4883-9844-f49d3f2f4a22"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.925016 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"openstack-galera-0\" (UID: \"ab76f235-6a48-4935-a2d5-5a79806c416c\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.926270 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e5f68c9e-894a-4eac-90fc-be12f8c49913-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"e5f68c9e-894a-4eac-90fc-be12f8c49913\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.926346 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/e5f68c9e-894a-4eac-90fc-be12f8c49913-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"e5f68c9e-894a-4eac-90fc-be12f8c49913\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.926391 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q7szz\" (UniqueName: \"kubernetes.io/projected/e5f68c9e-894a-4eac-90fc-be12f8c49913-kube-api-access-q7szz\") pod \"ovsdbserver-nb-0\" (UID: \"e5f68c9e-894a-4eac-90fc-be12f8c49913\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.926461 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/e5f68c9e-894a-4eac-90fc-be12f8c49913-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"e5f68c9e-894a-4eac-90fc-be12f8c49913\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.926487 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"ovsdbserver-nb-0\" (UID: \"e5f68c9e-894a-4eac-90fc-be12f8c49913\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.926634 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/e5f68c9e-894a-4eac-90fc-be12f8c49913-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"e5f68c9e-894a-4eac-90fc-be12f8c49913\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.926670 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/e5f68c9e-894a-4eac-90fc-be12f8c49913-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"e5f68c9e-894a-4eac-90fc-be12f8c49913\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.926808 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e5f68c9e-894a-4eac-90fc-be12f8c49913-config\") pod \"ovsdbserver-nb-0\" (UID: \"e5f68c9e-894a-4eac-90fc-be12f8c49913\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.926868 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/447b243b-6b80-4883-9844-f49d3f2f4a22-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.926882 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.926890 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/447b243b-6b80-4883-9844-f49d3f2f4a22-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.926919 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7712130b-a000-4541-a1b1-7442adb622f7-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.928378 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e5f68c9e-894a-4eac-90fc-be12f8c49913-config\") pod \"ovsdbserver-nb-0\" (UID: \"e5f68c9e-894a-4eac-90fc-be12f8c49913\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.928802 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/39da7446-acba-4bbb-b813-1a3e2c89ebcd-galera-tls-certs" (OuterVolumeSpecName: "galera-tls-certs") pod "39da7446-acba-4bbb-b813-1a3e2c89ebcd" (UID: "39da7446-acba-4bbb-b813-1a3e2c89ebcd"). InnerVolumeSpecName "galera-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.929557 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"ovsdbserver-nb-0\" (UID: \"e5f68c9e-894a-4eac-90fc-be12f8c49913\") device mount path \"/mnt/openstack/pv08\"" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.930011 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/e5f68c9e-894a-4eac-90fc-be12f8c49913-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"e5f68c9e-894a-4eac-90fc-be12f8c49913\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.930365 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/e5f68c9e-894a-4eac-90fc-be12f8c49913-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"e5f68c9e-894a-4eac-90fc-be12f8c49913\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.940469 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e5f68c9e-894a-4eac-90fc-be12f8c49913-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"e5f68c9e-894a-4eac-90fc-be12f8c49913\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.949230 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/e5f68c9e-894a-4eac-90fc-be12f8c49913-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"e5f68c9e-894a-4eac-90fc-be12f8c49913\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.952469 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/e5f68c9e-894a-4eac-90fc-be12f8c49913-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"e5f68c9e-894a-4eac-90fc-be12f8c49913\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:00:42 crc kubenswrapper[5120]: I0316 17:00:42.981089 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7szz\" (UniqueName: \"kubernetes.io/projected/e5f68c9e-894a-4eac-90fc-be12f8c49913-kube-api-access-q7szz\") pod \"ovsdbserver-nb-0\" (UID: \"e5f68c9e-894a-4eac-90fc-be12f8c49913\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.023213 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"ovsdbserver-nb-0\" (UID: \"e5f68c9e-894a-4eac-90fc-be12f8c49913\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.025734 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-keystone-listener-6b9b487fd6-hdw75" podStartSLOduration=8.025716389 podStartE2EDuration="8.025716389s" podCreationTimestamp="2026-03-16 17:00:35 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:00:42.59719534 +0000 UTC m=+5344.751126997" watchObservedRunningTime="2026-03-16 17:00:43.025716389 +0000 UTC m=+5345.179648046" Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.029930 5120 reconciler_common.go:299] "Volume detached for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/39da7446-acba-4bbb-b813-1a3e2c89ebcd-galera-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.223665 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.224293 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.224396 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.224496 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.224579 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.248150 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.248213 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.248351 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.252103 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ovndbcluster-sb-ovndbs\"" Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.252316 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovndbcluster-sb-scripts\"" Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.252338 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ovncluster-ovndbcluster-sb-dockercfg-scdkb\"" Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.256039 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.256089 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-5d8cb95448-4wwn9"] Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.256307 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-5d8cb95448-4wwn9" podUID="d4c74a5c-86a6-4bcf-b660-10a42c6a2be1" containerName="barbican-keystone-listener-log" containerID="cri-o://98a6bb7bcbdb1c9b868828021b7f938892232a44d9a2e07cc46cefbe5ca3da85" gracePeriod=30 Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.256439 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-5d8cb95448-4wwn9" podUID="d4c74a5c-86a6-4bcf-b660-10a42c6a2be1" containerName="barbican-keystone-listener" containerID="cri-o://6de8bdd5fb2544346e3cbeb0ae90bbd7bd95389cd023b6a97824529be2e5589f" gracePeriod=30 Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.256473 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.256864 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovndbcluster-sb-config\"" Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.262240 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-config-data\"" Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.262445 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-public-svc\"" Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.262602 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-internal-svc\"" Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.296988 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0d641338-e35d-4819-b487-513c8840cfd7-logs\") pod \"nova-api-0\" (UID: \"0d641338-e35d-4819-b487-513c8840cfd7\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.297044 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/0d641338-e35d-4819-b487-513c8840cfd7-internal-tls-certs\") pod \"nova-api-0\" (UID: \"0d641338-e35d-4819-b487-513c8840cfd7\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.297139 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0d641338-e35d-4819-b487-513c8840cfd7-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"0d641338-e35d-4819-b487-513c8840cfd7\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.297346 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/0d641338-e35d-4819-b487-513c8840cfd7-public-tls-certs\") pod \"nova-api-0\" (UID: \"0d641338-e35d-4819-b487-513c8840cfd7\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.297412 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0d641338-e35d-4819-b487-513c8840cfd7-config-data\") pod \"nova-api-0\" (UID: \"0d641338-e35d-4819-b487-513c8840cfd7\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.297443 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prnjd\" (UniqueName: \"kubernetes.io/projected/0d641338-e35d-4819-b487-513c8840cfd7-kube-api-access-prnjd\") pod \"nova-api-0\" (UID: \"0d641338-e35d-4819-b487-513c8840cfd7\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.306818 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.348907 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.374317 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.386981 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.395893 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.396862 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.405875 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0d641338-e35d-4819-b487-513c8840cfd7-config-data\") pod \"nova-api-0\" (UID: \"0d641338-e35d-4819-b487-513c8840cfd7\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.408133 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-prnjd\" (UniqueName: \"kubernetes.io/projected/0d641338-e35d-4819-b487-513c8840cfd7-kube-api-access-prnjd\") pod \"nova-api-0\" (UID: \"0d641338-e35d-4819-b487-513c8840cfd7\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.408278 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"ovsdbserver-sb-0\" (UID: \"5f9a749e-2dbb-409d-b935-4f2891d43397\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.408315 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/5f9a749e-2dbb-409d-b935-4f2891d43397-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"5f9a749e-2dbb-409d-b935-4f2891d43397\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.408357 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5f9a749e-2dbb-409d-b935-4f2891d43397-config\") pod \"ovsdbserver-sb-0\" (UID: \"5f9a749e-2dbb-409d-b935-4f2891d43397\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.408443 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5f9a749e-2dbb-409d-b935-4f2891d43397-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"5f9a749e-2dbb-409d-b935-4f2891d43397\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.408539 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0d641338-e35d-4819-b487-513c8840cfd7-logs\") pod \"nova-api-0\" (UID: \"0d641338-e35d-4819-b487-513c8840cfd7\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.408594 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/0d641338-e35d-4819-b487-513c8840cfd7-internal-tls-certs\") pod \"nova-api-0\" (UID: \"0d641338-e35d-4819-b487-513c8840cfd7\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.408645 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vznm4\" (UniqueName: \"kubernetes.io/projected/5f9a749e-2dbb-409d-b935-4f2891d43397-kube-api-access-vznm4\") pod \"ovsdbserver-sb-0\" (UID: \"5f9a749e-2dbb-409d-b935-4f2891d43397\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.408737 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0d641338-e35d-4819-b487-513c8840cfd7-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"0d641338-e35d-4819-b487-513c8840cfd7\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.408893 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/5f9a749e-2dbb-409d-b935-4f2891d43397-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"5f9a749e-2dbb-409d-b935-4f2891d43397\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.409058 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/5f9a749e-2dbb-409d-b935-4f2891d43397-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"5f9a749e-2dbb-409d-b935-4f2891d43397\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.409126 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/0d641338-e35d-4819-b487-513c8840cfd7-public-tls-certs\") pod \"nova-api-0\" (UID: \"0d641338-e35d-4819-b487-513c8840cfd7\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.409188 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/5f9a749e-2dbb-409d-b935-4f2891d43397-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"5f9a749e-2dbb-409d-b935-4f2891d43397\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.410157 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0d641338-e35d-4819-b487-513c8840cfd7-logs\") pod \"nova-api-0\" (UID: \"0d641338-e35d-4819-b487-513c8840cfd7\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.432870 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.451184 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0d641338-e35d-4819-b487-513c8840cfd7-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"0d641338-e35d-4819-b487-513c8840cfd7\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.452611 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/0d641338-e35d-4819-b487-513c8840cfd7-internal-tls-certs\") pod \"nova-api-0\" (UID: \"0d641338-e35d-4819-b487-513c8840cfd7\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.463086 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55f7f374-c6b2-422b-90bd-a7dcc936e74f" containerName="glance-log" Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.463122 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="55f7f374-c6b2-422b-90bd-a7dcc936e74f" containerName="glance-log" Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.463150 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55f7f374-c6b2-422b-90bd-a7dcc936e74f" containerName="glance-httpd" Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.463156 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="55f7f374-c6b2-422b-90bd-a7dcc936e74f" containerName="glance-httpd" Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.463561 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="55f7f374-c6b2-422b-90bd-a7dcc936e74f" containerName="glance-httpd" Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.463587 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="55f7f374-c6b2-422b-90bd-a7dcc936e74f" containerName="glance-log" Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.463963 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-prnjd\" (UniqueName: \"kubernetes.io/projected/0d641338-e35d-4819-b487-513c8840cfd7-kube-api-access-prnjd\") pod \"nova-api-0\" (UID: \"0d641338-e35d-4819-b487-513c8840cfd7\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.470696 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0d641338-e35d-4819-b487-513c8840cfd7-config-data\") pod \"nova-api-0\" (UID: \"0d641338-e35d-4819-b487-513c8840cfd7\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.473900 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.474020 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.489821 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-metadata-config-data\"" Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.490067 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-metadata-internal-svc\"" Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.494056 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/0d641338-e35d-4819-b487-513c8840cfd7-public-tls-certs\") pod \"nova-api-0\" (UID: \"0d641338-e35d-4819-b487-513c8840cfd7\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.517087 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/55f7f374-c6b2-422b-90bd-a7dcc936e74f-logs\") pod \"55f7f374-c6b2-422b-90bd-a7dcc936e74f\" (UID: \"55f7f374-c6b2-422b-90bd-a7dcc936e74f\") " Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.517278 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"55f7f374-c6b2-422b-90bd-a7dcc936e74f\" (UID: \"55f7f374-c6b2-422b-90bd-a7dcc936e74f\") " Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.517821 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vm2nn\" (UniqueName: \"kubernetes.io/projected/55f7f374-c6b2-422b-90bd-a7dcc936e74f-kube-api-access-vm2nn\") pod \"55f7f374-c6b2-422b-90bd-a7dcc936e74f\" (UID: \"55f7f374-c6b2-422b-90bd-a7dcc936e74f\") " Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.519681 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/55f7f374-c6b2-422b-90bd-a7dcc936e74f-scripts\") pod \"55f7f374-c6b2-422b-90bd-a7dcc936e74f\" (UID: \"55f7f374-c6b2-422b-90bd-a7dcc936e74f\") " Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.519829 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55f7f374-c6b2-422b-90bd-a7dcc936e74f-logs" (OuterVolumeSpecName: "logs") pod "55f7f374-c6b2-422b-90bd-a7dcc936e74f" (UID: "55f7f374-c6b2-422b-90bd-a7dcc936e74f"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.538557 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/55f7f374-c6b2-422b-90bd-a7dcc936e74f-internal-tls-certs\") pod \"55f7f374-c6b2-422b-90bd-a7dcc936e74f\" (UID: \"55f7f374-c6b2-422b-90bd-a7dcc936e74f\") " Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.538933 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/55f7f374-c6b2-422b-90bd-a7dcc936e74f-httpd-run\") pod \"55f7f374-c6b2-422b-90bd-a7dcc936e74f\" (UID: \"55f7f374-c6b2-422b-90bd-a7dcc936e74f\") " Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.539152 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/55f7f374-c6b2-422b-90bd-a7dcc936e74f-config-data\") pod \"55f7f374-c6b2-422b-90bd-a7dcc936e74f\" (UID: \"55f7f374-c6b2-422b-90bd-a7dcc936e74f\") " Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.539247 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/55f7f374-c6b2-422b-90bd-a7dcc936e74f-combined-ca-bundle\") pod \"55f7f374-c6b2-422b-90bd-a7dcc936e74f\" (UID: \"55f7f374-c6b2-422b-90bd-a7dcc936e74f\") " Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.539661 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55f7f374-c6b2-422b-90bd-a7dcc936e74f-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "55f7f374-c6b2-422b-90bd-a7dcc936e74f" (UID: "55f7f374-c6b2-422b-90bd-a7dcc936e74f"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.540983 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vznm4\" (UniqueName: \"kubernetes.io/projected/5f9a749e-2dbb-409d-b935-4f2891d43397-kube-api-access-vznm4\") pod \"ovsdbserver-sb-0\" (UID: \"5f9a749e-2dbb-409d-b935-4f2891d43397\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.541447 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/5f9a749e-2dbb-409d-b935-4f2891d43397-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"5f9a749e-2dbb-409d-b935-4f2891d43397\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.541731 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/5f9a749e-2dbb-409d-b935-4f2891d43397-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"5f9a749e-2dbb-409d-b935-4f2891d43397\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.542054 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/5f9a749e-2dbb-409d-b935-4f2891d43397-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"5f9a749e-2dbb-409d-b935-4f2891d43397\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.542571 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"ovsdbserver-sb-0\" (UID: \"5f9a749e-2dbb-409d-b935-4f2891d43397\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.543259 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/5f9a749e-2dbb-409d-b935-4f2891d43397-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"5f9a749e-2dbb-409d-b935-4f2891d43397\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.543374 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5f9a749e-2dbb-409d-b935-4f2891d43397-config\") pod \"ovsdbserver-sb-0\" (UID: \"5f9a749e-2dbb-409d-b935-4f2891d43397\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.544018 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/55f7f374-c6b2-422b-90bd-a7dcc936e74f-kube-api-access-vm2nn" (OuterVolumeSpecName: "kube-api-access-vm2nn") pod "55f7f374-c6b2-422b-90bd-a7dcc936e74f" (UID: "55f7f374-c6b2-422b-90bd-a7dcc936e74f"). InnerVolumeSpecName "kube-api-access-vm2nn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.545343 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5f9a749e-2dbb-409d-b935-4f2891d43397-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"5f9a749e-2dbb-409d-b935-4f2891d43397\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.546235 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/55f7f374-c6b2-422b-90bd-a7dcc936e74f-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.546255 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/55f7f374-c6b2-422b-90bd-a7dcc936e74f-logs\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.546266 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vm2nn\" (UniqueName: \"kubernetes.io/projected/55f7f374-c6b2-422b-90bd-a7dcc936e74f-kube-api-access-vm2nn\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.553020 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/5f9a749e-2dbb-409d-b935-4f2891d43397-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"5f9a749e-2dbb-409d-b935-4f2891d43397\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.553996 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"ovsdbserver-sb-0\" (UID: \"5f9a749e-2dbb-409d-b935-4f2891d43397\") device mount path \"/mnt/openstack/pv01\"" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.562906 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5f9a749e-2dbb-409d-b935-4f2891d43397-config\") pod \"ovsdbserver-sb-0\" (UID: \"5f9a749e-2dbb-409d-b935-4f2891d43397\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.564521 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/5f9a749e-2dbb-409d-b935-4f2891d43397-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"5f9a749e-2dbb-409d-b935-4f2891d43397\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.575496 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/5f9a749e-2dbb-409d-b935-4f2891d43397-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"5f9a749e-2dbb-409d-b935-4f2891d43397\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.575806 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/5f9a749e-2dbb-409d-b935-4f2891d43397-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"5f9a749e-2dbb-409d-b935-4f2891d43397\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.576053 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5f9a749e-2dbb-409d-b935-4f2891d43397-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"5f9a749e-2dbb-409d-b935-4f2891d43397\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.587941 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.614384 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.617495 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage06-crc" (OuterVolumeSpecName: "glance") pod "55f7f374-c6b2-422b-90bd-a7dcc936e74f" (UID: "55f7f374-c6b2-422b-90bd-a7dcc936e74f"). InnerVolumeSpecName "local-storage06-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.627499 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/55f7f374-c6b2-422b-90bd-a7dcc936e74f-scripts" (OuterVolumeSpecName: "scripts") pod "55f7f374-c6b2-422b-90bd-a7dcc936e74f" (UID: "55f7f374-c6b2-422b-90bd-a7dcc936e74f"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.647896 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vznm4\" (UniqueName: \"kubernetes.io/projected/5f9a749e-2dbb-409d-b935-4f2891d43397-kube-api-access-vznm4\") pod \"ovsdbserver-sb-0\" (UID: \"5f9a749e-2dbb-409d-b935-4f2891d43397\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.649294 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ce24ae83-459d-4410-bd4d-fb7e0fcad044-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"ce24ae83-459d-4410-bd4d-fb7e0fcad044\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.649483 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ce24ae83-459d-4410-bd4d-fb7e0fcad044-logs\") pod \"nova-metadata-0\" (UID: \"ce24ae83-459d-4410-bd4d-fb7e0fcad044\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.649550 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ce24ae83-459d-4410-bd4d-fb7e0fcad044-config-data\") pod \"nova-metadata-0\" (UID: \"ce24ae83-459d-4410-bd4d-fb7e0fcad044\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.649570 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8twx\" (UniqueName: \"kubernetes.io/projected/ce24ae83-459d-4410-bd4d-fb7e0fcad044-kube-api-access-v8twx\") pod \"nova-metadata-0\" (UID: \"ce24ae83-459d-4410-bd4d-fb7e0fcad044\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.649624 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/ce24ae83-459d-4410-bd4d-fb7e0fcad044-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"ce24ae83-459d-4410-bd4d-fb7e0fcad044\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.649873 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") on node \"crc\" " Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.649890 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/55f7f374-c6b2-422b-90bd-a7dcc936e74f-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.674884 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.676878 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage06-crc" (UniqueName: "kubernetes.io/local-volume/local-storage06-crc") on node "crc" Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.698859 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.719534 5120 generic.go:358] "Generic (PLEG): container finished" podID="d4c74a5c-86a6-4bcf-b660-10a42c6a2be1" containerID="98a6bb7bcbdb1c9b868828021b7f938892232a44d9a2e07cc46cefbe5ca3da85" exitCode=143 Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.748679 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-5d8cb95448-4wwn9" event={"ID":"d4c74a5c-86a6-4bcf-b660-10a42c6a2be1","Type":"ContainerDied","Data":"98a6bb7bcbdb1c9b868828021b7f938892232a44d9a2e07cc46cefbe5ca3da85"} Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.749334 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.749202 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.753982 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ce24ae83-459d-4410-bd4d-fb7e0fcad044-logs\") pod \"nova-metadata-0\" (UID: \"ce24ae83-459d-4410-bd4d-fb7e0fcad044\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.756220 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ce24ae83-459d-4410-bd4d-fb7e0fcad044-config-data\") pod \"nova-metadata-0\" (UID: \"ce24ae83-459d-4410-bd4d-fb7e0fcad044\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.756452 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v8twx\" (UniqueName: \"kubernetes.io/projected/ce24ae83-459d-4410-bd4d-fb7e0fcad044-kube-api-access-v8twx\") pod \"nova-metadata-0\" (UID: \"ce24ae83-459d-4410-bd4d-fb7e0fcad044\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.756635 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/ce24ae83-459d-4410-bd4d-fb7e0fcad044-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"ce24ae83-459d-4410-bd4d-fb7e0fcad044\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.758916 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ce24ae83-459d-4410-bd4d-fb7e0fcad044-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"ce24ae83-459d-4410-bd4d-fb7e0fcad044\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.754962 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ce24ae83-459d-4410-bd4d-fb7e0fcad044-logs\") pod \"nova-metadata-0\" (UID: \"ce24ae83-459d-4410-bd4d-fb7e0fcad044\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.760039 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.761072 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.761558 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-conductor-config-data\"" Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.773717 5120 generic.go:358] "Generic (PLEG): container finished" podID="30bfa4fc-b416-4f16-b673-158d4a8c552a" containerID="df8b5c31f6424cfe5184b05fc53b3787de9354c9c0022f3d3a4c534d5104986b" exitCode=0 Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.773838 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"30bfa4fc-b416-4f16-b673-158d4a8c552a","Type":"ContainerDied","Data":"df8b5c31f6424cfe5184b05fc53b3787de9354c9c0022f3d3a4c534d5104986b"} Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.780076 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.785433 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ce24ae83-459d-4410-bd4d-fb7e0fcad044-config-data\") pod \"nova-metadata-0\" (UID: \"ce24ae83-459d-4410-bd4d-fb7e0fcad044\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.788393 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"d0bd5c73-646f-42e2-885f-25fc4835ee47","Type":"ContainerStarted","Data":"f2f53baec56cdccd3f89e94dafd2aa8951b587b3d783db654fd2eeec176e9c73"} Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.796077 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/ce24ae83-459d-4410-bd4d-fb7e0fcad044-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"ce24ae83-459d-4410-bd4d-fb7e0fcad044\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.796588 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"b7434cde-890e-42d9-9b5c-bbd60a188517","Type":"ContainerStarted","Data":"e6f41b2eba86e2ad1ad67b7920bf775f201acf4a1d8d43b7f3ad7c19edd16e8f"} Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.796752 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.800421 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.808257 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8twx\" (UniqueName: \"kubernetes.io/projected/ce24ae83-459d-4410-bd4d-fb7e0fcad044-kube-api-access-v8twx\") pod \"nova-metadata-0\" (UID: \"ce24ae83-459d-4410-bd4d-fb7e0fcad044\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.815175 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.815526 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.820128 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-public-svc\"" Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.820536 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-external-config-data\"" Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.820880 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ce24ae83-459d-4410-bd4d-fb7e0fcad044-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"ce24ae83-459d-4410-bd4d-fb7e0fcad044\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.848414 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.863450 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jc7x\" (UniqueName: \"kubernetes.io/projected/284dc632-d111-40d1-97a9-f6e78aa92ce7-kube-api-access-2jc7x\") pod \"nova-cell0-conductor-0\" (UID: \"284dc632-d111-40d1-97a9-f6e78aa92ce7\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.863797 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/284dc632-d111-40d1-97a9-f6e78aa92ce7-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"284dc632-d111-40d1-97a9-f6e78aa92ce7\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.863856 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/284dc632-d111-40d1-97a9-f6e78aa92ce7-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"284dc632-d111-40d1-97a9-f6e78aa92ce7\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.866542 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"ovsdbserver-sb-0\" (UID: \"5f9a749e-2dbb-409d-b935-4f2891d43397\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.869109 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.917943 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/memcached-0" podUID="727aa42a-e1c1-427b-9912-f64504161039" containerName="memcached" probeResult="failure" output="dial tcp 10.217.1.65:11211: i/o timeout" Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.970334 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/25abef41-bfd4-4436-a8c8-262247bd936f-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"25abef41-bfd4-4436-a8c8-262247bd936f\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.970464 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/25abef41-bfd4-4436-a8c8-262247bd936f-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"25abef41-bfd4-4436-a8c8-262247bd936f\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.970732 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2jc7x\" (UniqueName: \"kubernetes.io/projected/284dc632-d111-40d1-97a9-f6e78aa92ce7-kube-api-access-2jc7x\") pod \"nova-cell0-conductor-0\" (UID: \"284dc632-d111-40d1-97a9-f6e78aa92ce7\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.970957 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/25abef41-bfd4-4436-a8c8-262247bd936f-config-data\") pod \"glance-default-external-api-0\" (UID: \"25abef41-bfd4-4436-a8c8-262247bd936f\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.971527 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"glance-default-external-api-0\" (UID: \"25abef41-bfd4-4436-a8c8-262247bd936f\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.971739 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brvxt\" (UniqueName: \"kubernetes.io/projected/25abef41-bfd4-4436-a8c8-262247bd936f-kube-api-access-brvxt\") pod \"glance-default-external-api-0\" (UID: \"25abef41-bfd4-4436-a8c8-262247bd936f\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.972691 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/284dc632-d111-40d1-97a9-f6e78aa92ce7-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"284dc632-d111-40d1-97a9-f6e78aa92ce7\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.974247 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/25abef41-bfd4-4436-a8c8-262247bd936f-scripts\") pod \"glance-default-external-api-0\" (UID: \"25abef41-bfd4-4436-a8c8-262247bd936f\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.974304 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/25abef41-bfd4-4436-a8c8-262247bd936f-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"25abef41-bfd4-4436-a8c8-262247bd936f\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.974352 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/25abef41-bfd4-4436-a8c8-262247bd936f-logs\") pod \"glance-default-external-api-0\" (UID: \"25abef41-bfd4-4436-a8c8-262247bd936f\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:00:43 crc kubenswrapper[5120]: I0316 17:00:43.974395 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/284dc632-d111-40d1-97a9-f6e78aa92ce7-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"284dc632-d111-40d1-97a9-f6e78aa92ce7\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 17:00:44 crc kubenswrapper[5120]: I0316 17:00:44.006832 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/284dc632-d111-40d1-97a9-f6e78aa92ce7-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"284dc632-d111-40d1-97a9-f6e78aa92ce7\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 17:00:44 crc kubenswrapper[5120]: I0316 17:00:44.017806 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jc7x\" (UniqueName: \"kubernetes.io/projected/284dc632-d111-40d1-97a9-f6e78aa92ce7-kube-api-access-2jc7x\") pod \"nova-cell0-conductor-0\" (UID: \"284dc632-d111-40d1-97a9-f6e78aa92ce7\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 17:00:44 crc kubenswrapper[5120]: I0316 17:00:44.054983 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/284dc632-d111-40d1-97a9-f6e78aa92ce7-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"284dc632-d111-40d1-97a9-f6e78aa92ce7\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 17:00:44 crc kubenswrapper[5120]: I0316 17:00:44.082204 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/25abef41-bfd4-4436-a8c8-262247bd936f-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"25abef41-bfd4-4436-a8c8-262247bd936f\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:00:44 crc kubenswrapper[5120]: I0316 17:00:44.082997 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/25abef41-bfd4-4436-a8c8-262247bd936f-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"25abef41-bfd4-4436-a8c8-262247bd936f\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:00:44 crc kubenswrapper[5120]: I0316 17:00:44.083199 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/25abef41-bfd4-4436-a8c8-262247bd936f-config-data\") pod \"glance-default-external-api-0\" (UID: \"25abef41-bfd4-4436-a8c8-262247bd936f\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:00:44 crc kubenswrapper[5120]: I0316 17:00:44.083394 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"glance-default-external-api-0\" (UID: \"25abef41-bfd4-4436-a8c8-262247bd936f\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:00:44 crc kubenswrapper[5120]: I0316 17:00:44.083551 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-brvxt\" (UniqueName: \"kubernetes.io/projected/25abef41-bfd4-4436-a8c8-262247bd936f-kube-api-access-brvxt\") pod \"glance-default-external-api-0\" (UID: \"25abef41-bfd4-4436-a8c8-262247bd936f\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:00:44 crc kubenswrapper[5120]: I0316 17:00:44.083641 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/25abef41-bfd4-4436-a8c8-262247bd936f-scripts\") pod \"glance-default-external-api-0\" (UID: \"25abef41-bfd4-4436-a8c8-262247bd936f\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:00:44 crc kubenswrapper[5120]: I0316 17:00:44.083718 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/25abef41-bfd4-4436-a8c8-262247bd936f-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"25abef41-bfd4-4436-a8c8-262247bd936f\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:00:44 crc kubenswrapper[5120]: I0316 17:00:44.083752 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/25abef41-bfd4-4436-a8c8-262247bd936f-logs\") pod \"glance-default-external-api-0\" (UID: \"25abef41-bfd4-4436-a8c8-262247bd936f\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:00:44 crc kubenswrapper[5120]: I0316 17:00:44.085518 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/25abef41-bfd4-4436-a8c8-262247bd936f-logs\") pod \"glance-default-external-api-0\" (UID: \"25abef41-bfd4-4436-a8c8-262247bd936f\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:00:44 crc kubenswrapper[5120]: I0316 17:00:44.088124 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"glance-default-external-api-0\" (UID: \"25abef41-bfd4-4436-a8c8-262247bd936f\") device mount path \"/mnt/openstack/pv05\"" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:00:44 crc kubenswrapper[5120]: I0316 17:00:44.088634 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/25abef41-bfd4-4436-a8c8-262247bd936f-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"25abef41-bfd4-4436-a8c8-262247bd936f\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:00:44 crc kubenswrapper[5120]: I0316 17:00:44.103559 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/25abef41-bfd4-4436-a8c8-262247bd936f-scripts\") pod \"glance-default-external-api-0\" (UID: \"25abef41-bfd4-4436-a8c8-262247bd936f\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:00:44 crc kubenswrapper[5120]: I0316 17:00:44.104090 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/25abef41-bfd4-4436-a8c8-262247bd936f-config-data\") pod \"glance-default-external-api-0\" (UID: \"25abef41-bfd4-4436-a8c8-262247bd936f\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:00:44 crc kubenswrapper[5120]: I0316 17:00:44.113221 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-brvxt\" (UniqueName: \"kubernetes.io/projected/25abef41-bfd4-4436-a8c8-262247bd936f-kube-api-access-brvxt\") pod \"glance-default-external-api-0\" (UID: \"25abef41-bfd4-4436-a8c8-262247bd936f\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:00:44 crc kubenswrapper[5120]: I0316 17:00:44.126070 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/25abef41-bfd4-4436-a8c8-262247bd936f-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"25abef41-bfd4-4436-a8c8-262247bd936f\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:00:44 crc kubenswrapper[5120]: I0316 17:00:44.127315 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/25abef41-bfd4-4436-a8c8-262247bd936f-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"25abef41-bfd4-4436-a8c8-262247bd936f\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:00:44 crc kubenswrapper[5120]: I0316 17:00:44.155106 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/55f7f374-c6b2-422b-90bd-a7dcc936e74f-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "55f7f374-c6b2-422b-90bd-a7dcc936e74f" (UID: "55f7f374-c6b2-422b-90bd-a7dcc936e74f"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:44 crc kubenswrapper[5120]: I0316 17:00:44.204935 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/55f7f374-c6b2-422b-90bd-a7dcc936e74f-config-data" (OuterVolumeSpecName: "config-data") pod "55f7f374-c6b2-422b-90bd-a7dcc936e74f" (UID: "55f7f374-c6b2-422b-90bd-a7dcc936e74f"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:44 crc kubenswrapper[5120]: I0316 17:00:44.214149 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/55f7f374-c6b2-422b-90bd-a7dcc936e74f-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "55f7f374-c6b2-422b-90bd-a7dcc936e74f" (UID: "55f7f374-c6b2-422b-90bd-a7dcc936e74f"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:44 crc kubenswrapper[5120]: I0316 17:00:44.214690 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/55f7f374-c6b2-422b-90bd-a7dcc936e74f-combined-ca-bundle\") pod \"55f7f374-c6b2-422b-90bd-a7dcc936e74f\" (UID: \"55f7f374-c6b2-422b-90bd-a7dcc936e74f\") " Mar 16 17:00:44 crc kubenswrapper[5120]: I0316 17:00:44.215495 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/55f7f374-c6b2-422b-90bd-a7dcc936e74f-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:44 crc kubenswrapper[5120]: I0316 17:00:44.215583 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/55f7f374-c6b2-422b-90bd-a7dcc936e74f-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:44 crc kubenswrapper[5120]: W0316 17:00:44.215696 5120 empty_dir.go:511] Warning: Unmount skipped because path does not exist: /var/lib/kubelet/pods/55f7f374-c6b2-422b-90bd-a7dcc936e74f/volumes/kubernetes.io~secret/combined-ca-bundle Mar 16 17:00:44 crc kubenswrapper[5120]: I0316 17:00:44.215862 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/55f7f374-c6b2-422b-90bd-a7dcc936e74f-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "55f7f374-c6b2-422b-90bd-a7dcc936e74f" (UID: "55f7f374-c6b2-422b-90bd-a7dcc936e74f"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:44 crc kubenswrapper[5120]: I0316 17:00:44.303022 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"glance-default-external-api-0\" (UID: \"25abef41-bfd4-4436-a8c8-262247bd936f\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:00:44 crc kubenswrapper[5120]: I0316 17:00:44.317586 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/55f7f374-c6b2-422b-90bd-a7dcc936e74f-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:44 crc kubenswrapper[5120]: I0316 17:00:44.454233 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 17:00:44 crc kubenswrapper[5120]: I0316 17:00:44.471049 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:00:44 crc kubenswrapper[5120]: I0316 17:00:44.635497 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 17:00:44 crc kubenswrapper[5120]: I0316 17:00:44.662593 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 17:00:44 crc kubenswrapper[5120]: I0316 17:00:44.702547 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="07f2b57d-24dd-44a8-9399-3d3df8cd1a86" path="/var/lib/kubelet/pods/07f2b57d-24dd-44a8-9399-3d3df8cd1a86/volumes" Mar 16 17:00:44 crc kubenswrapper[5120]: I0316 17:00:44.703903 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="447b243b-6b80-4883-9844-f49d3f2f4a22" path="/var/lib/kubelet/pods/447b243b-6b80-4883-9844-f49d3f2f4a22/volumes" Mar 16 17:00:44 crc kubenswrapper[5120]: I0316 17:00:44.705095 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5e3627d3-225e-4cd9-b5fb-9a27c888e1e1" path="/var/lib/kubelet/pods/5e3627d3-225e-4cd9-b5fb-9a27c888e1e1/volumes" Mar 16 17:00:44 crc kubenswrapper[5120]: I0316 17:00:44.706496 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7712130b-a000-4541-a1b1-7442adb622f7" path="/var/lib/kubelet/pods/7712130b-a000-4541-a1b1-7442adb622f7/volumes" Mar 16 17:00:44 crc kubenswrapper[5120]: I0316 17:00:44.708173 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e2ad712e-f6f5-4942-94b9-635bbc53da15" path="/var/lib/kubelet/pods/e2ad712e-f6f5-4942-94b9-635bbc53da15/volumes" Mar 16 17:00:44 crc kubenswrapper[5120]: I0316 17:00:44.833746 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-765bfffb44-jrj28" event={"ID":"ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801","Type":"ContainerStarted","Data":"f0a293cfac604dbfdd5f557ac486b40c3fa465c6d265faa6cb8381ab784fb73a"} Mar 16 17:00:44 crc kubenswrapper[5120]: I0316 17:00:44.867824 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 17:00:44 crc kubenswrapper[5120]: I0316 17:00:44.884634 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 17:00:44 crc kubenswrapper[5120]: I0316 17:00:44.892640 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"e5f68c9e-894a-4eac-90fc-be12f8c49913","Type":"ContainerStarted","Data":"edb55f5f325f50effe51e12af19adc64840ade86dc6a34682a72f5cc4f038341"} Mar 16 17:00:44 crc kubenswrapper[5120]: I0316 17:00:44.927851 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 17:00:44 crc kubenswrapper[5120]: I0316 17:00:44.956557 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 17:00:44 crc kubenswrapper[5120]: I0316 17:00:44.956689 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:00:44 crc kubenswrapper[5120]: I0316 17:00:44.959031 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-internal-config-data\"" Mar 16 17:00:44 crc kubenswrapper[5120]: I0316 17:00:44.959260 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-internal-svc\"" Mar 16 17:00:44 crc kubenswrapper[5120]: I0316 17:00:44.963614 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-5f9fc84dc4-7nfss" event={"ID":"bdbf2033-4671-473e-9ede-ce2611d51fac","Type":"ContainerStarted","Data":"99fb8edbf3d8a29e8de3b518723f36b5914f77d494d2927272dec17802ad898c"} Mar 16 17:00:44 crc kubenswrapper[5120]: I0316 17:00:44.964079 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/keystone-5f9fc84dc4-7nfss" Mar 16 17:00:44 crc kubenswrapper[5120]: I0316 17:00:44.966002 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"61d14db6-7d33-4e5f-8252-844441e519d7","Type":"ContainerStarted","Data":"82fa72826c06109e8772cf9c98727021004549d688ca10308fa6a52578eadb84"} Mar 16 17:00:44 crc kubenswrapper[5120]: I0316 17:00:44.967152 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"2cadcb9e-2a3b-4c14-8fcc-39939326678f","Type":"ContainerStarted","Data":"5ad1d16b0dfc1d11fbbfc7b23cd6a94811d6f0a510754599ea0450ef4d613e27"} Mar 16 17:00:44 crc kubenswrapper[5120]: I0316 17:00:44.968506 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-8579c6748-8wfdq" event={"ID":"6f3cdac2-9246-455c-b05a-347b4db60b7f","Type":"ContainerStarted","Data":"af6dfa5892c321c1794bd9331bf1e07d8de94fb188e1507acc85ea5149c14c24"} Mar 16 17:00:44 crc kubenswrapper[5120]: I0316 17:00:44.971097 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"30bfa4fc-b416-4f16-b673-158d4a8c552a","Type":"ContainerDied","Data":"de3ab1da21486e864021f0e8b93032ef66588bc2b8c3bfb0aeb0666a984fcf6a"} Mar 16 17:00:44 crc kubenswrapper[5120]: I0316 17:00:44.971123 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="de3ab1da21486e864021f0e8b93032ef66588bc2b8c3bfb0aeb0666a984fcf6a" Mar 16 17:00:45 crc kubenswrapper[5120]: I0316 17:00:45.007262 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-6f96bb5df9-spfxv" event={"ID":"fb7a2068-5a18-4c7b-92d0-364f371d59df","Type":"ContainerStarted","Data":"98b7269dea85c50b3653f02d53c97085506d9cf74a457e4aee7380d97d30f5ed"} Mar 16 17:00:45 crc kubenswrapper[5120]: I0316 17:00:45.011557 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-5f9fc84dc4-7nfss" podStartSLOduration=9.011535822 podStartE2EDuration="9.011535822s" podCreationTimestamp="2026-03-16 17:00:36 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:00:45.003210234 +0000 UTC m=+5347.157141891" watchObservedRunningTime="2026-03-16 17:00:45.011535822 +0000 UTC m=+5347.165467479" Mar 16 17:00:45 crc kubenswrapper[5120]: I0316 17:00:45.021820 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:00:45 crc kubenswrapper[5120]: I0316 17:00:45.022362 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:00:45 crc kubenswrapper[5120]: I0316 17:00:45.033934 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"9a5a470f-6027-43b1-aa7b-74626f464c7c","Type":"ContainerStarted","Data":"9eb68b319a03566f195605fb474b25b92762e37cf88586605010af31f02810fe"} Mar 16 17:00:45 crc kubenswrapper[5120]: I0316 17:00:45.040270 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-worker-6f96bb5df9-spfxv" podStartSLOduration=10.040250338 podStartE2EDuration="10.040250338s" podCreationTimestamp="2026-03-16 17:00:35 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:00:45.03482063 +0000 UTC m=+5347.188752287" watchObservedRunningTime="2026-03-16 17:00:45.040250338 +0000 UTC m=+5347.194181995" Mar 16 17:00:45 crc kubenswrapper[5120]: I0316 17:00:45.056888 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0fdecce9-8602-457d-8eec-c97b359170dd-scripts\") pod \"glance-default-internal-api-0\" (UID: \"0fdecce9-8602-457d-8eec-c97b359170dd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:00:45 crc kubenswrapper[5120]: I0316 17:00:45.060846 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"glance-default-internal-api-0\" (UID: \"0fdecce9-8602-457d-8eec-c97b359170dd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:00:45 crc kubenswrapper[5120]: I0316 17:00:45.061033 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0fdecce9-8602-457d-8eec-c97b359170dd-logs\") pod \"glance-default-internal-api-0\" (UID: \"0fdecce9-8602-457d-8eec-c97b359170dd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:00:45 crc kubenswrapper[5120]: I0316 17:00:45.061172 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0fdecce9-8602-457d-8eec-c97b359170dd-config-data\") pod \"glance-default-internal-api-0\" (UID: \"0fdecce9-8602-457d-8eec-c97b359170dd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:00:45 crc kubenswrapper[5120]: I0316 17:00:45.061253 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/0fdecce9-8602-457d-8eec-c97b359170dd-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"0fdecce9-8602-457d-8eec-c97b359170dd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:00:45 crc kubenswrapper[5120]: I0316 17:00:45.061294 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0fdecce9-8602-457d-8eec-c97b359170dd-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"0fdecce9-8602-457d-8eec-c97b359170dd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:00:45 crc kubenswrapper[5120]: I0316 17:00:45.061689 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvgxt\" (UniqueName: \"kubernetes.io/projected/0fdecce9-8602-457d-8eec-c97b359170dd-kube-api-access-wvgxt\") pod \"glance-default-internal-api-0\" (UID: \"0fdecce9-8602-457d-8eec-c97b359170dd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:00:45 crc kubenswrapper[5120]: I0316 17:00:45.062043 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/0fdecce9-8602-457d-8eec-c97b359170dd-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"0fdecce9-8602-457d-8eec-c97b359170dd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:00:45 crc kubenswrapper[5120]: I0316 17:00:45.062104 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"ab76f235-6a48-4935-a2d5-5a79806c416c","Type":"ContainerStarted","Data":"4bdb6777c658208e4e4a635c2814ef42493799e18877cf4be4e6b11c872da7e3"} Mar 16 17:00:45 crc kubenswrapper[5120]: I0316 17:00:45.109554 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-57589895fd-84tvt" event={"ID":"08933bb0-40b0-4b92-b9d1-af46cdcc8aad","Type":"ContainerStarted","Data":"6c5ab5c25f8f32671ed1d3f8ef0839c556632b36cd0e8b390fd2983c34cf090a"} Mar 16 17:00:45 crc kubenswrapper[5120]: I0316 17:00:45.138993 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 17:00:45 crc kubenswrapper[5120]: I0316 17:00:45.141742 5120 generic.go:358] "Generic (PLEG): container finished" podID="a19b5964-8116-49bd-9181-8eb2fe61703e" containerID="31aa48ae9a695364d87a26a4847032706a8126fc6a90204e85b5a9a0b0bde237" exitCode=0 Mar 16 17:00:45 crc kubenswrapper[5120]: I0316 17:00:45.141891 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"a19b5964-8116-49bd-9181-8eb2fe61703e","Type":"ContainerDied","Data":"31aa48ae9a695364d87a26a4847032706a8126fc6a90204e85b5a9a0b0bde237"} Mar 16 17:00:45 crc kubenswrapper[5120]: I0316 17:00:45.141923 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"a19b5964-8116-49bd-9181-8eb2fe61703e","Type":"ContainerDied","Data":"1ee9f725def2526b0bade2ce22c6c3b693cef85bec133f921e757c77db5af54f"} Mar 16 17:00:45 crc kubenswrapper[5120]: I0316 17:00:45.141941 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1ee9f725def2526b0bade2ce22c6c3b693cef85bec133f921e757c77db5af54f" Mar 16 17:00:45 crc kubenswrapper[5120]: I0316 17:00:45.155746 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:00:45 crc kubenswrapper[5120]: I0316 17:00:45.161621 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-7dcbb9bcc5-6bd78"] Mar 16 17:00:45 crc kubenswrapper[5120]: I0316 17:00:45.161928 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-7dcbb9bcc5-6bd78" podUID="e956ba16-b745-4928-b574-a942ab68fd58" containerName="barbican-worker-log" containerID="cri-o://190c300742841bbd5e9c6e0af99eef15ed79cfe6ad0596b1173acce50cbf6430" gracePeriod=30 Mar 16 17:00:45 crc kubenswrapper[5120]: I0316 17:00:45.162461 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-7dcbb9bcc5-6bd78" podUID="e956ba16-b745-4928-b574-a942ab68fd58" containerName="barbican-worker" containerID="cri-o://7cedd4f074f018190db9d89f7269449dd1c5b8a2dd44584e7e8fefcf284b2d18" gracePeriod=30 Mar 16 17:00:45 crc kubenswrapper[5120]: I0316 17:00:45.165234 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0fdecce9-8602-457d-8eec-c97b359170dd-scripts\") pod \"glance-default-internal-api-0\" (UID: \"0fdecce9-8602-457d-8eec-c97b359170dd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:00:45 crc kubenswrapper[5120]: I0316 17:00:45.165440 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"glance-default-internal-api-0\" (UID: \"0fdecce9-8602-457d-8eec-c97b359170dd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:00:45 crc kubenswrapper[5120]: I0316 17:00:45.165480 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0fdecce9-8602-457d-8eec-c97b359170dd-logs\") pod \"glance-default-internal-api-0\" (UID: \"0fdecce9-8602-457d-8eec-c97b359170dd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:00:45 crc kubenswrapper[5120]: I0316 17:00:45.166238 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0fdecce9-8602-457d-8eec-c97b359170dd-logs\") pod \"glance-default-internal-api-0\" (UID: \"0fdecce9-8602-457d-8eec-c97b359170dd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:00:45 crc kubenswrapper[5120]: I0316 17:00:45.166632 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"glance-default-internal-api-0\" (UID: \"0fdecce9-8602-457d-8eec-c97b359170dd\") device mount path \"/mnt/openstack/pv06\"" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:00:45 crc kubenswrapper[5120]: I0316 17:00:45.166668 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0fdecce9-8602-457d-8eec-c97b359170dd-config-data\") pod \"glance-default-internal-api-0\" (UID: \"0fdecce9-8602-457d-8eec-c97b359170dd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:00:45 crc kubenswrapper[5120]: I0316 17:00:45.168454 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/0fdecce9-8602-457d-8eec-c97b359170dd-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"0fdecce9-8602-457d-8eec-c97b359170dd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:00:45 crc kubenswrapper[5120]: I0316 17:00:45.168511 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0fdecce9-8602-457d-8eec-c97b359170dd-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"0fdecce9-8602-457d-8eec-c97b359170dd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:00:45 crc kubenswrapper[5120]: I0316 17:00:45.168695 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wvgxt\" (UniqueName: \"kubernetes.io/projected/0fdecce9-8602-457d-8eec-c97b359170dd-kube-api-access-wvgxt\") pod \"glance-default-internal-api-0\" (UID: \"0fdecce9-8602-457d-8eec-c97b359170dd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:00:45 crc kubenswrapper[5120]: I0316 17:00:45.169021 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/0fdecce9-8602-457d-8eec-c97b359170dd-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"0fdecce9-8602-457d-8eec-c97b359170dd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:00:45 crc kubenswrapper[5120]: I0316 17:00:45.171275 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/0fdecce9-8602-457d-8eec-c97b359170dd-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"0fdecce9-8602-457d-8eec-c97b359170dd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:00:45 crc kubenswrapper[5120]: I0316 17:00:45.199227 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:00:45 crc kubenswrapper[5120]: I0316 17:00:45.200385 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:00:45 crc kubenswrapper[5120]: I0316 17:00:45.211868 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvgxt\" (UniqueName: \"kubernetes.io/projected/0fdecce9-8602-457d-8eec-c97b359170dd-kube-api-access-wvgxt\") pod \"glance-default-internal-api-0\" (UID: \"0fdecce9-8602-457d-8eec-c97b359170dd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:00:45 crc kubenswrapper[5120]: I0316 17:00:45.213889 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0fdecce9-8602-457d-8eec-c97b359170dd-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"0fdecce9-8602-457d-8eec-c97b359170dd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:00:45 crc kubenswrapper[5120]: I0316 17:00:45.217292 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/0fdecce9-8602-457d-8eec-c97b359170dd-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"0fdecce9-8602-457d-8eec-c97b359170dd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:00:45 crc kubenswrapper[5120]: I0316 17:00:45.230491 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0fdecce9-8602-457d-8eec-c97b359170dd-scripts\") pod \"glance-default-internal-api-0\" (UID: \"0fdecce9-8602-457d-8eec-c97b359170dd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:00:45 crc kubenswrapper[5120]: I0316 17:00:45.233709 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0fdecce9-8602-457d-8eec-c97b359170dd-config-data\") pod \"glance-default-internal-api-0\" (UID: \"0fdecce9-8602-457d-8eec-c97b359170dd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:00:45 crc kubenswrapper[5120]: I0316 17:00:45.379563 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/30bfa4fc-b416-4f16-b673-158d4a8c552a-ceilometer-tls-certs\") pod \"30bfa4fc-b416-4f16-b673-158d4a8c552a\" (UID: \"30bfa4fc-b416-4f16-b673-158d4a8c552a\") " Mar 16 17:00:45 crc kubenswrapper[5120]: I0316 17:00:45.380181 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/30bfa4fc-b416-4f16-b673-158d4a8c552a-combined-ca-bundle\") pod \"30bfa4fc-b416-4f16-b673-158d4a8c552a\" (UID: \"30bfa4fc-b416-4f16-b673-158d4a8c552a\") " Mar 16 17:00:45 crc kubenswrapper[5120]: I0316 17:00:45.380259 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/30bfa4fc-b416-4f16-b673-158d4a8c552a-scripts\") pod \"30bfa4fc-b416-4f16-b673-158d4a8c552a\" (UID: \"30bfa4fc-b416-4f16-b673-158d4a8c552a\") " Mar 16 17:00:45 crc kubenswrapper[5120]: I0316 17:00:45.380773 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rtkkq\" (UniqueName: \"kubernetes.io/projected/a19b5964-8116-49bd-9181-8eb2fe61703e-kube-api-access-rtkkq\") pod \"a19b5964-8116-49bd-9181-8eb2fe61703e\" (UID: \"a19b5964-8116-49bd-9181-8eb2fe61703e\") " Mar 16 17:00:45 crc kubenswrapper[5120]: I0316 17:00:45.380870 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a19b5964-8116-49bd-9181-8eb2fe61703e-config-data\") pod \"a19b5964-8116-49bd-9181-8eb2fe61703e\" (UID: \"a19b5964-8116-49bd-9181-8eb2fe61703e\") " Mar 16 17:00:45 crc kubenswrapper[5120]: I0316 17:00:45.380900 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/30bfa4fc-b416-4f16-b673-158d4a8c552a-run-httpd\") pod \"30bfa4fc-b416-4f16-b673-158d4a8c552a\" (UID: \"30bfa4fc-b416-4f16-b673-158d4a8c552a\") " Mar 16 17:00:45 crc kubenswrapper[5120]: I0316 17:00:45.381112 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/30bfa4fc-b416-4f16-b673-158d4a8c552a-sg-core-conf-yaml\") pod \"30bfa4fc-b416-4f16-b673-158d4a8c552a\" (UID: \"30bfa4fc-b416-4f16-b673-158d4a8c552a\") " Mar 16 17:00:45 crc kubenswrapper[5120]: I0316 17:00:45.381198 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a19b5964-8116-49bd-9181-8eb2fe61703e-combined-ca-bundle\") pod \"a19b5964-8116-49bd-9181-8eb2fe61703e\" (UID: \"a19b5964-8116-49bd-9181-8eb2fe61703e\") " Mar 16 17:00:45 crc kubenswrapper[5120]: I0316 17:00:45.381264 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bcvgz\" (UniqueName: \"kubernetes.io/projected/30bfa4fc-b416-4f16-b673-158d4a8c552a-kube-api-access-bcvgz\") pod \"30bfa4fc-b416-4f16-b673-158d4a8c552a\" (UID: \"30bfa4fc-b416-4f16-b673-158d4a8c552a\") " Mar 16 17:00:45 crc kubenswrapper[5120]: I0316 17:00:45.381312 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/30bfa4fc-b416-4f16-b673-158d4a8c552a-log-httpd\") pod \"30bfa4fc-b416-4f16-b673-158d4a8c552a\" (UID: \"30bfa4fc-b416-4f16-b673-158d4a8c552a\") " Mar 16 17:00:45 crc kubenswrapper[5120]: I0316 17:00:45.381401 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/30bfa4fc-b416-4f16-b673-158d4a8c552a-config-data\") pod \"30bfa4fc-b416-4f16-b673-158d4a8c552a\" (UID: \"30bfa4fc-b416-4f16-b673-158d4a8c552a\") " Mar 16 17:00:45 crc kubenswrapper[5120]: I0316 17:00:45.391671 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/30bfa4fc-b416-4f16-b673-158d4a8c552a-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "30bfa4fc-b416-4f16-b673-158d4a8c552a" (UID: "30bfa4fc-b416-4f16-b673-158d4a8c552a"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:00:45 crc kubenswrapper[5120]: I0316 17:00:45.392178 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/30bfa4fc-b416-4f16-b673-158d4a8c552a-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "30bfa4fc-b416-4f16-b673-158d4a8c552a" (UID: "30bfa4fc-b416-4f16-b673-158d4a8c552a"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:00:45 crc kubenswrapper[5120]: I0316 17:00:45.403115 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30bfa4fc-b416-4f16-b673-158d4a8c552a-kube-api-access-bcvgz" (OuterVolumeSpecName: "kube-api-access-bcvgz") pod "30bfa4fc-b416-4f16-b673-158d4a8c552a" (UID: "30bfa4fc-b416-4f16-b673-158d4a8c552a"). InnerVolumeSpecName "kube-api-access-bcvgz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:00:45 crc kubenswrapper[5120]: I0316 17:00:45.443935 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/30bfa4fc-b416-4f16-b673-158d4a8c552a-scripts" (OuterVolumeSpecName: "scripts") pod "30bfa4fc-b416-4f16-b673-158d4a8c552a" (UID: "30bfa4fc-b416-4f16-b673-158d4a8c552a"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:45 crc kubenswrapper[5120]: I0316 17:00:45.472651 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a19b5964-8116-49bd-9181-8eb2fe61703e-kube-api-access-rtkkq" (OuterVolumeSpecName: "kube-api-access-rtkkq") pod "a19b5964-8116-49bd-9181-8eb2fe61703e" (UID: "a19b5964-8116-49bd-9181-8eb2fe61703e"). InnerVolumeSpecName "kube-api-access-rtkkq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:00:45 crc kubenswrapper[5120]: I0316 17:00:45.489331 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bcvgz\" (UniqueName: \"kubernetes.io/projected/30bfa4fc-b416-4f16-b673-158d4a8c552a-kube-api-access-bcvgz\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:45 crc kubenswrapper[5120]: I0316 17:00:45.489373 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/30bfa4fc-b416-4f16-b673-158d4a8c552a-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:45 crc kubenswrapper[5120]: I0316 17:00:45.489391 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/30bfa4fc-b416-4f16-b673-158d4a8c552a-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:45 crc kubenswrapper[5120]: I0316 17:00:45.489405 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rtkkq\" (UniqueName: \"kubernetes.io/projected/a19b5964-8116-49bd-9181-8eb2fe61703e-kube-api-access-rtkkq\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:45 crc kubenswrapper[5120]: I0316 17:00:45.489416 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/30bfa4fc-b416-4f16-b673-158d4a8c552a-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:45 crc kubenswrapper[5120]: I0316 17:00:45.668098 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 17:00:45 crc kubenswrapper[5120]: I0316 17:00:45.978299 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"glance-default-internal-api-0\" (UID: \"0fdecce9-8602-457d-8eec-c97b359170dd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:00:46 crc kubenswrapper[5120]: E0316 17:00:46.025943 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="667c0b4c5c210d8d2e00d4c0137f5f162ac03573aade3cb4dcbc340cb9470ded" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Mar 16 17:00:46 crc kubenswrapper[5120]: E0316 17:00:46.033147 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="667c0b4c5c210d8d2e00d4c0137f5f162ac03573aade3cb4dcbc340cb9470ded" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Mar 16 17:00:46 crc kubenswrapper[5120]: E0316 17:00:46.049467 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="667c0b4c5c210d8d2e00d4c0137f5f162ac03573aade3cb4dcbc340cb9470ded" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Mar 16 17:00:46 crc kubenswrapper[5120]: E0316 17:00:46.049541 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/ovn-northd-0" podUID="a519f6d6-0bc7-43f3-9ad7-98a44f627488" containerName="ovn-northd" probeResult="unknown" Mar 16 17:00:46 crc kubenswrapper[5120]: I0316 17:00:46.144735 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:00:46 crc kubenswrapper[5120]: I0316 17:00:46.210583 5120 generic.go:358] "Generic (PLEG): container finished" podID="d4c74a5c-86a6-4bcf-b660-10a42c6a2be1" containerID="6de8bdd5fb2544346e3cbeb0ae90bbd7bd95389cd023b6a97824529be2e5589f" exitCode=0 Mar 16 17:00:46 crc kubenswrapper[5120]: I0316 17:00:46.210720 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-5d8cb95448-4wwn9" event={"ID":"d4c74a5c-86a6-4bcf-b660-10a42c6a2be1","Type":"ContainerDied","Data":"6de8bdd5fb2544346e3cbeb0ae90bbd7bd95389cd023b6a97824529be2e5589f"} Mar 16 17:00:46 crc kubenswrapper[5120]: I0316 17:00:46.219224 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"61d14db6-7d33-4e5f-8252-844441e519d7","Type":"ContainerStarted","Data":"09ec4943c048e912f15eb43af459b9cf3ee8d9cf445b19b9f73bee58b9f168b2"} Mar 16 17:00:46 crc kubenswrapper[5120]: I0316 17:00:46.219321 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 17:00:46 crc kubenswrapper[5120]: I0316 17:00:46.221347 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 17:00:46 crc kubenswrapper[5120]: I0316 17:00:46.243521 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-8579c6748-8wfdq" event={"ID":"6f3cdac2-9246-455c-b05a-347b4db60b7f","Type":"ContainerStarted","Data":"a42992bd1d9cad8a2c4750ffb36344cddb046a7e90453c31912c59e31473304d"} Mar 16 17:00:46 crc kubenswrapper[5120]: I0316 17:00:46.246329 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-8579c6748-8wfdq" Mar 16 17:00:46 crc kubenswrapper[5120]: I0316 17:00:46.246381 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-8579c6748-8wfdq" Mar 16 17:00:46 crc kubenswrapper[5120]: I0316 17:00:46.259969 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"d0bd5c73-646f-42e2-885f-25fc4835ee47","Type":"ContainerStarted","Data":"8be0da7a54d695cbc009d1b94bbd227230732d4c227496afa2a45a9ba96f06ec"} Mar 16 17:00:46 crc kubenswrapper[5120]: I0316 17:00:46.260206 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/memcached-0" Mar 16 17:00:46 crc kubenswrapper[5120]: I0316 17:00:46.266606 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podStartSLOduration=4.266589053 podStartE2EDuration="4.266589053s" podCreationTimestamp="2026-03-16 17:00:42 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:00:46.251861711 +0000 UTC m=+5348.405793368" watchObservedRunningTime="2026-03-16 17:00:46.266589053 +0000 UTC m=+5348.420520710" Mar 16 17:00:46 crc kubenswrapper[5120]: I0316 17:00:46.287146 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"9a5a470f-6027-43b1-aa7b-74626f464c7c","Type":"ContainerStarted","Data":"aff7b5c38018439aeda171febf4dc85956a973bc799b03a28da649918795fbf3"} Mar 16 17:00:46 crc kubenswrapper[5120]: I0316 17:00:46.290915 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a19b5964-8116-49bd-9181-8eb2fe61703e-config-data" (OuterVolumeSpecName: "config-data") pod "a19b5964-8116-49bd-9181-8eb2fe61703e" (UID: "a19b5964-8116-49bd-9181-8eb2fe61703e"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:46 crc kubenswrapper[5120]: I0316 17:00:46.293116 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"5f9a749e-2dbb-409d-b935-4f2891d43397","Type":"ContainerStarted","Data":"0934ba3b30d73ace883906f71cb2122520018c55bc3b6c3cc66341b6e1a439cd"} Mar 16 17:00:46 crc kubenswrapper[5120]: I0316 17:00:46.293261 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/30bfa4fc-b416-4f16-b673-158d4a8c552a-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "30bfa4fc-b416-4f16-b673-158d4a8c552a" (UID: "30bfa4fc-b416-4f16-b673-158d4a8c552a"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:46 crc kubenswrapper[5120]: I0316 17:00:46.293467 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-api-8579c6748-8wfdq" podStartSLOduration=10.293451049 podStartE2EDuration="10.293451049s" podCreationTimestamp="2026-03-16 17:00:36 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:00:46.272284029 +0000 UTC m=+5348.426215696" watchObservedRunningTime="2026-03-16 17:00:46.293451049 +0000 UTC m=+5348.447382706" Mar 16 17:00:46 crc kubenswrapper[5120]: I0316 17:00:46.322275 5120 generic.go:358] "Generic (PLEG): container finished" podID="e956ba16-b745-4928-b574-a942ab68fd58" containerID="190c300742841bbd5e9c6e0af99eef15ed79cfe6ad0596b1173acce50cbf6430" exitCode=143 Mar 16 17:00:46 crc kubenswrapper[5120]: I0316 17:00:46.322367 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-7dcbb9bcc5-6bd78" event={"ID":"e956ba16-b745-4928-b574-a942ab68fd58","Type":"ContainerDied","Data":"190c300742841bbd5e9c6e0af99eef15ed79cfe6ad0596b1173acce50cbf6430"} Mar 16 17:00:46 crc kubenswrapper[5120]: I0316 17:00:46.324282 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/30bfa4fc-b416-4f16-b673-158d4a8c552a-ceilometer-tls-certs" (OuterVolumeSpecName: "ceilometer-tls-certs") pod "30bfa4fc-b416-4f16-b673-158d4a8c552a" (UID: "30bfa4fc-b416-4f16-b673-158d4a8c552a"). InnerVolumeSpecName "ceilometer-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:46 crc kubenswrapper[5120]: I0316 17:00:46.332680 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/memcached-0" podStartSLOduration=5.332661782 podStartE2EDuration="5.332661782s" podCreationTimestamp="2026-03-16 17:00:41 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:00:46.317649861 +0000 UTC m=+5348.471581538" watchObservedRunningTime="2026-03-16 17:00:46.332661782 +0000 UTC m=+5348.486593439" Mar 16 17:00:46 crc kubenswrapper[5120]: I0316 17:00:46.345264 5120 generic.go:358] "Generic (PLEG): container finished" podID="37a14538-41b4-4840-9f98-8e652da86950" containerID="37f46cae89751e61473cf75d604d271349a611787e527b84be5fb9bfab6bafd4" exitCode=0 Mar 16 17:00:46 crc kubenswrapper[5120]: I0316 17:00:46.345382 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-556c5fbd95-b6tt9" event={"ID":"37a14538-41b4-4840-9f98-8e652da86950","Type":"ContainerDied","Data":"37f46cae89751e61473cf75d604d271349a611787e527b84be5fb9bfab6bafd4"} Mar 16 17:00:46 crc kubenswrapper[5120]: I0316 17:00:46.345408 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-556c5fbd95-b6tt9" event={"ID":"37a14538-41b4-4840-9f98-8e652da86950","Type":"ContainerDied","Data":"c09f6b1669f31ac12e5745f5686aa5e5a77112007acc3e19b80c62182636f77f"} Mar 16 17:00:46 crc kubenswrapper[5120]: I0316 17:00:46.345421 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c09f6b1669f31ac12e5745f5686aa5e5a77112007acc3e19b80c62182636f77f" Mar 16 17:00:46 crc kubenswrapper[5120]: I0316 17:00:46.348727 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a19b5964-8116-49bd-9181-8eb2fe61703e-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:46 crc kubenswrapper[5120]: I0316 17:00:46.349592 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/30bfa4fc-b416-4f16-b673-158d4a8c552a-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:46 crc kubenswrapper[5120]: I0316 17:00:46.349615 5120 reconciler_common.go:299] "Volume detached for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/30bfa4fc-b416-4f16-b673-158d4a8c552a-ceilometer-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:46 crc kubenswrapper[5120]: I0316 17:00:46.356494 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podStartSLOduration=4.356470144 podStartE2EDuration="4.356470144s" podCreationTimestamp="2026-03-16 17:00:42 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:00:46.333664299 +0000 UTC m=+5348.487595976" watchObservedRunningTime="2026-03-16 17:00:46.356470144 +0000 UTC m=+5348.510401801" Mar 16 17:00:46 crc kubenswrapper[5120]: I0316 17:00:46.368116 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a19b5964-8116-49bd-9181-8eb2fe61703e-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "a19b5964-8116-49bd-9181-8eb2fe61703e" (UID: "a19b5964-8116-49bd-9181-8eb2fe61703e"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:46 crc kubenswrapper[5120]: I0316 17:00:46.369585 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"b7434cde-890e-42d9-9b5c-bbd60a188517","Type":"ContainerStarted","Data":"9533e6b54c1aa1c42b7613a7687dc06b42ee15eb1d443ad851370c895955ad91"} Mar 16 17:00:46 crc kubenswrapper[5120]: I0316 17:00:46.369850 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="b7434cde-890e-42d9-9b5c-bbd60a188517" containerName="cinder-api-log" containerID="cri-o://e6f41b2eba86e2ad1ad67b7920bf775f201acf4a1d8d43b7f3ad7c19edd16e8f" gracePeriod=30 Mar 16 17:00:46 crc kubenswrapper[5120]: I0316 17:00:46.369911 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:00:46 crc kubenswrapper[5120]: I0316 17:00:46.369942 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="b7434cde-890e-42d9-9b5c-bbd60a188517" containerName="cinder-api" containerID="cri-o://9533e6b54c1aa1c42b7613a7687dc06b42ee15eb1d443ad851370c895955ad91" gracePeriod=30 Mar 16 17:00:46 crc kubenswrapper[5120]: I0316 17:00:46.404065 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:00:46 crc kubenswrapper[5120]: I0316 17:00:46.410524 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-57589895fd-84tvt" event={"ID":"08933bb0-40b0-4b92-b9d1-af46cdcc8aad","Type":"ContainerStarted","Data":"d9ab28b0a7ccb773ffd22dadcda722c1f6eda9f10071fd99c7e5612da79f866f"} Mar 16 17:00:46 crc kubenswrapper[5120]: I0316 17:00:46.413406 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:00:46 crc kubenswrapper[5120]: I0316 17:00:46.421549 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-api-0" podStartSLOduration=12.421530804 podStartE2EDuration="12.421530804s" podCreationTimestamp="2026-03-16 17:00:34 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:00:46.414921383 +0000 UTC m=+5348.568853030" watchObservedRunningTime="2026-03-16 17:00:46.421530804 +0000 UTC m=+5348.575462461" Mar 16 17:00:46 crc kubenswrapper[5120]: I0316 17:00:46.461453 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a19b5964-8116-49bd-9181-8eb2fe61703e-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:46 crc kubenswrapper[5120]: I0316 17:00:46.462096 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-57589895fd-84tvt" podStartSLOduration=10.462081454 podStartE2EDuration="10.462081454s" podCreationTimestamp="2026-03-16 17:00:36 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:00:46.458550888 +0000 UTC m=+5348.612482555" watchObservedRunningTime="2026-03-16 17:00:46.462081454 +0000 UTC m=+5348.616013121" Mar 16 17:00:46 crc kubenswrapper[5120]: I0316 17:00:46.500778 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/30bfa4fc-b416-4f16-b673-158d4a8c552a-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "30bfa4fc-b416-4f16-b673-158d4a8c552a" (UID: "30bfa4fc-b416-4f16-b673-158d4a8c552a"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:46 crc kubenswrapper[5120]: I0316 17:00:46.526018 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-5b7968964b-sgwq2" podUID="e78c00c6-8a77-403d-a9f1-49d34962c3f7" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.1.76:9311/healthcheck\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Mar 16 17:00:46 crc kubenswrapper[5120]: I0316 17:00:46.526400 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-5b7968964b-sgwq2" podUID="e78c00c6-8a77-403d-a9f1-49d34962c3f7" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.1.76:9311/healthcheck\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Mar 16 17:00:46 crc kubenswrapper[5120]: I0316 17:00:46.608435 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/30bfa4fc-b416-4f16-b673-158d4a8c552a-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:46 crc kubenswrapper[5120]: I0316 17:00:46.616975 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/30bfa4fc-b416-4f16-b673-158d4a8c552a-config-data" (OuterVolumeSpecName: "config-data") pod "30bfa4fc-b416-4f16-b673-158d4a8c552a" (UID: "30bfa4fc-b416-4f16-b673-158d4a8c552a"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:46 crc kubenswrapper[5120]: I0316 17:00:46.712635 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/30bfa4fc-b416-4f16-b673-158d4a8c552a-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:46 crc kubenswrapper[5120]: I0316 17:00:46.833089 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-556c5fbd95-b6tt9" Mar 16 17:00:46 crc kubenswrapper[5120]: I0316 17:00:46.883225 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="55f7f374-c6b2-422b-90bd-a7dcc936e74f" path="/var/lib/kubelet/pods/55f7f374-c6b2-422b-90bd-a7dcc936e74f/volumes" Mar 16 17:00:46 crc kubenswrapper[5120]: I0316 17:00:46.884654 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 17:00:46 crc kubenswrapper[5120]: I0316 17:00:46.896183 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 17:00:46 crc kubenswrapper[5120]: I0316 17:00:46.924808 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 17:00:46 crc kubenswrapper[5120]: I0316 17:00:46.925877 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30bfa4fc-b416-4f16-b673-158d4a8c552a" containerName="ceilometer-notification-agent" Mar 16 17:00:46 crc kubenswrapper[5120]: I0316 17:00:46.925893 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="30bfa4fc-b416-4f16-b673-158d4a8c552a" containerName="ceilometer-notification-agent" Mar 16 17:00:46 crc kubenswrapper[5120]: I0316 17:00:46.925907 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30bfa4fc-b416-4f16-b673-158d4a8c552a" containerName="ceilometer-central-agent" Mar 16 17:00:46 crc kubenswrapper[5120]: I0316 17:00:46.925912 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="30bfa4fc-b416-4f16-b673-158d4a8c552a" containerName="ceilometer-central-agent" Mar 16 17:00:46 crc kubenswrapper[5120]: I0316 17:00:46.925937 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37a14538-41b4-4840-9f98-8e652da86950" containerName="keystone-api" Mar 16 17:00:46 crc kubenswrapper[5120]: I0316 17:00:46.925944 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="37a14538-41b4-4840-9f98-8e652da86950" containerName="keystone-api" Mar 16 17:00:46 crc kubenswrapper[5120]: I0316 17:00:46.925972 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a19b5964-8116-49bd-9181-8eb2fe61703e" containerName="nova-scheduler-scheduler" Mar 16 17:00:46 crc kubenswrapper[5120]: I0316 17:00:46.925977 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a19b5964-8116-49bd-9181-8eb2fe61703e" containerName="nova-scheduler-scheduler" Mar 16 17:00:46 crc kubenswrapper[5120]: I0316 17:00:46.925989 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30bfa4fc-b416-4f16-b673-158d4a8c552a" containerName="sg-core" Mar 16 17:00:46 crc kubenswrapper[5120]: I0316 17:00:46.925994 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="30bfa4fc-b416-4f16-b673-158d4a8c552a" containerName="sg-core" Mar 16 17:00:46 crc kubenswrapper[5120]: I0316 17:00:46.926032 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30bfa4fc-b416-4f16-b673-158d4a8c552a" containerName="proxy-httpd" Mar 16 17:00:46 crc kubenswrapper[5120]: I0316 17:00:46.926038 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="30bfa4fc-b416-4f16-b673-158d4a8c552a" containerName="proxy-httpd" Mar 16 17:00:46 crc kubenswrapper[5120]: I0316 17:00:46.926190 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="30bfa4fc-b416-4f16-b673-158d4a8c552a" containerName="ceilometer-notification-agent" Mar 16 17:00:46 crc kubenswrapper[5120]: I0316 17:00:46.926205 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="30bfa4fc-b416-4f16-b673-158d4a8c552a" containerName="proxy-httpd" Mar 16 17:00:46 crc kubenswrapper[5120]: I0316 17:00:46.926220 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="37a14538-41b4-4840-9f98-8e652da86950" containerName="keystone-api" Mar 16 17:00:46 crc kubenswrapper[5120]: I0316 17:00:46.926231 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="30bfa4fc-b416-4f16-b673-158d4a8c552a" containerName="ceilometer-central-agent" Mar 16 17:00:46 crc kubenswrapper[5120]: I0316 17:00:46.926240 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="30bfa4fc-b416-4f16-b673-158d4a8c552a" containerName="sg-core" Mar 16 17:00:46 crc kubenswrapper[5120]: I0316 17:00:46.926248 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="a19b5964-8116-49bd-9181-8eb2fe61703e" containerName="nova-scheduler-scheduler" Mar 16 17:00:46 crc kubenswrapper[5120]: I0316 17:00:46.938269 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/37a14538-41b4-4840-9f98-8e652da86950-credential-keys\") pod \"37a14538-41b4-4840-9f98-8e652da86950\" (UID: \"37a14538-41b4-4840-9f98-8e652da86950\") " Mar 16 17:00:46 crc kubenswrapper[5120]: I0316 17:00:46.938397 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/37a14538-41b4-4840-9f98-8e652da86950-public-tls-certs\") pod \"37a14538-41b4-4840-9f98-8e652da86950\" (UID: \"37a14538-41b4-4840-9f98-8e652da86950\") " Mar 16 17:00:46 crc kubenswrapper[5120]: I0316 17:00:46.938561 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/37a14538-41b4-4840-9f98-8e652da86950-scripts\") pod \"37a14538-41b4-4840-9f98-8e652da86950\" (UID: \"37a14538-41b4-4840-9f98-8e652da86950\") " Mar 16 17:00:46 crc kubenswrapper[5120]: I0316 17:00:46.939248 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/37a14538-41b4-4840-9f98-8e652da86950-config-data\") pod \"37a14538-41b4-4840-9f98-8e652da86950\" (UID: \"37a14538-41b4-4840-9f98-8e652da86950\") " Mar 16 17:00:46 crc kubenswrapper[5120]: I0316 17:00:46.939391 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vfcjw\" (UniqueName: \"kubernetes.io/projected/37a14538-41b4-4840-9f98-8e652da86950-kube-api-access-vfcjw\") pod \"37a14538-41b4-4840-9f98-8e652da86950\" (UID: \"37a14538-41b4-4840-9f98-8e652da86950\") " Mar 16 17:00:46 crc kubenswrapper[5120]: I0316 17:00:46.939432 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/37a14538-41b4-4840-9f98-8e652da86950-internal-tls-certs\") pod \"37a14538-41b4-4840-9f98-8e652da86950\" (UID: \"37a14538-41b4-4840-9f98-8e652da86950\") " Mar 16 17:00:46 crc kubenswrapper[5120]: I0316 17:00:46.939492 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/37a14538-41b4-4840-9f98-8e652da86950-fernet-keys\") pod \"37a14538-41b4-4840-9f98-8e652da86950\" (UID: \"37a14538-41b4-4840-9f98-8e652da86950\") " Mar 16 17:00:46 crc kubenswrapper[5120]: I0316 17:00:46.939580 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/37a14538-41b4-4840-9f98-8e652da86950-combined-ca-bundle\") pod \"37a14538-41b4-4840-9f98-8e652da86950\" (UID: \"37a14538-41b4-4840-9f98-8e652da86950\") " Mar 16 17:00:46 crc kubenswrapper[5120]: I0316 17:00:46.941474 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 17:00:46 crc kubenswrapper[5120]: I0316 17:00:46.941604 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:00:46 crc kubenswrapper[5120]: I0316 17:00:46.947481 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-scheduler-config-data\"" Mar 16 17:00:46 crc kubenswrapper[5120]: I0316 17:00:46.951410 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37a14538-41b4-4840-9f98-8e652da86950-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "37a14538-41b4-4840-9f98-8e652da86950" (UID: "37a14538-41b4-4840-9f98-8e652da86950"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:46 crc kubenswrapper[5120]: I0316 17:00:46.959023 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37a14538-41b4-4840-9f98-8e652da86950-scripts" (OuterVolumeSpecName: "scripts") pod "37a14538-41b4-4840-9f98-8e652da86950" (UID: "37a14538-41b4-4840-9f98-8e652da86950"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:46 crc kubenswrapper[5120]: I0316 17:00:46.963024 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37a14538-41b4-4840-9f98-8e652da86950-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "37a14538-41b4-4840-9f98-8e652da86950" (UID: "37a14538-41b4-4840-9f98-8e652da86950"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:46 crc kubenswrapper[5120]: I0316 17:00:46.988896 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37a14538-41b4-4840-9f98-8e652da86950-kube-api-access-vfcjw" (OuterVolumeSpecName: "kube-api-access-vfcjw") pod "37a14538-41b4-4840-9f98-8e652da86950" (UID: "37a14538-41b4-4840-9f98-8e652da86950"). InnerVolumeSpecName "kube-api-access-vfcjw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:00:47 crc kubenswrapper[5120]: I0316 17:00:47.062561 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d226072d-5d81-4c83-ade7-29bdc1df4c80-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"d226072d-5d81-4c83-ade7-29bdc1df4c80\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:00:47 crc kubenswrapper[5120]: I0316 17:00:47.063078 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d226072d-5d81-4c83-ade7-29bdc1df4c80-config-data\") pod \"nova-scheduler-0\" (UID: \"d226072d-5d81-4c83-ade7-29bdc1df4c80\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:00:47 crc kubenswrapper[5120]: I0316 17:00:47.063192 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jpsxp\" (UniqueName: \"kubernetes.io/projected/d226072d-5d81-4c83-ade7-29bdc1df4c80-kube-api-access-jpsxp\") pod \"nova-scheduler-0\" (UID: \"d226072d-5d81-4c83-ade7-29bdc1df4c80\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:00:47 crc kubenswrapper[5120]: I0316 17:00:47.063372 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vfcjw\" (UniqueName: \"kubernetes.io/projected/37a14538-41b4-4840-9f98-8e652da86950-kube-api-access-vfcjw\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:47 crc kubenswrapper[5120]: I0316 17:00:47.063388 5120 reconciler_common.go:299] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/37a14538-41b4-4840-9f98-8e652da86950-fernet-keys\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:47 crc kubenswrapper[5120]: I0316 17:00:47.063396 5120 reconciler_common.go:299] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/37a14538-41b4-4840-9f98-8e652da86950-credential-keys\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:47 crc kubenswrapper[5120]: I0316 17:00:47.063405 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/37a14538-41b4-4840-9f98-8e652da86950-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:47 crc kubenswrapper[5120]: I0316 17:00:47.118387 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37a14538-41b4-4840-9f98-8e652da86950-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "37a14538-41b4-4840-9f98-8e652da86950" (UID: "37a14538-41b4-4840-9f98-8e652da86950"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:47 crc kubenswrapper[5120]: I0316 17:00:47.124348 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37a14538-41b4-4840-9f98-8e652da86950-config-data" (OuterVolumeSpecName: "config-data") pod "37a14538-41b4-4840-9f98-8e652da86950" (UID: "37a14538-41b4-4840-9f98-8e652da86950"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:47 crc kubenswrapper[5120]: I0316 17:00:47.128912 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37a14538-41b4-4840-9f98-8e652da86950-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "37a14538-41b4-4840-9f98-8e652da86950" (UID: "37a14538-41b4-4840-9f98-8e652da86950"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:47 crc kubenswrapper[5120]: I0316 17:00:47.160582 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37a14538-41b4-4840-9f98-8e652da86950-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "37a14538-41b4-4840-9f98-8e652da86950" (UID: "37a14538-41b4-4840-9f98-8e652da86950"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:47 crc kubenswrapper[5120]: I0316 17:00:47.164785 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-5d8cb95448-4wwn9" Mar 16 17:00:47 crc kubenswrapper[5120]: I0316 17:00:47.165812 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jpsxp\" (UniqueName: \"kubernetes.io/projected/d226072d-5d81-4c83-ade7-29bdc1df4c80-kube-api-access-jpsxp\") pod \"nova-scheduler-0\" (UID: \"d226072d-5d81-4c83-ade7-29bdc1df4c80\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:00:47 crc kubenswrapper[5120]: I0316 17:00:47.165929 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d226072d-5d81-4c83-ade7-29bdc1df4c80-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"d226072d-5d81-4c83-ade7-29bdc1df4c80\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:00:47 crc kubenswrapper[5120]: I0316 17:00:47.166399 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d226072d-5d81-4c83-ade7-29bdc1df4c80-config-data\") pod \"nova-scheduler-0\" (UID: \"d226072d-5d81-4c83-ade7-29bdc1df4c80\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:00:47 crc kubenswrapper[5120]: I0316 17:00:47.166532 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/37a14538-41b4-4840-9f98-8e652da86950-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:47 crc kubenswrapper[5120]: I0316 17:00:47.166550 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/37a14538-41b4-4840-9f98-8e652da86950-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:47 crc kubenswrapper[5120]: I0316 17:00:47.166562 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/37a14538-41b4-4840-9f98-8e652da86950-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:47 crc kubenswrapper[5120]: I0316 17:00:47.166576 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/37a14538-41b4-4840-9f98-8e652da86950-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:47 crc kubenswrapper[5120]: I0316 17:00:47.188224 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d226072d-5d81-4c83-ade7-29bdc1df4c80-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"d226072d-5d81-4c83-ade7-29bdc1df4c80\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:00:47 crc kubenswrapper[5120]: I0316 17:00:47.195464 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d226072d-5d81-4c83-ade7-29bdc1df4c80-config-data\") pod \"nova-scheduler-0\" (UID: \"d226072d-5d81-4c83-ade7-29bdc1df4c80\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:00:47 crc kubenswrapper[5120]: I0316 17:00:47.231141 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jpsxp\" (UniqueName: \"kubernetes.io/projected/d226072d-5d81-4c83-ade7-29bdc1df4c80-kube-api-access-jpsxp\") pod \"nova-scheduler-0\" (UID: \"d226072d-5d81-4c83-ade7-29bdc1df4c80\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:00:47 crc kubenswrapper[5120]: I0316 17:00:47.267744 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d4c74a5c-86a6-4bcf-b660-10a42c6a2be1-config-data\") pod \"d4c74a5c-86a6-4bcf-b660-10a42c6a2be1\" (UID: \"d4c74a5c-86a6-4bcf-b660-10a42c6a2be1\") " Mar 16 17:00:47 crc kubenswrapper[5120]: I0316 17:00:47.267984 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/d4c74a5c-86a6-4bcf-b660-10a42c6a2be1-config-data-custom\") pod \"d4c74a5c-86a6-4bcf-b660-10a42c6a2be1\" (UID: \"d4c74a5c-86a6-4bcf-b660-10a42c6a2be1\") " Mar 16 17:00:47 crc kubenswrapper[5120]: I0316 17:00:47.268179 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d4c74a5c-86a6-4bcf-b660-10a42c6a2be1-logs\") pod \"d4c74a5c-86a6-4bcf-b660-10a42c6a2be1\" (UID: \"d4c74a5c-86a6-4bcf-b660-10a42c6a2be1\") " Mar 16 17:00:47 crc kubenswrapper[5120]: I0316 17:00:47.268355 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p5r6f\" (UniqueName: \"kubernetes.io/projected/d4c74a5c-86a6-4bcf-b660-10a42c6a2be1-kube-api-access-p5r6f\") pod \"d4c74a5c-86a6-4bcf-b660-10a42c6a2be1\" (UID: \"d4c74a5c-86a6-4bcf-b660-10a42c6a2be1\") " Mar 16 17:00:47 crc kubenswrapper[5120]: I0316 17:00:47.268596 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d4c74a5c-86a6-4bcf-b660-10a42c6a2be1-combined-ca-bundle\") pod \"d4c74a5c-86a6-4bcf-b660-10a42c6a2be1\" (UID: \"d4c74a5c-86a6-4bcf-b660-10a42c6a2be1\") " Mar 16 17:00:47 crc kubenswrapper[5120]: I0316 17:00:47.271154 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4c74a5c-86a6-4bcf-b660-10a42c6a2be1-logs" (OuterVolumeSpecName: "logs") pod "d4c74a5c-86a6-4bcf-b660-10a42c6a2be1" (UID: "d4c74a5c-86a6-4bcf-b660-10a42c6a2be1"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:00:47 crc kubenswrapper[5120]: I0316 17:00:47.337168 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4c74a5c-86a6-4bcf-b660-10a42c6a2be1-kube-api-access-p5r6f" (OuterVolumeSpecName: "kube-api-access-p5r6f") pod "d4c74a5c-86a6-4bcf-b660-10a42c6a2be1" (UID: "d4c74a5c-86a6-4bcf-b660-10a42c6a2be1"). InnerVolumeSpecName "kube-api-access-p5r6f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:00:47 crc kubenswrapper[5120]: I0316 17:00:47.365550 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 17:00:47 crc kubenswrapper[5120]: I0316 17:00:47.374258 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d4c74a5c-86a6-4bcf-b660-10a42c6a2be1-logs\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:47 crc kubenswrapper[5120]: I0316 17:00:47.374294 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p5r6f\" (UniqueName: \"kubernetes.io/projected/d4c74a5c-86a6-4bcf-b660-10a42c6a2be1-kube-api-access-p5r6f\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:47 crc kubenswrapper[5120]: I0316 17:00:47.387612 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 17:00:47 crc kubenswrapper[5120]: I0316 17:00:47.412659 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 17:00:47 crc kubenswrapper[5120]: I0316 17:00:47.417083 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4c74a5c-86a6-4bcf-b660-10a42c6a2be1-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "d4c74a5c-86a6-4bcf-b660-10a42c6a2be1" (UID: "d4c74a5c-86a6-4bcf-b660-10a42c6a2be1"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:47 crc kubenswrapper[5120]: I0316 17:00:47.453530 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 17:00:47 crc kubenswrapper[5120]: I0316 17:00:47.459731 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"25abef41-bfd4-4436-a8c8-262247bd936f","Type":"ContainerStarted","Data":"d2a3840b43a3b5e454f66025cece8b86377288f262dec0e49a55b5997c17ff86"} Mar 16 17:00:47 crc kubenswrapper[5120]: I0316 17:00:47.467927 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"ab76f235-6a48-4935-a2d5-5a79806c416c","Type":"ContainerStarted","Data":"50c9fb8e4395ff8d0b8a9ef7844ff6a387ea6735244afeae82df0471f26e8e1c"} Mar 16 17:00:47 crc kubenswrapper[5120]: I0316 17:00:47.471012 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"ce24ae83-459d-4410-bd4d-fb7e0fcad044","Type":"ContainerStarted","Data":"9f6462e34d47e34bdbb58d3565d44332f8aa04c8077e624308c782f5315a20a3"} Mar 16 17:00:47 crc kubenswrapper[5120]: I0316 17:00:47.477746 5120 generic.go:358] "Generic (PLEG): container finished" podID="b7434cde-890e-42d9-9b5c-bbd60a188517" containerID="e6f41b2eba86e2ad1ad67b7920bf775f201acf4a1d8d43b7f3ad7c19edd16e8f" exitCode=143 Mar 16 17:00:47 crc kubenswrapper[5120]: I0316 17:00:47.477802 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"b7434cde-890e-42d9-9b5c-bbd60a188517","Type":"ContainerDied","Data":"e6f41b2eba86e2ad1ad67b7920bf775f201acf4a1d8d43b7f3ad7c19edd16e8f"} Mar 16 17:00:47 crc kubenswrapper[5120]: I0316 17:00:47.477848 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/d4c74a5c-86a6-4bcf-b660-10a42c6a2be1-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:47 crc kubenswrapper[5120]: I0316 17:00:47.488236 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-765bfffb44-jrj28" event={"ID":"ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801","Type":"ContainerStarted","Data":"9441daf29df96c302c797aebd83789aeb29a6686baa145ee4bfdb90cc8d5046c"} Mar 16 17:00:47 crc kubenswrapper[5120]: I0316 17:00:47.491779 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4c74a5c-86a6-4bcf-b660-10a42c6a2be1-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "d4c74a5c-86a6-4bcf-b660-10a42c6a2be1" (UID: "d4c74a5c-86a6-4bcf-b660-10a42c6a2be1"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:47 crc kubenswrapper[5120]: I0316 17:00:47.495516 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-556c5fbd95-b6tt9" Mar 16 17:00:47 crc kubenswrapper[5120]: I0316 17:00:47.498952 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-5d8cb95448-4wwn9" event={"ID":"d4c74a5c-86a6-4bcf-b660-10a42c6a2be1","Type":"ContainerDied","Data":"2710f4dfdcbdb771a876100486788487345062da688ddbf35a48c4e196b1e95a"} Mar 16 17:00:47 crc kubenswrapper[5120]: I0316 17:00:47.498994 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-5d8cb95448-4wwn9" Mar 16 17:00:47 crc kubenswrapper[5120]: I0316 17:00:47.499097 5120 scope.go:117] "RemoveContainer" containerID="6de8bdd5fb2544346e3cbeb0ae90bbd7bd95389cd023b6a97824529be2e5589f" Mar 16 17:00:47 crc kubenswrapper[5120]: I0316 17:00:47.505108 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-57589895fd-84tvt" Mar 16 17:00:47 crc kubenswrapper[5120]: I0316 17:00:47.505158 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-57589895fd-84tvt" Mar 16 17:00:47 crc kubenswrapper[5120]: I0316 17:00:47.505612 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/neutron-765bfffb44-jrj28" Mar 16 17:00:47 crc kubenswrapper[5120]: I0316 17:00:47.524226 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:00:47 crc kubenswrapper[5120]: I0316 17:00:47.564513 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-765bfffb44-jrj28" podStartSLOduration=11.564491368 podStartE2EDuration="11.564491368s" podCreationTimestamp="2026-03-16 17:00:36 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:00:47.539649098 +0000 UTC m=+5349.693580765" watchObservedRunningTime="2026-03-16 17:00:47.564491368 +0000 UTC m=+5349.718423025" Mar 16 17:00:47 crc kubenswrapper[5120]: I0316 17:00:47.579890 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d4c74a5c-86a6-4bcf-b660-10a42c6a2be1-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:47 crc kubenswrapper[5120]: I0316 17:00:47.653999 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4c74a5c-86a6-4bcf-b660-10a42c6a2be1-config-data" (OuterVolumeSpecName: "config-data") pod "d4c74a5c-86a6-4bcf-b660-10a42c6a2be1" (UID: "d4c74a5c-86a6-4bcf-b660-10a42c6a2be1"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:47 crc kubenswrapper[5120]: I0316 17:00:47.693715 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d4c74a5c-86a6-4bcf-b660-10a42c6a2be1-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:47 crc kubenswrapper[5120]: I0316 17:00:47.718007 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-556c5fbd95-b6tt9"] Mar 16 17:00:47 crc kubenswrapper[5120]: I0316 17:00:47.806331 5120 scope.go:117] "RemoveContainer" containerID="98a6bb7bcbdb1c9b868828021b7f938892232a44d9a2e07cc46cefbe5ca3da85" Mar 16 17:00:47 crc kubenswrapper[5120]: I0316 17:00:47.810585 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-556c5fbd95-b6tt9"] Mar 16 17:00:47 crc kubenswrapper[5120]: E0316 17:00:47.869446 5120 fsHandler.go:119] failed to collect filesystem stats - rootDiskErr: , extraDiskErr: could not stat "/var/log/pods/openstack-kuttl-tests_barbican-keystone-listener-5d8cb95448-4wwn9_d4c74a5c-86a6-4bcf-b660-10a42c6a2be1/barbican-keystone-listener-log/0.log" to get inode usage: stat /var/log/pods/openstack-kuttl-tests_barbican-keystone-listener-5d8cb95448-4wwn9_d4c74a5c-86a6-4bcf-b660-10a42c6a2be1/barbican-keystone-listener-log/0.log: no such file or directory Mar 16 17:00:48 crc kubenswrapper[5120]: I0316 17:00:48.141650 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-5d8cb95448-4wwn9"] Mar 16 17:00:48 crc kubenswrapper[5120]: I0316 17:00:48.185675 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-5d8cb95448-4wwn9"] Mar 16 17:00:48 crc kubenswrapper[5120]: E0316 17:00:48.272064 5120 fsHandler.go:119] failed to collect filesystem stats - rootDiskErr: could not stat "/var/lib/containers/storage/overlay/ebe836e4b3d1a131b5d955448dac43cb29bf4c0da5964d6f033afa06a6ca2448/diff" to get inode usage: stat /var/lib/containers/storage/overlay/ebe836e4b3d1a131b5d955448dac43cb29bf4c0da5964d6f033afa06a6ca2448/diff: no such file or directory, extraDiskErr: could not stat "/var/log/pods/openstack-kuttl-tests_barbican-keystone-listener-5d8cb95448-4wwn9_d4c74a5c-86a6-4bcf-b660-10a42c6a2be1/barbican-keystone-listener/0.log" to get inode usage: stat /var/log/pods/openstack-kuttl-tests_barbican-keystone-listener-5d8cb95448-4wwn9_d4c74a5c-86a6-4bcf-b660-10a42c6a2be1/barbican-keystone-listener/0.log: no such file or directory Mar 16 17:00:48 crc kubenswrapper[5120]: I0316 17:00:48.319082 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:00:48 crc kubenswrapper[5120]: I0316 17:00:48.533386 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"0d641338-e35d-4819-b487-513c8840cfd7","Type":"ContainerStarted","Data":"0100259933ee5a0d60c815e0522f8958bf64827830e93951666d1ba73b88f2ad"} Mar 16 17:00:48 crc kubenswrapper[5120]: I0316 17:00:48.533710 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"0d641338-e35d-4819-b487-513c8840cfd7","Type":"ContainerStarted","Data":"4e2017038e0954cf71d3f9f12158d6292545cbe721edaeea72585563aa770bfb"} Mar 16 17:00:48 crc kubenswrapper[5120]: I0316 17:00:48.543193 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"0fdecce9-8602-457d-8eec-c97b359170dd","Type":"ContainerStarted","Data":"dcac205b014b21d17ad56e780b019d708c45533caa9f76fde023fd335cccb3ed"} Mar 16 17:00:48 crc kubenswrapper[5120]: I0316 17:00:48.548451 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"e5f68c9e-894a-4eac-90fc-be12f8c49913","Type":"ContainerStarted","Data":"bd00d07b486ec185ee02c5c8ceab221325f86394dc05335ac89adfe8d2779929"} Mar 16 17:00:48 crc kubenswrapper[5120]: I0316 17:00:48.564628 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"2cadcb9e-2a3b-4c14-8fcc-39939326678f","Type":"ContainerStarted","Data":"4825276674a4bf257366e44ec75f03f8d2509be62fcefccdb42e3184f86889cf"} Mar 16 17:00:48 crc kubenswrapper[5120]: I0316 17:00:48.568541 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"5f9a749e-2dbb-409d-b935-4f2891d43397","Type":"ContainerStarted","Data":"a4d20d76546c51fa2980f8102ff0540c2e4371359f2aac37edf70df305a1aa75"} Mar 16 17:00:48 crc kubenswrapper[5120]: I0316 17:00:48.639290 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"ce24ae83-459d-4410-bd4d-fb7e0fcad044","Type":"ContainerStarted","Data":"0a576c9c3f46dcb5e38a65bf5cfa9aefd0b0e74f1b4d9b5916785ecf2b6d9ee0"} Mar 16 17:00:48 crc kubenswrapper[5120]: I0316 17:00:48.652516 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"284dc632-d111-40d1-97a9-f6e78aa92ce7","Type":"ContainerStarted","Data":"0caf2f247366752c25fe3303453748c0082ba327ce5a5db56bf1da86155877f9"} Mar 16 17:00:48 crc kubenswrapper[5120]: I0316 17:00:48.779710 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="37a14538-41b4-4840-9f98-8e652da86950" path="/var/lib/kubelet/pods/37a14538-41b4-4840-9f98-8e652da86950/volumes" Mar 16 17:00:48 crc kubenswrapper[5120]: I0316 17:00:48.780737 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a19b5964-8116-49bd-9181-8eb2fe61703e" path="/var/lib/kubelet/pods/a19b5964-8116-49bd-9181-8eb2fe61703e/volumes" Mar 16 17:00:48 crc kubenswrapper[5120]: I0316 17:00:48.781518 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d4c74a5c-86a6-4bcf-b660-10a42c6a2be1" path="/var/lib/kubelet/pods/d4c74a5c-86a6-4bcf-b660-10a42c6a2be1/volumes" Mar 16 17:00:49 crc kubenswrapper[5120]: I0316 17:00:49.108179 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 17:00:49 crc kubenswrapper[5120]: W0316 17:00:49.537026 5120 watcher.go:93] Error while processing event ("/sys/fs/cgroup/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod30bfa4fc_b416_4f16_b673_158d4a8c552a.slice/crio-127be2cd9a418019067d28df39c8a22a07e067915f84e992cceebd4cedb161d5.scope": 0x40000100 == IN_CREATE|IN_ISDIR): inotify_add_watch /sys/fs/cgroup/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod30bfa4fc_b416_4f16_b673_158d4a8c552a.slice/crio-127be2cd9a418019067d28df39c8a22a07e067915f84e992cceebd4cedb161d5.scope: no such file or directory Mar 16 17:00:49 crc kubenswrapper[5120]: I0316 17:00:49.720671 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"284dc632-d111-40d1-97a9-f6e78aa92ce7","Type":"ContainerStarted","Data":"853bc5cbb6b2905c3f52af799cf24c043e5f94333c04f7d4cc83f8fb47830175"} Mar 16 17:00:49 crc kubenswrapper[5120]: I0316 17:00:49.722172 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 17:00:49 crc kubenswrapper[5120]: I0316 17:00:49.750210 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-northd-0_a519f6d6-0bc7-43f3-9ad7-98a44f627488/ovn-northd/0.log" Mar 16 17:00:49 crc kubenswrapper[5120]: I0316 17:00:49.750265 5120 generic.go:358] "Generic (PLEG): container finished" podID="a519f6d6-0bc7-43f3-9ad7-98a44f627488" containerID="667c0b4c5c210d8d2e00d4c0137f5f162ac03573aade3cb4dcbc340cb9470ded" exitCode=139 Mar 16 17:00:49 crc kubenswrapper[5120]: I0316 17:00:49.750410 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"a519f6d6-0bc7-43f3-9ad7-98a44f627488","Type":"ContainerDied","Data":"667c0b4c5c210d8d2e00d4c0137f5f162ac03573aade3cb4dcbc340cb9470ded"} Mar 16 17:00:49 crc kubenswrapper[5120]: I0316 17:00:49.828362 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podStartSLOduration=6.828338991 podStartE2EDuration="6.828338991s" podCreationTimestamp="2026-03-16 17:00:43 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:00:49.745160415 +0000 UTC m=+5351.899092072" watchObservedRunningTime="2026-03-16 17:00:49.828338991 +0000 UTC m=+5351.982270648" Mar 16 17:00:49 crc kubenswrapper[5120]: I0316 17:00:49.838103 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"0d641338-e35d-4819-b487-513c8840cfd7","Type":"ContainerStarted","Data":"913817c69070d4510b8042762cb63e057b4a8046effc6659ca14ddf12d68af77"} Mar 16 17:00:49 crc kubenswrapper[5120]: I0316 17:00:49.866598 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"e5f68c9e-894a-4eac-90fc-be12f8c49913","Type":"ContainerStarted","Data":"c6c3b078bcba74c557bdc2e467fc6e2de0b3d668951e7953bb03062d2d6e4f47"} Mar 16 17:00:49 crc kubenswrapper[5120]: I0316 17:00:49.891393 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=7.8913684459999995 podStartE2EDuration="7.891368446s" podCreationTimestamp="2026-03-16 17:00:42 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:00:49.86995503 +0000 UTC m=+5352.023886687" watchObservedRunningTime="2026-03-16 17:00:49.891368446 +0000 UTC m=+5352.045300103" Mar 16 17:00:49 crc kubenswrapper[5120]: I0316 17:00:49.910220 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"25abef41-bfd4-4436-a8c8-262247bd936f","Type":"ContainerStarted","Data":"5b50d4fd103f75c5ada5a2c6b1fe2f90bcd8e23a45024888035f4ee0b82396a6"} Mar 16 17:00:49 crc kubenswrapper[5120]: I0316 17:00:49.950592 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"5f9a749e-2dbb-409d-b935-4f2891d43397","Type":"ContainerStarted","Data":"b9ea6c64365c3398bfb7a01d52bf92315e0914e469529e7c3947aad7173b22b9"} Mar 16 17:00:49 crc kubenswrapper[5120]: I0316 17:00:49.980130 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podStartSLOduration=7.980096195 podStartE2EDuration="7.980096195s" podCreationTimestamp="2026-03-16 17:00:42 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:00:49.902610634 +0000 UTC m=+5352.056542301" watchObservedRunningTime="2026-03-16 17:00:49.980096195 +0000 UTC m=+5352.134027852" Mar 16 17:00:50 crc kubenswrapper[5120]: I0316 17:00:50.045703 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podStartSLOduration=8.04568495 podStartE2EDuration="8.04568495s" podCreationTimestamp="2026-03-16 17:00:42 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:00:49.979531989 +0000 UTC m=+5352.133463656" watchObservedRunningTime="2026-03-16 17:00:50.04568495 +0000 UTC m=+5352.199616607" Mar 16 17:00:50 crc kubenswrapper[5120]: I0316 17:00:50.049971 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"ce24ae83-459d-4410-bd4d-fb7e0fcad044","Type":"ContainerStarted","Data":"5c01207e6b7eaba66695795238027c1a25f25604d6e9fbe8b8369eab265fb078"} Mar 16 17:00:50 crc kubenswrapper[5120]: I0316 17:00:50.059139 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"d226072d-5d81-4c83-ade7-29bdc1df4c80","Type":"ContainerStarted","Data":"0928f62211951569390bc849563df11890859ff76e7b2036ebc79c2ab9dc6b00"} Mar 16 17:00:50 crc kubenswrapper[5120]: I0316 17:00:50.084723 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=7.084703888 podStartE2EDuration="7.084703888s" podCreationTimestamp="2026-03-16 17:00:43 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:00:50.071369033 +0000 UTC m=+5352.225300710" watchObservedRunningTime="2026-03-16 17:00:50.084703888 +0000 UTC m=+5352.238635545" Mar 16 17:00:50 crc kubenswrapper[5120]: I0316 17:00:50.334794 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-5b7968964b-sgwq2" podUID="e78c00c6-8a77-403d-a9f1-49d34962c3f7" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.1.76:9311/healthcheck\": read tcp 10.217.0.2:35150->10.217.1.76:9311: read: connection reset by peer" Mar 16 17:00:50 crc kubenswrapper[5120]: I0316 17:00:50.334812 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-5b7968964b-sgwq2" podUID="e78c00c6-8a77-403d-a9f1-49d34962c3f7" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.1.76:9311/healthcheck\": read tcp 10.217.0.2:35164->10.217.1.76:9311: read: connection reset by peer" Mar 16 17:00:50 crc kubenswrapper[5120]: I0316 17:00:50.463389 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-northd-0_a519f6d6-0bc7-43f3-9ad7-98a44f627488/ovn-northd/0.log" Mar 16 17:00:50 crc kubenswrapper[5120]: I0316 17:00:50.463463 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:00:50 crc kubenswrapper[5120]: I0316 17:00:50.472347 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:00:50 crc kubenswrapper[5120]: I0316 17:00:50.534417 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/a519f6d6-0bc7-43f3-9ad7-98a44f627488-ovn-northd-tls-certs\") pod \"a519f6d6-0bc7-43f3-9ad7-98a44f627488\" (UID: \"a519f6d6-0bc7-43f3-9ad7-98a44f627488\") " Mar 16 17:00:50 crc kubenswrapper[5120]: I0316 17:00:50.534537 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/a519f6d6-0bc7-43f3-9ad7-98a44f627488-metrics-certs-tls-certs\") pod \"a519f6d6-0bc7-43f3-9ad7-98a44f627488\" (UID: \"a519f6d6-0bc7-43f3-9ad7-98a44f627488\") " Mar 16 17:00:50 crc kubenswrapper[5120]: I0316 17:00:50.534893 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a519f6d6-0bc7-43f3-9ad7-98a44f627488-config\") pod \"a519f6d6-0bc7-43f3-9ad7-98a44f627488\" (UID: \"a519f6d6-0bc7-43f3-9ad7-98a44f627488\") " Mar 16 17:00:50 crc kubenswrapper[5120]: I0316 17:00:50.534997 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/a519f6d6-0bc7-43f3-9ad7-98a44f627488-ovn-rundir\") pod \"a519f6d6-0bc7-43f3-9ad7-98a44f627488\" (UID: \"a519f6d6-0bc7-43f3-9ad7-98a44f627488\") " Mar 16 17:00:50 crc kubenswrapper[5120]: I0316 17:00:50.535016 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/a519f6d6-0bc7-43f3-9ad7-98a44f627488-scripts\") pod \"a519f6d6-0bc7-43f3-9ad7-98a44f627488\" (UID: \"a519f6d6-0bc7-43f3-9ad7-98a44f627488\") " Mar 16 17:00:50 crc kubenswrapper[5120]: I0316 17:00:50.535041 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qq7vc\" (UniqueName: \"kubernetes.io/projected/a519f6d6-0bc7-43f3-9ad7-98a44f627488-kube-api-access-qq7vc\") pod \"a519f6d6-0bc7-43f3-9ad7-98a44f627488\" (UID: \"a519f6d6-0bc7-43f3-9ad7-98a44f627488\") " Mar 16 17:00:50 crc kubenswrapper[5120]: I0316 17:00:50.535102 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a519f6d6-0bc7-43f3-9ad7-98a44f627488-combined-ca-bundle\") pod \"a519f6d6-0bc7-43f3-9ad7-98a44f627488\" (UID: \"a519f6d6-0bc7-43f3-9ad7-98a44f627488\") " Mar 16 17:00:50 crc kubenswrapper[5120]: I0316 17:00:50.540573 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a519f6d6-0bc7-43f3-9ad7-98a44f627488-config" (OuterVolumeSpecName: "config") pod "a519f6d6-0bc7-43f3-9ad7-98a44f627488" (UID: "a519f6d6-0bc7-43f3-9ad7-98a44f627488"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:00:50 crc kubenswrapper[5120]: I0316 17:00:50.541130 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a519f6d6-0bc7-43f3-9ad7-98a44f627488-scripts" (OuterVolumeSpecName: "scripts") pod "a519f6d6-0bc7-43f3-9ad7-98a44f627488" (UID: "a519f6d6-0bc7-43f3-9ad7-98a44f627488"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:00:50 crc kubenswrapper[5120]: I0316 17:00:50.541272 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a519f6d6-0bc7-43f3-9ad7-98a44f627488-ovn-rundir" (OuterVolumeSpecName: "ovn-rundir") pod "a519f6d6-0bc7-43f3-9ad7-98a44f627488" (UID: "a519f6d6-0bc7-43f3-9ad7-98a44f627488"). InnerVolumeSpecName "ovn-rundir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:00:50 crc kubenswrapper[5120]: I0316 17:00:50.572926 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a519f6d6-0bc7-43f3-9ad7-98a44f627488-kube-api-access-qq7vc" (OuterVolumeSpecName: "kube-api-access-qq7vc") pod "a519f6d6-0bc7-43f3-9ad7-98a44f627488" (UID: "a519f6d6-0bc7-43f3-9ad7-98a44f627488"). InnerVolumeSpecName "kube-api-access-qq7vc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:00:50 crc kubenswrapper[5120]: I0316 17:00:50.638565 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a519f6d6-0bc7-43f3-9ad7-98a44f627488-config\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:50 crc kubenswrapper[5120]: I0316 17:00:50.640071 5120 reconciler_common.go:299] "Volume detached for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/a519f6d6-0bc7-43f3-9ad7-98a44f627488-ovn-rundir\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:50 crc kubenswrapper[5120]: I0316 17:00:50.640178 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/a519f6d6-0bc7-43f3-9ad7-98a44f627488-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:50 crc kubenswrapper[5120]: I0316 17:00:50.640258 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qq7vc\" (UniqueName: \"kubernetes.io/projected/a519f6d6-0bc7-43f3-9ad7-98a44f627488-kube-api-access-qq7vc\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:50 crc kubenswrapper[5120]: I0316 17:00:50.643178 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:00:50 crc kubenswrapper[5120]: I0316 17:00:50.819105 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a519f6d6-0bc7-43f3-9ad7-98a44f627488-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "a519f6d6-0bc7-43f3-9ad7-98a44f627488" (UID: "a519f6d6-0bc7-43f3-9ad7-98a44f627488"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:50 crc kubenswrapper[5120]: I0316 17:00:50.845568 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a519f6d6-0bc7-43f3-9ad7-98a44f627488-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:50 crc kubenswrapper[5120]: I0316 17:00:50.968975 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a519f6d6-0bc7-43f3-9ad7-98a44f627488-ovn-northd-tls-certs" (OuterVolumeSpecName: "ovn-northd-tls-certs") pod "a519f6d6-0bc7-43f3-9ad7-98a44f627488" (UID: "a519f6d6-0bc7-43f3-9ad7-98a44f627488"). InnerVolumeSpecName "ovn-northd-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:50 crc kubenswrapper[5120]: I0316 17:00:50.996908 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a519f6d6-0bc7-43f3-9ad7-98a44f627488-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "a519f6d6-0bc7-43f3-9ad7-98a44f627488" (UID: "a519f6d6-0bc7-43f3-9ad7-98a44f627488"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:51 crc kubenswrapper[5120]: I0316 17:00:51.062113 5120 reconciler_common.go:299] "Volume detached for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/a519f6d6-0bc7-43f3-9ad7-98a44f627488-ovn-northd-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:51 crc kubenswrapper[5120]: I0316 17:00:51.062147 5120 reconciler_common.go:299] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/a519f6d6-0bc7-43f3-9ad7-98a44f627488-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:51 crc kubenswrapper[5120]: I0316 17:00:51.171067 5120 generic.go:358] "Generic (PLEG): container finished" podID="ab76f235-6a48-4935-a2d5-5a79806c416c" containerID="50c9fb8e4395ff8d0b8a9ef7844ff6a387ea6735244afeae82df0471f26e8e1c" exitCode=0 Mar 16 17:00:51 crc kubenswrapper[5120]: I0316 17:00:51.174552 5120 generic.go:358] "Generic (PLEG): container finished" podID="e78c00c6-8a77-403d-a9f1-49d34962c3f7" containerID="94e1102e08240e0ac6ddeb805485b6575f608c17fcfd298c5170b5fd7e295206" exitCode=0 Mar 16 17:00:51 crc kubenswrapper[5120]: I0316 17:00:51.203304 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"25abef41-bfd4-4436-a8c8-262247bd936f","Type":"ContainerStarted","Data":"22bc321bf8bdaa4bae524c0d33ca3b1bfd1b617debabd58a58a512ee9428af0a"} Mar 16 17:00:51 crc kubenswrapper[5120]: I0316 17:00:51.203357 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"ab76f235-6a48-4935-a2d5-5a79806c416c","Type":"ContainerDied","Data":"50c9fb8e4395ff8d0b8a9ef7844ff6a387ea6735244afeae82df0471f26e8e1c"} Mar 16 17:00:51 crc kubenswrapper[5120]: I0316 17:00:51.203381 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-5b7968964b-sgwq2" event={"ID":"e78c00c6-8a77-403d-a9f1-49d34962c3f7","Type":"ContainerDied","Data":"94e1102e08240e0ac6ddeb805485b6575f608c17fcfd298c5170b5fd7e295206"} Mar 16 17:00:51 crc kubenswrapper[5120]: I0316 17:00:51.203427 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-5b7968964b-sgwq2" event={"ID":"e78c00c6-8a77-403d-a9f1-49d34962c3f7","Type":"ContainerDied","Data":"02ba749f49d9fa91a059285655a4e950537e9843a2d24092f2d772aeea3b5575"} Mar 16 17:00:51 crc kubenswrapper[5120]: I0316 17:00:51.203442 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="02ba749f49d9fa91a059285655a4e950537e9843a2d24092f2d772aeea3b5575" Mar 16 17:00:51 crc kubenswrapper[5120]: I0316 17:00:51.203454 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"d226072d-5d81-4c83-ade7-29bdc1df4c80","Type":"ContainerStarted","Data":"c41c6f68efc98a8a4f6e9bff4c63fcf3d9030c34f38836de8419c856a555595e"} Mar 16 17:00:51 crc kubenswrapper[5120]: I0316 17:00:51.209107 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-northd-0_a519f6d6-0bc7-43f3-9ad7-98a44f627488/ovn-northd/0.log" Mar 16 17:00:51 crc kubenswrapper[5120]: I0316 17:00:51.209387 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"a519f6d6-0bc7-43f3-9ad7-98a44f627488","Type":"ContainerDied","Data":"571e7f0c18b291c7d5c1562db49213b97052bb128e00699ce545a1842afeda13"} Mar 16 17:00:51 crc kubenswrapper[5120]: I0316 17:00:51.209494 5120 scope.go:117] "RemoveContainer" containerID="35ca9562e24968de8b31ef801a1f01d23ff0204af1a566b33c7aeeb79c0016fa" Mar 16 17:00:51 crc kubenswrapper[5120]: I0316 17:00:51.209771 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:00:51 crc kubenswrapper[5120]: I0316 17:00:51.218164 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-external-api-0" podStartSLOduration=8.218137411 podStartE2EDuration="8.218137411s" podCreationTimestamp="2026-03-16 17:00:43 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:00:51.189203569 +0000 UTC m=+5353.343135316" watchObservedRunningTime="2026-03-16 17:00:51.218137411 +0000 UTC m=+5353.372069068" Mar 16 17:00:51 crc kubenswrapper[5120]: I0316 17:00:51.251212 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"0fdecce9-8602-457d-8eec-c97b359170dd","Type":"ContainerStarted","Data":"19947c1a0b137846bb6d093126701f82159f9a27968b0667b1331783679eb16e"} Mar 16 17:00:51 crc kubenswrapper[5120]: I0316 17:00:51.255428 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-scheduler-0" podStartSLOduration=5.25540292 podStartE2EDuration="5.25540292s" podCreationTimestamp="2026-03-16 17:00:46 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:00:51.231715713 +0000 UTC m=+5353.385647370" watchObservedRunningTime="2026-03-16 17:00:51.25540292 +0000 UTC m=+5353.409334577" Mar 16 17:00:51 crc kubenswrapper[5120]: I0316 17:00:51.288349 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-5b7968964b-sgwq2" Mar 16 17:00:51 crc kubenswrapper[5120]: I0316 17:00:51.290107 5120 generic.go:358] "Generic (PLEG): container finished" podID="9c429916-2d70-42f0-a572-90ab8aafafbe" containerID="3ece0d70ebee943dfa6da07bcdd8a9f1af493f5fb471bb0e8264cf34758995a3" exitCode=0 Mar 16 17:00:51 crc kubenswrapper[5120]: I0316 17:00:51.290271 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-5b9b97df74-9rl5z" event={"ID":"9c429916-2d70-42f0-a572-90ab8aafafbe","Type":"ContainerDied","Data":"3ece0d70ebee943dfa6da07bcdd8a9f1af493f5fb471bb0e8264cf34758995a3"} Mar 16 17:00:51 crc kubenswrapper[5120]: I0316 17:00:51.306010 5120 generic.go:358] "Generic (PLEG): container finished" podID="61d14db6-7d33-4e5f-8252-844441e519d7" containerID="09ec4943c048e912f15eb43af459b9cf3ee8d9cf445b19b9f73bee58b9f168b2" exitCode=1 Mar 16 17:00:51 crc kubenswrapper[5120]: I0316 17:00:51.306220 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"61d14db6-7d33-4e5f-8252-844441e519d7","Type":"ContainerDied","Data":"09ec4943c048e912f15eb43af459b9cf3ee8d9cf445b19b9f73bee58b9f168b2"} Mar 16 17:00:51 crc kubenswrapper[5120]: I0316 17:00:51.307085 5120 scope.go:117] "RemoveContainer" containerID="09ec4943c048e912f15eb43af459b9cf3ee8d9cf445b19b9f73bee58b9f168b2" Mar 16 17:00:51 crc kubenswrapper[5120]: I0316 17:00:51.312190 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"2cadcb9e-2a3b-4c14-8fcc-39939326678f","Type":"ContainerStarted","Data":"6a23a121b6a8a57df4ea8368ee7e1898510506a29ce4485b74adeb024aebebae"} Mar 16 17:00:51 crc kubenswrapper[5120]: I0316 17:00:51.312433 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:00:51 crc kubenswrapper[5120]: I0316 17:00:51.375048 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e78c00c6-8a77-403d-a9f1-49d34962c3f7-public-tls-certs\") pod \"e78c00c6-8a77-403d-a9f1-49d34962c3f7\" (UID: \"e78c00c6-8a77-403d-a9f1-49d34962c3f7\") " Mar 16 17:00:51 crc kubenswrapper[5120]: I0316 17:00:51.377579 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e78c00c6-8a77-403d-a9f1-49d34962c3f7-logs\") pod \"e78c00c6-8a77-403d-a9f1-49d34962c3f7\" (UID: \"e78c00c6-8a77-403d-a9f1-49d34962c3f7\") " Mar 16 17:00:51 crc kubenswrapper[5120]: I0316 17:00:51.377892 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e78c00c6-8a77-403d-a9f1-49d34962c3f7-combined-ca-bundle\") pod \"e78c00c6-8a77-403d-a9f1-49d34962c3f7\" (UID: \"e78c00c6-8a77-403d-a9f1-49d34962c3f7\") " Mar 16 17:00:51 crc kubenswrapper[5120]: I0316 17:00:51.380615 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e78c00c6-8a77-403d-a9f1-49d34962c3f7-config-data\") pod \"e78c00c6-8a77-403d-a9f1-49d34962c3f7\" (UID: \"e78c00c6-8a77-403d-a9f1-49d34962c3f7\") " Mar 16 17:00:51 crc kubenswrapper[5120]: I0316 17:00:51.381076 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/e78c00c6-8a77-403d-a9f1-49d34962c3f7-config-data-custom\") pod \"e78c00c6-8a77-403d-a9f1-49d34962c3f7\" (UID: \"e78c00c6-8a77-403d-a9f1-49d34962c3f7\") " Mar 16 17:00:51 crc kubenswrapper[5120]: I0316 17:00:51.381583 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t9wqh\" (UniqueName: \"kubernetes.io/projected/e78c00c6-8a77-403d-a9f1-49d34962c3f7-kube-api-access-t9wqh\") pod \"e78c00c6-8a77-403d-a9f1-49d34962c3f7\" (UID: \"e78c00c6-8a77-403d-a9f1-49d34962c3f7\") " Mar 16 17:00:51 crc kubenswrapper[5120]: I0316 17:00:51.381696 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e78c00c6-8a77-403d-a9f1-49d34962c3f7-internal-tls-certs\") pod \"e78c00c6-8a77-403d-a9f1-49d34962c3f7\" (UID: \"e78c00c6-8a77-403d-a9f1-49d34962c3f7\") " Mar 16 17:00:51 crc kubenswrapper[5120]: I0316 17:00:51.378873 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e78c00c6-8a77-403d-a9f1-49d34962c3f7-logs" (OuterVolumeSpecName: "logs") pod "e78c00c6-8a77-403d-a9f1-49d34962c3f7" (UID: "e78c00c6-8a77-403d-a9f1-49d34962c3f7"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:00:51 crc kubenswrapper[5120]: I0316 17:00:51.391087 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e78c00c6-8a77-403d-a9f1-49d34962c3f7-logs\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:51 crc kubenswrapper[5120]: I0316 17:00:51.394453 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e78c00c6-8a77-403d-a9f1-49d34962c3f7-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "e78c00c6-8a77-403d-a9f1-49d34962c3f7" (UID: "e78c00c6-8a77-403d-a9f1-49d34962c3f7"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:51 crc kubenswrapper[5120]: I0316 17:00:51.397864 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-scheduler-0" podStartSLOduration=10.397843019 podStartE2EDuration="10.397843019s" podCreationTimestamp="2026-03-16 17:00:41 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:00:51.361856725 +0000 UTC m=+5353.515788382" watchObservedRunningTime="2026-03-16 17:00:51.397843019 +0000 UTC m=+5353.551774686" Mar 16 17:00:51 crc kubenswrapper[5120]: I0316 17:00:51.421163 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e78c00c6-8a77-403d-a9f1-49d34962c3f7-kube-api-access-t9wqh" (OuterVolumeSpecName: "kube-api-access-t9wqh") pod "e78c00c6-8a77-403d-a9f1-49d34962c3f7" (UID: "e78c00c6-8a77-403d-a9f1-49d34962c3f7"). InnerVolumeSpecName "kube-api-access-t9wqh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:00:51 crc kubenswrapper[5120]: I0316 17:00:51.421708 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-5b9b97df74-9rl5z" Mar 16 17:00:51 crc kubenswrapper[5120]: I0316 17:00:51.425103 5120 scope.go:117] "RemoveContainer" containerID="667c0b4c5c210d8d2e00d4c0137f5f162ac03573aade3cb4dcbc340cb9470ded" Mar 16 17:00:51 crc kubenswrapper[5120]: I0316 17:00:51.434845 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 17:00:51 crc kubenswrapper[5120]: I0316 17:00:51.498661 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9c429916-2d70-42f0-a572-90ab8aafafbe-combined-ca-bundle\") pod \"9c429916-2d70-42f0-a572-90ab8aafafbe\" (UID: \"9c429916-2d70-42f0-a572-90ab8aafafbe\") " Mar 16 17:00:51 crc kubenswrapper[5120]: I0316 17:00:51.498737 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/9c429916-2d70-42f0-a572-90ab8aafafbe-internal-tls-certs\") pod \"9c429916-2d70-42f0-a572-90ab8aafafbe\" (UID: \"9c429916-2d70-42f0-a572-90ab8aafafbe\") " Mar 16 17:00:51 crc kubenswrapper[5120]: I0316 17:00:51.499021 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xx7jk\" (UniqueName: \"kubernetes.io/projected/9c429916-2d70-42f0-a572-90ab8aafafbe-kube-api-access-xx7jk\") pod \"9c429916-2d70-42f0-a572-90ab8aafafbe\" (UID: \"9c429916-2d70-42f0-a572-90ab8aafafbe\") " Mar 16 17:00:51 crc kubenswrapper[5120]: I0316 17:00:51.499070 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9c429916-2d70-42f0-a572-90ab8aafafbe-logs\") pod \"9c429916-2d70-42f0-a572-90ab8aafafbe\" (UID: \"9c429916-2d70-42f0-a572-90ab8aafafbe\") " Mar 16 17:00:51 crc kubenswrapper[5120]: I0316 17:00:51.499128 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9c429916-2d70-42f0-a572-90ab8aafafbe-config-data\") pod \"9c429916-2d70-42f0-a572-90ab8aafafbe\" (UID: \"9c429916-2d70-42f0-a572-90ab8aafafbe\") " Mar 16 17:00:51 crc kubenswrapper[5120]: I0316 17:00:51.499397 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9c429916-2d70-42f0-a572-90ab8aafafbe-scripts\") pod \"9c429916-2d70-42f0-a572-90ab8aafafbe\" (UID: \"9c429916-2d70-42f0-a572-90ab8aafafbe\") " Mar 16 17:00:51 crc kubenswrapper[5120]: I0316 17:00:51.499440 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/9c429916-2d70-42f0-a572-90ab8aafafbe-public-tls-certs\") pod \"9c429916-2d70-42f0-a572-90ab8aafafbe\" (UID: \"9c429916-2d70-42f0-a572-90ab8aafafbe\") " Mar 16 17:00:51 crc kubenswrapper[5120]: I0316 17:00:51.500388 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/e78c00c6-8a77-403d-a9f1-49d34962c3f7-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:51 crc kubenswrapper[5120]: I0316 17:00:51.500416 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t9wqh\" (UniqueName: \"kubernetes.io/projected/e78c00c6-8a77-403d-a9f1-49d34962c3f7-kube-api-access-t9wqh\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:51 crc kubenswrapper[5120]: I0316 17:00:51.504214 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c429916-2d70-42f0-a572-90ab8aafafbe-logs" (OuterVolumeSpecName: "logs") pod "9c429916-2d70-42f0-a572-90ab8aafafbe" (UID: "9c429916-2d70-42f0-a572-90ab8aafafbe"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:00:51 crc kubenswrapper[5120]: I0316 17:00:51.510835 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 17:00:51 crc kubenswrapper[5120]: I0316 17:00:51.525999 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c429916-2d70-42f0-a572-90ab8aafafbe-kube-api-access-xx7jk" (OuterVolumeSpecName: "kube-api-access-xx7jk") pod "9c429916-2d70-42f0-a572-90ab8aafafbe" (UID: "9c429916-2d70-42f0-a572-90ab8aafafbe"). InnerVolumeSpecName "kube-api-access-xx7jk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:00:51 crc kubenswrapper[5120]: I0316 17:00:51.529907 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9c429916-2d70-42f0-a572-90ab8aafafbe-scripts" (OuterVolumeSpecName: "scripts") pod "9c429916-2d70-42f0-a572-90ab8aafafbe" (UID: "9c429916-2d70-42f0-a572-90ab8aafafbe"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:51 crc kubenswrapper[5120]: I0316 17:00:51.545834 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 17:00:51 crc kubenswrapper[5120]: I0316 17:00:51.547331 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a519f6d6-0bc7-43f3-9ad7-98a44f627488" containerName="ovn-northd" Mar 16 17:00:51 crc kubenswrapper[5120]: I0316 17:00:51.547360 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a519f6d6-0bc7-43f3-9ad7-98a44f627488" containerName="ovn-northd" Mar 16 17:00:51 crc kubenswrapper[5120]: I0316 17:00:51.547386 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c429916-2d70-42f0-a572-90ab8aafafbe" containerName="placement-log" Mar 16 17:00:51 crc kubenswrapper[5120]: I0316 17:00:51.547396 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c429916-2d70-42f0-a572-90ab8aafafbe" containerName="placement-log" Mar 16 17:00:51 crc kubenswrapper[5120]: I0316 17:00:51.547418 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4c74a5c-86a6-4bcf-b660-10a42c6a2be1" containerName="barbican-keystone-listener-log" Mar 16 17:00:51 crc kubenswrapper[5120]: I0316 17:00:51.547427 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4c74a5c-86a6-4bcf-b660-10a42c6a2be1" containerName="barbican-keystone-listener-log" Mar 16 17:00:51 crc kubenswrapper[5120]: I0316 17:00:51.547448 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e78c00c6-8a77-403d-a9f1-49d34962c3f7" containerName="barbican-api" Mar 16 17:00:51 crc kubenswrapper[5120]: I0316 17:00:51.547455 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e78c00c6-8a77-403d-a9f1-49d34962c3f7" containerName="barbican-api" Mar 16 17:00:51 crc kubenswrapper[5120]: I0316 17:00:51.547469 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c429916-2d70-42f0-a572-90ab8aafafbe" containerName="placement-api" Mar 16 17:00:51 crc kubenswrapper[5120]: I0316 17:00:51.547476 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c429916-2d70-42f0-a572-90ab8aafafbe" containerName="placement-api" Mar 16 17:00:51 crc kubenswrapper[5120]: I0316 17:00:51.547485 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4c74a5c-86a6-4bcf-b660-10a42c6a2be1" containerName="barbican-keystone-listener" Mar 16 17:00:51 crc kubenswrapper[5120]: I0316 17:00:51.547490 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4c74a5c-86a6-4bcf-b660-10a42c6a2be1" containerName="barbican-keystone-listener" Mar 16 17:00:51 crc kubenswrapper[5120]: I0316 17:00:51.547503 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e78c00c6-8a77-403d-a9f1-49d34962c3f7" containerName="barbican-api-log" Mar 16 17:00:51 crc kubenswrapper[5120]: I0316 17:00:51.547512 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e78c00c6-8a77-403d-a9f1-49d34962c3f7" containerName="barbican-api-log" Mar 16 17:00:51 crc kubenswrapper[5120]: I0316 17:00:51.547543 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a519f6d6-0bc7-43f3-9ad7-98a44f627488" containerName="openstack-network-exporter" Mar 16 17:00:51 crc kubenswrapper[5120]: I0316 17:00:51.547549 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a519f6d6-0bc7-43f3-9ad7-98a44f627488" containerName="openstack-network-exporter" Mar 16 17:00:51 crc kubenswrapper[5120]: I0316 17:00:51.547751 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="a519f6d6-0bc7-43f3-9ad7-98a44f627488" containerName="ovn-northd" Mar 16 17:00:51 crc kubenswrapper[5120]: I0316 17:00:51.547801 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="9c429916-2d70-42f0-a572-90ab8aafafbe" containerName="placement-log" Mar 16 17:00:51 crc kubenswrapper[5120]: I0316 17:00:51.547812 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="d4c74a5c-86a6-4bcf-b660-10a42c6a2be1" containerName="barbican-keystone-listener-log" Mar 16 17:00:51 crc kubenswrapper[5120]: I0316 17:00:51.547827 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e78c00c6-8a77-403d-a9f1-49d34962c3f7" containerName="barbican-api-log" Mar 16 17:00:51 crc kubenswrapper[5120]: I0316 17:00:51.547846 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e78c00c6-8a77-403d-a9f1-49d34962c3f7" containerName="barbican-api" Mar 16 17:00:51 crc kubenswrapper[5120]: I0316 17:00:51.547856 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="a519f6d6-0bc7-43f3-9ad7-98a44f627488" containerName="openstack-network-exporter" Mar 16 17:00:51 crc kubenswrapper[5120]: I0316 17:00:51.547866 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="9c429916-2d70-42f0-a572-90ab8aafafbe" containerName="placement-api" Mar 16 17:00:51 crc kubenswrapper[5120]: I0316 17:00:51.547874 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="d4c74a5c-86a6-4bcf-b660-10a42c6a2be1" containerName="barbican-keystone-listener" Mar 16 17:00:51 crc kubenswrapper[5120]: I0316 17:00:51.592005 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e78c00c6-8a77-403d-a9f1-49d34962c3f7-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "e78c00c6-8a77-403d-a9f1-49d34962c3f7" (UID: "e78c00c6-8a77-403d-a9f1-49d34962c3f7"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:51 crc kubenswrapper[5120]: I0316 17:00:51.599885 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e78c00c6-8a77-403d-a9f1-49d34962c3f7-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e78c00c6-8a77-403d-a9f1-49d34962c3f7" (UID: "e78c00c6-8a77-403d-a9f1-49d34962c3f7"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:51 crc kubenswrapper[5120]: I0316 17:00:51.602890 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e78c00c6-8a77-403d-a9f1-49d34962c3f7-config-data" (OuterVolumeSpecName: "config-data") pod "e78c00c6-8a77-403d-a9f1-49d34962c3f7" (UID: "e78c00c6-8a77-403d-a9f1-49d34962c3f7"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:51 crc kubenswrapper[5120]: I0316 17:00:51.603427 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e78c00c6-8a77-403d-a9f1-49d34962c3f7-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:51 crc kubenswrapper[5120]: I0316 17:00:51.603456 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9c429916-2d70-42f0-a572-90ab8aafafbe-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:51 crc kubenswrapper[5120]: I0316 17:00:51.603465 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e78c00c6-8a77-403d-a9f1-49d34962c3f7-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:51 crc kubenswrapper[5120]: I0316 17:00:51.603476 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xx7jk\" (UniqueName: \"kubernetes.io/projected/9c429916-2d70-42f0-a572-90ab8aafafbe-kube-api-access-xx7jk\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:51 crc kubenswrapper[5120]: I0316 17:00:51.603485 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9c429916-2d70-42f0-a572-90ab8aafafbe-logs\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:51 crc kubenswrapper[5120]: I0316 17:00:51.603498 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e78c00c6-8a77-403d-a9f1-49d34962c3f7-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:51 crc kubenswrapper[5120]: I0316 17:00:51.622732 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 17:00:51 crc kubenswrapper[5120]: I0316 17:00:51.623250 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:00:51 crc kubenswrapper[5120]: I0316 17:00:51.633984 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ovnnorthd-ovndbs\"" Mar 16 17:00:51 crc kubenswrapper[5120]: I0316 17:00:51.634294 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovnnorthd-scripts\"" Mar 16 17:00:51 crc kubenswrapper[5120]: I0316 17:00:51.634466 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovnnorthd-config\"" Mar 16 17:00:51 crc kubenswrapper[5120]: I0316 17:00:51.635083 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ovnnorthd-ovnnorthd-dockercfg-swqbh\"" Mar 16 17:00:51 crc kubenswrapper[5120]: I0316 17:00:51.652803 5120 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 17:00:51 crc kubenswrapper[5120]: I0316 17:00:51.705781 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9pxj9\" (UniqueName: \"kubernetes.io/projected/615448b7-8677-4a99-93ba-64a2388a6dcc-kube-api-access-9pxj9\") pod \"ovn-northd-0\" (UID: \"615448b7-8677-4a99-93ba-64a2388a6dcc\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:00:51 crc kubenswrapper[5120]: I0316 17:00:51.705842 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/615448b7-8677-4a99-93ba-64a2388a6dcc-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"615448b7-8677-4a99-93ba-64a2388a6dcc\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:00:51 crc kubenswrapper[5120]: I0316 17:00:51.705974 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/615448b7-8677-4a99-93ba-64a2388a6dcc-config\") pod \"ovn-northd-0\" (UID: \"615448b7-8677-4a99-93ba-64a2388a6dcc\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:00:51 crc kubenswrapper[5120]: I0316 17:00:51.706201 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/615448b7-8677-4a99-93ba-64a2388a6dcc-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"615448b7-8677-4a99-93ba-64a2388a6dcc\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:00:51 crc kubenswrapper[5120]: I0316 17:00:51.706242 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/615448b7-8677-4a99-93ba-64a2388a6dcc-scripts\") pod \"ovn-northd-0\" (UID: \"615448b7-8677-4a99-93ba-64a2388a6dcc\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:00:51 crc kubenswrapper[5120]: I0316 17:00:51.706279 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/615448b7-8677-4a99-93ba-64a2388a6dcc-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"615448b7-8677-4a99-93ba-64a2388a6dcc\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:00:51 crc kubenswrapper[5120]: I0316 17:00:51.706339 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/615448b7-8677-4a99-93ba-64a2388a6dcc-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"615448b7-8677-4a99-93ba-64a2388a6dcc\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:00:51 crc kubenswrapper[5120]: I0316 17:00:51.755889 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e78c00c6-8a77-403d-a9f1-49d34962c3f7-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "e78c00c6-8a77-403d-a9f1-49d34962c3f7" (UID: "e78c00c6-8a77-403d-a9f1-49d34962c3f7"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:51 crc kubenswrapper[5120]: I0316 17:00:51.809468 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/615448b7-8677-4a99-93ba-64a2388a6dcc-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"615448b7-8677-4a99-93ba-64a2388a6dcc\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:00:51 crc kubenswrapper[5120]: I0316 17:00:51.809554 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/615448b7-8677-4a99-93ba-64a2388a6dcc-scripts\") pod \"ovn-northd-0\" (UID: \"615448b7-8677-4a99-93ba-64a2388a6dcc\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:00:51 crc kubenswrapper[5120]: I0316 17:00:51.809620 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/615448b7-8677-4a99-93ba-64a2388a6dcc-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"615448b7-8677-4a99-93ba-64a2388a6dcc\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:00:51 crc kubenswrapper[5120]: I0316 17:00:51.809698 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/615448b7-8677-4a99-93ba-64a2388a6dcc-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"615448b7-8677-4a99-93ba-64a2388a6dcc\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:00:51 crc kubenswrapper[5120]: I0316 17:00:51.809940 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9pxj9\" (UniqueName: \"kubernetes.io/projected/615448b7-8677-4a99-93ba-64a2388a6dcc-kube-api-access-9pxj9\") pod \"ovn-northd-0\" (UID: \"615448b7-8677-4a99-93ba-64a2388a6dcc\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:00:51 crc kubenswrapper[5120]: I0316 17:00:51.809987 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/615448b7-8677-4a99-93ba-64a2388a6dcc-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"615448b7-8677-4a99-93ba-64a2388a6dcc\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:00:51 crc kubenswrapper[5120]: I0316 17:00:51.810138 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/615448b7-8677-4a99-93ba-64a2388a6dcc-config\") pod \"ovn-northd-0\" (UID: \"615448b7-8677-4a99-93ba-64a2388a6dcc\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:00:51 crc kubenswrapper[5120]: I0316 17:00:51.810429 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e78c00c6-8a77-403d-a9f1-49d34962c3f7-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:51 crc kubenswrapper[5120]: I0316 17:00:51.811615 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/615448b7-8677-4a99-93ba-64a2388a6dcc-config\") pod \"ovn-northd-0\" (UID: \"615448b7-8677-4a99-93ba-64a2388a6dcc\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:00:51 crc kubenswrapper[5120]: I0316 17:00:51.812453 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/615448b7-8677-4a99-93ba-64a2388a6dcc-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"615448b7-8677-4a99-93ba-64a2388a6dcc\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:00:51 crc kubenswrapper[5120]: I0316 17:00:51.813060 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/615448b7-8677-4a99-93ba-64a2388a6dcc-scripts\") pod \"ovn-northd-0\" (UID: \"615448b7-8677-4a99-93ba-64a2388a6dcc\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:00:51 crc kubenswrapper[5120]: I0316 17:00:51.817554 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/615448b7-8677-4a99-93ba-64a2388a6dcc-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"615448b7-8677-4a99-93ba-64a2388a6dcc\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:00:51 crc kubenswrapper[5120]: I0316 17:00:51.822419 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/615448b7-8677-4a99-93ba-64a2388a6dcc-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"615448b7-8677-4a99-93ba-64a2388a6dcc\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:00:51 crc kubenswrapper[5120]: I0316 17:00:51.829210 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/615448b7-8677-4a99-93ba-64a2388a6dcc-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"615448b7-8677-4a99-93ba-64a2388a6dcc\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:00:51 crc kubenswrapper[5120]: I0316 17:00:51.833025 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9pxj9\" (UniqueName: \"kubernetes.io/projected/615448b7-8677-4a99-93ba-64a2388a6dcc-kube-api-access-9pxj9\") pod \"ovn-northd-0\" (UID: \"615448b7-8677-4a99-93ba-64a2388a6dcc\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:00:51 crc kubenswrapper[5120]: I0316 17:00:51.883917 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9c429916-2d70-42f0-a572-90ab8aafafbe-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "9c429916-2d70-42f0-a572-90ab8aafafbe" (UID: "9c429916-2d70-42f0-a572-90ab8aafafbe"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:51 crc kubenswrapper[5120]: E0316 17:00:51.894051 5120 fsHandler.go:119] failed to collect filesystem stats - rootDiskErr: could not stat "/var/lib/containers/storage/overlay/30f123a459d381add036ca0bf4529244aa262f5036fd2a24066cf3f4d3e1ee1a/diff" to get inode usage: stat /var/lib/containers/storage/overlay/30f123a459d381add036ca0bf4529244aa262f5036fd2a24066cf3f4d3e1ee1a/diff: no such file or directory, extraDiskErr: could not stat "/var/log/pods/openstack-kuttl-tests_nova-cell0-conductor-0_7712130b-a000-4541-a1b1-7442adb622f7/nova-cell0-conductor-conductor/0.log" to get inode usage: stat /var/log/pods/openstack-kuttl-tests_nova-cell0-conductor-0_7712130b-a000-4541-a1b1-7442adb622f7/nova-cell0-conductor-conductor/0.log: no such file or directory Mar 16 17:00:51 crc kubenswrapper[5120]: I0316 17:00:51.913804 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9c429916-2d70-42f0-a572-90ab8aafafbe-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:51 crc kubenswrapper[5120]: I0316 17:00:51.935136 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9c429916-2d70-42f0-a572-90ab8aafafbe-config-data" (OuterVolumeSpecName: "config-data") pod "9c429916-2d70-42f0-a572-90ab8aafafbe" (UID: "9c429916-2d70-42f0-a572-90ab8aafafbe"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:51 crc kubenswrapper[5120]: I0316 17:00:51.941899 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9c429916-2d70-42f0-a572-90ab8aafafbe-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "9c429916-2d70-42f0-a572-90ab8aafafbe" (UID: "9c429916-2d70-42f0-a572-90ab8aafafbe"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:51 crc kubenswrapper[5120]: I0316 17:00:51.989672 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9c429916-2d70-42f0-a572-90ab8aafafbe-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "9c429916-2d70-42f0-a572-90ab8aafafbe" (UID: "9c429916-2d70-42f0-a572-90ab8aafafbe"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:52 crc kubenswrapper[5120]: I0316 17:00:52.016965 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/9c429916-2d70-42f0-a572-90ab8aafafbe-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:52 crc kubenswrapper[5120]: I0316 17:00:52.017004 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/9c429916-2d70-42f0-a572-90ab8aafafbe-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:52 crc kubenswrapper[5120]: I0316 17:00:52.017018 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9c429916-2d70-42f0-a572-90ab8aafafbe-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:52 crc kubenswrapper[5120]: I0316 17:00:52.080292 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:00:52 crc kubenswrapper[5120]: I0316 17:00:52.336968 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"61d14db6-7d33-4e5f-8252-844441e519d7","Type":"ContainerStarted","Data":"7cfb9cd38cd92ddc829e10b730d811e074d528fb177d79e12bdb69b5efe0978c"} Mar 16 17:00:52 crc kubenswrapper[5120]: I0316 17:00:52.337613 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 17:00:52 crc kubenswrapper[5120]: I0316 17:00:52.353558 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"ab76f235-6a48-4935-a2d5-5a79806c416c","Type":"ContainerStarted","Data":"472402137f246ce709088b3f0d51afee3215744c5a0d4026e8c342a19b0acee2"} Mar 16 17:00:52 crc kubenswrapper[5120]: I0316 17:00:52.369453 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"0fdecce9-8602-457d-8eec-c97b359170dd","Type":"ContainerStarted","Data":"13db0eeaeb1f2cf2000ab74839313ccae7e410cc64de56f0aa772b702b92719c"} Mar 16 17:00:52 crc kubenswrapper[5120]: I0316 17:00:52.397884 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-5b9b97df74-9rl5z" Mar 16 17:00:52 crc kubenswrapper[5120]: I0316 17:00:52.399592 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-5b9b97df74-9rl5z" event={"ID":"9c429916-2d70-42f0-a572-90ab8aafafbe","Type":"ContainerDied","Data":"8bbb4b9ac5e73a3c5982e6e3cb81df81774ea281b4ed6d95df533b9469474139"} Mar 16 17:00:52 crc kubenswrapper[5120]: I0316 17:00:52.399753 5120 scope.go:117] "RemoveContainer" containerID="3ece0d70ebee943dfa6da07bcdd8a9f1af493f5fb471bb0e8264cf34758995a3" Mar 16 17:00:52 crc kubenswrapper[5120]: I0316 17:00:52.401596 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-5b7968964b-sgwq2" Mar 16 17:00:52 crc kubenswrapper[5120]: I0316 17:00:52.413608 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:00:52 crc kubenswrapper[5120]: I0316 17:00:52.440818 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstack-galera-0" podStartSLOduration=10.440796766 podStartE2EDuration="10.440796766s" podCreationTimestamp="2026-03-16 17:00:42 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:00:52.386023417 +0000 UTC m=+5354.539955064" watchObservedRunningTime="2026-03-16 17:00:52.440796766 +0000 UTC m=+5354.594728423" Mar 16 17:00:52 crc kubenswrapper[5120]: I0316 17:00:52.459924 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-internal-api-0" podStartSLOduration=8.459906529 podStartE2EDuration="8.459906529s" podCreationTimestamp="2026-03-16 17:00:44 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:00:52.418936477 +0000 UTC m=+5354.572868144" watchObservedRunningTime="2026-03-16 17:00:52.459906529 +0000 UTC m=+5354.613838186" Mar 16 17:00:52 crc kubenswrapper[5120]: I0316 17:00:52.510047 5120 scope.go:117] "RemoveContainer" containerID="8c3e9f0e4cad0fda0af2b317f990769cd6b26ce52d37356ab5cfcec66dfb8757" Mar 16 17:00:52 crc kubenswrapper[5120]: I0316 17:00:52.512193 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/memcached-0" Mar 16 17:00:52 crc kubenswrapper[5120]: I0316 17:00:52.523372 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-5b9b97df74-9rl5z"] Mar 16 17:00:52 crc kubenswrapper[5120]: I0316 17:00:52.524846 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:00:52 crc kubenswrapper[5120]: I0316 17:00:52.526456 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:00:52 crc kubenswrapper[5120]: I0316 17:00:52.555695 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-5b9b97df74-9rl5z"] Mar 16 17:00:52 crc kubenswrapper[5120]: I0316 17:00:52.566956 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="2cadcb9e-2a3b-4c14-8fcc-39939326678f" containerName="cinder-scheduler" probeResult="failure" output="Get \"http://10.217.1.87:8080/\": dial tcp 10.217.1.87:8080: connect: connection refused" Mar 16 17:00:52 crc kubenswrapper[5120]: I0316 17:00:52.572511 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:00:52 crc kubenswrapper[5120]: I0316 17:00:52.588995 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:00:52 crc kubenswrapper[5120]: I0316 17:00:52.611724 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-5b7968964b-sgwq2"] Mar 16 17:00:52 crc kubenswrapper[5120]: I0316 17:00:52.657987 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-api-5b7968964b-sgwq2"] Mar 16 17:00:52 crc kubenswrapper[5120]: I0316 17:00:52.709827 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c429916-2d70-42f0-a572-90ab8aafafbe" path="/var/lib/kubelet/pods/9c429916-2d70-42f0-a572-90ab8aafafbe/volumes" Mar 16 17:00:52 crc kubenswrapper[5120]: I0316 17:00:52.712751 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a519f6d6-0bc7-43f3-9ad7-98a44f627488" path="/var/lib/kubelet/pods/a519f6d6-0bc7-43f3-9ad7-98a44f627488/volumes" Mar 16 17:00:52 crc kubenswrapper[5120]: I0316 17:00:52.713429 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e78c00c6-8a77-403d-a9f1-49d34962c3f7" path="/var/lib/kubelet/pods/e78c00c6-8a77-403d-a9f1-49d34962c3f7/volumes" Mar 16 17:00:52 crc kubenswrapper[5120]: I0316 17:00:52.753824 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 17:00:52 crc kubenswrapper[5120]: I0316 17:00:52.838644 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-5f9fc84dc4-7nfss"] Mar 16 17:00:52 crc kubenswrapper[5120]: I0316 17:00:52.839010 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/keystone-5f9fc84dc4-7nfss" podUID="bdbf2033-4671-473e-9ede-ce2611d51fac" containerName="keystone-api" containerID="cri-o://99fb8edbf3d8a29e8de3b518723f36b5914f77d494d2927272dec17802ad898c" gracePeriod=30 Mar 16 17:00:52 crc kubenswrapper[5120]: I0316 17:00:52.880955 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-6cb5f74687-7bbcw"] Mar 16 17:00:52 crc kubenswrapper[5120]: I0316 17:00:52.921456 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-6cb5f74687-7bbcw" Mar 16 17:00:52 crc kubenswrapper[5120]: I0316 17:00:52.950230 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-6cb5f74687-7bbcw"] Mar 16 17:00:52 crc kubenswrapper[5120]: I0316 17:00:52.981501 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/04658afd-5440-4feb-a1a2-3232b641b558-scripts\") pod \"keystone-6cb5f74687-7bbcw\" (UID: \"04658afd-5440-4feb-a1a2-3232b641b558\") " pod="openstack-kuttl-tests/keystone-6cb5f74687-7bbcw" Mar 16 17:00:52 crc kubenswrapper[5120]: I0316 17:00:52.981697 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcrbs\" (UniqueName: \"kubernetes.io/projected/04658afd-5440-4feb-a1a2-3232b641b558-kube-api-access-vcrbs\") pod \"keystone-6cb5f74687-7bbcw\" (UID: \"04658afd-5440-4feb-a1a2-3232b641b558\") " pod="openstack-kuttl-tests/keystone-6cb5f74687-7bbcw" Mar 16 17:00:52 crc kubenswrapper[5120]: I0316 17:00:52.981840 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/04658afd-5440-4feb-a1a2-3232b641b558-fernet-keys\") pod \"keystone-6cb5f74687-7bbcw\" (UID: \"04658afd-5440-4feb-a1a2-3232b641b558\") " pod="openstack-kuttl-tests/keystone-6cb5f74687-7bbcw" Mar 16 17:00:52 crc kubenswrapper[5120]: I0316 17:00:52.982004 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/04658afd-5440-4feb-a1a2-3232b641b558-combined-ca-bundle\") pod \"keystone-6cb5f74687-7bbcw\" (UID: \"04658afd-5440-4feb-a1a2-3232b641b558\") " pod="openstack-kuttl-tests/keystone-6cb5f74687-7bbcw" Mar 16 17:00:52 crc kubenswrapper[5120]: I0316 17:00:52.982031 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/04658afd-5440-4feb-a1a2-3232b641b558-public-tls-certs\") pod \"keystone-6cb5f74687-7bbcw\" (UID: \"04658afd-5440-4feb-a1a2-3232b641b558\") " pod="openstack-kuttl-tests/keystone-6cb5f74687-7bbcw" Mar 16 17:00:52 crc kubenswrapper[5120]: I0316 17:00:52.982059 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/04658afd-5440-4feb-a1a2-3232b641b558-internal-tls-certs\") pod \"keystone-6cb5f74687-7bbcw\" (UID: \"04658afd-5440-4feb-a1a2-3232b641b558\") " pod="openstack-kuttl-tests/keystone-6cb5f74687-7bbcw" Mar 16 17:00:52 crc kubenswrapper[5120]: I0316 17:00:52.982094 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/04658afd-5440-4feb-a1a2-3232b641b558-config-data\") pod \"keystone-6cb5f74687-7bbcw\" (UID: \"04658afd-5440-4feb-a1a2-3232b641b558\") " pod="openstack-kuttl-tests/keystone-6cb5f74687-7bbcw" Mar 16 17:00:52 crc kubenswrapper[5120]: I0316 17:00:52.982112 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/04658afd-5440-4feb-a1a2-3232b641b558-credential-keys\") pod \"keystone-6cb5f74687-7bbcw\" (UID: \"04658afd-5440-4feb-a1a2-3232b641b558\") " pod="openstack-kuttl-tests/keystone-6cb5f74687-7bbcw" Mar 16 17:00:53 crc kubenswrapper[5120]: I0316 17:00:53.089425 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/04658afd-5440-4feb-a1a2-3232b641b558-scripts\") pod \"keystone-6cb5f74687-7bbcw\" (UID: \"04658afd-5440-4feb-a1a2-3232b641b558\") " pod="openstack-kuttl-tests/keystone-6cb5f74687-7bbcw" Mar 16 17:00:53 crc kubenswrapper[5120]: I0316 17:00:53.089603 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vcrbs\" (UniqueName: \"kubernetes.io/projected/04658afd-5440-4feb-a1a2-3232b641b558-kube-api-access-vcrbs\") pod \"keystone-6cb5f74687-7bbcw\" (UID: \"04658afd-5440-4feb-a1a2-3232b641b558\") " pod="openstack-kuttl-tests/keystone-6cb5f74687-7bbcw" Mar 16 17:00:53 crc kubenswrapper[5120]: I0316 17:00:53.089728 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/04658afd-5440-4feb-a1a2-3232b641b558-fernet-keys\") pod \"keystone-6cb5f74687-7bbcw\" (UID: \"04658afd-5440-4feb-a1a2-3232b641b558\") " pod="openstack-kuttl-tests/keystone-6cb5f74687-7bbcw" Mar 16 17:00:53 crc kubenswrapper[5120]: I0316 17:00:53.089895 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/04658afd-5440-4feb-a1a2-3232b641b558-combined-ca-bundle\") pod \"keystone-6cb5f74687-7bbcw\" (UID: \"04658afd-5440-4feb-a1a2-3232b641b558\") " pod="openstack-kuttl-tests/keystone-6cb5f74687-7bbcw" Mar 16 17:00:53 crc kubenswrapper[5120]: I0316 17:00:53.089940 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/04658afd-5440-4feb-a1a2-3232b641b558-public-tls-certs\") pod \"keystone-6cb5f74687-7bbcw\" (UID: \"04658afd-5440-4feb-a1a2-3232b641b558\") " pod="openstack-kuttl-tests/keystone-6cb5f74687-7bbcw" Mar 16 17:00:53 crc kubenswrapper[5120]: I0316 17:00:53.089981 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/04658afd-5440-4feb-a1a2-3232b641b558-internal-tls-certs\") pod \"keystone-6cb5f74687-7bbcw\" (UID: \"04658afd-5440-4feb-a1a2-3232b641b558\") " pod="openstack-kuttl-tests/keystone-6cb5f74687-7bbcw" Mar 16 17:00:53 crc kubenswrapper[5120]: I0316 17:00:53.090022 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/04658afd-5440-4feb-a1a2-3232b641b558-config-data\") pod \"keystone-6cb5f74687-7bbcw\" (UID: \"04658afd-5440-4feb-a1a2-3232b641b558\") " pod="openstack-kuttl-tests/keystone-6cb5f74687-7bbcw" Mar 16 17:00:53 crc kubenswrapper[5120]: I0316 17:00:53.090041 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/04658afd-5440-4feb-a1a2-3232b641b558-credential-keys\") pod \"keystone-6cb5f74687-7bbcw\" (UID: \"04658afd-5440-4feb-a1a2-3232b641b558\") " pod="openstack-kuttl-tests/keystone-6cb5f74687-7bbcw" Mar 16 17:00:53 crc kubenswrapper[5120]: I0316 17:00:53.099290 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/04658afd-5440-4feb-a1a2-3232b641b558-internal-tls-certs\") pod \"keystone-6cb5f74687-7bbcw\" (UID: \"04658afd-5440-4feb-a1a2-3232b641b558\") " pod="openstack-kuttl-tests/keystone-6cb5f74687-7bbcw" Mar 16 17:00:53 crc kubenswrapper[5120]: I0316 17:00:53.099800 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/04658afd-5440-4feb-a1a2-3232b641b558-combined-ca-bundle\") pod \"keystone-6cb5f74687-7bbcw\" (UID: \"04658afd-5440-4feb-a1a2-3232b641b558\") " pod="openstack-kuttl-tests/keystone-6cb5f74687-7bbcw" Mar 16 17:00:53 crc kubenswrapper[5120]: I0316 17:00:53.101859 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/04658afd-5440-4feb-a1a2-3232b641b558-credential-keys\") pod \"keystone-6cb5f74687-7bbcw\" (UID: \"04658afd-5440-4feb-a1a2-3232b641b558\") " pod="openstack-kuttl-tests/keystone-6cb5f74687-7bbcw" Mar 16 17:00:53 crc kubenswrapper[5120]: I0316 17:00:53.102031 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/04658afd-5440-4feb-a1a2-3232b641b558-fernet-keys\") pod \"keystone-6cb5f74687-7bbcw\" (UID: \"04658afd-5440-4feb-a1a2-3232b641b558\") " pod="openstack-kuttl-tests/keystone-6cb5f74687-7bbcw" Mar 16 17:00:53 crc kubenswrapper[5120]: I0316 17:00:53.106662 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/04658afd-5440-4feb-a1a2-3232b641b558-config-data\") pod \"keystone-6cb5f74687-7bbcw\" (UID: \"04658afd-5440-4feb-a1a2-3232b641b558\") " pod="openstack-kuttl-tests/keystone-6cb5f74687-7bbcw" Mar 16 17:00:53 crc kubenswrapper[5120]: I0316 17:00:53.118994 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/04658afd-5440-4feb-a1a2-3232b641b558-public-tls-certs\") pod \"keystone-6cb5f74687-7bbcw\" (UID: \"04658afd-5440-4feb-a1a2-3232b641b558\") " pod="openstack-kuttl-tests/keystone-6cb5f74687-7bbcw" Mar 16 17:00:53 crc kubenswrapper[5120]: I0316 17:00:53.119925 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcrbs\" (UniqueName: \"kubernetes.io/projected/04658afd-5440-4feb-a1a2-3232b641b558-kube-api-access-vcrbs\") pod \"keystone-6cb5f74687-7bbcw\" (UID: \"04658afd-5440-4feb-a1a2-3232b641b558\") " pod="openstack-kuttl-tests/keystone-6cb5f74687-7bbcw" Mar 16 17:00:53 crc kubenswrapper[5120]: I0316 17:00:53.126688 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/04658afd-5440-4feb-a1a2-3232b641b558-scripts\") pod \"keystone-6cb5f74687-7bbcw\" (UID: \"04658afd-5440-4feb-a1a2-3232b641b558\") " pod="openstack-kuttl-tests/keystone-6cb5f74687-7bbcw" Mar 16 17:00:53 crc kubenswrapper[5120]: I0316 17:00:53.269968 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-6cb5f74687-7bbcw" Mar 16 17:00:53 crc kubenswrapper[5120]: I0316 17:00:53.294852 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/keystone-5f9fc84dc4-7nfss" podUID="bdbf2033-4671-473e-9ede-ce2611d51fac" containerName="keystone-api" probeResult="failure" output="Get \"https://10.217.1.84:5000/v3\": read tcp 10.217.0.2:33200->10.217.1.84:5000: read: connection reset by peer" Mar 16 17:00:53 crc kubenswrapper[5120]: I0316 17:00:53.308136 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:00:53 crc kubenswrapper[5120]: I0316 17:00:53.333487 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:00:53 crc kubenswrapper[5120]: I0316 17:00:53.388383 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:00:53 crc kubenswrapper[5120]: I0316 17:00:53.388468 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:00:53 crc kubenswrapper[5120]: I0316 17:00:53.398579 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:00:53 crc kubenswrapper[5120]: I0316 17:00:53.532497 5120 generic.go:358] "Generic (PLEG): container finished" podID="284dc632-d111-40d1-97a9-f6e78aa92ce7" containerID="853bc5cbb6b2905c3f52af799cf24c043e5f94333c04f7d4cc83f8fb47830175" exitCode=1 Mar 16 17:00:53 crc kubenswrapper[5120]: I0316 17:00:53.532771 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"284dc632-d111-40d1-97a9-f6e78aa92ce7","Type":"ContainerDied","Data":"853bc5cbb6b2905c3f52af799cf24c043e5f94333c04f7d4cc83f8fb47830175"} Mar 16 17:00:53 crc kubenswrapper[5120]: I0316 17:00:53.533326 5120 scope.go:117] "RemoveContainer" containerID="853bc5cbb6b2905c3f52af799cf24c043e5f94333c04f7d4cc83f8fb47830175" Mar 16 17:00:53 crc kubenswrapper[5120]: I0316 17:00:53.539839 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:00:53 crc kubenswrapper[5120]: I0316 17:00:53.567666 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"615448b7-8677-4a99-93ba-64a2388a6dcc","Type":"ContainerStarted","Data":"e035fad40aa52d287a6919e996a209abac082912f4c792b979746bdd509712a5"} Mar 16 17:00:53 crc kubenswrapper[5120]: I0316 17:00:53.567890 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"615448b7-8677-4a99-93ba-64a2388a6dcc","Type":"ContainerStarted","Data":"f7c63580126db55650667f8bc05d59546a627363558e5c5f426c2752ec02efd8"} Mar 16 17:00:53 crc kubenswrapper[5120]: I0316 17:00:53.567982 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"615448b7-8677-4a99-93ba-64a2388a6dcc","Type":"ContainerStarted","Data":"6aa06a1c8ea1e04a955109eac76fc4835dd6b36a46467c4ef7e69cf61c54dd1c"} Mar 16 17:00:53 crc kubenswrapper[5120]: I0316 17:00:53.569300 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:00:53 crc kubenswrapper[5120]: I0316 17:00:53.583484 5120 generic.go:358] "Generic (PLEG): container finished" podID="bdbf2033-4671-473e-9ede-ce2611d51fac" containerID="99fb8edbf3d8a29e8de3b518723f36b5914f77d494d2927272dec17802ad898c" exitCode=0 Mar 16 17:00:53 crc kubenswrapper[5120]: I0316 17:00:53.584104 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-5f9fc84dc4-7nfss" event={"ID":"bdbf2033-4671-473e-9ede-ce2611d51fac","Type":"ContainerDied","Data":"99fb8edbf3d8a29e8de3b518723f36b5914f77d494d2927272dec17802ad898c"} Mar 16 17:00:53 crc kubenswrapper[5120]: I0316 17:00:53.628016 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovn-northd-0" podStartSLOduration=2.62799043 podStartE2EDuration="2.62799043s" podCreationTimestamp="2026-03-16 17:00:51 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:00:53.611608021 +0000 UTC m=+5355.765539688" watchObservedRunningTime="2026-03-16 17:00:53.62799043 +0000 UTC m=+5355.781922087" Mar 16 17:00:53 crc kubenswrapper[5120]: I0316 17:00:53.647997 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:00:53 crc kubenswrapper[5120]: I0316 17:00:53.820256 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-6cb5f74687-7bbcw"] Mar 16 17:00:53 crc kubenswrapper[5120]: I0316 17:00:53.911197 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openstack-kuttl-tests/barbican-api-8579c6748-8wfdq" podUID="6f3cdac2-9246-455c-b05a-347b4db60b7f" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.1.83:9311/healthcheck\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 17:00:54 crc kubenswrapper[5120]: I0316 17:00:54.058011 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-5f9fc84dc4-7nfss" Mar 16 17:00:54 crc kubenswrapper[5120]: I0316 17:00:54.142879 5120 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 17:00:54 crc kubenswrapper[5120]: I0316 17:00:54.158512 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/bdbf2033-4671-473e-9ede-ce2611d51fac-credential-keys\") pod \"bdbf2033-4671-473e-9ede-ce2611d51fac\" (UID: \"bdbf2033-4671-473e-9ede-ce2611d51fac\") " Mar 16 17:00:54 crc kubenswrapper[5120]: I0316 17:00:54.158638 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/bdbf2033-4671-473e-9ede-ce2611d51fac-public-tls-certs\") pod \"bdbf2033-4671-473e-9ede-ce2611d51fac\" (UID: \"bdbf2033-4671-473e-9ede-ce2611d51fac\") " Mar 16 17:00:54 crc kubenswrapper[5120]: I0316 17:00:54.158776 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bdbf2033-4671-473e-9ede-ce2611d51fac-config-data\") pod \"bdbf2033-4671-473e-9ede-ce2611d51fac\" (UID: \"bdbf2033-4671-473e-9ede-ce2611d51fac\") " Mar 16 17:00:54 crc kubenswrapper[5120]: I0316 17:00:54.159103 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/bdbf2033-4671-473e-9ede-ce2611d51fac-internal-tls-certs\") pod \"bdbf2033-4671-473e-9ede-ce2611d51fac\" (UID: \"bdbf2033-4671-473e-9ede-ce2611d51fac\") " Mar 16 17:00:54 crc kubenswrapper[5120]: I0316 17:00:54.159205 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/bdbf2033-4671-473e-9ede-ce2611d51fac-fernet-keys\") pod \"bdbf2033-4671-473e-9ede-ce2611d51fac\" (UID: \"bdbf2033-4671-473e-9ede-ce2611d51fac\") " Mar 16 17:00:54 crc kubenswrapper[5120]: I0316 17:00:54.159225 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bdbf2033-4671-473e-9ede-ce2611d51fac-combined-ca-bundle\") pod \"bdbf2033-4671-473e-9ede-ce2611d51fac\" (UID: \"bdbf2033-4671-473e-9ede-ce2611d51fac\") " Mar 16 17:00:54 crc kubenswrapper[5120]: I0316 17:00:54.159263 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/bdbf2033-4671-473e-9ede-ce2611d51fac-scripts\") pod \"bdbf2033-4671-473e-9ede-ce2611d51fac\" (UID: \"bdbf2033-4671-473e-9ede-ce2611d51fac\") " Mar 16 17:00:54 crc kubenswrapper[5120]: I0316 17:00:54.159295 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ms7pw\" (UniqueName: \"kubernetes.io/projected/bdbf2033-4671-473e-9ede-ce2611d51fac-kube-api-access-ms7pw\") pod \"bdbf2033-4671-473e-9ede-ce2611d51fac\" (UID: \"bdbf2033-4671-473e-9ede-ce2611d51fac\") " Mar 16 17:00:54 crc kubenswrapper[5120]: I0316 17:00:54.167091 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bdbf2033-4671-473e-9ede-ce2611d51fac-scripts" (OuterVolumeSpecName: "scripts") pod "bdbf2033-4671-473e-9ede-ce2611d51fac" (UID: "bdbf2033-4671-473e-9ede-ce2611d51fac"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:54 crc kubenswrapper[5120]: I0316 17:00:54.168179 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bdbf2033-4671-473e-9ede-ce2611d51fac-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "bdbf2033-4671-473e-9ede-ce2611d51fac" (UID: "bdbf2033-4671-473e-9ede-ce2611d51fac"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:54 crc kubenswrapper[5120]: I0316 17:00:54.171957 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bdbf2033-4671-473e-9ede-ce2611d51fac-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "bdbf2033-4671-473e-9ede-ce2611d51fac" (UID: "bdbf2033-4671-473e-9ede-ce2611d51fac"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:54 crc kubenswrapper[5120]: I0316 17:00:54.178327 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bdbf2033-4671-473e-9ede-ce2611d51fac-kube-api-access-ms7pw" (OuterVolumeSpecName: "kube-api-access-ms7pw") pod "bdbf2033-4671-473e-9ede-ce2611d51fac" (UID: "bdbf2033-4671-473e-9ede-ce2611d51fac"). InnerVolumeSpecName "kube-api-access-ms7pw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:00:54 crc kubenswrapper[5120]: I0316 17:00:54.210992 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bdbf2033-4671-473e-9ede-ce2611d51fac-config-data" (OuterVolumeSpecName: "config-data") pod "bdbf2033-4671-473e-9ede-ce2611d51fac" (UID: "bdbf2033-4671-473e-9ede-ce2611d51fac"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:54 crc kubenswrapper[5120]: I0316 17:00:54.221879 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bdbf2033-4671-473e-9ede-ce2611d51fac-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "bdbf2033-4671-473e-9ede-ce2611d51fac" (UID: "bdbf2033-4671-473e-9ede-ce2611d51fac"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:54 crc kubenswrapper[5120]: I0316 17:00:54.255366 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bdbf2033-4671-473e-9ede-ce2611d51fac-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "bdbf2033-4671-473e-9ede-ce2611d51fac" (UID: "bdbf2033-4671-473e-9ede-ce2611d51fac"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:54 crc kubenswrapper[5120]: I0316 17:00:54.258935 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bdbf2033-4671-473e-9ede-ce2611d51fac-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "bdbf2033-4671-473e-9ede-ce2611d51fac" (UID: "bdbf2033-4671-473e-9ede-ce2611d51fac"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:54 crc kubenswrapper[5120]: I0316 17:00:54.262562 5120 reconciler_common.go:299] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/bdbf2033-4671-473e-9ede-ce2611d51fac-credential-keys\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:54 crc kubenswrapper[5120]: I0316 17:00:54.262595 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/bdbf2033-4671-473e-9ede-ce2611d51fac-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:54 crc kubenswrapper[5120]: I0316 17:00:54.262604 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bdbf2033-4671-473e-9ede-ce2611d51fac-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:54 crc kubenswrapper[5120]: I0316 17:00:54.262633 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/bdbf2033-4671-473e-9ede-ce2611d51fac-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:54 crc kubenswrapper[5120]: I0316 17:00:54.262642 5120 reconciler_common.go:299] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/bdbf2033-4671-473e-9ede-ce2611d51fac-fernet-keys\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:54 crc kubenswrapper[5120]: I0316 17:00:54.262650 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bdbf2033-4671-473e-9ede-ce2611d51fac-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:54 crc kubenswrapper[5120]: I0316 17:00:54.262658 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/bdbf2033-4671-473e-9ede-ce2611d51fac-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:54 crc kubenswrapper[5120]: I0316 17:00:54.262669 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ms7pw\" (UniqueName: \"kubernetes.io/projected/bdbf2033-4671-473e-9ede-ce2611d51fac-kube-api-access-ms7pw\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:54 crc kubenswrapper[5120]: I0316 17:00:54.597136 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-5f9fc84dc4-7nfss" Mar 16 17:00:54 crc kubenswrapper[5120]: I0316 17:00:54.597466 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-5f9fc84dc4-7nfss" event={"ID":"bdbf2033-4671-473e-9ede-ce2611d51fac","Type":"ContainerDied","Data":"6a9fd81ac5ab6d6384a09d8f12c8b03f6ccc15b49c065de4a42bd18b0f1b5e27"} Mar 16 17:00:54 crc kubenswrapper[5120]: I0316 17:00:54.597511 5120 scope.go:117] "RemoveContainer" containerID="99fb8edbf3d8a29e8de3b518723f36b5914f77d494d2927272dec17802ad898c" Mar 16 17:00:54 crc kubenswrapper[5120]: I0316 17:00:54.606079 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-6cb5f74687-7bbcw" event={"ID":"04658afd-5440-4feb-a1a2-3232b641b558","Type":"ContainerStarted","Data":"ec54314107d232b9b6dc6fa69411e61406a6e8472585c507180fff0ecb54cae4"} Mar 16 17:00:54 crc kubenswrapper[5120]: I0316 17:00:54.606352 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/keystone-6cb5f74687-7bbcw" Mar 16 17:00:54 crc kubenswrapper[5120]: I0316 17:00:54.606371 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-6cb5f74687-7bbcw" event={"ID":"04658afd-5440-4feb-a1a2-3232b641b558","Type":"ContainerStarted","Data":"a2fb16437e1da6cad3cdd1299f150d1a6ecf86ff190316056ffe4cc4a919f605"} Mar 16 17:00:54 crc kubenswrapper[5120]: I0316 17:00:54.619394 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"284dc632-d111-40d1-97a9-f6e78aa92ce7","Type":"ContainerStarted","Data":"c87cdce774051210b03731c88d545718b1887f3878a50a3fc79d5fc070ffb305"} Mar 16 17:00:54 crc kubenswrapper[5120]: I0316 17:00:54.619500 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 17:00:54 crc kubenswrapper[5120]: I0316 17:00:54.713475 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-6cb5f74687-7bbcw" podStartSLOduration=2.71344739 podStartE2EDuration="2.71344739s" podCreationTimestamp="2026-03-16 17:00:52 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:00:54.641137901 +0000 UTC m=+5356.795069568" watchObservedRunningTime="2026-03-16 17:00:54.71344739 +0000 UTC m=+5356.867379057" Mar 16 17:00:54 crc kubenswrapper[5120]: I0316 17:00:54.750748 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-5f9fc84dc4-7nfss"] Mar 16 17:00:54 crc kubenswrapper[5120]: I0316 17:00:54.760002 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-5f9fc84dc4-7nfss"] Mar 16 17:00:55 crc kubenswrapper[5120]: I0316 17:00:55.022909 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:00:55 crc kubenswrapper[5120]: I0316 17:00:55.022970 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:00:55 crc kubenswrapper[5120]: I0316 17:00:55.022984 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:00:55 crc kubenswrapper[5120]: I0316 17:00:55.023638 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:00:55 crc kubenswrapper[5120]: I0316 17:00:55.157635 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:00:55 crc kubenswrapper[5120]: I0316 17:00:55.157723 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:00:55 crc kubenswrapper[5120]: I0316 17:00:55.206101 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:00:55 crc kubenswrapper[5120]: I0316 17:00:55.209713 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:00:55 crc kubenswrapper[5120]: I0316 17:00:55.508527 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:00:55 crc kubenswrapper[5120]: I0316 17:00:55.671389 5120 generic.go:358] "Generic (PLEG): container finished" podID="61d14db6-7d33-4e5f-8252-844441e519d7" containerID="7cfb9cd38cd92ddc829e10b730d811e074d528fb177d79e12bdb69b5efe0978c" exitCode=1 Mar 16 17:00:55 crc kubenswrapper[5120]: I0316 17:00:55.671682 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"61d14db6-7d33-4e5f-8252-844441e519d7","Type":"ContainerDied","Data":"7cfb9cd38cd92ddc829e10b730d811e074d528fb177d79e12bdb69b5efe0978c"} Mar 16 17:00:55 crc kubenswrapper[5120]: I0316 17:00:55.671722 5120 scope.go:117] "RemoveContainer" containerID="09ec4943c048e912f15eb43af459b9cf3ee8d9cf445b19b9f73bee58b9f168b2" Mar 16 17:00:55 crc kubenswrapper[5120]: I0316 17:00:55.672252 5120 scope.go:117] "RemoveContainer" containerID="7cfb9cd38cd92ddc829e10b730d811e074d528fb177d79e12bdb69b5efe0978c" Mar 16 17:00:55 crc kubenswrapper[5120]: E0316 17:00:55.672556 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nova-cell1-conductor-conductor\" with CrashLoopBackOff: \"back-off 10s restarting failed container=nova-cell1-conductor-conductor pod=nova-cell1-conductor-0_openstack-kuttl-tests(61d14db6-7d33-4e5f-8252-844441e519d7)\"" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="61d14db6-7d33-4e5f-8252-844441e519d7" Mar 16 17:00:55 crc kubenswrapper[5120]: I0316 17:00:55.697390 5120 generic.go:358] "Generic (PLEG): container finished" podID="e956ba16-b745-4928-b574-a942ab68fd58" containerID="7cedd4f074f018190db9d89f7269449dd1c5b8a2dd44584e7e8fefcf284b2d18" exitCode=0 Mar 16 17:00:55 crc kubenswrapper[5120]: I0316 17:00:55.698928 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-7dcbb9bcc5-6bd78" event={"ID":"e956ba16-b745-4928-b574-a942ab68fd58","Type":"ContainerDied","Data":"7cedd4f074f018190db9d89f7269449dd1c5b8a2dd44584e7e8fefcf284b2d18"} Mar 16 17:00:55 crc kubenswrapper[5120]: I0316 17:00:55.702818 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:00:55 crc kubenswrapper[5120]: I0316 17:00:55.702928 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:00:55 crc kubenswrapper[5120]: I0316 17:00:55.928078 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:00:56 crc kubenswrapper[5120]: I0316 17:00:56.030882 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="ce24ae83-459d-4410-bd4d-fb7e0fcad044" containerName="nova-metadata-log" probeResult="failure" output="Get \"https://10.217.1.94:8775/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Mar 16 17:00:56 crc kubenswrapper[5120]: I0316 17:00:56.031273 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="0d641338-e35d-4819-b487-513c8840cfd7" containerName="nova-api-api" probeResult="failure" output="Get \"https://10.217.1.93:8774/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Mar 16 17:00:56 crc kubenswrapper[5120]: I0316 17:00:56.031407 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="ce24ae83-459d-4410-bd4d-fb7e0fcad044" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"https://10.217.1.94:8775/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Mar 16 17:00:56 crc kubenswrapper[5120]: I0316 17:00:56.035016 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="0d641338-e35d-4819-b487-513c8840cfd7" containerName="nova-api-log" probeResult="failure" output="Get \"https://10.217.1.93:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 17:00:56 crc kubenswrapper[5120]: I0316 17:00:56.080957 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-7dcbb9bcc5-6bd78" Mar 16 17:00:56 crc kubenswrapper[5120]: I0316 17:00:56.146181 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:00:56 crc kubenswrapper[5120]: I0316 17:00:56.146252 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:00:56 crc kubenswrapper[5120]: I0316 17:00:56.179421 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/e956ba16-b745-4928-b574-a942ab68fd58-config-data-custom\") pod \"e956ba16-b745-4928-b574-a942ab68fd58\" (UID: \"e956ba16-b745-4928-b574-a942ab68fd58\") " Mar 16 17:00:56 crc kubenswrapper[5120]: I0316 17:00:56.179510 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e956ba16-b745-4928-b574-a942ab68fd58-logs\") pod \"e956ba16-b745-4928-b574-a942ab68fd58\" (UID: \"e956ba16-b745-4928-b574-a942ab68fd58\") " Mar 16 17:00:56 crc kubenswrapper[5120]: I0316 17:00:56.179637 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5z58m\" (UniqueName: \"kubernetes.io/projected/e956ba16-b745-4928-b574-a942ab68fd58-kube-api-access-5z58m\") pod \"e956ba16-b745-4928-b574-a942ab68fd58\" (UID: \"e956ba16-b745-4928-b574-a942ab68fd58\") " Mar 16 17:00:56 crc kubenswrapper[5120]: I0316 17:00:56.179712 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e956ba16-b745-4928-b574-a942ab68fd58-combined-ca-bundle\") pod \"e956ba16-b745-4928-b574-a942ab68fd58\" (UID: \"e956ba16-b745-4928-b574-a942ab68fd58\") " Mar 16 17:00:56 crc kubenswrapper[5120]: I0316 17:00:56.180204 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e956ba16-b745-4928-b574-a942ab68fd58-config-data\") pod \"e956ba16-b745-4928-b574-a942ab68fd58\" (UID: \"e956ba16-b745-4928-b574-a942ab68fd58\") " Mar 16 17:00:56 crc kubenswrapper[5120]: I0316 17:00:56.183085 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e956ba16-b745-4928-b574-a942ab68fd58-logs" (OuterVolumeSpecName: "logs") pod "e956ba16-b745-4928-b574-a942ab68fd58" (UID: "e956ba16-b745-4928-b574-a942ab68fd58"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:00:56 crc kubenswrapper[5120]: I0316 17:00:56.215444 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e956ba16-b745-4928-b574-a942ab68fd58-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "e956ba16-b745-4928-b574-a942ab68fd58" (UID: "e956ba16-b745-4928-b574-a942ab68fd58"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:56 crc kubenswrapper[5120]: I0316 17:00:56.220270 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e956ba16-b745-4928-b574-a942ab68fd58-kube-api-access-5z58m" (OuterVolumeSpecName: "kube-api-access-5z58m") pod "e956ba16-b745-4928-b574-a942ab68fd58" (UID: "e956ba16-b745-4928-b574-a942ab68fd58"). InnerVolumeSpecName "kube-api-access-5z58m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:00:56 crc kubenswrapper[5120]: I0316 17:00:56.228986 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:00:56 crc kubenswrapper[5120]: I0316 17:00:56.245849 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:00:56 crc kubenswrapper[5120]: I0316 17:00:56.252980 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e956ba16-b745-4928-b574-a942ab68fd58-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e956ba16-b745-4928-b574-a942ab68fd58" (UID: "e956ba16-b745-4928-b574-a942ab68fd58"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:56 crc kubenswrapper[5120]: I0316 17:00:56.284080 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/e956ba16-b745-4928-b574-a942ab68fd58-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:56 crc kubenswrapper[5120]: I0316 17:00:56.284128 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e956ba16-b745-4928-b574-a942ab68fd58-logs\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:56 crc kubenswrapper[5120]: I0316 17:00:56.285448 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5z58m\" (UniqueName: \"kubernetes.io/projected/e956ba16-b745-4928-b574-a942ab68fd58-kube-api-access-5z58m\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:56 crc kubenswrapper[5120]: I0316 17:00:56.285468 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e956ba16-b745-4928-b574-a942ab68fd58-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:56 crc kubenswrapper[5120]: I0316 17:00:56.330417 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-57589895fd-84tvt"] Mar 16 17:00:56 crc kubenswrapper[5120]: I0316 17:00:56.331052 5120 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Mar 16 17:00:56 crc kubenswrapper[5120]: I0316 17:00:56.332263 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-57589895fd-84tvt" podUID="08933bb0-40b0-4b92-b9d1-af46cdcc8aad" containerName="placement-log" containerID="cri-o://6c5ab5c25f8f32671ed1d3f8ef0839c556632b36cd0e8b390fd2983c34cf090a" gracePeriod=30 Mar 16 17:00:56 crc kubenswrapper[5120]: I0316 17:00:56.332538 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-57589895fd-84tvt" podUID="08933bb0-40b0-4b92-b9d1-af46cdcc8aad" containerName="placement-api" containerID="cri-o://d9ab28b0a7ccb773ffd22dadcda722c1f6eda9f10071fd99c7e5612da79f866f" gracePeriod=30 Mar 16 17:00:56 crc kubenswrapper[5120]: I0316 17:00:56.342985 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/placement-57589895fd-84tvt" podUID="08933bb0-40b0-4b92-b9d1-af46cdcc8aad" containerName="placement-log" probeResult="failure" output="Get \"https://10.217.1.82:8778/\": EOF" Mar 16 17:00:56 crc kubenswrapper[5120]: I0316 17:00:56.352305 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/placement-57589895fd-84tvt" podUID="08933bb0-40b0-4b92-b9d1-af46cdcc8aad" containerName="placement-api" probeResult="failure" output="Get \"https://10.217.1.82:8778/\": EOF" Mar 16 17:00:56 crc kubenswrapper[5120]: I0316 17:00:56.356412 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-566756f6db-ctqm9"] Mar 16 17:00:56 crc kubenswrapper[5120]: I0316 17:00:56.357701 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e956ba16-b745-4928-b574-a942ab68fd58" containerName="barbican-worker" Mar 16 17:00:56 crc kubenswrapper[5120]: I0316 17:00:56.357725 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e956ba16-b745-4928-b574-a942ab68fd58" containerName="barbican-worker" Mar 16 17:00:56 crc kubenswrapper[5120]: I0316 17:00:56.357771 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e956ba16-b745-4928-b574-a942ab68fd58" containerName="barbican-worker-log" Mar 16 17:00:56 crc kubenswrapper[5120]: I0316 17:00:56.357782 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e956ba16-b745-4928-b574-a942ab68fd58" containerName="barbican-worker-log" Mar 16 17:00:56 crc kubenswrapper[5120]: I0316 17:00:56.357802 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bdbf2033-4671-473e-9ede-ce2611d51fac" containerName="keystone-api" Mar 16 17:00:56 crc kubenswrapper[5120]: I0316 17:00:56.357809 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="bdbf2033-4671-473e-9ede-ce2611d51fac" containerName="keystone-api" Mar 16 17:00:56 crc kubenswrapper[5120]: I0316 17:00:56.360820 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e956ba16-b745-4928-b574-a942ab68fd58" containerName="barbican-worker-log" Mar 16 17:00:56 crc kubenswrapper[5120]: I0316 17:00:56.360874 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="bdbf2033-4671-473e-9ede-ce2611d51fac" containerName="keystone-api" Mar 16 17:00:56 crc kubenswrapper[5120]: I0316 17:00:56.360888 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e956ba16-b745-4928-b574-a942ab68fd58" containerName="barbican-worker" Mar 16 17:00:56 crc kubenswrapper[5120]: I0316 17:00:56.387194 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e956ba16-b745-4928-b574-a942ab68fd58-config-data" (OuterVolumeSpecName: "config-data") pod "e956ba16-b745-4928-b574-a942ab68fd58" (UID: "e956ba16-b745-4928-b574-a942ab68fd58"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:00:56 crc kubenswrapper[5120]: I0316 17:00:56.394679 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e956ba16-b745-4928-b574-a942ab68fd58-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:00:56 crc kubenswrapper[5120]: I0316 17:00:56.401011 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-566756f6db-ctqm9" Mar 16 17:00:56 crc kubenswrapper[5120]: I0316 17:00:56.425403 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/cinder-api-0" podUID="b7434cde-890e-42d9-9b5c-bbd60a188517" containerName="cinder-api" probeResult="failure" output="Get \"https://10.217.1.79:8776/healthcheck\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 17:00:56 crc kubenswrapper[5120]: I0316 17:00:56.479098 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-566756f6db-ctqm9"] Mar 16 17:00:56 crc kubenswrapper[5120]: I0316 17:00:56.501238 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9s85r\" (UniqueName: \"kubernetes.io/projected/a91dab0d-d649-40d4-ae7e-84cb276b1119-kube-api-access-9s85r\") pod \"placement-566756f6db-ctqm9\" (UID: \"a91dab0d-d649-40d4-ae7e-84cb276b1119\") " pod="openstack-kuttl-tests/placement-566756f6db-ctqm9" Mar 16 17:00:56 crc kubenswrapper[5120]: I0316 17:00:56.501376 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a91dab0d-d649-40d4-ae7e-84cb276b1119-logs\") pod \"placement-566756f6db-ctqm9\" (UID: \"a91dab0d-d649-40d4-ae7e-84cb276b1119\") " pod="openstack-kuttl-tests/placement-566756f6db-ctqm9" Mar 16 17:00:56 crc kubenswrapper[5120]: I0316 17:00:56.501462 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a91dab0d-d649-40d4-ae7e-84cb276b1119-config-data\") pod \"placement-566756f6db-ctqm9\" (UID: \"a91dab0d-d649-40d4-ae7e-84cb276b1119\") " pod="openstack-kuttl-tests/placement-566756f6db-ctqm9" Mar 16 17:00:56 crc kubenswrapper[5120]: I0316 17:00:56.501548 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/a91dab0d-d649-40d4-ae7e-84cb276b1119-internal-tls-certs\") pod \"placement-566756f6db-ctqm9\" (UID: \"a91dab0d-d649-40d4-ae7e-84cb276b1119\") " pod="openstack-kuttl-tests/placement-566756f6db-ctqm9" Mar 16 17:00:56 crc kubenswrapper[5120]: I0316 17:00:56.501619 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/a91dab0d-d649-40d4-ae7e-84cb276b1119-public-tls-certs\") pod \"placement-566756f6db-ctqm9\" (UID: \"a91dab0d-d649-40d4-ae7e-84cb276b1119\") " pod="openstack-kuttl-tests/placement-566756f6db-ctqm9" Mar 16 17:00:56 crc kubenswrapper[5120]: I0316 17:00:56.501786 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a91dab0d-d649-40d4-ae7e-84cb276b1119-combined-ca-bundle\") pod \"placement-566756f6db-ctqm9\" (UID: \"a91dab0d-d649-40d4-ae7e-84cb276b1119\") " pod="openstack-kuttl-tests/placement-566756f6db-ctqm9" Mar 16 17:00:56 crc kubenswrapper[5120]: I0316 17:00:56.502070 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a91dab0d-d649-40d4-ae7e-84cb276b1119-scripts\") pod \"placement-566756f6db-ctqm9\" (UID: \"a91dab0d-d649-40d4-ae7e-84cb276b1119\") " pod="openstack-kuttl-tests/placement-566756f6db-ctqm9" Mar 16 17:00:56 crc kubenswrapper[5120]: I0316 17:00:56.603956 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a91dab0d-d649-40d4-ae7e-84cb276b1119-combined-ca-bundle\") pod \"placement-566756f6db-ctqm9\" (UID: \"a91dab0d-d649-40d4-ae7e-84cb276b1119\") " pod="openstack-kuttl-tests/placement-566756f6db-ctqm9" Mar 16 17:00:56 crc kubenswrapper[5120]: I0316 17:00:56.604230 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a91dab0d-d649-40d4-ae7e-84cb276b1119-scripts\") pod \"placement-566756f6db-ctqm9\" (UID: \"a91dab0d-d649-40d4-ae7e-84cb276b1119\") " pod="openstack-kuttl-tests/placement-566756f6db-ctqm9" Mar 16 17:00:56 crc kubenswrapper[5120]: I0316 17:00:56.604640 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9s85r\" (UniqueName: \"kubernetes.io/projected/a91dab0d-d649-40d4-ae7e-84cb276b1119-kube-api-access-9s85r\") pod \"placement-566756f6db-ctqm9\" (UID: \"a91dab0d-d649-40d4-ae7e-84cb276b1119\") " pod="openstack-kuttl-tests/placement-566756f6db-ctqm9" Mar 16 17:00:56 crc kubenswrapper[5120]: I0316 17:00:56.604865 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a91dab0d-d649-40d4-ae7e-84cb276b1119-logs\") pod \"placement-566756f6db-ctqm9\" (UID: \"a91dab0d-d649-40d4-ae7e-84cb276b1119\") " pod="openstack-kuttl-tests/placement-566756f6db-ctqm9" Mar 16 17:00:56 crc kubenswrapper[5120]: I0316 17:00:56.605017 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a91dab0d-d649-40d4-ae7e-84cb276b1119-config-data\") pod \"placement-566756f6db-ctqm9\" (UID: \"a91dab0d-d649-40d4-ae7e-84cb276b1119\") " pod="openstack-kuttl-tests/placement-566756f6db-ctqm9" Mar 16 17:00:56 crc kubenswrapper[5120]: I0316 17:00:56.605184 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/a91dab0d-d649-40d4-ae7e-84cb276b1119-internal-tls-certs\") pod \"placement-566756f6db-ctqm9\" (UID: \"a91dab0d-d649-40d4-ae7e-84cb276b1119\") " pod="openstack-kuttl-tests/placement-566756f6db-ctqm9" Mar 16 17:00:56 crc kubenswrapper[5120]: I0316 17:00:56.605329 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/a91dab0d-d649-40d4-ae7e-84cb276b1119-public-tls-certs\") pod \"placement-566756f6db-ctqm9\" (UID: \"a91dab0d-d649-40d4-ae7e-84cb276b1119\") " pod="openstack-kuttl-tests/placement-566756f6db-ctqm9" Mar 16 17:00:56 crc kubenswrapper[5120]: I0316 17:00:56.606129 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a91dab0d-d649-40d4-ae7e-84cb276b1119-logs\") pod \"placement-566756f6db-ctqm9\" (UID: \"a91dab0d-d649-40d4-ae7e-84cb276b1119\") " pod="openstack-kuttl-tests/placement-566756f6db-ctqm9" Mar 16 17:00:56 crc kubenswrapper[5120]: I0316 17:00:56.610244 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a91dab0d-d649-40d4-ae7e-84cb276b1119-scripts\") pod \"placement-566756f6db-ctqm9\" (UID: \"a91dab0d-d649-40d4-ae7e-84cb276b1119\") " pod="openstack-kuttl-tests/placement-566756f6db-ctqm9" Mar 16 17:00:56 crc kubenswrapper[5120]: I0316 17:00:56.610725 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a91dab0d-d649-40d4-ae7e-84cb276b1119-combined-ca-bundle\") pod \"placement-566756f6db-ctqm9\" (UID: \"a91dab0d-d649-40d4-ae7e-84cb276b1119\") " pod="openstack-kuttl-tests/placement-566756f6db-ctqm9" Mar 16 17:00:56 crc kubenswrapper[5120]: I0316 17:00:56.610733 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a91dab0d-d649-40d4-ae7e-84cb276b1119-config-data\") pod \"placement-566756f6db-ctqm9\" (UID: \"a91dab0d-d649-40d4-ae7e-84cb276b1119\") " pod="openstack-kuttl-tests/placement-566756f6db-ctqm9" Mar 16 17:00:56 crc kubenswrapper[5120]: I0316 17:00:56.611815 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/a91dab0d-d649-40d4-ae7e-84cb276b1119-internal-tls-certs\") pod \"placement-566756f6db-ctqm9\" (UID: \"a91dab0d-d649-40d4-ae7e-84cb276b1119\") " pod="openstack-kuttl-tests/placement-566756f6db-ctqm9" Mar 16 17:00:56 crc kubenswrapper[5120]: I0316 17:00:56.612354 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/a91dab0d-d649-40d4-ae7e-84cb276b1119-public-tls-certs\") pod \"placement-566756f6db-ctqm9\" (UID: \"a91dab0d-d649-40d4-ae7e-84cb276b1119\") " pod="openstack-kuttl-tests/placement-566756f6db-ctqm9" Mar 16 17:00:56 crc kubenswrapper[5120]: I0316 17:00:56.624619 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9s85r\" (UniqueName: \"kubernetes.io/projected/a91dab0d-d649-40d4-ae7e-84cb276b1119-kube-api-access-9s85r\") pod \"placement-566756f6db-ctqm9\" (UID: \"a91dab0d-d649-40d4-ae7e-84cb276b1119\") " pod="openstack-kuttl-tests/placement-566756f6db-ctqm9" Mar 16 17:00:56 crc kubenswrapper[5120]: I0316 17:00:56.675030 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bdbf2033-4671-473e-9ede-ce2611d51fac" path="/var/lib/kubelet/pods/bdbf2033-4671-473e-9ede-ce2611d51fac/volumes" Mar 16 17:00:56 crc kubenswrapper[5120]: I0316 17:00:56.713442 5120 generic.go:358] "Generic (PLEG): container finished" podID="08933bb0-40b0-4b92-b9d1-af46cdcc8aad" containerID="6c5ab5c25f8f32671ed1d3f8ef0839c556632b36cd0e8b390fd2983c34cf090a" exitCode=143 Mar 16 17:00:56 crc kubenswrapper[5120]: I0316 17:00:56.713873 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-57589895fd-84tvt" event={"ID":"08933bb0-40b0-4b92-b9d1-af46cdcc8aad","Type":"ContainerDied","Data":"6c5ab5c25f8f32671ed1d3f8ef0839c556632b36cd0e8b390fd2983c34cf090a"} Mar 16 17:00:56 crc kubenswrapper[5120]: I0316 17:00:56.719467 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-7dcbb9bcc5-6bd78" event={"ID":"e956ba16-b745-4928-b574-a942ab68fd58","Type":"ContainerDied","Data":"98d03f3990c308ab154fb822cfcf79d1654a2f6cee0bd521075d48c26af32d8d"} Mar 16 17:00:56 crc kubenswrapper[5120]: I0316 17:00:56.719598 5120 scope.go:117] "RemoveContainer" containerID="7cedd4f074f018190db9d89f7269449dd1c5b8a2dd44584e7e8fefcf284b2d18" Mar 16 17:00:56 crc kubenswrapper[5120]: I0316 17:00:56.720138 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-7dcbb9bcc5-6bd78" Mar 16 17:00:56 crc kubenswrapper[5120]: I0316 17:00:56.720357 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:00:56 crc kubenswrapper[5120]: I0316 17:00:56.720391 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:00:56 crc kubenswrapper[5120]: I0316 17:00:56.750497 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-566756f6db-ctqm9" Mar 16 17:00:56 crc kubenswrapper[5120]: I0316 17:00:56.771943 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-7dcbb9bcc5-6bd78"] Mar 16 17:00:56 crc kubenswrapper[5120]: I0316 17:00:56.777424 5120 scope.go:117] "RemoveContainer" containerID="190c300742841bbd5e9c6e0af99eef15ed79cfe6ad0596b1173acce50cbf6430" Mar 16 17:00:56 crc kubenswrapper[5120]: I0316 17:00:56.780767 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-worker-7dcbb9bcc5-6bd78"] Mar 16 17:00:56 crc kubenswrapper[5120]: I0316 17:00:56.931244 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openstack-kuttl-tests/barbican-api-8579c6748-8wfdq" podUID="6f3cdac2-9246-455c-b05a-347b4db60b7f" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.1.83:9311/healthcheck\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 17:00:57 crc kubenswrapper[5120]: I0316 17:00:57.340038 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-566756f6db-ctqm9"] Mar 16 17:00:57 crc kubenswrapper[5120]: I0316 17:00:57.509934 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-8579c6748-8wfdq" podUID="6f3cdac2-9246-455c-b05a-347b4db60b7f" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.1.83:9311/healthcheck\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Mar 16 17:00:57 crc kubenswrapper[5120]: I0316 17:00:57.513985 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-8579c6748-8wfdq" podUID="6f3cdac2-9246-455c-b05a-347b4db60b7f" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.1.83:9311/healthcheck\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 17:00:57 crc kubenswrapper[5120]: I0316 17:00:57.526406 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:00:57 crc kubenswrapper[5120]: I0316 17:00:57.552481 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-566756f6db-ctqm9"] Mar 16 17:00:57 crc kubenswrapper[5120]: I0316 17:00:57.594958 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-7944fd944b-x8xzf"] Mar 16 17:00:57 crc kubenswrapper[5120]: I0316 17:00:57.629113 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:00:57 crc kubenswrapper[5120]: I0316 17:00:57.629588 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-7944fd944b-x8xzf" Mar 16 17:00:57 crc kubenswrapper[5120]: I0316 17:00:57.630997 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-7944fd944b-x8xzf"] Mar 16 17:00:57 crc kubenswrapper[5120]: I0316 17:00:57.652002 5120 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 17:00:57 crc kubenswrapper[5120]: I0316 17:00:57.652659 5120 scope.go:117] "RemoveContainer" containerID="7cfb9cd38cd92ddc829e10b730d811e074d528fb177d79e12bdb69b5efe0978c" Mar 16 17:00:57 crc kubenswrapper[5120]: E0316 17:00:57.653020 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nova-cell1-conductor-conductor\" with CrashLoopBackOff: \"back-off 10s restarting failed container=nova-cell1-conductor-conductor pod=nova-cell1-conductor-0_openstack-kuttl-tests(61d14db6-7d33-4e5f-8252-844441e519d7)\"" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="61d14db6-7d33-4e5f-8252-844441e519d7" Mar 16 17:00:57 crc kubenswrapper[5120]: I0316 17:00:57.746370 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/15389dad-1183-441e-831c-de27ba4bac6e-combined-ca-bundle\") pod \"placement-7944fd944b-x8xzf\" (UID: \"15389dad-1183-441e-831c-de27ba4bac6e\") " pod="openstack-kuttl-tests/placement-7944fd944b-x8xzf" Mar 16 17:00:57 crc kubenswrapper[5120]: I0316 17:00:57.746695 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/15389dad-1183-441e-831c-de27ba4bac6e-scripts\") pod \"placement-7944fd944b-x8xzf\" (UID: \"15389dad-1183-441e-831c-de27ba4bac6e\") " pod="openstack-kuttl-tests/placement-7944fd944b-x8xzf" Mar 16 17:00:57 crc kubenswrapper[5120]: I0316 17:00:57.746749 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/15389dad-1183-441e-831c-de27ba4bac6e-config-data\") pod \"placement-7944fd944b-x8xzf\" (UID: \"15389dad-1183-441e-831c-de27ba4bac6e\") " pod="openstack-kuttl-tests/placement-7944fd944b-x8xzf" Mar 16 17:00:57 crc kubenswrapper[5120]: I0316 17:00:57.747130 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kd6pw\" (UniqueName: \"kubernetes.io/projected/15389dad-1183-441e-831c-de27ba4bac6e-kube-api-access-kd6pw\") pod \"placement-7944fd944b-x8xzf\" (UID: \"15389dad-1183-441e-831c-de27ba4bac6e\") " pod="openstack-kuttl-tests/placement-7944fd944b-x8xzf" Mar 16 17:00:57 crc kubenswrapper[5120]: I0316 17:00:57.747190 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/15389dad-1183-441e-831c-de27ba4bac6e-public-tls-certs\") pod \"placement-7944fd944b-x8xzf\" (UID: \"15389dad-1183-441e-831c-de27ba4bac6e\") " pod="openstack-kuttl-tests/placement-7944fd944b-x8xzf" Mar 16 17:00:57 crc kubenswrapper[5120]: I0316 17:00:57.747214 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/15389dad-1183-441e-831c-de27ba4bac6e-logs\") pod \"placement-7944fd944b-x8xzf\" (UID: \"15389dad-1183-441e-831c-de27ba4bac6e\") " pod="openstack-kuttl-tests/placement-7944fd944b-x8xzf" Mar 16 17:00:57 crc kubenswrapper[5120]: I0316 17:00:57.747232 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/15389dad-1183-441e-831c-de27ba4bac6e-internal-tls-certs\") pod \"placement-7944fd944b-x8xzf\" (UID: \"15389dad-1183-441e-831c-de27ba4bac6e\") " pod="openstack-kuttl-tests/placement-7944fd944b-x8xzf" Mar 16 17:00:57 crc kubenswrapper[5120]: I0316 17:00:57.753708 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-566756f6db-ctqm9" event={"ID":"a91dab0d-d649-40d4-ae7e-84cb276b1119","Type":"ContainerStarted","Data":"8c8df5a3a376e054bec3ba70517a12b1bbd43e3e26a2236e8d7a1526221be88f"} Mar 16 17:00:57 crc kubenswrapper[5120]: I0316 17:00:57.767000 5120 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Mar 16 17:00:57 crc kubenswrapper[5120]: I0316 17:00:57.827980 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:00:57 crc kubenswrapper[5120]: I0316 17:00:57.849695 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kd6pw\" (UniqueName: \"kubernetes.io/projected/15389dad-1183-441e-831c-de27ba4bac6e-kube-api-access-kd6pw\") pod \"placement-7944fd944b-x8xzf\" (UID: \"15389dad-1183-441e-831c-de27ba4bac6e\") " pod="openstack-kuttl-tests/placement-7944fd944b-x8xzf" Mar 16 17:00:57 crc kubenswrapper[5120]: I0316 17:00:57.849785 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/15389dad-1183-441e-831c-de27ba4bac6e-public-tls-certs\") pod \"placement-7944fd944b-x8xzf\" (UID: \"15389dad-1183-441e-831c-de27ba4bac6e\") " pod="openstack-kuttl-tests/placement-7944fd944b-x8xzf" Mar 16 17:00:57 crc kubenswrapper[5120]: I0316 17:00:57.849805 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/15389dad-1183-441e-831c-de27ba4bac6e-logs\") pod \"placement-7944fd944b-x8xzf\" (UID: \"15389dad-1183-441e-831c-de27ba4bac6e\") " pod="openstack-kuttl-tests/placement-7944fd944b-x8xzf" Mar 16 17:00:57 crc kubenswrapper[5120]: I0316 17:00:57.849821 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/15389dad-1183-441e-831c-de27ba4bac6e-internal-tls-certs\") pod \"placement-7944fd944b-x8xzf\" (UID: \"15389dad-1183-441e-831c-de27ba4bac6e\") " pod="openstack-kuttl-tests/placement-7944fd944b-x8xzf" Mar 16 17:00:57 crc kubenswrapper[5120]: I0316 17:00:57.850032 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/15389dad-1183-441e-831c-de27ba4bac6e-combined-ca-bundle\") pod \"placement-7944fd944b-x8xzf\" (UID: \"15389dad-1183-441e-831c-de27ba4bac6e\") " pod="openstack-kuttl-tests/placement-7944fd944b-x8xzf" Mar 16 17:00:57 crc kubenswrapper[5120]: I0316 17:00:57.850064 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/15389dad-1183-441e-831c-de27ba4bac6e-scripts\") pod \"placement-7944fd944b-x8xzf\" (UID: \"15389dad-1183-441e-831c-de27ba4bac6e\") " pod="openstack-kuttl-tests/placement-7944fd944b-x8xzf" Mar 16 17:00:57 crc kubenswrapper[5120]: I0316 17:00:57.850131 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/15389dad-1183-441e-831c-de27ba4bac6e-config-data\") pod \"placement-7944fd944b-x8xzf\" (UID: \"15389dad-1183-441e-831c-de27ba4bac6e\") " pod="openstack-kuttl-tests/placement-7944fd944b-x8xzf" Mar 16 17:00:57 crc kubenswrapper[5120]: I0316 17:00:57.852001 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/15389dad-1183-441e-831c-de27ba4bac6e-logs\") pod \"placement-7944fd944b-x8xzf\" (UID: \"15389dad-1183-441e-831c-de27ba4bac6e\") " pod="openstack-kuttl-tests/placement-7944fd944b-x8xzf" Mar 16 17:00:57 crc kubenswrapper[5120]: I0316 17:00:57.859028 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/15389dad-1183-441e-831c-de27ba4bac6e-combined-ca-bundle\") pod \"placement-7944fd944b-x8xzf\" (UID: \"15389dad-1183-441e-831c-de27ba4bac6e\") " pod="openstack-kuttl-tests/placement-7944fd944b-x8xzf" Mar 16 17:00:57 crc kubenswrapper[5120]: I0316 17:00:57.860080 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/15389dad-1183-441e-831c-de27ba4bac6e-public-tls-certs\") pod \"placement-7944fd944b-x8xzf\" (UID: \"15389dad-1183-441e-831c-de27ba4bac6e\") " pod="openstack-kuttl-tests/placement-7944fd944b-x8xzf" Mar 16 17:00:57 crc kubenswrapper[5120]: I0316 17:00:57.876457 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/15389dad-1183-441e-831c-de27ba4bac6e-scripts\") pod \"placement-7944fd944b-x8xzf\" (UID: \"15389dad-1183-441e-831c-de27ba4bac6e\") " pod="openstack-kuttl-tests/placement-7944fd944b-x8xzf" Mar 16 17:00:57 crc kubenswrapper[5120]: I0316 17:00:57.877562 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/15389dad-1183-441e-831c-de27ba4bac6e-config-data\") pod \"placement-7944fd944b-x8xzf\" (UID: \"15389dad-1183-441e-831c-de27ba4bac6e\") " pod="openstack-kuttl-tests/placement-7944fd944b-x8xzf" Mar 16 17:00:57 crc kubenswrapper[5120]: I0316 17:00:57.884441 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/15389dad-1183-441e-831c-de27ba4bac6e-internal-tls-certs\") pod \"placement-7944fd944b-x8xzf\" (UID: \"15389dad-1183-441e-831c-de27ba4bac6e\") " pod="openstack-kuttl-tests/placement-7944fd944b-x8xzf" Mar 16 17:00:57 crc kubenswrapper[5120]: I0316 17:00:57.888742 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kd6pw\" (UniqueName: \"kubernetes.io/projected/15389dad-1183-441e-831c-de27ba4bac6e-kube-api-access-kd6pw\") pod \"placement-7944fd944b-x8xzf\" (UID: \"15389dad-1183-441e-831c-de27ba4bac6e\") " pod="openstack-kuttl-tests/placement-7944fd944b-x8xzf" Mar 16 17:00:58 crc kubenswrapper[5120]: I0316 17:00:58.059334 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-7944fd944b-x8xzf" Mar 16 17:00:58 crc kubenswrapper[5120]: I0316 17:00:58.060194 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:00:58 crc kubenswrapper[5120]: I0316 17:00:58.657150 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-7944fd944b-x8xzf"] Mar 16 17:00:58 crc kubenswrapper[5120]: I0316 17:00:58.690306 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e956ba16-b745-4928-b574-a942ab68fd58" path="/var/lib/kubelet/pods/e956ba16-b745-4928-b574-a942ab68fd58/volumes" Mar 16 17:00:58 crc kubenswrapper[5120]: I0316 17:00:58.790482 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-7944fd944b-x8xzf" event={"ID":"15389dad-1183-441e-831c-de27ba4bac6e","Type":"ContainerStarted","Data":"3afbc34966f689fd13a2f3e7bb3e84157db37b570e57ba114ca1454bbb43b5bd"} Mar 16 17:00:58 crc kubenswrapper[5120]: I0316 17:00:58.797375 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-566756f6db-ctqm9" event={"ID":"a91dab0d-d649-40d4-ae7e-84cb276b1119","Type":"ContainerStarted","Data":"a468f867d60b3ff4573d5085cb0d514b4f9a39fbe71967977f2d058bcd4029df"} Mar 16 17:00:58 crc kubenswrapper[5120]: I0316 17:00:58.797421 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-566756f6db-ctqm9" event={"ID":"a91dab0d-d649-40d4-ae7e-84cb276b1119","Type":"ContainerStarted","Data":"234fe4366968cda8038866c2cc86105b2205546847091adc7055ae580de10c09"} Mar 16 17:00:58 crc kubenswrapper[5120]: I0316 17:00:58.797443 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-566756f6db-ctqm9" podUID="a91dab0d-d649-40d4-ae7e-84cb276b1119" containerName="placement-log" containerID="cri-o://234fe4366968cda8038866c2cc86105b2205546847091adc7055ae580de10c09" gracePeriod=30 Mar 16 17:00:58 crc kubenswrapper[5120]: I0316 17:00:58.797598 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-566756f6db-ctqm9" podUID="a91dab0d-d649-40d4-ae7e-84cb276b1119" containerName="placement-api" containerID="cri-o://a468f867d60b3ff4573d5085cb0d514b4f9a39fbe71967977f2d058bcd4029df" gracePeriod=30 Mar 16 17:00:58 crc kubenswrapper[5120]: I0316 17:00:58.798252 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-566756f6db-ctqm9" Mar 16 17:00:58 crc kubenswrapper[5120]: I0316 17:00:58.798287 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-566756f6db-ctqm9" Mar 16 17:00:58 crc kubenswrapper[5120]: I0316 17:00:58.836653 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-566756f6db-ctqm9" podStartSLOduration=2.836635374 podStartE2EDuration="2.836635374s" podCreationTimestamp="2026-03-16 17:00:56 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:00:58.832683876 +0000 UTC m=+5360.986615543" watchObservedRunningTime="2026-03-16 17:00:58.836635374 +0000 UTC m=+5360.990567031" Mar 16 17:00:58 crc kubenswrapper[5120]: I0316 17:00:58.916977 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openstack-kuttl-tests/barbican-api-8579c6748-8wfdq" podUID="6f3cdac2-9246-455c-b05a-347b4db60b7f" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.1.83:9311/healthcheck\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 17:00:59 crc kubenswrapper[5120]: I0316 17:00:59.644392 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-8579c6748-8wfdq" Mar 16 17:00:59 crc kubenswrapper[5120]: I0316 17:00:59.760070 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:00:59 crc kubenswrapper[5120]: I0316 17:00:59.760185 5120 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Mar 16 17:00:59 crc kubenswrapper[5120]: I0316 17:00:59.822071 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-7944fd944b-x8xzf" event={"ID":"15389dad-1183-441e-831c-de27ba4bac6e","Type":"ContainerStarted","Data":"72cd91669994d4f717e8dc9d24219ef29cee8da5fb209b92c3af6dc535d96d2c"} Mar 16 17:00:59 crc kubenswrapper[5120]: I0316 17:00:59.822135 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-7944fd944b-x8xzf" event={"ID":"15389dad-1183-441e-831c-de27ba4bac6e","Type":"ContainerStarted","Data":"0e421c8f4bd01dccbba64b51d71205b35f94454215e59a8a85c6b6da1bf033d0"} Mar 16 17:00:59 crc kubenswrapper[5120]: I0316 17:00:59.823933 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-7944fd944b-x8xzf" Mar 16 17:00:59 crc kubenswrapper[5120]: I0316 17:00:59.823987 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-7944fd944b-x8xzf" Mar 16 17:00:59 crc kubenswrapper[5120]: I0316 17:00:59.828548 5120 generic.go:358] "Generic (PLEG): container finished" podID="a91dab0d-d649-40d4-ae7e-84cb276b1119" containerID="a468f867d60b3ff4573d5085cb0d514b4f9a39fbe71967977f2d058bcd4029df" exitCode=0 Mar 16 17:00:59 crc kubenswrapper[5120]: I0316 17:00:59.828579 5120 generic.go:358] "Generic (PLEG): container finished" podID="a91dab0d-d649-40d4-ae7e-84cb276b1119" containerID="234fe4366968cda8038866c2cc86105b2205546847091adc7055ae580de10c09" exitCode=143 Mar 16 17:00:59 crc kubenswrapper[5120]: I0316 17:00:59.828755 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-566756f6db-ctqm9" event={"ID":"a91dab0d-d649-40d4-ae7e-84cb276b1119","Type":"ContainerDied","Data":"a468f867d60b3ff4573d5085cb0d514b4f9a39fbe71967977f2d058bcd4029df"} Mar 16 17:00:59 crc kubenswrapper[5120]: I0316 17:00:59.828793 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-566756f6db-ctqm9" event={"ID":"a91dab0d-d649-40d4-ae7e-84cb276b1119","Type":"ContainerDied","Data":"234fe4366968cda8038866c2cc86105b2205546847091adc7055ae580de10c09"} Mar 16 17:00:59 crc kubenswrapper[5120]: I0316 17:00:59.862650 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-7944fd944b-x8xzf" podStartSLOduration=2.862623307 podStartE2EDuration="2.862623307s" podCreationTimestamp="2026-03-16 17:00:57 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:00:59.85363322 +0000 UTC m=+5362.007564877" watchObservedRunningTime="2026-03-16 17:00:59.862623307 +0000 UTC m=+5362.016554964" Mar 16 17:01:00 crc kubenswrapper[5120]: I0316 17:01:00.115033 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-566756f6db-ctqm9" Mar 16 17:01:00 crc kubenswrapper[5120]: I0316 17:01:00.226899 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-cron-29561341-nzw57"] Mar 16 17:01:00 crc kubenswrapper[5120]: I0316 17:01:00.232080 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a91dab0d-d649-40d4-ae7e-84cb276b1119" containerName="placement-log" Mar 16 17:01:00 crc kubenswrapper[5120]: I0316 17:01:00.232113 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a91dab0d-d649-40d4-ae7e-84cb276b1119" containerName="placement-log" Mar 16 17:01:00 crc kubenswrapper[5120]: I0316 17:01:00.232135 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a91dab0d-d649-40d4-ae7e-84cb276b1119" containerName="placement-api" Mar 16 17:01:00 crc kubenswrapper[5120]: I0316 17:01:00.232143 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a91dab0d-d649-40d4-ae7e-84cb276b1119" containerName="placement-api" Mar 16 17:01:00 crc kubenswrapper[5120]: I0316 17:01:00.232427 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="a91dab0d-d649-40d4-ae7e-84cb276b1119" containerName="placement-log" Mar 16 17:01:00 crc kubenswrapper[5120]: I0316 17:01:00.232442 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="a91dab0d-d649-40d4-ae7e-84cb276b1119" containerName="placement-api" Mar 16 17:01:00 crc kubenswrapper[5120]: I0316 17:01:00.236522 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a91dab0d-d649-40d4-ae7e-84cb276b1119-logs\") pod \"a91dab0d-d649-40d4-ae7e-84cb276b1119\" (UID: \"a91dab0d-d649-40d4-ae7e-84cb276b1119\") " Mar 16 17:01:00 crc kubenswrapper[5120]: I0316 17:01:00.236680 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/a91dab0d-d649-40d4-ae7e-84cb276b1119-internal-tls-certs\") pod \"a91dab0d-d649-40d4-ae7e-84cb276b1119\" (UID: \"a91dab0d-d649-40d4-ae7e-84cb276b1119\") " Mar 16 17:01:00 crc kubenswrapper[5120]: I0316 17:01:00.236878 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a91dab0d-d649-40d4-ae7e-84cb276b1119-scripts\") pod \"a91dab0d-d649-40d4-ae7e-84cb276b1119\" (UID: \"a91dab0d-d649-40d4-ae7e-84cb276b1119\") " Mar 16 17:01:00 crc kubenswrapper[5120]: I0316 17:01:00.237240 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9s85r\" (UniqueName: \"kubernetes.io/projected/a91dab0d-d649-40d4-ae7e-84cb276b1119-kube-api-access-9s85r\") pod \"a91dab0d-d649-40d4-ae7e-84cb276b1119\" (UID: \"a91dab0d-d649-40d4-ae7e-84cb276b1119\") " Mar 16 17:01:00 crc kubenswrapper[5120]: I0316 17:01:00.237466 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a91dab0d-d649-40d4-ae7e-84cb276b1119-combined-ca-bundle\") pod \"a91dab0d-d649-40d4-ae7e-84cb276b1119\" (UID: \"a91dab0d-d649-40d4-ae7e-84cb276b1119\") " Mar 16 17:01:00 crc kubenswrapper[5120]: I0316 17:01:00.237501 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a91dab0d-d649-40d4-ae7e-84cb276b1119-config-data\") pod \"a91dab0d-d649-40d4-ae7e-84cb276b1119\" (UID: \"a91dab0d-d649-40d4-ae7e-84cb276b1119\") " Mar 16 17:01:00 crc kubenswrapper[5120]: I0316 17:01:00.237526 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/a91dab0d-d649-40d4-ae7e-84cb276b1119-public-tls-certs\") pod \"a91dab0d-d649-40d4-ae7e-84cb276b1119\" (UID: \"a91dab0d-d649-40d4-ae7e-84cb276b1119\") " Mar 16 17:01:00 crc kubenswrapper[5120]: I0316 17:01:00.253407 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a91dab0d-d649-40d4-ae7e-84cb276b1119-logs" (OuterVolumeSpecName: "logs") pod "a91dab0d-d649-40d4-ae7e-84cb276b1119" (UID: "a91dab0d-d649-40d4-ae7e-84cb276b1119"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:01:00 crc kubenswrapper[5120]: I0316 17:01:00.259041 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-cron-29561341-nzw57" Mar 16 17:01:00 crc kubenswrapper[5120]: I0316 17:01:00.290630 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-cron-29561341-nzw57"] Mar 16 17:01:00 crc kubenswrapper[5120]: I0316 17:01:00.317963 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a91dab0d-d649-40d4-ae7e-84cb276b1119-kube-api-access-9s85r" (OuterVolumeSpecName: "kube-api-access-9s85r") pod "a91dab0d-d649-40d4-ae7e-84cb276b1119" (UID: "a91dab0d-d649-40d4-ae7e-84cb276b1119"). InnerVolumeSpecName "kube-api-access-9s85r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:01:00 crc kubenswrapper[5120]: I0316 17:01:00.320187 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a91dab0d-d649-40d4-ae7e-84cb276b1119-scripts" (OuterVolumeSpecName: "scripts") pod "a91dab0d-d649-40d4-ae7e-84cb276b1119" (UID: "a91dab0d-d649-40d4-ae7e-84cb276b1119"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:01:00 crc kubenswrapper[5120]: I0316 17:01:00.350785 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2f4dc4ed-a579-46e8-a338-b310c55029d1-combined-ca-bundle\") pod \"keystone-cron-29561341-nzw57\" (UID: \"2f4dc4ed-a579-46e8-a338-b310c55029d1\") " pod="openstack-kuttl-tests/keystone-cron-29561341-nzw57" Mar 16 17:01:00 crc kubenswrapper[5120]: I0316 17:01:00.350867 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvvn5\" (UniqueName: \"kubernetes.io/projected/2f4dc4ed-a579-46e8-a338-b310c55029d1-kube-api-access-cvvn5\") pod \"keystone-cron-29561341-nzw57\" (UID: \"2f4dc4ed-a579-46e8-a338-b310c55029d1\") " pod="openstack-kuttl-tests/keystone-cron-29561341-nzw57" Mar 16 17:01:00 crc kubenswrapper[5120]: I0316 17:01:00.351227 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2f4dc4ed-a579-46e8-a338-b310c55029d1-config-data\") pod \"keystone-cron-29561341-nzw57\" (UID: \"2f4dc4ed-a579-46e8-a338-b310c55029d1\") " pod="openstack-kuttl-tests/keystone-cron-29561341-nzw57" Mar 16 17:01:00 crc kubenswrapper[5120]: I0316 17:01:00.351287 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/2f4dc4ed-a579-46e8-a338-b310c55029d1-fernet-keys\") pod \"keystone-cron-29561341-nzw57\" (UID: \"2f4dc4ed-a579-46e8-a338-b310c55029d1\") " pod="openstack-kuttl-tests/keystone-cron-29561341-nzw57" Mar 16 17:01:00 crc kubenswrapper[5120]: I0316 17:01:00.351493 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9s85r\" (UniqueName: \"kubernetes.io/projected/a91dab0d-d649-40d4-ae7e-84cb276b1119-kube-api-access-9s85r\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:00 crc kubenswrapper[5120]: I0316 17:01:00.351515 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a91dab0d-d649-40d4-ae7e-84cb276b1119-logs\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:00 crc kubenswrapper[5120]: I0316 17:01:00.351527 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a91dab0d-d649-40d4-ae7e-84cb276b1119-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:00 crc kubenswrapper[5120]: I0316 17:01:00.413348 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:01:00 crc kubenswrapper[5120]: I0316 17:01:00.413467 5120 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Mar 16 17:01:00 crc kubenswrapper[5120]: I0316 17:01:00.435332 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a91dab0d-d649-40d4-ae7e-84cb276b1119-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "a91dab0d-d649-40d4-ae7e-84cb276b1119" (UID: "a91dab0d-d649-40d4-ae7e-84cb276b1119"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:01:00 crc kubenswrapper[5120]: I0316 17:01:00.454688 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2f4dc4ed-a579-46e8-a338-b310c55029d1-config-data\") pod \"keystone-cron-29561341-nzw57\" (UID: \"2f4dc4ed-a579-46e8-a338-b310c55029d1\") " pod="openstack-kuttl-tests/keystone-cron-29561341-nzw57" Mar 16 17:01:00 crc kubenswrapper[5120]: I0316 17:01:00.454772 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/2f4dc4ed-a579-46e8-a338-b310c55029d1-fernet-keys\") pod \"keystone-cron-29561341-nzw57\" (UID: \"2f4dc4ed-a579-46e8-a338-b310c55029d1\") " pod="openstack-kuttl-tests/keystone-cron-29561341-nzw57" Mar 16 17:01:00 crc kubenswrapper[5120]: I0316 17:01:00.454959 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2f4dc4ed-a579-46e8-a338-b310c55029d1-combined-ca-bundle\") pod \"keystone-cron-29561341-nzw57\" (UID: \"2f4dc4ed-a579-46e8-a338-b310c55029d1\") " pod="openstack-kuttl-tests/keystone-cron-29561341-nzw57" Mar 16 17:01:00 crc kubenswrapper[5120]: I0316 17:01:00.455006 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cvvn5\" (UniqueName: \"kubernetes.io/projected/2f4dc4ed-a579-46e8-a338-b310c55029d1-kube-api-access-cvvn5\") pod \"keystone-cron-29561341-nzw57\" (UID: \"2f4dc4ed-a579-46e8-a338-b310c55029d1\") " pod="openstack-kuttl-tests/keystone-cron-29561341-nzw57" Mar 16 17:01:00 crc kubenswrapper[5120]: I0316 17:01:00.455123 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a91dab0d-d649-40d4-ae7e-84cb276b1119-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:00 crc kubenswrapper[5120]: I0316 17:01:00.456933 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a91dab0d-d649-40d4-ae7e-84cb276b1119-config-data" (OuterVolumeSpecName: "config-data") pod "a91dab0d-d649-40d4-ae7e-84cb276b1119" (UID: "a91dab0d-d649-40d4-ae7e-84cb276b1119"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:01:00 crc kubenswrapper[5120]: I0316 17:01:00.460678 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2f4dc4ed-a579-46e8-a338-b310c55029d1-combined-ca-bundle\") pod \"keystone-cron-29561341-nzw57\" (UID: \"2f4dc4ed-a579-46e8-a338-b310c55029d1\") " pod="openstack-kuttl-tests/keystone-cron-29561341-nzw57" Mar 16 17:01:00 crc kubenswrapper[5120]: I0316 17:01:00.461333 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/2f4dc4ed-a579-46e8-a338-b310c55029d1-fernet-keys\") pod \"keystone-cron-29561341-nzw57\" (UID: \"2f4dc4ed-a579-46e8-a338-b310c55029d1\") " pod="openstack-kuttl-tests/keystone-cron-29561341-nzw57" Mar 16 17:01:00 crc kubenswrapper[5120]: I0316 17:01:00.467453 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2f4dc4ed-a579-46e8-a338-b310c55029d1-config-data\") pod \"keystone-cron-29561341-nzw57\" (UID: \"2f4dc4ed-a579-46e8-a338-b310c55029d1\") " pod="openstack-kuttl-tests/keystone-cron-29561341-nzw57" Mar 16 17:01:00 crc kubenswrapper[5120]: I0316 17:01:00.475201 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvvn5\" (UniqueName: \"kubernetes.io/projected/2f4dc4ed-a579-46e8-a338-b310c55029d1-kube-api-access-cvvn5\") pod \"keystone-cron-29561341-nzw57\" (UID: \"2f4dc4ed-a579-46e8-a338-b310c55029d1\") " pod="openstack-kuttl-tests/keystone-cron-29561341-nzw57" Mar 16 17:01:00 crc kubenswrapper[5120]: I0316 17:01:00.479203 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a91dab0d-d649-40d4-ae7e-84cb276b1119-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "a91dab0d-d649-40d4-ae7e-84cb276b1119" (UID: "a91dab0d-d649-40d4-ae7e-84cb276b1119"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:01:00 crc kubenswrapper[5120]: I0316 17:01:00.486808 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a91dab0d-d649-40d4-ae7e-84cb276b1119-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "a91dab0d-d649-40d4-ae7e-84cb276b1119" (UID: "a91dab0d-d649-40d4-ae7e-84cb276b1119"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:01:00 crc kubenswrapper[5120]: I0316 17:01:00.552843 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:01:00 crc kubenswrapper[5120]: I0316 17:01:00.558667 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a91dab0d-d649-40d4-ae7e-84cb276b1119-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:00 crc kubenswrapper[5120]: I0316 17:01:00.558711 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/a91dab0d-d649-40d4-ae7e-84cb276b1119-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:00 crc kubenswrapper[5120]: I0316 17:01:00.558724 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/a91dab0d-d649-40d4-ae7e-84cb276b1119-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:00 crc kubenswrapper[5120]: I0316 17:01:00.740718 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-cron-29561341-nzw57" Mar 16 17:01:00 crc kubenswrapper[5120]: I0316 17:01:00.744964 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 17:01:00 crc kubenswrapper[5120]: I0316 17:01:00.873465 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-566756f6db-ctqm9" Mar 16 17:01:00 crc kubenswrapper[5120]: I0316 17:01:00.873651 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-566756f6db-ctqm9" event={"ID":"a91dab0d-d649-40d4-ae7e-84cb276b1119","Type":"ContainerDied","Data":"8c8df5a3a376e054bec3ba70517a12b1bbd43e3e26a2236e8d7a1526221be88f"} Mar 16 17:01:00 crc kubenswrapper[5120]: I0316 17:01:00.873706 5120 scope.go:117] "RemoveContainer" containerID="a468f867d60b3ff4573d5085cb0d514b4f9a39fbe71967977f2d058bcd4029df" Mar 16 17:01:00 crc kubenswrapper[5120]: I0316 17:01:00.913056 5120 scope.go:117] "RemoveContainer" containerID="234fe4366968cda8038866c2cc86105b2205546847091adc7055ae580de10c09" Mar 16 17:01:00 crc kubenswrapper[5120]: I0316 17:01:00.923145 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-566756f6db-ctqm9"] Mar 16 17:01:00 crc kubenswrapper[5120]: I0316 17:01:00.975231 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-566756f6db-ctqm9"] Mar 16 17:01:01 crc kubenswrapper[5120]: I0316 17:01:01.028378 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:01:01 crc kubenswrapper[5120]: I0316 17:01:01.104874 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-8579c6748-8wfdq" Mar 16 17:01:01 crc kubenswrapper[5120]: I0316 17:01:01.203144 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-774bd9565b-8dqvz"] Mar 16 17:01:01 crc kubenswrapper[5120]: I0316 17:01:01.203400 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-774bd9565b-8dqvz" podUID="92194734-7636-4b3f-a75a-2343b3d58c71" containerName="barbican-api-log" containerID="cri-o://684dcbf0d0e2d99b5464c64c981678afc1a2620d2ac3e69244d731b2c452354a" gracePeriod=30 Mar 16 17:01:01 crc kubenswrapper[5120]: I0316 17:01:01.203939 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-774bd9565b-8dqvz" podUID="92194734-7636-4b3f-a75a-2343b3d58c71" containerName="barbican-api" containerID="cri-o://0bc3676ee6500c4bb61bbac4704a4548780da105ebd8c4dee57f19a3e5d2abe2" gracePeriod=30 Mar 16 17:01:01 crc kubenswrapper[5120]: I0316 17:01:01.289625 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:01:01 crc kubenswrapper[5120]: I0316 17:01:01.409879 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-cron-29561341-nzw57"] Mar 16 17:01:01 crc kubenswrapper[5120]: I0316 17:01:01.890311 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-cron-29561341-nzw57" event={"ID":"2f4dc4ed-a579-46e8-a338-b310c55029d1","Type":"ContainerStarted","Data":"3d77304db468843668a74a6d34dd20b0deb2b697641fa4c425dbcfb15a0b20fd"} Mar 16 17:01:01 crc kubenswrapper[5120]: I0316 17:01:01.890627 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-cron-29561341-nzw57" event={"ID":"2f4dc4ed-a579-46e8-a338-b310c55029d1","Type":"ContainerStarted","Data":"298d443f7e1949ef45aec3128dceecd2cf865f7cf06d850f48e3f9490aae83af"} Mar 16 17:01:01 crc kubenswrapper[5120]: I0316 17:01:01.891226 5120 generic.go:358] "Generic (PLEG): container finished" podID="92194734-7636-4b3f-a75a-2343b3d58c71" containerID="684dcbf0d0e2d99b5464c64c981678afc1a2620d2ac3e69244d731b2c452354a" exitCode=143 Mar 16 17:01:01 crc kubenswrapper[5120]: I0316 17:01:01.891427 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-774bd9565b-8dqvz" event={"ID":"92194734-7636-4b3f-a75a-2343b3d58c71","Type":"ContainerDied","Data":"684dcbf0d0e2d99b5464c64c981678afc1a2620d2ac3e69244d731b2c452354a"} Mar 16 17:01:01 crc kubenswrapper[5120]: I0316 17:01:01.914515 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-cron-29561341-nzw57" podStartSLOduration=1.914496147 podStartE2EDuration="1.914496147s" podCreationTimestamp="2026-03-16 17:01:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:01:01.907377733 +0000 UTC m=+5364.061309390" watchObservedRunningTime="2026-03-16 17:01:01.914496147 +0000 UTC m=+5364.068427804" Mar 16 17:01:02 crc kubenswrapper[5120]: I0316 17:01:02.011467 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-api-699f94747b-4flvt"] Mar 16 17:01:02 crc kubenswrapper[5120]: I0316 17:01:02.018617 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-699f94747b-4flvt" Mar 16 17:01:02 crc kubenswrapper[5120]: I0316 17:01:02.039189 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-699f94747b-4flvt"] Mar 16 17:01:02 crc kubenswrapper[5120]: I0316 17:01:02.118603 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/54dca6ff-f965-48fc-8521-946430880efd-public-tls-certs\") pod \"barbican-api-699f94747b-4flvt\" (UID: \"54dca6ff-f965-48fc-8521-946430880efd\") " pod="openstack-kuttl-tests/barbican-api-699f94747b-4flvt" Mar 16 17:01:02 crc kubenswrapper[5120]: I0316 17:01:02.118687 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/54dca6ff-f965-48fc-8521-946430880efd-combined-ca-bundle\") pod \"barbican-api-699f94747b-4flvt\" (UID: \"54dca6ff-f965-48fc-8521-946430880efd\") " pod="openstack-kuttl-tests/barbican-api-699f94747b-4flvt" Mar 16 17:01:02 crc kubenswrapper[5120]: I0316 17:01:02.118997 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnmtg\" (UniqueName: \"kubernetes.io/projected/54dca6ff-f965-48fc-8521-946430880efd-kube-api-access-wnmtg\") pod \"barbican-api-699f94747b-4flvt\" (UID: \"54dca6ff-f965-48fc-8521-946430880efd\") " pod="openstack-kuttl-tests/barbican-api-699f94747b-4flvt" Mar 16 17:01:02 crc kubenswrapper[5120]: I0316 17:01:02.119148 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/54dca6ff-f965-48fc-8521-946430880efd-config-data-custom\") pod \"barbican-api-699f94747b-4flvt\" (UID: \"54dca6ff-f965-48fc-8521-946430880efd\") " pod="openstack-kuttl-tests/barbican-api-699f94747b-4flvt" Mar 16 17:01:02 crc kubenswrapper[5120]: I0316 17:01:02.119225 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/54dca6ff-f965-48fc-8521-946430880efd-internal-tls-certs\") pod \"barbican-api-699f94747b-4flvt\" (UID: \"54dca6ff-f965-48fc-8521-946430880efd\") " pod="openstack-kuttl-tests/barbican-api-699f94747b-4flvt" Mar 16 17:01:02 crc kubenswrapper[5120]: I0316 17:01:02.119397 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/54dca6ff-f965-48fc-8521-946430880efd-config-data\") pod \"barbican-api-699f94747b-4flvt\" (UID: \"54dca6ff-f965-48fc-8521-946430880efd\") " pod="openstack-kuttl-tests/barbican-api-699f94747b-4flvt" Mar 16 17:01:02 crc kubenswrapper[5120]: I0316 17:01:02.119590 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/54dca6ff-f965-48fc-8521-946430880efd-logs\") pod \"barbican-api-699f94747b-4flvt\" (UID: \"54dca6ff-f965-48fc-8521-946430880efd\") " pod="openstack-kuttl-tests/barbican-api-699f94747b-4flvt" Mar 16 17:01:02 crc kubenswrapper[5120]: I0316 17:01:02.221938 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/54dca6ff-f965-48fc-8521-946430880efd-config-data-custom\") pod \"barbican-api-699f94747b-4flvt\" (UID: \"54dca6ff-f965-48fc-8521-946430880efd\") " pod="openstack-kuttl-tests/barbican-api-699f94747b-4flvt" Mar 16 17:01:02 crc kubenswrapper[5120]: I0316 17:01:02.222018 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/54dca6ff-f965-48fc-8521-946430880efd-internal-tls-certs\") pod \"barbican-api-699f94747b-4flvt\" (UID: \"54dca6ff-f965-48fc-8521-946430880efd\") " pod="openstack-kuttl-tests/barbican-api-699f94747b-4flvt" Mar 16 17:01:02 crc kubenswrapper[5120]: I0316 17:01:02.222162 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/54dca6ff-f965-48fc-8521-946430880efd-config-data\") pod \"barbican-api-699f94747b-4flvt\" (UID: \"54dca6ff-f965-48fc-8521-946430880efd\") " pod="openstack-kuttl-tests/barbican-api-699f94747b-4flvt" Mar 16 17:01:02 crc kubenswrapper[5120]: I0316 17:01:02.222342 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/54dca6ff-f965-48fc-8521-946430880efd-logs\") pod \"barbican-api-699f94747b-4flvt\" (UID: \"54dca6ff-f965-48fc-8521-946430880efd\") " pod="openstack-kuttl-tests/barbican-api-699f94747b-4flvt" Mar 16 17:01:02 crc kubenswrapper[5120]: I0316 17:01:02.222515 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/54dca6ff-f965-48fc-8521-946430880efd-public-tls-certs\") pod \"barbican-api-699f94747b-4flvt\" (UID: \"54dca6ff-f965-48fc-8521-946430880efd\") " pod="openstack-kuttl-tests/barbican-api-699f94747b-4flvt" Mar 16 17:01:02 crc kubenswrapper[5120]: I0316 17:01:02.222574 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/54dca6ff-f965-48fc-8521-946430880efd-combined-ca-bundle\") pod \"barbican-api-699f94747b-4flvt\" (UID: \"54dca6ff-f965-48fc-8521-946430880efd\") " pod="openstack-kuttl-tests/barbican-api-699f94747b-4flvt" Mar 16 17:01:02 crc kubenswrapper[5120]: I0316 17:01:02.222664 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wnmtg\" (UniqueName: \"kubernetes.io/projected/54dca6ff-f965-48fc-8521-946430880efd-kube-api-access-wnmtg\") pod \"barbican-api-699f94747b-4flvt\" (UID: \"54dca6ff-f965-48fc-8521-946430880efd\") " pod="openstack-kuttl-tests/barbican-api-699f94747b-4flvt" Mar 16 17:01:02 crc kubenswrapper[5120]: I0316 17:01:02.222831 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/54dca6ff-f965-48fc-8521-946430880efd-logs\") pod \"barbican-api-699f94747b-4flvt\" (UID: \"54dca6ff-f965-48fc-8521-946430880efd\") " pod="openstack-kuttl-tests/barbican-api-699f94747b-4flvt" Mar 16 17:01:02 crc kubenswrapper[5120]: I0316 17:01:02.230791 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/54dca6ff-f965-48fc-8521-946430880efd-config-data-custom\") pod \"barbican-api-699f94747b-4flvt\" (UID: \"54dca6ff-f965-48fc-8521-946430880efd\") " pod="openstack-kuttl-tests/barbican-api-699f94747b-4flvt" Mar 16 17:01:02 crc kubenswrapper[5120]: I0316 17:01:02.233325 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/54dca6ff-f965-48fc-8521-946430880efd-internal-tls-certs\") pod \"barbican-api-699f94747b-4flvt\" (UID: \"54dca6ff-f965-48fc-8521-946430880efd\") " pod="openstack-kuttl-tests/barbican-api-699f94747b-4flvt" Mar 16 17:01:02 crc kubenswrapper[5120]: I0316 17:01:02.233926 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/54dca6ff-f965-48fc-8521-946430880efd-combined-ca-bundle\") pod \"barbican-api-699f94747b-4flvt\" (UID: \"54dca6ff-f965-48fc-8521-946430880efd\") " pod="openstack-kuttl-tests/barbican-api-699f94747b-4flvt" Mar 16 17:01:02 crc kubenswrapper[5120]: I0316 17:01:02.234103 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/54dca6ff-f965-48fc-8521-946430880efd-config-data\") pod \"barbican-api-699f94747b-4flvt\" (UID: \"54dca6ff-f965-48fc-8521-946430880efd\") " pod="openstack-kuttl-tests/barbican-api-699f94747b-4flvt" Mar 16 17:01:02 crc kubenswrapper[5120]: I0316 17:01:02.234465 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/54dca6ff-f965-48fc-8521-946430880efd-public-tls-certs\") pod \"barbican-api-699f94747b-4flvt\" (UID: \"54dca6ff-f965-48fc-8521-946430880efd\") " pod="openstack-kuttl-tests/barbican-api-699f94747b-4flvt" Mar 16 17:01:02 crc kubenswrapper[5120]: I0316 17:01:02.246534 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnmtg\" (UniqueName: \"kubernetes.io/projected/54dca6ff-f965-48fc-8521-946430880efd-kube-api-access-wnmtg\") pod \"barbican-api-699f94747b-4flvt\" (UID: \"54dca6ff-f965-48fc-8521-946430880efd\") " pod="openstack-kuttl-tests/barbican-api-699f94747b-4flvt" Mar 16 17:01:02 crc kubenswrapper[5120]: I0316 17:01:02.333892 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 17:01:02 crc kubenswrapper[5120]: I0316 17:01:02.362459 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-699f94747b-4flvt" Mar 16 17:01:02 crc kubenswrapper[5120]: I0316 17:01:02.569919 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/openstack-galera-0" podUID="ab76f235-6a48-4935-a2d5-5a79806c416c" containerName="galera" containerID="cri-o://472402137f246ce709088b3f0d51afee3215744c5a0d4026e8c342a19b0acee2" gracePeriod=30 Mar 16 17:01:02 crc kubenswrapper[5120]: I0316 17:01:02.703800 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a91dab0d-d649-40d4-ae7e-84cb276b1119" path="/var/lib/kubelet/pods/a91dab0d-d649-40d4-ae7e-84cb276b1119/volumes" Mar 16 17:01:02 crc kubenswrapper[5120]: I0316 17:01:02.962374 5120 generic.go:358] "Generic (PLEG): container finished" podID="e3143a49-62b5-408a-8dca-d723f7a31619" containerID="1ba29d334446e91abdcb11e44fde235c795515796425914cd3ff6f4f69019510" exitCode=0 Mar 16 17:01:02 crc kubenswrapper[5120]: I0316 17:01:02.962477 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-6f846b8bfd-w69px" event={"ID":"e3143a49-62b5-408a-8dca-d723f7a31619","Type":"ContainerDied","Data":"1ba29d334446e91abdcb11e44fde235c795515796425914cd3ff6f4f69019510"} Mar 16 17:01:02 crc kubenswrapper[5120]: I0316 17:01:02.962542 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-6f846b8bfd-w69px" event={"ID":"e3143a49-62b5-408a-8dca-d723f7a31619","Type":"ContainerDied","Data":"67efb27c447aaa8da521a63173f57591760fe73067f0d9d4541153a4568020db"} Mar 16 17:01:02 crc kubenswrapper[5120]: I0316 17:01:02.962553 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="67efb27c447aaa8da521a63173f57591760fe73067f0d9d4541153a4568020db" Mar 16 17:01:02 crc kubenswrapper[5120]: I0316 17:01:02.962734 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-6f846b8bfd-w69px" Mar 16 17:01:03 crc kubenswrapper[5120]: I0316 17:01:03.022734 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:01:03 crc kubenswrapper[5120]: I0316 17:01:03.024165 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:01:03 crc kubenswrapper[5120]: I0316 17:01:03.024965 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:01:03 crc kubenswrapper[5120]: I0316 17:01:03.025009 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:01:03 crc kubenswrapper[5120]: I0316 17:01:03.051430 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e3143a49-62b5-408a-8dca-d723f7a31619-combined-ca-bundle\") pod \"e3143a49-62b5-408a-8dca-d723f7a31619\" (UID: \"e3143a49-62b5-408a-8dca-d723f7a31619\") " Mar 16 17:01:03 crc kubenswrapper[5120]: I0316 17:01:03.051580 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/e3143a49-62b5-408a-8dca-d723f7a31619-httpd-config\") pod \"e3143a49-62b5-408a-8dca-d723f7a31619\" (UID: \"e3143a49-62b5-408a-8dca-d723f7a31619\") " Mar 16 17:01:03 crc kubenswrapper[5120]: I0316 17:01:03.051702 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e3143a49-62b5-408a-8dca-d723f7a31619-internal-tls-certs\") pod \"e3143a49-62b5-408a-8dca-d723f7a31619\" (UID: \"e3143a49-62b5-408a-8dca-d723f7a31619\") " Mar 16 17:01:03 crc kubenswrapper[5120]: I0316 17:01:03.051780 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e3143a49-62b5-408a-8dca-d723f7a31619-public-tls-certs\") pod \"e3143a49-62b5-408a-8dca-d723f7a31619\" (UID: \"e3143a49-62b5-408a-8dca-d723f7a31619\") " Mar 16 17:01:03 crc kubenswrapper[5120]: I0316 17:01:03.051821 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/e3143a49-62b5-408a-8dca-d723f7a31619-ovndb-tls-certs\") pod \"e3143a49-62b5-408a-8dca-d723f7a31619\" (UID: \"e3143a49-62b5-408a-8dca-d723f7a31619\") " Mar 16 17:01:03 crc kubenswrapper[5120]: I0316 17:01:03.052023 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hfnnr\" (UniqueName: \"kubernetes.io/projected/e3143a49-62b5-408a-8dca-d723f7a31619-kube-api-access-hfnnr\") pod \"e3143a49-62b5-408a-8dca-d723f7a31619\" (UID: \"e3143a49-62b5-408a-8dca-d723f7a31619\") " Mar 16 17:01:03 crc kubenswrapper[5120]: I0316 17:01:03.052167 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e3143a49-62b5-408a-8dca-d723f7a31619-config\") pod \"e3143a49-62b5-408a-8dca-d723f7a31619\" (UID: \"e3143a49-62b5-408a-8dca-d723f7a31619\") " Mar 16 17:01:03 crc kubenswrapper[5120]: I0316 17:01:03.062328 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3143a49-62b5-408a-8dca-d723f7a31619-httpd-config" (OuterVolumeSpecName: "httpd-config") pod "e3143a49-62b5-408a-8dca-d723f7a31619" (UID: "e3143a49-62b5-408a-8dca-d723f7a31619"). InnerVolumeSpecName "httpd-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:01:03 crc kubenswrapper[5120]: I0316 17:01:03.074251 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-699f94747b-4flvt"] Mar 16 17:01:03 crc kubenswrapper[5120]: I0316 17:01:03.123974 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3143a49-62b5-408a-8dca-d723f7a31619-kube-api-access-hfnnr" (OuterVolumeSpecName: "kube-api-access-hfnnr") pod "e3143a49-62b5-408a-8dca-d723f7a31619" (UID: "e3143a49-62b5-408a-8dca-d723f7a31619"). InnerVolumeSpecName "kube-api-access-hfnnr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:01:03 crc kubenswrapper[5120]: I0316 17:01:03.159262 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hfnnr\" (UniqueName: \"kubernetes.io/projected/e3143a49-62b5-408a-8dca-d723f7a31619-kube-api-access-hfnnr\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:03 crc kubenswrapper[5120]: I0316 17:01:03.159600 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/e3143a49-62b5-408a-8dca-d723f7a31619-httpd-config\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:03 crc kubenswrapper[5120]: I0316 17:01:03.185126 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3143a49-62b5-408a-8dca-d723f7a31619-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "e3143a49-62b5-408a-8dca-d723f7a31619" (UID: "e3143a49-62b5-408a-8dca-d723f7a31619"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:01:03 crc kubenswrapper[5120]: I0316 17:01:03.188805 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3143a49-62b5-408a-8dca-d723f7a31619-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e3143a49-62b5-408a-8dca-d723f7a31619" (UID: "e3143a49-62b5-408a-8dca-d723f7a31619"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:01:03 crc kubenswrapper[5120]: I0316 17:01:03.207968 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3143a49-62b5-408a-8dca-d723f7a31619-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "e3143a49-62b5-408a-8dca-d723f7a31619" (UID: "e3143a49-62b5-408a-8dca-d723f7a31619"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:01:03 crc kubenswrapper[5120]: I0316 17:01:03.234601 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3143a49-62b5-408a-8dca-d723f7a31619-ovndb-tls-certs" (OuterVolumeSpecName: "ovndb-tls-certs") pod "e3143a49-62b5-408a-8dca-d723f7a31619" (UID: "e3143a49-62b5-408a-8dca-d723f7a31619"). InnerVolumeSpecName "ovndb-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:01:03 crc kubenswrapper[5120]: I0316 17:01:03.270275 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e3143a49-62b5-408a-8dca-d723f7a31619-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:03 crc kubenswrapper[5120]: I0316 17:01:03.270313 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e3143a49-62b5-408a-8dca-d723f7a31619-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:03 crc kubenswrapper[5120]: I0316 17:01:03.270326 5120 reconciler_common.go:299] "Volume detached for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/e3143a49-62b5-408a-8dca-d723f7a31619-ovndb-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:03 crc kubenswrapper[5120]: I0316 17:01:03.270340 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e3143a49-62b5-408a-8dca-d723f7a31619-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:03 crc kubenswrapper[5120]: I0316 17:01:03.333605 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3143a49-62b5-408a-8dca-d723f7a31619-config" (OuterVolumeSpecName: "config") pod "e3143a49-62b5-408a-8dca-d723f7a31619" (UID: "e3143a49-62b5-408a-8dca-d723f7a31619"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:01:03 crc kubenswrapper[5120]: I0316 17:01:03.372558 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/e3143a49-62b5-408a-8dca-d723f7a31619-config\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:03 crc kubenswrapper[5120]: I0316 17:01:03.458787 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:01:03 crc kubenswrapper[5120]: I0316 17:01:03.579323 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="2cadcb9e-2a3b-4c14-8fcc-39939326678f" containerName="cinder-scheduler" probeResult="failure" output="HTTP probe failed with statuscode: 500" Mar 16 17:01:03 crc kubenswrapper[5120]: I0316 17:01:03.579468 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vg2zm\" (UniqueName: \"kubernetes.io/projected/ab76f235-6a48-4935-a2d5-5a79806c416c-kube-api-access-vg2zm\") pod \"ab76f235-6a48-4935-a2d5-5a79806c416c\" (UID: \"ab76f235-6a48-4935-a2d5-5a79806c416c\") " Mar 16 17:01:03 crc kubenswrapper[5120]: I0316 17:01:03.579588 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/ab76f235-6a48-4935-a2d5-5a79806c416c-config-data-generated\") pod \"ab76f235-6a48-4935-a2d5-5a79806c416c\" (UID: \"ab76f235-6a48-4935-a2d5-5a79806c416c\") " Mar 16 17:01:03 crc kubenswrapper[5120]: I0316 17:01:03.579737 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ab76f235-6a48-4935-a2d5-5a79806c416c-combined-ca-bundle\") pod \"ab76f235-6a48-4935-a2d5-5a79806c416c\" (UID: \"ab76f235-6a48-4935-a2d5-5a79806c416c\") " Mar 16 17:01:03 crc kubenswrapper[5120]: I0316 17:01:03.579773 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ab76f235-6a48-4935-a2d5-5a79806c416c-operator-scripts\") pod \"ab76f235-6a48-4935-a2d5-5a79806c416c\" (UID: \"ab76f235-6a48-4935-a2d5-5a79806c416c\") " Mar 16 17:01:03 crc kubenswrapper[5120]: I0316 17:01:03.579888 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"mysql-db\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"ab76f235-6a48-4935-a2d5-5a79806c416c\" (UID: \"ab76f235-6a48-4935-a2d5-5a79806c416c\") " Mar 16 17:01:03 crc kubenswrapper[5120]: I0316 17:01:03.580040 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/ab76f235-6a48-4935-a2d5-5a79806c416c-galera-tls-certs\") pod \"ab76f235-6a48-4935-a2d5-5a79806c416c\" (UID: \"ab76f235-6a48-4935-a2d5-5a79806c416c\") " Mar 16 17:01:03 crc kubenswrapper[5120]: I0316 17:01:03.580116 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/ab76f235-6a48-4935-a2d5-5a79806c416c-kolla-config\") pod \"ab76f235-6a48-4935-a2d5-5a79806c416c\" (UID: \"ab76f235-6a48-4935-a2d5-5a79806c416c\") " Mar 16 17:01:03 crc kubenswrapper[5120]: I0316 17:01:03.580227 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/ab76f235-6a48-4935-a2d5-5a79806c416c-config-data-default\") pod \"ab76f235-6a48-4935-a2d5-5a79806c416c\" (UID: \"ab76f235-6a48-4935-a2d5-5a79806c416c\") " Mar 16 17:01:03 crc kubenswrapper[5120]: I0316 17:01:03.580549 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab76f235-6a48-4935-a2d5-5a79806c416c-config-data-generated" (OuterVolumeSpecName: "config-data-generated") pod "ab76f235-6a48-4935-a2d5-5a79806c416c" (UID: "ab76f235-6a48-4935-a2d5-5a79806c416c"). InnerVolumeSpecName "config-data-generated". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:01:03 crc kubenswrapper[5120]: I0316 17:01:03.582070 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/ab76f235-6a48-4935-a2d5-5a79806c416c-config-data-generated\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:03 crc kubenswrapper[5120]: I0316 17:01:03.582781 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ab76f235-6a48-4935-a2d5-5a79806c416c-config-data-default" (OuterVolumeSpecName: "config-data-default") pod "ab76f235-6a48-4935-a2d5-5a79806c416c" (UID: "ab76f235-6a48-4935-a2d5-5a79806c416c"). InnerVolumeSpecName "config-data-default". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:01:03 crc kubenswrapper[5120]: I0316 17:01:03.583224 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ab76f235-6a48-4935-a2d5-5a79806c416c-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "ab76f235-6a48-4935-a2d5-5a79806c416c" (UID: "ab76f235-6a48-4935-a2d5-5a79806c416c"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:01:03 crc kubenswrapper[5120]: I0316 17:01:03.591377 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ab76f235-6a48-4935-a2d5-5a79806c416c-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "ab76f235-6a48-4935-a2d5-5a79806c416c" (UID: "ab76f235-6a48-4935-a2d5-5a79806c416c"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:01:03 crc kubenswrapper[5120]: I0316 17:01:03.595744 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab76f235-6a48-4935-a2d5-5a79806c416c-kube-api-access-vg2zm" (OuterVolumeSpecName: "kube-api-access-vg2zm") pod "ab76f235-6a48-4935-a2d5-5a79806c416c" (UID: "ab76f235-6a48-4935-a2d5-5a79806c416c"). InnerVolumeSpecName "kube-api-access-vg2zm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:01:03 crc kubenswrapper[5120]: I0316 17:01:03.621212 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage20-crc" (OuterVolumeSpecName: "mysql-db") pod "ab76f235-6a48-4935-a2d5-5a79806c416c" (UID: "ab76f235-6a48-4935-a2d5-5a79806c416c"). InnerVolumeSpecName "local-storage20-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 17:01:03 crc kubenswrapper[5120]: I0316 17:01:03.628734 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ab76f235-6a48-4935-a2d5-5a79806c416c-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ab76f235-6a48-4935-a2d5-5a79806c416c" (UID: "ab76f235-6a48-4935-a2d5-5a79806c416c"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:01:03 crc kubenswrapper[5120]: I0316 17:01:03.663614 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ab76f235-6a48-4935-a2d5-5a79806c416c-galera-tls-certs" (OuterVolumeSpecName: "galera-tls-certs") pod "ab76f235-6a48-4935-a2d5-5a79806c416c" (UID: "ab76f235-6a48-4935-a2d5-5a79806c416c"). InnerVolumeSpecName "galera-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:01:03 crc kubenswrapper[5120]: I0316 17:01:03.684727 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ab76f235-6a48-4935-a2d5-5a79806c416c-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:03 crc kubenswrapper[5120]: I0316 17:01:03.684781 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ab76f235-6a48-4935-a2d5-5a79806c416c-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:03 crc kubenswrapper[5120]: I0316 17:01:03.684816 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") on node \"crc\" " Mar 16 17:01:03 crc kubenswrapper[5120]: I0316 17:01:03.684826 5120 reconciler_common.go:299] "Volume detached for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/ab76f235-6a48-4935-a2d5-5a79806c416c-galera-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:03 crc kubenswrapper[5120]: I0316 17:01:03.684835 5120 reconciler_common.go:299] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/ab76f235-6a48-4935-a2d5-5a79806c416c-kolla-config\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:03 crc kubenswrapper[5120]: I0316 17:01:03.684844 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/ab76f235-6a48-4935-a2d5-5a79806c416c-config-data-default\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:03 crc kubenswrapper[5120]: I0316 17:01:03.684853 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vg2zm\" (UniqueName: \"kubernetes.io/projected/ab76f235-6a48-4935-a2d5-5a79806c416c-kube-api-access-vg2zm\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:03 crc kubenswrapper[5120]: I0316 17:01:03.712233 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage20-crc" (UniqueName: "kubernetes.io/local-volume/local-storage20-crc") on node "crc" Mar 16 17:01:03 crc kubenswrapper[5120]: I0316 17:01:03.790489 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:03 crc kubenswrapper[5120]: I0316 17:01:03.976110 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-699f94747b-4flvt" event={"ID":"54dca6ff-f965-48fc-8521-946430880efd","Type":"ContainerStarted","Data":"84b4826d9f823121ff329cfd3521bd14bd6b6ea04ab4ab7b0105a2062f73c8c6"} Mar 16 17:01:03 crc kubenswrapper[5120]: I0316 17:01:03.976460 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-699f94747b-4flvt" event={"ID":"54dca6ff-f965-48fc-8521-946430880efd","Type":"ContainerStarted","Data":"8feb0e246bfc57f3f361393b3ce7b92241ee250ac674e494ba77c3a8139f2177"} Mar 16 17:01:03 crc kubenswrapper[5120]: I0316 17:01:03.976487 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-699f94747b-4flvt" Mar 16 17:01:03 crc kubenswrapper[5120]: I0316 17:01:03.976500 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-699f94747b-4flvt" event={"ID":"54dca6ff-f965-48fc-8521-946430880efd","Type":"ContainerStarted","Data":"520faefb67cf7d90eb9777032b56957cff24114c7c22b3ba9cd146b0daf8c25a"} Mar 16 17:01:03 crc kubenswrapper[5120]: I0316 17:01:03.976514 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-699f94747b-4flvt" Mar 16 17:01:03 crc kubenswrapper[5120]: I0316 17:01:03.978498 5120 generic.go:358] "Generic (PLEG): container finished" podID="ab76f235-6a48-4935-a2d5-5a79806c416c" containerID="472402137f246ce709088b3f0d51afee3215744c5a0d4026e8c342a19b0acee2" exitCode=0 Mar 16 17:01:03 crc kubenswrapper[5120]: I0316 17:01:03.978541 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"ab76f235-6a48-4935-a2d5-5a79806c416c","Type":"ContainerDied","Data":"472402137f246ce709088b3f0d51afee3215744c5a0d4026e8c342a19b0acee2"} Mar 16 17:01:03 crc kubenswrapper[5120]: I0316 17:01:03.978563 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:01:03 crc kubenswrapper[5120]: I0316 17:01:03.978593 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"ab76f235-6a48-4935-a2d5-5a79806c416c","Type":"ContainerDied","Data":"4bdb6777c658208e4e4a635c2814ef42493799e18877cf4be4e6b11c872da7e3"} Mar 16 17:01:03 crc kubenswrapper[5120]: I0316 17:01:03.978619 5120 scope.go:117] "RemoveContainer" containerID="472402137f246ce709088b3f0d51afee3215744c5a0d4026e8c342a19b0acee2" Mar 16 17:01:03 crc kubenswrapper[5120]: I0316 17:01:03.979062 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-6f846b8bfd-w69px" Mar 16 17:01:04 crc kubenswrapper[5120]: I0316 17:01:04.018980 5120 scope.go:117] "RemoveContainer" containerID="50c9fb8e4395ff8d0b8a9ef7844ff6a387ea6735244afeae82df0471f26e8e1c" Mar 16 17:01:04 crc kubenswrapper[5120]: I0316 17:01:04.028016 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-api-699f94747b-4flvt" podStartSLOduration=3.027992955 podStartE2EDuration="3.027992955s" podCreationTimestamp="2026-03-16 17:01:01 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:01:04.006023954 +0000 UTC m=+5366.159955631" watchObservedRunningTime="2026-03-16 17:01:04.027992955 +0000 UTC m=+5366.181924612" Mar 16 17:01:04 crc kubenswrapper[5120]: I0316 17:01:04.066822 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 17:01:04 crc kubenswrapper[5120]: I0316 17:01:04.085165 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 17:01:04 crc kubenswrapper[5120]: I0316 17:01:04.096166 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-6f846b8bfd-w69px"] Mar 16 17:01:04 crc kubenswrapper[5120]: I0316 17:01:04.113214 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 17:01:04 crc kubenswrapper[5120]: I0316 17:01:04.117116 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3143a49-62b5-408a-8dca-d723f7a31619" containerName="neutron-api" Mar 16 17:01:04 crc kubenswrapper[5120]: I0316 17:01:04.117155 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3143a49-62b5-408a-8dca-d723f7a31619" containerName="neutron-api" Mar 16 17:01:04 crc kubenswrapper[5120]: I0316 17:01:04.117179 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab76f235-6a48-4935-a2d5-5a79806c416c" containerName="mysql-bootstrap" Mar 16 17:01:04 crc kubenswrapper[5120]: I0316 17:01:04.117188 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab76f235-6a48-4935-a2d5-5a79806c416c" containerName="mysql-bootstrap" Mar 16 17:01:04 crc kubenswrapper[5120]: I0316 17:01:04.117223 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3143a49-62b5-408a-8dca-d723f7a31619" containerName="neutron-httpd" Mar 16 17:01:04 crc kubenswrapper[5120]: I0316 17:01:04.117231 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3143a49-62b5-408a-8dca-d723f7a31619" containerName="neutron-httpd" Mar 16 17:01:04 crc kubenswrapper[5120]: I0316 17:01:04.117281 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab76f235-6a48-4935-a2d5-5a79806c416c" containerName="galera" Mar 16 17:01:04 crc kubenswrapper[5120]: I0316 17:01:04.117291 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab76f235-6a48-4935-a2d5-5a79806c416c" containerName="galera" Mar 16 17:01:04 crc kubenswrapper[5120]: I0316 17:01:04.117532 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e3143a49-62b5-408a-8dca-d723f7a31619" containerName="neutron-httpd" Mar 16 17:01:04 crc kubenswrapper[5120]: I0316 17:01:04.117559 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ab76f235-6a48-4935-a2d5-5a79806c416c" containerName="galera" Mar 16 17:01:04 crc kubenswrapper[5120]: I0316 17:01:04.117584 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e3143a49-62b5-408a-8dca-d723f7a31619" containerName="neutron-api" Mar 16 17:01:04 crc kubenswrapper[5120]: I0316 17:01:04.123732 5120 scope.go:117] "RemoveContainer" containerID="472402137f246ce709088b3f0d51afee3215744c5a0d4026e8c342a19b0acee2" Mar 16 17:01:04 crc kubenswrapper[5120]: E0316 17:01:04.124785 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"472402137f246ce709088b3f0d51afee3215744c5a0d4026e8c342a19b0acee2\": container with ID starting with 472402137f246ce709088b3f0d51afee3215744c5a0d4026e8c342a19b0acee2 not found: ID does not exist" containerID="472402137f246ce709088b3f0d51afee3215744c5a0d4026e8c342a19b0acee2" Mar 16 17:01:04 crc kubenswrapper[5120]: I0316 17:01:04.124852 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"472402137f246ce709088b3f0d51afee3215744c5a0d4026e8c342a19b0acee2"} err="failed to get container status \"472402137f246ce709088b3f0d51afee3215744c5a0d4026e8c342a19b0acee2\": rpc error: code = NotFound desc = could not find container \"472402137f246ce709088b3f0d51afee3215744c5a0d4026e8c342a19b0acee2\": container with ID starting with 472402137f246ce709088b3f0d51afee3215744c5a0d4026e8c342a19b0acee2 not found: ID does not exist" Mar 16 17:01:04 crc kubenswrapper[5120]: I0316 17:01:04.124879 5120 scope.go:117] "RemoveContainer" containerID="50c9fb8e4395ff8d0b8a9ef7844ff6a387ea6735244afeae82df0471f26e8e1c" Mar 16 17:01:04 crc kubenswrapper[5120]: E0316 17:01:04.125480 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"50c9fb8e4395ff8d0b8a9ef7844ff6a387ea6735244afeae82df0471f26e8e1c\": container with ID starting with 50c9fb8e4395ff8d0b8a9ef7844ff6a387ea6735244afeae82df0471f26e8e1c not found: ID does not exist" containerID="50c9fb8e4395ff8d0b8a9ef7844ff6a387ea6735244afeae82df0471f26e8e1c" Mar 16 17:01:04 crc kubenswrapper[5120]: I0316 17:01:04.125512 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50c9fb8e4395ff8d0b8a9ef7844ff6a387ea6735244afeae82df0471f26e8e1c"} err="failed to get container status \"50c9fb8e4395ff8d0b8a9ef7844ff6a387ea6735244afeae82df0471f26e8e1c\": rpc error: code = NotFound desc = could not find container \"50c9fb8e4395ff8d0b8a9ef7844ff6a387ea6735244afeae82df0471f26e8e1c\": container with ID starting with 50c9fb8e4395ff8d0b8a9ef7844ff6a387ea6735244afeae82df0471f26e8e1c not found: ID does not exist" Mar 16 17:01:04 crc kubenswrapper[5120]: I0316 17:01:04.137737 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-6f846b8bfd-w69px"] Mar 16 17:01:04 crc kubenswrapper[5120]: I0316 17:01:04.137801 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 17:01:04 crc kubenswrapper[5120]: I0316 17:01:04.137932 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:01:04 crc kubenswrapper[5120]: I0316 17:01:04.140918 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"galera-openstack-dockercfg-428w9\"" Mar 16 17:01:04 crc kubenswrapper[5120]: I0316 17:01:04.140996 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-galera-openstack-svc\"" Mar 16 17:01:04 crc kubenswrapper[5120]: I0316 17:01:04.141649 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-scripts\"" Mar 16 17:01:04 crc kubenswrapper[5120]: I0316 17:01:04.144206 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-config-data\"" Mar 16 17:01:04 crc kubenswrapper[5120]: I0316 17:01:04.304171 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/13b65e37-9126-401e-9ef6-3e531453aaba-config-data-default\") pod \"openstack-galera-0\" (UID: \"13b65e37-9126-401e-9ef6-3e531453aaba\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:01:04 crc kubenswrapper[5120]: I0316 17:01:04.304325 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/13b65e37-9126-401e-9ef6-3e531453aaba-kolla-config\") pod \"openstack-galera-0\" (UID: \"13b65e37-9126-401e-9ef6-3e531453aaba\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:01:04 crc kubenswrapper[5120]: I0316 17:01:04.304482 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/13b65e37-9126-401e-9ef6-3e531453aaba-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"13b65e37-9126-401e-9ef6-3e531453aaba\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:01:04 crc kubenswrapper[5120]: I0316 17:01:04.304850 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"openstack-galera-0\" (UID: \"13b65e37-9126-401e-9ef6-3e531453aaba\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:01:04 crc kubenswrapper[5120]: I0316 17:01:04.304945 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/13b65e37-9126-401e-9ef6-3e531453aaba-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"13b65e37-9126-401e-9ef6-3e531453aaba\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:01:04 crc kubenswrapper[5120]: I0316 17:01:04.304977 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/13b65e37-9126-401e-9ef6-3e531453aaba-operator-scripts\") pod \"openstack-galera-0\" (UID: \"13b65e37-9126-401e-9ef6-3e531453aaba\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:01:04 crc kubenswrapper[5120]: I0316 17:01:04.305213 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/13b65e37-9126-401e-9ef6-3e531453aaba-config-data-generated\") pod \"openstack-galera-0\" (UID: \"13b65e37-9126-401e-9ef6-3e531453aaba\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:01:04 crc kubenswrapper[5120]: I0316 17:01:04.305491 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwb2n\" (UniqueName: \"kubernetes.io/projected/13b65e37-9126-401e-9ef6-3e531453aaba-kube-api-access-cwb2n\") pod \"openstack-galera-0\" (UID: \"13b65e37-9126-401e-9ef6-3e531453aaba\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:01:04 crc kubenswrapper[5120]: I0316 17:01:04.408332 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"openstack-galera-0\" (UID: \"13b65e37-9126-401e-9ef6-3e531453aaba\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:01:04 crc kubenswrapper[5120]: I0316 17:01:04.408411 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/13b65e37-9126-401e-9ef6-3e531453aaba-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"13b65e37-9126-401e-9ef6-3e531453aaba\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:01:04 crc kubenswrapper[5120]: I0316 17:01:04.408448 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/13b65e37-9126-401e-9ef6-3e531453aaba-operator-scripts\") pod \"openstack-galera-0\" (UID: \"13b65e37-9126-401e-9ef6-3e531453aaba\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:01:04 crc kubenswrapper[5120]: I0316 17:01:04.408563 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/13b65e37-9126-401e-9ef6-3e531453aaba-config-data-generated\") pod \"openstack-galera-0\" (UID: \"13b65e37-9126-401e-9ef6-3e531453aaba\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:01:04 crc kubenswrapper[5120]: I0316 17:01:04.408656 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cwb2n\" (UniqueName: \"kubernetes.io/projected/13b65e37-9126-401e-9ef6-3e531453aaba-kube-api-access-cwb2n\") pod \"openstack-galera-0\" (UID: \"13b65e37-9126-401e-9ef6-3e531453aaba\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:01:04 crc kubenswrapper[5120]: I0316 17:01:04.408964 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/13b65e37-9126-401e-9ef6-3e531453aaba-config-data-default\") pod \"openstack-galera-0\" (UID: \"13b65e37-9126-401e-9ef6-3e531453aaba\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:01:04 crc kubenswrapper[5120]: I0316 17:01:04.409064 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/13b65e37-9126-401e-9ef6-3e531453aaba-kolla-config\") pod \"openstack-galera-0\" (UID: \"13b65e37-9126-401e-9ef6-3e531453aaba\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:01:04 crc kubenswrapper[5120]: I0316 17:01:04.409164 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/13b65e37-9126-401e-9ef6-3e531453aaba-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"13b65e37-9126-401e-9ef6-3e531453aaba\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:01:04 crc kubenswrapper[5120]: I0316 17:01:04.409695 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/13b65e37-9126-401e-9ef6-3e531453aaba-config-data-generated\") pod \"openstack-galera-0\" (UID: \"13b65e37-9126-401e-9ef6-3e531453aaba\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:01:04 crc kubenswrapper[5120]: I0316 17:01:04.409835 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"openstack-galera-0\" (UID: \"13b65e37-9126-401e-9ef6-3e531453aaba\") device mount path \"/mnt/openstack/pv20\"" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:01:04 crc kubenswrapper[5120]: I0316 17:01:04.410411 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-774bd9565b-8dqvz" podUID="92194734-7636-4b3f-a75a-2343b3d58c71" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.1.14:9311/healthcheck\": read tcp 10.217.0.2:40698->10.217.1.14:9311: read: connection reset by peer" Mar 16 17:01:04 crc kubenswrapper[5120]: I0316 17:01:04.410449 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-774bd9565b-8dqvz" podUID="92194734-7636-4b3f-a75a-2343b3d58c71" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.1.14:9311/healthcheck\": read tcp 10.217.0.2:40710->10.217.1.14:9311: read: connection reset by peer" Mar 16 17:01:04 crc kubenswrapper[5120]: I0316 17:01:04.411882 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/13b65e37-9126-401e-9ef6-3e531453aaba-operator-scripts\") pod \"openstack-galera-0\" (UID: \"13b65e37-9126-401e-9ef6-3e531453aaba\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:01:04 crc kubenswrapper[5120]: I0316 17:01:04.412603 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/13b65e37-9126-401e-9ef6-3e531453aaba-config-data-default\") pod \"openstack-galera-0\" (UID: \"13b65e37-9126-401e-9ef6-3e531453aaba\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:01:04 crc kubenswrapper[5120]: I0316 17:01:04.415613 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/13b65e37-9126-401e-9ef6-3e531453aaba-kolla-config\") pod \"openstack-galera-0\" (UID: \"13b65e37-9126-401e-9ef6-3e531453aaba\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:01:04 crc kubenswrapper[5120]: I0316 17:01:04.420198 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/13b65e37-9126-401e-9ef6-3e531453aaba-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"13b65e37-9126-401e-9ef6-3e531453aaba\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:01:04 crc kubenswrapper[5120]: I0316 17:01:04.422440 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/13b65e37-9126-401e-9ef6-3e531453aaba-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"13b65e37-9126-401e-9ef6-3e531453aaba\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:01:04 crc kubenswrapper[5120]: I0316 17:01:04.441501 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwb2n\" (UniqueName: \"kubernetes.io/projected/13b65e37-9126-401e-9ef6-3e531453aaba-kube-api-access-cwb2n\") pod \"openstack-galera-0\" (UID: \"13b65e37-9126-401e-9ef6-3e531453aaba\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:01:04 crc kubenswrapper[5120]: I0316 17:01:04.445264 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"openstack-galera-0\" (UID: \"13b65e37-9126-401e-9ef6-3e531453aaba\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:01:04 crc kubenswrapper[5120]: I0316 17:01:04.458919 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:01:04 crc kubenswrapper[5120]: I0316 17:01:04.675418 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ab76f235-6a48-4935-a2d5-5a79806c416c" path="/var/lib/kubelet/pods/ab76f235-6a48-4935-a2d5-5a79806c416c/volumes" Mar 16 17:01:04 crc kubenswrapper[5120]: I0316 17:01:04.676335 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e3143a49-62b5-408a-8dca-d723f7a31619" path="/var/lib/kubelet/pods/e3143a49-62b5-408a-8dca-d723f7a31619/volumes" Mar 16 17:01:05 crc kubenswrapper[5120]: I0316 17:01:05.001642 5120 generic.go:358] "Generic (PLEG): container finished" podID="92194734-7636-4b3f-a75a-2343b3d58c71" containerID="0bc3676ee6500c4bb61bbac4704a4548780da105ebd8c4dee57f19a3e5d2abe2" exitCode=0 Mar 16 17:01:05 crc kubenswrapper[5120]: I0316 17:01:05.001955 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-774bd9565b-8dqvz" event={"ID":"92194734-7636-4b3f-a75a-2343b3d58c71","Type":"ContainerDied","Data":"0bc3676ee6500c4bb61bbac4704a4548780da105ebd8c4dee57f19a3e5d2abe2"} Mar 16 17:01:05 crc kubenswrapper[5120]: I0316 17:01:05.162151 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 17:01:05 crc kubenswrapper[5120]: I0316 17:01:05.239136 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-774bd9565b-8dqvz" Mar 16 17:01:05 crc kubenswrapper[5120]: I0316 17:01:05.334546 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/92194734-7636-4b3f-a75a-2343b3d58c71-combined-ca-bundle\") pod \"92194734-7636-4b3f-a75a-2343b3d58c71\" (UID: \"92194734-7636-4b3f-a75a-2343b3d58c71\") " Mar 16 17:01:05 crc kubenswrapper[5120]: I0316 17:01:05.334652 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/92194734-7636-4b3f-a75a-2343b3d58c71-logs\") pod \"92194734-7636-4b3f-a75a-2343b3d58c71\" (UID: \"92194734-7636-4b3f-a75a-2343b3d58c71\") " Mar 16 17:01:05 crc kubenswrapper[5120]: I0316 17:01:05.334708 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/92194734-7636-4b3f-a75a-2343b3d58c71-config-data\") pod \"92194734-7636-4b3f-a75a-2343b3d58c71\" (UID: \"92194734-7636-4b3f-a75a-2343b3d58c71\") " Mar 16 17:01:05 crc kubenswrapper[5120]: I0316 17:01:05.334790 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/92194734-7636-4b3f-a75a-2343b3d58c71-internal-tls-certs\") pod \"92194734-7636-4b3f-a75a-2343b3d58c71\" (UID: \"92194734-7636-4b3f-a75a-2343b3d58c71\") " Mar 16 17:01:05 crc kubenswrapper[5120]: I0316 17:01:05.335005 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mv7v4\" (UniqueName: \"kubernetes.io/projected/92194734-7636-4b3f-a75a-2343b3d58c71-kube-api-access-mv7v4\") pod \"92194734-7636-4b3f-a75a-2343b3d58c71\" (UID: \"92194734-7636-4b3f-a75a-2343b3d58c71\") " Mar 16 17:01:05 crc kubenswrapper[5120]: I0316 17:01:05.335138 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/92194734-7636-4b3f-a75a-2343b3d58c71-public-tls-certs\") pod \"92194734-7636-4b3f-a75a-2343b3d58c71\" (UID: \"92194734-7636-4b3f-a75a-2343b3d58c71\") " Mar 16 17:01:05 crc kubenswrapper[5120]: I0316 17:01:05.335166 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/92194734-7636-4b3f-a75a-2343b3d58c71-config-data-custom\") pod \"92194734-7636-4b3f-a75a-2343b3d58c71\" (UID: \"92194734-7636-4b3f-a75a-2343b3d58c71\") " Mar 16 17:01:05 crc kubenswrapper[5120]: I0316 17:01:05.335817 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92194734-7636-4b3f-a75a-2343b3d58c71-logs" (OuterVolumeSpecName: "logs") pod "92194734-7636-4b3f-a75a-2343b3d58c71" (UID: "92194734-7636-4b3f-a75a-2343b3d58c71"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:01:05 crc kubenswrapper[5120]: I0316 17:01:05.336265 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/92194734-7636-4b3f-a75a-2343b3d58c71-logs\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:05 crc kubenswrapper[5120]: I0316 17:01:05.339855 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92194734-7636-4b3f-a75a-2343b3d58c71-kube-api-access-mv7v4" (OuterVolumeSpecName: "kube-api-access-mv7v4") pod "92194734-7636-4b3f-a75a-2343b3d58c71" (UID: "92194734-7636-4b3f-a75a-2343b3d58c71"). InnerVolumeSpecName "kube-api-access-mv7v4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:01:05 crc kubenswrapper[5120]: I0316 17:01:05.354125 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92194734-7636-4b3f-a75a-2343b3d58c71-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "92194734-7636-4b3f-a75a-2343b3d58c71" (UID: "92194734-7636-4b3f-a75a-2343b3d58c71"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:01:05 crc kubenswrapper[5120]: I0316 17:01:05.382936 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92194734-7636-4b3f-a75a-2343b3d58c71-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "92194734-7636-4b3f-a75a-2343b3d58c71" (UID: "92194734-7636-4b3f-a75a-2343b3d58c71"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:01:05 crc kubenswrapper[5120]: I0316 17:01:05.418074 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-699f94747b-4flvt"] Mar 16 17:01:05 crc kubenswrapper[5120]: I0316 17:01:05.443895 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-api-7bbc5ddcc6-cxnhk"] Mar 16 17:01:05 crc kubenswrapper[5120]: I0316 17:01:05.444777 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/92194734-7636-4b3f-a75a-2343b3d58c71-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:05 crc kubenswrapper[5120]: I0316 17:01:05.444821 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mv7v4\" (UniqueName: \"kubernetes.io/projected/92194734-7636-4b3f-a75a-2343b3d58c71-kube-api-access-mv7v4\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:05 crc kubenswrapper[5120]: I0316 17:01:05.444839 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/92194734-7636-4b3f-a75a-2343b3d58c71-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:05 crc kubenswrapper[5120]: I0316 17:01:05.452812 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92194734-7636-4b3f-a75a-2343b3d58c71" containerName="barbican-api" Mar 16 17:01:05 crc kubenswrapper[5120]: I0316 17:01:05.452847 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="92194734-7636-4b3f-a75a-2343b3d58c71" containerName="barbican-api" Mar 16 17:01:05 crc kubenswrapper[5120]: I0316 17:01:05.452918 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92194734-7636-4b3f-a75a-2343b3d58c71" containerName="barbican-api-log" Mar 16 17:01:05 crc kubenswrapper[5120]: I0316 17:01:05.452924 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="92194734-7636-4b3f-a75a-2343b3d58c71" containerName="barbican-api-log" Mar 16 17:01:05 crc kubenswrapper[5120]: I0316 17:01:05.455865 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="92194734-7636-4b3f-a75a-2343b3d58c71" containerName="barbican-api" Mar 16 17:01:05 crc kubenswrapper[5120]: I0316 17:01:05.455998 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="92194734-7636-4b3f-a75a-2343b3d58c71" containerName="barbican-api-log" Mar 16 17:01:05 crc kubenswrapper[5120]: I0316 17:01:05.503400 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92194734-7636-4b3f-a75a-2343b3d58c71-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "92194734-7636-4b3f-a75a-2343b3d58c71" (UID: "92194734-7636-4b3f-a75a-2343b3d58c71"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:01:05 crc kubenswrapper[5120]: I0316 17:01:05.527942 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92194734-7636-4b3f-a75a-2343b3d58c71-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "92194734-7636-4b3f-a75a-2343b3d58c71" (UID: "92194734-7636-4b3f-a75a-2343b3d58c71"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:01:05 crc kubenswrapper[5120]: I0316 17:01:05.528407 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-7bbc5ddcc6-cxnhk"] Mar 16 17:01:05 crc kubenswrapper[5120]: I0316 17:01:05.528579 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-7bbc5ddcc6-cxnhk" Mar 16 17:01:05 crc kubenswrapper[5120]: I0316 17:01:05.550472 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/92194734-7636-4b3f-a75a-2343b3d58c71-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:05 crc kubenswrapper[5120]: I0316 17:01:05.550816 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/92194734-7636-4b3f-a75a-2343b3d58c71-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:05 crc kubenswrapper[5120]: I0316 17:01:05.551581 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92194734-7636-4b3f-a75a-2343b3d58c71-config-data" (OuterVolumeSpecName: "config-data") pod "92194734-7636-4b3f-a75a-2343b3d58c71" (UID: "92194734-7636-4b3f-a75a-2343b3d58c71"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:01:05 crc kubenswrapper[5120]: I0316 17:01:05.653599 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/53cbb212-f009-4d4e-90fc-9a50a14cc62b-public-tls-certs\") pod \"barbican-api-7bbc5ddcc6-cxnhk\" (UID: \"53cbb212-f009-4d4e-90fc-9a50a14cc62b\") " pod="openstack-kuttl-tests/barbican-api-7bbc5ddcc6-cxnhk" Mar 16 17:01:05 crc kubenswrapper[5120]: I0316 17:01:05.653646 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtz88\" (UniqueName: \"kubernetes.io/projected/53cbb212-f009-4d4e-90fc-9a50a14cc62b-kube-api-access-dtz88\") pod \"barbican-api-7bbc5ddcc6-cxnhk\" (UID: \"53cbb212-f009-4d4e-90fc-9a50a14cc62b\") " pod="openstack-kuttl-tests/barbican-api-7bbc5ddcc6-cxnhk" Mar 16 17:01:05 crc kubenswrapper[5120]: I0316 17:01:05.653703 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/53cbb212-f009-4d4e-90fc-9a50a14cc62b-config-data-custom\") pod \"barbican-api-7bbc5ddcc6-cxnhk\" (UID: \"53cbb212-f009-4d4e-90fc-9a50a14cc62b\") " pod="openstack-kuttl-tests/barbican-api-7bbc5ddcc6-cxnhk" Mar 16 17:01:05 crc kubenswrapper[5120]: I0316 17:01:05.653722 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/53cbb212-f009-4d4e-90fc-9a50a14cc62b-combined-ca-bundle\") pod \"barbican-api-7bbc5ddcc6-cxnhk\" (UID: \"53cbb212-f009-4d4e-90fc-9a50a14cc62b\") " pod="openstack-kuttl-tests/barbican-api-7bbc5ddcc6-cxnhk" Mar 16 17:01:05 crc kubenswrapper[5120]: I0316 17:01:05.654149 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/53cbb212-f009-4d4e-90fc-9a50a14cc62b-config-data\") pod \"barbican-api-7bbc5ddcc6-cxnhk\" (UID: \"53cbb212-f009-4d4e-90fc-9a50a14cc62b\") " pod="openstack-kuttl-tests/barbican-api-7bbc5ddcc6-cxnhk" Mar 16 17:01:05 crc kubenswrapper[5120]: I0316 17:01:05.654263 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/53cbb212-f009-4d4e-90fc-9a50a14cc62b-internal-tls-certs\") pod \"barbican-api-7bbc5ddcc6-cxnhk\" (UID: \"53cbb212-f009-4d4e-90fc-9a50a14cc62b\") " pod="openstack-kuttl-tests/barbican-api-7bbc5ddcc6-cxnhk" Mar 16 17:01:05 crc kubenswrapper[5120]: I0316 17:01:05.654552 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/53cbb212-f009-4d4e-90fc-9a50a14cc62b-logs\") pod \"barbican-api-7bbc5ddcc6-cxnhk\" (UID: \"53cbb212-f009-4d4e-90fc-9a50a14cc62b\") " pod="openstack-kuttl-tests/barbican-api-7bbc5ddcc6-cxnhk" Mar 16 17:01:05 crc kubenswrapper[5120]: I0316 17:01:05.654775 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/92194734-7636-4b3f-a75a-2343b3d58c71-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:05 crc kubenswrapper[5120]: I0316 17:01:05.670358 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 17:01:05 crc kubenswrapper[5120]: I0316 17:01:05.670564 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/memcached-0" podUID="d0bd5c73-646f-42e2-885f-25fc4835ee47" containerName="memcached" containerID="cri-o://8be0da7a54d695cbc009d1b94bbd227230732d4c227496afa2a45a9ba96f06ec" gracePeriod=30 Mar 16 17:01:05 crc kubenswrapper[5120]: I0316 17:01:05.757482 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/53cbb212-f009-4d4e-90fc-9a50a14cc62b-config-data\") pod \"barbican-api-7bbc5ddcc6-cxnhk\" (UID: \"53cbb212-f009-4d4e-90fc-9a50a14cc62b\") " pod="openstack-kuttl-tests/barbican-api-7bbc5ddcc6-cxnhk" Mar 16 17:01:05 crc kubenswrapper[5120]: I0316 17:01:05.757575 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/53cbb212-f009-4d4e-90fc-9a50a14cc62b-internal-tls-certs\") pod \"barbican-api-7bbc5ddcc6-cxnhk\" (UID: \"53cbb212-f009-4d4e-90fc-9a50a14cc62b\") " pod="openstack-kuttl-tests/barbican-api-7bbc5ddcc6-cxnhk" Mar 16 17:01:05 crc kubenswrapper[5120]: I0316 17:01:05.757649 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/53cbb212-f009-4d4e-90fc-9a50a14cc62b-logs\") pod \"barbican-api-7bbc5ddcc6-cxnhk\" (UID: \"53cbb212-f009-4d4e-90fc-9a50a14cc62b\") " pod="openstack-kuttl-tests/barbican-api-7bbc5ddcc6-cxnhk" Mar 16 17:01:05 crc kubenswrapper[5120]: I0316 17:01:05.757990 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/53cbb212-f009-4d4e-90fc-9a50a14cc62b-public-tls-certs\") pod \"barbican-api-7bbc5ddcc6-cxnhk\" (UID: \"53cbb212-f009-4d4e-90fc-9a50a14cc62b\") " pod="openstack-kuttl-tests/barbican-api-7bbc5ddcc6-cxnhk" Mar 16 17:01:05 crc kubenswrapper[5120]: I0316 17:01:05.758037 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dtz88\" (UniqueName: \"kubernetes.io/projected/53cbb212-f009-4d4e-90fc-9a50a14cc62b-kube-api-access-dtz88\") pod \"barbican-api-7bbc5ddcc6-cxnhk\" (UID: \"53cbb212-f009-4d4e-90fc-9a50a14cc62b\") " pod="openstack-kuttl-tests/barbican-api-7bbc5ddcc6-cxnhk" Mar 16 17:01:05 crc kubenswrapper[5120]: I0316 17:01:05.758132 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/53cbb212-f009-4d4e-90fc-9a50a14cc62b-config-data-custom\") pod \"barbican-api-7bbc5ddcc6-cxnhk\" (UID: \"53cbb212-f009-4d4e-90fc-9a50a14cc62b\") " pod="openstack-kuttl-tests/barbican-api-7bbc5ddcc6-cxnhk" Mar 16 17:01:05 crc kubenswrapper[5120]: I0316 17:01:05.758153 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/53cbb212-f009-4d4e-90fc-9a50a14cc62b-combined-ca-bundle\") pod \"barbican-api-7bbc5ddcc6-cxnhk\" (UID: \"53cbb212-f009-4d4e-90fc-9a50a14cc62b\") " pod="openstack-kuttl-tests/barbican-api-7bbc5ddcc6-cxnhk" Mar 16 17:01:05 crc kubenswrapper[5120]: I0316 17:01:05.763515 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/53cbb212-f009-4d4e-90fc-9a50a14cc62b-combined-ca-bundle\") pod \"barbican-api-7bbc5ddcc6-cxnhk\" (UID: \"53cbb212-f009-4d4e-90fc-9a50a14cc62b\") " pod="openstack-kuttl-tests/barbican-api-7bbc5ddcc6-cxnhk" Mar 16 17:01:05 crc kubenswrapper[5120]: I0316 17:01:05.763973 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/53cbb212-f009-4d4e-90fc-9a50a14cc62b-logs\") pod \"barbican-api-7bbc5ddcc6-cxnhk\" (UID: \"53cbb212-f009-4d4e-90fc-9a50a14cc62b\") " pod="openstack-kuttl-tests/barbican-api-7bbc5ddcc6-cxnhk" Mar 16 17:01:05 crc kubenswrapper[5120]: I0316 17:01:05.769490 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/53cbb212-f009-4d4e-90fc-9a50a14cc62b-config-data\") pod \"barbican-api-7bbc5ddcc6-cxnhk\" (UID: \"53cbb212-f009-4d4e-90fc-9a50a14cc62b\") " pod="openstack-kuttl-tests/barbican-api-7bbc5ddcc6-cxnhk" Mar 16 17:01:05 crc kubenswrapper[5120]: I0316 17:01:05.775299 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/53cbb212-f009-4d4e-90fc-9a50a14cc62b-public-tls-certs\") pod \"barbican-api-7bbc5ddcc6-cxnhk\" (UID: \"53cbb212-f009-4d4e-90fc-9a50a14cc62b\") " pod="openstack-kuttl-tests/barbican-api-7bbc5ddcc6-cxnhk" Mar 16 17:01:05 crc kubenswrapper[5120]: I0316 17:01:05.776696 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/53cbb212-f009-4d4e-90fc-9a50a14cc62b-internal-tls-certs\") pod \"barbican-api-7bbc5ddcc6-cxnhk\" (UID: \"53cbb212-f009-4d4e-90fc-9a50a14cc62b\") " pod="openstack-kuttl-tests/barbican-api-7bbc5ddcc6-cxnhk" Mar 16 17:01:05 crc kubenswrapper[5120]: I0316 17:01:05.778150 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/53cbb212-f009-4d4e-90fc-9a50a14cc62b-config-data-custom\") pod \"barbican-api-7bbc5ddcc6-cxnhk\" (UID: \"53cbb212-f009-4d4e-90fc-9a50a14cc62b\") " pod="openstack-kuttl-tests/barbican-api-7bbc5ddcc6-cxnhk" Mar 16 17:01:05 crc kubenswrapper[5120]: I0316 17:01:05.783591 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/placement-57589895fd-84tvt" podUID="08933bb0-40b0-4b92-b9d1-af46cdcc8aad" containerName="placement-log" probeResult="failure" output="Get \"https://10.217.1.82:8778/\": read tcp 10.217.0.2:54114->10.217.1.82:8778: read: connection reset by peer" Mar 16 17:01:05 crc kubenswrapper[5120]: I0316 17:01:05.784095 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/placement-57589895fd-84tvt" podUID="08933bb0-40b0-4b92-b9d1-af46cdcc8aad" containerName="placement-api" probeResult="failure" output="Get \"https://10.217.1.82:8778/\": read tcp 10.217.0.2:54122->10.217.1.82:8778: read: connection reset by peer" Mar 16 17:01:05 crc kubenswrapper[5120]: I0316 17:01:05.784929 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtz88\" (UniqueName: \"kubernetes.io/projected/53cbb212-f009-4d4e-90fc-9a50a14cc62b-kube-api-access-dtz88\") pod \"barbican-api-7bbc5ddcc6-cxnhk\" (UID: \"53cbb212-f009-4d4e-90fc-9a50a14cc62b\") " pod="openstack-kuttl-tests/barbican-api-7bbc5ddcc6-cxnhk" Mar 16 17:01:05 crc kubenswrapper[5120]: I0316 17:01:05.834352 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:01:05 crc kubenswrapper[5120]: I0316 17:01:05.853198 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-7bbc5ddcc6-cxnhk" Mar 16 17:01:06 crc kubenswrapper[5120]: I0316 17:01:06.021156 5120 generic.go:358] "Generic (PLEG): container finished" podID="08933bb0-40b0-4b92-b9d1-af46cdcc8aad" containerID="d9ab28b0a7ccb773ffd22dadcda722c1f6eda9f10071fd99c7e5612da79f866f" exitCode=0 Mar 16 17:01:06 crc kubenswrapper[5120]: I0316 17:01:06.021560 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-57589895fd-84tvt" event={"ID":"08933bb0-40b0-4b92-b9d1-af46cdcc8aad","Type":"ContainerDied","Data":"d9ab28b0a7ccb773ffd22dadcda722c1f6eda9f10071fd99c7e5612da79f866f"} Mar 16 17:01:06 crc kubenswrapper[5120]: I0316 17:01:06.027748 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-774bd9565b-8dqvz" Mar 16 17:01:06 crc kubenswrapper[5120]: I0316 17:01:06.027775 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-774bd9565b-8dqvz" event={"ID":"92194734-7636-4b3f-a75a-2343b3d58c71","Type":"ContainerDied","Data":"6b72fa070d2d8ff0d23f0d6b17e72459acdad3050db6aaf053383ffe5a1b32ff"} Mar 16 17:01:06 crc kubenswrapper[5120]: I0316 17:01:06.027840 5120 scope.go:117] "RemoveContainer" containerID="0bc3676ee6500c4bb61bbac4704a4548780da105ebd8c4dee57f19a3e5d2abe2" Mar 16 17:01:06 crc kubenswrapper[5120]: I0316 17:01:06.029544 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="ce24ae83-459d-4410-bd4d-fb7e0fcad044" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"https://10.217.1.94:8775/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 17:01:06 crc kubenswrapper[5120]: I0316 17:01:06.030006 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="0d641338-e35d-4819-b487-513c8840cfd7" containerName="nova-api-log" probeResult="failure" output="Get \"https://10.217.1.93:8774/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Mar 16 17:01:06 crc kubenswrapper[5120]: I0316 17:01:06.032364 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"13b65e37-9126-401e-9ef6-3e531453aaba","Type":"ContainerStarted","Data":"d4f5205995b7c25196e08d7776a3216b01adf4671787cdf98654a2ac9fa24504"} Mar 16 17:01:06 crc kubenswrapper[5120]: I0316 17:01:06.032495 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"13b65e37-9126-401e-9ef6-3e531453aaba","Type":"ContainerStarted","Data":"08247345f8d90a3396f39a0ef7478ded938b0c018325212ecd7f452d9bb4800c"} Mar 16 17:01:06 crc kubenswrapper[5120]: I0316 17:01:06.032654 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-699f94747b-4flvt" podUID="54dca6ff-f965-48fc-8521-946430880efd" containerName="barbican-api-log" containerID="cri-o://8feb0e246bfc57f3f361393b3ce7b92241ee250ac674e494ba77c3a8139f2177" gracePeriod=30 Mar 16 17:01:06 crc kubenswrapper[5120]: I0316 17:01:06.032794 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-699f94747b-4flvt" podUID="54dca6ff-f965-48fc-8521-946430880efd" containerName="barbican-api" containerID="cri-o://84b4826d9f823121ff329cfd3521bd14bd6b6ea04ab4ab7b0105a2062f73c8c6" gracePeriod=30 Mar 16 17:01:06 crc kubenswrapper[5120]: I0316 17:01:06.032990 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="ce24ae83-459d-4410-bd4d-fb7e0fcad044" containerName="nova-metadata-log" probeResult="failure" output="Get \"https://10.217.1.94:8775/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 17:01:06 crc kubenswrapper[5120]: I0316 17:01:06.077738 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="0d641338-e35d-4819-b487-513c8840cfd7" containerName="nova-api-api" probeResult="failure" output="Get \"https://10.217.1.93:8774/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Mar 16 17:01:06 crc kubenswrapper[5120]: I0316 17:01:06.101071 5120 scope.go:117] "RemoveContainer" containerID="684dcbf0d0e2d99b5464c64c981678afc1a2620d2ac3e69244d731b2c452354a" Mar 16 17:01:06 crc kubenswrapper[5120]: I0316 17:01:06.113015 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-774bd9565b-8dqvz"] Mar 16 17:01:06 crc kubenswrapper[5120]: I0316 17:01:06.129956 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-api-774bd9565b-8dqvz"] Mar 16 17:01:06 crc kubenswrapper[5120]: I0316 17:01:06.278198 5120 scope.go:117] "RemoveContainer" containerID="28b9a50d02777d9bada17a7deaf883b3a5c44bf2b1edfc4884e2c9ba176b9986" Mar 16 17:01:06 crc kubenswrapper[5120]: I0316 17:01:06.380921 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/cinder-api-0" podUID="b7434cde-890e-42d9-9b5c-bbd60a188517" containerName="cinder-api" probeResult="failure" output="Get \"https://10.217.1.79:8776/healthcheck\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Mar 16 17:01:06 crc kubenswrapper[5120]: I0316 17:01:06.440661 5120 scope.go:117] "RemoveContainer" containerID="bfea2ccfeecd5668f548f56f9728d9652b77dcd3aa4937a75130937b9c0dfdc9" Mar 16 17:01:06 crc kubenswrapper[5120]: I0316 17:01:06.488906 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-57589895fd-84tvt" Mar 16 17:01:06 crc kubenswrapper[5120]: I0316 17:01:06.538665 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-7bbc5ddcc6-cxnhk"] Mar 16 17:01:06 crc kubenswrapper[5120]: I0316 17:01:06.579517 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="2cadcb9e-2a3b-4c14-8fcc-39939326678f" containerName="cinder-scheduler" probeResult="failure" output="HTTP probe failed with statuscode: 500" Mar 16 17:01:06 crc kubenswrapper[5120]: I0316 17:01:06.588924 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/08933bb0-40b0-4b92-b9d1-af46cdcc8aad-scripts\") pod \"08933bb0-40b0-4b92-b9d1-af46cdcc8aad\" (UID: \"08933bb0-40b0-4b92-b9d1-af46cdcc8aad\") " Mar 16 17:01:06 crc kubenswrapper[5120]: I0316 17:01:06.589113 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/08933bb0-40b0-4b92-b9d1-af46cdcc8aad-combined-ca-bundle\") pod \"08933bb0-40b0-4b92-b9d1-af46cdcc8aad\" (UID: \"08933bb0-40b0-4b92-b9d1-af46cdcc8aad\") " Mar 16 17:01:06 crc kubenswrapper[5120]: I0316 17:01:06.589145 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d2vsk\" (UniqueName: \"kubernetes.io/projected/08933bb0-40b0-4b92-b9d1-af46cdcc8aad-kube-api-access-d2vsk\") pod \"08933bb0-40b0-4b92-b9d1-af46cdcc8aad\" (UID: \"08933bb0-40b0-4b92-b9d1-af46cdcc8aad\") " Mar 16 17:01:06 crc kubenswrapper[5120]: I0316 17:01:06.589248 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/08933bb0-40b0-4b92-b9d1-af46cdcc8aad-public-tls-certs\") pod \"08933bb0-40b0-4b92-b9d1-af46cdcc8aad\" (UID: \"08933bb0-40b0-4b92-b9d1-af46cdcc8aad\") " Mar 16 17:01:06 crc kubenswrapper[5120]: I0316 17:01:06.589376 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/08933bb0-40b0-4b92-b9d1-af46cdcc8aad-logs\") pod \"08933bb0-40b0-4b92-b9d1-af46cdcc8aad\" (UID: \"08933bb0-40b0-4b92-b9d1-af46cdcc8aad\") " Mar 16 17:01:06 crc kubenswrapper[5120]: I0316 17:01:06.589398 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/08933bb0-40b0-4b92-b9d1-af46cdcc8aad-internal-tls-certs\") pod \"08933bb0-40b0-4b92-b9d1-af46cdcc8aad\" (UID: \"08933bb0-40b0-4b92-b9d1-af46cdcc8aad\") " Mar 16 17:01:06 crc kubenswrapper[5120]: I0316 17:01:06.589893 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/08933bb0-40b0-4b92-b9d1-af46cdcc8aad-config-data\") pod \"08933bb0-40b0-4b92-b9d1-af46cdcc8aad\" (UID: \"08933bb0-40b0-4b92-b9d1-af46cdcc8aad\") " Mar 16 17:01:06 crc kubenswrapper[5120]: I0316 17:01:06.590441 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08933bb0-40b0-4b92-b9d1-af46cdcc8aad-logs" (OuterVolumeSpecName: "logs") pod "08933bb0-40b0-4b92-b9d1-af46cdcc8aad" (UID: "08933bb0-40b0-4b92-b9d1-af46cdcc8aad"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:01:06 crc kubenswrapper[5120]: I0316 17:01:06.593086 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/08933bb0-40b0-4b92-b9d1-af46cdcc8aad-logs\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:06 crc kubenswrapper[5120]: I0316 17:01:06.595782 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08933bb0-40b0-4b92-b9d1-af46cdcc8aad-kube-api-access-d2vsk" (OuterVolumeSpecName: "kube-api-access-d2vsk") pod "08933bb0-40b0-4b92-b9d1-af46cdcc8aad" (UID: "08933bb0-40b0-4b92-b9d1-af46cdcc8aad"). InnerVolumeSpecName "kube-api-access-d2vsk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:01:06 crc kubenswrapper[5120]: I0316 17:01:06.602420 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/08933bb0-40b0-4b92-b9d1-af46cdcc8aad-scripts" (OuterVolumeSpecName: "scripts") pod "08933bb0-40b0-4b92-b9d1-af46cdcc8aad" (UID: "08933bb0-40b0-4b92-b9d1-af46cdcc8aad"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:01:06 crc kubenswrapper[5120]: I0316 17:01:06.667479 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/08933bb0-40b0-4b92-b9d1-af46cdcc8aad-config-data" (OuterVolumeSpecName: "config-data") pod "08933bb0-40b0-4b92-b9d1-af46cdcc8aad" (UID: "08933bb0-40b0-4b92-b9d1-af46cdcc8aad"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:01:06 crc kubenswrapper[5120]: I0316 17:01:06.678108 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="92194734-7636-4b3f-a75a-2343b3d58c71" path="/var/lib/kubelet/pods/92194734-7636-4b3f-a75a-2343b3d58c71/volumes" Mar 16 17:01:06 crc kubenswrapper[5120]: I0316 17:01:06.683484 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/08933bb0-40b0-4b92-b9d1-af46cdcc8aad-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "08933bb0-40b0-4b92-b9d1-af46cdcc8aad" (UID: "08933bb0-40b0-4b92-b9d1-af46cdcc8aad"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:01:06 crc kubenswrapper[5120]: I0316 17:01:06.686339 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-699f94747b-4flvt" Mar 16 17:01:06 crc kubenswrapper[5120]: I0316 17:01:06.696337 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/08933bb0-40b0-4b92-b9d1-af46cdcc8aad-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:06 crc kubenswrapper[5120]: I0316 17:01:06.696365 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/08933bb0-40b0-4b92-b9d1-af46cdcc8aad-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:06 crc kubenswrapper[5120]: I0316 17:01:06.696374 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/08933bb0-40b0-4b92-b9d1-af46cdcc8aad-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:06 crc kubenswrapper[5120]: I0316 17:01:06.696384 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d2vsk\" (UniqueName: \"kubernetes.io/projected/08933bb0-40b0-4b92-b9d1-af46cdcc8aad-kube-api-access-d2vsk\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:06 crc kubenswrapper[5120]: I0316 17:01:06.755827 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/08933bb0-40b0-4b92-b9d1-af46cdcc8aad-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "08933bb0-40b0-4b92-b9d1-af46cdcc8aad" (UID: "08933bb0-40b0-4b92-b9d1-af46cdcc8aad"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:01:06 crc kubenswrapper[5120]: I0316 17:01:06.759893 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/08933bb0-40b0-4b92-b9d1-af46cdcc8aad-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "08933bb0-40b0-4b92-b9d1-af46cdcc8aad" (UID: "08933bb0-40b0-4b92-b9d1-af46cdcc8aad"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:01:06 crc kubenswrapper[5120]: I0316 17:01:06.797806 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/54dca6ff-f965-48fc-8521-946430880efd-config-data\") pod \"54dca6ff-f965-48fc-8521-946430880efd\" (UID: \"54dca6ff-f965-48fc-8521-946430880efd\") " Mar 16 17:01:06 crc kubenswrapper[5120]: I0316 17:01:06.798779 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/54dca6ff-f965-48fc-8521-946430880efd-public-tls-certs\") pod \"54dca6ff-f965-48fc-8521-946430880efd\" (UID: \"54dca6ff-f965-48fc-8521-946430880efd\") " Mar 16 17:01:06 crc kubenswrapper[5120]: I0316 17:01:06.798985 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/54dca6ff-f965-48fc-8521-946430880efd-internal-tls-certs\") pod \"54dca6ff-f965-48fc-8521-946430880efd\" (UID: \"54dca6ff-f965-48fc-8521-946430880efd\") " Mar 16 17:01:06 crc kubenswrapper[5120]: I0316 17:01:06.799121 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/54dca6ff-f965-48fc-8521-946430880efd-combined-ca-bundle\") pod \"54dca6ff-f965-48fc-8521-946430880efd\" (UID: \"54dca6ff-f965-48fc-8521-946430880efd\") " Mar 16 17:01:06 crc kubenswrapper[5120]: I0316 17:01:06.799187 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/54dca6ff-f965-48fc-8521-946430880efd-logs\") pod \"54dca6ff-f965-48fc-8521-946430880efd\" (UID: \"54dca6ff-f965-48fc-8521-946430880efd\") " Mar 16 17:01:06 crc kubenswrapper[5120]: I0316 17:01:06.799293 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wnmtg\" (UniqueName: \"kubernetes.io/projected/54dca6ff-f965-48fc-8521-946430880efd-kube-api-access-wnmtg\") pod \"54dca6ff-f965-48fc-8521-946430880efd\" (UID: \"54dca6ff-f965-48fc-8521-946430880efd\") " Mar 16 17:01:06 crc kubenswrapper[5120]: I0316 17:01:06.799467 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/54dca6ff-f965-48fc-8521-946430880efd-config-data-custom\") pod \"54dca6ff-f965-48fc-8521-946430880efd\" (UID: \"54dca6ff-f965-48fc-8521-946430880efd\") " Mar 16 17:01:06 crc kubenswrapper[5120]: I0316 17:01:06.801696 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/08933bb0-40b0-4b92-b9d1-af46cdcc8aad-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:06 crc kubenswrapper[5120]: I0316 17:01:06.801809 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/08933bb0-40b0-4b92-b9d1-af46cdcc8aad-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:06 crc kubenswrapper[5120]: I0316 17:01:06.804065 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54dca6ff-f965-48fc-8521-946430880efd-logs" (OuterVolumeSpecName: "logs") pod "54dca6ff-f965-48fc-8521-946430880efd" (UID: "54dca6ff-f965-48fc-8521-946430880efd"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:01:06 crc kubenswrapper[5120]: I0316 17:01:06.834017 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54dca6ff-f965-48fc-8521-946430880efd-kube-api-access-wnmtg" (OuterVolumeSpecName: "kube-api-access-wnmtg") pod "54dca6ff-f965-48fc-8521-946430880efd" (UID: "54dca6ff-f965-48fc-8521-946430880efd"). InnerVolumeSpecName "kube-api-access-wnmtg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:01:06 crc kubenswrapper[5120]: I0316 17:01:06.840284 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54dca6ff-f965-48fc-8521-946430880efd-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "54dca6ff-f965-48fc-8521-946430880efd" (UID: "54dca6ff-f965-48fc-8521-946430880efd"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:01:06 crc kubenswrapper[5120]: I0316 17:01:06.903652 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54dca6ff-f965-48fc-8521-946430880efd-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "54dca6ff-f965-48fc-8521-946430880efd" (UID: "54dca6ff-f965-48fc-8521-946430880efd"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:01:06 crc kubenswrapper[5120]: I0316 17:01:06.908222 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/54dca6ff-f965-48fc-8521-946430880efd-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:06 crc kubenswrapper[5120]: I0316 17:01:06.908269 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/54dca6ff-f965-48fc-8521-946430880efd-logs\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:06 crc kubenswrapper[5120]: I0316 17:01:06.908283 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wnmtg\" (UniqueName: \"kubernetes.io/projected/54dca6ff-f965-48fc-8521-946430880efd-kube-api-access-wnmtg\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:06 crc kubenswrapper[5120]: I0316 17:01:06.908296 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/54dca6ff-f965-48fc-8521-946430880efd-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:06 crc kubenswrapper[5120]: I0316 17:01:06.926269 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-6cb5f74687-7bbcw"] Mar 16 17:01:06 crc kubenswrapper[5120]: I0316 17:01:06.926955 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/keystone-6cb5f74687-7bbcw" podUID="04658afd-5440-4feb-a1a2-3232b641b558" containerName="keystone-api" containerID="cri-o://ec54314107d232b9b6dc6fa69411e61406a6e8472585c507180fff0ecb54cae4" gracePeriod=30 Mar 16 17:01:06 crc kubenswrapper[5120]: I0316 17:01:06.983058 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-766c6fc56d-x6dc5"] Mar 16 17:01:06 crc kubenswrapper[5120]: I0316 17:01:06.985285 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54dca6ff-f965-48fc-8521-946430880efd-config-data" (OuterVolumeSpecName: "config-data") pod "54dca6ff-f965-48fc-8521-946430880efd" (UID: "54dca6ff-f965-48fc-8521-946430880efd"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:01:06 crc kubenswrapper[5120]: I0316 17:01:06.987721 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08933bb0-40b0-4b92-b9d1-af46cdcc8aad" containerName="placement-log" Mar 16 17:01:06 crc kubenswrapper[5120]: I0316 17:01:06.987752 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="08933bb0-40b0-4b92-b9d1-af46cdcc8aad" containerName="placement-log" Mar 16 17:01:06 crc kubenswrapper[5120]: I0316 17:01:06.987781 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54dca6ff-f965-48fc-8521-946430880efd" containerName="barbican-api-log" Mar 16 17:01:06 crc kubenswrapper[5120]: I0316 17:01:06.987787 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="54dca6ff-f965-48fc-8521-946430880efd" containerName="barbican-api-log" Mar 16 17:01:06 crc kubenswrapper[5120]: I0316 17:01:06.989891 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54dca6ff-f965-48fc-8521-946430880efd" containerName="barbican-api" Mar 16 17:01:06 crc kubenswrapper[5120]: I0316 17:01:06.989915 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="54dca6ff-f965-48fc-8521-946430880efd" containerName="barbican-api" Mar 16 17:01:06 crc kubenswrapper[5120]: I0316 17:01:06.989934 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08933bb0-40b0-4b92-b9d1-af46cdcc8aad" containerName="placement-api" Mar 16 17:01:06 crc kubenswrapper[5120]: I0316 17:01:06.989943 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="08933bb0-40b0-4b92-b9d1-af46cdcc8aad" containerName="placement-api" Mar 16 17:01:06 crc kubenswrapper[5120]: I0316 17:01:06.992941 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54dca6ff-f965-48fc-8521-946430880efd-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "54dca6ff-f965-48fc-8521-946430880efd" (UID: "54dca6ff-f965-48fc-8521-946430880efd"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:01:06 crc kubenswrapper[5120]: I0316 17:01:06.992978 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="54dca6ff-f965-48fc-8521-946430880efd" containerName="barbican-api" Mar 16 17:01:06 crc kubenswrapper[5120]: I0316 17:01:06.993396 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="08933bb0-40b0-4b92-b9d1-af46cdcc8aad" containerName="placement-log" Mar 16 17:01:06 crc kubenswrapper[5120]: I0316 17:01:06.993433 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="54dca6ff-f965-48fc-8521-946430880efd" containerName="barbican-api-log" Mar 16 17:01:06 crc kubenswrapper[5120]: I0316 17:01:06.993458 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="08933bb0-40b0-4b92-b9d1-af46cdcc8aad" containerName="placement-api" Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.009702 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-766c6fc56d-x6dc5"] Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.009864 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-766c6fc56d-x6dc5" Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.011026 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54dca6ff-f965-48fc-8521-946430880efd-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "54dca6ff-f965-48fc-8521-946430880efd" (UID: "54dca6ff-f965-48fc-8521-946430880efd"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.013126 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/54dca6ff-f965-48fc-8521-946430880efd-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.013158 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/54dca6ff-f965-48fc-8521-946430880efd-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.013171 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/54dca6ff-f965-48fc-8521-946430880efd-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.066665 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.076311 5120 generic.go:358] "Generic (PLEG): container finished" podID="54dca6ff-f965-48fc-8521-946430880efd" containerID="84b4826d9f823121ff329cfd3521bd14bd6b6ea04ab4ab7b0105a2062f73c8c6" exitCode=0 Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.076816 5120 generic.go:358] "Generic (PLEG): container finished" podID="54dca6ff-f965-48fc-8521-946430880efd" containerID="8feb0e246bfc57f3f361393b3ce7b92241ee250ac674e494ba77c3a8139f2177" exitCode=143 Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.076640 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-699f94747b-4flvt" Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.076503 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-699f94747b-4flvt" event={"ID":"54dca6ff-f965-48fc-8521-946430880efd","Type":"ContainerDied","Data":"84b4826d9f823121ff329cfd3521bd14bd6b6ea04ab4ab7b0105a2062f73c8c6"} Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.080617 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-699f94747b-4flvt" event={"ID":"54dca6ff-f965-48fc-8521-946430880efd","Type":"ContainerDied","Data":"8feb0e246bfc57f3f361393b3ce7b92241ee250ac674e494ba77c3a8139f2177"} Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.080648 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-699f94747b-4flvt" event={"ID":"54dca6ff-f965-48fc-8521-946430880efd","Type":"ContainerDied","Data":"520faefb67cf7d90eb9777032b56957cff24114c7c22b3ba9cd146b0daf8c25a"} Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.080676 5120 scope.go:117] "RemoveContainer" containerID="84b4826d9f823121ff329cfd3521bd14bd6b6ea04ab4ab7b0105a2062f73c8c6" Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.109561 5120 generic.go:358] "Generic (PLEG): container finished" podID="d0bd5c73-646f-42e2-885f-25fc4835ee47" containerID="8be0da7a54d695cbc009d1b94bbd227230732d4c227496afa2a45a9ba96f06ec" exitCode=0 Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.109883 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.109896 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"d0bd5c73-646f-42e2-885f-25fc4835ee47","Type":"ContainerDied","Data":"8be0da7a54d695cbc009d1b94bbd227230732d4c227496afa2a45a9ba96f06ec"} Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.109939 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"d0bd5c73-646f-42e2-885f-25fc4835ee47","Type":"ContainerDied","Data":"f2f53baec56cdccd3f89e94dafd2aa8951b587b3d783db654fd2eeec176e9c73"} Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.124525 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/d0bd5c73-646f-42e2-885f-25fc4835ee47-config-data\") pod \"d0bd5c73-646f-42e2-885f-25fc4835ee47\" (UID: \"d0bd5c73-646f-42e2-885f-25fc4835ee47\") " Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.124599 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d0bd5c73-646f-42e2-885f-25fc4835ee47-combined-ca-bundle\") pod \"d0bd5c73-646f-42e2-885f-25fc4835ee47\" (UID: \"d0bd5c73-646f-42e2-885f-25fc4835ee47\") " Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.124886 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/d0bd5c73-646f-42e2-885f-25fc4835ee47-memcached-tls-certs\") pod \"d0bd5c73-646f-42e2-885f-25fc4835ee47\" (UID: \"d0bd5c73-646f-42e2-885f-25fc4835ee47\") " Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.124960 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/d0bd5c73-646f-42e2-885f-25fc4835ee47-kolla-config\") pod \"d0bd5c73-646f-42e2-885f-25fc4835ee47\" (UID: \"d0bd5c73-646f-42e2-885f-25fc4835ee47\") " Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.125039 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5zl7d\" (UniqueName: \"kubernetes.io/projected/d0bd5c73-646f-42e2-885f-25fc4835ee47-kube-api-access-5zl7d\") pod \"d0bd5c73-646f-42e2-885f-25fc4835ee47\" (UID: \"d0bd5c73-646f-42e2-885f-25fc4835ee47\") " Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.125185 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d0bd5c73-646f-42e2-885f-25fc4835ee47-config-data" (OuterVolumeSpecName: "config-data") pod "d0bd5c73-646f-42e2-885f-25fc4835ee47" (UID: "d0bd5c73-646f-42e2-885f-25fc4835ee47"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.125219 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/532a5c65-05a2-4018-9244-1386bf31dcb2-combined-ca-bundle\") pod \"keystone-766c6fc56d-x6dc5\" (UID: \"532a5c65-05a2-4018-9244-1386bf31dcb2\") " pod="openstack-kuttl-tests/keystone-766c6fc56d-x6dc5" Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.125956 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d0bd5c73-646f-42e2-885f-25fc4835ee47-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "d0bd5c73-646f-42e2-885f-25fc4835ee47" (UID: "d0bd5c73-646f-42e2-885f-25fc4835ee47"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.149882 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/532a5c65-05a2-4018-9244-1386bf31dcb2-scripts\") pod \"keystone-766c6fc56d-x6dc5\" (UID: \"532a5c65-05a2-4018-9244-1386bf31dcb2\") " pod="openstack-kuttl-tests/keystone-766c6fc56d-x6dc5" Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.149973 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/532a5c65-05a2-4018-9244-1386bf31dcb2-public-tls-certs\") pod \"keystone-766c6fc56d-x6dc5\" (UID: \"532a5c65-05a2-4018-9244-1386bf31dcb2\") " pod="openstack-kuttl-tests/keystone-766c6fc56d-x6dc5" Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.150193 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/532a5c65-05a2-4018-9244-1386bf31dcb2-config-data\") pod \"keystone-766c6fc56d-x6dc5\" (UID: \"532a5c65-05a2-4018-9244-1386bf31dcb2\") " pod="openstack-kuttl-tests/keystone-766c6fc56d-x6dc5" Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.150235 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ph628\" (UniqueName: \"kubernetes.io/projected/532a5c65-05a2-4018-9244-1386bf31dcb2-kube-api-access-ph628\") pod \"keystone-766c6fc56d-x6dc5\" (UID: \"532a5c65-05a2-4018-9244-1386bf31dcb2\") " pod="openstack-kuttl-tests/keystone-766c6fc56d-x6dc5" Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.150288 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/532a5c65-05a2-4018-9244-1386bf31dcb2-internal-tls-certs\") pod \"keystone-766c6fc56d-x6dc5\" (UID: \"532a5c65-05a2-4018-9244-1386bf31dcb2\") " pod="openstack-kuttl-tests/keystone-766c6fc56d-x6dc5" Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.150338 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/532a5c65-05a2-4018-9244-1386bf31dcb2-fernet-keys\") pod \"keystone-766c6fc56d-x6dc5\" (UID: \"532a5c65-05a2-4018-9244-1386bf31dcb2\") " pod="openstack-kuttl-tests/keystone-766c6fc56d-x6dc5" Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.150415 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/532a5c65-05a2-4018-9244-1386bf31dcb2-credential-keys\") pod \"keystone-766c6fc56d-x6dc5\" (UID: \"532a5c65-05a2-4018-9244-1386bf31dcb2\") " pod="openstack-kuttl-tests/keystone-766c6fc56d-x6dc5" Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.150599 5120 reconciler_common.go:299] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/d0bd5c73-646f-42e2-885f-25fc4835ee47-kolla-config\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.150610 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/d0bd5c73-646f-42e2-885f-25fc4835ee47-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.168113 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/keystone-6cb5f74687-7bbcw" podUID="04658afd-5440-4feb-a1a2-3232b641b558" containerName="keystone-api" probeResult="failure" output="Get \"https://10.217.1.100:5000/v3\": read tcp 10.217.0.2:50110->10.217.1.100:5000: read: connection reset by peer" Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.172706 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0bd5c73-646f-42e2-885f-25fc4835ee47-kube-api-access-5zl7d" (OuterVolumeSpecName: "kube-api-access-5zl7d") pod "d0bd5c73-646f-42e2-885f-25fc4835ee47" (UID: "d0bd5c73-646f-42e2-885f-25fc4835ee47"). InnerVolumeSpecName "kube-api-access-5zl7d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.216832 5120 scope.go:117] "RemoveContainer" containerID="8feb0e246bfc57f3f361393b3ce7b92241ee250ac674e494ba77c3a8139f2177" Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.226338 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0bd5c73-646f-42e2-885f-25fc4835ee47-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "d0bd5c73-646f-42e2-885f-25fc4835ee47" (UID: "d0bd5c73-646f-42e2-885f-25fc4835ee47"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.227212 5120 generic.go:358] "Generic (PLEG): container finished" podID="1f6975fd-67a9-4ce2-87b0-7318d7345a80" containerID="a13b02076f983681a11b54a1569f95dfe4808752321801358ab0264bcf250454" exitCode=137 Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.227363 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"1f6975fd-67a9-4ce2-87b0-7318d7345a80","Type":"ContainerDied","Data":"a13b02076f983681a11b54a1569f95dfe4808752321801358ab0264bcf250454"} Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.237081 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-57589895fd-84tvt" Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.237071 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-57589895fd-84tvt" event={"ID":"08933bb0-40b0-4b92-b9d1-af46cdcc8aad","Type":"ContainerDied","Data":"d230fd9d0d090bd7f661fe53df8e714c7e59a18e5e08381b929cb2f2365f2e1c"} Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.245562 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-7bbc5ddcc6-cxnhk" event={"ID":"53cbb212-f009-4d4e-90fc-9a50a14cc62b","Type":"ContainerStarted","Data":"1aa3bba3e930ec962235431ddf3fe2a5d6f2094302d4df6b0f874c2f055eb2f6"} Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.245619 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-7bbc5ddcc6-cxnhk" event={"ID":"53cbb212-f009-4d4e-90fc-9a50a14cc62b","Type":"ContainerStarted","Data":"ffdd597f8127c978a9981146324a36d3bc6eb7c23cd2e7fc59d5ddcd0a7f1472"} Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.254711 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/532a5c65-05a2-4018-9244-1386bf31dcb2-combined-ca-bundle\") pod \"keystone-766c6fc56d-x6dc5\" (UID: \"532a5c65-05a2-4018-9244-1386bf31dcb2\") " pod="openstack-kuttl-tests/keystone-766c6fc56d-x6dc5" Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.255012 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/532a5c65-05a2-4018-9244-1386bf31dcb2-scripts\") pod \"keystone-766c6fc56d-x6dc5\" (UID: \"532a5c65-05a2-4018-9244-1386bf31dcb2\") " pod="openstack-kuttl-tests/keystone-766c6fc56d-x6dc5" Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.255078 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/532a5c65-05a2-4018-9244-1386bf31dcb2-public-tls-certs\") pod \"keystone-766c6fc56d-x6dc5\" (UID: \"532a5c65-05a2-4018-9244-1386bf31dcb2\") " pod="openstack-kuttl-tests/keystone-766c6fc56d-x6dc5" Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.255313 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/532a5c65-05a2-4018-9244-1386bf31dcb2-config-data\") pod \"keystone-766c6fc56d-x6dc5\" (UID: \"532a5c65-05a2-4018-9244-1386bf31dcb2\") " pod="openstack-kuttl-tests/keystone-766c6fc56d-x6dc5" Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.255372 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ph628\" (UniqueName: \"kubernetes.io/projected/532a5c65-05a2-4018-9244-1386bf31dcb2-kube-api-access-ph628\") pod \"keystone-766c6fc56d-x6dc5\" (UID: \"532a5c65-05a2-4018-9244-1386bf31dcb2\") " pod="openstack-kuttl-tests/keystone-766c6fc56d-x6dc5" Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.255438 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/532a5c65-05a2-4018-9244-1386bf31dcb2-internal-tls-certs\") pod \"keystone-766c6fc56d-x6dc5\" (UID: \"532a5c65-05a2-4018-9244-1386bf31dcb2\") " pod="openstack-kuttl-tests/keystone-766c6fc56d-x6dc5" Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.255503 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/532a5c65-05a2-4018-9244-1386bf31dcb2-fernet-keys\") pod \"keystone-766c6fc56d-x6dc5\" (UID: \"532a5c65-05a2-4018-9244-1386bf31dcb2\") " pod="openstack-kuttl-tests/keystone-766c6fc56d-x6dc5" Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.255593 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/532a5c65-05a2-4018-9244-1386bf31dcb2-credential-keys\") pod \"keystone-766c6fc56d-x6dc5\" (UID: \"532a5c65-05a2-4018-9244-1386bf31dcb2\") " pod="openstack-kuttl-tests/keystone-766c6fc56d-x6dc5" Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.255734 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5zl7d\" (UniqueName: \"kubernetes.io/projected/d0bd5c73-646f-42e2-885f-25fc4835ee47-kube-api-access-5zl7d\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.255772 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d0bd5c73-646f-42e2-885f-25fc4835ee47-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.262488 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0bd5c73-646f-42e2-885f-25fc4835ee47-memcached-tls-certs" (OuterVolumeSpecName: "memcached-tls-certs") pod "d0bd5c73-646f-42e2-885f-25fc4835ee47" (UID: "d0bd5c73-646f-42e2-885f-25fc4835ee47"). InnerVolumeSpecName "memcached-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.264354 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/532a5c65-05a2-4018-9244-1386bf31dcb2-scripts\") pod \"keystone-766c6fc56d-x6dc5\" (UID: \"532a5c65-05a2-4018-9244-1386bf31dcb2\") " pod="openstack-kuttl-tests/keystone-766c6fc56d-x6dc5" Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.264499 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/532a5c65-05a2-4018-9244-1386bf31dcb2-credential-keys\") pod \"keystone-766c6fc56d-x6dc5\" (UID: \"532a5c65-05a2-4018-9244-1386bf31dcb2\") " pod="openstack-kuttl-tests/keystone-766c6fc56d-x6dc5" Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.264518 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/532a5c65-05a2-4018-9244-1386bf31dcb2-internal-tls-certs\") pod \"keystone-766c6fc56d-x6dc5\" (UID: \"532a5c65-05a2-4018-9244-1386bf31dcb2\") " pod="openstack-kuttl-tests/keystone-766c6fc56d-x6dc5" Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.265578 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/532a5c65-05a2-4018-9244-1386bf31dcb2-config-data\") pod \"keystone-766c6fc56d-x6dc5\" (UID: \"532a5c65-05a2-4018-9244-1386bf31dcb2\") " pod="openstack-kuttl-tests/keystone-766c6fc56d-x6dc5" Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.266390 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/532a5c65-05a2-4018-9244-1386bf31dcb2-public-tls-certs\") pod \"keystone-766c6fc56d-x6dc5\" (UID: \"532a5c65-05a2-4018-9244-1386bf31dcb2\") " pod="openstack-kuttl-tests/keystone-766c6fc56d-x6dc5" Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.266440 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/532a5c65-05a2-4018-9244-1386bf31dcb2-fernet-keys\") pod \"keystone-766c6fc56d-x6dc5\" (UID: \"532a5c65-05a2-4018-9244-1386bf31dcb2\") " pod="openstack-kuttl-tests/keystone-766c6fc56d-x6dc5" Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.267468 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/532a5c65-05a2-4018-9244-1386bf31dcb2-combined-ca-bundle\") pod \"keystone-766c6fc56d-x6dc5\" (UID: \"532a5c65-05a2-4018-9244-1386bf31dcb2\") " pod="openstack-kuttl-tests/keystone-766c6fc56d-x6dc5" Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.281237 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ph628\" (UniqueName: \"kubernetes.io/projected/532a5c65-05a2-4018-9244-1386bf31dcb2-kube-api-access-ph628\") pod \"keystone-766c6fc56d-x6dc5\" (UID: \"532a5c65-05a2-4018-9244-1386bf31dcb2\") " pod="openstack-kuttl-tests/keystone-766c6fc56d-x6dc5" Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.357990 5120 reconciler_common.go:299] "Volume detached for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/d0bd5c73-646f-42e2-885f-25fc4835ee47-memcached-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.400523 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-766c6fc56d-x6dc5" Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.425067 5120 scope.go:117] "RemoveContainer" containerID="84b4826d9f823121ff329cfd3521bd14bd6b6ea04ab4ab7b0105a2062f73c8c6" Mar 16 17:01:07 crc kubenswrapper[5120]: E0316 17:01:07.425382 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"84b4826d9f823121ff329cfd3521bd14bd6b6ea04ab4ab7b0105a2062f73c8c6\": container with ID starting with 84b4826d9f823121ff329cfd3521bd14bd6b6ea04ab4ab7b0105a2062f73c8c6 not found: ID does not exist" containerID="84b4826d9f823121ff329cfd3521bd14bd6b6ea04ab4ab7b0105a2062f73c8c6" Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.425544 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84b4826d9f823121ff329cfd3521bd14bd6b6ea04ab4ab7b0105a2062f73c8c6"} err="failed to get container status \"84b4826d9f823121ff329cfd3521bd14bd6b6ea04ab4ab7b0105a2062f73c8c6\": rpc error: code = NotFound desc = could not find container \"84b4826d9f823121ff329cfd3521bd14bd6b6ea04ab4ab7b0105a2062f73c8c6\": container with ID starting with 84b4826d9f823121ff329cfd3521bd14bd6b6ea04ab4ab7b0105a2062f73c8c6 not found: ID does not exist" Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.425560 5120 scope.go:117] "RemoveContainer" containerID="8feb0e246bfc57f3f361393b3ce7b92241ee250ac674e494ba77c3a8139f2177" Mar 16 17:01:07 crc kubenswrapper[5120]: E0316 17:01:07.426963 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8feb0e246bfc57f3f361393b3ce7b92241ee250ac674e494ba77c3a8139f2177\": container with ID starting with 8feb0e246bfc57f3f361393b3ce7b92241ee250ac674e494ba77c3a8139f2177 not found: ID does not exist" containerID="8feb0e246bfc57f3f361393b3ce7b92241ee250ac674e494ba77c3a8139f2177" Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.426991 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8feb0e246bfc57f3f361393b3ce7b92241ee250ac674e494ba77c3a8139f2177"} err="failed to get container status \"8feb0e246bfc57f3f361393b3ce7b92241ee250ac674e494ba77c3a8139f2177\": rpc error: code = NotFound desc = could not find container \"8feb0e246bfc57f3f361393b3ce7b92241ee250ac674e494ba77c3a8139f2177\": container with ID starting with 8feb0e246bfc57f3f361393b3ce7b92241ee250ac674e494ba77c3a8139f2177 not found: ID does not exist" Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.427004 5120 scope.go:117] "RemoveContainer" containerID="84b4826d9f823121ff329cfd3521bd14bd6b6ea04ab4ab7b0105a2062f73c8c6" Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.427729 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-57589895fd-84tvt"] Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.439777 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84b4826d9f823121ff329cfd3521bd14bd6b6ea04ab4ab7b0105a2062f73c8c6"} err="failed to get container status \"84b4826d9f823121ff329cfd3521bd14bd6b6ea04ab4ab7b0105a2062f73c8c6\": rpc error: code = NotFound desc = could not find container \"84b4826d9f823121ff329cfd3521bd14bd6b6ea04ab4ab7b0105a2062f73c8c6\": container with ID starting with 84b4826d9f823121ff329cfd3521bd14bd6b6ea04ab4ab7b0105a2062f73c8c6 not found: ID does not exist" Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.439826 5120 scope.go:117] "RemoveContainer" containerID="8feb0e246bfc57f3f361393b3ce7b92241ee250ac674e494ba77c3a8139f2177" Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.445275 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8feb0e246bfc57f3f361393b3ce7b92241ee250ac674e494ba77c3a8139f2177"} err="failed to get container status \"8feb0e246bfc57f3f361393b3ce7b92241ee250ac674e494ba77c3a8139f2177\": rpc error: code = NotFound desc = could not find container \"8feb0e246bfc57f3f361393b3ce7b92241ee250ac674e494ba77c3a8139f2177\": container with ID starting with 8feb0e246bfc57f3f361393b3ce7b92241ee250ac674e494ba77c3a8139f2177 not found: ID does not exist" Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.445316 5120 scope.go:117] "RemoveContainer" containerID="8be0da7a54d695cbc009d1b94bbd227230732d4c227496afa2a45a9ba96f06ec" Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.448056 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-57589895fd-84tvt"] Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.457821 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-699f94747b-4flvt"] Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.478043 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-api-699f94747b-4flvt"] Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.487819 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.504054 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.517043 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.518644 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0bd5c73-646f-42e2-885f-25fc4835ee47" containerName="memcached" Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.518671 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0bd5c73-646f-42e2-885f-25fc4835ee47" containerName="memcached" Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.518926 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="d0bd5c73-646f-42e2-885f-25fc4835ee47" containerName="memcached" Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.530733 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.530892 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.538290 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"memcached-config-data\"" Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.538562 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"memcached-memcached-dockercfg-s2pts\"" Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.538687 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-memcached-svc\"" Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.585030 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.613049 5120 scope.go:117] "RemoveContainer" containerID="8be0da7a54d695cbc009d1b94bbd227230732d4c227496afa2a45a9ba96f06ec" Mar 16 17:01:07 crc kubenswrapper[5120]: E0316 17:01:07.614577 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8be0da7a54d695cbc009d1b94bbd227230732d4c227496afa2a45a9ba96f06ec\": container with ID starting with 8be0da7a54d695cbc009d1b94bbd227230732d4c227496afa2a45a9ba96f06ec not found: ID does not exist" containerID="8be0da7a54d695cbc009d1b94bbd227230732d4c227496afa2a45a9ba96f06ec" Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.614619 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8be0da7a54d695cbc009d1b94bbd227230732d4c227496afa2a45a9ba96f06ec"} err="failed to get container status \"8be0da7a54d695cbc009d1b94bbd227230732d4c227496afa2a45a9ba96f06ec\": rpc error: code = NotFound desc = could not find container \"8be0da7a54d695cbc009d1b94bbd227230732d4c227496afa2a45a9ba96f06ec\": container with ID starting with 8be0da7a54d695cbc009d1b94bbd227230732d4c227496afa2a45a9ba96f06ec not found: ID does not exist" Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.614792 5120 scope.go:117] "RemoveContainer" containerID="d9ab28b0a7ccb773ffd22dadcda722c1f6eda9f10071fd99c7e5612da79f866f" Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.680418 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/a2c4ebb0-3217-469c-88b5-b06d50a9db60-config-data\") pod \"memcached-0\" (UID: \"a2c4ebb0-3217-469c-88b5-b06d50a9db60\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.680743 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78r8b\" (UniqueName: \"kubernetes.io/projected/a2c4ebb0-3217-469c-88b5-b06d50a9db60-kube-api-access-78r8b\") pod \"memcached-0\" (UID: \"a2c4ebb0-3217-469c-88b5-b06d50a9db60\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.680875 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/a2c4ebb0-3217-469c-88b5-b06d50a9db60-kolla-config\") pod \"memcached-0\" (UID: \"a2c4ebb0-3217-469c-88b5-b06d50a9db60\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.681095 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a2c4ebb0-3217-469c-88b5-b06d50a9db60-combined-ca-bundle\") pod \"memcached-0\" (UID: \"a2c4ebb0-3217-469c-88b5-b06d50a9db60\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.681157 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/a2c4ebb0-3217-469c-88b5-b06d50a9db60-memcached-tls-certs\") pod \"memcached-0\" (UID: \"a2c4ebb0-3217-469c-88b5-b06d50a9db60\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.695924 5120 scope.go:117] "RemoveContainer" containerID="6c5ab5c25f8f32671ed1d3f8ef0839c556632b36cd0e8b390fd2983c34cf090a" Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.755518 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-6cb5f74687-7bbcw" Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.782840 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/1f6975fd-67a9-4ce2-87b0-7318d7345a80-cache\") pod \"1f6975fd-67a9-4ce2-87b0-7318d7345a80\" (UID: \"1f6975fd-67a9-4ce2-87b0-7318d7345a80\") " Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.783099 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xwbvs\" (UniqueName: \"kubernetes.io/projected/1f6975fd-67a9-4ce2-87b0-7318d7345a80-kube-api-access-xwbvs\") pod \"1f6975fd-67a9-4ce2-87b0-7318d7345a80\" (UID: \"1f6975fd-67a9-4ce2-87b0-7318d7345a80\") " Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.783210 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"swift\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"1f6975fd-67a9-4ce2-87b0-7318d7345a80\" (UID: \"1f6975fd-67a9-4ce2-87b0-7318d7345a80\") " Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.783366 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/1f6975fd-67a9-4ce2-87b0-7318d7345a80-lock\") pod \"1f6975fd-67a9-4ce2-87b0-7318d7345a80\" (UID: \"1f6975fd-67a9-4ce2-87b0-7318d7345a80\") " Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.784382 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f6975fd-67a9-4ce2-87b0-7318d7345a80-cache" (OuterVolumeSpecName: "cache") pod "1f6975fd-67a9-4ce2-87b0-7318d7345a80" (UID: "1f6975fd-67a9-4ce2-87b0-7318d7345a80"). InnerVolumeSpecName "cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.784783 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f6975fd-67a9-4ce2-87b0-7318d7345a80-lock" (OuterVolumeSpecName: "lock") pod "1f6975fd-67a9-4ce2-87b0-7318d7345a80" (UID: "1f6975fd-67a9-4ce2-87b0-7318d7345a80"). InnerVolumeSpecName "lock". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.785122 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/1f6975fd-67a9-4ce2-87b0-7318d7345a80-etc-swift\") pod \"1f6975fd-67a9-4ce2-87b0-7318d7345a80\" (UID: \"1f6975fd-67a9-4ce2-87b0-7318d7345a80\") " Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.785154 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1f6975fd-67a9-4ce2-87b0-7318d7345a80-combined-ca-bundle\") pod \"1f6975fd-67a9-4ce2-87b0-7318d7345a80\" (UID: \"1f6975fd-67a9-4ce2-87b0-7318d7345a80\") " Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.786016 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a2c4ebb0-3217-469c-88b5-b06d50a9db60-combined-ca-bundle\") pod \"memcached-0\" (UID: \"a2c4ebb0-3217-469c-88b5-b06d50a9db60\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.786093 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/a2c4ebb0-3217-469c-88b5-b06d50a9db60-memcached-tls-certs\") pod \"memcached-0\" (UID: \"a2c4ebb0-3217-469c-88b5-b06d50a9db60\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.786530 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/a2c4ebb0-3217-469c-88b5-b06d50a9db60-config-data\") pod \"memcached-0\" (UID: \"a2c4ebb0-3217-469c-88b5-b06d50a9db60\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.790956 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-78r8b\" (UniqueName: \"kubernetes.io/projected/a2c4ebb0-3217-469c-88b5-b06d50a9db60-kube-api-access-78r8b\") pod \"memcached-0\" (UID: \"a2c4ebb0-3217-469c-88b5-b06d50a9db60\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.791110 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/a2c4ebb0-3217-469c-88b5-b06d50a9db60-kolla-config\") pod \"memcached-0\" (UID: \"a2c4ebb0-3217-469c-88b5-b06d50a9db60\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.792080 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/a2c4ebb0-3217-469c-88b5-b06d50a9db60-kolla-config\") pod \"memcached-0\" (UID: \"a2c4ebb0-3217-469c-88b5-b06d50a9db60\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.792706 5120 reconciler_common.go:299] "Volume detached for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/1f6975fd-67a9-4ce2-87b0-7318d7345a80-lock\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.792848 5120 reconciler_common.go:299] "Volume detached for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/1f6975fd-67a9-4ce2-87b0-7318d7345a80-cache\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.793414 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/a2c4ebb0-3217-469c-88b5-b06d50a9db60-config-data\") pod \"memcached-0\" (UID: \"a2c4ebb0-3217-469c-88b5-b06d50a9db60\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.795481 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage03-crc" (OuterVolumeSpecName: "swift") pod "1f6975fd-67a9-4ce2-87b0-7318d7345a80" (UID: "1f6975fd-67a9-4ce2-87b0-7318d7345a80"). InnerVolumeSpecName "local-storage03-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.796421 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/a2c4ebb0-3217-469c-88b5-b06d50a9db60-memcached-tls-certs\") pod \"memcached-0\" (UID: \"a2c4ebb0-3217-469c-88b5-b06d50a9db60\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.796615 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f6975fd-67a9-4ce2-87b0-7318d7345a80-kube-api-access-xwbvs" (OuterVolumeSpecName: "kube-api-access-xwbvs") pod "1f6975fd-67a9-4ce2-87b0-7318d7345a80" (UID: "1f6975fd-67a9-4ce2-87b0-7318d7345a80"). InnerVolumeSpecName "kube-api-access-xwbvs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.859491 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-78r8b\" (UniqueName: \"kubernetes.io/projected/a2c4ebb0-3217-469c-88b5-b06d50a9db60-kube-api-access-78r8b\") pod \"memcached-0\" (UID: \"a2c4ebb0-3217-469c-88b5-b06d50a9db60\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.860186 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f6975fd-67a9-4ce2-87b0-7318d7345a80-etc-swift" (OuterVolumeSpecName: "etc-swift") pod "1f6975fd-67a9-4ce2-87b0-7318d7345a80" (UID: "1f6975fd-67a9-4ce2-87b0-7318d7345a80"). InnerVolumeSpecName "etc-swift". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.896196 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/04658afd-5440-4feb-a1a2-3232b641b558-public-tls-certs\") pod \"04658afd-5440-4feb-a1a2-3232b641b558\" (UID: \"04658afd-5440-4feb-a1a2-3232b641b558\") " Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.896528 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/04658afd-5440-4feb-a1a2-3232b641b558-config-data\") pod \"04658afd-5440-4feb-a1a2-3232b641b558\" (UID: \"04658afd-5440-4feb-a1a2-3232b641b558\") " Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.896587 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/04658afd-5440-4feb-a1a2-3232b641b558-combined-ca-bundle\") pod \"04658afd-5440-4feb-a1a2-3232b641b558\" (UID: \"04658afd-5440-4feb-a1a2-3232b641b558\") " Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.896647 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vcrbs\" (UniqueName: \"kubernetes.io/projected/04658afd-5440-4feb-a1a2-3232b641b558-kube-api-access-vcrbs\") pod \"04658afd-5440-4feb-a1a2-3232b641b558\" (UID: \"04658afd-5440-4feb-a1a2-3232b641b558\") " Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.896801 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/04658afd-5440-4feb-a1a2-3232b641b558-credential-keys\") pod \"04658afd-5440-4feb-a1a2-3232b641b558\" (UID: \"04658afd-5440-4feb-a1a2-3232b641b558\") " Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.896845 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/04658afd-5440-4feb-a1a2-3232b641b558-scripts\") pod \"04658afd-5440-4feb-a1a2-3232b641b558\" (UID: \"04658afd-5440-4feb-a1a2-3232b641b558\") " Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.896983 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/04658afd-5440-4feb-a1a2-3232b641b558-internal-tls-certs\") pod \"04658afd-5440-4feb-a1a2-3232b641b558\" (UID: \"04658afd-5440-4feb-a1a2-3232b641b558\") " Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.897071 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/04658afd-5440-4feb-a1a2-3232b641b558-fernet-keys\") pod \"04658afd-5440-4feb-a1a2-3232b641b558\" (UID: \"04658afd-5440-4feb-a1a2-3232b641b558\") " Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.919514 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") on node \"crc\" " Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.919551 5120 reconciler_common.go:299] "Volume detached for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/1f6975fd-67a9-4ce2-87b0-7318d7345a80-etc-swift\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.919569 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xwbvs\" (UniqueName: \"kubernetes.io/projected/1f6975fd-67a9-4ce2-87b0-7318d7345a80-kube-api-access-xwbvs\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.927041 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a2c4ebb0-3217-469c-88b5-b06d50a9db60-combined-ca-bundle\") pod \"memcached-0\" (UID: \"a2c4ebb0-3217-469c-88b5-b06d50a9db60\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.954938 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04658afd-5440-4feb-a1a2-3232b641b558-kube-api-access-vcrbs" (OuterVolumeSpecName: "kube-api-access-vcrbs") pod "04658afd-5440-4feb-a1a2-3232b641b558" (UID: "04658afd-5440-4feb-a1a2-3232b641b558"). InnerVolumeSpecName "kube-api-access-vcrbs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.960389 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/04658afd-5440-4feb-a1a2-3232b641b558-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "04658afd-5440-4feb-a1a2-3232b641b558" (UID: "04658afd-5440-4feb-a1a2-3232b641b558"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.962939 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/04658afd-5440-4feb-a1a2-3232b641b558-scripts" (OuterVolumeSpecName: "scripts") pod "04658afd-5440-4feb-a1a2-3232b641b558" (UID: "04658afd-5440-4feb-a1a2-3232b641b558"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.963230 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/04658afd-5440-4feb-a1a2-3232b641b558-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "04658afd-5440-4feb-a1a2-3232b641b558" (UID: "04658afd-5440-4feb-a1a2-3232b641b558"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:01:07 crc kubenswrapper[5120]: I0316 17:01:07.981360 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Mar 16 17:01:08 crc kubenswrapper[5120]: I0316 17:01:08.006400 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/04658afd-5440-4feb-a1a2-3232b641b558-config-data" (OuterVolumeSpecName: "config-data") pod "04658afd-5440-4feb-a1a2-3232b641b558" (UID: "04658afd-5440-4feb-a1a2-3232b641b558"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:01:08 crc kubenswrapper[5120]: I0316 17:01:08.049958 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/04658afd-5440-4feb-a1a2-3232b641b558-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "04658afd-5440-4feb-a1a2-3232b641b558" (UID: "04658afd-5440-4feb-a1a2-3232b641b558"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:01:08 crc kubenswrapper[5120]: I0316 17:01:08.095208 5120 reconciler_common.go:299] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/04658afd-5440-4feb-a1a2-3232b641b558-fernet-keys\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:08 crc kubenswrapper[5120]: I0316 17:01:08.095253 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/04658afd-5440-4feb-a1a2-3232b641b558-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:08 crc kubenswrapper[5120]: I0316 17:01:08.095277 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/04658afd-5440-4feb-a1a2-3232b641b558-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:08 crc kubenswrapper[5120]: I0316 17:01:08.095295 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vcrbs\" (UniqueName: \"kubernetes.io/projected/04658afd-5440-4feb-a1a2-3232b641b558-kube-api-access-vcrbs\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:08 crc kubenswrapper[5120]: I0316 17:01:08.095308 5120 reconciler_common.go:299] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/04658afd-5440-4feb-a1a2-3232b641b558-credential-keys\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:08 crc kubenswrapper[5120]: I0316 17:01:08.095354 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/04658afd-5440-4feb-a1a2-3232b641b558-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:08 crc kubenswrapper[5120]: I0316 17:01:08.169264 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/04658afd-5440-4feb-a1a2-3232b641b558-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "04658afd-5440-4feb-a1a2-3232b641b558" (UID: "04658afd-5440-4feb-a1a2-3232b641b558"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:01:08 crc kubenswrapper[5120]: I0316 17:01:08.191793 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage03-crc" (UniqueName: "kubernetes.io/local-volume/local-storage03-crc") on node "crc" Mar 16 17:01:08 crc kubenswrapper[5120]: I0316 17:01:08.195382 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/04658afd-5440-4feb-a1a2-3232b641b558-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "04658afd-5440-4feb-a1a2-3232b641b558" (UID: "04658afd-5440-4feb-a1a2-3232b641b558"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:01:08 crc kubenswrapper[5120]: I0316 17:01:08.199284 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/04658afd-5440-4feb-a1a2-3232b641b558-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:08 crc kubenswrapper[5120]: I0316 17:01:08.199327 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:08 crc kubenswrapper[5120]: I0316 17:01:08.199343 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/04658afd-5440-4feb-a1a2-3232b641b558-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:08 crc kubenswrapper[5120]: I0316 17:01:08.307688 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"1f6975fd-67a9-4ce2-87b0-7318d7345a80","Type":"ContainerDied","Data":"72f9999debf34e244f550c3b73907da465311d85efec9f87ac95ad99743671d3"} Mar 16 17:01:08 crc kubenswrapper[5120]: I0316 17:01:08.307745 5120 scope.go:117] "RemoveContainer" containerID="a13b02076f983681a11b54a1569f95dfe4808752321801358ab0264bcf250454" Mar 16 17:01:08 crc kubenswrapper[5120]: I0316 17:01:08.307997 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Mar 16 17:01:08 crc kubenswrapper[5120]: I0316 17:01:08.320840 5120 generic.go:358] "Generic (PLEG): container finished" podID="04658afd-5440-4feb-a1a2-3232b641b558" containerID="ec54314107d232b9b6dc6fa69411e61406a6e8472585c507180fff0ecb54cae4" exitCode=0 Mar 16 17:01:08 crc kubenswrapper[5120]: I0316 17:01:08.321070 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-6cb5f74687-7bbcw" Mar 16 17:01:08 crc kubenswrapper[5120]: I0316 17:01:08.321011 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-6cb5f74687-7bbcw" event={"ID":"04658afd-5440-4feb-a1a2-3232b641b558","Type":"ContainerDied","Data":"ec54314107d232b9b6dc6fa69411e61406a6e8472585c507180fff0ecb54cae4"} Mar 16 17:01:08 crc kubenswrapper[5120]: I0316 17:01:08.321235 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-6cb5f74687-7bbcw" event={"ID":"04658afd-5440-4feb-a1a2-3232b641b558","Type":"ContainerDied","Data":"a2fb16437e1da6cad3cdd1299f150d1a6ecf86ff190316056ffe4cc4a919f605"} Mar 16 17:01:08 crc kubenswrapper[5120]: I0316 17:01:08.351895 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-7bbc5ddcc6-cxnhk" event={"ID":"53cbb212-f009-4d4e-90fc-9a50a14cc62b","Type":"ContainerStarted","Data":"cd314e8c2ba56b3a12ba0679d21f2a55a4f7ab45f72f1581f1ae854629e205c9"} Mar 16 17:01:08 crc kubenswrapper[5120]: I0316 17:01:08.353584 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-7bbc5ddcc6-cxnhk" Mar 16 17:01:08 crc kubenswrapper[5120]: I0316 17:01:08.353612 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-7bbc5ddcc6-cxnhk" Mar 16 17:01:08 crc kubenswrapper[5120]: E0316 17:01:08.392885 5120 kuberuntime_gc.go:389] "Failed to remove container log dead symlink" err="remove /var/log/containers/swift-storage-0_openstack-kuttl-tests_swift-recon-cron-a13b02076f983681a11b54a1569f95dfe4808752321801358ab0264bcf250454.log: no such file or directory" path="/var/log/containers/swift-storage-0_openstack-kuttl-tests_swift-recon-cron-a13b02076f983681a11b54a1569f95dfe4808752321801358ab0264bcf250454.log" Mar 16 17:01:08 crc kubenswrapper[5120]: I0316 17:01:08.406350 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-api-7bbc5ddcc6-cxnhk" podStartSLOduration=3.406325623 podStartE2EDuration="3.406325623s" podCreationTimestamp="2026-03-16 17:01:05 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:01:08.381516334 +0000 UTC m=+5370.535447991" watchObservedRunningTime="2026-03-16 17:01:08.406325623 +0000 UTC m=+5370.560257290" Mar 16 17:01:08 crc kubenswrapper[5120]: I0316 17:01:08.440274 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-766c6fc56d-x6dc5"] Mar 16 17:01:08 crc kubenswrapper[5120]: I0316 17:01:08.520333 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-6cb5f74687-7bbcw"] Mar 16 17:01:08 crc kubenswrapper[5120]: I0316 17:01:08.530662 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-6cb5f74687-7bbcw"] Mar 16 17:01:08 crc kubenswrapper[5120]: I0316 17:01:08.558056 5120 scope.go:117] "RemoveContainer" containerID="ea0a58d085e77e9f2e80fb3abe6830d44085c6de8bbc41d01e3ce40efd201333" Mar 16 17:01:08 crc kubenswrapper[5120]: I0316 17:01:08.591640 5120 scope.go:117] "RemoveContainer" containerID="0d6f935c1c526a5f0534fe1c16af647e381d75b15f387ea4fe7dccbef914de3c" Mar 16 17:01:08 crc kubenswrapper[5120]: I0316 17:01:08.652148 5120 scope.go:117] "RemoveContainer" containerID="0e0c5f231603ea1e00da8c71a3719c91517ffbef85631d7b15f8ddffae3fc859" Mar 16 17:01:08 crc kubenswrapper[5120]: I0316 17:01:08.661980 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f6975fd-67a9-4ce2-87b0-7318d7345a80-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "1f6975fd-67a9-4ce2-87b0-7318d7345a80" (UID: "1f6975fd-67a9-4ce2-87b0-7318d7345a80"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:01:08 crc kubenswrapper[5120]: I0316 17:01:08.678375 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="04658afd-5440-4feb-a1a2-3232b641b558" path="/var/lib/kubelet/pods/04658afd-5440-4feb-a1a2-3232b641b558/volumes" Mar 16 17:01:08 crc kubenswrapper[5120]: I0316 17:01:08.679047 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="08933bb0-40b0-4b92-b9d1-af46cdcc8aad" path="/var/lib/kubelet/pods/08933bb0-40b0-4b92-b9d1-af46cdcc8aad/volumes" Mar 16 17:01:08 crc kubenswrapper[5120]: I0316 17:01:08.679722 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="54dca6ff-f965-48fc-8521-946430880efd" path="/var/lib/kubelet/pods/54dca6ff-f965-48fc-8521-946430880efd/volumes" Mar 16 17:01:08 crc kubenswrapper[5120]: I0316 17:01:08.684746 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d0bd5c73-646f-42e2-885f-25fc4835ee47" path="/var/lib/kubelet/pods/d0bd5c73-646f-42e2-885f-25fc4835ee47/volumes" Mar 16 17:01:08 crc kubenswrapper[5120]: I0316 17:01:08.685309 5120 scope.go:117] "RemoveContainer" containerID="8fcc879ae0f691fdfd5cd0fe4b16ffe3d232c975df243d8f32fa92fd036127e7" Mar 16 17:01:08 crc kubenswrapper[5120]: I0316 17:01:08.725082 5120 scope.go:117] "RemoveContainer" containerID="1d2089103eb63f1bcee2dbea95910e480727a3907ba19bd2a3fd5b82c3ef8a0e" Mar 16 17:01:08 crc kubenswrapper[5120]: I0316 17:01:08.725573 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 17:01:08 crc kubenswrapper[5120]: I0316 17:01:08.727743 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1f6975fd-67a9-4ce2-87b0-7318d7345a80-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:08 crc kubenswrapper[5120]: I0316 17:01:08.749479 5120 scope.go:117] "RemoveContainer" containerID="0ec73f2c6eba913a4bcd3d808e105a68bc2427f897a4d87db565f924c91ef3ac" Mar 16 17:01:08 crc kubenswrapper[5120]: I0316 17:01:08.773688 5120 scope.go:117] "RemoveContainer" containerID="556839845d225aff65b5ca07364c6f9f9b4d50587a636e047429ac5ade952de4" Mar 16 17:01:08 crc kubenswrapper[5120]: I0316 17:01:08.807274 5120 scope.go:117] "RemoveContainer" containerID="2ceda8ed6affc59d31db4f2f07d3a8ebf040b3bc7d71f407b104748fbaeb5108" Mar 16 17:01:08 crc kubenswrapper[5120]: I0316 17:01:08.835554 5120 scope.go:117] "RemoveContainer" containerID="2d33a82773827d3fc5dd80071dc63c0443a8e527afa994c6317d12be137c1056" Mar 16 17:01:08 crc kubenswrapper[5120]: I0316 17:01:08.880420 5120 scope.go:117] "RemoveContainer" containerID="3283eed1799cc5cf220c4d4610b8ff792b9e5f3e4e9b924171c4e3139945654e" Mar 16 17:01:08 crc kubenswrapper[5120]: I0316 17:01:08.937954 5120 scope.go:117] "RemoveContainer" containerID="42849e2776cea701e33065bdd6a04004ebe1c46b7b15be851b9968528ea41270" Mar 16 17:01:08 crc kubenswrapper[5120]: I0316 17:01:08.947267 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 17:01:08 crc kubenswrapper[5120]: I0316 17:01:08.957530 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 17:01:08 crc kubenswrapper[5120]: I0316 17:01:08.961656 5120 scope.go:117] "RemoveContainer" containerID="d9ba57534506b9295f26e2c084a6001d61593b940fe5c320a291c95cbf236766" Mar 16 17:01:08 crc kubenswrapper[5120]: I0316 17:01:08.998940 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 17:01:09 crc kubenswrapper[5120]: I0316 17:01:09.003682 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f6975fd-67a9-4ce2-87b0-7318d7345a80" containerName="object-replicator" Mar 16 17:01:09 crc kubenswrapper[5120]: I0316 17:01:09.003721 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f6975fd-67a9-4ce2-87b0-7318d7345a80" containerName="object-replicator" Mar 16 17:01:09 crc kubenswrapper[5120]: I0316 17:01:09.003779 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f6975fd-67a9-4ce2-87b0-7318d7345a80" containerName="account-server" Mar 16 17:01:09 crc kubenswrapper[5120]: I0316 17:01:09.003859 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f6975fd-67a9-4ce2-87b0-7318d7345a80" containerName="account-server" Mar 16 17:01:09 crc kubenswrapper[5120]: I0316 17:01:09.003880 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f6975fd-67a9-4ce2-87b0-7318d7345a80" containerName="object-updater" Mar 16 17:01:09 crc kubenswrapper[5120]: I0316 17:01:09.003887 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f6975fd-67a9-4ce2-87b0-7318d7345a80" containerName="object-updater" Mar 16 17:01:09 crc kubenswrapper[5120]: I0316 17:01:09.003962 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f6975fd-67a9-4ce2-87b0-7318d7345a80" containerName="object-server" Mar 16 17:01:09 crc kubenswrapper[5120]: I0316 17:01:09.003971 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f6975fd-67a9-4ce2-87b0-7318d7345a80" containerName="object-server" Mar 16 17:01:09 crc kubenswrapper[5120]: I0316 17:01:09.003983 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f6975fd-67a9-4ce2-87b0-7318d7345a80" containerName="account-auditor" Mar 16 17:01:09 crc kubenswrapper[5120]: I0316 17:01:09.003993 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f6975fd-67a9-4ce2-87b0-7318d7345a80" containerName="account-auditor" Mar 16 17:01:09 crc kubenswrapper[5120]: I0316 17:01:09.004014 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f6975fd-67a9-4ce2-87b0-7318d7345a80" containerName="swift-recon-cron" Mar 16 17:01:09 crc kubenswrapper[5120]: I0316 17:01:09.004020 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f6975fd-67a9-4ce2-87b0-7318d7345a80" containerName="swift-recon-cron" Mar 16 17:01:09 crc kubenswrapper[5120]: I0316 17:01:09.004050 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f6975fd-67a9-4ce2-87b0-7318d7345a80" containerName="rsync" Mar 16 17:01:09 crc kubenswrapper[5120]: I0316 17:01:09.004055 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f6975fd-67a9-4ce2-87b0-7318d7345a80" containerName="rsync" Mar 16 17:01:09 crc kubenswrapper[5120]: I0316 17:01:09.004071 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f6975fd-67a9-4ce2-87b0-7318d7345a80" containerName="container-updater" Mar 16 17:01:09 crc kubenswrapper[5120]: I0316 17:01:09.004078 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f6975fd-67a9-4ce2-87b0-7318d7345a80" containerName="container-updater" Mar 16 17:01:09 crc kubenswrapper[5120]: I0316 17:01:09.004926 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04658afd-5440-4feb-a1a2-3232b641b558" containerName="keystone-api" Mar 16 17:01:09 crc kubenswrapper[5120]: I0316 17:01:09.004976 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="04658afd-5440-4feb-a1a2-3232b641b558" containerName="keystone-api" Mar 16 17:01:09 crc kubenswrapper[5120]: I0316 17:01:09.005018 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f6975fd-67a9-4ce2-87b0-7318d7345a80" containerName="object-auditor" Mar 16 17:01:09 crc kubenswrapper[5120]: I0316 17:01:09.005025 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f6975fd-67a9-4ce2-87b0-7318d7345a80" containerName="object-auditor" Mar 16 17:01:09 crc kubenswrapper[5120]: I0316 17:01:09.005044 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f6975fd-67a9-4ce2-87b0-7318d7345a80" containerName="account-reaper" Mar 16 17:01:09 crc kubenswrapper[5120]: I0316 17:01:09.005051 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f6975fd-67a9-4ce2-87b0-7318d7345a80" containerName="account-reaper" Mar 16 17:01:09 crc kubenswrapper[5120]: I0316 17:01:09.005106 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f6975fd-67a9-4ce2-87b0-7318d7345a80" containerName="account-replicator" Mar 16 17:01:09 crc kubenswrapper[5120]: I0316 17:01:09.005113 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f6975fd-67a9-4ce2-87b0-7318d7345a80" containerName="account-replicator" Mar 16 17:01:09 crc kubenswrapper[5120]: I0316 17:01:09.005120 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f6975fd-67a9-4ce2-87b0-7318d7345a80" containerName="container-server" Mar 16 17:01:09 crc kubenswrapper[5120]: I0316 17:01:09.005127 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f6975fd-67a9-4ce2-87b0-7318d7345a80" containerName="container-server" Mar 16 17:01:09 crc kubenswrapper[5120]: I0316 17:01:09.005147 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f6975fd-67a9-4ce2-87b0-7318d7345a80" containerName="container-auditor" Mar 16 17:01:09 crc kubenswrapper[5120]: I0316 17:01:09.005154 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f6975fd-67a9-4ce2-87b0-7318d7345a80" containerName="container-auditor" Mar 16 17:01:09 crc kubenswrapper[5120]: I0316 17:01:09.005163 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f6975fd-67a9-4ce2-87b0-7318d7345a80" containerName="container-replicator" Mar 16 17:01:09 crc kubenswrapper[5120]: I0316 17:01:09.005169 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f6975fd-67a9-4ce2-87b0-7318d7345a80" containerName="container-replicator" Mar 16 17:01:09 crc kubenswrapper[5120]: I0316 17:01:09.005180 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f6975fd-67a9-4ce2-87b0-7318d7345a80" containerName="object-expirer" Mar 16 17:01:09 crc kubenswrapper[5120]: I0316 17:01:09.005186 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f6975fd-67a9-4ce2-87b0-7318d7345a80" containerName="object-expirer" Mar 16 17:01:09 crc kubenswrapper[5120]: I0316 17:01:09.005850 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1f6975fd-67a9-4ce2-87b0-7318d7345a80" containerName="object-updater" Mar 16 17:01:09 crc kubenswrapper[5120]: I0316 17:01:09.005881 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1f6975fd-67a9-4ce2-87b0-7318d7345a80" containerName="container-updater" Mar 16 17:01:09 crc kubenswrapper[5120]: I0316 17:01:09.005900 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1f6975fd-67a9-4ce2-87b0-7318d7345a80" containerName="container-replicator" Mar 16 17:01:09 crc kubenswrapper[5120]: I0316 17:01:09.005914 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1f6975fd-67a9-4ce2-87b0-7318d7345a80" containerName="rsync" Mar 16 17:01:09 crc kubenswrapper[5120]: I0316 17:01:09.005928 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1f6975fd-67a9-4ce2-87b0-7318d7345a80" containerName="container-auditor" Mar 16 17:01:09 crc kubenswrapper[5120]: I0316 17:01:09.005943 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1f6975fd-67a9-4ce2-87b0-7318d7345a80" containerName="container-server" Mar 16 17:01:09 crc kubenswrapper[5120]: I0316 17:01:09.005955 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1f6975fd-67a9-4ce2-87b0-7318d7345a80" containerName="swift-recon-cron" Mar 16 17:01:09 crc kubenswrapper[5120]: I0316 17:01:09.005979 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="04658afd-5440-4feb-a1a2-3232b641b558" containerName="keystone-api" Mar 16 17:01:09 crc kubenswrapper[5120]: I0316 17:01:09.005991 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1f6975fd-67a9-4ce2-87b0-7318d7345a80" containerName="account-server" Mar 16 17:01:09 crc kubenswrapper[5120]: I0316 17:01:09.006005 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1f6975fd-67a9-4ce2-87b0-7318d7345a80" containerName="object-auditor" Mar 16 17:01:09 crc kubenswrapper[5120]: I0316 17:01:09.006017 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1f6975fd-67a9-4ce2-87b0-7318d7345a80" containerName="account-auditor" Mar 16 17:01:09 crc kubenswrapper[5120]: I0316 17:01:09.006027 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1f6975fd-67a9-4ce2-87b0-7318d7345a80" containerName="object-expirer" Mar 16 17:01:09 crc kubenswrapper[5120]: I0316 17:01:09.006037 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1f6975fd-67a9-4ce2-87b0-7318d7345a80" containerName="account-replicator" Mar 16 17:01:09 crc kubenswrapper[5120]: I0316 17:01:09.006050 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1f6975fd-67a9-4ce2-87b0-7318d7345a80" containerName="account-reaper" Mar 16 17:01:09 crc kubenswrapper[5120]: I0316 17:01:09.006063 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1f6975fd-67a9-4ce2-87b0-7318d7345a80" containerName="object-server" Mar 16 17:01:09 crc kubenswrapper[5120]: I0316 17:01:09.006075 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1f6975fd-67a9-4ce2-87b0-7318d7345a80" containerName="object-replicator" Mar 16 17:01:09 crc kubenswrapper[5120]: I0316 17:01:09.021949 5120 scope.go:117] "RemoveContainer" containerID="b238bb89bbe2b3c43c7a92f158ccc80fa8bc740d10604a58081cf0dbc80ad67e" Mar 16 17:01:09 crc kubenswrapper[5120]: I0316 17:01:09.023508 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Mar 16 17:01:09 crc kubenswrapper[5120]: I0316 17:01:09.027188 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"swift-storage-config-data\"" Mar 16 17:01:09 crc kubenswrapper[5120]: I0316 17:01:09.030687 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 17:01:09 crc kubenswrapper[5120]: I0316 17:01:09.066940 5120 scope.go:117] "RemoveContainer" containerID="5bbe509850c00dbbb70f25ebabb5a6428197bfd27e4e15d3720d24f733d47545" Mar 16 17:01:09 crc kubenswrapper[5120]: I0316 17:01:09.095511 5120 scope.go:117] "RemoveContainer" containerID="ec54314107d232b9b6dc6fa69411e61406a6e8472585c507180fff0ecb54cae4" Mar 16 17:01:09 crc kubenswrapper[5120]: I0316 17:01:09.130840 5120 scope.go:117] "RemoveContainer" containerID="ec54314107d232b9b6dc6fa69411e61406a6e8472585c507180fff0ecb54cae4" Mar 16 17:01:09 crc kubenswrapper[5120]: E0316 17:01:09.136310 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec54314107d232b9b6dc6fa69411e61406a6e8472585c507180fff0ecb54cae4\": container with ID starting with ec54314107d232b9b6dc6fa69411e61406a6e8472585c507180fff0ecb54cae4 not found: ID does not exist" containerID="ec54314107d232b9b6dc6fa69411e61406a6e8472585c507180fff0ecb54cae4" Mar 16 17:01:09 crc kubenswrapper[5120]: I0316 17:01:09.136553 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec54314107d232b9b6dc6fa69411e61406a6e8472585c507180fff0ecb54cae4"} err="failed to get container status \"ec54314107d232b9b6dc6fa69411e61406a6e8472585c507180fff0ecb54cae4\": rpc error: code = NotFound desc = could not find container \"ec54314107d232b9b6dc6fa69411e61406a6e8472585c507180fff0ecb54cae4\": container with ID starting with ec54314107d232b9b6dc6fa69411e61406a6e8472585c507180fff0ecb54cae4 not found: ID does not exist" Mar 16 17:01:09 crc kubenswrapper[5120]: I0316 17:01:09.153637 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qgcx5\" (UniqueName: \"kubernetes.io/projected/aeacde0e-2862-4e69-9e7d-b88ca35912b8-kube-api-access-qgcx5\") pod \"swift-storage-0\" (UID: \"aeacde0e-2862-4e69-9e7d-b88ca35912b8\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 17:01:09 crc kubenswrapper[5120]: I0316 17:01:09.154039 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"swift-storage-0\" (UID: \"aeacde0e-2862-4e69-9e7d-b88ca35912b8\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 17:01:09 crc kubenswrapper[5120]: I0316 17:01:09.154401 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/aeacde0e-2862-4e69-9e7d-b88ca35912b8-lock\") pod \"swift-storage-0\" (UID: \"aeacde0e-2862-4e69-9e7d-b88ca35912b8\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 17:01:09 crc kubenswrapper[5120]: I0316 17:01:09.154513 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/aeacde0e-2862-4e69-9e7d-b88ca35912b8-combined-ca-bundle\") pod \"swift-storage-0\" (UID: \"aeacde0e-2862-4e69-9e7d-b88ca35912b8\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 17:01:09 crc kubenswrapper[5120]: I0316 17:01:09.154683 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/aeacde0e-2862-4e69-9e7d-b88ca35912b8-etc-swift\") pod \"swift-storage-0\" (UID: \"aeacde0e-2862-4e69-9e7d-b88ca35912b8\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 17:01:09 crc kubenswrapper[5120]: I0316 17:01:09.154855 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/aeacde0e-2862-4e69-9e7d-b88ca35912b8-cache\") pod \"swift-storage-0\" (UID: \"aeacde0e-2862-4e69-9e7d-b88ca35912b8\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 17:01:09 crc kubenswrapper[5120]: I0316 17:01:09.256531 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qgcx5\" (UniqueName: \"kubernetes.io/projected/aeacde0e-2862-4e69-9e7d-b88ca35912b8-kube-api-access-qgcx5\") pod \"swift-storage-0\" (UID: \"aeacde0e-2862-4e69-9e7d-b88ca35912b8\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 17:01:09 crc kubenswrapper[5120]: I0316 17:01:09.256593 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"swift-storage-0\" (UID: \"aeacde0e-2862-4e69-9e7d-b88ca35912b8\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 17:01:09 crc kubenswrapper[5120]: I0316 17:01:09.256736 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/aeacde0e-2862-4e69-9e7d-b88ca35912b8-lock\") pod \"swift-storage-0\" (UID: \"aeacde0e-2862-4e69-9e7d-b88ca35912b8\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 17:01:09 crc kubenswrapper[5120]: I0316 17:01:09.256892 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/aeacde0e-2862-4e69-9e7d-b88ca35912b8-combined-ca-bundle\") pod \"swift-storage-0\" (UID: \"aeacde0e-2862-4e69-9e7d-b88ca35912b8\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 17:01:09 crc kubenswrapper[5120]: I0316 17:01:09.256964 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/aeacde0e-2862-4e69-9e7d-b88ca35912b8-etc-swift\") pod \"swift-storage-0\" (UID: \"aeacde0e-2862-4e69-9e7d-b88ca35912b8\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 17:01:09 crc kubenswrapper[5120]: I0316 17:01:09.257018 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/aeacde0e-2862-4e69-9e7d-b88ca35912b8-cache\") pod \"swift-storage-0\" (UID: \"aeacde0e-2862-4e69-9e7d-b88ca35912b8\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 17:01:09 crc kubenswrapper[5120]: I0316 17:01:09.257526 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/aeacde0e-2862-4e69-9e7d-b88ca35912b8-cache\") pod \"swift-storage-0\" (UID: \"aeacde0e-2862-4e69-9e7d-b88ca35912b8\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 17:01:09 crc kubenswrapper[5120]: I0316 17:01:09.258235 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"swift-storage-0\" (UID: \"aeacde0e-2862-4e69-9e7d-b88ca35912b8\") device mount path \"/mnt/openstack/pv03\"" pod="openstack-kuttl-tests/swift-storage-0" Mar 16 17:01:09 crc kubenswrapper[5120]: I0316 17:01:09.259284 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/aeacde0e-2862-4e69-9e7d-b88ca35912b8-lock\") pod \"swift-storage-0\" (UID: \"aeacde0e-2862-4e69-9e7d-b88ca35912b8\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 17:01:09 crc kubenswrapper[5120]: I0316 17:01:09.265737 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/aeacde0e-2862-4e69-9e7d-b88ca35912b8-etc-swift\") pod \"swift-storage-0\" (UID: \"aeacde0e-2862-4e69-9e7d-b88ca35912b8\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 17:01:09 crc kubenswrapper[5120]: I0316 17:01:09.275916 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/aeacde0e-2862-4e69-9e7d-b88ca35912b8-combined-ca-bundle\") pod \"swift-storage-0\" (UID: \"aeacde0e-2862-4e69-9e7d-b88ca35912b8\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 17:01:09 crc kubenswrapper[5120]: I0316 17:01:09.289467 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qgcx5\" (UniqueName: \"kubernetes.io/projected/aeacde0e-2862-4e69-9e7d-b88ca35912b8-kube-api-access-qgcx5\") pod \"swift-storage-0\" (UID: \"aeacde0e-2862-4e69-9e7d-b88ca35912b8\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 17:01:09 crc kubenswrapper[5120]: I0316 17:01:09.308913 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"swift-storage-0\" (UID: \"aeacde0e-2862-4e69-9e7d-b88ca35912b8\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 17:01:09 crc kubenswrapper[5120]: I0316 17:01:09.358570 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Mar 16 17:01:09 crc kubenswrapper[5120]: I0316 17:01:09.371278 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-766c6fc56d-x6dc5" event={"ID":"532a5c65-05a2-4018-9244-1386bf31dcb2","Type":"ContainerStarted","Data":"f3475d302eda9b8f9f995f9084c858803d1f137a09ef9c3b6af35d343d7090c1"} Mar 16 17:01:09 crc kubenswrapper[5120]: I0316 17:01:09.371352 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/keystone-766c6fc56d-x6dc5" Mar 16 17:01:09 crc kubenswrapper[5120]: I0316 17:01:09.371365 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-766c6fc56d-x6dc5" event={"ID":"532a5c65-05a2-4018-9244-1386bf31dcb2","Type":"ContainerStarted","Data":"7bd64e87ef05c11750b3cf2a0f05a32193402ca0f9e7e427ce9cb91520e8db87"} Mar 16 17:01:09 crc kubenswrapper[5120]: I0316 17:01:09.373986 5120 generic.go:358] "Generic (PLEG): container finished" podID="13b65e37-9126-401e-9ef6-3e531453aaba" containerID="d4f5205995b7c25196e08d7776a3216b01adf4671787cdf98654a2ac9fa24504" exitCode=0 Mar 16 17:01:09 crc kubenswrapper[5120]: I0316 17:01:09.374188 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"13b65e37-9126-401e-9ef6-3e531453aaba","Type":"ContainerDied","Data":"d4f5205995b7c25196e08d7776a3216b01adf4671787cdf98654a2ac9fa24504"} Mar 16 17:01:09 crc kubenswrapper[5120]: I0316 17:01:09.384214 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"a2c4ebb0-3217-469c-88b5-b06d50a9db60","Type":"ContainerStarted","Data":"62a3266878d596b0fef9e2860df21eb9d22eda5d50110680ee608c9dfbf14e80"} Mar 16 17:01:09 crc kubenswrapper[5120]: I0316 17:01:09.384254 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/memcached-0" Mar 16 17:01:09 crc kubenswrapper[5120]: I0316 17:01:09.384266 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"a2c4ebb0-3217-469c-88b5-b06d50a9db60","Type":"ContainerStarted","Data":"f2e6b74bb80fb4d72c7c16aaff1631765c61496dee89eabfaa5a0889a97eb33a"} Mar 16 17:01:09 crc kubenswrapper[5120]: I0316 17:01:09.399887 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-766c6fc56d-x6dc5" podStartSLOduration=3.399872181 podStartE2EDuration="3.399872181s" podCreationTimestamp="2026-03-16 17:01:06 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:01:09.387062137 +0000 UTC m=+5371.540993794" watchObservedRunningTime="2026-03-16 17:01:09.399872181 +0000 UTC m=+5371.553803838" Mar 16 17:01:09 crc kubenswrapper[5120]: I0316 17:01:09.439423 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/memcached-0" podStartSLOduration=2.439398613 podStartE2EDuration="2.439398613s" podCreationTimestamp="2026-03-16 17:01:07 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:01:09.430985141 +0000 UTC m=+5371.584916798" watchObservedRunningTime="2026-03-16 17:01:09.439398613 +0000 UTC m=+5371.593330270" Mar 16 17:01:09 crc kubenswrapper[5120]: I0316 17:01:09.547704 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="2cadcb9e-2a3b-4c14-8fcc-39939326678f" containerName="cinder-scheduler" probeResult="failure" output="HTTP probe failed with statuscode: 500" Mar 16 17:01:09 crc kubenswrapper[5120]: I0316 17:01:09.547797 5120 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:01:09 crc kubenswrapper[5120]: I0316 17:01:09.548552 5120 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="cinder-scheduler" containerStatusID={"Type":"cri-o","ID":"4825276674a4bf257366e44ec75f03f8d2509be62fcefccdb42e3184f86889cf"} pod="openstack-kuttl-tests/cinder-scheduler-0" containerMessage="Container cinder-scheduler failed liveness probe, will be restarted" Mar 16 17:01:09 crc kubenswrapper[5120]: I0316 17:01:09.548613 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="2cadcb9e-2a3b-4c14-8fcc-39939326678f" containerName="cinder-scheduler" containerID="cri-o://4825276674a4bf257366e44ec75f03f8d2509be62fcefccdb42e3184f86889cf" gracePeriod=30 Mar 16 17:01:09 crc kubenswrapper[5120]: I0316 17:01:09.875160 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 17:01:09 crc kubenswrapper[5120]: I0316 17:01:09.949075 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openstack-kuttl-tests/neutron-765bfffb44-jrj28" podUID="ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801" containerName="neutron-httpd" probeResult="failure" output="HTTP probe failed with statuscode: 503" Mar 16 17:01:09 crc kubenswrapper[5120]: I0316 17:01:09.950532 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openstack-kuttl-tests/neutron-765bfffb44-jrj28" podUID="ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801" containerName="neutron-api" probeResult="failure" output="HTTP probe failed with statuscode: 503" Mar 16 17:01:10 crc kubenswrapper[5120]: E0316 17:01:10.063094 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1909887 actualBytes=10240 Mar 16 17:01:10 crc kubenswrapper[5120]: I0316 17:01:10.400365 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"aeacde0e-2862-4e69-9e7d-b88ca35912b8","Type":"ContainerStarted","Data":"39849e89c2ccc6af9f65a47428e8a27cfc4f4cdd9dae01876c7ffcc1c8ec9cdf"} Mar 16 17:01:10 crc kubenswrapper[5120]: I0316 17:01:10.400640 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"aeacde0e-2862-4e69-9e7d-b88ca35912b8","Type":"ContainerStarted","Data":"6ca5d6ea4402f88922cc4bdc75810ff0810c7269d939fc714fc5d2581a0381bf"} Mar 16 17:01:10 crc kubenswrapper[5120]: I0316 17:01:10.400652 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"aeacde0e-2862-4e69-9e7d-b88ca35912b8","Type":"ContainerStarted","Data":"babd93aa69c2bdb4a96ce0f8a42959cec047aad1610cd022f4693f30e42d1fb6"} Mar 16 17:01:10 crc kubenswrapper[5120]: I0316 17:01:10.409636 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"13b65e37-9126-401e-9ef6-3e531453aaba","Type":"ContainerStarted","Data":"0e7949a684f8f8fe500457e72cc4e4823aa78b079b839cbf757031b0c431a0bc"} Mar 16 17:01:10 crc kubenswrapper[5120]: I0316 17:01:10.442951 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstack-galera-0" podStartSLOduration=6.442928285 podStartE2EDuration="6.442928285s" podCreationTimestamp="2026-03-16 17:01:04 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:01:10.433407593 +0000 UTC m=+5372.587339260" watchObservedRunningTime="2026-03-16 17:01:10.442928285 +0000 UTC m=+5372.596859942" Mar 16 17:01:10 crc kubenswrapper[5120]: I0316 17:01:10.678028 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f6975fd-67a9-4ce2-87b0-7318d7345a80" path="/var/lib/kubelet/pods/1f6975fd-67a9-4ce2-87b0-7318d7345a80/volumes" Mar 16 17:01:11 crc kubenswrapper[5120]: I0316 17:01:11.384998 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/cinder-api-0" podUID="b7434cde-890e-42d9-9b5c-bbd60a188517" containerName="cinder-api" probeResult="failure" output="Get \"https://10.217.1.79:8776/healthcheck\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 17:01:11 crc kubenswrapper[5120]: I0316 17:01:11.423690 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"2cadcb9e-2a3b-4c14-8fcc-39939326678f","Type":"ContainerDied","Data":"4825276674a4bf257366e44ec75f03f8d2509be62fcefccdb42e3184f86889cf"} Mar 16 17:01:11 crc kubenswrapper[5120]: I0316 17:01:11.423893 5120 generic.go:358] "Generic (PLEG): container finished" podID="2cadcb9e-2a3b-4c14-8fcc-39939326678f" containerID="4825276674a4bf257366e44ec75f03f8d2509be62fcefccdb42e3184f86889cf" exitCode=0 Mar 16 17:01:11 crc kubenswrapper[5120]: I0316 17:01:11.424000 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"2cadcb9e-2a3b-4c14-8fcc-39939326678f","Type":"ContainerStarted","Data":"082f786272aedd7c68ee70e2d12f600cf20e6afc27f262f48a3b03f153c4650e"} Mar 16 17:01:11 crc kubenswrapper[5120]: I0316 17:01:11.427391 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"aeacde0e-2862-4e69-9e7d-b88ca35912b8","Type":"ContainerStarted","Data":"6469ce05f121fe416edfe1512f28049f6202b5c14ef3a421880ed284e3723c03"} Mar 16 17:01:11 crc kubenswrapper[5120]: I0316 17:01:11.427423 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"aeacde0e-2862-4e69-9e7d-b88ca35912b8","Type":"ContainerStarted","Data":"1c06198550f093ba013bceb3903d2c570a51a69e1b891c5f9d6eb3066933c0e3"} Mar 16 17:01:11 crc kubenswrapper[5120]: I0316 17:01:11.427435 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"aeacde0e-2862-4e69-9e7d-b88ca35912b8","Type":"ContainerStarted","Data":"9badd4ead08b15df51406a2e575e802a71fbfbdcabc5450a726e56b4e5258fde"} Mar 16 17:01:11 crc kubenswrapper[5120]: I0316 17:01:11.427448 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"aeacde0e-2862-4e69-9e7d-b88ca35912b8","Type":"ContainerStarted","Data":"095159c69aab52ae8cd46d98b8a125878d38f737cac679858fce218635fcab9f"} Mar 16 17:01:11 crc kubenswrapper[5120]: I0316 17:01:11.664367 5120 scope.go:117] "RemoveContainer" containerID="7cfb9cd38cd92ddc829e10b730d811e074d528fb177d79e12bdb69b5efe0978c" Mar 16 17:01:12 crc kubenswrapper[5120]: I0316 17:01:12.460024 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"61d14db6-7d33-4e5f-8252-844441e519d7","Type":"ContainerStarted","Data":"4e560143184389f153e8d0bbabf214261dca57a2f28afd54a6443f7d11775ee9"} Mar 16 17:01:12 crc kubenswrapper[5120]: I0316 17:01:12.460886 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 17:01:12 crc kubenswrapper[5120]: I0316 17:01:12.485856 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"aeacde0e-2862-4e69-9e7d-b88ca35912b8","Type":"ContainerStarted","Data":"44cb080f8154154a4a36b453ce52f3a77a483a82435bbd06cdd2e041a88fb9cc"} Mar 16 17:01:12 crc kubenswrapper[5120]: I0316 17:01:12.485913 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"aeacde0e-2862-4e69-9e7d-b88ca35912b8","Type":"ContainerStarted","Data":"8497a6be2923c0f36c47bb5031075424a0eb72cef279454537d1ede5f1036d3c"} Mar 16 17:01:12 crc kubenswrapper[5120]: I0316 17:01:12.485925 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"aeacde0e-2862-4e69-9e7d-b88ca35912b8","Type":"ContainerStarted","Data":"dc957e1a9d7bc3e1ab0c920f56da07e7a63162092103ea420708963bc78c77e9"} Mar 16 17:01:12 crc kubenswrapper[5120]: I0316 17:01:12.485936 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"aeacde0e-2862-4e69-9e7d-b88ca35912b8","Type":"ContainerStarted","Data":"77cf0e12f17307ccf6f98722a30265dbbf68f31c9b3098530603d4e4c87c55ce"} Mar 16 17:01:12 crc kubenswrapper[5120]: I0316 17:01:12.485949 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"aeacde0e-2862-4e69-9e7d-b88ca35912b8","Type":"ContainerStarted","Data":"e53436fec9df727dcd2d2beeb431759ec0856450eefd69d18611fc1b41806ac9"} Mar 16 17:01:12 crc kubenswrapper[5120]: I0316 17:01:12.527164 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:01:13 crc kubenswrapper[5120]: I0316 17:01:13.279442 5120 pod_container_manager_linux.go:217] "Failed to delete cgroup paths" cgroupName=["kubepods","besteffort","pod39da7446-acba-4bbb-b813-1a3e2c89ebcd"] err="unable to destroy cgroup paths for cgroup [kubepods besteffort pod39da7446-acba-4bbb-b813-1a3e2c89ebcd] : Timed out while waiting for systemd to remove kubepods-besteffort-pod39da7446_acba_4bbb_b813_1a3e2c89ebcd.slice" Mar 16 17:01:13 crc kubenswrapper[5120]: E0316 17:01:13.279796 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to delete cgroup paths for [kubepods besteffort pod39da7446-acba-4bbb-b813-1a3e2c89ebcd] : unable to destroy cgroup paths for cgroup [kubepods besteffort pod39da7446-acba-4bbb-b813-1a3e2c89ebcd] : Timed out while waiting for systemd to remove kubepods-besteffort-pod39da7446_acba_4bbb_b813_1a3e2c89ebcd.slice" pod="openstack-kuttl-tests/openstack-cell1-galera-0" podUID="39da7446-acba-4bbb-b813-1a3e2c89ebcd" Mar 16 17:01:13 crc kubenswrapper[5120]: I0316 17:01:13.498581 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"aeacde0e-2862-4e69-9e7d-b88ca35912b8","Type":"ContainerStarted","Data":"5643cd6e2f0a396a7c7f5aa76ae50b179dfbe75c50f8f250897c6dbe7c2f1f94"} Mar 16 17:01:13 crc kubenswrapper[5120]: I0316 17:01:13.498869 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"aeacde0e-2862-4e69-9e7d-b88ca35912b8","Type":"ContainerStarted","Data":"e1cc7167cc6d60a4ebf70616ac23d4c7c61e0ea254b4ce5939c1c303a76ba999"} Mar 16 17:01:13 crc kubenswrapper[5120]: I0316 17:01:13.498880 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"aeacde0e-2862-4e69-9e7d-b88ca35912b8","Type":"ContainerStarted","Data":"7e94fadc150440b2d15eda43c6265cf951173e81b5007cba27bd451ccf2a34f8"} Mar 16 17:01:13 crc kubenswrapper[5120]: I0316 17:01:13.498888 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"aeacde0e-2862-4e69-9e7d-b88ca35912b8","Type":"ContainerStarted","Data":"44cf1d2680a6b0bd1f3ea49fc5485a76fb86944c47db006aee554801e08df0ce"} Mar 16 17:01:13 crc kubenswrapper[5120]: I0316 17:01:13.499201 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:01:13 crc kubenswrapper[5120]: I0316 17:01:13.532994 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/swift-storage-0" podStartSLOduration=5.532970898 podStartE2EDuration="5.532970898s" podCreationTimestamp="2026-03-16 17:01:08 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:01:13.532864665 +0000 UTC m=+5375.686796332" watchObservedRunningTime="2026-03-16 17:01:13.532970898 +0000 UTC m=+5375.686902555" Mar 16 17:01:13 crc kubenswrapper[5120]: I0316 17:01:13.555534 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 17:01:13 crc kubenswrapper[5120]: I0316 17:01:13.565487 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 17:01:13 crc kubenswrapper[5120]: I0316 17:01:13.575186 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 17:01:13 crc kubenswrapper[5120]: I0316 17:01:13.583141 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:01:13 crc kubenswrapper[5120]: I0316 17:01:13.586084 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-galera-openstack-cell1-svc\"" Mar 16 17:01:13 crc kubenswrapper[5120]: I0316 17:01:13.586098 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 17:01:13 crc kubenswrapper[5120]: I0316 17:01:13.586201 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-cell1-scripts\"" Mar 16 17:01:13 crc kubenswrapper[5120]: I0316 17:01:13.586575 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"galera-openstack-cell1-dockercfg-zjhx5\"" Mar 16 17:01:13 crc kubenswrapper[5120]: I0316 17:01:13.587546 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-cell1-config-data\"" Mar 16 17:01:13 crc kubenswrapper[5120]: I0316 17:01:13.695109 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"openstack-cell1-galera-0\" (UID: \"8d144169-a686-4862-8b52-7a945bc3a36a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:01:13 crc kubenswrapper[5120]: I0316 17:01:13.695217 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/8d144169-a686-4862-8b52-7a945bc3a36a-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"8d144169-a686-4862-8b52-7a945bc3a36a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:01:13 crc kubenswrapper[5120]: I0316 17:01:13.695288 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/8d144169-a686-4862-8b52-7a945bc3a36a-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"8d144169-a686-4862-8b52-7a945bc3a36a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:01:13 crc kubenswrapper[5120]: I0316 17:01:13.695367 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpljt\" (UniqueName: \"kubernetes.io/projected/8d144169-a686-4862-8b52-7a945bc3a36a-kube-api-access-gpljt\") pod \"openstack-cell1-galera-0\" (UID: \"8d144169-a686-4862-8b52-7a945bc3a36a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:01:13 crc kubenswrapper[5120]: I0316 17:01:13.695693 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8d144169-a686-4862-8b52-7a945bc3a36a-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"8d144169-a686-4862-8b52-7a945bc3a36a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:01:13 crc kubenswrapper[5120]: I0316 17:01:13.696796 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8d144169-a686-4862-8b52-7a945bc3a36a-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"8d144169-a686-4862-8b52-7a945bc3a36a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:01:13 crc kubenswrapper[5120]: I0316 17:01:13.696971 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/8d144169-a686-4862-8b52-7a945bc3a36a-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"8d144169-a686-4862-8b52-7a945bc3a36a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:01:13 crc kubenswrapper[5120]: I0316 17:01:13.697119 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/8d144169-a686-4862-8b52-7a945bc3a36a-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"8d144169-a686-4862-8b52-7a945bc3a36a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:01:13 crc kubenswrapper[5120]: I0316 17:01:13.705436 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-7f699f9655-znk2w"] Mar 16 17:01:13 crc kubenswrapper[5120]: I0316 17:01:13.712427 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7f699f9655-znk2w" Mar 16 17:01:13 crc kubenswrapper[5120]: I0316 17:01:13.730699 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-7f699f9655-znk2w"] Mar 16 17:01:13 crc kubenswrapper[5120]: I0316 17:01:13.799161 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/8d144169-a686-4862-8b52-7a945bc3a36a-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"8d144169-a686-4862-8b52-7a945bc3a36a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:01:13 crc kubenswrapper[5120]: I0316 17:01:13.799444 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gpljt\" (UniqueName: \"kubernetes.io/projected/8d144169-a686-4862-8b52-7a945bc3a36a-kube-api-access-gpljt\") pod \"openstack-cell1-galera-0\" (UID: \"8d144169-a686-4862-8b52-7a945bc3a36a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:01:13 crc kubenswrapper[5120]: I0316 17:01:13.799934 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1afd582f-b48e-4483-8f98-8d4e7d54fabb-config\") pod \"dnsmasq-dnsmasq-7f699f9655-znk2w\" (UID: \"1afd582f-b48e-4483-8f98-8d4e7d54fabb\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7f699f9655-znk2w" Mar 16 17:01:13 crc kubenswrapper[5120]: I0316 17:01:13.800039 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/8d144169-a686-4862-8b52-7a945bc3a36a-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"8d144169-a686-4862-8b52-7a945bc3a36a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:01:13 crc kubenswrapper[5120]: I0316 17:01:13.800130 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8d144169-a686-4862-8b52-7a945bc3a36a-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"8d144169-a686-4862-8b52-7a945bc3a36a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:01:13 crc kubenswrapper[5120]: I0316 17:01:13.800354 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8d144169-a686-4862-8b52-7a945bc3a36a-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"8d144169-a686-4862-8b52-7a945bc3a36a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:01:13 crc kubenswrapper[5120]: I0316 17:01:13.800490 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/1afd582f-b48e-4483-8f98-8d4e7d54fabb-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-7f699f9655-znk2w\" (UID: \"1afd582f-b48e-4483-8f98-8d4e7d54fabb\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7f699f9655-znk2w" Mar 16 17:01:13 crc kubenswrapper[5120]: I0316 17:01:13.800631 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/8d144169-a686-4862-8b52-7a945bc3a36a-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"8d144169-a686-4862-8b52-7a945bc3a36a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:01:13 crc kubenswrapper[5120]: I0316 17:01:13.800728 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qcl2q\" (UniqueName: \"kubernetes.io/projected/1afd582f-b48e-4483-8f98-8d4e7d54fabb-kube-api-access-qcl2q\") pod \"dnsmasq-dnsmasq-7f699f9655-znk2w\" (UID: \"1afd582f-b48e-4483-8f98-8d4e7d54fabb\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7f699f9655-znk2w" Mar 16 17:01:13 crc kubenswrapper[5120]: I0316 17:01:13.800855 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/1afd582f-b48e-4483-8f98-8d4e7d54fabb-dns-swift-storage-0\") pod \"dnsmasq-dnsmasq-7f699f9655-znk2w\" (UID: \"1afd582f-b48e-4483-8f98-8d4e7d54fabb\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7f699f9655-znk2w" Mar 16 17:01:13 crc kubenswrapper[5120]: I0316 17:01:13.800981 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/8d144169-a686-4862-8b52-7a945bc3a36a-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"8d144169-a686-4862-8b52-7a945bc3a36a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:01:13 crc kubenswrapper[5120]: I0316 17:01:13.801106 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"openstack-cell1-galera-0\" (UID: \"8d144169-a686-4862-8b52-7a945bc3a36a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:01:13 crc kubenswrapper[5120]: I0316 17:01:13.801240 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/8d144169-a686-4862-8b52-7a945bc3a36a-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"8d144169-a686-4862-8b52-7a945bc3a36a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:01:13 crc kubenswrapper[5120]: I0316 17:01:13.801380 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/8d144169-a686-4862-8b52-7a945bc3a36a-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"8d144169-a686-4862-8b52-7a945bc3a36a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:01:13 crc kubenswrapper[5120]: I0316 17:01:13.801430 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"openstack-cell1-galera-0\" (UID: \"8d144169-a686-4862-8b52-7a945bc3a36a\") device mount path \"/mnt/openstack/pv04\"" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:01:13 crc kubenswrapper[5120]: I0316 17:01:13.801602 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/8d144169-a686-4862-8b52-7a945bc3a36a-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"8d144169-a686-4862-8b52-7a945bc3a36a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:01:13 crc kubenswrapper[5120]: I0316 17:01:13.801674 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8d144169-a686-4862-8b52-7a945bc3a36a-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"8d144169-a686-4862-8b52-7a945bc3a36a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:01:13 crc kubenswrapper[5120]: I0316 17:01:13.806026 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8d144169-a686-4862-8b52-7a945bc3a36a-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"8d144169-a686-4862-8b52-7a945bc3a36a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:01:13 crc kubenswrapper[5120]: I0316 17:01:13.806343 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/8d144169-a686-4862-8b52-7a945bc3a36a-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"8d144169-a686-4862-8b52-7a945bc3a36a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:01:13 crc kubenswrapper[5120]: I0316 17:01:13.821561 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpljt\" (UniqueName: \"kubernetes.io/projected/8d144169-a686-4862-8b52-7a945bc3a36a-kube-api-access-gpljt\") pod \"openstack-cell1-galera-0\" (UID: \"8d144169-a686-4862-8b52-7a945bc3a36a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:01:13 crc kubenswrapper[5120]: I0316 17:01:13.831080 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"openstack-cell1-galera-0\" (UID: \"8d144169-a686-4862-8b52-7a945bc3a36a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:01:13 crc kubenswrapper[5120]: I0316 17:01:13.904317 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1afd582f-b48e-4483-8f98-8d4e7d54fabb-config\") pod \"dnsmasq-dnsmasq-7f699f9655-znk2w\" (UID: \"1afd582f-b48e-4483-8f98-8d4e7d54fabb\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7f699f9655-znk2w" Mar 16 17:01:13 crc kubenswrapper[5120]: I0316 17:01:13.904586 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/1afd582f-b48e-4483-8f98-8d4e7d54fabb-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-7f699f9655-znk2w\" (UID: \"1afd582f-b48e-4483-8f98-8d4e7d54fabb\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7f699f9655-znk2w" Mar 16 17:01:13 crc kubenswrapper[5120]: I0316 17:01:13.904691 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qcl2q\" (UniqueName: \"kubernetes.io/projected/1afd582f-b48e-4483-8f98-8d4e7d54fabb-kube-api-access-qcl2q\") pod \"dnsmasq-dnsmasq-7f699f9655-znk2w\" (UID: \"1afd582f-b48e-4483-8f98-8d4e7d54fabb\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7f699f9655-znk2w" Mar 16 17:01:13 crc kubenswrapper[5120]: I0316 17:01:13.904744 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/1afd582f-b48e-4483-8f98-8d4e7d54fabb-dns-swift-storage-0\") pod \"dnsmasq-dnsmasq-7f699f9655-znk2w\" (UID: \"1afd582f-b48e-4483-8f98-8d4e7d54fabb\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7f699f9655-znk2w" Mar 16 17:01:13 crc kubenswrapper[5120]: I0316 17:01:13.905485 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/1afd582f-b48e-4483-8f98-8d4e7d54fabb-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-7f699f9655-znk2w\" (UID: \"1afd582f-b48e-4483-8f98-8d4e7d54fabb\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7f699f9655-znk2w" Mar 16 17:01:13 crc kubenswrapper[5120]: I0316 17:01:13.905781 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1afd582f-b48e-4483-8f98-8d4e7d54fabb-config\") pod \"dnsmasq-dnsmasq-7f699f9655-znk2w\" (UID: \"1afd582f-b48e-4483-8f98-8d4e7d54fabb\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7f699f9655-znk2w" Mar 16 17:01:13 crc kubenswrapper[5120]: I0316 17:01:13.905753 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/1afd582f-b48e-4483-8f98-8d4e7d54fabb-dns-swift-storage-0\") pod \"dnsmasq-dnsmasq-7f699f9655-znk2w\" (UID: \"1afd582f-b48e-4483-8f98-8d4e7d54fabb\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7f699f9655-znk2w" Mar 16 17:01:13 crc kubenswrapper[5120]: I0316 17:01:13.907245 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:01:13 crc kubenswrapper[5120]: I0316 17:01:13.930724 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qcl2q\" (UniqueName: \"kubernetes.io/projected/1afd582f-b48e-4483-8f98-8d4e7d54fabb-kube-api-access-qcl2q\") pod \"dnsmasq-dnsmasq-7f699f9655-znk2w\" (UID: \"1afd582f-b48e-4483-8f98-8d4e7d54fabb\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7f699f9655-znk2w" Mar 16 17:01:14 crc kubenswrapper[5120]: I0316 17:01:14.035052 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7f699f9655-znk2w" Mar 16 17:01:14 crc kubenswrapper[5120]: I0316 17:01:14.432421 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 17:01:14 crc kubenswrapper[5120]: I0316 17:01:14.460290 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:01:14 crc kubenswrapper[5120]: I0316 17:01:14.460351 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:01:14 crc kubenswrapper[5120]: I0316 17:01:14.513473 5120 generic.go:358] "Generic (PLEG): container finished" podID="61d14db6-7d33-4e5f-8252-844441e519d7" containerID="4e560143184389f153e8d0bbabf214261dca57a2f28afd54a6443f7d11775ee9" exitCode=1 Mar 16 17:01:14 crc kubenswrapper[5120]: I0316 17:01:14.513541 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"61d14db6-7d33-4e5f-8252-844441e519d7","Type":"ContainerDied","Data":"4e560143184389f153e8d0bbabf214261dca57a2f28afd54a6443f7d11775ee9"} Mar 16 17:01:14 crc kubenswrapper[5120]: I0316 17:01:14.513593 5120 scope.go:117] "RemoveContainer" containerID="7cfb9cd38cd92ddc829e10b730d811e074d528fb177d79e12bdb69b5efe0978c" Mar 16 17:01:14 crc kubenswrapper[5120]: I0316 17:01:14.514200 5120 scope.go:117] "RemoveContainer" containerID="4e560143184389f153e8d0bbabf214261dca57a2f28afd54a6443f7d11775ee9" Mar 16 17:01:14 crc kubenswrapper[5120]: E0316 17:01:14.514519 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nova-cell1-conductor-conductor\" with CrashLoopBackOff: \"back-off 20s restarting failed container=nova-cell1-conductor-conductor pod=nova-cell1-conductor-0_openstack-kuttl-tests(61d14db6-7d33-4e5f-8252-844441e519d7)\"" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="61d14db6-7d33-4e5f-8252-844441e519d7" Mar 16 17:01:14 crc kubenswrapper[5120]: I0316 17:01:14.521635 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"8d144169-a686-4862-8b52-7a945bc3a36a","Type":"ContainerStarted","Data":"ef4ed02be2a0bb9a07d836ff43fe29f8a53b3f04ab353b323c3637eab36bc690"} Mar 16 17:01:14 crc kubenswrapper[5120]: I0316 17:01:14.556002 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-7f699f9655-znk2w"] Mar 16 17:01:14 crc kubenswrapper[5120]: I0316 17:01:14.562304 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:01:14 crc kubenswrapper[5120]: I0316 17:01:14.647209 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:01:14 crc kubenswrapper[5120]: I0316 17:01:14.689462 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="39da7446-acba-4bbb-b813-1a3e2c89ebcd" path="/var/lib/kubelet/pods/39da7446-acba-4bbb-b813-1a3e2c89ebcd/volumes" Mar 16 17:01:14 crc kubenswrapper[5120]: E0316 17:01:14.836809 5120 fsHandler.go:119] failed to collect filesystem stats - rootDiskErr: , extraDiskErr: could not stat "/var/log/pods/openstack-kuttl-tests_keystone-556c5fbd95-b6tt9_37a14538-41b4-4840-9f98-8e652da86950/keystone-api/0.log" to get inode usage: stat /var/log/pods/openstack-kuttl-tests_keystone-556c5fbd95-b6tt9_37a14538-41b4-4840-9f98-8e652da86950/keystone-api/0.log: no such file or directory Mar 16 17:01:15 crc kubenswrapper[5120]: I0316 17:01:15.410976 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/memcached-0" Mar 16 17:01:15 crc kubenswrapper[5120]: I0316 17:01:15.521643 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 17:01:15 crc kubenswrapper[5120]: I0316 17:01:15.523011 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="0d641338-e35d-4819-b487-513c8840cfd7" containerName="nova-api-log" containerID="cri-o://0100259933ee5a0d60c815e0522f8958bf64827830e93951666d1ba73b88f2ad" gracePeriod=30 Mar 16 17:01:15 crc kubenswrapper[5120]: I0316 17:01:15.523064 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="0d641338-e35d-4819-b487-513c8840cfd7" containerName="nova-api-api" containerID="cri-o://913817c69070d4510b8042762cb63e057b4a8046effc6659ca14ddf12d68af77" gracePeriod=30 Mar 16 17:01:15 crc kubenswrapper[5120]: I0316 17:01:15.528226 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="0d641338-e35d-4819-b487-513c8840cfd7" containerName="nova-api-log" probeResult="failure" output="Get \"https://10.217.1.93:8774/\": EOF" Mar 16 17:01:15 crc kubenswrapper[5120]: I0316 17:01:15.530989 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 17:01:15 crc kubenswrapper[5120]: I0316 17:01:15.531229 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="ce24ae83-459d-4410-bd4d-fb7e0fcad044" containerName="nova-metadata-log" containerID="cri-o://0a576c9c3f46dcb5e38a65bf5cfa9aefd0b0e74f1b4d9b5916785ecf2b6d9ee0" gracePeriod=30 Mar 16 17:01:15 crc kubenswrapper[5120]: I0316 17:01:15.531286 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="ce24ae83-459d-4410-bd4d-fb7e0fcad044" containerName="nova-metadata-metadata" containerID="cri-o://5c01207e6b7eaba66695795238027c1a25f25604d6e9fbe8b8369eab265fb078" gracePeriod=30 Mar 16 17:01:15 crc kubenswrapper[5120]: I0316 17:01:15.541723 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="ce24ae83-459d-4410-bd4d-fb7e0fcad044" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"https://10.217.1.94:8775/\": EOF" Mar 16 17:01:15 crc kubenswrapper[5120]: I0316 17:01:15.543679 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"8d144169-a686-4862-8b52-7a945bc3a36a","Type":"ContainerStarted","Data":"48e312790cba7d0127ad5f8f851016781ff4d933732de34cf1f0cf328d69266d"} Mar 16 17:01:15 crc kubenswrapper[5120]: I0316 17:01:15.546388 5120 generic.go:358] "Generic (PLEG): container finished" podID="1afd582f-b48e-4483-8f98-8d4e7d54fabb" containerID="6dd2c1a4a88a8068453327fe9c9b252f6f45e930ef98b7fbf050e0eddabcc7aa" exitCode=0 Mar 16 17:01:15 crc kubenswrapper[5120]: I0316 17:01:15.546606 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7f699f9655-znk2w" event={"ID":"1afd582f-b48e-4483-8f98-8d4e7d54fabb","Type":"ContainerDied","Data":"6dd2c1a4a88a8068453327fe9c9b252f6f45e930ef98b7fbf050e0eddabcc7aa"} Mar 16 17:01:15 crc kubenswrapper[5120]: I0316 17:01:15.546645 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7f699f9655-znk2w" event={"ID":"1afd582f-b48e-4483-8f98-8d4e7d54fabb","Type":"ContainerStarted","Data":"b5a51589cacfada974946629585db32b7b364f1824bbb4d92fdf5272bec316d4"} Mar 16 17:01:15 crc kubenswrapper[5120]: I0316 17:01:15.550131 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 17:01:15 crc kubenswrapper[5120]: I0316 17:01:15.550390 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="25abef41-bfd4-4436-a8c8-262247bd936f" containerName="glance-log" containerID="cri-o://5b50d4fd103f75c5ada5a2c6b1fe2f90bcd8e23a45024888035f4ee0b82396a6" gracePeriod=30 Mar 16 17:01:15 crc kubenswrapper[5120]: I0316 17:01:15.550536 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="25abef41-bfd4-4436-a8c8-262247bd936f" containerName="glance-httpd" containerID="cri-o://22bc321bf8bdaa4bae524c0d33ca3b1bfd1b617debabd58a58a512ee9428af0a" gracePeriod=30 Mar 16 17:01:15 crc kubenswrapper[5120]: I0316 17:01:15.556811 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="ce24ae83-459d-4410-bd4d-fb7e0fcad044" containerName="nova-metadata-log" probeResult="failure" output="Get \"https://10.217.1.94:8775/\": EOF" Mar 16 17:01:15 crc kubenswrapper[5120]: I0316 17:01:15.557694 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="0d641338-e35d-4819-b487-513c8840cfd7" containerName="nova-api-api" probeResult="failure" output="Get \"https://10.217.1.93:8774/\": EOF" Mar 16 17:01:15 crc kubenswrapper[5120]: I0316 17:01:15.594008 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 17:01:15 crc kubenswrapper[5120]: I0316 17:01:15.594290 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podUID="9a5a470f-6027-43b1-aa7b-74626f464c7c" containerName="nova-cell1-novncproxy-novncproxy" containerID="cri-o://aff7b5c38018439aeda171febf4dc85956a973bc799b03a28da649918795fbf3" gracePeriod=30 Mar 16 17:01:15 crc kubenswrapper[5120]: I0316 17:01:15.653913 5120 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 17:01:15 crc kubenswrapper[5120]: I0316 17:01:15.654654 5120 scope.go:117] "RemoveContainer" containerID="4e560143184389f153e8d0bbabf214261dca57a2f28afd54a6443f7d11775ee9" Mar 16 17:01:15 crc kubenswrapper[5120]: E0316 17:01:15.655168 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nova-cell1-conductor-conductor\" with CrashLoopBackOff: \"back-off 20s restarting failed container=nova-cell1-conductor-conductor pod=nova-cell1-conductor-0_openstack-kuttl-tests(61d14db6-7d33-4e5f-8252-844441e519d7)\"" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="61d14db6-7d33-4e5f-8252-844441e519d7" Mar 16 17:01:15 crc kubenswrapper[5120]: I0316 17:01:15.668866 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 17:01:15 crc kubenswrapper[5120]: I0316 17:01:15.669337 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="0fdecce9-8602-457d-8eec-c97b359170dd" containerName="glance-log" containerID="cri-o://19947c1a0b137846bb6d093126701f82159f9a27968b0667b1331783679eb16e" gracePeriod=30 Mar 16 17:01:15 crc kubenswrapper[5120]: I0316 17:01:15.669584 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="0fdecce9-8602-457d-8eec-c97b359170dd" containerName="glance-httpd" containerID="cri-o://13db0eeaeb1f2cf2000ab74839313ccae7e410cc64de56f0aa772b702b92719c" gracePeriod=30 Mar 16 17:01:15 crc kubenswrapper[5120]: I0316 17:01:15.726276 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-765bfffb44-jrj28"] Mar 16 17:01:15 crc kubenswrapper[5120]: I0316 17:01:15.726594 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-765bfffb44-jrj28" podUID="ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801" containerName="neutron-api" containerID="cri-o://f0a293cfac604dbfdd5f557ac486b40c3fa465c6d265faa6cb8381ab784fb73a" gracePeriod=30 Mar 16 17:01:15 crc kubenswrapper[5120]: I0316 17:01:15.727633 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-765bfffb44-jrj28" podUID="ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801" containerName="neutron-httpd" containerID="cri-o://9441daf29df96c302c797aebd83789aeb29a6686baa145ee4bfdb90cc8d5046c" gracePeriod=30 Mar 16 17:01:15 crc kubenswrapper[5120]: I0316 17:01:15.805269 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/neutron-765bfffb44-jrj28" podUID="ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801" containerName="neutron-httpd" probeResult="failure" output="HTTP probe failed with statuscode: 503" Mar 16 17:01:15 crc kubenswrapper[5120]: I0316 17:01:15.814053 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-79c6c668c8-l5c8p"] Mar 16 17:01:15 crc kubenswrapper[5120]: I0316 17:01:15.839336 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-79c6c668c8-l5c8p" Mar 16 17:01:15 crc kubenswrapper[5120]: I0316 17:01:15.843697 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-79c6c668c8-l5c8p"] Mar 16 17:01:15 crc kubenswrapper[5120]: E0316 17:01:15.852505 5120 fsHandler.go:119] failed to collect filesystem stats - rootDiskErr: could not stat "/var/lib/containers/storage/overlay/18e1d63057715a67cd45536cea0a4cb1f06170218c0396fa70b919bcbcd86129/diff" to get inode usage: stat /var/lib/containers/storage/overlay/18e1d63057715a67cd45536cea0a4cb1f06170218c0396fa70b919bcbcd86129/diff: no such file or directory, extraDiskErr: Mar 16 17:01:15 crc kubenswrapper[5120]: I0316 17:01:15.873242 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbcdr\" (UniqueName: \"kubernetes.io/projected/394193fd-f8e0-4b81-8821-8d1251a0274b-kube-api-access-dbcdr\") pod \"neutron-79c6c668c8-l5c8p\" (UID: \"394193fd-f8e0-4b81-8821-8d1251a0274b\") " pod="openstack-kuttl-tests/neutron-79c6c668c8-l5c8p" Mar 16 17:01:15 crc kubenswrapper[5120]: I0316 17:01:15.873371 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/394193fd-f8e0-4b81-8821-8d1251a0274b-public-tls-certs\") pod \"neutron-79c6c668c8-l5c8p\" (UID: \"394193fd-f8e0-4b81-8821-8d1251a0274b\") " pod="openstack-kuttl-tests/neutron-79c6c668c8-l5c8p" Mar 16 17:01:15 crc kubenswrapper[5120]: I0316 17:01:15.873403 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/394193fd-f8e0-4b81-8821-8d1251a0274b-combined-ca-bundle\") pod \"neutron-79c6c668c8-l5c8p\" (UID: \"394193fd-f8e0-4b81-8821-8d1251a0274b\") " pod="openstack-kuttl-tests/neutron-79c6c668c8-l5c8p" Mar 16 17:01:15 crc kubenswrapper[5120]: I0316 17:01:15.873460 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/394193fd-f8e0-4b81-8821-8d1251a0274b-internal-tls-certs\") pod \"neutron-79c6c668c8-l5c8p\" (UID: \"394193fd-f8e0-4b81-8821-8d1251a0274b\") " pod="openstack-kuttl-tests/neutron-79c6c668c8-l5c8p" Mar 16 17:01:15 crc kubenswrapper[5120]: I0316 17:01:15.873690 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/394193fd-f8e0-4b81-8821-8d1251a0274b-ovndb-tls-certs\") pod \"neutron-79c6c668c8-l5c8p\" (UID: \"394193fd-f8e0-4b81-8821-8d1251a0274b\") " pod="openstack-kuttl-tests/neutron-79c6c668c8-l5c8p" Mar 16 17:01:15 crc kubenswrapper[5120]: I0316 17:01:15.873737 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/394193fd-f8e0-4b81-8821-8d1251a0274b-config\") pod \"neutron-79c6c668c8-l5c8p\" (UID: \"394193fd-f8e0-4b81-8821-8d1251a0274b\") " pod="openstack-kuttl-tests/neutron-79c6c668c8-l5c8p" Mar 16 17:01:15 crc kubenswrapper[5120]: I0316 17:01:15.873804 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/394193fd-f8e0-4b81-8821-8d1251a0274b-httpd-config\") pod \"neutron-79c6c668c8-l5c8p\" (UID: \"394193fd-f8e0-4b81-8821-8d1251a0274b\") " pod="openstack-kuttl-tests/neutron-79c6c668c8-l5c8p" Mar 16 17:01:15 crc kubenswrapper[5120]: I0316 17:01:15.976447 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/394193fd-f8e0-4b81-8821-8d1251a0274b-config\") pod \"neutron-79c6c668c8-l5c8p\" (UID: \"394193fd-f8e0-4b81-8821-8d1251a0274b\") " pod="openstack-kuttl-tests/neutron-79c6c668c8-l5c8p" Mar 16 17:01:15 crc kubenswrapper[5120]: I0316 17:01:15.976778 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/394193fd-f8e0-4b81-8821-8d1251a0274b-httpd-config\") pod \"neutron-79c6c668c8-l5c8p\" (UID: \"394193fd-f8e0-4b81-8821-8d1251a0274b\") " pod="openstack-kuttl-tests/neutron-79c6c668c8-l5c8p" Mar 16 17:01:15 crc kubenswrapper[5120]: I0316 17:01:15.976908 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dbcdr\" (UniqueName: \"kubernetes.io/projected/394193fd-f8e0-4b81-8821-8d1251a0274b-kube-api-access-dbcdr\") pod \"neutron-79c6c668c8-l5c8p\" (UID: \"394193fd-f8e0-4b81-8821-8d1251a0274b\") " pod="openstack-kuttl-tests/neutron-79c6c668c8-l5c8p" Mar 16 17:01:15 crc kubenswrapper[5120]: I0316 17:01:15.977009 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/394193fd-f8e0-4b81-8821-8d1251a0274b-public-tls-certs\") pod \"neutron-79c6c668c8-l5c8p\" (UID: \"394193fd-f8e0-4b81-8821-8d1251a0274b\") " pod="openstack-kuttl-tests/neutron-79c6c668c8-l5c8p" Mar 16 17:01:15 crc kubenswrapper[5120]: I0316 17:01:15.977141 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/394193fd-f8e0-4b81-8821-8d1251a0274b-combined-ca-bundle\") pod \"neutron-79c6c668c8-l5c8p\" (UID: \"394193fd-f8e0-4b81-8821-8d1251a0274b\") " pod="openstack-kuttl-tests/neutron-79c6c668c8-l5c8p" Mar 16 17:01:15 crc kubenswrapper[5120]: I0316 17:01:15.977198 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/394193fd-f8e0-4b81-8821-8d1251a0274b-internal-tls-certs\") pod \"neutron-79c6c668c8-l5c8p\" (UID: \"394193fd-f8e0-4b81-8821-8d1251a0274b\") " pod="openstack-kuttl-tests/neutron-79c6c668c8-l5c8p" Mar 16 17:01:15 crc kubenswrapper[5120]: I0316 17:01:15.977396 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/394193fd-f8e0-4b81-8821-8d1251a0274b-ovndb-tls-certs\") pod \"neutron-79c6c668c8-l5c8p\" (UID: \"394193fd-f8e0-4b81-8821-8d1251a0274b\") " pod="openstack-kuttl-tests/neutron-79c6c668c8-l5c8p" Mar 16 17:01:15 crc kubenswrapper[5120]: I0316 17:01:15.981792 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/394193fd-f8e0-4b81-8821-8d1251a0274b-internal-tls-certs\") pod \"neutron-79c6c668c8-l5c8p\" (UID: \"394193fd-f8e0-4b81-8821-8d1251a0274b\") " pod="openstack-kuttl-tests/neutron-79c6c668c8-l5c8p" Mar 16 17:01:15 crc kubenswrapper[5120]: I0316 17:01:15.981818 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/394193fd-f8e0-4b81-8821-8d1251a0274b-public-tls-certs\") pod \"neutron-79c6c668c8-l5c8p\" (UID: \"394193fd-f8e0-4b81-8821-8d1251a0274b\") " pod="openstack-kuttl-tests/neutron-79c6c668c8-l5c8p" Mar 16 17:01:15 crc kubenswrapper[5120]: I0316 17:01:15.982640 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/394193fd-f8e0-4b81-8821-8d1251a0274b-config\") pod \"neutron-79c6c668c8-l5c8p\" (UID: \"394193fd-f8e0-4b81-8821-8d1251a0274b\") " pod="openstack-kuttl-tests/neutron-79c6c668c8-l5c8p" Mar 16 17:01:15 crc kubenswrapper[5120]: I0316 17:01:15.984554 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/394193fd-f8e0-4b81-8821-8d1251a0274b-combined-ca-bundle\") pod \"neutron-79c6c668c8-l5c8p\" (UID: \"394193fd-f8e0-4b81-8821-8d1251a0274b\") " pod="openstack-kuttl-tests/neutron-79c6c668c8-l5c8p" Mar 16 17:01:15 crc kubenswrapper[5120]: I0316 17:01:15.990364 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/394193fd-f8e0-4b81-8821-8d1251a0274b-httpd-config\") pod \"neutron-79c6c668c8-l5c8p\" (UID: \"394193fd-f8e0-4b81-8821-8d1251a0274b\") " pod="openstack-kuttl-tests/neutron-79c6c668c8-l5c8p" Mar 16 17:01:15 crc kubenswrapper[5120]: I0316 17:01:15.991222 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/394193fd-f8e0-4b81-8821-8d1251a0274b-ovndb-tls-certs\") pod \"neutron-79c6c668c8-l5c8p\" (UID: \"394193fd-f8e0-4b81-8821-8d1251a0274b\") " pod="openstack-kuttl-tests/neutron-79c6c668c8-l5c8p" Mar 16 17:01:16 crc kubenswrapper[5120]: I0316 17:01:16.004563 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbcdr\" (UniqueName: \"kubernetes.io/projected/394193fd-f8e0-4b81-8821-8d1251a0274b-kube-api-access-dbcdr\") pod \"neutron-79c6c668c8-l5c8p\" (UID: \"394193fd-f8e0-4b81-8821-8d1251a0274b\") " pod="openstack-kuttl-tests/neutron-79c6c668c8-l5c8p" Mar 16 17:01:16 crc kubenswrapper[5120]: I0316 17:01:16.175377 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-79c6c668c8-l5c8p" Mar 16 17:01:16 crc kubenswrapper[5120]: W0316 17:01:16.495138 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod08933bb0_40b0_4b92_b9d1_af46cdcc8aad.slice/crio-d9ab28b0a7ccb773ffd22dadcda722c1f6eda9f10071fd99c7e5612da79f866f.scope WatchSource:0}: Error finding container d9ab28b0a7ccb773ffd22dadcda722c1f6eda9f10071fd99c7e5612da79f866f: Status 404 returned error can't find the container with id d9ab28b0a7ccb773ffd22dadcda722c1f6eda9f10071fd99c7e5612da79f866f Mar 16 17:01:16 crc kubenswrapper[5120]: W0316 17:01:16.518989 5120 watcher.go:93] Error while processing event ("/sys/fs/cgroup/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb7434cde_890e_42d9_9b5c_bbd60a188517.slice/crio-conmon-e6f41b2eba86e2ad1ad67b7920bf775f201acf4a1d8d43b7f3ad7c19edd16e8f.scope": 0x40000100 == IN_CREATE|IN_ISDIR): inotify_add_watch /sys/fs/cgroup/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb7434cde_890e_42d9_9b5c_bbd60a188517.slice/crio-conmon-e6f41b2eba86e2ad1ad67b7920bf775f201acf4a1d8d43b7f3ad7c19edd16e8f.scope: no such file or directory Mar 16 17:01:16 crc kubenswrapper[5120]: W0316 17:01:16.522329 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbdbf2033_4671_473e_9ede_ce2611d51fac.slice/crio-6a9fd81ac5ab6d6384a09d8f12c8b03f6ccc15b49c065de4a42bd18b0f1b5e27 WatchSource:0}: Error finding container 6a9fd81ac5ab6d6384a09d8f12c8b03f6ccc15b49c065de4a42bd18b0f1b5e27: Status 404 returned error can't find the container with id 6a9fd81ac5ab6d6384a09d8f12c8b03f6ccc15b49c065de4a42bd18b0f1b5e27 Mar 16 17:01:16 crc kubenswrapper[5120]: W0316 17:01:16.522527 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbdbf2033_4671_473e_9ede_ce2611d51fac.slice/crio-99fb8edbf3d8a29e8de3b518723f36b5914f77d494d2927272dec17802ad898c.scope WatchSource:0}: Error finding container 99fb8edbf3d8a29e8de3b518723f36b5914f77d494d2927272dec17802ad898c: Status 404 returned error can't find the container with id 99fb8edbf3d8a29e8de3b518723f36b5914f77d494d2927272dec17802ad898c Mar 16 17:01:16 crc kubenswrapper[5120]: I0316 17:01:16.584871 5120 generic.go:358] "Generic (PLEG): container finished" podID="ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801" containerID="9441daf29df96c302c797aebd83789aeb29a6686baa145ee4bfdb90cc8d5046c" exitCode=0 Mar 16 17:01:16 crc kubenswrapper[5120]: I0316 17:01:16.585291 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-765bfffb44-jrj28" event={"ID":"ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801","Type":"ContainerDied","Data":"9441daf29df96c302c797aebd83789aeb29a6686baa145ee4bfdb90cc8d5046c"} Mar 16 17:01:16 crc kubenswrapper[5120]: I0316 17:01:16.600608 5120 generic.go:358] "Generic (PLEG): container finished" podID="25abef41-bfd4-4436-a8c8-262247bd936f" containerID="5b50d4fd103f75c5ada5a2c6b1fe2f90bcd8e23a45024888035f4ee0b82396a6" exitCode=143 Mar 16 17:01:16 crc kubenswrapper[5120]: I0316 17:01:16.600837 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"25abef41-bfd4-4436-a8c8-262247bd936f","Type":"ContainerDied","Data":"5b50d4fd103f75c5ada5a2c6b1fe2f90bcd8e23a45024888035f4ee0b82396a6"} Mar 16 17:01:16 crc kubenswrapper[5120]: I0316 17:01:16.606122 5120 generic.go:358] "Generic (PLEG): container finished" podID="9a5a470f-6027-43b1-aa7b-74626f464c7c" containerID="aff7b5c38018439aeda171febf4dc85956a973bc799b03a28da649918795fbf3" exitCode=0 Mar 16 17:01:16 crc kubenswrapper[5120]: I0316 17:01:16.606259 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"9a5a470f-6027-43b1-aa7b-74626f464c7c","Type":"ContainerDied","Data":"aff7b5c38018439aeda171febf4dc85956a973bc799b03a28da649918795fbf3"} Mar 16 17:01:16 crc kubenswrapper[5120]: I0316 17:01:16.615640 5120 generic.go:358] "Generic (PLEG): container finished" podID="ce24ae83-459d-4410-bd4d-fb7e0fcad044" containerID="0a576c9c3f46dcb5e38a65bf5cfa9aefd0b0e74f1b4d9b5916785ecf2b6d9ee0" exitCode=143 Mar 16 17:01:16 crc kubenswrapper[5120]: I0316 17:01:16.615732 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"ce24ae83-459d-4410-bd4d-fb7e0fcad044","Type":"ContainerDied","Data":"0a576c9c3f46dcb5e38a65bf5cfa9aefd0b0e74f1b4d9b5916785ecf2b6d9ee0"} Mar 16 17:01:16 crc kubenswrapper[5120]: I0316 17:01:16.646428 5120 generic.go:358] "Generic (PLEG): container finished" podID="b7434cde-890e-42d9-9b5c-bbd60a188517" containerID="9533e6b54c1aa1c42b7613a7687dc06b42ee15eb1d443ad851370c895955ad91" exitCode=137 Mar 16 17:01:16 crc kubenswrapper[5120]: I0316 17:01:16.646696 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"b7434cde-890e-42d9-9b5c-bbd60a188517","Type":"ContainerDied","Data":"9533e6b54c1aa1c42b7613a7687dc06b42ee15eb1d443ad851370c895955ad91"} Mar 16 17:01:16 crc kubenswrapper[5120]: I0316 17:01:16.664132 5120 generic.go:358] "Generic (PLEG): container finished" podID="0d641338-e35d-4819-b487-513c8840cfd7" containerID="0100259933ee5a0d60c815e0522f8958bf64827830e93951666d1ba73b88f2ad" exitCode=143 Mar 16 17:01:16 crc kubenswrapper[5120]: I0316 17:01:16.668608 5120 generic.go:358] "Generic (PLEG): container finished" podID="0fdecce9-8602-457d-8eec-c97b359170dd" containerID="19947c1a0b137846bb6d093126701f82159f9a27968b0667b1331783679eb16e" exitCode=143 Mar 16 17:01:16 crc kubenswrapper[5120]: I0316 17:01:16.681444 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"0d641338-e35d-4819-b487-513c8840cfd7","Type":"ContainerDied","Data":"0100259933ee5a0d60c815e0522f8958bf64827830e93951666d1ba73b88f2ad"} Mar 16 17:01:16 crc kubenswrapper[5120]: I0316 17:01:16.681520 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"0fdecce9-8602-457d-8eec-c97b359170dd","Type":"ContainerDied","Data":"19947c1a0b137846bb6d093126701f82159f9a27968b0667b1331783679eb16e"} Mar 16 17:01:16 crc kubenswrapper[5120]: E0316 17:01:16.689143 5120 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6fdf4b26_c833_4319_954a_7ebaaedb71e5.slice/crio-d57fa08f95a6cfcfd09827365e075bbb88ead4151737bba2848bcdf78f8d733f\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod39da7446_acba_4bbb_b813_1a3e2c89ebcd.slice/crio-ca1d68086bd2a83cc28d2a6eb90891df500fbecdd5ff64704bc7f6b7f0c8e5f7\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod55f7f374_c6b2_422b_90bd_a7dcc936e74f.slice/crio-09bbf68572dda98d0eba8758d9ca27ed1d096829ca22317239ce3b4204cf1485\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod08933bb0_40b0_4b92_b9d1_af46cdcc8aad.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4ae0ee71_cb7b_4458_9176_1a941416c653.slice/crio-222ff7565ff2ea851a55d8addae5c28034ed18c8500a809c938a61566ef88ace\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod37a14538_41b4_4840_9f98_8e652da86950.slice/crio-c09f6b1669f31ac12e5745f5686aa5e5a77112007acc3e19b80c62182636f77f\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod30bfa4fc_b416_4f16_b673_158d4a8c552a.slice/crio-conmon-127be2cd9a418019067d28df39c8a22a07e067915f84e992cceebd4cedb161d5.scope\": RecentStats: unable to find data in memory cache]" Mar 16 17:01:16 crc kubenswrapper[5120]: I0316 17:01:16.772554 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:01:16 crc kubenswrapper[5120]: I0316 17:01:16.772557 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-79c6c668c8-l5c8p"] Mar 16 17:01:16 crc kubenswrapper[5120]: I0316 17:01:16.816542 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/9a5a470f-6027-43b1-aa7b-74626f464c7c-nova-novncproxy-tls-certs\") pod \"9a5a470f-6027-43b1-aa7b-74626f464c7c\" (UID: \"9a5a470f-6027-43b1-aa7b-74626f464c7c\") " Mar 16 17:01:16 crc kubenswrapper[5120]: I0316 17:01:16.817469 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9a5a470f-6027-43b1-aa7b-74626f464c7c-config-data\") pod \"9a5a470f-6027-43b1-aa7b-74626f464c7c\" (UID: \"9a5a470f-6027-43b1-aa7b-74626f464c7c\") " Mar 16 17:01:16 crc kubenswrapper[5120]: I0316 17:01:16.818036 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/9a5a470f-6027-43b1-aa7b-74626f464c7c-vencrypt-tls-certs\") pod \"9a5a470f-6027-43b1-aa7b-74626f464c7c\" (UID: \"9a5a470f-6027-43b1-aa7b-74626f464c7c\") " Mar 16 17:01:16 crc kubenswrapper[5120]: I0316 17:01:16.818267 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9zd9l\" (UniqueName: \"kubernetes.io/projected/9a5a470f-6027-43b1-aa7b-74626f464c7c-kube-api-access-9zd9l\") pod \"9a5a470f-6027-43b1-aa7b-74626f464c7c\" (UID: \"9a5a470f-6027-43b1-aa7b-74626f464c7c\") " Mar 16 17:01:16 crc kubenswrapper[5120]: I0316 17:01:16.818618 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9a5a470f-6027-43b1-aa7b-74626f464c7c-combined-ca-bundle\") pod \"9a5a470f-6027-43b1-aa7b-74626f464c7c\" (UID: \"9a5a470f-6027-43b1-aa7b-74626f464c7c\") " Mar 16 17:01:16 crc kubenswrapper[5120]: I0316 17:01:16.841707 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a5a470f-6027-43b1-aa7b-74626f464c7c-kube-api-access-9zd9l" (OuterVolumeSpecName: "kube-api-access-9zd9l") pod "9a5a470f-6027-43b1-aa7b-74626f464c7c" (UID: "9a5a470f-6027-43b1-aa7b-74626f464c7c"). InnerVolumeSpecName "kube-api-access-9zd9l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:01:16 crc kubenswrapper[5120]: I0316 17:01:16.876183 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a5a470f-6027-43b1-aa7b-74626f464c7c-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "9a5a470f-6027-43b1-aa7b-74626f464c7c" (UID: "9a5a470f-6027-43b1-aa7b-74626f464c7c"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:01:16 crc kubenswrapper[5120]: I0316 17:01:16.876571 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a5a470f-6027-43b1-aa7b-74626f464c7c-vencrypt-tls-certs" (OuterVolumeSpecName: "vencrypt-tls-certs") pod "9a5a470f-6027-43b1-aa7b-74626f464c7c" (UID: "9a5a470f-6027-43b1-aa7b-74626f464c7c"). InnerVolumeSpecName "vencrypt-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:01:16 crc kubenswrapper[5120]: I0316 17:01:16.888042 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a5a470f-6027-43b1-aa7b-74626f464c7c-config-data" (OuterVolumeSpecName: "config-data") pod "9a5a470f-6027-43b1-aa7b-74626f464c7c" (UID: "9a5a470f-6027-43b1-aa7b-74626f464c7c"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:01:16 crc kubenswrapper[5120]: I0316 17:01:16.888345 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a5a470f-6027-43b1-aa7b-74626f464c7c-nova-novncproxy-tls-certs" (OuterVolumeSpecName: "nova-novncproxy-tls-certs") pod "9a5a470f-6027-43b1-aa7b-74626f464c7c" (UID: "9a5a470f-6027-43b1-aa7b-74626f464c7c"). InnerVolumeSpecName "nova-novncproxy-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:01:16 crc kubenswrapper[5120]: I0316 17:01:16.931734 5120 reconciler_common.go:299] "Volume detached for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/9a5a470f-6027-43b1-aa7b-74626f464c7c-nova-novncproxy-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:16 crc kubenswrapper[5120]: I0316 17:01:16.931799 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9a5a470f-6027-43b1-aa7b-74626f464c7c-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:16 crc kubenswrapper[5120]: I0316 17:01:16.931814 5120 reconciler_common.go:299] "Volume detached for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/9a5a470f-6027-43b1-aa7b-74626f464c7c-vencrypt-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:16 crc kubenswrapper[5120]: I0316 17:01:16.931826 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9zd9l\" (UniqueName: \"kubernetes.io/projected/9a5a470f-6027-43b1-aa7b-74626f464c7c-kube-api-access-9zd9l\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:16 crc kubenswrapper[5120]: I0316 17:01:16.931839 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9a5a470f-6027-43b1-aa7b-74626f464c7c-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:16 crc kubenswrapper[5120]: I0316 17:01:16.946047 5120 pod_container_manager_linux.go:217] "Failed to delete cgroup paths" cgroupName=["kubepods","besteffort","pod30bfa4fc-b416-4f16-b673-158d4a8c552a"] err="unable to destroy cgroup paths for cgroup [kubepods besteffort pod30bfa4fc-b416-4f16-b673-158d4a8c552a] : Timed out while waiting for systemd to remove kubepods-besteffort-pod30bfa4fc_b416_4f16_b673_158d4a8c552a.slice" Mar 16 17:01:16 crc kubenswrapper[5120]: E0316 17:01:16.946099 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to delete cgroup paths for [kubepods besteffort pod30bfa4fc-b416-4f16-b673-158d4a8c552a] : unable to destroy cgroup paths for cgroup [kubepods besteffort pod30bfa4fc-b416-4f16-b673-158d4a8c552a] : Timed out while waiting for systemd to remove kubepods-besteffort-pod30bfa4fc_b416_4f16_b673_158d4a8c552a.slice" pod="openstack-kuttl-tests/ceilometer-0" podUID="30bfa4fc-b416-4f16-b673-158d4a8c552a" Mar 16 17:01:17 crc kubenswrapper[5120]: I0316 17:01:17.141400 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:01:17 crc kubenswrapper[5120]: I0316 17:01:17.239528 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b7434cde-890e-42d9-9b5c-bbd60a188517-combined-ca-bundle\") pod \"b7434cde-890e-42d9-9b5c-bbd60a188517\" (UID: \"b7434cde-890e-42d9-9b5c-bbd60a188517\") " Mar 16 17:01:17 crc kubenswrapper[5120]: I0316 17:01:17.239623 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/b7434cde-890e-42d9-9b5c-bbd60a188517-internal-tls-certs\") pod \"b7434cde-890e-42d9-9b5c-bbd60a188517\" (UID: \"b7434cde-890e-42d9-9b5c-bbd60a188517\") " Mar 16 17:01:17 crc kubenswrapper[5120]: I0316 17:01:17.239698 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hgp22\" (UniqueName: \"kubernetes.io/projected/b7434cde-890e-42d9-9b5c-bbd60a188517-kube-api-access-hgp22\") pod \"b7434cde-890e-42d9-9b5c-bbd60a188517\" (UID: \"b7434cde-890e-42d9-9b5c-bbd60a188517\") " Mar 16 17:01:17 crc kubenswrapper[5120]: I0316 17:01:17.239734 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/b7434cde-890e-42d9-9b5c-bbd60a188517-etc-machine-id\") pod \"b7434cde-890e-42d9-9b5c-bbd60a188517\" (UID: \"b7434cde-890e-42d9-9b5c-bbd60a188517\") " Mar 16 17:01:17 crc kubenswrapper[5120]: I0316 17:01:17.239997 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/b7434cde-890e-42d9-9b5c-bbd60a188517-config-data-custom\") pod \"b7434cde-890e-42d9-9b5c-bbd60a188517\" (UID: \"b7434cde-890e-42d9-9b5c-bbd60a188517\") " Mar 16 17:01:17 crc kubenswrapper[5120]: I0316 17:01:17.240062 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b7434cde-890e-42d9-9b5c-bbd60a188517-logs\") pod \"b7434cde-890e-42d9-9b5c-bbd60a188517\" (UID: \"b7434cde-890e-42d9-9b5c-bbd60a188517\") " Mar 16 17:01:17 crc kubenswrapper[5120]: I0316 17:01:17.240092 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b7434cde-890e-42d9-9b5c-bbd60a188517-scripts\") pod \"b7434cde-890e-42d9-9b5c-bbd60a188517\" (UID: \"b7434cde-890e-42d9-9b5c-bbd60a188517\") " Mar 16 17:01:17 crc kubenswrapper[5120]: I0316 17:01:17.240706 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b7434cde-890e-42d9-9b5c-bbd60a188517-config-data\") pod \"b7434cde-890e-42d9-9b5c-bbd60a188517\" (UID: \"b7434cde-890e-42d9-9b5c-bbd60a188517\") " Mar 16 17:01:17 crc kubenswrapper[5120]: I0316 17:01:17.240732 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/b7434cde-890e-42d9-9b5c-bbd60a188517-public-tls-certs\") pod \"b7434cde-890e-42d9-9b5c-bbd60a188517\" (UID: \"b7434cde-890e-42d9-9b5c-bbd60a188517\") " Mar 16 17:01:17 crc kubenswrapper[5120]: I0316 17:01:17.240932 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b7434cde-890e-42d9-9b5c-bbd60a188517-logs" (OuterVolumeSpecName: "logs") pod "b7434cde-890e-42d9-9b5c-bbd60a188517" (UID: "b7434cde-890e-42d9-9b5c-bbd60a188517"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:01:17 crc kubenswrapper[5120]: I0316 17:01:17.241237 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/b7434cde-890e-42d9-9b5c-bbd60a188517-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "b7434cde-890e-42d9-9b5c-bbd60a188517" (UID: "b7434cde-890e-42d9-9b5c-bbd60a188517"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 17:01:17 crc kubenswrapper[5120]: I0316 17:01:17.242091 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b7434cde-890e-42d9-9b5c-bbd60a188517-logs\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:17 crc kubenswrapper[5120]: I0316 17:01:17.242114 5120 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/b7434cde-890e-42d9-9b5c-bbd60a188517-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:17 crc kubenswrapper[5120]: I0316 17:01:17.252672 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b7434cde-890e-42d9-9b5c-bbd60a188517-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "b7434cde-890e-42d9-9b5c-bbd60a188517" (UID: "b7434cde-890e-42d9-9b5c-bbd60a188517"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:01:17 crc kubenswrapper[5120]: I0316 17:01:17.255976 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7434cde-890e-42d9-9b5c-bbd60a188517-kube-api-access-hgp22" (OuterVolumeSpecName: "kube-api-access-hgp22") pod "b7434cde-890e-42d9-9b5c-bbd60a188517" (UID: "b7434cde-890e-42d9-9b5c-bbd60a188517"). InnerVolumeSpecName "kube-api-access-hgp22". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:01:17 crc kubenswrapper[5120]: I0316 17:01:17.269890 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b7434cde-890e-42d9-9b5c-bbd60a188517-scripts" (OuterVolumeSpecName: "scripts") pod "b7434cde-890e-42d9-9b5c-bbd60a188517" (UID: "b7434cde-890e-42d9-9b5c-bbd60a188517"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:01:17 crc kubenswrapper[5120]: I0316 17:01:17.298107 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b7434cde-890e-42d9-9b5c-bbd60a188517-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "b7434cde-890e-42d9-9b5c-bbd60a188517" (UID: "b7434cde-890e-42d9-9b5c-bbd60a188517"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:01:17 crc kubenswrapper[5120]: I0316 17:01:17.304211 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b7434cde-890e-42d9-9b5c-bbd60a188517-config-data" (OuterVolumeSpecName: "config-data") pod "b7434cde-890e-42d9-9b5c-bbd60a188517" (UID: "b7434cde-890e-42d9-9b5c-bbd60a188517"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:01:17 crc kubenswrapper[5120]: I0316 17:01:17.310049 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b7434cde-890e-42d9-9b5c-bbd60a188517-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "b7434cde-890e-42d9-9b5c-bbd60a188517" (UID: "b7434cde-890e-42d9-9b5c-bbd60a188517"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:01:17 crc kubenswrapper[5120]: I0316 17:01:17.319901 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b7434cde-890e-42d9-9b5c-bbd60a188517-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "b7434cde-890e-42d9-9b5c-bbd60a188517" (UID: "b7434cde-890e-42d9-9b5c-bbd60a188517"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:01:17 crc kubenswrapper[5120]: I0316 17:01:17.343898 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b7434cde-890e-42d9-9b5c-bbd60a188517-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:17 crc kubenswrapper[5120]: I0316 17:01:17.343928 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/b7434cde-890e-42d9-9b5c-bbd60a188517-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:17 crc kubenswrapper[5120]: I0316 17:01:17.343938 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hgp22\" (UniqueName: \"kubernetes.io/projected/b7434cde-890e-42d9-9b5c-bbd60a188517-kube-api-access-hgp22\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:17 crc kubenswrapper[5120]: I0316 17:01:17.343948 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/b7434cde-890e-42d9-9b5c-bbd60a188517-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:17 crc kubenswrapper[5120]: I0316 17:01:17.343960 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b7434cde-890e-42d9-9b5c-bbd60a188517-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:17 crc kubenswrapper[5120]: I0316 17:01:17.343968 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b7434cde-890e-42d9-9b5c-bbd60a188517-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:17 crc kubenswrapper[5120]: I0316 17:01:17.343976 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/b7434cde-890e-42d9-9b5c-bbd60a188517-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:17 crc kubenswrapper[5120]: I0316 17:01:17.577504 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:01:17 crc kubenswrapper[5120]: I0316 17:01:17.588683 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-7bbc5ddcc6-cxnhk" Mar 16 17:01:17 crc kubenswrapper[5120]: I0316 17:01:17.679706 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7f699f9655-znk2w" event={"ID":"1afd582f-b48e-4483-8f98-8d4e7d54fabb","Type":"ContainerStarted","Data":"97b81bbed0b032bb774f35fb78029f82dfe379a718e6c62451e88d40f949f8f2"} Mar 16 17:01:17 crc kubenswrapper[5120]: I0316 17:01:17.680879 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7f699f9655-znk2w" Mar 16 17:01:17 crc kubenswrapper[5120]: I0316 17:01:17.683861 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-79c6c668c8-l5c8p" event={"ID":"394193fd-f8e0-4b81-8821-8d1251a0274b","Type":"ContainerStarted","Data":"b366089265c5a377f266a0c6132410502a91ab7d470144bba9e47254c5e54334"} Mar 16 17:01:17 crc kubenswrapper[5120]: I0316 17:01:17.683899 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-79c6c668c8-l5c8p" event={"ID":"394193fd-f8e0-4b81-8821-8d1251a0274b","Type":"ContainerStarted","Data":"bee153da9ff3794e8534a919e63d240cfcd1a5a2b982d46b350472046f40c2c1"} Mar 16 17:01:17 crc kubenswrapper[5120]: I0316 17:01:17.683912 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-79c6c668c8-l5c8p" event={"ID":"394193fd-f8e0-4b81-8821-8d1251a0274b","Type":"ContainerStarted","Data":"6a95911c154b11d00cab64de585c23912b3a98766a752c2156fb7bc9ee3b5865"} Mar 16 17:01:17 crc kubenswrapper[5120]: I0316 17:01:17.684049 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/neutron-79c6c668c8-l5c8p" Mar 16 17:01:17 crc kubenswrapper[5120]: I0316 17:01:17.686233 5120 generic.go:358] "Generic (PLEG): container finished" podID="8d144169-a686-4862-8b52-7a945bc3a36a" containerID="48e312790cba7d0127ad5f8f851016781ff4d933732de34cf1f0cf328d69266d" exitCode=0 Mar 16 17:01:17 crc kubenswrapper[5120]: I0316 17:01:17.686313 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"8d144169-a686-4862-8b52-7a945bc3a36a","Type":"ContainerDied","Data":"48e312790cba7d0127ad5f8f851016781ff4d933732de34cf1f0cf328d69266d"} Mar 16 17:01:17 crc kubenswrapper[5120]: I0316 17:01:17.688487 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:01:17 crc kubenswrapper[5120]: I0316 17:01:17.688496 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"9a5a470f-6027-43b1-aa7b-74626f464c7c","Type":"ContainerDied","Data":"9eb68b319a03566f195605fb474b25b92762e37cf88586605010af31f02810fe"} Mar 16 17:01:17 crc kubenswrapper[5120]: I0316 17:01:17.688540 5120 scope.go:117] "RemoveContainer" containerID="aff7b5c38018439aeda171febf4dc85956a973bc799b03a28da649918795fbf3" Mar 16 17:01:17 crc kubenswrapper[5120]: I0316 17:01:17.692222 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:01:17 crc kubenswrapper[5120]: I0316 17:01:17.692235 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"b7434cde-890e-42d9-9b5c-bbd60a188517","Type":"ContainerDied","Data":"525b14dde01f4ae8a7cd21cc0e4590787326b4e2ae2d92833391b7fa9e943dae"} Mar 16 17:01:17 crc kubenswrapper[5120]: I0316 17:01:17.707035 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:01:17 crc kubenswrapper[5120]: I0316 17:01:17.709440 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7f699f9655-znk2w" podStartSLOduration=4.7094196230000005 podStartE2EDuration="4.709419623s" podCreationTimestamp="2026-03-16 17:01:13 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:01:17.701167955 +0000 UTC m=+5379.855099612" watchObservedRunningTime="2026-03-16 17:01:17.709419623 +0000 UTC m=+5379.863351280" Mar 16 17:01:17 crc kubenswrapper[5120]: I0316 17:01:17.771392 5120 scope.go:117] "RemoveContainer" containerID="9533e6b54c1aa1c42b7613a7687dc06b42ee15eb1d443ad851370c895955ad91" Mar 16 17:01:17 crc kubenswrapper[5120]: I0316 17:01:17.793006 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-79c6c668c8-l5c8p" podStartSLOduration=2.792979672 podStartE2EDuration="2.792979672s" podCreationTimestamp="2026-03-16 17:01:15 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:01:17.749150242 +0000 UTC m=+5379.903081909" watchObservedRunningTime="2026-03-16 17:01:17.792979672 +0000 UTC m=+5379.946911329" Mar 16 17:01:17 crc kubenswrapper[5120]: I0316 17:01:17.798032 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-7bbc5ddcc6-cxnhk" Mar 16 17:01:17 crc kubenswrapper[5120]: I0316 17:01:17.862942 5120 scope.go:117] "RemoveContainer" containerID="e6f41b2eba86e2ad1ad67b7920bf775f201acf4a1d8d43b7f3ad7c19edd16e8f" Mar 16 17:01:17 crc kubenswrapper[5120]: I0316 17:01:17.870480 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 17:01:17 crc kubenswrapper[5120]: I0316 17:01:17.925889 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 17:01:17 crc kubenswrapper[5120]: I0316 17:01:17.942157 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 17:01:17 crc kubenswrapper[5120]: I0316 17:01:17.960468 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 17:01:17 crc kubenswrapper[5120]: I0316 17:01:17.971489 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 17:01:17 crc kubenswrapper[5120]: I0316 17:01:17.972627 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7434cde-890e-42d9-9b5c-bbd60a188517" containerName="cinder-api" Mar 16 17:01:17 crc kubenswrapper[5120]: I0316 17:01:17.972649 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7434cde-890e-42d9-9b5c-bbd60a188517" containerName="cinder-api" Mar 16 17:01:17 crc kubenswrapper[5120]: I0316 17:01:17.972674 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7434cde-890e-42d9-9b5c-bbd60a188517" containerName="cinder-api-log" Mar 16 17:01:17 crc kubenswrapper[5120]: I0316 17:01:17.972680 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7434cde-890e-42d9-9b5c-bbd60a188517" containerName="cinder-api-log" Mar 16 17:01:17 crc kubenswrapper[5120]: I0316 17:01:17.972701 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a5a470f-6027-43b1-aa7b-74626f464c7c" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 17:01:17 crc kubenswrapper[5120]: I0316 17:01:17.972707 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a5a470f-6027-43b1-aa7b-74626f464c7c" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 17:01:17 crc kubenswrapper[5120]: I0316 17:01:17.972941 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="b7434cde-890e-42d9-9b5c-bbd60a188517" containerName="cinder-api-log" Mar 16 17:01:17 crc kubenswrapper[5120]: I0316 17:01:17.972964 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="b7434cde-890e-42d9-9b5c-bbd60a188517" containerName="cinder-api" Mar 16 17:01:17 crc kubenswrapper[5120]: I0316 17:01:17.972973 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="9a5a470f-6027-43b1-aa7b-74626f464c7c" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 17:01:17 crc kubenswrapper[5120]: I0316 17:01:17.995839 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:01:17 crc kubenswrapper[5120]: I0316 17:01:17.996219 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:01:18 crc kubenswrapper[5120]: I0316 17:01:18.002584 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-novncproxy-cell1-public-svc\"" Mar 16 17:01:18 crc kubenswrapper[5120]: I0316 17:01:18.003106 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-novncproxy-config-data\"" Mar 16 17:01:18 crc kubenswrapper[5120]: I0316 17:01:18.003404 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-novncproxy-cell1-vencrypt\"" Mar 16 17:01:18 crc kubenswrapper[5120]: I0316 17:01:18.011707 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 17:01:18 crc kubenswrapper[5120]: I0316 17:01:18.033709 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:01:18 crc kubenswrapper[5120]: I0316 17:01:18.053948 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 17:01:18 crc kubenswrapper[5120]: I0316 17:01:18.071246 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/03d17609-c2ae-4dd1-b28d-4868bbcbe60f-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"03d17609-c2ae-4dd1-b28d-4868bbcbe60f\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:01:18 crc kubenswrapper[5120]: I0316 17:01:18.071307 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/03d17609-c2ae-4dd1-b28d-4868bbcbe60f-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"03d17609-c2ae-4dd1-b28d-4868bbcbe60f\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:01:18 crc kubenswrapper[5120]: I0316 17:01:18.071333 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2k9b\" (UniqueName: \"kubernetes.io/projected/03d17609-c2ae-4dd1-b28d-4868bbcbe60f-kube-api-access-g2k9b\") pod \"nova-cell1-novncproxy-0\" (UID: \"03d17609-c2ae-4dd1-b28d-4868bbcbe60f\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:01:18 crc kubenswrapper[5120]: I0316 17:01:18.071348 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:01:18 crc kubenswrapper[5120]: I0316 17:01:18.071382 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/03d17609-c2ae-4dd1-b28d-4868bbcbe60f-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"03d17609-c2ae-4dd1-b28d-4868bbcbe60f\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:01:18 crc kubenswrapper[5120]: I0316 17:01:18.073246 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/03d17609-c2ae-4dd1-b28d-4868bbcbe60f-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"03d17609-c2ae-4dd1-b28d-4868bbcbe60f\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:01:18 crc kubenswrapper[5120]: I0316 17:01:18.082383 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-cinder-internal-svc\"" Mar 16 17:01:18 crc kubenswrapper[5120]: I0316 17:01:18.082395 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-api-config-data\"" Mar 16 17:01:18 crc kubenswrapper[5120]: I0316 17:01:18.082447 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-cinder-public-svc\"" Mar 16 17:01:18 crc kubenswrapper[5120]: I0316 17:01:18.097394 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:01:18 crc kubenswrapper[5120]: I0316 17:01:18.122751 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 17:01:18 crc kubenswrapper[5120]: I0316 17:01:18.122933 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:01:18 crc kubenswrapper[5120]: I0316 17:01:18.124812 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 17:01:18 crc kubenswrapper[5120]: I0316 17:01:18.125135 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ceilometer-internal-svc\"" Mar 16 17:01:18 crc kubenswrapper[5120]: I0316 17:01:18.126199 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 17:01:18 crc kubenswrapper[5120]: I0316 17:01:18.132875 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-8579c6748-8wfdq"] Mar 16 17:01:18 crc kubenswrapper[5120]: I0316 17:01:18.133259 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-8579c6748-8wfdq" podUID="6f3cdac2-9246-455c-b05a-347b4db60b7f" containerName="barbican-api-log" containerID="cri-o://af6dfa5892c321c1794bd9331bf1e07d8de94fb188e1507acc85ea5149c14c24" gracePeriod=30 Mar 16 17:01:18 crc kubenswrapper[5120]: I0316 17:01:18.133546 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-8579c6748-8wfdq" podUID="6f3cdac2-9246-455c-b05a-347b4db60b7f" containerName="barbican-api" containerID="cri-o://a42992bd1d9cad8a2c4750ffb36344cddb046a7e90453c31912c59e31473304d" gracePeriod=30 Mar 16 17:01:18 crc kubenswrapper[5120]: I0316 17:01:18.159113 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:01:18 crc kubenswrapper[5120]: I0316 17:01:18.176499 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/03d17609-c2ae-4dd1-b28d-4868bbcbe60f-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"03d17609-c2ae-4dd1-b28d-4868bbcbe60f\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:01:18 crc kubenswrapper[5120]: I0316 17:01:18.176573 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g2k9b\" (UniqueName: \"kubernetes.io/projected/03d17609-c2ae-4dd1-b28d-4868bbcbe60f-kube-api-access-g2k9b\") pod \"nova-cell1-novncproxy-0\" (UID: \"03d17609-c2ae-4dd1-b28d-4868bbcbe60f\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:01:18 crc kubenswrapper[5120]: I0316 17:01:18.176666 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/03d17609-c2ae-4dd1-b28d-4868bbcbe60f-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"03d17609-c2ae-4dd1-b28d-4868bbcbe60f\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:01:18 crc kubenswrapper[5120]: I0316 17:01:18.176709 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/662e5dd1-e157-4e76-bb3d-f4310c982cb0-etc-machine-id\") pod \"cinder-api-0\" (UID: \"662e5dd1-e157-4e76-bb3d-f4310c982cb0\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:01:18 crc kubenswrapper[5120]: I0316 17:01:18.176749 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/662e5dd1-e157-4e76-bb3d-f4310c982cb0-public-tls-certs\") pod \"cinder-api-0\" (UID: \"662e5dd1-e157-4e76-bb3d-f4310c982cb0\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:01:18 crc kubenswrapper[5120]: I0316 17:01:18.176934 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/662e5dd1-e157-4e76-bb3d-f4310c982cb0-config-data-custom\") pod \"cinder-api-0\" (UID: \"662e5dd1-e157-4e76-bb3d-f4310c982cb0\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:01:18 crc kubenswrapper[5120]: I0316 17:01:18.176986 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/662e5dd1-e157-4e76-bb3d-f4310c982cb0-scripts\") pod \"cinder-api-0\" (UID: \"662e5dd1-e157-4e76-bb3d-f4310c982cb0\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:01:18 crc kubenswrapper[5120]: I0316 17:01:18.177060 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/03d17609-c2ae-4dd1-b28d-4868bbcbe60f-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"03d17609-c2ae-4dd1-b28d-4868bbcbe60f\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:01:18 crc kubenswrapper[5120]: I0316 17:01:18.177115 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/662e5dd1-e157-4e76-bb3d-f4310c982cb0-config-data\") pod \"cinder-api-0\" (UID: \"662e5dd1-e157-4e76-bb3d-f4310c982cb0\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:01:18 crc kubenswrapper[5120]: I0316 17:01:18.177381 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/662e5dd1-e157-4e76-bb3d-f4310c982cb0-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"662e5dd1-e157-4e76-bb3d-f4310c982cb0\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:01:18 crc kubenswrapper[5120]: I0316 17:01:18.177538 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxfxh\" (UniqueName: \"kubernetes.io/projected/662e5dd1-e157-4e76-bb3d-f4310c982cb0-kube-api-access-vxfxh\") pod \"cinder-api-0\" (UID: \"662e5dd1-e157-4e76-bb3d-f4310c982cb0\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:01:18 crc kubenswrapper[5120]: I0316 17:01:18.177614 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/662e5dd1-e157-4e76-bb3d-f4310c982cb0-logs\") pod \"cinder-api-0\" (UID: \"662e5dd1-e157-4e76-bb3d-f4310c982cb0\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:01:18 crc kubenswrapper[5120]: I0316 17:01:18.177732 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/662e5dd1-e157-4e76-bb3d-f4310c982cb0-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"662e5dd1-e157-4e76-bb3d-f4310c982cb0\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:01:18 crc kubenswrapper[5120]: I0316 17:01:18.177979 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/03d17609-c2ae-4dd1-b28d-4868bbcbe60f-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"03d17609-c2ae-4dd1-b28d-4868bbcbe60f\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:01:18 crc kubenswrapper[5120]: I0316 17:01:18.188500 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/03d17609-c2ae-4dd1-b28d-4868bbcbe60f-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"03d17609-c2ae-4dd1-b28d-4868bbcbe60f\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:01:18 crc kubenswrapper[5120]: I0316 17:01:18.188657 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/03d17609-c2ae-4dd1-b28d-4868bbcbe60f-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"03d17609-c2ae-4dd1-b28d-4868bbcbe60f\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:01:18 crc kubenswrapper[5120]: I0316 17:01:18.191524 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/03d17609-c2ae-4dd1-b28d-4868bbcbe60f-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"03d17609-c2ae-4dd1-b28d-4868bbcbe60f\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:01:18 crc kubenswrapper[5120]: I0316 17:01:18.194161 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/03d17609-c2ae-4dd1-b28d-4868bbcbe60f-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"03d17609-c2ae-4dd1-b28d-4868bbcbe60f\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:01:18 crc kubenswrapper[5120]: I0316 17:01:18.208485 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2k9b\" (UniqueName: \"kubernetes.io/projected/03d17609-c2ae-4dd1-b28d-4868bbcbe60f-kube-api-access-g2k9b\") pod \"nova-cell1-novncproxy-0\" (UID: \"03d17609-c2ae-4dd1-b28d-4868bbcbe60f\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:01:18 crc kubenswrapper[5120]: I0316 17:01:18.280487 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/662e5dd1-e157-4e76-bb3d-f4310c982cb0-config-data-custom\") pod \"cinder-api-0\" (UID: \"662e5dd1-e157-4e76-bb3d-f4310c982cb0\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:01:18 crc kubenswrapper[5120]: I0316 17:01:18.280547 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/662e5dd1-e157-4e76-bb3d-f4310c982cb0-scripts\") pod \"cinder-api-0\" (UID: \"662e5dd1-e157-4e76-bb3d-f4310c982cb0\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:01:18 crc kubenswrapper[5120]: I0316 17:01:18.280603 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/662e5dd1-e157-4e76-bb3d-f4310c982cb0-config-data\") pod \"cinder-api-0\" (UID: \"662e5dd1-e157-4e76-bb3d-f4310c982cb0\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:01:18 crc kubenswrapper[5120]: I0316 17:01:18.280731 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/69b6e961-8899-43be-9468-f199ead48923-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"69b6e961-8899-43be-9468-f199ead48923\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:01:18 crc kubenswrapper[5120]: I0316 17:01:18.280775 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/69b6e961-8899-43be-9468-f199ead48923-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"69b6e961-8899-43be-9468-f199ead48923\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:01:18 crc kubenswrapper[5120]: I0316 17:01:18.280828 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/69b6e961-8899-43be-9468-f199ead48923-scripts\") pod \"ceilometer-0\" (UID: \"69b6e961-8899-43be-9468-f199ead48923\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:01:18 crc kubenswrapper[5120]: I0316 17:01:18.280888 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/662e5dd1-e157-4e76-bb3d-f4310c982cb0-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"662e5dd1-e157-4e76-bb3d-f4310c982cb0\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:01:18 crc kubenswrapper[5120]: I0316 17:01:18.280905 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/69b6e961-8899-43be-9468-f199ead48923-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"69b6e961-8899-43be-9468-f199ead48923\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:01:18 crc kubenswrapper[5120]: I0316 17:01:18.280934 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/69b6e961-8899-43be-9468-f199ead48923-log-httpd\") pod \"ceilometer-0\" (UID: \"69b6e961-8899-43be-9468-f199ead48923\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:01:18 crc kubenswrapper[5120]: I0316 17:01:18.281020 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vxfxh\" (UniqueName: \"kubernetes.io/projected/662e5dd1-e157-4e76-bb3d-f4310c982cb0-kube-api-access-vxfxh\") pod \"cinder-api-0\" (UID: \"662e5dd1-e157-4e76-bb3d-f4310c982cb0\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:01:18 crc kubenswrapper[5120]: I0316 17:01:18.281045 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/69b6e961-8899-43be-9468-f199ead48923-config-data\") pod \"ceilometer-0\" (UID: \"69b6e961-8899-43be-9468-f199ead48923\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:01:18 crc kubenswrapper[5120]: I0316 17:01:18.281098 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/662e5dd1-e157-4e76-bb3d-f4310c982cb0-logs\") pod \"cinder-api-0\" (UID: \"662e5dd1-e157-4e76-bb3d-f4310c982cb0\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:01:18 crc kubenswrapper[5120]: I0316 17:01:18.281178 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/662e5dd1-e157-4e76-bb3d-f4310c982cb0-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"662e5dd1-e157-4e76-bb3d-f4310c982cb0\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:01:18 crc kubenswrapper[5120]: I0316 17:01:18.281288 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xdvz\" (UniqueName: \"kubernetes.io/projected/69b6e961-8899-43be-9468-f199ead48923-kube-api-access-2xdvz\") pod \"ceilometer-0\" (UID: \"69b6e961-8899-43be-9468-f199ead48923\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:01:18 crc kubenswrapper[5120]: I0316 17:01:18.281477 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/662e5dd1-e157-4e76-bb3d-f4310c982cb0-etc-machine-id\") pod \"cinder-api-0\" (UID: \"662e5dd1-e157-4e76-bb3d-f4310c982cb0\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:01:18 crc kubenswrapper[5120]: I0316 17:01:18.281517 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/662e5dd1-e157-4e76-bb3d-f4310c982cb0-public-tls-certs\") pod \"cinder-api-0\" (UID: \"662e5dd1-e157-4e76-bb3d-f4310c982cb0\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:01:18 crc kubenswrapper[5120]: I0316 17:01:18.281572 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/69b6e961-8899-43be-9468-f199ead48923-run-httpd\") pod \"ceilometer-0\" (UID: \"69b6e961-8899-43be-9468-f199ead48923\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:01:18 crc kubenswrapper[5120]: I0316 17:01:18.285033 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/662e5dd1-e157-4e76-bb3d-f4310c982cb0-etc-machine-id\") pod \"cinder-api-0\" (UID: \"662e5dd1-e157-4e76-bb3d-f4310c982cb0\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:01:18 crc kubenswrapper[5120]: I0316 17:01:18.285919 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/662e5dd1-e157-4e76-bb3d-f4310c982cb0-logs\") pod \"cinder-api-0\" (UID: \"662e5dd1-e157-4e76-bb3d-f4310c982cb0\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:01:18 crc kubenswrapper[5120]: I0316 17:01:18.288440 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/662e5dd1-e157-4e76-bb3d-f4310c982cb0-config-data-custom\") pod \"cinder-api-0\" (UID: \"662e5dd1-e157-4e76-bb3d-f4310c982cb0\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:01:18 crc kubenswrapper[5120]: I0316 17:01:18.288496 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/662e5dd1-e157-4e76-bb3d-f4310c982cb0-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"662e5dd1-e157-4e76-bb3d-f4310c982cb0\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:01:18 crc kubenswrapper[5120]: I0316 17:01:18.289845 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/662e5dd1-e157-4e76-bb3d-f4310c982cb0-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"662e5dd1-e157-4e76-bb3d-f4310c982cb0\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:01:18 crc kubenswrapper[5120]: I0316 17:01:18.290110 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/662e5dd1-e157-4e76-bb3d-f4310c982cb0-config-data\") pod \"cinder-api-0\" (UID: \"662e5dd1-e157-4e76-bb3d-f4310c982cb0\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:01:18 crc kubenswrapper[5120]: I0316 17:01:18.290451 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/662e5dd1-e157-4e76-bb3d-f4310c982cb0-public-tls-certs\") pod \"cinder-api-0\" (UID: \"662e5dd1-e157-4e76-bb3d-f4310c982cb0\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:01:18 crc kubenswrapper[5120]: I0316 17:01:18.295478 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/662e5dd1-e157-4e76-bb3d-f4310c982cb0-scripts\") pod \"cinder-api-0\" (UID: \"662e5dd1-e157-4e76-bb3d-f4310c982cb0\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:01:18 crc kubenswrapper[5120]: I0316 17:01:18.305691 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxfxh\" (UniqueName: \"kubernetes.io/projected/662e5dd1-e157-4e76-bb3d-f4310c982cb0-kube-api-access-vxfxh\") pod \"cinder-api-0\" (UID: \"662e5dd1-e157-4e76-bb3d-f4310c982cb0\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:01:18 crc kubenswrapper[5120]: I0316 17:01:18.327802 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:01:18 crc kubenswrapper[5120]: I0316 17:01:18.386146 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/69b6e961-8899-43be-9468-f199ead48923-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"69b6e961-8899-43be-9468-f199ead48923\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:01:18 crc kubenswrapper[5120]: I0316 17:01:18.386510 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/69b6e961-8899-43be-9468-f199ead48923-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"69b6e961-8899-43be-9468-f199ead48923\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:01:18 crc kubenswrapper[5120]: I0316 17:01:18.386580 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/69b6e961-8899-43be-9468-f199ead48923-scripts\") pod \"ceilometer-0\" (UID: \"69b6e961-8899-43be-9468-f199ead48923\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:01:18 crc kubenswrapper[5120]: I0316 17:01:18.386655 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/69b6e961-8899-43be-9468-f199ead48923-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"69b6e961-8899-43be-9468-f199ead48923\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:01:18 crc kubenswrapper[5120]: I0316 17:01:18.386704 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/69b6e961-8899-43be-9468-f199ead48923-log-httpd\") pod \"ceilometer-0\" (UID: \"69b6e961-8899-43be-9468-f199ead48923\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:01:18 crc kubenswrapper[5120]: I0316 17:01:18.386890 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/69b6e961-8899-43be-9468-f199ead48923-config-data\") pod \"ceilometer-0\" (UID: \"69b6e961-8899-43be-9468-f199ead48923\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:01:18 crc kubenswrapper[5120]: I0316 17:01:18.387113 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2xdvz\" (UniqueName: \"kubernetes.io/projected/69b6e961-8899-43be-9468-f199ead48923-kube-api-access-2xdvz\") pod \"ceilometer-0\" (UID: \"69b6e961-8899-43be-9468-f199ead48923\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:01:18 crc kubenswrapper[5120]: I0316 17:01:18.387252 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/69b6e961-8899-43be-9468-f199ead48923-run-httpd\") pod \"ceilometer-0\" (UID: \"69b6e961-8899-43be-9468-f199ead48923\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:01:18 crc kubenswrapper[5120]: I0316 17:01:18.388116 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/69b6e961-8899-43be-9468-f199ead48923-log-httpd\") pod \"ceilometer-0\" (UID: \"69b6e961-8899-43be-9468-f199ead48923\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:01:18 crc kubenswrapper[5120]: I0316 17:01:18.388855 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/69b6e961-8899-43be-9468-f199ead48923-run-httpd\") pod \"ceilometer-0\" (UID: \"69b6e961-8899-43be-9468-f199ead48923\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:01:18 crc kubenswrapper[5120]: I0316 17:01:18.392625 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/69b6e961-8899-43be-9468-f199ead48923-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"69b6e961-8899-43be-9468-f199ead48923\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:01:18 crc kubenswrapper[5120]: I0316 17:01:18.393430 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/69b6e961-8899-43be-9468-f199ead48923-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"69b6e961-8899-43be-9468-f199ead48923\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:01:18 crc kubenswrapper[5120]: I0316 17:01:18.400064 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:01:18 crc kubenswrapper[5120]: I0316 17:01:18.405883 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/69b6e961-8899-43be-9468-f199ead48923-config-data\") pod \"ceilometer-0\" (UID: \"69b6e961-8899-43be-9468-f199ead48923\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:01:18 crc kubenswrapper[5120]: I0316 17:01:18.407429 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/69b6e961-8899-43be-9468-f199ead48923-scripts\") pod \"ceilometer-0\" (UID: \"69b6e961-8899-43be-9468-f199ead48923\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:01:18 crc kubenswrapper[5120]: I0316 17:01:18.410779 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/69b6e961-8899-43be-9468-f199ead48923-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"69b6e961-8899-43be-9468-f199ead48923\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:01:18 crc kubenswrapper[5120]: I0316 17:01:18.412114 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xdvz\" (UniqueName: \"kubernetes.io/projected/69b6e961-8899-43be-9468-f199ead48923-kube-api-access-2xdvz\") pod \"ceilometer-0\" (UID: \"69b6e961-8899-43be-9468-f199ead48923\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:01:18 crc kubenswrapper[5120]: I0316 17:01:18.452918 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:01:18 crc kubenswrapper[5120]: I0316 17:01:18.681342 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="30bfa4fc-b416-4f16-b673-158d4a8c552a" path="/var/lib/kubelet/pods/30bfa4fc-b416-4f16-b673-158d4a8c552a/volumes" Mar 16 17:01:18 crc kubenswrapper[5120]: I0316 17:01:18.682737 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a5a470f-6027-43b1-aa7b-74626f464c7c" path="/var/lib/kubelet/pods/9a5a470f-6027-43b1-aa7b-74626f464c7c/volumes" Mar 16 17:01:18 crc kubenswrapper[5120]: I0316 17:01:18.683689 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b7434cde-890e-42d9-9b5c-bbd60a188517" path="/var/lib/kubelet/pods/b7434cde-890e-42d9-9b5c-bbd60a188517/volumes" Mar 16 17:01:18 crc kubenswrapper[5120]: I0316 17:01:18.721686 5120 generic.go:358] "Generic (PLEG): container finished" podID="6f3cdac2-9246-455c-b05a-347b4db60b7f" containerID="af6dfa5892c321c1794bd9331bf1e07d8de94fb188e1507acc85ea5149c14c24" exitCode=143 Mar 16 17:01:18 crc kubenswrapper[5120]: I0316 17:01:18.721891 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-8579c6748-8wfdq" event={"ID":"6f3cdac2-9246-455c-b05a-347b4db60b7f","Type":"ContainerDied","Data":"af6dfa5892c321c1794bd9331bf1e07d8de94fb188e1507acc85ea5149c14c24"} Mar 16 17:01:18 crc kubenswrapper[5120]: I0316 17:01:18.724343 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"8d144169-a686-4862-8b52-7a945bc3a36a","Type":"ContainerStarted","Data":"94add9dcf1e03858664425cf329c526e5cc98a269344ecef11775ce6356facac"} Mar 16 17:01:18 crc kubenswrapper[5120]: I0316 17:01:18.815891 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstack-cell1-galera-0" podStartSLOduration=5.815870599 podStartE2EDuration="5.815870599s" podCreationTimestamp="2026-03-16 17:01:13 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:01:18.758175065 +0000 UTC m=+5380.912106742" watchObservedRunningTime="2026-03-16 17:01:18.815870599 +0000 UTC m=+5380.969802256" Mar 16 17:01:19 crc kubenswrapper[5120]: I0316 17:01:19.025884 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 17:01:19 crc kubenswrapper[5120]: I0316 17:01:19.152627 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 17:01:19 crc kubenswrapper[5120]: I0316 17:01:19.199422 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:01:19 crc kubenswrapper[5120]: I0316 17:01:19.746550 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"662e5dd1-e157-4e76-bb3d-f4310c982cb0","Type":"ContainerStarted","Data":"a0d425699d631300d9a5c7fdcd039edc11aab69ecc38fa98221cb5345c059f71"} Mar 16 17:01:19 crc kubenswrapper[5120]: I0316 17:01:19.752261 5120 generic.go:358] "Generic (PLEG): container finished" podID="25abef41-bfd4-4436-a8c8-262247bd936f" containerID="22bc321bf8bdaa4bae524c0d33ca3b1bfd1b617debabd58a58a512ee9428af0a" exitCode=0 Mar 16 17:01:19 crc kubenswrapper[5120]: I0316 17:01:19.752373 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"25abef41-bfd4-4436-a8c8-262247bd936f","Type":"ContainerDied","Data":"22bc321bf8bdaa4bae524c0d33ca3b1bfd1b617debabd58a58a512ee9428af0a"} Mar 16 17:01:19 crc kubenswrapper[5120]: I0316 17:01:19.765180 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"69b6e961-8899-43be-9468-f199ead48923","Type":"ContainerStarted","Data":"a24c5fd95558d0264632785468f767777df60e855742d92e88730644bdb32a79"} Mar 16 17:01:19 crc kubenswrapper[5120]: I0316 17:01:19.809262 5120 generic.go:358] "Generic (PLEG): container finished" podID="0fdecce9-8602-457d-8eec-c97b359170dd" containerID="13db0eeaeb1f2cf2000ab74839313ccae7e410cc64de56f0aa772b702b92719c" exitCode=0 Mar 16 17:01:19 crc kubenswrapper[5120]: I0316 17:01:19.809494 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"0fdecce9-8602-457d-8eec-c97b359170dd","Type":"ContainerDied","Data":"13db0eeaeb1f2cf2000ab74839313ccae7e410cc64de56f0aa772b702b92719c"} Mar 16 17:01:19 crc kubenswrapper[5120]: I0316 17:01:19.814717 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"03d17609-c2ae-4dd1-b28d-4868bbcbe60f","Type":"ContainerStarted","Data":"d4a40189062f79503a77511e05b2b5d5ead5046a7f39d08901d2db10066a4fd5"} Mar 16 17:01:19 crc kubenswrapper[5120]: I0316 17:01:19.976441 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:01:19 crc kubenswrapper[5120]: I0316 17:01:19.989056 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/25abef41-bfd4-4436-a8c8-262247bd936f-public-tls-certs\") pod \"25abef41-bfd4-4436-a8c8-262247bd936f\" (UID: \"25abef41-bfd4-4436-a8c8-262247bd936f\") " Mar 16 17:01:19 crc kubenswrapper[5120]: I0316 17:01:19.989280 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/25abef41-bfd4-4436-a8c8-262247bd936f-logs\") pod \"25abef41-bfd4-4436-a8c8-262247bd936f\" (UID: \"25abef41-bfd4-4436-a8c8-262247bd936f\") " Mar 16 17:01:19 crc kubenswrapper[5120]: I0316 17:01:19.989649 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-brvxt\" (UniqueName: \"kubernetes.io/projected/25abef41-bfd4-4436-a8c8-262247bd936f-kube-api-access-brvxt\") pod \"25abef41-bfd4-4436-a8c8-262247bd936f\" (UID: \"25abef41-bfd4-4436-a8c8-262247bd936f\") " Mar 16 17:01:19 crc kubenswrapper[5120]: I0316 17:01:19.989702 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/25abef41-bfd4-4436-a8c8-262247bd936f-combined-ca-bundle\") pod \"25abef41-bfd4-4436-a8c8-262247bd936f\" (UID: \"25abef41-bfd4-4436-a8c8-262247bd936f\") " Mar 16 17:01:19 crc kubenswrapper[5120]: I0316 17:01:19.989818 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/25abef41-bfd4-4436-a8c8-262247bd936f-httpd-run\") pod \"25abef41-bfd4-4436-a8c8-262247bd936f\" (UID: \"25abef41-bfd4-4436-a8c8-262247bd936f\") " Mar 16 17:01:19 crc kubenswrapper[5120]: I0316 17:01:19.989837 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"25abef41-bfd4-4436-a8c8-262247bd936f\" (UID: \"25abef41-bfd4-4436-a8c8-262247bd936f\") " Mar 16 17:01:19 crc kubenswrapper[5120]: I0316 17:01:19.989906 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/25abef41-bfd4-4436-a8c8-262247bd936f-config-data\") pod \"25abef41-bfd4-4436-a8c8-262247bd936f\" (UID: \"25abef41-bfd4-4436-a8c8-262247bd936f\") " Mar 16 17:01:19 crc kubenswrapper[5120]: I0316 17:01:19.990063 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/25abef41-bfd4-4436-a8c8-262247bd936f-scripts\") pod \"25abef41-bfd4-4436-a8c8-262247bd936f\" (UID: \"25abef41-bfd4-4436-a8c8-262247bd936f\") " Mar 16 17:01:19 crc kubenswrapper[5120]: I0316 17:01:19.991216 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25abef41-bfd4-4436-a8c8-262247bd936f-logs" (OuterVolumeSpecName: "logs") pod "25abef41-bfd4-4436-a8c8-262247bd936f" (UID: "25abef41-bfd4-4436-a8c8-262247bd936f"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:01:19 crc kubenswrapper[5120]: I0316 17:01:19.992034 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25abef41-bfd4-4436-a8c8-262247bd936f-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "25abef41-bfd4-4436-a8c8-262247bd936f" (UID: "25abef41-bfd4-4436-a8c8-262247bd936f"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:01:20 crc kubenswrapper[5120]: I0316 17:01:20.017408 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25abef41-bfd4-4436-a8c8-262247bd936f-kube-api-access-brvxt" (OuterVolumeSpecName: "kube-api-access-brvxt") pod "25abef41-bfd4-4436-a8c8-262247bd936f" (UID: "25abef41-bfd4-4436-a8c8-262247bd936f"). InnerVolumeSpecName "kube-api-access-brvxt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:01:20 crc kubenswrapper[5120]: I0316 17:01:20.019505 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage05-crc" (OuterVolumeSpecName: "glance") pod "25abef41-bfd4-4436-a8c8-262247bd936f" (UID: "25abef41-bfd4-4436-a8c8-262247bd936f"). InnerVolumeSpecName "local-storage05-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 17:01:20 crc kubenswrapper[5120]: I0316 17:01:20.021085 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/25abef41-bfd4-4436-a8c8-262247bd936f-scripts" (OuterVolumeSpecName: "scripts") pod "25abef41-bfd4-4436-a8c8-262247bd936f" (UID: "25abef41-bfd4-4436-a8c8-262247bd936f"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:01:20 crc kubenswrapper[5120]: I0316 17:01:20.094854 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/25abef41-bfd4-4436-a8c8-262247bd936f-logs\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:20 crc kubenswrapper[5120]: I0316 17:01:20.094903 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-brvxt\" (UniqueName: \"kubernetes.io/projected/25abef41-bfd4-4436-a8c8-262247bd936f-kube-api-access-brvxt\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:20 crc kubenswrapper[5120]: I0316 17:01:20.094920 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/25abef41-bfd4-4436-a8c8-262247bd936f-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:20 crc kubenswrapper[5120]: I0316 17:01:20.094953 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") on node \"crc\" " Mar 16 17:01:20 crc kubenswrapper[5120]: I0316 17:01:20.094965 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/25abef41-bfd4-4436-a8c8-262247bd936f-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:20 crc kubenswrapper[5120]: I0316 17:01:20.125948 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/25abef41-bfd4-4436-a8c8-262247bd936f-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "25abef41-bfd4-4436-a8c8-262247bd936f" (UID: "25abef41-bfd4-4436-a8c8-262247bd936f"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:01:20 crc kubenswrapper[5120]: I0316 17:01:20.150561 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:01:20 crc kubenswrapper[5120]: I0316 17:01:20.151398 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage05-crc" (UniqueName: "kubernetes.io/local-volume/local-storage05-crc") on node "crc" Mar 16 17:01:20 crc kubenswrapper[5120]: I0316 17:01:20.196314 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0fdecce9-8602-457d-8eec-c97b359170dd-config-data\") pod \"0fdecce9-8602-457d-8eec-c97b359170dd\" (UID: \"0fdecce9-8602-457d-8eec-c97b359170dd\") " Mar 16 17:01:20 crc kubenswrapper[5120]: I0316 17:01:20.196380 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/0fdecce9-8602-457d-8eec-c97b359170dd-httpd-run\") pod \"0fdecce9-8602-457d-8eec-c97b359170dd\" (UID: \"0fdecce9-8602-457d-8eec-c97b359170dd\") " Mar 16 17:01:20 crc kubenswrapper[5120]: I0316 17:01:20.197407 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/25abef41-bfd4-4436-a8c8-262247bd936f-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "25abef41-bfd4-4436-a8c8-262247bd936f" (UID: "25abef41-bfd4-4436-a8c8-262247bd936f"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:01:20 crc kubenswrapper[5120]: I0316 17:01:20.198053 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0fdecce9-8602-457d-8eec-c97b359170dd-combined-ca-bundle\") pod \"0fdecce9-8602-457d-8eec-c97b359170dd\" (UID: \"0fdecce9-8602-457d-8eec-c97b359170dd\") " Mar 16 17:01:20 crc kubenswrapper[5120]: I0316 17:01:20.198452 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/0fdecce9-8602-457d-8eec-c97b359170dd-internal-tls-certs\") pod \"0fdecce9-8602-457d-8eec-c97b359170dd\" (UID: \"0fdecce9-8602-457d-8eec-c97b359170dd\") " Mar 16 17:01:20 crc kubenswrapper[5120]: I0316 17:01:20.198530 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0fdecce9-8602-457d-8eec-c97b359170dd-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "0fdecce9-8602-457d-8eec-c97b359170dd" (UID: "0fdecce9-8602-457d-8eec-c97b359170dd"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:01:20 crc kubenswrapper[5120]: I0316 17:01:20.198824 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"0fdecce9-8602-457d-8eec-c97b359170dd\" (UID: \"0fdecce9-8602-457d-8eec-c97b359170dd\") " Mar 16 17:01:20 crc kubenswrapper[5120]: I0316 17:01:20.198864 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0fdecce9-8602-457d-8eec-c97b359170dd-logs\") pod \"0fdecce9-8602-457d-8eec-c97b359170dd\" (UID: \"0fdecce9-8602-457d-8eec-c97b359170dd\") " Mar 16 17:01:20 crc kubenswrapper[5120]: I0316 17:01:20.198957 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0fdecce9-8602-457d-8eec-c97b359170dd-scripts\") pod \"0fdecce9-8602-457d-8eec-c97b359170dd\" (UID: \"0fdecce9-8602-457d-8eec-c97b359170dd\") " Mar 16 17:01:20 crc kubenswrapper[5120]: I0316 17:01:20.199051 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/25abef41-bfd4-4436-a8c8-262247bd936f-public-tls-certs\") pod \"25abef41-bfd4-4436-a8c8-262247bd936f\" (UID: \"25abef41-bfd4-4436-a8c8-262247bd936f\") " Mar 16 17:01:20 crc kubenswrapper[5120]: I0316 17:01:20.199139 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wvgxt\" (UniqueName: \"kubernetes.io/projected/0fdecce9-8602-457d-8eec-c97b359170dd-kube-api-access-wvgxt\") pod \"0fdecce9-8602-457d-8eec-c97b359170dd\" (UID: \"0fdecce9-8602-457d-8eec-c97b359170dd\") " Mar 16 17:01:20 crc kubenswrapper[5120]: I0316 17:01:20.200048 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0fdecce9-8602-457d-8eec-c97b359170dd-logs" (OuterVolumeSpecName: "logs") pod "0fdecce9-8602-457d-8eec-c97b359170dd" (UID: "0fdecce9-8602-457d-8eec-c97b359170dd"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:01:20 crc kubenswrapper[5120]: W0316 17:01:20.200124 5120 empty_dir.go:511] Warning: Unmount skipped because path does not exist: /var/lib/kubelet/pods/25abef41-bfd4-4436-a8c8-262247bd936f/volumes/kubernetes.io~secret/public-tls-certs Mar 16 17:01:20 crc kubenswrapper[5120]: I0316 17:01:20.200132 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/25abef41-bfd4-4436-a8c8-262247bd936f-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "25abef41-bfd4-4436-a8c8-262247bd936f" (UID: "25abef41-bfd4-4436-a8c8-262247bd936f"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:01:20 crc kubenswrapper[5120]: I0316 17:01:20.206870 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0fdecce9-8602-457d-8eec-c97b359170dd-logs\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:20 crc kubenswrapper[5120]: I0316 17:01:20.206953 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/25abef41-bfd4-4436-a8c8-262247bd936f-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:20 crc kubenswrapper[5120]: I0316 17:01:20.206969 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/0fdecce9-8602-457d-8eec-c97b359170dd-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:20 crc kubenswrapper[5120]: I0316 17:01:20.206981 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/25abef41-bfd4-4436-a8c8-262247bd936f-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:20 crc kubenswrapper[5120]: I0316 17:01:20.206997 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:20 crc kubenswrapper[5120]: I0316 17:01:20.213008 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0fdecce9-8602-457d-8eec-c97b359170dd-kube-api-access-wvgxt" (OuterVolumeSpecName: "kube-api-access-wvgxt") pod "0fdecce9-8602-457d-8eec-c97b359170dd" (UID: "0fdecce9-8602-457d-8eec-c97b359170dd"). InnerVolumeSpecName "kube-api-access-wvgxt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:01:20 crc kubenswrapper[5120]: I0316 17:01:20.215266 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0fdecce9-8602-457d-8eec-c97b359170dd-scripts" (OuterVolumeSpecName: "scripts") pod "0fdecce9-8602-457d-8eec-c97b359170dd" (UID: "0fdecce9-8602-457d-8eec-c97b359170dd"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:01:20 crc kubenswrapper[5120]: I0316 17:01:20.221983 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage06-crc" (OuterVolumeSpecName: "glance") pod "0fdecce9-8602-457d-8eec-c97b359170dd" (UID: "0fdecce9-8602-457d-8eec-c97b359170dd"). InnerVolumeSpecName "local-storage06-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 17:01:20 crc kubenswrapper[5120]: I0316 17:01:20.251955 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/25abef41-bfd4-4436-a8c8-262247bd936f-config-data" (OuterVolumeSpecName: "config-data") pod "25abef41-bfd4-4436-a8c8-262247bd936f" (UID: "25abef41-bfd4-4436-a8c8-262247bd936f"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:01:20 crc kubenswrapper[5120]: I0316 17:01:20.265878 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0fdecce9-8602-457d-8eec-c97b359170dd-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "0fdecce9-8602-457d-8eec-c97b359170dd" (UID: "0fdecce9-8602-457d-8eec-c97b359170dd"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:01:20 crc kubenswrapper[5120]: I0316 17:01:20.304324 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0fdecce9-8602-457d-8eec-c97b359170dd-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "0fdecce9-8602-457d-8eec-c97b359170dd" (UID: "0fdecce9-8602-457d-8eec-c97b359170dd"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:01:20 crc kubenswrapper[5120]: I0316 17:01:20.313077 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0fdecce9-8602-457d-8eec-c97b359170dd-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:20 crc kubenswrapper[5120]: I0316 17:01:20.313123 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/25abef41-bfd4-4436-a8c8-262247bd936f-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:20 crc kubenswrapper[5120]: I0316 17:01:20.313135 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/0fdecce9-8602-457d-8eec-c97b359170dd-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:20 crc kubenswrapper[5120]: I0316 17:01:20.313168 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") on node \"crc\" " Mar 16 17:01:20 crc kubenswrapper[5120]: I0316 17:01:20.313180 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0fdecce9-8602-457d-8eec-c97b359170dd-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:20 crc kubenswrapper[5120]: I0316 17:01:20.313192 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wvgxt\" (UniqueName: \"kubernetes.io/projected/0fdecce9-8602-457d-8eec-c97b359170dd-kube-api-access-wvgxt\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:20 crc kubenswrapper[5120]: I0316 17:01:20.336599 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0fdecce9-8602-457d-8eec-c97b359170dd-config-data" (OuterVolumeSpecName: "config-data") pod "0fdecce9-8602-457d-8eec-c97b359170dd" (UID: "0fdecce9-8602-457d-8eec-c97b359170dd"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:01:20 crc kubenswrapper[5120]: I0316 17:01:20.361386 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage06-crc" (UniqueName: "kubernetes.io/local-volume/local-storage06-crc") on node "crc" Mar 16 17:01:20 crc kubenswrapper[5120]: I0316 17:01:20.415951 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:20 crc kubenswrapper[5120]: I0316 17:01:20.415996 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0fdecce9-8602-457d-8eec-c97b359170dd-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:20 crc kubenswrapper[5120]: E0316 17:01:20.454219 5120 fsHandler.go:119] failed to collect filesystem stats - rootDiskErr: , extraDiskErr: could not stat "/var/log/pods/openstack-kuttl-tests_glance-default-internal-api-0_55f7f374-c6b2-422b-90bd-a7dcc936e74f/glance-httpd/0.log" to get inode usage: stat /var/log/pods/openstack-kuttl-tests_glance-default-internal-api-0_55f7f374-c6b2-422b-90bd-a7dcc936e74f/glance-httpd/0.log: no such file or directory Mar 16 17:01:20 crc kubenswrapper[5120]: I0316 17:01:20.839934 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"69b6e961-8899-43be-9468-f199ead48923","Type":"ContainerStarted","Data":"d8faa29bbf662c38afc672335e873815294c123589b63132659da7692be4c59a"} Mar 16 17:01:20 crc kubenswrapper[5120]: I0316 17:01:20.851055 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:01:20 crc kubenswrapper[5120]: I0316 17:01:20.851068 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"0fdecce9-8602-457d-8eec-c97b359170dd","Type":"ContainerDied","Data":"dcac205b014b21d17ad56e780b019d708c45533caa9f76fde023fd335cccb3ed"} Mar 16 17:01:20 crc kubenswrapper[5120]: I0316 17:01:20.851158 5120 scope.go:117] "RemoveContainer" containerID="13db0eeaeb1f2cf2000ab74839313ccae7e410cc64de56f0aa772b702b92719c" Mar 16 17:01:20 crc kubenswrapper[5120]: I0316 17:01:20.860781 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"03d17609-c2ae-4dd1-b28d-4868bbcbe60f","Type":"ContainerStarted","Data":"77ba34a41a27a7a956bde218fa15dba2b646abd9ed17c20b7ef4ac7872dbb267"} Mar 16 17:01:20 crc kubenswrapper[5120]: I0316 17:01:20.869206 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"662e5dd1-e157-4e76-bb3d-f4310c982cb0","Type":"ContainerStarted","Data":"6f3d5d660208c4b004ec65401f0ef1985dc6cff4ffcc709cf989fcdfe929481e"} Mar 16 17:01:20 crc kubenswrapper[5120]: I0316 17:01:20.884576 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 17:01:20 crc kubenswrapper[5120]: I0316 17:01:20.887117 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:01:20 crc kubenswrapper[5120]: I0316 17:01:20.887148 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"25abef41-bfd4-4436-a8c8-262247bd936f","Type":"ContainerDied","Data":"d2a3840b43a3b5e454f66025cece8b86377288f262dec0e49a55b5997c17ff86"} Mar 16 17:01:20 crc kubenswrapper[5120]: I0316 17:01:20.889124 5120 scope.go:117] "RemoveContainer" containerID="19947c1a0b137846bb6d093126701f82159f9a27968b0667b1331783679eb16e" Mar 16 17:01:20 crc kubenswrapper[5120]: I0316 17:01:20.894858 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 17:01:20 crc kubenswrapper[5120]: I0316 17:01:20.942567 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 17:01:20 crc kubenswrapper[5120]: I0316 17:01:20.943778 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25abef41-bfd4-4436-a8c8-262247bd936f" containerName="glance-log" Mar 16 17:01:20 crc kubenswrapper[5120]: I0316 17:01:20.943804 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="25abef41-bfd4-4436-a8c8-262247bd936f" containerName="glance-log" Mar 16 17:01:20 crc kubenswrapper[5120]: I0316 17:01:20.943840 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0fdecce9-8602-457d-8eec-c97b359170dd" containerName="glance-httpd" Mar 16 17:01:20 crc kubenswrapper[5120]: I0316 17:01:20.943849 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="0fdecce9-8602-457d-8eec-c97b359170dd" containerName="glance-httpd" Mar 16 17:01:20 crc kubenswrapper[5120]: I0316 17:01:20.943870 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0fdecce9-8602-457d-8eec-c97b359170dd" containerName="glance-log" Mar 16 17:01:20 crc kubenswrapper[5120]: I0316 17:01:20.943877 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="0fdecce9-8602-457d-8eec-c97b359170dd" containerName="glance-log" Mar 16 17:01:20 crc kubenswrapper[5120]: I0316 17:01:20.943921 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25abef41-bfd4-4436-a8c8-262247bd936f" containerName="glance-httpd" Mar 16 17:01:20 crc kubenswrapper[5120]: I0316 17:01:20.943930 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="25abef41-bfd4-4436-a8c8-262247bd936f" containerName="glance-httpd" Mar 16 17:01:20 crc kubenswrapper[5120]: I0316 17:01:20.944174 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="0fdecce9-8602-457d-8eec-c97b359170dd" containerName="glance-httpd" Mar 16 17:01:20 crc kubenswrapper[5120]: I0316 17:01:20.944195 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="25abef41-bfd4-4436-a8c8-262247bd936f" containerName="glance-httpd" Mar 16 17:01:20 crc kubenswrapper[5120]: I0316 17:01:20.944209 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="0fdecce9-8602-457d-8eec-c97b359170dd" containerName="glance-log" Mar 16 17:01:20 crc kubenswrapper[5120]: I0316 17:01:20.944232 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="25abef41-bfd4-4436-a8c8-262247bd936f" containerName="glance-log" Mar 16 17:01:20 crc kubenswrapper[5120]: I0316 17:01:20.944558 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podStartSLOduration=3.944538685 podStartE2EDuration="3.944538685s" podCreationTimestamp="2026-03-16 17:01:17 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:01:20.909374613 +0000 UTC m=+5383.063306270" watchObservedRunningTime="2026-03-16 17:01:20.944538685 +0000 UTC m=+5383.098470342" Mar 16 17:01:20 crc kubenswrapper[5120]: I0316 17:01:20.953875 5120 scope.go:117] "RemoveContainer" containerID="22bc321bf8bdaa4bae524c0d33ca3b1bfd1b617debabd58a58a512ee9428af0a" Mar 16 17:01:20 crc kubenswrapper[5120]: I0316 17:01:20.962789 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:01:20 crc kubenswrapper[5120]: I0316 17:01:20.967259 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-glance-dockercfg-tgms4\"" Mar 16 17:01:20 crc kubenswrapper[5120]: I0316 17:01:20.967514 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-internal-config-data\"" Mar 16 17:01:20 crc kubenswrapper[5120]: I0316 17:01:20.967736 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-internal-svc\"" Mar 16 17:01:20 crc kubenswrapper[5120]: I0316 17:01:20.967899 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-scripts\"" Mar 16 17:01:20 crc kubenswrapper[5120]: I0316 17:01:20.973648 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 17:01:20 crc kubenswrapper[5120]: I0316 17:01:20.985606 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 17:01:21 crc kubenswrapper[5120]: I0316 17:01:21.009058 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 17:01:21 crc kubenswrapper[5120]: I0316 17:01:21.021380 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 17:01:21 crc kubenswrapper[5120]: I0316 17:01:21.030165 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:01:21 crc kubenswrapper[5120]: I0316 17:01:21.033020 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-external-config-data\"" Mar 16 17:01:21 crc kubenswrapper[5120]: I0316 17:01:21.034071 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-public-svc\"" Mar 16 17:01:21 crc kubenswrapper[5120]: I0316 17:01:21.035091 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 17:01:21 crc kubenswrapper[5120]: I0316 17:01:21.035901 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c88b7d39-fb86-490a-8af1-a6754dab05c9-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"c88b7d39-fb86-490a-8af1-a6754dab05c9\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:01:21 crc kubenswrapper[5120]: I0316 17:01:21.035976 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c88b7d39-fb86-490a-8af1-a6754dab05c9-config-data\") pod \"glance-default-internal-api-0\" (UID: \"c88b7d39-fb86-490a-8af1-a6754dab05c9\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:01:21 crc kubenswrapper[5120]: I0316 17:01:21.036019 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/c88b7d39-fb86-490a-8af1-a6754dab05c9-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"c88b7d39-fb86-490a-8af1-a6754dab05c9\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:01:21 crc kubenswrapper[5120]: I0316 17:01:21.036184 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"glance-default-internal-api-0\" (UID: \"c88b7d39-fb86-490a-8af1-a6754dab05c9\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:01:21 crc kubenswrapper[5120]: I0316 17:01:21.036296 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xp9kr\" (UniqueName: \"kubernetes.io/projected/c88b7d39-fb86-490a-8af1-a6754dab05c9-kube-api-access-xp9kr\") pod \"glance-default-internal-api-0\" (UID: \"c88b7d39-fb86-490a-8af1-a6754dab05c9\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:01:21 crc kubenswrapper[5120]: I0316 17:01:21.036418 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c88b7d39-fb86-490a-8af1-a6754dab05c9-scripts\") pod \"glance-default-internal-api-0\" (UID: \"c88b7d39-fb86-490a-8af1-a6754dab05c9\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:01:21 crc kubenswrapper[5120]: I0316 17:01:21.036626 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/c88b7d39-fb86-490a-8af1-a6754dab05c9-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"c88b7d39-fb86-490a-8af1-a6754dab05c9\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:01:21 crc kubenswrapper[5120]: I0316 17:01:21.037131 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c88b7d39-fb86-490a-8af1-a6754dab05c9-logs\") pod \"glance-default-internal-api-0\" (UID: \"c88b7d39-fb86-490a-8af1-a6754dab05c9\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:01:21 crc kubenswrapper[5120]: I0316 17:01:21.056694 5120 scope.go:117] "RemoveContainer" containerID="5b50d4fd103f75c5ada5a2c6b1fe2f90bcd8e23a45024888035f4ee0b82396a6" Mar 16 17:01:21 crc kubenswrapper[5120]: I0316 17:01:21.141918 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/4740a262-b05d-4d08-a797-022ca51bbf69-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"4740a262-b05d-4d08-a797-022ca51bbf69\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:01:21 crc kubenswrapper[5120]: I0316 17:01:21.141991 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4740a262-b05d-4d08-a797-022ca51bbf69-config-data\") pod \"glance-default-external-api-0\" (UID: \"4740a262-b05d-4d08-a797-022ca51bbf69\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:01:21 crc kubenswrapper[5120]: I0316 17:01:21.142071 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/4740a262-b05d-4d08-a797-022ca51bbf69-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"4740a262-b05d-4d08-a797-022ca51bbf69\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:01:21 crc kubenswrapper[5120]: I0316 17:01:21.142144 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c88b7d39-fb86-490a-8af1-a6754dab05c9-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"c88b7d39-fb86-490a-8af1-a6754dab05c9\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:01:21 crc kubenswrapper[5120]: I0316 17:01:21.142172 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4740a262-b05d-4d08-a797-022ca51bbf69-scripts\") pod \"glance-default-external-api-0\" (UID: \"4740a262-b05d-4d08-a797-022ca51bbf69\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:01:21 crc kubenswrapper[5120]: I0316 17:01:21.142295 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c88b7d39-fb86-490a-8af1-a6754dab05c9-config-data\") pod \"glance-default-internal-api-0\" (UID: \"c88b7d39-fb86-490a-8af1-a6754dab05c9\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:01:21 crc kubenswrapper[5120]: I0316 17:01:21.142398 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/c88b7d39-fb86-490a-8af1-a6754dab05c9-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"c88b7d39-fb86-490a-8af1-a6754dab05c9\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:01:21 crc kubenswrapper[5120]: I0316 17:01:21.142576 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4740a262-b05d-4d08-a797-022ca51bbf69-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"4740a262-b05d-4d08-a797-022ca51bbf69\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:01:21 crc kubenswrapper[5120]: I0316 17:01:21.142704 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"glance-default-internal-api-0\" (UID: \"c88b7d39-fb86-490a-8af1-a6754dab05c9\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:01:21 crc kubenswrapper[5120]: I0316 17:01:21.142884 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xp9kr\" (UniqueName: \"kubernetes.io/projected/c88b7d39-fb86-490a-8af1-a6754dab05c9-kube-api-access-xp9kr\") pod \"glance-default-internal-api-0\" (UID: \"c88b7d39-fb86-490a-8af1-a6754dab05c9\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:01:21 crc kubenswrapper[5120]: I0316 17:01:21.142971 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bm76f\" (UniqueName: \"kubernetes.io/projected/4740a262-b05d-4d08-a797-022ca51bbf69-kube-api-access-bm76f\") pod \"glance-default-external-api-0\" (UID: \"4740a262-b05d-4d08-a797-022ca51bbf69\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:01:21 crc kubenswrapper[5120]: I0316 17:01:21.143146 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c88b7d39-fb86-490a-8af1-a6754dab05c9-scripts\") pod \"glance-default-internal-api-0\" (UID: \"c88b7d39-fb86-490a-8af1-a6754dab05c9\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:01:21 crc kubenswrapper[5120]: I0316 17:01:21.143372 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/c88b7d39-fb86-490a-8af1-a6754dab05c9-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"c88b7d39-fb86-490a-8af1-a6754dab05c9\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:01:21 crc kubenswrapper[5120]: I0316 17:01:21.143749 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4740a262-b05d-4d08-a797-022ca51bbf69-logs\") pod \"glance-default-external-api-0\" (UID: \"4740a262-b05d-4d08-a797-022ca51bbf69\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:01:21 crc kubenswrapper[5120]: I0316 17:01:21.143823 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"glance-default-external-api-0\" (UID: \"4740a262-b05d-4d08-a797-022ca51bbf69\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:01:21 crc kubenswrapper[5120]: I0316 17:01:21.143924 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c88b7d39-fb86-490a-8af1-a6754dab05c9-logs\") pod \"glance-default-internal-api-0\" (UID: \"c88b7d39-fb86-490a-8af1-a6754dab05c9\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:01:21 crc kubenswrapper[5120]: I0316 17:01:21.144577 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c88b7d39-fb86-490a-8af1-a6754dab05c9-logs\") pod \"glance-default-internal-api-0\" (UID: \"c88b7d39-fb86-490a-8af1-a6754dab05c9\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:01:21 crc kubenswrapper[5120]: I0316 17:01:21.146238 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/c88b7d39-fb86-490a-8af1-a6754dab05c9-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"c88b7d39-fb86-490a-8af1-a6754dab05c9\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:01:21 crc kubenswrapper[5120]: I0316 17:01:21.146781 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"glance-default-internal-api-0\" (UID: \"c88b7d39-fb86-490a-8af1-a6754dab05c9\") device mount path \"/mnt/openstack/pv06\"" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:01:21 crc kubenswrapper[5120]: I0316 17:01:21.148921 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c88b7d39-fb86-490a-8af1-a6754dab05c9-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"c88b7d39-fb86-490a-8af1-a6754dab05c9\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:01:21 crc kubenswrapper[5120]: I0316 17:01:21.151402 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/c88b7d39-fb86-490a-8af1-a6754dab05c9-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"c88b7d39-fb86-490a-8af1-a6754dab05c9\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:01:21 crc kubenswrapper[5120]: I0316 17:01:21.157048 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c88b7d39-fb86-490a-8af1-a6754dab05c9-config-data\") pod \"glance-default-internal-api-0\" (UID: \"c88b7d39-fb86-490a-8af1-a6754dab05c9\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:01:21 crc kubenswrapper[5120]: I0316 17:01:21.167504 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c88b7d39-fb86-490a-8af1-a6754dab05c9-scripts\") pod \"glance-default-internal-api-0\" (UID: \"c88b7d39-fb86-490a-8af1-a6754dab05c9\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:01:21 crc kubenswrapper[5120]: I0316 17:01:21.170433 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xp9kr\" (UniqueName: \"kubernetes.io/projected/c88b7d39-fb86-490a-8af1-a6754dab05c9-kube-api-access-xp9kr\") pod \"glance-default-internal-api-0\" (UID: \"c88b7d39-fb86-490a-8af1-a6754dab05c9\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:01:21 crc kubenswrapper[5120]: I0316 17:01:21.249640 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4740a262-b05d-4d08-a797-022ca51bbf69-logs\") pod \"glance-default-external-api-0\" (UID: \"4740a262-b05d-4d08-a797-022ca51bbf69\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:01:21 crc kubenswrapper[5120]: I0316 17:01:21.249689 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"glance-default-external-api-0\" (UID: \"4740a262-b05d-4d08-a797-022ca51bbf69\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:01:21 crc kubenswrapper[5120]: I0316 17:01:21.249903 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/4740a262-b05d-4d08-a797-022ca51bbf69-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"4740a262-b05d-4d08-a797-022ca51bbf69\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:01:21 crc kubenswrapper[5120]: I0316 17:01:21.250030 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4740a262-b05d-4d08-a797-022ca51bbf69-config-data\") pod \"glance-default-external-api-0\" (UID: \"4740a262-b05d-4d08-a797-022ca51bbf69\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:01:21 crc kubenswrapper[5120]: I0316 17:01:21.250043 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"glance-default-external-api-0\" (UID: \"4740a262-b05d-4d08-a797-022ca51bbf69\") device mount path \"/mnt/openstack/pv05\"" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:01:21 crc kubenswrapper[5120]: I0316 17:01:21.250068 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/4740a262-b05d-4d08-a797-022ca51bbf69-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"4740a262-b05d-4d08-a797-022ca51bbf69\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:01:21 crc kubenswrapper[5120]: I0316 17:01:21.250172 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4740a262-b05d-4d08-a797-022ca51bbf69-scripts\") pod \"glance-default-external-api-0\" (UID: \"4740a262-b05d-4d08-a797-022ca51bbf69\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:01:21 crc kubenswrapper[5120]: I0316 17:01:21.250341 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4740a262-b05d-4d08-a797-022ca51bbf69-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"4740a262-b05d-4d08-a797-022ca51bbf69\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:01:21 crc kubenswrapper[5120]: I0316 17:01:21.250571 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bm76f\" (UniqueName: \"kubernetes.io/projected/4740a262-b05d-4d08-a797-022ca51bbf69-kube-api-access-bm76f\") pod \"glance-default-external-api-0\" (UID: \"4740a262-b05d-4d08-a797-022ca51bbf69\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:01:21 crc kubenswrapper[5120]: I0316 17:01:21.252112 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4740a262-b05d-4d08-a797-022ca51bbf69-logs\") pod \"glance-default-external-api-0\" (UID: \"4740a262-b05d-4d08-a797-022ca51bbf69\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:01:21 crc kubenswrapper[5120]: I0316 17:01:21.253542 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/4740a262-b05d-4d08-a797-022ca51bbf69-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"4740a262-b05d-4d08-a797-022ca51bbf69\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:01:21 crc kubenswrapper[5120]: I0316 17:01:21.260512 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/4740a262-b05d-4d08-a797-022ca51bbf69-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"4740a262-b05d-4d08-a797-022ca51bbf69\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:01:21 crc kubenswrapper[5120]: I0316 17:01:21.260547 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"glance-default-internal-api-0\" (UID: \"c88b7d39-fb86-490a-8af1-a6754dab05c9\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:01:21 crc kubenswrapper[5120]: I0316 17:01:21.269052 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4740a262-b05d-4d08-a797-022ca51bbf69-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"4740a262-b05d-4d08-a797-022ca51bbf69\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:01:21 crc kubenswrapper[5120]: I0316 17:01:21.288521 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bm76f\" (UniqueName: \"kubernetes.io/projected/4740a262-b05d-4d08-a797-022ca51bbf69-kube-api-access-bm76f\") pod \"glance-default-external-api-0\" (UID: \"4740a262-b05d-4d08-a797-022ca51bbf69\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:01:21 crc kubenswrapper[5120]: I0316 17:01:21.291545 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4740a262-b05d-4d08-a797-022ca51bbf69-scripts\") pod \"glance-default-external-api-0\" (UID: \"4740a262-b05d-4d08-a797-022ca51bbf69\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:01:21 crc kubenswrapper[5120]: I0316 17:01:21.309242 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:01:21 crc kubenswrapper[5120]: I0316 17:01:21.310890 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4740a262-b05d-4d08-a797-022ca51bbf69-config-data\") pod \"glance-default-external-api-0\" (UID: \"4740a262-b05d-4d08-a797-022ca51bbf69\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:01:21 crc kubenswrapper[5120]: I0316 17:01:21.397052 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"glance-default-external-api-0\" (UID: \"4740a262-b05d-4d08-a797-022ca51bbf69\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:01:21 crc kubenswrapper[5120]: I0316 17:01:21.659718 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:01:21 crc kubenswrapper[5120]: I0316 17:01:21.887002 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 17:01:21 crc kubenswrapper[5120]: I0316 17:01:21.913586 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"69b6e961-8899-43be-9468-f199ead48923","Type":"ContainerStarted","Data":"57556380d05903b43150f0e1e88520977812335ca43baadcc20d6683fa6e3719"} Mar 16 17:01:21 crc kubenswrapper[5120]: I0316 17:01:21.922859 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"662e5dd1-e157-4e76-bb3d-f4310c982cb0","Type":"ContainerStarted","Data":"0e683e08d610b917770dfb8f5571d3b014df83f34754cc5c199e9efb9e29f138"} Mar 16 17:01:21 crc kubenswrapper[5120]: I0316 17:01:21.924288 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:01:21 crc kubenswrapper[5120]: I0316 17:01:21.929996 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"c88b7d39-fb86-490a-8af1-a6754dab05c9","Type":"ContainerStarted","Data":"cfd5f53f62d27fa4536977ee824f357e6f1c2aef6dbf581978011aa7aa1d60d0"} Mar 16 17:01:21 crc kubenswrapper[5120]: I0316 17:01:21.958924 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-api-0" podStartSLOduration=4.958900016 podStartE2EDuration="4.958900016s" podCreationTimestamp="2026-03-16 17:01:17 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:01:21.953167078 +0000 UTC m=+5384.107098735" watchObservedRunningTime="2026-03-16 17:01:21.958900016 +0000 UTC m=+5384.112831673" Mar 16 17:01:22 crc kubenswrapper[5120]: I0316 17:01:22.178537 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 17:01:22 crc kubenswrapper[5120]: I0316 17:01:22.683377 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0fdecce9-8602-457d-8eec-c97b359170dd" path="/var/lib/kubelet/pods/0fdecce9-8602-457d-8eec-c97b359170dd/volumes" Mar 16 17:01:22 crc kubenswrapper[5120]: I0316 17:01:22.684795 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="25abef41-bfd4-4436-a8c8-262247bd936f" path="/var/lib/kubelet/pods/25abef41-bfd4-4436-a8c8-262247bd936f/volumes" Mar 16 17:01:22 crc kubenswrapper[5120]: I0316 17:01:22.946310 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"69b6e961-8899-43be-9468-f199ead48923","Type":"ContainerStarted","Data":"c17e595386e6cd004c6bbf435772e0ccd0cd9e669df527a13857627c18505efe"} Mar 16 17:01:22 crc kubenswrapper[5120]: I0316 17:01:22.951200 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"4740a262-b05d-4d08-a797-022ca51bbf69","Type":"ContainerStarted","Data":"79198da16bd44572c679a58e4b972b3d27d1ad847d8cbe3073cd16c945182fb4"} Mar 16 17:01:22 crc kubenswrapper[5120]: I0316 17:01:22.954786 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"c88b7d39-fb86-490a-8af1-a6754dab05c9","Type":"ContainerStarted","Data":"23d89b9bddaab11d38e25c71f65ba18b27c7ad795dc47cea8da353083a2f58a6"} Mar 16 17:01:23 crc kubenswrapper[5120]: I0316 17:01:23.328267 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:01:23 crc kubenswrapper[5120]: I0316 17:01:23.908664 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:01:23 crc kubenswrapper[5120]: I0316 17:01:23.909032 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:01:23 crc kubenswrapper[5120]: I0316 17:01:23.968069 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"c88b7d39-fb86-490a-8af1-a6754dab05c9","Type":"ContainerStarted","Data":"c9d647c877cad46f80f83f0a8eec094f4e3b21c9820b23c8345a5a7561869a78"} Mar 16 17:01:23 crc kubenswrapper[5120]: I0316 17:01:23.970330 5120 generic.go:358] "Generic (PLEG): container finished" podID="d226072d-5d81-4c83-ade7-29bdc1df4c80" containerID="c41c6f68efc98a8a4f6e9bff4c63fcf3d9030c34f38836de8419c856a555595e" exitCode=1 Mar 16 17:01:23 crc kubenswrapper[5120]: I0316 17:01:23.970361 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"d226072d-5d81-4c83-ade7-29bdc1df4c80","Type":"ContainerDied","Data":"c41c6f68efc98a8a4f6e9bff4c63fcf3d9030c34f38836de8419c856a555595e"} Mar 16 17:01:23 crc kubenswrapper[5120]: I0316 17:01:23.970733 5120 scope.go:117] "RemoveContainer" containerID="c41c6f68efc98a8a4f6e9bff4c63fcf3d9030c34f38836de8419c856a555595e" Mar 16 17:01:23 crc kubenswrapper[5120]: I0316 17:01:23.978461 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"4740a262-b05d-4d08-a797-022ca51bbf69","Type":"ContainerStarted","Data":"a45c73e43a2af1fbab31a5e550d8f195e79c3fb48fa21fde2f0110195187fb5d"} Mar 16 17:01:23 crc kubenswrapper[5120]: I0316 17:01:23.978494 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"4740a262-b05d-4d08-a797-022ca51bbf69","Type":"ContainerStarted","Data":"7e14ea4540badd71cef4ac605d56c49684315345c8bdeeda628c416b54c1cea9"} Mar 16 17:01:24 crc kubenswrapper[5120]: I0316 17:01:24.006567 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-internal-api-0" podStartSLOduration=4.006549873 podStartE2EDuration="4.006549873s" podCreationTimestamp="2026-03-16 17:01:20 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:01:23.994369186 +0000 UTC m=+5386.148300863" watchObservedRunningTime="2026-03-16 17:01:24.006549873 +0000 UTC m=+5386.160481530" Mar 16 17:01:24 crc kubenswrapper[5120]: I0316 17:01:24.028882 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:01:24 crc kubenswrapper[5120]: I0316 17:01:24.065944 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-external-api-0" podStartSLOduration=4.065920193 podStartE2EDuration="4.065920193s" podCreationTimestamp="2026-03-16 17:01:20 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:01:24.025191428 +0000 UTC m=+5386.179123105" watchObservedRunningTime="2026-03-16 17:01:24.065920193 +0000 UTC m=+5386.219851850" Mar 16 17:01:24 crc kubenswrapper[5120]: I0316 17:01:24.136835 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:01:24 crc kubenswrapper[5120]: I0316 17:01:24.816994 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7f699f9655-znk2w" Mar 16 17:01:24 crc kubenswrapper[5120]: I0316 17:01:24.873137 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-58df95f9c7-sclzx"] Mar 16 17:01:24 crc kubenswrapper[5120]: I0316 17:01:24.873510 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58df95f9c7-sclzx" podUID="dc73e417-3a3e-4cda-9a94-b927abd6ca0d" containerName="dnsmasq-dns" containerID="cri-o://aabeb580e30961c2013c280e0704642ac871d74a031bfb5816b71ac9a86e572a" gracePeriod=10 Mar 16 17:01:24 crc kubenswrapper[5120]: I0316 17:01:24.992959 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"d226072d-5d81-4c83-ade7-29bdc1df4c80","Type":"ContainerStarted","Data":"89900d39fc204199e02d273a2bdfeaa13e11867682159dc0559a62567d877070"} Mar 16 17:01:24 crc kubenswrapper[5120]: I0316 17:01:24.996504 5120 generic.go:358] "Generic (PLEG): container finished" podID="2f4dc4ed-a579-46e8-a338-b310c55029d1" containerID="3d77304db468843668a74a6d34dd20b0deb2b697641fa4c425dbcfb15a0b20fd" exitCode=0 Mar 16 17:01:24 crc kubenswrapper[5120]: I0316 17:01:24.996803 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-cron-29561341-nzw57" event={"ID":"2f4dc4ed-a579-46e8-a338-b310c55029d1","Type":"ContainerDied","Data":"3d77304db468843668a74a6d34dd20b0deb2b697641fa4c425dbcfb15a0b20fd"} Mar 16 17:01:25 crc kubenswrapper[5120]: I0316 17:01:25.574639 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58df95f9c7-sclzx" Mar 16 17:01:25 crc kubenswrapper[5120]: E0316 17:01:25.617515 5120 fsHandler.go:119] failed to collect filesystem stats - rootDiskErr: , extraDiskErr: could not stat "/var/log/pods/openstack-kuttl-tests_neutron-6f846b8bfd-w69px_e3143a49-62b5-408a-8dca-d723f7a31619/neutron-api/0.log" to get inode usage: stat /var/log/pods/openstack-kuttl-tests_neutron-6f846b8bfd-w69px_e3143a49-62b5-408a-8dca-d723f7a31619/neutron-api/0.log: no such file or directory Mar 16 17:01:25 crc kubenswrapper[5120]: I0316 17:01:25.746822 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/dc73e417-3a3e-4cda-9a94-b927abd6ca0d-dnsmasq-svc\") pod \"dc73e417-3a3e-4cda-9a94-b927abd6ca0d\" (UID: \"dc73e417-3a3e-4cda-9a94-b927abd6ca0d\") " Mar 16 17:01:25 crc kubenswrapper[5120]: I0316 17:01:25.747267 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/dc73e417-3a3e-4cda-9a94-b927abd6ca0d-config\") pod \"dc73e417-3a3e-4cda-9a94-b927abd6ca0d\" (UID: \"dc73e417-3a3e-4cda-9a94-b927abd6ca0d\") " Mar 16 17:01:25 crc kubenswrapper[5120]: I0316 17:01:25.747691 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/dc73e417-3a3e-4cda-9a94-b927abd6ca0d-dns-swift-storage-0\") pod \"dc73e417-3a3e-4cda-9a94-b927abd6ca0d\" (UID: \"dc73e417-3a3e-4cda-9a94-b927abd6ca0d\") " Mar 16 17:01:25 crc kubenswrapper[5120]: I0316 17:01:25.747801 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nqbdz\" (UniqueName: \"kubernetes.io/projected/dc73e417-3a3e-4cda-9a94-b927abd6ca0d-kube-api-access-nqbdz\") pod \"dc73e417-3a3e-4cda-9a94-b927abd6ca0d\" (UID: \"dc73e417-3a3e-4cda-9a94-b927abd6ca0d\") " Mar 16 17:01:25 crc kubenswrapper[5120]: I0316 17:01:25.759671 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc73e417-3a3e-4cda-9a94-b927abd6ca0d-kube-api-access-nqbdz" (OuterVolumeSpecName: "kube-api-access-nqbdz") pod "dc73e417-3a3e-4cda-9a94-b927abd6ca0d" (UID: "dc73e417-3a3e-4cda-9a94-b927abd6ca0d"). InnerVolumeSpecName "kube-api-access-nqbdz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:01:25 crc kubenswrapper[5120]: I0316 17:01:25.803307 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc73e417-3a3e-4cda-9a94-b927abd6ca0d-config" (OuterVolumeSpecName: "config") pod "dc73e417-3a3e-4cda-9a94-b927abd6ca0d" (UID: "dc73e417-3a3e-4cda-9a94-b927abd6ca0d"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:01:25 crc kubenswrapper[5120]: I0316 17:01:25.807956 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc73e417-3a3e-4cda-9a94-b927abd6ca0d-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "dc73e417-3a3e-4cda-9a94-b927abd6ca0d" (UID: "dc73e417-3a3e-4cda-9a94-b927abd6ca0d"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:01:25 crc kubenswrapper[5120]: I0316 17:01:25.816042 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc73e417-3a3e-4cda-9a94-b927abd6ca0d-dns-swift-storage-0" (OuterVolumeSpecName: "dns-swift-storage-0") pod "dc73e417-3a3e-4cda-9a94-b927abd6ca0d" (UID: "dc73e417-3a3e-4cda-9a94-b927abd6ca0d"). InnerVolumeSpecName "dns-swift-storage-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:01:25 crc kubenswrapper[5120]: I0316 17:01:25.851567 5120 reconciler_common.go:299] "Volume detached for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/dc73e417-3a3e-4cda-9a94-b927abd6ca0d-dns-swift-storage-0\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:25 crc kubenswrapper[5120]: I0316 17:01:25.851604 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nqbdz\" (UniqueName: \"kubernetes.io/projected/dc73e417-3a3e-4cda-9a94-b927abd6ca0d-kube-api-access-nqbdz\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:25 crc kubenswrapper[5120]: I0316 17:01:25.851615 5120 reconciler_common.go:299] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/dc73e417-3a3e-4cda-9a94-b927abd6ca0d-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:25 crc kubenswrapper[5120]: I0316 17:01:25.851623 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/dc73e417-3a3e-4cda-9a94-b927abd6ca0d-config\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:26 crc kubenswrapper[5120]: I0316 17:01:26.010672 5120 generic.go:358] "Generic (PLEG): container finished" podID="dc73e417-3a3e-4cda-9a94-b927abd6ca0d" containerID="aabeb580e30961c2013c280e0704642ac871d74a031bfb5816b71ac9a86e572a" exitCode=0 Mar 16 17:01:26 crc kubenswrapper[5120]: I0316 17:01:26.010857 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58df95f9c7-sclzx" Mar 16 17:01:26 crc kubenswrapper[5120]: I0316 17:01:26.011994 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58df95f9c7-sclzx" event={"ID":"dc73e417-3a3e-4cda-9a94-b927abd6ca0d","Type":"ContainerDied","Data":"aabeb580e30961c2013c280e0704642ac871d74a031bfb5816b71ac9a86e572a"} Mar 16 17:01:26 crc kubenswrapper[5120]: I0316 17:01:26.012136 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58df95f9c7-sclzx" event={"ID":"dc73e417-3a3e-4cda-9a94-b927abd6ca0d","Type":"ContainerDied","Data":"af38ee8bb5b5aa6a332753340c94cb3180fdc2f443daa029e19898c3b02a1d72"} Mar 16 17:01:26 crc kubenswrapper[5120]: I0316 17:01:26.012210 5120 scope.go:117] "RemoveContainer" containerID="aabeb580e30961c2013c280e0704642ac871d74a031bfb5816b71ac9a86e572a" Mar 16 17:01:26 crc kubenswrapper[5120]: I0316 17:01:26.015255 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"69b6e961-8899-43be-9468-f199ead48923","Type":"ContainerStarted","Data":"411e747261cb35828375d792c96d9f9de79dfcd10463b5a6675aa950a091814d"} Mar 16 17:01:26 crc kubenswrapper[5120]: I0316 17:01:26.015413 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:01:26 crc kubenswrapper[5120]: I0316 17:01:26.079231 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.918639964 podStartE2EDuration="9.07921083s" podCreationTimestamp="2026-03-16 17:01:17 +0000 UTC" firstStartedPulling="2026-03-16 17:01:19.20647612 +0000 UTC m=+5381.360407777" lastFinishedPulling="2026-03-16 17:01:25.367046986 +0000 UTC m=+5387.520978643" observedRunningTime="2026-03-16 17:01:26.044320406 +0000 UTC m=+5388.198252083" watchObservedRunningTime="2026-03-16 17:01:26.07921083 +0000 UTC m=+5388.233142487" Mar 16 17:01:26 crc kubenswrapper[5120]: I0316 17:01:26.079895 5120 scope.go:117] "RemoveContainer" containerID="8ff51b8401bc2fb8dec6c6ed8f87ef0bbe339528463a2c823569c3dd0996f08e" Mar 16 17:01:26 crc kubenswrapper[5120]: I0316 17:01:26.104312 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-58df95f9c7-sclzx"] Mar 16 17:01:26 crc kubenswrapper[5120]: I0316 17:01:26.105964 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-8579c6748-8wfdq" podUID="6f3cdac2-9246-455c-b05a-347b4db60b7f" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.1.83:9311/healthcheck\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Mar 16 17:01:26 crc kubenswrapper[5120]: I0316 17:01:26.105981 5120 scope.go:117] "RemoveContainer" containerID="aabeb580e30961c2013c280e0704642ac871d74a031bfb5816b71ac9a86e572a" Mar 16 17:01:26 crc kubenswrapper[5120]: E0316 17:01:26.110070 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aabeb580e30961c2013c280e0704642ac871d74a031bfb5816b71ac9a86e572a\": container with ID starting with aabeb580e30961c2013c280e0704642ac871d74a031bfb5816b71ac9a86e572a not found: ID does not exist" containerID="aabeb580e30961c2013c280e0704642ac871d74a031bfb5816b71ac9a86e572a" Mar 16 17:01:26 crc kubenswrapper[5120]: I0316 17:01:26.110150 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aabeb580e30961c2013c280e0704642ac871d74a031bfb5816b71ac9a86e572a"} err="failed to get container status \"aabeb580e30961c2013c280e0704642ac871d74a031bfb5816b71ac9a86e572a\": rpc error: code = NotFound desc = could not find container \"aabeb580e30961c2013c280e0704642ac871d74a031bfb5816b71ac9a86e572a\": container with ID starting with aabeb580e30961c2013c280e0704642ac871d74a031bfb5816b71ac9a86e572a not found: ID does not exist" Mar 16 17:01:26 crc kubenswrapper[5120]: I0316 17:01:26.110199 5120 scope.go:117] "RemoveContainer" containerID="8ff51b8401bc2fb8dec6c6ed8f87ef0bbe339528463a2c823569c3dd0996f08e" Mar 16 17:01:26 crc kubenswrapper[5120]: E0316 17:01:26.110749 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ff51b8401bc2fb8dec6c6ed8f87ef0bbe339528463a2c823569c3dd0996f08e\": container with ID starting with 8ff51b8401bc2fb8dec6c6ed8f87ef0bbe339528463a2c823569c3dd0996f08e not found: ID does not exist" containerID="8ff51b8401bc2fb8dec6c6ed8f87ef0bbe339528463a2c823569c3dd0996f08e" Mar 16 17:01:26 crc kubenswrapper[5120]: I0316 17:01:26.110844 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ff51b8401bc2fb8dec6c6ed8f87ef0bbe339528463a2c823569c3dd0996f08e"} err="failed to get container status \"8ff51b8401bc2fb8dec6c6ed8f87ef0bbe339528463a2c823569c3dd0996f08e\": rpc error: code = NotFound desc = could not find container \"8ff51b8401bc2fb8dec6c6ed8f87ef0bbe339528463a2c823569c3dd0996f08e\": container with ID starting with 8ff51b8401bc2fb8dec6c6ed8f87ef0bbe339528463a2c823569c3dd0996f08e not found: ID does not exist" Mar 16 17:01:26 crc kubenswrapper[5120]: I0316 17:01:26.116444 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-58df95f9c7-sclzx"] Mar 16 17:01:26 crc kubenswrapper[5120]: I0316 17:01:26.435734 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-cron-29561341-nzw57" Mar 16 17:01:26 crc kubenswrapper[5120]: I0316 17:01:26.573085 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2f4dc4ed-a579-46e8-a338-b310c55029d1-combined-ca-bundle\") pod \"2f4dc4ed-a579-46e8-a338-b310c55029d1\" (UID: \"2f4dc4ed-a579-46e8-a338-b310c55029d1\") " Mar 16 17:01:26 crc kubenswrapper[5120]: I0316 17:01:26.573324 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cvvn5\" (UniqueName: \"kubernetes.io/projected/2f4dc4ed-a579-46e8-a338-b310c55029d1-kube-api-access-cvvn5\") pod \"2f4dc4ed-a579-46e8-a338-b310c55029d1\" (UID: \"2f4dc4ed-a579-46e8-a338-b310c55029d1\") " Mar 16 17:01:26 crc kubenswrapper[5120]: I0316 17:01:26.573374 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/2f4dc4ed-a579-46e8-a338-b310c55029d1-fernet-keys\") pod \"2f4dc4ed-a579-46e8-a338-b310c55029d1\" (UID: \"2f4dc4ed-a579-46e8-a338-b310c55029d1\") " Mar 16 17:01:26 crc kubenswrapper[5120]: I0316 17:01:26.573402 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2f4dc4ed-a579-46e8-a338-b310c55029d1-config-data\") pod \"2f4dc4ed-a579-46e8-a338-b310c55029d1\" (UID: \"2f4dc4ed-a579-46e8-a338-b310c55029d1\") " Mar 16 17:01:26 crc kubenswrapper[5120]: I0316 17:01:26.577711 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2f4dc4ed-a579-46e8-a338-b310c55029d1-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "2f4dc4ed-a579-46e8-a338-b310c55029d1" (UID: "2f4dc4ed-a579-46e8-a338-b310c55029d1"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:01:26 crc kubenswrapper[5120]: I0316 17:01:26.578028 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f4dc4ed-a579-46e8-a338-b310c55029d1-kube-api-access-cvvn5" (OuterVolumeSpecName: "kube-api-access-cvvn5") pod "2f4dc4ed-a579-46e8-a338-b310c55029d1" (UID: "2f4dc4ed-a579-46e8-a338-b310c55029d1"). InnerVolumeSpecName "kube-api-access-cvvn5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:01:26 crc kubenswrapper[5120]: I0316 17:01:26.601096 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2f4dc4ed-a579-46e8-a338-b310c55029d1-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "2f4dc4ed-a579-46e8-a338-b310c55029d1" (UID: "2f4dc4ed-a579-46e8-a338-b310c55029d1"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:01:26 crc kubenswrapper[5120]: I0316 17:01:26.634857 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2f4dc4ed-a579-46e8-a338-b310c55029d1-config-data" (OuterVolumeSpecName: "config-data") pod "2f4dc4ed-a579-46e8-a338-b310c55029d1" (UID: "2f4dc4ed-a579-46e8-a338-b310c55029d1"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:01:26 crc kubenswrapper[5120]: I0316 17:01:26.676973 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc73e417-3a3e-4cda-9a94-b927abd6ca0d" path="/var/lib/kubelet/pods/dc73e417-3a3e-4cda-9a94-b927abd6ca0d/volumes" Mar 16 17:01:26 crc kubenswrapper[5120]: I0316 17:01:26.677964 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2f4dc4ed-a579-46e8-a338-b310c55029d1-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:26 crc kubenswrapper[5120]: I0316 17:01:26.678005 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cvvn5\" (UniqueName: \"kubernetes.io/projected/2f4dc4ed-a579-46e8-a338-b310c55029d1-kube-api-access-cvvn5\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:26 crc kubenswrapper[5120]: I0316 17:01:26.678021 5120 reconciler_common.go:299] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/2f4dc4ed-a579-46e8-a338-b310c55029d1-fernet-keys\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:26 crc kubenswrapper[5120]: I0316 17:01:26.678032 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2f4dc4ed-a579-46e8-a338-b310c55029d1-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:26 crc kubenswrapper[5120]: I0316 17:01:26.748714 5120 pod_container_manager_linux.go:217] "Failed to delete cgroup paths" cgroupName=["kubepods","besteffort","pode956ba16-b745-4928-b574-a942ab68fd58"] err="unable to destroy cgroup paths for cgroup [kubepods besteffort pode956ba16-b745-4928-b574-a942ab68fd58] : Timed out while waiting for systemd to remove kubepods-besteffort-pode956ba16_b745_4928_b574_a942ab68fd58.slice" Mar 16 17:01:27 crc kubenswrapper[5120]: I0316 17:01:27.029965 5120 generic.go:358] "Generic (PLEG): container finished" podID="d226072d-5d81-4c83-ade7-29bdc1df4c80" containerID="89900d39fc204199e02d273a2bdfeaa13e11867682159dc0559a62567d877070" exitCode=1 Mar 16 17:01:27 crc kubenswrapper[5120]: I0316 17:01:27.030064 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"d226072d-5d81-4c83-ade7-29bdc1df4c80","Type":"ContainerDied","Data":"89900d39fc204199e02d273a2bdfeaa13e11867682159dc0559a62567d877070"} Mar 16 17:01:27 crc kubenswrapper[5120]: I0316 17:01:27.030132 5120 scope.go:117] "RemoveContainer" containerID="c41c6f68efc98a8a4f6e9bff4c63fcf3d9030c34f38836de8419c856a555595e" Mar 16 17:01:27 crc kubenswrapper[5120]: I0316 17:01:27.030660 5120 scope.go:117] "RemoveContainer" containerID="89900d39fc204199e02d273a2bdfeaa13e11867682159dc0559a62567d877070" Mar 16 17:01:27 crc kubenswrapper[5120]: E0316 17:01:27.031150 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nova-scheduler-scheduler\" with CrashLoopBackOff: \"back-off 10s restarting failed container=nova-scheduler-scheduler pod=nova-scheduler-0_openstack-kuttl-tests(d226072d-5d81-4c83-ade7-29bdc1df4c80)\"" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="d226072d-5d81-4c83-ade7-29bdc1df4c80" Mar 16 17:01:27 crc kubenswrapper[5120]: I0316 17:01:27.034075 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-cron-29561341-nzw57" Mar 16 17:01:27 crc kubenswrapper[5120]: I0316 17:01:27.034106 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-cron-29561341-nzw57" event={"ID":"2f4dc4ed-a579-46e8-a338-b310c55029d1","Type":"ContainerDied","Data":"298d443f7e1949ef45aec3128dceecd2cf865f7cf06d850f48e3f9490aae83af"} Mar 16 17:01:27 crc kubenswrapper[5120]: I0316 17:01:27.036601 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="298d443f7e1949ef45aec3128dceecd2cf865f7cf06d850f48e3f9490aae83af" Mar 16 17:01:27 crc kubenswrapper[5120]: E0316 17:01:27.382688 5120 fsHandler.go:119] failed to collect filesystem stats - rootDiskErr: could not stat "/var/lib/containers/storage/overlay/74025bd21ab544c8582ff7b1e7b4b04fe761ce35651018317837889659bb5a43/diff" to get inode usage: stat /var/lib/containers/storage/overlay/74025bd21ab544c8582ff7b1e7b4b04fe761ce35651018317837889659bb5a43/diff: no such file or directory, extraDiskErr: Mar 16 17:01:27 crc kubenswrapper[5120]: I0316 17:01:27.508793 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-8579c6748-8wfdq" podUID="6f3cdac2-9246-455c-b05a-347b4db60b7f" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.1.83:9311/healthcheck\": context deadline exceeded" Mar 16 17:01:27 crc kubenswrapper[5120]: I0316 17:01:27.525389 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:01:27 crc kubenswrapper[5120]: I0316 17:01:27.525440 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:01:27 crc kubenswrapper[5120]: I0316 17:01:27.525482 5120 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:01:27 crc kubenswrapper[5120]: I0316 17:01:27.664157 5120 scope.go:117] "RemoveContainer" containerID="4e560143184389f153e8d0bbabf214261dca57a2f28afd54a6443f7d11775ee9" Mar 16 17:01:27 crc kubenswrapper[5120]: E0316 17:01:27.664490 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nova-cell1-conductor-conductor\" with CrashLoopBackOff: \"back-off 20s restarting failed container=nova-cell1-conductor-conductor pod=nova-cell1-conductor-0_openstack-kuttl-tests(61d14db6-7d33-4e5f-8252-844441e519d7)\"" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="61d14db6-7d33-4e5f-8252-844441e519d7" Mar 16 17:01:27 crc kubenswrapper[5120]: I0316 17:01:27.768309 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:01:28 crc kubenswrapper[5120]: I0316 17:01:28.060200 5120 scope.go:117] "RemoveContainer" containerID="89900d39fc204199e02d273a2bdfeaa13e11867682159dc0559a62567d877070" Mar 16 17:01:28 crc kubenswrapper[5120]: E0316 17:01:28.060644 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nova-scheduler-scheduler\" with CrashLoopBackOff: \"back-off 10s restarting failed container=nova-scheduler-scheduler pod=nova-scheduler-0_openstack-kuttl-tests(d226072d-5d81-4c83-ade7-29bdc1df4c80)\"" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="d226072d-5d81-4c83-ade7-29bdc1df4c80" Mar 16 17:01:28 crc kubenswrapper[5120]: E0316 17:01:28.289088 5120 fsHandler.go:119] failed to collect filesystem stats - rootDiskErr: could not stat "/var/lib/containers/storage/overlay/21e155236b4e03e0b3e2f3e31c28a0f583b25d458f9d555aedcf63f0fb010183/diff" to get inode usage: stat /var/lib/containers/storage/overlay/21e155236b4e03e0b3e2f3e31c28a0f583b25d458f9d555aedcf63f0fb010183/diff: no such file or directory, extraDiskErr: could not stat "/var/log/pods/openstack-kuttl-tests_placement-5b9b97df74-9rl5z_9c429916-2d70-42f0-a572-90ab8aafafbe/placement-api/0.log" to get inode usage: stat /var/log/pods/openstack-kuttl-tests_placement-5b9b97df74-9rl5z_9c429916-2d70-42f0-a572-90ab8aafafbe/placement-api/0.log: no such file or directory Mar 16 17:01:28 crc kubenswrapper[5120]: I0316 17:01:28.328192 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:01:28 crc kubenswrapper[5120]: I0316 17:01:28.354034 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:01:28 crc kubenswrapper[5120]: I0316 17:01:28.584255 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-8579c6748-8wfdq" podUID="6f3cdac2-9246-455c-b05a-347b4db60b7f" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.1.83:9311/healthcheck\": read tcp 10.217.0.2:43622->10.217.1.83:9311: read: connection reset by peer" Mar 16 17:01:28 crc kubenswrapper[5120]: I0316 17:01:28.584255 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-8579c6748-8wfdq" podUID="6f3cdac2-9246-455c-b05a-347b4db60b7f" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.1.83:9311/healthcheck\": read tcp 10.217.0.2:43628->10.217.1.83:9311: read: connection reset by peer" Mar 16 17:01:29 crc kubenswrapper[5120]: I0316 17:01:29.083351 5120 generic.go:358] "Generic (PLEG): container finished" podID="6f3cdac2-9246-455c-b05a-347b4db60b7f" containerID="a42992bd1d9cad8a2c4750ffb36344cddb046a7e90453c31912c59e31473304d" exitCode=0 Mar 16 17:01:29 crc kubenswrapper[5120]: I0316 17:01:29.083431 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-8579c6748-8wfdq" event={"ID":"6f3cdac2-9246-455c-b05a-347b4db60b7f","Type":"ContainerDied","Data":"a42992bd1d9cad8a2c4750ffb36344cddb046a7e90453c31912c59e31473304d"} Mar 16 17:01:29 crc kubenswrapper[5120]: I0316 17:01:29.083474 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-8579c6748-8wfdq" event={"ID":"6f3cdac2-9246-455c-b05a-347b4db60b7f","Type":"ContainerDied","Data":"4963e870a7941975a5ebfdb82b7de24ce3c15dd67e1a939a43d4fd784d3166b2"} Mar 16 17:01:29 crc kubenswrapper[5120]: I0316 17:01:29.083487 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4963e870a7941975a5ebfdb82b7de24ce3c15dd67e1a939a43d4fd784d3166b2" Mar 16 17:01:29 crc kubenswrapper[5120]: I0316 17:01:29.090727 5120 generic.go:358] "Generic (PLEG): container finished" podID="ce24ae83-459d-4410-bd4d-fb7e0fcad044" containerID="5c01207e6b7eaba66695795238027c1a25f25604d6e9fbe8b8369eab265fb078" exitCode=0 Mar 16 17:01:29 crc kubenswrapper[5120]: I0316 17:01:29.090822 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"ce24ae83-459d-4410-bd4d-fb7e0fcad044","Type":"ContainerDied","Data":"5c01207e6b7eaba66695795238027c1a25f25604d6e9fbe8b8369eab265fb078"} Mar 16 17:01:29 crc kubenswrapper[5120]: I0316 17:01:29.099326 5120 generic.go:358] "Generic (PLEG): container finished" podID="0d641338-e35d-4819-b487-513c8840cfd7" containerID="913817c69070d4510b8042762cb63e057b4a8046effc6659ca14ddf12d68af77" exitCode=0 Mar 16 17:01:29 crc kubenswrapper[5120]: I0316 17:01:29.100055 5120 scope.go:117] "RemoveContainer" containerID="89900d39fc204199e02d273a2bdfeaa13e11867682159dc0559a62567d877070" Mar 16 17:01:29 crc kubenswrapper[5120]: E0316 17:01:29.100354 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nova-scheduler-scheduler\" with CrashLoopBackOff: \"back-off 10s restarting failed container=nova-scheduler-scheduler pod=nova-scheduler-0_openstack-kuttl-tests(d226072d-5d81-4c83-ade7-29bdc1df4c80)\"" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="d226072d-5d81-4c83-ade7-29bdc1df4c80" Mar 16 17:01:29 crc kubenswrapper[5120]: I0316 17:01:29.100454 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"0d641338-e35d-4819-b487-513c8840cfd7","Type":"ContainerDied","Data":"913817c69070d4510b8042762cb63e057b4a8046effc6659ca14ddf12d68af77"} Mar 16 17:01:29 crc kubenswrapper[5120]: I0316 17:01:29.123629 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:01:29 crc kubenswrapper[5120]: I0316 17:01:29.274612 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-8579c6748-8wfdq" Mar 16 17:01:29 crc kubenswrapper[5120]: I0316 17:01:29.363251 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6f3cdac2-9246-455c-b05a-347b4db60b7f-combined-ca-bundle\") pod \"6f3cdac2-9246-455c-b05a-347b4db60b7f\" (UID: \"6f3cdac2-9246-455c-b05a-347b4db60b7f\") " Mar 16 17:01:29 crc kubenswrapper[5120]: I0316 17:01:29.363354 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/6f3cdac2-9246-455c-b05a-347b4db60b7f-config-data-custom\") pod \"6f3cdac2-9246-455c-b05a-347b4db60b7f\" (UID: \"6f3cdac2-9246-455c-b05a-347b4db60b7f\") " Mar 16 17:01:29 crc kubenswrapper[5120]: I0316 17:01:29.363547 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vdlhf\" (UniqueName: \"kubernetes.io/projected/6f3cdac2-9246-455c-b05a-347b4db60b7f-kube-api-access-vdlhf\") pod \"6f3cdac2-9246-455c-b05a-347b4db60b7f\" (UID: \"6f3cdac2-9246-455c-b05a-347b4db60b7f\") " Mar 16 17:01:29 crc kubenswrapper[5120]: I0316 17:01:29.363629 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6f3cdac2-9246-455c-b05a-347b4db60b7f-logs\") pod \"6f3cdac2-9246-455c-b05a-347b4db60b7f\" (UID: \"6f3cdac2-9246-455c-b05a-347b4db60b7f\") " Mar 16 17:01:29 crc kubenswrapper[5120]: I0316 17:01:29.363808 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6f3cdac2-9246-455c-b05a-347b4db60b7f-internal-tls-certs\") pod \"6f3cdac2-9246-455c-b05a-347b4db60b7f\" (UID: \"6f3cdac2-9246-455c-b05a-347b4db60b7f\") " Mar 16 17:01:29 crc kubenswrapper[5120]: I0316 17:01:29.364003 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6f3cdac2-9246-455c-b05a-347b4db60b7f-config-data\") pod \"6f3cdac2-9246-455c-b05a-347b4db60b7f\" (UID: \"6f3cdac2-9246-455c-b05a-347b4db60b7f\") " Mar 16 17:01:29 crc kubenswrapper[5120]: I0316 17:01:29.364465 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6f3cdac2-9246-455c-b05a-347b4db60b7f-public-tls-certs\") pod \"6f3cdac2-9246-455c-b05a-347b4db60b7f\" (UID: \"6f3cdac2-9246-455c-b05a-347b4db60b7f\") " Mar 16 17:01:29 crc kubenswrapper[5120]: I0316 17:01:29.373220 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f3cdac2-9246-455c-b05a-347b4db60b7f-kube-api-access-vdlhf" (OuterVolumeSpecName: "kube-api-access-vdlhf") pod "6f3cdac2-9246-455c-b05a-347b4db60b7f" (UID: "6f3cdac2-9246-455c-b05a-347b4db60b7f"). InnerVolumeSpecName "kube-api-access-vdlhf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:01:29 crc kubenswrapper[5120]: I0316 17:01:29.378185 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f3cdac2-9246-455c-b05a-347b4db60b7f-logs" (OuterVolumeSpecName: "logs") pod "6f3cdac2-9246-455c-b05a-347b4db60b7f" (UID: "6f3cdac2-9246-455c-b05a-347b4db60b7f"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:01:29 crc kubenswrapper[5120]: I0316 17:01:29.428143 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f3cdac2-9246-455c-b05a-347b4db60b7f-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "6f3cdac2-9246-455c-b05a-347b4db60b7f" (UID: "6f3cdac2-9246-455c-b05a-347b4db60b7f"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:01:29 crc kubenswrapper[5120]: I0316 17:01:29.430677 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f3cdac2-9246-455c-b05a-347b4db60b7f-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "6f3cdac2-9246-455c-b05a-347b4db60b7f" (UID: "6f3cdac2-9246-455c-b05a-347b4db60b7f"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:01:29 crc kubenswrapper[5120]: I0316 17:01:29.463126 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f3cdac2-9246-455c-b05a-347b4db60b7f-config-data" (OuterVolumeSpecName: "config-data") pod "6f3cdac2-9246-455c-b05a-347b4db60b7f" (UID: "6f3cdac2-9246-455c-b05a-347b4db60b7f"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:01:29 crc kubenswrapper[5120]: I0316 17:01:29.470961 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6f3cdac2-9246-455c-b05a-347b4db60b7f-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:29 crc kubenswrapper[5120]: I0316 17:01:29.471004 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/6f3cdac2-9246-455c-b05a-347b4db60b7f-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:29 crc kubenswrapper[5120]: I0316 17:01:29.471017 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vdlhf\" (UniqueName: \"kubernetes.io/projected/6f3cdac2-9246-455c-b05a-347b4db60b7f-kube-api-access-vdlhf\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:29 crc kubenswrapper[5120]: I0316 17:01:29.471030 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6f3cdac2-9246-455c-b05a-347b4db60b7f-logs\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:29 crc kubenswrapper[5120]: I0316 17:01:29.471043 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6f3cdac2-9246-455c-b05a-347b4db60b7f-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:29 crc kubenswrapper[5120]: I0316 17:01:29.472173 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f3cdac2-9246-455c-b05a-347b4db60b7f-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "6f3cdac2-9246-455c-b05a-347b4db60b7f" (UID: "6f3cdac2-9246-455c-b05a-347b4db60b7f"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:01:29 crc kubenswrapper[5120]: I0316 17:01:29.481551 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:01:29 crc kubenswrapper[5120]: I0316 17:01:29.490114 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f3cdac2-9246-455c-b05a-347b4db60b7f-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "6f3cdac2-9246-455c-b05a-347b4db60b7f" (UID: "6f3cdac2-9246-455c-b05a-347b4db60b7f"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:01:29 crc kubenswrapper[5120]: I0316 17:01:29.572568 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ce24ae83-459d-4410-bd4d-fb7e0fcad044-config-data\") pod \"ce24ae83-459d-4410-bd4d-fb7e0fcad044\" (UID: \"ce24ae83-459d-4410-bd4d-fb7e0fcad044\") " Mar 16 17:01:29 crc kubenswrapper[5120]: I0316 17:01:29.572696 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v8twx\" (UniqueName: \"kubernetes.io/projected/ce24ae83-459d-4410-bd4d-fb7e0fcad044-kube-api-access-v8twx\") pod \"ce24ae83-459d-4410-bd4d-fb7e0fcad044\" (UID: \"ce24ae83-459d-4410-bd4d-fb7e0fcad044\") " Mar 16 17:01:29 crc kubenswrapper[5120]: I0316 17:01:29.573060 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ce24ae83-459d-4410-bd4d-fb7e0fcad044-logs\") pod \"ce24ae83-459d-4410-bd4d-fb7e0fcad044\" (UID: \"ce24ae83-459d-4410-bd4d-fb7e0fcad044\") " Mar 16 17:01:29 crc kubenswrapper[5120]: I0316 17:01:29.573177 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ce24ae83-459d-4410-bd4d-fb7e0fcad044-combined-ca-bundle\") pod \"ce24ae83-459d-4410-bd4d-fb7e0fcad044\" (UID: \"ce24ae83-459d-4410-bd4d-fb7e0fcad044\") " Mar 16 17:01:29 crc kubenswrapper[5120]: I0316 17:01:29.573422 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/ce24ae83-459d-4410-bd4d-fb7e0fcad044-nova-metadata-tls-certs\") pod \"ce24ae83-459d-4410-bd4d-fb7e0fcad044\" (UID: \"ce24ae83-459d-4410-bd4d-fb7e0fcad044\") " Mar 16 17:01:29 crc kubenswrapper[5120]: I0316 17:01:29.574146 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce24ae83-459d-4410-bd4d-fb7e0fcad044-logs" (OuterVolumeSpecName: "logs") pod "ce24ae83-459d-4410-bd4d-fb7e0fcad044" (UID: "ce24ae83-459d-4410-bd4d-fb7e0fcad044"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:01:29 crc kubenswrapper[5120]: I0316 17:01:29.574475 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6f3cdac2-9246-455c-b05a-347b4db60b7f-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:29 crc kubenswrapper[5120]: I0316 17:01:29.574572 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ce24ae83-459d-4410-bd4d-fb7e0fcad044-logs\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:29 crc kubenswrapper[5120]: I0316 17:01:29.574638 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6f3cdac2-9246-455c-b05a-347b4db60b7f-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:29 crc kubenswrapper[5120]: I0316 17:01:29.577940 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce24ae83-459d-4410-bd4d-fb7e0fcad044-kube-api-access-v8twx" (OuterVolumeSpecName: "kube-api-access-v8twx") pod "ce24ae83-459d-4410-bd4d-fb7e0fcad044" (UID: "ce24ae83-459d-4410-bd4d-fb7e0fcad044"). InnerVolumeSpecName "kube-api-access-v8twx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:01:29 crc kubenswrapper[5120]: I0316 17:01:29.601824 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:01:29 crc kubenswrapper[5120]: I0316 17:01:29.602307 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce24ae83-459d-4410-bd4d-fb7e0fcad044-config-data" (OuterVolumeSpecName: "config-data") pod "ce24ae83-459d-4410-bd4d-fb7e0fcad044" (UID: "ce24ae83-459d-4410-bd4d-fb7e0fcad044"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:01:29 crc kubenswrapper[5120]: I0316 17:01:29.610854 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce24ae83-459d-4410-bd4d-fb7e0fcad044-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ce24ae83-459d-4410-bd4d-fb7e0fcad044" (UID: "ce24ae83-459d-4410-bd4d-fb7e0fcad044"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:01:29 crc kubenswrapper[5120]: I0316 17:01:29.634860 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce24ae83-459d-4410-bd4d-fb7e0fcad044-nova-metadata-tls-certs" (OuterVolumeSpecName: "nova-metadata-tls-certs") pod "ce24ae83-459d-4410-bd4d-fb7e0fcad044" (UID: "ce24ae83-459d-4410-bd4d-fb7e0fcad044"). InnerVolumeSpecName "nova-metadata-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:01:29 crc kubenswrapper[5120]: I0316 17:01:29.675899 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0d641338-e35d-4819-b487-513c8840cfd7-config-data\") pod \"0d641338-e35d-4819-b487-513c8840cfd7\" (UID: \"0d641338-e35d-4819-b487-513c8840cfd7\") " Mar 16 17:01:29 crc kubenswrapper[5120]: I0316 17:01:29.676045 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/0d641338-e35d-4819-b487-513c8840cfd7-internal-tls-certs\") pod \"0d641338-e35d-4819-b487-513c8840cfd7\" (UID: \"0d641338-e35d-4819-b487-513c8840cfd7\") " Mar 16 17:01:29 crc kubenswrapper[5120]: I0316 17:01:29.676099 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-prnjd\" (UniqueName: \"kubernetes.io/projected/0d641338-e35d-4819-b487-513c8840cfd7-kube-api-access-prnjd\") pod \"0d641338-e35d-4819-b487-513c8840cfd7\" (UID: \"0d641338-e35d-4819-b487-513c8840cfd7\") " Mar 16 17:01:29 crc kubenswrapper[5120]: I0316 17:01:29.676320 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0d641338-e35d-4819-b487-513c8840cfd7-combined-ca-bundle\") pod \"0d641338-e35d-4819-b487-513c8840cfd7\" (UID: \"0d641338-e35d-4819-b487-513c8840cfd7\") " Mar 16 17:01:29 crc kubenswrapper[5120]: I0316 17:01:29.676526 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/0d641338-e35d-4819-b487-513c8840cfd7-public-tls-certs\") pod \"0d641338-e35d-4819-b487-513c8840cfd7\" (UID: \"0d641338-e35d-4819-b487-513c8840cfd7\") " Mar 16 17:01:29 crc kubenswrapper[5120]: I0316 17:01:29.676650 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0d641338-e35d-4819-b487-513c8840cfd7-logs\") pod \"0d641338-e35d-4819-b487-513c8840cfd7\" (UID: \"0d641338-e35d-4819-b487-513c8840cfd7\") " Mar 16 17:01:29 crc kubenswrapper[5120]: I0316 17:01:29.677280 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ce24ae83-459d-4410-bd4d-fb7e0fcad044-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:29 crc kubenswrapper[5120]: I0316 17:01:29.677297 5120 reconciler_common.go:299] "Volume detached for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/ce24ae83-459d-4410-bd4d-fb7e0fcad044-nova-metadata-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:29 crc kubenswrapper[5120]: I0316 17:01:29.677307 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ce24ae83-459d-4410-bd4d-fb7e0fcad044-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:29 crc kubenswrapper[5120]: I0316 17:01:29.677317 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v8twx\" (UniqueName: \"kubernetes.io/projected/ce24ae83-459d-4410-bd4d-fb7e0fcad044-kube-api-access-v8twx\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:29 crc kubenswrapper[5120]: I0316 17:01:29.677847 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d641338-e35d-4819-b487-513c8840cfd7-logs" (OuterVolumeSpecName: "logs") pod "0d641338-e35d-4819-b487-513c8840cfd7" (UID: "0d641338-e35d-4819-b487-513c8840cfd7"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:01:29 crc kubenswrapper[5120]: I0316 17:01:29.683219 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d641338-e35d-4819-b487-513c8840cfd7-kube-api-access-prnjd" (OuterVolumeSpecName: "kube-api-access-prnjd") pod "0d641338-e35d-4819-b487-513c8840cfd7" (UID: "0d641338-e35d-4819-b487-513c8840cfd7"). InnerVolumeSpecName "kube-api-access-prnjd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:01:29 crc kubenswrapper[5120]: I0316 17:01:29.711026 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0d641338-e35d-4819-b487-513c8840cfd7-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "0d641338-e35d-4819-b487-513c8840cfd7" (UID: "0d641338-e35d-4819-b487-513c8840cfd7"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:01:29 crc kubenswrapper[5120]: I0316 17:01:29.716544 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0d641338-e35d-4819-b487-513c8840cfd7-config-data" (OuterVolumeSpecName: "config-data") pod "0d641338-e35d-4819-b487-513c8840cfd7" (UID: "0d641338-e35d-4819-b487-513c8840cfd7"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:01:29 crc kubenswrapper[5120]: I0316 17:01:29.741236 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0d641338-e35d-4819-b487-513c8840cfd7-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "0d641338-e35d-4819-b487-513c8840cfd7" (UID: "0d641338-e35d-4819-b487-513c8840cfd7"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:01:29 crc kubenswrapper[5120]: I0316 17:01:29.765104 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0d641338-e35d-4819-b487-513c8840cfd7-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "0d641338-e35d-4819-b487-513c8840cfd7" (UID: "0d641338-e35d-4819-b487-513c8840cfd7"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:01:29 crc kubenswrapper[5120]: I0316 17:01:29.780683 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0d641338-e35d-4819-b487-513c8840cfd7-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:29 crc kubenswrapper[5120]: I0316 17:01:29.780731 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/0d641338-e35d-4819-b487-513c8840cfd7-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:29 crc kubenswrapper[5120]: I0316 17:01:29.780742 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-prnjd\" (UniqueName: \"kubernetes.io/projected/0d641338-e35d-4819-b487-513c8840cfd7-kube-api-access-prnjd\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:29 crc kubenswrapper[5120]: I0316 17:01:29.780754 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0d641338-e35d-4819-b487-513c8840cfd7-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:29 crc kubenswrapper[5120]: I0316 17:01:29.780789 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/0d641338-e35d-4819-b487-513c8840cfd7-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:29 crc kubenswrapper[5120]: I0316 17:01:29.780799 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0d641338-e35d-4819-b487-513c8840cfd7-logs\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:30 crc kubenswrapper[5120]: I0316 17:01:30.113358 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"ce24ae83-459d-4410-bd4d-fb7e0fcad044","Type":"ContainerDied","Data":"9f6462e34d47e34bdbb58d3565d44332f8aa04c8077e624308c782f5315a20a3"} Mar 16 17:01:30 crc kubenswrapper[5120]: I0316 17:01:30.113633 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:01:30 crc kubenswrapper[5120]: I0316 17:01:30.113660 5120 scope.go:117] "RemoveContainer" containerID="5c01207e6b7eaba66695795238027c1a25f25604d6e9fbe8b8369eab265fb078" Mar 16 17:01:30 crc kubenswrapper[5120]: I0316 17:01:30.123848 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:01:30 crc kubenswrapper[5120]: I0316 17:01:30.123880 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"0d641338-e35d-4819-b487-513c8840cfd7","Type":"ContainerDied","Data":"4e2017038e0954cf71d3f9f12158d6292545cbe721edaeea72585563aa770bfb"} Mar 16 17:01:30 crc kubenswrapper[5120]: I0316 17:01:30.124458 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-8579c6748-8wfdq" Mar 16 17:01:30 crc kubenswrapper[5120]: I0316 17:01:30.167473 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 17:01:30 crc kubenswrapper[5120]: I0316 17:01:30.167694 5120 scope.go:117] "RemoveContainer" containerID="0a576c9c3f46dcb5e38a65bf5cfa9aefd0b0e74f1b4d9b5916785ecf2b6d9ee0" Mar 16 17:01:30 crc kubenswrapper[5120]: I0316 17:01:30.184326 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 17:01:30 crc kubenswrapper[5120]: I0316 17:01:30.190925 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 17:01:30 crc kubenswrapper[5120]: I0316 17:01:30.203471 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 17:01:30 crc kubenswrapper[5120]: I0316 17:01:30.204701 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce24ae83-459d-4410-bd4d-fb7e0fcad044" containerName="nova-metadata-log" Mar 16 17:01:30 crc kubenswrapper[5120]: I0316 17:01:30.204726 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce24ae83-459d-4410-bd4d-fb7e0fcad044" containerName="nova-metadata-log" Mar 16 17:01:30 crc kubenswrapper[5120]: I0316 17:01:30.204746 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d641338-e35d-4819-b487-513c8840cfd7" containerName="nova-api-api" Mar 16 17:01:30 crc kubenswrapper[5120]: I0316 17:01:30.204753 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d641338-e35d-4819-b487-513c8840cfd7" containerName="nova-api-api" Mar 16 17:01:30 crc kubenswrapper[5120]: I0316 17:01:30.204795 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce24ae83-459d-4410-bd4d-fb7e0fcad044" containerName="nova-metadata-metadata" Mar 16 17:01:30 crc kubenswrapper[5120]: I0316 17:01:30.204803 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce24ae83-459d-4410-bd4d-fb7e0fcad044" containerName="nova-metadata-metadata" Mar 16 17:01:30 crc kubenswrapper[5120]: I0316 17:01:30.204839 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d641338-e35d-4819-b487-513c8840cfd7" containerName="nova-api-log" Mar 16 17:01:30 crc kubenswrapper[5120]: I0316 17:01:30.204847 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d641338-e35d-4819-b487-513c8840cfd7" containerName="nova-api-log" Mar 16 17:01:30 crc kubenswrapper[5120]: I0316 17:01:30.204858 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f4dc4ed-a579-46e8-a338-b310c55029d1" containerName="keystone-cron" Mar 16 17:01:30 crc kubenswrapper[5120]: I0316 17:01:30.204865 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f4dc4ed-a579-46e8-a338-b310c55029d1" containerName="keystone-cron" Mar 16 17:01:30 crc kubenswrapper[5120]: I0316 17:01:30.204888 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc73e417-3a3e-4cda-9a94-b927abd6ca0d" containerName="init" Mar 16 17:01:30 crc kubenswrapper[5120]: I0316 17:01:30.204895 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc73e417-3a3e-4cda-9a94-b927abd6ca0d" containerName="init" Mar 16 17:01:30 crc kubenswrapper[5120]: I0316 17:01:30.204910 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f3cdac2-9246-455c-b05a-347b4db60b7f" containerName="barbican-api-log" Mar 16 17:01:30 crc kubenswrapper[5120]: I0316 17:01:30.204916 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f3cdac2-9246-455c-b05a-347b4db60b7f" containerName="barbican-api-log" Mar 16 17:01:30 crc kubenswrapper[5120]: I0316 17:01:30.204925 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc73e417-3a3e-4cda-9a94-b927abd6ca0d" containerName="dnsmasq-dns" Mar 16 17:01:30 crc kubenswrapper[5120]: I0316 17:01:30.204931 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc73e417-3a3e-4cda-9a94-b927abd6ca0d" containerName="dnsmasq-dns" Mar 16 17:01:30 crc kubenswrapper[5120]: I0316 17:01:30.204947 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f3cdac2-9246-455c-b05a-347b4db60b7f" containerName="barbican-api" Mar 16 17:01:30 crc kubenswrapper[5120]: I0316 17:01:30.204952 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f3cdac2-9246-455c-b05a-347b4db60b7f" containerName="barbican-api" Mar 16 17:01:30 crc kubenswrapper[5120]: I0316 17:01:30.205145 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="6f3cdac2-9246-455c-b05a-347b4db60b7f" containerName="barbican-api-log" Mar 16 17:01:30 crc kubenswrapper[5120]: I0316 17:01:30.205161 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ce24ae83-459d-4410-bd4d-fb7e0fcad044" containerName="nova-metadata-metadata" Mar 16 17:01:30 crc kubenswrapper[5120]: I0316 17:01:30.205172 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="0d641338-e35d-4819-b487-513c8840cfd7" containerName="nova-api-api" Mar 16 17:01:30 crc kubenswrapper[5120]: I0316 17:01:30.205181 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="0d641338-e35d-4819-b487-513c8840cfd7" containerName="nova-api-log" Mar 16 17:01:30 crc kubenswrapper[5120]: I0316 17:01:30.205189 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="6f3cdac2-9246-455c-b05a-347b4db60b7f" containerName="barbican-api" Mar 16 17:01:30 crc kubenswrapper[5120]: I0316 17:01:30.205203 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ce24ae83-459d-4410-bd4d-fb7e0fcad044" containerName="nova-metadata-log" Mar 16 17:01:30 crc kubenswrapper[5120]: I0316 17:01:30.205214 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="2f4dc4ed-a579-46e8-a338-b310c55029d1" containerName="keystone-cron" Mar 16 17:01:30 crc kubenswrapper[5120]: I0316 17:01:30.205222 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="dc73e417-3a3e-4cda-9a94-b927abd6ca0d" containerName="dnsmasq-dns" Mar 16 17:01:30 crc kubenswrapper[5120]: I0316 17:01:30.210940 5120 scope.go:117] "RemoveContainer" containerID="913817c69070d4510b8042762cb63e057b4a8046effc6659ca14ddf12d68af77" Mar 16 17:01:30 crc kubenswrapper[5120]: I0316 17:01:30.214697 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 17:01:30 crc kubenswrapper[5120]: I0316 17:01:30.214865 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:01:30 crc kubenswrapper[5120]: I0316 17:01:30.217034 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-metadata-config-data\"" Mar 16 17:01:30 crc kubenswrapper[5120]: I0316 17:01:30.218154 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-metadata-internal-svc\"" Mar 16 17:01:30 crc kubenswrapper[5120]: I0316 17:01:30.229832 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 17:01:30 crc kubenswrapper[5120]: I0316 17:01:30.239783 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-8579c6748-8wfdq"] Mar 16 17:01:30 crc kubenswrapper[5120]: I0316 17:01:30.265989 5120 scope.go:117] "RemoveContainer" containerID="0100259933ee5a0d60c815e0522f8958bf64827830e93951666d1ba73b88f2ad" Mar 16 17:01:30 crc kubenswrapper[5120]: I0316 17:01:30.267202 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-api-8579c6748-8wfdq"] Mar 16 17:01:30 crc kubenswrapper[5120]: I0316 17:01:30.304498 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-884lc\" (UniqueName: \"kubernetes.io/projected/5b6e7f67-ee2d-4fbc-9519-00493157aec0-kube-api-access-884lc\") pod \"nova-metadata-0\" (UID: \"5b6e7f67-ee2d-4fbc-9519-00493157aec0\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:01:30 crc kubenswrapper[5120]: I0316 17:01:30.304638 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/5b6e7f67-ee2d-4fbc-9519-00493157aec0-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"5b6e7f67-ee2d-4fbc-9519-00493157aec0\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:01:30 crc kubenswrapper[5120]: I0316 17:01:30.304900 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5b6e7f67-ee2d-4fbc-9519-00493157aec0-config-data\") pod \"nova-metadata-0\" (UID: \"5b6e7f67-ee2d-4fbc-9519-00493157aec0\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:01:30 crc kubenswrapper[5120]: I0316 17:01:30.305700 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5b6e7f67-ee2d-4fbc-9519-00493157aec0-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"5b6e7f67-ee2d-4fbc-9519-00493157aec0\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:01:30 crc kubenswrapper[5120]: I0316 17:01:30.306190 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5b6e7f67-ee2d-4fbc-9519-00493157aec0-logs\") pod \"nova-metadata-0\" (UID: \"5b6e7f67-ee2d-4fbc-9519-00493157aec0\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:01:30 crc kubenswrapper[5120]: I0316 17:01:30.314693 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 17:01:30 crc kubenswrapper[5120]: I0316 17:01:30.327072 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 17:01:30 crc kubenswrapper[5120]: I0316 17:01:30.327216 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:01:30 crc kubenswrapper[5120]: I0316 17:01:30.330285 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-config-data\"" Mar 16 17:01:30 crc kubenswrapper[5120]: I0316 17:01:30.330382 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-internal-svc\"" Mar 16 17:01:30 crc kubenswrapper[5120]: I0316 17:01:30.330398 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-public-svc\"" Mar 16 17:01:30 crc kubenswrapper[5120]: I0316 17:01:30.409341 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/5b6e7f67-ee2d-4fbc-9519-00493157aec0-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"5b6e7f67-ee2d-4fbc-9519-00493157aec0\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:01:30 crc kubenswrapper[5120]: I0316 17:01:30.409442 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/593ab600-83e5-4863-b042-4fd69af25046-public-tls-certs\") pod \"nova-api-0\" (UID: \"593ab600-83e5-4863-b042-4fd69af25046\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:01:30 crc kubenswrapper[5120]: I0316 17:01:30.409495 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5b6e7f67-ee2d-4fbc-9519-00493157aec0-config-data\") pod \"nova-metadata-0\" (UID: \"5b6e7f67-ee2d-4fbc-9519-00493157aec0\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:01:30 crc kubenswrapper[5120]: I0316 17:01:30.409654 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/593ab600-83e5-4863-b042-4fd69af25046-internal-tls-certs\") pod \"nova-api-0\" (UID: \"593ab600-83e5-4863-b042-4fd69af25046\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:01:30 crc kubenswrapper[5120]: I0316 17:01:30.409707 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/593ab600-83e5-4863-b042-4fd69af25046-config-data\") pod \"nova-api-0\" (UID: \"593ab600-83e5-4863-b042-4fd69af25046\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:01:30 crc kubenswrapper[5120]: I0316 17:01:30.409744 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9zzp\" (UniqueName: \"kubernetes.io/projected/593ab600-83e5-4863-b042-4fd69af25046-kube-api-access-f9zzp\") pod \"nova-api-0\" (UID: \"593ab600-83e5-4863-b042-4fd69af25046\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:01:30 crc kubenswrapper[5120]: I0316 17:01:30.409903 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5b6e7f67-ee2d-4fbc-9519-00493157aec0-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"5b6e7f67-ee2d-4fbc-9519-00493157aec0\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:01:30 crc kubenswrapper[5120]: I0316 17:01:30.410038 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5b6e7f67-ee2d-4fbc-9519-00493157aec0-logs\") pod \"nova-metadata-0\" (UID: \"5b6e7f67-ee2d-4fbc-9519-00493157aec0\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:01:30 crc kubenswrapper[5120]: I0316 17:01:30.410161 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/593ab600-83e5-4863-b042-4fd69af25046-logs\") pod \"nova-api-0\" (UID: \"593ab600-83e5-4863-b042-4fd69af25046\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:01:30 crc kubenswrapper[5120]: I0316 17:01:30.410213 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-884lc\" (UniqueName: \"kubernetes.io/projected/5b6e7f67-ee2d-4fbc-9519-00493157aec0-kube-api-access-884lc\") pod \"nova-metadata-0\" (UID: \"5b6e7f67-ee2d-4fbc-9519-00493157aec0\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:01:30 crc kubenswrapper[5120]: I0316 17:01:30.410257 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/593ab600-83e5-4863-b042-4fd69af25046-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"593ab600-83e5-4863-b042-4fd69af25046\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:01:30 crc kubenswrapper[5120]: I0316 17:01:30.411695 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5b6e7f67-ee2d-4fbc-9519-00493157aec0-logs\") pod \"nova-metadata-0\" (UID: \"5b6e7f67-ee2d-4fbc-9519-00493157aec0\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:01:30 crc kubenswrapper[5120]: I0316 17:01:30.416587 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/5b6e7f67-ee2d-4fbc-9519-00493157aec0-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"5b6e7f67-ee2d-4fbc-9519-00493157aec0\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:01:30 crc kubenswrapper[5120]: I0316 17:01:30.416801 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5b6e7f67-ee2d-4fbc-9519-00493157aec0-config-data\") pod \"nova-metadata-0\" (UID: \"5b6e7f67-ee2d-4fbc-9519-00493157aec0\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:01:30 crc kubenswrapper[5120]: I0316 17:01:30.417422 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5b6e7f67-ee2d-4fbc-9519-00493157aec0-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"5b6e7f67-ee2d-4fbc-9519-00493157aec0\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:01:30 crc kubenswrapper[5120]: I0316 17:01:30.429659 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-884lc\" (UniqueName: \"kubernetes.io/projected/5b6e7f67-ee2d-4fbc-9519-00493157aec0-kube-api-access-884lc\") pod \"nova-metadata-0\" (UID: \"5b6e7f67-ee2d-4fbc-9519-00493157aec0\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:01:30 crc kubenswrapper[5120]: I0316 17:01:30.512514 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/593ab600-83e5-4863-b042-4fd69af25046-config-data\") pod \"nova-api-0\" (UID: \"593ab600-83e5-4863-b042-4fd69af25046\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:01:30 crc kubenswrapper[5120]: I0316 17:01:30.512580 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f9zzp\" (UniqueName: \"kubernetes.io/projected/593ab600-83e5-4863-b042-4fd69af25046-kube-api-access-f9zzp\") pod \"nova-api-0\" (UID: \"593ab600-83e5-4863-b042-4fd69af25046\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:01:30 crc kubenswrapper[5120]: I0316 17:01:30.512848 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/593ab600-83e5-4863-b042-4fd69af25046-logs\") pod \"nova-api-0\" (UID: \"593ab600-83e5-4863-b042-4fd69af25046\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:01:30 crc kubenswrapper[5120]: I0316 17:01:30.512943 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/593ab600-83e5-4863-b042-4fd69af25046-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"593ab600-83e5-4863-b042-4fd69af25046\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:01:30 crc kubenswrapper[5120]: I0316 17:01:30.512983 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/593ab600-83e5-4863-b042-4fd69af25046-public-tls-certs\") pod \"nova-api-0\" (UID: \"593ab600-83e5-4863-b042-4fd69af25046\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:01:30 crc kubenswrapper[5120]: I0316 17:01:30.513153 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/593ab600-83e5-4863-b042-4fd69af25046-internal-tls-certs\") pod \"nova-api-0\" (UID: \"593ab600-83e5-4863-b042-4fd69af25046\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:01:30 crc kubenswrapper[5120]: I0316 17:01:30.513295 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/593ab600-83e5-4863-b042-4fd69af25046-logs\") pod \"nova-api-0\" (UID: \"593ab600-83e5-4863-b042-4fd69af25046\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:01:30 crc kubenswrapper[5120]: I0316 17:01:30.516741 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/593ab600-83e5-4863-b042-4fd69af25046-config-data\") pod \"nova-api-0\" (UID: \"593ab600-83e5-4863-b042-4fd69af25046\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:01:30 crc kubenswrapper[5120]: I0316 17:01:30.517305 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/593ab600-83e5-4863-b042-4fd69af25046-public-tls-certs\") pod \"nova-api-0\" (UID: \"593ab600-83e5-4863-b042-4fd69af25046\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:01:30 crc kubenswrapper[5120]: I0316 17:01:30.518521 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/593ab600-83e5-4863-b042-4fd69af25046-internal-tls-certs\") pod \"nova-api-0\" (UID: \"593ab600-83e5-4863-b042-4fd69af25046\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:01:30 crc kubenswrapper[5120]: I0316 17:01:30.519016 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/593ab600-83e5-4863-b042-4fd69af25046-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"593ab600-83e5-4863-b042-4fd69af25046\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:01:30 crc kubenswrapper[5120]: I0316 17:01:30.530594 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9zzp\" (UniqueName: \"kubernetes.io/projected/593ab600-83e5-4863-b042-4fd69af25046-kube-api-access-f9zzp\") pod \"nova-api-0\" (UID: \"593ab600-83e5-4863-b042-4fd69af25046\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:01:30 crc kubenswrapper[5120]: I0316 17:01:30.535948 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:01:30 crc kubenswrapper[5120]: I0316 17:01:30.654325 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:01:30 crc kubenswrapper[5120]: I0316 17:01:30.675894 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d641338-e35d-4819-b487-513c8840cfd7" path="/var/lib/kubelet/pods/0d641338-e35d-4819-b487-513c8840cfd7/volumes" Mar 16 17:01:30 crc kubenswrapper[5120]: I0316 17:01:30.676644 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f3cdac2-9246-455c-b05a-347b4db60b7f" path="/var/lib/kubelet/pods/6f3cdac2-9246-455c-b05a-347b4db60b7f/volumes" Mar 16 17:01:30 crc kubenswrapper[5120]: I0316 17:01:30.677367 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce24ae83-459d-4410-bd4d-fb7e0fcad044" path="/var/lib/kubelet/pods/ce24ae83-459d-4410-bd4d-fb7e0fcad044/volumes" Mar 16 17:01:30 crc kubenswrapper[5120]: I0316 17:01:30.884104 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/placement-7944fd944b-x8xzf" Mar 16 17:01:31 crc kubenswrapper[5120]: I0316 17:01:31.007340 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 17:01:31 crc kubenswrapper[5120]: I0316 17:01:31.143582 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:01:31 crc kubenswrapper[5120]: I0316 17:01:31.170752 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 17:01:31 crc kubenswrapper[5120]: I0316 17:01:31.198234 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"5b6e7f67-ee2d-4fbc-9519-00493157aec0","Type":"ContainerStarted","Data":"3e44555187d1310d740578a6e6107a83660cd52dd77356861aa500186fe6367d"} Mar 16 17:01:31 crc kubenswrapper[5120]: I0316 17:01:31.310500 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:01:31 crc kubenswrapper[5120]: I0316 17:01:31.310893 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:01:31 crc kubenswrapper[5120]: I0316 17:01:31.364711 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:01:31 crc kubenswrapper[5120]: I0316 17:01:31.389900 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:01:31 crc kubenswrapper[5120]: I0316 17:01:31.660961 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:01:31 crc kubenswrapper[5120]: I0316 17:01:31.662115 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:01:31 crc kubenswrapper[5120]: I0316 17:01:31.697633 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:01:31 crc kubenswrapper[5120]: I0316 17:01:31.706717 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:01:31 crc kubenswrapper[5120]: E0316 17:01:31.721899 5120 fsHandler.go:119] failed to collect filesystem stats - rootDiskErr: , extraDiskErr: could not stat "/var/log/pods/openstack-kuttl-tests_barbican-api-5b7968964b-sgwq2_e78c00c6-8a77-403d-a9f1-49d34962c3f7/barbican-api/0.log" to get inode usage: stat /var/log/pods/openstack-kuttl-tests_barbican-api-5b7968964b-sgwq2_e78c00c6-8a77-403d-a9f1-49d34962c3f7/barbican-api/0.log: no such file or directory Mar 16 17:01:31 crc kubenswrapper[5120]: I0316 17:01:31.908706 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/placement-7944fd944b-x8xzf" Mar 16 17:01:31 crc kubenswrapper[5120]: I0316 17:01:31.988607 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-6c74bfb4f8-b872h"] Mar 16 17:01:31 crc kubenswrapper[5120]: I0316 17:01:31.989066 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-6c74bfb4f8-b872h" podUID="36d5b175-81c4-4fc3-bb05-93958f9a7a63" containerName="placement-log" containerID="cri-o://832a8bcafed4ed903d1874bc594e8c2a7491491a52387cf20fe3009e35d7fe3f" gracePeriod=30 Mar 16 17:01:31 crc kubenswrapper[5120]: I0316 17:01:31.989887 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-6c74bfb4f8-b872h" podUID="36d5b175-81c4-4fc3-bb05-93958f9a7a63" containerName="placement-api" containerID="cri-o://8812397f25a9f06ef21604757ef3678aa38f877a48b96f6e0806db2574b5a4f0" gracePeriod=30 Mar 16 17:01:32 crc kubenswrapper[5120]: I0316 17:01:32.222854 5120 generic.go:358] "Generic (PLEG): container finished" podID="36d5b175-81c4-4fc3-bb05-93958f9a7a63" containerID="832a8bcafed4ed903d1874bc594e8c2a7491491a52387cf20fe3009e35d7fe3f" exitCode=143 Mar 16 17:01:32 crc kubenswrapper[5120]: I0316 17:01:32.222997 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-6c74bfb4f8-b872h" event={"ID":"36d5b175-81c4-4fc3-bb05-93958f9a7a63","Type":"ContainerDied","Data":"832a8bcafed4ed903d1874bc594e8c2a7491491a52387cf20fe3009e35d7fe3f"} Mar 16 17:01:32 crc kubenswrapper[5120]: I0316 17:01:32.226482 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"593ab600-83e5-4863-b042-4fd69af25046","Type":"ContainerStarted","Data":"8e832e7dc397e67e74670c05012d05b2a1c2dc1d15b52f9df2af956db29f56da"} Mar 16 17:01:32 crc kubenswrapper[5120]: I0316 17:01:32.226522 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"593ab600-83e5-4863-b042-4fd69af25046","Type":"ContainerStarted","Data":"9d0c721f1532054af65c6cc8928ac439588b2d9e39e78b42d253329b01689024"} Mar 16 17:01:32 crc kubenswrapper[5120]: I0316 17:01:32.226534 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"593ab600-83e5-4863-b042-4fd69af25046","Type":"ContainerStarted","Data":"a1f6687a62f885ace9e191d7911f43e8d975a4893189311c3ce8100955f06535"} Mar 16 17:01:32 crc kubenswrapper[5120]: I0316 17:01:32.240829 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"5b6e7f67-ee2d-4fbc-9519-00493157aec0","Type":"ContainerStarted","Data":"0ed9f3a2d7a1517b282f8c04f00429f887151e188250ed9748eecf16b6169afe"} Mar 16 17:01:32 crc kubenswrapper[5120]: I0316 17:01:32.240871 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"5b6e7f67-ee2d-4fbc-9519-00493157aec0","Type":"ContainerStarted","Data":"0cd4e5c12c13138cfe18452ae14adb071a83d9e94a0872236f28ec43b55bae15"} Mar 16 17:01:32 crc kubenswrapper[5120]: I0316 17:01:32.241546 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:01:32 crc kubenswrapper[5120]: I0316 17:01:32.241630 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:01:32 crc kubenswrapper[5120]: I0316 17:01:32.241668 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:01:32 crc kubenswrapper[5120]: I0316 17:01:32.241678 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:01:32 crc kubenswrapper[5120]: I0316 17:01:32.276085 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=2.27606215 podStartE2EDuration="2.27606215s" podCreationTimestamp="2026-03-16 17:01:30 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:01:32.249864346 +0000 UTC m=+5394.403796003" watchObservedRunningTime="2026-03-16 17:01:32.27606215 +0000 UTC m=+5394.429993807" Mar 16 17:01:32 crc kubenswrapper[5120]: I0316 17:01:32.316333 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=2.316313422 podStartE2EDuration="2.316313422s" podCreationTimestamp="2026-03-16 17:01:30 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:01:32.286154328 +0000 UTC m=+5394.440085985" watchObservedRunningTime="2026-03-16 17:01:32.316313422 +0000 UTC m=+5394.470245079" Mar 16 17:01:32 crc kubenswrapper[5120]: E0316 17:01:32.953627 5120 fsHandler.go:119] failed to collect filesystem stats - rootDiskErr: could not stat "/var/lib/containers/storage/overlay/17e02fa3b986bb3854a1690907f4c5464c333bdc71ffe4bc90ed710436d43487/diff" to get inode usage: stat /var/lib/containers/storage/overlay/17e02fa3b986bb3854a1690907f4c5464c333bdc71ffe4bc90ed710436d43487/diff: no such file or directory, extraDiskErr: could not stat "/var/log/pods/openstack-kuttl-tests_ovn-northd-0_a519f6d6-0bc7-43f3-9ad7-98a44f627488/ovn-northd/0.log" to get inode usage: stat /var/log/pods/openstack-kuttl-tests_ovn-northd-0_a519f6d6-0bc7-43f3-9ad7-98a44f627488/ovn-northd/0.log: no such file or directory Mar 16 17:01:33 crc kubenswrapper[5120]: E0316 17:01:33.724248 5120 fsHandler.go:119] failed to collect filesystem stats - rootDiskErr: , extraDiskErr: could not stat "/var/log/pods/openstack-kuttl-tests_ceilometer-0_30bfa4fc-b416-4f16-b673-158d4a8c552a/ceilometer-central-agent/0.log" to get inode usage: stat /var/log/pods/openstack-kuttl-tests_ceilometer-0_30bfa4fc-b416-4f16-b673-158d4a8c552a/ceilometer-central-agent/0.log: no such file or directory Mar 16 17:01:34 crc kubenswrapper[5120]: I0316 17:01:34.260213 5120 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Mar 16 17:01:34 crc kubenswrapper[5120]: I0316 17:01:34.260254 5120 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Mar 16 17:01:34 crc kubenswrapper[5120]: I0316 17:01:34.261692 5120 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Mar 16 17:01:34 crc kubenswrapper[5120]: I0316 17:01:34.261712 5120 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Mar 16 17:01:34 crc kubenswrapper[5120]: I0316 17:01:34.276480 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:01:34 crc kubenswrapper[5120]: I0316 17:01:34.339841 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:01:34 crc kubenswrapper[5120]: I0316 17:01:34.344505 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:01:34 crc kubenswrapper[5120]: I0316 17:01:34.347803 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:01:34 crc kubenswrapper[5120]: E0316 17:01:34.644636 5120 fsHandler.go:119] failed to collect filesystem stats - rootDiskErr: , extraDiskErr: could not stat "/var/log/pods/openstack-kuttl-tests_ceilometer-0_30bfa4fc-b416-4f16-b673-158d4a8c552a/ceilometer-notification-agent/0.log" to get inode usage: stat /var/log/pods/openstack-kuttl-tests_ceilometer-0_30bfa4fc-b416-4f16-b673-158d4a8c552a/ceilometer-notification-agent/0.log: no such file or directory Mar 16 17:01:35 crc kubenswrapper[5120]: I0316 17:01:35.275881 5120 generic.go:358] "Generic (PLEG): container finished" podID="36d5b175-81c4-4fc3-bb05-93958f9a7a63" containerID="8812397f25a9f06ef21604757ef3678aa38f877a48b96f6e0806db2574b5a4f0" exitCode=0 Mar 16 17:01:35 crc kubenswrapper[5120]: I0316 17:01:35.275947 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-6c74bfb4f8-b872h" event={"ID":"36d5b175-81c4-4fc3-bb05-93958f9a7a63","Type":"ContainerDied","Data":"8812397f25a9f06ef21604757ef3678aa38f877a48b96f6e0806db2574b5a4f0"} Mar 16 17:01:35 crc kubenswrapper[5120]: E0316 17:01:35.481580 5120 fsHandler.go:119] failed to collect filesystem stats - rootDiskErr: , extraDiskErr: could not stat "/var/log/pods/openstack-kuttl-tests_ceilometer-0_30bfa4fc-b416-4f16-b673-158d4a8c552a/sg-core/0.log" to get inode usage: stat /var/log/pods/openstack-kuttl-tests_ceilometer-0_30bfa4fc-b416-4f16-b673-158d4a8c552a/sg-core/0.log: no such file or directory Mar 16 17:01:35 crc kubenswrapper[5120]: I0316 17:01:35.629127 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-6c74bfb4f8-b872h" Mar 16 17:01:35 crc kubenswrapper[5120]: E0316 17:01:35.688884 5120 fsHandler.go:119] failed to collect filesystem stats - rootDiskErr: , extraDiskErr: could not stat "/var/log/pods/openstack-kuttl-tests_nova-scheduler-0_a19b5964-8116-49bd-9181-8eb2fe61703e/nova-scheduler-scheduler/0.log" to get inode usage: stat /var/log/pods/openstack-kuttl-tests_nova-scheduler-0_a19b5964-8116-49bd-9181-8eb2fe61703e/nova-scheduler-scheduler/0.log: no such file or directory Mar 16 17:01:35 crc kubenswrapper[5120]: I0316 17:01:35.803426 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/36d5b175-81c4-4fc3-bb05-93958f9a7a63-public-tls-certs\") pod \"36d5b175-81c4-4fc3-bb05-93958f9a7a63\" (UID: \"36d5b175-81c4-4fc3-bb05-93958f9a7a63\") " Mar 16 17:01:35 crc kubenswrapper[5120]: I0316 17:01:35.803524 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/36d5b175-81c4-4fc3-bb05-93958f9a7a63-config-data\") pod \"36d5b175-81c4-4fc3-bb05-93958f9a7a63\" (UID: \"36d5b175-81c4-4fc3-bb05-93958f9a7a63\") " Mar 16 17:01:35 crc kubenswrapper[5120]: I0316 17:01:35.803703 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2qn89\" (UniqueName: \"kubernetes.io/projected/36d5b175-81c4-4fc3-bb05-93958f9a7a63-kube-api-access-2qn89\") pod \"36d5b175-81c4-4fc3-bb05-93958f9a7a63\" (UID: \"36d5b175-81c4-4fc3-bb05-93958f9a7a63\") " Mar 16 17:01:35 crc kubenswrapper[5120]: I0316 17:01:35.803994 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/36d5b175-81c4-4fc3-bb05-93958f9a7a63-internal-tls-certs\") pod \"36d5b175-81c4-4fc3-bb05-93958f9a7a63\" (UID: \"36d5b175-81c4-4fc3-bb05-93958f9a7a63\") " Mar 16 17:01:35 crc kubenswrapper[5120]: I0316 17:01:35.804069 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/36d5b175-81c4-4fc3-bb05-93958f9a7a63-logs\") pod \"36d5b175-81c4-4fc3-bb05-93958f9a7a63\" (UID: \"36d5b175-81c4-4fc3-bb05-93958f9a7a63\") " Mar 16 17:01:35 crc kubenswrapper[5120]: I0316 17:01:35.804245 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/36d5b175-81c4-4fc3-bb05-93958f9a7a63-combined-ca-bundle\") pod \"36d5b175-81c4-4fc3-bb05-93958f9a7a63\" (UID: \"36d5b175-81c4-4fc3-bb05-93958f9a7a63\") " Mar 16 17:01:35 crc kubenswrapper[5120]: I0316 17:01:35.804582 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/36d5b175-81c4-4fc3-bb05-93958f9a7a63-scripts\") pod \"36d5b175-81c4-4fc3-bb05-93958f9a7a63\" (UID: \"36d5b175-81c4-4fc3-bb05-93958f9a7a63\") " Mar 16 17:01:35 crc kubenswrapper[5120]: I0316 17:01:35.804853 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36d5b175-81c4-4fc3-bb05-93958f9a7a63-logs" (OuterVolumeSpecName: "logs") pod "36d5b175-81c4-4fc3-bb05-93958f9a7a63" (UID: "36d5b175-81c4-4fc3-bb05-93958f9a7a63"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:01:35 crc kubenswrapper[5120]: I0316 17:01:35.806378 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/36d5b175-81c4-4fc3-bb05-93958f9a7a63-logs\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:35 crc kubenswrapper[5120]: I0316 17:01:35.811647 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36d5b175-81c4-4fc3-bb05-93958f9a7a63-scripts" (OuterVolumeSpecName: "scripts") pod "36d5b175-81c4-4fc3-bb05-93958f9a7a63" (UID: "36d5b175-81c4-4fc3-bb05-93958f9a7a63"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:01:35 crc kubenswrapper[5120]: I0316 17:01:35.813058 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36d5b175-81c4-4fc3-bb05-93958f9a7a63-kube-api-access-2qn89" (OuterVolumeSpecName: "kube-api-access-2qn89") pod "36d5b175-81c4-4fc3-bb05-93958f9a7a63" (UID: "36d5b175-81c4-4fc3-bb05-93958f9a7a63"). InnerVolumeSpecName "kube-api-access-2qn89". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:01:35 crc kubenswrapper[5120]: I0316 17:01:35.865702 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36d5b175-81c4-4fc3-bb05-93958f9a7a63-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "36d5b175-81c4-4fc3-bb05-93958f9a7a63" (UID: "36d5b175-81c4-4fc3-bb05-93958f9a7a63"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:01:35 crc kubenswrapper[5120]: I0316 17:01:35.872207 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36d5b175-81c4-4fc3-bb05-93958f9a7a63-config-data" (OuterVolumeSpecName: "config-data") pod "36d5b175-81c4-4fc3-bb05-93958f9a7a63" (UID: "36d5b175-81c4-4fc3-bb05-93958f9a7a63"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:01:35 crc kubenswrapper[5120]: I0316 17:01:35.909887 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2qn89\" (UniqueName: \"kubernetes.io/projected/36d5b175-81c4-4fc3-bb05-93958f9a7a63-kube-api-access-2qn89\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:35 crc kubenswrapper[5120]: I0316 17:01:35.910025 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/36d5b175-81c4-4fc3-bb05-93958f9a7a63-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:35 crc kubenswrapper[5120]: I0316 17:01:35.910057 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/36d5b175-81c4-4fc3-bb05-93958f9a7a63-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:35 crc kubenswrapper[5120]: I0316 17:01:35.910070 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/36d5b175-81c4-4fc3-bb05-93958f9a7a63-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:35 crc kubenswrapper[5120]: I0316 17:01:35.935914 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36d5b175-81c4-4fc3-bb05-93958f9a7a63-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "36d5b175-81c4-4fc3-bb05-93958f9a7a63" (UID: "36d5b175-81c4-4fc3-bb05-93958f9a7a63"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:01:35 crc kubenswrapper[5120]: I0316 17:01:35.952660 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36d5b175-81c4-4fc3-bb05-93958f9a7a63-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "36d5b175-81c4-4fc3-bb05-93958f9a7a63" (UID: "36d5b175-81c4-4fc3-bb05-93958f9a7a63"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:01:36 crc kubenswrapper[5120]: I0316 17:01:36.012188 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/36d5b175-81c4-4fc3-bb05-93958f9a7a63-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:36 crc kubenswrapper[5120]: I0316 17:01:36.012227 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/36d5b175-81c4-4fc3-bb05-93958f9a7a63-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:36 crc kubenswrapper[5120]: E0316 17:01:36.014323 5120 fsHandler.go:119] failed to collect filesystem stats - rootDiskErr: , extraDiskErr: could not stat "/var/log/pods/openstack-kuttl-tests_nova-metadata-0_e2ad712e-f6f5-4942-94b9-635bbc53da15/nova-metadata-metadata/0.log" to get inode usage: stat /var/log/pods/openstack-kuttl-tests_nova-metadata-0_e2ad712e-f6f5-4942-94b9-635bbc53da15/nova-metadata-metadata/0.log: no such file or directory Mar 16 17:01:36 crc kubenswrapper[5120]: I0316 17:01:36.289980 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-6c74bfb4f8-b872h" Mar 16 17:01:36 crc kubenswrapper[5120]: I0316 17:01:36.289973 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-6c74bfb4f8-b872h" event={"ID":"36d5b175-81c4-4fc3-bb05-93958f9a7a63","Type":"ContainerDied","Data":"71584312a0bfafefaa393d016fa22d8339471a52aa59324fcd436f69dddfdd7e"} Mar 16 17:01:36 crc kubenswrapper[5120]: I0316 17:01:36.291128 5120 scope.go:117] "RemoveContainer" containerID="8812397f25a9f06ef21604757ef3678aa38f877a48b96f6e0806db2574b5a4f0" Mar 16 17:01:36 crc kubenswrapper[5120]: I0316 17:01:36.324799 5120 scope.go:117] "RemoveContainer" containerID="832a8bcafed4ed903d1874bc594e8c2a7491491a52387cf20fe3009e35d7fe3f" Mar 16 17:01:36 crc kubenswrapper[5120]: I0316 17:01:36.337715 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-6c74bfb4f8-b872h"] Mar 16 17:01:36 crc kubenswrapper[5120]: I0316 17:01:36.347804 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-6c74bfb4f8-b872h"] Mar 16 17:01:36 crc kubenswrapper[5120]: I0316 17:01:36.676902 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="36d5b175-81c4-4fc3-bb05-93958f9a7a63" path="/var/lib/kubelet/pods/36d5b175-81c4-4fc3-bb05-93958f9a7a63/volumes" Mar 16 17:01:38 crc kubenswrapper[5120]: I0316 17:01:38.678199 5120 scope.go:117] "RemoveContainer" containerID="4e560143184389f153e8d0bbabf214261dca57a2f28afd54a6443f7d11775ee9" Mar 16 17:01:38 crc kubenswrapper[5120]: E0316 17:01:38.713162 5120 fsHandler.go:119] failed to collect filesystem stats - rootDiskErr: could not stat "/var/lib/containers/storage/overlay/ae151fd4690024d680b672683972f60a559ed6e24911b1eeb469520902e6bd0d/diff" to get inode usage: stat /var/lib/containers/storage/overlay/ae151fd4690024d680b672683972f60a559ed6e24911b1eeb469520902e6bd0d/diff: no such file or directory, extraDiskErr: Mar 16 17:01:39 crc kubenswrapper[5120]: I0316 17:01:39.322321 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"61d14db6-7d33-4e5f-8252-844441e519d7","Type":"ContainerStarted","Data":"3f4aafa32edd97a4cd6857832bfde24c5f9a3e7c30285ec0f3a7bd7c08f686da"} Mar 16 17:01:39 crc kubenswrapper[5120]: I0316 17:01:39.323881 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 17:01:40 crc kubenswrapper[5120]: I0316 17:01:40.537196 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:01:40 crc kubenswrapper[5120]: I0316 17:01:40.537746 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:01:40 crc kubenswrapper[5120]: I0316 17:01:40.656065 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:01:40 crc kubenswrapper[5120]: I0316 17:01:40.656114 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:01:41 crc kubenswrapper[5120]: I0316 17:01:41.542937 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="5b6e7f67-ee2d-4fbc-9519-00493157aec0" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"https://10.217.1.118:8775/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Mar 16 17:01:41 crc kubenswrapper[5120]: I0316 17:01:41.543045 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="5b6e7f67-ee2d-4fbc-9519-00493157aec0" containerName="nova-metadata-log" probeResult="failure" output="Get \"https://10.217.1.118:8775/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 17:01:41 crc kubenswrapper[5120]: I0316 17:01:41.663063 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="593ab600-83e5-4863-b042-4fd69af25046" containerName="nova-api-api" probeResult="failure" output="Get \"https://10.217.1.119:8774/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Mar 16 17:01:41 crc kubenswrapper[5120]: I0316 17:01:41.663817 5120 scope.go:117] "RemoveContainer" containerID="89900d39fc204199e02d273a2bdfeaa13e11867682159dc0559a62567d877070" Mar 16 17:01:41 crc kubenswrapper[5120]: I0316 17:01:41.664075 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="593ab600-83e5-4863-b042-4fd69af25046" containerName="nova-api-log" probeResult="failure" output="Get \"https://10.217.1.119:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 17:01:41 crc kubenswrapper[5120]: I0316 17:01:41.930609 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/keystone-766c6fc56d-x6dc5" Mar 16 17:01:41 crc kubenswrapper[5120]: I0316 17:01:41.999283 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-ddf666799-df45b"] Mar 16 17:01:41 crc kubenswrapper[5120]: I0316 17:01:41.999578 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/keystone-ddf666799-df45b" podUID="aa20bbc5-67eb-41b6-83f9-a6dd3e1d9754" containerName="keystone-api" containerID="cri-o://7a0d02df021e34ba46af8468db125c17a6955a8df67524d59d149786c4b8bccd" gracePeriod=30 Mar 16 17:01:42 crc kubenswrapper[5120]: I0316 17:01:42.360255 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"d226072d-5d81-4c83-ade7-29bdc1df4c80","Type":"ContainerStarted","Data":"332dae2edfbf2e0f756cde2904bec2d8bbc2240aa37e84431e89ca72362d5c89"} Mar 16 17:01:42 crc kubenswrapper[5120]: I0316 17:01:42.362858 5120 generic.go:358] "Generic (PLEG): container finished" podID="61d14db6-7d33-4e5f-8252-844441e519d7" containerID="3f4aafa32edd97a4cd6857832bfde24c5f9a3e7c30285ec0f3a7bd7c08f686da" exitCode=1 Mar 16 17:01:42 crc kubenswrapper[5120]: I0316 17:01:42.362935 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"61d14db6-7d33-4e5f-8252-844441e519d7","Type":"ContainerDied","Data":"3f4aafa32edd97a4cd6857832bfde24c5f9a3e7c30285ec0f3a7bd7c08f686da"} Mar 16 17:01:42 crc kubenswrapper[5120]: I0316 17:01:42.362993 5120 scope.go:117] "RemoveContainer" containerID="4e560143184389f153e8d0bbabf214261dca57a2f28afd54a6443f7d11775ee9" Mar 16 17:01:42 crc kubenswrapper[5120]: I0316 17:01:42.363483 5120 scope.go:117] "RemoveContainer" containerID="3f4aafa32edd97a4cd6857832bfde24c5f9a3e7c30285ec0f3a7bd7c08f686da" Mar 16 17:01:42 crc kubenswrapper[5120]: E0316 17:01:42.363923 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nova-cell1-conductor-conductor\" with CrashLoopBackOff: \"back-off 40s restarting failed container=nova-cell1-conductor-conductor pod=nova-cell1-conductor-0_openstack-kuttl-tests(61d14db6-7d33-4e5f-8252-844441e519d7)\"" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="61d14db6-7d33-4e5f-8252-844441e519d7" Mar 16 17:01:42 crc kubenswrapper[5120]: I0316 17:01:42.651244 5120 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 17:01:42 crc kubenswrapper[5120]: I0316 17:01:42.768701 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:01:43 crc kubenswrapper[5120]: I0316 17:01:43.374830 5120 scope.go:117] "RemoveContainer" containerID="3f4aafa32edd97a4cd6857832bfde24c5f9a3e7c30285ec0f3a7bd7c08f686da" Mar 16 17:01:43 crc kubenswrapper[5120]: E0316 17:01:43.375316 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nova-cell1-conductor-conductor\" with CrashLoopBackOff: \"back-off 40s restarting failed container=nova-cell1-conductor-conductor pod=nova-cell1-conductor-0_openstack-kuttl-tests(61d14db6-7d33-4e5f-8252-844441e519d7)\"" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="61d14db6-7d33-4e5f-8252-844441e519d7" Mar 16 17:01:45 crc kubenswrapper[5120]: I0316 17:01:45.178888 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/keystone-ddf666799-df45b" podUID="aa20bbc5-67eb-41b6-83f9-a6dd3e1d9754" containerName="keystone-api" probeResult="failure" output="Get \"https://10.217.1.10:5000/v3\": read tcp 10.217.0.2:43102->10.217.1.10:5000: read: connection reset by peer" Mar 16 17:01:45 crc kubenswrapper[5120]: I0316 17:01:45.400612 5120 generic.go:358] "Generic (PLEG): container finished" podID="aa20bbc5-67eb-41b6-83f9-a6dd3e1d9754" containerID="7a0d02df021e34ba46af8468db125c17a6955a8df67524d59d149786c4b8bccd" exitCode=0 Mar 16 17:01:45 crc kubenswrapper[5120]: I0316 17:01:45.401425 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-ddf666799-df45b" event={"ID":"aa20bbc5-67eb-41b6-83f9-a6dd3e1d9754","Type":"ContainerDied","Data":"7a0d02df021e34ba46af8468db125c17a6955a8df67524d59d149786c4b8bccd"} Mar 16 17:01:45 crc kubenswrapper[5120]: I0316 17:01:45.584879 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-ddf666799-df45b" Mar 16 17:01:45 crc kubenswrapper[5120]: I0316 17:01:45.694194 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/aa20bbc5-67eb-41b6-83f9-a6dd3e1d9754-credential-keys\") pod \"aa20bbc5-67eb-41b6-83f9-a6dd3e1d9754\" (UID: \"aa20bbc5-67eb-41b6-83f9-a6dd3e1d9754\") " Mar 16 17:01:45 crc kubenswrapper[5120]: I0316 17:01:45.694436 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/aa20bbc5-67eb-41b6-83f9-a6dd3e1d9754-public-tls-certs\") pod \"aa20bbc5-67eb-41b6-83f9-a6dd3e1d9754\" (UID: \"aa20bbc5-67eb-41b6-83f9-a6dd3e1d9754\") " Mar 16 17:01:45 crc kubenswrapper[5120]: I0316 17:01:45.694513 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/aa20bbc5-67eb-41b6-83f9-a6dd3e1d9754-config-data\") pod \"aa20bbc5-67eb-41b6-83f9-a6dd3e1d9754\" (UID: \"aa20bbc5-67eb-41b6-83f9-a6dd3e1d9754\") " Mar 16 17:01:45 crc kubenswrapper[5120]: I0316 17:01:45.694538 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/aa20bbc5-67eb-41b6-83f9-a6dd3e1d9754-combined-ca-bundle\") pod \"aa20bbc5-67eb-41b6-83f9-a6dd3e1d9754\" (UID: \"aa20bbc5-67eb-41b6-83f9-a6dd3e1d9754\") " Mar 16 17:01:45 crc kubenswrapper[5120]: I0316 17:01:45.694789 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/aa20bbc5-67eb-41b6-83f9-a6dd3e1d9754-internal-tls-certs\") pod \"aa20bbc5-67eb-41b6-83f9-a6dd3e1d9754\" (UID: \"aa20bbc5-67eb-41b6-83f9-a6dd3e1d9754\") " Mar 16 17:01:45 crc kubenswrapper[5120]: I0316 17:01:45.694843 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/aa20bbc5-67eb-41b6-83f9-a6dd3e1d9754-scripts\") pod \"aa20bbc5-67eb-41b6-83f9-a6dd3e1d9754\" (UID: \"aa20bbc5-67eb-41b6-83f9-a6dd3e1d9754\") " Mar 16 17:01:45 crc kubenswrapper[5120]: I0316 17:01:45.694921 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8m44v\" (UniqueName: \"kubernetes.io/projected/aa20bbc5-67eb-41b6-83f9-a6dd3e1d9754-kube-api-access-8m44v\") pod \"aa20bbc5-67eb-41b6-83f9-a6dd3e1d9754\" (UID: \"aa20bbc5-67eb-41b6-83f9-a6dd3e1d9754\") " Mar 16 17:01:45 crc kubenswrapper[5120]: I0316 17:01:45.694951 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/aa20bbc5-67eb-41b6-83f9-a6dd3e1d9754-fernet-keys\") pod \"aa20bbc5-67eb-41b6-83f9-a6dd3e1d9754\" (UID: \"aa20bbc5-67eb-41b6-83f9-a6dd3e1d9754\") " Mar 16 17:01:45 crc kubenswrapper[5120]: I0316 17:01:45.703976 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aa20bbc5-67eb-41b6-83f9-a6dd3e1d9754-scripts" (OuterVolumeSpecName: "scripts") pod "aa20bbc5-67eb-41b6-83f9-a6dd3e1d9754" (UID: "aa20bbc5-67eb-41b6-83f9-a6dd3e1d9754"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:01:45 crc kubenswrapper[5120]: I0316 17:01:45.706984 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aa20bbc5-67eb-41b6-83f9-a6dd3e1d9754-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "aa20bbc5-67eb-41b6-83f9-a6dd3e1d9754" (UID: "aa20bbc5-67eb-41b6-83f9-a6dd3e1d9754"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:01:45 crc kubenswrapper[5120]: I0316 17:01:45.709292 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa20bbc5-67eb-41b6-83f9-a6dd3e1d9754-kube-api-access-8m44v" (OuterVolumeSpecName: "kube-api-access-8m44v") pod "aa20bbc5-67eb-41b6-83f9-a6dd3e1d9754" (UID: "aa20bbc5-67eb-41b6-83f9-a6dd3e1d9754"). InnerVolumeSpecName "kube-api-access-8m44v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:01:45 crc kubenswrapper[5120]: I0316 17:01:45.709409 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aa20bbc5-67eb-41b6-83f9-a6dd3e1d9754-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "aa20bbc5-67eb-41b6-83f9-a6dd3e1d9754" (UID: "aa20bbc5-67eb-41b6-83f9-a6dd3e1d9754"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:01:45 crc kubenswrapper[5120]: I0316 17:01:45.731490 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aa20bbc5-67eb-41b6-83f9-a6dd3e1d9754-config-data" (OuterVolumeSpecName: "config-data") pod "aa20bbc5-67eb-41b6-83f9-a6dd3e1d9754" (UID: "aa20bbc5-67eb-41b6-83f9-a6dd3e1d9754"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:01:45 crc kubenswrapper[5120]: I0316 17:01:45.732034 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/neutron-765bfffb44-jrj28" podUID="ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801" containerName="neutron-httpd" probeResult="failure" output="Get \"https://10.217.1.85:9696/\": dial tcp 10.217.1.85:9696: connect: connection refused" Mar 16 17:01:45 crc kubenswrapper[5120]: I0316 17:01:45.738454 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aa20bbc5-67eb-41b6-83f9-a6dd3e1d9754-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "aa20bbc5-67eb-41b6-83f9-a6dd3e1d9754" (UID: "aa20bbc5-67eb-41b6-83f9-a6dd3e1d9754"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:01:45 crc kubenswrapper[5120]: I0316 17:01:45.785794 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 17:01:45 crc kubenswrapper[5120]: I0316 17:01:45.786017 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/openstackclient" podUID="9d03800d-df43-4040-ac63-25536b89a363" containerName="openstackclient" containerID="cri-o://9c0dde63dded6fd7508da4b2be9ec12aa6b98bc4b44fdae1db73beace60a9ad0" gracePeriod=2 Mar 16 17:01:45 crc kubenswrapper[5120]: I0316 17:01:45.791145 5120 status_manager.go:895] "Failed to get status for pod" podUID="9d03800d-df43-4040-ac63-25536b89a363" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 17:01:45 crc kubenswrapper[5120]: I0316 17:01:45.791269 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aa20bbc5-67eb-41b6-83f9-a6dd3e1d9754-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "aa20bbc5-67eb-41b6-83f9-a6dd3e1d9754" (UID: "aa20bbc5-67eb-41b6-83f9-a6dd3e1d9754"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:01:45 crc kubenswrapper[5120]: I0316 17:01:45.792329 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aa20bbc5-67eb-41b6-83f9-a6dd3e1d9754-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "aa20bbc5-67eb-41b6-83f9-a6dd3e1d9754" (UID: "aa20bbc5-67eb-41b6-83f9-a6dd3e1d9754"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:01:45 crc kubenswrapper[5120]: I0316 17:01:45.800744 5120 reconciler_common.go:299] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/aa20bbc5-67eb-41b6-83f9-a6dd3e1d9754-credential-keys\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:45 crc kubenswrapper[5120]: I0316 17:01:45.800803 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/aa20bbc5-67eb-41b6-83f9-a6dd3e1d9754-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:45 crc kubenswrapper[5120]: I0316 17:01:45.800816 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/aa20bbc5-67eb-41b6-83f9-a6dd3e1d9754-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:45 crc kubenswrapper[5120]: I0316 17:01:45.800826 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/aa20bbc5-67eb-41b6-83f9-a6dd3e1d9754-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:45 crc kubenswrapper[5120]: I0316 17:01:45.800835 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/aa20bbc5-67eb-41b6-83f9-a6dd3e1d9754-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:45 crc kubenswrapper[5120]: I0316 17:01:45.800844 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/aa20bbc5-67eb-41b6-83f9-a6dd3e1d9754-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:45 crc kubenswrapper[5120]: I0316 17:01:45.800854 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8m44v\" (UniqueName: \"kubernetes.io/projected/aa20bbc5-67eb-41b6-83f9-a6dd3e1d9754-kube-api-access-8m44v\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:45 crc kubenswrapper[5120]: I0316 17:01:45.800866 5120 reconciler_common.go:299] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/aa20bbc5-67eb-41b6-83f9-a6dd3e1d9754-fernet-keys\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:45 crc kubenswrapper[5120]: I0316 17:01:45.813298 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 17:01:45 crc kubenswrapper[5120]: I0316 17:01:45.831562 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 17:01:45 crc kubenswrapper[5120]: I0316 17:01:45.833844 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa20bbc5-67eb-41b6-83f9-a6dd3e1d9754" containerName="keystone-api" Mar 16 17:01:45 crc kubenswrapper[5120]: I0316 17:01:45.833870 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa20bbc5-67eb-41b6-83f9-a6dd3e1d9754" containerName="keystone-api" Mar 16 17:01:45 crc kubenswrapper[5120]: I0316 17:01:45.833936 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d03800d-df43-4040-ac63-25536b89a363" containerName="openstackclient" Mar 16 17:01:45 crc kubenswrapper[5120]: I0316 17:01:45.833943 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d03800d-df43-4040-ac63-25536b89a363" containerName="openstackclient" Mar 16 17:01:45 crc kubenswrapper[5120]: I0316 17:01:45.833971 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36d5b175-81c4-4fc3-bb05-93958f9a7a63" containerName="placement-api" Mar 16 17:01:45 crc kubenswrapper[5120]: I0316 17:01:45.833976 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="36d5b175-81c4-4fc3-bb05-93958f9a7a63" containerName="placement-api" Mar 16 17:01:45 crc kubenswrapper[5120]: I0316 17:01:45.834160 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36d5b175-81c4-4fc3-bb05-93958f9a7a63" containerName="placement-log" Mar 16 17:01:45 crc kubenswrapper[5120]: I0316 17:01:45.834168 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="36d5b175-81c4-4fc3-bb05-93958f9a7a63" containerName="placement-log" Mar 16 17:01:45 crc kubenswrapper[5120]: I0316 17:01:45.834855 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="36d5b175-81c4-4fc3-bb05-93958f9a7a63" containerName="placement-log" Mar 16 17:01:45 crc kubenswrapper[5120]: I0316 17:01:45.834903 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="aa20bbc5-67eb-41b6-83f9-a6dd3e1d9754" containerName="keystone-api" Mar 16 17:01:45 crc kubenswrapper[5120]: I0316 17:01:45.834929 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="36d5b175-81c4-4fc3-bb05-93958f9a7a63" containerName="placement-api" Mar 16 17:01:45 crc kubenswrapper[5120]: I0316 17:01:45.834951 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="9d03800d-df43-4040-ac63-25536b89a363" containerName="openstackclient" Mar 16 17:01:45 crc kubenswrapper[5120]: I0316 17:01:45.844085 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Mar 16 17:01:45 crc kubenswrapper[5120]: I0316 17:01:45.848507 5120 status_manager.go:905] "Pod was deleted and then recreated, skipping status update" pod="openstack-kuttl-tests/openstackclient" oldPodUID="9d03800d-df43-4040-ac63-25536b89a363" podUID="a6d827da-888b-4463-b40a-041fef751ccc" Mar 16 17:01:45 crc kubenswrapper[5120]: I0316 17:01:45.889920 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 17:01:45 crc kubenswrapper[5120]: I0316 17:01:45.904374 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/a6d827da-888b-4463-b40a-041fef751ccc-openstack-config\") pod \"openstackclient\" (UID: \"a6d827da-888b-4463-b40a-041fef751ccc\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 17:01:45 crc kubenswrapper[5120]: I0316 17:01:45.904518 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/a6d827da-888b-4463-b40a-041fef751ccc-openstack-config-secret\") pod \"openstackclient\" (UID: \"a6d827da-888b-4463-b40a-041fef751ccc\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 17:01:45 crc kubenswrapper[5120]: I0316 17:01:45.904820 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a6d827da-888b-4463-b40a-041fef751ccc-combined-ca-bundle\") pod \"openstackclient\" (UID: \"a6d827da-888b-4463-b40a-041fef751ccc\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 17:01:45 crc kubenswrapper[5120]: I0316 17:01:45.904918 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9gv7\" (UniqueName: \"kubernetes.io/projected/a6d827da-888b-4463-b40a-041fef751ccc-kube-api-access-c9gv7\") pod \"openstackclient\" (UID: \"a6d827da-888b-4463-b40a-041fef751ccc\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 17:01:45 crc kubenswrapper[5120]: W0316 17:01:45.973848 5120 watcher.go:93] Error while processing event ("/sys/fs/cgroup/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb7434cde_890e_42d9_9b5c_bbd60a188517.slice/crio-e6f41b2eba86e2ad1ad67b7920bf775f201acf4a1d8d43b7f3ad7c19edd16e8f.scope": 0x40000100 == IN_CREATE|IN_ISDIR): inotify_add_watch /sys/fs/cgroup/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb7434cde_890e_42d9_9b5c_bbd60a188517.slice/crio-e6f41b2eba86e2ad1ad67b7920bf775f201acf4a1d8d43b7f3ad7c19edd16e8f.scope: no such file or directory Mar 16 17:01:45 crc kubenswrapper[5120]: W0316 17:01:45.975176 5120 watcher.go:93] Error while processing event ("/sys/fs/cgroup/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd0bd5c73_646f_42e2_885f_25fc4835ee47.slice": 0x40000100 == IN_CREATE|IN_ISDIR): inotify_add_watch /sys/fs/cgroup/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd0bd5c73_646f_42e2_885f_25fc4835ee47.slice: no such file or directory Mar 16 17:01:45 crc kubenswrapper[5120]: W0316 17:01:45.978070 5120 watcher.go:93] Error while processing event ("/sys/fs/cgroup/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9a5a470f_6027_43b1_aa7b_74626f464c7c.slice": 0x40000100 == IN_CREATE|IN_ISDIR): inotify_add_watch /sys/fs/cgroup/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9a5a470f_6027_43b1_aa7b_74626f464c7c.slice: no such file or directory Mar 16 17:01:45 crc kubenswrapper[5120]: W0316 17:01:45.984569 5120 watcher.go:93] Error while processing event ("/sys/fs/cgroup/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podab76f235_6a48_4935_a2d5_5a79806c416c.slice": 0x40000100 == IN_CREATE|IN_ISDIR): inotify_add_watch /sys/fs/cgroup/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podab76f235_6a48_4935_a2d5_5a79806c416c.slice: no such file or directory Mar 16 17:01:45 crc kubenswrapper[5120]: W0316 17:01:45.991000 5120 watcher.go:93] Error while processing event ("/sys/fs/cgroup/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0d641338_e35d_4819_b487_513c8840cfd7.slice": 0x40000100 == IN_CREATE|IN_ISDIR): inotify_add_watch /sys/fs/cgroup/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0d641338_e35d_4819_b487_513c8840cfd7.slice: no such file or directory Mar 16 17:01:45 crc kubenswrapper[5120]: W0316 17:01:45.991075 5120 watcher.go:93] Error while processing event ("/sys/fs/cgroup/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podce24ae83_459d_4410_bd4d_fb7e0fcad044.slice": 0x40000100 == IN_CREATE|IN_ISDIR): inotify_add_watch /sys/fs/cgroup/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podce24ae83_459d_4410_bd4d_fb7e0fcad044.slice: no such file or directory Mar 16 17:01:45 crc kubenswrapper[5120]: W0316 17:01:45.991137 5120 watcher.go:93] Error while processing event ("/sys/fs/cgroup/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb7434cde_890e_42d9_9b5c_bbd60a188517.slice/crio-conmon-9533e6b54c1aa1c42b7613a7687dc06b42ee15eb1d443ad851370c895955ad91.scope": 0x40000100 == IN_CREATE|IN_ISDIR): inotify_add_watch /sys/fs/cgroup/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb7434cde_890e_42d9_9b5c_bbd60a188517.slice/crio-conmon-9533e6b54c1aa1c42b7613a7687dc06b42ee15eb1d443ad851370c895955ad91.scope: no such file or directory Mar 16 17:01:45 crc kubenswrapper[5120]: W0316 17:01:45.996558 5120 watcher.go:93] Error while processing event ("/sys/fs/cgroup/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb7434cde_890e_42d9_9b5c_bbd60a188517.slice/crio-9533e6b54c1aa1c42b7613a7687dc06b42ee15eb1d443ad851370c895955ad91.scope": 0x40000100 == IN_CREATE|IN_ISDIR): inotify_add_watch /sys/fs/cgroup/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb7434cde_890e_42d9_9b5c_bbd60a188517.slice/crio-9533e6b54c1aa1c42b7613a7687dc06b42ee15eb1d443ad851370c895955ad91.scope: no such file or directory Mar 16 17:01:45 crc kubenswrapper[5120]: W0316 17:01:45.996625 5120 watcher.go:93] Error while processing event ("/sys/fs/cgroup/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod25abef41_bfd4_4436_a8c8_262247bd936f.slice": 0x40000100 == IN_CREATE|IN_ISDIR): inotify_add_watch /sys/fs/cgroup/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod25abef41_bfd4_4436_a8c8_262247bd936f.slice: no such file or directory Mar 16 17:01:45 crc kubenswrapper[5120]: W0316 17:01:45.999480 5120 watcher.go:93] Error while processing event ("/sys/fs/cgroup/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0fdecce9_8602_457d_8eec_c97b359170dd.slice": 0x40000100 == IN_CREATE|IN_ISDIR): inotify_add_watch /sys/fs/cgroup/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0fdecce9_8602_457d_8eec_c97b359170dd.slice: no such file or directory Mar 16 17:01:46 crc kubenswrapper[5120]: I0316 17:01:46.006932 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/a6d827da-888b-4463-b40a-041fef751ccc-openstack-config\") pod \"openstackclient\" (UID: \"a6d827da-888b-4463-b40a-041fef751ccc\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 17:01:46 crc kubenswrapper[5120]: I0316 17:01:46.007006 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/a6d827da-888b-4463-b40a-041fef751ccc-openstack-config-secret\") pod \"openstackclient\" (UID: \"a6d827da-888b-4463-b40a-041fef751ccc\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 17:01:46 crc kubenswrapper[5120]: I0316 17:01:46.007109 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a6d827da-888b-4463-b40a-041fef751ccc-combined-ca-bundle\") pod \"openstackclient\" (UID: \"a6d827da-888b-4463-b40a-041fef751ccc\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 17:01:46 crc kubenswrapper[5120]: I0316 17:01:46.007177 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c9gv7\" (UniqueName: \"kubernetes.io/projected/a6d827da-888b-4463-b40a-041fef751ccc-kube-api-access-c9gv7\") pod \"openstackclient\" (UID: \"a6d827da-888b-4463-b40a-041fef751ccc\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 17:01:46 crc kubenswrapper[5120]: I0316 17:01:46.008614 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/a6d827da-888b-4463-b40a-041fef751ccc-openstack-config\") pod \"openstackclient\" (UID: \"a6d827da-888b-4463-b40a-041fef751ccc\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 17:01:46 crc kubenswrapper[5120]: I0316 17:01:46.014045 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/a6d827da-888b-4463-b40a-041fef751ccc-openstack-config-secret\") pod \"openstackclient\" (UID: \"a6d827da-888b-4463-b40a-041fef751ccc\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 17:01:46 crc kubenswrapper[5120]: W0316 17:01:46.016791 5120 watcher.go:93] Error while processing event ("/sys/fs/cgroup/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod04658afd_5440_4feb_a1a2_3232b641b558.slice": 0x40000100 == IN_CREATE|IN_ISDIR): inotify_add_watch /sys/fs/cgroup/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod04658afd_5440_4feb_a1a2_3232b641b558.slice: no such file or directory Mar 16 17:01:46 crc kubenswrapper[5120]: I0316 17:01:46.016846 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a6d827da-888b-4463-b40a-041fef751ccc-combined-ca-bundle\") pod \"openstackclient\" (UID: \"a6d827da-888b-4463-b40a-041fef751ccc\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 17:01:46 crc kubenswrapper[5120]: W0316 17:01:46.018915 5120 watcher.go:93] Error while processing event ("/sys/fs/cgroup/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda91dab0d_d649_40d4_ae7e_84cb276b1119.slice": 0x40000100 == IN_CREATE|IN_ISDIR): inotify_add_watch /sys/fs/cgroup/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda91dab0d_d649_40d4_ae7e_84cb276b1119.slice: no such file or directory Mar 16 17:01:46 crc kubenswrapper[5120]: W0316 17:01:46.023696 5120 watcher.go:93] Error while processing event ("/sys/fs/cgroup/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2f4dc4ed_a579_46e8_a338_b310c55029d1.slice": 0x40000100 == IN_CREATE|IN_ISDIR): inotify_add_watch /sys/fs/cgroup/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2f4dc4ed_a579_46e8_a338_b310c55029d1.slice: no such file or directory Mar 16 17:01:46 crc kubenswrapper[5120]: I0316 17:01:46.025957 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9gv7\" (UniqueName: \"kubernetes.io/projected/a6d827da-888b-4463-b40a-041fef751ccc-kube-api-access-c9gv7\") pod \"openstackclient\" (UID: \"a6d827da-888b-4463-b40a-041fef751ccc\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 17:01:46 crc kubenswrapper[5120]: W0316 17:01:46.029659 5120 watcher.go:93] Error while processing event ("/sys/fs/cgroup/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod54dca6ff_f965_48fc_8521_946430880efd.slice": 0x40000100 == IN_CREATE|IN_ISDIR): inotify_add_watch /sys/fs/cgroup/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod54dca6ff_f965_48fc_8521_946430880efd.slice: no such file or directory Mar 16 17:01:46 crc kubenswrapper[5120]: I0316 17:01:46.165340 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Mar 16 17:01:46 crc kubenswrapper[5120]: I0316 17:01:46.376164 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-765bfffb44-jrj28_ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801/neutron-api/0.log" Mar 16 17:01:46 crc kubenswrapper[5120]: I0316 17:01:46.377018 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-765bfffb44-jrj28" Mar 16 17:01:46 crc kubenswrapper[5120]: I0316 17:01:46.420846 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801-ovndb-tls-certs\") pod \"ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801\" (UID: \"ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801\") " Mar 16 17:01:46 crc kubenswrapper[5120]: I0316 17:01:46.421140 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9c7q5\" (UniqueName: \"kubernetes.io/projected/ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801-kube-api-access-9c7q5\") pod \"ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801\" (UID: \"ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801\") " Mar 16 17:01:46 crc kubenswrapper[5120]: I0316 17:01:46.421280 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801-internal-tls-certs\") pod \"ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801\" (UID: \"ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801\") " Mar 16 17:01:46 crc kubenswrapper[5120]: I0316 17:01:46.421314 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801-public-tls-certs\") pod \"ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801\" (UID: \"ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801\") " Mar 16 17:01:46 crc kubenswrapper[5120]: I0316 17:01:46.421378 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801-httpd-config\") pod \"ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801\" (UID: \"ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801\") " Mar 16 17:01:46 crc kubenswrapper[5120]: I0316 17:01:46.421439 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801-combined-ca-bundle\") pod \"ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801\" (UID: \"ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801\") " Mar 16 17:01:46 crc kubenswrapper[5120]: I0316 17:01:46.421481 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801-config\") pod \"ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801\" (UID: \"ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801\") " Mar 16 17:01:46 crc kubenswrapper[5120]: I0316 17:01:46.423942 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-765bfffb44-jrj28_ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801/neutron-api/0.log" Mar 16 17:01:46 crc kubenswrapper[5120]: I0316 17:01:46.424226 5120 generic.go:358] "Generic (PLEG): container finished" podID="ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801" containerID="f0a293cfac604dbfdd5f557ac486b40c3fa465c6d265faa6cb8381ab784fb73a" exitCode=137 Mar 16 17:01:46 crc kubenswrapper[5120]: I0316 17:01:46.424399 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-765bfffb44-jrj28" event={"ID":"ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801","Type":"ContainerDied","Data":"f0a293cfac604dbfdd5f557ac486b40c3fa465c6d265faa6cb8381ab784fb73a"} Mar 16 17:01:46 crc kubenswrapper[5120]: I0316 17:01:46.424426 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-765bfffb44-jrj28" event={"ID":"ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801","Type":"ContainerDied","Data":"79df03a33585a1dbc7a97113d7983976a5afa997d7c7f5f744441ea7082e2046"} Mar 16 17:01:46 crc kubenswrapper[5120]: I0316 17:01:46.424442 5120 scope.go:117] "RemoveContainer" containerID="9441daf29df96c302c797aebd83789aeb29a6686baa145ee4bfdb90cc8d5046c" Mar 16 17:01:46 crc kubenswrapper[5120]: I0316 17:01:46.424588 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-765bfffb44-jrj28" Mar 16 17:01:46 crc kubenswrapper[5120]: I0316 17:01:46.431471 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-ddf666799-df45b" Mar 16 17:01:46 crc kubenswrapper[5120]: I0316 17:01:46.431843 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-ddf666799-df45b" event={"ID":"aa20bbc5-67eb-41b6-83f9-a6dd3e1d9754","Type":"ContainerDied","Data":"e877c6ca7abec18321954a81b70d60912631ff785a9519a7fe31d566cfef36db"} Mar 16 17:01:46 crc kubenswrapper[5120]: I0316 17:01:46.434363 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801-kube-api-access-9c7q5" (OuterVolumeSpecName: "kube-api-access-9c7q5") pod "ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801" (UID: "ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801"). InnerVolumeSpecName "kube-api-access-9c7q5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:01:46 crc kubenswrapper[5120]: I0316 17:01:46.451732 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801-httpd-config" (OuterVolumeSpecName: "httpd-config") pod "ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801" (UID: "ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801"). InnerVolumeSpecName "httpd-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:01:46 crc kubenswrapper[5120]: I0316 17:01:46.512979 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801" (UID: "ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:01:46 crc kubenswrapper[5120]: I0316 17:01:46.523206 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801" (UID: "ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:01:46 crc kubenswrapper[5120]: I0316 17:01:46.523924 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801" (UID: "ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:01:46 crc kubenswrapper[5120]: I0316 17:01:46.524352 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801-combined-ca-bundle\") pod \"ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801\" (UID: \"ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801\") " Mar 16 17:01:46 crc kubenswrapper[5120]: W0316 17:01:46.524473 5120 empty_dir.go:511] Warning: Unmount skipped because path does not exist: /var/lib/kubelet/pods/ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801/volumes/kubernetes.io~secret/combined-ca-bundle Mar 16 17:01:46 crc kubenswrapper[5120]: I0316 17:01:46.524489 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801" (UID: "ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:01:46 crc kubenswrapper[5120]: I0316 17:01:46.525060 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801-public-tls-certs\") pod \"ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801\" (UID: \"ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801\") " Mar 16 17:01:46 crc kubenswrapper[5120]: W0316 17:01:46.525182 5120 empty_dir.go:511] Warning: Unmount skipped because path does not exist: /var/lib/kubelet/pods/ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801/volumes/kubernetes.io~secret/public-tls-certs Mar 16 17:01:46 crc kubenswrapper[5120]: I0316 17:01:46.525199 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801" (UID: "ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:01:46 crc kubenswrapper[5120]: I0316 17:01:46.525671 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:46 crc kubenswrapper[5120]: I0316 17:01:46.525688 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:46 crc kubenswrapper[5120]: I0316 17:01:46.525697 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801-httpd-config\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:46 crc kubenswrapper[5120]: I0316 17:01:46.525705 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:46 crc kubenswrapper[5120]: I0316 17:01:46.525713 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9c7q5\" (UniqueName: \"kubernetes.io/projected/ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801-kube-api-access-9c7q5\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:46 crc kubenswrapper[5120]: I0316 17:01:46.543536 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801-config" (OuterVolumeSpecName: "config") pod "ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801" (UID: "ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:01:46 crc kubenswrapper[5120]: I0316 17:01:46.566278 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801-ovndb-tls-certs" (OuterVolumeSpecName: "ovndb-tls-certs") pod "ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801" (UID: "ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801"). InnerVolumeSpecName "ovndb-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:01:46 crc kubenswrapper[5120]: I0316 17:01:46.613332 5120 scope.go:117] "RemoveContainer" containerID="f0a293cfac604dbfdd5f557ac486b40c3fa465c6d265faa6cb8381ab784fb73a" Mar 16 17:01:46 crc kubenswrapper[5120]: I0316 17:01:46.622388 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-ddf666799-df45b"] Mar 16 17:01:46 crc kubenswrapper[5120]: I0316 17:01:46.629299 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801-config\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:46 crc kubenswrapper[5120]: I0316 17:01:46.629327 5120 reconciler_common.go:299] "Volume detached for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801-ovndb-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:46 crc kubenswrapper[5120]: E0316 17:01:46.630676 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9441daf29df96c302c797aebd83789aeb29a6686baa145ee4bfdb90cc8d5046c\": container with ID starting with 9441daf29df96c302c797aebd83789aeb29a6686baa145ee4bfdb90cc8d5046c not found: ID does not exist" containerID="9441daf29df96c302c797aebd83789aeb29a6686baa145ee4bfdb90cc8d5046c" Mar 16 17:01:46 crc kubenswrapper[5120]: I0316 17:01:46.630713 5120 image_gc_manager.go:222] "Failed to monitor images" err="get container status: runtime container status: rpc error: code = NotFound desc = could not find container \"9441daf29df96c302c797aebd83789aeb29a6686baa145ee4bfdb90cc8d5046c\": container with ID starting with 9441daf29df96c302c797aebd83789aeb29a6686baa145ee4bfdb90cc8d5046c not found: ID does not exist" Mar 16 17:01:46 crc kubenswrapper[5120]: I0316 17:01:46.633901 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-ddf666799-df45b"] Mar 16 17:01:46 crc kubenswrapper[5120]: I0316 17:01:46.641215 5120 scope.go:117] "RemoveContainer" containerID="9441daf29df96c302c797aebd83789aeb29a6686baa145ee4bfdb90cc8d5046c" Mar 16 17:01:46 crc kubenswrapper[5120]: I0316 17:01:46.641652 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9441daf29df96c302c797aebd83789aeb29a6686baa145ee4bfdb90cc8d5046c"} err="failed to get container status \"9441daf29df96c302c797aebd83789aeb29a6686baa145ee4bfdb90cc8d5046c\": rpc error: code = NotFound desc = could not find container \"9441daf29df96c302c797aebd83789aeb29a6686baa145ee4bfdb90cc8d5046c\": container with ID starting with 9441daf29df96c302c797aebd83789aeb29a6686baa145ee4bfdb90cc8d5046c not found: ID does not exist" Mar 16 17:01:46 crc kubenswrapper[5120]: I0316 17:01:46.641689 5120 scope.go:117] "RemoveContainer" containerID="f0a293cfac604dbfdd5f557ac486b40c3fa465c6d265faa6cb8381ab784fb73a" Mar 16 17:01:46 crc kubenswrapper[5120]: E0316 17:01:46.642059 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f0a293cfac604dbfdd5f557ac486b40c3fa465c6d265faa6cb8381ab784fb73a\": container with ID starting with f0a293cfac604dbfdd5f557ac486b40c3fa465c6d265faa6cb8381ab784fb73a not found: ID does not exist" containerID="f0a293cfac604dbfdd5f557ac486b40c3fa465c6d265faa6cb8381ab784fb73a" Mar 16 17:01:46 crc kubenswrapper[5120]: I0316 17:01:46.642222 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0a293cfac604dbfdd5f557ac486b40c3fa465c6d265faa6cb8381ab784fb73a"} err="failed to get container status \"f0a293cfac604dbfdd5f557ac486b40c3fa465c6d265faa6cb8381ab784fb73a\": rpc error: code = NotFound desc = could not find container \"f0a293cfac604dbfdd5f557ac486b40c3fa465c6d265faa6cb8381ab784fb73a\": container with ID starting with f0a293cfac604dbfdd5f557ac486b40c3fa465c6d265faa6cb8381ab784fb73a not found: ID does not exist" Mar 16 17:01:46 crc kubenswrapper[5120]: I0316 17:01:46.642248 5120 scope.go:117] "RemoveContainer" containerID="7a0d02df021e34ba46af8468db125c17a6955a8df67524d59d149786c4b8bccd" Mar 16 17:01:46 crc kubenswrapper[5120]: I0316 17:01:46.681634 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa20bbc5-67eb-41b6-83f9-a6dd3e1d9754" path="/var/lib/kubelet/pods/aa20bbc5-67eb-41b6-83f9-a6dd3e1d9754/volumes" Mar 16 17:01:46 crc kubenswrapper[5120]: I0316 17:01:46.686361 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 17:01:46 crc kubenswrapper[5120]: W0316 17:01:46.694266 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda6d827da_888b_4463_b40a_041fef751ccc.slice/crio-86982959829f006dafd73aa453b07551954125b9eb63af34eec82b6e3c211268 WatchSource:0}: Error finding container 86982959829f006dafd73aa453b07551954125b9eb63af34eec82b6e3c211268: Status 404 returned error can't find the container with id 86982959829f006dafd73aa453b07551954125b9eb63af34eec82b6e3c211268 Mar 16 17:01:46 crc kubenswrapper[5120]: I0316 17:01:46.751983 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-765bfffb44-jrj28"] Mar 16 17:01:46 crc kubenswrapper[5120]: I0316 17:01:46.763382 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-765bfffb44-jrj28"] Mar 16 17:01:46 crc kubenswrapper[5120]: I0316 17:01:46.969961 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-v822j_ac55471d-4e42-475f-a082-50f611571482/kube-multus/0.log" Mar 16 17:01:46 crc kubenswrapper[5120]: I0316 17:01:46.974329 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-crc_9f0bc7fcb0822a2c13eb2d22cd8c0641/kube-controller-manager/0.log" Mar 16 17:01:47 crc kubenswrapper[5120]: I0316 17:01:47.443330 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstackclient" event={"ID":"a6d827da-888b-4463-b40a-041fef751ccc","Type":"ContainerStarted","Data":"da57d0c85c4077395552861f82bea57510e45a2fb6167418fad685206cdc28c3"} Mar 16 17:01:47 crc kubenswrapper[5120]: I0316 17:01:47.443394 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstackclient" event={"ID":"a6d827da-888b-4463-b40a-041fef751ccc","Type":"ContainerStarted","Data":"86982959829f006dafd73aa453b07551954125b9eb63af34eec82b6e3c211268"} Mar 16 17:01:47 crc kubenswrapper[5120]: I0316 17:01:47.475673 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstackclient" podStartSLOduration=2.4756481900000002 podStartE2EDuration="2.47564819s" podCreationTimestamp="2026-03-16 17:01:45 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:01:47.458078074 +0000 UTC m=+5409.612009731" watchObservedRunningTime="2026-03-16 17:01:47.47564819 +0000 UTC m=+5409.629579847" Mar 16 17:01:47 crc kubenswrapper[5120]: I0316 17:01:47.525241 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:01:47 crc kubenswrapper[5120]: I0316 17:01:47.558980 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:01:47 crc kubenswrapper[5120]: I0316 17:01:47.800810 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:01:48 crc kubenswrapper[5120]: I0316 17:01:48.139867 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Mar 16 17:01:48 crc kubenswrapper[5120]: I0316 17:01:48.275076 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9d03800d-df43-4040-ac63-25536b89a363-combined-ca-bundle\") pod \"9d03800d-df43-4040-ac63-25536b89a363\" (UID: \"9d03800d-df43-4040-ac63-25536b89a363\") " Mar 16 17:01:48 crc kubenswrapper[5120]: I0316 17:01:48.275343 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9f4vd\" (UniqueName: \"kubernetes.io/projected/9d03800d-df43-4040-ac63-25536b89a363-kube-api-access-9f4vd\") pod \"9d03800d-df43-4040-ac63-25536b89a363\" (UID: \"9d03800d-df43-4040-ac63-25536b89a363\") " Mar 16 17:01:48 crc kubenswrapper[5120]: I0316 17:01:48.275492 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/9d03800d-df43-4040-ac63-25536b89a363-openstack-config-secret\") pod \"9d03800d-df43-4040-ac63-25536b89a363\" (UID: \"9d03800d-df43-4040-ac63-25536b89a363\") " Mar 16 17:01:48 crc kubenswrapper[5120]: I0316 17:01:48.275651 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/9d03800d-df43-4040-ac63-25536b89a363-openstack-config\") pod \"9d03800d-df43-4040-ac63-25536b89a363\" (UID: \"9d03800d-df43-4040-ac63-25536b89a363\") " Mar 16 17:01:48 crc kubenswrapper[5120]: I0316 17:01:48.290006 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d03800d-df43-4040-ac63-25536b89a363-kube-api-access-9f4vd" (OuterVolumeSpecName: "kube-api-access-9f4vd") pod "9d03800d-df43-4040-ac63-25536b89a363" (UID: "9d03800d-df43-4040-ac63-25536b89a363"). InnerVolumeSpecName "kube-api-access-9f4vd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:01:48 crc kubenswrapper[5120]: I0316 17:01:48.306068 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d03800d-df43-4040-ac63-25536b89a363-openstack-config" (OuterVolumeSpecName: "openstack-config") pod "9d03800d-df43-4040-ac63-25536b89a363" (UID: "9d03800d-df43-4040-ac63-25536b89a363"). InnerVolumeSpecName "openstack-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:01:48 crc kubenswrapper[5120]: I0316 17:01:48.313947 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9d03800d-df43-4040-ac63-25536b89a363-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "9d03800d-df43-4040-ac63-25536b89a363" (UID: "9d03800d-df43-4040-ac63-25536b89a363"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:01:48 crc kubenswrapper[5120]: I0316 17:01:48.347481 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9d03800d-df43-4040-ac63-25536b89a363-openstack-config-secret" (OuterVolumeSpecName: "openstack-config-secret") pod "9d03800d-df43-4040-ac63-25536b89a363" (UID: "9d03800d-df43-4040-ac63-25536b89a363"). InnerVolumeSpecName "openstack-config-secret". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:01:48 crc kubenswrapper[5120]: I0316 17:01:48.379916 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9f4vd\" (UniqueName: \"kubernetes.io/projected/9d03800d-df43-4040-ac63-25536b89a363-kube-api-access-9f4vd\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:48 crc kubenswrapper[5120]: I0316 17:01:48.379958 5120 reconciler_common.go:299] "Volume detached for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/9d03800d-df43-4040-ac63-25536b89a363-openstack-config-secret\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:48 crc kubenswrapper[5120]: I0316 17:01:48.379973 5120 reconciler_common.go:299] "Volume detached for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/9d03800d-df43-4040-ac63-25536b89a363-openstack-config\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:48 crc kubenswrapper[5120]: I0316 17:01:48.379983 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9d03800d-df43-4040-ac63-25536b89a363-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:01:48 crc kubenswrapper[5120]: I0316 17:01:48.470362 5120 generic.go:358] "Generic (PLEG): container finished" podID="9d03800d-df43-4040-ac63-25536b89a363" containerID="9c0dde63dded6fd7508da4b2be9ec12aa6b98bc4b44fdae1db73beace60a9ad0" exitCode=137 Mar 16 17:01:48 crc kubenswrapper[5120]: I0316 17:01:48.470780 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Mar 16 17:01:48 crc kubenswrapper[5120]: I0316 17:01:48.470778 5120 scope.go:117] "RemoveContainer" containerID="9c0dde63dded6fd7508da4b2be9ec12aa6b98bc4b44fdae1db73beace60a9ad0" Mar 16 17:01:48 crc kubenswrapper[5120]: I0316 17:01:48.492063 5120 status_manager.go:905] "Pod was deleted and then recreated, skipping status update" pod="openstack-kuttl-tests/openstackclient" oldPodUID="9d03800d-df43-4040-ac63-25536b89a363" podUID="a6d827da-888b-4463-b40a-041fef751ccc" Mar 16 17:01:48 crc kubenswrapper[5120]: I0316 17:01:48.494620 5120 scope.go:117] "RemoveContainer" containerID="9c0dde63dded6fd7508da4b2be9ec12aa6b98bc4b44fdae1db73beace60a9ad0" Mar 16 17:01:48 crc kubenswrapper[5120]: E0316 17:01:48.495156 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c0dde63dded6fd7508da4b2be9ec12aa6b98bc4b44fdae1db73beace60a9ad0\": container with ID starting with 9c0dde63dded6fd7508da4b2be9ec12aa6b98bc4b44fdae1db73beace60a9ad0 not found: ID does not exist" containerID="9c0dde63dded6fd7508da4b2be9ec12aa6b98bc4b44fdae1db73beace60a9ad0" Mar 16 17:01:48 crc kubenswrapper[5120]: I0316 17:01:48.495186 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c0dde63dded6fd7508da4b2be9ec12aa6b98bc4b44fdae1db73beace60a9ad0"} err="failed to get container status \"9c0dde63dded6fd7508da4b2be9ec12aa6b98bc4b44fdae1db73beace60a9ad0\": rpc error: code = NotFound desc = could not find container \"9c0dde63dded6fd7508da4b2be9ec12aa6b98bc4b44fdae1db73beace60a9ad0\": container with ID starting with 9c0dde63dded6fd7508da4b2be9ec12aa6b98bc4b44fdae1db73beace60a9ad0 not found: ID does not exist" Mar 16 17:01:48 crc kubenswrapper[5120]: I0316 17:01:48.536165 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:01:48 crc kubenswrapper[5120]: I0316 17:01:48.537020 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:01:48 crc kubenswrapper[5120]: I0316 17:01:48.655698 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:01:48 crc kubenswrapper[5120]: I0316 17:01:48.656946 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:01:48 crc kubenswrapper[5120]: I0316 17:01:48.679490 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9d03800d-df43-4040-ac63-25536b89a363" path="/var/lib/kubelet/pods/9d03800d-df43-4040-ac63-25536b89a363/volumes" Mar 16 17:01:48 crc kubenswrapper[5120]: I0316 17:01:48.680063 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801" path="/var/lib/kubelet/pods/ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801/volumes" Mar 16 17:01:48 crc kubenswrapper[5120]: I0316 17:01:48.743638 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/neutron-79c6c668c8-l5c8p" Mar 16 17:01:48 crc kubenswrapper[5120]: I0316 17:01:48.822743 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-8bf9bfcb4-2674f"] Mar 16 17:01:48 crc kubenswrapper[5120]: I0316 17:01:48.823028 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-8bf9bfcb4-2674f" podUID="95dbfc71-6afe-4106-b073-5a1edcc8788f" containerName="neutron-api" containerID="cri-o://5710a825d9e4076d2f3ae7a10f79b432da7ef32f643953fd0702e760bcea2f0a" gracePeriod=30 Mar 16 17:01:48 crc kubenswrapper[5120]: I0316 17:01:48.823111 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-8bf9bfcb4-2674f" podUID="95dbfc71-6afe-4106-b073-5a1edcc8788f" containerName="neutron-httpd" containerID="cri-o://43e6ee80bea5ccacd6e9cadc35391850863b090665249e7bb5dc73470649ce9d" gracePeriod=30 Mar 16 17:01:49 crc kubenswrapper[5120]: I0316 17:01:49.484530 5120 generic.go:358] "Generic (PLEG): container finished" podID="95dbfc71-6afe-4106-b073-5a1edcc8788f" containerID="43e6ee80bea5ccacd6e9cadc35391850863b090665249e7bb5dc73470649ce9d" exitCode=0 Mar 16 17:01:49 crc kubenswrapper[5120]: I0316 17:01:49.484619 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-8bf9bfcb4-2674f" event={"ID":"95dbfc71-6afe-4106-b073-5a1edcc8788f","Type":"ContainerDied","Data":"43e6ee80bea5ccacd6e9cadc35391850863b090665249e7bb5dc73470649ce9d"} Mar 16 17:01:50 crc kubenswrapper[5120]: I0316 17:01:50.540962 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:01:50 crc kubenswrapper[5120]: I0316 17:01:50.546134 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:01:50 crc kubenswrapper[5120]: I0316 17:01:50.548446 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:01:50 crc kubenswrapper[5120]: I0316 17:01:50.674317 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:01:50 crc kubenswrapper[5120]: I0316 17:01:50.674387 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:01:50 crc kubenswrapper[5120]: I0316 17:01:50.686873 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:01:50 crc kubenswrapper[5120]: I0316 17:01:50.692463 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:01:51 crc kubenswrapper[5120]: I0316 17:01:51.512871 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:01:52 crc kubenswrapper[5120]: I0316 17:01:52.007652 5120 patch_prober.go:28] interesting pod/machine-config-daemon-7bf76 container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 17:01:52 crc kubenswrapper[5120]: I0316 17:01:52.007714 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 17:01:52 crc kubenswrapper[5120]: I0316 17:01:52.378858 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/swift-proxy-7db84d667d-4xtpj"] Mar 16 17:01:52 crc kubenswrapper[5120]: I0316 17:01:52.380526 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801" containerName="neutron-httpd" Mar 16 17:01:52 crc kubenswrapper[5120]: I0316 17:01:52.380561 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801" containerName="neutron-httpd" Mar 16 17:01:52 crc kubenswrapper[5120]: I0316 17:01:52.380646 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801" containerName="neutron-api" Mar 16 17:01:52 crc kubenswrapper[5120]: I0316 17:01:52.380667 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801" containerName="neutron-api" Mar 16 17:01:52 crc kubenswrapper[5120]: I0316 17:01:52.380920 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801" containerName="neutron-httpd" Mar 16 17:01:52 crc kubenswrapper[5120]: I0316 17:01:52.380954 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ea0f3d23-6cd5-4ed4-bceb-d7cd366bb801" containerName="neutron-api" Mar 16 17:01:52 crc kubenswrapper[5120]: I0316 17:01:52.392501 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-7db84d667d-4xtpj" Mar 16 17:01:52 crc kubenswrapper[5120]: I0316 17:01:52.393215 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-proxy-7db84d667d-4xtpj"] Mar 16 17:01:52 crc kubenswrapper[5120]: I0316 17:01:52.499846 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/61f313f6-217b-4ab6-aaf9-2b45cb201326-combined-ca-bundle\") pod \"swift-proxy-7db84d667d-4xtpj\" (UID: \"61f313f6-217b-4ab6-aaf9-2b45cb201326\") " pod="openstack-kuttl-tests/swift-proxy-7db84d667d-4xtpj" Mar 16 17:01:52 crc kubenswrapper[5120]: I0316 17:01:52.499982 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/61f313f6-217b-4ab6-aaf9-2b45cb201326-internal-tls-certs\") pod \"swift-proxy-7db84d667d-4xtpj\" (UID: \"61f313f6-217b-4ab6-aaf9-2b45cb201326\") " pod="openstack-kuttl-tests/swift-proxy-7db84d667d-4xtpj" Mar 16 17:01:52 crc kubenswrapper[5120]: I0316 17:01:52.500083 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/61f313f6-217b-4ab6-aaf9-2b45cb201326-public-tls-certs\") pod \"swift-proxy-7db84d667d-4xtpj\" (UID: \"61f313f6-217b-4ab6-aaf9-2b45cb201326\") " pod="openstack-kuttl-tests/swift-proxy-7db84d667d-4xtpj" Mar 16 17:01:52 crc kubenswrapper[5120]: I0316 17:01:52.500231 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/61f313f6-217b-4ab6-aaf9-2b45cb201326-etc-swift\") pod \"swift-proxy-7db84d667d-4xtpj\" (UID: \"61f313f6-217b-4ab6-aaf9-2b45cb201326\") " pod="openstack-kuttl-tests/swift-proxy-7db84d667d-4xtpj" Mar 16 17:01:52 crc kubenswrapper[5120]: I0316 17:01:52.500426 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/61f313f6-217b-4ab6-aaf9-2b45cb201326-config-data\") pod \"swift-proxy-7db84d667d-4xtpj\" (UID: \"61f313f6-217b-4ab6-aaf9-2b45cb201326\") " pod="openstack-kuttl-tests/swift-proxy-7db84d667d-4xtpj" Mar 16 17:01:52 crc kubenswrapper[5120]: I0316 17:01:52.500507 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/61f313f6-217b-4ab6-aaf9-2b45cb201326-run-httpd\") pod \"swift-proxy-7db84d667d-4xtpj\" (UID: \"61f313f6-217b-4ab6-aaf9-2b45cb201326\") " pod="openstack-kuttl-tests/swift-proxy-7db84d667d-4xtpj" Mar 16 17:01:52 crc kubenswrapper[5120]: I0316 17:01:52.500544 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srtq2\" (UniqueName: \"kubernetes.io/projected/61f313f6-217b-4ab6-aaf9-2b45cb201326-kube-api-access-srtq2\") pod \"swift-proxy-7db84d667d-4xtpj\" (UID: \"61f313f6-217b-4ab6-aaf9-2b45cb201326\") " pod="openstack-kuttl-tests/swift-proxy-7db84d667d-4xtpj" Mar 16 17:01:52 crc kubenswrapper[5120]: I0316 17:01:52.503257 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/61f313f6-217b-4ab6-aaf9-2b45cb201326-log-httpd\") pod \"swift-proxy-7db84d667d-4xtpj\" (UID: \"61f313f6-217b-4ab6-aaf9-2b45cb201326\") " pod="openstack-kuttl-tests/swift-proxy-7db84d667d-4xtpj" Mar 16 17:01:52 crc kubenswrapper[5120]: I0316 17:01:52.606715 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/61f313f6-217b-4ab6-aaf9-2b45cb201326-combined-ca-bundle\") pod \"swift-proxy-7db84d667d-4xtpj\" (UID: \"61f313f6-217b-4ab6-aaf9-2b45cb201326\") " pod="openstack-kuttl-tests/swift-proxy-7db84d667d-4xtpj" Mar 16 17:01:52 crc kubenswrapper[5120]: I0316 17:01:52.606960 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/61f313f6-217b-4ab6-aaf9-2b45cb201326-internal-tls-certs\") pod \"swift-proxy-7db84d667d-4xtpj\" (UID: \"61f313f6-217b-4ab6-aaf9-2b45cb201326\") " pod="openstack-kuttl-tests/swift-proxy-7db84d667d-4xtpj" Mar 16 17:01:52 crc kubenswrapper[5120]: I0316 17:01:52.607019 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/61f313f6-217b-4ab6-aaf9-2b45cb201326-public-tls-certs\") pod \"swift-proxy-7db84d667d-4xtpj\" (UID: \"61f313f6-217b-4ab6-aaf9-2b45cb201326\") " pod="openstack-kuttl-tests/swift-proxy-7db84d667d-4xtpj" Mar 16 17:01:52 crc kubenswrapper[5120]: I0316 17:01:52.607150 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/61f313f6-217b-4ab6-aaf9-2b45cb201326-etc-swift\") pod \"swift-proxy-7db84d667d-4xtpj\" (UID: \"61f313f6-217b-4ab6-aaf9-2b45cb201326\") " pod="openstack-kuttl-tests/swift-proxy-7db84d667d-4xtpj" Mar 16 17:01:52 crc kubenswrapper[5120]: I0316 17:01:52.607294 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/61f313f6-217b-4ab6-aaf9-2b45cb201326-config-data\") pod \"swift-proxy-7db84d667d-4xtpj\" (UID: \"61f313f6-217b-4ab6-aaf9-2b45cb201326\") " pod="openstack-kuttl-tests/swift-proxy-7db84d667d-4xtpj" Mar 16 17:01:52 crc kubenswrapper[5120]: I0316 17:01:52.607369 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/61f313f6-217b-4ab6-aaf9-2b45cb201326-run-httpd\") pod \"swift-proxy-7db84d667d-4xtpj\" (UID: \"61f313f6-217b-4ab6-aaf9-2b45cb201326\") " pod="openstack-kuttl-tests/swift-proxy-7db84d667d-4xtpj" Mar 16 17:01:52 crc kubenswrapper[5120]: I0316 17:01:52.607393 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-srtq2\" (UniqueName: \"kubernetes.io/projected/61f313f6-217b-4ab6-aaf9-2b45cb201326-kube-api-access-srtq2\") pod \"swift-proxy-7db84d667d-4xtpj\" (UID: \"61f313f6-217b-4ab6-aaf9-2b45cb201326\") " pod="openstack-kuttl-tests/swift-proxy-7db84d667d-4xtpj" Mar 16 17:01:52 crc kubenswrapper[5120]: I0316 17:01:52.607594 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/61f313f6-217b-4ab6-aaf9-2b45cb201326-log-httpd\") pod \"swift-proxy-7db84d667d-4xtpj\" (UID: \"61f313f6-217b-4ab6-aaf9-2b45cb201326\") " pod="openstack-kuttl-tests/swift-proxy-7db84d667d-4xtpj" Mar 16 17:01:52 crc kubenswrapper[5120]: I0316 17:01:52.611973 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/61f313f6-217b-4ab6-aaf9-2b45cb201326-run-httpd\") pod \"swift-proxy-7db84d667d-4xtpj\" (UID: \"61f313f6-217b-4ab6-aaf9-2b45cb201326\") " pod="openstack-kuttl-tests/swift-proxy-7db84d667d-4xtpj" Mar 16 17:01:52 crc kubenswrapper[5120]: I0316 17:01:52.616912 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/61f313f6-217b-4ab6-aaf9-2b45cb201326-internal-tls-certs\") pod \"swift-proxy-7db84d667d-4xtpj\" (UID: \"61f313f6-217b-4ab6-aaf9-2b45cb201326\") " pod="openstack-kuttl-tests/swift-proxy-7db84d667d-4xtpj" Mar 16 17:01:52 crc kubenswrapper[5120]: I0316 17:01:52.618645 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/61f313f6-217b-4ab6-aaf9-2b45cb201326-log-httpd\") pod \"swift-proxy-7db84d667d-4xtpj\" (UID: \"61f313f6-217b-4ab6-aaf9-2b45cb201326\") " pod="openstack-kuttl-tests/swift-proxy-7db84d667d-4xtpj" Mar 16 17:01:52 crc kubenswrapper[5120]: I0316 17:01:52.621567 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/61f313f6-217b-4ab6-aaf9-2b45cb201326-public-tls-certs\") pod \"swift-proxy-7db84d667d-4xtpj\" (UID: \"61f313f6-217b-4ab6-aaf9-2b45cb201326\") " pod="openstack-kuttl-tests/swift-proxy-7db84d667d-4xtpj" Mar 16 17:01:52 crc kubenswrapper[5120]: I0316 17:01:52.623778 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/61f313f6-217b-4ab6-aaf9-2b45cb201326-combined-ca-bundle\") pod \"swift-proxy-7db84d667d-4xtpj\" (UID: \"61f313f6-217b-4ab6-aaf9-2b45cb201326\") " pod="openstack-kuttl-tests/swift-proxy-7db84d667d-4xtpj" Mar 16 17:01:52 crc kubenswrapper[5120]: I0316 17:01:52.626962 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/61f313f6-217b-4ab6-aaf9-2b45cb201326-config-data\") pod \"swift-proxy-7db84d667d-4xtpj\" (UID: \"61f313f6-217b-4ab6-aaf9-2b45cb201326\") " pod="openstack-kuttl-tests/swift-proxy-7db84d667d-4xtpj" Mar 16 17:01:52 crc kubenswrapper[5120]: I0316 17:01:52.631784 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/61f313f6-217b-4ab6-aaf9-2b45cb201326-etc-swift\") pod \"swift-proxy-7db84d667d-4xtpj\" (UID: \"61f313f6-217b-4ab6-aaf9-2b45cb201326\") " pod="openstack-kuttl-tests/swift-proxy-7db84d667d-4xtpj" Mar 16 17:01:52 crc kubenswrapper[5120]: I0316 17:01:52.635118 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-srtq2\" (UniqueName: \"kubernetes.io/projected/61f313f6-217b-4ab6-aaf9-2b45cb201326-kube-api-access-srtq2\") pod \"swift-proxy-7db84d667d-4xtpj\" (UID: \"61f313f6-217b-4ab6-aaf9-2b45cb201326\") " pod="openstack-kuttl-tests/swift-proxy-7db84d667d-4xtpj" Mar 16 17:01:52 crc kubenswrapper[5120]: I0316 17:01:52.723813 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-7db84d667d-4xtpj" Mar 16 17:01:53 crc kubenswrapper[5120]: I0316 17:01:53.209516 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-proxy-7db84d667d-4xtpj"] Mar 16 17:01:53 crc kubenswrapper[5120]: I0316 17:01:53.531540 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-7db84d667d-4xtpj" event={"ID":"61f313f6-217b-4ab6-aaf9-2b45cb201326","Type":"ContainerStarted","Data":"c0ab37643ef8d4e10deb832015361dee449ca3b088af8242b95d32087795d54a"} Mar 16 17:01:53 crc kubenswrapper[5120]: I0316 17:01:53.531950 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-7db84d667d-4xtpj" event={"ID":"61f313f6-217b-4ab6-aaf9-2b45cb201326","Type":"ContainerStarted","Data":"c0bcb55506fb022d64cb967f1df964d0c87ba1481c935bfd926d6a53054c8851"} Mar 16 17:01:54 crc kubenswrapper[5120]: I0316 17:01:54.543936 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-7db84d667d-4xtpj" event={"ID":"61f313f6-217b-4ab6-aaf9-2b45cb201326","Type":"ContainerStarted","Data":"c9f9f59cf38633969218626618ba40b5ed463c1ee0ff455a51269236211d9f2e"} Mar 16 17:01:54 crc kubenswrapper[5120]: I0316 17:01:54.544019 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/swift-proxy-7db84d667d-4xtpj" Mar 16 17:01:54 crc kubenswrapper[5120]: I0316 17:01:54.544038 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/swift-proxy-7db84d667d-4xtpj" Mar 16 17:01:55 crc kubenswrapper[5120]: I0316 17:01:55.663687 5120 scope.go:117] "RemoveContainer" containerID="3f4aafa32edd97a4cd6857832bfde24c5f9a3e7c30285ec0f3a7bd7c08f686da" Mar 16 17:01:55 crc kubenswrapper[5120]: E0316 17:01:55.664056 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nova-cell1-conductor-conductor\" with CrashLoopBackOff: \"back-off 40s restarting failed container=nova-cell1-conductor-conductor pod=nova-cell1-conductor-0_openstack-kuttl-tests(61d14db6-7d33-4e5f-8252-844441e519d7)\"" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="61d14db6-7d33-4e5f-8252-844441e519d7" Mar 16 17:01:57 crc kubenswrapper[5120]: I0316 17:01:57.051073 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:01:57 crc kubenswrapper[5120]: I0316 17:01:57.076593 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/swift-proxy-7db84d667d-4xtpj" podStartSLOduration=5.076573406 podStartE2EDuration="5.076573406s" podCreationTimestamp="2026-03-16 17:01:52 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:01:54.574076694 +0000 UTC m=+5416.728008371" watchObservedRunningTime="2026-03-16 17:01:57.076573406 +0000 UTC m=+5419.230505063" Mar 16 17:01:58 crc kubenswrapper[5120]: I0316 17:01:58.748228 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/neutron-8bf9bfcb4-2674f" podUID="95dbfc71-6afe-4106-b073-5a1edcc8788f" containerName="neutron-httpd" probeResult="failure" output="Get \"https://10.217.1.17:9696/\": dial tcp 10.217.1.17:9696: connect: connection refused" Mar 16 17:01:58 crc kubenswrapper[5120]: I0316 17:01:58.811050 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:01:58 crc kubenswrapper[5120]: I0316 17:01:58.811984 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="69b6e961-8899-43be-9468-f199ead48923" containerName="ceilometer-central-agent" containerID="cri-o://d8faa29bbf662c38afc672335e873815294c123589b63132659da7692be4c59a" gracePeriod=30 Mar 16 17:01:58 crc kubenswrapper[5120]: I0316 17:01:58.812057 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="69b6e961-8899-43be-9468-f199ead48923" containerName="sg-core" containerID="cri-o://c17e595386e6cd004c6bbf435772e0ccd0cd9e669df527a13857627c18505efe" gracePeriod=30 Mar 16 17:01:58 crc kubenswrapper[5120]: I0316 17:01:58.812067 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="69b6e961-8899-43be-9468-f199ead48923" containerName="ceilometer-notification-agent" containerID="cri-o://57556380d05903b43150f0e1e88520977812335ca43baadcc20d6683fa6e3719" gracePeriod=30 Mar 16 17:01:58 crc kubenswrapper[5120]: I0316 17:01:58.812010 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="69b6e961-8899-43be-9468-f199ead48923" containerName="proxy-httpd" containerID="cri-o://411e747261cb35828375d792c96d9f9de79dfcd10463b5a6675aa950a091814d" gracePeriod=30 Mar 16 17:01:59 crc kubenswrapper[5120]: I0316 17:01:59.641215 5120 generic.go:358] "Generic (PLEG): container finished" podID="69b6e961-8899-43be-9468-f199ead48923" containerID="411e747261cb35828375d792c96d9f9de79dfcd10463b5a6675aa950a091814d" exitCode=0 Mar 16 17:01:59 crc kubenswrapper[5120]: I0316 17:01:59.641252 5120 generic.go:358] "Generic (PLEG): container finished" podID="69b6e961-8899-43be-9468-f199ead48923" containerID="c17e595386e6cd004c6bbf435772e0ccd0cd9e669df527a13857627c18505efe" exitCode=2 Mar 16 17:01:59 crc kubenswrapper[5120]: I0316 17:01:59.641260 5120 generic.go:358] "Generic (PLEG): container finished" podID="69b6e961-8899-43be-9468-f199ead48923" containerID="d8faa29bbf662c38afc672335e873815294c123589b63132659da7692be4c59a" exitCode=0 Mar 16 17:01:59 crc kubenswrapper[5120]: I0316 17:01:59.641283 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"69b6e961-8899-43be-9468-f199ead48923","Type":"ContainerDied","Data":"411e747261cb35828375d792c96d9f9de79dfcd10463b5a6675aa950a091814d"} Mar 16 17:01:59 crc kubenswrapper[5120]: I0316 17:01:59.641322 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"69b6e961-8899-43be-9468-f199ead48923","Type":"ContainerDied","Data":"c17e595386e6cd004c6bbf435772e0ccd0cd9e669df527a13857627c18505efe"} Mar 16 17:01:59 crc kubenswrapper[5120]: I0316 17:01:59.641332 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"69b6e961-8899-43be-9468-f199ead48923","Type":"ContainerDied","Data":"d8faa29bbf662c38afc672335e873815294c123589b63132659da7692be4c59a"} Mar 16 17:02:00 crc kubenswrapper[5120]: I0316 17:02:00.159274 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-infra/auto-csr-approver-29561342-rrqbl"] Mar 16 17:02:00 crc kubenswrapper[5120]: I0316 17:02:00.166480 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561342-rrqbl" Mar 16 17:02:00 crc kubenswrapper[5120]: I0316 17:02:00.169090 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-infra\"/\"csr-approver-sa-dockercfg-x2nsz\"" Mar 16 17:02:00 crc kubenswrapper[5120]: I0316 17:02:00.169739 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561342-rrqbl"] Mar 16 17:02:00 crc kubenswrapper[5120]: I0316 17:02:00.170228 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"openshift-service-ca.crt\"" Mar 16 17:02:00 crc kubenswrapper[5120]: I0316 17:02:00.170250 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"kube-root-ca.crt\"" Mar 16 17:02:00 crc kubenswrapper[5120]: I0316 17:02:00.250277 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clbcn\" (UniqueName: \"kubernetes.io/projected/faf56689-0912-413f-9761-20c85fdbd7cb-kube-api-access-clbcn\") pod \"auto-csr-approver-29561342-rrqbl\" (UID: \"faf56689-0912-413f-9761-20c85fdbd7cb\") " pod="openshift-infra/auto-csr-approver-29561342-rrqbl" Mar 16 17:02:00 crc kubenswrapper[5120]: I0316 17:02:00.353465 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-clbcn\" (UniqueName: \"kubernetes.io/projected/faf56689-0912-413f-9761-20c85fdbd7cb-kube-api-access-clbcn\") pod \"auto-csr-approver-29561342-rrqbl\" (UID: \"faf56689-0912-413f-9761-20c85fdbd7cb\") " pod="openshift-infra/auto-csr-approver-29561342-rrqbl" Mar 16 17:02:00 crc kubenswrapper[5120]: I0316 17:02:00.376394 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-clbcn\" (UniqueName: \"kubernetes.io/projected/faf56689-0912-413f-9761-20c85fdbd7cb-kube-api-access-clbcn\") pod \"auto-csr-approver-29561342-rrqbl\" (UID: \"faf56689-0912-413f-9761-20c85fdbd7cb\") " pod="openshift-infra/auto-csr-approver-29561342-rrqbl" Mar 16 17:02:00 crc kubenswrapper[5120]: I0316 17:02:00.492658 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561342-rrqbl" Mar 16 17:02:00 crc kubenswrapper[5120]: I0316 17:02:00.561426 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/swift-proxy-7db84d667d-4xtpj" Mar 16 17:02:00 crc kubenswrapper[5120]: I0316 17:02:00.563379 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/swift-proxy-7db84d667d-4xtpj" Mar 16 17:02:00 crc kubenswrapper[5120]: I0316 17:02:00.719233 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-proxy-5f4bc687f4-xcf5c"] Mar 16 17:02:00 crc kubenswrapper[5120]: I0316 17:02:00.719728 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-proxy-5f4bc687f4-xcf5c" podUID="21a5384d-c9cf-429c-9e7e-cc9fb2a825b9" containerName="proxy-httpd" containerID="cri-o://e79959f71ab0d91a6dfd6500e6c23a90e3f5f472b910457be6bb1444ceb92626" gracePeriod=30 Mar 16 17:02:00 crc kubenswrapper[5120]: I0316 17:02:00.720365 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-proxy-5f4bc687f4-xcf5c" podUID="21a5384d-c9cf-429c-9e7e-cc9fb2a825b9" containerName="proxy-server" containerID="cri-o://3f7bb0f2d95b2604000e3cb06726dffeed7a15b51fc59eb520f23068db328b43" gracePeriod=30 Mar 16 17:02:01 crc kubenswrapper[5120]: I0316 17:02:01.015058 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561342-rrqbl"] Mar 16 17:02:01 crc kubenswrapper[5120]: W0316 17:02:01.018618 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfaf56689_0912_413f_9761_20c85fdbd7cb.slice/crio-d2c24e7e8055689459ade56383af4c812c3dadbbc5ee415e0e8bc9cc9f364821 WatchSource:0}: Error finding container d2c24e7e8055689459ade56383af4c812c3dadbbc5ee415e0e8bc9cc9f364821: Status 404 returned error can't find the container with id d2c24e7e8055689459ade56383af4c812c3dadbbc5ee415e0e8bc9cc9f364821 Mar 16 17:02:01 crc kubenswrapper[5120]: I0316 17:02:01.530141 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-5f4bc687f4-xcf5c" Mar 16 17:02:01 crc kubenswrapper[5120]: I0316 17:02:01.593536 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/21a5384d-c9cf-429c-9e7e-cc9fb2a825b9-run-httpd\") pod \"21a5384d-c9cf-429c-9e7e-cc9fb2a825b9\" (UID: \"21a5384d-c9cf-429c-9e7e-cc9fb2a825b9\") " Mar 16 17:02:01 crc kubenswrapper[5120]: I0316 17:02:01.593877 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21a5384d-c9cf-429c-9e7e-cc9fb2a825b9-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "21a5384d-c9cf-429c-9e7e-cc9fb2a825b9" (UID: "21a5384d-c9cf-429c-9e7e-cc9fb2a825b9"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:02:01 crc kubenswrapper[5120]: I0316 17:02:01.593947 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/21a5384d-c9cf-429c-9e7e-cc9fb2a825b9-log-httpd\") pod \"21a5384d-c9cf-429c-9e7e-cc9fb2a825b9\" (UID: \"21a5384d-c9cf-429c-9e7e-cc9fb2a825b9\") " Mar 16 17:02:01 crc kubenswrapper[5120]: I0316 17:02:01.594089 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/21a5384d-c9cf-429c-9e7e-cc9fb2a825b9-public-tls-certs\") pod \"21a5384d-c9cf-429c-9e7e-cc9fb2a825b9\" (UID: \"21a5384d-c9cf-429c-9e7e-cc9fb2a825b9\") " Mar 16 17:02:01 crc kubenswrapper[5120]: I0316 17:02:01.594158 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/21a5384d-c9cf-429c-9e7e-cc9fb2a825b9-internal-tls-certs\") pod \"21a5384d-c9cf-429c-9e7e-cc9fb2a825b9\" (UID: \"21a5384d-c9cf-429c-9e7e-cc9fb2a825b9\") " Mar 16 17:02:01 crc kubenswrapper[5120]: I0316 17:02:01.594247 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21a5384d-c9cf-429c-9e7e-cc9fb2a825b9-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "21a5384d-c9cf-429c-9e7e-cc9fb2a825b9" (UID: "21a5384d-c9cf-429c-9e7e-cc9fb2a825b9"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:02:01 crc kubenswrapper[5120]: I0316 17:02:01.594400 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rgmw4\" (UniqueName: \"kubernetes.io/projected/21a5384d-c9cf-429c-9e7e-cc9fb2a825b9-kube-api-access-rgmw4\") pod \"21a5384d-c9cf-429c-9e7e-cc9fb2a825b9\" (UID: \"21a5384d-c9cf-429c-9e7e-cc9fb2a825b9\") " Mar 16 17:02:01 crc kubenswrapper[5120]: I0316 17:02:01.594442 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/21a5384d-c9cf-429c-9e7e-cc9fb2a825b9-config-data\") pod \"21a5384d-c9cf-429c-9e7e-cc9fb2a825b9\" (UID: \"21a5384d-c9cf-429c-9e7e-cc9fb2a825b9\") " Mar 16 17:02:01 crc kubenswrapper[5120]: I0316 17:02:01.594839 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/21a5384d-c9cf-429c-9e7e-cc9fb2a825b9-combined-ca-bundle\") pod \"21a5384d-c9cf-429c-9e7e-cc9fb2a825b9\" (UID: \"21a5384d-c9cf-429c-9e7e-cc9fb2a825b9\") " Mar 16 17:02:01 crc kubenswrapper[5120]: I0316 17:02:01.595002 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/21a5384d-c9cf-429c-9e7e-cc9fb2a825b9-etc-swift\") pod \"21a5384d-c9cf-429c-9e7e-cc9fb2a825b9\" (UID: \"21a5384d-c9cf-429c-9e7e-cc9fb2a825b9\") " Mar 16 17:02:01 crc kubenswrapper[5120]: I0316 17:02:01.595746 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/21a5384d-c9cf-429c-9e7e-cc9fb2a825b9-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 17:02:01 crc kubenswrapper[5120]: I0316 17:02:01.595801 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/21a5384d-c9cf-429c-9e7e-cc9fb2a825b9-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 17:02:01 crc kubenswrapper[5120]: I0316 17:02:01.607321 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21a5384d-c9cf-429c-9e7e-cc9fb2a825b9-etc-swift" (OuterVolumeSpecName: "etc-swift") pod "21a5384d-c9cf-429c-9e7e-cc9fb2a825b9" (UID: "21a5384d-c9cf-429c-9e7e-cc9fb2a825b9"). InnerVolumeSpecName "etc-swift". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:02:01 crc kubenswrapper[5120]: I0316 17:02:01.626601 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21a5384d-c9cf-429c-9e7e-cc9fb2a825b9-kube-api-access-rgmw4" (OuterVolumeSpecName: "kube-api-access-rgmw4") pod "21a5384d-c9cf-429c-9e7e-cc9fb2a825b9" (UID: "21a5384d-c9cf-429c-9e7e-cc9fb2a825b9"). InnerVolumeSpecName "kube-api-access-rgmw4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:02:01 crc kubenswrapper[5120]: I0316 17:02:01.671998 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/21a5384d-c9cf-429c-9e7e-cc9fb2a825b9-config-data" (OuterVolumeSpecName: "config-data") pod "21a5384d-c9cf-429c-9e7e-cc9fb2a825b9" (UID: "21a5384d-c9cf-429c-9e7e-cc9fb2a825b9"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:02:01 crc kubenswrapper[5120]: I0316 17:02:01.688213 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/21a5384d-c9cf-429c-9e7e-cc9fb2a825b9-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "21a5384d-c9cf-429c-9e7e-cc9fb2a825b9" (UID: "21a5384d-c9cf-429c-9e7e-cc9fb2a825b9"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:02:01 crc kubenswrapper[5120]: I0316 17:02:01.698960 5120 reconciler_common.go:299] "Volume detached for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/21a5384d-c9cf-429c-9e7e-cc9fb2a825b9-etc-swift\") on node \"crc\" DevicePath \"\"" Mar 16 17:02:01 crc kubenswrapper[5120]: I0316 17:02:01.698995 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rgmw4\" (UniqueName: \"kubernetes.io/projected/21a5384d-c9cf-429c-9e7e-cc9fb2a825b9-kube-api-access-rgmw4\") on node \"crc\" DevicePath \"\"" Mar 16 17:02:01 crc kubenswrapper[5120]: I0316 17:02:01.699009 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/21a5384d-c9cf-429c-9e7e-cc9fb2a825b9-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:02:01 crc kubenswrapper[5120]: I0316 17:02:01.699020 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/21a5384d-c9cf-429c-9e7e-cc9fb2a825b9-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:02:01 crc kubenswrapper[5120]: I0316 17:02:01.709655 5120 generic.go:358] "Generic (PLEG): container finished" podID="21a5384d-c9cf-429c-9e7e-cc9fb2a825b9" containerID="3f7bb0f2d95b2604000e3cb06726dffeed7a15b51fc59eb520f23068db328b43" exitCode=0 Mar 16 17:02:01 crc kubenswrapper[5120]: I0316 17:02:01.709688 5120 generic.go:358] "Generic (PLEG): container finished" podID="21a5384d-c9cf-429c-9e7e-cc9fb2a825b9" containerID="e79959f71ab0d91a6dfd6500e6c23a90e3f5f472b910457be6bb1444ceb92626" exitCode=0 Mar 16 17:02:01 crc kubenswrapper[5120]: I0316 17:02:01.709974 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-5f4bc687f4-xcf5c" Mar 16 17:02:01 crc kubenswrapper[5120]: I0316 17:02:01.710149 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-5f4bc687f4-xcf5c" event={"ID":"21a5384d-c9cf-429c-9e7e-cc9fb2a825b9","Type":"ContainerDied","Data":"3f7bb0f2d95b2604000e3cb06726dffeed7a15b51fc59eb520f23068db328b43"} Mar 16 17:02:01 crc kubenswrapper[5120]: I0316 17:02:01.710220 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-5f4bc687f4-xcf5c" event={"ID":"21a5384d-c9cf-429c-9e7e-cc9fb2a825b9","Type":"ContainerDied","Data":"e79959f71ab0d91a6dfd6500e6c23a90e3f5f472b910457be6bb1444ceb92626"} Mar 16 17:02:01 crc kubenswrapper[5120]: I0316 17:02:01.710238 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-5f4bc687f4-xcf5c" event={"ID":"21a5384d-c9cf-429c-9e7e-cc9fb2a825b9","Type":"ContainerDied","Data":"a5c8c069d9991734fb054c96469979823968f3de7ae2ab4be6034a4f07480e86"} Mar 16 17:02:01 crc kubenswrapper[5120]: I0316 17:02:01.710259 5120 scope.go:117] "RemoveContainer" containerID="3f7bb0f2d95b2604000e3cb06726dffeed7a15b51fc59eb520f23068db328b43" Mar 16 17:02:01 crc kubenswrapper[5120]: I0316 17:02:01.711493 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/21a5384d-c9cf-429c-9e7e-cc9fb2a825b9-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "21a5384d-c9cf-429c-9e7e-cc9fb2a825b9" (UID: "21a5384d-c9cf-429c-9e7e-cc9fb2a825b9"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:02:01 crc kubenswrapper[5120]: I0316 17:02:01.712296 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561342-rrqbl" event={"ID":"faf56689-0912-413f-9761-20c85fdbd7cb","Type":"ContainerStarted","Data":"d2c24e7e8055689459ade56383af4c812c3dadbbc5ee415e0e8bc9cc9f364821"} Mar 16 17:02:01 crc kubenswrapper[5120]: I0316 17:02:01.714111 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/21a5384d-c9cf-429c-9e7e-cc9fb2a825b9-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "21a5384d-c9cf-429c-9e7e-cc9fb2a825b9" (UID: "21a5384d-c9cf-429c-9e7e-cc9fb2a825b9"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:02:01 crc kubenswrapper[5120]: I0316 17:02:01.772318 5120 scope.go:117] "RemoveContainer" containerID="e79959f71ab0d91a6dfd6500e6c23a90e3f5f472b910457be6bb1444ceb92626" Mar 16 17:02:01 crc kubenswrapper[5120]: I0316 17:02:01.800898 5120 scope.go:117] "RemoveContainer" containerID="3f7bb0f2d95b2604000e3cb06726dffeed7a15b51fc59eb520f23068db328b43" Mar 16 17:02:01 crc kubenswrapper[5120]: E0316 17:02:01.801238 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f7bb0f2d95b2604000e3cb06726dffeed7a15b51fc59eb520f23068db328b43\": container with ID starting with 3f7bb0f2d95b2604000e3cb06726dffeed7a15b51fc59eb520f23068db328b43 not found: ID does not exist" containerID="3f7bb0f2d95b2604000e3cb06726dffeed7a15b51fc59eb520f23068db328b43" Mar 16 17:02:01 crc kubenswrapper[5120]: I0316 17:02:01.801279 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f7bb0f2d95b2604000e3cb06726dffeed7a15b51fc59eb520f23068db328b43"} err="failed to get container status \"3f7bb0f2d95b2604000e3cb06726dffeed7a15b51fc59eb520f23068db328b43\": rpc error: code = NotFound desc = could not find container \"3f7bb0f2d95b2604000e3cb06726dffeed7a15b51fc59eb520f23068db328b43\": container with ID starting with 3f7bb0f2d95b2604000e3cb06726dffeed7a15b51fc59eb520f23068db328b43 not found: ID does not exist" Mar 16 17:02:01 crc kubenswrapper[5120]: I0316 17:02:01.801305 5120 scope.go:117] "RemoveContainer" containerID="e79959f71ab0d91a6dfd6500e6c23a90e3f5f472b910457be6bb1444ceb92626" Mar 16 17:02:01 crc kubenswrapper[5120]: I0316 17:02:01.801422 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/21a5384d-c9cf-429c-9e7e-cc9fb2a825b9-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:02:01 crc kubenswrapper[5120]: I0316 17:02:01.801452 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/21a5384d-c9cf-429c-9e7e-cc9fb2a825b9-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:02:01 crc kubenswrapper[5120]: E0316 17:02:01.801661 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e79959f71ab0d91a6dfd6500e6c23a90e3f5f472b910457be6bb1444ceb92626\": container with ID starting with e79959f71ab0d91a6dfd6500e6c23a90e3f5f472b910457be6bb1444ceb92626 not found: ID does not exist" containerID="e79959f71ab0d91a6dfd6500e6c23a90e3f5f472b910457be6bb1444ceb92626" Mar 16 17:02:01 crc kubenswrapper[5120]: I0316 17:02:01.801692 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e79959f71ab0d91a6dfd6500e6c23a90e3f5f472b910457be6bb1444ceb92626"} err="failed to get container status \"e79959f71ab0d91a6dfd6500e6c23a90e3f5f472b910457be6bb1444ceb92626\": rpc error: code = NotFound desc = could not find container \"e79959f71ab0d91a6dfd6500e6c23a90e3f5f472b910457be6bb1444ceb92626\": container with ID starting with e79959f71ab0d91a6dfd6500e6c23a90e3f5f472b910457be6bb1444ceb92626 not found: ID does not exist" Mar 16 17:02:01 crc kubenswrapper[5120]: I0316 17:02:01.801709 5120 scope.go:117] "RemoveContainer" containerID="3f7bb0f2d95b2604000e3cb06726dffeed7a15b51fc59eb520f23068db328b43" Mar 16 17:02:01 crc kubenswrapper[5120]: I0316 17:02:01.801985 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f7bb0f2d95b2604000e3cb06726dffeed7a15b51fc59eb520f23068db328b43"} err="failed to get container status \"3f7bb0f2d95b2604000e3cb06726dffeed7a15b51fc59eb520f23068db328b43\": rpc error: code = NotFound desc = could not find container \"3f7bb0f2d95b2604000e3cb06726dffeed7a15b51fc59eb520f23068db328b43\": container with ID starting with 3f7bb0f2d95b2604000e3cb06726dffeed7a15b51fc59eb520f23068db328b43 not found: ID does not exist" Mar 16 17:02:01 crc kubenswrapper[5120]: I0316 17:02:01.802025 5120 scope.go:117] "RemoveContainer" containerID="e79959f71ab0d91a6dfd6500e6c23a90e3f5f472b910457be6bb1444ceb92626" Mar 16 17:02:01 crc kubenswrapper[5120]: I0316 17:02:01.802414 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e79959f71ab0d91a6dfd6500e6c23a90e3f5f472b910457be6bb1444ceb92626"} err="failed to get container status \"e79959f71ab0d91a6dfd6500e6c23a90e3f5f472b910457be6bb1444ceb92626\": rpc error: code = NotFound desc = could not find container \"e79959f71ab0d91a6dfd6500e6c23a90e3f5f472b910457be6bb1444ceb92626\": container with ID starting with e79959f71ab0d91a6dfd6500e6c23a90e3f5f472b910457be6bb1444ceb92626 not found: ID does not exist" Mar 16 17:02:02 crc kubenswrapper[5120]: I0316 17:02:02.051495 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-proxy-5f4bc687f4-xcf5c"] Mar 16 17:02:02 crc kubenswrapper[5120]: I0316 17:02:02.070218 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/swift-proxy-5f4bc687f4-xcf5c"] Mar 16 17:02:02 crc kubenswrapper[5120]: I0316 17:02:02.679925 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="21a5384d-c9cf-429c-9e7e-cc9fb2a825b9" path="/var/lib/kubelet/pods/21a5384d-c9cf-429c-9e7e-cc9fb2a825b9/volumes" Mar 16 17:02:02 crc kubenswrapper[5120]: I0316 17:02:02.735565 5120 generic.go:358] "Generic (PLEG): container finished" podID="faf56689-0912-413f-9761-20c85fdbd7cb" containerID="b961b48c20ad81424ee896042d661e9274aaf36c91d9dedfa4dbb2056058edff" exitCode=0 Mar 16 17:02:02 crc kubenswrapper[5120]: I0316 17:02:02.735718 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561342-rrqbl" event={"ID":"faf56689-0912-413f-9761-20c85fdbd7cb","Type":"ContainerDied","Data":"b961b48c20ad81424ee896042d661e9274aaf36c91d9dedfa4dbb2056058edff"} Mar 16 17:02:04 crc kubenswrapper[5120]: I0316 17:02:04.145953 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561342-rrqbl" Mar 16 17:02:04 crc kubenswrapper[5120]: I0316 17:02:04.280288 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-clbcn\" (UniqueName: \"kubernetes.io/projected/faf56689-0912-413f-9761-20c85fdbd7cb-kube-api-access-clbcn\") pod \"faf56689-0912-413f-9761-20c85fdbd7cb\" (UID: \"faf56689-0912-413f-9761-20c85fdbd7cb\") " Mar 16 17:02:04 crc kubenswrapper[5120]: I0316 17:02:04.286945 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/faf56689-0912-413f-9761-20c85fdbd7cb-kube-api-access-clbcn" (OuterVolumeSpecName: "kube-api-access-clbcn") pod "faf56689-0912-413f-9761-20c85fdbd7cb" (UID: "faf56689-0912-413f-9761-20c85fdbd7cb"). InnerVolumeSpecName "kube-api-access-clbcn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:02:04 crc kubenswrapper[5120]: I0316 17:02:04.383862 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-clbcn\" (UniqueName: \"kubernetes.io/projected/faf56689-0912-413f-9761-20c85fdbd7cb-kube-api-access-clbcn\") on node \"crc\" DevicePath \"\"" Mar 16 17:02:04 crc kubenswrapper[5120]: I0316 17:02:04.763457 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561342-rrqbl" Mar 16 17:02:04 crc kubenswrapper[5120]: I0316 17:02:04.763479 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561342-rrqbl" event={"ID":"faf56689-0912-413f-9761-20c85fdbd7cb","Type":"ContainerDied","Data":"d2c24e7e8055689459ade56383af4c812c3dadbbc5ee415e0e8bc9cc9f364821"} Mar 16 17:02:04 crc kubenswrapper[5120]: I0316 17:02:04.763879 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d2c24e7e8055689459ade56383af4c812c3dadbbc5ee415e0e8bc9cc9f364821" Mar 16 17:02:05 crc kubenswrapper[5120]: I0316 17:02:05.217921 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-infra/auto-csr-approver-29561336-7cbfn"] Mar 16 17:02:05 crc kubenswrapper[5120]: I0316 17:02:05.227217 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-infra/auto-csr-approver-29561336-7cbfn"] Mar 16 17:02:05 crc kubenswrapper[5120]: I0316 17:02:05.297488 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:02:05 crc kubenswrapper[5120]: I0316 17:02:05.307734 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/69b6e961-8899-43be-9468-f199ead48923-scripts\") pod \"69b6e961-8899-43be-9468-f199ead48923\" (UID: \"69b6e961-8899-43be-9468-f199ead48923\") " Mar 16 17:02:05 crc kubenswrapper[5120]: I0316 17:02:05.307878 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/69b6e961-8899-43be-9468-f199ead48923-log-httpd\") pod \"69b6e961-8899-43be-9468-f199ead48923\" (UID: \"69b6e961-8899-43be-9468-f199ead48923\") " Mar 16 17:02:05 crc kubenswrapper[5120]: I0316 17:02:05.307931 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/69b6e961-8899-43be-9468-f199ead48923-run-httpd\") pod \"69b6e961-8899-43be-9468-f199ead48923\" (UID: \"69b6e961-8899-43be-9468-f199ead48923\") " Mar 16 17:02:05 crc kubenswrapper[5120]: I0316 17:02:05.308036 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/69b6e961-8899-43be-9468-f199ead48923-combined-ca-bundle\") pod \"69b6e961-8899-43be-9468-f199ead48923\" (UID: \"69b6e961-8899-43be-9468-f199ead48923\") " Mar 16 17:02:05 crc kubenswrapper[5120]: I0316 17:02:05.308368 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/69b6e961-8899-43be-9468-f199ead48923-config-data\") pod \"69b6e961-8899-43be-9468-f199ead48923\" (UID: \"69b6e961-8899-43be-9468-f199ead48923\") " Mar 16 17:02:05 crc kubenswrapper[5120]: I0316 17:02:05.308487 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/69b6e961-8899-43be-9468-f199ead48923-ceilometer-tls-certs\") pod \"69b6e961-8899-43be-9468-f199ead48923\" (UID: \"69b6e961-8899-43be-9468-f199ead48923\") " Mar 16 17:02:05 crc kubenswrapper[5120]: I0316 17:02:05.308559 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2xdvz\" (UniqueName: \"kubernetes.io/projected/69b6e961-8899-43be-9468-f199ead48923-kube-api-access-2xdvz\") pod \"69b6e961-8899-43be-9468-f199ead48923\" (UID: \"69b6e961-8899-43be-9468-f199ead48923\") " Mar 16 17:02:05 crc kubenswrapper[5120]: I0316 17:02:05.308716 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/69b6e961-8899-43be-9468-f199ead48923-sg-core-conf-yaml\") pod \"69b6e961-8899-43be-9468-f199ead48923\" (UID: \"69b6e961-8899-43be-9468-f199ead48923\") " Mar 16 17:02:05 crc kubenswrapper[5120]: I0316 17:02:05.310010 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69b6e961-8899-43be-9468-f199ead48923-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "69b6e961-8899-43be-9468-f199ead48923" (UID: "69b6e961-8899-43be-9468-f199ead48923"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:02:05 crc kubenswrapper[5120]: I0316 17:02:05.310263 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69b6e961-8899-43be-9468-f199ead48923-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "69b6e961-8899-43be-9468-f199ead48923" (UID: "69b6e961-8899-43be-9468-f199ead48923"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:02:05 crc kubenswrapper[5120]: I0316 17:02:05.314349 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69b6e961-8899-43be-9468-f199ead48923-scripts" (OuterVolumeSpecName: "scripts") pod "69b6e961-8899-43be-9468-f199ead48923" (UID: "69b6e961-8899-43be-9468-f199ead48923"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:02:05 crc kubenswrapper[5120]: I0316 17:02:05.318643 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69b6e961-8899-43be-9468-f199ead48923-kube-api-access-2xdvz" (OuterVolumeSpecName: "kube-api-access-2xdvz") pod "69b6e961-8899-43be-9468-f199ead48923" (UID: "69b6e961-8899-43be-9468-f199ead48923"). InnerVolumeSpecName "kube-api-access-2xdvz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:02:05 crc kubenswrapper[5120]: I0316 17:02:05.367938 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69b6e961-8899-43be-9468-f199ead48923-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "69b6e961-8899-43be-9468-f199ead48923" (UID: "69b6e961-8899-43be-9468-f199ead48923"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:02:05 crc kubenswrapper[5120]: I0316 17:02:05.368995 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69b6e961-8899-43be-9468-f199ead48923-ceilometer-tls-certs" (OuterVolumeSpecName: "ceilometer-tls-certs") pod "69b6e961-8899-43be-9468-f199ead48923" (UID: "69b6e961-8899-43be-9468-f199ead48923"). InnerVolumeSpecName "ceilometer-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:02:05 crc kubenswrapper[5120]: I0316 17:02:05.412380 5120 reconciler_common.go:299] "Volume detached for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/69b6e961-8899-43be-9468-f199ead48923-ceilometer-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:02:05 crc kubenswrapper[5120]: I0316 17:02:05.412406 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2xdvz\" (UniqueName: \"kubernetes.io/projected/69b6e961-8899-43be-9468-f199ead48923-kube-api-access-2xdvz\") on node \"crc\" DevicePath \"\"" Mar 16 17:02:05 crc kubenswrapper[5120]: I0316 17:02:05.412415 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/69b6e961-8899-43be-9468-f199ead48923-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 17:02:05 crc kubenswrapper[5120]: I0316 17:02:05.412424 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/69b6e961-8899-43be-9468-f199ead48923-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:02:05 crc kubenswrapper[5120]: I0316 17:02:05.412431 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/69b6e961-8899-43be-9468-f199ead48923-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 17:02:05 crc kubenswrapper[5120]: I0316 17:02:05.412439 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/69b6e961-8899-43be-9468-f199ead48923-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 17:02:05 crc kubenswrapper[5120]: I0316 17:02:05.451563 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69b6e961-8899-43be-9468-f199ead48923-config-data" (OuterVolumeSpecName: "config-data") pod "69b6e961-8899-43be-9468-f199ead48923" (UID: "69b6e961-8899-43be-9468-f199ead48923"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:02:05 crc kubenswrapper[5120]: I0316 17:02:05.453404 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69b6e961-8899-43be-9468-f199ead48923-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "69b6e961-8899-43be-9468-f199ead48923" (UID: "69b6e961-8899-43be-9468-f199ead48923"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:02:05 crc kubenswrapper[5120]: I0316 17:02:05.514914 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/69b6e961-8899-43be-9468-f199ead48923-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:02:05 crc kubenswrapper[5120]: I0316 17:02:05.514961 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/69b6e961-8899-43be-9468-f199ead48923-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:02:05 crc kubenswrapper[5120]: I0316 17:02:05.781365 5120 generic.go:358] "Generic (PLEG): container finished" podID="69b6e961-8899-43be-9468-f199ead48923" containerID="57556380d05903b43150f0e1e88520977812335ca43baadcc20d6683fa6e3719" exitCode=0 Mar 16 17:02:05 crc kubenswrapper[5120]: I0316 17:02:05.781409 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"69b6e961-8899-43be-9468-f199ead48923","Type":"ContainerDied","Data":"57556380d05903b43150f0e1e88520977812335ca43baadcc20d6683fa6e3719"} Mar 16 17:02:05 crc kubenswrapper[5120]: I0316 17:02:05.781499 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"69b6e961-8899-43be-9468-f199ead48923","Type":"ContainerDied","Data":"a24c5fd95558d0264632785468f767777df60e855742d92e88730644bdb32a79"} Mar 16 17:02:05 crc kubenswrapper[5120]: I0316 17:02:05.781497 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:02:05 crc kubenswrapper[5120]: I0316 17:02:05.781577 5120 scope.go:117] "RemoveContainer" containerID="411e747261cb35828375d792c96d9f9de79dfcd10463b5a6675aa950a091814d" Mar 16 17:02:05 crc kubenswrapper[5120]: I0316 17:02:05.807030 5120 scope.go:117] "RemoveContainer" containerID="c17e595386e6cd004c6bbf435772e0ccd0cd9e669df527a13857627c18505efe" Mar 16 17:02:05 crc kubenswrapper[5120]: I0316 17:02:05.836132 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:02:05 crc kubenswrapper[5120]: I0316 17:02:05.846260 5120 scope.go:117] "RemoveContainer" containerID="57556380d05903b43150f0e1e88520977812335ca43baadcc20d6683fa6e3719" Mar 16 17:02:05 crc kubenswrapper[5120]: I0316 17:02:05.847742 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:02:05 crc kubenswrapper[5120]: I0316 17:02:05.861638 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:02:05 crc kubenswrapper[5120]: I0316 17:02:05.863010 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69b6e961-8899-43be-9468-f199ead48923" containerName="ceilometer-notification-agent" Mar 16 17:02:05 crc kubenswrapper[5120]: I0316 17:02:05.863036 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="69b6e961-8899-43be-9468-f199ead48923" containerName="ceilometer-notification-agent" Mar 16 17:02:05 crc kubenswrapper[5120]: I0316 17:02:05.863090 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69b6e961-8899-43be-9468-f199ead48923" containerName="proxy-httpd" Mar 16 17:02:05 crc kubenswrapper[5120]: I0316 17:02:05.863099 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="69b6e961-8899-43be-9468-f199ead48923" containerName="proxy-httpd" Mar 16 17:02:05 crc kubenswrapper[5120]: I0316 17:02:05.863125 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69b6e961-8899-43be-9468-f199ead48923" containerName="ceilometer-central-agent" Mar 16 17:02:05 crc kubenswrapper[5120]: I0316 17:02:05.863133 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="69b6e961-8899-43be-9468-f199ead48923" containerName="ceilometer-central-agent" Mar 16 17:02:05 crc kubenswrapper[5120]: I0316 17:02:05.863157 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21a5384d-c9cf-429c-9e7e-cc9fb2a825b9" containerName="proxy-httpd" Mar 16 17:02:05 crc kubenswrapper[5120]: I0316 17:02:05.863164 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="21a5384d-c9cf-429c-9e7e-cc9fb2a825b9" containerName="proxy-httpd" Mar 16 17:02:05 crc kubenswrapper[5120]: I0316 17:02:05.863178 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="faf56689-0912-413f-9761-20c85fdbd7cb" containerName="oc" Mar 16 17:02:05 crc kubenswrapper[5120]: I0316 17:02:05.863183 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="faf56689-0912-413f-9761-20c85fdbd7cb" containerName="oc" Mar 16 17:02:05 crc kubenswrapper[5120]: I0316 17:02:05.863193 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21a5384d-c9cf-429c-9e7e-cc9fb2a825b9" containerName="proxy-server" Mar 16 17:02:05 crc kubenswrapper[5120]: I0316 17:02:05.863200 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="21a5384d-c9cf-429c-9e7e-cc9fb2a825b9" containerName="proxy-server" Mar 16 17:02:05 crc kubenswrapper[5120]: I0316 17:02:05.863217 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69b6e961-8899-43be-9468-f199ead48923" containerName="sg-core" Mar 16 17:02:05 crc kubenswrapper[5120]: I0316 17:02:05.863224 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="69b6e961-8899-43be-9468-f199ead48923" containerName="sg-core" Mar 16 17:02:05 crc kubenswrapper[5120]: I0316 17:02:05.863432 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="21a5384d-c9cf-429c-9e7e-cc9fb2a825b9" containerName="proxy-httpd" Mar 16 17:02:05 crc kubenswrapper[5120]: I0316 17:02:05.863445 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="faf56689-0912-413f-9761-20c85fdbd7cb" containerName="oc" Mar 16 17:02:05 crc kubenswrapper[5120]: I0316 17:02:05.863456 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="21a5384d-c9cf-429c-9e7e-cc9fb2a825b9" containerName="proxy-server" Mar 16 17:02:05 crc kubenswrapper[5120]: I0316 17:02:05.863475 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="69b6e961-8899-43be-9468-f199ead48923" containerName="ceilometer-central-agent" Mar 16 17:02:05 crc kubenswrapper[5120]: I0316 17:02:05.863486 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="69b6e961-8899-43be-9468-f199ead48923" containerName="proxy-httpd" Mar 16 17:02:05 crc kubenswrapper[5120]: I0316 17:02:05.863495 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="69b6e961-8899-43be-9468-f199ead48923" containerName="ceilometer-notification-agent" Mar 16 17:02:05 crc kubenswrapper[5120]: I0316 17:02:05.863507 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="69b6e961-8899-43be-9468-f199ead48923" containerName="sg-core" Mar 16 17:02:05 crc kubenswrapper[5120]: I0316 17:02:05.878986 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:02:05 crc kubenswrapper[5120]: I0316 17:02:05.879143 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:02:05 crc kubenswrapper[5120]: I0316 17:02:05.881616 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 17:02:05 crc kubenswrapper[5120]: I0316 17:02:05.881879 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 17:02:05 crc kubenswrapper[5120]: I0316 17:02:05.881947 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ceilometer-internal-svc\"" Mar 16 17:02:05 crc kubenswrapper[5120]: I0316 17:02:05.908494 5120 scope.go:117] "RemoveContainer" containerID="d8faa29bbf662c38afc672335e873815294c123589b63132659da7692be4c59a" Mar 16 17:02:05 crc kubenswrapper[5120]: I0316 17:02:05.924968 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72fv6\" (UniqueName: \"kubernetes.io/projected/9822d70f-7496-4aa6-b0fa-28a1c4ae7db7-kube-api-access-72fv6\") pod \"ceilometer-0\" (UID: \"9822d70f-7496-4aa6-b0fa-28a1c4ae7db7\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:02:05 crc kubenswrapper[5120]: I0316 17:02:05.925056 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9822d70f-7496-4aa6-b0fa-28a1c4ae7db7-scripts\") pod \"ceilometer-0\" (UID: \"9822d70f-7496-4aa6-b0fa-28a1c4ae7db7\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:02:05 crc kubenswrapper[5120]: I0316 17:02:05.925376 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/9822d70f-7496-4aa6-b0fa-28a1c4ae7db7-run-httpd\") pod \"ceilometer-0\" (UID: \"9822d70f-7496-4aa6-b0fa-28a1c4ae7db7\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:02:05 crc kubenswrapper[5120]: I0316 17:02:05.925540 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/9822d70f-7496-4aa6-b0fa-28a1c4ae7db7-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"9822d70f-7496-4aa6-b0fa-28a1c4ae7db7\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:02:05 crc kubenswrapper[5120]: I0316 17:02:05.925652 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/9822d70f-7496-4aa6-b0fa-28a1c4ae7db7-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"9822d70f-7496-4aa6-b0fa-28a1c4ae7db7\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:02:05 crc kubenswrapper[5120]: I0316 17:02:05.925786 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9822d70f-7496-4aa6-b0fa-28a1c4ae7db7-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"9822d70f-7496-4aa6-b0fa-28a1c4ae7db7\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:02:05 crc kubenswrapper[5120]: I0316 17:02:05.925873 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/9822d70f-7496-4aa6-b0fa-28a1c4ae7db7-log-httpd\") pod \"ceilometer-0\" (UID: \"9822d70f-7496-4aa6-b0fa-28a1c4ae7db7\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:02:05 crc kubenswrapper[5120]: I0316 17:02:05.926168 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9822d70f-7496-4aa6-b0fa-28a1c4ae7db7-config-data\") pod \"ceilometer-0\" (UID: \"9822d70f-7496-4aa6-b0fa-28a1c4ae7db7\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:02:05 crc kubenswrapper[5120]: I0316 17:02:05.931213 5120 scope.go:117] "RemoveContainer" containerID="411e747261cb35828375d792c96d9f9de79dfcd10463b5a6675aa950a091814d" Mar 16 17:02:05 crc kubenswrapper[5120]: E0316 17:02:05.931608 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"411e747261cb35828375d792c96d9f9de79dfcd10463b5a6675aa950a091814d\": container with ID starting with 411e747261cb35828375d792c96d9f9de79dfcd10463b5a6675aa950a091814d not found: ID does not exist" containerID="411e747261cb35828375d792c96d9f9de79dfcd10463b5a6675aa950a091814d" Mar 16 17:02:05 crc kubenswrapper[5120]: I0316 17:02:05.931642 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"411e747261cb35828375d792c96d9f9de79dfcd10463b5a6675aa950a091814d"} err="failed to get container status \"411e747261cb35828375d792c96d9f9de79dfcd10463b5a6675aa950a091814d\": rpc error: code = NotFound desc = could not find container \"411e747261cb35828375d792c96d9f9de79dfcd10463b5a6675aa950a091814d\": container with ID starting with 411e747261cb35828375d792c96d9f9de79dfcd10463b5a6675aa950a091814d not found: ID does not exist" Mar 16 17:02:05 crc kubenswrapper[5120]: I0316 17:02:05.931666 5120 scope.go:117] "RemoveContainer" containerID="c17e595386e6cd004c6bbf435772e0ccd0cd9e669df527a13857627c18505efe" Mar 16 17:02:05 crc kubenswrapper[5120]: E0316 17:02:05.932054 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c17e595386e6cd004c6bbf435772e0ccd0cd9e669df527a13857627c18505efe\": container with ID starting with c17e595386e6cd004c6bbf435772e0ccd0cd9e669df527a13857627c18505efe not found: ID does not exist" containerID="c17e595386e6cd004c6bbf435772e0ccd0cd9e669df527a13857627c18505efe" Mar 16 17:02:05 crc kubenswrapper[5120]: I0316 17:02:05.932109 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c17e595386e6cd004c6bbf435772e0ccd0cd9e669df527a13857627c18505efe"} err="failed to get container status \"c17e595386e6cd004c6bbf435772e0ccd0cd9e669df527a13857627c18505efe\": rpc error: code = NotFound desc = could not find container \"c17e595386e6cd004c6bbf435772e0ccd0cd9e669df527a13857627c18505efe\": container with ID starting with c17e595386e6cd004c6bbf435772e0ccd0cd9e669df527a13857627c18505efe not found: ID does not exist" Mar 16 17:02:05 crc kubenswrapper[5120]: I0316 17:02:05.932142 5120 scope.go:117] "RemoveContainer" containerID="57556380d05903b43150f0e1e88520977812335ca43baadcc20d6683fa6e3719" Mar 16 17:02:05 crc kubenswrapper[5120]: E0316 17:02:05.932575 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"57556380d05903b43150f0e1e88520977812335ca43baadcc20d6683fa6e3719\": container with ID starting with 57556380d05903b43150f0e1e88520977812335ca43baadcc20d6683fa6e3719 not found: ID does not exist" containerID="57556380d05903b43150f0e1e88520977812335ca43baadcc20d6683fa6e3719" Mar 16 17:02:05 crc kubenswrapper[5120]: I0316 17:02:05.932600 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57556380d05903b43150f0e1e88520977812335ca43baadcc20d6683fa6e3719"} err="failed to get container status \"57556380d05903b43150f0e1e88520977812335ca43baadcc20d6683fa6e3719\": rpc error: code = NotFound desc = could not find container \"57556380d05903b43150f0e1e88520977812335ca43baadcc20d6683fa6e3719\": container with ID starting with 57556380d05903b43150f0e1e88520977812335ca43baadcc20d6683fa6e3719 not found: ID does not exist" Mar 16 17:02:05 crc kubenswrapper[5120]: I0316 17:02:05.932617 5120 scope.go:117] "RemoveContainer" containerID="d8faa29bbf662c38afc672335e873815294c123589b63132659da7692be4c59a" Mar 16 17:02:05 crc kubenswrapper[5120]: E0316 17:02:05.933024 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d8faa29bbf662c38afc672335e873815294c123589b63132659da7692be4c59a\": container with ID starting with d8faa29bbf662c38afc672335e873815294c123589b63132659da7692be4c59a not found: ID does not exist" containerID="d8faa29bbf662c38afc672335e873815294c123589b63132659da7692be4c59a" Mar 16 17:02:05 crc kubenswrapper[5120]: I0316 17:02:05.933113 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8faa29bbf662c38afc672335e873815294c123589b63132659da7692be4c59a"} err="failed to get container status \"d8faa29bbf662c38afc672335e873815294c123589b63132659da7692be4c59a\": rpc error: code = NotFound desc = could not find container \"d8faa29bbf662c38afc672335e873815294c123589b63132659da7692be4c59a\": container with ID starting with d8faa29bbf662c38afc672335e873815294c123589b63132659da7692be4c59a not found: ID does not exist" Mar 16 17:02:06 crc kubenswrapper[5120]: I0316 17:02:06.028339 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-72fv6\" (UniqueName: \"kubernetes.io/projected/9822d70f-7496-4aa6-b0fa-28a1c4ae7db7-kube-api-access-72fv6\") pod \"ceilometer-0\" (UID: \"9822d70f-7496-4aa6-b0fa-28a1c4ae7db7\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:02:06 crc kubenswrapper[5120]: I0316 17:02:06.028400 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9822d70f-7496-4aa6-b0fa-28a1c4ae7db7-scripts\") pod \"ceilometer-0\" (UID: \"9822d70f-7496-4aa6-b0fa-28a1c4ae7db7\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:02:06 crc kubenswrapper[5120]: I0316 17:02:06.028485 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/9822d70f-7496-4aa6-b0fa-28a1c4ae7db7-run-httpd\") pod \"ceilometer-0\" (UID: \"9822d70f-7496-4aa6-b0fa-28a1c4ae7db7\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:02:06 crc kubenswrapper[5120]: I0316 17:02:06.028533 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/9822d70f-7496-4aa6-b0fa-28a1c4ae7db7-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"9822d70f-7496-4aa6-b0fa-28a1c4ae7db7\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:02:06 crc kubenswrapper[5120]: I0316 17:02:06.028575 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/9822d70f-7496-4aa6-b0fa-28a1c4ae7db7-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"9822d70f-7496-4aa6-b0fa-28a1c4ae7db7\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:02:06 crc kubenswrapper[5120]: I0316 17:02:06.028800 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9822d70f-7496-4aa6-b0fa-28a1c4ae7db7-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"9822d70f-7496-4aa6-b0fa-28a1c4ae7db7\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:02:06 crc kubenswrapper[5120]: I0316 17:02:06.028868 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/9822d70f-7496-4aa6-b0fa-28a1c4ae7db7-log-httpd\") pod \"ceilometer-0\" (UID: \"9822d70f-7496-4aa6-b0fa-28a1c4ae7db7\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:02:06 crc kubenswrapper[5120]: I0316 17:02:06.029080 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9822d70f-7496-4aa6-b0fa-28a1c4ae7db7-config-data\") pod \"ceilometer-0\" (UID: \"9822d70f-7496-4aa6-b0fa-28a1c4ae7db7\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:02:06 crc kubenswrapper[5120]: I0316 17:02:06.029173 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/9822d70f-7496-4aa6-b0fa-28a1c4ae7db7-run-httpd\") pod \"ceilometer-0\" (UID: \"9822d70f-7496-4aa6-b0fa-28a1c4ae7db7\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:02:06 crc kubenswrapper[5120]: I0316 17:02:06.029859 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/9822d70f-7496-4aa6-b0fa-28a1c4ae7db7-log-httpd\") pod \"ceilometer-0\" (UID: \"9822d70f-7496-4aa6-b0fa-28a1c4ae7db7\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:02:06 crc kubenswrapper[5120]: I0316 17:02:06.034451 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/9822d70f-7496-4aa6-b0fa-28a1c4ae7db7-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"9822d70f-7496-4aa6-b0fa-28a1c4ae7db7\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:02:06 crc kubenswrapper[5120]: I0316 17:02:06.034513 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/9822d70f-7496-4aa6-b0fa-28a1c4ae7db7-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"9822d70f-7496-4aa6-b0fa-28a1c4ae7db7\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:02:06 crc kubenswrapper[5120]: I0316 17:02:06.034744 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9822d70f-7496-4aa6-b0fa-28a1c4ae7db7-scripts\") pod \"ceilometer-0\" (UID: \"9822d70f-7496-4aa6-b0fa-28a1c4ae7db7\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:02:06 crc kubenswrapper[5120]: I0316 17:02:06.038590 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9822d70f-7496-4aa6-b0fa-28a1c4ae7db7-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"9822d70f-7496-4aa6-b0fa-28a1c4ae7db7\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:02:06 crc kubenswrapper[5120]: I0316 17:02:06.043457 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9822d70f-7496-4aa6-b0fa-28a1c4ae7db7-config-data\") pod \"ceilometer-0\" (UID: \"9822d70f-7496-4aa6-b0fa-28a1c4ae7db7\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:02:06 crc kubenswrapper[5120]: I0316 17:02:06.047056 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-72fv6\" (UniqueName: \"kubernetes.io/projected/9822d70f-7496-4aa6-b0fa-28a1c4ae7db7-kube-api-access-72fv6\") pod \"ceilometer-0\" (UID: \"9822d70f-7496-4aa6-b0fa-28a1c4ae7db7\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:02:06 crc kubenswrapper[5120]: I0316 17:02:06.203115 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:02:06 crc kubenswrapper[5120]: I0316 17:02:06.664800 5120 scope.go:117] "RemoveContainer" containerID="3f4aafa32edd97a4cd6857832bfde24c5f9a3e7c30285ec0f3a7bd7c08f686da" Mar 16 17:02:06 crc kubenswrapper[5120]: E0316 17:02:06.665439 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nova-cell1-conductor-conductor\" with CrashLoopBackOff: \"back-off 40s restarting failed container=nova-cell1-conductor-conductor pod=nova-cell1-conductor-0_openstack-kuttl-tests(61d14db6-7d33-4e5f-8252-844441e519d7)\"" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="61d14db6-7d33-4e5f-8252-844441e519d7" Mar 16 17:02:06 crc kubenswrapper[5120]: I0316 17:02:06.676098 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="69b6e961-8899-43be-9468-f199ead48923" path="/var/lib/kubelet/pods/69b6e961-8899-43be-9468-f199ead48923/volumes" Mar 16 17:02:06 crc kubenswrapper[5120]: I0316 17:02:06.676820 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="78e8efc3-678e-4afe-91ff-45758c8ddf5e" path="/var/lib/kubelet/pods/78e8efc3-678e-4afe-91ff-45758c8ddf5e/volumes" Mar 16 17:02:06 crc kubenswrapper[5120]: W0316 17:02:06.813492 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9822d70f_7496_4aa6_b0fa_28a1c4ae7db7.slice/crio-1a09492f78c17606cf71f4cb4d20e58db67b975d2936e443567850b209531166 WatchSource:0}: Error finding container 1a09492f78c17606cf71f4cb4d20e58db67b975d2936e443567850b209531166: Status 404 returned error can't find the container with id 1a09492f78c17606cf71f4cb4d20e58db67b975d2936e443567850b209531166 Mar 16 17:02:06 crc kubenswrapper[5120]: I0316 17:02:06.824357 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:02:07 crc kubenswrapper[5120]: I0316 17:02:07.815917 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"9822d70f-7496-4aa6-b0fa-28a1c4ae7db7","Type":"ContainerStarted","Data":"676ecca2659a20874ab25a6a892347a8f432119ffef02332827f47ffc00c26af"} Mar 16 17:02:07 crc kubenswrapper[5120]: I0316 17:02:07.816215 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"9822d70f-7496-4aa6-b0fa-28a1c4ae7db7","Type":"ContainerStarted","Data":"1a09492f78c17606cf71f4cb4d20e58db67b975d2936e443567850b209531166"} Mar 16 17:02:08 crc kubenswrapper[5120]: I0316 17:02:08.415237 5120 scope.go:117] "RemoveContainer" containerID="7154b5d6a06ae5d00b3ae356df0053f9e57a21e683e816164febe3789fe1d5ef" Mar 16 17:02:08 crc kubenswrapper[5120]: E0316 17:02:08.457967 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1898096 actualBytes=10240 Mar 16 17:02:08 crc kubenswrapper[5120]: I0316 17:02:08.514607 5120 scope.go:117] "RemoveContainer" containerID="da4e14c0ef027b329c77ef62b6ff40907a0fbb23df124dacb6638f85fd17bb1e" Mar 16 17:02:08 crc kubenswrapper[5120]: I0316 17:02:08.831861 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"9822d70f-7496-4aa6-b0fa-28a1c4ae7db7","Type":"ContainerStarted","Data":"66f1189a24416e91074b04dcaf79e83fefb91f45f121a8fd03153adae3b4103d"} Mar 16 17:02:09 crc kubenswrapper[5120]: I0316 17:02:09.852049 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"9822d70f-7496-4aa6-b0fa-28a1c4ae7db7","Type":"ContainerStarted","Data":"f13096a43403b81a2b3ce5c5e96d83e5f8b0fbb45eae3a01b928bf03074aa9f1"} Mar 16 17:02:11 crc kubenswrapper[5120]: I0316 17:02:11.872904 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"9822d70f-7496-4aa6-b0fa-28a1c4ae7db7","Type":"ContainerStarted","Data":"44084d0cacbd15cd8ba43433333853d104701dcb0fd8b785f4da824e3dfbe0e3"} Mar 16 17:02:11 crc kubenswrapper[5120]: I0316 17:02:11.874273 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:02:11 crc kubenswrapper[5120]: I0316 17:02:11.901962 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.625164133 podStartE2EDuration="6.901943279s" podCreationTimestamp="2026-03-16 17:02:05 +0000 UTC" firstStartedPulling="2026-03-16 17:02:06.815735293 +0000 UTC m=+5428.969666940" lastFinishedPulling="2026-03-16 17:02:11.092514429 +0000 UTC m=+5433.246446086" observedRunningTime="2026-03-16 17:02:11.894566886 +0000 UTC m=+5434.048498553" watchObservedRunningTime="2026-03-16 17:02:11.901943279 +0000 UTC m=+5434.055874936" Mar 16 17:02:17 crc kubenswrapper[5120]: I0316 17:02:17.664340 5120 scope.go:117] "RemoveContainer" containerID="3f4aafa32edd97a4cd6857832bfde24c5f9a3e7c30285ec0f3a7bd7c08f686da" Mar 16 17:02:17 crc kubenswrapper[5120]: E0316 17:02:17.665918 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nova-cell1-conductor-conductor\" with CrashLoopBackOff: \"back-off 40s restarting failed container=nova-cell1-conductor-conductor pod=nova-cell1-conductor-0_openstack-kuttl-tests(61d14db6-7d33-4e5f-8252-844441e519d7)\"" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="61d14db6-7d33-4e5f-8252-844441e519d7" Mar 16 17:02:18 crc kubenswrapper[5120]: I0316 17:02:18.956046 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-8bf9bfcb4-2674f_95dbfc71-6afe-4106-b073-5a1edcc8788f/neutron-api/0.log" Mar 16 17:02:18 crc kubenswrapper[5120]: I0316 17:02:18.956346 5120 generic.go:358] "Generic (PLEG): container finished" podID="95dbfc71-6afe-4106-b073-5a1edcc8788f" containerID="5710a825d9e4076d2f3ae7a10f79b432da7ef32f643953fd0702e760bcea2f0a" exitCode=137 Mar 16 17:02:18 crc kubenswrapper[5120]: I0316 17:02:18.956383 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-8bf9bfcb4-2674f" event={"ID":"95dbfc71-6afe-4106-b073-5a1edcc8788f","Type":"ContainerDied","Data":"5710a825d9e4076d2f3ae7a10f79b432da7ef32f643953fd0702e760bcea2f0a"} Mar 16 17:02:19 crc kubenswrapper[5120]: I0316 17:02:19.295217 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-8bf9bfcb4-2674f_95dbfc71-6afe-4106-b073-5a1edcc8788f/neutron-api/0.log" Mar 16 17:02:19 crc kubenswrapper[5120]: I0316 17:02:19.295310 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-8bf9bfcb4-2674f" Mar 16 17:02:19 crc kubenswrapper[5120]: I0316 17:02:19.316740 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/95dbfc71-6afe-4106-b073-5a1edcc8788f-httpd-config\") pod \"95dbfc71-6afe-4106-b073-5a1edcc8788f\" (UID: \"95dbfc71-6afe-4106-b073-5a1edcc8788f\") " Mar 16 17:02:19 crc kubenswrapper[5120]: I0316 17:02:19.316968 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/95dbfc71-6afe-4106-b073-5a1edcc8788f-config\") pod \"95dbfc71-6afe-4106-b073-5a1edcc8788f\" (UID: \"95dbfc71-6afe-4106-b073-5a1edcc8788f\") " Mar 16 17:02:19 crc kubenswrapper[5120]: I0316 17:02:19.317094 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/95dbfc71-6afe-4106-b073-5a1edcc8788f-internal-tls-certs\") pod \"95dbfc71-6afe-4106-b073-5a1edcc8788f\" (UID: \"95dbfc71-6afe-4106-b073-5a1edcc8788f\") " Mar 16 17:02:19 crc kubenswrapper[5120]: I0316 17:02:19.317135 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wnp4p\" (UniqueName: \"kubernetes.io/projected/95dbfc71-6afe-4106-b073-5a1edcc8788f-kube-api-access-wnp4p\") pod \"95dbfc71-6afe-4106-b073-5a1edcc8788f\" (UID: \"95dbfc71-6afe-4106-b073-5a1edcc8788f\") " Mar 16 17:02:19 crc kubenswrapper[5120]: I0316 17:02:19.317226 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/95dbfc71-6afe-4106-b073-5a1edcc8788f-public-tls-certs\") pod \"95dbfc71-6afe-4106-b073-5a1edcc8788f\" (UID: \"95dbfc71-6afe-4106-b073-5a1edcc8788f\") " Mar 16 17:02:19 crc kubenswrapper[5120]: I0316 17:02:19.317528 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/95dbfc71-6afe-4106-b073-5a1edcc8788f-combined-ca-bundle\") pod \"95dbfc71-6afe-4106-b073-5a1edcc8788f\" (UID: \"95dbfc71-6afe-4106-b073-5a1edcc8788f\") " Mar 16 17:02:19 crc kubenswrapper[5120]: I0316 17:02:19.317611 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/95dbfc71-6afe-4106-b073-5a1edcc8788f-ovndb-tls-certs\") pod \"95dbfc71-6afe-4106-b073-5a1edcc8788f\" (UID: \"95dbfc71-6afe-4106-b073-5a1edcc8788f\") " Mar 16 17:02:19 crc kubenswrapper[5120]: I0316 17:02:19.332777 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/95dbfc71-6afe-4106-b073-5a1edcc8788f-httpd-config" (OuterVolumeSpecName: "httpd-config") pod "95dbfc71-6afe-4106-b073-5a1edcc8788f" (UID: "95dbfc71-6afe-4106-b073-5a1edcc8788f"). InnerVolumeSpecName "httpd-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:02:19 crc kubenswrapper[5120]: I0316 17:02:19.334968 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95dbfc71-6afe-4106-b073-5a1edcc8788f-kube-api-access-wnp4p" (OuterVolumeSpecName: "kube-api-access-wnp4p") pod "95dbfc71-6afe-4106-b073-5a1edcc8788f" (UID: "95dbfc71-6afe-4106-b073-5a1edcc8788f"). InnerVolumeSpecName "kube-api-access-wnp4p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:02:19 crc kubenswrapper[5120]: I0316 17:02:19.376327 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/95dbfc71-6afe-4106-b073-5a1edcc8788f-config" (OuterVolumeSpecName: "config") pod "95dbfc71-6afe-4106-b073-5a1edcc8788f" (UID: "95dbfc71-6afe-4106-b073-5a1edcc8788f"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:02:19 crc kubenswrapper[5120]: I0316 17:02:19.381886 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/95dbfc71-6afe-4106-b073-5a1edcc8788f-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "95dbfc71-6afe-4106-b073-5a1edcc8788f" (UID: "95dbfc71-6afe-4106-b073-5a1edcc8788f"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:02:19 crc kubenswrapper[5120]: I0316 17:02:19.388594 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/95dbfc71-6afe-4106-b073-5a1edcc8788f-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "95dbfc71-6afe-4106-b073-5a1edcc8788f" (UID: "95dbfc71-6afe-4106-b073-5a1edcc8788f"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:02:19 crc kubenswrapper[5120]: I0316 17:02:19.399542 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/95dbfc71-6afe-4106-b073-5a1edcc8788f-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "95dbfc71-6afe-4106-b073-5a1edcc8788f" (UID: "95dbfc71-6afe-4106-b073-5a1edcc8788f"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:02:19 crc kubenswrapper[5120]: I0316 17:02:19.406915 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/95dbfc71-6afe-4106-b073-5a1edcc8788f-ovndb-tls-certs" (OuterVolumeSpecName: "ovndb-tls-certs") pod "95dbfc71-6afe-4106-b073-5a1edcc8788f" (UID: "95dbfc71-6afe-4106-b073-5a1edcc8788f"). InnerVolumeSpecName "ovndb-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:02:19 crc kubenswrapper[5120]: I0316 17:02:19.422161 5120 reconciler_common.go:299] "Volume detached for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/95dbfc71-6afe-4106-b073-5a1edcc8788f-ovndb-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:02:19 crc kubenswrapper[5120]: I0316 17:02:19.422312 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/95dbfc71-6afe-4106-b073-5a1edcc8788f-httpd-config\") on node \"crc\" DevicePath \"\"" Mar 16 17:02:19 crc kubenswrapper[5120]: I0316 17:02:19.422326 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/95dbfc71-6afe-4106-b073-5a1edcc8788f-config\") on node \"crc\" DevicePath \"\"" Mar 16 17:02:19 crc kubenswrapper[5120]: I0316 17:02:19.422336 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/95dbfc71-6afe-4106-b073-5a1edcc8788f-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:02:19 crc kubenswrapper[5120]: I0316 17:02:19.422349 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wnp4p\" (UniqueName: \"kubernetes.io/projected/95dbfc71-6afe-4106-b073-5a1edcc8788f-kube-api-access-wnp4p\") on node \"crc\" DevicePath \"\"" Mar 16 17:02:19 crc kubenswrapper[5120]: I0316 17:02:19.422359 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/95dbfc71-6afe-4106-b073-5a1edcc8788f-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:02:19 crc kubenswrapper[5120]: I0316 17:02:19.422392 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/95dbfc71-6afe-4106-b073-5a1edcc8788f-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:02:19 crc kubenswrapper[5120]: I0316 17:02:19.968645 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-8bf9bfcb4-2674f_95dbfc71-6afe-4106-b073-5a1edcc8788f/neutron-api/0.log" Mar 16 17:02:19 crc kubenswrapper[5120]: I0316 17:02:19.968818 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-8bf9bfcb4-2674f" event={"ID":"95dbfc71-6afe-4106-b073-5a1edcc8788f","Type":"ContainerDied","Data":"07b36da95c63b12da12f2880154c3d89e00fdbc5f6e3f1b478785dc4a210a94f"} Mar 16 17:02:19 crc kubenswrapper[5120]: I0316 17:02:19.968902 5120 scope.go:117] "RemoveContainer" containerID="43e6ee80bea5ccacd6e9cadc35391850863b090665249e7bb5dc73470649ce9d" Mar 16 17:02:19 crc kubenswrapper[5120]: I0316 17:02:19.969248 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-8bf9bfcb4-2674f" Mar 16 17:02:20 crc kubenswrapper[5120]: I0316 17:02:20.026183 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-8bf9bfcb4-2674f"] Mar 16 17:02:20 crc kubenswrapper[5120]: I0316 17:02:20.028061 5120 scope.go:117] "RemoveContainer" containerID="5710a825d9e4076d2f3ae7a10f79b432da7ef32f643953fd0702e760bcea2f0a" Mar 16 17:02:20 crc kubenswrapper[5120]: I0316 17:02:20.039135 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-8bf9bfcb4-2674f"] Mar 16 17:02:20 crc kubenswrapper[5120]: I0316 17:02:20.680572 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="95dbfc71-6afe-4106-b073-5a1edcc8788f" path="/var/lib/kubelet/pods/95dbfc71-6afe-4106-b073-5a1edcc8788f/volumes" Mar 16 17:02:22 crc kubenswrapper[5120]: I0316 17:02:22.008270 5120 patch_prober.go:28] interesting pod/machine-config-daemon-7bf76 container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 17:02:22 crc kubenswrapper[5120]: I0316 17:02:22.008341 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 17:02:32 crc kubenswrapper[5120]: I0316 17:02:32.663810 5120 scope.go:117] "RemoveContainer" containerID="3f4aafa32edd97a4cd6857832bfde24c5f9a3e7c30285ec0f3a7bd7c08f686da" Mar 16 17:02:33 crc kubenswrapper[5120]: I0316 17:02:33.117863 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"61d14db6-7d33-4e5f-8252-844441e519d7","Type":"ContainerStarted","Data":"8d1a8aa9bd86f2402b10b59285567fd78f4d62123af2fd8a44ad19b94394c08b"} Mar 16 17:02:33 crc kubenswrapper[5120]: I0316 17:02:33.118323 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 17:02:39 crc kubenswrapper[5120]: I0316 17:02:39.158677 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 17:02:42 crc kubenswrapper[5120]: I0316 17:02:42.891667 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:02:45 crc kubenswrapper[5120]: E0316 17:02:45.751058 5120 upgradeaware.go:427] Error proxying data from client to backend: readfrom tcp 38.102.83.119:44870->38.102.83.119:44311: write tcp 38.102.83.119:44870->38.102.83.119:44311: write: broken pipe Mar 16 17:02:47 crc kubenswrapper[5120]: E0316 17:02:47.473699 5120 upgradeaware.go:427] Error proxying data from client to backend: readfrom tcp 38.102.83.119:44968->38.102.83.119:44311: write tcp 38.102.83.119:44968->38.102.83.119:44311: write: connection reset by peer Mar 16 17:02:52 crc kubenswrapper[5120]: I0316 17:02:52.007683 5120 patch_prober.go:28] interesting pod/machine-config-daemon-7bf76 container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 17:02:52 crc kubenswrapper[5120]: I0316 17:02:52.008237 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 17:02:52 crc kubenswrapper[5120]: I0316 17:02:52.008290 5120 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" Mar 16 17:02:52 crc kubenswrapper[5120]: I0316 17:02:52.009137 5120 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="machine-config-daemon" containerStatusID={"Type":"cri-o","ID":"1a8491415f508d1d670b146ede741f345c7a12252caa1b80c34ffc970e7850f6"} pod="openshift-machine-config-operator/machine-config-daemon-7bf76" containerMessage="Container machine-config-daemon failed liveness probe, will be restarted" Mar 16 17:02:52 crc kubenswrapper[5120]: I0316 17:02:52.009203 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" containerID="cri-o://1a8491415f508d1d670b146ede741f345c7a12252caa1b80c34ffc970e7850f6" gracePeriod=600 Mar 16 17:02:52 crc kubenswrapper[5120]: I0316 17:02:52.327297 5120 generic.go:358] "Generic (PLEG): container finished" podID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerID="1a8491415f508d1d670b146ede741f345c7a12252caa1b80c34ffc970e7850f6" exitCode=0 Mar 16 17:02:52 crc kubenswrapper[5120]: I0316 17:02:52.327376 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" event={"ID":"e2275cb4-4905-4d66-a87e-8010120db2bd","Type":"ContainerDied","Data":"1a8491415f508d1d670b146ede741f345c7a12252caa1b80c34ffc970e7850f6"} Mar 16 17:02:52 crc kubenswrapper[5120]: I0316 17:02:52.327439 5120 scope.go:117] "RemoveContainer" containerID="083f72646c8d47c9c0467b39be99ddfa9c2e5900ae0a29ad53d7b39b950274b4" Mar 16 17:02:53 crc kubenswrapper[5120]: I0316 17:02:53.341882 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" event={"ID":"e2275cb4-4905-4d66-a87e-8010120db2bd","Type":"ContainerStarted","Data":"db39d192fa687a13805537d08ad22fed1ef362ef5027c920a616297dc55a8ea9"} Mar 16 17:03:01 crc kubenswrapper[5120]: I0316 17:03:01.058854 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-4aec-account-create-update-qxxcv"] Mar 16 17:03:01 crc kubenswrapper[5120]: I0316 17:03:01.084444 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-4aec-account-create-update-qxxcv"] Mar 16 17:03:01 crc kubenswrapper[5120]: I0316 17:03:01.094474 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-4aec-account-create-update-wk5d7"] Mar 16 17:03:01 crc kubenswrapper[5120]: I0316 17:03:01.097567 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95dbfc71-6afe-4106-b073-5a1edcc8788f" containerName="neutron-api" Mar 16 17:03:01 crc kubenswrapper[5120]: I0316 17:03:01.097595 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="95dbfc71-6afe-4106-b073-5a1edcc8788f" containerName="neutron-api" Mar 16 17:03:01 crc kubenswrapper[5120]: I0316 17:03:01.097624 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95dbfc71-6afe-4106-b073-5a1edcc8788f" containerName="neutron-httpd" Mar 16 17:03:01 crc kubenswrapper[5120]: I0316 17:03:01.097632 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="95dbfc71-6afe-4106-b073-5a1edcc8788f" containerName="neutron-httpd" Mar 16 17:03:01 crc kubenswrapper[5120]: I0316 17:03:01.097855 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="95dbfc71-6afe-4106-b073-5a1edcc8788f" containerName="neutron-api" Mar 16 17:03:01 crc kubenswrapper[5120]: I0316 17:03:01.097877 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="95dbfc71-6afe-4106-b073-5a1edcc8788f" containerName="neutron-httpd" Mar 16 17:03:01 crc kubenswrapper[5120]: I0316 17:03:01.146920 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 17:03:01 crc kubenswrapper[5120]: I0316 17:03:01.146956 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-4aec-account-create-update-wk5d7"] Mar 16 17:03:01 crc kubenswrapper[5120]: I0316 17:03:01.147663 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-4aec-account-create-update-wk5d7" Mar 16 17:03:01 crc kubenswrapper[5120]: I0316 17:03:01.153174 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-db-secret\"" Mar 16 17:03:01 crc kubenswrapper[5120]: I0316 17:03:01.159908 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/root-account-create-update-m55p2"] Mar 16 17:03:01 crc kubenswrapper[5120]: I0316 17:03:01.173284 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-m55p2"] Mar 16 17:03:01 crc kubenswrapper[5120]: I0316 17:03:01.173702 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-m55p2" Mar 16 17:03:01 crc kubenswrapper[5120]: I0316 17:03:01.189029 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"openstack-mariadb-root-db-secret\"" Mar 16 17:03:01 crc kubenswrapper[5120]: I0316 17:03:01.189723 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 17:03:01 crc kubenswrapper[5120]: I0316 17:03:01.190169 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/openstackclient" podUID="a6d827da-888b-4463-b40a-041fef751ccc" containerName="openstackclient" containerID="cri-o://da57d0c85c4077395552861f82bea57510e45a2fb6167418fad685206cdc28c3" gracePeriod=2 Mar 16 17:03:01 crc kubenswrapper[5120]: I0316 17:03:01.197350 5120 status_manager.go:895] "Failed to get status for pod" podUID="a6d827da-888b-4463-b40a-041fef751ccc" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 17:03:01 crc kubenswrapper[5120]: I0316 17:03:01.226738 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 17:03:01 crc kubenswrapper[5120]: I0316 17:03:01.275180 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-psx4m"] Mar 16 17:03:01 crc kubenswrapper[5120]: I0316 17:03:01.286281 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4qnh\" (UniqueName: \"kubernetes.io/projected/4aa85fd7-7d77-4285-97ff-4fa658725080-kube-api-access-m4qnh\") pod \"cinder-4aec-account-create-update-wk5d7\" (UID: \"4aa85fd7-7d77-4285-97ff-4fa658725080\") " pod="openstack-kuttl-tests/cinder-4aec-account-create-update-wk5d7" Mar 16 17:03:01 crc kubenswrapper[5120]: I0316 17:03:01.286382 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmfns\" (UniqueName: \"kubernetes.io/projected/70e3d80b-ae48-4742-90dd-95c106254f9f-kube-api-access-zmfns\") pod \"root-account-create-update-m55p2\" (UID: \"70e3d80b-ae48-4742-90dd-95c106254f9f\") " pod="openstack-kuttl-tests/root-account-create-update-m55p2" Mar 16 17:03:01 crc kubenswrapper[5120]: I0316 17:03:01.286446 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/70e3d80b-ae48-4742-90dd-95c106254f9f-operator-scripts\") pod \"root-account-create-update-m55p2\" (UID: \"70e3d80b-ae48-4742-90dd-95c106254f9f\") " pod="openstack-kuttl-tests/root-account-create-update-m55p2" Mar 16 17:03:01 crc kubenswrapper[5120]: I0316 17:03:01.286615 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/4aa85fd7-7d77-4285-97ff-4fa658725080-operator-scripts\") pod \"cinder-4aec-account-create-update-wk5d7\" (UID: \"4aa85fd7-7d77-4285-97ff-4fa658725080\") " pod="openstack-kuttl-tests/cinder-4aec-account-create-update-wk5d7" Mar 16 17:03:01 crc kubenswrapper[5120]: I0316 17:03:01.294938 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-psx4m"] Mar 16 17:03:01 crc kubenswrapper[5120]: I0316 17:03:01.315908 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-cd46-account-create-update-9454l"] Mar 16 17:03:01 crc kubenswrapper[5120]: I0316 17:03:01.366864 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-cd46-account-create-update-9454l"] Mar 16 17:03:01 crc kubenswrapper[5120]: I0316 17:03:01.384609 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-cd46-account-create-update-mrxmb"] Mar 16 17:03:01 crc kubenswrapper[5120]: I0316 17:03:01.385999 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6d827da-888b-4463-b40a-041fef751ccc" containerName="openstackclient" Mar 16 17:03:01 crc kubenswrapper[5120]: I0316 17:03:01.386018 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6d827da-888b-4463-b40a-041fef751ccc" containerName="openstackclient" Mar 16 17:03:01 crc kubenswrapper[5120]: I0316 17:03:01.386253 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="a6d827da-888b-4463-b40a-041fef751ccc" containerName="openstackclient" Mar 16 17:03:01 crc kubenswrapper[5120]: I0316 17:03:01.389046 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m4qnh\" (UniqueName: \"kubernetes.io/projected/4aa85fd7-7d77-4285-97ff-4fa658725080-kube-api-access-m4qnh\") pod \"cinder-4aec-account-create-update-wk5d7\" (UID: \"4aa85fd7-7d77-4285-97ff-4fa658725080\") " pod="openstack-kuttl-tests/cinder-4aec-account-create-update-wk5d7" Mar 16 17:03:01 crc kubenswrapper[5120]: I0316 17:03:01.389151 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zmfns\" (UniqueName: \"kubernetes.io/projected/70e3d80b-ae48-4742-90dd-95c106254f9f-kube-api-access-zmfns\") pod \"root-account-create-update-m55p2\" (UID: \"70e3d80b-ae48-4742-90dd-95c106254f9f\") " pod="openstack-kuttl-tests/root-account-create-update-m55p2" Mar 16 17:03:01 crc kubenswrapper[5120]: I0316 17:03:01.389216 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/70e3d80b-ae48-4742-90dd-95c106254f9f-operator-scripts\") pod \"root-account-create-update-m55p2\" (UID: \"70e3d80b-ae48-4742-90dd-95c106254f9f\") " pod="openstack-kuttl-tests/root-account-create-update-m55p2" Mar 16 17:03:01 crc kubenswrapper[5120]: I0316 17:03:01.389363 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/4aa85fd7-7d77-4285-97ff-4fa658725080-operator-scripts\") pod \"cinder-4aec-account-create-update-wk5d7\" (UID: \"4aa85fd7-7d77-4285-97ff-4fa658725080\") " pod="openstack-kuttl-tests/cinder-4aec-account-create-update-wk5d7" Mar 16 17:03:01 crc kubenswrapper[5120]: I0316 17:03:01.390557 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/4aa85fd7-7d77-4285-97ff-4fa658725080-operator-scripts\") pod \"cinder-4aec-account-create-update-wk5d7\" (UID: \"4aa85fd7-7d77-4285-97ff-4fa658725080\") " pod="openstack-kuttl-tests/cinder-4aec-account-create-update-wk5d7" Mar 16 17:03:01 crc kubenswrapper[5120]: I0316 17:03:01.390700 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/70e3d80b-ae48-4742-90dd-95c106254f9f-operator-scripts\") pod \"root-account-create-update-m55p2\" (UID: \"70e3d80b-ae48-4742-90dd-95c106254f9f\") " pod="openstack-kuttl-tests/root-account-create-update-m55p2" Mar 16 17:03:01 crc kubenswrapper[5120]: I0316 17:03:01.397928 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-cd46-account-create-update-mrxmb" Mar 16 17:03:01 crc kubenswrapper[5120]: I0316 17:03:01.417752 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-db-secret\"" Mar 16 17:03:01 crc kubenswrapper[5120]: I0316 17:03:01.417868 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-cd46-account-create-update-mrxmb"] Mar 16 17:03:01 crc kubenswrapper[5120]: I0316 17:03:01.428540 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 17:03:01 crc kubenswrapper[5120]: I0316 17:03:01.428975 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podUID="5f9a749e-2dbb-409d-b935-4f2891d43397" containerName="openstack-network-exporter" containerID="cri-o://b9ea6c64365c3398bfb7a01d52bf92315e0914e469529e7c3947aad7173b22b9" gracePeriod=300 Mar 16 17:03:01 crc kubenswrapper[5120]: I0316 17:03:01.480560 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmfns\" (UniqueName: \"kubernetes.io/projected/70e3d80b-ae48-4742-90dd-95c106254f9f-kube-api-access-zmfns\") pod \"root-account-create-update-m55p2\" (UID: \"70e3d80b-ae48-4742-90dd-95c106254f9f\") " pod="openstack-kuttl-tests/root-account-create-update-m55p2" Mar 16 17:03:01 crc kubenswrapper[5120]: I0316 17:03:01.487005 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4qnh\" (UniqueName: \"kubernetes.io/projected/4aa85fd7-7d77-4285-97ff-4fa658725080-kube-api-access-m4qnh\") pod \"cinder-4aec-account-create-update-wk5d7\" (UID: \"4aa85fd7-7d77-4285-97ff-4fa658725080\") " pod="openstack-kuttl-tests/cinder-4aec-account-create-update-wk5d7" Mar 16 17:03:01 crc kubenswrapper[5120]: I0316 17:03:01.492176 5120 status_manager.go:895] "Failed to get status for pod" podUID="a6d827da-888b-4463-b40a-041fef751ccc" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 17:03:01 crc kubenswrapper[5120]: I0316 17:03:01.494075 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3e9c8fc2-85ba-4408-a98b-56b2d62da7e3-operator-scripts\") pod \"barbican-cd46-account-create-update-mrxmb\" (UID: \"3e9c8fc2-85ba-4408-a98b-56b2d62da7e3\") " pod="openstack-kuttl-tests/barbican-cd46-account-create-update-mrxmb" Mar 16 17:03:01 crc kubenswrapper[5120]: I0316 17:03:01.494587 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pld6p\" (UniqueName: \"kubernetes.io/projected/3e9c8fc2-85ba-4408-a98b-56b2d62da7e3-kube-api-access-pld6p\") pod \"barbican-cd46-account-create-update-mrxmb\" (UID: \"3e9c8fc2-85ba-4408-a98b-56b2d62da7e3\") " pod="openstack-kuttl-tests/barbican-cd46-account-create-update-mrxmb" Mar 16 17:03:01 crc kubenswrapper[5120]: I0316 17:03:01.496952 5120 status_manager.go:895] "Failed to get status for pod" podUID="a6d827da-888b-4463-b40a-041fef751ccc" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 17:03:01 crc kubenswrapper[5120]: I0316 17:03:01.501297 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-4aec-account-create-update-wk5d7" Mar 16 17:03:01 crc kubenswrapper[5120]: I0316 17:03:01.517079 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-m55p2" Mar 16 17:03:01 crc kubenswrapper[5120]: I0316 17:03:01.556360 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 17:03:01 crc kubenswrapper[5120]: I0316 17:03:01.606489 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pld6p\" (UniqueName: \"kubernetes.io/projected/3e9c8fc2-85ba-4408-a98b-56b2d62da7e3-kube-api-access-pld6p\") pod \"barbican-cd46-account-create-update-mrxmb\" (UID: \"3e9c8fc2-85ba-4408-a98b-56b2d62da7e3\") " pod="openstack-kuttl-tests/barbican-cd46-account-create-update-mrxmb" Mar 16 17:03:01 crc kubenswrapper[5120]: I0316 17:03:01.606719 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3e9c8fc2-85ba-4408-a98b-56b2d62da7e3-operator-scripts\") pod \"barbican-cd46-account-create-update-mrxmb\" (UID: \"3e9c8fc2-85ba-4408-a98b-56b2d62da7e3\") " pod="openstack-kuttl-tests/barbican-cd46-account-create-update-mrxmb" Mar 16 17:03:01 crc kubenswrapper[5120]: I0316 17:03:01.611678 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3e9c8fc2-85ba-4408-a98b-56b2d62da7e3-operator-scripts\") pod \"barbican-cd46-account-create-update-mrxmb\" (UID: \"3e9c8fc2-85ba-4408-a98b-56b2d62da7e3\") " pod="openstack-kuttl-tests/barbican-cd46-account-create-update-mrxmb" Mar 16 17:03:01 crc kubenswrapper[5120]: I0316 17:03:01.626951 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 17:03:01 crc kubenswrapper[5120]: I0316 17:03:01.627801 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podUID="e5f68c9e-894a-4eac-90fc-be12f8c49913" containerName="openstack-network-exporter" containerID="cri-o://c6c3b078bcba74c557bdc2e467fc6e2de0b3d668951e7953bb03062d2d6e4f47" gracePeriod=300 Mar 16 17:03:01 crc kubenswrapper[5120]: I0316 17:03:01.635122 5120 status_manager.go:895] "Failed to get status for pod" podUID="a6d827da-888b-4463-b40a-041fef751ccc" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 17:03:01 crc kubenswrapper[5120]: I0316 17:03:01.678215 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pld6p\" (UniqueName: \"kubernetes.io/projected/3e9c8fc2-85ba-4408-a98b-56b2d62da7e3-kube-api-access-pld6p\") pod \"barbican-cd46-account-create-update-mrxmb\" (UID: \"3e9c8fc2-85ba-4408-a98b-56b2d62da7e3\") " pod="openstack-kuttl-tests/barbican-cd46-account-create-update-mrxmb" Mar 16 17:03:01 crc kubenswrapper[5120]: I0316 17:03:01.686237 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-94e3-account-create-update-n4td2"] Mar 16 17:03:01 crc kubenswrapper[5120]: E0316 17:03:01.708969 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Mar 16 17:03:01 crc kubenswrapper[5120]: E0316 17:03:01.709323 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/279c3e84-623c-4c5f-ae15-d7d8c439c4dc-config-data podName:279c3e84-623c-4c5f-ae15-d7d8c439c4dc nodeName:}" failed. No retries permitted until 2026-03-16 17:03:02.209299412 +0000 UTC m=+5484.363231069 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/279c3e84-623c-4c5f-ae15-d7d8c439c4dc-config-data") pod "rabbitmq-cell1-server-0" (UID: "279c3e84-623c-4c5f-ae15-d7d8c439c4dc") : configmap "rabbitmq-cell1-config-data" not found Mar 16 17:03:01 crc kubenswrapper[5120]: I0316 17:03:01.715979 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-94e3-account-create-update-n4td2"] Mar 16 17:03:01 crc kubenswrapper[5120]: I0316 17:03:01.759933 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-cd46-account-create-update-mrxmb" Mar 16 17:03:01 crc kubenswrapper[5120]: I0316 17:03:01.769412 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-d34e-account-create-update-ptq99"] Mar 16 17:03:01 crc kubenswrapper[5120]: I0316 17:03:01.785810 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-q2bn4"] Mar 16 17:03:01 crc kubenswrapper[5120]: I0316 17:03:01.931243 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podUID="5f9a749e-2dbb-409d-b935-4f2891d43397" containerName="ovsdbserver-sb" containerID="cri-o://a4d20d76546c51fa2980f8102ff0540c2e4371359f2aac37edf70df305a1aa75" gracePeriod=300 Mar 16 17:03:01 crc kubenswrapper[5120]: I0316 17:03:01.949606 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-q2bn4"] Mar 16 17:03:02 crc kubenswrapper[5120]: I0316 17:03:02.080019 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-d34e-account-create-update-ptq99"] Mar 16 17:03:02 crc kubenswrapper[5120]: I0316 17:03:02.098304 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 17:03:02 crc kubenswrapper[5120]: I0316 17:03:02.098968 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovn-northd-0" podUID="615448b7-8677-4a99-93ba-64a2388a6dcc" containerName="ovn-northd" containerID="cri-o://f7c63580126db55650667f8bc05d59546a627363558e5c5f426c2752ec02efd8" gracePeriod=30 Mar 16 17:03:02 crc kubenswrapper[5120]: I0316 17:03:02.099195 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovn-northd-0" podUID="615448b7-8677-4a99-93ba-64a2388a6dcc" containerName="openstack-network-exporter" containerID="cri-o://e035fad40aa52d287a6919e996a209abac082912f4c792b979746bdd509712a5" gracePeriod=30 Mar 16 17:03:02 crc kubenswrapper[5120]: I0316 17:03:02.106184 5120 status_manager.go:895] "Failed to get status for pod" podUID="a6d827da-888b-4463-b40a-041fef751ccc" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 17:03:02 crc kubenswrapper[5120]: I0316 17:03:02.111902 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podUID="e5f68c9e-894a-4eac-90fc-be12f8c49913" containerName="ovsdbserver-nb" containerID="cri-o://bd00d07b486ec185ee02c5c8ceab221325f86394dc05335ac89adfe8d2779929" gracePeriod=300 Mar 16 17:03:02 crc kubenswrapper[5120]: I0316 17:03:02.135894 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-zmwzp"] Mar 16 17:03:02 crc kubenswrapper[5120]: I0316 17:03:02.146902 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-zmwzp"] Mar 16 17:03:02 crc kubenswrapper[5120]: I0316 17:03:02.159802 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-np5jg"] Mar 16 17:03:02 crc kubenswrapper[5120]: I0316 17:03:02.174202 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-np5jg"] Mar 16 17:03:02 crc kubenswrapper[5120]: I0316 17:03:02.187851 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-8706-account-create-update-7kshs"] Mar 16 17:03:02 crc kubenswrapper[5120]: I0316 17:03:02.203054 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-8706-account-create-update-7kshs"] Mar 16 17:03:02 crc kubenswrapper[5120]: I0316 17:03:02.225388 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-hm7fn"] Mar 16 17:03:02 crc kubenswrapper[5120]: I0316 17:03:02.225444 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-hm7fn"] Mar 16 17:03:02 crc kubenswrapper[5120]: E0316 17:03:02.260222 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Mar 16 17:03:02 crc kubenswrapper[5120]: E0316 17:03:02.260312 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/279c3e84-623c-4c5f-ae15-d7d8c439c4dc-config-data podName:279c3e84-623c-4c5f-ae15-d7d8c439c4dc nodeName:}" failed. No retries permitted until 2026-03-16 17:03:03.260295684 +0000 UTC m=+5485.414227341 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/279c3e84-623c-4c5f-ae15-d7d8c439c4dc-config-data") pod "rabbitmq-cell1-server-0" (UID: "279c3e84-623c-4c5f-ae15-d7d8c439c4dc") : configmap "rabbitmq-cell1-config-data" not found Mar 16 17:03:02 crc kubenswrapper[5120]: I0316 17:03:02.332916 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-2nkb5"] Mar 16 17:03:02 crc kubenswrapper[5120]: I0316 17:03:02.354138 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-2nkb5"] Mar 16 17:03:02 crc kubenswrapper[5120]: I0316 17:03:02.365029 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 17:03:02 crc kubenswrapper[5120]: I0316 17:03:02.365366 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="2cadcb9e-2a3b-4c14-8fcc-39939326678f" containerName="probe" containerID="cri-o://6a23a121b6a8a57df4ea8368ee7e1898510506a29ce4485b74adeb024aebebae" gracePeriod=30 Mar 16 17:03:02 crc kubenswrapper[5120]: I0316 17:03:02.373660 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="2cadcb9e-2a3b-4c14-8fcc-39939326678f" containerName="cinder-scheduler" containerID="cri-o://082f786272aedd7c68ee70e2d12f600cf20e6afc27f262f48a3b03f153c4650e" gracePeriod=30 Mar 16 17:03:02 crc kubenswrapper[5120]: I0316 17:03:02.385878 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 17:03:02 crc kubenswrapper[5120]: I0316 17:03:02.386673 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="aeacde0e-2862-4e69-9e7d-b88ca35912b8" containerName="account-server" containerID="cri-o://6ca5d6ea4402f88922cc4bdc75810ff0810c7269d939fc714fc5d2581a0381bf" gracePeriod=30 Mar 16 17:03:02 crc kubenswrapper[5120]: I0316 17:03:02.386939 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="aeacde0e-2862-4e69-9e7d-b88ca35912b8" containerName="swift-recon-cron" containerID="cri-o://5643cd6e2f0a396a7c7f5aa76ae50b179dfbe75c50f8f250897c6dbe7c2f1f94" gracePeriod=30 Mar 16 17:03:02 crc kubenswrapper[5120]: I0316 17:03:02.386988 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="aeacde0e-2862-4e69-9e7d-b88ca35912b8" containerName="rsync" containerID="cri-o://e1cc7167cc6d60a4ebf70616ac23d4c7c61e0ea254b4ce5939c1c303a76ba999" gracePeriod=30 Mar 16 17:03:02 crc kubenswrapper[5120]: I0316 17:03:02.387086 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="aeacde0e-2862-4e69-9e7d-b88ca35912b8" containerName="object-expirer" containerID="cri-o://7e94fadc150440b2d15eda43c6265cf951173e81b5007cba27bd451ccf2a34f8" gracePeriod=30 Mar 16 17:03:02 crc kubenswrapper[5120]: I0316 17:03:02.387148 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="aeacde0e-2862-4e69-9e7d-b88ca35912b8" containerName="object-updater" containerID="cri-o://44cf1d2680a6b0bd1f3ea49fc5485a76fb86944c47db006aee554801e08df0ce" gracePeriod=30 Mar 16 17:03:02 crc kubenswrapper[5120]: I0316 17:03:02.387202 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="aeacde0e-2862-4e69-9e7d-b88ca35912b8" containerName="object-auditor" containerID="cri-o://44cb080f8154154a4a36b453ce52f3a77a483a82435bbd06cdd2e041a88fb9cc" gracePeriod=30 Mar 16 17:03:02 crc kubenswrapper[5120]: I0316 17:03:02.387249 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="aeacde0e-2862-4e69-9e7d-b88ca35912b8" containerName="object-replicator" containerID="cri-o://8497a6be2923c0f36c47bb5031075424a0eb72cef279454537d1ede5f1036d3c" gracePeriod=30 Mar 16 17:03:02 crc kubenswrapper[5120]: I0316 17:03:02.387291 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="aeacde0e-2862-4e69-9e7d-b88ca35912b8" containerName="object-server" containerID="cri-o://dc957e1a9d7bc3e1ab0c920f56da07e7a63162092103ea420708963bc78c77e9" gracePeriod=30 Mar 16 17:03:02 crc kubenswrapper[5120]: I0316 17:03:02.387339 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="aeacde0e-2862-4e69-9e7d-b88ca35912b8" containerName="container-updater" containerID="cri-o://77cf0e12f17307ccf6f98722a30265dbbf68f31c9b3098530603d4e4c87c55ce" gracePeriod=30 Mar 16 17:03:02 crc kubenswrapper[5120]: I0316 17:03:02.387381 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="aeacde0e-2862-4e69-9e7d-b88ca35912b8" containerName="container-auditor" containerID="cri-o://e53436fec9df727dcd2d2beeb431759ec0856450eefd69d18611fc1b41806ac9" gracePeriod=30 Mar 16 17:03:02 crc kubenswrapper[5120]: I0316 17:03:02.387422 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="aeacde0e-2862-4e69-9e7d-b88ca35912b8" containerName="container-replicator" containerID="cri-o://6469ce05f121fe416edfe1512f28049f6202b5c14ef3a421880ed284e3723c03" gracePeriod=30 Mar 16 17:03:02 crc kubenswrapper[5120]: I0316 17:03:02.387476 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="aeacde0e-2862-4e69-9e7d-b88ca35912b8" containerName="container-server" containerID="cri-o://1c06198550f093ba013bceb3903d2c570a51a69e1b891c5f9d6eb3066933c0e3" gracePeriod=30 Mar 16 17:03:02 crc kubenswrapper[5120]: I0316 17:03:02.387515 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="aeacde0e-2862-4e69-9e7d-b88ca35912b8" containerName="account-reaper" containerID="cri-o://9badd4ead08b15df51406a2e575e802a71fbfbdcabc5450a726e56b4e5258fde" gracePeriod=30 Mar 16 17:03:02 crc kubenswrapper[5120]: I0316 17:03:02.387557 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="aeacde0e-2862-4e69-9e7d-b88ca35912b8" containerName="account-auditor" containerID="cri-o://095159c69aab52ae8cd46d98b8a125878d38f737cac679858fce218635fcab9f" gracePeriod=30 Mar 16 17:03:02 crc kubenswrapper[5120]: I0316 17:03:02.387601 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="aeacde0e-2862-4e69-9e7d-b88ca35912b8" containerName="account-replicator" containerID="cri-o://39849e89c2ccc6af9f65a47428e8a27cfc4f4cdd9dae01876c7ffcc1c8ec9cdf" gracePeriod=30 Mar 16 17:03:02 crc kubenswrapper[5120]: I0316 17:03:02.395052 5120 status_manager.go:895] "Failed to get status for pod" podUID="a6d827da-888b-4463-b40a-041fef751ccc" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 17:03:02 crc kubenswrapper[5120]: I0316 17:03:02.397641 5120 status_manager.go:895] "Failed to get status for pod" podUID="a6d827da-888b-4463-b40a-041fef751ccc" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 17:03:02 crc kubenswrapper[5120]: E0316 17:03:02.435368 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of a4d20d76546c51fa2980f8102ff0540c2e4371359f2aac37edf70df305a1aa75 is running failed: container process not found" containerID="a4d20d76546c51fa2980f8102ff0540c2e4371359f2aac37edf70df305a1aa75" cmd=["/usr/bin/pidof","ovsdb-server"] Mar 16 17:03:02 crc kubenswrapper[5120]: I0316 17:03:02.435543 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openstack-kuttl-tests/ovn-northd-0" podUID="615448b7-8677-4a99-93ba-64a2388a6dcc" containerName="ovn-northd" probeResult="failure" output=< Mar 16 17:03:02 crc kubenswrapper[5120]: 2026-03-16T17:03:02Z|00001|unixctl|WARN|failed to connect to /tmp/ovn-northd.1.ctl Mar 16 17:03:02 crc kubenswrapper[5120]: ovn-appctl: cannot connect to "/tmp/ovn-northd.1.ctl" (No such file or directory) Mar 16 17:03:02 crc kubenswrapper[5120]: 2026-03-16T17:03:02Z|00001|unixctl|WARN|failed to connect to /tmp/ovn-northd.1.ctl Mar 16 17:03:02 crc kubenswrapper[5120]: ovn-appctl: cannot connect to "/tmp/ovn-northd.1.ctl" (No such file or directory) Mar 16 17:03:02 crc kubenswrapper[5120]: > Mar 16 17:03:02 crc kubenswrapper[5120]: E0316 17:03:02.443739 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of a4d20d76546c51fa2980f8102ff0540c2e4371359f2aac37edf70df305a1aa75 is running failed: container process not found" containerID="a4d20d76546c51fa2980f8102ff0540c2e4371359f2aac37edf70df305a1aa75" cmd=["/usr/bin/pidof","ovsdb-server"] Mar 16 17:03:02 crc kubenswrapper[5120]: E0316 17:03:02.459358 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of a4d20d76546c51fa2980f8102ff0540c2e4371359f2aac37edf70df305a1aa75 is running failed: container process not found" containerID="a4d20d76546c51fa2980f8102ff0540c2e4371359f2aac37edf70df305a1aa75" cmd=["/usr/bin/pidof","ovsdb-server"] Mar 16 17:03:02 crc kubenswrapper[5120]: E0316 17:03:02.459451 5120 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of a4d20d76546c51fa2980f8102ff0540c2e4371359f2aac37edf70df305a1aa75 is running failed: container process not found" probeType="Readiness" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podUID="5f9a749e-2dbb-409d-b935-4f2891d43397" containerName="ovsdbserver-sb" probeResult="unknown" Mar 16 17:03:02 crc kubenswrapper[5120]: I0316 17:03:02.464250 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-qdvhv"] Mar 16 17:03:02 crc kubenswrapper[5120]: I0316 17:03:02.512612 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-qdvhv"] Mar 16 17:03:02 crc kubenswrapper[5120]: I0316 17:03:02.534190 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_5f9a749e-2dbb-409d-b935-4f2891d43397/ovsdbserver-sb/0.log" Mar 16 17:03:02 crc kubenswrapper[5120]: I0316 17:03:02.534264 5120 generic.go:358] "Generic (PLEG): container finished" podID="5f9a749e-2dbb-409d-b935-4f2891d43397" containerID="b9ea6c64365c3398bfb7a01d52bf92315e0914e469529e7c3947aad7173b22b9" exitCode=2 Mar 16 17:03:02 crc kubenswrapper[5120]: I0316 17:03:02.534286 5120 generic.go:358] "Generic (PLEG): container finished" podID="5f9a749e-2dbb-409d-b935-4f2891d43397" containerID="a4d20d76546c51fa2980f8102ff0540c2e4371359f2aac37edf70df305a1aa75" exitCode=143 Mar 16 17:03:02 crc kubenswrapper[5120]: I0316 17:03:02.553468 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"5f9a749e-2dbb-409d-b935-4f2891d43397","Type":"ContainerDied","Data":"b9ea6c64365c3398bfb7a01d52bf92315e0914e469529e7c3947aad7173b22b9"} Mar 16 17:03:02 crc kubenswrapper[5120]: I0316 17:03:02.553972 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"5f9a749e-2dbb-409d-b935-4f2891d43397","Type":"ContainerDied","Data":"a4d20d76546c51fa2980f8102ff0540c2e4371359f2aac37edf70df305a1aa75"} Mar 16 17:03:02 crc kubenswrapper[5120]: I0316 17:03:02.554001 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-7944fd944b-x8xzf"] Mar 16 17:03:02 crc kubenswrapper[5120]: I0316 17:03:02.554385 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-7944fd944b-x8xzf" podUID="15389dad-1183-441e-831c-de27ba4bac6e" containerName="placement-log" containerID="cri-o://0e421c8f4bd01dccbba64b51d71205b35f94454215e59a8a85c6b6da1bf033d0" gracePeriod=30 Mar 16 17:03:02 crc kubenswrapper[5120]: I0316 17:03:02.555252 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-7944fd944b-x8xzf" podUID="15389dad-1183-441e-831c-de27ba4bac6e" containerName="placement-api" containerID="cri-o://72cd91669994d4f717e8dc9d24219ef29cee8da5fb209b92c3af6dc535d96d2c" gracePeriod=30 Mar 16 17:03:02 crc kubenswrapper[5120]: I0316 17:03:02.573432 5120 generic.go:358] "Generic (PLEG): container finished" podID="615448b7-8677-4a99-93ba-64a2388a6dcc" containerID="e035fad40aa52d287a6919e996a209abac082912f4c792b979746bdd509712a5" exitCode=2 Mar 16 17:03:02 crc kubenswrapper[5120]: I0316 17:03:02.573614 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"615448b7-8677-4a99-93ba-64a2388a6dcc","Type":"ContainerDied","Data":"e035fad40aa52d287a6919e996a209abac082912f4c792b979746bdd509712a5"} Mar 16 17:03:02 crc kubenswrapper[5120]: I0316 17:03:02.573934 5120 status_manager.go:895] "Failed to get status for pod" podUID="a6d827da-888b-4463-b40a-041fef751ccc" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 17:03:02 crc kubenswrapper[5120]: I0316 17:03:02.607275 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 17:03:02 crc kubenswrapper[5120]: I0316 17:03:02.609244 5120 status_manager.go:895] "Failed to get status for pod" podUID="a6d827da-888b-4463-b40a-041fef751ccc" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 17:03:02 crc kubenswrapper[5120]: I0316 17:03:02.625744 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_e5f68c9e-894a-4eac-90fc-be12f8c49913/ovsdbserver-nb/0.log" Mar 16 17:03:02 crc kubenswrapper[5120]: I0316 17:03:02.625810 5120 generic.go:358] "Generic (PLEG): container finished" podID="e5f68c9e-894a-4eac-90fc-be12f8c49913" containerID="c6c3b078bcba74c557bdc2e467fc6e2de0b3d668951e7953bb03062d2d6e4f47" exitCode=2 Mar 16 17:03:02 crc kubenswrapper[5120]: I0316 17:03:02.625827 5120 generic.go:358] "Generic (PLEG): container finished" podID="e5f68c9e-894a-4eac-90fc-be12f8c49913" containerID="bd00d07b486ec185ee02c5c8ceab221325f86394dc05335ac89adfe8d2779929" exitCode=143 Mar 16 17:03:02 crc kubenswrapper[5120]: I0316 17:03:02.625974 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"e5f68c9e-894a-4eac-90fc-be12f8c49913","Type":"ContainerDied","Data":"c6c3b078bcba74c557bdc2e467fc6e2de0b3d668951e7953bb03062d2d6e4f47"} Mar 16 17:03:02 crc kubenswrapper[5120]: I0316 17:03:02.626006 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"e5f68c9e-894a-4eac-90fc-be12f8c49913","Type":"ContainerDied","Data":"bd00d07b486ec185ee02c5c8ceab221325f86394dc05335ac89adfe8d2779929"} Mar 16 17:03:02 crc kubenswrapper[5120]: I0316 17:03:02.653247 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-5fprr"] Mar 16 17:03:02 crc kubenswrapper[5120]: I0316 17:03:02.678187 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-5fprr" Mar 16 17:03:02 crc kubenswrapper[5120]: I0316 17:03:02.706435 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d4d1258a-d21b-48af-ac55-d36aa473d0ad-config\") pod \"dnsmasq-dnsmasq-79dcd846c5-5fprr\" (UID: \"d4d1258a-d21b-48af-ac55-d36aa473d0ad\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-5fprr" Mar 16 17:03:02 crc kubenswrapper[5120]: I0316 17:03:02.706625 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/d4d1258a-d21b-48af-ac55-d36aa473d0ad-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-79dcd846c5-5fprr\" (UID: \"d4d1258a-d21b-48af-ac55-d36aa473d0ad\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-5fprr" Mar 16 17:03:02 crc kubenswrapper[5120]: I0316 17:03:02.706693 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4g2w\" (UniqueName: \"kubernetes.io/projected/d4d1258a-d21b-48af-ac55-d36aa473d0ad-kube-api-access-z4g2w\") pod \"dnsmasq-dnsmasq-79dcd846c5-5fprr\" (UID: \"d4d1258a-d21b-48af-ac55-d36aa473d0ad\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-5fprr" Mar 16 17:03:02 crc kubenswrapper[5120]: I0316 17:03:02.716644 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/rabbitmq-server-0" podUID="4ed551c0-3f37-4af6-b682-b9e35fd5fa42" containerName="rabbitmq" containerID="cri-o://b8bbcdffc34685e533b2e078ab9d7cc67872998017fd038f8b682e3c4a20dda7" gracePeriod=604800 Mar 16 17:03:02 crc kubenswrapper[5120]: I0316 17:03:02.734999 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="254f7ef3-eca3-448d-a697-5dbbccfd578c" path="/var/lib/kubelet/pods/254f7ef3-eca3-448d-a697-5dbbccfd578c/volumes" Mar 16 17:03:02 crc kubenswrapper[5120]: I0316 17:03:02.735552 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2cc34ac9-c7e0-4a0b-9984-a571c4f1c80d" path="/var/lib/kubelet/pods/2cc34ac9-c7e0-4a0b-9984-a571c4f1c80d/volumes" Mar 16 17:03:02 crc kubenswrapper[5120]: I0316 17:03:02.736124 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="72db1931-19ed-4989-bf2b-01fca6434989" path="/var/lib/kubelet/pods/72db1931-19ed-4989-bf2b-01fca6434989/volumes" Mar 16 17:03:02 crc kubenswrapper[5120]: I0316 17:03:02.736572 5120 status_manager.go:895] "Failed to get status for pod" podUID="a6d827da-888b-4463-b40a-041fef751ccc" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 17:03:02 crc kubenswrapper[5120]: I0316 17:03:02.736628 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ab6544e-3675-4473-8f87-b60b7a3783ca" path="/var/lib/kubelet/pods/8ab6544e-3675-4473-8f87-b60b7a3783ca/volumes" Mar 16 17:03:02 crc kubenswrapper[5120]: I0316 17:03:02.743324 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a4d34b4f-907c-4c67-a386-73e726afa874" path="/var/lib/kubelet/pods/a4d34b4f-907c-4c67-a386-73e726afa874/volumes" Mar 16 17:03:02 crc kubenswrapper[5120]: I0316 17:03:02.743888 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a9cf5cd8-0677-420a-95b9-931325ffe4d2" path="/var/lib/kubelet/pods/a9cf5cd8-0677-420a-95b9-931325ffe4d2/volumes" Mar 16 17:03:02 crc kubenswrapper[5120]: I0316 17:03:02.754135 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aae566ec-d4cb-4062-a390-c236ce58dd62" path="/var/lib/kubelet/pods/aae566ec-d4cb-4062-a390-c236ce58dd62/volumes" Mar 16 17:03:02 crc kubenswrapper[5120]: I0316 17:03:02.754798 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba4a73ee-a532-452e-bc3f-9126f54017f0" path="/var/lib/kubelet/pods/ba4a73ee-a532-452e-bc3f-9126f54017f0/volumes" Mar 16 17:03:02 crc kubenswrapper[5120]: I0316 17:03:02.755349 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c336b7b3-c896-4066-a40a-ca516ed7c2c1" path="/var/lib/kubelet/pods/c336b7b3-c896-4066-a40a-ca516ed7c2c1/volumes" Mar 16 17:03:02 crc kubenswrapper[5120]: I0316 17:03:02.760223 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e199c216-19d8-4055-9a2b-3d65e13116a2" path="/var/lib/kubelet/pods/e199c216-19d8-4055-9a2b-3d65e13116a2/volumes" Mar 16 17:03:02 crc kubenswrapper[5120]: I0316 17:03:02.770317 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ebbee40a-c6ba-4288-852d-acdc58f27e41" path="/var/lib/kubelet/pods/ebbee40a-c6ba-4288-852d-acdc58f27e41/volumes" Mar 16 17:03:02 crc kubenswrapper[5120]: I0316 17:03:02.771109 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f38ba03a-736c-4963-9059-d50f52f0bbf5" path="/var/lib/kubelet/pods/f38ba03a-736c-4963-9059-d50f52f0bbf5/volumes" Mar 16 17:03:02 crc kubenswrapper[5120]: I0316 17:03:02.771775 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-5fprr"] Mar 16 17:03:02 crc kubenswrapper[5120]: I0316 17:03:02.771801 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-1add-account-create-update-xxkxp"] Mar 16 17:03:02 crc kubenswrapper[5120]: I0316 17:03:02.803598 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-1add-account-create-update-xxkxp"] Mar 16 17:03:02 crc kubenswrapper[5120]: I0316 17:03:02.818446 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d4d1258a-d21b-48af-ac55-d36aa473d0ad-config\") pod \"dnsmasq-dnsmasq-79dcd846c5-5fprr\" (UID: \"d4d1258a-d21b-48af-ac55-d36aa473d0ad\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-5fprr" Mar 16 17:03:02 crc kubenswrapper[5120]: I0316 17:03:02.818574 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/d4d1258a-d21b-48af-ac55-d36aa473d0ad-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-79dcd846c5-5fprr\" (UID: \"d4d1258a-d21b-48af-ac55-d36aa473d0ad\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-5fprr" Mar 16 17:03:02 crc kubenswrapper[5120]: I0316 17:03:02.818623 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z4g2w\" (UniqueName: \"kubernetes.io/projected/d4d1258a-d21b-48af-ac55-d36aa473d0ad-kube-api-access-z4g2w\") pod \"dnsmasq-dnsmasq-79dcd846c5-5fprr\" (UID: \"d4d1258a-d21b-48af-ac55-d36aa473d0ad\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-5fprr" Mar 16 17:03:02 crc kubenswrapper[5120]: I0316 17:03:02.821860 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/d4d1258a-d21b-48af-ac55-d36aa473d0ad-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-79dcd846c5-5fprr\" (UID: \"d4d1258a-d21b-48af-ac55-d36aa473d0ad\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-5fprr" Mar 16 17:03:02 crc kubenswrapper[5120]: I0316 17:03:02.836539 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 17:03:02 crc kubenswrapper[5120]: I0316 17:03:02.837062 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="662e5dd1-e157-4e76-bb3d-f4310c982cb0" containerName="cinder-api-log" containerID="cri-o://6f3d5d660208c4b004ec65401f0ef1985dc6cff4ffcc709cf989fcdfe929481e" gracePeriod=30 Mar 16 17:03:02 crc kubenswrapper[5120]: I0316 17:03:02.837679 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="662e5dd1-e157-4e76-bb3d-f4310c982cb0" containerName="cinder-api" containerID="cri-o://0e683e08d610b917770dfb8f5571d3b014df83f34754cc5c199e9efb9e29f138" gracePeriod=30 Mar 16 17:03:02 crc kubenswrapper[5120]: I0316 17:03:02.865660 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 17:03:02 crc kubenswrapper[5120]: I0316 17:03:02.867295 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d4d1258a-d21b-48af-ac55-d36aa473d0ad-config\") pod \"dnsmasq-dnsmasq-79dcd846c5-5fprr\" (UID: \"d4d1258a-d21b-48af-ac55-d36aa473d0ad\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-5fprr" Mar 16 17:03:02 crc kubenswrapper[5120]: I0316 17:03:02.868268 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="c88b7d39-fb86-490a-8af1-a6754dab05c9" containerName="glance-log" containerID="cri-o://23d89b9bddaab11d38e25c71f65ba18b27c7ad795dc47cea8da353083a2f58a6" gracePeriod=30 Mar 16 17:03:02 crc kubenswrapper[5120]: I0316 17:03:02.868441 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="c88b7d39-fb86-490a-8af1-a6754dab05c9" containerName="glance-httpd" containerID="cri-o://c9d647c877cad46f80f83f0a8eec094f4e3b21c9820b23c8345a5a7561869a78" gracePeriod=30 Mar 16 17:03:02 crc kubenswrapper[5120]: I0316 17:03:02.949793 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4g2w\" (UniqueName: \"kubernetes.io/projected/d4d1258a-d21b-48af-ac55-d36aa473d0ad-kube-api-access-z4g2w\") pod \"dnsmasq-dnsmasq-79dcd846c5-5fprr\" (UID: \"d4d1258a-d21b-48af-ac55-d36aa473d0ad\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-5fprr" Mar 16 17:03:02 crc kubenswrapper[5120]: I0316 17:03:02.974838 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-gz7fl"] Mar 16 17:03:03 crc kubenswrapper[5120]: I0316 17:03:03.012229 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-gz7fl"] Mar 16 17:03:03 crc kubenswrapper[5120]: I0316 17:03:03.060987 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-dcndl"] Mar 16 17:03:03 crc kubenswrapper[5120]: I0316 17:03:03.090245 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_5f9a749e-2dbb-409d-b935-4f2891d43397/ovsdbserver-sb/0.log" Mar 16 17:03:03 crc kubenswrapper[5120]: I0316 17:03:03.092336 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:03:03 crc kubenswrapper[5120]: I0316 17:03:03.122225 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-dcndl"] Mar 16 17:03:03 crc kubenswrapper[5120]: I0316 17:03:03.151270 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovndbcluster-sb-etc-ovn\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"5f9a749e-2dbb-409d-b935-4f2891d43397\" (UID: \"5f9a749e-2dbb-409d-b935-4f2891d43397\") " Mar 16 17:03:03 crc kubenswrapper[5120]: I0316 17:03:03.151369 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/5f9a749e-2dbb-409d-b935-4f2891d43397-scripts\") pod \"5f9a749e-2dbb-409d-b935-4f2891d43397\" (UID: \"5f9a749e-2dbb-409d-b935-4f2891d43397\") " Mar 16 17:03:03 crc kubenswrapper[5120]: I0316 17:03:03.151496 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/5f9a749e-2dbb-409d-b935-4f2891d43397-ovsdb-rundir\") pod \"5f9a749e-2dbb-409d-b935-4f2891d43397\" (UID: \"5f9a749e-2dbb-409d-b935-4f2891d43397\") " Mar 16 17:03:03 crc kubenswrapper[5120]: I0316 17:03:03.151580 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5f9a749e-2dbb-409d-b935-4f2891d43397-config\") pod \"5f9a749e-2dbb-409d-b935-4f2891d43397\" (UID: \"5f9a749e-2dbb-409d-b935-4f2891d43397\") " Mar 16 17:03:03 crc kubenswrapper[5120]: I0316 17:03:03.151792 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/5f9a749e-2dbb-409d-b935-4f2891d43397-metrics-certs-tls-certs\") pod \"5f9a749e-2dbb-409d-b935-4f2891d43397\" (UID: \"5f9a749e-2dbb-409d-b935-4f2891d43397\") " Mar 16 17:03:03 crc kubenswrapper[5120]: I0316 17:03:03.151842 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vznm4\" (UniqueName: \"kubernetes.io/projected/5f9a749e-2dbb-409d-b935-4f2891d43397-kube-api-access-vznm4\") pod \"5f9a749e-2dbb-409d-b935-4f2891d43397\" (UID: \"5f9a749e-2dbb-409d-b935-4f2891d43397\") " Mar 16 17:03:03 crc kubenswrapper[5120]: I0316 17:03:03.152033 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5f9a749e-2dbb-409d-b935-4f2891d43397-combined-ca-bundle\") pod \"5f9a749e-2dbb-409d-b935-4f2891d43397\" (UID: \"5f9a749e-2dbb-409d-b935-4f2891d43397\") " Mar 16 17:03:03 crc kubenswrapper[5120]: I0316 17:03:03.152096 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/5f9a749e-2dbb-409d-b935-4f2891d43397-ovsdbserver-sb-tls-certs\") pod \"5f9a749e-2dbb-409d-b935-4f2891d43397\" (UID: \"5f9a749e-2dbb-409d-b935-4f2891d43397\") " Mar 16 17:03:03 crc kubenswrapper[5120]: I0316 17:03:03.152982 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f9a749e-2dbb-409d-b935-4f2891d43397-config" (OuterVolumeSpecName: "config") pod "5f9a749e-2dbb-409d-b935-4f2891d43397" (UID: "5f9a749e-2dbb-409d-b935-4f2891d43397"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:03:03 crc kubenswrapper[5120]: I0316 17:03:03.153450 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5f9a749e-2dbb-409d-b935-4f2891d43397-config\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:03 crc kubenswrapper[5120]: I0316 17:03:03.157061 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f9a749e-2dbb-409d-b935-4f2891d43397-scripts" (OuterVolumeSpecName: "scripts") pod "5f9a749e-2dbb-409d-b935-4f2891d43397" (UID: "5f9a749e-2dbb-409d-b935-4f2891d43397"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:03:03 crc kubenswrapper[5120]: I0316 17:03:03.157899 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f9a749e-2dbb-409d-b935-4f2891d43397-ovsdb-rundir" (OuterVolumeSpecName: "ovsdb-rundir") pod "5f9a749e-2dbb-409d-b935-4f2891d43397" (UID: "5f9a749e-2dbb-409d-b935-4f2891d43397"). InnerVolumeSpecName "ovsdb-rundir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:03:03 crc kubenswrapper[5120]: I0316 17:03:03.166091 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f9a749e-2dbb-409d-b935-4f2891d43397-kube-api-access-vznm4" (OuterVolumeSpecName: "kube-api-access-vznm4") pod "5f9a749e-2dbb-409d-b935-4f2891d43397" (UID: "5f9a749e-2dbb-409d-b935-4f2891d43397"). InnerVolumeSpecName "kube-api-access-vznm4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:03:03 crc kubenswrapper[5120]: I0316 17:03:03.187063 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage01-crc" (OuterVolumeSpecName: "ovndbcluster-sb-etc-ovn") pod "5f9a749e-2dbb-409d-b935-4f2891d43397" (UID: "5f9a749e-2dbb-409d-b935-4f2891d43397"). InnerVolumeSpecName "local-storage01-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 17:03:03 crc kubenswrapper[5120]: I0316 17:03:03.225273 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-5fprr" Mar 16 17:03:03 crc kubenswrapper[5120]: I0316 17:03:03.246587 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f9a749e-2dbb-409d-b935-4f2891d43397-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "5f9a749e-2dbb-409d-b935-4f2891d43397" (UID: "5f9a749e-2dbb-409d-b935-4f2891d43397"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:03:03 crc kubenswrapper[5120]: I0316 17:03:03.259472 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/rabbitmq-server-0" podUID="4ed551c0-3f37-4af6-b682-b9e35fd5fa42" containerName="rabbitmq" probeResult="failure" output="dial tcp 10.217.0.216:5671: connect: connection refused" Mar 16 17:03:03 crc kubenswrapper[5120]: I0316 17:03:03.259945 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vznm4\" (UniqueName: \"kubernetes.io/projected/5f9a749e-2dbb-409d-b935-4f2891d43397-kube-api-access-vznm4\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:03 crc kubenswrapper[5120]: I0316 17:03:03.259971 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5f9a749e-2dbb-409d-b935-4f2891d43397-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:03 crc kubenswrapper[5120]: I0316 17:03:03.259993 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") on node \"crc\" " Mar 16 17:03:03 crc kubenswrapper[5120]: I0316 17:03:03.260003 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/5f9a749e-2dbb-409d-b935-4f2891d43397-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:03 crc kubenswrapper[5120]: I0316 17:03:03.260012 5120 reconciler_common.go:299] "Volume detached for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/5f9a749e-2dbb-409d-b935-4f2891d43397-ovsdb-rundir\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:03 crc kubenswrapper[5120]: I0316 17:03:03.365199 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-79c6c668c8-l5c8p"] Mar 16 17:03:03 crc kubenswrapper[5120]: I0316 17:03:03.365825 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-79c6c668c8-l5c8p" podUID="394193fd-f8e0-4b81-8821-8d1251a0274b" containerName="neutron-api" containerID="cri-o://bee153da9ff3794e8534a919e63d240cfcd1a5a2b982d46b350472046f40c2c1" gracePeriod=30 Mar 16 17:03:03 crc kubenswrapper[5120]: I0316 17:03:03.366266 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-79c6c668c8-l5c8p" podUID="394193fd-f8e0-4b81-8821-8d1251a0274b" containerName="neutron-httpd" containerID="cri-o://b366089265c5a377f266a0c6132410502a91ab7d470144bba9e47254c5e54334" gracePeriod=30 Mar 16 17:03:03 crc kubenswrapper[5120]: E0316 17:03:03.368255 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Mar 16 17:03:03 crc kubenswrapper[5120]: E0316 17:03:03.368336 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/279c3e84-623c-4c5f-ae15-d7d8c439c4dc-config-data podName:279c3e84-623c-4c5f-ae15-d7d8c439c4dc nodeName:}" failed. No retries permitted until 2026-03-16 17:03:05.368315413 +0000 UTC m=+5487.522247070 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/279c3e84-623c-4c5f-ae15-d7d8c439c4dc-config-data") pod "rabbitmq-cell1-server-0" (UID: "279c3e84-623c-4c5f-ae15-d7d8c439c4dc") : configmap "rabbitmq-cell1-config-data" not found Mar 16 17:03:03 crc kubenswrapper[5120]: I0316 17:03:03.379590 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f9a749e-2dbb-409d-b935-4f2891d43397-ovsdbserver-sb-tls-certs" (OuterVolumeSpecName: "ovsdbserver-sb-tls-certs") pod "5f9a749e-2dbb-409d-b935-4f2891d43397" (UID: "5f9a749e-2dbb-409d-b935-4f2891d43397"). InnerVolumeSpecName "ovsdbserver-sb-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:03:03 crc kubenswrapper[5120]: E0316 17:03:03.401895 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of bd00d07b486ec185ee02c5c8ceab221325f86394dc05335ac89adfe8d2779929 is running failed: container process not found" containerID="bd00d07b486ec185ee02c5c8ceab221325f86394dc05335ac89adfe8d2779929" cmd=["/usr/bin/pidof","ovsdb-server"] Mar 16 17:03:03 crc kubenswrapper[5120]: E0316 17:03:03.403338 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of bd00d07b486ec185ee02c5c8ceab221325f86394dc05335ac89adfe8d2779929 is running failed: container process not found" containerID="bd00d07b486ec185ee02c5c8ceab221325f86394dc05335ac89adfe8d2779929" cmd=["/usr/bin/pidof","ovsdb-server"] Mar 16 17:03:03 crc kubenswrapper[5120]: E0316 17:03:03.404813 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of bd00d07b486ec185ee02c5c8ceab221325f86394dc05335ac89adfe8d2779929 is running failed: container process not found" containerID="bd00d07b486ec185ee02c5c8ceab221325f86394dc05335ac89adfe8d2779929" cmd=["/usr/bin/pidof","ovsdb-server"] Mar 16 17:03:03 crc kubenswrapper[5120]: E0316 17:03:03.404888 5120 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of bd00d07b486ec185ee02c5c8ceab221325f86394dc05335ac89adfe8d2779929 is running failed: container process not found" probeType="Readiness" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podUID="e5f68c9e-894a-4eac-90fc-be12f8c49913" containerName="ovsdbserver-nb" probeResult="unknown" Mar 16 17:03:03 crc kubenswrapper[5120]: I0316 17:03:03.430048 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f9a749e-2dbb-409d-b935-4f2891d43397-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "5f9a749e-2dbb-409d-b935-4f2891d43397" (UID: "5f9a749e-2dbb-409d-b935-4f2891d43397"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:03:03 crc kubenswrapper[5120]: I0316 17:03:03.454894 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-db-create-r5jqt"] Mar 16 17:03:03 crc kubenswrapper[5120]: I0316 17:03:03.489457 5120 reconciler_common.go:299] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/5f9a749e-2dbb-409d-b935-4f2891d43397-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:03 crc kubenswrapper[5120]: I0316 17:03:03.489505 5120 reconciler_common.go:299] "Volume detached for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/5f9a749e-2dbb-409d-b935-4f2891d43397-ovsdbserver-sb-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:03 crc kubenswrapper[5120]: I0316 17:03:03.489619 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage01-crc" (UniqueName: "kubernetes.io/local-volume/local-storage01-crc") on node "crc" Mar 16 17:03:03 crc kubenswrapper[5120]: I0316 17:03:03.502244 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-db-create-r5jqt"] Mar 16 17:03:03 crc kubenswrapper[5120]: I0316 17:03:03.564977 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-4aec-account-create-update-wk5d7"] Mar 16 17:03:03 crc kubenswrapper[5120]: I0316 17:03:03.621026 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:03 crc kubenswrapper[5120]: I0316 17:03:03.704130 5120 generic.go:358] "Generic (PLEG): container finished" podID="662e5dd1-e157-4e76-bb3d-f4310c982cb0" containerID="6f3d5d660208c4b004ec65401f0ef1985dc6cff4ffcc709cf989fcdfe929481e" exitCode=143 Mar 16 17:03:03 crc kubenswrapper[5120]: I0316 17:03:03.705717 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"662e5dd1-e157-4e76-bb3d-f4310c982cb0","Type":"ContainerDied","Data":"6f3d5d660208c4b004ec65401f0ef1985dc6cff4ffcc709cf989fcdfe929481e"} Mar 16 17:03:03 crc kubenswrapper[5120]: I0316 17:03:03.720732 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-6b9b487fd6-hdw75"] Mar 16 17:03:03 crc kubenswrapper[5120]: I0316 17:03:03.721676 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-6b9b487fd6-hdw75" podUID="20dac7f8-f03f-40f8-93f1-5ba59f5471b8" containerName="barbican-keystone-listener-log" containerID="cri-o://d14ac2dba32d1f9dc4677dff3df7613d2465c455461e222dedd3cc507f276a58" gracePeriod=30 Mar 16 17:03:03 crc kubenswrapper[5120]: I0316 17:03:03.722075 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-6b9b487fd6-hdw75" podUID="20dac7f8-f03f-40f8-93f1-5ba59f5471b8" containerName="barbican-keystone-listener" containerID="cri-o://66f4292cc65d6c8fdd967ff988b50c682f3d1dd97a48df06d9e5a314aa95e2f0" gracePeriod=30 Mar 16 17:03:03 crc kubenswrapper[5120]: I0316 17:03:03.735427 5120 generic.go:358] "Generic (PLEG): container finished" podID="c88b7d39-fb86-490a-8af1-a6754dab05c9" containerID="23d89b9bddaab11d38e25c71f65ba18b27c7ad795dc47cea8da353083a2f58a6" exitCode=143 Mar 16 17:03:03 crc kubenswrapper[5120]: I0316 17:03:03.736148 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"c88b7d39-fb86-490a-8af1-a6754dab05c9","Type":"ContainerDied","Data":"23d89b9bddaab11d38e25c71f65ba18b27c7ad795dc47cea8da353083a2f58a6"} Mar 16 17:03:03 crc kubenswrapper[5120]: I0316 17:03:03.751818 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_5f9a749e-2dbb-409d-b935-4f2891d43397/ovsdbserver-sb/0.log" Mar 16 17:03:03 crc kubenswrapper[5120]: I0316 17:03:03.752840 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"5f9a749e-2dbb-409d-b935-4f2891d43397","Type":"ContainerDied","Data":"0934ba3b30d73ace883906f71cb2122520018c55bc3b6c3cc66341b6e1a439cd"} Mar 16 17:03:03 crc kubenswrapper[5120]: I0316 17:03:03.752903 5120 scope.go:117] "RemoveContainer" containerID="b9ea6c64365c3398bfb7a01d52bf92315e0914e469529e7c3947aad7173b22b9" Mar 16 17:03:03 crc kubenswrapper[5120]: I0316 17:03:03.753253 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:03:03 crc kubenswrapper[5120]: I0316 17:03:03.758959 5120 generic.go:358] "Generic (PLEG): container finished" podID="a6d827da-888b-4463-b40a-041fef751ccc" containerID="da57d0c85c4077395552861f82bea57510e45a2fb6167418fad685206cdc28c3" exitCode=137 Mar 16 17:03:03 crc kubenswrapper[5120]: I0316 17:03:03.765022 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-6f96bb5df9-spfxv"] Mar 16 17:03:03 crc kubenswrapper[5120]: I0316 17:03:03.765511 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-6f96bb5df9-spfxv" podUID="fb7a2068-5a18-4c7b-92d0-364f371d59df" containerName="barbican-worker-log" containerID="cri-o://97410dc76f412387b08b4c4b9c619dfcb470a14033e5445e72e531bacfce7fe0" gracePeriod=30 Mar 16 17:03:03 crc kubenswrapper[5120]: I0316 17:03:03.766360 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-6f96bb5df9-spfxv" podUID="fb7a2068-5a18-4c7b-92d0-364f371d59df" containerName="barbican-worker" containerID="cri-o://98b7269dea85c50b3653f02d53c97085506d9cf74a457e4aee7380d97d30f5ed" gracePeriod=30 Mar 16 17:03:03 crc kubenswrapper[5120]: I0316 17:03:03.806550 5120 generic.go:358] "Generic (PLEG): container finished" podID="15389dad-1183-441e-831c-de27ba4bac6e" containerID="0e421c8f4bd01dccbba64b51d71205b35f94454215e59a8a85c6b6da1bf033d0" exitCode=143 Mar 16 17:03:03 crc kubenswrapper[5120]: I0316 17:03:03.806717 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-7944fd944b-x8xzf" event={"ID":"15389dad-1183-441e-831c-de27ba4bac6e","Type":"ContainerDied","Data":"0e421c8f4bd01dccbba64b51d71205b35f94454215e59a8a85c6b6da1bf033d0"} Mar 16 17:03:03 crc kubenswrapper[5120]: I0316 17:03:03.868808 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 17:03:03 crc kubenswrapper[5120]: I0316 17:03:03.869721 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="4740a262-b05d-4d08-a797-022ca51bbf69" containerName="glance-httpd" containerID="cri-o://a45c73e43a2af1fbab31a5e550d8f195e79c3fb48fa21fde2f0110195187fb5d" gracePeriod=30 Mar 16 17:03:03 crc kubenswrapper[5120]: I0316 17:03:03.869956 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="4740a262-b05d-4d08-a797-022ca51bbf69" containerName="glance-log" containerID="cri-o://7e14ea4540badd71cef4ac605d56c49684315345c8bdeeda628c416b54c1cea9" gracePeriod=30 Mar 16 17:03:03 crc kubenswrapper[5120]: I0316 17:03:03.926543 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-db-create-mzrns"] Mar 16 17:03:03 crc kubenswrapper[5120]: I0316 17:03:03.933599 5120 generic.go:358] "Generic (PLEG): container finished" podID="aeacde0e-2862-4e69-9e7d-b88ca35912b8" containerID="e1cc7167cc6d60a4ebf70616ac23d4c7c61e0ea254b4ce5939c1c303a76ba999" exitCode=0 Mar 16 17:03:03 crc kubenswrapper[5120]: I0316 17:03:03.933653 5120 generic.go:358] "Generic (PLEG): container finished" podID="aeacde0e-2862-4e69-9e7d-b88ca35912b8" containerID="7e94fadc150440b2d15eda43c6265cf951173e81b5007cba27bd451ccf2a34f8" exitCode=0 Mar 16 17:03:03 crc kubenswrapper[5120]: I0316 17:03:03.933662 5120 generic.go:358] "Generic (PLEG): container finished" podID="aeacde0e-2862-4e69-9e7d-b88ca35912b8" containerID="44cf1d2680a6b0bd1f3ea49fc5485a76fb86944c47db006aee554801e08df0ce" exitCode=0 Mar 16 17:03:03 crc kubenswrapper[5120]: I0316 17:03:03.933670 5120 generic.go:358] "Generic (PLEG): container finished" podID="aeacde0e-2862-4e69-9e7d-b88ca35912b8" containerID="44cb080f8154154a4a36b453ce52f3a77a483a82435bbd06cdd2e041a88fb9cc" exitCode=0 Mar 16 17:03:03 crc kubenswrapper[5120]: I0316 17:03:03.933677 5120 generic.go:358] "Generic (PLEG): container finished" podID="aeacde0e-2862-4e69-9e7d-b88ca35912b8" containerID="8497a6be2923c0f36c47bb5031075424a0eb72cef279454537d1ede5f1036d3c" exitCode=0 Mar 16 17:03:03 crc kubenswrapper[5120]: I0316 17:03:03.933685 5120 generic.go:358] "Generic (PLEG): container finished" podID="aeacde0e-2862-4e69-9e7d-b88ca35912b8" containerID="dc957e1a9d7bc3e1ab0c920f56da07e7a63162092103ea420708963bc78c77e9" exitCode=0 Mar 16 17:03:03 crc kubenswrapper[5120]: I0316 17:03:03.933693 5120 generic.go:358] "Generic (PLEG): container finished" podID="aeacde0e-2862-4e69-9e7d-b88ca35912b8" containerID="77cf0e12f17307ccf6f98722a30265dbbf68f31c9b3098530603d4e4c87c55ce" exitCode=0 Mar 16 17:03:03 crc kubenswrapper[5120]: I0316 17:03:03.933724 5120 generic.go:358] "Generic (PLEG): container finished" podID="aeacde0e-2862-4e69-9e7d-b88ca35912b8" containerID="e53436fec9df727dcd2d2beeb431759ec0856450eefd69d18611fc1b41806ac9" exitCode=0 Mar 16 17:03:03 crc kubenswrapper[5120]: I0316 17:03:03.933731 5120 generic.go:358] "Generic (PLEG): container finished" podID="aeacde0e-2862-4e69-9e7d-b88ca35912b8" containerID="6469ce05f121fe416edfe1512f28049f6202b5c14ef3a421880ed284e3723c03" exitCode=0 Mar 16 17:03:03 crc kubenswrapper[5120]: I0316 17:03:03.933736 5120 generic.go:358] "Generic (PLEG): container finished" podID="aeacde0e-2862-4e69-9e7d-b88ca35912b8" containerID="1c06198550f093ba013bceb3903d2c570a51a69e1b891c5f9d6eb3066933c0e3" exitCode=0 Mar 16 17:03:03 crc kubenswrapper[5120]: I0316 17:03:03.933743 5120 generic.go:358] "Generic (PLEG): container finished" podID="aeacde0e-2862-4e69-9e7d-b88ca35912b8" containerID="9badd4ead08b15df51406a2e575e802a71fbfbdcabc5450a726e56b4e5258fde" exitCode=0 Mar 16 17:03:03 crc kubenswrapper[5120]: I0316 17:03:03.933748 5120 generic.go:358] "Generic (PLEG): container finished" podID="aeacde0e-2862-4e69-9e7d-b88ca35912b8" containerID="095159c69aab52ae8cd46d98b8a125878d38f737cac679858fce218635fcab9f" exitCode=0 Mar 16 17:03:03 crc kubenswrapper[5120]: I0316 17:03:03.933754 5120 generic.go:358] "Generic (PLEG): container finished" podID="aeacde0e-2862-4e69-9e7d-b88ca35912b8" containerID="39849e89c2ccc6af9f65a47428e8a27cfc4f4cdd9dae01876c7ffcc1c8ec9cdf" exitCode=0 Mar 16 17:03:03 crc kubenswrapper[5120]: I0316 17:03:03.933798 5120 generic.go:358] "Generic (PLEG): container finished" podID="aeacde0e-2862-4e69-9e7d-b88ca35912b8" containerID="6ca5d6ea4402f88922cc4bdc75810ff0810c7269d939fc714fc5d2581a0381bf" exitCode=0 Mar 16 17:03:03 crc kubenswrapper[5120]: I0316 17:03:03.934002 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"aeacde0e-2862-4e69-9e7d-b88ca35912b8","Type":"ContainerDied","Data":"e1cc7167cc6d60a4ebf70616ac23d4c7c61e0ea254b4ce5939c1c303a76ba999"} Mar 16 17:03:03 crc kubenswrapper[5120]: I0316 17:03:03.934040 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"aeacde0e-2862-4e69-9e7d-b88ca35912b8","Type":"ContainerDied","Data":"7e94fadc150440b2d15eda43c6265cf951173e81b5007cba27bd451ccf2a34f8"} Mar 16 17:03:03 crc kubenswrapper[5120]: I0316 17:03:03.934054 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"aeacde0e-2862-4e69-9e7d-b88ca35912b8","Type":"ContainerDied","Data":"44cf1d2680a6b0bd1f3ea49fc5485a76fb86944c47db006aee554801e08df0ce"} Mar 16 17:03:03 crc kubenswrapper[5120]: I0316 17:03:03.934606 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"aeacde0e-2862-4e69-9e7d-b88ca35912b8","Type":"ContainerDied","Data":"44cb080f8154154a4a36b453ce52f3a77a483a82435bbd06cdd2e041a88fb9cc"} Mar 16 17:03:03 crc kubenswrapper[5120]: I0316 17:03:03.934623 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"aeacde0e-2862-4e69-9e7d-b88ca35912b8","Type":"ContainerDied","Data":"8497a6be2923c0f36c47bb5031075424a0eb72cef279454537d1ede5f1036d3c"} Mar 16 17:03:03 crc kubenswrapper[5120]: I0316 17:03:03.934638 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"aeacde0e-2862-4e69-9e7d-b88ca35912b8","Type":"ContainerDied","Data":"dc957e1a9d7bc3e1ab0c920f56da07e7a63162092103ea420708963bc78c77e9"} Mar 16 17:03:03 crc kubenswrapper[5120]: I0316 17:03:03.934674 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"aeacde0e-2862-4e69-9e7d-b88ca35912b8","Type":"ContainerDied","Data":"77cf0e12f17307ccf6f98722a30265dbbf68f31c9b3098530603d4e4c87c55ce"} Mar 16 17:03:03 crc kubenswrapper[5120]: I0316 17:03:03.934687 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"aeacde0e-2862-4e69-9e7d-b88ca35912b8","Type":"ContainerDied","Data":"e53436fec9df727dcd2d2beeb431759ec0856450eefd69d18611fc1b41806ac9"} Mar 16 17:03:03 crc kubenswrapper[5120]: I0316 17:03:03.934702 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"aeacde0e-2862-4e69-9e7d-b88ca35912b8","Type":"ContainerDied","Data":"6469ce05f121fe416edfe1512f28049f6202b5c14ef3a421880ed284e3723c03"} Mar 16 17:03:03 crc kubenswrapper[5120]: I0316 17:03:03.934714 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"aeacde0e-2862-4e69-9e7d-b88ca35912b8","Type":"ContainerDied","Data":"1c06198550f093ba013bceb3903d2c570a51a69e1b891c5f9d6eb3066933c0e3"} Mar 16 17:03:03 crc kubenswrapper[5120]: I0316 17:03:03.934725 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"aeacde0e-2862-4e69-9e7d-b88ca35912b8","Type":"ContainerDied","Data":"9badd4ead08b15df51406a2e575e802a71fbfbdcabc5450a726e56b4e5258fde"} Mar 16 17:03:03 crc kubenswrapper[5120]: I0316 17:03:03.934752 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"aeacde0e-2862-4e69-9e7d-b88ca35912b8","Type":"ContainerDied","Data":"095159c69aab52ae8cd46d98b8a125878d38f737cac679858fce218635fcab9f"} Mar 16 17:03:03 crc kubenswrapper[5120]: I0316 17:03:03.934773 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"aeacde0e-2862-4e69-9e7d-b88ca35912b8","Type":"ContainerDied","Data":"39849e89c2ccc6af9f65a47428e8a27cfc4f4cdd9dae01876c7ffcc1c8ec9cdf"} Mar 16 17:03:03 crc kubenswrapper[5120]: I0316 17:03:03.934785 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"aeacde0e-2862-4e69-9e7d-b88ca35912b8","Type":"ContainerDied","Data":"6ca5d6ea4402f88922cc4bdc75810ff0810c7269d939fc714fc5d2581a0381bf"} Mar 16 17:03:03 crc kubenswrapper[5120]: W0316 17:03:03.995461 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3e9c8fc2_85ba_4408_a98b_56b2d62da7e3.slice/crio-148db83ae7067f4e115a5aef4e5c43ca3b4844ff762561badcfb3fb66cc778b1 WatchSource:0}: Error finding container 148db83ae7067f4e115a5aef4e5c43ca3b4844ff762561badcfb3fb66cc778b1: Status 404 returned error can't find the container with id 148db83ae7067f4e115a5aef4e5c43ca3b4844ff762561badcfb3fb66cc778b1 Mar 16 17:03:04 crc kubenswrapper[5120]: I0316 17:03:04.032123 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-db-create-mzrns"] Mar 16 17:03:04 crc kubenswrapper[5120]: I0316 17:03:04.046537 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_e5f68c9e-894a-4eac-90fc-be12f8c49913/ovsdbserver-nb/0.log" Mar 16 17:03:04 crc kubenswrapper[5120]: I0316 17:03:04.046666 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:03:04 crc kubenswrapper[5120]: I0316 17:03:04.083481 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 17:03:04 crc kubenswrapper[5120]: I0316 17:03:04.110388 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-db-create-95bsl"] Mar 16 17:03:04 crc kubenswrapper[5120]: I0316 17:03:04.126204 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-db-create-95bsl"] Mar 16 17:03:04 crc kubenswrapper[5120]: I0316 17:03:04.135943 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-7bbc5ddcc6-cxnhk"] Mar 16 17:03:04 crc kubenswrapper[5120]: I0316 17:03:04.136389 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-7bbc5ddcc6-cxnhk" podUID="53cbb212-f009-4d4e-90fc-9a50a14cc62b" containerName="barbican-api-log" containerID="cri-o://1aa3bba3e930ec962235431ddf3fe2a5d6f2094302d4df6b0f874c2f055eb2f6" gracePeriod=30 Mar 16 17:03:04 crc kubenswrapper[5120]: I0316 17:03:04.137238 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-7bbc5ddcc6-cxnhk" podUID="53cbb212-f009-4d4e-90fc-9a50a14cc62b" containerName="barbican-api" containerID="cri-o://cd314e8c2ba56b3a12ba0679d21f2a55a4f7ab45f72f1581f1ae854629e205c9" gracePeriod=30 Mar 16 17:03:04 crc kubenswrapper[5120]: I0316 17:03:04.142328 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/e5f68c9e-894a-4eac-90fc-be12f8c49913-ovsdbserver-nb-tls-certs\") pod \"e5f68c9e-894a-4eac-90fc-be12f8c49913\" (UID: \"e5f68c9e-894a-4eac-90fc-be12f8c49913\") " Mar 16 17:03:04 crc kubenswrapper[5120]: I0316 17:03:04.142441 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovndbcluster-nb-etc-ovn\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"e5f68c9e-894a-4eac-90fc-be12f8c49913\" (UID: \"e5f68c9e-894a-4eac-90fc-be12f8c49913\") " Mar 16 17:03:04 crc kubenswrapper[5120]: I0316 17:03:04.142517 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e5f68c9e-894a-4eac-90fc-be12f8c49913-combined-ca-bundle\") pod \"e5f68c9e-894a-4eac-90fc-be12f8c49913\" (UID: \"e5f68c9e-894a-4eac-90fc-be12f8c49913\") " Mar 16 17:03:04 crc kubenswrapper[5120]: I0316 17:03:04.142605 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/e5f68c9e-894a-4eac-90fc-be12f8c49913-scripts\") pod \"e5f68c9e-894a-4eac-90fc-be12f8c49913\" (UID: \"e5f68c9e-894a-4eac-90fc-be12f8c49913\") " Mar 16 17:03:04 crc kubenswrapper[5120]: I0316 17:03:04.142688 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q7szz\" (UniqueName: \"kubernetes.io/projected/e5f68c9e-894a-4eac-90fc-be12f8c49913-kube-api-access-q7szz\") pod \"e5f68c9e-894a-4eac-90fc-be12f8c49913\" (UID: \"e5f68c9e-894a-4eac-90fc-be12f8c49913\") " Mar 16 17:03:04 crc kubenswrapper[5120]: I0316 17:03:04.143026 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e5f68c9e-894a-4eac-90fc-be12f8c49913-config\") pod \"e5f68c9e-894a-4eac-90fc-be12f8c49913\" (UID: \"e5f68c9e-894a-4eac-90fc-be12f8c49913\") " Mar 16 17:03:04 crc kubenswrapper[5120]: I0316 17:03:04.143086 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/e5f68c9e-894a-4eac-90fc-be12f8c49913-metrics-certs-tls-certs\") pod \"e5f68c9e-894a-4eac-90fc-be12f8c49913\" (UID: \"e5f68c9e-894a-4eac-90fc-be12f8c49913\") " Mar 16 17:03:04 crc kubenswrapper[5120]: I0316 17:03:04.143156 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/e5f68c9e-894a-4eac-90fc-be12f8c49913-ovsdb-rundir\") pod \"e5f68c9e-894a-4eac-90fc-be12f8c49913\" (UID: \"e5f68c9e-894a-4eac-90fc-be12f8c49913\") " Mar 16 17:03:04 crc kubenswrapper[5120]: I0316 17:03:04.145907 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5f68c9e-894a-4eac-90fc-be12f8c49913-ovsdb-rundir" (OuterVolumeSpecName: "ovsdb-rundir") pod "e5f68c9e-894a-4eac-90fc-be12f8c49913" (UID: "e5f68c9e-894a-4eac-90fc-be12f8c49913"). InnerVolumeSpecName "ovsdb-rundir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:03:04 crc kubenswrapper[5120]: I0316 17:03:04.151180 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-cd46-account-create-update-mrxmb"] Mar 16 17:03:04 crc kubenswrapper[5120]: I0316 17:03:04.155139 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" podUID="279c3e84-623c-4c5f-ae15-d7d8c439c4dc" containerName="rabbitmq" containerID="cri-o://f74ecc023217184e5ac69eafc7250f1064a8b35dbd565a66ef8fc760056c5822" gracePeriod=604800 Mar 16 17:03:04 crc kubenswrapper[5120]: I0316 17:03:04.155438 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e5f68c9e-894a-4eac-90fc-be12f8c49913-config" (OuterVolumeSpecName: "config") pod "e5f68c9e-894a-4eac-90fc-be12f8c49913" (UID: "e5f68c9e-894a-4eac-90fc-be12f8c49913"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:03:04 crc kubenswrapper[5120]: I0316 17:03:04.157168 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e5f68c9e-894a-4eac-90fc-be12f8c49913-scripts" (OuterVolumeSpecName: "scripts") pod "e5f68c9e-894a-4eac-90fc-be12f8c49913" (UID: "e5f68c9e-894a-4eac-90fc-be12f8c49913"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:03:04 crc kubenswrapper[5120]: I0316 17:03:04.160218 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage08-crc" (OuterVolumeSpecName: "ovndbcluster-nb-etc-ovn") pod "e5f68c9e-894a-4eac-90fc-be12f8c49913" (UID: "e5f68c9e-894a-4eac-90fc-be12f8c49913"). InnerVolumeSpecName "local-storage08-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 17:03:04 crc kubenswrapper[5120]: I0316 17:03:04.171156 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-4aec-account-create-update-wk5d7"] Mar 16 17:03:04 crc kubenswrapper[5120]: I0316 17:03:04.191610 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e5f68c9e-894a-4eac-90fc-be12f8c49913-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e5f68c9e-894a-4eac-90fc-be12f8c49913" (UID: "e5f68c9e-894a-4eac-90fc-be12f8c49913"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:03:04 crc kubenswrapper[5120]: I0316 17:03:04.193339 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5f68c9e-894a-4eac-90fc-be12f8c49913-kube-api-access-q7szz" (OuterVolumeSpecName: "kube-api-access-q7szz") pod "e5f68c9e-894a-4eac-90fc-be12f8c49913" (UID: "e5f68c9e-894a-4eac-90fc-be12f8c49913"). InnerVolumeSpecName "kube-api-access-q7szz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:03:04 crc kubenswrapper[5120]: I0316 17:03:04.210796 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 17:03:04 crc kubenswrapper[5120]: I0316 17:03:04.243955 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 17:03:04 crc kubenswrapper[5120]: I0316 17:03:04.244215 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="d226072d-5d81-4c83-ade7-29bdc1df4c80" containerName="nova-scheduler-scheduler" containerID="cri-o://332dae2edfbf2e0f756cde2904bec2d8bbc2240aa37e84431e89ca72362d5c89" gracePeriod=30 Mar 16 17:03:04 crc kubenswrapper[5120]: I0316 17:03:04.251473 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e5f68c9e-894a-4eac-90fc-be12f8c49913-config\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:04 crc kubenswrapper[5120]: I0316 17:03:04.251537 5120 reconciler_common.go:299] "Volume detached for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/e5f68c9e-894a-4eac-90fc-be12f8c49913-ovsdb-rundir\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:04 crc kubenswrapper[5120]: I0316 17:03:04.251629 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") on node \"crc\" " Mar 16 17:03:04 crc kubenswrapper[5120]: I0316 17:03:04.260058 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e5f68c9e-894a-4eac-90fc-be12f8c49913-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:04 crc kubenswrapper[5120]: I0316 17:03:04.260121 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/e5f68c9e-894a-4eac-90fc-be12f8c49913-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:04 crc kubenswrapper[5120]: I0316 17:03:04.260142 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q7szz\" (UniqueName: \"kubernetes.io/projected/e5f68c9e-894a-4eac-90fc-be12f8c49913-kube-api-access-q7szz\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:04 crc kubenswrapper[5120]: I0316 17:03:04.269398 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-e0b3-account-create-update-22hwc"] Mar 16 17:03:04 crc kubenswrapper[5120]: I0316 17:03:04.285619 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" podUID="279c3e84-623c-4c5f-ae15-d7d8c439c4dc" containerName="rabbitmq" probeResult="failure" output="dial tcp 10.217.0.217:5671: connect: connection refused" Mar 16 17:03:04 crc kubenswrapper[5120]: I0316 17:03:04.300016 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-e0b3-account-create-update-22hwc"] Mar 16 17:03:04 crc kubenswrapper[5120]: I0316 17:03:04.300215 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage08-crc" (UniqueName: "kubernetes.io/local-volume/local-storage08-crc") on node "crc" Mar 16 17:03:04 crc kubenswrapper[5120]: W0316 17:03:04.328871 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod70e3d80b_ae48_4742_90dd_95c106254f9f.slice/crio-babf579bf068a7a84c9998f5a513362b42369fa81062f55f8046e06d56371bd6 WatchSource:0}: Error finding container babf579bf068a7a84c9998f5a513362b42369fa81062f55f8046e06d56371bd6: Status 404 returned error can't find the container with id babf579bf068a7a84c9998f5a513362b42369fa81062f55f8046e06d56371bd6 Mar 16 17:03:04 crc kubenswrapper[5120]: I0316 17:03:04.329003 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-nn7ww"] Mar 16 17:03:04 crc kubenswrapper[5120]: E0316 17:03:04.329603 5120 kuberuntime_manager.go:1358] "Unhandled Error" err=< Mar 16 17:03:04 crc kubenswrapper[5120]: container &Container{Name:mariadb-account-create-update,Image:quay.io/podified-antelope-centos9/openstack-mariadb@sha256:4caef2b55e01b9a7ee88a22bc69db1893521a91d95c7ad4c8e593f14f17a5f95,Command:[/bin/sh -c #!/bin/bash Mar 16 17:03:04 crc kubenswrapper[5120]: Mar 16 17:03:04 crc kubenswrapper[5120]: MYSQL_REMOTE_HOST="" source /var/lib/operator-scripts/mysql_root_auth.sh Mar 16 17:03:04 crc kubenswrapper[5120]: Mar 16 17:03:04 crc kubenswrapper[5120]: export DatabasePassword=${DatabasePassword:?"Please specify a DatabasePassword variable."} Mar 16 17:03:04 crc kubenswrapper[5120]: Mar 16 17:03:04 crc kubenswrapper[5120]: MYSQL_CMD="mysql -h -u root -P 3306" Mar 16 17:03:04 crc kubenswrapper[5120]: Mar 16 17:03:04 crc kubenswrapper[5120]: if [ -n "cinder" ]; then Mar 16 17:03:04 crc kubenswrapper[5120]: GRANT_DATABASE="cinder" Mar 16 17:03:04 crc kubenswrapper[5120]: else Mar 16 17:03:04 crc kubenswrapper[5120]: GRANT_DATABASE="*" Mar 16 17:03:04 crc kubenswrapper[5120]: fi Mar 16 17:03:04 crc kubenswrapper[5120]: Mar 16 17:03:04 crc kubenswrapper[5120]: # going for maximum compatibility here: Mar 16 17:03:04 crc kubenswrapper[5120]: # 1. MySQL 8 no longer allows implicit create user when GRANT is used Mar 16 17:03:04 crc kubenswrapper[5120]: # 2. MariaDB has "CREATE OR REPLACE", but MySQL does not Mar 16 17:03:04 crc kubenswrapper[5120]: # 3. create user with CREATE but then do all password and TLS with ALTER to Mar 16 17:03:04 crc kubenswrapper[5120]: # support updates Mar 16 17:03:04 crc kubenswrapper[5120]: Mar 16 17:03:04 crc kubenswrapper[5120]: $MYSQL_CMD < logger="UnhandledError" Mar 16 17:03:04 crc kubenswrapper[5120]: E0316 17:03:04.331342 5120 kuberuntime_manager.go:1358] "Unhandled Error" err=< Mar 16 17:03:04 crc kubenswrapper[5120]: container &Container{Name:mariadb-account-create-update,Image:quay.io/podified-antelope-centos9/openstack-mariadb@sha256:4caef2b55e01b9a7ee88a22bc69db1893521a91d95c7ad4c8e593f14f17a5f95,Command:[/bin/sh -c #!/bin/bash Mar 16 17:03:04 crc kubenswrapper[5120]: Mar 16 17:03:04 crc kubenswrapper[5120]: MYSQL_REMOTE_HOST="" source /var/lib/operator-scripts/mysql_root_auth.sh Mar 16 17:03:04 crc kubenswrapper[5120]: Mar 16 17:03:04 crc kubenswrapper[5120]: export DatabasePassword=${DatabasePassword:?"Please specify a DatabasePassword variable."} Mar 16 17:03:04 crc kubenswrapper[5120]: Mar 16 17:03:04 crc kubenswrapper[5120]: MYSQL_CMD="mysql -h -u root -P 3306" Mar 16 17:03:04 crc kubenswrapper[5120]: Mar 16 17:03:04 crc kubenswrapper[5120]: if [ -n "barbican" ]; then Mar 16 17:03:04 crc kubenswrapper[5120]: GRANT_DATABASE="barbican" Mar 16 17:03:04 crc kubenswrapper[5120]: else Mar 16 17:03:04 crc kubenswrapper[5120]: GRANT_DATABASE="*" Mar 16 17:03:04 crc kubenswrapper[5120]: fi Mar 16 17:03:04 crc kubenswrapper[5120]: Mar 16 17:03:04 crc kubenswrapper[5120]: # going for maximum compatibility here: Mar 16 17:03:04 crc kubenswrapper[5120]: # 1. MySQL 8 no longer allows implicit create user when GRANT is used Mar 16 17:03:04 crc kubenswrapper[5120]: # 2. MariaDB has "CREATE OR REPLACE", but MySQL does not Mar 16 17:03:04 crc kubenswrapper[5120]: # 3. create user with CREATE but then do all password and TLS with ALTER to Mar 16 17:03:04 crc kubenswrapper[5120]: # support updates Mar 16 17:03:04 crc kubenswrapper[5120]: Mar 16 17:03:04 crc kubenswrapper[5120]: $MYSQL_CMD < logger="UnhandledError" Mar 16 17:03:04 crc kubenswrapper[5120]: E0316 17:03:04.331506 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"mariadb-account-create-update\" with CreateContainerConfigError: \"secret \\\"cinder-db-secret\\\" not found\"" pod="openstack-kuttl-tests/cinder-4aec-account-create-update-wk5d7" podUID="4aa85fd7-7d77-4285-97ff-4fa658725080" Mar 16 17:03:04 crc kubenswrapper[5120]: E0316 17:03:04.333438 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"mariadb-account-create-update\" with CreateContainerConfigError: \"secret \\\"barbican-db-secret\\\" not found\"" pod="openstack-kuttl-tests/barbican-cd46-account-create-update-mrxmb" podUID="3e9c8fc2-85ba-4408-a98b-56b2d62da7e3" Mar 16 17:03:04 crc kubenswrapper[5120]: I0316 17:03:04.340876 5120 scope.go:117] "RemoveContainer" containerID="a4d20d76546c51fa2980f8102ff0540c2e4371359f2aac37edf70df305a1aa75" Mar 16 17:03:04 crc kubenswrapper[5120]: I0316 17:03:04.344252 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-nn7ww"] Mar 16 17:03:04 crc kubenswrapper[5120]: I0316 17:03:04.349393 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e5f68c9e-894a-4eac-90fc-be12f8c49913-ovsdbserver-nb-tls-certs" (OuterVolumeSpecName: "ovsdbserver-nb-tls-certs") pod "e5f68c9e-894a-4eac-90fc-be12f8c49913" (UID: "e5f68c9e-894a-4eac-90fc-be12f8c49913"). InnerVolumeSpecName "ovsdbserver-nb-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:03:04 crc kubenswrapper[5120]: I0316 17:03:04.363350 5120 reconciler_common.go:299] "Volume detached for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/e5f68c9e-894a-4eac-90fc-be12f8c49913-ovsdbserver-nb-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:04 crc kubenswrapper[5120]: I0316 17:03:04.363384 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:04 crc kubenswrapper[5120]: I0316 17:03:04.370503 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-wbxjt"] Mar 16 17:03:04 crc kubenswrapper[5120]: I0316 17:03:04.380679 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e5f68c9e-894a-4eac-90fc-be12f8c49913-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "e5f68c9e-894a-4eac-90fc-be12f8c49913" (UID: "e5f68c9e-894a-4eac-90fc-be12f8c49913"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:03:04 crc kubenswrapper[5120]: I0316 17:03:04.401920 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-wbxjt"] Mar 16 17:03:04 crc kubenswrapper[5120]: I0316 17:03:04.417867 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-ff09-account-create-update-2k6sp"] Mar 16 17:03:04 crc kubenswrapper[5120]: I0316 17:03:04.427801 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-ff09-account-create-update-2k6sp"] Mar 16 17:03:04 crc kubenswrapper[5120]: I0316 17:03:04.437740 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 17:03:04 crc kubenswrapper[5120]: I0316 17:03:04.438054 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="5b6e7f67-ee2d-4fbc-9519-00493157aec0" containerName="nova-metadata-log" containerID="cri-o://0cd4e5c12c13138cfe18452ae14adb071a83d9e94a0872236f28ec43b55bae15" gracePeriod=30 Mar 16 17:03:04 crc kubenswrapper[5120]: I0316 17:03:04.438211 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="5b6e7f67-ee2d-4fbc-9519-00493157aec0" containerName="nova-metadata-metadata" containerID="cri-o://0ed9f3a2d7a1517b282f8c04f00429f887151e188250ed9748eecf16b6169afe" gracePeriod=30 Mar 16 17:03:04 crc kubenswrapper[5120]: I0316 17:03:04.449991 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-db-create-k56b6"] Mar 16 17:03:04 crc kubenswrapper[5120]: I0316 17:03:04.466137 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-db-create-k56b6"] Mar 16 17:03:04 crc kubenswrapper[5120]: I0316 17:03:04.466664 5120 reconciler_common.go:299] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/e5f68c9e-894a-4eac-90fc-be12f8c49913-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:04 crc kubenswrapper[5120]: I0316 17:03:04.531588 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/openstack-cell1-galera-0" podUID="8d144169-a686-4862-8b52-7a945bc3a36a" containerName="galera" containerID="cri-o://94add9dcf1e03858664425cf329c526e5cc98a269344ecef11775ce6356facac" gracePeriod=30 Mar 16 17:03:04 crc kubenswrapper[5120]: I0316 17:03:04.547868 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 17:03:04 crc kubenswrapper[5120]: I0316 17:03:04.548186 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="593ab600-83e5-4863-b042-4fd69af25046" containerName="nova-api-log" containerID="cri-o://9d0c721f1532054af65c6cc8928ac439588b2d9e39e78b42d253329b01689024" gracePeriod=30 Mar 16 17:03:04 crc kubenswrapper[5120]: I0316 17:03:04.548439 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="593ab600-83e5-4863-b042-4fd69af25046" containerName="nova-api-api" containerID="cri-o://8e832e7dc397e67e74670c05012d05b2a1c2dc1d15b52f9df2af956db29f56da" gracePeriod=30 Mar 16 17:03:04 crc kubenswrapper[5120]: I0316 17:03:04.566591 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-db-create-fnhgt"] Mar 16 17:03:04 crc kubenswrapper[5120]: I0316 17:03:04.578898 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-db-create-fnhgt"] Mar 16 17:03:04 crc kubenswrapper[5120]: I0316 17:03:04.587964 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-fqkvr"] Mar 16 17:03:04 crc kubenswrapper[5120]: I0316 17:03:04.604094 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-fqkvr"] Mar 16 17:03:04 crc kubenswrapper[5120]: I0316 17:03:04.622196 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 17:03:04 crc kubenswrapper[5120]: I0316 17:03:04.622438 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podUID="03d17609-c2ae-4dd1-b28d-4868bbcbe60f" containerName="nova-cell1-novncproxy-novncproxy" containerID="cri-o://77ba34a41a27a7a956bde218fa15dba2b646abd9ed17c20b7ef4ac7872dbb267" gracePeriod=30 Mar 16 17:03:04 crc kubenswrapper[5120]: I0316 17:03:04.688526 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="33aaf037-e50b-4983-94bd-46874d5aa9db" path="/var/lib/kubelet/pods/33aaf037-e50b-4983-94bd-46874d5aa9db/volumes" Mar 16 17:03:04 crc kubenswrapper[5120]: I0316 17:03:04.689476 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="38dbe21c-3c67-4241-b83d-0de332345bb9" path="/var/lib/kubelet/pods/38dbe21c-3c67-4241-b83d-0de332345bb9/volumes" Mar 16 17:03:04 crc kubenswrapper[5120]: I0316 17:03:04.690164 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="40d27067-1463-46fe-aef7-9d45c77c74c8" path="/var/lib/kubelet/pods/40d27067-1463-46fe-aef7-9d45c77c74c8/volumes" Mar 16 17:03:04 crc kubenswrapper[5120]: I0316 17:03:04.690957 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="90a64bb3-08ab-478c-812b-d673e0772e88" path="/var/lib/kubelet/pods/90a64bb3-08ab-478c-812b-d673e0772e88/volumes" Mar 16 17:03:04 crc kubenswrapper[5120]: I0316 17:03:04.693813 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a31afdf7-9949-4903-bc96-02df17647b63" path="/var/lib/kubelet/pods/a31afdf7-9949-4903-bc96-02df17647b63/volumes" Mar 16 17:03:04 crc kubenswrapper[5120]: I0316 17:03:04.694489 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a51b0e1a-a3bb-498f-96e4-b1aa631e68c2" path="/var/lib/kubelet/pods/a51b0e1a-a3bb-498f-96e4-b1aa631e68c2/volumes" Mar 16 17:03:04 crc kubenswrapper[5120]: I0316 17:03:04.695274 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b07886c3-349e-4172-8f68-077ceaf8711d" path="/var/lib/kubelet/pods/b07886c3-349e-4172-8f68-077ceaf8711d/volumes" Mar 16 17:03:04 crc kubenswrapper[5120]: I0316 17:03:04.696689 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bd8e2b8b-c48c-47f7-bd40-fdd658d1cdea" path="/var/lib/kubelet/pods/bd8e2b8b-c48c-47f7-bd40-fdd658d1cdea/volumes" Mar 16 17:03:04 crc kubenswrapper[5120]: I0316 17:03:04.697316 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb9960d8-4a8c-4a7e-88d5-de6c5e46e72f" path="/var/lib/kubelet/pods/cb9960d8-4a8c-4a7e-88d5-de6c5e46e72f/volumes" Mar 16 17:03:04 crc kubenswrapper[5120]: I0316 17:03:04.698150 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d4bdf21c-03be-41af-bd5b-e07309d9129e" path="/var/lib/kubelet/pods/d4bdf21c-03be-41af-bd5b-e07309d9129e/volumes" Mar 16 17:03:04 crc kubenswrapper[5120]: I0316 17:03:04.701629 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d90484fe-04d6-4cf9-a940-0356b2df189d" path="/var/lib/kubelet/pods/d90484fe-04d6-4cf9-a940-0356b2df189d/volumes" Mar 16 17:03:04 crc kubenswrapper[5120]: I0316 17:03:04.702292 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="feb1fe6d-59b3-482e-8dce-41b7d0ef4771" path="/var/lib/kubelet/pods/feb1fe6d-59b3-482e-8dce-41b7d0ef4771/volumes" Mar 16 17:03:04 crc kubenswrapper[5120]: I0316 17:03:04.703697 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ffde2e4f-11b6-4b41-8953-bca4be87a2bd" path="/var/lib/kubelet/pods/ffde2e4f-11b6-4b41-8953-bca4be87a2bd/volumes" Mar 16 17:03:04 crc kubenswrapper[5120]: I0316 17:03:04.705185 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 17:03:04 crc kubenswrapper[5120]: I0316 17:03:04.705218 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-cd46-account-create-update-mrxmb"] Mar 16 17:03:04 crc kubenswrapper[5120]: I0316 17:03:04.705499 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/kube-state-metrics-0" podUID="dfe6d730-dd04-4759-a360-e9a2e8f88dab" containerName="kube-state-metrics" containerID="cri-o://1fff1e33966ca1ffdcce7becb84f51ce0c07a0ab94db1170d3919627c2cd57ed" gracePeriod=30 Mar 16 17:03:04 crc kubenswrapper[5120]: I0316 17:03:04.736422 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:03:04 crc kubenswrapper[5120]: I0316 17:03:04.736753 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="9822d70f-7496-4aa6-b0fa-28a1c4ae7db7" containerName="ceilometer-central-agent" containerID="cri-o://676ecca2659a20874ab25a6a892347a8f432119ffef02332827f47ffc00c26af" gracePeriod=30 Mar 16 17:03:04 crc kubenswrapper[5120]: I0316 17:03:04.737362 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="9822d70f-7496-4aa6-b0fa-28a1c4ae7db7" containerName="proxy-httpd" containerID="cri-o://44084d0cacbd15cd8ba43433333853d104701dcb0fd8b785f4da824e3dfbe0e3" gracePeriod=30 Mar 16 17:03:04 crc kubenswrapper[5120]: I0316 17:03:04.737424 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="9822d70f-7496-4aa6-b0fa-28a1c4ae7db7" containerName="sg-core" containerID="cri-o://f13096a43403b81a2b3ce5c5e96d83e5f8b0fbb45eae3a01b928bf03074aa9f1" gracePeriod=30 Mar 16 17:03:04 crc kubenswrapper[5120]: I0316 17:03:04.737463 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="9822d70f-7496-4aa6-b0fa-28a1c4ae7db7" containerName="ceilometer-notification-agent" containerID="cri-o://66f1189a24416e91074b04dcaf79e83fefb91f45f121a8fd03153adae3b4103d" gracePeriod=30 Mar 16 17:03:04 crc kubenswrapper[5120]: I0316 17:03:04.767497 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-m55p2"] Mar 16 17:03:04 crc kubenswrapper[5120]: I0316 17:03:04.789029 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 17:03:04 crc kubenswrapper[5120]: I0316 17:03:04.789828 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="61d14db6-7d33-4e5f-8252-844441e519d7" containerName="nova-cell1-conductor-conductor" containerID="cri-o://8d1a8aa9bd86f2402b10b59285567fd78f4d62123af2fd8a44ad19b94394c08b" gracePeriod=30 Mar 16 17:03:04 crc kubenswrapper[5120]: I0316 17:03:04.802947 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-ttt9d"] Mar 16 17:03:04 crc kubenswrapper[5120]: I0316 17:03:04.827013 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-ttt9d"] Mar 16 17:03:04 crc kubenswrapper[5120]: I0316 17:03:04.835406 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 17:03:04 crc kubenswrapper[5120]: I0316 17:03:04.835636 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="284dc632-d111-40d1-97a9-f6e78aa92ce7" containerName="nova-cell0-conductor-conductor" containerID="cri-o://c87cdce774051210b03731c88d545718b1887f3878a50a3fc79d5fc070ffb305" gracePeriod=30 Mar 16 17:03:04 crc kubenswrapper[5120]: I0316 17:03:04.851711 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-7cmgm"] Mar 16 17:03:04 crc kubenswrapper[5120]: I0316 17:03:04.863891 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-7cmgm"] Mar 16 17:03:04 crc kubenswrapper[5120]: I0316 17:03:04.870923 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 17:03:04 crc kubenswrapper[5120]: I0316 17:03:04.887598 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 17:03:04 crc kubenswrapper[5120]: I0316 17:03:04.893876 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Mar 16 17:03:04 crc kubenswrapper[5120]: I0316 17:03:04.983711 5120 generic.go:358] "Generic (PLEG): container finished" podID="5b6e7f67-ee2d-4fbc-9519-00493157aec0" containerID="0cd4e5c12c13138cfe18452ae14adb071a83d9e94a0872236f28ec43b55bae15" exitCode=143 Mar 16 17:03:04 crc kubenswrapper[5120]: I0316 17:03:04.984114 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"5b6e7f67-ee2d-4fbc-9519-00493157aec0","Type":"ContainerDied","Data":"0cd4e5c12c13138cfe18452ae14adb071a83d9e94a0872236f28ec43b55bae15"} Mar 16 17:03:04 crc kubenswrapper[5120]: I0316 17:03:04.992523 5120 generic.go:358] "Generic (PLEG): container finished" podID="20dac7f8-f03f-40f8-93f1-5ba59f5471b8" containerID="d14ac2dba32d1f9dc4677dff3df7613d2465c455461e222dedd3cc507f276a58" exitCode=143 Mar 16 17:03:04 crc kubenswrapper[5120]: I0316 17:03:04.992755 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-6b9b487fd6-hdw75" event={"ID":"20dac7f8-f03f-40f8-93f1-5ba59f5471b8","Type":"ContainerDied","Data":"d14ac2dba32d1f9dc4677dff3df7613d2465c455461e222dedd3cc507f276a58"} Mar 16 17:03:04 crc kubenswrapper[5120]: I0316 17:03:04.996980 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c9gv7\" (UniqueName: \"kubernetes.io/projected/a6d827da-888b-4463-b40a-041fef751ccc-kube-api-access-c9gv7\") pod \"a6d827da-888b-4463-b40a-041fef751ccc\" (UID: \"a6d827da-888b-4463-b40a-041fef751ccc\") " Mar 16 17:03:04 crc kubenswrapper[5120]: I0316 17:03:04.999034 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/a6d827da-888b-4463-b40a-041fef751ccc-openstack-config\") pod \"a6d827da-888b-4463-b40a-041fef751ccc\" (UID: \"a6d827da-888b-4463-b40a-041fef751ccc\") " Mar 16 17:03:04 crc kubenswrapper[5120]: I0316 17:03:04.999085 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a6d827da-888b-4463-b40a-041fef751ccc-combined-ca-bundle\") pod \"a6d827da-888b-4463-b40a-041fef751ccc\" (UID: \"a6d827da-888b-4463-b40a-041fef751ccc\") " Mar 16 17:03:04 crc kubenswrapper[5120]: I0316 17:03:04.999254 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/a6d827da-888b-4463-b40a-041fef751ccc-openstack-config-secret\") pod \"a6d827da-888b-4463-b40a-041fef751ccc\" (UID: \"a6d827da-888b-4463-b40a-041fef751ccc\") " Mar 16 17:03:05 crc kubenswrapper[5120]: I0316 17:03:05.001829 5120 generic.go:358] "Generic (PLEG): container finished" podID="2cadcb9e-2a3b-4c14-8fcc-39939326678f" containerID="082f786272aedd7c68ee70e2d12f600cf20e6afc27f262f48a3b03f153c4650e" exitCode=0 Mar 16 17:03:05 crc kubenswrapper[5120]: I0316 17:03:05.001871 5120 generic.go:358] "Generic (PLEG): container finished" podID="2cadcb9e-2a3b-4c14-8fcc-39939326678f" containerID="6a23a121b6a8a57df4ea8368ee7e1898510506a29ce4485b74adeb024aebebae" exitCode=0 Mar 16 17:03:05 crc kubenswrapper[5120]: I0316 17:03:05.002123 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"2cadcb9e-2a3b-4c14-8fcc-39939326678f","Type":"ContainerDied","Data":"082f786272aedd7c68ee70e2d12f600cf20e6afc27f262f48a3b03f153c4650e"} Mar 16 17:03:05 crc kubenswrapper[5120]: I0316 17:03:05.002162 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"2cadcb9e-2a3b-4c14-8fcc-39939326678f","Type":"ContainerDied","Data":"6a23a121b6a8a57df4ea8368ee7e1898510506a29ce4485b74adeb024aebebae"} Mar 16 17:03:05 crc kubenswrapper[5120]: I0316 17:03:05.002188 5120 scope.go:117] "RemoveContainer" containerID="4825276674a4bf257366e44ec75f03f8d2509be62fcefccdb42e3184f86889cf" Mar 16 17:03:05 crc kubenswrapper[5120]: I0316 17:03:05.008226 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6d827da-888b-4463-b40a-041fef751ccc-kube-api-access-c9gv7" (OuterVolumeSpecName: "kube-api-access-c9gv7") pod "a6d827da-888b-4463-b40a-041fef751ccc" (UID: "a6d827da-888b-4463-b40a-041fef751ccc"). InnerVolumeSpecName "kube-api-access-c9gv7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:03:05 crc kubenswrapper[5120]: I0316 17:03:05.009045 5120 generic.go:358] "Generic (PLEG): container finished" podID="fb7a2068-5a18-4c7b-92d0-364f371d59df" containerID="97410dc76f412387b08b4c4b9c619dfcb470a14033e5445e72e531bacfce7fe0" exitCode=143 Mar 16 17:03:05 crc kubenswrapper[5120]: I0316 17:03:05.009269 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-6f96bb5df9-spfxv" event={"ID":"fb7a2068-5a18-4c7b-92d0-364f371d59df","Type":"ContainerDied","Data":"97410dc76f412387b08b4c4b9c619dfcb470a14033e5445e72e531bacfce7fe0"} Mar 16 17:03:05 crc kubenswrapper[5120]: I0316 17:03:05.014967 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-cd46-account-create-update-mrxmb" event={"ID":"3e9c8fc2-85ba-4408-a98b-56b2d62da7e3","Type":"ContainerStarted","Data":"148db83ae7067f4e115a5aef4e5c43ca3b4844ff762561badcfb3fb66cc778b1"} Mar 16 17:03:05 crc kubenswrapper[5120]: I0316 17:03:05.032422 5120 generic.go:358] "Generic (PLEG): container finished" podID="593ab600-83e5-4863-b042-4fd69af25046" containerID="9d0c721f1532054af65c6cc8928ac439588b2d9e39e78b42d253329b01689024" exitCode=143 Mar 16 17:03:05 crc kubenswrapper[5120]: I0316 17:03:05.032586 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"593ab600-83e5-4863-b042-4fd69af25046","Type":"ContainerDied","Data":"9d0c721f1532054af65c6cc8928ac439588b2d9e39e78b42d253329b01689024"} Mar 16 17:03:05 crc kubenswrapper[5120]: I0316 17:03:05.039378 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-4aec-account-create-update-wk5d7" event={"ID":"4aa85fd7-7d77-4285-97ff-4fa658725080","Type":"ContainerStarted","Data":"1cf9be1e4e20485f553e3b76b47675451a6bb482360de12cb765e0950a704942"} Mar 16 17:03:05 crc kubenswrapper[5120]: I0316 17:03:05.048453 5120 generic.go:358] "Generic (PLEG): container finished" podID="53cbb212-f009-4d4e-90fc-9a50a14cc62b" containerID="1aa3bba3e930ec962235431ddf3fe2a5d6f2094302d4df6b0f874c2f055eb2f6" exitCode=143 Mar 16 17:03:05 crc kubenswrapper[5120]: I0316 17:03:05.048565 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-7bbc5ddcc6-cxnhk" event={"ID":"53cbb212-f009-4d4e-90fc-9a50a14cc62b","Type":"ContainerDied","Data":"1aa3bba3e930ec962235431ddf3fe2a5d6f2094302d4df6b0f874c2f055eb2f6"} Mar 16 17:03:05 crc kubenswrapper[5120]: I0316 17:03:05.065493 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Mar 16 17:03:05 crc kubenswrapper[5120]: I0316 17:03:05.093081 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-m55p2" event={"ID":"70e3d80b-ae48-4742-90dd-95c106254f9f","Type":"ContainerStarted","Data":"babf579bf068a7a84c9998f5a513362b42369fa81062f55f8046e06d56371bd6"} Mar 16 17:03:05 crc kubenswrapper[5120]: I0316 17:03:05.110893 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c9gv7\" (UniqueName: \"kubernetes.io/projected/a6d827da-888b-4463-b40a-041fef751ccc-kube-api-access-c9gv7\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:05 crc kubenswrapper[5120]: I0316 17:03:05.132326 5120 generic.go:358] "Generic (PLEG): container finished" podID="9822d70f-7496-4aa6-b0fa-28a1c4ae7db7" containerID="f13096a43403b81a2b3ce5c5e96d83e5f8b0fbb45eae3a01b928bf03074aa9f1" exitCode=2 Mar 16 17:03:05 crc kubenswrapper[5120]: I0316 17:03:05.132542 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"9822d70f-7496-4aa6-b0fa-28a1c4ae7db7","Type":"ContainerDied","Data":"f13096a43403b81a2b3ce5c5e96d83e5f8b0fbb45eae3a01b928bf03074aa9f1"} Mar 16 17:03:05 crc kubenswrapper[5120]: I0316 17:03:05.154716 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6d827da-888b-4463-b40a-041fef751ccc-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "a6d827da-888b-4463-b40a-041fef751ccc" (UID: "a6d827da-888b-4463-b40a-041fef751ccc"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:03:05 crc kubenswrapper[5120]: I0316 17:03:05.176090 5120 generic.go:358] "Generic (PLEG): container finished" podID="394193fd-f8e0-4b81-8821-8d1251a0274b" containerID="b366089265c5a377f266a0c6132410502a91ab7d470144bba9e47254c5e54334" exitCode=0 Mar 16 17:03:05 crc kubenswrapper[5120]: I0316 17:03:05.176465 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-79c6c668c8-l5c8p" event={"ID":"394193fd-f8e0-4b81-8821-8d1251a0274b","Type":"ContainerDied","Data":"b366089265c5a377f266a0c6132410502a91ab7d470144bba9e47254c5e54334"} Mar 16 17:03:05 crc kubenswrapper[5120]: I0316 17:03:05.216789 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a6d827da-888b-4463-b40a-041fef751ccc-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:05 crc kubenswrapper[5120]: I0316 17:03:05.220789 5120 generic.go:358] "Generic (PLEG): container finished" podID="4740a262-b05d-4d08-a797-022ca51bbf69" containerID="7e14ea4540badd71cef4ac605d56c49684315345c8bdeeda628c416b54c1cea9" exitCode=143 Mar 16 17:03:05 crc kubenswrapper[5120]: I0316 17:03:05.220915 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"4740a262-b05d-4d08-a797-022ca51bbf69","Type":"ContainerDied","Data":"7e14ea4540badd71cef4ac605d56c49684315345c8bdeeda628c416b54c1cea9"} Mar 16 17:03:05 crc kubenswrapper[5120]: I0316 17:03:05.221831 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6d827da-888b-4463-b40a-041fef751ccc-openstack-config" (OuterVolumeSpecName: "openstack-config") pod "a6d827da-888b-4463-b40a-041fef751ccc" (UID: "a6d827da-888b-4463-b40a-041fef751ccc"). InnerVolumeSpecName "openstack-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:03:05 crc kubenswrapper[5120]: I0316 17:03:05.250712 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-5fprr"] Mar 16 17:03:05 crc kubenswrapper[5120]: I0316 17:03:05.307149 5120 generic.go:358] "Generic (PLEG): container finished" podID="dfe6d730-dd04-4759-a360-e9a2e8f88dab" containerID="1fff1e33966ca1ffdcce7becb84f51ce0c07a0ab94db1170d3919627c2cd57ed" exitCode=2 Mar 16 17:03:05 crc kubenswrapper[5120]: I0316 17:03:05.308803 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"dfe6d730-dd04-4759-a360-e9a2e8f88dab","Type":"ContainerDied","Data":"1fff1e33966ca1ffdcce7becb84f51ce0c07a0ab94db1170d3919627c2cd57ed"} Mar 16 17:03:05 crc kubenswrapper[5120]: I0316 17:03:05.320006 5120 reconciler_common.go:299] "Volume detached for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/a6d827da-888b-4463-b40a-041fef751ccc-openstack-config\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:05 crc kubenswrapper[5120]: I0316 17:03:05.345680 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6d827da-888b-4463-b40a-041fef751ccc-openstack-config-secret" (OuterVolumeSpecName: "openstack-config-secret") pod "a6d827da-888b-4463-b40a-041fef751ccc" (UID: "a6d827da-888b-4463-b40a-041fef751ccc"). InnerVolumeSpecName "openstack-config-secret". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:03:05 crc kubenswrapper[5120]: I0316 17:03:05.373318 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_e5f68c9e-894a-4eac-90fc-be12f8c49913/ovsdbserver-nb/0.log" Mar 16 17:03:05 crc kubenswrapper[5120]: I0316 17:03:05.373393 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"e5f68c9e-894a-4eac-90fc-be12f8c49913","Type":"ContainerDied","Data":"edb55f5f325f50effe51e12af19adc64840ade86dc6a34682a72f5cc4f038341"} Mar 16 17:03:05 crc kubenswrapper[5120]: I0316 17:03:05.373522 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:03:05 crc kubenswrapper[5120]: I0316 17:03:05.427572 5120 reconciler_common.go:299] "Volume detached for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/a6d827da-888b-4463-b40a-041fef751ccc-openstack-config-secret\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:05 crc kubenswrapper[5120]: E0316 17:03:05.427694 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Mar 16 17:03:05 crc kubenswrapper[5120]: E0316 17:03:05.427751 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/279c3e84-623c-4c5f-ae15-d7d8c439c4dc-config-data podName:279c3e84-623c-4c5f-ae15-d7d8c439c4dc nodeName:}" failed. No retries permitted until 2026-03-16 17:03:09.427733725 +0000 UTC m=+5491.581665382 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/279c3e84-623c-4c5f-ae15-d7d8c439c4dc-config-data") pod "rabbitmq-cell1-server-0" (UID: "279c3e84-623c-4c5f-ae15-d7d8c439c4dc") : configmap "rabbitmq-cell1-config-data" not found Mar 16 17:03:05 crc kubenswrapper[5120]: I0316 17:03:05.505312 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 17:03:05 crc kubenswrapper[5120]: I0316 17:03:05.512365 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 17:03:05 crc kubenswrapper[5120]: I0316 17:03:05.678409 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-proxy-7db84d667d-4xtpj"] Mar 16 17:03:05 crc kubenswrapper[5120]: I0316 17:03:05.678683 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-proxy-7db84d667d-4xtpj" podUID="61f313f6-217b-4ab6-aaf9-2b45cb201326" containerName="proxy-httpd" containerID="cri-o://c0ab37643ef8d4e10deb832015361dee449ca3b088af8242b95d32087795d54a" gracePeriod=30 Mar 16 17:03:05 crc kubenswrapper[5120]: I0316 17:03:05.679219 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-proxy-7db84d667d-4xtpj" podUID="61f313f6-217b-4ab6-aaf9-2b45cb201326" containerName="proxy-server" containerID="cri-o://c9f9f59cf38633969218626618ba40b5ed463c1ee0ff455a51269236211d9f2e" gracePeriod=30 Mar 16 17:03:05 crc kubenswrapper[5120]: E0316 17:03:05.754851 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="c87cdce774051210b03731c88d545718b1887f3878a50a3fc79d5fc070ffb305" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 17:03:05 crc kubenswrapper[5120]: E0316 17:03:05.754786 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="f7c63580126db55650667f8bc05d59546a627363558e5c5f426c2752ec02efd8" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Mar 16 17:03:05 crc kubenswrapper[5120]: E0316 17:03:05.770385 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="f7c63580126db55650667f8bc05d59546a627363558e5c5f426c2752ec02efd8" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Mar 16 17:03:05 crc kubenswrapper[5120]: E0316 17:03:05.789017 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="c87cdce774051210b03731c88d545718b1887f3878a50a3fc79d5fc070ffb305" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 17:03:05 crc kubenswrapper[5120]: E0316 17:03:05.812220 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="f7c63580126db55650667f8bc05d59546a627363558e5c5f426c2752ec02efd8" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Mar 16 17:03:05 crc kubenswrapper[5120]: E0316 17:03:05.812290 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/ovn-northd-0" podUID="615448b7-8677-4a99-93ba-64a2388a6dcc" containerName="ovn-northd" probeResult="unknown" Mar 16 17:03:05 crc kubenswrapper[5120]: E0316 17:03:05.819687 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="c87cdce774051210b03731c88d545718b1887f3878a50a3fc79d5fc070ffb305" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 17:03:05 crc kubenswrapper[5120]: E0316 17:03:05.819750 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="284dc632-d111-40d1-97a9-f6e78aa92ce7" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 17:03:05 crc kubenswrapper[5120]: I0316 17:03:05.886603 5120 scope.go:117] "RemoveContainer" containerID="da57d0c85c4077395552861f82bea57510e45a2fb6167418fad685206cdc28c3" Mar 16 17:03:05 crc kubenswrapper[5120]: I0316 17:03:05.900060 5120 status_manager.go:895] "Failed to get status for pod" podUID="a6d827da-888b-4463-b40a-041fef751ccc" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 17:03:05 crc kubenswrapper[5120]: I0316 17:03:05.973790 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-cd46-account-create-update-mrxmb" Mar 16 17:03:05 crc kubenswrapper[5120]: I0316 17:03:05.976033 5120 status_manager.go:895] "Failed to get status for pod" podUID="a6d827da-888b-4463-b40a-041fef751ccc" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 17:03:06 crc kubenswrapper[5120]: I0316 17:03:06.023050 5120 scope.go:117] "RemoveContainer" containerID="c6c3b078bcba74c557bdc2e467fc6e2de0b3d668951e7953bb03062d2d6e4f47" Mar 16 17:03:06 crc kubenswrapper[5120]: I0316 17:03:06.041722 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-4aec-account-create-update-wk5d7" Mar 16 17:03:06 crc kubenswrapper[5120]: I0316 17:03:06.043720 5120 status_manager.go:895] "Failed to get status for pod" podUID="a6d827da-888b-4463-b40a-041fef751ccc" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 17:03:06 crc kubenswrapper[5120]: I0316 17:03:06.085114 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 17:03:06 crc kubenswrapper[5120]: I0316 17:03:06.086745 5120 status_manager.go:895] "Failed to get status for pod" podUID="a6d827da-888b-4463-b40a-041fef751ccc" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 17:03:06 crc kubenswrapper[5120]: I0316 17:03:06.094303 5120 scope.go:117] "RemoveContainer" containerID="bd00d07b486ec185ee02c5c8ceab221325f86394dc05335ac89adfe8d2779929" Mar 16 17:03:06 crc kubenswrapper[5120]: I0316 17:03:06.118033 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:03:06 crc kubenswrapper[5120]: I0316 17:03:06.123236 5120 status_manager.go:895] "Failed to get status for pod" podUID="a6d827da-888b-4463-b40a-041fef751ccc" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 17:03:06 crc kubenswrapper[5120]: I0316 17:03:06.167978 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dfe6d730-dd04-4759-a360-e9a2e8f88dab-combined-ca-bundle\") pod \"dfe6d730-dd04-4759-a360-e9a2e8f88dab\" (UID: \"dfe6d730-dd04-4759-a360-e9a2e8f88dab\") " Mar 16 17:03:06 crc kubenswrapper[5120]: I0316 17:03:06.168229 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c8pb8\" (UniqueName: \"kubernetes.io/projected/dfe6d730-dd04-4759-a360-e9a2e8f88dab-kube-api-access-c8pb8\") pod \"dfe6d730-dd04-4759-a360-e9a2e8f88dab\" (UID: \"dfe6d730-dd04-4759-a360-e9a2e8f88dab\") " Mar 16 17:03:06 crc kubenswrapper[5120]: I0316 17:03:06.168262 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/2cadcb9e-2a3b-4c14-8fcc-39939326678f-etc-machine-id\") pod \"2cadcb9e-2a3b-4c14-8fcc-39939326678f\" (UID: \"2cadcb9e-2a3b-4c14-8fcc-39939326678f\") " Mar 16 17:03:06 crc kubenswrapper[5120]: I0316 17:03:06.168792 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/2cadcb9e-2a3b-4c14-8fcc-39939326678f-config-data-custom\") pod \"2cadcb9e-2a3b-4c14-8fcc-39939326678f\" (UID: \"2cadcb9e-2a3b-4c14-8fcc-39939326678f\") " Mar 16 17:03:06 crc kubenswrapper[5120]: I0316 17:03:06.168898 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2cadcb9e-2a3b-4c14-8fcc-39939326678f-combined-ca-bundle\") pod \"2cadcb9e-2a3b-4c14-8fcc-39939326678f\" (UID: \"2cadcb9e-2a3b-4c14-8fcc-39939326678f\") " Mar 16 17:03:06 crc kubenswrapper[5120]: I0316 17:03:06.168958 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/dfe6d730-dd04-4759-a360-e9a2e8f88dab-kube-state-metrics-tls-config\") pod \"dfe6d730-dd04-4759-a360-e9a2e8f88dab\" (UID: \"dfe6d730-dd04-4759-a360-e9a2e8f88dab\") " Mar 16 17:03:06 crc kubenswrapper[5120]: I0316 17:03:06.169006 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pld6p\" (UniqueName: \"kubernetes.io/projected/3e9c8fc2-85ba-4408-a98b-56b2d62da7e3-kube-api-access-pld6p\") pod \"3e9c8fc2-85ba-4408-a98b-56b2d62da7e3\" (UID: \"3e9c8fc2-85ba-4408-a98b-56b2d62da7e3\") " Mar 16 17:03:06 crc kubenswrapper[5120]: I0316 17:03:06.169076 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/dfe6d730-dd04-4759-a360-e9a2e8f88dab-kube-state-metrics-tls-certs\") pod \"dfe6d730-dd04-4759-a360-e9a2e8f88dab\" (UID: \"dfe6d730-dd04-4759-a360-e9a2e8f88dab\") " Mar 16 17:03:06 crc kubenswrapper[5120]: I0316 17:03:06.169816 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/2cadcb9e-2a3b-4c14-8fcc-39939326678f-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "2cadcb9e-2a3b-4c14-8fcc-39939326678f" (UID: "2cadcb9e-2a3b-4c14-8fcc-39939326678f"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 17:03:06 crc kubenswrapper[5120]: I0316 17:03:06.176083 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2cadcb9e-2a3b-4c14-8fcc-39939326678f-scripts\") pod \"2cadcb9e-2a3b-4c14-8fcc-39939326678f\" (UID: \"2cadcb9e-2a3b-4c14-8fcc-39939326678f\") " Mar 16 17:03:06 crc kubenswrapper[5120]: I0316 17:03:06.176543 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/4aa85fd7-7d77-4285-97ff-4fa658725080-operator-scripts\") pod \"4aa85fd7-7d77-4285-97ff-4fa658725080\" (UID: \"4aa85fd7-7d77-4285-97ff-4fa658725080\") " Mar 16 17:03:06 crc kubenswrapper[5120]: I0316 17:03:06.176610 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3e9c8fc2-85ba-4408-a98b-56b2d62da7e3-operator-scripts\") pod \"3e9c8fc2-85ba-4408-a98b-56b2d62da7e3\" (UID: \"3e9c8fc2-85ba-4408-a98b-56b2d62da7e3\") " Mar 16 17:03:06 crc kubenswrapper[5120]: I0316 17:03:06.176707 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kgb9t\" (UniqueName: \"kubernetes.io/projected/2cadcb9e-2a3b-4c14-8fcc-39939326678f-kube-api-access-kgb9t\") pod \"2cadcb9e-2a3b-4c14-8fcc-39939326678f\" (UID: \"2cadcb9e-2a3b-4c14-8fcc-39939326678f\") " Mar 16 17:03:06 crc kubenswrapper[5120]: I0316 17:03:06.176730 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m4qnh\" (UniqueName: \"kubernetes.io/projected/4aa85fd7-7d77-4285-97ff-4fa658725080-kube-api-access-m4qnh\") pod \"4aa85fd7-7d77-4285-97ff-4fa658725080\" (UID: \"4aa85fd7-7d77-4285-97ff-4fa658725080\") " Mar 16 17:03:06 crc kubenswrapper[5120]: I0316 17:03:06.176769 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2cadcb9e-2a3b-4c14-8fcc-39939326678f-config-data\") pod \"2cadcb9e-2a3b-4c14-8fcc-39939326678f\" (UID: \"2cadcb9e-2a3b-4c14-8fcc-39939326678f\") " Mar 16 17:03:06 crc kubenswrapper[5120]: I0316 17:03:06.195555 5120 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/2cadcb9e-2a3b-4c14-8fcc-39939326678f-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:06 crc kubenswrapper[5120]: I0316 17:03:06.198097 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4aa85fd7-7d77-4285-97ff-4fa658725080-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "4aa85fd7-7d77-4285-97ff-4fa658725080" (UID: "4aa85fd7-7d77-4285-97ff-4fa658725080"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:03:06 crc kubenswrapper[5120]: I0316 17:03:06.201846 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3e9c8fc2-85ba-4408-a98b-56b2d62da7e3-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "3e9c8fc2-85ba-4408-a98b-56b2d62da7e3" (UID: "3e9c8fc2-85ba-4408-a98b-56b2d62da7e3"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:03:06 crc kubenswrapper[5120]: I0316 17:03:06.214605 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dfe6d730-dd04-4759-a360-e9a2e8f88dab-kube-api-access-c8pb8" (OuterVolumeSpecName: "kube-api-access-c8pb8") pod "dfe6d730-dd04-4759-a360-e9a2e8f88dab" (UID: "dfe6d730-dd04-4759-a360-e9a2e8f88dab"). InnerVolumeSpecName "kube-api-access-c8pb8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:03:06 crc kubenswrapper[5120]: I0316 17:03:06.215291 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2cadcb9e-2a3b-4c14-8fcc-39939326678f-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "2cadcb9e-2a3b-4c14-8fcc-39939326678f" (UID: "2cadcb9e-2a3b-4c14-8fcc-39939326678f"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:03:06 crc kubenswrapper[5120]: I0316 17:03:06.228064 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2cadcb9e-2a3b-4c14-8fcc-39939326678f-kube-api-access-kgb9t" (OuterVolumeSpecName: "kube-api-access-kgb9t") pod "2cadcb9e-2a3b-4c14-8fcc-39939326678f" (UID: "2cadcb9e-2a3b-4c14-8fcc-39939326678f"). InnerVolumeSpecName "kube-api-access-kgb9t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:03:06 crc kubenswrapper[5120]: I0316 17:03:06.240146 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2cadcb9e-2a3b-4c14-8fcc-39939326678f-scripts" (OuterVolumeSpecName: "scripts") pod "2cadcb9e-2a3b-4c14-8fcc-39939326678f" (UID: "2cadcb9e-2a3b-4c14-8fcc-39939326678f"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:03:06 crc kubenswrapper[5120]: I0316 17:03:06.261628 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4aa85fd7-7d77-4285-97ff-4fa658725080-kube-api-access-m4qnh" (OuterVolumeSpecName: "kube-api-access-m4qnh") pod "4aa85fd7-7d77-4285-97ff-4fa658725080" (UID: "4aa85fd7-7d77-4285-97ff-4fa658725080"). InnerVolumeSpecName "kube-api-access-m4qnh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:03:06 crc kubenswrapper[5120]: I0316 17:03:06.263865 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e9c8fc2-85ba-4408-a98b-56b2d62da7e3-kube-api-access-pld6p" (OuterVolumeSpecName: "kube-api-access-pld6p") pod "3e9c8fc2-85ba-4408-a98b-56b2d62da7e3" (UID: "3e9c8fc2-85ba-4408-a98b-56b2d62da7e3"). InnerVolumeSpecName "kube-api-access-pld6p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:03:06 crc kubenswrapper[5120]: I0316 17:03:06.298588 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/4aa85fd7-7d77-4285-97ff-4fa658725080-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:06 crc kubenswrapper[5120]: I0316 17:03:06.298624 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3e9c8fc2-85ba-4408-a98b-56b2d62da7e3-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:06 crc kubenswrapper[5120]: I0316 17:03:06.298635 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kgb9t\" (UniqueName: \"kubernetes.io/projected/2cadcb9e-2a3b-4c14-8fcc-39939326678f-kube-api-access-kgb9t\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:06 crc kubenswrapper[5120]: I0316 17:03:06.298647 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m4qnh\" (UniqueName: \"kubernetes.io/projected/4aa85fd7-7d77-4285-97ff-4fa658725080-kube-api-access-m4qnh\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:06 crc kubenswrapper[5120]: I0316 17:03:06.298655 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c8pb8\" (UniqueName: \"kubernetes.io/projected/dfe6d730-dd04-4759-a360-e9a2e8f88dab-kube-api-access-c8pb8\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:06 crc kubenswrapper[5120]: I0316 17:03:06.298663 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/2cadcb9e-2a3b-4c14-8fcc-39939326678f-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:06 crc kubenswrapper[5120]: I0316 17:03:06.298673 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pld6p\" (UniqueName: \"kubernetes.io/projected/3e9c8fc2-85ba-4408-a98b-56b2d62da7e3-kube-api-access-pld6p\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:06 crc kubenswrapper[5120]: I0316 17:03:06.298683 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2cadcb9e-2a3b-4c14-8fcc-39939326678f-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:06 crc kubenswrapper[5120]: I0316 17:03:06.324003 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dfe6d730-dd04-4759-a360-e9a2e8f88dab-kube-state-metrics-tls-config" (OuterVolumeSpecName: "kube-state-metrics-tls-config") pod "dfe6d730-dd04-4759-a360-e9a2e8f88dab" (UID: "dfe6d730-dd04-4759-a360-e9a2e8f88dab"). InnerVolumeSpecName "kube-state-metrics-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:03:06 crc kubenswrapper[5120]: I0316 17:03:06.402697 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dfe6d730-dd04-4759-a360-e9a2e8f88dab-kube-state-metrics-tls-certs" (OuterVolumeSpecName: "kube-state-metrics-tls-certs") pod "dfe6d730-dd04-4759-a360-e9a2e8f88dab" (UID: "dfe6d730-dd04-4759-a360-e9a2e8f88dab"). InnerVolumeSpecName "kube-state-metrics-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:03:06 crc kubenswrapper[5120]: I0316 17:03:06.405237 5120 reconciler_common.go:299] "Volume detached for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/dfe6d730-dd04-4759-a360-e9a2e8f88dab-kube-state-metrics-tls-config\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:06 crc kubenswrapper[5120]: I0316 17:03:06.405274 5120 reconciler_common.go:299] "Volume detached for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/dfe6d730-dd04-4759-a360-e9a2e8f88dab-kube-state-metrics-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:06 crc kubenswrapper[5120]: I0316 17:03:06.413951 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"dfe6d730-dd04-4759-a360-e9a2e8f88dab","Type":"ContainerDied","Data":"bec823beebc858b748241a14a7256d823af5245bb0cc02feed2e26c049d8c677"} Mar 16 17:03:06 crc kubenswrapper[5120]: I0316 17:03:06.414015 5120 scope.go:117] "RemoveContainer" containerID="1fff1e33966ca1ffdcce7becb84f51ce0c07a0ab94db1170d3919627c2cd57ed" Mar 16 17:03:06 crc kubenswrapper[5120]: I0316 17:03:06.414865 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 17:03:06 crc kubenswrapper[5120]: I0316 17:03:06.428234 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/cinder-api-0" podUID="662e5dd1-e157-4e76-bb3d-f4310c982cb0" containerName="cinder-api" probeResult="failure" output="Get \"https://10.217.1.114:8776/healthcheck\": read tcp 10.217.0.2:57634->10.217.1.114:8776: read: connection reset by peer" Mar 16 17:03:06 crc kubenswrapper[5120]: I0316 17:03:06.429565 5120 status_manager.go:895] "Failed to get status for pod" podUID="a6d827da-888b-4463-b40a-041fef751ccc" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 17:03:06 crc kubenswrapper[5120]: I0316 17:03:06.451371 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dfe6d730-dd04-4759-a360-e9a2e8f88dab-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "dfe6d730-dd04-4759-a360-e9a2e8f88dab" (UID: "dfe6d730-dd04-4759-a360-e9a2e8f88dab"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:03:06 crc kubenswrapper[5120]: I0316 17:03:06.474170 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2cadcb9e-2a3b-4c14-8fcc-39939326678f-config-data" (OuterVolumeSpecName: "config-data") pod "2cadcb9e-2a3b-4c14-8fcc-39939326678f" (UID: "2cadcb9e-2a3b-4c14-8fcc-39939326678f"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:03:06 crc kubenswrapper[5120]: I0316 17:03:06.474565 5120 generic.go:358] "Generic (PLEG): container finished" podID="03d17609-c2ae-4dd1-b28d-4868bbcbe60f" containerID="77ba34a41a27a7a956bde218fa15dba2b646abd9ed17c20b7ef4ac7872dbb267" exitCode=0 Mar 16 17:03:06 crc kubenswrapper[5120]: I0316 17:03:06.474597 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"03d17609-c2ae-4dd1-b28d-4868bbcbe60f","Type":"ContainerDied","Data":"77ba34a41a27a7a956bde218fa15dba2b646abd9ed17c20b7ef4ac7872dbb267"} Mar 16 17:03:06 crc kubenswrapper[5120]: I0316 17:03:06.482021 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2cadcb9e-2a3b-4c14-8fcc-39939326678f-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "2cadcb9e-2a3b-4c14-8fcc-39939326678f" (UID: "2cadcb9e-2a3b-4c14-8fcc-39939326678f"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:03:06 crc kubenswrapper[5120]: I0316 17:03:06.484752 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"2cadcb9e-2a3b-4c14-8fcc-39939326678f","Type":"ContainerDied","Data":"5ad1d16b0dfc1d11fbbfc7b23cd6a94811d6f0a510754599ea0450ef4d613e27"} Mar 16 17:03:06 crc kubenswrapper[5120]: I0316 17:03:06.484870 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:03:06 crc kubenswrapper[5120]: I0316 17:03:06.492345 5120 generic.go:358] "Generic (PLEG): container finished" podID="15389dad-1183-441e-831c-de27ba4bac6e" containerID="72cd91669994d4f717e8dc9d24219ef29cee8da5fb209b92c3af6dc535d96d2c" exitCode=0 Mar 16 17:03:06 crc kubenswrapper[5120]: I0316 17:03:06.492539 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-7944fd944b-x8xzf" event={"ID":"15389dad-1183-441e-831c-de27ba4bac6e","Type":"ContainerDied","Data":"72cd91669994d4f717e8dc9d24219ef29cee8da5fb209b92c3af6dc535d96d2c"} Mar 16 17:03:06 crc kubenswrapper[5120]: I0316 17:03:06.492867 5120 status_manager.go:895] "Failed to get status for pod" podUID="a6d827da-888b-4463-b40a-041fef751ccc" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 17:03:06 crc kubenswrapper[5120]: I0316 17:03:06.493847 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-cd46-account-create-update-mrxmb" event={"ID":"3e9c8fc2-85ba-4408-a98b-56b2d62da7e3","Type":"ContainerDied","Data":"148db83ae7067f4e115a5aef4e5c43ca3b4844ff762561badcfb3fb66cc778b1"} Mar 16 17:03:06 crc kubenswrapper[5120]: I0316 17:03:06.493920 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-cd46-account-create-update-mrxmb" Mar 16 17:03:06 crc kubenswrapper[5120]: I0316 17:03:06.499686 5120 status_manager.go:895] "Failed to get status for pod" podUID="a6d827da-888b-4463-b40a-041fef751ccc" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 17:03:06 crc kubenswrapper[5120]: I0316 17:03:06.503306 5120 generic.go:358] "Generic (PLEG): container finished" podID="8d144169-a686-4862-8b52-7a945bc3a36a" containerID="94add9dcf1e03858664425cf329c526e5cc98a269344ecef11775ce6356facac" exitCode=0 Mar 16 17:03:06 crc kubenswrapper[5120]: I0316 17:03:06.503474 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"8d144169-a686-4862-8b52-7a945bc3a36a","Type":"ContainerDied","Data":"94add9dcf1e03858664425cf329c526e5cc98a269344ecef11775ce6356facac"} Mar 16 17:03:06 crc kubenswrapper[5120]: I0316 17:03:06.505040 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-4aec-account-create-update-wk5d7" event={"ID":"4aa85fd7-7d77-4285-97ff-4fa658725080","Type":"ContainerDied","Data":"1cf9be1e4e20485f553e3b76b47675451a6bb482360de12cb765e0950a704942"} Mar 16 17:03:06 crc kubenswrapper[5120]: I0316 17:03:06.505109 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-4aec-account-create-update-wk5d7" Mar 16 17:03:06 crc kubenswrapper[5120]: I0316 17:03:06.506662 5120 status_manager.go:895] "Failed to get status for pod" podUID="a6d827da-888b-4463-b40a-041fef751ccc" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 17:03:06 crc kubenswrapper[5120]: I0316 17:03:06.508032 5120 generic.go:358] "Generic (PLEG): container finished" podID="d4d1258a-d21b-48af-ac55-d36aa473d0ad" containerID="90d3217fa9853898e48742f4c1d79be701b58b485d41d583afc5a57597681ac5" exitCode=0 Mar 16 17:03:06 crc kubenswrapper[5120]: I0316 17:03:06.514253 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-5fprr" event={"ID":"d4d1258a-d21b-48af-ac55-d36aa473d0ad","Type":"ContainerDied","Data":"90d3217fa9853898e48742f4c1d79be701b58b485d41d583afc5a57597681ac5"} Mar 16 17:03:06 crc kubenswrapper[5120]: I0316 17:03:06.517273 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-5fprr" event={"ID":"d4d1258a-d21b-48af-ac55-d36aa473d0ad","Type":"ContainerStarted","Data":"89fc56a76d2e1d3bfd79c91a214d7cf0ef62c97659690ee09ab0dbbf71e5cc30"} Mar 16 17:03:06 crc kubenswrapper[5120]: I0316 17:03:06.519138 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2cadcb9e-2a3b-4c14-8fcc-39939326678f-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:06 crc kubenswrapper[5120]: I0316 17:03:06.519227 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2cadcb9e-2a3b-4c14-8fcc-39939326678f-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:06 crc kubenswrapper[5120]: I0316 17:03:06.519434 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dfe6d730-dd04-4759-a360-e9a2e8f88dab-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:06 crc kubenswrapper[5120]: I0316 17:03:06.529497 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-m55p2" event={"ID":"70e3d80b-ae48-4742-90dd-95c106254f9f","Type":"ContainerStarted","Data":"b8ab46569a3c06699626c8c74733b80f3e3d69a2d7719c4325fc9824fc301611"} Mar 16 17:03:06 crc kubenswrapper[5120]: I0316 17:03:06.530066 5120 scope.go:117] "RemoveContainer" containerID="b8ab46569a3c06699626c8c74733b80f3e3d69a2d7719c4325fc9824fc301611" Mar 16 17:03:06 crc kubenswrapper[5120]: I0316 17:03:06.540262 5120 status_manager.go:895] "Failed to get status for pod" podUID="a6d827da-888b-4463-b40a-041fef751ccc" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 17:03:06 crc kubenswrapper[5120]: I0316 17:03:06.554740 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="c88b7d39-fb86-490a-8af1-a6754dab05c9" containerName="glance-log" probeResult="failure" output="Get \"https://10.217.1.116:9292/healthcheck\": read tcp 10.217.0.2:58272->10.217.1.116:9292: read: connection reset by peer" Mar 16 17:03:06 crc kubenswrapper[5120]: I0316 17:03:06.555172 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="c88b7d39-fb86-490a-8af1-a6754dab05c9" containerName="glance-httpd" probeResult="failure" output="Get \"https://10.217.1.116:9292/healthcheck\": read tcp 10.217.0.2:58258->10.217.1.116:9292: read: connection reset by peer" Mar 16 17:03:06 crc kubenswrapper[5120]: I0316 17:03:06.555722 5120 generic.go:358] "Generic (PLEG): container finished" podID="9822d70f-7496-4aa6-b0fa-28a1c4ae7db7" containerID="44084d0cacbd15cd8ba43433333853d104701dcb0fd8b785f4da824e3dfbe0e3" exitCode=0 Mar 16 17:03:06 crc kubenswrapper[5120]: I0316 17:03:06.555853 5120 generic.go:358] "Generic (PLEG): container finished" podID="9822d70f-7496-4aa6-b0fa-28a1c4ae7db7" containerID="66f1189a24416e91074b04dcaf79e83fefb91f45f121a8fd03153adae3b4103d" exitCode=0 Mar 16 17:03:06 crc kubenswrapper[5120]: I0316 17:03:06.555914 5120 generic.go:358] "Generic (PLEG): container finished" podID="9822d70f-7496-4aa6-b0fa-28a1c4ae7db7" containerID="676ecca2659a20874ab25a6a892347a8f432119ffef02332827f47ffc00c26af" exitCode=0 Mar 16 17:03:06 crc kubenswrapper[5120]: I0316 17:03:06.555831 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"9822d70f-7496-4aa6-b0fa-28a1c4ae7db7","Type":"ContainerDied","Data":"44084d0cacbd15cd8ba43433333853d104701dcb0fd8b785f4da824e3dfbe0e3"} Mar 16 17:03:06 crc kubenswrapper[5120]: I0316 17:03:06.558839 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"9822d70f-7496-4aa6-b0fa-28a1c4ae7db7","Type":"ContainerDied","Data":"66f1189a24416e91074b04dcaf79e83fefb91f45f121a8fd03153adae3b4103d"} Mar 16 17:03:06 crc kubenswrapper[5120]: I0316 17:03:06.558854 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"9822d70f-7496-4aa6-b0fa-28a1c4ae7db7","Type":"ContainerDied","Data":"676ecca2659a20874ab25a6a892347a8f432119ffef02332827f47ffc00c26af"} Mar 16 17:03:06 crc kubenswrapper[5120]: I0316 17:03:06.566165 5120 status_manager.go:895] "Failed to get status for pod" podUID="a6d827da-888b-4463-b40a-041fef751ccc" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 17:03:06 crc kubenswrapper[5120]: I0316 17:03:06.576156 5120 generic.go:358] "Generic (PLEG): container finished" podID="61f313f6-217b-4ab6-aaf9-2b45cb201326" containerID="c0ab37643ef8d4e10deb832015361dee449ca3b088af8242b95d32087795d54a" exitCode=0 Mar 16 17:03:06 crc kubenswrapper[5120]: I0316 17:03:06.576254 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-7db84d667d-4xtpj" event={"ID":"61f313f6-217b-4ab6-aaf9-2b45cb201326","Type":"ContainerDied","Data":"c0ab37643ef8d4e10deb832015361dee449ca3b088af8242b95d32087795d54a"} Mar 16 17:03:06 crc kubenswrapper[5120]: I0316 17:03:06.678881 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5f9a749e-2dbb-409d-b935-4f2891d43397" path="/var/lib/kubelet/pods/5f9a749e-2dbb-409d-b935-4f2891d43397/volumes" Mar 16 17:03:06 crc kubenswrapper[5120]: I0316 17:03:06.680695 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="60725840-493f-4af4-97f6-ba67ec495e7d" path="/var/lib/kubelet/pods/60725840-493f-4af4-97f6-ba67ec495e7d/volumes" Mar 16 17:03:06 crc kubenswrapper[5120]: I0316 17:03:06.682921 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a6d827da-888b-4463-b40a-041fef751ccc" path="/var/lib/kubelet/pods/a6d827da-888b-4463-b40a-041fef751ccc/volumes" Mar 16 17:03:06 crc kubenswrapper[5120]: I0316 17:03:06.684482 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bcf6a825-1206-447b-937b-3bd88fb293a1" path="/var/lib/kubelet/pods/bcf6a825-1206-447b-937b-3bd88fb293a1/volumes" Mar 16 17:03:06 crc kubenswrapper[5120]: I0316 17:03:06.686088 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e5f68c9e-894a-4eac-90fc-be12f8c49913" path="/var/lib/kubelet/pods/e5f68c9e-894a-4eac-90fc-be12f8c49913/volumes" Mar 16 17:03:06 crc kubenswrapper[5120]: I0316 17:03:06.887950 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:03:06 crc kubenswrapper[5120]: I0316 17:03:06.990855 5120 scope.go:117] "RemoveContainer" containerID="082f786272aedd7c68ee70e2d12f600cf20e6afc27f262f48a3b03f153c4650e" Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.033372 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.045676 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/03d17609-c2ae-4dd1-b28d-4868bbcbe60f-config-data\") pod \"03d17609-c2ae-4dd1-b28d-4868bbcbe60f\" (UID: \"03d17609-c2ae-4dd1-b28d-4868bbcbe60f\") " Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.045853 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/03d17609-c2ae-4dd1-b28d-4868bbcbe60f-nova-novncproxy-tls-certs\") pod \"03d17609-c2ae-4dd1-b28d-4868bbcbe60f\" (UID: \"03d17609-c2ae-4dd1-b28d-4868bbcbe60f\") " Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.046120 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/03d17609-c2ae-4dd1-b28d-4868bbcbe60f-vencrypt-tls-certs\") pod \"03d17609-c2ae-4dd1-b28d-4868bbcbe60f\" (UID: \"03d17609-c2ae-4dd1-b28d-4868bbcbe60f\") " Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.046256 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/03d17609-c2ae-4dd1-b28d-4868bbcbe60f-combined-ca-bundle\") pod \"03d17609-c2ae-4dd1-b28d-4868bbcbe60f\" (UID: \"03d17609-c2ae-4dd1-b28d-4868bbcbe60f\") " Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.046296 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g2k9b\" (UniqueName: \"kubernetes.io/projected/03d17609-c2ae-4dd1-b28d-4868bbcbe60f-kube-api-access-g2k9b\") pod \"03d17609-c2ae-4dd1-b28d-4868bbcbe60f\" (UID: \"03d17609-c2ae-4dd1-b28d-4868bbcbe60f\") " Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.073175 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-7944fd944b-x8xzf" Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.076979 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03d17609-c2ae-4dd1-b28d-4868bbcbe60f-kube-api-access-g2k9b" (OuterVolumeSpecName: "kube-api-access-g2k9b") pod "03d17609-c2ae-4dd1-b28d-4868bbcbe60f" (UID: "03d17609-c2ae-4dd1-b28d-4868bbcbe60f"). InnerVolumeSpecName "kube-api-access-g2k9b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.080850 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.083984 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-4aec-account-create-update-wk5d7"] Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.105088 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-4aec-account-create-update-wk5d7"] Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.121088 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.124649 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/03d17609-c2ae-4dd1-b28d-4868bbcbe60f-config-data" (OuterVolumeSpecName: "config-data") pod "03d17609-c2ae-4dd1-b28d-4868bbcbe60f" (UID: "03d17609-c2ae-4dd1-b28d-4868bbcbe60f"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.134910 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.151624 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gpljt\" (UniqueName: \"kubernetes.io/projected/8d144169-a686-4862-8b52-7a945bc3a36a-kube-api-access-gpljt\") pod \"8d144169-a686-4862-8b52-7a945bc3a36a\" (UID: \"8d144169-a686-4862-8b52-7a945bc3a36a\") " Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.153167 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/9822d70f-7496-4aa6-b0fa-28a1c4ae7db7-ceilometer-tls-certs\") pod \"9822d70f-7496-4aa6-b0fa-28a1c4ae7db7\" (UID: \"9822d70f-7496-4aa6-b0fa-28a1c4ae7db7\") " Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.153535 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/8d144169-a686-4862-8b52-7a945bc3a36a-galera-tls-certs\") pod \"8d144169-a686-4862-8b52-7a945bc3a36a\" (UID: \"8d144169-a686-4862-8b52-7a945bc3a36a\") " Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.153687 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9822d70f-7496-4aa6-b0fa-28a1c4ae7db7-combined-ca-bundle\") pod \"9822d70f-7496-4aa6-b0fa-28a1c4ae7db7\" (UID: \"9822d70f-7496-4aa6-b0fa-28a1c4ae7db7\") " Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.153743 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/15389dad-1183-441e-831c-de27ba4bac6e-combined-ca-bundle\") pod \"15389dad-1183-441e-831c-de27ba4bac6e\" (UID: \"15389dad-1183-441e-831c-de27ba4bac6e\") " Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.153989 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/8d144169-a686-4862-8b52-7a945bc3a36a-config-data-default\") pod \"8d144169-a686-4862-8b52-7a945bc3a36a\" (UID: \"8d144169-a686-4862-8b52-7a945bc3a36a\") " Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.154028 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/9822d70f-7496-4aa6-b0fa-28a1c4ae7db7-sg-core-conf-yaml\") pod \"9822d70f-7496-4aa6-b0fa-28a1c4ae7db7\" (UID: \"9822d70f-7496-4aa6-b0fa-28a1c4ae7db7\") " Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.154126 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/15389dad-1183-441e-831c-de27ba4bac6e-logs\") pod \"15389dad-1183-441e-831c-de27ba4bac6e\" (UID: \"15389dad-1183-441e-831c-de27ba4bac6e\") " Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.154215 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8d144169-a686-4862-8b52-7a945bc3a36a-operator-scripts\") pod \"8d144169-a686-4862-8b52-7a945bc3a36a\" (UID: \"8d144169-a686-4862-8b52-7a945bc3a36a\") " Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.154243 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/8d144169-a686-4862-8b52-7a945bc3a36a-config-data-generated\") pod \"8d144169-a686-4862-8b52-7a945bc3a36a\" (UID: \"8d144169-a686-4862-8b52-7a945bc3a36a\") " Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.154272 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8d144169-a686-4862-8b52-7a945bc3a36a-combined-ca-bundle\") pod \"8d144169-a686-4862-8b52-7a945bc3a36a\" (UID: \"8d144169-a686-4862-8b52-7a945bc3a36a\") " Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.154447 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"mysql-db\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"8d144169-a686-4862-8b52-7a945bc3a36a\" (UID: \"8d144169-a686-4862-8b52-7a945bc3a36a\") " Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.154497 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-72fv6\" (UniqueName: \"kubernetes.io/projected/9822d70f-7496-4aa6-b0fa-28a1c4ae7db7-kube-api-access-72fv6\") pod \"9822d70f-7496-4aa6-b0fa-28a1c4ae7db7\" (UID: \"9822d70f-7496-4aa6-b0fa-28a1c4ae7db7\") " Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.154532 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/15389dad-1183-441e-831c-de27ba4bac6e-scripts\") pod \"15389dad-1183-441e-831c-de27ba4bac6e\" (UID: \"15389dad-1183-441e-831c-de27ba4bac6e\") " Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.154566 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/8d144169-a686-4862-8b52-7a945bc3a36a-kolla-config\") pod \"8d144169-a686-4862-8b52-7a945bc3a36a\" (UID: \"8d144169-a686-4862-8b52-7a945bc3a36a\") " Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.154618 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/15389dad-1183-441e-831c-de27ba4bac6e-config-data\") pod \"15389dad-1183-441e-831c-de27ba4bac6e\" (UID: \"15389dad-1183-441e-831c-de27ba4bac6e\") " Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.154719 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kd6pw\" (UniqueName: \"kubernetes.io/projected/15389dad-1183-441e-831c-de27ba4bac6e-kube-api-access-kd6pw\") pod \"15389dad-1183-441e-831c-de27ba4bac6e\" (UID: \"15389dad-1183-441e-831c-de27ba4bac6e\") " Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.154742 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9822d70f-7496-4aa6-b0fa-28a1c4ae7db7-scripts\") pod \"9822d70f-7496-4aa6-b0fa-28a1c4ae7db7\" (UID: \"9822d70f-7496-4aa6-b0fa-28a1c4ae7db7\") " Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.154801 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9822d70f-7496-4aa6-b0fa-28a1c4ae7db7-config-data\") pod \"9822d70f-7496-4aa6-b0fa-28a1c4ae7db7\" (UID: \"9822d70f-7496-4aa6-b0fa-28a1c4ae7db7\") " Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.154895 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/15389dad-1183-441e-831c-de27ba4bac6e-public-tls-certs\") pod \"15389dad-1183-441e-831c-de27ba4bac6e\" (UID: \"15389dad-1183-441e-831c-de27ba4bac6e\") " Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.154927 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/15389dad-1183-441e-831c-de27ba4bac6e-internal-tls-certs\") pod \"15389dad-1183-441e-831c-de27ba4bac6e\" (UID: \"15389dad-1183-441e-831c-de27ba4bac6e\") " Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.155639 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/9822d70f-7496-4aa6-b0fa-28a1c4ae7db7-log-httpd\") pod \"9822d70f-7496-4aa6-b0fa-28a1c4ae7db7\" (UID: \"9822d70f-7496-4aa6-b0fa-28a1c4ae7db7\") " Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.155709 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/9822d70f-7496-4aa6-b0fa-28a1c4ae7db7-run-httpd\") pod \"9822d70f-7496-4aa6-b0fa-28a1c4ae7db7\" (UID: \"9822d70f-7496-4aa6-b0fa-28a1c4ae7db7\") " Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.157484 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g2k9b\" (UniqueName: \"kubernetes.io/projected/03d17609-c2ae-4dd1-b28d-4868bbcbe60f-kube-api-access-g2k9b\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.157517 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/03d17609-c2ae-4dd1-b28d-4868bbcbe60f-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.157917 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9822d70f-7496-4aa6-b0fa-28a1c4ae7db7-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "9822d70f-7496-4aa6-b0fa-28a1c4ae7db7" (UID: "9822d70f-7496-4aa6-b0fa-28a1c4ae7db7"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.158412 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d144169-a686-4862-8b52-7a945bc3a36a-config-data-default" (OuterVolumeSpecName: "config-data-default") pod "8d144169-a686-4862-8b52-7a945bc3a36a" (UID: "8d144169-a686-4862-8b52-7a945bc3a36a"). InnerVolumeSpecName "config-data-default". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.159374 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d144169-a686-4862-8b52-7a945bc3a36a-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "8d144169-a686-4862-8b52-7a945bc3a36a" (UID: "8d144169-a686-4862-8b52-7a945bc3a36a"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.159919 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/03d17609-c2ae-4dd1-b28d-4868bbcbe60f-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "03d17609-c2ae-4dd1-b28d-4868bbcbe60f" (UID: "03d17609-c2ae-4dd1-b28d-4868bbcbe60f"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.160700 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d144169-a686-4862-8b52-7a945bc3a36a-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "8d144169-a686-4862-8b52-7a945bc3a36a" (UID: "8d144169-a686-4862-8b52-7a945bc3a36a"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.167233 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15389dad-1183-441e-831c-de27ba4bac6e-logs" (OuterVolumeSpecName: "logs") pod "15389dad-1183-441e-831c-de27ba4bac6e" (UID: "15389dad-1183-441e-831c-de27ba4bac6e"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.174025 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d144169-a686-4862-8b52-7a945bc3a36a-config-data-generated" (OuterVolumeSpecName: "config-data-generated") pod "8d144169-a686-4862-8b52-7a945bc3a36a" (UID: "8d144169-a686-4862-8b52-7a945bc3a36a"). InnerVolumeSpecName "config-data-generated". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.175309 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-cd46-account-create-update-mrxmb"] Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.176537 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9822d70f-7496-4aa6-b0fa-28a1c4ae7db7-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "9822d70f-7496-4aa6-b0fa-28a1c4ae7db7" (UID: "9822d70f-7496-4aa6-b0fa-28a1c4ae7db7"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.179490 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9822d70f-7496-4aa6-b0fa-28a1c4ae7db7-kube-api-access-72fv6" (OuterVolumeSpecName: "kube-api-access-72fv6") pod "9822d70f-7496-4aa6-b0fa-28a1c4ae7db7" (UID: "9822d70f-7496-4aa6-b0fa-28a1c4ae7db7"). InnerVolumeSpecName "kube-api-access-72fv6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.190163 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-cd46-account-create-update-mrxmb"] Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.201711 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d144169-a686-4862-8b52-7a945bc3a36a-kube-api-access-gpljt" (OuterVolumeSpecName: "kube-api-access-gpljt") pod "8d144169-a686-4862-8b52-7a945bc3a36a" (UID: "8d144169-a686-4862-8b52-7a945bc3a36a"). InnerVolumeSpecName "kube-api-access-gpljt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.204441 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15389dad-1183-441e-831c-de27ba4bac6e-kube-api-access-kd6pw" (OuterVolumeSpecName: "kube-api-access-kd6pw") pod "15389dad-1183-441e-831c-de27ba4bac6e" (UID: "15389dad-1183-441e-831c-de27ba4bac6e"). InnerVolumeSpecName "kube-api-access-kd6pw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.205227 5120 scope.go:117] "RemoveContainer" containerID="6a23a121b6a8a57df4ea8368ee7e1898510506a29ce4485b74adeb024aebebae" Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.215951 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/15389dad-1183-441e-831c-de27ba4bac6e-scripts" (OuterVolumeSpecName: "scripts") pod "15389dad-1183-441e-831c-de27ba4bac6e" (UID: "15389dad-1183-441e-831c-de27ba4bac6e"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.239087 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.264876 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9822d70f-7496-4aa6-b0fa-28a1c4ae7db7-scripts" (OuterVolumeSpecName: "scripts") pod "9822d70f-7496-4aa6-b0fa-28a1c4ae7db7" (UID: "9822d70f-7496-4aa6-b0fa-28a1c4ae7db7"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.270236 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/9822d70f-7496-4aa6-b0fa-28a1c4ae7db7-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.270268 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/9822d70f-7496-4aa6-b0fa-28a1c4ae7db7-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.270281 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gpljt\" (UniqueName: \"kubernetes.io/projected/8d144169-a686-4862-8b52-7a945bc3a36a-kube-api-access-gpljt\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.270295 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/8d144169-a686-4862-8b52-7a945bc3a36a-config-data-default\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.270496 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/15389dad-1183-441e-831c-de27ba4bac6e-logs\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.270590 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8d144169-a686-4862-8b52-7a945bc3a36a-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.270608 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/8d144169-a686-4862-8b52-7a945bc3a36a-config-data-generated\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.271434 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/03d17609-c2ae-4dd1-b28d-4868bbcbe60f-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.271452 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-72fv6\" (UniqueName: \"kubernetes.io/projected/9822d70f-7496-4aa6-b0fa-28a1c4ae7db7-kube-api-access-72fv6\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.271461 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/15389dad-1183-441e-831c-de27ba4bac6e-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.271471 5120 reconciler_common.go:299] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/8d144169-a686-4862-8b52-7a945bc3a36a-kolla-config\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.271480 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kd6pw\" (UniqueName: \"kubernetes.io/projected/15389dad-1183-441e-831c-de27ba4bac6e-kube-api-access-kd6pw\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.271488 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9822d70f-7496-4aa6-b0fa-28a1c4ae7db7-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.305200 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.342358 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.342611 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/memcached-0" podUID="a2c4ebb0-3217-469c-88b5-b06d50a9db60" containerName="memcached" containerID="cri-o://62a3266878d596b0fef9e2860df21eb9d22eda5d50110680ee608c9dfbf14e80" gracePeriod=30 Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.352686 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-f9be-account-create-update-6nsvb"] Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.363143 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-f9be-account-create-update-6nsvb"] Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.374050 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-f9be-account-create-update-hw8p5"] Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.376190 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dfe6d730-dd04-4759-a360-e9a2e8f88dab" containerName="kube-state-metrics" Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.376219 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="dfe6d730-dd04-4759-a360-e9a2e8f88dab" containerName="kube-state-metrics" Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.376241 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9822d70f-7496-4aa6-b0fa-28a1c4ae7db7" containerName="ceilometer-central-agent" Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.376247 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9822d70f-7496-4aa6-b0fa-28a1c4ae7db7" containerName="ceilometer-central-agent" Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.376260 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15389dad-1183-441e-831c-de27ba4bac6e" containerName="placement-log" Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.376265 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="15389dad-1183-441e-831c-de27ba4bac6e" containerName="placement-log" Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.376276 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5f68c9e-894a-4eac-90fc-be12f8c49913" containerName="ovsdbserver-nb" Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.376282 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5f68c9e-894a-4eac-90fc-be12f8c49913" containerName="ovsdbserver-nb" Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.376295 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9822d70f-7496-4aa6-b0fa-28a1c4ae7db7" containerName="ceilometer-notification-agent" Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.376301 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9822d70f-7496-4aa6-b0fa-28a1c4ae7db7" containerName="ceilometer-notification-agent" Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.376309 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5f68c9e-894a-4eac-90fc-be12f8c49913" containerName="openstack-network-exporter" Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.376314 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5f68c9e-894a-4eac-90fc-be12f8c49913" containerName="openstack-network-exporter" Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.376328 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03d17609-c2ae-4dd1-b28d-4868bbcbe60f" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.376335 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="03d17609-c2ae-4dd1-b28d-4868bbcbe60f" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.376356 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f9a749e-2dbb-409d-b935-4f2891d43397" containerName="openstack-network-exporter" Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.376362 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f9a749e-2dbb-409d-b935-4f2891d43397" containerName="openstack-network-exporter" Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.376377 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2cadcb9e-2a3b-4c14-8fcc-39939326678f" containerName="probe" Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.376383 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="2cadcb9e-2a3b-4c14-8fcc-39939326678f" containerName="probe" Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.376392 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d144169-a686-4862-8b52-7a945bc3a36a" containerName="galera" Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.376399 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d144169-a686-4862-8b52-7a945bc3a36a" containerName="galera" Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.376408 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2cadcb9e-2a3b-4c14-8fcc-39939326678f" containerName="cinder-scheduler" Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.376413 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="2cadcb9e-2a3b-4c14-8fcc-39939326678f" containerName="cinder-scheduler" Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.376425 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d144169-a686-4862-8b52-7a945bc3a36a" containerName="mysql-bootstrap" Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.376431 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d144169-a686-4862-8b52-7a945bc3a36a" containerName="mysql-bootstrap" Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.376446 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9822d70f-7496-4aa6-b0fa-28a1c4ae7db7" containerName="proxy-httpd" Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.376452 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9822d70f-7496-4aa6-b0fa-28a1c4ae7db7" containerName="proxy-httpd" Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.376479 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f9a749e-2dbb-409d-b935-4f2891d43397" containerName="ovsdbserver-sb" Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.376485 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f9a749e-2dbb-409d-b935-4f2891d43397" containerName="ovsdbserver-sb" Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.376492 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2cadcb9e-2a3b-4c14-8fcc-39939326678f" containerName="cinder-scheduler" Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.376498 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="2cadcb9e-2a3b-4c14-8fcc-39939326678f" containerName="cinder-scheduler" Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.376511 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15389dad-1183-441e-831c-de27ba4bac6e" containerName="placement-api" Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.376516 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="15389dad-1183-441e-831c-de27ba4bac6e" containerName="placement-api" Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.376526 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9822d70f-7496-4aa6-b0fa-28a1c4ae7db7" containerName="sg-core" Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.376531 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9822d70f-7496-4aa6-b0fa-28a1c4ae7db7" containerName="sg-core" Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.376686 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="15389dad-1183-441e-831c-de27ba4bac6e" containerName="placement-api" Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.376703 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="dfe6d730-dd04-4759-a360-e9a2e8f88dab" containerName="kube-state-metrics" Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.376712 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="03d17609-c2ae-4dd1-b28d-4868bbcbe60f" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.376722 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e5f68c9e-894a-4eac-90fc-be12f8c49913" containerName="ovsdbserver-nb" Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.376732 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="15389dad-1183-441e-831c-de27ba4bac6e" containerName="placement-log" Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.376740 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="9822d70f-7496-4aa6-b0fa-28a1c4ae7db7" containerName="sg-core" Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.376750 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="2cadcb9e-2a3b-4c14-8fcc-39939326678f" containerName="cinder-scheduler" Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.376759 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e5f68c9e-894a-4eac-90fc-be12f8c49913" containerName="openstack-network-exporter" Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.376768 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="8d144169-a686-4862-8b52-7a945bc3a36a" containerName="galera" Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.380563 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="9822d70f-7496-4aa6-b0fa-28a1c4ae7db7" containerName="ceilometer-central-agent" Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.380580 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="9822d70f-7496-4aa6-b0fa-28a1c4ae7db7" containerName="ceilometer-notification-agent" Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.380594 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="2cadcb9e-2a3b-4c14-8fcc-39939326678f" containerName="probe" Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.380610 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="5f9a749e-2dbb-409d-b935-4f2891d43397" containerName="openstack-network-exporter" Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.380624 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="9822d70f-7496-4aa6-b0fa-28a1c4ae7db7" containerName="proxy-httpd" Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.380637 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="5f9a749e-2dbb-409d-b935-4f2891d43397" containerName="ovsdbserver-sb" Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.380645 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="2cadcb9e-2a3b-4c14-8fcc-39939326678f" containerName="cinder-scheduler" Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.404705 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage04-crc" (OuterVolumeSpecName: "mysql-db") pod "8d144169-a686-4862-8b52-7a945bc3a36a" (UID: "8d144169-a686-4862-8b52-7a945bc3a36a"). InnerVolumeSpecName "local-storage04-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.405764 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-f9be-account-create-update-hw8p5" Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.475267 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-db-secret\"" Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.479727 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggxks\" (UniqueName: \"kubernetes.io/projected/275f09d2-7564-4210-b204-f0614f780f7e-kube-api-access-ggxks\") pod \"keystone-f9be-account-create-update-hw8p5\" (UID: \"275f09d2-7564-4210-b204-f0614f780f7e\") " pod="openstack-kuttl-tests/keystone-f9be-account-create-update-hw8p5" Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.479856 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/275f09d2-7564-4210-b204-f0614f780f7e-operator-scripts\") pod \"keystone-f9be-account-create-update-hw8p5\" (UID: \"275f09d2-7564-4210-b204-f0614f780f7e\") " pod="openstack-kuttl-tests/keystone-f9be-account-create-update-hw8p5" Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.480081 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") on node \"crc\" " Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.480152 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-f9be-account-create-update-hw8p5"] Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.482081 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="4740a262-b05d-4d08-a797-022ca51bbf69" containerName="glance-log" probeResult="failure" output="Get \"https://10.217.1.117:9292/healthcheck\": read tcp 10.217.0.2:59142->10.217.1.117:9292: read: connection reset by peer" Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.490611 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="4740a262-b05d-4d08-a797-022ca51bbf69" containerName="glance-httpd" probeResult="failure" output="Get \"https://10.217.1.117:9292/healthcheck\": read tcp 10.217.0.2:59158->10.217.1.117:9292: read: connection reset by peer" Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.493397 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-8mvwt"] Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.536598 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-8mvwt"] Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.556142 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-86x58"] Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.570284 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-86x58"] Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.577854 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-cron-29561341-nzw57"] Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.582840 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ggxks\" (UniqueName: \"kubernetes.io/projected/275f09d2-7564-4210-b204-f0614f780f7e-kube-api-access-ggxks\") pod \"keystone-f9be-account-create-update-hw8p5\" (UID: \"275f09d2-7564-4210-b204-f0614f780f7e\") " pod="openstack-kuttl-tests/keystone-f9be-account-create-update-hw8p5" Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.583011 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/275f09d2-7564-4210-b204-f0614f780f7e-operator-scripts\") pod \"keystone-f9be-account-create-update-hw8p5\" (UID: \"275f09d2-7564-4210-b204-f0614f780f7e\") " pod="openstack-kuttl-tests/keystone-f9be-account-create-update-hw8p5" Mar 16 17:03:07 crc kubenswrapper[5120]: E0316 17:03:07.584691 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Mar 16 17:03:07 crc kubenswrapper[5120]: E0316 17:03:07.584927 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/275f09d2-7564-4210-b204-f0614f780f7e-operator-scripts podName:275f09d2-7564-4210-b204-f0614f780f7e nodeName:}" failed. No retries permitted until 2026-03-16 17:03:08.084884867 +0000 UTC m=+5490.238816524 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/275f09d2-7564-4210-b204-f0614f780f7e-operator-scripts") pod "keystone-f9be-account-create-update-hw8p5" (UID: "275f09d2-7564-4210-b204-f0614f780f7e") : configmap "openstack-scripts" not found Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.586244 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-cron-29561341-nzw57"] Mar 16 17:03:07 crc kubenswrapper[5120]: E0316 17:03:07.589051 5120 projected.go:194] Error preparing data for projected volume kube-api-access-ggxks for pod openstack-kuttl-tests/keystone-f9be-account-create-update-hw8p5: failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 17:03:07 crc kubenswrapper[5120]: E0316 17:03:07.589138 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/275f09d2-7564-4210-b204-f0614f780f7e-kube-api-access-ggxks podName:275f09d2-7564-4210-b204-f0614f780f7e nodeName:}" failed. No retries permitted until 2026-03-16 17:03:08.089111643 +0000 UTC m=+5490.243043340 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-ggxks" (UniqueName: "kubernetes.io/projected/275f09d2-7564-4210-b204-f0614f780f7e-kube-api-access-ggxks") pod "keystone-f9be-account-create-update-hw8p5" (UID: "275f09d2-7564-4210-b204-f0614f780f7e") : failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.594581 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-766c6fc56d-x6dc5"] Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.595127 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/keystone-766c6fc56d-x6dc5" podUID="532a5c65-05a2-4018-9244-1386bf31dcb2" containerName="keystone-api" containerID="cri-o://f3475d302eda9b8f9f995f9084c858803d1f137a09ef9c3b6af35d343d7090c1" gracePeriod=30 Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.605534 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.615156 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d144169-a686-4862-8b52-7a945bc3a36a-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "8d144169-a686-4862-8b52-7a945bc3a36a" (UID: "8d144169-a686-4862-8b52-7a945bc3a36a"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.643959 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-db-create-cc255"] Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.644164 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-db-create-cc255"] Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.662668 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-f9be-account-create-update-hw8p5"] Mar 16 17:03:07 crc kubenswrapper[5120]: E0316 17:03:07.663530 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-ggxks operator-scripts], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openstack-kuttl-tests/keystone-f9be-account-create-update-hw8p5" podUID="275f09d2-7564-4210-b204-f0614f780f7e" Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.665973 5120 generic.go:358] "Generic (PLEG): container finished" podID="61f313f6-217b-4ab6-aaf9-2b45cb201326" containerID="c9f9f59cf38633969218626618ba40b5ed463c1ee0ff455a51269236211d9f2e" exitCode=0 Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.666035 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-7db84d667d-4xtpj" event={"ID":"61f313f6-217b-4ab6-aaf9-2b45cb201326","Type":"ContainerDied","Data":"c9f9f59cf38633969218626618ba40b5ed463c1ee0ff455a51269236211d9f2e"} Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.672769 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9822d70f-7496-4aa6-b0fa-28a1c4ae7db7-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "9822d70f-7496-4aa6-b0fa-28a1c4ae7db7" (UID: "9822d70f-7496-4aa6-b0fa-28a1c4ae7db7"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.682220 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-m55p2"] Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.684123 5120 generic.go:358] "Generic (PLEG): container finished" podID="4740a262-b05d-4d08-a797-022ca51bbf69" containerID="a45c73e43a2af1fbab31a5e550d8f195e79c3fb48fa21fde2f0110195187fb5d" exitCode=0 Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.684207 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"4740a262-b05d-4d08-a797-022ca51bbf69","Type":"ContainerDied","Data":"a45c73e43a2af1fbab31a5e550d8f195e79c3fb48fa21fde2f0110195187fb5d"} Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.689654 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8d144169-a686-4862-8b52-7a945bc3a36a-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.690712 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/9822d70f-7496-4aa6-b0fa-28a1c4ae7db7-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.712197 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"03d17609-c2ae-4dd1-b28d-4868bbcbe60f","Type":"ContainerDied","Data":"d4a40189062f79503a77511e05b2b5d5ead5046a7f39d08901d2db10066a4fd5"} Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.712250 5120 scope.go:117] "RemoveContainer" containerID="77ba34a41a27a7a956bde218fa15dba2b646abd9ed17c20b7ef4ac7872dbb267" Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.712393 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.761398 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage04-crc" (UniqueName: "kubernetes.io/local-volume/local-storage04-crc") on node "crc" Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.773737 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-7bbc5ddcc6-cxnhk" podUID="53cbb212-f009-4d4e-90fc-9a50a14cc62b" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.1.106:9311/healthcheck\": read tcp 10.217.0.2:36926->10.217.1.106:9311: read: connection reset by peer" Mar 16 17:03:07 crc kubenswrapper[5120]: E0316 17:03:07.775018 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="332dae2edfbf2e0f756cde2904bec2d8bbc2240aa37e84431e89ca72362d5c89" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.787030 5120 generic.go:358] "Generic (PLEG): container finished" podID="20dac7f8-f03f-40f8-93f1-5ba59f5471b8" containerID="66f4292cc65d6c8fdd967ff988b50c682f3d1dd97a48df06d9e5a314aa95e2f0" exitCode=0 Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.787228 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-6b9b487fd6-hdw75" event={"ID":"20dac7f8-f03f-40f8-93f1-5ba59f5471b8","Type":"ContainerDied","Data":"66f4292cc65d6c8fdd967ff988b50c682f3d1dd97a48df06d9e5a314aa95e2f0"} Mar 16 17:03:07 crc kubenswrapper[5120]: E0316 17:03:07.788499 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="332dae2edfbf2e0f756cde2904bec2d8bbc2240aa37e84431e89ca72362d5c89" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 17:03:07 crc kubenswrapper[5120]: E0316 17:03:07.791730 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="332dae2edfbf2e0f756cde2904bec2d8bbc2240aa37e84431e89ca72362d5c89" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 17:03:07 crc kubenswrapper[5120]: E0316 17:03:07.791824 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="d226072d-5d81-4c83-ade7-29bdc1df4c80" containerName="nova-scheduler-scheduler" probeResult="unknown" Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.798264 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-7bbc5ddcc6-cxnhk" podUID="53cbb212-f009-4d4e-90fc-9a50a14cc62b" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.1.106:9311/healthcheck\": dial tcp 10.217.1.106:9311: connect: connection refused" Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.802845 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.808806 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-7944fd944b-x8xzf" Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.808935 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-7944fd944b-x8xzf" event={"ID":"15389dad-1183-441e-831c-de27ba4bac6e","Type":"ContainerDied","Data":"3afbc34966f689fd13a2f3e7bb3e84157db37b570e57ba114ca1454bbb43b5bd"} Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.826595 5120 generic.go:358] "Generic (PLEG): container finished" podID="662e5dd1-e157-4e76-bb3d-f4310c982cb0" containerID="0e683e08d610b917770dfb8f5571d3b014df83f34754cc5c199e9efb9e29f138" exitCode=0 Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.826673 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"662e5dd1-e157-4e76-bb3d-f4310c982cb0","Type":"ContainerDied","Data":"0e683e08d610b917770dfb8f5571d3b014df83f34754cc5c199e9efb9e29f138"} Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.835729 5120 generic.go:358] "Generic (PLEG): container finished" podID="c88b7d39-fb86-490a-8af1-a6754dab05c9" containerID="c9d647c877cad46f80f83f0a8eec094f4e3b21c9820b23c8345a5a7561869a78" exitCode=0 Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.836363 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"c88b7d39-fb86-490a-8af1-a6754dab05c9","Type":"ContainerDied","Data":"c9d647c877cad46f80f83f0a8eec094f4e3b21c9820b23c8345a5a7561869a78"} Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.840923 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.841233 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"8d144169-a686-4862-8b52-7a945bc3a36a","Type":"ContainerDied","Data":"ef4ed02be2a0bb9a07d836ff43fe29f8a53b3f04ab353b323c3637eab36bc690"} Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.853475 5120 generic.go:358] "Generic (PLEG): container finished" podID="70e3d80b-ae48-4742-90dd-95c106254f9f" containerID="b8ab46569a3c06699626c8c74733b80f3e3d69a2d7719c4325fc9824fc301611" exitCode=1 Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.853872 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-m55p2" event={"ID":"70e3d80b-ae48-4742-90dd-95c106254f9f","Type":"ContainerDied","Data":"b8ab46569a3c06699626c8c74733b80f3e3d69a2d7719c4325fc9824fc301611"} Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.854577 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/root-account-create-update-m55p2" podUID="70e3d80b-ae48-4742-90dd-95c106254f9f" containerName="mariadb-account-create-update" containerID="cri-o://01a18ca0b10239e6c9de6d8b6dc31138b0602acec0f42adffb5dce9132fd4bfd" gracePeriod=30 Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.860176 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/03d17609-c2ae-4dd1-b28d-4868bbcbe60f-nova-novncproxy-tls-certs" (OuterVolumeSpecName: "nova-novncproxy-tls-certs") pod "03d17609-c2ae-4dd1-b28d-4868bbcbe60f" (UID: "03d17609-c2ae-4dd1-b28d-4868bbcbe60f"). InnerVolumeSpecName "nova-novncproxy-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.863827 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/15389dad-1183-441e-831c-de27ba4bac6e-config-data" (OuterVolumeSpecName: "config-data") pod "15389dad-1183-441e-831c-de27ba4bac6e" (UID: "15389dad-1183-441e-831c-de27ba4bac6e"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.865946 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"9822d70f-7496-4aa6-b0fa-28a1c4ae7db7","Type":"ContainerDied","Data":"1a09492f78c17606cf71f4cb4d20e58db67b975d2936e443567850b209531166"} Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.866065 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.888595 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/root-account-create-update-m55p2" podStartSLOduration=6.888571065 podStartE2EDuration="6.888571065s" podCreationTimestamp="2026-03-16 17:03:01 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:03:07.879830914 +0000 UTC m=+5490.033762591" watchObservedRunningTime="2026-03-16 17:03:07.888571065 +0000 UTC m=+5490.042502722" Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.907938 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/15389dad-1183-441e-831c-de27ba4bac6e-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.907998 5120 reconciler_common.go:299] "Volume detached for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/03d17609-c2ae-4dd1-b28d-4868bbcbe60f-nova-novncproxy-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.912336 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9822d70f-7496-4aa6-b0fa-28a1c4ae7db7-ceilometer-tls-certs" (OuterVolumeSpecName: "ceilometer-tls-certs") pod "9822d70f-7496-4aa6-b0fa-28a1c4ae7db7" (UID: "9822d70f-7496-4aa6-b0fa-28a1c4ae7db7"). InnerVolumeSpecName "ceilometer-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.921987 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9822d70f-7496-4aa6-b0fa-28a1c4ae7db7-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "9822d70f-7496-4aa6-b0fa-28a1c4ae7db7" (UID: "9822d70f-7496-4aa6-b0fa-28a1c4ae7db7"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.922101 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d144169-a686-4862-8b52-7a945bc3a36a-galera-tls-certs" (OuterVolumeSpecName: "galera-tls-certs") pod "8d144169-a686-4862-8b52-7a945bc3a36a" (UID: "8d144169-a686-4862-8b52-7a945bc3a36a"). InnerVolumeSpecName "galera-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.948746 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/15389dad-1183-441e-831c-de27ba4bac6e-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "15389dad-1183-441e-831c-de27ba4bac6e" (UID: "15389dad-1183-441e-831c-de27ba4bac6e"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.951941 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/openstack-galera-0" podUID="13b65e37-9126-401e-9ef6-3e531453aaba" containerName="galera" containerID="cri-o://0e7949a684f8f8fe500457e72cc4e4823aa78b079b839cbf757031b0c431a0bc" gracePeriod=30 Mar 16 17:03:07 crc kubenswrapper[5120]: I0316 17:03:07.955975 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/03d17609-c2ae-4dd1-b28d-4868bbcbe60f-vencrypt-tls-certs" (OuterVolumeSpecName: "vencrypt-tls-certs") pod "03d17609-c2ae-4dd1-b28d-4868bbcbe60f" (UID: "03d17609-c2ae-4dd1-b28d-4868bbcbe60f"). InnerVolumeSpecName "vencrypt-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.013829 5120 reconciler_common.go:299] "Volume detached for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/9822d70f-7496-4aa6-b0fa-28a1c4ae7db7-ceilometer-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.013866 5120 reconciler_common.go:299] "Volume detached for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/8d144169-a686-4862-8b52-7a945bc3a36a-galera-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.013925 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9822d70f-7496-4aa6-b0fa-28a1c4ae7db7-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.013940 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/15389dad-1183-441e-831c-de27ba4bac6e-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.013953 5120 reconciler_common.go:299] "Volume detached for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/03d17609-c2ae-4dd1-b28d-4868bbcbe60f-vencrypt-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.078029 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/15389dad-1183-441e-831c-de27ba4bac6e-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "15389dad-1183-441e-831c-de27ba4bac6e" (UID: "15389dad-1183-441e-831c-de27ba4bac6e"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.084594 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9822d70f-7496-4aa6-b0fa-28a1c4ae7db7-config-data" (OuterVolumeSpecName: "config-data") pod "9822d70f-7496-4aa6-b0fa-28a1c4ae7db7" (UID: "9822d70f-7496-4aa6-b0fa-28a1c4ae7db7"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.125713 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ggxks\" (UniqueName: \"kubernetes.io/projected/275f09d2-7564-4210-b204-f0614f780f7e-kube-api-access-ggxks\") pod \"keystone-f9be-account-create-update-hw8p5\" (UID: \"275f09d2-7564-4210-b204-f0614f780f7e\") " pod="openstack-kuttl-tests/keystone-f9be-account-create-update-hw8p5" Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.125823 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/275f09d2-7564-4210-b204-f0614f780f7e-operator-scripts\") pod \"keystone-f9be-account-create-update-hw8p5\" (UID: \"275f09d2-7564-4210-b204-f0614f780f7e\") " pod="openstack-kuttl-tests/keystone-f9be-account-create-update-hw8p5" Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.126037 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9822d70f-7496-4aa6-b0fa-28a1c4ae7db7-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.126053 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/15389dad-1183-441e-831c-de27ba4bac6e-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:08 crc kubenswrapper[5120]: E0316 17:03:08.126114 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Mar 16 17:03:08 crc kubenswrapper[5120]: E0316 17:03:08.126167 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/275f09d2-7564-4210-b204-f0614f780f7e-operator-scripts podName:275f09d2-7564-4210-b204-f0614f780f7e nodeName:}" failed. No retries permitted until 2026-03-16 17:03:09.126151929 +0000 UTC m=+5491.280083586 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/275f09d2-7564-4210-b204-f0614f780f7e-operator-scripts") pod "keystone-f9be-account-create-update-hw8p5" (UID: "275f09d2-7564-4210-b204-f0614f780f7e") : configmap "openstack-scripts" not found Mar 16 17:03:08 crc kubenswrapper[5120]: E0316 17:03:08.131677 5120 projected.go:194] Error preparing data for projected volume kube-api-access-ggxks for pod openstack-kuttl-tests/keystone-f9be-account-create-update-hw8p5: failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 17:03:08 crc kubenswrapper[5120]: E0316 17:03:08.132110 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/275f09d2-7564-4210-b204-f0614f780f7e-kube-api-access-ggxks podName:275f09d2-7564-4210-b204-f0614f780f7e nodeName:}" failed. No retries permitted until 2026-03-16 17:03:09.132075542 +0000 UTC m=+5491.286007199 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-ggxks" (UniqueName: "kubernetes.io/projected/275f09d2-7564-4210-b204-f0614f780f7e-kube-api-access-ggxks") pod "keystone-f9be-account-create-update-hw8p5" (UID: "275f09d2-7564-4210-b204-f0614f780f7e") : failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.137942 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/15389dad-1183-441e-831c-de27ba4bac6e-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "15389dad-1183-441e-831c-de27ba4bac6e" (UID: "15389dad-1183-441e-831c-de27ba4bac6e"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.228687 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/15389dad-1183-441e-831c-de27ba4bac6e-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.491412 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.503980 5120 scope.go:117] "RemoveContainer" containerID="72cd91669994d4f717e8dc9d24219ef29cee8da5fb209b92c3af6dc535d96d2c" Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.654527 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/662e5dd1-e157-4e76-bb3d-f4310c982cb0-combined-ca-bundle\") pod \"662e5dd1-e157-4e76-bb3d-f4310c982cb0\" (UID: \"662e5dd1-e157-4e76-bb3d-f4310c982cb0\") " Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.654587 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/662e5dd1-e157-4e76-bb3d-f4310c982cb0-internal-tls-certs\") pod \"662e5dd1-e157-4e76-bb3d-f4310c982cb0\" (UID: \"662e5dd1-e157-4e76-bb3d-f4310c982cb0\") " Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.654794 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/662e5dd1-e157-4e76-bb3d-f4310c982cb0-public-tls-certs\") pod \"662e5dd1-e157-4e76-bb3d-f4310c982cb0\" (UID: \"662e5dd1-e157-4e76-bb3d-f4310c982cb0\") " Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.654844 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/662e5dd1-e157-4e76-bb3d-f4310c982cb0-config-data\") pod \"662e5dd1-e157-4e76-bb3d-f4310c982cb0\" (UID: \"662e5dd1-e157-4e76-bb3d-f4310c982cb0\") " Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.654955 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/662e5dd1-e157-4e76-bb3d-f4310c982cb0-scripts\") pod \"662e5dd1-e157-4e76-bb3d-f4310c982cb0\" (UID: \"662e5dd1-e157-4e76-bb3d-f4310c982cb0\") " Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.655057 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/662e5dd1-e157-4e76-bb3d-f4310c982cb0-etc-machine-id\") pod \"662e5dd1-e157-4e76-bb3d-f4310c982cb0\" (UID: \"662e5dd1-e157-4e76-bb3d-f4310c982cb0\") " Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.655184 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vxfxh\" (UniqueName: \"kubernetes.io/projected/662e5dd1-e157-4e76-bb3d-f4310c982cb0-kube-api-access-vxfxh\") pod \"662e5dd1-e157-4e76-bb3d-f4310c982cb0\" (UID: \"662e5dd1-e157-4e76-bb3d-f4310c982cb0\") " Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.655222 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/662e5dd1-e157-4e76-bb3d-f4310c982cb0-logs\") pod \"662e5dd1-e157-4e76-bb3d-f4310c982cb0\" (UID: \"662e5dd1-e157-4e76-bb3d-f4310c982cb0\") " Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.655247 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/662e5dd1-e157-4e76-bb3d-f4310c982cb0-config-data-custom\") pod \"662e5dd1-e157-4e76-bb3d-f4310c982cb0\" (UID: \"662e5dd1-e157-4e76-bb3d-f4310c982cb0\") " Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.663937 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/662e5dd1-e157-4e76-bb3d-f4310c982cb0-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "662e5dd1-e157-4e76-bb3d-f4310c982cb0" (UID: "662e5dd1-e157-4e76-bb3d-f4310c982cb0"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.667479 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/662e5dd1-e157-4e76-bb3d-f4310c982cb0-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "662e5dd1-e157-4e76-bb3d-f4310c982cb0" (UID: "662e5dd1-e157-4e76-bb3d-f4310c982cb0"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.668141 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/662e5dd1-e157-4e76-bb3d-f4310c982cb0-logs" (OuterVolumeSpecName: "logs") pod "662e5dd1-e157-4e76-bb3d-f4310c982cb0" (UID: "662e5dd1-e157-4e76-bb3d-f4310c982cb0"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.668710 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/662e5dd1-e157-4e76-bb3d-f4310c982cb0-scripts" (OuterVolumeSpecName: "scripts") pod "662e5dd1-e157-4e76-bb3d-f4310c982cb0" (UID: "662e5dd1-e157-4e76-bb3d-f4310c982cb0"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.685071 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/662e5dd1-e157-4e76-bb3d-f4310c982cb0-kube-api-access-vxfxh" (OuterVolumeSpecName: "kube-api-access-vxfxh") pod "662e5dd1-e157-4e76-bb3d-f4310c982cb0" (UID: "662e5dd1-e157-4e76-bb3d-f4310c982cb0"). InnerVolumeSpecName "kube-api-access-vxfxh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.690516 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f940646-0e62-4646-899e-8e2f28a62167" path="/var/lib/kubelet/pods/1f940646-0e62-4646-899e-8e2f28a62167/volumes" Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.691513 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="28a7df09-48d2-4fae-ad59-a333d87354fd" path="/var/lib/kubelet/pods/28a7df09-48d2-4fae-ad59-a333d87354fd/volumes" Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.696811 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2cadcb9e-2a3b-4c14-8fcc-39939326678f" path="/var/lib/kubelet/pods/2cadcb9e-2a3b-4c14-8fcc-39939326678f/volumes" Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.698971 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/662e5dd1-e157-4e76-bb3d-f4310c982cb0-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "662e5dd1-e157-4e76-bb3d-f4310c982cb0" (UID: "662e5dd1-e157-4e76-bb3d-f4310c982cb0"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.699620 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f4dc4ed-a579-46e8-a338-b310c55029d1" path="/var/lib/kubelet/pods/2f4dc4ed-a579-46e8-a338-b310c55029d1/volumes" Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.701613 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3aa0bfe3-37d2-4600-a567-a69ce1cf4f03" path="/var/lib/kubelet/pods/3aa0bfe3-37d2-4600-a567-a69ce1cf4f03/volumes" Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.703154 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3e9c8fc2-85ba-4408-a98b-56b2d62da7e3" path="/var/lib/kubelet/pods/3e9c8fc2-85ba-4408-a98b-56b2d62da7e3/volumes" Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.703567 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4aa85fd7-7d77-4285-97ff-4fa658725080" path="/var/lib/kubelet/pods/4aa85fd7-7d77-4285-97ff-4fa658725080/volumes" Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.706860 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9cc0093b-f3a8-45cc-8df7-9d0ae312c41e" path="/var/lib/kubelet/pods/9cc0093b-f3a8-45cc-8df7-9d0ae312c41e/volumes" Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.710721 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dfe6d730-dd04-4759-a360-e9a2e8f88dab" path="/var/lib/kubelet/pods/dfe6d730-dd04-4759-a360-e9a2e8f88dab/volumes" Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.716916 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-6b9b487fd6-hdw75" Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.719331 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/662e5dd1-e157-4e76-bb3d-f4310c982cb0-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "662e5dd1-e157-4e76-bb3d-f4310c982cb0" (UID: "662e5dd1-e157-4e76-bb3d-f4310c982cb0"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.736826 5120 scope.go:117] "RemoveContainer" containerID="0e421c8f4bd01dccbba64b51d71205b35f94454215e59a8a85c6b6da1bf033d0" Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.754214 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/662e5dd1-e157-4e76-bb3d-f4310c982cb0-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "662e5dd1-e157-4e76-bb3d-f4310c982cb0" (UID: "662e5dd1-e157-4e76-bb3d-f4310c982cb0"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.765719 5120 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/662e5dd1-e157-4e76-bb3d-f4310c982cb0-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.766210 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vxfxh\" (UniqueName: \"kubernetes.io/projected/662e5dd1-e157-4e76-bb3d-f4310c982cb0-kube-api-access-vxfxh\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.766336 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/662e5dd1-e157-4e76-bb3d-f4310c982cb0-logs\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.766428 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/662e5dd1-e157-4e76-bb3d-f4310c982cb0-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.766643 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/662e5dd1-e157-4e76-bb3d-f4310c982cb0-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.766735 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/662e5dd1-e157-4e76-bb3d-f4310c982cb0-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.766867 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/662e5dd1-e157-4e76-bb3d-f4310c982cb0-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.766962 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/662e5dd1-e157-4e76-bb3d-f4310c982cb0-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.783664 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/662e5dd1-e157-4e76-bb3d-f4310c982cb0-config-data" (OuterVolumeSpecName: "config-data") pod "662e5dd1-e157-4e76-bb3d-f4310c982cb0" (UID: "662e5dd1-e157-4e76-bb3d-f4310c982cb0"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.790657 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.798927 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.819553 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.830157 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-7944fd944b-x8xzf"] Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.832875 5120 scope.go:117] "RemoveContainer" containerID="94add9dcf1e03858664425cf329c526e5cc98a269344ecef11775ce6356facac" Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.835013 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-7db84d667d-4xtpj" Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.849186 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-7944fd944b-x8xzf"] Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.859341 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.862678 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-7bbc5ddcc6-cxnhk" Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.868119 5120 scope.go:117] "RemoveContainer" containerID="48e312790cba7d0127ad5f8f851016781ff4d933732de34cf1f0cf328d69266d" Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.868727 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4740a262-b05d-4d08-a797-022ca51bbf69-logs\") pod \"4740a262-b05d-4d08-a797-022ca51bbf69\" (UID: \"4740a262-b05d-4d08-a797-022ca51bbf69\") " Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.868792 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/20dac7f8-f03f-40f8-93f1-5ba59f5471b8-config-data-custom\") pod \"20dac7f8-f03f-40f8-93f1-5ba59f5471b8\" (UID: \"20dac7f8-f03f-40f8-93f1-5ba59f5471b8\") " Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.868825 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4740a262-b05d-4d08-a797-022ca51bbf69-config-data\") pod \"4740a262-b05d-4d08-a797-022ca51bbf69\" (UID: \"4740a262-b05d-4d08-a797-022ca51bbf69\") " Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.868856 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c88b7d39-fb86-490a-8af1-a6754dab05c9-scripts\") pod \"c88b7d39-fb86-490a-8af1-a6754dab05c9\" (UID: \"c88b7d39-fb86-490a-8af1-a6754dab05c9\") " Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.868877 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/61f313f6-217b-4ab6-aaf9-2b45cb201326-internal-tls-certs\") pod \"61f313f6-217b-4ab6-aaf9-2b45cb201326\" (UID: \"61f313f6-217b-4ab6-aaf9-2b45cb201326\") " Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.869934 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/61f313f6-217b-4ab6-aaf9-2b45cb201326-public-tls-certs\") pod \"61f313f6-217b-4ab6-aaf9-2b45cb201326\" (UID: \"61f313f6-217b-4ab6-aaf9-2b45cb201326\") " Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.870014 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/4740a262-b05d-4d08-a797-022ca51bbf69-httpd-run\") pod \"4740a262-b05d-4d08-a797-022ca51bbf69\" (UID: \"4740a262-b05d-4d08-a797-022ca51bbf69\") " Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.870107 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/61f313f6-217b-4ab6-aaf9-2b45cb201326-run-httpd\") pod \"61f313f6-217b-4ab6-aaf9-2b45cb201326\" (UID: \"61f313f6-217b-4ab6-aaf9-2b45cb201326\") " Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.870136 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/c88b7d39-fb86-490a-8af1-a6754dab05c9-httpd-run\") pod \"c88b7d39-fb86-490a-8af1-a6754dab05c9\" (UID: \"c88b7d39-fb86-490a-8af1-a6754dab05c9\") " Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.870206 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/53cbb212-f009-4d4e-90fc-9a50a14cc62b-combined-ca-bundle\") pod \"53cbb212-f009-4d4e-90fc-9a50a14cc62b\" (UID: \"53cbb212-f009-4d4e-90fc-9a50a14cc62b\") " Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.870293 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bm76f\" (UniqueName: \"kubernetes.io/projected/4740a262-b05d-4d08-a797-022ca51bbf69-kube-api-access-bm76f\") pod \"4740a262-b05d-4d08-a797-022ca51bbf69\" (UID: \"4740a262-b05d-4d08-a797-022ca51bbf69\") " Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.870340 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/4740a262-b05d-4d08-a797-022ca51bbf69-public-tls-certs\") pod \"4740a262-b05d-4d08-a797-022ca51bbf69\" (UID: \"4740a262-b05d-4d08-a797-022ca51bbf69\") " Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.870385 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/20dac7f8-f03f-40f8-93f1-5ba59f5471b8-logs\") pod \"20dac7f8-f03f-40f8-93f1-5ba59f5471b8\" (UID: \"20dac7f8-f03f-40f8-93f1-5ba59f5471b8\") " Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.870443 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-srtq2\" (UniqueName: \"kubernetes.io/projected/61f313f6-217b-4ab6-aaf9-2b45cb201326-kube-api-access-srtq2\") pod \"61f313f6-217b-4ab6-aaf9-2b45cb201326\" (UID: \"61f313f6-217b-4ab6-aaf9-2b45cb201326\") " Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.870472 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c88b7d39-fb86-490a-8af1-a6754dab05c9-combined-ca-bundle\") pod \"c88b7d39-fb86-490a-8af1-a6754dab05c9\" (UID: \"c88b7d39-fb86-490a-8af1-a6754dab05c9\") " Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.870494 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"4740a262-b05d-4d08-a797-022ca51bbf69\" (UID: \"4740a262-b05d-4d08-a797-022ca51bbf69\") " Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.870544 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/53cbb212-f009-4d4e-90fc-9a50a14cc62b-internal-tls-certs\") pod \"53cbb212-f009-4d4e-90fc-9a50a14cc62b\" (UID: \"53cbb212-f009-4d4e-90fc-9a50a14cc62b\") " Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.870577 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/61f313f6-217b-4ab6-aaf9-2b45cb201326-combined-ca-bundle\") pod \"61f313f6-217b-4ab6-aaf9-2b45cb201326\" (UID: \"61f313f6-217b-4ab6-aaf9-2b45cb201326\") " Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.870601 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/61f313f6-217b-4ab6-aaf9-2b45cb201326-config-data\") pod \"61f313f6-217b-4ab6-aaf9-2b45cb201326\" (UID: \"61f313f6-217b-4ab6-aaf9-2b45cb201326\") " Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.870637 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/53cbb212-f009-4d4e-90fc-9a50a14cc62b-config-data\") pod \"53cbb212-f009-4d4e-90fc-9a50a14cc62b\" (UID: \"53cbb212-f009-4d4e-90fc-9a50a14cc62b\") " Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.870658 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xp9kr\" (UniqueName: \"kubernetes.io/projected/c88b7d39-fb86-490a-8af1-a6754dab05c9-kube-api-access-xp9kr\") pod \"c88b7d39-fb86-490a-8af1-a6754dab05c9\" (UID: \"c88b7d39-fb86-490a-8af1-a6754dab05c9\") " Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.872108 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4740a262-b05d-4d08-a797-022ca51bbf69-logs" (OuterVolumeSpecName: "logs") pod "4740a262-b05d-4d08-a797-022ca51bbf69" (UID: "4740a262-b05d-4d08-a797-022ca51bbf69"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.873577 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c88b7d39-fb86-490a-8af1-a6754dab05c9-logs\") pod \"c88b7d39-fb86-490a-8af1-a6754dab05c9\" (UID: \"c88b7d39-fb86-490a-8af1-a6754dab05c9\") " Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.873628 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4740a262-b05d-4d08-a797-022ca51bbf69-scripts\") pod \"4740a262-b05d-4d08-a797-022ca51bbf69\" (UID: \"4740a262-b05d-4d08-a797-022ca51bbf69\") " Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.873732 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/61f313f6-217b-4ab6-aaf9-2b45cb201326-etc-swift\") pod \"61f313f6-217b-4ab6-aaf9-2b45cb201326\" (UID: \"61f313f6-217b-4ab6-aaf9-2b45cb201326\") " Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.873801 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/c88b7d39-fb86-490a-8af1-a6754dab05c9-internal-tls-certs\") pod \"c88b7d39-fb86-490a-8af1-a6754dab05c9\" (UID: \"c88b7d39-fb86-490a-8af1-a6754dab05c9\") " Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.873860 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/53cbb212-f009-4d4e-90fc-9a50a14cc62b-public-tls-certs\") pod \"53cbb212-f009-4d4e-90fc-9a50a14cc62b\" (UID: \"53cbb212-f009-4d4e-90fc-9a50a14cc62b\") " Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.873925 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"c88b7d39-fb86-490a-8af1-a6754dab05c9\" (UID: \"c88b7d39-fb86-490a-8af1-a6754dab05c9\") " Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.873974 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/61f313f6-217b-4ab6-aaf9-2b45cb201326-log-httpd\") pod \"61f313f6-217b-4ab6-aaf9-2b45cb201326\" (UID: \"61f313f6-217b-4ab6-aaf9-2b45cb201326\") " Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.873993 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20dac7f8-f03f-40f8-93f1-5ba59f5471b8-logs" (OuterVolumeSpecName: "logs") pod "20dac7f8-f03f-40f8-93f1-5ba59f5471b8" (UID: "20dac7f8-f03f-40f8-93f1-5ba59f5471b8"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.874032 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/20dac7f8-f03f-40f8-93f1-5ba59f5471b8-config-data\") pod \"20dac7f8-f03f-40f8-93f1-5ba59f5471b8\" (UID: \"20dac7f8-f03f-40f8-93f1-5ba59f5471b8\") " Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.874088 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rhhc4\" (UniqueName: \"kubernetes.io/projected/20dac7f8-f03f-40f8-93f1-5ba59f5471b8-kube-api-access-rhhc4\") pod \"20dac7f8-f03f-40f8-93f1-5ba59f5471b8\" (UID: \"20dac7f8-f03f-40f8-93f1-5ba59f5471b8\") " Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.874189 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4740a262-b05d-4d08-a797-022ca51bbf69-combined-ca-bundle\") pod \"4740a262-b05d-4d08-a797-022ca51bbf69\" (UID: \"4740a262-b05d-4d08-a797-022ca51bbf69\") " Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.874219 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/20dac7f8-f03f-40f8-93f1-5ba59f5471b8-combined-ca-bundle\") pod \"20dac7f8-f03f-40f8-93f1-5ba59f5471b8\" (UID: \"20dac7f8-f03f-40f8-93f1-5ba59f5471b8\") " Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.874729 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61f313f6-217b-4ab6-aaf9-2b45cb201326-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "61f313f6-217b-4ab6-aaf9-2b45cb201326" (UID: "61f313f6-217b-4ab6-aaf9-2b45cb201326"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.876862 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c88b7d39-fb86-490a-8af1-a6754dab05c9-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "c88b7d39-fb86-490a-8af1-a6754dab05c9" (UID: "c88b7d39-fb86-490a-8af1-a6754dab05c9"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.876988 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c88b7d39-fb86-490a-8af1-a6754dab05c9-config-data\") pod \"c88b7d39-fb86-490a-8af1-a6754dab05c9\" (UID: \"c88b7d39-fb86-490a-8af1-a6754dab05c9\") " Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.877142 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4740a262-b05d-4d08-a797-022ca51bbf69-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "4740a262-b05d-4d08-a797-022ca51bbf69" (UID: "4740a262-b05d-4d08-a797-022ca51bbf69"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.877281 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/53cbb212-f009-4d4e-90fc-9a50a14cc62b-config-data-custom\") pod \"53cbb212-f009-4d4e-90fc-9a50a14cc62b\" (UID: \"53cbb212-f009-4d4e-90fc-9a50a14cc62b\") " Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.877333 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/53cbb212-f009-4d4e-90fc-9a50a14cc62b-logs\") pod \"53cbb212-f009-4d4e-90fc-9a50a14cc62b\" (UID: \"53cbb212-f009-4d4e-90fc-9a50a14cc62b\") " Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.877400 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dtz88\" (UniqueName: \"kubernetes.io/projected/53cbb212-f009-4d4e-90fc-9a50a14cc62b-kube-api-access-dtz88\") pod \"53cbb212-f009-4d4e-90fc-9a50a14cc62b\" (UID: \"53cbb212-f009-4d4e-90fc-9a50a14cc62b\") " Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.878762 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/20dac7f8-f03f-40f8-93f1-5ba59f5471b8-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "20dac7f8-f03f-40f8-93f1-5ba59f5471b8" (UID: "20dac7f8-f03f-40f8-93f1-5ba59f5471b8"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.884475 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.889853 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61f313f6-217b-4ab6-aaf9-2b45cb201326-kube-api-access-srtq2" (OuterVolumeSpecName: "kube-api-access-srtq2") pod "61f313f6-217b-4ab6-aaf9-2b45cb201326" (UID: "61f313f6-217b-4ab6-aaf9-2b45cb201326"). InnerVolumeSpecName "kube-api-access-srtq2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.890658 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.890859 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53cbb212-f009-4d4e-90fc-9a50a14cc62b-kube-api-access-dtz88" (OuterVolumeSpecName: "kube-api-access-dtz88") pod "53cbb212-f009-4d4e-90fc-9a50a14cc62b" (UID: "53cbb212-f009-4d4e-90fc-9a50a14cc62b"). InnerVolumeSpecName "kube-api-access-dtz88". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.892368 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage05-crc" (OuterVolumeSpecName: "glance") pod "4740a262-b05d-4d08-a797-022ca51bbf69" (UID: "4740a262-b05d-4d08-a797-022ca51bbf69"). InnerVolumeSpecName "local-storage05-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.894026 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.897468 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.908946 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4740a262-b05d-4d08-a797-022ca51bbf69-kube-api-access-bm76f" (OuterVolumeSpecName: "kube-api-access-bm76f") pod "4740a262-b05d-4d08-a797-022ca51bbf69" (UID: "4740a262-b05d-4d08-a797-022ca51bbf69"). InnerVolumeSpecName "kube-api-access-bm76f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.908979 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61f313f6-217b-4ab6-aaf9-2b45cb201326-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "61f313f6-217b-4ab6-aaf9-2b45cb201326" (UID: "61f313f6-217b-4ab6-aaf9-2b45cb201326"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.909112 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dtz88\" (UniqueName: \"kubernetes.io/projected/53cbb212-f009-4d4e-90fc-9a50a14cc62b-kube-api-access-dtz88\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.909146 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4740a262-b05d-4d08-a797-022ca51bbf69-logs\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.909165 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/20dac7f8-f03f-40f8-93f1-5ba59f5471b8-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.909179 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/4740a262-b05d-4d08-a797-022ca51bbf69-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.909194 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/61f313f6-217b-4ab6-aaf9-2b45cb201326-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.909208 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/c88b7d39-fb86-490a-8af1-a6754dab05c9-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.909224 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/20dac7f8-f03f-40f8-93f1-5ba59f5471b8-logs\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.909237 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-srtq2\" (UniqueName: \"kubernetes.io/projected/61f313f6-217b-4ab6-aaf9-2b45cb201326-kube-api-access-srtq2\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.909270 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") on node \"crc\" " Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.909286 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/662e5dd1-e157-4e76-bb3d-f4310c982cb0-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.912037 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20dac7f8-f03f-40f8-93f1-5ba59f5471b8-kube-api-access-rhhc4" (OuterVolumeSpecName: "kube-api-access-rhhc4") pod "20dac7f8-f03f-40f8-93f1-5ba59f5471b8" (UID: "20dac7f8-f03f-40f8-93f1-5ba59f5471b8"). InnerVolumeSpecName "kube-api-access-rhhc4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.914007 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/53cbb212-f009-4d4e-90fc-9a50a14cc62b-logs" (OuterVolumeSpecName: "logs") pod "53cbb212-f009-4d4e-90fc-9a50a14cc62b" (UID: "53cbb212-f009-4d4e-90fc-9a50a14cc62b"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.914288 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c88b7d39-fb86-490a-8af1-a6754dab05c9-logs" (OuterVolumeSpecName: "logs") pod "c88b7d39-fb86-490a-8af1-a6754dab05c9" (UID: "c88b7d39-fb86-490a-8af1-a6754dab05c9"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.918517 5120 generic.go:358] "Generic (PLEG): container finished" podID="53cbb212-f009-4d4e-90fc-9a50a14cc62b" containerID="cd314e8c2ba56b3a12ba0679d21f2a55a4f7ab45f72f1581f1ae854629e205c9" exitCode=0 Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.918613 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-7bbc5ddcc6-cxnhk" event={"ID":"53cbb212-f009-4d4e-90fc-9a50a14cc62b","Type":"ContainerDied","Data":"cd314e8c2ba56b3a12ba0679d21f2a55a4f7ab45f72f1581f1ae854629e205c9"} Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.918641 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-7bbc5ddcc6-cxnhk" event={"ID":"53cbb212-f009-4d4e-90fc-9a50a14cc62b","Type":"ContainerDied","Data":"ffdd597f8127c978a9981146324a36d3bc6eb7c23cd2e7fc59d5ddcd0a7f1472"} Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.918736 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-m55p2" Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.918859 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-7bbc5ddcc6-cxnhk" Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.920291 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.927400 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c88b7d39-fb86-490a-8af1-a6754dab05c9-kube-api-access-xp9kr" (OuterVolumeSpecName: "kube-api-access-xp9kr") pod "c88b7d39-fb86-490a-8af1-a6754dab05c9" (UID: "c88b7d39-fb86-490a-8af1-a6754dab05c9"). InnerVolumeSpecName "kube-api-access-xp9kr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.927574 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61f313f6-217b-4ab6-aaf9-2b45cb201326-etc-swift" (OuterVolumeSpecName: "etc-swift") pod "61f313f6-217b-4ab6-aaf9-2b45cb201326" (UID: "61f313f6-217b-4ab6-aaf9-2b45cb201326"). InnerVolumeSpecName "etc-swift". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.927832 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c88b7d39-fb86-490a-8af1-a6754dab05c9-scripts" (OuterVolumeSpecName: "scripts") pod "c88b7d39-fb86-490a-8af1-a6754dab05c9" (UID: "c88b7d39-fb86-490a-8af1-a6754dab05c9"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.928055 5120 scope.go:117] "RemoveContainer" containerID="44084d0cacbd15cd8ba43433333853d104701dcb0fd8b785f4da824e3dfbe0e3" Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.949593 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/53cbb212-f009-4d4e-90fc-9a50a14cc62b-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "53cbb212-f009-4d4e-90fc-9a50a14cc62b" (UID: "53cbb212-f009-4d4e-90fc-9a50a14cc62b"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.949727 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.950275 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4740a262-b05d-4d08-a797-022ca51bbf69-scripts" (OuterVolumeSpecName: "scripts") pod "4740a262-b05d-4d08-a797-022ca51bbf69" (UID: "4740a262-b05d-4d08-a797-022ca51bbf69"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.951968 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage06-crc" (OuterVolumeSpecName: "glance") pod "c88b7d39-fb86-490a-8af1-a6754dab05c9" (UID: "c88b7d39-fb86-490a-8af1-a6754dab05c9"). InnerVolumeSpecName "local-storage06-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.952927 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.955228 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-5fprr" Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.975788 5120 generic.go:358] "Generic (PLEG): container finished" podID="70e3d80b-ae48-4742-90dd-95c106254f9f" containerID="01a18ca0b10239e6c9de6d8b6dc31138b0602acec0f42adffb5dce9132fd4bfd" exitCode=1 Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.975946 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-m55p2" Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.976186 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-m55p2" event={"ID":"70e3d80b-ae48-4742-90dd-95c106254f9f","Type":"ContainerDied","Data":"babf579bf068a7a84c9998f5a513362b42369fa81062f55f8046e06d56371bd6"} Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.976211 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-m55p2" event={"ID":"70e3d80b-ae48-4742-90dd-95c106254f9f","Type":"ContainerDied","Data":"01a18ca0b10239e6c9de6d8b6dc31138b0602acec0f42adffb5dce9132fd4bfd"} Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.979601 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-7db84d667d-4xtpj" event={"ID":"61f313f6-217b-4ab6-aaf9-2b45cb201326","Type":"ContainerDied","Data":"c0bcb55506fb022d64cb967f1df964d0c87ba1481c935bfd926d6a53054c8851"} Mar 16 17:03:08 crc kubenswrapper[5120]: I0316 17:03:08.979720 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-7db84d667d-4xtpj" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.001572 5120 scope.go:117] "RemoveContainer" containerID="f13096a43403b81a2b3ce5c5e96d83e5f8b0fbb45eae3a01b928bf03074aa9f1" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.008664 5120 generic.go:358] "Generic (PLEG): container finished" podID="a2c4ebb0-3217-469c-88b5-b06d50a9db60" containerID="62a3266878d596b0fef9e2860df21eb9d22eda5d50110680ee608c9dfbf14e80" exitCode=0 Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.008795 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"a2c4ebb0-3217-469c-88b5-b06d50a9db60","Type":"ContainerDied","Data":"62a3266878d596b0fef9e2860df21eb9d22eda5d50110680ee608c9dfbf14e80"} Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.008850 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"a2c4ebb0-3217-469c-88b5-b06d50a9db60","Type":"ContainerDied","Data":"f2e6b74bb80fb4d72c7c16aaff1631765c61496dee89eabfaa5a0889a97eb33a"} Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.008970 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.010297 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/a2c4ebb0-3217-469c-88b5-b06d50a9db60-memcached-tls-certs\") pod \"a2c4ebb0-3217-469c-88b5-b06d50a9db60\" (UID: \"a2c4ebb0-3217-469c-88b5-b06d50a9db60\") " Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.010370 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5b6e7f67-ee2d-4fbc-9519-00493157aec0-logs\") pod \"5b6e7f67-ee2d-4fbc-9519-00493157aec0\" (UID: \"5b6e7f67-ee2d-4fbc-9519-00493157aec0\") " Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.010446 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/a2c4ebb0-3217-469c-88b5-b06d50a9db60-kolla-config\") pod \"a2c4ebb0-3217-469c-88b5-b06d50a9db60\" (UID: \"a2c4ebb0-3217-469c-88b5-b06d50a9db60\") " Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.010563 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/593ab600-83e5-4863-b042-4fd69af25046-internal-tls-certs\") pod \"593ab600-83e5-4863-b042-4fd69af25046\" (UID: \"593ab600-83e5-4863-b042-4fd69af25046\") " Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.010608 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/5b6e7f67-ee2d-4fbc-9519-00493157aec0-nova-metadata-tls-certs\") pod \"5b6e7f67-ee2d-4fbc-9519-00493157aec0\" (UID: \"5b6e7f67-ee2d-4fbc-9519-00493157aec0\") " Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.010659 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/593ab600-83e5-4863-b042-4fd69af25046-logs\") pod \"593ab600-83e5-4863-b042-4fd69af25046\" (UID: \"593ab600-83e5-4863-b042-4fd69af25046\") " Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.010715 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/593ab600-83e5-4863-b042-4fd69af25046-combined-ca-bundle\") pod \"593ab600-83e5-4863-b042-4fd69af25046\" (UID: \"593ab600-83e5-4863-b042-4fd69af25046\") " Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.010953 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a2c4ebb0-3217-469c-88b5-b06d50a9db60-combined-ca-bundle\") pod \"a2c4ebb0-3217-469c-88b5-b06d50a9db60\" (UID: \"a2c4ebb0-3217-469c-88b5-b06d50a9db60\") " Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.011245 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/a2c4ebb0-3217-469c-88b5-b06d50a9db60-config-data\") pod \"a2c4ebb0-3217-469c-88b5-b06d50a9db60\" (UID: \"a2c4ebb0-3217-469c-88b5-b06d50a9db60\") " Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.011425 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5b6e7f67-ee2d-4fbc-9519-00493157aec0-config-data\") pod \"5b6e7f67-ee2d-4fbc-9519-00493157aec0\" (UID: \"5b6e7f67-ee2d-4fbc-9519-00493157aec0\") " Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.011571 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f9zzp\" (UniqueName: \"kubernetes.io/projected/593ab600-83e5-4863-b042-4fd69af25046-kube-api-access-f9zzp\") pod \"593ab600-83e5-4863-b042-4fd69af25046\" (UID: \"593ab600-83e5-4863-b042-4fd69af25046\") " Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.011622 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b6e7f67-ee2d-4fbc-9519-00493157aec0-logs" (OuterVolumeSpecName: "logs") pod "5b6e7f67-ee2d-4fbc-9519-00493157aec0" (UID: "5b6e7f67-ee2d-4fbc-9519-00493157aec0"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.011681 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zmfns\" (UniqueName: \"kubernetes.io/projected/70e3d80b-ae48-4742-90dd-95c106254f9f-kube-api-access-zmfns\") pod \"70e3d80b-ae48-4742-90dd-95c106254f9f\" (UID: \"70e3d80b-ae48-4742-90dd-95c106254f9f\") " Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.011729 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/70e3d80b-ae48-4742-90dd-95c106254f9f-operator-scripts\") pod \"70e3d80b-ae48-4742-90dd-95c106254f9f\" (UID: \"70e3d80b-ae48-4742-90dd-95c106254f9f\") " Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.011889 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"4740a262-b05d-4d08-a797-022ca51bbf69","Type":"ContainerDied","Data":"79198da16bd44572c679a58e4b972b3d27d1ad847d8cbe3073cd16c945182fb4"} Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.011938 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/593ab600-83e5-4863-b042-4fd69af25046-public-tls-certs\") pod \"593ab600-83e5-4863-b042-4fd69af25046\" (UID: \"593ab600-83e5-4863-b042-4fd69af25046\") " Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.011994 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.012034 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-884lc\" (UniqueName: \"kubernetes.io/projected/5b6e7f67-ee2d-4fbc-9519-00493157aec0-kube-api-access-884lc\") pod \"5b6e7f67-ee2d-4fbc-9519-00493157aec0\" (UID: \"5b6e7f67-ee2d-4fbc-9519-00493157aec0\") " Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.012152 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5b6e7f67-ee2d-4fbc-9519-00493157aec0-combined-ca-bundle\") pod \"5b6e7f67-ee2d-4fbc-9519-00493157aec0\" (UID: \"5b6e7f67-ee2d-4fbc-9519-00493157aec0\") " Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.012266 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/593ab600-83e5-4863-b042-4fd69af25046-config-data\") pod \"593ab600-83e5-4863-b042-4fd69af25046\" (UID: \"593ab600-83e5-4863-b042-4fd69af25046\") " Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.012298 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-78r8b\" (UniqueName: \"kubernetes.io/projected/a2c4ebb0-3217-469c-88b5-b06d50a9db60-kube-api-access-78r8b\") pod \"a2c4ebb0-3217-469c-88b5-b06d50a9db60\" (UID: \"a2c4ebb0-3217-469c-88b5-b06d50a9db60\") " Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.014661 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xp9kr\" (UniqueName: \"kubernetes.io/projected/c88b7d39-fb86-490a-8af1-a6754dab05c9-kube-api-access-xp9kr\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.014685 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c88b7d39-fb86-490a-8af1-a6754dab05c9-logs\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.014695 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4740a262-b05d-4d08-a797-022ca51bbf69-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.014703 5120 reconciler_common.go:299] "Volume detached for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/61f313f6-217b-4ab6-aaf9-2b45cb201326-etc-swift\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.014731 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") on node \"crc\" " Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.014741 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/61f313f6-217b-4ab6-aaf9-2b45cb201326-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.014751 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rhhc4\" (UniqueName: \"kubernetes.io/projected/20dac7f8-f03f-40f8-93f1-5ba59f5471b8-kube-api-access-rhhc4\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.014763 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5b6e7f67-ee2d-4fbc-9519-00493157aec0-logs\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.014783 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/53cbb212-f009-4d4e-90fc-9a50a14cc62b-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.014792 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/53cbb212-f009-4d4e-90fc-9a50a14cc62b-logs\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.014800 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c88b7d39-fb86-490a-8af1-a6754dab05c9-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.014809 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bm76f\" (UniqueName: \"kubernetes.io/projected/4740a262-b05d-4d08-a797-022ca51bbf69-kube-api-access-bm76f\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.023792 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/593ab600-83e5-4863-b042-4fd69af25046-logs" (OuterVolumeSpecName: "logs") pod "593ab600-83e5-4863-b042-4fd69af25046" (UID: "593ab600-83e5-4863-b042-4fd69af25046"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.024698 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/70e3d80b-ae48-4742-90dd-95c106254f9f-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "70e3d80b-ae48-4742-90dd-95c106254f9f" (UID: "70e3d80b-ae48-4742-90dd-95c106254f9f"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.036162 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a2c4ebb0-3217-469c-88b5-b06d50a9db60-config-data" (OuterVolumeSpecName: "config-data") pod "a2c4ebb0-3217-469c-88b5-b06d50a9db60" (UID: "a2c4ebb0-3217-469c-88b5-b06d50a9db60"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.036669 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a2c4ebb0-3217-469c-88b5-b06d50a9db60-kube-api-access-78r8b" (OuterVolumeSpecName: "kube-api-access-78r8b") pod "a2c4ebb0-3217-469c-88b5-b06d50a9db60" (UID: "a2c4ebb0-3217-469c-88b5-b06d50a9db60"). InnerVolumeSpecName "kube-api-access-78r8b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.040030 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a2c4ebb0-3217-469c-88b5-b06d50a9db60-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "a2c4ebb0-3217-469c-88b5-b06d50a9db60" (UID: "a2c4ebb0-3217-469c-88b5-b06d50a9db60"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.044282 5120 scope.go:117] "RemoveContainer" containerID="3ff61502c356dc3d615d648d16c140bb610668b7068eebfd905e384b7c405294" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.046363 5120 generic.go:358] "Generic (PLEG): container finished" podID="5b6e7f67-ee2d-4fbc-9519-00493157aec0" containerID="0ed9f3a2d7a1517b282f8c04f00429f887151e188250ed9748eecf16b6169afe" exitCode=0 Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.046602 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"5b6e7f67-ee2d-4fbc-9519-00493157aec0","Type":"ContainerDied","Data":"0ed9f3a2d7a1517b282f8c04f00429f887151e188250ed9748eecf16b6169afe"} Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.046639 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"5b6e7f67-ee2d-4fbc-9519-00493157aec0","Type":"ContainerDied","Data":"3e44555187d1310d740578a6e6107a83660cd52dd77356861aa500186fe6367d"} Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.046791 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.050625 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.053313 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-6b9b487fd6-hdw75" event={"ID":"20dac7f8-f03f-40f8-93f1-5ba59f5471b8","Type":"ContainerDied","Data":"7436e41de3cb3eac0e6285a92be1d8f34cd78b933021e54cbe68b6462712154b"} Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.053542 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-6b9b487fd6-hdw75" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.065376 5120 generic.go:358] "Generic (PLEG): container finished" podID="13b65e37-9126-401e-9ef6-3e531453aaba" containerID="0e7949a684f8f8fe500457e72cc4e4823aa78b079b839cbf757031b0c431a0bc" exitCode=0 Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.065487 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"13b65e37-9126-401e-9ef6-3e531453aaba","Type":"ContainerDied","Data":"0e7949a684f8f8fe500457e72cc4e4823aa78b079b839cbf757031b0c431a0bc"} Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.065621 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.068943 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"662e5dd1-e157-4e76-bb3d-f4310c982cb0","Type":"ContainerDied","Data":"a0d425699d631300d9a5c7fdcd039edc11aab69ecc38fa98221cb5345c059f71"} Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.069075 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.079459 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"c88b7d39-fb86-490a-8af1-a6754dab05c9","Type":"ContainerDied","Data":"cfd5f53f62d27fa4536977ee824f357e6f1c2aef6dbf581978011aa7aa1d60d0"} Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.079940 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.094359 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70e3d80b-ae48-4742-90dd-95c106254f9f-kube-api-access-zmfns" (OuterVolumeSpecName: "kube-api-access-zmfns") pod "70e3d80b-ae48-4742-90dd-95c106254f9f" (UID: "70e3d80b-ae48-4742-90dd-95c106254f9f"). InnerVolumeSpecName "kube-api-access-zmfns". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.094491 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/593ab600-83e5-4863-b042-4fd69af25046-kube-api-access-f9zzp" (OuterVolumeSpecName: "kube-api-access-f9zzp") pod "593ab600-83e5-4863-b042-4fd69af25046" (UID: "593ab600-83e5-4863-b042-4fd69af25046"). InnerVolumeSpecName "kube-api-access-f9zzp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.094592 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b6e7f67-ee2d-4fbc-9519-00493157aec0-kube-api-access-884lc" (OuterVolumeSpecName: "kube-api-access-884lc") pod "5b6e7f67-ee2d-4fbc-9519-00493157aec0" (UID: "5b6e7f67-ee2d-4fbc-9519-00493157aec0"). InnerVolumeSpecName "kube-api-access-884lc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.107264 5120 generic.go:358] "Generic (PLEG): container finished" podID="593ab600-83e5-4863-b042-4fd69af25046" containerID="8e832e7dc397e67e74670c05012d05b2a1c2dc1d15b52f9df2af956db29f56da" exitCode=0 Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.107460 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-f9be-account-create-update-hw8p5" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.107736 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"593ab600-83e5-4863-b042-4fd69af25046","Type":"ContainerDied","Data":"8e832e7dc397e67e74670c05012d05b2a1c2dc1d15b52f9df2af956db29f56da"} Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.107805 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"593ab600-83e5-4863-b042-4fd69af25046","Type":"ContainerDied","Data":"a1f6687a62f885ace9e191d7911f43e8d975a4893189311c3ce8100955f06535"} Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.108013 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.131550 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-f9be-account-create-update-hw8p5" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.134840 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"mysql-db\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"13b65e37-9126-401e-9ef6-3e531453aaba\" (UID: \"13b65e37-9126-401e-9ef6-3e531453aaba\") " Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.135029 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/13b65e37-9126-401e-9ef6-3e531453aaba-combined-ca-bundle\") pod \"13b65e37-9126-401e-9ef6-3e531453aaba\" (UID: \"13b65e37-9126-401e-9ef6-3e531453aaba\") " Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.135093 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/13b65e37-9126-401e-9ef6-3e531453aaba-config-data-generated\") pod \"13b65e37-9126-401e-9ef6-3e531453aaba\" (UID: \"13b65e37-9126-401e-9ef6-3e531453aaba\") " Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.135244 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/13b65e37-9126-401e-9ef6-3e531453aaba-kolla-config\") pod \"13b65e37-9126-401e-9ef6-3e531453aaba\" (UID: \"13b65e37-9126-401e-9ef6-3e531453aaba\") " Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.135374 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/13b65e37-9126-401e-9ef6-3e531453aaba-config-data-default\") pod \"13b65e37-9126-401e-9ef6-3e531453aaba\" (UID: \"13b65e37-9126-401e-9ef6-3e531453aaba\") " Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.135409 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/13b65e37-9126-401e-9ef6-3e531453aaba-galera-tls-certs\") pod \"13b65e37-9126-401e-9ef6-3e531453aaba\" (UID: \"13b65e37-9126-401e-9ef6-3e531453aaba\") " Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.135445 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cwb2n\" (UniqueName: \"kubernetes.io/projected/13b65e37-9126-401e-9ef6-3e531453aaba-kube-api-access-cwb2n\") pod \"13b65e37-9126-401e-9ef6-3e531453aaba\" (UID: \"13b65e37-9126-401e-9ef6-3e531453aaba\") " Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.135518 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/13b65e37-9126-401e-9ef6-3e531453aaba-operator-scripts\") pod \"13b65e37-9126-401e-9ef6-3e531453aaba\" (UID: \"13b65e37-9126-401e-9ef6-3e531453aaba\") " Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.135719 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13b65e37-9126-401e-9ef6-3e531453aaba-config-data-generated" (OuterVolumeSpecName: "config-data-generated") pod "13b65e37-9126-401e-9ef6-3e531453aaba" (UID: "13b65e37-9126-401e-9ef6-3e531453aaba"). InnerVolumeSpecName "config-data-generated". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.137078 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ggxks\" (UniqueName: \"kubernetes.io/projected/275f09d2-7564-4210-b204-f0614f780f7e-kube-api-access-ggxks\") pod \"keystone-f9be-account-create-update-hw8p5\" (UID: \"275f09d2-7564-4210-b204-f0614f780f7e\") " pod="openstack-kuttl-tests/keystone-f9be-account-create-update-hw8p5" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.137194 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/275f09d2-7564-4210-b204-f0614f780f7e-operator-scripts\") pod \"keystone-f9be-account-create-update-hw8p5\" (UID: \"275f09d2-7564-4210-b204-f0614f780f7e\") " pod="openstack-kuttl-tests/keystone-f9be-account-create-update-hw8p5" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.137697 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/a2c4ebb0-3217-469c-88b5-b06d50a9db60-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.137719 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f9zzp\" (UniqueName: \"kubernetes.io/projected/593ab600-83e5-4863-b042-4fd69af25046-kube-api-access-f9zzp\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.137732 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zmfns\" (UniqueName: \"kubernetes.io/projected/70e3d80b-ae48-4742-90dd-95c106254f9f-kube-api-access-zmfns\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.137745 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/70e3d80b-ae48-4742-90dd-95c106254f9f-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.137762 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-884lc\" (UniqueName: \"kubernetes.io/projected/5b6e7f67-ee2d-4fbc-9519-00493157aec0-kube-api-access-884lc\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.137784 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-78r8b\" (UniqueName: \"kubernetes.io/projected/a2c4ebb0-3217-469c-88b5-b06d50a9db60-kube-api-access-78r8b\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.137794 5120 reconciler_common.go:299] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/a2c4ebb0-3217-469c-88b5-b06d50a9db60-kolla-config\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.137807 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/593ab600-83e5-4863-b042-4fd69af25046-logs\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.137823 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/13b65e37-9126-401e-9ef6-3e531453aaba-config-data-generated\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:09 crc kubenswrapper[5120]: E0316 17:03:09.137884 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Mar 16 17:03:09 crc kubenswrapper[5120]: E0316 17:03:09.137978 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/275f09d2-7564-4210-b204-f0614f780f7e-operator-scripts podName:275f09d2-7564-4210-b204-f0614f780f7e nodeName:}" failed. No retries permitted until 2026-03-16 17:03:11.137962631 +0000 UTC m=+5493.291894288 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/275f09d2-7564-4210-b204-f0614f780f7e-operator-scripts") pod "keystone-f9be-account-create-update-hw8p5" (UID: "275f09d2-7564-4210-b204-f0614f780f7e") : configmap "openstack-scripts" not found Mar 16 17:03:09 crc kubenswrapper[5120]: E0316 17:03:09.139090 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="8d1a8aa9bd86f2402b10b59285567fd78f4d62123af2fd8a44ad19b94394c08b" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.140527 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/13b65e37-9126-401e-9ef6-3e531453aaba-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "13b65e37-9126-401e-9ef6-3e531453aaba" (UID: "13b65e37-9126-401e-9ef6-3e531453aaba"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:03:09 crc kubenswrapper[5120]: E0316 17:03:09.145016 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="8d1a8aa9bd86f2402b10b59285567fd78f4d62123af2fd8a44ad19b94394c08b" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 17:03:09 crc kubenswrapper[5120]: E0316 17:03:09.146072 5120 projected.go:194] Error preparing data for projected volume kube-api-access-ggxks for pod openstack-kuttl-tests/keystone-f9be-account-create-update-hw8p5: failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 17:03:09 crc kubenswrapper[5120]: E0316 17:03:09.146144 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/275f09d2-7564-4210-b204-f0614f780f7e-kube-api-access-ggxks podName:275f09d2-7564-4210-b204-f0614f780f7e nodeName:}" failed. No retries permitted until 2026-03-16 17:03:11.146120406 +0000 UTC m=+5493.300052053 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-ggxks" (UniqueName: "kubernetes.io/projected/275f09d2-7564-4210-b204-f0614f780f7e-kube-api-access-ggxks") pod "keystone-f9be-account-create-update-hw8p5" (UID: "275f09d2-7564-4210-b204-f0614f780f7e") : failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.150264 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/13b65e37-9126-401e-9ef6-3e531453aaba-config-data-default" (OuterVolumeSpecName: "config-data-default") pod "13b65e37-9126-401e-9ef6-3e531453aaba" (UID: "13b65e37-9126-401e-9ef6-3e531453aaba"). InnerVolumeSpecName "config-data-default". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:03:09 crc kubenswrapper[5120]: E0316 17:03:09.152872 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="8d1a8aa9bd86f2402b10b59285567fd78f4d62123af2fd8a44ad19b94394c08b" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 17:03:09 crc kubenswrapper[5120]: E0316 17:03:09.152928 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="61d14db6-7d33-4e5f-8252-844441e519d7" containerName="nova-cell1-conductor-conductor" probeResult="unknown" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.155438 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c88b7d39-fb86-490a-8af1-a6754dab05c9-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "c88b7d39-fb86-490a-8af1-a6754dab05c9" (UID: "c88b7d39-fb86-490a-8af1-a6754dab05c9"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.165866 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-5fprr" podStartSLOduration=7.165845521 podStartE2EDuration="7.165845521s" podCreationTimestamp="2026-03-16 17:03:02 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:03:09.051220084 +0000 UTC m=+5491.205151761" watchObservedRunningTime="2026-03-16 17:03:09.165845521 +0000 UTC m=+5491.319777168" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.182036 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/13b65e37-9126-401e-9ef6-3e531453aaba-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "13b65e37-9126-401e-9ef6-3e531453aaba" (UID: "13b65e37-9126-401e-9ef6-3e531453aaba"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.186156 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13b65e37-9126-401e-9ef6-3e531453aaba-kube-api-access-cwb2n" (OuterVolumeSpecName: "kube-api-access-cwb2n") pod "13b65e37-9126-401e-9ef6-3e531453aaba" (UID: "13b65e37-9126-401e-9ef6-3e531453aaba"). InnerVolumeSpecName "kube-api-access-cwb2n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.186875 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/53cbb212-f009-4d4e-90fc-9a50a14cc62b-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "53cbb212-f009-4d4e-90fc-9a50a14cc62b" (UID: "53cbb212-f009-4d4e-90fc-9a50a14cc62b"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.193971 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/593ab600-83e5-4863-b042-4fd69af25046-config-data" (OuterVolumeSpecName: "config-data") pod "593ab600-83e5-4863-b042-4fd69af25046" (UID: "593ab600-83e5-4863-b042-4fd69af25046"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.208687 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage06-crc" (UniqueName: "kubernetes.io/local-volume/local-storage06-crc") on node "crc" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.230541 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c88b7d39-fb86-490a-8af1-a6754dab05c9-config-data" (OuterVolumeSpecName: "config-data") pod "c88b7d39-fb86-490a-8af1-a6754dab05c9" (UID: "c88b7d39-fb86-490a-8af1-a6754dab05c9"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.232405 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage20-crc" (OuterVolumeSpecName: "mysql-db") pod "13b65e37-9126-401e-9ef6-3e531453aaba" (UID: "13b65e37-9126-401e-9ef6-3e531453aaba"). InnerVolumeSpecName "local-storage20-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.241033 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.241064 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c88b7d39-fb86-490a-8af1-a6754dab05c9-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.241075 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/593ab600-83e5-4863-b042-4fd69af25046-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.241102 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") on node \"crc\" " Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.241112 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/53cbb212-f009-4d4e-90fc-9a50a14cc62b-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.241122 5120 reconciler_common.go:299] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/13b65e37-9126-401e-9ef6-3e531453aaba-kolla-config\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.241131 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/13b65e37-9126-401e-9ef6-3e531453aaba-config-data-default\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.241140 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cwb2n\" (UniqueName: \"kubernetes.io/projected/13b65e37-9126-401e-9ef6-3e531453aaba-kube-api-access-cwb2n\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.241149 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c88b7d39-fb86-490a-8af1-a6754dab05c9-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.241157 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/13b65e37-9126-401e-9ef6-3e531453aaba-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.244046 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage05-crc" (UniqueName: "kubernetes.io/local-volume/local-storage05-crc") on node "crc" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.247886 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4740a262-b05d-4d08-a797-022ca51bbf69-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "4740a262-b05d-4d08-a797-022ca51bbf69" (UID: "4740a262-b05d-4d08-a797-022ca51bbf69"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.248323 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b6e7f67-ee2d-4fbc-9519-00493157aec0-config-data" (OuterVolumeSpecName: "config-data") pod "5b6e7f67-ee2d-4fbc-9519-00493157aec0" (UID: "5b6e7f67-ee2d-4fbc-9519-00493157aec0"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.248436 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61f313f6-217b-4ab6-aaf9-2b45cb201326-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "61f313f6-217b-4ab6-aaf9-2b45cb201326" (UID: "61f313f6-217b-4ab6-aaf9-2b45cb201326"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.261611 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/53cbb212-f009-4d4e-90fc-9a50a14cc62b-config-data" (OuterVolumeSpecName: "config-data") pod "53cbb212-f009-4d4e-90fc-9a50a14cc62b" (UID: "53cbb212-f009-4d4e-90fc-9a50a14cc62b"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.263860 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.275921 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage20-crc" (UniqueName: "kubernetes.io/local-volume/local-storage20-crc") on node "crc" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.275989 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.277287 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/593ab600-83e5-4863-b042-4fd69af25046-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "593ab600-83e5-4863-b042-4fd69af25046" (UID: "593ab600-83e5-4863-b042-4fd69af25046"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.287985 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/53cbb212-f009-4d4e-90fc-9a50a14cc62b-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "53cbb212-f009-4d4e-90fc-9a50a14cc62b" (UID: "53cbb212-f009-4d4e-90fc-9a50a14cc62b"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.290097 5120 scope.go:117] "RemoveContainer" containerID="5bfafc526ad62699465630e81855b22eac1443b21d006f8f97fa8fa451d24f35" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.291093 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/20dac7f8-f03f-40f8-93f1-5ba59f5471b8-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "20dac7f8-f03f-40f8-93f1-5ba59f5471b8" (UID: "20dac7f8-f03f-40f8-93f1-5ba59f5471b8"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.297250 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/53cbb212-f009-4d4e-90fc-9a50a14cc62b-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "53cbb212-f009-4d4e-90fc-9a50a14cc62b" (UID: "53cbb212-f009-4d4e-90fc-9a50a14cc62b"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.310334 5120 scope.go:117] "RemoveContainer" containerID="66f1189a24416e91074b04dcaf79e83fefb91f45f121a8fd03153adae3b4103d" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.330121 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-m55p2"] Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.337938 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a2c4ebb0-3217-469c-88b5-b06d50a9db60-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "a2c4ebb0-3217-469c-88b5-b06d50a9db60" (UID: "a2c4ebb0-3217-469c-88b5-b06d50a9db60"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.338052 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b6e7f67-ee2d-4fbc-9519-00493157aec0-nova-metadata-tls-certs" (OuterVolumeSpecName: "nova-metadata-tls-certs") pod "5b6e7f67-ee2d-4fbc-9519-00493157aec0" (UID: "5b6e7f67-ee2d-4fbc-9519-00493157aec0"). InnerVolumeSpecName "nova-metadata-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.338319 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/20dac7f8-f03f-40f8-93f1-5ba59f5471b8-config-data" (OuterVolumeSpecName: "config-data") pod "20dac7f8-f03f-40f8-93f1-5ba59f5471b8" (UID: "20dac7f8-f03f-40f8-93f1-5ba59f5471b8"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.341657 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-m55p2"] Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.343008 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4740a262-b05d-4d08-a797-022ca51bbf69-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.343038 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/20dac7f8-f03f-40f8-93f1-5ba59f5471b8-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.343049 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.343059 5120 reconciler_common.go:299] "Volume detached for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/5b6e7f67-ee2d-4fbc-9519-00493157aec0-nova-metadata-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.343069 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/593ab600-83e5-4863-b042-4fd69af25046-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.343077 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a2c4ebb0-3217-469c-88b5-b06d50a9db60-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.343087 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.343097 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/53cbb212-f009-4d4e-90fc-9a50a14cc62b-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.343106 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/61f313f6-217b-4ab6-aaf9-2b45cb201326-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.343115 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/53cbb212-f009-4d4e-90fc-9a50a14cc62b-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.343123 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5b6e7f67-ee2d-4fbc-9519-00493157aec0-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.343133 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/53cbb212-f009-4d4e-90fc-9a50a14cc62b-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.343141 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/20dac7f8-f03f-40f8-93f1-5ba59f5471b8-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.349233 5120 scope.go:117] "RemoveContainer" containerID="e79bec4774f6a6e576ce22646b1f0afd4a6a10b83b113f6a415debac6c55cba5" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.365166 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b6e7f67-ee2d-4fbc-9519-00493157aec0-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "5b6e7f67-ee2d-4fbc-9519-00493157aec0" (UID: "5b6e7f67-ee2d-4fbc-9519-00493157aec0"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.366003 5120 scope.go:117] "RemoveContainer" containerID="676ecca2659a20874ab25a6a892347a8f432119ffef02332827f47ffc00c26af" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.370606 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c88b7d39-fb86-490a-8af1-a6754dab05c9-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "c88b7d39-fb86-490a-8af1-a6754dab05c9" (UID: "c88b7d39-fb86-490a-8af1-a6754dab05c9"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.371432 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/13b65e37-9126-401e-9ef6-3e531453aaba-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "13b65e37-9126-401e-9ef6-3e531453aaba" (UID: "13b65e37-9126-401e-9ef6-3e531453aaba"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.403429 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4740a262-b05d-4d08-a797-022ca51bbf69-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "4740a262-b05d-4d08-a797-022ca51bbf69" (UID: "4740a262-b05d-4d08-a797-022ca51bbf69"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.431386 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61f313f6-217b-4ab6-aaf9-2b45cb201326-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "61f313f6-217b-4ab6-aaf9-2b45cb201326" (UID: "61f313f6-217b-4ab6-aaf9-2b45cb201326"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.434931 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61f313f6-217b-4ab6-aaf9-2b45cb201326-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "61f313f6-217b-4ab6-aaf9-2b45cb201326" (UID: "61f313f6-217b-4ab6-aaf9-2b45cb201326"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.435220 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4740a262-b05d-4d08-a797-022ca51bbf69-config-data" (OuterVolumeSpecName: "config-data") pod "4740a262-b05d-4d08-a797-022ca51bbf69" (UID: "4740a262-b05d-4d08-a797-022ca51bbf69"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.441959 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61f313f6-217b-4ab6-aaf9-2b45cb201326-config-data" (OuterVolumeSpecName: "config-data") pod "61f313f6-217b-4ab6-aaf9-2b45cb201326" (UID: "61f313f6-217b-4ab6-aaf9-2b45cb201326"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.443059 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/13b65e37-9126-401e-9ef6-3e531453aaba-galera-tls-certs" (OuterVolumeSpecName: "galera-tls-certs") pod "13b65e37-9126-401e-9ef6-3e531453aaba" (UID: "13b65e37-9126-401e-9ef6-3e531453aaba"). InnerVolumeSpecName "galera-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.444733 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/593ab600-83e5-4863-b042-4fd69af25046-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "593ab600-83e5-4863-b042-4fd69af25046" (UID: "593ab600-83e5-4863-b042-4fd69af25046"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.445818 5120 scope.go:117] "RemoveContainer" containerID="d18ae45a7bd16b2475a636f555a606b5940bcadadeed5617f54d6d4c6a6b469f" Mar 16 17:03:09 crc kubenswrapper[5120]: E0316 17:03:09.446067 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Mar 16 17:03:09 crc kubenswrapper[5120]: E0316 17:03:09.446599 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/279c3e84-623c-4c5f-ae15-d7d8c439c4dc-config-data podName:279c3e84-623c-4c5f-ae15-d7d8c439c4dc nodeName:}" failed. No retries permitted until 2026-03-16 17:03:17.446575536 +0000 UTC m=+5499.600507203 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/279c3e84-623c-4c5f-ae15-d7d8c439c4dc-config-data") pod "rabbitmq-cell1-server-0" (UID: "279c3e84-623c-4c5f-ae15-d7d8c439c4dc") : configmap "rabbitmq-cell1-config-data" not found Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.446942 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/c88b7d39-fb86-490a-8af1-a6754dab05c9-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.447029 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5b6e7f67-ee2d-4fbc-9519-00493157aec0-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.447107 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4740a262-b05d-4d08-a797-022ca51bbf69-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.447281 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/61f313f6-217b-4ab6-aaf9-2b45cb201326-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.447436 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/593ab600-83e5-4863-b042-4fd69af25046-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.447526 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/61f313f6-217b-4ab6-aaf9-2b45cb201326-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.447601 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/13b65e37-9126-401e-9ef6-3e531453aaba-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.447675 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/4740a262-b05d-4d08-a797-022ca51bbf69-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.447751 5120 reconciler_common.go:299] "Volume detached for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/13b65e37-9126-401e-9ef6-3e531453aaba-galera-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.447865 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/61f313f6-217b-4ab6-aaf9-2b45cb201326-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.449973 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-6b9b487fd6-hdw75"] Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.460456 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a2c4ebb0-3217-469c-88b5-b06d50a9db60-memcached-tls-certs" (OuterVolumeSpecName: "memcached-tls-certs") pod "a2c4ebb0-3217-469c-88b5-b06d50a9db60" (UID: "a2c4ebb0-3217-469c-88b5-b06d50a9db60"). InnerVolumeSpecName "memcached-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.461753 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-6b9b487fd6-hdw75"] Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.466197 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/593ab600-83e5-4863-b042-4fd69af25046-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "593ab600-83e5-4863-b042-4fd69af25046" (UID: "593ab600-83e5-4863-b042-4fd69af25046"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.487975 5120 scope.go:117] "RemoveContainer" containerID="cd314e8c2ba56b3a12ba0679d21f2a55a4f7ab45f72f1581f1ae854629e205c9" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.494946 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.502919 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.511116 5120 scope.go:117] "RemoveContainer" containerID="70df15c29e7e18770997e7713428c52391954f52d73580a598f904dce87cf1c4" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.572746 5120 reconciler_common.go:299] "Volume detached for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/a2c4ebb0-3217-469c-88b5-b06d50a9db60-memcached-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.572807 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/593ab600-83e5-4863-b042-4fd69af25046-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.755874 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.760140 5120 scope.go:117] "RemoveContainer" containerID="1aa3bba3e930ec962235431ddf3fe2a5d6f2094302d4df6b0f874c2f055eb2f6" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.784010 5120 scope.go:117] "RemoveContainer" containerID="9ac3921838bb561759659bd1773fd3f8b082e010a21c94cdd332cda5e7d02964" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.824397 5120 scope.go:117] "RemoveContainer" containerID="cd314e8c2ba56b3a12ba0679d21f2a55a4f7ab45f72f1581f1ae854629e205c9" Mar 16 17:03:09 crc kubenswrapper[5120]: E0316 17:03:09.830605 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd314e8c2ba56b3a12ba0679d21f2a55a4f7ab45f72f1581f1ae854629e205c9\": container with ID starting with cd314e8c2ba56b3a12ba0679d21f2a55a4f7ab45f72f1581f1ae854629e205c9 not found: ID does not exist" containerID="cd314e8c2ba56b3a12ba0679d21f2a55a4f7ab45f72f1581f1ae854629e205c9" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.830667 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd314e8c2ba56b3a12ba0679d21f2a55a4f7ab45f72f1581f1ae854629e205c9"} err="failed to get container status \"cd314e8c2ba56b3a12ba0679d21f2a55a4f7ab45f72f1581f1ae854629e205c9\": rpc error: code = NotFound desc = could not find container \"cd314e8c2ba56b3a12ba0679d21f2a55a4f7ab45f72f1581f1ae854629e205c9\": container with ID starting with cd314e8c2ba56b3a12ba0679d21f2a55a4f7ab45f72f1581f1ae854629e205c9 not found: ID does not exist" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.830712 5120 scope.go:117] "RemoveContainer" containerID="1aa3bba3e930ec962235431ddf3fe2a5d6f2094302d4df6b0f874c2f055eb2f6" Mar 16 17:03:09 crc kubenswrapper[5120]: E0316 17:03:09.831292 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1aa3bba3e930ec962235431ddf3fe2a5d6f2094302d4df6b0f874c2f055eb2f6\": container with ID starting with 1aa3bba3e930ec962235431ddf3fe2a5d6f2094302d4df6b0f874c2f055eb2f6 not found: ID does not exist" containerID="1aa3bba3e930ec962235431ddf3fe2a5d6f2094302d4df6b0f874c2f055eb2f6" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.831335 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1aa3bba3e930ec962235431ddf3fe2a5d6f2094302d4df6b0f874c2f055eb2f6"} err="failed to get container status \"1aa3bba3e930ec962235431ddf3fe2a5d6f2094302d4df6b0f874c2f055eb2f6\": rpc error: code = NotFound desc = could not find container \"1aa3bba3e930ec962235431ddf3fe2a5d6f2094302d4df6b0f874c2f055eb2f6\": container with ID starting with 1aa3bba3e930ec962235431ddf3fe2a5d6f2094302d4df6b0f874c2f055eb2f6 not found: ID does not exist" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.831354 5120 scope.go:117] "RemoveContainer" containerID="01a18ca0b10239e6c9de6d8b6dc31138b0602acec0f42adffb5dce9132fd4bfd" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.873054 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.885938 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/4ed551c0-3f37-4af6-b682-b9e35fd5fa42-plugins-conf\") pod \"4ed551c0-3f37-4af6-b682-b9e35fd5fa42\" (UID: \"4ed551c0-3f37-4af6-b682-b9e35fd5fa42\") " Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.886101 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/4ed551c0-3f37-4af6-b682-b9e35fd5fa42-rabbitmq-plugins\") pod \"4ed551c0-3f37-4af6-b682-b9e35fd5fa42\" (UID: \"4ed551c0-3f37-4af6-b682-b9e35fd5fa42\") " Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.886154 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/4ed551c0-3f37-4af6-b682-b9e35fd5fa42-pod-info\") pod \"4ed551c0-3f37-4af6-b682-b9e35fd5fa42\" (UID: \"4ed551c0-3f37-4af6-b682-b9e35fd5fa42\") " Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.886176 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/4ed551c0-3f37-4af6-b682-b9e35fd5fa42-rabbitmq-erlang-cookie\") pod \"4ed551c0-3f37-4af6-b682-b9e35fd5fa42\" (UID: \"4ed551c0-3f37-4af6-b682-b9e35fd5fa42\") " Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.886195 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/4ed551c0-3f37-4af6-b682-b9e35fd5fa42-erlang-cookie-secret\") pod \"4ed551c0-3f37-4af6-b682-b9e35fd5fa42\" (UID: \"4ed551c0-3f37-4af6-b682-b9e35fd5fa42\") " Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.886243 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/4ed551c0-3f37-4af6-b682-b9e35fd5fa42-rabbitmq-confd\") pod \"4ed551c0-3f37-4af6-b682-b9e35fd5fa42\" (UID: \"4ed551c0-3f37-4af6-b682-b9e35fd5fa42\") " Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.886282 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/4ed551c0-3f37-4af6-b682-b9e35fd5fa42-config-data\") pod \"4ed551c0-3f37-4af6-b682-b9e35fd5fa42\" (UID: \"4ed551c0-3f37-4af6-b682-b9e35fd5fa42\") " Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.886300 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nkn8j\" (UniqueName: \"kubernetes.io/projected/4ed551c0-3f37-4af6-b682-b9e35fd5fa42-kube-api-access-nkn8j\") pod \"4ed551c0-3f37-4af6-b682-b9e35fd5fa42\" (UID: \"4ed551c0-3f37-4af6-b682-b9e35fd5fa42\") " Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.886327 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/4ed551c0-3f37-4af6-b682-b9e35fd5fa42-server-conf\") pod \"4ed551c0-3f37-4af6-b682-b9e35fd5fa42\" (UID: \"4ed551c0-3f37-4af6-b682-b9e35fd5fa42\") " Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.886379 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/4ed551c0-3f37-4af6-b682-b9e35fd5fa42-rabbitmq-tls\") pod \"4ed551c0-3f37-4af6-b682-b9e35fd5fa42\" (UID: \"4ed551c0-3f37-4af6-b682-b9e35fd5fa42\") " Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.886498 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"persistence\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") pod \"4ed551c0-3f37-4af6-b682-b9e35fd5fa42\" (UID: \"4ed551c0-3f37-4af6-b682-b9e35fd5fa42\") " Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.889572 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ed551c0-3f37-4af6-b682-b9e35fd5fa42-plugins-conf" (OuterVolumeSpecName: "plugins-conf") pod "4ed551c0-3f37-4af6-b682-b9e35fd5fa42" (UID: "4ed551c0-3f37-4af6-b682-b9e35fd5fa42"). InnerVolumeSpecName "plugins-conf". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.897793 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ed551c0-3f37-4af6-b682-b9e35fd5fa42-rabbitmq-tls" (OuterVolumeSpecName: "rabbitmq-tls") pod "4ed551c0-3f37-4af6-b682-b9e35fd5fa42" (UID: "4ed551c0-3f37-4af6-b682-b9e35fd5fa42"). InnerVolumeSpecName "rabbitmq-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.900147 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ed551c0-3f37-4af6-b682-b9e35fd5fa42-rabbitmq-erlang-cookie" (OuterVolumeSpecName: "rabbitmq-erlang-cookie") pod "4ed551c0-3f37-4af6-b682-b9e35fd5fa42" (UID: "4ed551c0-3f37-4af6-b682-b9e35fd5fa42"). InnerVolumeSpecName "rabbitmq-erlang-cookie". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.900241 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ed551c0-3f37-4af6-b682-b9e35fd5fa42-rabbitmq-plugins" (OuterVolumeSpecName: "rabbitmq-plugins") pod "4ed551c0-3f37-4af6-b682-b9e35fd5fa42" (UID: "4ed551c0-3f37-4af6-b682-b9e35fd5fa42"). InnerVolumeSpecName "rabbitmq-plugins". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.907984 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4ed551c0-3f37-4af6-b682-b9e35fd5fa42-pod-info" (OuterVolumeSpecName: "pod-info") pod "4ed551c0-3f37-4af6-b682-b9e35fd5fa42" (UID: "4ed551c0-3f37-4af6-b682-b9e35fd5fa42"). InnerVolumeSpecName "pod-info". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.908339 5120 scope.go:117] "RemoveContainer" containerID="c3734c1f7a2516f61c2ebf8d78d0ed774a324bcc7d1d3f325ed904393918d581" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.910017 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage17-crc" (OuterVolumeSpecName: "persistence") pod "4ed551c0-3f37-4af6-b682-b9e35fd5fa42" (UID: "4ed551c0-3f37-4af6-b682-b9e35fd5fa42"). InnerVolumeSpecName "local-storage17-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.919055 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.919774 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ed551c0-3f37-4af6-b682-b9e35fd5fa42-erlang-cookie-secret" (OuterVolumeSpecName: "erlang-cookie-secret") pod "4ed551c0-3f37-4af6-b682-b9e35fd5fa42" (UID: "4ed551c0-3f37-4af6-b682-b9e35fd5fa42"). InnerVolumeSpecName "erlang-cookie-secret". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.925373 5120 scope.go:117] "RemoveContainer" containerID="b8ab46569a3c06699626c8c74733b80f3e3d69a2d7719c4325fc9824fc301611" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.925581 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ed551c0-3f37-4af6-b682-b9e35fd5fa42-kube-api-access-nkn8j" (OuterVolumeSpecName: "kube-api-access-nkn8j") pod "4ed551c0-3f37-4af6-b682-b9e35fd5fa42" (UID: "4ed551c0-3f37-4af6-b682-b9e35fd5fa42"). InnerVolumeSpecName "kube-api-access-nkn8j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.926356 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.928660 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ed551c0-3f37-4af6-b682-b9e35fd5fa42-config-data" (OuterVolumeSpecName: "config-data") pod "4ed551c0-3f37-4af6-b682-b9e35fd5fa42" (UID: "4ed551c0-3f37-4af6-b682-b9e35fd5fa42"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.935184 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.940677 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.947859 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.956142 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-7bbc5ddcc6-cxnhk"] Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.961446 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ed551c0-3f37-4af6-b682-b9e35fd5fa42-server-conf" (OuterVolumeSpecName: "server-conf") pod "4ed551c0-3f37-4af6-b682-b9e35fd5fa42" (UID: "4ed551c0-3f37-4af6-b682-b9e35fd5fa42"). InnerVolumeSpecName "server-conf". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.966180 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-api-7bbc5ddcc6-cxnhk"] Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.976703 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-proxy-7db84d667d-4xtpj"] Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.981823 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/swift-proxy-7db84d667d-4xtpj"] Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.987182 5120 scope.go:117] "RemoveContainer" containerID="c2b21dd36b7e60c7557d1e47d96a5e15f4ffc92ec5cf76f7d08cce5248e92878" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.988915 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/4ed551c0-3f37-4af6-b682-b9e35fd5fa42-rabbitmq-plugins\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.988931 5120 reconciler_common.go:299] "Volume detached for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/4ed551c0-3f37-4af6-b682-b9e35fd5fa42-pod-info\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.988943 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/4ed551c0-3f37-4af6-b682-b9e35fd5fa42-rabbitmq-erlang-cookie\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.988953 5120 reconciler_common.go:299] "Volume detached for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/4ed551c0-3f37-4af6-b682-b9e35fd5fa42-erlang-cookie-secret\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.988962 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/4ed551c0-3f37-4af6-b682-b9e35fd5fa42-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.988970 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nkn8j\" (UniqueName: \"kubernetes.io/projected/4ed551c0-3f37-4af6-b682-b9e35fd5fa42-kube-api-access-nkn8j\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.988980 5120 reconciler_common.go:299] "Volume detached for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/4ed551c0-3f37-4af6-b682-b9e35fd5fa42-server-conf\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.988988 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/4ed551c0-3f37-4af6-b682-b9e35fd5fa42-rabbitmq-tls\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.989024 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") on node \"crc\" " Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.989032 5120 reconciler_common.go:299] "Volume detached for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/4ed551c0-3f37-4af6-b682-b9e35fd5fa42-plugins-conf\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:09 crc kubenswrapper[5120]: I0316 17:03:09.994962 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 17:03:10 crc kubenswrapper[5120]: I0316 17:03:10.000101 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ed551c0-3f37-4af6-b682-b9e35fd5fa42-rabbitmq-confd" (OuterVolumeSpecName: "rabbitmq-confd") pod "4ed551c0-3f37-4af6-b682-b9e35fd5fa42" (UID: "4ed551c0-3f37-4af6-b682-b9e35fd5fa42"). InnerVolumeSpecName "rabbitmq-confd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:03:10 crc kubenswrapper[5120]: I0316 17:03:10.004467 5120 scope.go:117] "RemoveContainer" containerID="01a18ca0b10239e6c9de6d8b6dc31138b0602acec0f42adffb5dce9132fd4bfd" Mar 16 17:03:10 crc kubenswrapper[5120]: I0316 17:03:10.004624 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 17:03:10 crc kubenswrapper[5120]: E0316 17:03:10.005007 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"01a18ca0b10239e6c9de6d8b6dc31138b0602acec0f42adffb5dce9132fd4bfd\": container with ID starting with 01a18ca0b10239e6c9de6d8b6dc31138b0602acec0f42adffb5dce9132fd4bfd not found: ID does not exist" containerID="01a18ca0b10239e6c9de6d8b6dc31138b0602acec0f42adffb5dce9132fd4bfd" Mar 16 17:03:10 crc kubenswrapper[5120]: I0316 17:03:10.005048 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01a18ca0b10239e6c9de6d8b6dc31138b0602acec0f42adffb5dce9132fd4bfd"} err="failed to get container status \"01a18ca0b10239e6c9de6d8b6dc31138b0602acec0f42adffb5dce9132fd4bfd\": rpc error: code = NotFound desc = could not find container \"01a18ca0b10239e6c9de6d8b6dc31138b0602acec0f42adffb5dce9132fd4bfd\": container with ID starting with 01a18ca0b10239e6c9de6d8b6dc31138b0602acec0f42adffb5dce9132fd4bfd not found: ID does not exist" Mar 16 17:03:10 crc kubenswrapper[5120]: I0316 17:03:10.005071 5120 scope.go:117] "RemoveContainer" containerID="b8ab46569a3c06699626c8c74733b80f3e3d69a2d7719c4325fc9824fc301611" Mar 16 17:03:10 crc kubenswrapper[5120]: E0316 17:03:10.005327 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b8ab46569a3c06699626c8c74733b80f3e3d69a2d7719c4325fc9824fc301611\": container with ID starting with b8ab46569a3c06699626c8c74733b80f3e3d69a2d7719c4325fc9824fc301611 not found: ID does not exist" containerID="b8ab46569a3c06699626c8c74733b80f3e3d69a2d7719c4325fc9824fc301611" Mar 16 17:03:10 crc kubenswrapper[5120]: I0316 17:03:10.005358 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8ab46569a3c06699626c8c74733b80f3e3d69a2d7719c4325fc9824fc301611"} err="failed to get container status \"b8ab46569a3c06699626c8c74733b80f3e3d69a2d7719c4325fc9824fc301611\": rpc error: code = NotFound desc = could not find container \"b8ab46569a3c06699626c8c74733b80f3e3d69a2d7719c4325fc9824fc301611\": container with ID starting with b8ab46569a3c06699626c8c74733b80f3e3d69a2d7719c4325fc9824fc301611 not found: ID does not exist" Mar 16 17:03:10 crc kubenswrapper[5120]: I0316 17:03:10.005375 5120 scope.go:117] "RemoveContainer" containerID="c9f9f59cf38633969218626618ba40b5ed463c1ee0ff455a51269236211d9f2e" Mar 16 17:03:10 crc kubenswrapper[5120]: I0316 17:03:10.010850 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 17:03:10 crc kubenswrapper[5120]: I0316 17:03:10.012689 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage17-crc" (UniqueName: "kubernetes.io/local-volume/local-storage17-crc") on node "crc" Mar 16 17:03:10 crc kubenswrapper[5120]: I0316 17:03:10.017042 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 17:03:10 crc kubenswrapper[5120]: E0316 17:03:10.021534 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1750489 actualBytes=10240 Mar 16 17:03:10 crc kubenswrapper[5120]: I0316 17:03:10.026789 5120 scope.go:117] "RemoveContainer" containerID="b975633145eda0f8448b1545826e6b8e31333016168f9b81f1ceaee40959dda8" Mar 16 17:03:10 crc kubenswrapper[5120]: I0316 17:03:10.044026 5120 scope.go:117] "RemoveContainer" containerID="c0ab37643ef8d4e10deb832015361dee449ca3b088af8242b95d32087795d54a" Mar 16 17:03:10 crc kubenswrapper[5120]: I0316 17:03:10.059568 5120 scope.go:117] "RemoveContainer" containerID="3c07d8e4cbd4126b42dc13d408ca198bcbd6f0c92b3ecb09696c4f6a41f38f11" Mar 16 17:03:10 crc kubenswrapper[5120]: I0316 17:03:10.085344 5120 scope.go:117] "RemoveContainer" containerID="62a3266878d596b0fef9e2860df21eb9d22eda5d50110680ee608c9dfbf14e80" Mar 16 17:03:10 crc kubenswrapper[5120]: I0316 17:03:10.090615 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/4ed551c0-3f37-4af6-b682-b9e35fd5fa42-rabbitmq-confd\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:10 crc kubenswrapper[5120]: I0316 17:03:10.090643 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:10 crc kubenswrapper[5120]: I0316 17:03:10.122991 5120 generic.go:358] "Generic (PLEG): container finished" podID="4ed551c0-3f37-4af6-b682-b9e35fd5fa42" containerID="b8bbcdffc34685e533b2e078ab9d7cc67872998017fd038f8b682e3c4a20dda7" exitCode=0 Mar 16 17:03:10 crc kubenswrapper[5120]: I0316 17:03:10.123048 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"4ed551c0-3f37-4af6-b682-b9e35fd5fa42","Type":"ContainerDied","Data":"b8bbcdffc34685e533b2e078ab9d7cc67872998017fd038f8b682e3c4a20dda7"} Mar 16 17:03:10 crc kubenswrapper[5120]: I0316 17:03:10.123377 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"4ed551c0-3f37-4af6-b682-b9e35fd5fa42","Type":"ContainerDied","Data":"e70aa7007beb1a5d940df9eae92f9093ba19419f9e918a6c0f5be0453ea4a777"} Mar 16 17:03:10 crc kubenswrapper[5120]: I0316 17:03:10.123137 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 17:03:10 crc kubenswrapper[5120]: I0316 17:03:10.127606 5120 scope.go:117] "RemoveContainer" containerID="c57ec37635360e149652c410437ff8f09f649f6a0a2557273d9df336db8b2879" Mar 16 17:03:10 crc kubenswrapper[5120]: I0316 17:03:10.140118 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-5fprr" event={"ID":"d4d1258a-d21b-48af-ac55-d36aa473d0ad","Type":"ContainerStarted","Data":"5966b74d793da45985b6c1d080d92d4353b0265274cb571270a2643a37a0d906"} Mar 16 17:03:10 crc kubenswrapper[5120]: I0316 17:03:10.146736 5120 scope.go:117] "RemoveContainer" containerID="62a3266878d596b0fef9e2860df21eb9d22eda5d50110680ee608c9dfbf14e80" Mar 16 17:03:10 crc kubenswrapper[5120]: E0316 17:03:10.147383 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"62a3266878d596b0fef9e2860df21eb9d22eda5d50110680ee608c9dfbf14e80\": container with ID starting with 62a3266878d596b0fef9e2860df21eb9d22eda5d50110680ee608c9dfbf14e80 not found: ID does not exist" containerID="62a3266878d596b0fef9e2860df21eb9d22eda5d50110680ee608c9dfbf14e80" Mar 16 17:03:10 crc kubenswrapper[5120]: I0316 17:03:10.147429 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62a3266878d596b0fef9e2860df21eb9d22eda5d50110680ee608c9dfbf14e80"} err="failed to get container status \"62a3266878d596b0fef9e2860df21eb9d22eda5d50110680ee608c9dfbf14e80\": rpc error: code = NotFound desc = could not find container \"62a3266878d596b0fef9e2860df21eb9d22eda5d50110680ee608c9dfbf14e80\": container with ID starting with 62a3266878d596b0fef9e2860df21eb9d22eda5d50110680ee608c9dfbf14e80 not found: ID does not exist" Mar 16 17:03:10 crc kubenswrapper[5120]: I0316 17:03:10.147446 5120 scope.go:117] "RemoveContainer" containerID="a45c73e43a2af1fbab31a5e550d8f195e79c3fb48fa21fde2f0110195187fb5d" Mar 16 17:03:10 crc kubenswrapper[5120]: I0316 17:03:10.166846 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-f9be-account-create-update-hw8p5" Mar 16 17:03:10 crc kubenswrapper[5120]: I0316 17:03:10.290051 5120 scope.go:117] "RemoveContainer" containerID="f82629f3f06f61f322716632ababb5b1f77b592bcd127329124905e46f3cd013" Mar 16 17:03:10 crc kubenswrapper[5120]: I0316 17:03:10.310081 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-f9be-account-create-update-hw8p5"] Mar 16 17:03:10 crc kubenswrapper[5120]: I0316 17:03:10.311583 5120 scope.go:117] "RemoveContainer" containerID="7e14ea4540badd71cef4ac605d56c49684315345c8bdeeda628c416b54c1cea9" Mar 16 17:03:10 crc kubenswrapper[5120]: I0316 17:03:10.344949 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-f9be-account-create-update-hw8p5"] Mar 16 17:03:10 crc kubenswrapper[5120]: I0316 17:03:10.362701 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 17:03:10 crc kubenswrapper[5120]: I0316 17:03:10.372115 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 17:03:10 crc kubenswrapper[5120]: I0316 17:03:10.376942 5120 scope.go:117] "RemoveContainer" containerID="83be31383715b564797084ccaaeed9a369f6e39621cebb5bc24a90110996ed25" Mar 16 17:03:10 crc kubenswrapper[5120]: I0316 17:03:10.398011 5120 scope.go:117] "RemoveContainer" containerID="0ed9f3a2d7a1517b282f8c04f00429f887151e188250ed9748eecf16b6169afe" Mar 16 17:03:10 crc kubenswrapper[5120]: I0316 17:03:10.399741 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ggxks\" (UniqueName: \"kubernetes.io/projected/275f09d2-7564-4210-b204-f0614f780f7e-kube-api-access-ggxks\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:10 crc kubenswrapper[5120]: I0316 17:03:10.399782 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/275f09d2-7564-4210-b204-f0614f780f7e-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:10 crc kubenswrapper[5120]: I0316 17:03:10.528620 5120 scope.go:117] "RemoveContainer" containerID="89ed989b8115df3758641743f9e6a6179864cce17534df40660f0f8eea65c204" Mar 16 17:03:10 crc kubenswrapper[5120]: I0316 17:03:10.647973 5120 scope.go:117] "RemoveContainer" containerID="0cd4e5c12c13138cfe18452ae14adb071a83d9e94a0872236f28ec43b55bae15" Mar 16 17:03:10 crc kubenswrapper[5120]: I0316 17:03:10.681941 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="03d17609-c2ae-4dd1-b28d-4868bbcbe60f" path="/var/lib/kubelet/pods/03d17609-c2ae-4dd1-b28d-4868bbcbe60f/volumes" Mar 16 17:03:10 crc kubenswrapper[5120]: I0316 17:03:10.682966 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="13b65e37-9126-401e-9ef6-3e531453aaba" path="/var/lib/kubelet/pods/13b65e37-9126-401e-9ef6-3e531453aaba/volumes" Mar 16 17:03:10 crc kubenswrapper[5120]: I0316 17:03:10.683745 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="15389dad-1183-441e-831c-de27ba4bac6e" path="/var/lib/kubelet/pods/15389dad-1183-441e-831c-de27ba4bac6e/volumes" Mar 16 17:03:10 crc kubenswrapper[5120]: I0316 17:03:10.685065 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="20dac7f8-f03f-40f8-93f1-5ba59f5471b8" path="/var/lib/kubelet/pods/20dac7f8-f03f-40f8-93f1-5ba59f5471b8/volumes" Mar 16 17:03:10 crc kubenswrapper[5120]: I0316 17:03:10.685607 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="275f09d2-7564-4210-b204-f0614f780f7e" path="/var/lib/kubelet/pods/275f09d2-7564-4210-b204-f0614f780f7e/volumes" Mar 16 17:03:10 crc kubenswrapper[5120]: I0316 17:03:10.686196 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4740a262-b05d-4d08-a797-022ca51bbf69" path="/var/lib/kubelet/pods/4740a262-b05d-4d08-a797-022ca51bbf69/volumes" Mar 16 17:03:10 crc kubenswrapper[5120]: I0316 17:03:10.688178 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4ed551c0-3f37-4af6-b682-b9e35fd5fa42" path="/var/lib/kubelet/pods/4ed551c0-3f37-4af6-b682-b9e35fd5fa42/volumes" Mar 16 17:03:10 crc kubenswrapper[5120]: I0316 17:03:10.688954 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="53cbb212-f009-4d4e-90fc-9a50a14cc62b" path="/var/lib/kubelet/pods/53cbb212-f009-4d4e-90fc-9a50a14cc62b/volumes" Mar 16 17:03:10 crc kubenswrapper[5120]: I0316 17:03:10.689781 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="593ab600-83e5-4863-b042-4fd69af25046" path="/var/lib/kubelet/pods/593ab600-83e5-4863-b042-4fd69af25046/volumes" Mar 16 17:03:10 crc kubenswrapper[5120]: I0316 17:03:10.690055 5120 scope.go:117] "RemoveContainer" containerID="8db8e6076fafae9ba6b0baeae22182d94990be75ab4568d643d967c6e11582d6" Mar 16 17:03:10 crc kubenswrapper[5120]: I0316 17:03:10.698474 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b6e7f67-ee2d-4fbc-9519-00493157aec0" path="/var/lib/kubelet/pods/5b6e7f67-ee2d-4fbc-9519-00493157aec0/volumes" Mar 16 17:03:10 crc kubenswrapper[5120]: I0316 17:03:10.699827 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="61f313f6-217b-4ab6-aaf9-2b45cb201326" path="/var/lib/kubelet/pods/61f313f6-217b-4ab6-aaf9-2b45cb201326/volumes" Mar 16 17:03:10 crc kubenswrapper[5120]: I0316 17:03:10.700721 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="662e5dd1-e157-4e76-bb3d-f4310c982cb0" path="/var/lib/kubelet/pods/662e5dd1-e157-4e76-bb3d-f4310c982cb0/volumes" Mar 16 17:03:10 crc kubenswrapper[5120]: E0316 17:03:10.701655 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of c87cdce774051210b03731c88d545718b1887f3878a50a3fc79d5fc070ffb305 is running failed: container process not found" containerID="c87cdce774051210b03731c88d545718b1887f3878a50a3fc79d5fc070ffb305" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 17:03:10 crc kubenswrapper[5120]: E0316 17:03:10.703831 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of c87cdce774051210b03731c88d545718b1887f3878a50a3fc79d5fc070ffb305 is running failed: container process not found" containerID="c87cdce774051210b03731c88d545718b1887f3878a50a3fc79d5fc070ffb305" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 17:03:10 crc kubenswrapper[5120]: E0316 17:03:10.705339 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of c87cdce774051210b03731c88d545718b1887f3878a50a3fc79d5fc070ffb305 is running failed: container process not found" containerID="c87cdce774051210b03731c88d545718b1887f3878a50a3fc79d5fc070ffb305" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 17:03:10 crc kubenswrapper[5120]: E0316 17:03:10.705420 5120 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of c87cdce774051210b03731c88d545718b1887f3878a50a3fc79d5fc070ffb305 is running failed: container process not found" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="284dc632-d111-40d1-97a9-f6e78aa92ce7" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 17:03:10 crc kubenswrapper[5120]: I0316 17:03:10.728411 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="70e3d80b-ae48-4742-90dd-95c106254f9f" path="/var/lib/kubelet/pods/70e3d80b-ae48-4742-90dd-95c106254f9f/volumes" Mar 16 17:03:10 crc kubenswrapper[5120]: I0316 17:03:10.729904 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8d144169-a686-4862-8b52-7a945bc3a36a" path="/var/lib/kubelet/pods/8d144169-a686-4862-8b52-7a945bc3a36a/volumes" Mar 16 17:03:10 crc kubenswrapper[5120]: I0316 17:03:10.731499 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9822d70f-7496-4aa6-b0fa-28a1c4ae7db7" path="/var/lib/kubelet/pods/9822d70f-7496-4aa6-b0fa-28a1c4ae7db7/volumes" Mar 16 17:03:10 crc kubenswrapper[5120]: I0316 17:03:10.732872 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a2c4ebb0-3217-469c-88b5-b06d50a9db60" path="/var/lib/kubelet/pods/a2c4ebb0-3217-469c-88b5-b06d50a9db60/volumes" Mar 16 17:03:10 crc kubenswrapper[5120]: I0316 17:03:10.734999 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c88b7d39-fb86-490a-8af1-a6754dab05c9" path="/var/lib/kubelet/pods/c88b7d39-fb86-490a-8af1-a6754dab05c9/volumes" Mar 16 17:03:10 crc kubenswrapper[5120]: I0316 17:03:10.784966 5120 scope.go:117] "RemoveContainer" containerID="7b5294ca5bc91805a1a9b36d87be84b93cad56915950107a1c221f00497c2fb6" Mar 16 17:03:10 crc kubenswrapper[5120]: I0316 17:03:10.795556 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-6f96bb5df9-spfxv" Mar 16 17:03:10 crc kubenswrapper[5120]: I0316 17:03:10.800676 5120 scope.go:117] "RemoveContainer" containerID="0ed9f3a2d7a1517b282f8c04f00429f887151e188250ed9748eecf16b6169afe" Mar 16 17:03:10 crc kubenswrapper[5120]: E0316 17:03:10.801859 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0ed9f3a2d7a1517b282f8c04f00429f887151e188250ed9748eecf16b6169afe\": container with ID starting with 0ed9f3a2d7a1517b282f8c04f00429f887151e188250ed9748eecf16b6169afe not found: ID does not exist" containerID="0ed9f3a2d7a1517b282f8c04f00429f887151e188250ed9748eecf16b6169afe" Mar 16 17:03:10 crc kubenswrapper[5120]: I0316 17:03:10.801925 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ed9f3a2d7a1517b282f8c04f00429f887151e188250ed9748eecf16b6169afe"} err="failed to get container status \"0ed9f3a2d7a1517b282f8c04f00429f887151e188250ed9748eecf16b6169afe\": rpc error: code = NotFound desc = could not find container \"0ed9f3a2d7a1517b282f8c04f00429f887151e188250ed9748eecf16b6169afe\": container with ID starting with 0ed9f3a2d7a1517b282f8c04f00429f887151e188250ed9748eecf16b6169afe not found: ID does not exist" Mar 16 17:03:10 crc kubenswrapper[5120]: I0316 17:03:10.801987 5120 scope.go:117] "RemoveContainer" containerID="0cd4e5c12c13138cfe18452ae14adb071a83d9e94a0872236f28ec43b55bae15" Mar 16 17:03:10 crc kubenswrapper[5120]: E0316 17:03:10.802750 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0cd4e5c12c13138cfe18452ae14adb071a83d9e94a0872236f28ec43b55bae15\": container with ID starting with 0cd4e5c12c13138cfe18452ae14adb071a83d9e94a0872236f28ec43b55bae15 not found: ID does not exist" containerID="0cd4e5c12c13138cfe18452ae14adb071a83d9e94a0872236f28ec43b55bae15" Mar 16 17:03:10 crc kubenswrapper[5120]: I0316 17:03:10.802795 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0cd4e5c12c13138cfe18452ae14adb071a83d9e94a0872236f28ec43b55bae15"} err="failed to get container status \"0cd4e5c12c13138cfe18452ae14adb071a83d9e94a0872236f28ec43b55bae15\": rpc error: code = NotFound desc = could not find container \"0cd4e5c12c13138cfe18452ae14adb071a83d9e94a0872236f28ec43b55bae15\": container with ID starting with 0cd4e5c12c13138cfe18452ae14adb071a83d9e94a0872236f28ec43b55bae15 not found: ID does not exist" Mar 16 17:03:10 crc kubenswrapper[5120]: I0316 17:03:10.802809 5120 scope.go:117] "RemoveContainer" containerID="66f4292cc65d6c8fdd967ff988b50c682f3d1dd97a48df06d9e5a314aa95e2f0" Mar 16 17:03:10 crc kubenswrapper[5120]: I0316 17:03:10.809451 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/fb7a2068-5a18-4c7b-92d0-364f371d59df-config-data-custom\") pod \"fb7a2068-5a18-4c7b-92d0-364f371d59df\" (UID: \"fb7a2068-5a18-4c7b-92d0-364f371d59df\") " Mar 16 17:03:10 crc kubenswrapper[5120]: I0316 17:03:10.809519 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-htrkw\" (UniqueName: \"kubernetes.io/projected/fb7a2068-5a18-4c7b-92d0-364f371d59df-kube-api-access-htrkw\") pod \"fb7a2068-5a18-4c7b-92d0-364f371d59df\" (UID: \"fb7a2068-5a18-4c7b-92d0-364f371d59df\") " Mar 16 17:03:10 crc kubenswrapper[5120]: I0316 17:03:10.809612 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fb7a2068-5a18-4c7b-92d0-364f371d59df-config-data\") pod \"fb7a2068-5a18-4c7b-92d0-364f371d59df\" (UID: \"fb7a2068-5a18-4c7b-92d0-364f371d59df\") " Mar 16 17:03:10 crc kubenswrapper[5120]: I0316 17:03:10.809706 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/fb7a2068-5a18-4c7b-92d0-364f371d59df-logs\") pod \"fb7a2068-5a18-4c7b-92d0-364f371d59df\" (UID: \"fb7a2068-5a18-4c7b-92d0-364f371d59df\") " Mar 16 17:03:10 crc kubenswrapper[5120]: I0316 17:03:10.810225 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fb7a2068-5a18-4c7b-92d0-364f371d59df-combined-ca-bundle\") pod \"fb7a2068-5a18-4c7b-92d0-364f371d59df\" (UID: \"fb7a2068-5a18-4c7b-92d0-364f371d59df\") " Mar 16 17:03:10 crc kubenswrapper[5120]: I0316 17:03:10.811967 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb7a2068-5a18-4c7b-92d0-364f371d59df-logs" (OuterVolumeSpecName: "logs") pod "fb7a2068-5a18-4c7b-92d0-364f371d59df" (UID: "fb7a2068-5a18-4c7b-92d0-364f371d59df"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:03:10 crc kubenswrapper[5120]: I0316 17:03:10.821147 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb7a2068-5a18-4c7b-92d0-364f371d59df-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "fb7a2068-5a18-4c7b-92d0-364f371d59df" (UID: "fb7a2068-5a18-4c7b-92d0-364f371d59df"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:03:10 crc kubenswrapper[5120]: I0316 17:03:10.823786 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-northd-0_615448b7-8677-4a99-93ba-64a2388a6dcc/ovn-northd/0.log" Mar 16 17:03:10 crc kubenswrapper[5120]: I0316 17:03:10.823862 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:03:10 crc kubenswrapper[5120]: I0316 17:03:10.838378 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb7a2068-5a18-4c7b-92d0-364f371d59df-kube-api-access-htrkw" (OuterVolumeSpecName: "kube-api-access-htrkw") pod "fb7a2068-5a18-4c7b-92d0-364f371d59df" (UID: "fb7a2068-5a18-4c7b-92d0-364f371d59df"). InnerVolumeSpecName "kube-api-access-htrkw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:03:10 crc kubenswrapper[5120]: I0316 17:03:10.839270 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb7a2068-5a18-4c7b-92d0-364f371d59df-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "fb7a2068-5a18-4c7b-92d0-364f371d59df" (UID: "fb7a2068-5a18-4c7b-92d0-364f371d59df"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:03:10 crc kubenswrapper[5120]: I0316 17:03:10.846703 5120 scope.go:117] "RemoveContainer" containerID="d14ac2dba32d1f9dc4677dff3df7613d2465c455461e222dedd3cc507f276a58" Mar 16 17:03:10 crc kubenswrapper[5120]: I0316 17:03:10.863545 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/keystone-766c6fc56d-x6dc5" podUID="532a5c65-05a2-4018-9244-1386bf31dcb2" containerName="keystone-api" probeResult="failure" output="Get \"https://10.217.1.107:5000/v3\": read tcp 10.217.0.2:39698->10.217.1.107:5000: read: connection reset by peer" Mar 16 17:03:10 crc kubenswrapper[5120]: I0316 17:03:10.892573 5120 scope.go:117] "RemoveContainer" containerID="d68fde987d845f07c8612dff8547b520bbcb4c17c138b2e4f5426a89fc2faaf5" Mar 16 17:03:10 crc kubenswrapper[5120]: I0316 17:03:10.911992 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/615448b7-8677-4a99-93ba-64a2388a6dcc-metrics-certs-tls-certs\") pod \"615448b7-8677-4a99-93ba-64a2388a6dcc\" (UID: \"615448b7-8677-4a99-93ba-64a2388a6dcc\") " Mar 16 17:03:10 crc kubenswrapper[5120]: I0316 17:03:10.912091 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9pxj9\" (UniqueName: \"kubernetes.io/projected/615448b7-8677-4a99-93ba-64a2388a6dcc-kube-api-access-9pxj9\") pod \"615448b7-8677-4a99-93ba-64a2388a6dcc\" (UID: \"615448b7-8677-4a99-93ba-64a2388a6dcc\") " Mar 16 17:03:10 crc kubenswrapper[5120]: I0316 17:03:10.912121 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/615448b7-8677-4a99-93ba-64a2388a6dcc-ovn-northd-tls-certs\") pod \"615448b7-8677-4a99-93ba-64a2388a6dcc\" (UID: \"615448b7-8677-4a99-93ba-64a2388a6dcc\") " Mar 16 17:03:10 crc kubenswrapper[5120]: I0316 17:03:10.912194 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/615448b7-8677-4a99-93ba-64a2388a6dcc-ovn-rundir\") pod \"615448b7-8677-4a99-93ba-64a2388a6dcc\" (UID: \"615448b7-8677-4a99-93ba-64a2388a6dcc\") " Mar 16 17:03:10 crc kubenswrapper[5120]: I0316 17:03:10.912214 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/615448b7-8677-4a99-93ba-64a2388a6dcc-config\") pod \"615448b7-8677-4a99-93ba-64a2388a6dcc\" (UID: \"615448b7-8677-4a99-93ba-64a2388a6dcc\") " Mar 16 17:03:10 crc kubenswrapper[5120]: I0316 17:03:10.912270 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/615448b7-8677-4a99-93ba-64a2388a6dcc-scripts\") pod \"615448b7-8677-4a99-93ba-64a2388a6dcc\" (UID: \"615448b7-8677-4a99-93ba-64a2388a6dcc\") " Mar 16 17:03:10 crc kubenswrapper[5120]: I0316 17:03:10.912325 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/615448b7-8677-4a99-93ba-64a2388a6dcc-combined-ca-bundle\") pod \"615448b7-8677-4a99-93ba-64a2388a6dcc\" (UID: \"615448b7-8677-4a99-93ba-64a2388a6dcc\") " Mar 16 17:03:10 crc kubenswrapper[5120]: I0316 17:03:10.912839 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/fb7a2068-5a18-4c7b-92d0-364f371d59df-logs\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:10 crc kubenswrapper[5120]: I0316 17:03:10.912854 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fb7a2068-5a18-4c7b-92d0-364f371d59df-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:10 crc kubenswrapper[5120]: I0316 17:03:10.912864 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/fb7a2068-5a18-4c7b-92d0-364f371d59df-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:10 crc kubenswrapper[5120]: I0316 17:03:10.912873 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-htrkw\" (UniqueName: \"kubernetes.io/projected/fb7a2068-5a18-4c7b-92d0-364f371d59df-kube-api-access-htrkw\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:10 crc kubenswrapper[5120]: I0316 17:03:10.913300 5120 scope.go:117] "RemoveContainer" containerID="0e7949a684f8f8fe500457e72cc4e4823aa78b079b839cbf757031b0c431a0bc" Mar 16 17:03:10 crc kubenswrapper[5120]: I0316 17:03:10.914265 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/615448b7-8677-4a99-93ba-64a2388a6dcc-scripts" (OuterVolumeSpecName: "scripts") pod "615448b7-8677-4a99-93ba-64a2388a6dcc" (UID: "615448b7-8677-4a99-93ba-64a2388a6dcc"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:03:10 crc kubenswrapper[5120]: I0316 17:03:10.914440 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/615448b7-8677-4a99-93ba-64a2388a6dcc-ovn-rundir" (OuterVolumeSpecName: "ovn-rundir") pod "615448b7-8677-4a99-93ba-64a2388a6dcc" (UID: "615448b7-8677-4a99-93ba-64a2388a6dcc"). InnerVolumeSpecName "ovn-rundir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:03:10 crc kubenswrapper[5120]: I0316 17:03:10.914605 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/615448b7-8677-4a99-93ba-64a2388a6dcc-config" (OuterVolumeSpecName: "config") pod "615448b7-8677-4a99-93ba-64a2388a6dcc" (UID: "615448b7-8677-4a99-93ba-64a2388a6dcc"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:03:10 crc kubenswrapper[5120]: I0316 17:03:10.916631 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb7a2068-5a18-4c7b-92d0-364f371d59df-config-data" (OuterVolumeSpecName: "config-data") pod "fb7a2068-5a18-4c7b-92d0-364f371d59df" (UID: "fb7a2068-5a18-4c7b-92d0-364f371d59df"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:03:10 crc kubenswrapper[5120]: I0316 17:03:10.940579 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/615448b7-8677-4a99-93ba-64a2388a6dcc-kube-api-access-9pxj9" (OuterVolumeSpecName: "kube-api-access-9pxj9") pod "615448b7-8677-4a99-93ba-64a2388a6dcc" (UID: "615448b7-8677-4a99-93ba-64a2388a6dcc"). InnerVolumeSpecName "kube-api-access-9pxj9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:03:10 crc kubenswrapper[5120]: I0316 17:03:10.963384 5120 scope.go:117] "RemoveContainer" containerID="7a0e860743d15f4f4b72328ec610b6dc439ff5bf46e14ab6366068df1d13ca98" Mar 16 17:03:10 crc kubenswrapper[5120]: I0316 17:03:10.964736 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/615448b7-8677-4a99-93ba-64a2388a6dcc-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "615448b7-8677-4a99-93ba-64a2388a6dcc" (UID: "615448b7-8677-4a99-93ba-64a2388a6dcc"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:03:10 crc kubenswrapper[5120]: I0316 17:03:10.982950 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/615448b7-8677-4a99-93ba-64a2388a6dcc-ovn-northd-tls-certs" (OuterVolumeSpecName: "ovn-northd-tls-certs") pod "615448b7-8677-4a99-93ba-64a2388a6dcc" (UID: "615448b7-8677-4a99-93ba-64a2388a6dcc"). InnerVolumeSpecName "ovn-northd-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:03:10 crc kubenswrapper[5120]: I0316 17:03:10.994139 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/615448b7-8677-4a99-93ba-64a2388a6dcc-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "615448b7-8677-4a99-93ba-64a2388a6dcc" (UID: "615448b7-8677-4a99-93ba-64a2388a6dcc"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.014348 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.014754 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/615448b7-8677-4a99-93ba-64a2388a6dcc-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.014814 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/615448b7-8677-4a99-93ba-64a2388a6dcc-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.014830 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fb7a2068-5a18-4c7b-92d0-364f371d59df-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.014847 5120 reconciler_common.go:299] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/615448b7-8677-4a99-93ba-64a2388a6dcc-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.014860 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9pxj9\" (UniqueName: \"kubernetes.io/projected/615448b7-8677-4a99-93ba-64a2388a6dcc-kube-api-access-9pxj9\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.014872 5120 reconciler_common.go:299] "Volume detached for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/615448b7-8677-4a99-93ba-64a2388a6dcc-ovn-northd-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.014883 5120 reconciler_common.go:299] "Volume detached for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/615448b7-8677-4a99-93ba-64a2388a6dcc-ovn-rundir\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.014895 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/615448b7-8677-4a99-93ba-64a2388a6dcc-config\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.115779 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/279c3e84-623c-4c5f-ae15-d7d8c439c4dc-pod-info\") pod \"279c3e84-623c-4c5f-ae15-d7d8c439c4dc\" (UID: \"279c3e84-623c-4c5f-ae15-d7d8c439c4dc\") " Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.115862 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/279c3e84-623c-4c5f-ae15-d7d8c439c4dc-rabbitmq-confd\") pod \"279c3e84-623c-4c5f-ae15-d7d8c439c4dc\" (UID: \"279c3e84-623c-4c5f-ae15-d7d8c439c4dc\") " Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.115954 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/279c3e84-623c-4c5f-ae15-d7d8c439c4dc-server-conf\") pod \"279c3e84-623c-4c5f-ae15-d7d8c439c4dc\" (UID: \"279c3e84-623c-4c5f-ae15-d7d8c439c4dc\") " Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.116203 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jq5rg\" (UniqueName: \"kubernetes.io/projected/279c3e84-623c-4c5f-ae15-d7d8c439c4dc-kube-api-access-jq5rg\") pod \"279c3e84-623c-4c5f-ae15-d7d8c439c4dc\" (UID: \"279c3e84-623c-4c5f-ae15-d7d8c439c4dc\") " Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.117035 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/279c3e84-623c-4c5f-ae15-d7d8c439c4dc-plugins-conf\") pod \"279c3e84-623c-4c5f-ae15-d7d8c439c4dc\" (UID: \"279c3e84-623c-4c5f-ae15-d7d8c439c4dc\") " Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.117115 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/279c3e84-623c-4c5f-ae15-d7d8c439c4dc-rabbitmq-tls\") pod \"279c3e84-623c-4c5f-ae15-d7d8c439c4dc\" (UID: \"279c3e84-623c-4c5f-ae15-d7d8c439c4dc\") " Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.117170 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/279c3e84-623c-4c5f-ae15-d7d8c439c4dc-rabbitmq-erlang-cookie\") pod \"279c3e84-623c-4c5f-ae15-d7d8c439c4dc\" (UID: \"279c3e84-623c-4c5f-ae15-d7d8c439c4dc\") " Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.117191 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/279c3e84-623c-4c5f-ae15-d7d8c439c4dc-erlang-cookie-secret\") pod \"279c3e84-623c-4c5f-ae15-d7d8c439c4dc\" (UID: \"279c3e84-623c-4c5f-ae15-d7d8c439c4dc\") " Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.117274 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/279c3e84-623c-4c5f-ae15-d7d8c439c4dc-rabbitmq-plugins\") pod \"279c3e84-623c-4c5f-ae15-d7d8c439c4dc\" (UID: \"279c3e84-623c-4c5f-ae15-d7d8c439c4dc\") " Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.117323 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"persistence\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"279c3e84-623c-4c5f-ae15-d7d8c439c4dc\" (UID: \"279c3e84-623c-4c5f-ae15-d7d8c439c4dc\") " Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.117385 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/279c3e84-623c-4c5f-ae15-d7d8c439c4dc-config-data\") pod \"279c3e84-623c-4c5f-ae15-d7d8c439c4dc\" (UID: \"279c3e84-623c-4c5f-ae15-d7d8c439c4dc\") " Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.119606 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/279c3e84-623c-4c5f-ae15-d7d8c439c4dc-rabbitmq-erlang-cookie" (OuterVolumeSpecName: "rabbitmq-erlang-cookie") pod "279c3e84-623c-4c5f-ae15-d7d8c439c4dc" (UID: "279c3e84-623c-4c5f-ae15-d7d8c439c4dc"). InnerVolumeSpecName "rabbitmq-erlang-cookie". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.120086 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/279c3e84-623c-4c5f-ae15-d7d8c439c4dc-plugins-conf" (OuterVolumeSpecName: "plugins-conf") pod "279c3e84-623c-4c5f-ae15-d7d8c439c4dc" (UID: "279c3e84-623c-4c5f-ae15-d7d8c439c4dc"). InnerVolumeSpecName "plugins-conf". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.122376 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/279c3e84-623c-4c5f-ae15-d7d8c439c4dc-kube-api-access-jq5rg" (OuterVolumeSpecName: "kube-api-access-jq5rg") pod "279c3e84-623c-4c5f-ae15-d7d8c439c4dc" (UID: "279c3e84-623c-4c5f-ae15-d7d8c439c4dc"). InnerVolumeSpecName "kube-api-access-jq5rg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.123630 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/279c3e84-623c-4c5f-ae15-d7d8c439c4dc-pod-info" (OuterVolumeSpecName: "pod-info") pod "279c3e84-623c-4c5f-ae15-d7d8c439c4dc" (UID: "279c3e84-623c-4c5f-ae15-d7d8c439c4dc"). InnerVolumeSpecName "pod-info". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.125081 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/279c3e84-623c-4c5f-ae15-d7d8c439c4dc-rabbitmq-plugins" (OuterVolumeSpecName: "rabbitmq-plugins") pod "279c3e84-623c-4c5f-ae15-d7d8c439c4dc" (UID: "279c3e84-623c-4c5f-ae15-d7d8c439c4dc"). InnerVolumeSpecName "rabbitmq-plugins". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.125312 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage02-crc" (OuterVolumeSpecName: "persistence") pod "279c3e84-623c-4c5f-ae15-d7d8c439c4dc" (UID: "279c3e84-623c-4c5f-ae15-d7d8c439c4dc"). InnerVolumeSpecName "local-storage02-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.126062 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/279c3e84-623c-4c5f-ae15-d7d8c439c4dc-erlang-cookie-secret" (OuterVolumeSpecName: "erlang-cookie-secret") pod "279c3e84-623c-4c5f-ae15-d7d8c439c4dc" (UID: "279c3e84-623c-4c5f-ae15-d7d8c439c4dc"). InnerVolumeSpecName "erlang-cookie-secret". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.133379 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/279c3e84-623c-4c5f-ae15-d7d8c439c4dc-rabbitmq-tls" (OuterVolumeSpecName: "rabbitmq-tls") pod "279c3e84-623c-4c5f-ae15-d7d8c439c4dc" (UID: "279c3e84-623c-4c5f-ae15-d7d8c439c4dc"). InnerVolumeSpecName "rabbitmq-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.143586 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/279c3e84-623c-4c5f-ae15-d7d8c439c4dc-config-data" (OuterVolumeSpecName: "config-data") pod "279c3e84-623c-4c5f-ae15-d7d8c439c4dc" (UID: "279c3e84-623c-4c5f-ae15-d7d8c439c4dc"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.161278 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/279c3e84-623c-4c5f-ae15-d7d8c439c4dc-server-conf" (OuterVolumeSpecName: "server-conf") pod "279c3e84-623c-4c5f-ae15-d7d8c439c4dc" (UID: "279c3e84-623c-4c5f-ae15-d7d8c439c4dc"). InnerVolumeSpecName "server-conf". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.181028 5120 generic.go:358] "Generic (PLEG): container finished" podID="d226072d-5d81-4c83-ade7-29bdc1df4c80" containerID="332dae2edfbf2e0f756cde2904bec2d8bbc2240aa37e84431e89ca72362d5c89" exitCode=0 Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.181159 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"d226072d-5d81-4c83-ade7-29bdc1df4c80","Type":"ContainerDied","Data":"332dae2edfbf2e0f756cde2904bec2d8bbc2240aa37e84431e89ca72362d5c89"} Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.185026 5120 generic.go:358] "Generic (PLEG): container finished" podID="284dc632-d111-40d1-97a9-f6e78aa92ce7" containerID="c87cdce774051210b03731c88d545718b1887f3878a50a3fc79d5fc070ffb305" exitCode=0 Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.185108 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"284dc632-d111-40d1-97a9-f6e78aa92ce7","Type":"ContainerDied","Data":"c87cdce774051210b03731c88d545718b1887f3878a50a3fc79d5fc070ffb305"} Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.185522 5120 scope.go:117] "RemoveContainer" containerID="d4f5205995b7c25196e08d7776a3216b01adf4671787cdf98654a2ac9fa24504" Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.209677 5120 generic.go:358] "Generic (PLEG): container finished" podID="279c3e84-623c-4c5f-ae15-d7d8c439c4dc" containerID="f74ecc023217184e5ac69eafc7250f1064a8b35dbd565a66ef8fc760056c5822" exitCode=0 Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.209809 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"279c3e84-623c-4c5f-ae15-d7d8c439c4dc","Type":"ContainerDied","Data":"f74ecc023217184e5ac69eafc7250f1064a8b35dbd565a66ef8fc760056c5822"} Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.209843 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"279c3e84-623c-4c5f-ae15-d7d8c439c4dc","Type":"ContainerDied","Data":"84776e61ff8397ceb9581ef5900d3e9c875d0757323432043de6ed5e713e754a"} Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.209957 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.220062 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jq5rg\" (UniqueName: \"kubernetes.io/projected/279c3e84-623c-4c5f-ae15-d7d8c439c4dc-kube-api-access-jq5rg\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.220098 5120 reconciler_common.go:299] "Volume detached for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/279c3e84-623c-4c5f-ae15-d7d8c439c4dc-plugins-conf\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.220112 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/279c3e84-623c-4c5f-ae15-d7d8c439c4dc-rabbitmq-tls\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.220125 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/279c3e84-623c-4c5f-ae15-d7d8c439c4dc-rabbitmq-erlang-cookie\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.220137 5120 reconciler_common.go:299] "Volume detached for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/279c3e84-623c-4c5f-ae15-d7d8c439c4dc-erlang-cookie-secret\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.220149 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/279c3e84-623c-4c5f-ae15-d7d8c439c4dc-rabbitmq-plugins\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.220189 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") on node \"crc\" " Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.220202 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/279c3e84-623c-4c5f-ae15-d7d8c439c4dc-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.220213 5120 reconciler_common.go:299] "Volume detached for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/279c3e84-623c-4c5f-ae15-d7d8c439c4dc-pod-info\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.220226 5120 reconciler_common.go:299] "Volume detached for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/279c3e84-623c-4c5f-ae15-d7d8c439c4dc-server-conf\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.226388 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/279c3e84-623c-4c5f-ae15-d7d8c439c4dc-rabbitmq-confd" (OuterVolumeSpecName: "rabbitmq-confd") pod "279c3e84-623c-4c5f-ae15-d7d8c439c4dc" (UID: "279c3e84-623c-4c5f-ae15-d7d8c439c4dc"). InnerVolumeSpecName "rabbitmq-confd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.226637 5120 scope.go:117] "RemoveContainer" containerID="f383084e950ec66f2be11165fb0d97fda3fc931351dce751484c16b2cba1669c" Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.237308 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-northd-0_615448b7-8677-4a99-93ba-64a2388a6dcc/ovn-northd/0.log" Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.237369 5120 generic.go:358] "Generic (PLEG): container finished" podID="615448b7-8677-4a99-93ba-64a2388a6dcc" containerID="f7c63580126db55650667f8bc05d59546a627363558e5c5f426c2752ec02efd8" exitCode=139 Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.237554 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.237782 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"615448b7-8677-4a99-93ba-64a2388a6dcc","Type":"ContainerDied","Data":"f7c63580126db55650667f8bc05d59546a627363558e5c5f426c2752ec02efd8"} Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.237823 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"615448b7-8677-4a99-93ba-64a2388a6dcc","Type":"ContainerDied","Data":"6aa06a1c8ea1e04a955109eac76fc4835dd6b36a46467c4ef7e69cf61c54dd1c"} Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.252188 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.254342 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage02-crc" (UniqueName: "kubernetes.io/local-volume/local-storage02-crc") on node "crc" Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.261157 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.261209 5120 scope.go:117] "RemoveContainer" containerID="d47416d19c007d5e7463c5d7c2361ba15d54663b2f0d53a6f0405c998c85ed69" Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.265757 5120 generic.go:358] "Generic (PLEG): container finished" podID="fb7a2068-5a18-4c7b-92d0-364f371d59df" containerID="98b7269dea85c50b3653f02d53c97085506d9cf74a457e4aee7380d97d30f5ed" exitCode=0 Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.265871 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-6f96bb5df9-spfxv" event={"ID":"fb7a2068-5a18-4c7b-92d0-364f371d59df","Type":"ContainerDied","Data":"98b7269dea85c50b3653f02d53c97085506d9cf74a457e4aee7380d97d30f5ed"} Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.265897 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-6f96bb5df9-spfxv" event={"ID":"fb7a2068-5a18-4c7b-92d0-364f371d59df","Type":"ContainerDied","Data":"bb4f2020b4cf1c075336e44a312cfee2c0c3a80e3fc6ec031e9744eca9de1bbb"} Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.265962 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-6f96bb5df9-spfxv" Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.275902 5120 generic.go:358] "Generic (PLEG): container finished" podID="532a5c65-05a2-4018-9244-1386bf31dcb2" containerID="f3475d302eda9b8f9f995f9084c858803d1f137a09ef9c3b6af35d343d7090c1" exitCode=0 Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.276007 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-766c6fc56d-x6dc5" event={"ID":"532a5c65-05a2-4018-9244-1386bf31dcb2","Type":"ContainerDied","Data":"f3475d302eda9b8f9f995f9084c858803d1f137a09ef9c3b6af35d343d7090c1"} Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.289521 5120 scope.go:117] "RemoveContainer" containerID="0e683e08d610b917770dfb8f5571d3b014df83f34754cc5c199e9efb9e29f138" Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.323909 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d226072d-5d81-4c83-ade7-29bdc1df4c80-config-data\") pod \"d226072d-5d81-4c83-ade7-29bdc1df4c80\" (UID: \"d226072d-5d81-4c83-ade7-29bdc1df4c80\") " Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.324112 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2jc7x\" (UniqueName: \"kubernetes.io/projected/284dc632-d111-40d1-97a9-f6e78aa92ce7-kube-api-access-2jc7x\") pod \"284dc632-d111-40d1-97a9-f6e78aa92ce7\" (UID: \"284dc632-d111-40d1-97a9-f6e78aa92ce7\") " Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.324314 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/284dc632-d111-40d1-97a9-f6e78aa92ce7-combined-ca-bundle\") pod \"284dc632-d111-40d1-97a9-f6e78aa92ce7\" (UID: \"284dc632-d111-40d1-97a9-f6e78aa92ce7\") " Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.324514 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/284dc632-d111-40d1-97a9-f6e78aa92ce7-config-data\") pod \"284dc632-d111-40d1-97a9-f6e78aa92ce7\" (UID: \"284dc632-d111-40d1-97a9-f6e78aa92ce7\") " Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.324550 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d226072d-5d81-4c83-ade7-29bdc1df4c80-combined-ca-bundle\") pod \"d226072d-5d81-4c83-ade7-29bdc1df4c80\" (UID: \"d226072d-5d81-4c83-ade7-29bdc1df4c80\") " Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.324796 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jpsxp\" (UniqueName: \"kubernetes.io/projected/d226072d-5d81-4c83-ade7-29bdc1df4c80-kube-api-access-jpsxp\") pod \"d226072d-5d81-4c83-ade7-29bdc1df4c80\" (UID: \"d226072d-5d81-4c83-ade7-29bdc1df4c80\") " Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.329008 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/284dc632-d111-40d1-97a9-f6e78aa92ce7-kube-api-access-2jc7x" (OuterVolumeSpecName: "kube-api-access-2jc7x") pod "284dc632-d111-40d1-97a9-f6e78aa92ce7" (UID: "284dc632-d111-40d1-97a9-f6e78aa92ce7"). InnerVolumeSpecName "kube-api-access-2jc7x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.329231 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2jc7x\" (UniqueName: \"kubernetes.io/projected/284dc632-d111-40d1-97a9-f6e78aa92ce7-kube-api-access-2jc7x\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.329295 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.329314 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/279c3e84-623c-4c5f-ae15-d7d8c439c4dc-rabbitmq-confd\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.331271 5120 scope.go:117] "RemoveContainer" containerID="7db690f4e8657183593f140a6de766cbf0ca9328b7cddc3663a1eba439f6b653" Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.331473 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.332551 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d226072d-5d81-4c83-ade7-29bdc1df4c80-kube-api-access-jpsxp" (OuterVolumeSpecName: "kube-api-access-jpsxp") pod "d226072d-5d81-4c83-ade7-29bdc1df4c80" (UID: "d226072d-5d81-4c83-ade7-29bdc1df4c80"). InnerVolumeSpecName "kube-api-access-jpsxp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.342959 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.349267 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d226072d-5d81-4c83-ade7-29bdc1df4c80-config-data" (OuterVolumeSpecName: "config-data") pod "d226072d-5d81-4c83-ade7-29bdc1df4c80" (UID: "d226072d-5d81-4c83-ade7-29bdc1df4c80"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.349602 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/284dc632-d111-40d1-97a9-f6e78aa92ce7-config-data" (OuterVolumeSpecName: "config-data") pod "284dc632-d111-40d1-97a9-f6e78aa92ce7" (UID: "284dc632-d111-40d1-97a9-f6e78aa92ce7"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.350073 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/284dc632-d111-40d1-97a9-f6e78aa92ce7-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "284dc632-d111-40d1-97a9-f6e78aa92ce7" (UID: "284dc632-d111-40d1-97a9-f6e78aa92ce7"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.353915 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d226072d-5d81-4c83-ade7-29bdc1df4c80-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "d226072d-5d81-4c83-ade7-29bdc1df4c80" (UID: "d226072d-5d81-4c83-ade7-29bdc1df4c80"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.357884 5120 scope.go:117] "RemoveContainer" containerID="6f3d5d660208c4b004ec65401f0ef1985dc6cff4ffcc709cf989fcdfe929481e" Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.359875 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-6f96bb5df9-spfxv"] Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.368519 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-worker-6f96bb5df9-spfxv"] Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.372043 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-766c6fc56d-x6dc5" Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.430619 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/532a5c65-05a2-4018-9244-1386bf31dcb2-fernet-keys\") pod \"532a5c65-05a2-4018-9244-1386bf31dcb2\" (UID: \"532a5c65-05a2-4018-9244-1386bf31dcb2\") " Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.430787 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/532a5c65-05a2-4018-9244-1386bf31dcb2-credential-keys\") pod \"532a5c65-05a2-4018-9244-1386bf31dcb2\" (UID: \"532a5c65-05a2-4018-9244-1386bf31dcb2\") " Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.430830 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/532a5c65-05a2-4018-9244-1386bf31dcb2-internal-tls-certs\") pod \"532a5c65-05a2-4018-9244-1386bf31dcb2\" (UID: \"532a5c65-05a2-4018-9244-1386bf31dcb2\") " Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.430999 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/532a5c65-05a2-4018-9244-1386bf31dcb2-public-tls-certs\") pod \"532a5c65-05a2-4018-9244-1386bf31dcb2\" (UID: \"532a5c65-05a2-4018-9244-1386bf31dcb2\") " Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.431088 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/532a5c65-05a2-4018-9244-1386bf31dcb2-config-data\") pod \"532a5c65-05a2-4018-9244-1386bf31dcb2\" (UID: \"532a5c65-05a2-4018-9244-1386bf31dcb2\") " Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.431178 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ph628\" (UniqueName: \"kubernetes.io/projected/532a5c65-05a2-4018-9244-1386bf31dcb2-kube-api-access-ph628\") pod \"532a5c65-05a2-4018-9244-1386bf31dcb2\" (UID: \"532a5c65-05a2-4018-9244-1386bf31dcb2\") " Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.431222 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/532a5c65-05a2-4018-9244-1386bf31dcb2-scripts\") pod \"532a5c65-05a2-4018-9244-1386bf31dcb2\" (UID: \"532a5c65-05a2-4018-9244-1386bf31dcb2\") " Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.431257 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/532a5c65-05a2-4018-9244-1386bf31dcb2-combined-ca-bundle\") pod \"532a5c65-05a2-4018-9244-1386bf31dcb2\" (UID: \"532a5c65-05a2-4018-9244-1386bf31dcb2\") " Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.431651 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d226072d-5d81-4c83-ade7-29bdc1df4c80-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.431672 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/284dc632-d111-40d1-97a9-f6e78aa92ce7-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.431681 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/284dc632-d111-40d1-97a9-f6e78aa92ce7-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.431690 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d226072d-5d81-4c83-ade7-29bdc1df4c80-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.431700 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jpsxp\" (UniqueName: \"kubernetes.io/projected/d226072d-5d81-4c83-ade7-29bdc1df4c80-kube-api-access-jpsxp\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.436409 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/532a5c65-05a2-4018-9244-1386bf31dcb2-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "532a5c65-05a2-4018-9244-1386bf31dcb2" (UID: "532a5c65-05a2-4018-9244-1386bf31dcb2"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.437454 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/532a5c65-05a2-4018-9244-1386bf31dcb2-kube-api-access-ph628" (OuterVolumeSpecName: "kube-api-access-ph628") pod "532a5c65-05a2-4018-9244-1386bf31dcb2" (UID: "532a5c65-05a2-4018-9244-1386bf31dcb2"). InnerVolumeSpecName "kube-api-access-ph628". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.438520 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/532a5c65-05a2-4018-9244-1386bf31dcb2-scripts" (OuterVolumeSpecName: "scripts") pod "532a5c65-05a2-4018-9244-1386bf31dcb2" (UID: "532a5c65-05a2-4018-9244-1386bf31dcb2"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.441696 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/532a5c65-05a2-4018-9244-1386bf31dcb2-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "532a5c65-05a2-4018-9244-1386bf31dcb2" (UID: "532a5c65-05a2-4018-9244-1386bf31dcb2"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.455830 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/532a5c65-05a2-4018-9244-1386bf31dcb2-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "532a5c65-05a2-4018-9244-1386bf31dcb2" (UID: "532a5c65-05a2-4018-9244-1386bf31dcb2"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.467707 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/532a5c65-05a2-4018-9244-1386bf31dcb2-config-data" (OuterVolumeSpecName: "config-data") pod "532a5c65-05a2-4018-9244-1386bf31dcb2" (UID: "532a5c65-05a2-4018-9244-1386bf31dcb2"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.486566 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/532a5c65-05a2-4018-9244-1386bf31dcb2-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "532a5c65-05a2-4018-9244-1386bf31dcb2" (UID: "532a5c65-05a2-4018-9244-1386bf31dcb2"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.490367 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/532a5c65-05a2-4018-9244-1386bf31dcb2-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "532a5c65-05a2-4018-9244-1386bf31dcb2" (UID: "532a5c65-05a2-4018-9244-1386bf31dcb2"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.499403 5120 scope.go:117] "RemoveContainer" containerID="c9d647c877cad46f80f83f0a8eec094f4e3b21c9820b23c8345a5a7561869a78" Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.533825 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/532a5c65-05a2-4018-9244-1386bf31dcb2-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.533865 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ph628\" (UniqueName: \"kubernetes.io/projected/532a5c65-05a2-4018-9244-1386bf31dcb2-kube-api-access-ph628\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.533878 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/532a5c65-05a2-4018-9244-1386bf31dcb2-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.533893 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/532a5c65-05a2-4018-9244-1386bf31dcb2-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.533906 5120 reconciler_common.go:299] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/532a5c65-05a2-4018-9244-1386bf31dcb2-fernet-keys\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.533917 5120 reconciler_common.go:299] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/532a5c65-05a2-4018-9244-1386bf31dcb2-credential-keys\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.533931 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/532a5c65-05a2-4018-9244-1386bf31dcb2-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.533943 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/532a5c65-05a2-4018-9244-1386bf31dcb2-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.550662 5120 scope.go:117] "RemoveContainer" containerID="b4ca7f201ba67359898e0f960da69c67ca6c46c934c27a9d0dcc34085b0182a0" Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.571705 5120 scope.go:117] "RemoveContainer" containerID="23d89b9bddaab11d38e25c71f65ba18b27c7ad795dc47cea8da353083a2f58a6" Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.719051 5120 scope.go:117] "RemoveContainer" containerID="8e832e7dc397e67e74670c05012d05b2a1c2dc1d15b52f9df2af956db29f56da" Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.747122 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.754949 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.766443 5120 scope.go:117] "RemoveContainer" containerID="9d0c721f1532054af65c6cc8928ac439588b2d9e39e78b42d253329b01689024" Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.801324 5120 scope.go:117] "RemoveContainer" containerID="8e832e7dc397e67e74670c05012d05b2a1c2dc1d15b52f9df2af956db29f56da" Mar 16 17:03:11 crc kubenswrapper[5120]: E0316 17:03:11.801960 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e832e7dc397e67e74670c05012d05b2a1c2dc1d15b52f9df2af956db29f56da\": container with ID starting with 8e832e7dc397e67e74670c05012d05b2a1c2dc1d15b52f9df2af956db29f56da not found: ID does not exist" containerID="8e832e7dc397e67e74670c05012d05b2a1c2dc1d15b52f9df2af956db29f56da" Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.801995 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e832e7dc397e67e74670c05012d05b2a1c2dc1d15b52f9df2af956db29f56da"} err="failed to get container status \"8e832e7dc397e67e74670c05012d05b2a1c2dc1d15b52f9df2af956db29f56da\": rpc error: code = NotFound desc = could not find container \"8e832e7dc397e67e74670c05012d05b2a1c2dc1d15b52f9df2af956db29f56da\": container with ID starting with 8e832e7dc397e67e74670c05012d05b2a1c2dc1d15b52f9df2af956db29f56da not found: ID does not exist" Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.802018 5120 scope.go:117] "RemoveContainer" containerID="9d0c721f1532054af65c6cc8928ac439588b2d9e39e78b42d253329b01689024" Mar 16 17:03:11 crc kubenswrapper[5120]: E0316 17:03:11.802355 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d0c721f1532054af65c6cc8928ac439588b2d9e39e78b42d253329b01689024\": container with ID starting with 9d0c721f1532054af65c6cc8928ac439588b2d9e39e78b42d253329b01689024 not found: ID does not exist" containerID="9d0c721f1532054af65c6cc8928ac439588b2d9e39e78b42d253329b01689024" Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.802387 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d0c721f1532054af65c6cc8928ac439588b2d9e39e78b42d253329b01689024"} err="failed to get container status \"9d0c721f1532054af65c6cc8928ac439588b2d9e39e78b42d253329b01689024\": rpc error: code = NotFound desc = could not find container \"9d0c721f1532054af65c6cc8928ac439588b2d9e39e78b42d253329b01689024\": container with ID starting with 9d0c721f1532054af65c6cc8928ac439588b2d9e39e78b42d253329b01689024 not found: ID does not exist" Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.802406 5120 scope.go:117] "RemoveContainer" containerID="b8bbcdffc34685e533b2e078ab9d7cc67872998017fd038f8b682e3c4a20dda7" Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.848312 5120 scope.go:117] "RemoveContainer" containerID="8712049419d751647f539cb23ec36107f7d405f68b95c688cf65f2c616a2aee4" Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.887460 5120 scope.go:117] "RemoveContainer" containerID="b8bbcdffc34685e533b2e078ab9d7cc67872998017fd038f8b682e3c4a20dda7" Mar 16 17:03:11 crc kubenswrapper[5120]: E0316 17:03:11.887998 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b8bbcdffc34685e533b2e078ab9d7cc67872998017fd038f8b682e3c4a20dda7\": container with ID starting with b8bbcdffc34685e533b2e078ab9d7cc67872998017fd038f8b682e3c4a20dda7 not found: ID does not exist" containerID="b8bbcdffc34685e533b2e078ab9d7cc67872998017fd038f8b682e3c4a20dda7" Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.888049 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8bbcdffc34685e533b2e078ab9d7cc67872998017fd038f8b682e3c4a20dda7"} err="failed to get container status \"b8bbcdffc34685e533b2e078ab9d7cc67872998017fd038f8b682e3c4a20dda7\": rpc error: code = NotFound desc = could not find container \"b8bbcdffc34685e533b2e078ab9d7cc67872998017fd038f8b682e3c4a20dda7\": container with ID starting with b8bbcdffc34685e533b2e078ab9d7cc67872998017fd038f8b682e3c4a20dda7 not found: ID does not exist" Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.888080 5120 scope.go:117] "RemoveContainer" containerID="8712049419d751647f539cb23ec36107f7d405f68b95c688cf65f2c616a2aee4" Mar 16 17:03:11 crc kubenswrapper[5120]: E0316 17:03:11.888405 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8712049419d751647f539cb23ec36107f7d405f68b95c688cf65f2c616a2aee4\": container with ID starting with 8712049419d751647f539cb23ec36107f7d405f68b95c688cf65f2c616a2aee4 not found: ID does not exist" containerID="8712049419d751647f539cb23ec36107f7d405f68b95c688cf65f2c616a2aee4" Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.888449 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8712049419d751647f539cb23ec36107f7d405f68b95c688cf65f2c616a2aee4"} err="failed to get container status \"8712049419d751647f539cb23ec36107f7d405f68b95c688cf65f2c616a2aee4\": rpc error: code = NotFound desc = could not find container \"8712049419d751647f539cb23ec36107f7d405f68b95c688cf65f2c616a2aee4\": container with ID starting with 8712049419d751647f539cb23ec36107f7d405f68b95c688cf65f2c616a2aee4 not found: ID does not exist" Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.888482 5120 scope.go:117] "RemoveContainer" containerID="0e7949a684f8f8fe500457e72cc4e4823aa78b079b839cbf757031b0c431a0bc" Mar 16 17:03:11 crc kubenswrapper[5120]: E0316 17:03:11.888828 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0e7949a684f8f8fe500457e72cc4e4823aa78b079b839cbf757031b0c431a0bc\": container with ID starting with 0e7949a684f8f8fe500457e72cc4e4823aa78b079b839cbf757031b0c431a0bc not found: ID does not exist" containerID="0e7949a684f8f8fe500457e72cc4e4823aa78b079b839cbf757031b0c431a0bc" Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.888889 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e7949a684f8f8fe500457e72cc4e4823aa78b079b839cbf757031b0c431a0bc"} err="failed to get container status \"0e7949a684f8f8fe500457e72cc4e4823aa78b079b839cbf757031b0c431a0bc\": rpc error: code = NotFound desc = could not find container \"0e7949a684f8f8fe500457e72cc4e4823aa78b079b839cbf757031b0c431a0bc\": container with ID starting with 0e7949a684f8f8fe500457e72cc4e4823aa78b079b839cbf757031b0c431a0bc not found: ID does not exist" Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.888916 5120 scope.go:117] "RemoveContainer" containerID="d4f5205995b7c25196e08d7776a3216b01adf4671787cdf98654a2ac9fa24504" Mar 16 17:03:11 crc kubenswrapper[5120]: E0316 17:03:11.889833 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d4f5205995b7c25196e08d7776a3216b01adf4671787cdf98654a2ac9fa24504\": container with ID starting with d4f5205995b7c25196e08d7776a3216b01adf4671787cdf98654a2ac9fa24504 not found: ID does not exist" containerID="d4f5205995b7c25196e08d7776a3216b01adf4671787cdf98654a2ac9fa24504" Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.889870 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4f5205995b7c25196e08d7776a3216b01adf4671787cdf98654a2ac9fa24504"} err="failed to get container status \"d4f5205995b7c25196e08d7776a3216b01adf4671787cdf98654a2ac9fa24504\": rpc error: code = NotFound desc = could not find container \"d4f5205995b7c25196e08d7776a3216b01adf4671787cdf98654a2ac9fa24504\": container with ID starting with d4f5205995b7c25196e08d7776a3216b01adf4671787cdf98654a2ac9fa24504 not found: ID does not exist" Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.889892 5120 scope.go:117] "RemoveContainer" containerID="89900d39fc204199e02d273a2bdfeaa13e11867682159dc0559a62567d877070" Mar 16 17:03:11 crc kubenswrapper[5120]: I0316 17:03:11.960370 5120 scope.go:117] "RemoveContainer" containerID="853bc5cbb6b2905c3f52af799cf24c043e5f94333c04f7d4cc83f8fb47830175" Mar 16 17:03:12 crc kubenswrapper[5120]: I0316 17:03:12.011406 5120 scope.go:117] "RemoveContainer" containerID="f74ecc023217184e5ac69eafc7250f1064a8b35dbd565a66ef8fc760056c5822" Mar 16 17:03:12 crc kubenswrapper[5120]: I0316 17:03:12.038293 5120 scope.go:117] "RemoveContainer" containerID="06c0c12d3e7e9a7aecfc7d72f564006daf6123f028c14aa026bced0fe656dd6e" Mar 16 17:03:12 crc kubenswrapper[5120]: I0316 17:03:12.064645 5120 scope.go:117] "RemoveContainer" containerID="f74ecc023217184e5ac69eafc7250f1064a8b35dbd565a66ef8fc760056c5822" Mar 16 17:03:12 crc kubenswrapper[5120]: E0316 17:03:12.065320 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f74ecc023217184e5ac69eafc7250f1064a8b35dbd565a66ef8fc760056c5822\": container with ID starting with f74ecc023217184e5ac69eafc7250f1064a8b35dbd565a66ef8fc760056c5822 not found: ID does not exist" containerID="f74ecc023217184e5ac69eafc7250f1064a8b35dbd565a66ef8fc760056c5822" Mar 16 17:03:12 crc kubenswrapper[5120]: I0316 17:03:12.065361 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f74ecc023217184e5ac69eafc7250f1064a8b35dbd565a66ef8fc760056c5822"} err="failed to get container status \"f74ecc023217184e5ac69eafc7250f1064a8b35dbd565a66ef8fc760056c5822\": rpc error: code = NotFound desc = could not find container \"f74ecc023217184e5ac69eafc7250f1064a8b35dbd565a66ef8fc760056c5822\": container with ID starting with f74ecc023217184e5ac69eafc7250f1064a8b35dbd565a66ef8fc760056c5822 not found: ID does not exist" Mar 16 17:03:12 crc kubenswrapper[5120]: I0316 17:03:12.065387 5120 scope.go:117] "RemoveContainer" containerID="06c0c12d3e7e9a7aecfc7d72f564006daf6123f028c14aa026bced0fe656dd6e" Mar 16 17:03:12 crc kubenswrapper[5120]: E0316 17:03:12.065990 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"06c0c12d3e7e9a7aecfc7d72f564006daf6123f028c14aa026bced0fe656dd6e\": container with ID starting with 06c0c12d3e7e9a7aecfc7d72f564006daf6123f028c14aa026bced0fe656dd6e not found: ID does not exist" containerID="06c0c12d3e7e9a7aecfc7d72f564006daf6123f028c14aa026bced0fe656dd6e" Mar 16 17:03:12 crc kubenswrapper[5120]: I0316 17:03:12.066051 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"06c0c12d3e7e9a7aecfc7d72f564006daf6123f028c14aa026bced0fe656dd6e"} err="failed to get container status \"06c0c12d3e7e9a7aecfc7d72f564006daf6123f028c14aa026bced0fe656dd6e\": rpc error: code = NotFound desc = could not find container \"06c0c12d3e7e9a7aecfc7d72f564006daf6123f028c14aa026bced0fe656dd6e\": container with ID starting with 06c0c12d3e7e9a7aecfc7d72f564006daf6123f028c14aa026bced0fe656dd6e not found: ID does not exist" Mar 16 17:03:12 crc kubenswrapper[5120]: I0316 17:03:12.066079 5120 scope.go:117] "RemoveContainer" containerID="e035fad40aa52d287a6919e996a209abac082912f4c792b979746bdd509712a5" Mar 16 17:03:12 crc kubenswrapper[5120]: I0316 17:03:12.096097 5120 scope.go:117] "RemoveContainer" containerID="f7c63580126db55650667f8bc05d59546a627363558e5c5f426c2752ec02efd8" Mar 16 17:03:12 crc kubenswrapper[5120]: I0316 17:03:12.128234 5120 scope.go:117] "RemoveContainer" containerID="e035fad40aa52d287a6919e996a209abac082912f4c792b979746bdd509712a5" Mar 16 17:03:12 crc kubenswrapper[5120]: E0316 17:03:12.128717 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e035fad40aa52d287a6919e996a209abac082912f4c792b979746bdd509712a5\": container with ID starting with e035fad40aa52d287a6919e996a209abac082912f4c792b979746bdd509712a5 not found: ID does not exist" containerID="e035fad40aa52d287a6919e996a209abac082912f4c792b979746bdd509712a5" Mar 16 17:03:12 crc kubenswrapper[5120]: I0316 17:03:12.128752 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e035fad40aa52d287a6919e996a209abac082912f4c792b979746bdd509712a5"} err="failed to get container status \"e035fad40aa52d287a6919e996a209abac082912f4c792b979746bdd509712a5\": rpc error: code = NotFound desc = could not find container \"e035fad40aa52d287a6919e996a209abac082912f4c792b979746bdd509712a5\": container with ID starting with e035fad40aa52d287a6919e996a209abac082912f4c792b979746bdd509712a5 not found: ID does not exist" Mar 16 17:03:12 crc kubenswrapper[5120]: I0316 17:03:12.128796 5120 scope.go:117] "RemoveContainer" containerID="f7c63580126db55650667f8bc05d59546a627363558e5c5f426c2752ec02efd8" Mar 16 17:03:12 crc kubenswrapper[5120]: E0316 17:03:12.129151 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f7c63580126db55650667f8bc05d59546a627363558e5c5f426c2752ec02efd8\": container with ID starting with f7c63580126db55650667f8bc05d59546a627363558e5c5f426c2752ec02efd8 not found: ID does not exist" containerID="f7c63580126db55650667f8bc05d59546a627363558e5c5f426c2752ec02efd8" Mar 16 17:03:12 crc kubenswrapper[5120]: I0316 17:03:12.129185 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7c63580126db55650667f8bc05d59546a627363558e5c5f426c2752ec02efd8"} err="failed to get container status \"f7c63580126db55650667f8bc05d59546a627363558e5c5f426c2752ec02efd8\": rpc error: code = NotFound desc = could not find container \"f7c63580126db55650667f8bc05d59546a627363558e5c5f426c2752ec02efd8\": container with ID starting with f7c63580126db55650667f8bc05d59546a627363558e5c5f426c2752ec02efd8 not found: ID does not exist" Mar 16 17:03:12 crc kubenswrapper[5120]: I0316 17:03:12.129204 5120 scope.go:117] "RemoveContainer" containerID="98b7269dea85c50b3653f02d53c97085506d9cf74a457e4aee7380d97d30f5ed" Mar 16 17:03:12 crc kubenswrapper[5120]: I0316 17:03:12.153318 5120 scope.go:117] "RemoveContainer" containerID="97410dc76f412387b08b4c4b9c619dfcb470a14033e5445e72e531bacfce7fe0" Mar 16 17:03:12 crc kubenswrapper[5120]: I0316 17:03:12.179385 5120 scope.go:117] "RemoveContainer" containerID="98b7269dea85c50b3653f02d53c97085506d9cf74a457e4aee7380d97d30f5ed" Mar 16 17:03:12 crc kubenswrapper[5120]: E0316 17:03:12.179927 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"98b7269dea85c50b3653f02d53c97085506d9cf74a457e4aee7380d97d30f5ed\": container with ID starting with 98b7269dea85c50b3653f02d53c97085506d9cf74a457e4aee7380d97d30f5ed not found: ID does not exist" containerID="98b7269dea85c50b3653f02d53c97085506d9cf74a457e4aee7380d97d30f5ed" Mar 16 17:03:12 crc kubenswrapper[5120]: I0316 17:03:12.179991 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98b7269dea85c50b3653f02d53c97085506d9cf74a457e4aee7380d97d30f5ed"} err="failed to get container status \"98b7269dea85c50b3653f02d53c97085506d9cf74a457e4aee7380d97d30f5ed\": rpc error: code = NotFound desc = could not find container \"98b7269dea85c50b3653f02d53c97085506d9cf74a457e4aee7380d97d30f5ed\": container with ID starting with 98b7269dea85c50b3653f02d53c97085506d9cf74a457e4aee7380d97d30f5ed not found: ID does not exist" Mar 16 17:03:12 crc kubenswrapper[5120]: I0316 17:03:12.180021 5120 scope.go:117] "RemoveContainer" containerID="97410dc76f412387b08b4c4b9c619dfcb470a14033e5445e72e531bacfce7fe0" Mar 16 17:03:12 crc kubenswrapper[5120]: E0316 17:03:12.181956 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"97410dc76f412387b08b4c4b9c619dfcb470a14033e5445e72e531bacfce7fe0\": container with ID starting with 97410dc76f412387b08b4c4b9c619dfcb470a14033e5445e72e531bacfce7fe0 not found: ID does not exist" containerID="97410dc76f412387b08b4c4b9c619dfcb470a14033e5445e72e531bacfce7fe0" Mar 16 17:03:12 crc kubenswrapper[5120]: I0316 17:03:12.181999 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97410dc76f412387b08b4c4b9c619dfcb470a14033e5445e72e531bacfce7fe0"} err="failed to get container status \"97410dc76f412387b08b4c4b9c619dfcb470a14033e5445e72e531bacfce7fe0\": rpc error: code = NotFound desc = could not find container \"97410dc76f412387b08b4c4b9c619dfcb470a14033e5445e72e531bacfce7fe0\": container with ID starting with 97410dc76f412387b08b4c4b9c619dfcb470a14033e5445e72e531bacfce7fe0 not found: ID does not exist" Mar 16 17:03:12 crc kubenswrapper[5120]: I0316 17:03:12.297105 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-766c6fc56d-x6dc5" event={"ID":"532a5c65-05a2-4018-9244-1386bf31dcb2","Type":"ContainerDied","Data":"7bd64e87ef05c11750b3cf2a0f05a32193402ca0f9e7e427ce9cb91520e8db87"} Mar 16 17:03:12 crc kubenswrapper[5120]: I0316 17:03:12.297177 5120 scope.go:117] "RemoveContainer" containerID="f3475d302eda9b8f9f995f9084c858803d1f137a09ef9c3b6af35d343d7090c1" Mar 16 17:03:12 crc kubenswrapper[5120]: I0316 17:03:12.297223 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-766c6fc56d-x6dc5" Mar 16 17:03:12 crc kubenswrapper[5120]: I0316 17:03:12.310987 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"d226072d-5d81-4c83-ade7-29bdc1df4c80","Type":"ContainerDied","Data":"0928f62211951569390bc849563df11890859ff76e7b2036ebc79c2ab9dc6b00"} Mar 16 17:03:12 crc kubenswrapper[5120]: I0316 17:03:12.311036 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:03:12 crc kubenswrapper[5120]: I0316 17:03:12.312405 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"284dc632-d111-40d1-97a9-f6e78aa92ce7","Type":"ContainerDied","Data":"0caf2f247366752c25fe3303453748c0082ba327ce5a5db56bf1da86155877f9"} Mar 16 17:03:12 crc kubenswrapper[5120]: I0316 17:03:12.312429 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 17:03:12 crc kubenswrapper[5120]: I0316 17:03:12.353915 5120 scope.go:117] "RemoveContainer" containerID="332dae2edfbf2e0f756cde2904bec2d8bbc2240aa37e84431e89ca72362d5c89" Mar 16 17:03:12 crc kubenswrapper[5120]: I0316 17:03:12.379267 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-766c6fc56d-x6dc5"] Mar 16 17:03:12 crc kubenswrapper[5120]: I0316 17:03:12.391097 5120 scope.go:117] "RemoveContainer" containerID="c87cdce774051210b03731c88d545718b1887f3878a50a3fc79d5fc070ffb305" Mar 16 17:03:12 crc kubenswrapper[5120]: I0316 17:03:12.391169 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-766c6fc56d-x6dc5"] Mar 16 17:03:12 crc kubenswrapper[5120]: I0316 17:03:12.398151 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 17:03:12 crc kubenswrapper[5120]: I0316 17:03:12.404847 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 17:03:12 crc kubenswrapper[5120]: I0316 17:03:12.413225 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 17:03:12 crc kubenswrapper[5120]: I0316 17:03:12.418937 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 17:03:13 crc kubenswrapper[5120]: I0316 17:03:13.164757 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="279c3e84-623c-4c5f-ae15-d7d8c439c4dc" path="/var/lib/kubelet/pods/279c3e84-623c-4c5f-ae15-d7d8c439c4dc/volumes" Mar 16 17:03:13 crc kubenswrapper[5120]: I0316 17:03:13.167161 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="284dc632-d111-40d1-97a9-f6e78aa92ce7" path="/var/lib/kubelet/pods/284dc632-d111-40d1-97a9-f6e78aa92ce7/volumes" Mar 16 17:03:13 crc kubenswrapper[5120]: I0316 17:03:13.169268 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="532a5c65-05a2-4018-9244-1386bf31dcb2" path="/var/lib/kubelet/pods/532a5c65-05a2-4018-9244-1386bf31dcb2/volumes" Mar 16 17:03:13 crc kubenswrapper[5120]: I0316 17:03:13.170967 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="615448b7-8677-4a99-93ba-64a2388a6dcc" path="/var/lib/kubelet/pods/615448b7-8677-4a99-93ba-64a2388a6dcc/volumes" Mar 16 17:03:13 crc kubenswrapper[5120]: I0316 17:03:13.172359 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d226072d-5d81-4c83-ade7-29bdc1df4c80" path="/var/lib/kubelet/pods/d226072d-5d81-4c83-ade7-29bdc1df4c80/volumes" Mar 16 17:03:13 crc kubenswrapper[5120]: I0316 17:03:13.173084 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fb7a2068-5a18-4c7b-92d0-364f371d59df" path="/var/lib/kubelet/pods/fb7a2068-5a18-4c7b-92d0-364f371d59df/volumes" Mar 16 17:03:14 crc kubenswrapper[5120]: E0316 17:03:14.131673 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="8d1a8aa9bd86f2402b10b59285567fd78f4d62123af2fd8a44ad19b94394c08b" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 17:03:14 crc kubenswrapper[5120]: E0316 17:03:14.132809 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="8d1a8aa9bd86f2402b10b59285567fd78f4d62123af2fd8a44ad19b94394c08b" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 17:03:14 crc kubenswrapper[5120]: E0316 17:03:14.134444 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="8d1a8aa9bd86f2402b10b59285567fd78f4d62123af2fd8a44ad19b94394c08b" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 17:03:14 crc kubenswrapper[5120]: E0316 17:03:14.134592 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="61d14db6-7d33-4e5f-8252-844441e519d7" containerName="nova-cell1-conductor-conductor" probeResult="unknown" Mar 16 17:03:16 crc kubenswrapper[5120]: I0316 17:03:16.288131 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-5fprr" Mar 16 17:03:16 crc kubenswrapper[5120]: I0316 17:03:16.342188 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-7f699f9655-znk2w"] Mar 16 17:03:16 crc kubenswrapper[5120]: I0316 17:03:16.342488 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7f699f9655-znk2w" podUID="1afd582f-b48e-4483-8f98-8d4e7d54fabb" containerName="dnsmasq-dns" containerID="cri-o://97b81bbed0b032bb774f35fb78029f82dfe379a718e6c62451e88d40f949f8f2" gracePeriod=10 Mar 16 17:03:16 crc kubenswrapper[5120]: I0316 17:03:16.769279 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7f699f9655-znk2w" Mar 16 17:03:16 crc kubenswrapper[5120]: I0316 17:03:16.852811 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1afd582f-b48e-4483-8f98-8d4e7d54fabb-config\") pod \"1afd582f-b48e-4483-8f98-8d4e7d54fabb\" (UID: \"1afd582f-b48e-4483-8f98-8d4e7d54fabb\") " Mar 16 17:03:16 crc kubenswrapper[5120]: I0316 17:03:16.852967 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qcl2q\" (UniqueName: \"kubernetes.io/projected/1afd582f-b48e-4483-8f98-8d4e7d54fabb-kube-api-access-qcl2q\") pod \"1afd582f-b48e-4483-8f98-8d4e7d54fabb\" (UID: \"1afd582f-b48e-4483-8f98-8d4e7d54fabb\") " Mar 16 17:03:16 crc kubenswrapper[5120]: I0316 17:03:16.853003 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/1afd582f-b48e-4483-8f98-8d4e7d54fabb-dnsmasq-svc\") pod \"1afd582f-b48e-4483-8f98-8d4e7d54fabb\" (UID: \"1afd582f-b48e-4483-8f98-8d4e7d54fabb\") " Mar 16 17:03:16 crc kubenswrapper[5120]: I0316 17:03:16.853257 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/1afd582f-b48e-4483-8f98-8d4e7d54fabb-dns-swift-storage-0\") pod \"1afd582f-b48e-4483-8f98-8d4e7d54fabb\" (UID: \"1afd582f-b48e-4483-8f98-8d4e7d54fabb\") " Mar 16 17:03:16 crc kubenswrapper[5120]: I0316 17:03:16.858549 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1afd582f-b48e-4483-8f98-8d4e7d54fabb-kube-api-access-qcl2q" (OuterVolumeSpecName: "kube-api-access-qcl2q") pod "1afd582f-b48e-4483-8f98-8d4e7d54fabb" (UID: "1afd582f-b48e-4483-8f98-8d4e7d54fabb"). InnerVolumeSpecName "kube-api-access-qcl2q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:03:16 crc kubenswrapper[5120]: I0316 17:03:16.887694 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1afd582f-b48e-4483-8f98-8d4e7d54fabb-config" (OuterVolumeSpecName: "config") pod "1afd582f-b48e-4483-8f98-8d4e7d54fabb" (UID: "1afd582f-b48e-4483-8f98-8d4e7d54fabb"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:03:16 crc kubenswrapper[5120]: I0316 17:03:16.891442 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1afd582f-b48e-4483-8f98-8d4e7d54fabb-dns-swift-storage-0" (OuterVolumeSpecName: "dns-swift-storage-0") pod "1afd582f-b48e-4483-8f98-8d4e7d54fabb" (UID: "1afd582f-b48e-4483-8f98-8d4e7d54fabb"). InnerVolumeSpecName "dns-swift-storage-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:03:16 crc kubenswrapper[5120]: I0316 17:03:16.892735 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1afd582f-b48e-4483-8f98-8d4e7d54fabb-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "1afd582f-b48e-4483-8f98-8d4e7d54fabb" (UID: "1afd582f-b48e-4483-8f98-8d4e7d54fabb"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:03:16 crc kubenswrapper[5120]: I0316 17:03:16.956245 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qcl2q\" (UniqueName: \"kubernetes.io/projected/1afd582f-b48e-4483-8f98-8d4e7d54fabb-kube-api-access-qcl2q\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:16 crc kubenswrapper[5120]: I0316 17:03:16.956500 5120 reconciler_common.go:299] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/1afd582f-b48e-4483-8f98-8d4e7d54fabb-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:16 crc kubenswrapper[5120]: I0316 17:03:16.956512 5120 reconciler_common.go:299] "Volume detached for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/1afd582f-b48e-4483-8f98-8d4e7d54fabb-dns-swift-storage-0\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:16 crc kubenswrapper[5120]: I0316 17:03:16.956524 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1afd582f-b48e-4483-8f98-8d4e7d54fabb-config\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:17 crc kubenswrapper[5120]: I0316 17:03:17.383575 5120 generic.go:358] "Generic (PLEG): container finished" podID="1afd582f-b48e-4483-8f98-8d4e7d54fabb" containerID="97b81bbed0b032bb774f35fb78029f82dfe379a718e6c62451e88d40f949f8f2" exitCode=0 Mar 16 17:03:17 crc kubenswrapper[5120]: I0316 17:03:17.383714 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7f699f9655-znk2w" Mar 16 17:03:17 crc kubenswrapper[5120]: I0316 17:03:17.383744 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7f699f9655-znk2w" event={"ID":"1afd582f-b48e-4483-8f98-8d4e7d54fabb","Type":"ContainerDied","Data":"97b81bbed0b032bb774f35fb78029f82dfe379a718e6c62451e88d40f949f8f2"} Mar 16 17:03:17 crc kubenswrapper[5120]: I0316 17:03:17.384727 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7f699f9655-znk2w" event={"ID":"1afd582f-b48e-4483-8f98-8d4e7d54fabb","Type":"ContainerDied","Data":"b5a51589cacfada974946629585db32b7b364f1824bbb4d92fdf5272bec316d4"} Mar 16 17:03:17 crc kubenswrapper[5120]: I0316 17:03:17.384753 5120 scope.go:117] "RemoveContainer" containerID="97b81bbed0b032bb774f35fb78029f82dfe379a718e6c62451e88d40f949f8f2" Mar 16 17:03:17 crc kubenswrapper[5120]: I0316 17:03:17.412869 5120 scope.go:117] "RemoveContainer" containerID="6dd2c1a4a88a8068453327fe9c9b252f6f45e930ef98b7fbf050e0eddabcc7aa" Mar 16 17:03:17 crc kubenswrapper[5120]: I0316 17:03:17.434346 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-7f699f9655-znk2w"] Mar 16 17:03:17 crc kubenswrapper[5120]: I0316 17:03:17.439096 5120 scope.go:117] "RemoveContainer" containerID="97b81bbed0b032bb774f35fb78029f82dfe379a718e6c62451e88d40f949f8f2" Mar 16 17:03:17 crc kubenswrapper[5120]: E0316 17:03:17.439989 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"97b81bbed0b032bb774f35fb78029f82dfe379a718e6c62451e88d40f949f8f2\": container with ID starting with 97b81bbed0b032bb774f35fb78029f82dfe379a718e6c62451e88d40f949f8f2 not found: ID does not exist" containerID="97b81bbed0b032bb774f35fb78029f82dfe379a718e6c62451e88d40f949f8f2" Mar 16 17:03:17 crc kubenswrapper[5120]: I0316 17:03:17.440085 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97b81bbed0b032bb774f35fb78029f82dfe379a718e6c62451e88d40f949f8f2"} err="failed to get container status \"97b81bbed0b032bb774f35fb78029f82dfe379a718e6c62451e88d40f949f8f2\": rpc error: code = NotFound desc = could not find container \"97b81bbed0b032bb774f35fb78029f82dfe379a718e6c62451e88d40f949f8f2\": container with ID starting with 97b81bbed0b032bb774f35fb78029f82dfe379a718e6c62451e88d40f949f8f2 not found: ID does not exist" Mar 16 17:03:17 crc kubenswrapper[5120]: I0316 17:03:17.440183 5120 scope.go:117] "RemoveContainer" containerID="6dd2c1a4a88a8068453327fe9c9b252f6f45e930ef98b7fbf050e0eddabcc7aa" Mar 16 17:03:17 crc kubenswrapper[5120]: E0316 17:03:17.440552 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6dd2c1a4a88a8068453327fe9c9b252f6f45e930ef98b7fbf050e0eddabcc7aa\": container with ID starting with 6dd2c1a4a88a8068453327fe9c9b252f6f45e930ef98b7fbf050e0eddabcc7aa not found: ID does not exist" containerID="6dd2c1a4a88a8068453327fe9c9b252f6f45e930ef98b7fbf050e0eddabcc7aa" Mar 16 17:03:17 crc kubenswrapper[5120]: I0316 17:03:17.440646 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6dd2c1a4a88a8068453327fe9c9b252f6f45e930ef98b7fbf050e0eddabcc7aa"} err="failed to get container status \"6dd2c1a4a88a8068453327fe9c9b252f6f45e930ef98b7fbf050e0eddabcc7aa\": rpc error: code = NotFound desc = could not find container \"6dd2c1a4a88a8068453327fe9c9b252f6f45e930ef98b7fbf050e0eddabcc7aa\": container with ID starting with 6dd2c1a4a88a8068453327fe9c9b252f6f45e930ef98b7fbf050e0eddabcc7aa not found: ID does not exist" Mar 16 17:03:17 crc kubenswrapper[5120]: I0316 17:03:17.441820 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-7f699f9655-znk2w"] Mar 16 17:03:18 crc kubenswrapper[5120]: I0316 17:03:18.677803 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1afd582f-b48e-4483-8f98-8d4e7d54fabb" path="/var/lib/kubelet/pods/1afd582f-b48e-4483-8f98-8d4e7d54fabb/volumes" Mar 16 17:03:18 crc kubenswrapper[5120]: I0316 17:03:18.735075 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/neutron-79c6c668c8-l5c8p" podUID="394193fd-f8e0-4b81-8821-8d1251a0274b" containerName="neutron-httpd" probeResult="failure" output="Get \"https://10.217.1.112:9696/\": dial tcp 10.217.1.112:9696: connect: connection refused" Mar 16 17:03:19 crc kubenswrapper[5120]: E0316 17:03:19.132635 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="8d1a8aa9bd86f2402b10b59285567fd78f4d62123af2fd8a44ad19b94394c08b" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 17:03:19 crc kubenswrapper[5120]: E0316 17:03:19.134140 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="8d1a8aa9bd86f2402b10b59285567fd78f4d62123af2fd8a44ad19b94394c08b" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 17:03:19 crc kubenswrapper[5120]: E0316 17:03:19.135752 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="8d1a8aa9bd86f2402b10b59285567fd78f4d62123af2fd8a44ad19b94394c08b" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 17:03:19 crc kubenswrapper[5120]: E0316 17:03:19.135853 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="61d14db6-7d33-4e5f-8252-844441e519d7" containerName="nova-cell1-conductor-conductor" probeResult="unknown" Mar 16 17:03:20 crc kubenswrapper[5120]: I0316 17:03:20.428311 5120 generic.go:358] "Generic (PLEG): container finished" podID="394193fd-f8e0-4b81-8821-8d1251a0274b" containerID="bee153da9ff3794e8534a919e63d240cfcd1a5a2b982d46b350472046f40c2c1" exitCode=0 Mar 16 17:03:20 crc kubenswrapper[5120]: I0316 17:03:20.428380 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-79c6c668c8-l5c8p" event={"ID":"394193fd-f8e0-4b81-8821-8d1251a0274b","Type":"ContainerDied","Data":"bee153da9ff3794e8534a919e63d240cfcd1a5a2b982d46b350472046f40c2c1"} Mar 16 17:03:20 crc kubenswrapper[5120]: I0316 17:03:20.566151 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-79c6c668c8-l5c8p" Mar 16 17:03:20 crc kubenswrapper[5120]: I0316 17:03:20.628895 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/394193fd-f8e0-4b81-8821-8d1251a0274b-httpd-config\") pod \"394193fd-f8e0-4b81-8821-8d1251a0274b\" (UID: \"394193fd-f8e0-4b81-8821-8d1251a0274b\") " Mar 16 17:03:20 crc kubenswrapper[5120]: I0316 17:03:20.628963 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/394193fd-f8e0-4b81-8821-8d1251a0274b-ovndb-tls-certs\") pod \"394193fd-f8e0-4b81-8821-8d1251a0274b\" (UID: \"394193fd-f8e0-4b81-8821-8d1251a0274b\") " Mar 16 17:03:20 crc kubenswrapper[5120]: I0316 17:03:20.629065 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dbcdr\" (UniqueName: \"kubernetes.io/projected/394193fd-f8e0-4b81-8821-8d1251a0274b-kube-api-access-dbcdr\") pod \"394193fd-f8e0-4b81-8821-8d1251a0274b\" (UID: \"394193fd-f8e0-4b81-8821-8d1251a0274b\") " Mar 16 17:03:20 crc kubenswrapper[5120]: I0316 17:03:20.629142 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/394193fd-f8e0-4b81-8821-8d1251a0274b-combined-ca-bundle\") pod \"394193fd-f8e0-4b81-8821-8d1251a0274b\" (UID: \"394193fd-f8e0-4b81-8821-8d1251a0274b\") " Mar 16 17:03:20 crc kubenswrapper[5120]: I0316 17:03:20.629168 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/394193fd-f8e0-4b81-8821-8d1251a0274b-public-tls-certs\") pod \"394193fd-f8e0-4b81-8821-8d1251a0274b\" (UID: \"394193fd-f8e0-4b81-8821-8d1251a0274b\") " Mar 16 17:03:20 crc kubenswrapper[5120]: I0316 17:03:20.629749 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/394193fd-f8e0-4b81-8821-8d1251a0274b-config\") pod \"394193fd-f8e0-4b81-8821-8d1251a0274b\" (UID: \"394193fd-f8e0-4b81-8821-8d1251a0274b\") " Mar 16 17:03:20 crc kubenswrapper[5120]: I0316 17:03:20.629902 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/394193fd-f8e0-4b81-8821-8d1251a0274b-internal-tls-certs\") pod \"394193fd-f8e0-4b81-8821-8d1251a0274b\" (UID: \"394193fd-f8e0-4b81-8821-8d1251a0274b\") " Mar 16 17:03:20 crc kubenswrapper[5120]: I0316 17:03:20.637033 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/394193fd-f8e0-4b81-8821-8d1251a0274b-httpd-config" (OuterVolumeSpecName: "httpd-config") pod "394193fd-f8e0-4b81-8821-8d1251a0274b" (UID: "394193fd-f8e0-4b81-8821-8d1251a0274b"). InnerVolumeSpecName "httpd-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:03:20 crc kubenswrapper[5120]: I0316 17:03:20.649890 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/394193fd-f8e0-4b81-8821-8d1251a0274b-kube-api-access-dbcdr" (OuterVolumeSpecName: "kube-api-access-dbcdr") pod "394193fd-f8e0-4b81-8821-8d1251a0274b" (UID: "394193fd-f8e0-4b81-8821-8d1251a0274b"). InnerVolumeSpecName "kube-api-access-dbcdr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:03:20 crc kubenswrapper[5120]: I0316 17:03:20.669179 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/394193fd-f8e0-4b81-8821-8d1251a0274b-config" (OuterVolumeSpecName: "config") pod "394193fd-f8e0-4b81-8821-8d1251a0274b" (UID: "394193fd-f8e0-4b81-8821-8d1251a0274b"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:03:20 crc kubenswrapper[5120]: I0316 17:03:20.673323 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/394193fd-f8e0-4b81-8821-8d1251a0274b-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "394193fd-f8e0-4b81-8821-8d1251a0274b" (UID: "394193fd-f8e0-4b81-8821-8d1251a0274b"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:03:20 crc kubenswrapper[5120]: I0316 17:03:20.678809 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/394193fd-f8e0-4b81-8821-8d1251a0274b-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "394193fd-f8e0-4b81-8821-8d1251a0274b" (UID: "394193fd-f8e0-4b81-8821-8d1251a0274b"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:03:20 crc kubenswrapper[5120]: I0316 17:03:20.679753 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/394193fd-f8e0-4b81-8821-8d1251a0274b-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "394193fd-f8e0-4b81-8821-8d1251a0274b" (UID: "394193fd-f8e0-4b81-8821-8d1251a0274b"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:03:20 crc kubenswrapper[5120]: I0316 17:03:20.686752 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/394193fd-f8e0-4b81-8821-8d1251a0274b-ovndb-tls-certs" (OuterVolumeSpecName: "ovndb-tls-certs") pod "394193fd-f8e0-4b81-8821-8d1251a0274b" (UID: "394193fd-f8e0-4b81-8821-8d1251a0274b"). InnerVolumeSpecName "ovndb-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:03:20 crc kubenswrapper[5120]: I0316 17:03:20.732243 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/394193fd-f8e0-4b81-8821-8d1251a0274b-httpd-config\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:20 crc kubenswrapper[5120]: I0316 17:03:20.732288 5120 reconciler_common.go:299] "Volume detached for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/394193fd-f8e0-4b81-8821-8d1251a0274b-ovndb-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:20 crc kubenswrapper[5120]: I0316 17:03:20.732304 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dbcdr\" (UniqueName: \"kubernetes.io/projected/394193fd-f8e0-4b81-8821-8d1251a0274b-kube-api-access-dbcdr\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:20 crc kubenswrapper[5120]: I0316 17:03:20.732316 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/394193fd-f8e0-4b81-8821-8d1251a0274b-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:20 crc kubenswrapper[5120]: I0316 17:03:20.732327 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/394193fd-f8e0-4b81-8821-8d1251a0274b-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:20 crc kubenswrapper[5120]: I0316 17:03:20.732338 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/394193fd-f8e0-4b81-8821-8d1251a0274b-config\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:20 crc kubenswrapper[5120]: I0316 17:03:20.732349 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/394193fd-f8e0-4b81-8821-8d1251a0274b-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:21 crc kubenswrapper[5120]: I0316 17:03:21.441906 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-79c6c668c8-l5c8p" event={"ID":"394193fd-f8e0-4b81-8821-8d1251a0274b","Type":"ContainerDied","Data":"6a95911c154b11d00cab64de585c23912b3a98766a752c2156fb7bc9ee3b5865"} Mar 16 17:03:21 crc kubenswrapper[5120]: I0316 17:03:21.441968 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-79c6c668c8-l5c8p" Mar 16 17:03:21 crc kubenswrapper[5120]: I0316 17:03:21.442328 5120 scope.go:117] "RemoveContainer" containerID="b366089265c5a377f266a0c6132410502a91ab7d470144bba9e47254c5e54334" Mar 16 17:03:21 crc kubenswrapper[5120]: I0316 17:03:21.476221 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-79c6c668c8-l5c8p"] Mar 16 17:03:21 crc kubenswrapper[5120]: I0316 17:03:21.482145 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-79c6c668c8-l5c8p"] Mar 16 17:03:21 crc kubenswrapper[5120]: I0316 17:03:21.483005 5120 scope.go:117] "RemoveContainer" containerID="bee153da9ff3794e8534a919e63d240cfcd1a5a2b982d46b350472046f40c2c1" Mar 16 17:03:22 crc kubenswrapper[5120]: I0316 17:03:22.673283 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="394193fd-f8e0-4b81-8821-8d1251a0274b" path="/var/lib/kubelet/pods/394193fd-f8e0-4b81-8821-8d1251a0274b/volumes" Mar 16 17:03:24 crc kubenswrapper[5120]: E0316 17:03:24.131622 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="8d1a8aa9bd86f2402b10b59285567fd78f4d62123af2fd8a44ad19b94394c08b" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 17:03:24 crc kubenswrapper[5120]: E0316 17:03:24.133229 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="8d1a8aa9bd86f2402b10b59285567fd78f4d62123af2fd8a44ad19b94394c08b" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 17:03:24 crc kubenswrapper[5120]: E0316 17:03:24.134840 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="8d1a8aa9bd86f2402b10b59285567fd78f4d62123af2fd8a44ad19b94394c08b" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 17:03:24 crc kubenswrapper[5120]: E0316 17:03:24.134883 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="61d14db6-7d33-4e5f-8252-844441e519d7" containerName="nova-cell1-conductor-conductor" probeResult="unknown" Mar 16 17:03:29 crc kubenswrapper[5120]: E0316 17:03:29.131918 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="8d1a8aa9bd86f2402b10b59285567fd78f4d62123af2fd8a44ad19b94394c08b" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 17:03:29 crc kubenswrapper[5120]: E0316 17:03:29.134272 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="8d1a8aa9bd86f2402b10b59285567fd78f4d62123af2fd8a44ad19b94394c08b" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 17:03:29 crc kubenswrapper[5120]: E0316 17:03:29.135621 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="8d1a8aa9bd86f2402b10b59285567fd78f4d62123af2fd8a44ad19b94394c08b" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 17:03:29 crc kubenswrapper[5120]: E0316 17:03:29.135654 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="61d14db6-7d33-4e5f-8252-844441e519d7" containerName="nova-cell1-conductor-conductor" probeResult="unknown" Mar 16 17:03:32 crc kubenswrapper[5120]: I0316 17:03:32.551964 5120 generic.go:358] "Generic (PLEG): container finished" podID="aeacde0e-2862-4e69-9e7d-b88ca35912b8" containerID="5643cd6e2f0a396a7c7f5aa76ae50b179dfbe75c50f8f250897c6dbe7c2f1f94" exitCode=137 Mar 16 17:03:32 crc kubenswrapper[5120]: I0316 17:03:32.552009 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"aeacde0e-2862-4e69-9e7d-b88ca35912b8","Type":"ContainerDied","Data":"5643cd6e2f0a396a7c7f5aa76ae50b179dfbe75c50f8f250897c6dbe7c2f1f94"} Mar 16 17:03:32 crc kubenswrapper[5120]: I0316 17:03:32.803349 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Mar 16 17:03:32 crc kubenswrapper[5120]: I0316 17:03:32.875646 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/aeacde0e-2862-4e69-9e7d-b88ca35912b8-combined-ca-bundle\") pod \"aeacde0e-2862-4e69-9e7d-b88ca35912b8\" (UID: \"aeacde0e-2862-4e69-9e7d-b88ca35912b8\") " Mar 16 17:03:32 crc kubenswrapper[5120]: I0316 17:03:32.876369 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"swift\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"aeacde0e-2862-4e69-9e7d-b88ca35912b8\" (UID: \"aeacde0e-2862-4e69-9e7d-b88ca35912b8\") " Mar 16 17:03:32 crc kubenswrapper[5120]: I0316 17:03:32.877247 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/aeacde0e-2862-4e69-9e7d-b88ca35912b8-etc-swift\") pod \"aeacde0e-2862-4e69-9e7d-b88ca35912b8\" (UID: \"aeacde0e-2862-4e69-9e7d-b88ca35912b8\") " Mar 16 17:03:32 crc kubenswrapper[5120]: I0316 17:03:32.877428 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qgcx5\" (UniqueName: \"kubernetes.io/projected/aeacde0e-2862-4e69-9e7d-b88ca35912b8-kube-api-access-qgcx5\") pod \"aeacde0e-2862-4e69-9e7d-b88ca35912b8\" (UID: \"aeacde0e-2862-4e69-9e7d-b88ca35912b8\") " Mar 16 17:03:32 crc kubenswrapper[5120]: I0316 17:03:32.877574 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/aeacde0e-2862-4e69-9e7d-b88ca35912b8-cache\") pod \"aeacde0e-2862-4e69-9e7d-b88ca35912b8\" (UID: \"aeacde0e-2862-4e69-9e7d-b88ca35912b8\") " Mar 16 17:03:32 crc kubenswrapper[5120]: I0316 17:03:32.877785 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/aeacde0e-2862-4e69-9e7d-b88ca35912b8-lock\") pod \"aeacde0e-2862-4e69-9e7d-b88ca35912b8\" (UID: \"aeacde0e-2862-4e69-9e7d-b88ca35912b8\") " Mar 16 17:03:32 crc kubenswrapper[5120]: I0316 17:03:32.878615 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aeacde0e-2862-4e69-9e7d-b88ca35912b8-cache" (OuterVolumeSpecName: "cache") pod "aeacde0e-2862-4e69-9e7d-b88ca35912b8" (UID: "aeacde0e-2862-4e69-9e7d-b88ca35912b8"). InnerVolumeSpecName "cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:03:32 crc kubenswrapper[5120]: I0316 17:03:32.878956 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aeacde0e-2862-4e69-9e7d-b88ca35912b8-lock" (OuterVolumeSpecName: "lock") pod "aeacde0e-2862-4e69-9e7d-b88ca35912b8" (UID: "aeacde0e-2862-4e69-9e7d-b88ca35912b8"). InnerVolumeSpecName "lock". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:03:32 crc kubenswrapper[5120]: I0316 17:03:32.882525 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage03-crc" (OuterVolumeSpecName: "swift") pod "aeacde0e-2862-4e69-9e7d-b88ca35912b8" (UID: "aeacde0e-2862-4e69-9e7d-b88ca35912b8"). InnerVolumeSpecName "local-storage03-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 17:03:32 crc kubenswrapper[5120]: I0316 17:03:32.882939 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aeacde0e-2862-4e69-9e7d-b88ca35912b8-etc-swift" (OuterVolumeSpecName: "etc-swift") pod "aeacde0e-2862-4e69-9e7d-b88ca35912b8" (UID: "aeacde0e-2862-4e69-9e7d-b88ca35912b8"). InnerVolumeSpecName "etc-swift". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:03:32 crc kubenswrapper[5120]: I0316 17:03:32.893630 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aeacde0e-2862-4e69-9e7d-b88ca35912b8-kube-api-access-qgcx5" (OuterVolumeSpecName: "kube-api-access-qgcx5") pod "aeacde0e-2862-4e69-9e7d-b88ca35912b8" (UID: "aeacde0e-2862-4e69-9e7d-b88ca35912b8"). InnerVolumeSpecName "kube-api-access-qgcx5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:03:32 crc kubenswrapper[5120]: I0316 17:03:32.980031 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") on node \"crc\" " Mar 16 17:03:32 crc kubenswrapper[5120]: I0316 17:03:32.980064 5120 reconciler_common.go:299] "Volume detached for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/aeacde0e-2862-4e69-9e7d-b88ca35912b8-etc-swift\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:32 crc kubenswrapper[5120]: I0316 17:03:32.980077 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qgcx5\" (UniqueName: \"kubernetes.io/projected/aeacde0e-2862-4e69-9e7d-b88ca35912b8-kube-api-access-qgcx5\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:32 crc kubenswrapper[5120]: I0316 17:03:32.980090 5120 reconciler_common.go:299] "Volume detached for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/aeacde0e-2862-4e69-9e7d-b88ca35912b8-cache\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:32 crc kubenswrapper[5120]: I0316 17:03:32.980102 5120 reconciler_common.go:299] "Volume detached for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/aeacde0e-2862-4e69-9e7d-b88ca35912b8-lock\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:32 crc kubenswrapper[5120]: I0316 17:03:32.994111 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage03-crc" (UniqueName: "kubernetes.io/local-volume/local-storage03-crc") on node "crc" Mar 16 17:03:33 crc kubenswrapper[5120]: I0316 17:03:33.081931 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:33 crc kubenswrapper[5120]: I0316 17:03:33.145042 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aeacde0e-2862-4e69-9e7d-b88ca35912b8-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "aeacde0e-2862-4e69-9e7d-b88ca35912b8" (UID: "aeacde0e-2862-4e69-9e7d-b88ca35912b8"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:03:33 crc kubenswrapper[5120]: I0316 17:03:33.183308 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/aeacde0e-2862-4e69-9e7d-b88ca35912b8-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:33 crc kubenswrapper[5120]: I0316 17:03:33.572475 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"aeacde0e-2862-4e69-9e7d-b88ca35912b8","Type":"ContainerDied","Data":"babd93aa69c2bdb4a96ce0f8a42959cec047aad1610cd022f4693f30e42d1fb6"} Mar 16 17:03:33 crc kubenswrapper[5120]: I0316 17:03:33.572556 5120 scope.go:117] "RemoveContainer" containerID="5643cd6e2f0a396a7c7f5aa76ae50b179dfbe75c50f8f250897c6dbe7c2f1f94" Mar 16 17:03:33 crc kubenswrapper[5120]: I0316 17:03:33.572901 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Mar 16 17:03:33 crc kubenswrapper[5120]: I0316 17:03:33.615638 5120 scope.go:117] "RemoveContainer" containerID="e1cc7167cc6d60a4ebf70616ac23d4c7c61e0ea254b4ce5939c1c303a76ba999" Mar 16 17:03:33 crc kubenswrapper[5120]: I0316 17:03:33.621801 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 17:03:33 crc kubenswrapper[5120]: I0316 17:03:33.628074 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 17:03:33 crc kubenswrapper[5120]: I0316 17:03:33.638926 5120 scope.go:117] "RemoveContainer" containerID="7e94fadc150440b2d15eda43c6265cf951173e81b5007cba27bd451ccf2a34f8" Mar 16 17:03:33 crc kubenswrapper[5120]: I0316 17:03:33.655556 5120 scope.go:117] "RemoveContainer" containerID="44cf1d2680a6b0bd1f3ea49fc5485a76fb86944c47db006aee554801e08df0ce" Mar 16 17:03:33 crc kubenswrapper[5120]: I0316 17:03:33.673804 5120 scope.go:117] "RemoveContainer" containerID="44cb080f8154154a4a36b453ce52f3a77a483a82435bbd06cdd2e041a88fb9cc" Mar 16 17:03:33 crc kubenswrapper[5120]: I0316 17:03:33.694430 5120 scope.go:117] "RemoveContainer" containerID="8497a6be2923c0f36c47bb5031075424a0eb72cef279454537d1ede5f1036d3c" Mar 16 17:03:33 crc kubenswrapper[5120]: I0316 17:03:33.710960 5120 scope.go:117] "RemoveContainer" containerID="dc957e1a9d7bc3e1ab0c920f56da07e7a63162092103ea420708963bc78c77e9" Mar 16 17:03:33 crc kubenswrapper[5120]: I0316 17:03:33.728050 5120 scope.go:117] "RemoveContainer" containerID="77cf0e12f17307ccf6f98722a30265dbbf68f31c9b3098530603d4e4c87c55ce" Mar 16 17:03:33 crc kubenswrapper[5120]: I0316 17:03:33.745448 5120 scope.go:117] "RemoveContainer" containerID="e53436fec9df727dcd2d2beeb431759ec0856450eefd69d18611fc1b41806ac9" Mar 16 17:03:33 crc kubenswrapper[5120]: I0316 17:03:33.761485 5120 scope.go:117] "RemoveContainer" containerID="6469ce05f121fe416edfe1512f28049f6202b5c14ef3a421880ed284e3723c03" Mar 16 17:03:33 crc kubenswrapper[5120]: I0316 17:03:33.777921 5120 scope.go:117] "RemoveContainer" containerID="1c06198550f093ba013bceb3903d2c570a51a69e1b891c5f9d6eb3066933c0e3" Mar 16 17:03:33 crc kubenswrapper[5120]: I0316 17:03:33.800956 5120 scope.go:117] "RemoveContainer" containerID="9badd4ead08b15df51406a2e575e802a71fbfbdcabc5450a726e56b4e5258fde" Mar 16 17:03:33 crc kubenswrapper[5120]: I0316 17:03:33.828683 5120 scope.go:117] "RemoveContainer" containerID="095159c69aab52ae8cd46d98b8a125878d38f737cac679858fce218635fcab9f" Mar 16 17:03:33 crc kubenswrapper[5120]: I0316 17:03:33.850074 5120 scope.go:117] "RemoveContainer" containerID="39849e89c2ccc6af9f65a47428e8a27cfc4f4cdd9dae01876c7ffcc1c8ec9cdf" Mar 16 17:03:33 crc kubenswrapper[5120]: I0316 17:03:33.870862 5120 scope.go:117] "RemoveContainer" containerID="6ca5d6ea4402f88922cc4bdc75810ff0810c7269d939fc714fc5d2581a0381bf" Mar 16 17:03:34 crc kubenswrapper[5120]: E0316 17:03:34.132164 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="8d1a8aa9bd86f2402b10b59285567fd78f4d62123af2fd8a44ad19b94394c08b" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 17:03:34 crc kubenswrapper[5120]: E0316 17:03:34.133532 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="8d1a8aa9bd86f2402b10b59285567fd78f4d62123af2fd8a44ad19b94394c08b" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 17:03:34 crc kubenswrapper[5120]: E0316 17:03:34.134622 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="8d1a8aa9bd86f2402b10b59285567fd78f4d62123af2fd8a44ad19b94394c08b" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 17:03:34 crc kubenswrapper[5120]: E0316 17:03:34.134661 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="61d14db6-7d33-4e5f-8252-844441e519d7" containerName="nova-cell1-conductor-conductor" probeResult="unknown" Mar 16 17:03:34 crc kubenswrapper[5120]: I0316 17:03:34.679141 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aeacde0e-2862-4e69-9e7d-b88ca35912b8" path="/var/lib/kubelet/pods/aeacde0e-2862-4e69-9e7d-b88ca35912b8/volumes" Mar 16 17:03:35 crc kubenswrapper[5120]: I0316 17:03:35.205602 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 17:03:35 crc kubenswrapper[5120]: I0316 17:03:35.337131 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-czgrr\" (UniqueName: \"kubernetes.io/projected/61d14db6-7d33-4e5f-8252-844441e519d7-kube-api-access-czgrr\") pod \"61d14db6-7d33-4e5f-8252-844441e519d7\" (UID: \"61d14db6-7d33-4e5f-8252-844441e519d7\") " Mar 16 17:03:35 crc kubenswrapper[5120]: I0316 17:03:35.337406 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/61d14db6-7d33-4e5f-8252-844441e519d7-config-data\") pod \"61d14db6-7d33-4e5f-8252-844441e519d7\" (UID: \"61d14db6-7d33-4e5f-8252-844441e519d7\") " Mar 16 17:03:35 crc kubenswrapper[5120]: I0316 17:03:35.337621 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/61d14db6-7d33-4e5f-8252-844441e519d7-combined-ca-bundle\") pod \"61d14db6-7d33-4e5f-8252-844441e519d7\" (UID: \"61d14db6-7d33-4e5f-8252-844441e519d7\") " Mar 16 17:03:35 crc kubenswrapper[5120]: I0316 17:03:35.344984 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61d14db6-7d33-4e5f-8252-844441e519d7-kube-api-access-czgrr" (OuterVolumeSpecName: "kube-api-access-czgrr") pod "61d14db6-7d33-4e5f-8252-844441e519d7" (UID: "61d14db6-7d33-4e5f-8252-844441e519d7"). InnerVolumeSpecName "kube-api-access-czgrr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:03:35 crc kubenswrapper[5120]: I0316 17:03:35.359214 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61d14db6-7d33-4e5f-8252-844441e519d7-config-data" (OuterVolumeSpecName: "config-data") pod "61d14db6-7d33-4e5f-8252-844441e519d7" (UID: "61d14db6-7d33-4e5f-8252-844441e519d7"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:03:35 crc kubenswrapper[5120]: I0316 17:03:35.359429 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61d14db6-7d33-4e5f-8252-844441e519d7-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "61d14db6-7d33-4e5f-8252-844441e519d7" (UID: "61d14db6-7d33-4e5f-8252-844441e519d7"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:03:35 crc kubenswrapper[5120]: I0316 17:03:35.440172 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-czgrr\" (UniqueName: \"kubernetes.io/projected/61d14db6-7d33-4e5f-8252-844441e519d7-kube-api-access-czgrr\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:35 crc kubenswrapper[5120]: I0316 17:03:35.440209 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/61d14db6-7d33-4e5f-8252-844441e519d7-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:35 crc kubenswrapper[5120]: I0316 17:03:35.440221 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/61d14db6-7d33-4e5f-8252-844441e519d7-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:03:35 crc kubenswrapper[5120]: I0316 17:03:35.601905 5120 generic.go:358] "Generic (PLEG): container finished" podID="61d14db6-7d33-4e5f-8252-844441e519d7" containerID="8d1a8aa9bd86f2402b10b59285567fd78f4d62123af2fd8a44ad19b94394c08b" exitCode=137 Mar 16 17:03:35 crc kubenswrapper[5120]: I0316 17:03:35.601955 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"61d14db6-7d33-4e5f-8252-844441e519d7","Type":"ContainerDied","Data":"8d1a8aa9bd86f2402b10b59285567fd78f4d62123af2fd8a44ad19b94394c08b"} Mar 16 17:03:35 crc kubenswrapper[5120]: I0316 17:03:35.602011 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"61d14db6-7d33-4e5f-8252-844441e519d7","Type":"ContainerDied","Data":"82fa72826c06109e8772cf9c98727021004549d688ca10308fa6a52578eadb84"} Mar 16 17:03:35 crc kubenswrapper[5120]: I0316 17:03:35.602033 5120 scope.go:117] "RemoveContainer" containerID="8d1a8aa9bd86f2402b10b59285567fd78f4d62123af2fd8a44ad19b94394c08b" Mar 16 17:03:35 crc kubenswrapper[5120]: I0316 17:03:35.602303 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 17:03:35 crc kubenswrapper[5120]: I0316 17:03:35.628388 5120 scope.go:117] "RemoveContainer" containerID="3f4aafa32edd97a4cd6857832bfde24c5f9a3e7c30285ec0f3a7bd7c08f686da" Mar 16 17:03:35 crc kubenswrapper[5120]: I0316 17:03:35.643373 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 17:03:35 crc kubenswrapper[5120]: I0316 17:03:35.650012 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 17:03:35 crc kubenswrapper[5120]: I0316 17:03:35.689312 5120 scope.go:117] "RemoveContainer" containerID="8d1a8aa9bd86f2402b10b59285567fd78f4d62123af2fd8a44ad19b94394c08b" Mar 16 17:03:35 crc kubenswrapper[5120]: E0316 17:03:35.689749 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d1a8aa9bd86f2402b10b59285567fd78f4d62123af2fd8a44ad19b94394c08b\": container with ID starting with 8d1a8aa9bd86f2402b10b59285567fd78f4d62123af2fd8a44ad19b94394c08b not found: ID does not exist" containerID="8d1a8aa9bd86f2402b10b59285567fd78f4d62123af2fd8a44ad19b94394c08b" Mar 16 17:03:35 crc kubenswrapper[5120]: I0316 17:03:35.689816 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d1a8aa9bd86f2402b10b59285567fd78f4d62123af2fd8a44ad19b94394c08b"} err="failed to get container status \"8d1a8aa9bd86f2402b10b59285567fd78f4d62123af2fd8a44ad19b94394c08b\": rpc error: code = NotFound desc = could not find container \"8d1a8aa9bd86f2402b10b59285567fd78f4d62123af2fd8a44ad19b94394c08b\": container with ID starting with 8d1a8aa9bd86f2402b10b59285567fd78f4d62123af2fd8a44ad19b94394c08b not found: ID does not exist" Mar 16 17:03:35 crc kubenswrapper[5120]: I0316 17:03:35.689843 5120 scope.go:117] "RemoveContainer" containerID="3f4aafa32edd97a4cd6857832bfde24c5f9a3e7c30285ec0f3a7bd7c08f686da" Mar 16 17:03:35 crc kubenswrapper[5120]: E0316 17:03:35.690068 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f4aafa32edd97a4cd6857832bfde24c5f9a3e7c30285ec0f3a7bd7c08f686da\": container with ID starting with 3f4aafa32edd97a4cd6857832bfde24c5f9a3e7c30285ec0f3a7bd7c08f686da not found: ID does not exist" containerID="3f4aafa32edd97a4cd6857832bfde24c5f9a3e7c30285ec0f3a7bd7c08f686da" Mar 16 17:03:35 crc kubenswrapper[5120]: I0316 17:03:35.690083 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f4aafa32edd97a4cd6857832bfde24c5f9a3e7c30285ec0f3a7bd7c08f686da"} err="failed to get container status \"3f4aafa32edd97a4cd6857832bfde24c5f9a3e7c30285ec0f3a7bd7c08f686da\": rpc error: code = NotFound desc = could not find container \"3f4aafa32edd97a4cd6857832bfde24c5f9a3e7c30285ec0f3a7bd7c08f686da\": container with ID starting with 3f4aafa32edd97a4cd6857832bfde24c5f9a3e7c30285ec0f3a7bd7c08f686da not found: ID does not exist" Mar 16 17:03:36 crc kubenswrapper[5120]: I0316 17:03:36.673752 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="61d14db6-7d33-4e5f-8252-844441e519d7" path="/var/lib/kubelet/pods/61d14db6-7d33-4e5f-8252-844441e519d7/volumes" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.019283 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.021681 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61d14db6-7d33-4e5f-8252-844441e519d7" containerName="nova-cell1-conductor-conductor" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.021721 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="61d14db6-7d33-4e5f-8252-844441e519d7" containerName="nova-cell1-conductor-conductor" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.021745 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="615448b7-8677-4a99-93ba-64a2388a6dcc" containerName="openstack-network-exporter" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.021758 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="615448b7-8677-4a99-93ba-64a2388a6dcc" containerName="openstack-network-exporter" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.021792 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="284dc632-d111-40d1-97a9-f6e78aa92ce7" containerName="nova-cell0-conductor-conductor" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.021801 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="284dc632-d111-40d1-97a9-f6e78aa92ce7" containerName="nova-cell0-conductor-conductor" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.021811 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61d14db6-7d33-4e5f-8252-844441e519d7" containerName="nova-cell1-conductor-conductor" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.021818 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="61d14db6-7d33-4e5f-8252-844441e519d7" containerName="nova-cell1-conductor-conductor" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.021827 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="593ab600-83e5-4863-b042-4fd69af25046" containerName="nova-api-api" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.021835 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="593ab600-83e5-4863-b042-4fd69af25046" containerName="nova-api-api" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.021843 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="532a5c65-05a2-4018-9244-1386bf31dcb2" containerName="keystone-api" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.021851 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="532a5c65-05a2-4018-9244-1386bf31dcb2" containerName="keystone-api" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.021872 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70e3d80b-ae48-4742-90dd-95c106254f9f" containerName="mariadb-account-create-update" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.021879 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="70e3d80b-ae48-4742-90dd-95c106254f9f" containerName="mariadb-account-create-update" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.021888 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4740a262-b05d-4d08-a797-022ca51bbf69" containerName="glance-httpd" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.021898 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="4740a262-b05d-4d08-a797-022ca51bbf69" containerName="glance-httpd" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.021912 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aeacde0e-2862-4e69-9e7d-b88ca35912b8" containerName="account-server" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.021921 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="aeacde0e-2862-4e69-9e7d-b88ca35912b8" containerName="account-server" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.021937 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61f313f6-217b-4ab6-aaf9-2b45cb201326" containerName="proxy-server" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.021945 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="61f313f6-217b-4ab6-aaf9-2b45cb201326" containerName="proxy-server" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.021955 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ed551c0-3f37-4af6-b682-b9e35fd5fa42" containerName="rabbitmq" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.021963 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ed551c0-3f37-4af6-b682-b9e35fd5fa42" containerName="rabbitmq" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.021976 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1afd582f-b48e-4483-8f98-8d4e7d54fabb" containerName="init" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.021984 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1afd582f-b48e-4483-8f98-8d4e7d54fabb" containerName="init" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.021995 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13b65e37-9126-401e-9ef6-3e531453aaba" containerName="galera" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.022003 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="13b65e37-9126-401e-9ef6-3e531453aaba" containerName="galera" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.022016 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53cbb212-f009-4d4e-90fc-9a50a14cc62b" containerName="barbican-api" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.022024 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="53cbb212-f009-4d4e-90fc-9a50a14cc62b" containerName="barbican-api" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.022036 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c88b7d39-fb86-490a-8af1-a6754dab05c9" containerName="glance-log" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.022044 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c88b7d39-fb86-490a-8af1-a6754dab05c9" containerName="glance-log" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.022062 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d226072d-5d81-4c83-ade7-29bdc1df4c80" containerName="nova-scheduler-scheduler" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.022070 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="d226072d-5d81-4c83-ade7-29bdc1df4c80" containerName="nova-scheduler-scheduler" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.022080 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20dac7f8-f03f-40f8-93f1-5ba59f5471b8" containerName="barbican-keystone-listener-log" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.022088 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="20dac7f8-f03f-40f8-93f1-5ba59f5471b8" containerName="barbican-keystone-listener-log" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.022099 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb7a2068-5a18-4c7b-92d0-364f371d59df" containerName="barbican-worker" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.022106 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb7a2068-5a18-4c7b-92d0-364f371d59df" containerName="barbican-worker" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.022127 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1afd582f-b48e-4483-8f98-8d4e7d54fabb" containerName="dnsmasq-dns" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.022135 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1afd582f-b48e-4483-8f98-8d4e7d54fabb" containerName="dnsmasq-dns" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.022149 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="394193fd-f8e0-4b81-8821-8d1251a0274b" containerName="neutron-api" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.022162 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="394193fd-f8e0-4b81-8821-8d1251a0274b" containerName="neutron-api" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.022172 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb7a2068-5a18-4c7b-92d0-364f371d59df" containerName="barbican-worker-log" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.022180 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb7a2068-5a18-4c7b-92d0-364f371d59df" containerName="barbican-worker-log" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.022193 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b6e7f67-ee2d-4fbc-9519-00493157aec0" containerName="nova-metadata-log" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.022201 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b6e7f67-ee2d-4fbc-9519-00493157aec0" containerName="nova-metadata-log" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.022216 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aeacde0e-2862-4e69-9e7d-b88ca35912b8" containerName="account-auditor" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.022224 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="aeacde0e-2862-4e69-9e7d-b88ca35912b8" containerName="account-auditor" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.022232 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="284dc632-d111-40d1-97a9-f6e78aa92ce7" containerName="nova-cell0-conductor-conductor" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.022241 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="284dc632-d111-40d1-97a9-f6e78aa92ce7" containerName="nova-cell0-conductor-conductor" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.022252 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="662e5dd1-e157-4e76-bb3d-f4310c982cb0" containerName="cinder-api-log" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.022260 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="662e5dd1-e157-4e76-bb3d-f4310c982cb0" containerName="cinder-api-log" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.022269 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c88b7d39-fb86-490a-8af1-a6754dab05c9" containerName="glance-httpd" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.022277 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c88b7d39-fb86-490a-8af1-a6754dab05c9" containerName="glance-httpd" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.022286 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70e3d80b-ae48-4742-90dd-95c106254f9f" containerName="mariadb-account-create-update" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.022294 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="70e3d80b-ae48-4742-90dd-95c106254f9f" containerName="mariadb-account-create-update" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.022305 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61d14db6-7d33-4e5f-8252-844441e519d7" containerName="nova-cell1-conductor-conductor" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.022314 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="61d14db6-7d33-4e5f-8252-844441e519d7" containerName="nova-cell1-conductor-conductor" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.022326 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61f313f6-217b-4ab6-aaf9-2b45cb201326" containerName="proxy-httpd" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.022333 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="61f313f6-217b-4ab6-aaf9-2b45cb201326" containerName="proxy-httpd" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.022347 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aeacde0e-2862-4e69-9e7d-b88ca35912b8" containerName="object-server" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.022354 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="aeacde0e-2862-4e69-9e7d-b88ca35912b8" containerName="object-server" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.022366 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aeacde0e-2862-4e69-9e7d-b88ca35912b8" containerName="container-server" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.022374 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="aeacde0e-2862-4e69-9e7d-b88ca35912b8" containerName="container-server" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.022387 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d226072d-5d81-4c83-ade7-29bdc1df4c80" containerName="nova-scheduler-scheduler" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.022395 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="d226072d-5d81-4c83-ade7-29bdc1df4c80" containerName="nova-scheduler-scheduler" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.022409 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aeacde0e-2862-4e69-9e7d-b88ca35912b8" containerName="object-auditor" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.022418 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="aeacde0e-2862-4e69-9e7d-b88ca35912b8" containerName="object-auditor" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.022432 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d226072d-5d81-4c83-ade7-29bdc1df4c80" containerName="nova-scheduler-scheduler" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.022440 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="d226072d-5d81-4c83-ade7-29bdc1df4c80" containerName="nova-scheduler-scheduler" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.022456 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aeacde0e-2862-4e69-9e7d-b88ca35912b8" containerName="account-reaper" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.022465 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="aeacde0e-2862-4e69-9e7d-b88ca35912b8" containerName="account-reaper" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.022480 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="279c3e84-623c-4c5f-ae15-d7d8c439c4dc" containerName="rabbitmq" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.022488 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="279c3e84-623c-4c5f-ae15-d7d8c439c4dc" containerName="rabbitmq" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.022503 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b6e7f67-ee2d-4fbc-9519-00493157aec0" containerName="nova-metadata-metadata" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.022513 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b6e7f67-ee2d-4fbc-9519-00493157aec0" containerName="nova-metadata-metadata" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.022524 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13b65e37-9126-401e-9ef6-3e531453aaba" containerName="mysql-bootstrap" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.022531 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="13b65e37-9126-401e-9ef6-3e531453aaba" containerName="mysql-bootstrap" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.022539 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aeacde0e-2862-4e69-9e7d-b88ca35912b8" containerName="object-replicator" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.022548 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="aeacde0e-2862-4e69-9e7d-b88ca35912b8" containerName="object-replicator" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.022558 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="615448b7-8677-4a99-93ba-64a2388a6dcc" containerName="ovn-northd" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.022565 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="615448b7-8677-4a99-93ba-64a2388a6dcc" containerName="ovn-northd" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.022577 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61d14db6-7d33-4e5f-8252-844441e519d7" containerName="nova-cell1-conductor-conductor" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.022585 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="61d14db6-7d33-4e5f-8252-844441e519d7" containerName="nova-cell1-conductor-conductor" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.022595 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aeacde0e-2862-4e69-9e7d-b88ca35912b8" containerName="object-updater" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.022601 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="aeacde0e-2862-4e69-9e7d-b88ca35912b8" containerName="object-updater" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.022614 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aeacde0e-2862-4e69-9e7d-b88ca35912b8" containerName="swift-recon-cron" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.022621 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="aeacde0e-2862-4e69-9e7d-b88ca35912b8" containerName="swift-recon-cron" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.022630 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ed551c0-3f37-4af6-b682-b9e35fd5fa42" containerName="setup-container" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.022637 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ed551c0-3f37-4af6-b682-b9e35fd5fa42" containerName="setup-container" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.022648 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53cbb212-f009-4d4e-90fc-9a50a14cc62b" containerName="barbican-api-log" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.022656 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="53cbb212-f009-4d4e-90fc-9a50a14cc62b" containerName="barbican-api-log" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.022668 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="394193fd-f8e0-4b81-8821-8d1251a0274b" containerName="neutron-httpd" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.022675 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="394193fd-f8e0-4b81-8821-8d1251a0274b" containerName="neutron-httpd" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.022685 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20dac7f8-f03f-40f8-93f1-5ba59f5471b8" containerName="barbican-keystone-listener" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.022693 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="20dac7f8-f03f-40f8-93f1-5ba59f5471b8" containerName="barbican-keystone-listener" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.022709 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aeacde0e-2862-4e69-9e7d-b88ca35912b8" containerName="object-expirer" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.022716 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="aeacde0e-2862-4e69-9e7d-b88ca35912b8" containerName="object-expirer" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.022728 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2c4ebb0-3217-469c-88b5-b06d50a9db60" containerName="memcached" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.022735 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2c4ebb0-3217-469c-88b5-b06d50a9db60" containerName="memcached" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.022751 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aeacde0e-2862-4e69-9e7d-b88ca35912b8" containerName="container-auditor" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.022784 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="aeacde0e-2862-4e69-9e7d-b88ca35912b8" containerName="container-auditor" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.022809 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aeacde0e-2862-4e69-9e7d-b88ca35912b8" containerName="container-updater" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.022818 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="aeacde0e-2862-4e69-9e7d-b88ca35912b8" containerName="container-updater" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.022828 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aeacde0e-2862-4e69-9e7d-b88ca35912b8" containerName="account-replicator" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.022836 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="aeacde0e-2862-4e69-9e7d-b88ca35912b8" containerName="account-replicator" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.022848 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aeacde0e-2862-4e69-9e7d-b88ca35912b8" containerName="rsync" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.022858 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="aeacde0e-2862-4e69-9e7d-b88ca35912b8" containerName="rsync" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.022871 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4740a262-b05d-4d08-a797-022ca51bbf69" containerName="glance-log" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.022879 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="4740a262-b05d-4d08-a797-022ca51bbf69" containerName="glance-log" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.022896 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="279c3e84-623c-4c5f-ae15-d7d8c439c4dc" containerName="setup-container" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.022904 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="279c3e84-623c-4c5f-ae15-d7d8c439c4dc" containerName="setup-container" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.022920 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="662e5dd1-e157-4e76-bb3d-f4310c982cb0" containerName="cinder-api" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.022928 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="662e5dd1-e157-4e76-bb3d-f4310c982cb0" containerName="cinder-api" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.022946 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aeacde0e-2862-4e69-9e7d-b88ca35912b8" containerName="container-replicator" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.022954 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="aeacde0e-2862-4e69-9e7d-b88ca35912b8" containerName="container-replicator" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.022966 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="593ab600-83e5-4863-b042-4fd69af25046" containerName="nova-api-log" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.022973 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="593ab600-83e5-4863-b042-4fd69af25046" containerName="nova-api-log" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.023223 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="13b65e37-9126-401e-9ef6-3e531453aaba" containerName="galera" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.023254 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="aeacde0e-2862-4e69-9e7d-b88ca35912b8" containerName="account-replicator" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.023269 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="aeacde0e-2862-4e69-9e7d-b88ca35912b8" containerName="rsync" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.023283 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="61f313f6-217b-4ab6-aaf9-2b45cb201326" containerName="proxy-httpd" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.023294 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="20dac7f8-f03f-40f8-93f1-5ba59f5471b8" containerName="barbican-keystone-listener-log" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.023305 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="aeacde0e-2862-4e69-9e7d-b88ca35912b8" containerName="object-server" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.023317 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="662e5dd1-e157-4e76-bb3d-f4310c982cb0" containerName="cinder-api-log" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.023329 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="53cbb212-f009-4d4e-90fc-9a50a14cc62b" containerName="barbican-api" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.023341 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="aeacde0e-2862-4e69-9e7d-b88ca35912b8" containerName="account-auditor" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.023355 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="aeacde0e-2862-4e69-9e7d-b88ca35912b8" containerName="object-expirer" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.023370 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="fb7a2068-5a18-4c7b-92d0-364f371d59df" containerName="barbican-worker-log" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.023379 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="a2c4ebb0-3217-469c-88b5-b06d50a9db60" containerName="memcached" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.023392 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="aeacde0e-2862-4e69-9e7d-b88ca35912b8" containerName="object-replicator" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.023405 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="61d14db6-7d33-4e5f-8252-844441e519d7" containerName="nova-cell1-conductor-conductor" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.023413 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="61d14db6-7d33-4e5f-8252-844441e519d7" containerName="nova-cell1-conductor-conductor" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.023422 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="aeacde0e-2862-4e69-9e7d-b88ca35912b8" containerName="object-updater" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.023439 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c88b7d39-fb86-490a-8af1-a6754dab05c9" containerName="glance-log" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.023454 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="284dc632-d111-40d1-97a9-f6e78aa92ce7" containerName="nova-cell0-conductor-conductor" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.023465 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="615448b7-8677-4a99-93ba-64a2388a6dcc" containerName="ovn-northd" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.023475 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="aeacde0e-2862-4e69-9e7d-b88ca35912b8" containerName="account-server" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.023486 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="aeacde0e-2862-4e69-9e7d-b88ca35912b8" containerName="swift-recon-cron" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.023497 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="61d14db6-7d33-4e5f-8252-844441e519d7" containerName="nova-cell1-conductor-conductor" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.023508 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="279c3e84-623c-4c5f-ae15-d7d8c439c4dc" containerName="rabbitmq" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.023519 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="593ab600-83e5-4863-b042-4fd69af25046" containerName="nova-api-log" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.023534 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="5b6e7f67-ee2d-4fbc-9519-00493157aec0" containerName="nova-metadata-metadata" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.023544 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="d226072d-5d81-4c83-ade7-29bdc1df4c80" containerName="nova-scheduler-scheduler" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.023553 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="53cbb212-f009-4d4e-90fc-9a50a14cc62b" containerName="barbican-api-log" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.023567 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="394193fd-f8e0-4b81-8821-8d1251a0274b" containerName="neutron-api" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.023578 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="4ed551c0-3f37-4af6-b682-b9e35fd5fa42" containerName="rabbitmq" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.023591 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="70e3d80b-ae48-4742-90dd-95c106254f9f" containerName="mariadb-account-create-update" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.023606 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="4740a262-b05d-4d08-a797-022ca51bbf69" containerName="glance-log" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.023621 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="aeacde0e-2862-4e69-9e7d-b88ca35912b8" containerName="container-updater" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.023634 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="593ab600-83e5-4863-b042-4fd69af25046" containerName="nova-api-api" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.023646 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c88b7d39-fb86-490a-8af1-a6754dab05c9" containerName="glance-httpd" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.023654 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="d226072d-5d81-4c83-ade7-29bdc1df4c80" containerName="nova-scheduler-scheduler" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.023663 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="aeacde0e-2862-4e69-9e7d-b88ca35912b8" containerName="container-server" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.023671 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="d226072d-5d81-4c83-ade7-29bdc1df4c80" containerName="nova-scheduler-scheduler" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.023679 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="4740a262-b05d-4d08-a797-022ca51bbf69" containerName="glance-httpd" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.023693 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="5b6e7f67-ee2d-4fbc-9519-00493157aec0" containerName="nova-metadata-log" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.023705 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="394193fd-f8e0-4b81-8821-8d1251a0274b" containerName="neutron-httpd" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.023717 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="aeacde0e-2862-4e69-9e7d-b88ca35912b8" containerName="container-auditor" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.023728 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="aeacde0e-2862-4e69-9e7d-b88ca35912b8" containerName="account-reaper" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.023739 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="70e3d80b-ae48-4742-90dd-95c106254f9f" containerName="mariadb-account-create-update" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.023747 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1afd582f-b48e-4483-8f98-8d4e7d54fabb" containerName="dnsmasq-dns" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.023782 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="61f313f6-217b-4ab6-aaf9-2b45cb201326" containerName="proxy-server" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.023790 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="20dac7f8-f03f-40f8-93f1-5ba59f5471b8" containerName="barbican-keystone-listener" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.023801 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="fb7a2068-5a18-4c7b-92d0-364f371d59df" containerName="barbican-worker" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.023813 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="615448b7-8677-4a99-93ba-64a2388a6dcc" containerName="openstack-network-exporter" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.023828 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="532a5c65-05a2-4018-9244-1386bf31dcb2" containerName="keystone-api" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.023838 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="aeacde0e-2862-4e69-9e7d-b88ca35912b8" containerName="container-replicator" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.023852 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="aeacde0e-2862-4e69-9e7d-b88ca35912b8" containerName="object-auditor" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.023862 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="662e5dd1-e157-4e76-bb3d-f4310c982cb0" containerName="cinder-api" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.024127 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61d14db6-7d33-4e5f-8252-844441e519d7" containerName="nova-cell1-conductor-conductor" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.024137 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="61d14db6-7d33-4e5f-8252-844441e519d7" containerName="nova-cell1-conductor-conductor" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.024315 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="61d14db6-7d33-4e5f-8252-844441e519d7" containerName="nova-cell1-conductor-conductor" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.024330 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="284dc632-d111-40d1-97a9-f6e78aa92ce7" containerName="nova-cell0-conductor-conductor" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.024358 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="61d14db6-7d33-4e5f-8252-844441e519d7" containerName="nova-cell1-conductor-conductor" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.032437 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.032684 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.035421 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-cell1-plugins-conf\"" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.036046 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-cell1-erlang-cookie\"" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.036070 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-cell1-server-conf\"" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.036378 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-cell1-default-user\"" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.038876 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-cell1-config-data\"" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.039290 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-cell1-server-dockercfg-ccv88\"" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.039469 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-rabbitmq-cell1-svc\"" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.115647 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/259e8ab8-dfd3-414c-b392-951a9f770559-plugins-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"259e8ab8-dfd3-414c-b392-951a9f770559\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.115749 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/259e8ab8-dfd3-414c-b392-951a9f770559-pod-info\") pod \"rabbitmq-cell1-server-0\" (UID: \"259e8ab8-dfd3-414c-b392-951a9f770559\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.116045 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/259e8ab8-dfd3-414c-b392-951a9f770559-rabbitmq-erlang-cookie\") pod \"rabbitmq-cell1-server-0\" (UID: \"259e8ab8-dfd3-414c-b392-951a9f770559\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.116177 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtqrc\" (UniqueName: \"kubernetes.io/projected/259e8ab8-dfd3-414c-b392-951a9f770559-kube-api-access-vtqrc\") pod \"rabbitmq-cell1-server-0\" (UID: \"259e8ab8-dfd3-414c-b392-951a9f770559\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.116248 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/259e8ab8-dfd3-414c-b392-951a9f770559-rabbitmq-tls\") pod \"rabbitmq-cell1-server-0\" (UID: \"259e8ab8-dfd3-414c-b392-951a9f770559\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.116384 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage07-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"259e8ab8-dfd3-414c-b392-951a9f770559\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.116438 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/259e8ab8-dfd3-414c-b392-951a9f770559-server-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"259e8ab8-dfd3-414c-b392-951a9f770559\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.116461 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/259e8ab8-dfd3-414c-b392-951a9f770559-erlang-cookie-secret\") pod \"rabbitmq-cell1-server-0\" (UID: \"259e8ab8-dfd3-414c-b392-951a9f770559\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.116481 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/259e8ab8-dfd3-414c-b392-951a9f770559-rabbitmq-confd\") pod \"rabbitmq-cell1-server-0\" (UID: \"259e8ab8-dfd3-414c-b392-951a9f770559\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.116516 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/259e8ab8-dfd3-414c-b392-951a9f770559-config-data\") pod \"rabbitmq-cell1-server-0\" (UID: \"259e8ab8-dfd3-414c-b392-951a9f770559\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.116586 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/259e8ab8-dfd3-414c-b392-951a9f770559-rabbitmq-plugins\") pod \"rabbitmq-cell1-server-0\" (UID: \"259e8ab8-dfd3-414c-b392-951a9f770559\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.218155 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/259e8ab8-dfd3-414c-b392-951a9f770559-pod-info\") pod \"rabbitmq-cell1-server-0\" (UID: \"259e8ab8-dfd3-414c-b392-951a9f770559\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.218252 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/259e8ab8-dfd3-414c-b392-951a9f770559-rabbitmq-erlang-cookie\") pod \"rabbitmq-cell1-server-0\" (UID: \"259e8ab8-dfd3-414c-b392-951a9f770559\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.218291 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vtqrc\" (UniqueName: \"kubernetes.io/projected/259e8ab8-dfd3-414c-b392-951a9f770559-kube-api-access-vtqrc\") pod \"rabbitmq-cell1-server-0\" (UID: \"259e8ab8-dfd3-414c-b392-951a9f770559\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.218324 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/259e8ab8-dfd3-414c-b392-951a9f770559-rabbitmq-tls\") pod \"rabbitmq-cell1-server-0\" (UID: \"259e8ab8-dfd3-414c-b392-951a9f770559\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.218410 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage07-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"259e8ab8-dfd3-414c-b392-951a9f770559\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.218457 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/259e8ab8-dfd3-414c-b392-951a9f770559-server-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"259e8ab8-dfd3-414c-b392-951a9f770559\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.218486 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/259e8ab8-dfd3-414c-b392-951a9f770559-erlang-cookie-secret\") pod \"rabbitmq-cell1-server-0\" (UID: \"259e8ab8-dfd3-414c-b392-951a9f770559\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.218509 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/259e8ab8-dfd3-414c-b392-951a9f770559-rabbitmq-confd\") pod \"rabbitmq-cell1-server-0\" (UID: \"259e8ab8-dfd3-414c-b392-951a9f770559\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.218542 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/259e8ab8-dfd3-414c-b392-951a9f770559-config-data\") pod \"rabbitmq-cell1-server-0\" (UID: \"259e8ab8-dfd3-414c-b392-951a9f770559\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.218610 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/259e8ab8-dfd3-414c-b392-951a9f770559-rabbitmq-plugins\") pod \"rabbitmq-cell1-server-0\" (UID: \"259e8ab8-dfd3-414c-b392-951a9f770559\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.218654 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/259e8ab8-dfd3-414c-b392-951a9f770559-plugins-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"259e8ab8-dfd3-414c-b392-951a9f770559\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.219622 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/259e8ab8-dfd3-414c-b392-951a9f770559-plugins-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"259e8ab8-dfd3-414c-b392-951a9f770559\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.220328 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/259e8ab8-dfd3-414c-b392-951a9f770559-rabbitmq-erlang-cookie\") pod \"rabbitmq-cell1-server-0\" (UID: \"259e8ab8-dfd3-414c-b392-951a9f770559\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.220683 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/259e8ab8-dfd3-414c-b392-951a9f770559-rabbitmq-plugins\") pod \"rabbitmq-cell1-server-0\" (UID: \"259e8ab8-dfd3-414c-b392-951a9f770559\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.220789 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage07-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"259e8ab8-dfd3-414c-b392-951a9f770559\") device mount path \"/mnt/openstack/pv07\"" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.220795 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/259e8ab8-dfd3-414c-b392-951a9f770559-server-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"259e8ab8-dfd3-414c-b392-951a9f770559\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.222396 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/259e8ab8-dfd3-414c-b392-951a9f770559-config-data\") pod \"rabbitmq-cell1-server-0\" (UID: \"259e8ab8-dfd3-414c-b392-951a9f770559\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.226842 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/259e8ab8-dfd3-414c-b392-951a9f770559-rabbitmq-confd\") pod \"rabbitmq-cell1-server-0\" (UID: \"259e8ab8-dfd3-414c-b392-951a9f770559\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.226892 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/259e8ab8-dfd3-414c-b392-951a9f770559-erlang-cookie-secret\") pod \"rabbitmq-cell1-server-0\" (UID: \"259e8ab8-dfd3-414c-b392-951a9f770559\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.234245 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/259e8ab8-dfd3-414c-b392-951a9f770559-rabbitmq-tls\") pod \"rabbitmq-cell1-server-0\" (UID: \"259e8ab8-dfd3-414c-b392-951a9f770559\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.236498 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/259e8ab8-dfd3-414c-b392-951a9f770559-pod-info\") pod \"rabbitmq-cell1-server-0\" (UID: \"259e8ab8-dfd3-414c-b392-951a9f770559\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.239699 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtqrc\" (UniqueName: \"kubernetes.io/projected/259e8ab8-dfd3-414c-b392-951a9f770559-kube-api-access-vtqrc\") pod \"rabbitmq-cell1-server-0\" (UID: \"259e8ab8-dfd3-414c-b392-951a9f770559\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.247273 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage07-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"259e8ab8-dfd3-414c-b392-951a9f770559\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.281471 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.288356 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.291515 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-default-user\"" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.297722 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-erlang-cookie\"" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.298194 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-rabbitmq-svc\"" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.298445 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-server-dockercfg-ggdb7\"" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.301275 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-server-conf\"" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.301548 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-config-data\"" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.301747 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-plugins-conf\"" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.303275 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.363092 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.423211 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/ef2e55ac-292f-4242-b410-0eb4d2ff90d3-pod-info\") pod \"rabbitmq-server-0\" (UID: \"ef2e55ac-292f-4242-b410-0eb4d2ff90d3\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.423309 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/ef2e55ac-292f-4242-b410-0eb4d2ff90d3-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"ef2e55ac-292f-4242-b410-0eb4d2ff90d3\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.423395 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/ef2e55ac-292f-4242-b410-0eb4d2ff90d3-rabbitmq-tls\") pod \"rabbitmq-server-0\" (UID: \"ef2e55ac-292f-4242-b410-0eb4d2ff90d3\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.423417 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/ef2e55ac-292f-4242-b410-0eb4d2ff90d3-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"ef2e55ac-292f-4242-b410-0eb4d2ff90d3\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.423451 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/ef2e55ac-292f-4242-b410-0eb4d2ff90d3-config-data\") pod \"rabbitmq-server-0\" (UID: \"ef2e55ac-292f-4242-b410-0eb4d2ff90d3\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.423488 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/ef2e55ac-292f-4242-b410-0eb4d2ff90d3-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"ef2e55ac-292f-4242-b410-0eb4d2ff90d3\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.423538 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bnv8n\" (UniqueName: \"kubernetes.io/projected/ef2e55ac-292f-4242-b410-0eb4d2ff90d3-kube-api-access-bnv8n\") pod \"rabbitmq-server-0\" (UID: \"ef2e55ac-292f-4242-b410-0eb4d2ff90d3\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.423558 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/ef2e55ac-292f-4242-b410-0eb4d2ff90d3-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"ef2e55ac-292f-4242-b410-0eb4d2ff90d3\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.423582 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/ef2e55ac-292f-4242-b410-0eb4d2ff90d3-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"ef2e55ac-292f-4242-b410-0eb4d2ff90d3\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.423719 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/ef2e55ac-292f-4242-b410-0eb4d2ff90d3-server-conf\") pod \"rabbitmq-server-0\" (UID: \"ef2e55ac-292f-4242-b410-0eb4d2ff90d3\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.423753 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"rabbitmq-server-0\" (UID: \"ef2e55ac-292f-4242-b410-0eb4d2ff90d3\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.525176 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/ef2e55ac-292f-4242-b410-0eb4d2ff90d3-config-data\") pod \"rabbitmq-server-0\" (UID: \"ef2e55ac-292f-4242-b410-0eb4d2ff90d3\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.525593 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/ef2e55ac-292f-4242-b410-0eb4d2ff90d3-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"ef2e55ac-292f-4242-b410-0eb4d2ff90d3\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.525897 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bnv8n\" (UniqueName: \"kubernetes.io/projected/ef2e55ac-292f-4242-b410-0eb4d2ff90d3-kube-api-access-bnv8n\") pod \"rabbitmq-server-0\" (UID: \"ef2e55ac-292f-4242-b410-0eb4d2ff90d3\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.525928 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/ef2e55ac-292f-4242-b410-0eb4d2ff90d3-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"ef2e55ac-292f-4242-b410-0eb4d2ff90d3\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.526416 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/ef2e55ac-292f-4242-b410-0eb4d2ff90d3-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"ef2e55ac-292f-4242-b410-0eb4d2ff90d3\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.526469 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/ef2e55ac-292f-4242-b410-0eb4d2ff90d3-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"ef2e55ac-292f-4242-b410-0eb4d2ff90d3\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.527466 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/ef2e55ac-292f-4242-b410-0eb4d2ff90d3-server-conf\") pod \"rabbitmq-server-0\" (UID: \"ef2e55ac-292f-4242-b410-0eb4d2ff90d3\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.527514 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"rabbitmq-server-0\" (UID: \"ef2e55ac-292f-4242-b410-0eb4d2ff90d3\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.527758 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/ef2e55ac-292f-4242-b410-0eb4d2ff90d3-pod-info\") pod \"rabbitmq-server-0\" (UID: \"ef2e55ac-292f-4242-b410-0eb4d2ff90d3\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.527908 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/ef2e55ac-292f-4242-b410-0eb4d2ff90d3-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"ef2e55ac-292f-4242-b410-0eb4d2ff90d3\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.527185 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/ef2e55ac-292f-4242-b410-0eb4d2ff90d3-config-data\") pod \"rabbitmq-server-0\" (UID: \"ef2e55ac-292f-4242-b410-0eb4d2ff90d3\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.528359 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"rabbitmq-server-0\" (UID: \"ef2e55ac-292f-4242-b410-0eb4d2ff90d3\") device mount path \"/mnt/openstack/pv13\"" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.528713 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/ef2e55ac-292f-4242-b410-0eb4d2ff90d3-rabbitmq-tls\") pod \"rabbitmq-server-0\" (UID: \"ef2e55ac-292f-4242-b410-0eb4d2ff90d3\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.528759 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/ef2e55ac-292f-4242-b410-0eb4d2ff90d3-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"ef2e55ac-292f-4242-b410-0eb4d2ff90d3\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.528795 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/ef2e55ac-292f-4242-b410-0eb4d2ff90d3-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"ef2e55ac-292f-4242-b410-0eb4d2ff90d3\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.528821 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/ef2e55ac-292f-4242-b410-0eb4d2ff90d3-server-conf\") pod \"rabbitmq-server-0\" (UID: \"ef2e55ac-292f-4242-b410-0eb4d2ff90d3\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.529720 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/ef2e55ac-292f-4242-b410-0eb4d2ff90d3-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"ef2e55ac-292f-4242-b410-0eb4d2ff90d3\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.533009 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/ef2e55ac-292f-4242-b410-0eb4d2ff90d3-rabbitmq-tls\") pod \"rabbitmq-server-0\" (UID: \"ef2e55ac-292f-4242-b410-0eb4d2ff90d3\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.535291 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/ef2e55ac-292f-4242-b410-0eb4d2ff90d3-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"ef2e55ac-292f-4242-b410-0eb4d2ff90d3\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.535659 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/ef2e55ac-292f-4242-b410-0eb4d2ff90d3-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"ef2e55ac-292f-4242-b410-0eb4d2ff90d3\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.541486 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/ef2e55ac-292f-4242-b410-0eb4d2ff90d3-pod-info\") pod \"rabbitmq-server-0\" (UID: \"ef2e55ac-292f-4242-b410-0eb4d2ff90d3\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.544684 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bnv8n\" (UniqueName: \"kubernetes.io/projected/ef2e55ac-292f-4242-b410-0eb4d2ff90d3-kube-api-access-bnv8n\") pod \"rabbitmq-server-0\" (UID: \"ef2e55ac-292f-4242-b410-0eb4d2ff90d3\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.564571 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"rabbitmq-server-0\" (UID: \"ef2e55ac-292f-4242-b410-0eb4d2ff90d3\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.626603 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.733903 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.746004 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.749061 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.749597 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-config-data\"" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.749597 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"galera-openstack-dockercfg-ct9tq\"" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.749721 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-galera-openstack-svc\"" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.749969 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-scripts\"" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.764389 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"combined-ca-bundle\"" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.836178 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/8f7be4b3-fcec-41d8-9b93-a41201c60005-kolla-config\") pod \"openstack-galera-0\" (UID: \"8f7be4b3-fcec-41d8-9b93-a41201c60005\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.836549 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2dpt\" (UniqueName: \"kubernetes.io/projected/8f7be4b3-fcec-41d8-9b93-a41201c60005-kube-api-access-n2dpt\") pod \"openstack-galera-0\" (UID: \"8f7be4b3-fcec-41d8-9b93-a41201c60005\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.836596 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"openstack-galera-0\" (UID: \"8f7be4b3-fcec-41d8-9b93-a41201c60005\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.836615 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/8f7be4b3-fcec-41d8-9b93-a41201c60005-config-data-default\") pod \"openstack-galera-0\" (UID: \"8f7be4b3-fcec-41d8-9b93-a41201c60005\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.836708 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/8f7be4b3-fcec-41d8-9b93-a41201c60005-config-data-generated\") pod \"openstack-galera-0\" (UID: \"8f7be4b3-fcec-41d8-9b93-a41201c60005\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.836727 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/8f7be4b3-fcec-41d8-9b93-a41201c60005-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"8f7be4b3-fcec-41d8-9b93-a41201c60005\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.836754 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8f7be4b3-fcec-41d8-9b93-a41201c60005-operator-scripts\") pod \"openstack-galera-0\" (UID: \"8f7be4b3-fcec-41d8-9b93-a41201c60005\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.836801 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8f7be4b3-fcec-41d8-9b93-a41201c60005-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"8f7be4b3-fcec-41d8-9b93-a41201c60005\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.848466 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.940222 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8f7be4b3-fcec-41d8-9b93-a41201c60005-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"8f7be4b3-fcec-41d8-9b93-a41201c60005\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.940341 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/8f7be4b3-fcec-41d8-9b93-a41201c60005-kolla-config\") pod \"openstack-galera-0\" (UID: \"8f7be4b3-fcec-41d8-9b93-a41201c60005\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.940448 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n2dpt\" (UniqueName: \"kubernetes.io/projected/8f7be4b3-fcec-41d8-9b93-a41201c60005-kube-api-access-n2dpt\") pod \"openstack-galera-0\" (UID: \"8f7be4b3-fcec-41d8-9b93-a41201c60005\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.940504 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"openstack-galera-0\" (UID: \"8f7be4b3-fcec-41d8-9b93-a41201c60005\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.940574 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/8f7be4b3-fcec-41d8-9b93-a41201c60005-config-data-default\") pod \"openstack-galera-0\" (UID: \"8f7be4b3-fcec-41d8-9b93-a41201c60005\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.940732 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/8f7be4b3-fcec-41d8-9b93-a41201c60005-config-data-generated\") pod \"openstack-galera-0\" (UID: \"8f7be4b3-fcec-41d8-9b93-a41201c60005\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.940751 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/8f7be4b3-fcec-41d8-9b93-a41201c60005-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"8f7be4b3-fcec-41d8-9b93-a41201c60005\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.940792 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8f7be4b3-fcec-41d8-9b93-a41201c60005-operator-scripts\") pod \"openstack-galera-0\" (UID: \"8f7be4b3-fcec-41d8-9b93-a41201c60005\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.942418 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8f7be4b3-fcec-41d8-9b93-a41201c60005-operator-scripts\") pod \"openstack-galera-0\" (UID: \"8f7be4b3-fcec-41d8-9b93-a41201c60005\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.943140 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"openstack-galera-0\" (UID: \"8f7be4b3-fcec-41d8-9b93-a41201c60005\") device mount path \"/mnt/openstack/pv20\"" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.943689 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/8f7be4b3-fcec-41d8-9b93-a41201c60005-config-data-generated\") pod \"openstack-galera-0\" (UID: \"8f7be4b3-fcec-41d8-9b93-a41201c60005\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.944235 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/8f7be4b3-fcec-41d8-9b93-a41201c60005-kolla-config\") pod \"openstack-galera-0\" (UID: \"8f7be4b3-fcec-41d8-9b93-a41201c60005\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.945126 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/8f7be4b3-fcec-41d8-9b93-a41201c60005-config-data-default\") pod \"openstack-galera-0\" (UID: \"8f7be4b3-fcec-41d8-9b93-a41201c60005\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.947462 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/8f7be4b3-fcec-41d8-9b93-a41201c60005-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"8f7be4b3-fcec-41d8-9b93-a41201c60005\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.949150 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8f7be4b3-fcec-41d8-9b93-a41201c60005-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"8f7be4b3-fcec-41d8-9b93-a41201c60005\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.964893 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2dpt\" (UniqueName: \"kubernetes.io/projected/8f7be4b3-fcec-41d8-9b93-a41201c60005-kube-api-access-n2dpt\") pod \"openstack-galera-0\" (UID: \"8f7be4b3-fcec-41d8-9b93-a41201c60005\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:03:44 crc kubenswrapper[5120]: I0316 17:03:44.971731 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"openstack-galera-0\" (UID: \"8f7be4b3-fcec-41d8-9b93-a41201c60005\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:03:45 crc kubenswrapper[5120]: I0316 17:03:45.070002 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:03:45 crc kubenswrapper[5120]: I0316 17:03:45.205242 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 17:03:45 crc kubenswrapper[5120]: I0316 17:03:45.318642 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 17:03:45 crc kubenswrapper[5120]: W0316 17:03:45.334967 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8f7be4b3_fcec_41d8_9b93_a41201c60005.slice/crio-14e0a938f7873b66717cfd28df64638c437654550798b5ea9f4597d6a9aa5555 WatchSource:0}: Error finding container 14e0a938f7873b66717cfd28df64638c437654550798b5ea9f4597d6a9aa5555: Status 404 returned error can't find the container with id 14e0a938f7873b66717cfd28df64638c437654550798b5ea9f4597d6a9aa5555 Mar 16 17:03:45 crc kubenswrapper[5120]: I0316 17:03:45.703612 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"259e8ab8-dfd3-414c-b392-951a9f770559","Type":"ContainerStarted","Data":"824a9cdebaceb4238a2b74f53311169cfde00fc6ba8e52a8424ed5d8bd12c929"} Mar 16 17:03:45 crc kubenswrapper[5120]: I0316 17:03:45.710132 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"ef2e55ac-292f-4242-b410-0eb4d2ff90d3","Type":"ContainerStarted","Data":"7d0da671e12ee7417a6c5b0bac1f7504c2fd2a59aa47cd6a1acce9cb288c37c0"} Mar 16 17:03:45 crc kubenswrapper[5120]: I0316 17:03:45.712520 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"8f7be4b3-fcec-41d8-9b93-a41201c60005","Type":"ContainerStarted","Data":"60a0181a4eaeebcf2ae4e423742282cd4c2d215a2fa81882dbe1949313877686"} Mar 16 17:03:45 crc kubenswrapper[5120]: I0316 17:03:45.712549 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"8f7be4b3-fcec-41d8-9b93-a41201c60005","Type":"ContainerStarted","Data":"14e0a938f7873b66717cfd28df64638c437654550798b5ea9f4597d6a9aa5555"} Mar 16 17:03:46 crc kubenswrapper[5120]: I0316 17:03:46.090051 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 17:03:46 crc kubenswrapper[5120]: I0316 17:03:46.095348 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:03:46 crc kubenswrapper[5120]: I0316 17:03:46.097053 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-galera-openstack-cell1-svc\"" Mar 16 17:03:46 crc kubenswrapper[5120]: I0316 17:03:46.098256 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-cell1-config-data\"" Mar 16 17:03:46 crc kubenswrapper[5120]: I0316 17:03:46.098638 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-cell1-scripts\"" Mar 16 17:03:46 crc kubenswrapper[5120]: I0316 17:03:46.098742 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"galera-openstack-cell1-dockercfg-lq677\"" Mar 16 17:03:46 crc kubenswrapper[5120]: I0316 17:03:46.105407 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 17:03:46 crc kubenswrapper[5120]: I0316 17:03:46.167184 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/5eac4201-2543-460e-8643-d376fab79512-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"5eac4201-2543-460e-8643-d376fab79512\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:03:46 crc kubenswrapper[5120]: I0316 17:03:46.167241 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"openstack-cell1-galera-0\" (UID: \"5eac4201-2543-460e-8643-d376fab79512\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:03:46 crc kubenswrapper[5120]: I0316 17:03:46.167363 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/5eac4201-2543-460e-8643-d376fab79512-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"5eac4201-2543-460e-8643-d376fab79512\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:03:46 crc kubenswrapper[5120]: I0316 17:03:46.167415 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/5eac4201-2543-460e-8643-d376fab79512-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"5eac4201-2543-460e-8643-d376fab79512\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:03:46 crc kubenswrapper[5120]: I0316 17:03:46.167443 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5eac4201-2543-460e-8643-d376fab79512-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"5eac4201-2543-460e-8643-d376fab79512\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:03:46 crc kubenswrapper[5120]: I0316 17:03:46.167573 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5eac4201-2543-460e-8643-d376fab79512-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"5eac4201-2543-460e-8643-d376fab79512\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:03:46 crc kubenswrapper[5120]: I0316 17:03:46.167605 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzzlq\" (UniqueName: \"kubernetes.io/projected/5eac4201-2543-460e-8643-d376fab79512-kube-api-access-rzzlq\") pod \"openstack-cell1-galera-0\" (UID: \"5eac4201-2543-460e-8643-d376fab79512\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:03:46 crc kubenswrapper[5120]: I0316 17:03:46.167638 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/5eac4201-2543-460e-8643-d376fab79512-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"5eac4201-2543-460e-8643-d376fab79512\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:03:46 crc kubenswrapper[5120]: I0316 17:03:46.269620 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/5eac4201-2543-460e-8643-d376fab79512-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"5eac4201-2543-460e-8643-d376fab79512\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:03:46 crc kubenswrapper[5120]: I0316 17:03:46.269684 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"openstack-cell1-galera-0\" (UID: \"5eac4201-2543-460e-8643-d376fab79512\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:03:46 crc kubenswrapper[5120]: I0316 17:03:46.269721 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/5eac4201-2543-460e-8643-d376fab79512-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"5eac4201-2543-460e-8643-d376fab79512\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:03:46 crc kubenswrapper[5120]: I0316 17:03:46.269748 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/5eac4201-2543-460e-8643-d376fab79512-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"5eac4201-2543-460e-8643-d376fab79512\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:03:46 crc kubenswrapper[5120]: I0316 17:03:46.269796 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5eac4201-2543-460e-8643-d376fab79512-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"5eac4201-2543-460e-8643-d376fab79512\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:03:46 crc kubenswrapper[5120]: I0316 17:03:46.269855 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5eac4201-2543-460e-8643-d376fab79512-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"5eac4201-2543-460e-8643-d376fab79512\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:03:46 crc kubenswrapper[5120]: I0316 17:03:46.269877 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rzzlq\" (UniqueName: \"kubernetes.io/projected/5eac4201-2543-460e-8643-d376fab79512-kube-api-access-rzzlq\") pod \"openstack-cell1-galera-0\" (UID: \"5eac4201-2543-460e-8643-d376fab79512\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:03:46 crc kubenswrapper[5120]: I0316 17:03:46.269897 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/5eac4201-2543-460e-8643-d376fab79512-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"5eac4201-2543-460e-8643-d376fab79512\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:03:46 crc kubenswrapper[5120]: I0316 17:03:46.271287 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/5eac4201-2543-460e-8643-d376fab79512-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"5eac4201-2543-460e-8643-d376fab79512\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:03:46 crc kubenswrapper[5120]: I0316 17:03:46.271382 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/5eac4201-2543-460e-8643-d376fab79512-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"5eac4201-2543-460e-8643-d376fab79512\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:03:46 crc kubenswrapper[5120]: I0316 17:03:46.271655 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"openstack-cell1-galera-0\" (UID: \"5eac4201-2543-460e-8643-d376fab79512\") device mount path \"/mnt/openstack/pv04\"" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:03:46 crc kubenswrapper[5120]: I0316 17:03:46.271709 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5eac4201-2543-460e-8643-d376fab79512-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"5eac4201-2543-460e-8643-d376fab79512\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:03:46 crc kubenswrapper[5120]: I0316 17:03:46.271997 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/5eac4201-2543-460e-8643-d376fab79512-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"5eac4201-2543-460e-8643-d376fab79512\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:03:46 crc kubenswrapper[5120]: I0316 17:03:46.278692 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/5eac4201-2543-460e-8643-d376fab79512-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"5eac4201-2543-460e-8643-d376fab79512\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:03:46 crc kubenswrapper[5120]: I0316 17:03:46.278833 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5eac4201-2543-460e-8643-d376fab79512-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"5eac4201-2543-460e-8643-d376fab79512\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:03:46 crc kubenswrapper[5120]: I0316 17:03:46.289174 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzzlq\" (UniqueName: \"kubernetes.io/projected/5eac4201-2543-460e-8643-d376fab79512-kube-api-access-rzzlq\") pod \"openstack-cell1-galera-0\" (UID: \"5eac4201-2543-460e-8643-d376fab79512\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:03:46 crc kubenswrapper[5120]: I0316 17:03:46.294999 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"openstack-cell1-galera-0\" (UID: \"5eac4201-2543-460e-8643-d376fab79512\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:03:46 crc kubenswrapper[5120]: I0316 17:03:46.416557 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:03:46 crc kubenswrapper[5120]: I0316 17:03:46.725214 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"259e8ab8-dfd3-414c-b392-951a9f770559","Type":"ContainerStarted","Data":"14337f79a09b00109b153c607b179ada53efe4992d9f6a5e163d9cfcdcce5532"} Mar 16 17:03:46 crc kubenswrapper[5120]: I0316 17:03:46.729806 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"ef2e55ac-292f-4242-b410-0eb4d2ff90d3","Type":"ContainerStarted","Data":"24e0ba9b36b8c8e69c25e031b104d209f612119e56f3f2a6862bfdac4178b943"} Mar 16 17:03:46 crc kubenswrapper[5120]: I0316 17:03:46.913110 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 17:03:47 crc kubenswrapper[5120]: I0316 17:03:47.410294 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 17:03:47 crc kubenswrapper[5120]: I0316 17:03:47.418528 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Mar 16 17:03:47 crc kubenswrapper[5120]: I0316 17:03:47.422848 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 17:03:47 crc kubenswrapper[5120]: I0316 17:03:47.423460 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"memcached-config-data\"" Mar 16 17:03:47 crc kubenswrapper[5120]: I0316 17:03:47.423801 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"memcached-memcached-dockercfg-ss77k\"" Mar 16 17:03:47 crc kubenswrapper[5120]: I0316 17:03:47.424071 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-memcached-svc\"" Mar 16 17:03:47 crc kubenswrapper[5120]: I0316 17:03:47.495734 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/95f093ea-03a9-45b1-925d-0f51d76dc93d-memcached-tls-certs\") pod \"memcached-0\" (UID: \"95f093ea-03a9-45b1-925d-0f51d76dc93d\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 17:03:47 crc kubenswrapper[5120]: I0316 17:03:47.495948 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/95f093ea-03a9-45b1-925d-0f51d76dc93d-config-data\") pod \"memcached-0\" (UID: \"95f093ea-03a9-45b1-925d-0f51d76dc93d\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 17:03:47 crc kubenswrapper[5120]: I0316 17:03:47.496015 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/95f093ea-03a9-45b1-925d-0f51d76dc93d-combined-ca-bundle\") pod \"memcached-0\" (UID: \"95f093ea-03a9-45b1-925d-0f51d76dc93d\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 17:03:47 crc kubenswrapper[5120]: I0316 17:03:47.496419 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/95f093ea-03a9-45b1-925d-0f51d76dc93d-kolla-config\") pod \"memcached-0\" (UID: \"95f093ea-03a9-45b1-925d-0f51d76dc93d\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 17:03:47 crc kubenswrapper[5120]: I0316 17:03:47.496530 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwtjt\" (UniqueName: \"kubernetes.io/projected/95f093ea-03a9-45b1-925d-0f51d76dc93d-kube-api-access-fwtjt\") pod \"memcached-0\" (UID: \"95f093ea-03a9-45b1-925d-0f51d76dc93d\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 17:03:47 crc kubenswrapper[5120]: I0316 17:03:47.598423 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/95f093ea-03a9-45b1-925d-0f51d76dc93d-combined-ca-bundle\") pod \"memcached-0\" (UID: \"95f093ea-03a9-45b1-925d-0f51d76dc93d\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 17:03:47 crc kubenswrapper[5120]: I0316 17:03:47.598604 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/95f093ea-03a9-45b1-925d-0f51d76dc93d-kolla-config\") pod \"memcached-0\" (UID: \"95f093ea-03a9-45b1-925d-0f51d76dc93d\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 17:03:47 crc kubenswrapper[5120]: I0316 17:03:47.598633 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fwtjt\" (UniqueName: \"kubernetes.io/projected/95f093ea-03a9-45b1-925d-0f51d76dc93d-kube-api-access-fwtjt\") pod \"memcached-0\" (UID: \"95f093ea-03a9-45b1-925d-0f51d76dc93d\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 17:03:47 crc kubenswrapper[5120]: I0316 17:03:47.598711 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/95f093ea-03a9-45b1-925d-0f51d76dc93d-memcached-tls-certs\") pod \"memcached-0\" (UID: \"95f093ea-03a9-45b1-925d-0f51d76dc93d\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 17:03:47 crc kubenswrapper[5120]: I0316 17:03:47.598842 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/95f093ea-03a9-45b1-925d-0f51d76dc93d-config-data\") pod \"memcached-0\" (UID: \"95f093ea-03a9-45b1-925d-0f51d76dc93d\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 17:03:47 crc kubenswrapper[5120]: I0316 17:03:47.599624 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/95f093ea-03a9-45b1-925d-0f51d76dc93d-config-data\") pod \"memcached-0\" (UID: \"95f093ea-03a9-45b1-925d-0f51d76dc93d\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 17:03:47 crc kubenswrapper[5120]: I0316 17:03:47.599718 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/95f093ea-03a9-45b1-925d-0f51d76dc93d-kolla-config\") pod \"memcached-0\" (UID: \"95f093ea-03a9-45b1-925d-0f51d76dc93d\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 17:03:47 crc kubenswrapper[5120]: I0316 17:03:47.603796 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/95f093ea-03a9-45b1-925d-0f51d76dc93d-combined-ca-bundle\") pod \"memcached-0\" (UID: \"95f093ea-03a9-45b1-925d-0f51d76dc93d\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 17:03:47 crc kubenswrapper[5120]: I0316 17:03:47.604228 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/95f093ea-03a9-45b1-925d-0f51d76dc93d-memcached-tls-certs\") pod \"memcached-0\" (UID: \"95f093ea-03a9-45b1-925d-0f51d76dc93d\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 17:03:47 crc kubenswrapper[5120]: I0316 17:03:47.624449 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwtjt\" (UniqueName: \"kubernetes.io/projected/95f093ea-03a9-45b1-925d-0f51d76dc93d-kube-api-access-fwtjt\") pod \"memcached-0\" (UID: \"95f093ea-03a9-45b1-925d-0f51d76dc93d\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 17:03:47 crc kubenswrapper[5120]: I0316 17:03:47.739751 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Mar 16 17:03:47 crc kubenswrapper[5120]: I0316 17:03:47.740586 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"5eac4201-2543-460e-8643-d376fab79512","Type":"ContainerStarted","Data":"9138ee4aadb68a2acd1b72111c7f5fa6685919d8489bbaf034f00ddf002da6a1"} Mar 16 17:03:47 crc kubenswrapper[5120]: I0316 17:03:47.740625 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"5eac4201-2543-460e-8643-d376fab79512","Type":"ContainerStarted","Data":"222ecbf2f5c98f5531309556067e9e3d0932b6a92c2b25fa5d51b22a0d996258"} Mar 16 17:03:48 crc kubenswrapper[5120]: I0316 17:03:48.178420 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 17:03:48 crc kubenswrapper[5120]: W0316 17:03:48.184004 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod95f093ea_03a9_45b1_925d_0f51d76dc93d.slice/crio-c5dafb31f46f99288b54f0f736b57e3464e0c0f8e0fa5630e13f04d611882977 WatchSource:0}: Error finding container c5dafb31f46f99288b54f0f736b57e3464e0c0f8e0fa5630e13f04d611882977: Status 404 returned error can't find the container with id c5dafb31f46f99288b54f0f736b57e3464e0c0f8e0fa5630e13f04d611882977 Mar 16 17:03:48 crc kubenswrapper[5120]: I0316 17:03:48.750514 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"95f093ea-03a9-45b1-925d-0f51d76dc93d","Type":"ContainerStarted","Data":"f2c002513e80d40847d0f84315fc311d9e8d0c9a0c8aed763c8c5e27340df54f"} Mar 16 17:03:48 crc kubenswrapper[5120]: I0316 17:03:48.750818 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"95f093ea-03a9-45b1-925d-0f51d76dc93d","Type":"ContainerStarted","Data":"c5dafb31f46f99288b54f0f736b57e3464e0c0f8e0fa5630e13f04d611882977"} Mar 16 17:03:48 crc kubenswrapper[5120]: I0316 17:03:48.750872 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/memcached-0" Mar 16 17:03:48 crc kubenswrapper[5120]: I0316 17:03:48.756840 5120 generic.go:358] "Generic (PLEG): container finished" podID="8f7be4b3-fcec-41d8-9b93-a41201c60005" containerID="60a0181a4eaeebcf2ae4e423742282cd4c2d215a2fa81882dbe1949313877686" exitCode=0 Mar 16 17:03:48 crc kubenswrapper[5120]: I0316 17:03:48.757518 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"8f7be4b3-fcec-41d8-9b93-a41201c60005","Type":"ContainerDied","Data":"60a0181a4eaeebcf2ae4e423742282cd4c2d215a2fa81882dbe1949313877686"} Mar 16 17:03:48 crc kubenswrapper[5120]: I0316 17:03:48.777151 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/memcached-0" podStartSLOduration=1.777129057 podStartE2EDuration="1.777129057s" podCreationTimestamp="2026-03-16 17:03:47 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:03:48.771488831 +0000 UTC m=+5530.925420498" watchObservedRunningTime="2026-03-16 17:03:48.777129057 +0000 UTC m=+5530.931060714" Mar 16 17:03:49 crc kubenswrapper[5120]: I0316 17:03:49.536450 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 17:03:49 crc kubenswrapper[5120]: I0316 17:03:49.549626 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 17:03:49 crc kubenswrapper[5120]: I0316 17:03:49.551612 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 17:03:49 crc kubenswrapper[5120]: I0316 17:03:49.554920 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"telemetry-ceilometer-dockercfg-hcc28\"" Mar 16 17:03:49 crc kubenswrapper[5120]: I0316 17:03:49.643328 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6cdcj\" (UniqueName: \"kubernetes.io/projected/6d176076-ae9c-45e6-a1b4-be07747b4e73-kube-api-access-6cdcj\") pod \"kube-state-metrics-0\" (UID: \"6d176076-ae9c-45e6-a1b4-be07747b4e73\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 17:03:49 crc kubenswrapper[5120]: I0316 17:03:49.744611 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6cdcj\" (UniqueName: \"kubernetes.io/projected/6d176076-ae9c-45e6-a1b4-be07747b4e73-kube-api-access-6cdcj\") pod \"kube-state-metrics-0\" (UID: \"6d176076-ae9c-45e6-a1b4-be07747b4e73\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 17:03:49 crc kubenswrapper[5120]: I0316 17:03:49.764622 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6cdcj\" (UniqueName: \"kubernetes.io/projected/6d176076-ae9c-45e6-a1b4-be07747b4e73-kube-api-access-6cdcj\") pod \"kube-state-metrics-0\" (UID: \"6d176076-ae9c-45e6-a1b4-be07747b4e73\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 17:03:49 crc kubenswrapper[5120]: I0316 17:03:49.769079 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"8f7be4b3-fcec-41d8-9b93-a41201c60005","Type":"ContainerStarted","Data":"7dd60adc27480f52058b362abed27158f7e301ca1ac5ae0382560a9459203f9e"} Mar 16 17:03:49 crc kubenswrapper[5120]: I0316 17:03:49.771368 5120 generic.go:358] "Generic (PLEG): container finished" podID="5eac4201-2543-460e-8643-d376fab79512" containerID="9138ee4aadb68a2acd1b72111c7f5fa6685919d8489bbaf034f00ddf002da6a1" exitCode=0 Mar 16 17:03:49 crc kubenswrapper[5120]: I0316 17:03:49.772479 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"5eac4201-2543-460e-8643-d376fab79512","Type":"ContainerDied","Data":"9138ee4aadb68a2acd1b72111c7f5fa6685919d8489bbaf034f00ddf002da6a1"} Mar 16 17:03:49 crc kubenswrapper[5120]: I0316 17:03:49.817295 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstack-galera-0" podStartSLOduration=5.81726824 podStartE2EDuration="5.81726824s" podCreationTimestamp="2026-03-16 17:03:44 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:03:49.796134606 +0000 UTC m=+5531.950066273" watchObservedRunningTime="2026-03-16 17:03:49.81726824 +0000 UTC m=+5531.971199907" Mar 16 17:03:49 crc kubenswrapper[5120]: I0316 17:03:49.879059 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 17:03:50 crc kubenswrapper[5120]: I0316 17:03:50.312574 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 17:03:50 crc kubenswrapper[5120]: I0316 17:03:50.772688 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 17:03:50 crc kubenswrapper[5120]: I0316 17:03:50.779311 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:03:50 crc kubenswrapper[5120]: I0316 17:03:50.781209 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ovn-metrics\"" Mar 16 17:03:50 crc kubenswrapper[5120]: I0316 17:03:50.781423 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ovndbcluster-nb-ovndbs\"" Mar 16 17:03:50 crc kubenswrapper[5120]: I0316 17:03:50.781881 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovndbcluster-nb-config\"" Mar 16 17:03:50 crc kubenswrapper[5120]: I0316 17:03:50.781902 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovndbcluster-nb-scripts\"" Mar 16 17:03:50 crc kubenswrapper[5120]: I0316 17:03:50.782061 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ovncluster-ovndbcluster-nb-dockercfg-kfjxr\"" Mar 16 17:03:50 crc kubenswrapper[5120]: I0316 17:03:50.785419 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 17:03:50 crc kubenswrapper[5120]: I0316 17:03:50.805238 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"6d176076-ae9c-45e6-a1b4-be07747b4e73","Type":"ContainerStarted","Data":"29bccd2d7616b7858edca21d481bffca93d3c8be4c3136f7bc36c64060bfb229"} Mar 16 17:03:50 crc kubenswrapper[5120]: I0316 17:03:50.808857 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"5eac4201-2543-460e-8643-d376fab79512","Type":"ContainerStarted","Data":"c4fbb0d93de06153ee805dc84d38adcfe4df3b1761b668d82ce6b1cc908a9080"} Mar 16 17:03:50 crc kubenswrapper[5120]: I0316 17:03:50.835211 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstack-cell1-galera-0" podStartSLOduration=4.83519143 podStartE2EDuration="4.83519143s" podCreationTimestamp="2026-03-16 17:03:46 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:03:50.831664553 +0000 UTC m=+5532.985596210" watchObservedRunningTime="2026-03-16 17:03:50.83519143 +0000 UTC m=+5532.989123087" Mar 16 17:03:50 crc kubenswrapper[5120]: I0316 17:03:50.870181 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"ovsdbserver-nb-0\" (UID: \"b9d1b067-481f-4959-99ab-68d36e78226d\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:03:50 crc kubenswrapper[5120]: I0316 17:03:50.870268 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/b9d1b067-481f-4959-99ab-68d36e78226d-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"b9d1b067-481f-4959-99ab-68d36e78226d\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:03:50 crc kubenswrapper[5120]: I0316 17:03:50.870319 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b9d1b067-481f-4959-99ab-68d36e78226d-config\") pod \"ovsdbserver-nb-0\" (UID: \"b9d1b067-481f-4959-99ab-68d36e78226d\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:03:50 crc kubenswrapper[5120]: I0316 17:03:50.870363 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b9d1b067-481f-4959-99ab-68d36e78226d-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"b9d1b067-481f-4959-99ab-68d36e78226d\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:03:50 crc kubenswrapper[5120]: I0316 17:03:50.870396 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/b9d1b067-481f-4959-99ab-68d36e78226d-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"b9d1b067-481f-4959-99ab-68d36e78226d\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:03:50 crc kubenswrapper[5120]: I0316 17:03:50.870489 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/b9d1b067-481f-4959-99ab-68d36e78226d-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"b9d1b067-481f-4959-99ab-68d36e78226d\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:03:50 crc kubenswrapper[5120]: I0316 17:03:50.871123 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/b9d1b067-481f-4959-99ab-68d36e78226d-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"b9d1b067-481f-4959-99ab-68d36e78226d\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:03:50 crc kubenswrapper[5120]: I0316 17:03:50.871472 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qfvt\" (UniqueName: \"kubernetes.io/projected/b9d1b067-481f-4959-99ab-68d36e78226d-kube-api-access-7qfvt\") pod \"ovsdbserver-nb-0\" (UID: \"b9d1b067-481f-4959-99ab-68d36e78226d\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:03:50 crc kubenswrapper[5120]: I0316 17:03:50.973627 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/b9d1b067-481f-4959-99ab-68d36e78226d-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"b9d1b067-481f-4959-99ab-68d36e78226d\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:03:50 crc kubenswrapper[5120]: I0316 17:03:50.974113 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7qfvt\" (UniqueName: \"kubernetes.io/projected/b9d1b067-481f-4959-99ab-68d36e78226d-kube-api-access-7qfvt\") pod \"ovsdbserver-nb-0\" (UID: \"b9d1b067-481f-4959-99ab-68d36e78226d\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:03:50 crc kubenswrapper[5120]: I0316 17:03:50.974187 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"ovsdbserver-nb-0\" (UID: \"b9d1b067-481f-4959-99ab-68d36e78226d\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:03:50 crc kubenswrapper[5120]: I0316 17:03:50.974300 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/b9d1b067-481f-4959-99ab-68d36e78226d-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"b9d1b067-481f-4959-99ab-68d36e78226d\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:03:50 crc kubenswrapper[5120]: I0316 17:03:50.974382 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b9d1b067-481f-4959-99ab-68d36e78226d-config\") pod \"ovsdbserver-nb-0\" (UID: \"b9d1b067-481f-4959-99ab-68d36e78226d\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:03:50 crc kubenswrapper[5120]: I0316 17:03:50.974414 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b9d1b067-481f-4959-99ab-68d36e78226d-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"b9d1b067-481f-4959-99ab-68d36e78226d\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:03:50 crc kubenswrapper[5120]: I0316 17:03:50.974496 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/b9d1b067-481f-4959-99ab-68d36e78226d-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"b9d1b067-481f-4959-99ab-68d36e78226d\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:03:50 crc kubenswrapper[5120]: I0316 17:03:50.974526 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/b9d1b067-481f-4959-99ab-68d36e78226d-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"b9d1b067-481f-4959-99ab-68d36e78226d\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:03:50 crc kubenswrapper[5120]: I0316 17:03:50.974644 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"ovsdbserver-nb-0\" (UID: \"b9d1b067-481f-4959-99ab-68d36e78226d\") device mount path \"/mnt/openstack/pv08\"" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:03:50 crc kubenswrapper[5120]: I0316 17:03:50.975005 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/b9d1b067-481f-4959-99ab-68d36e78226d-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"b9d1b067-481f-4959-99ab-68d36e78226d\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:03:50 crc kubenswrapper[5120]: I0316 17:03:50.975590 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b9d1b067-481f-4959-99ab-68d36e78226d-config\") pod \"ovsdbserver-nb-0\" (UID: \"b9d1b067-481f-4959-99ab-68d36e78226d\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:03:50 crc kubenswrapper[5120]: I0316 17:03:50.975746 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/b9d1b067-481f-4959-99ab-68d36e78226d-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"b9d1b067-481f-4959-99ab-68d36e78226d\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:03:50 crc kubenswrapper[5120]: I0316 17:03:50.980406 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/b9d1b067-481f-4959-99ab-68d36e78226d-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"b9d1b067-481f-4959-99ab-68d36e78226d\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:03:50 crc kubenswrapper[5120]: I0316 17:03:50.980408 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b9d1b067-481f-4959-99ab-68d36e78226d-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"b9d1b067-481f-4959-99ab-68d36e78226d\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:03:50 crc kubenswrapper[5120]: I0316 17:03:50.983050 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/b9d1b067-481f-4959-99ab-68d36e78226d-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"b9d1b067-481f-4959-99ab-68d36e78226d\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:03:50 crc kubenswrapper[5120]: I0316 17:03:50.990314 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qfvt\" (UniqueName: \"kubernetes.io/projected/b9d1b067-481f-4959-99ab-68d36e78226d-kube-api-access-7qfvt\") pod \"ovsdbserver-nb-0\" (UID: \"b9d1b067-481f-4959-99ab-68d36e78226d\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:03:51 crc kubenswrapper[5120]: I0316 17:03:51.004074 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"ovsdbserver-nb-0\" (UID: \"b9d1b067-481f-4959-99ab-68d36e78226d\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:03:51 crc kubenswrapper[5120]: I0316 17:03:51.162063 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:03:51 crc kubenswrapper[5120]: I0316 17:03:51.597714 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 17:03:51 crc kubenswrapper[5120]: I0316 17:03:51.824200 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"6d176076-ae9c-45e6-a1b4-be07747b4e73","Type":"ContainerStarted","Data":"38305f8ebd4a2ffa00c4fb7a684c0da44d402ffe2f36fd764592c8b71ee675f8"} Mar 16 17:03:51 crc kubenswrapper[5120]: I0316 17:03:51.826177 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 17:03:51 crc kubenswrapper[5120]: I0316 17:03:51.828254 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"b9d1b067-481f-4959-99ab-68d36e78226d","Type":"ContainerStarted","Data":"400808da31cd313ab6122809b1a8caf64bfc05ff3b932a21cc294191c8a85be9"} Mar 16 17:03:51 crc kubenswrapper[5120]: I0316 17:03:51.828304 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"b9d1b067-481f-4959-99ab-68d36e78226d","Type":"ContainerStarted","Data":"3be04d307eae6087bcb3df8d0bbba5be6925f33e9891888b114ff0ef1d790842"} Mar 16 17:03:51 crc kubenswrapper[5120]: I0316 17:03:51.859373 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/kube-state-metrics-0" podStartSLOduration=2.457575174 podStartE2EDuration="2.859346223s" podCreationTimestamp="2026-03-16 17:03:49 +0000 UTC" firstStartedPulling="2026-03-16 17:03:50.31790449 +0000 UTC m=+5532.471836147" lastFinishedPulling="2026-03-16 17:03:50.719675539 +0000 UTC m=+5532.873607196" observedRunningTime="2026-03-16 17:03:51.838883417 +0000 UTC m=+5533.992815084" watchObservedRunningTime="2026-03-16 17:03:51.859346223 +0000 UTC m=+5534.013277880" Mar 16 17:03:52 crc kubenswrapper[5120]: I0316 17:03:52.849259 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"b9d1b067-481f-4959-99ab-68d36e78226d","Type":"ContainerStarted","Data":"36e19874faebe75c231a863143f7dd73c50e3adbff0c872e4b6a75af80b20e30"} Mar 16 17:03:52 crc kubenswrapper[5120]: I0316 17:03:52.866366 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podStartSLOduration=2.866342381 podStartE2EDuration="2.866342381s" podCreationTimestamp="2026-03-16 17:03:50 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:03:52.864360247 +0000 UTC m=+5535.018291924" watchObservedRunningTime="2026-03-16 17:03:52.866342381 +0000 UTC m=+5535.020274038" Mar 16 17:03:54 crc kubenswrapper[5120]: I0316 17:03:54.162633 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:03:54 crc kubenswrapper[5120]: I0316 17:03:54.207085 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:03:54 crc kubenswrapper[5120]: I0316 17:03:54.404624 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 17:03:54 crc kubenswrapper[5120]: I0316 17:03:54.413138 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:03:54 crc kubenswrapper[5120]: I0316 17:03:54.428349 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 17:03:54 crc kubenswrapper[5120]: I0316 17:03:54.428964 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ovncluster-ovndbcluster-sb-dockercfg-8h2r2\"" Mar 16 17:03:54 crc kubenswrapper[5120]: I0316 17:03:54.429286 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovndbcluster-sb-config\"" Mar 16 17:03:54 crc kubenswrapper[5120]: I0316 17:03:54.429604 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovndbcluster-sb-scripts\"" Mar 16 17:03:54 crc kubenswrapper[5120]: I0316 17:03:54.430358 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ovndbcluster-sb-ovndbs\"" Mar 16 17:03:54 crc kubenswrapper[5120]: I0316 17:03:54.443725 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1b14824b-ab59-47bd-af31-b5f0b806a9c3-config\") pod \"ovsdbserver-sb-0\" (UID: \"1b14824b-ab59-47bd-af31-b5f0b806a9c3\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:03:54 crc kubenswrapper[5120]: I0316 17:03:54.443790 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/1b14824b-ab59-47bd-af31-b5f0b806a9c3-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"1b14824b-ab59-47bd-af31-b5f0b806a9c3\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:03:54 crc kubenswrapper[5120]: I0316 17:03:54.443878 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1b14824b-ab59-47bd-af31-b5f0b806a9c3-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"1b14824b-ab59-47bd-af31-b5f0b806a9c3\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:03:54 crc kubenswrapper[5120]: I0316 17:03:54.443911 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/1b14824b-ab59-47bd-af31-b5f0b806a9c3-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"1b14824b-ab59-47bd-af31-b5f0b806a9c3\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:03:54 crc kubenswrapper[5120]: I0316 17:03:54.443966 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"ovsdbserver-sb-0\" (UID: \"1b14824b-ab59-47bd-af31-b5f0b806a9c3\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:03:54 crc kubenswrapper[5120]: I0316 17:03:54.443993 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/1b14824b-ab59-47bd-af31-b5f0b806a9c3-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"1b14824b-ab59-47bd-af31-b5f0b806a9c3\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:03:54 crc kubenswrapper[5120]: I0316 17:03:54.444122 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/1b14824b-ab59-47bd-af31-b5f0b806a9c3-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"1b14824b-ab59-47bd-af31-b5f0b806a9c3\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:03:54 crc kubenswrapper[5120]: I0316 17:03:54.444294 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wtdt\" (UniqueName: \"kubernetes.io/projected/1b14824b-ab59-47bd-af31-b5f0b806a9c3-kube-api-access-2wtdt\") pod \"ovsdbserver-sb-0\" (UID: \"1b14824b-ab59-47bd-af31-b5f0b806a9c3\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:03:54 crc kubenswrapper[5120]: I0316 17:03:54.546335 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/1b14824b-ab59-47bd-af31-b5f0b806a9c3-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"1b14824b-ab59-47bd-af31-b5f0b806a9c3\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:03:54 crc kubenswrapper[5120]: I0316 17:03:54.546413 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2wtdt\" (UniqueName: \"kubernetes.io/projected/1b14824b-ab59-47bd-af31-b5f0b806a9c3-kube-api-access-2wtdt\") pod \"ovsdbserver-sb-0\" (UID: \"1b14824b-ab59-47bd-af31-b5f0b806a9c3\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:03:54 crc kubenswrapper[5120]: I0316 17:03:54.546469 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1b14824b-ab59-47bd-af31-b5f0b806a9c3-config\") pod \"ovsdbserver-sb-0\" (UID: \"1b14824b-ab59-47bd-af31-b5f0b806a9c3\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:03:54 crc kubenswrapper[5120]: I0316 17:03:54.546505 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/1b14824b-ab59-47bd-af31-b5f0b806a9c3-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"1b14824b-ab59-47bd-af31-b5f0b806a9c3\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:03:54 crc kubenswrapper[5120]: I0316 17:03:54.546593 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1b14824b-ab59-47bd-af31-b5f0b806a9c3-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"1b14824b-ab59-47bd-af31-b5f0b806a9c3\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:03:54 crc kubenswrapper[5120]: I0316 17:03:54.546628 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/1b14824b-ab59-47bd-af31-b5f0b806a9c3-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"1b14824b-ab59-47bd-af31-b5f0b806a9c3\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:03:54 crc kubenswrapper[5120]: I0316 17:03:54.546657 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"ovsdbserver-sb-0\" (UID: \"1b14824b-ab59-47bd-af31-b5f0b806a9c3\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:03:54 crc kubenswrapper[5120]: I0316 17:03:54.546677 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/1b14824b-ab59-47bd-af31-b5f0b806a9c3-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"1b14824b-ab59-47bd-af31-b5f0b806a9c3\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:03:54 crc kubenswrapper[5120]: I0316 17:03:54.548018 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"ovsdbserver-sb-0\" (UID: \"1b14824b-ab59-47bd-af31-b5f0b806a9c3\") device mount path \"/mnt/openstack/pv01\"" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:03:54 crc kubenswrapper[5120]: I0316 17:03:54.548096 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/1b14824b-ab59-47bd-af31-b5f0b806a9c3-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"1b14824b-ab59-47bd-af31-b5f0b806a9c3\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:03:54 crc kubenswrapper[5120]: I0316 17:03:54.551032 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1b14824b-ab59-47bd-af31-b5f0b806a9c3-config\") pod \"ovsdbserver-sb-0\" (UID: \"1b14824b-ab59-47bd-af31-b5f0b806a9c3\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:03:54 crc kubenswrapper[5120]: I0316 17:03:54.551374 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/1b14824b-ab59-47bd-af31-b5f0b806a9c3-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"1b14824b-ab59-47bd-af31-b5f0b806a9c3\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:03:54 crc kubenswrapper[5120]: I0316 17:03:54.556132 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/1b14824b-ab59-47bd-af31-b5f0b806a9c3-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"1b14824b-ab59-47bd-af31-b5f0b806a9c3\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:03:54 crc kubenswrapper[5120]: I0316 17:03:54.556320 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1b14824b-ab59-47bd-af31-b5f0b806a9c3-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"1b14824b-ab59-47bd-af31-b5f0b806a9c3\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:03:54 crc kubenswrapper[5120]: I0316 17:03:54.556501 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/1b14824b-ab59-47bd-af31-b5f0b806a9c3-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"1b14824b-ab59-47bd-af31-b5f0b806a9c3\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:03:54 crc kubenswrapper[5120]: I0316 17:03:54.565579 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wtdt\" (UniqueName: \"kubernetes.io/projected/1b14824b-ab59-47bd-af31-b5f0b806a9c3-kube-api-access-2wtdt\") pod \"ovsdbserver-sb-0\" (UID: \"1b14824b-ab59-47bd-af31-b5f0b806a9c3\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:03:54 crc kubenswrapper[5120]: I0316 17:03:54.581642 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"ovsdbserver-sb-0\" (UID: \"1b14824b-ab59-47bd-af31-b5f0b806a9c3\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:03:54 crc kubenswrapper[5120]: I0316 17:03:54.743201 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:03:54 crc kubenswrapper[5120]: I0316 17:03:54.773698 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/memcached-0" Mar 16 17:03:54 crc kubenswrapper[5120]: I0316 17:03:54.881723 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:03:55 crc kubenswrapper[5120]: I0316 17:03:55.070268 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:03:55 crc kubenswrapper[5120]: I0316 17:03:55.070738 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:03:55 crc kubenswrapper[5120]: I0316 17:03:55.139489 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:03:55 crc kubenswrapper[5120]: I0316 17:03:55.199304 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 17:03:55 crc kubenswrapper[5120]: W0316 17:03:55.202404 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1b14824b_ab59_47bd_af31_b5f0b806a9c3.slice/crio-3a445d7d481129d7979655b9a8bcd71aa4ed485762dd8865d37a438877fd2301 WatchSource:0}: Error finding container 3a445d7d481129d7979655b9a8bcd71aa4ed485762dd8865d37a438877fd2301: Status 404 returned error can't find the container with id 3a445d7d481129d7979655b9a8bcd71aa4ed485762dd8865d37a438877fd2301 Mar 16 17:03:55 crc kubenswrapper[5120]: I0316 17:03:55.891479 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"1b14824b-ab59-47bd-af31-b5f0b806a9c3","Type":"ContainerStarted","Data":"b9a2e58ea47b55c32ddeca091d4724c0a91bc2544cf67c854eae81885c19cc96"} Mar 16 17:03:55 crc kubenswrapper[5120]: I0316 17:03:55.892044 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"1b14824b-ab59-47bd-af31-b5f0b806a9c3","Type":"ContainerStarted","Data":"9493f8688a6a97514909dc97423f4687ed171063e7b2f0935a0373e4f07b3637"} Mar 16 17:03:55 crc kubenswrapper[5120]: I0316 17:03:55.892062 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"1b14824b-ab59-47bd-af31-b5f0b806a9c3","Type":"ContainerStarted","Data":"3a445d7d481129d7979655b9a8bcd71aa4ed485762dd8865d37a438877fd2301"} Mar 16 17:03:55 crc kubenswrapper[5120]: I0316 17:03:55.909279 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podStartSLOduration=1.909256252 podStartE2EDuration="1.909256252s" podCreationTimestamp="2026-03-16 17:03:54 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:03:55.906711033 +0000 UTC m=+5538.060642700" watchObservedRunningTime="2026-03-16 17:03:55.909256252 +0000 UTC m=+5538.063187909" Mar 16 17:03:55 crc kubenswrapper[5120]: I0316 17:03:55.968427 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:03:56 crc kubenswrapper[5120]: I0316 17:03:56.417572 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:03:56 crc kubenswrapper[5120]: I0316 17:03:56.417952 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:03:56 crc kubenswrapper[5120]: I0316 17:03:56.483693 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:03:56 crc kubenswrapper[5120]: I0316 17:03:56.991422 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:03:57 crc kubenswrapper[5120]: I0316 17:03:57.744003 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:03:58 crc kubenswrapper[5120]: I0316 17:03:58.755892 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-db-create-9rxdh"] Mar 16 17:03:58 crc kubenswrapper[5120]: I0316 17:03:58.816268 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-db-create-9rxdh"] Mar 16 17:03:58 crc kubenswrapper[5120]: I0316 17:03:58.816389 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-create-9rxdh" Mar 16 17:03:58 crc kubenswrapper[5120]: I0316 17:03:58.875952 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-d475-account-create-update-wx6bw"] Mar 16 17:03:58 crc kubenswrapper[5120]: I0316 17:03:58.890845 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-d475-account-create-update-wx6bw"] Mar 16 17:03:58 crc kubenswrapper[5120]: I0316 17:03:58.890971 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-d475-account-create-update-wx6bw" Mar 16 17:03:58 crc kubenswrapper[5120]: I0316 17:03:58.892903 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-db-secret\"" Mar 16 17:03:58 crc kubenswrapper[5120]: I0316 17:03:58.946442 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/abe5ce91-c17a-44b5-8153-a8ffe8d440e9-operator-scripts\") pod \"keystone-db-create-9rxdh\" (UID: \"abe5ce91-c17a-44b5-8153-a8ffe8d440e9\") " pod="openstack-kuttl-tests/keystone-db-create-9rxdh" Mar 16 17:03:58 crc kubenswrapper[5120]: I0316 17:03:58.946808 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ngjxj\" (UniqueName: \"kubernetes.io/projected/83183a55-1c89-4496-b455-9c7e28bee8e3-kube-api-access-ngjxj\") pod \"keystone-d475-account-create-update-wx6bw\" (UID: \"83183a55-1c89-4496-b455-9c7e28bee8e3\") " pod="openstack-kuttl-tests/keystone-d475-account-create-update-wx6bw" Mar 16 17:03:58 crc kubenswrapper[5120]: I0316 17:03:58.947030 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/83183a55-1c89-4496-b455-9c7e28bee8e3-operator-scripts\") pod \"keystone-d475-account-create-update-wx6bw\" (UID: \"83183a55-1c89-4496-b455-9c7e28bee8e3\") " pod="openstack-kuttl-tests/keystone-d475-account-create-update-wx6bw" Mar 16 17:03:58 crc kubenswrapper[5120]: I0316 17:03:58.947524 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zlq55\" (UniqueName: \"kubernetes.io/projected/abe5ce91-c17a-44b5-8153-a8ffe8d440e9-kube-api-access-zlq55\") pod \"keystone-db-create-9rxdh\" (UID: \"abe5ce91-c17a-44b5-8153-a8ffe8d440e9\") " pod="openstack-kuttl-tests/keystone-db-create-9rxdh" Mar 16 17:03:58 crc kubenswrapper[5120]: I0316 17:03:58.987070 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-db-create-h7w47"] Mar 16 17:03:58 crc kubenswrapper[5120]: I0316 17:03:58.999675 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-db-create-h7w47"] Mar 16 17:03:58 crc kubenswrapper[5120]: I0316 17:03:58.999822 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-create-h7w47" Mar 16 17:03:59 crc kubenswrapper[5120]: I0316 17:03:59.049178 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kr5h\" (UniqueName: \"kubernetes.io/projected/df308c5a-dfce-4996-b129-fcc1f36e1743-kube-api-access-2kr5h\") pod \"placement-db-create-h7w47\" (UID: \"df308c5a-dfce-4996-b129-fcc1f36e1743\") " pod="openstack-kuttl-tests/placement-db-create-h7w47" Mar 16 17:03:59 crc kubenswrapper[5120]: I0316 17:03:59.049247 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/df308c5a-dfce-4996-b129-fcc1f36e1743-operator-scripts\") pod \"placement-db-create-h7w47\" (UID: \"df308c5a-dfce-4996-b129-fcc1f36e1743\") " pod="openstack-kuttl-tests/placement-db-create-h7w47" Mar 16 17:03:59 crc kubenswrapper[5120]: I0316 17:03:59.049807 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zlq55\" (UniqueName: \"kubernetes.io/projected/abe5ce91-c17a-44b5-8153-a8ffe8d440e9-kube-api-access-zlq55\") pod \"keystone-db-create-9rxdh\" (UID: \"abe5ce91-c17a-44b5-8153-a8ffe8d440e9\") " pod="openstack-kuttl-tests/keystone-db-create-9rxdh" Mar 16 17:03:59 crc kubenswrapper[5120]: I0316 17:03:59.050895 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/abe5ce91-c17a-44b5-8153-a8ffe8d440e9-operator-scripts\") pod \"keystone-db-create-9rxdh\" (UID: \"abe5ce91-c17a-44b5-8153-a8ffe8d440e9\") " pod="openstack-kuttl-tests/keystone-db-create-9rxdh" Mar 16 17:03:59 crc kubenswrapper[5120]: I0316 17:03:59.051560 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/abe5ce91-c17a-44b5-8153-a8ffe8d440e9-operator-scripts\") pod \"keystone-db-create-9rxdh\" (UID: \"abe5ce91-c17a-44b5-8153-a8ffe8d440e9\") " pod="openstack-kuttl-tests/keystone-db-create-9rxdh" Mar 16 17:03:59 crc kubenswrapper[5120]: I0316 17:03:59.052120 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ngjxj\" (UniqueName: \"kubernetes.io/projected/83183a55-1c89-4496-b455-9c7e28bee8e3-kube-api-access-ngjxj\") pod \"keystone-d475-account-create-update-wx6bw\" (UID: \"83183a55-1c89-4496-b455-9c7e28bee8e3\") " pod="openstack-kuttl-tests/keystone-d475-account-create-update-wx6bw" Mar 16 17:03:59 crc kubenswrapper[5120]: I0316 17:03:59.052692 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/83183a55-1c89-4496-b455-9c7e28bee8e3-operator-scripts\") pod \"keystone-d475-account-create-update-wx6bw\" (UID: \"83183a55-1c89-4496-b455-9c7e28bee8e3\") " pod="openstack-kuttl-tests/keystone-d475-account-create-update-wx6bw" Mar 16 17:03:59 crc kubenswrapper[5120]: I0316 17:03:59.053234 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/83183a55-1c89-4496-b455-9c7e28bee8e3-operator-scripts\") pod \"keystone-d475-account-create-update-wx6bw\" (UID: \"83183a55-1c89-4496-b455-9c7e28bee8e3\") " pod="openstack-kuttl-tests/keystone-d475-account-create-update-wx6bw" Mar 16 17:03:59 crc kubenswrapper[5120]: I0316 17:03:59.071732 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ngjxj\" (UniqueName: \"kubernetes.io/projected/83183a55-1c89-4496-b455-9c7e28bee8e3-kube-api-access-ngjxj\") pod \"keystone-d475-account-create-update-wx6bw\" (UID: \"83183a55-1c89-4496-b455-9c7e28bee8e3\") " pod="openstack-kuttl-tests/keystone-d475-account-create-update-wx6bw" Mar 16 17:03:59 crc kubenswrapper[5120]: I0316 17:03:59.075039 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zlq55\" (UniqueName: \"kubernetes.io/projected/abe5ce91-c17a-44b5-8153-a8ffe8d440e9-kube-api-access-zlq55\") pod \"keystone-db-create-9rxdh\" (UID: \"abe5ce91-c17a-44b5-8153-a8ffe8d440e9\") " pod="openstack-kuttl-tests/keystone-db-create-9rxdh" Mar 16 17:03:59 crc kubenswrapper[5120]: I0316 17:03:59.100636 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-7ee8-account-create-update-8npng"] Mar 16 17:03:59 crc kubenswrapper[5120]: I0316 17:03:59.111511 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-7ee8-account-create-update-8npng" Mar 16 17:03:59 crc kubenswrapper[5120]: I0316 17:03:59.113907 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-db-secret\"" Mar 16 17:03:59 crc kubenswrapper[5120]: I0316 17:03:59.115005 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-7ee8-account-create-update-8npng"] Mar 16 17:03:59 crc kubenswrapper[5120]: I0316 17:03:59.137472 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-create-9rxdh" Mar 16 17:03:59 crc kubenswrapper[5120]: I0316 17:03:59.154211 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/79a9c531-41a9-4754-91ee-697e1c3bdb44-operator-scripts\") pod \"placement-7ee8-account-create-update-8npng\" (UID: \"79a9c531-41a9-4754-91ee-697e1c3bdb44\") " pod="openstack-kuttl-tests/placement-7ee8-account-create-update-8npng" Mar 16 17:03:59 crc kubenswrapper[5120]: I0316 17:03:59.154605 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2kr5h\" (UniqueName: \"kubernetes.io/projected/df308c5a-dfce-4996-b129-fcc1f36e1743-kube-api-access-2kr5h\") pod \"placement-db-create-h7w47\" (UID: \"df308c5a-dfce-4996-b129-fcc1f36e1743\") " pod="openstack-kuttl-tests/placement-db-create-h7w47" Mar 16 17:03:59 crc kubenswrapper[5120]: I0316 17:03:59.154638 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/df308c5a-dfce-4996-b129-fcc1f36e1743-operator-scripts\") pod \"placement-db-create-h7w47\" (UID: \"df308c5a-dfce-4996-b129-fcc1f36e1743\") " pod="openstack-kuttl-tests/placement-db-create-h7w47" Mar 16 17:03:59 crc kubenswrapper[5120]: I0316 17:03:59.154680 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5p2j\" (UniqueName: \"kubernetes.io/projected/79a9c531-41a9-4754-91ee-697e1c3bdb44-kube-api-access-c5p2j\") pod \"placement-7ee8-account-create-update-8npng\" (UID: \"79a9c531-41a9-4754-91ee-697e1c3bdb44\") " pod="openstack-kuttl-tests/placement-7ee8-account-create-update-8npng" Mar 16 17:03:59 crc kubenswrapper[5120]: I0316 17:03:59.155351 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/df308c5a-dfce-4996-b129-fcc1f36e1743-operator-scripts\") pod \"placement-db-create-h7w47\" (UID: \"df308c5a-dfce-4996-b129-fcc1f36e1743\") " pod="openstack-kuttl-tests/placement-db-create-h7w47" Mar 16 17:03:59 crc kubenswrapper[5120]: I0316 17:03:59.170606 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kr5h\" (UniqueName: \"kubernetes.io/projected/df308c5a-dfce-4996-b129-fcc1f36e1743-kube-api-access-2kr5h\") pod \"placement-db-create-h7w47\" (UID: \"df308c5a-dfce-4996-b129-fcc1f36e1743\") " pod="openstack-kuttl-tests/placement-db-create-h7w47" Mar 16 17:03:59 crc kubenswrapper[5120]: I0316 17:03:59.212313 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-d475-account-create-update-wx6bw" Mar 16 17:03:59 crc kubenswrapper[5120]: I0316 17:03:59.257476 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c5p2j\" (UniqueName: \"kubernetes.io/projected/79a9c531-41a9-4754-91ee-697e1c3bdb44-kube-api-access-c5p2j\") pod \"placement-7ee8-account-create-update-8npng\" (UID: \"79a9c531-41a9-4754-91ee-697e1c3bdb44\") " pod="openstack-kuttl-tests/placement-7ee8-account-create-update-8npng" Mar 16 17:03:59 crc kubenswrapper[5120]: I0316 17:03:59.258093 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/79a9c531-41a9-4754-91ee-697e1c3bdb44-operator-scripts\") pod \"placement-7ee8-account-create-update-8npng\" (UID: \"79a9c531-41a9-4754-91ee-697e1c3bdb44\") " pod="openstack-kuttl-tests/placement-7ee8-account-create-update-8npng" Mar 16 17:03:59 crc kubenswrapper[5120]: I0316 17:03:59.259200 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/79a9c531-41a9-4754-91ee-697e1c3bdb44-operator-scripts\") pod \"placement-7ee8-account-create-update-8npng\" (UID: \"79a9c531-41a9-4754-91ee-697e1c3bdb44\") " pod="openstack-kuttl-tests/placement-7ee8-account-create-update-8npng" Mar 16 17:03:59 crc kubenswrapper[5120]: I0316 17:03:59.276189 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5p2j\" (UniqueName: \"kubernetes.io/projected/79a9c531-41a9-4754-91ee-697e1c3bdb44-kube-api-access-c5p2j\") pod \"placement-7ee8-account-create-update-8npng\" (UID: \"79a9c531-41a9-4754-91ee-697e1c3bdb44\") " pod="openstack-kuttl-tests/placement-7ee8-account-create-update-8npng" Mar 16 17:03:59 crc kubenswrapper[5120]: I0316 17:03:59.324451 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-create-h7w47" Mar 16 17:03:59 crc kubenswrapper[5120]: I0316 17:03:59.443936 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-7ee8-account-create-update-8npng" Mar 16 17:03:59 crc kubenswrapper[5120]: I0316 17:03:59.599312 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-db-create-9rxdh"] Mar 16 17:03:59 crc kubenswrapper[5120]: I0316 17:03:59.716668 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-d475-account-create-update-wx6bw"] Mar 16 17:03:59 crc kubenswrapper[5120]: W0316 17:03:59.717109 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod83183a55_1c89_4496_b455_9c7e28bee8e3.slice/crio-6e5dd996cd549177e7fbabf5a6b108ce343bf5885017c62e733aa07571878d1e WatchSource:0}: Error finding container 6e5dd996cd549177e7fbabf5a6b108ce343bf5885017c62e733aa07571878d1e: Status 404 returned error can't find the container with id 6e5dd996cd549177e7fbabf5a6b108ce343bf5885017c62e733aa07571878d1e Mar 16 17:03:59 crc kubenswrapper[5120]: I0316 17:03:59.743784 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:03:59 crc kubenswrapper[5120]: I0316 17:03:59.857501 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-db-create-h7w47"] Mar 16 17:03:59 crc kubenswrapper[5120]: W0316 17:03:59.877242 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddf308c5a_dfce_4996_b129_fcc1f36e1743.slice/crio-6ad6d251e8b47ab305ee6fe2b66d00dffe53bc25f248ab9c44b4d9aaf3cf6010 WatchSource:0}: Error finding container 6ad6d251e8b47ab305ee6fe2b66d00dffe53bc25f248ab9c44b4d9aaf3cf6010: Status 404 returned error can't find the container with id 6ad6d251e8b47ab305ee6fe2b66d00dffe53bc25f248ab9c44b4d9aaf3cf6010 Mar 16 17:03:59 crc kubenswrapper[5120]: I0316 17:03:59.940379 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-create-h7w47" event={"ID":"df308c5a-dfce-4996-b129-fcc1f36e1743","Type":"ContainerStarted","Data":"6ad6d251e8b47ab305ee6fe2b66d00dffe53bc25f248ab9c44b4d9aaf3cf6010"} Mar 16 17:03:59 crc kubenswrapper[5120]: I0316 17:03:59.956792 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-d475-account-create-update-wx6bw" event={"ID":"83183a55-1c89-4496-b455-9c7e28bee8e3","Type":"ContainerStarted","Data":"6e5dd996cd549177e7fbabf5a6b108ce343bf5885017c62e733aa07571878d1e"} Mar 16 17:03:59 crc kubenswrapper[5120]: I0316 17:03:59.958251 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 17:04:00 crc kubenswrapper[5120]: I0316 17:04:00.019647 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-db-create-9rxdh" podStartSLOduration=2.019612482 podStartE2EDuration="2.019612482s" podCreationTimestamp="2026-03-16 17:03:58 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:03:59.989643644 +0000 UTC m=+5542.143575311" watchObservedRunningTime="2026-03-16 17:04:00.019612482 +0000 UTC m=+5542.173544149" Mar 16 17:04:00 crc kubenswrapper[5120]: I0316 17:04:00.037680 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-7ee8-account-create-update-8npng"] Mar 16 17:04:00 crc kubenswrapper[5120]: I0316 17:04:00.037747 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-create-9rxdh" event={"ID":"abe5ce91-c17a-44b5-8153-a8ffe8d440e9","Type":"ContainerStarted","Data":"a801ff774ac57d46c7793df3794f49ee61fc297f51dc9e6284b121a7bde069f0"} Mar 16 17:04:00 crc kubenswrapper[5120]: I0316 17:04:00.037872 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 17:04:00 crc kubenswrapper[5120]: I0316 17:04:00.037890 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-create-9rxdh" event={"ID":"abe5ce91-c17a-44b5-8153-a8ffe8d440e9","Type":"ContainerStarted","Data":"e1001c3d431596956dfbeae7ea9a92dba41752e6c39159489f02f2a1eec47178"} Mar 16 17:04:00 crc kubenswrapper[5120]: I0316 17:04:00.042629 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Mar 16 17:04:00 crc kubenswrapper[5120]: I0316 17:04:00.046816 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"swift-conf\"" Mar 16 17:04:00 crc kubenswrapper[5120]: I0316 17:04:00.050732 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"swift-storage-config-data\"" Mar 16 17:04:00 crc kubenswrapper[5120]: I0316 17:04:00.051616 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"swift-swift-dockercfg-8r289\"" Mar 16 17:04:00 crc kubenswrapper[5120]: I0316 17:04:00.063021 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"swift-ring-files\"" Mar 16 17:04:00 crc kubenswrapper[5120]: I0316 17:04:00.078325 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-dhrvt"] Mar 16 17:04:00 crc kubenswrapper[5120]: I0316 17:04:00.082367 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/1a6911b8-1804-40ce-88c2-3da863703774-etc-swift\") pod \"swift-storage-0\" (UID: \"1a6911b8-1804-40ce-88c2-3da863703774\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 17:04:00 crc kubenswrapper[5120]: I0316 17:04:00.082444 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1a6911b8-1804-40ce-88c2-3da863703774-combined-ca-bundle\") pod \"swift-storage-0\" (UID: \"1a6911b8-1804-40ce-88c2-3da863703774\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 17:04:00 crc kubenswrapper[5120]: I0316 17:04:00.082526 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2p9f7\" (UniqueName: \"kubernetes.io/projected/1a6911b8-1804-40ce-88c2-3da863703774-kube-api-access-2p9f7\") pod \"swift-storage-0\" (UID: \"1a6911b8-1804-40ce-88c2-3da863703774\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 17:04:00 crc kubenswrapper[5120]: I0316 17:04:00.084455 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"swift-storage-0\" (UID: \"1a6911b8-1804-40ce-88c2-3da863703774\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 17:04:00 crc kubenswrapper[5120]: I0316 17:04:00.084593 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/1a6911b8-1804-40ce-88c2-3da863703774-cache\") pod \"swift-storage-0\" (UID: \"1a6911b8-1804-40ce-88c2-3da863703774\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 17:04:00 crc kubenswrapper[5120]: I0316 17:04:00.084670 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/1a6911b8-1804-40ce-88c2-3da863703774-lock\") pod \"swift-storage-0\" (UID: \"1a6911b8-1804-40ce-88c2-3da863703774\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 17:04:00 crc kubenswrapper[5120]: I0316 17:04:00.092821 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-dhrvt" Mar 16 17:04:00 crc kubenswrapper[5120]: I0316 17:04:00.092890 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-dhrvt"] Mar 16 17:04:00 crc kubenswrapper[5120]: I0316 17:04:00.095727 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"swift-ring-scripts\"" Mar 16 17:04:00 crc kubenswrapper[5120]: I0316 17:04:00.095962 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"swift-proxy-config-data\"" Mar 16 17:04:00 crc kubenswrapper[5120]: I0316 17:04:00.099209 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"swift-ring-config-data\"" Mar 16 17:04:00 crc kubenswrapper[5120]: I0316 17:04:00.164059 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-infra/auto-csr-approver-29561344-8gb27"] Mar 16 17:04:00 crc kubenswrapper[5120]: I0316 17:04:00.175093 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561344-8gb27"] Mar 16 17:04:00 crc kubenswrapper[5120]: I0316 17:04:00.175224 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561344-8gb27" Mar 16 17:04:00 crc kubenswrapper[5120]: I0316 17:04:00.177539 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"openshift-service-ca.crt\"" Mar 16 17:04:00 crc kubenswrapper[5120]: I0316 17:04:00.178017 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-infra\"/\"csr-approver-sa-dockercfg-x2nsz\"" Mar 16 17:04:00 crc kubenswrapper[5120]: I0316 17:04:00.179373 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"kube-root-ca.crt\"" Mar 16 17:04:00 crc kubenswrapper[5120]: I0316 17:04:00.192203 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4acc93da-5600-4c0b-890d-8e2411d387bf-combined-ca-bundle\") pod \"swift-ring-rebalance-dhrvt\" (UID: \"4acc93da-5600-4c0b-890d-8e2411d387bf\") " pod="openstack-kuttl-tests/swift-ring-rebalance-dhrvt" Mar 16 17:04:00 crc kubenswrapper[5120]: I0316 17:04:00.192316 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/1a6911b8-1804-40ce-88c2-3da863703774-etc-swift\") pod \"swift-storage-0\" (UID: \"1a6911b8-1804-40ce-88c2-3da863703774\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 17:04:00 crc kubenswrapper[5120]: I0316 17:04:00.192414 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1a6911b8-1804-40ce-88c2-3da863703774-combined-ca-bundle\") pod \"swift-storage-0\" (UID: \"1a6911b8-1804-40ce-88c2-3da863703774\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 17:04:00 crc kubenswrapper[5120]: I0316 17:04:00.192481 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8k94\" (UniqueName: \"kubernetes.io/projected/4acc93da-5600-4c0b-890d-8e2411d387bf-kube-api-access-c8k94\") pod \"swift-ring-rebalance-dhrvt\" (UID: \"4acc93da-5600-4c0b-890d-8e2411d387bf\") " pod="openstack-kuttl-tests/swift-ring-rebalance-dhrvt" Mar 16 17:04:00 crc kubenswrapper[5120]: I0316 17:04:00.192556 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/4acc93da-5600-4c0b-890d-8e2411d387bf-dispersionconf\") pod \"swift-ring-rebalance-dhrvt\" (UID: \"4acc93da-5600-4c0b-890d-8e2411d387bf\") " pod="openstack-kuttl-tests/swift-ring-rebalance-dhrvt" Mar 16 17:04:00 crc kubenswrapper[5120]: I0316 17:04:00.192638 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2p9f7\" (UniqueName: \"kubernetes.io/projected/1a6911b8-1804-40ce-88c2-3da863703774-kube-api-access-2p9f7\") pod \"swift-storage-0\" (UID: \"1a6911b8-1804-40ce-88c2-3da863703774\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 17:04:00 crc kubenswrapper[5120]: I0316 17:04:00.192731 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/4acc93da-5600-4c0b-890d-8e2411d387bf-swiftconf\") pod \"swift-ring-rebalance-dhrvt\" (UID: \"4acc93da-5600-4c0b-890d-8e2411d387bf\") " pod="openstack-kuttl-tests/swift-ring-rebalance-dhrvt" Mar 16 17:04:00 crc kubenswrapper[5120]: I0316 17:04:00.192863 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/4acc93da-5600-4c0b-890d-8e2411d387bf-etc-swift\") pod \"swift-ring-rebalance-dhrvt\" (UID: \"4acc93da-5600-4c0b-890d-8e2411d387bf\") " pod="openstack-kuttl-tests/swift-ring-rebalance-dhrvt" Mar 16 17:04:00 crc kubenswrapper[5120]: I0316 17:04:00.192943 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/4acc93da-5600-4c0b-890d-8e2411d387bf-scripts\") pod \"swift-ring-rebalance-dhrvt\" (UID: \"4acc93da-5600-4c0b-890d-8e2411d387bf\") " pod="openstack-kuttl-tests/swift-ring-rebalance-dhrvt" Mar 16 17:04:00 crc kubenswrapper[5120]: I0316 17:04:00.193061 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"swift-storage-0\" (UID: \"1a6911b8-1804-40ce-88c2-3da863703774\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 17:04:00 crc kubenswrapper[5120]: I0316 17:04:00.193235 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/4acc93da-5600-4c0b-890d-8e2411d387bf-ring-data-devices\") pod \"swift-ring-rebalance-dhrvt\" (UID: \"4acc93da-5600-4c0b-890d-8e2411d387bf\") " pod="openstack-kuttl-tests/swift-ring-rebalance-dhrvt" Mar 16 17:04:00 crc kubenswrapper[5120]: I0316 17:04:00.193266 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/1a6911b8-1804-40ce-88c2-3da863703774-cache\") pod \"swift-storage-0\" (UID: \"1a6911b8-1804-40ce-88c2-3da863703774\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 17:04:00 crc kubenswrapper[5120]: I0316 17:04:00.193345 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/1a6911b8-1804-40ce-88c2-3da863703774-lock\") pod \"swift-storage-0\" (UID: \"1a6911b8-1804-40ce-88c2-3da863703774\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 17:04:00 crc kubenswrapper[5120]: I0316 17:04:00.194306 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/1a6911b8-1804-40ce-88c2-3da863703774-lock\") pod \"swift-storage-0\" (UID: \"1a6911b8-1804-40ce-88c2-3da863703774\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 17:04:00 crc kubenswrapper[5120]: E0316 17:04:00.194500 5120 projected.go:289] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Mar 16 17:04:00 crc kubenswrapper[5120]: E0316 17:04:00.194527 5120 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Mar 16 17:04:00 crc kubenswrapper[5120]: E0316 17:04:00.194599 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1a6911b8-1804-40ce-88c2-3da863703774-etc-swift podName:1a6911b8-1804-40ce-88c2-3da863703774 nodeName:}" failed. No retries permitted until 2026-03-16 17:04:00.694572535 +0000 UTC m=+5542.848504192 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/1a6911b8-1804-40ce-88c2-3da863703774-etc-swift") pod "swift-storage-0" (UID: "1a6911b8-1804-40ce-88c2-3da863703774") : configmap "swift-ring-files" not found Mar 16 17:04:00 crc kubenswrapper[5120]: I0316 17:04:00.195430 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/1a6911b8-1804-40ce-88c2-3da863703774-cache\") pod \"swift-storage-0\" (UID: \"1a6911b8-1804-40ce-88c2-3da863703774\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 17:04:00 crc kubenswrapper[5120]: I0316 17:04:00.195573 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"swift-storage-0\" (UID: \"1a6911b8-1804-40ce-88c2-3da863703774\") device mount path \"/mnt/openstack/pv03\"" pod="openstack-kuttl-tests/swift-storage-0" Mar 16 17:04:00 crc kubenswrapper[5120]: I0316 17:04:00.205967 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1a6911b8-1804-40ce-88c2-3da863703774-combined-ca-bundle\") pod \"swift-storage-0\" (UID: \"1a6911b8-1804-40ce-88c2-3da863703774\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 17:04:00 crc kubenswrapper[5120]: I0316 17:04:00.219418 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2p9f7\" (UniqueName: \"kubernetes.io/projected/1a6911b8-1804-40ce-88c2-3da863703774-kube-api-access-2p9f7\") pod \"swift-storage-0\" (UID: \"1a6911b8-1804-40ce-88c2-3da863703774\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 17:04:00 crc kubenswrapper[5120]: I0316 17:04:00.229024 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"swift-storage-0\" (UID: \"1a6911b8-1804-40ce-88c2-3da863703774\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 17:04:00 crc kubenswrapper[5120]: I0316 17:04:00.294697 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/4acc93da-5600-4c0b-890d-8e2411d387bf-swiftconf\") pod \"swift-ring-rebalance-dhrvt\" (UID: \"4acc93da-5600-4c0b-890d-8e2411d387bf\") " pod="openstack-kuttl-tests/swift-ring-rebalance-dhrvt" Mar 16 17:04:00 crc kubenswrapper[5120]: I0316 17:04:00.294774 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/4acc93da-5600-4c0b-890d-8e2411d387bf-etc-swift\") pod \"swift-ring-rebalance-dhrvt\" (UID: \"4acc93da-5600-4c0b-890d-8e2411d387bf\") " pod="openstack-kuttl-tests/swift-ring-rebalance-dhrvt" Mar 16 17:04:00 crc kubenswrapper[5120]: I0316 17:04:00.294818 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/4acc93da-5600-4c0b-890d-8e2411d387bf-scripts\") pod \"swift-ring-rebalance-dhrvt\" (UID: \"4acc93da-5600-4c0b-890d-8e2411d387bf\") " pod="openstack-kuttl-tests/swift-ring-rebalance-dhrvt" Mar 16 17:04:00 crc kubenswrapper[5120]: I0316 17:04:00.294908 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2b25n\" (UniqueName: \"kubernetes.io/projected/b42179bd-7723-4c0f-b65b-b61d9cc5aab1-kube-api-access-2b25n\") pod \"auto-csr-approver-29561344-8gb27\" (UID: \"b42179bd-7723-4c0f-b65b-b61d9cc5aab1\") " pod="openshift-infra/auto-csr-approver-29561344-8gb27" Mar 16 17:04:00 crc kubenswrapper[5120]: I0316 17:04:00.294961 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/4acc93da-5600-4c0b-890d-8e2411d387bf-ring-data-devices\") pod \"swift-ring-rebalance-dhrvt\" (UID: \"4acc93da-5600-4c0b-890d-8e2411d387bf\") " pod="openstack-kuttl-tests/swift-ring-rebalance-dhrvt" Mar 16 17:04:00 crc kubenswrapper[5120]: I0316 17:04:00.295022 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4acc93da-5600-4c0b-890d-8e2411d387bf-combined-ca-bundle\") pod \"swift-ring-rebalance-dhrvt\" (UID: \"4acc93da-5600-4c0b-890d-8e2411d387bf\") " pod="openstack-kuttl-tests/swift-ring-rebalance-dhrvt" Mar 16 17:04:00 crc kubenswrapper[5120]: I0316 17:04:00.295091 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c8k94\" (UniqueName: \"kubernetes.io/projected/4acc93da-5600-4c0b-890d-8e2411d387bf-kube-api-access-c8k94\") pod \"swift-ring-rebalance-dhrvt\" (UID: \"4acc93da-5600-4c0b-890d-8e2411d387bf\") " pod="openstack-kuttl-tests/swift-ring-rebalance-dhrvt" Mar 16 17:04:00 crc kubenswrapper[5120]: I0316 17:04:00.295124 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/4acc93da-5600-4c0b-890d-8e2411d387bf-dispersionconf\") pod \"swift-ring-rebalance-dhrvt\" (UID: \"4acc93da-5600-4c0b-890d-8e2411d387bf\") " pod="openstack-kuttl-tests/swift-ring-rebalance-dhrvt" Mar 16 17:04:00 crc kubenswrapper[5120]: I0316 17:04:00.295473 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/4acc93da-5600-4c0b-890d-8e2411d387bf-etc-swift\") pod \"swift-ring-rebalance-dhrvt\" (UID: \"4acc93da-5600-4c0b-890d-8e2411d387bf\") " pod="openstack-kuttl-tests/swift-ring-rebalance-dhrvt" Mar 16 17:04:00 crc kubenswrapper[5120]: I0316 17:04:00.296027 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/4acc93da-5600-4c0b-890d-8e2411d387bf-ring-data-devices\") pod \"swift-ring-rebalance-dhrvt\" (UID: \"4acc93da-5600-4c0b-890d-8e2411d387bf\") " pod="openstack-kuttl-tests/swift-ring-rebalance-dhrvt" Mar 16 17:04:00 crc kubenswrapper[5120]: I0316 17:04:00.296437 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/4acc93da-5600-4c0b-890d-8e2411d387bf-scripts\") pod \"swift-ring-rebalance-dhrvt\" (UID: \"4acc93da-5600-4c0b-890d-8e2411d387bf\") " pod="openstack-kuttl-tests/swift-ring-rebalance-dhrvt" Mar 16 17:04:00 crc kubenswrapper[5120]: I0316 17:04:00.298204 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/4acc93da-5600-4c0b-890d-8e2411d387bf-dispersionconf\") pod \"swift-ring-rebalance-dhrvt\" (UID: \"4acc93da-5600-4c0b-890d-8e2411d387bf\") " pod="openstack-kuttl-tests/swift-ring-rebalance-dhrvt" Mar 16 17:04:00 crc kubenswrapper[5120]: I0316 17:04:00.301314 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/4acc93da-5600-4c0b-890d-8e2411d387bf-swiftconf\") pod \"swift-ring-rebalance-dhrvt\" (UID: \"4acc93da-5600-4c0b-890d-8e2411d387bf\") " pod="openstack-kuttl-tests/swift-ring-rebalance-dhrvt" Mar 16 17:04:00 crc kubenswrapper[5120]: I0316 17:04:00.301570 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4acc93da-5600-4c0b-890d-8e2411d387bf-combined-ca-bundle\") pod \"swift-ring-rebalance-dhrvt\" (UID: \"4acc93da-5600-4c0b-890d-8e2411d387bf\") " pod="openstack-kuttl-tests/swift-ring-rebalance-dhrvt" Mar 16 17:04:00 crc kubenswrapper[5120]: I0316 17:04:00.324324 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8k94\" (UniqueName: \"kubernetes.io/projected/4acc93da-5600-4c0b-890d-8e2411d387bf-kube-api-access-c8k94\") pod \"swift-ring-rebalance-dhrvt\" (UID: \"4acc93da-5600-4c0b-890d-8e2411d387bf\") " pod="openstack-kuttl-tests/swift-ring-rebalance-dhrvt" Mar 16 17:04:00 crc kubenswrapper[5120]: I0316 17:04:00.397276 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2b25n\" (UniqueName: \"kubernetes.io/projected/b42179bd-7723-4c0f-b65b-b61d9cc5aab1-kube-api-access-2b25n\") pod \"auto-csr-approver-29561344-8gb27\" (UID: \"b42179bd-7723-4c0f-b65b-b61d9cc5aab1\") " pod="openshift-infra/auto-csr-approver-29561344-8gb27" Mar 16 17:04:00 crc kubenswrapper[5120]: I0316 17:04:00.420214 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2b25n\" (UniqueName: \"kubernetes.io/projected/b42179bd-7723-4c0f-b65b-b61d9cc5aab1-kube-api-access-2b25n\") pod \"auto-csr-approver-29561344-8gb27\" (UID: \"b42179bd-7723-4c0f-b65b-b61d9cc5aab1\") " pod="openshift-infra/auto-csr-approver-29561344-8gb27" Mar 16 17:04:00 crc kubenswrapper[5120]: I0316 17:04:00.504645 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-dhrvt" Mar 16 17:04:00 crc kubenswrapper[5120]: I0316 17:04:00.512366 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561344-8gb27" Mar 16 17:04:00 crc kubenswrapper[5120]: I0316 17:04:00.704697 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/1a6911b8-1804-40ce-88c2-3da863703774-etc-swift\") pod \"swift-storage-0\" (UID: \"1a6911b8-1804-40ce-88c2-3da863703774\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 17:04:00 crc kubenswrapper[5120]: E0316 17:04:00.706032 5120 projected.go:289] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Mar 16 17:04:00 crc kubenswrapper[5120]: E0316 17:04:00.706063 5120 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Mar 16 17:04:00 crc kubenswrapper[5120]: E0316 17:04:00.706125 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1a6911b8-1804-40ce-88c2-3da863703774-etc-swift podName:1a6911b8-1804-40ce-88c2-3da863703774 nodeName:}" failed. No retries permitted until 2026-03-16 17:04:01.706105256 +0000 UTC m=+5543.860036913 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/1a6911b8-1804-40ce-88c2-3da863703774-etc-swift") pod "swift-storage-0" (UID: "1a6911b8-1804-40ce-88c2-3da863703774") : configmap "swift-ring-files" not found Mar 16 17:04:00 crc kubenswrapper[5120]: I0316 17:04:00.789793 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:04:00 crc kubenswrapper[5120]: I0316 17:04:00.841424 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:04:00 crc kubenswrapper[5120]: I0316 17:04:00.960080 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:04:01 crc kubenswrapper[5120]: I0316 17:04:01.002250 5120 generic.go:358] "Generic (PLEG): container finished" podID="83183a55-1c89-4496-b455-9c7e28bee8e3" containerID="5de45d663659734bf67fea9f4b926f140bb82d2bd443138837c84671f787b1af" exitCode=0 Mar 16 17:04:01 crc kubenswrapper[5120]: I0316 17:04:01.002331 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-d475-account-create-update-wx6bw" event={"ID":"83183a55-1c89-4496-b455-9c7e28bee8e3","Type":"ContainerDied","Data":"5de45d663659734bf67fea9f4b926f140bb82d2bd443138837c84671f787b1af"} Mar 16 17:04:01 crc kubenswrapper[5120]: I0316 17:04:01.005706 5120 generic.go:358] "Generic (PLEG): container finished" podID="abe5ce91-c17a-44b5-8153-a8ffe8d440e9" containerID="a801ff774ac57d46c7793df3794f49ee61fc297f51dc9e6284b121a7bde069f0" exitCode=0 Mar 16 17:04:01 crc kubenswrapper[5120]: I0316 17:04:01.006130 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-create-9rxdh" event={"ID":"abe5ce91-c17a-44b5-8153-a8ffe8d440e9","Type":"ContainerDied","Data":"a801ff774ac57d46c7793df3794f49ee61fc297f51dc9e6284b121a7bde069f0"} Mar 16 17:04:01 crc kubenswrapper[5120]: I0316 17:04:01.010717 5120 generic.go:358] "Generic (PLEG): container finished" podID="df308c5a-dfce-4996-b129-fcc1f36e1743" containerID="1fdd300bb1428e16cfede9bd5ea3086098c6706381ad7ad817f2f22bbaf5dd41" exitCode=0 Mar 16 17:04:01 crc kubenswrapper[5120]: I0316 17:04:01.011045 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-create-h7w47" event={"ID":"df308c5a-dfce-4996-b129-fcc1f36e1743","Type":"ContainerDied","Data":"1fdd300bb1428e16cfede9bd5ea3086098c6706381ad7ad817f2f22bbaf5dd41"} Mar 16 17:04:01 crc kubenswrapper[5120]: I0316 17:04:01.016967 5120 generic.go:358] "Generic (PLEG): container finished" podID="79a9c531-41a9-4754-91ee-697e1c3bdb44" containerID="d4fbec92f3dc1a4f9c6b9dee1448e97936aebfc047d4fd728d57a8c167fbfec7" exitCode=0 Mar 16 17:04:01 crc kubenswrapper[5120]: I0316 17:04:01.020411 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-7ee8-account-create-update-8npng" event={"ID":"79a9c531-41a9-4754-91ee-697e1c3bdb44","Type":"ContainerDied","Data":"d4fbec92f3dc1a4f9c6b9dee1448e97936aebfc047d4fd728d57a8c167fbfec7"} Mar 16 17:04:01 crc kubenswrapper[5120]: I0316 17:04:01.020500 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-7ee8-account-create-update-8npng" event={"ID":"79a9c531-41a9-4754-91ee-697e1c3bdb44","Type":"ContainerStarted","Data":"8499cfd1569f018350a8c6b1db4b8fc27419824a481d7e74e535be1cf5a43882"} Mar 16 17:04:01 crc kubenswrapper[5120]: I0316 17:04:01.022642 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-dhrvt"] Mar 16 17:04:01 crc kubenswrapper[5120]: I0316 17:04:01.113541 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561344-8gb27"] Mar 16 17:04:01 crc kubenswrapper[5120]: W0316 17:04:01.119511 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb42179bd_7723_4c0f_b65b_b61d9cc5aab1.slice/crio-62facf2d986f9097af0def4acec0e08306b47ebdcdee9b03d122eb7d07093d5a WatchSource:0}: Error finding container 62facf2d986f9097af0def4acec0e08306b47ebdcdee9b03d122eb7d07093d5a: Status 404 returned error can't find the container with id 62facf2d986f9097af0def4acec0e08306b47ebdcdee9b03d122eb7d07093d5a Mar 16 17:04:01 crc kubenswrapper[5120]: I0316 17:04:01.279948 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 17:04:01 crc kubenswrapper[5120]: I0316 17:04:01.299720 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:04:01 crc kubenswrapper[5120]: I0316 17:04:01.303403 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ovnnorthd-ovnnorthd-dockercfg-qc4rf\"" Mar 16 17:04:01 crc kubenswrapper[5120]: I0316 17:04:01.303597 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovnnorthd-scripts\"" Mar 16 17:04:01 crc kubenswrapper[5120]: I0316 17:04:01.303697 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovnnorthd-config\"" Mar 16 17:04:01 crc kubenswrapper[5120]: I0316 17:04:01.305895 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ovnnorthd-ovndbs\"" Mar 16 17:04:01 crc kubenswrapper[5120]: I0316 17:04:01.312900 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 17:04:01 crc kubenswrapper[5120]: I0316 17:04:01.322564 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4281ec55-3466-4ca1-8054-498475a4407a-config\") pod \"ovn-northd-0\" (UID: \"4281ec55-3466-4ca1-8054-498475a4407a\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:04:01 crc kubenswrapper[5120]: I0316 17:04:01.322614 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/4281ec55-3466-4ca1-8054-498475a4407a-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"4281ec55-3466-4ca1-8054-498475a4407a\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:04:01 crc kubenswrapper[5120]: I0316 17:04:01.322650 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4281ec55-3466-4ca1-8054-498475a4407a-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"4281ec55-3466-4ca1-8054-498475a4407a\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:04:01 crc kubenswrapper[5120]: I0316 17:04:01.322672 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/4281ec55-3466-4ca1-8054-498475a4407a-scripts\") pod \"ovn-northd-0\" (UID: \"4281ec55-3466-4ca1-8054-498475a4407a\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:04:01 crc kubenswrapper[5120]: I0316 17:04:01.322867 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/4281ec55-3466-4ca1-8054-498475a4407a-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"4281ec55-3466-4ca1-8054-498475a4407a\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:04:01 crc kubenswrapper[5120]: I0316 17:04:01.322918 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/4281ec55-3466-4ca1-8054-498475a4407a-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"4281ec55-3466-4ca1-8054-498475a4407a\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:04:01 crc kubenswrapper[5120]: I0316 17:04:01.323040 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgqpg\" (UniqueName: \"kubernetes.io/projected/4281ec55-3466-4ca1-8054-498475a4407a-kube-api-access-xgqpg\") pod \"ovn-northd-0\" (UID: \"4281ec55-3466-4ca1-8054-498475a4407a\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:04:01 crc kubenswrapper[5120]: I0316 17:04:01.424693 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4281ec55-3466-4ca1-8054-498475a4407a-config\") pod \"ovn-northd-0\" (UID: \"4281ec55-3466-4ca1-8054-498475a4407a\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:04:01 crc kubenswrapper[5120]: I0316 17:04:01.424741 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/4281ec55-3466-4ca1-8054-498475a4407a-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"4281ec55-3466-4ca1-8054-498475a4407a\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:04:01 crc kubenswrapper[5120]: I0316 17:04:01.424798 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4281ec55-3466-4ca1-8054-498475a4407a-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"4281ec55-3466-4ca1-8054-498475a4407a\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:04:01 crc kubenswrapper[5120]: I0316 17:04:01.424818 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/4281ec55-3466-4ca1-8054-498475a4407a-scripts\") pod \"ovn-northd-0\" (UID: \"4281ec55-3466-4ca1-8054-498475a4407a\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:04:01 crc kubenswrapper[5120]: I0316 17:04:01.424885 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/4281ec55-3466-4ca1-8054-498475a4407a-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"4281ec55-3466-4ca1-8054-498475a4407a\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:04:01 crc kubenswrapper[5120]: I0316 17:04:01.424912 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/4281ec55-3466-4ca1-8054-498475a4407a-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"4281ec55-3466-4ca1-8054-498475a4407a\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:04:01 crc kubenswrapper[5120]: I0316 17:04:01.424969 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xgqpg\" (UniqueName: \"kubernetes.io/projected/4281ec55-3466-4ca1-8054-498475a4407a-kube-api-access-xgqpg\") pod \"ovn-northd-0\" (UID: \"4281ec55-3466-4ca1-8054-498475a4407a\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:04:01 crc kubenswrapper[5120]: I0316 17:04:01.426093 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4281ec55-3466-4ca1-8054-498475a4407a-config\") pod \"ovn-northd-0\" (UID: \"4281ec55-3466-4ca1-8054-498475a4407a\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:04:01 crc kubenswrapper[5120]: I0316 17:04:01.426999 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/4281ec55-3466-4ca1-8054-498475a4407a-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"4281ec55-3466-4ca1-8054-498475a4407a\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:04:01 crc kubenswrapper[5120]: I0316 17:04:01.427211 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/4281ec55-3466-4ca1-8054-498475a4407a-scripts\") pod \"ovn-northd-0\" (UID: \"4281ec55-3466-4ca1-8054-498475a4407a\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:04:01 crc kubenswrapper[5120]: I0316 17:04:01.432055 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4281ec55-3466-4ca1-8054-498475a4407a-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"4281ec55-3466-4ca1-8054-498475a4407a\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:04:01 crc kubenswrapper[5120]: I0316 17:04:01.432467 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/4281ec55-3466-4ca1-8054-498475a4407a-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"4281ec55-3466-4ca1-8054-498475a4407a\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:04:01 crc kubenswrapper[5120]: I0316 17:04:01.437865 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/4281ec55-3466-4ca1-8054-498475a4407a-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"4281ec55-3466-4ca1-8054-498475a4407a\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:04:01 crc kubenswrapper[5120]: I0316 17:04:01.444027 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgqpg\" (UniqueName: \"kubernetes.io/projected/4281ec55-3466-4ca1-8054-498475a4407a-kube-api-access-xgqpg\") pod \"ovn-northd-0\" (UID: \"4281ec55-3466-4ca1-8054-498475a4407a\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:04:01 crc kubenswrapper[5120]: I0316 17:04:01.626524 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:04:01 crc kubenswrapper[5120]: I0316 17:04:01.733591 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/1a6911b8-1804-40ce-88c2-3da863703774-etc-swift\") pod \"swift-storage-0\" (UID: \"1a6911b8-1804-40ce-88c2-3da863703774\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 17:04:01 crc kubenswrapper[5120]: E0316 17:04:01.733860 5120 projected.go:289] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Mar 16 17:04:01 crc kubenswrapper[5120]: E0316 17:04:01.734469 5120 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Mar 16 17:04:01 crc kubenswrapper[5120]: E0316 17:04:01.734629 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1a6911b8-1804-40ce-88c2-3da863703774-etc-swift podName:1a6911b8-1804-40ce-88c2-3da863703774 nodeName:}" failed. No retries permitted until 2026-03-16 17:04:03.734600208 +0000 UTC m=+5545.888531865 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/1a6911b8-1804-40ce-88c2-3da863703774-etc-swift") pod "swift-storage-0" (UID: "1a6911b8-1804-40ce-88c2-3da863703774") : configmap "swift-ring-files" not found Mar 16 17:04:02 crc kubenswrapper[5120]: I0316 17:04:02.027796 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561344-8gb27" event={"ID":"b42179bd-7723-4c0f-b65b-b61d9cc5aab1","Type":"ContainerStarted","Data":"62facf2d986f9097af0def4acec0e08306b47ebdcdee9b03d122eb7d07093d5a"} Mar 16 17:04:02 crc kubenswrapper[5120]: I0316 17:04:02.030316 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-dhrvt" event={"ID":"4acc93da-5600-4c0b-890d-8e2411d387bf","Type":"ContainerStarted","Data":"b94db45a50541559bdedc3c8aa62f31b1d4a3f0a3bfdb5aa16e8b980a8e658a1"} Mar 16 17:04:02 crc kubenswrapper[5120]: I0316 17:04:02.030341 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-dhrvt" event={"ID":"4acc93da-5600-4c0b-890d-8e2411d387bf","Type":"ContainerStarted","Data":"6f45d0a40712529afed104b53d7fc6f237c6223b03d5978f883b16888e84329e"} Mar 16 17:04:02 crc kubenswrapper[5120]: I0316 17:04:02.062528 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/swift-ring-rebalance-dhrvt" podStartSLOduration=2.062509887 podStartE2EDuration="2.062509887s" podCreationTimestamp="2026-03-16 17:04:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:04:02.060162372 +0000 UTC m=+5544.214094029" watchObservedRunningTime="2026-03-16 17:04:02.062509887 +0000 UTC m=+5544.216441564" Mar 16 17:04:02 crc kubenswrapper[5120]: W0316 17:04:02.126810 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4281ec55_3466_4ca1_8054_498475a4407a.slice/crio-8385739d66aa2f859a8ec60bb5634b39e5f4bc93afc6081df9a6afd60b4231bf WatchSource:0}: Error finding container 8385739d66aa2f859a8ec60bb5634b39e5f4bc93afc6081df9a6afd60b4231bf: Status 404 returned error can't find the container with id 8385739d66aa2f859a8ec60bb5634b39e5f4bc93afc6081df9a6afd60b4231bf Mar 16 17:04:02 crc kubenswrapper[5120]: I0316 17:04:02.127677 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 17:04:02 crc kubenswrapper[5120]: I0316 17:04:02.368407 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-d475-account-create-update-wx6bw" Mar 16 17:04:02 crc kubenswrapper[5120]: I0316 17:04:02.454829 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ngjxj\" (UniqueName: \"kubernetes.io/projected/83183a55-1c89-4496-b455-9c7e28bee8e3-kube-api-access-ngjxj\") pod \"83183a55-1c89-4496-b455-9c7e28bee8e3\" (UID: \"83183a55-1c89-4496-b455-9c7e28bee8e3\") " Mar 16 17:04:02 crc kubenswrapper[5120]: I0316 17:04:02.455983 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/83183a55-1c89-4496-b455-9c7e28bee8e3-operator-scripts\") pod \"83183a55-1c89-4496-b455-9c7e28bee8e3\" (UID: \"83183a55-1c89-4496-b455-9c7e28bee8e3\") " Mar 16 17:04:02 crc kubenswrapper[5120]: I0316 17:04:02.457080 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/83183a55-1c89-4496-b455-9c7e28bee8e3-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "83183a55-1c89-4496-b455-9c7e28bee8e3" (UID: "83183a55-1c89-4496-b455-9c7e28bee8e3"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:04:02 crc kubenswrapper[5120]: I0316 17:04:02.457943 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/83183a55-1c89-4496-b455-9c7e28bee8e3-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:04:02 crc kubenswrapper[5120]: I0316 17:04:02.461698 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83183a55-1c89-4496-b455-9c7e28bee8e3-kube-api-access-ngjxj" (OuterVolumeSpecName: "kube-api-access-ngjxj") pod "83183a55-1c89-4496-b455-9c7e28bee8e3" (UID: "83183a55-1c89-4496-b455-9c7e28bee8e3"). InnerVolumeSpecName "kube-api-access-ngjxj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:04:02 crc kubenswrapper[5120]: I0316 17:04:02.560060 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ngjxj\" (UniqueName: \"kubernetes.io/projected/83183a55-1c89-4496-b455-9c7e28bee8e3-kube-api-access-ngjxj\") on node \"crc\" DevicePath \"\"" Mar 16 17:04:02 crc kubenswrapper[5120]: I0316 17:04:02.633975 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-7ee8-account-create-update-8npng" Mar 16 17:04:02 crc kubenswrapper[5120]: I0316 17:04:02.662424 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/79a9c531-41a9-4754-91ee-697e1c3bdb44-operator-scripts\") pod \"79a9c531-41a9-4754-91ee-697e1c3bdb44\" (UID: \"79a9c531-41a9-4754-91ee-697e1c3bdb44\") " Mar 16 17:04:02 crc kubenswrapper[5120]: I0316 17:04:02.662815 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c5p2j\" (UniqueName: \"kubernetes.io/projected/79a9c531-41a9-4754-91ee-697e1c3bdb44-kube-api-access-c5p2j\") pod \"79a9c531-41a9-4754-91ee-697e1c3bdb44\" (UID: \"79a9c531-41a9-4754-91ee-697e1c3bdb44\") " Mar 16 17:04:02 crc kubenswrapper[5120]: I0316 17:04:02.663356 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/79a9c531-41a9-4754-91ee-697e1c3bdb44-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "79a9c531-41a9-4754-91ee-697e1c3bdb44" (UID: "79a9c531-41a9-4754-91ee-697e1c3bdb44"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:04:02 crc kubenswrapper[5120]: I0316 17:04:02.670887 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-create-9rxdh" Mar 16 17:04:02 crc kubenswrapper[5120]: I0316 17:04:02.672002 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79a9c531-41a9-4754-91ee-697e1c3bdb44-kube-api-access-c5p2j" (OuterVolumeSpecName: "kube-api-access-c5p2j") pod "79a9c531-41a9-4754-91ee-697e1c3bdb44" (UID: "79a9c531-41a9-4754-91ee-697e1c3bdb44"). InnerVolumeSpecName "kube-api-access-c5p2j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:04:02 crc kubenswrapper[5120]: I0316 17:04:02.678498 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-create-h7w47" Mar 16 17:04:02 crc kubenswrapper[5120]: I0316 17:04:02.764414 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/abe5ce91-c17a-44b5-8153-a8ffe8d440e9-operator-scripts\") pod \"abe5ce91-c17a-44b5-8153-a8ffe8d440e9\" (UID: \"abe5ce91-c17a-44b5-8153-a8ffe8d440e9\") " Mar 16 17:04:02 crc kubenswrapper[5120]: I0316 17:04:02.764578 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2kr5h\" (UniqueName: \"kubernetes.io/projected/df308c5a-dfce-4996-b129-fcc1f36e1743-kube-api-access-2kr5h\") pod \"df308c5a-dfce-4996-b129-fcc1f36e1743\" (UID: \"df308c5a-dfce-4996-b129-fcc1f36e1743\") " Mar 16 17:04:02 crc kubenswrapper[5120]: I0316 17:04:02.764892 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/df308c5a-dfce-4996-b129-fcc1f36e1743-operator-scripts\") pod \"df308c5a-dfce-4996-b129-fcc1f36e1743\" (UID: \"df308c5a-dfce-4996-b129-fcc1f36e1743\") " Mar 16 17:04:02 crc kubenswrapper[5120]: I0316 17:04:02.765088 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zlq55\" (UniqueName: \"kubernetes.io/projected/abe5ce91-c17a-44b5-8153-a8ffe8d440e9-kube-api-access-zlq55\") pod \"abe5ce91-c17a-44b5-8153-a8ffe8d440e9\" (UID: \"abe5ce91-c17a-44b5-8153-a8ffe8d440e9\") " Mar 16 17:04:02 crc kubenswrapper[5120]: I0316 17:04:02.766063 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c5p2j\" (UniqueName: \"kubernetes.io/projected/79a9c531-41a9-4754-91ee-697e1c3bdb44-kube-api-access-c5p2j\") on node \"crc\" DevicePath \"\"" Mar 16 17:04:02 crc kubenswrapper[5120]: I0316 17:04:02.766090 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/79a9c531-41a9-4754-91ee-697e1c3bdb44-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:04:02 crc kubenswrapper[5120]: I0316 17:04:02.768385 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/df308c5a-dfce-4996-b129-fcc1f36e1743-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "df308c5a-dfce-4996-b129-fcc1f36e1743" (UID: "df308c5a-dfce-4996-b129-fcc1f36e1743"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:04:02 crc kubenswrapper[5120]: I0316 17:04:02.788933 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/abe5ce91-c17a-44b5-8153-a8ffe8d440e9-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "abe5ce91-c17a-44b5-8153-a8ffe8d440e9" (UID: "abe5ce91-c17a-44b5-8153-a8ffe8d440e9"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:04:02 crc kubenswrapper[5120]: I0316 17:04:02.789448 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df308c5a-dfce-4996-b129-fcc1f36e1743-kube-api-access-2kr5h" (OuterVolumeSpecName: "kube-api-access-2kr5h") pod "df308c5a-dfce-4996-b129-fcc1f36e1743" (UID: "df308c5a-dfce-4996-b129-fcc1f36e1743"). InnerVolumeSpecName "kube-api-access-2kr5h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:04:02 crc kubenswrapper[5120]: I0316 17:04:02.796787 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/abe5ce91-c17a-44b5-8153-a8ffe8d440e9-kube-api-access-zlq55" (OuterVolumeSpecName: "kube-api-access-zlq55") pod "abe5ce91-c17a-44b5-8153-a8ffe8d440e9" (UID: "abe5ce91-c17a-44b5-8153-a8ffe8d440e9"). InnerVolumeSpecName "kube-api-access-zlq55". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:04:02 crc kubenswrapper[5120]: I0316 17:04:02.868584 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zlq55\" (UniqueName: \"kubernetes.io/projected/abe5ce91-c17a-44b5-8153-a8ffe8d440e9-kube-api-access-zlq55\") on node \"crc\" DevicePath \"\"" Mar 16 17:04:02 crc kubenswrapper[5120]: I0316 17:04:02.868631 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/abe5ce91-c17a-44b5-8153-a8ffe8d440e9-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:04:02 crc kubenswrapper[5120]: I0316 17:04:02.868644 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2kr5h\" (UniqueName: \"kubernetes.io/projected/df308c5a-dfce-4996-b129-fcc1f36e1743-kube-api-access-2kr5h\") on node \"crc\" DevicePath \"\"" Mar 16 17:04:02 crc kubenswrapper[5120]: I0316 17:04:02.868656 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/df308c5a-dfce-4996-b129-fcc1f36e1743-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:04:03 crc kubenswrapper[5120]: I0316 17:04:03.041313 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-7ee8-account-create-update-8npng" Mar 16 17:04:03 crc kubenswrapper[5120]: I0316 17:04:03.041346 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-7ee8-account-create-update-8npng" event={"ID":"79a9c531-41a9-4754-91ee-697e1c3bdb44","Type":"ContainerDied","Data":"8499cfd1569f018350a8c6b1db4b8fc27419824a481d7e74e535be1cf5a43882"} Mar 16 17:04:03 crc kubenswrapper[5120]: I0316 17:04:03.041682 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8499cfd1569f018350a8c6b1db4b8fc27419824a481d7e74e535be1cf5a43882" Mar 16 17:04:03 crc kubenswrapper[5120]: I0316 17:04:03.043178 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-d475-account-create-update-wx6bw" event={"ID":"83183a55-1c89-4496-b455-9c7e28bee8e3","Type":"ContainerDied","Data":"6e5dd996cd549177e7fbabf5a6b108ce343bf5885017c62e733aa07571878d1e"} Mar 16 17:04:03 crc kubenswrapper[5120]: I0316 17:04:03.043222 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6e5dd996cd549177e7fbabf5a6b108ce343bf5885017c62e733aa07571878d1e" Mar 16 17:04:03 crc kubenswrapper[5120]: I0316 17:04:03.043291 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-d475-account-create-update-wx6bw" Mar 16 17:04:03 crc kubenswrapper[5120]: I0316 17:04:03.045468 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-create-9rxdh" Mar 16 17:04:03 crc kubenswrapper[5120]: I0316 17:04:03.045560 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-create-9rxdh" event={"ID":"abe5ce91-c17a-44b5-8153-a8ffe8d440e9","Type":"ContainerDied","Data":"e1001c3d431596956dfbeae7ea9a92dba41752e6c39159489f02f2a1eec47178"} Mar 16 17:04:03 crc kubenswrapper[5120]: I0316 17:04:03.045596 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e1001c3d431596956dfbeae7ea9a92dba41752e6c39159489f02f2a1eec47178" Mar 16 17:04:03 crc kubenswrapper[5120]: I0316 17:04:03.049303 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561344-8gb27" event={"ID":"b42179bd-7723-4c0f-b65b-b61d9cc5aab1","Type":"ContainerStarted","Data":"bb08a4df642a778f0975079b5dcf2a213766a7068c8ac2b1c5b7b2eca73dc7e3"} Mar 16 17:04:03 crc kubenswrapper[5120]: I0316 17:04:03.051715 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"4281ec55-3466-4ca1-8054-498475a4407a","Type":"ContainerStarted","Data":"40692fb4e719bbea05f717260a282bea677f342794b8fe0f8ea6f1f1abbfebd5"} Mar 16 17:04:03 crc kubenswrapper[5120]: I0316 17:04:03.051904 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"4281ec55-3466-4ca1-8054-498475a4407a","Type":"ContainerStarted","Data":"96a5af6c245f152292c5f105e917134b38b18b97df711c59fca353841e123fc8"} Mar 16 17:04:03 crc kubenswrapper[5120]: I0316 17:04:03.052000 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:04:03 crc kubenswrapper[5120]: I0316 17:04:03.052078 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"4281ec55-3466-4ca1-8054-498475a4407a","Type":"ContainerStarted","Data":"8385739d66aa2f859a8ec60bb5634b39e5f4bc93afc6081df9a6afd60b4231bf"} Mar 16 17:04:03 crc kubenswrapper[5120]: I0316 17:04:03.054524 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-create-h7w47" event={"ID":"df308c5a-dfce-4996-b129-fcc1f36e1743","Type":"ContainerDied","Data":"6ad6d251e8b47ab305ee6fe2b66d00dffe53bc25f248ab9c44b4d9aaf3cf6010"} Mar 16 17:04:03 crc kubenswrapper[5120]: I0316 17:04:03.054567 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6ad6d251e8b47ab305ee6fe2b66d00dffe53bc25f248ab9c44b4d9aaf3cf6010" Mar 16 17:04:03 crc kubenswrapper[5120]: I0316 17:04:03.054784 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-create-h7w47" Mar 16 17:04:03 crc kubenswrapper[5120]: I0316 17:04:03.073372 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-infra/auto-csr-approver-29561344-8gb27" podStartSLOduration=1.926333206 podStartE2EDuration="3.073354272s" podCreationTimestamp="2026-03-16 17:04:00 +0000 UTC" firstStartedPulling="2026-03-16 17:04:01.123069075 +0000 UTC m=+5543.277000732" lastFinishedPulling="2026-03-16 17:04:02.270090141 +0000 UTC m=+5544.424021798" observedRunningTime="2026-03-16 17:04:03.0696738 +0000 UTC m=+5545.223605447" watchObservedRunningTime="2026-03-16 17:04:03.073354272 +0000 UTC m=+5545.227285929" Mar 16 17:04:03 crc kubenswrapper[5120]: I0316 17:04:03.108776 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovn-northd-0" podStartSLOduration=2.108738439 podStartE2EDuration="2.108738439s" podCreationTimestamp="2026-03-16 17:04:01 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:04:03.103909896 +0000 UTC m=+5545.257841553" watchObservedRunningTime="2026-03-16 17:04:03.108738439 +0000 UTC m=+5545.262670096" Mar 16 17:04:03 crc kubenswrapper[5120]: I0316 17:04:03.788346 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/1a6911b8-1804-40ce-88c2-3da863703774-etc-swift\") pod \"swift-storage-0\" (UID: \"1a6911b8-1804-40ce-88c2-3da863703774\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 17:04:03 crc kubenswrapper[5120]: E0316 17:04:03.788719 5120 projected.go:289] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Mar 16 17:04:03 crc kubenswrapper[5120]: E0316 17:04:03.788751 5120 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Mar 16 17:04:03 crc kubenswrapper[5120]: E0316 17:04:03.788845 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1a6911b8-1804-40ce-88c2-3da863703774-etc-swift podName:1a6911b8-1804-40ce-88c2-3da863703774 nodeName:}" failed. No retries permitted until 2026-03-16 17:04:07.788819637 +0000 UTC m=+5549.942751344 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/1a6911b8-1804-40ce-88c2-3da863703774-etc-swift") pod "swift-storage-0" (UID: "1a6911b8-1804-40ce-88c2-3da863703774") : configmap "swift-ring-files" not found Mar 16 17:04:03 crc kubenswrapper[5120]: I0316 17:04:03.863775 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 17:04:04 crc kubenswrapper[5120]: I0316 17:04:04.063970 5120 generic.go:358] "Generic (PLEG): container finished" podID="b42179bd-7723-4c0f-b65b-b61d9cc5aab1" containerID="bb08a4df642a778f0975079b5dcf2a213766a7068c8ac2b1c5b7b2eca73dc7e3" exitCode=0 Mar 16 17:04:04 crc kubenswrapper[5120]: I0316 17:04:04.064017 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561344-8gb27" event={"ID":"b42179bd-7723-4c0f-b65b-b61d9cc5aab1","Type":"ContainerDied","Data":"bb08a4df642a778f0975079b5dcf2a213766a7068c8ac2b1c5b7b2eca73dc7e3"} Mar 16 17:04:04 crc kubenswrapper[5120]: I0316 17:04:04.718472 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/root-account-create-update-swmpp"] Mar 16 17:04:04 crc kubenswrapper[5120]: I0316 17:04:04.719444 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df308c5a-dfce-4996-b129-fcc1f36e1743" containerName="mariadb-database-create" Mar 16 17:04:04 crc kubenswrapper[5120]: I0316 17:04:04.719465 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="df308c5a-dfce-4996-b129-fcc1f36e1743" containerName="mariadb-database-create" Mar 16 17:04:04 crc kubenswrapper[5120]: I0316 17:04:04.719483 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="abe5ce91-c17a-44b5-8153-a8ffe8d440e9" containerName="mariadb-database-create" Mar 16 17:04:04 crc kubenswrapper[5120]: I0316 17:04:04.719489 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="abe5ce91-c17a-44b5-8153-a8ffe8d440e9" containerName="mariadb-database-create" Mar 16 17:04:04 crc kubenswrapper[5120]: I0316 17:04:04.719511 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83183a55-1c89-4496-b455-9c7e28bee8e3" containerName="mariadb-account-create-update" Mar 16 17:04:04 crc kubenswrapper[5120]: I0316 17:04:04.719520 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="83183a55-1c89-4496-b455-9c7e28bee8e3" containerName="mariadb-account-create-update" Mar 16 17:04:04 crc kubenswrapper[5120]: I0316 17:04:04.719554 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79a9c531-41a9-4754-91ee-697e1c3bdb44" containerName="mariadb-account-create-update" Mar 16 17:04:04 crc kubenswrapper[5120]: I0316 17:04:04.719561 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="79a9c531-41a9-4754-91ee-697e1c3bdb44" containerName="mariadb-account-create-update" Mar 16 17:04:04 crc kubenswrapper[5120]: I0316 17:04:04.719691 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="df308c5a-dfce-4996-b129-fcc1f36e1743" containerName="mariadb-database-create" Mar 16 17:04:04 crc kubenswrapper[5120]: I0316 17:04:04.719714 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="abe5ce91-c17a-44b5-8153-a8ffe8d440e9" containerName="mariadb-database-create" Mar 16 17:04:04 crc kubenswrapper[5120]: I0316 17:04:04.719726 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="83183a55-1c89-4496-b455-9c7e28bee8e3" containerName="mariadb-account-create-update" Mar 16 17:04:04 crc kubenswrapper[5120]: I0316 17:04:04.719736 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="79a9c531-41a9-4754-91ee-697e1c3bdb44" containerName="mariadb-account-create-update" Mar 16 17:04:04 crc kubenswrapper[5120]: I0316 17:04:04.723694 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-swmpp" Mar 16 17:04:04 crc kubenswrapper[5120]: I0316 17:04:04.725773 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"openstack-mariadb-root-db-secret\"" Mar 16 17:04:04 crc kubenswrapper[5120]: I0316 17:04:04.740020 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-swmpp"] Mar 16 17:04:04 crc kubenswrapper[5120]: I0316 17:04:04.816358 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/30d97b5c-f2b9-48c4-883b-778ed47cd193-operator-scripts\") pod \"root-account-create-update-swmpp\" (UID: \"30d97b5c-f2b9-48c4-883b-778ed47cd193\") " pod="openstack-kuttl-tests/root-account-create-update-swmpp" Mar 16 17:04:04 crc kubenswrapper[5120]: I0316 17:04:04.816568 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zmzs\" (UniqueName: \"kubernetes.io/projected/30d97b5c-f2b9-48c4-883b-778ed47cd193-kube-api-access-9zmzs\") pod \"root-account-create-update-swmpp\" (UID: \"30d97b5c-f2b9-48c4-883b-778ed47cd193\") " pod="openstack-kuttl-tests/root-account-create-update-swmpp" Mar 16 17:04:04 crc kubenswrapper[5120]: I0316 17:04:04.918796 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/30d97b5c-f2b9-48c4-883b-778ed47cd193-operator-scripts\") pod \"root-account-create-update-swmpp\" (UID: \"30d97b5c-f2b9-48c4-883b-778ed47cd193\") " pod="openstack-kuttl-tests/root-account-create-update-swmpp" Mar 16 17:04:04 crc kubenswrapper[5120]: I0316 17:04:04.919042 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9zmzs\" (UniqueName: \"kubernetes.io/projected/30d97b5c-f2b9-48c4-883b-778ed47cd193-kube-api-access-9zmzs\") pod \"root-account-create-update-swmpp\" (UID: \"30d97b5c-f2b9-48c4-883b-778ed47cd193\") " pod="openstack-kuttl-tests/root-account-create-update-swmpp" Mar 16 17:04:04 crc kubenswrapper[5120]: I0316 17:04:04.919659 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/30d97b5c-f2b9-48c4-883b-778ed47cd193-operator-scripts\") pod \"root-account-create-update-swmpp\" (UID: \"30d97b5c-f2b9-48c4-883b-778ed47cd193\") " pod="openstack-kuttl-tests/root-account-create-update-swmpp" Mar 16 17:04:04 crc kubenswrapper[5120]: I0316 17:04:04.926359 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-db-create-spg6n"] Mar 16 17:04:04 crc kubenswrapper[5120]: I0316 17:04:04.932640 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-create-spg6n" Mar 16 17:04:04 crc kubenswrapper[5120]: I0316 17:04:04.935122 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-db-create-spg6n"] Mar 16 17:04:04 crc kubenswrapper[5120]: I0316 17:04:04.954128 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zmzs\" (UniqueName: \"kubernetes.io/projected/30d97b5c-f2b9-48c4-883b-778ed47cd193-kube-api-access-9zmzs\") pod \"root-account-create-update-swmpp\" (UID: \"30d97b5c-f2b9-48c4-883b-778ed47cd193\") " pod="openstack-kuttl-tests/root-account-create-update-swmpp" Mar 16 17:04:05 crc kubenswrapper[5120]: I0316 17:04:05.024531 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96dp6\" (UniqueName: \"kubernetes.io/projected/2e1e9b50-de11-457e-a169-242ab16075b2-kube-api-access-96dp6\") pod \"glance-db-create-spg6n\" (UID: \"2e1e9b50-de11-457e-a169-242ab16075b2\") " pod="openstack-kuttl-tests/glance-db-create-spg6n" Mar 16 17:04:05 crc kubenswrapper[5120]: I0316 17:04:05.024893 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2e1e9b50-de11-457e-a169-242ab16075b2-operator-scripts\") pod \"glance-db-create-spg6n\" (UID: \"2e1e9b50-de11-457e-a169-242ab16075b2\") " pod="openstack-kuttl-tests/glance-db-create-spg6n" Mar 16 17:04:05 crc kubenswrapper[5120]: I0316 17:04:05.040140 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-swmpp" Mar 16 17:04:05 crc kubenswrapper[5120]: I0316 17:04:05.052616 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-34b5-account-create-update-qb955"] Mar 16 17:04:05 crc kubenswrapper[5120]: I0316 17:04:05.061264 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-34b5-account-create-update-qb955" Mar 16 17:04:05 crc kubenswrapper[5120]: I0316 17:04:05.063422 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-db-secret\"" Mar 16 17:04:05 crc kubenswrapper[5120]: I0316 17:04:05.065906 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-34b5-account-create-update-qb955"] Mar 16 17:04:05 crc kubenswrapper[5120]: I0316 17:04:05.126938 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5gkx\" (UniqueName: \"kubernetes.io/projected/49651491-1f99-4112-8643-230b978a064d-kube-api-access-r5gkx\") pod \"glance-34b5-account-create-update-qb955\" (UID: \"49651491-1f99-4112-8643-230b978a064d\") " pod="openstack-kuttl-tests/glance-34b5-account-create-update-qb955" Mar 16 17:04:05 crc kubenswrapper[5120]: I0316 17:04:05.127511 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-96dp6\" (UniqueName: \"kubernetes.io/projected/2e1e9b50-de11-457e-a169-242ab16075b2-kube-api-access-96dp6\") pod \"glance-db-create-spg6n\" (UID: \"2e1e9b50-de11-457e-a169-242ab16075b2\") " pod="openstack-kuttl-tests/glance-db-create-spg6n" Mar 16 17:04:05 crc kubenswrapper[5120]: I0316 17:04:05.127547 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/49651491-1f99-4112-8643-230b978a064d-operator-scripts\") pod \"glance-34b5-account-create-update-qb955\" (UID: \"49651491-1f99-4112-8643-230b978a064d\") " pod="openstack-kuttl-tests/glance-34b5-account-create-update-qb955" Mar 16 17:04:05 crc kubenswrapper[5120]: I0316 17:04:05.127672 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2e1e9b50-de11-457e-a169-242ab16075b2-operator-scripts\") pod \"glance-db-create-spg6n\" (UID: \"2e1e9b50-de11-457e-a169-242ab16075b2\") " pod="openstack-kuttl-tests/glance-db-create-spg6n" Mar 16 17:04:05 crc kubenswrapper[5120]: I0316 17:04:05.128541 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2e1e9b50-de11-457e-a169-242ab16075b2-operator-scripts\") pod \"glance-db-create-spg6n\" (UID: \"2e1e9b50-de11-457e-a169-242ab16075b2\") " pod="openstack-kuttl-tests/glance-db-create-spg6n" Mar 16 17:04:05 crc kubenswrapper[5120]: I0316 17:04:05.151040 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-96dp6\" (UniqueName: \"kubernetes.io/projected/2e1e9b50-de11-457e-a169-242ab16075b2-kube-api-access-96dp6\") pod \"glance-db-create-spg6n\" (UID: \"2e1e9b50-de11-457e-a169-242ab16075b2\") " pod="openstack-kuttl-tests/glance-db-create-spg6n" Mar 16 17:04:05 crc kubenswrapper[5120]: I0316 17:04:05.230603 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r5gkx\" (UniqueName: \"kubernetes.io/projected/49651491-1f99-4112-8643-230b978a064d-kube-api-access-r5gkx\") pod \"glance-34b5-account-create-update-qb955\" (UID: \"49651491-1f99-4112-8643-230b978a064d\") " pod="openstack-kuttl-tests/glance-34b5-account-create-update-qb955" Mar 16 17:04:05 crc kubenswrapper[5120]: I0316 17:04:05.230837 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/49651491-1f99-4112-8643-230b978a064d-operator-scripts\") pod \"glance-34b5-account-create-update-qb955\" (UID: \"49651491-1f99-4112-8643-230b978a064d\") " pod="openstack-kuttl-tests/glance-34b5-account-create-update-qb955" Mar 16 17:04:05 crc kubenswrapper[5120]: I0316 17:04:05.231905 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/49651491-1f99-4112-8643-230b978a064d-operator-scripts\") pod \"glance-34b5-account-create-update-qb955\" (UID: \"49651491-1f99-4112-8643-230b978a064d\") " pod="openstack-kuttl-tests/glance-34b5-account-create-update-qb955" Mar 16 17:04:05 crc kubenswrapper[5120]: I0316 17:04:05.256589 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5gkx\" (UniqueName: \"kubernetes.io/projected/49651491-1f99-4112-8643-230b978a064d-kube-api-access-r5gkx\") pod \"glance-34b5-account-create-update-qb955\" (UID: \"49651491-1f99-4112-8643-230b978a064d\") " pod="openstack-kuttl-tests/glance-34b5-account-create-update-qb955" Mar 16 17:04:05 crc kubenswrapper[5120]: I0316 17:04:05.294822 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-create-spg6n" Mar 16 17:04:05 crc kubenswrapper[5120]: I0316 17:04:05.482222 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561344-8gb27" Mar 16 17:04:05 crc kubenswrapper[5120]: I0316 17:04:05.500157 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-34b5-account-create-update-qb955" Mar 16 17:04:05 crc kubenswrapper[5120]: I0316 17:04:05.539935 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2b25n\" (UniqueName: \"kubernetes.io/projected/b42179bd-7723-4c0f-b65b-b61d9cc5aab1-kube-api-access-2b25n\") pod \"b42179bd-7723-4c0f-b65b-b61d9cc5aab1\" (UID: \"b42179bd-7723-4c0f-b65b-b61d9cc5aab1\") " Mar 16 17:04:05 crc kubenswrapper[5120]: I0316 17:04:05.547912 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b42179bd-7723-4c0f-b65b-b61d9cc5aab1-kube-api-access-2b25n" (OuterVolumeSpecName: "kube-api-access-2b25n") pod "b42179bd-7723-4c0f-b65b-b61d9cc5aab1" (UID: "b42179bd-7723-4c0f-b65b-b61d9cc5aab1"). InnerVolumeSpecName "kube-api-access-2b25n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:04:05 crc kubenswrapper[5120]: I0316 17:04:05.617809 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-swmpp"] Mar 16 17:04:05 crc kubenswrapper[5120]: I0316 17:04:05.646965 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2b25n\" (UniqueName: \"kubernetes.io/projected/b42179bd-7723-4c0f-b65b-b61d9cc5aab1-kube-api-access-2b25n\") on node \"crc\" DevicePath \"\"" Mar 16 17:04:05 crc kubenswrapper[5120]: I0316 17:04:05.758439 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-db-create-spg6n"] Mar 16 17:04:05 crc kubenswrapper[5120]: W0316 17:04:05.763676 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2e1e9b50_de11_457e_a169_242ab16075b2.slice/crio-4dc6360aad74d18f6ce4eae9f35334214177875aad6ab495950da8cd209098e7 WatchSource:0}: Error finding container 4dc6360aad74d18f6ce4eae9f35334214177875aad6ab495950da8cd209098e7: Status 404 returned error can't find the container with id 4dc6360aad74d18f6ce4eae9f35334214177875aad6ab495950da8cd209098e7 Mar 16 17:04:05 crc kubenswrapper[5120]: I0316 17:04:05.959232 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-34b5-account-create-update-qb955"] Mar 16 17:04:06 crc kubenswrapper[5120]: I0316 17:04:06.087304 5120 generic.go:358] "Generic (PLEG): container finished" podID="30d97b5c-f2b9-48c4-883b-778ed47cd193" containerID="d8992622777e359a36bbb915f35144a1b6c0e1414ce53bc4cb034c1aed040645" exitCode=0 Mar 16 17:04:06 crc kubenswrapper[5120]: I0316 17:04:06.087719 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-swmpp" event={"ID":"30d97b5c-f2b9-48c4-883b-778ed47cd193","Type":"ContainerDied","Data":"d8992622777e359a36bbb915f35144a1b6c0e1414ce53bc4cb034c1aed040645"} Mar 16 17:04:06 crc kubenswrapper[5120]: I0316 17:04:06.087751 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-swmpp" event={"ID":"30d97b5c-f2b9-48c4-883b-778ed47cd193","Type":"ContainerStarted","Data":"8aecdd76cfe11d575cbc726804e8ea7d9a86b295b42c4ded4f2de293dcbe360d"} Mar 16 17:04:06 crc kubenswrapper[5120]: I0316 17:04:06.090891 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561344-8gb27" Mar 16 17:04:06 crc kubenswrapper[5120]: I0316 17:04:06.090976 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561344-8gb27" event={"ID":"b42179bd-7723-4c0f-b65b-b61d9cc5aab1","Type":"ContainerDied","Data":"62facf2d986f9097af0def4acec0e08306b47ebdcdee9b03d122eb7d07093d5a"} Mar 16 17:04:06 crc kubenswrapper[5120]: I0316 17:04:06.091000 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="62facf2d986f9097af0def4acec0e08306b47ebdcdee9b03d122eb7d07093d5a" Mar 16 17:04:06 crc kubenswrapper[5120]: I0316 17:04:06.093177 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-create-spg6n" event={"ID":"2e1e9b50-de11-457e-a169-242ab16075b2","Type":"ContainerStarted","Data":"2c2eebc8ed470bd67c51676be329387e1edf365b6cc130aa3ae3e37e7168f002"} Mar 16 17:04:06 crc kubenswrapper[5120]: I0316 17:04:06.093213 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-create-spg6n" event={"ID":"2e1e9b50-de11-457e-a169-242ab16075b2","Type":"ContainerStarted","Data":"4dc6360aad74d18f6ce4eae9f35334214177875aad6ab495950da8cd209098e7"} Mar 16 17:04:06 crc kubenswrapper[5120]: I0316 17:04:06.094658 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-34b5-account-create-update-qb955" event={"ID":"49651491-1f99-4112-8643-230b978a064d","Type":"ContainerStarted","Data":"36e958c5ec413949d9c4fdedb555bb9b1aca15bae6acbecbde22651483910e26"} Mar 16 17:04:06 crc kubenswrapper[5120]: I0316 17:04:06.123730 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-db-create-spg6n" podStartSLOduration=2.123710799 podStartE2EDuration="2.123710799s" podCreationTimestamp="2026-03-16 17:04:04 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:04:06.121787825 +0000 UTC m=+5548.275719482" watchObservedRunningTime="2026-03-16 17:04:06.123710799 +0000 UTC m=+5548.277642456" Mar 16 17:04:06 crc kubenswrapper[5120]: I0316 17:04:06.144075 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-infra/auto-csr-approver-29561338-cpxpc"] Mar 16 17:04:06 crc kubenswrapper[5120]: I0316 17:04:06.150052 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-infra/auto-csr-approver-29561338-cpxpc"] Mar 16 17:04:07 crc kubenswrapper[5120]: I0316 17:04:07.188184 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3bcb4bc8-ad9d-40a6-a44b-2f174a1993cd" path="/var/lib/kubelet/pods/3bcb4bc8-ad9d-40a6-a44b-2f174a1993cd/volumes" Mar 16 17:04:07 crc kubenswrapper[5120]: I0316 17:04:07.215216 5120 generic.go:358] "Generic (PLEG): container finished" podID="2e1e9b50-de11-457e-a169-242ab16075b2" containerID="2c2eebc8ed470bd67c51676be329387e1edf365b6cc130aa3ae3e37e7168f002" exitCode=0 Mar 16 17:04:07 crc kubenswrapper[5120]: I0316 17:04:07.215461 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-create-spg6n" event={"ID":"2e1e9b50-de11-457e-a169-242ab16075b2","Type":"ContainerDied","Data":"2c2eebc8ed470bd67c51676be329387e1edf365b6cc130aa3ae3e37e7168f002"} Mar 16 17:04:07 crc kubenswrapper[5120]: I0316 17:04:07.606514 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-swmpp" Mar 16 17:04:07 crc kubenswrapper[5120]: I0316 17:04:07.676795 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9zmzs\" (UniqueName: \"kubernetes.io/projected/30d97b5c-f2b9-48c4-883b-778ed47cd193-kube-api-access-9zmzs\") pod \"30d97b5c-f2b9-48c4-883b-778ed47cd193\" (UID: \"30d97b5c-f2b9-48c4-883b-778ed47cd193\") " Mar 16 17:04:07 crc kubenswrapper[5120]: I0316 17:04:07.677222 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/30d97b5c-f2b9-48c4-883b-778ed47cd193-operator-scripts\") pod \"30d97b5c-f2b9-48c4-883b-778ed47cd193\" (UID: \"30d97b5c-f2b9-48c4-883b-778ed47cd193\") " Mar 16 17:04:07 crc kubenswrapper[5120]: I0316 17:04:07.678699 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/30d97b5c-f2b9-48c4-883b-778ed47cd193-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "30d97b5c-f2b9-48c4-883b-778ed47cd193" (UID: "30d97b5c-f2b9-48c4-883b-778ed47cd193"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:04:07 crc kubenswrapper[5120]: I0316 17:04:07.684932 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30d97b5c-f2b9-48c4-883b-778ed47cd193-kube-api-access-9zmzs" (OuterVolumeSpecName: "kube-api-access-9zmzs") pod "30d97b5c-f2b9-48c4-883b-778ed47cd193" (UID: "30d97b5c-f2b9-48c4-883b-778ed47cd193"). InnerVolumeSpecName "kube-api-access-9zmzs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:04:07 crc kubenswrapper[5120]: I0316 17:04:07.780748 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9zmzs\" (UniqueName: \"kubernetes.io/projected/30d97b5c-f2b9-48c4-883b-778ed47cd193-kube-api-access-9zmzs\") on node \"crc\" DevicePath \"\"" Mar 16 17:04:07 crc kubenswrapper[5120]: I0316 17:04:07.781348 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/30d97b5c-f2b9-48c4-883b-778ed47cd193-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:04:07 crc kubenswrapper[5120]: I0316 17:04:07.883501 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/1a6911b8-1804-40ce-88c2-3da863703774-etc-swift\") pod \"swift-storage-0\" (UID: \"1a6911b8-1804-40ce-88c2-3da863703774\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 17:04:07 crc kubenswrapper[5120]: E0316 17:04:07.883813 5120 projected.go:289] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Mar 16 17:04:07 crc kubenswrapper[5120]: E0316 17:04:07.883832 5120 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Mar 16 17:04:07 crc kubenswrapper[5120]: E0316 17:04:07.883882 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1a6911b8-1804-40ce-88c2-3da863703774-etc-swift podName:1a6911b8-1804-40ce-88c2-3da863703774 nodeName:}" failed. No retries permitted until 2026-03-16 17:04:15.883867263 +0000 UTC m=+5558.037798920 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/1a6911b8-1804-40ce-88c2-3da863703774-etc-swift") pod "swift-storage-0" (UID: "1a6911b8-1804-40ce-88c2-3da863703774") : configmap "swift-ring-files" not found Mar 16 17:04:08 crc kubenswrapper[5120]: I0316 17:04:08.230686 5120 generic.go:358] "Generic (PLEG): container finished" podID="49651491-1f99-4112-8643-230b978a064d" containerID="49ea0ac86a7b1dbc77c7c9a8507bd7eeae570e9fbbc82c79faa69b496986fa40" exitCode=0 Mar 16 17:04:08 crc kubenswrapper[5120]: I0316 17:04:08.231707 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-34b5-account-create-update-qb955" event={"ID":"49651491-1f99-4112-8643-230b978a064d","Type":"ContainerDied","Data":"49ea0ac86a7b1dbc77c7c9a8507bd7eeae570e9fbbc82c79faa69b496986fa40"} Mar 16 17:04:08 crc kubenswrapper[5120]: I0316 17:04:08.232714 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-swmpp" Mar 16 17:04:08 crc kubenswrapper[5120]: I0316 17:04:08.232736 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-swmpp" event={"ID":"30d97b5c-f2b9-48c4-883b-778ed47cd193","Type":"ContainerDied","Data":"8aecdd76cfe11d575cbc726804e8ea7d9a86b295b42c4ded4f2de293dcbe360d"} Mar 16 17:04:08 crc kubenswrapper[5120]: I0316 17:04:08.232942 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8aecdd76cfe11d575cbc726804e8ea7d9a86b295b42c4ded4f2de293dcbe360d" Mar 16 17:04:08 crc kubenswrapper[5120]: I0316 17:04:08.640821 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-create-spg6n" Mar 16 17:04:08 crc kubenswrapper[5120]: I0316 17:04:08.699733 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2e1e9b50-de11-457e-a169-242ab16075b2-operator-scripts\") pod \"2e1e9b50-de11-457e-a169-242ab16075b2\" (UID: \"2e1e9b50-de11-457e-a169-242ab16075b2\") " Mar 16 17:04:08 crc kubenswrapper[5120]: I0316 17:04:08.700285 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-96dp6\" (UniqueName: \"kubernetes.io/projected/2e1e9b50-de11-457e-a169-242ab16075b2-kube-api-access-96dp6\") pod \"2e1e9b50-de11-457e-a169-242ab16075b2\" (UID: \"2e1e9b50-de11-457e-a169-242ab16075b2\") " Mar 16 17:04:08 crc kubenswrapper[5120]: I0316 17:04:08.700278 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e1e9b50-de11-457e-a169-242ab16075b2-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "2e1e9b50-de11-457e-a169-242ab16075b2" (UID: "2e1e9b50-de11-457e-a169-242ab16075b2"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:04:08 crc kubenswrapper[5120]: I0316 17:04:08.701297 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2e1e9b50-de11-457e-a169-242ab16075b2-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:04:08 crc kubenswrapper[5120]: I0316 17:04:08.708944 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e1e9b50-de11-457e-a169-242ab16075b2-kube-api-access-96dp6" (OuterVolumeSpecName: "kube-api-access-96dp6") pod "2e1e9b50-de11-457e-a169-242ab16075b2" (UID: "2e1e9b50-de11-457e-a169-242ab16075b2"). InnerVolumeSpecName "kube-api-access-96dp6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:04:08 crc kubenswrapper[5120]: I0316 17:04:08.803479 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-96dp6\" (UniqueName: \"kubernetes.io/projected/2e1e9b50-de11-457e-a169-242ab16075b2-kube-api-access-96dp6\") on node \"crc\" DevicePath \"\"" Mar 16 17:04:09 crc kubenswrapper[5120]: I0316 17:04:09.243054 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-create-spg6n" Mar 16 17:04:09 crc kubenswrapper[5120]: I0316 17:04:09.243856 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-create-spg6n" event={"ID":"2e1e9b50-de11-457e-a169-242ab16075b2","Type":"ContainerDied","Data":"4dc6360aad74d18f6ce4eae9f35334214177875aad6ab495950da8cd209098e7"} Mar 16 17:04:09 crc kubenswrapper[5120]: I0316 17:04:09.251383 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4dc6360aad74d18f6ce4eae9f35334214177875aad6ab495950da8cd209098e7" Mar 16 17:04:09 crc kubenswrapper[5120]: I0316 17:04:09.712380 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-34b5-account-create-update-qb955" Mar 16 17:04:09 crc kubenswrapper[5120]: I0316 17:04:09.828875 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/49651491-1f99-4112-8643-230b978a064d-operator-scripts\") pod \"49651491-1f99-4112-8643-230b978a064d\" (UID: \"49651491-1f99-4112-8643-230b978a064d\") " Mar 16 17:04:09 crc kubenswrapper[5120]: I0316 17:04:09.828953 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r5gkx\" (UniqueName: \"kubernetes.io/projected/49651491-1f99-4112-8643-230b978a064d-kube-api-access-r5gkx\") pod \"49651491-1f99-4112-8643-230b978a064d\" (UID: \"49651491-1f99-4112-8643-230b978a064d\") " Mar 16 17:04:09 crc kubenswrapper[5120]: I0316 17:04:09.829890 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/49651491-1f99-4112-8643-230b978a064d-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "49651491-1f99-4112-8643-230b978a064d" (UID: "49651491-1f99-4112-8643-230b978a064d"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:04:09 crc kubenswrapper[5120]: I0316 17:04:09.841873 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49651491-1f99-4112-8643-230b978a064d-kube-api-access-r5gkx" (OuterVolumeSpecName: "kube-api-access-r5gkx") pod "49651491-1f99-4112-8643-230b978a064d" (UID: "49651491-1f99-4112-8643-230b978a064d"). InnerVolumeSpecName "kube-api-access-r5gkx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:04:09 crc kubenswrapper[5120]: E0316 17:04:09.856940 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1492561 actualBytes=10240 Mar 16 17:04:09 crc kubenswrapper[5120]: I0316 17:04:09.932086 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/49651491-1f99-4112-8643-230b978a064d-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:04:09 crc kubenswrapper[5120]: I0316 17:04:09.932411 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r5gkx\" (UniqueName: \"kubernetes.io/projected/49651491-1f99-4112-8643-230b978a064d-kube-api-access-r5gkx\") on node \"crc\" DevicePath \"\"" Mar 16 17:04:10 crc kubenswrapper[5120]: I0316 17:04:10.255296 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-34b5-account-create-update-qb955" Mar 16 17:04:10 crc kubenswrapper[5120]: I0316 17:04:10.255333 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-34b5-account-create-update-qb955" event={"ID":"49651491-1f99-4112-8643-230b978a064d","Type":"ContainerDied","Data":"36e958c5ec413949d9c4fdedb555bb9b1aca15bae6acbecbde22651483910e26"} Mar 16 17:04:10 crc kubenswrapper[5120]: I0316 17:04:10.255382 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="36e958c5ec413949d9c4fdedb555bb9b1aca15bae6acbecbde22651483910e26" Mar 16 17:04:10 crc kubenswrapper[5120]: I0316 17:04:10.258105 5120 generic.go:358] "Generic (PLEG): container finished" podID="4acc93da-5600-4c0b-890d-8e2411d387bf" containerID="b94db45a50541559bdedc3c8aa62f31b1d4a3f0a3bfdb5aa16e8b980a8e658a1" exitCode=0 Mar 16 17:04:10 crc kubenswrapper[5120]: I0316 17:04:10.258144 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-dhrvt" event={"ID":"4acc93da-5600-4c0b-890d-8e2411d387bf","Type":"ContainerDied","Data":"b94db45a50541559bdedc3c8aa62f31b1d4a3f0a3bfdb5aa16e8b980a8e658a1"} Mar 16 17:04:11 crc kubenswrapper[5120]: I0316 17:04:11.073718 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-swmpp"] Mar 16 17:04:11 crc kubenswrapper[5120]: I0316 17:04:11.079410 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-swmpp"] Mar 16 17:04:11 crc kubenswrapper[5120]: I0316 17:04:11.640240 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-dhrvt" Mar 16 17:04:11 crc kubenswrapper[5120]: I0316 17:04:11.773242 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/4acc93da-5600-4c0b-890d-8e2411d387bf-etc-swift\") pod \"4acc93da-5600-4c0b-890d-8e2411d387bf\" (UID: \"4acc93da-5600-4c0b-890d-8e2411d387bf\") " Mar 16 17:04:11 crc kubenswrapper[5120]: I0316 17:04:11.773542 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/4acc93da-5600-4c0b-890d-8e2411d387bf-swiftconf\") pod \"4acc93da-5600-4c0b-890d-8e2411d387bf\" (UID: \"4acc93da-5600-4c0b-890d-8e2411d387bf\") " Mar 16 17:04:11 crc kubenswrapper[5120]: I0316 17:04:11.773629 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c8k94\" (UniqueName: \"kubernetes.io/projected/4acc93da-5600-4c0b-890d-8e2411d387bf-kube-api-access-c8k94\") pod \"4acc93da-5600-4c0b-890d-8e2411d387bf\" (UID: \"4acc93da-5600-4c0b-890d-8e2411d387bf\") " Mar 16 17:04:11 crc kubenswrapper[5120]: I0316 17:04:11.773725 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/4acc93da-5600-4c0b-890d-8e2411d387bf-ring-data-devices\") pod \"4acc93da-5600-4c0b-890d-8e2411d387bf\" (UID: \"4acc93da-5600-4c0b-890d-8e2411d387bf\") " Mar 16 17:04:11 crc kubenswrapper[5120]: I0316 17:04:11.773840 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/4acc93da-5600-4c0b-890d-8e2411d387bf-dispersionconf\") pod \"4acc93da-5600-4c0b-890d-8e2411d387bf\" (UID: \"4acc93da-5600-4c0b-890d-8e2411d387bf\") " Mar 16 17:04:11 crc kubenswrapper[5120]: I0316 17:04:11.773997 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4acc93da-5600-4c0b-890d-8e2411d387bf-combined-ca-bundle\") pod \"4acc93da-5600-4c0b-890d-8e2411d387bf\" (UID: \"4acc93da-5600-4c0b-890d-8e2411d387bf\") " Mar 16 17:04:11 crc kubenswrapper[5120]: I0316 17:04:11.774051 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/4acc93da-5600-4c0b-890d-8e2411d387bf-scripts\") pod \"4acc93da-5600-4c0b-890d-8e2411d387bf\" (UID: \"4acc93da-5600-4c0b-890d-8e2411d387bf\") " Mar 16 17:04:11 crc kubenswrapper[5120]: I0316 17:04:11.774205 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4acc93da-5600-4c0b-890d-8e2411d387bf-ring-data-devices" (OuterVolumeSpecName: "ring-data-devices") pod "4acc93da-5600-4c0b-890d-8e2411d387bf" (UID: "4acc93da-5600-4c0b-890d-8e2411d387bf"). InnerVolumeSpecName "ring-data-devices". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:04:11 crc kubenswrapper[5120]: I0316 17:04:11.774381 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4acc93da-5600-4c0b-890d-8e2411d387bf-etc-swift" (OuterVolumeSpecName: "etc-swift") pod "4acc93da-5600-4c0b-890d-8e2411d387bf" (UID: "4acc93da-5600-4c0b-890d-8e2411d387bf"). InnerVolumeSpecName "etc-swift". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:04:11 crc kubenswrapper[5120]: I0316 17:04:11.775044 5120 reconciler_common.go:299] "Volume detached for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/4acc93da-5600-4c0b-890d-8e2411d387bf-etc-swift\") on node \"crc\" DevicePath \"\"" Mar 16 17:04:11 crc kubenswrapper[5120]: I0316 17:04:11.775072 5120 reconciler_common.go:299] "Volume detached for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/4acc93da-5600-4c0b-890d-8e2411d387bf-ring-data-devices\") on node \"crc\" DevicePath \"\"" Mar 16 17:04:11 crc kubenswrapper[5120]: I0316 17:04:11.778449 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4acc93da-5600-4c0b-890d-8e2411d387bf-kube-api-access-c8k94" (OuterVolumeSpecName: "kube-api-access-c8k94") pod "4acc93da-5600-4c0b-890d-8e2411d387bf" (UID: "4acc93da-5600-4c0b-890d-8e2411d387bf"). InnerVolumeSpecName "kube-api-access-c8k94". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:04:11 crc kubenswrapper[5120]: I0316 17:04:11.781502 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4acc93da-5600-4c0b-890d-8e2411d387bf-dispersionconf" (OuterVolumeSpecName: "dispersionconf") pod "4acc93da-5600-4c0b-890d-8e2411d387bf" (UID: "4acc93da-5600-4c0b-890d-8e2411d387bf"). InnerVolumeSpecName "dispersionconf". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:04:11 crc kubenswrapper[5120]: I0316 17:04:11.794648 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4acc93da-5600-4c0b-890d-8e2411d387bf-scripts" (OuterVolumeSpecName: "scripts") pod "4acc93da-5600-4c0b-890d-8e2411d387bf" (UID: "4acc93da-5600-4c0b-890d-8e2411d387bf"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:04:11 crc kubenswrapper[5120]: I0316 17:04:11.802563 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4acc93da-5600-4c0b-890d-8e2411d387bf-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "4acc93da-5600-4c0b-890d-8e2411d387bf" (UID: "4acc93da-5600-4c0b-890d-8e2411d387bf"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:04:11 crc kubenswrapper[5120]: I0316 17:04:11.803514 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4acc93da-5600-4c0b-890d-8e2411d387bf-swiftconf" (OuterVolumeSpecName: "swiftconf") pod "4acc93da-5600-4c0b-890d-8e2411d387bf" (UID: "4acc93da-5600-4c0b-890d-8e2411d387bf"). InnerVolumeSpecName "swiftconf". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:04:11 crc kubenswrapper[5120]: I0316 17:04:11.877539 5120 reconciler_common.go:299] "Volume detached for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/4acc93da-5600-4c0b-890d-8e2411d387bf-swiftconf\") on node \"crc\" DevicePath \"\"" Mar 16 17:04:11 crc kubenswrapper[5120]: I0316 17:04:11.877584 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c8k94\" (UniqueName: \"kubernetes.io/projected/4acc93da-5600-4c0b-890d-8e2411d387bf-kube-api-access-c8k94\") on node \"crc\" DevicePath \"\"" Mar 16 17:04:11 crc kubenswrapper[5120]: I0316 17:04:11.877619 5120 reconciler_common.go:299] "Volume detached for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/4acc93da-5600-4c0b-890d-8e2411d387bf-dispersionconf\") on node \"crc\" DevicePath \"\"" Mar 16 17:04:11 crc kubenswrapper[5120]: I0316 17:04:11.877631 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4acc93da-5600-4c0b-890d-8e2411d387bf-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:04:11 crc kubenswrapper[5120]: I0316 17:04:11.877642 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/4acc93da-5600-4c0b-890d-8e2411d387bf-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:04:12 crc kubenswrapper[5120]: I0316 17:04:12.295974 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-dhrvt" event={"ID":"4acc93da-5600-4c0b-890d-8e2411d387bf","Type":"ContainerDied","Data":"6f45d0a40712529afed104b53d7fc6f237c6223b03d5978f883b16888e84329e"} Mar 16 17:04:12 crc kubenswrapper[5120]: I0316 17:04:12.296360 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6f45d0a40712529afed104b53d7fc6f237c6223b03d5978f883b16888e84329e" Mar 16 17:04:12 crc kubenswrapper[5120]: I0316 17:04:12.296007 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-dhrvt" Mar 16 17:04:12 crc kubenswrapper[5120]: I0316 17:04:12.335569 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/certified-operators-wpshd"] Mar 16 17:04:12 crc kubenswrapper[5120]: I0316 17:04:12.336913 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4acc93da-5600-4c0b-890d-8e2411d387bf" containerName="swift-ring-rebalance" Mar 16 17:04:12 crc kubenswrapper[5120]: I0316 17:04:12.336943 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="4acc93da-5600-4c0b-890d-8e2411d387bf" containerName="swift-ring-rebalance" Mar 16 17:04:12 crc kubenswrapper[5120]: I0316 17:04:12.336980 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b42179bd-7723-4c0f-b65b-b61d9cc5aab1" containerName="oc" Mar 16 17:04:12 crc kubenswrapper[5120]: I0316 17:04:12.336991 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="b42179bd-7723-4c0f-b65b-b61d9cc5aab1" containerName="oc" Mar 16 17:04:12 crc kubenswrapper[5120]: I0316 17:04:12.337019 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e1e9b50-de11-457e-a169-242ab16075b2" containerName="mariadb-database-create" Mar 16 17:04:12 crc kubenswrapper[5120]: I0316 17:04:12.337028 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e1e9b50-de11-457e-a169-242ab16075b2" containerName="mariadb-database-create" Mar 16 17:04:12 crc kubenswrapper[5120]: I0316 17:04:12.337045 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30d97b5c-f2b9-48c4-883b-778ed47cd193" containerName="mariadb-account-create-update" Mar 16 17:04:12 crc kubenswrapper[5120]: I0316 17:04:12.337056 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="30d97b5c-f2b9-48c4-883b-778ed47cd193" containerName="mariadb-account-create-update" Mar 16 17:04:12 crc kubenswrapper[5120]: I0316 17:04:12.337094 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49651491-1f99-4112-8643-230b978a064d" containerName="mariadb-account-create-update" Mar 16 17:04:12 crc kubenswrapper[5120]: I0316 17:04:12.337101 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="49651491-1f99-4112-8643-230b978a064d" containerName="mariadb-account-create-update" Mar 16 17:04:12 crc kubenswrapper[5120]: I0316 17:04:12.337289 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="49651491-1f99-4112-8643-230b978a064d" containerName="mariadb-account-create-update" Mar 16 17:04:12 crc kubenswrapper[5120]: I0316 17:04:12.337309 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="30d97b5c-f2b9-48c4-883b-778ed47cd193" containerName="mariadb-account-create-update" Mar 16 17:04:12 crc kubenswrapper[5120]: I0316 17:04:12.337326 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="2e1e9b50-de11-457e-a169-242ab16075b2" containerName="mariadb-database-create" Mar 16 17:04:12 crc kubenswrapper[5120]: I0316 17:04:12.337339 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="4acc93da-5600-4c0b-890d-8e2411d387bf" containerName="swift-ring-rebalance" Mar 16 17:04:12 crc kubenswrapper[5120]: I0316 17:04:12.337354 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="b42179bd-7723-4c0f-b65b-b61d9cc5aab1" containerName="oc" Mar 16 17:04:12 crc kubenswrapper[5120]: I0316 17:04:12.347203 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/certified-operators-wpshd"] Mar 16 17:04:12 crc kubenswrapper[5120]: I0316 17:04:12.347402 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-wpshd" Mar 16 17:04:12 crc kubenswrapper[5120]: I0316 17:04:12.495044 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/ebaf96b7-6e2e-4c6f-93e8-25abea285916-catalog-content\") pod \"certified-operators-wpshd\" (UID: \"ebaf96b7-6e2e-4c6f-93e8-25abea285916\") " pod="openshift-marketplace/certified-operators-wpshd" Mar 16 17:04:12 crc kubenswrapper[5120]: I0316 17:04:12.495196 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/ebaf96b7-6e2e-4c6f-93e8-25abea285916-utilities\") pod \"certified-operators-wpshd\" (UID: \"ebaf96b7-6e2e-4c6f-93e8-25abea285916\") " pod="openshift-marketplace/certified-operators-wpshd" Mar 16 17:04:12 crc kubenswrapper[5120]: I0316 17:04:12.495260 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lz9tl\" (UniqueName: \"kubernetes.io/projected/ebaf96b7-6e2e-4c6f-93e8-25abea285916-kube-api-access-lz9tl\") pod \"certified-operators-wpshd\" (UID: \"ebaf96b7-6e2e-4c6f-93e8-25abea285916\") " pod="openshift-marketplace/certified-operators-wpshd" Mar 16 17:04:12 crc kubenswrapper[5120]: I0316 17:04:12.597442 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/ebaf96b7-6e2e-4c6f-93e8-25abea285916-catalog-content\") pod \"certified-operators-wpshd\" (UID: \"ebaf96b7-6e2e-4c6f-93e8-25abea285916\") " pod="openshift-marketplace/certified-operators-wpshd" Mar 16 17:04:12 crc kubenswrapper[5120]: I0316 17:04:12.597572 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/ebaf96b7-6e2e-4c6f-93e8-25abea285916-utilities\") pod \"certified-operators-wpshd\" (UID: \"ebaf96b7-6e2e-4c6f-93e8-25abea285916\") " pod="openshift-marketplace/certified-operators-wpshd" Mar 16 17:04:12 crc kubenswrapper[5120]: I0316 17:04:12.597685 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lz9tl\" (UniqueName: \"kubernetes.io/projected/ebaf96b7-6e2e-4c6f-93e8-25abea285916-kube-api-access-lz9tl\") pod \"certified-operators-wpshd\" (UID: \"ebaf96b7-6e2e-4c6f-93e8-25abea285916\") " pod="openshift-marketplace/certified-operators-wpshd" Mar 16 17:04:12 crc kubenswrapper[5120]: I0316 17:04:12.597983 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/ebaf96b7-6e2e-4c6f-93e8-25abea285916-catalog-content\") pod \"certified-operators-wpshd\" (UID: \"ebaf96b7-6e2e-4c6f-93e8-25abea285916\") " pod="openshift-marketplace/certified-operators-wpshd" Mar 16 17:04:12 crc kubenswrapper[5120]: I0316 17:04:12.598074 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/ebaf96b7-6e2e-4c6f-93e8-25abea285916-utilities\") pod \"certified-operators-wpshd\" (UID: \"ebaf96b7-6e2e-4c6f-93e8-25abea285916\") " pod="openshift-marketplace/certified-operators-wpshd" Mar 16 17:04:12 crc kubenswrapper[5120]: I0316 17:04:12.625893 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lz9tl\" (UniqueName: \"kubernetes.io/projected/ebaf96b7-6e2e-4c6f-93e8-25abea285916-kube-api-access-lz9tl\") pod \"certified-operators-wpshd\" (UID: \"ebaf96b7-6e2e-4c6f-93e8-25abea285916\") " pod="openshift-marketplace/certified-operators-wpshd" Mar 16 17:04:12 crc kubenswrapper[5120]: I0316 17:04:12.667328 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-wpshd" Mar 16 17:04:12 crc kubenswrapper[5120]: I0316 17:04:12.673651 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="30d97b5c-f2b9-48c4-883b-778ed47cd193" path="/var/lib/kubelet/pods/30d97b5c-f2b9-48c4-883b-778ed47cd193/volumes" Mar 16 17:04:12 crc kubenswrapper[5120]: I0316 17:04:12.708458 5120 scope.go:117] "RemoveContainer" containerID="192dc6632db5d07e0f36b0240e4f98e1b355edf0c9ef9c79a3cde5f3a6bb487a" Mar 16 17:04:12 crc kubenswrapper[5120]: I0316 17:04:12.787003 5120 scope.go:117] "RemoveContainer" containerID="a7f6467cdcb3317973a736b263e03c8df1085bea9b0eddb39d5647f94fe9343b" Mar 16 17:04:12 crc kubenswrapper[5120]: I0316 17:04:12.810089 5120 scope.go:117] "RemoveContainer" containerID="944c2852f2412c9d950f56ca2ba9379432e3e19c19474fcade16e4aef26d008b" Mar 16 17:04:12 crc kubenswrapper[5120]: I0316 17:04:12.842972 5120 scope.go:117] "RemoveContainer" containerID="d58458049831b0118a792984131bfd9ce2aaabb224a23571e31dd75d3357c502" Mar 16 17:04:12 crc kubenswrapper[5120]: I0316 17:04:12.875350 5120 scope.go:117] "RemoveContainer" containerID="30900d147a28421fa41bcb63b053adb219f28881d1c2de138bcd335a68106800" Mar 16 17:04:12 crc kubenswrapper[5120]: I0316 17:04:12.909696 5120 scope.go:117] "RemoveContainer" containerID="536ac9829d05f55217292db62329933db52db68078e969e8e56c87357cfeee75" Mar 16 17:04:12 crc kubenswrapper[5120]: I0316 17:04:12.927567 5120 scope.go:117] "RemoveContainer" containerID="19017a08e8303b155aca1ad52e1d214868ff7c87ba86215486d7d71861c0ba4c" Mar 16 17:04:13 crc kubenswrapper[5120]: I0316 17:04:13.007453 5120 scope.go:117] "RemoveContainer" containerID="7f4b6ccac11d75b0188041fa8380457b3874c5ef963e069e90d3afcdf1d82922" Mar 16 17:04:13 crc kubenswrapper[5120]: I0316 17:04:13.123966 5120 scope.go:117] "RemoveContainer" containerID="718fc975ef6e3bdd08e304cbdb49697f544fc322b571dfe40e3f243a0642a65b" Mar 16 17:04:13 crc kubenswrapper[5120]: I0316 17:04:13.184417 5120 scope.go:117] "RemoveContainer" containerID="89e994443283c3b0c455666b21ea5448adcc79f46926d6b06e778b67c67d16fd" Mar 16 17:04:13 crc kubenswrapper[5120]: I0316 17:04:13.208716 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/certified-operators-wpshd"] Mar 16 17:04:13 crc kubenswrapper[5120]: I0316 17:04:13.221746 5120 scope.go:117] "RemoveContainer" containerID="3979f5b2c8f3e27e58c3bf66a809beac256cccdeb07924610ae962d31618914f" Mar 16 17:04:13 crc kubenswrapper[5120]: W0316 17:04:13.230659 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebaf96b7_6e2e_4c6f_93e8_25abea285916.slice/crio-51c8a8b7d871417da8cc8db3cf0248abd4a0706e8a8d7148db88425ec077440d WatchSource:0}: Error finding container 51c8a8b7d871417da8cc8db3cf0248abd4a0706e8a8d7148db88425ec077440d: Status 404 returned error can't find the container with id 51c8a8b7d871417da8cc8db3cf0248abd4a0706e8a8d7148db88425ec077440d Mar 16 17:04:13 crc kubenswrapper[5120]: I0316 17:04:13.274207 5120 scope.go:117] "RemoveContainer" containerID="6a271e5eda0bab7e1bc390ba06ddcc271ea45963e9ec7be7e8b9e1a45b064854" Mar 16 17:04:13 crc kubenswrapper[5120]: I0316 17:04:13.298599 5120 scope.go:117] "RemoveContainer" containerID="0d0a5b84c395fb30badadf14a48e15a5bf036ad2f750fcc8859c8cd2ab121bbb" Mar 16 17:04:13 crc kubenswrapper[5120]: I0316 17:04:13.324973 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-wpshd" event={"ID":"ebaf96b7-6e2e-4c6f-93e8-25abea285916","Type":"ContainerStarted","Data":"51c8a8b7d871417da8cc8db3cf0248abd4a0706e8a8d7148db88425ec077440d"} Mar 16 17:04:13 crc kubenswrapper[5120]: I0316 17:04:13.397909 5120 scope.go:117] "RemoveContainer" containerID="1b393fcb605979a7f06391fe5103518a7689554356343956c6189482a5f9e84b" Mar 16 17:04:14 crc kubenswrapper[5120]: I0316 17:04:14.122609 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:04:14 crc kubenswrapper[5120]: I0316 17:04:14.346930 5120 generic.go:358] "Generic (PLEG): container finished" podID="ebaf96b7-6e2e-4c6f-93e8-25abea285916" containerID="357ecf96a0c6bbf34082102a4be72be4a3a99fc7d085ea93e1a3892d7a0032df" exitCode=0 Mar 16 17:04:14 crc kubenswrapper[5120]: I0316 17:04:14.346978 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-wpshd" event={"ID":"ebaf96b7-6e2e-4c6f-93e8-25abea285916","Type":"ContainerDied","Data":"357ecf96a0c6bbf34082102a4be72be4a3a99fc7d085ea93e1a3892d7a0032df"} Mar 16 17:04:15 crc kubenswrapper[5120]: I0316 17:04:15.208206 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-db-sync-zzp2r"] Mar 16 17:04:15 crc kubenswrapper[5120]: I0316 17:04:15.217255 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-zzp2r" Mar 16 17:04:15 crc kubenswrapper[5120]: I0316 17:04:15.219858 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-glance-dockercfg-w6x6w\"" Mar 16 17:04:15 crc kubenswrapper[5120]: I0316 17:04:15.220688 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-config-data\"" Mar 16 17:04:15 crc kubenswrapper[5120]: I0316 17:04:15.220898 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-zzp2r"] Mar 16 17:04:15 crc kubenswrapper[5120]: I0316 17:04:15.277883 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/93dfd188-3406-4990-b8e2-423cfa2265fa-combined-ca-bundle\") pod \"glance-db-sync-zzp2r\" (UID: \"93dfd188-3406-4990-b8e2-423cfa2265fa\") " pod="openstack-kuttl-tests/glance-db-sync-zzp2r" Mar 16 17:04:15 crc kubenswrapper[5120]: I0316 17:04:15.278345 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/93dfd188-3406-4990-b8e2-423cfa2265fa-config-data\") pod \"glance-db-sync-zzp2r\" (UID: \"93dfd188-3406-4990-b8e2-423cfa2265fa\") " pod="openstack-kuttl-tests/glance-db-sync-zzp2r" Mar 16 17:04:15 crc kubenswrapper[5120]: I0316 17:04:15.278537 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7twt\" (UniqueName: \"kubernetes.io/projected/93dfd188-3406-4990-b8e2-423cfa2265fa-kube-api-access-t7twt\") pod \"glance-db-sync-zzp2r\" (UID: \"93dfd188-3406-4990-b8e2-423cfa2265fa\") " pod="openstack-kuttl-tests/glance-db-sync-zzp2r" Mar 16 17:04:15 crc kubenswrapper[5120]: I0316 17:04:15.278598 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/93dfd188-3406-4990-b8e2-423cfa2265fa-db-sync-config-data\") pod \"glance-db-sync-zzp2r\" (UID: \"93dfd188-3406-4990-b8e2-423cfa2265fa\") " pod="openstack-kuttl-tests/glance-db-sync-zzp2r" Mar 16 17:04:15 crc kubenswrapper[5120]: I0316 17:04:15.363051 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-wpshd" event={"ID":"ebaf96b7-6e2e-4c6f-93e8-25abea285916","Type":"ContainerStarted","Data":"a2250cedf14eb131da5eb3091b686f49b79ceaa18fcf6fb92efe429f3b97f5e4"} Mar 16 17:04:15 crc kubenswrapper[5120]: I0316 17:04:15.380811 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t7twt\" (UniqueName: \"kubernetes.io/projected/93dfd188-3406-4990-b8e2-423cfa2265fa-kube-api-access-t7twt\") pod \"glance-db-sync-zzp2r\" (UID: \"93dfd188-3406-4990-b8e2-423cfa2265fa\") " pod="openstack-kuttl-tests/glance-db-sync-zzp2r" Mar 16 17:04:15 crc kubenswrapper[5120]: I0316 17:04:15.380934 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/93dfd188-3406-4990-b8e2-423cfa2265fa-db-sync-config-data\") pod \"glance-db-sync-zzp2r\" (UID: \"93dfd188-3406-4990-b8e2-423cfa2265fa\") " pod="openstack-kuttl-tests/glance-db-sync-zzp2r" Mar 16 17:04:15 crc kubenswrapper[5120]: I0316 17:04:15.380993 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/93dfd188-3406-4990-b8e2-423cfa2265fa-combined-ca-bundle\") pod \"glance-db-sync-zzp2r\" (UID: \"93dfd188-3406-4990-b8e2-423cfa2265fa\") " pod="openstack-kuttl-tests/glance-db-sync-zzp2r" Mar 16 17:04:15 crc kubenswrapper[5120]: I0316 17:04:15.382678 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/93dfd188-3406-4990-b8e2-423cfa2265fa-config-data\") pod \"glance-db-sync-zzp2r\" (UID: \"93dfd188-3406-4990-b8e2-423cfa2265fa\") " pod="openstack-kuttl-tests/glance-db-sync-zzp2r" Mar 16 17:04:15 crc kubenswrapper[5120]: I0316 17:04:15.389573 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/93dfd188-3406-4990-b8e2-423cfa2265fa-combined-ca-bundle\") pod \"glance-db-sync-zzp2r\" (UID: \"93dfd188-3406-4990-b8e2-423cfa2265fa\") " pod="openstack-kuttl-tests/glance-db-sync-zzp2r" Mar 16 17:04:15 crc kubenswrapper[5120]: I0316 17:04:15.390413 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/93dfd188-3406-4990-b8e2-423cfa2265fa-config-data\") pod \"glance-db-sync-zzp2r\" (UID: \"93dfd188-3406-4990-b8e2-423cfa2265fa\") " pod="openstack-kuttl-tests/glance-db-sync-zzp2r" Mar 16 17:04:15 crc kubenswrapper[5120]: I0316 17:04:15.399072 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/93dfd188-3406-4990-b8e2-423cfa2265fa-db-sync-config-data\") pod \"glance-db-sync-zzp2r\" (UID: \"93dfd188-3406-4990-b8e2-423cfa2265fa\") " pod="openstack-kuttl-tests/glance-db-sync-zzp2r" Mar 16 17:04:15 crc kubenswrapper[5120]: I0316 17:04:15.399329 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7twt\" (UniqueName: \"kubernetes.io/projected/93dfd188-3406-4990-b8e2-423cfa2265fa-kube-api-access-t7twt\") pod \"glance-db-sync-zzp2r\" (UID: \"93dfd188-3406-4990-b8e2-423cfa2265fa\") " pod="openstack-kuttl-tests/glance-db-sync-zzp2r" Mar 16 17:04:15 crc kubenswrapper[5120]: I0316 17:04:15.547108 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-zzp2r" Mar 16 17:04:15 crc kubenswrapper[5120]: I0316 17:04:15.896496 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/1a6911b8-1804-40ce-88c2-3da863703774-etc-swift\") pod \"swift-storage-0\" (UID: \"1a6911b8-1804-40ce-88c2-3da863703774\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 17:04:15 crc kubenswrapper[5120]: I0316 17:04:15.905908 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/1a6911b8-1804-40ce-88c2-3da863703774-etc-swift\") pod \"swift-storage-0\" (UID: \"1a6911b8-1804-40ce-88c2-3da863703774\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 17:04:16 crc kubenswrapper[5120]: I0316 17:04:16.020607 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-zzp2r"] Mar 16 17:04:16 crc kubenswrapper[5120]: W0316 17:04:16.022554 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod93dfd188_3406_4990_b8e2_423cfa2265fa.slice/crio-c4d9befe9fe8b71c0b44d5a795eba999795c4177eba3753aa0ec4b6140a99a1b WatchSource:0}: Error finding container c4d9befe9fe8b71c0b44d5a795eba999795c4177eba3753aa0ec4b6140a99a1b: Status 404 returned error can't find the container with id c4d9befe9fe8b71c0b44d5a795eba999795c4177eba3753aa0ec4b6140a99a1b Mar 16 17:04:16 crc kubenswrapper[5120]: I0316 17:04:16.079576 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Mar 16 17:04:16 crc kubenswrapper[5120]: I0316 17:04:16.160893 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/root-account-create-update-kxc4d"] Mar 16 17:04:16 crc kubenswrapper[5120]: I0316 17:04:16.170569 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-kxc4d"] Mar 16 17:04:16 crc kubenswrapper[5120]: I0316 17:04:16.170786 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-kxc4d" Mar 16 17:04:16 crc kubenswrapper[5120]: I0316 17:04:16.175740 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"openstack-cell1-mariadb-root-db-secret\"" Mar 16 17:04:16 crc kubenswrapper[5120]: I0316 17:04:16.203044 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rm8c\" (UniqueName: \"kubernetes.io/projected/c43d22b4-7a33-42bc-9fcd-79cb1735c27e-kube-api-access-6rm8c\") pod \"root-account-create-update-kxc4d\" (UID: \"c43d22b4-7a33-42bc-9fcd-79cb1735c27e\") " pod="openstack-kuttl-tests/root-account-create-update-kxc4d" Mar 16 17:04:16 crc kubenswrapper[5120]: I0316 17:04:16.203293 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c43d22b4-7a33-42bc-9fcd-79cb1735c27e-operator-scripts\") pod \"root-account-create-update-kxc4d\" (UID: \"c43d22b4-7a33-42bc-9fcd-79cb1735c27e\") " pod="openstack-kuttl-tests/root-account-create-update-kxc4d" Mar 16 17:04:16 crc kubenswrapper[5120]: I0316 17:04:16.307911 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6rm8c\" (UniqueName: \"kubernetes.io/projected/c43d22b4-7a33-42bc-9fcd-79cb1735c27e-kube-api-access-6rm8c\") pod \"root-account-create-update-kxc4d\" (UID: \"c43d22b4-7a33-42bc-9fcd-79cb1735c27e\") " pod="openstack-kuttl-tests/root-account-create-update-kxc4d" Mar 16 17:04:16 crc kubenswrapper[5120]: I0316 17:04:16.309153 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c43d22b4-7a33-42bc-9fcd-79cb1735c27e-operator-scripts\") pod \"root-account-create-update-kxc4d\" (UID: \"c43d22b4-7a33-42bc-9fcd-79cb1735c27e\") " pod="openstack-kuttl-tests/root-account-create-update-kxc4d" Mar 16 17:04:16 crc kubenswrapper[5120]: I0316 17:04:16.310096 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c43d22b4-7a33-42bc-9fcd-79cb1735c27e-operator-scripts\") pod \"root-account-create-update-kxc4d\" (UID: \"c43d22b4-7a33-42bc-9fcd-79cb1735c27e\") " pod="openstack-kuttl-tests/root-account-create-update-kxc4d" Mar 16 17:04:16 crc kubenswrapper[5120]: I0316 17:04:16.343263 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rm8c\" (UniqueName: \"kubernetes.io/projected/c43d22b4-7a33-42bc-9fcd-79cb1735c27e-kube-api-access-6rm8c\") pod \"root-account-create-update-kxc4d\" (UID: \"c43d22b4-7a33-42bc-9fcd-79cb1735c27e\") " pod="openstack-kuttl-tests/root-account-create-update-kxc4d" Mar 16 17:04:16 crc kubenswrapper[5120]: I0316 17:04:16.374794 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-zzp2r" event={"ID":"93dfd188-3406-4990-b8e2-423cfa2265fa","Type":"ContainerStarted","Data":"c4d9befe9fe8b71c0b44d5a795eba999795c4177eba3753aa0ec4b6140a99a1b"} Mar 16 17:04:16 crc kubenswrapper[5120]: I0316 17:04:16.499331 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-kxc4d" Mar 16 17:04:16 crc kubenswrapper[5120]: I0316 17:04:16.529878 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 17:04:16 crc kubenswrapper[5120]: W0316 17:04:16.545223 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1a6911b8_1804_40ce_88c2_3da863703774.slice/crio-5010bb1a2a8ed7c5a793b240e61e7a99165cba8d6927537c45ffe778c5bff222 WatchSource:0}: Error finding container 5010bb1a2a8ed7c5a793b240e61e7a99165cba8d6927537c45ffe778c5bff222: Status 404 returned error can't find the container with id 5010bb1a2a8ed7c5a793b240e61e7a99165cba8d6927537c45ffe778c5bff222 Mar 16 17:04:16 crc kubenswrapper[5120]: I0316 17:04:16.966431 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-kxc4d"] Mar 16 17:04:16 crc kubenswrapper[5120]: W0316 17:04:16.974596 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc43d22b4_7a33_42bc_9fcd_79cb1735c27e.slice/crio-326a581d3c680b70391d2cd54ad204b04dca97858be5c6e4ef7e59fe5bf51ad5 WatchSource:0}: Error finding container 326a581d3c680b70391d2cd54ad204b04dca97858be5c6e4ef7e59fe5bf51ad5: Status 404 returned error can't find the container with id 326a581d3c680b70391d2cd54ad204b04dca97858be5c6e4ef7e59fe5bf51ad5 Mar 16 17:04:17 crc kubenswrapper[5120]: I0316 17:04:17.385493 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"1a6911b8-1804-40ce-88c2-3da863703774","Type":"ContainerStarted","Data":"74b6ded1ca90df3a7680b3667eb45a59ed7c4161508c89148fac28872165aad5"} Mar 16 17:04:17 crc kubenswrapper[5120]: I0316 17:04:17.385892 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"1a6911b8-1804-40ce-88c2-3da863703774","Type":"ContainerStarted","Data":"80c15f9c6214656853deb3afd716e5558ff0381737507b767a4f1a07d636dc25"} Mar 16 17:04:17 crc kubenswrapper[5120]: I0316 17:04:17.385911 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"1a6911b8-1804-40ce-88c2-3da863703774","Type":"ContainerStarted","Data":"6cac886d9d64581e2f03ae4d053a2a05790fb1dc3dac0b14b081cf3e631c709c"} Mar 16 17:04:17 crc kubenswrapper[5120]: I0316 17:04:17.385923 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"1a6911b8-1804-40ce-88c2-3da863703774","Type":"ContainerStarted","Data":"8e3d0f9ddaf5e60bb60873b508b6a595547e102a296dfd3de5c2efae3f915946"} Mar 16 17:04:17 crc kubenswrapper[5120]: I0316 17:04:17.385941 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"1a6911b8-1804-40ce-88c2-3da863703774","Type":"ContainerStarted","Data":"5010bb1a2a8ed7c5a793b240e61e7a99165cba8d6927537c45ffe778c5bff222"} Mar 16 17:04:17 crc kubenswrapper[5120]: I0316 17:04:17.387252 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-zzp2r" event={"ID":"93dfd188-3406-4990-b8e2-423cfa2265fa","Type":"ContainerStarted","Data":"3775781460db8ee2f83339813fced0666ae8be36eb4e9f89396cc442f43f8177"} Mar 16 17:04:17 crc kubenswrapper[5120]: I0316 17:04:17.389864 5120 generic.go:358] "Generic (PLEG): container finished" podID="ebaf96b7-6e2e-4c6f-93e8-25abea285916" containerID="a2250cedf14eb131da5eb3091b686f49b79ceaa18fcf6fb92efe429f3b97f5e4" exitCode=0 Mar 16 17:04:17 crc kubenswrapper[5120]: I0316 17:04:17.389960 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-wpshd" event={"ID":"ebaf96b7-6e2e-4c6f-93e8-25abea285916","Type":"ContainerDied","Data":"a2250cedf14eb131da5eb3091b686f49b79ceaa18fcf6fb92efe429f3b97f5e4"} Mar 16 17:04:17 crc kubenswrapper[5120]: I0316 17:04:17.392376 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-kxc4d" event={"ID":"c43d22b4-7a33-42bc-9fcd-79cb1735c27e","Type":"ContainerStarted","Data":"fdec3c8762d2f8d8ae47e970c4b3e0edbd6320b978c45c913213074531aab3da"} Mar 16 17:04:17 crc kubenswrapper[5120]: I0316 17:04:17.392419 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-kxc4d" event={"ID":"c43d22b4-7a33-42bc-9fcd-79cb1735c27e","Type":"ContainerStarted","Data":"326a581d3c680b70391d2cd54ad204b04dca97858be5c6e4ef7e59fe5bf51ad5"} Mar 16 17:04:17 crc kubenswrapper[5120]: I0316 17:04:17.410977 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-db-sync-zzp2r" podStartSLOduration=2.41096279 podStartE2EDuration="2.41096279s" podCreationTimestamp="2026-03-16 17:04:15 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:04:17.403446902 +0000 UTC m=+5559.557378569" watchObservedRunningTime="2026-03-16 17:04:17.41096279 +0000 UTC m=+5559.564894447" Mar 16 17:04:17 crc kubenswrapper[5120]: I0316 17:04:17.423744 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/root-account-create-update-kxc4d" podStartSLOduration=1.423729692 podStartE2EDuration="1.423729692s" podCreationTimestamp="2026-03-16 17:04:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:04:17.418434857 +0000 UTC m=+5559.572366514" watchObservedRunningTime="2026-03-16 17:04:17.423729692 +0000 UTC m=+5559.577661349" Mar 16 17:04:18 crc kubenswrapper[5120]: I0316 17:04:18.403715 5120 generic.go:358] "Generic (PLEG): container finished" podID="c43d22b4-7a33-42bc-9fcd-79cb1735c27e" containerID="fdec3c8762d2f8d8ae47e970c4b3e0edbd6320b978c45c913213074531aab3da" exitCode=0 Mar 16 17:04:18 crc kubenswrapper[5120]: I0316 17:04:18.403808 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-kxc4d" event={"ID":"c43d22b4-7a33-42bc-9fcd-79cb1735c27e","Type":"ContainerDied","Data":"fdec3c8762d2f8d8ae47e970c4b3e0edbd6320b978c45c913213074531aab3da"} Mar 16 17:04:18 crc kubenswrapper[5120]: I0316 17:04:18.406140 5120 generic.go:358] "Generic (PLEG): container finished" podID="259e8ab8-dfd3-414c-b392-951a9f770559" containerID="14337f79a09b00109b153c607b179ada53efe4992d9f6a5e163d9cfcdcce5532" exitCode=0 Mar 16 17:04:18 crc kubenswrapper[5120]: I0316 17:04:18.406268 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"259e8ab8-dfd3-414c-b392-951a9f770559","Type":"ContainerDied","Data":"14337f79a09b00109b153c607b179ada53efe4992d9f6a5e163d9cfcdcce5532"} Mar 16 17:04:18 crc kubenswrapper[5120]: I0316 17:04:18.411007 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"1a6911b8-1804-40ce-88c2-3da863703774","Type":"ContainerStarted","Data":"cb569b064bfb2f3dd5071e1c85d0dfddab098ebc74a76b4f9cbbdd2dd604b2b2"} Mar 16 17:04:18 crc kubenswrapper[5120]: I0316 17:04:18.411040 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"1a6911b8-1804-40ce-88c2-3da863703774","Type":"ContainerStarted","Data":"fcaa41db7f6b2b8655584a426b862d77c42d55c54fa1dc017b5c98bcb6369875"} Mar 16 17:04:18 crc kubenswrapper[5120]: I0316 17:04:18.411052 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"1a6911b8-1804-40ce-88c2-3da863703774","Type":"ContainerStarted","Data":"0602cdf7cd4de99a43963da16f1e923e6041dd0ccfb8ec804e378960e6ee602d"} Mar 16 17:04:18 crc kubenswrapper[5120]: I0316 17:04:18.411062 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"1a6911b8-1804-40ce-88c2-3da863703774","Type":"ContainerStarted","Data":"86f9da2a34f9df6e767f05f80a230f7f4244350d372505d0d4572c4ede7233a8"} Mar 16 17:04:18 crc kubenswrapper[5120]: I0316 17:04:18.411073 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"1a6911b8-1804-40ce-88c2-3da863703774","Type":"ContainerStarted","Data":"b17c5c3627da4f5e5b7fc0294a06455b8592076064fc51ef743ed73361d54cca"} Mar 16 17:04:18 crc kubenswrapper[5120]: I0316 17:04:18.417801 5120 generic.go:358] "Generic (PLEG): container finished" podID="ef2e55ac-292f-4242-b410-0eb4d2ff90d3" containerID="24e0ba9b36b8c8e69c25e031b104d209f612119e56f3f2a6862bfdac4178b943" exitCode=0 Mar 16 17:04:18 crc kubenswrapper[5120]: I0316 17:04:18.418245 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"ef2e55ac-292f-4242-b410-0eb4d2ff90d3","Type":"ContainerDied","Data":"24e0ba9b36b8c8e69c25e031b104d209f612119e56f3f2a6862bfdac4178b943"} Mar 16 17:04:18 crc kubenswrapper[5120]: I0316 17:04:18.431189 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-wpshd" event={"ID":"ebaf96b7-6e2e-4c6f-93e8-25abea285916","Type":"ContainerStarted","Data":"db6c014a47af6d4c48bac44492159c3dd4e0c4eb4d511b7f3f45e8aabad1ac35"} Mar 16 17:04:18 crc kubenswrapper[5120]: I0316 17:04:18.484072 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/certified-operators-wpshd" podStartSLOduration=5.833678458 podStartE2EDuration="6.484047804s" podCreationTimestamp="2026-03-16 17:04:12 +0000 UTC" firstStartedPulling="2026-03-16 17:04:14.348218501 +0000 UTC m=+5556.502150158" lastFinishedPulling="2026-03-16 17:04:14.998587847 +0000 UTC m=+5557.152519504" observedRunningTime="2026-03-16 17:04:18.479881719 +0000 UTC m=+5560.633813386" watchObservedRunningTime="2026-03-16 17:04:18.484047804 +0000 UTC m=+5560.637979461" Mar 16 17:04:19 crc kubenswrapper[5120]: I0316 17:04:19.444349 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"259e8ab8-dfd3-414c-b392-951a9f770559","Type":"ContainerStarted","Data":"b67b7228974d46807a751b668298e02443b992e24f050797b1c8edbe101dc618"} Mar 16 17:04:19 crc kubenswrapper[5120]: I0316 17:04:19.445823 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 17:04:19 crc kubenswrapper[5120]: I0316 17:04:19.453811 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"1a6911b8-1804-40ce-88c2-3da863703774","Type":"ContainerStarted","Data":"5098fec9a781166eb146869f3b45433c89e4149e842057b0aaddbb9c681c7c3b"} Mar 16 17:04:19 crc kubenswrapper[5120]: I0316 17:04:19.454035 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"1a6911b8-1804-40ce-88c2-3da863703774","Type":"ContainerStarted","Data":"26147a9fb03ce38ea3372a952b4e58d7ed008843847066114964a28ec1957d0b"} Mar 16 17:04:19 crc kubenswrapper[5120]: I0316 17:04:19.454102 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"1a6911b8-1804-40ce-88c2-3da863703774","Type":"ContainerStarted","Data":"fffd62bf82332525123277c7167d5d539fb0e406dd1cd781091c41260675fbfa"} Mar 16 17:04:19 crc kubenswrapper[5120]: I0316 17:04:19.454178 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"1a6911b8-1804-40ce-88c2-3da863703774","Type":"ContainerStarted","Data":"081c334e4b23b1cf2a7028106205f291abb6558ec66919bfb6c0c3657a7caf3c"} Mar 16 17:04:19 crc kubenswrapper[5120]: I0316 17:04:19.454238 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"1a6911b8-1804-40ce-88c2-3da863703774","Type":"ContainerStarted","Data":"aef5ac3f9a8cd4ef3a09154c9b4ca0fb6ac5e3c8fdc5d37721d7af270d940c36"} Mar 16 17:04:19 crc kubenswrapper[5120]: I0316 17:04:19.457959 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"ef2e55ac-292f-4242-b410-0eb4d2ff90d3","Type":"ContainerStarted","Data":"06fea802450630dea417ed7a0f1368308b9cfa3ae4a234fa4cd696d5b294abdc"} Mar 16 17:04:19 crc kubenswrapper[5120]: I0316 17:04:19.458935 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 17:04:19 crc kubenswrapper[5120]: I0316 17:04:19.511092 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" podStartSLOduration=37.511068695 podStartE2EDuration="37.511068695s" podCreationTimestamp="2026-03-16 17:03:42 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:04:19.478689481 +0000 UTC m=+5561.632621158" watchObservedRunningTime="2026-03-16 17:04:19.511068695 +0000 UTC m=+5561.665000352" Mar 16 17:04:19 crc kubenswrapper[5120]: I0316 17:04:19.512210 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/rabbitmq-server-0" podStartSLOduration=36.512202227 podStartE2EDuration="36.512202227s" podCreationTimestamp="2026-03-16 17:03:43 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:04:19.504548565 +0000 UTC m=+5561.658480232" watchObservedRunningTime="2026-03-16 17:04:19.512202227 +0000 UTC m=+5561.666133884" Mar 16 17:04:19 crc kubenswrapper[5120]: I0316 17:04:19.722975 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-kxc4d" Mar 16 17:04:19 crc kubenswrapper[5120]: I0316 17:04:19.801079 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6rm8c\" (UniqueName: \"kubernetes.io/projected/c43d22b4-7a33-42bc-9fcd-79cb1735c27e-kube-api-access-6rm8c\") pod \"c43d22b4-7a33-42bc-9fcd-79cb1735c27e\" (UID: \"c43d22b4-7a33-42bc-9fcd-79cb1735c27e\") " Mar 16 17:04:19 crc kubenswrapper[5120]: I0316 17:04:19.801593 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c43d22b4-7a33-42bc-9fcd-79cb1735c27e-operator-scripts\") pod \"c43d22b4-7a33-42bc-9fcd-79cb1735c27e\" (UID: \"c43d22b4-7a33-42bc-9fcd-79cb1735c27e\") " Mar 16 17:04:19 crc kubenswrapper[5120]: I0316 17:04:19.802723 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c43d22b4-7a33-42bc-9fcd-79cb1735c27e-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "c43d22b4-7a33-42bc-9fcd-79cb1735c27e" (UID: "c43d22b4-7a33-42bc-9fcd-79cb1735c27e"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:04:19 crc kubenswrapper[5120]: I0316 17:04:19.807101 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c43d22b4-7a33-42bc-9fcd-79cb1735c27e-kube-api-access-6rm8c" (OuterVolumeSpecName: "kube-api-access-6rm8c") pod "c43d22b4-7a33-42bc-9fcd-79cb1735c27e" (UID: "c43d22b4-7a33-42bc-9fcd-79cb1735c27e"). InnerVolumeSpecName "kube-api-access-6rm8c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:04:19 crc kubenswrapper[5120]: I0316 17:04:19.904228 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c43d22b4-7a33-42bc-9fcd-79cb1735c27e-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:04:19 crc kubenswrapper[5120]: I0316 17:04:19.904265 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6rm8c\" (UniqueName: \"kubernetes.io/projected/c43d22b4-7a33-42bc-9fcd-79cb1735c27e-kube-api-access-6rm8c\") on node \"crc\" DevicePath \"\"" Mar 16 17:04:20 crc kubenswrapper[5120]: I0316 17:04:20.135511 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-marketplace-7dnrp"] Mar 16 17:04:20 crc kubenswrapper[5120]: I0316 17:04:20.137044 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c43d22b4-7a33-42bc-9fcd-79cb1735c27e" containerName="mariadb-account-create-update" Mar 16 17:04:20 crc kubenswrapper[5120]: I0316 17:04:20.137064 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c43d22b4-7a33-42bc-9fcd-79cb1735c27e" containerName="mariadb-account-create-update" Mar 16 17:04:20 crc kubenswrapper[5120]: I0316 17:04:20.137228 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c43d22b4-7a33-42bc-9fcd-79cb1735c27e" containerName="mariadb-account-create-update" Mar 16 17:04:20 crc kubenswrapper[5120]: I0316 17:04:20.143522 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-7dnrp" Mar 16 17:04:20 crc kubenswrapper[5120]: I0316 17:04:20.153813 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-7dnrp"] Mar 16 17:04:20 crc kubenswrapper[5120]: I0316 17:04:20.210707 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/c5f2c866-0f0f-473e-aeb3-00e4d9df0b70-utilities\") pod \"redhat-marketplace-7dnrp\" (UID: \"c5f2c866-0f0f-473e-aeb3-00e4d9df0b70\") " pod="openshift-marketplace/redhat-marketplace-7dnrp" Mar 16 17:04:20 crc kubenswrapper[5120]: I0316 17:04:20.210956 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/c5f2c866-0f0f-473e-aeb3-00e4d9df0b70-catalog-content\") pod \"redhat-marketplace-7dnrp\" (UID: \"c5f2c866-0f0f-473e-aeb3-00e4d9df0b70\") " pod="openshift-marketplace/redhat-marketplace-7dnrp" Mar 16 17:04:20 crc kubenswrapper[5120]: I0316 17:04:20.211391 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdgt7\" (UniqueName: \"kubernetes.io/projected/c5f2c866-0f0f-473e-aeb3-00e4d9df0b70-kube-api-access-vdgt7\") pod \"redhat-marketplace-7dnrp\" (UID: \"c5f2c866-0f0f-473e-aeb3-00e4d9df0b70\") " pod="openshift-marketplace/redhat-marketplace-7dnrp" Mar 16 17:04:20 crc kubenswrapper[5120]: I0316 17:04:20.314435 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vdgt7\" (UniqueName: \"kubernetes.io/projected/c5f2c866-0f0f-473e-aeb3-00e4d9df0b70-kube-api-access-vdgt7\") pod \"redhat-marketplace-7dnrp\" (UID: \"c5f2c866-0f0f-473e-aeb3-00e4d9df0b70\") " pod="openshift-marketplace/redhat-marketplace-7dnrp" Mar 16 17:04:20 crc kubenswrapper[5120]: I0316 17:04:20.314672 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/c5f2c866-0f0f-473e-aeb3-00e4d9df0b70-utilities\") pod \"redhat-marketplace-7dnrp\" (UID: \"c5f2c866-0f0f-473e-aeb3-00e4d9df0b70\") " pod="openshift-marketplace/redhat-marketplace-7dnrp" Mar 16 17:04:20 crc kubenswrapper[5120]: I0316 17:04:20.314720 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/c5f2c866-0f0f-473e-aeb3-00e4d9df0b70-catalog-content\") pod \"redhat-marketplace-7dnrp\" (UID: \"c5f2c866-0f0f-473e-aeb3-00e4d9df0b70\") " pod="openshift-marketplace/redhat-marketplace-7dnrp" Mar 16 17:04:20 crc kubenswrapper[5120]: I0316 17:04:20.315291 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/c5f2c866-0f0f-473e-aeb3-00e4d9df0b70-catalog-content\") pod \"redhat-marketplace-7dnrp\" (UID: \"c5f2c866-0f0f-473e-aeb3-00e4d9df0b70\") " pod="openshift-marketplace/redhat-marketplace-7dnrp" Mar 16 17:04:20 crc kubenswrapper[5120]: I0316 17:04:20.315420 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/c5f2c866-0f0f-473e-aeb3-00e4d9df0b70-utilities\") pod \"redhat-marketplace-7dnrp\" (UID: \"c5f2c866-0f0f-473e-aeb3-00e4d9df0b70\") " pod="openshift-marketplace/redhat-marketplace-7dnrp" Mar 16 17:04:20 crc kubenswrapper[5120]: I0316 17:04:20.333254 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdgt7\" (UniqueName: \"kubernetes.io/projected/c5f2c866-0f0f-473e-aeb3-00e4d9df0b70-kube-api-access-vdgt7\") pod \"redhat-marketplace-7dnrp\" (UID: \"c5f2c866-0f0f-473e-aeb3-00e4d9df0b70\") " pod="openshift-marketplace/redhat-marketplace-7dnrp" Mar 16 17:04:20 crc kubenswrapper[5120]: I0316 17:04:20.464013 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-7dnrp" Mar 16 17:04:20 crc kubenswrapper[5120]: I0316 17:04:20.501788 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"1a6911b8-1804-40ce-88c2-3da863703774","Type":"ContainerStarted","Data":"fc3653aadde94d85e422b461f8f63dc7a32af850418ac80e3af785d73f21e8ee"} Mar 16 17:04:20 crc kubenswrapper[5120]: I0316 17:04:20.506862 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-kxc4d" Mar 16 17:04:20 crc kubenswrapper[5120]: I0316 17:04:20.506928 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-kxc4d" event={"ID":"c43d22b4-7a33-42bc-9fcd-79cb1735c27e","Type":"ContainerDied","Data":"326a581d3c680b70391d2cd54ad204b04dca97858be5c6e4ef7e59fe5bf51ad5"} Mar 16 17:04:20 crc kubenswrapper[5120]: I0316 17:04:20.506974 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="326a581d3c680b70391d2cd54ad204b04dca97858be5c6e4ef7e59fe5bf51ad5" Mar 16 17:04:20 crc kubenswrapper[5120]: I0316 17:04:20.557495 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/swift-storage-0" podStartSLOduration=21.557475602 podStartE2EDuration="21.557475602s" podCreationTimestamp="2026-03-16 17:03:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:04:20.544269718 +0000 UTC m=+5562.698201395" watchObservedRunningTime="2026-03-16 17:04:20.557475602 +0000 UTC m=+5562.711407259" Mar 16 17:04:20 crc kubenswrapper[5120]: I0316 17:04:20.800820 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-77c6fdf6b9-g6qx5"] Mar 16 17:04:20 crc kubenswrapper[5120]: I0316 17:04:20.816693 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-77c6fdf6b9-g6qx5"] Mar 16 17:04:20 crc kubenswrapper[5120]: I0316 17:04:20.816857 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-77c6fdf6b9-g6qx5" Mar 16 17:04:20 crc kubenswrapper[5120]: I0316 17:04:20.820010 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"dns-swift-storage-0\"" Mar 16 17:04:20 crc kubenswrapper[5120]: I0316 17:04:20.828135 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/01210506-f19f-4c41-9245-e8b287618649-config\") pod \"dnsmasq-dnsmasq-77c6fdf6b9-g6qx5\" (UID: \"01210506-f19f-4c41-9245-e8b287618649\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-77c6fdf6b9-g6qx5" Mar 16 17:04:20 crc kubenswrapper[5120]: I0316 17:04:20.828283 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmd9j\" (UniqueName: \"kubernetes.io/projected/01210506-f19f-4c41-9245-e8b287618649-kube-api-access-nmd9j\") pod \"dnsmasq-dnsmasq-77c6fdf6b9-g6qx5\" (UID: \"01210506-f19f-4c41-9245-e8b287618649\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-77c6fdf6b9-g6qx5" Mar 16 17:04:20 crc kubenswrapper[5120]: I0316 17:04:20.828439 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/01210506-f19f-4c41-9245-e8b287618649-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-77c6fdf6b9-g6qx5\" (UID: \"01210506-f19f-4c41-9245-e8b287618649\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-77c6fdf6b9-g6qx5" Mar 16 17:04:20 crc kubenswrapper[5120]: I0316 17:04:20.828531 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/01210506-f19f-4c41-9245-e8b287618649-dns-swift-storage-0\") pod \"dnsmasq-dnsmasq-77c6fdf6b9-g6qx5\" (UID: \"01210506-f19f-4c41-9245-e8b287618649\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-77c6fdf6b9-g6qx5" Mar 16 17:04:20 crc kubenswrapper[5120]: I0316 17:04:20.930451 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/01210506-f19f-4c41-9245-e8b287618649-config\") pod \"dnsmasq-dnsmasq-77c6fdf6b9-g6qx5\" (UID: \"01210506-f19f-4c41-9245-e8b287618649\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-77c6fdf6b9-g6qx5" Mar 16 17:04:20 crc kubenswrapper[5120]: I0316 17:04:20.930659 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nmd9j\" (UniqueName: \"kubernetes.io/projected/01210506-f19f-4c41-9245-e8b287618649-kube-api-access-nmd9j\") pod \"dnsmasq-dnsmasq-77c6fdf6b9-g6qx5\" (UID: \"01210506-f19f-4c41-9245-e8b287618649\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-77c6fdf6b9-g6qx5" Mar 16 17:04:20 crc kubenswrapper[5120]: I0316 17:04:20.930801 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/01210506-f19f-4c41-9245-e8b287618649-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-77c6fdf6b9-g6qx5\" (UID: \"01210506-f19f-4c41-9245-e8b287618649\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-77c6fdf6b9-g6qx5" Mar 16 17:04:20 crc kubenswrapper[5120]: I0316 17:04:20.930909 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/01210506-f19f-4c41-9245-e8b287618649-dns-swift-storage-0\") pod \"dnsmasq-dnsmasq-77c6fdf6b9-g6qx5\" (UID: \"01210506-f19f-4c41-9245-e8b287618649\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-77c6fdf6b9-g6qx5" Mar 16 17:04:20 crc kubenswrapper[5120]: I0316 17:04:20.931956 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/01210506-f19f-4c41-9245-e8b287618649-config\") pod \"dnsmasq-dnsmasq-77c6fdf6b9-g6qx5\" (UID: \"01210506-f19f-4c41-9245-e8b287618649\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-77c6fdf6b9-g6qx5" Mar 16 17:04:20 crc kubenswrapper[5120]: I0316 17:04:20.932159 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/01210506-f19f-4c41-9245-e8b287618649-dns-swift-storage-0\") pod \"dnsmasq-dnsmasq-77c6fdf6b9-g6qx5\" (UID: \"01210506-f19f-4c41-9245-e8b287618649\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-77c6fdf6b9-g6qx5" Mar 16 17:04:20 crc kubenswrapper[5120]: I0316 17:04:20.932338 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/01210506-f19f-4c41-9245-e8b287618649-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-77c6fdf6b9-g6qx5\" (UID: \"01210506-f19f-4c41-9245-e8b287618649\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-77c6fdf6b9-g6qx5" Mar 16 17:04:20 crc kubenswrapper[5120]: I0316 17:04:20.953073 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmd9j\" (UniqueName: \"kubernetes.io/projected/01210506-f19f-4c41-9245-e8b287618649-kube-api-access-nmd9j\") pod \"dnsmasq-dnsmasq-77c6fdf6b9-g6qx5\" (UID: \"01210506-f19f-4c41-9245-e8b287618649\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-77c6fdf6b9-g6qx5" Mar 16 17:04:20 crc kubenswrapper[5120]: W0316 17:04:20.956523 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5f2c866_0f0f_473e_aeb3_00e4d9df0b70.slice/crio-429f51108374d9572e375b38e20543890c31989d5ffe2109d67df34038cca1d8 WatchSource:0}: Error finding container 429f51108374d9572e375b38e20543890c31989d5ffe2109d67df34038cca1d8: Status 404 returned error can't find the container with id 429f51108374d9572e375b38e20543890c31989d5ffe2109d67df34038cca1d8 Mar 16 17:04:20 crc kubenswrapper[5120]: I0316 17:04:20.957794 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-7dnrp"] Mar 16 17:04:21 crc kubenswrapper[5120]: I0316 17:04:21.140715 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-77c6fdf6b9-g6qx5" Mar 16 17:04:21 crc kubenswrapper[5120]: I0316 17:04:21.518224 5120 generic.go:358] "Generic (PLEG): container finished" podID="93dfd188-3406-4990-b8e2-423cfa2265fa" containerID="3775781460db8ee2f83339813fced0666ae8be36eb4e9f89396cc442f43f8177" exitCode=0 Mar 16 17:04:21 crc kubenswrapper[5120]: I0316 17:04:21.518462 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-zzp2r" event={"ID":"93dfd188-3406-4990-b8e2-423cfa2265fa","Type":"ContainerDied","Data":"3775781460db8ee2f83339813fced0666ae8be36eb4e9f89396cc442f43f8177"} Mar 16 17:04:21 crc kubenswrapper[5120]: I0316 17:04:21.520603 5120 generic.go:358] "Generic (PLEG): container finished" podID="c5f2c866-0f0f-473e-aeb3-00e4d9df0b70" containerID="0e310fc5ae84bdef7574e66297f8f5bd0cf5452abcbc9dda4614705c27dc7e3b" exitCode=0 Mar 16 17:04:21 crc kubenswrapper[5120]: I0316 17:04:21.523035 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-7dnrp" event={"ID":"c5f2c866-0f0f-473e-aeb3-00e4d9df0b70","Type":"ContainerDied","Data":"0e310fc5ae84bdef7574e66297f8f5bd0cf5452abcbc9dda4614705c27dc7e3b"} Mar 16 17:04:21 crc kubenswrapper[5120]: I0316 17:04:21.523093 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-7dnrp" event={"ID":"c5f2c866-0f0f-473e-aeb3-00e4d9df0b70","Type":"ContainerStarted","Data":"429f51108374d9572e375b38e20543890c31989d5ffe2109d67df34038cca1d8"} Mar 16 17:04:21 crc kubenswrapper[5120]: I0316 17:04:21.630899 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-77c6fdf6b9-g6qx5"] Mar 16 17:04:21 crc kubenswrapper[5120]: W0316 17:04:21.633994 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod01210506_f19f_4c41_9245_e8b287618649.slice/crio-70f3578e00ca4c9ef1a3c3ee1ab0fff95a41059d2001a2a8cbbf8538f47d51ac WatchSource:0}: Error finding container 70f3578e00ca4c9ef1a3c3ee1ab0fff95a41059d2001a2a8cbbf8538f47d51ac: Status 404 returned error can't find the container with id 70f3578e00ca4c9ef1a3c3ee1ab0fff95a41059d2001a2a8cbbf8538f47d51ac Mar 16 17:04:22 crc kubenswrapper[5120]: I0316 17:04:22.531465 5120 generic.go:358] "Generic (PLEG): container finished" podID="01210506-f19f-4c41-9245-e8b287618649" containerID="e18b7f5318a0899ff7447d43bcc97722b75931fc63f4eb188ef5750d34a03978" exitCode=0 Mar 16 17:04:22 crc kubenswrapper[5120]: I0316 17:04:22.531594 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-77c6fdf6b9-g6qx5" event={"ID":"01210506-f19f-4c41-9245-e8b287618649","Type":"ContainerDied","Data":"e18b7f5318a0899ff7447d43bcc97722b75931fc63f4eb188ef5750d34a03978"} Mar 16 17:04:22 crc kubenswrapper[5120]: I0316 17:04:22.531932 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-77c6fdf6b9-g6qx5" event={"ID":"01210506-f19f-4c41-9245-e8b287618649","Type":"ContainerStarted","Data":"70f3578e00ca4c9ef1a3c3ee1ab0fff95a41059d2001a2a8cbbf8538f47d51ac"} Mar 16 17:04:22 crc kubenswrapper[5120]: I0316 17:04:22.674670 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/certified-operators-wpshd" Mar 16 17:04:22 crc kubenswrapper[5120]: I0316 17:04:22.675045 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-marketplace/certified-operators-wpshd" Mar 16 17:04:22 crc kubenswrapper[5120]: I0316 17:04:22.719649 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/certified-operators-wpshd" Mar 16 17:04:22 crc kubenswrapper[5120]: I0316 17:04:22.831025 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-zzp2r" Mar 16 17:04:22 crc kubenswrapper[5120]: I0316 17:04:22.877717 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t7twt\" (UniqueName: \"kubernetes.io/projected/93dfd188-3406-4990-b8e2-423cfa2265fa-kube-api-access-t7twt\") pod \"93dfd188-3406-4990-b8e2-423cfa2265fa\" (UID: \"93dfd188-3406-4990-b8e2-423cfa2265fa\") " Mar 16 17:04:22 crc kubenswrapper[5120]: I0316 17:04:22.878026 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/93dfd188-3406-4990-b8e2-423cfa2265fa-combined-ca-bundle\") pod \"93dfd188-3406-4990-b8e2-423cfa2265fa\" (UID: \"93dfd188-3406-4990-b8e2-423cfa2265fa\") " Mar 16 17:04:22 crc kubenswrapper[5120]: I0316 17:04:22.878087 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/93dfd188-3406-4990-b8e2-423cfa2265fa-config-data\") pod \"93dfd188-3406-4990-b8e2-423cfa2265fa\" (UID: \"93dfd188-3406-4990-b8e2-423cfa2265fa\") " Mar 16 17:04:22 crc kubenswrapper[5120]: I0316 17:04:22.878174 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/93dfd188-3406-4990-b8e2-423cfa2265fa-db-sync-config-data\") pod \"93dfd188-3406-4990-b8e2-423cfa2265fa\" (UID: \"93dfd188-3406-4990-b8e2-423cfa2265fa\") " Mar 16 17:04:22 crc kubenswrapper[5120]: I0316 17:04:22.884079 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93dfd188-3406-4990-b8e2-423cfa2265fa-db-sync-config-data" (OuterVolumeSpecName: "db-sync-config-data") pod "93dfd188-3406-4990-b8e2-423cfa2265fa" (UID: "93dfd188-3406-4990-b8e2-423cfa2265fa"). InnerVolumeSpecName "db-sync-config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:04:22 crc kubenswrapper[5120]: I0316 17:04:22.884138 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93dfd188-3406-4990-b8e2-423cfa2265fa-kube-api-access-t7twt" (OuterVolumeSpecName: "kube-api-access-t7twt") pod "93dfd188-3406-4990-b8e2-423cfa2265fa" (UID: "93dfd188-3406-4990-b8e2-423cfa2265fa"). InnerVolumeSpecName "kube-api-access-t7twt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:04:22 crc kubenswrapper[5120]: I0316 17:04:22.905741 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93dfd188-3406-4990-b8e2-423cfa2265fa-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "93dfd188-3406-4990-b8e2-423cfa2265fa" (UID: "93dfd188-3406-4990-b8e2-423cfa2265fa"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:04:22 crc kubenswrapper[5120]: I0316 17:04:22.921511 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93dfd188-3406-4990-b8e2-423cfa2265fa-config-data" (OuterVolumeSpecName: "config-data") pod "93dfd188-3406-4990-b8e2-423cfa2265fa" (UID: "93dfd188-3406-4990-b8e2-423cfa2265fa"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:04:22 crc kubenswrapper[5120]: I0316 17:04:22.980982 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t7twt\" (UniqueName: \"kubernetes.io/projected/93dfd188-3406-4990-b8e2-423cfa2265fa-kube-api-access-t7twt\") on node \"crc\" DevicePath \"\"" Mar 16 17:04:22 crc kubenswrapper[5120]: I0316 17:04:22.981020 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/93dfd188-3406-4990-b8e2-423cfa2265fa-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:04:22 crc kubenswrapper[5120]: I0316 17:04:22.981031 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/93dfd188-3406-4990-b8e2-423cfa2265fa-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:04:22 crc kubenswrapper[5120]: I0316 17:04:22.981042 5120 reconciler_common.go:299] "Volume detached for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/93dfd188-3406-4990-b8e2-423cfa2265fa-db-sync-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:04:23 crc kubenswrapper[5120]: I0316 17:04:23.542073 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-zzp2r" Mar 16 17:04:23 crc kubenswrapper[5120]: I0316 17:04:23.542104 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-zzp2r" event={"ID":"93dfd188-3406-4990-b8e2-423cfa2265fa","Type":"ContainerDied","Data":"c4d9befe9fe8b71c0b44d5a795eba999795c4177eba3753aa0ec4b6140a99a1b"} Mar 16 17:04:23 crc kubenswrapper[5120]: I0316 17:04:23.543637 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c4d9befe9fe8b71c0b44d5a795eba999795c4177eba3753aa0ec4b6140a99a1b" Mar 16 17:04:23 crc kubenswrapper[5120]: I0316 17:04:23.544257 5120 generic.go:358] "Generic (PLEG): container finished" podID="c5f2c866-0f0f-473e-aeb3-00e4d9df0b70" containerID="2b0b8779853fcd51ea7b4563fd104bf3052138c86ac51e0e376398e41a00eb04" exitCode=0 Mar 16 17:04:23 crc kubenswrapper[5120]: I0316 17:04:23.544394 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-7dnrp" event={"ID":"c5f2c866-0f0f-473e-aeb3-00e4d9df0b70","Type":"ContainerDied","Data":"2b0b8779853fcd51ea7b4563fd104bf3052138c86ac51e0e376398e41a00eb04"} Mar 16 17:04:23 crc kubenswrapper[5120]: I0316 17:04:23.546453 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-77c6fdf6b9-g6qx5" event={"ID":"01210506-f19f-4c41-9245-e8b287618649","Type":"ContainerStarted","Data":"d8ce36678684ad10fdcc7f2a74aa9bb51ab1d711a3814757cc6a3a1c1aa05e09"} Mar 16 17:04:23 crc kubenswrapper[5120]: I0316 17:04:23.546779 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-77c6fdf6b9-g6qx5" Mar 16 17:04:23 crc kubenswrapper[5120]: I0316 17:04:23.598921 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/certified-operators-wpshd" Mar 16 17:04:23 crc kubenswrapper[5120]: I0316 17:04:23.611482 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-77c6fdf6b9-g6qx5" podStartSLOduration=3.61146622 podStartE2EDuration="3.61146622s" podCreationTimestamp="2026-03-16 17:04:20 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:04:23.608438575 +0000 UTC m=+5565.762370242" watchObservedRunningTime="2026-03-16 17:04:23.61146622 +0000 UTC m=+5565.765397877" Mar 16 17:04:24 crc kubenswrapper[5120]: I0316 17:04:24.098442 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/certified-operators-wpshd"] Mar 16 17:04:24 crc kubenswrapper[5120]: I0316 17:04:24.559305 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-7dnrp" event={"ID":"c5f2c866-0f0f-473e-aeb3-00e4d9df0b70","Type":"ContainerStarted","Data":"0ce9b890bc505fe6bf47aead2d5e90a9ebb599e3cb660bcef2cd172362a348d4"} Mar 16 17:04:24 crc kubenswrapper[5120]: I0316 17:04:24.586272 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/redhat-marketplace-7dnrp" podStartSLOduration=3.747821526 podStartE2EDuration="4.586254398s" podCreationTimestamp="2026-03-16 17:04:20 +0000 UTC" firstStartedPulling="2026-03-16 17:04:21.522935134 +0000 UTC m=+5563.676866791" lastFinishedPulling="2026-03-16 17:04:22.361367966 +0000 UTC m=+5564.515299663" observedRunningTime="2026-03-16 17:04:24.579174083 +0000 UTC m=+5566.733105740" watchObservedRunningTime="2026-03-16 17:04:24.586254398 +0000 UTC m=+5566.740186055" Mar 16 17:04:25 crc kubenswrapper[5120]: I0316 17:04:25.584135 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-marketplace/certified-operators-wpshd" podUID="ebaf96b7-6e2e-4c6f-93e8-25abea285916" containerName="registry-server" containerID="cri-o://db6c014a47af6d4c48bac44492159c3dd4e0c4eb4d511b7f3f45e8aabad1ac35" gracePeriod=2 Mar 16 17:04:26 crc kubenswrapper[5120]: I0316 17:04:26.092646 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-wpshd" Mar 16 17:04:26 crc kubenswrapper[5120]: I0316 17:04:26.153694 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/ebaf96b7-6e2e-4c6f-93e8-25abea285916-utilities\") pod \"ebaf96b7-6e2e-4c6f-93e8-25abea285916\" (UID: \"ebaf96b7-6e2e-4c6f-93e8-25abea285916\") " Mar 16 17:04:26 crc kubenswrapper[5120]: I0316 17:04:26.154382 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lz9tl\" (UniqueName: \"kubernetes.io/projected/ebaf96b7-6e2e-4c6f-93e8-25abea285916-kube-api-access-lz9tl\") pod \"ebaf96b7-6e2e-4c6f-93e8-25abea285916\" (UID: \"ebaf96b7-6e2e-4c6f-93e8-25abea285916\") " Mar 16 17:04:26 crc kubenswrapper[5120]: I0316 17:04:26.154578 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/ebaf96b7-6e2e-4c6f-93e8-25abea285916-catalog-content\") pod \"ebaf96b7-6e2e-4c6f-93e8-25abea285916\" (UID: \"ebaf96b7-6e2e-4c6f-93e8-25abea285916\") " Mar 16 17:04:26 crc kubenswrapper[5120]: I0316 17:04:26.155487 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ebaf96b7-6e2e-4c6f-93e8-25abea285916-utilities" (OuterVolumeSpecName: "utilities") pod "ebaf96b7-6e2e-4c6f-93e8-25abea285916" (UID: "ebaf96b7-6e2e-4c6f-93e8-25abea285916"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:04:26 crc kubenswrapper[5120]: I0316 17:04:26.160036 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ebaf96b7-6e2e-4c6f-93e8-25abea285916-kube-api-access-lz9tl" (OuterVolumeSpecName: "kube-api-access-lz9tl") pod "ebaf96b7-6e2e-4c6f-93e8-25abea285916" (UID: "ebaf96b7-6e2e-4c6f-93e8-25abea285916"). InnerVolumeSpecName "kube-api-access-lz9tl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:04:26 crc kubenswrapper[5120]: I0316 17:04:26.198974 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ebaf96b7-6e2e-4c6f-93e8-25abea285916-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "ebaf96b7-6e2e-4c6f-93e8-25abea285916" (UID: "ebaf96b7-6e2e-4c6f-93e8-25abea285916"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:04:26 crc kubenswrapper[5120]: I0316 17:04:26.257157 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lz9tl\" (UniqueName: \"kubernetes.io/projected/ebaf96b7-6e2e-4c6f-93e8-25abea285916-kube-api-access-lz9tl\") on node \"crc\" DevicePath \"\"" Mar 16 17:04:26 crc kubenswrapper[5120]: I0316 17:04:26.257421 5120 reconciler_common.go:299] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/ebaf96b7-6e2e-4c6f-93e8-25abea285916-catalog-content\") on node \"crc\" DevicePath \"\"" Mar 16 17:04:26 crc kubenswrapper[5120]: I0316 17:04:26.257496 5120 reconciler_common.go:299] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/ebaf96b7-6e2e-4c6f-93e8-25abea285916-utilities\") on node \"crc\" DevicePath \"\"" Mar 16 17:04:26 crc kubenswrapper[5120]: I0316 17:04:26.594661 5120 generic.go:358] "Generic (PLEG): container finished" podID="ebaf96b7-6e2e-4c6f-93e8-25abea285916" containerID="db6c014a47af6d4c48bac44492159c3dd4e0c4eb4d511b7f3f45e8aabad1ac35" exitCode=0 Mar 16 17:04:26 crc kubenswrapper[5120]: I0316 17:04:26.594788 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-wpshd" event={"ID":"ebaf96b7-6e2e-4c6f-93e8-25abea285916","Type":"ContainerDied","Data":"db6c014a47af6d4c48bac44492159c3dd4e0c4eb4d511b7f3f45e8aabad1ac35"} Mar 16 17:04:26 crc kubenswrapper[5120]: I0316 17:04:26.595723 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-wpshd" event={"ID":"ebaf96b7-6e2e-4c6f-93e8-25abea285916","Type":"ContainerDied","Data":"51c8a8b7d871417da8cc8db3cf0248abd4a0706e8a8d7148db88425ec077440d"} Mar 16 17:04:26 crc kubenswrapper[5120]: I0316 17:04:26.594844 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-wpshd" Mar 16 17:04:26 crc kubenswrapper[5120]: I0316 17:04:26.595792 5120 scope.go:117] "RemoveContainer" containerID="db6c014a47af6d4c48bac44492159c3dd4e0c4eb4d511b7f3f45e8aabad1ac35" Mar 16 17:04:26 crc kubenswrapper[5120]: I0316 17:04:26.617700 5120 scope.go:117] "RemoveContainer" containerID="a2250cedf14eb131da5eb3091b686f49b79ceaa18fcf6fb92efe429f3b97f5e4" Mar 16 17:04:26 crc kubenswrapper[5120]: I0316 17:04:26.630782 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/certified-operators-wpshd"] Mar 16 17:04:26 crc kubenswrapper[5120]: I0316 17:04:26.641688 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/certified-operators-wpshd"] Mar 16 17:04:26 crc kubenswrapper[5120]: I0316 17:04:26.659205 5120 scope.go:117] "RemoveContainer" containerID="357ecf96a0c6bbf34082102a4be72be4a3a99fc7d085ea93e1a3892d7a0032df" Mar 16 17:04:26 crc kubenswrapper[5120]: I0316 17:04:26.678170 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ebaf96b7-6e2e-4c6f-93e8-25abea285916" path="/var/lib/kubelet/pods/ebaf96b7-6e2e-4c6f-93e8-25abea285916/volumes" Mar 16 17:04:26 crc kubenswrapper[5120]: I0316 17:04:26.683724 5120 scope.go:117] "RemoveContainer" containerID="db6c014a47af6d4c48bac44492159c3dd4e0c4eb4d511b7f3f45e8aabad1ac35" Mar 16 17:04:26 crc kubenswrapper[5120]: E0316 17:04:26.684317 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db6c014a47af6d4c48bac44492159c3dd4e0c4eb4d511b7f3f45e8aabad1ac35\": container with ID starting with db6c014a47af6d4c48bac44492159c3dd4e0c4eb4d511b7f3f45e8aabad1ac35 not found: ID does not exist" containerID="db6c014a47af6d4c48bac44492159c3dd4e0c4eb4d511b7f3f45e8aabad1ac35" Mar 16 17:04:26 crc kubenswrapper[5120]: I0316 17:04:26.684374 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db6c014a47af6d4c48bac44492159c3dd4e0c4eb4d511b7f3f45e8aabad1ac35"} err="failed to get container status \"db6c014a47af6d4c48bac44492159c3dd4e0c4eb4d511b7f3f45e8aabad1ac35\": rpc error: code = NotFound desc = could not find container \"db6c014a47af6d4c48bac44492159c3dd4e0c4eb4d511b7f3f45e8aabad1ac35\": container with ID starting with db6c014a47af6d4c48bac44492159c3dd4e0c4eb4d511b7f3f45e8aabad1ac35 not found: ID does not exist" Mar 16 17:04:26 crc kubenswrapper[5120]: I0316 17:04:26.684408 5120 scope.go:117] "RemoveContainer" containerID="a2250cedf14eb131da5eb3091b686f49b79ceaa18fcf6fb92efe429f3b97f5e4" Mar 16 17:04:26 crc kubenswrapper[5120]: E0316 17:04:26.684936 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a2250cedf14eb131da5eb3091b686f49b79ceaa18fcf6fb92efe429f3b97f5e4\": container with ID starting with a2250cedf14eb131da5eb3091b686f49b79ceaa18fcf6fb92efe429f3b97f5e4 not found: ID does not exist" containerID="a2250cedf14eb131da5eb3091b686f49b79ceaa18fcf6fb92efe429f3b97f5e4" Mar 16 17:04:26 crc kubenswrapper[5120]: I0316 17:04:26.684966 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2250cedf14eb131da5eb3091b686f49b79ceaa18fcf6fb92efe429f3b97f5e4"} err="failed to get container status \"a2250cedf14eb131da5eb3091b686f49b79ceaa18fcf6fb92efe429f3b97f5e4\": rpc error: code = NotFound desc = could not find container \"a2250cedf14eb131da5eb3091b686f49b79ceaa18fcf6fb92efe429f3b97f5e4\": container with ID starting with a2250cedf14eb131da5eb3091b686f49b79ceaa18fcf6fb92efe429f3b97f5e4 not found: ID does not exist" Mar 16 17:04:26 crc kubenswrapper[5120]: I0316 17:04:26.684984 5120 scope.go:117] "RemoveContainer" containerID="357ecf96a0c6bbf34082102a4be72be4a3a99fc7d085ea93e1a3892d7a0032df" Mar 16 17:04:26 crc kubenswrapper[5120]: E0316 17:04:26.685306 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"357ecf96a0c6bbf34082102a4be72be4a3a99fc7d085ea93e1a3892d7a0032df\": container with ID starting with 357ecf96a0c6bbf34082102a4be72be4a3a99fc7d085ea93e1a3892d7a0032df not found: ID does not exist" containerID="357ecf96a0c6bbf34082102a4be72be4a3a99fc7d085ea93e1a3892d7a0032df" Mar 16 17:04:26 crc kubenswrapper[5120]: I0316 17:04:26.685365 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"357ecf96a0c6bbf34082102a4be72be4a3a99fc7d085ea93e1a3892d7a0032df"} err="failed to get container status \"357ecf96a0c6bbf34082102a4be72be4a3a99fc7d085ea93e1a3892d7a0032df\": rpc error: code = NotFound desc = could not find container \"357ecf96a0c6bbf34082102a4be72be4a3a99fc7d085ea93e1a3892d7a0032df\": container with ID starting with 357ecf96a0c6bbf34082102a4be72be4a3a99fc7d085ea93e1a3892d7a0032df not found: ID does not exist" Mar 16 17:04:29 crc kubenswrapper[5120]: I0316 17:04:29.561015 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-77c6fdf6b9-g6qx5" Mar 16 17:04:29 crc kubenswrapper[5120]: I0316 17:04:29.654536 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-5fprr"] Mar 16 17:04:29 crc kubenswrapper[5120]: I0316 17:04:29.654915 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-5fprr" podUID="d4d1258a-d21b-48af-ac55-d36aa473d0ad" containerName="dnsmasq-dns" containerID="cri-o://5966b74d793da45985b6c1d080d92d4353b0265274cb571270a2643a37a0d906" gracePeriod=10 Mar 16 17:04:29 crc kubenswrapper[5120]: E0316 17:04:29.821254 5120 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd4d1258a_d21b_48af_ac55_d36aa473d0ad.slice/crio-conmon-5966b74d793da45985b6c1d080d92d4353b0265274cb571270a2643a37a0d906.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd4d1258a_d21b_48af_ac55_d36aa473d0ad.slice/crio-5966b74d793da45985b6c1d080d92d4353b0265274cb571270a2643a37a0d906.scope\": RecentStats: unable to find data in memory cache]" Mar 16 17:04:30 crc kubenswrapper[5120]: I0316 17:04:30.136956 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-5fprr" Mar 16 17:04:30 crc kubenswrapper[5120]: I0316 17:04:30.244077 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z4g2w\" (UniqueName: \"kubernetes.io/projected/d4d1258a-d21b-48af-ac55-d36aa473d0ad-kube-api-access-z4g2w\") pod \"d4d1258a-d21b-48af-ac55-d36aa473d0ad\" (UID: \"d4d1258a-d21b-48af-ac55-d36aa473d0ad\") " Mar 16 17:04:30 crc kubenswrapper[5120]: I0316 17:04:30.244702 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d4d1258a-d21b-48af-ac55-d36aa473d0ad-config\") pod \"d4d1258a-d21b-48af-ac55-d36aa473d0ad\" (UID: \"d4d1258a-d21b-48af-ac55-d36aa473d0ad\") " Mar 16 17:04:30 crc kubenswrapper[5120]: I0316 17:04:30.245271 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/d4d1258a-d21b-48af-ac55-d36aa473d0ad-dnsmasq-svc\") pod \"d4d1258a-d21b-48af-ac55-d36aa473d0ad\" (UID: \"d4d1258a-d21b-48af-ac55-d36aa473d0ad\") " Mar 16 17:04:30 crc kubenswrapper[5120]: I0316 17:04:30.251290 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4d1258a-d21b-48af-ac55-d36aa473d0ad-kube-api-access-z4g2w" (OuterVolumeSpecName: "kube-api-access-z4g2w") pod "d4d1258a-d21b-48af-ac55-d36aa473d0ad" (UID: "d4d1258a-d21b-48af-ac55-d36aa473d0ad"). InnerVolumeSpecName "kube-api-access-z4g2w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:04:30 crc kubenswrapper[5120]: I0316 17:04:30.286502 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4d1258a-d21b-48af-ac55-d36aa473d0ad-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "d4d1258a-d21b-48af-ac55-d36aa473d0ad" (UID: "d4d1258a-d21b-48af-ac55-d36aa473d0ad"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:04:30 crc kubenswrapper[5120]: I0316 17:04:30.298346 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4d1258a-d21b-48af-ac55-d36aa473d0ad-config" (OuterVolumeSpecName: "config") pod "d4d1258a-d21b-48af-ac55-d36aa473d0ad" (UID: "d4d1258a-d21b-48af-ac55-d36aa473d0ad"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:04:30 crc kubenswrapper[5120]: I0316 17:04:30.348200 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d4d1258a-d21b-48af-ac55-d36aa473d0ad-config\") on node \"crc\" DevicePath \"\"" Mar 16 17:04:30 crc kubenswrapper[5120]: I0316 17:04:30.348544 5120 reconciler_common.go:299] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/d4d1258a-d21b-48af-ac55-d36aa473d0ad-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Mar 16 17:04:30 crc kubenswrapper[5120]: I0316 17:04:30.348653 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z4g2w\" (UniqueName: \"kubernetes.io/projected/d4d1258a-d21b-48af-ac55-d36aa473d0ad-kube-api-access-z4g2w\") on node \"crc\" DevicePath \"\"" Mar 16 17:04:30 crc kubenswrapper[5120]: I0316 17:04:30.465324 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-marketplace/redhat-marketplace-7dnrp" Mar 16 17:04:30 crc kubenswrapper[5120]: I0316 17:04:30.465404 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-marketplace-7dnrp" Mar 16 17:04:30 crc kubenswrapper[5120]: I0316 17:04:30.504281 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-marketplace-7dnrp" Mar 16 17:04:30 crc kubenswrapper[5120]: I0316 17:04:30.509967 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 17:04:30 crc kubenswrapper[5120]: I0316 17:04:30.511048 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 17:04:30 crc kubenswrapper[5120]: I0316 17:04:30.644952 5120 generic.go:358] "Generic (PLEG): container finished" podID="d4d1258a-d21b-48af-ac55-d36aa473d0ad" containerID="5966b74d793da45985b6c1d080d92d4353b0265274cb571270a2643a37a0d906" exitCode=0 Mar 16 17:04:30 crc kubenswrapper[5120]: I0316 17:04:30.646044 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-5fprr" Mar 16 17:04:30 crc kubenswrapper[5120]: I0316 17:04:30.648006 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-5fprr" event={"ID":"d4d1258a-d21b-48af-ac55-d36aa473d0ad","Type":"ContainerDied","Data":"5966b74d793da45985b6c1d080d92d4353b0265274cb571270a2643a37a0d906"} Mar 16 17:04:30 crc kubenswrapper[5120]: I0316 17:04:30.648084 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-5fprr" event={"ID":"d4d1258a-d21b-48af-ac55-d36aa473d0ad","Type":"ContainerDied","Data":"89fc56a76d2e1d3bfd79c91a214d7cf0ef62c97659690ee09ab0dbbf71e5cc30"} Mar 16 17:04:30 crc kubenswrapper[5120]: I0316 17:04:30.648117 5120 scope.go:117] "RemoveContainer" containerID="5966b74d793da45985b6c1d080d92d4353b0265274cb571270a2643a37a0d906" Mar 16 17:04:30 crc kubenswrapper[5120]: I0316 17:04:30.745129 5120 scope.go:117] "RemoveContainer" containerID="90d3217fa9853898e48742f4c1d79be701b58b485d41d583afc5a57597681ac5" Mar 16 17:04:30 crc kubenswrapper[5120]: I0316 17:04:30.746844 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-marketplace-7dnrp" Mar 16 17:04:30 crc kubenswrapper[5120]: I0316 17:04:30.754833 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-5fprr"] Mar 16 17:04:30 crc kubenswrapper[5120]: I0316 17:04:30.790488 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-5fprr"] Mar 16 17:04:30 crc kubenswrapper[5120]: I0316 17:04:30.841083 5120 scope.go:117] "RemoveContainer" containerID="5966b74d793da45985b6c1d080d92d4353b0265274cb571270a2643a37a0d906" Mar 16 17:04:30 crc kubenswrapper[5120]: I0316 17:04:30.841210 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-db-create-xjpbh"] Mar 16 17:04:30 crc kubenswrapper[5120]: I0316 17:04:30.842439 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4d1258a-d21b-48af-ac55-d36aa473d0ad" containerName="init" Mar 16 17:04:30 crc kubenswrapper[5120]: I0316 17:04:30.842463 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4d1258a-d21b-48af-ac55-d36aa473d0ad" containerName="init" Mar 16 17:04:30 crc kubenswrapper[5120]: I0316 17:04:30.842484 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4d1258a-d21b-48af-ac55-d36aa473d0ad" containerName="dnsmasq-dns" Mar 16 17:04:30 crc kubenswrapper[5120]: I0316 17:04:30.842493 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4d1258a-d21b-48af-ac55-d36aa473d0ad" containerName="dnsmasq-dns" Mar 16 17:04:30 crc kubenswrapper[5120]: I0316 17:04:30.842515 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93dfd188-3406-4990-b8e2-423cfa2265fa" containerName="glance-db-sync" Mar 16 17:04:30 crc kubenswrapper[5120]: I0316 17:04:30.842523 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="93dfd188-3406-4990-b8e2-423cfa2265fa" containerName="glance-db-sync" Mar 16 17:04:30 crc kubenswrapper[5120]: I0316 17:04:30.842548 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ebaf96b7-6e2e-4c6f-93e8-25abea285916" containerName="extract-utilities" Mar 16 17:04:30 crc kubenswrapper[5120]: I0316 17:04:30.842556 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ebaf96b7-6e2e-4c6f-93e8-25abea285916" containerName="extract-utilities" Mar 16 17:04:30 crc kubenswrapper[5120]: I0316 17:04:30.842567 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ebaf96b7-6e2e-4c6f-93e8-25abea285916" containerName="registry-server" Mar 16 17:04:30 crc kubenswrapper[5120]: I0316 17:04:30.842577 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ebaf96b7-6e2e-4c6f-93e8-25abea285916" containerName="registry-server" Mar 16 17:04:30 crc kubenswrapper[5120]: I0316 17:04:30.842597 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ebaf96b7-6e2e-4c6f-93e8-25abea285916" containerName="extract-content" Mar 16 17:04:30 crc kubenswrapper[5120]: I0316 17:04:30.842605 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ebaf96b7-6e2e-4c6f-93e8-25abea285916" containerName="extract-content" Mar 16 17:04:30 crc kubenswrapper[5120]: I0316 17:04:30.842867 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="93dfd188-3406-4990-b8e2-423cfa2265fa" containerName="glance-db-sync" Mar 16 17:04:30 crc kubenswrapper[5120]: I0316 17:04:30.842887 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="d4d1258a-d21b-48af-ac55-d36aa473d0ad" containerName="dnsmasq-dns" Mar 16 17:04:30 crc kubenswrapper[5120]: I0316 17:04:30.842904 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ebaf96b7-6e2e-4c6f-93e8-25abea285916" containerName="registry-server" Mar 16 17:04:30 crc kubenswrapper[5120]: E0316 17:04:30.842989 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5966b74d793da45985b6c1d080d92d4353b0265274cb571270a2643a37a0d906\": container with ID starting with 5966b74d793da45985b6c1d080d92d4353b0265274cb571270a2643a37a0d906 not found: ID does not exist" containerID="5966b74d793da45985b6c1d080d92d4353b0265274cb571270a2643a37a0d906" Mar 16 17:04:30 crc kubenswrapper[5120]: I0316 17:04:30.843030 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5966b74d793da45985b6c1d080d92d4353b0265274cb571270a2643a37a0d906"} err="failed to get container status \"5966b74d793da45985b6c1d080d92d4353b0265274cb571270a2643a37a0d906\": rpc error: code = NotFound desc = could not find container \"5966b74d793da45985b6c1d080d92d4353b0265274cb571270a2643a37a0d906\": container with ID starting with 5966b74d793da45985b6c1d080d92d4353b0265274cb571270a2643a37a0d906 not found: ID does not exist" Mar 16 17:04:30 crc kubenswrapper[5120]: I0316 17:04:30.843055 5120 scope.go:117] "RemoveContainer" containerID="90d3217fa9853898e48742f4c1d79be701b58b485d41d583afc5a57597681ac5" Mar 16 17:04:30 crc kubenswrapper[5120]: E0316 17:04:30.847584 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"90d3217fa9853898e48742f4c1d79be701b58b485d41d583afc5a57597681ac5\": container with ID starting with 90d3217fa9853898e48742f4c1d79be701b58b485d41d583afc5a57597681ac5 not found: ID does not exist" containerID="90d3217fa9853898e48742f4c1d79be701b58b485d41d583afc5a57597681ac5" Mar 16 17:04:30 crc kubenswrapper[5120]: I0316 17:04:30.847626 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90d3217fa9853898e48742f4c1d79be701b58b485d41d583afc5a57597681ac5"} err="failed to get container status \"90d3217fa9853898e48742f4c1d79be701b58b485d41d583afc5a57597681ac5\": rpc error: code = NotFound desc = could not find container \"90d3217fa9853898e48742f4c1d79be701b58b485d41d583afc5a57597681ac5\": container with ID starting with 90d3217fa9853898e48742f4c1d79be701b58b485d41d583afc5a57597681ac5 not found: ID does not exist" Mar 16 17:04:30 crc kubenswrapper[5120]: I0316 17:04:30.861296 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-db-create-xjpbh"] Mar 16 17:04:30 crc kubenswrapper[5120]: I0316 17:04:30.861498 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-create-xjpbh" Mar 16 17:04:30 crc kubenswrapper[5120]: I0316 17:04:30.936024 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-16fb-account-create-update-4lmvk"] Mar 16 17:04:30 crc kubenswrapper[5120]: I0316 17:04:30.941798 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-16fb-account-create-update-4lmvk" Mar 16 17:04:30 crc kubenswrapper[5120]: I0316 17:04:30.946623 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-16fb-account-create-update-4lmvk"] Mar 16 17:04:30 crc kubenswrapper[5120]: I0316 17:04:30.951443 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-db-secret\"" Mar 16 17:04:30 crc kubenswrapper[5120]: I0316 17:04:30.981275 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfp62\" (UniqueName: \"kubernetes.io/projected/3bc621ac-57fe-4689-ac4d-cd47b0909a03-kube-api-access-lfp62\") pod \"cinder-db-create-xjpbh\" (UID: \"3bc621ac-57fe-4689-ac4d-cd47b0909a03\") " pod="openstack-kuttl-tests/cinder-db-create-xjpbh" Mar 16 17:04:30 crc kubenswrapper[5120]: I0316 17:04:30.983206 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgl8s\" (UniqueName: \"kubernetes.io/projected/1abe87e9-49d9-4da3-bfb2-e0aa5d891a71-kube-api-access-wgl8s\") pod \"cinder-16fb-account-create-update-4lmvk\" (UID: \"1abe87e9-49d9-4da3-bfb2-e0aa5d891a71\") " pod="openstack-kuttl-tests/cinder-16fb-account-create-update-4lmvk" Mar 16 17:04:30 crc kubenswrapper[5120]: I0316 17:04:30.983558 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/1abe87e9-49d9-4da3-bfb2-e0aa5d891a71-operator-scripts\") pod \"cinder-16fb-account-create-update-4lmvk\" (UID: \"1abe87e9-49d9-4da3-bfb2-e0aa5d891a71\") " pod="openstack-kuttl-tests/cinder-16fb-account-create-update-4lmvk" Mar 16 17:04:30 crc kubenswrapper[5120]: I0316 17:04:30.983724 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3bc621ac-57fe-4689-ac4d-cd47b0909a03-operator-scripts\") pod \"cinder-db-create-xjpbh\" (UID: \"3bc621ac-57fe-4689-ac4d-cd47b0909a03\") " pod="openstack-kuttl-tests/cinder-db-create-xjpbh" Mar 16 17:04:31 crc kubenswrapper[5120]: I0316 17:04:31.010187 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-db-create-s6gpg"] Mar 16 17:04:31 crc kubenswrapper[5120]: I0316 17:04:31.018189 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-create-s6gpg" Mar 16 17:04:31 crc kubenswrapper[5120]: I0316 17:04:31.034775 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-db-create-s6gpg"] Mar 16 17:04:31 crc kubenswrapper[5120]: I0316 17:04:31.085875 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f91eb2a7-c2b0-42c9-abf5-a3904c2b2eeb-operator-scripts\") pod \"neutron-db-create-s6gpg\" (UID: \"f91eb2a7-c2b0-42c9-abf5-a3904c2b2eeb\") " pod="openstack-kuttl-tests/neutron-db-create-s6gpg" Mar 16 17:04:31 crc kubenswrapper[5120]: I0316 17:04:31.085984 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drvz9\" (UniqueName: \"kubernetes.io/projected/f91eb2a7-c2b0-42c9-abf5-a3904c2b2eeb-kube-api-access-drvz9\") pod \"neutron-db-create-s6gpg\" (UID: \"f91eb2a7-c2b0-42c9-abf5-a3904c2b2eeb\") " pod="openstack-kuttl-tests/neutron-db-create-s6gpg" Mar 16 17:04:31 crc kubenswrapper[5120]: I0316 17:04:31.086033 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3bc621ac-57fe-4689-ac4d-cd47b0909a03-operator-scripts\") pod \"cinder-db-create-xjpbh\" (UID: \"3bc621ac-57fe-4689-ac4d-cd47b0909a03\") " pod="openstack-kuttl-tests/cinder-db-create-xjpbh" Mar 16 17:04:31 crc kubenswrapper[5120]: I0316 17:04:31.086218 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lfp62\" (UniqueName: \"kubernetes.io/projected/3bc621ac-57fe-4689-ac4d-cd47b0909a03-kube-api-access-lfp62\") pod \"cinder-db-create-xjpbh\" (UID: \"3bc621ac-57fe-4689-ac4d-cd47b0909a03\") " pod="openstack-kuttl-tests/cinder-db-create-xjpbh" Mar 16 17:04:31 crc kubenswrapper[5120]: I0316 17:04:31.086355 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wgl8s\" (UniqueName: \"kubernetes.io/projected/1abe87e9-49d9-4da3-bfb2-e0aa5d891a71-kube-api-access-wgl8s\") pod \"cinder-16fb-account-create-update-4lmvk\" (UID: \"1abe87e9-49d9-4da3-bfb2-e0aa5d891a71\") " pod="openstack-kuttl-tests/cinder-16fb-account-create-update-4lmvk" Mar 16 17:04:31 crc kubenswrapper[5120]: I0316 17:04:31.086450 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/1abe87e9-49d9-4da3-bfb2-e0aa5d891a71-operator-scripts\") pod \"cinder-16fb-account-create-update-4lmvk\" (UID: \"1abe87e9-49d9-4da3-bfb2-e0aa5d891a71\") " pod="openstack-kuttl-tests/cinder-16fb-account-create-update-4lmvk" Mar 16 17:04:31 crc kubenswrapper[5120]: I0316 17:04:31.087138 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/1abe87e9-49d9-4da3-bfb2-e0aa5d891a71-operator-scripts\") pod \"cinder-16fb-account-create-update-4lmvk\" (UID: \"1abe87e9-49d9-4da3-bfb2-e0aa5d891a71\") " pod="openstack-kuttl-tests/cinder-16fb-account-create-update-4lmvk" Mar 16 17:04:31 crc kubenswrapper[5120]: I0316 17:04:31.087603 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3bc621ac-57fe-4689-ac4d-cd47b0909a03-operator-scripts\") pod \"cinder-db-create-xjpbh\" (UID: \"3bc621ac-57fe-4689-ac4d-cd47b0909a03\") " pod="openstack-kuttl-tests/cinder-db-create-xjpbh" Mar 16 17:04:31 crc kubenswrapper[5120]: I0316 17:04:31.106878 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-db-create-52gqt"] Mar 16 17:04:31 crc kubenswrapper[5120]: I0316 17:04:31.113402 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgl8s\" (UniqueName: \"kubernetes.io/projected/1abe87e9-49d9-4da3-bfb2-e0aa5d891a71-kube-api-access-wgl8s\") pod \"cinder-16fb-account-create-update-4lmvk\" (UID: \"1abe87e9-49d9-4da3-bfb2-e0aa5d891a71\") " pod="openstack-kuttl-tests/cinder-16fb-account-create-update-4lmvk" Mar 16 17:04:31 crc kubenswrapper[5120]: I0316 17:04:31.115049 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-create-52gqt" Mar 16 17:04:31 crc kubenswrapper[5120]: I0316 17:04:31.115391 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfp62\" (UniqueName: \"kubernetes.io/projected/3bc621ac-57fe-4689-ac4d-cd47b0909a03-kube-api-access-lfp62\") pod \"cinder-db-create-xjpbh\" (UID: \"3bc621ac-57fe-4689-ac4d-cd47b0909a03\") " pod="openstack-kuttl-tests/cinder-db-create-xjpbh" Mar 16 17:04:31 crc kubenswrapper[5120]: I0316 17:04:31.117370 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-a4d9-account-create-update-wk6gm"] Mar 16 17:04:31 crc kubenswrapper[5120]: I0316 17:04:31.125738 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-a4d9-account-create-update-wk6gm" Mar 16 17:04:31 crc kubenswrapper[5120]: I0316 17:04:31.132687 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-db-create-52gqt"] Mar 16 17:04:31 crc kubenswrapper[5120]: I0316 17:04:31.139329 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-db-secret\"" Mar 16 17:04:31 crc kubenswrapper[5120]: I0316 17:04:31.157127 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-a4d9-account-create-update-wk6gm"] Mar 16 17:04:31 crc kubenswrapper[5120]: I0316 17:04:31.188840 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ee5601d1-7c70-4816-a43f-c43030bcb640-operator-scripts\") pod \"barbican-db-create-52gqt\" (UID: \"ee5601d1-7c70-4816-a43f-c43030bcb640\") " pod="openstack-kuttl-tests/barbican-db-create-52gqt" Mar 16 17:04:31 crc kubenswrapper[5120]: I0316 17:04:31.188954 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f91eb2a7-c2b0-42c9-abf5-a3904c2b2eeb-operator-scripts\") pod \"neutron-db-create-s6gpg\" (UID: \"f91eb2a7-c2b0-42c9-abf5-a3904c2b2eeb\") " pod="openstack-kuttl-tests/neutron-db-create-s6gpg" Mar 16 17:04:31 crc kubenswrapper[5120]: I0316 17:04:31.189029 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6nns\" (UniqueName: \"kubernetes.io/projected/42ffc217-f12f-401c-a152-5be06f692da5-kube-api-access-v6nns\") pod \"barbican-a4d9-account-create-update-wk6gm\" (UID: \"42ffc217-f12f-401c-a152-5be06f692da5\") " pod="openstack-kuttl-tests/barbican-a4d9-account-create-update-wk6gm" Mar 16 17:04:31 crc kubenswrapper[5120]: I0316 17:04:31.189056 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-drvz9\" (UniqueName: \"kubernetes.io/projected/f91eb2a7-c2b0-42c9-abf5-a3904c2b2eeb-kube-api-access-drvz9\") pod \"neutron-db-create-s6gpg\" (UID: \"f91eb2a7-c2b0-42c9-abf5-a3904c2b2eeb\") " pod="openstack-kuttl-tests/neutron-db-create-s6gpg" Mar 16 17:04:31 crc kubenswrapper[5120]: I0316 17:04:31.189145 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gxrd\" (UniqueName: \"kubernetes.io/projected/ee5601d1-7c70-4816-a43f-c43030bcb640-kube-api-access-4gxrd\") pod \"barbican-db-create-52gqt\" (UID: \"ee5601d1-7c70-4816-a43f-c43030bcb640\") " pod="openstack-kuttl-tests/barbican-db-create-52gqt" Mar 16 17:04:31 crc kubenswrapper[5120]: I0316 17:04:31.189320 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/42ffc217-f12f-401c-a152-5be06f692da5-operator-scripts\") pod \"barbican-a4d9-account-create-update-wk6gm\" (UID: \"42ffc217-f12f-401c-a152-5be06f692da5\") " pod="openstack-kuttl-tests/barbican-a4d9-account-create-update-wk6gm" Mar 16 17:04:31 crc kubenswrapper[5120]: I0316 17:04:31.190344 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f91eb2a7-c2b0-42c9-abf5-a3904c2b2eeb-operator-scripts\") pod \"neutron-db-create-s6gpg\" (UID: \"f91eb2a7-c2b0-42c9-abf5-a3904c2b2eeb\") " pod="openstack-kuttl-tests/neutron-db-create-s6gpg" Mar 16 17:04:31 crc kubenswrapper[5120]: I0316 17:04:31.191194 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-create-xjpbh" Mar 16 17:04:31 crc kubenswrapper[5120]: I0316 17:04:31.201818 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-pps9b"] Mar 16 17:04:31 crc kubenswrapper[5120]: I0316 17:04:31.208058 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-pps9b" Mar 16 17:04:31 crc kubenswrapper[5120]: I0316 17:04:31.210290 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone\"" Mar 16 17:04:31 crc kubenswrapper[5120]: I0316 17:04:31.211275 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-pps9b"] Mar 16 17:04:31 crc kubenswrapper[5120]: I0316 17:04:31.211412 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-keystone-dockercfg-crlsv\"" Mar 16 17:04:31 crc kubenswrapper[5120]: I0316 17:04:31.211631 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-scripts\"" Mar 16 17:04:31 crc kubenswrapper[5120]: I0316 17:04:31.212661 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-config-data\"" Mar 16 17:04:31 crc kubenswrapper[5120]: I0316 17:04:31.219890 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-drvz9\" (UniqueName: \"kubernetes.io/projected/f91eb2a7-c2b0-42c9-abf5-a3904c2b2eeb-kube-api-access-drvz9\") pod \"neutron-db-create-s6gpg\" (UID: \"f91eb2a7-c2b0-42c9-abf5-a3904c2b2eeb\") " pod="openstack-kuttl-tests/neutron-db-create-s6gpg" Mar 16 17:04:31 crc kubenswrapper[5120]: I0316 17:04:31.229452 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-64dd-account-create-update-t5j6r"] Mar 16 17:04:31 crc kubenswrapper[5120]: I0316 17:04:31.235391 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-64dd-account-create-update-t5j6r" Mar 16 17:04:31 crc kubenswrapper[5120]: I0316 17:04:31.237649 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-db-secret\"" Mar 16 17:04:31 crc kubenswrapper[5120]: I0316 17:04:31.256609 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-16fb-account-create-update-4lmvk" Mar 16 17:04:31 crc kubenswrapper[5120]: I0316 17:04:31.259574 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-64dd-account-create-update-t5j6r"] Mar 16 17:04:31 crc kubenswrapper[5120]: I0316 17:04:31.293336 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v6nns\" (UniqueName: \"kubernetes.io/projected/42ffc217-f12f-401c-a152-5be06f692da5-kube-api-access-v6nns\") pod \"barbican-a4d9-account-create-update-wk6gm\" (UID: \"42ffc217-f12f-401c-a152-5be06f692da5\") " pod="openstack-kuttl-tests/barbican-a4d9-account-create-update-wk6gm" Mar 16 17:04:31 crc kubenswrapper[5120]: I0316 17:04:31.293441 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4gxrd\" (UniqueName: \"kubernetes.io/projected/ee5601d1-7c70-4816-a43f-c43030bcb640-kube-api-access-4gxrd\") pod \"barbican-db-create-52gqt\" (UID: \"ee5601d1-7c70-4816-a43f-c43030bcb640\") " pod="openstack-kuttl-tests/barbican-db-create-52gqt" Mar 16 17:04:31 crc kubenswrapper[5120]: I0316 17:04:31.293613 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/42ffc217-f12f-401c-a152-5be06f692da5-operator-scripts\") pod \"barbican-a4d9-account-create-update-wk6gm\" (UID: \"42ffc217-f12f-401c-a152-5be06f692da5\") " pod="openstack-kuttl-tests/barbican-a4d9-account-create-update-wk6gm" Mar 16 17:04:31 crc kubenswrapper[5120]: I0316 17:04:31.293886 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ee5601d1-7c70-4816-a43f-c43030bcb640-operator-scripts\") pod \"barbican-db-create-52gqt\" (UID: \"ee5601d1-7c70-4816-a43f-c43030bcb640\") " pod="openstack-kuttl-tests/barbican-db-create-52gqt" Mar 16 17:04:31 crc kubenswrapper[5120]: I0316 17:04:31.294715 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ee5601d1-7c70-4816-a43f-c43030bcb640-operator-scripts\") pod \"barbican-db-create-52gqt\" (UID: \"ee5601d1-7c70-4816-a43f-c43030bcb640\") " pod="openstack-kuttl-tests/barbican-db-create-52gqt" Mar 16 17:04:31 crc kubenswrapper[5120]: I0316 17:04:31.296721 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/42ffc217-f12f-401c-a152-5be06f692da5-operator-scripts\") pod \"barbican-a4d9-account-create-update-wk6gm\" (UID: \"42ffc217-f12f-401c-a152-5be06f692da5\") " pod="openstack-kuttl-tests/barbican-a4d9-account-create-update-wk6gm" Mar 16 17:04:31 crc kubenswrapper[5120]: I0316 17:04:31.301694 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-marketplace-7dnrp"] Mar 16 17:04:31 crc kubenswrapper[5120]: I0316 17:04:31.322483 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6nns\" (UniqueName: \"kubernetes.io/projected/42ffc217-f12f-401c-a152-5be06f692da5-kube-api-access-v6nns\") pod \"barbican-a4d9-account-create-update-wk6gm\" (UID: \"42ffc217-f12f-401c-a152-5be06f692da5\") " pod="openstack-kuttl-tests/barbican-a4d9-account-create-update-wk6gm" Mar 16 17:04:31 crc kubenswrapper[5120]: I0316 17:04:31.323046 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gxrd\" (UniqueName: \"kubernetes.io/projected/ee5601d1-7c70-4816-a43f-c43030bcb640-kube-api-access-4gxrd\") pod \"barbican-db-create-52gqt\" (UID: \"ee5601d1-7c70-4816-a43f-c43030bcb640\") " pod="openstack-kuttl-tests/barbican-db-create-52gqt" Mar 16 17:04:31 crc kubenswrapper[5120]: I0316 17:04:31.364241 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-create-s6gpg" Mar 16 17:04:31 crc kubenswrapper[5120]: I0316 17:04:31.395812 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/49bacc96-e90b-4510-b47a-5012b3d7988e-combined-ca-bundle\") pod \"keystone-db-sync-pps9b\" (UID: \"49bacc96-e90b-4510-b47a-5012b3d7988e\") " pod="openstack-kuttl-tests/keystone-db-sync-pps9b" Mar 16 17:04:31 crc kubenswrapper[5120]: I0316 17:04:31.395919 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqbzf\" (UniqueName: \"kubernetes.io/projected/49bacc96-e90b-4510-b47a-5012b3d7988e-kube-api-access-xqbzf\") pod \"keystone-db-sync-pps9b\" (UID: \"49bacc96-e90b-4510-b47a-5012b3d7988e\") " pod="openstack-kuttl-tests/keystone-db-sync-pps9b" Mar 16 17:04:31 crc kubenswrapper[5120]: I0316 17:04:31.395941 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/49bacc96-e90b-4510-b47a-5012b3d7988e-config-data\") pod \"keystone-db-sync-pps9b\" (UID: \"49bacc96-e90b-4510-b47a-5012b3d7988e\") " pod="openstack-kuttl-tests/keystone-db-sync-pps9b" Mar 16 17:04:31 crc kubenswrapper[5120]: I0316 17:04:31.396027 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2425\" (UniqueName: \"kubernetes.io/projected/4fd979d4-32ca-4d12-977d-e9afea46b929-kube-api-access-t2425\") pod \"neutron-64dd-account-create-update-t5j6r\" (UID: \"4fd979d4-32ca-4d12-977d-e9afea46b929\") " pod="openstack-kuttl-tests/neutron-64dd-account-create-update-t5j6r" Mar 16 17:04:31 crc kubenswrapper[5120]: I0316 17:04:31.396091 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/4fd979d4-32ca-4d12-977d-e9afea46b929-operator-scripts\") pod \"neutron-64dd-account-create-update-t5j6r\" (UID: \"4fd979d4-32ca-4d12-977d-e9afea46b929\") " pod="openstack-kuttl-tests/neutron-64dd-account-create-update-t5j6r" Mar 16 17:04:31 crc kubenswrapper[5120]: I0316 17:04:31.498922 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xqbzf\" (UniqueName: \"kubernetes.io/projected/49bacc96-e90b-4510-b47a-5012b3d7988e-kube-api-access-xqbzf\") pod \"keystone-db-sync-pps9b\" (UID: \"49bacc96-e90b-4510-b47a-5012b3d7988e\") " pod="openstack-kuttl-tests/keystone-db-sync-pps9b" Mar 16 17:04:31 crc kubenswrapper[5120]: I0316 17:04:31.499002 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/49bacc96-e90b-4510-b47a-5012b3d7988e-config-data\") pod \"keystone-db-sync-pps9b\" (UID: \"49bacc96-e90b-4510-b47a-5012b3d7988e\") " pod="openstack-kuttl-tests/keystone-db-sync-pps9b" Mar 16 17:04:31 crc kubenswrapper[5120]: I0316 17:04:31.499132 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t2425\" (UniqueName: \"kubernetes.io/projected/4fd979d4-32ca-4d12-977d-e9afea46b929-kube-api-access-t2425\") pod \"neutron-64dd-account-create-update-t5j6r\" (UID: \"4fd979d4-32ca-4d12-977d-e9afea46b929\") " pod="openstack-kuttl-tests/neutron-64dd-account-create-update-t5j6r" Mar 16 17:04:31 crc kubenswrapper[5120]: I0316 17:04:31.499230 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/4fd979d4-32ca-4d12-977d-e9afea46b929-operator-scripts\") pod \"neutron-64dd-account-create-update-t5j6r\" (UID: \"4fd979d4-32ca-4d12-977d-e9afea46b929\") " pod="openstack-kuttl-tests/neutron-64dd-account-create-update-t5j6r" Mar 16 17:04:31 crc kubenswrapper[5120]: I0316 17:04:31.499429 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/49bacc96-e90b-4510-b47a-5012b3d7988e-combined-ca-bundle\") pod \"keystone-db-sync-pps9b\" (UID: \"49bacc96-e90b-4510-b47a-5012b3d7988e\") " pod="openstack-kuttl-tests/keystone-db-sync-pps9b" Mar 16 17:04:31 crc kubenswrapper[5120]: I0316 17:04:31.500598 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/4fd979d4-32ca-4d12-977d-e9afea46b929-operator-scripts\") pod \"neutron-64dd-account-create-update-t5j6r\" (UID: \"4fd979d4-32ca-4d12-977d-e9afea46b929\") " pod="openstack-kuttl-tests/neutron-64dd-account-create-update-t5j6r" Mar 16 17:04:31 crc kubenswrapper[5120]: I0316 17:04:31.506771 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-create-52gqt" Mar 16 17:04:31 crc kubenswrapper[5120]: I0316 17:04:31.509250 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/49bacc96-e90b-4510-b47a-5012b3d7988e-combined-ca-bundle\") pod \"keystone-db-sync-pps9b\" (UID: \"49bacc96-e90b-4510-b47a-5012b3d7988e\") " pod="openstack-kuttl-tests/keystone-db-sync-pps9b" Mar 16 17:04:31 crc kubenswrapper[5120]: I0316 17:04:31.510577 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/49bacc96-e90b-4510-b47a-5012b3d7988e-config-data\") pod \"keystone-db-sync-pps9b\" (UID: \"49bacc96-e90b-4510-b47a-5012b3d7988e\") " pod="openstack-kuttl-tests/keystone-db-sync-pps9b" Mar 16 17:04:31 crc kubenswrapper[5120]: I0316 17:04:31.523388 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqbzf\" (UniqueName: \"kubernetes.io/projected/49bacc96-e90b-4510-b47a-5012b3d7988e-kube-api-access-xqbzf\") pod \"keystone-db-sync-pps9b\" (UID: \"49bacc96-e90b-4510-b47a-5012b3d7988e\") " pod="openstack-kuttl-tests/keystone-db-sync-pps9b" Mar 16 17:04:31 crc kubenswrapper[5120]: I0316 17:04:31.524589 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2425\" (UniqueName: \"kubernetes.io/projected/4fd979d4-32ca-4d12-977d-e9afea46b929-kube-api-access-t2425\") pod \"neutron-64dd-account-create-update-t5j6r\" (UID: \"4fd979d4-32ca-4d12-977d-e9afea46b929\") " pod="openstack-kuttl-tests/neutron-64dd-account-create-update-t5j6r" Mar 16 17:04:31 crc kubenswrapper[5120]: I0316 17:04:31.563244 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-a4d9-account-create-update-wk6gm" Mar 16 17:04:31 crc kubenswrapper[5120]: I0316 17:04:31.578072 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-pps9b" Mar 16 17:04:31 crc kubenswrapper[5120]: I0316 17:04:31.596851 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-64dd-account-create-update-t5j6r" Mar 16 17:04:31 crc kubenswrapper[5120]: I0316 17:04:31.798980 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-db-create-xjpbh"] Mar 16 17:04:31 crc kubenswrapper[5120]: W0316 17:04:31.816664 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3bc621ac_57fe_4689_ac4d_cd47b0909a03.slice/crio-37e01acb6b9bea5c00c9eeae4bb3bfa334c57fec90dfa96420fb6be67ff2f0ed WatchSource:0}: Error finding container 37e01acb6b9bea5c00c9eeae4bb3bfa334c57fec90dfa96420fb6be67ff2f0ed: Status 404 returned error can't find the container with id 37e01acb6b9bea5c00c9eeae4bb3bfa334c57fec90dfa96420fb6be67ff2f0ed Mar 16 17:04:31 crc kubenswrapper[5120]: I0316 17:04:31.875798 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-16fb-account-create-update-4lmvk"] Mar 16 17:04:31 crc kubenswrapper[5120]: W0316 17:04:31.879359 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1abe87e9_49d9_4da3_bfb2_e0aa5d891a71.slice/crio-50791c4a84c71f3d78c4fddff2ac44b8d8083823f2e43d557a6f72299a6be004 WatchSource:0}: Error finding container 50791c4a84c71f3d78c4fddff2ac44b8d8083823f2e43d557a6f72299a6be004: Status 404 returned error can't find the container with id 50791c4a84c71f3d78c4fddff2ac44b8d8083823f2e43d557a6f72299a6be004 Mar 16 17:04:31 crc kubenswrapper[5120]: I0316 17:04:31.949347 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-db-create-s6gpg"] Mar 16 17:04:32 crc kubenswrapper[5120]: I0316 17:04:32.082888 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-db-create-52gqt"] Mar 16 17:04:32 crc kubenswrapper[5120]: W0316 17:04:32.090474 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podee5601d1_7c70_4816_a43f_c43030bcb640.slice/crio-d676ba90f21aa35bd3298f0b56eb02941182048b6da8377b194ef536738cc511 WatchSource:0}: Error finding container d676ba90f21aa35bd3298f0b56eb02941182048b6da8377b194ef536738cc511: Status 404 returned error can't find the container with id d676ba90f21aa35bd3298f0b56eb02941182048b6da8377b194ef536738cc511 Mar 16 17:04:32 crc kubenswrapper[5120]: I0316 17:04:32.184609 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-64dd-account-create-update-t5j6r"] Mar 16 17:04:32 crc kubenswrapper[5120]: I0316 17:04:32.210009 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-pps9b"] Mar 16 17:04:32 crc kubenswrapper[5120]: I0316 17:04:32.229060 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-a4d9-account-create-update-wk6gm"] Mar 16 17:04:32 crc kubenswrapper[5120]: W0316 17:04:32.255014 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod49bacc96_e90b_4510_b47a_5012b3d7988e.slice/crio-561486e1ef3f575454eca22f3b4b6147fa6b4ada453e7816b4f8adddb6ae7139 WatchSource:0}: Error finding container 561486e1ef3f575454eca22f3b4b6147fa6b4ada453e7816b4f8adddb6ae7139: Status 404 returned error can't find the container with id 561486e1ef3f575454eca22f3b4b6147fa6b4ada453e7816b4f8adddb6ae7139 Mar 16 17:04:32 crc kubenswrapper[5120]: I0316 17:04:32.678694 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d4d1258a-d21b-48af-ac55-d36aa473d0ad" path="/var/lib/kubelet/pods/d4d1258a-d21b-48af-ac55-d36aa473d0ad/volumes" Mar 16 17:04:32 crc kubenswrapper[5120]: I0316 17:04:32.681185 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-pps9b" event={"ID":"49bacc96-e90b-4510-b47a-5012b3d7988e","Type":"ContainerStarted","Data":"94554d84ae0a270229130fd9933c51b22c8f24ecd4373c32ab36d2621bff039a"} Mar 16 17:04:32 crc kubenswrapper[5120]: I0316 17:04:32.681220 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-pps9b" event={"ID":"49bacc96-e90b-4510-b47a-5012b3d7988e","Type":"ContainerStarted","Data":"561486e1ef3f575454eca22f3b4b6147fa6b4ada453e7816b4f8adddb6ae7139"} Mar 16 17:04:32 crc kubenswrapper[5120]: I0316 17:04:32.683500 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-create-xjpbh" event={"ID":"3bc621ac-57fe-4689-ac4d-cd47b0909a03","Type":"ContainerStarted","Data":"2639d28a5861875f09fc04a1d7456f74ed4ca9d395f83f21c6c1d464036a0b0f"} Mar 16 17:04:32 crc kubenswrapper[5120]: I0316 17:04:32.683527 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-create-xjpbh" event={"ID":"3bc621ac-57fe-4689-ac4d-cd47b0909a03","Type":"ContainerStarted","Data":"37e01acb6b9bea5c00c9eeae4bb3bfa334c57fec90dfa96420fb6be67ff2f0ed"} Mar 16 17:04:32 crc kubenswrapper[5120]: I0316 17:04:32.685420 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-64dd-account-create-update-t5j6r" event={"ID":"4fd979d4-32ca-4d12-977d-e9afea46b929","Type":"ContainerStarted","Data":"4cc160f72df41a9f00d1fb6b2a2de67301502f27dfe9f93c6bdcf983ec3fd934"} Mar 16 17:04:32 crc kubenswrapper[5120]: I0316 17:04:32.685444 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-64dd-account-create-update-t5j6r" event={"ID":"4fd979d4-32ca-4d12-977d-e9afea46b929","Type":"ContainerStarted","Data":"50cc15ea4b6e2de607dfd261e812db918bf01ea68bd543515dc91511de9f7ab2"} Mar 16 17:04:32 crc kubenswrapper[5120]: I0316 17:04:32.686969 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-16fb-account-create-update-4lmvk" event={"ID":"1abe87e9-49d9-4da3-bfb2-e0aa5d891a71","Type":"ContainerStarted","Data":"f8f1e81860d9d8e752ebcc95a60379adddcc03a54feb00474f4891bbb2eaed18"} Mar 16 17:04:32 crc kubenswrapper[5120]: I0316 17:04:32.687007 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-16fb-account-create-update-4lmvk" event={"ID":"1abe87e9-49d9-4da3-bfb2-e0aa5d891a71","Type":"ContainerStarted","Data":"50791c4a84c71f3d78c4fddff2ac44b8d8083823f2e43d557a6f72299a6be004"} Mar 16 17:04:32 crc kubenswrapper[5120]: I0316 17:04:32.688462 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-create-52gqt" event={"ID":"ee5601d1-7c70-4816-a43f-c43030bcb640","Type":"ContainerStarted","Data":"ac31c458a23a7c88a468103329903e25f76c14611b2ee2fe488d13901859dba4"} Mar 16 17:04:32 crc kubenswrapper[5120]: I0316 17:04:32.688489 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-create-52gqt" event={"ID":"ee5601d1-7c70-4816-a43f-c43030bcb640","Type":"ContainerStarted","Data":"d676ba90f21aa35bd3298f0b56eb02941182048b6da8377b194ef536738cc511"} Mar 16 17:04:32 crc kubenswrapper[5120]: I0316 17:04:32.690535 5120 generic.go:358] "Generic (PLEG): container finished" podID="f91eb2a7-c2b0-42c9-abf5-a3904c2b2eeb" containerID="f5a36233b998399b8509375b165a56525bdd7456350061623e0fe86d2c84166b" exitCode=0 Mar 16 17:04:32 crc kubenswrapper[5120]: I0316 17:04:32.690780 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-create-s6gpg" event={"ID":"f91eb2a7-c2b0-42c9-abf5-a3904c2b2eeb","Type":"ContainerDied","Data":"f5a36233b998399b8509375b165a56525bdd7456350061623e0fe86d2c84166b"} Mar 16 17:04:32 crc kubenswrapper[5120]: I0316 17:04:32.690803 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-create-s6gpg" event={"ID":"f91eb2a7-c2b0-42c9-abf5-a3904c2b2eeb","Type":"ContainerStarted","Data":"1c64b7ace9e441c98c3a80f1f83e8255660906d27b7387551a36b63bfa63b441"} Mar 16 17:04:32 crc kubenswrapper[5120]: I0316 17:04:32.692408 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-marketplace/redhat-marketplace-7dnrp" podUID="c5f2c866-0f0f-473e-aeb3-00e4d9df0b70" containerName="registry-server" containerID="cri-o://0ce9b890bc505fe6bf47aead2d5e90a9ebb599e3cb660bcef2cd172362a348d4" gracePeriod=2 Mar 16 17:04:32 crc kubenswrapper[5120]: I0316 17:04:32.693220 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-a4d9-account-create-update-wk6gm" event={"ID":"42ffc217-f12f-401c-a152-5be06f692da5","Type":"ContainerStarted","Data":"6b92a7c8ef21eca1c42f0c68768f5875e49ca7306cf74cf2db4fd0b787c9798d"} Mar 16 17:04:32 crc kubenswrapper[5120]: I0316 17:04:32.693249 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-a4d9-account-create-update-wk6gm" event={"ID":"42ffc217-f12f-401c-a152-5be06f692da5","Type":"ContainerStarted","Data":"99c7ab2799315a7187ef723c72db2e79328f36d9be3aca1ef7da292c1c738b05"} Mar 16 17:04:32 crc kubenswrapper[5120]: I0316 17:04:32.729118 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-db-sync-pps9b" podStartSLOduration=1.729098076 podStartE2EDuration="1.729098076s" podCreationTimestamp="2026-03-16 17:04:31 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:04:32.705809222 +0000 UTC m=+5574.859740879" watchObservedRunningTime="2026-03-16 17:04:32.729098076 +0000 UTC m=+5574.883029733" Mar 16 17:04:32 crc kubenswrapper[5120]: I0316 17:04:32.756782 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-64dd-account-create-update-t5j6r" podStartSLOduration=1.7567459890000001 podStartE2EDuration="1.756745989s" podCreationTimestamp="2026-03-16 17:04:31 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:04:32.749580241 +0000 UTC m=+5574.903511888" watchObservedRunningTime="2026-03-16 17:04:32.756745989 +0000 UTC m=+5574.910677646" Mar 16 17:04:32 crc kubenswrapper[5120]: I0316 17:04:32.757341 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-16fb-account-create-update-4lmvk" podStartSLOduration=2.757334036 podStartE2EDuration="2.757334036s" podCreationTimestamp="2026-03-16 17:04:30 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:04:32.722675058 +0000 UTC m=+5574.876606715" watchObservedRunningTime="2026-03-16 17:04:32.757334036 +0000 UTC m=+5574.911265693" Mar 16 17:04:32 crc kubenswrapper[5120]: I0316 17:04:32.767315 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-db-create-xjpbh" podStartSLOduration=2.767297981 podStartE2EDuration="2.767297981s" podCreationTimestamp="2026-03-16 17:04:30 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:04:32.766733895 +0000 UTC m=+5574.920665552" watchObservedRunningTime="2026-03-16 17:04:32.767297981 +0000 UTC m=+5574.921229638" Mar 16 17:04:32 crc kubenswrapper[5120]: I0316 17:04:32.791991 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-a4d9-account-create-update-wk6gm" podStartSLOduration=1.791972582 podStartE2EDuration="1.791972582s" podCreationTimestamp="2026-03-16 17:04:31 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:04:32.785164265 +0000 UTC m=+5574.939095932" watchObservedRunningTime="2026-03-16 17:04:32.791972582 +0000 UTC m=+5574.945904239" Mar 16 17:04:32 crc kubenswrapper[5120]: I0316 17:04:32.803568 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-db-create-52gqt" podStartSLOduration=1.803545953 podStartE2EDuration="1.803545953s" podCreationTimestamp="2026-03-16 17:04:31 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:04:32.799209763 +0000 UTC m=+5574.953141420" watchObservedRunningTime="2026-03-16 17:04:32.803545953 +0000 UTC m=+5574.957477600" Mar 16 17:04:33 crc kubenswrapper[5120]: I0316 17:04:33.258629 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-7dnrp" Mar 16 17:04:33 crc kubenswrapper[5120]: I0316 17:04:33.275658 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vdgt7\" (UniqueName: \"kubernetes.io/projected/c5f2c866-0f0f-473e-aeb3-00e4d9df0b70-kube-api-access-vdgt7\") pod \"c5f2c866-0f0f-473e-aeb3-00e4d9df0b70\" (UID: \"c5f2c866-0f0f-473e-aeb3-00e4d9df0b70\") " Mar 16 17:04:33 crc kubenswrapper[5120]: I0316 17:04:33.275782 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/c5f2c866-0f0f-473e-aeb3-00e4d9df0b70-utilities\") pod \"c5f2c866-0f0f-473e-aeb3-00e4d9df0b70\" (UID: \"c5f2c866-0f0f-473e-aeb3-00e4d9df0b70\") " Mar 16 17:04:33 crc kubenswrapper[5120]: I0316 17:04:33.275891 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/c5f2c866-0f0f-473e-aeb3-00e4d9df0b70-catalog-content\") pod \"c5f2c866-0f0f-473e-aeb3-00e4d9df0b70\" (UID: \"c5f2c866-0f0f-473e-aeb3-00e4d9df0b70\") " Mar 16 17:04:33 crc kubenswrapper[5120]: I0316 17:04:33.276967 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5f2c866-0f0f-473e-aeb3-00e4d9df0b70-utilities" (OuterVolumeSpecName: "utilities") pod "c5f2c866-0f0f-473e-aeb3-00e4d9df0b70" (UID: "c5f2c866-0f0f-473e-aeb3-00e4d9df0b70"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:04:33 crc kubenswrapper[5120]: I0316 17:04:33.294784 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5f2c866-0f0f-473e-aeb3-00e4d9df0b70-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "c5f2c866-0f0f-473e-aeb3-00e4d9df0b70" (UID: "c5f2c866-0f0f-473e-aeb3-00e4d9df0b70"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:04:33 crc kubenswrapper[5120]: I0316 17:04:33.324228 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5f2c866-0f0f-473e-aeb3-00e4d9df0b70-kube-api-access-vdgt7" (OuterVolumeSpecName: "kube-api-access-vdgt7") pod "c5f2c866-0f0f-473e-aeb3-00e4d9df0b70" (UID: "c5f2c866-0f0f-473e-aeb3-00e4d9df0b70"). InnerVolumeSpecName "kube-api-access-vdgt7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:04:33 crc kubenswrapper[5120]: I0316 17:04:33.379117 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vdgt7\" (UniqueName: \"kubernetes.io/projected/c5f2c866-0f0f-473e-aeb3-00e4d9df0b70-kube-api-access-vdgt7\") on node \"crc\" DevicePath \"\"" Mar 16 17:04:33 crc kubenswrapper[5120]: I0316 17:04:33.379165 5120 reconciler_common.go:299] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/c5f2c866-0f0f-473e-aeb3-00e4d9df0b70-utilities\") on node \"crc\" DevicePath \"\"" Mar 16 17:04:33 crc kubenswrapper[5120]: I0316 17:04:33.379180 5120 reconciler_common.go:299] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/c5f2c866-0f0f-473e-aeb3-00e4d9df0b70-catalog-content\") on node \"crc\" DevicePath \"\"" Mar 16 17:04:33 crc kubenswrapper[5120]: I0316 17:04:33.703303 5120 generic.go:358] "Generic (PLEG): container finished" podID="3bc621ac-57fe-4689-ac4d-cd47b0909a03" containerID="2639d28a5861875f09fc04a1d7456f74ed4ca9d395f83f21c6c1d464036a0b0f" exitCode=0 Mar 16 17:04:33 crc kubenswrapper[5120]: I0316 17:04:33.703499 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-create-xjpbh" event={"ID":"3bc621ac-57fe-4689-ac4d-cd47b0909a03","Type":"ContainerDied","Data":"2639d28a5861875f09fc04a1d7456f74ed4ca9d395f83f21c6c1d464036a0b0f"} Mar 16 17:04:33 crc kubenswrapper[5120]: I0316 17:04:33.706632 5120 generic.go:358] "Generic (PLEG): container finished" podID="4fd979d4-32ca-4d12-977d-e9afea46b929" containerID="4cc160f72df41a9f00d1fb6b2a2de67301502f27dfe9f93c6bdcf983ec3fd934" exitCode=0 Mar 16 17:04:33 crc kubenswrapper[5120]: I0316 17:04:33.706810 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-64dd-account-create-update-t5j6r" event={"ID":"4fd979d4-32ca-4d12-977d-e9afea46b929","Type":"ContainerDied","Data":"4cc160f72df41a9f00d1fb6b2a2de67301502f27dfe9f93c6bdcf983ec3fd934"} Mar 16 17:04:33 crc kubenswrapper[5120]: I0316 17:04:33.709061 5120 generic.go:358] "Generic (PLEG): container finished" podID="1abe87e9-49d9-4da3-bfb2-e0aa5d891a71" containerID="f8f1e81860d9d8e752ebcc95a60379adddcc03a54feb00474f4891bbb2eaed18" exitCode=0 Mar 16 17:04:33 crc kubenswrapper[5120]: I0316 17:04:33.709203 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-16fb-account-create-update-4lmvk" event={"ID":"1abe87e9-49d9-4da3-bfb2-e0aa5d891a71","Type":"ContainerDied","Data":"f8f1e81860d9d8e752ebcc95a60379adddcc03a54feb00474f4891bbb2eaed18"} Mar 16 17:04:33 crc kubenswrapper[5120]: I0316 17:04:33.710562 5120 generic.go:358] "Generic (PLEG): container finished" podID="ee5601d1-7c70-4816-a43f-c43030bcb640" containerID="ac31c458a23a7c88a468103329903e25f76c14611b2ee2fe488d13901859dba4" exitCode=0 Mar 16 17:04:33 crc kubenswrapper[5120]: I0316 17:04:33.710702 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-create-52gqt" event={"ID":"ee5601d1-7c70-4816-a43f-c43030bcb640","Type":"ContainerDied","Data":"ac31c458a23a7c88a468103329903e25f76c14611b2ee2fe488d13901859dba4"} Mar 16 17:04:33 crc kubenswrapper[5120]: I0316 17:04:33.712803 5120 generic.go:358] "Generic (PLEG): container finished" podID="42ffc217-f12f-401c-a152-5be06f692da5" containerID="6b92a7c8ef21eca1c42f0c68768f5875e49ca7306cf74cf2db4fd0b787c9798d" exitCode=0 Mar 16 17:04:33 crc kubenswrapper[5120]: I0316 17:04:33.712938 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-a4d9-account-create-update-wk6gm" event={"ID":"42ffc217-f12f-401c-a152-5be06f692da5","Type":"ContainerDied","Data":"6b92a7c8ef21eca1c42f0c68768f5875e49ca7306cf74cf2db4fd0b787c9798d"} Mar 16 17:04:33 crc kubenswrapper[5120]: I0316 17:04:33.715065 5120 generic.go:358] "Generic (PLEG): container finished" podID="c5f2c866-0f0f-473e-aeb3-00e4d9df0b70" containerID="0ce9b890bc505fe6bf47aead2d5e90a9ebb599e3cb660bcef2cd172362a348d4" exitCode=0 Mar 16 17:04:33 crc kubenswrapper[5120]: I0316 17:04:33.715191 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-7dnrp" event={"ID":"c5f2c866-0f0f-473e-aeb3-00e4d9df0b70","Type":"ContainerDied","Data":"0ce9b890bc505fe6bf47aead2d5e90a9ebb599e3cb660bcef2cd172362a348d4"} Mar 16 17:04:33 crc kubenswrapper[5120]: I0316 17:04:33.715242 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-7dnrp" event={"ID":"c5f2c866-0f0f-473e-aeb3-00e4d9df0b70","Type":"ContainerDied","Data":"429f51108374d9572e375b38e20543890c31989d5ffe2109d67df34038cca1d8"} Mar 16 17:04:33 crc kubenswrapper[5120]: I0316 17:04:33.715264 5120 scope.go:117] "RemoveContainer" containerID="0ce9b890bc505fe6bf47aead2d5e90a9ebb599e3cb660bcef2cd172362a348d4" Mar 16 17:04:33 crc kubenswrapper[5120]: I0316 17:04:33.715508 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-7dnrp" Mar 16 17:04:33 crc kubenswrapper[5120]: I0316 17:04:33.768673 5120 scope.go:117] "RemoveContainer" containerID="2b0b8779853fcd51ea7b4563fd104bf3052138c86ac51e0e376398e41a00eb04" Mar 16 17:04:33 crc kubenswrapper[5120]: I0316 17:04:33.832071 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-marketplace-7dnrp"] Mar 16 17:04:33 crc kubenswrapper[5120]: I0316 17:04:33.837726 5120 scope.go:117] "RemoveContainer" containerID="0e310fc5ae84bdef7574e66297f8f5bd0cf5452abcbc9dda4614705c27dc7e3b" Mar 16 17:04:33 crc kubenswrapper[5120]: I0316 17:04:33.848348 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/redhat-marketplace-7dnrp"] Mar 16 17:04:33 crc kubenswrapper[5120]: I0316 17:04:33.867232 5120 scope.go:117] "RemoveContainer" containerID="0ce9b890bc505fe6bf47aead2d5e90a9ebb599e3cb660bcef2cd172362a348d4" Mar 16 17:04:33 crc kubenswrapper[5120]: E0316 17:04:33.867693 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0ce9b890bc505fe6bf47aead2d5e90a9ebb599e3cb660bcef2cd172362a348d4\": container with ID starting with 0ce9b890bc505fe6bf47aead2d5e90a9ebb599e3cb660bcef2cd172362a348d4 not found: ID does not exist" containerID="0ce9b890bc505fe6bf47aead2d5e90a9ebb599e3cb660bcef2cd172362a348d4" Mar 16 17:04:33 crc kubenswrapper[5120]: I0316 17:04:33.867716 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ce9b890bc505fe6bf47aead2d5e90a9ebb599e3cb660bcef2cd172362a348d4"} err="failed to get container status \"0ce9b890bc505fe6bf47aead2d5e90a9ebb599e3cb660bcef2cd172362a348d4\": rpc error: code = NotFound desc = could not find container \"0ce9b890bc505fe6bf47aead2d5e90a9ebb599e3cb660bcef2cd172362a348d4\": container with ID starting with 0ce9b890bc505fe6bf47aead2d5e90a9ebb599e3cb660bcef2cd172362a348d4 not found: ID does not exist" Mar 16 17:04:33 crc kubenswrapper[5120]: I0316 17:04:33.867736 5120 scope.go:117] "RemoveContainer" containerID="2b0b8779853fcd51ea7b4563fd104bf3052138c86ac51e0e376398e41a00eb04" Mar 16 17:04:33 crc kubenswrapper[5120]: E0316 17:04:33.868846 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b0b8779853fcd51ea7b4563fd104bf3052138c86ac51e0e376398e41a00eb04\": container with ID starting with 2b0b8779853fcd51ea7b4563fd104bf3052138c86ac51e0e376398e41a00eb04 not found: ID does not exist" containerID="2b0b8779853fcd51ea7b4563fd104bf3052138c86ac51e0e376398e41a00eb04" Mar 16 17:04:33 crc kubenswrapper[5120]: I0316 17:04:33.868867 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b0b8779853fcd51ea7b4563fd104bf3052138c86ac51e0e376398e41a00eb04"} err="failed to get container status \"2b0b8779853fcd51ea7b4563fd104bf3052138c86ac51e0e376398e41a00eb04\": rpc error: code = NotFound desc = could not find container \"2b0b8779853fcd51ea7b4563fd104bf3052138c86ac51e0e376398e41a00eb04\": container with ID starting with 2b0b8779853fcd51ea7b4563fd104bf3052138c86ac51e0e376398e41a00eb04 not found: ID does not exist" Mar 16 17:04:33 crc kubenswrapper[5120]: I0316 17:04:33.868880 5120 scope.go:117] "RemoveContainer" containerID="0e310fc5ae84bdef7574e66297f8f5bd0cf5452abcbc9dda4614705c27dc7e3b" Mar 16 17:04:33 crc kubenswrapper[5120]: E0316 17:04:33.869155 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0e310fc5ae84bdef7574e66297f8f5bd0cf5452abcbc9dda4614705c27dc7e3b\": container with ID starting with 0e310fc5ae84bdef7574e66297f8f5bd0cf5452abcbc9dda4614705c27dc7e3b not found: ID does not exist" containerID="0e310fc5ae84bdef7574e66297f8f5bd0cf5452abcbc9dda4614705c27dc7e3b" Mar 16 17:04:33 crc kubenswrapper[5120]: I0316 17:04:33.869172 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e310fc5ae84bdef7574e66297f8f5bd0cf5452abcbc9dda4614705c27dc7e3b"} err="failed to get container status \"0e310fc5ae84bdef7574e66297f8f5bd0cf5452abcbc9dda4614705c27dc7e3b\": rpc error: code = NotFound desc = could not find container \"0e310fc5ae84bdef7574e66297f8f5bd0cf5452abcbc9dda4614705c27dc7e3b\": container with ID starting with 0e310fc5ae84bdef7574e66297f8f5bd0cf5452abcbc9dda4614705c27dc7e3b not found: ID does not exist" Mar 16 17:04:34 crc kubenswrapper[5120]: I0316 17:04:34.216638 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-create-s6gpg" Mar 16 17:04:34 crc kubenswrapper[5120]: I0316 17:04:34.300356 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-drvz9\" (UniqueName: \"kubernetes.io/projected/f91eb2a7-c2b0-42c9-abf5-a3904c2b2eeb-kube-api-access-drvz9\") pod \"f91eb2a7-c2b0-42c9-abf5-a3904c2b2eeb\" (UID: \"f91eb2a7-c2b0-42c9-abf5-a3904c2b2eeb\") " Mar 16 17:04:34 crc kubenswrapper[5120]: I0316 17:04:34.300522 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f91eb2a7-c2b0-42c9-abf5-a3904c2b2eeb-operator-scripts\") pod \"f91eb2a7-c2b0-42c9-abf5-a3904c2b2eeb\" (UID: \"f91eb2a7-c2b0-42c9-abf5-a3904c2b2eeb\") " Mar 16 17:04:34 crc kubenswrapper[5120]: I0316 17:04:34.301507 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f91eb2a7-c2b0-42c9-abf5-a3904c2b2eeb-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "f91eb2a7-c2b0-42c9-abf5-a3904c2b2eeb" (UID: "f91eb2a7-c2b0-42c9-abf5-a3904c2b2eeb"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:04:34 crc kubenswrapper[5120]: I0316 17:04:34.305257 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f91eb2a7-c2b0-42c9-abf5-a3904c2b2eeb-kube-api-access-drvz9" (OuterVolumeSpecName: "kube-api-access-drvz9") pod "f91eb2a7-c2b0-42c9-abf5-a3904c2b2eeb" (UID: "f91eb2a7-c2b0-42c9-abf5-a3904c2b2eeb"). InnerVolumeSpecName "kube-api-access-drvz9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:04:34 crc kubenswrapper[5120]: I0316 17:04:34.402890 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-drvz9\" (UniqueName: \"kubernetes.io/projected/f91eb2a7-c2b0-42c9-abf5-a3904c2b2eeb-kube-api-access-drvz9\") on node \"crc\" DevicePath \"\"" Mar 16 17:04:34 crc kubenswrapper[5120]: I0316 17:04:34.403207 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f91eb2a7-c2b0-42c9-abf5-a3904c2b2eeb-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:04:34 crc kubenswrapper[5120]: I0316 17:04:34.673447 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c5f2c866-0f0f-473e-aeb3-00e4d9df0b70" path="/var/lib/kubelet/pods/c5f2c866-0f0f-473e-aeb3-00e4d9df0b70/volumes" Mar 16 17:04:34 crc kubenswrapper[5120]: I0316 17:04:34.728774 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-create-s6gpg" Mar 16 17:04:34 crc kubenswrapper[5120]: I0316 17:04:34.728801 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-create-s6gpg" event={"ID":"f91eb2a7-c2b0-42c9-abf5-a3904c2b2eeb","Type":"ContainerDied","Data":"1c64b7ace9e441c98c3a80f1f83e8255660906d27b7387551a36b63bfa63b441"} Mar 16 17:04:34 crc kubenswrapper[5120]: I0316 17:04:34.728853 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1c64b7ace9e441c98c3a80f1f83e8255660906d27b7387551a36b63bfa63b441" Mar 16 17:04:34 crc kubenswrapper[5120]: I0316 17:04:34.734402 5120 generic.go:358] "Generic (PLEG): container finished" podID="49bacc96-e90b-4510-b47a-5012b3d7988e" containerID="94554d84ae0a270229130fd9933c51b22c8f24ecd4373c32ab36d2621bff039a" exitCode=0 Mar 16 17:04:34 crc kubenswrapper[5120]: I0316 17:04:34.734626 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-pps9b" event={"ID":"49bacc96-e90b-4510-b47a-5012b3d7988e","Type":"ContainerDied","Data":"94554d84ae0a270229130fd9933c51b22c8f24ecd4373c32ab36d2621bff039a"} Mar 16 17:04:35 crc kubenswrapper[5120]: I0316 17:04:35.145343 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-a4d9-account-create-update-wk6gm" Mar 16 17:04:35 crc kubenswrapper[5120]: I0316 17:04:35.222106 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/42ffc217-f12f-401c-a152-5be06f692da5-operator-scripts\") pod \"42ffc217-f12f-401c-a152-5be06f692da5\" (UID: \"42ffc217-f12f-401c-a152-5be06f692da5\") " Mar 16 17:04:35 crc kubenswrapper[5120]: I0316 17:04:35.222676 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v6nns\" (UniqueName: \"kubernetes.io/projected/42ffc217-f12f-401c-a152-5be06f692da5-kube-api-access-v6nns\") pod \"42ffc217-f12f-401c-a152-5be06f692da5\" (UID: \"42ffc217-f12f-401c-a152-5be06f692da5\") " Mar 16 17:04:35 crc kubenswrapper[5120]: I0316 17:04:35.223380 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/42ffc217-f12f-401c-a152-5be06f692da5-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "42ffc217-f12f-401c-a152-5be06f692da5" (UID: "42ffc217-f12f-401c-a152-5be06f692da5"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:04:35 crc kubenswrapper[5120]: I0316 17:04:35.226629 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42ffc217-f12f-401c-a152-5be06f692da5-kube-api-access-v6nns" (OuterVolumeSpecName: "kube-api-access-v6nns") pod "42ffc217-f12f-401c-a152-5be06f692da5" (UID: "42ffc217-f12f-401c-a152-5be06f692da5"). InnerVolumeSpecName "kube-api-access-v6nns". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:04:35 crc kubenswrapper[5120]: I0316 17:04:35.300530 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-16fb-account-create-update-4lmvk" Mar 16 17:04:35 crc kubenswrapper[5120]: I0316 17:04:35.308209 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-create-52gqt" Mar 16 17:04:35 crc kubenswrapper[5120]: I0316 17:04:35.321090 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-create-xjpbh" Mar 16 17:04:35 crc kubenswrapper[5120]: I0316 17:04:35.324999 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v6nns\" (UniqueName: \"kubernetes.io/projected/42ffc217-f12f-401c-a152-5be06f692da5-kube-api-access-v6nns\") on node \"crc\" DevicePath \"\"" Mar 16 17:04:35 crc kubenswrapper[5120]: I0316 17:04:35.325026 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/42ffc217-f12f-401c-a152-5be06f692da5-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:04:35 crc kubenswrapper[5120]: I0316 17:04:35.333157 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-64dd-account-create-update-t5j6r" Mar 16 17:04:35 crc kubenswrapper[5120]: I0316 17:04:35.427360 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/1abe87e9-49d9-4da3-bfb2-e0aa5d891a71-operator-scripts\") pod \"1abe87e9-49d9-4da3-bfb2-e0aa5d891a71\" (UID: \"1abe87e9-49d9-4da3-bfb2-e0aa5d891a71\") " Mar 16 17:04:35 crc kubenswrapper[5120]: I0316 17:04:35.427782 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3bc621ac-57fe-4689-ac4d-cd47b0909a03-operator-scripts\") pod \"3bc621ac-57fe-4689-ac4d-cd47b0909a03\" (UID: \"3bc621ac-57fe-4689-ac4d-cd47b0909a03\") " Mar 16 17:04:35 crc kubenswrapper[5120]: I0316 17:04:35.428092 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1abe87e9-49d9-4da3-bfb2-e0aa5d891a71-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "1abe87e9-49d9-4da3-bfb2-e0aa5d891a71" (UID: "1abe87e9-49d9-4da3-bfb2-e0aa5d891a71"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:04:35 crc kubenswrapper[5120]: I0316 17:04:35.428317 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3bc621ac-57fe-4689-ac4d-cd47b0909a03-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "3bc621ac-57fe-4689-ac4d-cd47b0909a03" (UID: "3bc621ac-57fe-4689-ac4d-cd47b0909a03"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:04:35 crc kubenswrapper[5120]: I0316 17:04:35.428612 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t2425\" (UniqueName: \"kubernetes.io/projected/4fd979d4-32ca-4d12-977d-e9afea46b929-kube-api-access-t2425\") pod \"4fd979d4-32ca-4d12-977d-e9afea46b929\" (UID: \"4fd979d4-32ca-4d12-977d-e9afea46b929\") " Mar 16 17:04:35 crc kubenswrapper[5120]: I0316 17:04:35.428698 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4gxrd\" (UniqueName: \"kubernetes.io/projected/ee5601d1-7c70-4816-a43f-c43030bcb640-kube-api-access-4gxrd\") pod \"ee5601d1-7c70-4816-a43f-c43030bcb640\" (UID: \"ee5601d1-7c70-4816-a43f-c43030bcb640\") " Mar 16 17:04:35 crc kubenswrapper[5120]: I0316 17:04:35.428863 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ee5601d1-7c70-4816-a43f-c43030bcb640-operator-scripts\") pod \"ee5601d1-7c70-4816-a43f-c43030bcb640\" (UID: \"ee5601d1-7c70-4816-a43f-c43030bcb640\") " Mar 16 17:04:35 crc kubenswrapper[5120]: I0316 17:04:35.428901 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/4fd979d4-32ca-4d12-977d-e9afea46b929-operator-scripts\") pod \"4fd979d4-32ca-4d12-977d-e9afea46b929\" (UID: \"4fd979d4-32ca-4d12-977d-e9afea46b929\") " Mar 16 17:04:35 crc kubenswrapper[5120]: I0316 17:04:35.428922 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lfp62\" (UniqueName: \"kubernetes.io/projected/3bc621ac-57fe-4689-ac4d-cd47b0909a03-kube-api-access-lfp62\") pod \"3bc621ac-57fe-4689-ac4d-cd47b0909a03\" (UID: \"3bc621ac-57fe-4689-ac4d-cd47b0909a03\") " Mar 16 17:04:35 crc kubenswrapper[5120]: I0316 17:04:35.429027 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wgl8s\" (UniqueName: \"kubernetes.io/projected/1abe87e9-49d9-4da3-bfb2-e0aa5d891a71-kube-api-access-wgl8s\") pod \"1abe87e9-49d9-4da3-bfb2-e0aa5d891a71\" (UID: \"1abe87e9-49d9-4da3-bfb2-e0aa5d891a71\") " Mar 16 17:04:35 crc kubenswrapper[5120]: I0316 17:04:35.429967 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4fd979d4-32ca-4d12-977d-e9afea46b929-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "4fd979d4-32ca-4d12-977d-e9afea46b929" (UID: "4fd979d4-32ca-4d12-977d-e9afea46b929"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:04:35 crc kubenswrapper[5120]: I0316 17:04:35.430074 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ee5601d1-7c70-4816-a43f-c43030bcb640-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "ee5601d1-7c70-4816-a43f-c43030bcb640" (UID: "ee5601d1-7c70-4816-a43f-c43030bcb640"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:04:35 crc kubenswrapper[5120]: I0316 17:04:35.431085 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/1abe87e9-49d9-4da3-bfb2-e0aa5d891a71-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:04:35 crc kubenswrapper[5120]: I0316 17:04:35.431120 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3bc621ac-57fe-4689-ac4d-cd47b0909a03-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:04:35 crc kubenswrapper[5120]: I0316 17:04:35.431133 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ee5601d1-7c70-4816-a43f-c43030bcb640-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:04:35 crc kubenswrapper[5120]: I0316 17:04:35.431149 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/4fd979d4-32ca-4d12-977d-e9afea46b929-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:04:35 crc kubenswrapper[5120]: I0316 17:04:35.432412 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4fd979d4-32ca-4d12-977d-e9afea46b929-kube-api-access-t2425" (OuterVolumeSpecName: "kube-api-access-t2425") pod "4fd979d4-32ca-4d12-977d-e9afea46b929" (UID: "4fd979d4-32ca-4d12-977d-e9afea46b929"). InnerVolumeSpecName "kube-api-access-t2425". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:04:35 crc kubenswrapper[5120]: I0316 17:04:35.432459 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee5601d1-7c70-4816-a43f-c43030bcb640-kube-api-access-4gxrd" (OuterVolumeSpecName: "kube-api-access-4gxrd") pod "ee5601d1-7c70-4816-a43f-c43030bcb640" (UID: "ee5601d1-7c70-4816-a43f-c43030bcb640"). InnerVolumeSpecName "kube-api-access-4gxrd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:04:35 crc kubenswrapper[5120]: I0316 17:04:35.433035 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3bc621ac-57fe-4689-ac4d-cd47b0909a03-kube-api-access-lfp62" (OuterVolumeSpecName: "kube-api-access-lfp62") pod "3bc621ac-57fe-4689-ac4d-cd47b0909a03" (UID: "3bc621ac-57fe-4689-ac4d-cd47b0909a03"). InnerVolumeSpecName "kube-api-access-lfp62". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:04:35 crc kubenswrapper[5120]: I0316 17:04:35.433405 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1abe87e9-49d9-4da3-bfb2-e0aa5d891a71-kube-api-access-wgl8s" (OuterVolumeSpecName: "kube-api-access-wgl8s") pod "1abe87e9-49d9-4da3-bfb2-e0aa5d891a71" (UID: "1abe87e9-49d9-4da3-bfb2-e0aa5d891a71"). InnerVolumeSpecName "kube-api-access-wgl8s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:04:35 crc kubenswrapper[5120]: I0316 17:04:35.533615 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t2425\" (UniqueName: \"kubernetes.io/projected/4fd979d4-32ca-4d12-977d-e9afea46b929-kube-api-access-t2425\") on node \"crc\" DevicePath \"\"" Mar 16 17:04:35 crc kubenswrapper[5120]: I0316 17:04:35.533656 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4gxrd\" (UniqueName: \"kubernetes.io/projected/ee5601d1-7c70-4816-a43f-c43030bcb640-kube-api-access-4gxrd\") on node \"crc\" DevicePath \"\"" Mar 16 17:04:35 crc kubenswrapper[5120]: I0316 17:04:35.533667 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lfp62\" (UniqueName: \"kubernetes.io/projected/3bc621ac-57fe-4689-ac4d-cd47b0909a03-kube-api-access-lfp62\") on node \"crc\" DevicePath \"\"" Mar 16 17:04:35 crc kubenswrapper[5120]: I0316 17:04:35.533676 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wgl8s\" (UniqueName: \"kubernetes.io/projected/1abe87e9-49d9-4da3-bfb2-e0aa5d891a71-kube-api-access-wgl8s\") on node \"crc\" DevicePath \"\"" Mar 16 17:04:35 crc kubenswrapper[5120]: I0316 17:04:35.750669 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-16fb-account-create-update-4lmvk" event={"ID":"1abe87e9-49d9-4da3-bfb2-e0aa5d891a71","Type":"ContainerDied","Data":"50791c4a84c71f3d78c4fddff2ac44b8d8083823f2e43d557a6f72299a6be004"} Mar 16 17:04:35 crc kubenswrapper[5120]: I0316 17:04:35.750715 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="50791c4a84c71f3d78c4fddff2ac44b8d8083823f2e43d557a6f72299a6be004" Mar 16 17:04:35 crc kubenswrapper[5120]: I0316 17:04:35.750870 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-16fb-account-create-update-4lmvk" Mar 16 17:04:35 crc kubenswrapper[5120]: I0316 17:04:35.765674 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-create-52gqt" event={"ID":"ee5601d1-7c70-4816-a43f-c43030bcb640","Type":"ContainerDied","Data":"d676ba90f21aa35bd3298f0b56eb02941182048b6da8377b194ef536738cc511"} Mar 16 17:04:35 crc kubenswrapper[5120]: I0316 17:04:35.765714 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d676ba90f21aa35bd3298f0b56eb02941182048b6da8377b194ef536738cc511" Mar 16 17:04:35 crc kubenswrapper[5120]: I0316 17:04:35.765811 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-create-52gqt" Mar 16 17:04:35 crc kubenswrapper[5120]: I0316 17:04:35.768018 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-a4d9-account-create-update-wk6gm" Mar 16 17:04:35 crc kubenswrapper[5120]: I0316 17:04:35.768065 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-a4d9-account-create-update-wk6gm" event={"ID":"42ffc217-f12f-401c-a152-5be06f692da5","Type":"ContainerDied","Data":"99c7ab2799315a7187ef723c72db2e79328f36d9be3aca1ef7da292c1c738b05"} Mar 16 17:04:35 crc kubenswrapper[5120]: I0316 17:04:35.768106 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="99c7ab2799315a7187ef723c72db2e79328f36d9be3aca1ef7da292c1c738b05" Mar 16 17:04:35 crc kubenswrapper[5120]: I0316 17:04:35.770643 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-create-xjpbh" event={"ID":"3bc621ac-57fe-4689-ac4d-cd47b0909a03","Type":"ContainerDied","Data":"37e01acb6b9bea5c00c9eeae4bb3bfa334c57fec90dfa96420fb6be67ff2f0ed"} Mar 16 17:04:35 crc kubenswrapper[5120]: I0316 17:04:35.770680 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="37e01acb6b9bea5c00c9eeae4bb3bfa334c57fec90dfa96420fb6be67ff2f0ed" Mar 16 17:04:35 crc kubenswrapper[5120]: I0316 17:04:35.770689 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-create-xjpbh" Mar 16 17:04:35 crc kubenswrapper[5120]: I0316 17:04:35.775941 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-64dd-account-create-update-t5j6r" Mar 16 17:04:35 crc kubenswrapper[5120]: I0316 17:04:35.781923 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-64dd-account-create-update-t5j6r" event={"ID":"4fd979d4-32ca-4d12-977d-e9afea46b929","Type":"ContainerDied","Data":"50cc15ea4b6e2de607dfd261e812db918bf01ea68bd543515dc91511de9f7ab2"} Mar 16 17:04:35 crc kubenswrapper[5120]: I0316 17:04:35.781964 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="50cc15ea4b6e2de607dfd261e812db918bf01ea68bd543515dc91511de9f7ab2" Mar 16 17:04:36 crc kubenswrapper[5120]: I0316 17:04:36.012155 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-pps9b" Mar 16 17:04:36 crc kubenswrapper[5120]: I0316 17:04:36.146913 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xqbzf\" (UniqueName: \"kubernetes.io/projected/49bacc96-e90b-4510-b47a-5012b3d7988e-kube-api-access-xqbzf\") pod \"49bacc96-e90b-4510-b47a-5012b3d7988e\" (UID: \"49bacc96-e90b-4510-b47a-5012b3d7988e\") " Mar 16 17:04:36 crc kubenswrapper[5120]: I0316 17:04:36.147317 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/49bacc96-e90b-4510-b47a-5012b3d7988e-config-data\") pod \"49bacc96-e90b-4510-b47a-5012b3d7988e\" (UID: \"49bacc96-e90b-4510-b47a-5012b3d7988e\") " Mar 16 17:04:36 crc kubenswrapper[5120]: I0316 17:04:36.147370 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/49bacc96-e90b-4510-b47a-5012b3d7988e-combined-ca-bundle\") pod \"49bacc96-e90b-4510-b47a-5012b3d7988e\" (UID: \"49bacc96-e90b-4510-b47a-5012b3d7988e\") " Mar 16 17:04:36 crc kubenswrapper[5120]: I0316 17:04:36.151241 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49bacc96-e90b-4510-b47a-5012b3d7988e-kube-api-access-xqbzf" (OuterVolumeSpecName: "kube-api-access-xqbzf") pod "49bacc96-e90b-4510-b47a-5012b3d7988e" (UID: "49bacc96-e90b-4510-b47a-5012b3d7988e"). InnerVolumeSpecName "kube-api-access-xqbzf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:04:36 crc kubenswrapper[5120]: I0316 17:04:36.171555 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/49bacc96-e90b-4510-b47a-5012b3d7988e-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "49bacc96-e90b-4510-b47a-5012b3d7988e" (UID: "49bacc96-e90b-4510-b47a-5012b3d7988e"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:04:36 crc kubenswrapper[5120]: I0316 17:04:36.191516 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/49bacc96-e90b-4510-b47a-5012b3d7988e-config-data" (OuterVolumeSpecName: "config-data") pod "49bacc96-e90b-4510-b47a-5012b3d7988e" (UID: "49bacc96-e90b-4510-b47a-5012b3d7988e"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:04:36 crc kubenswrapper[5120]: I0316 17:04:36.249724 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xqbzf\" (UniqueName: \"kubernetes.io/projected/49bacc96-e90b-4510-b47a-5012b3d7988e-kube-api-access-xqbzf\") on node \"crc\" DevicePath \"\"" Mar 16 17:04:36 crc kubenswrapper[5120]: I0316 17:04:36.249829 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/49bacc96-e90b-4510-b47a-5012b3d7988e-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:04:36 crc kubenswrapper[5120]: I0316 17:04:36.249842 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/49bacc96-e90b-4510-b47a-5012b3d7988e-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:04:36 crc kubenswrapper[5120]: I0316 17:04:36.791063 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-pps9b" event={"ID":"49bacc96-e90b-4510-b47a-5012b3d7988e","Type":"ContainerDied","Data":"561486e1ef3f575454eca22f3b4b6147fa6b4ada453e7816b4f8adddb6ae7139"} Mar 16 17:04:36 crc kubenswrapper[5120]: I0316 17:04:36.791337 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="561486e1ef3f575454eca22f3b4b6147fa6b4ada453e7816b4f8adddb6ae7139" Mar 16 17:04:36 crc kubenswrapper[5120]: I0316 17:04:36.791140 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-pps9b" Mar 16 17:04:36 crc kubenswrapper[5120]: I0316 17:04:36.949419 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-lsvkk"] Mar 16 17:04:36 crc kubenswrapper[5120]: I0316 17:04:36.950689 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f91eb2a7-c2b0-42c9-abf5-a3904c2b2eeb" containerName="mariadb-database-create" Mar 16 17:04:36 crc kubenswrapper[5120]: I0316 17:04:36.950807 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f91eb2a7-c2b0-42c9-abf5-a3904c2b2eeb" containerName="mariadb-database-create" Mar 16 17:04:36 crc kubenswrapper[5120]: I0316 17:04:36.950881 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42ffc217-f12f-401c-a152-5be06f692da5" containerName="mariadb-account-create-update" Mar 16 17:04:36 crc kubenswrapper[5120]: I0316 17:04:36.950940 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="42ffc217-f12f-401c-a152-5be06f692da5" containerName="mariadb-account-create-update" Mar 16 17:04:36 crc kubenswrapper[5120]: I0316 17:04:36.951018 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5f2c866-0f0f-473e-aeb3-00e4d9df0b70" containerName="extract-content" Mar 16 17:04:36 crc kubenswrapper[5120]: I0316 17:04:36.951070 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5f2c866-0f0f-473e-aeb3-00e4d9df0b70" containerName="extract-content" Mar 16 17:04:36 crc kubenswrapper[5120]: I0316 17:04:36.951146 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3bc621ac-57fe-4689-ac4d-cd47b0909a03" containerName="mariadb-database-create" Mar 16 17:04:36 crc kubenswrapper[5120]: I0316 17:04:36.951197 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="3bc621ac-57fe-4689-ac4d-cd47b0909a03" containerName="mariadb-database-create" Mar 16 17:04:36 crc kubenswrapper[5120]: I0316 17:04:36.951260 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1abe87e9-49d9-4da3-bfb2-e0aa5d891a71" containerName="mariadb-account-create-update" Mar 16 17:04:36 crc kubenswrapper[5120]: I0316 17:04:36.951318 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1abe87e9-49d9-4da3-bfb2-e0aa5d891a71" containerName="mariadb-account-create-update" Mar 16 17:04:36 crc kubenswrapper[5120]: I0316 17:04:36.951380 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee5601d1-7c70-4816-a43f-c43030bcb640" containerName="mariadb-database-create" Mar 16 17:04:36 crc kubenswrapper[5120]: I0316 17:04:36.951430 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee5601d1-7c70-4816-a43f-c43030bcb640" containerName="mariadb-database-create" Mar 16 17:04:36 crc kubenswrapper[5120]: I0316 17:04:36.951487 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5f2c866-0f0f-473e-aeb3-00e4d9df0b70" containerName="registry-server" Mar 16 17:04:36 crc kubenswrapper[5120]: I0316 17:04:36.951543 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5f2c866-0f0f-473e-aeb3-00e4d9df0b70" containerName="registry-server" Mar 16 17:04:36 crc kubenswrapper[5120]: I0316 17:04:36.951600 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49bacc96-e90b-4510-b47a-5012b3d7988e" containerName="keystone-db-sync" Mar 16 17:04:36 crc kubenswrapper[5120]: I0316 17:04:36.951651 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="49bacc96-e90b-4510-b47a-5012b3d7988e" containerName="keystone-db-sync" Mar 16 17:04:36 crc kubenswrapper[5120]: I0316 17:04:36.951718 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5f2c866-0f0f-473e-aeb3-00e4d9df0b70" containerName="extract-utilities" Mar 16 17:04:36 crc kubenswrapper[5120]: I0316 17:04:36.951794 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5f2c866-0f0f-473e-aeb3-00e4d9df0b70" containerName="extract-utilities" Mar 16 17:04:36 crc kubenswrapper[5120]: I0316 17:04:36.951870 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4fd979d4-32ca-4d12-977d-e9afea46b929" containerName="mariadb-account-create-update" Mar 16 17:04:36 crc kubenswrapper[5120]: I0316 17:04:36.951922 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="4fd979d4-32ca-4d12-977d-e9afea46b929" containerName="mariadb-account-create-update" Mar 16 17:04:36 crc kubenswrapper[5120]: I0316 17:04:36.952110 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f91eb2a7-c2b0-42c9-abf5-a3904c2b2eeb" containerName="mariadb-database-create" Mar 16 17:04:36 crc kubenswrapper[5120]: I0316 17:04:36.952171 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="3bc621ac-57fe-4689-ac4d-cd47b0909a03" containerName="mariadb-database-create" Mar 16 17:04:36 crc kubenswrapper[5120]: I0316 17:04:36.952240 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c5f2c866-0f0f-473e-aeb3-00e4d9df0b70" containerName="registry-server" Mar 16 17:04:36 crc kubenswrapper[5120]: I0316 17:04:36.952306 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="49bacc96-e90b-4510-b47a-5012b3d7988e" containerName="keystone-db-sync" Mar 16 17:04:36 crc kubenswrapper[5120]: I0316 17:04:36.952370 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ee5601d1-7c70-4816-a43f-c43030bcb640" containerName="mariadb-database-create" Mar 16 17:04:36 crc kubenswrapper[5120]: I0316 17:04:36.952425 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="4fd979d4-32ca-4d12-977d-e9afea46b929" containerName="mariadb-account-create-update" Mar 16 17:04:36 crc kubenswrapper[5120]: I0316 17:04:36.952483 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="42ffc217-f12f-401c-a152-5be06f692da5" containerName="mariadb-account-create-update" Mar 16 17:04:36 crc kubenswrapper[5120]: I0316 17:04:36.952541 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1abe87e9-49d9-4da3-bfb2-e0aa5d891a71" containerName="mariadb-account-create-update" Mar 16 17:04:36 crc kubenswrapper[5120]: I0316 17:04:36.976986 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-lsvkk"] Mar 16 17:04:36 crc kubenswrapper[5120]: I0316 17:04:36.977599 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-lsvkk" Mar 16 17:04:36 crc kubenswrapper[5120]: I0316 17:04:36.980110 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-config-data\"" Mar 16 17:04:36 crc kubenswrapper[5120]: I0316 17:04:36.980443 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-scripts\"" Mar 16 17:04:36 crc kubenswrapper[5120]: I0316 17:04:36.980689 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"osp-secret\"" Mar 16 17:04:36 crc kubenswrapper[5120]: I0316 17:04:36.980934 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone\"" Mar 16 17:04:36 crc kubenswrapper[5120]: I0316 17:04:36.981099 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-keystone-dockercfg-crlsv\"" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.028073 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.036912 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.043394 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-scripts\"" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.043732 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-public-svc\"" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.043934 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-glance-dockercfg-w6x6w\"" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.044171 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-external-config-data\"" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.067856 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.070219 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/1097f29f-d62e-451e-befd-0e4fbe6c3ca0-credential-keys\") pod \"keystone-bootstrap-lsvkk\" (UID: \"1097f29f-d62e-451e-befd-0e4fbe6c3ca0\") " pod="openstack-kuttl-tests/keystone-bootstrap-lsvkk" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.070301 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/1097f29f-d62e-451e-befd-0e4fbe6c3ca0-fernet-keys\") pod \"keystone-bootstrap-lsvkk\" (UID: \"1097f29f-d62e-451e-befd-0e4fbe6c3ca0\") " pod="openstack-kuttl-tests/keystone-bootstrap-lsvkk" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.070414 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1097f29f-d62e-451e-befd-0e4fbe6c3ca0-combined-ca-bundle\") pod \"keystone-bootstrap-lsvkk\" (UID: \"1097f29f-d62e-451e-befd-0e4fbe6c3ca0\") " pod="openstack-kuttl-tests/keystone-bootstrap-lsvkk" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.070527 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1097f29f-d62e-451e-befd-0e4fbe6c3ca0-config-data\") pod \"keystone-bootstrap-lsvkk\" (UID: \"1097f29f-d62e-451e-befd-0e4fbe6c3ca0\") " pod="openstack-kuttl-tests/keystone-bootstrap-lsvkk" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.070669 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fghxj\" (UniqueName: \"kubernetes.io/projected/1097f29f-d62e-451e-befd-0e4fbe6c3ca0-kube-api-access-fghxj\") pod \"keystone-bootstrap-lsvkk\" (UID: \"1097f29f-d62e-451e-befd-0e4fbe6c3ca0\") " pod="openstack-kuttl-tests/keystone-bootstrap-lsvkk" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.070714 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1097f29f-d62e-451e-befd-0e4fbe6c3ca0-scripts\") pod \"keystone-bootstrap-lsvkk\" (UID: \"1097f29f-d62e-451e-befd-0e4fbe6c3ca0\") " pod="openstack-kuttl-tests/keystone-bootstrap-lsvkk" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.133816 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.145454 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.148069 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-internal-config-data\"" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.151022 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-internal-svc\"" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.153472 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.166398 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.172571 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbmgh\" (UniqueName: \"kubernetes.io/projected/c78826fe-ae87-4178-9fdf-543f594f5afb-kube-api-access-zbmgh\") pod \"glance-default-external-api-0\" (UID: \"c78826fe-ae87-4178-9fdf-543f594f5afb\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.172662 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/1097f29f-d62e-451e-befd-0e4fbe6c3ca0-credential-keys\") pod \"keystone-bootstrap-lsvkk\" (UID: \"1097f29f-d62e-451e-befd-0e4fbe6c3ca0\") " pod="openstack-kuttl-tests/keystone-bootstrap-lsvkk" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.172707 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/1097f29f-d62e-451e-befd-0e4fbe6c3ca0-fernet-keys\") pod \"keystone-bootstrap-lsvkk\" (UID: \"1097f29f-d62e-451e-befd-0e4fbe6c3ca0\") " pod="openstack-kuttl-tests/keystone-bootstrap-lsvkk" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.172734 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c78826fe-ae87-4178-9fdf-543f594f5afb-logs\") pod \"glance-default-external-api-0\" (UID: \"c78826fe-ae87-4178-9fdf-543f594f5afb\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.172818 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"glance-default-external-api-0\" (UID: \"c78826fe-ae87-4178-9fdf-543f594f5afb\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.172855 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1097f29f-d62e-451e-befd-0e4fbe6c3ca0-combined-ca-bundle\") pod \"keystone-bootstrap-lsvkk\" (UID: \"1097f29f-d62e-451e-befd-0e4fbe6c3ca0\") " pod="openstack-kuttl-tests/keystone-bootstrap-lsvkk" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.172879 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/c78826fe-ae87-4178-9fdf-543f594f5afb-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"c78826fe-ae87-4178-9fdf-543f594f5afb\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.172976 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1097f29f-d62e-451e-befd-0e4fbe6c3ca0-config-data\") pod \"keystone-bootstrap-lsvkk\" (UID: \"1097f29f-d62e-451e-befd-0e4fbe6c3ca0\") " pod="openstack-kuttl-tests/keystone-bootstrap-lsvkk" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.173074 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fghxj\" (UniqueName: \"kubernetes.io/projected/1097f29f-d62e-451e-befd-0e4fbe6c3ca0-kube-api-access-fghxj\") pod \"keystone-bootstrap-lsvkk\" (UID: \"1097f29f-d62e-451e-befd-0e4fbe6c3ca0\") " pod="openstack-kuttl-tests/keystone-bootstrap-lsvkk" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.173098 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c78826fe-ae87-4178-9fdf-543f594f5afb-scripts\") pod \"glance-default-external-api-0\" (UID: \"c78826fe-ae87-4178-9fdf-543f594f5afb\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.173130 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1097f29f-d62e-451e-befd-0e4fbe6c3ca0-scripts\") pod \"keystone-bootstrap-lsvkk\" (UID: \"1097f29f-d62e-451e-befd-0e4fbe6c3ca0\") " pod="openstack-kuttl-tests/keystone-bootstrap-lsvkk" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.173175 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c78826fe-ae87-4178-9fdf-543f594f5afb-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"c78826fe-ae87-4178-9fdf-543f594f5afb\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.173229 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c78826fe-ae87-4178-9fdf-543f594f5afb-config-data\") pod \"glance-default-external-api-0\" (UID: \"c78826fe-ae87-4178-9fdf-543f594f5afb\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.173328 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/c78826fe-ae87-4178-9fdf-543f594f5afb-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"c78826fe-ae87-4178-9fdf-543f594f5afb\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.175191 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.179613 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/1097f29f-d62e-451e-befd-0e4fbe6c3ca0-credential-keys\") pod \"keystone-bootstrap-lsvkk\" (UID: \"1097f29f-d62e-451e-befd-0e4fbe6c3ca0\") " pod="openstack-kuttl-tests/keystone-bootstrap-lsvkk" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.181112 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.184160 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/1097f29f-d62e-451e-befd-0e4fbe6c3ca0-fernet-keys\") pod \"keystone-bootstrap-lsvkk\" (UID: \"1097f29f-d62e-451e-befd-0e4fbe6c3ca0\") " pod="openstack-kuttl-tests/keystone-bootstrap-lsvkk" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.184578 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.187861 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1097f29f-d62e-451e-befd-0e4fbe6c3ca0-scripts\") pod \"keystone-bootstrap-lsvkk\" (UID: \"1097f29f-d62e-451e-befd-0e4fbe6c3ca0\") " pod="openstack-kuttl-tests/keystone-bootstrap-lsvkk" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.188741 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1097f29f-d62e-451e-befd-0e4fbe6c3ca0-config-data\") pod \"keystone-bootstrap-lsvkk\" (UID: \"1097f29f-d62e-451e-befd-0e4fbe6c3ca0\") " pod="openstack-kuttl-tests/keystone-bootstrap-lsvkk" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.192419 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1097f29f-d62e-451e-befd-0e4fbe6c3ca0-combined-ca-bundle\") pod \"keystone-bootstrap-lsvkk\" (UID: \"1097f29f-d62e-451e-befd-0e4fbe6c3ca0\") " pod="openstack-kuttl-tests/keystone-bootstrap-lsvkk" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.200313 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.210190 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fghxj\" (UniqueName: \"kubernetes.io/projected/1097f29f-d62e-451e-befd-0e4fbe6c3ca0-kube-api-access-fghxj\") pod \"keystone-bootstrap-lsvkk\" (UID: \"1097f29f-d62e-451e-befd-0e4fbe6c3ca0\") " pod="openstack-kuttl-tests/keystone-bootstrap-lsvkk" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.270157 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-db-sync-b8q8w"] Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.274879 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpjll\" (UniqueName: \"kubernetes.io/projected/97594790-c415-4a95-800c-9bf5c983ce70-kube-api-access-xpjll\") pod \"glance-default-internal-api-0\" (UID: \"97594790-c415-4a95-800c-9bf5c983ce70\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.274920 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/97594790-c415-4a95-800c-9bf5c983ce70-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"97594790-c415-4a95-800c-9bf5c983ce70\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.274954 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"glance-default-external-api-0\" (UID: \"c78826fe-ae87-4178-9fdf-543f594f5afb\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.274985 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/97594790-c415-4a95-800c-9bf5c983ce70-logs\") pod \"glance-default-internal-api-0\" (UID: \"97594790-c415-4a95-800c-9bf5c983ce70\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.275014 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/c78826fe-ae87-4178-9fdf-543f594f5afb-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"c78826fe-ae87-4178-9fdf-543f594f5afb\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.275061 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/97594790-c415-4a95-800c-9bf5c983ce70-config-data\") pod \"glance-default-internal-api-0\" (UID: \"97594790-c415-4a95-800c-9bf5c983ce70\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.275127 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/97594790-c415-4a95-800c-9bf5c983ce70-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"97594790-c415-4a95-800c-9bf5c983ce70\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.275165 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/01efd45f-aa9b-487b-99f1-3320f37ebd2e-scripts\") pod \"ceilometer-0\" (UID: \"01efd45f-aa9b-487b-99f1-3320f37ebd2e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.275231 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"glance-default-internal-api-0\" (UID: \"97594790-c415-4a95-800c-9bf5c983ce70\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.275248 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/01efd45f-aa9b-487b-99f1-3320f37ebd2e-run-httpd\") pod \"ceilometer-0\" (UID: \"01efd45f-aa9b-487b-99f1-3320f37ebd2e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.275283 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c78826fe-ae87-4178-9fdf-543f594f5afb-scripts\") pod \"glance-default-external-api-0\" (UID: \"c78826fe-ae87-4178-9fdf-543f594f5afb\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.275316 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/01efd45f-aa9b-487b-99f1-3320f37ebd2e-config-data\") pod \"ceilometer-0\" (UID: \"01efd45f-aa9b-487b-99f1-3320f37ebd2e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.275364 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c78826fe-ae87-4178-9fdf-543f594f5afb-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"c78826fe-ae87-4178-9fdf-543f594f5afb\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.275394 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/01efd45f-aa9b-487b-99f1-3320f37ebd2e-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"01efd45f-aa9b-487b-99f1-3320f37ebd2e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.275423 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jcwpd\" (UniqueName: \"kubernetes.io/projected/01efd45f-aa9b-487b-99f1-3320f37ebd2e-kube-api-access-jcwpd\") pod \"ceilometer-0\" (UID: \"01efd45f-aa9b-487b-99f1-3320f37ebd2e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.275466 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c78826fe-ae87-4178-9fdf-543f594f5afb-config-data\") pod \"glance-default-external-api-0\" (UID: \"c78826fe-ae87-4178-9fdf-543f594f5afb\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.275515 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/01efd45f-aa9b-487b-99f1-3320f37ebd2e-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"01efd45f-aa9b-487b-99f1-3320f37ebd2e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.275550 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/01efd45f-aa9b-487b-99f1-3320f37ebd2e-log-httpd\") pod \"ceilometer-0\" (UID: \"01efd45f-aa9b-487b-99f1-3320f37ebd2e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.275592 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/c78826fe-ae87-4178-9fdf-543f594f5afb-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"c78826fe-ae87-4178-9fdf-543f594f5afb\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.275633 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zbmgh\" (UniqueName: \"kubernetes.io/projected/c78826fe-ae87-4178-9fdf-543f594f5afb-kube-api-access-zbmgh\") pod \"glance-default-external-api-0\" (UID: \"c78826fe-ae87-4178-9fdf-543f594f5afb\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.275660 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/97594790-c415-4a95-800c-9bf5c983ce70-scripts\") pod \"glance-default-internal-api-0\" (UID: \"97594790-c415-4a95-800c-9bf5c983ce70\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.275729 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/97594790-c415-4a95-800c-9bf5c983ce70-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"97594790-c415-4a95-800c-9bf5c983ce70\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.275784 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c78826fe-ae87-4178-9fdf-543f594f5afb-logs\") pod \"glance-default-external-api-0\" (UID: \"c78826fe-ae87-4178-9fdf-543f594f5afb\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.276188 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c78826fe-ae87-4178-9fdf-543f594f5afb-logs\") pod \"glance-default-external-api-0\" (UID: \"c78826fe-ae87-4178-9fdf-543f594f5afb\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.276603 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"glance-default-external-api-0\" (UID: \"c78826fe-ae87-4178-9fdf-543f594f5afb\") device mount path \"/mnt/openstack/pv05\"" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.277437 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-b8q8w" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.278898 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/c78826fe-ae87-4178-9fdf-543f594f5afb-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"c78826fe-ae87-4178-9fdf-543f594f5afb\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.284253 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-scripts\"" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.284420 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-placement-dockercfg-2bl8h\"" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.284622 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-config-data\"" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.288459 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-b8q8w"] Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.292662 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c78826fe-ae87-4178-9fdf-543f594f5afb-config-data\") pod \"glance-default-external-api-0\" (UID: \"c78826fe-ae87-4178-9fdf-543f594f5afb\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.304142 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-lsvkk" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.309526 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c78826fe-ae87-4178-9fdf-543f594f5afb-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"c78826fe-ae87-4178-9fdf-543f594f5afb\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.318685 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/c78826fe-ae87-4178-9fdf-543f594f5afb-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"c78826fe-ae87-4178-9fdf-543f594f5afb\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.320745 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbmgh\" (UniqueName: \"kubernetes.io/projected/c78826fe-ae87-4178-9fdf-543f594f5afb-kube-api-access-zbmgh\") pod \"glance-default-external-api-0\" (UID: \"c78826fe-ae87-4178-9fdf-543f594f5afb\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.332318 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c78826fe-ae87-4178-9fdf-543f594f5afb-scripts\") pod \"glance-default-external-api-0\" (UID: \"c78826fe-ae87-4178-9fdf-543f594f5afb\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.349805 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"glance-default-external-api-0\" (UID: \"c78826fe-ae87-4178-9fdf-543f594f5afb\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.378516 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"glance-default-internal-api-0\" (UID: \"97594790-c415-4a95-800c-9bf5c983ce70\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.379071 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/01efd45f-aa9b-487b-99f1-3320f37ebd2e-run-httpd\") pod \"ceilometer-0\" (UID: \"01efd45f-aa9b-487b-99f1-3320f37ebd2e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.379197 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/01efd45f-aa9b-487b-99f1-3320f37ebd2e-config-data\") pod \"ceilometer-0\" (UID: \"01efd45f-aa9b-487b-99f1-3320f37ebd2e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.379288 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ef0e4aec-f4b7-43b1-9496-2b50031875a4-config-data\") pod \"placement-db-sync-b8q8w\" (UID: \"ef0e4aec-f4b7-43b1-9496-2b50031875a4\") " pod="openstack-kuttl-tests/placement-db-sync-b8q8w" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.379394 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/01efd45f-aa9b-487b-99f1-3320f37ebd2e-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"01efd45f-aa9b-487b-99f1-3320f37ebd2e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.379479 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jcwpd\" (UniqueName: \"kubernetes.io/projected/01efd45f-aa9b-487b-99f1-3320f37ebd2e-kube-api-access-jcwpd\") pod \"ceilometer-0\" (UID: \"01efd45f-aa9b-487b-99f1-3320f37ebd2e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.379571 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ef0e4aec-f4b7-43b1-9496-2b50031875a4-logs\") pod \"placement-db-sync-b8q8w\" (UID: \"ef0e4aec-f4b7-43b1-9496-2b50031875a4\") " pod="openstack-kuttl-tests/placement-db-sync-b8q8w" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.379677 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/01efd45f-aa9b-487b-99f1-3320f37ebd2e-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"01efd45f-aa9b-487b-99f1-3320f37ebd2e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.379784 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/01efd45f-aa9b-487b-99f1-3320f37ebd2e-log-httpd\") pod \"ceilometer-0\" (UID: \"01efd45f-aa9b-487b-99f1-3320f37ebd2e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.379895 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/01efd45f-aa9b-487b-99f1-3320f37ebd2e-run-httpd\") pod \"ceilometer-0\" (UID: \"01efd45f-aa9b-487b-99f1-3320f37ebd2e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.378953 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.380017 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/97594790-c415-4a95-800c-9bf5c983ce70-scripts\") pod \"glance-default-internal-api-0\" (UID: \"97594790-c415-4a95-800c-9bf5c983ce70\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.380139 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/97594790-c415-4a95-800c-9bf5c983ce70-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"97594790-c415-4a95-800c-9bf5c983ce70\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.380250 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xpjll\" (UniqueName: \"kubernetes.io/projected/97594790-c415-4a95-800c-9bf5c983ce70-kube-api-access-xpjll\") pod \"glance-default-internal-api-0\" (UID: \"97594790-c415-4a95-800c-9bf5c983ce70\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.380338 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/97594790-c415-4a95-800c-9bf5c983ce70-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"97594790-c415-4a95-800c-9bf5c983ce70\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.380446 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/97594790-c415-4a95-800c-9bf5c983ce70-logs\") pod \"glance-default-internal-api-0\" (UID: \"97594790-c415-4a95-800c-9bf5c983ce70\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.380523 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ef0e4aec-f4b7-43b1-9496-2b50031875a4-scripts\") pod \"placement-db-sync-b8q8w\" (UID: \"ef0e4aec-f4b7-43b1-9496-2b50031875a4\") " pod="openstack-kuttl-tests/placement-db-sync-b8q8w" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.380640 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/97594790-c415-4a95-800c-9bf5c983ce70-config-data\") pod \"glance-default-internal-api-0\" (UID: \"97594790-c415-4a95-800c-9bf5c983ce70\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.380807 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/97594790-c415-4a95-800c-9bf5c983ce70-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"97594790-c415-4a95-800c-9bf5c983ce70\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.380915 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ef0e4aec-f4b7-43b1-9496-2b50031875a4-combined-ca-bundle\") pod \"placement-db-sync-b8q8w\" (UID: \"ef0e4aec-f4b7-43b1-9496-2b50031875a4\") " pod="openstack-kuttl-tests/placement-db-sync-b8q8w" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.380997 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85bw6\" (UniqueName: \"kubernetes.io/projected/ef0e4aec-f4b7-43b1-9496-2b50031875a4-kube-api-access-85bw6\") pod \"placement-db-sync-b8q8w\" (UID: \"ef0e4aec-f4b7-43b1-9496-2b50031875a4\") " pod="openstack-kuttl-tests/placement-db-sync-b8q8w" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.381085 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/01efd45f-aa9b-487b-99f1-3320f37ebd2e-scripts\") pod \"ceilometer-0\" (UID: \"01efd45f-aa9b-487b-99f1-3320f37ebd2e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.379332 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"glance-default-internal-api-0\" (UID: \"97594790-c415-4a95-800c-9bf5c983ce70\") device mount path \"/mnt/openstack/pv06\"" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.387466 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/01efd45f-aa9b-487b-99f1-3320f37ebd2e-log-httpd\") pod \"ceilometer-0\" (UID: \"01efd45f-aa9b-487b-99f1-3320f37ebd2e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.388721 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/97594790-c415-4a95-800c-9bf5c983ce70-logs\") pod \"glance-default-internal-api-0\" (UID: \"97594790-c415-4a95-800c-9bf5c983ce70\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.391781 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/97594790-c415-4a95-800c-9bf5c983ce70-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"97594790-c415-4a95-800c-9bf5c983ce70\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.392047 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/97594790-c415-4a95-800c-9bf5c983ce70-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"97594790-c415-4a95-800c-9bf5c983ce70\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.394355 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/97594790-c415-4a95-800c-9bf5c983ce70-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"97594790-c415-4a95-800c-9bf5c983ce70\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.395208 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/01efd45f-aa9b-487b-99f1-3320f37ebd2e-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"01efd45f-aa9b-487b-99f1-3320f37ebd2e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.398726 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/01efd45f-aa9b-487b-99f1-3320f37ebd2e-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"01efd45f-aa9b-487b-99f1-3320f37ebd2e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.399062 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/01efd45f-aa9b-487b-99f1-3320f37ebd2e-scripts\") pod \"ceilometer-0\" (UID: \"01efd45f-aa9b-487b-99f1-3320f37ebd2e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.399536 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/97594790-c415-4a95-800c-9bf5c983ce70-scripts\") pod \"glance-default-internal-api-0\" (UID: \"97594790-c415-4a95-800c-9bf5c983ce70\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.401203 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/97594790-c415-4a95-800c-9bf5c983ce70-config-data\") pod \"glance-default-internal-api-0\" (UID: \"97594790-c415-4a95-800c-9bf5c983ce70\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.416494 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/01efd45f-aa9b-487b-99f1-3320f37ebd2e-config-data\") pod \"ceilometer-0\" (UID: \"01efd45f-aa9b-487b-99f1-3320f37ebd2e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.419580 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpjll\" (UniqueName: \"kubernetes.io/projected/97594790-c415-4a95-800c-9bf5c983ce70-kube-api-access-xpjll\") pod \"glance-default-internal-api-0\" (UID: \"97594790-c415-4a95-800c-9bf5c983ce70\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.438193 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jcwpd\" (UniqueName: \"kubernetes.io/projected/01efd45f-aa9b-487b-99f1-3320f37ebd2e-kube-api-access-jcwpd\") pod \"ceilometer-0\" (UID: \"01efd45f-aa9b-487b-99f1-3320f37ebd2e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.446079 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"glance-default-internal-api-0\" (UID: \"97594790-c415-4a95-800c-9bf5c983ce70\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.466988 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.496195 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ef0e4aec-f4b7-43b1-9496-2b50031875a4-scripts\") pod \"placement-db-sync-b8q8w\" (UID: \"ef0e4aec-f4b7-43b1-9496-2b50031875a4\") " pod="openstack-kuttl-tests/placement-db-sync-b8q8w" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.496296 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ef0e4aec-f4b7-43b1-9496-2b50031875a4-combined-ca-bundle\") pod \"placement-db-sync-b8q8w\" (UID: \"ef0e4aec-f4b7-43b1-9496-2b50031875a4\") " pod="openstack-kuttl-tests/placement-db-sync-b8q8w" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.496318 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-85bw6\" (UniqueName: \"kubernetes.io/projected/ef0e4aec-f4b7-43b1-9496-2b50031875a4-kube-api-access-85bw6\") pod \"placement-db-sync-b8q8w\" (UID: \"ef0e4aec-f4b7-43b1-9496-2b50031875a4\") " pod="openstack-kuttl-tests/placement-db-sync-b8q8w" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.496400 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ef0e4aec-f4b7-43b1-9496-2b50031875a4-config-data\") pod \"placement-db-sync-b8q8w\" (UID: \"ef0e4aec-f4b7-43b1-9496-2b50031875a4\") " pod="openstack-kuttl-tests/placement-db-sync-b8q8w" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.496439 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ef0e4aec-f4b7-43b1-9496-2b50031875a4-logs\") pod \"placement-db-sync-b8q8w\" (UID: \"ef0e4aec-f4b7-43b1-9496-2b50031875a4\") " pod="openstack-kuttl-tests/placement-db-sync-b8q8w" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.496909 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ef0e4aec-f4b7-43b1-9496-2b50031875a4-logs\") pod \"placement-db-sync-b8q8w\" (UID: \"ef0e4aec-f4b7-43b1-9496-2b50031875a4\") " pod="openstack-kuttl-tests/placement-db-sync-b8q8w" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.502352 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ef0e4aec-f4b7-43b1-9496-2b50031875a4-combined-ca-bundle\") pod \"placement-db-sync-b8q8w\" (UID: \"ef0e4aec-f4b7-43b1-9496-2b50031875a4\") " pod="openstack-kuttl-tests/placement-db-sync-b8q8w" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.508265 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ef0e4aec-f4b7-43b1-9496-2b50031875a4-scripts\") pod \"placement-db-sync-b8q8w\" (UID: \"ef0e4aec-f4b7-43b1-9496-2b50031875a4\") " pod="openstack-kuttl-tests/placement-db-sync-b8q8w" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.512431 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ef0e4aec-f4b7-43b1-9496-2b50031875a4-config-data\") pod \"placement-db-sync-b8q8w\" (UID: \"ef0e4aec-f4b7-43b1-9496-2b50031875a4\") " pod="openstack-kuttl-tests/placement-db-sync-b8q8w" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.524323 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-85bw6\" (UniqueName: \"kubernetes.io/projected/ef0e4aec-f4b7-43b1-9496-2b50031875a4-kube-api-access-85bw6\") pod \"placement-db-sync-b8q8w\" (UID: \"ef0e4aec-f4b7-43b1-9496-2b50031875a4\") " pod="openstack-kuttl-tests/placement-db-sync-b8q8w" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.575689 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.779742 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-b8q8w" Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.809703 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-lsvkk"] Mar 16 17:04:37 crc kubenswrapper[5120]: W0316 17:04:37.816774 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1097f29f_d62e_451e_befd_0e4fbe6c3ca0.slice/crio-0db9c38495cd01547800bcec9fab3ad913870bda3088a11776436ea873477998 WatchSource:0}: Error finding container 0db9c38495cd01547800bcec9fab3ad913870bda3088a11776436ea873477998: Status 404 returned error can't find the container with id 0db9c38495cd01547800bcec9fab3ad913870bda3088a11776436ea873477998 Mar 16 17:04:37 crc kubenswrapper[5120]: I0316 17:04:37.990497 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 17:04:37 crc kubenswrapper[5120]: W0316 17:04:37.998719 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc78826fe_ae87_4178_9fdf_543f594f5afb.slice/crio-e16568865ddf5a19efb932850721a1c2d040935a963c4fec6753e931328fc726 WatchSource:0}: Error finding container e16568865ddf5a19efb932850721a1c2d040935a963c4fec6753e931328fc726: Status 404 returned error can't find the container with id e16568865ddf5a19efb932850721a1c2d040935a963c4fec6753e931328fc726 Mar 16 17:04:38 crc kubenswrapper[5120]: I0316 17:04:38.007855 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 17:04:38 crc kubenswrapper[5120]: I0316 17:04:38.160181 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:04:38 crc kubenswrapper[5120]: I0316 17:04:38.262576 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-b8q8w"] Mar 16 17:04:38 crc kubenswrapper[5120]: W0316 17:04:38.282270 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podef0e4aec_f4b7_43b1_9496_2b50031875a4.slice/crio-f466ea7c1405b7d13f0ecec3fc1e1b82b69652644b358afe9a332debc79bcc47 WatchSource:0}: Error finding container f466ea7c1405b7d13f0ecec3fc1e1b82b69652644b358afe9a332debc79bcc47: Status 404 returned error can't find the container with id f466ea7c1405b7d13f0ecec3fc1e1b82b69652644b358afe9a332debc79bcc47 Mar 16 17:04:38 crc kubenswrapper[5120]: I0316 17:04:38.840508 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"c78826fe-ae87-4178-9fdf-543f594f5afb","Type":"ContainerStarted","Data":"e9772c73c597c88a47613d687acc08db60cb9c31aea299ccbeb9021a61dea5f7"} Mar 16 17:04:38 crc kubenswrapper[5120]: I0316 17:04:38.840991 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"c78826fe-ae87-4178-9fdf-543f594f5afb","Type":"ContainerStarted","Data":"e16568865ddf5a19efb932850721a1c2d040935a963c4fec6753e931328fc726"} Mar 16 17:04:38 crc kubenswrapper[5120]: I0316 17:04:38.856790 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"01efd45f-aa9b-487b-99f1-3320f37ebd2e","Type":"ContainerStarted","Data":"824adb99bd1fc3adb2fa7e2f4e16af9a26a03e34f6ed3ec9c1e373f36a9cd7b6"} Mar 16 17:04:38 crc kubenswrapper[5120]: I0316 17:04:38.860586 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"97594790-c415-4a95-800c-9bf5c983ce70","Type":"ContainerStarted","Data":"a0573d4baa676df06512dfb4b55a7fba469f73e506f1ae8671890e2a050a2168"} Mar 16 17:04:38 crc kubenswrapper[5120]: I0316 17:04:38.860631 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"97594790-c415-4a95-800c-9bf5c983ce70","Type":"ContainerStarted","Data":"ec21412ee04fadaf8783ad8a4c869c954ccca72017f1529957220966838b3b40"} Mar 16 17:04:38 crc kubenswrapper[5120]: I0316 17:04:38.862411 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-lsvkk" event={"ID":"1097f29f-d62e-451e-befd-0e4fbe6c3ca0","Type":"ContainerStarted","Data":"49d0fe703443d5c46a4dbd56ca15824de9b502e026cd2ba54e9f70fc748f91ee"} Mar 16 17:04:38 crc kubenswrapper[5120]: I0316 17:04:38.862451 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-lsvkk" event={"ID":"1097f29f-d62e-451e-befd-0e4fbe6c3ca0","Type":"ContainerStarted","Data":"0db9c38495cd01547800bcec9fab3ad913870bda3088a11776436ea873477998"} Mar 16 17:04:38 crc kubenswrapper[5120]: I0316 17:04:38.868642 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-b8q8w" event={"ID":"ef0e4aec-f4b7-43b1-9496-2b50031875a4","Type":"ContainerStarted","Data":"37396698e7652fbd338cc75da2ef41d2618aa93a7113c6d6f2bed1feb0b3a762"} Mar 16 17:04:38 crc kubenswrapper[5120]: I0316 17:04:38.868685 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-b8q8w" event={"ID":"ef0e4aec-f4b7-43b1-9496-2b50031875a4","Type":"ContainerStarted","Data":"f466ea7c1405b7d13f0ecec3fc1e1b82b69652644b358afe9a332debc79bcc47"} Mar 16 17:04:38 crc kubenswrapper[5120]: I0316 17:04:38.891007 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-bootstrap-lsvkk" podStartSLOduration=2.890989419 podStartE2EDuration="2.890989419s" podCreationTimestamp="2026-03-16 17:04:36 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:04:38.885741104 +0000 UTC m=+5581.039672781" watchObservedRunningTime="2026-03-16 17:04:38.890989419 +0000 UTC m=+5581.044921076" Mar 16 17:04:38 crc kubenswrapper[5120]: I0316 17:04:38.950958 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-db-sync-b8q8w" podStartSLOduration=1.950939815 podStartE2EDuration="1.950939815s" podCreationTimestamp="2026-03-16 17:04:37 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:04:38.907030532 +0000 UTC m=+5581.060962199" watchObservedRunningTime="2026-03-16 17:04:38.950939815 +0000 UTC m=+5581.104871472" Mar 16 17:04:39 crc kubenswrapper[5120]: I0316 17:04:39.079914 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 17:04:39 crc kubenswrapper[5120]: I0316 17:04:39.111167 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:04:39 crc kubenswrapper[5120]: I0316 17:04:39.181488 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 17:04:39 crc kubenswrapper[5120]: I0316 17:04:39.917534 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"01efd45f-aa9b-487b-99f1-3320f37ebd2e","Type":"ContainerStarted","Data":"6b739c38a914fed3ff1d9a888a162085bb4993068271ed3de06098a07ae1e4af"} Mar 16 17:04:40 crc kubenswrapper[5120]: E0316 17:04:40.104691 5120 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podef0e4aec_f4b7_43b1_9496_2b50031875a4.slice/crio-37396698e7652fbd338cc75da2ef41d2618aa93a7113c6d6f2bed1feb0b3a762.scope\": RecentStats: unable to find data in memory cache]" Mar 16 17:04:40 crc kubenswrapper[5120]: I0316 17:04:40.936728 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"c78826fe-ae87-4178-9fdf-543f594f5afb","Type":"ContainerStarted","Data":"c13a96a511f17afa96c95d8f55fc3642a9f1ff4aa17556132d3589fc0efa0ed3"} Mar 16 17:04:40 crc kubenswrapper[5120]: I0316 17:04:40.937216 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="c78826fe-ae87-4178-9fdf-543f594f5afb" containerName="glance-log" containerID="cri-o://e9772c73c597c88a47613d687acc08db60cb9c31aea299ccbeb9021a61dea5f7" gracePeriod=30 Mar 16 17:04:40 crc kubenswrapper[5120]: I0316 17:04:40.938000 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="c78826fe-ae87-4178-9fdf-543f594f5afb" containerName="glance-httpd" containerID="cri-o://c13a96a511f17afa96c95d8f55fc3642a9f1ff4aa17556132d3589fc0efa0ed3" gracePeriod=30 Mar 16 17:04:40 crc kubenswrapper[5120]: I0316 17:04:40.943079 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"01efd45f-aa9b-487b-99f1-3320f37ebd2e","Type":"ContainerStarted","Data":"8fa00d47838a96dc1e89fc1bbf326f3fb6428b7a6f10775c34e1d77786e0227f"} Mar 16 17:04:40 crc kubenswrapper[5120]: I0316 17:04:40.943163 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"01efd45f-aa9b-487b-99f1-3320f37ebd2e","Type":"ContainerStarted","Data":"f52b0845273b4e3787cb7e7232e9e0b7c19ed7252254ee9c05ef5db3727f0a77"} Mar 16 17:04:40 crc kubenswrapper[5120]: I0316 17:04:40.947324 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"97594790-c415-4a95-800c-9bf5c983ce70","Type":"ContainerStarted","Data":"a3bbf287ef8ad05bdb817657666447521c58519b251f3478a3d943cd4b318c42"} Mar 16 17:04:40 crc kubenswrapper[5120]: I0316 17:04:40.947334 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="97594790-c415-4a95-800c-9bf5c983ce70" containerName="glance-log" containerID="cri-o://a0573d4baa676df06512dfb4b55a7fba469f73e506f1ae8671890e2a050a2168" gracePeriod=30 Mar 16 17:04:40 crc kubenswrapper[5120]: I0316 17:04:40.947493 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="97594790-c415-4a95-800c-9bf5c983ce70" containerName="glance-httpd" containerID="cri-o://a3bbf287ef8ad05bdb817657666447521c58519b251f3478a3d943cd4b318c42" gracePeriod=30 Mar 16 17:04:40 crc kubenswrapper[5120]: I0316 17:04:40.962214 5120 generic.go:358] "Generic (PLEG): container finished" podID="ef0e4aec-f4b7-43b1-9496-2b50031875a4" containerID="37396698e7652fbd338cc75da2ef41d2618aa93a7113c6d6f2bed1feb0b3a762" exitCode=0 Mar 16 17:04:40 crc kubenswrapper[5120]: I0316 17:04:40.962297 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-b8q8w" event={"ID":"ef0e4aec-f4b7-43b1-9496-2b50031875a4","Type":"ContainerDied","Data":"37396698e7652fbd338cc75da2ef41d2618aa93a7113c6d6f2bed1feb0b3a762"} Mar 16 17:04:40 crc kubenswrapper[5120]: I0316 17:04:40.963696 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-external-api-0" podStartSLOduration=4.963683758 podStartE2EDuration="4.963683758s" podCreationTimestamp="2026-03-16 17:04:36 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:04:40.957717923 +0000 UTC m=+5583.111649580" watchObservedRunningTime="2026-03-16 17:04:40.963683758 +0000 UTC m=+5583.117615415" Mar 16 17:04:40 crc kubenswrapper[5120]: I0316 17:04:40.999023 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-internal-api-0" podStartSLOduration=3.9989968830000002 podStartE2EDuration="3.998996883s" podCreationTimestamp="2026-03-16 17:04:37 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:04:40.985258384 +0000 UTC m=+5583.139190061" watchObservedRunningTime="2026-03-16 17:04:40.998996883 +0000 UTC m=+5583.152928540" Mar 16 17:04:41 crc kubenswrapper[5120]: I0316 17:04:41.176153 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-qk75k"] Mar 16 17:04:41 crc kubenswrapper[5120]: I0316 17:04:41.194571 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-qk75k"] Mar 16 17:04:41 crc kubenswrapper[5120]: I0316 17:04:41.194832 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-qk75k" Mar 16 17:04:41 crc kubenswrapper[5120]: I0316 17:04:41.208391 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-config-data\"" Mar 16 17:04:41 crc kubenswrapper[5120]: I0316 17:04:41.209976 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-cinder-dockercfg-df8z9\"" Mar 16 17:04:41 crc kubenswrapper[5120]: I0316 17:04:41.220936 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-scripts\"" Mar 16 17:04:41 crc kubenswrapper[5120]: I0316 17:04:41.329948 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/727c8c9a-fcc8-42c3-8a58-df87dc295191-db-sync-config-data\") pod \"cinder-db-sync-qk75k\" (UID: \"727c8c9a-fcc8-42c3-8a58-df87dc295191\") " pod="openstack-kuttl-tests/cinder-db-sync-qk75k" Mar 16 17:04:41 crc kubenswrapper[5120]: I0316 17:04:41.330009 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/727c8c9a-fcc8-42c3-8a58-df87dc295191-combined-ca-bundle\") pod \"cinder-db-sync-qk75k\" (UID: \"727c8c9a-fcc8-42c3-8a58-df87dc295191\") " pod="openstack-kuttl-tests/cinder-db-sync-qk75k" Mar 16 17:04:41 crc kubenswrapper[5120]: I0316 17:04:41.330268 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/727c8c9a-fcc8-42c3-8a58-df87dc295191-scripts\") pod \"cinder-db-sync-qk75k\" (UID: \"727c8c9a-fcc8-42c3-8a58-df87dc295191\") " pod="openstack-kuttl-tests/cinder-db-sync-qk75k" Mar 16 17:04:41 crc kubenswrapper[5120]: I0316 17:04:41.330324 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/727c8c9a-fcc8-42c3-8a58-df87dc295191-config-data\") pod \"cinder-db-sync-qk75k\" (UID: \"727c8c9a-fcc8-42c3-8a58-df87dc295191\") " pod="openstack-kuttl-tests/cinder-db-sync-qk75k" Mar 16 17:04:41 crc kubenswrapper[5120]: I0316 17:04:41.330462 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9cvt\" (UniqueName: \"kubernetes.io/projected/727c8c9a-fcc8-42c3-8a58-df87dc295191-kube-api-access-s9cvt\") pod \"cinder-db-sync-qk75k\" (UID: \"727c8c9a-fcc8-42c3-8a58-df87dc295191\") " pod="openstack-kuttl-tests/cinder-db-sync-qk75k" Mar 16 17:04:41 crc kubenswrapper[5120]: I0316 17:04:41.330529 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/727c8c9a-fcc8-42c3-8a58-df87dc295191-etc-machine-id\") pod \"cinder-db-sync-qk75k\" (UID: \"727c8c9a-fcc8-42c3-8a58-df87dc295191\") " pod="openstack-kuttl-tests/cinder-db-sync-qk75k" Mar 16 17:04:41 crc kubenswrapper[5120]: I0316 17:04:41.432935 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/727c8c9a-fcc8-42c3-8a58-df87dc295191-scripts\") pod \"cinder-db-sync-qk75k\" (UID: \"727c8c9a-fcc8-42c3-8a58-df87dc295191\") " pod="openstack-kuttl-tests/cinder-db-sync-qk75k" Mar 16 17:04:41 crc kubenswrapper[5120]: I0316 17:04:41.433011 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/727c8c9a-fcc8-42c3-8a58-df87dc295191-config-data\") pod \"cinder-db-sync-qk75k\" (UID: \"727c8c9a-fcc8-42c3-8a58-df87dc295191\") " pod="openstack-kuttl-tests/cinder-db-sync-qk75k" Mar 16 17:04:41 crc kubenswrapper[5120]: I0316 17:04:41.433121 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s9cvt\" (UniqueName: \"kubernetes.io/projected/727c8c9a-fcc8-42c3-8a58-df87dc295191-kube-api-access-s9cvt\") pod \"cinder-db-sync-qk75k\" (UID: \"727c8c9a-fcc8-42c3-8a58-df87dc295191\") " pod="openstack-kuttl-tests/cinder-db-sync-qk75k" Mar 16 17:04:41 crc kubenswrapper[5120]: I0316 17:04:41.433168 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/727c8c9a-fcc8-42c3-8a58-df87dc295191-etc-machine-id\") pod \"cinder-db-sync-qk75k\" (UID: \"727c8c9a-fcc8-42c3-8a58-df87dc295191\") " pod="openstack-kuttl-tests/cinder-db-sync-qk75k" Mar 16 17:04:41 crc kubenswrapper[5120]: I0316 17:04:41.433215 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/727c8c9a-fcc8-42c3-8a58-df87dc295191-db-sync-config-data\") pod \"cinder-db-sync-qk75k\" (UID: \"727c8c9a-fcc8-42c3-8a58-df87dc295191\") " pod="openstack-kuttl-tests/cinder-db-sync-qk75k" Mar 16 17:04:41 crc kubenswrapper[5120]: I0316 17:04:41.433234 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/727c8c9a-fcc8-42c3-8a58-df87dc295191-combined-ca-bundle\") pod \"cinder-db-sync-qk75k\" (UID: \"727c8c9a-fcc8-42c3-8a58-df87dc295191\") " pod="openstack-kuttl-tests/cinder-db-sync-qk75k" Mar 16 17:04:41 crc kubenswrapper[5120]: I0316 17:04:41.434351 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/727c8c9a-fcc8-42c3-8a58-df87dc295191-etc-machine-id\") pod \"cinder-db-sync-qk75k\" (UID: \"727c8c9a-fcc8-42c3-8a58-df87dc295191\") " pod="openstack-kuttl-tests/cinder-db-sync-qk75k" Mar 16 17:04:41 crc kubenswrapper[5120]: I0316 17:04:41.435173 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-hjq5d"] Mar 16 17:04:41 crc kubenswrapper[5120]: I0316 17:04:41.441816 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/727c8c9a-fcc8-42c3-8a58-df87dc295191-scripts\") pod \"cinder-db-sync-qk75k\" (UID: \"727c8c9a-fcc8-42c3-8a58-df87dc295191\") " pod="openstack-kuttl-tests/cinder-db-sync-qk75k" Mar 16 17:04:41 crc kubenswrapper[5120]: I0316 17:04:41.444003 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/727c8c9a-fcc8-42c3-8a58-df87dc295191-db-sync-config-data\") pod \"cinder-db-sync-qk75k\" (UID: \"727c8c9a-fcc8-42c3-8a58-df87dc295191\") " pod="openstack-kuttl-tests/cinder-db-sync-qk75k" Mar 16 17:04:41 crc kubenswrapper[5120]: I0316 17:04:41.445867 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/727c8c9a-fcc8-42c3-8a58-df87dc295191-config-data\") pod \"cinder-db-sync-qk75k\" (UID: \"727c8c9a-fcc8-42c3-8a58-df87dc295191\") " pod="openstack-kuttl-tests/cinder-db-sync-qk75k" Mar 16 17:04:41 crc kubenswrapper[5120]: I0316 17:04:41.446043 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/727c8c9a-fcc8-42c3-8a58-df87dc295191-combined-ca-bundle\") pod \"cinder-db-sync-qk75k\" (UID: \"727c8c9a-fcc8-42c3-8a58-df87dc295191\") " pod="openstack-kuttl-tests/cinder-db-sync-qk75k" Mar 16 17:04:41 crc kubenswrapper[5120]: I0316 17:04:41.452388 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-hjq5d" Mar 16 17:04:41 crc kubenswrapper[5120]: I0316 17:04:41.458409 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-config-data\"" Mar 16 17:04:41 crc kubenswrapper[5120]: I0316 17:04:41.458672 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-barbican-dockercfg-8tjmr\"" Mar 16 17:04:41 crc kubenswrapper[5120]: I0316 17:04:41.469074 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-hjq5d"] Mar 16 17:04:41 crc kubenswrapper[5120]: I0316 17:04:41.490531 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9cvt\" (UniqueName: \"kubernetes.io/projected/727c8c9a-fcc8-42c3-8a58-df87dc295191-kube-api-access-s9cvt\") pod \"cinder-db-sync-qk75k\" (UID: \"727c8c9a-fcc8-42c3-8a58-df87dc295191\") " pod="openstack-kuttl-tests/cinder-db-sync-qk75k" Mar 16 17:04:41 crc kubenswrapper[5120]: I0316 17:04:41.535654 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbls7\" (UniqueName: \"kubernetes.io/projected/de53f6e3-e1a7-49fd-8c2e-e57add0fe5eb-kube-api-access-nbls7\") pod \"barbican-db-sync-hjq5d\" (UID: \"de53f6e3-e1a7-49fd-8c2e-e57add0fe5eb\") " pod="openstack-kuttl-tests/barbican-db-sync-hjq5d" Mar 16 17:04:41 crc kubenswrapper[5120]: I0316 17:04:41.535821 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/de53f6e3-e1a7-49fd-8c2e-e57add0fe5eb-combined-ca-bundle\") pod \"barbican-db-sync-hjq5d\" (UID: \"de53f6e3-e1a7-49fd-8c2e-e57add0fe5eb\") " pod="openstack-kuttl-tests/barbican-db-sync-hjq5d" Mar 16 17:04:41 crc kubenswrapper[5120]: I0316 17:04:41.535878 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/de53f6e3-e1a7-49fd-8c2e-e57add0fe5eb-db-sync-config-data\") pod \"barbican-db-sync-hjq5d\" (UID: \"de53f6e3-e1a7-49fd-8c2e-e57add0fe5eb\") " pod="openstack-kuttl-tests/barbican-db-sync-hjq5d" Mar 16 17:04:41 crc kubenswrapper[5120]: I0316 17:04:41.612180 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-qk75k" Mar 16 17:04:41 crc kubenswrapper[5120]: I0316 17:04:41.639124 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nbls7\" (UniqueName: \"kubernetes.io/projected/de53f6e3-e1a7-49fd-8c2e-e57add0fe5eb-kube-api-access-nbls7\") pod \"barbican-db-sync-hjq5d\" (UID: \"de53f6e3-e1a7-49fd-8c2e-e57add0fe5eb\") " pod="openstack-kuttl-tests/barbican-db-sync-hjq5d" Mar 16 17:04:41 crc kubenswrapper[5120]: I0316 17:04:41.639229 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/de53f6e3-e1a7-49fd-8c2e-e57add0fe5eb-combined-ca-bundle\") pod \"barbican-db-sync-hjq5d\" (UID: \"de53f6e3-e1a7-49fd-8c2e-e57add0fe5eb\") " pod="openstack-kuttl-tests/barbican-db-sync-hjq5d" Mar 16 17:04:41 crc kubenswrapper[5120]: I0316 17:04:41.639310 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/de53f6e3-e1a7-49fd-8c2e-e57add0fe5eb-db-sync-config-data\") pod \"barbican-db-sync-hjq5d\" (UID: \"de53f6e3-e1a7-49fd-8c2e-e57add0fe5eb\") " pod="openstack-kuttl-tests/barbican-db-sync-hjq5d" Mar 16 17:04:41 crc kubenswrapper[5120]: I0316 17:04:41.649098 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/de53f6e3-e1a7-49fd-8c2e-e57add0fe5eb-combined-ca-bundle\") pod \"barbican-db-sync-hjq5d\" (UID: \"de53f6e3-e1a7-49fd-8c2e-e57add0fe5eb\") " pod="openstack-kuttl-tests/barbican-db-sync-hjq5d" Mar 16 17:04:41 crc kubenswrapper[5120]: I0316 17:04:41.662133 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbls7\" (UniqueName: \"kubernetes.io/projected/de53f6e3-e1a7-49fd-8c2e-e57add0fe5eb-kube-api-access-nbls7\") pod \"barbican-db-sync-hjq5d\" (UID: \"de53f6e3-e1a7-49fd-8c2e-e57add0fe5eb\") " pod="openstack-kuttl-tests/barbican-db-sync-hjq5d" Mar 16 17:04:41 crc kubenswrapper[5120]: I0316 17:04:41.662745 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-fd2mn"] Mar 16 17:04:41 crc kubenswrapper[5120]: I0316 17:04:41.664224 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/de53f6e3-e1a7-49fd-8c2e-e57add0fe5eb-db-sync-config-data\") pod \"barbican-db-sync-hjq5d\" (UID: \"de53f6e3-e1a7-49fd-8c2e-e57add0fe5eb\") " pod="openstack-kuttl-tests/barbican-db-sync-hjq5d" Mar 16 17:04:41 crc kubenswrapper[5120]: I0316 17:04:41.671069 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-fd2mn" Mar 16 17:04:41 crc kubenswrapper[5120]: I0316 17:04:41.676070 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-neutron-dockercfg-k92rs\"" Mar 16 17:04:41 crc kubenswrapper[5120]: I0316 17:04:41.676952 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-httpd-config\"" Mar 16 17:04:41 crc kubenswrapper[5120]: I0316 17:04:41.677383 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-config\"" Mar 16 17:04:41 crc kubenswrapper[5120]: I0316 17:04:41.682733 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-fd2mn"] Mar 16 17:04:41 crc kubenswrapper[5120]: I0316 17:04:41.789579 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-hjq5d" Mar 16 17:04:41 crc kubenswrapper[5120]: I0316 17:04:41.843792 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6eeffada-e22e-43d1-b349-aab71bf994eb-config\") pod \"neutron-db-sync-fd2mn\" (UID: \"6eeffada-e22e-43d1-b349-aab71bf994eb\") " pod="openstack-kuttl-tests/neutron-db-sync-fd2mn" Mar 16 17:04:41 crc kubenswrapper[5120]: I0316 17:04:41.843947 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcnlj\" (UniqueName: \"kubernetes.io/projected/6eeffada-e22e-43d1-b349-aab71bf994eb-kube-api-access-mcnlj\") pod \"neutron-db-sync-fd2mn\" (UID: \"6eeffada-e22e-43d1-b349-aab71bf994eb\") " pod="openstack-kuttl-tests/neutron-db-sync-fd2mn" Mar 16 17:04:41 crc kubenswrapper[5120]: I0316 17:04:41.844004 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6eeffada-e22e-43d1-b349-aab71bf994eb-combined-ca-bundle\") pod \"neutron-db-sync-fd2mn\" (UID: \"6eeffada-e22e-43d1-b349-aab71bf994eb\") " pod="openstack-kuttl-tests/neutron-db-sync-fd2mn" Mar 16 17:04:41 crc kubenswrapper[5120]: I0316 17:04:41.946054 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mcnlj\" (UniqueName: \"kubernetes.io/projected/6eeffada-e22e-43d1-b349-aab71bf994eb-kube-api-access-mcnlj\") pod \"neutron-db-sync-fd2mn\" (UID: \"6eeffada-e22e-43d1-b349-aab71bf994eb\") " pod="openstack-kuttl-tests/neutron-db-sync-fd2mn" Mar 16 17:04:41 crc kubenswrapper[5120]: I0316 17:04:41.946116 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6eeffada-e22e-43d1-b349-aab71bf994eb-combined-ca-bundle\") pod \"neutron-db-sync-fd2mn\" (UID: \"6eeffada-e22e-43d1-b349-aab71bf994eb\") " pod="openstack-kuttl-tests/neutron-db-sync-fd2mn" Mar 16 17:04:41 crc kubenswrapper[5120]: I0316 17:04:41.946339 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6eeffada-e22e-43d1-b349-aab71bf994eb-config\") pod \"neutron-db-sync-fd2mn\" (UID: \"6eeffada-e22e-43d1-b349-aab71bf994eb\") " pod="openstack-kuttl-tests/neutron-db-sync-fd2mn" Mar 16 17:04:41 crc kubenswrapper[5120]: I0316 17:04:41.953406 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/6eeffada-e22e-43d1-b349-aab71bf994eb-config\") pod \"neutron-db-sync-fd2mn\" (UID: \"6eeffada-e22e-43d1-b349-aab71bf994eb\") " pod="openstack-kuttl-tests/neutron-db-sync-fd2mn" Mar 16 17:04:41 crc kubenswrapper[5120]: I0316 17:04:41.954508 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6eeffada-e22e-43d1-b349-aab71bf994eb-combined-ca-bundle\") pod \"neutron-db-sync-fd2mn\" (UID: \"6eeffada-e22e-43d1-b349-aab71bf994eb\") " pod="openstack-kuttl-tests/neutron-db-sync-fd2mn" Mar 16 17:04:41 crc kubenswrapper[5120]: I0316 17:04:41.977203 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcnlj\" (UniqueName: \"kubernetes.io/projected/6eeffada-e22e-43d1-b349-aab71bf994eb-kube-api-access-mcnlj\") pod \"neutron-db-sync-fd2mn\" (UID: \"6eeffada-e22e-43d1-b349-aab71bf994eb\") " pod="openstack-kuttl-tests/neutron-db-sync-fd2mn" Mar 16 17:04:42 crc kubenswrapper[5120]: I0316 17:04:42.052889 5120 generic.go:358] "Generic (PLEG): container finished" podID="c78826fe-ae87-4178-9fdf-543f594f5afb" containerID="c13a96a511f17afa96c95d8f55fc3642a9f1ff4aa17556132d3589fc0efa0ed3" exitCode=0 Mar 16 17:04:42 crc kubenswrapper[5120]: I0316 17:04:42.053162 5120 generic.go:358] "Generic (PLEG): container finished" podID="c78826fe-ae87-4178-9fdf-543f594f5afb" containerID="e9772c73c597c88a47613d687acc08db60cb9c31aea299ccbeb9021a61dea5f7" exitCode=143 Mar 16 17:04:42 crc kubenswrapper[5120]: I0316 17:04:42.053503 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"c78826fe-ae87-4178-9fdf-543f594f5afb","Type":"ContainerDied","Data":"c13a96a511f17afa96c95d8f55fc3642a9f1ff4aa17556132d3589fc0efa0ed3"} Mar 16 17:04:42 crc kubenswrapper[5120]: I0316 17:04:42.053534 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"c78826fe-ae87-4178-9fdf-543f594f5afb","Type":"ContainerDied","Data":"e9772c73c597c88a47613d687acc08db60cb9c31aea299ccbeb9021a61dea5f7"} Mar 16 17:04:42 crc kubenswrapper[5120]: I0316 17:04:42.053991 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:04:42 crc kubenswrapper[5120]: I0316 17:04:42.055823 5120 generic.go:358] "Generic (PLEG): container finished" podID="97594790-c415-4a95-800c-9bf5c983ce70" containerID="a3bbf287ef8ad05bdb817657666447521c58519b251f3478a3d943cd4b318c42" exitCode=0 Mar 16 17:04:42 crc kubenswrapper[5120]: I0316 17:04:42.055868 5120 generic.go:358] "Generic (PLEG): container finished" podID="97594790-c415-4a95-800c-9bf5c983ce70" containerID="a0573d4baa676df06512dfb4b55a7fba469f73e506f1ae8671890e2a050a2168" exitCode=143 Mar 16 17:04:42 crc kubenswrapper[5120]: I0316 17:04:42.056017 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"97594790-c415-4a95-800c-9bf5c983ce70","Type":"ContainerDied","Data":"a3bbf287ef8ad05bdb817657666447521c58519b251f3478a3d943cd4b318c42"} Mar 16 17:04:42 crc kubenswrapper[5120]: I0316 17:04:42.056054 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"97594790-c415-4a95-800c-9bf5c983ce70","Type":"ContainerDied","Data":"a0573d4baa676df06512dfb4b55a7fba469f73e506f1ae8671890e2a050a2168"} Mar 16 17:04:42 crc kubenswrapper[5120]: I0316 17:04:42.059055 5120 generic.go:358] "Generic (PLEG): container finished" podID="1097f29f-d62e-451e-befd-0e4fbe6c3ca0" containerID="49d0fe703443d5c46a4dbd56ca15824de9b502e026cd2ba54e9f70fc748f91ee" exitCode=0 Mar 16 17:04:42 crc kubenswrapper[5120]: I0316 17:04:42.059084 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-lsvkk" event={"ID":"1097f29f-d62e-451e-befd-0e4fbe6c3ca0","Type":"ContainerDied","Data":"49d0fe703443d5c46a4dbd56ca15824de9b502e026cd2ba54e9f70fc748f91ee"} Mar 16 17:04:42 crc kubenswrapper[5120]: I0316 17:04:42.062642 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-fd2mn" Mar 16 17:04:42 crc kubenswrapper[5120]: I0316 17:04:42.149908 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/c78826fe-ae87-4178-9fdf-543f594f5afb-public-tls-certs\") pod \"c78826fe-ae87-4178-9fdf-543f594f5afb\" (UID: \"c78826fe-ae87-4178-9fdf-543f594f5afb\") " Mar 16 17:04:42 crc kubenswrapper[5120]: I0316 17:04:42.150025 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/c78826fe-ae87-4178-9fdf-543f594f5afb-httpd-run\") pod \"c78826fe-ae87-4178-9fdf-543f594f5afb\" (UID: \"c78826fe-ae87-4178-9fdf-543f594f5afb\") " Mar 16 17:04:42 crc kubenswrapper[5120]: I0316 17:04:42.150064 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c78826fe-ae87-4178-9fdf-543f594f5afb-combined-ca-bundle\") pod \"c78826fe-ae87-4178-9fdf-543f594f5afb\" (UID: \"c78826fe-ae87-4178-9fdf-543f594f5afb\") " Mar 16 17:04:42 crc kubenswrapper[5120]: I0316 17:04:42.150196 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zbmgh\" (UniqueName: \"kubernetes.io/projected/c78826fe-ae87-4178-9fdf-543f594f5afb-kube-api-access-zbmgh\") pod \"c78826fe-ae87-4178-9fdf-543f594f5afb\" (UID: \"c78826fe-ae87-4178-9fdf-543f594f5afb\") " Mar 16 17:04:42 crc kubenswrapper[5120]: I0316 17:04:42.150490 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c78826fe-ae87-4178-9fdf-543f594f5afb-logs\") pod \"c78826fe-ae87-4178-9fdf-543f594f5afb\" (UID: \"c78826fe-ae87-4178-9fdf-543f594f5afb\") " Mar 16 17:04:42 crc kubenswrapper[5120]: I0316 17:04:42.150534 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c78826fe-ae87-4178-9fdf-543f594f5afb-config-data\") pod \"c78826fe-ae87-4178-9fdf-543f594f5afb\" (UID: \"c78826fe-ae87-4178-9fdf-543f594f5afb\") " Mar 16 17:04:42 crc kubenswrapper[5120]: I0316 17:04:42.150637 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"c78826fe-ae87-4178-9fdf-543f594f5afb\" (UID: \"c78826fe-ae87-4178-9fdf-543f594f5afb\") " Mar 16 17:04:42 crc kubenswrapper[5120]: I0316 17:04:42.150669 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c78826fe-ae87-4178-9fdf-543f594f5afb-scripts\") pod \"c78826fe-ae87-4178-9fdf-543f594f5afb\" (UID: \"c78826fe-ae87-4178-9fdf-543f594f5afb\") " Mar 16 17:04:42 crc kubenswrapper[5120]: I0316 17:04:42.150704 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c78826fe-ae87-4178-9fdf-543f594f5afb-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "c78826fe-ae87-4178-9fdf-543f594f5afb" (UID: "c78826fe-ae87-4178-9fdf-543f594f5afb"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:04:42 crc kubenswrapper[5120]: I0316 17:04:42.151265 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/c78826fe-ae87-4178-9fdf-543f594f5afb-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 17:04:42 crc kubenswrapper[5120]: I0316 17:04:42.151840 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c78826fe-ae87-4178-9fdf-543f594f5afb-logs" (OuterVolumeSpecName: "logs") pod "c78826fe-ae87-4178-9fdf-543f594f5afb" (UID: "c78826fe-ae87-4178-9fdf-543f594f5afb"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:04:42 crc kubenswrapper[5120]: I0316 17:04:42.162024 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c78826fe-ae87-4178-9fdf-543f594f5afb-scripts" (OuterVolumeSpecName: "scripts") pod "c78826fe-ae87-4178-9fdf-543f594f5afb" (UID: "c78826fe-ae87-4178-9fdf-543f594f5afb"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:04:42 crc kubenswrapper[5120]: I0316 17:04:42.166941 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage05-crc" (OuterVolumeSpecName: "glance") pod "c78826fe-ae87-4178-9fdf-543f594f5afb" (UID: "c78826fe-ae87-4178-9fdf-543f594f5afb"). InnerVolumeSpecName "local-storage05-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 17:04:42 crc kubenswrapper[5120]: I0316 17:04:42.166995 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c78826fe-ae87-4178-9fdf-543f594f5afb-kube-api-access-zbmgh" (OuterVolumeSpecName: "kube-api-access-zbmgh") pod "c78826fe-ae87-4178-9fdf-543f594f5afb" (UID: "c78826fe-ae87-4178-9fdf-543f594f5afb"). InnerVolumeSpecName "kube-api-access-zbmgh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:04:42 crc kubenswrapper[5120]: I0316 17:04:42.185099 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:04:42 crc kubenswrapper[5120]: I0316 17:04:42.201015 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c78826fe-ae87-4178-9fdf-543f594f5afb-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "c78826fe-ae87-4178-9fdf-543f594f5afb" (UID: "c78826fe-ae87-4178-9fdf-543f594f5afb"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:04:42 crc kubenswrapper[5120]: I0316 17:04:42.253572 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c78826fe-ae87-4178-9fdf-543f594f5afb-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:04:42 crc kubenswrapper[5120]: I0316 17:04:42.253977 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zbmgh\" (UniqueName: \"kubernetes.io/projected/c78826fe-ae87-4178-9fdf-543f594f5afb-kube-api-access-zbmgh\") on node \"crc\" DevicePath \"\"" Mar 16 17:04:42 crc kubenswrapper[5120]: I0316 17:04:42.254022 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c78826fe-ae87-4178-9fdf-543f594f5afb-logs\") on node \"crc\" DevicePath \"\"" Mar 16 17:04:42 crc kubenswrapper[5120]: I0316 17:04:42.254053 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") on node \"crc\" " Mar 16 17:04:42 crc kubenswrapper[5120]: I0316 17:04:42.254061 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c78826fe-ae87-4178-9fdf-543f594f5afb-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:04:42 crc kubenswrapper[5120]: I0316 17:04:42.254304 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c78826fe-ae87-4178-9fdf-543f594f5afb-config-data" (OuterVolumeSpecName: "config-data") pod "c78826fe-ae87-4178-9fdf-543f594f5afb" (UID: "c78826fe-ae87-4178-9fdf-543f594f5afb"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:04:42 crc kubenswrapper[5120]: I0316 17:04:42.271904 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c78826fe-ae87-4178-9fdf-543f594f5afb-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "c78826fe-ae87-4178-9fdf-543f594f5afb" (UID: "c78826fe-ae87-4178-9fdf-543f594f5afb"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:04:42 crc kubenswrapper[5120]: I0316 17:04:42.283311 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage05-crc" (UniqueName: "kubernetes.io/local-volume/local-storage05-crc") on node "crc" Mar 16 17:04:42 crc kubenswrapper[5120]: I0316 17:04:42.356100 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/97594790-c415-4a95-800c-9bf5c983ce70-combined-ca-bundle\") pod \"97594790-c415-4a95-800c-9bf5c983ce70\" (UID: \"97594790-c415-4a95-800c-9bf5c983ce70\") " Mar 16 17:04:42 crc kubenswrapper[5120]: I0316 17:04:42.356410 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"97594790-c415-4a95-800c-9bf5c983ce70\" (UID: \"97594790-c415-4a95-800c-9bf5c983ce70\") " Mar 16 17:04:42 crc kubenswrapper[5120]: I0316 17:04:42.356584 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/97594790-c415-4a95-800c-9bf5c983ce70-config-data\") pod \"97594790-c415-4a95-800c-9bf5c983ce70\" (UID: \"97594790-c415-4a95-800c-9bf5c983ce70\") " Mar 16 17:04:42 crc kubenswrapper[5120]: I0316 17:04:42.356784 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/97594790-c415-4a95-800c-9bf5c983ce70-httpd-run\") pod \"97594790-c415-4a95-800c-9bf5c983ce70\" (UID: \"97594790-c415-4a95-800c-9bf5c983ce70\") " Mar 16 17:04:42 crc kubenswrapper[5120]: I0316 17:04:42.356836 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/97594790-c415-4a95-800c-9bf5c983ce70-internal-tls-certs\") pod \"97594790-c415-4a95-800c-9bf5c983ce70\" (UID: \"97594790-c415-4a95-800c-9bf5c983ce70\") " Mar 16 17:04:42 crc kubenswrapper[5120]: I0316 17:04:42.356982 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xpjll\" (UniqueName: \"kubernetes.io/projected/97594790-c415-4a95-800c-9bf5c983ce70-kube-api-access-xpjll\") pod \"97594790-c415-4a95-800c-9bf5c983ce70\" (UID: \"97594790-c415-4a95-800c-9bf5c983ce70\") " Mar 16 17:04:42 crc kubenswrapper[5120]: I0316 17:04:42.357147 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/97594790-c415-4a95-800c-9bf5c983ce70-logs\") pod \"97594790-c415-4a95-800c-9bf5c983ce70\" (UID: \"97594790-c415-4a95-800c-9bf5c983ce70\") " Mar 16 17:04:42 crc kubenswrapper[5120]: I0316 17:04:42.357326 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/97594790-c415-4a95-800c-9bf5c983ce70-scripts\") pod \"97594790-c415-4a95-800c-9bf5c983ce70\" (UID: \"97594790-c415-4a95-800c-9bf5c983ce70\") " Mar 16 17:04:42 crc kubenswrapper[5120]: I0316 17:04:42.357674 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97594790-c415-4a95-800c-9bf5c983ce70-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "97594790-c415-4a95-800c-9bf5c983ce70" (UID: "97594790-c415-4a95-800c-9bf5c983ce70"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:04:42 crc kubenswrapper[5120]: I0316 17:04:42.358574 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97594790-c415-4a95-800c-9bf5c983ce70-logs" (OuterVolumeSpecName: "logs") pod "97594790-c415-4a95-800c-9bf5c983ce70" (UID: "97594790-c415-4a95-800c-9bf5c983ce70"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:04:42 crc kubenswrapper[5120]: I0316 17:04:42.358920 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/97594790-c415-4a95-800c-9bf5c983ce70-logs\") on node \"crc\" DevicePath \"\"" Mar 16 17:04:42 crc kubenswrapper[5120]: I0316 17:04:42.358956 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c78826fe-ae87-4178-9fdf-543f594f5afb-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:04:42 crc kubenswrapper[5120]: I0316 17:04:42.358974 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") on node \"crc\" DevicePath \"\"" Mar 16 17:04:42 crc kubenswrapper[5120]: I0316 17:04:42.358990 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/c78826fe-ae87-4178-9fdf-543f594f5afb-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:04:42 crc kubenswrapper[5120]: I0316 17:04:42.359006 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/97594790-c415-4a95-800c-9bf5c983ce70-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 17:04:42 crc kubenswrapper[5120]: I0316 17:04:42.368851 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/97594790-c415-4a95-800c-9bf5c983ce70-scripts" (OuterVolumeSpecName: "scripts") pod "97594790-c415-4a95-800c-9bf5c983ce70" (UID: "97594790-c415-4a95-800c-9bf5c983ce70"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:04:42 crc kubenswrapper[5120]: I0316 17:04:42.384342 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97594790-c415-4a95-800c-9bf5c983ce70-kube-api-access-xpjll" (OuterVolumeSpecName: "kube-api-access-xpjll") pod "97594790-c415-4a95-800c-9bf5c983ce70" (UID: "97594790-c415-4a95-800c-9bf5c983ce70"). InnerVolumeSpecName "kube-api-access-xpjll". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:04:42 crc kubenswrapper[5120]: I0316 17:04:42.395995 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage06-crc" (OuterVolumeSpecName: "glance") pod "97594790-c415-4a95-800c-9bf5c983ce70" (UID: "97594790-c415-4a95-800c-9bf5c983ce70"). InnerVolumeSpecName "local-storage06-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 17:04:42 crc kubenswrapper[5120]: I0316 17:04:42.421145 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/97594790-c415-4a95-800c-9bf5c983ce70-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "97594790-c415-4a95-800c-9bf5c983ce70" (UID: "97594790-c415-4a95-800c-9bf5c983ce70"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:04:42 crc kubenswrapper[5120]: E0316 17:04:42.442119 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97594790-c415-4a95-800c-9bf5c983ce70-internal-tls-certs podName:97594790-c415-4a95-800c-9bf5c983ce70 nodeName:}" failed. No retries permitted until 2026-03-16 17:04:42.942090179 +0000 UTC m=+5585.096021836 (durationBeforeRetry 500ms). Error: error cleaning subPath mounts for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/97594790-c415-4a95-800c-9bf5c983ce70-internal-tls-certs") pod "97594790-c415-4a95-800c-9bf5c983ce70" (UID: "97594790-c415-4a95-800c-9bf5c983ce70") : error deleting /var/lib/kubelet/pods/97594790-c415-4a95-800c-9bf5c983ce70/volume-subpaths: remove /var/lib/kubelet/pods/97594790-c415-4a95-800c-9bf5c983ce70/volume-subpaths: no such file or directory Mar 16 17:04:42 crc kubenswrapper[5120]: I0316 17:04:42.446188 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/97594790-c415-4a95-800c-9bf5c983ce70-config-data" (OuterVolumeSpecName: "config-data") pod "97594790-c415-4a95-800c-9bf5c983ce70" (UID: "97594790-c415-4a95-800c-9bf5c983ce70"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:04:42 crc kubenswrapper[5120]: I0316 17:04:42.461833 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") on node \"crc\" " Mar 16 17:04:42 crc kubenswrapper[5120]: I0316 17:04:42.461861 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/97594790-c415-4a95-800c-9bf5c983ce70-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:04:42 crc kubenswrapper[5120]: I0316 17:04:42.461872 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xpjll\" (UniqueName: \"kubernetes.io/projected/97594790-c415-4a95-800c-9bf5c983ce70-kube-api-access-xpjll\") on node \"crc\" DevicePath \"\"" Mar 16 17:04:42 crc kubenswrapper[5120]: I0316 17:04:42.461882 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/97594790-c415-4a95-800c-9bf5c983ce70-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:04:42 crc kubenswrapper[5120]: I0316 17:04:42.461919 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/97594790-c415-4a95-800c-9bf5c983ce70-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:04:42 crc kubenswrapper[5120]: I0316 17:04:42.484185 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage06-crc" (UniqueName: "kubernetes.io/local-volume/local-storage06-crc") on node "crc" Mar 16 17:04:42 crc kubenswrapper[5120]: I0316 17:04:42.542697 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-b8q8w" Mar 16 17:04:42 crc kubenswrapper[5120]: I0316 17:04:42.567127 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") on node \"crc\" DevicePath \"\"" Mar 16 17:04:42 crc kubenswrapper[5120]: W0316 17:04:42.612551 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podde53f6e3_e1a7_49fd_8c2e_e57add0fe5eb.slice/crio-eeba41650291e17d1384cf8545c1428f626459d3b0f32a68390de0b2a6229e26 WatchSource:0}: Error finding container eeba41650291e17d1384cf8545c1428f626459d3b0f32a68390de0b2a6229e26: Status 404 returned error can't find the container with id eeba41650291e17d1384cf8545c1428f626459d3b0f32a68390de0b2a6229e26 Mar 16 17:04:42 crc kubenswrapper[5120]: I0316 17:04:42.631919 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-hjq5d"] Mar 16 17:04:42 crc kubenswrapper[5120]: W0316 17:04:42.633534 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6eeffada_e22e_43d1_b349_aab71bf994eb.slice/crio-cb4c9617efe6a2e1f69b1406ae33c2d6c24b10c247d3b16856757f56e95c48b5 WatchSource:0}: Error finding container cb4c9617efe6a2e1f69b1406ae33c2d6c24b10c247d3b16856757f56e95c48b5: Status 404 returned error can't find the container with id cb4c9617efe6a2e1f69b1406ae33c2d6c24b10c247d3b16856757f56e95c48b5 Mar 16 17:04:42 crc kubenswrapper[5120]: I0316 17:04:42.644301 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-fd2mn"] Mar 16 17:04:42 crc kubenswrapper[5120]: I0316 17:04:42.670875 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ef0e4aec-f4b7-43b1-9496-2b50031875a4-config-data\") pod \"ef0e4aec-f4b7-43b1-9496-2b50031875a4\" (UID: \"ef0e4aec-f4b7-43b1-9496-2b50031875a4\") " Mar 16 17:04:42 crc kubenswrapper[5120]: I0316 17:04:42.671026 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ef0e4aec-f4b7-43b1-9496-2b50031875a4-scripts\") pod \"ef0e4aec-f4b7-43b1-9496-2b50031875a4\" (UID: \"ef0e4aec-f4b7-43b1-9496-2b50031875a4\") " Mar 16 17:04:42 crc kubenswrapper[5120]: I0316 17:04:42.671178 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-85bw6\" (UniqueName: \"kubernetes.io/projected/ef0e4aec-f4b7-43b1-9496-2b50031875a4-kube-api-access-85bw6\") pod \"ef0e4aec-f4b7-43b1-9496-2b50031875a4\" (UID: \"ef0e4aec-f4b7-43b1-9496-2b50031875a4\") " Mar 16 17:04:42 crc kubenswrapper[5120]: I0316 17:04:42.671545 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ef0e4aec-f4b7-43b1-9496-2b50031875a4-combined-ca-bundle\") pod \"ef0e4aec-f4b7-43b1-9496-2b50031875a4\" (UID: \"ef0e4aec-f4b7-43b1-9496-2b50031875a4\") " Mar 16 17:04:42 crc kubenswrapper[5120]: I0316 17:04:42.674267 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ef0e4aec-f4b7-43b1-9496-2b50031875a4-logs\") pod \"ef0e4aec-f4b7-43b1-9496-2b50031875a4\" (UID: \"ef0e4aec-f4b7-43b1-9496-2b50031875a4\") " Mar 16 17:04:42 crc kubenswrapper[5120]: I0316 17:04:42.675399 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef0e4aec-f4b7-43b1-9496-2b50031875a4-logs" (OuterVolumeSpecName: "logs") pod "ef0e4aec-f4b7-43b1-9496-2b50031875a4" (UID: "ef0e4aec-f4b7-43b1-9496-2b50031875a4"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:04:42 crc kubenswrapper[5120]: I0316 17:04:42.678744 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef0e4aec-f4b7-43b1-9496-2b50031875a4-kube-api-access-85bw6" (OuterVolumeSpecName: "kube-api-access-85bw6") pod "ef0e4aec-f4b7-43b1-9496-2b50031875a4" (UID: "ef0e4aec-f4b7-43b1-9496-2b50031875a4"). InnerVolumeSpecName "kube-api-access-85bw6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:04:42 crc kubenswrapper[5120]: I0316 17:04:42.685616 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef0e4aec-f4b7-43b1-9496-2b50031875a4-scripts" (OuterVolumeSpecName: "scripts") pod "ef0e4aec-f4b7-43b1-9496-2b50031875a4" (UID: "ef0e4aec-f4b7-43b1-9496-2b50031875a4"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:04:42 crc kubenswrapper[5120]: I0316 17:04:42.723824 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef0e4aec-f4b7-43b1-9496-2b50031875a4-config-data" (OuterVolumeSpecName: "config-data") pod "ef0e4aec-f4b7-43b1-9496-2b50031875a4" (UID: "ef0e4aec-f4b7-43b1-9496-2b50031875a4"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:04:42 crc kubenswrapper[5120]: I0316 17:04:42.728506 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef0e4aec-f4b7-43b1-9496-2b50031875a4-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ef0e4aec-f4b7-43b1-9496-2b50031875a4" (UID: "ef0e4aec-f4b7-43b1-9496-2b50031875a4"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:04:42 crc kubenswrapper[5120]: I0316 17:04:42.780622 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ef0e4aec-f4b7-43b1-9496-2b50031875a4-logs\") on node \"crc\" DevicePath \"\"" Mar 16 17:04:42 crc kubenswrapper[5120]: I0316 17:04:42.780658 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ef0e4aec-f4b7-43b1-9496-2b50031875a4-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:04:42 crc kubenswrapper[5120]: I0316 17:04:42.780671 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ef0e4aec-f4b7-43b1-9496-2b50031875a4-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:04:42 crc kubenswrapper[5120]: I0316 17:04:42.780683 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-85bw6\" (UniqueName: \"kubernetes.io/projected/ef0e4aec-f4b7-43b1-9496-2b50031875a4-kube-api-access-85bw6\") on node \"crc\" DevicePath \"\"" Mar 16 17:04:42 crc kubenswrapper[5120]: I0316 17:04:42.780695 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ef0e4aec-f4b7-43b1-9496-2b50031875a4-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:04:42 crc kubenswrapper[5120]: I0316 17:04:42.818383 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-qk75k"] Mar 16 17:04:42 crc kubenswrapper[5120]: I0316 17:04:42.983566 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/97594790-c415-4a95-800c-9bf5c983ce70-internal-tls-certs\") pod \"97594790-c415-4a95-800c-9bf5c983ce70\" (UID: \"97594790-c415-4a95-800c-9bf5c983ce70\") " Mar 16 17:04:42 crc kubenswrapper[5120]: I0316 17:04:42.989246 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/97594790-c415-4a95-800c-9bf5c983ce70-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "97594790-c415-4a95-800c-9bf5c983ce70" (UID: "97594790-c415-4a95-800c-9bf5c983ce70"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.084132 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-fd2mn" event={"ID":"6eeffada-e22e-43d1-b349-aab71bf994eb","Type":"ContainerStarted","Data":"5a021c077594081de548e79d15b87b604c22660a4b0c83508b50545f82c4fb3c"} Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.084186 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-fd2mn" event={"ID":"6eeffada-e22e-43d1-b349-aab71bf994eb","Type":"ContainerStarted","Data":"cb4c9617efe6a2e1f69b1406ae33c2d6c24b10c247d3b16856757f56e95c48b5"} Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.085984 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/97594790-c415-4a95-800c-9bf5c983ce70-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.095959 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"97594790-c415-4a95-800c-9bf5c983ce70","Type":"ContainerDied","Data":"ec21412ee04fadaf8783ad8a4c869c954ccca72017f1529957220966838b3b40"} Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.096018 5120 scope.go:117] "RemoveContainer" containerID="a3bbf287ef8ad05bdb817657666447521c58519b251f3478a3d943cd4b318c42" Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.096182 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.115887 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-db-sync-fd2mn" podStartSLOduration=2.115870712 podStartE2EDuration="2.115870712s" podCreationTimestamp="2026-03-16 17:04:41 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:04:43.107482131 +0000 UTC m=+5585.261413788" watchObservedRunningTime="2026-03-16 17:04:43.115870712 +0000 UTC m=+5585.269802369" Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.120852 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-qk75k" event={"ID":"727c8c9a-fcc8-42c3-8a58-df87dc295191","Type":"ContainerStarted","Data":"fcae1d6d4771a3c3cd2083230ef418042229a67dc509d85100d321819adc5d80"} Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.134093 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-b8q8w" event={"ID":"ef0e4aec-f4b7-43b1-9496-2b50031875a4","Type":"ContainerDied","Data":"f466ea7c1405b7d13f0ecec3fc1e1b82b69652644b358afe9a332debc79bcc47"} Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.134152 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f466ea7c1405b7d13f0ecec3fc1e1b82b69652644b358afe9a332debc79bcc47" Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.134238 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-b8q8w" Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.141012 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-hjq5d" event={"ID":"de53f6e3-e1a7-49fd-8c2e-e57add0fe5eb","Type":"ContainerStarted","Data":"9af52bd4160e110b5dbee7df41625a71b1f855885bb069a59f279a7e651995ab"} Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.141060 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-hjq5d" event={"ID":"de53f6e3-e1a7-49fd-8c2e-e57add0fe5eb","Type":"ContainerStarted","Data":"eeba41650291e17d1384cf8545c1428f626459d3b0f32a68390de0b2a6229e26"} Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.175233 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.175384 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"c78826fe-ae87-4178-9fdf-543f594f5afb","Type":"ContainerDied","Data":"e16568865ddf5a19efb932850721a1c2d040935a963c4fec6753e931328fc726"} Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.274445 5120 scope.go:117] "RemoveContainer" containerID="a0573d4baa676df06512dfb4b55a7fba469f73e506f1ae8671890e2a050a2168" Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.285938 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-784497c6b4-5g4fn"] Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.288099 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c78826fe-ae87-4178-9fdf-543f594f5afb" containerName="glance-log" Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.288123 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c78826fe-ae87-4178-9fdf-543f594f5afb" containerName="glance-log" Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.288131 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97594790-c415-4a95-800c-9bf5c983ce70" containerName="glance-httpd" Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.288137 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="97594790-c415-4a95-800c-9bf5c983ce70" containerName="glance-httpd" Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.288155 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef0e4aec-f4b7-43b1-9496-2b50031875a4" containerName="placement-db-sync" Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.288164 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef0e4aec-f4b7-43b1-9496-2b50031875a4" containerName="placement-db-sync" Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.288179 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97594790-c415-4a95-800c-9bf5c983ce70" containerName="glance-log" Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.288184 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="97594790-c415-4a95-800c-9bf5c983ce70" containerName="glance-log" Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.288202 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c78826fe-ae87-4178-9fdf-543f594f5afb" containerName="glance-httpd" Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.288207 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c78826fe-ae87-4178-9fdf-543f594f5afb" containerName="glance-httpd" Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.288371 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c78826fe-ae87-4178-9fdf-543f594f5afb" containerName="glance-httpd" Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.288381 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c78826fe-ae87-4178-9fdf-543f594f5afb" containerName="glance-log" Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.288390 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="97594790-c415-4a95-800c-9bf5c983ce70" containerName="glance-httpd" Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.288407 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ef0e4aec-f4b7-43b1-9496-2b50031875a4" containerName="placement-db-sync" Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.288419 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="97594790-c415-4a95-800c-9bf5c983ce70" containerName="glance-log" Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.296688 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-784497c6b4-5g4fn" Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.299576 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-placement-internal-svc\"" Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.299918 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-config-data\"" Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.300187 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-placement-public-svc\"" Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.300332 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-placement-dockercfg-2bl8h\"" Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.301723 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-scripts\"" Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.307173 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-784497c6b4-5g4fn"] Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.325114 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.357562 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.357776 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-db-sync-hjq5d" podStartSLOduration=2.357741564 podStartE2EDuration="2.357741564s" podCreationTimestamp="2026-03-16 17:04:41 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:04:43.168104445 +0000 UTC m=+5585.322036102" watchObservedRunningTime="2026-03-16 17:04:43.357741564 +0000 UTC m=+5585.511673221" Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.384274 5120 scope.go:117] "RemoveContainer" containerID="c13a96a511f17afa96c95d8f55fc3642a9f1ff4aa17556132d3589fc0efa0ed3" Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.384383 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.398580 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/16bbeb65-e9fb-4f92-9642-83ac828e09d7-logs\") pod \"placement-784497c6b4-5g4fn\" (UID: \"16bbeb65-e9fb-4f92-9642-83ac828e09d7\") " pod="openstack-kuttl-tests/placement-784497c6b4-5g4fn" Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.398652 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/16bbeb65-e9fb-4f92-9642-83ac828e09d7-config-data\") pod \"placement-784497c6b4-5g4fn\" (UID: \"16bbeb65-e9fb-4f92-9642-83ac828e09d7\") " pod="openstack-kuttl-tests/placement-784497c6b4-5g4fn" Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.398890 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/16bbeb65-e9fb-4f92-9642-83ac828e09d7-scripts\") pod \"placement-784497c6b4-5g4fn\" (UID: \"16bbeb65-e9fb-4f92-9642-83ac828e09d7\") " pod="openstack-kuttl-tests/placement-784497c6b4-5g4fn" Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.398935 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2fvc\" (UniqueName: \"kubernetes.io/projected/16bbeb65-e9fb-4f92-9642-83ac828e09d7-kube-api-access-m2fvc\") pod \"placement-784497c6b4-5g4fn\" (UID: \"16bbeb65-e9fb-4f92-9642-83ac828e09d7\") " pod="openstack-kuttl-tests/placement-784497c6b4-5g4fn" Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.399145 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/16bbeb65-e9fb-4f92-9642-83ac828e09d7-combined-ca-bundle\") pod \"placement-784497c6b4-5g4fn\" (UID: \"16bbeb65-e9fb-4f92-9642-83ac828e09d7\") " pod="openstack-kuttl-tests/placement-784497c6b4-5g4fn" Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.399483 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/16bbeb65-e9fb-4f92-9642-83ac828e09d7-public-tls-certs\") pod \"placement-784497c6b4-5g4fn\" (UID: \"16bbeb65-e9fb-4f92-9642-83ac828e09d7\") " pod="openstack-kuttl-tests/placement-784497c6b4-5g4fn" Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.399641 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/16bbeb65-e9fb-4f92-9642-83ac828e09d7-internal-tls-certs\") pod \"placement-784497c6b4-5g4fn\" (UID: \"16bbeb65-e9fb-4f92-9642-83ac828e09d7\") " pod="openstack-kuttl-tests/placement-784497c6b4-5g4fn" Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.404699 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.407472 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.411952 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-internal-config-data\"" Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.412168 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-glance-dockercfg-w6x6w\"" Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.420084 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.425257 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-internal-svc\"" Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.425609 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-scripts\"" Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.451199 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.460988 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.473140 5120 scope.go:117] "RemoveContainer" containerID="e9772c73c597c88a47613d687acc08db60cb9c31aea299ccbeb9021a61dea5f7" Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.473269 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.477948 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-external-config-data\"" Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.478634 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-public-svc\"" Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.485748 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.501047 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mplsq\" (UniqueName: \"kubernetes.io/projected/4b135a46-d885-4bc3-8344-f00c571b74fd-kube-api-access-mplsq\") pod \"glance-default-internal-api-0\" (UID: \"4b135a46-d885-4bc3-8344-f00c571b74fd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.501146 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4b135a46-d885-4bc3-8344-f00c571b74fd-config-data\") pod \"glance-default-internal-api-0\" (UID: \"4b135a46-d885-4bc3-8344-f00c571b74fd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.501240 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4b135a46-d885-4bc3-8344-f00c571b74fd-logs\") pod \"glance-default-internal-api-0\" (UID: \"4b135a46-d885-4bc3-8344-f00c571b74fd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.501282 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/16bbeb65-e9fb-4f92-9642-83ac828e09d7-scripts\") pod \"placement-784497c6b4-5g4fn\" (UID: \"16bbeb65-e9fb-4f92-9642-83ac828e09d7\") " pod="openstack-kuttl-tests/placement-784497c6b4-5g4fn" Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.501320 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m2fvc\" (UniqueName: \"kubernetes.io/projected/16bbeb65-e9fb-4f92-9642-83ac828e09d7-kube-api-access-m2fvc\") pod \"placement-784497c6b4-5g4fn\" (UID: \"16bbeb65-e9fb-4f92-9642-83ac828e09d7\") " pod="openstack-kuttl-tests/placement-784497c6b4-5g4fn" Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.501352 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/16bbeb65-e9fb-4f92-9642-83ac828e09d7-combined-ca-bundle\") pod \"placement-784497c6b4-5g4fn\" (UID: \"16bbeb65-e9fb-4f92-9642-83ac828e09d7\") " pod="openstack-kuttl-tests/placement-784497c6b4-5g4fn" Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.501459 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/16bbeb65-e9fb-4f92-9642-83ac828e09d7-public-tls-certs\") pod \"placement-784497c6b4-5g4fn\" (UID: \"16bbeb65-e9fb-4f92-9642-83ac828e09d7\") " pod="openstack-kuttl-tests/placement-784497c6b4-5g4fn" Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.501513 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4b135a46-d885-4bc3-8344-f00c571b74fd-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"4b135a46-d885-4bc3-8344-f00c571b74fd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.501543 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/4b135a46-d885-4bc3-8344-f00c571b74fd-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"4b135a46-d885-4bc3-8344-f00c571b74fd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.501678 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4b135a46-d885-4bc3-8344-f00c571b74fd-scripts\") pod \"glance-default-internal-api-0\" (UID: \"4b135a46-d885-4bc3-8344-f00c571b74fd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.502221 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/16bbeb65-e9fb-4f92-9642-83ac828e09d7-internal-tls-certs\") pod \"placement-784497c6b4-5g4fn\" (UID: \"16bbeb65-e9fb-4f92-9642-83ac828e09d7\") " pod="openstack-kuttl-tests/placement-784497c6b4-5g4fn" Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.506149 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/16bbeb65-e9fb-4f92-9642-83ac828e09d7-logs\") pod \"placement-784497c6b4-5g4fn\" (UID: \"16bbeb65-e9fb-4f92-9642-83ac828e09d7\") " pod="openstack-kuttl-tests/placement-784497c6b4-5g4fn" Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.506424 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/16bbeb65-e9fb-4f92-9642-83ac828e09d7-config-data\") pod \"placement-784497c6b4-5g4fn\" (UID: \"16bbeb65-e9fb-4f92-9642-83ac828e09d7\") " pod="openstack-kuttl-tests/placement-784497c6b4-5g4fn" Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.506477 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/4b135a46-d885-4bc3-8344-f00c571b74fd-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"4b135a46-d885-4bc3-8344-f00c571b74fd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.507008 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"glance-default-internal-api-0\" (UID: \"4b135a46-d885-4bc3-8344-f00c571b74fd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.509981 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/16bbeb65-e9fb-4f92-9642-83ac828e09d7-logs\") pod \"placement-784497c6b4-5g4fn\" (UID: \"16bbeb65-e9fb-4f92-9642-83ac828e09d7\") " pod="openstack-kuttl-tests/placement-784497c6b4-5g4fn" Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.514445 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/16bbeb65-e9fb-4f92-9642-83ac828e09d7-config-data\") pod \"placement-784497c6b4-5g4fn\" (UID: \"16bbeb65-e9fb-4f92-9642-83ac828e09d7\") " pod="openstack-kuttl-tests/placement-784497c6b4-5g4fn" Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.516056 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/16bbeb65-e9fb-4f92-9642-83ac828e09d7-combined-ca-bundle\") pod \"placement-784497c6b4-5g4fn\" (UID: \"16bbeb65-e9fb-4f92-9642-83ac828e09d7\") " pod="openstack-kuttl-tests/placement-784497c6b4-5g4fn" Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.519239 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2fvc\" (UniqueName: \"kubernetes.io/projected/16bbeb65-e9fb-4f92-9642-83ac828e09d7-kube-api-access-m2fvc\") pod \"placement-784497c6b4-5g4fn\" (UID: \"16bbeb65-e9fb-4f92-9642-83ac828e09d7\") " pod="openstack-kuttl-tests/placement-784497c6b4-5g4fn" Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.525594 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/16bbeb65-e9fb-4f92-9642-83ac828e09d7-internal-tls-certs\") pod \"placement-784497c6b4-5g4fn\" (UID: \"16bbeb65-e9fb-4f92-9642-83ac828e09d7\") " pod="openstack-kuttl-tests/placement-784497c6b4-5g4fn" Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.531081 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/16bbeb65-e9fb-4f92-9642-83ac828e09d7-public-tls-certs\") pod \"placement-784497c6b4-5g4fn\" (UID: \"16bbeb65-e9fb-4f92-9642-83ac828e09d7\") " pod="openstack-kuttl-tests/placement-784497c6b4-5g4fn" Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.538217 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/16bbeb65-e9fb-4f92-9642-83ac828e09d7-scripts\") pod \"placement-784497c6b4-5g4fn\" (UID: \"16bbeb65-e9fb-4f92-9642-83ac828e09d7\") " pod="openstack-kuttl-tests/placement-784497c6b4-5g4fn" Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.611062 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/4b135a46-d885-4bc3-8344-f00c571b74fd-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"4b135a46-d885-4bc3-8344-f00c571b74fd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.611158 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"glance-default-internal-api-0\" (UID: \"4b135a46-d885-4bc3-8344-f00c571b74fd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.611199 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mplsq\" (UniqueName: \"kubernetes.io/projected/4b135a46-d885-4bc3-8344-f00c571b74fd-kube-api-access-mplsq\") pod \"glance-default-internal-api-0\" (UID: \"4b135a46-d885-4bc3-8344-f00c571b74fd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.611253 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xr7qv\" (UniqueName: \"kubernetes.io/projected/96b6737b-826e-4600-978e-3384f064dd15-kube-api-access-xr7qv\") pod \"glance-default-external-api-0\" (UID: \"96b6737b-826e-4600-978e-3384f064dd15\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.611290 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4b135a46-d885-4bc3-8344-f00c571b74fd-config-data\") pod \"glance-default-internal-api-0\" (UID: \"4b135a46-d885-4bc3-8344-f00c571b74fd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.611330 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/96b6737b-826e-4600-978e-3384f064dd15-config-data\") pod \"glance-default-external-api-0\" (UID: \"96b6737b-826e-4600-978e-3384f064dd15\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.611379 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4b135a46-d885-4bc3-8344-f00c571b74fd-logs\") pod \"glance-default-internal-api-0\" (UID: \"4b135a46-d885-4bc3-8344-f00c571b74fd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.611436 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/96b6737b-826e-4600-978e-3384f064dd15-scripts\") pod \"glance-default-external-api-0\" (UID: \"96b6737b-826e-4600-978e-3384f064dd15\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.611466 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/96b6737b-826e-4600-978e-3384f064dd15-logs\") pod \"glance-default-external-api-0\" (UID: \"96b6737b-826e-4600-978e-3384f064dd15\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.611493 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/96b6737b-826e-4600-978e-3384f064dd15-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"96b6737b-826e-4600-978e-3384f064dd15\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.611519 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4b135a46-d885-4bc3-8344-f00c571b74fd-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"4b135a46-d885-4bc3-8344-f00c571b74fd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.611543 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/4b135a46-d885-4bc3-8344-f00c571b74fd-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"4b135a46-d885-4bc3-8344-f00c571b74fd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.611598 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4b135a46-d885-4bc3-8344-f00c571b74fd-scripts\") pod \"glance-default-internal-api-0\" (UID: \"4b135a46-d885-4bc3-8344-f00c571b74fd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.611695 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/96b6737b-826e-4600-978e-3384f064dd15-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"96b6737b-826e-4600-978e-3384f064dd15\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.611715 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"glance-default-external-api-0\" (UID: \"96b6737b-826e-4600-978e-3384f064dd15\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.611824 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/96b6737b-826e-4600-978e-3384f064dd15-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"96b6737b-826e-4600-978e-3384f064dd15\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.613885 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/4b135a46-d885-4bc3-8344-f00c571b74fd-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"4b135a46-d885-4bc3-8344-f00c571b74fd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.613966 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4b135a46-d885-4bc3-8344-f00c571b74fd-logs\") pod \"glance-default-internal-api-0\" (UID: \"4b135a46-d885-4bc3-8344-f00c571b74fd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.614439 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"glance-default-internal-api-0\" (UID: \"4b135a46-d885-4bc3-8344-f00c571b74fd\") device mount path \"/mnt/openstack/pv06\"" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.618669 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4b135a46-d885-4bc3-8344-f00c571b74fd-scripts\") pod \"glance-default-internal-api-0\" (UID: \"4b135a46-d885-4bc3-8344-f00c571b74fd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.622508 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/4b135a46-d885-4bc3-8344-f00c571b74fd-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"4b135a46-d885-4bc3-8344-f00c571b74fd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.626392 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4b135a46-d885-4bc3-8344-f00c571b74fd-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"4b135a46-d885-4bc3-8344-f00c571b74fd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.627563 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4b135a46-d885-4bc3-8344-f00c571b74fd-config-data\") pod \"glance-default-internal-api-0\" (UID: \"4b135a46-d885-4bc3-8344-f00c571b74fd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.630012 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mplsq\" (UniqueName: \"kubernetes.io/projected/4b135a46-d885-4bc3-8344-f00c571b74fd-kube-api-access-mplsq\") pod \"glance-default-internal-api-0\" (UID: \"4b135a46-d885-4bc3-8344-f00c571b74fd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.650408 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-784497c6b4-5g4fn" Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.698887 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"glance-default-internal-api-0\" (UID: \"4b135a46-d885-4bc3-8344-f00c571b74fd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.713669 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/96b6737b-826e-4600-978e-3384f064dd15-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"96b6737b-826e-4600-978e-3384f064dd15\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.713725 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"glance-default-external-api-0\" (UID: \"96b6737b-826e-4600-978e-3384f064dd15\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.713826 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/96b6737b-826e-4600-978e-3384f064dd15-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"96b6737b-826e-4600-978e-3384f064dd15\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.714037 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xr7qv\" (UniqueName: \"kubernetes.io/projected/96b6737b-826e-4600-978e-3384f064dd15-kube-api-access-xr7qv\") pod \"glance-default-external-api-0\" (UID: \"96b6737b-826e-4600-978e-3384f064dd15\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.714119 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/96b6737b-826e-4600-978e-3384f064dd15-config-data\") pod \"glance-default-external-api-0\" (UID: \"96b6737b-826e-4600-978e-3384f064dd15\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.714246 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/96b6737b-826e-4600-978e-3384f064dd15-scripts\") pod \"glance-default-external-api-0\" (UID: \"96b6737b-826e-4600-978e-3384f064dd15\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.714294 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/96b6737b-826e-4600-978e-3384f064dd15-logs\") pod \"glance-default-external-api-0\" (UID: \"96b6737b-826e-4600-978e-3384f064dd15\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.714298 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"glance-default-external-api-0\" (UID: \"96b6737b-826e-4600-978e-3384f064dd15\") device mount path \"/mnt/openstack/pv05\"" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.714329 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/96b6737b-826e-4600-978e-3384f064dd15-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"96b6737b-826e-4600-978e-3384f064dd15\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.715475 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/96b6737b-826e-4600-978e-3384f064dd15-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"96b6737b-826e-4600-978e-3384f064dd15\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.718891 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/96b6737b-826e-4600-978e-3384f064dd15-logs\") pod \"glance-default-external-api-0\" (UID: \"96b6737b-826e-4600-978e-3384f064dd15\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.722107 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/96b6737b-826e-4600-978e-3384f064dd15-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"96b6737b-826e-4600-978e-3384f064dd15\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.722606 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/96b6737b-826e-4600-978e-3384f064dd15-config-data\") pod \"glance-default-external-api-0\" (UID: \"96b6737b-826e-4600-978e-3384f064dd15\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.732338 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/96b6737b-826e-4600-978e-3384f064dd15-scripts\") pod \"glance-default-external-api-0\" (UID: \"96b6737b-826e-4600-978e-3384f064dd15\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.734200 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/96b6737b-826e-4600-978e-3384f064dd15-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"96b6737b-826e-4600-978e-3384f064dd15\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.741274 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.752326 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xr7qv\" (UniqueName: \"kubernetes.io/projected/96b6737b-826e-4600-978e-3384f064dd15-kube-api-access-xr7qv\") pod \"glance-default-external-api-0\" (UID: \"96b6737b-826e-4600-978e-3384f064dd15\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.761414 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"glance-default-external-api-0\" (UID: \"96b6737b-826e-4600-978e-3384f064dd15\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.813019 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.820110 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-lsvkk" Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.919808 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1097f29f-d62e-451e-befd-0e4fbe6c3ca0-combined-ca-bundle\") pod \"1097f29f-d62e-451e-befd-0e4fbe6c3ca0\" (UID: \"1097f29f-d62e-451e-befd-0e4fbe6c3ca0\") " Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.920298 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1097f29f-d62e-451e-befd-0e4fbe6c3ca0-scripts\") pod \"1097f29f-d62e-451e-befd-0e4fbe6c3ca0\" (UID: \"1097f29f-d62e-451e-befd-0e4fbe6c3ca0\") " Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.920462 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1097f29f-d62e-451e-befd-0e4fbe6c3ca0-config-data\") pod \"1097f29f-d62e-451e-befd-0e4fbe6c3ca0\" (UID: \"1097f29f-d62e-451e-befd-0e4fbe6c3ca0\") " Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.920490 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/1097f29f-d62e-451e-befd-0e4fbe6c3ca0-fernet-keys\") pod \"1097f29f-d62e-451e-befd-0e4fbe6c3ca0\" (UID: \"1097f29f-d62e-451e-befd-0e4fbe6c3ca0\") " Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.920565 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/1097f29f-d62e-451e-befd-0e4fbe6c3ca0-credential-keys\") pod \"1097f29f-d62e-451e-befd-0e4fbe6c3ca0\" (UID: \"1097f29f-d62e-451e-befd-0e4fbe6c3ca0\") " Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.924099 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fghxj\" (UniqueName: \"kubernetes.io/projected/1097f29f-d62e-451e-befd-0e4fbe6c3ca0-kube-api-access-fghxj\") pod \"1097f29f-d62e-451e-befd-0e4fbe6c3ca0\" (UID: \"1097f29f-d62e-451e-befd-0e4fbe6c3ca0\") " Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.931910 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1097f29f-d62e-451e-befd-0e4fbe6c3ca0-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "1097f29f-d62e-451e-befd-0e4fbe6c3ca0" (UID: "1097f29f-d62e-451e-befd-0e4fbe6c3ca0"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.932000 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1097f29f-d62e-451e-befd-0e4fbe6c3ca0-scripts" (OuterVolumeSpecName: "scripts") pod "1097f29f-d62e-451e-befd-0e4fbe6c3ca0" (UID: "1097f29f-d62e-451e-befd-0e4fbe6c3ca0"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.931992 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1097f29f-d62e-451e-befd-0e4fbe6c3ca0-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "1097f29f-d62e-451e-befd-0e4fbe6c3ca0" (UID: "1097f29f-d62e-451e-befd-0e4fbe6c3ca0"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.945513 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1097f29f-d62e-451e-befd-0e4fbe6c3ca0-kube-api-access-fghxj" (OuterVolumeSpecName: "kube-api-access-fghxj") pod "1097f29f-d62e-451e-befd-0e4fbe6c3ca0" (UID: "1097f29f-d62e-451e-befd-0e4fbe6c3ca0"). InnerVolumeSpecName "kube-api-access-fghxj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.956561 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1097f29f-d62e-451e-befd-0e4fbe6c3ca0-config-data" (OuterVolumeSpecName: "config-data") pod "1097f29f-d62e-451e-befd-0e4fbe6c3ca0" (UID: "1097f29f-d62e-451e-befd-0e4fbe6c3ca0"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:04:43 crc kubenswrapper[5120]: I0316 17:04:43.960660 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1097f29f-d62e-451e-befd-0e4fbe6c3ca0-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "1097f29f-d62e-451e-befd-0e4fbe6c3ca0" (UID: "1097f29f-d62e-451e-befd-0e4fbe6c3ca0"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:04:44 crc kubenswrapper[5120]: I0316 17:04:44.027130 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1097f29f-d62e-451e-befd-0e4fbe6c3ca0-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:04:44 crc kubenswrapper[5120]: I0316 17:04:44.027416 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1097f29f-d62e-451e-befd-0e4fbe6c3ca0-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:04:44 crc kubenswrapper[5120]: I0316 17:04:44.027427 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1097f29f-d62e-451e-befd-0e4fbe6c3ca0-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:04:44 crc kubenswrapper[5120]: I0316 17:04:44.027436 5120 reconciler_common.go:299] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/1097f29f-d62e-451e-befd-0e4fbe6c3ca0-fernet-keys\") on node \"crc\" DevicePath \"\"" Mar 16 17:04:44 crc kubenswrapper[5120]: I0316 17:04:44.027445 5120 reconciler_common.go:299] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/1097f29f-d62e-451e-befd-0e4fbe6c3ca0-credential-keys\") on node \"crc\" DevicePath \"\"" Mar 16 17:04:44 crc kubenswrapper[5120]: I0316 17:04:44.027455 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fghxj\" (UniqueName: \"kubernetes.io/projected/1097f29f-d62e-451e-befd-0e4fbe6c3ca0-kube-api-access-fghxj\") on node \"crc\" DevicePath \"\"" Mar 16 17:04:44 crc kubenswrapper[5120]: I0316 17:04:44.196235 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-784497c6b4-5g4fn"] Mar 16 17:04:44 crc kubenswrapper[5120]: I0316 17:04:44.200047 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"01efd45f-aa9b-487b-99f1-3320f37ebd2e","Type":"ContainerStarted","Data":"4fcd6f34895838bb01b32b91ba633a9854f828c743b048f186d080e7c575cdf3"} Mar 16 17:04:44 crc kubenswrapper[5120]: I0316 17:04:44.200251 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="01efd45f-aa9b-487b-99f1-3320f37ebd2e" containerName="ceilometer-central-agent" containerID="cri-o://6b739c38a914fed3ff1d9a888a162085bb4993068271ed3de06098a07ae1e4af" gracePeriod=30 Mar 16 17:04:44 crc kubenswrapper[5120]: I0316 17:04:44.200538 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:04:44 crc kubenswrapper[5120]: I0316 17:04:44.200871 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="01efd45f-aa9b-487b-99f1-3320f37ebd2e" containerName="proxy-httpd" containerID="cri-o://4fcd6f34895838bb01b32b91ba633a9854f828c743b048f186d080e7c575cdf3" gracePeriod=30 Mar 16 17:04:44 crc kubenswrapper[5120]: I0316 17:04:44.200937 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="01efd45f-aa9b-487b-99f1-3320f37ebd2e" containerName="sg-core" containerID="cri-o://8fa00d47838a96dc1e89fc1bbf326f3fb6428b7a6f10775c34e1d77786e0227f" gracePeriod=30 Mar 16 17:04:44 crc kubenswrapper[5120]: I0316 17:04:44.201003 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="01efd45f-aa9b-487b-99f1-3320f37ebd2e" containerName="ceilometer-notification-agent" containerID="cri-o://f52b0845273b4e3787cb7e7232e9e0b7c19ed7252254ee9c05ef5db3727f0a77" gracePeriod=30 Mar 16 17:04:44 crc kubenswrapper[5120]: W0316 17:04:44.208947 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod16bbeb65_e9fb_4f92_9642_83ac828e09d7.slice/crio-74b9ec2e21fc991583ef344354e3d3e8fa072e4ab5410f813d160c344e173790 WatchSource:0}: Error finding container 74b9ec2e21fc991583ef344354e3d3e8fa072e4ab5410f813d160c344e173790: Status 404 returned error can't find the container with id 74b9ec2e21fc991583ef344354e3d3e8fa072e4ab5410f813d160c344e173790 Mar 16 17:04:44 crc kubenswrapper[5120]: I0316 17:04:44.213354 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-lsvkk"] Mar 16 17:04:44 crc kubenswrapper[5120]: I0316 17:04:44.219098 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-lsvkk" event={"ID":"1097f29f-d62e-451e-befd-0e4fbe6c3ca0","Type":"ContainerDied","Data":"0db9c38495cd01547800bcec9fab3ad913870bda3088a11776436ea873477998"} Mar 16 17:04:44 crc kubenswrapper[5120]: I0316 17:04:44.219147 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0db9c38495cd01547800bcec9fab3ad913870bda3088a11776436ea873477998" Mar 16 17:04:44 crc kubenswrapper[5120]: I0316 17:04:44.219239 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-lsvkk" Mar 16 17:04:44 crc kubenswrapper[5120]: I0316 17:04:44.225448 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-lsvkk"] Mar 16 17:04:44 crc kubenswrapper[5120]: I0316 17:04:44.243273 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=1.863178019 podStartE2EDuration="7.243248896s" podCreationTimestamp="2026-03-16 17:04:37 +0000 UTC" firstStartedPulling="2026-03-16 17:04:38.166817593 +0000 UTC m=+5580.320749250" lastFinishedPulling="2026-03-16 17:04:43.54688847 +0000 UTC m=+5585.700820127" observedRunningTime="2026-03-16 17:04:44.234428973 +0000 UTC m=+5586.388360650" watchObservedRunningTime="2026-03-16 17:04:44.243248896 +0000 UTC m=+5586.397180553" Mar 16 17:04:44 crc kubenswrapper[5120]: I0316 17:04:44.283152 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-f26kx"] Mar 16 17:04:44 crc kubenswrapper[5120]: I0316 17:04:44.284113 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1097f29f-d62e-451e-befd-0e4fbe6c3ca0" containerName="keystone-bootstrap" Mar 16 17:04:44 crc kubenswrapper[5120]: I0316 17:04:44.284132 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1097f29f-d62e-451e-befd-0e4fbe6c3ca0" containerName="keystone-bootstrap" Mar 16 17:04:44 crc kubenswrapper[5120]: I0316 17:04:44.284304 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1097f29f-d62e-451e-befd-0e4fbe6c3ca0" containerName="keystone-bootstrap" Mar 16 17:04:44 crc kubenswrapper[5120]: I0316 17:04:44.291249 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-f26kx" Mar 16 17:04:44 crc kubenswrapper[5120]: I0316 17:04:44.294386 5120 status_manager.go:895] "Failed to get status for pod" podUID="1097f29f-d62e-451e-befd-0e4fbe6c3ca0" pod="openstack-kuttl-tests/keystone-bootstrap-lsvkk" err="pods \"keystone-bootstrap-lsvkk\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 17:04:44 crc kubenswrapper[5120]: I0316 17:04:44.294943 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-scripts\"" Mar 16 17:04:44 crc kubenswrapper[5120]: I0316 17:04:44.294963 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"osp-secret\"" Mar 16 17:04:44 crc kubenswrapper[5120]: I0316 17:04:44.295659 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone\"" Mar 16 17:04:44 crc kubenswrapper[5120]: I0316 17:04:44.295666 5120 status_manager.go:895] "Failed to get status for pod" podUID="1097f29f-d62e-451e-befd-0e4fbe6c3ca0" pod="openstack-kuttl-tests/keystone-bootstrap-lsvkk" err="pods \"keystone-bootstrap-lsvkk\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 17:04:44 crc kubenswrapper[5120]: I0316 17:04:44.295933 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-keystone-dockercfg-crlsv\"" Mar 16 17:04:44 crc kubenswrapper[5120]: I0316 17:04:44.295958 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-config-data\"" Mar 16 17:04:44 crc kubenswrapper[5120]: I0316 17:04:44.324176 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-f26kx"] Mar 16 17:04:44 crc kubenswrapper[5120]: I0316 17:04:44.357360 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 17:04:44 crc kubenswrapper[5120]: I0316 17:04:44.440257 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f4aa434d-2a76-4cd1-b875-74b763ad15bd-config-data\") pod \"keystone-bootstrap-f26kx\" (UID: \"f4aa434d-2a76-4cd1-b875-74b763ad15bd\") " pod="openstack-kuttl-tests/keystone-bootstrap-f26kx" Mar 16 17:04:44 crc kubenswrapper[5120]: I0316 17:04:44.441170 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/f4aa434d-2a76-4cd1-b875-74b763ad15bd-credential-keys\") pod \"keystone-bootstrap-f26kx\" (UID: \"f4aa434d-2a76-4cd1-b875-74b763ad15bd\") " pod="openstack-kuttl-tests/keystone-bootstrap-f26kx" Mar 16 17:04:44 crc kubenswrapper[5120]: I0316 17:04:44.441233 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/f4aa434d-2a76-4cd1-b875-74b763ad15bd-fernet-keys\") pod \"keystone-bootstrap-f26kx\" (UID: \"f4aa434d-2a76-4cd1-b875-74b763ad15bd\") " pod="openstack-kuttl-tests/keystone-bootstrap-f26kx" Mar 16 17:04:44 crc kubenswrapper[5120]: I0316 17:04:44.441263 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4lgbx\" (UniqueName: \"kubernetes.io/projected/f4aa434d-2a76-4cd1-b875-74b763ad15bd-kube-api-access-4lgbx\") pod \"keystone-bootstrap-f26kx\" (UID: \"f4aa434d-2a76-4cd1-b875-74b763ad15bd\") " pod="openstack-kuttl-tests/keystone-bootstrap-f26kx" Mar 16 17:04:44 crc kubenswrapper[5120]: I0316 17:04:44.441345 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f4aa434d-2a76-4cd1-b875-74b763ad15bd-combined-ca-bundle\") pod \"keystone-bootstrap-f26kx\" (UID: \"f4aa434d-2a76-4cd1-b875-74b763ad15bd\") " pod="openstack-kuttl-tests/keystone-bootstrap-f26kx" Mar 16 17:04:44 crc kubenswrapper[5120]: I0316 17:04:44.441636 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f4aa434d-2a76-4cd1-b875-74b763ad15bd-scripts\") pod \"keystone-bootstrap-f26kx\" (UID: \"f4aa434d-2a76-4cd1-b875-74b763ad15bd\") " pod="openstack-kuttl-tests/keystone-bootstrap-f26kx" Mar 16 17:04:44 crc kubenswrapper[5120]: I0316 17:04:44.537734 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 17:04:44 crc kubenswrapper[5120]: I0316 17:04:44.544379 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f4aa434d-2a76-4cd1-b875-74b763ad15bd-scripts\") pod \"keystone-bootstrap-f26kx\" (UID: \"f4aa434d-2a76-4cd1-b875-74b763ad15bd\") " pod="openstack-kuttl-tests/keystone-bootstrap-f26kx" Mar 16 17:04:44 crc kubenswrapper[5120]: I0316 17:04:44.544559 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f4aa434d-2a76-4cd1-b875-74b763ad15bd-config-data\") pod \"keystone-bootstrap-f26kx\" (UID: \"f4aa434d-2a76-4cd1-b875-74b763ad15bd\") " pod="openstack-kuttl-tests/keystone-bootstrap-f26kx" Mar 16 17:04:44 crc kubenswrapper[5120]: I0316 17:04:44.544593 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/f4aa434d-2a76-4cd1-b875-74b763ad15bd-credential-keys\") pod \"keystone-bootstrap-f26kx\" (UID: \"f4aa434d-2a76-4cd1-b875-74b763ad15bd\") " pod="openstack-kuttl-tests/keystone-bootstrap-f26kx" Mar 16 17:04:44 crc kubenswrapper[5120]: I0316 17:04:44.544629 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/f4aa434d-2a76-4cd1-b875-74b763ad15bd-fernet-keys\") pod \"keystone-bootstrap-f26kx\" (UID: \"f4aa434d-2a76-4cd1-b875-74b763ad15bd\") " pod="openstack-kuttl-tests/keystone-bootstrap-f26kx" Mar 16 17:04:44 crc kubenswrapper[5120]: I0316 17:04:44.544951 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4lgbx\" (UniqueName: \"kubernetes.io/projected/f4aa434d-2a76-4cd1-b875-74b763ad15bd-kube-api-access-4lgbx\") pod \"keystone-bootstrap-f26kx\" (UID: \"f4aa434d-2a76-4cd1-b875-74b763ad15bd\") " pod="openstack-kuttl-tests/keystone-bootstrap-f26kx" Mar 16 17:04:44 crc kubenswrapper[5120]: I0316 17:04:44.545140 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f4aa434d-2a76-4cd1-b875-74b763ad15bd-combined-ca-bundle\") pod \"keystone-bootstrap-f26kx\" (UID: \"f4aa434d-2a76-4cd1-b875-74b763ad15bd\") " pod="openstack-kuttl-tests/keystone-bootstrap-f26kx" Mar 16 17:04:44 crc kubenswrapper[5120]: I0316 17:04:44.552489 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f4aa434d-2a76-4cd1-b875-74b763ad15bd-scripts\") pod \"keystone-bootstrap-f26kx\" (UID: \"f4aa434d-2a76-4cd1-b875-74b763ad15bd\") " pod="openstack-kuttl-tests/keystone-bootstrap-f26kx" Mar 16 17:04:44 crc kubenswrapper[5120]: I0316 17:04:44.552707 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/f4aa434d-2a76-4cd1-b875-74b763ad15bd-fernet-keys\") pod \"keystone-bootstrap-f26kx\" (UID: \"f4aa434d-2a76-4cd1-b875-74b763ad15bd\") " pod="openstack-kuttl-tests/keystone-bootstrap-f26kx" Mar 16 17:04:44 crc kubenswrapper[5120]: I0316 17:04:44.558384 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f4aa434d-2a76-4cd1-b875-74b763ad15bd-combined-ca-bundle\") pod \"keystone-bootstrap-f26kx\" (UID: \"f4aa434d-2a76-4cd1-b875-74b763ad15bd\") " pod="openstack-kuttl-tests/keystone-bootstrap-f26kx" Mar 16 17:04:44 crc kubenswrapper[5120]: I0316 17:04:44.566251 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f4aa434d-2a76-4cd1-b875-74b763ad15bd-config-data\") pod \"keystone-bootstrap-f26kx\" (UID: \"f4aa434d-2a76-4cd1-b875-74b763ad15bd\") " pod="openstack-kuttl-tests/keystone-bootstrap-f26kx" Mar 16 17:04:44 crc kubenswrapper[5120]: I0316 17:04:44.566906 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/f4aa434d-2a76-4cd1-b875-74b763ad15bd-credential-keys\") pod \"keystone-bootstrap-f26kx\" (UID: \"f4aa434d-2a76-4cd1-b875-74b763ad15bd\") " pod="openstack-kuttl-tests/keystone-bootstrap-f26kx" Mar 16 17:04:44 crc kubenswrapper[5120]: I0316 17:04:44.570206 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4lgbx\" (UniqueName: \"kubernetes.io/projected/f4aa434d-2a76-4cd1-b875-74b763ad15bd-kube-api-access-4lgbx\") pod \"keystone-bootstrap-f26kx\" (UID: \"f4aa434d-2a76-4cd1-b875-74b763ad15bd\") " pod="openstack-kuttl-tests/keystone-bootstrap-f26kx" Mar 16 17:04:44 crc kubenswrapper[5120]: W0316 17:04:44.571121 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod96b6737b_826e_4600_978e_3384f064dd15.slice/crio-9dc4b2162b684667e552dd4fffd1dec836cbcabc356f92531683c95e61c3bea3 WatchSource:0}: Error finding container 9dc4b2162b684667e552dd4fffd1dec836cbcabc356f92531683c95e61c3bea3: Status 404 returned error can't find the container with id 9dc4b2162b684667e552dd4fffd1dec836cbcabc356f92531683c95e61c3bea3 Mar 16 17:04:44 crc kubenswrapper[5120]: I0316 17:04:44.625221 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-f26kx" Mar 16 17:04:44 crc kubenswrapper[5120]: I0316 17:04:44.713534 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1097f29f-d62e-451e-befd-0e4fbe6c3ca0" path="/var/lib/kubelet/pods/1097f29f-d62e-451e-befd-0e4fbe6c3ca0/volumes" Mar 16 17:04:44 crc kubenswrapper[5120]: I0316 17:04:44.716116 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="97594790-c415-4a95-800c-9bf5c983ce70" path="/var/lib/kubelet/pods/97594790-c415-4a95-800c-9bf5c983ce70/volumes" Mar 16 17:04:44 crc kubenswrapper[5120]: I0316 17:04:44.717224 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c78826fe-ae87-4178-9fdf-543f594f5afb" path="/var/lib/kubelet/pods/c78826fe-ae87-4178-9fdf-543f594f5afb/volumes" Mar 16 17:04:45 crc kubenswrapper[5120]: I0316 17:04:45.256397 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"4b135a46-d885-4bc3-8344-f00c571b74fd","Type":"ContainerStarted","Data":"62b26c6e7319ae17990a55699df2588bca7b4410e695dac05a2c329773ae67e6"} Mar 16 17:04:45 crc kubenswrapper[5120]: I0316 17:04:45.263534 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-784497c6b4-5g4fn" event={"ID":"16bbeb65-e9fb-4f92-9642-83ac828e09d7","Type":"ContainerStarted","Data":"971f6fc81706ba34789d4f2218c6bb34f3823902fa216187b0d5ec6955c4b8cd"} Mar 16 17:04:45 crc kubenswrapper[5120]: I0316 17:04:45.263638 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-784497c6b4-5g4fn" event={"ID":"16bbeb65-e9fb-4f92-9642-83ac828e09d7","Type":"ContainerStarted","Data":"9d2c3e8026c7db5aa800a0f4f60458365ac79b36769cf2f66fc7818d19ff1e1c"} Mar 16 17:04:45 crc kubenswrapper[5120]: I0316 17:04:45.263671 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-784497c6b4-5g4fn" event={"ID":"16bbeb65-e9fb-4f92-9642-83ac828e09d7","Type":"ContainerStarted","Data":"74b9ec2e21fc991583ef344354e3d3e8fa072e4ab5410f813d160c344e173790"} Mar 16 17:04:45 crc kubenswrapper[5120]: I0316 17:04:45.265640 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-784497c6b4-5g4fn" Mar 16 17:04:45 crc kubenswrapper[5120]: I0316 17:04:45.265881 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-784497c6b4-5g4fn" Mar 16 17:04:45 crc kubenswrapper[5120]: I0316 17:04:45.304255 5120 generic.go:358] "Generic (PLEG): container finished" podID="de53f6e3-e1a7-49fd-8c2e-e57add0fe5eb" containerID="9af52bd4160e110b5dbee7df41625a71b1f855885bb069a59f279a7e651995ab" exitCode=0 Mar 16 17:04:45 crc kubenswrapper[5120]: I0316 17:04:45.304349 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-hjq5d" event={"ID":"de53f6e3-e1a7-49fd-8c2e-e57add0fe5eb","Type":"ContainerDied","Data":"9af52bd4160e110b5dbee7df41625a71b1f855885bb069a59f279a7e651995ab"} Mar 16 17:04:45 crc kubenswrapper[5120]: I0316 17:04:45.312504 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"96b6737b-826e-4600-978e-3384f064dd15","Type":"ContainerStarted","Data":"9dc4b2162b684667e552dd4fffd1dec836cbcabc356f92531683c95e61c3bea3"} Mar 16 17:04:45 crc kubenswrapper[5120]: I0316 17:04:45.320048 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-f26kx"] Mar 16 17:04:45 crc kubenswrapper[5120]: I0316 17:04:45.333718 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-784497c6b4-5g4fn" podStartSLOduration=2.333661279 podStartE2EDuration="2.333661279s" podCreationTimestamp="2026-03-16 17:04:43 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:04:45.299213387 +0000 UTC m=+5587.453145064" watchObservedRunningTime="2026-03-16 17:04:45.333661279 +0000 UTC m=+5587.487592936" Mar 16 17:04:45 crc kubenswrapper[5120]: I0316 17:04:45.339992 5120 generic.go:358] "Generic (PLEG): container finished" podID="01efd45f-aa9b-487b-99f1-3320f37ebd2e" containerID="4fcd6f34895838bb01b32b91ba633a9854f828c743b048f186d080e7c575cdf3" exitCode=0 Mar 16 17:04:45 crc kubenswrapper[5120]: I0316 17:04:45.340022 5120 generic.go:358] "Generic (PLEG): container finished" podID="01efd45f-aa9b-487b-99f1-3320f37ebd2e" containerID="8fa00d47838a96dc1e89fc1bbf326f3fb6428b7a6f10775c34e1d77786e0227f" exitCode=2 Mar 16 17:04:45 crc kubenswrapper[5120]: I0316 17:04:45.340029 5120 generic.go:358] "Generic (PLEG): container finished" podID="01efd45f-aa9b-487b-99f1-3320f37ebd2e" containerID="f52b0845273b4e3787cb7e7232e9e0b7c19ed7252254ee9c05ef5db3727f0a77" exitCode=0 Mar 16 17:04:45 crc kubenswrapper[5120]: I0316 17:04:45.340035 5120 generic.go:358] "Generic (PLEG): container finished" podID="01efd45f-aa9b-487b-99f1-3320f37ebd2e" containerID="6b739c38a914fed3ff1d9a888a162085bb4993068271ed3de06098a07ae1e4af" exitCode=0 Mar 16 17:04:45 crc kubenswrapper[5120]: I0316 17:04:45.340141 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"01efd45f-aa9b-487b-99f1-3320f37ebd2e","Type":"ContainerDied","Data":"4fcd6f34895838bb01b32b91ba633a9854f828c743b048f186d080e7c575cdf3"} Mar 16 17:04:45 crc kubenswrapper[5120]: I0316 17:04:45.340166 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"01efd45f-aa9b-487b-99f1-3320f37ebd2e","Type":"ContainerDied","Data":"8fa00d47838a96dc1e89fc1bbf326f3fb6428b7a6f10775c34e1d77786e0227f"} Mar 16 17:04:45 crc kubenswrapper[5120]: I0316 17:04:45.340177 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"01efd45f-aa9b-487b-99f1-3320f37ebd2e","Type":"ContainerDied","Data":"f52b0845273b4e3787cb7e7232e9e0b7c19ed7252254ee9c05ef5db3727f0a77"} Mar 16 17:04:45 crc kubenswrapper[5120]: I0316 17:04:45.340186 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"01efd45f-aa9b-487b-99f1-3320f37ebd2e","Type":"ContainerDied","Data":"6b739c38a914fed3ff1d9a888a162085bb4993068271ed3de06098a07ae1e4af"} Mar 16 17:04:45 crc kubenswrapper[5120]: I0316 17:04:45.356563 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-qk75k" event={"ID":"727c8c9a-fcc8-42c3-8a58-df87dc295191","Type":"ContainerStarted","Data":"b03c923ee5173cf2f5c215baaf2037300c95b3029a814fb8eff08aaad254ee85"} Mar 16 17:04:45 crc kubenswrapper[5120]: I0316 17:04:45.388439 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-db-sync-qk75k" podStartSLOduration=4.388410732 podStartE2EDuration="4.388410732s" podCreationTimestamp="2026-03-16 17:04:41 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:04:45.376968126 +0000 UTC m=+5587.530899803" watchObservedRunningTime="2026-03-16 17:04:45.388410732 +0000 UTC m=+5587.542342389" Mar 16 17:04:45 crc kubenswrapper[5120]: I0316 17:04:45.449056 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:04:45 crc kubenswrapper[5120]: I0316 17:04:45.587415 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/01efd45f-aa9b-487b-99f1-3320f37ebd2e-log-httpd\") pod \"01efd45f-aa9b-487b-99f1-3320f37ebd2e\" (UID: \"01efd45f-aa9b-487b-99f1-3320f37ebd2e\") " Mar 16 17:04:45 crc kubenswrapper[5120]: I0316 17:04:45.588134 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01efd45f-aa9b-487b-99f1-3320f37ebd2e-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "01efd45f-aa9b-487b-99f1-3320f37ebd2e" (UID: "01efd45f-aa9b-487b-99f1-3320f37ebd2e"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:04:45 crc kubenswrapper[5120]: I0316 17:04:45.596046 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jcwpd\" (UniqueName: \"kubernetes.io/projected/01efd45f-aa9b-487b-99f1-3320f37ebd2e-kube-api-access-jcwpd\") pod \"01efd45f-aa9b-487b-99f1-3320f37ebd2e\" (UID: \"01efd45f-aa9b-487b-99f1-3320f37ebd2e\") " Mar 16 17:04:45 crc kubenswrapper[5120]: I0316 17:04:45.596395 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/01efd45f-aa9b-487b-99f1-3320f37ebd2e-combined-ca-bundle\") pod \"01efd45f-aa9b-487b-99f1-3320f37ebd2e\" (UID: \"01efd45f-aa9b-487b-99f1-3320f37ebd2e\") " Mar 16 17:04:45 crc kubenswrapper[5120]: I0316 17:04:45.596570 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/01efd45f-aa9b-487b-99f1-3320f37ebd2e-scripts\") pod \"01efd45f-aa9b-487b-99f1-3320f37ebd2e\" (UID: \"01efd45f-aa9b-487b-99f1-3320f37ebd2e\") " Mar 16 17:04:45 crc kubenswrapper[5120]: I0316 17:04:45.596713 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/01efd45f-aa9b-487b-99f1-3320f37ebd2e-config-data\") pod \"01efd45f-aa9b-487b-99f1-3320f37ebd2e\" (UID: \"01efd45f-aa9b-487b-99f1-3320f37ebd2e\") " Mar 16 17:04:45 crc kubenswrapper[5120]: I0316 17:04:45.596853 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/01efd45f-aa9b-487b-99f1-3320f37ebd2e-run-httpd\") pod \"01efd45f-aa9b-487b-99f1-3320f37ebd2e\" (UID: \"01efd45f-aa9b-487b-99f1-3320f37ebd2e\") " Mar 16 17:04:45 crc kubenswrapper[5120]: I0316 17:04:45.596898 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/01efd45f-aa9b-487b-99f1-3320f37ebd2e-sg-core-conf-yaml\") pod \"01efd45f-aa9b-487b-99f1-3320f37ebd2e\" (UID: \"01efd45f-aa9b-487b-99f1-3320f37ebd2e\") " Mar 16 17:04:45 crc kubenswrapper[5120]: I0316 17:04:45.597899 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/01efd45f-aa9b-487b-99f1-3320f37ebd2e-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 17:04:45 crc kubenswrapper[5120]: I0316 17:04:45.597944 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01efd45f-aa9b-487b-99f1-3320f37ebd2e-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "01efd45f-aa9b-487b-99f1-3320f37ebd2e" (UID: "01efd45f-aa9b-487b-99f1-3320f37ebd2e"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:04:45 crc kubenswrapper[5120]: I0316 17:04:45.629273 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/01efd45f-aa9b-487b-99f1-3320f37ebd2e-scripts" (OuterVolumeSpecName: "scripts") pod "01efd45f-aa9b-487b-99f1-3320f37ebd2e" (UID: "01efd45f-aa9b-487b-99f1-3320f37ebd2e"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:04:45 crc kubenswrapper[5120]: I0316 17:04:45.631559 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01efd45f-aa9b-487b-99f1-3320f37ebd2e-kube-api-access-jcwpd" (OuterVolumeSpecName: "kube-api-access-jcwpd") pod "01efd45f-aa9b-487b-99f1-3320f37ebd2e" (UID: "01efd45f-aa9b-487b-99f1-3320f37ebd2e"). InnerVolumeSpecName "kube-api-access-jcwpd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:04:45 crc kubenswrapper[5120]: I0316 17:04:45.661888 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/01efd45f-aa9b-487b-99f1-3320f37ebd2e-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "01efd45f-aa9b-487b-99f1-3320f37ebd2e" (UID: "01efd45f-aa9b-487b-99f1-3320f37ebd2e"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:04:45 crc kubenswrapper[5120]: I0316 17:04:45.700443 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/01efd45f-aa9b-487b-99f1-3320f37ebd2e-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 17:04:45 crc kubenswrapper[5120]: I0316 17:04:45.700498 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jcwpd\" (UniqueName: \"kubernetes.io/projected/01efd45f-aa9b-487b-99f1-3320f37ebd2e-kube-api-access-jcwpd\") on node \"crc\" DevicePath \"\"" Mar 16 17:04:45 crc kubenswrapper[5120]: I0316 17:04:45.700515 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/01efd45f-aa9b-487b-99f1-3320f37ebd2e-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:04:45 crc kubenswrapper[5120]: I0316 17:04:45.700527 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/01efd45f-aa9b-487b-99f1-3320f37ebd2e-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 17:04:45 crc kubenswrapper[5120]: I0316 17:04:45.724111 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/01efd45f-aa9b-487b-99f1-3320f37ebd2e-config-data" (OuterVolumeSpecName: "config-data") pod "01efd45f-aa9b-487b-99f1-3320f37ebd2e" (UID: "01efd45f-aa9b-487b-99f1-3320f37ebd2e"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:04:45 crc kubenswrapper[5120]: I0316 17:04:45.745030 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/01efd45f-aa9b-487b-99f1-3320f37ebd2e-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "01efd45f-aa9b-487b-99f1-3320f37ebd2e" (UID: "01efd45f-aa9b-487b-99f1-3320f37ebd2e"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:04:45 crc kubenswrapper[5120]: I0316 17:04:45.803571 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/01efd45f-aa9b-487b-99f1-3320f37ebd2e-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:04:45 crc kubenswrapper[5120]: I0316 17:04:45.803621 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/01efd45f-aa9b-487b-99f1-3320f37ebd2e-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:04:46 crc kubenswrapper[5120]: I0316 17:04:46.372508 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-f26kx" event={"ID":"f4aa434d-2a76-4cd1-b875-74b763ad15bd","Type":"ContainerStarted","Data":"872bbebcb661fffcc8e13eb4398a4bf7f4c0d71bf43c1e67d9574cecdab4ca04"} Mar 16 17:04:46 crc kubenswrapper[5120]: I0316 17:04:46.372575 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-f26kx" event={"ID":"f4aa434d-2a76-4cd1-b875-74b763ad15bd","Type":"ContainerStarted","Data":"1e454483173966c3cf3dd114be6dab7a33eb9da52bc0d15be1aacd27c9821882"} Mar 16 17:04:46 crc kubenswrapper[5120]: I0316 17:04:46.387712 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:04:46 crc kubenswrapper[5120]: I0316 17:04:46.387746 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"01efd45f-aa9b-487b-99f1-3320f37ebd2e","Type":"ContainerDied","Data":"824adb99bd1fc3adb2fa7e2f4e16af9a26a03e34f6ed3ec9c1e373f36a9cd7b6"} Mar 16 17:04:46 crc kubenswrapper[5120]: I0316 17:04:46.387828 5120 scope.go:117] "RemoveContainer" containerID="4fcd6f34895838bb01b32b91ba633a9854f828c743b048f186d080e7c575cdf3" Mar 16 17:04:46 crc kubenswrapper[5120]: I0316 17:04:46.399387 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-bootstrap-f26kx" podStartSLOduration=2.399372349 podStartE2EDuration="2.399372349s" podCreationTimestamp="2026-03-16 17:04:44 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:04:46.394195416 +0000 UTC m=+5588.548127073" watchObservedRunningTime="2026-03-16 17:04:46.399372349 +0000 UTC m=+5588.553304006" Mar 16 17:04:46 crc kubenswrapper[5120]: I0316 17:04:46.401534 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"4b135a46-d885-4bc3-8344-f00c571b74fd","Type":"ContainerStarted","Data":"5ecccdf200fc2559f650f9b142c97a2e4cfa48901046a38edc67e81794d14036"} Mar 16 17:04:46 crc kubenswrapper[5120]: I0316 17:04:46.401567 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"4b135a46-d885-4bc3-8344-f00c571b74fd","Type":"ContainerStarted","Data":"b6fb75251afc9bd01783c470c45aa16184640e5c91b3ad33b86d481ff9a7fbe4"} Mar 16 17:04:46 crc kubenswrapper[5120]: I0316 17:04:46.407964 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"96b6737b-826e-4600-978e-3384f064dd15","Type":"ContainerStarted","Data":"29a344fadbdeacf8249d20dd5c4764539985868f4fdfbb1a19f3d419cea7f7e8"} Mar 16 17:04:46 crc kubenswrapper[5120]: I0316 17:04:46.424614 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-internal-api-0" podStartSLOduration=3.424598826 podStartE2EDuration="3.424598826s" podCreationTimestamp="2026-03-16 17:04:43 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:04:46.422489138 +0000 UTC m=+5588.576420805" watchObservedRunningTime="2026-03-16 17:04:46.424598826 +0000 UTC m=+5588.578530483" Mar 16 17:04:46 crc kubenswrapper[5120]: I0316 17:04:46.468865 5120 scope.go:117] "RemoveContainer" containerID="8fa00d47838a96dc1e89fc1bbf326f3fb6428b7a6f10775c34e1d77786e0227f" Mar 16 17:04:46 crc kubenswrapper[5120]: I0316 17:04:46.472528 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:04:46 crc kubenswrapper[5120]: I0316 17:04:46.489326 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:04:46 crc kubenswrapper[5120]: I0316 17:04:46.503998 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:04:46 crc kubenswrapper[5120]: I0316 17:04:46.505013 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01efd45f-aa9b-487b-99f1-3320f37ebd2e" containerName="sg-core" Mar 16 17:04:46 crc kubenswrapper[5120]: I0316 17:04:46.505027 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="01efd45f-aa9b-487b-99f1-3320f37ebd2e" containerName="sg-core" Mar 16 17:04:46 crc kubenswrapper[5120]: I0316 17:04:46.505062 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01efd45f-aa9b-487b-99f1-3320f37ebd2e" containerName="ceilometer-notification-agent" Mar 16 17:04:46 crc kubenswrapper[5120]: I0316 17:04:46.505068 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="01efd45f-aa9b-487b-99f1-3320f37ebd2e" containerName="ceilometer-notification-agent" Mar 16 17:04:46 crc kubenswrapper[5120]: I0316 17:04:46.505079 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01efd45f-aa9b-487b-99f1-3320f37ebd2e" containerName="proxy-httpd" Mar 16 17:04:46 crc kubenswrapper[5120]: I0316 17:04:46.505085 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="01efd45f-aa9b-487b-99f1-3320f37ebd2e" containerName="proxy-httpd" Mar 16 17:04:46 crc kubenswrapper[5120]: I0316 17:04:46.505126 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01efd45f-aa9b-487b-99f1-3320f37ebd2e" containerName="ceilometer-central-agent" Mar 16 17:04:46 crc kubenswrapper[5120]: I0316 17:04:46.505131 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="01efd45f-aa9b-487b-99f1-3320f37ebd2e" containerName="ceilometer-central-agent" Mar 16 17:04:46 crc kubenswrapper[5120]: I0316 17:04:46.505281 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="01efd45f-aa9b-487b-99f1-3320f37ebd2e" containerName="ceilometer-notification-agent" Mar 16 17:04:46 crc kubenswrapper[5120]: I0316 17:04:46.505299 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="01efd45f-aa9b-487b-99f1-3320f37ebd2e" containerName="proxy-httpd" Mar 16 17:04:46 crc kubenswrapper[5120]: I0316 17:04:46.505309 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="01efd45f-aa9b-487b-99f1-3320f37ebd2e" containerName="ceilometer-central-agent" Mar 16 17:04:46 crc kubenswrapper[5120]: I0316 17:04:46.505325 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="01efd45f-aa9b-487b-99f1-3320f37ebd2e" containerName="sg-core" Mar 16 17:04:46 crc kubenswrapper[5120]: I0316 17:04:46.518928 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:04:46 crc kubenswrapper[5120]: I0316 17:04:46.519067 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:04:46 crc kubenswrapper[5120]: I0316 17:04:46.522644 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 17:04:46 crc kubenswrapper[5120]: I0316 17:04:46.522717 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 17:04:46 crc kubenswrapper[5120]: I0316 17:04:46.536733 5120 scope.go:117] "RemoveContainer" containerID="f52b0845273b4e3787cb7e7232e9e0b7c19ed7252254ee9c05ef5db3727f0a77" Mar 16 17:04:46 crc kubenswrapper[5120]: I0316 17:04:46.617834 5120 scope.go:117] "RemoveContainer" containerID="6b739c38a914fed3ff1d9a888a162085bb4993068271ed3de06098a07ae1e4af" Mar 16 17:04:46 crc kubenswrapper[5120]: I0316 17:04:46.628641 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a9e1bfc3-4b43-41e4-af96-bba09e1c74b3-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"a9e1bfc3-4b43-41e4-af96-bba09e1c74b3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:04:46 crc kubenswrapper[5120]: I0316 17:04:46.628752 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a9e1bfc3-4b43-41e4-af96-bba09e1c74b3-scripts\") pod \"ceilometer-0\" (UID: \"a9e1bfc3-4b43-41e4-af96-bba09e1c74b3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:04:46 crc kubenswrapper[5120]: I0316 17:04:46.629159 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a9e1bfc3-4b43-41e4-af96-bba09e1c74b3-run-httpd\") pod \"ceilometer-0\" (UID: \"a9e1bfc3-4b43-41e4-af96-bba09e1c74b3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:04:46 crc kubenswrapper[5120]: I0316 17:04:46.629243 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a9e1bfc3-4b43-41e4-af96-bba09e1c74b3-log-httpd\") pod \"ceilometer-0\" (UID: \"a9e1bfc3-4b43-41e4-af96-bba09e1c74b3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:04:46 crc kubenswrapper[5120]: I0316 17:04:46.629403 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a9e1bfc3-4b43-41e4-af96-bba09e1c74b3-config-data\") pod \"ceilometer-0\" (UID: \"a9e1bfc3-4b43-41e4-af96-bba09e1c74b3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:04:46 crc kubenswrapper[5120]: I0316 17:04:46.629509 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/a9e1bfc3-4b43-41e4-af96-bba09e1c74b3-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"a9e1bfc3-4b43-41e4-af96-bba09e1c74b3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:04:46 crc kubenswrapper[5120]: I0316 17:04:46.629579 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gr8h\" (UniqueName: \"kubernetes.io/projected/a9e1bfc3-4b43-41e4-af96-bba09e1c74b3-kube-api-access-9gr8h\") pod \"ceilometer-0\" (UID: \"a9e1bfc3-4b43-41e4-af96-bba09e1c74b3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:04:46 crc kubenswrapper[5120]: I0316 17:04:46.679715 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="01efd45f-aa9b-487b-99f1-3320f37ebd2e" path="/var/lib/kubelet/pods/01efd45f-aa9b-487b-99f1-3320f37ebd2e/volumes" Mar 16 17:04:46 crc kubenswrapper[5120]: I0316 17:04:46.731412 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9gr8h\" (UniqueName: \"kubernetes.io/projected/a9e1bfc3-4b43-41e4-af96-bba09e1c74b3-kube-api-access-9gr8h\") pod \"ceilometer-0\" (UID: \"a9e1bfc3-4b43-41e4-af96-bba09e1c74b3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:04:46 crc kubenswrapper[5120]: I0316 17:04:46.731557 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a9e1bfc3-4b43-41e4-af96-bba09e1c74b3-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"a9e1bfc3-4b43-41e4-af96-bba09e1c74b3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:04:46 crc kubenswrapper[5120]: I0316 17:04:46.731625 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a9e1bfc3-4b43-41e4-af96-bba09e1c74b3-scripts\") pod \"ceilometer-0\" (UID: \"a9e1bfc3-4b43-41e4-af96-bba09e1c74b3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:04:46 crc kubenswrapper[5120]: I0316 17:04:46.731702 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a9e1bfc3-4b43-41e4-af96-bba09e1c74b3-run-httpd\") pod \"ceilometer-0\" (UID: \"a9e1bfc3-4b43-41e4-af96-bba09e1c74b3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:04:46 crc kubenswrapper[5120]: I0316 17:04:46.731826 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a9e1bfc3-4b43-41e4-af96-bba09e1c74b3-log-httpd\") pod \"ceilometer-0\" (UID: \"a9e1bfc3-4b43-41e4-af96-bba09e1c74b3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:04:46 crc kubenswrapper[5120]: I0316 17:04:46.731872 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a9e1bfc3-4b43-41e4-af96-bba09e1c74b3-config-data\") pod \"ceilometer-0\" (UID: \"a9e1bfc3-4b43-41e4-af96-bba09e1c74b3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:04:46 crc kubenswrapper[5120]: I0316 17:04:46.732047 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/a9e1bfc3-4b43-41e4-af96-bba09e1c74b3-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"a9e1bfc3-4b43-41e4-af96-bba09e1c74b3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:04:46 crc kubenswrapper[5120]: I0316 17:04:46.734395 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a9e1bfc3-4b43-41e4-af96-bba09e1c74b3-log-httpd\") pod \"ceilometer-0\" (UID: \"a9e1bfc3-4b43-41e4-af96-bba09e1c74b3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:04:46 crc kubenswrapper[5120]: I0316 17:04:46.734965 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a9e1bfc3-4b43-41e4-af96-bba09e1c74b3-run-httpd\") pod \"ceilometer-0\" (UID: \"a9e1bfc3-4b43-41e4-af96-bba09e1c74b3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:04:46 crc kubenswrapper[5120]: I0316 17:04:46.740564 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a9e1bfc3-4b43-41e4-af96-bba09e1c74b3-config-data\") pod \"ceilometer-0\" (UID: \"a9e1bfc3-4b43-41e4-af96-bba09e1c74b3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:04:46 crc kubenswrapper[5120]: I0316 17:04:46.740622 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a9e1bfc3-4b43-41e4-af96-bba09e1c74b3-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"a9e1bfc3-4b43-41e4-af96-bba09e1c74b3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:04:46 crc kubenswrapper[5120]: I0316 17:04:46.741676 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a9e1bfc3-4b43-41e4-af96-bba09e1c74b3-scripts\") pod \"ceilometer-0\" (UID: \"a9e1bfc3-4b43-41e4-af96-bba09e1c74b3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:04:46 crc kubenswrapper[5120]: I0316 17:04:46.749563 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gr8h\" (UniqueName: \"kubernetes.io/projected/a9e1bfc3-4b43-41e4-af96-bba09e1c74b3-kube-api-access-9gr8h\") pod \"ceilometer-0\" (UID: \"a9e1bfc3-4b43-41e4-af96-bba09e1c74b3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:04:46 crc kubenswrapper[5120]: I0316 17:04:46.751465 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/a9e1bfc3-4b43-41e4-af96-bba09e1c74b3-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"a9e1bfc3-4b43-41e4-af96-bba09e1c74b3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:04:46 crc kubenswrapper[5120]: I0316 17:04:46.853962 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-hjq5d" Mar 16 17:04:46 crc kubenswrapper[5120]: I0316 17:04:46.902423 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:04:47 crc kubenswrapper[5120]: I0316 17:04:47.038841 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nbls7\" (UniqueName: \"kubernetes.io/projected/de53f6e3-e1a7-49fd-8c2e-e57add0fe5eb-kube-api-access-nbls7\") pod \"de53f6e3-e1a7-49fd-8c2e-e57add0fe5eb\" (UID: \"de53f6e3-e1a7-49fd-8c2e-e57add0fe5eb\") " Mar 16 17:04:47 crc kubenswrapper[5120]: I0316 17:04:47.039182 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/de53f6e3-e1a7-49fd-8c2e-e57add0fe5eb-combined-ca-bundle\") pod \"de53f6e3-e1a7-49fd-8c2e-e57add0fe5eb\" (UID: \"de53f6e3-e1a7-49fd-8c2e-e57add0fe5eb\") " Mar 16 17:04:47 crc kubenswrapper[5120]: I0316 17:04:47.039335 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/de53f6e3-e1a7-49fd-8c2e-e57add0fe5eb-db-sync-config-data\") pod \"de53f6e3-e1a7-49fd-8c2e-e57add0fe5eb\" (UID: \"de53f6e3-e1a7-49fd-8c2e-e57add0fe5eb\") " Mar 16 17:04:47 crc kubenswrapper[5120]: I0316 17:04:47.044074 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de53f6e3-e1a7-49fd-8c2e-e57add0fe5eb-db-sync-config-data" (OuterVolumeSpecName: "db-sync-config-data") pod "de53f6e3-e1a7-49fd-8c2e-e57add0fe5eb" (UID: "de53f6e3-e1a7-49fd-8c2e-e57add0fe5eb"). InnerVolumeSpecName "db-sync-config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:04:47 crc kubenswrapper[5120]: I0316 17:04:47.044344 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de53f6e3-e1a7-49fd-8c2e-e57add0fe5eb-kube-api-access-nbls7" (OuterVolumeSpecName: "kube-api-access-nbls7") pod "de53f6e3-e1a7-49fd-8c2e-e57add0fe5eb" (UID: "de53f6e3-e1a7-49fd-8c2e-e57add0fe5eb"). InnerVolumeSpecName "kube-api-access-nbls7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:04:47 crc kubenswrapper[5120]: I0316 17:04:47.080053 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de53f6e3-e1a7-49fd-8c2e-e57add0fe5eb-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "de53f6e3-e1a7-49fd-8c2e-e57add0fe5eb" (UID: "de53f6e3-e1a7-49fd-8c2e-e57add0fe5eb"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:04:47 crc kubenswrapper[5120]: I0316 17:04:47.142429 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nbls7\" (UniqueName: \"kubernetes.io/projected/de53f6e3-e1a7-49fd-8c2e-e57add0fe5eb-kube-api-access-nbls7\") on node \"crc\" DevicePath \"\"" Mar 16 17:04:47 crc kubenswrapper[5120]: I0316 17:04:47.142468 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/de53f6e3-e1a7-49fd-8c2e-e57add0fe5eb-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:04:47 crc kubenswrapper[5120]: I0316 17:04:47.142479 5120 reconciler_common.go:299] "Volume detached for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/de53f6e3-e1a7-49fd-8c2e-e57add0fe5eb-db-sync-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:04:47 crc kubenswrapper[5120]: I0316 17:04:47.355496 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:04:47 crc kubenswrapper[5120]: I0316 17:04:47.418414 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-hjq5d" event={"ID":"de53f6e3-e1a7-49fd-8c2e-e57add0fe5eb","Type":"ContainerDied","Data":"eeba41650291e17d1384cf8545c1428f626459d3b0f32a68390de0b2a6229e26"} Mar 16 17:04:47 crc kubenswrapper[5120]: I0316 17:04:47.418459 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="eeba41650291e17d1384cf8545c1428f626459d3b0f32a68390de0b2a6229e26" Mar 16 17:04:47 crc kubenswrapper[5120]: I0316 17:04:47.418421 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-hjq5d" Mar 16 17:04:47 crc kubenswrapper[5120]: I0316 17:04:47.420058 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a9e1bfc3-4b43-41e4-af96-bba09e1c74b3","Type":"ContainerStarted","Data":"b52e5cab1aa531dc8faacc8d8c7ae27b5f4af763b2afa06395e6883c49a36c7c"} Mar 16 17:04:47 crc kubenswrapper[5120]: I0316 17:04:47.422732 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"96b6737b-826e-4600-978e-3384f064dd15","Type":"ContainerStarted","Data":"589ac4179852ce4cf654b164939e6e9d6e1c80f6a1f72bb6c82ef2efaefb63ac"} Mar 16 17:04:47 crc kubenswrapper[5120]: I0316 17:04:47.433569 5120 generic.go:358] "Generic (PLEG): container finished" podID="6eeffada-e22e-43d1-b349-aab71bf994eb" containerID="5a021c077594081de548e79d15b87b604c22660a4b0c83508b50545f82c4fb3c" exitCode=0 Mar 16 17:04:47 crc kubenswrapper[5120]: I0316 17:04:47.433663 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-fd2mn" event={"ID":"6eeffada-e22e-43d1-b349-aab71bf994eb","Type":"ContainerDied","Data":"5a021c077594081de548e79d15b87b604c22660a4b0c83508b50545f82c4fb3c"} Mar 16 17:04:47 crc kubenswrapper[5120]: I0316 17:04:47.450100 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-external-api-0" podStartSLOduration=4.450072385 podStartE2EDuration="4.450072385s" podCreationTimestamp="2026-03-16 17:04:43 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:04:47.439288637 +0000 UTC m=+5589.593220294" watchObservedRunningTime="2026-03-16 17:04:47.450072385 +0000 UTC m=+5589.604004062" Mar 16 17:04:47 crc kubenswrapper[5120]: I0316 17:04:47.573392 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-9bbf69f54-w7krh"] Mar 16 17:04:47 crc kubenswrapper[5120]: I0316 17:04:47.574639 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de53f6e3-e1a7-49fd-8c2e-e57add0fe5eb" containerName="barbican-db-sync" Mar 16 17:04:47 crc kubenswrapper[5120]: I0316 17:04:47.574664 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="de53f6e3-e1a7-49fd-8c2e-e57add0fe5eb" containerName="barbican-db-sync" Mar 16 17:04:47 crc kubenswrapper[5120]: I0316 17:04:47.574940 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="de53f6e3-e1a7-49fd-8c2e-e57add0fe5eb" containerName="barbican-db-sync" Mar 16 17:04:47 crc kubenswrapper[5120]: I0316 17:04:47.598873 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-9bbf69f54-w7krh" Mar 16 17:04:47 crc kubenswrapper[5120]: I0316 17:04:47.625060 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-config-data\"" Mar 16 17:04:47 crc kubenswrapper[5120]: I0316 17:04:47.625405 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-keystone-listener-config-data\"" Mar 16 17:04:47 crc kubenswrapper[5120]: I0316 17:04:47.634752 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-barbican-dockercfg-8tjmr\"" Mar 16 17:04:47 crc kubenswrapper[5120]: I0316 17:04:47.670856 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-worker-86c6c867c-6rtwz"] Mar 16 17:04:47 crc kubenswrapper[5120]: I0316 17:04:47.698151 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-86c6c867c-6rtwz" Mar 16 17:04:47 crc kubenswrapper[5120]: I0316 17:04:47.712562 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-worker-config-data\"" Mar 16 17:04:47 crc kubenswrapper[5120]: I0316 17:04:47.714475 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-9bbf69f54-w7krh"] Mar 16 17:04:47 crc kubenswrapper[5120]: I0316 17:04:47.736044 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-86c6c867c-6rtwz"] Mar 16 17:04:47 crc kubenswrapper[5120]: I0316 17:04:47.764270 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jgp9f\" (UniqueName: \"kubernetes.io/projected/13f9ea15-8a79-4a2e-87bb-eeee5bb593ee-kube-api-access-jgp9f\") pod \"barbican-keystone-listener-9bbf69f54-w7krh\" (UID: \"13f9ea15-8a79-4a2e-87bb-eeee5bb593ee\") " pod="openstack-kuttl-tests/barbican-keystone-listener-9bbf69f54-w7krh" Mar 16 17:04:47 crc kubenswrapper[5120]: I0316 17:04:47.764437 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/13f9ea15-8a79-4a2e-87bb-eeee5bb593ee-config-data-custom\") pod \"barbican-keystone-listener-9bbf69f54-w7krh\" (UID: \"13f9ea15-8a79-4a2e-87bb-eeee5bb593ee\") " pod="openstack-kuttl-tests/barbican-keystone-listener-9bbf69f54-w7krh" Mar 16 17:04:47 crc kubenswrapper[5120]: I0316 17:04:47.764548 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/13f9ea15-8a79-4a2e-87bb-eeee5bb593ee-logs\") pod \"barbican-keystone-listener-9bbf69f54-w7krh\" (UID: \"13f9ea15-8a79-4a2e-87bb-eeee5bb593ee\") " pod="openstack-kuttl-tests/barbican-keystone-listener-9bbf69f54-w7krh" Mar 16 17:04:47 crc kubenswrapper[5120]: I0316 17:04:47.764804 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/13f9ea15-8a79-4a2e-87bb-eeee5bb593ee-combined-ca-bundle\") pod \"barbican-keystone-listener-9bbf69f54-w7krh\" (UID: \"13f9ea15-8a79-4a2e-87bb-eeee5bb593ee\") " pod="openstack-kuttl-tests/barbican-keystone-listener-9bbf69f54-w7krh" Mar 16 17:04:47 crc kubenswrapper[5120]: I0316 17:04:47.765033 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/13f9ea15-8a79-4a2e-87bb-eeee5bb593ee-config-data\") pod \"barbican-keystone-listener-9bbf69f54-w7krh\" (UID: \"13f9ea15-8a79-4a2e-87bb-eeee5bb593ee\") " pod="openstack-kuttl-tests/barbican-keystone-listener-9bbf69f54-w7krh" Mar 16 17:04:47 crc kubenswrapper[5120]: I0316 17:04:47.829168 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-api-79d5f46648-ptcxs"] Mar 16 17:04:47 crc kubenswrapper[5120]: I0316 17:04:47.840498 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-79d5f46648-ptcxs" Mar 16 17:04:47 crc kubenswrapper[5120]: I0316 17:04:47.842947 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-api-config-data\"" Mar 16 17:04:47 crc kubenswrapper[5120]: I0316 17:04:47.866539 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-79d5f46648-ptcxs"] Mar 16 17:04:47 crc kubenswrapper[5120]: I0316 17:04:47.869883 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/13f9ea15-8a79-4a2e-87bb-eeee5bb593ee-config-data\") pod \"barbican-keystone-listener-9bbf69f54-w7krh\" (UID: \"13f9ea15-8a79-4a2e-87bb-eeee5bb593ee\") " pod="openstack-kuttl-tests/barbican-keystone-listener-9bbf69f54-w7krh" Mar 16 17:04:47 crc kubenswrapper[5120]: I0316 17:04:47.869946 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9a8dcc05-35bc-4bcd-9e33-b90543374049-combined-ca-bundle\") pod \"barbican-worker-86c6c867c-6rtwz\" (UID: \"9a8dcc05-35bc-4bcd-9e33-b90543374049\") " pod="openstack-kuttl-tests/barbican-worker-86c6c867c-6rtwz" Mar 16 17:04:47 crc kubenswrapper[5120]: I0316 17:04:47.869993 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mngtc\" (UniqueName: \"kubernetes.io/projected/9a8dcc05-35bc-4bcd-9e33-b90543374049-kube-api-access-mngtc\") pod \"barbican-worker-86c6c867c-6rtwz\" (UID: \"9a8dcc05-35bc-4bcd-9e33-b90543374049\") " pod="openstack-kuttl-tests/barbican-worker-86c6c867c-6rtwz" Mar 16 17:04:47 crc kubenswrapper[5120]: I0316 17:04:47.870160 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/9a8dcc05-35bc-4bcd-9e33-b90543374049-config-data-custom\") pod \"barbican-worker-86c6c867c-6rtwz\" (UID: \"9a8dcc05-35bc-4bcd-9e33-b90543374049\") " pod="openstack-kuttl-tests/barbican-worker-86c6c867c-6rtwz" Mar 16 17:04:47 crc kubenswrapper[5120]: I0316 17:04:47.870230 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jgp9f\" (UniqueName: \"kubernetes.io/projected/13f9ea15-8a79-4a2e-87bb-eeee5bb593ee-kube-api-access-jgp9f\") pod \"barbican-keystone-listener-9bbf69f54-w7krh\" (UID: \"13f9ea15-8a79-4a2e-87bb-eeee5bb593ee\") " pod="openstack-kuttl-tests/barbican-keystone-listener-9bbf69f54-w7krh" Mar 16 17:04:47 crc kubenswrapper[5120]: I0316 17:04:47.870311 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/13f9ea15-8a79-4a2e-87bb-eeee5bb593ee-config-data-custom\") pod \"barbican-keystone-listener-9bbf69f54-w7krh\" (UID: \"13f9ea15-8a79-4a2e-87bb-eeee5bb593ee\") " pod="openstack-kuttl-tests/barbican-keystone-listener-9bbf69f54-w7krh" Mar 16 17:04:47 crc kubenswrapper[5120]: I0316 17:04:47.870386 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/13f9ea15-8a79-4a2e-87bb-eeee5bb593ee-logs\") pod \"barbican-keystone-listener-9bbf69f54-w7krh\" (UID: \"13f9ea15-8a79-4a2e-87bb-eeee5bb593ee\") " pod="openstack-kuttl-tests/barbican-keystone-listener-9bbf69f54-w7krh" Mar 16 17:04:47 crc kubenswrapper[5120]: I0316 17:04:47.870426 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9a8dcc05-35bc-4bcd-9e33-b90543374049-logs\") pod \"barbican-worker-86c6c867c-6rtwz\" (UID: \"9a8dcc05-35bc-4bcd-9e33-b90543374049\") " pod="openstack-kuttl-tests/barbican-worker-86c6c867c-6rtwz" Mar 16 17:04:47 crc kubenswrapper[5120]: I0316 17:04:47.870630 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/13f9ea15-8a79-4a2e-87bb-eeee5bb593ee-combined-ca-bundle\") pod \"barbican-keystone-listener-9bbf69f54-w7krh\" (UID: \"13f9ea15-8a79-4a2e-87bb-eeee5bb593ee\") " pod="openstack-kuttl-tests/barbican-keystone-listener-9bbf69f54-w7krh" Mar 16 17:04:47 crc kubenswrapper[5120]: I0316 17:04:47.870720 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9a8dcc05-35bc-4bcd-9e33-b90543374049-config-data\") pod \"barbican-worker-86c6c867c-6rtwz\" (UID: \"9a8dcc05-35bc-4bcd-9e33-b90543374049\") " pod="openstack-kuttl-tests/barbican-worker-86c6c867c-6rtwz" Mar 16 17:04:47 crc kubenswrapper[5120]: I0316 17:04:47.873457 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/13f9ea15-8a79-4a2e-87bb-eeee5bb593ee-logs\") pod \"barbican-keystone-listener-9bbf69f54-w7krh\" (UID: \"13f9ea15-8a79-4a2e-87bb-eeee5bb593ee\") " pod="openstack-kuttl-tests/barbican-keystone-listener-9bbf69f54-w7krh" Mar 16 17:04:47 crc kubenswrapper[5120]: I0316 17:04:47.882707 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/13f9ea15-8a79-4a2e-87bb-eeee5bb593ee-combined-ca-bundle\") pod \"barbican-keystone-listener-9bbf69f54-w7krh\" (UID: \"13f9ea15-8a79-4a2e-87bb-eeee5bb593ee\") " pod="openstack-kuttl-tests/barbican-keystone-listener-9bbf69f54-w7krh" Mar 16 17:04:47 crc kubenswrapper[5120]: I0316 17:04:47.883291 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/13f9ea15-8a79-4a2e-87bb-eeee5bb593ee-config-data-custom\") pod \"barbican-keystone-listener-9bbf69f54-w7krh\" (UID: \"13f9ea15-8a79-4a2e-87bb-eeee5bb593ee\") " pod="openstack-kuttl-tests/barbican-keystone-listener-9bbf69f54-w7krh" Mar 16 17:04:47 crc kubenswrapper[5120]: I0316 17:04:47.883944 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/13f9ea15-8a79-4a2e-87bb-eeee5bb593ee-config-data\") pod \"barbican-keystone-listener-9bbf69f54-w7krh\" (UID: \"13f9ea15-8a79-4a2e-87bb-eeee5bb593ee\") " pod="openstack-kuttl-tests/barbican-keystone-listener-9bbf69f54-w7krh" Mar 16 17:04:47 crc kubenswrapper[5120]: I0316 17:04:47.911822 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jgp9f\" (UniqueName: \"kubernetes.io/projected/13f9ea15-8a79-4a2e-87bb-eeee5bb593ee-kube-api-access-jgp9f\") pod \"barbican-keystone-listener-9bbf69f54-w7krh\" (UID: \"13f9ea15-8a79-4a2e-87bb-eeee5bb593ee\") " pod="openstack-kuttl-tests/barbican-keystone-listener-9bbf69f54-w7krh" Mar 16 17:04:47 crc kubenswrapper[5120]: I0316 17:04:47.955520 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-9bbf69f54-w7krh" Mar 16 17:04:47 crc kubenswrapper[5120]: I0316 17:04:47.977468 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9a8dcc05-35bc-4bcd-9e33-b90543374049-combined-ca-bundle\") pod \"barbican-worker-86c6c867c-6rtwz\" (UID: \"9a8dcc05-35bc-4bcd-9e33-b90543374049\") " pod="openstack-kuttl-tests/barbican-worker-86c6c867c-6rtwz" Mar 16 17:04:47 crc kubenswrapper[5120]: I0316 17:04:47.977544 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0ba70df7-6538-42cf-9fbc-c6c3473cd8ec-config-data\") pod \"barbican-api-79d5f46648-ptcxs\" (UID: \"0ba70df7-6538-42cf-9fbc-c6c3473cd8ec\") " pod="openstack-kuttl-tests/barbican-api-79d5f46648-ptcxs" Mar 16 17:04:47 crc kubenswrapper[5120]: I0316 17:04:47.977572 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mngtc\" (UniqueName: \"kubernetes.io/projected/9a8dcc05-35bc-4bcd-9e33-b90543374049-kube-api-access-mngtc\") pod \"barbican-worker-86c6c867c-6rtwz\" (UID: \"9a8dcc05-35bc-4bcd-9e33-b90543374049\") " pod="openstack-kuttl-tests/barbican-worker-86c6c867c-6rtwz" Mar 16 17:04:47 crc kubenswrapper[5120]: I0316 17:04:47.977636 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzqbk\" (UniqueName: \"kubernetes.io/projected/0ba70df7-6538-42cf-9fbc-c6c3473cd8ec-kube-api-access-hzqbk\") pod \"barbican-api-79d5f46648-ptcxs\" (UID: \"0ba70df7-6538-42cf-9fbc-c6c3473cd8ec\") " pod="openstack-kuttl-tests/barbican-api-79d5f46648-ptcxs" Mar 16 17:04:47 crc kubenswrapper[5120]: I0316 17:04:47.977727 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/0ba70df7-6538-42cf-9fbc-c6c3473cd8ec-config-data-custom\") pod \"barbican-api-79d5f46648-ptcxs\" (UID: \"0ba70df7-6538-42cf-9fbc-c6c3473cd8ec\") " pod="openstack-kuttl-tests/barbican-api-79d5f46648-ptcxs" Mar 16 17:04:47 crc kubenswrapper[5120]: I0316 17:04:47.977797 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/9a8dcc05-35bc-4bcd-9e33-b90543374049-config-data-custom\") pod \"barbican-worker-86c6c867c-6rtwz\" (UID: \"9a8dcc05-35bc-4bcd-9e33-b90543374049\") " pod="openstack-kuttl-tests/barbican-worker-86c6c867c-6rtwz" Mar 16 17:04:47 crc kubenswrapper[5120]: I0316 17:04:47.977951 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0ba70df7-6538-42cf-9fbc-c6c3473cd8ec-combined-ca-bundle\") pod \"barbican-api-79d5f46648-ptcxs\" (UID: \"0ba70df7-6538-42cf-9fbc-c6c3473cd8ec\") " pod="openstack-kuttl-tests/barbican-api-79d5f46648-ptcxs" Mar 16 17:04:47 crc kubenswrapper[5120]: I0316 17:04:47.977984 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0ba70df7-6538-42cf-9fbc-c6c3473cd8ec-logs\") pod \"barbican-api-79d5f46648-ptcxs\" (UID: \"0ba70df7-6538-42cf-9fbc-c6c3473cd8ec\") " pod="openstack-kuttl-tests/barbican-api-79d5f46648-ptcxs" Mar 16 17:04:47 crc kubenswrapper[5120]: I0316 17:04:47.978021 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9a8dcc05-35bc-4bcd-9e33-b90543374049-logs\") pod \"barbican-worker-86c6c867c-6rtwz\" (UID: \"9a8dcc05-35bc-4bcd-9e33-b90543374049\") " pod="openstack-kuttl-tests/barbican-worker-86c6c867c-6rtwz" Mar 16 17:04:47 crc kubenswrapper[5120]: I0316 17:04:47.978160 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9a8dcc05-35bc-4bcd-9e33-b90543374049-config-data\") pod \"barbican-worker-86c6c867c-6rtwz\" (UID: \"9a8dcc05-35bc-4bcd-9e33-b90543374049\") " pod="openstack-kuttl-tests/barbican-worker-86c6c867c-6rtwz" Mar 16 17:04:47 crc kubenswrapper[5120]: I0316 17:04:47.984137 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9a8dcc05-35bc-4bcd-9e33-b90543374049-logs\") pod \"barbican-worker-86c6c867c-6rtwz\" (UID: \"9a8dcc05-35bc-4bcd-9e33-b90543374049\") " pod="openstack-kuttl-tests/barbican-worker-86c6c867c-6rtwz" Mar 16 17:04:47 crc kubenswrapper[5120]: I0316 17:04:47.996120 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9a8dcc05-35bc-4bcd-9e33-b90543374049-config-data\") pod \"barbican-worker-86c6c867c-6rtwz\" (UID: \"9a8dcc05-35bc-4bcd-9e33-b90543374049\") " pod="openstack-kuttl-tests/barbican-worker-86c6c867c-6rtwz" Mar 16 17:04:48 crc kubenswrapper[5120]: I0316 17:04:48.000401 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9a8dcc05-35bc-4bcd-9e33-b90543374049-combined-ca-bundle\") pod \"barbican-worker-86c6c867c-6rtwz\" (UID: \"9a8dcc05-35bc-4bcd-9e33-b90543374049\") " pod="openstack-kuttl-tests/barbican-worker-86c6c867c-6rtwz" Mar 16 17:04:48 crc kubenswrapper[5120]: I0316 17:04:48.009536 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/9a8dcc05-35bc-4bcd-9e33-b90543374049-config-data-custom\") pod \"barbican-worker-86c6c867c-6rtwz\" (UID: \"9a8dcc05-35bc-4bcd-9e33-b90543374049\") " pod="openstack-kuttl-tests/barbican-worker-86c6c867c-6rtwz" Mar 16 17:04:48 crc kubenswrapper[5120]: I0316 17:04:48.022553 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mngtc\" (UniqueName: \"kubernetes.io/projected/9a8dcc05-35bc-4bcd-9e33-b90543374049-kube-api-access-mngtc\") pod \"barbican-worker-86c6c867c-6rtwz\" (UID: \"9a8dcc05-35bc-4bcd-9e33-b90543374049\") " pod="openstack-kuttl-tests/barbican-worker-86c6c867c-6rtwz" Mar 16 17:04:48 crc kubenswrapper[5120]: I0316 17:04:48.047456 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-86c6c867c-6rtwz" Mar 16 17:04:48 crc kubenswrapper[5120]: I0316 17:04:48.089818 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/0ba70df7-6538-42cf-9fbc-c6c3473cd8ec-config-data-custom\") pod \"barbican-api-79d5f46648-ptcxs\" (UID: \"0ba70df7-6538-42cf-9fbc-c6c3473cd8ec\") " pod="openstack-kuttl-tests/barbican-api-79d5f46648-ptcxs" Mar 16 17:04:48 crc kubenswrapper[5120]: I0316 17:04:48.089972 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0ba70df7-6538-42cf-9fbc-c6c3473cd8ec-combined-ca-bundle\") pod \"barbican-api-79d5f46648-ptcxs\" (UID: \"0ba70df7-6538-42cf-9fbc-c6c3473cd8ec\") " pod="openstack-kuttl-tests/barbican-api-79d5f46648-ptcxs" Mar 16 17:04:48 crc kubenswrapper[5120]: I0316 17:04:48.089995 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0ba70df7-6538-42cf-9fbc-c6c3473cd8ec-logs\") pod \"barbican-api-79d5f46648-ptcxs\" (UID: \"0ba70df7-6538-42cf-9fbc-c6c3473cd8ec\") " pod="openstack-kuttl-tests/barbican-api-79d5f46648-ptcxs" Mar 16 17:04:48 crc kubenswrapper[5120]: I0316 17:04:48.090247 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0ba70df7-6538-42cf-9fbc-c6c3473cd8ec-config-data\") pod \"barbican-api-79d5f46648-ptcxs\" (UID: \"0ba70df7-6538-42cf-9fbc-c6c3473cd8ec\") " pod="openstack-kuttl-tests/barbican-api-79d5f46648-ptcxs" Mar 16 17:04:48 crc kubenswrapper[5120]: I0316 17:04:48.090341 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hzqbk\" (UniqueName: \"kubernetes.io/projected/0ba70df7-6538-42cf-9fbc-c6c3473cd8ec-kube-api-access-hzqbk\") pod \"barbican-api-79d5f46648-ptcxs\" (UID: \"0ba70df7-6538-42cf-9fbc-c6c3473cd8ec\") " pod="openstack-kuttl-tests/barbican-api-79d5f46648-ptcxs" Mar 16 17:04:48 crc kubenswrapper[5120]: I0316 17:04:48.092078 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0ba70df7-6538-42cf-9fbc-c6c3473cd8ec-logs\") pod \"barbican-api-79d5f46648-ptcxs\" (UID: \"0ba70df7-6538-42cf-9fbc-c6c3473cd8ec\") " pod="openstack-kuttl-tests/barbican-api-79d5f46648-ptcxs" Mar 16 17:04:48 crc kubenswrapper[5120]: I0316 17:04:48.098506 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0ba70df7-6538-42cf-9fbc-c6c3473cd8ec-combined-ca-bundle\") pod \"barbican-api-79d5f46648-ptcxs\" (UID: \"0ba70df7-6538-42cf-9fbc-c6c3473cd8ec\") " pod="openstack-kuttl-tests/barbican-api-79d5f46648-ptcxs" Mar 16 17:04:48 crc kubenswrapper[5120]: I0316 17:04:48.102250 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/0ba70df7-6538-42cf-9fbc-c6c3473cd8ec-config-data-custom\") pod \"barbican-api-79d5f46648-ptcxs\" (UID: \"0ba70df7-6538-42cf-9fbc-c6c3473cd8ec\") " pod="openstack-kuttl-tests/barbican-api-79d5f46648-ptcxs" Mar 16 17:04:48 crc kubenswrapper[5120]: I0316 17:04:48.102405 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0ba70df7-6538-42cf-9fbc-c6c3473cd8ec-config-data\") pod \"barbican-api-79d5f46648-ptcxs\" (UID: \"0ba70df7-6538-42cf-9fbc-c6c3473cd8ec\") " pod="openstack-kuttl-tests/barbican-api-79d5f46648-ptcxs" Mar 16 17:04:48 crc kubenswrapper[5120]: I0316 17:04:48.122209 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzqbk\" (UniqueName: \"kubernetes.io/projected/0ba70df7-6538-42cf-9fbc-c6c3473cd8ec-kube-api-access-hzqbk\") pod \"barbican-api-79d5f46648-ptcxs\" (UID: \"0ba70df7-6538-42cf-9fbc-c6c3473cd8ec\") " pod="openstack-kuttl-tests/barbican-api-79d5f46648-ptcxs" Mar 16 17:04:48 crc kubenswrapper[5120]: I0316 17:04:48.171148 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-79d5f46648-ptcxs" Mar 16 17:04:48 crc kubenswrapper[5120]: I0316 17:04:48.448516 5120 generic.go:358] "Generic (PLEG): container finished" podID="727c8c9a-fcc8-42c3-8a58-df87dc295191" containerID="b03c923ee5173cf2f5c215baaf2037300c95b3029a814fb8eff08aaad254ee85" exitCode=0 Mar 16 17:04:48 crc kubenswrapper[5120]: I0316 17:04:48.448710 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-qk75k" event={"ID":"727c8c9a-fcc8-42c3-8a58-df87dc295191","Type":"ContainerDied","Data":"b03c923ee5173cf2f5c215baaf2037300c95b3029a814fb8eff08aaad254ee85"} Mar 16 17:04:48 crc kubenswrapper[5120]: I0316 17:04:48.454789 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a9e1bfc3-4b43-41e4-af96-bba09e1c74b3","Type":"ContainerStarted","Data":"60c2d39c36a3a538eeada6bbcbcf4c86d96fd24cd27c838f963ac043bffb0d92"} Mar 16 17:04:48 crc kubenswrapper[5120]: I0316 17:04:48.520132 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-9bbf69f54-w7krh"] Mar 16 17:04:48 crc kubenswrapper[5120]: W0316 17:04:48.540208 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod13f9ea15_8a79_4a2e_87bb_eeee5bb593ee.slice/crio-807df865a0eadabf88ace51ec38d3c252b55723fc6aa77fad7d2a51a733d147e WatchSource:0}: Error finding container 807df865a0eadabf88ace51ec38d3c252b55723fc6aa77fad7d2a51a733d147e: Status 404 returned error can't find the container with id 807df865a0eadabf88ace51ec38d3c252b55723fc6aa77fad7d2a51a733d147e Mar 16 17:04:48 crc kubenswrapper[5120]: I0316 17:04:48.703154 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-86c6c867c-6rtwz"] Mar 16 17:04:48 crc kubenswrapper[5120]: I0316 17:04:48.842244 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-79d5f46648-ptcxs"] Mar 16 17:04:48 crc kubenswrapper[5120]: W0316 17:04:48.862260 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0ba70df7_6538_42cf_9fbc_c6c3473cd8ec.slice/crio-2ac9e1d2b22624fb042a5eb900189570514dd92411723ab9a6a52844d280057c WatchSource:0}: Error finding container 2ac9e1d2b22624fb042a5eb900189570514dd92411723ab9a6a52844d280057c: Status 404 returned error can't find the container with id 2ac9e1d2b22624fb042a5eb900189570514dd92411723ab9a6a52844d280057c Mar 16 17:04:48 crc kubenswrapper[5120]: I0316 17:04:48.904407 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-fd2mn" Mar 16 17:04:49 crc kubenswrapper[5120]: I0316 17:04:49.014282 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6eeffada-e22e-43d1-b349-aab71bf994eb-config\") pod \"6eeffada-e22e-43d1-b349-aab71bf994eb\" (UID: \"6eeffada-e22e-43d1-b349-aab71bf994eb\") " Mar 16 17:04:49 crc kubenswrapper[5120]: I0316 17:04:49.014591 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6eeffada-e22e-43d1-b349-aab71bf994eb-combined-ca-bundle\") pod \"6eeffada-e22e-43d1-b349-aab71bf994eb\" (UID: \"6eeffada-e22e-43d1-b349-aab71bf994eb\") " Mar 16 17:04:49 crc kubenswrapper[5120]: I0316 17:04:49.014981 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mcnlj\" (UniqueName: \"kubernetes.io/projected/6eeffada-e22e-43d1-b349-aab71bf994eb-kube-api-access-mcnlj\") pod \"6eeffada-e22e-43d1-b349-aab71bf994eb\" (UID: \"6eeffada-e22e-43d1-b349-aab71bf994eb\") " Mar 16 17:04:49 crc kubenswrapper[5120]: I0316 17:04:49.024229 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6eeffada-e22e-43d1-b349-aab71bf994eb-kube-api-access-mcnlj" (OuterVolumeSpecName: "kube-api-access-mcnlj") pod "6eeffada-e22e-43d1-b349-aab71bf994eb" (UID: "6eeffada-e22e-43d1-b349-aab71bf994eb"). InnerVolumeSpecName "kube-api-access-mcnlj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:04:49 crc kubenswrapper[5120]: I0316 17:04:49.048442 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6eeffada-e22e-43d1-b349-aab71bf994eb-config" (OuterVolumeSpecName: "config") pod "6eeffada-e22e-43d1-b349-aab71bf994eb" (UID: "6eeffada-e22e-43d1-b349-aab71bf994eb"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:04:49 crc kubenswrapper[5120]: I0316 17:04:49.049526 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6eeffada-e22e-43d1-b349-aab71bf994eb-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "6eeffada-e22e-43d1-b349-aab71bf994eb" (UID: "6eeffada-e22e-43d1-b349-aab71bf994eb"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:04:49 crc kubenswrapper[5120]: I0316 17:04:49.118526 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/6eeffada-e22e-43d1-b349-aab71bf994eb-config\") on node \"crc\" DevicePath \"\"" Mar 16 17:04:49 crc kubenswrapper[5120]: I0316 17:04:49.118559 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6eeffada-e22e-43d1-b349-aab71bf994eb-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:04:49 crc kubenswrapper[5120]: I0316 17:04:49.118570 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mcnlj\" (UniqueName: \"kubernetes.io/projected/6eeffada-e22e-43d1-b349-aab71bf994eb-kube-api-access-mcnlj\") on node \"crc\" DevicePath \"\"" Mar 16 17:04:49 crc kubenswrapper[5120]: I0316 17:04:49.501628 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a9e1bfc3-4b43-41e4-af96-bba09e1c74b3","Type":"ContainerStarted","Data":"98a9675a48061678c809e191cbebf8b353cb09cbd50fdc3e788e3b63210a648d"} Mar 16 17:04:49 crc kubenswrapper[5120]: I0316 17:04:49.519847 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-79d5f46648-ptcxs" event={"ID":"0ba70df7-6538-42cf-9fbc-c6c3473cd8ec","Type":"ContainerStarted","Data":"88c9553a5802d8d7b8c47aab0188ef91fae69f404a2274edf6d00922a88dac58"} Mar 16 17:04:49 crc kubenswrapper[5120]: I0316 17:04:49.519920 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-79d5f46648-ptcxs" event={"ID":"0ba70df7-6538-42cf-9fbc-c6c3473cd8ec","Type":"ContainerStarted","Data":"00c04018db0ce5d7f01a159aebafede490e4b203d6e2ad891b5a88dd112d40e2"} Mar 16 17:04:49 crc kubenswrapper[5120]: I0316 17:04:49.519938 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-79d5f46648-ptcxs" event={"ID":"0ba70df7-6538-42cf-9fbc-c6c3473cd8ec","Type":"ContainerStarted","Data":"2ac9e1d2b22624fb042a5eb900189570514dd92411723ab9a6a52844d280057c"} Mar 16 17:04:49 crc kubenswrapper[5120]: I0316 17:04:49.519962 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-79d5f46648-ptcxs" Mar 16 17:04:49 crc kubenswrapper[5120]: I0316 17:04:49.523319 5120 generic.go:358] "Generic (PLEG): container finished" podID="f4aa434d-2a76-4cd1-b875-74b763ad15bd" containerID="872bbebcb661fffcc8e13eb4398a4bf7f4c0d71bf43c1e67d9574cecdab4ca04" exitCode=0 Mar 16 17:04:49 crc kubenswrapper[5120]: I0316 17:04:49.523432 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-f26kx" event={"ID":"f4aa434d-2a76-4cd1-b875-74b763ad15bd","Type":"ContainerDied","Data":"872bbebcb661fffcc8e13eb4398a4bf7f4c0d71bf43c1e67d9574cecdab4ca04"} Mar 16 17:04:49 crc kubenswrapper[5120]: I0316 17:04:49.531200 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-fd2mn" Mar 16 17:04:49 crc kubenswrapper[5120]: I0316 17:04:49.531226 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-fd2mn" event={"ID":"6eeffada-e22e-43d1-b349-aab71bf994eb","Type":"ContainerDied","Data":"cb4c9617efe6a2e1f69b1406ae33c2d6c24b10c247d3b16856757f56e95c48b5"} Mar 16 17:04:49 crc kubenswrapper[5120]: I0316 17:04:49.531276 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cb4c9617efe6a2e1f69b1406ae33c2d6c24b10c247d3b16856757f56e95c48b5" Mar 16 17:04:49 crc kubenswrapper[5120]: I0316 17:04:49.534321 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-9bbf69f54-w7krh" event={"ID":"13f9ea15-8a79-4a2e-87bb-eeee5bb593ee","Type":"ContainerStarted","Data":"0ca4518c674a9fcd5147789ec4f4ed26f8157453883a4e00412653726814f834"} Mar 16 17:04:49 crc kubenswrapper[5120]: I0316 17:04:49.534363 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-9bbf69f54-w7krh" event={"ID":"13f9ea15-8a79-4a2e-87bb-eeee5bb593ee","Type":"ContainerStarted","Data":"4ba10c753384bcd6c6df8154b987f5c33462bbab2b730af7b9575e307ee0f9a4"} Mar 16 17:04:49 crc kubenswrapper[5120]: I0316 17:04:49.534377 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-9bbf69f54-w7krh" event={"ID":"13f9ea15-8a79-4a2e-87bb-eeee5bb593ee","Type":"ContainerStarted","Data":"807df865a0eadabf88ace51ec38d3c252b55723fc6aa77fad7d2a51a733d147e"} Mar 16 17:04:49 crc kubenswrapper[5120]: I0316 17:04:49.538723 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-api-79d5f46648-ptcxs" podStartSLOduration=2.538705313 podStartE2EDuration="2.538705313s" podCreationTimestamp="2026-03-16 17:04:47 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:04:49.533612653 +0000 UTC m=+5591.687544310" watchObservedRunningTime="2026-03-16 17:04:49.538705313 +0000 UTC m=+5591.692636970" Mar 16 17:04:49 crc kubenswrapper[5120]: I0316 17:04:49.543959 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-86c6c867c-6rtwz" event={"ID":"9a8dcc05-35bc-4bcd-9e33-b90543374049","Type":"ContainerStarted","Data":"e53c17a81540e6c5cdc9f087ef3483a478ca22c0ec3e5f339b6016a47c3cf5d9"} Mar 16 17:04:49 crc kubenswrapper[5120]: I0316 17:04:49.544008 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-86c6c867c-6rtwz" event={"ID":"9a8dcc05-35bc-4bcd-9e33-b90543374049","Type":"ContainerStarted","Data":"85cb67abb8b62ca3bf3b6b7226041ce7d719f7c8727b9d274261d3e8c0b391c2"} Mar 16 17:04:49 crc kubenswrapper[5120]: I0316 17:04:49.544020 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-86c6c867c-6rtwz" event={"ID":"9a8dcc05-35bc-4bcd-9e33-b90543374049","Type":"ContainerStarted","Data":"2d95ae5cf048f5a71959dce70d378a93ba6fc79bfe289bfdd8e66d8dbbee6db2"} Mar 16 17:04:49 crc kubenswrapper[5120]: I0316 17:04:49.622039 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-keystone-listener-9bbf69f54-w7krh" podStartSLOduration=2.622023296 podStartE2EDuration="2.622023296s" podCreationTimestamp="2026-03-16 17:04:47 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:04:49.602588799 +0000 UTC m=+5591.756520456" watchObservedRunningTime="2026-03-16 17:04:49.622023296 +0000 UTC m=+5591.775954953" Mar 16 17:04:49 crc kubenswrapper[5120]: I0316 17:04:49.643865 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-worker-86c6c867c-6rtwz" podStartSLOduration=2.643817897 podStartE2EDuration="2.643817897s" podCreationTimestamp="2026-03-16 17:04:47 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:04:49.632561386 +0000 UTC m=+5591.786493043" watchObservedRunningTime="2026-03-16 17:04:49.643817897 +0000 UTC m=+5591.797749554" Mar 16 17:04:49 crc kubenswrapper[5120]: I0316 17:04:49.851928 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-78d789956f-w2p5r"] Mar 16 17:04:49 crc kubenswrapper[5120]: I0316 17:04:49.903294 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6eeffada-e22e-43d1-b349-aab71bf994eb" containerName="neutron-db-sync" Mar 16 17:04:49 crc kubenswrapper[5120]: I0316 17:04:49.903797 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="6eeffada-e22e-43d1-b349-aab71bf994eb" containerName="neutron-db-sync" Mar 16 17:04:49 crc kubenswrapper[5120]: I0316 17:04:49.904889 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="6eeffada-e22e-43d1-b349-aab71bf994eb" containerName="neutron-db-sync" Mar 16 17:04:49 crc kubenswrapper[5120]: I0316 17:04:49.936196 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-78d789956f-w2p5r"] Mar 16 17:04:49 crc kubenswrapper[5120]: I0316 17:04:49.936386 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-78d789956f-w2p5r" Mar 16 17:04:49 crc kubenswrapper[5120]: I0316 17:04:49.972965 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-neutron-dockercfg-k92rs\"" Mar 16 17:04:49 crc kubenswrapper[5120]: I0316 17:04:49.974977 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-httpd-config\"" Mar 16 17:04:49 crc kubenswrapper[5120]: I0316 17:04:49.975334 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-config\"" Mar 16 17:04:49 crc kubenswrapper[5120]: I0316 17:04:49.977079 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-neutron-ovndbs\"" Mar 16 17:04:50 crc kubenswrapper[5120]: I0316 17:04:50.039738 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-qk75k" Mar 16 17:04:50 crc kubenswrapper[5120]: I0316 17:04:50.048092 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f3e6d999-ab20-420f-b881-a34d5781d9f9-config\") pod \"neutron-78d789956f-w2p5r\" (UID: \"f3e6d999-ab20-420f-b881-a34d5781d9f9\") " pod="openstack-kuttl-tests/neutron-78d789956f-w2p5r" Mar 16 17:04:50 crc kubenswrapper[5120]: I0316 17:04:50.048456 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f3e6d999-ab20-420f-b881-a34d5781d9f9-combined-ca-bundle\") pod \"neutron-78d789956f-w2p5r\" (UID: \"f3e6d999-ab20-420f-b881-a34d5781d9f9\") " pod="openstack-kuttl-tests/neutron-78d789956f-w2p5r" Mar 16 17:04:50 crc kubenswrapper[5120]: I0316 17:04:50.048721 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/f3e6d999-ab20-420f-b881-a34d5781d9f9-httpd-config\") pod \"neutron-78d789956f-w2p5r\" (UID: \"f3e6d999-ab20-420f-b881-a34d5781d9f9\") " pod="openstack-kuttl-tests/neutron-78d789956f-w2p5r" Mar 16 17:04:50 crc kubenswrapper[5120]: I0316 17:04:50.048896 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5zn5\" (UniqueName: \"kubernetes.io/projected/f3e6d999-ab20-420f-b881-a34d5781d9f9-kube-api-access-g5zn5\") pod \"neutron-78d789956f-w2p5r\" (UID: \"f3e6d999-ab20-420f-b881-a34d5781d9f9\") " pod="openstack-kuttl-tests/neutron-78d789956f-w2p5r" Mar 16 17:04:50 crc kubenswrapper[5120]: I0316 17:04:50.049056 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/f3e6d999-ab20-420f-b881-a34d5781d9f9-ovndb-tls-certs\") pod \"neutron-78d789956f-w2p5r\" (UID: \"f3e6d999-ab20-420f-b881-a34d5781d9f9\") " pod="openstack-kuttl-tests/neutron-78d789956f-w2p5r" Mar 16 17:04:50 crc kubenswrapper[5120]: I0316 17:04:50.150534 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/727c8c9a-fcc8-42c3-8a58-df87dc295191-combined-ca-bundle\") pod \"727c8c9a-fcc8-42c3-8a58-df87dc295191\" (UID: \"727c8c9a-fcc8-42c3-8a58-df87dc295191\") " Mar 16 17:04:50 crc kubenswrapper[5120]: I0316 17:04:50.150850 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/727c8c9a-fcc8-42c3-8a58-df87dc295191-config-data\") pod \"727c8c9a-fcc8-42c3-8a58-df87dc295191\" (UID: \"727c8c9a-fcc8-42c3-8a58-df87dc295191\") " Mar 16 17:04:50 crc kubenswrapper[5120]: I0316 17:04:50.150897 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s9cvt\" (UniqueName: \"kubernetes.io/projected/727c8c9a-fcc8-42c3-8a58-df87dc295191-kube-api-access-s9cvt\") pod \"727c8c9a-fcc8-42c3-8a58-df87dc295191\" (UID: \"727c8c9a-fcc8-42c3-8a58-df87dc295191\") " Mar 16 17:04:50 crc kubenswrapper[5120]: I0316 17:04:50.150971 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/727c8c9a-fcc8-42c3-8a58-df87dc295191-scripts\") pod \"727c8c9a-fcc8-42c3-8a58-df87dc295191\" (UID: \"727c8c9a-fcc8-42c3-8a58-df87dc295191\") " Mar 16 17:04:50 crc kubenswrapper[5120]: I0316 17:04:50.151055 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/727c8c9a-fcc8-42c3-8a58-df87dc295191-db-sync-config-data\") pod \"727c8c9a-fcc8-42c3-8a58-df87dc295191\" (UID: \"727c8c9a-fcc8-42c3-8a58-df87dc295191\") " Mar 16 17:04:50 crc kubenswrapper[5120]: I0316 17:04:50.151212 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/727c8c9a-fcc8-42c3-8a58-df87dc295191-etc-machine-id\") pod \"727c8c9a-fcc8-42c3-8a58-df87dc295191\" (UID: \"727c8c9a-fcc8-42c3-8a58-df87dc295191\") " Mar 16 17:04:50 crc kubenswrapper[5120]: I0316 17:04:50.151732 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f3e6d999-ab20-420f-b881-a34d5781d9f9-combined-ca-bundle\") pod \"neutron-78d789956f-w2p5r\" (UID: \"f3e6d999-ab20-420f-b881-a34d5781d9f9\") " pod="openstack-kuttl-tests/neutron-78d789956f-w2p5r" Mar 16 17:04:50 crc kubenswrapper[5120]: I0316 17:04:50.152021 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/f3e6d999-ab20-420f-b881-a34d5781d9f9-httpd-config\") pod \"neutron-78d789956f-w2p5r\" (UID: \"f3e6d999-ab20-420f-b881-a34d5781d9f9\") " pod="openstack-kuttl-tests/neutron-78d789956f-w2p5r" Mar 16 17:04:50 crc kubenswrapper[5120]: I0316 17:04:50.152143 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g5zn5\" (UniqueName: \"kubernetes.io/projected/f3e6d999-ab20-420f-b881-a34d5781d9f9-kube-api-access-g5zn5\") pod \"neutron-78d789956f-w2p5r\" (UID: \"f3e6d999-ab20-420f-b881-a34d5781d9f9\") " pod="openstack-kuttl-tests/neutron-78d789956f-w2p5r" Mar 16 17:04:50 crc kubenswrapper[5120]: I0316 17:04:50.152196 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/f3e6d999-ab20-420f-b881-a34d5781d9f9-ovndb-tls-certs\") pod \"neutron-78d789956f-w2p5r\" (UID: \"f3e6d999-ab20-420f-b881-a34d5781d9f9\") " pod="openstack-kuttl-tests/neutron-78d789956f-w2p5r" Mar 16 17:04:50 crc kubenswrapper[5120]: I0316 17:04:50.152260 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/727c8c9a-fcc8-42c3-8a58-df87dc295191-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "727c8c9a-fcc8-42c3-8a58-df87dc295191" (UID: "727c8c9a-fcc8-42c3-8a58-df87dc295191"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 17:04:50 crc kubenswrapper[5120]: I0316 17:04:50.152460 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f3e6d999-ab20-420f-b881-a34d5781d9f9-config\") pod \"neutron-78d789956f-w2p5r\" (UID: \"f3e6d999-ab20-420f-b881-a34d5781d9f9\") " pod="openstack-kuttl-tests/neutron-78d789956f-w2p5r" Mar 16 17:04:50 crc kubenswrapper[5120]: I0316 17:04:50.152601 5120 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/727c8c9a-fcc8-42c3-8a58-df87dc295191-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 17:04:50 crc kubenswrapper[5120]: I0316 17:04:50.162261 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/727c8c9a-fcc8-42c3-8a58-df87dc295191-db-sync-config-data" (OuterVolumeSpecName: "db-sync-config-data") pod "727c8c9a-fcc8-42c3-8a58-df87dc295191" (UID: "727c8c9a-fcc8-42c3-8a58-df87dc295191"). InnerVolumeSpecName "db-sync-config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:04:50 crc kubenswrapper[5120]: I0316 17:04:50.162563 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/727c8c9a-fcc8-42c3-8a58-df87dc295191-scripts" (OuterVolumeSpecName: "scripts") pod "727c8c9a-fcc8-42c3-8a58-df87dc295191" (UID: "727c8c9a-fcc8-42c3-8a58-df87dc295191"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:04:50 crc kubenswrapper[5120]: I0316 17:04:50.163447 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/f3e6d999-ab20-420f-b881-a34d5781d9f9-config\") pod \"neutron-78d789956f-w2p5r\" (UID: \"f3e6d999-ab20-420f-b881-a34d5781d9f9\") " pod="openstack-kuttl-tests/neutron-78d789956f-w2p5r" Mar 16 17:04:50 crc kubenswrapper[5120]: I0316 17:04:50.168925 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/727c8c9a-fcc8-42c3-8a58-df87dc295191-kube-api-access-s9cvt" (OuterVolumeSpecName: "kube-api-access-s9cvt") pod "727c8c9a-fcc8-42c3-8a58-df87dc295191" (UID: "727c8c9a-fcc8-42c3-8a58-df87dc295191"). InnerVolumeSpecName "kube-api-access-s9cvt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:04:50 crc kubenswrapper[5120]: I0316 17:04:50.169381 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/f3e6d999-ab20-420f-b881-a34d5781d9f9-ovndb-tls-certs\") pod \"neutron-78d789956f-w2p5r\" (UID: \"f3e6d999-ab20-420f-b881-a34d5781d9f9\") " pod="openstack-kuttl-tests/neutron-78d789956f-w2p5r" Mar 16 17:04:50 crc kubenswrapper[5120]: I0316 17:04:50.169544 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f3e6d999-ab20-420f-b881-a34d5781d9f9-combined-ca-bundle\") pod \"neutron-78d789956f-w2p5r\" (UID: \"f3e6d999-ab20-420f-b881-a34d5781d9f9\") " pod="openstack-kuttl-tests/neutron-78d789956f-w2p5r" Mar 16 17:04:50 crc kubenswrapper[5120]: I0316 17:04:50.172445 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/f3e6d999-ab20-420f-b881-a34d5781d9f9-httpd-config\") pod \"neutron-78d789956f-w2p5r\" (UID: \"f3e6d999-ab20-420f-b881-a34d5781d9f9\") " pod="openstack-kuttl-tests/neutron-78d789956f-w2p5r" Mar 16 17:04:50 crc kubenswrapper[5120]: I0316 17:04:50.179487 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5zn5\" (UniqueName: \"kubernetes.io/projected/f3e6d999-ab20-420f-b881-a34d5781d9f9-kube-api-access-g5zn5\") pod \"neutron-78d789956f-w2p5r\" (UID: \"f3e6d999-ab20-420f-b881-a34d5781d9f9\") " pod="openstack-kuttl-tests/neutron-78d789956f-w2p5r" Mar 16 17:04:50 crc kubenswrapper[5120]: I0316 17:04:50.211812 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/727c8c9a-fcc8-42c3-8a58-df87dc295191-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "727c8c9a-fcc8-42c3-8a58-df87dc295191" (UID: "727c8c9a-fcc8-42c3-8a58-df87dc295191"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:04:50 crc kubenswrapper[5120]: I0316 17:04:50.252284 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/727c8c9a-fcc8-42c3-8a58-df87dc295191-config-data" (OuterVolumeSpecName: "config-data") pod "727c8c9a-fcc8-42c3-8a58-df87dc295191" (UID: "727c8c9a-fcc8-42c3-8a58-df87dc295191"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:04:50 crc kubenswrapper[5120]: I0316 17:04:50.256493 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/727c8c9a-fcc8-42c3-8a58-df87dc295191-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:04:50 crc kubenswrapper[5120]: I0316 17:04:50.256722 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/727c8c9a-fcc8-42c3-8a58-df87dc295191-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:04:50 crc kubenswrapper[5120]: I0316 17:04:50.256861 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s9cvt\" (UniqueName: \"kubernetes.io/projected/727c8c9a-fcc8-42c3-8a58-df87dc295191-kube-api-access-s9cvt\") on node \"crc\" DevicePath \"\"" Mar 16 17:04:50 crc kubenswrapper[5120]: I0316 17:04:50.256962 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/727c8c9a-fcc8-42c3-8a58-df87dc295191-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:04:50 crc kubenswrapper[5120]: I0316 17:04:50.257042 5120 reconciler_common.go:299] "Volume detached for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/727c8c9a-fcc8-42c3-8a58-df87dc295191-db-sync-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:04:50 crc kubenswrapper[5120]: I0316 17:04:50.335821 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-78d789956f-w2p5r" Mar 16 17:04:50 crc kubenswrapper[5120]: I0316 17:04:50.557802 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-qk75k" event={"ID":"727c8c9a-fcc8-42c3-8a58-df87dc295191","Type":"ContainerDied","Data":"fcae1d6d4771a3c3cd2083230ef418042229a67dc509d85100d321819adc5d80"} Mar 16 17:04:50 crc kubenswrapper[5120]: I0316 17:04:50.558165 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fcae1d6d4771a3c3cd2083230ef418042229a67dc509d85100d321819adc5d80" Mar 16 17:04:50 crc kubenswrapper[5120]: I0316 17:04:50.558088 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-qk75k" Mar 16 17:04:50 crc kubenswrapper[5120]: I0316 17:04:50.562817 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a9e1bfc3-4b43-41e4-af96-bba09e1c74b3","Type":"ContainerStarted","Data":"bc6059038bcbf227e81791577f3c4135df8bdd6f10e8037b2b6a1d03339d91a4"} Mar 16 17:04:50 crc kubenswrapper[5120]: I0316 17:04:50.563881 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-79d5f46648-ptcxs" Mar 16 17:04:50 crc kubenswrapper[5120]: I0316 17:04:50.745181 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 17:04:50 crc kubenswrapper[5120]: I0316 17:04:50.746479 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="727c8c9a-fcc8-42c3-8a58-df87dc295191" containerName="cinder-db-sync" Mar 16 17:04:50 crc kubenswrapper[5120]: I0316 17:04:50.746511 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="727c8c9a-fcc8-42c3-8a58-df87dc295191" containerName="cinder-db-sync" Mar 16 17:04:50 crc kubenswrapper[5120]: I0316 17:04:50.746682 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="727c8c9a-fcc8-42c3-8a58-df87dc295191" containerName="cinder-db-sync" Mar 16 17:04:50 crc kubenswrapper[5120]: I0316 17:04:50.752855 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:04:50 crc kubenswrapper[5120]: I0316 17:04:50.757135 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 17:04:50 crc kubenswrapper[5120]: I0316 17:04:50.759246 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-scheduler-config-data\"" Mar 16 17:04:50 crc kubenswrapper[5120]: I0316 17:04:50.759485 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-cinder-dockercfg-df8z9\"" Mar 16 17:04:50 crc kubenswrapper[5120]: I0316 17:04:50.759700 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-config-data\"" Mar 16 17:04:50 crc kubenswrapper[5120]: I0316 17:04:50.760178 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-scripts\"" Mar 16 17:04:50 crc kubenswrapper[5120]: I0316 17:04:50.816952 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-78d789956f-w2p5r"] Mar 16 17:04:50 crc kubenswrapper[5120]: I0316 17:04:50.877327 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d6321014-00e1-45b6-a60b-777fade8e877-scripts\") pod \"cinder-scheduler-0\" (UID: \"d6321014-00e1-45b6-a60b-777fade8e877\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:04:50 crc kubenswrapper[5120]: I0316 17:04:50.888116 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkg98\" (UniqueName: \"kubernetes.io/projected/d6321014-00e1-45b6-a60b-777fade8e877-kube-api-access-fkg98\") pod \"cinder-scheduler-0\" (UID: \"d6321014-00e1-45b6-a60b-777fade8e877\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:04:50 crc kubenswrapper[5120]: I0316 17:04:50.888753 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d6321014-00e1-45b6-a60b-777fade8e877-config-data\") pod \"cinder-scheduler-0\" (UID: \"d6321014-00e1-45b6-a60b-777fade8e877\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:04:50 crc kubenswrapper[5120]: I0316 17:04:50.888853 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/d6321014-00e1-45b6-a60b-777fade8e877-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"d6321014-00e1-45b6-a60b-777fade8e877\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:04:50 crc kubenswrapper[5120]: I0316 17:04:50.888908 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d6321014-00e1-45b6-a60b-777fade8e877-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"d6321014-00e1-45b6-a60b-777fade8e877\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:04:50 crc kubenswrapper[5120]: I0316 17:04:50.888986 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/d6321014-00e1-45b6-a60b-777fade8e877-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"d6321014-00e1-45b6-a60b-777fade8e877\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:04:50 crc kubenswrapper[5120]: I0316 17:04:50.911061 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 17:04:50 crc kubenswrapper[5120]: I0316 17:04:50.919742 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:04:50 crc kubenswrapper[5120]: I0316 17:04:50.941957 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-api-config-data\"" Mar 16 17:04:50 crc kubenswrapper[5120]: I0316 17:04:50.958899 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 17:04:50 crc kubenswrapper[5120]: I0316 17:04:50.992637 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d6321014-00e1-45b6-a60b-777fade8e877-config-data\") pod \"cinder-scheduler-0\" (UID: \"d6321014-00e1-45b6-a60b-777fade8e877\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:04:50 crc kubenswrapper[5120]: I0316 17:04:50.992719 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/d6321014-00e1-45b6-a60b-777fade8e877-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"d6321014-00e1-45b6-a60b-777fade8e877\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:04:50 crc kubenswrapper[5120]: I0316 17:04:50.992783 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d6321014-00e1-45b6-a60b-777fade8e877-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"d6321014-00e1-45b6-a60b-777fade8e877\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:04:50 crc kubenswrapper[5120]: I0316 17:04:50.992849 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/d6321014-00e1-45b6-a60b-777fade8e877-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"d6321014-00e1-45b6-a60b-777fade8e877\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:04:50 crc kubenswrapper[5120]: I0316 17:04:50.992889 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d6321014-00e1-45b6-a60b-777fade8e877-scripts\") pod \"cinder-scheduler-0\" (UID: \"d6321014-00e1-45b6-a60b-777fade8e877\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:04:50 crc kubenswrapper[5120]: I0316 17:04:50.992969 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fkg98\" (UniqueName: \"kubernetes.io/projected/d6321014-00e1-45b6-a60b-777fade8e877-kube-api-access-fkg98\") pod \"cinder-scheduler-0\" (UID: \"d6321014-00e1-45b6-a60b-777fade8e877\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:04:50 crc kubenswrapper[5120]: I0316 17:04:50.993637 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/d6321014-00e1-45b6-a60b-777fade8e877-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"d6321014-00e1-45b6-a60b-777fade8e877\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:04:51 crc kubenswrapper[5120]: I0316 17:04:51.028741 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/d6321014-00e1-45b6-a60b-777fade8e877-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"d6321014-00e1-45b6-a60b-777fade8e877\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:04:51 crc kubenswrapper[5120]: I0316 17:04:51.029875 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d6321014-00e1-45b6-a60b-777fade8e877-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"d6321014-00e1-45b6-a60b-777fade8e877\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:04:51 crc kubenswrapper[5120]: I0316 17:04:51.031356 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d6321014-00e1-45b6-a60b-777fade8e877-config-data\") pod \"cinder-scheduler-0\" (UID: \"d6321014-00e1-45b6-a60b-777fade8e877\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:04:51 crc kubenswrapper[5120]: I0316 17:04:51.033634 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d6321014-00e1-45b6-a60b-777fade8e877-scripts\") pod \"cinder-scheduler-0\" (UID: \"d6321014-00e1-45b6-a60b-777fade8e877\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:04:51 crc kubenswrapper[5120]: I0316 17:04:51.034441 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkg98\" (UniqueName: \"kubernetes.io/projected/d6321014-00e1-45b6-a60b-777fade8e877-kube-api-access-fkg98\") pod \"cinder-scheduler-0\" (UID: \"d6321014-00e1-45b6-a60b-777fade8e877\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:04:51 crc kubenswrapper[5120]: I0316 17:04:51.065126 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-f26kx" Mar 16 17:04:51 crc kubenswrapper[5120]: I0316 17:04:51.087150 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:04:51 crc kubenswrapper[5120]: I0316 17:04:51.095370 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/b2d5e452-345a-44a8-9565-819d12354734-config-data-custom\") pod \"cinder-api-0\" (UID: \"b2d5e452-345a-44a8-9565-819d12354734\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:04:51 crc kubenswrapper[5120]: I0316 17:04:51.095714 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b2d5e452-345a-44a8-9565-819d12354734-scripts\") pod \"cinder-api-0\" (UID: \"b2d5e452-345a-44a8-9565-819d12354734\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:04:51 crc kubenswrapper[5120]: I0316 17:04:51.100169 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b2d5e452-345a-44a8-9565-819d12354734-logs\") pod \"cinder-api-0\" (UID: \"b2d5e452-345a-44a8-9565-819d12354734\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:04:51 crc kubenswrapper[5120]: I0316 17:04:51.100571 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhhzl\" (UniqueName: \"kubernetes.io/projected/b2d5e452-345a-44a8-9565-819d12354734-kube-api-access-zhhzl\") pod \"cinder-api-0\" (UID: \"b2d5e452-345a-44a8-9565-819d12354734\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:04:51 crc kubenswrapper[5120]: I0316 17:04:51.102366 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b2d5e452-345a-44a8-9565-819d12354734-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"b2d5e452-345a-44a8-9565-819d12354734\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:04:51 crc kubenswrapper[5120]: I0316 17:04:51.102593 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b2d5e452-345a-44a8-9565-819d12354734-config-data\") pod \"cinder-api-0\" (UID: \"b2d5e452-345a-44a8-9565-819d12354734\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:04:51 crc kubenswrapper[5120]: I0316 17:04:51.103641 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/b2d5e452-345a-44a8-9565-819d12354734-etc-machine-id\") pod \"cinder-api-0\" (UID: \"b2d5e452-345a-44a8-9565-819d12354734\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:04:51 crc kubenswrapper[5120]: I0316 17:04:51.206027 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f4aa434d-2a76-4cd1-b875-74b763ad15bd-combined-ca-bundle\") pod \"f4aa434d-2a76-4cd1-b875-74b763ad15bd\" (UID: \"f4aa434d-2a76-4cd1-b875-74b763ad15bd\") " Mar 16 17:04:51 crc kubenswrapper[5120]: I0316 17:04:51.206194 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f4aa434d-2a76-4cd1-b875-74b763ad15bd-config-data\") pod \"f4aa434d-2a76-4cd1-b875-74b763ad15bd\" (UID: \"f4aa434d-2a76-4cd1-b875-74b763ad15bd\") " Mar 16 17:04:51 crc kubenswrapper[5120]: I0316 17:04:51.206424 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/f4aa434d-2a76-4cd1-b875-74b763ad15bd-credential-keys\") pod \"f4aa434d-2a76-4cd1-b875-74b763ad15bd\" (UID: \"f4aa434d-2a76-4cd1-b875-74b763ad15bd\") " Mar 16 17:04:51 crc kubenswrapper[5120]: I0316 17:04:51.206609 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4lgbx\" (UniqueName: \"kubernetes.io/projected/f4aa434d-2a76-4cd1-b875-74b763ad15bd-kube-api-access-4lgbx\") pod \"f4aa434d-2a76-4cd1-b875-74b763ad15bd\" (UID: \"f4aa434d-2a76-4cd1-b875-74b763ad15bd\") " Mar 16 17:04:51 crc kubenswrapper[5120]: I0316 17:04:51.207955 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f4aa434d-2a76-4cd1-b875-74b763ad15bd-scripts\") pod \"f4aa434d-2a76-4cd1-b875-74b763ad15bd\" (UID: \"f4aa434d-2a76-4cd1-b875-74b763ad15bd\") " Mar 16 17:04:51 crc kubenswrapper[5120]: I0316 17:04:51.208299 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/f4aa434d-2a76-4cd1-b875-74b763ad15bd-fernet-keys\") pod \"f4aa434d-2a76-4cd1-b875-74b763ad15bd\" (UID: \"f4aa434d-2a76-4cd1-b875-74b763ad15bd\") " Mar 16 17:04:51 crc kubenswrapper[5120]: I0316 17:04:51.208961 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/b2d5e452-345a-44a8-9565-819d12354734-config-data-custom\") pod \"cinder-api-0\" (UID: \"b2d5e452-345a-44a8-9565-819d12354734\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:04:51 crc kubenswrapper[5120]: I0316 17:04:51.209106 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b2d5e452-345a-44a8-9565-819d12354734-scripts\") pod \"cinder-api-0\" (UID: \"b2d5e452-345a-44a8-9565-819d12354734\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:04:51 crc kubenswrapper[5120]: I0316 17:04:51.209125 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b2d5e452-345a-44a8-9565-819d12354734-logs\") pod \"cinder-api-0\" (UID: \"b2d5e452-345a-44a8-9565-819d12354734\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:04:51 crc kubenswrapper[5120]: I0316 17:04:51.209197 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zhhzl\" (UniqueName: \"kubernetes.io/projected/b2d5e452-345a-44a8-9565-819d12354734-kube-api-access-zhhzl\") pod \"cinder-api-0\" (UID: \"b2d5e452-345a-44a8-9565-819d12354734\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:04:51 crc kubenswrapper[5120]: I0316 17:04:51.209364 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b2d5e452-345a-44a8-9565-819d12354734-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"b2d5e452-345a-44a8-9565-819d12354734\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:04:51 crc kubenswrapper[5120]: I0316 17:04:51.209809 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b2d5e452-345a-44a8-9565-819d12354734-config-data\") pod \"cinder-api-0\" (UID: \"b2d5e452-345a-44a8-9565-819d12354734\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:04:51 crc kubenswrapper[5120]: I0316 17:04:51.209870 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/b2d5e452-345a-44a8-9565-819d12354734-etc-machine-id\") pod \"cinder-api-0\" (UID: \"b2d5e452-345a-44a8-9565-819d12354734\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:04:51 crc kubenswrapper[5120]: I0316 17:04:51.210003 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/b2d5e452-345a-44a8-9565-819d12354734-etc-machine-id\") pod \"cinder-api-0\" (UID: \"b2d5e452-345a-44a8-9565-819d12354734\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:04:51 crc kubenswrapper[5120]: I0316 17:04:51.212752 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4aa434d-2a76-4cd1-b875-74b763ad15bd-kube-api-access-4lgbx" (OuterVolumeSpecName: "kube-api-access-4lgbx") pod "f4aa434d-2a76-4cd1-b875-74b763ad15bd" (UID: "f4aa434d-2a76-4cd1-b875-74b763ad15bd"). InnerVolumeSpecName "kube-api-access-4lgbx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:04:51 crc kubenswrapper[5120]: I0316 17:04:51.212972 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b2d5e452-345a-44a8-9565-819d12354734-logs\") pod \"cinder-api-0\" (UID: \"b2d5e452-345a-44a8-9565-819d12354734\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:04:51 crc kubenswrapper[5120]: I0316 17:04:51.214097 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b2d5e452-345a-44a8-9565-819d12354734-scripts\") pod \"cinder-api-0\" (UID: \"b2d5e452-345a-44a8-9565-819d12354734\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:04:51 crc kubenswrapper[5120]: I0316 17:04:51.215079 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f4aa434d-2a76-4cd1-b875-74b763ad15bd-scripts" (OuterVolumeSpecName: "scripts") pod "f4aa434d-2a76-4cd1-b875-74b763ad15bd" (UID: "f4aa434d-2a76-4cd1-b875-74b763ad15bd"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:04:51 crc kubenswrapper[5120]: I0316 17:04:51.215191 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/b2d5e452-345a-44a8-9565-819d12354734-config-data-custom\") pod \"cinder-api-0\" (UID: \"b2d5e452-345a-44a8-9565-819d12354734\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:04:51 crc kubenswrapper[5120]: I0316 17:04:51.217809 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b2d5e452-345a-44a8-9565-819d12354734-config-data\") pod \"cinder-api-0\" (UID: \"b2d5e452-345a-44a8-9565-819d12354734\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:04:51 crc kubenswrapper[5120]: I0316 17:04:51.218051 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b2d5e452-345a-44a8-9565-819d12354734-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"b2d5e452-345a-44a8-9565-819d12354734\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:04:51 crc kubenswrapper[5120]: I0316 17:04:51.234479 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f4aa434d-2a76-4cd1-b875-74b763ad15bd-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "f4aa434d-2a76-4cd1-b875-74b763ad15bd" (UID: "f4aa434d-2a76-4cd1-b875-74b763ad15bd"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:04:51 crc kubenswrapper[5120]: I0316 17:04:51.235572 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f4aa434d-2a76-4cd1-b875-74b763ad15bd-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "f4aa434d-2a76-4cd1-b875-74b763ad15bd" (UID: "f4aa434d-2a76-4cd1-b875-74b763ad15bd"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:04:51 crc kubenswrapper[5120]: I0316 17:04:51.244261 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhhzl\" (UniqueName: \"kubernetes.io/projected/b2d5e452-345a-44a8-9565-819d12354734-kube-api-access-zhhzl\") pod \"cinder-api-0\" (UID: \"b2d5e452-345a-44a8-9565-819d12354734\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:04:51 crc kubenswrapper[5120]: I0316 17:04:51.263565 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f4aa434d-2a76-4cd1-b875-74b763ad15bd-config-data" (OuterVolumeSpecName: "config-data") pod "f4aa434d-2a76-4cd1-b875-74b763ad15bd" (UID: "f4aa434d-2a76-4cd1-b875-74b763ad15bd"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:04:51 crc kubenswrapper[5120]: I0316 17:04:51.264108 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f4aa434d-2a76-4cd1-b875-74b763ad15bd-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f4aa434d-2a76-4cd1-b875-74b763ad15bd" (UID: "f4aa434d-2a76-4cd1-b875-74b763ad15bd"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:04:51 crc kubenswrapper[5120]: I0316 17:04:51.312117 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f4aa434d-2a76-4cd1-b875-74b763ad15bd-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:04:51 crc kubenswrapper[5120]: I0316 17:04:51.312152 5120 reconciler_common.go:299] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/f4aa434d-2a76-4cd1-b875-74b763ad15bd-fernet-keys\") on node \"crc\" DevicePath \"\"" Mar 16 17:04:51 crc kubenswrapper[5120]: I0316 17:04:51.312163 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f4aa434d-2a76-4cd1-b875-74b763ad15bd-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:04:51 crc kubenswrapper[5120]: I0316 17:04:51.312175 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f4aa434d-2a76-4cd1-b875-74b763ad15bd-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:04:51 crc kubenswrapper[5120]: I0316 17:04:51.312183 5120 reconciler_common.go:299] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/f4aa434d-2a76-4cd1-b875-74b763ad15bd-credential-keys\") on node \"crc\" DevicePath \"\"" Mar 16 17:04:51 crc kubenswrapper[5120]: I0316 17:04:51.312192 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4lgbx\" (UniqueName: \"kubernetes.io/projected/f4aa434d-2a76-4cd1-b875-74b763ad15bd-kube-api-access-4lgbx\") on node \"crc\" DevicePath \"\"" Mar 16 17:04:51 crc kubenswrapper[5120]: I0316 17:04:51.355142 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:04:51 crc kubenswrapper[5120]: I0316 17:04:51.576922 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-f26kx" event={"ID":"f4aa434d-2a76-4cd1-b875-74b763ad15bd","Type":"ContainerDied","Data":"1e454483173966c3cf3dd114be6dab7a33eb9da52bc0d15be1aacd27c9821882"} Mar 16 17:04:51 crc kubenswrapper[5120]: I0316 17:04:51.576968 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1e454483173966c3cf3dd114be6dab7a33eb9da52bc0d15be1aacd27c9821882" Mar 16 17:04:51 crc kubenswrapper[5120]: I0316 17:04:51.577060 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-f26kx" Mar 16 17:04:51 crc kubenswrapper[5120]: I0316 17:04:51.589952 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-78d789956f-w2p5r" event={"ID":"f3e6d999-ab20-420f-b881-a34d5781d9f9","Type":"ContainerStarted","Data":"8aea133900a3ee5ac17fab7d48ec3375790901136af846706c5e28365d7cf0ec"} Mar 16 17:04:51 crc kubenswrapper[5120]: I0316 17:04:51.590001 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-78d789956f-w2p5r" event={"ID":"f3e6d999-ab20-420f-b881-a34d5781d9f9","Type":"ContainerStarted","Data":"5bd2bd96c8b0e3237f1b34fd6f286d5a894c9e75983172d8f7cb1abdc67c91a5"} Mar 16 17:04:51 crc kubenswrapper[5120]: I0316 17:04:51.590011 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-78d789956f-w2p5r" event={"ID":"f3e6d999-ab20-420f-b881-a34d5781d9f9","Type":"ContainerStarted","Data":"004bd6fca60094be80660d0d50f03444458c03398e319b202e248f01bebf4366"} Mar 16 17:04:51 crc kubenswrapper[5120]: I0316 17:04:51.590776 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/neutron-78d789956f-w2p5r" Mar 16 17:04:51 crc kubenswrapper[5120]: I0316 17:04:51.600830 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 17:04:51 crc kubenswrapper[5120]: I0316 17:04:51.633500 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-78d789956f-w2p5r" podStartSLOduration=2.633476611 podStartE2EDuration="2.633476611s" podCreationTimestamp="2026-03-16 17:04:49 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:04:51.616645087 +0000 UTC m=+5593.770576744" watchObservedRunningTime="2026-03-16 17:04:51.633476611 +0000 UTC m=+5593.787408278" Mar 16 17:04:51 crc kubenswrapper[5120]: I0316 17:04:51.713826 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-7df86b764c-bv9sm"] Mar 16 17:04:51 crc kubenswrapper[5120]: I0316 17:04:51.715195 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4aa434d-2a76-4cd1-b875-74b763ad15bd" containerName="keystone-bootstrap" Mar 16 17:04:51 crc kubenswrapper[5120]: I0316 17:04:51.715222 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4aa434d-2a76-4cd1-b875-74b763ad15bd" containerName="keystone-bootstrap" Mar 16 17:04:51 crc kubenswrapper[5120]: I0316 17:04:51.715487 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f4aa434d-2a76-4cd1-b875-74b763ad15bd" containerName="keystone-bootstrap" Mar 16 17:04:51 crc kubenswrapper[5120]: I0316 17:04:51.735961 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-7df86b764c-bv9sm"] Mar 16 17:04:51 crc kubenswrapper[5120]: I0316 17:04:51.736089 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-7df86b764c-bv9sm" Mar 16 17:04:51 crc kubenswrapper[5120]: I0316 17:04:51.747525 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-keystone-public-svc\"" Mar 16 17:04:51 crc kubenswrapper[5120]: I0316 17:04:51.747779 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-scripts\"" Mar 16 17:04:51 crc kubenswrapper[5120]: I0316 17:04:51.749919 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone\"" Mar 16 17:04:51 crc kubenswrapper[5120]: I0316 17:04:51.749988 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-config-data\"" Mar 16 17:04:51 crc kubenswrapper[5120]: I0316 17:04:51.750251 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-keystone-internal-svc\"" Mar 16 17:04:51 crc kubenswrapper[5120]: I0316 17:04:51.750208 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-keystone-dockercfg-crlsv\"" Mar 16 17:04:51 crc kubenswrapper[5120]: I0316 17:04:51.830423 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 17:04:51 crc kubenswrapper[5120]: I0316 17:04:51.836843 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/957ea161-cf8b-43d5-b464-24dc4ee777df-config-data\") pod \"keystone-7df86b764c-bv9sm\" (UID: \"957ea161-cf8b-43d5-b464-24dc4ee777df\") " pod="openstack-kuttl-tests/keystone-7df86b764c-bv9sm" Mar 16 17:04:51 crc kubenswrapper[5120]: I0316 17:04:51.837127 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/957ea161-cf8b-43d5-b464-24dc4ee777df-credential-keys\") pod \"keystone-7df86b764c-bv9sm\" (UID: \"957ea161-cf8b-43d5-b464-24dc4ee777df\") " pod="openstack-kuttl-tests/keystone-7df86b764c-bv9sm" Mar 16 17:04:51 crc kubenswrapper[5120]: I0316 17:04:51.837279 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/957ea161-cf8b-43d5-b464-24dc4ee777df-scripts\") pod \"keystone-7df86b764c-bv9sm\" (UID: \"957ea161-cf8b-43d5-b464-24dc4ee777df\") " pod="openstack-kuttl-tests/keystone-7df86b764c-bv9sm" Mar 16 17:04:51 crc kubenswrapper[5120]: I0316 17:04:51.837832 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/957ea161-cf8b-43d5-b464-24dc4ee777df-fernet-keys\") pod \"keystone-7df86b764c-bv9sm\" (UID: \"957ea161-cf8b-43d5-b464-24dc4ee777df\") " pod="openstack-kuttl-tests/keystone-7df86b764c-bv9sm" Mar 16 17:04:51 crc kubenswrapper[5120]: I0316 17:04:51.837945 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/957ea161-cf8b-43d5-b464-24dc4ee777df-internal-tls-certs\") pod \"keystone-7df86b764c-bv9sm\" (UID: \"957ea161-cf8b-43d5-b464-24dc4ee777df\") " pod="openstack-kuttl-tests/keystone-7df86b764c-bv9sm" Mar 16 17:04:51 crc kubenswrapper[5120]: I0316 17:04:51.838144 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/957ea161-cf8b-43d5-b464-24dc4ee777df-combined-ca-bundle\") pod \"keystone-7df86b764c-bv9sm\" (UID: \"957ea161-cf8b-43d5-b464-24dc4ee777df\") " pod="openstack-kuttl-tests/keystone-7df86b764c-bv9sm" Mar 16 17:04:51 crc kubenswrapper[5120]: I0316 17:04:51.838247 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/957ea161-cf8b-43d5-b464-24dc4ee777df-public-tls-certs\") pod \"keystone-7df86b764c-bv9sm\" (UID: \"957ea161-cf8b-43d5-b464-24dc4ee777df\") " pod="openstack-kuttl-tests/keystone-7df86b764c-bv9sm" Mar 16 17:04:51 crc kubenswrapper[5120]: I0316 17:04:51.838329 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhb5v\" (UniqueName: \"kubernetes.io/projected/957ea161-cf8b-43d5-b464-24dc4ee777df-kube-api-access-nhb5v\") pod \"keystone-7df86b764c-bv9sm\" (UID: \"957ea161-cf8b-43d5-b464-24dc4ee777df\") " pod="openstack-kuttl-tests/keystone-7df86b764c-bv9sm" Mar 16 17:04:51 crc kubenswrapper[5120]: W0316 17:04:51.842640 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb2d5e452_345a_44a8_9565_819d12354734.slice/crio-5a16d22407432abb9b778257b4dd531cefb393f652552bd61420666dcaa31379 WatchSource:0}: Error finding container 5a16d22407432abb9b778257b4dd531cefb393f652552bd61420666dcaa31379: Status 404 returned error can't find the container with id 5a16d22407432abb9b778257b4dd531cefb393f652552bd61420666dcaa31379 Mar 16 17:04:51 crc kubenswrapper[5120]: I0316 17:04:51.940648 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/957ea161-cf8b-43d5-b464-24dc4ee777df-config-data\") pod \"keystone-7df86b764c-bv9sm\" (UID: \"957ea161-cf8b-43d5-b464-24dc4ee777df\") " pod="openstack-kuttl-tests/keystone-7df86b764c-bv9sm" Mar 16 17:04:51 crc kubenswrapper[5120]: I0316 17:04:51.940778 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/957ea161-cf8b-43d5-b464-24dc4ee777df-credential-keys\") pod \"keystone-7df86b764c-bv9sm\" (UID: \"957ea161-cf8b-43d5-b464-24dc4ee777df\") " pod="openstack-kuttl-tests/keystone-7df86b764c-bv9sm" Mar 16 17:04:51 crc kubenswrapper[5120]: I0316 17:04:51.940832 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/957ea161-cf8b-43d5-b464-24dc4ee777df-scripts\") pod \"keystone-7df86b764c-bv9sm\" (UID: \"957ea161-cf8b-43d5-b464-24dc4ee777df\") " pod="openstack-kuttl-tests/keystone-7df86b764c-bv9sm" Mar 16 17:04:51 crc kubenswrapper[5120]: I0316 17:04:51.940907 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/957ea161-cf8b-43d5-b464-24dc4ee777df-fernet-keys\") pod \"keystone-7df86b764c-bv9sm\" (UID: \"957ea161-cf8b-43d5-b464-24dc4ee777df\") " pod="openstack-kuttl-tests/keystone-7df86b764c-bv9sm" Mar 16 17:04:51 crc kubenswrapper[5120]: I0316 17:04:51.940925 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/957ea161-cf8b-43d5-b464-24dc4ee777df-internal-tls-certs\") pod \"keystone-7df86b764c-bv9sm\" (UID: \"957ea161-cf8b-43d5-b464-24dc4ee777df\") " pod="openstack-kuttl-tests/keystone-7df86b764c-bv9sm" Mar 16 17:04:51 crc kubenswrapper[5120]: I0316 17:04:51.941018 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/957ea161-cf8b-43d5-b464-24dc4ee777df-combined-ca-bundle\") pod \"keystone-7df86b764c-bv9sm\" (UID: \"957ea161-cf8b-43d5-b464-24dc4ee777df\") " pod="openstack-kuttl-tests/keystone-7df86b764c-bv9sm" Mar 16 17:04:51 crc kubenswrapper[5120]: I0316 17:04:51.941034 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/957ea161-cf8b-43d5-b464-24dc4ee777df-public-tls-certs\") pod \"keystone-7df86b764c-bv9sm\" (UID: \"957ea161-cf8b-43d5-b464-24dc4ee777df\") " pod="openstack-kuttl-tests/keystone-7df86b764c-bv9sm" Mar 16 17:04:51 crc kubenswrapper[5120]: I0316 17:04:51.941100 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nhb5v\" (UniqueName: \"kubernetes.io/projected/957ea161-cf8b-43d5-b464-24dc4ee777df-kube-api-access-nhb5v\") pod \"keystone-7df86b764c-bv9sm\" (UID: \"957ea161-cf8b-43d5-b464-24dc4ee777df\") " pod="openstack-kuttl-tests/keystone-7df86b764c-bv9sm" Mar 16 17:04:51 crc kubenswrapper[5120]: I0316 17:04:51.947657 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/957ea161-cf8b-43d5-b464-24dc4ee777df-config-data\") pod \"keystone-7df86b764c-bv9sm\" (UID: \"957ea161-cf8b-43d5-b464-24dc4ee777df\") " pod="openstack-kuttl-tests/keystone-7df86b764c-bv9sm" Mar 16 17:04:51 crc kubenswrapper[5120]: I0316 17:04:51.948323 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/957ea161-cf8b-43d5-b464-24dc4ee777df-public-tls-certs\") pod \"keystone-7df86b764c-bv9sm\" (UID: \"957ea161-cf8b-43d5-b464-24dc4ee777df\") " pod="openstack-kuttl-tests/keystone-7df86b764c-bv9sm" Mar 16 17:04:51 crc kubenswrapper[5120]: I0316 17:04:51.948877 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/957ea161-cf8b-43d5-b464-24dc4ee777df-combined-ca-bundle\") pod \"keystone-7df86b764c-bv9sm\" (UID: \"957ea161-cf8b-43d5-b464-24dc4ee777df\") " pod="openstack-kuttl-tests/keystone-7df86b764c-bv9sm" Mar 16 17:04:51 crc kubenswrapper[5120]: I0316 17:04:51.950373 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/957ea161-cf8b-43d5-b464-24dc4ee777df-credential-keys\") pod \"keystone-7df86b764c-bv9sm\" (UID: \"957ea161-cf8b-43d5-b464-24dc4ee777df\") " pod="openstack-kuttl-tests/keystone-7df86b764c-bv9sm" Mar 16 17:04:51 crc kubenswrapper[5120]: I0316 17:04:51.950467 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/957ea161-cf8b-43d5-b464-24dc4ee777df-internal-tls-certs\") pod \"keystone-7df86b764c-bv9sm\" (UID: \"957ea161-cf8b-43d5-b464-24dc4ee777df\") " pod="openstack-kuttl-tests/keystone-7df86b764c-bv9sm" Mar 16 17:04:51 crc kubenswrapper[5120]: I0316 17:04:51.952055 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/957ea161-cf8b-43d5-b464-24dc4ee777df-scripts\") pod \"keystone-7df86b764c-bv9sm\" (UID: \"957ea161-cf8b-43d5-b464-24dc4ee777df\") " pod="openstack-kuttl-tests/keystone-7df86b764c-bv9sm" Mar 16 17:04:51 crc kubenswrapper[5120]: I0316 17:04:51.959538 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/957ea161-cf8b-43d5-b464-24dc4ee777df-fernet-keys\") pod \"keystone-7df86b764c-bv9sm\" (UID: \"957ea161-cf8b-43d5-b464-24dc4ee777df\") " pod="openstack-kuttl-tests/keystone-7df86b764c-bv9sm" Mar 16 17:04:51 crc kubenswrapper[5120]: I0316 17:04:51.968295 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhb5v\" (UniqueName: \"kubernetes.io/projected/957ea161-cf8b-43d5-b464-24dc4ee777df-kube-api-access-nhb5v\") pod \"keystone-7df86b764c-bv9sm\" (UID: \"957ea161-cf8b-43d5-b464-24dc4ee777df\") " pod="openstack-kuttl-tests/keystone-7df86b764c-bv9sm" Mar 16 17:04:52 crc kubenswrapper[5120]: I0316 17:04:52.007689 5120 patch_prober.go:28] interesting pod/machine-config-daemon-7bf76 container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 17:04:52 crc kubenswrapper[5120]: I0316 17:04:52.007780 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 17:04:52 crc kubenswrapper[5120]: I0316 17:04:52.162460 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-7df86b764c-bv9sm" Mar 16 17:04:52 crc kubenswrapper[5120]: I0316 17:04:52.602489 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"d6321014-00e1-45b6-a60b-777fade8e877","Type":"ContainerStarted","Data":"01fbebd9c4cb489491d921e6832b1ae0c35350f3906fa4b6a6d70a5b654c439f"} Mar 16 17:04:52 crc kubenswrapper[5120]: I0316 17:04:52.602754 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"d6321014-00e1-45b6-a60b-777fade8e877","Type":"ContainerStarted","Data":"da0946bfeea07d374a41a7c98607c6a40f5993651f18ff4436479c6d22c58c37"} Mar 16 17:04:52 crc kubenswrapper[5120]: I0316 17:04:52.608631 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"b2d5e452-345a-44a8-9565-819d12354734","Type":"ContainerStarted","Data":"5a16d22407432abb9b778257b4dd531cefb393f652552bd61420666dcaa31379"} Mar 16 17:04:52 crc kubenswrapper[5120]: I0316 17:04:52.689429 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-7df86b764c-bv9sm"] Mar 16 17:04:53 crc kubenswrapper[5120]: I0316 17:04:53.644390 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"b2d5e452-345a-44a8-9565-819d12354734","Type":"ContainerStarted","Data":"e7f311842b759e2d57b9a0080f778a8a633c00c1a97ef3a69c697995305b3871"} Mar 16 17:04:53 crc kubenswrapper[5120]: I0316 17:04:53.647395 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a9e1bfc3-4b43-41e4-af96-bba09e1c74b3","Type":"ContainerStarted","Data":"096f2a30a311d5a9357edbe18150646307ad87f31168d9af80f3221149d5b44c"} Mar 16 17:04:53 crc kubenswrapper[5120]: I0316 17:04:53.648563 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:04:53 crc kubenswrapper[5120]: I0316 17:04:53.652016 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-7df86b764c-bv9sm" event={"ID":"957ea161-cf8b-43d5-b464-24dc4ee777df","Type":"ContainerStarted","Data":"74b7d9768e9239473cf544c5e604fd8d6d2571d55e0643f31939cb1dde6c4948"} Mar 16 17:04:53 crc kubenswrapper[5120]: I0316 17:04:53.652065 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-7df86b764c-bv9sm" event={"ID":"957ea161-cf8b-43d5-b464-24dc4ee777df","Type":"ContainerStarted","Data":"e85b051dc662e47e1d91c43d4c1b48a233490de98892d0d97a755dd05f330565"} Mar 16 17:04:53 crc kubenswrapper[5120]: I0316 17:04:53.652112 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/keystone-7df86b764c-bv9sm" Mar 16 17:04:53 crc kubenswrapper[5120]: I0316 17:04:53.656925 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"d6321014-00e1-45b6-a60b-777fade8e877","Type":"ContainerStarted","Data":"2eb8bab7956008f7ef95a842379b5930514b2b0af917b496712706bf21712297"} Mar 16 17:04:53 crc kubenswrapper[5120]: I0316 17:04:53.674270 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.529218418 podStartE2EDuration="7.674248759s" podCreationTimestamp="2026-03-16 17:04:46 +0000 UTC" firstStartedPulling="2026-03-16 17:04:47.360906522 +0000 UTC m=+5589.514838179" lastFinishedPulling="2026-03-16 17:04:52.505936863 +0000 UTC m=+5594.659868520" observedRunningTime="2026-03-16 17:04:53.671644656 +0000 UTC m=+5595.825576323" watchObservedRunningTime="2026-03-16 17:04:53.674248759 +0000 UTC m=+5595.828180416" Mar 16 17:04:53 crc kubenswrapper[5120]: I0316 17:04:53.693585 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-scheduler-0" podStartSLOduration=3.6935674819999997 podStartE2EDuration="3.693567482s" podCreationTimestamp="2026-03-16 17:04:50 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:04:53.68917325 +0000 UTC m=+5595.843104907" watchObservedRunningTime="2026-03-16 17:04:53.693567482 +0000 UTC m=+5595.847499139" Mar 16 17:04:53 crc kubenswrapper[5120]: I0316 17:04:53.721734 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-7df86b764c-bv9sm" podStartSLOduration=2.72171458 podStartE2EDuration="2.72171458s" podCreationTimestamp="2026-03-16 17:04:51 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:04:53.715532468 +0000 UTC m=+5595.869464126" watchObservedRunningTime="2026-03-16 17:04:53.72171458 +0000 UTC m=+5595.875646227" Mar 16 17:04:53 crc kubenswrapper[5120]: I0316 17:04:53.741557 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:04:53 crc kubenswrapper[5120]: I0316 17:04:53.741609 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:04:53 crc kubenswrapper[5120]: I0316 17:04:53.782529 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:04:53 crc kubenswrapper[5120]: I0316 17:04:53.798657 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:04:53 crc kubenswrapper[5120]: I0316 17:04:53.813940 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:04:53 crc kubenswrapper[5120]: I0316 17:04:53.813979 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:04:53 crc kubenswrapper[5120]: I0316 17:04:53.850469 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:04:53 crc kubenswrapper[5120]: I0316 17:04:53.860579 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:04:54 crc kubenswrapper[5120]: I0316 17:04:54.675337 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"b2d5e452-345a-44a8-9565-819d12354734","Type":"ContainerStarted","Data":"fb37ee080652aa183bb7e68b17e6e29ceeb7fa51994a6aeb0fcd1ee639ee1f3e"} Mar 16 17:04:54 crc kubenswrapper[5120]: I0316 17:04:54.675713 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:04:54 crc kubenswrapper[5120]: I0316 17:04:54.675732 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:04:54 crc kubenswrapper[5120]: I0316 17:04:54.675744 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:04:54 crc kubenswrapper[5120]: I0316 17:04:54.675813 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:04:54 crc kubenswrapper[5120]: I0316 17:04:54.675833 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:04:54 crc kubenswrapper[5120]: I0316 17:04:54.688394 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-api-0" podStartSLOduration=4.688373294 podStartE2EDuration="4.688373294s" podCreationTimestamp="2026-03-16 17:04:50 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:04:54.685830973 +0000 UTC m=+5596.839762640" watchObservedRunningTime="2026-03-16 17:04:54.688373294 +0000 UTC m=+5596.842304951" Mar 16 17:04:55 crc kubenswrapper[5120]: I0316 17:04:55.556155 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 17:04:55 crc kubenswrapper[5120]: I0316 17:04:55.733210 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:04:55 crc kubenswrapper[5120]: I0316 17:04:55.733488 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="a9e1bfc3-4b43-41e4-af96-bba09e1c74b3" containerName="proxy-httpd" containerID="cri-o://096f2a30a311d5a9357edbe18150646307ad87f31168d9af80f3221149d5b44c" gracePeriod=30 Mar 16 17:04:55 crc kubenswrapper[5120]: I0316 17:04:55.733488 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="a9e1bfc3-4b43-41e4-af96-bba09e1c74b3" containerName="sg-core" containerID="cri-o://bc6059038bcbf227e81791577f3c4135df8bdd6f10e8037b2b6a1d03339d91a4" gracePeriod=30 Mar 16 17:04:55 crc kubenswrapper[5120]: I0316 17:04:55.733521 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="a9e1bfc3-4b43-41e4-af96-bba09e1c74b3" containerName="ceilometer-notification-agent" containerID="cri-o://98a9675a48061678c809e191cbebf8b353cb09cbd50fdc3e788e3b63210a648d" gracePeriod=30 Mar 16 17:04:55 crc kubenswrapper[5120]: I0316 17:04:55.733590 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="a9e1bfc3-4b43-41e4-af96-bba09e1c74b3" containerName="ceilometer-central-agent" containerID="cri-o://60c2d39c36a3a538eeada6bbcbcf4c86d96fd24cd27c838f963ac043bffb0d92" gracePeriod=30 Mar 16 17:04:56 crc kubenswrapper[5120]: I0316 17:04:56.090012 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:04:56 crc kubenswrapper[5120]: I0316 17:04:56.570920 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:04:56 crc kubenswrapper[5120]: I0316 17:04:56.694185 5120 generic.go:358] "Generic (PLEG): container finished" podID="a9e1bfc3-4b43-41e4-af96-bba09e1c74b3" containerID="096f2a30a311d5a9357edbe18150646307ad87f31168d9af80f3221149d5b44c" exitCode=0 Mar 16 17:04:56 crc kubenswrapper[5120]: I0316 17:04:56.694214 5120 generic.go:358] "Generic (PLEG): container finished" podID="a9e1bfc3-4b43-41e4-af96-bba09e1c74b3" containerID="bc6059038bcbf227e81791577f3c4135df8bdd6f10e8037b2b6a1d03339d91a4" exitCode=2 Mar 16 17:04:56 crc kubenswrapper[5120]: I0316 17:04:56.694223 5120 generic.go:358] "Generic (PLEG): container finished" podID="a9e1bfc3-4b43-41e4-af96-bba09e1c74b3" containerID="98a9675a48061678c809e191cbebf8b353cb09cbd50fdc3e788e3b63210a648d" exitCode=0 Mar 16 17:04:56 crc kubenswrapper[5120]: I0316 17:04:56.694231 5120 generic.go:358] "Generic (PLEG): container finished" podID="a9e1bfc3-4b43-41e4-af96-bba09e1c74b3" containerID="60c2d39c36a3a538eeada6bbcbcf4c86d96fd24cd27c838f963ac043bffb0d92" exitCode=0 Mar 16 17:04:56 crc kubenswrapper[5120]: I0316 17:04:56.694233 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a9e1bfc3-4b43-41e4-af96-bba09e1c74b3","Type":"ContainerDied","Data":"096f2a30a311d5a9357edbe18150646307ad87f31168d9af80f3221149d5b44c"} Mar 16 17:04:56 crc kubenswrapper[5120]: I0316 17:04:56.694271 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:04:56 crc kubenswrapper[5120]: I0316 17:04:56.694313 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a9e1bfc3-4b43-41e4-af96-bba09e1c74b3","Type":"ContainerDied","Data":"bc6059038bcbf227e81791577f3c4135df8bdd6f10e8037b2b6a1d03339d91a4"} Mar 16 17:04:56 crc kubenswrapper[5120]: I0316 17:04:56.694326 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a9e1bfc3-4b43-41e4-af96-bba09e1c74b3","Type":"ContainerDied","Data":"98a9675a48061678c809e191cbebf8b353cb09cbd50fdc3e788e3b63210a648d"} Mar 16 17:04:56 crc kubenswrapper[5120]: I0316 17:04:56.694336 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a9e1bfc3-4b43-41e4-af96-bba09e1c74b3","Type":"ContainerDied","Data":"60c2d39c36a3a538eeada6bbcbcf4c86d96fd24cd27c838f963ac043bffb0d92"} Mar 16 17:04:56 crc kubenswrapper[5120]: I0316 17:04:56.694346 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a9e1bfc3-4b43-41e4-af96-bba09e1c74b3","Type":"ContainerDied","Data":"b52e5cab1aa531dc8faacc8d8c7ae27b5f4af763b2afa06395e6883c49a36c7c"} Mar 16 17:04:56 crc kubenswrapper[5120]: I0316 17:04:56.694364 5120 scope.go:117] "RemoveContainer" containerID="096f2a30a311d5a9357edbe18150646307ad87f31168d9af80f3221149d5b44c" Mar 16 17:04:56 crc kubenswrapper[5120]: I0316 17:04:56.694501 5120 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Mar 16 17:04:56 crc kubenswrapper[5120]: I0316 17:04:56.694511 5120 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Mar 16 17:04:56 crc kubenswrapper[5120]: I0316 17:04:56.694824 5120 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Mar 16 17:04:56 crc kubenswrapper[5120]: I0316 17:04:56.694835 5120 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Mar 16 17:04:56 crc kubenswrapper[5120]: I0316 17:04:56.695121 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="b2d5e452-345a-44a8-9565-819d12354734" containerName="cinder-api-log" containerID="cri-o://e7f311842b759e2d57b9a0080f778a8a633c00c1a97ef3a69c697995305b3871" gracePeriod=30 Mar 16 17:04:56 crc kubenswrapper[5120]: I0316 17:04:56.695146 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="b2d5e452-345a-44a8-9565-819d12354734" containerName="cinder-api" containerID="cri-o://fb37ee080652aa183bb7e68b17e6e29ceeb7fa51994a6aeb0fcd1ee639ee1f3e" gracePeriod=30 Mar 16 17:04:56 crc kubenswrapper[5120]: I0316 17:04:56.710518 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/a9e1bfc3-4b43-41e4-af96-bba09e1c74b3-sg-core-conf-yaml\") pod \"a9e1bfc3-4b43-41e4-af96-bba09e1c74b3\" (UID: \"a9e1bfc3-4b43-41e4-af96-bba09e1c74b3\") " Mar 16 17:04:56 crc kubenswrapper[5120]: I0316 17:04:56.711052 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a9e1bfc3-4b43-41e4-af96-bba09e1c74b3-run-httpd\") pod \"a9e1bfc3-4b43-41e4-af96-bba09e1c74b3\" (UID: \"a9e1bfc3-4b43-41e4-af96-bba09e1c74b3\") " Mar 16 17:04:56 crc kubenswrapper[5120]: I0316 17:04:56.711342 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9gr8h\" (UniqueName: \"kubernetes.io/projected/a9e1bfc3-4b43-41e4-af96-bba09e1c74b3-kube-api-access-9gr8h\") pod \"a9e1bfc3-4b43-41e4-af96-bba09e1c74b3\" (UID: \"a9e1bfc3-4b43-41e4-af96-bba09e1c74b3\") " Mar 16 17:04:56 crc kubenswrapper[5120]: I0316 17:04:56.711438 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a9e1bfc3-4b43-41e4-af96-bba09e1c74b3-log-httpd\") pod \"a9e1bfc3-4b43-41e4-af96-bba09e1c74b3\" (UID: \"a9e1bfc3-4b43-41e4-af96-bba09e1c74b3\") " Mar 16 17:04:56 crc kubenswrapper[5120]: I0316 17:04:56.711514 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a9e1bfc3-4b43-41e4-af96-bba09e1c74b3-scripts\") pod \"a9e1bfc3-4b43-41e4-af96-bba09e1c74b3\" (UID: \"a9e1bfc3-4b43-41e4-af96-bba09e1c74b3\") " Mar 16 17:04:56 crc kubenswrapper[5120]: I0316 17:04:56.711546 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a9e1bfc3-4b43-41e4-af96-bba09e1c74b3-config-data\") pod \"a9e1bfc3-4b43-41e4-af96-bba09e1c74b3\" (UID: \"a9e1bfc3-4b43-41e4-af96-bba09e1c74b3\") " Mar 16 17:04:56 crc kubenswrapper[5120]: I0316 17:04:56.711777 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a9e1bfc3-4b43-41e4-af96-bba09e1c74b3-combined-ca-bundle\") pod \"a9e1bfc3-4b43-41e4-af96-bba09e1c74b3\" (UID: \"a9e1bfc3-4b43-41e4-af96-bba09e1c74b3\") " Mar 16 17:04:56 crc kubenswrapper[5120]: I0316 17:04:56.711887 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a9e1bfc3-4b43-41e4-af96-bba09e1c74b3-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "a9e1bfc3-4b43-41e4-af96-bba09e1c74b3" (UID: "a9e1bfc3-4b43-41e4-af96-bba09e1c74b3"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:04:56 crc kubenswrapper[5120]: I0316 17:04:56.712188 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a9e1bfc3-4b43-41e4-af96-bba09e1c74b3-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "a9e1bfc3-4b43-41e4-af96-bba09e1c74b3" (UID: "a9e1bfc3-4b43-41e4-af96-bba09e1c74b3"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:04:56 crc kubenswrapper[5120]: I0316 17:04:56.712918 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a9e1bfc3-4b43-41e4-af96-bba09e1c74b3-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 17:04:56 crc kubenswrapper[5120]: I0316 17:04:56.712936 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a9e1bfc3-4b43-41e4-af96-bba09e1c74b3-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 17:04:56 crc kubenswrapper[5120]: I0316 17:04:56.719555 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a9e1bfc3-4b43-41e4-af96-bba09e1c74b3-kube-api-access-9gr8h" (OuterVolumeSpecName: "kube-api-access-9gr8h") pod "a9e1bfc3-4b43-41e4-af96-bba09e1c74b3" (UID: "a9e1bfc3-4b43-41e4-af96-bba09e1c74b3"). InnerVolumeSpecName "kube-api-access-9gr8h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:04:56 crc kubenswrapper[5120]: I0316 17:04:56.720918 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a9e1bfc3-4b43-41e4-af96-bba09e1c74b3-scripts" (OuterVolumeSpecName: "scripts") pod "a9e1bfc3-4b43-41e4-af96-bba09e1c74b3" (UID: "a9e1bfc3-4b43-41e4-af96-bba09e1c74b3"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:04:56 crc kubenswrapper[5120]: I0316 17:04:56.731959 5120 scope.go:117] "RemoveContainer" containerID="bc6059038bcbf227e81791577f3c4135df8bdd6f10e8037b2b6a1d03339d91a4" Mar 16 17:04:56 crc kubenswrapper[5120]: I0316 17:04:56.767648 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a9e1bfc3-4b43-41e4-af96-bba09e1c74b3-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "a9e1bfc3-4b43-41e4-af96-bba09e1c74b3" (UID: "a9e1bfc3-4b43-41e4-af96-bba09e1c74b3"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:04:56 crc kubenswrapper[5120]: I0316 17:04:56.775413 5120 scope.go:117] "RemoveContainer" containerID="98a9675a48061678c809e191cbebf8b353cb09cbd50fdc3e788e3b63210a648d" Mar 16 17:04:56 crc kubenswrapper[5120]: I0316 17:04:56.801269 5120 scope.go:117] "RemoveContainer" containerID="60c2d39c36a3a538eeada6bbcbcf4c86d96fd24cd27c838f963ac043bffb0d92" Mar 16 17:04:56 crc kubenswrapper[5120]: I0316 17:04:56.811059 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a9e1bfc3-4b43-41e4-af96-bba09e1c74b3-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "a9e1bfc3-4b43-41e4-af96-bba09e1c74b3" (UID: "a9e1bfc3-4b43-41e4-af96-bba09e1c74b3"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:04:56 crc kubenswrapper[5120]: I0316 17:04:56.827793 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9gr8h\" (UniqueName: \"kubernetes.io/projected/a9e1bfc3-4b43-41e4-af96-bba09e1c74b3-kube-api-access-9gr8h\") on node \"crc\" DevicePath \"\"" Mar 16 17:04:56 crc kubenswrapper[5120]: I0316 17:04:56.827829 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a9e1bfc3-4b43-41e4-af96-bba09e1c74b3-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:04:56 crc kubenswrapper[5120]: I0316 17:04:56.827840 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a9e1bfc3-4b43-41e4-af96-bba09e1c74b3-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:04:56 crc kubenswrapper[5120]: I0316 17:04:56.827850 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/a9e1bfc3-4b43-41e4-af96-bba09e1c74b3-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 17:04:56 crc kubenswrapper[5120]: I0316 17:04:56.835311 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a9e1bfc3-4b43-41e4-af96-bba09e1c74b3-config-data" (OuterVolumeSpecName: "config-data") pod "a9e1bfc3-4b43-41e4-af96-bba09e1c74b3" (UID: "a9e1bfc3-4b43-41e4-af96-bba09e1c74b3"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:04:56 crc kubenswrapper[5120]: I0316 17:04:56.911390 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-5bb4df7ffd-xw448"] Mar 16 17:04:56 crc kubenswrapper[5120]: I0316 17:04:56.918721 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9e1bfc3-4b43-41e4-af96-bba09e1c74b3" containerName="ceilometer-central-agent" Mar 16 17:04:56 crc kubenswrapper[5120]: I0316 17:04:56.918788 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9e1bfc3-4b43-41e4-af96-bba09e1c74b3" containerName="ceilometer-central-agent" Mar 16 17:04:56 crc kubenswrapper[5120]: I0316 17:04:56.918811 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9e1bfc3-4b43-41e4-af96-bba09e1c74b3" containerName="proxy-httpd" Mar 16 17:04:56 crc kubenswrapper[5120]: I0316 17:04:56.918818 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9e1bfc3-4b43-41e4-af96-bba09e1c74b3" containerName="proxy-httpd" Mar 16 17:04:56 crc kubenswrapper[5120]: I0316 17:04:56.918854 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9e1bfc3-4b43-41e4-af96-bba09e1c74b3" containerName="sg-core" Mar 16 17:04:56 crc kubenswrapper[5120]: I0316 17:04:56.918860 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9e1bfc3-4b43-41e4-af96-bba09e1c74b3" containerName="sg-core" Mar 16 17:04:56 crc kubenswrapper[5120]: I0316 17:04:56.918873 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9e1bfc3-4b43-41e4-af96-bba09e1c74b3" containerName="ceilometer-notification-agent" Mar 16 17:04:56 crc kubenswrapper[5120]: I0316 17:04:56.918880 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9e1bfc3-4b43-41e4-af96-bba09e1c74b3" containerName="ceilometer-notification-agent" Mar 16 17:04:56 crc kubenswrapper[5120]: I0316 17:04:56.919038 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="a9e1bfc3-4b43-41e4-af96-bba09e1c74b3" containerName="sg-core" Mar 16 17:04:56 crc kubenswrapper[5120]: I0316 17:04:56.919055 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="a9e1bfc3-4b43-41e4-af96-bba09e1c74b3" containerName="ceilometer-notification-agent" Mar 16 17:04:56 crc kubenswrapper[5120]: I0316 17:04:56.919070 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="a9e1bfc3-4b43-41e4-af96-bba09e1c74b3" containerName="proxy-httpd" Mar 16 17:04:56 crc kubenswrapper[5120]: I0316 17:04:56.919080 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="a9e1bfc3-4b43-41e4-af96-bba09e1c74b3" containerName="ceilometer-central-agent" Mar 16 17:04:56 crc kubenswrapper[5120]: I0316 17:04:56.929800 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a9e1bfc3-4b43-41e4-af96-bba09e1c74b3-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:04:56 crc kubenswrapper[5120]: I0316 17:04:56.951251 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-5bb4df7ffd-xw448"] Mar 16 17:04:56 crc kubenswrapper[5120]: I0316 17:04:56.951381 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-5bb4df7ffd-xw448" Mar 16 17:04:56 crc kubenswrapper[5120]: I0316 17:04:56.968439 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-neutron-internal-svc\"" Mar 16 17:04:56 crc kubenswrapper[5120]: I0316 17:04:56.968578 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-neutron-public-svc\"" Mar 16 17:04:57 crc kubenswrapper[5120]: I0316 17:04:57.026008 5120 scope.go:117] "RemoveContainer" containerID="096f2a30a311d5a9357edbe18150646307ad87f31168d9af80f3221149d5b44c" Mar 16 17:04:57 crc kubenswrapper[5120]: E0316 17:04:57.033106 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"096f2a30a311d5a9357edbe18150646307ad87f31168d9af80f3221149d5b44c\": container with ID starting with 096f2a30a311d5a9357edbe18150646307ad87f31168d9af80f3221149d5b44c not found: ID does not exist" containerID="096f2a30a311d5a9357edbe18150646307ad87f31168d9af80f3221149d5b44c" Mar 16 17:04:57 crc kubenswrapper[5120]: I0316 17:04:57.033438 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"096f2a30a311d5a9357edbe18150646307ad87f31168d9af80f3221149d5b44c"} err="failed to get container status \"096f2a30a311d5a9357edbe18150646307ad87f31168d9af80f3221149d5b44c\": rpc error: code = NotFound desc = could not find container \"096f2a30a311d5a9357edbe18150646307ad87f31168d9af80f3221149d5b44c\": container with ID starting with 096f2a30a311d5a9357edbe18150646307ad87f31168d9af80f3221149d5b44c not found: ID does not exist" Mar 16 17:04:57 crc kubenswrapper[5120]: I0316 17:04:57.033554 5120 scope.go:117] "RemoveContainer" containerID="bc6059038bcbf227e81791577f3c4135df8bdd6f10e8037b2b6a1d03339d91a4" Mar 16 17:04:57 crc kubenswrapper[5120]: I0316 17:04:57.033856 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:04:57 crc kubenswrapper[5120]: I0316 17:04:57.034203 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:04:57 crc kubenswrapper[5120]: E0316 17:04:57.034310 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc6059038bcbf227e81791577f3c4135df8bdd6f10e8037b2b6a1d03339d91a4\": container with ID starting with bc6059038bcbf227e81791577f3c4135df8bdd6f10e8037b2b6a1d03339d91a4 not found: ID does not exist" containerID="bc6059038bcbf227e81791577f3c4135df8bdd6f10e8037b2b6a1d03339d91a4" Mar 16 17:04:57 crc kubenswrapper[5120]: I0316 17:04:57.034337 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc6059038bcbf227e81791577f3c4135df8bdd6f10e8037b2b6a1d03339d91a4"} err="failed to get container status \"bc6059038bcbf227e81791577f3c4135df8bdd6f10e8037b2b6a1d03339d91a4\": rpc error: code = NotFound desc = could not find container \"bc6059038bcbf227e81791577f3c4135df8bdd6f10e8037b2b6a1d03339d91a4\": container with ID starting with bc6059038bcbf227e81791577f3c4135df8bdd6f10e8037b2b6a1d03339d91a4 not found: ID does not exist" Mar 16 17:04:57 crc kubenswrapper[5120]: I0316 17:04:57.034361 5120 scope.go:117] "RemoveContainer" containerID="98a9675a48061678c809e191cbebf8b353cb09cbd50fdc3e788e3b63210a648d" Mar 16 17:04:57 crc kubenswrapper[5120]: E0316 17:04:57.034691 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"98a9675a48061678c809e191cbebf8b353cb09cbd50fdc3e788e3b63210a648d\": container with ID starting with 98a9675a48061678c809e191cbebf8b353cb09cbd50fdc3e788e3b63210a648d not found: ID does not exist" containerID="98a9675a48061678c809e191cbebf8b353cb09cbd50fdc3e788e3b63210a648d" Mar 16 17:04:57 crc kubenswrapper[5120]: I0316 17:04:57.034716 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98a9675a48061678c809e191cbebf8b353cb09cbd50fdc3e788e3b63210a648d"} err="failed to get container status \"98a9675a48061678c809e191cbebf8b353cb09cbd50fdc3e788e3b63210a648d\": rpc error: code = NotFound desc = could not find container \"98a9675a48061678c809e191cbebf8b353cb09cbd50fdc3e788e3b63210a648d\": container with ID starting with 98a9675a48061678c809e191cbebf8b353cb09cbd50fdc3e788e3b63210a648d not found: ID does not exist" Mar 16 17:04:57 crc kubenswrapper[5120]: I0316 17:04:57.034732 5120 scope.go:117] "RemoveContainer" containerID="60c2d39c36a3a538eeada6bbcbcf4c86d96fd24cd27c838f963ac043bffb0d92" Mar 16 17:04:57 crc kubenswrapper[5120]: E0316 17:04:57.035186 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"60c2d39c36a3a538eeada6bbcbcf4c86d96fd24cd27c838f963ac043bffb0d92\": container with ID starting with 60c2d39c36a3a538eeada6bbcbcf4c86d96fd24cd27c838f963ac043bffb0d92 not found: ID does not exist" containerID="60c2d39c36a3a538eeada6bbcbcf4c86d96fd24cd27c838f963ac043bffb0d92" Mar 16 17:04:57 crc kubenswrapper[5120]: I0316 17:04:57.035211 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60c2d39c36a3a538eeada6bbcbcf4c86d96fd24cd27c838f963ac043bffb0d92"} err="failed to get container status \"60c2d39c36a3a538eeada6bbcbcf4c86d96fd24cd27c838f963ac043bffb0d92\": rpc error: code = NotFound desc = could not find container \"60c2d39c36a3a538eeada6bbcbcf4c86d96fd24cd27c838f963ac043bffb0d92\": container with ID starting with 60c2d39c36a3a538eeada6bbcbcf4c86d96fd24cd27c838f963ac043bffb0d92 not found: ID does not exist" Mar 16 17:04:57 crc kubenswrapper[5120]: I0316 17:04:57.035224 5120 scope.go:117] "RemoveContainer" containerID="096f2a30a311d5a9357edbe18150646307ad87f31168d9af80f3221149d5b44c" Mar 16 17:04:57 crc kubenswrapper[5120]: I0316 17:04:57.035526 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"096f2a30a311d5a9357edbe18150646307ad87f31168d9af80f3221149d5b44c"} err="failed to get container status \"096f2a30a311d5a9357edbe18150646307ad87f31168d9af80f3221149d5b44c\": rpc error: code = NotFound desc = could not find container \"096f2a30a311d5a9357edbe18150646307ad87f31168d9af80f3221149d5b44c\": container with ID starting with 096f2a30a311d5a9357edbe18150646307ad87f31168d9af80f3221149d5b44c not found: ID does not exist" Mar 16 17:04:57 crc kubenswrapper[5120]: I0316 17:04:57.035543 5120 scope.go:117] "RemoveContainer" containerID="bc6059038bcbf227e81791577f3c4135df8bdd6f10e8037b2b6a1d03339d91a4" Mar 16 17:04:57 crc kubenswrapper[5120]: I0316 17:04:57.035913 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc6059038bcbf227e81791577f3c4135df8bdd6f10e8037b2b6a1d03339d91a4"} err="failed to get container status \"bc6059038bcbf227e81791577f3c4135df8bdd6f10e8037b2b6a1d03339d91a4\": rpc error: code = NotFound desc = could not find container \"bc6059038bcbf227e81791577f3c4135df8bdd6f10e8037b2b6a1d03339d91a4\": container with ID starting with bc6059038bcbf227e81791577f3c4135df8bdd6f10e8037b2b6a1d03339d91a4 not found: ID does not exist" Mar 16 17:04:57 crc kubenswrapper[5120]: I0316 17:04:57.036072 5120 scope.go:117] "RemoveContainer" containerID="98a9675a48061678c809e191cbebf8b353cb09cbd50fdc3e788e3b63210a648d" Mar 16 17:04:57 crc kubenswrapper[5120]: I0316 17:04:57.036931 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74m4f\" (UniqueName: \"kubernetes.io/projected/aadf64b4-9c41-4b13-be3a-4bb9172d06dd-kube-api-access-74m4f\") pod \"neutron-5bb4df7ffd-xw448\" (UID: \"aadf64b4-9c41-4b13-be3a-4bb9172d06dd\") " pod="openstack-kuttl-tests/neutron-5bb4df7ffd-xw448" Mar 16 17:04:57 crc kubenswrapper[5120]: I0316 17:04:57.037971 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/aadf64b4-9c41-4b13-be3a-4bb9172d06dd-ovndb-tls-certs\") pod \"neutron-5bb4df7ffd-xw448\" (UID: \"aadf64b4-9c41-4b13-be3a-4bb9172d06dd\") " pod="openstack-kuttl-tests/neutron-5bb4df7ffd-xw448" Mar 16 17:04:57 crc kubenswrapper[5120]: I0316 17:04:57.038372 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98a9675a48061678c809e191cbebf8b353cb09cbd50fdc3e788e3b63210a648d"} err="failed to get container status \"98a9675a48061678c809e191cbebf8b353cb09cbd50fdc3e788e3b63210a648d\": rpc error: code = NotFound desc = could not find container \"98a9675a48061678c809e191cbebf8b353cb09cbd50fdc3e788e3b63210a648d\": container with ID starting with 98a9675a48061678c809e191cbebf8b353cb09cbd50fdc3e788e3b63210a648d not found: ID does not exist" Mar 16 17:04:57 crc kubenswrapper[5120]: I0316 17:04:57.038411 5120 scope.go:117] "RemoveContainer" containerID="60c2d39c36a3a538eeada6bbcbcf4c86d96fd24cd27c838f963ac043bffb0d92" Mar 16 17:04:57 crc kubenswrapper[5120]: I0316 17:04:57.038682 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/aadf64b4-9c41-4b13-be3a-4bb9172d06dd-httpd-config\") pod \"neutron-5bb4df7ffd-xw448\" (UID: \"aadf64b4-9c41-4b13-be3a-4bb9172d06dd\") " pod="openstack-kuttl-tests/neutron-5bb4df7ffd-xw448" Mar 16 17:04:57 crc kubenswrapper[5120]: I0316 17:04:57.038973 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/aadf64b4-9c41-4b13-be3a-4bb9172d06dd-public-tls-certs\") pod \"neutron-5bb4df7ffd-xw448\" (UID: \"aadf64b4-9c41-4b13-be3a-4bb9172d06dd\") " pod="openstack-kuttl-tests/neutron-5bb4df7ffd-xw448" Mar 16 17:04:57 crc kubenswrapper[5120]: I0316 17:04:57.039145 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/aadf64b4-9c41-4b13-be3a-4bb9172d06dd-combined-ca-bundle\") pod \"neutron-5bb4df7ffd-xw448\" (UID: \"aadf64b4-9c41-4b13-be3a-4bb9172d06dd\") " pod="openstack-kuttl-tests/neutron-5bb4df7ffd-xw448" Mar 16 17:04:57 crc kubenswrapper[5120]: I0316 17:04:57.039248 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/aadf64b4-9c41-4b13-be3a-4bb9172d06dd-internal-tls-certs\") pod \"neutron-5bb4df7ffd-xw448\" (UID: \"aadf64b4-9c41-4b13-be3a-4bb9172d06dd\") " pod="openstack-kuttl-tests/neutron-5bb4df7ffd-xw448" Mar 16 17:04:57 crc kubenswrapper[5120]: I0316 17:04:57.039394 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/aadf64b4-9c41-4b13-be3a-4bb9172d06dd-config\") pod \"neutron-5bb4df7ffd-xw448\" (UID: \"aadf64b4-9c41-4b13-be3a-4bb9172d06dd\") " pod="openstack-kuttl-tests/neutron-5bb4df7ffd-xw448" Mar 16 17:04:57 crc kubenswrapper[5120]: I0316 17:04:57.041504 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60c2d39c36a3a538eeada6bbcbcf4c86d96fd24cd27c838f963ac043bffb0d92"} err="failed to get container status \"60c2d39c36a3a538eeada6bbcbcf4c86d96fd24cd27c838f963ac043bffb0d92\": rpc error: code = NotFound desc = could not find container \"60c2d39c36a3a538eeada6bbcbcf4c86d96fd24cd27c838f963ac043bffb0d92\": container with ID starting with 60c2d39c36a3a538eeada6bbcbcf4c86d96fd24cd27c838f963ac043bffb0d92 not found: ID does not exist" Mar 16 17:04:57 crc kubenswrapper[5120]: I0316 17:04:57.041803 5120 scope.go:117] "RemoveContainer" containerID="096f2a30a311d5a9357edbe18150646307ad87f31168d9af80f3221149d5b44c" Mar 16 17:04:57 crc kubenswrapper[5120]: I0316 17:04:57.045148 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"096f2a30a311d5a9357edbe18150646307ad87f31168d9af80f3221149d5b44c"} err="failed to get container status \"096f2a30a311d5a9357edbe18150646307ad87f31168d9af80f3221149d5b44c\": rpc error: code = NotFound desc = could not find container \"096f2a30a311d5a9357edbe18150646307ad87f31168d9af80f3221149d5b44c\": container with ID starting with 096f2a30a311d5a9357edbe18150646307ad87f31168d9af80f3221149d5b44c not found: ID does not exist" Mar 16 17:04:57 crc kubenswrapper[5120]: I0316 17:04:57.045194 5120 scope.go:117] "RemoveContainer" containerID="bc6059038bcbf227e81791577f3c4135df8bdd6f10e8037b2b6a1d03339d91a4" Mar 16 17:04:57 crc kubenswrapper[5120]: I0316 17:04:57.045976 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc6059038bcbf227e81791577f3c4135df8bdd6f10e8037b2b6a1d03339d91a4"} err="failed to get container status \"bc6059038bcbf227e81791577f3c4135df8bdd6f10e8037b2b6a1d03339d91a4\": rpc error: code = NotFound desc = could not find container \"bc6059038bcbf227e81791577f3c4135df8bdd6f10e8037b2b6a1d03339d91a4\": container with ID starting with bc6059038bcbf227e81791577f3c4135df8bdd6f10e8037b2b6a1d03339d91a4 not found: ID does not exist" Mar 16 17:04:57 crc kubenswrapper[5120]: I0316 17:04:57.046038 5120 scope.go:117] "RemoveContainer" containerID="98a9675a48061678c809e191cbebf8b353cb09cbd50fdc3e788e3b63210a648d" Mar 16 17:04:57 crc kubenswrapper[5120]: I0316 17:04:57.046412 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98a9675a48061678c809e191cbebf8b353cb09cbd50fdc3e788e3b63210a648d"} err="failed to get container status \"98a9675a48061678c809e191cbebf8b353cb09cbd50fdc3e788e3b63210a648d\": rpc error: code = NotFound desc = could not find container \"98a9675a48061678c809e191cbebf8b353cb09cbd50fdc3e788e3b63210a648d\": container with ID starting with 98a9675a48061678c809e191cbebf8b353cb09cbd50fdc3e788e3b63210a648d not found: ID does not exist" Mar 16 17:04:57 crc kubenswrapper[5120]: I0316 17:04:57.046447 5120 scope.go:117] "RemoveContainer" containerID="60c2d39c36a3a538eeada6bbcbcf4c86d96fd24cd27c838f963ac043bffb0d92" Mar 16 17:04:57 crc kubenswrapper[5120]: I0316 17:04:57.046752 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60c2d39c36a3a538eeada6bbcbcf4c86d96fd24cd27c838f963ac043bffb0d92"} err="failed to get container status \"60c2d39c36a3a538eeada6bbcbcf4c86d96fd24cd27c838f963ac043bffb0d92\": rpc error: code = NotFound desc = could not find container \"60c2d39c36a3a538eeada6bbcbcf4c86d96fd24cd27c838f963ac043bffb0d92\": container with ID starting with 60c2d39c36a3a538eeada6bbcbcf4c86d96fd24cd27c838f963ac043bffb0d92 not found: ID does not exist" Mar 16 17:04:57 crc kubenswrapper[5120]: I0316 17:04:57.046869 5120 scope.go:117] "RemoveContainer" containerID="096f2a30a311d5a9357edbe18150646307ad87f31168d9af80f3221149d5b44c" Mar 16 17:04:57 crc kubenswrapper[5120]: I0316 17:04:57.047107 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"096f2a30a311d5a9357edbe18150646307ad87f31168d9af80f3221149d5b44c"} err="failed to get container status \"096f2a30a311d5a9357edbe18150646307ad87f31168d9af80f3221149d5b44c\": rpc error: code = NotFound desc = could not find container \"096f2a30a311d5a9357edbe18150646307ad87f31168d9af80f3221149d5b44c\": container with ID starting with 096f2a30a311d5a9357edbe18150646307ad87f31168d9af80f3221149d5b44c not found: ID does not exist" Mar 16 17:04:57 crc kubenswrapper[5120]: I0316 17:04:57.047125 5120 scope.go:117] "RemoveContainer" containerID="bc6059038bcbf227e81791577f3c4135df8bdd6f10e8037b2b6a1d03339d91a4" Mar 16 17:04:57 crc kubenswrapper[5120]: I0316 17:04:57.050918 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc6059038bcbf227e81791577f3c4135df8bdd6f10e8037b2b6a1d03339d91a4"} err="failed to get container status \"bc6059038bcbf227e81791577f3c4135df8bdd6f10e8037b2b6a1d03339d91a4\": rpc error: code = NotFound desc = could not find container \"bc6059038bcbf227e81791577f3c4135df8bdd6f10e8037b2b6a1d03339d91a4\": container with ID starting with bc6059038bcbf227e81791577f3c4135df8bdd6f10e8037b2b6a1d03339d91a4 not found: ID does not exist" Mar 16 17:04:57 crc kubenswrapper[5120]: I0316 17:04:57.051131 5120 scope.go:117] "RemoveContainer" containerID="98a9675a48061678c809e191cbebf8b353cb09cbd50fdc3e788e3b63210a648d" Mar 16 17:04:57 crc kubenswrapper[5120]: I0316 17:04:57.054095 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98a9675a48061678c809e191cbebf8b353cb09cbd50fdc3e788e3b63210a648d"} err="failed to get container status \"98a9675a48061678c809e191cbebf8b353cb09cbd50fdc3e788e3b63210a648d\": rpc error: code = NotFound desc = could not find container \"98a9675a48061678c809e191cbebf8b353cb09cbd50fdc3e788e3b63210a648d\": container with ID starting with 98a9675a48061678c809e191cbebf8b353cb09cbd50fdc3e788e3b63210a648d not found: ID does not exist" Mar 16 17:04:57 crc kubenswrapper[5120]: I0316 17:04:57.054154 5120 scope.go:117] "RemoveContainer" containerID="60c2d39c36a3a538eeada6bbcbcf4c86d96fd24cd27c838f963ac043bffb0d92" Mar 16 17:04:57 crc kubenswrapper[5120]: I0316 17:04:57.054551 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60c2d39c36a3a538eeada6bbcbcf4c86d96fd24cd27c838f963ac043bffb0d92"} err="failed to get container status \"60c2d39c36a3a538eeada6bbcbcf4c86d96fd24cd27c838f963ac043bffb0d92\": rpc error: code = NotFound desc = could not find container \"60c2d39c36a3a538eeada6bbcbcf4c86d96fd24cd27c838f963ac043bffb0d92\": container with ID starting with 60c2d39c36a3a538eeada6bbcbcf4c86d96fd24cd27c838f963ac043bffb0d92 not found: ID does not exist" Mar 16 17:04:57 crc kubenswrapper[5120]: I0316 17:04:57.135434 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:04:57 crc kubenswrapper[5120]: I0316 17:04:57.142204 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-74m4f\" (UniqueName: \"kubernetes.io/projected/aadf64b4-9c41-4b13-be3a-4bb9172d06dd-kube-api-access-74m4f\") pod \"neutron-5bb4df7ffd-xw448\" (UID: \"aadf64b4-9c41-4b13-be3a-4bb9172d06dd\") " pod="openstack-kuttl-tests/neutron-5bb4df7ffd-xw448" Mar 16 17:04:57 crc kubenswrapper[5120]: I0316 17:04:57.142278 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/aadf64b4-9c41-4b13-be3a-4bb9172d06dd-ovndb-tls-certs\") pod \"neutron-5bb4df7ffd-xw448\" (UID: \"aadf64b4-9c41-4b13-be3a-4bb9172d06dd\") " pod="openstack-kuttl-tests/neutron-5bb4df7ffd-xw448" Mar 16 17:04:57 crc kubenswrapper[5120]: I0316 17:04:57.142383 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/aadf64b4-9c41-4b13-be3a-4bb9172d06dd-httpd-config\") pod \"neutron-5bb4df7ffd-xw448\" (UID: \"aadf64b4-9c41-4b13-be3a-4bb9172d06dd\") " pod="openstack-kuttl-tests/neutron-5bb4df7ffd-xw448" Mar 16 17:04:57 crc kubenswrapper[5120]: I0316 17:04:57.142410 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/aadf64b4-9c41-4b13-be3a-4bb9172d06dd-public-tls-certs\") pod \"neutron-5bb4df7ffd-xw448\" (UID: \"aadf64b4-9c41-4b13-be3a-4bb9172d06dd\") " pod="openstack-kuttl-tests/neutron-5bb4df7ffd-xw448" Mar 16 17:04:57 crc kubenswrapper[5120]: I0316 17:04:57.142467 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/aadf64b4-9c41-4b13-be3a-4bb9172d06dd-combined-ca-bundle\") pod \"neutron-5bb4df7ffd-xw448\" (UID: \"aadf64b4-9c41-4b13-be3a-4bb9172d06dd\") " pod="openstack-kuttl-tests/neutron-5bb4df7ffd-xw448" Mar 16 17:04:57 crc kubenswrapper[5120]: I0316 17:04:57.142491 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/aadf64b4-9c41-4b13-be3a-4bb9172d06dd-internal-tls-certs\") pod \"neutron-5bb4df7ffd-xw448\" (UID: \"aadf64b4-9c41-4b13-be3a-4bb9172d06dd\") " pod="openstack-kuttl-tests/neutron-5bb4df7ffd-xw448" Mar 16 17:04:57 crc kubenswrapper[5120]: I0316 17:04:57.142543 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/aadf64b4-9c41-4b13-be3a-4bb9172d06dd-config\") pod \"neutron-5bb4df7ffd-xw448\" (UID: \"aadf64b4-9c41-4b13-be3a-4bb9172d06dd\") " pod="openstack-kuttl-tests/neutron-5bb4df7ffd-xw448" Mar 16 17:04:57 crc kubenswrapper[5120]: I0316 17:04:57.161082 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:04:57 crc kubenswrapper[5120]: I0316 17:04:57.167872 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/aadf64b4-9c41-4b13-be3a-4bb9172d06dd-httpd-config\") pod \"neutron-5bb4df7ffd-xw448\" (UID: \"aadf64b4-9c41-4b13-be3a-4bb9172d06dd\") " pod="openstack-kuttl-tests/neutron-5bb4df7ffd-xw448" Mar 16 17:04:57 crc kubenswrapper[5120]: I0316 17:04:57.170738 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/aadf64b4-9c41-4b13-be3a-4bb9172d06dd-internal-tls-certs\") pod \"neutron-5bb4df7ffd-xw448\" (UID: \"aadf64b4-9c41-4b13-be3a-4bb9172d06dd\") " pod="openstack-kuttl-tests/neutron-5bb4df7ffd-xw448" Mar 16 17:04:57 crc kubenswrapper[5120]: I0316 17:04:57.185059 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:04:57 crc kubenswrapper[5120]: I0316 17:04:57.190572 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/aadf64b4-9c41-4b13-be3a-4bb9172d06dd-config\") pod \"neutron-5bb4df7ffd-xw448\" (UID: \"aadf64b4-9c41-4b13-be3a-4bb9172d06dd\") " pod="openstack-kuttl-tests/neutron-5bb4df7ffd-xw448" Mar 16 17:04:57 crc kubenswrapper[5120]: I0316 17:04:57.195680 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/aadf64b4-9c41-4b13-be3a-4bb9172d06dd-public-tls-certs\") pod \"neutron-5bb4df7ffd-xw448\" (UID: \"aadf64b4-9c41-4b13-be3a-4bb9172d06dd\") " pod="openstack-kuttl-tests/neutron-5bb4df7ffd-xw448" Mar 16 17:04:57 crc kubenswrapper[5120]: I0316 17:04:57.203582 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/aadf64b4-9c41-4b13-be3a-4bb9172d06dd-combined-ca-bundle\") pod \"neutron-5bb4df7ffd-xw448\" (UID: \"aadf64b4-9c41-4b13-be3a-4bb9172d06dd\") " pod="openstack-kuttl-tests/neutron-5bb4df7ffd-xw448" Mar 16 17:04:57 crc kubenswrapper[5120]: I0316 17:04:57.204818 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-74m4f\" (UniqueName: \"kubernetes.io/projected/aadf64b4-9c41-4b13-be3a-4bb9172d06dd-kube-api-access-74m4f\") pod \"neutron-5bb4df7ffd-xw448\" (UID: \"aadf64b4-9c41-4b13-be3a-4bb9172d06dd\") " pod="openstack-kuttl-tests/neutron-5bb4df7ffd-xw448" Mar 16 17:04:57 crc kubenswrapper[5120]: I0316 17:04:57.208450 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:04:57 crc kubenswrapper[5120]: I0316 17:04:57.208597 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:04:57 crc kubenswrapper[5120]: I0316 17:04:57.212643 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 17:04:57 crc kubenswrapper[5120]: I0316 17:04:57.215541 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 17:04:57 crc kubenswrapper[5120]: I0316 17:04:57.247354 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/aadf64b4-9c41-4b13-be3a-4bb9172d06dd-ovndb-tls-certs\") pod \"neutron-5bb4df7ffd-xw448\" (UID: \"aadf64b4-9c41-4b13-be3a-4bb9172d06dd\") " pod="openstack-kuttl-tests/neutron-5bb4df7ffd-xw448" Mar 16 17:04:57 crc kubenswrapper[5120]: I0316 17:04:57.297461 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-5bb4df7ffd-xw448" Mar 16 17:04:57 crc kubenswrapper[5120]: I0316 17:04:57.351868 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/b0e290e3-0e59-4d06-950e-c679ec283a0b-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"b0e290e3-0e59-4d06-950e-c679ec283a0b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:04:57 crc kubenswrapper[5120]: I0316 17:04:57.352255 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/b0e290e3-0e59-4d06-950e-c679ec283a0b-run-httpd\") pod \"ceilometer-0\" (UID: \"b0e290e3-0e59-4d06-950e-c679ec283a0b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:04:57 crc kubenswrapper[5120]: I0316 17:04:57.352304 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ksgln\" (UniqueName: \"kubernetes.io/projected/b0e290e3-0e59-4d06-950e-c679ec283a0b-kube-api-access-ksgln\") pod \"ceilometer-0\" (UID: \"b0e290e3-0e59-4d06-950e-c679ec283a0b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:04:57 crc kubenswrapper[5120]: I0316 17:04:57.352586 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b0e290e3-0e59-4d06-950e-c679ec283a0b-scripts\") pod \"ceilometer-0\" (UID: \"b0e290e3-0e59-4d06-950e-c679ec283a0b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:04:57 crc kubenswrapper[5120]: I0316 17:04:57.352792 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/b0e290e3-0e59-4d06-950e-c679ec283a0b-log-httpd\") pod \"ceilometer-0\" (UID: \"b0e290e3-0e59-4d06-950e-c679ec283a0b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:04:57 crc kubenswrapper[5120]: I0316 17:04:57.352814 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b0e290e3-0e59-4d06-950e-c679ec283a0b-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"b0e290e3-0e59-4d06-950e-c679ec283a0b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:04:57 crc kubenswrapper[5120]: I0316 17:04:57.353547 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b0e290e3-0e59-4d06-950e-c679ec283a0b-config-data\") pod \"ceilometer-0\" (UID: \"b0e290e3-0e59-4d06-950e-c679ec283a0b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:04:57 crc kubenswrapper[5120]: I0316 17:04:57.353217 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:04:57 crc kubenswrapper[5120]: I0316 17:04:57.365278 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:04:57 crc kubenswrapper[5120]: I0316 17:04:57.463335 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b0e290e3-0e59-4d06-950e-c679ec283a0b-scripts\") pod \"ceilometer-0\" (UID: \"b0e290e3-0e59-4d06-950e-c679ec283a0b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:04:57 crc kubenswrapper[5120]: I0316 17:04:57.463619 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/b0e290e3-0e59-4d06-950e-c679ec283a0b-log-httpd\") pod \"ceilometer-0\" (UID: \"b0e290e3-0e59-4d06-950e-c679ec283a0b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:04:57 crc kubenswrapper[5120]: I0316 17:04:57.463662 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b0e290e3-0e59-4d06-950e-c679ec283a0b-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"b0e290e3-0e59-4d06-950e-c679ec283a0b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:04:57 crc kubenswrapper[5120]: I0316 17:04:57.463746 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b0e290e3-0e59-4d06-950e-c679ec283a0b-config-data\") pod \"ceilometer-0\" (UID: \"b0e290e3-0e59-4d06-950e-c679ec283a0b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:04:57 crc kubenswrapper[5120]: I0316 17:04:57.463819 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/b0e290e3-0e59-4d06-950e-c679ec283a0b-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"b0e290e3-0e59-4d06-950e-c679ec283a0b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:04:57 crc kubenswrapper[5120]: I0316 17:04:57.463916 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/b0e290e3-0e59-4d06-950e-c679ec283a0b-run-httpd\") pod \"ceilometer-0\" (UID: \"b0e290e3-0e59-4d06-950e-c679ec283a0b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:04:57 crc kubenswrapper[5120]: I0316 17:04:57.464036 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ksgln\" (UniqueName: \"kubernetes.io/projected/b0e290e3-0e59-4d06-950e-c679ec283a0b-kube-api-access-ksgln\") pod \"ceilometer-0\" (UID: \"b0e290e3-0e59-4d06-950e-c679ec283a0b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:04:57 crc kubenswrapper[5120]: I0316 17:04:57.464425 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/b0e290e3-0e59-4d06-950e-c679ec283a0b-log-httpd\") pod \"ceilometer-0\" (UID: \"b0e290e3-0e59-4d06-950e-c679ec283a0b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:04:57 crc kubenswrapper[5120]: I0316 17:04:57.465374 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/b0e290e3-0e59-4d06-950e-c679ec283a0b-run-httpd\") pod \"ceilometer-0\" (UID: \"b0e290e3-0e59-4d06-950e-c679ec283a0b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:04:57 crc kubenswrapper[5120]: I0316 17:04:57.474648 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b0e290e3-0e59-4d06-950e-c679ec283a0b-scripts\") pod \"ceilometer-0\" (UID: \"b0e290e3-0e59-4d06-950e-c679ec283a0b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:04:57 crc kubenswrapper[5120]: I0316 17:04:57.475939 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b0e290e3-0e59-4d06-950e-c679ec283a0b-config-data\") pod \"ceilometer-0\" (UID: \"b0e290e3-0e59-4d06-950e-c679ec283a0b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:04:57 crc kubenswrapper[5120]: I0316 17:04:57.480721 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/b0e290e3-0e59-4d06-950e-c679ec283a0b-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"b0e290e3-0e59-4d06-950e-c679ec283a0b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:04:57 crc kubenswrapper[5120]: I0316 17:04:57.486954 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b0e290e3-0e59-4d06-950e-c679ec283a0b-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"b0e290e3-0e59-4d06-950e-c679ec283a0b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:04:57 crc kubenswrapper[5120]: I0316 17:04:57.492061 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ksgln\" (UniqueName: \"kubernetes.io/projected/b0e290e3-0e59-4d06-950e-c679ec283a0b-kube-api-access-ksgln\") pod \"ceilometer-0\" (UID: \"b0e290e3-0e59-4d06-950e-c679ec283a0b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:04:57 crc kubenswrapper[5120]: I0316 17:04:57.671184 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:04:57 crc kubenswrapper[5120]: I0316 17:04:57.726617 5120 generic.go:358] "Generic (PLEG): container finished" podID="b2d5e452-345a-44a8-9565-819d12354734" containerID="fb37ee080652aa183bb7e68b17e6e29ceeb7fa51994a6aeb0fcd1ee639ee1f3e" exitCode=0 Mar 16 17:04:57 crc kubenswrapper[5120]: I0316 17:04:57.726644 5120 generic.go:358] "Generic (PLEG): container finished" podID="b2d5e452-345a-44a8-9565-819d12354734" containerID="e7f311842b759e2d57b9a0080f778a8a633c00c1a97ef3a69c697995305b3871" exitCode=143 Mar 16 17:04:57 crc kubenswrapper[5120]: I0316 17:04:57.726807 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"b2d5e452-345a-44a8-9565-819d12354734","Type":"ContainerDied","Data":"fb37ee080652aa183bb7e68b17e6e29ceeb7fa51994a6aeb0fcd1ee639ee1f3e"} Mar 16 17:04:57 crc kubenswrapper[5120]: I0316 17:04:57.726833 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"b2d5e452-345a-44a8-9565-819d12354734","Type":"ContainerDied","Data":"e7f311842b759e2d57b9a0080f778a8a633c00c1a97ef3a69c697995305b3871"} Mar 16 17:04:57 crc kubenswrapper[5120]: I0316 17:04:57.931003 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:04:58 crc kubenswrapper[5120]: I0316 17:04:58.066879 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-d7c955d94-2dfzr"] Mar 16 17:04:58 crc kubenswrapper[5120]: I0316 17:04:58.068012 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2d5e452-345a-44a8-9565-819d12354734" containerName="cinder-api-log" Mar 16 17:04:58 crc kubenswrapper[5120]: I0316 17:04:58.068032 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2d5e452-345a-44a8-9565-819d12354734" containerName="cinder-api-log" Mar 16 17:04:58 crc kubenswrapper[5120]: I0316 17:04:58.068069 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2d5e452-345a-44a8-9565-819d12354734" containerName="cinder-api" Mar 16 17:04:58 crc kubenswrapper[5120]: I0316 17:04:58.068076 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2d5e452-345a-44a8-9565-819d12354734" containerName="cinder-api" Mar 16 17:04:58 crc kubenswrapper[5120]: I0316 17:04:58.068232 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="b2d5e452-345a-44a8-9565-819d12354734" containerName="cinder-api" Mar 16 17:04:58 crc kubenswrapper[5120]: I0316 17:04:58.068264 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="b2d5e452-345a-44a8-9565-819d12354734" containerName="cinder-api-log" Mar 16 17:04:58 crc kubenswrapper[5120]: I0316 17:04:58.090754 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b2d5e452-345a-44a8-9565-819d12354734-scripts\") pod \"b2d5e452-345a-44a8-9565-819d12354734\" (UID: \"b2d5e452-345a-44a8-9565-819d12354734\") " Mar 16 17:04:58 crc kubenswrapper[5120]: I0316 17:04:58.090855 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b2d5e452-345a-44a8-9565-819d12354734-logs\") pod \"b2d5e452-345a-44a8-9565-819d12354734\" (UID: \"b2d5e452-345a-44a8-9565-819d12354734\") " Mar 16 17:04:58 crc kubenswrapper[5120]: I0316 17:04:58.090988 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zhhzl\" (UniqueName: \"kubernetes.io/projected/b2d5e452-345a-44a8-9565-819d12354734-kube-api-access-zhhzl\") pod \"b2d5e452-345a-44a8-9565-819d12354734\" (UID: \"b2d5e452-345a-44a8-9565-819d12354734\") " Mar 16 17:04:58 crc kubenswrapper[5120]: I0316 17:04:58.091214 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b2d5e452-345a-44a8-9565-819d12354734-combined-ca-bundle\") pod \"b2d5e452-345a-44a8-9565-819d12354734\" (UID: \"b2d5e452-345a-44a8-9565-819d12354734\") " Mar 16 17:04:58 crc kubenswrapper[5120]: I0316 17:04:58.091323 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/b2d5e452-345a-44a8-9565-819d12354734-config-data-custom\") pod \"b2d5e452-345a-44a8-9565-819d12354734\" (UID: \"b2d5e452-345a-44a8-9565-819d12354734\") " Mar 16 17:04:58 crc kubenswrapper[5120]: I0316 17:04:58.091360 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b2d5e452-345a-44a8-9565-819d12354734-config-data\") pod \"b2d5e452-345a-44a8-9565-819d12354734\" (UID: \"b2d5e452-345a-44a8-9565-819d12354734\") " Mar 16 17:04:58 crc kubenswrapper[5120]: I0316 17:04:58.091404 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/b2d5e452-345a-44a8-9565-819d12354734-etc-machine-id\") pod \"b2d5e452-345a-44a8-9565-819d12354734\" (UID: \"b2d5e452-345a-44a8-9565-819d12354734\") " Mar 16 17:04:58 crc kubenswrapper[5120]: I0316 17:04:58.092269 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/b2d5e452-345a-44a8-9565-819d12354734-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "b2d5e452-345a-44a8-9565-819d12354734" (UID: "b2d5e452-345a-44a8-9565-819d12354734"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 17:04:58 crc kubenswrapper[5120]: I0316 17:04:58.096514 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2d5e452-345a-44a8-9565-819d12354734-logs" (OuterVolumeSpecName: "logs") pod "b2d5e452-345a-44a8-9565-819d12354734" (UID: "b2d5e452-345a-44a8-9565-819d12354734"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:04:58 crc kubenswrapper[5120]: I0316 17:04:58.097477 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-d7c955d94-2dfzr"] Mar 16 17:04:58 crc kubenswrapper[5120]: I0316 17:04:58.097621 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-d7c955d94-2dfzr" Mar 16 17:04:58 crc kubenswrapper[5120]: I0316 17:04:58.106849 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-5bb4df7ffd-xw448"] Mar 16 17:04:58 crc kubenswrapper[5120]: I0316 17:04:58.127416 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b2d5e452-345a-44a8-9565-819d12354734-scripts" (OuterVolumeSpecName: "scripts") pod "b2d5e452-345a-44a8-9565-819d12354734" (UID: "b2d5e452-345a-44a8-9565-819d12354734"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:04:58 crc kubenswrapper[5120]: I0316 17:04:58.138026 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2d5e452-345a-44a8-9565-819d12354734-kube-api-access-zhhzl" (OuterVolumeSpecName: "kube-api-access-zhhzl") pod "b2d5e452-345a-44a8-9565-819d12354734" (UID: "b2d5e452-345a-44a8-9565-819d12354734"). InnerVolumeSpecName "kube-api-access-zhhzl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:04:58 crc kubenswrapper[5120]: I0316 17:04:58.148374 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-worker-9f6dcd6cf-pldhd"] Mar 16 17:04:58 crc kubenswrapper[5120]: I0316 17:04:58.149913 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b2d5e452-345a-44a8-9565-819d12354734-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "b2d5e452-345a-44a8-9565-819d12354734" (UID: "b2d5e452-345a-44a8-9565-819d12354734"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:04:58 crc kubenswrapper[5120]: I0316 17:04:58.158528 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-9f6dcd6cf-pldhd" Mar 16 17:04:58 crc kubenswrapper[5120]: I0316 17:04:58.180644 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-9f6dcd6cf-pldhd"] Mar 16 17:04:58 crc kubenswrapper[5120]: I0316 17:04:58.197444 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/06ad2651-812c-46f9-b42d-f893b573e5c5-logs\") pod \"barbican-keystone-listener-d7c955d94-2dfzr\" (UID: \"06ad2651-812c-46f9-b42d-f893b573e5c5\") " pod="openstack-kuttl-tests/barbican-keystone-listener-d7c955d94-2dfzr" Mar 16 17:04:58 crc kubenswrapper[5120]: I0316 17:04:58.201218 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/06ad2651-812c-46f9-b42d-f893b573e5c5-config-data\") pod \"barbican-keystone-listener-d7c955d94-2dfzr\" (UID: \"06ad2651-812c-46f9-b42d-f893b573e5c5\") " pod="openstack-kuttl-tests/barbican-keystone-listener-d7c955d94-2dfzr" Mar 16 17:04:58 crc kubenswrapper[5120]: I0316 17:04:58.201448 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/06ad2651-812c-46f9-b42d-f893b573e5c5-combined-ca-bundle\") pod \"barbican-keystone-listener-d7c955d94-2dfzr\" (UID: \"06ad2651-812c-46f9-b42d-f893b573e5c5\") " pod="openstack-kuttl-tests/barbican-keystone-listener-d7c955d94-2dfzr" Mar 16 17:04:58 crc kubenswrapper[5120]: I0316 17:04:58.201588 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cc25l\" (UniqueName: \"kubernetes.io/projected/06ad2651-812c-46f9-b42d-f893b573e5c5-kube-api-access-cc25l\") pod \"barbican-keystone-listener-d7c955d94-2dfzr\" (UID: \"06ad2651-812c-46f9-b42d-f893b573e5c5\") " pod="openstack-kuttl-tests/barbican-keystone-listener-d7c955d94-2dfzr" Mar 16 17:04:58 crc kubenswrapper[5120]: I0316 17:04:58.201750 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/06ad2651-812c-46f9-b42d-f893b573e5c5-config-data-custom\") pod \"barbican-keystone-listener-d7c955d94-2dfzr\" (UID: \"06ad2651-812c-46f9-b42d-f893b573e5c5\") " pod="openstack-kuttl-tests/barbican-keystone-listener-d7c955d94-2dfzr" Mar 16 17:04:58 crc kubenswrapper[5120]: I0316 17:04:58.202229 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b2d5e452-345a-44a8-9565-819d12354734-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:04:58 crc kubenswrapper[5120]: I0316 17:04:58.202253 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b2d5e452-345a-44a8-9565-819d12354734-logs\") on node \"crc\" DevicePath \"\"" Mar 16 17:04:58 crc kubenswrapper[5120]: I0316 17:04:58.202292 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zhhzl\" (UniqueName: \"kubernetes.io/projected/b2d5e452-345a-44a8-9565-819d12354734-kube-api-access-zhhzl\") on node \"crc\" DevicePath \"\"" Mar 16 17:04:58 crc kubenswrapper[5120]: I0316 17:04:58.202307 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/b2d5e452-345a-44a8-9565-819d12354734-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 17:04:58 crc kubenswrapper[5120]: I0316 17:04:58.202319 5120 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/b2d5e452-345a-44a8-9565-819d12354734-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 17:04:58 crc kubenswrapper[5120]: I0316 17:04:58.257710 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-api-b95589884-bsqwd"] Mar 16 17:04:58 crc kubenswrapper[5120]: I0316 17:04:58.266968 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-b95589884-bsqwd" Mar 16 17:04:58 crc kubenswrapper[5120]: I0316 17:04:58.272319 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-barbican-internal-svc\"" Mar 16 17:04:58 crc kubenswrapper[5120]: I0316 17:04:58.273056 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-barbican-public-svc\"" Mar 16 17:04:58 crc kubenswrapper[5120]: I0316 17:04:58.323145 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-b95589884-bsqwd"] Mar 16 17:04:58 crc kubenswrapper[5120]: I0316 17:04:58.331389 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b2d5e452-345a-44a8-9565-819d12354734-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "b2d5e452-345a-44a8-9565-819d12354734" (UID: "b2d5e452-345a-44a8-9565-819d12354734"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:04:58 crc kubenswrapper[5120]: I0316 17:04:58.335185 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/040d2221-969e-4e00-8097-340b3c4a1b43-internal-tls-certs\") pod \"barbican-api-b95589884-bsqwd\" (UID: \"040d2221-969e-4e00-8097-340b3c4a1b43\") " pod="openstack-kuttl-tests/barbican-api-b95589884-bsqwd" Mar 16 17:04:58 crc kubenswrapper[5120]: I0316 17:04:58.335563 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7590c7f4-950a-41b1-889b-359a9a608f4f-config-data\") pod \"barbican-worker-9f6dcd6cf-pldhd\" (UID: \"7590c7f4-950a-41b1-889b-359a9a608f4f\") " pod="openstack-kuttl-tests/barbican-worker-9f6dcd6cf-pldhd" Mar 16 17:04:58 crc kubenswrapper[5120]: I0316 17:04:58.335852 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/06ad2651-812c-46f9-b42d-f893b573e5c5-config-data\") pod \"barbican-keystone-listener-d7c955d94-2dfzr\" (UID: \"06ad2651-812c-46f9-b42d-f893b573e5c5\") " pod="openstack-kuttl-tests/barbican-keystone-listener-d7c955d94-2dfzr" Mar 16 17:04:58 crc kubenswrapper[5120]: I0316 17:04:58.336862 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/040d2221-969e-4e00-8097-340b3c4a1b43-public-tls-certs\") pod \"barbican-api-b95589884-bsqwd\" (UID: \"040d2221-969e-4e00-8097-340b3c4a1b43\") " pod="openstack-kuttl-tests/barbican-api-b95589884-bsqwd" Mar 16 17:04:58 crc kubenswrapper[5120]: I0316 17:04:58.337085 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxdsl\" (UniqueName: \"kubernetes.io/projected/7590c7f4-950a-41b1-889b-359a9a608f4f-kube-api-access-qxdsl\") pod \"barbican-worker-9f6dcd6cf-pldhd\" (UID: \"7590c7f4-950a-41b1-889b-359a9a608f4f\") " pod="openstack-kuttl-tests/barbican-worker-9f6dcd6cf-pldhd" Mar 16 17:04:58 crc kubenswrapper[5120]: I0316 17:04:58.337231 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/06ad2651-812c-46f9-b42d-f893b573e5c5-combined-ca-bundle\") pod \"barbican-keystone-listener-d7c955d94-2dfzr\" (UID: \"06ad2651-812c-46f9-b42d-f893b573e5c5\") " pod="openstack-kuttl-tests/barbican-keystone-listener-d7c955d94-2dfzr" Mar 16 17:04:58 crc kubenswrapper[5120]: I0316 17:04:58.337410 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/040d2221-969e-4e00-8097-340b3c4a1b43-logs\") pod \"barbican-api-b95589884-bsqwd\" (UID: \"040d2221-969e-4e00-8097-340b3c4a1b43\") " pod="openstack-kuttl-tests/barbican-api-b95589884-bsqwd" Mar 16 17:04:58 crc kubenswrapper[5120]: I0316 17:04:58.337529 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/040d2221-969e-4e00-8097-340b3c4a1b43-config-data-custom\") pod \"barbican-api-b95589884-bsqwd\" (UID: \"040d2221-969e-4e00-8097-340b3c4a1b43\") " pod="openstack-kuttl-tests/barbican-api-b95589884-bsqwd" Mar 16 17:04:58 crc kubenswrapper[5120]: I0316 17:04:58.337701 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cc25l\" (UniqueName: \"kubernetes.io/projected/06ad2651-812c-46f9-b42d-f893b573e5c5-kube-api-access-cc25l\") pod \"barbican-keystone-listener-d7c955d94-2dfzr\" (UID: \"06ad2651-812c-46f9-b42d-f893b573e5c5\") " pod="openstack-kuttl-tests/barbican-keystone-listener-d7c955d94-2dfzr" Mar 16 17:04:58 crc kubenswrapper[5120]: I0316 17:04:58.338018 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/040d2221-969e-4e00-8097-340b3c4a1b43-config-data\") pod \"barbican-api-b95589884-bsqwd\" (UID: \"040d2221-969e-4e00-8097-340b3c4a1b43\") " pod="openstack-kuttl-tests/barbican-api-b95589884-bsqwd" Mar 16 17:04:58 crc kubenswrapper[5120]: I0316 17:04:58.338161 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/06ad2651-812c-46f9-b42d-f893b573e5c5-config-data-custom\") pod \"barbican-keystone-listener-d7c955d94-2dfzr\" (UID: \"06ad2651-812c-46f9-b42d-f893b573e5c5\") " pod="openstack-kuttl-tests/barbican-keystone-listener-d7c955d94-2dfzr" Mar 16 17:04:58 crc kubenswrapper[5120]: I0316 17:04:58.338337 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7590c7f4-950a-41b1-889b-359a9a608f4f-combined-ca-bundle\") pod \"barbican-worker-9f6dcd6cf-pldhd\" (UID: \"7590c7f4-950a-41b1-889b-359a9a608f4f\") " pod="openstack-kuttl-tests/barbican-worker-9f6dcd6cf-pldhd" Mar 16 17:04:58 crc kubenswrapper[5120]: I0316 17:04:58.338462 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/7590c7f4-950a-41b1-889b-359a9a608f4f-config-data-custom\") pod \"barbican-worker-9f6dcd6cf-pldhd\" (UID: \"7590c7f4-950a-41b1-889b-359a9a608f4f\") " pod="openstack-kuttl-tests/barbican-worker-9f6dcd6cf-pldhd" Mar 16 17:04:58 crc kubenswrapper[5120]: I0316 17:04:58.338571 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7590c7f4-950a-41b1-889b-359a9a608f4f-logs\") pod \"barbican-worker-9f6dcd6cf-pldhd\" (UID: \"7590c7f4-950a-41b1-889b-359a9a608f4f\") " pod="openstack-kuttl-tests/barbican-worker-9f6dcd6cf-pldhd" Mar 16 17:04:58 crc kubenswrapper[5120]: I0316 17:04:58.338791 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/040d2221-969e-4e00-8097-340b3c4a1b43-combined-ca-bundle\") pod \"barbican-api-b95589884-bsqwd\" (UID: \"040d2221-969e-4e00-8097-340b3c4a1b43\") " pod="openstack-kuttl-tests/barbican-api-b95589884-bsqwd" Mar 16 17:04:58 crc kubenswrapper[5120]: I0316 17:04:58.338987 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/06ad2651-812c-46f9-b42d-f893b573e5c5-logs\") pod \"barbican-keystone-listener-d7c955d94-2dfzr\" (UID: \"06ad2651-812c-46f9-b42d-f893b573e5c5\") " pod="openstack-kuttl-tests/barbican-keystone-listener-d7c955d94-2dfzr" Mar 16 17:04:58 crc kubenswrapper[5120]: I0316 17:04:58.339103 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lct49\" (UniqueName: \"kubernetes.io/projected/040d2221-969e-4e00-8097-340b3c4a1b43-kube-api-access-lct49\") pod \"barbican-api-b95589884-bsqwd\" (UID: \"040d2221-969e-4e00-8097-340b3c4a1b43\") " pod="openstack-kuttl-tests/barbican-api-b95589884-bsqwd" Mar 16 17:04:58 crc kubenswrapper[5120]: I0316 17:04:58.339401 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b2d5e452-345a-44a8-9565-819d12354734-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:04:58 crc kubenswrapper[5120]: I0316 17:04:58.335332 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b2d5e452-345a-44a8-9565-819d12354734-config-data" (OuterVolumeSpecName: "config-data") pod "b2d5e452-345a-44a8-9565-819d12354734" (UID: "b2d5e452-345a-44a8-9565-819d12354734"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:04:58 crc kubenswrapper[5120]: I0316 17:04:58.341643 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/06ad2651-812c-46f9-b42d-f893b573e5c5-logs\") pod \"barbican-keystone-listener-d7c955d94-2dfzr\" (UID: \"06ad2651-812c-46f9-b42d-f893b573e5c5\") " pod="openstack-kuttl-tests/barbican-keystone-listener-d7c955d94-2dfzr" Mar 16 17:04:58 crc kubenswrapper[5120]: I0316 17:04:58.365201 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cc25l\" (UniqueName: \"kubernetes.io/projected/06ad2651-812c-46f9-b42d-f893b573e5c5-kube-api-access-cc25l\") pod \"barbican-keystone-listener-d7c955d94-2dfzr\" (UID: \"06ad2651-812c-46f9-b42d-f893b573e5c5\") " pod="openstack-kuttl-tests/barbican-keystone-listener-d7c955d94-2dfzr" Mar 16 17:04:58 crc kubenswrapper[5120]: I0316 17:04:58.383162 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/06ad2651-812c-46f9-b42d-f893b573e5c5-config-data\") pod \"barbican-keystone-listener-d7c955d94-2dfzr\" (UID: \"06ad2651-812c-46f9-b42d-f893b573e5c5\") " pod="openstack-kuttl-tests/barbican-keystone-listener-d7c955d94-2dfzr" Mar 16 17:04:58 crc kubenswrapper[5120]: I0316 17:04:58.400259 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:04:58 crc kubenswrapper[5120]: I0316 17:04:58.405600 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/06ad2651-812c-46f9-b42d-f893b573e5c5-config-data-custom\") pod \"barbican-keystone-listener-d7c955d94-2dfzr\" (UID: \"06ad2651-812c-46f9-b42d-f893b573e5c5\") " pod="openstack-kuttl-tests/barbican-keystone-listener-d7c955d94-2dfzr" Mar 16 17:04:58 crc kubenswrapper[5120]: I0316 17:04:58.406085 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/06ad2651-812c-46f9-b42d-f893b573e5c5-combined-ca-bundle\") pod \"barbican-keystone-listener-d7c955d94-2dfzr\" (UID: \"06ad2651-812c-46f9-b42d-f893b573e5c5\") " pod="openstack-kuttl-tests/barbican-keystone-listener-d7c955d94-2dfzr" Mar 16 17:04:58 crc kubenswrapper[5120]: I0316 17:04:58.446737 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/040d2221-969e-4e00-8097-340b3c4a1b43-logs\") pod \"barbican-api-b95589884-bsqwd\" (UID: \"040d2221-969e-4e00-8097-340b3c4a1b43\") " pod="openstack-kuttl-tests/barbican-api-b95589884-bsqwd" Mar 16 17:04:58 crc kubenswrapper[5120]: I0316 17:04:58.446968 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/040d2221-969e-4e00-8097-340b3c4a1b43-config-data-custom\") pod \"barbican-api-b95589884-bsqwd\" (UID: \"040d2221-969e-4e00-8097-340b3c4a1b43\") " pod="openstack-kuttl-tests/barbican-api-b95589884-bsqwd" Mar 16 17:04:58 crc kubenswrapper[5120]: I0316 17:04:58.447122 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/040d2221-969e-4e00-8097-340b3c4a1b43-config-data\") pod \"barbican-api-b95589884-bsqwd\" (UID: \"040d2221-969e-4e00-8097-340b3c4a1b43\") " pod="openstack-kuttl-tests/barbican-api-b95589884-bsqwd" Mar 16 17:04:58 crc kubenswrapper[5120]: I0316 17:04:58.447694 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/040d2221-969e-4e00-8097-340b3c4a1b43-logs\") pod \"barbican-api-b95589884-bsqwd\" (UID: \"040d2221-969e-4e00-8097-340b3c4a1b43\") " pod="openstack-kuttl-tests/barbican-api-b95589884-bsqwd" Mar 16 17:04:58 crc kubenswrapper[5120]: I0316 17:04:58.448215 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7590c7f4-950a-41b1-889b-359a9a608f4f-combined-ca-bundle\") pod \"barbican-worker-9f6dcd6cf-pldhd\" (UID: \"7590c7f4-950a-41b1-889b-359a9a608f4f\") " pod="openstack-kuttl-tests/barbican-worker-9f6dcd6cf-pldhd" Mar 16 17:04:58 crc kubenswrapper[5120]: I0316 17:04:58.448251 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/7590c7f4-950a-41b1-889b-359a9a608f4f-config-data-custom\") pod \"barbican-worker-9f6dcd6cf-pldhd\" (UID: \"7590c7f4-950a-41b1-889b-359a9a608f4f\") " pod="openstack-kuttl-tests/barbican-worker-9f6dcd6cf-pldhd" Mar 16 17:04:58 crc kubenswrapper[5120]: I0316 17:04:58.448678 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7590c7f4-950a-41b1-889b-359a9a608f4f-logs\") pod \"barbican-worker-9f6dcd6cf-pldhd\" (UID: \"7590c7f4-950a-41b1-889b-359a9a608f4f\") " pod="openstack-kuttl-tests/barbican-worker-9f6dcd6cf-pldhd" Mar 16 17:04:58 crc kubenswrapper[5120]: I0316 17:04:58.449071 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7590c7f4-950a-41b1-889b-359a9a608f4f-logs\") pod \"barbican-worker-9f6dcd6cf-pldhd\" (UID: \"7590c7f4-950a-41b1-889b-359a9a608f4f\") " pod="openstack-kuttl-tests/barbican-worker-9f6dcd6cf-pldhd" Mar 16 17:04:58 crc kubenswrapper[5120]: I0316 17:04:58.449185 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/040d2221-969e-4e00-8097-340b3c4a1b43-combined-ca-bundle\") pod \"barbican-api-b95589884-bsqwd\" (UID: \"040d2221-969e-4e00-8097-340b3c4a1b43\") " pod="openstack-kuttl-tests/barbican-api-b95589884-bsqwd" Mar 16 17:04:58 crc kubenswrapper[5120]: I0316 17:04:58.449526 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lct49\" (UniqueName: \"kubernetes.io/projected/040d2221-969e-4e00-8097-340b3c4a1b43-kube-api-access-lct49\") pod \"barbican-api-b95589884-bsqwd\" (UID: \"040d2221-969e-4e00-8097-340b3c4a1b43\") " pod="openstack-kuttl-tests/barbican-api-b95589884-bsqwd" Mar 16 17:04:58 crc kubenswrapper[5120]: I0316 17:04:58.449718 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/040d2221-969e-4e00-8097-340b3c4a1b43-internal-tls-certs\") pod \"barbican-api-b95589884-bsqwd\" (UID: \"040d2221-969e-4e00-8097-340b3c4a1b43\") " pod="openstack-kuttl-tests/barbican-api-b95589884-bsqwd" Mar 16 17:04:58 crc kubenswrapper[5120]: I0316 17:04:58.449906 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7590c7f4-950a-41b1-889b-359a9a608f4f-config-data\") pod \"barbican-worker-9f6dcd6cf-pldhd\" (UID: \"7590c7f4-950a-41b1-889b-359a9a608f4f\") " pod="openstack-kuttl-tests/barbican-worker-9f6dcd6cf-pldhd" Mar 16 17:04:58 crc kubenswrapper[5120]: I0316 17:04:58.450241 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/040d2221-969e-4e00-8097-340b3c4a1b43-public-tls-certs\") pod \"barbican-api-b95589884-bsqwd\" (UID: \"040d2221-969e-4e00-8097-340b3c4a1b43\") " pod="openstack-kuttl-tests/barbican-api-b95589884-bsqwd" Mar 16 17:04:58 crc kubenswrapper[5120]: I0316 17:04:58.450357 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qxdsl\" (UniqueName: \"kubernetes.io/projected/7590c7f4-950a-41b1-889b-359a9a608f4f-kube-api-access-qxdsl\") pod \"barbican-worker-9f6dcd6cf-pldhd\" (UID: \"7590c7f4-950a-41b1-889b-359a9a608f4f\") " pod="openstack-kuttl-tests/barbican-worker-9f6dcd6cf-pldhd" Mar 16 17:04:58 crc kubenswrapper[5120]: I0316 17:04:58.450516 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b2d5e452-345a-44a8-9565-819d12354734-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:04:58 crc kubenswrapper[5120]: I0316 17:04:58.452660 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/040d2221-969e-4e00-8097-340b3c4a1b43-config-data-custom\") pod \"barbican-api-b95589884-bsqwd\" (UID: \"040d2221-969e-4e00-8097-340b3c4a1b43\") " pod="openstack-kuttl-tests/barbican-api-b95589884-bsqwd" Mar 16 17:04:58 crc kubenswrapper[5120]: I0316 17:04:58.455351 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/040d2221-969e-4e00-8097-340b3c4a1b43-internal-tls-certs\") pod \"barbican-api-b95589884-bsqwd\" (UID: \"040d2221-969e-4e00-8097-340b3c4a1b43\") " pod="openstack-kuttl-tests/barbican-api-b95589884-bsqwd" Mar 16 17:04:58 crc kubenswrapper[5120]: I0316 17:04:58.455370 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/040d2221-969e-4e00-8097-340b3c4a1b43-public-tls-certs\") pod \"barbican-api-b95589884-bsqwd\" (UID: \"040d2221-969e-4e00-8097-340b3c4a1b43\") " pod="openstack-kuttl-tests/barbican-api-b95589884-bsqwd" Mar 16 17:04:58 crc kubenswrapper[5120]: I0316 17:04:58.455713 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/040d2221-969e-4e00-8097-340b3c4a1b43-combined-ca-bundle\") pod \"barbican-api-b95589884-bsqwd\" (UID: \"040d2221-969e-4e00-8097-340b3c4a1b43\") " pod="openstack-kuttl-tests/barbican-api-b95589884-bsqwd" Mar 16 17:04:58 crc kubenswrapper[5120]: I0316 17:04:58.460184 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/7590c7f4-950a-41b1-889b-359a9a608f4f-config-data-custom\") pod \"barbican-worker-9f6dcd6cf-pldhd\" (UID: \"7590c7f4-950a-41b1-889b-359a9a608f4f\") " pod="openstack-kuttl-tests/barbican-worker-9f6dcd6cf-pldhd" Mar 16 17:04:58 crc kubenswrapper[5120]: I0316 17:04:58.461356 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7590c7f4-950a-41b1-889b-359a9a608f4f-config-data\") pod \"barbican-worker-9f6dcd6cf-pldhd\" (UID: \"7590c7f4-950a-41b1-889b-359a9a608f4f\") " pod="openstack-kuttl-tests/barbican-worker-9f6dcd6cf-pldhd" Mar 16 17:04:58 crc kubenswrapper[5120]: I0316 17:04:58.463972 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/040d2221-969e-4e00-8097-340b3c4a1b43-config-data\") pod \"barbican-api-b95589884-bsqwd\" (UID: \"040d2221-969e-4e00-8097-340b3c4a1b43\") " pod="openstack-kuttl-tests/barbican-api-b95589884-bsqwd" Mar 16 17:04:58 crc kubenswrapper[5120]: I0316 17:04:58.476810 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7590c7f4-950a-41b1-889b-359a9a608f4f-combined-ca-bundle\") pod \"barbican-worker-9f6dcd6cf-pldhd\" (UID: \"7590c7f4-950a-41b1-889b-359a9a608f4f\") " pod="openstack-kuttl-tests/barbican-worker-9f6dcd6cf-pldhd" Mar 16 17:04:58 crc kubenswrapper[5120]: I0316 17:04:58.491352 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lct49\" (UniqueName: \"kubernetes.io/projected/040d2221-969e-4e00-8097-340b3c4a1b43-kube-api-access-lct49\") pod \"barbican-api-b95589884-bsqwd\" (UID: \"040d2221-969e-4e00-8097-340b3c4a1b43\") " pod="openstack-kuttl-tests/barbican-api-b95589884-bsqwd" Mar 16 17:04:58 crc kubenswrapper[5120]: I0316 17:04:58.493634 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxdsl\" (UniqueName: \"kubernetes.io/projected/7590c7f4-950a-41b1-889b-359a9a608f4f-kube-api-access-qxdsl\") pod \"barbican-worker-9f6dcd6cf-pldhd\" (UID: \"7590c7f4-950a-41b1-889b-359a9a608f4f\") " pod="openstack-kuttl-tests/barbican-worker-9f6dcd6cf-pldhd" Mar 16 17:04:58 crc kubenswrapper[5120]: I0316 17:04:58.633531 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-d7c955d94-2dfzr" Mar 16 17:04:58 crc kubenswrapper[5120]: I0316 17:04:58.661382 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-9f6dcd6cf-pldhd" Mar 16 17:04:58 crc kubenswrapper[5120]: I0316 17:04:58.679129 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-b95589884-bsqwd" Mar 16 17:04:58 crc kubenswrapper[5120]: I0316 17:04:58.690959 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a9e1bfc3-4b43-41e4-af96-bba09e1c74b3" path="/var/lib/kubelet/pods/a9e1bfc3-4b43-41e4-af96-bba09e1c74b3/volumes" Mar 16 17:04:58 crc kubenswrapper[5120]: I0316 17:04:58.767860 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-5bb4df7ffd-xw448" event={"ID":"aadf64b4-9c41-4b13-be3a-4bb9172d06dd","Type":"ContainerStarted","Data":"56403faf32f68846ceae22cf5e25eefebe5388a2c426b29ce462eac8315a559e"} Mar 16 17:04:58 crc kubenswrapper[5120]: I0316 17:04:58.767927 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-5bb4df7ffd-xw448" event={"ID":"aadf64b4-9c41-4b13-be3a-4bb9172d06dd","Type":"ContainerStarted","Data":"e889b6079176a26b38518263cbd9407b29fe9fbee04a202abc8bc8162dac1395"} Mar 16 17:04:58 crc kubenswrapper[5120]: I0316 17:04:58.770527 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"b0e290e3-0e59-4d06-950e-c679ec283a0b","Type":"ContainerStarted","Data":"037c57477557d2f28f1066843fc3a09f5c5bed5e1f52c00f28137f51feec8780"} Mar 16 17:04:58 crc kubenswrapper[5120]: I0316 17:04:58.778227 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:04:58 crc kubenswrapper[5120]: I0316 17:04:58.779647 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"b2d5e452-345a-44a8-9565-819d12354734","Type":"ContainerDied","Data":"5a16d22407432abb9b778257b4dd531cefb393f652552bd61420666dcaa31379"} Mar 16 17:04:58 crc kubenswrapper[5120]: I0316 17:04:58.779693 5120 scope.go:117] "RemoveContainer" containerID="fb37ee080652aa183bb7e68b17e6e29ceeb7fa51994a6aeb0fcd1ee639ee1f3e" Mar 16 17:04:58 crc kubenswrapper[5120]: I0316 17:04:58.836194 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 17:04:58 crc kubenswrapper[5120]: I0316 17:04:58.870844 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 17:04:58 crc kubenswrapper[5120]: I0316 17:04:58.891534 5120 scope.go:117] "RemoveContainer" containerID="e7f311842b759e2d57b9a0080f778a8a633c00c1a97ef3a69c697995305b3871" Mar 16 17:04:58 crc kubenswrapper[5120]: I0316 17:04:58.892300 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 17:04:58 crc kubenswrapper[5120]: I0316 17:04:58.906243 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:04:58 crc kubenswrapper[5120]: I0316 17:04:58.907341 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 17:04:58 crc kubenswrapper[5120]: I0316 17:04:58.908388 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-api-config-data\"" Mar 16 17:04:58 crc kubenswrapper[5120]: I0316 17:04:58.910023 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-cinder-internal-svc\"" Mar 16 17:04:58 crc kubenswrapper[5120]: I0316 17:04:58.913821 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-cinder-public-svc\"" Mar 16 17:04:58 crc kubenswrapper[5120]: I0316 17:04:58.976337 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0156f10b-e51f-4ce8-a414-e6339cd30530-logs\") pod \"cinder-api-0\" (UID: \"0156f10b-e51f-4ce8-a414-e6339cd30530\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:04:58 crc kubenswrapper[5120]: I0316 17:04:58.976408 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0156f10b-e51f-4ce8-a414-e6339cd30530-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"0156f10b-e51f-4ce8-a414-e6339cd30530\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:04:58 crc kubenswrapper[5120]: I0316 17:04:58.976486 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/0156f10b-e51f-4ce8-a414-e6339cd30530-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"0156f10b-e51f-4ce8-a414-e6339cd30530\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:04:58 crc kubenswrapper[5120]: I0316 17:04:58.976506 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxsqw\" (UniqueName: \"kubernetes.io/projected/0156f10b-e51f-4ce8-a414-e6339cd30530-kube-api-access-cxsqw\") pod \"cinder-api-0\" (UID: \"0156f10b-e51f-4ce8-a414-e6339cd30530\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:04:58 crc kubenswrapper[5120]: I0316 17:04:58.976549 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/0156f10b-e51f-4ce8-a414-e6339cd30530-public-tls-certs\") pod \"cinder-api-0\" (UID: \"0156f10b-e51f-4ce8-a414-e6339cd30530\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:04:58 crc kubenswrapper[5120]: I0316 17:04:58.976660 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/0156f10b-e51f-4ce8-a414-e6339cd30530-etc-machine-id\") pod \"cinder-api-0\" (UID: \"0156f10b-e51f-4ce8-a414-e6339cd30530\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:04:58 crc kubenswrapper[5120]: I0316 17:04:58.976690 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0156f10b-e51f-4ce8-a414-e6339cd30530-config-data\") pod \"cinder-api-0\" (UID: \"0156f10b-e51f-4ce8-a414-e6339cd30530\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:04:58 crc kubenswrapper[5120]: I0316 17:04:58.976728 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/0156f10b-e51f-4ce8-a414-e6339cd30530-config-data-custom\") pod \"cinder-api-0\" (UID: \"0156f10b-e51f-4ce8-a414-e6339cd30530\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:04:58 crc kubenswrapper[5120]: I0316 17:04:58.976902 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0156f10b-e51f-4ce8-a414-e6339cd30530-scripts\") pod \"cinder-api-0\" (UID: \"0156f10b-e51f-4ce8-a414-e6339cd30530\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:04:59 crc kubenswrapper[5120]: I0316 17:04:59.081282 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0156f10b-e51f-4ce8-a414-e6339cd30530-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"0156f10b-e51f-4ce8-a414-e6339cd30530\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:04:59 crc kubenswrapper[5120]: I0316 17:04:59.081775 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/0156f10b-e51f-4ce8-a414-e6339cd30530-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"0156f10b-e51f-4ce8-a414-e6339cd30530\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:04:59 crc kubenswrapper[5120]: I0316 17:04:59.081805 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cxsqw\" (UniqueName: \"kubernetes.io/projected/0156f10b-e51f-4ce8-a414-e6339cd30530-kube-api-access-cxsqw\") pod \"cinder-api-0\" (UID: \"0156f10b-e51f-4ce8-a414-e6339cd30530\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:04:59 crc kubenswrapper[5120]: I0316 17:04:59.081858 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/0156f10b-e51f-4ce8-a414-e6339cd30530-public-tls-certs\") pod \"cinder-api-0\" (UID: \"0156f10b-e51f-4ce8-a414-e6339cd30530\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:04:59 crc kubenswrapper[5120]: I0316 17:04:59.081952 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/0156f10b-e51f-4ce8-a414-e6339cd30530-etc-machine-id\") pod \"cinder-api-0\" (UID: \"0156f10b-e51f-4ce8-a414-e6339cd30530\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:04:59 crc kubenswrapper[5120]: I0316 17:04:59.081979 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0156f10b-e51f-4ce8-a414-e6339cd30530-config-data\") pod \"cinder-api-0\" (UID: \"0156f10b-e51f-4ce8-a414-e6339cd30530\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:04:59 crc kubenswrapper[5120]: I0316 17:04:59.082008 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/0156f10b-e51f-4ce8-a414-e6339cd30530-config-data-custom\") pod \"cinder-api-0\" (UID: \"0156f10b-e51f-4ce8-a414-e6339cd30530\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:04:59 crc kubenswrapper[5120]: I0316 17:04:59.082097 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0156f10b-e51f-4ce8-a414-e6339cd30530-scripts\") pod \"cinder-api-0\" (UID: \"0156f10b-e51f-4ce8-a414-e6339cd30530\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:04:59 crc kubenswrapper[5120]: I0316 17:04:59.082278 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0156f10b-e51f-4ce8-a414-e6339cd30530-logs\") pod \"cinder-api-0\" (UID: \"0156f10b-e51f-4ce8-a414-e6339cd30530\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:04:59 crc kubenswrapper[5120]: I0316 17:04:59.082660 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0156f10b-e51f-4ce8-a414-e6339cd30530-logs\") pod \"cinder-api-0\" (UID: \"0156f10b-e51f-4ce8-a414-e6339cd30530\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:04:59 crc kubenswrapper[5120]: I0316 17:04:59.082718 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/0156f10b-e51f-4ce8-a414-e6339cd30530-etc-machine-id\") pod \"cinder-api-0\" (UID: \"0156f10b-e51f-4ce8-a414-e6339cd30530\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:04:59 crc kubenswrapper[5120]: I0316 17:04:59.088677 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/0156f10b-e51f-4ce8-a414-e6339cd30530-public-tls-certs\") pod \"cinder-api-0\" (UID: \"0156f10b-e51f-4ce8-a414-e6339cd30530\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:04:59 crc kubenswrapper[5120]: I0316 17:04:59.089705 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0156f10b-e51f-4ce8-a414-e6339cd30530-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"0156f10b-e51f-4ce8-a414-e6339cd30530\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:04:59 crc kubenswrapper[5120]: I0316 17:04:59.097724 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0156f10b-e51f-4ce8-a414-e6339cd30530-config-data\") pod \"cinder-api-0\" (UID: \"0156f10b-e51f-4ce8-a414-e6339cd30530\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:04:59 crc kubenswrapper[5120]: I0316 17:04:59.104206 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/0156f10b-e51f-4ce8-a414-e6339cd30530-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"0156f10b-e51f-4ce8-a414-e6339cd30530\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:04:59 crc kubenswrapper[5120]: I0316 17:04:59.106349 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/0156f10b-e51f-4ce8-a414-e6339cd30530-config-data-custom\") pod \"cinder-api-0\" (UID: \"0156f10b-e51f-4ce8-a414-e6339cd30530\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:04:59 crc kubenswrapper[5120]: I0316 17:04:59.107383 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0156f10b-e51f-4ce8-a414-e6339cd30530-scripts\") pod \"cinder-api-0\" (UID: \"0156f10b-e51f-4ce8-a414-e6339cd30530\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:04:59 crc kubenswrapper[5120]: I0316 17:04:59.114701 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxsqw\" (UniqueName: \"kubernetes.io/projected/0156f10b-e51f-4ce8-a414-e6339cd30530-kube-api-access-cxsqw\") pod \"cinder-api-0\" (UID: \"0156f10b-e51f-4ce8-a414-e6339cd30530\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:04:59 crc kubenswrapper[5120]: I0316 17:04:59.320469 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:04:59 crc kubenswrapper[5120]: I0316 17:04:59.365312 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-d7c955d94-2dfzr"] Mar 16 17:04:59 crc kubenswrapper[5120]: W0316 17:04:59.382799 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod06ad2651_812c_46f9_b42d_f893b573e5c5.slice/crio-9f2f3c4cd86a0c5d3b576cbfa54811c97946e1993aa4ffe5213e9fac8ce79358 WatchSource:0}: Error finding container 9f2f3c4cd86a0c5d3b576cbfa54811c97946e1993aa4ffe5213e9fac8ce79358: Status 404 returned error can't find the container with id 9f2f3c4cd86a0c5d3b576cbfa54811c97946e1993aa4ffe5213e9fac8ce79358 Mar 16 17:04:59 crc kubenswrapper[5120]: I0316 17:04:59.500201 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-9f6dcd6cf-pldhd"] Mar 16 17:04:59 crc kubenswrapper[5120]: I0316 17:04:59.515642 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-b95589884-bsqwd"] Mar 16 17:04:59 crc kubenswrapper[5120]: I0316 17:04:59.808926 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"b0e290e3-0e59-4d06-950e-c679ec283a0b","Type":"ContainerStarted","Data":"4d90c2140d1eef3f63b3dcbca1737d8f058172254b9865d71395accfda08696e"} Mar 16 17:04:59 crc kubenswrapper[5120]: I0316 17:04:59.814322 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-b95589884-bsqwd" event={"ID":"040d2221-969e-4e00-8097-340b3c4a1b43","Type":"ContainerStarted","Data":"b13a7cc96752773178f5fa8323baa006c7ceae9ccbd1738c628f2a229f9ec4ee"} Mar 16 17:04:59 crc kubenswrapper[5120]: I0316 17:04:59.820732 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-9f6dcd6cf-pldhd" event={"ID":"7590c7f4-950a-41b1-889b-359a9a608f4f","Type":"ContainerStarted","Data":"bf3899bf14e525ddd58e9d3ea348ada7026cfc5d0cc646f43b98809e7bae6fb5"} Mar 16 17:04:59 crc kubenswrapper[5120]: I0316 17:04:59.825077 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-d7c955d94-2dfzr" event={"ID":"06ad2651-812c-46f9-b42d-f893b573e5c5","Type":"ContainerStarted","Data":"8a188b7110c5836b7c80b00c9cf9f7a20f0d97e16acf0ffdf1aec16c43c6d210"} Mar 16 17:04:59 crc kubenswrapper[5120]: I0316 17:04:59.825358 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-d7c955d94-2dfzr" event={"ID":"06ad2651-812c-46f9-b42d-f893b573e5c5","Type":"ContainerStarted","Data":"9f2f3c4cd86a0c5d3b576cbfa54811c97946e1993aa4ffe5213e9fac8ce79358"} Mar 16 17:04:59 crc kubenswrapper[5120]: I0316 17:04:59.827323 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-5bb4df7ffd-xw448" event={"ID":"aadf64b4-9c41-4b13-be3a-4bb9172d06dd","Type":"ContainerStarted","Data":"eda1116ec9b84caf5116448411997d10e50f93eefcee581f8f9dab7d32c1efd2"} Mar 16 17:04:59 crc kubenswrapper[5120]: I0316 17:04:59.827609 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/neutron-5bb4df7ffd-xw448" Mar 16 17:04:59 crc kubenswrapper[5120]: I0316 17:04:59.865716 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-5bb4df7ffd-xw448" podStartSLOduration=3.865694538 podStartE2EDuration="3.865694538s" podCreationTimestamp="2026-03-16 17:04:56 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:04:59.852630408 +0000 UTC m=+5602.006562065" watchObservedRunningTime="2026-03-16 17:04:59.865694538 +0000 UTC m=+5602.019626195" Mar 16 17:04:59 crc kubenswrapper[5120]: I0316 17:04:59.892066 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 17:04:59 crc kubenswrapper[5120]: W0316 17:04:59.967277 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0156f10b_e51f_4ce8_a414_e6339cd30530.slice/crio-c9c555d9c75154f25dfbc95d1eb1d9f3cf46aa6fc7f7590fe7f2674e44e21078 WatchSource:0}: Error finding container c9c555d9c75154f25dfbc95d1eb1d9f3cf46aa6fc7f7590fe7f2674e44e21078: Status 404 returned error can't find the container with id c9c555d9c75154f25dfbc95d1eb1d9f3cf46aa6fc7f7590fe7f2674e44e21078 Mar 16 17:05:00 crc kubenswrapper[5120]: I0316 17:05:00.017779 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-79d5f46648-ptcxs" Mar 16 17:05:00 crc kubenswrapper[5120]: I0316 17:05:00.294634 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-79d5f46648-ptcxs" Mar 16 17:05:00 crc kubenswrapper[5120]: I0316 17:05:00.689269 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b2d5e452-345a-44a8-9565-819d12354734" path="/var/lib/kubelet/pods/b2d5e452-345a-44a8-9565-819d12354734/volumes" Mar 16 17:05:00 crc kubenswrapper[5120]: I0316 17:05:00.888686 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"0156f10b-e51f-4ce8-a414-e6339cd30530","Type":"ContainerStarted","Data":"c9c555d9c75154f25dfbc95d1eb1d9f3cf46aa6fc7f7590fe7f2674e44e21078"} Mar 16 17:05:00 crc kubenswrapper[5120]: I0316 17:05:00.901183 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-d7c955d94-2dfzr" event={"ID":"06ad2651-812c-46f9-b42d-f893b573e5c5","Type":"ContainerStarted","Data":"f0dafd0b50f382fac206fc5965f0bc433fa364c9262cb0c2312ba18c24331e5e"} Mar 16 17:05:00 crc kubenswrapper[5120]: I0316 17:05:00.922160 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"b0e290e3-0e59-4d06-950e-c679ec283a0b","Type":"ContainerStarted","Data":"26fedc9d06a776e7a4afc6338f3cd6eb323e61832fd0b2921a96dc91a56a705b"} Mar 16 17:05:00 crc kubenswrapper[5120]: I0316 17:05:00.935492 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-keystone-listener-d7c955d94-2dfzr" podStartSLOduration=2.93543692 podStartE2EDuration="2.93543692s" podCreationTimestamp="2026-03-16 17:04:58 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:05:00.925936397 +0000 UTC m=+5603.079868074" watchObservedRunningTime="2026-03-16 17:05:00.93543692 +0000 UTC m=+5603.089368587" Mar 16 17:05:00 crc kubenswrapper[5120]: I0316 17:05:00.958978 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-9bbf69f54-w7krh"] Mar 16 17:05:00 crc kubenswrapper[5120]: I0316 17:05:00.959251 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-9bbf69f54-w7krh" podUID="13f9ea15-8a79-4a2e-87bb-eeee5bb593ee" containerName="barbican-keystone-listener-log" containerID="cri-o://4ba10c753384bcd6c6df8154b987f5c33462bbab2b730af7b9575e307ee0f9a4" gracePeriod=30 Mar 16 17:05:00 crc kubenswrapper[5120]: I0316 17:05:00.959796 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-9bbf69f54-w7krh" podUID="13f9ea15-8a79-4a2e-87bb-eeee5bb593ee" containerName="barbican-keystone-listener" containerID="cri-o://0ca4518c674a9fcd5147789ec4f4ed26f8157453883a4e00412653726814f834" gracePeriod=30 Mar 16 17:05:00 crc kubenswrapper[5120]: I0316 17:05:00.983851 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-b95589884-bsqwd" event={"ID":"040d2221-969e-4e00-8097-340b3c4a1b43","Type":"ContainerStarted","Data":"d932a84914494f64428fea8a34e2f4f28444bbf97f75dac7e239cbfae42f21ad"} Mar 16 17:05:00 crc kubenswrapper[5120]: I0316 17:05:00.983907 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-b95589884-bsqwd" event={"ID":"040d2221-969e-4e00-8097-340b3c4a1b43","Type":"ContainerStarted","Data":"7bc5f449c2736601b6112b4a1aa0bd4ded20f0647daa7dca214d9f4a87b1e680"} Mar 16 17:05:00 crc kubenswrapper[5120]: I0316 17:05:00.984480 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-b95589884-bsqwd" Mar 16 17:05:00 crc kubenswrapper[5120]: I0316 17:05:00.984527 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-b95589884-bsqwd" Mar 16 17:05:01 crc kubenswrapper[5120]: I0316 17:05:01.018736 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-api-b95589884-bsqwd" podStartSLOduration=3.01871295 podStartE2EDuration="3.01871295s" podCreationTimestamp="2026-03-16 17:04:58 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:05:01.006152423 +0000 UTC m=+5603.160084070" watchObservedRunningTime="2026-03-16 17:05:01.01871295 +0000 UTC m=+5603.172644607" Mar 16 17:05:01 crc kubenswrapper[5120]: I0316 17:05:01.029825 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-9f6dcd6cf-pldhd" event={"ID":"7590c7f4-950a-41b1-889b-359a9a608f4f","Type":"ContainerStarted","Data":"61ae3e8283d26fa6d34d7ac17f4f91382d53380682cb2f4fdfec75d30675e77c"} Mar 16 17:05:01 crc kubenswrapper[5120]: I0316 17:05:01.029935 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-9f6dcd6cf-pldhd" event={"ID":"7590c7f4-950a-41b1-889b-359a9a608f4f","Type":"ContainerStarted","Data":"033fe6dfc023fa648951152496fd38bf04fae7e6660b02f0bb4af884e0f1fe54"} Mar 16 17:05:01 crc kubenswrapper[5120]: I0316 17:05:01.063360 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-worker-9f6dcd6cf-pldhd" podStartSLOduration=3.063337503 podStartE2EDuration="3.063337503s" podCreationTimestamp="2026-03-16 17:04:58 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:05:01.051014842 +0000 UTC m=+5603.204946499" watchObservedRunningTime="2026-03-16 17:05:01.063337503 +0000 UTC m=+5603.217269160" Mar 16 17:05:01 crc kubenswrapper[5120]: I0316 17:05:01.173403 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-86c6c867c-6rtwz"] Mar 16 17:05:01 crc kubenswrapper[5120]: I0316 17:05:01.173705 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-86c6c867c-6rtwz" podUID="9a8dcc05-35bc-4bcd-9e33-b90543374049" containerName="barbican-worker-log" containerID="cri-o://85cb67abb8b62ca3bf3b6b7226041ce7d719f7c8727b9d274261d3e8c0b391c2" gracePeriod=30 Mar 16 17:05:01 crc kubenswrapper[5120]: I0316 17:05:01.174294 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-86c6c867c-6rtwz" podUID="9a8dcc05-35bc-4bcd-9e33-b90543374049" containerName="barbican-worker" containerID="cri-o://e53c17a81540e6c5cdc9f087ef3483a478ca22c0ec3e5f339b6016a47c3cf5d9" gracePeriod=30 Mar 16 17:05:01 crc kubenswrapper[5120]: I0316 17:05:01.655157 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:05:01 crc kubenswrapper[5120]: I0316 17:05:01.733352 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 17:05:02 crc kubenswrapper[5120]: I0316 17:05:02.044102 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"0156f10b-e51f-4ce8-a414-e6339cd30530","Type":"ContainerStarted","Data":"0dfc84e67d0d7f257d495c814e97c5fa6984e88ce792fe5da46f735a6735d0dd"} Mar 16 17:05:02 crc kubenswrapper[5120]: I0316 17:05:02.049222 5120 generic.go:358] "Generic (PLEG): container finished" podID="13f9ea15-8a79-4a2e-87bb-eeee5bb593ee" containerID="4ba10c753384bcd6c6df8154b987f5c33462bbab2b730af7b9575e307ee0f9a4" exitCode=143 Mar 16 17:05:02 crc kubenswrapper[5120]: I0316 17:05:02.049321 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-9bbf69f54-w7krh" event={"ID":"13f9ea15-8a79-4a2e-87bb-eeee5bb593ee","Type":"ContainerDied","Data":"4ba10c753384bcd6c6df8154b987f5c33462bbab2b730af7b9575e307ee0f9a4"} Mar 16 17:05:02 crc kubenswrapper[5120]: I0316 17:05:02.053704 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"b0e290e3-0e59-4d06-950e-c679ec283a0b","Type":"ContainerStarted","Data":"2cf359425be6824b5a27038264e5f716e735cef7527a6305370e54b52ba77edf"} Mar 16 17:05:02 crc kubenswrapper[5120]: I0316 17:05:02.061102 5120 generic.go:358] "Generic (PLEG): container finished" podID="9a8dcc05-35bc-4bcd-9e33-b90543374049" containerID="85cb67abb8b62ca3bf3b6b7226041ce7d719f7c8727b9d274261d3e8c0b391c2" exitCode=143 Mar 16 17:05:02 crc kubenswrapper[5120]: I0316 17:05:02.061158 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-86c6c867c-6rtwz" event={"ID":"9a8dcc05-35bc-4bcd-9e33-b90543374049","Type":"ContainerDied","Data":"85cb67abb8b62ca3bf3b6b7226041ce7d719f7c8727b9d274261d3e8c0b391c2"} Mar 16 17:05:02 crc kubenswrapper[5120]: I0316 17:05:02.061895 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="d6321014-00e1-45b6-a60b-777fade8e877" containerName="cinder-scheduler" containerID="cri-o://01fbebd9c4cb489491d921e6832b1ae0c35350f3906fa4b6a6d70a5b654c439f" gracePeriod=30 Mar 16 17:05:02 crc kubenswrapper[5120]: I0316 17:05:02.062415 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="d6321014-00e1-45b6-a60b-777fade8e877" containerName="probe" containerID="cri-o://2eb8bab7956008f7ef95a842379b5930514b2b0af917b496712706bf21712297" gracePeriod=30 Mar 16 17:05:03 crc kubenswrapper[5120]: I0316 17:05:03.075852 5120 generic.go:358] "Generic (PLEG): container finished" podID="d6321014-00e1-45b6-a60b-777fade8e877" containerID="2eb8bab7956008f7ef95a842379b5930514b2b0af917b496712706bf21712297" exitCode=0 Mar 16 17:05:03 crc kubenswrapper[5120]: I0316 17:05:03.075909 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"d6321014-00e1-45b6-a60b-777fade8e877","Type":"ContainerDied","Data":"2eb8bab7956008f7ef95a842379b5930514b2b0af917b496712706bf21712297"} Mar 16 17:05:03 crc kubenswrapper[5120]: I0316 17:05:03.078815 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"0156f10b-e51f-4ce8-a414-e6339cd30530","Type":"ContainerStarted","Data":"4feffabf29873c38fc600009dba2873008f7c996513320da07ca2954a6024344"} Mar 16 17:05:03 crc kubenswrapper[5120]: I0316 17:05:03.078891 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:05:03 crc kubenswrapper[5120]: I0316 17:05:03.107307 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-api-0" podStartSLOduration=5.107286738 podStartE2EDuration="5.107286738s" podCreationTimestamp="2026-03-16 17:04:58 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:05:03.103446811 +0000 UTC m=+5605.257378478" watchObservedRunningTime="2026-03-16 17:05:03.107286738 +0000 UTC m=+5605.261218395" Mar 16 17:05:04 crc kubenswrapper[5120]: I0316 17:05:04.090833 5120 generic.go:358] "Generic (PLEG): container finished" podID="d6321014-00e1-45b6-a60b-777fade8e877" containerID="01fbebd9c4cb489491d921e6832b1ae0c35350f3906fa4b6a6d70a5b654c439f" exitCode=0 Mar 16 17:05:04 crc kubenswrapper[5120]: I0316 17:05:04.090902 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"d6321014-00e1-45b6-a60b-777fade8e877","Type":"ContainerDied","Data":"01fbebd9c4cb489491d921e6832b1ae0c35350f3906fa4b6a6d70a5b654c439f"} Mar 16 17:05:04 crc kubenswrapper[5120]: I0316 17:05:04.091015 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"d6321014-00e1-45b6-a60b-777fade8e877","Type":"ContainerDied","Data":"da0946bfeea07d374a41a7c98607c6a40f5993651f18ff4436479c6d22c58c37"} Mar 16 17:05:04 crc kubenswrapper[5120]: I0316 17:05:04.091031 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="da0946bfeea07d374a41a7c98607c6a40f5993651f18ff4436479c6d22c58c37" Mar 16 17:05:04 crc kubenswrapper[5120]: I0316 17:05:04.091187 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:05:04 crc kubenswrapper[5120]: I0316 17:05:04.255515 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/d6321014-00e1-45b6-a60b-777fade8e877-config-data-custom\") pod \"d6321014-00e1-45b6-a60b-777fade8e877\" (UID: \"d6321014-00e1-45b6-a60b-777fade8e877\") " Mar 16 17:05:04 crc kubenswrapper[5120]: I0316 17:05:04.256788 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/d6321014-00e1-45b6-a60b-777fade8e877-etc-machine-id\") pod \"d6321014-00e1-45b6-a60b-777fade8e877\" (UID: \"d6321014-00e1-45b6-a60b-777fade8e877\") " Mar 16 17:05:04 crc kubenswrapper[5120]: I0316 17:05:04.256817 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fkg98\" (UniqueName: \"kubernetes.io/projected/d6321014-00e1-45b6-a60b-777fade8e877-kube-api-access-fkg98\") pod \"d6321014-00e1-45b6-a60b-777fade8e877\" (UID: \"d6321014-00e1-45b6-a60b-777fade8e877\") " Mar 16 17:05:04 crc kubenswrapper[5120]: I0316 17:05:04.256937 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d6321014-00e1-45b6-a60b-777fade8e877-combined-ca-bundle\") pod \"d6321014-00e1-45b6-a60b-777fade8e877\" (UID: \"d6321014-00e1-45b6-a60b-777fade8e877\") " Mar 16 17:05:04 crc kubenswrapper[5120]: I0316 17:05:04.257013 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/d6321014-00e1-45b6-a60b-777fade8e877-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "d6321014-00e1-45b6-a60b-777fade8e877" (UID: "d6321014-00e1-45b6-a60b-777fade8e877"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 17:05:04 crc kubenswrapper[5120]: I0316 17:05:04.257065 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d6321014-00e1-45b6-a60b-777fade8e877-config-data\") pod \"d6321014-00e1-45b6-a60b-777fade8e877\" (UID: \"d6321014-00e1-45b6-a60b-777fade8e877\") " Mar 16 17:05:04 crc kubenswrapper[5120]: I0316 17:05:04.257219 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d6321014-00e1-45b6-a60b-777fade8e877-scripts\") pod \"d6321014-00e1-45b6-a60b-777fade8e877\" (UID: \"d6321014-00e1-45b6-a60b-777fade8e877\") " Mar 16 17:05:04 crc kubenswrapper[5120]: I0316 17:05:04.258233 5120 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/d6321014-00e1-45b6-a60b-777fade8e877-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 17:05:04 crc kubenswrapper[5120]: I0316 17:05:04.262877 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6321014-00e1-45b6-a60b-777fade8e877-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "d6321014-00e1-45b6-a60b-777fade8e877" (UID: "d6321014-00e1-45b6-a60b-777fade8e877"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:05:04 crc kubenswrapper[5120]: I0316 17:05:04.262998 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6321014-00e1-45b6-a60b-777fade8e877-scripts" (OuterVolumeSpecName: "scripts") pod "d6321014-00e1-45b6-a60b-777fade8e877" (UID: "d6321014-00e1-45b6-a60b-777fade8e877"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:05:04 crc kubenswrapper[5120]: I0316 17:05:04.263217 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6321014-00e1-45b6-a60b-777fade8e877-kube-api-access-fkg98" (OuterVolumeSpecName: "kube-api-access-fkg98") pod "d6321014-00e1-45b6-a60b-777fade8e877" (UID: "d6321014-00e1-45b6-a60b-777fade8e877"). InnerVolumeSpecName "kube-api-access-fkg98". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:05:04 crc kubenswrapper[5120]: I0316 17:05:04.314623 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6321014-00e1-45b6-a60b-777fade8e877-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "d6321014-00e1-45b6-a60b-777fade8e877" (UID: "d6321014-00e1-45b6-a60b-777fade8e877"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:05:04 crc kubenswrapper[5120]: I0316 17:05:04.361998 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/d6321014-00e1-45b6-a60b-777fade8e877-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 17:05:04 crc kubenswrapper[5120]: I0316 17:05:04.362054 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fkg98\" (UniqueName: \"kubernetes.io/projected/d6321014-00e1-45b6-a60b-777fade8e877-kube-api-access-fkg98\") on node \"crc\" DevicePath \"\"" Mar 16 17:05:04 crc kubenswrapper[5120]: I0316 17:05:04.362066 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d6321014-00e1-45b6-a60b-777fade8e877-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:05:04 crc kubenswrapper[5120]: I0316 17:05:04.362089 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d6321014-00e1-45b6-a60b-777fade8e877-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:05:04 crc kubenswrapper[5120]: I0316 17:05:04.399732 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6321014-00e1-45b6-a60b-777fade8e877-config-data" (OuterVolumeSpecName: "config-data") pod "d6321014-00e1-45b6-a60b-777fade8e877" (UID: "d6321014-00e1-45b6-a60b-777fade8e877"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:05:04 crc kubenswrapper[5120]: I0316 17:05:04.464665 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d6321014-00e1-45b6-a60b-777fade8e877-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:05:05 crc kubenswrapper[5120]: I0316 17:05:05.115405 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"b0e290e3-0e59-4d06-950e-c679ec283a0b","Type":"ContainerStarted","Data":"d6ddd4f62a73258ac1ecba0897e418a576220e1aa98057408906b7e96251c1cf"} Mar 16 17:05:05 crc kubenswrapper[5120]: I0316 17:05:05.116548 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:05:05 crc kubenswrapper[5120]: I0316 17:05:05.127037 5120 generic.go:358] "Generic (PLEG): container finished" podID="9a8dcc05-35bc-4bcd-9e33-b90543374049" containerID="e53c17a81540e6c5cdc9f087ef3483a478ca22c0ec3e5f339b6016a47c3cf5d9" exitCode=0 Mar 16 17:05:05 crc kubenswrapper[5120]: I0316 17:05:05.127341 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-86c6c867c-6rtwz" event={"ID":"9a8dcc05-35bc-4bcd-9e33-b90543374049","Type":"ContainerDied","Data":"e53c17a81540e6c5cdc9f087ef3483a478ca22c0ec3e5f339b6016a47c3cf5d9"} Mar 16 17:05:05 crc kubenswrapper[5120]: I0316 17:05:05.131329 5120 generic.go:358] "Generic (PLEG): container finished" podID="13f9ea15-8a79-4a2e-87bb-eeee5bb593ee" containerID="0ca4518c674a9fcd5147789ec4f4ed26f8157453883a4e00412653726814f834" exitCode=0 Mar 16 17:05:05 crc kubenswrapper[5120]: I0316 17:05:05.131463 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:05:05 crc kubenswrapper[5120]: I0316 17:05:05.131838 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-9bbf69f54-w7krh" event={"ID":"13f9ea15-8a79-4a2e-87bb-eeee5bb593ee","Type":"ContainerDied","Data":"0ca4518c674a9fcd5147789ec4f4ed26f8157453883a4e00412653726814f834"} Mar 16 17:05:05 crc kubenswrapper[5120]: I0316 17:05:05.131874 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-9bbf69f54-w7krh" event={"ID":"13f9ea15-8a79-4a2e-87bb-eeee5bb593ee","Type":"ContainerDied","Data":"807df865a0eadabf88ace51ec38d3c252b55723fc6aa77fad7d2a51a733d147e"} Mar 16 17:05:05 crc kubenswrapper[5120]: I0316 17:05:05.131889 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="807df865a0eadabf88ace51ec38d3c252b55723fc6aa77fad7d2a51a733d147e" Mar 16 17:05:05 crc kubenswrapper[5120]: I0316 17:05:05.153939 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.321503104 podStartE2EDuration="8.153917496s" podCreationTimestamp="2026-03-16 17:04:57 +0000 UTC" firstStartedPulling="2026-03-16 17:04:58.436718402 +0000 UTC m=+5600.590650059" lastFinishedPulling="2026-03-16 17:05:04.269132794 +0000 UTC m=+5606.423064451" observedRunningTime="2026-03-16 17:05:05.150555693 +0000 UTC m=+5607.304487370" watchObservedRunningTime="2026-03-16 17:05:05.153917496 +0000 UTC m=+5607.307849153" Mar 16 17:05:05 crc kubenswrapper[5120]: I0316 17:05:05.175167 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-9bbf69f54-w7krh" Mar 16 17:05:05 crc kubenswrapper[5120]: I0316 17:05:05.206840 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 17:05:05 crc kubenswrapper[5120]: I0316 17:05:05.224565 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 17:05:05 crc kubenswrapper[5120]: I0316 17:05:05.239414 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 17:05:05 crc kubenswrapper[5120]: I0316 17:05:05.242807 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6321014-00e1-45b6-a60b-777fade8e877" containerName="probe" Mar 16 17:05:05 crc kubenswrapper[5120]: I0316 17:05:05.242839 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6321014-00e1-45b6-a60b-777fade8e877" containerName="probe" Mar 16 17:05:05 crc kubenswrapper[5120]: I0316 17:05:05.242907 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6321014-00e1-45b6-a60b-777fade8e877" containerName="cinder-scheduler" Mar 16 17:05:05 crc kubenswrapper[5120]: I0316 17:05:05.242915 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6321014-00e1-45b6-a60b-777fade8e877" containerName="cinder-scheduler" Mar 16 17:05:05 crc kubenswrapper[5120]: I0316 17:05:05.242926 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13f9ea15-8a79-4a2e-87bb-eeee5bb593ee" containerName="barbican-keystone-listener" Mar 16 17:05:05 crc kubenswrapper[5120]: I0316 17:05:05.242933 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="13f9ea15-8a79-4a2e-87bb-eeee5bb593ee" containerName="barbican-keystone-listener" Mar 16 17:05:05 crc kubenswrapper[5120]: I0316 17:05:05.242947 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13f9ea15-8a79-4a2e-87bb-eeee5bb593ee" containerName="barbican-keystone-listener-log" Mar 16 17:05:05 crc kubenswrapper[5120]: I0316 17:05:05.242953 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="13f9ea15-8a79-4a2e-87bb-eeee5bb593ee" containerName="barbican-keystone-listener-log" Mar 16 17:05:05 crc kubenswrapper[5120]: I0316 17:05:05.243115 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="d6321014-00e1-45b6-a60b-777fade8e877" containerName="cinder-scheduler" Mar 16 17:05:05 crc kubenswrapper[5120]: I0316 17:05:05.243130 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="13f9ea15-8a79-4a2e-87bb-eeee5bb593ee" containerName="barbican-keystone-listener" Mar 16 17:05:05 crc kubenswrapper[5120]: I0316 17:05:05.243145 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="13f9ea15-8a79-4a2e-87bb-eeee5bb593ee" containerName="barbican-keystone-listener-log" Mar 16 17:05:05 crc kubenswrapper[5120]: I0316 17:05:05.243156 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="d6321014-00e1-45b6-a60b-777fade8e877" containerName="probe" Mar 16 17:05:05 crc kubenswrapper[5120]: I0316 17:05:05.249448 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:05:05 crc kubenswrapper[5120]: I0316 17:05:05.255175 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-scheduler-config-data\"" Mar 16 17:05:05 crc kubenswrapper[5120]: I0316 17:05:05.270600 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 17:05:05 crc kubenswrapper[5120]: I0316 17:05:05.277406 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-86c6c867c-6rtwz" Mar 16 17:05:05 crc kubenswrapper[5120]: I0316 17:05:05.325091 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/13f9ea15-8a79-4a2e-87bb-eeee5bb593ee-config-data-custom\") pod \"13f9ea15-8a79-4a2e-87bb-eeee5bb593ee\" (UID: \"13f9ea15-8a79-4a2e-87bb-eeee5bb593ee\") " Mar 16 17:05:05 crc kubenswrapper[5120]: I0316 17:05:05.326215 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/13f9ea15-8a79-4a2e-87bb-eeee5bb593ee-logs\") pod \"13f9ea15-8a79-4a2e-87bb-eeee5bb593ee\" (UID: \"13f9ea15-8a79-4a2e-87bb-eeee5bb593ee\") " Mar 16 17:05:05 crc kubenswrapper[5120]: I0316 17:05:05.326672 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/13f9ea15-8a79-4a2e-87bb-eeee5bb593ee-combined-ca-bundle\") pod \"13f9ea15-8a79-4a2e-87bb-eeee5bb593ee\" (UID: \"13f9ea15-8a79-4a2e-87bb-eeee5bb593ee\") " Mar 16 17:05:05 crc kubenswrapper[5120]: I0316 17:05:05.326712 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13f9ea15-8a79-4a2e-87bb-eeee5bb593ee-logs" (OuterVolumeSpecName: "logs") pod "13f9ea15-8a79-4a2e-87bb-eeee5bb593ee" (UID: "13f9ea15-8a79-4a2e-87bb-eeee5bb593ee"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:05:05 crc kubenswrapper[5120]: I0316 17:05:05.327089 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jgp9f\" (UniqueName: \"kubernetes.io/projected/13f9ea15-8a79-4a2e-87bb-eeee5bb593ee-kube-api-access-jgp9f\") pod \"13f9ea15-8a79-4a2e-87bb-eeee5bb593ee\" (UID: \"13f9ea15-8a79-4a2e-87bb-eeee5bb593ee\") " Mar 16 17:05:05 crc kubenswrapper[5120]: I0316 17:05:05.327260 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/13f9ea15-8a79-4a2e-87bb-eeee5bb593ee-config-data\") pod \"13f9ea15-8a79-4a2e-87bb-eeee5bb593ee\" (UID: \"13f9ea15-8a79-4a2e-87bb-eeee5bb593ee\") " Mar 16 17:05:05 crc kubenswrapper[5120]: I0316 17:05:05.327511 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzthg\" (UniqueName: \"kubernetes.io/projected/3f3771ee-c5b9-4004-b631-437b1508ac5a-kube-api-access-jzthg\") pod \"cinder-scheduler-0\" (UID: \"3f3771ee-c5b9-4004-b631-437b1508ac5a\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:05:05 crc kubenswrapper[5120]: I0316 17:05:05.327607 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3f3771ee-c5b9-4004-b631-437b1508ac5a-config-data\") pod \"cinder-scheduler-0\" (UID: \"3f3771ee-c5b9-4004-b631-437b1508ac5a\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:05:05 crc kubenswrapper[5120]: I0316 17:05:05.327635 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/3f3771ee-c5b9-4004-b631-437b1508ac5a-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"3f3771ee-c5b9-4004-b631-437b1508ac5a\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:05:05 crc kubenswrapper[5120]: I0316 17:05:05.327732 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/3f3771ee-c5b9-4004-b631-437b1508ac5a-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"3f3771ee-c5b9-4004-b631-437b1508ac5a\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:05:05 crc kubenswrapper[5120]: I0316 17:05:05.327920 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3f3771ee-c5b9-4004-b631-437b1508ac5a-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"3f3771ee-c5b9-4004-b631-437b1508ac5a\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:05:05 crc kubenswrapper[5120]: I0316 17:05:05.328045 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3f3771ee-c5b9-4004-b631-437b1508ac5a-scripts\") pod \"cinder-scheduler-0\" (UID: \"3f3771ee-c5b9-4004-b631-437b1508ac5a\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:05:05 crc kubenswrapper[5120]: I0316 17:05:05.328267 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/13f9ea15-8a79-4a2e-87bb-eeee5bb593ee-logs\") on node \"crc\" DevicePath \"\"" Mar 16 17:05:05 crc kubenswrapper[5120]: I0316 17:05:05.332283 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/13f9ea15-8a79-4a2e-87bb-eeee5bb593ee-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "13f9ea15-8a79-4a2e-87bb-eeee5bb593ee" (UID: "13f9ea15-8a79-4a2e-87bb-eeee5bb593ee"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:05:05 crc kubenswrapper[5120]: I0316 17:05:05.332591 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13f9ea15-8a79-4a2e-87bb-eeee5bb593ee-kube-api-access-jgp9f" (OuterVolumeSpecName: "kube-api-access-jgp9f") pod "13f9ea15-8a79-4a2e-87bb-eeee5bb593ee" (UID: "13f9ea15-8a79-4a2e-87bb-eeee5bb593ee"). InnerVolumeSpecName "kube-api-access-jgp9f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:05:05 crc kubenswrapper[5120]: I0316 17:05:05.356172 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/13f9ea15-8a79-4a2e-87bb-eeee5bb593ee-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "13f9ea15-8a79-4a2e-87bb-eeee5bb593ee" (UID: "13f9ea15-8a79-4a2e-87bb-eeee5bb593ee"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:05:05 crc kubenswrapper[5120]: I0316 17:05:05.383526 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/13f9ea15-8a79-4a2e-87bb-eeee5bb593ee-config-data" (OuterVolumeSpecName: "config-data") pod "13f9ea15-8a79-4a2e-87bb-eeee5bb593ee" (UID: "13f9ea15-8a79-4a2e-87bb-eeee5bb593ee"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:05:05 crc kubenswrapper[5120]: I0316 17:05:05.429029 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/9a8dcc05-35bc-4bcd-9e33-b90543374049-config-data-custom\") pod \"9a8dcc05-35bc-4bcd-9e33-b90543374049\" (UID: \"9a8dcc05-35bc-4bcd-9e33-b90543374049\") " Mar 16 17:05:05 crc kubenswrapper[5120]: I0316 17:05:05.429175 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9a8dcc05-35bc-4bcd-9e33-b90543374049-logs\") pod \"9a8dcc05-35bc-4bcd-9e33-b90543374049\" (UID: \"9a8dcc05-35bc-4bcd-9e33-b90543374049\") " Mar 16 17:05:05 crc kubenswrapper[5120]: I0316 17:05:05.429280 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mngtc\" (UniqueName: \"kubernetes.io/projected/9a8dcc05-35bc-4bcd-9e33-b90543374049-kube-api-access-mngtc\") pod \"9a8dcc05-35bc-4bcd-9e33-b90543374049\" (UID: \"9a8dcc05-35bc-4bcd-9e33-b90543374049\") " Mar 16 17:05:05 crc kubenswrapper[5120]: I0316 17:05:05.429388 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9a8dcc05-35bc-4bcd-9e33-b90543374049-combined-ca-bundle\") pod \"9a8dcc05-35bc-4bcd-9e33-b90543374049\" (UID: \"9a8dcc05-35bc-4bcd-9e33-b90543374049\") " Mar 16 17:05:05 crc kubenswrapper[5120]: I0316 17:05:05.429432 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9a8dcc05-35bc-4bcd-9e33-b90543374049-config-data\") pod \"9a8dcc05-35bc-4bcd-9e33-b90543374049\" (UID: \"9a8dcc05-35bc-4bcd-9e33-b90543374049\") " Mar 16 17:05:05 crc kubenswrapper[5120]: I0316 17:05:05.429843 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3f3771ee-c5b9-4004-b631-437b1508ac5a-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"3f3771ee-c5b9-4004-b631-437b1508ac5a\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:05:05 crc kubenswrapper[5120]: I0316 17:05:05.429939 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3f3771ee-c5b9-4004-b631-437b1508ac5a-scripts\") pod \"cinder-scheduler-0\" (UID: \"3f3771ee-c5b9-4004-b631-437b1508ac5a\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:05:05 crc kubenswrapper[5120]: I0316 17:05:05.430143 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jzthg\" (UniqueName: \"kubernetes.io/projected/3f3771ee-c5b9-4004-b631-437b1508ac5a-kube-api-access-jzthg\") pod \"cinder-scheduler-0\" (UID: \"3f3771ee-c5b9-4004-b631-437b1508ac5a\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:05:05 crc kubenswrapper[5120]: I0316 17:05:05.430210 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3f3771ee-c5b9-4004-b631-437b1508ac5a-config-data\") pod \"cinder-scheduler-0\" (UID: \"3f3771ee-c5b9-4004-b631-437b1508ac5a\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:05:05 crc kubenswrapper[5120]: I0316 17:05:05.430231 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/3f3771ee-c5b9-4004-b631-437b1508ac5a-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"3f3771ee-c5b9-4004-b631-437b1508ac5a\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:05:05 crc kubenswrapper[5120]: I0316 17:05:05.430296 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/3f3771ee-c5b9-4004-b631-437b1508ac5a-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"3f3771ee-c5b9-4004-b631-437b1508ac5a\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:05:05 crc kubenswrapper[5120]: I0316 17:05:05.430434 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jgp9f\" (UniqueName: \"kubernetes.io/projected/13f9ea15-8a79-4a2e-87bb-eeee5bb593ee-kube-api-access-jgp9f\") on node \"crc\" DevicePath \"\"" Mar 16 17:05:05 crc kubenswrapper[5120]: I0316 17:05:05.430452 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/13f9ea15-8a79-4a2e-87bb-eeee5bb593ee-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:05:05 crc kubenswrapper[5120]: I0316 17:05:05.430461 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/13f9ea15-8a79-4a2e-87bb-eeee5bb593ee-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 17:05:05 crc kubenswrapper[5120]: I0316 17:05:05.430471 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/13f9ea15-8a79-4a2e-87bb-eeee5bb593ee-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:05:05 crc kubenswrapper[5120]: I0316 17:05:05.430519 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a8dcc05-35bc-4bcd-9e33-b90543374049-logs" (OuterVolumeSpecName: "logs") pod "9a8dcc05-35bc-4bcd-9e33-b90543374049" (UID: "9a8dcc05-35bc-4bcd-9e33-b90543374049"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:05:05 crc kubenswrapper[5120]: I0316 17:05:05.431560 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/3f3771ee-c5b9-4004-b631-437b1508ac5a-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"3f3771ee-c5b9-4004-b631-437b1508ac5a\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:05:05 crc kubenswrapper[5120]: I0316 17:05:05.434299 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3f3771ee-c5b9-4004-b631-437b1508ac5a-scripts\") pod \"cinder-scheduler-0\" (UID: \"3f3771ee-c5b9-4004-b631-437b1508ac5a\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:05:05 crc kubenswrapper[5120]: I0316 17:05:05.434488 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3f3771ee-c5b9-4004-b631-437b1508ac5a-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"3f3771ee-c5b9-4004-b631-437b1508ac5a\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:05:05 crc kubenswrapper[5120]: I0316 17:05:05.434844 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3f3771ee-c5b9-4004-b631-437b1508ac5a-config-data\") pod \"cinder-scheduler-0\" (UID: \"3f3771ee-c5b9-4004-b631-437b1508ac5a\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:05:05 crc kubenswrapper[5120]: I0316 17:05:05.435305 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a8dcc05-35bc-4bcd-9e33-b90543374049-kube-api-access-mngtc" (OuterVolumeSpecName: "kube-api-access-mngtc") pod "9a8dcc05-35bc-4bcd-9e33-b90543374049" (UID: "9a8dcc05-35bc-4bcd-9e33-b90543374049"). InnerVolumeSpecName "kube-api-access-mngtc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:05:05 crc kubenswrapper[5120]: I0316 17:05:05.437884 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a8dcc05-35bc-4bcd-9e33-b90543374049-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "9a8dcc05-35bc-4bcd-9e33-b90543374049" (UID: "9a8dcc05-35bc-4bcd-9e33-b90543374049"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:05:05 crc kubenswrapper[5120]: I0316 17:05:05.437963 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/3f3771ee-c5b9-4004-b631-437b1508ac5a-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"3f3771ee-c5b9-4004-b631-437b1508ac5a\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:05:05 crc kubenswrapper[5120]: I0316 17:05:05.453513 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzthg\" (UniqueName: \"kubernetes.io/projected/3f3771ee-c5b9-4004-b631-437b1508ac5a-kube-api-access-jzthg\") pod \"cinder-scheduler-0\" (UID: \"3f3771ee-c5b9-4004-b631-437b1508ac5a\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:05:05 crc kubenswrapper[5120]: I0316 17:05:05.456399 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a8dcc05-35bc-4bcd-9e33-b90543374049-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "9a8dcc05-35bc-4bcd-9e33-b90543374049" (UID: "9a8dcc05-35bc-4bcd-9e33-b90543374049"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:05:05 crc kubenswrapper[5120]: I0316 17:05:05.476070 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a8dcc05-35bc-4bcd-9e33-b90543374049-config-data" (OuterVolumeSpecName: "config-data") pod "9a8dcc05-35bc-4bcd-9e33-b90543374049" (UID: "9a8dcc05-35bc-4bcd-9e33-b90543374049"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:05:05 crc kubenswrapper[5120]: I0316 17:05:05.532990 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9a8dcc05-35bc-4bcd-9e33-b90543374049-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:05:05 crc kubenswrapper[5120]: I0316 17:05:05.533034 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9a8dcc05-35bc-4bcd-9e33-b90543374049-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:05:05 crc kubenswrapper[5120]: I0316 17:05:05.533052 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/9a8dcc05-35bc-4bcd-9e33-b90543374049-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 17:05:05 crc kubenswrapper[5120]: I0316 17:05:05.533071 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9a8dcc05-35bc-4bcd-9e33-b90543374049-logs\") on node \"crc\" DevicePath \"\"" Mar 16 17:05:05 crc kubenswrapper[5120]: I0316 17:05:05.533084 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mngtc\" (UniqueName: \"kubernetes.io/projected/9a8dcc05-35bc-4bcd-9e33-b90543374049-kube-api-access-mngtc\") on node \"crc\" DevicePath \"\"" Mar 16 17:05:05 crc kubenswrapper[5120]: I0316 17:05:05.574053 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:05:06 crc kubenswrapper[5120]: I0316 17:05:06.008372 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 17:05:06 crc kubenswrapper[5120]: W0316 17:05:06.011946 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3f3771ee_c5b9_4004_b631_437b1508ac5a.slice/crio-abdf9beed650a3b1a58c273a958bb4ea37c86da23c9b785707540342f0c83536 WatchSource:0}: Error finding container abdf9beed650a3b1a58c273a958bb4ea37c86da23c9b785707540342f0c83536: Status 404 returned error can't find the container with id abdf9beed650a3b1a58c273a958bb4ea37c86da23c9b785707540342f0c83536 Mar 16 17:05:06 crc kubenswrapper[5120]: I0316 17:05:06.145834 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-86c6c867c-6rtwz" event={"ID":"9a8dcc05-35bc-4bcd-9e33-b90543374049","Type":"ContainerDied","Data":"2d95ae5cf048f5a71959dce70d378a93ba6fc79bfe289bfdd8e66d8dbbee6db2"} Mar 16 17:05:06 crc kubenswrapper[5120]: I0316 17:05:06.145883 5120 scope.go:117] "RemoveContainer" containerID="e53c17a81540e6c5cdc9f087ef3483a478ca22c0ec3e5f339b6016a47c3cf5d9" Mar 16 17:05:06 crc kubenswrapper[5120]: I0316 17:05:06.146021 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-86c6c867c-6rtwz" Mar 16 17:05:06 crc kubenswrapper[5120]: I0316 17:05:06.161131 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-9bbf69f54-w7krh" Mar 16 17:05:06 crc kubenswrapper[5120]: I0316 17:05:06.161689 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"3f3771ee-c5b9-4004-b631-437b1508ac5a","Type":"ContainerStarted","Data":"abdf9beed650a3b1a58c273a958bb4ea37c86da23c9b785707540342f0c83536"} Mar 16 17:05:06 crc kubenswrapper[5120]: I0316 17:05:06.195976 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-86c6c867c-6rtwz"] Mar 16 17:05:06 crc kubenswrapper[5120]: I0316 17:05:06.216861 5120 scope.go:117] "RemoveContainer" containerID="85cb67abb8b62ca3bf3b6b7226041ce7d719f7c8727b9d274261d3e8c0b391c2" Mar 16 17:05:06 crc kubenswrapper[5120]: I0316 17:05:06.217564 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-worker-86c6c867c-6rtwz"] Mar 16 17:05:06 crc kubenswrapper[5120]: I0316 17:05:06.229505 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-9bbf69f54-w7krh"] Mar 16 17:05:06 crc kubenswrapper[5120]: I0316 17:05:06.238575 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-9bbf69f54-w7krh"] Mar 16 17:05:06 crc kubenswrapper[5120]: I0316 17:05:06.676187 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="13f9ea15-8a79-4a2e-87bb-eeee5bb593ee" path="/var/lib/kubelet/pods/13f9ea15-8a79-4a2e-87bb-eeee5bb593ee/volumes" Mar 16 17:05:06 crc kubenswrapper[5120]: I0316 17:05:06.677613 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a8dcc05-35bc-4bcd-9e33-b90543374049" path="/var/lib/kubelet/pods/9a8dcc05-35bc-4bcd-9e33-b90543374049/volumes" Mar 16 17:05:06 crc kubenswrapper[5120]: I0316 17:05:06.678500 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d6321014-00e1-45b6-a60b-777fade8e877" path="/var/lib/kubelet/pods/d6321014-00e1-45b6-a60b-777fade8e877/volumes" Mar 16 17:05:07 crc kubenswrapper[5120]: I0316 17:05:07.176789 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"3f3771ee-c5b9-4004-b631-437b1508ac5a","Type":"ContainerStarted","Data":"f9d4176477338724d48f077eb733c4cfa2586a8f3b67c1ffb86859f778db89d5"} Mar 16 17:05:08 crc kubenswrapper[5120]: E0316 17:05:08.136146 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1756270 actualBytes=10240 Mar 16 17:05:08 crc kubenswrapper[5120]: I0316 17:05:08.189537 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"3f3771ee-c5b9-4004-b631-437b1508ac5a","Type":"ContainerStarted","Data":"4ad7c1867c57d52a4fcc80cb4798fb797a71daf87508fcc099ea396489f4ae08"} Mar 16 17:05:08 crc kubenswrapper[5120]: I0316 17:05:08.212640 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-scheduler-0" podStartSLOduration=3.212617893 podStartE2EDuration="3.212617893s" podCreationTimestamp="2026-03-16 17:05:05 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:05:08.208925421 +0000 UTC m=+5610.362857079" watchObservedRunningTime="2026-03-16 17:05:08.212617893 +0000 UTC m=+5610.366549550" Mar 16 17:05:08 crc kubenswrapper[5120]: I0316 17:05:08.573951 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-b95589884-bsqwd" Mar 16 17:05:08 crc kubenswrapper[5120]: I0316 17:05:08.772835 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-b95589884-bsqwd" Mar 16 17:05:08 crc kubenswrapper[5120]: I0316 17:05:08.829514 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-79d5f46648-ptcxs"] Mar 16 17:05:08 crc kubenswrapper[5120]: I0316 17:05:08.830131 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-79d5f46648-ptcxs" podUID="0ba70df7-6538-42cf-9fbc-c6c3473cd8ec" containerName="barbican-api-log" containerID="cri-o://00c04018db0ce5d7f01a159aebafede490e4b203d6e2ad891b5a88dd112d40e2" gracePeriod=30 Mar 16 17:05:08 crc kubenswrapper[5120]: I0316 17:05:08.830812 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-79d5f46648-ptcxs" podUID="0ba70df7-6538-42cf-9fbc-c6c3473cd8ec" containerName="barbican-api" containerID="cri-o://88c9553a5802d8d7b8c47aab0188ef91fae69f404a2274edf6d00922a88dac58" gracePeriod=30 Mar 16 17:05:09 crc kubenswrapper[5120]: I0316 17:05:09.217391 5120 generic.go:358] "Generic (PLEG): container finished" podID="0ba70df7-6538-42cf-9fbc-c6c3473cd8ec" containerID="00c04018db0ce5d7f01a159aebafede490e4b203d6e2ad891b5a88dd112d40e2" exitCode=143 Mar 16 17:05:09 crc kubenswrapper[5120]: I0316 17:05:09.217504 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-79d5f46648-ptcxs" event={"ID":"0ba70df7-6538-42cf-9fbc-c6c3473cd8ec","Type":"ContainerDied","Data":"00c04018db0ce5d7f01a159aebafede490e4b203d6e2ad891b5a88dd112d40e2"} Mar 16 17:05:10 crc kubenswrapper[5120]: I0316 17:05:10.574908 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:05:11 crc kubenswrapper[5120]: I0316 17:05:11.173919 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:05:11 crc kubenswrapper[5120]: I0316 17:05:11.976227 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-79d5f46648-ptcxs" podUID="0ba70df7-6538-42cf-9fbc-c6c3473cd8ec" containerName="barbican-api" probeResult="failure" output="Get \"http://10.217.1.175:9311/healthcheck\": read tcp 10.217.0.2:54084->10.217.1.175:9311: read: connection reset by peer" Mar 16 17:05:11 crc kubenswrapper[5120]: I0316 17:05:11.976227 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-79d5f46648-ptcxs" podUID="0ba70df7-6538-42cf-9fbc-c6c3473cd8ec" containerName="barbican-api-log" probeResult="failure" output="Get \"http://10.217.1.175:9311/healthcheck\": read tcp 10.217.0.2:54088->10.217.1.175:9311: read: connection reset by peer" Mar 16 17:05:12 crc kubenswrapper[5120]: I0316 17:05:12.262799 5120 generic.go:358] "Generic (PLEG): container finished" podID="0ba70df7-6538-42cf-9fbc-c6c3473cd8ec" containerID="88c9553a5802d8d7b8c47aab0188ef91fae69f404a2274edf6d00922a88dac58" exitCode=0 Mar 16 17:05:12 crc kubenswrapper[5120]: I0316 17:05:12.263507 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-79d5f46648-ptcxs" event={"ID":"0ba70df7-6538-42cf-9fbc-c6c3473cd8ec","Type":"ContainerDied","Data":"88c9553a5802d8d7b8c47aab0188ef91fae69f404a2274edf6d00922a88dac58"} Mar 16 17:05:12 crc kubenswrapper[5120]: I0316 17:05:12.404790 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-79d5f46648-ptcxs" Mar 16 17:05:12 crc kubenswrapper[5120]: I0316 17:05:12.525670 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0ba70df7-6538-42cf-9fbc-c6c3473cd8ec-config-data\") pod \"0ba70df7-6538-42cf-9fbc-c6c3473cd8ec\" (UID: \"0ba70df7-6538-42cf-9fbc-c6c3473cd8ec\") " Mar 16 17:05:12 crc kubenswrapper[5120]: I0316 17:05:12.525810 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0ba70df7-6538-42cf-9fbc-c6c3473cd8ec-combined-ca-bundle\") pod \"0ba70df7-6538-42cf-9fbc-c6c3473cd8ec\" (UID: \"0ba70df7-6538-42cf-9fbc-c6c3473cd8ec\") " Mar 16 17:05:12 crc kubenswrapper[5120]: I0316 17:05:12.526047 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hzqbk\" (UniqueName: \"kubernetes.io/projected/0ba70df7-6538-42cf-9fbc-c6c3473cd8ec-kube-api-access-hzqbk\") pod \"0ba70df7-6538-42cf-9fbc-c6c3473cd8ec\" (UID: \"0ba70df7-6538-42cf-9fbc-c6c3473cd8ec\") " Mar 16 17:05:12 crc kubenswrapper[5120]: I0316 17:05:12.526680 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/0ba70df7-6538-42cf-9fbc-c6c3473cd8ec-config-data-custom\") pod \"0ba70df7-6538-42cf-9fbc-c6c3473cd8ec\" (UID: \"0ba70df7-6538-42cf-9fbc-c6c3473cd8ec\") " Mar 16 17:05:12 crc kubenswrapper[5120]: I0316 17:05:12.526824 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0ba70df7-6538-42cf-9fbc-c6c3473cd8ec-logs\") pod \"0ba70df7-6538-42cf-9fbc-c6c3473cd8ec\" (UID: \"0ba70df7-6538-42cf-9fbc-c6c3473cd8ec\") " Mar 16 17:05:12 crc kubenswrapper[5120]: I0316 17:05:12.527260 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ba70df7-6538-42cf-9fbc-c6c3473cd8ec-logs" (OuterVolumeSpecName: "logs") pod "0ba70df7-6538-42cf-9fbc-c6c3473cd8ec" (UID: "0ba70df7-6538-42cf-9fbc-c6c3473cd8ec"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:05:12 crc kubenswrapper[5120]: I0316 17:05:12.527815 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0ba70df7-6538-42cf-9fbc-c6c3473cd8ec-logs\") on node \"crc\" DevicePath \"\"" Mar 16 17:05:12 crc kubenswrapper[5120]: I0316 17:05:12.532001 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ba70df7-6538-42cf-9fbc-c6c3473cd8ec-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "0ba70df7-6538-42cf-9fbc-c6c3473cd8ec" (UID: "0ba70df7-6538-42cf-9fbc-c6c3473cd8ec"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:05:12 crc kubenswrapper[5120]: I0316 17:05:12.533046 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ba70df7-6538-42cf-9fbc-c6c3473cd8ec-kube-api-access-hzqbk" (OuterVolumeSpecName: "kube-api-access-hzqbk") pod "0ba70df7-6538-42cf-9fbc-c6c3473cd8ec" (UID: "0ba70df7-6538-42cf-9fbc-c6c3473cd8ec"). InnerVolumeSpecName "kube-api-access-hzqbk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:05:12 crc kubenswrapper[5120]: I0316 17:05:12.556512 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ba70df7-6538-42cf-9fbc-c6c3473cd8ec-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "0ba70df7-6538-42cf-9fbc-c6c3473cd8ec" (UID: "0ba70df7-6538-42cf-9fbc-c6c3473cd8ec"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:05:12 crc kubenswrapper[5120]: I0316 17:05:12.577570 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ba70df7-6538-42cf-9fbc-c6c3473cd8ec-config-data" (OuterVolumeSpecName: "config-data") pod "0ba70df7-6538-42cf-9fbc-c6c3473cd8ec" (UID: "0ba70df7-6538-42cf-9fbc-c6c3473cd8ec"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:05:12 crc kubenswrapper[5120]: I0316 17:05:12.630196 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/0ba70df7-6538-42cf-9fbc-c6c3473cd8ec-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 17:05:12 crc kubenswrapper[5120]: I0316 17:05:12.630232 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0ba70df7-6538-42cf-9fbc-c6c3473cd8ec-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:05:12 crc kubenswrapper[5120]: I0316 17:05:12.630246 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0ba70df7-6538-42cf-9fbc-c6c3473cd8ec-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:05:12 crc kubenswrapper[5120]: I0316 17:05:12.630259 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hzqbk\" (UniqueName: \"kubernetes.io/projected/0ba70df7-6538-42cf-9fbc-c6c3473cd8ec-kube-api-access-hzqbk\") on node \"crc\" DevicePath \"\"" Mar 16 17:05:13 crc kubenswrapper[5120]: I0316 17:05:13.272861 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-79d5f46648-ptcxs" Mar 16 17:05:13 crc kubenswrapper[5120]: I0316 17:05:13.272888 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-79d5f46648-ptcxs" event={"ID":"0ba70df7-6538-42cf-9fbc-c6c3473cd8ec","Type":"ContainerDied","Data":"2ac9e1d2b22624fb042a5eb900189570514dd92411723ab9a6a52844d280057c"} Mar 16 17:05:13 crc kubenswrapper[5120]: I0316 17:05:13.273233 5120 scope.go:117] "RemoveContainer" containerID="88c9553a5802d8d7b8c47aab0188ef91fae69f404a2274edf6d00922a88dac58" Mar 16 17:05:13 crc kubenswrapper[5120]: I0316 17:05:13.312826 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-79d5f46648-ptcxs"] Mar 16 17:05:13 crc kubenswrapper[5120]: I0316 17:05:13.317865 5120 scope.go:117] "RemoveContainer" containerID="00c04018db0ce5d7f01a159aebafede490e4b203d6e2ad891b5a88dd112d40e2" Mar 16 17:05:13 crc kubenswrapper[5120]: I0316 17:05:13.322421 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-api-79d5f46648-ptcxs"] Mar 16 17:05:13 crc kubenswrapper[5120]: I0316 17:05:13.789994 5120 scope.go:117] "RemoveContainer" containerID="31aa48ae9a695364d87a26a4847032706a8126fc6a90204e85b5a9a0b0bde237" Mar 16 17:05:13 crc kubenswrapper[5120]: I0316 17:05:13.815676 5120 scope.go:117] "RemoveContainer" containerID="76410021abc023713496ae0953fc6f1147e2f5232e4ad8b48fce68f89aa80c38" Mar 16 17:05:13 crc kubenswrapper[5120]: I0316 17:05:13.843990 5120 scope.go:117] "RemoveContainer" containerID="a1d23aa6e5afd485101028f0d3443a4dce5fef13ef6cd029e16a3912f04ce04d" Mar 16 17:05:13 crc kubenswrapper[5120]: I0316 17:05:13.873560 5120 scope.go:117] "RemoveContainer" containerID="1159dc9696ac2804dca778a04dee66734e301f35d4b9418fde5cf1e34d65610d" Mar 16 17:05:13 crc kubenswrapper[5120]: I0316 17:05:13.921614 5120 scope.go:117] "RemoveContainer" containerID="a50bcb7bcd40881ab5aeb26896fa0bf1d2d92d9720a9cc6da29240635d7ae72b" Mar 16 17:05:14 crc kubenswrapper[5120]: I0316 17:05:14.683185 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ba70df7-6538-42cf-9fbc-c6c3473cd8ec" path="/var/lib/kubelet/pods/0ba70df7-6538-42cf-9fbc-c6c3473cd8ec/volumes" Mar 16 17:05:15 crc kubenswrapper[5120]: I0316 17:05:15.812869 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:05:17 crc kubenswrapper[5120]: I0316 17:05:17.442730 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/placement-784497c6b4-5g4fn" Mar 16 17:05:18 crc kubenswrapper[5120]: I0316 17:05:18.366580 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/placement-784497c6b4-5g4fn" Mar 16 17:05:18 crc kubenswrapper[5120]: I0316 17:05:18.594688 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-654b89dc46-nkv85"] Mar 16 17:05:18 crc kubenswrapper[5120]: I0316 17:05:18.596605 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a8dcc05-35bc-4bcd-9e33-b90543374049" containerName="barbican-worker" Mar 16 17:05:18 crc kubenswrapper[5120]: I0316 17:05:18.596650 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a8dcc05-35bc-4bcd-9e33-b90543374049" containerName="barbican-worker" Mar 16 17:05:18 crc kubenswrapper[5120]: I0316 17:05:18.596716 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a8dcc05-35bc-4bcd-9e33-b90543374049" containerName="barbican-worker-log" Mar 16 17:05:18 crc kubenswrapper[5120]: I0316 17:05:18.596732 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a8dcc05-35bc-4bcd-9e33-b90543374049" containerName="barbican-worker-log" Mar 16 17:05:18 crc kubenswrapper[5120]: I0316 17:05:18.596751 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ba70df7-6538-42cf-9fbc-c6c3473cd8ec" containerName="barbican-api-log" Mar 16 17:05:18 crc kubenswrapper[5120]: I0316 17:05:18.596787 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ba70df7-6538-42cf-9fbc-c6c3473cd8ec" containerName="barbican-api-log" Mar 16 17:05:18 crc kubenswrapper[5120]: I0316 17:05:18.596823 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ba70df7-6538-42cf-9fbc-c6c3473cd8ec" containerName="barbican-api" Mar 16 17:05:18 crc kubenswrapper[5120]: I0316 17:05:18.596833 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ba70df7-6538-42cf-9fbc-c6c3473cd8ec" containerName="barbican-api" Mar 16 17:05:18 crc kubenswrapper[5120]: I0316 17:05:18.597079 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="9a8dcc05-35bc-4bcd-9e33-b90543374049" containerName="barbican-worker" Mar 16 17:05:18 crc kubenswrapper[5120]: I0316 17:05:18.597115 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="9a8dcc05-35bc-4bcd-9e33-b90543374049" containerName="barbican-worker-log" Mar 16 17:05:18 crc kubenswrapper[5120]: I0316 17:05:18.597136 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="0ba70df7-6538-42cf-9fbc-c6c3473cd8ec" containerName="barbican-api-log" Mar 16 17:05:18 crc kubenswrapper[5120]: I0316 17:05:18.597163 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="0ba70df7-6538-42cf-9fbc-c6c3473cd8ec" containerName="barbican-api" Mar 16 17:05:18 crc kubenswrapper[5120]: I0316 17:05:18.606008 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-654b89dc46-nkv85" Mar 16 17:05:18 crc kubenswrapper[5120]: I0316 17:05:18.609722 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-654b89dc46-nkv85"] Mar 16 17:05:18 crc kubenswrapper[5120]: I0316 17:05:18.681337 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t82hz\" (UniqueName: \"kubernetes.io/projected/f4f308ec-0dee-4238-817c-144d3f5f7f5d-kube-api-access-t82hz\") pod \"placement-654b89dc46-nkv85\" (UID: \"f4f308ec-0dee-4238-817c-144d3f5f7f5d\") " pod="openstack-kuttl-tests/placement-654b89dc46-nkv85" Mar 16 17:05:18 crc kubenswrapper[5120]: I0316 17:05:18.681462 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f4f308ec-0dee-4238-817c-144d3f5f7f5d-combined-ca-bundle\") pod \"placement-654b89dc46-nkv85\" (UID: \"f4f308ec-0dee-4238-817c-144d3f5f7f5d\") " pod="openstack-kuttl-tests/placement-654b89dc46-nkv85" Mar 16 17:05:18 crc kubenswrapper[5120]: I0316 17:05:18.681509 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f4f308ec-0dee-4238-817c-144d3f5f7f5d-logs\") pod \"placement-654b89dc46-nkv85\" (UID: \"f4f308ec-0dee-4238-817c-144d3f5f7f5d\") " pod="openstack-kuttl-tests/placement-654b89dc46-nkv85" Mar 16 17:05:18 crc kubenswrapper[5120]: I0316 17:05:18.681613 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f4f308ec-0dee-4238-817c-144d3f5f7f5d-config-data\") pod \"placement-654b89dc46-nkv85\" (UID: \"f4f308ec-0dee-4238-817c-144d3f5f7f5d\") " pod="openstack-kuttl-tests/placement-654b89dc46-nkv85" Mar 16 17:05:18 crc kubenswrapper[5120]: I0316 17:05:18.681675 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f4f308ec-0dee-4238-817c-144d3f5f7f5d-internal-tls-certs\") pod \"placement-654b89dc46-nkv85\" (UID: \"f4f308ec-0dee-4238-817c-144d3f5f7f5d\") " pod="openstack-kuttl-tests/placement-654b89dc46-nkv85" Mar 16 17:05:18 crc kubenswrapper[5120]: I0316 17:05:18.681712 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f4f308ec-0dee-4238-817c-144d3f5f7f5d-scripts\") pod \"placement-654b89dc46-nkv85\" (UID: \"f4f308ec-0dee-4238-817c-144d3f5f7f5d\") " pod="openstack-kuttl-tests/placement-654b89dc46-nkv85" Mar 16 17:05:18 crc kubenswrapper[5120]: I0316 17:05:18.681739 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f4f308ec-0dee-4238-817c-144d3f5f7f5d-public-tls-certs\") pod \"placement-654b89dc46-nkv85\" (UID: \"f4f308ec-0dee-4238-817c-144d3f5f7f5d\") " pod="openstack-kuttl-tests/placement-654b89dc46-nkv85" Mar 16 17:05:18 crc kubenswrapper[5120]: I0316 17:05:18.784196 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t82hz\" (UniqueName: \"kubernetes.io/projected/f4f308ec-0dee-4238-817c-144d3f5f7f5d-kube-api-access-t82hz\") pod \"placement-654b89dc46-nkv85\" (UID: \"f4f308ec-0dee-4238-817c-144d3f5f7f5d\") " pod="openstack-kuttl-tests/placement-654b89dc46-nkv85" Mar 16 17:05:18 crc kubenswrapper[5120]: I0316 17:05:18.784567 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f4f308ec-0dee-4238-817c-144d3f5f7f5d-combined-ca-bundle\") pod \"placement-654b89dc46-nkv85\" (UID: \"f4f308ec-0dee-4238-817c-144d3f5f7f5d\") " pod="openstack-kuttl-tests/placement-654b89dc46-nkv85" Mar 16 17:05:18 crc kubenswrapper[5120]: I0316 17:05:18.784702 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f4f308ec-0dee-4238-817c-144d3f5f7f5d-logs\") pod \"placement-654b89dc46-nkv85\" (UID: \"f4f308ec-0dee-4238-817c-144d3f5f7f5d\") " pod="openstack-kuttl-tests/placement-654b89dc46-nkv85" Mar 16 17:05:18 crc kubenswrapper[5120]: I0316 17:05:18.785188 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f4f308ec-0dee-4238-817c-144d3f5f7f5d-logs\") pod \"placement-654b89dc46-nkv85\" (UID: \"f4f308ec-0dee-4238-817c-144d3f5f7f5d\") " pod="openstack-kuttl-tests/placement-654b89dc46-nkv85" Mar 16 17:05:18 crc kubenswrapper[5120]: I0316 17:05:18.785204 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f4f308ec-0dee-4238-817c-144d3f5f7f5d-config-data\") pod \"placement-654b89dc46-nkv85\" (UID: \"f4f308ec-0dee-4238-817c-144d3f5f7f5d\") " pod="openstack-kuttl-tests/placement-654b89dc46-nkv85" Mar 16 17:05:18 crc kubenswrapper[5120]: I0316 17:05:18.785336 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f4f308ec-0dee-4238-817c-144d3f5f7f5d-internal-tls-certs\") pod \"placement-654b89dc46-nkv85\" (UID: \"f4f308ec-0dee-4238-817c-144d3f5f7f5d\") " pod="openstack-kuttl-tests/placement-654b89dc46-nkv85" Mar 16 17:05:18 crc kubenswrapper[5120]: I0316 17:05:18.785389 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f4f308ec-0dee-4238-817c-144d3f5f7f5d-scripts\") pod \"placement-654b89dc46-nkv85\" (UID: \"f4f308ec-0dee-4238-817c-144d3f5f7f5d\") " pod="openstack-kuttl-tests/placement-654b89dc46-nkv85" Mar 16 17:05:18 crc kubenswrapper[5120]: I0316 17:05:18.785421 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f4f308ec-0dee-4238-817c-144d3f5f7f5d-public-tls-certs\") pod \"placement-654b89dc46-nkv85\" (UID: \"f4f308ec-0dee-4238-817c-144d3f5f7f5d\") " pod="openstack-kuttl-tests/placement-654b89dc46-nkv85" Mar 16 17:05:18 crc kubenswrapper[5120]: I0316 17:05:18.792336 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f4f308ec-0dee-4238-817c-144d3f5f7f5d-public-tls-certs\") pod \"placement-654b89dc46-nkv85\" (UID: \"f4f308ec-0dee-4238-817c-144d3f5f7f5d\") " pod="openstack-kuttl-tests/placement-654b89dc46-nkv85" Mar 16 17:05:18 crc kubenswrapper[5120]: I0316 17:05:18.792544 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f4f308ec-0dee-4238-817c-144d3f5f7f5d-scripts\") pod \"placement-654b89dc46-nkv85\" (UID: \"f4f308ec-0dee-4238-817c-144d3f5f7f5d\") " pod="openstack-kuttl-tests/placement-654b89dc46-nkv85" Mar 16 17:05:18 crc kubenswrapper[5120]: I0316 17:05:18.792545 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f4f308ec-0dee-4238-817c-144d3f5f7f5d-config-data\") pod \"placement-654b89dc46-nkv85\" (UID: \"f4f308ec-0dee-4238-817c-144d3f5f7f5d\") " pod="openstack-kuttl-tests/placement-654b89dc46-nkv85" Mar 16 17:05:18 crc kubenswrapper[5120]: I0316 17:05:18.793271 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f4f308ec-0dee-4238-817c-144d3f5f7f5d-combined-ca-bundle\") pod \"placement-654b89dc46-nkv85\" (UID: \"f4f308ec-0dee-4238-817c-144d3f5f7f5d\") " pod="openstack-kuttl-tests/placement-654b89dc46-nkv85" Mar 16 17:05:18 crc kubenswrapper[5120]: I0316 17:05:18.793594 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f4f308ec-0dee-4238-817c-144d3f5f7f5d-internal-tls-certs\") pod \"placement-654b89dc46-nkv85\" (UID: \"f4f308ec-0dee-4238-817c-144d3f5f7f5d\") " pod="openstack-kuttl-tests/placement-654b89dc46-nkv85" Mar 16 17:05:18 crc kubenswrapper[5120]: I0316 17:05:18.802276 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t82hz\" (UniqueName: \"kubernetes.io/projected/f4f308ec-0dee-4238-817c-144d3f5f7f5d-kube-api-access-t82hz\") pod \"placement-654b89dc46-nkv85\" (UID: \"f4f308ec-0dee-4238-817c-144d3f5f7f5d\") " pod="openstack-kuttl-tests/placement-654b89dc46-nkv85" Mar 16 17:05:18 crc kubenswrapper[5120]: I0316 17:05:18.931952 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-654b89dc46-nkv85" Mar 16 17:05:19 crc kubenswrapper[5120]: I0316 17:05:19.360326 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-654b89dc46-nkv85"] Mar 16 17:05:19 crc kubenswrapper[5120]: W0316 17:05:19.365123 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf4f308ec_0dee_4238_817c_144d3f5f7f5d.slice/crio-dddba88f6a1dc30c27a67e43f37447def3057684a1f7e00524b527b6f6bdd877 WatchSource:0}: Error finding container dddba88f6a1dc30c27a67e43f37447def3057684a1f7e00524b527b6f6bdd877: Status 404 returned error can't find the container with id dddba88f6a1dc30c27a67e43f37447def3057684a1f7e00524b527b6f6bdd877 Mar 16 17:05:19 crc kubenswrapper[5120]: I0316 17:05:19.368042 5120 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Mar 16 17:05:20 crc kubenswrapper[5120]: I0316 17:05:20.352921 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-654b89dc46-nkv85" event={"ID":"f4f308ec-0dee-4238-817c-144d3f5f7f5d","Type":"ContainerStarted","Data":"8837ed0b6f7a64ac73ea321d7c483a04cb9a140f80591b89d2edbb6bb6e04b64"} Mar 16 17:05:20 crc kubenswrapper[5120]: I0316 17:05:20.352987 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-654b89dc46-nkv85" event={"ID":"f4f308ec-0dee-4238-817c-144d3f5f7f5d","Type":"ContainerStarted","Data":"aac663539a87a40563cdbc36f105c3f7f4a4f053d388b2533a21e308f1a9cede"} Mar 16 17:05:20 crc kubenswrapper[5120]: I0316 17:05:20.353004 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-654b89dc46-nkv85" event={"ID":"f4f308ec-0dee-4238-817c-144d3f5f7f5d","Type":"ContainerStarted","Data":"dddba88f6a1dc30c27a67e43f37447def3057684a1f7e00524b527b6f6bdd877"} Mar 16 17:05:20 crc kubenswrapper[5120]: I0316 17:05:20.355266 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-654b89dc46-nkv85" Mar 16 17:05:20 crc kubenswrapper[5120]: I0316 17:05:20.355338 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-654b89dc46-nkv85" Mar 16 17:05:20 crc kubenswrapper[5120]: I0316 17:05:20.397216 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-654b89dc46-nkv85" podStartSLOduration=2.397193384 podStartE2EDuration="2.397193384s" podCreationTimestamp="2026-03-16 17:05:18 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:05:20.374740414 +0000 UTC m=+5622.528672101" watchObservedRunningTime="2026-03-16 17:05:20.397193384 +0000 UTC m=+5622.551125041" Mar 16 17:05:22 crc kubenswrapper[5120]: I0316 17:05:22.008740 5120 patch_prober.go:28] interesting pod/machine-config-daemon-7bf76 container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 17:05:22 crc kubenswrapper[5120]: I0316 17:05:22.009116 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 17:05:23 crc kubenswrapper[5120]: I0316 17:05:23.661315 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/neutron-78d789956f-w2p5r" Mar 16 17:05:26 crc kubenswrapper[5120]: I0316 17:05:26.157346 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/keystone-7df86b764c-bv9sm" Mar 16 17:05:29 crc kubenswrapper[5120]: I0316 17:05:29.269840 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 17:05:29 crc kubenswrapper[5120]: I0316 17:05:29.279594 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Mar 16 17:05:29 crc kubenswrapper[5120]: I0316 17:05:29.280582 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 17:05:29 crc kubenswrapper[5120]: I0316 17:05:29.282168 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"openstackclient-openstackclient-dockercfg-74v62\"" Mar 16 17:05:29 crc kubenswrapper[5120]: I0316 17:05:29.284081 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"openstack-config-secret\"" Mar 16 17:05:29 crc kubenswrapper[5120]: I0316 17:05:29.287542 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-config\"" Mar 16 17:05:29 crc kubenswrapper[5120]: I0316 17:05:29.379381 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/d325d1cb-bde7-4d3d-978f-2f9d1188717e-openstack-config\") pod \"openstackclient\" (UID: \"d325d1cb-bde7-4d3d-978f-2f9d1188717e\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 17:05:29 crc kubenswrapper[5120]: I0316 17:05:29.379624 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d325d1cb-bde7-4d3d-978f-2f9d1188717e-combined-ca-bundle\") pod \"openstackclient\" (UID: \"d325d1cb-bde7-4d3d-978f-2f9d1188717e\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 17:05:29 crc kubenswrapper[5120]: I0316 17:05:29.379754 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/d325d1cb-bde7-4d3d-978f-2f9d1188717e-openstack-config-secret\") pod \"openstackclient\" (UID: \"d325d1cb-bde7-4d3d-978f-2f9d1188717e\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 17:05:29 crc kubenswrapper[5120]: I0316 17:05:29.379884 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6snck\" (UniqueName: \"kubernetes.io/projected/d325d1cb-bde7-4d3d-978f-2f9d1188717e-kube-api-access-6snck\") pod \"openstackclient\" (UID: \"d325d1cb-bde7-4d3d-978f-2f9d1188717e\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 17:05:29 crc kubenswrapper[5120]: I0316 17:05:29.481824 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/d325d1cb-bde7-4d3d-978f-2f9d1188717e-openstack-config\") pod \"openstackclient\" (UID: \"d325d1cb-bde7-4d3d-978f-2f9d1188717e\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 17:05:29 crc kubenswrapper[5120]: I0316 17:05:29.482060 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d325d1cb-bde7-4d3d-978f-2f9d1188717e-combined-ca-bundle\") pod \"openstackclient\" (UID: \"d325d1cb-bde7-4d3d-978f-2f9d1188717e\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 17:05:29 crc kubenswrapper[5120]: I0316 17:05:29.482969 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/d325d1cb-bde7-4d3d-978f-2f9d1188717e-openstack-config\") pod \"openstackclient\" (UID: \"d325d1cb-bde7-4d3d-978f-2f9d1188717e\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 17:05:29 crc kubenswrapper[5120]: I0316 17:05:29.483148 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/d325d1cb-bde7-4d3d-978f-2f9d1188717e-openstack-config-secret\") pod \"openstackclient\" (UID: \"d325d1cb-bde7-4d3d-978f-2f9d1188717e\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 17:05:29 crc kubenswrapper[5120]: I0316 17:05:29.483318 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6snck\" (UniqueName: \"kubernetes.io/projected/d325d1cb-bde7-4d3d-978f-2f9d1188717e-kube-api-access-6snck\") pod \"openstackclient\" (UID: \"d325d1cb-bde7-4d3d-978f-2f9d1188717e\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 17:05:29 crc kubenswrapper[5120]: I0316 17:05:29.488851 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d325d1cb-bde7-4d3d-978f-2f9d1188717e-combined-ca-bundle\") pod \"openstackclient\" (UID: \"d325d1cb-bde7-4d3d-978f-2f9d1188717e\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 17:05:29 crc kubenswrapper[5120]: I0316 17:05:29.489450 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/d325d1cb-bde7-4d3d-978f-2f9d1188717e-openstack-config-secret\") pod \"openstackclient\" (UID: \"d325d1cb-bde7-4d3d-978f-2f9d1188717e\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 17:05:29 crc kubenswrapper[5120]: I0316 17:05:29.513732 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6snck\" (UniqueName: \"kubernetes.io/projected/d325d1cb-bde7-4d3d-978f-2f9d1188717e-kube-api-access-6snck\") pod \"openstackclient\" (UID: \"d325d1cb-bde7-4d3d-978f-2f9d1188717e\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 17:05:29 crc kubenswrapper[5120]: I0316 17:05:29.613183 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Mar 16 17:05:30 crc kubenswrapper[5120]: I0316 17:05:30.092577 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 17:05:30 crc kubenswrapper[5120]: I0316 17:05:30.348478 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:05:30 crc kubenswrapper[5120]: I0316 17:05:30.349077 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="b0e290e3-0e59-4d06-950e-c679ec283a0b" containerName="ceilometer-central-agent" containerID="cri-o://4d90c2140d1eef3f63b3dcbca1737d8f058172254b9865d71395accfda08696e" gracePeriod=30 Mar 16 17:05:30 crc kubenswrapper[5120]: I0316 17:05:30.349965 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="b0e290e3-0e59-4d06-950e-c679ec283a0b" containerName="proxy-httpd" containerID="cri-o://d6ddd4f62a73258ac1ecba0897e418a576220e1aa98057408906b7e96251c1cf" gracePeriod=30 Mar 16 17:05:30 crc kubenswrapper[5120]: I0316 17:05:30.350025 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="b0e290e3-0e59-4d06-950e-c679ec283a0b" containerName="sg-core" containerID="cri-o://2cf359425be6824b5a27038264e5f716e735cef7527a6305370e54b52ba77edf" gracePeriod=30 Mar 16 17:05:30 crc kubenswrapper[5120]: I0316 17:05:30.350065 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="b0e290e3-0e59-4d06-950e-c679ec283a0b" containerName="ceilometer-notification-agent" containerID="cri-o://26fedc9d06a776e7a4afc6338f3cd6eb323e61832fd0b2921a96dc91a56a705b" gracePeriod=30 Mar 16 17:05:30 crc kubenswrapper[5120]: I0316 17:05:30.357204 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/ceilometer-0" podUID="b0e290e3-0e59-4d06-950e-c679ec283a0b" containerName="proxy-httpd" probeResult="failure" output="Get \"http://10.217.1.181:3000/\": EOF" Mar 16 17:05:30 crc kubenswrapper[5120]: I0316 17:05:30.459427 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstackclient" event={"ID":"d325d1cb-bde7-4d3d-978f-2f9d1188717e","Type":"ContainerStarted","Data":"3f289a8fede143f8dca99cdbaa1cac9860a28fa61689bab6b0b824d500b16adf"} Mar 16 17:05:30 crc kubenswrapper[5120]: I0316 17:05:30.459660 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstackclient" event={"ID":"d325d1cb-bde7-4d3d-978f-2f9d1188717e","Type":"ContainerStarted","Data":"101e01aec5c2cee1f6c4d9aa550620b2731a12eaa3671fa6627da96543c7ddab"} Mar 16 17:05:30 crc kubenswrapper[5120]: I0316 17:05:30.479301 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstackclient" podStartSLOduration=1.479284413 podStartE2EDuration="1.479284413s" podCreationTimestamp="2026-03-16 17:05:29 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:05:30.477409921 +0000 UTC m=+5632.631341578" watchObservedRunningTime="2026-03-16 17:05:30.479284413 +0000 UTC m=+5632.633216070" Mar 16 17:05:31 crc kubenswrapper[5120]: I0316 17:05:31.038728 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/neutron-5bb4df7ffd-xw448" Mar 16 17:05:31 crc kubenswrapper[5120]: I0316 17:05:31.103428 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-78d789956f-w2p5r"] Mar 16 17:05:31 crc kubenswrapper[5120]: I0316 17:05:31.103732 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-78d789956f-w2p5r" podUID="f3e6d999-ab20-420f-b881-a34d5781d9f9" containerName="neutron-api" containerID="cri-o://5bd2bd96c8b0e3237f1b34fd6f286d5a894c9e75983172d8f7cb1abdc67c91a5" gracePeriod=30 Mar 16 17:05:31 crc kubenswrapper[5120]: I0316 17:05:31.103846 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-78d789956f-w2p5r" podUID="f3e6d999-ab20-420f-b881-a34d5781d9f9" containerName="neutron-httpd" containerID="cri-o://8aea133900a3ee5ac17fab7d48ec3375790901136af846706c5e28365d7cf0ec" gracePeriod=30 Mar 16 17:05:31 crc kubenswrapper[5120]: I0316 17:05:31.479991 5120 generic.go:358] "Generic (PLEG): container finished" podID="f3e6d999-ab20-420f-b881-a34d5781d9f9" containerID="8aea133900a3ee5ac17fab7d48ec3375790901136af846706c5e28365d7cf0ec" exitCode=0 Mar 16 17:05:31 crc kubenswrapper[5120]: I0316 17:05:31.480073 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-78d789956f-w2p5r" event={"ID":"f3e6d999-ab20-420f-b881-a34d5781d9f9","Type":"ContainerDied","Data":"8aea133900a3ee5ac17fab7d48ec3375790901136af846706c5e28365d7cf0ec"} Mar 16 17:05:31 crc kubenswrapper[5120]: I0316 17:05:31.490719 5120 generic.go:358] "Generic (PLEG): container finished" podID="b0e290e3-0e59-4d06-950e-c679ec283a0b" containerID="d6ddd4f62a73258ac1ecba0897e418a576220e1aa98057408906b7e96251c1cf" exitCode=0 Mar 16 17:05:31 crc kubenswrapper[5120]: I0316 17:05:31.490772 5120 generic.go:358] "Generic (PLEG): container finished" podID="b0e290e3-0e59-4d06-950e-c679ec283a0b" containerID="2cf359425be6824b5a27038264e5f716e735cef7527a6305370e54b52ba77edf" exitCode=2 Mar 16 17:05:31 crc kubenswrapper[5120]: I0316 17:05:31.490780 5120 generic.go:358] "Generic (PLEG): container finished" podID="b0e290e3-0e59-4d06-950e-c679ec283a0b" containerID="4d90c2140d1eef3f63b3dcbca1737d8f058172254b9865d71395accfda08696e" exitCode=0 Mar 16 17:05:31 crc kubenswrapper[5120]: I0316 17:05:31.490827 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"b0e290e3-0e59-4d06-950e-c679ec283a0b","Type":"ContainerDied","Data":"d6ddd4f62a73258ac1ecba0897e418a576220e1aa98057408906b7e96251c1cf"} Mar 16 17:05:31 crc kubenswrapper[5120]: I0316 17:05:31.490862 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"b0e290e3-0e59-4d06-950e-c679ec283a0b","Type":"ContainerDied","Data":"2cf359425be6824b5a27038264e5f716e735cef7527a6305370e54b52ba77edf"} Mar 16 17:05:31 crc kubenswrapper[5120]: I0316 17:05:31.490873 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"b0e290e3-0e59-4d06-950e-c679ec283a0b","Type":"ContainerDied","Data":"4d90c2140d1eef3f63b3dcbca1737d8f058172254b9865d71395accfda08696e"} Mar 16 17:05:31 crc kubenswrapper[5120]: I0316 17:05:31.769466 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/swift-proxy-664c964b6d-gxvmn"] Mar 16 17:05:31 crc kubenswrapper[5120]: I0316 17:05:31.779942 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-664c964b6d-gxvmn" Mar 16 17:05:31 crc kubenswrapper[5120]: I0316 17:05:31.782273 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-swift-internal-svc\"" Mar 16 17:05:31 crc kubenswrapper[5120]: I0316 17:05:31.783218 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-swift-public-svc\"" Mar 16 17:05:31 crc kubenswrapper[5120]: I0316 17:05:31.783519 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"swift-proxy-config-data\"" Mar 16 17:05:31 crc kubenswrapper[5120]: I0316 17:05:31.787504 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-proxy-664c964b6d-gxvmn"] Mar 16 17:05:31 crc kubenswrapper[5120]: I0316 17:05:31.950729 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c3ef2c2d-c556-439c-872c-c3e48ae34a71-log-httpd\") pod \"swift-proxy-664c964b6d-gxvmn\" (UID: \"c3ef2c2d-c556-439c-872c-c3e48ae34a71\") " pod="openstack-kuttl-tests/swift-proxy-664c964b6d-gxvmn" Mar 16 17:05:31 crc kubenswrapper[5120]: I0316 17:05:31.951487 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/c3ef2c2d-c556-439c-872c-c3e48ae34a71-etc-swift\") pod \"swift-proxy-664c964b6d-gxvmn\" (UID: \"c3ef2c2d-c556-439c-872c-c3e48ae34a71\") " pod="openstack-kuttl-tests/swift-proxy-664c964b6d-gxvmn" Mar 16 17:05:31 crc kubenswrapper[5120]: I0316 17:05:31.951775 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whn4q\" (UniqueName: \"kubernetes.io/projected/c3ef2c2d-c556-439c-872c-c3e48ae34a71-kube-api-access-whn4q\") pod \"swift-proxy-664c964b6d-gxvmn\" (UID: \"c3ef2c2d-c556-439c-872c-c3e48ae34a71\") " pod="openstack-kuttl-tests/swift-proxy-664c964b6d-gxvmn" Mar 16 17:05:31 crc kubenswrapper[5120]: I0316 17:05:31.952013 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c3ef2c2d-c556-439c-872c-c3e48ae34a71-combined-ca-bundle\") pod \"swift-proxy-664c964b6d-gxvmn\" (UID: \"c3ef2c2d-c556-439c-872c-c3e48ae34a71\") " pod="openstack-kuttl-tests/swift-proxy-664c964b6d-gxvmn" Mar 16 17:05:31 crc kubenswrapper[5120]: I0316 17:05:31.952263 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c3ef2c2d-c556-439c-872c-c3e48ae34a71-config-data\") pod \"swift-proxy-664c964b6d-gxvmn\" (UID: \"c3ef2c2d-c556-439c-872c-c3e48ae34a71\") " pod="openstack-kuttl-tests/swift-proxy-664c964b6d-gxvmn" Mar 16 17:05:31 crc kubenswrapper[5120]: I0316 17:05:31.952416 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/c3ef2c2d-c556-439c-872c-c3e48ae34a71-public-tls-certs\") pod \"swift-proxy-664c964b6d-gxvmn\" (UID: \"c3ef2c2d-c556-439c-872c-c3e48ae34a71\") " pod="openstack-kuttl-tests/swift-proxy-664c964b6d-gxvmn" Mar 16 17:05:31 crc kubenswrapper[5120]: I0316 17:05:31.952568 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/c3ef2c2d-c556-439c-872c-c3e48ae34a71-internal-tls-certs\") pod \"swift-proxy-664c964b6d-gxvmn\" (UID: \"c3ef2c2d-c556-439c-872c-c3e48ae34a71\") " pod="openstack-kuttl-tests/swift-proxy-664c964b6d-gxvmn" Mar 16 17:05:31 crc kubenswrapper[5120]: I0316 17:05:31.952744 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c3ef2c2d-c556-439c-872c-c3e48ae34a71-run-httpd\") pod \"swift-proxy-664c964b6d-gxvmn\" (UID: \"c3ef2c2d-c556-439c-872c-c3e48ae34a71\") " pod="openstack-kuttl-tests/swift-proxy-664c964b6d-gxvmn" Mar 16 17:05:32 crc kubenswrapper[5120]: I0316 17:05:32.054565 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/c3ef2c2d-c556-439c-872c-c3e48ae34a71-internal-tls-certs\") pod \"swift-proxy-664c964b6d-gxvmn\" (UID: \"c3ef2c2d-c556-439c-872c-c3e48ae34a71\") " pod="openstack-kuttl-tests/swift-proxy-664c964b6d-gxvmn" Mar 16 17:05:32 crc kubenswrapper[5120]: I0316 17:05:32.054895 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c3ef2c2d-c556-439c-872c-c3e48ae34a71-run-httpd\") pod \"swift-proxy-664c964b6d-gxvmn\" (UID: \"c3ef2c2d-c556-439c-872c-c3e48ae34a71\") " pod="openstack-kuttl-tests/swift-proxy-664c964b6d-gxvmn" Mar 16 17:05:32 crc kubenswrapper[5120]: I0316 17:05:32.055019 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c3ef2c2d-c556-439c-872c-c3e48ae34a71-log-httpd\") pod \"swift-proxy-664c964b6d-gxvmn\" (UID: \"c3ef2c2d-c556-439c-872c-c3e48ae34a71\") " pod="openstack-kuttl-tests/swift-proxy-664c964b6d-gxvmn" Mar 16 17:05:32 crc kubenswrapper[5120]: I0316 17:05:32.055183 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/c3ef2c2d-c556-439c-872c-c3e48ae34a71-etc-swift\") pod \"swift-proxy-664c964b6d-gxvmn\" (UID: \"c3ef2c2d-c556-439c-872c-c3e48ae34a71\") " pod="openstack-kuttl-tests/swift-proxy-664c964b6d-gxvmn" Mar 16 17:05:32 crc kubenswrapper[5120]: I0316 17:05:32.055369 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-whn4q\" (UniqueName: \"kubernetes.io/projected/c3ef2c2d-c556-439c-872c-c3e48ae34a71-kube-api-access-whn4q\") pod \"swift-proxy-664c964b6d-gxvmn\" (UID: \"c3ef2c2d-c556-439c-872c-c3e48ae34a71\") " pod="openstack-kuttl-tests/swift-proxy-664c964b6d-gxvmn" Mar 16 17:05:32 crc kubenswrapper[5120]: I0316 17:05:32.055535 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c3ef2c2d-c556-439c-872c-c3e48ae34a71-combined-ca-bundle\") pod \"swift-proxy-664c964b6d-gxvmn\" (UID: \"c3ef2c2d-c556-439c-872c-c3e48ae34a71\") " pod="openstack-kuttl-tests/swift-proxy-664c964b6d-gxvmn" Mar 16 17:05:32 crc kubenswrapper[5120]: I0316 17:05:32.055544 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c3ef2c2d-c556-439c-872c-c3e48ae34a71-run-httpd\") pod \"swift-proxy-664c964b6d-gxvmn\" (UID: \"c3ef2c2d-c556-439c-872c-c3e48ae34a71\") " pod="openstack-kuttl-tests/swift-proxy-664c964b6d-gxvmn" Mar 16 17:05:32 crc kubenswrapper[5120]: I0316 17:05:32.055570 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c3ef2c2d-c556-439c-872c-c3e48ae34a71-log-httpd\") pod \"swift-proxy-664c964b6d-gxvmn\" (UID: \"c3ef2c2d-c556-439c-872c-c3e48ae34a71\") " pod="openstack-kuttl-tests/swift-proxy-664c964b6d-gxvmn" Mar 16 17:05:32 crc kubenswrapper[5120]: I0316 17:05:32.055837 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c3ef2c2d-c556-439c-872c-c3e48ae34a71-config-data\") pod \"swift-proxy-664c964b6d-gxvmn\" (UID: \"c3ef2c2d-c556-439c-872c-c3e48ae34a71\") " pod="openstack-kuttl-tests/swift-proxy-664c964b6d-gxvmn" Mar 16 17:05:32 crc kubenswrapper[5120]: I0316 17:05:32.055947 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/c3ef2c2d-c556-439c-872c-c3e48ae34a71-public-tls-certs\") pod \"swift-proxy-664c964b6d-gxvmn\" (UID: \"c3ef2c2d-c556-439c-872c-c3e48ae34a71\") " pod="openstack-kuttl-tests/swift-proxy-664c964b6d-gxvmn" Mar 16 17:05:32 crc kubenswrapper[5120]: I0316 17:05:32.061285 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/c3ef2c2d-c556-439c-872c-c3e48ae34a71-internal-tls-certs\") pod \"swift-proxy-664c964b6d-gxvmn\" (UID: \"c3ef2c2d-c556-439c-872c-c3e48ae34a71\") " pod="openstack-kuttl-tests/swift-proxy-664c964b6d-gxvmn" Mar 16 17:05:32 crc kubenswrapper[5120]: I0316 17:05:32.061484 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c3ef2c2d-c556-439c-872c-c3e48ae34a71-config-data\") pod \"swift-proxy-664c964b6d-gxvmn\" (UID: \"c3ef2c2d-c556-439c-872c-c3e48ae34a71\") " pod="openstack-kuttl-tests/swift-proxy-664c964b6d-gxvmn" Mar 16 17:05:32 crc kubenswrapper[5120]: I0316 17:05:32.063028 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c3ef2c2d-c556-439c-872c-c3e48ae34a71-combined-ca-bundle\") pod \"swift-proxy-664c964b6d-gxvmn\" (UID: \"c3ef2c2d-c556-439c-872c-c3e48ae34a71\") " pod="openstack-kuttl-tests/swift-proxy-664c964b6d-gxvmn" Mar 16 17:05:32 crc kubenswrapper[5120]: I0316 17:05:32.063481 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/c3ef2c2d-c556-439c-872c-c3e48ae34a71-public-tls-certs\") pod \"swift-proxy-664c964b6d-gxvmn\" (UID: \"c3ef2c2d-c556-439c-872c-c3e48ae34a71\") " pod="openstack-kuttl-tests/swift-proxy-664c964b6d-gxvmn" Mar 16 17:05:32 crc kubenswrapper[5120]: I0316 17:05:32.078133 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/c3ef2c2d-c556-439c-872c-c3e48ae34a71-etc-swift\") pod \"swift-proxy-664c964b6d-gxvmn\" (UID: \"c3ef2c2d-c556-439c-872c-c3e48ae34a71\") " pod="openstack-kuttl-tests/swift-proxy-664c964b6d-gxvmn" Mar 16 17:05:32 crc kubenswrapper[5120]: I0316 17:05:32.081902 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-whn4q\" (UniqueName: \"kubernetes.io/projected/c3ef2c2d-c556-439c-872c-c3e48ae34a71-kube-api-access-whn4q\") pod \"swift-proxy-664c964b6d-gxvmn\" (UID: \"c3ef2c2d-c556-439c-872c-c3e48ae34a71\") " pod="openstack-kuttl-tests/swift-proxy-664c964b6d-gxvmn" Mar 16 17:05:32 crc kubenswrapper[5120]: I0316 17:05:32.108707 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-664c964b6d-gxvmn" Mar 16 17:05:32 crc kubenswrapper[5120]: I0316 17:05:32.584216 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-proxy-664c964b6d-gxvmn"] Mar 16 17:05:33 crc kubenswrapper[5120]: I0316 17:05:33.520002 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-664c964b6d-gxvmn" event={"ID":"c3ef2c2d-c556-439c-872c-c3e48ae34a71","Type":"ContainerStarted","Data":"d80bc6369582c9774af68162d0f737c52bccd453f9b816c7e22bb11292caf25b"} Mar 16 17:05:33 crc kubenswrapper[5120]: I0316 17:05:33.520581 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-664c964b6d-gxvmn" event={"ID":"c3ef2c2d-c556-439c-872c-c3e48ae34a71","Type":"ContainerStarted","Data":"e4a1d46ba0e623133a190ddcb429fda2afa213c8683a469a7e30d5d5d4fcddfb"} Mar 16 17:05:33 crc kubenswrapper[5120]: I0316 17:05:33.520802 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-664c964b6d-gxvmn" event={"ID":"c3ef2c2d-c556-439c-872c-c3e48ae34a71","Type":"ContainerStarted","Data":"78e33624e40e941cd2cfd1aa9e8f0c80b64d5832dd2b2eeda8eccfdd956f6bc3"} Mar 16 17:05:33 crc kubenswrapper[5120]: I0316 17:05:33.520816 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/swift-proxy-664c964b6d-gxvmn" Mar 16 17:05:33 crc kubenswrapper[5120]: I0316 17:05:33.525267 5120 generic.go:358] "Generic (PLEG): container finished" podID="b0e290e3-0e59-4d06-950e-c679ec283a0b" containerID="26fedc9d06a776e7a4afc6338f3cd6eb323e61832fd0b2921a96dc91a56a705b" exitCode=0 Mar 16 17:05:33 crc kubenswrapper[5120]: I0316 17:05:33.525355 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"b0e290e3-0e59-4d06-950e-c679ec283a0b","Type":"ContainerDied","Data":"26fedc9d06a776e7a4afc6338f3cd6eb323e61832fd0b2921a96dc91a56a705b"} Mar 16 17:05:33 crc kubenswrapper[5120]: I0316 17:05:33.553416 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/swift-proxy-664c964b6d-gxvmn" podStartSLOduration=2.5533956460000002 podStartE2EDuration="2.553395646s" podCreationTimestamp="2026-03-16 17:05:31 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:05:33.544592503 +0000 UTC m=+5635.698524160" watchObservedRunningTime="2026-03-16 17:05:33.553395646 +0000 UTC m=+5635.707327303" Mar 16 17:05:33 crc kubenswrapper[5120]: I0316 17:05:33.839202 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:05:33 crc kubenswrapper[5120]: I0316 17:05:33.898089 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b0e290e3-0e59-4d06-950e-c679ec283a0b-config-data\") pod \"b0e290e3-0e59-4d06-950e-c679ec283a0b\" (UID: \"b0e290e3-0e59-4d06-950e-c679ec283a0b\") " Mar 16 17:05:33 crc kubenswrapper[5120]: I0316 17:05:33.898270 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ksgln\" (UniqueName: \"kubernetes.io/projected/b0e290e3-0e59-4d06-950e-c679ec283a0b-kube-api-access-ksgln\") pod \"b0e290e3-0e59-4d06-950e-c679ec283a0b\" (UID: \"b0e290e3-0e59-4d06-950e-c679ec283a0b\") " Mar 16 17:05:33 crc kubenswrapper[5120]: I0316 17:05:33.898507 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/b0e290e3-0e59-4d06-950e-c679ec283a0b-log-httpd\") pod \"b0e290e3-0e59-4d06-950e-c679ec283a0b\" (UID: \"b0e290e3-0e59-4d06-950e-c679ec283a0b\") " Mar 16 17:05:33 crc kubenswrapper[5120]: I0316 17:05:33.898579 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b0e290e3-0e59-4d06-950e-c679ec283a0b-combined-ca-bundle\") pod \"b0e290e3-0e59-4d06-950e-c679ec283a0b\" (UID: \"b0e290e3-0e59-4d06-950e-c679ec283a0b\") " Mar 16 17:05:33 crc kubenswrapper[5120]: I0316 17:05:33.898825 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b0e290e3-0e59-4d06-950e-c679ec283a0b-scripts\") pod \"b0e290e3-0e59-4d06-950e-c679ec283a0b\" (UID: \"b0e290e3-0e59-4d06-950e-c679ec283a0b\") " Mar 16 17:05:33 crc kubenswrapper[5120]: I0316 17:05:33.899177 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0e290e3-0e59-4d06-950e-c679ec283a0b-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "b0e290e3-0e59-4d06-950e-c679ec283a0b" (UID: "b0e290e3-0e59-4d06-950e-c679ec283a0b"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:05:33 crc kubenswrapper[5120]: I0316 17:05:33.898861 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/b0e290e3-0e59-4d06-950e-c679ec283a0b-sg-core-conf-yaml\") pod \"b0e290e3-0e59-4d06-950e-c679ec283a0b\" (UID: \"b0e290e3-0e59-4d06-950e-c679ec283a0b\") " Mar 16 17:05:33 crc kubenswrapper[5120]: I0316 17:05:33.899481 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/b0e290e3-0e59-4d06-950e-c679ec283a0b-run-httpd\") pod \"b0e290e3-0e59-4d06-950e-c679ec283a0b\" (UID: \"b0e290e3-0e59-4d06-950e-c679ec283a0b\") " Mar 16 17:05:33 crc kubenswrapper[5120]: I0316 17:05:33.899832 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0e290e3-0e59-4d06-950e-c679ec283a0b-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "b0e290e3-0e59-4d06-950e-c679ec283a0b" (UID: "b0e290e3-0e59-4d06-950e-c679ec283a0b"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:05:33 crc kubenswrapper[5120]: I0316 17:05:33.900603 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/b0e290e3-0e59-4d06-950e-c679ec283a0b-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 17:05:33 crc kubenswrapper[5120]: I0316 17:05:33.900622 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/b0e290e3-0e59-4d06-950e-c679ec283a0b-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 17:05:33 crc kubenswrapper[5120]: I0316 17:05:33.905397 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b0e290e3-0e59-4d06-950e-c679ec283a0b-scripts" (OuterVolumeSpecName: "scripts") pod "b0e290e3-0e59-4d06-950e-c679ec283a0b" (UID: "b0e290e3-0e59-4d06-950e-c679ec283a0b"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:05:33 crc kubenswrapper[5120]: I0316 17:05:33.905738 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0e290e3-0e59-4d06-950e-c679ec283a0b-kube-api-access-ksgln" (OuterVolumeSpecName: "kube-api-access-ksgln") pod "b0e290e3-0e59-4d06-950e-c679ec283a0b" (UID: "b0e290e3-0e59-4d06-950e-c679ec283a0b"). InnerVolumeSpecName "kube-api-access-ksgln". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:05:33 crc kubenswrapper[5120]: I0316 17:05:33.956379 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b0e290e3-0e59-4d06-950e-c679ec283a0b-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "b0e290e3-0e59-4d06-950e-c679ec283a0b" (UID: "b0e290e3-0e59-4d06-950e-c679ec283a0b"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:05:34 crc kubenswrapper[5120]: I0316 17:05:34.007054 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ksgln\" (UniqueName: \"kubernetes.io/projected/b0e290e3-0e59-4d06-950e-c679ec283a0b-kube-api-access-ksgln\") on node \"crc\" DevicePath \"\"" Mar 16 17:05:34 crc kubenswrapper[5120]: I0316 17:05:34.007094 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b0e290e3-0e59-4d06-950e-c679ec283a0b-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:05:34 crc kubenswrapper[5120]: I0316 17:05:34.007109 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/b0e290e3-0e59-4d06-950e-c679ec283a0b-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 17:05:34 crc kubenswrapper[5120]: I0316 17:05:34.008866 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b0e290e3-0e59-4d06-950e-c679ec283a0b-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "b0e290e3-0e59-4d06-950e-c679ec283a0b" (UID: "b0e290e3-0e59-4d06-950e-c679ec283a0b"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:05:34 crc kubenswrapper[5120]: I0316 17:05:34.012955 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b0e290e3-0e59-4d06-950e-c679ec283a0b-config-data" (OuterVolumeSpecName: "config-data") pod "b0e290e3-0e59-4d06-950e-c679ec283a0b" (UID: "b0e290e3-0e59-4d06-950e-c679ec283a0b"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:05:34 crc kubenswrapper[5120]: I0316 17:05:34.109629 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b0e290e3-0e59-4d06-950e-c679ec283a0b-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:05:34 crc kubenswrapper[5120]: I0316 17:05:34.109950 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b0e290e3-0e59-4d06-950e-c679ec283a0b-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:05:34 crc kubenswrapper[5120]: I0316 17:05:34.540594 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:05:34 crc kubenswrapper[5120]: I0316 17:05:34.544481 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"b0e290e3-0e59-4d06-950e-c679ec283a0b","Type":"ContainerDied","Data":"037c57477557d2f28f1066843fc3a09f5c5bed5e1f52c00f28137f51feec8780"} Mar 16 17:05:34 crc kubenswrapper[5120]: I0316 17:05:34.544551 5120 scope.go:117] "RemoveContainer" containerID="d6ddd4f62a73258ac1ecba0897e418a576220e1aa98057408906b7e96251c1cf" Mar 16 17:05:34 crc kubenswrapper[5120]: I0316 17:05:34.545078 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/swift-proxy-664c964b6d-gxvmn" Mar 16 17:05:34 crc kubenswrapper[5120]: I0316 17:05:34.567479 5120 scope.go:117] "RemoveContainer" containerID="2cf359425be6824b5a27038264e5f716e735cef7527a6305370e54b52ba77edf" Mar 16 17:05:34 crc kubenswrapper[5120]: I0316 17:05:34.588459 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:05:34 crc kubenswrapper[5120]: I0316 17:05:34.592944 5120 scope.go:117] "RemoveContainer" containerID="26fedc9d06a776e7a4afc6338f3cd6eb323e61832fd0b2921a96dc91a56a705b" Mar 16 17:05:34 crc kubenswrapper[5120]: I0316 17:05:34.607250 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:05:34 crc kubenswrapper[5120]: I0316 17:05:34.616627 5120 scope.go:117] "RemoveContainer" containerID="4d90c2140d1eef3f63b3dcbca1737d8f058172254b9865d71395accfda08696e" Mar 16 17:05:34 crc kubenswrapper[5120]: I0316 17:05:34.620458 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:05:34 crc kubenswrapper[5120]: I0316 17:05:34.621718 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0e290e3-0e59-4d06-950e-c679ec283a0b" containerName="sg-core" Mar 16 17:05:34 crc kubenswrapper[5120]: I0316 17:05:34.621747 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0e290e3-0e59-4d06-950e-c679ec283a0b" containerName="sg-core" Mar 16 17:05:34 crc kubenswrapper[5120]: I0316 17:05:34.621791 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0e290e3-0e59-4d06-950e-c679ec283a0b" containerName="ceilometer-notification-agent" Mar 16 17:05:34 crc kubenswrapper[5120]: I0316 17:05:34.621802 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0e290e3-0e59-4d06-950e-c679ec283a0b" containerName="ceilometer-notification-agent" Mar 16 17:05:34 crc kubenswrapper[5120]: I0316 17:05:34.621880 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0e290e3-0e59-4d06-950e-c679ec283a0b" containerName="ceilometer-central-agent" Mar 16 17:05:34 crc kubenswrapper[5120]: I0316 17:05:34.621888 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0e290e3-0e59-4d06-950e-c679ec283a0b" containerName="ceilometer-central-agent" Mar 16 17:05:34 crc kubenswrapper[5120]: I0316 17:05:34.621898 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0e290e3-0e59-4d06-950e-c679ec283a0b" containerName="proxy-httpd" Mar 16 17:05:34 crc kubenswrapper[5120]: I0316 17:05:34.621905 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0e290e3-0e59-4d06-950e-c679ec283a0b" containerName="proxy-httpd" Mar 16 17:05:34 crc kubenswrapper[5120]: I0316 17:05:34.622130 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="b0e290e3-0e59-4d06-950e-c679ec283a0b" containerName="proxy-httpd" Mar 16 17:05:34 crc kubenswrapper[5120]: I0316 17:05:34.622150 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="b0e290e3-0e59-4d06-950e-c679ec283a0b" containerName="ceilometer-notification-agent" Mar 16 17:05:34 crc kubenswrapper[5120]: I0316 17:05:34.622158 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="b0e290e3-0e59-4d06-950e-c679ec283a0b" containerName="ceilometer-central-agent" Mar 16 17:05:34 crc kubenswrapper[5120]: I0316 17:05:34.622173 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="b0e290e3-0e59-4d06-950e-c679ec283a0b" containerName="sg-core" Mar 16 17:05:34 crc kubenswrapper[5120]: I0316 17:05:34.638499 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:05:34 crc kubenswrapper[5120]: I0316 17:05:34.638663 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:05:34 crc kubenswrapper[5120]: I0316 17:05:34.641884 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 17:05:34 crc kubenswrapper[5120]: I0316 17:05:34.646184 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 17:05:34 crc kubenswrapper[5120]: I0316 17:05:34.673918 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b0e290e3-0e59-4d06-950e-c679ec283a0b" path="/var/lib/kubelet/pods/b0e290e3-0e59-4d06-950e-c679ec283a0b/volumes" Mar 16 17:05:34 crc kubenswrapper[5120]: I0316 17:05:34.725242 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/b095a10a-8eb3-4a74-a688-9ce1b98fa501-run-httpd\") pod \"ceilometer-0\" (UID: \"b095a10a-8eb3-4a74-a688-9ce1b98fa501\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:05:34 crc kubenswrapper[5120]: I0316 17:05:34.725406 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wjwh\" (UniqueName: \"kubernetes.io/projected/b095a10a-8eb3-4a74-a688-9ce1b98fa501-kube-api-access-8wjwh\") pod \"ceilometer-0\" (UID: \"b095a10a-8eb3-4a74-a688-9ce1b98fa501\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:05:34 crc kubenswrapper[5120]: I0316 17:05:34.725601 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b095a10a-8eb3-4a74-a688-9ce1b98fa501-config-data\") pod \"ceilometer-0\" (UID: \"b095a10a-8eb3-4a74-a688-9ce1b98fa501\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:05:34 crc kubenswrapper[5120]: I0316 17:05:34.725874 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/b095a10a-8eb3-4a74-a688-9ce1b98fa501-log-httpd\") pod \"ceilometer-0\" (UID: \"b095a10a-8eb3-4a74-a688-9ce1b98fa501\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:05:34 crc kubenswrapper[5120]: I0316 17:05:34.725936 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b095a10a-8eb3-4a74-a688-9ce1b98fa501-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"b095a10a-8eb3-4a74-a688-9ce1b98fa501\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:05:34 crc kubenswrapper[5120]: I0316 17:05:34.725995 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b095a10a-8eb3-4a74-a688-9ce1b98fa501-scripts\") pod \"ceilometer-0\" (UID: \"b095a10a-8eb3-4a74-a688-9ce1b98fa501\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:05:34 crc kubenswrapper[5120]: I0316 17:05:34.726078 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/b095a10a-8eb3-4a74-a688-9ce1b98fa501-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"b095a10a-8eb3-4a74-a688-9ce1b98fa501\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:05:34 crc kubenswrapper[5120]: I0316 17:05:34.828436 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8wjwh\" (UniqueName: \"kubernetes.io/projected/b095a10a-8eb3-4a74-a688-9ce1b98fa501-kube-api-access-8wjwh\") pod \"ceilometer-0\" (UID: \"b095a10a-8eb3-4a74-a688-9ce1b98fa501\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:05:34 crc kubenswrapper[5120]: I0316 17:05:34.828509 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b095a10a-8eb3-4a74-a688-9ce1b98fa501-config-data\") pod \"ceilometer-0\" (UID: \"b095a10a-8eb3-4a74-a688-9ce1b98fa501\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:05:34 crc kubenswrapper[5120]: I0316 17:05:34.828655 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/b095a10a-8eb3-4a74-a688-9ce1b98fa501-log-httpd\") pod \"ceilometer-0\" (UID: \"b095a10a-8eb3-4a74-a688-9ce1b98fa501\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:05:34 crc kubenswrapper[5120]: I0316 17:05:34.828697 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b095a10a-8eb3-4a74-a688-9ce1b98fa501-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"b095a10a-8eb3-4a74-a688-9ce1b98fa501\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:05:34 crc kubenswrapper[5120]: I0316 17:05:34.828747 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b095a10a-8eb3-4a74-a688-9ce1b98fa501-scripts\") pod \"ceilometer-0\" (UID: \"b095a10a-8eb3-4a74-a688-9ce1b98fa501\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:05:34 crc kubenswrapper[5120]: I0316 17:05:34.828846 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/b095a10a-8eb3-4a74-a688-9ce1b98fa501-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"b095a10a-8eb3-4a74-a688-9ce1b98fa501\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:05:34 crc kubenswrapper[5120]: I0316 17:05:34.828944 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/b095a10a-8eb3-4a74-a688-9ce1b98fa501-run-httpd\") pod \"ceilometer-0\" (UID: \"b095a10a-8eb3-4a74-a688-9ce1b98fa501\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:05:34 crc kubenswrapper[5120]: I0316 17:05:34.829419 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/b095a10a-8eb3-4a74-a688-9ce1b98fa501-run-httpd\") pod \"ceilometer-0\" (UID: \"b095a10a-8eb3-4a74-a688-9ce1b98fa501\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:05:34 crc kubenswrapper[5120]: I0316 17:05:34.829573 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/b095a10a-8eb3-4a74-a688-9ce1b98fa501-log-httpd\") pod \"ceilometer-0\" (UID: \"b095a10a-8eb3-4a74-a688-9ce1b98fa501\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:05:34 crc kubenswrapper[5120]: I0316 17:05:34.834487 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b095a10a-8eb3-4a74-a688-9ce1b98fa501-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"b095a10a-8eb3-4a74-a688-9ce1b98fa501\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:05:34 crc kubenswrapper[5120]: I0316 17:05:34.834565 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/b095a10a-8eb3-4a74-a688-9ce1b98fa501-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"b095a10a-8eb3-4a74-a688-9ce1b98fa501\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:05:34 crc kubenswrapper[5120]: I0316 17:05:34.836121 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b095a10a-8eb3-4a74-a688-9ce1b98fa501-config-data\") pod \"ceilometer-0\" (UID: \"b095a10a-8eb3-4a74-a688-9ce1b98fa501\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:05:34 crc kubenswrapper[5120]: I0316 17:05:34.836362 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b095a10a-8eb3-4a74-a688-9ce1b98fa501-scripts\") pod \"ceilometer-0\" (UID: \"b095a10a-8eb3-4a74-a688-9ce1b98fa501\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:05:34 crc kubenswrapper[5120]: I0316 17:05:34.860401 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wjwh\" (UniqueName: \"kubernetes.io/projected/b095a10a-8eb3-4a74-a688-9ce1b98fa501-kube-api-access-8wjwh\") pod \"ceilometer-0\" (UID: \"b095a10a-8eb3-4a74-a688-9ce1b98fa501\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:05:34 crc kubenswrapper[5120]: I0316 17:05:34.963280 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:05:35 crc kubenswrapper[5120]: I0316 17:05:35.432256 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:05:35 crc kubenswrapper[5120]: I0316 17:05:35.554245 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"b095a10a-8eb3-4a74-a688-9ce1b98fa501","Type":"ContainerStarted","Data":"204ed59093457dfd7ab1c24eade1952e4c22709dc41fe55dba2f76a6419945bf"} Mar 16 17:05:36 crc kubenswrapper[5120]: I0316 17:05:36.144687 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-78d789956f-w2p5r" Mar 16 17:05:36 crc kubenswrapper[5120]: I0316 17:05:36.267708 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g5zn5\" (UniqueName: \"kubernetes.io/projected/f3e6d999-ab20-420f-b881-a34d5781d9f9-kube-api-access-g5zn5\") pod \"f3e6d999-ab20-420f-b881-a34d5781d9f9\" (UID: \"f3e6d999-ab20-420f-b881-a34d5781d9f9\") " Mar 16 17:05:36 crc kubenswrapper[5120]: I0316 17:05:36.267833 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f3e6d999-ab20-420f-b881-a34d5781d9f9-config\") pod \"f3e6d999-ab20-420f-b881-a34d5781d9f9\" (UID: \"f3e6d999-ab20-420f-b881-a34d5781d9f9\") " Mar 16 17:05:36 crc kubenswrapper[5120]: I0316 17:05:36.268023 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f3e6d999-ab20-420f-b881-a34d5781d9f9-combined-ca-bundle\") pod \"f3e6d999-ab20-420f-b881-a34d5781d9f9\" (UID: \"f3e6d999-ab20-420f-b881-a34d5781d9f9\") " Mar 16 17:05:36 crc kubenswrapper[5120]: I0316 17:05:36.268076 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/f3e6d999-ab20-420f-b881-a34d5781d9f9-ovndb-tls-certs\") pod \"f3e6d999-ab20-420f-b881-a34d5781d9f9\" (UID: \"f3e6d999-ab20-420f-b881-a34d5781d9f9\") " Mar 16 17:05:36 crc kubenswrapper[5120]: I0316 17:05:36.268519 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/f3e6d999-ab20-420f-b881-a34d5781d9f9-httpd-config\") pod \"f3e6d999-ab20-420f-b881-a34d5781d9f9\" (UID: \"f3e6d999-ab20-420f-b881-a34d5781d9f9\") " Mar 16 17:05:36 crc kubenswrapper[5120]: I0316 17:05:36.275445 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3e6d999-ab20-420f-b881-a34d5781d9f9-kube-api-access-g5zn5" (OuterVolumeSpecName: "kube-api-access-g5zn5") pod "f3e6d999-ab20-420f-b881-a34d5781d9f9" (UID: "f3e6d999-ab20-420f-b881-a34d5781d9f9"). InnerVolumeSpecName "kube-api-access-g5zn5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:05:36 crc kubenswrapper[5120]: I0316 17:05:36.276963 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3e6d999-ab20-420f-b881-a34d5781d9f9-httpd-config" (OuterVolumeSpecName: "httpd-config") pod "f3e6d999-ab20-420f-b881-a34d5781d9f9" (UID: "f3e6d999-ab20-420f-b881-a34d5781d9f9"). InnerVolumeSpecName "httpd-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:05:36 crc kubenswrapper[5120]: I0316 17:05:36.317354 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3e6d999-ab20-420f-b881-a34d5781d9f9-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f3e6d999-ab20-420f-b881-a34d5781d9f9" (UID: "f3e6d999-ab20-420f-b881-a34d5781d9f9"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:05:36 crc kubenswrapper[5120]: I0316 17:05:36.323168 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3e6d999-ab20-420f-b881-a34d5781d9f9-config" (OuterVolumeSpecName: "config") pod "f3e6d999-ab20-420f-b881-a34d5781d9f9" (UID: "f3e6d999-ab20-420f-b881-a34d5781d9f9"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:05:36 crc kubenswrapper[5120]: I0316 17:05:36.341675 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3e6d999-ab20-420f-b881-a34d5781d9f9-ovndb-tls-certs" (OuterVolumeSpecName: "ovndb-tls-certs") pod "f3e6d999-ab20-420f-b881-a34d5781d9f9" (UID: "f3e6d999-ab20-420f-b881-a34d5781d9f9"). InnerVolumeSpecName "ovndb-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:05:36 crc kubenswrapper[5120]: I0316 17:05:36.372148 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/f3e6d999-ab20-420f-b881-a34d5781d9f9-httpd-config\") on node \"crc\" DevicePath \"\"" Mar 16 17:05:36 crc kubenswrapper[5120]: I0316 17:05:36.372192 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g5zn5\" (UniqueName: \"kubernetes.io/projected/f3e6d999-ab20-420f-b881-a34d5781d9f9-kube-api-access-g5zn5\") on node \"crc\" DevicePath \"\"" Mar 16 17:05:36 crc kubenswrapper[5120]: I0316 17:05:36.372205 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/f3e6d999-ab20-420f-b881-a34d5781d9f9-config\") on node \"crc\" DevicePath \"\"" Mar 16 17:05:36 crc kubenswrapper[5120]: I0316 17:05:36.372214 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f3e6d999-ab20-420f-b881-a34d5781d9f9-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:05:36 crc kubenswrapper[5120]: I0316 17:05:36.372224 5120 reconciler_common.go:299] "Volume detached for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/f3e6d999-ab20-420f-b881-a34d5781d9f9-ovndb-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:05:36 crc kubenswrapper[5120]: I0316 17:05:36.507974 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-92qrl"] Mar 16 17:05:36 crc kubenswrapper[5120]: I0316 17:05:36.509470 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3e6d999-ab20-420f-b881-a34d5781d9f9" containerName="neutron-api" Mar 16 17:05:36 crc kubenswrapper[5120]: I0316 17:05:36.509502 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3e6d999-ab20-420f-b881-a34d5781d9f9" containerName="neutron-api" Mar 16 17:05:36 crc kubenswrapper[5120]: I0316 17:05:36.509537 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3e6d999-ab20-420f-b881-a34d5781d9f9" containerName="neutron-httpd" Mar 16 17:05:36 crc kubenswrapper[5120]: I0316 17:05:36.509546 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3e6d999-ab20-420f-b881-a34d5781d9f9" containerName="neutron-httpd" Mar 16 17:05:36 crc kubenswrapper[5120]: I0316 17:05:36.509815 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f3e6d999-ab20-420f-b881-a34d5781d9f9" containerName="neutron-httpd" Mar 16 17:05:36 crc kubenswrapper[5120]: I0316 17:05:36.509844 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f3e6d999-ab20-420f-b881-a34d5781d9f9" containerName="neutron-api" Mar 16 17:05:36 crc kubenswrapper[5120]: I0316 17:05:36.517162 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-db-create-92qrl" Mar 16 17:05:36 crc kubenswrapper[5120]: I0316 17:05:36.532903 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-92qrl"] Mar 16 17:05:36 crc kubenswrapper[5120]: I0316 17:05:36.574016 5120 generic.go:358] "Generic (PLEG): container finished" podID="f3e6d999-ab20-420f-b881-a34d5781d9f9" containerID="5bd2bd96c8b0e3237f1b34fd6f286d5a894c9e75983172d8f7cb1abdc67c91a5" exitCode=0 Mar 16 17:05:36 crc kubenswrapper[5120]: I0316 17:05:36.575546 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-78d789956f-w2p5r" Mar 16 17:05:36 crc kubenswrapper[5120]: I0316 17:05:36.577155 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdjgl\" (UniqueName: \"kubernetes.io/projected/e5b1ed14-6bc8-4405-8d3d-bb32cd972388-kube-api-access-jdjgl\") pod \"nova-api-db-create-92qrl\" (UID: \"e5b1ed14-6bc8-4405-8d3d-bb32cd972388\") " pod="openstack-kuttl-tests/nova-api-db-create-92qrl" Mar 16 17:05:36 crc kubenswrapper[5120]: I0316 17:05:36.577254 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e5b1ed14-6bc8-4405-8d3d-bb32cd972388-operator-scripts\") pod \"nova-api-db-create-92qrl\" (UID: \"e5b1ed14-6bc8-4405-8d3d-bb32cd972388\") " pod="openstack-kuttl-tests/nova-api-db-create-92qrl" Mar 16 17:05:36 crc kubenswrapper[5120]: I0316 17:05:36.575550 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-78d789956f-w2p5r" event={"ID":"f3e6d999-ab20-420f-b881-a34d5781d9f9","Type":"ContainerDied","Data":"5bd2bd96c8b0e3237f1b34fd6f286d5a894c9e75983172d8f7cb1abdc67c91a5"} Mar 16 17:05:36 crc kubenswrapper[5120]: I0316 17:05:36.577676 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-78d789956f-w2p5r" event={"ID":"f3e6d999-ab20-420f-b881-a34d5781d9f9","Type":"ContainerDied","Data":"004bd6fca60094be80660d0d50f03444458c03398e319b202e248f01bebf4366"} Mar 16 17:05:36 crc kubenswrapper[5120]: I0316 17:05:36.577707 5120 scope.go:117] "RemoveContainer" containerID="8aea133900a3ee5ac17fab7d48ec3375790901136af846706c5e28365d7cf0ec" Mar 16 17:05:36 crc kubenswrapper[5120]: I0316 17:05:36.595079 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"b095a10a-8eb3-4a74-a688-9ce1b98fa501","Type":"ContainerStarted","Data":"891846f278b3100e050fff46c1c2b5f58814de5cc9ad178b5042235a56ff8c78"} Mar 16 17:05:36 crc kubenswrapper[5120]: I0316 17:05:36.620344 5120 scope.go:117] "RemoveContainer" containerID="5bd2bd96c8b0e3237f1b34fd6f286d5a894c9e75983172d8f7cb1abdc67c91a5" Mar 16 17:05:36 crc kubenswrapper[5120]: I0316 17:05:36.645250 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-78d789956f-w2p5r"] Mar 16 17:05:36 crc kubenswrapper[5120]: I0316 17:05:36.679708 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jdjgl\" (UniqueName: \"kubernetes.io/projected/e5b1ed14-6bc8-4405-8d3d-bb32cd972388-kube-api-access-jdjgl\") pod \"nova-api-db-create-92qrl\" (UID: \"e5b1ed14-6bc8-4405-8d3d-bb32cd972388\") " pod="openstack-kuttl-tests/nova-api-db-create-92qrl" Mar 16 17:05:36 crc kubenswrapper[5120]: I0316 17:05:36.680149 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e5b1ed14-6bc8-4405-8d3d-bb32cd972388-operator-scripts\") pod \"nova-api-db-create-92qrl\" (UID: \"e5b1ed14-6bc8-4405-8d3d-bb32cd972388\") " pod="openstack-kuttl-tests/nova-api-db-create-92qrl" Mar 16 17:05:36 crc kubenswrapper[5120]: I0316 17:05:36.683265 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e5b1ed14-6bc8-4405-8d3d-bb32cd972388-operator-scripts\") pod \"nova-api-db-create-92qrl\" (UID: \"e5b1ed14-6bc8-4405-8d3d-bb32cd972388\") " pod="openstack-kuttl-tests/nova-api-db-create-92qrl" Mar 16 17:05:36 crc kubenswrapper[5120]: I0316 17:05:36.687290 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-78d789956f-w2p5r"] Mar 16 17:05:36 crc kubenswrapper[5120]: I0316 17:05:36.691499 5120 scope.go:117] "RemoveContainer" containerID="8aea133900a3ee5ac17fab7d48ec3375790901136af846706c5e28365d7cf0ec" Mar 16 17:05:36 crc kubenswrapper[5120]: E0316 17:05:36.696234 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8aea133900a3ee5ac17fab7d48ec3375790901136af846706c5e28365d7cf0ec\": container with ID starting with 8aea133900a3ee5ac17fab7d48ec3375790901136af846706c5e28365d7cf0ec not found: ID does not exist" containerID="8aea133900a3ee5ac17fab7d48ec3375790901136af846706c5e28365d7cf0ec" Mar 16 17:05:36 crc kubenswrapper[5120]: I0316 17:05:36.696293 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8aea133900a3ee5ac17fab7d48ec3375790901136af846706c5e28365d7cf0ec"} err="failed to get container status \"8aea133900a3ee5ac17fab7d48ec3375790901136af846706c5e28365d7cf0ec\": rpc error: code = NotFound desc = could not find container \"8aea133900a3ee5ac17fab7d48ec3375790901136af846706c5e28365d7cf0ec\": container with ID starting with 8aea133900a3ee5ac17fab7d48ec3375790901136af846706c5e28365d7cf0ec not found: ID does not exist" Mar 16 17:05:36 crc kubenswrapper[5120]: I0316 17:05:36.696324 5120 scope.go:117] "RemoveContainer" containerID="5bd2bd96c8b0e3237f1b34fd6f286d5a894c9e75983172d8f7cb1abdc67c91a5" Mar 16 17:05:36 crc kubenswrapper[5120]: E0316 17:05:36.697583 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5bd2bd96c8b0e3237f1b34fd6f286d5a894c9e75983172d8f7cb1abdc67c91a5\": container with ID starting with 5bd2bd96c8b0e3237f1b34fd6f286d5a894c9e75983172d8f7cb1abdc67c91a5 not found: ID does not exist" containerID="5bd2bd96c8b0e3237f1b34fd6f286d5a894c9e75983172d8f7cb1abdc67c91a5" Mar 16 17:05:36 crc kubenswrapper[5120]: I0316 17:05:36.697695 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5bd2bd96c8b0e3237f1b34fd6f286d5a894c9e75983172d8f7cb1abdc67c91a5"} err="failed to get container status \"5bd2bd96c8b0e3237f1b34fd6f286d5a894c9e75983172d8f7cb1abdc67c91a5\": rpc error: code = NotFound desc = could not find container \"5bd2bd96c8b0e3237f1b34fd6f286d5a894c9e75983172d8f7cb1abdc67c91a5\": container with ID starting with 5bd2bd96c8b0e3237f1b34fd6f286d5a894c9e75983172d8f7cb1abdc67c91a5 not found: ID does not exist" Mar 16 17:05:36 crc kubenswrapper[5120]: I0316 17:05:36.715344 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdjgl\" (UniqueName: \"kubernetes.io/projected/e5b1ed14-6bc8-4405-8d3d-bb32cd972388-kube-api-access-jdjgl\") pod \"nova-api-db-create-92qrl\" (UID: \"e5b1ed14-6bc8-4405-8d3d-bb32cd972388\") " pod="openstack-kuttl-tests/nova-api-db-create-92qrl" Mar 16 17:05:36 crc kubenswrapper[5120]: I0316 17:05:36.742610 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-2cbe-account-create-update-46tlj"] Mar 16 17:05:36 crc kubenswrapper[5120]: I0316 17:05:36.750232 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-2cbe-account-create-update-46tlj" Mar 16 17:05:36 crc kubenswrapper[5120]: I0316 17:05:36.756080 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-db-secret\"" Mar 16 17:05:36 crc kubenswrapper[5120]: I0316 17:05:36.766807 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-tphh5"] Mar 16 17:05:36 crc kubenswrapper[5120]: I0316 17:05:36.773368 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-db-create-tphh5" Mar 16 17:05:36 crc kubenswrapper[5120]: I0316 17:05:36.788068 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-2cbe-account-create-update-46tlj"] Mar 16 17:05:36 crc kubenswrapper[5120]: I0316 17:05:36.800822 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-tphh5"] Mar 16 17:05:36 crc kubenswrapper[5120]: I0316 17:05:36.833825 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-75cx7"] Mar 16 17:05:36 crc kubenswrapper[5120]: I0316 17:05:36.838029 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-db-create-92qrl" Mar 16 17:05:36 crc kubenswrapper[5120]: I0316 17:05:36.848565 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-db-create-75cx7" Mar 16 17:05:36 crc kubenswrapper[5120]: I0316 17:05:36.856959 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-75cx7"] Mar 16 17:05:36 crc kubenswrapper[5120]: I0316 17:05:36.890898 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ee822a71-2526-491c-bbe7-59b07e4d3218-operator-scripts\") pod \"nova-api-2cbe-account-create-update-46tlj\" (UID: \"ee822a71-2526-491c-bbe7-59b07e4d3218\") " pod="openstack-kuttl-tests/nova-api-2cbe-account-create-update-46tlj" Mar 16 17:05:36 crc kubenswrapper[5120]: I0316 17:05:36.891552 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwnm6\" (UniqueName: \"kubernetes.io/projected/f62fd214-379e-4288-be75-3cb17e6bfa0c-kube-api-access-nwnm6\") pod \"nova-cell0-db-create-tphh5\" (UID: \"f62fd214-379e-4288-be75-3cb17e6bfa0c\") " pod="openstack-kuttl-tests/nova-cell0-db-create-tphh5" Mar 16 17:05:36 crc kubenswrapper[5120]: I0316 17:05:36.891724 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwvwt\" (UniqueName: \"kubernetes.io/projected/ee822a71-2526-491c-bbe7-59b07e4d3218-kube-api-access-cwvwt\") pod \"nova-api-2cbe-account-create-update-46tlj\" (UID: \"ee822a71-2526-491c-bbe7-59b07e4d3218\") " pod="openstack-kuttl-tests/nova-api-2cbe-account-create-update-46tlj" Mar 16 17:05:36 crc kubenswrapper[5120]: I0316 17:05:36.891988 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f62fd214-379e-4288-be75-3cb17e6bfa0c-operator-scripts\") pod \"nova-cell0-db-create-tphh5\" (UID: \"f62fd214-379e-4288-be75-3cb17e6bfa0c\") " pod="openstack-kuttl-tests/nova-cell0-db-create-tphh5" Mar 16 17:05:37 crc kubenswrapper[5120]: I0316 17:05:36.996545 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ee822a71-2526-491c-bbe7-59b07e4d3218-operator-scripts\") pod \"nova-api-2cbe-account-create-update-46tlj\" (UID: \"ee822a71-2526-491c-bbe7-59b07e4d3218\") " pod="openstack-kuttl-tests/nova-api-2cbe-account-create-update-46tlj" Mar 16 17:05:37 crc kubenswrapper[5120]: I0316 17:05:36.996712 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a74632f0-ed16-437d-9ae7-509101abc460-operator-scripts\") pod \"nova-cell1-db-create-75cx7\" (UID: \"a74632f0-ed16-437d-9ae7-509101abc460\") " pod="openstack-kuttl-tests/nova-cell1-db-create-75cx7" Mar 16 17:05:37 crc kubenswrapper[5120]: I0316 17:05:36.996898 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nwnm6\" (UniqueName: \"kubernetes.io/projected/f62fd214-379e-4288-be75-3cb17e6bfa0c-kube-api-access-nwnm6\") pod \"nova-cell0-db-create-tphh5\" (UID: \"f62fd214-379e-4288-be75-3cb17e6bfa0c\") " pod="openstack-kuttl-tests/nova-cell0-db-create-tphh5" Mar 16 17:05:37 crc kubenswrapper[5120]: I0316 17:05:36.996946 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7td9r\" (UniqueName: \"kubernetes.io/projected/a74632f0-ed16-437d-9ae7-509101abc460-kube-api-access-7td9r\") pod \"nova-cell1-db-create-75cx7\" (UID: \"a74632f0-ed16-437d-9ae7-509101abc460\") " pod="openstack-kuttl-tests/nova-cell1-db-create-75cx7" Mar 16 17:05:37 crc kubenswrapper[5120]: I0316 17:05:36.997001 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cwvwt\" (UniqueName: \"kubernetes.io/projected/ee822a71-2526-491c-bbe7-59b07e4d3218-kube-api-access-cwvwt\") pod \"nova-api-2cbe-account-create-update-46tlj\" (UID: \"ee822a71-2526-491c-bbe7-59b07e4d3218\") " pod="openstack-kuttl-tests/nova-api-2cbe-account-create-update-46tlj" Mar 16 17:05:37 crc kubenswrapper[5120]: I0316 17:05:36.997114 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f62fd214-379e-4288-be75-3cb17e6bfa0c-operator-scripts\") pod \"nova-cell0-db-create-tphh5\" (UID: \"f62fd214-379e-4288-be75-3cb17e6bfa0c\") " pod="openstack-kuttl-tests/nova-cell0-db-create-tphh5" Mar 16 17:05:37 crc kubenswrapper[5120]: I0316 17:05:36.998065 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f62fd214-379e-4288-be75-3cb17e6bfa0c-operator-scripts\") pod \"nova-cell0-db-create-tphh5\" (UID: \"f62fd214-379e-4288-be75-3cb17e6bfa0c\") " pod="openstack-kuttl-tests/nova-cell0-db-create-tphh5" Mar 16 17:05:37 crc kubenswrapper[5120]: I0316 17:05:36.998663 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ee822a71-2526-491c-bbe7-59b07e4d3218-operator-scripts\") pod \"nova-api-2cbe-account-create-update-46tlj\" (UID: \"ee822a71-2526-491c-bbe7-59b07e4d3218\") " pod="openstack-kuttl-tests/nova-api-2cbe-account-create-update-46tlj" Mar 16 17:05:37 crc kubenswrapper[5120]: I0316 17:05:37.004872 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-f4dc-account-create-update-j8gnr"] Mar 16 17:05:37 crc kubenswrapper[5120]: I0316 17:05:37.036392 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwnm6\" (UniqueName: \"kubernetes.io/projected/f62fd214-379e-4288-be75-3cb17e6bfa0c-kube-api-access-nwnm6\") pod \"nova-cell0-db-create-tphh5\" (UID: \"f62fd214-379e-4288-be75-3cb17e6bfa0c\") " pod="openstack-kuttl-tests/nova-cell0-db-create-tphh5" Mar 16 17:05:37 crc kubenswrapper[5120]: I0316 17:05:37.037312 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-f4dc-account-create-update-j8gnr" Mar 16 17:05:37 crc kubenswrapper[5120]: I0316 17:05:37.041523 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-db-secret\"" Mar 16 17:05:37 crc kubenswrapper[5120]: I0316 17:05:37.054378 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwvwt\" (UniqueName: \"kubernetes.io/projected/ee822a71-2526-491c-bbe7-59b07e4d3218-kube-api-access-cwvwt\") pod \"nova-api-2cbe-account-create-update-46tlj\" (UID: \"ee822a71-2526-491c-bbe7-59b07e4d3218\") " pod="openstack-kuttl-tests/nova-api-2cbe-account-create-update-46tlj" Mar 16 17:05:37 crc kubenswrapper[5120]: I0316 17:05:37.062978 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-f4dc-account-create-update-j8gnr"] Mar 16 17:05:37 crc kubenswrapper[5120]: I0316 17:05:37.095630 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-2cbe-account-create-update-46tlj" Mar 16 17:05:37 crc kubenswrapper[5120]: I0316 17:05:37.102673 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7td9r\" (UniqueName: \"kubernetes.io/projected/a74632f0-ed16-437d-9ae7-509101abc460-kube-api-access-7td9r\") pod \"nova-cell1-db-create-75cx7\" (UID: \"a74632f0-ed16-437d-9ae7-509101abc460\") " pod="openstack-kuttl-tests/nova-cell1-db-create-75cx7" Mar 16 17:05:37 crc kubenswrapper[5120]: I0316 17:05:37.102804 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tx7db\" (UniqueName: \"kubernetes.io/projected/12376f21-bf7b-4ee9-bafa-ecadf4d94c8a-kube-api-access-tx7db\") pod \"nova-cell0-f4dc-account-create-update-j8gnr\" (UID: \"12376f21-bf7b-4ee9-bafa-ecadf4d94c8a\") " pod="openstack-kuttl-tests/nova-cell0-f4dc-account-create-update-j8gnr" Mar 16 17:05:37 crc kubenswrapper[5120]: I0316 17:05:37.103086 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/12376f21-bf7b-4ee9-bafa-ecadf4d94c8a-operator-scripts\") pod \"nova-cell0-f4dc-account-create-update-j8gnr\" (UID: \"12376f21-bf7b-4ee9-bafa-ecadf4d94c8a\") " pod="openstack-kuttl-tests/nova-cell0-f4dc-account-create-update-j8gnr" Mar 16 17:05:37 crc kubenswrapper[5120]: I0316 17:05:37.103160 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a74632f0-ed16-437d-9ae7-509101abc460-operator-scripts\") pod \"nova-cell1-db-create-75cx7\" (UID: \"a74632f0-ed16-437d-9ae7-509101abc460\") " pod="openstack-kuttl-tests/nova-cell1-db-create-75cx7" Mar 16 17:05:37 crc kubenswrapper[5120]: I0316 17:05:37.103920 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a74632f0-ed16-437d-9ae7-509101abc460-operator-scripts\") pod \"nova-cell1-db-create-75cx7\" (UID: \"a74632f0-ed16-437d-9ae7-509101abc460\") " pod="openstack-kuttl-tests/nova-cell1-db-create-75cx7" Mar 16 17:05:37 crc kubenswrapper[5120]: I0316 17:05:37.128883 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-db-create-tphh5" Mar 16 17:05:37 crc kubenswrapper[5120]: I0316 17:05:37.145501 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7td9r\" (UniqueName: \"kubernetes.io/projected/a74632f0-ed16-437d-9ae7-509101abc460-kube-api-access-7td9r\") pod \"nova-cell1-db-create-75cx7\" (UID: \"a74632f0-ed16-437d-9ae7-509101abc460\") " pod="openstack-kuttl-tests/nova-cell1-db-create-75cx7" Mar 16 17:05:37 crc kubenswrapper[5120]: I0316 17:05:37.172628 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-d22a-account-create-update-6c6wl"] Mar 16 17:05:37 crc kubenswrapper[5120]: I0316 17:05:37.182576 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-d22a-account-create-update-6c6wl" Mar 16 17:05:37 crc kubenswrapper[5120]: I0316 17:05:37.186990 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-db-secret\"" Mar 16 17:05:37 crc kubenswrapper[5120]: I0316 17:05:37.202047 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-db-create-75cx7" Mar 16 17:05:37 crc kubenswrapper[5120]: I0316 17:05:37.206782 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-d22a-account-create-update-6c6wl"] Mar 16 17:05:37 crc kubenswrapper[5120]: I0316 17:05:37.211470 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/12376f21-bf7b-4ee9-bafa-ecadf4d94c8a-operator-scripts\") pod \"nova-cell0-f4dc-account-create-update-j8gnr\" (UID: \"12376f21-bf7b-4ee9-bafa-ecadf4d94c8a\") " pod="openstack-kuttl-tests/nova-cell0-f4dc-account-create-update-j8gnr" Mar 16 17:05:37 crc kubenswrapper[5120]: I0316 17:05:37.211979 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tx7db\" (UniqueName: \"kubernetes.io/projected/12376f21-bf7b-4ee9-bafa-ecadf4d94c8a-kube-api-access-tx7db\") pod \"nova-cell0-f4dc-account-create-update-j8gnr\" (UID: \"12376f21-bf7b-4ee9-bafa-ecadf4d94c8a\") " pod="openstack-kuttl-tests/nova-cell0-f4dc-account-create-update-j8gnr" Mar 16 17:05:37 crc kubenswrapper[5120]: I0316 17:05:37.222274 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/12376f21-bf7b-4ee9-bafa-ecadf4d94c8a-operator-scripts\") pod \"nova-cell0-f4dc-account-create-update-j8gnr\" (UID: \"12376f21-bf7b-4ee9-bafa-ecadf4d94c8a\") " pod="openstack-kuttl-tests/nova-cell0-f4dc-account-create-update-j8gnr" Mar 16 17:05:37 crc kubenswrapper[5120]: I0316 17:05:37.239729 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tx7db\" (UniqueName: \"kubernetes.io/projected/12376f21-bf7b-4ee9-bafa-ecadf4d94c8a-kube-api-access-tx7db\") pod \"nova-cell0-f4dc-account-create-update-j8gnr\" (UID: \"12376f21-bf7b-4ee9-bafa-ecadf4d94c8a\") " pod="openstack-kuttl-tests/nova-cell0-f4dc-account-create-update-j8gnr" Mar 16 17:05:37 crc kubenswrapper[5120]: I0316 17:05:37.316613 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2crsx\" (UniqueName: \"kubernetes.io/projected/18615479-af1d-4771-95d5-ef6581ecc5f7-kube-api-access-2crsx\") pod \"nova-cell1-d22a-account-create-update-6c6wl\" (UID: \"18615479-af1d-4771-95d5-ef6581ecc5f7\") " pod="openstack-kuttl-tests/nova-cell1-d22a-account-create-update-6c6wl" Mar 16 17:05:37 crc kubenswrapper[5120]: I0316 17:05:37.317310 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/18615479-af1d-4771-95d5-ef6581ecc5f7-operator-scripts\") pod \"nova-cell1-d22a-account-create-update-6c6wl\" (UID: \"18615479-af1d-4771-95d5-ef6581ecc5f7\") " pod="openstack-kuttl-tests/nova-cell1-d22a-account-create-update-6c6wl" Mar 16 17:05:37 crc kubenswrapper[5120]: I0316 17:05:37.419166 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2crsx\" (UniqueName: \"kubernetes.io/projected/18615479-af1d-4771-95d5-ef6581ecc5f7-kube-api-access-2crsx\") pod \"nova-cell1-d22a-account-create-update-6c6wl\" (UID: \"18615479-af1d-4771-95d5-ef6581ecc5f7\") " pod="openstack-kuttl-tests/nova-cell1-d22a-account-create-update-6c6wl" Mar 16 17:05:37 crc kubenswrapper[5120]: I0316 17:05:37.419356 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/18615479-af1d-4771-95d5-ef6581ecc5f7-operator-scripts\") pod \"nova-cell1-d22a-account-create-update-6c6wl\" (UID: \"18615479-af1d-4771-95d5-ef6581ecc5f7\") " pod="openstack-kuttl-tests/nova-cell1-d22a-account-create-update-6c6wl" Mar 16 17:05:37 crc kubenswrapper[5120]: I0316 17:05:37.420413 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/18615479-af1d-4771-95d5-ef6581ecc5f7-operator-scripts\") pod \"nova-cell1-d22a-account-create-update-6c6wl\" (UID: \"18615479-af1d-4771-95d5-ef6581ecc5f7\") " pod="openstack-kuttl-tests/nova-cell1-d22a-account-create-update-6c6wl" Mar 16 17:05:37 crc kubenswrapper[5120]: I0316 17:05:37.447487 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-f4dc-account-create-update-j8gnr" Mar 16 17:05:37 crc kubenswrapper[5120]: I0316 17:05:37.458333 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2crsx\" (UniqueName: \"kubernetes.io/projected/18615479-af1d-4771-95d5-ef6581ecc5f7-kube-api-access-2crsx\") pod \"nova-cell1-d22a-account-create-update-6c6wl\" (UID: \"18615479-af1d-4771-95d5-ef6581ecc5f7\") " pod="openstack-kuttl-tests/nova-cell1-d22a-account-create-update-6c6wl" Mar 16 17:05:37 crc kubenswrapper[5120]: I0316 17:05:37.528612 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-d22a-account-create-update-6c6wl" Mar 16 17:05:37 crc kubenswrapper[5120]: I0316 17:05:37.614792 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-92qrl"] Mar 16 17:05:37 crc kubenswrapper[5120]: I0316 17:05:37.660451 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"b095a10a-8eb3-4a74-a688-9ce1b98fa501","Type":"ContainerStarted","Data":"c4681fdef8433999209fb8af6f68e5eaf5356c009bf14387ce968b048bc9a577"} Mar 16 17:05:37 crc kubenswrapper[5120]: I0316 17:05:37.841848 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-2cbe-account-create-update-46tlj"] Mar 16 17:05:37 crc kubenswrapper[5120]: W0316 17:05:37.850774 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podee822a71_2526_491c_bbe7_59b07e4d3218.slice/crio-27afa85969aeb7eaea1e563ebe8a197a98f93638d66ad71bb14e00494b1b3e06 WatchSource:0}: Error finding container 27afa85969aeb7eaea1e563ebe8a197a98f93638d66ad71bb14e00494b1b3e06: Status 404 returned error can't find the container with id 27afa85969aeb7eaea1e563ebe8a197a98f93638d66ad71bb14e00494b1b3e06 Mar 16 17:05:37 crc kubenswrapper[5120]: W0316 17:05:37.860578 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda74632f0_ed16_437d_9ae7_509101abc460.slice/crio-08b46a26ccc0b3555e690a25a50ea49ff37699ec69599e1766980a8924ebce0d WatchSource:0}: Error finding container 08b46a26ccc0b3555e690a25a50ea49ff37699ec69599e1766980a8924ebce0d: Status 404 returned error can't find the container with id 08b46a26ccc0b3555e690a25a50ea49ff37699ec69599e1766980a8924ebce0d Mar 16 17:05:37 crc kubenswrapper[5120]: I0316 17:05:37.863279 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-75cx7"] Mar 16 17:05:38 crc kubenswrapper[5120]: I0316 17:05:38.063369 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-tphh5"] Mar 16 17:05:38 crc kubenswrapper[5120]: W0316 17:05:38.070838 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf62fd214_379e_4288_be75_3cb17e6bfa0c.slice/crio-dfb4794d8d0bbae87dee5f13ccdb68ac7feef731e0f3566625ca16ef5b8a9474 WatchSource:0}: Error finding container dfb4794d8d0bbae87dee5f13ccdb68ac7feef731e0f3566625ca16ef5b8a9474: Status 404 returned error can't find the container with id dfb4794d8d0bbae87dee5f13ccdb68ac7feef731e0f3566625ca16ef5b8a9474 Mar 16 17:05:38 crc kubenswrapper[5120]: I0316 17:05:38.211454 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-f4dc-account-create-update-j8gnr"] Mar 16 17:05:38 crc kubenswrapper[5120]: I0316 17:05:38.249258 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-d22a-account-create-update-6c6wl"] Mar 16 17:05:38 crc kubenswrapper[5120]: I0316 17:05:38.677828 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f3e6d999-ab20-420f-b881-a34d5781d9f9" path="/var/lib/kubelet/pods/f3e6d999-ab20-420f-b881-a34d5781d9f9/volumes" Mar 16 17:05:38 crc kubenswrapper[5120]: I0316 17:05:38.686147 5120 generic.go:358] "Generic (PLEG): container finished" podID="12376f21-bf7b-4ee9-bafa-ecadf4d94c8a" containerID="be187fbdf2eeb50bf613fe5d86b6fd66dc403572e0f21c95382351f0b9dd6cff" exitCode=0 Mar 16 17:05:38 crc kubenswrapper[5120]: I0316 17:05:38.686374 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-f4dc-account-create-update-j8gnr" event={"ID":"12376f21-bf7b-4ee9-bafa-ecadf4d94c8a","Type":"ContainerDied","Data":"be187fbdf2eeb50bf613fe5d86b6fd66dc403572e0f21c95382351f0b9dd6cff"} Mar 16 17:05:38 crc kubenswrapper[5120]: I0316 17:05:38.686414 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-f4dc-account-create-update-j8gnr" event={"ID":"12376f21-bf7b-4ee9-bafa-ecadf4d94c8a","Type":"ContainerStarted","Data":"58a1d90ae2b4b749b00111d8a5d29096a6e4712adf24b1c19070af6d2bd4a009"} Mar 16 17:05:38 crc kubenswrapper[5120]: I0316 17:05:38.693335 5120 generic.go:358] "Generic (PLEG): container finished" podID="f62fd214-379e-4288-be75-3cb17e6bfa0c" containerID="fa7c30386291cba51b9496e8301950e602444d271cb3d2ecf3d99150f08f1253" exitCode=0 Mar 16 17:05:38 crc kubenswrapper[5120]: I0316 17:05:38.693421 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-db-create-tphh5" event={"ID":"f62fd214-379e-4288-be75-3cb17e6bfa0c","Type":"ContainerDied","Data":"fa7c30386291cba51b9496e8301950e602444d271cb3d2ecf3d99150f08f1253"} Mar 16 17:05:38 crc kubenswrapper[5120]: I0316 17:05:38.693477 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-db-create-tphh5" event={"ID":"f62fd214-379e-4288-be75-3cb17e6bfa0c","Type":"ContainerStarted","Data":"dfb4794d8d0bbae87dee5f13ccdb68ac7feef731e0f3566625ca16ef5b8a9474"} Mar 16 17:05:38 crc kubenswrapper[5120]: I0316 17:05:38.699017 5120 generic.go:358] "Generic (PLEG): container finished" podID="a74632f0-ed16-437d-9ae7-509101abc460" containerID="000ae778638d01c693ec8a876b371b0f252038361297203e5b7cc7879f7671d2" exitCode=0 Mar 16 17:05:38 crc kubenswrapper[5120]: I0316 17:05:38.699112 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-db-create-75cx7" event={"ID":"a74632f0-ed16-437d-9ae7-509101abc460","Type":"ContainerDied","Data":"000ae778638d01c693ec8a876b371b0f252038361297203e5b7cc7879f7671d2"} Mar 16 17:05:38 crc kubenswrapper[5120]: I0316 17:05:38.699163 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-db-create-75cx7" event={"ID":"a74632f0-ed16-437d-9ae7-509101abc460","Type":"ContainerStarted","Data":"08b46a26ccc0b3555e690a25a50ea49ff37699ec69599e1766980a8924ebce0d"} Mar 16 17:05:38 crc kubenswrapper[5120]: I0316 17:05:38.710632 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"b095a10a-8eb3-4a74-a688-9ce1b98fa501","Type":"ContainerStarted","Data":"0e347f198a04af0ee84116f260d92f69253371c79e7bd7c25ea09784df47b449"} Mar 16 17:05:38 crc kubenswrapper[5120]: I0316 17:05:38.713335 5120 generic.go:358] "Generic (PLEG): container finished" podID="ee822a71-2526-491c-bbe7-59b07e4d3218" containerID="e53bfce3ac613f9572f3e64cff3234a3817a5ff8e5a3e56d3ca329d2a482bbe5" exitCode=0 Mar 16 17:05:38 crc kubenswrapper[5120]: I0316 17:05:38.713540 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-2cbe-account-create-update-46tlj" event={"ID":"ee822a71-2526-491c-bbe7-59b07e4d3218","Type":"ContainerDied","Data":"e53bfce3ac613f9572f3e64cff3234a3817a5ff8e5a3e56d3ca329d2a482bbe5"} Mar 16 17:05:38 crc kubenswrapper[5120]: I0316 17:05:38.713598 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-2cbe-account-create-update-46tlj" event={"ID":"ee822a71-2526-491c-bbe7-59b07e4d3218","Type":"ContainerStarted","Data":"27afa85969aeb7eaea1e563ebe8a197a98f93638d66ad71bb14e00494b1b3e06"} Mar 16 17:05:38 crc kubenswrapper[5120]: I0316 17:05:38.717244 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-d22a-account-create-update-6c6wl" event={"ID":"18615479-af1d-4771-95d5-ef6581ecc5f7","Type":"ContainerStarted","Data":"e413c1b55f2d515ac2346254787e44bdb69ed1697dd63457ce33161c739d4b85"} Mar 16 17:05:38 crc kubenswrapper[5120]: I0316 17:05:38.717293 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-d22a-account-create-update-6c6wl" event={"ID":"18615479-af1d-4771-95d5-ef6581ecc5f7","Type":"ContainerStarted","Data":"4db2cf502e292884afed8b4cfb526ab6e90bc7ef6a4a740d0938e966966a7736"} Mar 16 17:05:38 crc kubenswrapper[5120]: I0316 17:05:38.720828 5120 generic.go:358] "Generic (PLEG): container finished" podID="e5b1ed14-6bc8-4405-8d3d-bb32cd972388" containerID="c83720f0ab64d168c7d63f2774354f82ea2dabb1d007a18740bbdcf618972697" exitCode=0 Mar 16 17:05:38 crc kubenswrapper[5120]: I0316 17:05:38.720932 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-db-create-92qrl" event={"ID":"e5b1ed14-6bc8-4405-8d3d-bb32cd972388","Type":"ContainerDied","Data":"c83720f0ab64d168c7d63f2774354f82ea2dabb1d007a18740bbdcf618972697"} Mar 16 17:05:38 crc kubenswrapper[5120]: I0316 17:05:38.720962 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-db-create-92qrl" event={"ID":"e5b1ed14-6bc8-4405-8d3d-bb32cd972388","Type":"ContainerStarted","Data":"3ea9eac11b0ac90ce6ac64c7bed4a1b5539766485cd21bd11a512242e0813bb9"} Mar 16 17:05:39 crc kubenswrapper[5120]: I0316 17:05:39.748740 5120 generic.go:358] "Generic (PLEG): container finished" podID="18615479-af1d-4771-95d5-ef6581ecc5f7" containerID="e413c1b55f2d515ac2346254787e44bdb69ed1697dd63457ce33161c739d4b85" exitCode=0 Mar 16 17:05:39 crc kubenswrapper[5120]: I0316 17:05:39.750424 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-d22a-account-create-update-6c6wl" event={"ID":"18615479-af1d-4771-95d5-ef6581ecc5f7","Type":"ContainerDied","Data":"e413c1b55f2d515ac2346254787e44bdb69ed1697dd63457ce33161c739d4b85"} Mar 16 17:05:40 crc kubenswrapper[5120]: I0316 17:05:40.238791 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-db-create-tphh5" Mar 16 17:05:40 crc kubenswrapper[5120]: I0316 17:05:40.304705 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f62fd214-379e-4288-be75-3cb17e6bfa0c-operator-scripts\") pod \"f62fd214-379e-4288-be75-3cb17e6bfa0c\" (UID: \"f62fd214-379e-4288-be75-3cb17e6bfa0c\") " Mar 16 17:05:40 crc kubenswrapper[5120]: I0316 17:05:40.304878 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nwnm6\" (UniqueName: \"kubernetes.io/projected/f62fd214-379e-4288-be75-3cb17e6bfa0c-kube-api-access-nwnm6\") pod \"f62fd214-379e-4288-be75-3cb17e6bfa0c\" (UID: \"f62fd214-379e-4288-be75-3cb17e6bfa0c\") " Mar 16 17:05:40 crc kubenswrapper[5120]: I0316 17:05:40.308487 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f62fd214-379e-4288-be75-3cb17e6bfa0c-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "f62fd214-379e-4288-be75-3cb17e6bfa0c" (UID: "f62fd214-379e-4288-be75-3cb17e6bfa0c"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:05:40 crc kubenswrapper[5120]: I0316 17:05:40.314949 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f62fd214-379e-4288-be75-3cb17e6bfa0c-kube-api-access-nwnm6" (OuterVolumeSpecName: "kube-api-access-nwnm6") pod "f62fd214-379e-4288-be75-3cb17e6bfa0c" (UID: "f62fd214-379e-4288-be75-3cb17e6bfa0c"). InnerVolumeSpecName "kube-api-access-nwnm6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:05:40 crc kubenswrapper[5120]: I0316 17:05:40.345106 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-2cbe-account-create-update-46tlj" Mar 16 17:05:40 crc kubenswrapper[5120]: I0316 17:05:40.373211 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-db-create-92qrl" Mar 16 17:05:40 crc kubenswrapper[5120]: I0316 17:05:40.406257 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-db-create-75cx7" Mar 16 17:05:40 crc kubenswrapper[5120]: I0316 17:05:40.406504 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ee822a71-2526-491c-bbe7-59b07e4d3218-operator-scripts\") pod \"ee822a71-2526-491c-bbe7-59b07e4d3218\" (UID: \"ee822a71-2526-491c-bbe7-59b07e4d3218\") " Mar 16 17:05:40 crc kubenswrapper[5120]: I0316 17:05:40.406786 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e5b1ed14-6bc8-4405-8d3d-bb32cd972388-operator-scripts\") pod \"e5b1ed14-6bc8-4405-8d3d-bb32cd972388\" (UID: \"e5b1ed14-6bc8-4405-8d3d-bb32cd972388\") " Mar 16 17:05:40 crc kubenswrapper[5120]: I0316 17:05:40.407030 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cwvwt\" (UniqueName: \"kubernetes.io/projected/ee822a71-2526-491c-bbe7-59b07e4d3218-kube-api-access-cwvwt\") pod \"ee822a71-2526-491c-bbe7-59b07e4d3218\" (UID: \"ee822a71-2526-491c-bbe7-59b07e4d3218\") " Mar 16 17:05:40 crc kubenswrapper[5120]: I0316 17:05:40.407054 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jdjgl\" (UniqueName: \"kubernetes.io/projected/e5b1ed14-6bc8-4405-8d3d-bb32cd972388-kube-api-access-jdjgl\") pod \"e5b1ed14-6bc8-4405-8d3d-bb32cd972388\" (UID: \"e5b1ed14-6bc8-4405-8d3d-bb32cd972388\") " Mar 16 17:05:40 crc kubenswrapper[5120]: I0316 17:05:40.407406 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ee822a71-2526-491c-bbe7-59b07e4d3218-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "ee822a71-2526-491c-bbe7-59b07e4d3218" (UID: "ee822a71-2526-491c-bbe7-59b07e4d3218"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:05:40 crc kubenswrapper[5120]: I0316 17:05:40.407971 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ee822a71-2526-491c-bbe7-59b07e4d3218-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:05:40 crc kubenswrapper[5120]: I0316 17:05:40.407986 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f62fd214-379e-4288-be75-3cb17e6bfa0c-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:05:40 crc kubenswrapper[5120]: I0316 17:05:40.407996 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nwnm6\" (UniqueName: \"kubernetes.io/projected/f62fd214-379e-4288-be75-3cb17e6bfa0c-kube-api-access-nwnm6\") on node \"crc\" DevicePath \"\"" Mar 16 17:05:40 crc kubenswrapper[5120]: I0316 17:05:40.409107 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e5b1ed14-6bc8-4405-8d3d-bb32cd972388-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "e5b1ed14-6bc8-4405-8d3d-bb32cd972388" (UID: "e5b1ed14-6bc8-4405-8d3d-bb32cd972388"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:05:40 crc kubenswrapper[5120]: I0316 17:05:40.412141 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee822a71-2526-491c-bbe7-59b07e4d3218-kube-api-access-cwvwt" (OuterVolumeSpecName: "kube-api-access-cwvwt") pod "ee822a71-2526-491c-bbe7-59b07e4d3218" (UID: "ee822a71-2526-491c-bbe7-59b07e4d3218"). InnerVolumeSpecName "kube-api-access-cwvwt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:05:40 crc kubenswrapper[5120]: I0316 17:05:40.412592 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-f4dc-account-create-update-j8gnr" Mar 16 17:05:40 crc kubenswrapper[5120]: I0316 17:05:40.416638 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5b1ed14-6bc8-4405-8d3d-bb32cd972388-kube-api-access-jdjgl" (OuterVolumeSpecName: "kube-api-access-jdjgl") pod "e5b1ed14-6bc8-4405-8d3d-bb32cd972388" (UID: "e5b1ed14-6bc8-4405-8d3d-bb32cd972388"). InnerVolumeSpecName "kube-api-access-jdjgl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:05:40 crc kubenswrapper[5120]: I0316 17:05:40.423621 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-d22a-account-create-update-6c6wl" Mar 16 17:05:40 crc kubenswrapper[5120]: I0316 17:05:40.508644 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7td9r\" (UniqueName: \"kubernetes.io/projected/a74632f0-ed16-437d-9ae7-509101abc460-kube-api-access-7td9r\") pod \"a74632f0-ed16-437d-9ae7-509101abc460\" (UID: \"a74632f0-ed16-437d-9ae7-509101abc460\") " Mar 16 17:05:40 crc kubenswrapper[5120]: I0316 17:05:40.508932 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/18615479-af1d-4771-95d5-ef6581ecc5f7-operator-scripts\") pod \"18615479-af1d-4771-95d5-ef6581ecc5f7\" (UID: \"18615479-af1d-4771-95d5-ef6581ecc5f7\") " Mar 16 17:05:40 crc kubenswrapper[5120]: I0316 17:05:40.509040 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tx7db\" (UniqueName: \"kubernetes.io/projected/12376f21-bf7b-4ee9-bafa-ecadf4d94c8a-kube-api-access-tx7db\") pod \"12376f21-bf7b-4ee9-bafa-ecadf4d94c8a\" (UID: \"12376f21-bf7b-4ee9-bafa-ecadf4d94c8a\") " Mar 16 17:05:40 crc kubenswrapper[5120]: I0316 17:05:40.509067 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/12376f21-bf7b-4ee9-bafa-ecadf4d94c8a-operator-scripts\") pod \"12376f21-bf7b-4ee9-bafa-ecadf4d94c8a\" (UID: \"12376f21-bf7b-4ee9-bafa-ecadf4d94c8a\") " Mar 16 17:05:40 crc kubenswrapper[5120]: I0316 17:05:40.509225 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a74632f0-ed16-437d-9ae7-509101abc460-operator-scripts\") pod \"a74632f0-ed16-437d-9ae7-509101abc460\" (UID: \"a74632f0-ed16-437d-9ae7-509101abc460\") " Mar 16 17:05:40 crc kubenswrapper[5120]: I0316 17:05:40.509465 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2crsx\" (UniqueName: \"kubernetes.io/projected/18615479-af1d-4771-95d5-ef6581ecc5f7-kube-api-access-2crsx\") pod \"18615479-af1d-4771-95d5-ef6581ecc5f7\" (UID: \"18615479-af1d-4771-95d5-ef6581ecc5f7\") " Mar 16 17:05:40 crc kubenswrapper[5120]: I0316 17:05:40.509595 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18615479-af1d-4771-95d5-ef6581ecc5f7-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "18615479-af1d-4771-95d5-ef6581ecc5f7" (UID: "18615479-af1d-4771-95d5-ef6581ecc5f7"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:05:40 crc kubenswrapper[5120]: I0316 17:05:40.509667 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/12376f21-bf7b-4ee9-bafa-ecadf4d94c8a-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "12376f21-bf7b-4ee9-bafa-ecadf4d94c8a" (UID: "12376f21-bf7b-4ee9-bafa-ecadf4d94c8a"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:05:40 crc kubenswrapper[5120]: I0316 17:05:40.510413 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cwvwt\" (UniqueName: \"kubernetes.io/projected/ee822a71-2526-491c-bbe7-59b07e4d3218-kube-api-access-cwvwt\") on node \"crc\" DevicePath \"\"" Mar 16 17:05:40 crc kubenswrapper[5120]: I0316 17:05:40.510435 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jdjgl\" (UniqueName: \"kubernetes.io/projected/e5b1ed14-6bc8-4405-8d3d-bb32cd972388-kube-api-access-jdjgl\") on node \"crc\" DevicePath \"\"" Mar 16 17:05:40 crc kubenswrapper[5120]: I0316 17:05:40.510447 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/18615479-af1d-4771-95d5-ef6581ecc5f7-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:05:40 crc kubenswrapper[5120]: I0316 17:05:40.510455 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/12376f21-bf7b-4ee9-bafa-ecadf4d94c8a-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:05:40 crc kubenswrapper[5120]: I0316 17:05:40.510464 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e5b1ed14-6bc8-4405-8d3d-bb32cd972388-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:05:40 crc kubenswrapper[5120]: I0316 17:05:40.510847 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a74632f0-ed16-437d-9ae7-509101abc460-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "a74632f0-ed16-437d-9ae7-509101abc460" (UID: "a74632f0-ed16-437d-9ae7-509101abc460"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:05:40 crc kubenswrapper[5120]: I0316 17:05:40.512604 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a74632f0-ed16-437d-9ae7-509101abc460-kube-api-access-7td9r" (OuterVolumeSpecName: "kube-api-access-7td9r") pod "a74632f0-ed16-437d-9ae7-509101abc460" (UID: "a74632f0-ed16-437d-9ae7-509101abc460"). InnerVolumeSpecName "kube-api-access-7td9r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:05:40 crc kubenswrapper[5120]: I0316 17:05:40.515074 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18615479-af1d-4771-95d5-ef6581ecc5f7-kube-api-access-2crsx" (OuterVolumeSpecName: "kube-api-access-2crsx") pod "18615479-af1d-4771-95d5-ef6581ecc5f7" (UID: "18615479-af1d-4771-95d5-ef6581ecc5f7"). InnerVolumeSpecName "kube-api-access-2crsx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:05:40 crc kubenswrapper[5120]: I0316 17:05:40.516410 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12376f21-bf7b-4ee9-bafa-ecadf4d94c8a-kube-api-access-tx7db" (OuterVolumeSpecName: "kube-api-access-tx7db") pod "12376f21-bf7b-4ee9-bafa-ecadf4d94c8a" (UID: "12376f21-bf7b-4ee9-bafa-ecadf4d94c8a"). InnerVolumeSpecName "kube-api-access-tx7db". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:05:40 crc kubenswrapper[5120]: I0316 17:05:40.561662 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/swift-proxy-664c964b6d-gxvmn" Mar 16 17:05:40 crc kubenswrapper[5120]: I0316 17:05:40.568602 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/swift-proxy-664c964b6d-gxvmn" Mar 16 17:05:40 crc kubenswrapper[5120]: I0316 17:05:40.618896 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tx7db\" (UniqueName: \"kubernetes.io/projected/12376f21-bf7b-4ee9-bafa-ecadf4d94c8a-kube-api-access-tx7db\") on node \"crc\" DevicePath \"\"" Mar 16 17:05:40 crc kubenswrapper[5120]: I0316 17:05:40.619157 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a74632f0-ed16-437d-9ae7-509101abc460-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:05:40 crc kubenswrapper[5120]: I0316 17:05:40.619169 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2crsx\" (UniqueName: \"kubernetes.io/projected/18615479-af1d-4771-95d5-ef6581ecc5f7-kube-api-access-2crsx\") on node \"crc\" DevicePath \"\"" Mar 16 17:05:40 crc kubenswrapper[5120]: I0316 17:05:40.619182 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7td9r\" (UniqueName: \"kubernetes.io/projected/a74632f0-ed16-437d-9ae7-509101abc460-kube-api-access-7td9r\") on node \"crc\" DevicePath \"\"" Mar 16 17:05:40 crc kubenswrapper[5120]: I0316 17:05:40.761879 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-d22a-account-create-update-6c6wl" event={"ID":"18615479-af1d-4771-95d5-ef6581ecc5f7","Type":"ContainerDied","Data":"4db2cf502e292884afed8b4cfb526ab6e90bc7ef6a4a740d0938e966966a7736"} Mar 16 17:05:40 crc kubenswrapper[5120]: I0316 17:05:40.761917 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4db2cf502e292884afed8b4cfb526ab6e90bc7ef6a4a740d0938e966966a7736" Mar 16 17:05:40 crc kubenswrapper[5120]: I0316 17:05:40.762033 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-d22a-account-create-update-6c6wl" Mar 16 17:05:40 crc kubenswrapper[5120]: I0316 17:05:40.766468 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-db-create-92qrl" event={"ID":"e5b1ed14-6bc8-4405-8d3d-bb32cd972388","Type":"ContainerDied","Data":"3ea9eac11b0ac90ce6ac64c7bed4a1b5539766485cd21bd11a512242e0813bb9"} Mar 16 17:05:40 crc kubenswrapper[5120]: I0316 17:05:40.766506 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3ea9eac11b0ac90ce6ac64c7bed4a1b5539766485cd21bd11a512242e0813bb9" Mar 16 17:05:40 crc kubenswrapper[5120]: I0316 17:05:40.766526 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-db-create-92qrl" Mar 16 17:05:40 crc kubenswrapper[5120]: I0316 17:05:40.768636 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-f4dc-account-create-update-j8gnr" Mar 16 17:05:40 crc kubenswrapper[5120]: I0316 17:05:40.769046 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-f4dc-account-create-update-j8gnr" event={"ID":"12376f21-bf7b-4ee9-bafa-ecadf4d94c8a","Type":"ContainerDied","Data":"58a1d90ae2b4b749b00111d8a5d29096a6e4712adf24b1c19070af6d2bd4a009"} Mar 16 17:05:40 crc kubenswrapper[5120]: I0316 17:05:40.769093 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="58a1d90ae2b4b749b00111d8a5d29096a6e4712adf24b1c19070af6d2bd4a009" Mar 16 17:05:40 crc kubenswrapper[5120]: I0316 17:05:40.771146 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-db-create-tphh5" event={"ID":"f62fd214-379e-4288-be75-3cb17e6bfa0c","Type":"ContainerDied","Data":"dfb4794d8d0bbae87dee5f13ccdb68ac7feef731e0f3566625ca16ef5b8a9474"} Mar 16 17:05:40 crc kubenswrapper[5120]: I0316 17:05:40.771170 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dfb4794d8d0bbae87dee5f13ccdb68ac7feef731e0f3566625ca16ef5b8a9474" Mar 16 17:05:40 crc kubenswrapper[5120]: I0316 17:05:40.771157 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-db-create-tphh5" Mar 16 17:05:40 crc kubenswrapper[5120]: I0316 17:05:40.774397 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-db-create-75cx7" Mar 16 17:05:40 crc kubenswrapper[5120]: I0316 17:05:40.774405 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-db-create-75cx7" event={"ID":"a74632f0-ed16-437d-9ae7-509101abc460","Type":"ContainerDied","Data":"08b46a26ccc0b3555e690a25a50ea49ff37699ec69599e1766980a8924ebce0d"} Mar 16 17:05:40 crc kubenswrapper[5120]: I0316 17:05:40.774431 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="08b46a26ccc0b3555e690a25a50ea49ff37699ec69599e1766980a8924ebce0d" Mar 16 17:05:40 crc kubenswrapper[5120]: I0316 17:05:40.777713 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"b095a10a-8eb3-4a74-a688-9ce1b98fa501","Type":"ContainerStarted","Data":"8062dd2ce9ea1ddad53e39178bfdd16e6085fc5e451d3a6b77d164784aefe795"} Mar 16 17:05:40 crc kubenswrapper[5120]: I0316 17:05:40.777987 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:05:40 crc kubenswrapper[5120]: I0316 17:05:40.781535 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-2cbe-account-create-update-46tlj" Mar 16 17:05:40 crc kubenswrapper[5120]: I0316 17:05:40.781977 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-2cbe-account-create-update-46tlj" event={"ID":"ee822a71-2526-491c-bbe7-59b07e4d3218","Type":"ContainerDied","Data":"27afa85969aeb7eaea1e563ebe8a197a98f93638d66ad71bb14e00494b1b3e06"} Mar 16 17:05:40 crc kubenswrapper[5120]: I0316 17:05:40.782008 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="27afa85969aeb7eaea1e563ebe8a197a98f93638d66ad71bb14e00494b1b3e06" Mar 16 17:05:40 crc kubenswrapper[5120]: I0316 17:05:40.801025 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.511878355 podStartE2EDuration="6.800996392s" podCreationTimestamp="2026-03-16 17:05:34 +0000 UTC" firstStartedPulling="2026-03-16 17:05:35.420732212 +0000 UTC m=+5637.574663869" lastFinishedPulling="2026-03-16 17:05:39.709850249 +0000 UTC m=+5641.863781906" observedRunningTime="2026-03-16 17:05:40.798457191 +0000 UTC m=+5642.952388858" watchObservedRunningTime="2026-03-16 17:05:40.800996392 +0000 UTC m=+5642.954928049" Mar 16 17:05:41 crc kubenswrapper[5120]: I0316 17:05:41.427546 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:05:42 crc kubenswrapper[5120]: I0316 17:05:42.217084 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-v7jp2"] Mar 16 17:05:42 crc kubenswrapper[5120]: I0316 17:05:42.218688 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f62fd214-379e-4288-be75-3cb17e6bfa0c" containerName="mariadb-database-create" Mar 16 17:05:42 crc kubenswrapper[5120]: I0316 17:05:42.218715 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f62fd214-379e-4288-be75-3cb17e6bfa0c" containerName="mariadb-database-create" Mar 16 17:05:42 crc kubenswrapper[5120]: I0316 17:05:42.218744 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18615479-af1d-4771-95d5-ef6581ecc5f7" containerName="mariadb-account-create-update" Mar 16 17:05:42 crc kubenswrapper[5120]: I0316 17:05:42.218752 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="18615479-af1d-4771-95d5-ef6581ecc5f7" containerName="mariadb-account-create-update" Mar 16 17:05:42 crc kubenswrapper[5120]: I0316 17:05:42.218802 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a74632f0-ed16-437d-9ae7-509101abc460" containerName="mariadb-database-create" Mar 16 17:05:42 crc kubenswrapper[5120]: I0316 17:05:42.218808 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a74632f0-ed16-437d-9ae7-509101abc460" containerName="mariadb-database-create" Mar 16 17:05:42 crc kubenswrapper[5120]: I0316 17:05:42.218816 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee822a71-2526-491c-bbe7-59b07e4d3218" containerName="mariadb-account-create-update" Mar 16 17:05:42 crc kubenswrapper[5120]: I0316 17:05:42.218822 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee822a71-2526-491c-bbe7-59b07e4d3218" containerName="mariadb-account-create-update" Mar 16 17:05:42 crc kubenswrapper[5120]: I0316 17:05:42.218832 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5b1ed14-6bc8-4405-8d3d-bb32cd972388" containerName="mariadb-database-create" Mar 16 17:05:42 crc kubenswrapper[5120]: I0316 17:05:42.218838 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5b1ed14-6bc8-4405-8d3d-bb32cd972388" containerName="mariadb-database-create" Mar 16 17:05:42 crc kubenswrapper[5120]: I0316 17:05:42.218862 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12376f21-bf7b-4ee9-bafa-ecadf4d94c8a" containerName="mariadb-account-create-update" Mar 16 17:05:42 crc kubenswrapper[5120]: I0316 17:05:42.218869 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="12376f21-bf7b-4ee9-bafa-ecadf4d94c8a" containerName="mariadb-account-create-update" Mar 16 17:05:42 crc kubenswrapper[5120]: I0316 17:05:42.219023 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="18615479-af1d-4771-95d5-ef6581ecc5f7" containerName="mariadb-account-create-update" Mar 16 17:05:42 crc kubenswrapper[5120]: I0316 17:05:42.219036 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e5b1ed14-6bc8-4405-8d3d-bb32cd972388" containerName="mariadb-database-create" Mar 16 17:05:42 crc kubenswrapper[5120]: I0316 17:05:42.219049 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f62fd214-379e-4288-be75-3cb17e6bfa0c" containerName="mariadb-database-create" Mar 16 17:05:42 crc kubenswrapper[5120]: I0316 17:05:42.219062 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="12376f21-bf7b-4ee9-bafa-ecadf4d94c8a" containerName="mariadb-account-create-update" Mar 16 17:05:42 crc kubenswrapper[5120]: I0316 17:05:42.219073 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="a74632f0-ed16-437d-9ae7-509101abc460" containerName="mariadb-database-create" Mar 16 17:05:42 crc kubenswrapper[5120]: I0316 17:05:42.219082 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ee822a71-2526-491c-bbe7-59b07e4d3218" containerName="mariadb-account-create-update" Mar 16 17:05:42 crc kubenswrapper[5120]: I0316 17:05:42.230073 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-v7jp2" Mar 16 17:05:42 crc kubenswrapper[5120]: I0316 17:05:42.235311 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-nova-dockercfg-q5mt5\"" Mar 16 17:05:42 crc kubenswrapper[5120]: I0316 17:05:42.235897 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-conductor-config-data\"" Mar 16 17:05:42 crc kubenswrapper[5120]: I0316 17:05:42.238694 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-conductor-scripts\"" Mar 16 17:05:42 crc kubenswrapper[5120]: I0316 17:05:42.242440 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-v7jp2"] Mar 16 17:05:42 crc kubenswrapper[5120]: I0316 17:05:42.372707 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/35df4ab4-9f08-490e-a061-c219d8312906-combined-ca-bundle\") pod \"nova-cell0-conductor-db-sync-v7jp2\" (UID: \"35df4ab4-9f08-490e-a061-c219d8312906\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-v7jp2" Mar 16 17:05:42 crc kubenswrapper[5120]: I0316 17:05:42.372831 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znzfr\" (UniqueName: \"kubernetes.io/projected/35df4ab4-9f08-490e-a061-c219d8312906-kube-api-access-znzfr\") pod \"nova-cell0-conductor-db-sync-v7jp2\" (UID: \"35df4ab4-9f08-490e-a061-c219d8312906\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-v7jp2" Mar 16 17:05:42 crc kubenswrapper[5120]: I0316 17:05:42.373192 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/35df4ab4-9f08-490e-a061-c219d8312906-scripts\") pod \"nova-cell0-conductor-db-sync-v7jp2\" (UID: \"35df4ab4-9f08-490e-a061-c219d8312906\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-v7jp2" Mar 16 17:05:42 crc kubenswrapper[5120]: I0316 17:05:42.373434 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/35df4ab4-9f08-490e-a061-c219d8312906-config-data\") pod \"nova-cell0-conductor-db-sync-v7jp2\" (UID: \"35df4ab4-9f08-490e-a061-c219d8312906\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-v7jp2" Mar 16 17:05:42 crc kubenswrapper[5120]: I0316 17:05:42.475881 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/35df4ab4-9f08-490e-a061-c219d8312906-scripts\") pod \"nova-cell0-conductor-db-sync-v7jp2\" (UID: \"35df4ab4-9f08-490e-a061-c219d8312906\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-v7jp2" Mar 16 17:05:42 crc kubenswrapper[5120]: I0316 17:05:42.476149 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/35df4ab4-9f08-490e-a061-c219d8312906-config-data\") pod \"nova-cell0-conductor-db-sync-v7jp2\" (UID: \"35df4ab4-9f08-490e-a061-c219d8312906\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-v7jp2" Mar 16 17:05:42 crc kubenswrapper[5120]: I0316 17:05:42.476299 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/35df4ab4-9f08-490e-a061-c219d8312906-combined-ca-bundle\") pod \"nova-cell0-conductor-db-sync-v7jp2\" (UID: \"35df4ab4-9f08-490e-a061-c219d8312906\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-v7jp2" Mar 16 17:05:42 crc kubenswrapper[5120]: I0316 17:05:42.476353 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-znzfr\" (UniqueName: \"kubernetes.io/projected/35df4ab4-9f08-490e-a061-c219d8312906-kube-api-access-znzfr\") pod \"nova-cell0-conductor-db-sync-v7jp2\" (UID: \"35df4ab4-9f08-490e-a061-c219d8312906\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-v7jp2" Mar 16 17:05:42 crc kubenswrapper[5120]: I0316 17:05:42.485745 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/35df4ab4-9f08-490e-a061-c219d8312906-config-data\") pod \"nova-cell0-conductor-db-sync-v7jp2\" (UID: \"35df4ab4-9f08-490e-a061-c219d8312906\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-v7jp2" Mar 16 17:05:42 crc kubenswrapper[5120]: I0316 17:05:42.488295 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/35df4ab4-9f08-490e-a061-c219d8312906-combined-ca-bundle\") pod \"nova-cell0-conductor-db-sync-v7jp2\" (UID: \"35df4ab4-9f08-490e-a061-c219d8312906\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-v7jp2" Mar 16 17:05:42 crc kubenswrapper[5120]: I0316 17:05:42.489112 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/35df4ab4-9f08-490e-a061-c219d8312906-scripts\") pod \"nova-cell0-conductor-db-sync-v7jp2\" (UID: \"35df4ab4-9f08-490e-a061-c219d8312906\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-v7jp2" Mar 16 17:05:42 crc kubenswrapper[5120]: I0316 17:05:42.497313 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-znzfr\" (UniqueName: \"kubernetes.io/projected/35df4ab4-9f08-490e-a061-c219d8312906-kube-api-access-znzfr\") pod \"nova-cell0-conductor-db-sync-v7jp2\" (UID: \"35df4ab4-9f08-490e-a061-c219d8312906\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-v7jp2" Mar 16 17:05:42 crc kubenswrapper[5120]: I0316 17:05:42.567135 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-v7jp2" Mar 16 17:05:42 crc kubenswrapper[5120]: I0316 17:05:42.805395 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="b095a10a-8eb3-4a74-a688-9ce1b98fa501" containerName="ceilometer-central-agent" containerID="cri-o://891846f278b3100e050fff46c1c2b5f58814de5cc9ad178b5042235a56ff8c78" gracePeriod=30 Mar 16 17:05:42 crc kubenswrapper[5120]: I0316 17:05:42.805935 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="b095a10a-8eb3-4a74-a688-9ce1b98fa501" containerName="proxy-httpd" containerID="cri-o://8062dd2ce9ea1ddad53e39178bfdd16e6085fc5e451d3a6b77d164784aefe795" gracePeriod=30 Mar 16 17:05:42 crc kubenswrapper[5120]: I0316 17:05:42.805997 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="b095a10a-8eb3-4a74-a688-9ce1b98fa501" containerName="sg-core" containerID="cri-o://0e347f198a04af0ee84116f260d92f69253371c79e7bd7c25ea09784df47b449" gracePeriod=30 Mar 16 17:05:42 crc kubenswrapper[5120]: I0316 17:05:42.806039 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="b095a10a-8eb3-4a74-a688-9ce1b98fa501" containerName="ceilometer-notification-agent" containerID="cri-o://c4681fdef8433999209fb8af6f68e5eaf5356c009bf14387ce968b048bc9a577" gracePeriod=30 Mar 16 17:05:43 crc kubenswrapper[5120]: I0316 17:05:43.041616 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-v7jp2"] Mar 16 17:05:43 crc kubenswrapper[5120]: W0316 17:05:43.047169 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod35df4ab4_9f08_490e_a061_c219d8312906.slice/crio-fa6744560f037c4757c4d2d2c9718c2bceed22dd729c540b1f30b80adc7701c3 WatchSource:0}: Error finding container fa6744560f037c4757c4d2d2c9718c2bceed22dd729c540b1f30b80adc7701c3: Status 404 returned error can't find the container with id fa6744560f037c4757c4d2d2c9718c2bceed22dd729c540b1f30b80adc7701c3 Mar 16 17:05:43 crc kubenswrapper[5120]: I0316 17:05:43.816013 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-v7jp2" event={"ID":"35df4ab4-9f08-490e-a061-c219d8312906","Type":"ContainerStarted","Data":"7f035182fc6202822643fd7fab4de5ea1ef2278ad874bffd7ecb67dcd27073c6"} Mar 16 17:05:43 crc kubenswrapper[5120]: I0316 17:05:43.816370 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-v7jp2" event={"ID":"35df4ab4-9f08-490e-a061-c219d8312906","Type":"ContainerStarted","Data":"fa6744560f037c4757c4d2d2c9718c2bceed22dd729c540b1f30b80adc7701c3"} Mar 16 17:05:43 crc kubenswrapper[5120]: I0316 17:05:43.831202 5120 generic.go:358] "Generic (PLEG): container finished" podID="b095a10a-8eb3-4a74-a688-9ce1b98fa501" containerID="8062dd2ce9ea1ddad53e39178bfdd16e6085fc5e451d3a6b77d164784aefe795" exitCode=0 Mar 16 17:05:43 crc kubenswrapper[5120]: I0316 17:05:43.831242 5120 generic.go:358] "Generic (PLEG): container finished" podID="b095a10a-8eb3-4a74-a688-9ce1b98fa501" containerID="0e347f198a04af0ee84116f260d92f69253371c79e7bd7c25ea09784df47b449" exitCode=2 Mar 16 17:05:43 crc kubenswrapper[5120]: I0316 17:05:43.831250 5120 generic.go:358] "Generic (PLEG): container finished" podID="b095a10a-8eb3-4a74-a688-9ce1b98fa501" containerID="c4681fdef8433999209fb8af6f68e5eaf5356c009bf14387ce968b048bc9a577" exitCode=0 Mar 16 17:05:43 crc kubenswrapper[5120]: I0316 17:05:43.831678 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"b095a10a-8eb3-4a74-a688-9ce1b98fa501","Type":"ContainerDied","Data":"8062dd2ce9ea1ddad53e39178bfdd16e6085fc5e451d3a6b77d164784aefe795"} Mar 16 17:05:43 crc kubenswrapper[5120]: I0316 17:05:43.831719 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"b095a10a-8eb3-4a74-a688-9ce1b98fa501","Type":"ContainerDied","Data":"0e347f198a04af0ee84116f260d92f69253371c79e7bd7c25ea09784df47b449"} Mar 16 17:05:43 crc kubenswrapper[5120]: I0316 17:05:43.831733 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"b095a10a-8eb3-4a74-a688-9ce1b98fa501","Type":"ContainerDied","Data":"c4681fdef8433999209fb8af6f68e5eaf5356c009bf14387ce968b048bc9a577"} Mar 16 17:05:43 crc kubenswrapper[5120]: I0316 17:05:43.837643 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-v7jp2" podStartSLOduration=1.837628439 podStartE2EDuration="1.837628439s" podCreationTimestamp="2026-03-16 17:05:42 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:05:43.836866159 +0000 UTC m=+5645.990797816" watchObservedRunningTime="2026-03-16 17:05:43.837628439 +0000 UTC m=+5645.991560086" Mar 16 17:05:48 crc kubenswrapper[5120]: I0316 17:05:48.124555 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/community-operators-hfs9z"] Mar 16 17:05:48 crc kubenswrapper[5120]: I0316 17:05:48.139252 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-hfs9z" Mar 16 17:05:48 crc kubenswrapper[5120]: I0316 17:05:48.141133 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/community-operators-hfs9z"] Mar 16 17:05:48 crc kubenswrapper[5120]: I0316 17:05:48.231389 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/b1c7cd6c-f5b4-449c-b2a1-f92d7bb56c59-utilities\") pod \"community-operators-hfs9z\" (UID: \"b1c7cd6c-f5b4-449c-b2a1-f92d7bb56c59\") " pod="openshift-marketplace/community-operators-hfs9z" Mar 16 17:05:48 crc kubenswrapper[5120]: I0316 17:05:48.231451 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftkvd\" (UniqueName: \"kubernetes.io/projected/b1c7cd6c-f5b4-449c-b2a1-f92d7bb56c59-kube-api-access-ftkvd\") pod \"community-operators-hfs9z\" (UID: \"b1c7cd6c-f5b4-449c-b2a1-f92d7bb56c59\") " pod="openshift-marketplace/community-operators-hfs9z" Mar 16 17:05:48 crc kubenswrapper[5120]: I0316 17:05:48.231705 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/b1c7cd6c-f5b4-449c-b2a1-f92d7bb56c59-catalog-content\") pod \"community-operators-hfs9z\" (UID: \"b1c7cd6c-f5b4-449c-b2a1-f92d7bb56c59\") " pod="openshift-marketplace/community-operators-hfs9z" Mar 16 17:05:48 crc kubenswrapper[5120]: I0316 17:05:48.334912 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/b1c7cd6c-f5b4-449c-b2a1-f92d7bb56c59-utilities\") pod \"community-operators-hfs9z\" (UID: \"b1c7cd6c-f5b4-449c-b2a1-f92d7bb56c59\") " pod="openshift-marketplace/community-operators-hfs9z" Mar 16 17:05:48 crc kubenswrapper[5120]: I0316 17:05:48.335239 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ftkvd\" (UniqueName: \"kubernetes.io/projected/b1c7cd6c-f5b4-449c-b2a1-f92d7bb56c59-kube-api-access-ftkvd\") pod \"community-operators-hfs9z\" (UID: \"b1c7cd6c-f5b4-449c-b2a1-f92d7bb56c59\") " pod="openshift-marketplace/community-operators-hfs9z" Mar 16 17:05:48 crc kubenswrapper[5120]: I0316 17:05:48.335367 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/b1c7cd6c-f5b4-449c-b2a1-f92d7bb56c59-catalog-content\") pod \"community-operators-hfs9z\" (UID: \"b1c7cd6c-f5b4-449c-b2a1-f92d7bb56c59\") " pod="openshift-marketplace/community-operators-hfs9z" Mar 16 17:05:48 crc kubenswrapper[5120]: I0316 17:05:48.335590 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/b1c7cd6c-f5b4-449c-b2a1-f92d7bb56c59-utilities\") pod \"community-operators-hfs9z\" (UID: \"b1c7cd6c-f5b4-449c-b2a1-f92d7bb56c59\") " pod="openshift-marketplace/community-operators-hfs9z" Mar 16 17:05:48 crc kubenswrapper[5120]: I0316 17:05:48.335799 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/b1c7cd6c-f5b4-449c-b2a1-f92d7bb56c59-catalog-content\") pod \"community-operators-hfs9z\" (UID: \"b1c7cd6c-f5b4-449c-b2a1-f92d7bb56c59\") " pod="openshift-marketplace/community-operators-hfs9z" Mar 16 17:05:48 crc kubenswrapper[5120]: I0316 17:05:48.355448 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftkvd\" (UniqueName: \"kubernetes.io/projected/b1c7cd6c-f5b4-449c-b2a1-f92d7bb56c59-kube-api-access-ftkvd\") pod \"community-operators-hfs9z\" (UID: \"b1c7cd6c-f5b4-449c-b2a1-f92d7bb56c59\") " pod="openshift-marketplace/community-operators-hfs9z" Mar 16 17:05:48 crc kubenswrapper[5120]: I0316 17:05:48.473344 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-hfs9z" Mar 16 17:05:48 crc kubenswrapper[5120]: I0316 17:05:48.881814 5120 generic.go:358] "Generic (PLEG): container finished" podID="35df4ab4-9f08-490e-a061-c219d8312906" containerID="7f035182fc6202822643fd7fab4de5ea1ef2278ad874bffd7ecb67dcd27073c6" exitCode=0 Mar 16 17:05:48 crc kubenswrapper[5120]: I0316 17:05:48.881969 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-v7jp2" event={"ID":"35df4ab4-9f08-490e-a061-c219d8312906","Type":"ContainerDied","Data":"7f035182fc6202822643fd7fab4de5ea1ef2278ad874bffd7ecb67dcd27073c6"} Mar 16 17:05:49 crc kubenswrapper[5120]: I0316 17:05:49.017996 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/community-operators-hfs9z"] Mar 16 17:05:49 crc kubenswrapper[5120]: I0316 17:05:49.709181 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:05:49 crc kubenswrapper[5120]: I0316 17:05:49.815436 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/b095a10a-8eb3-4a74-a688-9ce1b98fa501-run-httpd\") pod \"b095a10a-8eb3-4a74-a688-9ce1b98fa501\" (UID: \"b095a10a-8eb3-4a74-a688-9ce1b98fa501\") " Mar 16 17:05:49 crc kubenswrapper[5120]: I0316 17:05:49.815870 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/b095a10a-8eb3-4a74-a688-9ce1b98fa501-sg-core-conf-yaml\") pod \"b095a10a-8eb3-4a74-a688-9ce1b98fa501\" (UID: \"b095a10a-8eb3-4a74-a688-9ce1b98fa501\") " Mar 16 17:05:49 crc kubenswrapper[5120]: I0316 17:05:49.815921 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b095a10a-8eb3-4a74-a688-9ce1b98fa501-config-data\") pod \"b095a10a-8eb3-4a74-a688-9ce1b98fa501\" (UID: \"b095a10a-8eb3-4a74-a688-9ce1b98fa501\") " Mar 16 17:05:49 crc kubenswrapper[5120]: I0316 17:05:49.816122 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/b095a10a-8eb3-4a74-a688-9ce1b98fa501-log-httpd\") pod \"b095a10a-8eb3-4a74-a688-9ce1b98fa501\" (UID: \"b095a10a-8eb3-4a74-a688-9ce1b98fa501\") " Mar 16 17:05:49 crc kubenswrapper[5120]: I0316 17:05:49.816243 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b095a10a-8eb3-4a74-a688-9ce1b98fa501-combined-ca-bundle\") pod \"b095a10a-8eb3-4a74-a688-9ce1b98fa501\" (UID: \"b095a10a-8eb3-4a74-a688-9ce1b98fa501\") " Mar 16 17:05:49 crc kubenswrapper[5120]: I0316 17:05:49.816503 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b095a10a-8eb3-4a74-a688-9ce1b98fa501-scripts\") pod \"b095a10a-8eb3-4a74-a688-9ce1b98fa501\" (UID: \"b095a10a-8eb3-4a74-a688-9ce1b98fa501\") " Mar 16 17:05:49 crc kubenswrapper[5120]: I0316 17:05:49.816580 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8wjwh\" (UniqueName: \"kubernetes.io/projected/b095a10a-8eb3-4a74-a688-9ce1b98fa501-kube-api-access-8wjwh\") pod \"b095a10a-8eb3-4a74-a688-9ce1b98fa501\" (UID: \"b095a10a-8eb3-4a74-a688-9ce1b98fa501\") " Mar 16 17:05:49 crc kubenswrapper[5120]: I0316 17:05:49.819348 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b095a10a-8eb3-4a74-a688-9ce1b98fa501-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "b095a10a-8eb3-4a74-a688-9ce1b98fa501" (UID: "b095a10a-8eb3-4a74-a688-9ce1b98fa501"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:05:49 crc kubenswrapper[5120]: I0316 17:05:49.819477 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b095a10a-8eb3-4a74-a688-9ce1b98fa501-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "b095a10a-8eb3-4a74-a688-9ce1b98fa501" (UID: "b095a10a-8eb3-4a74-a688-9ce1b98fa501"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:05:49 crc kubenswrapper[5120]: I0316 17:05:49.824471 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b095a10a-8eb3-4a74-a688-9ce1b98fa501-scripts" (OuterVolumeSpecName: "scripts") pod "b095a10a-8eb3-4a74-a688-9ce1b98fa501" (UID: "b095a10a-8eb3-4a74-a688-9ce1b98fa501"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:05:49 crc kubenswrapper[5120]: I0316 17:05:49.831067 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b095a10a-8eb3-4a74-a688-9ce1b98fa501-kube-api-access-8wjwh" (OuterVolumeSpecName: "kube-api-access-8wjwh") pod "b095a10a-8eb3-4a74-a688-9ce1b98fa501" (UID: "b095a10a-8eb3-4a74-a688-9ce1b98fa501"). InnerVolumeSpecName "kube-api-access-8wjwh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:05:49 crc kubenswrapper[5120]: I0316 17:05:49.852754 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b095a10a-8eb3-4a74-a688-9ce1b98fa501-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "b095a10a-8eb3-4a74-a688-9ce1b98fa501" (UID: "b095a10a-8eb3-4a74-a688-9ce1b98fa501"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:05:49 crc kubenswrapper[5120]: I0316 17:05:49.904880 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b095a10a-8eb3-4a74-a688-9ce1b98fa501-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "b095a10a-8eb3-4a74-a688-9ce1b98fa501" (UID: "b095a10a-8eb3-4a74-a688-9ce1b98fa501"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:05:49 crc kubenswrapper[5120]: I0316 17:05:49.905136 5120 generic.go:358] "Generic (PLEG): container finished" podID="b095a10a-8eb3-4a74-a688-9ce1b98fa501" containerID="891846f278b3100e050fff46c1c2b5f58814de5cc9ad178b5042235a56ff8c78" exitCode=0 Mar 16 17:05:49 crc kubenswrapper[5120]: I0316 17:05:49.905181 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"b095a10a-8eb3-4a74-a688-9ce1b98fa501","Type":"ContainerDied","Data":"891846f278b3100e050fff46c1c2b5f58814de5cc9ad178b5042235a56ff8c78"} Mar 16 17:05:49 crc kubenswrapper[5120]: I0316 17:05:49.905247 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"b095a10a-8eb3-4a74-a688-9ce1b98fa501","Type":"ContainerDied","Data":"204ed59093457dfd7ab1c24eade1952e4c22709dc41fe55dba2f76a6419945bf"} Mar 16 17:05:49 crc kubenswrapper[5120]: I0316 17:05:49.905267 5120 scope.go:117] "RemoveContainer" containerID="8062dd2ce9ea1ddad53e39178bfdd16e6085fc5e451d3a6b77d164784aefe795" Mar 16 17:05:49 crc kubenswrapper[5120]: I0316 17:05:49.905160 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:05:49 crc kubenswrapper[5120]: I0316 17:05:49.911082 5120 generic.go:358] "Generic (PLEG): container finished" podID="b1c7cd6c-f5b4-449c-b2a1-f92d7bb56c59" containerID="4566d8d4500761a24279232d26b1749522cbc8c2a2c6c2d251b529bb403c3a22" exitCode=0 Mar 16 17:05:49 crc kubenswrapper[5120]: I0316 17:05:49.911906 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-hfs9z" event={"ID":"b1c7cd6c-f5b4-449c-b2a1-f92d7bb56c59","Type":"ContainerDied","Data":"4566d8d4500761a24279232d26b1749522cbc8c2a2c6c2d251b529bb403c3a22"} Mar 16 17:05:49 crc kubenswrapper[5120]: I0316 17:05:49.911960 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-hfs9z" event={"ID":"b1c7cd6c-f5b4-449c-b2a1-f92d7bb56c59","Type":"ContainerStarted","Data":"58df6dca0fcc7743256100f529766c3869878e338592285732b402ceea5e97a7"} Mar 16 17:05:49 crc kubenswrapper[5120]: I0316 17:05:49.917784 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b095a10a-8eb3-4a74-a688-9ce1b98fa501-config-data" (OuterVolumeSpecName: "config-data") pod "b095a10a-8eb3-4a74-a688-9ce1b98fa501" (UID: "b095a10a-8eb3-4a74-a688-9ce1b98fa501"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:05:49 crc kubenswrapper[5120]: I0316 17:05:49.919716 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8wjwh\" (UniqueName: \"kubernetes.io/projected/b095a10a-8eb3-4a74-a688-9ce1b98fa501-kube-api-access-8wjwh\") on node \"crc\" DevicePath \"\"" Mar 16 17:05:49 crc kubenswrapper[5120]: I0316 17:05:49.919745 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/b095a10a-8eb3-4a74-a688-9ce1b98fa501-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 17:05:49 crc kubenswrapper[5120]: I0316 17:05:49.919801 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/b095a10a-8eb3-4a74-a688-9ce1b98fa501-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 17:05:49 crc kubenswrapper[5120]: I0316 17:05:49.919813 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b095a10a-8eb3-4a74-a688-9ce1b98fa501-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:05:49 crc kubenswrapper[5120]: I0316 17:05:49.919825 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/b095a10a-8eb3-4a74-a688-9ce1b98fa501-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 17:05:49 crc kubenswrapper[5120]: I0316 17:05:49.919836 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b095a10a-8eb3-4a74-a688-9ce1b98fa501-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:05:49 crc kubenswrapper[5120]: I0316 17:05:49.919846 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b095a10a-8eb3-4a74-a688-9ce1b98fa501-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:05:49 crc kubenswrapper[5120]: I0316 17:05:49.974409 5120 scope.go:117] "RemoveContainer" containerID="0e347f198a04af0ee84116f260d92f69253371c79e7bd7c25ea09784df47b449" Mar 16 17:05:50 crc kubenswrapper[5120]: I0316 17:05:50.014892 5120 scope.go:117] "RemoveContainer" containerID="c4681fdef8433999209fb8af6f68e5eaf5356c009bf14387ce968b048bc9a577" Mar 16 17:05:50 crc kubenswrapper[5120]: I0316 17:05:50.058292 5120 scope.go:117] "RemoveContainer" containerID="891846f278b3100e050fff46c1c2b5f58814de5cc9ad178b5042235a56ff8c78" Mar 16 17:05:50 crc kubenswrapper[5120]: I0316 17:05:50.098016 5120 scope.go:117] "RemoveContainer" containerID="8062dd2ce9ea1ddad53e39178bfdd16e6085fc5e451d3a6b77d164784aefe795" Mar 16 17:05:50 crc kubenswrapper[5120]: E0316 17:05:50.098630 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8062dd2ce9ea1ddad53e39178bfdd16e6085fc5e451d3a6b77d164784aefe795\": container with ID starting with 8062dd2ce9ea1ddad53e39178bfdd16e6085fc5e451d3a6b77d164784aefe795 not found: ID does not exist" containerID="8062dd2ce9ea1ddad53e39178bfdd16e6085fc5e451d3a6b77d164784aefe795" Mar 16 17:05:50 crc kubenswrapper[5120]: I0316 17:05:50.098664 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8062dd2ce9ea1ddad53e39178bfdd16e6085fc5e451d3a6b77d164784aefe795"} err="failed to get container status \"8062dd2ce9ea1ddad53e39178bfdd16e6085fc5e451d3a6b77d164784aefe795\": rpc error: code = NotFound desc = could not find container \"8062dd2ce9ea1ddad53e39178bfdd16e6085fc5e451d3a6b77d164784aefe795\": container with ID starting with 8062dd2ce9ea1ddad53e39178bfdd16e6085fc5e451d3a6b77d164784aefe795 not found: ID does not exist" Mar 16 17:05:50 crc kubenswrapper[5120]: I0316 17:05:50.098683 5120 scope.go:117] "RemoveContainer" containerID="0e347f198a04af0ee84116f260d92f69253371c79e7bd7c25ea09784df47b449" Mar 16 17:05:50 crc kubenswrapper[5120]: E0316 17:05:50.099628 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0e347f198a04af0ee84116f260d92f69253371c79e7bd7c25ea09784df47b449\": container with ID starting with 0e347f198a04af0ee84116f260d92f69253371c79e7bd7c25ea09784df47b449 not found: ID does not exist" containerID="0e347f198a04af0ee84116f260d92f69253371c79e7bd7c25ea09784df47b449" Mar 16 17:05:50 crc kubenswrapper[5120]: I0316 17:05:50.099688 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e347f198a04af0ee84116f260d92f69253371c79e7bd7c25ea09784df47b449"} err="failed to get container status \"0e347f198a04af0ee84116f260d92f69253371c79e7bd7c25ea09784df47b449\": rpc error: code = NotFound desc = could not find container \"0e347f198a04af0ee84116f260d92f69253371c79e7bd7c25ea09784df47b449\": container with ID starting with 0e347f198a04af0ee84116f260d92f69253371c79e7bd7c25ea09784df47b449 not found: ID does not exist" Mar 16 17:05:50 crc kubenswrapper[5120]: I0316 17:05:50.099720 5120 scope.go:117] "RemoveContainer" containerID="c4681fdef8433999209fb8af6f68e5eaf5356c009bf14387ce968b048bc9a577" Mar 16 17:05:50 crc kubenswrapper[5120]: E0316 17:05:50.100049 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c4681fdef8433999209fb8af6f68e5eaf5356c009bf14387ce968b048bc9a577\": container with ID starting with c4681fdef8433999209fb8af6f68e5eaf5356c009bf14387ce968b048bc9a577 not found: ID does not exist" containerID="c4681fdef8433999209fb8af6f68e5eaf5356c009bf14387ce968b048bc9a577" Mar 16 17:05:50 crc kubenswrapper[5120]: I0316 17:05:50.100078 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4681fdef8433999209fb8af6f68e5eaf5356c009bf14387ce968b048bc9a577"} err="failed to get container status \"c4681fdef8433999209fb8af6f68e5eaf5356c009bf14387ce968b048bc9a577\": rpc error: code = NotFound desc = could not find container \"c4681fdef8433999209fb8af6f68e5eaf5356c009bf14387ce968b048bc9a577\": container with ID starting with c4681fdef8433999209fb8af6f68e5eaf5356c009bf14387ce968b048bc9a577 not found: ID does not exist" Mar 16 17:05:50 crc kubenswrapper[5120]: I0316 17:05:50.100099 5120 scope.go:117] "RemoveContainer" containerID="891846f278b3100e050fff46c1c2b5f58814de5cc9ad178b5042235a56ff8c78" Mar 16 17:05:50 crc kubenswrapper[5120]: E0316 17:05:50.100491 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"891846f278b3100e050fff46c1c2b5f58814de5cc9ad178b5042235a56ff8c78\": container with ID starting with 891846f278b3100e050fff46c1c2b5f58814de5cc9ad178b5042235a56ff8c78 not found: ID does not exist" containerID="891846f278b3100e050fff46c1c2b5f58814de5cc9ad178b5042235a56ff8c78" Mar 16 17:05:50 crc kubenswrapper[5120]: I0316 17:05:50.100516 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"891846f278b3100e050fff46c1c2b5f58814de5cc9ad178b5042235a56ff8c78"} err="failed to get container status \"891846f278b3100e050fff46c1c2b5f58814de5cc9ad178b5042235a56ff8c78\": rpc error: code = NotFound desc = could not find container \"891846f278b3100e050fff46c1c2b5f58814de5cc9ad178b5042235a56ff8c78\": container with ID starting with 891846f278b3100e050fff46c1c2b5f58814de5cc9ad178b5042235a56ff8c78 not found: ID does not exist" Mar 16 17:05:50 crc kubenswrapper[5120]: I0316 17:05:50.147177 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-v7jp2" Mar 16 17:05:50 crc kubenswrapper[5120]: I0316 17:05:50.225879 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/35df4ab4-9f08-490e-a061-c219d8312906-config-data\") pod \"35df4ab4-9f08-490e-a061-c219d8312906\" (UID: \"35df4ab4-9f08-490e-a061-c219d8312906\") " Mar 16 17:05:50 crc kubenswrapper[5120]: I0316 17:05:50.226098 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/35df4ab4-9f08-490e-a061-c219d8312906-combined-ca-bundle\") pod \"35df4ab4-9f08-490e-a061-c219d8312906\" (UID: \"35df4ab4-9f08-490e-a061-c219d8312906\") " Mar 16 17:05:50 crc kubenswrapper[5120]: I0316 17:05:50.226243 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-znzfr\" (UniqueName: \"kubernetes.io/projected/35df4ab4-9f08-490e-a061-c219d8312906-kube-api-access-znzfr\") pod \"35df4ab4-9f08-490e-a061-c219d8312906\" (UID: \"35df4ab4-9f08-490e-a061-c219d8312906\") " Mar 16 17:05:50 crc kubenswrapper[5120]: I0316 17:05:50.226590 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/35df4ab4-9f08-490e-a061-c219d8312906-scripts\") pod \"35df4ab4-9f08-490e-a061-c219d8312906\" (UID: \"35df4ab4-9f08-490e-a061-c219d8312906\") " Mar 16 17:05:50 crc kubenswrapper[5120]: I0316 17:05:50.231113 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35df4ab4-9f08-490e-a061-c219d8312906-kube-api-access-znzfr" (OuterVolumeSpecName: "kube-api-access-znzfr") pod "35df4ab4-9f08-490e-a061-c219d8312906" (UID: "35df4ab4-9f08-490e-a061-c219d8312906"). InnerVolumeSpecName "kube-api-access-znzfr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:05:50 crc kubenswrapper[5120]: I0316 17:05:50.232025 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/35df4ab4-9f08-490e-a061-c219d8312906-scripts" (OuterVolumeSpecName: "scripts") pod "35df4ab4-9f08-490e-a061-c219d8312906" (UID: "35df4ab4-9f08-490e-a061-c219d8312906"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:05:50 crc kubenswrapper[5120]: I0316 17:05:50.266025 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/35df4ab4-9f08-490e-a061-c219d8312906-config-data" (OuterVolumeSpecName: "config-data") pod "35df4ab4-9f08-490e-a061-c219d8312906" (UID: "35df4ab4-9f08-490e-a061-c219d8312906"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:05:50 crc kubenswrapper[5120]: I0316 17:05:50.271140 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:05:50 crc kubenswrapper[5120]: I0316 17:05:50.271301 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/35df4ab4-9f08-490e-a061-c219d8312906-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "35df4ab4-9f08-490e-a061-c219d8312906" (UID: "35df4ab4-9f08-490e-a061-c219d8312906"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:05:50 crc kubenswrapper[5120]: I0316 17:05:50.283995 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:05:50 crc kubenswrapper[5120]: I0316 17:05:50.304704 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:05:50 crc kubenswrapper[5120]: I0316 17:05:50.305911 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b095a10a-8eb3-4a74-a688-9ce1b98fa501" containerName="ceilometer-notification-agent" Mar 16 17:05:50 crc kubenswrapper[5120]: I0316 17:05:50.305943 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="b095a10a-8eb3-4a74-a688-9ce1b98fa501" containerName="ceilometer-notification-agent" Mar 16 17:05:50 crc kubenswrapper[5120]: I0316 17:05:50.305963 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b095a10a-8eb3-4a74-a688-9ce1b98fa501" containerName="proxy-httpd" Mar 16 17:05:50 crc kubenswrapper[5120]: I0316 17:05:50.305974 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="b095a10a-8eb3-4a74-a688-9ce1b98fa501" containerName="proxy-httpd" Mar 16 17:05:50 crc kubenswrapper[5120]: I0316 17:05:50.306021 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35df4ab4-9f08-490e-a061-c219d8312906" containerName="nova-cell0-conductor-db-sync" Mar 16 17:05:50 crc kubenswrapper[5120]: I0316 17:05:50.306030 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="35df4ab4-9f08-490e-a061-c219d8312906" containerName="nova-cell0-conductor-db-sync" Mar 16 17:05:50 crc kubenswrapper[5120]: I0316 17:05:50.306062 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b095a10a-8eb3-4a74-a688-9ce1b98fa501" containerName="ceilometer-central-agent" Mar 16 17:05:50 crc kubenswrapper[5120]: I0316 17:05:50.306067 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="b095a10a-8eb3-4a74-a688-9ce1b98fa501" containerName="ceilometer-central-agent" Mar 16 17:05:50 crc kubenswrapper[5120]: I0316 17:05:50.306082 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b095a10a-8eb3-4a74-a688-9ce1b98fa501" containerName="sg-core" Mar 16 17:05:50 crc kubenswrapper[5120]: I0316 17:05:50.306088 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="b095a10a-8eb3-4a74-a688-9ce1b98fa501" containerName="sg-core" Mar 16 17:05:50 crc kubenswrapper[5120]: I0316 17:05:50.306252 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="b095a10a-8eb3-4a74-a688-9ce1b98fa501" containerName="ceilometer-central-agent" Mar 16 17:05:50 crc kubenswrapper[5120]: I0316 17:05:50.306265 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="b095a10a-8eb3-4a74-a688-9ce1b98fa501" containerName="proxy-httpd" Mar 16 17:05:50 crc kubenswrapper[5120]: I0316 17:05:50.306275 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="b095a10a-8eb3-4a74-a688-9ce1b98fa501" containerName="ceilometer-notification-agent" Mar 16 17:05:50 crc kubenswrapper[5120]: I0316 17:05:50.306294 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="35df4ab4-9f08-490e-a061-c219d8312906" containerName="nova-cell0-conductor-db-sync" Mar 16 17:05:50 crc kubenswrapper[5120]: I0316 17:05:50.306300 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="b095a10a-8eb3-4a74-a688-9ce1b98fa501" containerName="sg-core" Mar 16 17:05:50 crc kubenswrapper[5120]: I0316 17:05:50.313705 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:05:50 crc kubenswrapper[5120]: I0316 17:05:50.320843 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:05:50 crc kubenswrapper[5120]: I0316 17:05:50.324769 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 17:05:50 crc kubenswrapper[5120]: I0316 17:05:50.327186 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 17:05:50 crc kubenswrapper[5120]: I0316 17:05:50.335189 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f1e1a325-f67c-4d27-8481-cc8b1ca16544-scripts\") pod \"ceilometer-0\" (UID: \"f1e1a325-f67c-4d27-8481-cc8b1ca16544\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:05:50 crc kubenswrapper[5120]: I0316 17:05:50.336990 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f1e1a325-f67c-4d27-8481-cc8b1ca16544-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"f1e1a325-f67c-4d27-8481-cc8b1ca16544\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:05:50 crc kubenswrapper[5120]: I0316 17:05:50.337062 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/f1e1a325-f67c-4d27-8481-cc8b1ca16544-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"f1e1a325-f67c-4d27-8481-cc8b1ca16544\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:05:50 crc kubenswrapper[5120]: I0316 17:05:50.337099 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kt7p\" (UniqueName: \"kubernetes.io/projected/f1e1a325-f67c-4d27-8481-cc8b1ca16544-kube-api-access-2kt7p\") pod \"ceilometer-0\" (UID: \"f1e1a325-f67c-4d27-8481-cc8b1ca16544\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:05:50 crc kubenswrapper[5120]: I0316 17:05:50.337244 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f1e1a325-f67c-4d27-8481-cc8b1ca16544-config-data\") pod \"ceilometer-0\" (UID: \"f1e1a325-f67c-4d27-8481-cc8b1ca16544\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:05:50 crc kubenswrapper[5120]: I0316 17:05:50.337322 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f1e1a325-f67c-4d27-8481-cc8b1ca16544-log-httpd\") pod \"ceilometer-0\" (UID: \"f1e1a325-f67c-4d27-8481-cc8b1ca16544\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:05:50 crc kubenswrapper[5120]: I0316 17:05:50.337350 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f1e1a325-f67c-4d27-8481-cc8b1ca16544-run-httpd\") pod \"ceilometer-0\" (UID: \"f1e1a325-f67c-4d27-8481-cc8b1ca16544\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:05:50 crc kubenswrapper[5120]: I0316 17:05:50.337847 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/35df4ab4-9f08-490e-a061-c219d8312906-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:05:50 crc kubenswrapper[5120]: I0316 17:05:50.337896 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/35df4ab4-9f08-490e-a061-c219d8312906-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:05:50 crc kubenswrapper[5120]: I0316 17:05:50.337911 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-znzfr\" (UniqueName: \"kubernetes.io/projected/35df4ab4-9f08-490e-a061-c219d8312906-kube-api-access-znzfr\") on node \"crc\" DevicePath \"\"" Mar 16 17:05:50 crc kubenswrapper[5120]: I0316 17:05:50.337921 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/35df4ab4-9f08-490e-a061-c219d8312906-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:05:50 crc kubenswrapper[5120]: I0316 17:05:50.440793 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f1e1a325-f67c-4d27-8481-cc8b1ca16544-log-httpd\") pod \"ceilometer-0\" (UID: \"f1e1a325-f67c-4d27-8481-cc8b1ca16544\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:05:50 crc kubenswrapper[5120]: I0316 17:05:50.441364 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f1e1a325-f67c-4d27-8481-cc8b1ca16544-run-httpd\") pod \"ceilometer-0\" (UID: \"f1e1a325-f67c-4d27-8481-cc8b1ca16544\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:05:50 crc kubenswrapper[5120]: I0316 17:05:50.441425 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f1e1a325-f67c-4d27-8481-cc8b1ca16544-log-httpd\") pod \"ceilometer-0\" (UID: \"f1e1a325-f67c-4d27-8481-cc8b1ca16544\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:05:50 crc kubenswrapper[5120]: I0316 17:05:50.441853 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f1e1a325-f67c-4d27-8481-cc8b1ca16544-run-httpd\") pod \"ceilometer-0\" (UID: \"f1e1a325-f67c-4d27-8481-cc8b1ca16544\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:05:50 crc kubenswrapper[5120]: I0316 17:05:50.442121 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f1e1a325-f67c-4d27-8481-cc8b1ca16544-scripts\") pod \"ceilometer-0\" (UID: \"f1e1a325-f67c-4d27-8481-cc8b1ca16544\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:05:50 crc kubenswrapper[5120]: I0316 17:05:50.442389 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f1e1a325-f67c-4d27-8481-cc8b1ca16544-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"f1e1a325-f67c-4d27-8481-cc8b1ca16544\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:05:50 crc kubenswrapper[5120]: I0316 17:05:50.442523 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/f1e1a325-f67c-4d27-8481-cc8b1ca16544-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"f1e1a325-f67c-4d27-8481-cc8b1ca16544\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:05:50 crc kubenswrapper[5120]: I0316 17:05:50.442644 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2kt7p\" (UniqueName: \"kubernetes.io/projected/f1e1a325-f67c-4d27-8481-cc8b1ca16544-kube-api-access-2kt7p\") pod \"ceilometer-0\" (UID: \"f1e1a325-f67c-4d27-8481-cc8b1ca16544\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:05:50 crc kubenswrapper[5120]: I0316 17:05:50.442896 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f1e1a325-f67c-4d27-8481-cc8b1ca16544-config-data\") pod \"ceilometer-0\" (UID: \"f1e1a325-f67c-4d27-8481-cc8b1ca16544\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:05:50 crc kubenswrapper[5120]: I0316 17:05:50.449974 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/f1e1a325-f67c-4d27-8481-cc8b1ca16544-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"f1e1a325-f67c-4d27-8481-cc8b1ca16544\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:05:50 crc kubenswrapper[5120]: I0316 17:05:50.450807 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f1e1a325-f67c-4d27-8481-cc8b1ca16544-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"f1e1a325-f67c-4d27-8481-cc8b1ca16544\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:05:50 crc kubenswrapper[5120]: I0316 17:05:50.453357 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f1e1a325-f67c-4d27-8481-cc8b1ca16544-scripts\") pod \"ceilometer-0\" (UID: \"f1e1a325-f67c-4d27-8481-cc8b1ca16544\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:05:50 crc kubenswrapper[5120]: I0316 17:05:50.453875 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f1e1a325-f67c-4d27-8481-cc8b1ca16544-config-data\") pod \"ceilometer-0\" (UID: \"f1e1a325-f67c-4d27-8481-cc8b1ca16544\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:05:50 crc kubenswrapper[5120]: I0316 17:05:50.465999 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kt7p\" (UniqueName: \"kubernetes.io/projected/f1e1a325-f67c-4d27-8481-cc8b1ca16544-kube-api-access-2kt7p\") pod \"ceilometer-0\" (UID: \"f1e1a325-f67c-4d27-8481-cc8b1ca16544\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:05:50 crc kubenswrapper[5120]: I0316 17:05:50.638579 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:05:50 crc kubenswrapper[5120]: I0316 17:05:50.682615 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b095a10a-8eb3-4a74-a688-9ce1b98fa501" path="/var/lib/kubelet/pods/b095a10a-8eb3-4a74-a688-9ce1b98fa501/volumes" Mar 16 17:05:50 crc kubenswrapper[5120]: I0316 17:05:50.684319 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 17:05:50 crc kubenswrapper[5120]: I0316 17:05:50.707209 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 17:05:50 crc kubenswrapper[5120]: I0316 17:05:50.707514 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 17:05:50 crc kubenswrapper[5120]: I0316 17:05:50.751226 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/109878b2-8544-42b9-9602-c9d665976dfa-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"109878b2-8544-42b9-9602-c9d665976dfa\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 17:05:50 crc kubenswrapper[5120]: I0316 17:05:50.752709 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/109878b2-8544-42b9-9602-c9d665976dfa-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"109878b2-8544-42b9-9602-c9d665976dfa\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 17:05:50 crc kubenswrapper[5120]: I0316 17:05:50.752997 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ksx45\" (UniqueName: \"kubernetes.io/projected/109878b2-8544-42b9-9602-c9d665976dfa-kube-api-access-ksx45\") pod \"nova-cell0-conductor-0\" (UID: \"109878b2-8544-42b9-9602-c9d665976dfa\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 17:05:50 crc kubenswrapper[5120]: I0316 17:05:50.854917 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ksx45\" (UniqueName: \"kubernetes.io/projected/109878b2-8544-42b9-9602-c9d665976dfa-kube-api-access-ksx45\") pod \"nova-cell0-conductor-0\" (UID: \"109878b2-8544-42b9-9602-c9d665976dfa\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 17:05:50 crc kubenswrapper[5120]: I0316 17:05:50.855397 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/109878b2-8544-42b9-9602-c9d665976dfa-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"109878b2-8544-42b9-9602-c9d665976dfa\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 17:05:50 crc kubenswrapper[5120]: I0316 17:05:50.855538 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/109878b2-8544-42b9-9602-c9d665976dfa-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"109878b2-8544-42b9-9602-c9d665976dfa\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 17:05:50 crc kubenswrapper[5120]: I0316 17:05:50.868473 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/109878b2-8544-42b9-9602-c9d665976dfa-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"109878b2-8544-42b9-9602-c9d665976dfa\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 17:05:50 crc kubenswrapper[5120]: I0316 17:05:50.877228 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/109878b2-8544-42b9-9602-c9d665976dfa-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"109878b2-8544-42b9-9602-c9d665976dfa\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 17:05:50 crc kubenswrapper[5120]: I0316 17:05:50.878303 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ksx45\" (UniqueName: \"kubernetes.io/projected/109878b2-8544-42b9-9602-c9d665976dfa-kube-api-access-ksx45\") pod \"nova-cell0-conductor-0\" (UID: \"109878b2-8544-42b9-9602-c9d665976dfa\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 17:05:50 crc kubenswrapper[5120]: I0316 17:05:50.933857 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-hfs9z" event={"ID":"b1c7cd6c-f5b4-449c-b2a1-f92d7bb56c59","Type":"ContainerStarted","Data":"721f0588f0e3742c62af464e8a7e3ec3154f57768e3b04d9d2834fa3c30030de"} Mar 16 17:05:50 crc kubenswrapper[5120]: I0316 17:05:50.952622 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-v7jp2" event={"ID":"35df4ab4-9f08-490e-a061-c219d8312906","Type":"ContainerDied","Data":"fa6744560f037c4757c4d2d2c9718c2bceed22dd729c540b1f30b80adc7701c3"} Mar 16 17:05:50 crc kubenswrapper[5120]: I0316 17:05:50.952667 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fa6744560f037c4757c4d2d2c9718c2bceed22dd729c540b1f30b80adc7701c3" Mar 16 17:05:50 crc kubenswrapper[5120]: I0316 17:05:50.952740 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-v7jp2" Mar 16 17:05:51 crc kubenswrapper[5120]: I0316 17:05:51.119127 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 17:05:51 crc kubenswrapper[5120]: I0316 17:05:51.177553 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:05:51 crc kubenswrapper[5120]: W0316 17:05:51.212006 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf1e1a325_f67c_4d27_8481_cc8b1ca16544.slice/crio-ad7386ff02d28b3cc31b174be2064d6aa8d90463057868d8984b04d0967b2dac WatchSource:0}: Error finding container ad7386ff02d28b3cc31b174be2064d6aa8d90463057868d8984b04d0967b2dac: Status 404 returned error can't find the container with id ad7386ff02d28b3cc31b174be2064d6aa8d90463057868d8984b04d0967b2dac Mar 16 17:05:51 crc kubenswrapper[5120]: I0316 17:05:51.570636 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 17:05:51 crc kubenswrapper[5120]: I0316 17:05:51.984025 5120 generic.go:358] "Generic (PLEG): container finished" podID="b1c7cd6c-f5b4-449c-b2a1-f92d7bb56c59" containerID="721f0588f0e3742c62af464e8a7e3ec3154f57768e3b04d9d2834fa3c30030de" exitCode=0 Mar 16 17:05:51 crc kubenswrapper[5120]: I0316 17:05:51.984231 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-hfs9z" event={"ID":"b1c7cd6c-f5b4-449c-b2a1-f92d7bb56c59","Type":"ContainerDied","Data":"721f0588f0e3742c62af464e8a7e3ec3154f57768e3b04d9d2834fa3c30030de"} Mar 16 17:05:51 crc kubenswrapper[5120]: I0316 17:05:51.987156 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"109878b2-8544-42b9-9602-c9d665976dfa","Type":"ContainerStarted","Data":"6373a49f2ca5926b46a5e287c0c8e3e91bcb8757910f9aad9787202e32cbdc1f"} Mar 16 17:05:51 crc kubenswrapper[5120]: I0316 17:05:51.989675 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"f1e1a325-f67c-4d27-8481-cc8b1ca16544","Type":"ContainerStarted","Data":"ad7386ff02d28b3cc31b174be2064d6aa8d90463057868d8984b04d0967b2dac"} Mar 16 17:05:52 crc kubenswrapper[5120]: I0316 17:05:52.007453 5120 patch_prober.go:28] interesting pod/machine-config-daemon-7bf76 container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 17:05:52 crc kubenswrapper[5120]: I0316 17:05:52.007509 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 17:05:52 crc kubenswrapper[5120]: I0316 17:05:52.007554 5120 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" Mar 16 17:05:52 crc kubenswrapper[5120]: I0316 17:05:52.008232 5120 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="machine-config-daemon" containerStatusID={"Type":"cri-o","ID":"db39d192fa687a13805537d08ad22fed1ef362ef5027c920a616297dc55a8ea9"} pod="openshift-machine-config-operator/machine-config-daemon-7bf76" containerMessage="Container machine-config-daemon failed liveness probe, will be restarted" Mar 16 17:05:52 crc kubenswrapper[5120]: I0316 17:05:52.008286 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" containerID="cri-o://db39d192fa687a13805537d08ad22fed1ef362ef5027c920a616297dc55a8ea9" gracePeriod=600 Mar 16 17:05:52 crc kubenswrapper[5120]: I0316 17:05:52.131181 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 17:05:52 crc kubenswrapper[5120]: I0316 17:05:52.131441 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="96b6737b-826e-4600-978e-3384f064dd15" containerName="glance-log" containerID="cri-o://29a344fadbdeacf8249d20dd5c4764539985868f4fdfbb1a19f3d419cea7f7e8" gracePeriod=30 Mar 16 17:05:52 crc kubenswrapper[5120]: I0316 17:05:52.131980 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="96b6737b-826e-4600-978e-3384f064dd15" containerName="glance-httpd" containerID="cri-o://589ac4179852ce4cf654b164939e6e9d6e1c80f6a1f72bb6c82ef2efaefb63ac" gracePeriod=30 Mar 16 17:05:52 crc kubenswrapper[5120]: E0316 17:05:52.159283 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 17:05:52 crc kubenswrapper[5120]: E0316 17:05:52.173466 5120 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2275cb4_4905_4d66_a87e_8010120db2bd.slice/crio-db39d192fa687a13805537d08ad22fed1ef362ef5027c920a616297dc55a8ea9.scope\": RecentStats: unable to find data in memory cache]" Mar 16 17:05:52 crc kubenswrapper[5120]: I0316 17:05:52.410873 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/placement-654b89dc46-nkv85" Mar 16 17:05:52 crc kubenswrapper[5120]: I0316 17:05:52.842965 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 17:05:52 crc kubenswrapper[5120]: I0316 17:05:52.881646 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 17:05:52 crc kubenswrapper[5120]: I0316 17:05:52.884312 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="4b135a46-d885-4bc3-8344-f00c571b74fd" containerName="glance-httpd" containerID="cri-o://5ecccdf200fc2559f650f9b142c97a2e4cfa48901046a38edc67e81794d14036" gracePeriod=30 Mar 16 17:05:52 crc kubenswrapper[5120]: I0316 17:05:52.884204 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="4b135a46-d885-4bc3-8344-f00c571b74fd" containerName="glance-log" containerID="cri-o://b6fb75251afc9bd01783c470c45aa16184640e5c91b3ad33b86d481ff9a7fbe4" gracePeriod=30 Mar 16 17:05:52 crc kubenswrapper[5120]: I0316 17:05:52.968388 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:05:53 crc kubenswrapper[5120]: I0316 17:05:53.040449 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-hfs9z" event={"ID":"b1c7cd6c-f5b4-449c-b2a1-f92d7bb56c59","Type":"ContainerStarted","Data":"f38e885b0fdd465fddbd5430ced7e2ee57a3217b955e9a4c49b12c573be94a2c"} Mar 16 17:05:53 crc kubenswrapper[5120]: I0316 17:05:53.046804 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"109878b2-8544-42b9-9602-c9d665976dfa","Type":"ContainerStarted","Data":"8993820f9a0e78f6731cfe3132d071f83d39bacb35b813574b2d3dc5377237b4"} Mar 16 17:05:53 crc kubenswrapper[5120]: I0316 17:05:53.046903 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 17:05:53 crc kubenswrapper[5120]: I0316 17:05:53.053125 5120 generic.go:358] "Generic (PLEG): container finished" podID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerID="db39d192fa687a13805537d08ad22fed1ef362ef5027c920a616297dc55a8ea9" exitCode=0 Mar 16 17:05:53 crc kubenswrapper[5120]: I0316 17:05:53.053207 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" event={"ID":"e2275cb4-4905-4d66-a87e-8010120db2bd","Type":"ContainerDied","Data":"db39d192fa687a13805537d08ad22fed1ef362ef5027c920a616297dc55a8ea9"} Mar 16 17:05:53 crc kubenswrapper[5120]: I0316 17:05:53.053257 5120 scope.go:117] "RemoveContainer" containerID="1a8491415f508d1d670b146ede741f345c7a12252caa1b80c34ffc970e7850f6" Mar 16 17:05:53 crc kubenswrapper[5120]: I0316 17:05:53.054012 5120 scope.go:117] "RemoveContainer" containerID="db39d192fa687a13805537d08ad22fed1ef362ef5027c920a616297dc55a8ea9" Mar 16 17:05:53 crc kubenswrapper[5120]: E0316 17:05:53.055269 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 17:05:53 crc kubenswrapper[5120]: I0316 17:05:53.058006 5120 generic.go:358] "Generic (PLEG): container finished" podID="96b6737b-826e-4600-978e-3384f064dd15" containerID="29a344fadbdeacf8249d20dd5c4764539985868f4fdfbb1a19f3d419cea7f7e8" exitCode=143 Mar 16 17:05:53 crc kubenswrapper[5120]: I0316 17:05:53.058232 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"96b6737b-826e-4600-978e-3384f064dd15","Type":"ContainerDied","Data":"29a344fadbdeacf8249d20dd5c4764539985868f4fdfbb1a19f3d419cea7f7e8"} Mar 16 17:05:53 crc kubenswrapper[5120]: I0316 17:05:53.067325 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"f1e1a325-f67c-4d27-8481-cc8b1ca16544","Type":"ContainerStarted","Data":"cb8d454fd5d6f96fe29a6adb9edf420a55afe0e6278e9f8e01d74b8073f30ee1"} Mar 16 17:05:53 crc kubenswrapper[5120]: I0316 17:05:53.081372 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/community-operators-hfs9z" podStartSLOduration=4.364562737 podStartE2EDuration="5.081346399s" podCreationTimestamp="2026-03-16 17:05:48 +0000 UTC" firstStartedPulling="2026-03-16 17:05:49.91328553 +0000 UTC m=+5652.067217177" lastFinishedPulling="2026-03-16 17:05:50.630069172 +0000 UTC m=+5652.784000839" observedRunningTime="2026-03-16 17:05:53.063714281 +0000 UTC m=+5655.217645948" watchObservedRunningTime="2026-03-16 17:05:53.081346399 +0000 UTC m=+5655.235278056" Mar 16 17:05:53 crc kubenswrapper[5120]: I0316 17:05:53.129389 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podStartSLOduration=3.129365315 podStartE2EDuration="3.129365315s" podCreationTimestamp="2026-03-16 17:05:50 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:05:53.110316609 +0000 UTC m=+5655.264248276" watchObservedRunningTime="2026-03-16 17:05:53.129365315 +0000 UTC m=+5655.283296962" Mar 16 17:05:53 crc kubenswrapper[5120]: I0316 17:05:53.907023 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/placement-654b89dc46-nkv85" Mar 16 17:05:54 crc kubenswrapper[5120]: I0316 17:05:54.010692 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-784497c6b4-5g4fn"] Mar 16 17:05:54 crc kubenswrapper[5120]: I0316 17:05:54.011373 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-784497c6b4-5g4fn" podUID="16bbeb65-e9fb-4f92-9642-83ac828e09d7" containerName="placement-log" containerID="cri-o://9d2c3e8026c7db5aa800a0f4f60458365ac79b36769cf2f66fc7818d19ff1e1c" gracePeriod=30 Mar 16 17:05:54 crc kubenswrapper[5120]: I0316 17:05:54.011485 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-784497c6b4-5g4fn" podUID="16bbeb65-e9fb-4f92-9642-83ac828e09d7" containerName="placement-api" containerID="cri-o://971f6fc81706ba34789d4f2218c6bb34f3823902fa216187b0d5ec6955c4b8cd" gracePeriod=30 Mar 16 17:05:54 crc kubenswrapper[5120]: I0316 17:05:54.108575 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"f1e1a325-f67c-4d27-8481-cc8b1ca16544","Type":"ContainerStarted","Data":"330cc0aa03e6f2c6d0aa3277cd49c36db34efa5f48e8b1c37afcf9735a44e1f1"} Mar 16 17:05:54 crc kubenswrapper[5120]: I0316 17:05:54.128930 5120 generic.go:358] "Generic (PLEG): container finished" podID="4b135a46-d885-4bc3-8344-f00c571b74fd" containerID="b6fb75251afc9bd01783c470c45aa16184640e5c91b3ad33b86d481ff9a7fbe4" exitCode=143 Mar 16 17:05:54 crc kubenswrapper[5120]: I0316 17:05:54.129327 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"4b135a46-d885-4bc3-8344-f00c571b74fd","Type":"ContainerDied","Data":"b6fb75251afc9bd01783c470c45aa16184640e5c91b3ad33b86d481ff9a7fbe4"} Mar 16 17:05:54 crc kubenswrapper[5120]: I0316 17:05:54.144736 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="109878b2-8544-42b9-9602-c9d665976dfa" containerName="nova-cell0-conductor-conductor" containerID="cri-o://8993820f9a0e78f6731cfe3132d071f83d39bacb35b813574b2d3dc5377237b4" gracePeriod=30 Mar 16 17:05:55 crc kubenswrapper[5120]: I0316 17:05:55.156947 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"f1e1a325-f67c-4d27-8481-cc8b1ca16544","Type":"ContainerStarted","Data":"5f11fe9c300aadc98f27a5b7c9ab43408d490f0eeb54de93b11fdca9e195338e"} Mar 16 17:05:55 crc kubenswrapper[5120]: I0316 17:05:55.159835 5120 generic.go:358] "Generic (PLEG): container finished" podID="16bbeb65-e9fb-4f92-9642-83ac828e09d7" containerID="9d2c3e8026c7db5aa800a0f4f60458365ac79b36769cf2f66fc7818d19ff1e1c" exitCode=143 Mar 16 17:05:55 crc kubenswrapper[5120]: I0316 17:05:55.159911 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-784497c6b4-5g4fn" event={"ID":"16bbeb65-e9fb-4f92-9642-83ac828e09d7","Type":"ContainerDied","Data":"9d2c3e8026c7db5aa800a0f4f60458365ac79b36769cf2f66fc7818d19ff1e1c"} Mar 16 17:05:55 crc kubenswrapper[5120]: I0316 17:05:55.868786 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:05:56 crc kubenswrapper[5120]: I0316 17:05:56.008379 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/96b6737b-826e-4600-978e-3384f064dd15-httpd-run\") pod \"96b6737b-826e-4600-978e-3384f064dd15\" (UID: \"96b6737b-826e-4600-978e-3384f064dd15\") " Mar 16 17:05:56 crc kubenswrapper[5120]: I0316 17:05:56.008449 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/96b6737b-826e-4600-978e-3384f064dd15-scripts\") pod \"96b6737b-826e-4600-978e-3384f064dd15\" (UID: \"96b6737b-826e-4600-978e-3384f064dd15\") " Mar 16 17:05:56 crc kubenswrapper[5120]: I0316 17:05:56.008472 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/96b6737b-826e-4600-978e-3384f064dd15-config-data\") pod \"96b6737b-826e-4600-978e-3384f064dd15\" (UID: \"96b6737b-826e-4600-978e-3384f064dd15\") " Mar 16 17:05:56 crc kubenswrapper[5120]: I0316 17:05:56.008685 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"96b6737b-826e-4600-978e-3384f064dd15\" (UID: \"96b6737b-826e-4600-978e-3384f064dd15\") " Mar 16 17:05:56 crc kubenswrapper[5120]: I0316 17:05:56.008789 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xr7qv\" (UniqueName: \"kubernetes.io/projected/96b6737b-826e-4600-978e-3384f064dd15-kube-api-access-xr7qv\") pod \"96b6737b-826e-4600-978e-3384f064dd15\" (UID: \"96b6737b-826e-4600-978e-3384f064dd15\") " Mar 16 17:05:56 crc kubenswrapper[5120]: I0316 17:05:56.008849 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/96b6737b-826e-4600-978e-3384f064dd15-public-tls-certs\") pod \"96b6737b-826e-4600-978e-3384f064dd15\" (UID: \"96b6737b-826e-4600-978e-3384f064dd15\") " Mar 16 17:05:56 crc kubenswrapper[5120]: I0316 17:05:56.009015 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96b6737b-826e-4600-978e-3384f064dd15-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "96b6737b-826e-4600-978e-3384f064dd15" (UID: "96b6737b-826e-4600-978e-3384f064dd15"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:05:56 crc kubenswrapper[5120]: I0316 17:05:56.009025 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/96b6737b-826e-4600-978e-3384f064dd15-combined-ca-bundle\") pod \"96b6737b-826e-4600-978e-3384f064dd15\" (UID: \"96b6737b-826e-4600-978e-3384f064dd15\") " Mar 16 17:05:56 crc kubenswrapper[5120]: I0316 17:05:56.009142 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/96b6737b-826e-4600-978e-3384f064dd15-logs\") pod \"96b6737b-826e-4600-978e-3384f064dd15\" (UID: \"96b6737b-826e-4600-978e-3384f064dd15\") " Mar 16 17:05:56 crc kubenswrapper[5120]: I0316 17:05:56.009468 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96b6737b-826e-4600-978e-3384f064dd15-logs" (OuterVolumeSpecName: "logs") pod "96b6737b-826e-4600-978e-3384f064dd15" (UID: "96b6737b-826e-4600-978e-3384f064dd15"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:05:56 crc kubenswrapper[5120]: I0316 17:05:56.010244 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/96b6737b-826e-4600-978e-3384f064dd15-logs\") on node \"crc\" DevicePath \"\"" Mar 16 17:05:56 crc kubenswrapper[5120]: I0316 17:05:56.010278 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/96b6737b-826e-4600-978e-3384f064dd15-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 17:05:56 crc kubenswrapper[5120]: I0316 17:05:56.026972 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96b6737b-826e-4600-978e-3384f064dd15-scripts" (OuterVolumeSpecName: "scripts") pod "96b6737b-826e-4600-978e-3384f064dd15" (UID: "96b6737b-826e-4600-978e-3384f064dd15"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:05:56 crc kubenswrapper[5120]: I0316 17:05:56.027000 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96b6737b-826e-4600-978e-3384f064dd15-kube-api-access-xr7qv" (OuterVolumeSpecName: "kube-api-access-xr7qv") pod "96b6737b-826e-4600-978e-3384f064dd15" (UID: "96b6737b-826e-4600-978e-3384f064dd15"). InnerVolumeSpecName "kube-api-access-xr7qv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:05:56 crc kubenswrapper[5120]: I0316 17:05:56.027046 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage05-crc" (OuterVolumeSpecName: "glance") pod "96b6737b-826e-4600-978e-3384f064dd15" (UID: "96b6737b-826e-4600-978e-3384f064dd15"). InnerVolumeSpecName "local-storage05-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 17:05:56 crc kubenswrapper[5120]: I0316 17:05:56.045457 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96b6737b-826e-4600-978e-3384f064dd15-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "96b6737b-826e-4600-978e-3384f064dd15" (UID: "96b6737b-826e-4600-978e-3384f064dd15"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:05:56 crc kubenswrapper[5120]: I0316 17:05:56.090587 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96b6737b-826e-4600-978e-3384f064dd15-config-data" (OuterVolumeSpecName: "config-data") pod "96b6737b-826e-4600-978e-3384f064dd15" (UID: "96b6737b-826e-4600-978e-3384f064dd15"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:05:56 crc kubenswrapper[5120]: I0316 17:05:56.094312 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96b6737b-826e-4600-978e-3384f064dd15-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "96b6737b-826e-4600-978e-3384f064dd15" (UID: "96b6737b-826e-4600-978e-3384f064dd15"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:05:56 crc kubenswrapper[5120]: I0316 17:05:56.111995 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/96b6737b-826e-4600-978e-3384f064dd15-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:05:56 crc kubenswrapper[5120]: I0316 17:05:56.112028 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/96b6737b-826e-4600-978e-3384f064dd15-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:05:56 crc kubenswrapper[5120]: I0316 17:05:56.112059 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") on node \"crc\" " Mar 16 17:05:56 crc kubenswrapper[5120]: I0316 17:05:56.112068 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xr7qv\" (UniqueName: \"kubernetes.io/projected/96b6737b-826e-4600-978e-3384f064dd15-kube-api-access-xr7qv\") on node \"crc\" DevicePath \"\"" Mar 16 17:05:56 crc kubenswrapper[5120]: I0316 17:05:56.112078 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/96b6737b-826e-4600-978e-3384f064dd15-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:05:56 crc kubenswrapper[5120]: I0316 17:05:56.112089 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/96b6737b-826e-4600-978e-3384f064dd15-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:05:56 crc kubenswrapper[5120]: I0316 17:05:56.162277 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage05-crc" (UniqueName: "kubernetes.io/local-volume/local-storage05-crc") on node "crc" Mar 16 17:05:56 crc kubenswrapper[5120]: I0316 17:05:56.179014 5120 generic.go:358] "Generic (PLEG): container finished" podID="4b135a46-d885-4bc3-8344-f00c571b74fd" containerID="5ecccdf200fc2559f650f9b142c97a2e4cfa48901046a38edc67e81794d14036" exitCode=0 Mar 16 17:05:56 crc kubenswrapper[5120]: I0316 17:05:56.179444 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"4b135a46-d885-4bc3-8344-f00c571b74fd","Type":"ContainerDied","Data":"5ecccdf200fc2559f650f9b142c97a2e4cfa48901046a38edc67e81794d14036"} Mar 16 17:05:56 crc kubenswrapper[5120]: I0316 17:05:56.181895 5120 generic.go:358] "Generic (PLEG): container finished" podID="96b6737b-826e-4600-978e-3384f064dd15" containerID="589ac4179852ce4cf654b164939e6e9d6e1c80f6a1f72bb6c82ef2efaefb63ac" exitCode=0 Mar 16 17:05:56 crc kubenswrapper[5120]: I0316 17:05:56.181999 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"96b6737b-826e-4600-978e-3384f064dd15","Type":"ContainerDied","Data":"589ac4179852ce4cf654b164939e6e9d6e1c80f6a1f72bb6c82ef2efaefb63ac"} Mar 16 17:05:56 crc kubenswrapper[5120]: I0316 17:05:56.182081 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"96b6737b-826e-4600-978e-3384f064dd15","Type":"ContainerDied","Data":"9dc4b2162b684667e552dd4fffd1dec836cbcabc356f92531683c95e61c3bea3"} Mar 16 17:05:56 crc kubenswrapper[5120]: I0316 17:05:56.182139 5120 scope.go:117] "RemoveContainer" containerID="589ac4179852ce4cf654b164939e6e9d6e1c80f6a1f72bb6c82ef2efaefb63ac" Mar 16 17:05:56 crc kubenswrapper[5120]: I0316 17:05:56.182372 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:05:56 crc kubenswrapper[5120]: I0316 17:05:56.223001 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") on node \"crc\" DevicePath \"\"" Mar 16 17:05:56 crc kubenswrapper[5120]: I0316 17:05:56.237622 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 17:05:56 crc kubenswrapper[5120]: I0316 17:05:56.248445 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 17:05:56 crc kubenswrapper[5120]: I0316 17:05:56.257318 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 17:05:56 crc kubenswrapper[5120]: I0316 17:05:56.258309 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96b6737b-826e-4600-978e-3384f064dd15" containerName="glance-log" Mar 16 17:05:56 crc kubenswrapper[5120]: I0316 17:05:56.258329 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="96b6737b-826e-4600-978e-3384f064dd15" containerName="glance-log" Mar 16 17:05:56 crc kubenswrapper[5120]: I0316 17:05:56.258368 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96b6737b-826e-4600-978e-3384f064dd15" containerName="glance-httpd" Mar 16 17:05:56 crc kubenswrapper[5120]: I0316 17:05:56.258376 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="96b6737b-826e-4600-978e-3384f064dd15" containerName="glance-httpd" Mar 16 17:05:56 crc kubenswrapper[5120]: I0316 17:05:56.258574 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="96b6737b-826e-4600-978e-3384f064dd15" containerName="glance-httpd" Mar 16 17:05:56 crc kubenswrapper[5120]: I0316 17:05:56.258588 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="96b6737b-826e-4600-978e-3384f064dd15" containerName="glance-log" Mar 16 17:05:56 crc kubenswrapper[5120]: I0316 17:05:56.262431 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:05:56 crc kubenswrapper[5120]: I0316 17:05:56.272566 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 17:05:56 crc kubenswrapper[5120]: I0316 17:05:56.307561 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-external-config-data\"" Mar 16 17:05:56 crc kubenswrapper[5120]: I0316 17:05:56.307863 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-public-svc\"" Mar 16 17:05:56 crc kubenswrapper[5120]: I0316 17:05:56.381414 5120 scope.go:117] "RemoveContainer" containerID="29a344fadbdeacf8249d20dd5c4764539985868f4fdfbb1a19f3d419cea7f7e8" Mar 16 17:05:56 crc kubenswrapper[5120]: I0316 17:05:56.428451 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"glance-default-external-api-0\" (UID: \"45bed047-fbff-439b-b659-657f9b9d3b62\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:05:56 crc kubenswrapper[5120]: I0316 17:05:56.428520 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vnqs\" (UniqueName: \"kubernetes.io/projected/45bed047-fbff-439b-b659-657f9b9d3b62-kube-api-access-7vnqs\") pod \"glance-default-external-api-0\" (UID: \"45bed047-fbff-439b-b659-657f9b9d3b62\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:05:56 crc kubenswrapper[5120]: I0316 17:05:56.428552 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/45bed047-fbff-439b-b659-657f9b9d3b62-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"45bed047-fbff-439b-b659-657f9b9d3b62\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:05:56 crc kubenswrapper[5120]: I0316 17:05:56.428657 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/45bed047-fbff-439b-b659-657f9b9d3b62-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"45bed047-fbff-439b-b659-657f9b9d3b62\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:05:56 crc kubenswrapper[5120]: I0316 17:05:56.428682 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/45bed047-fbff-439b-b659-657f9b9d3b62-config-data\") pod \"glance-default-external-api-0\" (UID: \"45bed047-fbff-439b-b659-657f9b9d3b62\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:05:56 crc kubenswrapper[5120]: I0316 17:05:56.428716 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/45bed047-fbff-439b-b659-657f9b9d3b62-logs\") pod \"glance-default-external-api-0\" (UID: \"45bed047-fbff-439b-b659-657f9b9d3b62\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:05:56 crc kubenswrapper[5120]: I0316 17:05:56.428737 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/45bed047-fbff-439b-b659-657f9b9d3b62-scripts\") pod \"glance-default-external-api-0\" (UID: \"45bed047-fbff-439b-b659-657f9b9d3b62\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:05:56 crc kubenswrapper[5120]: I0316 17:05:56.429605 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/45bed047-fbff-439b-b659-657f9b9d3b62-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"45bed047-fbff-439b-b659-657f9b9d3b62\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:05:56 crc kubenswrapper[5120]: I0316 17:05:56.429995 5120 scope.go:117] "RemoveContainer" containerID="589ac4179852ce4cf654b164939e6e9d6e1c80f6a1f72bb6c82ef2efaefb63ac" Mar 16 17:05:56 crc kubenswrapper[5120]: E0316 17:05:56.431561 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"589ac4179852ce4cf654b164939e6e9d6e1c80f6a1f72bb6c82ef2efaefb63ac\": container with ID starting with 589ac4179852ce4cf654b164939e6e9d6e1c80f6a1f72bb6c82ef2efaefb63ac not found: ID does not exist" containerID="589ac4179852ce4cf654b164939e6e9d6e1c80f6a1f72bb6c82ef2efaefb63ac" Mar 16 17:05:56 crc kubenswrapper[5120]: I0316 17:05:56.431596 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"589ac4179852ce4cf654b164939e6e9d6e1c80f6a1f72bb6c82ef2efaefb63ac"} err="failed to get container status \"589ac4179852ce4cf654b164939e6e9d6e1c80f6a1f72bb6c82ef2efaefb63ac\": rpc error: code = NotFound desc = could not find container \"589ac4179852ce4cf654b164939e6e9d6e1c80f6a1f72bb6c82ef2efaefb63ac\": container with ID starting with 589ac4179852ce4cf654b164939e6e9d6e1c80f6a1f72bb6c82ef2efaefb63ac not found: ID does not exist" Mar 16 17:05:56 crc kubenswrapper[5120]: I0316 17:05:56.431620 5120 scope.go:117] "RemoveContainer" containerID="29a344fadbdeacf8249d20dd5c4764539985868f4fdfbb1a19f3d419cea7f7e8" Mar 16 17:05:56 crc kubenswrapper[5120]: E0316 17:05:56.432260 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"29a344fadbdeacf8249d20dd5c4764539985868f4fdfbb1a19f3d419cea7f7e8\": container with ID starting with 29a344fadbdeacf8249d20dd5c4764539985868f4fdfbb1a19f3d419cea7f7e8 not found: ID does not exist" containerID="29a344fadbdeacf8249d20dd5c4764539985868f4fdfbb1a19f3d419cea7f7e8" Mar 16 17:05:56 crc kubenswrapper[5120]: I0316 17:05:56.432294 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29a344fadbdeacf8249d20dd5c4764539985868f4fdfbb1a19f3d419cea7f7e8"} err="failed to get container status \"29a344fadbdeacf8249d20dd5c4764539985868f4fdfbb1a19f3d419cea7f7e8\": rpc error: code = NotFound desc = could not find container \"29a344fadbdeacf8249d20dd5c4764539985868f4fdfbb1a19f3d419cea7f7e8\": container with ID starting with 29a344fadbdeacf8249d20dd5c4764539985868f4fdfbb1a19f3d419cea7f7e8 not found: ID does not exist" Mar 16 17:05:56 crc kubenswrapper[5120]: I0316 17:05:56.532414 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/45bed047-fbff-439b-b659-657f9b9d3b62-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"45bed047-fbff-439b-b659-657f9b9d3b62\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:05:56 crc kubenswrapper[5120]: I0316 17:05:56.532719 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/45bed047-fbff-439b-b659-657f9b9d3b62-config-data\") pod \"glance-default-external-api-0\" (UID: \"45bed047-fbff-439b-b659-657f9b9d3b62\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:05:56 crc kubenswrapper[5120]: I0316 17:05:56.532747 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/45bed047-fbff-439b-b659-657f9b9d3b62-logs\") pod \"glance-default-external-api-0\" (UID: \"45bed047-fbff-439b-b659-657f9b9d3b62\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:05:56 crc kubenswrapper[5120]: I0316 17:05:56.532781 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/45bed047-fbff-439b-b659-657f9b9d3b62-scripts\") pod \"glance-default-external-api-0\" (UID: \"45bed047-fbff-439b-b659-657f9b9d3b62\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:05:56 crc kubenswrapper[5120]: I0316 17:05:56.532988 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/45bed047-fbff-439b-b659-657f9b9d3b62-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"45bed047-fbff-439b-b659-657f9b9d3b62\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:05:56 crc kubenswrapper[5120]: I0316 17:05:56.533131 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"glance-default-external-api-0\" (UID: \"45bed047-fbff-439b-b659-657f9b9d3b62\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:05:56 crc kubenswrapper[5120]: I0316 17:05:56.533155 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7vnqs\" (UniqueName: \"kubernetes.io/projected/45bed047-fbff-439b-b659-657f9b9d3b62-kube-api-access-7vnqs\") pod \"glance-default-external-api-0\" (UID: \"45bed047-fbff-439b-b659-657f9b9d3b62\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:05:56 crc kubenswrapper[5120]: I0316 17:05:56.533177 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/45bed047-fbff-439b-b659-657f9b9d3b62-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"45bed047-fbff-439b-b659-657f9b9d3b62\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:05:56 crc kubenswrapper[5120]: I0316 17:05:56.538639 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/45bed047-fbff-439b-b659-657f9b9d3b62-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"45bed047-fbff-439b-b659-657f9b9d3b62\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:05:56 crc kubenswrapper[5120]: I0316 17:05:56.539143 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"glance-default-external-api-0\" (UID: \"45bed047-fbff-439b-b659-657f9b9d3b62\") device mount path \"/mnt/openstack/pv05\"" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:05:56 crc kubenswrapper[5120]: I0316 17:05:56.539480 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/45bed047-fbff-439b-b659-657f9b9d3b62-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"45bed047-fbff-439b-b659-657f9b9d3b62\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:05:56 crc kubenswrapper[5120]: I0316 17:05:56.539643 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/45bed047-fbff-439b-b659-657f9b9d3b62-logs\") pod \"glance-default-external-api-0\" (UID: \"45bed047-fbff-439b-b659-657f9b9d3b62\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:05:56 crc kubenswrapper[5120]: I0316 17:05:56.540100 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/45bed047-fbff-439b-b659-657f9b9d3b62-scripts\") pod \"glance-default-external-api-0\" (UID: \"45bed047-fbff-439b-b659-657f9b9d3b62\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:05:56 crc kubenswrapper[5120]: I0316 17:05:56.551948 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/45bed047-fbff-439b-b659-657f9b9d3b62-config-data\") pod \"glance-default-external-api-0\" (UID: \"45bed047-fbff-439b-b659-657f9b9d3b62\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:05:56 crc kubenswrapper[5120]: I0316 17:05:56.554491 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/45bed047-fbff-439b-b659-657f9b9d3b62-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"45bed047-fbff-439b-b659-657f9b9d3b62\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:05:56 crc kubenswrapper[5120]: I0316 17:05:56.560983 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vnqs\" (UniqueName: \"kubernetes.io/projected/45bed047-fbff-439b-b659-657f9b9d3b62-kube-api-access-7vnqs\") pod \"glance-default-external-api-0\" (UID: \"45bed047-fbff-439b-b659-657f9b9d3b62\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:05:56 crc kubenswrapper[5120]: I0316 17:05:56.584479 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"glance-default-external-api-0\" (UID: \"45bed047-fbff-439b-b659-657f9b9d3b62\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:05:56 crc kubenswrapper[5120]: I0316 17:05:56.639899 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:05:56 crc kubenswrapper[5120]: I0316 17:05:56.675812 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="96b6737b-826e-4600-978e-3384f064dd15" path="/var/lib/kubelet/pods/96b6737b-826e-4600-978e-3384f064dd15/volumes" Mar 16 17:05:56 crc kubenswrapper[5120]: I0316 17:05:56.761515 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:05:56 crc kubenswrapper[5120]: I0316 17:05:56.940988 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/4b135a46-d885-4bc3-8344-f00c571b74fd-httpd-run\") pod \"4b135a46-d885-4bc3-8344-f00c571b74fd\" (UID: \"4b135a46-d885-4bc3-8344-f00c571b74fd\") " Mar 16 17:05:56 crc kubenswrapper[5120]: I0316 17:05:56.941388 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b135a46-d885-4bc3-8344-f00c571b74fd-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "4b135a46-d885-4bc3-8344-f00c571b74fd" (UID: "4b135a46-d885-4bc3-8344-f00c571b74fd"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:05:56 crc kubenswrapper[5120]: I0316 17:05:56.941585 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4b135a46-d885-4bc3-8344-f00c571b74fd-config-data\") pod \"4b135a46-d885-4bc3-8344-f00c571b74fd\" (UID: \"4b135a46-d885-4bc3-8344-f00c571b74fd\") " Mar 16 17:05:56 crc kubenswrapper[5120]: I0316 17:05:56.941629 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"4b135a46-d885-4bc3-8344-f00c571b74fd\" (UID: \"4b135a46-d885-4bc3-8344-f00c571b74fd\") " Mar 16 17:05:56 crc kubenswrapper[5120]: I0316 17:05:56.941744 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4b135a46-d885-4bc3-8344-f00c571b74fd-logs\") pod \"4b135a46-d885-4bc3-8344-f00c571b74fd\" (UID: \"4b135a46-d885-4bc3-8344-f00c571b74fd\") " Mar 16 17:05:56 crc kubenswrapper[5120]: I0316 17:05:56.941849 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/4b135a46-d885-4bc3-8344-f00c571b74fd-internal-tls-certs\") pod \"4b135a46-d885-4bc3-8344-f00c571b74fd\" (UID: \"4b135a46-d885-4bc3-8344-f00c571b74fd\") " Mar 16 17:05:56 crc kubenswrapper[5120]: I0316 17:05:56.941911 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mplsq\" (UniqueName: \"kubernetes.io/projected/4b135a46-d885-4bc3-8344-f00c571b74fd-kube-api-access-mplsq\") pod \"4b135a46-d885-4bc3-8344-f00c571b74fd\" (UID: \"4b135a46-d885-4bc3-8344-f00c571b74fd\") " Mar 16 17:05:56 crc kubenswrapper[5120]: I0316 17:05:56.941951 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4b135a46-d885-4bc3-8344-f00c571b74fd-scripts\") pod \"4b135a46-d885-4bc3-8344-f00c571b74fd\" (UID: \"4b135a46-d885-4bc3-8344-f00c571b74fd\") " Mar 16 17:05:56 crc kubenswrapper[5120]: I0316 17:05:56.942327 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4b135a46-d885-4bc3-8344-f00c571b74fd-combined-ca-bundle\") pod \"4b135a46-d885-4bc3-8344-f00c571b74fd\" (UID: \"4b135a46-d885-4bc3-8344-f00c571b74fd\") " Mar 16 17:05:56 crc kubenswrapper[5120]: I0316 17:05:56.942323 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b135a46-d885-4bc3-8344-f00c571b74fd-logs" (OuterVolumeSpecName: "logs") pod "4b135a46-d885-4bc3-8344-f00c571b74fd" (UID: "4b135a46-d885-4bc3-8344-f00c571b74fd"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:05:56 crc kubenswrapper[5120]: I0316 17:05:56.944030 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/4b135a46-d885-4bc3-8344-f00c571b74fd-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 17:05:56 crc kubenswrapper[5120]: I0316 17:05:56.944065 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4b135a46-d885-4bc3-8344-f00c571b74fd-logs\") on node \"crc\" DevicePath \"\"" Mar 16 17:05:56 crc kubenswrapper[5120]: I0316 17:05:56.947160 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b135a46-d885-4bc3-8344-f00c571b74fd-kube-api-access-mplsq" (OuterVolumeSpecName: "kube-api-access-mplsq") pod "4b135a46-d885-4bc3-8344-f00c571b74fd" (UID: "4b135a46-d885-4bc3-8344-f00c571b74fd"). InnerVolumeSpecName "kube-api-access-mplsq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:05:56 crc kubenswrapper[5120]: I0316 17:05:56.950890 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage06-crc" (OuterVolumeSpecName: "glance") pod "4b135a46-d885-4bc3-8344-f00c571b74fd" (UID: "4b135a46-d885-4bc3-8344-f00c571b74fd"). InnerVolumeSpecName "local-storage06-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 17:05:56 crc kubenswrapper[5120]: I0316 17:05:56.953608 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b135a46-d885-4bc3-8344-f00c571b74fd-scripts" (OuterVolumeSpecName: "scripts") pod "4b135a46-d885-4bc3-8344-f00c571b74fd" (UID: "4b135a46-d885-4bc3-8344-f00c571b74fd"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:05:56 crc kubenswrapper[5120]: I0316 17:05:56.976005 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b135a46-d885-4bc3-8344-f00c571b74fd-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "4b135a46-d885-4bc3-8344-f00c571b74fd" (UID: "4b135a46-d885-4bc3-8344-f00c571b74fd"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:05:57 crc kubenswrapper[5120]: I0316 17:05:57.001433 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b135a46-d885-4bc3-8344-f00c571b74fd-config-data" (OuterVolumeSpecName: "config-data") pod "4b135a46-d885-4bc3-8344-f00c571b74fd" (UID: "4b135a46-d885-4bc3-8344-f00c571b74fd"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:05:57 crc kubenswrapper[5120]: I0316 17:05:57.003112 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b135a46-d885-4bc3-8344-f00c571b74fd-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "4b135a46-d885-4bc3-8344-f00c571b74fd" (UID: "4b135a46-d885-4bc3-8344-f00c571b74fd"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:05:57 crc kubenswrapper[5120]: I0316 17:05:57.046194 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4b135a46-d885-4bc3-8344-f00c571b74fd-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:05:57 crc kubenswrapper[5120]: I0316 17:05:57.046245 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") on node \"crc\" " Mar 16 17:05:57 crc kubenswrapper[5120]: I0316 17:05:57.046262 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/4b135a46-d885-4bc3-8344-f00c571b74fd-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:05:57 crc kubenswrapper[5120]: I0316 17:05:57.046275 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mplsq\" (UniqueName: \"kubernetes.io/projected/4b135a46-d885-4bc3-8344-f00c571b74fd-kube-api-access-mplsq\") on node \"crc\" DevicePath \"\"" Mar 16 17:05:57 crc kubenswrapper[5120]: I0316 17:05:57.046284 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4b135a46-d885-4bc3-8344-f00c571b74fd-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:05:57 crc kubenswrapper[5120]: I0316 17:05:57.046292 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4b135a46-d885-4bc3-8344-f00c571b74fd-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:05:57 crc kubenswrapper[5120]: I0316 17:05:57.068987 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage06-crc" (UniqueName: "kubernetes.io/local-volume/local-storage06-crc") on node "crc" Mar 16 17:05:57 crc kubenswrapper[5120]: I0316 17:05:57.137873 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 17:05:57 crc kubenswrapper[5120]: I0316 17:05:57.148053 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") on node \"crc\" DevicePath \"\"" Mar 16 17:05:57 crc kubenswrapper[5120]: I0316 17:05:57.199246 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:05:57 crc kubenswrapper[5120]: I0316 17:05:57.200916 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"4b135a46-d885-4bc3-8344-f00c571b74fd","Type":"ContainerDied","Data":"62b26c6e7319ae17990a55699df2588bca7b4410e695dac05a2c329773ae67e6"} Mar 16 17:05:57 crc kubenswrapper[5120]: I0316 17:05:57.201005 5120 scope.go:117] "RemoveContainer" containerID="5ecccdf200fc2559f650f9b142c97a2e4cfa48901046a38edc67e81794d14036" Mar 16 17:05:57 crc kubenswrapper[5120]: I0316 17:05:57.207708 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"45bed047-fbff-439b-b659-657f9b9d3b62","Type":"ContainerStarted","Data":"ccab7c76daeba3ad9eada595dafd9e9de667e2f9c9f21f28300a7fed24686396"} Mar 16 17:05:57 crc kubenswrapper[5120]: I0316 17:05:57.238738 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"f1e1a325-f67c-4d27-8481-cc8b1ca16544","Type":"ContainerStarted","Data":"54b93f3676075dc4f599853c1b5a0e0e15138101b435f7bba936a022aeeb7bad"} Mar 16 17:05:57 crc kubenswrapper[5120]: I0316 17:05:57.238918 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="f1e1a325-f67c-4d27-8481-cc8b1ca16544" containerName="ceilometer-central-agent" containerID="cri-o://cb8d454fd5d6f96fe29a6adb9edf420a55afe0e6278e9f8e01d74b8073f30ee1" gracePeriod=30 Mar 16 17:05:57 crc kubenswrapper[5120]: I0316 17:05:57.239387 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:05:57 crc kubenswrapper[5120]: I0316 17:05:57.239447 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="f1e1a325-f67c-4d27-8481-cc8b1ca16544" containerName="proxy-httpd" containerID="cri-o://54b93f3676075dc4f599853c1b5a0e0e15138101b435f7bba936a022aeeb7bad" gracePeriod=30 Mar 16 17:05:57 crc kubenswrapper[5120]: I0316 17:05:57.239476 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="f1e1a325-f67c-4d27-8481-cc8b1ca16544" containerName="ceilometer-notification-agent" containerID="cri-o://330cc0aa03e6f2c6d0aa3277cd49c36db34efa5f48e8b1c37afcf9735a44e1f1" gracePeriod=30 Mar 16 17:05:57 crc kubenswrapper[5120]: I0316 17:05:57.239545 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="f1e1a325-f67c-4d27-8481-cc8b1ca16544" containerName="sg-core" containerID="cri-o://5f11fe9c300aadc98f27a5b7c9ab43408d490f0eeb54de93b11fdca9e195338e" gracePeriod=30 Mar 16 17:05:57 crc kubenswrapper[5120]: I0316 17:05:57.239601 5120 scope.go:117] "RemoveContainer" containerID="b6fb75251afc9bd01783c470c45aa16184640e5c91b3ad33b86d481ff9a7fbe4" Mar 16 17:05:57 crc kubenswrapper[5120]: I0316 17:05:57.289023 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.474778592 podStartE2EDuration="7.288980265s" podCreationTimestamp="2026-03-16 17:05:50 +0000 UTC" firstStartedPulling="2026-03-16 17:05:51.213574181 +0000 UTC m=+5653.367505838" lastFinishedPulling="2026-03-16 17:05:56.027775854 +0000 UTC m=+5658.181707511" observedRunningTime="2026-03-16 17:05:57.275620547 +0000 UTC m=+5659.429552194" watchObservedRunningTime="2026-03-16 17:05:57.288980265 +0000 UTC m=+5659.442911942" Mar 16 17:05:57 crc kubenswrapper[5120]: I0316 17:05:57.309021 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 17:05:57 crc kubenswrapper[5120]: I0316 17:05:57.331816 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 17:05:57 crc kubenswrapper[5120]: I0316 17:05:57.375011 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 17:05:57 crc kubenswrapper[5120]: I0316 17:05:57.376689 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b135a46-d885-4bc3-8344-f00c571b74fd" containerName="glance-httpd" Mar 16 17:05:57 crc kubenswrapper[5120]: I0316 17:05:57.376716 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b135a46-d885-4bc3-8344-f00c571b74fd" containerName="glance-httpd" Mar 16 17:05:57 crc kubenswrapper[5120]: I0316 17:05:57.376733 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b135a46-d885-4bc3-8344-f00c571b74fd" containerName="glance-log" Mar 16 17:05:57 crc kubenswrapper[5120]: I0316 17:05:57.376739 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b135a46-d885-4bc3-8344-f00c571b74fd" containerName="glance-log" Mar 16 17:05:57 crc kubenswrapper[5120]: I0316 17:05:57.377049 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="4b135a46-d885-4bc3-8344-f00c571b74fd" containerName="glance-log" Mar 16 17:05:57 crc kubenswrapper[5120]: I0316 17:05:57.377065 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="4b135a46-d885-4bc3-8344-f00c571b74fd" containerName="glance-httpd" Mar 16 17:05:57 crc kubenswrapper[5120]: I0316 17:05:57.387504 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:05:57 crc kubenswrapper[5120]: I0316 17:05:57.390427 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-internal-svc\"" Mar 16 17:05:57 crc kubenswrapper[5120]: I0316 17:05:57.392177 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 17:05:57 crc kubenswrapper[5120]: I0316 17:05:57.392686 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-internal-config-data\"" Mar 16 17:05:57 crc kubenswrapper[5120]: I0316 17:05:57.564706 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/431c87cc-4a05-421e-a7d6-74fa09328220-scripts\") pod \"glance-default-internal-api-0\" (UID: \"431c87cc-4a05-421e-a7d6-74fa09328220\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:05:57 crc kubenswrapper[5120]: I0316 17:05:57.564929 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"glance-default-internal-api-0\" (UID: \"431c87cc-4a05-421e-a7d6-74fa09328220\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:05:57 crc kubenswrapper[5120]: I0316 17:05:57.565002 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/431c87cc-4a05-421e-a7d6-74fa09328220-logs\") pod \"glance-default-internal-api-0\" (UID: \"431c87cc-4a05-421e-a7d6-74fa09328220\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:05:57 crc kubenswrapper[5120]: I0316 17:05:57.565035 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/431c87cc-4a05-421e-a7d6-74fa09328220-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"431c87cc-4a05-421e-a7d6-74fa09328220\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:05:57 crc kubenswrapper[5120]: I0316 17:05:57.565057 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/431c87cc-4a05-421e-a7d6-74fa09328220-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"431c87cc-4a05-421e-a7d6-74fa09328220\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:05:57 crc kubenswrapper[5120]: I0316 17:05:57.565094 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qcmkl\" (UniqueName: \"kubernetes.io/projected/431c87cc-4a05-421e-a7d6-74fa09328220-kube-api-access-qcmkl\") pod \"glance-default-internal-api-0\" (UID: \"431c87cc-4a05-421e-a7d6-74fa09328220\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:05:57 crc kubenswrapper[5120]: I0316 17:05:57.565116 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/431c87cc-4a05-421e-a7d6-74fa09328220-config-data\") pod \"glance-default-internal-api-0\" (UID: \"431c87cc-4a05-421e-a7d6-74fa09328220\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:05:57 crc kubenswrapper[5120]: I0316 17:05:57.565229 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/431c87cc-4a05-421e-a7d6-74fa09328220-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"431c87cc-4a05-421e-a7d6-74fa09328220\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:05:57 crc kubenswrapper[5120]: I0316 17:05:57.666998 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/431c87cc-4a05-421e-a7d6-74fa09328220-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"431c87cc-4a05-421e-a7d6-74fa09328220\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:05:57 crc kubenswrapper[5120]: I0316 17:05:57.667527 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/431c87cc-4a05-421e-a7d6-74fa09328220-scripts\") pod \"glance-default-internal-api-0\" (UID: \"431c87cc-4a05-421e-a7d6-74fa09328220\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:05:57 crc kubenswrapper[5120]: I0316 17:05:57.667661 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"glance-default-internal-api-0\" (UID: \"431c87cc-4a05-421e-a7d6-74fa09328220\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:05:57 crc kubenswrapper[5120]: I0316 17:05:57.667717 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/431c87cc-4a05-421e-a7d6-74fa09328220-logs\") pod \"glance-default-internal-api-0\" (UID: \"431c87cc-4a05-421e-a7d6-74fa09328220\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:05:57 crc kubenswrapper[5120]: I0316 17:05:57.668351 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"glance-default-internal-api-0\" (UID: \"431c87cc-4a05-421e-a7d6-74fa09328220\") device mount path \"/mnt/openstack/pv06\"" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:05:57 crc kubenswrapper[5120]: I0316 17:05:57.668566 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/431c87cc-4a05-421e-a7d6-74fa09328220-logs\") pod \"glance-default-internal-api-0\" (UID: \"431c87cc-4a05-421e-a7d6-74fa09328220\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:05:57 crc kubenswrapper[5120]: I0316 17:05:57.668858 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/431c87cc-4a05-421e-a7d6-74fa09328220-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"431c87cc-4a05-421e-a7d6-74fa09328220\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:05:57 crc kubenswrapper[5120]: I0316 17:05:57.668896 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/431c87cc-4a05-421e-a7d6-74fa09328220-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"431c87cc-4a05-421e-a7d6-74fa09328220\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:05:57 crc kubenswrapper[5120]: I0316 17:05:57.669005 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qcmkl\" (UniqueName: \"kubernetes.io/projected/431c87cc-4a05-421e-a7d6-74fa09328220-kube-api-access-qcmkl\") pod \"glance-default-internal-api-0\" (UID: \"431c87cc-4a05-421e-a7d6-74fa09328220\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:05:57 crc kubenswrapper[5120]: I0316 17:05:57.669054 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/431c87cc-4a05-421e-a7d6-74fa09328220-config-data\") pod \"glance-default-internal-api-0\" (UID: \"431c87cc-4a05-421e-a7d6-74fa09328220\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:05:57 crc kubenswrapper[5120]: I0316 17:05:57.669222 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/431c87cc-4a05-421e-a7d6-74fa09328220-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"431c87cc-4a05-421e-a7d6-74fa09328220\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:05:57 crc kubenswrapper[5120]: I0316 17:05:57.675321 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/431c87cc-4a05-421e-a7d6-74fa09328220-scripts\") pod \"glance-default-internal-api-0\" (UID: \"431c87cc-4a05-421e-a7d6-74fa09328220\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:05:57 crc kubenswrapper[5120]: I0316 17:05:57.675535 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/431c87cc-4a05-421e-a7d6-74fa09328220-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"431c87cc-4a05-421e-a7d6-74fa09328220\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:05:57 crc kubenswrapper[5120]: I0316 17:05:57.676045 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/431c87cc-4a05-421e-a7d6-74fa09328220-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"431c87cc-4a05-421e-a7d6-74fa09328220\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:05:57 crc kubenswrapper[5120]: I0316 17:05:57.678557 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/431c87cc-4a05-421e-a7d6-74fa09328220-config-data\") pod \"glance-default-internal-api-0\" (UID: \"431c87cc-4a05-421e-a7d6-74fa09328220\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:05:57 crc kubenswrapper[5120]: I0316 17:05:57.692502 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qcmkl\" (UniqueName: \"kubernetes.io/projected/431c87cc-4a05-421e-a7d6-74fa09328220-kube-api-access-qcmkl\") pod \"glance-default-internal-api-0\" (UID: \"431c87cc-4a05-421e-a7d6-74fa09328220\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:05:57 crc kubenswrapper[5120]: I0316 17:05:57.708225 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"glance-default-internal-api-0\" (UID: \"431c87cc-4a05-421e-a7d6-74fa09328220\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:05:57 crc kubenswrapper[5120]: I0316 17:05:57.722814 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-784497c6b4-5g4fn" Mar 16 17:05:57 crc kubenswrapper[5120]: I0316 17:05:57.855835 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:05:57 crc kubenswrapper[5120]: I0316 17:05:57.872824 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/16bbeb65-e9fb-4f92-9642-83ac828e09d7-combined-ca-bundle\") pod \"16bbeb65-e9fb-4f92-9642-83ac828e09d7\" (UID: \"16bbeb65-e9fb-4f92-9642-83ac828e09d7\") " Mar 16 17:05:57 crc kubenswrapper[5120]: I0316 17:05:57.872935 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m2fvc\" (UniqueName: \"kubernetes.io/projected/16bbeb65-e9fb-4f92-9642-83ac828e09d7-kube-api-access-m2fvc\") pod \"16bbeb65-e9fb-4f92-9642-83ac828e09d7\" (UID: \"16bbeb65-e9fb-4f92-9642-83ac828e09d7\") " Mar 16 17:05:57 crc kubenswrapper[5120]: I0316 17:05:57.873013 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/16bbeb65-e9fb-4f92-9642-83ac828e09d7-internal-tls-certs\") pod \"16bbeb65-e9fb-4f92-9642-83ac828e09d7\" (UID: \"16bbeb65-e9fb-4f92-9642-83ac828e09d7\") " Mar 16 17:05:57 crc kubenswrapper[5120]: I0316 17:05:57.873169 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/16bbeb65-e9fb-4f92-9642-83ac828e09d7-scripts\") pod \"16bbeb65-e9fb-4f92-9642-83ac828e09d7\" (UID: \"16bbeb65-e9fb-4f92-9642-83ac828e09d7\") " Mar 16 17:05:57 crc kubenswrapper[5120]: I0316 17:05:57.873220 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/16bbeb65-e9fb-4f92-9642-83ac828e09d7-config-data\") pod \"16bbeb65-e9fb-4f92-9642-83ac828e09d7\" (UID: \"16bbeb65-e9fb-4f92-9642-83ac828e09d7\") " Mar 16 17:05:57 crc kubenswrapper[5120]: I0316 17:05:57.873334 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/16bbeb65-e9fb-4f92-9642-83ac828e09d7-public-tls-certs\") pod \"16bbeb65-e9fb-4f92-9642-83ac828e09d7\" (UID: \"16bbeb65-e9fb-4f92-9642-83ac828e09d7\") " Mar 16 17:05:57 crc kubenswrapper[5120]: I0316 17:05:57.873476 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/16bbeb65-e9fb-4f92-9642-83ac828e09d7-logs\") pod \"16bbeb65-e9fb-4f92-9642-83ac828e09d7\" (UID: \"16bbeb65-e9fb-4f92-9642-83ac828e09d7\") " Mar 16 17:05:57 crc kubenswrapper[5120]: I0316 17:05:57.874600 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16bbeb65-e9fb-4f92-9642-83ac828e09d7-logs" (OuterVolumeSpecName: "logs") pod "16bbeb65-e9fb-4f92-9642-83ac828e09d7" (UID: "16bbeb65-e9fb-4f92-9642-83ac828e09d7"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:05:57 crc kubenswrapper[5120]: I0316 17:05:57.878062 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/16bbeb65-e9fb-4f92-9642-83ac828e09d7-scripts" (OuterVolumeSpecName: "scripts") pod "16bbeb65-e9fb-4f92-9642-83ac828e09d7" (UID: "16bbeb65-e9fb-4f92-9642-83ac828e09d7"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:05:57 crc kubenswrapper[5120]: I0316 17:05:57.880560 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16bbeb65-e9fb-4f92-9642-83ac828e09d7-kube-api-access-m2fvc" (OuterVolumeSpecName: "kube-api-access-m2fvc") pod "16bbeb65-e9fb-4f92-9642-83ac828e09d7" (UID: "16bbeb65-e9fb-4f92-9642-83ac828e09d7"). InnerVolumeSpecName "kube-api-access-m2fvc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:05:57 crc kubenswrapper[5120]: I0316 17:05:57.940311 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/16bbeb65-e9fb-4f92-9642-83ac828e09d7-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "16bbeb65-e9fb-4f92-9642-83ac828e09d7" (UID: "16bbeb65-e9fb-4f92-9642-83ac828e09d7"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:05:57 crc kubenswrapper[5120]: I0316 17:05:57.954838 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/16bbeb65-e9fb-4f92-9642-83ac828e09d7-config-data" (OuterVolumeSpecName: "config-data") pod "16bbeb65-e9fb-4f92-9642-83ac828e09d7" (UID: "16bbeb65-e9fb-4f92-9642-83ac828e09d7"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:05:57 crc kubenswrapper[5120]: I0316 17:05:57.976396 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/16bbeb65-e9fb-4f92-9642-83ac828e09d7-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:05:57 crc kubenswrapper[5120]: I0316 17:05:57.976645 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m2fvc\" (UniqueName: \"kubernetes.io/projected/16bbeb65-e9fb-4f92-9642-83ac828e09d7-kube-api-access-m2fvc\") on node \"crc\" DevicePath \"\"" Mar 16 17:05:57 crc kubenswrapper[5120]: I0316 17:05:57.976738 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/16bbeb65-e9fb-4f92-9642-83ac828e09d7-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:05:57 crc kubenswrapper[5120]: I0316 17:05:57.976845 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/16bbeb65-e9fb-4f92-9642-83ac828e09d7-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:05:57 crc kubenswrapper[5120]: I0316 17:05:57.976939 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/16bbeb65-e9fb-4f92-9642-83ac828e09d7-logs\") on node \"crc\" DevicePath \"\"" Mar 16 17:05:57 crc kubenswrapper[5120]: I0316 17:05:57.992892 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/16bbeb65-e9fb-4f92-9642-83ac828e09d7-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "16bbeb65-e9fb-4f92-9642-83ac828e09d7" (UID: "16bbeb65-e9fb-4f92-9642-83ac828e09d7"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:05:58 crc kubenswrapper[5120]: I0316 17:05:58.014473 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/16bbeb65-e9fb-4f92-9642-83ac828e09d7-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "16bbeb65-e9fb-4f92-9642-83ac828e09d7" (UID: "16bbeb65-e9fb-4f92-9642-83ac828e09d7"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:05:58 crc kubenswrapper[5120]: I0316 17:05:58.080255 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/16bbeb65-e9fb-4f92-9642-83ac828e09d7-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:05:58 crc kubenswrapper[5120]: I0316 17:05:58.080751 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/16bbeb65-e9fb-4f92-9642-83ac828e09d7-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:05:58 crc kubenswrapper[5120]: I0316 17:05:58.269058 5120 generic.go:358] "Generic (PLEG): container finished" podID="f1e1a325-f67c-4d27-8481-cc8b1ca16544" containerID="54b93f3676075dc4f599853c1b5a0e0e15138101b435f7bba936a022aeeb7bad" exitCode=0 Mar 16 17:05:58 crc kubenswrapper[5120]: I0316 17:05:58.269099 5120 generic.go:358] "Generic (PLEG): container finished" podID="f1e1a325-f67c-4d27-8481-cc8b1ca16544" containerID="5f11fe9c300aadc98f27a5b7c9ab43408d490f0eeb54de93b11fdca9e195338e" exitCode=2 Mar 16 17:05:58 crc kubenswrapper[5120]: I0316 17:05:58.269109 5120 generic.go:358] "Generic (PLEG): container finished" podID="f1e1a325-f67c-4d27-8481-cc8b1ca16544" containerID="330cc0aa03e6f2c6d0aa3277cd49c36db34efa5f48e8b1c37afcf9735a44e1f1" exitCode=0 Mar 16 17:05:58 crc kubenswrapper[5120]: I0316 17:05:58.269320 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"f1e1a325-f67c-4d27-8481-cc8b1ca16544","Type":"ContainerDied","Data":"54b93f3676075dc4f599853c1b5a0e0e15138101b435f7bba936a022aeeb7bad"} Mar 16 17:05:58 crc kubenswrapper[5120]: I0316 17:05:58.269353 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"f1e1a325-f67c-4d27-8481-cc8b1ca16544","Type":"ContainerDied","Data":"5f11fe9c300aadc98f27a5b7c9ab43408d490f0eeb54de93b11fdca9e195338e"} Mar 16 17:05:58 crc kubenswrapper[5120]: I0316 17:05:58.269366 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"f1e1a325-f67c-4d27-8481-cc8b1ca16544","Type":"ContainerDied","Data":"330cc0aa03e6f2c6d0aa3277cd49c36db34efa5f48e8b1c37afcf9735a44e1f1"} Mar 16 17:05:58 crc kubenswrapper[5120]: I0316 17:05:58.286769 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-784497c6b4-5g4fn" Mar 16 17:05:58 crc kubenswrapper[5120]: I0316 17:05:58.288268 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-784497c6b4-5g4fn" event={"ID":"16bbeb65-e9fb-4f92-9642-83ac828e09d7","Type":"ContainerDied","Data":"971f6fc81706ba34789d4f2218c6bb34f3823902fa216187b0d5ec6955c4b8cd"} Mar 16 17:05:58 crc kubenswrapper[5120]: I0316 17:05:58.288361 5120 scope.go:117] "RemoveContainer" containerID="971f6fc81706ba34789d4f2218c6bb34f3823902fa216187b0d5ec6955c4b8cd" Mar 16 17:05:58 crc kubenswrapper[5120]: I0316 17:05:58.286655 5120 generic.go:358] "Generic (PLEG): container finished" podID="16bbeb65-e9fb-4f92-9642-83ac828e09d7" containerID="971f6fc81706ba34789d4f2218c6bb34f3823902fa216187b0d5ec6955c4b8cd" exitCode=0 Mar 16 17:05:58 crc kubenswrapper[5120]: I0316 17:05:58.298210 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-784497c6b4-5g4fn" event={"ID":"16bbeb65-e9fb-4f92-9642-83ac828e09d7","Type":"ContainerDied","Data":"74b9ec2e21fc991583ef344354e3d3e8fa072e4ab5410f813d160c344e173790"} Mar 16 17:05:58 crc kubenswrapper[5120]: I0316 17:05:58.302719 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"45bed047-fbff-439b-b659-657f9b9d3b62","Type":"ContainerStarted","Data":"1c02bc06344293428f1e8f7afa638a50bbb02427e908baa3d149b016a246865b"} Mar 16 17:05:58 crc kubenswrapper[5120]: I0316 17:05:58.302970 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 17:05:58 crc kubenswrapper[5120]: I0316 17:05:58.328676 5120 scope.go:117] "RemoveContainer" containerID="9d2c3e8026c7db5aa800a0f4f60458365ac79b36769cf2f66fc7818d19ff1e1c" Mar 16 17:05:58 crc kubenswrapper[5120]: I0316 17:05:58.332823 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-784497c6b4-5g4fn"] Mar 16 17:05:58 crc kubenswrapper[5120]: W0316 17:05:58.342852 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod431c87cc_4a05_421e_a7d6_74fa09328220.slice/crio-023ef7cb276d884a0b0822d7ca0c829887f4ff6e850fe7e26f26389090714167 WatchSource:0}: Error finding container 023ef7cb276d884a0b0822d7ca0c829887f4ff6e850fe7e26f26389090714167: Status 404 returned error can't find the container with id 023ef7cb276d884a0b0822d7ca0c829887f4ff6e850fe7e26f26389090714167 Mar 16 17:05:58 crc kubenswrapper[5120]: I0316 17:05:58.347180 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-784497c6b4-5g4fn"] Mar 16 17:05:58 crc kubenswrapper[5120]: I0316 17:05:58.369698 5120 scope.go:117] "RemoveContainer" containerID="971f6fc81706ba34789d4f2218c6bb34f3823902fa216187b0d5ec6955c4b8cd" Mar 16 17:05:58 crc kubenswrapper[5120]: E0316 17:05:58.370668 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"971f6fc81706ba34789d4f2218c6bb34f3823902fa216187b0d5ec6955c4b8cd\": container with ID starting with 971f6fc81706ba34789d4f2218c6bb34f3823902fa216187b0d5ec6955c4b8cd not found: ID does not exist" containerID="971f6fc81706ba34789d4f2218c6bb34f3823902fa216187b0d5ec6955c4b8cd" Mar 16 17:05:58 crc kubenswrapper[5120]: I0316 17:05:58.370709 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"971f6fc81706ba34789d4f2218c6bb34f3823902fa216187b0d5ec6955c4b8cd"} err="failed to get container status \"971f6fc81706ba34789d4f2218c6bb34f3823902fa216187b0d5ec6955c4b8cd\": rpc error: code = NotFound desc = could not find container \"971f6fc81706ba34789d4f2218c6bb34f3823902fa216187b0d5ec6955c4b8cd\": container with ID starting with 971f6fc81706ba34789d4f2218c6bb34f3823902fa216187b0d5ec6955c4b8cd not found: ID does not exist" Mar 16 17:05:58 crc kubenswrapper[5120]: I0316 17:05:58.370782 5120 scope.go:117] "RemoveContainer" containerID="9d2c3e8026c7db5aa800a0f4f60458365ac79b36769cf2f66fc7818d19ff1e1c" Mar 16 17:05:58 crc kubenswrapper[5120]: E0316 17:05:58.371404 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d2c3e8026c7db5aa800a0f4f60458365ac79b36769cf2f66fc7818d19ff1e1c\": container with ID starting with 9d2c3e8026c7db5aa800a0f4f60458365ac79b36769cf2f66fc7818d19ff1e1c not found: ID does not exist" containerID="9d2c3e8026c7db5aa800a0f4f60458365ac79b36769cf2f66fc7818d19ff1e1c" Mar 16 17:05:58 crc kubenswrapper[5120]: I0316 17:05:58.371459 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d2c3e8026c7db5aa800a0f4f60458365ac79b36769cf2f66fc7818d19ff1e1c"} err="failed to get container status \"9d2c3e8026c7db5aa800a0f4f60458365ac79b36769cf2f66fc7818d19ff1e1c\": rpc error: code = NotFound desc = could not find container \"9d2c3e8026c7db5aa800a0f4f60458365ac79b36769cf2f66fc7818d19ff1e1c\": container with ID starting with 9d2c3e8026c7db5aa800a0f4f60458365ac79b36769cf2f66fc7818d19ff1e1c not found: ID does not exist" Mar 16 17:05:58 crc kubenswrapper[5120]: I0316 17:05:58.474093 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/community-operators-hfs9z" Mar 16 17:05:58 crc kubenswrapper[5120]: I0316 17:05:58.474145 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-marketplace/community-operators-hfs9z" Mar 16 17:05:58 crc kubenswrapper[5120]: I0316 17:05:58.525065 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/community-operators-hfs9z" Mar 16 17:05:58 crc kubenswrapper[5120]: I0316 17:05:58.684221 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="16bbeb65-e9fb-4f92-9642-83ac828e09d7" path="/var/lib/kubelet/pods/16bbeb65-e9fb-4f92-9642-83ac828e09d7/volumes" Mar 16 17:05:58 crc kubenswrapper[5120]: I0316 17:05:58.685257 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b135a46-d885-4bc3-8344-f00c571b74fd" path="/var/lib/kubelet/pods/4b135a46-d885-4bc3-8344-f00c571b74fd/volumes" Mar 16 17:05:59 crc kubenswrapper[5120]: E0316 17:05:59.147583 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="8993820f9a0e78f6731cfe3132d071f83d39bacb35b813574b2d3dc5377237b4" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 17:05:59 crc kubenswrapper[5120]: E0316 17:05:59.150704 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="8993820f9a0e78f6731cfe3132d071f83d39bacb35b813574b2d3dc5377237b4" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 17:05:59 crc kubenswrapper[5120]: E0316 17:05:59.152205 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="8993820f9a0e78f6731cfe3132d071f83d39bacb35b813574b2d3dc5377237b4" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 17:05:59 crc kubenswrapper[5120]: E0316 17:05:59.152270 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="109878b2-8544-42b9-9602-c9d665976dfa" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 17:05:59 crc kubenswrapper[5120]: I0316 17:05:59.322280 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"431c87cc-4a05-421e-a7d6-74fa09328220","Type":"ContainerStarted","Data":"cbd76d8c28f83ef8bd43cd5bd6f08ee3a70f86373be2df33f85e4b2f6e009395"} Mar 16 17:05:59 crc kubenswrapper[5120]: I0316 17:05:59.322328 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"431c87cc-4a05-421e-a7d6-74fa09328220","Type":"ContainerStarted","Data":"023ef7cb276d884a0b0822d7ca0c829887f4ff6e850fe7e26f26389090714167"} Mar 16 17:05:59 crc kubenswrapper[5120]: I0316 17:05:59.331366 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"45bed047-fbff-439b-b659-657f9b9d3b62","Type":"ContainerStarted","Data":"27cb3386aadf2d6768da83f5c6070a5e4f3208984e63cb60bbb72e30c860ac1f"} Mar 16 17:05:59 crc kubenswrapper[5120]: I0316 17:05:59.363296 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-external-api-0" podStartSLOduration=3.363278248 podStartE2EDuration="3.363278248s" podCreationTimestamp="2026-03-16 17:05:56 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:05:59.357964931 +0000 UTC m=+5661.511896588" watchObservedRunningTime="2026-03-16 17:05:59.363278248 +0000 UTC m=+5661.517209905" Mar 16 17:05:59 crc kubenswrapper[5120]: I0316 17:05:59.393571 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/community-operators-hfs9z" Mar 16 17:05:59 crc kubenswrapper[5120]: I0316 17:05:59.459698 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/community-operators-hfs9z"] Mar 16 17:06:00 crc kubenswrapper[5120]: I0316 17:06:00.146272 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-infra/auto-csr-approver-29561346-4bglb"] Mar 16 17:06:00 crc kubenswrapper[5120]: I0316 17:06:00.148225 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16bbeb65-e9fb-4f92-9642-83ac828e09d7" containerName="placement-api" Mar 16 17:06:00 crc kubenswrapper[5120]: I0316 17:06:00.148809 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="16bbeb65-e9fb-4f92-9642-83ac828e09d7" containerName="placement-api" Mar 16 17:06:00 crc kubenswrapper[5120]: I0316 17:06:00.148908 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16bbeb65-e9fb-4f92-9642-83ac828e09d7" containerName="placement-log" Mar 16 17:06:00 crc kubenswrapper[5120]: I0316 17:06:00.148918 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="16bbeb65-e9fb-4f92-9642-83ac828e09d7" containerName="placement-log" Mar 16 17:06:00 crc kubenswrapper[5120]: I0316 17:06:00.149379 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="16bbeb65-e9fb-4f92-9642-83ac828e09d7" containerName="placement-log" Mar 16 17:06:00 crc kubenswrapper[5120]: I0316 17:06:00.149410 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="16bbeb65-e9fb-4f92-9642-83ac828e09d7" containerName="placement-api" Mar 16 17:06:00 crc kubenswrapper[5120]: I0316 17:06:00.154638 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561346-4bglb" Mar 16 17:06:00 crc kubenswrapper[5120]: I0316 17:06:00.157018 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"kube-root-ca.crt\"" Mar 16 17:06:00 crc kubenswrapper[5120]: I0316 17:06:00.157354 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"openshift-service-ca.crt\"" Mar 16 17:06:00 crc kubenswrapper[5120]: I0316 17:06:00.157583 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-infra\"/\"csr-approver-sa-dockercfg-x2nsz\"" Mar 16 17:06:00 crc kubenswrapper[5120]: I0316 17:06:00.164895 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561346-4bglb"] Mar 16 17:06:00 crc kubenswrapper[5120]: I0316 17:06:00.237690 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:06:00 crc kubenswrapper[5120]: I0316 17:06:00.245208 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c552v\" (UniqueName: \"kubernetes.io/projected/25275544-fa2d-4ef6-9576-b49753a36b45-kube-api-access-c552v\") pod \"auto-csr-approver-29561346-4bglb\" (UID: \"25275544-fa2d-4ef6-9576-b49753a36b45\") " pod="openshift-infra/auto-csr-approver-29561346-4bglb" Mar 16 17:06:00 crc kubenswrapper[5120]: I0316 17:06:00.346488 5120 generic.go:358] "Generic (PLEG): container finished" podID="f1e1a325-f67c-4d27-8481-cc8b1ca16544" containerID="cb8d454fd5d6f96fe29a6adb9edf420a55afe0e6278e9f8e01d74b8073f30ee1" exitCode=0 Mar 16 17:06:00 crc kubenswrapper[5120]: I0316 17:06:00.346547 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"f1e1a325-f67c-4d27-8481-cc8b1ca16544","Type":"ContainerDied","Data":"cb8d454fd5d6f96fe29a6adb9edf420a55afe0e6278e9f8e01d74b8073f30ee1"} Mar 16 17:06:00 crc kubenswrapper[5120]: I0316 17:06:00.346602 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:06:00 crc kubenswrapper[5120]: I0316 17:06:00.346630 5120 scope.go:117] "RemoveContainer" containerID="54b93f3676075dc4f599853c1b5a0e0e15138101b435f7bba936a022aeeb7bad" Mar 16 17:06:00 crc kubenswrapper[5120]: I0316 17:06:00.346614 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"f1e1a325-f67c-4d27-8481-cc8b1ca16544","Type":"ContainerDied","Data":"ad7386ff02d28b3cc31b174be2064d6aa8d90463057868d8984b04d0967b2dac"} Mar 16 17:06:00 crc kubenswrapper[5120]: I0316 17:06:00.346607 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/f1e1a325-f67c-4d27-8481-cc8b1ca16544-sg-core-conf-yaml\") pod \"f1e1a325-f67c-4d27-8481-cc8b1ca16544\" (UID: \"f1e1a325-f67c-4d27-8481-cc8b1ca16544\") " Mar 16 17:06:00 crc kubenswrapper[5120]: I0316 17:06:00.347161 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2kt7p\" (UniqueName: \"kubernetes.io/projected/f1e1a325-f67c-4d27-8481-cc8b1ca16544-kube-api-access-2kt7p\") pod \"f1e1a325-f67c-4d27-8481-cc8b1ca16544\" (UID: \"f1e1a325-f67c-4d27-8481-cc8b1ca16544\") " Mar 16 17:06:00 crc kubenswrapper[5120]: I0316 17:06:00.347291 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f1e1a325-f67c-4d27-8481-cc8b1ca16544-config-data\") pod \"f1e1a325-f67c-4d27-8481-cc8b1ca16544\" (UID: \"f1e1a325-f67c-4d27-8481-cc8b1ca16544\") " Mar 16 17:06:00 crc kubenswrapper[5120]: I0316 17:06:00.347734 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f1e1a325-f67c-4d27-8481-cc8b1ca16544-combined-ca-bundle\") pod \"f1e1a325-f67c-4d27-8481-cc8b1ca16544\" (UID: \"f1e1a325-f67c-4d27-8481-cc8b1ca16544\") " Mar 16 17:06:00 crc kubenswrapper[5120]: I0316 17:06:00.348033 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f1e1a325-f67c-4d27-8481-cc8b1ca16544-run-httpd\") pod \"f1e1a325-f67c-4d27-8481-cc8b1ca16544\" (UID: \"f1e1a325-f67c-4d27-8481-cc8b1ca16544\") " Mar 16 17:06:00 crc kubenswrapper[5120]: I0316 17:06:00.348087 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f1e1a325-f67c-4d27-8481-cc8b1ca16544-scripts\") pod \"f1e1a325-f67c-4d27-8481-cc8b1ca16544\" (UID: \"f1e1a325-f67c-4d27-8481-cc8b1ca16544\") " Mar 16 17:06:00 crc kubenswrapper[5120]: I0316 17:06:00.348140 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f1e1a325-f67c-4d27-8481-cc8b1ca16544-log-httpd\") pod \"f1e1a325-f67c-4d27-8481-cc8b1ca16544\" (UID: \"f1e1a325-f67c-4d27-8481-cc8b1ca16544\") " Mar 16 17:06:00 crc kubenswrapper[5120]: I0316 17:06:00.348566 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1e1a325-f67c-4d27-8481-cc8b1ca16544-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "f1e1a325-f67c-4d27-8481-cc8b1ca16544" (UID: "f1e1a325-f67c-4d27-8481-cc8b1ca16544"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:06:00 crc kubenswrapper[5120]: I0316 17:06:00.348881 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c552v\" (UniqueName: \"kubernetes.io/projected/25275544-fa2d-4ef6-9576-b49753a36b45-kube-api-access-c552v\") pod \"auto-csr-approver-29561346-4bglb\" (UID: \"25275544-fa2d-4ef6-9576-b49753a36b45\") " pod="openshift-infra/auto-csr-approver-29561346-4bglb" Mar 16 17:06:00 crc kubenswrapper[5120]: I0316 17:06:00.349073 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1e1a325-f67c-4d27-8481-cc8b1ca16544-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "f1e1a325-f67c-4d27-8481-cc8b1ca16544" (UID: "f1e1a325-f67c-4d27-8481-cc8b1ca16544"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:06:00 crc kubenswrapper[5120]: I0316 17:06:00.349355 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f1e1a325-f67c-4d27-8481-cc8b1ca16544-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 17:06:00 crc kubenswrapper[5120]: I0316 17:06:00.349375 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f1e1a325-f67c-4d27-8481-cc8b1ca16544-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 17:06:00 crc kubenswrapper[5120]: I0316 17:06:00.351444 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"431c87cc-4a05-421e-a7d6-74fa09328220","Type":"ContainerStarted","Data":"33661e25e8fa4b583a11c440c5312f2c3e50e752530fcc9b7fd8fcd89222eb0b"} Mar 16 17:06:00 crc kubenswrapper[5120]: I0316 17:06:00.354502 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f1e1a325-f67c-4d27-8481-cc8b1ca16544-scripts" (OuterVolumeSpecName: "scripts") pod "f1e1a325-f67c-4d27-8481-cc8b1ca16544" (UID: "f1e1a325-f67c-4d27-8481-cc8b1ca16544"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:06:00 crc kubenswrapper[5120]: I0316 17:06:00.356130 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1e1a325-f67c-4d27-8481-cc8b1ca16544-kube-api-access-2kt7p" (OuterVolumeSpecName: "kube-api-access-2kt7p") pod "f1e1a325-f67c-4d27-8481-cc8b1ca16544" (UID: "f1e1a325-f67c-4d27-8481-cc8b1ca16544"). InnerVolumeSpecName "kube-api-access-2kt7p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:06:00 crc kubenswrapper[5120]: I0316 17:06:00.366483 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c552v\" (UniqueName: \"kubernetes.io/projected/25275544-fa2d-4ef6-9576-b49753a36b45-kube-api-access-c552v\") pod \"auto-csr-approver-29561346-4bglb\" (UID: \"25275544-fa2d-4ef6-9576-b49753a36b45\") " pod="openshift-infra/auto-csr-approver-29561346-4bglb" Mar 16 17:06:00 crc kubenswrapper[5120]: I0316 17:06:00.388379 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-internal-api-0" podStartSLOduration=3.388355036 podStartE2EDuration="3.388355036s" podCreationTimestamp="2026-03-16 17:05:57 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:06:00.375049267 +0000 UTC m=+5662.528980944" watchObservedRunningTime="2026-03-16 17:06:00.388355036 +0000 UTC m=+5662.542286693" Mar 16 17:06:00 crc kubenswrapper[5120]: I0316 17:06:00.391563 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f1e1a325-f67c-4d27-8481-cc8b1ca16544-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "f1e1a325-f67c-4d27-8481-cc8b1ca16544" (UID: "f1e1a325-f67c-4d27-8481-cc8b1ca16544"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:06:00 crc kubenswrapper[5120]: I0316 17:06:00.445000 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f1e1a325-f67c-4d27-8481-cc8b1ca16544-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f1e1a325-f67c-4d27-8481-cc8b1ca16544" (UID: "f1e1a325-f67c-4d27-8481-cc8b1ca16544"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:06:00 crc kubenswrapper[5120]: I0316 17:06:00.455852 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f1e1a325-f67c-4d27-8481-cc8b1ca16544-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:06:00 crc kubenswrapper[5120]: I0316 17:06:00.455879 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f1e1a325-f67c-4d27-8481-cc8b1ca16544-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:06:00 crc kubenswrapper[5120]: I0316 17:06:00.455889 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/f1e1a325-f67c-4d27-8481-cc8b1ca16544-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 17:06:00 crc kubenswrapper[5120]: I0316 17:06:00.455897 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2kt7p\" (UniqueName: \"kubernetes.io/projected/f1e1a325-f67c-4d27-8481-cc8b1ca16544-kube-api-access-2kt7p\") on node \"crc\" DevicePath \"\"" Mar 16 17:06:00 crc kubenswrapper[5120]: I0316 17:06:00.461729 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f1e1a325-f67c-4d27-8481-cc8b1ca16544-config-data" (OuterVolumeSpecName: "config-data") pod "f1e1a325-f67c-4d27-8481-cc8b1ca16544" (UID: "f1e1a325-f67c-4d27-8481-cc8b1ca16544"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:06:00 crc kubenswrapper[5120]: I0316 17:06:00.472572 5120 scope.go:117] "RemoveContainer" containerID="5f11fe9c300aadc98f27a5b7c9ab43408d490f0eeb54de93b11fdca9e195338e" Mar 16 17:06:00 crc kubenswrapper[5120]: I0316 17:06:00.491275 5120 scope.go:117] "RemoveContainer" containerID="330cc0aa03e6f2c6d0aa3277cd49c36db34efa5f48e8b1c37afcf9735a44e1f1" Mar 16 17:06:00 crc kubenswrapper[5120]: I0316 17:06:00.513232 5120 scope.go:117] "RemoveContainer" containerID="cb8d454fd5d6f96fe29a6adb9edf420a55afe0e6278e9f8e01d74b8073f30ee1" Mar 16 17:06:00 crc kubenswrapper[5120]: I0316 17:06:00.545225 5120 scope.go:117] "RemoveContainer" containerID="54b93f3676075dc4f599853c1b5a0e0e15138101b435f7bba936a022aeeb7bad" Mar 16 17:06:00 crc kubenswrapper[5120]: E0316 17:06:00.545737 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"54b93f3676075dc4f599853c1b5a0e0e15138101b435f7bba936a022aeeb7bad\": container with ID starting with 54b93f3676075dc4f599853c1b5a0e0e15138101b435f7bba936a022aeeb7bad not found: ID does not exist" containerID="54b93f3676075dc4f599853c1b5a0e0e15138101b435f7bba936a022aeeb7bad" Mar 16 17:06:00 crc kubenswrapper[5120]: I0316 17:06:00.545861 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54b93f3676075dc4f599853c1b5a0e0e15138101b435f7bba936a022aeeb7bad"} err="failed to get container status \"54b93f3676075dc4f599853c1b5a0e0e15138101b435f7bba936a022aeeb7bad\": rpc error: code = NotFound desc = could not find container \"54b93f3676075dc4f599853c1b5a0e0e15138101b435f7bba936a022aeeb7bad\": container with ID starting with 54b93f3676075dc4f599853c1b5a0e0e15138101b435f7bba936a022aeeb7bad not found: ID does not exist" Mar 16 17:06:00 crc kubenswrapper[5120]: I0316 17:06:00.545952 5120 scope.go:117] "RemoveContainer" containerID="5f11fe9c300aadc98f27a5b7c9ab43408d490f0eeb54de93b11fdca9e195338e" Mar 16 17:06:00 crc kubenswrapper[5120]: E0316 17:06:00.546497 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f11fe9c300aadc98f27a5b7c9ab43408d490f0eeb54de93b11fdca9e195338e\": container with ID starting with 5f11fe9c300aadc98f27a5b7c9ab43408d490f0eeb54de93b11fdca9e195338e not found: ID does not exist" containerID="5f11fe9c300aadc98f27a5b7c9ab43408d490f0eeb54de93b11fdca9e195338e" Mar 16 17:06:00 crc kubenswrapper[5120]: I0316 17:06:00.546541 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f11fe9c300aadc98f27a5b7c9ab43408d490f0eeb54de93b11fdca9e195338e"} err="failed to get container status \"5f11fe9c300aadc98f27a5b7c9ab43408d490f0eeb54de93b11fdca9e195338e\": rpc error: code = NotFound desc = could not find container \"5f11fe9c300aadc98f27a5b7c9ab43408d490f0eeb54de93b11fdca9e195338e\": container with ID starting with 5f11fe9c300aadc98f27a5b7c9ab43408d490f0eeb54de93b11fdca9e195338e not found: ID does not exist" Mar 16 17:06:00 crc kubenswrapper[5120]: I0316 17:06:00.546579 5120 scope.go:117] "RemoveContainer" containerID="330cc0aa03e6f2c6d0aa3277cd49c36db34efa5f48e8b1c37afcf9735a44e1f1" Mar 16 17:06:00 crc kubenswrapper[5120]: E0316 17:06:00.546941 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"330cc0aa03e6f2c6d0aa3277cd49c36db34efa5f48e8b1c37afcf9735a44e1f1\": container with ID starting with 330cc0aa03e6f2c6d0aa3277cd49c36db34efa5f48e8b1c37afcf9735a44e1f1 not found: ID does not exist" containerID="330cc0aa03e6f2c6d0aa3277cd49c36db34efa5f48e8b1c37afcf9735a44e1f1" Mar 16 17:06:00 crc kubenswrapper[5120]: I0316 17:06:00.546979 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"330cc0aa03e6f2c6d0aa3277cd49c36db34efa5f48e8b1c37afcf9735a44e1f1"} err="failed to get container status \"330cc0aa03e6f2c6d0aa3277cd49c36db34efa5f48e8b1c37afcf9735a44e1f1\": rpc error: code = NotFound desc = could not find container \"330cc0aa03e6f2c6d0aa3277cd49c36db34efa5f48e8b1c37afcf9735a44e1f1\": container with ID starting with 330cc0aa03e6f2c6d0aa3277cd49c36db34efa5f48e8b1c37afcf9735a44e1f1 not found: ID does not exist" Mar 16 17:06:00 crc kubenswrapper[5120]: I0316 17:06:00.547027 5120 scope.go:117] "RemoveContainer" containerID="cb8d454fd5d6f96fe29a6adb9edf420a55afe0e6278e9f8e01d74b8073f30ee1" Mar 16 17:06:00 crc kubenswrapper[5120]: E0316 17:06:00.547326 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cb8d454fd5d6f96fe29a6adb9edf420a55afe0e6278e9f8e01d74b8073f30ee1\": container with ID starting with cb8d454fd5d6f96fe29a6adb9edf420a55afe0e6278e9f8e01d74b8073f30ee1 not found: ID does not exist" containerID="cb8d454fd5d6f96fe29a6adb9edf420a55afe0e6278e9f8e01d74b8073f30ee1" Mar 16 17:06:00 crc kubenswrapper[5120]: I0316 17:06:00.547351 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb8d454fd5d6f96fe29a6adb9edf420a55afe0e6278e9f8e01d74b8073f30ee1"} err="failed to get container status \"cb8d454fd5d6f96fe29a6adb9edf420a55afe0e6278e9f8e01d74b8073f30ee1\": rpc error: code = NotFound desc = could not find container \"cb8d454fd5d6f96fe29a6adb9edf420a55afe0e6278e9f8e01d74b8073f30ee1\": container with ID starting with cb8d454fd5d6f96fe29a6adb9edf420a55afe0e6278e9f8e01d74b8073f30ee1 not found: ID does not exist" Mar 16 17:06:00 crc kubenswrapper[5120]: I0316 17:06:00.552637 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561346-4bglb" Mar 16 17:06:00 crc kubenswrapper[5120]: I0316 17:06:00.558053 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f1e1a325-f67c-4d27-8481-cc8b1ca16544-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:06:00 crc kubenswrapper[5120]: I0316 17:06:00.691534 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:06:00 crc kubenswrapper[5120]: I0316 17:06:00.710863 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:06:00 crc kubenswrapper[5120]: I0316 17:06:00.727069 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:06:00 crc kubenswrapper[5120]: I0316 17:06:00.728591 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1e1a325-f67c-4d27-8481-cc8b1ca16544" containerName="sg-core" Mar 16 17:06:00 crc kubenswrapper[5120]: I0316 17:06:00.728619 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1e1a325-f67c-4d27-8481-cc8b1ca16544" containerName="sg-core" Mar 16 17:06:00 crc kubenswrapper[5120]: I0316 17:06:00.728648 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1e1a325-f67c-4d27-8481-cc8b1ca16544" containerName="ceilometer-central-agent" Mar 16 17:06:00 crc kubenswrapper[5120]: I0316 17:06:00.728657 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1e1a325-f67c-4d27-8481-cc8b1ca16544" containerName="ceilometer-central-agent" Mar 16 17:06:00 crc kubenswrapper[5120]: I0316 17:06:00.728679 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1e1a325-f67c-4d27-8481-cc8b1ca16544" containerName="proxy-httpd" Mar 16 17:06:00 crc kubenswrapper[5120]: I0316 17:06:00.728687 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1e1a325-f67c-4d27-8481-cc8b1ca16544" containerName="proxy-httpd" Mar 16 17:06:00 crc kubenswrapper[5120]: I0316 17:06:00.728710 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1e1a325-f67c-4d27-8481-cc8b1ca16544" containerName="ceilometer-notification-agent" Mar 16 17:06:00 crc kubenswrapper[5120]: I0316 17:06:00.728718 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1e1a325-f67c-4d27-8481-cc8b1ca16544" containerName="ceilometer-notification-agent" Mar 16 17:06:00 crc kubenswrapper[5120]: I0316 17:06:00.728983 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f1e1a325-f67c-4d27-8481-cc8b1ca16544" containerName="ceilometer-notification-agent" Mar 16 17:06:00 crc kubenswrapper[5120]: I0316 17:06:00.729010 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f1e1a325-f67c-4d27-8481-cc8b1ca16544" containerName="ceilometer-central-agent" Mar 16 17:06:00 crc kubenswrapper[5120]: I0316 17:06:00.729023 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f1e1a325-f67c-4d27-8481-cc8b1ca16544" containerName="sg-core" Mar 16 17:06:00 crc kubenswrapper[5120]: I0316 17:06:00.729043 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f1e1a325-f67c-4d27-8481-cc8b1ca16544" containerName="proxy-httpd" Mar 16 17:06:00 crc kubenswrapper[5120]: I0316 17:06:00.743286 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:06:00 crc kubenswrapper[5120]: I0316 17:06:00.743433 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:06:00 crc kubenswrapper[5120]: I0316 17:06:00.745408 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 17:06:00 crc kubenswrapper[5120]: I0316 17:06:00.746091 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 17:06:00 crc kubenswrapper[5120]: I0316 17:06:00.865110 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/194d643a-a5df-47e5-a784-033ce596809e-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"194d643a-a5df-47e5-a784-033ce596809e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:06:00 crc kubenswrapper[5120]: I0316 17:06:00.865219 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/194d643a-a5df-47e5-a784-033ce596809e-run-httpd\") pod \"ceilometer-0\" (UID: \"194d643a-a5df-47e5-a784-033ce596809e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:06:00 crc kubenswrapper[5120]: I0316 17:06:00.865454 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/194d643a-a5df-47e5-a784-033ce596809e-scripts\") pod \"ceilometer-0\" (UID: \"194d643a-a5df-47e5-a784-033ce596809e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:06:00 crc kubenswrapper[5120]: I0316 17:06:00.865685 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/194d643a-a5df-47e5-a784-033ce596809e-config-data\") pod \"ceilometer-0\" (UID: \"194d643a-a5df-47e5-a784-033ce596809e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:06:00 crc kubenswrapper[5120]: I0316 17:06:00.865891 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7z9nx\" (UniqueName: \"kubernetes.io/projected/194d643a-a5df-47e5-a784-033ce596809e-kube-api-access-7z9nx\") pod \"ceilometer-0\" (UID: \"194d643a-a5df-47e5-a784-033ce596809e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:06:00 crc kubenswrapper[5120]: I0316 17:06:00.866055 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/194d643a-a5df-47e5-a784-033ce596809e-log-httpd\") pod \"ceilometer-0\" (UID: \"194d643a-a5df-47e5-a784-033ce596809e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:06:00 crc kubenswrapper[5120]: I0316 17:06:00.866120 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/194d643a-a5df-47e5-a784-033ce596809e-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"194d643a-a5df-47e5-a784-033ce596809e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:06:00 crc kubenswrapper[5120]: I0316 17:06:00.968211 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/194d643a-a5df-47e5-a784-033ce596809e-run-httpd\") pod \"ceilometer-0\" (UID: \"194d643a-a5df-47e5-a784-033ce596809e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:06:00 crc kubenswrapper[5120]: I0316 17:06:00.968339 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/194d643a-a5df-47e5-a784-033ce596809e-scripts\") pod \"ceilometer-0\" (UID: \"194d643a-a5df-47e5-a784-033ce596809e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:06:00 crc kubenswrapper[5120]: I0316 17:06:00.968415 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/194d643a-a5df-47e5-a784-033ce596809e-config-data\") pod \"ceilometer-0\" (UID: \"194d643a-a5df-47e5-a784-033ce596809e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:06:00 crc kubenswrapper[5120]: I0316 17:06:00.968508 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7z9nx\" (UniqueName: \"kubernetes.io/projected/194d643a-a5df-47e5-a784-033ce596809e-kube-api-access-7z9nx\") pod \"ceilometer-0\" (UID: \"194d643a-a5df-47e5-a784-033ce596809e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:06:00 crc kubenswrapper[5120]: I0316 17:06:00.968591 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/194d643a-a5df-47e5-a784-033ce596809e-log-httpd\") pod \"ceilometer-0\" (UID: \"194d643a-a5df-47e5-a784-033ce596809e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:06:00 crc kubenswrapper[5120]: I0316 17:06:00.968656 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/194d643a-a5df-47e5-a784-033ce596809e-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"194d643a-a5df-47e5-a784-033ce596809e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:06:00 crc kubenswrapper[5120]: I0316 17:06:00.968716 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/194d643a-a5df-47e5-a784-033ce596809e-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"194d643a-a5df-47e5-a784-033ce596809e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:06:00 crc kubenswrapper[5120]: I0316 17:06:00.968880 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/194d643a-a5df-47e5-a784-033ce596809e-run-httpd\") pod \"ceilometer-0\" (UID: \"194d643a-a5df-47e5-a784-033ce596809e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:06:00 crc kubenswrapper[5120]: I0316 17:06:00.969742 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/194d643a-a5df-47e5-a784-033ce596809e-log-httpd\") pod \"ceilometer-0\" (UID: \"194d643a-a5df-47e5-a784-033ce596809e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:06:00 crc kubenswrapper[5120]: I0316 17:06:00.974052 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/194d643a-a5df-47e5-a784-033ce596809e-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"194d643a-a5df-47e5-a784-033ce596809e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:06:00 crc kubenswrapper[5120]: I0316 17:06:00.974319 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/194d643a-a5df-47e5-a784-033ce596809e-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"194d643a-a5df-47e5-a784-033ce596809e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:06:00 crc kubenswrapper[5120]: I0316 17:06:00.974689 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/194d643a-a5df-47e5-a784-033ce596809e-scripts\") pod \"ceilometer-0\" (UID: \"194d643a-a5df-47e5-a784-033ce596809e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:06:00 crc kubenswrapper[5120]: I0316 17:06:00.975077 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/194d643a-a5df-47e5-a784-033ce596809e-config-data\") pod \"ceilometer-0\" (UID: \"194d643a-a5df-47e5-a784-033ce596809e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:06:00 crc kubenswrapper[5120]: I0316 17:06:00.985587 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7z9nx\" (UniqueName: \"kubernetes.io/projected/194d643a-a5df-47e5-a784-033ce596809e-kube-api-access-7z9nx\") pod \"ceilometer-0\" (UID: \"194d643a-a5df-47e5-a784-033ce596809e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:06:01 crc kubenswrapper[5120]: I0316 17:06:01.021230 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561346-4bglb"] Mar 16 17:06:01 crc kubenswrapper[5120]: I0316 17:06:01.064405 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:06:01 crc kubenswrapper[5120]: I0316 17:06:01.363198 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561346-4bglb" event={"ID":"25275544-fa2d-4ef6-9576-b49753a36b45","Type":"ContainerStarted","Data":"ccfb67ccabab4541a53c7a436814c9fe9ef493ad3a01cc42c89d75518976186c"} Mar 16 17:06:01 crc kubenswrapper[5120]: I0316 17:06:01.365653 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-marketplace/community-operators-hfs9z" podUID="b1c7cd6c-f5b4-449c-b2a1-f92d7bb56c59" containerName="registry-server" containerID="cri-o://f38e885b0fdd465fddbd5430ced7e2ee57a3217b955e9a4c49b12c573be94a2c" gracePeriod=2 Mar 16 17:06:01 crc kubenswrapper[5120]: I0316 17:06:01.524608 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:06:01 crc kubenswrapper[5120]: W0316 17:06:01.525589 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod194d643a_a5df_47e5_a784_033ce596809e.slice/crio-9dd4b9b5768752960674b8e1e44307e8549b7639c9c786831c17afb374408a20 WatchSource:0}: Error finding container 9dd4b9b5768752960674b8e1e44307e8549b7639c9c786831c17afb374408a20: Status 404 returned error can't find the container with id 9dd4b9b5768752960674b8e1e44307e8549b7639c9c786831c17afb374408a20 Mar 16 17:06:01 crc kubenswrapper[5120]: I0316 17:06:01.763772 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-hfs9z" Mar 16 17:06:01 crc kubenswrapper[5120]: I0316 17:06:01.902114 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ftkvd\" (UniqueName: \"kubernetes.io/projected/b1c7cd6c-f5b4-449c-b2a1-f92d7bb56c59-kube-api-access-ftkvd\") pod \"b1c7cd6c-f5b4-449c-b2a1-f92d7bb56c59\" (UID: \"b1c7cd6c-f5b4-449c-b2a1-f92d7bb56c59\") " Mar 16 17:06:01 crc kubenswrapper[5120]: I0316 17:06:01.902645 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/b1c7cd6c-f5b4-449c-b2a1-f92d7bb56c59-utilities\") pod \"b1c7cd6c-f5b4-449c-b2a1-f92d7bb56c59\" (UID: \"b1c7cd6c-f5b4-449c-b2a1-f92d7bb56c59\") " Mar 16 17:06:01 crc kubenswrapper[5120]: I0316 17:06:01.902943 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/b1c7cd6c-f5b4-449c-b2a1-f92d7bb56c59-catalog-content\") pod \"b1c7cd6c-f5b4-449c-b2a1-f92d7bb56c59\" (UID: \"b1c7cd6c-f5b4-449c-b2a1-f92d7bb56c59\") " Mar 16 17:06:01 crc kubenswrapper[5120]: I0316 17:06:01.903789 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1c7cd6c-f5b4-449c-b2a1-f92d7bb56c59-utilities" (OuterVolumeSpecName: "utilities") pod "b1c7cd6c-f5b4-449c-b2a1-f92d7bb56c59" (UID: "b1c7cd6c-f5b4-449c-b2a1-f92d7bb56c59"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:06:01 crc kubenswrapper[5120]: I0316 17:06:01.908750 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1c7cd6c-f5b4-449c-b2a1-f92d7bb56c59-kube-api-access-ftkvd" (OuterVolumeSpecName: "kube-api-access-ftkvd") pod "b1c7cd6c-f5b4-449c-b2a1-f92d7bb56c59" (UID: "b1c7cd6c-f5b4-449c-b2a1-f92d7bb56c59"). InnerVolumeSpecName "kube-api-access-ftkvd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:06:01 crc kubenswrapper[5120]: I0316 17:06:01.962486 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1c7cd6c-f5b4-449c-b2a1-f92d7bb56c59-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "b1c7cd6c-f5b4-449c-b2a1-f92d7bb56c59" (UID: "b1c7cd6c-f5b4-449c-b2a1-f92d7bb56c59"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:06:02 crc kubenswrapper[5120]: I0316 17:06:02.006080 5120 reconciler_common.go:299] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/b1c7cd6c-f5b4-449c-b2a1-f92d7bb56c59-catalog-content\") on node \"crc\" DevicePath \"\"" Mar 16 17:06:02 crc kubenswrapper[5120]: I0316 17:06:02.006123 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ftkvd\" (UniqueName: \"kubernetes.io/projected/b1c7cd6c-f5b4-449c-b2a1-f92d7bb56c59-kube-api-access-ftkvd\") on node \"crc\" DevicePath \"\"" Mar 16 17:06:02 crc kubenswrapper[5120]: I0316 17:06:02.006137 5120 reconciler_common.go:299] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/b1c7cd6c-f5b4-449c-b2a1-f92d7bb56c59-utilities\") on node \"crc\" DevicePath \"\"" Mar 16 17:06:02 crc kubenswrapper[5120]: I0316 17:06:02.394443 5120 generic.go:358] "Generic (PLEG): container finished" podID="b1c7cd6c-f5b4-449c-b2a1-f92d7bb56c59" containerID="f38e885b0fdd465fddbd5430ced7e2ee57a3217b955e9a4c49b12c573be94a2c" exitCode=0 Mar 16 17:06:02 crc kubenswrapper[5120]: I0316 17:06:02.394490 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-hfs9z" event={"ID":"b1c7cd6c-f5b4-449c-b2a1-f92d7bb56c59","Type":"ContainerDied","Data":"f38e885b0fdd465fddbd5430ced7e2ee57a3217b955e9a4c49b12c573be94a2c"} Mar 16 17:06:02 crc kubenswrapper[5120]: I0316 17:06:02.395103 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-hfs9z" event={"ID":"b1c7cd6c-f5b4-449c-b2a1-f92d7bb56c59","Type":"ContainerDied","Data":"58df6dca0fcc7743256100f529766c3869878e338592285732b402ceea5e97a7"} Mar 16 17:06:02 crc kubenswrapper[5120]: I0316 17:06:02.394583 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-hfs9z" Mar 16 17:06:02 crc kubenswrapper[5120]: I0316 17:06:02.395132 5120 scope.go:117] "RemoveContainer" containerID="f38e885b0fdd465fddbd5430ced7e2ee57a3217b955e9a4c49b12c573be94a2c" Mar 16 17:06:02 crc kubenswrapper[5120]: I0316 17:06:02.400167 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"194d643a-a5df-47e5-a784-033ce596809e","Type":"ContainerStarted","Data":"88a8e8261bde1f1f9445d5410d4b6633d98a1011efa62d11e1974fc3853830da"} Mar 16 17:06:02 crc kubenswrapper[5120]: I0316 17:06:02.400233 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"194d643a-a5df-47e5-a784-033ce596809e","Type":"ContainerStarted","Data":"9dd4b9b5768752960674b8e1e44307e8549b7639c9c786831c17afb374408a20"} Mar 16 17:06:02 crc kubenswrapper[5120]: I0316 17:06:02.429150 5120 scope.go:117] "RemoveContainer" containerID="721f0588f0e3742c62af464e8a7e3ec3154f57768e3b04d9d2834fa3c30030de" Mar 16 17:06:02 crc kubenswrapper[5120]: I0316 17:06:02.442367 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/community-operators-hfs9z"] Mar 16 17:06:02 crc kubenswrapper[5120]: I0316 17:06:02.456774 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/community-operators-hfs9z"] Mar 16 17:06:02 crc kubenswrapper[5120]: I0316 17:06:02.472686 5120 scope.go:117] "RemoveContainer" containerID="4566d8d4500761a24279232d26b1749522cbc8c2a2c6c2d251b529bb403c3a22" Mar 16 17:06:02 crc kubenswrapper[5120]: I0316 17:06:02.499566 5120 scope.go:117] "RemoveContainer" containerID="f38e885b0fdd465fddbd5430ced7e2ee57a3217b955e9a4c49b12c573be94a2c" Mar 16 17:06:02 crc kubenswrapper[5120]: E0316 17:06:02.500130 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f38e885b0fdd465fddbd5430ced7e2ee57a3217b955e9a4c49b12c573be94a2c\": container with ID starting with f38e885b0fdd465fddbd5430ced7e2ee57a3217b955e9a4c49b12c573be94a2c not found: ID does not exist" containerID="f38e885b0fdd465fddbd5430ced7e2ee57a3217b955e9a4c49b12c573be94a2c" Mar 16 17:06:02 crc kubenswrapper[5120]: I0316 17:06:02.500192 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f38e885b0fdd465fddbd5430ced7e2ee57a3217b955e9a4c49b12c573be94a2c"} err="failed to get container status \"f38e885b0fdd465fddbd5430ced7e2ee57a3217b955e9a4c49b12c573be94a2c\": rpc error: code = NotFound desc = could not find container \"f38e885b0fdd465fddbd5430ced7e2ee57a3217b955e9a4c49b12c573be94a2c\": container with ID starting with f38e885b0fdd465fddbd5430ced7e2ee57a3217b955e9a4c49b12c573be94a2c not found: ID does not exist" Mar 16 17:06:02 crc kubenswrapper[5120]: I0316 17:06:02.500219 5120 scope.go:117] "RemoveContainer" containerID="721f0588f0e3742c62af464e8a7e3ec3154f57768e3b04d9d2834fa3c30030de" Mar 16 17:06:02 crc kubenswrapper[5120]: E0316 17:06:02.500591 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"721f0588f0e3742c62af464e8a7e3ec3154f57768e3b04d9d2834fa3c30030de\": container with ID starting with 721f0588f0e3742c62af464e8a7e3ec3154f57768e3b04d9d2834fa3c30030de not found: ID does not exist" containerID="721f0588f0e3742c62af464e8a7e3ec3154f57768e3b04d9d2834fa3c30030de" Mar 16 17:06:02 crc kubenswrapper[5120]: I0316 17:06:02.500622 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"721f0588f0e3742c62af464e8a7e3ec3154f57768e3b04d9d2834fa3c30030de"} err="failed to get container status \"721f0588f0e3742c62af464e8a7e3ec3154f57768e3b04d9d2834fa3c30030de\": rpc error: code = NotFound desc = could not find container \"721f0588f0e3742c62af464e8a7e3ec3154f57768e3b04d9d2834fa3c30030de\": container with ID starting with 721f0588f0e3742c62af464e8a7e3ec3154f57768e3b04d9d2834fa3c30030de not found: ID does not exist" Mar 16 17:06:02 crc kubenswrapper[5120]: I0316 17:06:02.500660 5120 scope.go:117] "RemoveContainer" containerID="4566d8d4500761a24279232d26b1749522cbc8c2a2c6c2d251b529bb403c3a22" Mar 16 17:06:02 crc kubenswrapper[5120]: E0316 17:06:02.501065 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4566d8d4500761a24279232d26b1749522cbc8c2a2c6c2d251b529bb403c3a22\": container with ID starting with 4566d8d4500761a24279232d26b1749522cbc8c2a2c6c2d251b529bb403c3a22 not found: ID does not exist" containerID="4566d8d4500761a24279232d26b1749522cbc8c2a2c6c2d251b529bb403c3a22" Mar 16 17:06:02 crc kubenswrapper[5120]: I0316 17:06:02.501162 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4566d8d4500761a24279232d26b1749522cbc8c2a2c6c2d251b529bb403c3a22"} err="failed to get container status \"4566d8d4500761a24279232d26b1749522cbc8c2a2c6c2d251b529bb403c3a22\": rpc error: code = NotFound desc = could not find container \"4566d8d4500761a24279232d26b1749522cbc8c2a2c6c2d251b529bb403c3a22\": container with ID starting with 4566d8d4500761a24279232d26b1749522cbc8c2a2c6c2d251b529bb403c3a22 not found: ID does not exist" Mar 16 17:06:02 crc kubenswrapper[5120]: I0316 17:06:02.676370 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b1c7cd6c-f5b4-449c-b2a1-f92d7bb56c59" path="/var/lib/kubelet/pods/b1c7cd6c-f5b4-449c-b2a1-f92d7bb56c59/volumes" Mar 16 17:06:02 crc kubenswrapper[5120]: I0316 17:06:02.679652 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f1e1a325-f67c-4d27-8481-cc8b1ca16544" path="/var/lib/kubelet/pods/f1e1a325-f67c-4d27-8481-cc8b1ca16544/volumes" Mar 16 17:06:03 crc kubenswrapper[5120]: I0316 17:06:03.419770 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"194d643a-a5df-47e5-a784-033ce596809e","Type":"ContainerStarted","Data":"dd1479fa3ec45e1bd78229508bb4d71140d5aaed1abfa331b1be4fa2ca4a7ed1"} Mar 16 17:06:03 crc kubenswrapper[5120]: I0316 17:06:03.421473 5120 generic.go:358] "Generic (PLEG): container finished" podID="25275544-fa2d-4ef6-9576-b49753a36b45" containerID="24729fcf1c0b649ba0cab170d265c4eeac4f015a4ef24e096631af5caa5bfe96" exitCode=0 Mar 16 17:06:03 crc kubenswrapper[5120]: I0316 17:06:03.421589 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561346-4bglb" event={"ID":"25275544-fa2d-4ef6-9576-b49753a36b45","Type":"ContainerDied","Data":"24729fcf1c0b649ba0cab170d265c4eeac4f015a4ef24e096631af5caa5bfe96"} Mar 16 17:06:04 crc kubenswrapper[5120]: E0316 17:06:04.148158 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="8993820f9a0e78f6731cfe3132d071f83d39bacb35b813574b2d3dc5377237b4" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 17:06:04 crc kubenswrapper[5120]: E0316 17:06:04.149983 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="8993820f9a0e78f6731cfe3132d071f83d39bacb35b813574b2d3dc5377237b4" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 17:06:04 crc kubenswrapper[5120]: E0316 17:06:04.151683 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="8993820f9a0e78f6731cfe3132d071f83d39bacb35b813574b2d3dc5377237b4" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 17:06:04 crc kubenswrapper[5120]: E0316 17:06:04.151752 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="109878b2-8544-42b9-9602-c9d665976dfa" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 17:06:04 crc kubenswrapper[5120]: I0316 17:06:04.435861 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"194d643a-a5df-47e5-a784-033ce596809e","Type":"ContainerStarted","Data":"cc9a8cdc43460a02454df2b447222ac753a835e25b4678c7eac4ef94e84005c5"} Mar 16 17:06:04 crc kubenswrapper[5120]: I0316 17:06:04.665175 5120 scope.go:117] "RemoveContainer" containerID="db39d192fa687a13805537d08ad22fed1ef362ef5027c920a616297dc55a8ea9" Mar 16 17:06:04 crc kubenswrapper[5120]: E0316 17:06:04.665449 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 17:06:04 crc kubenswrapper[5120]: I0316 17:06:04.814085 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561346-4bglb" Mar 16 17:06:04 crc kubenswrapper[5120]: I0316 17:06:04.987963 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c552v\" (UniqueName: \"kubernetes.io/projected/25275544-fa2d-4ef6-9576-b49753a36b45-kube-api-access-c552v\") pod \"25275544-fa2d-4ef6-9576-b49753a36b45\" (UID: \"25275544-fa2d-4ef6-9576-b49753a36b45\") " Mar 16 17:06:04 crc kubenswrapper[5120]: I0316 17:06:04.994435 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25275544-fa2d-4ef6-9576-b49753a36b45-kube-api-access-c552v" (OuterVolumeSpecName: "kube-api-access-c552v") pod "25275544-fa2d-4ef6-9576-b49753a36b45" (UID: "25275544-fa2d-4ef6-9576-b49753a36b45"). InnerVolumeSpecName "kube-api-access-c552v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:06:05 crc kubenswrapper[5120]: I0316 17:06:05.091978 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c552v\" (UniqueName: \"kubernetes.io/projected/25275544-fa2d-4ef6-9576-b49753a36b45-kube-api-access-c552v\") on node \"crc\" DevicePath \"\"" Mar 16 17:06:05 crc kubenswrapper[5120]: I0316 17:06:05.453796 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561346-4bglb" event={"ID":"25275544-fa2d-4ef6-9576-b49753a36b45","Type":"ContainerDied","Data":"ccfb67ccabab4541a53c7a436814c9fe9ef493ad3a01cc42c89d75518976186c"} Mar 16 17:06:05 crc kubenswrapper[5120]: I0316 17:06:05.453839 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ccfb67ccabab4541a53c7a436814c9fe9ef493ad3a01cc42c89d75518976186c" Mar 16 17:06:05 crc kubenswrapper[5120]: I0316 17:06:05.453927 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561346-4bglb" Mar 16 17:06:05 crc kubenswrapper[5120]: I0316 17:06:05.888050 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-infra/auto-csr-approver-29561340-lqcpp"] Mar 16 17:06:05 crc kubenswrapper[5120]: I0316 17:06:05.897425 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-infra/auto-csr-approver-29561340-lqcpp"] Mar 16 17:06:06 crc kubenswrapper[5120]: I0316 17:06:06.465974 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"194d643a-a5df-47e5-a784-033ce596809e","Type":"ContainerStarted","Data":"93648515609f108a56c2bda326b39d41ec58faa1e5500425d82c0664febb6508"} Mar 16 17:06:06 crc kubenswrapper[5120]: I0316 17:06:06.466072 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:06:06 crc kubenswrapper[5120]: I0316 17:06:06.496886 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.046381719 podStartE2EDuration="6.496859693s" podCreationTimestamp="2026-03-16 17:06:00 +0000 UTC" firstStartedPulling="2026-03-16 17:06:01.527814523 +0000 UTC m=+5663.681746180" lastFinishedPulling="2026-03-16 17:06:05.978292497 +0000 UTC m=+5668.132224154" observedRunningTime="2026-03-16 17:06:06.487642078 +0000 UTC m=+5668.641573735" watchObservedRunningTime="2026-03-16 17:06:06.496859693 +0000 UTC m=+5668.650791350" Mar 16 17:06:06 crc kubenswrapper[5120]: I0316 17:06:06.985513 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ad8c715f-c9c8-4ab6-8b01-dc9a8dd3eda2" path="/var/lib/kubelet/pods/ad8c715f-c9c8-4ab6-8b01-dc9a8dd3eda2/volumes" Mar 16 17:06:06 crc kubenswrapper[5120]: I0316 17:06:06.986504 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:06:06 crc kubenswrapper[5120]: I0316 17:06:06.986541 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:06:07 crc kubenswrapper[5120]: I0316 17:06:07.002542 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:06:07 crc kubenswrapper[5120]: I0316 17:06:07.031322 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:06:07 crc kubenswrapper[5120]: I0316 17:06:07.475976 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:06:07 crc kubenswrapper[5120]: I0316 17:06:07.478830 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:06:07 crc kubenswrapper[5120]: I0316 17:06:07.856226 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:06:07 crc kubenswrapper[5120]: I0316 17:06:07.861643 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:06:07 crc kubenswrapper[5120]: I0316 17:06:07.898067 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:06:07 crc kubenswrapper[5120]: I0316 17:06:07.902782 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:06:08 crc kubenswrapper[5120]: E0316 17:06:08.437690 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1764455 actualBytes=10240 Mar 16 17:06:08 crc kubenswrapper[5120]: I0316 17:06:08.485948 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:06:08 crc kubenswrapper[5120]: I0316 17:06:08.485994 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:06:09 crc kubenswrapper[5120]: E0316 17:06:09.147225 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="8993820f9a0e78f6731cfe3132d071f83d39bacb35b813574b2d3dc5377237b4" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 17:06:09 crc kubenswrapper[5120]: E0316 17:06:09.149308 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="8993820f9a0e78f6731cfe3132d071f83d39bacb35b813574b2d3dc5377237b4" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 17:06:09 crc kubenswrapper[5120]: E0316 17:06:09.150653 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="8993820f9a0e78f6731cfe3132d071f83d39bacb35b813574b2d3dc5377237b4" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 17:06:09 crc kubenswrapper[5120]: E0316 17:06:09.150706 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="109878b2-8544-42b9-9602-c9d665976dfa" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 17:06:09 crc kubenswrapper[5120]: I0316 17:06:09.495840 5120 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Mar 16 17:06:09 crc kubenswrapper[5120]: I0316 17:06:09.496656 5120 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Mar 16 17:06:09 crc kubenswrapper[5120]: I0316 17:06:09.497166 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:06:09 crc kubenswrapper[5120]: I0316 17:06:09.600113 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:06:10 crc kubenswrapper[5120]: I0316 17:06:10.500098 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:06:10 crc kubenswrapper[5120]: I0316 17:06:10.509989 5120 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Mar 16 17:06:10 crc kubenswrapper[5120]: I0316 17:06:10.524398 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:06:14 crc kubenswrapper[5120]: E0316 17:06:14.147476 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="8993820f9a0e78f6731cfe3132d071f83d39bacb35b813574b2d3dc5377237b4" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 17:06:14 crc kubenswrapper[5120]: E0316 17:06:14.149674 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="8993820f9a0e78f6731cfe3132d071f83d39bacb35b813574b2d3dc5377237b4" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 17:06:14 crc kubenswrapper[5120]: E0316 17:06:14.151411 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="8993820f9a0e78f6731cfe3132d071f83d39bacb35b813574b2d3dc5377237b4" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 17:06:14 crc kubenswrapper[5120]: E0316 17:06:14.151455 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="109878b2-8544-42b9-9602-c9d665976dfa" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 17:06:14 crc kubenswrapper[5120]: I0316 17:06:14.188782 5120 scope.go:117] "RemoveContainer" containerID="0c04394e8329ca282f6aec00fd61c8a448833782b4dc1a23dcf01dfbde2cad08" Mar 16 17:06:14 crc kubenswrapper[5120]: I0316 17:06:14.214643 5120 scope.go:117] "RemoveContainer" containerID="39019e1d54d9812f3ac3e601ff87d3b2deb317247e2373de978d0f90ce4a6afb" Mar 16 17:06:14 crc kubenswrapper[5120]: I0316 17:06:14.242708 5120 scope.go:117] "RemoveContainer" containerID="412a89ff4eb28302a6a1e3be4668598f262e22d05cebaa7d38b522757af048f9" Mar 16 17:06:14 crc kubenswrapper[5120]: I0316 17:06:14.342612 5120 scope.go:117] "RemoveContainer" containerID="9f10ab7f240e18dc5d0dc1c428ee6fb6885c1a2a7b2d3b49049debfc1e5289c0" Mar 16 17:06:14 crc kubenswrapper[5120]: I0316 17:06:14.369702 5120 scope.go:117] "RemoveContainer" containerID="712abafe835b278bb412b2351660de03a42a32112f74bd71143224f932d3850b" Mar 16 17:06:16 crc kubenswrapper[5120]: I0316 17:06:16.663592 5120 scope.go:117] "RemoveContainer" containerID="db39d192fa687a13805537d08ad22fed1ef362ef5027c920a616297dc55a8ea9" Mar 16 17:06:16 crc kubenswrapper[5120]: E0316 17:06:16.664273 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 17:06:19 crc kubenswrapper[5120]: E0316 17:06:19.147201 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="8993820f9a0e78f6731cfe3132d071f83d39bacb35b813574b2d3dc5377237b4" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 17:06:19 crc kubenswrapper[5120]: E0316 17:06:19.149137 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="8993820f9a0e78f6731cfe3132d071f83d39bacb35b813574b2d3dc5377237b4" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 17:06:19 crc kubenswrapper[5120]: E0316 17:06:19.150726 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="8993820f9a0e78f6731cfe3132d071f83d39bacb35b813574b2d3dc5377237b4" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 17:06:19 crc kubenswrapper[5120]: E0316 17:06:19.150809 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="109878b2-8544-42b9-9602-c9d665976dfa" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 17:06:24 crc kubenswrapper[5120]: E0316 17:06:24.148494 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="8993820f9a0e78f6731cfe3132d071f83d39bacb35b813574b2d3dc5377237b4" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 17:06:24 crc kubenswrapper[5120]: E0316 17:06:24.150970 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="8993820f9a0e78f6731cfe3132d071f83d39bacb35b813574b2d3dc5377237b4" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 17:06:24 crc kubenswrapper[5120]: E0316 17:06:24.152813 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="8993820f9a0e78f6731cfe3132d071f83d39bacb35b813574b2d3dc5377237b4" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 17:06:24 crc kubenswrapper[5120]: E0316 17:06:24.152868 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="109878b2-8544-42b9-9602-c9d665976dfa" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 17:06:24 crc kubenswrapper[5120]: I0316 17:06:24.579506 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 17:06:24 crc kubenswrapper[5120]: I0316 17:06:24.666404 5120 generic.go:358] "Generic (PLEG): container finished" podID="109878b2-8544-42b9-9602-c9d665976dfa" containerID="8993820f9a0e78f6731cfe3132d071f83d39bacb35b813574b2d3dc5377237b4" exitCode=137 Mar 16 17:06:24 crc kubenswrapper[5120]: I0316 17:06:24.666532 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 17:06:24 crc kubenswrapper[5120]: I0316 17:06:24.680535 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"109878b2-8544-42b9-9602-c9d665976dfa","Type":"ContainerDied","Data":"8993820f9a0e78f6731cfe3132d071f83d39bacb35b813574b2d3dc5377237b4"} Mar 16 17:06:24 crc kubenswrapper[5120]: I0316 17:06:24.680594 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"109878b2-8544-42b9-9602-c9d665976dfa","Type":"ContainerDied","Data":"6373a49f2ca5926b46a5e287c0c8e3e91bcb8757910f9aad9787202e32cbdc1f"} Mar 16 17:06:24 crc kubenswrapper[5120]: I0316 17:06:24.680614 5120 scope.go:117] "RemoveContainer" containerID="8993820f9a0e78f6731cfe3132d071f83d39bacb35b813574b2d3dc5377237b4" Mar 16 17:06:24 crc kubenswrapper[5120]: I0316 17:06:24.702567 5120 scope.go:117] "RemoveContainer" containerID="8993820f9a0e78f6731cfe3132d071f83d39bacb35b813574b2d3dc5377237b4" Mar 16 17:06:24 crc kubenswrapper[5120]: E0316 17:06:24.703002 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8993820f9a0e78f6731cfe3132d071f83d39bacb35b813574b2d3dc5377237b4\": container with ID starting with 8993820f9a0e78f6731cfe3132d071f83d39bacb35b813574b2d3dc5377237b4 not found: ID does not exist" containerID="8993820f9a0e78f6731cfe3132d071f83d39bacb35b813574b2d3dc5377237b4" Mar 16 17:06:24 crc kubenswrapper[5120]: I0316 17:06:24.703054 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8993820f9a0e78f6731cfe3132d071f83d39bacb35b813574b2d3dc5377237b4"} err="failed to get container status \"8993820f9a0e78f6731cfe3132d071f83d39bacb35b813574b2d3dc5377237b4\": rpc error: code = NotFound desc = could not find container \"8993820f9a0e78f6731cfe3132d071f83d39bacb35b813574b2d3dc5377237b4\": container with ID starting with 8993820f9a0e78f6731cfe3132d071f83d39bacb35b813574b2d3dc5377237b4 not found: ID does not exist" Mar 16 17:06:24 crc kubenswrapper[5120]: I0316 17:06:24.724374 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ksx45\" (UniqueName: \"kubernetes.io/projected/109878b2-8544-42b9-9602-c9d665976dfa-kube-api-access-ksx45\") pod \"109878b2-8544-42b9-9602-c9d665976dfa\" (UID: \"109878b2-8544-42b9-9602-c9d665976dfa\") " Mar 16 17:06:24 crc kubenswrapper[5120]: I0316 17:06:24.724730 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/109878b2-8544-42b9-9602-c9d665976dfa-combined-ca-bundle\") pod \"109878b2-8544-42b9-9602-c9d665976dfa\" (UID: \"109878b2-8544-42b9-9602-c9d665976dfa\") " Mar 16 17:06:24 crc kubenswrapper[5120]: I0316 17:06:24.724834 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/109878b2-8544-42b9-9602-c9d665976dfa-config-data\") pod \"109878b2-8544-42b9-9602-c9d665976dfa\" (UID: \"109878b2-8544-42b9-9602-c9d665976dfa\") " Mar 16 17:06:24 crc kubenswrapper[5120]: I0316 17:06:24.734086 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/109878b2-8544-42b9-9602-c9d665976dfa-kube-api-access-ksx45" (OuterVolumeSpecName: "kube-api-access-ksx45") pod "109878b2-8544-42b9-9602-c9d665976dfa" (UID: "109878b2-8544-42b9-9602-c9d665976dfa"). InnerVolumeSpecName "kube-api-access-ksx45". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:06:24 crc kubenswrapper[5120]: I0316 17:06:24.752786 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/109878b2-8544-42b9-9602-c9d665976dfa-config-data" (OuterVolumeSpecName: "config-data") pod "109878b2-8544-42b9-9602-c9d665976dfa" (UID: "109878b2-8544-42b9-9602-c9d665976dfa"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:06:24 crc kubenswrapper[5120]: I0316 17:06:24.759633 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/109878b2-8544-42b9-9602-c9d665976dfa-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "109878b2-8544-42b9-9602-c9d665976dfa" (UID: "109878b2-8544-42b9-9602-c9d665976dfa"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:06:24 crc kubenswrapper[5120]: I0316 17:06:24.829261 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/109878b2-8544-42b9-9602-c9d665976dfa-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:06:24 crc kubenswrapper[5120]: I0316 17:06:24.829296 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/109878b2-8544-42b9-9602-c9d665976dfa-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:06:24 crc kubenswrapper[5120]: I0316 17:06:24.829306 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ksx45\" (UniqueName: \"kubernetes.io/projected/109878b2-8544-42b9-9602-c9d665976dfa-kube-api-access-ksx45\") on node \"crc\" DevicePath \"\"" Mar 16 17:06:25 crc kubenswrapper[5120]: I0316 17:06:25.001875 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 17:06:25 crc kubenswrapper[5120]: I0316 17:06:25.011088 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 17:06:25 crc kubenswrapper[5120]: I0316 17:06:25.022667 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 17:06:25 crc kubenswrapper[5120]: I0316 17:06:25.024679 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1c7cd6c-f5b4-449c-b2a1-f92d7bb56c59" containerName="extract-content" Mar 16 17:06:25 crc kubenswrapper[5120]: I0316 17:06:25.024710 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1c7cd6c-f5b4-449c-b2a1-f92d7bb56c59" containerName="extract-content" Mar 16 17:06:25 crc kubenswrapper[5120]: I0316 17:06:25.024750 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1c7cd6c-f5b4-449c-b2a1-f92d7bb56c59" containerName="extract-utilities" Mar 16 17:06:25 crc kubenswrapper[5120]: I0316 17:06:25.024779 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1c7cd6c-f5b4-449c-b2a1-f92d7bb56c59" containerName="extract-utilities" Mar 16 17:06:25 crc kubenswrapper[5120]: I0316 17:06:25.024801 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="109878b2-8544-42b9-9602-c9d665976dfa" containerName="nova-cell0-conductor-conductor" Mar 16 17:06:25 crc kubenswrapper[5120]: I0316 17:06:25.024810 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="109878b2-8544-42b9-9602-c9d665976dfa" containerName="nova-cell0-conductor-conductor" Mar 16 17:06:25 crc kubenswrapper[5120]: I0316 17:06:25.024833 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1c7cd6c-f5b4-449c-b2a1-f92d7bb56c59" containerName="registry-server" Mar 16 17:06:25 crc kubenswrapper[5120]: I0316 17:06:25.024841 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1c7cd6c-f5b4-449c-b2a1-f92d7bb56c59" containerName="registry-server" Mar 16 17:06:25 crc kubenswrapper[5120]: I0316 17:06:25.028060 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25275544-fa2d-4ef6-9576-b49753a36b45" containerName="oc" Mar 16 17:06:25 crc kubenswrapper[5120]: I0316 17:06:25.028091 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="25275544-fa2d-4ef6-9576-b49753a36b45" containerName="oc" Mar 16 17:06:25 crc kubenswrapper[5120]: I0316 17:06:25.028412 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="b1c7cd6c-f5b4-449c-b2a1-f92d7bb56c59" containerName="registry-server" Mar 16 17:06:25 crc kubenswrapper[5120]: I0316 17:06:25.028438 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="25275544-fa2d-4ef6-9576-b49753a36b45" containerName="oc" Mar 16 17:06:25 crc kubenswrapper[5120]: I0316 17:06:25.028454 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="109878b2-8544-42b9-9602-c9d665976dfa" containerName="nova-cell0-conductor-conductor" Mar 16 17:06:25 crc kubenswrapper[5120]: I0316 17:06:25.034941 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 17:06:25 crc kubenswrapper[5120]: I0316 17:06:25.050216 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-nova-dockercfg-q5mt5\"" Mar 16 17:06:25 crc kubenswrapper[5120]: I0316 17:06:25.050498 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-conductor-config-data\"" Mar 16 17:06:25 crc kubenswrapper[5120]: I0316 17:06:25.054113 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 17:06:25 crc kubenswrapper[5120]: I0316 17:06:25.134645 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6a21ca52-7273-4160-914b-4958e7f2c2ce-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"6a21ca52-7273-4160-914b-4958e7f2c2ce\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 17:06:25 crc kubenswrapper[5120]: I0316 17:06:25.134979 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6a21ca52-7273-4160-914b-4958e7f2c2ce-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"6a21ca52-7273-4160-914b-4958e7f2c2ce\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 17:06:25 crc kubenswrapper[5120]: I0316 17:06:25.135074 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtz5b\" (UniqueName: \"kubernetes.io/projected/6a21ca52-7273-4160-914b-4958e7f2c2ce-kube-api-access-vtz5b\") pod \"nova-cell0-conductor-0\" (UID: \"6a21ca52-7273-4160-914b-4958e7f2c2ce\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 17:06:25 crc kubenswrapper[5120]: I0316 17:06:25.237554 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6a21ca52-7273-4160-914b-4958e7f2c2ce-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"6a21ca52-7273-4160-914b-4958e7f2c2ce\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 17:06:25 crc kubenswrapper[5120]: I0316 17:06:25.237644 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6a21ca52-7273-4160-914b-4958e7f2c2ce-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"6a21ca52-7273-4160-914b-4958e7f2c2ce\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 17:06:25 crc kubenswrapper[5120]: I0316 17:06:25.237701 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vtz5b\" (UniqueName: \"kubernetes.io/projected/6a21ca52-7273-4160-914b-4958e7f2c2ce-kube-api-access-vtz5b\") pod \"nova-cell0-conductor-0\" (UID: \"6a21ca52-7273-4160-914b-4958e7f2c2ce\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 17:06:25 crc kubenswrapper[5120]: I0316 17:06:25.242551 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6a21ca52-7273-4160-914b-4958e7f2c2ce-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"6a21ca52-7273-4160-914b-4958e7f2c2ce\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 17:06:25 crc kubenswrapper[5120]: I0316 17:06:25.242556 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6a21ca52-7273-4160-914b-4958e7f2c2ce-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"6a21ca52-7273-4160-914b-4958e7f2c2ce\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 17:06:25 crc kubenswrapper[5120]: I0316 17:06:25.254806 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtz5b\" (UniqueName: \"kubernetes.io/projected/6a21ca52-7273-4160-914b-4958e7f2c2ce-kube-api-access-vtz5b\") pod \"nova-cell0-conductor-0\" (UID: \"6a21ca52-7273-4160-914b-4958e7f2c2ce\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 17:06:25 crc kubenswrapper[5120]: I0316 17:06:25.369109 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 17:06:25 crc kubenswrapper[5120]: I0316 17:06:25.796866 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 17:06:25 crc kubenswrapper[5120]: W0316 17:06:25.799705 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6a21ca52_7273_4160_914b_4958e7f2c2ce.slice/crio-660330668e90411e4081e4e830e891aae69d04c7ec8cf73bb87b65f12de41c7c WatchSource:0}: Error finding container 660330668e90411e4081e4e830e891aae69d04c7ec8cf73bb87b65f12de41c7c: Status 404 returned error can't find the container with id 660330668e90411e4081e4e830e891aae69d04c7ec8cf73bb87b65f12de41c7c Mar 16 17:06:26 crc kubenswrapper[5120]: I0316 17:06:26.674973 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="109878b2-8544-42b9-9602-c9d665976dfa" path="/var/lib/kubelet/pods/109878b2-8544-42b9-9602-c9d665976dfa/volumes" Mar 16 17:06:26 crc kubenswrapper[5120]: I0316 17:06:26.688199 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"6a21ca52-7273-4160-914b-4958e7f2c2ce","Type":"ContainerStarted","Data":"1c22580c851343e8b19eb347321deb3137a86e53ef649ed430e0c0ee54117213"} Mar 16 17:06:26 crc kubenswrapper[5120]: I0316 17:06:26.688247 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"6a21ca52-7273-4160-914b-4958e7f2c2ce","Type":"ContainerStarted","Data":"660330668e90411e4081e4e830e891aae69d04c7ec8cf73bb87b65f12de41c7c"} Mar 16 17:06:26 crc kubenswrapper[5120]: I0316 17:06:26.688288 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 17:06:26 crc kubenswrapper[5120]: I0316 17:06:26.709497 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podStartSLOduration=1.709477579 podStartE2EDuration="1.709477579s" podCreationTimestamp="2026-03-16 17:06:25 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:06:26.703463612 +0000 UTC m=+5688.857395279" watchObservedRunningTime="2026-03-16 17:06:26.709477579 +0000 UTC m=+5688.863409236" Mar 16 17:06:31 crc kubenswrapper[5120]: I0316 17:06:31.664039 5120 scope.go:117] "RemoveContainer" containerID="db39d192fa687a13805537d08ad22fed1ef362ef5027c920a616297dc55a8ea9" Mar 16 17:06:31 crc kubenswrapper[5120]: E0316 17:06:31.664725 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 17:06:32 crc kubenswrapper[5120]: I0316 17:06:32.727909 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 17:06:33 crc kubenswrapper[5120]: I0316 17:06:33.190523 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-cgxw5"] Mar 16 17:06:33 crc kubenswrapper[5120]: I0316 17:06:33.202523 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-cgxw5" Mar 16 17:06:33 crc kubenswrapper[5120]: I0316 17:06:33.206234 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-manage-config-data\"" Mar 16 17:06:33 crc kubenswrapper[5120]: I0316 17:06:33.209937 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-manage-scripts\"" Mar 16 17:06:33 crc kubenswrapper[5120]: I0316 17:06:33.212658 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-cgxw5"] Mar 16 17:06:33 crc kubenswrapper[5120]: I0316 17:06:33.309359 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 17:06:33 crc kubenswrapper[5120]: I0316 17:06:33.317457 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:06:33 crc kubenswrapper[5120]: I0316 17:06:33.324246 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 17:06:33 crc kubenswrapper[5120]: I0316 17:06:33.330633 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-config-data\"" Mar 16 17:06:33 crc kubenswrapper[5120]: I0316 17:06:33.340906 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b09a0851-56c4-4871-be74-3dc7be582a80-scripts\") pod \"nova-cell0-cell-mapping-cgxw5\" (UID: \"b09a0851-56c4-4871-be74-3dc7be582a80\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-cgxw5" Mar 16 17:06:33 crc kubenswrapper[5120]: I0316 17:06:33.341019 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ht8vc\" (UniqueName: \"kubernetes.io/projected/b09a0851-56c4-4871-be74-3dc7be582a80-kube-api-access-ht8vc\") pod \"nova-cell0-cell-mapping-cgxw5\" (UID: \"b09a0851-56c4-4871-be74-3dc7be582a80\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-cgxw5" Mar 16 17:06:33 crc kubenswrapper[5120]: I0316 17:06:33.341204 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b09a0851-56c4-4871-be74-3dc7be582a80-config-data\") pod \"nova-cell0-cell-mapping-cgxw5\" (UID: \"b09a0851-56c4-4871-be74-3dc7be582a80\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-cgxw5" Mar 16 17:06:33 crc kubenswrapper[5120]: I0316 17:06:33.341245 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b09a0851-56c4-4871-be74-3dc7be582a80-combined-ca-bundle\") pod \"nova-cell0-cell-mapping-cgxw5\" (UID: \"b09a0851-56c4-4871-be74-3dc7be582a80\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-cgxw5" Mar 16 17:06:33 crc kubenswrapper[5120]: I0316 17:06:33.381906 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 17:06:33 crc kubenswrapper[5120]: I0316 17:06:33.389220 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:06:33 crc kubenswrapper[5120]: I0316 17:06:33.396078 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-metadata-config-data\"" Mar 16 17:06:33 crc kubenswrapper[5120]: I0316 17:06:33.417331 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 17:06:33 crc kubenswrapper[5120]: I0316 17:06:33.443963 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b09a0851-56c4-4871-be74-3dc7be582a80-scripts\") pod \"nova-cell0-cell-mapping-cgxw5\" (UID: \"b09a0851-56c4-4871-be74-3dc7be582a80\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-cgxw5" Mar 16 17:06:33 crc kubenswrapper[5120]: I0316 17:06:33.444066 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0afcb817-e0e0-495b-b68d-ea067f4f3200-logs\") pod \"nova-api-0\" (UID: \"0afcb817-e0e0-495b-b68d-ea067f4f3200\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:06:33 crc kubenswrapper[5120]: I0316 17:06:33.444093 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ht8vc\" (UniqueName: \"kubernetes.io/projected/b09a0851-56c4-4871-be74-3dc7be582a80-kube-api-access-ht8vc\") pod \"nova-cell0-cell-mapping-cgxw5\" (UID: \"b09a0851-56c4-4871-be74-3dc7be582a80\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-cgxw5" Mar 16 17:06:33 crc kubenswrapper[5120]: I0316 17:06:33.444146 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0afcb817-e0e0-495b-b68d-ea067f4f3200-config-data\") pod \"nova-api-0\" (UID: \"0afcb817-e0e0-495b-b68d-ea067f4f3200\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:06:33 crc kubenswrapper[5120]: I0316 17:06:33.444294 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b09a0851-56c4-4871-be74-3dc7be582a80-config-data\") pod \"nova-cell0-cell-mapping-cgxw5\" (UID: \"b09a0851-56c4-4871-be74-3dc7be582a80\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-cgxw5" Mar 16 17:06:33 crc kubenswrapper[5120]: I0316 17:06:33.444333 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b09a0851-56c4-4871-be74-3dc7be582a80-combined-ca-bundle\") pod \"nova-cell0-cell-mapping-cgxw5\" (UID: \"b09a0851-56c4-4871-be74-3dc7be582a80\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-cgxw5" Mar 16 17:06:33 crc kubenswrapper[5120]: I0316 17:06:33.444363 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2596p\" (UniqueName: \"kubernetes.io/projected/0afcb817-e0e0-495b-b68d-ea067f4f3200-kube-api-access-2596p\") pod \"nova-api-0\" (UID: \"0afcb817-e0e0-495b-b68d-ea067f4f3200\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:06:33 crc kubenswrapper[5120]: I0316 17:06:33.444457 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0afcb817-e0e0-495b-b68d-ea067f4f3200-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"0afcb817-e0e0-495b-b68d-ea067f4f3200\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:06:33 crc kubenswrapper[5120]: I0316 17:06:33.453130 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b09a0851-56c4-4871-be74-3dc7be582a80-config-data\") pod \"nova-cell0-cell-mapping-cgxw5\" (UID: \"b09a0851-56c4-4871-be74-3dc7be582a80\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-cgxw5" Mar 16 17:06:33 crc kubenswrapper[5120]: I0316 17:06:33.474115 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b09a0851-56c4-4871-be74-3dc7be582a80-combined-ca-bundle\") pod \"nova-cell0-cell-mapping-cgxw5\" (UID: \"b09a0851-56c4-4871-be74-3dc7be582a80\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-cgxw5" Mar 16 17:06:33 crc kubenswrapper[5120]: I0316 17:06:33.477597 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b09a0851-56c4-4871-be74-3dc7be582a80-scripts\") pod \"nova-cell0-cell-mapping-cgxw5\" (UID: \"b09a0851-56c4-4871-be74-3dc7be582a80\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-cgxw5" Mar 16 17:06:33 crc kubenswrapper[5120]: I0316 17:06:33.487513 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ht8vc\" (UniqueName: \"kubernetes.io/projected/b09a0851-56c4-4871-be74-3dc7be582a80-kube-api-access-ht8vc\") pod \"nova-cell0-cell-mapping-cgxw5\" (UID: \"b09a0851-56c4-4871-be74-3dc7be582a80\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-cgxw5" Mar 16 17:06:33 crc kubenswrapper[5120]: I0316 17:06:33.503972 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 17:06:33 crc kubenswrapper[5120]: I0316 17:06:33.547101 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-cgxw5" Mar 16 17:06:33 crc kubenswrapper[5120]: I0316 17:06:33.547461 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 17:06:33 crc kubenswrapper[5120]: I0316 17:06:33.547555 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:06:33 crc kubenswrapper[5120]: I0316 17:06:33.552164 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-scheduler-config-data\"" Mar 16 17:06:33 crc kubenswrapper[5120]: I0316 17:06:33.555870 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0afcb817-e0e0-495b-b68d-ea067f4f3200-logs\") pod \"nova-api-0\" (UID: \"0afcb817-e0e0-495b-b68d-ea067f4f3200\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:06:33 crc kubenswrapper[5120]: I0316 17:06:33.555969 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0afcb817-e0e0-495b-b68d-ea067f4f3200-config-data\") pod \"nova-api-0\" (UID: \"0afcb817-e0e0-495b-b68d-ea067f4f3200\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:06:33 crc kubenswrapper[5120]: I0316 17:06:33.556084 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2596p\" (UniqueName: \"kubernetes.io/projected/0afcb817-e0e0-495b-b68d-ea067f4f3200-kube-api-access-2596p\") pod \"nova-api-0\" (UID: \"0afcb817-e0e0-495b-b68d-ea067f4f3200\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:06:33 crc kubenswrapper[5120]: I0316 17:06:33.556109 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fc772fff-eba2-4aa4-85ff-40057e068148-config-data\") pod \"nova-metadata-0\" (UID: \"fc772fff-eba2-4aa4-85ff-40057e068148\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:06:33 crc kubenswrapper[5120]: I0316 17:06:33.556216 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0afcb817-e0e0-495b-b68d-ea067f4f3200-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"0afcb817-e0e0-495b-b68d-ea067f4f3200\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:06:33 crc kubenswrapper[5120]: I0316 17:06:33.556304 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/fc772fff-eba2-4aa4-85ff-40057e068148-logs\") pod \"nova-metadata-0\" (UID: \"fc772fff-eba2-4aa4-85ff-40057e068148\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:06:33 crc kubenswrapper[5120]: I0316 17:06:33.556344 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qsgst\" (UniqueName: \"kubernetes.io/projected/fc772fff-eba2-4aa4-85ff-40057e068148-kube-api-access-qsgst\") pod \"nova-metadata-0\" (UID: \"fc772fff-eba2-4aa4-85ff-40057e068148\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:06:33 crc kubenswrapper[5120]: I0316 17:06:33.556416 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fc772fff-eba2-4aa4-85ff-40057e068148-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"fc772fff-eba2-4aa4-85ff-40057e068148\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:06:33 crc kubenswrapper[5120]: I0316 17:06:33.556806 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0afcb817-e0e0-495b-b68d-ea067f4f3200-logs\") pod \"nova-api-0\" (UID: \"0afcb817-e0e0-495b-b68d-ea067f4f3200\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:06:33 crc kubenswrapper[5120]: I0316 17:06:33.569668 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0afcb817-e0e0-495b-b68d-ea067f4f3200-config-data\") pod \"nova-api-0\" (UID: \"0afcb817-e0e0-495b-b68d-ea067f4f3200\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:06:33 crc kubenswrapper[5120]: I0316 17:06:33.584584 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0afcb817-e0e0-495b-b68d-ea067f4f3200-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"0afcb817-e0e0-495b-b68d-ea067f4f3200\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:06:33 crc kubenswrapper[5120]: I0316 17:06:33.587870 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 17:06:33 crc kubenswrapper[5120]: I0316 17:06:33.601202 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2596p\" (UniqueName: \"kubernetes.io/projected/0afcb817-e0e0-495b-b68d-ea067f4f3200-kube-api-access-2596p\") pod \"nova-api-0\" (UID: \"0afcb817-e0e0-495b-b68d-ea067f4f3200\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:06:33 crc kubenswrapper[5120]: I0316 17:06:33.606048 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:06:33 crc kubenswrapper[5120]: I0316 17:06:33.614817 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 17:06:33 crc kubenswrapper[5120]: I0316 17:06:33.621087 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-novncproxy-config-data\"" Mar 16 17:06:33 crc kubenswrapper[5120]: I0316 17:06:33.638308 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:06:33 crc kubenswrapper[5120]: I0316 17:06:33.658151 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fc772fff-eba2-4aa4-85ff-40057e068148-config-data\") pod \"nova-metadata-0\" (UID: \"fc772fff-eba2-4aa4-85ff-40057e068148\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:06:33 crc kubenswrapper[5120]: I0316 17:06:33.658263 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czqz2\" (UniqueName: \"kubernetes.io/projected/ab5e26e4-ccf7-4dc1-a4d7-4687023dd74c-kube-api-access-czqz2\") pod \"nova-scheduler-0\" (UID: \"ab5e26e4-ccf7-4dc1-a4d7-4687023dd74c\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:06:33 crc kubenswrapper[5120]: I0316 17:06:33.658300 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/fc772fff-eba2-4aa4-85ff-40057e068148-logs\") pod \"nova-metadata-0\" (UID: \"fc772fff-eba2-4aa4-85ff-40057e068148\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:06:33 crc kubenswrapper[5120]: I0316 17:06:33.658321 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qsgst\" (UniqueName: \"kubernetes.io/projected/fc772fff-eba2-4aa4-85ff-40057e068148-kube-api-access-qsgst\") pod \"nova-metadata-0\" (UID: \"fc772fff-eba2-4aa4-85ff-40057e068148\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:06:33 crc kubenswrapper[5120]: I0316 17:06:33.658364 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fc772fff-eba2-4aa4-85ff-40057e068148-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"fc772fff-eba2-4aa4-85ff-40057e068148\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:06:33 crc kubenswrapper[5120]: I0316 17:06:33.658456 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ab5e26e4-ccf7-4dc1-a4d7-4687023dd74c-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"ab5e26e4-ccf7-4dc1-a4d7-4687023dd74c\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:06:33 crc kubenswrapper[5120]: I0316 17:06:33.658586 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ab5e26e4-ccf7-4dc1-a4d7-4687023dd74c-config-data\") pod \"nova-scheduler-0\" (UID: \"ab5e26e4-ccf7-4dc1-a4d7-4687023dd74c\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:06:33 crc kubenswrapper[5120]: I0316 17:06:33.660232 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/fc772fff-eba2-4aa4-85ff-40057e068148-logs\") pod \"nova-metadata-0\" (UID: \"fc772fff-eba2-4aa4-85ff-40057e068148\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:06:33 crc kubenswrapper[5120]: I0316 17:06:33.663870 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fc772fff-eba2-4aa4-85ff-40057e068148-config-data\") pod \"nova-metadata-0\" (UID: \"fc772fff-eba2-4aa4-85ff-40057e068148\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:06:33 crc kubenswrapper[5120]: I0316 17:06:33.672352 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fc772fff-eba2-4aa4-85ff-40057e068148-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"fc772fff-eba2-4aa4-85ff-40057e068148\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:06:33 crc kubenswrapper[5120]: I0316 17:06:33.679599 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qsgst\" (UniqueName: \"kubernetes.io/projected/fc772fff-eba2-4aa4-85ff-40057e068148-kube-api-access-qsgst\") pod \"nova-metadata-0\" (UID: \"fc772fff-eba2-4aa4-85ff-40057e068148\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:06:33 crc kubenswrapper[5120]: I0316 17:06:33.707962 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:06:33 crc kubenswrapper[5120]: I0316 17:06:33.761153 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f32b373d-941d-4c2f-a53f-fa417428838b-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"f32b373d-941d-4c2f-a53f-fa417428838b\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:06:33 crc kubenswrapper[5120]: I0316 17:06:33.761249 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ab5e26e4-ccf7-4dc1-a4d7-4687023dd74c-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"ab5e26e4-ccf7-4dc1-a4d7-4687023dd74c\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:06:33 crc kubenswrapper[5120]: I0316 17:06:33.761374 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gphr\" (UniqueName: \"kubernetes.io/projected/f32b373d-941d-4c2f-a53f-fa417428838b-kube-api-access-4gphr\") pod \"nova-cell1-novncproxy-0\" (UID: \"f32b373d-941d-4c2f-a53f-fa417428838b\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:06:33 crc kubenswrapper[5120]: I0316 17:06:33.761399 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ab5e26e4-ccf7-4dc1-a4d7-4687023dd74c-config-data\") pod \"nova-scheduler-0\" (UID: \"ab5e26e4-ccf7-4dc1-a4d7-4687023dd74c\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:06:33 crc kubenswrapper[5120]: I0316 17:06:33.761449 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f32b373d-941d-4c2f-a53f-fa417428838b-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"f32b373d-941d-4c2f-a53f-fa417428838b\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:06:33 crc kubenswrapper[5120]: I0316 17:06:33.761572 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-czqz2\" (UniqueName: \"kubernetes.io/projected/ab5e26e4-ccf7-4dc1-a4d7-4687023dd74c-kube-api-access-czqz2\") pod \"nova-scheduler-0\" (UID: \"ab5e26e4-ccf7-4dc1-a4d7-4687023dd74c\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:06:33 crc kubenswrapper[5120]: I0316 17:06:33.778825 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ab5e26e4-ccf7-4dc1-a4d7-4687023dd74c-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"ab5e26e4-ccf7-4dc1-a4d7-4687023dd74c\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:06:33 crc kubenswrapper[5120]: I0316 17:06:33.779291 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ab5e26e4-ccf7-4dc1-a4d7-4687023dd74c-config-data\") pod \"nova-scheduler-0\" (UID: \"ab5e26e4-ccf7-4dc1-a4d7-4687023dd74c\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:06:33 crc kubenswrapper[5120]: I0316 17:06:33.789296 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-czqz2\" (UniqueName: \"kubernetes.io/projected/ab5e26e4-ccf7-4dc1-a4d7-4687023dd74c-kube-api-access-czqz2\") pod \"nova-scheduler-0\" (UID: \"ab5e26e4-ccf7-4dc1-a4d7-4687023dd74c\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:06:33 crc kubenswrapper[5120]: I0316 17:06:33.863320 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4gphr\" (UniqueName: \"kubernetes.io/projected/f32b373d-941d-4c2f-a53f-fa417428838b-kube-api-access-4gphr\") pod \"nova-cell1-novncproxy-0\" (UID: \"f32b373d-941d-4c2f-a53f-fa417428838b\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:06:33 crc kubenswrapper[5120]: I0316 17:06:33.863626 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f32b373d-941d-4c2f-a53f-fa417428838b-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"f32b373d-941d-4c2f-a53f-fa417428838b\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:06:33 crc kubenswrapper[5120]: I0316 17:06:33.863835 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f32b373d-941d-4c2f-a53f-fa417428838b-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"f32b373d-941d-4c2f-a53f-fa417428838b\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:06:33 crc kubenswrapper[5120]: I0316 17:06:33.873963 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f32b373d-941d-4c2f-a53f-fa417428838b-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"f32b373d-941d-4c2f-a53f-fa417428838b\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:06:33 crc kubenswrapper[5120]: I0316 17:06:33.874352 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f32b373d-941d-4c2f-a53f-fa417428838b-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"f32b373d-941d-4c2f-a53f-fa417428838b\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:06:33 crc kubenswrapper[5120]: I0316 17:06:33.884887 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gphr\" (UniqueName: \"kubernetes.io/projected/f32b373d-941d-4c2f-a53f-fa417428838b-kube-api-access-4gphr\") pod \"nova-cell1-novncproxy-0\" (UID: \"f32b373d-941d-4c2f-a53f-fa417428838b\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:06:33 crc kubenswrapper[5120]: I0316 17:06:33.992176 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:06:34 crc kubenswrapper[5120]: I0316 17:06:34.014302 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:06:34 crc kubenswrapper[5120]: I0316 17:06:34.176555 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-cgxw5"] Mar 16 17:06:34 crc kubenswrapper[5120]: I0316 17:06:34.187913 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 17:06:34 crc kubenswrapper[5120]: I0316 17:06:34.288740 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-st2nf"] Mar 16 17:06:34 crc kubenswrapper[5120]: I0316 17:06:34.297289 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-st2nf" Mar 16 17:06:34 crc kubenswrapper[5120]: I0316 17:06:34.302969 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-conductor-scripts\"" Mar 16 17:06:34 crc kubenswrapper[5120]: I0316 17:06:34.303586 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-conductor-config-data\"" Mar 16 17:06:34 crc kubenswrapper[5120]: I0316 17:06:34.318231 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-st2nf"] Mar 16 17:06:34 crc kubenswrapper[5120]: I0316 17:06:34.338025 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 17:06:34 crc kubenswrapper[5120]: I0316 17:06:34.388554 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 17:06:34 crc kubenswrapper[5120]: I0316 17:06:34.479069 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a4ae208c-9690-4d37-bd09-f87420dbe1c1-config-data\") pod \"nova-cell1-conductor-db-sync-st2nf\" (UID: \"a4ae208c-9690-4d37-bd09-f87420dbe1c1\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-st2nf" Mar 16 17:06:34 crc kubenswrapper[5120]: I0316 17:06:34.479162 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hm7l\" (UniqueName: \"kubernetes.io/projected/a4ae208c-9690-4d37-bd09-f87420dbe1c1-kube-api-access-4hm7l\") pod \"nova-cell1-conductor-db-sync-st2nf\" (UID: \"a4ae208c-9690-4d37-bd09-f87420dbe1c1\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-st2nf" Mar 16 17:06:34 crc kubenswrapper[5120]: I0316 17:06:34.479208 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a4ae208c-9690-4d37-bd09-f87420dbe1c1-scripts\") pod \"nova-cell1-conductor-db-sync-st2nf\" (UID: \"a4ae208c-9690-4d37-bd09-f87420dbe1c1\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-st2nf" Mar 16 17:06:34 crc kubenswrapper[5120]: I0316 17:06:34.479291 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a4ae208c-9690-4d37-bd09-f87420dbe1c1-combined-ca-bundle\") pod \"nova-cell1-conductor-db-sync-st2nf\" (UID: \"a4ae208c-9690-4d37-bd09-f87420dbe1c1\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-st2nf" Mar 16 17:06:34 crc kubenswrapper[5120]: I0316 17:06:34.582398 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a4ae208c-9690-4d37-bd09-f87420dbe1c1-config-data\") pod \"nova-cell1-conductor-db-sync-st2nf\" (UID: \"a4ae208c-9690-4d37-bd09-f87420dbe1c1\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-st2nf" Mar 16 17:06:34 crc kubenswrapper[5120]: I0316 17:06:34.582844 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4hm7l\" (UniqueName: \"kubernetes.io/projected/a4ae208c-9690-4d37-bd09-f87420dbe1c1-kube-api-access-4hm7l\") pod \"nova-cell1-conductor-db-sync-st2nf\" (UID: \"a4ae208c-9690-4d37-bd09-f87420dbe1c1\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-st2nf" Mar 16 17:06:34 crc kubenswrapper[5120]: I0316 17:06:34.582927 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a4ae208c-9690-4d37-bd09-f87420dbe1c1-scripts\") pod \"nova-cell1-conductor-db-sync-st2nf\" (UID: \"a4ae208c-9690-4d37-bd09-f87420dbe1c1\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-st2nf" Mar 16 17:06:34 crc kubenswrapper[5120]: I0316 17:06:34.582999 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a4ae208c-9690-4d37-bd09-f87420dbe1c1-combined-ca-bundle\") pod \"nova-cell1-conductor-db-sync-st2nf\" (UID: \"a4ae208c-9690-4d37-bd09-f87420dbe1c1\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-st2nf" Mar 16 17:06:34 crc kubenswrapper[5120]: I0316 17:06:34.589565 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a4ae208c-9690-4d37-bd09-f87420dbe1c1-config-data\") pod \"nova-cell1-conductor-db-sync-st2nf\" (UID: \"a4ae208c-9690-4d37-bd09-f87420dbe1c1\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-st2nf" Mar 16 17:06:34 crc kubenswrapper[5120]: I0316 17:06:34.589608 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a4ae208c-9690-4d37-bd09-f87420dbe1c1-combined-ca-bundle\") pod \"nova-cell1-conductor-db-sync-st2nf\" (UID: \"a4ae208c-9690-4d37-bd09-f87420dbe1c1\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-st2nf" Mar 16 17:06:34 crc kubenswrapper[5120]: I0316 17:06:34.590494 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a4ae208c-9690-4d37-bd09-f87420dbe1c1-scripts\") pod \"nova-cell1-conductor-db-sync-st2nf\" (UID: \"a4ae208c-9690-4d37-bd09-f87420dbe1c1\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-st2nf" Mar 16 17:06:34 crc kubenswrapper[5120]: I0316 17:06:34.604970 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hm7l\" (UniqueName: \"kubernetes.io/projected/a4ae208c-9690-4d37-bd09-f87420dbe1c1-kube-api-access-4hm7l\") pod \"nova-cell1-conductor-db-sync-st2nf\" (UID: \"a4ae208c-9690-4d37-bd09-f87420dbe1c1\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-st2nf" Mar 16 17:06:34 crc kubenswrapper[5120]: W0316 17:06:34.634577 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf32b373d_941d_4c2f_a53f_fa417428838b.slice/crio-13839265ede719839c8d75568fd6bf5da5e0d0d779c91f9a7677ca1d4c1ba0fd WatchSource:0}: Error finding container 13839265ede719839c8d75568fd6bf5da5e0d0d779c91f9a7677ca1d4c1ba0fd: Status 404 returned error can't find the container with id 13839265ede719839c8d75568fd6bf5da5e0d0d779c91f9a7677ca1d4c1ba0fd Mar 16 17:06:34 crc kubenswrapper[5120]: I0316 17:06:34.636214 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 17:06:34 crc kubenswrapper[5120]: I0316 17:06:34.645828 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-st2nf" Mar 16 17:06:34 crc kubenswrapper[5120]: I0316 17:06:34.840039 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"0afcb817-e0e0-495b-b68d-ea067f4f3200","Type":"ContainerStarted","Data":"1f51c0e559d037c438795d8f5fcea546e860e6f4a8339f9883bf47f95ccd8996"} Mar 16 17:06:34 crc kubenswrapper[5120]: I0316 17:06:34.840667 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"0afcb817-e0e0-495b-b68d-ea067f4f3200","Type":"ContainerStarted","Data":"e5527564906d85a01d40b72e1fee4d9ee0b87ca0c5fab42ca6577bb90e66afea"} Mar 16 17:06:34 crc kubenswrapper[5120]: I0316 17:06:34.843668 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"f32b373d-941d-4c2f-a53f-fa417428838b","Type":"ContainerStarted","Data":"13839265ede719839c8d75568fd6bf5da5e0d0d779c91f9a7677ca1d4c1ba0fd"} Mar 16 17:06:34 crc kubenswrapper[5120]: I0316 17:06:34.845807 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"fc772fff-eba2-4aa4-85ff-40057e068148","Type":"ContainerStarted","Data":"e9e927aa88712ffcef7dbe6a7389f1734f487859737adb662ad3224b816a100f"} Mar 16 17:06:34 crc kubenswrapper[5120]: I0316 17:06:34.847090 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"ab5e26e4-ccf7-4dc1-a4d7-4687023dd74c","Type":"ContainerStarted","Data":"d208a3a5f082e204ffac19251894beb93fed78b48cb0c21bd9c4ee9980ed6c3a"} Mar 16 17:06:34 crc kubenswrapper[5120]: I0316 17:06:34.857418 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-cgxw5" event={"ID":"b09a0851-56c4-4871-be74-3dc7be582a80","Type":"ContainerStarted","Data":"c7dea1965a80cb2989e9f401e59d00f0a34ace41781d462763f621d9f8898d96"} Mar 16 17:06:34 crc kubenswrapper[5120]: I0316 17:06:34.857463 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-cgxw5" event={"ID":"b09a0851-56c4-4871-be74-3dc7be582a80","Type":"ContainerStarted","Data":"89fd2f875c9fa1beda1c873a096f1e80eda20899a6cc7f9d96b5df85cf2daee8"} Mar 16 17:06:34 crc kubenswrapper[5120]: I0316 17:06:34.887682 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-cgxw5" podStartSLOduration=1.887656503 podStartE2EDuration="1.887656503s" podCreationTimestamp="2026-03-16 17:06:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:06:34.878564241 +0000 UTC m=+5697.032495898" watchObservedRunningTime="2026-03-16 17:06:34.887656503 +0000 UTC m=+5697.041588160" Mar 16 17:06:35 crc kubenswrapper[5120]: I0316 17:06:35.169234 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-st2nf"] Mar 16 17:06:35 crc kubenswrapper[5120]: I0316 17:06:35.870112 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"f32b373d-941d-4c2f-a53f-fa417428838b","Type":"ContainerStarted","Data":"1766683330a4cbeed4e84484197d9fae7b219ebf3f826292afc182a94cf06611"} Mar 16 17:06:35 crc kubenswrapper[5120]: I0316 17:06:35.873537 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"fc772fff-eba2-4aa4-85ff-40057e068148","Type":"ContainerStarted","Data":"24d5c81201a216ebc4478fa5fc3f565ac0fdce3be4939786b4d136a99a8ea523"} Mar 16 17:06:35 crc kubenswrapper[5120]: I0316 17:06:35.873573 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"fc772fff-eba2-4aa4-85ff-40057e068148","Type":"ContainerStarted","Data":"c93ef53de8d14f57cb1a178bcc78b9b6b19093e526eb6efa0a68f99583708ac5"} Mar 16 17:06:35 crc kubenswrapper[5120]: I0316 17:06:35.877362 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"ab5e26e4-ccf7-4dc1-a4d7-4687023dd74c","Type":"ContainerStarted","Data":"655356dce435a2e2be1abb74154a1de57661f5d1cd984036e19e9e9607990d79"} Mar 16 17:06:35 crc kubenswrapper[5120]: I0316 17:06:35.878636 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-st2nf" event={"ID":"a4ae208c-9690-4d37-bd09-f87420dbe1c1","Type":"ContainerStarted","Data":"0bcd0282304ca4ed1e673f7299d69b14cead794f843cc3e09c09a70628b6aee4"} Mar 16 17:06:35 crc kubenswrapper[5120]: I0316 17:06:35.878668 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-st2nf" event={"ID":"a4ae208c-9690-4d37-bd09-f87420dbe1c1","Type":"ContainerStarted","Data":"94c08d81429f721e72f03dd4402fb8dbdb0a1ba898e456529ac85584126b0d7a"} Mar 16 17:06:35 crc kubenswrapper[5120]: I0316 17:06:35.882712 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"0afcb817-e0e0-495b-b68d-ea067f4f3200","Type":"ContainerStarted","Data":"c36235d360b75e4cce33435a98a48f547b90d3f55ef0055adc203b826178695b"} Mar 16 17:06:35 crc kubenswrapper[5120]: I0316 17:06:35.902292 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podStartSLOduration=2.902265901 podStartE2EDuration="2.902265901s" podCreationTimestamp="2026-03-16 17:06:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:06:35.890140876 +0000 UTC m=+5698.044072533" watchObservedRunningTime="2026-03-16 17:06:35.902265901 +0000 UTC m=+5698.056197578" Mar 16 17:06:35 crc kubenswrapper[5120]: I0316 17:06:35.929706 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-st2nf" podStartSLOduration=1.9296871690000001 podStartE2EDuration="1.929687169s" podCreationTimestamp="2026-03-16 17:06:34 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:06:35.912522335 +0000 UTC m=+5698.066454002" watchObservedRunningTime="2026-03-16 17:06:35.929687169 +0000 UTC m=+5698.083618826" Mar 16 17:06:35 crc kubenswrapper[5120]: I0316 17:06:35.959444 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=2.95941877 podStartE2EDuration="2.95941877s" podCreationTimestamp="2026-03-16 17:06:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:06:35.943613393 +0000 UTC m=+5698.097545050" watchObservedRunningTime="2026-03-16 17:06:35.95941877 +0000 UTC m=+5698.113350427" Mar 16 17:06:35 crc kubenswrapper[5120]: I0316 17:06:35.977380 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-scheduler-0" podStartSLOduration=2.977353445 podStartE2EDuration="2.977353445s" podCreationTimestamp="2026-03-16 17:06:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:06:35.9673894 +0000 UTC m=+5698.121321077" watchObservedRunningTime="2026-03-16 17:06:35.977353445 +0000 UTC m=+5698.131285112" Mar 16 17:06:35 crc kubenswrapper[5120]: I0316 17:06:35.999700 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=2.9996762820000002 podStartE2EDuration="2.999676282s" podCreationTimestamp="2026-03-16 17:06:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:06:35.991748853 +0000 UTC m=+5698.145680520" watchObservedRunningTime="2026-03-16 17:06:35.999676282 +0000 UTC m=+5698.153607939" Mar 16 17:06:36 crc kubenswrapper[5120]: I0316 17:06:36.252435 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 17:06:36 crc kubenswrapper[5120]: I0316 17:06:36.263063 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 17:06:37 crc kubenswrapper[5120]: I0316 17:06:37.481858 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:06:37 crc kubenswrapper[5120]: I0316 17:06:37.900813 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podUID="f32b373d-941d-4c2f-a53f-fa417428838b" containerName="nova-cell1-novncproxy-novncproxy" containerID="cri-o://1766683330a4cbeed4e84484197d9fae7b219ebf3f826292afc182a94cf06611" gracePeriod=30 Mar 16 17:06:37 crc kubenswrapper[5120]: I0316 17:06:37.900873 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="fc772fff-eba2-4aa4-85ff-40057e068148" containerName="nova-metadata-log" containerID="cri-o://c93ef53de8d14f57cb1a178bcc78b9b6b19093e526eb6efa0a68f99583708ac5" gracePeriod=30 Mar 16 17:06:37 crc kubenswrapper[5120]: I0316 17:06:37.901261 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="fc772fff-eba2-4aa4-85ff-40057e068148" containerName="nova-metadata-metadata" containerID="cri-o://24d5c81201a216ebc4478fa5fc3f565ac0fdce3be4939786b4d136a99a8ea523" gracePeriod=30 Mar 16 17:06:38 crc kubenswrapper[5120]: I0316 17:06:38.485711 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:06:38 crc kubenswrapper[5120]: I0316 17:06:38.565922 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/fc772fff-eba2-4aa4-85ff-40057e068148-logs\") pod \"fc772fff-eba2-4aa4-85ff-40057e068148\" (UID: \"fc772fff-eba2-4aa4-85ff-40057e068148\") " Mar 16 17:06:38 crc kubenswrapper[5120]: I0316 17:06:38.566153 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fc772fff-eba2-4aa4-85ff-40057e068148-config-data\") pod \"fc772fff-eba2-4aa4-85ff-40057e068148\" (UID: \"fc772fff-eba2-4aa4-85ff-40057e068148\") " Mar 16 17:06:38 crc kubenswrapper[5120]: I0316 17:06:38.566389 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qsgst\" (UniqueName: \"kubernetes.io/projected/fc772fff-eba2-4aa4-85ff-40057e068148-kube-api-access-qsgst\") pod \"fc772fff-eba2-4aa4-85ff-40057e068148\" (UID: \"fc772fff-eba2-4aa4-85ff-40057e068148\") " Mar 16 17:06:38 crc kubenswrapper[5120]: I0316 17:06:38.566556 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fc772fff-eba2-4aa4-85ff-40057e068148-combined-ca-bundle\") pod \"fc772fff-eba2-4aa4-85ff-40057e068148\" (UID: \"fc772fff-eba2-4aa4-85ff-40057e068148\") " Mar 16 17:06:38 crc kubenswrapper[5120]: I0316 17:06:38.567288 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc772fff-eba2-4aa4-85ff-40057e068148-logs" (OuterVolumeSpecName: "logs") pod "fc772fff-eba2-4aa4-85ff-40057e068148" (UID: "fc772fff-eba2-4aa4-85ff-40057e068148"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:06:38 crc kubenswrapper[5120]: I0316 17:06:38.573961 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc772fff-eba2-4aa4-85ff-40057e068148-kube-api-access-qsgst" (OuterVolumeSpecName: "kube-api-access-qsgst") pod "fc772fff-eba2-4aa4-85ff-40057e068148" (UID: "fc772fff-eba2-4aa4-85ff-40057e068148"). InnerVolumeSpecName "kube-api-access-qsgst". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:06:38 crc kubenswrapper[5120]: I0316 17:06:38.596882 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc772fff-eba2-4aa4-85ff-40057e068148-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "fc772fff-eba2-4aa4-85ff-40057e068148" (UID: "fc772fff-eba2-4aa4-85ff-40057e068148"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:06:38 crc kubenswrapper[5120]: I0316 17:06:38.599137 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc772fff-eba2-4aa4-85ff-40057e068148-config-data" (OuterVolumeSpecName: "config-data") pod "fc772fff-eba2-4aa4-85ff-40057e068148" (UID: "fc772fff-eba2-4aa4-85ff-40057e068148"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:06:38 crc kubenswrapper[5120]: I0316 17:06:38.634842 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:06:38 crc kubenswrapper[5120]: I0316 17:06:38.669326 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qsgst\" (UniqueName: \"kubernetes.io/projected/fc772fff-eba2-4aa4-85ff-40057e068148-kube-api-access-qsgst\") on node \"crc\" DevicePath \"\"" Mar 16 17:06:38 crc kubenswrapper[5120]: I0316 17:06:38.669360 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fc772fff-eba2-4aa4-85ff-40057e068148-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:06:38 crc kubenswrapper[5120]: I0316 17:06:38.669380 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/fc772fff-eba2-4aa4-85ff-40057e068148-logs\") on node \"crc\" DevicePath \"\"" Mar 16 17:06:38 crc kubenswrapper[5120]: I0316 17:06:38.669389 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fc772fff-eba2-4aa4-85ff-40057e068148-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:06:38 crc kubenswrapper[5120]: I0316 17:06:38.770465 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f32b373d-941d-4c2f-a53f-fa417428838b-config-data\") pod \"f32b373d-941d-4c2f-a53f-fa417428838b\" (UID: \"f32b373d-941d-4c2f-a53f-fa417428838b\") " Mar 16 17:06:38 crc kubenswrapper[5120]: I0316 17:06:38.770892 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f32b373d-941d-4c2f-a53f-fa417428838b-combined-ca-bundle\") pod \"f32b373d-941d-4c2f-a53f-fa417428838b\" (UID: \"f32b373d-941d-4c2f-a53f-fa417428838b\") " Mar 16 17:06:38 crc kubenswrapper[5120]: I0316 17:06:38.771241 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4gphr\" (UniqueName: \"kubernetes.io/projected/f32b373d-941d-4c2f-a53f-fa417428838b-kube-api-access-4gphr\") pod \"f32b373d-941d-4c2f-a53f-fa417428838b\" (UID: \"f32b373d-941d-4c2f-a53f-fa417428838b\") " Mar 16 17:06:38 crc kubenswrapper[5120]: I0316 17:06:38.780006 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f32b373d-941d-4c2f-a53f-fa417428838b-kube-api-access-4gphr" (OuterVolumeSpecName: "kube-api-access-4gphr") pod "f32b373d-941d-4c2f-a53f-fa417428838b" (UID: "f32b373d-941d-4c2f-a53f-fa417428838b"). InnerVolumeSpecName "kube-api-access-4gphr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:06:38 crc kubenswrapper[5120]: I0316 17:06:38.796087 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f32b373d-941d-4c2f-a53f-fa417428838b-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f32b373d-941d-4c2f-a53f-fa417428838b" (UID: "f32b373d-941d-4c2f-a53f-fa417428838b"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:06:38 crc kubenswrapper[5120]: I0316 17:06:38.801192 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f32b373d-941d-4c2f-a53f-fa417428838b-config-data" (OuterVolumeSpecName: "config-data") pod "f32b373d-941d-4c2f-a53f-fa417428838b" (UID: "f32b373d-941d-4c2f-a53f-fa417428838b"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:06:38 crc kubenswrapper[5120]: I0316 17:06:38.874311 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f32b373d-941d-4c2f-a53f-fa417428838b-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:06:38 crc kubenswrapper[5120]: I0316 17:06:38.874342 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4gphr\" (UniqueName: \"kubernetes.io/projected/f32b373d-941d-4c2f-a53f-fa417428838b-kube-api-access-4gphr\") on node \"crc\" DevicePath \"\"" Mar 16 17:06:38 crc kubenswrapper[5120]: I0316 17:06:38.874355 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f32b373d-941d-4c2f-a53f-fa417428838b-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:06:38 crc kubenswrapper[5120]: I0316 17:06:38.944993 5120 generic.go:358] "Generic (PLEG): container finished" podID="fc772fff-eba2-4aa4-85ff-40057e068148" containerID="24d5c81201a216ebc4478fa5fc3f565ac0fdce3be4939786b4d136a99a8ea523" exitCode=0 Mar 16 17:06:38 crc kubenswrapper[5120]: I0316 17:06:38.945026 5120 generic.go:358] "Generic (PLEG): container finished" podID="fc772fff-eba2-4aa4-85ff-40057e068148" containerID="c93ef53de8d14f57cb1a178bcc78b9b6b19093e526eb6efa0a68f99583708ac5" exitCode=143 Mar 16 17:06:38 crc kubenswrapper[5120]: I0316 17:06:38.945148 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:06:38 crc kubenswrapper[5120]: I0316 17:06:38.945147 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"fc772fff-eba2-4aa4-85ff-40057e068148","Type":"ContainerDied","Data":"24d5c81201a216ebc4478fa5fc3f565ac0fdce3be4939786b4d136a99a8ea523"} Mar 16 17:06:38 crc kubenswrapper[5120]: I0316 17:06:38.945244 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"fc772fff-eba2-4aa4-85ff-40057e068148","Type":"ContainerDied","Data":"c93ef53de8d14f57cb1a178bcc78b9b6b19093e526eb6efa0a68f99583708ac5"} Mar 16 17:06:38 crc kubenswrapper[5120]: I0316 17:06:38.945260 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"fc772fff-eba2-4aa4-85ff-40057e068148","Type":"ContainerDied","Data":"e9e927aa88712ffcef7dbe6a7389f1734f487859737adb662ad3224b816a100f"} Mar 16 17:06:38 crc kubenswrapper[5120]: I0316 17:06:38.945282 5120 scope.go:117] "RemoveContainer" containerID="24d5c81201a216ebc4478fa5fc3f565ac0fdce3be4939786b4d136a99a8ea523" Mar 16 17:06:38 crc kubenswrapper[5120]: I0316 17:06:38.951045 5120 generic.go:358] "Generic (PLEG): container finished" podID="a4ae208c-9690-4d37-bd09-f87420dbe1c1" containerID="0bcd0282304ca4ed1e673f7299d69b14cead794f843cc3e09c09a70628b6aee4" exitCode=0 Mar 16 17:06:38 crc kubenswrapper[5120]: I0316 17:06:38.951142 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-st2nf" event={"ID":"a4ae208c-9690-4d37-bd09-f87420dbe1c1","Type":"ContainerDied","Data":"0bcd0282304ca4ed1e673f7299d69b14cead794f843cc3e09c09a70628b6aee4"} Mar 16 17:06:38 crc kubenswrapper[5120]: I0316 17:06:38.954277 5120 generic.go:358] "Generic (PLEG): container finished" podID="f32b373d-941d-4c2f-a53f-fa417428838b" containerID="1766683330a4cbeed4e84484197d9fae7b219ebf3f826292afc182a94cf06611" exitCode=0 Mar 16 17:06:38 crc kubenswrapper[5120]: I0316 17:06:38.954368 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:06:38 crc kubenswrapper[5120]: I0316 17:06:38.954472 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"f32b373d-941d-4c2f-a53f-fa417428838b","Type":"ContainerDied","Data":"1766683330a4cbeed4e84484197d9fae7b219ebf3f826292afc182a94cf06611"} Mar 16 17:06:38 crc kubenswrapper[5120]: I0316 17:06:38.954526 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"f32b373d-941d-4c2f-a53f-fa417428838b","Type":"ContainerDied","Data":"13839265ede719839c8d75568fd6bf5da5e0d0d779c91f9a7677ca1d4c1ba0fd"} Mar 16 17:06:38 crc kubenswrapper[5120]: I0316 17:06:38.992392 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:06:38 crc kubenswrapper[5120]: I0316 17:06:38.996100 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 17:06:38 crc kubenswrapper[5120]: I0316 17:06:38.997604 5120 scope.go:117] "RemoveContainer" containerID="c93ef53de8d14f57cb1a178bcc78b9b6b19093e526eb6efa0a68f99583708ac5" Mar 16 17:06:39 crc kubenswrapper[5120]: I0316 17:06:39.035733 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 17:06:39 crc kubenswrapper[5120]: I0316 17:06:39.060887 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 17:06:39 crc kubenswrapper[5120]: I0316 17:06:39.062278 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f32b373d-941d-4c2f-a53f-fa417428838b" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 17:06:39 crc kubenswrapper[5120]: I0316 17:06:39.062301 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f32b373d-941d-4c2f-a53f-fa417428838b" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 17:06:39 crc kubenswrapper[5120]: I0316 17:06:39.062351 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc772fff-eba2-4aa4-85ff-40057e068148" containerName="nova-metadata-metadata" Mar 16 17:06:39 crc kubenswrapper[5120]: I0316 17:06:39.062357 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc772fff-eba2-4aa4-85ff-40057e068148" containerName="nova-metadata-metadata" Mar 16 17:06:39 crc kubenswrapper[5120]: I0316 17:06:39.062380 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc772fff-eba2-4aa4-85ff-40057e068148" containerName="nova-metadata-log" Mar 16 17:06:39 crc kubenswrapper[5120]: I0316 17:06:39.062386 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc772fff-eba2-4aa4-85ff-40057e068148" containerName="nova-metadata-log" Mar 16 17:06:39 crc kubenswrapper[5120]: I0316 17:06:39.062567 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="fc772fff-eba2-4aa4-85ff-40057e068148" containerName="nova-metadata-metadata" Mar 16 17:06:39 crc kubenswrapper[5120]: I0316 17:06:39.062593 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="fc772fff-eba2-4aa4-85ff-40057e068148" containerName="nova-metadata-log" Mar 16 17:06:39 crc kubenswrapper[5120]: I0316 17:06:39.062605 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f32b373d-941d-4c2f-a53f-fa417428838b" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 17:06:39 crc kubenswrapper[5120]: I0316 17:06:39.070139 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:06:39 crc kubenswrapper[5120]: I0316 17:06:39.072927 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-metadata-config-data\"" Mar 16 17:06:39 crc kubenswrapper[5120]: I0316 17:06:39.073241 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-metadata-internal-svc\"" Mar 16 17:06:39 crc kubenswrapper[5120]: I0316 17:06:39.097708 5120 scope.go:117] "RemoveContainer" containerID="24d5c81201a216ebc4478fa5fc3f565ac0fdce3be4939786b4d136a99a8ea523" Mar 16 17:06:39 crc kubenswrapper[5120]: E0316 17:06:39.098581 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"24d5c81201a216ebc4478fa5fc3f565ac0fdce3be4939786b4d136a99a8ea523\": container with ID starting with 24d5c81201a216ebc4478fa5fc3f565ac0fdce3be4939786b4d136a99a8ea523 not found: ID does not exist" containerID="24d5c81201a216ebc4478fa5fc3f565ac0fdce3be4939786b4d136a99a8ea523" Mar 16 17:06:39 crc kubenswrapper[5120]: I0316 17:06:39.098610 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24d5c81201a216ebc4478fa5fc3f565ac0fdce3be4939786b4d136a99a8ea523"} err="failed to get container status \"24d5c81201a216ebc4478fa5fc3f565ac0fdce3be4939786b4d136a99a8ea523\": rpc error: code = NotFound desc = could not find container \"24d5c81201a216ebc4478fa5fc3f565ac0fdce3be4939786b4d136a99a8ea523\": container with ID starting with 24d5c81201a216ebc4478fa5fc3f565ac0fdce3be4939786b4d136a99a8ea523 not found: ID does not exist" Mar 16 17:06:39 crc kubenswrapper[5120]: I0316 17:06:39.098631 5120 scope.go:117] "RemoveContainer" containerID="c93ef53de8d14f57cb1a178bcc78b9b6b19093e526eb6efa0a68f99583708ac5" Mar 16 17:06:39 crc kubenswrapper[5120]: E0316 17:06:39.099195 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c93ef53de8d14f57cb1a178bcc78b9b6b19093e526eb6efa0a68f99583708ac5\": container with ID starting with c93ef53de8d14f57cb1a178bcc78b9b6b19093e526eb6efa0a68f99583708ac5 not found: ID does not exist" containerID="c93ef53de8d14f57cb1a178bcc78b9b6b19093e526eb6efa0a68f99583708ac5" Mar 16 17:06:39 crc kubenswrapper[5120]: I0316 17:06:39.099338 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c93ef53de8d14f57cb1a178bcc78b9b6b19093e526eb6efa0a68f99583708ac5"} err="failed to get container status \"c93ef53de8d14f57cb1a178bcc78b9b6b19093e526eb6efa0a68f99583708ac5\": rpc error: code = NotFound desc = could not find container \"c93ef53de8d14f57cb1a178bcc78b9b6b19093e526eb6efa0a68f99583708ac5\": container with ID starting with c93ef53de8d14f57cb1a178bcc78b9b6b19093e526eb6efa0a68f99583708ac5 not found: ID does not exist" Mar 16 17:06:39 crc kubenswrapper[5120]: I0316 17:06:39.099428 5120 scope.go:117] "RemoveContainer" containerID="24d5c81201a216ebc4478fa5fc3f565ac0fdce3be4939786b4d136a99a8ea523" Mar 16 17:06:39 crc kubenswrapper[5120]: I0316 17:06:39.099572 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 17:06:39 crc kubenswrapper[5120]: I0316 17:06:39.099807 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24d5c81201a216ebc4478fa5fc3f565ac0fdce3be4939786b4d136a99a8ea523"} err="failed to get container status \"24d5c81201a216ebc4478fa5fc3f565ac0fdce3be4939786b4d136a99a8ea523\": rpc error: code = NotFound desc = could not find container \"24d5c81201a216ebc4478fa5fc3f565ac0fdce3be4939786b4d136a99a8ea523\": container with ID starting with 24d5c81201a216ebc4478fa5fc3f565ac0fdce3be4939786b4d136a99a8ea523 not found: ID does not exist" Mar 16 17:06:39 crc kubenswrapper[5120]: I0316 17:06:39.099915 5120 scope.go:117] "RemoveContainer" containerID="c93ef53de8d14f57cb1a178bcc78b9b6b19093e526eb6efa0a68f99583708ac5" Mar 16 17:06:39 crc kubenswrapper[5120]: I0316 17:06:39.100665 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c93ef53de8d14f57cb1a178bcc78b9b6b19093e526eb6efa0a68f99583708ac5"} err="failed to get container status \"c93ef53de8d14f57cb1a178bcc78b9b6b19093e526eb6efa0a68f99583708ac5\": rpc error: code = NotFound desc = could not find container \"c93ef53de8d14f57cb1a178bcc78b9b6b19093e526eb6efa0a68f99583708ac5\": container with ID starting with c93ef53de8d14f57cb1a178bcc78b9b6b19093e526eb6efa0a68f99583708ac5 not found: ID does not exist" Mar 16 17:06:39 crc kubenswrapper[5120]: I0316 17:06:39.100778 5120 scope.go:117] "RemoveContainer" containerID="1766683330a4cbeed4e84484197d9fae7b219ebf3f826292afc182a94cf06611" Mar 16 17:06:39 crc kubenswrapper[5120]: I0316 17:06:39.109991 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 17:06:39 crc kubenswrapper[5120]: I0316 17:06:39.120466 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 17:06:39 crc kubenswrapper[5120]: I0316 17:06:39.127627 5120 scope.go:117] "RemoveContainer" containerID="1766683330a4cbeed4e84484197d9fae7b219ebf3f826292afc182a94cf06611" Mar 16 17:06:39 crc kubenswrapper[5120]: E0316 17:06:39.128330 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1766683330a4cbeed4e84484197d9fae7b219ebf3f826292afc182a94cf06611\": container with ID starting with 1766683330a4cbeed4e84484197d9fae7b219ebf3f826292afc182a94cf06611 not found: ID does not exist" containerID="1766683330a4cbeed4e84484197d9fae7b219ebf3f826292afc182a94cf06611" Mar 16 17:06:39 crc kubenswrapper[5120]: I0316 17:06:39.128380 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1766683330a4cbeed4e84484197d9fae7b219ebf3f826292afc182a94cf06611"} err="failed to get container status \"1766683330a4cbeed4e84484197d9fae7b219ebf3f826292afc182a94cf06611\": rpc error: code = NotFound desc = could not find container \"1766683330a4cbeed4e84484197d9fae7b219ebf3f826292afc182a94cf06611\": container with ID starting with 1766683330a4cbeed4e84484197d9fae7b219ebf3f826292afc182a94cf06611 not found: ID does not exist" Mar 16 17:06:39 crc kubenswrapper[5120]: I0316 17:06:39.129248 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 17:06:39 crc kubenswrapper[5120]: I0316 17:06:39.137537 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 17:06:39 crc kubenswrapper[5120]: I0316 17:06:39.137649 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:06:39 crc kubenswrapper[5120]: I0316 17:06:39.140416 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-novncproxy-config-data\"" Mar 16 17:06:39 crc kubenswrapper[5120]: I0316 17:06:39.140470 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-novncproxy-cell1-public-svc\"" Mar 16 17:06:39 crc kubenswrapper[5120]: I0316 17:06:39.140427 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-novncproxy-cell1-vencrypt\"" Mar 16 17:06:39 crc kubenswrapper[5120]: I0316 17:06:39.181831 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e919cb04-9f01-4a7a-9a04-42ba26aa26e7-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"e919cb04-9f01-4a7a-9a04-42ba26aa26e7\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:06:39 crc kubenswrapper[5120]: I0316 17:06:39.181947 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e919cb04-9f01-4a7a-9a04-42ba26aa26e7-logs\") pod \"nova-metadata-0\" (UID: \"e919cb04-9f01-4a7a-9a04-42ba26aa26e7\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:06:39 crc kubenswrapper[5120]: I0316 17:06:39.181984 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/e919cb04-9f01-4a7a-9a04-42ba26aa26e7-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"e919cb04-9f01-4a7a-9a04-42ba26aa26e7\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:06:39 crc kubenswrapper[5120]: I0316 17:06:39.182064 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e919cb04-9f01-4a7a-9a04-42ba26aa26e7-config-data\") pod \"nova-metadata-0\" (UID: \"e919cb04-9f01-4a7a-9a04-42ba26aa26e7\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:06:39 crc kubenswrapper[5120]: I0316 17:06:39.182107 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmsj5\" (UniqueName: \"kubernetes.io/projected/e919cb04-9f01-4a7a-9a04-42ba26aa26e7-kube-api-access-cmsj5\") pod \"nova-metadata-0\" (UID: \"e919cb04-9f01-4a7a-9a04-42ba26aa26e7\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:06:39 crc kubenswrapper[5120]: I0316 17:06:39.285066 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e919cb04-9f01-4a7a-9a04-42ba26aa26e7-config-data\") pod \"nova-metadata-0\" (UID: \"e919cb04-9f01-4a7a-9a04-42ba26aa26e7\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:06:39 crc kubenswrapper[5120]: I0316 17:06:39.285170 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cmsj5\" (UniqueName: \"kubernetes.io/projected/e919cb04-9f01-4a7a-9a04-42ba26aa26e7-kube-api-access-cmsj5\") pod \"nova-metadata-0\" (UID: \"e919cb04-9f01-4a7a-9a04-42ba26aa26e7\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:06:39 crc kubenswrapper[5120]: I0316 17:06:39.285301 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/286e2312-ce33-48da-ac60-149b96ace59a-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"286e2312-ce33-48da-ac60-149b96ace59a\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:06:39 crc kubenswrapper[5120]: I0316 17:06:39.285412 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/286e2312-ce33-48da-ac60-149b96ace59a-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"286e2312-ce33-48da-ac60-149b96ace59a\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:06:39 crc kubenswrapper[5120]: I0316 17:06:39.285616 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/286e2312-ce33-48da-ac60-149b96ace59a-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"286e2312-ce33-48da-ac60-149b96ace59a\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:06:39 crc kubenswrapper[5120]: I0316 17:06:39.285678 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fd5xd\" (UniqueName: \"kubernetes.io/projected/286e2312-ce33-48da-ac60-149b96ace59a-kube-api-access-fd5xd\") pod \"nova-cell1-novncproxy-0\" (UID: \"286e2312-ce33-48da-ac60-149b96ace59a\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:06:39 crc kubenswrapper[5120]: I0316 17:06:39.285868 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/286e2312-ce33-48da-ac60-149b96ace59a-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"286e2312-ce33-48da-ac60-149b96ace59a\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:06:39 crc kubenswrapper[5120]: I0316 17:06:39.285980 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e919cb04-9f01-4a7a-9a04-42ba26aa26e7-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"e919cb04-9f01-4a7a-9a04-42ba26aa26e7\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:06:39 crc kubenswrapper[5120]: I0316 17:06:39.286085 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e919cb04-9f01-4a7a-9a04-42ba26aa26e7-logs\") pod \"nova-metadata-0\" (UID: \"e919cb04-9f01-4a7a-9a04-42ba26aa26e7\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:06:39 crc kubenswrapper[5120]: I0316 17:06:39.286135 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/e919cb04-9f01-4a7a-9a04-42ba26aa26e7-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"e919cb04-9f01-4a7a-9a04-42ba26aa26e7\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:06:39 crc kubenswrapper[5120]: I0316 17:06:39.286519 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e919cb04-9f01-4a7a-9a04-42ba26aa26e7-logs\") pod \"nova-metadata-0\" (UID: \"e919cb04-9f01-4a7a-9a04-42ba26aa26e7\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:06:39 crc kubenswrapper[5120]: I0316 17:06:39.290385 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/e919cb04-9f01-4a7a-9a04-42ba26aa26e7-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"e919cb04-9f01-4a7a-9a04-42ba26aa26e7\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:06:39 crc kubenswrapper[5120]: I0316 17:06:39.290672 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e919cb04-9f01-4a7a-9a04-42ba26aa26e7-config-data\") pod \"nova-metadata-0\" (UID: \"e919cb04-9f01-4a7a-9a04-42ba26aa26e7\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:06:39 crc kubenswrapper[5120]: I0316 17:06:39.290672 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e919cb04-9f01-4a7a-9a04-42ba26aa26e7-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"e919cb04-9f01-4a7a-9a04-42ba26aa26e7\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:06:39 crc kubenswrapper[5120]: I0316 17:06:39.301567 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmsj5\" (UniqueName: \"kubernetes.io/projected/e919cb04-9f01-4a7a-9a04-42ba26aa26e7-kube-api-access-cmsj5\") pod \"nova-metadata-0\" (UID: \"e919cb04-9f01-4a7a-9a04-42ba26aa26e7\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:06:39 crc kubenswrapper[5120]: I0316 17:06:39.389972 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/286e2312-ce33-48da-ac60-149b96ace59a-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"286e2312-ce33-48da-ac60-149b96ace59a\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:06:39 crc kubenswrapper[5120]: I0316 17:06:39.390821 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/286e2312-ce33-48da-ac60-149b96ace59a-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"286e2312-ce33-48da-ac60-149b96ace59a\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:06:39 crc kubenswrapper[5120]: I0316 17:06:39.390952 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/286e2312-ce33-48da-ac60-149b96ace59a-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"286e2312-ce33-48da-ac60-149b96ace59a\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:06:39 crc kubenswrapper[5120]: I0316 17:06:39.391072 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fd5xd\" (UniqueName: \"kubernetes.io/projected/286e2312-ce33-48da-ac60-149b96ace59a-kube-api-access-fd5xd\") pod \"nova-cell1-novncproxy-0\" (UID: \"286e2312-ce33-48da-ac60-149b96ace59a\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:06:39 crc kubenswrapper[5120]: I0316 17:06:39.391199 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/286e2312-ce33-48da-ac60-149b96ace59a-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"286e2312-ce33-48da-ac60-149b96ace59a\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:06:39 crc kubenswrapper[5120]: I0316 17:06:39.396527 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:06:39 crc kubenswrapper[5120]: I0316 17:06:39.397929 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/286e2312-ce33-48da-ac60-149b96ace59a-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"286e2312-ce33-48da-ac60-149b96ace59a\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:06:39 crc kubenswrapper[5120]: I0316 17:06:39.404505 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/286e2312-ce33-48da-ac60-149b96ace59a-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"286e2312-ce33-48da-ac60-149b96ace59a\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:06:39 crc kubenswrapper[5120]: I0316 17:06:39.408482 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/286e2312-ce33-48da-ac60-149b96ace59a-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"286e2312-ce33-48da-ac60-149b96ace59a\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:06:39 crc kubenswrapper[5120]: I0316 17:06:39.416165 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/286e2312-ce33-48da-ac60-149b96ace59a-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"286e2312-ce33-48da-ac60-149b96ace59a\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:06:39 crc kubenswrapper[5120]: I0316 17:06:39.418587 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fd5xd\" (UniqueName: \"kubernetes.io/projected/286e2312-ce33-48da-ac60-149b96ace59a-kube-api-access-fd5xd\") pod \"nova-cell1-novncproxy-0\" (UID: \"286e2312-ce33-48da-ac60-149b96ace59a\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:06:39 crc kubenswrapper[5120]: I0316 17:06:39.459829 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:06:39 crc kubenswrapper[5120]: I0316 17:06:39.893874 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 17:06:39 crc kubenswrapper[5120]: I0316 17:06:39.973909 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"e919cb04-9f01-4a7a-9a04-42ba26aa26e7","Type":"ContainerStarted","Data":"6ebfdd3134465310b5ae7be105878d7e93bd4ee213ca7bd5001ccc3152589dec"} Mar 16 17:06:39 crc kubenswrapper[5120]: I0316 17:06:39.975957 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 17:06:39 crc kubenswrapper[5120]: W0316 17:06:39.990530 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod286e2312_ce33_48da_ac60_149b96ace59a.slice/crio-af6b84b95ec1df0adffb6a534aeaba5075a3098379eb9127824551fbdc4013a0 WatchSource:0}: Error finding container af6b84b95ec1df0adffb6a534aeaba5075a3098379eb9127824551fbdc4013a0: Status 404 returned error can't find the container with id af6b84b95ec1df0adffb6a534aeaba5075a3098379eb9127824551fbdc4013a0 Mar 16 17:06:40 crc kubenswrapper[5120]: I0316 17:06:40.391437 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-st2nf" Mar 16 17:06:40 crc kubenswrapper[5120]: I0316 17:06:40.520103 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4hm7l\" (UniqueName: \"kubernetes.io/projected/a4ae208c-9690-4d37-bd09-f87420dbe1c1-kube-api-access-4hm7l\") pod \"a4ae208c-9690-4d37-bd09-f87420dbe1c1\" (UID: \"a4ae208c-9690-4d37-bd09-f87420dbe1c1\") " Mar 16 17:06:40 crc kubenswrapper[5120]: I0316 17:06:40.520158 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a4ae208c-9690-4d37-bd09-f87420dbe1c1-config-data\") pod \"a4ae208c-9690-4d37-bd09-f87420dbe1c1\" (UID: \"a4ae208c-9690-4d37-bd09-f87420dbe1c1\") " Mar 16 17:06:40 crc kubenswrapper[5120]: I0316 17:06:40.520329 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a4ae208c-9690-4d37-bd09-f87420dbe1c1-combined-ca-bundle\") pod \"a4ae208c-9690-4d37-bd09-f87420dbe1c1\" (UID: \"a4ae208c-9690-4d37-bd09-f87420dbe1c1\") " Mar 16 17:06:40 crc kubenswrapper[5120]: I0316 17:06:40.520395 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a4ae208c-9690-4d37-bd09-f87420dbe1c1-scripts\") pod \"a4ae208c-9690-4d37-bd09-f87420dbe1c1\" (UID: \"a4ae208c-9690-4d37-bd09-f87420dbe1c1\") " Mar 16 17:06:40 crc kubenswrapper[5120]: I0316 17:06:40.525104 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a4ae208c-9690-4d37-bd09-f87420dbe1c1-kube-api-access-4hm7l" (OuterVolumeSpecName: "kube-api-access-4hm7l") pod "a4ae208c-9690-4d37-bd09-f87420dbe1c1" (UID: "a4ae208c-9690-4d37-bd09-f87420dbe1c1"). InnerVolumeSpecName "kube-api-access-4hm7l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:06:40 crc kubenswrapper[5120]: I0316 17:06:40.525502 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a4ae208c-9690-4d37-bd09-f87420dbe1c1-scripts" (OuterVolumeSpecName: "scripts") pod "a4ae208c-9690-4d37-bd09-f87420dbe1c1" (UID: "a4ae208c-9690-4d37-bd09-f87420dbe1c1"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:06:40 crc kubenswrapper[5120]: I0316 17:06:40.554404 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a4ae208c-9690-4d37-bd09-f87420dbe1c1-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "a4ae208c-9690-4d37-bd09-f87420dbe1c1" (UID: "a4ae208c-9690-4d37-bd09-f87420dbe1c1"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:06:40 crc kubenswrapper[5120]: I0316 17:06:40.567517 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a4ae208c-9690-4d37-bd09-f87420dbe1c1-config-data" (OuterVolumeSpecName: "config-data") pod "a4ae208c-9690-4d37-bd09-f87420dbe1c1" (UID: "a4ae208c-9690-4d37-bd09-f87420dbe1c1"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:06:40 crc kubenswrapper[5120]: I0316 17:06:40.624059 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4hm7l\" (UniqueName: \"kubernetes.io/projected/a4ae208c-9690-4d37-bd09-f87420dbe1c1-kube-api-access-4hm7l\") on node \"crc\" DevicePath \"\"" Mar 16 17:06:40 crc kubenswrapper[5120]: I0316 17:06:40.624101 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a4ae208c-9690-4d37-bd09-f87420dbe1c1-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:06:40 crc kubenswrapper[5120]: I0316 17:06:40.624115 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a4ae208c-9690-4d37-bd09-f87420dbe1c1-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:06:40 crc kubenswrapper[5120]: I0316 17:06:40.624131 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a4ae208c-9690-4d37-bd09-f87420dbe1c1-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:06:40 crc kubenswrapper[5120]: I0316 17:06:40.674021 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f32b373d-941d-4c2f-a53f-fa417428838b" path="/var/lib/kubelet/pods/f32b373d-941d-4c2f-a53f-fa417428838b/volumes" Mar 16 17:06:40 crc kubenswrapper[5120]: I0316 17:06:40.674605 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc772fff-eba2-4aa4-85ff-40057e068148" path="/var/lib/kubelet/pods/fc772fff-eba2-4aa4-85ff-40057e068148/volumes" Mar 16 17:06:40 crc kubenswrapper[5120]: I0316 17:06:40.984573 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"286e2312-ce33-48da-ac60-149b96ace59a","Type":"ContainerStarted","Data":"c21a10708b310667945ad3e55d48904fa4e2513041d3f95d448b7f3f10ed9b7b"} Mar 16 17:06:40 crc kubenswrapper[5120]: I0316 17:06:40.985712 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"286e2312-ce33-48da-ac60-149b96ace59a","Type":"ContainerStarted","Data":"af6b84b95ec1df0adffb6a534aeaba5075a3098379eb9127824551fbdc4013a0"} Mar 16 17:06:40 crc kubenswrapper[5120]: I0316 17:06:40.990295 5120 generic.go:358] "Generic (PLEG): container finished" podID="b09a0851-56c4-4871-be74-3dc7be582a80" containerID="c7dea1965a80cb2989e9f401e59d00f0a34ace41781d462763f621d9f8898d96" exitCode=0 Mar 16 17:06:40 crc kubenswrapper[5120]: I0316 17:06:40.990477 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-cgxw5" event={"ID":"b09a0851-56c4-4871-be74-3dc7be582a80","Type":"ContainerDied","Data":"c7dea1965a80cb2989e9f401e59d00f0a34ace41781d462763f621d9f8898d96"} Mar 16 17:06:40 crc kubenswrapper[5120]: I0316 17:06:40.993395 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-st2nf" Mar 16 17:06:40 crc kubenswrapper[5120]: I0316 17:06:40.993393 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-st2nf" event={"ID":"a4ae208c-9690-4d37-bd09-f87420dbe1c1","Type":"ContainerDied","Data":"94c08d81429f721e72f03dd4402fb8dbdb0a1ba898e456529ac85584126b0d7a"} Mar 16 17:06:40 crc kubenswrapper[5120]: I0316 17:06:40.993517 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="94c08d81429f721e72f03dd4402fb8dbdb0a1ba898e456529ac85584126b0d7a" Mar 16 17:06:40 crc kubenswrapper[5120]: I0316 17:06:40.998441 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"e919cb04-9f01-4a7a-9a04-42ba26aa26e7","Type":"ContainerStarted","Data":"99ba40b332ad8dfe72c130468e5066b0e67c854aefb4afe1a319594273991a76"} Mar 16 17:06:40 crc kubenswrapper[5120]: I0316 17:06:40.998485 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"e919cb04-9f01-4a7a-9a04-42ba26aa26e7","Type":"ContainerStarted","Data":"13871f10e7b44d70fdef29137a04d01ae1b3bba964759eb77439de0180c8e40a"} Mar 16 17:06:41 crc kubenswrapper[5120]: I0316 17:06:41.022629 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podStartSLOduration=2.022610731 podStartE2EDuration="2.022610731s" podCreationTimestamp="2026-03-16 17:06:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:06:41.007272747 +0000 UTC m=+5703.161204414" watchObservedRunningTime="2026-03-16 17:06:41.022610731 +0000 UTC m=+5703.176542388" Mar 16 17:06:41 crc kubenswrapper[5120]: I0316 17:06:41.046266 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=3.046244304 podStartE2EDuration="3.046244304s" podCreationTimestamp="2026-03-16 17:06:38 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:06:41.02545308 +0000 UTC m=+5703.179384737" watchObservedRunningTime="2026-03-16 17:06:41.046244304 +0000 UTC m=+5703.200175961" Mar 16 17:06:41 crc kubenswrapper[5120]: I0316 17:06:41.100822 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 17:06:41 crc kubenswrapper[5120]: I0316 17:06:41.102407 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4ae208c-9690-4d37-bd09-f87420dbe1c1" containerName="nova-cell1-conductor-db-sync" Mar 16 17:06:41 crc kubenswrapper[5120]: I0316 17:06:41.102435 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4ae208c-9690-4d37-bd09-f87420dbe1c1" containerName="nova-cell1-conductor-db-sync" Mar 16 17:06:41 crc kubenswrapper[5120]: I0316 17:06:41.102734 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="a4ae208c-9690-4d37-bd09-f87420dbe1c1" containerName="nova-cell1-conductor-db-sync" Mar 16 17:06:41 crc kubenswrapper[5120]: I0316 17:06:41.144623 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 17:06:41 crc kubenswrapper[5120]: I0316 17:06:41.147782 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-conductor-config-data\"" Mar 16 17:06:41 crc kubenswrapper[5120]: I0316 17:06:41.148129 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 17:06:41 crc kubenswrapper[5120]: I0316 17:06:41.242956 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dfe74d0c-e886-4057-8cb1-0bdb487b317c-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"dfe74d0c-e886-4057-8cb1-0bdb487b317c\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 17:06:41 crc kubenswrapper[5120]: I0316 17:06:41.243057 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dfe74d0c-e886-4057-8cb1-0bdb487b317c-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"dfe74d0c-e886-4057-8cb1-0bdb487b317c\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 17:06:41 crc kubenswrapper[5120]: I0316 17:06:41.243687 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4vst\" (UniqueName: \"kubernetes.io/projected/dfe74d0c-e886-4057-8cb1-0bdb487b317c-kube-api-access-m4vst\") pod \"nova-cell1-conductor-0\" (UID: \"dfe74d0c-e886-4057-8cb1-0bdb487b317c\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 17:06:41 crc kubenswrapper[5120]: I0316 17:06:41.346041 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m4vst\" (UniqueName: \"kubernetes.io/projected/dfe74d0c-e886-4057-8cb1-0bdb487b317c-kube-api-access-m4vst\") pod \"nova-cell1-conductor-0\" (UID: \"dfe74d0c-e886-4057-8cb1-0bdb487b317c\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 17:06:41 crc kubenswrapper[5120]: I0316 17:06:41.346226 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dfe74d0c-e886-4057-8cb1-0bdb487b317c-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"dfe74d0c-e886-4057-8cb1-0bdb487b317c\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 17:06:41 crc kubenswrapper[5120]: I0316 17:06:41.346310 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dfe74d0c-e886-4057-8cb1-0bdb487b317c-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"dfe74d0c-e886-4057-8cb1-0bdb487b317c\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 17:06:41 crc kubenswrapper[5120]: I0316 17:06:41.375509 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dfe74d0c-e886-4057-8cb1-0bdb487b317c-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"dfe74d0c-e886-4057-8cb1-0bdb487b317c\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 17:06:41 crc kubenswrapper[5120]: I0316 17:06:41.379333 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4vst\" (UniqueName: \"kubernetes.io/projected/dfe74d0c-e886-4057-8cb1-0bdb487b317c-kube-api-access-m4vst\") pod \"nova-cell1-conductor-0\" (UID: \"dfe74d0c-e886-4057-8cb1-0bdb487b317c\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 17:06:41 crc kubenswrapper[5120]: I0316 17:06:41.379569 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dfe74d0c-e886-4057-8cb1-0bdb487b317c-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"dfe74d0c-e886-4057-8cb1-0bdb487b317c\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 17:06:41 crc kubenswrapper[5120]: I0316 17:06:41.477169 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 17:06:41 crc kubenswrapper[5120]: I0316 17:06:41.926531 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 17:06:41 crc kubenswrapper[5120]: I0316 17:06:41.978408 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 17:06:41 crc kubenswrapper[5120]: I0316 17:06:41.978686 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/kube-state-metrics-0" podUID="6d176076-ae9c-45e6-a1b4-be07747b4e73" containerName="kube-state-metrics" containerID="cri-o://38305f8ebd4a2ffa00c4fb7a684c0da44d402ffe2f36fd764592c8b71ee675f8" gracePeriod=30 Mar 16 17:06:42 crc kubenswrapper[5120]: I0316 17:06:42.023171 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"dfe74d0c-e886-4057-8cb1-0bdb487b317c","Type":"ContainerStarted","Data":"ba5bf3e7c62179ca7fe81d2569b4abfe1c8d21579e4a55fab2068d0bbff6024b"} Mar 16 17:06:42 crc kubenswrapper[5120]: I0316 17:06:42.466555 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-cgxw5" Mar 16 17:06:42 crc kubenswrapper[5120]: I0316 17:06:42.557747 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 17:06:42 crc kubenswrapper[5120]: I0316 17:06:42.586205 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ht8vc\" (UniqueName: \"kubernetes.io/projected/b09a0851-56c4-4871-be74-3dc7be582a80-kube-api-access-ht8vc\") pod \"b09a0851-56c4-4871-be74-3dc7be582a80\" (UID: \"b09a0851-56c4-4871-be74-3dc7be582a80\") " Mar 16 17:06:42 crc kubenswrapper[5120]: I0316 17:06:42.586517 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b09a0851-56c4-4871-be74-3dc7be582a80-scripts\") pod \"b09a0851-56c4-4871-be74-3dc7be582a80\" (UID: \"b09a0851-56c4-4871-be74-3dc7be582a80\") " Mar 16 17:06:42 crc kubenswrapper[5120]: I0316 17:06:42.586744 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b09a0851-56c4-4871-be74-3dc7be582a80-config-data\") pod \"b09a0851-56c4-4871-be74-3dc7be582a80\" (UID: \"b09a0851-56c4-4871-be74-3dc7be582a80\") " Mar 16 17:06:42 crc kubenswrapper[5120]: I0316 17:06:42.586993 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b09a0851-56c4-4871-be74-3dc7be582a80-combined-ca-bundle\") pod \"b09a0851-56c4-4871-be74-3dc7be582a80\" (UID: \"b09a0851-56c4-4871-be74-3dc7be582a80\") " Mar 16 17:06:42 crc kubenswrapper[5120]: I0316 17:06:42.597722 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b09a0851-56c4-4871-be74-3dc7be582a80-kube-api-access-ht8vc" (OuterVolumeSpecName: "kube-api-access-ht8vc") pod "b09a0851-56c4-4871-be74-3dc7be582a80" (UID: "b09a0851-56c4-4871-be74-3dc7be582a80"). InnerVolumeSpecName "kube-api-access-ht8vc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:06:42 crc kubenswrapper[5120]: I0316 17:06:42.598333 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b09a0851-56c4-4871-be74-3dc7be582a80-scripts" (OuterVolumeSpecName: "scripts") pod "b09a0851-56c4-4871-be74-3dc7be582a80" (UID: "b09a0851-56c4-4871-be74-3dc7be582a80"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:06:42 crc kubenswrapper[5120]: I0316 17:06:42.628071 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b09a0851-56c4-4871-be74-3dc7be582a80-config-data" (OuterVolumeSpecName: "config-data") pod "b09a0851-56c4-4871-be74-3dc7be582a80" (UID: "b09a0851-56c4-4871-be74-3dc7be582a80"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:06:42 crc kubenswrapper[5120]: I0316 17:06:42.628094 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b09a0851-56c4-4871-be74-3dc7be582a80-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "b09a0851-56c4-4871-be74-3dc7be582a80" (UID: "b09a0851-56c4-4871-be74-3dc7be582a80"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:06:42 crc kubenswrapper[5120]: I0316 17:06:42.689039 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6cdcj\" (UniqueName: \"kubernetes.io/projected/6d176076-ae9c-45e6-a1b4-be07747b4e73-kube-api-access-6cdcj\") pod \"6d176076-ae9c-45e6-a1b4-be07747b4e73\" (UID: \"6d176076-ae9c-45e6-a1b4-be07747b4e73\") " Mar 16 17:06:42 crc kubenswrapper[5120]: I0316 17:06:42.690427 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b09a0851-56c4-4871-be74-3dc7be582a80-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:06:42 crc kubenswrapper[5120]: I0316 17:06:42.690458 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ht8vc\" (UniqueName: \"kubernetes.io/projected/b09a0851-56c4-4871-be74-3dc7be582a80-kube-api-access-ht8vc\") on node \"crc\" DevicePath \"\"" Mar 16 17:06:42 crc kubenswrapper[5120]: I0316 17:06:42.690471 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b09a0851-56c4-4871-be74-3dc7be582a80-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:06:42 crc kubenswrapper[5120]: I0316 17:06:42.690482 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b09a0851-56c4-4871-be74-3dc7be582a80-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:06:42 crc kubenswrapper[5120]: I0316 17:06:42.692685 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d176076-ae9c-45e6-a1b4-be07747b4e73-kube-api-access-6cdcj" (OuterVolumeSpecName: "kube-api-access-6cdcj") pod "6d176076-ae9c-45e6-a1b4-be07747b4e73" (UID: "6d176076-ae9c-45e6-a1b4-be07747b4e73"). InnerVolumeSpecName "kube-api-access-6cdcj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:06:42 crc kubenswrapper[5120]: I0316 17:06:42.792532 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6cdcj\" (UniqueName: \"kubernetes.io/projected/6d176076-ae9c-45e6-a1b4-be07747b4e73-kube-api-access-6cdcj\") on node \"crc\" DevicePath \"\"" Mar 16 17:06:43 crc kubenswrapper[5120]: I0316 17:06:43.035896 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"dfe74d0c-e886-4057-8cb1-0bdb487b317c","Type":"ContainerStarted","Data":"f68243cf4325c812ddc49bff1063df157769dc8e1e0e4bf7bb8137f1da918e6d"} Mar 16 17:06:43 crc kubenswrapper[5120]: I0316 17:06:43.036277 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 17:06:43 crc kubenswrapper[5120]: I0316 17:06:43.042778 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-cgxw5" Mar 16 17:06:43 crc kubenswrapper[5120]: I0316 17:06:43.042841 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-cgxw5" event={"ID":"b09a0851-56c4-4871-be74-3dc7be582a80","Type":"ContainerDied","Data":"89fd2f875c9fa1beda1c873a096f1e80eda20899a6cc7f9d96b5df85cf2daee8"} Mar 16 17:06:43 crc kubenswrapper[5120]: I0316 17:06:43.042909 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="89fd2f875c9fa1beda1c873a096f1e80eda20899a6cc7f9d96b5df85cf2daee8" Mar 16 17:06:43 crc kubenswrapper[5120]: I0316 17:06:43.045862 5120 generic.go:358] "Generic (PLEG): container finished" podID="6d176076-ae9c-45e6-a1b4-be07747b4e73" containerID="38305f8ebd4a2ffa00c4fb7a684c0da44d402ffe2f36fd764592c8b71ee675f8" exitCode=2 Mar 16 17:06:43 crc kubenswrapper[5120]: I0316 17:06:43.046014 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"6d176076-ae9c-45e6-a1b4-be07747b4e73","Type":"ContainerDied","Data":"38305f8ebd4a2ffa00c4fb7a684c0da44d402ffe2f36fd764592c8b71ee675f8"} Mar 16 17:06:43 crc kubenswrapper[5120]: I0316 17:06:43.046048 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"6d176076-ae9c-45e6-a1b4-be07747b4e73","Type":"ContainerDied","Data":"29bccd2d7616b7858edca21d481bffca93d3c8be4c3136f7bc36c64060bfb229"} Mar 16 17:06:43 crc kubenswrapper[5120]: I0316 17:06:43.046070 5120 scope.go:117] "RemoveContainer" containerID="38305f8ebd4a2ffa00c4fb7a684c0da44d402ffe2f36fd764592c8b71ee675f8" Mar 16 17:06:43 crc kubenswrapper[5120]: I0316 17:06:43.046203 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 17:06:43 crc kubenswrapper[5120]: I0316 17:06:43.063446 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podStartSLOduration=2.063426699 podStartE2EDuration="2.063426699s" podCreationTimestamp="2026-03-16 17:06:41 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:06:43.055998495 +0000 UTC m=+5705.209930152" watchObservedRunningTime="2026-03-16 17:06:43.063426699 +0000 UTC m=+5705.217358356" Mar 16 17:06:43 crc kubenswrapper[5120]: I0316 17:06:43.084518 5120 scope.go:117] "RemoveContainer" containerID="38305f8ebd4a2ffa00c4fb7a684c0da44d402ffe2f36fd764592c8b71ee675f8" Mar 16 17:06:43 crc kubenswrapper[5120]: E0316 17:06:43.085298 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"38305f8ebd4a2ffa00c4fb7a684c0da44d402ffe2f36fd764592c8b71ee675f8\": container with ID starting with 38305f8ebd4a2ffa00c4fb7a684c0da44d402ffe2f36fd764592c8b71ee675f8 not found: ID does not exist" containerID="38305f8ebd4a2ffa00c4fb7a684c0da44d402ffe2f36fd764592c8b71ee675f8" Mar 16 17:06:43 crc kubenswrapper[5120]: I0316 17:06:43.085356 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38305f8ebd4a2ffa00c4fb7a684c0da44d402ffe2f36fd764592c8b71ee675f8"} err="failed to get container status \"38305f8ebd4a2ffa00c4fb7a684c0da44d402ffe2f36fd764592c8b71ee675f8\": rpc error: code = NotFound desc = could not find container \"38305f8ebd4a2ffa00c4fb7a684c0da44d402ffe2f36fd764592c8b71ee675f8\": container with ID starting with 38305f8ebd4a2ffa00c4fb7a684c0da44d402ffe2f36fd764592c8b71ee675f8 not found: ID does not exist" Mar 16 17:06:43 crc kubenswrapper[5120]: I0316 17:06:43.175931 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 17:06:43 crc kubenswrapper[5120]: I0316 17:06:43.190197 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 17:06:43 crc kubenswrapper[5120]: I0316 17:06:43.198355 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 17:06:43 crc kubenswrapper[5120]: I0316 17:06:43.199834 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b09a0851-56c4-4871-be74-3dc7be582a80" containerName="nova-manage" Mar 16 17:06:43 crc kubenswrapper[5120]: I0316 17:06:43.199961 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="b09a0851-56c4-4871-be74-3dc7be582a80" containerName="nova-manage" Mar 16 17:06:43 crc kubenswrapper[5120]: I0316 17:06:43.200038 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d176076-ae9c-45e6-a1b4-be07747b4e73" containerName="kube-state-metrics" Mar 16 17:06:43 crc kubenswrapper[5120]: I0316 17:06:43.200105 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d176076-ae9c-45e6-a1b4-be07747b4e73" containerName="kube-state-metrics" Mar 16 17:06:43 crc kubenswrapper[5120]: I0316 17:06:43.200328 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="6d176076-ae9c-45e6-a1b4-be07747b4e73" containerName="kube-state-metrics" Mar 16 17:06:43 crc kubenswrapper[5120]: I0316 17:06:43.200404 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="b09a0851-56c4-4871-be74-3dc7be582a80" containerName="nova-manage" Mar 16 17:06:43 crc kubenswrapper[5120]: I0316 17:06:43.205518 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 17:06:43 crc kubenswrapper[5120]: I0316 17:06:43.207399 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 17:06:43 crc kubenswrapper[5120]: I0316 17:06:43.236123 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"kube-state-metrics-tls-config\"" Mar 16 17:06:43 crc kubenswrapper[5120]: I0316 17:06:43.236276 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-kube-state-metrics-svc\"" Mar 16 17:06:43 crc kubenswrapper[5120]: I0316 17:06:43.303050 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sh4v7\" (UniqueName: \"kubernetes.io/projected/483d872a-47d2-44f6-a80a-acf24e5f37c8-kube-api-access-sh4v7\") pod \"kube-state-metrics-0\" (UID: \"483d872a-47d2-44f6-a80a-acf24e5f37c8\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 17:06:43 crc kubenswrapper[5120]: I0316 17:06:43.306275 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/483d872a-47d2-44f6-a80a-acf24e5f37c8-combined-ca-bundle\") pod \"kube-state-metrics-0\" (UID: \"483d872a-47d2-44f6-a80a-acf24e5f37c8\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 17:06:43 crc kubenswrapper[5120]: I0316 17:06:43.307164 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/483d872a-47d2-44f6-a80a-acf24e5f37c8-kube-state-metrics-tls-config\") pod \"kube-state-metrics-0\" (UID: \"483d872a-47d2-44f6-a80a-acf24e5f37c8\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 17:06:43 crc kubenswrapper[5120]: I0316 17:06:43.307436 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/483d872a-47d2-44f6-a80a-acf24e5f37c8-kube-state-metrics-tls-certs\") pod \"kube-state-metrics-0\" (UID: \"483d872a-47d2-44f6-a80a-acf24e5f37c8\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 17:06:43 crc kubenswrapper[5120]: I0316 17:06:43.357200 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 17:06:43 crc kubenswrapper[5120]: I0316 17:06:43.357608 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="0afcb817-e0e0-495b-b68d-ea067f4f3200" containerName="nova-api-log" containerID="cri-o://1f51c0e559d037c438795d8f5fcea546e860e6f4a8339f9883bf47f95ccd8996" gracePeriod=30 Mar 16 17:06:43 crc kubenswrapper[5120]: I0316 17:06:43.357808 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="0afcb817-e0e0-495b-b68d-ea067f4f3200" containerName="nova-api-api" containerID="cri-o://c36235d360b75e4cce33435a98a48f547b90d3f55ef0055adc203b826178695b" gracePeriod=30 Mar 16 17:06:43 crc kubenswrapper[5120]: I0316 17:06:43.374604 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 17:06:43 crc kubenswrapper[5120]: I0316 17:06:43.375952 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="ab5e26e4-ccf7-4dc1-a4d7-4687023dd74c" containerName="nova-scheduler-scheduler" containerID="cri-o://655356dce435a2e2be1abb74154a1de57661f5d1cd984036e19e9e9607990d79" gracePeriod=30 Mar 16 17:06:43 crc kubenswrapper[5120]: I0316 17:06:43.395838 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 17:06:43 crc kubenswrapper[5120]: I0316 17:06:43.396088 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="e919cb04-9f01-4a7a-9a04-42ba26aa26e7" containerName="nova-metadata-log" containerID="cri-o://13871f10e7b44d70fdef29137a04d01ae1b3bba964759eb77439de0180c8e40a" gracePeriod=30 Mar 16 17:06:43 crc kubenswrapper[5120]: I0316 17:06:43.396532 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="e919cb04-9f01-4a7a-9a04-42ba26aa26e7" containerName="nova-metadata-metadata" containerID="cri-o://99ba40b332ad8dfe72c130468e5066b0e67c854aefb4afe1a319594273991a76" gracePeriod=30 Mar 16 17:06:43 crc kubenswrapper[5120]: I0316 17:06:43.409958 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/483d872a-47d2-44f6-a80a-acf24e5f37c8-kube-state-metrics-tls-config\") pod \"kube-state-metrics-0\" (UID: \"483d872a-47d2-44f6-a80a-acf24e5f37c8\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 17:06:43 crc kubenswrapper[5120]: I0316 17:06:43.410090 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/483d872a-47d2-44f6-a80a-acf24e5f37c8-kube-state-metrics-tls-certs\") pod \"kube-state-metrics-0\" (UID: \"483d872a-47d2-44f6-a80a-acf24e5f37c8\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 17:06:43 crc kubenswrapper[5120]: I0316 17:06:43.410198 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sh4v7\" (UniqueName: \"kubernetes.io/projected/483d872a-47d2-44f6-a80a-acf24e5f37c8-kube-api-access-sh4v7\") pod \"kube-state-metrics-0\" (UID: \"483d872a-47d2-44f6-a80a-acf24e5f37c8\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 17:06:43 crc kubenswrapper[5120]: I0316 17:06:43.410375 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/483d872a-47d2-44f6-a80a-acf24e5f37c8-combined-ca-bundle\") pod \"kube-state-metrics-0\" (UID: \"483d872a-47d2-44f6-a80a-acf24e5f37c8\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 17:06:43 crc kubenswrapper[5120]: I0316 17:06:43.415976 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/483d872a-47d2-44f6-a80a-acf24e5f37c8-kube-state-metrics-tls-config\") pod \"kube-state-metrics-0\" (UID: \"483d872a-47d2-44f6-a80a-acf24e5f37c8\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 17:06:43 crc kubenswrapper[5120]: I0316 17:06:43.423860 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/483d872a-47d2-44f6-a80a-acf24e5f37c8-combined-ca-bundle\") pod \"kube-state-metrics-0\" (UID: \"483d872a-47d2-44f6-a80a-acf24e5f37c8\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 17:06:43 crc kubenswrapper[5120]: I0316 17:06:43.426311 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/483d872a-47d2-44f6-a80a-acf24e5f37c8-kube-state-metrics-tls-certs\") pod \"kube-state-metrics-0\" (UID: \"483d872a-47d2-44f6-a80a-acf24e5f37c8\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 17:06:43 crc kubenswrapper[5120]: I0316 17:06:43.434734 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sh4v7\" (UniqueName: \"kubernetes.io/projected/483d872a-47d2-44f6-a80a-acf24e5f37c8-kube-api-access-sh4v7\") pod \"kube-state-metrics-0\" (UID: \"483d872a-47d2-44f6-a80a-acf24e5f37c8\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 17:06:43 crc kubenswrapper[5120]: E0316 17:06:43.491561 5120 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfc772fff_eba2_4aa4_85ff_40057e068148.slice/crio-e9e927aa88712ffcef7dbe6a7389f1734f487859737adb662ad3224b816a100f\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfc772fff_eba2_4aa4_85ff_40057e068148.slice\": RecentStats: unable to find data in memory cache]" Mar 16 17:06:43 crc kubenswrapper[5120]: I0316 17:06:43.564793 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 17:06:44 crc kubenswrapper[5120]: I0316 17:06:44.059413 5120 generic.go:358] "Generic (PLEG): container finished" podID="e919cb04-9f01-4a7a-9a04-42ba26aa26e7" containerID="99ba40b332ad8dfe72c130468e5066b0e67c854aefb4afe1a319594273991a76" exitCode=0 Mar 16 17:06:44 crc kubenswrapper[5120]: I0316 17:06:44.059445 5120 generic.go:358] "Generic (PLEG): container finished" podID="e919cb04-9f01-4a7a-9a04-42ba26aa26e7" containerID="13871f10e7b44d70fdef29137a04d01ae1b3bba964759eb77439de0180c8e40a" exitCode=143 Mar 16 17:06:44 crc kubenswrapper[5120]: I0316 17:06:44.059620 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"e919cb04-9f01-4a7a-9a04-42ba26aa26e7","Type":"ContainerDied","Data":"99ba40b332ad8dfe72c130468e5066b0e67c854aefb4afe1a319594273991a76"} Mar 16 17:06:44 crc kubenswrapper[5120]: I0316 17:06:44.059651 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"e919cb04-9f01-4a7a-9a04-42ba26aa26e7","Type":"ContainerDied","Data":"13871f10e7b44d70fdef29137a04d01ae1b3bba964759eb77439de0180c8e40a"} Mar 16 17:06:44 crc kubenswrapper[5120]: I0316 17:06:44.063407 5120 generic.go:358] "Generic (PLEG): container finished" podID="0afcb817-e0e0-495b-b68d-ea067f4f3200" containerID="c36235d360b75e4cce33435a98a48f547b90d3f55ef0055adc203b826178695b" exitCode=0 Mar 16 17:06:44 crc kubenswrapper[5120]: I0316 17:06:44.063438 5120 generic.go:358] "Generic (PLEG): container finished" podID="0afcb817-e0e0-495b-b68d-ea067f4f3200" containerID="1f51c0e559d037c438795d8f5fcea546e860e6f4a8339f9883bf47f95ccd8996" exitCode=143 Mar 16 17:06:44 crc kubenswrapper[5120]: I0316 17:06:44.063595 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"0afcb817-e0e0-495b-b68d-ea067f4f3200","Type":"ContainerDied","Data":"c36235d360b75e4cce33435a98a48f547b90d3f55ef0055adc203b826178695b"} Mar 16 17:06:44 crc kubenswrapper[5120]: I0316 17:06:44.063624 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"0afcb817-e0e0-495b-b68d-ea067f4f3200","Type":"ContainerDied","Data":"1f51c0e559d037c438795d8f5fcea546e860e6f4a8339f9883bf47f95ccd8996"} Mar 16 17:06:44 crc kubenswrapper[5120]: I0316 17:06:44.093589 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 17:06:44 crc kubenswrapper[5120]: I0316 17:06:44.285820 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:06:44 crc kubenswrapper[5120]: I0316 17:06:44.286419 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="194d643a-a5df-47e5-a784-033ce596809e" containerName="ceilometer-central-agent" containerID="cri-o://88a8e8261bde1f1f9445d5410d4b6633d98a1011efa62d11e1974fc3853830da" gracePeriod=30 Mar 16 17:06:44 crc kubenswrapper[5120]: I0316 17:06:44.286466 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="194d643a-a5df-47e5-a784-033ce596809e" containerName="proxy-httpd" containerID="cri-o://93648515609f108a56c2bda326b39d41ec58faa1e5500425d82c0664febb6508" gracePeriod=30 Mar 16 17:06:44 crc kubenswrapper[5120]: I0316 17:06:44.286556 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="194d643a-a5df-47e5-a784-033ce596809e" containerName="ceilometer-notification-agent" containerID="cri-o://dd1479fa3ec45e1bd78229508bb4d71140d5aaed1abfa331b1be4fa2ca4a7ed1" gracePeriod=30 Mar 16 17:06:44 crc kubenswrapper[5120]: I0316 17:06:44.286836 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="194d643a-a5df-47e5-a784-033ce596809e" containerName="sg-core" containerID="cri-o://cc9a8cdc43460a02454df2b447222ac753a835e25b4678c7eac4ef94e84005c5" gracePeriod=30 Mar 16 17:06:44 crc kubenswrapper[5120]: I0316 17:06:44.308162 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:06:44 crc kubenswrapper[5120]: I0316 17:06:44.321268 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:06:44 crc kubenswrapper[5120]: I0316 17:06:44.382668 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e919cb04-9f01-4a7a-9a04-42ba26aa26e7-combined-ca-bundle\") pod \"e919cb04-9f01-4a7a-9a04-42ba26aa26e7\" (UID: \"e919cb04-9f01-4a7a-9a04-42ba26aa26e7\") " Mar 16 17:06:44 crc kubenswrapper[5120]: I0316 17:06:44.382837 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0afcb817-e0e0-495b-b68d-ea067f4f3200-combined-ca-bundle\") pod \"0afcb817-e0e0-495b-b68d-ea067f4f3200\" (UID: \"0afcb817-e0e0-495b-b68d-ea067f4f3200\") " Mar 16 17:06:44 crc kubenswrapper[5120]: I0316 17:06:44.382868 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cmsj5\" (UniqueName: \"kubernetes.io/projected/e919cb04-9f01-4a7a-9a04-42ba26aa26e7-kube-api-access-cmsj5\") pod \"e919cb04-9f01-4a7a-9a04-42ba26aa26e7\" (UID: \"e919cb04-9f01-4a7a-9a04-42ba26aa26e7\") " Mar 16 17:06:44 crc kubenswrapper[5120]: I0316 17:06:44.382895 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e919cb04-9f01-4a7a-9a04-42ba26aa26e7-config-data\") pod \"e919cb04-9f01-4a7a-9a04-42ba26aa26e7\" (UID: \"e919cb04-9f01-4a7a-9a04-42ba26aa26e7\") " Mar 16 17:06:44 crc kubenswrapper[5120]: I0316 17:06:44.383207 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0afcb817-e0e0-495b-b68d-ea067f4f3200-logs\") pod \"0afcb817-e0e0-495b-b68d-ea067f4f3200\" (UID: \"0afcb817-e0e0-495b-b68d-ea067f4f3200\") " Mar 16 17:06:44 crc kubenswrapper[5120]: I0316 17:06:44.383319 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/e919cb04-9f01-4a7a-9a04-42ba26aa26e7-nova-metadata-tls-certs\") pod \"e919cb04-9f01-4a7a-9a04-42ba26aa26e7\" (UID: \"e919cb04-9f01-4a7a-9a04-42ba26aa26e7\") " Mar 16 17:06:44 crc kubenswrapper[5120]: I0316 17:06:44.383366 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2596p\" (UniqueName: \"kubernetes.io/projected/0afcb817-e0e0-495b-b68d-ea067f4f3200-kube-api-access-2596p\") pod \"0afcb817-e0e0-495b-b68d-ea067f4f3200\" (UID: \"0afcb817-e0e0-495b-b68d-ea067f4f3200\") " Mar 16 17:06:44 crc kubenswrapper[5120]: I0316 17:06:44.383456 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0afcb817-e0e0-495b-b68d-ea067f4f3200-config-data\") pod \"0afcb817-e0e0-495b-b68d-ea067f4f3200\" (UID: \"0afcb817-e0e0-495b-b68d-ea067f4f3200\") " Mar 16 17:06:44 crc kubenswrapper[5120]: I0316 17:06:44.383808 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e919cb04-9f01-4a7a-9a04-42ba26aa26e7-logs\") pod \"e919cb04-9f01-4a7a-9a04-42ba26aa26e7\" (UID: \"e919cb04-9f01-4a7a-9a04-42ba26aa26e7\") " Mar 16 17:06:44 crc kubenswrapper[5120]: I0316 17:06:44.384403 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0afcb817-e0e0-495b-b68d-ea067f4f3200-logs" (OuterVolumeSpecName: "logs") pod "0afcb817-e0e0-495b-b68d-ea067f4f3200" (UID: "0afcb817-e0e0-495b-b68d-ea067f4f3200"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:06:44 crc kubenswrapper[5120]: I0316 17:06:44.384395 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e919cb04-9f01-4a7a-9a04-42ba26aa26e7-logs" (OuterVolumeSpecName: "logs") pod "e919cb04-9f01-4a7a-9a04-42ba26aa26e7" (UID: "e919cb04-9f01-4a7a-9a04-42ba26aa26e7"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:06:44 crc kubenswrapper[5120]: I0316 17:06:44.385221 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0afcb817-e0e0-495b-b68d-ea067f4f3200-logs\") on node \"crc\" DevicePath \"\"" Mar 16 17:06:44 crc kubenswrapper[5120]: I0316 17:06:44.385253 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e919cb04-9f01-4a7a-9a04-42ba26aa26e7-logs\") on node \"crc\" DevicePath \"\"" Mar 16 17:06:44 crc kubenswrapper[5120]: I0316 17:06:44.389517 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0afcb817-e0e0-495b-b68d-ea067f4f3200-kube-api-access-2596p" (OuterVolumeSpecName: "kube-api-access-2596p") pod "0afcb817-e0e0-495b-b68d-ea067f4f3200" (UID: "0afcb817-e0e0-495b-b68d-ea067f4f3200"). InnerVolumeSpecName "kube-api-access-2596p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:06:44 crc kubenswrapper[5120]: I0316 17:06:44.404551 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e919cb04-9f01-4a7a-9a04-42ba26aa26e7-kube-api-access-cmsj5" (OuterVolumeSpecName: "kube-api-access-cmsj5") pod "e919cb04-9f01-4a7a-9a04-42ba26aa26e7" (UID: "e919cb04-9f01-4a7a-9a04-42ba26aa26e7"). InnerVolumeSpecName "kube-api-access-cmsj5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:06:44 crc kubenswrapper[5120]: I0316 17:06:44.442965 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e919cb04-9f01-4a7a-9a04-42ba26aa26e7-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e919cb04-9f01-4a7a-9a04-42ba26aa26e7" (UID: "e919cb04-9f01-4a7a-9a04-42ba26aa26e7"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:06:44 crc kubenswrapper[5120]: I0316 17:06:44.443254 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e919cb04-9f01-4a7a-9a04-42ba26aa26e7-config-data" (OuterVolumeSpecName: "config-data") pod "e919cb04-9f01-4a7a-9a04-42ba26aa26e7" (UID: "e919cb04-9f01-4a7a-9a04-42ba26aa26e7"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:06:44 crc kubenswrapper[5120]: I0316 17:06:44.460615 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:06:44 crc kubenswrapper[5120]: I0316 17:06:44.473131 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0afcb817-e0e0-495b-b68d-ea067f4f3200-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "0afcb817-e0e0-495b-b68d-ea067f4f3200" (UID: "0afcb817-e0e0-495b-b68d-ea067f4f3200"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:06:44 crc kubenswrapper[5120]: I0316 17:06:44.477008 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e919cb04-9f01-4a7a-9a04-42ba26aa26e7-nova-metadata-tls-certs" (OuterVolumeSpecName: "nova-metadata-tls-certs") pod "e919cb04-9f01-4a7a-9a04-42ba26aa26e7" (UID: "e919cb04-9f01-4a7a-9a04-42ba26aa26e7"). InnerVolumeSpecName "nova-metadata-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:06:44 crc kubenswrapper[5120]: I0316 17:06:44.489185 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e919cb04-9f01-4a7a-9a04-42ba26aa26e7-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:06:44 crc kubenswrapper[5120]: I0316 17:06:44.489243 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0afcb817-e0e0-495b-b68d-ea067f4f3200-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:06:44 crc kubenswrapper[5120]: I0316 17:06:44.489256 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cmsj5\" (UniqueName: \"kubernetes.io/projected/e919cb04-9f01-4a7a-9a04-42ba26aa26e7-kube-api-access-cmsj5\") on node \"crc\" DevicePath \"\"" Mar 16 17:06:44 crc kubenswrapper[5120]: I0316 17:06:44.489269 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e919cb04-9f01-4a7a-9a04-42ba26aa26e7-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:06:44 crc kubenswrapper[5120]: I0316 17:06:44.489281 5120 reconciler_common.go:299] "Volume detached for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/e919cb04-9f01-4a7a-9a04-42ba26aa26e7-nova-metadata-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:06:44 crc kubenswrapper[5120]: I0316 17:06:44.489293 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2596p\" (UniqueName: \"kubernetes.io/projected/0afcb817-e0e0-495b-b68d-ea067f4f3200-kube-api-access-2596p\") on node \"crc\" DevicePath \"\"" Mar 16 17:06:44 crc kubenswrapper[5120]: I0316 17:06:44.502949 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0afcb817-e0e0-495b-b68d-ea067f4f3200-config-data" (OuterVolumeSpecName: "config-data") pod "0afcb817-e0e0-495b-b68d-ea067f4f3200" (UID: "0afcb817-e0e0-495b-b68d-ea067f4f3200"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:06:44 crc kubenswrapper[5120]: I0316 17:06:44.595992 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0afcb817-e0e0-495b-b68d-ea067f4f3200-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:06:44 crc kubenswrapper[5120]: I0316 17:06:44.679049 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6d176076-ae9c-45e6-a1b4-be07747b4e73" path="/var/lib/kubelet/pods/6d176076-ae9c-45e6-a1b4-be07747b4e73/volumes" Mar 16 17:06:45 crc kubenswrapper[5120]: I0316 17:06:45.077565 5120 generic.go:358] "Generic (PLEG): container finished" podID="194d643a-a5df-47e5-a784-033ce596809e" containerID="93648515609f108a56c2bda326b39d41ec58faa1e5500425d82c0664febb6508" exitCode=0 Mar 16 17:06:45 crc kubenswrapper[5120]: I0316 17:06:45.077592 5120 generic.go:358] "Generic (PLEG): container finished" podID="194d643a-a5df-47e5-a784-033ce596809e" containerID="cc9a8cdc43460a02454df2b447222ac753a835e25b4678c7eac4ef94e84005c5" exitCode=2 Mar 16 17:06:45 crc kubenswrapper[5120]: I0316 17:06:45.077600 5120 generic.go:358] "Generic (PLEG): container finished" podID="194d643a-a5df-47e5-a784-033ce596809e" containerID="88a8e8261bde1f1f9445d5410d4b6633d98a1011efa62d11e1974fc3853830da" exitCode=0 Mar 16 17:06:45 crc kubenswrapper[5120]: I0316 17:06:45.077667 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"194d643a-a5df-47e5-a784-033ce596809e","Type":"ContainerDied","Data":"93648515609f108a56c2bda326b39d41ec58faa1e5500425d82c0664febb6508"} Mar 16 17:06:45 crc kubenswrapper[5120]: I0316 17:06:45.077692 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"194d643a-a5df-47e5-a784-033ce596809e","Type":"ContainerDied","Data":"cc9a8cdc43460a02454df2b447222ac753a835e25b4678c7eac4ef94e84005c5"} Mar 16 17:06:45 crc kubenswrapper[5120]: I0316 17:06:45.077701 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"194d643a-a5df-47e5-a784-033ce596809e","Type":"ContainerDied","Data":"88a8e8261bde1f1f9445d5410d4b6633d98a1011efa62d11e1974fc3853830da"} Mar 16 17:06:45 crc kubenswrapper[5120]: I0316 17:06:45.079510 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"e919cb04-9f01-4a7a-9a04-42ba26aa26e7","Type":"ContainerDied","Data":"6ebfdd3134465310b5ae7be105878d7e93bd4ee213ca7bd5001ccc3152589dec"} Mar 16 17:06:45 crc kubenswrapper[5120]: I0316 17:06:45.079537 5120 scope.go:117] "RemoveContainer" containerID="99ba40b332ad8dfe72c130468e5066b0e67c854aefb4afe1a319594273991a76" Mar 16 17:06:45 crc kubenswrapper[5120]: I0316 17:06:45.079637 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:06:45 crc kubenswrapper[5120]: I0316 17:06:45.083659 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"0afcb817-e0e0-495b-b68d-ea067f4f3200","Type":"ContainerDied","Data":"e5527564906d85a01d40b72e1fee4d9ee0b87ca0c5fab42ca6577bb90e66afea"} Mar 16 17:06:45 crc kubenswrapper[5120]: I0316 17:06:45.083722 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:06:45 crc kubenswrapper[5120]: I0316 17:06:45.089525 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"483d872a-47d2-44f6-a80a-acf24e5f37c8","Type":"ContainerStarted","Data":"52f34ac885b11da9ee43ba4a878d1623997383148b6223e1da309b744d0c7ee3"} Mar 16 17:06:45 crc kubenswrapper[5120]: I0316 17:06:45.089548 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"483d872a-47d2-44f6-a80a-acf24e5f37c8","Type":"ContainerStarted","Data":"345202c89264508b76f31a00ca01230337139db561679a528e1127da136e279f"} Mar 16 17:06:45 crc kubenswrapper[5120]: I0316 17:06:45.089570 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 17:06:45 crc kubenswrapper[5120]: I0316 17:06:45.162157 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/kube-state-metrics-0" podStartSLOduration=1.742625667 podStartE2EDuration="2.162141257s" podCreationTimestamp="2026-03-16 17:06:43 +0000 UTC" firstStartedPulling="2026-03-16 17:06:44.128404069 +0000 UTC m=+5706.282335726" lastFinishedPulling="2026-03-16 17:06:44.547919659 +0000 UTC m=+5706.701851316" observedRunningTime="2026-03-16 17:06:45.108959798 +0000 UTC m=+5707.262891455" watchObservedRunningTime="2026-03-16 17:06:45.162141257 +0000 UTC m=+5707.316072924" Mar 16 17:06:45 crc kubenswrapper[5120]: I0316 17:06:45.170654 5120 scope.go:117] "RemoveContainer" containerID="13871f10e7b44d70fdef29137a04d01ae1b3bba964759eb77439de0180c8e40a" Mar 16 17:06:45 crc kubenswrapper[5120]: I0316 17:06:45.203886 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 17:06:45 crc kubenswrapper[5120]: I0316 17:06:45.255164 5120 scope.go:117] "RemoveContainer" containerID="c36235d360b75e4cce33435a98a48f547b90d3f55ef0055adc203b826178695b" Mar 16 17:06:45 crc kubenswrapper[5120]: I0316 17:06:45.256613 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 17:06:45 crc kubenswrapper[5120]: I0316 17:06:45.298937 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 17:06:45 crc kubenswrapper[5120]: I0316 17:06:45.313225 5120 scope.go:117] "RemoveContainer" containerID="1f51c0e559d037c438795d8f5fcea546e860e6f4a8339f9883bf47f95ccd8996" Mar 16 17:06:45 crc kubenswrapper[5120]: I0316 17:06:45.316384 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 17:06:45 crc kubenswrapper[5120]: I0316 17:06:45.329625 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 17:06:45 crc kubenswrapper[5120]: I0316 17:06:45.334253 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0afcb817-e0e0-495b-b68d-ea067f4f3200" containerName="nova-api-api" Mar 16 17:06:45 crc kubenswrapper[5120]: I0316 17:06:45.334296 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="0afcb817-e0e0-495b-b68d-ea067f4f3200" containerName="nova-api-api" Mar 16 17:06:45 crc kubenswrapper[5120]: I0316 17:06:45.334333 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e919cb04-9f01-4a7a-9a04-42ba26aa26e7" containerName="nova-metadata-log" Mar 16 17:06:45 crc kubenswrapper[5120]: I0316 17:06:45.334340 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e919cb04-9f01-4a7a-9a04-42ba26aa26e7" containerName="nova-metadata-log" Mar 16 17:06:45 crc kubenswrapper[5120]: I0316 17:06:45.334356 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e919cb04-9f01-4a7a-9a04-42ba26aa26e7" containerName="nova-metadata-metadata" Mar 16 17:06:45 crc kubenswrapper[5120]: I0316 17:06:45.334364 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e919cb04-9f01-4a7a-9a04-42ba26aa26e7" containerName="nova-metadata-metadata" Mar 16 17:06:45 crc kubenswrapper[5120]: I0316 17:06:45.334401 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0afcb817-e0e0-495b-b68d-ea067f4f3200" containerName="nova-api-log" Mar 16 17:06:45 crc kubenswrapper[5120]: I0316 17:06:45.334407 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="0afcb817-e0e0-495b-b68d-ea067f4f3200" containerName="nova-api-log" Mar 16 17:06:45 crc kubenswrapper[5120]: I0316 17:06:45.336986 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e919cb04-9f01-4a7a-9a04-42ba26aa26e7" containerName="nova-metadata-metadata" Mar 16 17:06:45 crc kubenswrapper[5120]: I0316 17:06:45.337022 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="0afcb817-e0e0-495b-b68d-ea067f4f3200" containerName="nova-api-log" Mar 16 17:06:45 crc kubenswrapper[5120]: I0316 17:06:45.337038 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="0afcb817-e0e0-495b-b68d-ea067f4f3200" containerName="nova-api-api" Mar 16 17:06:45 crc kubenswrapper[5120]: I0316 17:06:45.337051 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e919cb04-9f01-4a7a-9a04-42ba26aa26e7" containerName="nova-metadata-log" Mar 16 17:06:45 crc kubenswrapper[5120]: I0316 17:06:45.344849 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 17:06:45 crc kubenswrapper[5120]: I0316 17:06:45.345066 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:06:45 crc kubenswrapper[5120]: I0316 17:06:45.347517 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-metadata-internal-svc\"" Mar 16 17:06:45 crc kubenswrapper[5120]: I0316 17:06:45.349392 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-metadata-config-data\"" Mar 16 17:06:45 crc kubenswrapper[5120]: I0316 17:06:45.350515 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 17:06:45 crc kubenswrapper[5120]: I0316 17:06:45.357943 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:06:45 crc kubenswrapper[5120]: I0316 17:06:45.363511 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 17:06:45 crc kubenswrapper[5120]: I0316 17:06:45.364280 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-config-data\"" Mar 16 17:06:45 crc kubenswrapper[5120]: I0316 17:06:45.423464 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3c799dfa-c6ab-4e66-9c61-63c1833ee6d4-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"3c799dfa-c6ab-4e66-9c61-63c1833ee6d4\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:06:45 crc kubenswrapper[5120]: I0316 17:06:45.423950 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqxg2\" (UniqueName: \"kubernetes.io/projected/3c799dfa-c6ab-4e66-9c61-63c1833ee6d4-kube-api-access-mqxg2\") pod \"nova-metadata-0\" (UID: \"3c799dfa-c6ab-4e66-9c61-63c1833ee6d4\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:06:45 crc kubenswrapper[5120]: I0316 17:06:45.423996 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/3c799dfa-c6ab-4e66-9c61-63c1833ee6d4-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"3c799dfa-c6ab-4e66-9c61-63c1833ee6d4\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:06:45 crc kubenswrapper[5120]: I0316 17:06:45.424082 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3c799dfa-c6ab-4e66-9c61-63c1833ee6d4-logs\") pod \"nova-metadata-0\" (UID: \"3c799dfa-c6ab-4e66-9c61-63c1833ee6d4\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:06:45 crc kubenswrapper[5120]: I0316 17:06:45.424179 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3c799dfa-c6ab-4e66-9c61-63c1833ee6d4-config-data\") pod \"nova-metadata-0\" (UID: \"3c799dfa-c6ab-4e66-9c61-63c1833ee6d4\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:06:45 crc kubenswrapper[5120]: I0316 17:06:45.526554 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3c799dfa-c6ab-4e66-9c61-63c1833ee6d4-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"3c799dfa-c6ab-4e66-9c61-63c1833ee6d4\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:06:45 crc kubenswrapper[5120]: I0316 17:06:45.526644 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mqxg2\" (UniqueName: \"kubernetes.io/projected/3c799dfa-c6ab-4e66-9c61-63c1833ee6d4-kube-api-access-mqxg2\") pod \"nova-metadata-0\" (UID: \"3c799dfa-c6ab-4e66-9c61-63c1833ee6d4\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:06:45 crc kubenswrapper[5120]: I0316 17:06:45.526678 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/3c799dfa-c6ab-4e66-9c61-63c1833ee6d4-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"3c799dfa-c6ab-4e66-9c61-63c1833ee6d4\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:06:45 crc kubenswrapper[5120]: I0316 17:06:45.526715 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bv5f\" (UniqueName: \"kubernetes.io/projected/16295648-8a78-488d-b66b-e0e2814a7d77-kube-api-access-7bv5f\") pod \"nova-api-0\" (UID: \"16295648-8a78-488d-b66b-e0e2814a7d77\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:06:45 crc kubenswrapper[5120]: I0316 17:06:45.526736 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3c799dfa-c6ab-4e66-9c61-63c1833ee6d4-logs\") pod \"nova-metadata-0\" (UID: \"3c799dfa-c6ab-4e66-9c61-63c1833ee6d4\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:06:45 crc kubenswrapper[5120]: I0316 17:06:45.526820 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3c799dfa-c6ab-4e66-9c61-63c1833ee6d4-config-data\") pod \"nova-metadata-0\" (UID: \"3c799dfa-c6ab-4e66-9c61-63c1833ee6d4\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:06:45 crc kubenswrapper[5120]: I0316 17:06:45.526898 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/16295648-8a78-488d-b66b-e0e2814a7d77-config-data\") pod \"nova-api-0\" (UID: \"16295648-8a78-488d-b66b-e0e2814a7d77\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:06:45 crc kubenswrapper[5120]: I0316 17:06:45.527027 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/16295648-8a78-488d-b66b-e0e2814a7d77-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"16295648-8a78-488d-b66b-e0e2814a7d77\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:06:45 crc kubenswrapper[5120]: I0316 17:06:45.527067 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/16295648-8a78-488d-b66b-e0e2814a7d77-logs\") pod \"nova-api-0\" (UID: \"16295648-8a78-488d-b66b-e0e2814a7d77\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:06:45 crc kubenswrapper[5120]: I0316 17:06:45.527740 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3c799dfa-c6ab-4e66-9c61-63c1833ee6d4-logs\") pod \"nova-metadata-0\" (UID: \"3c799dfa-c6ab-4e66-9c61-63c1833ee6d4\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:06:45 crc kubenswrapper[5120]: I0316 17:06:45.533142 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3c799dfa-c6ab-4e66-9c61-63c1833ee6d4-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"3c799dfa-c6ab-4e66-9c61-63c1833ee6d4\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:06:45 crc kubenswrapper[5120]: I0316 17:06:45.535297 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3c799dfa-c6ab-4e66-9c61-63c1833ee6d4-config-data\") pod \"nova-metadata-0\" (UID: \"3c799dfa-c6ab-4e66-9c61-63c1833ee6d4\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:06:45 crc kubenswrapper[5120]: I0316 17:06:45.545743 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/3c799dfa-c6ab-4e66-9c61-63c1833ee6d4-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"3c799dfa-c6ab-4e66-9c61-63c1833ee6d4\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:06:45 crc kubenswrapper[5120]: I0316 17:06:45.546777 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqxg2\" (UniqueName: \"kubernetes.io/projected/3c799dfa-c6ab-4e66-9c61-63c1833ee6d4-kube-api-access-mqxg2\") pod \"nova-metadata-0\" (UID: \"3c799dfa-c6ab-4e66-9c61-63c1833ee6d4\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:06:45 crc kubenswrapper[5120]: I0316 17:06:45.631562 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/16295648-8a78-488d-b66b-e0e2814a7d77-config-data\") pod \"nova-api-0\" (UID: \"16295648-8a78-488d-b66b-e0e2814a7d77\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:06:45 crc kubenswrapper[5120]: I0316 17:06:45.631792 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/16295648-8a78-488d-b66b-e0e2814a7d77-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"16295648-8a78-488d-b66b-e0e2814a7d77\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:06:45 crc kubenswrapper[5120]: I0316 17:06:45.631855 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/16295648-8a78-488d-b66b-e0e2814a7d77-logs\") pod \"nova-api-0\" (UID: \"16295648-8a78-488d-b66b-e0e2814a7d77\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:06:45 crc kubenswrapper[5120]: I0316 17:06:45.632069 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7bv5f\" (UniqueName: \"kubernetes.io/projected/16295648-8a78-488d-b66b-e0e2814a7d77-kube-api-access-7bv5f\") pod \"nova-api-0\" (UID: \"16295648-8a78-488d-b66b-e0e2814a7d77\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:06:45 crc kubenswrapper[5120]: I0316 17:06:45.635199 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/16295648-8a78-488d-b66b-e0e2814a7d77-logs\") pod \"nova-api-0\" (UID: \"16295648-8a78-488d-b66b-e0e2814a7d77\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:06:45 crc kubenswrapper[5120]: I0316 17:06:45.636460 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/16295648-8a78-488d-b66b-e0e2814a7d77-config-data\") pod \"nova-api-0\" (UID: \"16295648-8a78-488d-b66b-e0e2814a7d77\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:06:45 crc kubenswrapper[5120]: I0316 17:06:45.638434 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/16295648-8a78-488d-b66b-e0e2814a7d77-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"16295648-8a78-488d-b66b-e0e2814a7d77\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:06:45 crc kubenswrapper[5120]: I0316 17:06:45.652646 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bv5f\" (UniqueName: \"kubernetes.io/projected/16295648-8a78-488d-b66b-e0e2814a7d77-kube-api-access-7bv5f\") pod \"nova-api-0\" (UID: \"16295648-8a78-488d-b66b-e0e2814a7d77\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:06:45 crc kubenswrapper[5120]: I0316 17:06:45.672236 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:06:45 crc kubenswrapper[5120]: I0316 17:06:45.688945 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:06:46 crc kubenswrapper[5120]: I0316 17:06:46.112097 5120 generic.go:358] "Generic (PLEG): container finished" podID="194d643a-a5df-47e5-a784-033ce596809e" containerID="dd1479fa3ec45e1bd78229508bb4d71140d5aaed1abfa331b1be4fa2ca4a7ed1" exitCode=0 Mar 16 17:06:46 crc kubenswrapper[5120]: I0316 17:06:46.112468 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"194d643a-a5df-47e5-a784-033ce596809e","Type":"ContainerDied","Data":"dd1479fa3ec45e1bd78229508bb4d71140d5aaed1abfa331b1be4fa2ca4a7ed1"} Mar 16 17:06:46 crc kubenswrapper[5120]: I0316 17:06:46.171335 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 17:06:46 crc kubenswrapper[5120]: W0316 17:06:46.175992 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3c799dfa_c6ab_4e66_9c61_63c1833ee6d4.slice/crio-ab9a21b359458da1619cc034ca0c89734622ea373746f210144091e5da3d4ec2 WatchSource:0}: Error finding container ab9a21b359458da1619cc034ca0c89734622ea373746f210144091e5da3d4ec2: Status 404 returned error can't find the container with id ab9a21b359458da1619cc034ca0c89734622ea373746f210144091e5da3d4ec2 Mar 16 17:06:46 crc kubenswrapper[5120]: I0316 17:06:46.255571 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 17:06:46 crc kubenswrapper[5120]: W0316 17:06:46.260202 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod16295648_8a78_488d_b66b_e0e2814a7d77.slice/crio-e1388ac1aea12f43ae9f3aaf3064b5b37330e25dbc403b492d278b4b291fcae9 WatchSource:0}: Error finding container e1388ac1aea12f43ae9f3aaf3064b5b37330e25dbc403b492d278b4b291fcae9: Status 404 returned error can't find the container with id e1388ac1aea12f43ae9f3aaf3064b5b37330e25dbc403b492d278b4b291fcae9 Mar 16 17:06:46 crc kubenswrapper[5120]: I0316 17:06:46.391015 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:06:46 crc kubenswrapper[5120]: I0316 17:06:46.558677 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/194d643a-a5df-47e5-a784-033ce596809e-sg-core-conf-yaml\") pod \"194d643a-a5df-47e5-a784-033ce596809e\" (UID: \"194d643a-a5df-47e5-a784-033ce596809e\") " Mar 16 17:06:46 crc kubenswrapper[5120]: I0316 17:06:46.558724 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/194d643a-a5df-47e5-a784-033ce596809e-config-data\") pod \"194d643a-a5df-47e5-a784-033ce596809e\" (UID: \"194d643a-a5df-47e5-a784-033ce596809e\") " Mar 16 17:06:46 crc kubenswrapper[5120]: I0316 17:06:46.558922 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/194d643a-a5df-47e5-a784-033ce596809e-run-httpd\") pod \"194d643a-a5df-47e5-a784-033ce596809e\" (UID: \"194d643a-a5df-47e5-a784-033ce596809e\") " Mar 16 17:06:46 crc kubenswrapper[5120]: I0316 17:06:46.559105 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/194d643a-a5df-47e5-a784-033ce596809e-log-httpd\") pod \"194d643a-a5df-47e5-a784-033ce596809e\" (UID: \"194d643a-a5df-47e5-a784-033ce596809e\") " Mar 16 17:06:46 crc kubenswrapper[5120]: I0316 17:06:46.559237 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/194d643a-a5df-47e5-a784-033ce596809e-combined-ca-bundle\") pod \"194d643a-a5df-47e5-a784-033ce596809e\" (UID: \"194d643a-a5df-47e5-a784-033ce596809e\") " Mar 16 17:06:46 crc kubenswrapper[5120]: I0316 17:06:46.559262 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/194d643a-a5df-47e5-a784-033ce596809e-scripts\") pod \"194d643a-a5df-47e5-a784-033ce596809e\" (UID: \"194d643a-a5df-47e5-a784-033ce596809e\") " Mar 16 17:06:46 crc kubenswrapper[5120]: I0316 17:06:46.559335 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7z9nx\" (UniqueName: \"kubernetes.io/projected/194d643a-a5df-47e5-a784-033ce596809e-kube-api-access-7z9nx\") pod \"194d643a-a5df-47e5-a784-033ce596809e\" (UID: \"194d643a-a5df-47e5-a784-033ce596809e\") " Mar 16 17:06:46 crc kubenswrapper[5120]: I0316 17:06:46.559483 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/194d643a-a5df-47e5-a784-033ce596809e-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "194d643a-a5df-47e5-a784-033ce596809e" (UID: "194d643a-a5df-47e5-a784-033ce596809e"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:06:46 crc kubenswrapper[5120]: I0316 17:06:46.559943 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/194d643a-a5df-47e5-a784-033ce596809e-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "194d643a-a5df-47e5-a784-033ce596809e" (UID: "194d643a-a5df-47e5-a784-033ce596809e"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:06:46 crc kubenswrapper[5120]: I0316 17:06:46.560184 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/194d643a-a5df-47e5-a784-033ce596809e-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 17:06:46 crc kubenswrapper[5120]: I0316 17:06:46.560198 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/194d643a-a5df-47e5-a784-033ce596809e-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 17:06:46 crc kubenswrapper[5120]: I0316 17:06:46.569311 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/194d643a-a5df-47e5-a784-033ce596809e-scripts" (OuterVolumeSpecName: "scripts") pod "194d643a-a5df-47e5-a784-033ce596809e" (UID: "194d643a-a5df-47e5-a784-033ce596809e"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:06:46 crc kubenswrapper[5120]: I0316 17:06:46.570283 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/194d643a-a5df-47e5-a784-033ce596809e-kube-api-access-7z9nx" (OuterVolumeSpecName: "kube-api-access-7z9nx") pod "194d643a-a5df-47e5-a784-033ce596809e" (UID: "194d643a-a5df-47e5-a784-033ce596809e"). InnerVolumeSpecName "kube-api-access-7z9nx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:06:46 crc kubenswrapper[5120]: I0316 17:06:46.611018 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/194d643a-a5df-47e5-a784-033ce596809e-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "194d643a-a5df-47e5-a784-033ce596809e" (UID: "194d643a-a5df-47e5-a784-033ce596809e"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:06:46 crc kubenswrapper[5120]: I0316 17:06:46.663024 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7z9nx\" (UniqueName: \"kubernetes.io/projected/194d643a-a5df-47e5-a784-033ce596809e-kube-api-access-7z9nx\") on node \"crc\" DevicePath \"\"" Mar 16 17:06:46 crc kubenswrapper[5120]: I0316 17:06:46.663067 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/194d643a-a5df-47e5-a784-033ce596809e-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 17:06:46 crc kubenswrapper[5120]: I0316 17:06:46.663079 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/194d643a-a5df-47e5-a784-033ce596809e-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:06:46 crc kubenswrapper[5120]: I0316 17:06:46.664153 5120 scope.go:117] "RemoveContainer" containerID="db39d192fa687a13805537d08ad22fed1ef362ef5027c920a616297dc55a8ea9" Mar 16 17:06:46 crc kubenswrapper[5120]: E0316 17:06:46.664445 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 17:06:46 crc kubenswrapper[5120]: I0316 17:06:46.693339 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0afcb817-e0e0-495b-b68d-ea067f4f3200" path="/var/lib/kubelet/pods/0afcb817-e0e0-495b-b68d-ea067f4f3200/volumes" Mar 16 17:06:46 crc kubenswrapper[5120]: I0316 17:06:46.700373 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e919cb04-9f01-4a7a-9a04-42ba26aa26e7" path="/var/lib/kubelet/pods/e919cb04-9f01-4a7a-9a04-42ba26aa26e7/volumes" Mar 16 17:06:46 crc kubenswrapper[5120]: I0316 17:06:46.717899 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/194d643a-a5df-47e5-a784-033ce596809e-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "194d643a-a5df-47e5-a784-033ce596809e" (UID: "194d643a-a5df-47e5-a784-033ce596809e"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:06:46 crc kubenswrapper[5120]: I0316 17:06:46.762131 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/194d643a-a5df-47e5-a784-033ce596809e-config-data" (OuterVolumeSpecName: "config-data") pod "194d643a-a5df-47e5-a784-033ce596809e" (UID: "194d643a-a5df-47e5-a784-033ce596809e"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:06:46 crc kubenswrapper[5120]: I0316 17:06:46.766434 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/194d643a-a5df-47e5-a784-033ce596809e-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:06:46 crc kubenswrapper[5120]: I0316 17:06:46.766471 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/194d643a-a5df-47e5-a784-033ce596809e-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:06:46 crc kubenswrapper[5120]: I0316 17:06:46.817130 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:06:46 crc kubenswrapper[5120]: I0316 17:06:46.866269 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-v822j_ac55471d-4e42-475f-a082-50f611571482/kube-multus/0.log" Mar 16 17:06:46 crc kubenswrapper[5120]: I0316 17:06:46.867288 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-czqz2\" (UniqueName: \"kubernetes.io/projected/ab5e26e4-ccf7-4dc1-a4d7-4687023dd74c-kube-api-access-czqz2\") pod \"ab5e26e4-ccf7-4dc1-a4d7-4687023dd74c\" (UID: \"ab5e26e4-ccf7-4dc1-a4d7-4687023dd74c\") " Mar 16 17:06:46 crc kubenswrapper[5120]: I0316 17:06:46.867445 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ab5e26e4-ccf7-4dc1-a4d7-4687023dd74c-combined-ca-bundle\") pod \"ab5e26e4-ccf7-4dc1-a4d7-4687023dd74c\" (UID: \"ab5e26e4-ccf7-4dc1-a4d7-4687023dd74c\") " Mar 16 17:06:46 crc kubenswrapper[5120]: I0316 17:06:46.867611 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ab5e26e4-ccf7-4dc1-a4d7-4687023dd74c-config-data\") pod \"ab5e26e4-ccf7-4dc1-a4d7-4687023dd74c\" (UID: \"ab5e26e4-ccf7-4dc1-a4d7-4687023dd74c\") " Mar 16 17:06:46 crc kubenswrapper[5120]: I0316 17:06:46.874918 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab5e26e4-ccf7-4dc1-a4d7-4687023dd74c-kube-api-access-czqz2" (OuterVolumeSpecName: "kube-api-access-czqz2") pod "ab5e26e4-ccf7-4dc1-a4d7-4687023dd74c" (UID: "ab5e26e4-ccf7-4dc1-a4d7-4687023dd74c"). InnerVolumeSpecName "kube-api-access-czqz2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:06:46 crc kubenswrapper[5120]: I0316 17:06:46.889973 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-crc_9f0bc7fcb0822a2c13eb2d22cd8c0641/kube-controller-manager/0.log" Mar 16 17:06:46 crc kubenswrapper[5120]: I0316 17:06:46.898610 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ab5e26e4-ccf7-4dc1-a4d7-4687023dd74c-config-data" (OuterVolumeSpecName: "config-data") pod "ab5e26e4-ccf7-4dc1-a4d7-4687023dd74c" (UID: "ab5e26e4-ccf7-4dc1-a4d7-4687023dd74c"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:06:46 crc kubenswrapper[5120]: I0316 17:06:46.900166 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ab5e26e4-ccf7-4dc1-a4d7-4687023dd74c-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ab5e26e4-ccf7-4dc1-a4d7-4687023dd74c" (UID: "ab5e26e4-ccf7-4dc1-a4d7-4687023dd74c"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:06:46 crc kubenswrapper[5120]: I0316 17:06:46.970899 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-czqz2\" (UniqueName: \"kubernetes.io/projected/ab5e26e4-ccf7-4dc1-a4d7-4687023dd74c-kube-api-access-czqz2\") on node \"crc\" DevicePath \"\"" Mar 16 17:06:46 crc kubenswrapper[5120]: I0316 17:06:46.970936 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ab5e26e4-ccf7-4dc1-a4d7-4687023dd74c-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:06:46 crc kubenswrapper[5120]: I0316 17:06:46.970947 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ab5e26e4-ccf7-4dc1-a4d7-4687023dd74c-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:06:47 crc kubenswrapper[5120]: I0316 17:06:47.137716 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"16295648-8a78-488d-b66b-e0e2814a7d77","Type":"ContainerStarted","Data":"75830ab3669bb566bebc4bb46a4fb471003fbf76c0ac18fdf52db156b50bff15"} Mar 16 17:06:47 crc kubenswrapper[5120]: I0316 17:06:47.138063 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"16295648-8a78-488d-b66b-e0e2814a7d77","Type":"ContainerStarted","Data":"047b4667eae6883af1117ae7b2ea59f81318426233af3cc46e1c4d58f70c24a1"} Mar 16 17:06:47 crc kubenswrapper[5120]: I0316 17:06:47.138078 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"16295648-8a78-488d-b66b-e0e2814a7d77","Type":"ContainerStarted","Data":"e1388ac1aea12f43ae9f3aaf3064b5b37330e25dbc403b492d278b4b291fcae9"} Mar 16 17:06:47 crc kubenswrapper[5120]: I0316 17:06:47.144387 5120 generic.go:358] "Generic (PLEG): container finished" podID="ab5e26e4-ccf7-4dc1-a4d7-4687023dd74c" containerID="655356dce435a2e2be1abb74154a1de57661f5d1cd984036e19e9e9607990d79" exitCode=0 Mar 16 17:06:47 crc kubenswrapper[5120]: I0316 17:06:47.144624 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"ab5e26e4-ccf7-4dc1-a4d7-4687023dd74c","Type":"ContainerDied","Data":"655356dce435a2e2be1abb74154a1de57661f5d1cd984036e19e9e9607990d79"} Mar 16 17:06:47 crc kubenswrapper[5120]: I0316 17:06:47.144983 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"ab5e26e4-ccf7-4dc1-a4d7-4687023dd74c","Type":"ContainerDied","Data":"d208a3a5f082e204ffac19251894beb93fed78b48cb0c21bd9c4ee9980ed6c3a"} Mar 16 17:06:47 crc kubenswrapper[5120]: I0316 17:06:47.145008 5120 scope.go:117] "RemoveContainer" containerID="655356dce435a2e2be1abb74154a1de57661f5d1cd984036e19e9e9607990d79" Mar 16 17:06:47 crc kubenswrapper[5120]: I0316 17:06:47.144658 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:06:47 crc kubenswrapper[5120]: I0316 17:06:47.156122 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"3c799dfa-c6ab-4e66-9c61-63c1833ee6d4","Type":"ContainerStarted","Data":"df1d8bd581c157876ea9c8788eebf9a396e17c4e8a0235dee7e03ca140c9194a"} Mar 16 17:06:47 crc kubenswrapper[5120]: I0316 17:06:47.156167 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"3c799dfa-c6ab-4e66-9c61-63c1833ee6d4","Type":"ContainerStarted","Data":"692094eaa0160d44e37f8f4462155332d5a4b47e315e08a4ddbdd5c9c9c1aeb4"} Mar 16 17:06:47 crc kubenswrapper[5120]: I0316 17:06:47.156179 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"3c799dfa-c6ab-4e66-9c61-63c1833ee6d4","Type":"ContainerStarted","Data":"ab9a21b359458da1619cc034ca0c89734622ea373746f210144091e5da3d4ec2"} Mar 16 17:06:47 crc kubenswrapper[5120]: I0316 17:06:47.163510 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:06:47 crc kubenswrapper[5120]: I0316 17:06:47.163496 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"194d643a-a5df-47e5-a784-033ce596809e","Type":"ContainerDied","Data":"9dd4b9b5768752960674b8e1e44307e8549b7639c9c786831c17afb374408a20"} Mar 16 17:06:47 crc kubenswrapper[5120]: I0316 17:06:47.165717 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=2.165700745 podStartE2EDuration="2.165700745s" podCreationTimestamp="2026-03-16 17:06:45 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:06:47.159203006 +0000 UTC m=+5709.313134683" watchObservedRunningTime="2026-03-16 17:06:47.165700745 +0000 UTC m=+5709.319632402" Mar 16 17:06:47 crc kubenswrapper[5120]: I0316 17:06:47.179834 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-v822j_ac55471d-4e42-475f-a082-50f611571482/kube-multus/0.log" Mar 16 17:06:47 crc kubenswrapper[5120]: I0316 17:06:47.185328 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-crc_9f0bc7fcb0822a2c13eb2d22cd8c0641/kube-controller-manager/0.log" Mar 16 17:06:47 crc kubenswrapper[5120]: I0316 17:06:47.191016 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=2.190991214 podStartE2EDuration="2.190991214s" podCreationTimestamp="2026-03-16 17:06:45 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:06:47.187344163 +0000 UTC m=+5709.341275820" watchObservedRunningTime="2026-03-16 17:06:47.190991214 +0000 UTC m=+5709.344922871" Mar 16 17:06:47 crc kubenswrapper[5120]: I0316 17:06:47.203530 5120 scope.go:117] "RemoveContainer" containerID="655356dce435a2e2be1abb74154a1de57661f5d1cd984036e19e9e9607990d79" Mar 16 17:06:47 crc kubenswrapper[5120]: E0316 17:06:47.212390 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"655356dce435a2e2be1abb74154a1de57661f5d1cd984036e19e9e9607990d79\": container with ID starting with 655356dce435a2e2be1abb74154a1de57661f5d1cd984036e19e9e9607990d79 not found: ID does not exist" containerID="655356dce435a2e2be1abb74154a1de57661f5d1cd984036e19e9e9607990d79" Mar 16 17:06:47 crc kubenswrapper[5120]: I0316 17:06:47.212436 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"655356dce435a2e2be1abb74154a1de57661f5d1cd984036e19e9e9607990d79"} err="failed to get container status \"655356dce435a2e2be1abb74154a1de57661f5d1cd984036e19e9e9607990d79\": rpc error: code = NotFound desc = could not find container \"655356dce435a2e2be1abb74154a1de57661f5d1cd984036e19e9e9607990d79\": container with ID starting with 655356dce435a2e2be1abb74154a1de57661f5d1cd984036e19e9e9607990d79 not found: ID does not exist" Mar 16 17:06:47 crc kubenswrapper[5120]: I0316 17:06:47.212461 5120 scope.go:117] "RemoveContainer" containerID="93648515609f108a56c2bda326b39d41ec58faa1e5500425d82c0664febb6508" Mar 16 17:06:47 crc kubenswrapper[5120]: I0316 17:06:47.237717 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 17:06:47 crc kubenswrapper[5120]: I0316 17:06:47.269316 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 17:06:47 crc kubenswrapper[5120]: I0316 17:06:47.275890 5120 scope.go:117] "RemoveContainer" containerID="cc9a8cdc43460a02454df2b447222ac753a835e25b4678c7eac4ef94e84005c5" Mar 16 17:06:47 crc kubenswrapper[5120]: I0316 17:06:47.290823 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:06:47 crc kubenswrapper[5120]: I0316 17:06:47.298670 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:06:47 crc kubenswrapper[5120]: I0316 17:06:47.303434 5120 scope.go:117] "RemoveContainer" containerID="dd1479fa3ec45e1bd78229508bb4d71140d5aaed1abfa331b1be4fa2ca4a7ed1" Mar 16 17:06:47 crc kubenswrapper[5120]: I0316 17:06:47.311672 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 17:06:47 crc kubenswrapper[5120]: I0316 17:06:47.313392 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="194d643a-a5df-47e5-a784-033ce596809e" containerName="ceilometer-notification-agent" Mar 16 17:06:47 crc kubenswrapper[5120]: I0316 17:06:47.313421 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="194d643a-a5df-47e5-a784-033ce596809e" containerName="ceilometer-notification-agent" Mar 16 17:06:47 crc kubenswrapper[5120]: I0316 17:06:47.313442 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="194d643a-a5df-47e5-a784-033ce596809e" containerName="ceilometer-central-agent" Mar 16 17:06:47 crc kubenswrapper[5120]: I0316 17:06:47.313451 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="194d643a-a5df-47e5-a784-033ce596809e" containerName="ceilometer-central-agent" Mar 16 17:06:47 crc kubenswrapper[5120]: I0316 17:06:47.313506 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="194d643a-a5df-47e5-a784-033ce596809e" containerName="sg-core" Mar 16 17:06:47 crc kubenswrapper[5120]: I0316 17:06:47.313514 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="194d643a-a5df-47e5-a784-033ce596809e" containerName="sg-core" Mar 16 17:06:47 crc kubenswrapper[5120]: I0316 17:06:47.313527 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="194d643a-a5df-47e5-a784-033ce596809e" containerName="proxy-httpd" Mar 16 17:06:47 crc kubenswrapper[5120]: I0316 17:06:47.313535 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="194d643a-a5df-47e5-a784-033ce596809e" containerName="proxy-httpd" Mar 16 17:06:47 crc kubenswrapper[5120]: I0316 17:06:47.313568 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab5e26e4-ccf7-4dc1-a4d7-4687023dd74c" containerName="nova-scheduler-scheduler" Mar 16 17:06:47 crc kubenswrapper[5120]: I0316 17:06:47.313576 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab5e26e4-ccf7-4dc1-a4d7-4687023dd74c" containerName="nova-scheduler-scheduler" Mar 16 17:06:47 crc kubenswrapper[5120]: I0316 17:06:47.313825 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="194d643a-a5df-47e5-a784-033ce596809e" containerName="sg-core" Mar 16 17:06:47 crc kubenswrapper[5120]: I0316 17:06:47.313852 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="194d643a-a5df-47e5-a784-033ce596809e" containerName="ceilometer-notification-agent" Mar 16 17:06:47 crc kubenswrapper[5120]: I0316 17:06:47.313867 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ab5e26e4-ccf7-4dc1-a4d7-4687023dd74c" containerName="nova-scheduler-scheduler" Mar 16 17:06:47 crc kubenswrapper[5120]: I0316 17:06:47.313881 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="194d643a-a5df-47e5-a784-033ce596809e" containerName="ceilometer-central-agent" Mar 16 17:06:47 crc kubenswrapper[5120]: I0316 17:06:47.313899 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="194d643a-a5df-47e5-a784-033ce596809e" containerName="proxy-httpd" Mar 16 17:06:47 crc kubenswrapper[5120]: I0316 17:06:47.322355 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:06:47 crc kubenswrapper[5120]: I0316 17:06:47.323359 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:06:47 crc kubenswrapper[5120]: I0316 17:06:47.325674 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-scheduler-config-data\"" Mar 16 17:06:47 crc kubenswrapper[5120]: I0316 17:06:47.333623 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 17:06:47 crc kubenswrapper[5120]: I0316 17:06:47.333843 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:06:47 crc kubenswrapper[5120]: I0316 17:06:47.336894 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 17:06:47 crc kubenswrapper[5120]: I0316 17:06:47.337238 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ceilometer-internal-svc\"" Mar 16 17:06:47 crc kubenswrapper[5120]: I0316 17:06:47.337457 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 17:06:47 crc kubenswrapper[5120]: I0316 17:06:47.337470 5120 scope.go:117] "RemoveContainer" containerID="88a8e8261bde1f1f9445d5410d4b6633d98a1011efa62d11e1974fc3853830da" Mar 16 17:06:47 crc kubenswrapper[5120]: I0316 17:06:47.342151 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:06:47 crc kubenswrapper[5120]: I0316 17:06:47.396625 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/92843a01-448b-4ffb-a5c5-e957cffdbe9d-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"92843a01-448b-4ffb-a5c5-e957cffdbe9d\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:06:47 crc kubenswrapper[5120]: I0316 17:06:47.396931 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/07fab23c-ba13-4edc-921f-5ff095397928-log-httpd\") pod \"ceilometer-0\" (UID: \"07fab23c-ba13-4edc-921f-5ff095397928\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:06:47 crc kubenswrapper[5120]: I0316 17:06:47.397142 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/07fab23c-ba13-4edc-921f-5ff095397928-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"07fab23c-ba13-4edc-921f-5ff095397928\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:06:47 crc kubenswrapper[5120]: I0316 17:06:47.397384 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m46sl\" (UniqueName: \"kubernetes.io/projected/92843a01-448b-4ffb-a5c5-e957cffdbe9d-kube-api-access-m46sl\") pod \"nova-scheduler-0\" (UID: \"92843a01-448b-4ffb-a5c5-e957cffdbe9d\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:06:47 crc kubenswrapper[5120]: I0316 17:06:47.397563 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/07fab23c-ba13-4edc-921f-5ff095397928-run-httpd\") pod \"ceilometer-0\" (UID: \"07fab23c-ba13-4edc-921f-5ff095397928\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:06:47 crc kubenswrapper[5120]: I0316 17:06:47.397842 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/07fab23c-ba13-4edc-921f-5ff095397928-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"07fab23c-ba13-4edc-921f-5ff095397928\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:06:47 crc kubenswrapper[5120]: I0316 17:06:47.398103 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbgvx\" (UniqueName: \"kubernetes.io/projected/07fab23c-ba13-4edc-921f-5ff095397928-kube-api-access-vbgvx\") pod \"ceilometer-0\" (UID: \"07fab23c-ba13-4edc-921f-5ff095397928\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:06:47 crc kubenswrapper[5120]: I0316 17:06:47.398278 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/07fab23c-ba13-4edc-921f-5ff095397928-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"07fab23c-ba13-4edc-921f-5ff095397928\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:06:47 crc kubenswrapper[5120]: I0316 17:06:47.398401 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/07fab23c-ba13-4edc-921f-5ff095397928-config-data\") pod \"ceilometer-0\" (UID: \"07fab23c-ba13-4edc-921f-5ff095397928\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:06:47 crc kubenswrapper[5120]: I0316 17:06:47.399373 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/07fab23c-ba13-4edc-921f-5ff095397928-scripts\") pod \"ceilometer-0\" (UID: \"07fab23c-ba13-4edc-921f-5ff095397928\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:06:47 crc kubenswrapper[5120]: I0316 17:06:47.399654 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/92843a01-448b-4ffb-a5c5-e957cffdbe9d-config-data\") pod \"nova-scheduler-0\" (UID: \"92843a01-448b-4ffb-a5c5-e957cffdbe9d\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:06:47 crc kubenswrapper[5120]: I0316 17:06:47.501964 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vbgvx\" (UniqueName: \"kubernetes.io/projected/07fab23c-ba13-4edc-921f-5ff095397928-kube-api-access-vbgvx\") pod \"ceilometer-0\" (UID: \"07fab23c-ba13-4edc-921f-5ff095397928\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:06:47 crc kubenswrapper[5120]: I0316 17:06:47.502302 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/07fab23c-ba13-4edc-921f-5ff095397928-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"07fab23c-ba13-4edc-921f-5ff095397928\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:06:47 crc kubenswrapper[5120]: I0316 17:06:47.502411 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/07fab23c-ba13-4edc-921f-5ff095397928-config-data\") pod \"ceilometer-0\" (UID: \"07fab23c-ba13-4edc-921f-5ff095397928\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:06:47 crc kubenswrapper[5120]: I0316 17:06:47.502506 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/07fab23c-ba13-4edc-921f-5ff095397928-scripts\") pod \"ceilometer-0\" (UID: \"07fab23c-ba13-4edc-921f-5ff095397928\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:06:47 crc kubenswrapper[5120]: I0316 17:06:47.503141 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/92843a01-448b-4ffb-a5c5-e957cffdbe9d-config-data\") pod \"nova-scheduler-0\" (UID: \"92843a01-448b-4ffb-a5c5-e957cffdbe9d\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:06:47 crc kubenswrapper[5120]: I0316 17:06:47.503264 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/92843a01-448b-4ffb-a5c5-e957cffdbe9d-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"92843a01-448b-4ffb-a5c5-e957cffdbe9d\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:06:47 crc kubenswrapper[5120]: I0316 17:06:47.503345 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/07fab23c-ba13-4edc-921f-5ff095397928-log-httpd\") pod \"ceilometer-0\" (UID: \"07fab23c-ba13-4edc-921f-5ff095397928\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:06:47 crc kubenswrapper[5120]: I0316 17:06:47.503546 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/07fab23c-ba13-4edc-921f-5ff095397928-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"07fab23c-ba13-4edc-921f-5ff095397928\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:06:47 crc kubenswrapper[5120]: I0316 17:06:47.503696 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m46sl\" (UniqueName: \"kubernetes.io/projected/92843a01-448b-4ffb-a5c5-e957cffdbe9d-kube-api-access-m46sl\") pod \"nova-scheduler-0\" (UID: \"92843a01-448b-4ffb-a5c5-e957cffdbe9d\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:06:47 crc kubenswrapper[5120]: I0316 17:06:47.503791 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/07fab23c-ba13-4edc-921f-5ff095397928-run-httpd\") pod \"ceilometer-0\" (UID: \"07fab23c-ba13-4edc-921f-5ff095397928\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:06:47 crc kubenswrapper[5120]: I0316 17:06:47.504022 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/07fab23c-ba13-4edc-921f-5ff095397928-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"07fab23c-ba13-4edc-921f-5ff095397928\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:06:47 crc kubenswrapper[5120]: I0316 17:06:47.505474 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/07fab23c-ba13-4edc-921f-5ff095397928-log-httpd\") pod \"ceilometer-0\" (UID: \"07fab23c-ba13-4edc-921f-5ff095397928\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:06:47 crc kubenswrapper[5120]: I0316 17:06:47.508369 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/07fab23c-ba13-4edc-921f-5ff095397928-scripts\") pod \"ceilometer-0\" (UID: \"07fab23c-ba13-4edc-921f-5ff095397928\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:06:47 crc kubenswrapper[5120]: I0316 17:06:47.509381 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/07fab23c-ba13-4edc-921f-5ff095397928-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"07fab23c-ba13-4edc-921f-5ff095397928\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:06:47 crc kubenswrapper[5120]: I0316 17:06:47.509719 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/07fab23c-ba13-4edc-921f-5ff095397928-run-httpd\") pod \"ceilometer-0\" (UID: \"07fab23c-ba13-4edc-921f-5ff095397928\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:06:47 crc kubenswrapper[5120]: I0316 17:06:47.510447 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/92843a01-448b-4ffb-a5c5-e957cffdbe9d-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"92843a01-448b-4ffb-a5c5-e957cffdbe9d\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:06:47 crc kubenswrapper[5120]: I0316 17:06:47.510651 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/07fab23c-ba13-4edc-921f-5ff095397928-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"07fab23c-ba13-4edc-921f-5ff095397928\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:06:47 crc kubenswrapper[5120]: I0316 17:06:47.511740 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/92843a01-448b-4ffb-a5c5-e957cffdbe9d-config-data\") pod \"nova-scheduler-0\" (UID: \"92843a01-448b-4ffb-a5c5-e957cffdbe9d\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:06:47 crc kubenswrapper[5120]: I0316 17:06:47.511746 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/07fab23c-ba13-4edc-921f-5ff095397928-config-data\") pod \"ceilometer-0\" (UID: \"07fab23c-ba13-4edc-921f-5ff095397928\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:06:47 crc kubenswrapper[5120]: I0316 17:06:47.526268 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/07fab23c-ba13-4edc-921f-5ff095397928-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"07fab23c-ba13-4edc-921f-5ff095397928\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:06:47 crc kubenswrapper[5120]: I0316 17:06:47.526410 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m46sl\" (UniqueName: \"kubernetes.io/projected/92843a01-448b-4ffb-a5c5-e957cffdbe9d-kube-api-access-m46sl\") pod \"nova-scheduler-0\" (UID: \"92843a01-448b-4ffb-a5c5-e957cffdbe9d\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:06:47 crc kubenswrapper[5120]: I0316 17:06:47.526522 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbgvx\" (UniqueName: \"kubernetes.io/projected/07fab23c-ba13-4edc-921f-5ff095397928-kube-api-access-vbgvx\") pod \"ceilometer-0\" (UID: \"07fab23c-ba13-4edc-921f-5ff095397928\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:06:47 crc kubenswrapper[5120]: I0316 17:06:47.659321 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:06:47 crc kubenswrapper[5120]: I0316 17:06:47.682384 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:06:48 crc kubenswrapper[5120]: I0316 17:06:48.134721 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 17:06:48 crc kubenswrapper[5120]: I0316 17:06:48.188974 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"92843a01-448b-4ffb-a5c5-e957cffdbe9d","Type":"ContainerStarted","Data":"c70e78e3b7c14e438e28740f2bce5da34d357ea62dbb3668e3a9a845b05cfbdb"} Mar 16 17:06:48 crc kubenswrapper[5120]: W0316 17:06:48.230490 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod07fab23c_ba13_4edc_921f_5ff095397928.slice/crio-47858aa7c9230c048405f0f734327ad5fd4b253d411b70af9680d87ca235495b WatchSource:0}: Error finding container 47858aa7c9230c048405f0f734327ad5fd4b253d411b70af9680d87ca235495b: Status 404 returned error can't find the container with id 47858aa7c9230c048405f0f734327ad5fd4b253d411b70af9680d87ca235495b Mar 16 17:06:48 crc kubenswrapper[5120]: I0316 17:06:48.230800 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:06:48 crc kubenswrapper[5120]: I0316 17:06:48.458406 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-operators-b4xn8"] Mar 16 17:06:48 crc kubenswrapper[5120]: I0316 17:06:48.467907 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-b4xn8" Mar 16 17:06:48 crc kubenswrapper[5120]: I0316 17:06:48.471921 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-b4xn8"] Mar 16 17:06:48 crc kubenswrapper[5120]: I0316 17:06:48.531326 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/39020bfa-624a-485d-8a2e-517cc5eb177d-utilities\") pod \"redhat-operators-b4xn8\" (UID: \"39020bfa-624a-485d-8a2e-517cc5eb177d\") " pod="openshift-marketplace/redhat-operators-b4xn8" Mar 16 17:06:48 crc kubenswrapper[5120]: I0316 17:06:48.531676 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qv5c2\" (UniqueName: \"kubernetes.io/projected/39020bfa-624a-485d-8a2e-517cc5eb177d-kube-api-access-qv5c2\") pod \"redhat-operators-b4xn8\" (UID: \"39020bfa-624a-485d-8a2e-517cc5eb177d\") " pod="openshift-marketplace/redhat-operators-b4xn8" Mar 16 17:06:48 crc kubenswrapper[5120]: I0316 17:06:48.531975 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/39020bfa-624a-485d-8a2e-517cc5eb177d-catalog-content\") pod \"redhat-operators-b4xn8\" (UID: \"39020bfa-624a-485d-8a2e-517cc5eb177d\") " pod="openshift-marketplace/redhat-operators-b4xn8" Mar 16 17:06:48 crc kubenswrapper[5120]: I0316 17:06:48.633830 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/39020bfa-624a-485d-8a2e-517cc5eb177d-catalog-content\") pod \"redhat-operators-b4xn8\" (UID: \"39020bfa-624a-485d-8a2e-517cc5eb177d\") " pod="openshift-marketplace/redhat-operators-b4xn8" Mar 16 17:06:48 crc kubenswrapper[5120]: I0316 17:06:48.634023 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/39020bfa-624a-485d-8a2e-517cc5eb177d-utilities\") pod \"redhat-operators-b4xn8\" (UID: \"39020bfa-624a-485d-8a2e-517cc5eb177d\") " pod="openshift-marketplace/redhat-operators-b4xn8" Mar 16 17:06:48 crc kubenswrapper[5120]: I0316 17:06:48.634184 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qv5c2\" (UniqueName: \"kubernetes.io/projected/39020bfa-624a-485d-8a2e-517cc5eb177d-kube-api-access-qv5c2\") pod \"redhat-operators-b4xn8\" (UID: \"39020bfa-624a-485d-8a2e-517cc5eb177d\") " pod="openshift-marketplace/redhat-operators-b4xn8" Mar 16 17:06:48 crc kubenswrapper[5120]: I0316 17:06:48.634402 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/39020bfa-624a-485d-8a2e-517cc5eb177d-catalog-content\") pod \"redhat-operators-b4xn8\" (UID: \"39020bfa-624a-485d-8a2e-517cc5eb177d\") " pod="openshift-marketplace/redhat-operators-b4xn8" Mar 16 17:06:48 crc kubenswrapper[5120]: I0316 17:06:48.634629 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/39020bfa-624a-485d-8a2e-517cc5eb177d-utilities\") pod \"redhat-operators-b4xn8\" (UID: \"39020bfa-624a-485d-8a2e-517cc5eb177d\") " pod="openshift-marketplace/redhat-operators-b4xn8" Mar 16 17:06:48 crc kubenswrapper[5120]: I0316 17:06:48.667609 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qv5c2\" (UniqueName: \"kubernetes.io/projected/39020bfa-624a-485d-8a2e-517cc5eb177d-kube-api-access-qv5c2\") pod \"redhat-operators-b4xn8\" (UID: \"39020bfa-624a-485d-8a2e-517cc5eb177d\") " pod="openshift-marketplace/redhat-operators-b4xn8" Mar 16 17:06:48 crc kubenswrapper[5120]: I0316 17:06:48.679081 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="194d643a-a5df-47e5-a784-033ce596809e" path="/var/lib/kubelet/pods/194d643a-a5df-47e5-a784-033ce596809e/volumes" Mar 16 17:06:48 crc kubenswrapper[5120]: I0316 17:06:48.679949 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ab5e26e4-ccf7-4dc1-a4d7-4687023dd74c" path="/var/lib/kubelet/pods/ab5e26e4-ccf7-4dc1-a4d7-4687023dd74c/volumes" Mar 16 17:06:48 crc kubenswrapper[5120]: I0316 17:06:48.793919 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-b4xn8" Mar 16 17:06:49 crc kubenswrapper[5120]: I0316 17:06:49.204927 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"92843a01-448b-4ffb-a5c5-e957cffdbe9d","Type":"ContainerStarted","Data":"b47e7c1b23ad6f3592049f3d03c7a6148ba1ef5e062c395491f8a4b3694fbd41"} Mar 16 17:06:49 crc kubenswrapper[5120]: I0316 17:06:49.208341 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"07fab23c-ba13-4edc-921f-5ff095397928","Type":"ContainerStarted","Data":"e34d91e2d5484e302cc10073074e0ef7ec543eff491fe1cbcbf4f3d986d59e07"} Mar 16 17:06:49 crc kubenswrapper[5120]: I0316 17:06:49.208370 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"07fab23c-ba13-4edc-921f-5ff095397928","Type":"ContainerStarted","Data":"47858aa7c9230c048405f0f734327ad5fd4b253d411b70af9680d87ca235495b"} Mar 16 17:06:49 crc kubenswrapper[5120]: I0316 17:06:49.222296 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-scheduler-0" podStartSLOduration=2.222276649 podStartE2EDuration="2.222276649s" podCreationTimestamp="2026-03-16 17:06:47 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:06:49.219369798 +0000 UTC m=+5711.373301445" watchObservedRunningTime="2026-03-16 17:06:49.222276649 +0000 UTC m=+5711.376208316" Mar 16 17:06:49 crc kubenswrapper[5120]: W0316 17:06:49.335569 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39020bfa_624a_485d_8a2e_517cc5eb177d.slice/crio-af49db86fd2add9fb29544d2c34a03085b3dde2f6dd65b0577f757904460a189 WatchSource:0}: Error finding container af49db86fd2add9fb29544d2c34a03085b3dde2f6dd65b0577f757904460a189: Status 404 returned error can't find the container with id af49db86fd2add9fb29544d2c34a03085b3dde2f6dd65b0577f757904460a189 Mar 16 17:06:49 crc kubenswrapper[5120]: I0316 17:06:49.336873 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-b4xn8"] Mar 16 17:06:49 crc kubenswrapper[5120]: I0316 17:06:49.460662 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:06:49 crc kubenswrapper[5120]: I0316 17:06:49.491415 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:06:50 crc kubenswrapper[5120]: I0316 17:06:50.115059 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 17:06:50 crc kubenswrapper[5120]: I0316 17:06:50.224517 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"07fab23c-ba13-4edc-921f-5ff095397928","Type":"ContainerStarted","Data":"d84133fa679de58c5a7b33b1aeed8e1e076bfe6cc56a12e2ac35621adf0da354"} Mar 16 17:06:50 crc kubenswrapper[5120]: I0316 17:06:50.226902 5120 generic.go:358] "Generic (PLEG): container finished" podID="39020bfa-624a-485d-8a2e-517cc5eb177d" containerID="8ebfab740169f08d1b7ee76bca0cf692dc803a4e4b2632bc32bcf45c6713ba00" exitCode=0 Mar 16 17:06:50 crc kubenswrapper[5120]: I0316 17:06:50.227016 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-b4xn8" event={"ID":"39020bfa-624a-485d-8a2e-517cc5eb177d","Type":"ContainerDied","Data":"8ebfab740169f08d1b7ee76bca0cf692dc803a4e4b2632bc32bcf45c6713ba00"} Mar 16 17:06:50 crc kubenswrapper[5120]: I0316 17:06:50.227093 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-b4xn8" event={"ID":"39020bfa-624a-485d-8a2e-517cc5eb177d","Type":"ContainerStarted","Data":"af49db86fd2add9fb29544d2c34a03085b3dde2f6dd65b0577f757904460a189"} Mar 16 17:06:50 crc kubenswrapper[5120]: I0316 17:06:50.258577 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:06:50 crc kubenswrapper[5120]: I0316 17:06:50.653581 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-z74x9"] Mar 16 17:06:50 crc kubenswrapper[5120]: I0316 17:06:50.663854 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-z74x9" Mar 16 17:06:50 crc kubenswrapper[5120]: I0316 17:06:50.673780 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-manage-config-data\"" Mar 16 17:06:50 crc kubenswrapper[5120]: I0316 17:06:50.673956 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-manage-scripts\"" Mar 16 17:06:50 crc kubenswrapper[5120]: I0316 17:06:50.679060 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-z74x9"] Mar 16 17:06:50 crc kubenswrapper[5120]: I0316 17:06:50.805023 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d09005bc-6e0f-4946-848c-ca47f6ad1401-config-data\") pod \"nova-cell1-cell-mapping-z74x9\" (UID: \"d09005bc-6e0f-4946-848c-ca47f6ad1401\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-z74x9" Mar 16 17:06:50 crc kubenswrapper[5120]: I0316 17:06:50.805242 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxdtf\" (UniqueName: \"kubernetes.io/projected/d09005bc-6e0f-4946-848c-ca47f6ad1401-kube-api-access-bxdtf\") pod \"nova-cell1-cell-mapping-z74x9\" (UID: \"d09005bc-6e0f-4946-848c-ca47f6ad1401\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-z74x9" Mar 16 17:06:50 crc kubenswrapper[5120]: I0316 17:06:50.805281 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d09005bc-6e0f-4946-848c-ca47f6ad1401-combined-ca-bundle\") pod \"nova-cell1-cell-mapping-z74x9\" (UID: \"d09005bc-6e0f-4946-848c-ca47f6ad1401\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-z74x9" Mar 16 17:06:50 crc kubenswrapper[5120]: I0316 17:06:50.805302 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d09005bc-6e0f-4946-848c-ca47f6ad1401-scripts\") pod \"nova-cell1-cell-mapping-z74x9\" (UID: \"d09005bc-6e0f-4946-848c-ca47f6ad1401\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-z74x9" Mar 16 17:06:50 crc kubenswrapper[5120]: I0316 17:06:50.907515 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d09005bc-6e0f-4946-848c-ca47f6ad1401-config-data\") pod \"nova-cell1-cell-mapping-z74x9\" (UID: \"d09005bc-6e0f-4946-848c-ca47f6ad1401\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-z74x9" Mar 16 17:06:50 crc kubenswrapper[5120]: I0316 17:06:50.907689 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bxdtf\" (UniqueName: \"kubernetes.io/projected/d09005bc-6e0f-4946-848c-ca47f6ad1401-kube-api-access-bxdtf\") pod \"nova-cell1-cell-mapping-z74x9\" (UID: \"d09005bc-6e0f-4946-848c-ca47f6ad1401\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-z74x9" Mar 16 17:06:50 crc kubenswrapper[5120]: I0316 17:06:50.907732 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d09005bc-6e0f-4946-848c-ca47f6ad1401-combined-ca-bundle\") pod \"nova-cell1-cell-mapping-z74x9\" (UID: \"d09005bc-6e0f-4946-848c-ca47f6ad1401\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-z74x9" Mar 16 17:06:50 crc kubenswrapper[5120]: I0316 17:06:50.907774 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d09005bc-6e0f-4946-848c-ca47f6ad1401-scripts\") pod \"nova-cell1-cell-mapping-z74x9\" (UID: \"d09005bc-6e0f-4946-848c-ca47f6ad1401\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-z74x9" Mar 16 17:06:50 crc kubenswrapper[5120]: I0316 17:06:50.914743 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d09005bc-6e0f-4946-848c-ca47f6ad1401-scripts\") pod \"nova-cell1-cell-mapping-z74x9\" (UID: \"d09005bc-6e0f-4946-848c-ca47f6ad1401\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-z74x9" Mar 16 17:06:50 crc kubenswrapper[5120]: I0316 17:06:50.915284 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d09005bc-6e0f-4946-848c-ca47f6ad1401-combined-ca-bundle\") pod \"nova-cell1-cell-mapping-z74x9\" (UID: \"d09005bc-6e0f-4946-848c-ca47f6ad1401\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-z74x9" Mar 16 17:06:50 crc kubenswrapper[5120]: I0316 17:06:50.915622 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d09005bc-6e0f-4946-848c-ca47f6ad1401-config-data\") pod \"nova-cell1-cell-mapping-z74x9\" (UID: \"d09005bc-6e0f-4946-848c-ca47f6ad1401\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-z74x9" Mar 16 17:06:50 crc kubenswrapper[5120]: I0316 17:06:50.930241 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxdtf\" (UniqueName: \"kubernetes.io/projected/d09005bc-6e0f-4946-848c-ca47f6ad1401-kube-api-access-bxdtf\") pod \"nova-cell1-cell-mapping-z74x9\" (UID: \"d09005bc-6e0f-4946-848c-ca47f6ad1401\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-z74x9" Mar 16 17:06:50 crc kubenswrapper[5120]: I0316 17:06:50.986435 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-z74x9" Mar 16 17:06:51 crc kubenswrapper[5120]: I0316 17:06:51.260131 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"07fab23c-ba13-4edc-921f-5ff095397928","Type":"ContainerStarted","Data":"af4a1813b5822ec6224caaea7e89b284ea1457e530a20e6f28f622a0c49d2c13"} Mar 16 17:06:51 crc kubenswrapper[5120]: I0316 17:06:51.476862 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-z74x9"] Mar 16 17:06:52 crc kubenswrapper[5120]: I0316 17:06:52.274536 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-b4xn8" event={"ID":"39020bfa-624a-485d-8a2e-517cc5eb177d","Type":"ContainerStarted","Data":"85ee15482b056adbd83dd925ddc9fa0a9ff75e1295abc7d6a85bf334963afd7b"} Mar 16 17:06:52 crc kubenswrapper[5120]: I0316 17:06:52.276922 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-z74x9" event={"ID":"d09005bc-6e0f-4946-848c-ca47f6ad1401","Type":"ContainerStarted","Data":"ce83778e363bf737ec9123e9b6f6ab14c486b01e00aa784b7adccb3e06348981"} Mar 16 17:06:52 crc kubenswrapper[5120]: I0316 17:06:52.276959 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-z74x9" event={"ID":"d09005bc-6e0f-4946-848c-ca47f6ad1401","Type":"ContainerStarted","Data":"6b528b69ccb4ca9e857a95d73314a4dff5f332f992970ff54fc6cdf8a86a4217"} Mar 16 17:06:52 crc kubenswrapper[5120]: I0316 17:06:52.332644 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-z74x9" podStartSLOduration=2.332625262 podStartE2EDuration="2.332625262s" podCreationTimestamp="2026-03-16 17:06:50 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:06:52.324854137 +0000 UTC m=+5714.478785814" watchObservedRunningTime="2026-03-16 17:06:52.332625262 +0000 UTC m=+5714.486556919" Mar 16 17:06:52 crc kubenswrapper[5120]: I0316 17:06:52.659975 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:06:53 crc kubenswrapper[5120]: E0316 17:06:53.778583 5120 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfc772fff_eba2_4aa4_85ff_40057e068148.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfc772fff_eba2_4aa4_85ff_40057e068148.slice/crio-e9e927aa88712ffcef7dbe6a7389f1734f487859737adb662ad3224b816a100f\": RecentStats: unable to find data in memory cache]" Mar 16 17:06:54 crc kubenswrapper[5120]: I0316 17:06:54.307019 5120 generic.go:358] "Generic (PLEG): container finished" podID="39020bfa-624a-485d-8a2e-517cc5eb177d" containerID="85ee15482b056adbd83dd925ddc9fa0a9ff75e1295abc7d6a85bf334963afd7b" exitCode=0 Mar 16 17:06:54 crc kubenswrapper[5120]: I0316 17:06:54.307086 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-b4xn8" event={"ID":"39020bfa-624a-485d-8a2e-517cc5eb177d","Type":"ContainerDied","Data":"85ee15482b056adbd83dd925ddc9fa0a9ff75e1295abc7d6a85bf334963afd7b"} Mar 16 17:06:55 crc kubenswrapper[5120]: I0316 17:06:55.319046 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-b4xn8" event={"ID":"39020bfa-624a-485d-8a2e-517cc5eb177d","Type":"ContainerStarted","Data":"4c7f90e1bb342605fe70c4f36aada52f6d8f6ab5a5c85927d3db452a7f186fe3"} Mar 16 17:06:55 crc kubenswrapper[5120]: I0316 17:06:55.344884 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/redhat-operators-b4xn8" podStartSLOduration=5.940186852 podStartE2EDuration="7.344865536s" podCreationTimestamp="2026-03-16 17:06:48 +0000 UTC" firstStartedPulling="2026-03-16 17:06:50.227668343 +0000 UTC m=+5712.381600000" lastFinishedPulling="2026-03-16 17:06:51.632347027 +0000 UTC m=+5713.786278684" observedRunningTime="2026-03-16 17:06:55.338559752 +0000 UTC m=+5717.492491409" watchObservedRunningTime="2026-03-16 17:06:55.344865536 +0000 UTC m=+5717.498797183" Mar 16 17:06:55 crc kubenswrapper[5120]: I0316 17:06:55.674274 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:06:55 crc kubenswrapper[5120]: I0316 17:06:55.675823 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:06:55 crc kubenswrapper[5120]: I0316 17:06:55.689798 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:06:55 crc kubenswrapper[5120]: I0316 17:06:55.689847 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:06:56 crc kubenswrapper[5120]: I0316 17:06:56.681984 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="3c799dfa-c6ab-4e66-9c61-63c1833ee6d4" containerName="nova-metadata-log" probeResult="failure" output="Get \"https://10.217.1.216:8775/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Mar 16 17:06:56 crc kubenswrapper[5120]: I0316 17:06:56.684892 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="3c799dfa-c6ab-4e66-9c61-63c1833ee6d4" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"https://10.217.1.216:8775/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 17:06:56 crc kubenswrapper[5120]: I0316 17:06:56.731014 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="16295648-8a78-488d-b66b-e0e2814a7d77" containerName="nova-api-log" probeResult="failure" output="Get \"http://10.217.1.217:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 17:06:56 crc kubenswrapper[5120]: I0316 17:06:56.731692 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="16295648-8a78-488d-b66b-e0e2814a7d77" containerName="nova-api-api" probeResult="failure" output="Get \"http://10.217.1.217:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 17:06:57 crc kubenswrapper[5120]: I0316 17:06:57.174439 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 17:06:57 crc kubenswrapper[5120]: I0316 17:06:57.344941 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"07fab23c-ba13-4edc-921f-5ff095397928","Type":"ContainerStarted","Data":"328a75582227369a883c8f5a2f34d630d36c4531260c450848de3af0734abc19"} Mar 16 17:06:57 crc kubenswrapper[5120]: I0316 17:06:57.345109 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:06:57 crc kubenswrapper[5120]: I0316 17:06:57.347731 5120 generic.go:358] "Generic (PLEG): container finished" podID="d09005bc-6e0f-4946-848c-ca47f6ad1401" containerID="ce83778e363bf737ec9123e9b6f6ab14c486b01e00aa784b7adccb3e06348981" exitCode=0 Mar 16 17:06:57 crc kubenswrapper[5120]: I0316 17:06:57.347811 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-z74x9" event={"ID":"d09005bc-6e0f-4946-848c-ca47f6ad1401","Type":"ContainerDied","Data":"ce83778e363bf737ec9123e9b6f6ab14c486b01e00aa784b7adccb3e06348981"} Mar 16 17:06:57 crc kubenswrapper[5120]: I0316 17:06:57.370526 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=1.966881673 podStartE2EDuration="10.370510715s" podCreationTimestamp="2026-03-16 17:06:47 +0000 UTC" firstStartedPulling="2026-03-16 17:06:48.232588998 +0000 UTC m=+5710.386520655" lastFinishedPulling="2026-03-16 17:06:56.63621804 +0000 UTC m=+5718.790149697" observedRunningTime="2026-03-16 17:06:57.365129236 +0000 UTC m=+5719.519060893" watchObservedRunningTime="2026-03-16 17:06:57.370510715 +0000 UTC m=+5719.524442372" Mar 16 17:06:57 crc kubenswrapper[5120]: I0316 17:06:57.659533 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:06:57 crc kubenswrapper[5120]: I0316 17:06:57.694297 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:06:58 crc kubenswrapper[5120]: I0316 17:06:58.422847 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:06:58 crc kubenswrapper[5120]: I0316 17:06:58.794830 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-marketplace/redhat-operators-b4xn8" Mar 16 17:06:58 crc kubenswrapper[5120]: I0316 17:06:58.795641 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-operators-b4xn8" Mar 16 17:06:58 crc kubenswrapper[5120]: I0316 17:06:58.823024 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-z74x9" Mar 16 17:06:58 crc kubenswrapper[5120]: I0316 17:06:58.858505 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d09005bc-6e0f-4946-848c-ca47f6ad1401-combined-ca-bundle\") pod \"d09005bc-6e0f-4946-848c-ca47f6ad1401\" (UID: \"d09005bc-6e0f-4946-848c-ca47f6ad1401\") " Mar 16 17:06:58 crc kubenswrapper[5120]: I0316 17:06:58.858923 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d09005bc-6e0f-4946-848c-ca47f6ad1401-scripts\") pod \"d09005bc-6e0f-4946-848c-ca47f6ad1401\" (UID: \"d09005bc-6e0f-4946-848c-ca47f6ad1401\") " Mar 16 17:06:58 crc kubenswrapper[5120]: I0316 17:06:58.859147 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d09005bc-6e0f-4946-848c-ca47f6ad1401-config-data\") pod \"d09005bc-6e0f-4946-848c-ca47f6ad1401\" (UID: \"d09005bc-6e0f-4946-848c-ca47f6ad1401\") " Mar 16 17:06:58 crc kubenswrapper[5120]: I0316 17:06:58.859171 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bxdtf\" (UniqueName: \"kubernetes.io/projected/d09005bc-6e0f-4946-848c-ca47f6ad1401-kube-api-access-bxdtf\") pod \"d09005bc-6e0f-4946-848c-ca47f6ad1401\" (UID: \"d09005bc-6e0f-4946-848c-ca47f6ad1401\") " Mar 16 17:06:58 crc kubenswrapper[5120]: I0316 17:06:58.884599 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d09005bc-6e0f-4946-848c-ca47f6ad1401-kube-api-access-bxdtf" (OuterVolumeSpecName: "kube-api-access-bxdtf") pod "d09005bc-6e0f-4946-848c-ca47f6ad1401" (UID: "d09005bc-6e0f-4946-848c-ca47f6ad1401"). InnerVolumeSpecName "kube-api-access-bxdtf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:06:58 crc kubenswrapper[5120]: I0316 17:06:58.887257 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d09005bc-6e0f-4946-848c-ca47f6ad1401-scripts" (OuterVolumeSpecName: "scripts") pod "d09005bc-6e0f-4946-848c-ca47f6ad1401" (UID: "d09005bc-6e0f-4946-848c-ca47f6ad1401"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:06:58 crc kubenswrapper[5120]: I0316 17:06:58.899342 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d09005bc-6e0f-4946-848c-ca47f6ad1401-config-data" (OuterVolumeSpecName: "config-data") pod "d09005bc-6e0f-4946-848c-ca47f6ad1401" (UID: "d09005bc-6e0f-4946-848c-ca47f6ad1401"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:06:58 crc kubenswrapper[5120]: I0316 17:06:58.921350 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d09005bc-6e0f-4946-848c-ca47f6ad1401-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "d09005bc-6e0f-4946-848c-ca47f6ad1401" (UID: "d09005bc-6e0f-4946-848c-ca47f6ad1401"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:06:58 crc kubenswrapper[5120]: I0316 17:06:58.962817 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d09005bc-6e0f-4946-848c-ca47f6ad1401-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:06:58 crc kubenswrapper[5120]: I0316 17:06:58.962865 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d09005bc-6e0f-4946-848c-ca47f6ad1401-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:06:58 crc kubenswrapper[5120]: I0316 17:06:58.962878 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d09005bc-6e0f-4946-848c-ca47f6ad1401-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:06:58 crc kubenswrapper[5120]: I0316 17:06:58.962891 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bxdtf\" (UniqueName: \"kubernetes.io/projected/d09005bc-6e0f-4946-848c-ca47f6ad1401-kube-api-access-bxdtf\") on node \"crc\" DevicePath \"\"" Mar 16 17:06:59 crc kubenswrapper[5120]: I0316 17:06:59.369973 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-z74x9" Mar 16 17:06:59 crc kubenswrapper[5120]: I0316 17:06:59.370038 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-z74x9" event={"ID":"d09005bc-6e0f-4946-848c-ca47f6ad1401","Type":"ContainerDied","Data":"6b528b69ccb4ca9e857a95d73314a4dff5f332f992970ff54fc6cdf8a86a4217"} Mar 16 17:06:59 crc kubenswrapper[5120]: I0316 17:06:59.370150 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6b528b69ccb4ca9e857a95d73314a4dff5f332f992970ff54fc6cdf8a86a4217" Mar 16 17:06:59 crc kubenswrapper[5120]: I0316 17:06:59.589879 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 17:06:59 crc kubenswrapper[5120]: I0316 17:06:59.590183 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="16295648-8a78-488d-b66b-e0e2814a7d77" containerName="nova-api-log" containerID="cri-o://047b4667eae6883af1117ae7b2ea59f81318426233af3cc46e1c4d58f70c24a1" gracePeriod=30 Mar 16 17:06:59 crc kubenswrapper[5120]: I0316 17:06:59.590335 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="16295648-8a78-488d-b66b-e0e2814a7d77" containerName="nova-api-api" containerID="cri-o://75830ab3669bb566bebc4bb46a4fb471003fbf76c0ac18fdf52db156b50bff15" gracePeriod=30 Mar 16 17:06:59 crc kubenswrapper[5120]: I0316 17:06:59.612046 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 17:06:59 crc kubenswrapper[5120]: I0316 17:06:59.628335 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 17:06:59 crc kubenswrapper[5120]: I0316 17:06:59.628616 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="3c799dfa-c6ab-4e66-9c61-63c1833ee6d4" containerName="nova-metadata-log" containerID="cri-o://692094eaa0160d44e37f8f4462155332d5a4b47e315e08a4ddbdd5c9c9c1aeb4" gracePeriod=30 Mar 16 17:06:59 crc kubenswrapper[5120]: I0316 17:06:59.628722 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="3c799dfa-c6ab-4e66-9c61-63c1833ee6d4" containerName="nova-metadata-metadata" containerID="cri-o://df1d8bd581c157876ea9c8788eebf9a396e17c4e8a0235dee7e03ca140c9194a" gracePeriod=30 Mar 16 17:06:59 crc kubenswrapper[5120]: I0316 17:06:59.853232 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-marketplace/redhat-operators-b4xn8" podUID="39020bfa-624a-485d-8a2e-517cc5eb177d" containerName="registry-server" probeResult="failure" output=< Mar 16 17:06:59 crc kubenswrapper[5120]: timeout: failed to connect service ":50051" within 1s Mar 16 17:06:59 crc kubenswrapper[5120]: > Mar 16 17:07:00 crc kubenswrapper[5120]: I0316 17:07:00.400746 5120 generic.go:358] "Generic (PLEG): container finished" podID="16295648-8a78-488d-b66b-e0e2814a7d77" containerID="047b4667eae6883af1117ae7b2ea59f81318426233af3cc46e1c4d58f70c24a1" exitCode=143 Mar 16 17:07:00 crc kubenswrapper[5120]: I0316 17:07:00.402274 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"16295648-8a78-488d-b66b-e0e2814a7d77","Type":"ContainerDied","Data":"047b4667eae6883af1117ae7b2ea59f81318426233af3cc46e1c4d58f70c24a1"} Mar 16 17:07:00 crc kubenswrapper[5120]: I0316 17:07:00.417575 5120 generic.go:358] "Generic (PLEG): container finished" podID="3c799dfa-c6ab-4e66-9c61-63c1833ee6d4" containerID="692094eaa0160d44e37f8f4462155332d5a4b47e315e08a4ddbdd5c9c9c1aeb4" exitCode=143 Mar 16 17:07:00 crc kubenswrapper[5120]: I0316 17:07:00.417642 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"3c799dfa-c6ab-4e66-9c61-63c1833ee6d4","Type":"ContainerDied","Data":"692094eaa0160d44e37f8f4462155332d5a4b47e315e08a4ddbdd5c9c9c1aeb4"} Mar 16 17:07:00 crc kubenswrapper[5120]: I0316 17:07:00.418384 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="92843a01-448b-4ffb-a5c5-e957cffdbe9d" containerName="nova-scheduler-scheduler" containerID="cri-o://b47e7c1b23ad6f3592049f3d03c7a6148ba1ef5e062c395491f8a4b3694fbd41" gracePeriod=30 Mar 16 17:07:01 crc kubenswrapper[5120]: I0316 17:07:01.663878 5120 scope.go:117] "RemoveContainer" containerID="db39d192fa687a13805537d08ad22fed1ef362ef5027c920a616297dc55a8ea9" Mar 16 17:07:01 crc kubenswrapper[5120]: E0316 17:07:01.664253 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 17:07:03 crc kubenswrapper[5120]: I0316 17:07:03.291349 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:07:03 crc kubenswrapper[5120]: I0316 17:07:03.302318 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:07:03 crc kubenswrapper[5120]: E0316 17:07:03.357910 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="b47e7c1b23ad6f3592049f3d03c7a6148ba1ef5e062c395491f8a4b3694fbd41" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 17:07:03 crc kubenswrapper[5120]: E0316 17:07:03.366724 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="b47e7c1b23ad6f3592049f3d03c7a6148ba1ef5e062c395491f8a4b3694fbd41" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 17:07:03 crc kubenswrapper[5120]: E0316 17:07:03.369740 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="b47e7c1b23ad6f3592049f3d03c7a6148ba1ef5e062c395491f8a4b3694fbd41" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 17:07:03 crc kubenswrapper[5120]: E0316 17:07:03.369828 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="92843a01-448b-4ffb-a5c5-e957cffdbe9d" containerName="nova-scheduler-scheduler" probeResult="unknown" Mar 16 17:07:03 crc kubenswrapper[5120]: I0316 17:07:03.382842 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3c799dfa-c6ab-4e66-9c61-63c1833ee6d4-logs\") pod \"3c799dfa-c6ab-4e66-9c61-63c1833ee6d4\" (UID: \"3c799dfa-c6ab-4e66-9c61-63c1833ee6d4\") " Mar 16 17:07:03 crc kubenswrapper[5120]: I0316 17:07:03.382962 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/3c799dfa-c6ab-4e66-9c61-63c1833ee6d4-nova-metadata-tls-certs\") pod \"3c799dfa-c6ab-4e66-9c61-63c1833ee6d4\" (UID: \"3c799dfa-c6ab-4e66-9c61-63c1833ee6d4\") " Mar 16 17:07:03 crc kubenswrapper[5120]: I0316 17:07:03.383264 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mqxg2\" (UniqueName: \"kubernetes.io/projected/3c799dfa-c6ab-4e66-9c61-63c1833ee6d4-kube-api-access-mqxg2\") pod \"3c799dfa-c6ab-4e66-9c61-63c1833ee6d4\" (UID: \"3c799dfa-c6ab-4e66-9c61-63c1833ee6d4\") " Mar 16 17:07:03 crc kubenswrapper[5120]: I0316 17:07:03.383310 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/16295648-8a78-488d-b66b-e0e2814a7d77-config-data\") pod \"16295648-8a78-488d-b66b-e0e2814a7d77\" (UID: \"16295648-8a78-488d-b66b-e0e2814a7d77\") " Mar 16 17:07:03 crc kubenswrapper[5120]: I0316 17:07:03.383330 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7bv5f\" (UniqueName: \"kubernetes.io/projected/16295648-8a78-488d-b66b-e0e2814a7d77-kube-api-access-7bv5f\") pod \"16295648-8a78-488d-b66b-e0e2814a7d77\" (UID: \"16295648-8a78-488d-b66b-e0e2814a7d77\") " Mar 16 17:07:03 crc kubenswrapper[5120]: I0316 17:07:03.383377 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/16295648-8a78-488d-b66b-e0e2814a7d77-combined-ca-bundle\") pod \"16295648-8a78-488d-b66b-e0e2814a7d77\" (UID: \"16295648-8a78-488d-b66b-e0e2814a7d77\") " Mar 16 17:07:03 crc kubenswrapper[5120]: I0316 17:07:03.383486 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c799dfa-c6ab-4e66-9c61-63c1833ee6d4-logs" (OuterVolumeSpecName: "logs") pod "3c799dfa-c6ab-4e66-9c61-63c1833ee6d4" (UID: "3c799dfa-c6ab-4e66-9c61-63c1833ee6d4"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:07:03 crc kubenswrapper[5120]: I0316 17:07:03.383603 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3c799dfa-c6ab-4e66-9c61-63c1833ee6d4-config-data\") pod \"3c799dfa-c6ab-4e66-9c61-63c1833ee6d4\" (UID: \"3c799dfa-c6ab-4e66-9c61-63c1833ee6d4\") " Mar 16 17:07:03 crc kubenswrapper[5120]: I0316 17:07:03.383650 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/16295648-8a78-488d-b66b-e0e2814a7d77-logs\") pod \"16295648-8a78-488d-b66b-e0e2814a7d77\" (UID: \"16295648-8a78-488d-b66b-e0e2814a7d77\") " Mar 16 17:07:03 crc kubenswrapper[5120]: I0316 17:07:03.383684 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3c799dfa-c6ab-4e66-9c61-63c1833ee6d4-combined-ca-bundle\") pod \"3c799dfa-c6ab-4e66-9c61-63c1833ee6d4\" (UID: \"3c799dfa-c6ab-4e66-9c61-63c1833ee6d4\") " Mar 16 17:07:03 crc kubenswrapper[5120]: I0316 17:07:03.384252 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16295648-8a78-488d-b66b-e0e2814a7d77-logs" (OuterVolumeSpecName: "logs") pod "16295648-8a78-488d-b66b-e0e2814a7d77" (UID: "16295648-8a78-488d-b66b-e0e2814a7d77"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:07:03 crc kubenswrapper[5120]: I0316 17:07:03.384311 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3c799dfa-c6ab-4e66-9c61-63c1833ee6d4-logs\") on node \"crc\" DevicePath \"\"" Mar 16 17:07:03 crc kubenswrapper[5120]: I0316 17:07:03.392305 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c799dfa-c6ab-4e66-9c61-63c1833ee6d4-kube-api-access-mqxg2" (OuterVolumeSpecName: "kube-api-access-mqxg2") pod "3c799dfa-c6ab-4e66-9c61-63c1833ee6d4" (UID: "3c799dfa-c6ab-4e66-9c61-63c1833ee6d4"). InnerVolumeSpecName "kube-api-access-mqxg2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:07:03 crc kubenswrapper[5120]: I0316 17:07:03.394848 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16295648-8a78-488d-b66b-e0e2814a7d77-kube-api-access-7bv5f" (OuterVolumeSpecName: "kube-api-access-7bv5f") pod "16295648-8a78-488d-b66b-e0e2814a7d77" (UID: "16295648-8a78-488d-b66b-e0e2814a7d77"). InnerVolumeSpecName "kube-api-access-7bv5f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:07:03 crc kubenswrapper[5120]: I0316 17:07:03.414353 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c799dfa-c6ab-4e66-9c61-63c1833ee6d4-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "3c799dfa-c6ab-4e66-9c61-63c1833ee6d4" (UID: "3c799dfa-c6ab-4e66-9c61-63c1833ee6d4"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:07:03 crc kubenswrapper[5120]: I0316 17:07:03.415012 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c799dfa-c6ab-4e66-9c61-63c1833ee6d4-config-data" (OuterVolumeSpecName: "config-data") pod "3c799dfa-c6ab-4e66-9c61-63c1833ee6d4" (UID: "3c799dfa-c6ab-4e66-9c61-63c1833ee6d4"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:07:03 crc kubenswrapper[5120]: I0316 17:07:03.415102 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/16295648-8a78-488d-b66b-e0e2814a7d77-config-data" (OuterVolumeSpecName: "config-data") pod "16295648-8a78-488d-b66b-e0e2814a7d77" (UID: "16295648-8a78-488d-b66b-e0e2814a7d77"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:07:03 crc kubenswrapper[5120]: I0316 17:07:03.422961 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/16295648-8a78-488d-b66b-e0e2814a7d77-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "16295648-8a78-488d-b66b-e0e2814a7d77" (UID: "16295648-8a78-488d-b66b-e0e2814a7d77"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:07:03 crc kubenswrapper[5120]: I0316 17:07:03.439110 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c799dfa-c6ab-4e66-9c61-63c1833ee6d4-nova-metadata-tls-certs" (OuterVolumeSpecName: "nova-metadata-tls-certs") pod "3c799dfa-c6ab-4e66-9c61-63c1833ee6d4" (UID: "3c799dfa-c6ab-4e66-9c61-63c1833ee6d4"). InnerVolumeSpecName "nova-metadata-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:07:03 crc kubenswrapper[5120]: I0316 17:07:03.449977 5120 generic.go:358] "Generic (PLEG): container finished" podID="16295648-8a78-488d-b66b-e0e2814a7d77" containerID="75830ab3669bb566bebc4bb46a4fb471003fbf76c0ac18fdf52db156b50bff15" exitCode=0 Mar 16 17:07:03 crc kubenswrapper[5120]: I0316 17:07:03.450095 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"16295648-8a78-488d-b66b-e0e2814a7d77","Type":"ContainerDied","Data":"75830ab3669bb566bebc4bb46a4fb471003fbf76c0ac18fdf52db156b50bff15"} Mar 16 17:07:03 crc kubenswrapper[5120]: I0316 17:07:03.450128 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:07:03 crc kubenswrapper[5120]: I0316 17:07:03.450151 5120 scope.go:117] "RemoveContainer" containerID="75830ab3669bb566bebc4bb46a4fb471003fbf76c0ac18fdf52db156b50bff15" Mar 16 17:07:03 crc kubenswrapper[5120]: I0316 17:07:03.450140 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"16295648-8a78-488d-b66b-e0e2814a7d77","Type":"ContainerDied","Data":"e1388ac1aea12f43ae9f3aaf3064b5b37330e25dbc403b492d278b4b291fcae9"} Mar 16 17:07:03 crc kubenswrapper[5120]: I0316 17:07:03.454235 5120 generic.go:358] "Generic (PLEG): container finished" podID="3c799dfa-c6ab-4e66-9c61-63c1833ee6d4" containerID="df1d8bd581c157876ea9c8788eebf9a396e17c4e8a0235dee7e03ca140c9194a" exitCode=0 Mar 16 17:07:03 crc kubenswrapper[5120]: I0316 17:07:03.454337 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:07:03 crc kubenswrapper[5120]: I0316 17:07:03.454377 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"3c799dfa-c6ab-4e66-9c61-63c1833ee6d4","Type":"ContainerDied","Data":"df1d8bd581c157876ea9c8788eebf9a396e17c4e8a0235dee7e03ca140c9194a"} Mar 16 17:07:03 crc kubenswrapper[5120]: I0316 17:07:03.454439 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"3c799dfa-c6ab-4e66-9c61-63c1833ee6d4","Type":"ContainerDied","Data":"ab9a21b359458da1619cc034ca0c89734622ea373746f210144091e5da3d4ec2"} Mar 16 17:07:03 crc kubenswrapper[5120]: I0316 17:07:03.478709 5120 scope.go:117] "RemoveContainer" containerID="047b4667eae6883af1117ae7b2ea59f81318426233af3cc46e1c4d58f70c24a1" Mar 16 17:07:03 crc kubenswrapper[5120]: I0316 17:07:03.487005 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mqxg2\" (UniqueName: \"kubernetes.io/projected/3c799dfa-c6ab-4e66-9c61-63c1833ee6d4-kube-api-access-mqxg2\") on node \"crc\" DevicePath \"\"" Mar 16 17:07:03 crc kubenswrapper[5120]: I0316 17:07:03.487037 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/16295648-8a78-488d-b66b-e0e2814a7d77-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:07:03 crc kubenswrapper[5120]: I0316 17:07:03.487049 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7bv5f\" (UniqueName: \"kubernetes.io/projected/16295648-8a78-488d-b66b-e0e2814a7d77-kube-api-access-7bv5f\") on node \"crc\" DevicePath \"\"" Mar 16 17:07:03 crc kubenswrapper[5120]: I0316 17:07:03.487058 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/16295648-8a78-488d-b66b-e0e2814a7d77-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:07:03 crc kubenswrapper[5120]: I0316 17:07:03.487068 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3c799dfa-c6ab-4e66-9c61-63c1833ee6d4-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:07:03 crc kubenswrapper[5120]: I0316 17:07:03.487078 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/16295648-8a78-488d-b66b-e0e2814a7d77-logs\") on node \"crc\" DevicePath \"\"" Mar 16 17:07:03 crc kubenswrapper[5120]: I0316 17:07:03.487087 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3c799dfa-c6ab-4e66-9c61-63c1833ee6d4-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:07:03 crc kubenswrapper[5120]: I0316 17:07:03.487096 5120 reconciler_common.go:299] "Volume detached for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/3c799dfa-c6ab-4e66-9c61-63c1833ee6d4-nova-metadata-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:07:03 crc kubenswrapper[5120]: I0316 17:07:03.488786 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 17:07:03 crc kubenswrapper[5120]: I0316 17:07:03.506555 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 17:07:03 crc kubenswrapper[5120]: I0316 17:07:03.521504 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 17:07:03 crc kubenswrapper[5120]: I0316 17:07:03.526092 5120 scope.go:117] "RemoveContainer" containerID="75830ab3669bb566bebc4bb46a4fb471003fbf76c0ac18fdf52db156b50bff15" Mar 16 17:07:03 crc kubenswrapper[5120]: E0316 17:07:03.526786 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"75830ab3669bb566bebc4bb46a4fb471003fbf76c0ac18fdf52db156b50bff15\": container with ID starting with 75830ab3669bb566bebc4bb46a4fb471003fbf76c0ac18fdf52db156b50bff15 not found: ID does not exist" containerID="75830ab3669bb566bebc4bb46a4fb471003fbf76c0ac18fdf52db156b50bff15" Mar 16 17:07:03 crc kubenswrapper[5120]: I0316 17:07:03.526870 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75830ab3669bb566bebc4bb46a4fb471003fbf76c0ac18fdf52db156b50bff15"} err="failed to get container status \"75830ab3669bb566bebc4bb46a4fb471003fbf76c0ac18fdf52db156b50bff15\": rpc error: code = NotFound desc = could not find container \"75830ab3669bb566bebc4bb46a4fb471003fbf76c0ac18fdf52db156b50bff15\": container with ID starting with 75830ab3669bb566bebc4bb46a4fb471003fbf76c0ac18fdf52db156b50bff15 not found: ID does not exist" Mar 16 17:07:03 crc kubenswrapper[5120]: I0316 17:07:03.526924 5120 scope.go:117] "RemoveContainer" containerID="047b4667eae6883af1117ae7b2ea59f81318426233af3cc46e1c4d58f70c24a1" Mar 16 17:07:03 crc kubenswrapper[5120]: E0316 17:07:03.527451 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"047b4667eae6883af1117ae7b2ea59f81318426233af3cc46e1c4d58f70c24a1\": container with ID starting with 047b4667eae6883af1117ae7b2ea59f81318426233af3cc46e1c4d58f70c24a1 not found: ID does not exist" containerID="047b4667eae6883af1117ae7b2ea59f81318426233af3cc46e1c4d58f70c24a1" Mar 16 17:07:03 crc kubenswrapper[5120]: I0316 17:07:03.527568 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"047b4667eae6883af1117ae7b2ea59f81318426233af3cc46e1c4d58f70c24a1"} err="failed to get container status \"047b4667eae6883af1117ae7b2ea59f81318426233af3cc46e1c4d58f70c24a1\": rpc error: code = NotFound desc = could not find container \"047b4667eae6883af1117ae7b2ea59f81318426233af3cc46e1c4d58f70c24a1\": container with ID starting with 047b4667eae6883af1117ae7b2ea59f81318426233af3cc46e1c4d58f70c24a1 not found: ID does not exist" Mar 16 17:07:03 crc kubenswrapper[5120]: I0316 17:07:03.527655 5120 scope.go:117] "RemoveContainer" containerID="df1d8bd581c157876ea9c8788eebf9a396e17c4e8a0235dee7e03ca140c9194a" Mar 16 17:07:03 crc kubenswrapper[5120]: I0316 17:07:03.531356 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 17:07:03 crc kubenswrapper[5120]: I0316 17:07:03.551054 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 17:07:03 crc kubenswrapper[5120]: I0316 17:07:03.552976 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16295648-8a78-488d-b66b-e0e2814a7d77" containerName="nova-api-log" Mar 16 17:07:03 crc kubenswrapper[5120]: I0316 17:07:03.553028 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="16295648-8a78-488d-b66b-e0e2814a7d77" containerName="nova-api-log" Mar 16 17:07:03 crc kubenswrapper[5120]: I0316 17:07:03.553041 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d09005bc-6e0f-4946-848c-ca47f6ad1401" containerName="nova-manage" Mar 16 17:07:03 crc kubenswrapper[5120]: I0316 17:07:03.553050 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="d09005bc-6e0f-4946-848c-ca47f6ad1401" containerName="nova-manage" Mar 16 17:07:03 crc kubenswrapper[5120]: I0316 17:07:03.553071 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c799dfa-c6ab-4e66-9c61-63c1833ee6d4" containerName="nova-metadata-log" Mar 16 17:07:03 crc kubenswrapper[5120]: I0316 17:07:03.553080 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c799dfa-c6ab-4e66-9c61-63c1833ee6d4" containerName="nova-metadata-log" Mar 16 17:07:03 crc kubenswrapper[5120]: I0316 17:07:03.553137 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c799dfa-c6ab-4e66-9c61-63c1833ee6d4" containerName="nova-metadata-metadata" Mar 16 17:07:03 crc kubenswrapper[5120]: I0316 17:07:03.553146 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c799dfa-c6ab-4e66-9c61-63c1833ee6d4" containerName="nova-metadata-metadata" Mar 16 17:07:03 crc kubenswrapper[5120]: I0316 17:07:03.553177 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16295648-8a78-488d-b66b-e0e2814a7d77" containerName="nova-api-api" Mar 16 17:07:03 crc kubenswrapper[5120]: I0316 17:07:03.553186 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="16295648-8a78-488d-b66b-e0e2814a7d77" containerName="nova-api-api" Mar 16 17:07:03 crc kubenswrapper[5120]: I0316 17:07:03.553497 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="d09005bc-6e0f-4946-848c-ca47f6ad1401" containerName="nova-manage" Mar 16 17:07:03 crc kubenswrapper[5120]: I0316 17:07:03.553528 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="16295648-8a78-488d-b66b-e0e2814a7d77" containerName="nova-api-log" Mar 16 17:07:03 crc kubenswrapper[5120]: I0316 17:07:03.553544 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="3c799dfa-c6ab-4e66-9c61-63c1833ee6d4" containerName="nova-metadata-metadata" Mar 16 17:07:03 crc kubenswrapper[5120]: I0316 17:07:03.553564 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="3c799dfa-c6ab-4e66-9c61-63c1833ee6d4" containerName="nova-metadata-log" Mar 16 17:07:03 crc kubenswrapper[5120]: I0316 17:07:03.553578 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="16295648-8a78-488d-b66b-e0e2814a7d77" containerName="nova-api-api" Mar 16 17:07:03 crc kubenswrapper[5120]: I0316 17:07:03.568223 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 17:07:03 crc kubenswrapper[5120]: I0316 17:07:03.568468 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:07:03 crc kubenswrapper[5120]: I0316 17:07:03.569454 5120 scope.go:117] "RemoveContainer" containerID="692094eaa0160d44e37f8f4462155332d5a4b47e315e08a4ddbdd5c9c9c1aeb4" Mar 16 17:07:03 crc kubenswrapper[5120]: I0316 17:07:03.570535 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-config-data\"" Mar 16 17:07:03 crc kubenswrapper[5120]: I0316 17:07:03.577863 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 17:07:03 crc kubenswrapper[5120]: I0316 17:07:03.578034 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:07:03 crc kubenswrapper[5120]: I0316 17:07:03.580444 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-metadata-internal-svc\"" Mar 16 17:07:03 crc kubenswrapper[5120]: I0316 17:07:03.581584 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-metadata-config-data\"" Mar 16 17:07:03 crc kubenswrapper[5120]: I0316 17:07:03.583106 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 17:07:03 crc kubenswrapper[5120]: I0316 17:07:03.605592 5120 scope.go:117] "RemoveContainer" containerID="df1d8bd581c157876ea9c8788eebf9a396e17c4e8a0235dee7e03ca140c9194a" Mar 16 17:07:03 crc kubenswrapper[5120]: E0316 17:07:03.606056 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df1d8bd581c157876ea9c8788eebf9a396e17c4e8a0235dee7e03ca140c9194a\": container with ID starting with df1d8bd581c157876ea9c8788eebf9a396e17c4e8a0235dee7e03ca140c9194a not found: ID does not exist" containerID="df1d8bd581c157876ea9c8788eebf9a396e17c4e8a0235dee7e03ca140c9194a" Mar 16 17:07:03 crc kubenswrapper[5120]: I0316 17:07:03.606100 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df1d8bd581c157876ea9c8788eebf9a396e17c4e8a0235dee7e03ca140c9194a"} err="failed to get container status \"df1d8bd581c157876ea9c8788eebf9a396e17c4e8a0235dee7e03ca140c9194a\": rpc error: code = NotFound desc = could not find container \"df1d8bd581c157876ea9c8788eebf9a396e17c4e8a0235dee7e03ca140c9194a\": container with ID starting with df1d8bd581c157876ea9c8788eebf9a396e17c4e8a0235dee7e03ca140c9194a not found: ID does not exist" Mar 16 17:07:03 crc kubenswrapper[5120]: I0316 17:07:03.606127 5120 scope.go:117] "RemoveContainer" containerID="692094eaa0160d44e37f8f4462155332d5a4b47e315e08a4ddbdd5c9c9c1aeb4" Mar 16 17:07:03 crc kubenswrapper[5120]: E0316 17:07:03.608424 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"692094eaa0160d44e37f8f4462155332d5a4b47e315e08a4ddbdd5c9c9c1aeb4\": container with ID starting with 692094eaa0160d44e37f8f4462155332d5a4b47e315e08a4ddbdd5c9c9c1aeb4 not found: ID does not exist" containerID="692094eaa0160d44e37f8f4462155332d5a4b47e315e08a4ddbdd5c9c9c1aeb4" Mar 16 17:07:03 crc kubenswrapper[5120]: I0316 17:07:03.608449 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"692094eaa0160d44e37f8f4462155332d5a4b47e315e08a4ddbdd5c9c9c1aeb4"} err="failed to get container status \"692094eaa0160d44e37f8f4462155332d5a4b47e315e08a4ddbdd5c9c9c1aeb4\": rpc error: code = NotFound desc = could not find container \"692094eaa0160d44e37f8f4462155332d5a4b47e315e08a4ddbdd5c9c9c1aeb4\": container with ID starting with 692094eaa0160d44e37f8f4462155332d5a4b47e315e08a4ddbdd5c9c9c1aeb4 not found: ID does not exist" Mar 16 17:07:03 crc kubenswrapper[5120]: I0316 17:07:03.690685 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c8ccd406-033f-4230-b9a3-357d14ec49f2-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"c8ccd406-033f-4230-b9a3-357d14ec49f2\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:07:03 crc kubenswrapper[5120]: I0316 17:07:03.691140 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/c8ccd406-033f-4230-b9a3-357d14ec49f2-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"c8ccd406-033f-4230-b9a3-357d14ec49f2\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:07:03 crc kubenswrapper[5120]: I0316 17:07:03.691186 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jpbm\" (UniqueName: \"kubernetes.io/projected/c8ccd406-033f-4230-b9a3-357d14ec49f2-kube-api-access-6jpbm\") pod \"nova-metadata-0\" (UID: \"c8ccd406-033f-4230-b9a3-357d14ec49f2\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:07:03 crc kubenswrapper[5120]: I0316 17:07:03.691432 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f280ed38-a71f-4438-80c1-92cdea7075e0-config-data\") pod \"nova-api-0\" (UID: \"f280ed38-a71f-4438-80c1-92cdea7075e0\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:07:03 crc kubenswrapper[5120]: I0316 17:07:03.691514 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f280ed38-a71f-4438-80c1-92cdea7075e0-logs\") pod \"nova-api-0\" (UID: \"f280ed38-a71f-4438-80c1-92cdea7075e0\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:07:03 crc kubenswrapper[5120]: I0316 17:07:03.691640 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48bck\" (UniqueName: \"kubernetes.io/projected/f280ed38-a71f-4438-80c1-92cdea7075e0-kube-api-access-48bck\") pod \"nova-api-0\" (UID: \"f280ed38-a71f-4438-80c1-92cdea7075e0\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:07:03 crc kubenswrapper[5120]: I0316 17:07:03.691670 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f280ed38-a71f-4438-80c1-92cdea7075e0-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"f280ed38-a71f-4438-80c1-92cdea7075e0\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:07:03 crc kubenswrapper[5120]: I0316 17:07:03.691856 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c8ccd406-033f-4230-b9a3-357d14ec49f2-config-data\") pod \"nova-metadata-0\" (UID: \"c8ccd406-033f-4230-b9a3-357d14ec49f2\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:07:03 crc kubenswrapper[5120]: I0316 17:07:03.691980 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c8ccd406-033f-4230-b9a3-357d14ec49f2-logs\") pod \"nova-metadata-0\" (UID: \"c8ccd406-033f-4230-b9a3-357d14ec49f2\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:07:03 crc kubenswrapper[5120]: I0316 17:07:03.794916 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/c8ccd406-033f-4230-b9a3-357d14ec49f2-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"c8ccd406-033f-4230-b9a3-357d14ec49f2\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:07:03 crc kubenswrapper[5120]: I0316 17:07:03.795046 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6jpbm\" (UniqueName: \"kubernetes.io/projected/c8ccd406-033f-4230-b9a3-357d14ec49f2-kube-api-access-6jpbm\") pod \"nova-metadata-0\" (UID: \"c8ccd406-033f-4230-b9a3-357d14ec49f2\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:07:03 crc kubenswrapper[5120]: I0316 17:07:03.795203 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f280ed38-a71f-4438-80c1-92cdea7075e0-config-data\") pod \"nova-api-0\" (UID: \"f280ed38-a71f-4438-80c1-92cdea7075e0\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:07:03 crc kubenswrapper[5120]: I0316 17:07:03.795277 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f280ed38-a71f-4438-80c1-92cdea7075e0-logs\") pod \"nova-api-0\" (UID: \"f280ed38-a71f-4438-80c1-92cdea7075e0\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:07:03 crc kubenswrapper[5120]: I0316 17:07:03.795390 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-48bck\" (UniqueName: \"kubernetes.io/projected/f280ed38-a71f-4438-80c1-92cdea7075e0-kube-api-access-48bck\") pod \"nova-api-0\" (UID: \"f280ed38-a71f-4438-80c1-92cdea7075e0\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:07:03 crc kubenswrapper[5120]: I0316 17:07:03.795433 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f280ed38-a71f-4438-80c1-92cdea7075e0-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"f280ed38-a71f-4438-80c1-92cdea7075e0\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:07:03 crc kubenswrapper[5120]: I0316 17:07:03.795517 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c8ccd406-033f-4230-b9a3-357d14ec49f2-config-data\") pod \"nova-metadata-0\" (UID: \"c8ccd406-033f-4230-b9a3-357d14ec49f2\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:07:03 crc kubenswrapper[5120]: I0316 17:07:03.795593 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c8ccd406-033f-4230-b9a3-357d14ec49f2-logs\") pod \"nova-metadata-0\" (UID: \"c8ccd406-033f-4230-b9a3-357d14ec49f2\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:07:03 crc kubenswrapper[5120]: I0316 17:07:03.795776 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f280ed38-a71f-4438-80c1-92cdea7075e0-logs\") pod \"nova-api-0\" (UID: \"f280ed38-a71f-4438-80c1-92cdea7075e0\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:07:03 crc kubenswrapper[5120]: I0316 17:07:03.796017 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c8ccd406-033f-4230-b9a3-357d14ec49f2-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"c8ccd406-033f-4230-b9a3-357d14ec49f2\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:07:03 crc kubenswrapper[5120]: I0316 17:07:03.796512 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c8ccd406-033f-4230-b9a3-357d14ec49f2-logs\") pod \"nova-metadata-0\" (UID: \"c8ccd406-033f-4230-b9a3-357d14ec49f2\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:07:03 crc kubenswrapper[5120]: I0316 17:07:03.800057 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c8ccd406-033f-4230-b9a3-357d14ec49f2-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"c8ccd406-033f-4230-b9a3-357d14ec49f2\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:07:03 crc kubenswrapper[5120]: I0316 17:07:03.800139 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c8ccd406-033f-4230-b9a3-357d14ec49f2-config-data\") pod \"nova-metadata-0\" (UID: \"c8ccd406-033f-4230-b9a3-357d14ec49f2\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:07:03 crc kubenswrapper[5120]: I0316 17:07:03.800201 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/c8ccd406-033f-4230-b9a3-357d14ec49f2-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"c8ccd406-033f-4230-b9a3-357d14ec49f2\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:07:03 crc kubenswrapper[5120]: I0316 17:07:03.801940 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f280ed38-a71f-4438-80c1-92cdea7075e0-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"f280ed38-a71f-4438-80c1-92cdea7075e0\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:07:03 crc kubenswrapper[5120]: I0316 17:07:03.803896 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f280ed38-a71f-4438-80c1-92cdea7075e0-config-data\") pod \"nova-api-0\" (UID: \"f280ed38-a71f-4438-80c1-92cdea7075e0\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:07:03 crc kubenswrapper[5120]: I0316 17:07:03.815034 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jpbm\" (UniqueName: \"kubernetes.io/projected/c8ccd406-033f-4230-b9a3-357d14ec49f2-kube-api-access-6jpbm\") pod \"nova-metadata-0\" (UID: \"c8ccd406-033f-4230-b9a3-357d14ec49f2\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:07:03 crc kubenswrapper[5120]: I0316 17:07:03.823789 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-48bck\" (UniqueName: \"kubernetes.io/projected/f280ed38-a71f-4438-80c1-92cdea7075e0-kube-api-access-48bck\") pod \"nova-api-0\" (UID: \"f280ed38-a71f-4438-80c1-92cdea7075e0\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:07:03 crc kubenswrapper[5120]: I0316 17:07:03.886122 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:07:03 crc kubenswrapper[5120]: I0316 17:07:03.904271 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:07:04 crc kubenswrapper[5120]: E0316 17:07:04.041054 5120 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfc772fff_eba2_4aa4_85ff_40057e068148.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfc772fff_eba2_4aa4_85ff_40057e068148.slice/crio-e9e927aa88712ffcef7dbe6a7389f1734f487859737adb662ad3224b816a100f\": RecentStats: unable to find data in memory cache]" Mar 16 17:07:04 crc kubenswrapper[5120]: I0316 17:07:04.420202 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 17:07:04 crc kubenswrapper[5120]: I0316 17:07:04.423989 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 17:07:04 crc kubenswrapper[5120]: W0316 17:07:04.423990 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf280ed38_a71f_4438_80c1_92cdea7075e0.slice/crio-657b004df2a7c4d18107f71644b043ec877da2c325043b0c3f51e19c77ba1b38 WatchSource:0}: Error finding container 657b004df2a7c4d18107f71644b043ec877da2c325043b0c3f51e19c77ba1b38: Status 404 returned error can't find the container with id 657b004df2a7c4d18107f71644b043ec877da2c325043b0c3f51e19c77ba1b38 Mar 16 17:07:04 crc kubenswrapper[5120]: I0316 17:07:04.472706 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"c8ccd406-033f-4230-b9a3-357d14ec49f2","Type":"ContainerStarted","Data":"47d6068a3a6618e91c820a81c5f5a592757970099237dd3acbf0356c24102cc9"} Mar 16 17:07:04 crc kubenswrapper[5120]: I0316 17:07:04.477041 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"f280ed38-a71f-4438-80c1-92cdea7075e0","Type":"ContainerStarted","Data":"657b004df2a7c4d18107f71644b043ec877da2c325043b0c3f51e19c77ba1b38"} Mar 16 17:07:04 crc kubenswrapper[5120]: I0316 17:07:04.675668 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="16295648-8a78-488d-b66b-e0e2814a7d77" path="/var/lib/kubelet/pods/16295648-8a78-488d-b66b-e0e2814a7d77/volumes" Mar 16 17:07:04 crc kubenswrapper[5120]: I0316 17:07:04.676989 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c799dfa-c6ab-4e66-9c61-63c1833ee6d4" path="/var/lib/kubelet/pods/3c799dfa-c6ab-4e66-9c61-63c1833ee6d4/volumes" Mar 16 17:07:05 crc kubenswrapper[5120]: I0316 17:07:05.350279 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:07:05 crc kubenswrapper[5120]: I0316 17:07:05.481953 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m46sl\" (UniqueName: \"kubernetes.io/projected/92843a01-448b-4ffb-a5c5-e957cffdbe9d-kube-api-access-m46sl\") pod \"92843a01-448b-4ffb-a5c5-e957cffdbe9d\" (UID: \"92843a01-448b-4ffb-a5c5-e957cffdbe9d\") " Mar 16 17:07:05 crc kubenswrapper[5120]: I0316 17:07:05.482190 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/92843a01-448b-4ffb-a5c5-e957cffdbe9d-combined-ca-bundle\") pod \"92843a01-448b-4ffb-a5c5-e957cffdbe9d\" (UID: \"92843a01-448b-4ffb-a5c5-e957cffdbe9d\") " Mar 16 17:07:05 crc kubenswrapper[5120]: I0316 17:07:05.482222 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/92843a01-448b-4ffb-a5c5-e957cffdbe9d-config-data\") pod \"92843a01-448b-4ffb-a5c5-e957cffdbe9d\" (UID: \"92843a01-448b-4ffb-a5c5-e957cffdbe9d\") " Mar 16 17:07:05 crc kubenswrapper[5120]: I0316 17:07:05.493928 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"c8ccd406-033f-4230-b9a3-357d14ec49f2","Type":"ContainerStarted","Data":"6a7c746793e3f12759628d71fa2a4ada61abd83c18eff2afb39b04da6a35153f"} Mar 16 17:07:05 crc kubenswrapper[5120]: I0316 17:07:05.494233 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"c8ccd406-033f-4230-b9a3-357d14ec49f2","Type":"ContainerStarted","Data":"9148b8c5f1c6856439d0eefe2fbe6ed8be889376dd71647351caecf518bbe7e2"} Mar 16 17:07:05 crc kubenswrapper[5120]: I0316 17:07:05.495752 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"f280ed38-a71f-4438-80c1-92cdea7075e0","Type":"ContainerStarted","Data":"293255a6a66dbc894c43f487895bbf455cf5383dd6c6ef65bf783a45c757f038"} Mar 16 17:07:05 crc kubenswrapper[5120]: I0316 17:07:05.495805 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"f280ed38-a71f-4438-80c1-92cdea7075e0","Type":"ContainerStarted","Data":"85d06857f2e6ac0b12e32fee76e5bacddb4d623b1414eeb7c8afe1757d9e7654"} Mar 16 17:07:05 crc kubenswrapper[5120]: I0316 17:07:05.499092 5120 generic.go:358] "Generic (PLEG): container finished" podID="92843a01-448b-4ffb-a5c5-e957cffdbe9d" containerID="b47e7c1b23ad6f3592049f3d03c7a6148ba1ef5e062c395491f8a4b3694fbd41" exitCode=0 Mar 16 17:07:05 crc kubenswrapper[5120]: I0316 17:07:05.499154 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"92843a01-448b-4ffb-a5c5-e957cffdbe9d","Type":"ContainerDied","Data":"b47e7c1b23ad6f3592049f3d03c7a6148ba1ef5e062c395491f8a4b3694fbd41"} Mar 16 17:07:05 crc kubenswrapper[5120]: I0316 17:07:05.499184 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"92843a01-448b-4ffb-a5c5-e957cffdbe9d","Type":"ContainerDied","Data":"c70e78e3b7c14e438e28740f2bce5da34d357ea62dbb3668e3a9a845b05cfbdb"} Mar 16 17:07:05 crc kubenswrapper[5120]: I0316 17:07:05.499199 5120 scope.go:117] "RemoveContainer" containerID="b47e7c1b23ad6f3592049f3d03c7a6148ba1ef5e062c395491f8a4b3694fbd41" Mar 16 17:07:05 crc kubenswrapper[5120]: I0316 17:07:05.499339 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:07:05 crc kubenswrapper[5120]: I0316 17:07:05.506979 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92843a01-448b-4ffb-a5c5-e957cffdbe9d-kube-api-access-m46sl" (OuterVolumeSpecName: "kube-api-access-m46sl") pod "92843a01-448b-4ffb-a5c5-e957cffdbe9d" (UID: "92843a01-448b-4ffb-a5c5-e957cffdbe9d"). InnerVolumeSpecName "kube-api-access-m46sl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:07:05 crc kubenswrapper[5120]: I0316 17:07:05.521041 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92843a01-448b-4ffb-a5c5-e957cffdbe9d-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "92843a01-448b-4ffb-a5c5-e957cffdbe9d" (UID: "92843a01-448b-4ffb-a5c5-e957cffdbe9d"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:07:05 crc kubenswrapper[5120]: I0316 17:07:05.525804 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92843a01-448b-4ffb-a5c5-e957cffdbe9d-config-data" (OuterVolumeSpecName: "config-data") pod "92843a01-448b-4ffb-a5c5-e957cffdbe9d" (UID: "92843a01-448b-4ffb-a5c5-e957cffdbe9d"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:07:05 crc kubenswrapper[5120]: I0316 17:07:05.525902 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=2.525856708 podStartE2EDuration="2.525856708s" podCreationTimestamp="2026-03-16 17:07:03 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:07:05.51328176 +0000 UTC m=+5727.667213427" watchObservedRunningTime="2026-03-16 17:07:05.525856708 +0000 UTC m=+5727.679788395" Mar 16 17:07:05 crc kubenswrapper[5120]: I0316 17:07:05.542701 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=2.542683863 podStartE2EDuration="2.542683863s" podCreationTimestamp="2026-03-16 17:07:03 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:07:05.536709238 +0000 UTC m=+5727.690640915" watchObservedRunningTime="2026-03-16 17:07:05.542683863 +0000 UTC m=+5727.696615520" Mar 16 17:07:05 crc kubenswrapper[5120]: I0316 17:07:05.556310 5120 scope.go:117] "RemoveContainer" containerID="b47e7c1b23ad6f3592049f3d03c7a6148ba1ef5e062c395491f8a4b3694fbd41" Mar 16 17:07:05 crc kubenswrapper[5120]: E0316 17:07:05.556743 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b47e7c1b23ad6f3592049f3d03c7a6148ba1ef5e062c395491f8a4b3694fbd41\": container with ID starting with b47e7c1b23ad6f3592049f3d03c7a6148ba1ef5e062c395491f8a4b3694fbd41 not found: ID does not exist" containerID="b47e7c1b23ad6f3592049f3d03c7a6148ba1ef5e062c395491f8a4b3694fbd41" Mar 16 17:07:05 crc kubenswrapper[5120]: I0316 17:07:05.556791 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b47e7c1b23ad6f3592049f3d03c7a6148ba1ef5e062c395491f8a4b3694fbd41"} err="failed to get container status \"b47e7c1b23ad6f3592049f3d03c7a6148ba1ef5e062c395491f8a4b3694fbd41\": rpc error: code = NotFound desc = could not find container \"b47e7c1b23ad6f3592049f3d03c7a6148ba1ef5e062c395491f8a4b3694fbd41\": container with ID starting with b47e7c1b23ad6f3592049f3d03c7a6148ba1ef5e062c395491f8a4b3694fbd41 not found: ID does not exist" Mar 16 17:07:05 crc kubenswrapper[5120]: I0316 17:07:05.586113 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m46sl\" (UniqueName: \"kubernetes.io/projected/92843a01-448b-4ffb-a5c5-e957cffdbe9d-kube-api-access-m46sl\") on node \"crc\" DevicePath \"\"" Mar 16 17:07:05 crc kubenswrapper[5120]: I0316 17:07:05.586158 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/92843a01-448b-4ffb-a5c5-e957cffdbe9d-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:07:05 crc kubenswrapper[5120]: I0316 17:07:05.586174 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/92843a01-448b-4ffb-a5c5-e957cffdbe9d-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:07:05 crc kubenswrapper[5120]: I0316 17:07:05.869278 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 17:07:05 crc kubenswrapper[5120]: I0316 17:07:05.879427 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 17:07:05 crc kubenswrapper[5120]: I0316 17:07:05.891278 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 17:07:05 crc kubenswrapper[5120]: I0316 17:07:05.892490 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92843a01-448b-4ffb-a5c5-e957cffdbe9d" containerName="nova-scheduler-scheduler" Mar 16 17:07:05 crc kubenswrapper[5120]: I0316 17:07:05.892510 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="92843a01-448b-4ffb-a5c5-e957cffdbe9d" containerName="nova-scheduler-scheduler" Mar 16 17:07:05 crc kubenswrapper[5120]: I0316 17:07:05.893030 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="92843a01-448b-4ffb-a5c5-e957cffdbe9d" containerName="nova-scheduler-scheduler" Mar 16 17:07:05 crc kubenswrapper[5120]: I0316 17:07:05.899386 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:07:05 crc kubenswrapper[5120]: I0316 17:07:05.901027 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 17:07:05 crc kubenswrapper[5120]: I0316 17:07:05.901876 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-scheduler-config-data\"" Mar 16 17:07:05 crc kubenswrapper[5120]: I0316 17:07:05.996938 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbzxr\" (UniqueName: \"kubernetes.io/projected/0205947a-d88b-45b3-8dfb-67965e155ab7-kube-api-access-sbzxr\") pod \"nova-scheduler-0\" (UID: \"0205947a-d88b-45b3-8dfb-67965e155ab7\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:07:05 crc kubenswrapper[5120]: I0316 17:07:05.997745 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0205947a-d88b-45b3-8dfb-67965e155ab7-config-data\") pod \"nova-scheduler-0\" (UID: \"0205947a-d88b-45b3-8dfb-67965e155ab7\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:07:05 crc kubenswrapper[5120]: I0316 17:07:05.997838 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0205947a-d88b-45b3-8dfb-67965e155ab7-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"0205947a-d88b-45b3-8dfb-67965e155ab7\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:07:06 crc kubenswrapper[5120]: I0316 17:07:06.099497 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0205947a-d88b-45b3-8dfb-67965e155ab7-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"0205947a-d88b-45b3-8dfb-67965e155ab7\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:07:06 crc kubenswrapper[5120]: I0316 17:07:06.099674 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sbzxr\" (UniqueName: \"kubernetes.io/projected/0205947a-d88b-45b3-8dfb-67965e155ab7-kube-api-access-sbzxr\") pod \"nova-scheduler-0\" (UID: \"0205947a-d88b-45b3-8dfb-67965e155ab7\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:07:06 crc kubenswrapper[5120]: I0316 17:07:06.100122 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0205947a-d88b-45b3-8dfb-67965e155ab7-config-data\") pod \"nova-scheduler-0\" (UID: \"0205947a-d88b-45b3-8dfb-67965e155ab7\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:07:06 crc kubenswrapper[5120]: I0316 17:07:06.104399 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0205947a-d88b-45b3-8dfb-67965e155ab7-config-data\") pod \"nova-scheduler-0\" (UID: \"0205947a-d88b-45b3-8dfb-67965e155ab7\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:07:06 crc kubenswrapper[5120]: I0316 17:07:06.104445 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0205947a-d88b-45b3-8dfb-67965e155ab7-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"0205947a-d88b-45b3-8dfb-67965e155ab7\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:07:06 crc kubenswrapper[5120]: I0316 17:07:06.118061 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbzxr\" (UniqueName: \"kubernetes.io/projected/0205947a-d88b-45b3-8dfb-67965e155ab7-kube-api-access-sbzxr\") pod \"nova-scheduler-0\" (UID: \"0205947a-d88b-45b3-8dfb-67965e155ab7\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:07:06 crc kubenswrapper[5120]: I0316 17:07:06.225216 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:07:06 crc kubenswrapper[5120]: I0316 17:07:06.677143 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="92843a01-448b-4ffb-a5c5-e957cffdbe9d" path="/var/lib/kubelet/pods/92843a01-448b-4ffb-a5c5-e957cffdbe9d/volumes" Mar 16 17:07:06 crc kubenswrapper[5120]: I0316 17:07:06.690388 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 17:07:06 crc kubenswrapper[5120]: W0316 17:07:06.694372 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0205947a_d88b_45b3_8dfb_67965e155ab7.slice/crio-3541add131a22b2412845bcd1022d8ef007e8dbb3d9243756c3276c9b12157f6 WatchSource:0}: Error finding container 3541add131a22b2412845bcd1022d8ef007e8dbb3d9243756c3276c9b12157f6: Status 404 returned error can't find the container with id 3541add131a22b2412845bcd1022d8ef007e8dbb3d9243756c3276c9b12157f6 Mar 16 17:07:07 crc kubenswrapper[5120]: I0316 17:07:07.523281 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"0205947a-d88b-45b3-8dfb-67965e155ab7","Type":"ContainerStarted","Data":"aa472661815dedb1608725d2fbfcc5a464730a1bf9356da21f6903148c5bd7dd"} Mar 16 17:07:07 crc kubenswrapper[5120]: I0316 17:07:07.523913 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"0205947a-d88b-45b3-8dfb-67965e155ab7","Type":"ContainerStarted","Data":"3541add131a22b2412845bcd1022d8ef007e8dbb3d9243756c3276c9b12157f6"} Mar 16 17:07:07 crc kubenswrapper[5120]: I0316 17:07:07.561679 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-scheduler-0" podStartSLOduration=2.561654927 podStartE2EDuration="2.561654927s" podCreationTimestamp="2026-03-16 17:07:05 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:07:07.551569549 +0000 UTC m=+5729.705501216" watchObservedRunningTime="2026-03-16 17:07:07.561654927 +0000 UTC m=+5729.715586584" Mar 16 17:07:08 crc kubenswrapper[5120]: E0316 17:07:08.224613 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1898239 actualBytes=10240 Mar 16 17:07:08 crc kubenswrapper[5120]: I0316 17:07:08.840935 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-operators-b4xn8" Mar 16 17:07:08 crc kubenswrapper[5120]: I0316 17:07:08.892566 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-operators-b4xn8" Mar 16 17:07:09 crc kubenswrapper[5120]: I0316 17:07:09.076715 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-operators-b4xn8"] Mar 16 17:07:10 crc kubenswrapper[5120]: I0316 17:07:10.564172 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-marketplace/redhat-operators-b4xn8" podUID="39020bfa-624a-485d-8a2e-517cc5eb177d" containerName="registry-server" containerID="cri-o://4c7f90e1bb342605fe70c4f36aada52f6d8f6ab5a5c85927d3db452a7f186fe3" gracePeriod=2 Mar 16 17:07:11 crc kubenswrapper[5120]: I0316 17:07:11.114685 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-b4xn8" Mar 16 17:07:11 crc kubenswrapper[5120]: I0316 17:07:11.140465 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qv5c2\" (UniqueName: \"kubernetes.io/projected/39020bfa-624a-485d-8a2e-517cc5eb177d-kube-api-access-qv5c2\") pod \"39020bfa-624a-485d-8a2e-517cc5eb177d\" (UID: \"39020bfa-624a-485d-8a2e-517cc5eb177d\") " Mar 16 17:07:11 crc kubenswrapper[5120]: I0316 17:07:11.140879 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/39020bfa-624a-485d-8a2e-517cc5eb177d-utilities\") pod \"39020bfa-624a-485d-8a2e-517cc5eb177d\" (UID: \"39020bfa-624a-485d-8a2e-517cc5eb177d\") " Mar 16 17:07:11 crc kubenswrapper[5120]: I0316 17:07:11.141156 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/39020bfa-624a-485d-8a2e-517cc5eb177d-catalog-content\") pod \"39020bfa-624a-485d-8a2e-517cc5eb177d\" (UID: \"39020bfa-624a-485d-8a2e-517cc5eb177d\") " Mar 16 17:07:11 crc kubenswrapper[5120]: I0316 17:07:11.141652 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39020bfa-624a-485d-8a2e-517cc5eb177d-utilities" (OuterVolumeSpecName: "utilities") pod "39020bfa-624a-485d-8a2e-517cc5eb177d" (UID: "39020bfa-624a-485d-8a2e-517cc5eb177d"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:07:11 crc kubenswrapper[5120]: I0316 17:07:11.147892 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39020bfa-624a-485d-8a2e-517cc5eb177d-kube-api-access-qv5c2" (OuterVolumeSpecName: "kube-api-access-qv5c2") pod "39020bfa-624a-485d-8a2e-517cc5eb177d" (UID: "39020bfa-624a-485d-8a2e-517cc5eb177d"). InnerVolumeSpecName "kube-api-access-qv5c2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:07:11 crc kubenswrapper[5120]: I0316 17:07:11.157384 5120 reconciler_common.go:299] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/39020bfa-624a-485d-8a2e-517cc5eb177d-utilities\") on node \"crc\" DevicePath \"\"" Mar 16 17:07:11 crc kubenswrapper[5120]: I0316 17:07:11.157424 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qv5c2\" (UniqueName: \"kubernetes.io/projected/39020bfa-624a-485d-8a2e-517cc5eb177d-kube-api-access-qv5c2\") on node \"crc\" DevicePath \"\"" Mar 16 17:07:11 crc kubenswrapper[5120]: I0316 17:07:11.226350 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:07:11 crc kubenswrapper[5120]: I0316 17:07:11.272384 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39020bfa-624a-485d-8a2e-517cc5eb177d-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "39020bfa-624a-485d-8a2e-517cc5eb177d" (UID: "39020bfa-624a-485d-8a2e-517cc5eb177d"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:07:11 crc kubenswrapper[5120]: I0316 17:07:11.362240 5120 reconciler_common.go:299] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/39020bfa-624a-485d-8a2e-517cc5eb177d-catalog-content\") on node \"crc\" DevicePath \"\"" Mar 16 17:07:11 crc kubenswrapper[5120]: I0316 17:07:11.574556 5120 generic.go:358] "Generic (PLEG): container finished" podID="39020bfa-624a-485d-8a2e-517cc5eb177d" containerID="4c7f90e1bb342605fe70c4f36aada52f6d8f6ab5a5c85927d3db452a7f186fe3" exitCode=0 Mar 16 17:07:11 crc kubenswrapper[5120]: I0316 17:07:11.574596 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-b4xn8" event={"ID":"39020bfa-624a-485d-8a2e-517cc5eb177d","Type":"ContainerDied","Data":"4c7f90e1bb342605fe70c4f36aada52f6d8f6ab5a5c85927d3db452a7f186fe3"} Mar 16 17:07:11 crc kubenswrapper[5120]: I0316 17:07:11.574639 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-b4xn8" event={"ID":"39020bfa-624a-485d-8a2e-517cc5eb177d","Type":"ContainerDied","Data":"af49db86fd2add9fb29544d2c34a03085b3dde2f6dd65b0577f757904460a189"} Mar 16 17:07:11 crc kubenswrapper[5120]: I0316 17:07:11.574642 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-b4xn8" Mar 16 17:07:11 crc kubenswrapper[5120]: I0316 17:07:11.574656 5120 scope.go:117] "RemoveContainer" containerID="4c7f90e1bb342605fe70c4f36aada52f6d8f6ab5a5c85927d3db452a7f186fe3" Mar 16 17:07:11 crc kubenswrapper[5120]: I0316 17:07:11.601462 5120 scope.go:117] "RemoveContainer" containerID="85ee15482b056adbd83dd925ddc9fa0a9ff75e1295abc7d6a85bf334963afd7b" Mar 16 17:07:11 crc kubenswrapper[5120]: I0316 17:07:11.606034 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-operators-b4xn8"] Mar 16 17:07:11 crc kubenswrapper[5120]: I0316 17:07:11.617295 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/redhat-operators-b4xn8"] Mar 16 17:07:11 crc kubenswrapper[5120]: I0316 17:07:11.641045 5120 scope.go:117] "RemoveContainer" containerID="8ebfab740169f08d1b7ee76bca0cf692dc803a4e4b2632bc32bcf45c6713ba00" Mar 16 17:07:11 crc kubenswrapper[5120]: I0316 17:07:11.670172 5120 scope.go:117] "RemoveContainer" containerID="4c7f90e1bb342605fe70c4f36aada52f6d8f6ab5a5c85927d3db452a7f186fe3" Mar 16 17:07:11 crc kubenswrapper[5120]: E0316 17:07:11.670798 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c7f90e1bb342605fe70c4f36aada52f6d8f6ab5a5c85927d3db452a7f186fe3\": container with ID starting with 4c7f90e1bb342605fe70c4f36aada52f6d8f6ab5a5c85927d3db452a7f186fe3 not found: ID does not exist" containerID="4c7f90e1bb342605fe70c4f36aada52f6d8f6ab5a5c85927d3db452a7f186fe3" Mar 16 17:07:11 crc kubenswrapper[5120]: I0316 17:07:11.670848 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c7f90e1bb342605fe70c4f36aada52f6d8f6ab5a5c85927d3db452a7f186fe3"} err="failed to get container status \"4c7f90e1bb342605fe70c4f36aada52f6d8f6ab5a5c85927d3db452a7f186fe3\": rpc error: code = NotFound desc = could not find container \"4c7f90e1bb342605fe70c4f36aada52f6d8f6ab5a5c85927d3db452a7f186fe3\": container with ID starting with 4c7f90e1bb342605fe70c4f36aada52f6d8f6ab5a5c85927d3db452a7f186fe3 not found: ID does not exist" Mar 16 17:07:11 crc kubenswrapper[5120]: I0316 17:07:11.670877 5120 scope.go:117] "RemoveContainer" containerID="85ee15482b056adbd83dd925ddc9fa0a9ff75e1295abc7d6a85bf334963afd7b" Mar 16 17:07:11 crc kubenswrapper[5120]: E0316 17:07:11.671177 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"85ee15482b056adbd83dd925ddc9fa0a9ff75e1295abc7d6a85bf334963afd7b\": container with ID starting with 85ee15482b056adbd83dd925ddc9fa0a9ff75e1295abc7d6a85bf334963afd7b not found: ID does not exist" containerID="85ee15482b056adbd83dd925ddc9fa0a9ff75e1295abc7d6a85bf334963afd7b" Mar 16 17:07:11 crc kubenswrapper[5120]: I0316 17:07:11.671206 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85ee15482b056adbd83dd925ddc9fa0a9ff75e1295abc7d6a85bf334963afd7b"} err="failed to get container status \"85ee15482b056adbd83dd925ddc9fa0a9ff75e1295abc7d6a85bf334963afd7b\": rpc error: code = NotFound desc = could not find container \"85ee15482b056adbd83dd925ddc9fa0a9ff75e1295abc7d6a85bf334963afd7b\": container with ID starting with 85ee15482b056adbd83dd925ddc9fa0a9ff75e1295abc7d6a85bf334963afd7b not found: ID does not exist" Mar 16 17:07:11 crc kubenswrapper[5120]: I0316 17:07:11.671225 5120 scope.go:117] "RemoveContainer" containerID="8ebfab740169f08d1b7ee76bca0cf692dc803a4e4b2632bc32bcf45c6713ba00" Mar 16 17:07:11 crc kubenswrapper[5120]: E0316 17:07:11.671527 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ebfab740169f08d1b7ee76bca0cf692dc803a4e4b2632bc32bcf45c6713ba00\": container with ID starting with 8ebfab740169f08d1b7ee76bca0cf692dc803a4e4b2632bc32bcf45c6713ba00 not found: ID does not exist" containerID="8ebfab740169f08d1b7ee76bca0cf692dc803a4e4b2632bc32bcf45c6713ba00" Mar 16 17:07:11 crc kubenswrapper[5120]: I0316 17:07:11.671561 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ebfab740169f08d1b7ee76bca0cf692dc803a4e4b2632bc32bcf45c6713ba00"} err="failed to get container status \"8ebfab740169f08d1b7ee76bca0cf692dc803a4e4b2632bc32bcf45c6713ba00\": rpc error: code = NotFound desc = could not find container \"8ebfab740169f08d1b7ee76bca0cf692dc803a4e4b2632bc32bcf45c6713ba00\": container with ID starting with 8ebfab740169f08d1b7ee76bca0cf692dc803a4e4b2632bc32bcf45c6713ba00 not found: ID does not exist" Mar 16 17:07:12 crc kubenswrapper[5120]: I0316 17:07:12.664067 5120 scope.go:117] "RemoveContainer" containerID="db39d192fa687a13805537d08ad22fed1ef362ef5027c920a616297dc55a8ea9" Mar 16 17:07:12 crc kubenswrapper[5120]: E0316 17:07:12.664281 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 17:07:12 crc kubenswrapper[5120]: I0316 17:07:12.674875 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="39020bfa-624a-485d-8a2e-517cc5eb177d" path="/var/lib/kubelet/pods/39020bfa-624a-485d-8a2e-517cc5eb177d/volumes" Mar 16 17:07:13 crc kubenswrapper[5120]: I0316 17:07:13.886875 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:07:13 crc kubenswrapper[5120]: I0316 17:07:13.887232 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:07:13 crc kubenswrapper[5120]: I0316 17:07:13.904488 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:07:13 crc kubenswrapper[5120]: I0316 17:07:13.904568 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:07:14 crc kubenswrapper[5120]: E0316 17:07:14.287919 5120 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfc772fff_eba2_4aa4_85ff_40057e068148.slice/crio-e9e927aa88712ffcef7dbe6a7389f1734f487859737adb662ad3224b816a100f\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfc772fff_eba2_4aa4_85ff_40057e068148.slice\": RecentStats: unable to find data in memory cache]" Mar 16 17:07:14 crc kubenswrapper[5120]: I0316 17:07:14.621370 5120 scope.go:117] "RemoveContainer" containerID="5bdcd7fe3db4704f6e4591adfb538eaadb322c191c3a867ec1f159e1cecab7f2" Mar 16 17:07:14 crc kubenswrapper[5120]: I0316 17:07:14.642098 5120 scope.go:117] "RemoveContainer" containerID="a42992bd1d9cad8a2c4750ffb36344cddb046a7e90453c31912c59e31473304d" Mar 16 17:07:14 crc kubenswrapper[5120]: I0316 17:07:14.667190 5120 scope.go:117] "RemoveContainer" containerID="99635dda3eea0d4e53ecc0eb0ea3b6a04905af4d37311147fd10c24ffbd66ca8" Mar 16 17:07:14 crc kubenswrapper[5120]: I0316 17:07:14.685858 5120 scope.go:117] "RemoveContainer" containerID="82559c94402956204e6c0ed603726a5ace776e97196e0de5c9afcf91e3a1161b" Mar 16 17:07:14 crc kubenswrapper[5120]: I0316 17:07:14.716474 5120 scope.go:117] "RemoveContainer" containerID="cc3dcdb1265699fdbedb2921119937ef9d8f0d38f35e3694813c0b97b57789f0" Mar 16 17:07:14 crc kubenswrapper[5120]: I0316 17:07:14.743417 5120 scope.go:117] "RemoveContainer" containerID="f8c1c5109f6bdbd96450c7a23d67c1a63f13b173010194ecf69b1864ecf069cd" Mar 16 17:07:14 crc kubenswrapper[5120]: I0316 17:07:14.764854 5120 scope.go:117] "RemoveContainer" containerID="3a8540189ac4b61cc8961e4e6f1bd0b50460a59e9a3da28c3f5cb5d2109ddf3f" Mar 16 17:07:14 crc kubenswrapper[5120]: I0316 17:07:14.787170 5120 scope.go:117] "RemoveContainer" containerID="58dfb8f6f45a99d10e362ec0532e93b658925573a2fd7ebc9291f9e8266f5a1e" Mar 16 17:07:14 crc kubenswrapper[5120]: I0316 17:07:14.811014 5120 scope.go:117] "RemoveContainer" containerID="b7185365438c501fea659d44b0265e1ac0ff2a84cf85471c746ee7f483aa0b4e" Mar 16 17:07:14 crc kubenswrapper[5120]: I0316 17:07:14.832731 5120 scope.go:117] "RemoveContainer" containerID="df8b5c31f6424cfe5184b05fc53b3787de9354c9c0022f3d3a4c534d5104986b" Mar 16 17:07:14 crc kubenswrapper[5120]: I0316 17:07:14.856492 5120 scope.go:117] "RemoveContainer" containerID="9ffb7d4c0f767f982e7526ce10b289cd90603393d82c612888bce9bf3709ecce" Mar 16 17:07:14 crc kubenswrapper[5120]: I0316 17:07:14.879660 5120 scope.go:117] "RemoveContainer" containerID="37f46cae89751e61473cf75d604d271349a611787e527b84be5fb9bfab6bafd4" Mar 16 17:07:14 crc kubenswrapper[5120]: I0316 17:07:14.905092 5120 scope.go:117] "RemoveContainer" containerID="af6dfa5892c321c1794bd9331bf1e07d8de94fb188e1507acc85ea5149c14c24" Mar 16 17:07:14 crc kubenswrapper[5120]: I0316 17:07:14.910956 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="c8ccd406-033f-4230-b9a3-357d14ec49f2" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"https://10.217.1.223:8775/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 17:07:14 crc kubenswrapper[5120]: I0316 17:07:14.911922 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="c8ccd406-033f-4230-b9a3-357d14ec49f2" containerName="nova-metadata-log" probeResult="failure" output="Get \"https://10.217.1.223:8775/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Mar 16 17:07:14 crc kubenswrapper[5120]: I0316 17:07:14.929045 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="f280ed38-a71f-4438-80c1-92cdea7075e0" containerName="nova-api-log" probeResult="failure" output="Get \"http://10.217.1.222:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 17:07:14 crc kubenswrapper[5120]: I0316 17:07:14.929064 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="f280ed38-a71f-4438-80c1-92cdea7075e0" containerName="nova-api-api" probeResult="failure" output="Get \"http://10.217.1.222:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 17:07:14 crc kubenswrapper[5120]: I0316 17:07:14.943473 5120 scope.go:117] "RemoveContainer" containerID="127be2cd9a418019067d28df39c8a22a07e067915f84e992cceebd4cedb161d5" Mar 16 17:07:14 crc kubenswrapper[5120]: I0316 17:07:14.963590 5120 scope.go:117] "RemoveContainer" containerID="c2c1a9748e9ea2942668489224606d646bc848231e5d479039bf6c1c2906c46c" Mar 16 17:07:14 crc kubenswrapper[5120]: I0316 17:07:14.981927 5120 scope.go:117] "RemoveContainer" containerID="94e1102e08240e0ac6ddeb805485b6575f608c17fcfd298c5170b5fd7e295206" Mar 16 17:07:15 crc kubenswrapper[5120]: I0316 17:07:15.015240 5120 scope.go:117] "RemoveContainer" containerID="c0ab31c9aab17588366733825ad14e257d3b43a783281ffa0077f78647ed983a" Mar 16 17:07:15 crc kubenswrapper[5120]: I0316 17:07:15.036964 5120 scope.go:117] "RemoveContainer" containerID="5af1b89049fce0d163cf34818a7156ce0fb2fde2aea842a3668857248b70d770" Mar 16 17:07:15 crc kubenswrapper[5120]: I0316 17:07:15.063359 5120 scope.go:117] "RemoveContainer" containerID="6706e0144fa060f50b0e39d25b8522795d2fe95416f82712ad1b24882f9fff1a" Mar 16 17:07:15 crc kubenswrapper[5120]: I0316 17:07:15.087352 5120 scope.go:117] "RemoveContainer" containerID="1ba29d334446e91abdcb11e44fde235c795515796425914cd3ff6f4f69019510" Mar 16 17:07:15 crc kubenswrapper[5120]: I0316 17:07:15.112000 5120 scope.go:117] "RemoveContainer" containerID="7b707ffbba30ff002e830acdf2190ce1b9f026c0222d528d2f44fc799f718492" Mar 16 17:07:15 crc kubenswrapper[5120]: I0316 17:07:15.136282 5120 scope.go:117] "RemoveContainer" containerID="2aaf683507989a8fa9876cc1505c80fb8c145455029fa196d10039ad20b5e5a7" Mar 16 17:07:15 crc kubenswrapper[5120]: I0316 17:07:15.162098 5120 scope.go:117] "RemoveContainer" containerID="7c8283b18df5600672951ca55dfc7a2133e3c633c2c87ee077597e69c0583de6" Mar 16 17:07:15 crc kubenswrapper[5120]: I0316 17:07:15.188369 5120 scope.go:117] "RemoveContainer" containerID="3d77304db468843668a74a6d34dd20b0deb2b697641fa4c425dbcfb15a0b20fd" Mar 16 17:07:15 crc kubenswrapper[5120]: I0316 17:07:15.232572 5120 scope.go:117] "RemoveContainer" containerID="8a2a241180e8498f806434023245a7cf96892a004e496f210c200d2c05c4951c" Mar 16 17:07:15 crc kubenswrapper[5120]: I0316 17:07:15.256500 5120 scope.go:117] "RemoveContainer" containerID="e2e1bc3fa454ce2aaa626ec44d02991c8621e7f7302023f4b23a970d86c6d80a" Mar 16 17:07:16 crc kubenswrapper[5120]: I0316 17:07:16.226518 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:07:16 crc kubenswrapper[5120]: I0316 17:07:16.258586 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:07:16 crc kubenswrapper[5120]: I0316 17:07:16.681380 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:07:21 crc kubenswrapper[5120]: I0316 17:07:21.886236 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:07:21 crc kubenswrapper[5120]: I0316 17:07:21.886669 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:07:21 crc kubenswrapper[5120]: I0316 17:07:21.905159 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:07:21 crc kubenswrapper[5120]: I0316 17:07:21.905530 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:07:23 crc kubenswrapper[5120]: I0316 17:07:23.663962 5120 scope.go:117] "RemoveContainer" containerID="db39d192fa687a13805537d08ad22fed1ef362ef5027c920a616297dc55a8ea9" Mar 16 17:07:23 crc kubenswrapper[5120]: E0316 17:07:23.664515 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 17:07:23 crc kubenswrapper[5120]: I0316 17:07:23.890748 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:07:23 crc kubenswrapper[5120]: I0316 17:07:23.891431 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:07:23 crc kubenswrapper[5120]: I0316 17:07:23.894030 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:07:23 crc kubenswrapper[5120]: I0316 17:07:23.912283 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:07:23 crc kubenswrapper[5120]: I0316 17:07:23.916307 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:07:23 crc kubenswrapper[5120]: I0316 17:07:23.917904 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:07:24 crc kubenswrapper[5120]: E0316 17:07:24.537030 5120 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfc772fff_eba2_4aa4_85ff_40057e068148.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfc772fff_eba2_4aa4_85ff_40057e068148.slice/crio-e9e927aa88712ffcef7dbe6a7389f1734f487859737adb662ad3224b816a100f\": RecentStats: unable to find data in memory cache]" Mar 16 17:07:24 crc kubenswrapper[5120]: I0316 17:07:24.734687 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:07:24 crc kubenswrapper[5120]: I0316 17:07:24.736779 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:07:26 crc kubenswrapper[5120]: I0316 17:07:26.591784 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:07:26 crc kubenswrapper[5120]: I0316 17:07:26.592669 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="07fab23c-ba13-4edc-921f-5ff095397928" containerName="ceilometer-central-agent" containerID="cri-o://e34d91e2d5484e302cc10073074e0ef7ec543eff491fe1cbcbf4f3d986d59e07" gracePeriod=30 Mar 16 17:07:26 crc kubenswrapper[5120]: I0316 17:07:26.592829 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="07fab23c-ba13-4edc-921f-5ff095397928" containerName="proxy-httpd" containerID="cri-o://328a75582227369a883c8f5a2f34d630d36c4531260c450848de3af0734abc19" gracePeriod=30 Mar 16 17:07:26 crc kubenswrapper[5120]: I0316 17:07:26.592875 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="07fab23c-ba13-4edc-921f-5ff095397928" containerName="sg-core" containerID="cri-o://af4a1813b5822ec6224caaea7e89b284ea1457e530a20e6f28f622a0c49d2c13" gracePeriod=30 Mar 16 17:07:26 crc kubenswrapper[5120]: I0316 17:07:26.592906 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="07fab23c-ba13-4edc-921f-5ff095397928" containerName="ceilometer-notification-agent" containerID="cri-o://d84133fa679de58c5a7b33b1aeed8e1e076bfe6cc56a12e2ac35621adf0da354" gracePeriod=30 Mar 16 17:07:26 crc kubenswrapper[5120]: I0316 17:07:26.611191 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/ceilometer-0" podUID="07fab23c-ba13-4edc-921f-5ff095397928" containerName="proxy-httpd" probeResult="failure" output="Get \"https://10.217.1.219:3000/\": EOF" Mar 16 17:07:26 crc kubenswrapper[5120]: I0316 17:07:26.754154 5120 generic.go:358] "Generic (PLEG): container finished" podID="07fab23c-ba13-4edc-921f-5ff095397928" containerID="af4a1813b5822ec6224caaea7e89b284ea1457e530a20e6f28f622a0c49d2c13" exitCode=2 Mar 16 17:07:26 crc kubenswrapper[5120]: I0316 17:07:26.754203 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"07fab23c-ba13-4edc-921f-5ff095397928","Type":"ContainerDied","Data":"af4a1813b5822ec6224caaea7e89b284ea1457e530a20e6f28f622a0c49d2c13"} Mar 16 17:07:27 crc kubenswrapper[5120]: I0316 17:07:27.334261 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 17:07:27 crc kubenswrapper[5120]: I0316 17:07:27.682862 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:07:27 crc kubenswrapper[5120]: I0316 17:07:27.766639 5120 generic.go:358] "Generic (PLEG): container finished" podID="07fab23c-ba13-4edc-921f-5ff095397928" containerID="328a75582227369a883c8f5a2f34d630d36c4531260c450848de3af0734abc19" exitCode=0 Mar 16 17:07:27 crc kubenswrapper[5120]: I0316 17:07:27.766674 5120 generic.go:358] "Generic (PLEG): container finished" podID="07fab23c-ba13-4edc-921f-5ff095397928" containerID="d84133fa679de58c5a7b33b1aeed8e1e076bfe6cc56a12e2ac35621adf0da354" exitCode=0 Mar 16 17:07:27 crc kubenswrapper[5120]: I0316 17:07:27.766683 5120 generic.go:358] "Generic (PLEG): container finished" podID="07fab23c-ba13-4edc-921f-5ff095397928" containerID="e34d91e2d5484e302cc10073074e0ef7ec543eff491fe1cbcbf4f3d986d59e07" exitCode=0 Mar 16 17:07:27 crc kubenswrapper[5120]: I0316 17:07:27.766692 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"07fab23c-ba13-4edc-921f-5ff095397928","Type":"ContainerDied","Data":"328a75582227369a883c8f5a2f34d630d36c4531260c450848de3af0734abc19"} Mar 16 17:07:27 crc kubenswrapper[5120]: I0316 17:07:27.766723 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:07:27 crc kubenswrapper[5120]: I0316 17:07:27.766793 5120 scope.go:117] "RemoveContainer" containerID="328a75582227369a883c8f5a2f34d630d36c4531260c450848de3af0734abc19" Mar 16 17:07:27 crc kubenswrapper[5120]: I0316 17:07:27.766780 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"07fab23c-ba13-4edc-921f-5ff095397928","Type":"ContainerDied","Data":"d84133fa679de58c5a7b33b1aeed8e1e076bfe6cc56a12e2ac35621adf0da354"} Mar 16 17:07:27 crc kubenswrapper[5120]: I0316 17:07:27.766955 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"07fab23c-ba13-4edc-921f-5ff095397928","Type":"ContainerDied","Data":"e34d91e2d5484e302cc10073074e0ef7ec543eff491fe1cbcbf4f3d986d59e07"} Mar 16 17:07:27 crc kubenswrapper[5120]: I0316 17:07:27.766973 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"07fab23c-ba13-4edc-921f-5ff095397928","Type":"ContainerDied","Data":"47858aa7c9230c048405f0f734327ad5fd4b253d411b70af9680d87ca235495b"} Mar 16 17:07:27 crc kubenswrapper[5120]: I0316 17:07:27.767127 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="f280ed38-a71f-4438-80c1-92cdea7075e0" containerName="nova-api-log" containerID="cri-o://85d06857f2e6ac0b12e32fee76e5bacddb4d623b1414eeb7c8afe1757d9e7654" gracePeriod=30 Mar 16 17:07:27 crc kubenswrapper[5120]: I0316 17:07:27.767261 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="f280ed38-a71f-4438-80c1-92cdea7075e0" containerName="nova-api-api" containerID="cri-o://293255a6a66dbc894c43f487895bbf455cf5383dd6c6ef65bf783a45c757f038" gracePeriod=30 Mar 16 17:07:27 crc kubenswrapper[5120]: I0316 17:07:27.805563 5120 scope.go:117] "RemoveContainer" containerID="af4a1813b5822ec6224caaea7e89b284ea1457e530a20e6f28f622a0c49d2c13" Mar 16 17:07:27 crc kubenswrapper[5120]: I0316 17:07:27.835101 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/07fab23c-ba13-4edc-921f-5ff095397928-run-httpd\") pod \"07fab23c-ba13-4edc-921f-5ff095397928\" (UID: \"07fab23c-ba13-4edc-921f-5ff095397928\") " Mar 16 17:07:27 crc kubenswrapper[5120]: I0316 17:07:27.835395 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/07fab23c-ba13-4edc-921f-5ff095397928-log-httpd\") pod \"07fab23c-ba13-4edc-921f-5ff095397928\" (UID: \"07fab23c-ba13-4edc-921f-5ff095397928\") " Mar 16 17:07:27 crc kubenswrapper[5120]: I0316 17:07:27.835486 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/07fab23c-ba13-4edc-921f-5ff095397928-combined-ca-bundle\") pod \"07fab23c-ba13-4edc-921f-5ff095397928\" (UID: \"07fab23c-ba13-4edc-921f-5ff095397928\") " Mar 16 17:07:27 crc kubenswrapper[5120]: I0316 17:07:27.835557 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/07fab23c-ba13-4edc-921f-5ff095397928-sg-core-conf-yaml\") pod \"07fab23c-ba13-4edc-921f-5ff095397928\" (UID: \"07fab23c-ba13-4edc-921f-5ff095397928\") " Mar 16 17:07:27 crc kubenswrapper[5120]: I0316 17:07:27.835715 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07fab23c-ba13-4edc-921f-5ff095397928-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "07fab23c-ba13-4edc-921f-5ff095397928" (UID: "07fab23c-ba13-4edc-921f-5ff095397928"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:07:27 crc kubenswrapper[5120]: I0316 17:07:27.835733 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/07fab23c-ba13-4edc-921f-5ff095397928-ceilometer-tls-certs\") pod \"07fab23c-ba13-4edc-921f-5ff095397928\" (UID: \"07fab23c-ba13-4edc-921f-5ff095397928\") " Mar 16 17:07:27 crc kubenswrapper[5120]: I0316 17:07:27.835876 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/07fab23c-ba13-4edc-921f-5ff095397928-scripts\") pod \"07fab23c-ba13-4edc-921f-5ff095397928\" (UID: \"07fab23c-ba13-4edc-921f-5ff095397928\") " Mar 16 17:07:27 crc kubenswrapper[5120]: I0316 17:07:27.835945 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/07fab23c-ba13-4edc-921f-5ff095397928-config-data\") pod \"07fab23c-ba13-4edc-921f-5ff095397928\" (UID: \"07fab23c-ba13-4edc-921f-5ff095397928\") " Mar 16 17:07:27 crc kubenswrapper[5120]: I0316 17:07:27.836137 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vbgvx\" (UniqueName: \"kubernetes.io/projected/07fab23c-ba13-4edc-921f-5ff095397928-kube-api-access-vbgvx\") pod \"07fab23c-ba13-4edc-921f-5ff095397928\" (UID: \"07fab23c-ba13-4edc-921f-5ff095397928\") " Mar 16 17:07:27 crc kubenswrapper[5120]: I0316 17:07:27.837125 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/07fab23c-ba13-4edc-921f-5ff095397928-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 17:07:27 crc kubenswrapper[5120]: I0316 17:07:27.837722 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07fab23c-ba13-4edc-921f-5ff095397928-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "07fab23c-ba13-4edc-921f-5ff095397928" (UID: "07fab23c-ba13-4edc-921f-5ff095397928"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:07:27 crc kubenswrapper[5120]: I0316 17:07:27.840976 5120 scope.go:117] "RemoveContainer" containerID="d84133fa679de58c5a7b33b1aeed8e1e076bfe6cc56a12e2ac35621adf0da354" Mar 16 17:07:27 crc kubenswrapper[5120]: I0316 17:07:27.841122 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07fab23c-ba13-4edc-921f-5ff095397928-kube-api-access-vbgvx" (OuterVolumeSpecName: "kube-api-access-vbgvx") pod "07fab23c-ba13-4edc-921f-5ff095397928" (UID: "07fab23c-ba13-4edc-921f-5ff095397928"). InnerVolumeSpecName "kube-api-access-vbgvx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:07:27 crc kubenswrapper[5120]: I0316 17:07:27.842340 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07fab23c-ba13-4edc-921f-5ff095397928-scripts" (OuterVolumeSpecName: "scripts") pod "07fab23c-ba13-4edc-921f-5ff095397928" (UID: "07fab23c-ba13-4edc-921f-5ff095397928"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:07:27 crc kubenswrapper[5120]: I0316 17:07:27.893176 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07fab23c-ba13-4edc-921f-5ff095397928-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "07fab23c-ba13-4edc-921f-5ff095397928" (UID: "07fab23c-ba13-4edc-921f-5ff095397928"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:07:27 crc kubenswrapper[5120]: I0316 17:07:27.925356 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07fab23c-ba13-4edc-921f-5ff095397928-ceilometer-tls-certs" (OuterVolumeSpecName: "ceilometer-tls-certs") pod "07fab23c-ba13-4edc-921f-5ff095397928" (UID: "07fab23c-ba13-4edc-921f-5ff095397928"). InnerVolumeSpecName "ceilometer-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:07:27 crc kubenswrapper[5120]: I0316 17:07:27.930631 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07fab23c-ba13-4edc-921f-5ff095397928-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "07fab23c-ba13-4edc-921f-5ff095397928" (UID: "07fab23c-ba13-4edc-921f-5ff095397928"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:07:27 crc kubenswrapper[5120]: I0316 17:07:27.939739 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/07fab23c-ba13-4edc-921f-5ff095397928-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:07:27 crc kubenswrapper[5120]: I0316 17:07:27.939884 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/07fab23c-ba13-4edc-921f-5ff095397928-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 17:07:27 crc kubenswrapper[5120]: I0316 17:07:27.939953 5120 reconciler_common.go:299] "Volume detached for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/07fab23c-ba13-4edc-921f-5ff095397928-ceilometer-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:07:27 crc kubenswrapper[5120]: I0316 17:07:27.940013 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/07fab23c-ba13-4edc-921f-5ff095397928-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:07:27 crc kubenswrapper[5120]: I0316 17:07:27.940079 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vbgvx\" (UniqueName: \"kubernetes.io/projected/07fab23c-ba13-4edc-921f-5ff095397928-kube-api-access-vbgvx\") on node \"crc\" DevicePath \"\"" Mar 16 17:07:27 crc kubenswrapper[5120]: I0316 17:07:27.940147 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/07fab23c-ba13-4edc-921f-5ff095397928-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 17:07:27 crc kubenswrapper[5120]: I0316 17:07:27.953874 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07fab23c-ba13-4edc-921f-5ff095397928-config-data" (OuterVolumeSpecName: "config-data") pod "07fab23c-ba13-4edc-921f-5ff095397928" (UID: "07fab23c-ba13-4edc-921f-5ff095397928"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:07:28 crc kubenswrapper[5120]: I0316 17:07:28.043104 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/07fab23c-ba13-4edc-921f-5ff095397928-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:07:28 crc kubenswrapper[5120]: I0316 17:07:28.044878 5120 scope.go:117] "RemoveContainer" containerID="e34d91e2d5484e302cc10073074e0ef7ec543eff491fe1cbcbf4f3d986d59e07" Mar 16 17:07:28 crc kubenswrapper[5120]: I0316 17:07:28.065085 5120 scope.go:117] "RemoveContainer" containerID="328a75582227369a883c8f5a2f34d630d36c4531260c450848de3af0734abc19" Mar 16 17:07:28 crc kubenswrapper[5120]: E0316 17:07:28.065579 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"328a75582227369a883c8f5a2f34d630d36c4531260c450848de3af0734abc19\": container with ID starting with 328a75582227369a883c8f5a2f34d630d36c4531260c450848de3af0734abc19 not found: ID does not exist" containerID="328a75582227369a883c8f5a2f34d630d36c4531260c450848de3af0734abc19" Mar 16 17:07:28 crc kubenswrapper[5120]: I0316 17:07:28.065636 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"328a75582227369a883c8f5a2f34d630d36c4531260c450848de3af0734abc19"} err="failed to get container status \"328a75582227369a883c8f5a2f34d630d36c4531260c450848de3af0734abc19\": rpc error: code = NotFound desc = could not find container \"328a75582227369a883c8f5a2f34d630d36c4531260c450848de3af0734abc19\": container with ID starting with 328a75582227369a883c8f5a2f34d630d36c4531260c450848de3af0734abc19 not found: ID does not exist" Mar 16 17:07:28 crc kubenswrapper[5120]: I0316 17:07:28.065669 5120 scope.go:117] "RemoveContainer" containerID="af4a1813b5822ec6224caaea7e89b284ea1457e530a20e6f28f622a0c49d2c13" Mar 16 17:07:28 crc kubenswrapper[5120]: E0316 17:07:28.065998 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af4a1813b5822ec6224caaea7e89b284ea1457e530a20e6f28f622a0c49d2c13\": container with ID starting with af4a1813b5822ec6224caaea7e89b284ea1457e530a20e6f28f622a0c49d2c13 not found: ID does not exist" containerID="af4a1813b5822ec6224caaea7e89b284ea1457e530a20e6f28f622a0c49d2c13" Mar 16 17:07:28 crc kubenswrapper[5120]: I0316 17:07:28.066037 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af4a1813b5822ec6224caaea7e89b284ea1457e530a20e6f28f622a0c49d2c13"} err="failed to get container status \"af4a1813b5822ec6224caaea7e89b284ea1457e530a20e6f28f622a0c49d2c13\": rpc error: code = NotFound desc = could not find container \"af4a1813b5822ec6224caaea7e89b284ea1457e530a20e6f28f622a0c49d2c13\": container with ID starting with af4a1813b5822ec6224caaea7e89b284ea1457e530a20e6f28f622a0c49d2c13 not found: ID does not exist" Mar 16 17:07:28 crc kubenswrapper[5120]: I0316 17:07:28.066056 5120 scope.go:117] "RemoveContainer" containerID="d84133fa679de58c5a7b33b1aeed8e1e076bfe6cc56a12e2ac35621adf0da354" Mar 16 17:07:28 crc kubenswrapper[5120]: E0316 17:07:28.066349 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d84133fa679de58c5a7b33b1aeed8e1e076bfe6cc56a12e2ac35621adf0da354\": container with ID starting with d84133fa679de58c5a7b33b1aeed8e1e076bfe6cc56a12e2ac35621adf0da354 not found: ID does not exist" containerID="d84133fa679de58c5a7b33b1aeed8e1e076bfe6cc56a12e2ac35621adf0da354" Mar 16 17:07:28 crc kubenswrapper[5120]: I0316 17:07:28.066384 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d84133fa679de58c5a7b33b1aeed8e1e076bfe6cc56a12e2ac35621adf0da354"} err="failed to get container status \"d84133fa679de58c5a7b33b1aeed8e1e076bfe6cc56a12e2ac35621adf0da354\": rpc error: code = NotFound desc = could not find container \"d84133fa679de58c5a7b33b1aeed8e1e076bfe6cc56a12e2ac35621adf0da354\": container with ID starting with d84133fa679de58c5a7b33b1aeed8e1e076bfe6cc56a12e2ac35621adf0da354 not found: ID does not exist" Mar 16 17:07:28 crc kubenswrapper[5120]: I0316 17:07:28.066404 5120 scope.go:117] "RemoveContainer" containerID="e34d91e2d5484e302cc10073074e0ef7ec543eff491fe1cbcbf4f3d986d59e07" Mar 16 17:07:28 crc kubenswrapper[5120]: E0316 17:07:28.066664 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e34d91e2d5484e302cc10073074e0ef7ec543eff491fe1cbcbf4f3d986d59e07\": container with ID starting with e34d91e2d5484e302cc10073074e0ef7ec543eff491fe1cbcbf4f3d986d59e07 not found: ID does not exist" containerID="e34d91e2d5484e302cc10073074e0ef7ec543eff491fe1cbcbf4f3d986d59e07" Mar 16 17:07:28 crc kubenswrapper[5120]: I0316 17:07:28.066697 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e34d91e2d5484e302cc10073074e0ef7ec543eff491fe1cbcbf4f3d986d59e07"} err="failed to get container status \"e34d91e2d5484e302cc10073074e0ef7ec543eff491fe1cbcbf4f3d986d59e07\": rpc error: code = NotFound desc = could not find container \"e34d91e2d5484e302cc10073074e0ef7ec543eff491fe1cbcbf4f3d986d59e07\": container with ID starting with e34d91e2d5484e302cc10073074e0ef7ec543eff491fe1cbcbf4f3d986d59e07 not found: ID does not exist" Mar 16 17:07:28 crc kubenswrapper[5120]: I0316 17:07:28.066725 5120 scope.go:117] "RemoveContainer" containerID="328a75582227369a883c8f5a2f34d630d36c4531260c450848de3af0734abc19" Mar 16 17:07:28 crc kubenswrapper[5120]: I0316 17:07:28.067155 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"328a75582227369a883c8f5a2f34d630d36c4531260c450848de3af0734abc19"} err="failed to get container status \"328a75582227369a883c8f5a2f34d630d36c4531260c450848de3af0734abc19\": rpc error: code = NotFound desc = could not find container \"328a75582227369a883c8f5a2f34d630d36c4531260c450848de3af0734abc19\": container with ID starting with 328a75582227369a883c8f5a2f34d630d36c4531260c450848de3af0734abc19 not found: ID does not exist" Mar 16 17:07:28 crc kubenswrapper[5120]: I0316 17:07:28.067182 5120 scope.go:117] "RemoveContainer" containerID="af4a1813b5822ec6224caaea7e89b284ea1457e530a20e6f28f622a0c49d2c13" Mar 16 17:07:28 crc kubenswrapper[5120]: I0316 17:07:28.067451 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af4a1813b5822ec6224caaea7e89b284ea1457e530a20e6f28f622a0c49d2c13"} err="failed to get container status \"af4a1813b5822ec6224caaea7e89b284ea1457e530a20e6f28f622a0c49d2c13\": rpc error: code = NotFound desc = could not find container \"af4a1813b5822ec6224caaea7e89b284ea1457e530a20e6f28f622a0c49d2c13\": container with ID starting with af4a1813b5822ec6224caaea7e89b284ea1457e530a20e6f28f622a0c49d2c13 not found: ID does not exist" Mar 16 17:07:28 crc kubenswrapper[5120]: I0316 17:07:28.067475 5120 scope.go:117] "RemoveContainer" containerID="d84133fa679de58c5a7b33b1aeed8e1e076bfe6cc56a12e2ac35621adf0da354" Mar 16 17:07:28 crc kubenswrapper[5120]: I0316 17:07:28.067661 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d84133fa679de58c5a7b33b1aeed8e1e076bfe6cc56a12e2ac35621adf0da354"} err="failed to get container status \"d84133fa679de58c5a7b33b1aeed8e1e076bfe6cc56a12e2ac35621adf0da354\": rpc error: code = NotFound desc = could not find container \"d84133fa679de58c5a7b33b1aeed8e1e076bfe6cc56a12e2ac35621adf0da354\": container with ID starting with d84133fa679de58c5a7b33b1aeed8e1e076bfe6cc56a12e2ac35621adf0da354 not found: ID does not exist" Mar 16 17:07:28 crc kubenswrapper[5120]: I0316 17:07:28.067911 5120 scope.go:117] "RemoveContainer" containerID="e34d91e2d5484e302cc10073074e0ef7ec543eff491fe1cbcbf4f3d986d59e07" Mar 16 17:07:28 crc kubenswrapper[5120]: I0316 17:07:28.068249 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e34d91e2d5484e302cc10073074e0ef7ec543eff491fe1cbcbf4f3d986d59e07"} err="failed to get container status \"e34d91e2d5484e302cc10073074e0ef7ec543eff491fe1cbcbf4f3d986d59e07\": rpc error: code = NotFound desc = could not find container \"e34d91e2d5484e302cc10073074e0ef7ec543eff491fe1cbcbf4f3d986d59e07\": container with ID starting with e34d91e2d5484e302cc10073074e0ef7ec543eff491fe1cbcbf4f3d986d59e07 not found: ID does not exist" Mar 16 17:07:28 crc kubenswrapper[5120]: I0316 17:07:28.068280 5120 scope.go:117] "RemoveContainer" containerID="328a75582227369a883c8f5a2f34d630d36c4531260c450848de3af0734abc19" Mar 16 17:07:28 crc kubenswrapper[5120]: I0316 17:07:28.068519 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"328a75582227369a883c8f5a2f34d630d36c4531260c450848de3af0734abc19"} err="failed to get container status \"328a75582227369a883c8f5a2f34d630d36c4531260c450848de3af0734abc19\": rpc error: code = NotFound desc = could not find container \"328a75582227369a883c8f5a2f34d630d36c4531260c450848de3af0734abc19\": container with ID starting with 328a75582227369a883c8f5a2f34d630d36c4531260c450848de3af0734abc19 not found: ID does not exist" Mar 16 17:07:28 crc kubenswrapper[5120]: I0316 17:07:28.068606 5120 scope.go:117] "RemoveContainer" containerID="af4a1813b5822ec6224caaea7e89b284ea1457e530a20e6f28f622a0c49d2c13" Mar 16 17:07:28 crc kubenswrapper[5120]: I0316 17:07:28.068897 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af4a1813b5822ec6224caaea7e89b284ea1457e530a20e6f28f622a0c49d2c13"} err="failed to get container status \"af4a1813b5822ec6224caaea7e89b284ea1457e530a20e6f28f622a0c49d2c13\": rpc error: code = NotFound desc = could not find container \"af4a1813b5822ec6224caaea7e89b284ea1457e530a20e6f28f622a0c49d2c13\": container with ID starting with af4a1813b5822ec6224caaea7e89b284ea1457e530a20e6f28f622a0c49d2c13 not found: ID does not exist" Mar 16 17:07:28 crc kubenswrapper[5120]: I0316 17:07:28.068922 5120 scope.go:117] "RemoveContainer" containerID="d84133fa679de58c5a7b33b1aeed8e1e076bfe6cc56a12e2ac35621adf0da354" Mar 16 17:07:28 crc kubenswrapper[5120]: I0316 17:07:28.069117 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d84133fa679de58c5a7b33b1aeed8e1e076bfe6cc56a12e2ac35621adf0da354"} err="failed to get container status \"d84133fa679de58c5a7b33b1aeed8e1e076bfe6cc56a12e2ac35621adf0da354\": rpc error: code = NotFound desc = could not find container \"d84133fa679de58c5a7b33b1aeed8e1e076bfe6cc56a12e2ac35621adf0da354\": container with ID starting with d84133fa679de58c5a7b33b1aeed8e1e076bfe6cc56a12e2ac35621adf0da354 not found: ID does not exist" Mar 16 17:07:28 crc kubenswrapper[5120]: I0316 17:07:28.069200 5120 scope.go:117] "RemoveContainer" containerID="e34d91e2d5484e302cc10073074e0ef7ec543eff491fe1cbcbf4f3d986d59e07" Mar 16 17:07:28 crc kubenswrapper[5120]: I0316 17:07:28.069908 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e34d91e2d5484e302cc10073074e0ef7ec543eff491fe1cbcbf4f3d986d59e07"} err="failed to get container status \"e34d91e2d5484e302cc10073074e0ef7ec543eff491fe1cbcbf4f3d986d59e07\": rpc error: code = NotFound desc = could not find container \"e34d91e2d5484e302cc10073074e0ef7ec543eff491fe1cbcbf4f3d986d59e07\": container with ID starting with e34d91e2d5484e302cc10073074e0ef7ec543eff491fe1cbcbf4f3d986d59e07 not found: ID does not exist" Mar 16 17:07:28 crc kubenswrapper[5120]: I0316 17:07:28.106507 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:07:28 crc kubenswrapper[5120]: I0316 17:07:28.121094 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:07:28 crc kubenswrapper[5120]: I0316 17:07:28.134788 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:07:28 crc kubenswrapper[5120]: I0316 17:07:28.135967 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39020bfa-624a-485d-8a2e-517cc5eb177d" containerName="registry-server" Mar 16 17:07:28 crc kubenswrapper[5120]: I0316 17:07:28.135990 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="39020bfa-624a-485d-8a2e-517cc5eb177d" containerName="registry-server" Mar 16 17:07:28 crc kubenswrapper[5120]: I0316 17:07:28.136006 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39020bfa-624a-485d-8a2e-517cc5eb177d" containerName="extract-content" Mar 16 17:07:28 crc kubenswrapper[5120]: I0316 17:07:28.136012 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="39020bfa-624a-485d-8a2e-517cc5eb177d" containerName="extract-content" Mar 16 17:07:28 crc kubenswrapper[5120]: I0316 17:07:28.136029 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07fab23c-ba13-4edc-921f-5ff095397928" containerName="proxy-httpd" Mar 16 17:07:28 crc kubenswrapper[5120]: I0316 17:07:28.136035 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="07fab23c-ba13-4edc-921f-5ff095397928" containerName="proxy-httpd" Mar 16 17:07:28 crc kubenswrapper[5120]: I0316 17:07:28.136044 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07fab23c-ba13-4edc-921f-5ff095397928" containerName="ceilometer-central-agent" Mar 16 17:07:28 crc kubenswrapper[5120]: I0316 17:07:28.136051 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="07fab23c-ba13-4edc-921f-5ff095397928" containerName="ceilometer-central-agent" Mar 16 17:07:28 crc kubenswrapper[5120]: I0316 17:07:28.136090 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07fab23c-ba13-4edc-921f-5ff095397928" containerName="ceilometer-notification-agent" Mar 16 17:07:28 crc kubenswrapper[5120]: I0316 17:07:28.136096 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="07fab23c-ba13-4edc-921f-5ff095397928" containerName="ceilometer-notification-agent" Mar 16 17:07:28 crc kubenswrapper[5120]: I0316 17:07:28.136109 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39020bfa-624a-485d-8a2e-517cc5eb177d" containerName="extract-utilities" Mar 16 17:07:28 crc kubenswrapper[5120]: I0316 17:07:28.136115 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="39020bfa-624a-485d-8a2e-517cc5eb177d" containerName="extract-utilities" Mar 16 17:07:28 crc kubenswrapper[5120]: I0316 17:07:28.136128 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07fab23c-ba13-4edc-921f-5ff095397928" containerName="sg-core" Mar 16 17:07:28 crc kubenswrapper[5120]: I0316 17:07:28.136133 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="07fab23c-ba13-4edc-921f-5ff095397928" containerName="sg-core" Mar 16 17:07:28 crc kubenswrapper[5120]: I0316 17:07:28.136326 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="07fab23c-ba13-4edc-921f-5ff095397928" containerName="proxy-httpd" Mar 16 17:07:28 crc kubenswrapper[5120]: I0316 17:07:28.136339 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="07fab23c-ba13-4edc-921f-5ff095397928" containerName="ceilometer-central-agent" Mar 16 17:07:28 crc kubenswrapper[5120]: I0316 17:07:28.136350 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="07fab23c-ba13-4edc-921f-5ff095397928" containerName="ceilometer-notification-agent" Mar 16 17:07:28 crc kubenswrapper[5120]: I0316 17:07:28.136363 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="39020bfa-624a-485d-8a2e-517cc5eb177d" containerName="registry-server" Mar 16 17:07:28 crc kubenswrapper[5120]: I0316 17:07:28.136373 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="07fab23c-ba13-4edc-921f-5ff095397928" containerName="sg-core" Mar 16 17:07:28 crc kubenswrapper[5120]: I0316 17:07:28.147154 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:07:28 crc kubenswrapper[5120]: I0316 17:07:28.148701 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:07:28 crc kubenswrapper[5120]: I0316 17:07:28.155176 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 17:07:28 crc kubenswrapper[5120]: I0316 17:07:28.155508 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 17:07:28 crc kubenswrapper[5120]: I0316 17:07:28.155906 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ceilometer-internal-svc\"" Mar 16 17:07:28 crc kubenswrapper[5120]: I0316 17:07:28.247030 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:07:28 crc kubenswrapper[5120]: I0316 17:07:28.247086 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8-run-httpd\") pod \"ceilometer-0\" (UID: \"3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:07:28 crc kubenswrapper[5120]: I0316 17:07:28.247352 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfhkm\" (UniqueName: \"kubernetes.io/projected/3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8-kube-api-access-tfhkm\") pod \"ceilometer-0\" (UID: \"3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:07:28 crc kubenswrapper[5120]: I0316 17:07:28.247407 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:07:28 crc kubenswrapper[5120]: I0316 17:07:28.247926 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:07:28 crc kubenswrapper[5120]: I0316 17:07:28.248031 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8-config-data\") pod \"ceilometer-0\" (UID: \"3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:07:28 crc kubenswrapper[5120]: I0316 17:07:28.248102 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8-scripts\") pod \"ceilometer-0\" (UID: \"3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:07:28 crc kubenswrapper[5120]: I0316 17:07:28.248301 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8-log-httpd\") pod \"ceilometer-0\" (UID: \"3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:07:28 crc kubenswrapper[5120]: I0316 17:07:28.350741 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:07:28 crc kubenswrapper[5120]: I0316 17:07:28.350836 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8-config-data\") pod \"ceilometer-0\" (UID: \"3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:07:28 crc kubenswrapper[5120]: I0316 17:07:28.350863 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8-scripts\") pod \"ceilometer-0\" (UID: \"3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:07:28 crc kubenswrapper[5120]: I0316 17:07:28.350999 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8-log-httpd\") pod \"ceilometer-0\" (UID: \"3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:07:28 crc kubenswrapper[5120]: I0316 17:07:28.351191 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:07:28 crc kubenswrapper[5120]: I0316 17:07:28.351241 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8-run-httpd\") pod \"ceilometer-0\" (UID: \"3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:07:28 crc kubenswrapper[5120]: I0316 17:07:28.351366 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tfhkm\" (UniqueName: \"kubernetes.io/projected/3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8-kube-api-access-tfhkm\") pod \"ceilometer-0\" (UID: \"3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:07:28 crc kubenswrapper[5120]: I0316 17:07:28.351415 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:07:28 crc kubenswrapper[5120]: I0316 17:07:28.351642 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8-log-httpd\") pod \"ceilometer-0\" (UID: \"3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:07:28 crc kubenswrapper[5120]: I0316 17:07:28.352146 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8-run-httpd\") pod \"ceilometer-0\" (UID: \"3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:07:28 crc kubenswrapper[5120]: I0316 17:07:28.356825 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:07:28 crc kubenswrapper[5120]: I0316 17:07:28.358066 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:07:28 crc kubenswrapper[5120]: I0316 17:07:28.358122 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8-config-data\") pod \"ceilometer-0\" (UID: \"3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:07:28 crc kubenswrapper[5120]: I0316 17:07:28.358438 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:07:28 crc kubenswrapper[5120]: I0316 17:07:28.370819 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8-scripts\") pod \"ceilometer-0\" (UID: \"3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:07:28 crc kubenswrapper[5120]: I0316 17:07:28.373594 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfhkm\" (UniqueName: \"kubernetes.io/projected/3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8-kube-api-access-tfhkm\") pod \"ceilometer-0\" (UID: \"3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:07:28 crc kubenswrapper[5120]: I0316 17:07:28.467487 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:07:28 crc kubenswrapper[5120]: I0316 17:07:28.682683 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="07fab23c-ba13-4edc-921f-5ff095397928" path="/var/lib/kubelet/pods/07fab23c-ba13-4edc-921f-5ff095397928/volumes" Mar 16 17:07:28 crc kubenswrapper[5120]: I0316 17:07:28.721571 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:07:28 crc kubenswrapper[5120]: I0316 17:07:28.780474 5120 generic.go:358] "Generic (PLEG): container finished" podID="f280ed38-a71f-4438-80c1-92cdea7075e0" containerID="85d06857f2e6ac0b12e32fee76e5bacddb4d623b1414eeb7c8afe1757d9e7654" exitCode=143 Mar 16 17:07:28 crc kubenswrapper[5120]: I0316 17:07:28.780564 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"f280ed38-a71f-4438-80c1-92cdea7075e0","Type":"ContainerDied","Data":"85d06857f2e6ac0b12e32fee76e5bacddb4d623b1414eeb7c8afe1757d9e7654"} Mar 16 17:07:28 crc kubenswrapper[5120]: I0316 17:07:28.951499 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:07:29 crc kubenswrapper[5120]: I0316 17:07:29.793735 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8","Type":"ContainerStarted","Data":"9aa1181b5b6e62f592be9fd3fa7cf09ca6f2fcd7ddc82bdc83a4872e3cd7aa5c"} Mar 16 17:07:30 crc kubenswrapper[5120]: I0316 17:07:30.804371 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8","Type":"ContainerStarted","Data":"18923c8ec7669847bfdf079788331af0c5b3c5f916cc5eab12eb27447998d12f"} Mar 16 17:07:30 crc kubenswrapper[5120]: I0316 17:07:30.804667 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8","Type":"ContainerStarted","Data":"603ff86600d1e7da0ffa0d4d713fdf79bd0405aa9c1f61bc9a158cbd61e39c48"} Mar 16 17:07:31 crc kubenswrapper[5120]: I0316 17:07:31.457525 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:07:31 crc kubenswrapper[5120]: I0316 17:07:31.544388 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f280ed38-a71f-4438-80c1-92cdea7075e0-logs\") pod \"f280ed38-a71f-4438-80c1-92cdea7075e0\" (UID: \"f280ed38-a71f-4438-80c1-92cdea7075e0\") " Mar 16 17:07:31 crc kubenswrapper[5120]: I0316 17:07:31.544519 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f280ed38-a71f-4438-80c1-92cdea7075e0-config-data\") pod \"f280ed38-a71f-4438-80c1-92cdea7075e0\" (UID: \"f280ed38-a71f-4438-80c1-92cdea7075e0\") " Mar 16 17:07:31 crc kubenswrapper[5120]: I0316 17:07:31.544817 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f280ed38-a71f-4438-80c1-92cdea7075e0-logs" (OuterVolumeSpecName: "logs") pod "f280ed38-a71f-4438-80c1-92cdea7075e0" (UID: "f280ed38-a71f-4438-80c1-92cdea7075e0"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:07:31 crc kubenswrapper[5120]: I0316 17:07:31.545272 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-48bck\" (UniqueName: \"kubernetes.io/projected/f280ed38-a71f-4438-80c1-92cdea7075e0-kube-api-access-48bck\") pod \"f280ed38-a71f-4438-80c1-92cdea7075e0\" (UID: \"f280ed38-a71f-4438-80c1-92cdea7075e0\") " Mar 16 17:07:31 crc kubenswrapper[5120]: I0316 17:07:31.545341 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f280ed38-a71f-4438-80c1-92cdea7075e0-combined-ca-bundle\") pod \"f280ed38-a71f-4438-80c1-92cdea7075e0\" (UID: \"f280ed38-a71f-4438-80c1-92cdea7075e0\") " Mar 16 17:07:31 crc kubenswrapper[5120]: I0316 17:07:31.546696 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f280ed38-a71f-4438-80c1-92cdea7075e0-logs\") on node \"crc\" DevicePath \"\"" Mar 16 17:07:31 crc kubenswrapper[5120]: I0316 17:07:31.548799 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f280ed38-a71f-4438-80c1-92cdea7075e0-kube-api-access-48bck" (OuterVolumeSpecName: "kube-api-access-48bck") pod "f280ed38-a71f-4438-80c1-92cdea7075e0" (UID: "f280ed38-a71f-4438-80c1-92cdea7075e0"). InnerVolumeSpecName "kube-api-access-48bck". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:07:31 crc kubenswrapper[5120]: I0316 17:07:31.579800 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f280ed38-a71f-4438-80c1-92cdea7075e0-config-data" (OuterVolumeSpecName: "config-data") pod "f280ed38-a71f-4438-80c1-92cdea7075e0" (UID: "f280ed38-a71f-4438-80c1-92cdea7075e0"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:07:31 crc kubenswrapper[5120]: I0316 17:07:31.581996 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f280ed38-a71f-4438-80c1-92cdea7075e0-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f280ed38-a71f-4438-80c1-92cdea7075e0" (UID: "f280ed38-a71f-4438-80c1-92cdea7075e0"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:07:31 crc kubenswrapper[5120]: I0316 17:07:31.648477 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-48bck\" (UniqueName: \"kubernetes.io/projected/f280ed38-a71f-4438-80c1-92cdea7075e0-kube-api-access-48bck\") on node \"crc\" DevicePath \"\"" Mar 16 17:07:31 crc kubenswrapper[5120]: I0316 17:07:31.648522 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f280ed38-a71f-4438-80c1-92cdea7075e0-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:07:31 crc kubenswrapper[5120]: I0316 17:07:31.648534 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f280ed38-a71f-4438-80c1-92cdea7075e0-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:07:31 crc kubenswrapper[5120]: I0316 17:07:31.816159 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8","Type":"ContainerStarted","Data":"a2f33d8acdbe2353757787bfca08008a12a789d2cf00051da5beeba6a9d7ffde"} Mar 16 17:07:31 crc kubenswrapper[5120]: I0316 17:07:31.818338 5120 generic.go:358] "Generic (PLEG): container finished" podID="f280ed38-a71f-4438-80c1-92cdea7075e0" containerID="293255a6a66dbc894c43f487895bbf455cf5383dd6c6ef65bf783a45c757f038" exitCode=0 Mar 16 17:07:31 crc kubenswrapper[5120]: I0316 17:07:31.818737 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"f280ed38-a71f-4438-80c1-92cdea7075e0","Type":"ContainerDied","Data":"293255a6a66dbc894c43f487895bbf455cf5383dd6c6ef65bf783a45c757f038"} Mar 16 17:07:31 crc kubenswrapper[5120]: I0316 17:07:31.818792 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"f280ed38-a71f-4438-80c1-92cdea7075e0","Type":"ContainerDied","Data":"657b004df2a7c4d18107f71644b043ec877da2c325043b0c3f51e19c77ba1b38"} Mar 16 17:07:31 crc kubenswrapper[5120]: I0316 17:07:31.818814 5120 scope.go:117] "RemoveContainer" containerID="293255a6a66dbc894c43f487895bbf455cf5383dd6c6ef65bf783a45c757f038" Mar 16 17:07:31 crc kubenswrapper[5120]: I0316 17:07:31.818973 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:07:31 crc kubenswrapper[5120]: I0316 17:07:31.857863 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 17:07:31 crc kubenswrapper[5120]: I0316 17:07:31.862593 5120 scope.go:117] "RemoveContainer" containerID="85d06857f2e6ac0b12e32fee76e5bacddb4d623b1414eeb7c8afe1757d9e7654" Mar 16 17:07:31 crc kubenswrapper[5120]: I0316 17:07:31.881217 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 17:07:31 crc kubenswrapper[5120]: I0316 17:07:31.889992 5120 scope.go:117] "RemoveContainer" containerID="293255a6a66dbc894c43f487895bbf455cf5383dd6c6ef65bf783a45c757f038" Mar 16 17:07:31 crc kubenswrapper[5120]: E0316 17:07:31.890440 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"293255a6a66dbc894c43f487895bbf455cf5383dd6c6ef65bf783a45c757f038\": container with ID starting with 293255a6a66dbc894c43f487895bbf455cf5383dd6c6ef65bf783a45c757f038 not found: ID does not exist" containerID="293255a6a66dbc894c43f487895bbf455cf5383dd6c6ef65bf783a45c757f038" Mar 16 17:07:31 crc kubenswrapper[5120]: I0316 17:07:31.890476 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"293255a6a66dbc894c43f487895bbf455cf5383dd6c6ef65bf783a45c757f038"} err="failed to get container status \"293255a6a66dbc894c43f487895bbf455cf5383dd6c6ef65bf783a45c757f038\": rpc error: code = NotFound desc = could not find container \"293255a6a66dbc894c43f487895bbf455cf5383dd6c6ef65bf783a45c757f038\": container with ID starting with 293255a6a66dbc894c43f487895bbf455cf5383dd6c6ef65bf783a45c757f038 not found: ID does not exist" Mar 16 17:07:31 crc kubenswrapper[5120]: I0316 17:07:31.890495 5120 scope.go:117] "RemoveContainer" containerID="85d06857f2e6ac0b12e32fee76e5bacddb4d623b1414eeb7c8afe1757d9e7654" Mar 16 17:07:31 crc kubenswrapper[5120]: E0316 17:07:31.891792 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"85d06857f2e6ac0b12e32fee76e5bacddb4d623b1414eeb7c8afe1757d9e7654\": container with ID starting with 85d06857f2e6ac0b12e32fee76e5bacddb4d623b1414eeb7c8afe1757d9e7654 not found: ID does not exist" containerID="85d06857f2e6ac0b12e32fee76e5bacddb4d623b1414eeb7c8afe1757d9e7654" Mar 16 17:07:31 crc kubenswrapper[5120]: I0316 17:07:31.891831 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85d06857f2e6ac0b12e32fee76e5bacddb4d623b1414eeb7c8afe1757d9e7654"} err="failed to get container status \"85d06857f2e6ac0b12e32fee76e5bacddb4d623b1414eeb7c8afe1757d9e7654\": rpc error: code = NotFound desc = could not find container \"85d06857f2e6ac0b12e32fee76e5bacddb4d623b1414eeb7c8afe1757d9e7654\": container with ID starting with 85d06857f2e6ac0b12e32fee76e5bacddb4d623b1414eeb7c8afe1757d9e7654 not found: ID does not exist" Mar 16 17:07:31 crc kubenswrapper[5120]: I0316 17:07:31.891913 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 17:07:31 crc kubenswrapper[5120]: I0316 17:07:31.893040 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f280ed38-a71f-4438-80c1-92cdea7075e0" containerName="nova-api-api" Mar 16 17:07:31 crc kubenswrapper[5120]: I0316 17:07:31.893062 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f280ed38-a71f-4438-80c1-92cdea7075e0" containerName="nova-api-api" Mar 16 17:07:31 crc kubenswrapper[5120]: I0316 17:07:31.893131 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f280ed38-a71f-4438-80c1-92cdea7075e0" containerName="nova-api-log" Mar 16 17:07:31 crc kubenswrapper[5120]: I0316 17:07:31.893139 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f280ed38-a71f-4438-80c1-92cdea7075e0" containerName="nova-api-log" Mar 16 17:07:31 crc kubenswrapper[5120]: I0316 17:07:31.893326 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f280ed38-a71f-4438-80c1-92cdea7075e0" containerName="nova-api-log" Mar 16 17:07:31 crc kubenswrapper[5120]: I0316 17:07:31.893361 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f280ed38-a71f-4438-80c1-92cdea7075e0" containerName="nova-api-api" Mar 16 17:07:31 crc kubenswrapper[5120]: I0316 17:07:31.904685 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 17:07:31 crc kubenswrapper[5120]: I0316 17:07:31.904839 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:07:31 crc kubenswrapper[5120]: I0316 17:07:31.911870 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-config-data\"" Mar 16 17:07:31 crc kubenswrapper[5120]: I0316 17:07:31.911917 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-internal-svc\"" Mar 16 17:07:31 crc kubenswrapper[5120]: I0316 17:07:31.911980 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-public-svc\"" Mar 16 17:07:31 crc kubenswrapper[5120]: I0316 17:07:31.955639 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9dde2b26-18b2-469b-94d1-92da183402fc-logs\") pod \"nova-api-0\" (UID: \"9dde2b26-18b2-469b-94d1-92da183402fc\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:07:31 crc kubenswrapper[5120]: I0316 17:07:31.956247 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwxjf\" (UniqueName: \"kubernetes.io/projected/9dde2b26-18b2-469b-94d1-92da183402fc-kube-api-access-qwxjf\") pod \"nova-api-0\" (UID: \"9dde2b26-18b2-469b-94d1-92da183402fc\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:07:31 crc kubenswrapper[5120]: I0316 17:07:31.956523 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/9dde2b26-18b2-469b-94d1-92da183402fc-public-tls-certs\") pod \"nova-api-0\" (UID: \"9dde2b26-18b2-469b-94d1-92da183402fc\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:07:31 crc kubenswrapper[5120]: I0316 17:07:31.956605 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/9dde2b26-18b2-469b-94d1-92da183402fc-internal-tls-certs\") pod \"nova-api-0\" (UID: \"9dde2b26-18b2-469b-94d1-92da183402fc\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:07:31 crc kubenswrapper[5120]: I0316 17:07:31.956704 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9dde2b26-18b2-469b-94d1-92da183402fc-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"9dde2b26-18b2-469b-94d1-92da183402fc\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:07:31 crc kubenswrapper[5120]: I0316 17:07:31.956800 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9dde2b26-18b2-469b-94d1-92da183402fc-config-data\") pod \"nova-api-0\" (UID: \"9dde2b26-18b2-469b-94d1-92da183402fc\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:07:32 crc kubenswrapper[5120]: I0316 17:07:32.059441 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qwxjf\" (UniqueName: \"kubernetes.io/projected/9dde2b26-18b2-469b-94d1-92da183402fc-kube-api-access-qwxjf\") pod \"nova-api-0\" (UID: \"9dde2b26-18b2-469b-94d1-92da183402fc\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:07:32 crc kubenswrapper[5120]: I0316 17:07:32.059599 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/9dde2b26-18b2-469b-94d1-92da183402fc-public-tls-certs\") pod \"nova-api-0\" (UID: \"9dde2b26-18b2-469b-94d1-92da183402fc\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:07:32 crc kubenswrapper[5120]: I0316 17:07:32.059651 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/9dde2b26-18b2-469b-94d1-92da183402fc-internal-tls-certs\") pod \"nova-api-0\" (UID: \"9dde2b26-18b2-469b-94d1-92da183402fc\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:07:32 crc kubenswrapper[5120]: I0316 17:07:32.059675 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9dde2b26-18b2-469b-94d1-92da183402fc-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"9dde2b26-18b2-469b-94d1-92da183402fc\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:07:32 crc kubenswrapper[5120]: I0316 17:07:32.059706 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9dde2b26-18b2-469b-94d1-92da183402fc-config-data\") pod \"nova-api-0\" (UID: \"9dde2b26-18b2-469b-94d1-92da183402fc\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:07:32 crc kubenswrapper[5120]: I0316 17:07:32.059780 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9dde2b26-18b2-469b-94d1-92da183402fc-logs\") pod \"nova-api-0\" (UID: \"9dde2b26-18b2-469b-94d1-92da183402fc\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:07:32 crc kubenswrapper[5120]: I0316 17:07:32.060213 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9dde2b26-18b2-469b-94d1-92da183402fc-logs\") pod \"nova-api-0\" (UID: \"9dde2b26-18b2-469b-94d1-92da183402fc\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:07:32 crc kubenswrapper[5120]: I0316 17:07:32.065362 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/9dde2b26-18b2-469b-94d1-92da183402fc-public-tls-certs\") pod \"nova-api-0\" (UID: \"9dde2b26-18b2-469b-94d1-92da183402fc\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:07:32 crc kubenswrapper[5120]: I0316 17:07:32.065412 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9dde2b26-18b2-469b-94d1-92da183402fc-config-data\") pod \"nova-api-0\" (UID: \"9dde2b26-18b2-469b-94d1-92da183402fc\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:07:32 crc kubenswrapper[5120]: I0316 17:07:32.066482 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9dde2b26-18b2-469b-94d1-92da183402fc-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"9dde2b26-18b2-469b-94d1-92da183402fc\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:07:32 crc kubenswrapper[5120]: I0316 17:07:32.080035 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/9dde2b26-18b2-469b-94d1-92da183402fc-internal-tls-certs\") pod \"nova-api-0\" (UID: \"9dde2b26-18b2-469b-94d1-92da183402fc\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:07:32 crc kubenswrapper[5120]: I0316 17:07:32.080596 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwxjf\" (UniqueName: \"kubernetes.io/projected/9dde2b26-18b2-469b-94d1-92da183402fc-kube-api-access-qwxjf\") pod \"nova-api-0\" (UID: \"9dde2b26-18b2-469b-94d1-92da183402fc\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:07:32 crc kubenswrapper[5120]: I0316 17:07:32.231046 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:07:32 crc kubenswrapper[5120]: I0316 17:07:32.676951 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f280ed38-a71f-4438-80c1-92cdea7075e0" path="/var/lib/kubelet/pods/f280ed38-a71f-4438-80c1-92cdea7075e0/volumes" Mar 16 17:07:32 crc kubenswrapper[5120]: I0316 17:07:32.680367 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 17:07:32 crc kubenswrapper[5120]: W0316 17:07:32.682411 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9dde2b26_18b2_469b_94d1_92da183402fc.slice/crio-41486997eb501731865b0a3d4dcf07f4ab8bc484d2bf5a2039cc2a2d618e283b WatchSource:0}: Error finding container 41486997eb501731865b0a3d4dcf07f4ab8bc484d2bf5a2039cc2a2d618e283b: Status 404 returned error can't find the container with id 41486997eb501731865b0a3d4dcf07f4ab8bc484d2bf5a2039cc2a2d618e283b Mar 16 17:07:32 crc kubenswrapper[5120]: I0316 17:07:32.833148 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"9dde2b26-18b2-469b-94d1-92da183402fc","Type":"ContainerStarted","Data":"41486997eb501731865b0a3d4dcf07f4ab8bc484d2bf5a2039cc2a2d618e283b"} Mar 16 17:07:33 crc kubenswrapper[5120]: I0316 17:07:33.848301 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"9dde2b26-18b2-469b-94d1-92da183402fc","Type":"ContainerStarted","Data":"826523d22c0f17610c94f5ab82fd83f348513fd8f4f1dac94cefc1a9fb7f997c"} Mar 16 17:07:33 crc kubenswrapper[5120]: I0316 17:07:33.848680 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"9dde2b26-18b2-469b-94d1-92da183402fc","Type":"ContainerStarted","Data":"dc6a6cb1197c6dd1f31981da01142c0924c2b5390f63c67e892c9c4f82c3320e"} Mar 16 17:07:33 crc kubenswrapper[5120]: I0316 17:07:33.851365 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8","Type":"ContainerStarted","Data":"317ac4527e14e5d97767351bcc6df08bede7f79ad7f03e49d3dfc08e07bab786"} Mar 16 17:07:33 crc kubenswrapper[5120]: I0316 17:07:33.851520 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8" containerName="ceilometer-central-agent" containerID="cri-o://603ff86600d1e7da0ffa0d4d713fdf79bd0405aa9c1f61bc9a158cbd61e39c48" gracePeriod=30 Mar 16 17:07:33 crc kubenswrapper[5120]: I0316 17:07:33.851595 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8" containerName="proxy-httpd" containerID="cri-o://317ac4527e14e5d97767351bcc6df08bede7f79ad7f03e49d3dfc08e07bab786" gracePeriod=30 Mar 16 17:07:33 crc kubenswrapper[5120]: I0316 17:07:33.851611 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:07:33 crc kubenswrapper[5120]: I0316 17:07:33.851642 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8" containerName="sg-core" containerID="cri-o://a2f33d8acdbe2353757787bfca08008a12a789d2cf00051da5beeba6a9d7ffde" gracePeriod=30 Mar 16 17:07:33 crc kubenswrapper[5120]: I0316 17:07:33.851685 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8" containerName="ceilometer-notification-agent" containerID="cri-o://18923c8ec7669847bfdf079788331af0c5b3c5f916cc5eab12eb27447998d12f" gracePeriod=30 Mar 16 17:07:33 crc kubenswrapper[5120]: I0316 17:07:33.880754 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=2.880733593 podStartE2EDuration="2.880733593s" podCreationTimestamp="2026-03-16 17:07:31 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:07:33.868146445 +0000 UTC m=+5756.022078102" watchObservedRunningTime="2026-03-16 17:07:33.880733593 +0000 UTC m=+5756.034665250" Mar 16 17:07:33 crc kubenswrapper[5120]: I0316 17:07:33.896812 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=1.525686504 podStartE2EDuration="5.896753616s" podCreationTimestamp="2026-03-16 17:07:28 +0000 UTC" firstStartedPulling="2026-03-16 17:07:28.958044133 +0000 UTC m=+5751.111975790" lastFinishedPulling="2026-03-16 17:07:33.329111245 +0000 UTC m=+5755.483042902" observedRunningTime="2026-03-16 17:07:33.89148026 +0000 UTC m=+5756.045411927" watchObservedRunningTime="2026-03-16 17:07:33.896753616 +0000 UTC m=+5756.050685273" Mar 16 17:07:34 crc kubenswrapper[5120]: E0316 17:07:34.757079 5120 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfc772fff_eba2_4aa4_85ff_40057e068148.slice/crio-e9e927aa88712ffcef7dbe6a7389f1734f487859737adb662ad3224b816a100f\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfc772fff_eba2_4aa4_85ff_40057e068148.slice\": RecentStats: unable to find data in memory cache]" Mar 16 17:07:34 crc kubenswrapper[5120]: I0316 17:07:34.865781 5120 generic.go:358] "Generic (PLEG): container finished" podID="3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8" containerID="317ac4527e14e5d97767351bcc6df08bede7f79ad7f03e49d3dfc08e07bab786" exitCode=0 Mar 16 17:07:34 crc kubenswrapper[5120]: I0316 17:07:34.865820 5120 generic.go:358] "Generic (PLEG): container finished" podID="3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8" containerID="a2f33d8acdbe2353757787bfca08008a12a789d2cf00051da5beeba6a9d7ffde" exitCode=2 Mar 16 17:07:34 crc kubenswrapper[5120]: I0316 17:07:34.865829 5120 generic.go:358] "Generic (PLEG): container finished" podID="3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8" containerID="18923c8ec7669847bfdf079788331af0c5b3c5f916cc5eab12eb27447998d12f" exitCode=0 Mar 16 17:07:34 crc kubenswrapper[5120]: I0316 17:07:34.865867 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8","Type":"ContainerDied","Data":"317ac4527e14e5d97767351bcc6df08bede7f79ad7f03e49d3dfc08e07bab786"} Mar 16 17:07:34 crc kubenswrapper[5120]: I0316 17:07:34.865935 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8","Type":"ContainerDied","Data":"a2f33d8acdbe2353757787bfca08008a12a789d2cf00051da5beeba6a9d7ffde"} Mar 16 17:07:34 crc kubenswrapper[5120]: I0316 17:07:34.865979 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8","Type":"ContainerDied","Data":"18923c8ec7669847bfdf079788331af0c5b3c5f916cc5eab12eb27447998d12f"} Mar 16 17:07:35 crc kubenswrapper[5120]: I0316 17:07:35.765336 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:07:35 crc kubenswrapper[5120]: I0316 17:07:35.873647 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8-ceilometer-tls-certs\") pod \"3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8\" (UID: \"3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8\") " Mar 16 17:07:35 crc kubenswrapper[5120]: I0316 17:07:35.873891 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8-config-data\") pod \"3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8\" (UID: \"3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8\") " Mar 16 17:07:35 crc kubenswrapper[5120]: I0316 17:07:35.874018 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8-scripts\") pod \"3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8\" (UID: \"3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8\") " Mar 16 17:07:35 crc kubenswrapper[5120]: I0316 17:07:35.874197 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8-combined-ca-bundle\") pod \"3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8\" (UID: \"3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8\") " Mar 16 17:07:35 crc kubenswrapper[5120]: I0316 17:07:35.874339 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tfhkm\" (UniqueName: \"kubernetes.io/projected/3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8-kube-api-access-tfhkm\") pod \"3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8\" (UID: \"3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8\") " Mar 16 17:07:35 crc kubenswrapper[5120]: I0316 17:07:35.874412 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8-run-httpd\") pod \"3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8\" (UID: \"3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8\") " Mar 16 17:07:35 crc kubenswrapper[5120]: I0316 17:07:35.874451 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8-sg-core-conf-yaml\") pod \"3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8\" (UID: \"3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8\") " Mar 16 17:07:35 crc kubenswrapper[5120]: I0316 17:07:35.874529 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8-log-httpd\") pod \"3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8\" (UID: \"3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8\") " Mar 16 17:07:35 crc kubenswrapper[5120]: I0316 17:07:35.875452 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8" (UID: "3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:07:35 crc kubenswrapper[5120]: I0316 17:07:35.876315 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8" (UID: "3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:07:35 crc kubenswrapper[5120]: I0316 17:07:35.879879 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8-scripts" (OuterVolumeSpecName: "scripts") pod "3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8" (UID: "3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:07:35 crc kubenswrapper[5120]: I0316 17:07:35.881222 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8-kube-api-access-tfhkm" (OuterVolumeSpecName: "kube-api-access-tfhkm") pod "3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8" (UID: "3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8"). InnerVolumeSpecName "kube-api-access-tfhkm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:07:35 crc kubenswrapper[5120]: I0316 17:07:35.882667 5120 generic.go:358] "Generic (PLEG): container finished" podID="3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8" containerID="603ff86600d1e7da0ffa0d4d713fdf79bd0405aa9c1f61bc9a158cbd61e39c48" exitCode=0 Mar 16 17:07:35 crc kubenswrapper[5120]: I0316 17:07:35.882705 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8","Type":"ContainerDied","Data":"603ff86600d1e7da0ffa0d4d713fdf79bd0405aa9c1f61bc9a158cbd61e39c48"} Mar 16 17:07:35 crc kubenswrapper[5120]: I0316 17:07:35.882748 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8","Type":"ContainerDied","Data":"9aa1181b5b6e62f592be9fd3fa7cf09ca6f2fcd7ddc82bdc83a4872e3cd7aa5c"} Mar 16 17:07:35 crc kubenswrapper[5120]: I0316 17:07:35.882749 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:07:35 crc kubenswrapper[5120]: I0316 17:07:35.882776 5120 scope.go:117] "RemoveContainer" containerID="317ac4527e14e5d97767351bcc6df08bede7f79ad7f03e49d3dfc08e07bab786" Mar 16 17:07:35 crc kubenswrapper[5120]: I0316 17:07:35.908730 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8" (UID: "3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:07:35 crc kubenswrapper[5120]: I0316 17:07:35.925995 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8-ceilometer-tls-certs" (OuterVolumeSpecName: "ceilometer-tls-certs") pod "3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8" (UID: "3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8"). InnerVolumeSpecName "ceilometer-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:07:35 crc kubenswrapper[5120]: I0316 17:07:35.959630 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8" (UID: "3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:07:35 crc kubenswrapper[5120]: I0316 17:07:35.969915 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8-config-data" (OuterVolumeSpecName: "config-data") pod "3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8" (UID: "3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:07:35 crc kubenswrapper[5120]: I0316 17:07:35.978305 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:07:35 crc kubenswrapper[5120]: I0316 17:07:35.978344 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tfhkm\" (UniqueName: \"kubernetes.io/projected/3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8-kube-api-access-tfhkm\") on node \"crc\" DevicePath \"\"" Mar 16 17:07:35 crc kubenswrapper[5120]: I0316 17:07:35.978356 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 17:07:35 crc kubenswrapper[5120]: I0316 17:07:35.978367 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 17:07:35 crc kubenswrapper[5120]: I0316 17:07:35.978376 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 17:07:35 crc kubenswrapper[5120]: I0316 17:07:35.978384 5120 reconciler_common.go:299] "Volume detached for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8-ceilometer-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:07:35 crc kubenswrapper[5120]: I0316 17:07:35.978395 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:07:35 crc kubenswrapper[5120]: I0316 17:07:35.978403 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:07:35 crc kubenswrapper[5120]: I0316 17:07:35.995223 5120 scope.go:117] "RemoveContainer" containerID="a2f33d8acdbe2353757787bfca08008a12a789d2cf00051da5beeba6a9d7ffde" Mar 16 17:07:36 crc kubenswrapper[5120]: I0316 17:07:36.016036 5120 scope.go:117] "RemoveContainer" containerID="18923c8ec7669847bfdf079788331af0c5b3c5f916cc5eab12eb27447998d12f" Mar 16 17:07:36 crc kubenswrapper[5120]: I0316 17:07:36.036347 5120 scope.go:117] "RemoveContainer" containerID="603ff86600d1e7da0ffa0d4d713fdf79bd0405aa9c1f61bc9a158cbd61e39c48" Mar 16 17:07:36 crc kubenswrapper[5120]: I0316 17:07:36.061697 5120 scope.go:117] "RemoveContainer" containerID="317ac4527e14e5d97767351bcc6df08bede7f79ad7f03e49d3dfc08e07bab786" Mar 16 17:07:36 crc kubenswrapper[5120]: E0316 17:07:36.062157 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"317ac4527e14e5d97767351bcc6df08bede7f79ad7f03e49d3dfc08e07bab786\": container with ID starting with 317ac4527e14e5d97767351bcc6df08bede7f79ad7f03e49d3dfc08e07bab786 not found: ID does not exist" containerID="317ac4527e14e5d97767351bcc6df08bede7f79ad7f03e49d3dfc08e07bab786" Mar 16 17:07:36 crc kubenswrapper[5120]: I0316 17:07:36.062183 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"317ac4527e14e5d97767351bcc6df08bede7f79ad7f03e49d3dfc08e07bab786"} err="failed to get container status \"317ac4527e14e5d97767351bcc6df08bede7f79ad7f03e49d3dfc08e07bab786\": rpc error: code = NotFound desc = could not find container \"317ac4527e14e5d97767351bcc6df08bede7f79ad7f03e49d3dfc08e07bab786\": container with ID starting with 317ac4527e14e5d97767351bcc6df08bede7f79ad7f03e49d3dfc08e07bab786 not found: ID does not exist" Mar 16 17:07:36 crc kubenswrapper[5120]: I0316 17:07:36.062202 5120 scope.go:117] "RemoveContainer" containerID="a2f33d8acdbe2353757787bfca08008a12a789d2cf00051da5beeba6a9d7ffde" Mar 16 17:07:36 crc kubenswrapper[5120]: E0316 17:07:36.062474 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a2f33d8acdbe2353757787bfca08008a12a789d2cf00051da5beeba6a9d7ffde\": container with ID starting with a2f33d8acdbe2353757787bfca08008a12a789d2cf00051da5beeba6a9d7ffde not found: ID does not exist" containerID="a2f33d8acdbe2353757787bfca08008a12a789d2cf00051da5beeba6a9d7ffde" Mar 16 17:07:36 crc kubenswrapper[5120]: I0316 17:07:36.062599 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2f33d8acdbe2353757787bfca08008a12a789d2cf00051da5beeba6a9d7ffde"} err="failed to get container status \"a2f33d8acdbe2353757787bfca08008a12a789d2cf00051da5beeba6a9d7ffde\": rpc error: code = NotFound desc = could not find container \"a2f33d8acdbe2353757787bfca08008a12a789d2cf00051da5beeba6a9d7ffde\": container with ID starting with a2f33d8acdbe2353757787bfca08008a12a789d2cf00051da5beeba6a9d7ffde not found: ID does not exist" Mar 16 17:07:36 crc kubenswrapper[5120]: I0316 17:07:36.062719 5120 scope.go:117] "RemoveContainer" containerID="18923c8ec7669847bfdf079788331af0c5b3c5f916cc5eab12eb27447998d12f" Mar 16 17:07:36 crc kubenswrapper[5120]: E0316 17:07:36.063625 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"18923c8ec7669847bfdf079788331af0c5b3c5f916cc5eab12eb27447998d12f\": container with ID starting with 18923c8ec7669847bfdf079788331af0c5b3c5f916cc5eab12eb27447998d12f not found: ID does not exist" containerID="18923c8ec7669847bfdf079788331af0c5b3c5f916cc5eab12eb27447998d12f" Mar 16 17:07:36 crc kubenswrapper[5120]: I0316 17:07:36.063683 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18923c8ec7669847bfdf079788331af0c5b3c5f916cc5eab12eb27447998d12f"} err="failed to get container status \"18923c8ec7669847bfdf079788331af0c5b3c5f916cc5eab12eb27447998d12f\": rpc error: code = NotFound desc = could not find container \"18923c8ec7669847bfdf079788331af0c5b3c5f916cc5eab12eb27447998d12f\": container with ID starting with 18923c8ec7669847bfdf079788331af0c5b3c5f916cc5eab12eb27447998d12f not found: ID does not exist" Mar 16 17:07:36 crc kubenswrapper[5120]: I0316 17:07:36.063698 5120 scope.go:117] "RemoveContainer" containerID="603ff86600d1e7da0ffa0d4d713fdf79bd0405aa9c1f61bc9a158cbd61e39c48" Mar 16 17:07:36 crc kubenswrapper[5120]: E0316 17:07:36.064000 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"603ff86600d1e7da0ffa0d4d713fdf79bd0405aa9c1f61bc9a158cbd61e39c48\": container with ID starting with 603ff86600d1e7da0ffa0d4d713fdf79bd0405aa9c1f61bc9a158cbd61e39c48 not found: ID does not exist" containerID="603ff86600d1e7da0ffa0d4d713fdf79bd0405aa9c1f61bc9a158cbd61e39c48" Mar 16 17:07:36 crc kubenswrapper[5120]: I0316 17:07:36.064026 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"603ff86600d1e7da0ffa0d4d713fdf79bd0405aa9c1f61bc9a158cbd61e39c48"} err="failed to get container status \"603ff86600d1e7da0ffa0d4d713fdf79bd0405aa9c1f61bc9a158cbd61e39c48\": rpc error: code = NotFound desc = could not find container \"603ff86600d1e7da0ffa0d4d713fdf79bd0405aa9c1f61bc9a158cbd61e39c48\": container with ID starting with 603ff86600d1e7da0ffa0d4d713fdf79bd0405aa9c1f61bc9a158cbd61e39c48 not found: ID does not exist" Mar 16 17:07:36 crc kubenswrapper[5120]: I0316 17:07:36.226489 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:07:36 crc kubenswrapper[5120]: I0316 17:07:36.244753 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:07:36 crc kubenswrapper[5120]: I0316 17:07:36.264747 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:07:36 crc kubenswrapper[5120]: I0316 17:07:36.266117 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8" containerName="sg-core" Mar 16 17:07:36 crc kubenswrapper[5120]: I0316 17:07:36.266146 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8" containerName="sg-core" Mar 16 17:07:36 crc kubenswrapper[5120]: I0316 17:07:36.266190 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8" containerName="proxy-httpd" Mar 16 17:07:36 crc kubenswrapper[5120]: I0316 17:07:36.266198 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8" containerName="proxy-httpd" Mar 16 17:07:36 crc kubenswrapper[5120]: I0316 17:07:36.266247 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8" containerName="ceilometer-notification-agent" Mar 16 17:07:36 crc kubenswrapper[5120]: I0316 17:07:36.266259 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8" containerName="ceilometer-notification-agent" Mar 16 17:07:36 crc kubenswrapper[5120]: I0316 17:07:36.266274 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8" containerName="ceilometer-central-agent" Mar 16 17:07:36 crc kubenswrapper[5120]: I0316 17:07:36.266280 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8" containerName="ceilometer-central-agent" Mar 16 17:07:36 crc kubenswrapper[5120]: I0316 17:07:36.267159 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8" containerName="proxy-httpd" Mar 16 17:07:36 crc kubenswrapper[5120]: I0316 17:07:36.267186 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8" containerName="ceilometer-notification-agent" Mar 16 17:07:36 crc kubenswrapper[5120]: I0316 17:07:36.267197 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8" containerName="ceilometer-central-agent" Mar 16 17:07:36 crc kubenswrapper[5120]: I0316 17:07:36.267208 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8" containerName="sg-core" Mar 16 17:07:36 crc kubenswrapper[5120]: I0316 17:07:36.283965 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:07:36 crc kubenswrapper[5120]: I0316 17:07:36.284182 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:07:36 crc kubenswrapper[5120]: I0316 17:07:36.289365 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 17:07:36 crc kubenswrapper[5120]: I0316 17:07:36.289612 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 17:07:36 crc kubenswrapper[5120]: I0316 17:07:36.289971 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ceilometer-internal-svc\"" Mar 16 17:07:36 crc kubenswrapper[5120]: I0316 17:07:36.389393 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/6ff9b987-d4c9-427f-a8d1-0900da11bef5-run-httpd\") pod \"ceilometer-0\" (UID: \"6ff9b987-d4c9-427f-a8d1-0900da11bef5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:07:36 crc kubenswrapper[5120]: I0316 17:07:36.389476 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/6ff9b987-d4c9-427f-a8d1-0900da11bef5-log-httpd\") pod \"ceilometer-0\" (UID: \"6ff9b987-d4c9-427f-a8d1-0900da11bef5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:07:36 crc kubenswrapper[5120]: I0316 17:07:36.389533 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/6ff9b987-d4c9-427f-a8d1-0900da11bef5-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"6ff9b987-d4c9-427f-a8d1-0900da11bef5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:07:36 crc kubenswrapper[5120]: I0316 17:07:36.389703 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hn5j\" (UniqueName: \"kubernetes.io/projected/6ff9b987-d4c9-427f-a8d1-0900da11bef5-kube-api-access-6hn5j\") pod \"ceilometer-0\" (UID: \"6ff9b987-d4c9-427f-a8d1-0900da11bef5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:07:36 crc kubenswrapper[5120]: I0316 17:07:36.389805 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6ff9b987-d4c9-427f-a8d1-0900da11bef5-config-data\") pod \"ceilometer-0\" (UID: \"6ff9b987-d4c9-427f-a8d1-0900da11bef5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:07:36 crc kubenswrapper[5120]: I0316 17:07:36.389941 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6ff9b987-d4c9-427f-a8d1-0900da11bef5-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"6ff9b987-d4c9-427f-a8d1-0900da11bef5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:07:36 crc kubenswrapper[5120]: I0316 17:07:36.390166 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6ff9b987-d4c9-427f-a8d1-0900da11bef5-scripts\") pod \"ceilometer-0\" (UID: \"6ff9b987-d4c9-427f-a8d1-0900da11bef5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:07:36 crc kubenswrapper[5120]: I0316 17:07:36.390210 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/6ff9b987-d4c9-427f-a8d1-0900da11bef5-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"6ff9b987-d4c9-427f-a8d1-0900da11bef5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:07:36 crc kubenswrapper[5120]: I0316 17:07:36.492706 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/6ff9b987-d4c9-427f-a8d1-0900da11bef5-run-httpd\") pod \"ceilometer-0\" (UID: \"6ff9b987-d4c9-427f-a8d1-0900da11bef5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:07:36 crc kubenswrapper[5120]: I0316 17:07:36.492782 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/6ff9b987-d4c9-427f-a8d1-0900da11bef5-log-httpd\") pod \"ceilometer-0\" (UID: \"6ff9b987-d4c9-427f-a8d1-0900da11bef5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:07:36 crc kubenswrapper[5120]: I0316 17:07:36.492850 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/6ff9b987-d4c9-427f-a8d1-0900da11bef5-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"6ff9b987-d4c9-427f-a8d1-0900da11bef5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:07:36 crc kubenswrapper[5120]: I0316 17:07:36.492974 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6hn5j\" (UniqueName: \"kubernetes.io/projected/6ff9b987-d4c9-427f-a8d1-0900da11bef5-kube-api-access-6hn5j\") pod \"ceilometer-0\" (UID: \"6ff9b987-d4c9-427f-a8d1-0900da11bef5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:07:36 crc kubenswrapper[5120]: I0316 17:07:36.493045 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6ff9b987-d4c9-427f-a8d1-0900da11bef5-config-data\") pod \"ceilometer-0\" (UID: \"6ff9b987-d4c9-427f-a8d1-0900da11bef5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:07:36 crc kubenswrapper[5120]: I0316 17:07:36.493119 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6ff9b987-d4c9-427f-a8d1-0900da11bef5-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"6ff9b987-d4c9-427f-a8d1-0900da11bef5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:07:36 crc kubenswrapper[5120]: I0316 17:07:36.493260 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6ff9b987-d4c9-427f-a8d1-0900da11bef5-scripts\") pod \"ceilometer-0\" (UID: \"6ff9b987-d4c9-427f-a8d1-0900da11bef5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:07:36 crc kubenswrapper[5120]: I0316 17:07:36.493289 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/6ff9b987-d4c9-427f-a8d1-0900da11bef5-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"6ff9b987-d4c9-427f-a8d1-0900da11bef5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:07:36 crc kubenswrapper[5120]: I0316 17:07:36.493547 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/6ff9b987-d4c9-427f-a8d1-0900da11bef5-run-httpd\") pod \"ceilometer-0\" (UID: \"6ff9b987-d4c9-427f-a8d1-0900da11bef5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:07:36 crc kubenswrapper[5120]: I0316 17:07:36.493594 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/6ff9b987-d4c9-427f-a8d1-0900da11bef5-log-httpd\") pod \"ceilometer-0\" (UID: \"6ff9b987-d4c9-427f-a8d1-0900da11bef5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:07:36 crc kubenswrapper[5120]: I0316 17:07:36.497485 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6ff9b987-d4c9-427f-a8d1-0900da11bef5-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"6ff9b987-d4c9-427f-a8d1-0900da11bef5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:07:36 crc kubenswrapper[5120]: I0316 17:07:36.497868 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/6ff9b987-d4c9-427f-a8d1-0900da11bef5-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"6ff9b987-d4c9-427f-a8d1-0900da11bef5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:07:36 crc kubenswrapper[5120]: I0316 17:07:36.497955 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/6ff9b987-d4c9-427f-a8d1-0900da11bef5-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"6ff9b987-d4c9-427f-a8d1-0900da11bef5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:07:36 crc kubenswrapper[5120]: I0316 17:07:36.500173 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6ff9b987-d4c9-427f-a8d1-0900da11bef5-scripts\") pod \"ceilometer-0\" (UID: \"6ff9b987-d4c9-427f-a8d1-0900da11bef5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:07:36 crc kubenswrapper[5120]: I0316 17:07:36.508942 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6ff9b987-d4c9-427f-a8d1-0900da11bef5-config-data\") pod \"ceilometer-0\" (UID: \"6ff9b987-d4c9-427f-a8d1-0900da11bef5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:07:36 crc kubenswrapper[5120]: I0316 17:07:36.515108 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hn5j\" (UniqueName: \"kubernetes.io/projected/6ff9b987-d4c9-427f-a8d1-0900da11bef5-kube-api-access-6hn5j\") pod \"ceilometer-0\" (UID: \"6ff9b987-d4c9-427f-a8d1-0900da11bef5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:07:36 crc kubenswrapper[5120]: I0316 17:07:36.607846 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:07:36 crc kubenswrapper[5120]: I0316 17:07:36.683514 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8" path="/var/lib/kubelet/pods/3be9e6ce-1bed-4b10-8b0e-2a56a440d7a8/volumes" Mar 16 17:07:37 crc kubenswrapper[5120]: I0316 17:07:37.067266 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:07:37 crc kubenswrapper[5120]: W0316 17:07:37.067571 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6ff9b987_d4c9_427f_a8d1_0900da11bef5.slice/crio-9a0f02e0dde2e457ecb9c168d2940413d17e419a88dc2b2b07bde6ad93e01b6f WatchSource:0}: Error finding container 9a0f02e0dde2e457ecb9c168d2940413d17e419a88dc2b2b07bde6ad93e01b6f: Status 404 returned error can't find the container with id 9a0f02e0dde2e457ecb9c168d2940413d17e419a88dc2b2b07bde6ad93e01b6f Mar 16 17:07:37 crc kubenswrapper[5120]: I0316 17:07:37.664402 5120 scope.go:117] "RemoveContainer" containerID="db39d192fa687a13805537d08ad22fed1ef362ef5027c920a616297dc55a8ea9" Mar 16 17:07:37 crc kubenswrapper[5120]: E0316 17:07:37.664968 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 17:07:37 crc kubenswrapper[5120]: I0316 17:07:37.924251 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"6ff9b987-d4c9-427f-a8d1-0900da11bef5","Type":"ContainerStarted","Data":"287f8090dea674cb40a38ec071885a3f7894ef839aaf3eb8d78c6dc9e7abca92"} Mar 16 17:07:37 crc kubenswrapper[5120]: I0316 17:07:37.924697 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"6ff9b987-d4c9-427f-a8d1-0900da11bef5","Type":"ContainerStarted","Data":"9a0f02e0dde2e457ecb9c168d2940413d17e419a88dc2b2b07bde6ad93e01b6f"} Mar 16 17:07:38 crc kubenswrapper[5120]: E0316 17:07:38.722535 5120 fsHandler.go:119] failed to collect filesystem stats - rootDiskErr: could not stat "/var/lib/containers/storage/overlay/2481fd4b7fdfd41de1c78c4b053fa077ccf9ae24c0f70229ebd9bc9bbf7e924a/diff" to get inode usage: stat /var/lib/containers/storage/overlay/2481fd4b7fdfd41de1c78c4b053fa077ccf9ae24c0f70229ebd9bc9bbf7e924a/diff: no such file or directory, extraDiskErr: Mar 16 17:07:38 crc kubenswrapper[5120]: I0316 17:07:38.945966 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"6ff9b987-d4c9-427f-a8d1-0900da11bef5","Type":"ContainerStarted","Data":"51c9bc540f5f5f1943fdf912d7fb80205db793e6c9378b27720eafa6a4b52b3e"} Mar 16 17:07:39 crc kubenswrapper[5120]: I0316 17:07:39.959209 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"6ff9b987-d4c9-427f-a8d1-0900da11bef5","Type":"ContainerStarted","Data":"e9a80af08a4b83cbe6b83abbdfeb801e4f9d662462e9e634f977b1c0bf2f25b5"} Mar 16 17:07:42 crc kubenswrapper[5120]: I0316 17:07:42.231812 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:07:42 crc kubenswrapper[5120]: I0316 17:07:42.233379 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:07:43 crc kubenswrapper[5120]: I0316 17:07:43.239005 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="9dde2b26-18b2-469b-94d1-92da183402fc" containerName="nova-api-api" probeResult="failure" output="Get \"https://10.217.1.226:8774/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Mar 16 17:07:43 crc kubenswrapper[5120]: I0316 17:07:43.239890 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="9dde2b26-18b2-469b-94d1-92da183402fc" containerName="nova-api-log" probeResult="failure" output="Get \"https://10.217.1.226:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 17:07:45 crc kubenswrapper[5120]: I0316 17:07:45.022249 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"6ff9b987-d4c9-427f-a8d1-0900da11bef5","Type":"ContainerStarted","Data":"39da148bdc75ed714a628ed59f7ddc25fb6e712f3610df622442f9f8898925c6"} Mar 16 17:07:45 crc kubenswrapper[5120]: I0316 17:07:45.022795 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:07:45 crc kubenswrapper[5120]: I0316 17:07:45.056110 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.406613312 podStartE2EDuration="9.056087265s" podCreationTimestamp="2026-03-16 17:07:36 +0000 UTC" firstStartedPulling="2026-03-16 17:07:37.069448522 +0000 UTC m=+5759.223380179" lastFinishedPulling="2026-03-16 17:07:43.718922475 +0000 UTC m=+5765.872854132" observedRunningTime="2026-03-16 17:07:45.041856972 +0000 UTC m=+5767.195788639" watchObservedRunningTime="2026-03-16 17:07:45.056087265 +0000 UTC m=+5767.210018922" Mar 16 17:07:48 crc kubenswrapper[5120]: I0316 17:07:48.674145 5120 scope.go:117] "RemoveContainer" containerID="db39d192fa687a13805537d08ad22fed1ef362ef5027c920a616297dc55a8ea9" Mar 16 17:07:48 crc kubenswrapper[5120]: E0316 17:07:48.674898 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 17:07:50 crc kubenswrapper[5120]: I0316 17:07:50.231205 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:07:50 crc kubenswrapper[5120]: I0316 17:07:50.231522 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:07:52 crc kubenswrapper[5120]: I0316 17:07:52.239087 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:07:52 crc kubenswrapper[5120]: I0316 17:07:52.239358 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:07:52 crc kubenswrapper[5120]: I0316 17:07:52.245836 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:07:52 crc kubenswrapper[5120]: I0316 17:07:52.247914 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:08:00 crc kubenswrapper[5120]: I0316 17:08:00.142884 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-infra/auto-csr-approver-29561348-4k2jn"] Mar 16 17:08:00 crc kubenswrapper[5120]: I0316 17:08:00.160564 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561348-4k2jn"] Mar 16 17:08:00 crc kubenswrapper[5120]: I0316 17:08:00.160968 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561348-4k2jn" Mar 16 17:08:00 crc kubenswrapper[5120]: I0316 17:08:00.165791 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"openshift-service-ca.crt\"" Mar 16 17:08:00 crc kubenswrapper[5120]: I0316 17:08:00.167697 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-infra\"/\"csr-approver-sa-dockercfg-x2nsz\"" Mar 16 17:08:00 crc kubenswrapper[5120]: I0316 17:08:00.167848 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"kube-root-ca.crt\"" Mar 16 17:08:00 crc kubenswrapper[5120]: I0316 17:08:00.225456 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2tfm9\" (UniqueName: \"kubernetes.io/projected/70f669ba-f1f0-4d96-b7c5-1bc940ae0040-kube-api-access-2tfm9\") pod \"auto-csr-approver-29561348-4k2jn\" (UID: \"70f669ba-f1f0-4d96-b7c5-1bc940ae0040\") " pod="openshift-infra/auto-csr-approver-29561348-4k2jn" Mar 16 17:08:00 crc kubenswrapper[5120]: I0316 17:08:00.330366 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2tfm9\" (UniqueName: \"kubernetes.io/projected/70f669ba-f1f0-4d96-b7c5-1bc940ae0040-kube-api-access-2tfm9\") pod \"auto-csr-approver-29561348-4k2jn\" (UID: \"70f669ba-f1f0-4d96-b7c5-1bc940ae0040\") " pod="openshift-infra/auto-csr-approver-29561348-4k2jn" Mar 16 17:08:00 crc kubenswrapper[5120]: I0316 17:08:00.351851 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2tfm9\" (UniqueName: \"kubernetes.io/projected/70f669ba-f1f0-4d96-b7c5-1bc940ae0040-kube-api-access-2tfm9\") pod \"auto-csr-approver-29561348-4k2jn\" (UID: \"70f669ba-f1f0-4d96-b7c5-1bc940ae0040\") " pod="openshift-infra/auto-csr-approver-29561348-4k2jn" Mar 16 17:08:00 crc kubenswrapper[5120]: I0316 17:08:00.491868 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561348-4k2jn" Mar 16 17:08:00 crc kubenswrapper[5120]: W0316 17:08:00.935111 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod70f669ba_f1f0_4d96_b7c5_1bc940ae0040.slice/crio-e591d7e378538c74aab9696103e5e97222c203aaaf7780dc9b8e6502fdbb279b WatchSource:0}: Error finding container e591d7e378538c74aab9696103e5e97222c203aaaf7780dc9b8e6502fdbb279b: Status 404 returned error can't find the container with id e591d7e378538c74aab9696103e5e97222c203aaaf7780dc9b8e6502fdbb279b Mar 16 17:08:00 crc kubenswrapper[5120]: I0316 17:08:00.936528 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561348-4k2jn"] Mar 16 17:08:01 crc kubenswrapper[5120]: I0316 17:08:01.188794 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561348-4k2jn" event={"ID":"70f669ba-f1f0-4d96-b7c5-1bc940ae0040","Type":"ContainerStarted","Data":"e591d7e378538c74aab9696103e5e97222c203aaaf7780dc9b8e6502fdbb279b"} Mar 16 17:08:03 crc kubenswrapper[5120]: I0316 17:08:03.209522 5120 generic.go:358] "Generic (PLEG): container finished" podID="70f669ba-f1f0-4d96-b7c5-1bc940ae0040" containerID="2aa4c0e3d1ed0755af2cf0f201d22247aedd0b245fdba62d7c8b06139cdce0cc" exitCode=0 Mar 16 17:08:03 crc kubenswrapper[5120]: I0316 17:08:03.209605 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561348-4k2jn" event={"ID":"70f669ba-f1f0-4d96-b7c5-1bc940ae0040","Type":"ContainerDied","Data":"2aa4c0e3d1ed0755af2cf0f201d22247aedd0b245fdba62d7c8b06139cdce0cc"} Mar 16 17:08:03 crc kubenswrapper[5120]: I0316 17:08:03.663776 5120 scope.go:117] "RemoveContainer" containerID="db39d192fa687a13805537d08ad22fed1ef362ef5027c920a616297dc55a8ea9" Mar 16 17:08:03 crc kubenswrapper[5120]: E0316 17:08:03.664112 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 17:08:04 crc kubenswrapper[5120]: I0316 17:08:04.632563 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561348-4k2jn" Mar 16 17:08:04 crc kubenswrapper[5120]: I0316 17:08:04.749438 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2tfm9\" (UniqueName: \"kubernetes.io/projected/70f669ba-f1f0-4d96-b7c5-1bc940ae0040-kube-api-access-2tfm9\") pod \"70f669ba-f1f0-4d96-b7c5-1bc940ae0040\" (UID: \"70f669ba-f1f0-4d96-b7c5-1bc940ae0040\") " Mar 16 17:08:04 crc kubenswrapper[5120]: I0316 17:08:04.756285 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70f669ba-f1f0-4d96-b7c5-1bc940ae0040-kube-api-access-2tfm9" (OuterVolumeSpecName: "kube-api-access-2tfm9") pod "70f669ba-f1f0-4d96-b7c5-1bc940ae0040" (UID: "70f669ba-f1f0-4d96-b7c5-1bc940ae0040"). InnerVolumeSpecName "kube-api-access-2tfm9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:08:04 crc kubenswrapper[5120]: I0316 17:08:04.855257 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2tfm9\" (UniqueName: \"kubernetes.io/projected/70f669ba-f1f0-4d96-b7c5-1bc940ae0040-kube-api-access-2tfm9\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:05 crc kubenswrapper[5120]: I0316 17:08:05.233518 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561348-4k2jn" Mar 16 17:08:05 crc kubenswrapper[5120]: I0316 17:08:05.233538 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561348-4k2jn" event={"ID":"70f669ba-f1f0-4d96-b7c5-1bc940ae0040","Type":"ContainerDied","Data":"e591d7e378538c74aab9696103e5e97222c203aaaf7780dc9b8e6502fdbb279b"} Mar 16 17:08:05 crc kubenswrapper[5120]: I0316 17:08:05.234143 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e591d7e378538c74aab9696103e5e97222c203aaaf7780dc9b8e6502fdbb279b" Mar 16 17:08:05 crc kubenswrapper[5120]: I0316 17:08:05.699598 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-infra/auto-csr-approver-29561342-rrqbl"] Mar 16 17:08:05 crc kubenswrapper[5120]: I0316 17:08:05.712437 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-infra/auto-csr-approver-29561342-rrqbl"] Mar 16 17:08:06 crc kubenswrapper[5120]: I0316 17:08:06.674464 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="faf56689-0912-413f-9761-20c85fdbd7cb" path="/var/lib/kubelet/pods/faf56689-0912-413f-9761-20c85fdbd7cb/volumes" Mar 16 17:08:07 crc kubenswrapper[5120]: E0316 17:08:07.956717 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1873680 actualBytes=10240 Mar 16 17:08:15 crc kubenswrapper[5120]: I0316 17:08:15.708934 5120 scope.go:117] "RemoveContainer" containerID="b961b48c20ad81424ee896042d661e9274aaf36c91d9dedfa4dbb2056058edff" Mar 16 17:08:16 crc kubenswrapper[5120]: I0316 17:08:16.039937 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:08:17 crc kubenswrapper[5120]: I0316 17:08:17.664932 5120 scope.go:117] "RemoveContainer" containerID="db39d192fa687a13805537d08ad22fed1ef362ef5027c920a616297dc55a8ea9" Mar 16 17:08:17 crc kubenswrapper[5120]: E0316 17:08:17.665540 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 17:08:20 crc kubenswrapper[5120]: E0316 17:08:20.432907 5120 upgradeaware.go:427] Error proxying data from client to backend: readfrom tcp 38.102.83.119:56718->38.102.83.119:44311: write tcp 38.102.83.119:56718->38.102.83.119:44311: write: connection reset by peer Mar 16 17:08:29 crc kubenswrapper[5120]: I0316 17:08:29.664148 5120 scope.go:117] "RemoveContainer" containerID="db39d192fa687a13805537d08ad22fed1ef362ef5027c920a616297dc55a8ea9" Mar 16 17:08:29 crc kubenswrapper[5120]: E0316 17:08:29.666151 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.012453 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.015495 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/openstackclient" podUID="d325d1cb-bde7-4d3d-978f-2f9d1188717e" containerName="openstackclient" containerID="cri-o://3f289a8fede143f8dca99cdbaa1cac9860a28fa61689bab6b0b824d500b16adf" gracePeriod=2 Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.021659 5120 status_manager.go:895] "Failed to get status for pod" podUID="d325d1cb-bde7-4d3d-978f-2f9d1188717e" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.079625 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.117356 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.119646 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="3f3771ee-c5b9-4004-b631-437b1508ac5a" containerName="probe" containerID="cri-o://4ad7c1867c57d52a4fcc80cb4798fb797a71daf87508fcc099ea396489f4ae08" gracePeriod=30 Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.119796 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="3f3771ee-c5b9-4004-b631-437b1508ac5a" containerName="cinder-scheduler" containerID="cri-o://f9d4176477338724d48f077eb733c4cfa2586a8f3b67c1ffb86859f778db89d5" gracePeriod=30 Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.145654 5120 status_manager.go:905] "Pod was deleted and then recreated, skipping status update" pod="openstack-kuttl-tests/openstackclient" oldPodUID="d325d1cb-bde7-4d3d-978f-2f9d1188717e" podUID="140a02f0-df36-49fb-b2bb-b267e350f5c5" Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.163068 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.163337 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovn-northd-0" podUID="4281ec55-3466-4ca1-8054-498475a4407a" containerName="ovn-northd" containerID="cri-o://96a5af6c245f152292c5f105e917134b38b18b97df711c59fca353841e123fc8" gracePeriod=30 Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.163903 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovn-northd-0" podUID="4281ec55-3466-4ca1-8054-498475a4407a" containerName="openstack-network-exporter" containerID="cri-o://40692fb4e719bbea05f717260a282bea677f342794b8fe0f8ea6f1f1abbfebd5" gracePeriod=30 Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.184802 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.186120 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podUID="b9d1b067-481f-4959-99ab-68d36e78226d" containerName="openstack-network-exporter" containerID="cri-o://36e19874faebe75c231a863143f7dd73c50e3adbff0c872e4b6a75af80b20e30" gracePeriod=300 Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.221515 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.221776 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="45bed047-fbff-439b-b659-657f9b9d3b62" containerName="glance-log" containerID="cri-o://1c02bc06344293428f1e8f7afa638a50bbb02427e908baa3d149b016a246865b" gracePeriod=30 Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.221844 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="45bed047-fbff-439b-b659-657f9b9d3b62" containerName="glance-httpd" containerID="cri-o://27cb3386aadf2d6768da83f5c6070a5e4f3208984e63cb60bbb72e30c860ac1f" gracePeriod=30 Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.237490 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-worker-6f95f9d4f9-4kmmn"] Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.238645 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d325d1cb-bde7-4d3d-978f-2f9d1188717e" containerName="openstackclient" Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.238664 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="d325d1cb-bde7-4d3d-978f-2f9d1188717e" containerName="openstackclient" Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.238707 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70f669ba-f1f0-4d96-b7c5-1bc940ae0040" containerName="oc" Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.238713 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="70f669ba-f1f0-4d96-b7c5-1bc940ae0040" containerName="oc" Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.238917 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="d325d1cb-bde7-4d3d-978f-2f9d1188717e" containerName="openstackclient" Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.238930 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="70f669ba-f1f0-4d96-b7c5-1bc940ae0040" containerName="oc" Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.251260 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-6f95f9d4f9-4kmmn" Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.258424 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-7d8dcb56b8-42f9n"] Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.320147 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.331114 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-7d8dcb56b8-42f9n" Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.333281 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e491da9b-3bac-45f2-b9f5-41af945fe1eb-logs\") pod \"barbican-worker-6f95f9d4f9-4kmmn\" (UID: \"e491da9b-3bac-45f2-b9f5-41af945fe1eb\") " pod="openstack-kuttl-tests/barbican-worker-6f95f9d4f9-4kmmn" Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.333322 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e491da9b-3bac-45f2-b9f5-41af945fe1eb-config-data\") pod \"barbican-worker-6f95f9d4f9-4kmmn\" (UID: \"e491da9b-3bac-45f2-b9f5-41af945fe1eb\") " pod="openstack-kuttl-tests/barbican-worker-6f95f9d4f9-4kmmn" Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.333377 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/e491da9b-3bac-45f2-b9f5-41af945fe1eb-config-data-custom\") pod \"barbican-worker-6f95f9d4f9-4kmmn\" (UID: \"e491da9b-3bac-45f2-b9f5-41af945fe1eb\") " pod="openstack-kuttl-tests/barbican-worker-6f95f9d4f9-4kmmn" Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.333543 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7pprv\" (UniqueName: \"kubernetes.io/projected/e491da9b-3bac-45f2-b9f5-41af945fe1eb-kube-api-access-7pprv\") pod \"barbican-worker-6f95f9d4f9-4kmmn\" (UID: \"e491da9b-3bac-45f2-b9f5-41af945fe1eb\") " pod="openstack-kuttl-tests/barbican-worker-6f95f9d4f9-4kmmn" Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.333676 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e491da9b-3bac-45f2-b9f5-41af945fe1eb-combined-ca-bundle\") pod \"barbican-worker-6f95f9d4f9-4kmmn\" (UID: \"e491da9b-3bac-45f2-b9f5-41af945fe1eb\") " pod="openstack-kuttl-tests/barbican-worker-6f95f9d4f9-4kmmn" Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.374011 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-7d8dcb56b8-42f9n"] Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.374140 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.387232 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-6f95f9d4f9-4kmmn"] Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.434126 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.436821 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/140a02f0-df36-49fb-b2bb-b267e350f5c5-combined-ca-bundle\") pod \"openstackclient\" (UID: \"140a02f0-df36-49fb-b2bb-b267e350f5c5\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.436903 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7pprv\" (UniqueName: \"kubernetes.io/projected/e491da9b-3bac-45f2-b9f5-41af945fe1eb-kube-api-access-7pprv\") pod \"barbican-worker-6f95f9d4f9-4kmmn\" (UID: \"e491da9b-3bac-45f2-b9f5-41af945fe1eb\") " pod="openstack-kuttl-tests/barbican-worker-6f95f9d4f9-4kmmn" Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.436953 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1b7d191f-d557-4a83-829b-bad5a5ed7dbb-config-data\") pod \"barbican-keystone-listener-7d8dcb56b8-42f9n\" (UID: \"1b7d191f-d557-4a83-829b-bad5a5ed7dbb\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7d8dcb56b8-42f9n" Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.437051 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/140a02f0-df36-49fb-b2bb-b267e350f5c5-openstack-config-secret\") pod \"openstackclient\" (UID: \"140a02f0-df36-49fb-b2bb-b267e350f5c5\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.437101 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/140a02f0-df36-49fb-b2bb-b267e350f5c5-openstack-config\") pod \"openstackclient\" (UID: \"140a02f0-df36-49fb-b2bb-b267e350f5c5\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.443015 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/1b7d191f-d557-4a83-829b-bad5a5ed7dbb-config-data-custom\") pod \"barbican-keystone-listener-7d8dcb56b8-42f9n\" (UID: \"1b7d191f-d557-4a83-829b-bad5a5ed7dbb\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7d8dcb56b8-42f9n" Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.443131 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e491da9b-3bac-45f2-b9f5-41af945fe1eb-combined-ca-bundle\") pod \"barbican-worker-6f95f9d4f9-4kmmn\" (UID: \"e491da9b-3bac-45f2-b9f5-41af945fe1eb\") " pod="openstack-kuttl-tests/barbican-worker-6f95f9d4f9-4kmmn" Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.443172 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-964xx\" (UniqueName: \"kubernetes.io/projected/140a02f0-df36-49fb-b2bb-b267e350f5c5-kube-api-access-964xx\") pod \"openstackclient\" (UID: \"140a02f0-df36-49fb-b2bb-b267e350f5c5\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.443231 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1b7d191f-d557-4a83-829b-bad5a5ed7dbb-combined-ca-bundle\") pod \"barbican-keystone-listener-7d8dcb56b8-42f9n\" (UID: \"1b7d191f-d557-4a83-829b-bad5a5ed7dbb\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7d8dcb56b8-42f9n" Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.443370 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqqbp\" (UniqueName: \"kubernetes.io/projected/1b7d191f-d557-4a83-829b-bad5a5ed7dbb-kube-api-access-rqqbp\") pod \"barbican-keystone-listener-7d8dcb56b8-42f9n\" (UID: \"1b7d191f-d557-4a83-829b-bad5a5ed7dbb\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7d8dcb56b8-42f9n" Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.443479 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e491da9b-3bac-45f2-b9f5-41af945fe1eb-logs\") pod \"barbican-worker-6f95f9d4f9-4kmmn\" (UID: \"e491da9b-3bac-45f2-b9f5-41af945fe1eb\") " pod="openstack-kuttl-tests/barbican-worker-6f95f9d4f9-4kmmn" Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.443543 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e491da9b-3bac-45f2-b9f5-41af945fe1eb-config-data\") pod \"barbican-worker-6f95f9d4f9-4kmmn\" (UID: \"e491da9b-3bac-45f2-b9f5-41af945fe1eb\") " pod="openstack-kuttl-tests/barbican-worker-6f95f9d4f9-4kmmn" Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.443584 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/1b7d191f-d557-4a83-829b-bad5a5ed7dbb-logs\") pod \"barbican-keystone-listener-7d8dcb56b8-42f9n\" (UID: \"1b7d191f-d557-4a83-829b-bad5a5ed7dbb\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7d8dcb56b8-42f9n" Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.443636 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/e491da9b-3bac-45f2-b9f5-41af945fe1eb-config-data-custom\") pod \"barbican-worker-6f95f9d4f9-4kmmn\" (UID: \"e491da9b-3bac-45f2-b9f5-41af945fe1eb\") " pod="openstack-kuttl-tests/barbican-worker-6f95f9d4f9-4kmmn" Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.471950 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e491da9b-3bac-45f2-b9f5-41af945fe1eb-logs\") pod \"barbican-worker-6f95f9d4f9-4kmmn\" (UID: \"e491da9b-3bac-45f2-b9f5-41af945fe1eb\") " pod="openstack-kuttl-tests/barbican-worker-6f95f9d4f9-4kmmn" Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.491675 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/e491da9b-3bac-45f2-b9f5-41af945fe1eb-config-data-custom\") pod \"barbican-worker-6f95f9d4f9-4kmmn\" (UID: \"e491da9b-3bac-45f2-b9f5-41af945fe1eb\") " pod="openstack-kuttl-tests/barbican-worker-6f95f9d4f9-4kmmn" Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.493418 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e491da9b-3bac-45f2-b9f5-41af945fe1eb-combined-ca-bundle\") pod \"barbican-worker-6f95f9d4f9-4kmmn\" (UID: \"e491da9b-3bac-45f2-b9f5-41af945fe1eb\") " pod="openstack-kuttl-tests/barbican-worker-6f95f9d4f9-4kmmn" Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.498093 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.498382 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="c8ccd406-033f-4230-b9a3-357d14ec49f2" containerName="nova-metadata-log" containerID="cri-o://9148b8c5f1c6856439d0eefe2fbe6ed8be889376dd71647351caecf518bbe7e2" gracePeriod=30 Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.498537 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="c8ccd406-033f-4230-b9a3-357d14ec49f2" containerName="nova-metadata-metadata" containerID="cri-o://6a7c746793e3f12759628d71fa2a4ada61abd83c18eff2afb39b04da6a35153f" gracePeriod=30 Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.505618 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e491da9b-3bac-45f2-b9f5-41af945fe1eb-config-data\") pod \"barbican-worker-6f95f9d4f9-4kmmn\" (UID: \"e491da9b-3bac-45f2-b9f5-41af945fe1eb\") " pod="openstack-kuttl-tests/barbican-worker-6f95f9d4f9-4kmmn" Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.515997 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7pprv\" (UniqueName: \"kubernetes.io/projected/e491da9b-3bac-45f2-b9f5-41af945fe1eb-kube-api-access-7pprv\") pod \"barbican-worker-6f95f9d4f9-4kmmn\" (UID: \"e491da9b-3bac-45f2-b9f5-41af945fe1eb\") " pod="openstack-kuttl-tests/barbican-worker-6f95f9d4f9-4kmmn" Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.537846 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.538048 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="6a21ca52-7273-4160-914b-4958e7f2c2ce" containerName="nova-cell0-conductor-conductor" containerID="cri-o://1c22580c851343e8b19eb347321deb3137a86e53ef649ed430e0c0ee54117213" gracePeriod=30 Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.547888 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/140a02f0-df36-49fb-b2bb-b267e350f5c5-openstack-config-secret\") pod \"openstackclient\" (UID: \"140a02f0-df36-49fb-b2bb-b267e350f5c5\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.547944 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/140a02f0-df36-49fb-b2bb-b267e350f5c5-openstack-config\") pod \"openstackclient\" (UID: \"140a02f0-df36-49fb-b2bb-b267e350f5c5\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.548040 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/1b7d191f-d557-4a83-829b-bad5a5ed7dbb-config-data-custom\") pod \"barbican-keystone-listener-7d8dcb56b8-42f9n\" (UID: \"1b7d191f-d557-4a83-829b-bad5a5ed7dbb\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7d8dcb56b8-42f9n" Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.548101 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-964xx\" (UniqueName: \"kubernetes.io/projected/140a02f0-df36-49fb-b2bb-b267e350f5c5-kube-api-access-964xx\") pod \"openstackclient\" (UID: \"140a02f0-df36-49fb-b2bb-b267e350f5c5\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.548139 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1b7d191f-d557-4a83-829b-bad5a5ed7dbb-combined-ca-bundle\") pod \"barbican-keystone-listener-7d8dcb56b8-42f9n\" (UID: \"1b7d191f-d557-4a83-829b-bad5a5ed7dbb\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7d8dcb56b8-42f9n" Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.548239 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rqqbp\" (UniqueName: \"kubernetes.io/projected/1b7d191f-d557-4a83-829b-bad5a5ed7dbb-kube-api-access-rqqbp\") pod \"barbican-keystone-listener-7d8dcb56b8-42f9n\" (UID: \"1b7d191f-d557-4a83-829b-bad5a5ed7dbb\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7d8dcb56b8-42f9n" Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.548381 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/1b7d191f-d557-4a83-829b-bad5a5ed7dbb-logs\") pod \"barbican-keystone-listener-7d8dcb56b8-42f9n\" (UID: \"1b7d191f-d557-4a83-829b-bad5a5ed7dbb\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7d8dcb56b8-42f9n" Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.552651 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/140a02f0-df36-49fb-b2bb-b267e350f5c5-combined-ca-bundle\") pod \"openstackclient\" (UID: \"140a02f0-df36-49fb-b2bb-b267e350f5c5\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.552864 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1b7d191f-d557-4a83-829b-bad5a5ed7dbb-config-data\") pod \"barbican-keystone-listener-7d8dcb56b8-42f9n\" (UID: \"1b7d191f-d557-4a83-829b-bad5a5ed7dbb\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7d8dcb56b8-42f9n" Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.554438 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-api-7648f748d8-cxwnc"] Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.560917 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/140a02f0-df36-49fb-b2bb-b267e350f5c5-openstack-config\") pod \"openstackclient\" (UID: \"140a02f0-df36-49fb-b2bb-b267e350f5c5\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.561926 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/1b7d191f-d557-4a83-829b-bad5a5ed7dbb-logs\") pod \"barbican-keystone-listener-7d8dcb56b8-42f9n\" (UID: \"1b7d191f-d557-4a83-829b-bad5a5ed7dbb\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7d8dcb56b8-42f9n" Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.571546 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/140a02f0-df36-49fb-b2bb-b267e350f5c5-combined-ca-bundle\") pod \"openstackclient\" (UID: \"140a02f0-df36-49fb-b2bb-b267e350f5c5\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.575467 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/1b7d191f-d557-4a83-829b-bad5a5ed7dbb-config-data-custom\") pod \"barbican-keystone-listener-7d8dcb56b8-42f9n\" (UID: \"1b7d191f-d557-4a83-829b-bad5a5ed7dbb\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7d8dcb56b8-42f9n" Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.578253 5120 generic.go:358] "Generic (PLEG): container finished" podID="b9d1b067-481f-4959-99ab-68d36e78226d" containerID="36e19874faebe75c231a863143f7dd73c50e3adbff0c872e4b6a75af80b20e30" exitCode=2 Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.596299 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1b7d191f-d557-4a83-829b-bad5a5ed7dbb-combined-ca-bundle\") pod \"barbican-keystone-listener-7d8dcb56b8-42f9n\" (UID: \"1b7d191f-d557-4a83-829b-bad5a5ed7dbb\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7d8dcb56b8-42f9n" Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.598029 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/140a02f0-df36-49fb-b2bb-b267e350f5c5-openstack-config-secret\") pod \"openstackclient\" (UID: \"140a02f0-df36-49fb-b2bb-b267e350f5c5\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.603330 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1b7d191f-d557-4a83-829b-bad5a5ed7dbb-config-data\") pod \"barbican-keystone-listener-7d8dcb56b8-42f9n\" (UID: \"1b7d191f-d557-4a83-829b-bad5a5ed7dbb\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7d8dcb56b8-42f9n" Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.612115 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqqbp\" (UniqueName: \"kubernetes.io/projected/1b7d191f-d557-4a83-829b-bad5a5ed7dbb-kube-api-access-rqqbp\") pod \"barbican-keystone-listener-7d8dcb56b8-42f9n\" (UID: \"1b7d191f-d557-4a83-829b-bad5a5ed7dbb\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7d8dcb56b8-42f9n" Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.614098 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"b9d1b067-481f-4959-99ab-68d36e78226d","Type":"ContainerDied","Data":"36e19874faebe75c231a863143f7dd73c50e3adbff0c872e4b6a75af80b20e30"} Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.614159 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.614185 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.614413 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/memcached-0" podUID="95f093ea-03a9-45b1-925d-0f51d76dc93d" containerName="memcached" containerID="cri-o://f2c002513e80d40847d0f84315fc311d9e8d0c9a0c8aed763c8c5e27340df54f" gracePeriod=30 Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.614613 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-7648f748d8-cxwnc" Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.616117 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="9dde2b26-18b2-469b-94d1-92da183402fc" containerName="nova-api-log" containerID="cri-o://dc6a6cb1197c6dd1f31981da01142c0924c2b5390f63c67e892c9c4f82c3320e" gracePeriod=30 Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.616801 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="9dde2b26-18b2-469b-94d1-92da183402fc" containerName="nova-api-api" containerID="cri-o://826523d22c0f17610c94f5ab82fd83f348513fd8f4f1dac94cefc1a9fb7f997c" gracePeriod=30 Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.620421 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.620683 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="0205947a-d88b-45b3-8dfb-67965e155ab7" containerName="nova-scheduler-scheduler" containerID="cri-o://aa472661815dedb1608725d2fbfcc5a464730a1bf9356da21f6903148c5bd7dd" gracePeriod=30 Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.653287 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-964xx\" (UniqueName: \"kubernetes.io/projected/140a02f0-df36-49fb-b2bb-b267e350f5c5-kube-api-access-964xx\") pod \"openstackclient\" (UID: \"140a02f0-df36-49fb-b2bb-b267e350f5c5\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.659375 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-7648f748d8-cxwnc"] Mar 16 17:08:36 crc kubenswrapper[5120]: E0316 17:08:36.660339 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="aa472661815dedb1608725d2fbfcc5a464730a1bf9356da21f6903148c5bd7dd" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 17:08:36 crc kubenswrapper[5120]: E0316 17:08:36.688078 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="aa472661815dedb1608725d2fbfcc5a464730a1bf9356da21f6903148c5bd7dd" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 17:08:36 crc kubenswrapper[5120]: E0316 17:08:36.703737 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="aa472661815dedb1608725d2fbfcc5a464730a1bf9356da21f6903148c5bd7dd" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 17:08:36 crc kubenswrapper[5120]: E0316 17:08:36.705972 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="0205947a-d88b-45b3-8dfb-67965e155ab7" containerName="nova-scheduler-scheduler" probeResult="unknown" Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.767453 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-6f95f9d4f9-4kmmn" Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.788127 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3f98651e-6cef-4b31-8aac-46d152305e88-combined-ca-bundle\") pod \"barbican-api-7648f748d8-cxwnc\" (UID: \"3f98651e-6cef-4b31-8aac-46d152305e88\") " pod="openstack-kuttl-tests/barbican-api-7648f748d8-cxwnc" Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.788388 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3f98651e-6cef-4b31-8aac-46d152305e88-config-data\") pod \"barbican-api-7648f748d8-cxwnc\" (UID: \"3f98651e-6cef-4b31-8aac-46d152305e88\") " pod="openstack-kuttl-tests/barbican-api-7648f748d8-cxwnc" Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.788517 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2mhb\" (UniqueName: \"kubernetes.io/projected/3f98651e-6cef-4b31-8aac-46d152305e88-kube-api-access-r2mhb\") pod \"barbican-api-7648f748d8-cxwnc\" (UID: \"3f98651e-6cef-4b31-8aac-46d152305e88\") " pod="openstack-kuttl-tests/barbican-api-7648f748d8-cxwnc" Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.788852 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/3f98651e-6cef-4b31-8aac-46d152305e88-public-tls-certs\") pod \"barbican-api-7648f748d8-cxwnc\" (UID: \"3f98651e-6cef-4b31-8aac-46d152305e88\") " pod="openstack-kuttl-tests/barbican-api-7648f748d8-cxwnc" Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.790035 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/3f98651e-6cef-4b31-8aac-46d152305e88-internal-tls-certs\") pod \"barbican-api-7648f748d8-cxwnc\" (UID: \"3f98651e-6cef-4b31-8aac-46d152305e88\") " pod="openstack-kuttl-tests/barbican-api-7648f748d8-cxwnc" Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.791580 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/3f98651e-6cef-4b31-8aac-46d152305e88-config-data-custom\") pod \"barbican-api-7648f748d8-cxwnc\" (UID: \"3f98651e-6cef-4b31-8aac-46d152305e88\") " pod="openstack-kuttl-tests/barbican-api-7648f748d8-cxwnc" Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.791837 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3f98651e-6cef-4b31-8aac-46d152305e88-logs\") pod \"barbican-api-7648f748d8-cxwnc\" (UID: \"3f98651e-6cef-4b31-8aac-46d152305e88\") " pod="openstack-kuttl-tests/barbican-api-7648f748d8-cxwnc" Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.793436 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-85687c8566-vv9qr"] Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.796150 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podUID="b9d1b067-481f-4959-99ab-68d36e78226d" containerName="ovsdbserver-nb" containerID="cri-o://400808da31cd313ab6122809b1a8caf64bfc05ff3b932a21cc294191c8a85be9" gracePeriod=300 Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.809808 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-85687c8566-vv9qr"] Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.809846 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.809863 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.809873 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.810317 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="1a6911b8-1804-40ce-88c2-3da863703774" containerName="account-server" containerID="cri-o://8e3d0f9ddaf5e60bb60873b508b6a595547e102a296dfd3de5c2efae3f915946" gracePeriod=30 Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.810373 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="1a6911b8-1804-40ce-88c2-3da863703774" containerName="swift-recon-cron" containerID="cri-o://fc3653aadde94d85e422b461f8f63dc7a32af850418ac80e3af785d73f21e8ee" gracePeriod=30 Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.810434 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="1a6911b8-1804-40ce-88c2-3da863703774" containerName="rsync" containerID="cri-o://5098fec9a781166eb146869f3b45433c89e4149e842057b0aaddbb9c681c7c3b" gracePeriod=30 Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.810483 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="1a6911b8-1804-40ce-88c2-3da863703774" containerName="object-expirer" containerID="cri-o://26147a9fb03ce38ea3372a952b4e58d7ed008843847066114964a28ec1957d0b" gracePeriod=30 Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.810516 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="1a6911b8-1804-40ce-88c2-3da863703774" containerName="object-updater" containerID="cri-o://fffd62bf82332525123277c7167d5d539fb0e406dd1cd781091c41260675fbfa" gracePeriod=30 Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.810549 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="1a6911b8-1804-40ce-88c2-3da863703774" containerName="object-auditor" containerID="cri-o://081c334e4b23b1cf2a7028106205f291abb6558ec66919bfb6c0c3657a7caf3c" gracePeriod=30 Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.810580 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="1a6911b8-1804-40ce-88c2-3da863703774" containerName="object-replicator" containerID="cri-o://aef5ac3f9a8cd4ef3a09154c9b4ca0fb6ac5e3c8fdc5d37721d7af270d940c36" gracePeriod=30 Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.810614 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="1a6911b8-1804-40ce-88c2-3da863703774" containerName="object-server" containerID="cri-o://cb569b064bfb2f3dd5071e1c85d0dfddab098ebc74a76b4f9cbbdd2dd604b2b2" gracePeriod=30 Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.810642 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="1a6911b8-1804-40ce-88c2-3da863703774" containerName="container-updater" containerID="cri-o://fcaa41db7f6b2b8655584a426b862d77c42d55c54fa1dc017b5c98bcb6369875" gracePeriod=30 Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.810670 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="1a6911b8-1804-40ce-88c2-3da863703774" containerName="container-auditor" containerID="cri-o://0602cdf7cd4de99a43963da16f1e923e6041dd0ccfb8ec804e378960e6ee602d" gracePeriod=30 Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.810700 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="1a6911b8-1804-40ce-88c2-3da863703774" containerName="container-replicator" containerID="cri-o://86f9da2a34f9df6e767f05f80a230f7f4244350d372505d0d4572c4ede7233a8" gracePeriod=30 Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.810743 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="1a6911b8-1804-40ce-88c2-3da863703774" containerName="container-server" containerID="cri-o://b17c5c3627da4f5e5b7fc0294a06455b8592076064fc51ef743ed73361d54cca" gracePeriod=30 Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.810816 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="1a6911b8-1804-40ce-88c2-3da863703774" containerName="account-auditor" containerID="cri-o://80c15f9c6214656853deb3afd716e5558ff0381737507b767a4f1a07d636dc25" gracePeriod=30 Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.810902 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="1a6911b8-1804-40ce-88c2-3da863703774" containerName="account-reaper" containerID="cri-o://74b6ded1ca90df3a7680b3667eb45a59ed7c4161508c89148fac28872165aad5" gracePeriod=30 Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.810950 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="1a6911b8-1804-40ce-88c2-3da863703774" containerName="account-replicator" containerID="cri-o://6cac886d9d64581e2f03ae4d053a2a05790fb1dc3dac0b14b081cf3e631c709c" gracePeriod=30 Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.812498 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="0156f10b-e51f-4ce8-a414-e6339cd30530" containerName="cinder-api-log" containerID="cri-o://0dfc84e67d0d7f257d495c814e97c5fa6984e88ce792fe5da46f735a6735d0dd" gracePeriod=30 Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.812920 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="0156f10b-e51f-4ce8-a414-e6339cd30530" containerName="cinder-api" containerID="cri-o://4feffabf29873c38fc600009dba2873008f7c996513320da07ca2954a6024344" gracePeriod=30 Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.813279 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-85687c8566-vv9qr" Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.813508 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podUID="286e2312-ce33-48da-ac60-149b96ace59a" containerName="nova-cell1-novncproxy-novncproxy" containerID="cri-o://c21a10708b310667945ad3e55d48904fa4e2513041d3f95d448b7f3f10ed9b7b" gracePeriod=30 Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.826915 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.862644 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.863088 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podUID="1b14824b-ab59-47bd-af31-b5f0b806a9c3" containerName="openstack-network-exporter" containerID="cri-o://b9a2e58ea47b55c32ddeca091d4724c0a91bc2544cf67c854eae81885c19cc96" gracePeriod=300 Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.881322 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.895460 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/3f98651e-6cef-4b31-8aac-46d152305e88-public-tls-certs\") pod \"barbican-api-7648f748d8-cxwnc\" (UID: \"3f98651e-6cef-4b31-8aac-46d152305e88\") " pod="openstack-kuttl-tests/barbican-api-7648f748d8-cxwnc" Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.895817 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/3f98651e-6cef-4b31-8aac-46d152305e88-internal-tls-certs\") pod \"barbican-api-7648f748d8-cxwnc\" (UID: \"3f98651e-6cef-4b31-8aac-46d152305e88\") " pod="openstack-kuttl-tests/barbican-api-7648f748d8-cxwnc" Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.896083 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/3f98651e-6cef-4b31-8aac-46d152305e88-config-data-custom\") pod \"barbican-api-7648f748d8-cxwnc\" (UID: \"3f98651e-6cef-4b31-8aac-46d152305e88\") " pod="openstack-kuttl-tests/barbican-api-7648f748d8-cxwnc" Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.896232 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3f98651e-6cef-4b31-8aac-46d152305e88-logs\") pod \"barbican-api-7648f748d8-cxwnc\" (UID: \"3f98651e-6cef-4b31-8aac-46d152305e88\") " pod="openstack-kuttl-tests/barbican-api-7648f748d8-cxwnc" Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.896528 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3f98651e-6cef-4b31-8aac-46d152305e88-combined-ca-bundle\") pod \"barbican-api-7648f748d8-cxwnc\" (UID: \"3f98651e-6cef-4b31-8aac-46d152305e88\") " pod="openstack-kuttl-tests/barbican-api-7648f748d8-cxwnc" Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.896654 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3f98651e-6cef-4b31-8aac-46d152305e88-config-data\") pod \"barbican-api-7648f748d8-cxwnc\" (UID: \"3f98651e-6cef-4b31-8aac-46d152305e88\") " pod="openstack-kuttl-tests/barbican-api-7648f748d8-cxwnc" Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.896791 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r2mhb\" (UniqueName: \"kubernetes.io/projected/3f98651e-6cef-4b31-8aac-46d152305e88-kube-api-access-r2mhb\") pod \"barbican-api-7648f748d8-cxwnc\" (UID: \"3f98651e-6cef-4b31-8aac-46d152305e88\") " pod="openstack-kuttl-tests/barbican-api-7648f748d8-cxwnc" Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.899645 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3f98651e-6cef-4b31-8aac-46d152305e88-logs\") pod \"barbican-api-7648f748d8-cxwnc\" (UID: \"3f98651e-6cef-4b31-8aac-46d152305e88\") " pod="openstack-kuttl-tests/barbican-api-7648f748d8-cxwnc" Mar 16 17:08:36 crc kubenswrapper[5120]: E0316 17:08:36.899718 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-barbican-public-svc: secret "cert-barbican-public-svc" not found Mar 16 17:08:36 crc kubenswrapper[5120]: E0316 17:08:36.899784 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f98651e-6cef-4b31-8aac-46d152305e88-public-tls-certs podName:3f98651e-6cef-4b31-8aac-46d152305e88 nodeName:}" failed. No retries permitted until 2026-03-16 17:08:37.399767799 +0000 UTC m=+5819.553699456 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/3f98651e-6cef-4b31-8aac-46d152305e88-public-tls-certs") pod "barbican-api-7648f748d8-cxwnc" (UID: "3f98651e-6cef-4b31-8aac-46d152305e88") : secret "cert-barbican-public-svc" not found Mar 16 17:08:36 crc kubenswrapper[5120]: E0316 17:08:36.900305 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-barbican-internal-svc: secret "cert-barbican-internal-svc" not found Mar 16 17:08:36 crc kubenswrapper[5120]: E0316 17:08:36.900341 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f98651e-6cef-4b31-8aac-46d152305e88-internal-tls-certs podName:3f98651e-6cef-4b31-8aac-46d152305e88 nodeName:}" failed. No retries permitted until 2026-03-16 17:08:37.400331524 +0000 UTC m=+5819.554263191 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/3f98651e-6cef-4b31-8aac-46d152305e88-internal-tls-certs") pod "barbican-api-7648f748d8-cxwnc" (UID: "3f98651e-6cef-4b31-8aac-46d152305e88") : secret "cert-barbican-internal-svc" not found Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.905243 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3f98651e-6cef-4b31-8aac-46d152305e88-config-data\") pod \"barbican-api-7648f748d8-cxwnc\" (UID: \"3f98651e-6cef-4b31-8aac-46d152305e88\") " pod="openstack-kuttl-tests/barbican-api-7648f748d8-cxwnc" Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.908623 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3f98651e-6cef-4b31-8aac-46d152305e88-combined-ca-bundle\") pod \"barbican-api-7648f748d8-cxwnc\" (UID: \"3f98651e-6cef-4b31-8aac-46d152305e88\") " pod="openstack-kuttl-tests/barbican-api-7648f748d8-cxwnc" Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.910652 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/3f98651e-6cef-4b31-8aac-46d152305e88-config-data-custom\") pod \"barbican-api-7648f748d8-cxwnc\" (UID: \"3f98651e-6cef-4b31-8aac-46d152305e88\") " pod="openstack-kuttl-tests/barbican-api-7648f748d8-cxwnc" Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.924551 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-64b7569b94-dxks6"] Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.925479 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2mhb\" (UniqueName: \"kubernetes.io/projected/3f98651e-6cef-4b31-8aac-46d152305e88-kube-api-access-r2mhb\") pod \"barbican-api-7648f748d8-cxwnc\" (UID: \"3f98651e-6cef-4b31-8aac-46d152305e88\") " pod="openstack-kuttl-tests/barbican-api-7648f748d8-cxwnc" Mar 16 17:08:36 crc kubenswrapper[5120]: I0316 17:08:36.958187 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-64b7569b94-dxks6" Mar 16 17:08:37 crc kubenswrapper[5120]: I0316 17:08:37.002208 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7a637c98-abe1-4f51-bee0-eb384fa79a43-config-data\") pod \"placement-85687c8566-vv9qr\" (UID: \"7a637c98-abe1-4f51-bee0-eb384fa79a43\") " pod="openstack-kuttl-tests/placement-85687c8566-vv9qr" Mar 16 17:08:37 crc kubenswrapper[5120]: I0316 17:08:37.002258 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbh84\" (UniqueName: \"kubernetes.io/projected/7a637c98-abe1-4f51-bee0-eb384fa79a43-kube-api-access-kbh84\") pod \"placement-85687c8566-vv9qr\" (UID: \"7a637c98-abe1-4f51-bee0-eb384fa79a43\") " pod="openstack-kuttl-tests/placement-85687c8566-vv9qr" Mar 16 17:08:37 crc kubenswrapper[5120]: I0316 17:08:37.002370 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7a637c98-abe1-4f51-bee0-eb384fa79a43-logs\") pod \"placement-85687c8566-vv9qr\" (UID: \"7a637c98-abe1-4f51-bee0-eb384fa79a43\") " pod="openstack-kuttl-tests/placement-85687c8566-vv9qr" Mar 16 17:08:37 crc kubenswrapper[5120]: I0316 17:08:37.002485 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/7a637c98-abe1-4f51-bee0-eb384fa79a43-public-tls-certs\") pod \"placement-85687c8566-vv9qr\" (UID: \"7a637c98-abe1-4f51-bee0-eb384fa79a43\") " pod="openstack-kuttl-tests/placement-85687c8566-vv9qr" Mar 16 17:08:37 crc kubenswrapper[5120]: I0316 17:08:37.002544 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7a637c98-abe1-4f51-bee0-eb384fa79a43-scripts\") pod \"placement-85687c8566-vv9qr\" (UID: \"7a637c98-abe1-4f51-bee0-eb384fa79a43\") " pod="openstack-kuttl-tests/placement-85687c8566-vv9qr" Mar 16 17:08:37 crc kubenswrapper[5120]: I0316 17:08:37.002610 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/7a637c98-abe1-4f51-bee0-eb384fa79a43-internal-tls-certs\") pod \"placement-85687c8566-vv9qr\" (UID: \"7a637c98-abe1-4f51-bee0-eb384fa79a43\") " pod="openstack-kuttl-tests/placement-85687c8566-vv9qr" Mar 16 17:08:37 crc kubenswrapper[5120]: I0316 17:08:37.002695 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7a637c98-abe1-4f51-bee0-eb384fa79a43-combined-ca-bundle\") pod \"placement-85687c8566-vv9qr\" (UID: \"7a637c98-abe1-4f51-bee0-eb384fa79a43\") " pod="openstack-kuttl-tests/placement-85687c8566-vv9qr" Mar 16 17:08:37 crc kubenswrapper[5120]: I0316 17:08:37.021180 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-64b7569b94-dxks6"] Mar 16 17:08:37 crc kubenswrapper[5120]: I0316 17:08:37.106676 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/7a637c98-abe1-4f51-bee0-eb384fa79a43-public-tls-certs\") pod \"placement-85687c8566-vv9qr\" (UID: \"7a637c98-abe1-4f51-bee0-eb384fa79a43\") " pod="openstack-kuttl-tests/placement-85687c8566-vv9qr" Mar 16 17:08:37 crc kubenswrapper[5120]: I0316 17:08:37.107175 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7a637c98-abe1-4f51-bee0-eb384fa79a43-scripts\") pod \"placement-85687c8566-vv9qr\" (UID: \"7a637c98-abe1-4f51-bee0-eb384fa79a43\") " pod="openstack-kuttl-tests/placement-85687c8566-vv9qr" Mar 16 17:08:37 crc kubenswrapper[5120]: I0316 17:08:37.107335 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/7a637c98-abe1-4f51-bee0-eb384fa79a43-internal-tls-certs\") pod \"placement-85687c8566-vv9qr\" (UID: \"7a637c98-abe1-4f51-bee0-eb384fa79a43\") " pod="openstack-kuttl-tests/placement-85687c8566-vv9qr" Mar 16 17:08:37 crc kubenswrapper[5120]: I0316 17:08:37.107409 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/76f0322f-b14b-4b9b-9665-2121e3b21629-config\") pod \"neutron-64b7569b94-dxks6\" (UID: \"76f0322f-b14b-4b9b-9665-2121e3b21629\") " pod="openstack-kuttl-tests/neutron-64b7569b94-dxks6" Mar 16 17:08:37 crc kubenswrapper[5120]: I0316 17:08:37.107496 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/76f0322f-b14b-4b9b-9665-2121e3b21629-ovndb-tls-certs\") pod \"neutron-64b7569b94-dxks6\" (UID: \"76f0322f-b14b-4b9b-9665-2121e3b21629\") " pod="openstack-kuttl-tests/neutron-64b7569b94-dxks6" Mar 16 17:08:37 crc kubenswrapper[5120]: I0316 17:08:37.107559 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qq9nn\" (UniqueName: \"kubernetes.io/projected/76f0322f-b14b-4b9b-9665-2121e3b21629-kube-api-access-qq9nn\") pod \"neutron-64b7569b94-dxks6\" (UID: \"76f0322f-b14b-4b9b-9665-2121e3b21629\") " pod="openstack-kuttl-tests/neutron-64b7569b94-dxks6" Mar 16 17:08:37 crc kubenswrapper[5120]: I0316 17:08:37.107689 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7a637c98-abe1-4f51-bee0-eb384fa79a43-combined-ca-bundle\") pod \"placement-85687c8566-vv9qr\" (UID: \"7a637c98-abe1-4f51-bee0-eb384fa79a43\") " pod="openstack-kuttl-tests/placement-85687c8566-vv9qr" Mar 16 17:08:37 crc kubenswrapper[5120]: I0316 17:08:37.109402 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/76f0322f-b14b-4b9b-9665-2121e3b21629-internal-tls-certs\") pod \"neutron-64b7569b94-dxks6\" (UID: \"76f0322f-b14b-4b9b-9665-2121e3b21629\") " pod="openstack-kuttl-tests/neutron-64b7569b94-dxks6" Mar 16 17:08:37 crc kubenswrapper[5120]: I0316 17:08:37.109476 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7a637c98-abe1-4f51-bee0-eb384fa79a43-config-data\") pod \"placement-85687c8566-vv9qr\" (UID: \"7a637c98-abe1-4f51-bee0-eb384fa79a43\") " pod="openstack-kuttl-tests/placement-85687c8566-vv9qr" Mar 16 17:08:37 crc kubenswrapper[5120]: I0316 17:08:37.109500 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kbh84\" (UniqueName: \"kubernetes.io/projected/7a637c98-abe1-4f51-bee0-eb384fa79a43-kube-api-access-kbh84\") pod \"placement-85687c8566-vv9qr\" (UID: \"7a637c98-abe1-4f51-bee0-eb384fa79a43\") " pod="openstack-kuttl-tests/placement-85687c8566-vv9qr" Mar 16 17:08:37 crc kubenswrapper[5120]: I0316 17:08:37.109593 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/76f0322f-b14b-4b9b-9665-2121e3b21629-public-tls-certs\") pod \"neutron-64b7569b94-dxks6\" (UID: \"76f0322f-b14b-4b9b-9665-2121e3b21629\") " pod="openstack-kuttl-tests/neutron-64b7569b94-dxks6" Mar 16 17:08:37 crc kubenswrapper[5120]: I0316 17:08:37.109651 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/76f0322f-b14b-4b9b-9665-2121e3b21629-combined-ca-bundle\") pod \"neutron-64b7569b94-dxks6\" (UID: \"76f0322f-b14b-4b9b-9665-2121e3b21629\") " pod="openstack-kuttl-tests/neutron-64b7569b94-dxks6" Mar 16 17:08:37 crc kubenswrapper[5120]: E0316 17:08:37.109927 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-placement-internal-svc: secret "cert-placement-internal-svc" not found Mar 16 17:08:37 crc kubenswrapper[5120]: E0316 17:08:37.110008 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a637c98-abe1-4f51-bee0-eb384fa79a43-internal-tls-certs podName:7a637c98-abe1-4f51-bee0-eb384fa79a43 nodeName:}" failed. No retries permitted until 2026-03-16 17:08:37.609987576 +0000 UTC m=+5819.763919233 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/7a637c98-abe1-4f51-bee0-eb384fa79a43-internal-tls-certs") pod "placement-85687c8566-vv9qr" (UID: "7a637c98-abe1-4f51-bee0-eb384fa79a43") : secret "cert-placement-internal-svc" not found Mar 16 17:08:37 crc kubenswrapper[5120]: E0316 17:08:37.110562 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-placement-public-svc: secret "cert-placement-public-svc" not found Mar 16 17:08:37 crc kubenswrapper[5120]: E0316 17:08:37.110620 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a637c98-abe1-4f51-bee0-eb384fa79a43-public-tls-certs podName:7a637c98-abe1-4f51-bee0-eb384fa79a43 nodeName:}" failed. No retries permitted until 2026-03-16 17:08:37.610606704 +0000 UTC m=+5819.764538361 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/7a637c98-abe1-4f51-bee0-eb384fa79a43-public-tls-certs") pod "placement-85687c8566-vv9qr" (UID: "7a637c98-abe1-4f51-bee0-eb384fa79a43") : secret "cert-placement-public-svc" not found Mar 16 17:08:37 crc kubenswrapper[5120]: I0316 17:08:37.110707 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7a637c98-abe1-4f51-bee0-eb384fa79a43-logs\") pod \"placement-85687c8566-vv9qr\" (UID: \"7a637c98-abe1-4f51-bee0-eb384fa79a43\") " pod="openstack-kuttl-tests/placement-85687c8566-vv9qr" Mar 16 17:08:37 crc kubenswrapper[5120]: I0316 17:08:37.111158 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7a637c98-abe1-4f51-bee0-eb384fa79a43-logs\") pod \"placement-85687c8566-vv9qr\" (UID: \"7a637c98-abe1-4f51-bee0-eb384fa79a43\") " pod="openstack-kuttl-tests/placement-85687c8566-vv9qr" Mar 16 17:08:37 crc kubenswrapper[5120]: I0316 17:08:37.111746 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/76f0322f-b14b-4b9b-9665-2121e3b21629-httpd-config\") pod \"neutron-64b7569b94-dxks6\" (UID: \"76f0322f-b14b-4b9b-9665-2121e3b21629\") " pod="openstack-kuttl-tests/neutron-64b7569b94-dxks6" Mar 16 17:08:37 crc kubenswrapper[5120]: I0316 17:08:37.118320 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7a637c98-abe1-4f51-bee0-eb384fa79a43-combined-ca-bundle\") pod \"placement-85687c8566-vv9qr\" (UID: \"7a637c98-abe1-4f51-bee0-eb384fa79a43\") " pod="openstack-kuttl-tests/placement-85687c8566-vv9qr" Mar 16 17:08:37 crc kubenswrapper[5120]: I0316 17:08:37.118392 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7a637c98-abe1-4f51-bee0-eb384fa79a43-config-data\") pod \"placement-85687c8566-vv9qr\" (UID: \"7a637c98-abe1-4f51-bee0-eb384fa79a43\") " pod="openstack-kuttl-tests/placement-85687c8566-vv9qr" Mar 16 17:08:37 crc kubenswrapper[5120]: I0316 17:08:37.121298 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7a637c98-abe1-4f51-bee0-eb384fa79a43-scripts\") pod \"placement-85687c8566-vv9qr\" (UID: \"7a637c98-abe1-4f51-bee0-eb384fa79a43\") " pod="openstack-kuttl-tests/placement-85687c8566-vv9qr" Mar 16 17:08:37 crc kubenswrapper[5120]: I0316 17:08:37.130452 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbh84\" (UniqueName: \"kubernetes.io/projected/7a637c98-abe1-4f51-bee0-eb384fa79a43-kube-api-access-kbh84\") pod \"placement-85687c8566-vv9qr\" (UID: \"7a637c98-abe1-4f51-bee0-eb384fa79a43\") " pod="openstack-kuttl-tests/placement-85687c8566-vv9qr" Mar 16 17:08:37 crc kubenswrapper[5120]: I0316 17:08:37.217238 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/76f0322f-b14b-4b9b-9665-2121e3b21629-config\") pod \"neutron-64b7569b94-dxks6\" (UID: \"76f0322f-b14b-4b9b-9665-2121e3b21629\") " pod="openstack-kuttl-tests/neutron-64b7569b94-dxks6" Mar 16 17:08:37 crc kubenswrapper[5120]: I0316 17:08:37.217311 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/76f0322f-b14b-4b9b-9665-2121e3b21629-ovndb-tls-certs\") pod \"neutron-64b7569b94-dxks6\" (UID: \"76f0322f-b14b-4b9b-9665-2121e3b21629\") " pod="openstack-kuttl-tests/neutron-64b7569b94-dxks6" Mar 16 17:08:37 crc kubenswrapper[5120]: I0316 17:08:37.217340 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qq9nn\" (UniqueName: \"kubernetes.io/projected/76f0322f-b14b-4b9b-9665-2121e3b21629-kube-api-access-qq9nn\") pod \"neutron-64b7569b94-dxks6\" (UID: \"76f0322f-b14b-4b9b-9665-2121e3b21629\") " pod="openstack-kuttl-tests/neutron-64b7569b94-dxks6" Mar 16 17:08:37 crc kubenswrapper[5120]: I0316 17:08:37.217602 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/76f0322f-b14b-4b9b-9665-2121e3b21629-internal-tls-certs\") pod \"neutron-64b7569b94-dxks6\" (UID: \"76f0322f-b14b-4b9b-9665-2121e3b21629\") " pod="openstack-kuttl-tests/neutron-64b7569b94-dxks6" Mar 16 17:08:37 crc kubenswrapper[5120]: I0316 17:08:37.217674 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/76f0322f-b14b-4b9b-9665-2121e3b21629-public-tls-certs\") pod \"neutron-64b7569b94-dxks6\" (UID: \"76f0322f-b14b-4b9b-9665-2121e3b21629\") " pod="openstack-kuttl-tests/neutron-64b7569b94-dxks6" Mar 16 17:08:37 crc kubenswrapper[5120]: I0316 17:08:37.217711 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/76f0322f-b14b-4b9b-9665-2121e3b21629-combined-ca-bundle\") pod \"neutron-64b7569b94-dxks6\" (UID: \"76f0322f-b14b-4b9b-9665-2121e3b21629\") " pod="openstack-kuttl-tests/neutron-64b7569b94-dxks6" Mar 16 17:08:37 crc kubenswrapper[5120]: I0316 17:08:37.217850 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/76f0322f-b14b-4b9b-9665-2121e3b21629-httpd-config\") pod \"neutron-64b7569b94-dxks6\" (UID: \"76f0322f-b14b-4b9b-9665-2121e3b21629\") " pod="openstack-kuttl-tests/neutron-64b7569b94-dxks6" Mar 16 17:08:37 crc kubenswrapper[5120]: E0316 17:08:37.220618 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-neutron-internal-svc: secret "cert-neutron-internal-svc" not found Mar 16 17:08:37 crc kubenswrapper[5120]: E0316 17:08:37.220688 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76f0322f-b14b-4b9b-9665-2121e3b21629-internal-tls-certs podName:76f0322f-b14b-4b9b-9665-2121e3b21629 nodeName:}" failed. No retries permitted until 2026-03-16 17:08:37.720669564 +0000 UTC m=+5819.874601221 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/76f0322f-b14b-4b9b-9665-2121e3b21629-internal-tls-certs") pod "neutron-64b7569b94-dxks6" (UID: "76f0322f-b14b-4b9b-9665-2121e3b21629") : secret "cert-neutron-internal-svc" not found Mar 16 17:08:37 crc kubenswrapper[5120]: E0316 17:08:37.220868 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-neutron-public-svc: secret "cert-neutron-public-svc" not found Mar 16 17:08:37 crc kubenswrapper[5120]: E0316 17:08:37.220898 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76f0322f-b14b-4b9b-9665-2121e3b21629-public-tls-certs podName:76f0322f-b14b-4b9b-9665-2121e3b21629 nodeName:}" failed. No retries permitted until 2026-03-16 17:08:37.72089131 +0000 UTC m=+5819.874822967 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/76f0322f-b14b-4b9b-9665-2121e3b21629-public-tls-certs") pod "neutron-64b7569b94-dxks6" (UID: "76f0322f-b14b-4b9b-9665-2121e3b21629") : secret "cert-neutron-public-svc" not found Mar 16 17:08:37 crc kubenswrapper[5120]: E0316 17:08:37.221256 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-neutron-ovndbs: secret "cert-neutron-ovndbs" not found Mar 16 17:08:37 crc kubenswrapper[5120]: E0316 17:08:37.221344 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76f0322f-b14b-4b9b-9665-2121e3b21629-ovndb-tls-certs podName:76f0322f-b14b-4b9b-9665-2121e3b21629 nodeName:}" failed. No retries permitted until 2026-03-16 17:08:37.721323383 +0000 UTC m=+5819.875255040 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ovndb-tls-certs" (UniqueName: "kubernetes.io/secret/76f0322f-b14b-4b9b-9665-2121e3b21629-ovndb-tls-certs") pod "neutron-64b7569b94-dxks6" (UID: "76f0322f-b14b-4b9b-9665-2121e3b21629") : secret "cert-neutron-ovndbs" not found Mar 16 17:08:37 crc kubenswrapper[5120]: I0316 17:08:37.250950 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/76f0322f-b14b-4b9b-9665-2121e3b21629-httpd-config\") pod \"neutron-64b7569b94-dxks6\" (UID: \"76f0322f-b14b-4b9b-9665-2121e3b21629\") " pod="openstack-kuttl-tests/neutron-64b7569b94-dxks6" Mar 16 17:08:37 crc kubenswrapper[5120]: I0316 17:08:37.271617 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/76f0322f-b14b-4b9b-9665-2121e3b21629-config\") pod \"neutron-64b7569b94-dxks6\" (UID: \"76f0322f-b14b-4b9b-9665-2121e3b21629\") " pod="openstack-kuttl-tests/neutron-64b7569b94-dxks6" Mar 16 17:08:37 crc kubenswrapper[5120]: I0316 17:08:37.272734 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qq9nn\" (UniqueName: \"kubernetes.io/projected/76f0322f-b14b-4b9b-9665-2121e3b21629-kube-api-access-qq9nn\") pod \"neutron-64b7569b94-dxks6\" (UID: \"76f0322f-b14b-4b9b-9665-2121e3b21629\") " pod="openstack-kuttl-tests/neutron-64b7569b94-dxks6" Mar 16 17:08:37 crc kubenswrapper[5120]: I0316 17:08:37.273507 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/76f0322f-b14b-4b9b-9665-2121e3b21629-combined-ca-bundle\") pod \"neutron-64b7569b94-dxks6\" (UID: \"76f0322f-b14b-4b9b-9665-2121e3b21629\") " pod="openstack-kuttl-tests/neutron-64b7569b94-dxks6" Mar 16 17:08:37 crc kubenswrapper[5120]: E0316 17:08:37.354649 5120 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod45bed047_fbff_439b_b659_657f9b9d3b62.slice/crio-1c02bc06344293428f1e8f7afa638a50bbb02427e908baa3d149b016a246865b.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb9d1b067_481f_4959_99ab_68d36e78226d.slice/crio-36e19874faebe75c231a863143f7dd73c50e3adbff0c872e4b6a75af80b20e30.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9dde2b26_18b2_469b_94d1_92da183402fc.slice/crio-dc6a6cb1197c6dd1f31981da01142c0924c2b5390f63c67e892c9c4f82c3320e.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb9d1b067_481f_4959_99ab_68d36e78226d.slice/crio-conmon-36e19874faebe75c231a863143f7dd73c50e3adbff0c872e4b6a75af80b20e30.scope\": RecentStats: unable to find data in memory cache]" Mar 16 17:08:37 crc kubenswrapper[5120]: I0316 17:08:37.366216 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podUID="1b14824b-ab59-47bd-af31-b5f0b806a9c3" containerName="ovsdbserver-sb" containerID="cri-o://9493f8688a6a97514909dc97423f4687ed171063e7b2f0935a0373e4f07b3637" gracePeriod=300 Mar 16 17:08:37 crc kubenswrapper[5120]: I0316 17:08:37.474555 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/3f98651e-6cef-4b31-8aac-46d152305e88-public-tls-certs\") pod \"barbican-api-7648f748d8-cxwnc\" (UID: \"3f98651e-6cef-4b31-8aac-46d152305e88\") " pod="openstack-kuttl-tests/barbican-api-7648f748d8-cxwnc" Mar 16 17:08:37 crc kubenswrapper[5120]: I0316 17:08:37.474621 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/3f98651e-6cef-4b31-8aac-46d152305e88-internal-tls-certs\") pod \"barbican-api-7648f748d8-cxwnc\" (UID: \"3f98651e-6cef-4b31-8aac-46d152305e88\") " pod="openstack-kuttl-tests/barbican-api-7648f748d8-cxwnc" Mar 16 17:08:37 crc kubenswrapper[5120]: E0316 17:08:37.475169 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-barbican-internal-svc: secret "cert-barbican-internal-svc" not found Mar 16 17:08:37 crc kubenswrapper[5120]: E0316 17:08:37.475233 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f98651e-6cef-4b31-8aac-46d152305e88-internal-tls-certs podName:3f98651e-6cef-4b31-8aac-46d152305e88 nodeName:}" failed. No retries permitted until 2026-03-16 17:08:38.475217656 +0000 UTC m=+5820.629149313 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/3f98651e-6cef-4b31-8aac-46d152305e88-internal-tls-certs") pod "barbican-api-7648f748d8-cxwnc" (UID: "3f98651e-6cef-4b31-8aac-46d152305e88") : secret "cert-barbican-internal-svc" not found Mar 16 17:08:37 crc kubenswrapper[5120]: E0316 17:08:37.475601 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-barbican-public-svc: secret "cert-barbican-public-svc" not found Mar 16 17:08:37 crc kubenswrapper[5120]: E0316 17:08:37.475634 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f98651e-6cef-4b31-8aac-46d152305e88-public-tls-certs podName:3f98651e-6cef-4b31-8aac-46d152305e88 nodeName:}" failed. No retries permitted until 2026-03-16 17:08:38.475624657 +0000 UTC m=+5820.629556314 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/3f98651e-6cef-4b31-8aac-46d152305e88-public-tls-certs") pod "barbican-api-7648f748d8-cxwnc" (UID: "3f98651e-6cef-4b31-8aac-46d152305e88") : secret "cert-barbican-public-svc" not found Mar 16 17:08:37 crc kubenswrapper[5120]: I0316 17:08:37.547118 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/openstack-cell1-galera-0" podUID="5eac4201-2543-460e-8643-d376fab79512" containerName="galera" containerID="cri-o://c4fbb0d93de06153ee805dc84d38adcfe4df3b1761b668d82ce6b1cc908a9080" gracePeriod=30 Mar 16 17:08:37 crc kubenswrapper[5120]: I0316 17:08:37.621196 5120 generic.go:358] "Generic (PLEG): container finished" podID="9dde2b26-18b2-469b-94d1-92da183402fc" containerID="dc6a6cb1197c6dd1f31981da01142c0924c2b5390f63c67e892c9c4f82c3320e" exitCode=143 Mar 16 17:08:37 crc kubenswrapper[5120]: I0316 17:08:37.621348 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"9dde2b26-18b2-469b-94d1-92da183402fc","Type":"ContainerDied","Data":"dc6a6cb1197c6dd1f31981da01142c0924c2b5390f63c67e892c9c4f82c3320e"} Mar 16 17:08:37 crc kubenswrapper[5120]: I0316 17:08:37.639646 5120 generic.go:358] "Generic (PLEG): container finished" podID="c8ccd406-033f-4230-b9a3-357d14ec49f2" containerID="9148b8c5f1c6856439d0eefe2fbe6ed8be889376dd71647351caecf518bbe7e2" exitCode=143 Mar 16 17:08:37 crc kubenswrapper[5120]: I0316 17:08:37.639850 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"c8ccd406-033f-4230-b9a3-357d14ec49f2","Type":"ContainerDied","Data":"9148b8c5f1c6856439d0eefe2fbe6ed8be889376dd71647351caecf518bbe7e2"} Mar 16 17:08:37 crc kubenswrapper[5120]: I0316 17:08:37.646481 5120 generic.go:358] "Generic (PLEG): container finished" podID="3f3771ee-c5b9-4004-b631-437b1508ac5a" containerID="4ad7c1867c57d52a4fcc80cb4798fb797a71daf87508fcc099ea396489f4ae08" exitCode=0 Mar 16 17:08:37 crc kubenswrapper[5120]: I0316 17:08:37.646539 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"3f3771ee-c5b9-4004-b631-437b1508ac5a","Type":"ContainerDied","Data":"4ad7c1867c57d52a4fcc80cb4798fb797a71daf87508fcc099ea396489f4ae08"} Mar 16 17:08:37 crc kubenswrapper[5120]: I0316 17:08:37.659868 5120 generic.go:358] "Generic (PLEG): container finished" podID="95f093ea-03a9-45b1-925d-0f51d76dc93d" containerID="f2c002513e80d40847d0f84315fc311d9e8d0c9a0c8aed763c8c5e27340df54f" exitCode=0 Mar 16 17:08:37 crc kubenswrapper[5120]: I0316 17:08:37.659970 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"95f093ea-03a9-45b1-925d-0f51d76dc93d","Type":"ContainerDied","Data":"f2c002513e80d40847d0f84315fc311d9e8d0c9a0c8aed763c8c5e27340df54f"} Mar 16 17:08:37 crc kubenswrapper[5120]: I0316 17:08:37.670387 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_1b14824b-ab59-47bd-af31-b5f0b806a9c3/ovsdbserver-sb/0.log" Mar 16 17:08:37 crc kubenswrapper[5120]: I0316 17:08:37.670437 5120 generic.go:358] "Generic (PLEG): container finished" podID="1b14824b-ab59-47bd-af31-b5f0b806a9c3" containerID="b9a2e58ea47b55c32ddeca091d4724c0a91bc2544cf67c854eae81885c19cc96" exitCode=2 Mar 16 17:08:37 crc kubenswrapper[5120]: I0316 17:08:37.670457 5120 generic.go:358] "Generic (PLEG): container finished" podID="1b14824b-ab59-47bd-af31-b5f0b806a9c3" containerID="9493f8688a6a97514909dc97423f4687ed171063e7b2f0935a0373e4f07b3637" exitCode=143 Mar 16 17:08:37 crc kubenswrapper[5120]: I0316 17:08:37.670636 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"1b14824b-ab59-47bd-af31-b5f0b806a9c3","Type":"ContainerDied","Data":"b9a2e58ea47b55c32ddeca091d4724c0a91bc2544cf67c854eae81885c19cc96"} Mar 16 17:08:37 crc kubenswrapper[5120]: I0316 17:08:37.670667 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"1b14824b-ab59-47bd-af31-b5f0b806a9c3","Type":"ContainerDied","Data":"9493f8688a6a97514909dc97423f4687ed171063e7b2f0935a0373e4f07b3637"} Mar 16 17:08:37 crc kubenswrapper[5120]: I0316 17:08:37.681702 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/7a637c98-abe1-4f51-bee0-eb384fa79a43-public-tls-certs\") pod \"placement-85687c8566-vv9qr\" (UID: \"7a637c98-abe1-4f51-bee0-eb384fa79a43\") " pod="openstack-kuttl-tests/placement-85687c8566-vv9qr" Mar 16 17:08:37 crc kubenswrapper[5120]: I0316 17:08:37.681828 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/7a637c98-abe1-4f51-bee0-eb384fa79a43-internal-tls-certs\") pod \"placement-85687c8566-vv9qr\" (UID: \"7a637c98-abe1-4f51-bee0-eb384fa79a43\") " pod="openstack-kuttl-tests/placement-85687c8566-vv9qr" Mar 16 17:08:37 crc kubenswrapper[5120]: E0316 17:08:37.682154 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-placement-public-svc: secret "cert-placement-public-svc" not found Mar 16 17:08:37 crc kubenswrapper[5120]: E0316 17:08:37.682251 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a637c98-abe1-4f51-bee0-eb384fa79a43-public-tls-certs podName:7a637c98-abe1-4f51-bee0-eb384fa79a43 nodeName:}" failed. No retries permitted until 2026-03-16 17:08:38.682228065 +0000 UTC m=+5820.836159772 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/7a637c98-abe1-4f51-bee0-eb384fa79a43-public-tls-certs") pod "placement-85687c8566-vv9qr" (UID: "7a637c98-abe1-4f51-bee0-eb384fa79a43") : secret "cert-placement-public-svc" not found Mar 16 17:08:37 crc kubenswrapper[5120]: E0316 17:08:37.682280 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-placement-internal-svc: secret "cert-placement-internal-svc" not found Mar 16 17:08:37 crc kubenswrapper[5120]: E0316 17:08:37.682336 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a637c98-abe1-4f51-bee0-eb384fa79a43-internal-tls-certs podName:7a637c98-abe1-4f51-bee0-eb384fa79a43 nodeName:}" failed. No retries permitted until 2026-03-16 17:08:38.682320927 +0000 UTC m=+5820.836252584 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/7a637c98-abe1-4f51-bee0-eb384fa79a43-internal-tls-certs") pod "placement-85687c8566-vv9qr" (UID: "7a637c98-abe1-4f51-bee0-eb384fa79a43") : secret "cert-placement-internal-svc" not found Mar 16 17:08:37 crc kubenswrapper[5120]: I0316 17:08:37.688723 5120 generic.go:358] "Generic (PLEG): container finished" podID="0156f10b-e51f-4ce8-a414-e6339cd30530" containerID="0dfc84e67d0d7f257d495c814e97c5fa6984e88ce792fe5da46f735a6735d0dd" exitCode=143 Mar 16 17:08:37 crc kubenswrapper[5120]: I0316 17:08:37.688877 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"0156f10b-e51f-4ce8-a414-e6339cd30530","Type":"ContainerDied","Data":"0dfc84e67d0d7f257d495c814e97c5fa6984e88ce792fe5da46f735a6735d0dd"} Mar 16 17:08:37 crc kubenswrapper[5120]: I0316 17:08:37.707854 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/openstack-galera-0" podUID="8f7be4b3-fcec-41d8-9b93-a41201c60005" containerName="galera" containerID="cri-o://7dd60adc27480f52058b362abed27158f7e301ca1ac5ae0382560a9459203f9e" gracePeriod=30 Mar 16 17:08:37 crc kubenswrapper[5120]: E0316 17:08:37.707968 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="1c22580c851343e8b19eb347321deb3137a86e53ef649ed430e0c0ee54117213" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 17:08:37 crc kubenswrapper[5120]: I0316 17:08:37.711525 5120 generic.go:358] "Generic (PLEG): container finished" podID="1a6911b8-1804-40ce-88c2-3da863703774" containerID="5098fec9a781166eb146869f3b45433c89e4149e842057b0aaddbb9c681c7c3b" exitCode=0 Mar 16 17:08:37 crc kubenswrapper[5120]: I0316 17:08:37.711545 5120 generic.go:358] "Generic (PLEG): container finished" podID="1a6911b8-1804-40ce-88c2-3da863703774" containerID="26147a9fb03ce38ea3372a952b4e58d7ed008843847066114964a28ec1957d0b" exitCode=0 Mar 16 17:08:37 crc kubenswrapper[5120]: I0316 17:08:37.711553 5120 generic.go:358] "Generic (PLEG): container finished" podID="1a6911b8-1804-40ce-88c2-3da863703774" containerID="fffd62bf82332525123277c7167d5d539fb0e406dd1cd781091c41260675fbfa" exitCode=0 Mar 16 17:08:37 crc kubenswrapper[5120]: I0316 17:08:37.711560 5120 generic.go:358] "Generic (PLEG): container finished" podID="1a6911b8-1804-40ce-88c2-3da863703774" containerID="081c334e4b23b1cf2a7028106205f291abb6558ec66919bfb6c0c3657a7caf3c" exitCode=0 Mar 16 17:08:37 crc kubenswrapper[5120]: I0316 17:08:37.711565 5120 generic.go:358] "Generic (PLEG): container finished" podID="1a6911b8-1804-40ce-88c2-3da863703774" containerID="aef5ac3f9a8cd4ef3a09154c9b4ca0fb6ac5e3c8fdc5d37721d7af270d940c36" exitCode=0 Mar 16 17:08:37 crc kubenswrapper[5120]: I0316 17:08:37.711571 5120 generic.go:358] "Generic (PLEG): container finished" podID="1a6911b8-1804-40ce-88c2-3da863703774" containerID="cb569b064bfb2f3dd5071e1c85d0dfddab098ebc74a76b4f9cbbdd2dd604b2b2" exitCode=0 Mar 16 17:08:37 crc kubenswrapper[5120]: I0316 17:08:37.711577 5120 generic.go:358] "Generic (PLEG): container finished" podID="1a6911b8-1804-40ce-88c2-3da863703774" containerID="fcaa41db7f6b2b8655584a426b862d77c42d55c54fa1dc017b5c98bcb6369875" exitCode=0 Mar 16 17:08:37 crc kubenswrapper[5120]: I0316 17:08:37.711583 5120 generic.go:358] "Generic (PLEG): container finished" podID="1a6911b8-1804-40ce-88c2-3da863703774" containerID="0602cdf7cd4de99a43963da16f1e923e6041dd0ccfb8ec804e378960e6ee602d" exitCode=0 Mar 16 17:08:37 crc kubenswrapper[5120]: I0316 17:08:37.711589 5120 generic.go:358] "Generic (PLEG): container finished" podID="1a6911b8-1804-40ce-88c2-3da863703774" containerID="86f9da2a34f9df6e767f05f80a230f7f4244350d372505d0d4572c4ede7233a8" exitCode=0 Mar 16 17:08:37 crc kubenswrapper[5120]: I0316 17:08:37.711594 5120 generic.go:358] "Generic (PLEG): container finished" podID="1a6911b8-1804-40ce-88c2-3da863703774" containerID="b17c5c3627da4f5e5b7fc0294a06455b8592076064fc51ef743ed73361d54cca" exitCode=0 Mar 16 17:08:37 crc kubenswrapper[5120]: I0316 17:08:37.711601 5120 generic.go:358] "Generic (PLEG): container finished" podID="1a6911b8-1804-40ce-88c2-3da863703774" containerID="74b6ded1ca90df3a7680b3667eb45a59ed7c4161508c89148fac28872165aad5" exitCode=0 Mar 16 17:08:37 crc kubenswrapper[5120]: I0316 17:08:37.711608 5120 generic.go:358] "Generic (PLEG): container finished" podID="1a6911b8-1804-40ce-88c2-3da863703774" containerID="80c15f9c6214656853deb3afd716e5558ff0381737507b767a4f1a07d636dc25" exitCode=0 Mar 16 17:08:37 crc kubenswrapper[5120]: I0316 17:08:37.711614 5120 generic.go:358] "Generic (PLEG): container finished" podID="1a6911b8-1804-40ce-88c2-3da863703774" containerID="6cac886d9d64581e2f03ae4d053a2a05790fb1dc3dac0b14b081cf3e631c709c" exitCode=0 Mar 16 17:08:37 crc kubenswrapper[5120]: I0316 17:08:37.711619 5120 generic.go:358] "Generic (PLEG): container finished" podID="1a6911b8-1804-40ce-88c2-3da863703774" containerID="8e3d0f9ddaf5e60bb60873b508b6a595547e102a296dfd3de5c2efae3f915946" exitCode=0 Mar 16 17:08:37 crc kubenswrapper[5120]: I0316 17:08:37.711725 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"1a6911b8-1804-40ce-88c2-3da863703774","Type":"ContainerDied","Data":"5098fec9a781166eb146869f3b45433c89e4149e842057b0aaddbb9c681c7c3b"} Mar 16 17:08:37 crc kubenswrapper[5120]: I0316 17:08:37.711751 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"1a6911b8-1804-40ce-88c2-3da863703774","Type":"ContainerDied","Data":"26147a9fb03ce38ea3372a952b4e58d7ed008843847066114964a28ec1957d0b"} Mar 16 17:08:37 crc kubenswrapper[5120]: I0316 17:08:37.711773 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"1a6911b8-1804-40ce-88c2-3da863703774","Type":"ContainerDied","Data":"fffd62bf82332525123277c7167d5d539fb0e406dd1cd781091c41260675fbfa"} Mar 16 17:08:37 crc kubenswrapper[5120]: I0316 17:08:37.711783 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"1a6911b8-1804-40ce-88c2-3da863703774","Type":"ContainerDied","Data":"081c334e4b23b1cf2a7028106205f291abb6558ec66919bfb6c0c3657a7caf3c"} Mar 16 17:08:37 crc kubenswrapper[5120]: I0316 17:08:37.711791 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"1a6911b8-1804-40ce-88c2-3da863703774","Type":"ContainerDied","Data":"aef5ac3f9a8cd4ef3a09154c9b4ca0fb6ac5e3c8fdc5d37721d7af270d940c36"} Mar 16 17:08:37 crc kubenswrapper[5120]: I0316 17:08:37.711800 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"1a6911b8-1804-40ce-88c2-3da863703774","Type":"ContainerDied","Data":"cb569b064bfb2f3dd5071e1c85d0dfddab098ebc74a76b4f9cbbdd2dd604b2b2"} Mar 16 17:08:37 crc kubenswrapper[5120]: I0316 17:08:37.711809 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"1a6911b8-1804-40ce-88c2-3da863703774","Type":"ContainerDied","Data":"fcaa41db7f6b2b8655584a426b862d77c42d55c54fa1dc017b5c98bcb6369875"} Mar 16 17:08:37 crc kubenswrapper[5120]: I0316 17:08:37.711817 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"1a6911b8-1804-40ce-88c2-3da863703774","Type":"ContainerDied","Data":"0602cdf7cd4de99a43963da16f1e923e6041dd0ccfb8ec804e378960e6ee602d"} Mar 16 17:08:37 crc kubenswrapper[5120]: I0316 17:08:37.711832 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"1a6911b8-1804-40ce-88c2-3da863703774","Type":"ContainerDied","Data":"86f9da2a34f9df6e767f05f80a230f7f4244350d372505d0d4572c4ede7233a8"} Mar 16 17:08:37 crc kubenswrapper[5120]: I0316 17:08:37.711841 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"1a6911b8-1804-40ce-88c2-3da863703774","Type":"ContainerDied","Data":"b17c5c3627da4f5e5b7fc0294a06455b8592076064fc51ef743ed73361d54cca"} Mar 16 17:08:37 crc kubenswrapper[5120]: I0316 17:08:37.711850 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"1a6911b8-1804-40ce-88c2-3da863703774","Type":"ContainerDied","Data":"74b6ded1ca90df3a7680b3667eb45a59ed7c4161508c89148fac28872165aad5"} Mar 16 17:08:37 crc kubenswrapper[5120]: I0316 17:08:37.711868 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"1a6911b8-1804-40ce-88c2-3da863703774","Type":"ContainerDied","Data":"80c15f9c6214656853deb3afd716e5558ff0381737507b767a4f1a07d636dc25"} Mar 16 17:08:37 crc kubenswrapper[5120]: I0316 17:08:37.711878 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"1a6911b8-1804-40ce-88c2-3da863703774","Type":"ContainerDied","Data":"6cac886d9d64581e2f03ae4d053a2a05790fb1dc3dac0b14b081cf3e631c709c"} Mar 16 17:08:37 crc kubenswrapper[5120]: I0316 17:08:37.711888 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"1a6911b8-1804-40ce-88c2-3da863703774","Type":"ContainerDied","Data":"8e3d0f9ddaf5e60bb60873b508b6a595547e102a296dfd3de5c2efae3f915946"} Mar 16 17:08:37 crc kubenswrapper[5120]: I0316 17:08:37.715959 5120 generic.go:358] "Generic (PLEG): container finished" podID="45bed047-fbff-439b-b659-657f9b9d3b62" containerID="1c02bc06344293428f1e8f7afa638a50bbb02427e908baa3d149b016a246865b" exitCode=143 Mar 16 17:08:37 crc kubenswrapper[5120]: I0316 17:08:37.716044 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"45bed047-fbff-439b-b659-657f9b9d3b62","Type":"ContainerDied","Data":"1c02bc06344293428f1e8f7afa638a50bbb02427e908baa3d149b016a246865b"} Mar 16 17:08:37 crc kubenswrapper[5120]: E0316 17:08:37.722613 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="1c22580c851343e8b19eb347321deb3137a86e53ef649ed430e0c0ee54117213" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 17:08:37 crc kubenswrapper[5120]: I0316 17:08:37.724219 5120 generic.go:358] "Generic (PLEG): container finished" podID="4281ec55-3466-4ca1-8054-498475a4407a" containerID="40692fb4e719bbea05f717260a282bea677f342794b8fe0f8ea6f1f1abbfebd5" exitCode=2 Mar 16 17:08:37 crc kubenswrapper[5120]: I0316 17:08:37.724365 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"4281ec55-3466-4ca1-8054-498475a4407a","Type":"ContainerDied","Data":"40692fb4e719bbea05f717260a282bea677f342794b8fe0f8ea6f1f1abbfebd5"} Mar 16 17:08:37 crc kubenswrapper[5120]: E0316 17:08:37.724445 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="1c22580c851343e8b19eb347321deb3137a86e53ef649ed430e0c0ee54117213" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 17:08:37 crc kubenswrapper[5120]: E0316 17:08:37.724496 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="6a21ca52-7273-4160-914b-4958e7f2c2ce" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 17:08:37 crc kubenswrapper[5120]: I0316 17:08:37.728551 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_b9d1b067-481f-4959-99ab-68d36e78226d/ovsdbserver-nb/0.log" Mar 16 17:08:37 crc kubenswrapper[5120]: I0316 17:08:37.728602 5120 generic.go:358] "Generic (PLEG): container finished" podID="b9d1b067-481f-4959-99ab-68d36e78226d" containerID="400808da31cd313ab6122809b1a8caf64bfc05ff3b932a21cc294191c8a85be9" exitCode=143 Mar 16 17:08:37 crc kubenswrapper[5120]: I0316 17:08:37.728662 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"b9d1b067-481f-4959-99ab-68d36e78226d","Type":"ContainerDied","Data":"400808da31cd313ab6122809b1a8caf64bfc05ff3b932a21cc294191c8a85be9"} Mar 16 17:08:37 crc kubenswrapper[5120]: I0316 17:08:37.784386 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/76f0322f-b14b-4b9b-9665-2121e3b21629-internal-tls-certs\") pod \"neutron-64b7569b94-dxks6\" (UID: \"76f0322f-b14b-4b9b-9665-2121e3b21629\") " pod="openstack-kuttl-tests/neutron-64b7569b94-dxks6" Mar 16 17:08:37 crc kubenswrapper[5120]: I0316 17:08:37.784807 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/76f0322f-b14b-4b9b-9665-2121e3b21629-public-tls-certs\") pod \"neutron-64b7569b94-dxks6\" (UID: \"76f0322f-b14b-4b9b-9665-2121e3b21629\") " pod="openstack-kuttl-tests/neutron-64b7569b94-dxks6" Mar 16 17:08:37 crc kubenswrapper[5120]: I0316 17:08:37.785225 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/76f0322f-b14b-4b9b-9665-2121e3b21629-ovndb-tls-certs\") pod \"neutron-64b7569b94-dxks6\" (UID: \"76f0322f-b14b-4b9b-9665-2121e3b21629\") " pod="openstack-kuttl-tests/neutron-64b7569b94-dxks6" Mar 16 17:08:37 crc kubenswrapper[5120]: E0316 17:08:37.785452 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-neutron-ovndbs: secret "cert-neutron-ovndbs" not found Mar 16 17:08:37 crc kubenswrapper[5120]: E0316 17:08:37.785514 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76f0322f-b14b-4b9b-9665-2121e3b21629-ovndb-tls-certs podName:76f0322f-b14b-4b9b-9665-2121e3b21629 nodeName:}" failed. No retries permitted until 2026-03-16 17:08:38.785497628 +0000 UTC m=+5820.939429285 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "ovndb-tls-certs" (UniqueName: "kubernetes.io/secret/76f0322f-b14b-4b9b-9665-2121e3b21629-ovndb-tls-certs") pod "neutron-64b7569b94-dxks6" (UID: "76f0322f-b14b-4b9b-9665-2121e3b21629") : secret "cert-neutron-ovndbs" not found Mar 16 17:08:37 crc kubenswrapper[5120]: E0316 17:08:37.786754 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-neutron-internal-svc: secret "cert-neutron-internal-svc" not found Mar 16 17:08:37 crc kubenswrapper[5120]: E0316 17:08:37.786807 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76f0322f-b14b-4b9b-9665-2121e3b21629-internal-tls-certs podName:76f0322f-b14b-4b9b-9665-2121e3b21629 nodeName:}" failed. No retries permitted until 2026-03-16 17:08:38.786797064 +0000 UTC m=+5820.940728721 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/76f0322f-b14b-4b9b-9665-2121e3b21629-internal-tls-certs") pod "neutron-64b7569b94-dxks6" (UID: "76f0322f-b14b-4b9b-9665-2121e3b21629") : secret "cert-neutron-internal-svc" not found Mar 16 17:08:37 crc kubenswrapper[5120]: E0316 17:08:37.786841 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-neutron-public-svc: secret "cert-neutron-public-svc" not found Mar 16 17:08:37 crc kubenswrapper[5120]: E0316 17:08:37.786863 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76f0322f-b14b-4b9b-9665-2121e3b21629-public-tls-certs podName:76f0322f-b14b-4b9b-9665-2121e3b21629 nodeName:}" failed. No retries permitted until 2026-03-16 17:08:38.786854216 +0000 UTC m=+5820.940785883 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/76f0322f-b14b-4b9b-9665-2121e3b21629-public-tls-certs") pod "neutron-64b7569b94-dxks6" (UID: "76f0322f-b14b-4b9b-9665-2121e3b21629") : secret "cert-neutron-public-svc" not found Mar 16 17:08:37 crc kubenswrapper[5120]: I0316 17:08:37.871756 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-7d8dcb56b8-42f9n" Mar 16 17:08:37 crc kubenswrapper[5120]: I0316 17:08:37.905601 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.035628 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.036188 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="6ff9b987-d4c9-427f-a8d1-0900da11bef5" containerName="ceilometer-central-agent" containerID="cri-o://287f8090dea674cb40a38ec071885a3f7894ef839aaf3eb8d78c6dc9e7abca92" gracePeriod=30 Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.036720 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="6ff9b987-d4c9-427f-a8d1-0900da11bef5" containerName="proxy-httpd" containerID="cri-o://39da148bdc75ed714a628ed59f7ddc25fb6e712f3610df622442f9f8898925c6" gracePeriod=30 Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.037150 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="6ff9b987-d4c9-427f-a8d1-0900da11bef5" containerName="ceilometer-notification-agent" containerID="cri-o://51c9bc540f5f5f1943fdf912d7fb80205db793e6c9378b27720eafa6a4b52b3e" gracePeriod=30 Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.037247 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="6ff9b987-d4c9-427f-a8d1-0900da11bef5" containerName="sg-core" containerID="cri-o://e9a80af08a4b83cbe6b83abbdfeb801e4f9d662462e9e634f977b1c0bf2f25b5" gracePeriod=30 Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.125466 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-6f95f9d4f9-4kmmn"] Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.160204 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_b9d1b067-481f-4959-99ab-68d36e78226d/ovsdbserver-nb/0.log" Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.160376 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.169689 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.215558 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/b9d1b067-481f-4959-99ab-68d36e78226d-metrics-certs-tls-certs\") pod \"b9d1b067-481f-4959-99ab-68d36e78226d\" (UID: \"b9d1b067-481f-4959-99ab-68d36e78226d\") " Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.215747 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fwtjt\" (UniqueName: \"kubernetes.io/projected/95f093ea-03a9-45b1-925d-0f51d76dc93d-kube-api-access-fwtjt\") pod \"95f093ea-03a9-45b1-925d-0f51d76dc93d\" (UID: \"95f093ea-03a9-45b1-925d-0f51d76dc93d\") " Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.217915 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/b9d1b067-481f-4959-99ab-68d36e78226d-ovsdbserver-nb-tls-certs\") pod \"b9d1b067-481f-4959-99ab-68d36e78226d\" (UID: \"b9d1b067-481f-4959-99ab-68d36e78226d\") " Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.217957 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovndbcluster-nb-etc-ovn\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"b9d1b067-481f-4959-99ab-68d36e78226d\" (UID: \"b9d1b067-481f-4959-99ab-68d36e78226d\") " Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.218103 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/95f093ea-03a9-45b1-925d-0f51d76dc93d-memcached-tls-certs\") pod \"95f093ea-03a9-45b1-925d-0f51d76dc93d\" (UID: \"95f093ea-03a9-45b1-925d-0f51d76dc93d\") " Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.218194 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b9d1b067-481f-4959-99ab-68d36e78226d-config\") pod \"b9d1b067-481f-4959-99ab-68d36e78226d\" (UID: \"b9d1b067-481f-4959-99ab-68d36e78226d\") " Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.218325 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/b9d1b067-481f-4959-99ab-68d36e78226d-scripts\") pod \"b9d1b067-481f-4959-99ab-68d36e78226d\" (UID: \"b9d1b067-481f-4959-99ab-68d36e78226d\") " Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.218399 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/95f093ea-03a9-45b1-925d-0f51d76dc93d-config-data\") pod \"95f093ea-03a9-45b1-925d-0f51d76dc93d\" (UID: \"95f093ea-03a9-45b1-925d-0f51d76dc93d\") " Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.218427 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/b9d1b067-481f-4959-99ab-68d36e78226d-ovsdb-rundir\") pod \"b9d1b067-481f-4959-99ab-68d36e78226d\" (UID: \"b9d1b067-481f-4959-99ab-68d36e78226d\") " Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.218516 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7qfvt\" (UniqueName: \"kubernetes.io/projected/b9d1b067-481f-4959-99ab-68d36e78226d-kube-api-access-7qfvt\") pod \"b9d1b067-481f-4959-99ab-68d36e78226d\" (UID: \"b9d1b067-481f-4959-99ab-68d36e78226d\") " Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.218811 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b9d1b067-481f-4959-99ab-68d36e78226d-combined-ca-bundle\") pod \"b9d1b067-481f-4959-99ab-68d36e78226d\" (UID: \"b9d1b067-481f-4959-99ab-68d36e78226d\") " Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.218880 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/95f093ea-03a9-45b1-925d-0f51d76dc93d-combined-ca-bundle\") pod \"95f093ea-03a9-45b1-925d-0f51d76dc93d\" (UID: \"95f093ea-03a9-45b1-925d-0f51d76dc93d\") " Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.222431 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9d1b067-481f-4959-99ab-68d36e78226d-ovsdb-rundir" (OuterVolumeSpecName: "ovsdb-rundir") pod "b9d1b067-481f-4959-99ab-68d36e78226d" (UID: "b9d1b067-481f-4959-99ab-68d36e78226d"). InnerVolumeSpecName "ovsdb-rundir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.223032 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/95f093ea-03a9-45b1-925d-0f51d76dc93d-config-data" (OuterVolumeSpecName: "config-data") pod "95f093ea-03a9-45b1-925d-0f51d76dc93d" (UID: "95f093ea-03a9-45b1-925d-0f51d76dc93d"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.224251 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b9d1b067-481f-4959-99ab-68d36e78226d-scripts" (OuterVolumeSpecName: "scripts") pod "b9d1b067-481f-4959-99ab-68d36e78226d" (UID: "b9d1b067-481f-4959-99ab-68d36e78226d"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.229935 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/95f093ea-03a9-45b1-925d-0f51d76dc93d-kolla-config\") pod \"95f093ea-03a9-45b1-925d-0f51d76dc93d\" (UID: \"95f093ea-03a9-45b1-925d-0f51d76dc93d\") " Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.230416 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b9d1b067-481f-4959-99ab-68d36e78226d-config" (OuterVolumeSpecName: "config") pod "b9d1b067-481f-4959-99ab-68d36e78226d" (UID: "b9d1b067-481f-4959-99ab-68d36e78226d"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.230899 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/95f093ea-03a9-45b1-925d-0f51d76dc93d-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "95f093ea-03a9-45b1-925d-0f51d76dc93d" (UID: "95f093ea-03a9-45b1-925d-0f51d76dc93d"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.231478 5120 reconciler_common.go:299] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/95f093ea-03a9-45b1-925d-0f51d76dc93d-kolla-config\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.231648 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b9d1b067-481f-4959-99ab-68d36e78226d-config\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.231661 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/b9d1b067-481f-4959-99ab-68d36e78226d-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.231670 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/95f093ea-03a9-45b1-925d-0f51d76dc93d-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.231679 5120 reconciler_common.go:299] "Volume detached for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/b9d1b067-481f-4959-99ab-68d36e78226d-ovsdb-rundir\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.240706 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95f093ea-03a9-45b1-925d-0f51d76dc93d-kube-api-access-fwtjt" (OuterVolumeSpecName: "kube-api-access-fwtjt") pod "95f093ea-03a9-45b1-925d-0f51d76dc93d" (UID: "95f093ea-03a9-45b1-925d-0f51d76dc93d"). InnerVolumeSpecName "kube-api-access-fwtjt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.244998 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9d1b067-481f-4959-99ab-68d36e78226d-kube-api-access-7qfvt" (OuterVolumeSpecName: "kube-api-access-7qfvt") pod "b9d1b067-481f-4959-99ab-68d36e78226d" (UID: "b9d1b067-481f-4959-99ab-68d36e78226d"). InnerVolumeSpecName "kube-api-access-7qfvt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.256964 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_1b14824b-ab59-47bd-af31-b5f0b806a9c3/ovsdbserver-sb/0.log" Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.257065 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.260001 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage08-crc" (OuterVolumeSpecName: "ovndbcluster-nb-etc-ovn") pod "b9d1b067-481f-4959-99ab-68d36e78226d" (UID: "b9d1b067-481f-4959-99ab-68d36e78226d"). InnerVolumeSpecName "local-storage08-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.313474 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/95f093ea-03a9-45b1-925d-0f51d76dc93d-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "95f093ea-03a9-45b1-925d-0f51d76dc93d" (UID: "95f093ea-03a9-45b1-925d-0f51d76dc93d"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.333474 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovndbcluster-sb-etc-ovn\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"1b14824b-ab59-47bd-af31-b5f0b806a9c3\" (UID: \"1b14824b-ab59-47bd-af31-b5f0b806a9c3\") " Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.334001 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1b14824b-ab59-47bd-af31-b5f0b806a9c3-config\") pod \"1b14824b-ab59-47bd-af31-b5f0b806a9c3\" (UID: \"1b14824b-ab59-47bd-af31-b5f0b806a9c3\") " Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.335004 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1b14824b-ab59-47bd-af31-b5f0b806a9c3-config" (OuterVolumeSpecName: "config") pod "1b14824b-ab59-47bd-af31-b5f0b806a9c3" (UID: "1b14824b-ab59-47bd-af31-b5f0b806a9c3"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.337751 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/1b14824b-ab59-47bd-af31-b5f0b806a9c3-ovsdbserver-sb-tls-certs\") pod \"1b14824b-ab59-47bd-af31-b5f0b806a9c3\" (UID: \"1b14824b-ab59-47bd-af31-b5f0b806a9c3\") " Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.337918 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/1b14824b-ab59-47bd-af31-b5f0b806a9c3-scripts\") pod \"1b14824b-ab59-47bd-af31-b5f0b806a9c3\" (UID: \"1b14824b-ab59-47bd-af31-b5f0b806a9c3\") " Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.338330 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1b14824b-ab59-47bd-af31-b5f0b806a9c3-combined-ca-bundle\") pod \"1b14824b-ab59-47bd-af31-b5f0b806a9c3\" (UID: \"1b14824b-ab59-47bd-af31-b5f0b806a9c3\") " Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.338581 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2wtdt\" (UniqueName: \"kubernetes.io/projected/1b14824b-ab59-47bd-af31-b5f0b806a9c3-kube-api-access-2wtdt\") pod \"1b14824b-ab59-47bd-af31-b5f0b806a9c3\" (UID: \"1b14824b-ab59-47bd-af31-b5f0b806a9c3\") " Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.338632 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/1b14824b-ab59-47bd-af31-b5f0b806a9c3-metrics-certs-tls-certs\") pod \"1b14824b-ab59-47bd-af31-b5f0b806a9c3\" (UID: \"1b14824b-ab59-47bd-af31-b5f0b806a9c3\") " Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.338890 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/1b14824b-ab59-47bd-af31-b5f0b806a9c3-ovsdb-rundir\") pod \"1b14824b-ab59-47bd-af31-b5f0b806a9c3\" (UID: \"1b14824b-ab59-47bd-af31-b5f0b806a9c3\") " Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.339187 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage01-crc" (OuterVolumeSpecName: "ovndbcluster-sb-etc-ovn") pod "1b14824b-ab59-47bd-af31-b5f0b806a9c3" (UID: "1b14824b-ab59-47bd-af31-b5f0b806a9c3"). InnerVolumeSpecName "local-storage01-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.340917 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b14824b-ab59-47bd-af31-b5f0b806a9c3-ovsdb-rundir" (OuterVolumeSpecName: "ovsdb-rundir") pod "1b14824b-ab59-47bd-af31-b5f0b806a9c3" (UID: "1b14824b-ab59-47bd-af31-b5f0b806a9c3"). InnerVolumeSpecName "ovsdb-rundir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.340999 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1b14824b-ab59-47bd-af31-b5f0b806a9c3-scripts" (OuterVolumeSpecName: "scripts") pod "1b14824b-ab59-47bd-af31-b5f0b806a9c3" (UID: "1b14824b-ab59-47bd-af31-b5f0b806a9c3"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.342264 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fwtjt\" (UniqueName: \"kubernetes.io/projected/95f093ea-03a9-45b1-925d-0f51d76dc93d-kube-api-access-fwtjt\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.343451 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") on node \"crc\" " Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.343695 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") on node \"crc\" " Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.343822 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1b14824b-ab59-47bd-af31-b5f0b806a9c3-config\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.343933 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/1b14824b-ab59-47bd-af31-b5f0b806a9c3-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.344034 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7qfvt\" (UniqueName: \"kubernetes.io/projected/b9d1b067-481f-4959-99ab-68d36e78226d-kube-api-access-7qfvt\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.344125 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/95f093ea-03a9-45b1-925d-0f51d76dc93d-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.345137 5120 reconciler_common.go:299] "Volume detached for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/1b14824b-ab59-47bd-af31-b5f0b806a9c3-ovsdb-rundir\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.348569 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b14824b-ab59-47bd-af31-b5f0b806a9c3-kube-api-access-2wtdt" (OuterVolumeSpecName: "kube-api-access-2wtdt") pod "1b14824b-ab59-47bd-af31-b5f0b806a9c3" (UID: "1b14824b-ab59-47bd-af31-b5f0b806a9c3"). InnerVolumeSpecName "kube-api-access-2wtdt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.366583 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.401902 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9d1b067-481f-4959-99ab-68d36e78226d-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "b9d1b067-481f-4959-99ab-68d36e78226d" (UID: "b9d1b067-481f-4959-99ab-68d36e78226d"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.432724 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1b14824b-ab59-47bd-af31-b5f0b806a9c3-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "1b14824b-ab59-47bd-af31-b5f0b806a9c3" (UID: "1b14824b-ab59-47bd-af31-b5f0b806a9c3"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.438536 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage01-crc" (UniqueName: "kubernetes.io/local-volume/local-storage01-crc") on node "crc" Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.445917 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/95f093ea-03a9-45b1-925d-0f51d76dc93d-memcached-tls-certs" (OuterVolumeSpecName: "memcached-tls-certs") pod "95f093ea-03a9-45b1-925d-0f51d76dc93d" (UID: "95f093ea-03a9-45b1-925d-0f51d76dc93d"). InnerVolumeSpecName "memcached-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.446540 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/286e2312-ce33-48da-ac60-149b96ace59a-config-data\") pod \"286e2312-ce33-48da-ac60-149b96ace59a\" (UID: \"286e2312-ce33-48da-ac60-149b96ace59a\") " Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.446613 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/286e2312-ce33-48da-ac60-149b96ace59a-vencrypt-tls-certs\") pod \"286e2312-ce33-48da-ac60-149b96ace59a\" (UID: \"286e2312-ce33-48da-ac60-149b96ace59a\") " Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.446847 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fd5xd\" (UniqueName: \"kubernetes.io/projected/286e2312-ce33-48da-ac60-149b96ace59a-kube-api-access-fd5xd\") pod \"286e2312-ce33-48da-ac60-149b96ace59a\" (UID: \"286e2312-ce33-48da-ac60-149b96ace59a\") " Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.447173 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/286e2312-ce33-48da-ac60-149b96ace59a-nova-novncproxy-tls-certs\") pod \"286e2312-ce33-48da-ac60-149b96ace59a\" (UID: \"286e2312-ce33-48da-ac60-149b96ace59a\") " Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.447457 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/286e2312-ce33-48da-ac60-149b96ace59a-combined-ca-bundle\") pod \"286e2312-ce33-48da-ac60-149b96ace59a\" (UID: \"286e2312-ce33-48da-ac60-149b96ace59a\") " Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.448807 5120 reconciler_common.go:299] "Volume detached for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/95f093ea-03a9-45b1-925d-0f51d76dc93d-memcached-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.448827 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.448840 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b9d1b067-481f-4959-99ab-68d36e78226d-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.448852 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1b14824b-ab59-47bd-af31-b5f0b806a9c3-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.448866 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2wtdt\" (UniqueName: \"kubernetes.io/projected/1b14824b-ab59-47bd-af31-b5f0b806a9c3-kube-api-access-2wtdt\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.462296 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/286e2312-ce33-48da-ac60-149b96ace59a-kube-api-access-fd5xd" (OuterVolumeSpecName: "kube-api-access-fd5xd") pod "286e2312-ce33-48da-ac60-149b96ace59a" (UID: "286e2312-ce33-48da-ac60-149b96ace59a"). InnerVolumeSpecName "kube-api-access-fd5xd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.506619 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/286e2312-ce33-48da-ac60-149b96ace59a-config-data" (OuterVolumeSpecName: "config-data") pod "286e2312-ce33-48da-ac60-149b96ace59a" (UID: "286e2312-ce33-48da-ac60-149b96ace59a"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.512029 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage08-crc" (UniqueName: "kubernetes.io/local-volume/local-storage08-crc") on node "crc" Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.547716 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/286e2312-ce33-48da-ac60-149b96ace59a-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "286e2312-ce33-48da-ac60-149b96ace59a" (UID: "286e2312-ce33-48da-ac60-149b96ace59a"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.553109 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9d1b067-481f-4959-99ab-68d36e78226d-ovsdbserver-nb-tls-certs" (OuterVolumeSpecName: "ovsdbserver-nb-tls-certs") pod "b9d1b067-481f-4959-99ab-68d36e78226d" (UID: "b9d1b067-481f-4959-99ab-68d36e78226d"). InnerVolumeSpecName "ovsdbserver-nb-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.558729 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/b9d1b067-481f-4959-99ab-68d36e78226d-ovsdbserver-nb-tls-certs\") pod \"b9d1b067-481f-4959-99ab-68d36e78226d\" (UID: \"b9d1b067-481f-4959-99ab-68d36e78226d\") " Mar 16 17:08:38 crc kubenswrapper[5120]: W0316 17:08:38.560062 5120 empty_dir.go:511] Warning: Unmount skipped because path does not exist: /var/lib/kubelet/pods/b9d1b067-481f-4959-99ab-68d36e78226d/volumes/kubernetes.io~secret/ovsdbserver-nb-tls-certs Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.560081 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9d1b067-481f-4959-99ab-68d36e78226d-ovsdbserver-nb-tls-certs" (OuterVolumeSpecName: "ovsdbserver-nb-tls-certs") pod "b9d1b067-481f-4959-99ab-68d36e78226d" (UID: "b9d1b067-481f-4959-99ab-68d36e78226d"). InnerVolumeSpecName "ovsdbserver-nb-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:08:38 crc kubenswrapper[5120]: W0316 17:08:38.562963 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1b7d191f_d557_4a83_829b_bad5a5ed7dbb.slice/crio-888cf3b04e22366bb61e30c15f80f6737f637d3d40cc21932cf1a9c6a7115eea WatchSource:0}: Error finding container 888cf3b04e22366bb61e30c15f80f6737f637d3d40cc21932cf1a9c6a7115eea: Status 404 returned error can't find the container with id 888cf3b04e22366bb61e30c15f80f6737f637d3d40cc21932cf1a9c6a7115eea Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.572652 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/3f98651e-6cef-4b31-8aac-46d152305e88-public-tls-certs\") pod \"barbican-api-7648f748d8-cxwnc\" (UID: \"3f98651e-6cef-4b31-8aac-46d152305e88\") " pod="openstack-kuttl-tests/barbican-api-7648f748d8-cxwnc" Mar 16 17:08:38 crc kubenswrapper[5120]: E0316 17:08:38.573482 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-barbican-public-svc: secret "cert-barbican-public-svc" not found Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.573633 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/3f98651e-6cef-4b31-8aac-46d152305e88-internal-tls-certs\") pod \"barbican-api-7648f748d8-cxwnc\" (UID: \"3f98651e-6cef-4b31-8aac-46d152305e88\") " pod="openstack-kuttl-tests/barbican-api-7648f748d8-cxwnc" Mar 16 17:08:38 crc kubenswrapper[5120]: E0316 17:08:38.573843 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-barbican-internal-svc: secret "cert-barbican-internal-svc" not found Mar 16 17:08:38 crc kubenswrapper[5120]: E0316 17:08:38.573900 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f98651e-6cef-4b31-8aac-46d152305e88-internal-tls-certs podName:3f98651e-6cef-4b31-8aac-46d152305e88 nodeName:}" failed. No retries permitted until 2026-03-16 17:08:40.573881877 +0000 UTC m=+5822.727813534 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/3f98651e-6cef-4b31-8aac-46d152305e88-internal-tls-certs") pod "barbican-api-7648f748d8-cxwnc" (UID: "3f98651e-6cef-4b31-8aac-46d152305e88") : secret "cert-barbican-internal-svc" not found Mar 16 17:08:38 crc kubenswrapper[5120]: E0316 17:08:38.573934 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f98651e-6cef-4b31-8aac-46d152305e88-public-tls-certs podName:3f98651e-6cef-4b31-8aac-46d152305e88 nodeName:}" failed. No retries permitted until 2026-03-16 17:08:40.573919098 +0000 UTC m=+5822.727850755 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/3f98651e-6cef-4b31-8aac-46d152305e88-public-tls-certs") pod "barbican-api-7648f748d8-cxwnc" (UID: "3f98651e-6cef-4b31-8aac-46d152305e88") : secret "cert-barbican-public-svc" not found Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.574170 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fd5xd\" (UniqueName: \"kubernetes.io/projected/286e2312-ce33-48da-ac60-149b96ace59a-kube-api-access-fd5xd\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.574192 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/286e2312-ce33-48da-ac60-149b96ace59a-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.574204 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/286e2312-ce33-48da-ac60-149b96ace59a-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.574214 5120 reconciler_common.go:299] "Volume detached for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/b9d1b067-481f-4959-99ab-68d36e78226d-ovsdbserver-nb-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.574233 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.580011 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-7d8dcb56b8-42f9n"] Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.584639 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1b14824b-ab59-47bd-af31-b5f0b806a9c3-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "1b14824b-ab59-47bd-af31-b5f0b806a9c3" (UID: "1b14824b-ab59-47bd-af31-b5f0b806a9c3"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.585123 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1b14824b-ab59-47bd-af31-b5f0b806a9c3-ovsdbserver-sb-tls-certs" (OuterVolumeSpecName: "ovsdbserver-sb-tls-certs") pod "1b14824b-ab59-47bd-af31-b5f0b806a9c3" (UID: "1b14824b-ab59-47bd-af31-b5f0b806a9c3"). InnerVolumeSpecName "ovsdbserver-sb-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.588358 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9d1b067-481f-4959-99ab-68d36e78226d-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "b9d1b067-481f-4959-99ab-68d36e78226d" (UID: "b9d1b067-481f-4959-99ab-68d36e78226d"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.627735 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/286e2312-ce33-48da-ac60-149b96ace59a-nova-novncproxy-tls-certs" (OuterVolumeSpecName: "nova-novncproxy-tls-certs") pod "286e2312-ce33-48da-ac60-149b96ace59a" (UID: "286e2312-ce33-48da-ac60-149b96ace59a"). InnerVolumeSpecName "nova-novncproxy-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.634212 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/286e2312-ce33-48da-ac60-149b96ace59a-vencrypt-tls-certs" (OuterVolumeSpecName: "vencrypt-tls-certs") pod "286e2312-ce33-48da-ac60-149b96ace59a" (UID: "286e2312-ce33-48da-ac60-149b96ace59a"). InnerVolumeSpecName "vencrypt-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.678184 5120 reconciler_common.go:299] "Volume detached for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/1b14824b-ab59-47bd-af31-b5f0b806a9c3-ovsdbserver-sb-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.678212 5120 reconciler_common.go:299] "Volume detached for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/286e2312-ce33-48da-ac60-149b96ace59a-nova-novncproxy-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.678224 5120 reconciler_common.go:299] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/1b14824b-ab59-47bd-af31-b5f0b806a9c3-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.678233 5120 reconciler_common.go:299] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/b9d1b067-481f-4959-99ab-68d36e78226d-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.678242 5120 reconciler_common.go:299] "Volume detached for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/286e2312-ce33-48da-ac60-149b96ace59a-vencrypt-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.755727 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_1b14824b-ab59-47bd-af31-b5f0b806a9c3/ovsdbserver-sb/0.log" Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.755872 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"1b14824b-ab59-47bd-af31-b5f0b806a9c3","Type":"ContainerDied","Data":"3a445d7d481129d7979655b9a8bcd71aa4ed485762dd8865d37a438877fd2301"} Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.755910 5120 scope.go:117] "RemoveContainer" containerID="b9a2e58ea47b55c32ddeca091d4724c0a91bc2544cf67c854eae81885c19cc96" Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.756060 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.770184 5120 generic.go:358] "Generic (PLEG): container finished" podID="6ff9b987-d4c9-427f-a8d1-0900da11bef5" containerID="39da148bdc75ed714a628ed59f7ddc25fb6e712f3610df622442f9f8898925c6" exitCode=0 Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.770221 5120 generic.go:358] "Generic (PLEG): container finished" podID="6ff9b987-d4c9-427f-a8d1-0900da11bef5" containerID="e9a80af08a4b83cbe6b83abbdfeb801e4f9d662462e9e634f977b1c0bf2f25b5" exitCode=2 Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.770231 5120 generic.go:358] "Generic (PLEG): container finished" podID="6ff9b987-d4c9-427f-a8d1-0900da11bef5" containerID="287f8090dea674cb40a38ec071885a3f7894ef839aaf3eb8d78c6dc9e7abca92" exitCode=0 Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.770270 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"6ff9b987-d4c9-427f-a8d1-0900da11bef5","Type":"ContainerDied","Data":"39da148bdc75ed714a628ed59f7ddc25fb6e712f3610df622442f9f8898925c6"} Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.770314 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"6ff9b987-d4c9-427f-a8d1-0900da11bef5","Type":"ContainerDied","Data":"e9a80af08a4b83cbe6b83abbdfeb801e4f9d662462e9e634f977b1c0bf2f25b5"} Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.770324 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"6ff9b987-d4c9-427f-a8d1-0900da11bef5","Type":"ContainerDied","Data":"287f8090dea674cb40a38ec071885a3f7894ef839aaf3eb8d78c6dc9e7abca92"} Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.774969 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-7d8dcb56b8-42f9n" event={"ID":"1b7d191f-d557-4a83-829b-bad5a5ed7dbb","Type":"ContainerStarted","Data":"888cf3b04e22366bb61e30c15f80f6737f637d3d40cc21932cf1a9c6a7115eea"} Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.779075 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-6f95f9d4f9-4kmmn" event={"ID":"e491da9b-3bac-45f2-b9f5-41af945fe1eb","Type":"ContainerStarted","Data":"82d5a310e35e3b9b1dcc74a60d649c5700808537fad7321c1a5203c33e52168c"} Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.780501 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/7a637c98-abe1-4f51-bee0-eb384fa79a43-public-tls-certs\") pod \"placement-85687c8566-vv9qr\" (UID: \"7a637c98-abe1-4f51-bee0-eb384fa79a43\") " pod="openstack-kuttl-tests/placement-85687c8566-vv9qr" Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.780605 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/7a637c98-abe1-4f51-bee0-eb384fa79a43-internal-tls-certs\") pod \"placement-85687c8566-vv9qr\" (UID: \"7a637c98-abe1-4f51-bee0-eb384fa79a43\") " pod="openstack-kuttl-tests/placement-85687c8566-vv9qr" Mar 16 17:08:38 crc kubenswrapper[5120]: E0316 17:08:38.780708 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-placement-public-svc: secret "cert-placement-public-svc" not found Mar 16 17:08:38 crc kubenswrapper[5120]: E0316 17:08:38.780788 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a637c98-abe1-4f51-bee0-eb384fa79a43-public-tls-certs podName:7a637c98-abe1-4f51-bee0-eb384fa79a43 nodeName:}" failed. No retries permitted until 2026-03-16 17:08:40.780770363 +0000 UTC m=+5822.934702060 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/7a637c98-abe1-4f51-bee0-eb384fa79a43-public-tls-certs") pod "placement-85687c8566-vv9qr" (UID: "7a637c98-abe1-4f51-bee0-eb384fa79a43") : secret "cert-placement-public-svc" not found Mar 16 17:08:38 crc kubenswrapper[5120]: E0316 17:08:38.780979 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-placement-internal-svc: secret "cert-placement-internal-svc" not found Mar 16 17:08:38 crc kubenswrapper[5120]: E0316 17:08:38.781036 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a637c98-abe1-4f51-bee0-eb384fa79a43-internal-tls-certs podName:7a637c98-abe1-4f51-bee0-eb384fa79a43 nodeName:}" failed. No retries permitted until 2026-03-16 17:08:40.78102099 +0000 UTC m=+5822.934952647 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/7a637c98-abe1-4f51-bee0-eb384fa79a43-internal-tls-certs") pod "placement-85687c8566-vv9qr" (UID: "7a637c98-abe1-4f51-bee0-eb384fa79a43") : secret "cert-placement-internal-svc" not found Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.785446 5120 generic.go:358] "Generic (PLEG): container finished" podID="8f7be4b3-fcec-41d8-9b93-a41201c60005" containerID="7dd60adc27480f52058b362abed27158f7e301ca1ac5ae0382560a9459203f9e" exitCode=0 Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.785556 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"8f7be4b3-fcec-41d8-9b93-a41201c60005","Type":"ContainerDied","Data":"7dd60adc27480f52058b362abed27158f7e301ca1ac5ae0382560a9459203f9e"} Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.792107 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_b9d1b067-481f-4959-99ab-68d36e78226d/ovsdbserver-nb/0.log" Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.792638 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.792648 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"b9d1b067-481f-4959-99ab-68d36e78226d","Type":"ContainerDied","Data":"3be04d307eae6087bcb3df8d0bbba5be6925f33e9891888b114ff0ef1d790842"} Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.796851 5120 generic.go:358] "Generic (PLEG): container finished" podID="286e2312-ce33-48da-ac60-149b96ace59a" containerID="c21a10708b310667945ad3e55d48904fa4e2513041d3f95d448b7f3f10ed9b7b" exitCode=0 Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.796898 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.796951 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"286e2312-ce33-48da-ac60-149b96ace59a","Type":"ContainerDied","Data":"c21a10708b310667945ad3e55d48904fa4e2513041d3f95d448b7f3f10ed9b7b"} Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.796985 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"286e2312-ce33-48da-ac60-149b96ace59a","Type":"ContainerDied","Data":"af6b84b95ec1df0adffb6a534aeaba5075a3098379eb9127824551fbdc4013a0"} Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.799458 5120 generic.go:358] "Generic (PLEG): container finished" podID="d325d1cb-bde7-4d3d-978f-2f9d1188717e" containerID="3f289a8fede143f8dca99cdbaa1cac9860a28fa61689bab6b0b824d500b16adf" exitCode=137 Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.810803 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.810903 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"95f093ea-03a9-45b1-925d-0f51d76dc93d","Type":"ContainerDied","Data":"c5dafb31f46f99288b54f0f736b57e3464e0c0f8e0fa5630e13f04d611882977"} Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.819364 5120 generic.go:358] "Generic (PLEG): container finished" podID="5eac4201-2543-460e-8643-d376fab79512" containerID="c4fbb0d93de06153ee805dc84d38adcfe4df3b1761b668d82ce6b1cc908a9080" exitCode=0 Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.819431 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"5eac4201-2543-460e-8643-d376fab79512","Type":"ContainerDied","Data":"c4fbb0d93de06153ee805dc84d38adcfe4df3b1761b668d82ce6b1cc908a9080"} Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.877717 5120 scope.go:117] "RemoveContainer" containerID="9493f8688a6a97514909dc97423f4687ed171063e7b2f0935a0373e4f07b3637" Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.891984 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/76f0322f-b14b-4b9b-9665-2121e3b21629-ovndb-tls-certs\") pod \"neutron-64b7569b94-dxks6\" (UID: \"76f0322f-b14b-4b9b-9665-2121e3b21629\") " pod="openstack-kuttl-tests/neutron-64b7569b94-dxks6" Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.892439 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/76f0322f-b14b-4b9b-9665-2121e3b21629-internal-tls-certs\") pod \"neutron-64b7569b94-dxks6\" (UID: \"76f0322f-b14b-4b9b-9665-2121e3b21629\") " pod="openstack-kuttl-tests/neutron-64b7569b94-dxks6" Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.892532 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/76f0322f-b14b-4b9b-9665-2121e3b21629-public-tls-certs\") pod \"neutron-64b7569b94-dxks6\" (UID: \"76f0322f-b14b-4b9b-9665-2121e3b21629\") " pod="openstack-kuttl-tests/neutron-64b7569b94-dxks6" Mar 16 17:08:38 crc kubenswrapper[5120]: E0316 17:08:38.897028 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-neutron-ovndbs: secret "cert-neutron-ovndbs" not found Mar 16 17:08:38 crc kubenswrapper[5120]: E0316 17:08:38.897216 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76f0322f-b14b-4b9b-9665-2121e3b21629-ovndb-tls-certs podName:76f0322f-b14b-4b9b-9665-2121e3b21629 nodeName:}" failed. No retries permitted until 2026-03-16 17:08:40.897192309 +0000 UTC m=+5823.051123966 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "ovndb-tls-certs" (UniqueName: "kubernetes.io/secret/76f0322f-b14b-4b9b-9665-2121e3b21629-ovndb-tls-certs") pod "neutron-64b7569b94-dxks6" (UID: "76f0322f-b14b-4b9b-9665-2121e3b21629") : secret "cert-neutron-ovndbs" not found Mar 16 17:08:38 crc kubenswrapper[5120]: E0316 17:08:38.897708 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-neutron-internal-svc: secret "cert-neutron-internal-svc" not found Mar 16 17:08:38 crc kubenswrapper[5120]: E0316 17:08:38.897864 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76f0322f-b14b-4b9b-9665-2121e3b21629-internal-tls-certs podName:76f0322f-b14b-4b9b-9665-2121e3b21629 nodeName:}" failed. No retries permitted until 2026-03-16 17:08:40.897851117 +0000 UTC m=+5823.051782774 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/76f0322f-b14b-4b9b-9665-2121e3b21629-internal-tls-certs") pod "neutron-64b7569b94-dxks6" (UID: "76f0322f-b14b-4b9b-9665-2121e3b21629") : secret "cert-neutron-internal-svc" not found Mar 16 17:08:38 crc kubenswrapper[5120]: E0316 17:08:38.899907 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-neutron-public-svc: secret "cert-neutron-public-svc" not found Mar 16 17:08:38 crc kubenswrapper[5120]: E0316 17:08:38.900123 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76f0322f-b14b-4b9b-9665-2121e3b21629-public-tls-certs podName:76f0322f-b14b-4b9b-9665-2121e3b21629 nodeName:}" failed. No retries permitted until 2026-03-16 17:08:40.900104099 +0000 UTC m=+5823.054035756 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/76f0322f-b14b-4b9b-9665-2121e3b21629-public-tls-certs") pod "neutron-64b7569b94-dxks6" (UID: "76f0322f-b14b-4b9b-9665-2121e3b21629") : secret "cert-neutron-public-svc" not found Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.923044 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.957584 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 17:08:38 crc kubenswrapper[5120]: I0316 17:08:38.992831 5120 scope.go:117] "RemoveContainer" containerID="36e19874faebe75c231a863143f7dd73c50e3adbff0c872e4b6a75af80b20e30" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.015443 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.032778 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.045206 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.124148 5120 scope.go:117] "RemoveContainer" containerID="400808da31cd313ab6122809b1a8caf64bfc05ff3b932a21cc294191c8a85be9" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.127597 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rzzlq\" (UniqueName: \"kubernetes.io/projected/5eac4201-2543-460e-8643-d376fab79512-kube-api-access-rzzlq\") pod \"5eac4201-2543-460e-8643-d376fab79512\" (UID: \"5eac4201-2543-460e-8643-d376fab79512\") " Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.135454 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/5eac4201-2543-460e-8643-d376fab79512-kolla-config\") pod \"5eac4201-2543-460e-8643-d376fab79512\" (UID: \"5eac4201-2543-460e-8643-d376fab79512\") " Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.139196 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5eac4201-2543-460e-8643-d376fab79512-combined-ca-bundle\") pod \"5eac4201-2543-460e-8643-d376fab79512\" (UID: \"5eac4201-2543-460e-8643-d376fab79512\") " Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.139289 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/5eac4201-2543-460e-8643-d376fab79512-config-data-default\") pod \"5eac4201-2543-460e-8643-d376fab79512\" (UID: \"5eac4201-2543-460e-8643-d376fab79512\") " Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.139951 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5eac4201-2543-460e-8643-d376fab79512-operator-scripts\") pod \"5eac4201-2543-460e-8643-d376fab79512\" (UID: \"5eac4201-2543-460e-8643-d376fab79512\") " Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.140062 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/5eac4201-2543-460e-8643-d376fab79512-config-data-generated\") pod \"5eac4201-2543-460e-8643-d376fab79512\" (UID: \"5eac4201-2543-460e-8643-d376fab79512\") " Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.142576 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/5eac4201-2543-460e-8643-d376fab79512-galera-tls-certs\") pod \"5eac4201-2543-460e-8643-d376fab79512\" (UID: \"5eac4201-2543-460e-8643-d376fab79512\") " Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.143335 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"mysql-db\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"5eac4201-2543-460e-8643-d376fab79512\" (UID: \"5eac4201-2543-460e-8643-d376fab79512\") " Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.145938 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.147945 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.159216 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5eac4201-2543-460e-8643-d376fab79512-config-data-generated" (OuterVolumeSpecName: "config-data-generated") pod "5eac4201-2543-460e-8643-d376fab79512" (UID: "5eac4201-2543-460e-8643-d376fab79512"). InnerVolumeSpecName "config-data-generated". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.160269 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5eac4201-2543-460e-8643-d376fab79512-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "5eac4201-2543-460e-8643-d376fab79512" (UID: "5eac4201-2543-460e-8643-d376fab79512"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.167463 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5eac4201-2543-460e-8643-d376fab79512-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "5eac4201-2543-460e-8643-d376fab79512" (UID: "5eac4201-2543-460e-8643-d376fab79512"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.167710 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5eac4201-2543-460e-8643-d376fab79512-config-data-default" (OuterVolumeSpecName: "config-data-default") pod "5eac4201-2543-460e-8643-d376fab79512" (UID: "5eac4201-2543-460e-8643-d376fab79512"). InnerVolumeSpecName "config-data-default". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.170789 5120 scope.go:117] "RemoveContainer" containerID="c21a10708b310667945ad3e55d48904fa4e2513041d3f95d448b7f3f10ed9b7b" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.208018 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5eac4201-2543-460e-8643-d376fab79512-kube-api-access-rzzlq" (OuterVolumeSpecName: "kube-api-access-rzzlq") pod "5eac4201-2543-460e-8643-d376fab79512" (UID: "5eac4201-2543-460e-8643-d376fab79512"). InnerVolumeSpecName "kube-api-access-rzzlq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.224380 5120 scope.go:117] "RemoveContainer" containerID="c21a10708b310667945ad3e55d48904fa4e2513041d3f95d448b7f3f10ed9b7b" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.241895 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.246683 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b14824b-ab59-47bd-af31-b5f0b806a9c3" containerName="ovsdbserver-sb" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.246727 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b14824b-ab59-47bd-af31-b5f0b806a9c3" containerName="ovsdbserver-sb" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.246777 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f7be4b3-fcec-41d8-9b93-a41201c60005" containerName="galera" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.246790 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f7be4b3-fcec-41d8-9b93-a41201c60005" containerName="galera" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.246804 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="286e2312-ce33-48da-ac60-149b96ace59a" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.246814 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="286e2312-ce33-48da-ac60-149b96ace59a" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.246830 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95f093ea-03a9-45b1-925d-0f51d76dc93d" containerName="memcached" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.246837 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="95f093ea-03a9-45b1-925d-0f51d76dc93d" containerName="memcached" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.246852 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5eac4201-2543-460e-8643-d376fab79512" containerName="mysql-bootstrap" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.246859 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="5eac4201-2543-460e-8643-d376fab79512" containerName="mysql-bootstrap" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.246885 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9d1b067-481f-4959-99ab-68d36e78226d" containerName="ovsdbserver-nb" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.246894 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9d1b067-481f-4959-99ab-68d36e78226d" containerName="ovsdbserver-nb" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.246917 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9d1b067-481f-4959-99ab-68d36e78226d" containerName="openstack-network-exporter" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.246925 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9d1b067-481f-4959-99ab-68d36e78226d" containerName="openstack-network-exporter" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.246941 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f7be4b3-fcec-41d8-9b93-a41201c60005" containerName="mysql-bootstrap" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.246947 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f7be4b3-fcec-41d8-9b93-a41201c60005" containerName="mysql-bootstrap" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.246956 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b14824b-ab59-47bd-af31-b5f0b806a9c3" containerName="openstack-network-exporter" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.246963 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b14824b-ab59-47bd-af31-b5f0b806a9c3" containerName="openstack-network-exporter" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.246983 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5eac4201-2543-460e-8643-d376fab79512" containerName="galera" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.246989 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="5eac4201-2543-460e-8643-d376fab79512" containerName="galera" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.247202 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="95f093ea-03a9-45b1-925d-0f51d76dc93d" containerName="memcached" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.247220 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="b9d1b067-481f-4959-99ab-68d36e78226d" containerName="openstack-network-exporter" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.247234 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="b9d1b067-481f-4959-99ab-68d36e78226d" containerName="ovsdbserver-nb" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.247249 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="8f7be4b3-fcec-41d8-9b93-a41201c60005" containerName="galera" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.247262 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1b14824b-ab59-47bd-af31-b5f0b806a9c3" containerName="ovsdbserver-sb" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.247276 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="286e2312-ce33-48da-ac60-149b96ace59a" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.247295 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1b14824b-ab59-47bd-af31-b5f0b806a9c3" containerName="openstack-network-exporter" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.247307 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="5eac4201-2543-460e-8643-d376fab79512" containerName="galera" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.253452 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.253900 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage04-crc" (OuterVolumeSpecName: "mysql-db") pod "5eac4201-2543-460e-8643-d376fab79512" (UID: "5eac4201-2543-460e-8643-d376fab79512"). InnerVolumeSpecName "local-storage04-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.259204 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/8f7be4b3-fcec-41d8-9b93-a41201c60005-kolla-config\") pod \"8f7be4b3-fcec-41d8-9b93-a41201c60005\" (UID: \"8f7be4b3-fcec-41d8-9b93-a41201c60005\") " Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.259511 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8f7be4b3-fcec-41d8-9b93-a41201c60005-combined-ca-bundle\") pod \"8f7be4b3-fcec-41d8-9b93-a41201c60005\" (UID: \"8f7be4b3-fcec-41d8-9b93-a41201c60005\") " Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.259684 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/8f7be4b3-fcec-41d8-9b93-a41201c60005-config-data-generated\") pod \"8f7be4b3-fcec-41d8-9b93-a41201c60005\" (UID: \"8f7be4b3-fcec-41d8-9b93-a41201c60005\") " Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.259918 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8f7be4b3-fcec-41d8-9b93-a41201c60005-operator-scripts\") pod \"8f7be4b3-fcec-41d8-9b93-a41201c60005\" (UID: \"8f7be4b3-fcec-41d8-9b93-a41201c60005\") " Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.259985 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"mysql-db\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"8f7be4b3-fcec-41d8-9b93-a41201c60005\" (UID: \"8f7be4b3-fcec-41d8-9b93-a41201c60005\") " Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.260138 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n2dpt\" (UniqueName: \"kubernetes.io/projected/8f7be4b3-fcec-41d8-9b93-a41201c60005-kube-api-access-n2dpt\") pod \"8f7be4b3-fcec-41d8-9b93-a41201c60005\" (UID: \"8f7be4b3-fcec-41d8-9b93-a41201c60005\") " Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.260179 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/8f7be4b3-fcec-41d8-9b93-a41201c60005-config-data-default\") pod \"8f7be4b3-fcec-41d8-9b93-a41201c60005\" (UID: \"8f7be4b3-fcec-41d8-9b93-a41201c60005\") " Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.260304 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f7be4b3-fcec-41d8-9b93-a41201c60005-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "8f7be4b3-fcec-41d8-9b93-a41201c60005" (UID: "8f7be4b3-fcec-41d8-9b93-a41201c60005"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.260320 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/8f7be4b3-fcec-41d8-9b93-a41201c60005-galera-tls-certs\") pod \"8f7be4b3-fcec-41d8-9b93-a41201c60005\" (UID: \"8f7be4b3-fcec-41d8-9b93-a41201c60005\") " Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.261356 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5eac4201-2543-460e-8643-d376fab79512-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "5eac4201-2543-460e-8643-d376fab79512" (UID: "5eac4201-2543-460e-8643-d376fab79512"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:08:39 crc kubenswrapper[5120]: E0316 17:08:39.261536 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c21a10708b310667945ad3e55d48904fa4e2513041d3f95d448b7f3f10ed9b7b\": container with ID starting with c21a10708b310667945ad3e55d48904fa4e2513041d3f95d448b7f3f10ed9b7b not found: ID does not exist" containerID="c21a10708b310667945ad3e55d48904fa4e2513041d3f95d448b7f3f10ed9b7b" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.261820 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovndbcluster-sb-scripts\"" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.262069 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f7be4b3-fcec-41d8-9b93-a41201c60005-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "8f7be4b3-fcec-41d8-9b93-a41201c60005" (UID: "8f7be4b3-fcec-41d8-9b93-a41201c60005"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.262335 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rzzlq\" (UniqueName: \"kubernetes.io/projected/5eac4201-2543-460e-8643-d376fab79512-kube-api-access-rzzlq\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.262416 5120 reconciler_common.go:299] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/5eac4201-2543-460e-8643-d376fab79512-kolla-config\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.262484 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5eac4201-2543-460e-8643-d376fab79512-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.262565 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/5eac4201-2543-460e-8643-d376fab79512-config-data-default\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.262647 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5eac4201-2543-460e-8643-d376fab79512-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.262723 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/5eac4201-2543-460e-8643-d376fab79512-config-data-generated\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.262799 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8f7be4b3-fcec-41d8-9b93-a41201c60005-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.262886 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") on node \"crc\" " Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.263229 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f7be4b3-fcec-41d8-9b93-a41201c60005-config-data-generated" (OuterVolumeSpecName: "config-data-generated") pod "8f7be4b3-fcec-41d8-9b93-a41201c60005" (UID: "8f7be4b3-fcec-41d8-9b93-a41201c60005"). InnerVolumeSpecName "config-data-generated". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.263399 5120 reconciler_common.go:299] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/8f7be4b3-fcec-41d8-9b93-a41201c60005-kolla-config\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.261554 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovndbcluster-sb-config\"" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.263842 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ovncluster-ovndbcluster-sb-dockercfg-8h2r2\"" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.263982 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ovndbcluster-sb-ovndbs\"" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.261588 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c21a10708b310667945ad3e55d48904fa4e2513041d3f95d448b7f3f10ed9b7b"} err="failed to get container status \"c21a10708b310667945ad3e55d48904fa4e2513041d3f95d448b7f3f10ed9b7b\": rpc error: code = NotFound desc = could not find container \"c21a10708b310667945ad3e55d48904fa4e2513041d3f95d448b7f3f10ed9b7b\": container with ID starting with c21a10708b310667945ad3e55d48904fa4e2513041d3f95d448b7f3f10ed9b7b not found: ID does not exist" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.264080 5120 scope.go:117] "RemoveContainer" containerID="f2c002513e80d40847d0f84315fc311d9e8d0c9a0c8aed763c8c5e27340df54f" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.269143 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.273351 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f7be4b3-fcec-41d8-9b93-a41201c60005-config-data-default" (OuterVolumeSpecName: "config-data-default") pod "8f7be4b3-fcec-41d8-9b93-a41201c60005" (UID: "8f7be4b3-fcec-41d8-9b93-a41201c60005"). InnerVolumeSpecName "config-data-default". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.278231 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f7be4b3-fcec-41d8-9b93-a41201c60005-kube-api-access-n2dpt" (OuterVolumeSpecName: "kube-api-access-n2dpt") pod "8f7be4b3-fcec-41d8-9b93-a41201c60005" (UID: "8f7be4b3-fcec-41d8-9b93-a41201c60005"). InnerVolumeSpecName "kube-api-access-n2dpt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.281847 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.290542 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.292064 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.294516 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-novncproxy-cell1-vencrypt\"" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.295929 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-novncproxy-cell1-public-svc\"" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.296157 5120 status_manager.go:905] "Pod was deleted and then recreated, skipping status update" pod="openstack-kuttl-tests/openstackclient" oldPodUID="d325d1cb-bde7-4d3d-978f-2f9d1188717e" podUID="140a02f0-df36-49fb-b2bb-b267e350f5c5" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.296320 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-novncproxy-config-data\"" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.304098 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.335389 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage20-crc" (OuterVolumeSpecName: "mysql-db") pod "8f7be4b3-fcec-41d8-9b93-a41201c60005" (UID: "8f7be4b3-fcec-41d8-9b93-a41201c60005"). InnerVolumeSpecName "local-storage20-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.336898 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f7be4b3-fcec-41d8-9b93-a41201c60005-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "8f7be4b3-fcec-41d8-9b93-a41201c60005" (UID: "8f7be4b3-fcec-41d8-9b93-a41201c60005"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.337472 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage04-crc" (UniqueName: "kubernetes.io/local-volume/local-storage04-crc") on node "crc" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.373028 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6snck\" (UniqueName: \"kubernetes.io/projected/d325d1cb-bde7-4d3d-978f-2f9d1188717e-kube-api-access-6snck\") pod \"d325d1cb-bde7-4d3d-978f-2f9d1188717e\" (UID: \"d325d1cb-bde7-4d3d-978f-2f9d1188717e\") " Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.373110 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d325d1cb-bde7-4d3d-978f-2f9d1188717e-combined-ca-bundle\") pod \"d325d1cb-bde7-4d3d-978f-2f9d1188717e\" (UID: \"d325d1cb-bde7-4d3d-978f-2f9d1188717e\") " Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.373213 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/d325d1cb-bde7-4d3d-978f-2f9d1188717e-openstack-config\") pod \"d325d1cb-bde7-4d3d-978f-2f9d1188717e\" (UID: \"d325d1cb-bde7-4d3d-978f-2f9d1188717e\") " Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.373313 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/d325d1cb-bde7-4d3d-978f-2f9d1188717e-openstack-config-secret\") pod \"d325d1cb-bde7-4d3d-978f-2f9d1188717e\" (UID: \"d325d1cb-bde7-4d3d-978f-2f9d1188717e\") " Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.373728 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/a96c9fab-fbd4-459d-90a5-ca103703bfc9-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"a96c9fab-fbd4-459d-90a5-ca103703bfc9\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.373808 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.373827 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jp84v\" (UniqueName: \"kubernetes.io/projected/eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3-kube-api-access-jp84v\") pod \"nova-cell1-novncproxy-0\" (UID: \"eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.373870 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a96c9fab-fbd4-459d-90a5-ca103703bfc9-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"a96c9fab-fbd4-459d-90a5-ca103703bfc9\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.373894 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.374087 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4z5xk\" (UniqueName: \"kubernetes.io/projected/a96c9fab-fbd4-459d-90a5-ca103703bfc9-kube-api-access-4z5xk\") pod \"ovsdbserver-sb-0\" (UID: \"a96c9fab-fbd4-459d-90a5-ca103703bfc9\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.374188 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.374242 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/a96c9fab-fbd4-459d-90a5-ca103703bfc9-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"a96c9fab-fbd4-459d-90a5-ca103703bfc9\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.374291 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/a96c9fab-fbd4-459d-90a5-ca103703bfc9-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"a96c9fab-fbd4-459d-90a5-ca103703bfc9\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.374396 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a96c9fab-fbd4-459d-90a5-ca103703bfc9-config\") pod \"ovsdbserver-sb-0\" (UID: \"a96c9fab-fbd4-459d-90a5-ca103703bfc9\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.374443 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"ovsdbserver-sb-0\" (UID: \"a96c9fab-fbd4-459d-90a5-ca103703bfc9\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.374470 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/a96c9fab-fbd4-459d-90a5-ca103703bfc9-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"a96c9fab-fbd4-459d-90a5-ca103703bfc9\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.374486 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.382308 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f7be4b3-fcec-41d8-9b93-a41201c60005-galera-tls-certs" (OuterVolumeSpecName: "galera-tls-certs") pod "8f7be4b3-fcec-41d8-9b93-a41201c60005" (UID: "8f7be4b3-fcec-41d8-9b93-a41201c60005"). InnerVolumeSpecName "galera-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.383638 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d325d1cb-bde7-4d3d-978f-2f9d1188717e-kube-api-access-6snck" (OuterVolumeSpecName: "kube-api-access-6snck") pod "d325d1cb-bde7-4d3d-978f-2f9d1188717e" (UID: "d325d1cb-bde7-4d3d-978f-2f9d1188717e"). InnerVolumeSpecName "kube-api-access-6snck". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.394366 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.398033 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n2dpt\" (UniqueName: \"kubernetes.io/projected/8f7be4b3-fcec-41d8-9b93-a41201c60005-kube-api-access-n2dpt\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.398063 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/8f7be4b3-fcec-41d8-9b93-a41201c60005-config-data-default\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.398077 5120 reconciler_common.go:299] "Volume detached for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/8f7be4b3-fcec-41d8-9b93-a41201c60005-galera-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.398088 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.398106 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6snck\" (UniqueName: \"kubernetes.io/projected/d325d1cb-bde7-4d3d-978f-2f9d1188717e-kube-api-access-6snck\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.398116 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8f7be4b3-fcec-41d8-9b93-a41201c60005-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.398127 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/8f7be4b3-fcec-41d8-9b93-a41201c60005-config-data-generated\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.398155 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") on node \"crc\" " Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.406643 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.431332 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d325d1cb-bde7-4d3d-978f-2f9d1188717e-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "d325d1cb-bde7-4d3d-978f-2f9d1188717e" (UID: "d325d1cb-bde7-4d3d-978f-2f9d1188717e"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.431415 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.443582 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.446337 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-memcached-svc\"" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.446817 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"memcached-config-data\"" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.447555 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"memcached-memcached-dockercfg-ss77k\"" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.451543 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.454146 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage20-crc" (UniqueName: "kubernetes.io/local-volume/local-storage20-crc") on node "crc" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.466365 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.482482 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.485270 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5eac4201-2543-460e-8643-d376fab79512-galera-tls-certs" (OuterVolumeSpecName: "galera-tls-certs") pod "5eac4201-2543-460e-8643-d376fab79512" (UID: "5eac4201-2543-460e-8643-d376fab79512"). InnerVolumeSpecName "galera-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.490131 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d325d1cb-bde7-4d3d-978f-2f9d1188717e-openstack-config" (OuterVolumeSpecName: "openstack-config") pod "d325d1cb-bde7-4d3d-978f-2f9d1188717e" (UID: "d325d1cb-bde7-4d3d-978f-2f9d1188717e"). InnerVolumeSpecName "openstack-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.499510 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/10bd837b-2e0d-460b-a254-20e23b6768f7-combined-ca-bundle\") pod \"memcached-0\" (UID: \"10bd837b-2e0d-460b-a254-20e23b6768f7\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.499583 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4z5xk\" (UniqueName: \"kubernetes.io/projected/a96c9fab-fbd4-459d-90a5-ca103703bfc9-kube-api-access-4z5xk\") pod \"ovsdbserver-sb-0\" (UID: \"a96c9fab-fbd4-459d-90a5-ca103703bfc9\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.499648 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.499684 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/a96c9fab-fbd4-459d-90a5-ca103703bfc9-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"a96c9fab-fbd4-459d-90a5-ca103703bfc9\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.499707 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/10bd837b-2e0d-460b-a254-20e23b6768f7-config-data\") pod \"memcached-0\" (UID: \"10bd837b-2e0d-460b-a254-20e23b6768f7\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.499732 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/a96c9fab-fbd4-459d-90a5-ca103703bfc9-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"a96c9fab-fbd4-459d-90a5-ca103703bfc9\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.499878 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/10bd837b-2e0d-460b-a254-20e23b6768f7-kolla-config\") pod \"memcached-0\" (UID: \"10bd837b-2e0d-460b-a254-20e23b6768f7\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.499911 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a96c9fab-fbd4-459d-90a5-ca103703bfc9-config\") pod \"ovsdbserver-sb-0\" (UID: \"a96c9fab-fbd4-459d-90a5-ca103703bfc9\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.499948 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"ovsdbserver-sb-0\" (UID: \"a96c9fab-fbd4-459d-90a5-ca103703bfc9\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.499970 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/a96c9fab-fbd4-459d-90a5-ca103703bfc9-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"a96c9fab-fbd4-459d-90a5-ca103703bfc9\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.499985 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.500128 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/10bd837b-2e0d-460b-a254-20e23b6768f7-memcached-tls-certs\") pod \"memcached-0\" (UID: \"10bd837b-2e0d-460b-a254-20e23b6768f7\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.500229 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/a96c9fab-fbd4-459d-90a5-ca103703bfc9-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"a96c9fab-fbd4-459d-90a5-ca103703bfc9\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.500285 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.500305 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jp84v\" (UniqueName: \"kubernetes.io/projected/eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3-kube-api-access-jp84v\") pod \"nova-cell1-novncproxy-0\" (UID: \"eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.500340 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a96c9fab-fbd4-459d-90a5-ca103703bfc9-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"a96c9fab-fbd4-459d-90a5-ca103703bfc9\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.500361 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.500415 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-blklg\" (UniqueName: \"kubernetes.io/projected/10bd837b-2e0d-460b-a254-20e23b6768f7-kube-api-access-blklg\") pod \"memcached-0\" (UID: \"10bd837b-2e0d-460b-a254-20e23b6768f7\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.500479 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d325d1cb-bde7-4d3d-978f-2f9d1188717e-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.500490 5120 reconciler_common.go:299] "Volume detached for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/d325d1cb-bde7-4d3d-978f-2f9d1188717e-openstack-config\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.500500 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.500510 5120 reconciler_common.go:299] "Volume detached for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/5eac4201-2543-460e-8643-d376fab79512-galera-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:39 crc kubenswrapper[5120]: E0316 17:08:39.500590 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-nova-novncproxy-cell1-vencrypt: secret "cert-nova-novncproxy-cell1-vencrypt" not found Mar 16 17:08:39 crc kubenswrapper[5120]: E0316 17:08:39.500668 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3-vencrypt-tls-certs podName:eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3 nodeName:}" failed. No retries permitted until 2026-03-16 17:08:40.000644759 +0000 UTC m=+5822.154576416 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "vencrypt-tls-certs" (UniqueName: "kubernetes.io/secret/eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3-vencrypt-tls-certs") pod "nova-cell1-novncproxy-0" (UID: "eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3") : secret "cert-nova-novncproxy-cell1-vencrypt" not found Mar 16 17:08:39 crc kubenswrapper[5120]: E0316 17:08:39.500774 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-ovndbcluster-sb-ovndbs: secret "cert-ovndbcluster-sb-ovndbs" not found Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.500903 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/a96c9fab-fbd4-459d-90a5-ca103703bfc9-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"a96c9fab-fbd4-459d-90a5-ca103703bfc9\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:08:39 crc kubenswrapper[5120]: E0316 17:08:39.501075 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-ovn-metrics: secret "cert-ovn-metrics" not found Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.501193 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"ovsdbserver-sb-0\" (UID: \"a96c9fab-fbd4-459d-90a5-ca103703bfc9\") device mount path \"/mnt/openstack/pv01\"" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.501411 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a96c9fab-fbd4-459d-90a5-ca103703bfc9-config\") pod \"ovsdbserver-sb-0\" (UID: \"a96c9fab-fbd4-459d-90a5-ca103703bfc9\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:08:39 crc kubenswrapper[5120]: E0316 17:08:39.501483 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-nova-novncproxy-cell1-public-svc: secret "cert-nova-novncproxy-cell1-public-svc" not found Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.501413 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 17:08:39 crc kubenswrapper[5120]: E0316 17:08:39.502026 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a96c9fab-fbd4-459d-90a5-ca103703bfc9-ovsdbserver-sb-tls-certs podName:a96c9fab-fbd4-459d-90a5-ca103703bfc9 nodeName:}" failed. No retries permitted until 2026-03-16 17:08:40.000844765 +0000 UTC m=+5822.154776422 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ovsdbserver-sb-tls-certs" (UniqueName: "kubernetes.io/secret/a96c9fab-fbd4-459d-90a5-ca103703bfc9-ovsdbserver-sb-tls-certs") pod "ovsdbserver-sb-0" (UID: "a96c9fab-fbd4-459d-90a5-ca103703bfc9") : secret "cert-ovndbcluster-sb-ovndbs" not found Mar 16 17:08:39 crc kubenswrapper[5120]: E0316 17:08:39.502063 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a96c9fab-fbd4-459d-90a5-ca103703bfc9-metrics-certs-tls-certs podName:a96c9fab-fbd4-459d-90a5-ca103703bfc9 nodeName:}" failed. No retries permitted until 2026-03-16 17:08:40.002050288 +0000 UTC m=+5822.155982005 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs-tls-certs" (UniqueName: "kubernetes.io/secret/a96c9fab-fbd4-459d-90a5-ca103703bfc9-metrics-certs-tls-certs") pod "ovsdbserver-sb-0" (UID: "a96c9fab-fbd4-459d-90a5-ca103703bfc9") : secret "cert-ovn-metrics" not found Mar 16 17:08:39 crc kubenswrapper[5120]: E0316 17:08:39.502082 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3-nova-novncproxy-tls-certs podName:eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3 nodeName:}" failed. No retries permitted until 2026-03-16 17:08:40.002073319 +0000 UTC m=+5822.156004976 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "nova-novncproxy-tls-certs" (UniqueName: "kubernetes.io/secret/eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3-nova-novncproxy-tls-certs") pod "nova-cell1-novncproxy-0" (UID: "eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3") : secret "cert-nova-novncproxy-cell1-public-svc" not found Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.502497 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/a96c9fab-fbd4-459d-90a5-ca103703bfc9-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"a96c9fab-fbd4-459d-90a5-ca103703bfc9\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.513585 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.521474 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.522063 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a96c9fab-fbd4-459d-90a5-ca103703bfc9-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"a96c9fab-fbd4-459d-90a5-ca103703bfc9\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.522599 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jp84v\" (UniqueName: \"kubernetes.io/projected/eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3-kube-api-access-jp84v\") pod \"nova-cell1-novncproxy-0\" (UID: \"eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.526170 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.527305 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.536199 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ovndbcluster-nb-ovndbs\"" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.536972 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovndbcluster-nb-config\"" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.537130 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ovncluster-ovndbcluster-nb-dockercfg-kfjxr\"" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.537392 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovndbcluster-nb-scripts\"" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.538500 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4z5xk\" (UniqueName: \"kubernetes.io/projected/a96c9fab-fbd4-459d-90a5-ca103703bfc9-kube-api-access-4z5xk\") pod \"ovsdbserver-sb-0\" (UID: \"a96c9fab-fbd4-459d-90a5-ca103703bfc9\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.547828 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"ovsdbserver-sb-0\" (UID: \"a96c9fab-fbd4-459d-90a5-ca103703bfc9\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.554966 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d325d1cb-bde7-4d3d-978f-2f9d1188717e-openstack-config-secret" (OuterVolumeSpecName: "openstack-config-secret") pod "d325d1cb-bde7-4d3d-978f-2f9d1188717e" (UID: "d325d1cb-bde7-4d3d-978f-2f9d1188717e"). InnerVolumeSpecName "openstack-config-secret". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.602207 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/cde31df2-efeb-4fee-b565-f24b7eaeff60-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"cde31df2-efeb-4fee-b565-f24b7eaeff60\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.602321 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wwnb\" (UniqueName: \"kubernetes.io/projected/cde31df2-efeb-4fee-b565-f24b7eaeff60-kube-api-access-7wwnb\") pod \"ovsdbserver-nb-0\" (UID: \"cde31df2-efeb-4fee-b565-f24b7eaeff60\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.602379 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/10bd837b-2e0d-460b-a254-20e23b6768f7-memcached-tls-certs\") pod \"memcached-0\" (UID: \"10bd837b-2e0d-460b-a254-20e23b6768f7\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.602473 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/cde31df2-efeb-4fee-b565-f24b7eaeff60-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"cde31df2-efeb-4fee-b565-f24b7eaeff60\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.602503 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cde31df2-efeb-4fee-b565-f24b7eaeff60-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"cde31df2-efeb-4fee-b565-f24b7eaeff60\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.602550 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-blklg\" (UniqueName: \"kubernetes.io/projected/10bd837b-2e0d-460b-a254-20e23b6768f7-kube-api-access-blklg\") pod \"memcached-0\" (UID: \"10bd837b-2e0d-460b-a254-20e23b6768f7\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.602598 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/cde31df2-efeb-4fee-b565-f24b7eaeff60-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"cde31df2-efeb-4fee-b565-f24b7eaeff60\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.602648 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/10bd837b-2e0d-460b-a254-20e23b6768f7-combined-ca-bundle\") pod \"memcached-0\" (UID: \"10bd837b-2e0d-460b-a254-20e23b6768f7\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.602791 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"ovsdbserver-nb-0\" (UID: \"cde31df2-efeb-4fee-b565-f24b7eaeff60\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.602844 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cde31df2-efeb-4fee-b565-f24b7eaeff60-config\") pod \"ovsdbserver-nb-0\" (UID: \"cde31df2-efeb-4fee-b565-f24b7eaeff60\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.602893 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/10bd837b-2e0d-460b-a254-20e23b6768f7-config-data\") pod \"memcached-0\" (UID: \"10bd837b-2e0d-460b-a254-20e23b6768f7\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.602919 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/cde31df2-efeb-4fee-b565-f24b7eaeff60-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"cde31df2-efeb-4fee-b565-f24b7eaeff60\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.603004 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/10bd837b-2e0d-460b-a254-20e23b6768f7-kolla-config\") pod \"memcached-0\" (UID: \"10bd837b-2e0d-460b-a254-20e23b6768f7\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.603624 5120 reconciler_common.go:299] "Volume detached for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/d325d1cb-bde7-4d3d-978f-2f9d1188717e-openstack-config-secret\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.606360 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/10bd837b-2e0d-460b-a254-20e23b6768f7-kolla-config\") pod \"memcached-0\" (UID: \"10bd837b-2e0d-460b-a254-20e23b6768f7\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 17:08:39 crc kubenswrapper[5120]: E0316 17:08:39.606573 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-memcached-svc: secret "cert-memcached-svc" not found Mar 16 17:08:39 crc kubenswrapper[5120]: E0316 17:08:39.606648 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10bd837b-2e0d-460b-a254-20e23b6768f7-memcached-tls-certs podName:10bd837b-2e0d-460b-a254-20e23b6768f7 nodeName:}" failed. No retries permitted until 2026-03-16 17:08:40.106631667 +0000 UTC m=+5822.260563344 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "memcached-tls-certs" (UniqueName: "kubernetes.io/secret/10bd837b-2e0d-460b-a254-20e23b6768f7-memcached-tls-certs") pod "memcached-0" (UID: "10bd837b-2e0d-460b-a254-20e23b6768f7") : secret "cert-memcached-svc" not found Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.607788 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/10bd837b-2e0d-460b-a254-20e23b6768f7-config-data\") pod \"memcached-0\" (UID: \"10bd837b-2e0d-460b-a254-20e23b6768f7\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.612118 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/10bd837b-2e0d-460b-a254-20e23b6768f7-combined-ca-bundle\") pod \"memcached-0\" (UID: \"10bd837b-2e0d-460b-a254-20e23b6768f7\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.626493 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-blklg\" (UniqueName: \"kubernetes.io/projected/10bd837b-2e0d-460b-a254-20e23b6768f7-kube-api-access-blklg\") pod \"memcached-0\" (UID: \"10bd837b-2e0d-460b-a254-20e23b6768f7\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.706189 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"ovsdbserver-nb-0\" (UID: \"cde31df2-efeb-4fee-b565-f24b7eaeff60\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.706291 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cde31df2-efeb-4fee-b565-f24b7eaeff60-config\") pod \"ovsdbserver-nb-0\" (UID: \"cde31df2-efeb-4fee-b565-f24b7eaeff60\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.706453 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"ovsdbserver-nb-0\" (UID: \"cde31df2-efeb-4fee-b565-f24b7eaeff60\") device mount path \"/mnt/openstack/pv08\"" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.706633 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/cde31df2-efeb-4fee-b565-f24b7eaeff60-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"cde31df2-efeb-4fee-b565-f24b7eaeff60\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.707040 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/cde31df2-efeb-4fee-b565-f24b7eaeff60-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"cde31df2-efeb-4fee-b565-f24b7eaeff60\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.707240 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7wwnb\" (UniqueName: \"kubernetes.io/projected/cde31df2-efeb-4fee-b565-f24b7eaeff60-kube-api-access-7wwnb\") pod \"ovsdbserver-nb-0\" (UID: \"cde31df2-efeb-4fee-b565-f24b7eaeff60\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.707682 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/cde31df2-efeb-4fee-b565-f24b7eaeff60-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"cde31df2-efeb-4fee-b565-f24b7eaeff60\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.707923 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cde31df2-efeb-4fee-b565-f24b7eaeff60-config\") pod \"ovsdbserver-nb-0\" (UID: \"cde31df2-efeb-4fee-b565-f24b7eaeff60\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:08:39 crc kubenswrapper[5120]: E0316 17:08:39.707971 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-ovn-metrics: secret "cert-ovn-metrics" not found Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.708894 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/cde31df2-efeb-4fee-b565-f24b7eaeff60-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"cde31df2-efeb-4fee-b565-f24b7eaeff60\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.709365 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/cde31df2-efeb-4fee-b565-f24b7eaeff60-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"cde31df2-efeb-4fee-b565-f24b7eaeff60\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:08:39 crc kubenswrapper[5120]: E0316 17:08:39.710173 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cde31df2-efeb-4fee-b565-f24b7eaeff60-metrics-certs-tls-certs podName:cde31df2-efeb-4fee-b565-f24b7eaeff60 nodeName:}" failed. No retries permitted until 2026-03-16 17:08:40.210142006 +0000 UTC m=+5822.364073663 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs-tls-certs" (UniqueName: "kubernetes.io/secret/cde31df2-efeb-4fee-b565-f24b7eaeff60-metrics-certs-tls-certs") pod "ovsdbserver-nb-0" (UID: "cde31df2-efeb-4fee-b565-f24b7eaeff60") : secret "cert-ovn-metrics" not found Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.710227 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cde31df2-efeb-4fee-b565-f24b7eaeff60-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"cde31df2-efeb-4fee-b565-f24b7eaeff60\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.710394 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/cde31df2-efeb-4fee-b565-f24b7eaeff60-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"cde31df2-efeb-4fee-b565-f24b7eaeff60\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:08:39 crc kubenswrapper[5120]: E0316 17:08:39.710703 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-ovndbcluster-nb-ovndbs: secret "cert-ovndbcluster-nb-ovndbs" not found Mar 16 17:08:39 crc kubenswrapper[5120]: E0316 17:08:39.710791 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cde31df2-efeb-4fee-b565-f24b7eaeff60-ovsdbserver-nb-tls-certs podName:cde31df2-efeb-4fee-b565-f24b7eaeff60 nodeName:}" failed. No retries permitted until 2026-03-16 17:08:40.210777244 +0000 UTC m=+5822.364708921 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ovsdbserver-nb-tls-certs" (UniqueName: "kubernetes.io/secret/cde31df2-efeb-4fee-b565-f24b7eaeff60-ovsdbserver-nb-tls-certs") pod "ovsdbserver-nb-0" (UID: "cde31df2-efeb-4fee-b565-f24b7eaeff60") : secret "cert-ovndbcluster-nb-ovndbs" not found Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.718437 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cde31df2-efeb-4fee-b565-f24b7eaeff60-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"cde31df2-efeb-4fee-b565-f24b7eaeff60\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.734842 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wwnb\" (UniqueName: \"kubernetes.io/projected/cde31df2-efeb-4fee-b565-f24b7eaeff60-kube-api-access-7wwnb\") pod \"ovsdbserver-nb-0\" (UID: \"cde31df2-efeb-4fee-b565-f24b7eaeff60\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.739577 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"ovsdbserver-nb-0\" (UID: \"cde31df2-efeb-4fee-b565-f24b7eaeff60\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.831037 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.831033 5120 scope.go:117] "RemoveContainer" containerID="3f289a8fede143f8dca99cdbaa1cac9860a28fa61689bab6b0b824d500b16adf" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.834129 5120 status_manager.go:905] "Pod was deleted and then recreated, skipping status update" pod="openstack-kuttl-tests/openstackclient" oldPodUID="d325d1cb-bde7-4d3d-978f-2f9d1188717e" podUID="140a02f0-df36-49fb-b2bb-b267e350f5c5" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.837035 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.837025 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"5eac4201-2543-460e-8643-d376fab79512","Type":"ContainerDied","Data":"222ecbf2f5c98f5531309556067e9e3d0932b6a92c2b25fa5d51b22a0d996258"} Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.842645 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-7d8dcb56b8-42f9n" event={"ID":"1b7d191f-d557-4a83-829b-bad5a5ed7dbb","Type":"ContainerStarted","Data":"7910ed697b40b1459f42e3b89f80666792021d8e9714d9012682a2dbde466be8"} Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.843708 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstackclient" event={"ID":"140a02f0-df36-49fb-b2bb-b267e350f5c5","Type":"ContainerStarted","Data":"e8d5de1d76473ce9598658d8893f94ad1d8f4edf5c6e73beeddfcbd802809017"} Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.845499 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-6f95f9d4f9-4kmmn" event={"ID":"e491da9b-3bac-45f2-b9f5-41af945fe1eb","Type":"ContainerStarted","Data":"50ba6f99478a2553d827336920b5f82ff35d489c47d9082dbe0a248bce182ecc"} Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.847428 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"8f7be4b3-fcec-41d8-9b93-a41201c60005","Type":"ContainerDied","Data":"14e0a938f7873b66717cfd28df64638c437654550798b5ea9f4597d6a9aa5555"} Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.847498 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.853471 5120 generic.go:358] "Generic (PLEG): container finished" podID="6a21ca52-7273-4160-914b-4958e7f2c2ce" containerID="1c22580c851343e8b19eb347321deb3137a86e53ef649ed430e0c0ee54117213" exitCode=0 Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.853539 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"6a21ca52-7273-4160-914b-4958e7f2c2ce","Type":"ContainerDied","Data":"1c22580c851343e8b19eb347321deb3137a86e53ef649ed430e0c0ee54117213"} Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.853571 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"6a21ca52-7273-4160-914b-4958e7f2c2ce","Type":"ContainerDied","Data":"660330668e90411e4081e4e830e891aae69d04c7ec8cf73bb87b65f12de41c7c"} Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.853580 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="660330668e90411e4081e4e830e891aae69d04c7ec8cf73bb87b65f12de41c7c" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.894698 5120 scope.go:117] "RemoveContainer" containerID="c4fbb0d93de06153ee805dc84d38adcfe4df3b1761b668d82ce6b1cc908a9080" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.924100 5120 status_manager.go:905] "Pod was deleted and then recreated, skipping status update" pod="openstack-kuttl-tests/openstackclient" oldPodUID="d325d1cb-bde7-4d3d-978f-2f9d1188717e" podUID="140a02f0-df36-49fb-b2bb-b267e350f5c5" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.955773 5120 scope.go:117] "RemoveContainer" containerID="9138ee4aadb68a2acd1b72111c7f5fa6685919d8489bbaf034f00ddf002da6a1" Mar 16 17:08:39 crc kubenswrapper[5120]: I0316 17:08:39.987421 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.011245 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.016699 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.033197 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.033299 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/a96c9fab-fbd4-459d-90a5-ca103703bfc9-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"a96c9fab-fbd4-459d-90a5-ca103703bfc9\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.033608 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/a96c9fab-fbd4-459d-90a5-ca103703bfc9-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"a96c9fab-fbd4-459d-90a5-ca103703bfc9\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:08:40 crc kubenswrapper[5120]: E0316 17:08:40.035164 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-ovndbcluster-sb-ovndbs: secret "cert-ovndbcluster-sb-ovndbs" not found Mar 16 17:08:40 crc kubenswrapper[5120]: E0316 17:08:40.036199 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-nova-novncproxy-cell1-vencrypt: secret "cert-nova-novncproxy-cell1-vencrypt" not found Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.036513 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.037819 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a21ca52-7273-4160-914b-4958e7f2c2ce" containerName="nova-cell0-conductor-conductor" Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.037838 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a21ca52-7273-4160-914b-4958e7f2c2ce" containerName="nova-cell0-conductor-conductor" Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.038065 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="6a21ca52-7273-4160-914b-4958e7f2c2ce" containerName="nova-cell0-conductor-conductor" Mar 16 17:08:40 crc kubenswrapper[5120]: E0316 17:08:40.040036 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-ovn-metrics: secret "cert-ovn-metrics" not found Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.047769 5120 scope.go:117] "RemoveContainer" containerID="7dd60adc27480f52058b362abed27158f7e301ca1ac5ae0382560a9459203f9e" Mar 16 17:08:40 crc kubenswrapper[5120]: E0316 17:08:40.048177 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a96c9fab-fbd4-459d-90a5-ca103703bfc9-ovsdbserver-sb-tls-certs podName:a96c9fab-fbd4-459d-90a5-ca103703bfc9 nodeName:}" failed. No retries permitted until 2026-03-16 17:08:41.048127034 +0000 UTC m=+5823.202058691 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "ovsdbserver-sb-tls-certs" (UniqueName: "kubernetes.io/secret/a96c9fab-fbd4-459d-90a5-ca103703bfc9-ovsdbserver-sb-tls-certs") pod "ovsdbserver-sb-0" (UID: "a96c9fab-fbd4-459d-90a5-ca103703bfc9") : secret "cert-ovndbcluster-sb-ovndbs" not found Mar 16 17:08:40 crc kubenswrapper[5120]: E0316 17:08:40.048226 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3-vencrypt-tls-certs podName:eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3 nodeName:}" failed. No retries permitted until 2026-03-16 17:08:41.048214746 +0000 UTC m=+5823.202146403 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "vencrypt-tls-certs" (UniqueName: "kubernetes.io/secret/eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3-vencrypt-tls-certs") pod "nova-cell1-novncproxy-0" (UID: "eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3") : secret "cert-nova-novncproxy-cell1-vencrypt" not found Mar 16 17:08:40 crc kubenswrapper[5120]: E0316 17:08:40.048259 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a96c9fab-fbd4-459d-90a5-ca103703bfc9-metrics-certs-tls-certs podName:a96c9fab-fbd4-459d-90a5-ca103703bfc9 nodeName:}" failed. No retries permitted until 2026-03-16 17:08:41.048250657 +0000 UTC m=+5823.202182314 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs-tls-certs" (UniqueName: "kubernetes.io/secret/a96c9fab-fbd4-459d-90a5-ca103703bfc9-metrics-certs-tls-certs") pod "ovsdbserver-sb-0" (UID: "a96c9fab-fbd4-459d-90a5-ca103703bfc9") : secret "cert-ovn-metrics" not found Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.048655 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:08:40 crc kubenswrapper[5120]: E0316 17:08:40.048967 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-nova-novncproxy-cell1-public-svc: secret "cert-nova-novncproxy-cell1-public-svc" not found Mar 16 17:08:40 crc kubenswrapper[5120]: E0316 17:08:40.049063 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3-nova-novncproxy-tls-certs podName:eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3 nodeName:}" failed. No retries permitted until 2026-03-16 17:08:41.049033218 +0000 UTC m=+5823.202964875 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "nova-novncproxy-tls-certs" (UniqueName: "kubernetes.io/secret/eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3-nova-novncproxy-tls-certs") pod "nova-cell1-novncproxy-0" (UID: "eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3") : secret "cert-nova-novncproxy-cell1-public-svc" not found Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.061076 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.061256 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.064260 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-cell1-config-data\"" Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.064846 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/nova-metadata-0" podUID="c8ccd406-033f-4230-b9a3-357d14ec49f2" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"https://10.217.1.223:8775/\": read tcp 10.217.0.2:55218->10.217.1.223:8775: read: connection reset by peer" Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.066936 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.075219 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-cell1-scripts\"" Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.075226 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"galera-openstack-cell1-dockercfg-lq677\"" Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.079294 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-galera-openstack-cell1-svc\"" Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.089002 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.103135 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.112868 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.114353 5120 scope.go:117] "RemoveContainer" containerID="60a0181a4eaeebcf2ae4e423742282cd4c2d215a2fa81882dbe1949313877686" Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.118102 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-config-data\"" Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.118444 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"galera-openstack-dockercfg-ct9tq\"" Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.121801 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-scripts\"" Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.128104 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-galera-openstack-svc\"" Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.163412 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6a21ca52-7273-4160-914b-4958e7f2c2ce-config-data\") pod \"6a21ca52-7273-4160-914b-4958e7f2c2ce\" (UID: \"6a21ca52-7273-4160-914b-4958e7f2c2ce\") " Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.163777 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vtz5b\" (UniqueName: \"kubernetes.io/projected/6a21ca52-7273-4160-914b-4958e7f2c2ce-kube-api-access-vtz5b\") pod \"6a21ca52-7273-4160-914b-4958e7f2c2ce\" (UID: \"6a21ca52-7273-4160-914b-4958e7f2c2ce\") " Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.163903 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6a21ca52-7273-4160-914b-4958e7f2c2ce-combined-ca-bundle\") pod \"6a21ca52-7273-4160-914b-4958e7f2c2ce\" (UID: \"6a21ca52-7273-4160-914b-4958e7f2c2ce\") " Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.165992 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wnsm\" (UniqueName: \"kubernetes.io/projected/1f26bb19-36e1-4611-8fef-a2b16661b9f1-kube-api-access-7wnsm\") pod \"openstack-cell1-galera-0\" (UID: \"1f26bb19-36e1-4611-8fef-a2b16661b9f1\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.166328 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/1f26bb19-36e1-4611-8fef-a2b16661b9f1-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"1f26bb19-36e1-4611-8fef-a2b16661b9f1\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.166436 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/1f26bb19-36e1-4611-8fef-a2b16661b9f1-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"1f26bb19-36e1-4611-8fef-a2b16661b9f1\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.184291 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/1f26bb19-36e1-4611-8fef-a2b16661b9f1-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"1f26bb19-36e1-4611-8fef-a2b16661b9f1\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.185507 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/1f26bb19-36e1-4611-8fef-a2b16661b9f1-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"1f26bb19-36e1-4611-8fef-a2b16661b9f1\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.185900 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.185962 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/10bd837b-2e0d-460b-a254-20e23b6768f7-memcached-tls-certs\") pod \"memcached-0\" (UID: \"10bd837b-2e0d-460b-a254-20e23b6768f7\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.186034 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"openstack-cell1-galera-0\" (UID: \"1f26bb19-36e1-4611-8fef-a2b16661b9f1\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.186090 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1f26bb19-36e1-4611-8fef-a2b16661b9f1-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"1f26bb19-36e1-4611-8fef-a2b16661b9f1\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.186194 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/1f26bb19-36e1-4611-8fef-a2b16661b9f1-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"1f26bb19-36e1-4611-8fef-a2b16661b9f1\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:08:40 crc kubenswrapper[5120]: E0316 17:08:40.186679 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-memcached-svc: secret "cert-memcached-svc" not found Mar 16 17:08:40 crc kubenswrapper[5120]: E0316 17:08:40.186734 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10bd837b-2e0d-460b-a254-20e23b6768f7-memcached-tls-certs podName:10bd837b-2e0d-460b-a254-20e23b6768f7 nodeName:}" failed. No retries permitted until 2026-03-16 17:08:41.186718622 +0000 UTC m=+5823.340650279 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "memcached-tls-certs" (UniqueName: "kubernetes.io/secret/10bd837b-2e0d-460b-a254-20e23b6768f7-memcached-tls-certs") pod "memcached-0" (UID: "10bd837b-2e0d-460b-a254-20e23b6768f7") : secret "cert-memcached-svc" not found Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.218025 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a21ca52-7273-4160-914b-4958e7f2c2ce-kube-api-access-vtz5b" (OuterVolumeSpecName: "kube-api-access-vtz5b") pod "6a21ca52-7273-4160-914b-4958e7f2c2ce" (UID: "6a21ca52-7273-4160-914b-4958e7f2c2ce"). InnerVolumeSpecName "kube-api-access-vtz5b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.221783 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a21ca52-7273-4160-914b-4958e7f2c2ce-config-data" (OuterVolumeSpecName: "config-data") pod "6a21ca52-7273-4160-914b-4958e7f2c2ce" (UID: "6a21ca52-7273-4160-914b-4958e7f2c2ce"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.224892 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a21ca52-7273-4160-914b-4958e7f2c2ce-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "6a21ca52-7273-4160-914b-4958e7f2c2ce" (UID: "6a21ca52-7273-4160-914b-4958e7f2c2ce"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.289888 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7wnsm\" (UniqueName: \"kubernetes.io/projected/1f26bb19-36e1-4611-8fef-a2b16661b9f1-kube-api-access-7wnsm\") pod \"openstack-cell1-galera-0\" (UID: \"1f26bb19-36e1-4611-8fef-a2b16661b9f1\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.290018 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/1f26bb19-36e1-4611-8fef-a2b16661b9f1-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"1f26bb19-36e1-4611-8fef-a2b16661b9f1\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.293749 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/1f26bb19-36e1-4611-8fef-a2b16661b9f1-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"1f26bb19-36e1-4611-8fef-a2b16661b9f1\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.293977 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/1f26bb19-36e1-4611-8fef-a2b16661b9f1-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"1f26bb19-36e1-4611-8fef-a2b16661b9f1\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:08:40 crc kubenswrapper[5120]: E0316 17:08:40.294147 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-galera-openstack-cell1-svc: secret "cert-galera-openstack-cell1-svc" not found Mar 16 17:08:40 crc kubenswrapper[5120]: E0316 17:08:40.294228 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f26bb19-36e1-4611-8fef-a2b16661b9f1-galera-tls-certs podName:1f26bb19-36e1-4611-8fef-a2b16661b9f1 nodeName:}" failed. No retries permitted until 2026-03-16 17:08:40.794206491 +0000 UTC m=+5822.948138148 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "galera-tls-certs" (UniqueName: "kubernetes.io/secret/1f26bb19-36e1-4611-8fef-a2b16661b9f1-galera-tls-certs") pod "openstack-cell1-galera-0" (UID: "1f26bb19-36e1-4611-8fef-a2b16661b9f1") : secret "cert-galera-openstack-cell1-svc" not found Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.294150 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/ab5d1889-4b15-4b9d-92fb-838a10dc858f-config-data-default\") pod \"openstack-galera-0\" (UID: \"ab5d1889-4b15-4b9d-92fb-838a10dc858f\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.294524 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"openstack-galera-0\" (UID: \"ab5d1889-4b15-4b9d-92fb-838a10dc858f\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.294629 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/1f26bb19-36e1-4611-8fef-a2b16661b9f1-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"1f26bb19-36e1-4611-8fef-a2b16661b9f1\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.294717 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/ab5d1889-4b15-4b9d-92fb-838a10dc858f-kolla-config\") pod \"openstack-galera-0\" (UID: \"ab5d1889-4b15-4b9d-92fb-838a10dc858f\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.294774 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/1f26bb19-36e1-4611-8fef-a2b16661b9f1-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"1f26bb19-36e1-4611-8fef-a2b16661b9f1\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.294800 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/ab5d1889-4b15-4b9d-92fb-838a10dc858f-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"ab5d1889-4b15-4b9d-92fb-838a10dc858f\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.294899 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqbln\" (UniqueName: \"kubernetes.io/projected/ab5d1889-4b15-4b9d-92fb-838a10dc858f-kube-api-access-fqbln\") pod \"openstack-galera-0\" (UID: \"ab5d1889-4b15-4b9d-92fb-838a10dc858f\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.295065 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"openstack-cell1-galera-0\" (UID: \"1f26bb19-36e1-4611-8fef-a2b16661b9f1\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.295131 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1f26bb19-36e1-4611-8fef-a2b16661b9f1-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"1f26bb19-36e1-4611-8fef-a2b16661b9f1\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.295209 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/ab5d1889-4b15-4b9d-92fb-838a10dc858f-config-data-generated\") pod \"openstack-galera-0\" (UID: \"ab5d1889-4b15-4b9d-92fb-838a10dc858f\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.295252 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/cde31df2-efeb-4fee-b565-f24b7eaeff60-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"cde31df2-efeb-4fee-b565-f24b7eaeff60\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.295287 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/1f26bb19-36e1-4611-8fef-a2b16661b9f1-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"1f26bb19-36e1-4611-8fef-a2b16661b9f1\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.295413 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ab5d1889-4b15-4b9d-92fb-838a10dc858f-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"ab5d1889-4b15-4b9d-92fb-838a10dc858f\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.295456 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/cde31df2-efeb-4fee-b565-f24b7eaeff60-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"cde31df2-efeb-4fee-b565-f24b7eaeff60\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.295512 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ab5d1889-4b15-4b9d-92fb-838a10dc858f-operator-scripts\") pod \"openstack-galera-0\" (UID: \"ab5d1889-4b15-4b9d-92fb-838a10dc858f\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.295626 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"openstack-cell1-galera-0\" (UID: \"1f26bb19-36e1-4611-8fef-a2b16661b9f1\") device mount path \"/mnt/openstack/pv04\"" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.295846 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/1f26bb19-36e1-4611-8fef-a2b16661b9f1-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"1f26bb19-36e1-4611-8fef-a2b16661b9f1\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:08:40 crc kubenswrapper[5120]: E0316 17:08:40.295890 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-ovndbcluster-nb-ovndbs: secret "cert-ovndbcluster-nb-ovndbs" not found Mar 16 17:08:40 crc kubenswrapper[5120]: E0316 17:08:40.295920 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-ovn-metrics: secret "cert-ovn-metrics" not found Mar 16 17:08:40 crc kubenswrapper[5120]: E0316 17:08:40.295978 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cde31df2-efeb-4fee-b565-f24b7eaeff60-ovsdbserver-nb-tls-certs podName:cde31df2-efeb-4fee-b565-f24b7eaeff60 nodeName:}" failed. No retries permitted until 2026-03-16 17:08:41.29596247 +0000 UTC m=+5823.449894127 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "ovsdbserver-nb-tls-certs" (UniqueName: "kubernetes.io/secret/cde31df2-efeb-4fee-b565-f24b7eaeff60-ovsdbserver-nb-tls-certs") pod "ovsdbserver-nb-0" (UID: "cde31df2-efeb-4fee-b565-f24b7eaeff60") : secret "cert-ovndbcluster-nb-ovndbs" not found Mar 16 17:08:40 crc kubenswrapper[5120]: E0316 17:08:40.296024 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cde31df2-efeb-4fee-b565-f24b7eaeff60-metrics-certs-tls-certs podName:cde31df2-efeb-4fee-b565-f24b7eaeff60 nodeName:}" failed. No retries permitted until 2026-03-16 17:08:41.296013561 +0000 UTC m=+5823.449945208 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs-tls-certs" (UniqueName: "kubernetes.io/secret/cde31df2-efeb-4fee-b565-f24b7eaeff60-metrics-certs-tls-certs") pod "ovsdbserver-nb-0" (UID: "cde31df2-efeb-4fee-b565-f24b7eaeff60") : secret "cert-ovn-metrics" not found Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.296109 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6a21ca52-7273-4160-914b-4958e7f2c2ce-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.296130 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vtz5b\" (UniqueName: \"kubernetes.io/projected/6a21ca52-7273-4160-914b-4958e7f2c2ce-kube-api-access-vtz5b\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.296145 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6a21ca52-7273-4160-914b-4958e7f2c2ce-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.296265 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/1f26bb19-36e1-4611-8fef-a2b16661b9f1-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"1f26bb19-36e1-4611-8fef-a2b16661b9f1\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.298454 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/1f26bb19-36e1-4611-8fef-a2b16661b9f1-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"1f26bb19-36e1-4611-8fef-a2b16661b9f1\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.304868 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1f26bb19-36e1-4611-8fef-a2b16661b9f1-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"1f26bb19-36e1-4611-8fef-a2b16661b9f1\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.317268 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wnsm\" (UniqueName: \"kubernetes.io/projected/1f26bb19-36e1-4611-8fef-a2b16661b9f1-kube-api-access-7wnsm\") pod \"openstack-cell1-galera-0\" (UID: \"1f26bb19-36e1-4611-8fef-a2b16661b9f1\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.327689 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/cinder-api-0" podUID="0156f10b-e51f-4ce8-a414-e6339cd30530" containerName="cinder-api" probeResult="failure" output="Get \"https://10.217.1.185:8776/healthcheck\": read tcp 10.217.0.2:52566->10.217.1.185:8776: read: connection reset by peer" Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.352474 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"openstack-cell1-galera-0\" (UID: \"1f26bb19-36e1-4611-8fef-a2b16661b9f1\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.399169 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ab5d1889-4b15-4b9d-92fb-838a10dc858f-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"ab5d1889-4b15-4b9d-92fb-838a10dc858f\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.399824 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ab5d1889-4b15-4b9d-92fb-838a10dc858f-operator-scripts\") pod \"openstack-galera-0\" (UID: \"ab5d1889-4b15-4b9d-92fb-838a10dc858f\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.401433 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ab5d1889-4b15-4b9d-92fb-838a10dc858f-operator-scripts\") pod \"openstack-galera-0\" (UID: \"ab5d1889-4b15-4b9d-92fb-838a10dc858f\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.402137 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/ab5d1889-4b15-4b9d-92fb-838a10dc858f-config-data-default\") pod \"openstack-galera-0\" (UID: \"ab5d1889-4b15-4b9d-92fb-838a10dc858f\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.402204 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"openstack-galera-0\" (UID: \"ab5d1889-4b15-4b9d-92fb-838a10dc858f\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.402336 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/ab5d1889-4b15-4b9d-92fb-838a10dc858f-kolla-config\") pod \"openstack-galera-0\" (UID: \"ab5d1889-4b15-4b9d-92fb-838a10dc858f\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.402373 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/ab5d1889-4b15-4b9d-92fb-838a10dc858f-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"ab5d1889-4b15-4b9d-92fb-838a10dc858f\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.402456 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fqbln\" (UniqueName: \"kubernetes.io/projected/ab5d1889-4b15-4b9d-92fb-838a10dc858f-kube-api-access-fqbln\") pod \"openstack-galera-0\" (UID: \"ab5d1889-4b15-4b9d-92fb-838a10dc858f\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.402705 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/ab5d1889-4b15-4b9d-92fb-838a10dc858f-config-data-generated\") pod \"openstack-galera-0\" (UID: \"ab5d1889-4b15-4b9d-92fb-838a10dc858f\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.402984 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"openstack-galera-0\" (UID: \"ab5d1889-4b15-4b9d-92fb-838a10dc858f\") device mount path \"/mnt/openstack/pv20\"" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.403166 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/ab5d1889-4b15-4b9d-92fb-838a10dc858f-config-data-generated\") pod \"openstack-galera-0\" (UID: \"ab5d1889-4b15-4b9d-92fb-838a10dc858f\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.403666 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/ab5d1889-4b15-4b9d-92fb-838a10dc858f-kolla-config\") pod \"openstack-galera-0\" (UID: \"ab5d1889-4b15-4b9d-92fb-838a10dc858f\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:08:40 crc kubenswrapper[5120]: E0316 17:08:40.403750 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-galera-openstack-svc: secret "cert-galera-openstack-svc" not found Mar 16 17:08:40 crc kubenswrapper[5120]: E0316 17:08:40.403827 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab5d1889-4b15-4b9d-92fb-838a10dc858f-galera-tls-certs podName:ab5d1889-4b15-4b9d-92fb-838a10dc858f nodeName:}" failed. No retries permitted until 2026-03-16 17:08:40.903809519 +0000 UTC m=+5823.057741176 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "galera-tls-certs" (UniqueName: "kubernetes.io/secret/ab5d1889-4b15-4b9d-92fb-838a10dc858f-galera-tls-certs") pod "openstack-galera-0" (UID: "ab5d1889-4b15-4b9d-92fb-838a10dc858f") : secret "cert-galera-openstack-svc" not found Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.406480 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/ab5d1889-4b15-4b9d-92fb-838a10dc858f-config-data-default\") pod \"openstack-galera-0\" (UID: \"ab5d1889-4b15-4b9d-92fb-838a10dc858f\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.407035 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ab5d1889-4b15-4b9d-92fb-838a10dc858f-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"ab5d1889-4b15-4b9d-92fb-838a10dc858f\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.432990 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"openstack-galera-0\" (UID: \"ab5d1889-4b15-4b9d-92fb-838a10dc858f\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.437369 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqbln\" (UniqueName: \"kubernetes.io/projected/ab5d1889-4b15-4b9d-92fb-838a10dc858f-kube-api-access-fqbln\") pod \"openstack-galera-0\" (UID: \"ab5d1889-4b15-4b9d-92fb-838a10dc858f\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.612300 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/3f98651e-6cef-4b31-8aac-46d152305e88-public-tls-certs\") pod \"barbican-api-7648f748d8-cxwnc\" (UID: \"3f98651e-6cef-4b31-8aac-46d152305e88\") " pod="openstack-kuttl-tests/barbican-api-7648f748d8-cxwnc" Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.612418 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/3f98651e-6cef-4b31-8aac-46d152305e88-internal-tls-certs\") pod \"barbican-api-7648f748d8-cxwnc\" (UID: \"3f98651e-6cef-4b31-8aac-46d152305e88\") " pod="openstack-kuttl-tests/barbican-api-7648f748d8-cxwnc" Mar 16 17:08:40 crc kubenswrapper[5120]: E0316 17:08:40.613422 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-barbican-public-svc: secret "cert-barbican-public-svc" not found Mar 16 17:08:40 crc kubenswrapper[5120]: E0316 17:08:40.613509 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f98651e-6cef-4b31-8aac-46d152305e88-public-tls-certs podName:3f98651e-6cef-4b31-8aac-46d152305e88 nodeName:}" failed. No retries permitted until 2026-03-16 17:08:44.613485961 +0000 UTC m=+5826.767417648 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/3f98651e-6cef-4b31-8aac-46d152305e88-public-tls-certs") pod "barbican-api-7648f748d8-cxwnc" (UID: "3f98651e-6cef-4b31-8aac-46d152305e88") : secret "cert-barbican-public-svc" not found Mar 16 17:08:40 crc kubenswrapper[5120]: E0316 17:08:40.614100 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-barbican-internal-svc: secret "cert-barbican-internal-svc" not found Mar 16 17:08:40 crc kubenswrapper[5120]: E0316 17:08:40.616064 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f98651e-6cef-4b31-8aac-46d152305e88-internal-tls-certs podName:3f98651e-6cef-4b31-8aac-46d152305e88 nodeName:}" failed. No retries permitted until 2026-03-16 17:08:44.616037502 +0000 UTC m=+5826.769969179 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/3f98651e-6cef-4b31-8aac-46d152305e88-internal-tls-certs") pod "barbican-api-7648f748d8-cxwnc" (UID: "3f98651e-6cef-4b31-8aac-46d152305e88") : secret "cert-barbican-internal-svc" not found Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.695596 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.703779 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1b14824b-ab59-47bd-af31-b5f0b806a9c3" path="/var/lib/kubelet/pods/1b14824b-ab59-47bd-af31-b5f0b806a9c3/volumes" Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.704392 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="286e2312-ce33-48da-ac60-149b96ace59a" path="/var/lib/kubelet/pods/286e2312-ce33-48da-ac60-149b96ace59a/volumes" Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.705005 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5eac4201-2543-460e-8643-d376fab79512" path="/var/lib/kubelet/pods/5eac4201-2543-460e-8643-d376fab79512/volumes" Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.706180 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8f7be4b3-fcec-41d8-9b93-a41201c60005" path="/var/lib/kubelet/pods/8f7be4b3-fcec-41d8-9b93-a41201c60005/volumes" Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.706739 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="95f093ea-03a9-45b1-925d-0f51d76dc93d" path="/var/lib/kubelet/pods/95f093ea-03a9-45b1-925d-0f51d76dc93d/volumes" Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.708735 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b9d1b067-481f-4959-99ab-68d36e78226d" path="/var/lib/kubelet/pods/b9d1b067-481f-4959-99ab-68d36e78226d/volumes" Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.710404 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.710631 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d325d1cb-bde7-4d3d-978f-2f9d1188717e" path="/var/lib/kubelet/pods/d325d1cb-bde7-4d3d-978f-2f9d1188717e/volumes" Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.819926 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c8ccd406-033f-4230-b9a3-357d14ec49f2-logs\") pod \"c8ccd406-033f-4230-b9a3-357d14ec49f2\" (UID: \"c8ccd406-033f-4230-b9a3-357d14ec49f2\") " Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.820150 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9dde2b26-18b2-469b-94d1-92da183402fc-combined-ca-bundle\") pod \"9dde2b26-18b2-469b-94d1-92da183402fc\" (UID: \"9dde2b26-18b2-469b-94d1-92da183402fc\") " Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.820284 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c8ccd406-033f-4230-b9a3-357d14ec49f2-config-data\") pod \"c8ccd406-033f-4230-b9a3-357d14ec49f2\" (UID: \"c8ccd406-033f-4230-b9a3-357d14ec49f2\") " Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.820365 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9dde2b26-18b2-469b-94d1-92da183402fc-logs\") pod \"9dde2b26-18b2-469b-94d1-92da183402fc\" (UID: \"9dde2b26-18b2-469b-94d1-92da183402fc\") " Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.820414 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c8ccd406-033f-4230-b9a3-357d14ec49f2-combined-ca-bundle\") pod \"c8ccd406-033f-4230-b9a3-357d14ec49f2\" (UID: \"c8ccd406-033f-4230-b9a3-357d14ec49f2\") " Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.820462 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8ccd406-033f-4230-b9a3-357d14ec49f2-logs" (OuterVolumeSpecName: "logs") pod "c8ccd406-033f-4230-b9a3-357d14ec49f2" (UID: "c8ccd406-033f-4230-b9a3-357d14ec49f2"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.820495 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qwxjf\" (UniqueName: \"kubernetes.io/projected/9dde2b26-18b2-469b-94d1-92da183402fc-kube-api-access-qwxjf\") pod \"9dde2b26-18b2-469b-94d1-92da183402fc\" (UID: \"9dde2b26-18b2-469b-94d1-92da183402fc\") " Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.820791 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/c8ccd406-033f-4230-b9a3-357d14ec49f2-nova-metadata-tls-certs\") pod \"c8ccd406-033f-4230-b9a3-357d14ec49f2\" (UID: \"c8ccd406-033f-4230-b9a3-357d14ec49f2\") " Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.821005 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/9dde2b26-18b2-469b-94d1-92da183402fc-public-tls-certs\") pod \"9dde2b26-18b2-469b-94d1-92da183402fc\" (UID: \"9dde2b26-18b2-469b-94d1-92da183402fc\") " Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.821062 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9dde2b26-18b2-469b-94d1-92da183402fc-logs" (OuterVolumeSpecName: "logs") pod "9dde2b26-18b2-469b-94d1-92da183402fc" (UID: "9dde2b26-18b2-469b-94d1-92da183402fc"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.821095 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9dde2b26-18b2-469b-94d1-92da183402fc-config-data\") pod \"9dde2b26-18b2-469b-94d1-92da183402fc\" (UID: \"9dde2b26-18b2-469b-94d1-92da183402fc\") " Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.821261 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6jpbm\" (UniqueName: \"kubernetes.io/projected/c8ccd406-033f-4230-b9a3-357d14ec49f2-kube-api-access-6jpbm\") pod \"c8ccd406-033f-4230-b9a3-357d14ec49f2\" (UID: \"c8ccd406-033f-4230-b9a3-357d14ec49f2\") " Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.821371 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/9dde2b26-18b2-469b-94d1-92da183402fc-internal-tls-certs\") pod \"9dde2b26-18b2-469b-94d1-92da183402fc\" (UID: \"9dde2b26-18b2-469b-94d1-92da183402fc\") " Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.822234 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/1f26bb19-36e1-4611-8fef-a2b16661b9f1-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"1f26bb19-36e1-4611-8fef-a2b16661b9f1\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.822296 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/7a637c98-abe1-4f51-bee0-eb384fa79a43-public-tls-certs\") pod \"placement-85687c8566-vv9qr\" (UID: \"7a637c98-abe1-4f51-bee0-eb384fa79a43\") " pod="openstack-kuttl-tests/placement-85687c8566-vv9qr" Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.822463 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/7a637c98-abe1-4f51-bee0-eb384fa79a43-internal-tls-certs\") pod \"placement-85687c8566-vv9qr\" (UID: \"7a637c98-abe1-4f51-bee0-eb384fa79a43\") " pod="openstack-kuttl-tests/placement-85687c8566-vv9qr" Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.822664 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c8ccd406-033f-4230-b9a3-357d14ec49f2-logs\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.822680 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9dde2b26-18b2-469b-94d1-92da183402fc-logs\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:40 crc kubenswrapper[5120]: E0316 17:08:40.822950 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-placement-internal-svc: secret "cert-placement-internal-svc" not found Mar 16 17:08:40 crc kubenswrapper[5120]: E0316 17:08:40.823009 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a637c98-abe1-4f51-bee0-eb384fa79a43-internal-tls-certs podName:7a637c98-abe1-4f51-bee0-eb384fa79a43 nodeName:}" failed. No retries permitted until 2026-03-16 17:08:44.822988759 +0000 UTC m=+5826.976920416 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/7a637c98-abe1-4f51-bee0-eb384fa79a43-internal-tls-certs") pod "placement-85687c8566-vv9qr" (UID: "7a637c98-abe1-4f51-bee0-eb384fa79a43") : secret "cert-placement-internal-svc" not found Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.827938 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9dde2b26-18b2-469b-94d1-92da183402fc-kube-api-access-qwxjf" (OuterVolumeSpecName: "kube-api-access-qwxjf") pod "9dde2b26-18b2-469b-94d1-92da183402fc" (UID: "9dde2b26-18b2-469b-94d1-92da183402fc"). InnerVolumeSpecName "kube-api-access-qwxjf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:08:40 crc kubenswrapper[5120]: E0316 17:08:40.833700 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-galera-openstack-cell1-svc: secret "cert-galera-openstack-cell1-svc" not found Mar 16 17:08:40 crc kubenswrapper[5120]: E0316 17:08:40.833827 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f26bb19-36e1-4611-8fef-a2b16661b9f1-galera-tls-certs podName:1f26bb19-36e1-4611-8fef-a2b16661b9f1 nodeName:}" failed. No retries permitted until 2026-03-16 17:08:41.833806888 +0000 UTC m=+5823.987738545 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "galera-tls-certs" (UniqueName: "kubernetes.io/secret/1f26bb19-36e1-4611-8fef-a2b16661b9f1-galera-tls-certs") pod "openstack-cell1-galera-0" (UID: "1f26bb19-36e1-4611-8fef-a2b16661b9f1") : secret "cert-galera-openstack-cell1-svc" not found Mar 16 17:08:40 crc kubenswrapper[5120]: E0316 17:08:40.838847 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-placement-public-svc: secret "cert-placement-public-svc" not found Mar 16 17:08:40 crc kubenswrapper[5120]: E0316 17:08:40.838916 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a637c98-abe1-4f51-bee0-eb384fa79a43-public-tls-certs podName:7a637c98-abe1-4f51-bee0-eb384fa79a43 nodeName:}" failed. No retries permitted until 2026-03-16 17:08:44.838898458 +0000 UTC m=+5826.992830105 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/7a637c98-abe1-4f51-bee0-eb384fa79a43-public-tls-certs") pod "placement-85687c8566-vv9qr" (UID: "7a637c98-abe1-4f51-bee0-eb384fa79a43") : secret "cert-placement-public-svc" not found Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.885936 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9dde2b26-18b2-469b-94d1-92da183402fc-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "9dde2b26-18b2-469b-94d1-92da183402fc" (UID: "9dde2b26-18b2-469b-94d1-92da183402fc"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.887567 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8ccd406-033f-4230-b9a3-357d14ec49f2-kube-api-access-6jpbm" (OuterVolumeSpecName: "kube-api-access-6jpbm") pod "c8ccd406-033f-4230-b9a3-357d14ec49f2" (UID: "c8ccd406-033f-4230-b9a3-357d14ec49f2"). InnerVolumeSpecName "kube-api-access-6jpbm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.909669 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c8ccd406-033f-4230-b9a3-357d14ec49f2-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "c8ccd406-033f-4230-b9a3-357d14ec49f2" (UID: "c8ccd406-033f-4230-b9a3-357d14ec49f2"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.911217 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-7d8dcb56b8-42f9n" event={"ID":"1b7d191f-d557-4a83-829b-bad5a5ed7dbb","Type":"ContainerStarted","Data":"93a02ab0690546f90261545a3915392e1acc235fe9f611e9496292d465c53236"} Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.917548 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9dde2b26-18b2-469b-94d1-92da183402fc-config-data" (OuterVolumeSpecName: "config-data") pod "9dde2b26-18b2-469b-94d1-92da183402fc" (UID: "9dde2b26-18b2-469b-94d1-92da183402fc"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.926073 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c8ccd406-033f-4230-b9a3-357d14ec49f2-nova-metadata-tls-certs" (OuterVolumeSpecName: "nova-metadata-tls-certs") pod "c8ccd406-033f-4230-b9a3-357d14ec49f2" (UID: "c8ccd406-033f-4230-b9a3-357d14ec49f2"). InnerVolumeSpecName "nova-metadata-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.926412 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/76f0322f-b14b-4b9b-9665-2121e3b21629-ovndb-tls-certs\") pod \"neutron-64b7569b94-dxks6\" (UID: \"76f0322f-b14b-4b9b-9665-2121e3b21629\") " pod="openstack-kuttl-tests/neutron-64b7569b94-dxks6" Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.926474 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/ab5d1889-4b15-4b9d-92fb-838a10dc858f-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"ab5d1889-4b15-4b9d-92fb-838a10dc858f\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.926515 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstackclient" event={"ID":"140a02f0-df36-49fb-b2bb-b267e350f5c5","Type":"ContainerStarted","Data":"e2183bcba7b9ba237a63c8b8b38663b980601a86090e8c6ae375714527039f8d"} Mar 16 17:08:40 crc kubenswrapper[5120]: E0316 17:08:40.926663 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-neutron-ovndbs: secret "cert-neutron-ovndbs" not found Mar 16 17:08:40 crc kubenswrapper[5120]: E0316 17:08:40.926734 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-galera-openstack-svc: secret "cert-galera-openstack-svc" not found Mar 16 17:08:40 crc kubenswrapper[5120]: E0316 17:08:40.926811 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76f0322f-b14b-4b9b-9665-2121e3b21629-ovndb-tls-certs podName:76f0322f-b14b-4b9b-9665-2121e3b21629 nodeName:}" failed. No retries permitted until 2026-03-16 17:08:44.926788486 +0000 UTC m=+5827.080720153 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "ovndb-tls-certs" (UniqueName: "kubernetes.io/secret/76f0322f-b14b-4b9b-9665-2121e3b21629-ovndb-tls-certs") pod "neutron-64b7569b94-dxks6" (UID: "76f0322f-b14b-4b9b-9665-2121e3b21629") : secret "cert-neutron-ovndbs" not found Mar 16 17:08:40 crc kubenswrapper[5120]: E0316 17:08:40.926833 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab5d1889-4b15-4b9d-92fb-838a10dc858f-galera-tls-certs podName:ab5d1889-4b15-4b9d-92fb-838a10dc858f nodeName:}" failed. No retries permitted until 2026-03-16 17:08:41.926824407 +0000 UTC m=+5824.080756174 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "galera-tls-certs" (UniqueName: "kubernetes.io/secret/ab5d1889-4b15-4b9d-92fb-838a10dc858f-galera-tls-certs") pod "openstack-galera-0" (UID: "ab5d1889-4b15-4b9d-92fb-838a10dc858f") : secret "cert-galera-openstack-svc" not found Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.927364 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.927256 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/76f0322f-b14b-4b9b-9665-2121e3b21629-internal-tls-certs\") pod \"neutron-64b7569b94-dxks6\" (UID: \"76f0322f-b14b-4b9b-9665-2121e3b21629\") " pod="openstack-kuttl-tests/neutron-64b7569b94-dxks6" Mar 16 17:08:40 crc kubenswrapper[5120]: E0316 17:08:40.927672 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-neutron-internal-svc: secret "cert-neutron-internal-svc" not found Mar 16 17:08:40 crc kubenswrapper[5120]: E0316 17:08:40.927724 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76f0322f-b14b-4b9b-9665-2121e3b21629-internal-tls-certs podName:76f0322f-b14b-4b9b-9665-2121e3b21629 nodeName:}" failed. No retries permitted until 2026-03-16 17:08:44.927704372 +0000 UTC m=+5827.081636079 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/76f0322f-b14b-4b9b-9665-2121e3b21629-internal-tls-certs") pod "neutron-64b7569b94-dxks6" (UID: "76f0322f-b14b-4b9b-9665-2121e3b21629") : secret "cert-neutron-internal-svc" not found Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.927792 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/76f0322f-b14b-4b9b-9665-2121e3b21629-public-tls-certs\") pod \"neutron-64b7569b94-dxks6\" (UID: \"76f0322f-b14b-4b9b-9665-2121e3b21629\") " pod="openstack-kuttl-tests/neutron-64b7569b94-dxks6" Mar 16 17:08:40 crc kubenswrapper[5120]: E0316 17:08:40.927967 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-neutron-public-svc: secret "cert-neutron-public-svc" not found Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.929113 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-6f95f9d4f9-4kmmn" event={"ID":"e491da9b-3bac-45f2-b9f5-41af945fe1eb","Type":"ContainerStarted","Data":"870c2a927bc2107b7a9af1bd4b1b5d380ffd03e113df8349bec56a3b69849df3"} Mar 16 17:08:40 crc kubenswrapper[5120]: E0316 17:08:40.929844 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76f0322f-b14b-4b9b-9665-2121e3b21629-public-tls-certs podName:76f0322f-b14b-4b9b-9665-2121e3b21629 nodeName:}" failed. No retries permitted until 2026-03-16 17:08:44.92982407 +0000 UTC m=+5827.083755737 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/76f0322f-b14b-4b9b-9665-2121e3b21629-public-tls-certs") pod "neutron-64b7569b94-dxks6" (UID: "76f0322f-b14b-4b9b-9665-2121e3b21629") : secret "cert-neutron-public-svc" not found Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.937877 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="45bed047-fbff-439b-b659-657f9b9d3b62" containerName="glance-httpd" probeResult="failure" output="Get \"https://10.217.1.201:9292/healthcheck\": read tcp 10.217.0.2:52564->10.217.1.201:9292: read: connection reset by peer" Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.937877 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="45bed047-fbff-439b-b659-657f9b9d3b62" containerName="glance-log" probeResult="failure" output="Get \"https://10.217.1.201:9292/healthcheck\": read tcp 10.217.0.2:52580->10.217.1.201:9292: read: connection reset by peer" Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.942085 5120 reconciler_common.go:299] "Volume detached for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/c8ccd406-033f-4230-b9a3-357d14ec49f2-nova-metadata-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.942121 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9dde2b26-18b2-469b-94d1-92da183402fc-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.942137 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6jpbm\" (UniqueName: \"kubernetes.io/projected/c8ccd406-033f-4230-b9a3-357d14ec49f2-kube-api-access-6jpbm\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.942149 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9dde2b26-18b2-469b-94d1-92da183402fc-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.942163 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c8ccd406-033f-4230-b9a3-357d14ec49f2-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.942174 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qwxjf\" (UniqueName: \"kubernetes.io/projected/9dde2b26-18b2-469b-94d1-92da183402fc-kube-api-access-qwxjf\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.944942 5120 generic.go:358] "Generic (PLEG): container finished" podID="0156f10b-e51f-4ce8-a414-e6339cd30530" containerID="4feffabf29873c38fc600009dba2873008f7c996513320da07ca2954a6024344" exitCode=0 Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.945320 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.945503 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"0156f10b-e51f-4ce8-a414-e6339cd30530","Type":"ContainerDied","Data":"4feffabf29873c38fc600009dba2873008f7c996513320da07ca2954a6024344"} Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.945664 5120 scope.go:117] "RemoveContainer" containerID="4feffabf29873c38fc600009dba2873008f7c996513320da07ca2954a6024344" Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.946609 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-keystone-listener-7d8dcb56b8-42f9n" podStartSLOduration=5.946588823 podStartE2EDuration="5.946588823s" podCreationTimestamp="2026-03-16 17:08:35 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:08:40.938667675 +0000 UTC m=+5823.092599322" watchObservedRunningTime="2026-03-16 17:08:40.946588823 +0000 UTC m=+5823.100520480" Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.952740 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9dde2b26-18b2-469b-94d1-92da183402fc-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "9dde2b26-18b2-469b-94d1-92da183402fc" (UID: "9dde2b26-18b2-469b-94d1-92da183402fc"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.967644 5120 generic.go:358] "Generic (PLEG): container finished" podID="9dde2b26-18b2-469b-94d1-92da183402fc" containerID="826523d22c0f17610c94f5ab82fd83f348513fd8f4f1dac94cefc1a9fb7f997c" exitCode=0 Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.967817 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"9dde2b26-18b2-469b-94d1-92da183402fc","Type":"ContainerDied","Data":"826523d22c0f17610c94f5ab82fd83f348513fd8f4f1dac94cefc1a9fb7f997c"} Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.967845 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"9dde2b26-18b2-469b-94d1-92da183402fc","Type":"ContainerDied","Data":"41486997eb501731865b0a3d4dcf07f4ab8bc484d2bf5a2039cc2a2d618e283b"} Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.967866 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:08:40 crc kubenswrapper[5120]: I0316 17:08:40.975350 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9dde2b26-18b2-469b-94d1-92da183402fc-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "9dde2b26-18b2-469b-94d1-92da183402fc" (UID: "9dde2b26-18b2-469b-94d1-92da183402fc"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.002565 5120 generic.go:358] "Generic (PLEG): container finished" podID="c8ccd406-033f-4230-b9a3-357d14ec49f2" containerID="6a7c746793e3f12759628d71fa2a4ada61abd83c18eff2afb39b04da6a35153f" exitCode=0 Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.002798 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"c8ccd406-033f-4230-b9a3-357d14ec49f2","Type":"ContainerDied","Data":"6a7c746793e3f12759628d71fa2a4ada61abd83c18eff2afb39b04da6a35153f"} Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.002834 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"c8ccd406-033f-4230-b9a3-357d14ec49f2","Type":"ContainerDied","Data":"47d6068a3a6618e91c820a81c5f5a592757970099237dd3acbf0356c24102cc9"} Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.002914 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.010474 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.042718 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c8ccd406-033f-4230-b9a3-357d14ec49f2-config-data" (OuterVolumeSpecName: "config-data") pod "c8ccd406-033f-4230-b9a3-357d14ec49f2" (UID: "c8ccd406-033f-4230-b9a3-357d14ec49f2"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.044376 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstackclient" podStartSLOduration=6.044358574 podStartE2EDuration="6.044358574s" podCreationTimestamp="2026-03-16 17:08:35 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:08:40.972548101 +0000 UTC m=+5823.126479858" watchObservedRunningTime="2026-03-16 17:08:41.044358574 +0000 UTC m=+5823.198290241" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.045316 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cxsqw\" (UniqueName: \"kubernetes.io/projected/0156f10b-e51f-4ce8-a414-e6339cd30530-kube-api-access-cxsqw\") pod \"0156f10b-e51f-4ce8-a414-e6339cd30530\" (UID: \"0156f10b-e51f-4ce8-a414-e6339cd30530\") " Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.045582 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0156f10b-e51f-4ce8-a414-e6339cd30530-scripts\") pod \"0156f10b-e51f-4ce8-a414-e6339cd30530\" (UID: \"0156f10b-e51f-4ce8-a414-e6339cd30530\") " Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.045703 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0156f10b-e51f-4ce8-a414-e6339cd30530-config-data\") pod \"0156f10b-e51f-4ce8-a414-e6339cd30530\" (UID: \"0156f10b-e51f-4ce8-a414-e6339cd30530\") " Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.046029 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/0156f10b-e51f-4ce8-a414-e6339cd30530-internal-tls-certs\") pod \"0156f10b-e51f-4ce8-a414-e6339cd30530\" (UID: \"0156f10b-e51f-4ce8-a414-e6339cd30530\") " Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.046114 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0156f10b-e51f-4ce8-a414-e6339cd30530-logs\") pod \"0156f10b-e51f-4ce8-a414-e6339cd30530\" (UID: \"0156f10b-e51f-4ce8-a414-e6339cd30530\") " Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.046149 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/0156f10b-e51f-4ce8-a414-e6339cd30530-config-data-custom\") pod \"0156f10b-e51f-4ce8-a414-e6339cd30530\" (UID: \"0156f10b-e51f-4ce8-a414-e6339cd30530\") " Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.046287 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/0156f10b-e51f-4ce8-a414-e6339cd30530-public-tls-certs\") pod \"0156f10b-e51f-4ce8-a414-e6339cd30530\" (UID: \"0156f10b-e51f-4ce8-a414-e6339cd30530\") " Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.046463 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/0156f10b-e51f-4ce8-a414-e6339cd30530-etc-machine-id\") pod \"0156f10b-e51f-4ce8-a414-e6339cd30530\" (UID: \"0156f10b-e51f-4ce8-a414-e6339cd30530\") " Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.046527 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0156f10b-e51f-4ce8-a414-e6339cd30530-combined-ca-bundle\") pod \"0156f10b-e51f-4ce8-a414-e6339cd30530\" (UID: \"0156f10b-e51f-4ce8-a414-e6339cd30530\") " Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.057352 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-d7c955d94-2dfzr"] Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.058699 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-d7c955d94-2dfzr" podUID="06ad2651-812c-46f9-b42d-f893b573e5c5" containerName="barbican-keystone-listener-log" containerID="cri-o://8a188b7110c5836b7c80b00c9cf9f7a20f0d97e16acf0ffdf1aec16c43c6d210" gracePeriod=30 Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.062260 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-worker-6f95f9d4f9-4kmmn" podStartSLOduration=6.062245809 podStartE2EDuration="6.062245809s" podCreationTimestamp="2026-03-16 17:08:35 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:08:41.001370576 +0000 UTC m=+5823.155302233" watchObservedRunningTime="2026-03-16 17:08:41.062245809 +0000 UTC m=+5823.216177466" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.066564 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0156f10b-e51f-4ce8-a414-e6339cd30530-logs" (OuterVolumeSpecName: "logs") pod "0156f10b-e51f-4ce8-a414-e6339cd30530" (UID: "0156f10b-e51f-4ce8-a414-e6339cd30530"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.066707 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-d7c955d94-2dfzr" podUID="06ad2651-812c-46f9-b42d-f893b573e5c5" containerName="barbican-keystone-listener" containerID="cri-o://f0dafd0b50f382fac206fc5965f0bc433fa364c9262cb0c2312ba18c24331e5e" gracePeriod=30 Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.066968 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/0156f10b-e51f-4ce8-a414-e6339cd30530-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "0156f10b-e51f-4ce8-a414-e6339cd30530" (UID: "0156f10b-e51f-4ce8-a414-e6339cd30530"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.070533 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.070970 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.071033 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/a96c9fab-fbd4-459d-90a5-ca103703bfc9-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"a96c9fab-fbd4-459d-90a5-ca103703bfc9\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.071316 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/a96c9fab-fbd4-459d-90a5-ca103703bfc9-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"a96c9fab-fbd4-459d-90a5-ca103703bfc9\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.071603 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/9dde2b26-18b2-469b-94d1-92da183402fc-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.071628 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/9dde2b26-18b2-469b-94d1-92da183402fc-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.071641 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0156f10b-e51f-4ce8-a414-e6339cd30530-logs\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.071654 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c8ccd406-033f-4230-b9a3-357d14ec49f2-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.071668 5120 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/0156f10b-e51f-4ce8-a414-e6339cd30530-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:41 crc kubenswrapper[5120]: E0316 17:08:41.073791 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-nova-novncproxy-cell1-public-svc: secret "cert-nova-novncproxy-cell1-public-svc" not found Mar 16 17:08:41 crc kubenswrapper[5120]: E0316 17:08:41.073907 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3-nova-novncproxy-tls-certs podName:eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3 nodeName:}" failed. No retries permitted until 2026-03-16 17:08:43.073856769 +0000 UTC m=+5825.227788436 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "nova-novncproxy-tls-certs" (UniqueName: "kubernetes.io/secret/eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3-nova-novncproxy-tls-certs") pod "nova-cell1-novncproxy-0" (UID: "eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3") : secret "cert-nova-novncproxy-cell1-public-svc" not found Mar 16 17:08:41 crc kubenswrapper[5120]: E0316 17:08:41.074721 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-nova-novncproxy-cell1-vencrypt: secret "cert-nova-novncproxy-cell1-vencrypt" not found Mar 16 17:08:41 crc kubenswrapper[5120]: E0316 17:08:41.074779 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3-vencrypt-tls-certs podName:eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3 nodeName:}" failed. No retries permitted until 2026-03-16 17:08:43.074768965 +0000 UTC m=+5825.228700622 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "vencrypt-tls-certs" (UniqueName: "kubernetes.io/secret/eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3-vencrypt-tls-certs") pod "nova-cell1-novncproxy-0" (UID: "eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3") : secret "cert-nova-novncproxy-cell1-vencrypt" not found Mar 16 17:08:41 crc kubenswrapper[5120]: E0316 17:08:41.074817 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-ovndbcluster-sb-ovndbs: secret "cert-ovndbcluster-sb-ovndbs" not found Mar 16 17:08:41 crc kubenswrapper[5120]: E0316 17:08:41.074838 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a96c9fab-fbd4-459d-90a5-ca103703bfc9-ovsdbserver-sb-tls-certs podName:a96c9fab-fbd4-459d-90a5-ca103703bfc9 nodeName:}" failed. No retries permitted until 2026-03-16 17:08:43.074832716 +0000 UTC m=+5825.228764363 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "ovsdbserver-sb-tls-certs" (UniqueName: "kubernetes.io/secret/a96c9fab-fbd4-459d-90a5-ca103703bfc9-ovsdbserver-sb-tls-certs") pod "ovsdbserver-sb-0" (UID: "a96c9fab-fbd4-459d-90a5-ca103703bfc9") : secret "cert-ovndbcluster-sb-ovndbs" not found Mar 16 17:08:41 crc kubenswrapper[5120]: E0316 17:08:41.074913 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-ovn-metrics: secret "cert-ovn-metrics" not found Mar 16 17:08:41 crc kubenswrapper[5120]: E0316 17:08:41.074984 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a96c9fab-fbd4-459d-90a5-ca103703bfc9-metrics-certs-tls-certs podName:a96c9fab-fbd4-459d-90a5-ca103703bfc9 nodeName:}" failed. No retries permitted until 2026-03-16 17:08:43.07496292 +0000 UTC m=+5825.228894627 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs-tls-certs" (UniqueName: "kubernetes.io/secret/a96c9fab-fbd4-459d-90a5-ca103703bfc9-metrics-certs-tls-certs") pod "ovsdbserver-sb-0" (UID: "a96c9fab-fbd4-459d-90a5-ca103703bfc9") : secret "cert-ovn-metrics" not found Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.078271 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0156f10b-e51f-4ce8-a414-e6339cd30530-scripts" (OuterVolumeSpecName: "scripts") pod "0156f10b-e51f-4ce8-a414-e6339cd30530" (UID: "0156f10b-e51f-4ce8-a414-e6339cd30530"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.078996 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0156f10b-e51f-4ce8-a414-e6339cd30530-kube-api-access-cxsqw" (OuterVolumeSpecName: "kube-api-access-cxsqw") pod "0156f10b-e51f-4ce8-a414-e6339cd30530" (UID: "0156f10b-e51f-4ce8-a414-e6339cd30530"). InnerVolumeSpecName "kube-api-access-cxsqw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.087840 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-9f6dcd6cf-pldhd"] Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.088195 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-9f6dcd6cf-pldhd" podUID="7590c7f4-950a-41b1-889b-359a9a608f4f" containerName="barbican-worker-log" containerID="cri-o://61ae3e8283d26fa6d34d7ac17f4f91382d53380682cb2f4fdfec75d30675e77c" gracePeriod=30 Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.088334 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-9f6dcd6cf-pldhd" podUID="7590c7f4-950a-41b1-889b-359a9a608f4f" containerName="barbican-worker" containerID="cri-o://033fe6dfc023fa648951152496fd38bf04fae7e6660b02f0bb4af884e0f1fe54" gracePeriod=30 Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.089716 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0156f10b-e51f-4ce8-a414-e6339cd30530-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "0156f10b-e51f-4ce8-a414-e6339cd30530" (UID: "0156f10b-e51f-4ce8-a414-e6339cd30530"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.157069 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.173633 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cxsqw\" (UniqueName: \"kubernetes.io/projected/0156f10b-e51f-4ce8-a414-e6339cd30530-kube-api-access-cxsqw\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.173665 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0156f10b-e51f-4ce8-a414-e6339cd30530-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.173676 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/0156f10b-e51f-4ce8-a414-e6339cd30530-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.192269 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.204587 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0156f10b-e51f-4ce8-a414-e6339cd30530-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "0156f10b-e51f-4ce8-a414-e6339cd30530" (UID: "0156f10b-e51f-4ce8-a414-e6339cd30530"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.205020 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0156f10b-e51f-4ce8-a414-e6339cd30530-config-data" (OuterVolumeSpecName: "config-data") pod "0156f10b-e51f-4ce8-a414-e6339cd30530" (UID: "0156f10b-e51f-4ce8-a414-e6339cd30530"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.208921 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0156f10b-e51f-4ce8-a414-e6339cd30530-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "0156f10b-e51f-4ce8-a414-e6339cd30530" (UID: "0156f10b-e51f-4ce8-a414-e6339cd30530"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.215927 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.217297 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0156f10b-e51f-4ce8-a414-e6339cd30530" containerName="cinder-api" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.217325 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="0156f10b-e51f-4ce8-a414-e6339cd30530" containerName="cinder-api" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.217366 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9dde2b26-18b2-469b-94d1-92da183402fc" containerName="nova-api-api" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.217375 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9dde2b26-18b2-469b-94d1-92da183402fc" containerName="nova-api-api" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.217391 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8ccd406-033f-4230-b9a3-357d14ec49f2" containerName="nova-metadata-metadata" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.217399 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8ccd406-033f-4230-b9a3-357d14ec49f2" containerName="nova-metadata-metadata" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.217420 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9dde2b26-18b2-469b-94d1-92da183402fc" containerName="nova-api-log" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.217429 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9dde2b26-18b2-469b-94d1-92da183402fc" containerName="nova-api-log" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.217448 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8ccd406-033f-4230-b9a3-357d14ec49f2" containerName="nova-metadata-log" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.217456 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8ccd406-033f-4230-b9a3-357d14ec49f2" containerName="nova-metadata-log" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.217487 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0156f10b-e51f-4ce8-a414-e6339cd30530" containerName="cinder-api-log" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.217495 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="0156f10b-e51f-4ce8-a414-e6339cd30530" containerName="cinder-api-log" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.217842 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="9dde2b26-18b2-469b-94d1-92da183402fc" containerName="nova-api-log" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.217864 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c8ccd406-033f-4230-b9a3-357d14ec49f2" containerName="nova-metadata-log" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.217880 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="9dde2b26-18b2-469b-94d1-92da183402fc" containerName="nova-api-api" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.217922 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="0156f10b-e51f-4ce8-a414-e6339cd30530" containerName="cinder-api-log" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.217940 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c8ccd406-033f-4230-b9a3-357d14ec49f2" containerName="nova-metadata-metadata" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.217953 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="0156f10b-e51f-4ce8-a414-e6339cd30530" containerName="cinder-api" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.219503 5120 scope.go:117] "RemoveContainer" containerID="0dfc84e67d0d7f257d495c814e97c5fa6984e88ce792fe5da46f735a6735d0dd" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.220601 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0156f10b-e51f-4ce8-a414-e6339cd30530-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "0156f10b-e51f-4ce8-a414-e6339cd30530" (UID: "0156f10b-e51f-4ce8-a414-e6339cd30530"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.226385 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.230517 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-conductor-config-data\"" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.231857 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.275287 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9a997459-37ba-46a9-9cb8-075f77fa009f-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"9a997459-37ba-46a9-9cb8-075f77fa009f\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.279042 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrrl2\" (UniqueName: \"kubernetes.io/projected/9a997459-37ba-46a9-9cb8-075f77fa009f-kube-api-access-zrrl2\") pod \"nova-cell0-conductor-0\" (UID: \"9a997459-37ba-46a9-9cb8-075f77fa009f\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.279691 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9a997459-37ba-46a9-9cb8-075f77fa009f-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"9a997459-37ba-46a9-9cb8-075f77fa009f\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.279742 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/10bd837b-2e0d-460b-a254-20e23b6768f7-memcached-tls-certs\") pod \"memcached-0\" (UID: \"10bd837b-2e0d-460b-a254-20e23b6768f7\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.279872 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0156f10b-e51f-4ce8-a414-e6339cd30530-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.279884 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/0156f10b-e51f-4ce8-a414-e6339cd30530-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.279897 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/0156f10b-e51f-4ce8-a414-e6339cd30530-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.279906 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0156f10b-e51f-4ce8-a414-e6339cd30530-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:41 crc kubenswrapper[5120]: E0316 17:08:41.280273 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-memcached-svc: secret "cert-memcached-svc" not found Mar 16 17:08:41 crc kubenswrapper[5120]: E0316 17:08:41.280327 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10bd837b-2e0d-460b-a254-20e23b6768f7-memcached-tls-certs podName:10bd837b-2e0d-460b-a254-20e23b6768f7 nodeName:}" failed. No retries permitted until 2026-03-16 17:08:43.280312123 +0000 UTC m=+5825.434243770 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "memcached-tls-certs" (UniqueName: "kubernetes.io/secret/10bd837b-2e0d-460b-a254-20e23b6768f7-memcached-tls-certs") pod "memcached-0" (UID: "10bd837b-2e0d-460b-a254-20e23b6768f7") : secret "cert-memcached-svc" not found Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.285580 5120 scope.go:117] "RemoveContainer" containerID="826523d22c0f17610c94f5ab82fd83f348513fd8f4f1dac94cefc1a9fb7f997c" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.300512 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.321364 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.328082 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.359237 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.359277 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.359424 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.379786 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.399124 5120 scope.go:117] "RemoveContainer" containerID="dc6a6cb1197c6dd1f31981da01142c0924c2b5390f63c67e892c9c4f82c3320e" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.400456 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-api-config-data\"" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.400692 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-cinder-public-svc\"" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.400859 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-cinder-internal-svc\"" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.401837 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9a997459-37ba-46a9-9cb8-075f77fa009f-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"9a997459-37ba-46a9-9cb8-075f77fa009f\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.401908 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/cde31df2-efeb-4fee-b565-f24b7eaeff60-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"cde31df2-efeb-4fee-b565-f24b7eaeff60\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.402017 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/cde31df2-efeb-4fee-b565-f24b7eaeff60-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"cde31df2-efeb-4fee-b565-f24b7eaeff60\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.402049 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/45defe5f-ca2f-4993-8430-d713ed1c9df0-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"45defe5f-ca2f-4993-8430-d713ed1c9df0\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.402150 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/45defe5f-ca2f-4993-8430-d713ed1c9df0-config-data\") pod \"cinder-api-0\" (UID: \"45defe5f-ca2f-4993-8430-d713ed1c9df0\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.402310 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zrrl2\" (UniqueName: \"kubernetes.io/projected/9a997459-37ba-46a9-9cb8-075f77fa009f-kube-api-access-zrrl2\") pod \"nova-cell0-conductor-0\" (UID: \"9a997459-37ba-46a9-9cb8-075f77fa009f\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.402340 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/45defe5f-ca2f-4993-8430-d713ed1c9df0-logs\") pod \"cinder-api-0\" (UID: \"45defe5f-ca2f-4993-8430-d713ed1c9df0\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.402439 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69rwg\" (UniqueName: \"kubernetes.io/projected/45defe5f-ca2f-4993-8430-d713ed1c9df0-kube-api-access-69rwg\") pod \"cinder-api-0\" (UID: \"45defe5f-ca2f-4993-8430-d713ed1c9df0\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.402461 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/45defe5f-ca2f-4993-8430-d713ed1c9df0-scripts\") pod \"cinder-api-0\" (UID: \"45defe5f-ca2f-4993-8430-d713ed1c9df0\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.402481 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/45defe5f-ca2f-4993-8430-d713ed1c9df0-etc-machine-id\") pod \"cinder-api-0\" (UID: \"45defe5f-ca2f-4993-8430-d713ed1c9df0\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.402515 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/45defe5f-ca2f-4993-8430-d713ed1c9df0-public-tls-certs\") pod \"cinder-api-0\" (UID: \"45defe5f-ca2f-4993-8430-d713ed1c9df0\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.402587 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/45defe5f-ca2f-4993-8430-d713ed1c9df0-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"45defe5f-ca2f-4993-8430-d713ed1c9df0\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.402650 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/45defe5f-ca2f-4993-8430-d713ed1c9df0-config-data-custom\") pod \"cinder-api-0\" (UID: \"45defe5f-ca2f-4993-8430-d713ed1c9df0\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.402711 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9a997459-37ba-46a9-9cb8-075f77fa009f-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"9a997459-37ba-46a9-9cb8-075f77fa009f\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 17:08:41 crc kubenswrapper[5120]: E0316 17:08:41.402843 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-ovn-metrics: secret "cert-ovn-metrics" not found Mar 16 17:08:41 crc kubenswrapper[5120]: E0316 17:08:41.402904 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cde31df2-efeb-4fee-b565-f24b7eaeff60-metrics-certs-tls-certs podName:cde31df2-efeb-4fee-b565-f24b7eaeff60 nodeName:}" failed. No retries permitted until 2026-03-16 17:08:43.402884088 +0000 UTC m=+5825.556815745 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs-tls-certs" (UniqueName: "kubernetes.io/secret/cde31df2-efeb-4fee-b565-f24b7eaeff60-metrics-certs-tls-certs") pod "ovsdbserver-nb-0" (UID: "cde31df2-efeb-4fee-b565-f24b7eaeff60") : secret "cert-ovn-metrics" not found Mar 16 17:08:41 crc kubenswrapper[5120]: E0316 17:08:41.403197 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-ovndbcluster-nb-ovndbs: secret "cert-ovndbcluster-nb-ovndbs" not found Mar 16 17:08:41 crc kubenswrapper[5120]: E0316 17:08:41.403244 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cde31df2-efeb-4fee-b565-f24b7eaeff60-ovsdbserver-nb-tls-certs podName:cde31df2-efeb-4fee-b565-f24b7eaeff60 nodeName:}" failed. No retries permitted until 2026-03-16 17:08:43.403234419 +0000 UTC m=+5825.557166076 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "ovsdbserver-nb-tls-certs" (UniqueName: "kubernetes.io/secret/cde31df2-efeb-4fee-b565-f24b7eaeff60-ovsdbserver-nb-tls-certs") pod "ovsdbserver-nb-0" (UID: "cde31df2-efeb-4fee-b565-f24b7eaeff60") : secret "cert-ovndbcluster-nb-ovndbs" not found Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.403791 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.412983 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9a997459-37ba-46a9-9cb8-075f77fa009f-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"9a997459-37ba-46a9-9cb8-075f77fa009f\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.435174 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.438141 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9a997459-37ba-46a9-9cb8-075f77fa009f-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"9a997459-37ba-46a9-9cb8-075f77fa009f\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.456885 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrrl2\" (UniqueName: \"kubernetes.io/projected/9a997459-37ba-46a9-9cb8-075f77fa009f-kube-api-access-zrrl2\") pod \"nova-cell0-conductor-0\" (UID: \"9a997459-37ba-46a9-9cb8-075f77fa009f\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.497985 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.504794 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/45defe5f-ca2f-4993-8430-d713ed1c9df0-logs\") pod \"cinder-api-0\" (UID: \"45defe5f-ca2f-4993-8430-d713ed1c9df0\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.505619 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/45defe5f-ca2f-4993-8430-d713ed1c9df0-logs\") pod \"cinder-api-0\" (UID: \"45defe5f-ca2f-4993-8430-d713ed1c9df0\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.507165 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-69rwg\" (UniqueName: \"kubernetes.io/projected/45defe5f-ca2f-4993-8430-d713ed1c9df0-kube-api-access-69rwg\") pod \"cinder-api-0\" (UID: \"45defe5f-ca2f-4993-8430-d713ed1c9df0\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.507959 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/45defe5f-ca2f-4993-8430-d713ed1c9df0-scripts\") pod \"cinder-api-0\" (UID: \"45defe5f-ca2f-4993-8430-d713ed1c9df0\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.508747 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/45defe5f-ca2f-4993-8430-d713ed1c9df0-etc-machine-id\") pod \"cinder-api-0\" (UID: \"45defe5f-ca2f-4993-8430-d713ed1c9df0\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.508893 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/45defe5f-ca2f-4993-8430-d713ed1c9df0-public-tls-certs\") pod \"cinder-api-0\" (UID: \"45defe5f-ca2f-4993-8430-d713ed1c9df0\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.508992 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/45defe5f-ca2f-4993-8430-d713ed1c9df0-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"45defe5f-ca2f-4993-8430-d713ed1c9df0\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.509096 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/45defe5f-ca2f-4993-8430-d713ed1c9df0-config-data-custom\") pod \"cinder-api-0\" (UID: \"45defe5f-ca2f-4993-8430-d713ed1c9df0\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.509470 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/45defe5f-ca2f-4993-8430-d713ed1c9df0-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"45defe5f-ca2f-4993-8430-d713ed1c9df0\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.509604 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/45defe5f-ca2f-4993-8430-d713ed1c9df0-config-data\") pod \"cinder-api-0\" (UID: \"45defe5f-ca2f-4993-8430-d713ed1c9df0\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.508815 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/45defe5f-ca2f-4993-8430-d713ed1c9df0-etc-machine-id\") pod \"cinder-api-0\" (UID: \"45defe5f-ca2f-4993-8430-d713ed1c9df0\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:08:41 crc kubenswrapper[5120]: E0316 17:08:41.509850 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-cinder-internal-svc: secret "cert-cinder-internal-svc" not found Mar 16 17:08:41 crc kubenswrapper[5120]: E0316 17:08:41.509883 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-cinder-public-svc: secret "cert-cinder-public-svc" not found Mar 16 17:08:41 crc kubenswrapper[5120]: E0316 17:08:41.510601 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45defe5f-ca2f-4993-8430-d713ed1c9df0-public-tls-certs podName:45defe5f-ca2f-4993-8430-d713ed1c9df0 nodeName:}" failed. No retries permitted until 2026-03-16 17:08:42.010582204 +0000 UTC m=+5824.164513861 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/45defe5f-ca2f-4993-8430-d713ed1c9df0-public-tls-certs") pod "cinder-api-0" (UID: "45defe5f-ca2f-4993-8430-d713ed1c9df0") : secret "cert-cinder-public-svc" not found Mar 16 17:08:41 crc kubenswrapper[5120]: E0316 17:08:41.511177 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45defe5f-ca2f-4993-8430-d713ed1c9df0-internal-tls-certs podName:45defe5f-ca2f-4993-8430-d713ed1c9df0 nodeName:}" failed. No retries permitted until 2026-03-16 17:08:42.01116268 +0000 UTC m=+5824.165094337 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/45defe5f-ca2f-4993-8430-d713ed1c9df0-internal-tls-certs") pod "cinder-api-0" (UID: "45defe5f-ca2f-4993-8430-d713ed1c9df0") : secret "cert-cinder-internal-svc" not found Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.511233 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.557026 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-69rwg\" (UniqueName: \"kubernetes.io/projected/45defe5f-ca2f-4993-8430-d713ed1c9df0-kube-api-access-69rwg\") pod \"cinder-api-0\" (UID: \"45defe5f-ca2f-4993-8430-d713ed1c9df0\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.558543 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/45defe5f-ca2f-4993-8430-d713ed1c9df0-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"45defe5f-ca2f-4993-8430-d713ed1c9df0\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.559920 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/45defe5f-ca2f-4993-8430-d713ed1c9df0-config-data\") pod \"cinder-api-0\" (UID: \"45defe5f-ca2f-4993-8430-d713ed1c9df0\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.567096 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/45defe5f-ca2f-4993-8430-d713ed1c9df0-config-data-custom\") pod \"cinder-api-0\" (UID: \"45defe5f-ca2f-4993-8430-d713ed1c9df0\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.567440 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/45defe5f-ca2f-4993-8430-d713ed1c9df0-scripts\") pod \"cinder-api-0\" (UID: \"45defe5f-ca2f-4993-8430-d713ed1c9df0\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.568300 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.571140 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-internal-svc\"" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.571347 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-config-data\"" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.571495 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-public-svc\"" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.590242 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.616546 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/69bb2342-14e1-4c32-889a-e33f6ba42651-logs\") pod \"nova-api-0\" (UID: \"69bb2342-14e1-4c32-889a-e33f6ba42651\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.616613 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77mk6\" (UniqueName: \"kubernetes.io/projected/69bb2342-14e1-4c32-889a-e33f6ba42651-kube-api-access-77mk6\") pod \"nova-api-0\" (UID: \"69bb2342-14e1-4c32-889a-e33f6ba42651\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.617114 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/69bb2342-14e1-4c32-889a-e33f6ba42651-internal-tls-certs\") pod \"nova-api-0\" (UID: \"69bb2342-14e1-4c32-889a-e33f6ba42651\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.617328 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/69bb2342-14e1-4c32-889a-e33f6ba42651-public-tls-certs\") pod \"nova-api-0\" (UID: \"69bb2342-14e1-4c32-889a-e33f6ba42651\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.617371 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/69bb2342-14e1-4c32-889a-e33f6ba42651-config-data\") pod \"nova-api-0\" (UID: \"69bb2342-14e1-4c32-889a-e33f6ba42651\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.617597 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/69bb2342-14e1-4c32-889a-e33f6ba42651-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"69bb2342-14e1-4c32-889a-e33f6ba42651\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.617883 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.636372 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.640030 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-metadata-internal-svc\"" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.640745 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-metadata-config-data\"" Mar 16 17:08:41 crc kubenswrapper[5120]: E0316 17:08:41.651579 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="aa472661815dedb1608725d2fbfcc5a464730a1bf9356da21f6903148c5bd7dd" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 17:08:41 crc kubenswrapper[5120]: E0316 17:08:41.655680 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="aa472661815dedb1608725d2fbfcc5a464730a1bf9356da21f6903148c5bd7dd" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.659183 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 17:08:41 crc kubenswrapper[5120]: E0316 17:08:41.662433 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="aa472661815dedb1608725d2fbfcc5a464730a1bf9356da21f6903148c5bd7dd" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 17:08:41 crc kubenswrapper[5120]: E0316 17:08:41.662511 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="0205947a-d88b-45b3-8dfb-67965e155ab7" containerName="nova-scheduler-scheduler" probeResult="unknown" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.677400 5120 scope.go:117] "RemoveContainer" containerID="826523d22c0f17610c94f5ab82fd83f348513fd8f4f1dac94cefc1a9fb7f997c" Mar 16 17:08:41 crc kubenswrapper[5120]: E0316 17:08:41.679101 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"826523d22c0f17610c94f5ab82fd83f348513fd8f4f1dac94cefc1a9fb7f997c\": container with ID starting with 826523d22c0f17610c94f5ab82fd83f348513fd8f4f1dac94cefc1a9fb7f997c not found: ID does not exist" containerID="826523d22c0f17610c94f5ab82fd83f348513fd8f4f1dac94cefc1a9fb7f997c" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.679211 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"826523d22c0f17610c94f5ab82fd83f348513fd8f4f1dac94cefc1a9fb7f997c"} err="failed to get container status \"826523d22c0f17610c94f5ab82fd83f348513fd8f4f1dac94cefc1a9fb7f997c\": rpc error: code = NotFound desc = could not find container \"826523d22c0f17610c94f5ab82fd83f348513fd8f4f1dac94cefc1a9fb7f997c\": container with ID starting with 826523d22c0f17610c94f5ab82fd83f348513fd8f4f1dac94cefc1a9fb7f997c not found: ID does not exist" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.679317 5120 scope.go:117] "RemoveContainer" containerID="dc6a6cb1197c6dd1f31981da01142c0924c2b5390f63c67e892c9c4f82c3320e" Mar 16 17:08:41 crc kubenswrapper[5120]: E0316 17:08:41.683149 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc6a6cb1197c6dd1f31981da01142c0924c2b5390f63c67e892c9c4f82c3320e\": container with ID starting with dc6a6cb1197c6dd1f31981da01142c0924c2b5390f63c67e892c9c4f82c3320e not found: ID does not exist" containerID="dc6a6cb1197c6dd1f31981da01142c0924c2b5390f63c67e892c9c4f82c3320e" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.683290 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc6a6cb1197c6dd1f31981da01142c0924c2b5390f63c67e892c9c4f82c3320e"} err="failed to get container status \"dc6a6cb1197c6dd1f31981da01142c0924c2b5390f63c67e892c9c4f82c3320e\": rpc error: code = NotFound desc = could not find container \"dc6a6cb1197c6dd1f31981da01142c0924c2b5390f63c67e892c9c4f82c3320e\": container with ID starting with dc6a6cb1197c6dd1f31981da01142c0924c2b5390f63c67e892c9c4f82c3320e not found: ID does not exist" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.683403 5120 scope.go:117] "RemoveContainer" containerID="6a7c746793e3f12759628d71fa2a4ada61abd83c18eff2afb39b04da6a35153f" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.716088 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.719140 5120 scope.go:117] "RemoveContainer" containerID="9148b8c5f1c6856439d0eefe2fbe6ed8be889376dd71647351caecf518bbe7e2" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.721284 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48r92\" (UniqueName: \"kubernetes.io/projected/f39a0edc-bfc5-400a-ad5e-4c83f2065778-kube-api-access-48r92\") pod \"nova-metadata-0\" (UID: \"f39a0edc-bfc5-400a-ad5e-4c83f2065778\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.721727 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/69bb2342-14e1-4c32-889a-e33f6ba42651-internal-tls-certs\") pod \"nova-api-0\" (UID: \"69bb2342-14e1-4c32-889a-e33f6ba42651\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:08:41 crc kubenswrapper[5120]: E0316 17:08:41.723223 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-nova-internal-svc: secret "cert-nova-internal-svc" not found Mar 16 17:08:41 crc kubenswrapper[5120]: E0316 17:08:41.723294 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69bb2342-14e1-4c32-889a-e33f6ba42651-internal-tls-certs podName:69bb2342-14e1-4c32-889a-e33f6ba42651 nodeName:}" failed. No retries permitted until 2026-03-16 17:08:42.223276889 +0000 UTC m=+5824.377208546 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/69bb2342-14e1-4c32-889a-e33f6ba42651-internal-tls-certs") pod "nova-api-0" (UID: "69bb2342-14e1-4c32-889a-e33f6ba42651") : secret "cert-nova-internal-svc" not found Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.723350 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/f39a0edc-bfc5-400a-ad5e-4c83f2065778-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"f39a0edc-bfc5-400a-ad5e-4c83f2065778\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.723398 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f39a0edc-bfc5-400a-ad5e-4c83f2065778-config-data\") pod \"nova-metadata-0\" (UID: \"f39a0edc-bfc5-400a-ad5e-4c83f2065778\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.723470 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/69bb2342-14e1-4c32-889a-e33f6ba42651-public-tls-certs\") pod \"nova-api-0\" (UID: \"69bb2342-14e1-4c32-889a-e33f6ba42651\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.723530 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/69bb2342-14e1-4c32-889a-e33f6ba42651-config-data\") pod \"nova-api-0\" (UID: \"69bb2342-14e1-4c32-889a-e33f6ba42651\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:08:41 crc kubenswrapper[5120]: E0316 17:08:41.723547 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-nova-public-svc: secret "cert-nova-public-svc" not found Mar 16 17:08:41 crc kubenswrapper[5120]: E0316 17:08:41.723667 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69bb2342-14e1-4c32-889a-e33f6ba42651-public-tls-certs podName:69bb2342-14e1-4c32-889a-e33f6ba42651 nodeName:}" failed. No retries permitted until 2026-03-16 17:08:42.223649649 +0000 UTC m=+5824.377581316 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/69bb2342-14e1-4c32-889a-e33f6ba42651-public-tls-certs") pod "nova-api-0" (UID: "69bb2342-14e1-4c32-889a-e33f6ba42651") : secret "cert-nova-public-svc" not found Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.723958 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f39a0edc-bfc5-400a-ad5e-4c83f2065778-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"f39a0edc-bfc5-400a-ad5e-4c83f2065778\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.724177 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f39a0edc-bfc5-400a-ad5e-4c83f2065778-logs\") pod \"nova-metadata-0\" (UID: \"f39a0edc-bfc5-400a-ad5e-4c83f2065778\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.724247 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/69bb2342-14e1-4c32-889a-e33f6ba42651-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"69bb2342-14e1-4c32-889a-e33f6ba42651\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.725448 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/69bb2342-14e1-4c32-889a-e33f6ba42651-logs\") pod \"nova-api-0\" (UID: \"69bb2342-14e1-4c32-889a-e33f6ba42651\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.726633 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/69bb2342-14e1-4c32-889a-e33f6ba42651-logs\") pod \"nova-api-0\" (UID: \"69bb2342-14e1-4c32-889a-e33f6ba42651\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.725486 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-77mk6\" (UniqueName: \"kubernetes.io/projected/69bb2342-14e1-4c32-889a-e33f6ba42651-kube-api-access-77mk6\") pod \"nova-api-0\" (UID: \"69bb2342-14e1-4c32-889a-e33f6ba42651\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.731784 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/69bb2342-14e1-4c32-889a-e33f6ba42651-config-data\") pod \"nova-api-0\" (UID: \"69bb2342-14e1-4c32-889a-e33f6ba42651\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.744538 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/69bb2342-14e1-4c32-889a-e33f6ba42651-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"69bb2342-14e1-4c32-889a-e33f6ba42651\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.749636 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-77mk6\" (UniqueName: \"kubernetes.io/projected/69bb2342-14e1-4c32-889a-e33f6ba42651-kube-api-access-77mk6\") pod \"nova-api-0\" (UID: \"69bb2342-14e1-4c32-889a-e33f6ba42651\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.776001 5120 scope.go:117] "RemoveContainer" containerID="6a7c746793e3f12759628d71fa2a4ada61abd83c18eff2afb39b04da6a35153f" Mar 16 17:08:41 crc kubenswrapper[5120]: E0316 17:08:41.776957 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a7c746793e3f12759628d71fa2a4ada61abd83c18eff2afb39b04da6a35153f\": container with ID starting with 6a7c746793e3f12759628d71fa2a4ada61abd83c18eff2afb39b04da6a35153f not found: ID does not exist" containerID="6a7c746793e3f12759628d71fa2a4ada61abd83c18eff2afb39b04da6a35153f" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.776985 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a7c746793e3f12759628d71fa2a4ada61abd83c18eff2afb39b04da6a35153f"} err="failed to get container status \"6a7c746793e3f12759628d71fa2a4ada61abd83c18eff2afb39b04da6a35153f\": rpc error: code = NotFound desc = could not find container \"6a7c746793e3f12759628d71fa2a4ada61abd83c18eff2afb39b04da6a35153f\": container with ID starting with 6a7c746793e3f12759628d71fa2a4ada61abd83c18eff2afb39b04da6a35153f not found: ID does not exist" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.777005 5120 scope.go:117] "RemoveContainer" containerID="9148b8c5f1c6856439d0eefe2fbe6ed8be889376dd71647351caecf518bbe7e2" Mar 16 17:08:41 crc kubenswrapper[5120]: E0316 17:08:41.780924 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9148b8c5f1c6856439d0eefe2fbe6ed8be889376dd71647351caecf518bbe7e2\": container with ID starting with 9148b8c5f1c6856439d0eefe2fbe6ed8be889376dd71647351caecf518bbe7e2 not found: ID does not exist" containerID="9148b8c5f1c6856439d0eefe2fbe6ed8be889376dd71647351caecf518bbe7e2" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.780966 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9148b8c5f1c6856439d0eefe2fbe6ed8be889376dd71647351caecf518bbe7e2"} err="failed to get container status \"9148b8c5f1c6856439d0eefe2fbe6ed8be889376dd71647351caecf518bbe7e2\": rpc error: code = NotFound desc = could not find container \"9148b8c5f1c6856439d0eefe2fbe6ed8be889376dd71647351caecf518bbe7e2\": container with ID starting with 9148b8c5f1c6856439d0eefe2fbe6ed8be889376dd71647351caecf518bbe7e2 not found: ID does not exist" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.830908 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/45bed047-fbff-439b-b659-657f9b9d3b62-config-data\") pod \"45bed047-fbff-439b-b659-657f9b9d3b62\" (UID: \"45bed047-fbff-439b-b659-657f9b9d3b62\") " Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.833105 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/45bed047-fbff-439b-b659-657f9b9d3b62-scripts\") pod \"45bed047-fbff-439b-b659-657f9b9d3b62\" (UID: \"45bed047-fbff-439b-b659-657f9b9d3b62\") " Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.833307 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"45bed047-fbff-439b-b659-657f9b9d3b62\" (UID: \"45bed047-fbff-439b-b659-657f9b9d3b62\") " Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.834095 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7vnqs\" (UniqueName: \"kubernetes.io/projected/45bed047-fbff-439b-b659-657f9b9d3b62-kube-api-access-7vnqs\") pod \"45bed047-fbff-439b-b659-657f9b9d3b62\" (UID: \"45bed047-fbff-439b-b659-657f9b9d3b62\") " Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.834516 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/45bed047-fbff-439b-b659-657f9b9d3b62-combined-ca-bundle\") pod \"45bed047-fbff-439b-b659-657f9b9d3b62\" (UID: \"45bed047-fbff-439b-b659-657f9b9d3b62\") " Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.834812 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/45bed047-fbff-439b-b659-657f9b9d3b62-logs\") pod \"45bed047-fbff-439b-b659-657f9b9d3b62\" (UID: \"45bed047-fbff-439b-b659-657f9b9d3b62\") " Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.834945 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/45bed047-fbff-439b-b659-657f9b9d3b62-public-tls-certs\") pod \"45bed047-fbff-439b-b659-657f9b9d3b62\" (UID: \"45bed047-fbff-439b-b659-657f9b9d3b62\") " Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.835341 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45bed047-fbff-439b-b659-657f9b9d3b62-logs" (OuterVolumeSpecName: "logs") pod "45bed047-fbff-439b-b659-657f9b9d3b62" (UID: "45bed047-fbff-439b-b659-657f9b9d3b62"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.836124 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/45bed047-fbff-439b-b659-657f9b9d3b62-httpd-run\") pod \"45bed047-fbff-439b-b659-657f9b9d3b62\" (UID: \"45bed047-fbff-439b-b659-657f9b9d3b62\") " Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.837542 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/f39a0edc-bfc5-400a-ad5e-4c83f2065778-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"f39a0edc-bfc5-400a-ad5e-4c83f2065778\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.837902 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f39a0edc-bfc5-400a-ad5e-4c83f2065778-config-data\") pod \"nova-metadata-0\" (UID: \"f39a0edc-bfc5-400a-ad5e-4c83f2065778\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.837974 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45bed047-fbff-439b-b659-657f9b9d3b62-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "45bed047-fbff-439b-b659-657f9b9d3b62" (UID: "45bed047-fbff-439b-b659-657f9b9d3b62"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.839683 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45bed047-fbff-439b-b659-657f9b9d3b62-scripts" (OuterVolumeSpecName: "scripts") pod "45bed047-fbff-439b-b659-657f9b9d3b62" (UID: "45bed047-fbff-439b-b659-657f9b9d3b62"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.840540 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45bed047-fbff-439b-b659-657f9b9d3b62-kube-api-access-7vnqs" (OuterVolumeSpecName: "kube-api-access-7vnqs") pod "45bed047-fbff-439b-b659-657f9b9d3b62" (UID: "45bed047-fbff-439b-b659-657f9b9d3b62"). InnerVolumeSpecName "kube-api-access-7vnqs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.840702 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f39a0edc-bfc5-400a-ad5e-4c83f2065778-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"f39a0edc-bfc5-400a-ad5e-4c83f2065778\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.840871 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f39a0edc-bfc5-400a-ad5e-4c83f2065778-logs\") pod \"nova-metadata-0\" (UID: \"f39a0edc-bfc5-400a-ad5e-4c83f2065778\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.841367 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f39a0edc-bfc5-400a-ad5e-4c83f2065778-logs\") pod \"nova-metadata-0\" (UID: \"f39a0edc-bfc5-400a-ad5e-4c83f2065778\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.841574 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/1f26bb19-36e1-4611-8fef-a2b16661b9f1-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"1f26bb19-36e1-4611-8fef-a2b16661b9f1\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.841704 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-48r92\" (UniqueName: \"kubernetes.io/projected/f39a0edc-bfc5-400a-ad5e-4c83f2065778-kube-api-access-48r92\") pod \"nova-metadata-0\" (UID: \"f39a0edc-bfc5-400a-ad5e-4c83f2065778\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.841995 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7vnqs\" (UniqueName: \"kubernetes.io/projected/45bed047-fbff-439b-b659-657f9b9d3b62-kube-api-access-7vnqs\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.842012 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/45bed047-fbff-439b-b659-657f9b9d3b62-logs\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.842021 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/45bed047-fbff-439b-b659-657f9b9d3b62-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.842036 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/45bed047-fbff-439b-b659-657f9b9d3b62-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:41 crc kubenswrapper[5120]: E0316 17:08:41.842412 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-galera-openstack-cell1-svc: secret "cert-galera-openstack-cell1-svc" not found Mar 16 17:08:41 crc kubenswrapper[5120]: E0316 17:08:41.842459 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f26bb19-36e1-4611-8fef-a2b16661b9f1-galera-tls-certs podName:1f26bb19-36e1-4611-8fef-a2b16661b9f1 nodeName:}" failed. No retries permitted until 2026-03-16 17:08:43.842445771 +0000 UTC m=+5825.996377428 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "galera-tls-certs" (UniqueName: "kubernetes.io/secret/1f26bb19-36e1-4611-8fef-a2b16661b9f1-galera-tls-certs") pod "openstack-cell1-galera-0" (UID: "1f26bb19-36e1-4611-8fef-a2b16661b9f1") : secret "cert-galera-openstack-cell1-svc" not found Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.845214 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/f39a0edc-bfc5-400a-ad5e-4c83f2065778-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"f39a0edc-bfc5-400a-ad5e-4c83f2065778\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.845226 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f39a0edc-bfc5-400a-ad5e-4c83f2065778-config-data\") pod \"nova-metadata-0\" (UID: \"f39a0edc-bfc5-400a-ad5e-4c83f2065778\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.846737 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f39a0edc-bfc5-400a-ad5e-4c83f2065778-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"f39a0edc-bfc5-400a-ad5e-4c83f2065778\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.853387 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage05-crc" (OuterVolumeSpecName: "glance") pod "45bed047-fbff-439b-b659-657f9b9d3b62" (UID: "45bed047-fbff-439b-b659-657f9b9d3b62"). InnerVolumeSpecName "local-storage05-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.859134 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-48r92\" (UniqueName: \"kubernetes.io/projected/f39a0edc-bfc5-400a-ad5e-4c83f2065778-kube-api-access-48r92\") pod \"nova-metadata-0\" (UID: \"f39a0edc-bfc5-400a-ad5e-4c83f2065778\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.889367 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45bed047-fbff-439b-b659-657f9b9d3b62-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "45bed047-fbff-439b-b659-657f9b9d3b62" (UID: "45bed047-fbff-439b-b659-657f9b9d3b62"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.904073 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45bed047-fbff-439b-b659-657f9b9d3b62-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "45bed047-fbff-439b-b659-657f9b9d3b62" (UID: "45bed047-fbff-439b-b659-657f9b9d3b62"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.908684 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45bed047-fbff-439b-b659-657f9b9d3b62-config-data" (OuterVolumeSpecName: "config-data") pod "45bed047-fbff-439b-b659-657f9b9d3b62" (UID: "45bed047-fbff-439b-b659-657f9b9d3b62"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.945043 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/ab5d1889-4b15-4b9d-92fb-838a10dc858f-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"ab5d1889-4b15-4b9d-92fb-838a10dc858f\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:08:41 crc kubenswrapper[5120]: E0316 17:08:41.945228 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-galera-openstack-svc: secret "cert-galera-openstack-svc" not found Mar 16 17:08:41 crc kubenswrapper[5120]: E0316 17:08:41.945333 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab5d1889-4b15-4b9d-92fb-838a10dc858f-galera-tls-certs podName:ab5d1889-4b15-4b9d-92fb-838a10dc858f nodeName:}" failed. No retries permitted until 2026-03-16 17:08:43.945301003 +0000 UTC m=+5826.099232660 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "galera-tls-certs" (UniqueName: "kubernetes.io/secret/ab5d1889-4b15-4b9d-92fb-838a10dc858f-galera-tls-certs") pod "openstack-galera-0" (UID: "ab5d1889-4b15-4b9d-92fb-838a10dc858f") : secret "cert-galera-openstack-svc" not found Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.946394 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/45bed047-fbff-439b-b659-657f9b9d3b62-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.946449 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") on node \"crc\" " Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.946467 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/45bed047-fbff-439b-b659-657f9b9d3b62-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.946482 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/45bed047-fbff-439b-b659-657f9b9d3b62-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:41 crc kubenswrapper[5120]: I0316 17:08:41.973533 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage05-crc" (UniqueName: "kubernetes.io/local-volume/local-storage05-crc") on node "crc" Mar 16 17:08:42 crc kubenswrapper[5120]: I0316 17:08:42.019436 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:08:42 crc kubenswrapper[5120]: I0316 17:08:42.042612 5120 generic.go:358] "Generic (PLEG): container finished" podID="7590c7f4-950a-41b1-889b-359a9a608f4f" containerID="61ae3e8283d26fa6d34d7ac17f4f91382d53380682cb2f4fdfec75d30675e77c" exitCode=143 Mar 16 17:08:42 crc kubenswrapper[5120]: I0316 17:08:42.042746 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-9f6dcd6cf-pldhd" event={"ID":"7590c7f4-950a-41b1-889b-359a9a608f4f","Type":"ContainerDied","Data":"61ae3e8283d26fa6d34d7ac17f4f91382d53380682cb2f4fdfec75d30675e77c"} Mar 16 17:08:42 crc kubenswrapper[5120]: I0316 17:08:42.048503 5120 generic.go:358] "Generic (PLEG): container finished" podID="6ff9b987-d4c9-427f-a8d1-0900da11bef5" containerID="51c9bc540f5f5f1943fdf912d7fb80205db793e6c9378b27720eafa6a4b52b3e" exitCode=0 Mar 16 17:08:42 crc kubenswrapper[5120]: I0316 17:08:42.048609 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"6ff9b987-d4c9-427f-a8d1-0900da11bef5","Type":"ContainerDied","Data":"51c9bc540f5f5f1943fdf912d7fb80205db793e6c9378b27720eafa6a4b52b3e"} Mar 16 17:08:42 crc kubenswrapper[5120]: I0316 17:08:42.049251 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/45defe5f-ca2f-4993-8430-d713ed1c9df0-public-tls-certs\") pod \"cinder-api-0\" (UID: \"45defe5f-ca2f-4993-8430-d713ed1c9df0\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:08:42 crc kubenswrapper[5120]: I0316 17:08:42.049356 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/45defe5f-ca2f-4993-8430-d713ed1c9df0-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"45defe5f-ca2f-4993-8430-d713ed1c9df0\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:08:42 crc kubenswrapper[5120]: E0316 17:08:42.049429 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-cinder-public-svc: secret "cert-cinder-public-svc" not found Mar 16 17:08:42 crc kubenswrapper[5120]: E0316 17:08:42.049489 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-cinder-internal-svc: secret "cert-cinder-internal-svc" not found Mar 16 17:08:42 crc kubenswrapper[5120]: E0316 17:08:42.049570 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45defe5f-ca2f-4993-8430-d713ed1c9df0-public-tls-certs podName:45defe5f-ca2f-4993-8430-d713ed1c9df0 nodeName:}" failed. No retries permitted until 2026-03-16 17:08:43.049529042 +0000 UTC m=+5825.203460699 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/45defe5f-ca2f-4993-8430-d713ed1c9df0-public-tls-certs") pod "cinder-api-0" (UID: "45defe5f-ca2f-4993-8430-d713ed1c9df0") : secret "cert-cinder-public-svc" not found Mar 16 17:08:42 crc kubenswrapper[5120]: I0316 17:08:42.049617 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:42 crc kubenswrapper[5120]: E0316 17:08:42.049644 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45defe5f-ca2f-4993-8430-d713ed1c9df0-internal-tls-certs podName:45defe5f-ca2f-4993-8430-d713ed1c9df0 nodeName:}" failed. No retries permitted until 2026-03-16 17:08:43.049635315 +0000 UTC m=+5825.203566972 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/45defe5f-ca2f-4993-8430-d713ed1c9df0-internal-tls-certs") pod "cinder-api-0" (UID: "45defe5f-ca2f-4993-8430-d713ed1c9df0") : secret "cert-cinder-internal-svc" not found Mar 16 17:08:42 crc kubenswrapper[5120]: I0316 17:08:42.053110 5120 generic.go:358] "Generic (PLEG): container finished" podID="06ad2651-812c-46f9-b42d-f893b573e5c5" containerID="8a188b7110c5836b7c80b00c9cf9f7a20f0d97e16acf0ffdf1aec16c43c6d210" exitCode=143 Mar 16 17:08:42 crc kubenswrapper[5120]: I0316 17:08:42.053167 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-d7c955d94-2dfzr" event={"ID":"06ad2651-812c-46f9-b42d-f893b573e5c5","Type":"ContainerDied","Data":"8a188b7110c5836b7c80b00c9cf9f7a20f0d97e16acf0ffdf1aec16c43c6d210"} Mar 16 17:08:42 crc kubenswrapper[5120]: I0316 17:08:42.057123 5120 generic.go:358] "Generic (PLEG): container finished" podID="45bed047-fbff-439b-b659-657f9b9d3b62" containerID="27cb3386aadf2d6768da83f5c6070a5e4f3208984e63cb60bbb72e30c860ac1f" exitCode=0 Mar 16 17:08:42 crc kubenswrapper[5120]: I0316 17:08:42.057215 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:08:42 crc kubenswrapper[5120]: I0316 17:08:42.057284 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"45bed047-fbff-439b-b659-657f9b9d3b62","Type":"ContainerDied","Data":"27cb3386aadf2d6768da83f5c6070a5e4f3208984e63cb60bbb72e30c860ac1f"} Mar 16 17:08:42 crc kubenswrapper[5120]: I0316 17:08:42.057336 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"45bed047-fbff-439b-b659-657f9b9d3b62","Type":"ContainerDied","Data":"ccab7c76daeba3ad9eada595dafd9e9de667e2f9c9f21f28300a7fed24686396"} Mar 16 17:08:42 crc kubenswrapper[5120]: I0316 17:08:42.057360 5120 scope.go:117] "RemoveContainer" containerID="27cb3386aadf2d6768da83f5c6070a5e4f3208984e63cb60bbb72e30c860ac1f" Mar 16 17:08:42 crc kubenswrapper[5120]: I0316 17:08:42.131640 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 17:08:42 crc kubenswrapper[5120]: I0316 17:08:42.158218 5120 scope.go:117] "RemoveContainer" containerID="1c02bc06344293428f1e8f7afa638a50bbb02427e908baa3d149b016a246865b" Mar 16 17:08:42 crc kubenswrapper[5120]: I0316 17:08:42.176176 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 17:08:42 crc kubenswrapper[5120]: I0316 17:08:42.211134 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:08:42 crc kubenswrapper[5120]: I0316 17:08:42.218010 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 17:08:42 crc kubenswrapper[5120]: I0316 17:08:42.218198 5120 scope.go:117] "RemoveContainer" containerID="27cb3386aadf2d6768da83f5c6070a5e4f3208984e63cb60bbb72e30c860ac1f" Mar 16 17:08:42 crc kubenswrapper[5120]: I0316 17:08:42.219310 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ff9b987-d4c9-427f-a8d1-0900da11bef5" containerName="ceilometer-notification-agent" Mar 16 17:08:42 crc kubenswrapper[5120]: I0316 17:08:42.219328 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ff9b987-d4c9-427f-a8d1-0900da11bef5" containerName="ceilometer-notification-agent" Mar 16 17:08:42 crc kubenswrapper[5120]: I0316 17:08:42.219357 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ff9b987-d4c9-427f-a8d1-0900da11bef5" containerName="sg-core" Mar 16 17:08:42 crc kubenswrapper[5120]: I0316 17:08:42.219362 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ff9b987-d4c9-427f-a8d1-0900da11bef5" containerName="sg-core" Mar 16 17:08:42 crc kubenswrapper[5120]: I0316 17:08:42.219379 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ff9b987-d4c9-427f-a8d1-0900da11bef5" containerName="proxy-httpd" Mar 16 17:08:42 crc kubenswrapper[5120]: I0316 17:08:42.219384 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ff9b987-d4c9-427f-a8d1-0900da11bef5" containerName="proxy-httpd" Mar 16 17:08:42 crc kubenswrapper[5120]: I0316 17:08:42.219423 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ff9b987-d4c9-427f-a8d1-0900da11bef5" containerName="ceilometer-central-agent" Mar 16 17:08:42 crc kubenswrapper[5120]: I0316 17:08:42.219428 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ff9b987-d4c9-427f-a8d1-0900da11bef5" containerName="ceilometer-central-agent" Mar 16 17:08:42 crc kubenswrapper[5120]: I0316 17:08:42.219437 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45bed047-fbff-439b-b659-657f9b9d3b62" containerName="glance-log" Mar 16 17:08:42 crc kubenswrapper[5120]: I0316 17:08:42.219442 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="45bed047-fbff-439b-b659-657f9b9d3b62" containerName="glance-log" Mar 16 17:08:42 crc kubenswrapper[5120]: I0316 17:08:42.219450 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45bed047-fbff-439b-b659-657f9b9d3b62" containerName="glance-httpd" Mar 16 17:08:42 crc kubenswrapper[5120]: I0316 17:08:42.219456 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="45bed047-fbff-439b-b659-657f9b9d3b62" containerName="glance-httpd" Mar 16 17:08:42 crc kubenswrapper[5120]: I0316 17:08:42.219629 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="45bed047-fbff-439b-b659-657f9b9d3b62" containerName="glance-log" Mar 16 17:08:42 crc kubenswrapper[5120]: I0316 17:08:42.219642 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="6ff9b987-d4c9-427f-a8d1-0900da11bef5" containerName="proxy-httpd" Mar 16 17:08:42 crc kubenswrapper[5120]: I0316 17:08:42.219663 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="45bed047-fbff-439b-b659-657f9b9d3b62" containerName="glance-httpd" Mar 16 17:08:42 crc kubenswrapper[5120]: I0316 17:08:42.219674 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="6ff9b987-d4c9-427f-a8d1-0900da11bef5" containerName="ceilometer-notification-agent" Mar 16 17:08:42 crc kubenswrapper[5120]: I0316 17:08:42.219686 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="6ff9b987-d4c9-427f-a8d1-0900da11bef5" containerName="ceilometer-central-agent" Mar 16 17:08:42 crc kubenswrapper[5120]: I0316 17:08:42.219700 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="6ff9b987-d4c9-427f-a8d1-0900da11bef5" containerName="sg-core" Mar 16 17:08:42 crc kubenswrapper[5120]: E0316 17:08:42.222056 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"27cb3386aadf2d6768da83f5c6070a5e4f3208984e63cb60bbb72e30c860ac1f\": container with ID starting with 27cb3386aadf2d6768da83f5c6070a5e4f3208984e63cb60bbb72e30c860ac1f not found: ID does not exist" containerID="27cb3386aadf2d6768da83f5c6070a5e4f3208984e63cb60bbb72e30c860ac1f" Mar 16 17:08:42 crc kubenswrapper[5120]: I0316 17:08:42.222111 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27cb3386aadf2d6768da83f5c6070a5e4f3208984e63cb60bbb72e30c860ac1f"} err="failed to get container status \"27cb3386aadf2d6768da83f5c6070a5e4f3208984e63cb60bbb72e30c860ac1f\": rpc error: code = NotFound desc = could not find container \"27cb3386aadf2d6768da83f5c6070a5e4f3208984e63cb60bbb72e30c860ac1f\": container with ID starting with 27cb3386aadf2d6768da83f5c6070a5e4f3208984e63cb60bbb72e30c860ac1f not found: ID does not exist" Mar 16 17:08:42 crc kubenswrapper[5120]: I0316 17:08:42.222137 5120 scope.go:117] "RemoveContainer" containerID="1c02bc06344293428f1e8f7afa638a50bbb02427e908baa3d149b016a246865b" Mar 16 17:08:42 crc kubenswrapper[5120]: E0316 17:08:42.222515 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c02bc06344293428f1e8f7afa638a50bbb02427e908baa3d149b016a246865b\": container with ID starting with 1c02bc06344293428f1e8f7afa638a50bbb02427e908baa3d149b016a246865b not found: ID does not exist" containerID="1c02bc06344293428f1e8f7afa638a50bbb02427e908baa3d149b016a246865b" Mar 16 17:08:42 crc kubenswrapper[5120]: I0316 17:08:42.222539 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c02bc06344293428f1e8f7afa638a50bbb02427e908baa3d149b016a246865b"} err="failed to get container status \"1c02bc06344293428f1e8f7afa638a50bbb02427e908baa3d149b016a246865b\": rpc error: code = NotFound desc = could not find container \"1c02bc06344293428f1e8f7afa638a50bbb02427e908baa3d149b016a246865b\": container with ID starting with 1c02bc06344293428f1e8f7afa638a50bbb02427e908baa3d149b016a246865b not found: ID does not exist" Mar 16 17:08:42 crc kubenswrapper[5120]: I0316 17:08:42.244118 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 17:08:42 crc kubenswrapper[5120]: I0316 17:08:42.244253 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:08:42 crc kubenswrapper[5120]: I0316 17:08:42.246278 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-public-svc\"" Mar 16 17:08:42 crc kubenswrapper[5120]: I0316 17:08:42.247067 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-external-config-data\"" Mar 16 17:08:42 crc kubenswrapper[5120]: I0316 17:08:42.248829 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 17:08:42 crc kubenswrapper[5120]: I0316 17:08:42.257857 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6ff9b987-d4c9-427f-a8d1-0900da11bef5-config-data\") pod \"6ff9b987-d4c9-427f-a8d1-0900da11bef5\" (UID: \"6ff9b987-d4c9-427f-a8d1-0900da11bef5\") " Mar 16 17:08:42 crc kubenswrapper[5120]: I0316 17:08:42.258013 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/6ff9b987-d4c9-427f-a8d1-0900da11bef5-log-httpd\") pod \"6ff9b987-d4c9-427f-a8d1-0900da11bef5\" (UID: \"6ff9b987-d4c9-427f-a8d1-0900da11bef5\") " Mar 16 17:08:42 crc kubenswrapper[5120]: I0316 17:08:42.258158 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6ff9b987-d4c9-427f-a8d1-0900da11bef5-scripts\") pod \"6ff9b987-d4c9-427f-a8d1-0900da11bef5\" (UID: \"6ff9b987-d4c9-427f-a8d1-0900da11bef5\") " Mar 16 17:08:42 crc kubenswrapper[5120]: I0316 17:08:42.258491 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/6ff9b987-d4c9-427f-a8d1-0900da11bef5-ceilometer-tls-certs\") pod \"6ff9b987-d4c9-427f-a8d1-0900da11bef5\" (UID: \"6ff9b987-d4c9-427f-a8d1-0900da11bef5\") " Mar 16 17:08:42 crc kubenswrapper[5120]: I0316 17:08:42.258541 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6hn5j\" (UniqueName: \"kubernetes.io/projected/6ff9b987-d4c9-427f-a8d1-0900da11bef5-kube-api-access-6hn5j\") pod \"6ff9b987-d4c9-427f-a8d1-0900da11bef5\" (UID: \"6ff9b987-d4c9-427f-a8d1-0900da11bef5\") " Mar 16 17:08:42 crc kubenswrapper[5120]: I0316 17:08:42.258652 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/6ff9b987-d4c9-427f-a8d1-0900da11bef5-sg-core-conf-yaml\") pod \"6ff9b987-d4c9-427f-a8d1-0900da11bef5\" (UID: \"6ff9b987-d4c9-427f-a8d1-0900da11bef5\") " Mar 16 17:08:42 crc kubenswrapper[5120]: I0316 17:08:42.260370 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/6ff9b987-d4c9-427f-a8d1-0900da11bef5-run-httpd\") pod \"6ff9b987-d4c9-427f-a8d1-0900da11bef5\" (UID: \"6ff9b987-d4c9-427f-a8d1-0900da11bef5\") " Mar 16 17:08:42 crc kubenswrapper[5120]: I0316 17:08:42.260703 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6ff9b987-d4c9-427f-a8d1-0900da11bef5-combined-ca-bundle\") pod \"6ff9b987-d4c9-427f-a8d1-0900da11bef5\" (UID: \"6ff9b987-d4c9-427f-a8d1-0900da11bef5\") " Mar 16 17:08:42 crc kubenswrapper[5120]: I0316 17:08:42.261055 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/69bb2342-14e1-4c32-889a-e33f6ba42651-public-tls-certs\") pod \"nova-api-0\" (UID: \"69bb2342-14e1-4c32-889a-e33f6ba42651\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:08:42 crc kubenswrapper[5120]: I0316 17:08:42.261916 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/69bb2342-14e1-4c32-889a-e33f6ba42651-internal-tls-certs\") pod \"nova-api-0\" (UID: \"69bb2342-14e1-4c32-889a-e33f6ba42651\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:08:42 crc kubenswrapper[5120]: E0316 17:08:42.262172 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-nova-internal-svc: secret "cert-nova-internal-svc" not found Mar 16 17:08:42 crc kubenswrapper[5120]: E0316 17:08:42.262233 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69bb2342-14e1-4c32-889a-e33f6ba42651-internal-tls-certs podName:69bb2342-14e1-4c32-889a-e33f6ba42651 nodeName:}" failed. No retries permitted until 2026-03-16 17:08:43.262215138 +0000 UTC m=+5825.416146795 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/69bb2342-14e1-4c32-889a-e33f6ba42651-internal-tls-certs") pod "nova-api-0" (UID: "69bb2342-14e1-4c32-889a-e33f6ba42651") : secret "cert-nova-internal-svc" not found Mar 16 17:08:42 crc kubenswrapper[5120]: E0316 17:08:42.263927 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-nova-public-svc: secret "cert-nova-public-svc" not found Mar 16 17:08:42 crc kubenswrapper[5120]: E0316 17:08:42.264005 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69bb2342-14e1-4c32-889a-e33f6ba42651-public-tls-certs podName:69bb2342-14e1-4c32-889a-e33f6ba42651 nodeName:}" failed. No retries permitted until 2026-03-16 17:08:43.263985557 +0000 UTC m=+5825.417917214 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/69bb2342-14e1-4c32-889a-e33f6ba42651-public-tls-certs") pod "nova-api-0" (UID: "69bb2342-14e1-4c32-889a-e33f6ba42651") : secret "cert-nova-public-svc" not found Mar 16 17:08:42 crc kubenswrapper[5120]: I0316 17:08:42.265199 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ff9b987-d4c9-427f-a8d1-0900da11bef5-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "6ff9b987-d4c9-427f-a8d1-0900da11bef5" (UID: "6ff9b987-d4c9-427f-a8d1-0900da11bef5"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:08:42 crc kubenswrapper[5120]: I0316 17:08:42.267651 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ff9b987-d4c9-427f-a8d1-0900da11bef5-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "6ff9b987-d4c9-427f-a8d1-0900da11bef5" (UID: "6ff9b987-d4c9-427f-a8d1-0900da11bef5"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:08:42 crc kubenswrapper[5120]: I0316 17:08:42.271453 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ff9b987-d4c9-427f-a8d1-0900da11bef5-scripts" (OuterVolumeSpecName: "scripts") pod "6ff9b987-d4c9-427f-a8d1-0900da11bef5" (UID: "6ff9b987-d4c9-427f-a8d1-0900da11bef5"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:08:42 crc kubenswrapper[5120]: I0316 17:08:42.273494 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ff9b987-d4c9-427f-a8d1-0900da11bef5-kube-api-access-6hn5j" (OuterVolumeSpecName: "kube-api-access-6hn5j") pod "6ff9b987-d4c9-427f-a8d1-0900da11bef5" (UID: "6ff9b987-d4c9-427f-a8d1-0900da11bef5"). InnerVolumeSpecName "kube-api-access-6hn5j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:08:42 crc kubenswrapper[5120]: I0316 17:08:42.332835 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ff9b987-d4c9-427f-a8d1-0900da11bef5-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "6ff9b987-d4c9-427f-a8d1-0900da11bef5" (UID: "6ff9b987-d4c9-427f-a8d1-0900da11bef5"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:08:42 crc kubenswrapper[5120]: I0316 17:08:42.365145 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/15200613-4843-450f-bf1e-e7b152c48f43-scripts\") pod \"glance-default-external-api-0\" (UID: \"15200613-4843-450f-bf1e-e7b152c48f43\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:08:42 crc kubenswrapper[5120]: I0316 17:08:42.365285 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/15200613-4843-450f-bf1e-e7b152c48f43-logs\") pod \"glance-default-external-api-0\" (UID: \"15200613-4843-450f-bf1e-e7b152c48f43\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:08:42 crc kubenswrapper[5120]: I0316 17:08:42.365712 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/15200613-4843-450f-bf1e-e7b152c48f43-config-data\") pod \"glance-default-external-api-0\" (UID: \"15200613-4843-450f-bf1e-e7b152c48f43\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:08:42 crc kubenswrapper[5120]: I0316 17:08:42.366479 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6xl9\" (UniqueName: \"kubernetes.io/projected/15200613-4843-450f-bf1e-e7b152c48f43-kube-api-access-j6xl9\") pod \"glance-default-external-api-0\" (UID: \"15200613-4843-450f-bf1e-e7b152c48f43\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:08:42 crc kubenswrapper[5120]: I0316 17:08:42.366591 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/15200613-4843-450f-bf1e-e7b152c48f43-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"15200613-4843-450f-bf1e-e7b152c48f43\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:08:42 crc kubenswrapper[5120]: I0316 17:08:42.366903 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"glance-default-external-api-0\" (UID: \"15200613-4843-450f-bf1e-e7b152c48f43\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:08:42 crc kubenswrapper[5120]: I0316 17:08:42.367890 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/15200613-4843-450f-bf1e-e7b152c48f43-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"15200613-4843-450f-bf1e-e7b152c48f43\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:08:42 crc kubenswrapper[5120]: I0316 17:08:42.368357 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/15200613-4843-450f-bf1e-e7b152c48f43-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"15200613-4843-450f-bf1e-e7b152c48f43\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:08:42 crc kubenswrapper[5120]: I0316 17:08:42.368943 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/6ff9b987-d4c9-427f-a8d1-0900da11bef5-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:42 crc kubenswrapper[5120]: I0316 17:08:42.368968 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/6ff9b987-d4c9-427f-a8d1-0900da11bef5-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:42 crc kubenswrapper[5120]: I0316 17:08:42.368979 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6ff9b987-d4c9-427f-a8d1-0900da11bef5-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:42 crc kubenswrapper[5120]: I0316 17:08:42.368991 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6hn5j\" (UniqueName: \"kubernetes.io/projected/6ff9b987-d4c9-427f-a8d1-0900da11bef5-kube-api-access-6hn5j\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:42 crc kubenswrapper[5120]: I0316 17:08:42.369002 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/6ff9b987-d4c9-427f-a8d1-0900da11bef5-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:42 crc kubenswrapper[5120]: I0316 17:08:42.385664 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ff9b987-d4c9-427f-a8d1-0900da11bef5-ceilometer-tls-certs" (OuterVolumeSpecName: "ceilometer-tls-certs") pod "6ff9b987-d4c9-427f-a8d1-0900da11bef5" (UID: "6ff9b987-d4c9-427f-a8d1-0900da11bef5"). InnerVolumeSpecName "ceilometer-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:08:42 crc kubenswrapper[5120]: I0316 17:08:42.389956 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ff9b987-d4c9-427f-a8d1-0900da11bef5-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "6ff9b987-d4c9-427f-a8d1-0900da11bef5" (UID: "6ff9b987-d4c9-427f-a8d1-0900da11bef5"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:08:42 crc kubenswrapper[5120]: I0316 17:08:42.415567 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ff9b987-d4c9-427f-a8d1-0900da11bef5-config-data" (OuterVolumeSpecName: "config-data") pod "6ff9b987-d4c9-427f-a8d1-0900da11bef5" (UID: "6ff9b987-d4c9-427f-a8d1-0900da11bef5"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:08:42 crc kubenswrapper[5120]: I0316 17:08:42.435453 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 17:08:42 crc kubenswrapper[5120]: I0316 17:08:42.477664 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"glance-default-external-api-0\" (UID: \"15200613-4843-450f-bf1e-e7b152c48f43\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:08:42 crc kubenswrapper[5120]: I0316 17:08:42.478885 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"glance-default-external-api-0\" (UID: \"15200613-4843-450f-bf1e-e7b152c48f43\") device mount path \"/mnt/openstack/pv05\"" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:08:42 crc kubenswrapper[5120]: I0316 17:08:42.481982 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/15200613-4843-450f-bf1e-e7b152c48f43-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"15200613-4843-450f-bf1e-e7b152c48f43\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:08:42 crc kubenswrapper[5120]: I0316 17:08:42.482256 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/15200613-4843-450f-bf1e-e7b152c48f43-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"15200613-4843-450f-bf1e-e7b152c48f43\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:08:42 crc kubenswrapper[5120]: E0316 17:08:42.482286 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-glance-default-public-svc: secret "cert-glance-default-public-svc" not found Mar 16 17:08:42 crc kubenswrapper[5120]: I0316 17:08:42.482354 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/15200613-4843-450f-bf1e-e7b152c48f43-scripts\") pod \"glance-default-external-api-0\" (UID: \"15200613-4843-450f-bf1e-e7b152c48f43\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:08:42 crc kubenswrapper[5120]: E0316 17:08:42.482445 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15200613-4843-450f-bf1e-e7b152c48f43-public-tls-certs podName:15200613-4843-450f-bf1e-e7b152c48f43 nodeName:}" failed. No retries permitted until 2026-03-16 17:08:42.982423671 +0000 UTC m=+5825.136355338 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/15200613-4843-450f-bf1e-e7b152c48f43-public-tls-certs") pod "glance-default-external-api-0" (UID: "15200613-4843-450f-bf1e-e7b152c48f43") : secret "cert-glance-default-public-svc" not found Mar 16 17:08:42 crc kubenswrapper[5120]: I0316 17:08:42.482562 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/15200613-4843-450f-bf1e-e7b152c48f43-logs\") pod \"glance-default-external-api-0\" (UID: \"15200613-4843-450f-bf1e-e7b152c48f43\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:08:42 crc kubenswrapper[5120]: I0316 17:08:42.482786 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/15200613-4843-450f-bf1e-e7b152c48f43-config-data\") pod \"glance-default-external-api-0\" (UID: \"15200613-4843-450f-bf1e-e7b152c48f43\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:08:42 crc kubenswrapper[5120]: I0316 17:08:42.483229 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j6xl9\" (UniqueName: \"kubernetes.io/projected/15200613-4843-450f-bf1e-e7b152c48f43-kube-api-access-j6xl9\") pod \"glance-default-external-api-0\" (UID: \"15200613-4843-450f-bf1e-e7b152c48f43\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:08:42 crc kubenswrapper[5120]: I0316 17:08:42.483291 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/15200613-4843-450f-bf1e-e7b152c48f43-logs\") pod \"glance-default-external-api-0\" (UID: \"15200613-4843-450f-bf1e-e7b152c48f43\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:08:42 crc kubenswrapper[5120]: I0316 17:08:42.483356 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/15200613-4843-450f-bf1e-e7b152c48f43-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"15200613-4843-450f-bf1e-e7b152c48f43\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:08:42 crc kubenswrapper[5120]: I0316 17:08:42.483594 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6ff9b987-d4c9-427f-a8d1-0900da11bef5-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:42 crc kubenswrapper[5120]: I0316 17:08:42.483610 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6ff9b987-d4c9-427f-a8d1-0900da11bef5-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:42 crc kubenswrapper[5120]: I0316 17:08:42.483623 5120 reconciler_common.go:299] "Volume detached for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/6ff9b987-d4c9-427f-a8d1-0900da11bef5-ceilometer-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:42 crc kubenswrapper[5120]: I0316 17:08:42.483944 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/15200613-4843-450f-bf1e-e7b152c48f43-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"15200613-4843-450f-bf1e-e7b152c48f43\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:08:42 crc kubenswrapper[5120]: I0316 17:08:42.493018 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/15200613-4843-450f-bf1e-e7b152c48f43-scripts\") pod \"glance-default-external-api-0\" (UID: \"15200613-4843-450f-bf1e-e7b152c48f43\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:08:42 crc kubenswrapper[5120]: I0316 17:08:42.495582 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/15200613-4843-450f-bf1e-e7b152c48f43-config-data\") pod \"glance-default-external-api-0\" (UID: \"15200613-4843-450f-bf1e-e7b152c48f43\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:08:42 crc kubenswrapper[5120]: I0316 17:08:42.499169 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6xl9\" (UniqueName: \"kubernetes.io/projected/15200613-4843-450f-bf1e-e7b152c48f43-kube-api-access-j6xl9\") pod \"glance-default-external-api-0\" (UID: \"15200613-4843-450f-bf1e-e7b152c48f43\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:08:42 crc kubenswrapper[5120]: I0316 17:08:42.515552 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/15200613-4843-450f-bf1e-e7b152c48f43-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"15200613-4843-450f-bf1e-e7b152c48f43\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:08:42 crc kubenswrapper[5120]: I0316 17:08:42.527284 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"glance-default-external-api-0\" (UID: \"15200613-4843-450f-bf1e-e7b152c48f43\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:08:42 crc kubenswrapper[5120]: I0316 17:08:42.685320 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0156f10b-e51f-4ce8-a414-e6339cd30530" path="/var/lib/kubelet/pods/0156f10b-e51f-4ce8-a414-e6339cd30530/volumes" Mar 16 17:08:42 crc kubenswrapper[5120]: I0316 17:08:42.686530 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="45bed047-fbff-439b-b659-657f9b9d3b62" path="/var/lib/kubelet/pods/45bed047-fbff-439b-b659-657f9b9d3b62/volumes" Mar 16 17:08:42 crc kubenswrapper[5120]: I0316 17:08:42.687305 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a21ca52-7273-4160-914b-4958e7f2c2ce" path="/var/lib/kubelet/pods/6a21ca52-7273-4160-914b-4958e7f2c2ce/volumes" Mar 16 17:08:42 crc kubenswrapper[5120]: I0316 17:08:42.691016 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9dde2b26-18b2-469b-94d1-92da183402fc" path="/var/lib/kubelet/pods/9dde2b26-18b2-469b-94d1-92da183402fc/volumes" Mar 16 17:08:42 crc kubenswrapper[5120]: I0316 17:08:42.693496 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c8ccd406-033f-4230-b9a3-357d14ec49f2" path="/var/lib/kubelet/pods/c8ccd406-033f-4230-b9a3-357d14ec49f2/volumes" Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.008824 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/15200613-4843-450f-bf1e-e7b152c48f43-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"15200613-4843-450f-bf1e-e7b152c48f43\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:08:43 crc kubenswrapper[5120]: E0316 17:08:43.010777 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-glance-default-public-svc: secret "cert-glance-default-public-svc" not found Mar 16 17:08:43 crc kubenswrapper[5120]: E0316 17:08:43.011402 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15200613-4843-450f-bf1e-e7b152c48f43-public-tls-certs podName:15200613-4843-450f-bf1e-e7b152c48f43 nodeName:}" failed. No retries permitted until 2026-03-16 17:08:44.011371293 +0000 UTC m=+5826.165302950 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/15200613-4843-450f-bf1e-e7b152c48f43-public-tls-certs") pod "glance-default-external-api-0" (UID: "15200613-4843-450f-bf1e-e7b152c48f43") : secret "cert-glance-default-public-svc" not found Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.070480 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-9f6dcd6cf-pldhd" Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.071392 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 17:08:43 crc kubenswrapper[5120]: E0316 17:08:43.072349 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[galera-tls-certs], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openstack-kuttl-tests/openstack-cell1-galera-0" podUID="1f26bb19-36e1-4611-8fef-a2b16661b9f1" Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.109643 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"6ff9b987-d4c9-427f-a8d1-0900da11bef5","Type":"ContainerDied","Data":"9a0f02e0dde2e457ecb9c168d2940413d17e419a88dc2b2b07bde6ad93e01b6f"} Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.109702 5120 scope.go:117] "RemoveContainer" containerID="39da148bdc75ed714a628ed59f7ddc25fb6e712f3610df622442f9f8898925c6" Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.109661 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.114953 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.115061 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/a96c9fab-fbd4-459d-90a5-ca103703bfc9-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"a96c9fab-fbd4-459d-90a5-ca103703bfc9\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.115278 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/a96c9fab-fbd4-459d-90a5-ca103703bfc9-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"a96c9fab-fbd4-459d-90a5-ca103703bfc9\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.115352 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/45defe5f-ca2f-4993-8430-d713ed1c9df0-public-tls-certs\") pod \"cinder-api-0\" (UID: \"45defe5f-ca2f-4993-8430-d713ed1c9df0\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.115433 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/45defe5f-ca2f-4993-8430-d713ed1c9df0-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"45defe5f-ca2f-4993-8430-d713ed1c9df0\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:08:43 crc kubenswrapper[5120]: E0316 17:08:43.115653 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-ovndbcluster-sb-ovndbs: secret "cert-ovndbcluster-sb-ovndbs" not found Mar 16 17:08:43 crc kubenswrapper[5120]: E0316 17:08:43.115734 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a96c9fab-fbd4-459d-90a5-ca103703bfc9-ovsdbserver-sb-tls-certs podName:a96c9fab-fbd4-459d-90a5-ca103703bfc9 nodeName:}" failed. No retries permitted until 2026-03-16 17:08:47.115705206 +0000 UTC m=+5829.269636933 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "ovsdbserver-sb-tls-certs" (UniqueName: "kubernetes.io/secret/a96c9fab-fbd4-459d-90a5-ca103703bfc9-ovsdbserver-sb-tls-certs") pod "ovsdbserver-sb-0" (UID: "a96c9fab-fbd4-459d-90a5-ca103703bfc9") : secret "cert-ovndbcluster-sb-ovndbs" not found Mar 16 17:08:43 crc kubenswrapper[5120]: E0316 17:08:43.116058 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-ovn-metrics: secret "cert-ovn-metrics" not found Mar 16 17:08:43 crc kubenswrapper[5120]: E0316 17:08:43.116114 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-cinder-public-svc: secret "cert-cinder-public-svc" not found Mar 16 17:08:43 crc kubenswrapper[5120]: E0316 17:08:43.116139 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a96c9fab-fbd4-459d-90a5-ca103703bfc9-metrics-certs-tls-certs podName:a96c9fab-fbd4-459d-90a5-ca103703bfc9 nodeName:}" failed. No retries permitted until 2026-03-16 17:08:47.116117287 +0000 UTC m=+5829.270048944 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs-tls-certs" (UniqueName: "kubernetes.io/secret/a96c9fab-fbd4-459d-90a5-ca103703bfc9-metrics-certs-tls-certs") pod "ovsdbserver-sb-0" (UID: "a96c9fab-fbd4-459d-90a5-ca103703bfc9") : secret "cert-ovn-metrics" not found Mar 16 17:08:43 crc kubenswrapper[5120]: E0316 17:08:43.116142 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-nova-novncproxy-cell1-vencrypt: secret "cert-nova-novncproxy-cell1-vencrypt" not found Mar 16 17:08:43 crc kubenswrapper[5120]: E0316 17:08:43.116159 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45defe5f-ca2f-4993-8430-d713ed1c9df0-public-tls-certs podName:45defe5f-ca2f-4993-8430-d713ed1c9df0 nodeName:}" failed. No retries permitted until 2026-03-16 17:08:45.116148588 +0000 UTC m=+5827.270080245 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/45defe5f-ca2f-4993-8430-d713ed1c9df0-public-tls-certs") pod "cinder-api-0" (UID: "45defe5f-ca2f-4993-8430-d713ed1c9df0") : secret "cert-cinder-public-svc" not found Mar 16 17:08:43 crc kubenswrapper[5120]: E0316 17:08:43.116209 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3-vencrypt-tls-certs podName:eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3 nodeName:}" failed. No retries permitted until 2026-03-16 17:08:47.116188719 +0000 UTC m=+5829.270120376 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "vencrypt-tls-certs" (UniqueName: "kubernetes.io/secret/eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3-vencrypt-tls-certs") pod "nova-cell1-novncproxy-0" (UID: "eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3") : secret "cert-nova-novncproxy-cell1-vencrypt" not found Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.116316 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:08:43 crc kubenswrapper[5120]: E0316 17:08:43.116390 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-nova-novncproxy-cell1-public-svc: secret "cert-nova-novncproxy-cell1-public-svc" not found Mar 16 17:08:43 crc kubenswrapper[5120]: E0316 17:08:43.116437 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3-nova-novncproxy-tls-certs podName:eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3 nodeName:}" failed. No retries permitted until 2026-03-16 17:08:47.116427665 +0000 UTC m=+5829.270359382 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "nova-novncproxy-tls-certs" (UniqueName: "kubernetes.io/secret/eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3-nova-novncproxy-tls-certs") pod "nova-cell1-novncproxy-0" (UID: "eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3") : secret "cert-nova-novncproxy-cell1-public-svc" not found Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.122414 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/45defe5f-ca2f-4993-8430-d713ed1c9df0-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"45defe5f-ca2f-4993-8430-d713ed1c9df0\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.132729 5120 generic.go:358] "Generic (PLEG): container finished" podID="06ad2651-812c-46f9-b42d-f893b573e5c5" containerID="f0dafd0b50f382fac206fc5965f0bc433fa364c9262cb0c2312ba18c24331e5e" exitCode=0 Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.132978 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-d7c955d94-2dfzr" event={"ID":"06ad2651-812c-46f9-b42d-f893b573e5c5","Type":"ContainerDied","Data":"f0dafd0b50f382fac206fc5965f0bc433fa364c9262cb0c2312ba18c24331e5e"} Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.148465 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-northd-0_4281ec55-3466-4ca1-8054-498475a4407a/ovn-northd/0.log" Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.149093 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.158290 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-northd-0_4281ec55-3466-4ca1-8054-498475a4407a/ovn-northd/0.log" Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.158339 5120 generic.go:358] "Generic (PLEG): container finished" podID="4281ec55-3466-4ca1-8054-498475a4407a" containerID="96a5af6c245f152292c5f105e917134b38b18b97df711c59fca353841e123fc8" exitCode=139 Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.158429 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"4281ec55-3466-4ca1-8054-498475a4407a","Type":"ContainerDied","Data":"96a5af6c245f152292c5f105e917134b38b18b97df711c59fca353841e123fc8"} Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.170825 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-d7c955d94-2dfzr" Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.175114 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"f39a0edc-bfc5-400a-ad5e-4c83f2065778","Type":"ContainerStarted","Data":"133a443bb923fc3f1efaf1d03003bc3a31940bc61076471810e08ec74c9bda24"} Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.175166 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"f39a0edc-bfc5-400a-ad5e-4c83f2065778","Type":"ContainerStarted","Data":"cab6884efb8354c2caa071f67dd82ea67cfafad9173c180803035eec23da1c36"} Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.185858 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.188420 5120 scope.go:117] "RemoveContainer" containerID="e9a80af08a4b83cbe6b83abbdfeb801e4f9d662462e9e634f977b1c0bf2f25b5" Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.201815 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.204383 5120 generic.go:358] "Generic (PLEG): container finished" podID="7590c7f4-950a-41b1-889b-359a9a608f4f" containerID="033fe6dfc023fa648951152496fd38bf04fae7e6660b02f0bb4af884e0f1fe54" exitCode=0 Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.204492 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-9f6dcd6cf-pldhd" event={"ID":"7590c7f4-950a-41b1-889b-359a9a608f4f","Type":"ContainerDied","Data":"033fe6dfc023fa648951152496fd38bf04fae7e6660b02f0bb4af884e0f1fe54"} Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.204523 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-9f6dcd6cf-pldhd" event={"ID":"7590c7f4-950a-41b1-889b-359a9a608f4f","Type":"ContainerDied","Data":"bf3899bf14e525ddd58e9d3ea348ada7026cfc5d0cc646f43b98809e7bae6fb5"} Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.204607 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-9f6dcd6cf-pldhd" Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.210309 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.212470 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7590c7f4-950a-41b1-889b-359a9a608f4f" containerName="barbican-worker" Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.212497 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7590c7f4-950a-41b1-889b-359a9a608f4f" containerName="barbican-worker" Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.212516 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4281ec55-3466-4ca1-8054-498475a4407a" containerName="openstack-network-exporter" Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.212525 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="4281ec55-3466-4ca1-8054-498475a4407a" containerName="openstack-network-exporter" Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.212563 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7590c7f4-950a-41b1-889b-359a9a608f4f" containerName="barbican-worker-log" Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.212572 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7590c7f4-950a-41b1-889b-359a9a608f4f" containerName="barbican-worker-log" Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.212600 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06ad2651-812c-46f9-b42d-f893b573e5c5" containerName="barbican-keystone-listener" Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.212608 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="06ad2651-812c-46f9-b42d-f893b573e5c5" containerName="barbican-keystone-listener" Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.212624 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4281ec55-3466-4ca1-8054-498475a4407a" containerName="ovn-northd" Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.212631 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="4281ec55-3466-4ca1-8054-498475a4407a" containerName="ovn-northd" Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.212653 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06ad2651-812c-46f9-b42d-f893b573e5c5" containerName="barbican-keystone-listener-log" Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.212663 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="06ad2651-812c-46f9-b42d-f893b573e5c5" containerName="barbican-keystone-listener-log" Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.212911 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7590c7f4-950a-41b1-889b-359a9a608f4f" containerName="barbican-worker" Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.212928 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="06ad2651-812c-46f9-b42d-f893b573e5c5" containerName="barbican-keystone-listener" Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.212939 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7590c7f4-950a-41b1-889b-359a9a608f4f" containerName="barbican-worker-log" Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.212965 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="4281ec55-3466-4ca1-8054-498475a4407a" containerName="ovn-northd" Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.212976 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="4281ec55-3466-4ca1-8054-498475a4407a" containerName="openstack-network-exporter" Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.212984 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="06ad2651-812c-46f9-b42d-f893b573e5c5" containerName="barbican-keystone-listener-log" Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.219650 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7590c7f4-950a-41b1-889b-359a9a608f4f-combined-ca-bundle\") pod \"7590c7f4-950a-41b1-889b-359a9a608f4f\" (UID: \"7590c7f4-950a-41b1-889b-359a9a608f4f\") " Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.219888 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7590c7f4-950a-41b1-889b-359a9a608f4f-logs\") pod \"7590c7f4-950a-41b1-889b-359a9a608f4f\" (UID: \"7590c7f4-950a-41b1-889b-359a9a608f4f\") " Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.219937 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/7590c7f4-950a-41b1-889b-359a9a608f4f-config-data-custom\") pod \"7590c7f4-950a-41b1-889b-359a9a608f4f\" (UID: \"7590c7f4-950a-41b1-889b-359a9a608f4f\") " Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.220069 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qxdsl\" (UniqueName: \"kubernetes.io/projected/7590c7f4-950a-41b1-889b-359a9a608f4f-kube-api-access-qxdsl\") pod \"7590c7f4-950a-41b1-889b-359a9a608f4f\" (UID: \"7590c7f4-950a-41b1-889b-359a9a608f4f\") " Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.220194 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/4281ec55-3466-4ca1-8054-498475a4407a-metrics-certs-tls-certs\") pod \"4281ec55-3466-4ca1-8054-498475a4407a\" (UID: \"4281ec55-3466-4ca1-8054-498475a4407a\") " Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.220347 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/4281ec55-3466-4ca1-8054-498475a4407a-ovn-rundir\") pod \"4281ec55-3466-4ca1-8054-498475a4407a\" (UID: \"4281ec55-3466-4ca1-8054-498475a4407a\") " Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.220401 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/4281ec55-3466-4ca1-8054-498475a4407a-ovn-northd-tls-certs\") pod \"4281ec55-3466-4ca1-8054-498475a4407a\" (UID: \"4281ec55-3466-4ca1-8054-498475a4407a\") " Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.220487 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4281ec55-3466-4ca1-8054-498475a4407a-config\") pod \"4281ec55-3466-4ca1-8054-498475a4407a\" (UID: \"4281ec55-3466-4ca1-8054-498475a4407a\") " Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.220564 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4281ec55-3466-4ca1-8054-498475a4407a-combined-ca-bundle\") pod \"4281ec55-3466-4ca1-8054-498475a4407a\" (UID: \"4281ec55-3466-4ca1-8054-498475a4407a\") " Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.220885 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7590c7f4-950a-41b1-889b-359a9a608f4f-config-data\") pod \"7590c7f4-950a-41b1-889b-359a9a608f4f\" (UID: \"7590c7f4-950a-41b1-889b-359a9a608f4f\") " Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.221032 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xgqpg\" (UniqueName: \"kubernetes.io/projected/4281ec55-3466-4ca1-8054-498475a4407a-kube-api-access-xgqpg\") pod \"4281ec55-3466-4ca1-8054-498475a4407a\" (UID: \"4281ec55-3466-4ca1-8054-498475a4407a\") " Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.221063 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/4281ec55-3466-4ca1-8054-498475a4407a-scripts\") pod \"4281ec55-3466-4ca1-8054-498475a4407a\" (UID: \"4281ec55-3466-4ca1-8054-498475a4407a\") " Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.223177 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4281ec55-3466-4ca1-8054-498475a4407a-ovn-rundir" (OuterVolumeSpecName: "ovn-rundir") pod "4281ec55-3466-4ca1-8054-498475a4407a" (UID: "4281ec55-3466-4ca1-8054-498475a4407a"). InnerVolumeSpecName "ovn-rundir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.223953 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"9a997459-37ba-46a9-9cb8-075f77fa009f","Type":"ContainerStarted","Data":"42b3134c7d5cdc4ab6cd16467e7527ff5871c8a605e0d6e3cc919d98453fc2ac"} Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.224001 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"9a997459-37ba-46a9-9cb8-075f77fa009f","Type":"ContainerStarted","Data":"ff70156b44dee76c7728fe4ee09d8f1e85e30ab8d9e97476c53d0492ab6fca64"} Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.224152 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.227462 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4281ec55-3466-4ca1-8054-498475a4407a-scripts" (OuterVolumeSpecName: "scripts") pod "4281ec55-3466-4ca1-8054-498475a4407a" (UID: "4281ec55-3466-4ca1-8054-498475a4407a"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.227829 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4281ec55-3466-4ca1-8054-498475a4407a-config" (OuterVolumeSpecName: "config") pod "4281ec55-3466-4ca1-8054-498475a4407a" (UID: "4281ec55-3466-4ca1-8054-498475a4407a"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.230294 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.230881 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.231453 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ceilometer-internal-svc\"" Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.232070 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7590c7f4-950a-41b1-889b-359a9a608f4f-logs" (OuterVolumeSpecName: "logs") pod "7590c7f4-950a-41b1-889b-359a9a608f4f" (UID: "7590c7f4-950a-41b1-889b-359a9a608f4f"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.238086 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4281ec55-3466-4ca1-8054-498475a4407a-kube-api-access-xgqpg" (OuterVolumeSpecName: "kube-api-access-xgqpg") pod "4281ec55-3466-4ca1-8054-498475a4407a" (UID: "4281ec55-3466-4ca1-8054-498475a4407a"). InnerVolumeSpecName "kube-api-access-xgqpg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.243939 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7590c7f4-950a-41b1-889b-359a9a608f4f-kube-api-access-qxdsl" (OuterVolumeSpecName: "kube-api-access-qxdsl") pod "7590c7f4-950a-41b1-889b-359a9a608f4f" (UID: "7590c7f4-950a-41b1-889b-359a9a608f4f"). InnerVolumeSpecName "kube-api-access-qxdsl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.243966 5120 scope.go:117] "RemoveContainer" containerID="51c9bc540f5f5f1943fdf912d7fb80205db793e6c9378b27720eafa6a4b52b3e" Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.245376 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.250938 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7590c7f4-950a-41b1-889b-359a9a608f4f-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "7590c7f4-950a-41b1-889b-359a9a608f4f" (UID: "7590c7f4-950a-41b1-889b-359a9a608f4f"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.277875 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7590c7f4-950a-41b1-889b-359a9a608f4f-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "7590c7f4-950a-41b1-889b-359a9a608f4f" (UID: "7590c7f4-950a-41b1-889b-359a9a608f4f"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.291266 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=2.291248385 podStartE2EDuration="2.291248385s" podCreationTimestamp="2026-03-16 17:08:41 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:08:43.222487886 +0000 UTC m=+5825.376419543" watchObservedRunningTime="2026-03-16 17:08:43.291248385 +0000 UTC m=+5825.445180042" Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.291640 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4281ec55-3466-4ca1-8054-498475a4407a-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "4281ec55-3466-4ca1-8054-498475a4407a" (UID: "4281ec55-3466-4ca1-8054-498475a4407a"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.298439 5120 scope.go:117] "RemoveContainer" containerID="287f8090dea674cb40a38ec071885a3f7894ef839aaf3eb8d78c6dc9e7abca92" Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.314237 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podStartSLOduration=2.314217299 podStartE2EDuration="2.314217299s" podCreationTimestamp="2026-03-16 17:08:41 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:08:43.248475733 +0000 UTC m=+5825.402407400" watchObservedRunningTime="2026-03-16 17:08:43.314217299 +0000 UTC m=+5825.468148956" Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.324795 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/06ad2651-812c-46f9-b42d-f893b573e5c5-combined-ca-bundle\") pod \"06ad2651-812c-46f9-b42d-f893b573e5c5\" (UID: \"06ad2651-812c-46f9-b42d-f893b573e5c5\") " Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.324854 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/06ad2651-812c-46f9-b42d-f893b573e5c5-logs\") pod \"06ad2651-812c-46f9-b42d-f893b573e5c5\" (UID: \"06ad2651-812c-46f9-b42d-f893b573e5c5\") " Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.325056 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/06ad2651-812c-46f9-b42d-f893b573e5c5-config-data-custom\") pod \"06ad2651-812c-46f9-b42d-f893b573e5c5\" (UID: \"06ad2651-812c-46f9-b42d-f893b573e5c5\") " Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.325254 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cc25l\" (UniqueName: \"kubernetes.io/projected/06ad2651-812c-46f9-b42d-f893b573e5c5-kube-api-access-cc25l\") pod \"06ad2651-812c-46f9-b42d-f893b573e5c5\" (UID: \"06ad2651-812c-46f9-b42d-f893b573e5c5\") " Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.325324 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/06ad2651-812c-46f9-b42d-f893b573e5c5-config-data\") pod \"06ad2651-812c-46f9-b42d-f893b573e5c5\" (UID: \"06ad2651-812c-46f9-b42d-f893b573e5c5\") " Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.326279 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/69bb2342-14e1-4c32-889a-e33f6ba42651-internal-tls-certs\") pod \"nova-api-0\" (UID: \"69bb2342-14e1-4c32-889a-e33f6ba42651\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.326343 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/d8ee8115-84b1-4f8e-acce-1f745eb1a339-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"d8ee8115-84b1-4f8e-acce-1f745eb1a339\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.326353 5120 scope.go:117] "RemoveContainer" containerID="40692fb4e719bbea05f717260a282bea677f342794b8fe0f8ea6f1f1abbfebd5" Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.326414 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/10bd837b-2e0d-460b-a254-20e23b6768f7-memcached-tls-certs\") pod \"memcached-0\" (UID: \"10bd837b-2e0d-460b-a254-20e23b6768f7\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.326539 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/d8ee8115-84b1-4f8e-acce-1f745eb1a339-run-httpd\") pod \"ceilometer-0\" (UID: \"d8ee8115-84b1-4f8e-acce-1f745eb1a339\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.326622 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/69bb2342-14e1-4c32-889a-e33f6ba42651-public-tls-certs\") pod \"nova-api-0\" (UID: \"69bb2342-14e1-4c32-889a-e33f6ba42651\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.326686 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/d8ee8115-84b1-4f8e-acce-1f745eb1a339-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"d8ee8115-84b1-4f8e-acce-1f745eb1a339\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:08:43 crc kubenswrapper[5120]: E0316 17:08:43.326690 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-memcached-svc: secret "cert-memcached-svc" not found Mar 16 17:08:43 crc kubenswrapper[5120]: E0316 17:08:43.326786 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10bd837b-2e0d-460b-a254-20e23b6768f7-memcached-tls-certs podName:10bd837b-2e0d-460b-a254-20e23b6768f7 nodeName:}" failed. No retries permitted until 2026-03-16 17:08:47.326767506 +0000 UTC m=+5829.480699163 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "memcached-tls-certs" (UniqueName: "kubernetes.io/secret/10bd837b-2e0d-460b-a254-20e23b6768f7-memcached-tls-certs") pod "memcached-0" (UID: "10bd837b-2e0d-460b-a254-20e23b6768f7") : secret "cert-memcached-svc" not found Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.326989 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06ad2651-812c-46f9-b42d-f893b573e5c5-logs" (OuterVolumeSpecName: "logs") pod "06ad2651-812c-46f9-b42d-f893b573e5c5" (UID: "06ad2651-812c-46f9-b42d-f893b573e5c5"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.327238 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/d8ee8115-84b1-4f8e-acce-1f745eb1a339-log-httpd\") pod \"ceilometer-0\" (UID: \"d8ee8115-84b1-4f8e-acce-1f745eb1a339\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.327378 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q269k\" (UniqueName: \"kubernetes.io/projected/d8ee8115-84b1-4f8e-acce-1f745eb1a339-kube-api-access-q269k\") pod \"ceilometer-0\" (UID: \"d8ee8115-84b1-4f8e-acce-1f745eb1a339\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:08:43 crc kubenswrapper[5120]: E0316 17:08:43.327281 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-nova-internal-svc: secret "cert-nova-internal-svc" not found Mar 16 17:08:43 crc kubenswrapper[5120]: E0316 17:08:43.329358 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-nova-public-svc: secret "cert-nova-public-svc" not found Mar 16 17:08:43 crc kubenswrapper[5120]: E0316 17:08:43.329425 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69bb2342-14e1-4c32-889a-e33f6ba42651-internal-tls-certs podName:69bb2342-14e1-4c32-889a-e33f6ba42651 nodeName:}" failed. No retries permitted until 2026-03-16 17:08:45.329405379 +0000 UTC m=+5827.483337036 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/69bb2342-14e1-4c32-889a-e33f6ba42651-internal-tls-certs") pod "nova-api-0" (UID: "69bb2342-14e1-4c32-889a-e33f6ba42651") : secret "cert-nova-internal-svc" not found Mar 16 17:08:43 crc kubenswrapper[5120]: E0316 17:08:43.329711 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69bb2342-14e1-4c32-889a-e33f6ba42651-public-tls-certs podName:69bb2342-14e1-4c32-889a-e33f6ba42651 nodeName:}" failed. No retries permitted until 2026-03-16 17:08:45.329686766 +0000 UTC m=+5827.483618433 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/69bb2342-14e1-4c32-889a-e33f6ba42651-public-tls-certs") pod "nova-api-0" (UID: "69bb2342-14e1-4c32-889a-e33f6ba42651") : secret "cert-nova-public-svc" not found Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.330319 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d8ee8115-84b1-4f8e-acce-1f745eb1a339-scripts\") pod \"ceilometer-0\" (UID: \"d8ee8115-84b1-4f8e-acce-1f745eb1a339\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.330569 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d8ee8115-84b1-4f8e-acce-1f745eb1a339-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"d8ee8115-84b1-4f8e-acce-1f745eb1a339\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.330989 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d8ee8115-84b1-4f8e-acce-1f745eb1a339-config-data\") pod \"ceilometer-0\" (UID: \"d8ee8115-84b1-4f8e-acce-1f745eb1a339\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.331773 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/06ad2651-812c-46f9-b42d-f893b573e5c5-logs\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.332246 5120 reconciler_common.go:299] "Volume detached for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/4281ec55-3466-4ca1-8054-498475a4407a-ovn-rundir\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.332269 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4281ec55-3466-4ca1-8054-498475a4407a-config\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.332280 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4281ec55-3466-4ca1-8054-498475a4407a-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.332305 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xgqpg\" (UniqueName: \"kubernetes.io/projected/4281ec55-3466-4ca1-8054-498475a4407a-kube-api-access-xgqpg\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.332318 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/4281ec55-3466-4ca1-8054-498475a4407a-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.332329 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7590c7f4-950a-41b1-889b-359a9a608f4f-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.332378 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7590c7f4-950a-41b1-889b-359a9a608f4f-logs\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.332394 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/7590c7f4-950a-41b1-889b-359a9a608f4f-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.332409 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qxdsl\" (UniqueName: \"kubernetes.io/projected/7590c7f4-950a-41b1-889b-359a9a608f4f-kube-api-access-qxdsl\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.333931 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7590c7f4-950a-41b1-889b-359a9a608f4f-config-data" (OuterVolumeSpecName: "config-data") pod "7590c7f4-950a-41b1-889b-359a9a608f4f" (UID: "7590c7f4-950a-41b1-889b-359a9a608f4f"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.343708 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06ad2651-812c-46f9-b42d-f893b573e5c5-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "06ad2651-812c-46f9-b42d-f893b573e5c5" (UID: "06ad2651-812c-46f9-b42d-f893b573e5c5"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.353256 5120 scope.go:117] "RemoveContainer" containerID="96a5af6c245f152292c5f105e917134b38b18b97df711c59fca353841e123fc8" Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.359606 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06ad2651-812c-46f9-b42d-f893b573e5c5-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "06ad2651-812c-46f9-b42d-f893b573e5c5" (UID: "06ad2651-812c-46f9-b42d-f893b573e5c5"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.363209 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4281ec55-3466-4ca1-8054-498475a4407a-ovn-northd-tls-certs" (OuterVolumeSpecName: "ovn-northd-tls-certs") pod "4281ec55-3466-4ca1-8054-498475a4407a" (UID: "4281ec55-3466-4ca1-8054-498475a4407a"). InnerVolumeSpecName "ovn-northd-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.363536 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06ad2651-812c-46f9-b42d-f893b573e5c5-kube-api-access-cc25l" (OuterVolumeSpecName: "kube-api-access-cc25l") pod "06ad2651-812c-46f9-b42d-f893b573e5c5" (UID: "06ad2651-812c-46f9-b42d-f893b573e5c5"). InnerVolumeSpecName "kube-api-access-cc25l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.380946 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4281ec55-3466-4ca1-8054-498475a4407a-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "4281ec55-3466-4ca1-8054-498475a4407a" (UID: "4281ec55-3466-4ca1-8054-498475a4407a"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.381235 5120 scope.go:117] "RemoveContainer" containerID="033fe6dfc023fa648951152496fd38bf04fae7e6660b02f0bb4af884e0f1fe54" Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.407976 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06ad2651-812c-46f9-b42d-f893b573e5c5-config-data" (OuterVolumeSpecName: "config-data") pod "06ad2651-812c-46f9-b42d-f893b573e5c5" (UID: "06ad2651-812c-46f9-b42d-f893b573e5c5"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.423607 5120 scope.go:117] "RemoveContainer" containerID="61ae3e8283d26fa6d34d7ac17f4f91382d53380682cb2f4fdfec75d30675e77c" Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.436456 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d8ee8115-84b1-4f8e-acce-1f745eb1a339-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"d8ee8115-84b1-4f8e-acce-1f745eb1a339\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.436699 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d8ee8115-84b1-4f8e-acce-1f745eb1a339-config-data\") pod \"ceilometer-0\" (UID: \"d8ee8115-84b1-4f8e-acce-1f745eb1a339\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.437004 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/d8ee8115-84b1-4f8e-acce-1f745eb1a339-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"d8ee8115-84b1-4f8e-acce-1f745eb1a339\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.437310 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/d8ee8115-84b1-4f8e-acce-1f745eb1a339-run-httpd\") pod \"ceilometer-0\" (UID: \"d8ee8115-84b1-4f8e-acce-1f745eb1a339\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.437395 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/d8ee8115-84b1-4f8e-acce-1f745eb1a339-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"d8ee8115-84b1-4f8e-acce-1f745eb1a339\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.437421 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/cde31df2-efeb-4fee-b565-f24b7eaeff60-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"cde31df2-efeb-4fee-b565-f24b7eaeff60\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.437567 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/cde31df2-efeb-4fee-b565-f24b7eaeff60-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"cde31df2-efeb-4fee-b565-f24b7eaeff60\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:08:43 crc kubenswrapper[5120]: E0316 17:08:43.437667 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-ovn-metrics: secret "cert-ovn-metrics" not found Mar 16 17:08:43 crc kubenswrapper[5120]: E0316 17:08:43.437753 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cde31df2-efeb-4fee-b565-f24b7eaeff60-metrics-certs-tls-certs podName:cde31df2-efeb-4fee-b565-f24b7eaeff60 nodeName:}" failed. No retries permitted until 2026-03-16 17:08:47.437734212 +0000 UTC m=+5829.591665869 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs-tls-certs" (UniqueName: "kubernetes.io/secret/cde31df2-efeb-4fee-b565-f24b7eaeff60-metrics-certs-tls-certs") pod "ovsdbserver-nb-0" (UID: "cde31df2-efeb-4fee-b565-f24b7eaeff60") : secret "cert-ovn-metrics" not found Mar 16 17:08:43 crc kubenswrapper[5120]: E0316 17:08:43.437846 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-ovndbcluster-nb-ovndbs: secret "cert-ovndbcluster-nb-ovndbs" not found Mar 16 17:08:43 crc kubenswrapper[5120]: E0316 17:08:43.437899 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cde31df2-efeb-4fee-b565-f24b7eaeff60-ovsdbserver-nb-tls-certs podName:cde31df2-efeb-4fee-b565-f24b7eaeff60 nodeName:}" failed. No retries permitted until 2026-03-16 17:08:47.437886386 +0000 UTC m=+5829.591818043 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "ovsdbserver-nb-tls-certs" (UniqueName: "kubernetes.io/secret/cde31df2-efeb-4fee-b565-f24b7eaeff60-ovsdbserver-nb-tls-certs") pod "ovsdbserver-nb-0" (UID: "cde31df2-efeb-4fee-b565-f24b7eaeff60") : secret "cert-ovndbcluster-nb-ovndbs" not found Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.437963 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/d8ee8115-84b1-4f8e-acce-1f745eb1a339-run-httpd\") pod \"ceilometer-0\" (UID: \"d8ee8115-84b1-4f8e-acce-1f745eb1a339\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.437979 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/d8ee8115-84b1-4f8e-acce-1f745eb1a339-log-httpd\") pod \"ceilometer-0\" (UID: \"d8ee8115-84b1-4f8e-acce-1f745eb1a339\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.438060 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q269k\" (UniqueName: \"kubernetes.io/projected/d8ee8115-84b1-4f8e-acce-1f745eb1a339-kube-api-access-q269k\") pod \"ceilometer-0\" (UID: \"d8ee8115-84b1-4f8e-acce-1f745eb1a339\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.438334 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/d8ee8115-84b1-4f8e-acce-1f745eb1a339-log-httpd\") pod \"ceilometer-0\" (UID: \"d8ee8115-84b1-4f8e-acce-1f745eb1a339\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.438368 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d8ee8115-84b1-4f8e-acce-1f745eb1a339-scripts\") pod \"ceilometer-0\" (UID: \"d8ee8115-84b1-4f8e-acce-1f745eb1a339\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:08:43 crc kubenswrapper[5120]: E0316 17:08:43.438355 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-ceilometer-internal-svc: secret "cert-ceilometer-internal-svc" not found Mar 16 17:08:43 crc kubenswrapper[5120]: E0316 17:08:43.438739 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8ee8115-84b1-4f8e-acce-1f745eb1a339-ceilometer-tls-certs podName:d8ee8115-84b1-4f8e-acce-1f745eb1a339 nodeName:}" failed. No retries permitted until 2026-03-16 17:08:43.93840989 +0000 UTC m=+5826.092341537 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ceilometer-tls-certs" (UniqueName: "kubernetes.io/secret/d8ee8115-84b1-4f8e-acce-1f745eb1a339-ceilometer-tls-certs") pod "ceilometer-0" (UID: "d8ee8115-84b1-4f8e-acce-1f745eb1a339") : secret "cert-ceilometer-internal-svc" not found Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.438793 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cc25l\" (UniqueName: \"kubernetes.io/projected/06ad2651-812c-46f9-b42d-f893b573e5c5-kube-api-access-cc25l\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.438814 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7590c7f4-950a-41b1-889b-359a9a608f4f-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.438828 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/06ad2651-812c-46f9-b42d-f893b573e5c5-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.438847 5120 reconciler_common.go:299] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/4281ec55-3466-4ca1-8054-498475a4407a-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.438861 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/06ad2651-812c-46f9-b42d-f893b573e5c5-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.438876 5120 reconciler_common.go:299] "Volume detached for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/4281ec55-3466-4ca1-8054-498475a4407a-ovn-northd-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.438890 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/06ad2651-812c-46f9-b42d-f893b573e5c5-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.441788 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/d8ee8115-84b1-4f8e-acce-1f745eb1a339-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"d8ee8115-84b1-4f8e-acce-1f745eb1a339\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.441838 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d8ee8115-84b1-4f8e-acce-1f745eb1a339-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"d8ee8115-84b1-4f8e-acce-1f745eb1a339\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.443308 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d8ee8115-84b1-4f8e-acce-1f745eb1a339-scripts\") pod \"ceilometer-0\" (UID: \"d8ee8115-84b1-4f8e-acce-1f745eb1a339\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.443685 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d8ee8115-84b1-4f8e-acce-1f745eb1a339-config-data\") pod \"ceilometer-0\" (UID: \"d8ee8115-84b1-4f8e-acce-1f745eb1a339\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.455509 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q269k\" (UniqueName: \"kubernetes.io/projected/d8ee8115-84b1-4f8e-acce-1f745eb1a339-kube-api-access-q269k\") pod \"ceilometer-0\" (UID: \"d8ee8115-84b1-4f8e-acce-1f745eb1a339\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.572016 5120 scope.go:117] "RemoveContainer" containerID="033fe6dfc023fa648951152496fd38bf04fae7e6660b02f0bb4af884e0f1fe54" Mar 16 17:08:43 crc kubenswrapper[5120]: E0316 17:08:43.572453 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"033fe6dfc023fa648951152496fd38bf04fae7e6660b02f0bb4af884e0f1fe54\": container with ID starting with 033fe6dfc023fa648951152496fd38bf04fae7e6660b02f0bb4af884e0f1fe54 not found: ID does not exist" containerID="033fe6dfc023fa648951152496fd38bf04fae7e6660b02f0bb4af884e0f1fe54" Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.572575 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"033fe6dfc023fa648951152496fd38bf04fae7e6660b02f0bb4af884e0f1fe54"} err="failed to get container status \"033fe6dfc023fa648951152496fd38bf04fae7e6660b02f0bb4af884e0f1fe54\": rpc error: code = NotFound desc = could not find container \"033fe6dfc023fa648951152496fd38bf04fae7e6660b02f0bb4af884e0f1fe54\": container with ID starting with 033fe6dfc023fa648951152496fd38bf04fae7e6660b02f0bb4af884e0f1fe54 not found: ID does not exist" Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.572683 5120 scope.go:117] "RemoveContainer" containerID="61ae3e8283d26fa6d34d7ac17f4f91382d53380682cb2f4fdfec75d30675e77c" Mar 16 17:08:43 crc kubenswrapper[5120]: E0316 17:08:43.576701 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"61ae3e8283d26fa6d34d7ac17f4f91382d53380682cb2f4fdfec75d30675e77c\": container with ID starting with 61ae3e8283d26fa6d34d7ac17f4f91382d53380682cb2f4fdfec75d30675e77c not found: ID does not exist" containerID="61ae3e8283d26fa6d34d7ac17f4f91382d53380682cb2f4fdfec75d30675e77c" Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.577224 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61ae3e8283d26fa6d34d7ac17f4f91382d53380682cb2f4fdfec75d30675e77c"} err="failed to get container status \"61ae3e8283d26fa6d34d7ac17f4f91382d53380682cb2f4fdfec75d30675e77c\": rpc error: code = NotFound desc = could not find container \"61ae3e8283d26fa6d34d7ac17f4f91382d53380682cb2f4fdfec75d30675e77c\": container with ID starting with 61ae3e8283d26fa6d34d7ac17f4f91382d53380682cb2f4fdfec75d30675e77c not found: ID does not exist" Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.587742 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-9f6dcd6cf-pldhd"] Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.596145 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-worker-9f6dcd6cf-pldhd"] Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.664943 5120 scope.go:117] "RemoveContainer" containerID="db39d192fa687a13805537d08ad22fed1ef362ef5027c920a616297dc55a8ea9" Mar 16 17:08:43 crc kubenswrapper[5120]: E0316 17:08:43.665513 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.852486 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/1f26bb19-36e1-4611-8fef-a2b16661b9f1-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"1f26bb19-36e1-4611-8fef-a2b16661b9f1\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.856724 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/1f26bb19-36e1-4611-8fef-a2b16661b9f1-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"1f26bb19-36e1-4611-8fef-a2b16661b9f1\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.956918 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/d8ee8115-84b1-4f8e-acce-1f745eb1a339-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"d8ee8115-84b1-4f8e-acce-1f745eb1a339\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:08:43 crc kubenswrapper[5120]: E0316 17:08:43.957143 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-ceilometer-internal-svc: secret "cert-ceilometer-internal-svc" not found Mar 16 17:08:43 crc kubenswrapper[5120]: E0316 17:08:43.957338 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8ee8115-84b1-4f8e-acce-1f745eb1a339-ceilometer-tls-certs podName:d8ee8115-84b1-4f8e-acce-1f745eb1a339 nodeName:}" failed. No retries permitted until 2026-03-16 17:08:44.957316286 +0000 UTC m=+5827.111247933 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "ceilometer-tls-certs" (UniqueName: "kubernetes.io/secret/d8ee8115-84b1-4f8e-acce-1f745eb1a339-ceilometer-tls-certs") pod "ceilometer-0" (UID: "d8ee8115-84b1-4f8e-acce-1f745eb1a339") : secret "cert-ceilometer-internal-svc" not found Mar 16 17:08:43 crc kubenswrapper[5120]: I0316 17:08:43.957472 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/ab5d1889-4b15-4b9d-92fb-838a10dc858f-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"ab5d1889-4b15-4b9d-92fb-838a10dc858f\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:08:43 crc kubenswrapper[5120]: E0316 17:08:43.957667 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-galera-openstack-svc: secret "cert-galera-openstack-svc" not found Mar 16 17:08:43 crc kubenswrapper[5120]: E0316 17:08:43.957694 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab5d1889-4b15-4b9d-92fb-838a10dc858f-galera-tls-certs podName:ab5d1889-4b15-4b9d-92fb-838a10dc858f nodeName:}" failed. No retries permitted until 2026-03-16 17:08:47.957687356 +0000 UTC m=+5830.111619013 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "galera-tls-certs" (UniqueName: "kubernetes.io/secret/ab5d1889-4b15-4b9d-92fb-838a10dc858f-galera-tls-certs") pod "openstack-galera-0" (UID: "ab5d1889-4b15-4b9d-92fb-838a10dc858f") : secret "cert-galera-openstack-svc" not found Mar 16 17:08:44 crc kubenswrapper[5120]: I0316 17:08:44.060101 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/15200613-4843-450f-bf1e-e7b152c48f43-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"15200613-4843-450f-bf1e-e7b152c48f43\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:08:44 crc kubenswrapper[5120]: E0316 17:08:44.060569 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-glance-default-public-svc: secret "cert-glance-default-public-svc" not found Mar 16 17:08:44 crc kubenswrapper[5120]: E0316 17:08:44.060626 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15200613-4843-450f-bf1e-e7b152c48f43-public-tls-certs podName:15200613-4843-450f-bf1e-e7b152c48f43 nodeName:}" failed. No retries permitted until 2026-03-16 17:08:46.060609878 +0000 UTC m=+5828.214541535 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/15200613-4843-450f-bf1e-e7b152c48f43-public-tls-certs") pod "glance-default-external-api-0" (UID: "15200613-4843-450f-bf1e-e7b152c48f43") : secret "cert-glance-default-public-svc" not found Mar 16 17:08:44 crc kubenswrapper[5120]: I0316 17:08:44.230566 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-d7c955d94-2dfzr" event={"ID":"06ad2651-812c-46f9-b42d-f893b573e5c5","Type":"ContainerDied","Data":"9f2f3c4cd86a0c5d3b576cbfa54811c97946e1993aa4ffe5213e9fac8ce79358"} Mar 16 17:08:44 crc kubenswrapper[5120]: I0316 17:08:44.230656 5120 scope.go:117] "RemoveContainer" containerID="f0dafd0b50f382fac206fc5965f0bc433fa364c9262cb0c2312ba18c24331e5e" Mar 16 17:08:44 crc kubenswrapper[5120]: I0316 17:08:44.230911 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-d7c955d94-2dfzr" Mar 16 17:08:44 crc kubenswrapper[5120]: I0316 17:08:44.244971 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"4281ec55-3466-4ca1-8054-498475a4407a","Type":"ContainerDied","Data":"8385739d66aa2f859a8ec60bb5634b39e5f4bc93afc6081df9a6afd60b4231bf"} Mar 16 17:08:44 crc kubenswrapper[5120]: I0316 17:08:44.245089 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:08:44 crc kubenswrapper[5120]: I0316 17:08:44.251447 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"f39a0edc-bfc5-400a-ad5e-4c83f2065778","Type":"ContainerStarted","Data":"70e5e2e54e67dd6e8b0b2a8d83ca632ba63c3a8a7def0c8c691e052b4afaa549"} Mar 16 17:08:44 crc kubenswrapper[5120]: I0316 17:08:44.255803 5120 generic.go:358] "Generic (PLEG): container finished" podID="3f3771ee-c5b9-4004-b631-437b1508ac5a" containerID="f9d4176477338724d48f077eb733c4cfa2586a8f3b67c1ffb86859f778db89d5" exitCode=0 Mar 16 17:08:44 crc kubenswrapper[5120]: I0316 17:08:44.255897 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"3f3771ee-c5b9-4004-b631-437b1508ac5a","Type":"ContainerDied","Data":"f9d4176477338724d48f077eb733c4cfa2586a8f3b67c1ffb86859f778db89d5"} Mar 16 17:08:44 crc kubenswrapper[5120]: I0316 17:08:44.257830 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:08:44 crc kubenswrapper[5120]: I0316 17:08:44.258190 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 17:08:44 crc kubenswrapper[5120]: I0316 17:08:44.281638 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:08:44 crc kubenswrapper[5120]: I0316 17:08:44.289641 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-d7c955d94-2dfzr"] Mar 16 17:08:44 crc kubenswrapper[5120]: I0316 17:08:44.294070 5120 scope.go:117] "RemoveContainer" containerID="8a188b7110c5836b7c80b00c9cf9f7a20f0d97e16acf0ffdf1aec16c43c6d210" Mar 16 17:08:44 crc kubenswrapper[5120]: I0316 17:08:44.371750 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/1f26bb19-36e1-4611-8fef-a2b16661b9f1-kolla-config\") pod \"1f26bb19-36e1-4611-8fef-a2b16661b9f1\" (UID: \"1f26bb19-36e1-4611-8fef-a2b16661b9f1\") " Mar 16 17:08:44 crc kubenswrapper[5120]: I0316 17:08:44.371925 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1f26bb19-36e1-4611-8fef-a2b16661b9f1-combined-ca-bundle\") pod \"1f26bb19-36e1-4611-8fef-a2b16661b9f1\" (UID: \"1f26bb19-36e1-4611-8fef-a2b16661b9f1\") " Mar 16 17:08:44 crc kubenswrapper[5120]: I0316 17:08:44.372090 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/1f26bb19-36e1-4611-8fef-a2b16661b9f1-config-data-default\") pod \"1f26bb19-36e1-4611-8fef-a2b16661b9f1\" (UID: \"1f26bb19-36e1-4611-8fef-a2b16661b9f1\") " Mar 16 17:08:44 crc kubenswrapper[5120]: I0316 17:08:44.372377 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/1f26bb19-36e1-4611-8fef-a2b16661b9f1-config-data-generated\") pod \"1f26bb19-36e1-4611-8fef-a2b16661b9f1\" (UID: \"1f26bb19-36e1-4611-8fef-a2b16661b9f1\") " Mar 16 17:08:44 crc kubenswrapper[5120]: I0316 17:08:44.372552 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7wnsm\" (UniqueName: \"kubernetes.io/projected/1f26bb19-36e1-4611-8fef-a2b16661b9f1-kube-api-access-7wnsm\") pod \"1f26bb19-36e1-4611-8fef-a2b16661b9f1\" (UID: \"1f26bb19-36e1-4611-8fef-a2b16661b9f1\") " Mar 16 17:08:44 crc kubenswrapper[5120]: I0316 17:08:44.372639 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/1f26bb19-36e1-4611-8fef-a2b16661b9f1-galera-tls-certs\") pod \"1f26bb19-36e1-4611-8fef-a2b16661b9f1\" (UID: \"1f26bb19-36e1-4611-8fef-a2b16661b9f1\") " Mar 16 17:08:44 crc kubenswrapper[5120]: I0316 17:08:44.372824 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"mysql-db\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"1f26bb19-36e1-4611-8fef-a2b16661b9f1\" (UID: \"1f26bb19-36e1-4611-8fef-a2b16661b9f1\") " Mar 16 17:08:44 crc kubenswrapper[5120]: I0316 17:08:44.372879 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/1f26bb19-36e1-4611-8fef-a2b16661b9f1-operator-scripts\") pod \"1f26bb19-36e1-4611-8fef-a2b16661b9f1\" (UID: \"1f26bb19-36e1-4611-8fef-a2b16661b9f1\") " Mar 16 17:08:44 crc kubenswrapper[5120]: I0316 17:08:44.376625 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f26bb19-36e1-4611-8fef-a2b16661b9f1-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "1f26bb19-36e1-4611-8fef-a2b16661b9f1" (UID: "1f26bb19-36e1-4611-8fef-a2b16661b9f1"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:08:44 crc kubenswrapper[5120]: I0316 17:08:44.385658 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/1f26bb19-36e1-4611-8fef-a2b16661b9f1-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:44 crc kubenswrapper[5120]: I0316 17:08:44.391819 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f26bb19-36e1-4611-8fef-a2b16661b9f1-config-data-default" (OuterVolumeSpecName: "config-data-default") pod "1f26bb19-36e1-4611-8fef-a2b16661b9f1" (UID: "1f26bb19-36e1-4611-8fef-a2b16661b9f1"). InnerVolumeSpecName "config-data-default". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:08:44 crc kubenswrapper[5120]: I0316 17:08:44.392385 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f26bb19-36e1-4611-8fef-a2b16661b9f1-config-data-generated" (OuterVolumeSpecName: "config-data-generated") pod "1f26bb19-36e1-4611-8fef-a2b16661b9f1" (UID: "1f26bb19-36e1-4611-8fef-a2b16661b9f1"). InnerVolumeSpecName "config-data-generated". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:08:44 crc kubenswrapper[5120]: I0316 17:08:44.392513 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f26bb19-36e1-4611-8fef-a2b16661b9f1-kube-api-access-7wnsm" (OuterVolumeSpecName: "kube-api-access-7wnsm") pod "1f26bb19-36e1-4611-8fef-a2b16661b9f1" (UID: "1f26bb19-36e1-4611-8fef-a2b16661b9f1"). InnerVolumeSpecName "kube-api-access-7wnsm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:08:44 crc kubenswrapper[5120]: I0316 17:08:44.392705 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f26bb19-36e1-4611-8fef-a2b16661b9f1-galera-tls-certs" (OuterVolumeSpecName: "galera-tls-certs") pod "1f26bb19-36e1-4611-8fef-a2b16661b9f1" (UID: "1f26bb19-36e1-4611-8fef-a2b16661b9f1"). InnerVolumeSpecName "galera-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:08:44 crc kubenswrapper[5120]: I0316 17:08:44.393191 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f26bb19-36e1-4611-8fef-a2b16661b9f1-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "1f26bb19-36e1-4611-8fef-a2b16661b9f1" (UID: "1f26bb19-36e1-4611-8fef-a2b16661b9f1"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:08:44 crc kubenswrapper[5120]: I0316 17:08:44.393251 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-d7c955d94-2dfzr"] Mar 16 17:08:44 crc kubenswrapper[5120]: I0316 17:08:44.409799 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f26bb19-36e1-4611-8fef-a2b16661b9f1-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "1f26bb19-36e1-4611-8fef-a2b16661b9f1" (UID: "1f26bb19-36e1-4611-8fef-a2b16661b9f1"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:08:44 crc kubenswrapper[5120]: I0316 17:08:44.432989 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage04-crc" (OuterVolumeSpecName: "mysql-db") pod "1f26bb19-36e1-4611-8fef-a2b16661b9f1" (UID: "1f26bb19-36e1-4611-8fef-a2b16661b9f1"). InnerVolumeSpecName "local-storage04-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 17:08:44 crc kubenswrapper[5120]: I0316 17:08:44.435816 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 17:08:44 crc kubenswrapper[5120]: I0316 17:08:44.449342 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 17:08:44 crc kubenswrapper[5120]: I0316 17:08:44.463565 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 17:08:44 crc kubenswrapper[5120]: I0316 17:08:44.497579 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 17:08:44 crc kubenswrapper[5120]: I0316 17:08:44.497745 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:08:44 crc kubenswrapper[5120]: I0316 17:08:44.511943 5120 reconciler_common.go:299] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/1f26bb19-36e1-4611-8fef-a2b16661b9f1-kolla-config\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:44 crc kubenswrapper[5120]: I0316 17:08:44.511972 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1f26bb19-36e1-4611-8fef-a2b16661b9f1-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:44 crc kubenswrapper[5120]: I0316 17:08:44.511982 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/1f26bb19-36e1-4611-8fef-a2b16661b9f1-config-data-default\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:44 crc kubenswrapper[5120]: I0316 17:08:44.511993 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/1f26bb19-36e1-4611-8fef-a2b16661b9f1-config-data-generated\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:44 crc kubenswrapper[5120]: I0316 17:08:44.512003 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7wnsm\" (UniqueName: \"kubernetes.io/projected/1f26bb19-36e1-4611-8fef-a2b16661b9f1-kube-api-access-7wnsm\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:44 crc kubenswrapper[5120]: I0316 17:08:44.512011 5120 reconciler_common.go:299] "Volume detached for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/1f26bb19-36e1-4611-8fef-a2b16661b9f1-galera-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:44 crc kubenswrapper[5120]: I0316 17:08:44.512032 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") on node \"crc\" " Mar 16 17:08:44 crc kubenswrapper[5120]: I0316 17:08:44.517444 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ovnnorthd-ovndbs\"" Mar 16 17:08:44 crc kubenswrapper[5120]: I0316 17:08:44.542182 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovnnorthd-config\"" Mar 16 17:08:44 crc kubenswrapper[5120]: I0316 17:08:44.542624 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovnnorthd-scripts\"" Mar 16 17:08:44 crc kubenswrapper[5120]: I0316 17:08:44.542929 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ovnnorthd-ovnnorthd-dockercfg-qc4rf\"" Mar 16 17:08:44 crc kubenswrapper[5120]: I0316 17:08:44.576266 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage04-crc" (UniqueName: "kubernetes.io/local-volume/local-storage04-crc") on node "crc" Mar 16 17:08:44 crc kubenswrapper[5120]: I0316 17:08:44.615293 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/617facde-390d-4bc0-b061-a5b7d7b78c8d-scripts\") pod \"ovn-northd-0\" (UID: \"617facde-390d-4bc0-b061-a5b7d7b78c8d\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:08:44 crc kubenswrapper[5120]: I0316 17:08:44.615664 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/3f98651e-6cef-4b31-8aac-46d152305e88-public-tls-certs\") pod \"barbican-api-7648f748d8-cxwnc\" (UID: \"3f98651e-6cef-4b31-8aac-46d152305e88\") " pod="openstack-kuttl-tests/barbican-api-7648f748d8-cxwnc" Mar 16 17:08:44 crc kubenswrapper[5120]: I0316 17:08:44.615841 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/617facde-390d-4bc0-b061-a5b7d7b78c8d-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"617facde-390d-4bc0-b061-a5b7d7b78c8d\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:08:44 crc kubenswrapper[5120]: I0316 17:08:44.616004 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/617facde-390d-4bc0-b061-a5b7d7b78c8d-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"617facde-390d-4bc0-b061-a5b7d7b78c8d\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:08:44 crc kubenswrapper[5120]: I0316 17:08:44.616163 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/617facde-390d-4bc0-b061-a5b7d7b78c8d-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"617facde-390d-4bc0-b061-a5b7d7b78c8d\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:08:44 crc kubenswrapper[5120]: I0316 17:08:44.616274 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/617facde-390d-4bc0-b061-a5b7d7b78c8d-config\") pod \"ovn-northd-0\" (UID: \"617facde-390d-4bc0-b061-a5b7d7b78c8d\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:08:44 crc kubenswrapper[5120]: I0316 17:08:44.616587 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/617facde-390d-4bc0-b061-a5b7d7b78c8d-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"617facde-390d-4bc0-b061-a5b7d7b78c8d\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:08:44 crc kubenswrapper[5120]: I0316 17:08:44.616907 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52jrz\" (UniqueName: \"kubernetes.io/projected/617facde-390d-4bc0-b061-a5b7d7b78c8d-kube-api-access-52jrz\") pod \"ovn-northd-0\" (UID: \"617facde-390d-4bc0-b061-a5b7d7b78c8d\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:08:44 crc kubenswrapper[5120]: I0316 17:08:44.617043 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:44 crc kubenswrapper[5120]: E0316 17:08:44.617220 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-barbican-public-svc: secret "cert-barbican-public-svc" not found Mar 16 17:08:44 crc kubenswrapper[5120]: E0316 17:08:44.618960 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f98651e-6cef-4b31-8aac-46d152305e88-public-tls-certs podName:3f98651e-6cef-4b31-8aac-46d152305e88 nodeName:}" failed. No retries permitted until 2026-03-16 17:08:52.618937912 +0000 UTC m=+5834.772869569 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/3f98651e-6cef-4b31-8aac-46d152305e88-public-tls-certs") pod "barbican-api-7648f748d8-cxwnc" (UID: "3f98651e-6cef-4b31-8aac-46d152305e88") : secret "cert-barbican-public-svc" not found Mar 16 17:08:44 crc kubenswrapper[5120]: I0316 17:08:44.684412 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="06ad2651-812c-46f9-b42d-f893b573e5c5" path="/var/lib/kubelet/pods/06ad2651-812c-46f9-b42d-f893b573e5c5/volumes" Mar 16 17:08:44 crc kubenswrapper[5120]: I0316 17:08:44.685212 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4281ec55-3466-4ca1-8054-498475a4407a" path="/var/lib/kubelet/pods/4281ec55-3466-4ca1-8054-498475a4407a/volumes" Mar 16 17:08:44 crc kubenswrapper[5120]: I0316 17:08:44.686197 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ff9b987-d4c9-427f-a8d1-0900da11bef5" path="/var/lib/kubelet/pods/6ff9b987-d4c9-427f-a8d1-0900da11bef5/volumes" Mar 16 17:08:44 crc kubenswrapper[5120]: I0316 17:08:44.688678 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7590c7f4-950a-41b1-889b-359a9a608f4f" path="/var/lib/kubelet/pods/7590c7f4-950a-41b1-889b-359a9a608f4f/volumes" Mar 16 17:08:44 crc kubenswrapper[5120]: I0316 17:08:44.690583 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:08:44 crc kubenswrapper[5120]: I0316 17:08:44.720921 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/617facde-390d-4bc0-b061-a5b7d7b78c8d-scripts\") pod \"ovn-northd-0\" (UID: \"617facde-390d-4bc0-b061-a5b7d7b78c8d\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:08:44 crc kubenswrapper[5120]: I0316 17:08:44.722043 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/617facde-390d-4bc0-b061-a5b7d7b78c8d-scripts\") pod \"ovn-northd-0\" (UID: \"617facde-390d-4bc0-b061-a5b7d7b78c8d\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:08:44 crc kubenswrapper[5120]: I0316 17:08:44.722812 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/617facde-390d-4bc0-b061-a5b7d7b78c8d-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"617facde-390d-4bc0-b061-a5b7d7b78c8d\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:08:44 crc kubenswrapper[5120]: I0316 17:08:44.722879 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/3f98651e-6cef-4b31-8aac-46d152305e88-internal-tls-certs\") pod \"barbican-api-7648f748d8-cxwnc\" (UID: \"3f98651e-6cef-4b31-8aac-46d152305e88\") " pod="openstack-kuttl-tests/barbican-api-7648f748d8-cxwnc" Mar 16 17:08:44 crc kubenswrapper[5120]: I0316 17:08:44.722923 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/617facde-390d-4bc0-b061-a5b7d7b78c8d-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"617facde-390d-4bc0-b061-a5b7d7b78c8d\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:08:44 crc kubenswrapper[5120]: I0316 17:08:44.723044 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/617facde-390d-4bc0-b061-a5b7d7b78c8d-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"617facde-390d-4bc0-b061-a5b7d7b78c8d\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:08:44 crc kubenswrapper[5120]: I0316 17:08:44.723106 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/617facde-390d-4bc0-b061-a5b7d7b78c8d-config\") pod \"ovn-northd-0\" (UID: \"617facde-390d-4bc0-b061-a5b7d7b78c8d\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:08:44 crc kubenswrapper[5120]: I0316 17:08:44.723407 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/617facde-390d-4bc0-b061-a5b7d7b78c8d-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"617facde-390d-4bc0-b061-a5b7d7b78c8d\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:08:44 crc kubenswrapper[5120]: I0316 17:08:44.723688 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-52jrz\" (UniqueName: \"kubernetes.io/projected/617facde-390d-4bc0-b061-a5b7d7b78c8d-kube-api-access-52jrz\") pod \"ovn-northd-0\" (UID: \"617facde-390d-4bc0-b061-a5b7d7b78c8d\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:08:44 crc kubenswrapper[5120]: E0316 17:08:44.724130 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-barbican-internal-svc: secret "cert-barbican-internal-svc" not found Mar 16 17:08:44 crc kubenswrapper[5120]: E0316 17:08:44.724249 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f98651e-6cef-4b31-8aac-46d152305e88-internal-tls-certs podName:3f98651e-6cef-4b31-8aac-46d152305e88 nodeName:}" failed. No retries permitted until 2026-03-16 17:08:52.724167219 +0000 UTC m=+5834.878098876 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/3f98651e-6cef-4b31-8aac-46d152305e88-internal-tls-certs") pod "barbican-api-7648f748d8-cxwnc" (UID: "3f98651e-6cef-4b31-8aac-46d152305e88") : secret "cert-barbican-internal-svc" not found Mar 16 17:08:44 crc kubenswrapper[5120]: E0316 17:08:44.724490 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-ovn-metrics: secret "cert-ovn-metrics" not found Mar 16 17:08:44 crc kubenswrapper[5120]: E0316 17:08:44.724522 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/617facde-390d-4bc0-b061-a5b7d7b78c8d-metrics-certs-tls-certs podName:617facde-390d-4bc0-b061-a5b7d7b78c8d nodeName:}" failed. No retries permitted until 2026-03-16 17:08:45.22451393 +0000 UTC m=+5827.378445587 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs-tls-certs" (UniqueName: "kubernetes.io/secret/617facde-390d-4bc0-b061-a5b7d7b78c8d-metrics-certs-tls-certs") pod "ovn-northd-0" (UID: "617facde-390d-4bc0-b061-a5b7d7b78c8d") : secret "cert-ovn-metrics" not found Mar 16 17:08:44 crc kubenswrapper[5120]: I0316 17:08:44.724979 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/617facde-390d-4bc0-b061-a5b7d7b78c8d-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"617facde-390d-4bc0-b061-a5b7d7b78c8d\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:08:44 crc kubenswrapper[5120]: E0316 17:08:44.726922 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-ovnnorthd-ovndbs: secret "cert-ovnnorthd-ovndbs" not found Mar 16 17:08:44 crc kubenswrapper[5120]: E0316 17:08:44.727011 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/617facde-390d-4bc0-b061-a5b7d7b78c8d-ovn-northd-tls-certs podName:617facde-390d-4bc0-b061-a5b7d7b78c8d nodeName:}" failed. No retries permitted until 2026-03-16 17:08:45.226993377 +0000 UTC m=+5827.380925034 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ovn-northd-tls-certs" (UniqueName: "kubernetes.io/secret/617facde-390d-4bc0-b061-a5b7d7b78c8d-ovn-northd-tls-certs") pod "ovn-northd-0" (UID: "617facde-390d-4bc0-b061-a5b7d7b78c8d") : secret "cert-ovnnorthd-ovndbs" not found Mar 16 17:08:44 crc kubenswrapper[5120]: I0316 17:08:44.727521 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/617facde-390d-4bc0-b061-a5b7d7b78c8d-config\") pod \"ovn-northd-0\" (UID: \"617facde-390d-4bc0-b061-a5b7d7b78c8d\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:08:44 crc kubenswrapper[5120]: I0316 17:08:44.737775 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/617facde-390d-4bc0-b061-a5b7d7b78c8d-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"617facde-390d-4bc0-b061-a5b7d7b78c8d\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:08:44 crc kubenswrapper[5120]: I0316 17:08:44.746976 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-52jrz\" (UniqueName: \"kubernetes.io/projected/617facde-390d-4bc0-b061-a5b7d7b78c8d-kube-api-access-52jrz\") pod \"ovn-northd-0\" (UID: \"617facde-390d-4bc0-b061-a5b7d7b78c8d\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:08:44 crc kubenswrapper[5120]: I0316 17:08:44.825429 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3f3771ee-c5b9-4004-b631-437b1508ac5a-config-data\") pod \"3f3771ee-c5b9-4004-b631-437b1508ac5a\" (UID: \"3f3771ee-c5b9-4004-b631-437b1508ac5a\") " Mar 16 17:08:44 crc kubenswrapper[5120]: I0316 17:08:44.825488 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3f3771ee-c5b9-4004-b631-437b1508ac5a-scripts\") pod \"3f3771ee-c5b9-4004-b631-437b1508ac5a\" (UID: \"3f3771ee-c5b9-4004-b631-437b1508ac5a\") " Mar 16 17:08:44 crc kubenswrapper[5120]: I0316 17:08:44.825878 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3f3771ee-c5b9-4004-b631-437b1508ac5a-combined-ca-bundle\") pod \"3f3771ee-c5b9-4004-b631-437b1508ac5a\" (UID: \"3f3771ee-c5b9-4004-b631-437b1508ac5a\") " Mar 16 17:08:44 crc kubenswrapper[5120]: I0316 17:08:44.825912 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/3f3771ee-c5b9-4004-b631-437b1508ac5a-etc-machine-id\") pod \"3f3771ee-c5b9-4004-b631-437b1508ac5a\" (UID: \"3f3771ee-c5b9-4004-b631-437b1508ac5a\") " Mar 16 17:08:44 crc kubenswrapper[5120]: I0316 17:08:44.826131 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jzthg\" (UniqueName: \"kubernetes.io/projected/3f3771ee-c5b9-4004-b631-437b1508ac5a-kube-api-access-jzthg\") pod \"3f3771ee-c5b9-4004-b631-437b1508ac5a\" (UID: \"3f3771ee-c5b9-4004-b631-437b1508ac5a\") " Mar 16 17:08:44 crc kubenswrapper[5120]: I0316 17:08:44.826264 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/3f3771ee-c5b9-4004-b631-437b1508ac5a-config-data-custom\") pod \"3f3771ee-c5b9-4004-b631-437b1508ac5a\" (UID: \"3f3771ee-c5b9-4004-b631-437b1508ac5a\") " Mar 16 17:08:44 crc kubenswrapper[5120]: I0316 17:08:44.826535 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/7a637c98-abe1-4f51-bee0-eb384fa79a43-internal-tls-certs\") pod \"placement-85687c8566-vv9qr\" (UID: \"7a637c98-abe1-4f51-bee0-eb384fa79a43\") " pod="openstack-kuttl-tests/placement-85687c8566-vv9qr" Mar 16 17:08:44 crc kubenswrapper[5120]: I0316 17:08:44.827098 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/3f3771ee-c5b9-4004-b631-437b1508ac5a-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "3f3771ee-c5b9-4004-b631-437b1508ac5a" (UID: "3f3771ee-c5b9-4004-b631-437b1508ac5a"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 17:08:44 crc kubenswrapper[5120]: E0316 17:08:44.827205 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-placement-internal-svc: secret "cert-placement-internal-svc" not found Mar 16 17:08:44 crc kubenswrapper[5120]: E0316 17:08:44.827275 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a637c98-abe1-4f51-bee0-eb384fa79a43-internal-tls-certs podName:7a637c98-abe1-4f51-bee0-eb384fa79a43 nodeName:}" failed. No retries permitted until 2026-03-16 17:08:52.827256688 +0000 UTC m=+5834.981188345 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/7a637c98-abe1-4f51-bee0-eb384fa79a43-internal-tls-certs") pod "placement-85687c8566-vv9qr" (UID: "7a637c98-abe1-4f51-bee0-eb384fa79a43") : secret "cert-placement-internal-svc" not found Mar 16 17:08:44 crc kubenswrapper[5120]: I0316 17:08:44.827513 5120 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/3f3771ee-c5b9-4004-b631-437b1508ac5a-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:44 crc kubenswrapper[5120]: I0316 17:08:44.831165 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f3771ee-c5b9-4004-b631-437b1508ac5a-scripts" (OuterVolumeSpecName: "scripts") pod "3f3771ee-c5b9-4004-b631-437b1508ac5a" (UID: "3f3771ee-c5b9-4004-b631-437b1508ac5a"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:08:44 crc kubenswrapper[5120]: I0316 17:08:44.831565 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f3771ee-c5b9-4004-b631-437b1508ac5a-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "3f3771ee-c5b9-4004-b631-437b1508ac5a" (UID: "3f3771ee-c5b9-4004-b631-437b1508ac5a"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:08:44 crc kubenswrapper[5120]: I0316 17:08:44.832141 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f3771ee-c5b9-4004-b631-437b1508ac5a-kube-api-access-jzthg" (OuterVolumeSpecName: "kube-api-access-jzthg") pod "3f3771ee-c5b9-4004-b631-437b1508ac5a" (UID: "3f3771ee-c5b9-4004-b631-437b1508ac5a"). InnerVolumeSpecName "kube-api-access-jzthg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:08:44 crc kubenswrapper[5120]: I0316 17:08:44.876947 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f3771ee-c5b9-4004-b631-437b1508ac5a-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "3f3771ee-c5b9-4004-b631-437b1508ac5a" (UID: "3f3771ee-c5b9-4004-b631-437b1508ac5a"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:08:44 crc kubenswrapper[5120]: I0316 17:08:44.916446 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f3771ee-c5b9-4004-b631-437b1508ac5a-config-data" (OuterVolumeSpecName: "config-data") pod "3f3771ee-c5b9-4004-b631-437b1508ac5a" (UID: "3f3771ee-c5b9-4004-b631-437b1508ac5a"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:08:44 crc kubenswrapper[5120]: I0316 17:08:44.929581 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/7a637c98-abe1-4f51-bee0-eb384fa79a43-public-tls-certs\") pod \"placement-85687c8566-vv9qr\" (UID: \"7a637c98-abe1-4f51-bee0-eb384fa79a43\") " pod="openstack-kuttl-tests/placement-85687c8566-vv9qr" Mar 16 17:08:44 crc kubenswrapper[5120]: E0316 17:08:44.929809 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-placement-public-svc: secret "cert-placement-public-svc" not found Mar 16 17:08:44 crc kubenswrapper[5120]: E0316 17:08:44.929913 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a637c98-abe1-4f51-bee0-eb384fa79a43-public-tls-certs podName:7a637c98-abe1-4f51-bee0-eb384fa79a43 nodeName:}" failed. No retries permitted until 2026-03-16 17:08:52.929894013 +0000 UTC m=+5835.083825660 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/7a637c98-abe1-4f51-bee0-eb384fa79a43-public-tls-certs") pod "placement-85687c8566-vv9qr" (UID: "7a637c98-abe1-4f51-bee0-eb384fa79a43") : secret "cert-placement-public-svc" not found Mar 16 17:08:44 crc kubenswrapper[5120]: I0316 17:08:44.930079 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/76f0322f-b14b-4b9b-9665-2121e3b21629-ovndb-tls-certs\") pod \"neutron-64b7569b94-dxks6\" (UID: \"76f0322f-b14b-4b9b-9665-2121e3b21629\") " pod="openstack-kuttl-tests/neutron-64b7569b94-dxks6" Mar 16 17:08:44 crc kubenswrapper[5120]: E0316 17:08:44.930238 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-neutron-ovndbs: secret "cert-neutron-ovndbs" not found Mar 16 17:08:44 crc kubenswrapper[5120]: E0316 17:08:44.930392 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76f0322f-b14b-4b9b-9665-2121e3b21629-ovndb-tls-certs podName:76f0322f-b14b-4b9b-9665-2121e3b21629 nodeName:}" failed. No retries permitted until 2026-03-16 17:08:52.930354346 +0000 UTC m=+5835.084286003 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "ovndb-tls-certs" (UniqueName: "kubernetes.io/secret/76f0322f-b14b-4b9b-9665-2121e3b21629-ovndb-tls-certs") pod "neutron-64b7569b94-dxks6" (UID: "76f0322f-b14b-4b9b-9665-2121e3b21629") : secret "cert-neutron-ovndbs" not found Mar 16 17:08:44 crc kubenswrapper[5120]: I0316 17:08:44.930867 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/76f0322f-b14b-4b9b-9665-2121e3b21629-internal-tls-certs\") pod \"neutron-64b7569b94-dxks6\" (UID: \"76f0322f-b14b-4b9b-9665-2121e3b21629\") " pod="openstack-kuttl-tests/neutron-64b7569b94-dxks6" Mar 16 17:08:44 crc kubenswrapper[5120]: E0316 17:08:44.931015 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-neutron-internal-svc: secret "cert-neutron-internal-svc" not found Mar 16 17:08:44 crc kubenswrapper[5120]: E0316 17:08:44.931088 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76f0322f-b14b-4b9b-9665-2121e3b21629-internal-tls-certs podName:76f0322f-b14b-4b9b-9665-2121e3b21629 nodeName:}" failed. No retries permitted until 2026-03-16 17:08:52.931067765 +0000 UTC m=+5835.084999432 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/76f0322f-b14b-4b9b-9665-2121e3b21629-internal-tls-certs") pod "neutron-64b7569b94-dxks6" (UID: "76f0322f-b14b-4b9b-9665-2121e3b21629") : secret "cert-neutron-internal-svc" not found Mar 16 17:08:44 crc kubenswrapper[5120]: I0316 17:08:44.931212 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/76f0322f-b14b-4b9b-9665-2121e3b21629-public-tls-certs\") pod \"neutron-64b7569b94-dxks6\" (UID: \"76f0322f-b14b-4b9b-9665-2121e3b21629\") " pod="openstack-kuttl-tests/neutron-64b7569b94-dxks6" Mar 16 17:08:44 crc kubenswrapper[5120]: E0316 17:08:44.931385 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-neutron-public-svc: secret "cert-neutron-public-svc" not found Mar 16 17:08:44 crc kubenswrapper[5120]: E0316 17:08:44.931522 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76f0322f-b14b-4b9b-9665-2121e3b21629-public-tls-certs podName:76f0322f-b14b-4b9b-9665-2121e3b21629 nodeName:}" failed. No retries permitted until 2026-03-16 17:08:52.931470286 +0000 UTC m=+5835.085401943 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/76f0322f-b14b-4b9b-9665-2121e3b21629-public-tls-certs") pod "neutron-64b7569b94-dxks6" (UID: "76f0322f-b14b-4b9b-9665-2121e3b21629") : secret "cert-neutron-public-svc" not found Mar 16 17:08:44 crc kubenswrapper[5120]: I0316 17:08:44.931640 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jzthg\" (UniqueName: \"kubernetes.io/projected/3f3771ee-c5b9-4004-b631-437b1508ac5a-kube-api-access-jzthg\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:44 crc kubenswrapper[5120]: I0316 17:08:44.931669 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/3f3771ee-c5b9-4004-b631-437b1508ac5a-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:44 crc kubenswrapper[5120]: I0316 17:08:44.931691 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3f3771ee-c5b9-4004-b631-437b1508ac5a-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:44 crc kubenswrapper[5120]: I0316 17:08:44.931731 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3f3771ee-c5b9-4004-b631-437b1508ac5a-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:44 crc kubenswrapper[5120]: I0316 17:08:44.931755 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3f3771ee-c5b9-4004-b631-437b1508ac5a-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:45 crc kubenswrapper[5120]: I0316 17:08:45.034072 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/d8ee8115-84b1-4f8e-acce-1f745eb1a339-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"d8ee8115-84b1-4f8e-acce-1f745eb1a339\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:08:45 crc kubenswrapper[5120]: E0316 17:08:45.034254 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-ceilometer-internal-svc: secret "cert-ceilometer-internal-svc" not found Mar 16 17:08:45 crc kubenswrapper[5120]: E0316 17:08:45.034863 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8ee8115-84b1-4f8e-acce-1f745eb1a339-ceilometer-tls-certs podName:d8ee8115-84b1-4f8e-acce-1f745eb1a339 nodeName:}" failed. No retries permitted until 2026-03-16 17:08:47.034819731 +0000 UTC m=+5829.188751388 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "ceilometer-tls-certs" (UniqueName: "kubernetes.io/secret/d8ee8115-84b1-4f8e-acce-1f745eb1a339-ceilometer-tls-certs") pod "ceilometer-0" (UID: "d8ee8115-84b1-4f8e-acce-1f745eb1a339") : secret "cert-ceilometer-internal-svc" not found Mar 16 17:08:45 crc kubenswrapper[5120]: I0316 17:08:45.138921 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/45defe5f-ca2f-4993-8430-d713ed1c9df0-public-tls-certs\") pod \"cinder-api-0\" (UID: \"45defe5f-ca2f-4993-8430-d713ed1c9df0\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:08:45 crc kubenswrapper[5120]: E0316 17:08:45.139171 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-cinder-public-svc: secret "cert-cinder-public-svc" not found Mar 16 17:08:45 crc kubenswrapper[5120]: E0316 17:08:45.139276 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45defe5f-ca2f-4993-8430-d713ed1c9df0-public-tls-certs podName:45defe5f-ca2f-4993-8430-d713ed1c9df0 nodeName:}" failed. No retries permitted until 2026-03-16 17:08:49.139254987 +0000 UTC m=+5831.293186644 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/45defe5f-ca2f-4993-8430-d713ed1c9df0-public-tls-certs") pod "cinder-api-0" (UID: "45defe5f-ca2f-4993-8430-d713ed1c9df0") : secret "cert-cinder-public-svc" not found Mar 16 17:08:45 crc kubenswrapper[5120]: I0316 17:08:45.242316 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/617facde-390d-4bc0-b061-a5b7d7b78c8d-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"617facde-390d-4bc0-b061-a5b7d7b78c8d\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:08:45 crc kubenswrapper[5120]: E0316 17:08:45.242799 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-ovnnorthd-ovndbs: secret "cert-ovnnorthd-ovndbs" not found Mar 16 17:08:45 crc kubenswrapper[5120]: E0316 17:08:45.243023 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/617facde-390d-4bc0-b061-a5b7d7b78c8d-ovn-northd-tls-certs podName:617facde-390d-4bc0-b061-a5b7d7b78c8d nodeName:}" failed. No retries permitted until 2026-03-16 17:08:46.242868009 +0000 UTC m=+5828.396799676 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "ovn-northd-tls-certs" (UniqueName: "kubernetes.io/secret/617facde-390d-4bc0-b061-a5b7d7b78c8d-ovn-northd-tls-certs") pod "ovn-northd-0" (UID: "617facde-390d-4bc0-b061-a5b7d7b78c8d") : secret "cert-ovnnorthd-ovndbs" not found Mar 16 17:08:45 crc kubenswrapper[5120]: I0316 17:08:45.243366 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/617facde-390d-4bc0-b061-a5b7d7b78c8d-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"617facde-390d-4bc0-b061-a5b7d7b78c8d\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:08:45 crc kubenswrapper[5120]: E0316 17:08:45.243968 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-ovn-metrics: secret "cert-ovn-metrics" not found Mar 16 17:08:45 crc kubenswrapper[5120]: E0316 17:08:45.244017 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/617facde-390d-4bc0-b061-a5b7d7b78c8d-metrics-certs-tls-certs podName:617facde-390d-4bc0-b061-a5b7d7b78c8d nodeName:}" failed. No retries permitted until 2026-03-16 17:08:46.244006041 +0000 UTC m=+5828.397937698 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs-tls-certs" (UniqueName: "kubernetes.io/secret/617facde-390d-4bc0-b061-a5b7d7b78c8d-metrics-certs-tls-certs") pod "ovn-northd-0" (UID: "617facde-390d-4bc0-b061-a5b7d7b78c8d") : secret "cert-ovn-metrics" not found Mar 16 17:08:45 crc kubenswrapper[5120]: I0316 17:08:45.278314 5120 generic.go:358] "Generic (PLEG): container finished" podID="0205947a-d88b-45b3-8dfb-67965e155ab7" containerID="aa472661815dedb1608725d2fbfcc5a464730a1bf9356da21f6903148c5bd7dd" exitCode=0 Mar 16 17:08:45 crc kubenswrapper[5120]: I0316 17:08:45.278407 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"0205947a-d88b-45b3-8dfb-67965e155ab7","Type":"ContainerDied","Data":"aa472661815dedb1608725d2fbfcc5a464730a1bf9356da21f6903148c5bd7dd"} Mar 16 17:08:45 crc kubenswrapper[5120]: I0316 17:08:45.282677 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:08:45 crc kubenswrapper[5120]: I0316 17:08:45.282730 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"3f3771ee-c5b9-4004-b631-437b1508ac5a","Type":"ContainerDied","Data":"abdf9beed650a3b1a58c273a958bb4ea37c86da23c9b785707540342f0c83536"} Mar 16 17:08:45 crc kubenswrapper[5120]: I0316 17:08:45.282798 5120 scope.go:117] "RemoveContainer" containerID="4ad7c1867c57d52a4fcc80cb4798fb797a71daf87508fcc099ea396489f4ae08" Mar 16 17:08:45 crc kubenswrapper[5120]: I0316 17:08:45.283608 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:08:45 crc kubenswrapper[5120]: I0316 17:08:45.310257 5120 scope.go:117] "RemoveContainer" containerID="f9d4176477338724d48f077eb733c4cfa2586a8f3b67c1ffb86859f778db89d5" Mar 16 17:08:45 crc kubenswrapper[5120]: I0316 17:08:45.355312 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/69bb2342-14e1-4c32-889a-e33f6ba42651-internal-tls-certs\") pod \"nova-api-0\" (UID: \"69bb2342-14e1-4c32-889a-e33f6ba42651\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:08:45 crc kubenswrapper[5120]: I0316 17:08:45.355589 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/69bb2342-14e1-4c32-889a-e33f6ba42651-public-tls-certs\") pod \"nova-api-0\" (UID: \"69bb2342-14e1-4c32-889a-e33f6ba42651\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:08:45 crc kubenswrapper[5120]: E0316 17:08:45.356053 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-nova-internal-svc: secret "cert-nova-internal-svc" not found Mar 16 17:08:45 crc kubenswrapper[5120]: E0316 17:08:45.356106 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69bb2342-14e1-4c32-889a-e33f6ba42651-internal-tls-certs podName:69bb2342-14e1-4c32-889a-e33f6ba42651 nodeName:}" failed. No retries permitted until 2026-03-16 17:08:49.356092007 +0000 UTC m=+5831.510023664 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/69bb2342-14e1-4c32-889a-e33f6ba42651-internal-tls-certs") pod "nova-api-0" (UID: "69bb2342-14e1-4c32-889a-e33f6ba42651") : secret "cert-nova-internal-svc" not found Mar 16 17:08:45 crc kubenswrapper[5120]: E0316 17:08:45.356190 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-nova-public-svc: secret "cert-nova-public-svc" not found Mar 16 17:08:45 crc kubenswrapper[5120]: E0316 17:08:45.356284 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69bb2342-14e1-4c32-889a-e33f6ba42651-public-tls-certs podName:69bb2342-14e1-4c32-889a-e33f6ba42651 nodeName:}" failed. No retries permitted until 2026-03-16 17:08:49.356262632 +0000 UTC m=+5831.510194289 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/69bb2342-14e1-4c32-889a-e33f6ba42651-public-tls-certs") pod "nova-api-0" (UID: "69bb2342-14e1-4c32-889a-e33f6ba42651") : secret "cert-nova-public-svc" not found Mar 16 17:08:45 crc kubenswrapper[5120]: I0316 17:08:45.359575 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 17:08:45 crc kubenswrapper[5120]: I0316 17:08:45.400615 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 17:08:45 crc kubenswrapper[5120]: I0316 17:08:45.436816 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 17:08:45 crc kubenswrapper[5120]: I0316 17:08:45.448368 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 17:08:45 crc kubenswrapper[5120]: I0316 17:08:45.463672 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 17:08:45 crc kubenswrapper[5120]: I0316 17:08:45.465714 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f3771ee-c5b9-4004-b631-437b1508ac5a" containerName="cinder-scheduler" Mar 16 17:08:45 crc kubenswrapper[5120]: I0316 17:08:45.465896 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f3771ee-c5b9-4004-b631-437b1508ac5a" containerName="cinder-scheduler" Mar 16 17:08:45 crc kubenswrapper[5120]: I0316 17:08:45.466013 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f3771ee-c5b9-4004-b631-437b1508ac5a" containerName="probe" Mar 16 17:08:45 crc kubenswrapper[5120]: I0316 17:08:45.466131 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f3771ee-c5b9-4004-b631-437b1508ac5a" containerName="probe" Mar 16 17:08:45 crc kubenswrapper[5120]: I0316 17:08:45.466571 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="3f3771ee-c5b9-4004-b631-437b1508ac5a" containerName="cinder-scheduler" Mar 16 17:08:45 crc kubenswrapper[5120]: I0316 17:08:45.466696 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="3f3771ee-c5b9-4004-b631-437b1508ac5a" containerName="probe" Mar 16 17:08:45 crc kubenswrapper[5120]: I0316 17:08:45.474301 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 17:08:45 crc kubenswrapper[5120]: I0316 17:08:45.474487 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:08:45 crc kubenswrapper[5120]: I0316 17:08:45.477541 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"galera-openstack-cell1-dockercfg-lq677\"" Mar 16 17:08:45 crc kubenswrapper[5120]: I0316 17:08:45.477646 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-cell1-config-data\"" Mar 16 17:08:45 crc kubenswrapper[5120]: I0316 17:08:45.477552 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-galera-openstack-cell1-svc\"" Mar 16 17:08:45 crc kubenswrapper[5120]: I0316 17:08:45.477953 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-cell1-scripts\"" Mar 16 17:08:45 crc kubenswrapper[5120]: I0316 17:08:45.483477 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 17:08:45 crc kubenswrapper[5120]: I0316 17:08:45.492238 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:08:45 crc kubenswrapper[5120]: I0316 17:08:45.493987 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-scheduler-config-data\"" Mar 16 17:08:45 crc kubenswrapper[5120]: I0316 17:08:45.496404 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 17:08:45 crc kubenswrapper[5120]: I0316 17:08:45.554167 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:08:45 crc kubenswrapper[5120]: I0316 17:08:45.565484 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6e4e8c65-5607-4f79-ba90-208ca1a32521-config-data\") pod \"cinder-scheduler-0\" (UID: \"6e4e8c65-5607-4f79-ba90-208ca1a32521\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:08:45 crc kubenswrapper[5120]: I0316 17:08:45.565562 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/6e4e8c65-5607-4f79-ba90-208ca1a32521-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"6e4e8c65-5607-4f79-ba90-208ca1a32521\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:08:45 crc kubenswrapper[5120]: I0316 17:08:45.566718 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfm2g\" (UniqueName: \"kubernetes.io/projected/6e4e8c65-5607-4f79-ba90-208ca1a32521-kube-api-access-vfm2g\") pod \"cinder-scheduler-0\" (UID: \"6e4e8c65-5607-4f79-ba90-208ca1a32521\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:08:45 crc kubenswrapper[5120]: I0316 17:08:45.566781 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6e4e8c65-5607-4f79-ba90-208ca1a32521-scripts\") pod \"cinder-scheduler-0\" (UID: \"6e4e8c65-5607-4f79-ba90-208ca1a32521\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:08:45 crc kubenswrapper[5120]: I0316 17:08:45.567049 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6e4e8c65-5607-4f79-ba90-208ca1a32521-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"6e4e8c65-5607-4f79-ba90-208ca1a32521\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:08:45 crc kubenswrapper[5120]: I0316 17:08:45.568050 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/6e4e8c65-5607-4f79-ba90-208ca1a32521-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"6e4e8c65-5607-4f79-ba90-208ca1a32521\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:08:45 crc kubenswrapper[5120]: I0316 17:08:45.668486 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0205947a-d88b-45b3-8dfb-67965e155ab7-combined-ca-bundle\") pod \"0205947a-d88b-45b3-8dfb-67965e155ab7\" (UID: \"0205947a-d88b-45b3-8dfb-67965e155ab7\") " Mar 16 17:08:45 crc kubenswrapper[5120]: I0316 17:08:45.668566 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sbzxr\" (UniqueName: \"kubernetes.io/projected/0205947a-d88b-45b3-8dfb-67965e155ab7-kube-api-access-sbzxr\") pod \"0205947a-d88b-45b3-8dfb-67965e155ab7\" (UID: \"0205947a-d88b-45b3-8dfb-67965e155ab7\") " Mar 16 17:08:45 crc kubenswrapper[5120]: I0316 17:08:45.669150 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0205947a-d88b-45b3-8dfb-67965e155ab7-config-data\") pod \"0205947a-d88b-45b3-8dfb-67965e155ab7\" (UID: \"0205947a-d88b-45b3-8dfb-67965e155ab7\") " Mar 16 17:08:45 crc kubenswrapper[5120]: I0316 17:08:45.669650 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9009d26a-9c60-48c3-981f-41e60a03545d-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"9009d26a-9c60-48c3-981f-41e60a03545d\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:08:45 crc kubenswrapper[5120]: I0316 17:08:45.669683 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6e4e8c65-5607-4f79-ba90-208ca1a32521-config-data\") pod \"cinder-scheduler-0\" (UID: \"6e4e8c65-5607-4f79-ba90-208ca1a32521\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:08:45 crc kubenswrapper[5120]: I0316 17:08:45.669706 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/6e4e8c65-5607-4f79-ba90-208ca1a32521-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"6e4e8c65-5607-4f79-ba90-208ca1a32521\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:08:45 crc kubenswrapper[5120]: I0316 17:08:45.669801 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"openstack-cell1-galera-0\" (UID: \"9009d26a-9c60-48c3-981f-41e60a03545d\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:08:45 crc kubenswrapper[5120]: I0316 17:08:45.669904 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9009d26a-9c60-48c3-981f-41e60a03545d-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"9009d26a-9c60-48c3-981f-41e60a03545d\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:08:45 crc kubenswrapper[5120]: I0316 17:08:45.669974 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/9009d26a-9c60-48c3-981f-41e60a03545d-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"9009d26a-9c60-48c3-981f-41e60a03545d\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:08:45 crc kubenswrapper[5120]: I0316 17:08:45.670070 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7sp7\" (UniqueName: \"kubernetes.io/projected/9009d26a-9c60-48c3-981f-41e60a03545d-kube-api-access-h7sp7\") pod \"openstack-cell1-galera-0\" (UID: \"9009d26a-9c60-48c3-981f-41e60a03545d\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:08:45 crc kubenswrapper[5120]: I0316 17:08:45.670174 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vfm2g\" (UniqueName: \"kubernetes.io/projected/6e4e8c65-5607-4f79-ba90-208ca1a32521-kube-api-access-vfm2g\") pod \"cinder-scheduler-0\" (UID: \"6e4e8c65-5607-4f79-ba90-208ca1a32521\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:08:45 crc kubenswrapper[5120]: I0316 17:08:45.670243 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6e4e8c65-5607-4f79-ba90-208ca1a32521-scripts\") pod \"cinder-scheduler-0\" (UID: \"6e4e8c65-5607-4f79-ba90-208ca1a32521\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:08:45 crc kubenswrapper[5120]: I0316 17:08:45.671942 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6e4e8c65-5607-4f79-ba90-208ca1a32521-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"6e4e8c65-5607-4f79-ba90-208ca1a32521\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:08:45 crc kubenswrapper[5120]: I0316 17:08:45.672058 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/9009d26a-9c60-48c3-981f-41e60a03545d-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"9009d26a-9c60-48c3-981f-41e60a03545d\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:08:45 crc kubenswrapper[5120]: I0316 17:08:45.672095 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/9009d26a-9c60-48c3-981f-41e60a03545d-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"9009d26a-9c60-48c3-981f-41e60a03545d\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:08:45 crc kubenswrapper[5120]: I0316 17:08:45.672183 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/9009d26a-9c60-48c3-981f-41e60a03545d-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"9009d26a-9c60-48c3-981f-41e60a03545d\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:08:45 crc kubenswrapper[5120]: I0316 17:08:45.672316 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/6e4e8c65-5607-4f79-ba90-208ca1a32521-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"6e4e8c65-5607-4f79-ba90-208ca1a32521\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:08:45 crc kubenswrapper[5120]: I0316 17:08:45.672534 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/6e4e8c65-5607-4f79-ba90-208ca1a32521-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"6e4e8c65-5607-4f79-ba90-208ca1a32521\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:08:45 crc kubenswrapper[5120]: I0316 17:08:45.674839 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/6e4e8c65-5607-4f79-ba90-208ca1a32521-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"6e4e8c65-5607-4f79-ba90-208ca1a32521\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:08:45 crc kubenswrapper[5120]: I0316 17:08:45.676357 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6e4e8c65-5607-4f79-ba90-208ca1a32521-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"6e4e8c65-5607-4f79-ba90-208ca1a32521\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:08:45 crc kubenswrapper[5120]: I0316 17:08:45.682035 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6e4e8c65-5607-4f79-ba90-208ca1a32521-config-data\") pod \"cinder-scheduler-0\" (UID: \"6e4e8c65-5607-4f79-ba90-208ca1a32521\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:08:45 crc kubenswrapper[5120]: I0316 17:08:45.686452 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6e4e8c65-5607-4f79-ba90-208ca1a32521-scripts\") pod \"cinder-scheduler-0\" (UID: \"6e4e8c65-5607-4f79-ba90-208ca1a32521\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:08:45 crc kubenswrapper[5120]: I0316 17:08:45.688264 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfm2g\" (UniqueName: \"kubernetes.io/projected/6e4e8c65-5607-4f79-ba90-208ca1a32521-kube-api-access-vfm2g\") pod \"cinder-scheduler-0\" (UID: \"6e4e8c65-5607-4f79-ba90-208ca1a32521\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:08:45 crc kubenswrapper[5120]: I0316 17:08:45.688698 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0205947a-d88b-45b3-8dfb-67965e155ab7-kube-api-access-sbzxr" (OuterVolumeSpecName: "kube-api-access-sbzxr") pod "0205947a-d88b-45b3-8dfb-67965e155ab7" (UID: "0205947a-d88b-45b3-8dfb-67965e155ab7"). InnerVolumeSpecName "kube-api-access-sbzxr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:08:45 crc kubenswrapper[5120]: I0316 17:08:45.699347 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0205947a-d88b-45b3-8dfb-67965e155ab7-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "0205947a-d88b-45b3-8dfb-67965e155ab7" (UID: "0205947a-d88b-45b3-8dfb-67965e155ab7"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:08:45 crc kubenswrapper[5120]: I0316 17:08:45.700169 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0205947a-d88b-45b3-8dfb-67965e155ab7-config-data" (OuterVolumeSpecName: "config-data") pod "0205947a-d88b-45b3-8dfb-67965e155ab7" (UID: "0205947a-d88b-45b3-8dfb-67965e155ab7"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:08:45 crc kubenswrapper[5120]: I0316 17:08:45.775361 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h7sp7\" (UniqueName: \"kubernetes.io/projected/9009d26a-9c60-48c3-981f-41e60a03545d-kube-api-access-h7sp7\") pod \"openstack-cell1-galera-0\" (UID: \"9009d26a-9c60-48c3-981f-41e60a03545d\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:08:45 crc kubenswrapper[5120]: I0316 17:08:45.775699 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/9009d26a-9c60-48c3-981f-41e60a03545d-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"9009d26a-9c60-48c3-981f-41e60a03545d\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:08:45 crc kubenswrapper[5120]: I0316 17:08:45.775720 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/9009d26a-9c60-48c3-981f-41e60a03545d-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"9009d26a-9c60-48c3-981f-41e60a03545d\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:08:45 crc kubenswrapper[5120]: I0316 17:08:45.775807 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/9009d26a-9c60-48c3-981f-41e60a03545d-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"9009d26a-9c60-48c3-981f-41e60a03545d\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:08:45 crc kubenswrapper[5120]: I0316 17:08:45.776087 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9009d26a-9c60-48c3-981f-41e60a03545d-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"9009d26a-9c60-48c3-981f-41e60a03545d\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:08:45 crc kubenswrapper[5120]: I0316 17:08:45.776789 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/9009d26a-9c60-48c3-981f-41e60a03545d-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"9009d26a-9c60-48c3-981f-41e60a03545d\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:08:45 crc kubenswrapper[5120]: I0316 17:08:45.776816 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"openstack-cell1-galera-0\" (UID: \"9009d26a-9c60-48c3-981f-41e60a03545d\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:08:45 crc kubenswrapper[5120]: I0316 17:08:45.776939 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9009d26a-9c60-48c3-981f-41e60a03545d-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"9009d26a-9c60-48c3-981f-41e60a03545d\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:08:45 crc kubenswrapper[5120]: I0316 17:08:45.777007 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/9009d26a-9c60-48c3-981f-41e60a03545d-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"9009d26a-9c60-48c3-981f-41e60a03545d\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:08:45 crc kubenswrapper[5120]: I0316 17:08:45.777125 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0205947a-d88b-45b3-8dfb-67965e155ab7-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:45 crc kubenswrapper[5120]: I0316 17:08:45.777145 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sbzxr\" (UniqueName: \"kubernetes.io/projected/0205947a-d88b-45b3-8dfb-67965e155ab7-kube-api-access-sbzxr\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:45 crc kubenswrapper[5120]: I0316 17:08:45.777165 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0205947a-d88b-45b3-8dfb-67965e155ab7-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:45 crc kubenswrapper[5120]: I0316 17:08:45.777185 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"openstack-cell1-galera-0\" (UID: \"9009d26a-9c60-48c3-981f-41e60a03545d\") device mount path \"/mnt/openstack/pv04\"" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:08:45 crc kubenswrapper[5120]: I0316 17:08:45.777403 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9009d26a-9c60-48c3-981f-41e60a03545d-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"9009d26a-9c60-48c3-981f-41e60a03545d\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:08:45 crc kubenswrapper[5120]: I0316 17:08:45.777616 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/9009d26a-9c60-48c3-981f-41e60a03545d-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"9009d26a-9c60-48c3-981f-41e60a03545d\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:08:45 crc kubenswrapper[5120]: I0316 17:08:45.777698 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/9009d26a-9c60-48c3-981f-41e60a03545d-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"9009d26a-9c60-48c3-981f-41e60a03545d\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:08:45 crc kubenswrapper[5120]: I0316 17:08:45.781011 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9009d26a-9c60-48c3-981f-41e60a03545d-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"9009d26a-9c60-48c3-981f-41e60a03545d\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:08:45 crc kubenswrapper[5120]: I0316 17:08:45.781443 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/9009d26a-9c60-48c3-981f-41e60a03545d-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"9009d26a-9c60-48c3-981f-41e60a03545d\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:08:45 crc kubenswrapper[5120]: I0316 17:08:45.794482 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7sp7\" (UniqueName: \"kubernetes.io/projected/9009d26a-9c60-48c3-981f-41e60a03545d-kube-api-access-h7sp7\") pod \"openstack-cell1-galera-0\" (UID: \"9009d26a-9c60-48c3-981f-41e60a03545d\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:08:45 crc kubenswrapper[5120]: I0316 17:08:45.802313 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"openstack-cell1-galera-0\" (UID: \"9009d26a-9c60-48c3-981f-41e60a03545d\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:08:45 crc kubenswrapper[5120]: I0316 17:08:45.875464 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:08:45 crc kubenswrapper[5120]: I0316 17:08:45.883220 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:08:46 crc kubenswrapper[5120]: I0316 17:08:46.085475 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/15200613-4843-450f-bf1e-e7b152c48f43-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"15200613-4843-450f-bf1e-e7b152c48f43\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:08:46 crc kubenswrapper[5120]: E0316 17:08:46.085680 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-glance-default-public-svc: secret "cert-glance-default-public-svc" not found Mar 16 17:08:46 crc kubenswrapper[5120]: E0316 17:08:46.086033 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15200613-4843-450f-bf1e-e7b152c48f43-public-tls-certs podName:15200613-4843-450f-bf1e-e7b152c48f43 nodeName:}" failed. No retries permitted until 2026-03-16 17:08:50.086007801 +0000 UTC m=+5832.239939458 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/15200613-4843-450f-bf1e-e7b152c48f43-public-tls-certs") pod "glance-default-external-api-0" (UID: "15200613-4843-450f-bf1e-e7b152c48f43") : secret "cert-glance-default-public-svc" not found Mar 16 17:08:46 crc kubenswrapper[5120]: I0316 17:08:46.294957 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/617facde-390d-4bc0-b061-a5b7d7b78c8d-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"617facde-390d-4bc0-b061-a5b7d7b78c8d\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:08:46 crc kubenswrapper[5120]: E0316 17:08:46.295114 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-ovn-metrics: secret "cert-ovn-metrics" not found Mar 16 17:08:46 crc kubenswrapper[5120]: E0316 17:08:46.295189 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/617facde-390d-4bc0-b061-a5b7d7b78c8d-metrics-certs-tls-certs podName:617facde-390d-4bc0-b061-a5b7d7b78c8d nodeName:}" failed. No retries permitted until 2026-03-16 17:08:48.295169789 +0000 UTC m=+5830.449101446 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs-tls-certs" (UniqueName: "kubernetes.io/secret/617facde-390d-4bc0-b061-a5b7d7b78c8d-metrics-certs-tls-certs") pod "ovn-northd-0" (UID: "617facde-390d-4bc0-b061-a5b7d7b78c8d") : secret "cert-ovn-metrics" not found Mar 16 17:08:46 crc kubenswrapper[5120]: I0316 17:08:46.295488 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/617facde-390d-4bc0-b061-a5b7d7b78c8d-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"617facde-390d-4bc0-b061-a5b7d7b78c8d\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:08:46 crc kubenswrapper[5120]: E0316 17:08:46.295614 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-ovnnorthd-ovndbs: secret "cert-ovnnorthd-ovndbs" not found Mar 16 17:08:46 crc kubenswrapper[5120]: E0316 17:08:46.295652 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/617facde-390d-4bc0-b061-a5b7d7b78c8d-ovn-northd-tls-certs podName:617facde-390d-4bc0-b061-a5b7d7b78c8d nodeName:}" failed. No retries permitted until 2026-03-16 17:08:48.295641062 +0000 UTC m=+5830.449572719 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "ovn-northd-tls-certs" (UniqueName: "kubernetes.io/secret/617facde-390d-4bc0-b061-a5b7d7b78c8d-ovn-northd-tls-certs") pod "ovn-northd-0" (UID: "617facde-390d-4bc0-b061-a5b7d7b78c8d") : secret "cert-ovnnorthd-ovndbs" not found Mar 16 17:08:46 crc kubenswrapper[5120]: I0316 17:08:46.296942 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:08:46 crc kubenswrapper[5120]: I0316 17:08:46.296935 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"0205947a-d88b-45b3-8dfb-67965e155ab7","Type":"ContainerDied","Data":"3541add131a22b2412845bcd1022d8ef007e8dbb3d9243756c3276c9b12157f6"} Mar 16 17:08:46 crc kubenswrapper[5120]: I0316 17:08:46.297013 5120 scope.go:117] "RemoveContainer" containerID="aa472661815dedb1608725d2fbfcc5a464730a1bf9356da21f6903148c5bd7dd" Mar 16 17:08:46 crc kubenswrapper[5120]: I0316 17:08:46.310345 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"9a997459-37ba-46a9-9cb8-075f77fa009f","Type":"ContainerDied","Data":"42b3134c7d5cdc4ab6cd16467e7527ff5871c8a605e0d6e3cc919d98453fc2ac"} Mar 16 17:08:46 crc kubenswrapper[5120]: I0316 17:08:46.311041 5120 scope.go:117] "RemoveContainer" containerID="42b3134c7d5cdc4ab6cd16467e7527ff5871c8a605e0d6e3cc919d98453fc2ac" Mar 16 17:08:46 crc kubenswrapper[5120]: I0316 17:08:46.311713 5120 generic.go:358] "Generic (PLEG): container finished" podID="9a997459-37ba-46a9-9cb8-075f77fa009f" containerID="42b3134c7d5cdc4ab6cd16467e7527ff5871c8a605e0d6e3cc919d98453fc2ac" exitCode=1 Mar 16 17:08:46 crc kubenswrapper[5120]: W0316 17:08:46.373995 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9009d26a_9c60_48c3_981f_41e60a03545d.slice/crio-bc558bce5b50dd6107dff1ac3ba371642e0bc73e37596fbd0b59433f72a841bb WatchSource:0}: Error finding container bc558bce5b50dd6107dff1ac3ba371642e0bc73e37596fbd0b59433f72a841bb: Status 404 returned error can't find the container with id bc558bce5b50dd6107dff1ac3ba371642e0bc73e37596fbd0b59433f72a841bb Mar 16 17:08:46 crc kubenswrapper[5120]: I0316 17:08:46.389899 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 17:08:46 crc kubenswrapper[5120]: I0316 17:08:46.408974 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 17:08:46 crc kubenswrapper[5120]: I0316 17:08:46.420573 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 17:08:46 crc kubenswrapper[5120]: I0316 17:08:46.432855 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 17:08:46 crc kubenswrapper[5120]: I0316 17:08:46.435146 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0205947a-d88b-45b3-8dfb-67965e155ab7" containerName="nova-scheduler-scheduler" Mar 16 17:08:46 crc kubenswrapper[5120]: I0316 17:08:46.435169 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="0205947a-d88b-45b3-8dfb-67965e155ab7" containerName="nova-scheduler-scheduler" Mar 16 17:08:46 crc kubenswrapper[5120]: I0316 17:08:46.435368 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="0205947a-d88b-45b3-8dfb-67965e155ab7" containerName="nova-scheduler-scheduler" Mar 16 17:08:46 crc kubenswrapper[5120]: I0316 17:08:46.443082 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:08:46 crc kubenswrapper[5120]: I0316 17:08:46.444200 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 17:08:46 crc kubenswrapper[5120]: I0316 17:08:46.446057 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-scheduler-config-data\"" Mar 16 17:08:46 crc kubenswrapper[5120]: I0316 17:08:46.456602 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 17:08:46 crc kubenswrapper[5120]: I0316 17:08:46.505659 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/32194c8a-90a1-4132-9b75-3882418d7f7d-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"32194c8a-90a1-4132-9b75-3882418d7f7d\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:08:46 crc kubenswrapper[5120]: I0316 17:08:46.505967 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/32194c8a-90a1-4132-9b75-3882418d7f7d-config-data\") pod \"nova-scheduler-0\" (UID: \"32194c8a-90a1-4132-9b75-3882418d7f7d\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:08:46 crc kubenswrapper[5120]: I0316 17:08:46.506448 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l45c5\" (UniqueName: \"kubernetes.io/projected/32194c8a-90a1-4132-9b75-3882418d7f7d-kube-api-access-l45c5\") pod \"nova-scheduler-0\" (UID: \"32194c8a-90a1-4132-9b75-3882418d7f7d\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:08:46 crc kubenswrapper[5120]: I0316 17:08:46.609061 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/32194c8a-90a1-4132-9b75-3882418d7f7d-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"32194c8a-90a1-4132-9b75-3882418d7f7d\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:08:46 crc kubenswrapper[5120]: I0316 17:08:46.609216 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/32194c8a-90a1-4132-9b75-3882418d7f7d-config-data\") pod \"nova-scheduler-0\" (UID: \"32194c8a-90a1-4132-9b75-3882418d7f7d\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:08:46 crc kubenswrapper[5120]: I0316 17:08:46.609591 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l45c5\" (UniqueName: \"kubernetes.io/projected/32194c8a-90a1-4132-9b75-3882418d7f7d-kube-api-access-l45c5\") pod \"nova-scheduler-0\" (UID: \"32194c8a-90a1-4132-9b75-3882418d7f7d\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:08:46 crc kubenswrapper[5120]: I0316 17:08:46.614379 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/32194c8a-90a1-4132-9b75-3882418d7f7d-config-data\") pod \"nova-scheduler-0\" (UID: \"32194c8a-90a1-4132-9b75-3882418d7f7d\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:08:46 crc kubenswrapper[5120]: I0316 17:08:46.616796 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/32194c8a-90a1-4132-9b75-3882418d7f7d-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"32194c8a-90a1-4132-9b75-3882418d7f7d\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:08:46 crc kubenswrapper[5120]: I0316 17:08:46.630384 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l45c5\" (UniqueName: \"kubernetes.io/projected/32194c8a-90a1-4132-9b75-3882418d7f7d-kube-api-access-l45c5\") pod \"nova-scheduler-0\" (UID: \"32194c8a-90a1-4132-9b75-3882418d7f7d\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:08:46 crc kubenswrapper[5120]: I0316 17:08:46.676586 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0205947a-d88b-45b3-8dfb-67965e155ab7" path="/var/lib/kubelet/pods/0205947a-d88b-45b3-8dfb-67965e155ab7/volumes" Mar 16 17:08:46 crc kubenswrapper[5120]: I0316 17:08:46.678129 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f26bb19-36e1-4611-8fef-a2b16661b9f1" path="/var/lib/kubelet/pods/1f26bb19-36e1-4611-8fef-a2b16661b9f1/volumes" Mar 16 17:08:46 crc kubenswrapper[5120]: I0316 17:08:46.678630 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3f3771ee-c5b9-4004-b631-437b1508ac5a" path="/var/lib/kubelet/pods/3f3771ee-c5b9-4004-b631-437b1508ac5a/volumes" Mar 16 17:08:46 crc kubenswrapper[5120]: I0316 17:08:46.713732 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:08:47 crc kubenswrapper[5120]: I0316 17:08:47.130609 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:08:47 crc kubenswrapper[5120]: E0316 17:08:47.130812 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-nova-novncproxy-cell1-public-svc: secret "cert-nova-novncproxy-cell1-public-svc" not found Mar 16 17:08:47 crc kubenswrapper[5120]: E0316 17:08:47.131127 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3-nova-novncproxy-tls-certs podName:eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3 nodeName:}" failed. No retries permitted until 2026-03-16 17:08:55.131102451 +0000 UTC m=+5837.285034108 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "nova-novncproxy-tls-certs" (UniqueName: "kubernetes.io/secret/eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3-nova-novncproxy-tls-certs") pod "nova-cell1-novncproxy-0" (UID: "eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3") : secret "cert-nova-novncproxy-cell1-public-svc" not found Mar 16 17:08:47 crc kubenswrapper[5120]: I0316 17:08:47.131307 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:08:47 crc kubenswrapper[5120]: I0316 17:08:47.131380 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/a96c9fab-fbd4-459d-90a5-ca103703bfc9-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"a96c9fab-fbd4-459d-90a5-ca103703bfc9\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:08:47 crc kubenswrapper[5120]: E0316 17:08:47.131450 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-nova-novncproxy-cell1-vencrypt: secret "cert-nova-novncproxy-cell1-vencrypt" not found Mar 16 17:08:47 crc kubenswrapper[5120]: E0316 17:08:47.131463 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-ovndbcluster-sb-ovndbs: secret "cert-ovndbcluster-sb-ovndbs" not found Mar 16 17:08:47 crc kubenswrapper[5120]: E0316 17:08:47.131551 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3-vencrypt-tls-certs podName:eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3 nodeName:}" failed. No retries permitted until 2026-03-16 17:08:55.131526454 +0000 UTC m=+5837.285458111 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "vencrypt-tls-certs" (UniqueName: "kubernetes.io/secret/eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3-vencrypt-tls-certs") pod "nova-cell1-novncproxy-0" (UID: "eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3") : secret "cert-nova-novncproxy-cell1-vencrypt" not found Mar 16 17:08:47 crc kubenswrapper[5120]: E0316 17:08:47.131617 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a96c9fab-fbd4-459d-90a5-ca103703bfc9-ovsdbserver-sb-tls-certs podName:a96c9fab-fbd4-459d-90a5-ca103703bfc9 nodeName:}" failed. No retries permitted until 2026-03-16 17:08:55.131603206 +0000 UTC m=+5837.285534873 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "ovsdbserver-sb-tls-certs" (UniqueName: "kubernetes.io/secret/a96c9fab-fbd4-459d-90a5-ca103703bfc9-ovsdbserver-sb-tls-certs") pod "ovsdbserver-sb-0" (UID: "a96c9fab-fbd4-459d-90a5-ca103703bfc9") : secret "cert-ovndbcluster-sb-ovndbs" not found Mar 16 17:08:47 crc kubenswrapper[5120]: I0316 17:08:47.131703 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/a96c9fab-fbd4-459d-90a5-ca103703bfc9-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"a96c9fab-fbd4-459d-90a5-ca103703bfc9\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:08:47 crc kubenswrapper[5120]: E0316 17:08:47.131837 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-ovn-metrics: secret "cert-ovn-metrics" not found Mar 16 17:08:47 crc kubenswrapper[5120]: E0316 17:08:47.131899 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a96c9fab-fbd4-459d-90a5-ca103703bfc9-metrics-certs-tls-certs podName:a96c9fab-fbd4-459d-90a5-ca103703bfc9 nodeName:}" failed. No retries permitted until 2026-03-16 17:08:55.131885513 +0000 UTC m=+5837.285817290 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs-tls-certs" (UniqueName: "kubernetes.io/secret/a96c9fab-fbd4-459d-90a5-ca103703bfc9-metrics-certs-tls-certs") pod "ovsdbserver-sb-0" (UID: "a96c9fab-fbd4-459d-90a5-ca103703bfc9") : secret "cert-ovn-metrics" not found Mar 16 17:08:47 crc kubenswrapper[5120]: I0316 17:08:47.132323 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/d8ee8115-84b1-4f8e-acce-1f745eb1a339-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"d8ee8115-84b1-4f8e-acce-1f745eb1a339\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:08:47 crc kubenswrapper[5120]: E0316 17:08:47.132473 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-ceilometer-internal-svc: secret "cert-ceilometer-internal-svc" not found Mar 16 17:08:47 crc kubenswrapper[5120]: E0316 17:08:47.132531 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8ee8115-84b1-4f8e-acce-1f745eb1a339-ceilometer-tls-certs podName:d8ee8115-84b1-4f8e-acce-1f745eb1a339 nodeName:}" failed. No retries permitted until 2026-03-16 17:08:51.1325224 +0000 UTC m=+5833.286454057 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "ceilometer-tls-certs" (UniqueName: "kubernetes.io/secret/d8ee8115-84b1-4f8e-acce-1f745eb1a339-ceilometer-tls-certs") pod "ceilometer-0" (UID: "d8ee8115-84b1-4f8e-acce-1f745eb1a339") : secret "cert-ceilometer-internal-svc" not found Mar 16 17:08:47 crc kubenswrapper[5120]: I0316 17:08:47.177649 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 17:08:47 crc kubenswrapper[5120]: I0316 17:08:47.326384 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"32194c8a-90a1-4132-9b75-3882418d7f7d","Type":"ContainerStarted","Data":"e0365d1b14b4166167d9eecf9dcb3f90cd1da385a725c2311a91877bb496df23"} Mar 16 17:08:47 crc kubenswrapper[5120]: I0316 17:08:47.329873 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"6e4e8c65-5607-4f79-ba90-208ca1a32521","Type":"ContainerStarted","Data":"3e8b71b950bf390402480c1399c32a4782772e498df0022e04eb4416ca056fdf"} Mar 16 17:08:47 crc kubenswrapper[5120]: I0316 17:08:47.329905 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"6e4e8c65-5607-4f79-ba90-208ca1a32521","Type":"ContainerStarted","Data":"31e30d7229add62f5f93ae2a06085a6b83f5b0d25512fb9ca09f0389c4ff6a62"} Mar 16 17:08:47 crc kubenswrapper[5120]: I0316 17:08:47.333391 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"9009d26a-9c60-48c3-981f-41e60a03545d","Type":"ContainerStarted","Data":"15391224417c302e54e42e40b0f9c3068ad4bfa0470ea89ee0df220ceb40a6e2"} Mar 16 17:08:47 crc kubenswrapper[5120]: I0316 17:08:47.333448 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"9009d26a-9c60-48c3-981f-41e60a03545d","Type":"ContainerStarted","Data":"bc558bce5b50dd6107dff1ac3ba371642e0bc73e37596fbd0b59433f72a841bb"} Mar 16 17:08:47 crc kubenswrapper[5120]: I0316 17:08:47.337735 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/10bd837b-2e0d-460b-a254-20e23b6768f7-memcached-tls-certs\") pod \"memcached-0\" (UID: \"10bd837b-2e0d-460b-a254-20e23b6768f7\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 17:08:47 crc kubenswrapper[5120]: E0316 17:08:47.337883 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-memcached-svc: secret "cert-memcached-svc" not found Mar 16 17:08:47 crc kubenswrapper[5120]: E0316 17:08:47.337963 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10bd837b-2e0d-460b-a254-20e23b6768f7-memcached-tls-certs podName:10bd837b-2e0d-460b-a254-20e23b6768f7 nodeName:}" failed. No retries permitted until 2026-03-16 17:08:55.337941865 +0000 UTC m=+5837.491873522 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "memcached-tls-certs" (UniqueName: "kubernetes.io/secret/10bd837b-2e0d-460b-a254-20e23b6768f7-memcached-tls-certs") pod "memcached-0" (UID: "10bd837b-2e0d-460b-a254-20e23b6768f7") : secret "cert-memcached-svc" not found Mar 16 17:08:47 crc kubenswrapper[5120]: I0316 17:08:47.345436 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"9a997459-37ba-46a9-9cb8-075f77fa009f","Type":"ContainerStarted","Data":"42045ce1645b68cad8b1bbbfc95aca5ef9dc16d881fd98903c7824b31f5fd0cf"} Mar 16 17:08:47 crc kubenswrapper[5120]: I0316 17:08:47.345789 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 17:08:47 crc kubenswrapper[5120]: I0316 17:08:47.440392 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/cde31df2-efeb-4fee-b565-f24b7eaeff60-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"cde31df2-efeb-4fee-b565-f24b7eaeff60\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:08:47 crc kubenswrapper[5120]: I0316 17:08:47.441495 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/cde31df2-efeb-4fee-b565-f24b7eaeff60-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"cde31df2-efeb-4fee-b565-f24b7eaeff60\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:08:47 crc kubenswrapper[5120]: E0316 17:08:47.441876 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-ovndbcluster-nb-ovndbs: secret "cert-ovndbcluster-nb-ovndbs" not found Mar 16 17:08:47 crc kubenswrapper[5120]: E0316 17:08:47.441915 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-ovn-metrics: secret "cert-ovn-metrics" not found Mar 16 17:08:47 crc kubenswrapper[5120]: E0316 17:08:47.441935 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cde31df2-efeb-4fee-b565-f24b7eaeff60-ovsdbserver-nb-tls-certs podName:cde31df2-efeb-4fee-b565-f24b7eaeff60 nodeName:}" failed. No retries permitted until 2026-03-16 17:08:55.441920068 +0000 UTC m=+5837.595851725 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "ovsdbserver-nb-tls-certs" (UniqueName: "kubernetes.io/secret/cde31df2-efeb-4fee-b565-f24b7eaeff60-ovsdbserver-nb-tls-certs") pod "ovsdbserver-nb-0" (UID: "cde31df2-efeb-4fee-b565-f24b7eaeff60") : secret "cert-ovndbcluster-nb-ovndbs" not found Mar 16 17:08:47 crc kubenswrapper[5120]: E0316 17:08:47.442050 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cde31df2-efeb-4fee-b565-f24b7eaeff60-metrics-certs-tls-certs podName:cde31df2-efeb-4fee-b565-f24b7eaeff60 nodeName:}" failed. No retries permitted until 2026-03-16 17:08:55.44202275 +0000 UTC m=+5837.595954417 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs-tls-certs" (UniqueName: "kubernetes.io/secret/cde31df2-efeb-4fee-b565-f24b7eaeff60-metrics-certs-tls-certs") pod "ovsdbserver-nb-0" (UID: "cde31df2-efeb-4fee-b565-f24b7eaeff60") : secret "cert-ovn-metrics" not found Mar 16 17:08:48 crc kubenswrapper[5120]: I0316 17:08:48.061278 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/ab5d1889-4b15-4b9d-92fb-838a10dc858f-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"ab5d1889-4b15-4b9d-92fb-838a10dc858f\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:08:48 crc kubenswrapper[5120]: E0316 17:08:48.061873 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-galera-openstack-svc: secret "cert-galera-openstack-svc" not found Mar 16 17:08:48 crc kubenswrapper[5120]: E0316 17:08:48.061954 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab5d1889-4b15-4b9d-92fb-838a10dc858f-galera-tls-certs podName:ab5d1889-4b15-4b9d-92fb-838a10dc858f nodeName:}" failed. No retries permitted until 2026-03-16 17:08:56.061933196 +0000 UTC m=+5838.215864863 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "galera-tls-certs" (UniqueName: "kubernetes.io/secret/ab5d1889-4b15-4b9d-92fb-838a10dc858f-galera-tls-certs") pod "openstack-galera-0" (UID: "ab5d1889-4b15-4b9d-92fb-838a10dc858f") : secret "cert-galera-openstack-svc" not found Mar 16 17:08:48 crc kubenswrapper[5120]: I0316 17:08:48.373394 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/617facde-390d-4bc0-b061-a5b7d7b78c8d-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"617facde-390d-4bc0-b061-a5b7d7b78c8d\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:08:48 crc kubenswrapper[5120]: I0316 17:08:48.373961 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/617facde-390d-4bc0-b061-a5b7d7b78c8d-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"617facde-390d-4bc0-b061-a5b7d7b78c8d\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:08:48 crc kubenswrapper[5120]: E0316 17:08:48.374255 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-ovnnorthd-ovndbs: secret "cert-ovnnorthd-ovndbs" not found Mar 16 17:08:48 crc kubenswrapper[5120]: E0316 17:08:48.374338 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/617facde-390d-4bc0-b061-a5b7d7b78c8d-ovn-northd-tls-certs podName:617facde-390d-4bc0-b061-a5b7d7b78c8d nodeName:}" failed. No retries permitted until 2026-03-16 17:08:52.374318265 +0000 UTC m=+5834.528249922 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "ovn-northd-tls-certs" (UniqueName: "kubernetes.io/secret/617facde-390d-4bc0-b061-a5b7d7b78c8d-ovn-northd-tls-certs") pod "ovn-northd-0" (UID: "617facde-390d-4bc0-b061-a5b7d7b78c8d") : secret "cert-ovnnorthd-ovndbs" not found Mar 16 17:08:48 crc kubenswrapper[5120]: E0316 17:08:48.374925 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-ovn-metrics: secret "cert-ovn-metrics" not found Mar 16 17:08:48 crc kubenswrapper[5120]: E0316 17:08:48.374975 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/617facde-390d-4bc0-b061-a5b7d7b78c8d-metrics-certs-tls-certs podName:617facde-390d-4bc0-b061-a5b7d7b78c8d nodeName:}" failed. No retries permitted until 2026-03-16 17:08:52.374956373 +0000 UTC m=+5834.528888030 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs-tls-certs" (UniqueName: "kubernetes.io/secret/617facde-390d-4bc0-b061-a5b7d7b78c8d-metrics-certs-tls-certs") pod "ovn-northd-0" (UID: "617facde-390d-4bc0-b061-a5b7d7b78c8d") : secret "cert-ovn-metrics" not found Mar 16 17:08:48 crc kubenswrapper[5120]: I0316 17:08:48.387450 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"32194c8a-90a1-4132-9b75-3882418d7f7d","Type":"ContainerStarted","Data":"bbcffb8c84703cef27f1a9a537df36babdb550b7a8ff5473f1bb80d9395d63f6"} Mar 16 17:08:48 crc kubenswrapper[5120]: I0316 17:08:48.392255 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"6e4e8c65-5607-4f79-ba90-208ca1a32521","Type":"ContainerStarted","Data":"8068446c44f56d29481ac3b9d2b0df62ffc47e46509fc2d2da921fb2004e7286"} Mar 16 17:08:48 crc kubenswrapper[5120]: I0316 17:08:48.420837 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-scheduler-0" podStartSLOduration=2.420815291 podStartE2EDuration="2.420815291s" podCreationTimestamp="2026-03-16 17:08:46 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:08:48.408797918 +0000 UTC m=+5830.562729565" watchObservedRunningTime="2026-03-16 17:08:48.420815291 +0000 UTC m=+5830.574746958" Mar 16 17:08:48 crc kubenswrapper[5120]: I0316 17:08:48.436736 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-scheduler-0" podStartSLOduration=3.4367161299999998 podStartE2EDuration="3.43671613s" podCreationTimestamp="2026-03-16 17:08:45 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:08:48.433220052 +0000 UTC m=+5830.587151719" watchObservedRunningTime="2026-03-16 17:08:48.43671613 +0000 UTC m=+5830.590647787" Mar 16 17:08:49 crc kubenswrapper[5120]: I0316 17:08:49.197927 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/45defe5f-ca2f-4993-8430-d713ed1c9df0-public-tls-certs\") pod \"cinder-api-0\" (UID: \"45defe5f-ca2f-4993-8430-d713ed1c9df0\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:08:49 crc kubenswrapper[5120]: E0316 17:08:49.198054 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-cinder-public-svc: secret "cert-cinder-public-svc" not found Mar 16 17:08:49 crc kubenswrapper[5120]: E0316 17:08:49.198429 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45defe5f-ca2f-4993-8430-d713ed1c9df0-public-tls-certs podName:45defe5f-ca2f-4993-8430-d713ed1c9df0 nodeName:}" failed. No retries permitted until 2026-03-16 17:08:57.198411661 +0000 UTC m=+5839.352343318 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/45defe5f-ca2f-4993-8430-d713ed1c9df0-public-tls-certs") pod "cinder-api-0" (UID: "45defe5f-ca2f-4993-8430-d713ed1c9df0") : secret "cert-cinder-public-svc" not found Mar 16 17:08:49 crc kubenswrapper[5120]: I0316 17:08:49.404328 5120 generic.go:358] "Generic (PLEG): container finished" podID="9a997459-37ba-46a9-9cb8-075f77fa009f" containerID="42045ce1645b68cad8b1bbbfc95aca5ef9dc16d881fd98903c7824b31f5fd0cf" exitCode=1 Mar 16 17:08:49 crc kubenswrapper[5120]: I0316 17:08:49.404440 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"9a997459-37ba-46a9-9cb8-075f77fa009f","Type":"ContainerDied","Data":"42045ce1645b68cad8b1bbbfc95aca5ef9dc16d881fd98903c7824b31f5fd0cf"} Mar 16 17:08:49 crc kubenswrapper[5120]: I0316 17:08:49.404525 5120 scope.go:117] "RemoveContainer" containerID="42b3134c7d5cdc4ab6cd16467e7527ff5871c8a605e0d6e3cc919d98453fc2ac" Mar 16 17:08:49 crc kubenswrapper[5120]: I0316 17:08:49.404951 5120 scope.go:117] "RemoveContainer" containerID="42045ce1645b68cad8b1bbbfc95aca5ef9dc16d881fd98903c7824b31f5fd0cf" Mar 16 17:08:49 crc kubenswrapper[5120]: I0316 17:08:49.404968 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/69bb2342-14e1-4c32-889a-e33f6ba42651-internal-tls-certs\") pod \"nova-api-0\" (UID: \"69bb2342-14e1-4c32-889a-e33f6ba42651\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:08:49 crc kubenswrapper[5120]: I0316 17:08:49.405156 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/69bb2342-14e1-4c32-889a-e33f6ba42651-public-tls-certs\") pod \"nova-api-0\" (UID: \"69bb2342-14e1-4c32-889a-e33f6ba42651\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:08:49 crc kubenswrapper[5120]: E0316 17:08:49.405394 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nova-cell0-conductor-conductor\" with CrashLoopBackOff: \"back-off 10s restarting failed container=nova-cell0-conductor-conductor pod=nova-cell0-conductor-0_openstack-kuttl-tests(9a997459-37ba-46a9-9cb8-075f77fa009f)\"" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="9a997459-37ba-46a9-9cb8-075f77fa009f" Mar 16 17:08:49 crc kubenswrapper[5120]: I0316 17:08:49.413412 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/69bb2342-14e1-4c32-889a-e33f6ba42651-public-tls-certs\") pod \"nova-api-0\" (UID: \"69bb2342-14e1-4c32-889a-e33f6ba42651\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:08:49 crc kubenswrapper[5120]: I0316 17:08:49.414621 5120 generic.go:358] "Generic (PLEG): container finished" podID="9009d26a-9c60-48c3-981f-41e60a03545d" containerID="15391224417c302e54e42e40b0f9c3068ad4bfa0470ea89ee0df220ceb40a6e2" exitCode=0 Mar 16 17:08:49 crc kubenswrapper[5120]: I0316 17:08:49.414954 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"9009d26a-9c60-48c3-981f-41e60a03545d","Type":"ContainerDied","Data":"15391224417c302e54e42e40b0f9c3068ad4bfa0470ea89ee0df220ceb40a6e2"} Mar 16 17:08:49 crc kubenswrapper[5120]: I0316 17:08:49.420145 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/69bb2342-14e1-4c32-889a-e33f6ba42651-internal-tls-certs\") pod \"nova-api-0\" (UID: \"69bb2342-14e1-4c32-889a-e33f6ba42651\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:08:49 crc kubenswrapper[5120]: I0316 17:08:49.473360 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 17:08:49 crc kubenswrapper[5120]: E0316 17:08:49.474603 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs-tls-certs ovsdbserver-nb-tls-certs], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podUID="cde31df2-efeb-4fee-b565-f24b7eaeff60" Mar 16 17:08:49 crc kubenswrapper[5120]: I0316 17:08:49.498332 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:08:49 crc kubenswrapper[5120]: I0316 17:08:49.827882 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 17:08:49 crc kubenswrapper[5120]: E0316 17:08:49.828960 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs-tls-certs ovsdbserver-sb-tls-certs], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podUID="a96c9fab-fbd4-459d-90a5-ca103703bfc9" Mar 16 17:08:49 crc kubenswrapper[5120]: I0316 17:08:49.954912 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 17:08:50 crc kubenswrapper[5120]: I0316 17:08:50.130066 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/15200613-4843-450f-bf1e-e7b152c48f43-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"15200613-4843-450f-bf1e-e7b152c48f43\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:08:50 crc kubenswrapper[5120]: E0316 17:08:50.130261 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-glance-default-public-svc: secret "cert-glance-default-public-svc" not found Mar 16 17:08:50 crc kubenswrapper[5120]: E0316 17:08:50.130348 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15200613-4843-450f-bf1e-e7b152c48f43-public-tls-certs podName:15200613-4843-450f-bf1e-e7b152c48f43 nodeName:}" failed. No retries permitted until 2026-03-16 17:08:58.130328345 +0000 UTC m=+5840.284260002 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/15200613-4843-450f-bf1e-e7b152c48f43-public-tls-certs") pod "glance-default-external-api-0" (UID: "15200613-4843-450f-bf1e-e7b152c48f43") : secret "cert-glance-default-public-svc" not found Mar 16 17:08:50 crc kubenswrapper[5120]: I0316 17:08:50.430049 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"9009d26a-9c60-48c3-981f-41e60a03545d","Type":"ContainerStarted","Data":"33961ef2975a425dd7210db90373c59aec60bdd5c1d85eaf062818262e6fb1af"} Mar 16 17:08:50 crc kubenswrapper[5120]: I0316 17:08:50.433695 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"69bb2342-14e1-4c32-889a-e33f6ba42651","Type":"ContainerStarted","Data":"c7f0ec29ac153c1aa743c1495484bf9605c92e2cea32e4a9b49c14f6df61dfbe"} Mar 16 17:08:50 crc kubenswrapper[5120]: I0316 17:08:50.433826 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"69bb2342-14e1-4c32-889a-e33f6ba42651","Type":"ContainerStarted","Data":"da449289366bc4a4a5ae59798a3049978cb54421e9beeb0f8d61e84b89a25756"} Mar 16 17:08:50 crc kubenswrapper[5120]: I0316 17:08:50.433845 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"69bb2342-14e1-4c32-889a-e33f6ba42651","Type":"ContainerStarted","Data":"6e5ff1c7a50af491dbf1f52d9c896f0ab29c54a6eae3986fa7a211092f8cf3b6"} Mar 16 17:08:50 crc kubenswrapper[5120]: I0316 17:08:50.436952 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:08:50 crc kubenswrapper[5120]: I0316 17:08:50.436976 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:08:50 crc kubenswrapper[5120]: I0316 17:08:50.457167 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstack-cell1-galera-0" podStartSLOduration=5.457146854 podStartE2EDuration="5.457146854s" podCreationTimestamp="2026-03-16 17:08:45 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:08:50.453361289 +0000 UTC m=+5832.607292946" watchObservedRunningTime="2026-03-16 17:08:50.457146854 +0000 UTC m=+5832.611078511" Mar 16 17:08:50 crc kubenswrapper[5120]: I0316 17:08:50.468391 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:08:50 crc kubenswrapper[5120]: I0316 17:08:50.475615 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:08:50 crc kubenswrapper[5120]: I0316 17:08:50.483210 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=9.483189574 podStartE2EDuration="9.483189574s" podCreationTimestamp="2026-03-16 17:08:41 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:08:50.47760586 +0000 UTC m=+5832.631537527" watchObservedRunningTime="2026-03-16 17:08:50.483189574 +0000 UTC m=+5832.637121241" Mar 16 17:08:50 crc kubenswrapper[5120]: I0316 17:08:50.545044 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/a96c9fab-fbd4-459d-90a5-ca103703bfc9-ovsdb-rundir\") pod \"a96c9fab-fbd4-459d-90a5-ca103703bfc9\" (UID: \"a96c9fab-fbd4-459d-90a5-ca103703bfc9\") " Mar 16 17:08:50 crc kubenswrapper[5120]: I0316 17:08:50.545388 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/cde31df2-efeb-4fee-b565-f24b7eaeff60-scripts\") pod \"cde31df2-efeb-4fee-b565-f24b7eaeff60\" (UID: \"cde31df2-efeb-4fee-b565-f24b7eaeff60\") " Mar 16 17:08:50 crc kubenswrapper[5120]: I0316 17:08:50.545435 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a96c9fab-fbd4-459d-90a5-ca103703bfc9-ovsdb-rundir" (OuterVolumeSpecName: "ovsdb-rundir") pod "a96c9fab-fbd4-459d-90a5-ca103703bfc9" (UID: "a96c9fab-fbd4-459d-90a5-ca103703bfc9"). InnerVolumeSpecName "ovsdb-rundir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:08:50 crc kubenswrapper[5120]: I0316 17:08:50.545687 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovndbcluster-nb-etc-ovn\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"cde31df2-efeb-4fee-b565-f24b7eaeff60\" (UID: \"cde31df2-efeb-4fee-b565-f24b7eaeff60\") " Mar 16 17:08:50 crc kubenswrapper[5120]: I0316 17:08:50.545883 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a96c9fab-fbd4-459d-90a5-ca103703bfc9-combined-ca-bundle\") pod \"a96c9fab-fbd4-459d-90a5-ca103703bfc9\" (UID: \"a96c9fab-fbd4-459d-90a5-ca103703bfc9\") " Mar 16 17:08:50 crc kubenswrapper[5120]: I0316 17:08:50.545892 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cde31df2-efeb-4fee-b565-f24b7eaeff60-scripts" (OuterVolumeSpecName: "scripts") pod "cde31df2-efeb-4fee-b565-f24b7eaeff60" (UID: "cde31df2-efeb-4fee-b565-f24b7eaeff60"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:08:50 crc kubenswrapper[5120]: I0316 17:08:50.546205 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovndbcluster-sb-etc-ovn\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"a96c9fab-fbd4-459d-90a5-ca103703bfc9\" (UID: \"a96c9fab-fbd4-459d-90a5-ca103703bfc9\") " Mar 16 17:08:50 crc kubenswrapper[5120]: I0316 17:08:50.546426 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cde31df2-efeb-4fee-b565-f24b7eaeff60-config\") pod \"cde31df2-efeb-4fee-b565-f24b7eaeff60\" (UID: \"cde31df2-efeb-4fee-b565-f24b7eaeff60\") " Mar 16 17:08:50 crc kubenswrapper[5120]: I0316 17:08:50.546849 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cde31df2-efeb-4fee-b565-f24b7eaeff60-config" (OuterVolumeSpecName: "config") pod "cde31df2-efeb-4fee-b565-f24b7eaeff60" (UID: "cde31df2-efeb-4fee-b565-f24b7eaeff60"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:08:50 crc kubenswrapper[5120]: I0316 17:08:50.547119 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4z5xk\" (UniqueName: \"kubernetes.io/projected/a96c9fab-fbd4-459d-90a5-ca103703bfc9-kube-api-access-4z5xk\") pod \"a96c9fab-fbd4-459d-90a5-ca103703bfc9\" (UID: \"a96c9fab-fbd4-459d-90a5-ca103703bfc9\") " Mar 16 17:08:50 crc kubenswrapper[5120]: I0316 17:08:50.547486 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/a96c9fab-fbd4-459d-90a5-ca103703bfc9-scripts\") pod \"a96c9fab-fbd4-459d-90a5-ca103703bfc9\" (UID: \"a96c9fab-fbd4-459d-90a5-ca103703bfc9\") " Mar 16 17:08:50 crc kubenswrapper[5120]: I0316 17:08:50.547655 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a96c9fab-fbd4-459d-90a5-ca103703bfc9-config\") pod \"a96c9fab-fbd4-459d-90a5-ca103703bfc9\" (UID: \"a96c9fab-fbd4-459d-90a5-ca103703bfc9\") " Mar 16 17:08:50 crc kubenswrapper[5120]: I0316 17:08:50.548300 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/cde31df2-efeb-4fee-b565-f24b7eaeff60-ovsdb-rundir\") pod \"cde31df2-efeb-4fee-b565-f24b7eaeff60\" (UID: \"cde31df2-efeb-4fee-b565-f24b7eaeff60\") " Mar 16 17:08:50 crc kubenswrapper[5120]: I0316 17:08:50.548427 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cde31df2-efeb-4fee-b565-f24b7eaeff60-combined-ca-bundle\") pod \"cde31df2-efeb-4fee-b565-f24b7eaeff60\" (UID: \"cde31df2-efeb-4fee-b565-f24b7eaeff60\") " Mar 16 17:08:50 crc kubenswrapper[5120]: I0316 17:08:50.548236 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a96c9fab-fbd4-459d-90a5-ca103703bfc9-config" (OuterVolumeSpecName: "config") pod "a96c9fab-fbd4-459d-90a5-ca103703bfc9" (UID: "a96c9fab-fbd4-459d-90a5-ca103703bfc9"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:08:50 crc kubenswrapper[5120]: I0316 17:08:50.548607 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a96c9fab-fbd4-459d-90a5-ca103703bfc9-scripts" (OuterVolumeSpecName: "scripts") pod "a96c9fab-fbd4-459d-90a5-ca103703bfc9" (UID: "a96c9fab-fbd4-459d-90a5-ca103703bfc9"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:08:50 crc kubenswrapper[5120]: I0316 17:08:50.548884 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7wwnb\" (UniqueName: \"kubernetes.io/projected/cde31df2-efeb-4fee-b565-f24b7eaeff60-kube-api-access-7wwnb\") pod \"cde31df2-efeb-4fee-b565-f24b7eaeff60\" (UID: \"cde31df2-efeb-4fee-b565-f24b7eaeff60\") " Mar 16 17:08:50 crc kubenswrapper[5120]: I0316 17:08:50.549133 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cde31df2-efeb-4fee-b565-f24b7eaeff60-ovsdb-rundir" (OuterVolumeSpecName: "ovsdb-rundir") pod "cde31df2-efeb-4fee-b565-f24b7eaeff60" (UID: "cde31df2-efeb-4fee-b565-f24b7eaeff60"). InnerVolumeSpecName "ovsdb-rundir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:08:50 crc kubenswrapper[5120]: I0316 17:08:50.550577 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/a96c9fab-fbd4-459d-90a5-ca103703bfc9-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:50 crc kubenswrapper[5120]: I0316 17:08:50.550608 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a96c9fab-fbd4-459d-90a5-ca103703bfc9-config\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:50 crc kubenswrapper[5120]: I0316 17:08:50.550622 5120 reconciler_common.go:299] "Volume detached for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/cde31df2-efeb-4fee-b565-f24b7eaeff60-ovsdb-rundir\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:50 crc kubenswrapper[5120]: I0316 17:08:50.550640 5120 reconciler_common.go:299] "Volume detached for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/a96c9fab-fbd4-459d-90a5-ca103703bfc9-ovsdb-rundir\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:50 crc kubenswrapper[5120]: I0316 17:08:50.550650 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/cde31df2-efeb-4fee-b565-f24b7eaeff60-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:50 crc kubenswrapper[5120]: I0316 17:08:50.550661 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cde31df2-efeb-4fee-b565-f24b7eaeff60-config\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:50 crc kubenswrapper[5120]: I0316 17:08:50.552406 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cde31df2-efeb-4fee-b565-f24b7eaeff60-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "cde31df2-efeb-4fee-b565-f24b7eaeff60" (UID: "cde31df2-efeb-4fee-b565-f24b7eaeff60"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:08:50 crc kubenswrapper[5120]: I0316 17:08:50.552409 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage01-crc" (OuterVolumeSpecName: "ovndbcluster-sb-etc-ovn") pod "a96c9fab-fbd4-459d-90a5-ca103703bfc9" (UID: "a96c9fab-fbd4-459d-90a5-ca103703bfc9"). InnerVolumeSpecName "local-storage01-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 17:08:50 crc kubenswrapper[5120]: I0316 17:08:50.552426 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a96c9fab-fbd4-459d-90a5-ca103703bfc9-kube-api-access-4z5xk" (OuterVolumeSpecName: "kube-api-access-4z5xk") pod "a96c9fab-fbd4-459d-90a5-ca103703bfc9" (UID: "a96c9fab-fbd4-459d-90a5-ca103703bfc9"). InnerVolumeSpecName "kube-api-access-4z5xk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:08:50 crc kubenswrapper[5120]: I0316 17:08:50.552844 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage08-crc" (OuterVolumeSpecName: "ovndbcluster-nb-etc-ovn") pod "cde31df2-efeb-4fee-b565-f24b7eaeff60" (UID: "cde31df2-efeb-4fee-b565-f24b7eaeff60"). InnerVolumeSpecName "local-storage08-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 17:08:50 crc kubenswrapper[5120]: I0316 17:08:50.562481 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cde31df2-efeb-4fee-b565-f24b7eaeff60-kube-api-access-7wwnb" (OuterVolumeSpecName: "kube-api-access-7wwnb") pod "cde31df2-efeb-4fee-b565-f24b7eaeff60" (UID: "cde31df2-efeb-4fee-b565-f24b7eaeff60"). InnerVolumeSpecName "kube-api-access-7wwnb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:08:50 crc kubenswrapper[5120]: I0316 17:08:50.565968 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a96c9fab-fbd4-459d-90a5-ca103703bfc9-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "a96c9fab-fbd4-459d-90a5-ca103703bfc9" (UID: "a96c9fab-fbd4-459d-90a5-ca103703bfc9"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:08:50 crc kubenswrapper[5120]: I0316 17:08:50.572122 5120 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 17:08:50 crc kubenswrapper[5120]: I0316 17:08:50.572976 5120 scope.go:117] "RemoveContainer" containerID="42045ce1645b68cad8b1bbbfc95aca5ef9dc16d881fd98903c7824b31f5fd0cf" Mar 16 17:08:50 crc kubenswrapper[5120]: E0316 17:08:50.573491 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nova-cell0-conductor-conductor\" with CrashLoopBackOff: \"back-off 10s restarting failed container=nova-cell0-conductor-conductor pod=nova-cell0-conductor-0_openstack-kuttl-tests(9a997459-37ba-46a9-9cb8-075f77fa009f)\"" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="9a997459-37ba-46a9-9cb8-075f77fa009f" Mar 16 17:08:50 crc kubenswrapper[5120]: I0316 17:08:50.653858 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7wwnb\" (UniqueName: \"kubernetes.io/projected/cde31df2-efeb-4fee-b565-f24b7eaeff60-kube-api-access-7wwnb\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:50 crc kubenswrapper[5120]: I0316 17:08:50.653910 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") on node \"crc\" " Mar 16 17:08:50 crc kubenswrapper[5120]: I0316 17:08:50.653926 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a96c9fab-fbd4-459d-90a5-ca103703bfc9-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:50 crc kubenswrapper[5120]: I0316 17:08:50.653941 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") on node \"crc\" " Mar 16 17:08:50 crc kubenswrapper[5120]: I0316 17:08:50.653951 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4z5xk\" (UniqueName: \"kubernetes.io/projected/a96c9fab-fbd4-459d-90a5-ca103703bfc9-kube-api-access-4z5xk\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:50 crc kubenswrapper[5120]: I0316 17:08:50.653965 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cde31df2-efeb-4fee-b565-f24b7eaeff60-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:50 crc kubenswrapper[5120]: I0316 17:08:50.679403 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage08-crc" (UniqueName: "kubernetes.io/local-volume/local-storage08-crc") on node "crc" Mar 16 17:08:50 crc kubenswrapper[5120]: I0316 17:08:50.681795 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage01-crc" (UniqueName: "kubernetes.io/local-volume/local-storage01-crc") on node "crc" Mar 16 17:08:50 crc kubenswrapper[5120]: I0316 17:08:50.756652 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:50 crc kubenswrapper[5120]: I0316 17:08:50.756698 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:50 crc kubenswrapper[5120]: I0316 17:08:50.883566 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:08:50 crc kubenswrapper[5120]: I0316 17:08:50.905623 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 17:08:50 crc kubenswrapper[5120]: E0316 17:08:50.906613 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs-tls-certs ovn-northd-tls-certs], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openstack-kuttl-tests/ovn-northd-0" podUID="617facde-390d-4bc0-b061-a5b7d7b78c8d" Mar 16 17:08:51 crc kubenswrapper[5120]: I0316 17:08:51.168539 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/d8ee8115-84b1-4f8e-acce-1f745eb1a339-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"d8ee8115-84b1-4f8e-acce-1f745eb1a339\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:08:51 crc kubenswrapper[5120]: E0316 17:08:51.169206 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-ceilometer-internal-svc: secret "cert-ceilometer-internal-svc" not found Mar 16 17:08:51 crc kubenswrapper[5120]: E0316 17:08:51.169265 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8ee8115-84b1-4f8e-acce-1f745eb1a339-ceilometer-tls-certs podName:d8ee8115-84b1-4f8e-acce-1f745eb1a339 nodeName:}" failed. No retries permitted until 2026-03-16 17:08:59.169250227 +0000 UTC m=+5841.323181884 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "ceilometer-tls-certs" (UniqueName: "kubernetes.io/secret/d8ee8115-84b1-4f8e-acce-1f745eb1a339-ceilometer-tls-certs") pod "ceilometer-0" (UID: "d8ee8115-84b1-4f8e-acce-1f745eb1a339") : secret "cert-ceilometer-internal-svc" not found Mar 16 17:08:51 crc kubenswrapper[5120]: I0316 17:08:51.445659 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:08:51 crc kubenswrapper[5120]: I0316 17:08:51.445835 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:08:51 crc kubenswrapper[5120]: I0316 17:08:51.446788 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:08:51 crc kubenswrapper[5120]: I0316 17:08:51.461478 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:08:51 crc kubenswrapper[5120]: I0316 17:08:51.537696 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 17:08:51 crc kubenswrapper[5120]: I0316 17:08:51.582723 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/617facde-390d-4bc0-b061-a5b7d7b78c8d-scripts\") pod \"617facde-390d-4bc0-b061-a5b7d7b78c8d\" (UID: \"617facde-390d-4bc0-b061-a5b7d7b78c8d\") " Mar 16 17:08:51 crc kubenswrapper[5120]: I0316 17:08:51.583036 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/617facde-390d-4bc0-b061-a5b7d7b78c8d-config\") pod \"617facde-390d-4bc0-b061-a5b7d7b78c8d\" (UID: \"617facde-390d-4bc0-b061-a5b7d7b78c8d\") " Mar 16 17:08:51 crc kubenswrapper[5120]: I0316 17:08:51.583121 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-52jrz\" (UniqueName: \"kubernetes.io/projected/617facde-390d-4bc0-b061-a5b7d7b78c8d-kube-api-access-52jrz\") pod \"617facde-390d-4bc0-b061-a5b7d7b78c8d\" (UID: \"617facde-390d-4bc0-b061-a5b7d7b78c8d\") " Mar 16 17:08:51 crc kubenswrapper[5120]: I0316 17:08:51.583234 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/617facde-390d-4bc0-b061-a5b7d7b78c8d-combined-ca-bundle\") pod \"617facde-390d-4bc0-b061-a5b7d7b78c8d\" (UID: \"617facde-390d-4bc0-b061-a5b7d7b78c8d\") " Mar 16 17:08:51 crc kubenswrapper[5120]: I0316 17:08:51.583746 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/617facde-390d-4bc0-b061-a5b7d7b78c8d-ovn-rundir\") pod \"617facde-390d-4bc0-b061-a5b7d7b78c8d\" (UID: \"617facde-390d-4bc0-b061-a5b7d7b78c8d\") " Mar 16 17:08:51 crc kubenswrapper[5120]: I0316 17:08:51.584353 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/617facde-390d-4bc0-b061-a5b7d7b78c8d-ovn-rundir" (OuterVolumeSpecName: "ovn-rundir") pod "617facde-390d-4bc0-b061-a5b7d7b78c8d" (UID: "617facde-390d-4bc0-b061-a5b7d7b78c8d"). InnerVolumeSpecName "ovn-rundir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:08:51 crc kubenswrapper[5120]: I0316 17:08:51.584534 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/617facde-390d-4bc0-b061-a5b7d7b78c8d-config" (OuterVolumeSpecName: "config") pod "617facde-390d-4bc0-b061-a5b7d7b78c8d" (UID: "617facde-390d-4bc0-b061-a5b7d7b78c8d"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:08:51 crc kubenswrapper[5120]: I0316 17:08:51.585065 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/617facde-390d-4bc0-b061-a5b7d7b78c8d-scripts" (OuterVolumeSpecName: "scripts") pod "617facde-390d-4bc0-b061-a5b7d7b78c8d" (UID: "617facde-390d-4bc0-b061-a5b7d7b78c8d"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:08:51 crc kubenswrapper[5120]: I0316 17:08:51.591008 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/617facde-390d-4bc0-b061-a5b7d7b78c8d-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:51 crc kubenswrapper[5120]: I0316 17:08:51.591049 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/617facde-390d-4bc0-b061-a5b7d7b78c8d-config\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:51 crc kubenswrapper[5120]: I0316 17:08:51.591075 5120 reconciler_common.go:299] "Volume detached for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/617facde-390d-4bc0-b061-a5b7d7b78c8d-ovn-rundir\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:51 crc kubenswrapper[5120]: I0316 17:08:51.594982 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/617facde-390d-4bc0-b061-a5b7d7b78c8d-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "617facde-390d-4bc0-b061-a5b7d7b78c8d" (UID: "617facde-390d-4bc0-b061-a5b7d7b78c8d"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:08:51 crc kubenswrapper[5120]: I0316 17:08:51.598071 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/617facde-390d-4bc0-b061-a5b7d7b78c8d-kube-api-access-52jrz" (OuterVolumeSpecName: "kube-api-access-52jrz") pod "617facde-390d-4bc0-b061-a5b7d7b78c8d" (UID: "617facde-390d-4bc0-b061-a5b7d7b78c8d"). InnerVolumeSpecName "kube-api-access-52jrz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:08:51 crc kubenswrapper[5120]: I0316 17:08:51.604863 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 17:08:51 crc kubenswrapper[5120]: I0316 17:08:51.650924 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 17:08:51 crc kubenswrapper[5120]: I0316 17:08:51.663523 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:08:51 crc kubenswrapper[5120]: I0316 17:08:51.667576 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovndbcluster-nb-config\"" Mar 16 17:08:51 crc kubenswrapper[5120]: I0316 17:08:51.667589 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ovndbcluster-nb-ovndbs\"" Mar 16 17:08:51 crc kubenswrapper[5120]: I0316 17:08:51.667954 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovndbcluster-nb-scripts\"" Mar 16 17:08:51 crc kubenswrapper[5120]: I0316 17:08:51.677828 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 17:08:51 crc kubenswrapper[5120]: I0316 17:08:51.679870 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ovncluster-ovndbcluster-nb-dockercfg-kfjxr\"" Mar 16 17:08:51 crc kubenswrapper[5120]: I0316 17:08:51.693945 5120 reconciler_common.go:299] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/cde31df2-efeb-4fee-b565-f24b7eaeff60-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:51 crc kubenswrapper[5120]: I0316 17:08:51.693987 5120 reconciler_common.go:299] "Volume detached for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/cde31df2-efeb-4fee-b565-f24b7eaeff60-ovsdbserver-nb-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:51 crc kubenswrapper[5120]: I0316 17:08:51.693997 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-52jrz\" (UniqueName: \"kubernetes.io/projected/617facde-390d-4bc0-b061-a5b7d7b78c8d-kube-api-access-52jrz\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:51 crc kubenswrapper[5120]: I0316 17:08:51.694007 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/617facde-390d-4bc0-b061-a5b7d7b78c8d-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:51 crc kubenswrapper[5120]: I0316 17:08:51.715899 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:08:51 crc kubenswrapper[5120]: I0316 17:08:51.722983 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 17:08:51 crc kubenswrapper[5120]: I0316 17:08:51.731697 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 17:08:51 crc kubenswrapper[5120]: I0316 17:08:51.740160 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 17:08:51 crc kubenswrapper[5120]: I0316 17:08:51.746436 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:08:51 crc kubenswrapper[5120]: I0316 17:08:51.748808 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 17:08:51 crc kubenswrapper[5120]: I0316 17:08:51.751454 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovndbcluster-sb-scripts\"" Mar 16 17:08:51 crc kubenswrapper[5120]: I0316 17:08:51.751463 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ovndbcluster-sb-ovndbs\"" Mar 16 17:08:51 crc kubenswrapper[5120]: I0316 17:08:51.752271 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovndbcluster-sb-config\"" Mar 16 17:08:51 crc kubenswrapper[5120]: I0316 17:08:51.752444 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ovncluster-ovndbcluster-sb-dockercfg-8h2r2\"" Mar 16 17:08:51 crc kubenswrapper[5120]: I0316 17:08:51.800368 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"ovsdbserver-nb-0\" (UID: \"fa8d6c88-cfc9-4ead-974d-005ae362769a\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:08:51 crc kubenswrapper[5120]: I0316 17:08:51.800452 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfjr8\" (UniqueName: \"kubernetes.io/projected/fa8d6c88-cfc9-4ead-974d-005ae362769a-kube-api-access-jfjr8\") pod \"ovsdbserver-nb-0\" (UID: \"fa8d6c88-cfc9-4ead-974d-005ae362769a\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:08:51 crc kubenswrapper[5120]: I0316 17:08:51.800538 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/fa8d6c88-cfc9-4ead-974d-005ae362769a-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"fa8d6c88-cfc9-4ead-974d-005ae362769a\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:08:51 crc kubenswrapper[5120]: I0316 17:08:51.800722 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fa8d6c88-cfc9-4ead-974d-005ae362769a-config\") pod \"ovsdbserver-nb-0\" (UID: \"fa8d6c88-cfc9-4ead-974d-005ae362769a\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:08:51 crc kubenswrapper[5120]: I0316 17:08:51.800836 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/fa8d6c88-cfc9-4ead-974d-005ae362769a-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"fa8d6c88-cfc9-4ead-974d-005ae362769a\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:08:51 crc kubenswrapper[5120]: I0316 17:08:51.801138 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/fa8d6c88-cfc9-4ead-974d-005ae362769a-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"fa8d6c88-cfc9-4ead-974d-005ae362769a\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:08:51 crc kubenswrapper[5120]: I0316 17:08:51.801576 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/fa8d6c88-cfc9-4ead-974d-005ae362769a-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"fa8d6c88-cfc9-4ead-974d-005ae362769a\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:08:51 crc kubenswrapper[5120]: I0316 17:08:51.801899 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fa8d6c88-cfc9-4ead-974d-005ae362769a-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"fa8d6c88-cfc9-4ead-974d-005ae362769a\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:08:51 crc kubenswrapper[5120]: I0316 17:08:51.905047 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6482e901-6b9d-4e99-b859-40ed46b549e1-config\") pod \"ovsdbserver-sb-0\" (UID: \"6482e901-6b9d-4e99-b859-40ed46b549e1\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:08:51 crc kubenswrapper[5120]: I0316 17:08:51.905189 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fa8d6c88-cfc9-4ead-974d-005ae362769a-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"fa8d6c88-cfc9-4ead-974d-005ae362769a\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:08:51 crc kubenswrapper[5120]: I0316 17:08:51.905294 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/6482e901-6b9d-4e99-b859-40ed46b549e1-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"6482e901-6b9d-4e99-b859-40ed46b549e1\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:08:51 crc kubenswrapper[5120]: I0316 17:08:51.905404 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/6482e901-6b9d-4e99-b859-40ed46b549e1-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"6482e901-6b9d-4e99-b859-40ed46b549e1\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:08:51 crc kubenswrapper[5120]: I0316 17:08:51.905562 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/6482e901-6b9d-4e99-b859-40ed46b549e1-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"6482e901-6b9d-4e99-b859-40ed46b549e1\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:08:51 crc kubenswrapper[5120]: I0316 17:08:51.905618 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tpz28\" (UniqueName: \"kubernetes.io/projected/6482e901-6b9d-4e99-b859-40ed46b549e1-kube-api-access-tpz28\") pod \"ovsdbserver-sb-0\" (UID: \"6482e901-6b9d-4e99-b859-40ed46b549e1\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:08:51 crc kubenswrapper[5120]: I0316 17:08:51.905710 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/6482e901-6b9d-4e99-b859-40ed46b549e1-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"6482e901-6b9d-4e99-b859-40ed46b549e1\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:08:51 crc kubenswrapper[5120]: I0316 17:08:51.905895 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"ovsdbserver-nb-0\" (UID: \"fa8d6c88-cfc9-4ead-974d-005ae362769a\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:08:51 crc kubenswrapper[5120]: I0316 17:08:51.905969 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jfjr8\" (UniqueName: \"kubernetes.io/projected/fa8d6c88-cfc9-4ead-974d-005ae362769a-kube-api-access-jfjr8\") pod \"ovsdbserver-nb-0\" (UID: \"fa8d6c88-cfc9-4ead-974d-005ae362769a\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:08:51 crc kubenswrapper[5120]: I0316 17:08:51.906089 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/fa8d6c88-cfc9-4ead-974d-005ae362769a-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"fa8d6c88-cfc9-4ead-974d-005ae362769a\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:08:51 crc kubenswrapper[5120]: I0316 17:08:51.906174 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fa8d6c88-cfc9-4ead-974d-005ae362769a-config\") pod \"ovsdbserver-nb-0\" (UID: \"fa8d6c88-cfc9-4ead-974d-005ae362769a\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:08:51 crc kubenswrapper[5120]: I0316 17:08:51.906241 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/fa8d6c88-cfc9-4ead-974d-005ae362769a-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"fa8d6c88-cfc9-4ead-974d-005ae362769a\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:08:51 crc kubenswrapper[5120]: I0316 17:08:51.906254 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"ovsdbserver-nb-0\" (UID: \"fa8d6c88-cfc9-4ead-974d-005ae362769a\") device mount path \"/mnt/openstack/pv08\"" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:08:51 crc kubenswrapper[5120]: I0316 17:08:51.906450 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6482e901-6b9d-4e99-b859-40ed46b549e1-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"6482e901-6b9d-4e99-b859-40ed46b549e1\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:08:51 crc kubenswrapper[5120]: I0316 17:08:51.906615 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/fa8d6c88-cfc9-4ead-974d-005ae362769a-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"fa8d6c88-cfc9-4ead-974d-005ae362769a\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:08:51 crc kubenswrapper[5120]: I0316 17:08:51.906663 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"ovsdbserver-sb-0\" (UID: \"6482e901-6b9d-4e99-b859-40ed46b549e1\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:08:51 crc kubenswrapper[5120]: I0316 17:08:51.906876 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/fa8d6c88-cfc9-4ead-974d-005ae362769a-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"fa8d6c88-cfc9-4ead-974d-005ae362769a\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:08:51 crc kubenswrapper[5120]: I0316 17:08:51.907016 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fa8d6c88-cfc9-4ead-974d-005ae362769a-config\") pod \"ovsdbserver-nb-0\" (UID: \"fa8d6c88-cfc9-4ead-974d-005ae362769a\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:08:51 crc kubenswrapper[5120]: I0316 17:08:51.907282 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/fa8d6c88-cfc9-4ead-974d-005ae362769a-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"fa8d6c88-cfc9-4ead-974d-005ae362769a\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:08:51 crc kubenswrapper[5120]: I0316 17:08:51.907741 5120 reconciler_common.go:299] "Volume detached for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/a96c9fab-fbd4-459d-90a5-ca103703bfc9-ovsdbserver-sb-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:51 crc kubenswrapper[5120]: I0316 17:08:51.907854 5120 reconciler_common.go:299] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/a96c9fab-fbd4-459d-90a5-ca103703bfc9-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:51 crc kubenswrapper[5120]: I0316 17:08:51.908367 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/fa8d6c88-cfc9-4ead-974d-005ae362769a-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"fa8d6c88-cfc9-4ead-974d-005ae362769a\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:08:51 crc kubenswrapper[5120]: I0316 17:08:51.909288 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fa8d6c88-cfc9-4ead-974d-005ae362769a-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"fa8d6c88-cfc9-4ead-974d-005ae362769a\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:08:51 crc kubenswrapper[5120]: I0316 17:08:51.911526 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/fa8d6c88-cfc9-4ead-974d-005ae362769a-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"fa8d6c88-cfc9-4ead-974d-005ae362769a\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:08:51 crc kubenswrapper[5120]: I0316 17:08:51.913287 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/fa8d6c88-cfc9-4ead-974d-005ae362769a-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"fa8d6c88-cfc9-4ead-974d-005ae362769a\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:08:51 crc kubenswrapper[5120]: I0316 17:08:51.922054 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfjr8\" (UniqueName: \"kubernetes.io/projected/fa8d6c88-cfc9-4ead-974d-005ae362769a-kube-api-access-jfjr8\") pod \"ovsdbserver-nb-0\" (UID: \"fa8d6c88-cfc9-4ead-974d-005ae362769a\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:08:51 crc kubenswrapper[5120]: I0316 17:08:51.933040 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"ovsdbserver-nb-0\" (UID: \"fa8d6c88-cfc9-4ead-974d-005ae362769a\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:08:52 crc kubenswrapper[5120]: I0316 17:08:52.003419 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:08:52 crc kubenswrapper[5120]: I0316 17:08:52.010292 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6482e901-6b9d-4e99-b859-40ed46b549e1-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"6482e901-6b9d-4e99-b859-40ed46b549e1\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:08:52 crc kubenswrapper[5120]: I0316 17:08:52.010476 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"ovsdbserver-sb-0\" (UID: \"6482e901-6b9d-4e99-b859-40ed46b549e1\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:08:52 crc kubenswrapper[5120]: I0316 17:08:52.010898 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6482e901-6b9d-4e99-b859-40ed46b549e1-config\") pod \"ovsdbserver-sb-0\" (UID: \"6482e901-6b9d-4e99-b859-40ed46b549e1\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:08:52 crc kubenswrapper[5120]: I0316 17:08:52.011251 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"ovsdbserver-sb-0\" (UID: \"6482e901-6b9d-4e99-b859-40ed46b549e1\") device mount path \"/mnt/openstack/pv01\"" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:08:52 crc kubenswrapper[5120]: I0316 17:08:52.011740 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6482e901-6b9d-4e99-b859-40ed46b549e1-config\") pod \"ovsdbserver-sb-0\" (UID: \"6482e901-6b9d-4e99-b859-40ed46b549e1\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:08:52 crc kubenswrapper[5120]: I0316 17:08:52.011886 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/6482e901-6b9d-4e99-b859-40ed46b549e1-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"6482e901-6b9d-4e99-b859-40ed46b549e1\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:08:52 crc kubenswrapper[5120]: I0316 17:08:52.011931 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/6482e901-6b9d-4e99-b859-40ed46b549e1-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"6482e901-6b9d-4e99-b859-40ed46b549e1\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:08:52 crc kubenswrapper[5120]: I0316 17:08:52.012001 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/6482e901-6b9d-4e99-b859-40ed46b549e1-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"6482e901-6b9d-4e99-b859-40ed46b549e1\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:08:52 crc kubenswrapper[5120]: I0316 17:08:52.012034 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tpz28\" (UniqueName: \"kubernetes.io/projected/6482e901-6b9d-4e99-b859-40ed46b549e1-kube-api-access-tpz28\") pod \"ovsdbserver-sb-0\" (UID: \"6482e901-6b9d-4e99-b859-40ed46b549e1\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:08:52 crc kubenswrapper[5120]: I0316 17:08:52.012059 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/6482e901-6b9d-4e99-b859-40ed46b549e1-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"6482e901-6b9d-4e99-b859-40ed46b549e1\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:08:52 crc kubenswrapper[5120]: I0316 17:08:52.012980 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/6482e901-6b9d-4e99-b859-40ed46b549e1-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"6482e901-6b9d-4e99-b859-40ed46b549e1\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:08:52 crc kubenswrapper[5120]: I0316 17:08:52.013236 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/6482e901-6b9d-4e99-b859-40ed46b549e1-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"6482e901-6b9d-4e99-b859-40ed46b549e1\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:08:52 crc kubenswrapper[5120]: I0316 17:08:52.016749 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/6482e901-6b9d-4e99-b859-40ed46b549e1-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"6482e901-6b9d-4e99-b859-40ed46b549e1\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:08:52 crc kubenswrapper[5120]: I0316 17:08:52.018370 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6482e901-6b9d-4e99-b859-40ed46b549e1-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"6482e901-6b9d-4e99-b859-40ed46b549e1\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:08:52 crc kubenswrapper[5120]: I0316 17:08:52.019079 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/6482e901-6b9d-4e99-b859-40ed46b549e1-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"6482e901-6b9d-4e99-b859-40ed46b549e1\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:08:52 crc kubenswrapper[5120]: I0316 17:08:52.022064 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:08:52 crc kubenswrapper[5120]: I0316 17:08:52.022106 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:08:52 crc kubenswrapper[5120]: I0316 17:08:52.039525 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tpz28\" (UniqueName: \"kubernetes.io/projected/6482e901-6b9d-4e99-b859-40ed46b549e1-kube-api-access-tpz28\") pod \"ovsdbserver-sb-0\" (UID: \"6482e901-6b9d-4e99-b859-40ed46b549e1\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:08:52 crc kubenswrapper[5120]: I0316 17:08:52.043718 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"ovsdbserver-sb-0\" (UID: \"6482e901-6b9d-4e99-b859-40ed46b549e1\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:08:52 crc kubenswrapper[5120]: I0316 17:08:52.064035 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:08:52 crc kubenswrapper[5120]: I0316 17:08:52.426345 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/617facde-390d-4bc0-b061-a5b7d7b78c8d-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"617facde-390d-4bc0-b061-a5b7d7b78c8d\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:08:52 crc kubenswrapper[5120]: I0316 17:08:52.426696 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/617facde-390d-4bc0-b061-a5b7d7b78c8d-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"617facde-390d-4bc0-b061-a5b7d7b78c8d\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:08:52 crc kubenswrapper[5120]: I0316 17:08:52.432236 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/617facde-390d-4bc0-b061-a5b7d7b78c8d-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"617facde-390d-4bc0-b061-a5b7d7b78c8d\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:08:52 crc kubenswrapper[5120]: I0316 17:08:52.434445 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/617facde-390d-4bc0-b061-a5b7d7b78c8d-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"617facde-390d-4bc0-b061-a5b7d7b78c8d\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:08:52 crc kubenswrapper[5120]: I0316 17:08:52.455284 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:08:52 crc kubenswrapper[5120]: W0316 17:08:52.477358 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfa8d6c88_cfc9_4ead_974d_005ae362769a.slice/crio-7b73922c63e780c288644e1cb66b743794cf0f68ca94a187cf062cab9c239364 WatchSource:0}: Error finding container 7b73922c63e780c288644e1cb66b743794cf0f68ca94a187cf062cab9c239364: Status 404 returned error can't find the container with id 7b73922c63e780c288644e1cb66b743794cf0f68ca94a187cf062cab9c239364 Mar 16 17:08:52 crc kubenswrapper[5120]: I0316 17:08:52.484015 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 17:08:52 crc kubenswrapper[5120]: I0316 17:08:52.528370 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/617facde-390d-4bc0-b061-a5b7d7b78c8d-ovn-northd-tls-certs\") pod \"617facde-390d-4bc0-b061-a5b7d7b78c8d\" (UID: \"617facde-390d-4bc0-b061-a5b7d7b78c8d\") " Mar 16 17:08:52 crc kubenswrapper[5120]: I0316 17:08:52.528951 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/617facde-390d-4bc0-b061-a5b7d7b78c8d-metrics-certs-tls-certs\") pod \"617facde-390d-4bc0-b061-a5b7d7b78c8d\" (UID: \"617facde-390d-4bc0-b061-a5b7d7b78c8d\") " Mar 16 17:08:52 crc kubenswrapper[5120]: I0316 17:08:52.532136 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/617facde-390d-4bc0-b061-a5b7d7b78c8d-ovn-northd-tls-certs" (OuterVolumeSpecName: "ovn-northd-tls-certs") pod "617facde-390d-4bc0-b061-a5b7d7b78c8d" (UID: "617facde-390d-4bc0-b061-a5b7d7b78c8d"). InnerVolumeSpecName "ovn-northd-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:08:52 crc kubenswrapper[5120]: I0316 17:08:52.532218 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/617facde-390d-4bc0-b061-a5b7d7b78c8d-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "617facde-390d-4bc0-b061-a5b7d7b78c8d" (UID: "617facde-390d-4bc0-b061-a5b7d7b78c8d"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:08:52 crc kubenswrapper[5120]: I0316 17:08:52.603594 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 17:08:52 crc kubenswrapper[5120]: W0316 17:08:52.609309 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6482e901_6b9d_4e99_b859_40ed46b549e1.slice/crio-72e2351e62a7b0c48341123550ea7fcb804165ba61361f85d9fc0f7c0a0d0679 WatchSource:0}: Error finding container 72e2351e62a7b0c48341123550ea7fcb804165ba61361f85d9fc0f7c0a0d0679: Status 404 returned error can't find the container with id 72e2351e62a7b0c48341123550ea7fcb804165ba61361f85d9fc0f7c0a0d0679 Mar 16 17:08:52 crc kubenswrapper[5120]: I0316 17:08:52.632275 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/3f98651e-6cef-4b31-8aac-46d152305e88-public-tls-certs\") pod \"barbican-api-7648f748d8-cxwnc\" (UID: \"3f98651e-6cef-4b31-8aac-46d152305e88\") " pod="openstack-kuttl-tests/barbican-api-7648f748d8-cxwnc" Mar 16 17:08:52 crc kubenswrapper[5120]: I0316 17:08:52.632463 5120 reconciler_common.go:299] "Volume detached for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/617facde-390d-4bc0-b061-a5b7d7b78c8d-ovn-northd-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:52 crc kubenswrapper[5120]: I0316 17:08:52.632476 5120 reconciler_common.go:299] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/617facde-390d-4bc0-b061-a5b7d7b78c8d-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:52 crc kubenswrapper[5120]: E0316 17:08:52.632564 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-barbican-public-svc: secret "cert-barbican-public-svc" not found Mar 16 17:08:52 crc kubenswrapper[5120]: E0316 17:08:52.632616 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f98651e-6cef-4b31-8aac-46d152305e88-public-tls-certs podName:3f98651e-6cef-4b31-8aac-46d152305e88 nodeName:}" failed. No retries permitted until 2026-03-16 17:09:08.632601492 +0000 UTC m=+5850.786533149 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/3f98651e-6cef-4b31-8aac-46d152305e88-public-tls-certs") pod "barbican-api-7648f748d8-cxwnc" (UID: "3f98651e-6cef-4b31-8aac-46d152305e88") : secret "cert-barbican-public-svc" not found Mar 16 17:08:52 crc kubenswrapper[5120]: I0316 17:08:52.674096 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a96c9fab-fbd4-459d-90a5-ca103703bfc9" path="/var/lib/kubelet/pods/a96c9fab-fbd4-459d-90a5-ca103703bfc9/volumes" Mar 16 17:08:52 crc kubenswrapper[5120]: I0316 17:08:52.674701 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cde31df2-efeb-4fee-b565-f24b7eaeff60" path="/var/lib/kubelet/pods/cde31df2-efeb-4fee-b565-f24b7eaeff60/volumes" Mar 16 17:08:52 crc kubenswrapper[5120]: I0316 17:08:52.735444 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/3f98651e-6cef-4b31-8aac-46d152305e88-internal-tls-certs\") pod \"barbican-api-7648f748d8-cxwnc\" (UID: \"3f98651e-6cef-4b31-8aac-46d152305e88\") " pod="openstack-kuttl-tests/barbican-api-7648f748d8-cxwnc" Mar 16 17:08:52 crc kubenswrapper[5120]: E0316 17:08:52.735602 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-barbican-internal-svc: secret "cert-barbican-internal-svc" not found Mar 16 17:08:52 crc kubenswrapper[5120]: E0316 17:08:52.735697 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f98651e-6cef-4b31-8aac-46d152305e88-internal-tls-certs podName:3f98651e-6cef-4b31-8aac-46d152305e88 nodeName:}" failed. No retries permitted until 2026-03-16 17:09:08.735671438 +0000 UTC m=+5850.889603095 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/3f98651e-6cef-4b31-8aac-46d152305e88-internal-tls-certs") pod "barbican-api-7648f748d8-cxwnc" (UID: "3f98651e-6cef-4b31-8aac-46d152305e88") : secret "cert-barbican-internal-svc" not found Mar 16 17:08:52 crc kubenswrapper[5120]: I0316 17:08:52.827900 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 17:08:52 crc kubenswrapper[5120]: I0316 17:08:52.841418 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/7a637c98-abe1-4f51-bee0-eb384fa79a43-internal-tls-certs\") pod \"placement-85687c8566-vv9qr\" (UID: \"7a637c98-abe1-4f51-bee0-eb384fa79a43\") " pod="openstack-kuttl-tests/placement-85687c8566-vv9qr" Mar 16 17:08:52 crc kubenswrapper[5120]: I0316 17:08:52.846029 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 17:08:52 crc kubenswrapper[5120]: I0316 17:08:52.850591 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/7a637c98-abe1-4f51-bee0-eb384fa79a43-internal-tls-certs\") pod \"placement-85687c8566-vv9qr\" (UID: \"7a637c98-abe1-4f51-bee0-eb384fa79a43\") " pod="openstack-kuttl-tests/placement-85687c8566-vv9qr" Mar 16 17:08:52 crc kubenswrapper[5120]: I0316 17:08:52.861226 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 17:08:52 crc kubenswrapper[5120]: I0316 17:08:52.874924 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 17:08:52 crc kubenswrapper[5120]: I0316 17:08:52.875070 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:08:52 crc kubenswrapper[5120]: I0316 17:08:52.881321 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovnnorthd-scripts\"" Mar 16 17:08:52 crc kubenswrapper[5120]: I0316 17:08:52.881502 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovnnorthd-config\"" Mar 16 17:08:52 crc kubenswrapper[5120]: I0316 17:08:52.881625 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ovnnorthd-ovnnorthd-dockercfg-qc4rf\"" Mar 16 17:08:52 crc kubenswrapper[5120]: I0316 17:08:52.881735 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ovnnorthd-ovndbs\"" Mar 16 17:08:52 crc kubenswrapper[5120]: I0316 17:08:52.945549 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/76f0322f-b14b-4b9b-9665-2121e3b21629-internal-tls-certs\") pod \"neutron-64b7569b94-dxks6\" (UID: \"76f0322f-b14b-4b9b-9665-2121e3b21629\") " pod="openstack-kuttl-tests/neutron-64b7569b94-dxks6" Mar 16 17:08:52 crc kubenswrapper[5120]: I0316 17:08:52.945638 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/76f0322f-b14b-4b9b-9665-2121e3b21629-public-tls-certs\") pod \"neutron-64b7569b94-dxks6\" (UID: \"76f0322f-b14b-4b9b-9665-2121e3b21629\") " pod="openstack-kuttl-tests/neutron-64b7569b94-dxks6" Mar 16 17:08:52 crc kubenswrapper[5120]: I0316 17:08:52.945879 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/7a637c98-abe1-4f51-bee0-eb384fa79a43-public-tls-certs\") pod \"placement-85687c8566-vv9qr\" (UID: \"7a637c98-abe1-4f51-bee0-eb384fa79a43\") " pod="openstack-kuttl-tests/placement-85687c8566-vv9qr" Mar 16 17:08:52 crc kubenswrapper[5120]: I0316 17:08:52.946044 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/76f0322f-b14b-4b9b-9665-2121e3b21629-ovndb-tls-certs\") pod \"neutron-64b7569b94-dxks6\" (UID: \"76f0322f-b14b-4b9b-9665-2121e3b21629\") " pod="openstack-kuttl-tests/neutron-64b7569b94-dxks6" Mar 16 17:08:52 crc kubenswrapper[5120]: E0316 17:08:52.946194 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-neutron-ovndbs: secret "cert-neutron-ovndbs" not found Mar 16 17:08:52 crc kubenswrapper[5120]: E0316 17:08:52.946239 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76f0322f-b14b-4b9b-9665-2121e3b21629-ovndb-tls-certs podName:76f0322f-b14b-4b9b-9665-2121e3b21629 nodeName:}" failed. No retries permitted until 2026-03-16 17:09:08.946224616 +0000 UTC m=+5851.100156273 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "ovndb-tls-certs" (UniqueName: "kubernetes.io/secret/76f0322f-b14b-4b9b-9665-2121e3b21629-ovndb-tls-certs") pod "neutron-64b7569b94-dxks6" (UID: "76f0322f-b14b-4b9b-9665-2121e3b21629") : secret "cert-neutron-ovndbs" not found Mar 16 17:08:52 crc kubenswrapper[5120]: E0316 17:08:52.946298 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-neutron-internal-svc: secret "cert-neutron-internal-svc" not found Mar 16 17:08:52 crc kubenswrapper[5120]: E0316 17:08:52.946320 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76f0322f-b14b-4b9b-9665-2121e3b21629-internal-tls-certs podName:76f0322f-b14b-4b9b-9665-2121e3b21629 nodeName:}" failed. No retries permitted until 2026-03-16 17:09:08.946313548 +0000 UTC m=+5851.100245205 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/76f0322f-b14b-4b9b-9665-2121e3b21629-internal-tls-certs") pod "neutron-64b7569b94-dxks6" (UID: "76f0322f-b14b-4b9b-9665-2121e3b21629") : secret "cert-neutron-internal-svc" not found Mar 16 17:08:52 crc kubenswrapper[5120]: E0316 17:08:52.946371 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-neutron-public-svc: secret "cert-neutron-public-svc" not found Mar 16 17:08:52 crc kubenswrapper[5120]: E0316 17:08:52.946391 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76f0322f-b14b-4b9b-9665-2121e3b21629-public-tls-certs podName:76f0322f-b14b-4b9b-9665-2121e3b21629 nodeName:}" failed. No retries permitted until 2026-03-16 17:09:08.9463856 +0000 UTC m=+5851.100317257 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/76f0322f-b14b-4b9b-9665-2121e3b21629-public-tls-certs") pod "neutron-64b7569b94-dxks6" (UID: "76f0322f-b14b-4b9b-9665-2121e3b21629") : secret "cert-neutron-public-svc" not found Mar 16 17:08:52 crc kubenswrapper[5120]: E0316 17:08:52.946500 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-placement-public-svc: secret "cert-placement-public-svc" not found Mar 16 17:08:52 crc kubenswrapper[5120]: E0316 17:08:52.946528 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a637c98-abe1-4f51-bee0-eb384fa79a43-public-tls-certs podName:7a637c98-abe1-4f51-bee0-eb384fa79a43 nodeName:}" failed. No retries permitted until 2026-03-16 17:09:08.946521934 +0000 UTC m=+5851.100453591 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/7a637c98-abe1-4f51-bee0-eb384fa79a43-public-tls-certs") pod "placement-85687c8566-vv9qr" (UID: "7a637c98-abe1-4f51-bee0-eb384fa79a43") : secret "cert-placement-public-svc" not found Mar 16 17:08:53 crc kubenswrapper[5120]: I0316 17:08:53.026932 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="f39a0edc-bfc5-400a-ad5e-4c83f2065778" containerName="nova-metadata-log" probeResult="failure" output="Get \"https://10.217.1.244:8775/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Mar 16 17:08:53 crc kubenswrapper[5120]: I0316 17:08:53.027107 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="f39a0edc-bfc5-400a-ad5e-4c83f2065778" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"https://10.217.1.244:8775/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Mar 16 17:08:53 crc kubenswrapper[5120]: I0316 17:08:53.049121 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/45b8119e-70b5-45ad-9629-41a99f2f8ed0-config\") pod \"ovn-northd-0\" (UID: \"45b8119e-70b5-45ad-9629-41a99f2f8ed0\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:08:53 crc kubenswrapper[5120]: I0316 17:08:53.049303 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/45b8119e-70b5-45ad-9629-41a99f2f8ed0-scripts\") pod \"ovn-northd-0\" (UID: \"45b8119e-70b5-45ad-9629-41a99f2f8ed0\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:08:53 crc kubenswrapper[5120]: I0316 17:08:53.049611 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9m92h\" (UniqueName: \"kubernetes.io/projected/45b8119e-70b5-45ad-9629-41a99f2f8ed0-kube-api-access-9m92h\") pod \"ovn-northd-0\" (UID: \"45b8119e-70b5-45ad-9629-41a99f2f8ed0\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:08:53 crc kubenswrapper[5120]: I0316 17:08:53.049774 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/45b8119e-70b5-45ad-9629-41a99f2f8ed0-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"45b8119e-70b5-45ad-9629-41a99f2f8ed0\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:08:53 crc kubenswrapper[5120]: I0316 17:08:53.049848 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/45b8119e-70b5-45ad-9629-41a99f2f8ed0-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"45b8119e-70b5-45ad-9629-41a99f2f8ed0\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:08:53 crc kubenswrapper[5120]: I0316 17:08:53.049968 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/45b8119e-70b5-45ad-9629-41a99f2f8ed0-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"45b8119e-70b5-45ad-9629-41a99f2f8ed0\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:08:53 crc kubenswrapper[5120]: I0316 17:08:53.050294 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/45b8119e-70b5-45ad-9629-41a99f2f8ed0-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"45b8119e-70b5-45ad-9629-41a99f2f8ed0\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:08:53 crc kubenswrapper[5120]: I0316 17:08:53.152355 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/45b8119e-70b5-45ad-9629-41a99f2f8ed0-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"45b8119e-70b5-45ad-9629-41a99f2f8ed0\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:08:53 crc kubenswrapper[5120]: I0316 17:08:53.152652 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/45b8119e-70b5-45ad-9629-41a99f2f8ed0-config\") pod \"ovn-northd-0\" (UID: \"45b8119e-70b5-45ad-9629-41a99f2f8ed0\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:08:53 crc kubenswrapper[5120]: I0316 17:08:53.152699 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/45b8119e-70b5-45ad-9629-41a99f2f8ed0-scripts\") pod \"ovn-northd-0\" (UID: \"45b8119e-70b5-45ad-9629-41a99f2f8ed0\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:08:53 crc kubenswrapper[5120]: I0316 17:08:53.152857 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9m92h\" (UniqueName: \"kubernetes.io/projected/45b8119e-70b5-45ad-9629-41a99f2f8ed0-kube-api-access-9m92h\") pod \"ovn-northd-0\" (UID: \"45b8119e-70b5-45ad-9629-41a99f2f8ed0\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:08:53 crc kubenswrapper[5120]: I0316 17:08:53.152963 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/45b8119e-70b5-45ad-9629-41a99f2f8ed0-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"45b8119e-70b5-45ad-9629-41a99f2f8ed0\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:08:53 crc kubenswrapper[5120]: I0316 17:08:53.153018 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/45b8119e-70b5-45ad-9629-41a99f2f8ed0-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"45b8119e-70b5-45ad-9629-41a99f2f8ed0\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:08:53 crc kubenswrapper[5120]: I0316 17:08:53.153069 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/45b8119e-70b5-45ad-9629-41a99f2f8ed0-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"45b8119e-70b5-45ad-9629-41a99f2f8ed0\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:08:53 crc kubenswrapper[5120]: I0316 17:08:53.153489 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/45b8119e-70b5-45ad-9629-41a99f2f8ed0-scripts\") pod \"ovn-northd-0\" (UID: \"45b8119e-70b5-45ad-9629-41a99f2f8ed0\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:08:53 crc kubenswrapper[5120]: I0316 17:08:53.153518 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/45b8119e-70b5-45ad-9629-41a99f2f8ed0-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"45b8119e-70b5-45ad-9629-41a99f2f8ed0\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:08:53 crc kubenswrapper[5120]: I0316 17:08:53.153517 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/45b8119e-70b5-45ad-9629-41a99f2f8ed0-config\") pod \"ovn-northd-0\" (UID: \"45b8119e-70b5-45ad-9629-41a99f2f8ed0\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:08:53 crc kubenswrapper[5120]: I0316 17:08:53.157079 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/45b8119e-70b5-45ad-9629-41a99f2f8ed0-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"45b8119e-70b5-45ad-9629-41a99f2f8ed0\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:08:53 crc kubenswrapper[5120]: I0316 17:08:53.157247 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/45b8119e-70b5-45ad-9629-41a99f2f8ed0-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"45b8119e-70b5-45ad-9629-41a99f2f8ed0\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:08:53 crc kubenswrapper[5120]: I0316 17:08:53.158819 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/45b8119e-70b5-45ad-9629-41a99f2f8ed0-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"45b8119e-70b5-45ad-9629-41a99f2f8ed0\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:08:53 crc kubenswrapper[5120]: I0316 17:08:53.173559 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9m92h\" (UniqueName: \"kubernetes.io/projected/45b8119e-70b5-45ad-9629-41a99f2f8ed0-kube-api-access-9m92h\") pod \"ovn-northd-0\" (UID: \"45b8119e-70b5-45ad-9629-41a99f2f8ed0\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:08:53 crc kubenswrapper[5120]: I0316 17:08:53.202982 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:08:53 crc kubenswrapper[5120]: I0316 17:08:53.451782 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-85687c8566-vv9qr"] Mar 16 17:08:53 crc kubenswrapper[5120]: E0316 17:08:53.454678 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[public-tls-certs], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openstack-kuttl-tests/placement-85687c8566-vv9qr" podUID="7a637c98-abe1-4f51-bee0-eb384fa79a43" Mar 16 17:08:53 crc kubenswrapper[5120]: I0316 17:08:53.495577 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"6482e901-6b9d-4e99-b859-40ed46b549e1","Type":"ContainerStarted","Data":"896a1fedb10dc78e3a5ec32e18c9e89730edd87bf0bf1ea066ac7fe083c294a2"} Mar 16 17:08:53 crc kubenswrapper[5120]: I0316 17:08:53.495627 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"6482e901-6b9d-4e99-b859-40ed46b549e1","Type":"ContainerStarted","Data":"c133cde2bb6de9540fd49f580d5a3c063dfae25ba05b7b2819f3fb0d3931f86a"} Mar 16 17:08:53 crc kubenswrapper[5120]: I0316 17:08:53.495639 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"6482e901-6b9d-4e99-b859-40ed46b549e1","Type":"ContainerStarted","Data":"72e2351e62a7b0c48341123550ea7fcb804165ba61361f85d9fc0f7c0a0d0679"} Mar 16 17:08:53 crc kubenswrapper[5120]: I0316 17:08:53.499286 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-85687c8566-vv9qr" Mar 16 17:08:53 crc kubenswrapper[5120]: I0316 17:08:53.501692 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"fa8d6c88-cfc9-4ead-974d-005ae362769a","Type":"ContainerStarted","Data":"48f695b820174f4434e930d86a102d88c95f5b423ba918f29f0e70dac0fe7545"} Mar 16 17:08:53 crc kubenswrapper[5120]: I0316 17:08:53.501726 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"fa8d6c88-cfc9-4ead-974d-005ae362769a","Type":"ContainerStarted","Data":"1ffc97c292aa55c56c3a0b3eec9167bb3bdcfa607e015223082151d77e8b31c8"} Mar 16 17:08:53 crc kubenswrapper[5120]: I0316 17:08:53.501737 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"fa8d6c88-cfc9-4ead-974d-005ae362769a","Type":"ContainerStarted","Data":"7b73922c63e780c288644e1cb66b743794cf0f68ca94a187cf062cab9c239364"} Mar 16 17:08:53 crc kubenswrapper[5120]: I0316 17:08:53.504901 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-76c554b9b6-6szl6"] Mar 16 17:08:53 crc kubenswrapper[5120]: I0316 17:08:53.521884 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-85687c8566-vv9qr" Mar 16 17:08:53 crc kubenswrapper[5120]: I0316 17:08:53.525644 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-76c554b9b6-6szl6" Mar 16 17:08:53 crc kubenswrapper[5120]: I0316 17:08:53.557516 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-76c554b9b6-6szl6"] Mar 16 17:08:53 crc kubenswrapper[5120]: I0316 17:08:53.571542 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podStartSLOduration=2.571525159 podStartE2EDuration="2.571525159s" podCreationTimestamp="2026-03-16 17:08:51 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:08:53.524382667 +0000 UTC m=+5835.678314344" watchObservedRunningTime="2026-03-16 17:08:53.571525159 +0000 UTC m=+5835.725456826" Mar 16 17:08:53 crc kubenswrapper[5120]: I0316 17:08:53.588698 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podStartSLOduration=2.588681393 podStartE2EDuration="2.588681393s" podCreationTimestamp="2026-03-16 17:08:51 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:08:53.555965559 +0000 UTC m=+5835.709897226" watchObservedRunningTime="2026-03-16 17:08:53.588681393 +0000 UTC m=+5835.742613040" Mar 16 17:08:53 crc kubenswrapper[5120]: I0316 17:08:53.675464 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 17:08:53 crc kubenswrapper[5120]: I0316 17:08:53.680499 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7a637c98-abe1-4f51-bee0-eb384fa79a43-config-data\") pod \"7a637c98-abe1-4f51-bee0-eb384fa79a43\" (UID: \"7a637c98-abe1-4f51-bee0-eb384fa79a43\") " Mar 16 17:08:53 crc kubenswrapper[5120]: I0316 17:08:53.680582 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7a637c98-abe1-4f51-bee0-eb384fa79a43-combined-ca-bundle\") pod \"7a637c98-abe1-4f51-bee0-eb384fa79a43\" (UID: \"7a637c98-abe1-4f51-bee0-eb384fa79a43\") " Mar 16 17:08:53 crc kubenswrapper[5120]: I0316 17:08:53.680715 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/7a637c98-abe1-4f51-bee0-eb384fa79a43-internal-tls-certs\") pod \"7a637c98-abe1-4f51-bee0-eb384fa79a43\" (UID: \"7a637c98-abe1-4f51-bee0-eb384fa79a43\") " Mar 16 17:08:53 crc kubenswrapper[5120]: I0316 17:08:53.680962 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7a637c98-abe1-4f51-bee0-eb384fa79a43-scripts\") pod \"7a637c98-abe1-4f51-bee0-eb384fa79a43\" (UID: \"7a637c98-abe1-4f51-bee0-eb384fa79a43\") " Mar 16 17:08:53 crc kubenswrapper[5120]: I0316 17:08:53.681280 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7a637c98-abe1-4f51-bee0-eb384fa79a43-logs\") pod \"7a637c98-abe1-4f51-bee0-eb384fa79a43\" (UID: \"7a637c98-abe1-4f51-bee0-eb384fa79a43\") " Mar 16 17:08:53 crc kubenswrapper[5120]: I0316 17:08:53.681392 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kbh84\" (UniqueName: \"kubernetes.io/projected/7a637c98-abe1-4f51-bee0-eb384fa79a43-kube-api-access-kbh84\") pod \"7a637c98-abe1-4f51-bee0-eb384fa79a43\" (UID: \"7a637c98-abe1-4f51-bee0-eb384fa79a43\") " Mar 16 17:08:53 crc kubenswrapper[5120]: I0316 17:08:53.683516 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/fccc0955-b4d6-488f-ae48-111ad10834ab-public-tls-certs\") pod \"placement-76c554b9b6-6szl6\" (UID: \"fccc0955-b4d6-488f-ae48-111ad10834ab\") " pod="openstack-kuttl-tests/placement-76c554b9b6-6szl6" Mar 16 17:08:53 crc kubenswrapper[5120]: I0316 17:08:53.683618 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/fccc0955-b4d6-488f-ae48-111ad10834ab-scripts\") pod \"placement-76c554b9b6-6szl6\" (UID: \"fccc0955-b4d6-488f-ae48-111ad10834ab\") " pod="openstack-kuttl-tests/placement-76c554b9b6-6szl6" Mar 16 17:08:53 crc kubenswrapper[5120]: I0316 17:08:53.683709 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmh4w\" (UniqueName: \"kubernetes.io/projected/fccc0955-b4d6-488f-ae48-111ad10834ab-kube-api-access-dmh4w\") pod \"placement-76c554b9b6-6szl6\" (UID: \"fccc0955-b4d6-488f-ae48-111ad10834ab\") " pod="openstack-kuttl-tests/placement-76c554b9b6-6szl6" Mar 16 17:08:53 crc kubenswrapper[5120]: I0316 17:08:53.683873 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fccc0955-b4d6-488f-ae48-111ad10834ab-config-data\") pod \"placement-76c554b9b6-6szl6\" (UID: \"fccc0955-b4d6-488f-ae48-111ad10834ab\") " pod="openstack-kuttl-tests/placement-76c554b9b6-6szl6" Mar 16 17:08:53 crc kubenswrapper[5120]: I0316 17:08:53.683977 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/fccc0955-b4d6-488f-ae48-111ad10834ab-logs\") pod \"placement-76c554b9b6-6szl6\" (UID: \"fccc0955-b4d6-488f-ae48-111ad10834ab\") " pod="openstack-kuttl-tests/placement-76c554b9b6-6szl6" Mar 16 17:08:53 crc kubenswrapper[5120]: I0316 17:08:53.684514 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/fccc0955-b4d6-488f-ae48-111ad10834ab-internal-tls-certs\") pod \"placement-76c554b9b6-6szl6\" (UID: \"fccc0955-b4d6-488f-ae48-111ad10834ab\") " pod="openstack-kuttl-tests/placement-76c554b9b6-6szl6" Mar 16 17:08:53 crc kubenswrapper[5120]: I0316 17:08:53.684617 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fccc0955-b4d6-488f-ae48-111ad10834ab-combined-ca-bundle\") pod \"placement-76c554b9b6-6szl6\" (UID: \"fccc0955-b4d6-488f-ae48-111ad10834ab\") " pod="openstack-kuttl-tests/placement-76c554b9b6-6szl6" Mar 16 17:08:53 crc kubenswrapper[5120]: I0316 17:08:53.684955 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a637c98-abe1-4f51-bee0-eb384fa79a43-logs" (OuterVolumeSpecName: "logs") pod "7a637c98-abe1-4f51-bee0-eb384fa79a43" (UID: "7a637c98-abe1-4f51-bee0-eb384fa79a43"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:08:53 crc kubenswrapper[5120]: W0316 17:08:53.688489 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod45b8119e_70b5_45ad_9629_41a99f2f8ed0.slice/crio-b4d73ce0f003b2eb700fd0a7258032d2b45a9c1c52da367cbbca780d6e6d9d4f WatchSource:0}: Error finding container b4d73ce0f003b2eb700fd0a7258032d2b45a9c1c52da367cbbca780d6e6d9d4f: Status 404 returned error can't find the container with id b4d73ce0f003b2eb700fd0a7258032d2b45a9c1c52da367cbbca780d6e6d9d4f Mar 16 17:08:53 crc kubenswrapper[5120]: I0316 17:08:53.689528 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7a637c98-abe1-4f51-bee0-eb384fa79a43-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "7a637c98-abe1-4f51-bee0-eb384fa79a43" (UID: "7a637c98-abe1-4f51-bee0-eb384fa79a43"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:08:53 crc kubenswrapper[5120]: I0316 17:08:53.690614 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a637c98-abe1-4f51-bee0-eb384fa79a43-kube-api-access-kbh84" (OuterVolumeSpecName: "kube-api-access-kbh84") pod "7a637c98-abe1-4f51-bee0-eb384fa79a43" (UID: "7a637c98-abe1-4f51-bee0-eb384fa79a43"). InnerVolumeSpecName "kube-api-access-kbh84". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:08:53 crc kubenswrapper[5120]: I0316 17:08:53.691145 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7a637c98-abe1-4f51-bee0-eb384fa79a43-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "7a637c98-abe1-4f51-bee0-eb384fa79a43" (UID: "7a637c98-abe1-4f51-bee0-eb384fa79a43"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:08:53 crc kubenswrapper[5120]: I0316 17:08:53.702991 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7a637c98-abe1-4f51-bee0-eb384fa79a43-config-data" (OuterVolumeSpecName: "config-data") pod "7a637c98-abe1-4f51-bee0-eb384fa79a43" (UID: "7a637c98-abe1-4f51-bee0-eb384fa79a43"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:08:53 crc kubenswrapper[5120]: I0316 17:08:53.719904 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7a637c98-abe1-4f51-bee0-eb384fa79a43-scripts" (OuterVolumeSpecName: "scripts") pod "7a637c98-abe1-4f51-bee0-eb384fa79a43" (UID: "7a637c98-abe1-4f51-bee0-eb384fa79a43"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:08:53 crc kubenswrapper[5120]: I0316 17:08:53.786902 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/fccc0955-b4d6-488f-ae48-111ad10834ab-public-tls-certs\") pod \"placement-76c554b9b6-6szl6\" (UID: \"fccc0955-b4d6-488f-ae48-111ad10834ab\") " pod="openstack-kuttl-tests/placement-76c554b9b6-6szl6" Mar 16 17:08:53 crc kubenswrapper[5120]: I0316 17:08:53.786979 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/fccc0955-b4d6-488f-ae48-111ad10834ab-scripts\") pod \"placement-76c554b9b6-6szl6\" (UID: \"fccc0955-b4d6-488f-ae48-111ad10834ab\") " pod="openstack-kuttl-tests/placement-76c554b9b6-6szl6" Mar 16 17:08:53 crc kubenswrapper[5120]: I0316 17:08:53.787036 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dmh4w\" (UniqueName: \"kubernetes.io/projected/fccc0955-b4d6-488f-ae48-111ad10834ab-kube-api-access-dmh4w\") pod \"placement-76c554b9b6-6szl6\" (UID: \"fccc0955-b4d6-488f-ae48-111ad10834ab\") " pod="openstack-kuttl-tests/placement-76c554b9b6-6szl6" Mar 16 17:08:53 crc kubenswrapper[5120]: I0316 17:08:53.787125 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fccc0955-b4d6-488f-ae48-111ad10834ab-config-data\") pod \"placement-76c554b9b6-6szl6\" (UID: \"fccc0955-b4d6-488f-ae48-111ad10834ab\") " pod="openstack-kuttl-tests/placement-76c554b9b6-6szl6" Mar 16 17:08:53 crc kubenswrapper[5120]: I0316 17:08:53.787192 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/fccc0955-b4d6-488f-ae48-111ad10834ab-logs\") pod \"placement-76c554b9b6-6szl6\" (UID: \"fccc0955-b4d6-488f-ae48-111ad10834ab\") " pod="openstack-kuttl-tests/placement-76c554b9b6-6szl6" Mar 16 17:08:53 crc kubenswrapper[5120]: I0316 17:08:53.787502 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/fccc0955-b4d6-488f-ae48-111ad10834ab-internal-tls-certs\") pod \"placement-76c554b9b6-6szl6\" (UID: \"fccc0955-b4d6-488f-ae48-111ad10834ab\") " pod="openstack-kuttl-tests/placement-76c554b9b6-6szl6" Mar 16 17:08:53 crc kubenswrapper[5120]: I0316 17:08:53.787621 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fccc0955-b4d6-488f-ae48-111ad10834ab-combined-ca-bundle\") pod \"placement-76c554b9b6-6szl6\" (UID: \"fccc0955-b4d6-488f-ae48-111ad10834ab\") " pod="openstack-kuttl-tests/placement-76c554b9b6-6szl6" Mar 16 17:08:53 crc kubenswrapper[5120]: I0316 17:08:53.787792 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7a637c98-abe1-4f51-bee0-eb384fa79a43-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:53 crc kubenswrapper[5120]: I0316 17:08:53.787811 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7a637c98-abe1-4f51-bee0-eb384fa79a43-logs\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:53 crc kubenswrapper[5120]: I0316 17:08:53.787826 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kbh84\" (UniqueName: \"kubernetes.io/projected/7a637c98-abe1-4f51-bee0-eb384fa79a43-kube-api-access-kbh84\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:53 crc kubenswrapper[5120]: I0316 17:08:53.787843 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7a637c98-abe1-4f51-bee0-eb384fa79a43-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:53 crc kubenswrapper[5120]: I0316 17:08:53.787855 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7a637c98-abe1-4f51-bee0-eb384fa79a43-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:53 crc kubenswrapper[5120]: I0316 17:08:53.787866 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/7a637c98-abe1-4f51-bee0-eb384fa79a43-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:53 crc kubenswrapper[5120]: I0316 17:08:53.788357 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/fccc0955-b4d6-488f-ae48-111ad10834ab-logs\") pod \"placement-76c554b9b6-6szl6\" (UID: \"fccc0955-b4d6-488f-ae48-111ad10834ab\") " pod="openstack-kuttl-tests/placement-76c554b9b6-6szl6" Mar 16 17:08:53 crc kubenswrapper[5120]: I0316 17:08:53.794304 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fccc0955-b4d6-488f-ae48-111ad10834ab-combined-ca-bundle\") pod \"placement-76c554b9b6-6szl6\" (UID: \"fccc0955-b4d6-488f-ae48-111ad10834ab\") " pod="openstack-kuttl-tests/placement-76c554b9b6-6szl6" Mar 16 17:08:53 crc kubenswrapper[5120]: I0316 17:08:53.794418 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/fccc0955-b4d6-488f-ae48-111ad10834ab-public-tls-certs\") pod \"placement-76c554b9b6-6szl6\" (UID: \"fccc0955-b4d6-488f-ae48-111ad10834ab\") " pod="openstack-kuttl-tests/placement-76c554b9b6-6szl6" Mar 16 17:08:53 crc kubenswrapper[5120]: I0316 17:08:53.794984 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fccc0955-b4d6-488f-ae48-111ad10834ab-config-data\") pod \"placement-76c554b9b6-6szl6\" (UID: \"fccc0955-b4d6-488f-ae48-111ad10834ab\") " pod="openstack-kuttl-tests/placement-76c554b9b6-6szl6" Mar 16 17:08:53 crc kubenswrapper[5120]: I0316 17:08:53.795364 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/fccc0955-b4d6-488f-ae48-111ad10834ab-scripts\") pod \"placement-76c554b9b6-6szl6\" (UID: \"fccc0955-b4d6-488f-ae48-111ad10834ab\") " pod="openstack-kuttl-tests/placement-76c554b9b6-6szl6" Mar 16 17:08:53 crc kubenswrapper[5120]: I0316 17:08:53.796236 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/fccc0955-b4d6-488f-ae48-111ad10834ab-internal-tls-certs\") pod \"placement-76c554b9b6-6szl6\" (UID: \"fccc0955-b4d6-488f-ae48-111ad10834ab\") " pod="openstack-kuttl-tests/placement-76c554b9b6-6szl6" Mar 16 17:08:53 crc kubenswrapper[5120]: I0316 17:08:53.816397 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmh4w\" (UniqueName: \"kubernetes.io/projected/fccc0955-b4d6-488f-ae48-111ad10834ab-kube-api-access-dmh4w\") pod \"placement-76c554b9b6-6szl6\" (UID: \"fccc0955-b4d6-488f-ae48-111ad10834ab\") " pod="openstack-kuttl-tests/placement-76c554b9b6-6szl6" Mar 16 17:08:53 crc kubenswrapper[5120]: I0316 17:08:53.875288 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-76c554b9b6-6szl6" Mar 16 17:08:54 crc kubenswrapper[5120]: I0316 17:08:54.336464 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-76c554b9b6-6szl6"] Mar 16 17:08:54 crc kubenswrapper[5120]: W0316 17:08:54.341259 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfccc0955_b4d6_488f_ae48_111ad10834ab.slice/crio-3662dc514209f930277775d799abe9245c825b895dcf0cf030f559ffaadac52b WatchSource:0}: Error finding container 3662dc514209f930277775d799abe9245c825b895dcf0cf030f559ffaadac52b: Status 404 returned error can't find the container with id 3662dc514209f930277775d799abe9245c825b895dcf0cf030f559ffaadac52b Mar 16 17:08:54 crc kubenswrapper[5120]: I0316 17:08:54.514860 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-76c554b9b6-6szl6" event={"ID":"fccc0955-b4d6-488f-ae48-111ad10834ab","Type":"ContainerStarted","Data":"3662dc514209f930277775d799abe9245c825b895dcf0cf030f559ffaadac52b"} Mar 16 17:08:54 crc kubenswrapper[5120]: I0316 17:08:54.517163 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-85687c8566-vv9qr" Mar 16 17:08:54 crc kubenswrapper[5120]: I0316 17:08:54.518650 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"45b8119e-70b5-45ad-9629-41a99f2f8ed0","Type":"ContainerStarted","Data":"0f5d3fe3e143a4e70eb6ec298ec173e607da98d4085d398c54f81b39a2ff9614"} Mar 16 17:08:54 crc kubenswrapper[5120]: I0316 17:08:54.518848 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"45b8119e-70b5-45ad-9629-41a99f2f8ed0","Type":"ContainerStarted","Data":"c8b8353c7b4c0db1e4fca1851f4e10b0bf58243a8726401407c787fd457ff216"} Mar 16 17:08:54 crc kubenswrapper[5120]: I0316 17:08:54.518925 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"45b8119e-70b5-45ad-9629-41a99f2f8ed0","Type":"ContainerStarted","Data":"b4d73ce0f003b2eb700fd0a7258032d2b45a9c1c52da367cbbca780d6e6d9d4f"} Mar 16 17:08:54 crc kubenswrapper[5120]: I0316 17:08:54.541315 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovn-northd-0" podStartSLOduration=2.54129701 podStartE2EDuration="2.54129701s" podCreationTimestamp="2026-03-16 17:08:52 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:08:54.536858867 +0000 UTC m=+5836.690790534" watchObservedRunningTime="2026-03-16 17:08:54.54129701 +0000 UTC m=+5836.695228667" Mar 16 17:08:54 crc kubenswrapper[5120]: I0316 17:08:54.578511 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-85687c8566-vv9qr"] Mar 16 17:08:54 crc kubenswrapper[5120]: I0316 17:08:54.588923 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-85687c8566-vv9qr"] Mar 16 17:08:54 crc kubenswrapper[5120]: I0316 17:08:54.676530 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="617facde-390d-4bc0-b061-a5b7d7b78c8d" path="/var/lib/kubelet/pods/617facde-390d-4bc0-b061-a5b7d7b78c8d/volumes" Mar 16 17:08:54 crc kubenswrapper[5120]: I0316 17:08:54.676956 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7a637c98-abe1-4f51-bee0-eb384fa79a43" path="/var/lib/kubelet/pods/7a637c98-abe1-4f51-bee0-eb384fa79a43/volumes" Mar 16 17:08:54 crc kubenswrapper[5120]: I0316 17:08:54.726943 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/7a637c98-abe1-4f51-bee0-eb384fa79a43-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:55 crc kubenswrapper[5120]: I0316 17:08:55.003688 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:08:55 crc kubenswrapper[5120]: I0316 17:08:55.041190 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:08:55 crc kubenswrapper[5120]: I0316 17:08:55.064449 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:08:55 crc kubenswrapper[5120]: I0316 17:08:55.101598 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:08:55 crc kubenswrapper[5120]: I0316 17:08:55.138895 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:08:55 crc kubenswrapper[5120]: E0316 17:08:55.139115 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-nova-novncproxy-cell1-public-svc: secret "cert-nova-novncproxy-cell1-public-svc" not found Mar 16 17:08:55 crc kubenswrapper[5120]: E0316 17:08:55.139198 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3-nova-novncproxy-tls-certs podName:eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3 nodeName:}" failed. No retries permitted until 2026-03-16 17:09:11.139179056 +0000 UTC m=+5853.293110713 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "nova-novncproxy-tls-certs" (UniqueName: "kubernetes.io/secret/eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3-nova-novncproxy-tls-certs") pod "nova-cell1-novncproxy-0" (UID: "eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3") : secret "cert-nova-novncproxy-cell1-public-svc" not found Mar 16 17:08:55 crc kubenswrapper[5120]: I0316 17:08:55.139235 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:08:55 crc kubenswrapper[5120]: E0316 17:08:55.139374 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-nova-novncproxy-cell1-vencrypt: secret "cert-nova-novncproxy-cell1-vencrypt" not found Mar 16 17:08:55 crc kubenswrapper[5120]: E0316 17:08:55.139427 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3-vencrypt-tls-certs podName:eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3 nodeName:}" failed. No retries permitted until 2026-03-16 17:09:11.139419563 +0000 UTC m=+5853.293351220 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "vencrypt-tls-certs" (UniqueName: "kubernetes.io/secret/eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3-vencrypt-tls-certs") pod "nova-cell1-novncproxy-0" (UID: "eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3") : secret "cert-nova-novncproxy-cell1-vencrypt" not found Mar 16 17:08:55 crc kubenswrapper[5120]: I0316 17:08:55.344586 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/10bd837b-2e0d-460b-a254-20e23b6768f7-memcached-tls-certs\") pod \"memcached-0\" (UID: \"10bd837b-2e0d-460b-a254-20e23b6768f7\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 17:08:55 crc kubenswrapper[5120]: E0316 17:08:55.344743 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-memcached-svc: secret "cert-memcached-svc" not found Mar 16 17:08:55 crc kubenswrapper[5120]: E0316 17:08:55.345327 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10bd837b-2e0d-460b-a254-20e23b6768f7-memcached-tls-certs podName:10bd837b-2e0d-460b-a254-20e23b6768f7 nodeName:}" failed. No retries permitted until 2026-03-16 17:09:11.34530239 +0000 UTC m=+5853.499234047 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "memcached-tls-certs" (UniqueName: "kubernetes.io/secret/10bd837b-2e0d-460b-a254-20e23b6768f7-memcached-tls-certs") pod "memcached-0" (UID: "10bd837b-2e0d-460b-a254-20e23b6768f7") : secret "cert-memcached-svc" not found Mar 16 17:08:55 crc kubenswrapper[5120]: I0316 17:08:55.527416 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-76c554b9b6-6szl6" event={"ID":"fccc0955-b4d6-488f-ae48-111ad10834ab","Type":"ContainerStarted","Data":"90e5284168f77c3ac58e206d4b4e442855ec7c1ecb1ae74189deade63029f209"} Mar 16 17:08:55 crc kubenswrapper[5120]: I0316 17:08:55.528389 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-76c554b9b6-6szl6" event={"ID":"fccc0955-b4d6-488f-ae48-111ad10834ab","Type":"ContainerStarted","Data":"7abf5a6fafc6c51969fe53fdedc4a19b5eb7d795048b19a5a90cbc53b99fd23b"} Mar 16 17:08:55 crc kubenswrapper[5120]: I0316 17:08:55.528499 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:08:55 crc kubenswrapper[5120]: I0316 17:08:55.528626 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:08:55 crc kubenswrapper[5120]: I0316 17:08:55.528717 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:08:55 crc kubenswrapper[5120]: I0316 17:08:55.557755 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-76c554b9b6-6szl6" podStartSLOduration=2.557736899 podStartE2EDuration="2.557736899s" podCreationTimestamp="2026-03-16 17:08:53 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:08:55.551394633 +0000 UTC m=+5837.705326310" watchObservedRunningTime="2026-03-16 17:08:55.557736899 +0000 UTC m=+5837.711668556" Mar 16 17:08:55 crc kubenswrapper[5120]: I0316 17:08:55.664712 5120 scope.go:117] "RemoveContainer" containerID="db39d192fa687a13805537d08ad22fed1ef362ef5027c920a616297dc55a8ea9" Mar 16 17:08:55 crc kubenswrapper[5120]: E0316 17:08:55.665119 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 17:08:55 crc kubenswrapper[5120]: I0316 17:08:55.876329 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:08:55 crc kubenswrapper[5120]: I0316 17:08:55.876402 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:08:55 crc kubenswrapper[5120]: I0316 17:08:55.957431 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:08:56 crc kubenswrapper[5120]: I0316 17:08:56.067153 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/ab5d1889-4b15-4b9d-92fb-838a10dc858f-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"ab5d1889-4b15-4b9d-92fb-838a10dc858f\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:08:56 crc kubenswrapper[5120]: E0316 17:08:56.067268 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-galera-openstack-svc: secret "cert-galera-openstack-svc" not found Mar 16 17:08:56 crc kubenswrapper[5120]: E0316 17:08:56.067361 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab5d1889-4b15-4b9d-92fb-838a10dc858f-galera-tls-certs podName:ab5d1889-4b15-4b9d-92fb-838a10dc858f nodeName:}" failed. No retries permitted until 2026-03-16 17:09:12.067336107 +0000 UTC m=+5854.221267794 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "galera-tls-certs" (UniqueName: "kubernetes.io/secret/ab5d1889-4b15-4b9d-92fb-838a10dc858f-galera-tls-certs") pod "openstack-galera-0" (UID: "ab5d1889-4b15-4b9d-92fb-838a10dc858f") : secret "cert-galera-openstack-svc" not found Mar 16 17:08:56 crc kubenswrapper[5120]: I0316 17:08:56.537173 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-76c554b9b6-6szl6" Mar 16 17:08:56 crc kubenswrapper[5120]: I0316 17:08:56.537564 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-76c554b9b6-6szl6" Mar 16 17:08:56 crc kubenswrapper[5120]: I0316 17:08:56.618601 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:08:56 crc kubenswrapper[5120]: I0316 17:08:56.717728 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:08:56 crc kubenswrapper[5120]: I0316 17:08:56.745509 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:08:57 crc kubenswrapper[5120]: I0316 17:08:57.202872 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/45defe5f-ca2f-4993-8430-d713ed1c9df0-public-tls-certs\") pod \"cinder-api-0\" (UID: \"45defe5f-ca2f-4993-8430-d713ed1c9df0\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:08:57 crc kubenswrapper[5120]: E0316 17:08:57.203239 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-cinder-public-svc: secret "cert-cinder-public-svc" not found Mar 16 17:08:57 crc kubenswrapper[5120]: E0316 17:08:57.203396 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45defe5f-ca2f-4993-8430-d713ed1c9df0-public-tls-certs podName:45defe5f-ca2f-4993-8430-d713ed1c9df0 nodeName:}" failed. No retries permitted until 2026-03-16 17:09:13.203362879 +0000 UTC m=+5855.357294576 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/45defe5f-ca2f-4993-8430-d713ed1c9df0-public-tls-certs") pod "cinder-api-0" (UID: "45defe5f-ca2f-4993-8430-d713ed1c9df0") : secret "cert-cinder-public-svc" not found Mar 16 17:08:57 crc kubenswrapper[5120]: I0316 17:08:57.575942 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:08:57 crc kubenswrapper[5120]: I0316 17:08:57.597689 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:08:57 crc kubenswrapper[5120]: I0316 17:08:57.603307 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:08:58 crc kubenswrapper[5120]: I0316 17:08:58.147734 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/15200613-4843-450f-bf1e-e7b152c48f43-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"15200613-4843-450f-bf1e-e7b152c48f43\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:08:58 crc kubenswrapper[5120]: E0316 17:08:58.148391 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-glance-default-public-svc: secret "cert-glance-default-public-svc" not found Mar 16 17:08:58 crc kubenswrapper[5120]: E0316 17:08:58.148512 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15200613-4843-450f-bf1e-e7b152c48f43-public-tls-certs podName:15200613-4843-450f-bf1e-e7b152c48f43 nodeName:}" failed. No retries permitted until 2026-03-16 17:09:14.148475908 +0000 UTC m=+5856.302407565 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/15200613-4843-450f-bf1e-e7b152c48f43-public-tls-certs") pod "glance-default-external-api-0" (UID: "15200613-4843-450f-bf1e-e7b152c48f43") : secret "cert-glance-default-public-svc" not found Mar 16 17:08:59 crc kubenswrapper[5120]: I0316 17:08:59.078228 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-7648f748d8-cxwnc"] Mar 16 17:08:59 crc kubenswrapper[5120]: E0316 17:08:59.079572 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[internal-tls-certs public-tls-certs], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openstack-kuttl-tests/barbican-api-7648f748d8-cxwnc" podUID="3f98651e-6cef-4b31-8aac-46d152305e88" Mar 16 17:08:59 crc kubenswrapper[5120]: I0316 17:08:59.101910 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-api-5866f469b4-fczj7"] Mar 16 17:08:59 crc kubenswrapper[5120]: I0316 17:08:59.133873 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-5866f469b4-fczj7"] Mar 16 17:08:59 crc kubenswrapper[5120]: I0316 17:08:59.133997 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-5866f469b4-fczj7" Mar 16 17:08:59 crc kubenswrapper[5120]: I0316 17:08:59.179232 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bc40587b-0877-4370-bdcc-a56479bf99e6-config-data\") pod \"barbican-api-5866f469b4-fczj7\" (UID: \"bc40587b-0877-4370-bdcc-a56479bf99e6\") " pod="openstack-kuttl-tests/barbican-api-5866f469b4-fczj7" Mar 16 17:08:59 crc kubenswrapper[5120]: I0316 17:08:59.179527 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/bc40587b-0877-4370-bdcc-a56479bf99e6-logs\") pod \"barbican-api-5866f469b4-fczj7\" (UID: \"bc40587b-0877-4370-bdcc-a56479bf99e6\") " pod="openstack-kuttl-tests/barbican-api-5866f469b4-fczj7" Mar 16 17:08:59 crc kubenswrapper[5120]: I0316 17:08:59.179625 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bc40587b-0877-4370-bdcc-a56479bf99e6-combined-ca-bundle\") pod \"barbican-api-5866f469b4-fczj7\" (UID: \"bc40587b-0877-4370-bdcc-a56479bf99e6\") " pod="openstack-kuttl-tests/barbican-api-5866f469b4-fczj7" Mar 16 17:08:59 crc kubenswrapper[5120]: I0316 17:08:59.180096 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/bc40587b-0877-4370-bdcc-a56479bf99e6-internal-tls-certs\") pod \"barbican-api-5866f469b4-fczj7\" (UID: \"bc40587b-0877-4370-bdcc-a56479bf99e6\") " pod="openstack-kuttl-tests/barbican-api-5866f469b4-fczj7" Mar 16 17:08:59 crc kubenswrapper[5120]: I0316 17:08:59.180157 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkzlf\" (UniqueName: \"kubernetes.io/projected/bc40587b-0877-4370-bdcc-a56479bf99e6-kube-api-access-dkzlf\") pod \"barbican-api-5866f469b4-fczj7\" (UID: \"bc40587b-0877-4370-bdcc-a56479bf99e6\") " pod="openstack-kuttl-tests/barbican-api-5866f469b4-fczj7" Mar 16 17:08:59 crc kubenswrapper[5120]: I0316 17:08:59.180278 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/bc40587b-0877-4370-bdcc-a56479bf99e6-public-tls-certs\") pod \"barbican-api-5866f469b4-fczj7\" (UID: \"bc40587b-0877-4370-bdcc-a56479bf99e6\") " pod="openstack-kuttl-tests/barbican-api-5866f469b4-fczj7" Mar 16 17:08:59 crc kubenswrapper[5120]: I0316 17:08:59.180326 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/d8ee8115-84b1-4f8e-acce-1f745eb1a339-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"d8ee8115-84b1-4f8e-acce-1f745eb1a339\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:08:59 crc kubenswrapper[5120]: I0316 17:08:59.180361 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/bc40587b-0877-4370-bdcc-a56479bf99e6-config-data-custom\") pod \"barbican-api-5866f469b4-fczj7\" (UID: \"bc40587b-0877-4370-bdcc-a56479bf99e6\") " pod="openstack-kuttl-tests/barbican-api-5866f469b4-fczj7" Mar 16 17:08:59 crc kubenswrapper[5120]: I0316 17:08:59.189201 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/d8ee8115-84b1-4f8e-acce-1f745eb1a339-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"d8ee8115-84b1-4f8e-acce-1f745eb1a339\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:08:59 crc kubenswrapper[5120]: I0316 17:08:59.282277 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/bc40587b-0877-4370-bdcc-a56479bf99e6-logs\") pod \"barbican-api-5866f469b4-fczj7\" (UID: \"bc40587b-0877-4370-bdcc-a56479bf99e6\") " pod="openstack-kuttl-tests/barbican-api-5866f469b4-fczj7" Mar 16 17:08:59 crc kubenswrapper[5120]: I0316 17:08:59.282623 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bc40587b-0877-4370-bdcc-a56479bf99e6-combined-ca-bundle\") pod \"barbican-api-5866f469b4-fczj7\" (UID: \"bc40587b-0877-4370-bdcc-a56479bf99e6\") " pod="openstack-kuttl-tests/barbican-api-5866f469b4-fczj7" Mar 16 17:08:59 crc kubenswrapper[5120]: I0316 17:08:59.282834 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/bc40587b-0877-4370-bdcc-a56479bf99e6-logs\") pod \"barbican-api-5866f469b4-fczj7\" (UID: \"bc40587b-0877-4370-bdcc-a56479bf99e6\") " pod="openstack-kuttl-tests/barbican-api-5866f469b4-fczj7" Mar 16 17:08:59 crc kubenswrapper[5120]: I0316 17:08:59.282997 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/bc40587b-0877-4370-bdcc-a56479bf99e6-internal-tls-certs\") pod \"barbican-api-5866f469b4-fczj7\" (UID: \"bc40587b-0877-4370-bdcc-a56479bf99e6\") " pod="openstack-kuttl-tests/barbican-api-5866f469b4-fczj7" Mar 16 17:08:59 crc kubenswrapper[5120]: I0316 17:08:59.283050 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dkzlf\" (UniqueName: \"kubernetes.io/projected/bc40587b-0877-4370-bdcc-a56479bf99e6-kube-api-access-dkzlf\") pod \"barbican-api-5866f469b4-fczj7\" (UID: \"bc40587b-0877-4370-bdcc-a56479bf99e6\") " pod="openstack-kuttl-tests/barbican-api-5866f469b4-fczj7" Mar 16 17:08:59 crc kubenswrapper[5120]: I0316 17:08:59.283162 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/bc40587b-0877-4370-bdcc-a56479bf99e6-public-tls-certs\") pod \"barbican-api-5866f469b4-fczj7\" (UID: \"bc40587b-0877-4370-bdcc-a56479bf99e6\") " pod="openstack-kuttl-tests/barbican-api-5866f469b4-fczj7" Mar 16 17:08:59 crc kubenswrapper[5120]: I0316 17:08:59.283236 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/bc40587b-0877-4370-bdcc-a56479bf99e6-config-data-custom\") pod \"barbican-api-5866f469b4-fczj7\" (UID: \"bc40587b-0877-4370-bdcc-a56479bf99e6\") " pod="openstack-kuttl-tests/barbican-api-5866f469b4-fczj7" Mar 16 17:08:59 crc kubenswrapper[5120]: I0316 17:08:59.283913 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bc40587b-0877-4370-bdcc-a56479bf99e6-config-data\") pod \"barbican-api-5866f469b4-fczj7\" (UID: \"bc40587b-0877-4370-bdcc-a56479bf99e6\") " pod="openstack-kuttl-tests/barbican-api-5866f469b4-fczj7" Mar 16 17:08:59 crc kubenswrapper[5120]: I0316 17:08:59.287101 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/bc40587b-0877-4370-bdcc-a56479bf99e6-internal-tls-certs\") pod \"barbican-api-5866f469b4-fczj7\" (UID: \"bc40587b-0877-4370-bdcc-a56479bf99e6\") " pod="openstack-kuttl-tests/barbican-api-5866f469b4-fczj7" Mar 16 17:08:59 crc kubenswrapper[5120]: I0316 17:08:59.287238 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/bc40587b-0877-4370-bdcc-a56479bf99e6-config-data-custom\") pod \"barbican-api-5866f469b4-fczj7\" (UID: \"bc40587b-0877-4370-bdcc-a56479bf99e6\") " pod="openstack-kuttl-tests/barbican-api-5866f469b4-fczj7" Mar 16 17:08:59 crc kubenswrapper[5120]: I0316 17:08:59.287577 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bc40587b-0877-4370-bdcc-a56479bf99e6-combined-ca-bundle\") pod \"barbican-api-5866f469b4-fczj7\" (UID: \"bc40587b-0877-4370-bdcc-a56479bf99e6\") " pod="openstack-kuttl-tests/barbican-api-5866f469b4-fczj7" Mar 16 17:08:59 crc kubenswrapper[5120]: I0316 17:08:59.288286 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bc40587b-0877-4370-bdcc-a56479bf99e6-config-data\") pod \"barbican-api-5866f469b4-fczj7\" (UID: \"bc40587b-0877-4370-bdcc-a56479bf99e6\") " pod="openstack-kuttl-tests/barbican-api-5866f469b4-fczj7" Mar 16 17:08:59 crc kubenswrapper[5120]: I0316 17:08:59.288378 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/bc40587b-0877-4370-bdcc-a56479bf99e6-public-tls-certs\") pod \"barbican-api-5866f469b4-fczj7\" (UID: \"bc40587b-0877-4370-bdcc-a56479bf99e6\") " pod="openstack-kuttl-tests/barbican-api-5866f469b4-fczj7" Mar 16 17:08:59 crc kubenswrapper[5120]: I0316 17:08:59.308310 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkzlf\" (UniqueName: \"kubernetes.io/projected/bc40587b-0877-4370-bdcc-a56479bf99e6-kube-api-access-dkzlf\") pod \"barbican-api-5866f469b4-fczj7\" (UID: \"bc40587b-0877-4370-bdcc-a56479bf99e6\") " pod="openstack-kuttl-tests/barbican-api-5866f469b4-fczj7" Mar 16 17:08:59 crc kubenswrapper[5120]: I0316 17:08:59.461105 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-5866f469b4-fczj7" Mar 16 17:08:59 crc kubenswrapper[5120]: I0316 17:08:59.483244 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:08:59 crc kubenswrapper[5120]: I0316 17:08:59.499269 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:08:59 crc kubenswrapper[5120]: I0316 17:08:59.499398 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:08:59 crc kubenswrapper[5120]: I0316 17:08:59.585064 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-7648f748d8-cxwnc" Mar 16 17:08:59 crc kubenswrapper[5120]: I0316 17:08:59.620255 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-7648f748d8-cxwnc" Mar 16 17:08:59 crc kubenswrapper[5120]: I0316 17:08:59.693458 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/3f98651e-6cef-4b31-8aac-46d152305e88-config-data-custom\") pod \"3f98651e-6cef-4b31-8aac-46d152305e88\" (UID: \"3f98651e-6cef-4b31-8aac-46d152305e88\") " Mar 16 17:08:59 crc kubenswrapper[5120]: I0316 17:08:59.693545 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3f98651e-6cef-4b31-8aac-46d152305e88-config-data\") pod \"3f98651e-6cef-4b31-8aac-46d152305e88\" (UID: \"3f98651e-6cef-4b31-8aac-46d152305e88\") " Mar 16 17:08:59 crc kubenswrapper[5120]: I0316 17:08:59.694382 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3f98651e-6cef-4b31-8aac-46d152305e88-combined-ca-bundle\") pod \"3f98651e-6cef-4b31-8aac-46d152305e88\" (UID: \"3f98651e-6cef-4b31-8aac-46d152305e88\") " Mar 16 17:08:59 crc kubenswrapper[5120]: I0316 17:08:59.694436 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3f98651e-6cef-4b31-8aac-46d152305e88-logs\") pod \"3f98651e-6cef-4b31-8aac-46d152305e88\" (UID: \"3f98651e-6cef-4b31-8aac-46d152305e88\") " Mar 16 17:08:59 crc kubenswrapper[5120]: I0316 17:08:59.694525 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r2mhb\" (UniqueName: \"kubernetes.io/projected/3f98651e-6cef-4b31-8aac-46d152305e88-kube-api-access-r2mhb\") pod \"3f98651e-6cef-4b31-8aac-46d152305e88\" (UID: \"3f98651e-6cef-4b31-8aac-46d152305e88\") " Mar 16 17:08:59 crc kubenswrapper[5120]: I0316 17:08:59.694825 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f98651e-6cef-4b31-8aac-46d152305e88-logs" (OuterVolumeSpecName: "logs") pod "3f98651e-6cef-4b31-8aac-46d152305e88" (UID: "3f98651e-6cef-4b31-8aac-46d152305e88"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:08:59 crc kubenswrapper[5120]: I0316 17:08:59.695553 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3f98651e-6cef-4b31-8aac-46d152305e88-logs\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:59 crc kubenswrapper[5120]: I0316 17:08:59.700819 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f98651e-6cef-4b31-8aac-46d152305e88-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "3f98651e-6cef-4b31-8aac-46d152305e88" (UID: "3f98651e-6cef-4b31-8aac-46d152305e88"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:08:59 crc kubenswrapper[5120]: I0316 17:08:59.702040 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f98651e-6cef-4b31-8aac-46d152305e88-kube-api-access-r2mhb" (OuterVolumeSpecName: "kube-api-access-r2mhb") pod "3f98651e-6cef-4b31-8aac-46d152305e88" (UID: "3f98651e-6cef-4b31-8aac-46d152305e88"). InnerVolumeSpecName "kube-api-access-r2mhb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:08:59 crc kubenswrapper[5120]: I0316 17:08:59.702133 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f98651e-6cef-4b31-8aac-46d152305e88-config-data" (OuterVolumeSpecName: "config-data") pod "3f98651e-6cef-4b31-8aac-46d152305e88" (UID: "3f98651e-6cef-4b31-8aac-46d152305e88"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:08:59 crc kubenswrapper[5120]: I0316 17:08:59.710207 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f98651e-6cef-4b31-8aac-46d152305e88-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "3f98651e-6cef-4b31-8aac-46d152305e88" (UID: "3f98651e-6cef-4b31-8aac-46d152305e88"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:08:59 crc kubenswrapper[5120]: I0316 17:08:59.798064 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3f98651e-6cef-4b31-8aac-46d152305e88-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:59 crc kubenswrapper[5120]: I0316 17:08:59.798099 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r2mhb\" (UniqueName: \"kubernetes.io/projected/3f98651e-6cef-4b31-8aac-46d152305e88-kube-api-access-r2mhb\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:59 crc kubenswrapper[5120]: I0316 17:08:59.798112 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/3f98651e-6cef-4b31-8aac-46d152305e88-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:59 crc kubenswrapper[5120]: I0316 17:08:59.798121 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3f98651e-6cef-4b31-8aac-46d152305e88-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:08:59 crc kubenswrapper[5120]: I0316 17:08:59.933493 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-5866f469b4-fczj7"] Mar 16 17:09:00 crc kubenswrapper[5120]: I0316 17:09:00.000367 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:09:00 crc kubenswrapper[5120]: W0316 17:09:00.002153 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd8ee8115_84b1_4f8e_acce_1f745eb1a339.slice/crio-43833890f668da5b21bd398db33197c7844adec6e9aab3470d9313710c62b35a WatchSource:0}: Error finding container 43833890f668da5b21bd398db33197c7844adec6e9aab3470d9313710c62b35a: Status 404 returned error can't find the container with id 43833890f668da5b21bd398db33197c7844adec6e9aab3470d9313710c62b35a Mar 16 17:09:00 crc kubenswrapper[5120]: I0316 17:09:00.019710 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:09:00 crc kubenswrapper[5120]: I0316 17:09:00.019845 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:09:00 crc kubenswrapper[5120]: I0316 17:09:00.245416 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 17:09:00 crc kubenswrapper[5120]: E0316 17:09:00.246553 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[public-tls-certs], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openstack-kuttl-tests/cinder-api-0" podUID="45defe5f-ca2f-4993-8430-d713ed1c9df0" Mar 16 17:09:00 crc kubenswrapper[5120]: I0316 17:09:00.436752 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 17:09:00 crc kubenswrapper[5120]: E0316 17:09:00.437543 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[galera-tls-certs], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openstack-kuttl-tests/openstack-galera-0" podUID="ab5d1889-4b15-4b9d-92fb-838a10dc858f" Mar 16 17:09:00 crc kubenswrapper[5120]: I0316 17:09:00.504975 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="69bb2342-14e1-4c32-889a-e33f6ba42651" containerName="nova-api-log" probeResult="failure" output="Get \"https://10.217.1.243:8774/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Mar 16 17:09:00 crc kubenswrapper[5120]: I0316 17:09:00.505983 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="69bb2342-14e1-4c32-889a-e33f6ba42651" containerName="nova-api-api" probeResult="failure" output="Get \"https://10.217.1.243:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 17:09:00 crc kubenswrapper[5120]: I0316 17:09:00.599571 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"d8ee8115-84b1-4f8e-acce-1f745eb1a339","Type":"ContainerStarted","Data":"43833890f668da5b21bd398db33197c7844adec6e9aab3470d9313710c62b35a"} Mar 16 17:09:00 crc kubenswrapper[5120]: I0316 17:09:00.603633 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-5866f469b4-fczj7" event={"ID":"bc40587b-0877-4370-bdcc-a56479bf99e6","Type":"ContainerStarted","Data":"7d73343d7be0ecf4e34e8548de8e689810358007288282c370dc697d0c48f215"} Mar 16 17:09:00 crc kubenswrapper[5120]: I0316 17:09:00.603713 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-5866f469b4-fczj7" event={"ID":"bc40587b-0877-4370-bdcc-a56479bf99e6","Type":"ContainerStarted","Data":"de97a4d8d92d47af6b2c3179afe85e9468a8f5f8548789f8052a414b31dd9b1d"} Mar 16 17:09:00 crc kubenswrapper[5120]: I0316 17:09:00.603732 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-5866f469b4-fczj7" event={"ID":"bc40587b-0877-4370-bdcc-a56479bf99e6","Type":"ContainerStarted","Data":"959fa3511d7e747bd3ff41c6639e595ac27b4a50154b39463bd4e88088d5dace"} Mar 16 17:09:00 crc kubenswrapper[5120]: I0316 17:09:00.603820 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-5866f469b4-fczj7" Mar 16 17:09:00 crc kubenswrapper[5120]: I0316 17:09:00.603854 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-5866f469b4-fczj7" Mar 16 17:09:00 crc kubenswrapper[5120]: I0316 17:09:00.603882 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-7648f748d8-cxwnc" Mar 16 17:09:00 crc kubenswrapper[5120]: I0316 17:09:00.603934 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:09:00 crc kubenswrapper[5120]: I0316 17:09:00.604599 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:09:00 crc kubenswrapper[5120]: I0316 17:09:00.626765 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:09:00 crc kubenswrapper[5120]: I0316 17:09:00.645794 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:09:00 crc kubenswrapper[5120]: I0316 17:09:00.686082 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-api-5866f469b4-fczj7" podStartSLOduration=1.68606007 podStartE2EDuration="1.68606007s" podCreationTimestamp="2026-03-16 17:08:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:09:00.636308485 +0000 UTC m=+5842.790240162" watchObservedRunningTime="2026-03-16 17:09:00.68606007 +0000 UTC m=+5842.839991727" Mar 16 17:09:00 crc kubenswrapper[5120]: I0316 17:09:00.761997 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/45defe5f-ca2f-4993-8430-d713ed1c9df0-config-data-custom\") pod \"45defe5f-ca2f-4993-8430-d713ed1c9df0\" (UID: \"45defe5f-ca2f-4993-8430-d713ed1c9df0\") " Mar 16 17:09:00 crc kubenswrapper[5120]: I0316 17:09:00.762141 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/45defe5f-ca2f-4993-8430-d713ed1c9df0-scripts\") pod \"45defe5f-ca2f-4993-8430-d713ed1c9df0\" (UID: \"45defe5f-ca2f-4993-8430-d713ed1c9df0\") " Mar 16 17:09:00 crc kubenswrapper[5120]: I0316 17:09:00.762231 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fqbln\" (UniqueName: \"kubernetes.io/projected/ab5d1889-4b15-4b9d-92fb-838a10dc858f-kube-api-access-fqbln\") pod \"ab5d1889-4b15-4b9d-92fb-838a10dc858f\" (UID: \"ab5d1889-4b15-4b9d-92fb-838a10dc858f\") " Mar 16 17:09:00 crc kubenswrapper[5120]: I0316 17:09:00.762380 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-69rwg\" (UniqueName: \"kubernetes.io/projected/45defe5f-ca2f-4993-8430-d713ed1c9df0-kube-api-access-69rwg\") pod \"45defe5f-ca2f-4993-8430-d713ed1c9df0\" (UID: \"45defe5f-ca2f-4993-8430-d713ed1c9df0\") " Mar 16 17:09:00 crc kubenswrapper[5120]: I0316 17:09:00.762444 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/45defe5f-ca2f-4993-8430-d713ed1c9df0-logs\") pod \"45defe5f-ca2f-4993-8430-d713ed1c9df0\" (UID: \"45defe5f-ca2f-4993-8430-d713ed1c9df0\") " Mar 16 17:09:00 crc kubenswrapper[5120]: I0316 17:09:00.762464 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ab5d1889-4b15-4b9d-92fb-838a10dc858f-operator-scripts\") pod \"ab5d1889-4b15-4b9d-92fb-838a10dc858f\" (UID: \"ab5d1889-4b15-4b9d-92fb-838a10dc858f\") " Mar 16 17:09:00 crc kubenswrapper[5120]: I0316 17:09:00.762543 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/45defe5f-ca2f-4993-8430-d713ed1c9df0-etc-machine-id\") pod \"45defe5f-ca2f-4993-8430-d713ed1c9df0\" (UID: \"45defe5f-ca2f-4993-8430-d713ed1c9df0\") " Mar 16 17:09:00 crc kubenswrapper[5120]: I0316 17:09:00.762621 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/45defe5f-ca2f-4993-8430-d713ed1c9df0-config-data\") pod \"45defe5f-ca2f-4993-8430-d713ed1c9df0\" (UID: \"45defe5f-ca2f-4993-8430-d713ed1c9df0\") " Mar 16 17:09:00 crc kubenswrapper[5120]: I0316 17:09:00.762665 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/ab5d1889-4b15-4b9d-92fb-838a10dc858f-config-data-default\") pod \"ab5d1889-4b15-4b9d-92fb-838a10dc858f\" (UID: \"ab5d1889-4b15-4b9d-92fb-838a10dc858f\") " Mar 16 17:09:00 crc kubenswrapper[5120]: I0316 17:09:00.762735 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/ab5d1889-4b15-4b9d-92fb-838a10dc858f-config-data-generated\") pod \"ab5d1889-4b15-4b9d-92fb-838a10dc858f\" (UID: \"ab5d1889-4b15-4b9d-92fb-838a10dc858f\") " Mar 16 17:09:00 crc kubenswrapper[5120]: I0316 17:09:00.762750 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/45defe5f-ca2f-4993-8430-d713ed1c9df0-combined-ca-bundle\") pod \"45defe5f-ca2f-4993-8430-d713ed1c9df0\" (UID: \"45defe5f-ca2f-4993-8430-d713ed1c9df0\") " Mar 16 17:09:00 crc kubenswrapper[5120]: I0316 17:09:00.762831 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ab5d1889-4b15-4b9d-92fb-838a10dc858f-combined-ca-bundle\") pod \"ab5d1889-4b15-4b9d-92fb-838a10dc858f\" (UID: \"ab5d1889-4b15-4b9d-92fb-838a10dc858f\") " Mar 16 17:09:00 crc kubenswrapper[5120]: I0316 17:09:00.762870 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/45defe5f-ca2f-4993-8430-d713ed1c9df0-internal-tls-certs\") pod \"45defe5f-ca2f-4993-8430-d713ed1c9df0\" (UID: \"45defe5f-ca2f-4993-8430-d713ed1c9df0\") " Mar 16 17:09:00 crc kubenswrapper[5120]: I0316 17:09:00.762906 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/ab5d1889-4b15-4b9d-92fb-838a10dc858f-kolla-config\") pod \"ab5d1889-4b15-4b9d-92fb-838a10dc858f\" (UID: \"ab5d1889-4b15-4b9d-92fb-838a10dc858f\") " Mar 16 17:09:00 crc kubenswrapper[5120]: I0316 17:09:00.763111 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"mysql-db\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"ab5d1889-4b15-4b9d-92fb-838a10dc858f\" (UID: \"ab5d1889-4b15-4b9d-92fb-838a10dc858f\") " Mar 16 17:09:00 crc kubenswrapper[5120]: I0316 17:09:00.763720 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ab5d1889-4b15-4b9d-92fb-838a10dc858f-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "ab5d1889-4b15-4b9d-92fb-838a10dc858f" (UID: "ab5d1889-4b15-4b9d-92fb-838a10dc858f"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:09:00 crc kubenswrapper[5120]: I0316 17:09:00.764408 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ab5d1889-4b15-4b9d-92fb-838a10dc858f-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:00 crc kubenswrapper[5120]: I0316 17:09:00.764943 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/45defe5f-ca2f-4993-8430-d713ed1c9df0-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "45defe5f-ca2f-4993-8430-d713ed1c9df0" (UID: "45defe5f-ca2f-4993-8430-d713ed1c9df0"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 17:09:00 crc kubenswrapper[5120]: I0316 17:09:00.767072 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab5d1889-4b15-4b9d-92fb-838a10dc858f-kube-api-access-fqbln" (OuterVolumeSpecName: "kube-api-access-fqbln") pod "ab5d1889-4b15-4b9d-92fb-838a10dc858f" (UID: "ab5d1889-4b15-4b9d-92fb-838a10dc858f"). InnerVolumeSpecName "kube-api-access-fqbln". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:09:00 crc kubenswrapper[5120]: I0316 17:09:00.769237 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45defe5f-ca2f-4993-8430-d713ed1c9df0-logs" (OuterVolumeSpecName: "logs") pod "45defe5f-ca2f-4993-8430-d713ed1c9df0" (UID: "45defe5f-ca2f-4993-8430-d713ed1c9df0"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:09:00 crc kubenswrapper[5120]: I0316 17:09:00.769504 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ab5d1889-4b15-4b9d-92fb-838a10dc858f-config-data-default" (OuterVolumeSpecName: "config-data-default") pod "ab5d1889-4b15-4b9d-92fb-838a10dc858f" (UID: "ab5d1889-4b15-4b9d-92fb-838a10dc858f"). InnerVolumeSpecName "config-data-default". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:09:00 crc kubenswrapper[5120]: I0316 17:09:00.770180 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45defe5f-ca2f-4993-8430-d713ed1c9df0-config-data" (OuterVolumeSpecName: "config-data") pod "45defe5f-ca2f-4993-8430-d713ed1c9df0" (UID: "45defe5f-ca2f-4993-8430-d713ed1c9df0"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:09:00 crc kubenswrapper[5120]: I0316 17:09:00.770627 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab5d1889-4b15-4b9d-92fb-838a10dc858f-config-data-generated" (OuterVolumeSpecName: "config-data-generated") pod "ab5d1889-4b15-4b9d-92fb-838a10dc858f" (UID: "ab5d1889-4b15-4b9d-92fb-838a10dc858f"). InnerVolumeSpecName "config-data-generated". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:09:00 crc kubenswrapper[5120]: I0316 17:09:00.771131 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45defe5f-ca2f-4993-8430-d713ed1c9df0-kube-api-access-69rwg" (OuterVolumeSpecName: "kube-api-access-69rwg") pod "45defe5f-ca2f-4993-8430-d713ed1c9df0" (UID: "45defe5f-ca2f-4993-8430-d713ed1c9df0"). InnerVolumeSpecName "kube-api-access-69rwg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:09:00 crc kubenswrapper[5120]: I0316 17:09:00.773690 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45defe5f-ca2f-4993-8430-d713ed1c9df0-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "45defe5f-ca2f-4993-8430-d713ed1c9df0" (UID: "45defe5f-ca2f-4993-8430-d713ed1c9df0"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:09:00 crc kubenswrapper[5120]: I0316 17:09:00.774201 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ab5d1889-4b15-4b9d-92fb-838a10dc858f-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "ab5d1889-4b15-4b9d-92fb-838a10dc858f" (UID: "ab5d1889-4b15-4b9d-92fb-838a10dc858f"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:09:00 crc kubenswrapper[5120]: I0316 17:09:00.776626 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ab5d1889-4b15-4b9d-92fb-838a10dc858f-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ab5d1889-4b15-4b9d-92fb-838a10dc858f" (UID: "ab5d1889-4b15-4b9d-92fb-838a10dc858f"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:09:00 crc kubenswrapper[5120]: I0316 17:09:00.777722 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45defe5f-ca2f-4993-8430-d713ed1c9df0-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "45defe5f-ca2f-4993-8430-d713ed1c9df0" (UID: "45defe5f-ca2f-4993-8430-d713ed1c9df0"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:09:00 crc kubenswrapper[5120]: I0316 17:09:00.779138 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage20-crc" (OuterVolumeSpecName: "mysql-db") pod "ab5d1889-4b15-4b9d-92fb-838a10dc858f" (UID: "ab5d1889-4b15-4b9d-92fb-838a10dc858f"). InnerVolumeSpecName "local-storage20-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 17:09:00 crc kubenswrapper[5120]: I0316 17:09:00.781217 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45defe5f-ca2f-4993-8430-d713ed1c9df0-scripts" (OuterVolumeSpecName: "scripts") pod "45defe5f-ca2f-4993-8430-d713ed1c9df0" (UID: "45defe5f-ca2f-4993-8430-d713ed1c9df0"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:09:00 crc kubenswrapper[5120]: I0316 17:09:00.783667 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45defe5f-ca2f-4993-8430-d713ed1c9df0-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "45defe5f-ca2f-4993-8430-d713ed1c9df0" (UID: "45defe5f-ca2f-4993-8430-d713ed1c9df0"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:09:00 crc kubenswrapper[5120]: I0316 17:09:00.867432 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/45defe5f-ca2f-4993-8430-d713ed1c9df0-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:00 crc kubenswrapper[5120]: I0316 17:09:00.867481 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/ab5d1889-4b15-4b9d-92fb-838a10dc858f-config-data-default\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:00 crc kubenswrapper[5120]: I0316 17:09:00.867498 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/ab5d1889-4b15-4b9d-92fb-838a10dc858f-config-data-generated\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:00 crc kubenswrapper[5120]: I0316 17:09:00.867509 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/45defe5f-ca2f-4993-8430-d713ed1c9df0-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:00 crc kubenswrapper[5120]: I0316 17:09:00.867519 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ab5d1889-4b15-4b9d-92fb-838a10dc858f-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:00 crc kubenswrapper[5120]: I0316 17:09:00.867531 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/45defe5f-ca2f-4993-8430-d713ed1c9df0-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:00 crc kubenswrapper[5120]: I0316 17:09:00.867545 5120 reconciler_common.go:299] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/ab5d1889-4b15-4b9d-92fb-838a10dc858f-kolla-config\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:00 crc kubenswrapper[5120]: I0316 17:09:00.867586 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") on node \"crc\" " Mar 16 17:09:00 crc kubenswrapper[5120]: I0316 17:09:00.867598 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/45defe5f-ca2f-4993-8430-d713ed1c9df0-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:00 crc kubenswrapper[5120]: I0316 17:09:00.867609 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/45defe5f-ca2f-4993-8430-d713ed1c9df0-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:00 crc kubenswrapper[5120]: I0316 17:09:00.867620 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fqbln\" (UniqueName: \"kubernetes.io/projected/ab5d1889-4b15-4b9d-92fb-838a10dc858f-kube-api-access-fqbln\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:00 crc kubenswrapper[5120]: I0316 17:09:00.867633 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-69rwg\" (UniqueName: \"kubernetes.io/projected/45defe5f-ca2f-4993-8430-d713ed1c9df0-kube-api-access-69rwg\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:00 crc kubenswrapper[5120]: I0316 17:09:00.867644 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/45defe5f-ca2f-4993-8430-d713ed1c9df0-logs\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:00 crc kubenswrapper[5120]: I0316 17:09:00.867656 5120 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/45defe5f-ca2f-4993-8430-d713ed1c9df0-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:00 crc kubenswrapper[5120]: I0316 17:09:00.886745 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-7648f748d8-cxwnc"] Mar 16 17:09:00 crc kubenswrapper[5120]: I0316 17:09:00.886818 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-api-7648f748d8-cxwnc"] Mar 16 17:09:00 crc kubenswrapper[5120]: I0316 17:09:00.888832 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage20-crc" (UniqueName: "kubernetes.io/local-volume/local-storage20-crc") on node "crc" Mar 16 17:09:00 crc kubenswrapper[5120]: I0316 17:09:00.924996 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="6e4e8c65-5607-4f79-ba90-208ca1a32521" containerName="cinder-scheduler" probeResult="failure" output="Get \"http://10.217.1.249:8080/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 17:09:00 crc kubenswrapper[5120]: I0316 17:09:00.971000 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/3f98651e-6cef-4b31-8aac-46d152305e88-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:00 crc kubenswrapper[5120]: I0316 17:09:00.971043 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/3f98651e-6cef-4b31-8aac-46d152305e88-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:00 crc kubenswrapper[5120]: I0316 17:09:00.971053 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:01 crc kubenswrapper[5120]: I0316 17:09:01.629977 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"d8ee8115-84b1-4f8e-acce-1f745eb1a339","Type":"ContainerStarted","Data":"8c17be947fc1c3fb5e147a045257806a695cefab621e507228a1226e917445fa"} Mar 16 17:09:01 crc kubenswrapper[5120]: I0316 17:09:01.630125 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:09:01 crc kubenswrapper[5120]: I0316 17:09:01.630317 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:09:01 crc kubenswrapper[5120]: I0316 17:09:01.664313 5120 scope.go:117] "RemoveContainer" containerID="42045ce1645b68cad8b1bbbfc95aca5ef9dc16d881fd98903c7824b31f5fd0cf" Mar 16 17:09:01 crc kubenswrapper[5120]: I0316 17:09:01.855225 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 17:09:01 crc kubenswrapper[5120]: I0316 17:09:01.896383 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 17:09:01 crc kubenswrapper[5120]: I0316 17:09:01.914141 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 17:09:01 crc kubenswrapper[5120]: I0316 17:09:01.931108 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:09:01 crc kubenswrapper[5120]: I0316 17:09:01.938470 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"galera-openstack-dockercfg-ct9tq\"" Mar 16 17:09:01 crc kubenswrapper[5120]: I0316 17:09:01.938827 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-scripts\"" Mar 16 17:09:01 crc kubenswrapper[5120]: I0316 17:09:01.942920 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 17:09:01 crc kubenswrapper[5120]: I0316 17:09:01.947964 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-galera-openstack-svc\"" Mar 16 17:09:01 crc kubenswrapper[5120]: I0316 17:09:01.948275 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-config-data\"" Mar 16 17:09:01 crc kubenswrapper[5120]: I0316 17:09:01.992726 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 17:09:02 crc kubenswrapper[5120]: I0316 17:09:02.005308 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/466bdf84-87d2-46ac-8f19-914a10b4ad63-operator-scripts\") pod \"openstack-galera-0\" (UID: \"466bdf84-87d2-46ac-8f19-914a10b4ad63\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:09:02 crc kubenswrapper[5120]: I0316 17:09:02.005536 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5wk8\" (UniqueName: \"kubernetes.io/projected/466bdf84-87d2-46ac-8f19-914a10b4ad63-kube-api-access-n5wk8\") pod \"openstack-galera-0\" (UID: \"466bdf84-87d2-46ac-8f19-914a10b4ad63\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:09:02 crc kubenswrapper[5120]: I0316 17:09:02.005649 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/466bdf84-87d2-46ac-8f19-914a10b4ad63-config-data-default\") pod \"openstack-galera-0\" (UID: \"466bdf84-87d2-46ac-8f19-914a10b4ad63\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:09:02 crc kubenswrapper[5120]: I0316 17:09:02.005742 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"openstack-galera-0\" (UID: \"466bdf84-87d2-46ac-8f19-914a10b4ad63\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:09:02 crc kubenswrapper[5120]: I0316 17:09:02.006308 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/466bdf84-87d2-46ac-8f19-914a10b4ad63-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"466bdf84-87d2-46ac-8f19-914a10b4ad63\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:09:02 crc kubenswrapper[5120]: I0316 17:09:02.006572 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/466bdf84-87d2-46ac-8f19-914a10b4ad63-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"466bdf84-87d2-46ac-8f19-914a10b4ad63\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:09:02 crc kubenswrapper[5120]: I0316 17:09:02.006742 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/466bdf84-87d2-46ac-8f19-914a10b4ad63-config-data-generated\") pod \"openstack-galera-0\" (UID: \"466bdf84-87d2-46ac-8f19-914a10b4ad63\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:09:02 crc kubenswrapper[5120]: I0316 17:09:02.006976 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/466bdf84-87d2-46ac-8f19-914a10b4ad63-kolla-config\") pod \"openstack-galera-0\" (UID: \"466bdf84-87d2-46ac-8f19-914a10b4ad63\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:09:02 crc kubenswrapper[5120]: I0316 17:09:02.007479 5120 reconciler_common.go:299] "Volume detached for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/ab5d1889-4b15-4b9d-92fb-838a10dc858f-galera-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:02 crc kubenswrapper[5120]: I0316 17:09:02.024537 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 17:09:02 crc kubenswrapper[5120]: I0316 17:09:02.036951 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 17:09:02 crc kubenswrapper[5120]: I0316 17:09:02.047395 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 17:09:02 crc kubenswrapper[5120]: I0316 17:09:02.047421 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:09:02 crc kubenswrapper[5120]: I0316 17:09:02.051115 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-api-config-data\"" Mar 16 17:09:02 crc kubenswrapper[5120]: I0316 17:09:02.051425 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-cinder-public-svc\"" Mar 16 17:09:02 crc kubenswrapper[5120]: I0316 17:09:02.052228 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-cinder-internal-svc\"" Mar 16 17:09:02 crc kubenswrapper[5120]: I0316 17:09:02.111947 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/466bdf84-87d2-46ac-8f19-914a10b4ad63-config-data-default\") pod \"openstack-galera-0\" (UID: \"466bdf84-87d2-46ac-8f19-914a10b4ad63\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:09:02 crc kubenswrapper[5120]: I0316 17:09:02.111999 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"openstack-galera-0\" (UID: \"466bdf84-87d2-46ac-8f19-914a10b4ad63\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:09:02 crc kubenswrapper[5120]: I0316 17:09:02.112039 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/466bdf84-87d2-46ac-8f19-914a10b4ad63-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"466bdf84-87d2-46ac-8f19-914a10b4ad63\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:09:02 crc kubenswrapper[5120]: I0316 17:09:02.112156 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:09:02 crc kubenswrapper[5120]: I0316 17:09:02.112207 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee-public-tls-certs\") pod \"cinder-api-0\" (UID: \"f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:09:02 crc kubenswrapper[5120]: I0316 17:09:02.112246 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/466bdf84-87d2-46ac-8f19-914a10b4ad63-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"466bdf84-87d2-46ac-8f19-914a10b4ad63\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:09:02 crc kubenswrapper[5120]: I0316 17:09:02.112294 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2pkpk\" (UniqueName: \"kubernetes.io/projected/f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee-kube-api-access-2pkpk\") pod \"cinder-api-0\" (UID: \"f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:09:02 crc kubenswrapper[5120]: I0316 17:09:02.112339 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/466bdf84-87d2-46ac-8f19-914a10b4ad63-config-data-generated\") pod \"openstack-galera-0\" (UID: \"466bdf84-87d2-46ac-8f19-914a10b4ad63\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:09:02 crc kubenswrapper[5120]: I0316 17:09:02.112424 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee-config-data-custom\") pod \"cinder-api-0\" (UID: \"f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:09:02 crc kubenswrapper[5120]: I0316 17:09:02.112458 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/466bdf84-87d2-46ac-8f19-914a10b4ad63-kolla-config\") pod \"openstack-galera-0\" (UID: \"466bdf84-87d2-46ac-8f19-914a10b4ad63\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:09:02 crc kubenswrapper[5120]: I0316 17:09:02.112500 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee-logs\") pod \"cinder-api-0\" (UID: \"f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:09:02 crc kubenswrapper[5120]: I0316 17:09:02.112551 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee-etc-machine-id\") pod \"cinder-api-0\" (UID: \"f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:09:02 crc kubenswrapper[5120]: I0316 17:09:02.112693 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee-scripts\") pod \"cinder-api-0\" (UID: \"f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:09:02 crc kubenswrapper[5120]: I0316 17:09:02.113055 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/466bdf84-87d2-46ac-8f19-914a10b4ad63-config-data-default\") pod \"openstack-galera-0\" (UID: \"466bdf84-87d2-46ac-8f19-914a10b4ad63\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:09:02 crc kubenswrapper[5120]: I0316 17:09:02.112772 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee-config-data\") pod \"cinder-api-0\" (UID: \"f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:09:02 crc kubenswrapper[5120]: I0316 17:09:02.113415 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/466bdf84-87d2-46ac-8f19-914a10b4ad63-config-data-generated\") pod \"openstack-galera-0\" (UID: \"466bdf84-87d2-46ac-8f19-914a10b4ad63\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:09:02 crc kubenswrapper[5120]: I0316 17:09:02.113561 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"openstack-galera-0\" (UID: \"466bdf84-87d2-46ac-8f19-914a10b4ad63\") device mount path \"/mnt/openstack/pv20\"" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:09:02 crc kubenswrapper[5120]: I0316 17:09:02.113581 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/466bdf84-87d2-46ac-8f19-914a10b4ad63-operator-scripts\") pod \"openstack-galera-0\" (UID: \"466bdf84-87d2-46ac-8f19-914a10b4ad63\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:09:02 crc kubenswrapper[5120]: I0316 17:09:02.113682 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:09:02 crc kubenswrapper[5120]: I0316 17:09:02.113725 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/466bdf84-87d2-46ac-8f19-914a10b4ad63-kolla-config\") pod \"openstack-galera-0\" (UID: \"466bdf84-87d2-46ac-8f19-914a10b4ad63\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:09:02 crc kubenswrapper[5120]: I0316 17:09:02.113734 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n5wk8\" (UniqueName: \"kubernetes.io/projected/466bdf84-87d2-46ac-8f19-914a10b4ad63-kube-api-access-n5wk8\") pod \"openstack-galera-0\" (UID: \"466bdf84-87d2-46ac-8f19-914a10b4ad63\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:09:02 crc kubenswrapper[5120]: I0316 17:09:02.114017 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/45defe5f-ca2f-4993-8430-d713ed1c9df0-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:02 crc kubenswrapper[5120]: I0316 17:09:02.115142 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/466bdf84-87d2-46ac-8f19-914a10b4ad63-operator-scripts\") pod \"openstack-galera-0\" (UID: \"466bdf84-87d2-46ac-8f19-914a10b4ad63\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:09:02 crc kubenswrapper[5120]: I0316 17:09:02.118430 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/466bdf84-87d2-46ac-8f19-914a10b4ad63-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"466bdf84-87d2-46ac-8f19-914a10b4ad63\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:09:02 crc kubenswrapper[5120]: I0316 17:09:02.128494 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/466bdf84-87d2-46ac-8f19-914a10b4ad63-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"466bdf84-87d2-46ac-8f19-914a10b4ad63\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:09:02 crc kubenswrapper[5120]: I0316 17:09:02.140683 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"openstack-galera-0\" (UID: \"466bdf84-87d2-46ac-8f19-914a10b4ad63\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:09:02 crc kubenswrapper[5120]: I0316 17:09:02.143180 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5wk8\" (UniqueName: \"kubernetes.io/projected/466bdf84-87d2-46ac-8f19-914a10b4ad63-kube-api-access-n5wk8\") pod \"openstack-galera-0\" (UID: \"466bdf84-87d2-46ac-8f19-914a10b4ad63\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:09:02 crc kubenswrapper[5120]: I0316 17:09:02.216159 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2pkpk\" (UniqueName: \"kubernetes.io/projected/f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee-kube-api-access-2pkpk\") pod \"cinder-api-0\" (UID: \"f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:09:02 crc kubenswrapper[5120]: I0316 17:09:02.216548 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee-config-data-custom\") pod \"cinder-api-0\" (UID: \"f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:09:02 crc kubenswrapper[5120]: I0316 17:09:02.216721 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee-logs\") pod \"cinder-api-0\" (UID: \"f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:09:02 crc kubenswrapper[5120]: I0316 17:09:02.216874 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee-etc-machine-id\") pod \"cinder-api-0\" (UID: \"f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:09:02 crc kubenswrapper[5120]: I0316 17:09:02.216973 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee-etc-machine-id\") pod \"cinder-api-0\" (UID: \"f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:09:02 crc kubenswrapper[5120]: I0316 17:09:02.217216 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee-scripts\") pod \"cinder-api-0\" (UID: \"f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:09:02 crc kubenswrapper[5120]: I0316 17:09:02.217333 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee-logs\") pod \"cinder-api-0\" (UID: \"f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:09:02 crc kubenswrapper[5120]: I0316 17:09:02.217455 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee-config-data\") pod \"cinder-api-0\" (UID: \"f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:09:02 crc kubenswrapper[5120]: I0316 17:09:02.217595 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:09:02 crc kubenswrapper[5120]: I0316 17:09:02.217863 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:09:02 crc kubenswrapper[5120]: I0316 17:09:02.217997 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee-public-tls-certs\") pod \"cinder-api-0\" (UID: \"f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:09:02 crc kubenswrapper[5120]: I0316 17:09:02.220806 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee-scripts\") pod \"cinder-api-0\" (UID: \"f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:09:02 crc kubenswrapper[5120]: I0316 17:09:02.221239 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee-config-data-custom\") pod \"cinder-api-0\" (UID: \"f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:09:02 crc kubenswrapper[5120]: I0316 17:09:02.223328 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:09:02 crc kubenswrapper[5120]: I0316 17:09:02.223361 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee-public-tls-certs\") pod \"cinder-api-0\" (UID: \"f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:09:02 crc kubenswrapper[5120]: I0316 17:09:02.223682 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee-config-data\") pod \"cinder-api-0\" (UID: \"f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:09:02 crc kubenswrapper[5120]: I0316 17:09:02.223714 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:09:02 crc kubenswrapper[5120]: I0316 17:09:02.233964 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pkpk\" (UniqueName: \"kubernetes.io/projected/f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee-kube-api-access-2pkpk\") pod \"cinder-api-0\" (UID: \"f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:09:02 crc kubenswrapper[5120]: I0316 17:09:02.265648 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:09:02 crc kubenswrapper[5120]: I0316 17:09:02.371972 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:09:02 crc kubenswrapper[5120]: I0316 17:09:02.652165 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"d8ee8115-84b1-4f8e-acce-1f745eb1a339","Type":"ContainerStarted","Data":"10357c1a70b5ebdb78b53a435ca7c70a89706af651ab0bd0a5996cf33de886d5"} Mar 16 17:09:02 crc kubenswrapper[5120]: I0316 17:09:02.657235 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"9a997459-37ba-46a9-9cb8-075f77fa009f","Type":"ContainerStarted","Data":"5113d15f8f41624447f1bdf582aecad1fb1c48fe4cd626381d844607c1670c0e"} Mar 16 17:09:02 crc kubenswrapper[5120]: I0316 17:09:02.658634 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 17:09:02 crc kubenswrapper[5120]: I0316 17:09:02.681349 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3f98651e-6cef-4b31-8aac-46d152305e88" path="/var/lib/kubelet/pods/3f98651e-6cef-4b31-8aac-46d152305e88/volumes" Mar 16 17:09:02 crc kubenswrapper[5120]: I0316 17:09:02.681892 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="45defe5f-ca2f-4993-8430-d713ed1c9df0" path="/var/lib/kubelet/pods/45defe5f-ca2f-4993-8430-d713ed1c9df0/volumes" Mar 16 17:09:02 crc kubenswrapper[5120]: I0316 17:09:02.682448 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ab5d1889-4b15-4b9d-92fb-838a10dc858f" path="/var/lib/kubelet/pods/ab5d1889-4b15-4b9d-92fb-838a10dc858f/volumes" Mar 16 17:09:02 crc kubenswrapper[5120]: I0316 17:09:02.731356 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 17:09:02 crc kubenswrapper[5120]: W0316 17:09:02.734829 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod466bdf84_87d2_46ac_8f19_914a10b4ad63.slice/crio-79be26452cbbeb3d3287b432d1051e82e5e233d75e4245ec3037d170e07d3a90 WatchSource:0}: Error finding container 79be26452cbbeb3d3287b432d1051e82e5e233d75e4245ec3037d170e07d3a90: Status 404 returned error can't find the container with id 79be26452cbbeb3d3287b432d1051e82e5e233d75e4245ec3037d170e07d3a90 Mar 16 17:09:02 crc kubenswrapper[5120]: I0316 17:09:02.863873 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 17:09:03 crc kubenswrapper[5120]: I0316 17:09:03.027995 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="f39a0edc-bfc5-400a-ad5e-4c83f2065778" containerName="nova-metadata-log" probeResult="failure" output="Get \"https://10.217.1.244:8775/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Mar 16 17:09:03 crc kubenswrapper[5120]: I0316 17:09:03.041037 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="f39a0edc-bfc5-400a-ad5e-4c83f2065778" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"https://10.217.1.244:8775/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Mar 16 17:09:03 crc kubenswrapper[5120]: I0316 17:09:03.678668 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"d8ee8115-84b1-4f8e-acce-1f745eb1a339","Type":"ContainerStarted","Data":"9458c656f50a693b70d60833863a585dcaf9872029d5488df9e9ea78c96c35fe"} Mar 16 17:09:03 crc kubenswrapper[5120]: I0316 17:09:03.682823 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"466bdf84-87d2-46ac-8f19-914a10b4ad63","Type":"ContainerStarted","Data":"73773fc9b12d84b9a31c8dd6bdf7fab0c068e2a986b8cd569bb78748415e8adc"} Mar 16 17:09:03 crc kubenswrapper[5120]: I0316 17:09:03.682881 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"466bdf84-87d2-46ac-8f19-914a10b4ad63","Type":"ContainerStarted","Data":"79be26452cbbeb3d3287b432d1051e82e5e233d75e4245ec3037d170e07d3a90"} Mar 16 17:09:03 crc kubenswrapper[5120]: I0316 17:09:03.685011 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee","Type":"ContainerStarted","Data":"d62c1b34b409b862479ce97ceab32e16b55f5d2b09e9a3eda65f971385fa4b73"} Mar 16 17:09:03 crc kubenswrapper[5120]: I0316 17:09:03.685292 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee","Type":"ContainerStarted","Data":"9e1f064a72d3e67659ab7a5a44caecdb144ee6fe67e5bdcee10a17b755660f81"} Mar 16 17:09:04 crc kubenswrapper[5120]: I0316 17:09:04.696552 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee","Type":"ContainerStarted","Data":"32ee293ec5c5b79f5752c783b21343e79effbfa28a13f724be9cd5fff90f077f"} Mar 16 17:09:04 crc kubenswrapper[5120]: I0316 17:09:04.696898 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:09:04 crc kubenswrapper[5120]: I0316 17:09:04.698777 5120 generic.go:358] "Generic (PLEG): container finished" podID="9a997459-37ba-46a9-9cb8-075f77fa009f" containerID="5113d15f8f41624447f1bdf582aecad1fb1c48fe4cd626381d844607c1670c0e" exitCode=1 Mar 16 17:09:04 crc kubenswrapper[5120]: I0316 17:09:04.698879 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"9a997459-37ba-46a9-9cb8-075f77fa009f","Type":"ContainerDied","Data":"5113d15f8f41624447f1bdf582aecad1fb1c48fe4cd626381d844607c1670c0e"} Mar 16 17:09:04 crc kubenswrapper[5120]: I0316 17:09:04.698913 5120 scope.go:117] "RemoveContainer" containerID="42045ce1645b68cad8b1bbbfc95aca5ef9dc16d881fd98903c7824b31f5fd0cf" Mar 16 17:09:04 crc kubenswrapper[5120]: I0316 17:09:04.699206 5120 scope.go:117] "RemoveContainer" containerID="5113d15f8f41624447f1bdf582aecad1fb1c48fe4cd626381d844607c1670c0e" Mar 16 17:09:04 crc kubenswrapper[5120]: E0316 17:09:04.699405 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nova-cell0-conductor-conductor\" with CrashLoopBackOff: \"back-off 20s restarting failed container=nova-cell0-conductor-conductor pod=nova-cell0-conductor-0_openstack-kuttl-tests(9a997459-37ba-46a9-9cb8-075f77fa009f)\"" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="9a997459-37ba-46a9-9cb8-075f77fa009f" Mar 16 17:09:04 crc kubenswrapper[5120]: I0316 17:09:04.728981 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-api-0" podStartSLOduration=3.728960766 podStartE2EDuration="3.728960766s" podCreationTimestamp="2026-03-16 17:09:01 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:09:04.720995675 +0000 UTC m=+5846.874927352" watchObservedRunningTime="2026-03-16 17:09:04.728960766 +0000 UTC m=+5846.882892423" Mar 16 17:09:05 crc kubenswrapper[5120]: I0316 17:09:05.571923 5120 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 17:09:05 crc kubenswrapper[5120]: I0316 17:09:05.714417 5120 generic.go:358] "Generic (PLEG): container finished" podID="466bdf84-87d2-46ac-8f19-914a10b4ad63" containerID="73773fc9b12d84b9a31c8dd6bdf7fab0c068e2a986b8cd569bb78748415e8adc" exitCode=0 Mar 16 17:09:05 crc kubenswrapper[5120]: I0316 17:09:05.714736 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"466bdf84-87d2-46ac-8f19-914a10b4ad63","Type":"ContainerDied","Data":"73773fc9b12d84b9a31c8dd6bdf7fab0c068e2a986b8cd569bb78748415e8adc"} Mar 16 17:09:05 crc kubenswrapper[5120]: I0316 17:09:05.725931 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"d8ee8115-84b1-4f8e-acce-1f745eb1a339","Type":"ContainerStarted","Data":"4cc2b40ad4b0514c539231a19752ecb7a9242130424729f6b8932f54a31234d1"} Mar 16 17:09:05 crc kubenswrapper[5120]: I0316 17:09:05.726895 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:09:05 crc kubenswrapper[5120]: I0316 17:09:05.730039 5120 scope.go:117] "RemoveContainer" containerID="5113d15f8f41624447f1bdf582aecad1fb1c48fe4cd626381d844607c1670c0e" Mar 16 17:09:05 crc kubenswrapper[5120]: E0316 17:09:05.730410 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nova-cell0-conductor-conductor\" with CrashLoopBackOff: \"back-off 20s restarting failed container=nova-cell0-conductor-conductor pod=nova-cell0-conductor-0_openstack-kuttl-tests(9a997459-37ba-46a9-9cb8-075f77fa009f)\"" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="9a997459-37ba-46a9-9cb8-075f77fa009f" Mar 16 17:09:05 crc kubenswrapper[5120]: I0316 17:09:05.966994 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="6e4e8c65-5607-4f79-ba90-208ca1a32521" containerName="cinder-scheduler" probeResult="failure" output="Get \"http://10.217.1.249:8080/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 17:09:05 crc kubenswrapper[5120]: I0316 17:09:05.985925 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=17.707124572 podStartE2EDuration="22.985899249s" podCreationTimestamp="2026-03-16 17:08:43 +0000 UTC" firstStartedPulling="2026-03-16 17:09:00.003609577 +0000 UTC m=+5842.157541234" lastFinishedPulling="2026-03-16 17:09:05.282384244 +0000 UTC m=+5847.436315911" observedRunningTime="2026-03-16 17:09:05.828520571 +0000 UTC m=+5847.982452238" watchObservedRunningTime="2026-03-16 17:09:05.985899249 +0000 UTC m=+5848.139830906" Mar 16 17:09:05 crc kubenswrapper[5120]: I0316 17:09:05.994894 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:09:06 crc kubenswrapper[5120]: I0316 17:09:06.633176 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:09:06 crc kubenswrapper[5120]: I0316 17:09:06.745312 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"466bdf84-87d2-46ac-8f19-914a10b4ad63","Type":"ContainerStarted","Data":"4b969fe349f39efb2301e4ebf45ed1f29a97d12b0b7e6304273d199bd2f72fc7"} Mar 16 17:09:06 crc kubenswrapper[5120]: I0316 17:09:06.771134 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstack-galera-0" podStartSLOduration=5.771117611 podStartE2EDuration="5.771117611s" podCreationTimestamp="2026-03-16 17:09:01 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:09:06.770185744 +0000 UTC m=+5848.924117401" watchObservedRunningTime="2026-03-16 17:09:06.771117611 +0000 UTC m=+5848.925049268" Mar 16 17:09:06 crc kubenswrapper[5120]: E0316 17:09:06.783957 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-neutron-public-svc: secret "cert-neutron-public-svc" not found Mar 16 17:09:06 crc kubenswrapper[5120]: E0316 17:09:06.784183 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-neutron-ovndbs: secret "cert-neutron-ovndbs" not found Mar 16 17:09:06 crc kubenswrapper[5120]: E0316 17:09:06.784314 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aadf64b4-9c41-4b13-be3a-4bb9172d06dd-public-tls-certs podName:aadf64b4-9c41-4b13-be3a-4bb9172d06dd nodeName:}" failed. No retries permitted until 2026-03-16 17:09:07.284285704 +0000 UTC m=+5849.438217371 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/aadf64b4-9c41-4b13-be3a-4bb9172d06dd-public-tls-certs") pod "neutron-5bb4df7ffd-xw448" (UID: "aadf64b4-9c41-4b13-be3a-4bb9172d06dd") : secret "cert-neutron-public-svc" not found Mar 16 17:09:06 crc kubenswrapper[5120]: E0316 17:09:06.784464 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aadf64b4-9c41-4b13-be3a-4bb9172d06dd-ovndb-tls-certs podName:aadf64b4-9c41-4b13-be3a-4bb9172d06dd nodeName:}" failed. No retries permitted until 2026-03-16 17:09:07.284438938 +0000 UTC m=+5849.438370585 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ovndb-tls-certs" (UniqueName: "kubernetes.io/secret/aadf64b4-9c41-4b13-be3a-4bb9172d06dd-ovndb-tls-certs") pod "neutron-5bb4df7ffd-xw448" (UID: "aadf64b4-9c41-4b13-be3a-4bb9172d06dd") : secret "cert-neutron-ovndbs" not found Mar 16 17:09:06 crc kubenswrapper[5120]: E0316 17:09:06.784905 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-neutron-internal-svc: secret "cert-neutron-internal-svc" not found Mar 16 17:09:06 crc kubenswrapper[5120]: E0316 17:09:06.785004 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aadf64b4-9c41-4b13-be3a-4bb9172d06dd-internal-tls-certs podName:aadf64b4-9c41-4b13-be3a-4bb9172d06dd nodeName:}" failed. No retries permitted until 2026-03-16 17:09:07.284975682 +0000 UTC m=+5849.438907339 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/aadf64b4-9c41-4b13-be3a-4bb9172d06dd-internal-tls-certs") pod "neutron-5bb4df7ffd-xw448" (UID: "aadf64b4-9c41-4b13-be3a-4bb9172d06dd") : secret "cert-neutron-internal-svc" not found Mar 16 17:09:07 crc kubenswrapper[5120]: E0316 17:09:07.300141 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-neutron-public-svc: secret "cert-neutron-public-svc" not found Mar 16 17:09:07 crc kubenswrapper[5120]: E0316 17:09:07.300552 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aadf64b4-9c41-4b13-be3a-4bb9172d06dd-public-tls-certs podName:aadf64b4-9c41-4b13-be3a-4bb9172d06dd nodeName:}" failed. No retries permitted until 2026-03-16 17:09:08.300531516 +0000 UTC m=+5850.454463173 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/aadf64b4-9c41-4b13-be3a-4bb9172d06dd-public-tls-certs") pod "neutron-5bb4df7ffd-xw448" (UID: "aadf64b4-9c41-4b13-be3a-4bb9172d06dd") : secret "cert-neutron-public-svc" not found Mar 16 17:09:07 crc kubenswrapper[5120]: E0316 17:09:07.301848 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-neutron-internal-svc: secret "cert-neutron-internal-svc" not found Mar 16 17:09:07 crc kubenswrapper[5120]: E0316 17:09:07.301907 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aadf64b4-9c41-4b13-be3a-4bb9172d06dd-internal-tls-certs podName:aadf64b4-9c41-4b13-be3a-4bb9172d06dd nodeName:}" failed. No retries permitted until 2026-03-16 17:09:08.301892564 +0000 UTC m=+5850.455824221 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/aadf64b4-9c41-4b13-be3a-4bb9172d06dd-internal-tls-certs") pod "neutron-5bb4df7ffd-xw448" (UID: "aadf64b4-9c41-4b13-be3a-4bb9172d06dd") : secret "cert-neutron-internal-svc" not found Mar 16 17:09:07 crc kubenswrapper[5120]: I0316 17:09:07.490567 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Mar 16 17:09:07 crc kubenswrapper[5120]: I0316 17:09:07.498989 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:09:07 crc kubenswrapper[5120]: I0316 17:09:07.499050 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:09:07 crc kubenswrapper[5120]: I0316 17:09:07.613721 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/1a6911b8-1804-40ce-88c2-3da863703774-cache\") pod \"1a6911b8-1804-40ce-88c2-3da863703774\" (UID: \"1a6911b8-1804-40ce-88c2-3da863703774\") " Mar 16 17:09:07 crc kubenswrapper[5120]: I0316 17:09:07.614128 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/1a6911b8-1804-40ce-88c2-3da863703774-etc-swift\") pod \"1a6911b8-1804-40ce-88c2-3da863703774\" (UID: \"1a6911b8-1804-40ce-88c2-3da863703774\") " Mar 16 17:09:07 crc kubenswrapper[5120]: I0316 17:09:07.614190 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1a6911b8-1804-40ce-88c2-3da863703774-combined-ca-bundle\") pod \"1a6911b8-1804-40ce-88c2-3da863703774\" (UID: \"1a6911b8-1804-40ce-88c2-3da863703774\") " Mar 16 17:09:07 crc kubenswrapper[5120]: I0316 17:09:07.614704 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a6911b8-1804-40ce-88c2-3da863703774-cache" (OuterVolumeSpecName: "cache") pod "1a6911b8-1804-40ce-88c2-3da863703774" (UID: "1a6911b8-1804-40ce-88c2-3da863703774"). InnerVolumeSpecName "cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:09:07 crc kubenswrapper[5120]: I0316 17:09:07.615472 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/1a6911b8-1804-40ce-88c2-3da863703774-lock\") pod \"1a6911b8-1804-40ce-88c2-3da863703774\" (UID: \"1a6911b8-1804-40ce-88c2-3da863703774\") " Mar 16 17:09:07 crc kubenswrapper[5120]: I0316 17:09:07.616537 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a6911b8-1804-40ce-88c2-3da863703774-lock" (OuterVolumeSpecName: "lock") pod "1a6911b8-1804-40ce-88c2-3da863703774" (UID: "1a6911b8-1804-40ce-88c2-3da863703774"). InnerVolumeSpecName "lock". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:09:07 crc kubenswrapper[5120]: I0316 17:09:07.620399 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2p9f7\" (UniqueName: \"kubernetes.io/projected/1a6911b8-1804-40ce-88c2-3da863703774-kube-api-access-2p9f7\") pod \"1a6911b8-1804-40ce-88c2-3da863703774\" (UID: \"1a6911b8-1804-40ce-88c2-3da863703774\") " Mar 16 17:09:07 crc kubenswrapper[5120]: I0316 17:09:07.620593 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"swift\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"1a6911b8-1804-40ce-88c2-3da863703774\" (UID: \"1a6911b8-1804-40ce-88c2-3da863703774\") " Mar 16 17:09:07 crc kubenswrapper[5120]: I0316 17:09:07.630941 5120 reconciler_common.go:299] "Volume detached for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/1a6911b8-1804-40ce-88c2-3da863703774-lock\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:07 crc kubenswrapper[5120]: I0316 17:09:07.631000 5120 reconciler_common.go:299] "Volume detached for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/1a6911b8-1804-40ce-88c2-3da863703774-cache\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:07 crc kubenswrapper[5120]: I0316 17:09:07.640947 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a6911b8-1804-40ce-88c2-3da863703774-kube-api-access-2p9f7" (OuterVolumeSpecName: "kube-api-access-2p9f7") pod "1a6911b8-1804-40ce-88c2-3da863703774" (UID: "1a6911b8-1804-40ce-88c2-3da863703774"). InnerVolumeSpecName "kube-api-access-2p9f7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:09:07 crc kubenswrapper[5120]: I0316 17:09:07.641355 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a6911b8-1804-40ce-88c2-3da863703774-etc-swift" (OuterVolumeSpecName: "etc-swift") pod "1a6911b8-1804-40ce-88c2-3da863703774" (UID: "1a6911b8-1804-40ce-88c2-3da863703774"). InnerVolumeSpecName "etc-swift". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:09:07 crc kubenswrapper[5120]: I0316 17:09:07.653884 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage03-crc" (OuterVolumeSpecName: "swift") pod "1a6911b8-1804-40ce-88c2-3da863703774" (UID: "1a6911b8-1804-40ce-88c2-3da863703774"). InnerVolumeSpecName "local-storage03-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 17:09:07 crc kubenswrapper[5120]: I0316 17:09:07.739600 5120 reconciler_common.go:299] "Volume detached for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/1a6911b8-1804-40ce-88c2-3da863703774-etc-swift\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:07 crc kubenswrapper[5120]: I0316 17:09:07.739927 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2p9f7\" (UniqueName: \"kubernetes.io/projected/1a6911b8-1804-40ce-88c2-3da863703774-kube-api-access-2p9f7\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:07 crc kubenswrapper[5120]: I0316 17:09:07.741525 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") on node \"crc\" " Mar 16 17:09:07 crc kubenswrapper[5120]: I0316 17:09:07.771899 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage03-crc" (UniqueName: "kubernetes.io/local-volume/local-storage03-crc") on node "crc" Mar 16 17:09:07 crc kubenswrapper[5120]: I0316 17:09:07.792732 5120 generic.go:358] "Generic (PLEG): container finished" podID="1a6911b8-1804-40ce-88c2-3da863703774" containerID="fc3653aadde94d85e422b461f8f63dc7a32af850418ac80e3af785d73f21e8ee" exitCode=137 Mar 16 17:09:07 crc kubenswrapper[5120]: I0316 17:09:07.793005 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Mar 16 17:09:07 crc kubenswrapper[5120]: I0316 17:09:07.793008 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"1a6911b8-1804-40ce-88c2-3da863703774","Type":"ContainerDied","Data":"fc3653aadde94d85e422b461f8f63dc7a32af850418ac80e3af785d73f21e8ee"} Mar 16 17:09:07 crc kubenswrapper[5120]: I0316 17:09:07.793156 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"1a6911b8-1804-40ce-88c2-3da863703774","Type":"ContainerDied","Data":"5010bb1a2a8ed7c5a793b240e61e7a99165cba8d6927537c45ffe778c5bff222"} Mar 16 17:09:07 crc kubenswrapper[5120]: I0316 17:09:07.793186 5120 scope.go:117] "RemoveContainer" containerID="fc3653aadde94d85e422b461f8f63dc7a32af850418ac80e3af785d73f21e8ee" Mar 16 17:09:07 crc kubenswrapper[5120]: I0316 17:09:07.794627 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="d8ee8115-84b1-4f8e-acce-1f745eb1a339" containerName="ceilometer-central-agent" containerID="cri-o://8c17be947fc1c3fb5e147a045257806a695cefab621e507228a1226e917445fa" gracePeriod=30 Mar 16 17:09:07 crc kubenswrapper[5120]: I0316 17:09:07.794746 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="d8ee8115-84b1-4f8e-acce-1f745eb1a339" containerName="proxy-httpd" containerID="cri-o://4cc2b40ad4b0514c539231a19752ecb7a9242130424729f6b8932f54a31234d1" gracePeriod=30 Mar 16 17:09:07 crc kubenswrapper[5120]: I0316 17:09:07.794892 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="d8ee8115-84b1-4f8e-acce-1f745eb1a339" containerName="sg-core" containerID="cri-o://9458c656f50a693b70d60833863a585dcaf9872029d5488df9e9ea78c96c35fe" gracePeriod=30 Mar 16 17:09:07 crc kubenswrapper[5120]: I0316 17:09:07.795229 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="d8ee8115-84b1-4f8e-acce-1f745eb1a339" containerName="ceilometer-notification-agent" containerID="cri-o://10357c1a70b5ebdb78b53a435ca7c70a89706af651ab0bd0a5996cf33de886d5" gracePeriod=30 Mar 16 17:09:07 crc kubenswrapper[5120]: I0316 17:09:07.834981 5120 scope.go:117] "RemoveContainer" containerID="5098fec9a781166eb146869f3b45433c89e4149e842057b0aaddbb9c681c7c3b" Mar 16 17:09:07 crc kubenswrapper[5120]: I0316 17:09:07.845062 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:07 crc kubenswrapper[5120]: I0316 17:09:07.866118 5120 scope.go:117] "RemoveContainer" containerID="26147a9fb03ce38ea3372a952b4e58d7ed008843847066114964a28ec1957d0b" Mar 16 17:09:07 crc kubenswrapper[5120]: I0316 17:09:07.891811 5120 scope.go:117] "RemoveContainer" containerID="fffd62bf82332525123277c7167d5d539fb0e406dd1cd781091c41260675fbfa" Mar 16 17:09:07 crc kubenswrapper[5120]: I0316 17:09:07.944274 5120 scope.go:117] "RemoveContainer" containerID="081c334e4b23b1cf2a7028106205f291abb6558ec66919bfb6c0c3657a7caf3c" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.148436 5120 scope.go:117] "RemoveContainer" containerID="aef5ac3f9a8cd4ef3a09154c9b4ca0fb6ac5e3c8fdc5d37721d7af270d940c36" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.153745 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1a6911b8-1804-40ce-88c2-3da863703774-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "1a6911b8-1804-40ce-88c2-3da863703774" (UID: "1a6911b8-1804-40ce-88c2-3da863703774"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.167014 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1a6911b8-1804-40ce-88c2-3da863703774-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.179055 5120 scope.go:117] "RemoveContainer" containerID="cb569b064bfb2f3dd5071e1c85d0dfddab098ebc74a76b4f9cbbdd2dd604b2b2" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.204663 5120 scope.go:117] "RemoveContainer" containerID="fcaa41db7f6b2b8655584a426b862d77c42d55c54fa1dc017b5c98bcb6369875" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.236688 5120 scope.go:117] "RemoveContainer" containerID="0602cdf7cd4de99a43963da16f1e923e6041dd0ccfb8ec804e378960e6ee602d" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.305532 5120 scope.go:117] "RemoveContainer" containerID="86f9da2a34f9df6e767f05f80a230f7f4244350d372505d0d4572c4ede7233a8" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.336314 5120 scope.go:117] "RemoveContainer" containerID="b17c5c3627da4f5e5b7fc0294a06455b8592076064fc51ef743ed73361d54cca" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.365724 5120 scope.go:117] "RemoveContainer" containerID="74b6ded1ca90df3a7680b3667eb45a59ed7c4161508c89148fac28872165aad5" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.397510 5120 scope.go:117] "RemoveContainer" containerID="80c15f9c6214656853deb3afd716e5558ff0381737507b767a4f1a07d636dc25" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.428065 5120 scope.go:117] "RemoveContainer" containerID="6cac886d9d64581e2f03ae4d053a2a05790fb1dc3dac0b14b081cf3e631c709c" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.471110 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.487891 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.491480 5120 scope.go:117] "RemoveContainer" containerID="8e3d0f9ddaf5e60bb60873b508b6a595547e102a296dfd3de5c2efae3f915946" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.497078 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.498241 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a6911b8-1804-40ce-88c2-3da863703774" containerName="account-reaper" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.498262 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a6911b8-1804-40ce-88c2-3da863703774" containerName="account-reaper" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.498281 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a6911b8-1804-40ce-88c2-3da863703774" containerName="container-replicator" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.498288 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a6911b8-1804-40ce-88c2-3da863703774" containerName="container-replicator" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.498297 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a6911b8-1804-40ce-88c2-3da863703774" containerName="rsync" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.498302 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a6911b8-1804-40ce-88c2-3da863703774" containerName="rsync" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.498310 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a6911b8-1804-40ce-88c2-3da863703774" containerName="container-auditor" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.498315 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a6911b8-1804-40ce-88c2-3da863703774" containerName="container-auditor" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.498324 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a6911b8-1804-40ce-88c2-3da863703774" containerName="container-server" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.498330 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a6911b8-1804-40ce-88c2-3da863703774" containerName="container-server" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.498336 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a6911b8-1804-40ce-88c2-3da863703774" containerName="container-updater" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.498341 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a6911b8-1804-40ce-88c2-3da863703774" containerName="container-updater" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.498360 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a6911b8-1804-40ce-88c2-3da863703774" containerName="swift-recon-cron" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.498365 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a6911b8-1804-40ce-88c2-3da863703774" containerName="swift-recon-cron" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.498374 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a6911b8-1804-40ce-88c2-3da863703774" containerName="account-server" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.498380 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a6911b8-1804-40ce-88c2-3da863703774" containerName="account-server" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.498390 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a6911b8-1804-40ce-88c2-3da863703774" containerName="account-auditor" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.498397 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a6911b8-1804-40ce-88c2-3da863703774" containerName="account-auditor" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.498407 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a6911b8-1804-40ce-88c2-3da863703774" containerName="object-server" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.498413 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a6911b8-1804-40ce-88c2-3da863703774" containerName="object-server" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.498420 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a6911b8-1804-40ce-88c2-3da863703774" containerName="object-expirer" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.498425 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a6911b8-1804-40ce-88c2-3da863703774" containerName="object-expirer" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.498445 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a6911b8-1804-40ce-88c2-3da863703774" containerName="object-replicator" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.498450 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a6911b8-1804-40ce-88c2-3da863703774" containerName="object-replicator" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.498459 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a6911b8-1804-40ce-88c2-3da863703774" containerName="object-auditor" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.498464 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a6911b8-1804-40ce-88c2-3da863703774" containerName="object-auditor" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.498484 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a6911b8-1804-40ce-88c2-3da863703774" containerName="account-replicator" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.498489 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a6911b8-1804-40ce-88c2-3da863703774" containerName="account-replicator" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.498509 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a6911b8-1804-40ce-88c2-3da863703774" containerName="object-updater" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.498514 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a6911b8-1804-40ce-88c2-3da863703774" containerName="object-updater" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.498670 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1a6911b8-1804-40ce-88c2-3da863703774" containerName="account-replicator" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.498683 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1a6911b8-1804-40ce-88c2-3da863703774" containerName="account-server" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.498693 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1a6911b8-1804-40ce-88c2-3da863703774" containerName="object-replicator" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.498700 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1a6911b8-1804-40ce-88c2-3da863703774" containerName="object-expirer" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.498707 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1a6911b8-1804-40ce-88c2-3da863703774" containerName="container-auditor" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.498717 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1a6911b8-1804-40ce-88c2-3da863703774" containerName="account-reaper" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.498725 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1a6911b8-1804-40ce-88c2-3da863703774" containerName="object-server" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.498734 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1a6911b8-1804-40ce-88c2-3da863703774" containerName="rsync" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.498741 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1a6911b8-1804-40ce-88c2-3da863703774" containerName="object-auditor" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.498751 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1a6911b8-1804-40ce-88c2-3da863703774" containerName="swift-recon-cron" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.498778 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1a6911b8-1804-40ce-88c2-3da863703774" containerName="container-replicator" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.498787 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1a6911b8-1804-40ce-88c2-3da863703774" containerName="account-auditor" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.498794 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1a6911b8-1804-40ce-88c2-3da863703774" containerName="object-updater" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.498806 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1a6911b8-1804-40ce-88c2-3da863703774" containerName="container-updater" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.498818 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1a6911b8-1804-40ce-88c2-3da863703774" containerName="container-server" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.514967 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.518264 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"swift-storage-config-data\"" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.548581 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.551401 5120 scope.go:117] "RemoveContainer" containerID="fc3653aadde94d85e422b461f8f63dc7a32af850418ac80e3af785d73f21e8ee" Mar 16 17:09:08 crc kubenswrapper[5120]: E0316 17:09:08.554238 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc3653aadde94d85e422b461f8f63dc7a32af850418ac80e3af785d73f21e8ee\": container with ID starting with fc3653aadde94d85e422b461f8f63dc7a32af850418ac80e3af785d73f21e8ee not found: ID does not exist" containerID="fc3653aadde94d85e422b461f8f63dc7a32af850418ac80e3af785d73f21e8ee" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.554416 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc3653aadde94d85e422b461f8f63dc7a32af850418ac80e3af785d73f21e8ee"} err="failed to get container status \"fc3653aadde94d85e422b461f8f63dc7a32af850418ac80e3af785d73f21e8ee\": rpc error: code = NotFound desc = could not find container \"fc3653aadde94d85e422b461f8f63dc7a32af850418ac80e3af785d73f21e8ee\": container with ID starting with fc3653aadde94d85e422b461f8f63dc7a32af850418ac80e3af785d73f21e8ee not found: ID does not exist" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.554533 5120 scope.go:117] "RemoveContainer" containerID="5098fec9a781166eb146869f3b45433c89e4149e842057b0aaddbb9c681c7c3b" Mar 16 17:09:08 crc kubenswrapper[5120]: E0316 17:09:08.566110 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5098fec9a781166eb146869f3b45433c89e4149e842057b0aaddbb9c681c7c3b\": container with ID starting with 5098fec9a781166eb146869f3b45433c89e4149e842057b0aaddbb9c681c7c3b not found: ID does not exist" containerID="5098fec9a781166eb146869f3b45433c89e4149e842057b0aaddbb9c681c7c3b" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.566157 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5098fec9a781166eb146869f3b45433c89e4149e842057b0aaddbb9c681c7c3b"} err="failed to get container status \"5098fec9a781166eb146869f3b45433c89e4149e842057b0aaddbb9c681c7c3b\": rpc error: code = NotFound desc = could not find container \"5098fec9a781166eb146869f3b45433c89e4149e842057b0aaddbb9c681c7c3b\": container with ID starting with 5098fec9a781166eb146869f3b45433c89e4149e842057b0aaddbb9c681c7c3b not found: ID does not exist" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.566185 5120 scope.go:117] "RemoveContainer" containerID="26147a9fb03ce38ea3372a952b4e58d7ed008843847066114964a28ec1957d0b" Mar 16 17:09:08 crc kubenswrapper[5120]: E0316 17:09:08.566846 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"26147a9fb03ce38ea3372a952b4e58d7ed008843847066114964a28ec1957d0b\": container with ID starting with 26147a9fb03ce38ea3372a952b4e58d7ed008843847066114964a28ec1957d0b not found: ID does not exist" containerID="26147a9fb03ce38ea3372a952b4e58d7ed008843847066114964a28ec1957d0b" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.566871 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26147a9fb03ce38ea3372a952b4e58d7ed008843847066114964a28ec1957d0b"} err="failed to get container status \"26147a9fb03ce38ea3372a952b4e58d7ed008843847066114964a28ec1957d0b\": rpc error: code = NotFound desc = could not find container \"26147a9fb03ce38ea3372a952b4e58d7ed008843847066114964a28ec1957d0b\": container with ID starting with 26147a9fb03ce38ea3372a952b4e58d7ed008843847066114964a28ec1957d0b not found: ID does not exist" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.566888 5120 scope.go:117] "RemoveContainer" containerID="fffd62bf82332525123277c7167d5d539fb0e406dd1cd781091c41260675fbfa" Mar 16 17:09:08 crc kubenswrapper[5120]: E0316 17:09:08.568645 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fffd62bf82332525123277c7167d5d539fb0e406dd1cd781091c41260675fbfa\": container with ID starting with fffd62bf82332525123277c7167d5d539fb0e406dd1cd781091c41260675fbfa not found: ID does not exist" containerID="fffd62bf82332525123277c7167d5d539fb0e406dd1cd781091c41260675fbfa" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.568778 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fffd62bf82332525123277c7167d5d539fb0e406dd1cd781091c41260675fbfa"} err="failed to get container status \"fffd62bf82332525123277c7167d5d539fb0e406dd1cd781091c41260675fbfa\": rpc error: code = NotFound desc = could not find container \"fffd62bf82332525123277c7167d5d539fb0e406dd1cd781091c41260675fbfa\": container with ID starting with fffd62bf82332525123277c7167d5d539fb0e406dd1cd781091c41260675fbfa not found: ID does not exist" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.568808 5120 scope.go:117] "RemoveContainer" containerID="081c334e4b23b1cf2a7028106205f291abb6558ec66919bfb6c0c3657a7caf3c" Mar 16 17:09:08 crc kubenswrapper[5120]: E0316 17:09:08.569359 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"081c334e4b23b1cf2a7028106205f291abb6558ec66919bfb6c0c3657a7caf3c\": container with ID starting with 081c334e4b23b1cf2a7028106205f291abb6558ec66919bfb6c0c3657a7caf3c not found: ID does not exist" containerID="081c334e4b23b1cf2a7028106205f291abb6558ec66919bfb6c0c3657a7caf3c" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.569386 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"081c334e4b23b1cf2a7028106205f291abb6558ec66919bfb6c0c3657a7caf3c"} err="failed to get container status \"081c334e4b23b1cf2a7028106205f291abb6558ec66919bfb6c0c3657a7caf3c\": rpc error: code = NotFound desc = could not find container \"081c334e4b23b1cf2a7028106205f291abb6558ec66919bfb6c0c3657a7caf3c\": container with ID starting with 081c334e4b23b1cf2a7028106205f291abb6558ec66919bfb6c0c3657a7caf3c not found: ID does not exist" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.569401 5120 scope.go:117] "RemoveContainer" containerID="aef5ac3f9a8cd4ef3a09154c9b4ca0fb6ac5e3c8fdc5d37721d7af270d940c36" Mar 16 17:09:08 crc kubenswrapper[5120]: E0316 17:09:08.569693 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aef5ac3f9a8cd4ef3a09154c9b4ca0fb6ac5e3c8fdc5d37721d7af270d940c36\": container with ID starting with aef5ac3f9a8cd4ef3a09154c9b4ca0fb6ac5e3c8fdc5d37721d7af270d940c36 not found: ID does not exist" containerID="aef5ac3f9a8cd4ef3a09154c9b4ca0fb6ac5e3c8fdc5d37721d7af270d940c36" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.569955 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aef5ac3f9a8cd4ef3a09154c9b4ca0fb6ac5e3c8fdc5d37721d7af270d940c36"} err="failed to get container status \"aef5ac3f9a8cd4ef3a09154c9b4ca0fb6ac5e3c8fdc5d37721d7af270d940c36\": rpc error: code = NotFound desc = could not find container \"aef5ac3f9a8cd4ef3a09154c9b4ca0fb6ac5e3c8fdc5d37721d7af270d940c36\": container with ID starting with aef5ac3f9a8cd4ef3a09154c9b4ca0fb6ac5e3c8fdc5d37721d7af270d940c36 not found: ID does not exist" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.570062 5120 scope.go:117] "RemoveContainer" containerID="cb569b064bfb2f3dd5071e1c85d0dfddab098ebc74a76b4f9cbbdd2dd604b2b2" Mar 16 17:09:08 crc kubenswrapper[5120]: E0316 17:09:08.570506 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cb569b064bfb2f3dd5071e1c85d0dfddab098ebc74a76b4f9cbbdd2dd604b2b2\": container with ID starting with cb569b064bfb2f3dd5071e1c85d0dfddab098ebc74a76b4f9cbbdd2dd604b2b2 not found: ID does not exist" containerID="cb569b064bfb2f3dd5071e1c85d0dfddab098ebc74a76b4f9cbbdd2dd604b2b2" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.570538 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb569b064bfb2f3dd5071e1c85d0dfddab098ebc74a76b4f9cbbdd2dd604b2b2"} err="failed to get container status \"cb569b064bfb2f3dd5071e1c85d0dfddab098ebc74a76b4f9cbbdd2dd604b2b2\": rpc error: code = NotFound desc = could not find container \"cb569b064bfb2f3dd5071e1c85d0dfddab098ebc74a76b4f9cbbdd2dd604b2b2\": container with ID starting with cb569b064bfb2f3dd5071e1c85d0dfddab098ebc74a76b4f9cbbdd2dd604b2b2 not found: ID does not exist" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.570556 5120 scope.go:117] "RemoveContainer" containerID="fcaa41db7f6b2b8655584a426b862d77c42d55c54fa1dc017b5c98bcb6369875" Mar 16 17:09:08 crc kubenswrapper[5120]: E0316 17:09:08.575634 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fcaa41db7f6b2b8655584a426b862d77c42d55c54fa1dc017b5c98bcb6369875\": container with ID starting with fcaa41db7f6b2b8655584a426b862d77c42d55c54fa1dc017b5c98bcb6369875 not found: ID does not exist" containerID="fcaa41db7f6b2b8655584a426b862d77c42d55c54fa1dc017b5c98bcb6369875" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.575976 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fcaa41db7f6b2b8655584a426b862d77c42d55c54fa1dc017b5c98bcb6369875"} err="failed to get container status \"fcaa41db7f6b2b8655584a426b862d77c42d55c54fa1dc017b5c98bcb6369875\": rpc error: code = NotFound desc = could not find container \"fcaa41db7f6b2b8655584a426b862d77c42d55c54fa1dc017b5c98bcb6369875\": container with ID starting with fcaa41db7f6b2b8655584a426b862d77c42d55c54fa1dc017b5c98bcb6369875 not found: ID does not exist" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.576210 5120 scope.go:117] "RemoveContainer" containerID="0602cdf7cd4de99a43963da16f1e923e6041dd0ccfb8ec804e378960e6ee602d" Mar 16 17:09:08 crc kubenswrapper[5120]: E0316 17:09:08.576831 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0602cdf7cd4de99a43963da16f1e923e6041dd0ccfb8ec804e378960e6ee602d\": container with ID starting with 0602cdf7cd4de99a43963da16f1e923e6041dd0ccfb8ec804e378960e6ee602d not found: ID does not exist" containerID="0602cdf7cd4de99a43963da16f1e923e6041dd0ccfb8ec804e378960e6ee602d" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.577037 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0602cdf7cd4de99a43963da16f1e923e6041dd0ccfb8ec804e378960e6ee602d"} err="failed to get container status \"0602cdf7cd4de99a43963da16f1e923e6041dd0ccfb8ec804e378960e6ee602d\": rpc error: code = NotFound desc = could not find container \"0602cdf7cd4de99a43963da16f1e923e6041dd0ccfb8ec804e378960e6ee602d\": container with ID starting with 0602cdf7cd4de99a43963da16f1e923e6041dd0ccfb8ec804e378960e6ee602d not found: ID does not exist" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.577133 5120 scope.go:117] "RemoveContainer" containerID="86f9da2a34f9df6e767f05f80a230f7f4244350d372505d0d4572c4ede7233a8" Mar 16 17:09:08 crc kubenswrapper[5120]: E0316 17:09:08.577723 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"86f9da2a34f9df6e767f05f80a230f7f4244350d372505d0d4572c4ede7233a8\": container with ID starting with 86f9da2a34f9df6e767f05f80a230f7f4244350d372505d0d4572c4ede7233a8 not found: ID does not exist" containerID="86f9da2a34f9df6e767f05f80a230f7f4244350d372505d0d4572c4ede7233a8" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.577935 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86f9da2a34f9df6e767f05f80a230f7f4244350d372505d0d4572c4ede7233a8"} err="failed to get container status \"86f9da2a34f9df6e767f05f80a230f7f4244350d372505d0d4572c4ede7233a8\": rpc error: code = NotFound desc = could not find container \"86f9da2a34f9df6e767f05f80a230f7f4244350d372505d0d4572c4ede7233a8\": container with ID starting with 86f9da2a34f9df6e767f05f80a230f7f4244350d372505d0d4572c4ede7233a8 not found: ID does not exist" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.578164 5120 scope.go:117] "RemoveContainer" containerID="b17c5c3627da4f5e5b7fc0294a06455b8592076064fc51ef743ed73361d54cca" Mar 16 17:09:08 crc kubenswrapper[5120]: E0316 17:09:08.578910 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b17c5c3627da4f5e5b7fc0294a06455b8592076064fc51ef743ed73361d54cca\": container with ID starting with b17c5c3627da4f5e5b7fc0294a06455b8592076064fc51ef743ed73361d54cca not found: ID does not exist" containerID="b17c5c3627da4f5e5b7fc0294a06455b8592076064fc51ef743ed73361d54cca" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.578959 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b17c5c3627da4f5e5b7fc0294a06455b8592076064fc51ef743ed73361d54cca"} err="failed to get container status \"b17c5c3627da4f5e5b7fc0294a06455b8592076064fc51ef743ed73361d54cca\": rpc error: code = NotFound desc = could not find container \"b17c5c3627da4f5e5b7fc0294a06455b8592076064fc51ef743ed73361d54cca\": container with ID starting with b17c5c3627da4f5e5b7fc0294a06455b8592076064fc51ef743ed73361d54cca not found: ID does not exist" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.578989 5120 scope.go:117] "RemoveContainer" containerID="74b6ded1ca90df3a7680b3667eb45a59ed7c4161508c89148fac28872165aad5" Mar 16 17:09:08 crc kubenswrapper[5120]: E0316 17:09:08.582864 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"74b6ded1ca90df3a7680b3667eb45a59ed7c4161508c89148fac28872165aad5\": container with ID starting with 74b6ded1ca90df3a7680b3667eb45a59ed7c4161508c89148fac28872165aad5 not found: ID does not exist" containerID="74b6ded1ca90df3a7680b3667eb45a59ed7c4161508c89148fac28872165aad5" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.582901 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74b6ded1ca90df3a7680b3667eb45a59ed7c4161508c89148fac28872165aad5"} err="failed to get container status \"74b6ded1ca90df3a7680b3667eb45a59ed7c4161508c89148fac28872165aad5\": rpc error: code = NotFound desc = could not find container \"74b6ded1ca90df3a7680b3667eb45a59ed7c4161508c89148fac28872165aad5\": container with ID starting with 74b6ded1ca90df3a7680b3667eb45a59ed7c4161508c89148fac28872165aad5 not found: ID does not exist" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.582929 5120 scope.go:117] "RemoveContainer" containerID="80c15f9c6214656853deb3afd716e5558ff0381737507b767a4f1a07d636dc25" Mar 16 17:09:08 crc kubenswrapper[5120]: E0316 17:09:08.583241 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"80c15f9c6214656853deb3afd716e5558ff0381737507b767a4f1a07d636dc25\": container with ID starting with 80c15f9c6214656853deb3afd716e5558ff0381737507b767a4f1a07d636dc25 not found: ID does not exist" containerID="80c15f9c6214656853deb3afd716e5558ff0381737507b767a4f1a07d636dc25" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.583267 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80c15f9c6214656853deb3afd716e5558ff0381737507b767a4f1a07d636dc25"} err="failed to get container status \"80c15f9c6214656853deb3afd716e5558ff0381737507b767a4f1a07d636dc25\": rpc error: code = NotFound desc = could not find container \"80c15f9c6214656853deb3afd716e5558ff0381737507b767a4f1a07d636dc25\": container with ID starting with 80c15f9c6214656853deb3afd716e5558ff0381737507b767a4f1a07d636dc25 not found: ID does not exist" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.583281 5120 scope.go:117] "RemoveContainer" containerID="6cac886d9d64581e2f03ae4d053a2a05790fb1dc3dac0b14b081cf3e631c709c" Mar 16 17:09:08 crc kubenswrapper[5120]: E0316 17:09:08.583491 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6cac886d9d64581e2f03ae4d053a2a05790fb1dc3dac0b14b081cf3e631c709c\": container with ID starting with 6cac886d9d64581e2f03ae4d053a2a05790fb1dc3dac0b14b081cf3e631c709c not found: ID does not exist" containerID="6cac886d9d64581e2f03ae4d053a2a05790fb1dc3dac0b14b081cf3e631c709c" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.583516 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6cac886d9d64581e2f03ae4d053a2a05790fb1dc3dac0b14b081cf3e631c709c"} err="failed to get container status \"6cac886d9d64581e2f03ae4d053a2a05790fb1dc3dac0b14b081cf3e631c709c\": rpc error: code = NotFound desc = could not find container \"6cac886d9d64581e2f03ae4d053a2a05790fb1dc3dac0b14b081cf3e631c709c\": container with ID starting with 6cac886d9d64581e2f03ae4d053a2a05790fb1dc3dac0b14b081cf3e631c709c not found: ID does not exist" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.583535 5120 scope.go:117] "RemoveContainer" containerID="8e3d0f9ddaf5e60bb60873b508b6a595547e102a296dfd3de5c2efae3f915946" Mar 16 17:09:08 crc kubenswrapper[5120]: E0316 17:09:08.583734 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e3d0f9ddaf5e60bb60873b508b6a595547e102a296dfd3de5c2efae3f915946\": container with ID starting with 8e3d0f9ddaf5e60bb60873b508b6a595547e102a296dfd3de5c2efae3f915946 not found: ID does not exist" containerID="8e3d0f9ddaf5e60bb60873b508b6a595547e102a296dfd3de5c2efae3f915946" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.583762 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e3d0f9ddaf5e60bb60873b508b6a595547e102a296dfd3de5c2efae3f915946"} err="failed to get container status \"8e3d0f9ddaf5e60bb60873b508b6a595547e102a296dfd3de5c2efae3f915946\": rpc error: code = NotFound desc = could not find container \"8e3d0f9ddaf5e60bb60873b508b6a595547e102a296dfd3de5c2efae3f915946\": container with ID starting with 8e3d0f9ddaf5e60bb60873b508b6a595547e102a296dfd3de5c2efae3f915946 not found: ID does not exist" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.651588 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.680651 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1a6911b8-1804-40ce-88c2-3da863703774" path="/var/lib/kubelet/pods/1a6911b8-1804-40ce-88c2-3da863703774/volumes" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.692804 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8c67a3db-090c-4122-baa3-57a35abe4a77-combined-ca-bundle\") pod \"swift-storage-0\" (UID: \"8c67a3db-090c-4122-baa3-57a35abe4a77\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.692988 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87g2l\" (UniqueName: \"kubernetes.io/projected/8c67a3db-090c-4122-baa3-57a35abe4a77-kube-api-access-87g2l\") pod \"swift-storage-0\" (UID: \"8c67a3db-090c-4122-baa3-57a35abe4a77\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.693255 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/8c67a3db-090c-4122-baa3-57a35abe4a77-cache\") pod \"swift-storage-0\" (UID: \"8c67a3db-090c-4122-baa3-57a35abe4a77\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.693327 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/8c67a3db-090c-4122-baa3-57a35abe4a77-lock\") pod \"swift-storage-0\" (UID: \"8c67a3db-090c-4122-baa3-57a35abe4a77\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.693674 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/8c67a3db-090c-4122-baa3-57a35abe4a77-etc-swift\") pod \"swift-storage-0\" (UID: \"8c67a3db-090c-4122-baa3-57a35abe4a77\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.693719 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"swift-storage-0\" (UID: \"8c67a3db-090c-4122-baa3-57a35abe4a77\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 17:09:08 crc kubenswrapper[5120]: E0316 17:09:08.777508 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1865022 actualBytes=10240 Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.794894 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d8ee8115-84b1-4f8e-acce-1f745eb1a339-scripts\") pod \"d8ee8115-84b1-4f8e-acce-1f745eb1a339\" (UID: \"d8ee8115-84b1-4f8e-acce-1f745eb1a339\") " Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.795103 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d8ee8115-84b1-4f8e-acce-1f745eb1a339-config-data\") pod \"d8ee8115-84b1-4f8e-acce-1f745eb1a339\" (UID: \"d8ee8115-84b1-4f8e-acce-1f745eb1a339\") " Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.795409 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/d8ee8115-84b1-4f8e-acce-1f745eb1a339-sg-core-conf-yaml\") pod \"d8ee8115-84b1-4f8e-acce-1f745eb1a339\" (UID: \"d8ee8115-84b1-4f8e-acce-1f745eb1a339\") " Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.795469 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/d8ee8115-84b1-4f8e-acce-1f745eb1a339-ceilometer-tls-certs\") pod \"d8ee8115-84b1-4f8e-acce-1f745eb1a339\" (UID: \"d8ee8115-84b1-4f8e-acce-1f745eb1a339\") " Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.795595 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q269k\" (UniqueName: \"kubernetes.io/projected/d8ee8115-84b1-4f8e-acce-1f745eb1a339-kube-api-access-q269k\") pod \"d8ee8115-84b1-4f8e-acce-1f745eb1a339\" (UID: \"d8ee8115-84b1-4f8e-acce-1f745eb1a339\") " Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.795642 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d8ee8115-84b1-4f8e-acce-1f745eb1a339-combined-ca-bundle\") pod \"d8ee8115-84b1-4f8e-acce-1f745eb1a339\" (UID: \"d8ee8115-84b1-4f8e-acce-1f745eb1a339\") " Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.795708 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/d8ee8115-84b1-4f8e-acce-1f745eb1a339-log-httpd\") pod \"d8ee8115-84b1-4f8e-acce-1f745eb1a339\" (UID: \"d8ee8115-84b1-4f8e-acce-1f745eb1a339\") " Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.795872 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/d8ee8115-84b1-4f8e-acce-1f745eb1a339-run-httpd\") pod \"d8ee8115-84b1-4f8e-acce-1f745eb1a339\" (UID: \"d8ee8115-84b1-4f8e-acce-1f745eb1a339\") " Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.796142 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/8c67a3db-090c-4122-baa3-57a35abe4a77-cache\") pod \"swift-storage-0\" (UID: \"8c67a3db-090c-4122-baa3-57a35abe4a77\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.796201 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/8c67a3db-090c-4122-baa3-57a35abe4a77-lock\") pod \"swift-storage-0\" (UID: \"8c67a3db-090c-4122-baa3-57a35abe4a77\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.796496 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/8c67a3db-090c-4122-baa3-57a35abe4a77-etc-swift\") pod \"swift-storage-0\" (UID: \"8c67a3db-090c-4122-baa3-57a35abe4a77\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.796535 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"swift-storage-0\" (UID: \"8c67a3db-090c-4122-baa3-57a35abe4a77\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.796607 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8c67a3db-090c-4122-baa3-57a35abe4a77-combined-ca-bundle\") pod \"swift-storage-0\" (UID: \"8c67a3db-090c-4122-baa3-57a35abe4a77\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.796674 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-87g2l\" (UniqueName: \"kubernetes.io/projected/8c67a3db-090c-4122-baa3-57a35abe4a77-kube-api-access-87g2l\") pod \"swift-storage-0\" (UID: \"8c67a3db-090c-4122-baa3-57a35abe4a77\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.803291 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d8ee8115-84b1-4f8e-acce-1f745eb1a339-scripts" (OuterVolumeSpecName: "scripts") pod "d8ee8115-84b1-4f8e-acce-1f745eb1a339" (UID: "d8ee8115-84b1-4f8e-acce-1f745eb1a339"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.803934 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8ee8115-84b1-4f8e-acce-1f745eb1a339-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "d8ee8115-84b1-4f8e-acce-1f745eb1a339" (UID: "d8ee8115-84b1-4f8e-acce-1f745eb1a339"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.815082 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"swift-storage-0\" (UID: \"8c67a3db-090c-4122-baa3-57a35abe4a77\") device mount path \"/mnt/openstack/pv03\"" pod="openstack-kuttl-tests/swift-storage-0" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.816031 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/8c67a3db-090c-4122-baa3-57a35abe4a77-cache\") pod \"swift-storage-0\" (UID: \"8c67a3db-090c-4122-baa3-57a35abe4a77\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.816395 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/8c67a3db-090c-4122-baa3-57a35abe4a77-etc-swift\") pod \"swift-storage-0\" (UID: \"8c67a3db-090c-4122-baa3-57a35abe4a77\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.816415 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/8c67a3db-090c-4122-baa3-57a35abe4a77-lock\") pod \"swift-storage-0\" (UID: \"8c67a3db-090c-4122-baa3-57a35abe4a77\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.816796 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8ee8115-84b1-4f8e-acce-1f745eb1a339-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "d8ee8115-84b1-4f8e-acce-1f745eb1a339" (UID: "d8ee8115-84b1-4f8e-acce-1f745eb1a339"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.818524 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-87g2l\" (UniqueName: \"kubernetes.io/projected/8c67a3db-090c-4122-baa3-57a35abe4a77-kube-api-access-87g2l\") pod \"swift-storage-0\" (UID: \"8c67a3db-090c-4122-baa3-57a35abe4a77\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.821130 5120 generic.go:358] "Generic (PLEG): container finished" podID="d8ee8115-84b1-4f8e-acce-1f745eb1a339" containerID="4cc2b40ad4b0514c539231a19752ecb7a9242130424729f6b8932f54a31234d1" exitCode=0 Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.821154 5120 generic.go:358] "Generic (PLEG): container finished" podID="d8ee8115-84b1-4f8e-acce-1f745eb1a339" containerID="9458c656f50a693b70d60833863a585dcaf9872029d5488df9e9ea78c96c35fe" exitCode=2 Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.821162 5120 generic.go:358] "Generic (PLEG): container finished" podID="d8ee8115-84b1-4f8e-acce-1f745eb1a339" containerID="10357c1a70b5ebdb78b53a435ca7c70a89706af651ab0bd0a5996cf33de886d5" exitCode=0 Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.821168 5120 generic.go:358] "Generic (PLEG): container finished" podID="d8ee8115-84b1-4f8e-acce-1f745eb1a339" containerID="8c17be947fc1c3fb5e147a045257806a695cefab621e507228a1226e917445fa" exitCode=0 Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.821290 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"d8ee8115-84b1-4f8e-acce-1f745eb1a339","Type":"ContainerDied","Data":"4cc2b40ad4b0514c539231a19752ecb7a9242130424729f6b8932f54a31234d1"} Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.821316 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"d8ee8115-84b1-4f8e-acce-1f745eb1a339","Type":"ContainerDied","Data":"9458c656f50a693b70d60833863a585dcaf9872029d5488df9e9ea78c96c35fe"} Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.821326 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"d8ee8115-84b1-4f8e-acce-1f745eb1a339","Type":"ContainerDied","Data":"10357c1a70b5ebdb78b53a435ca7c70a89706af651ab0bd0a5996cf33de886d5"} Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.821334 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"d8ee8115-84b1-4f8e-acce-1f745eb1a339","Type":"ContainerDied","Data":"8c17be947fc1c3fb5e147a045257806a695cefab621e507228a1226e917445fa"} Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.821342 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"d8ee8115-84b1-4f8e-acce-1f745eb1a339","Type":"ContainerDied","Data":"43833890f668da5b21bd398db33197c7844adec6e9aab3470d9313710c62b35a"} Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.821357 5120 scope.go:117] "RemoveContainer" containerID="4cc2b40ad4b0514c539231a19752ecb7a9242130424729f6b8932f54a31234d1" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.821488 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.823083 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8c67a3db-090c-4122-baa3-57a35abe4a77-combined-ca-bundle\") pod \"swift-storage-0\" (UID: \"8c67a3db-090c-4122-baa3-57a35abe4a77\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.827748 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8ee8115-84b1-4f8e-acce-1f745eb1a339-kube-api-access-q269k" (OuterVolumeSpecName: "kube-api-access-q269k") pod "d8ee8115-84b1-4f8e-acce-1f745eb1a339" (UID: "d8ee8115-84b1-4f8e-acce-1f745eb1a339"). InnerVolumeSpecName "kube-api-access-q269k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.848401 5120 scope.go:117] "RemoveContainer" containerID="9458c656f50a693b70d60833863a585dcaf9872029d5488df9e9ea78c96c35fe" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.853963 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"swift-storage-0\" (UID: \"8c67a3db-090c-4122-baa3-57a35abe4a77\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.856132 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d8ee8115-84b1-4f8e-acce-1f745eb1a339-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "d8ee8115-84b1-4f8e-acce-1f745eb1a339" (UID: "d8ee8115-84b1-4f8e-acce-1f745eb1a339"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.888098 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d8ee8115-84b1-4f8e-acce-1f745eb1a339-ceilometer-tls-certs" (OuterVolumeSpecName: "ceilometer-tls-certs") pod "d8ee8115-84b1-4f8e-acce-1f745eb1a339" (UID: "d8ee8115-84b1-4f8e-acce-1f745eb1a339"). InnerVolumeSpecName "ceilometer-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.891520 5120 scope.go:117] "RemoveContainer" containerID="10357c1a70b5ebdb78b53a435ca7c70a89706af651ab0bd0a5996cf33de886d5" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.899974 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d8ee8115-84b1-4f8e-acce-1f745eb1a339-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.900001 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/d8ee8115-84b1-4f8e-acce-1f745eb1a339-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.900010 5120 reconciler_common.go:299] "Volume detached for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/d8ee8115-84b1-4f8e-acce-1f745eb1a339-ceilometer-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.900021 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q269k\" (UniqueName: \"kubernetes.io/projected/d8ee8115-84b1-4f8e-acce-1f745eb1a339-kube-api-access-q269k\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.900029 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/d8ee8115-84b1-4f8e-acce-1f745eb1a339-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.900038 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/d8ee8115-84b1-4f8e-acce-1f745eb1a339-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.907270 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d8ee8115-84b1-4f8e-acce-1f745eb1a339-config-data" (OuterVolumeSpecName: "config-data") pod "d8ee8115-84b1-4f8e-acce-1f745eb1a339" (UID: "d8ee8115-84b1-4f8e-acce-1f745eb1a339"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.912400 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d8ee8115-84b1-4f8e-acce-1f745eb1a339-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "d8ee8115-84b1-4f8e-acce-1f745eb1a339" (UID: "d8ee8115-84b1-4f8e-acce-1f745eb1a339"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:09:08 crc kubenswrapper[5120]: I0316 17:09:08.916384 5120 scope.go:117] "RemoveContainer" containerID="8c17be947fc1c3fb5e147a045257806a695cefab621e507228a1226e917445fa" Mar 16 17:09:09 crc kubenswrapper[5120]: I0316 17:09:09.002029 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/76f0322f-b14b-4b9b-9665-2121e3b21629-internal-tls-certs\") pod \"neutron-64b7569b94-dxks6\" (UID: \"76f0322f-b14b-4b9b-9665-2121e3b21629\") " pod="openstack-kuttl-tests/neutron-64b7569b94-dxks6" Mar 16 17:09:09 crc kubenswrapper[5120]: I0316 17:09:09.002371 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/76f0322f-b14b-4b9b-9665-2121e3b21629-public-tls-certs\") pod \"neutron-64b7569b94-dxks6\" (UID: \"76f0322f-b14b-4b9b-9665-2121e3b21629\") " pod="openstack-kuttl-tests/neutron-64b7569b94-dxks6" Mar 16 17:09:09 crc kubenswrapper[5120]: I0316 17:09:09.002622 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/76f0322f-b14b-4b9b-9665-2121e3b21629-ovndb-tls-certs\") pod \"neutron-64b7569b94-dxks6\" (UID: \"76f0322f-b14b-4b9b-9665-2121e3b21629\") " pod="openstack-kuttl-tests/neutron-64b7569b94-dxks6" Mar 16 17:09:09 crc kubenswrapper[5120]: I0316 17:09:09.002717 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d8ee8115-84b1-4f8e-acce-1f745eb1a339-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:09 crc kubenswrapper[5120]: I0316 17:09:09.002735 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d8ee8115-84b1-4f8e-acce-1f745eb1a339-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:09 crc kubenswrapper[5120]: I0316 17:09:09.007883 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/76f0322f-b14b-4b9b-9665-2121e3b21629-internal-tls-certs\") pod \"neutron-64b7569b94-dxks6\" (UID: \"76f0322f-b14b-4b9b-9665-2121e3b21629\") " pod="openstack-kuttl-tests/neutron-64b7569b94-dxks6" Mar 16 17:09:09 crc kubenswrapper[5120]: I0316 17:09:09.015952 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/76f0322f-b14b-4b9b-9665-2121e3b21629-ovndb-tls-certs\") pod \"neutron-64b7569b94-dxks6\" (UID: \"76f0322f-b14b-4b9b-9665-2121e3b21629\") " pod="openstack-kuttl-tests/neutron-64b7569b94-dxks6" Mar 16 17:09:09 crc kubenswrapper[5120]: I0316 17:09:09.017588 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/76f0322f-b14b-4b9b-9665-2121e3b21629-public-tls-certs\") pod \"neutron-64b7569b94-dxks6\" (UID: \"76f0322f-b14b-4b9b-9665-2121e3b21629\") " pod="openstack-kuttl-tests/neutron-64b7569b94-dxks6" Mar 16 17:09:09 crc kubenswrapper[5120]: I0316 17:09:09.046183 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-64b7569b94-dxks6" Mar 16 17:09:09 crc kubenswrapper[5120]: I0316 17:09:09.097941 5120 scope.go:117] "RemoveContainer" containerID="4cc2b40ad4b0514c539231a19752ecb7a9242130424729f6b8932f54a31234d1" Mar 16 17:09:09 crc kubenswrapper[5120]: E0316 17:09:09.101132 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4cc2b40ad4b0514c539231a19752ecb7a9242130424729f6b8932f54a31234d1\": container with ID starting with 4cc2b40ad4b0514c539231a19752ecb7a9242130424729f6b8932f54a31234d1 not found: ID does not exist" containerID="4cc2b40ad4b0514c539231a19752ecb7a9242130424729f6b8932f54a31234d1" Mar 16 17:09:09 crc kubenswrapper[5120]: I0316 17:09:09.101209 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4cc2b40ad4b0514c539231a19752ecb7a9242130424729f6b8932f54a31234d1"} err="failed to get container status \"4cc2b40ad4b0514c539231a19752ecb7a9242130424729f6b8932f54a31234d1\": rpc error: code = NotFound desc = could not find container \"4cc2b40ad4b0514c539231a19752ecb7a9242130424729f6b8932f54a31234d1\": container with ID starting with 4cc2b40ad4b0514c539231a19752ecb7a9242130424729f6b8932f54a31234d1 not found: ID does not exist" Mar 16 17:09:09 crc kubenswrapper[5120]: I0316 17:09:09.101240 5120 scope.go:117] "RemoveContainer" containerID="9458c656f50a693b70d60833863a585dcaf9872029d5488df9e9ea78c96c35fe" Mar 16 17:09:09 crc kubenswrapper[5120]: E0316 17:09:09.104901 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9458c656f50a693b70d60833863a585dcaf9872029d5488df9e9ea78c96c35fe\": container with ID starting with 9458c656f50a693b70d60833863a585dcaf9872029d5488df9e9ea78c96c35fe not found: ID does not exist" containerID="9458c656f50a693b70d60833863a585dcaf9872029d5488df9e9ea78c96c35fe" Mar 16 17:09:09 crc kubenswrapper[5120]: I0316 17:09:09.104952 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9458c656f50a693b70d60833863a585dcaf9872029d5488df9e9ea78c96c35fe"} err="failed to get container status \"9458c656f50a693b70d60833863a585dcaf9872029d5488df9e9ea78c96c35fe\": rpc error: code = NotFound desc = could not find container \"9458c656f50a693b70d60833863a585dcaf9872029d5488df9e9ea78c96c35fe\": container with ID starting with 9458c656f50a693b70d60833863a585dcaf9872029d5488df9e9ea78c96c35fe not found: ID does not exist" Mar 16 17:09:09 crc kubenswrapper[5120]: I0316 17:09:09.104987 5120 scope.go:117] "RemoveContainer" containerID="10357c1a70b5ebdb78b53a435ca7c70a89706af651ab0bd0a5996cf33de886d5" Mar 16 17:09:09 crc kubenswrapper[5120]: E0316 17:09:09.105484 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"10357c1a70b5ebdb78b53a435ca7c70a89706af651ab0bd0a5996cf33de886d5\": container with ID starting with 10357c1a70b5ebdb78b53a435ca7c70a89706af651ab0bd0a5996cf33de886d5 not found: ID does not exist" containerID="10357c1a70b5ebdb78b53a435ca7c70a89706af651ab0bd0a5996cf33de886d5" Mar 16 17:09:09 crc kubenswrapper[5120]: I0316 17:09:09.105535 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10357c1a70b5ebdb78b53a435ca7c70a89706af651ab0bd0a5996cf33de886d5"} err="failed to get container status \"10357c1a70b5ebdb78b53a435ca7c70a89706af651ab0bd0a5996cf33de886d5\": rpc error: code = NotFound desc = could not find container \"10357c1a70b5ebdb78b53a435ca7c70a89706af651ab0bd0a5996cf33de886d5\": container with ID starting with 10357c1a70b5ebdb78b53a435ca7c70a89706af651ab0bd0a5996cf33de886d5 not found: ID does not exist" Mar 16 17:09:09 crc kubenswrapper[5120]: I0316 17:09:09.105568 5120 scope.go:117] "RemoveContainer" containerID="8c17be947fc1c3fb5e147a045257806a695cefab621e507228a1226e917445fa" Mar 16 17:09:09 crc kubenswrapper[5120]: E0316 17:09:09.105842 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c17be947fc1c3fb5e147a045257806a695cefab621e507228a1226e917445fa\": container with ID starting with 8c17be947fc1c3fb5e147a045257806a695cefab621e507228a1226e917445fa not found: ID does not exist" containerID="8c17be947fc1c3fb5e147a045257806a695cefab621e507228a1226e917445fa" Mar 16 17:09:09 crc kubenswrapper[5120]: I0316 17:09:09.105873 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c17be947fc1c3fb5e147a045257806a695cefab621e507228a1226e917445fa"} err="failed to get container status \"8c17be947fc1c3fb5e147a045257806a695cefab621e507228a1226e917445fa\": rpc error: code = NotFound desc = could not find container \"8c17be947fc1c3fb5e147a045257806a695cefab621e507228a1226e917445fa\": container with ID starting with 8c17be947fc1c3fb5e147a045257806a695cefab621e507228a1226e917445fa not found: ID does not exist" Mar 16 17:09:09 crc kubenswrapper[5120]: I0316 17:09:09.105892 5120 scope.go:117] "RemoveContainer" containerID="4cc2b40ad4b0514c539231a19752ecb7a9242130424729f6b8932f54a31234d1" Mar 16 17:09:09 crc kubenswrapper[5120]: I0316 17:09:09.106155 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4cc2b40ad4b0514c539231a19752ecb7a9242130424729f6b8932f54a31234d1"} err="failed to get container status \"4cc2b40ad4b0514c539231a19752ecb7a9242130424729f6b8932f54a31234d1\": rpc error: code = NotFound desc = could not find container \"4cc2b40ad4b0514c539231a19752ecb7a9242130424729f6b8932f54a31234d1\": container with ID starting with 4cc2b40ad4b0514c539231a19752ecb7a9242130424729f6b8932f54a31234d1 not found: ID does not exist" Mar 16 17:09:09 crc kubenswrapper[5120]: I0316 17:09:09.106177 5120 scope.go:117] "RemoveContainer" containerID="9458c656f50a693b70d60833863a585dcaf9872029d5488df9e9ea78c96c35fe" Mar 16 17:09:09 crc kubenswrapper[5120]: I0316 17:09:09.106417 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9458c656f50a693b70d60833863a585dcaf9872029d5488df9e9ea78c96c35fe"} err="failed to get container status \"9458c656f50a693b70d60833863a585dcaf9872029d5488df9e9ea78c96c35fe\": rpc error: code = NotFound desc = could not find container \"9458c656f50a693b70d60833863a585dcaf9872029d5488df9e9ea78c96c35fe\": container with ID starting with 9458c656f50a693b70d60833863a585dcaf9872029d5488df9e9ea78c96c35fe not found: ID does not exist" Mar 16 17:09:09 crc kubenswrapper[5120]: I0316 17:09:09.106440 5120 scope.go:117] "RemoveContainer" containerID="10357c1a70b5ebdb78b53a435ca7c70a89706af651ab0bd0a5996cf33de886d5" Mar 16 17:09:09 crc kubenswrapper[5120]: I0316 17:09:09.106812 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10357c1a70b5ebdb78b53a435ca7c70a89706af651ab0bd0a5996cf33de886d5"} err="failed to get container status \"10357c1a70b5ebdb78b53a435ca7c70a89706af651ab0bd0a5996cf33de886d5\": rpc error: code = NotFound desc = could not find container \"10357c1a70b5ebdb78b53a435ca7c70a89706af651ab0bd0a5996cf33de886d5\": container with ID starting with 10357c1a70b5ebdb78b53a435ca7c70a89706af651ab0bd0a5996cf33de886d5 not found: ID does not exist" Mar 16 17:09:09 crc kubenswrapper[5120]: I0316 17:09:09.106837 5120 scope.go:117] "RemoveContainer" containerID="8c17be947fc1c3fb5e147a045257806a695cefab621e507228a1226e917445fa" Mar 16 17:09:09 crc kubenswrapper[5120]: I0316 17:09:09.110868 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c17be947fc1c3fb5e147a045257806a695cefab621e507228a1226e917445fa"} err="failed to get container status \"8c17be947fc1c3fb5e147a045257806a695cefab621e507228a1226e917445fa\": rpc error: code = NotFound desc = could not find container \"8c17be947fc1c3fb5e147a045257806a695cefab621e507228a1226e917445fa\": container with ID starting with 8c17be947fc1c3fb5e147a045257806a695cefab621e507228a1226e917445fa not found: ID does not exist" Mar 16 17:09:09 crc kubenswrapper[5120]: I0316 17:09:09.110902 5120 scope.go:117] "RemoveContainer" containerID="4cc2b40ad4b0514c539231a19752ecb7a9242130424729f6b8932f54a31234d1" Mar 16 17:09:09 crc kubenswrapper[5120]: I0316 17:09:09.114907 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4cc2b40ad4b0514c539231a19752ecb7a9242130424729f6b8932f54a31234d1"} err="failed to get container status \"4cc2b40ad4b0514c539231a19752ecb7a9242130424729f6b8932f54a31234d1\": rpc error: code = NotFound desc = could not find container \"4cc2b40ad4b0514c539231a19752ecb7a9242130424729f6b8932f54a31234d1\": container with ID starting with 4cc2b40ad4b0514c539231a19752ecb7a9242130424729f6b8932f54a31234d1 not found: ID does not exist" Mar 16 17:09:09 crc kubenswrapper[5120]: I0316 17:09:09.114950 5120 scope.go:117] "RemoveContainer" containerID="9458c656f50a693b70d60833863a585dcaf9872029d5488df9e9ea78c96c35fe" Mar 16 17:09:09 crc kubenswrapper[5120]: I0316 17:09:09.119913 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9458c656f50a693b70d60833863a585dcaf9872029d5488df9e9ea78c96c35fe"} err="failed to get container status \"9458c656f50a693b70d60833863a585dcaf9872029d5488df9e9ea78c96c35fe\": rpc error: code = NotFound desc = could not find container \"9458c656f50a693b70d60833863a585dcaf9872029d5488df9e9ea78c96c35fe\": container with ID starting with 9458c656f50a693b70d60833863a585dcaf9872029d5488df9e9ea78c96c35fe not found: ID does not exist" Mar 16 17:09:09 crc kubenswrapper[5120]: I0316 17:09:09.119991 5120 scope.go:117] "RemoveContainer" containerID="10357c1a70b5ebdb78b53a435ca7c70a89706af651ab0bd0a5996cf33de886d5" Mar 16 17:09:09 crc kubenswrapper[5120]: I0316 17:09:09.123891 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10357c1a70b5ebdb78b53a435ca7c70a89706af651ab0bd0a5996cf33de886d5"} err="failed to get container status \"10357c1a70b5ebdb78b53a435ca7c70a89706af651ab0bd0a5996cf33de886d5\": rpc error: code = NotFound desc = could not find container \"10357c1a70b5ebdb78b53a435ca7c70a89706af651ab0bd0a5996cf33de886d5\": container with ID starting with 10357c1a70b5ebdb78b53a435ca7c70a89706af651ab0bd0a5996cf33de886d5 not found: ID does not exist" Mar 16 17:09:09 crc kubenswrapper[5120]: I0316 17:09:09.123933 5120 scope.go:117] "RemoveContainer" containerID="8c17be947fc1c3fb5e147a045257806a695cefab621e507228a1226e917445fa" Mar 16 17:09:09 crc kubenswrapper[5120]: I0316 17:09:09.124970 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c17be947fc1c3fb5e147a045257806a695cefab621e507228a1226e917445fa"} err="failed to get container status \"8c17be947fc1c3fb5e147a045257806a695cefab621e507228a1226e917445fa\": rpc error: code = NotFound desc = could not find container \"8c17be947fc1c3fb5e147a045257806a695cefab621e507228a1226e917445fa\": container with ID starting with 8c17be947fc1c3fb5e147a045257806a695cefab621e507228a1226e917445fa not found: ID does not exist" Mar 16 17:09:09 crc kubenswrapper[5120]: I0316 17:09:09.125000 5120 scope.go:117] "RemoveContainer" containerID="4cc2b40ad4b0514c539231a19752ecb7a9242130424729f6b8932f54a31234d1" Mar 16 17:09:09 crc kubenswrapper[5120]: I0316 17:09:09.126023 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4cc2b40ad4b0514c539231a19752ecb7a9242130424729f6b8932f54a31234d1"} err="failed to get container status \"4cc2b40ad4b0514c539231a19752ecb7a9242130424729f6b8932f54a31234d1\": rpc error: code = NotFound desc = could not find container \"4cc2b40ad4b0514c539231a19752ecb7a9242130424729f6b8932f54a31234d1\": container with ID starting with 4cc2b40ad4b0514c539231a19752ecb7a9242130424729f6b8932f54a31234d1 not found: ID does not exist" Mar 16 17:09:09 crc kubenswrapper[5120]: I0316 17:09:09.126069 5120 scope.go:117] "RemoveContainer" containerID="9458c656f50a693b70d60833863a585dcaf9872029d5488df9e9ea78c96c35fe" Mar 16 17:09:09 crc kubenswrapper[5120]: I0316 17:09:09.126333 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9458c656f50a693b70d60833863a585dcaf9872029d5488df9e9ea78c96c35fe"} err="failed to get container status \"9458c656f50a693b70d60833863a585dcaf9872029d5488df9e9ea78c96c35fe\": rpc error: code = NotFound desc = could not find container \"9458c656f50a693b70d60833863a585dcaf9872029d5488df9e9ea78c96c35fe\": container with ID starting with 9458c656f50a693b70d60833863a585dcaf9872029d5488df9e9ea78c96c35fe not found: ID does not exist" Mar 16 17:09:09 crc kubenswrapper[5120]: I0316 17:09:09.126352 5120 scope.go:117] "RemoveContainer" containerID="10357c1a70b5ebdb78b53a435ca7c70a89706af651ab0bd0a5996cf33de886d5" Mar 16 17:09:09 crc kubenswrapper[5120]: I0316 17:09:09.127906 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10357c1a70b5ebdb78b53a435ca7c70a89706af651ab0bd0a5996cf33de886d5"} err="failed to get container status \"10357c1a70b5ebdb78b53a435ca7c70a89706af651ab0bd0a5996cf33de886d5\": rpc error: code = NotFound desc = could not find container \"10357c1a70b5ebdb78b53a435ca7c70a89706af651ab0bd0a5996cf33de886d5\": container with ID starting with 10357c1a70b5ebdb78b53a435ca7c70a89706af651ab0bd0a5996cf33de886d5 not found: ID does not exist" Mar 16 17:09:09 crc kubenswrapper[5120]: I0316 17:09:09.127933 5120 scope.go:117] "RemoveContainer" containerID="8c17be947fc1c3fb5e147a045257806a695cefab621e507228a1226e917445fa" Mar 16 17:09:09 crc kubenswrapper[5120]: I0316 17:09:09.130183 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c17be947fc1c3fb5e147a045257806a695cefab621e507228a1226e917445fa"} err="failed to get container status \"8c17be947fc1c3fb5e147a045257806a695cefab621e507228a1226e917445fa\": rpc error: code = NotFound desc = could not find container \"8c17be947fc1c3fb5e147a045257806a695cefab621e507228a1226e917445fa\": container with ID starting with 8c17be947fc1c3fb5e147a045257806a695cefab621e507228a1226e917445fa not found: ID does not exist" Mar 16 17:09:09 crc kubenswrapper[5120]: I0316 17:09:09.145621 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Mar 16 17:09:09 crc kubenswrapper[5120]: I0316 17:09:09.250795 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:09:09 crc kubenswrapper[5120]: I0316 17:09:09.274793 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:09:09 crc kubenswrapper[5120]: I0316 17:09:09.298793 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:09:09 crc kubenswrapper[5120]: I0316 17:09:09.299893 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8ee8115-84b1-4f8e-acce-1f745eb1a339" containerName="ceilometer-central-agent" Mar 16 17:09:09 crc kubenswrapper[5120]: I0316 17:09:09.299912 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8ee8115-84b1-4f8e-acce-1f745eb1a339" containerName="ceilometer-central-agent" Mar 16 17:09:09 crc kubenswrapper[5120]: I0316 17:09:09.299931 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8ee8115-84b1-4f8e-acce-1f745eb1a339" containerName="sg-core" Mar 16 17:09:09 crc kubenswrapper[5120]: I0316 17:09:09.299937 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8ee8115-84b1-4f8e-acce-1f745eb1a339" containerName="sg-core" Mar 16 17:09:09 crc kubenswrapper[5120]: I0316 17:09:09.299966 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8ee8115-84b1-4f8e-acce-1f745eb1a339" containerName="ceilometer-notification-agent" Mar 16 17:09:09 crc kubenswrapper[5120]: I0316 17:09:09.299972 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8ee8115-84b1-4f8e-acce-1f745eb1a339" containerName="ceilometer-notification-agent" Mar 16 17:09:09 crc kubenswrapper[5120]: I0316 17:09:09.299986 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8ee8115-84b1-4f8e-acce-1f745eb1a339" containerName="proxy-httpd" Mar 16 17:09:09 crc kubenswrapper[5120]: I0316 17:09:09.299991 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8ee8115-84b1-4f8e-acce-1f745eb1a339" containerName="proxy-httpd" Mar 16 17:09:09 crc kubenswrapper[5120]: I0316 17:09:09.300150 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="d8ee8115-84b1-4f8e-acce-1f745eb1a339" containerName="ceilometer-central-agent" Mar 16 17:09:09 crc kubenswrapper[5120]: I0316 17:09:09.300168 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="d8ee8115-84b1-4f8e-acce-1f745eb1a339" containerName="sg-core" Mar 16 17:09:09 crc kubenswrapper[5120]: I0316 17:09:09.300176 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="d8ee8115-84b1-4f8e-acce-1f745eb1a339" containerName="ceilometer-notification-agent" Mar 16 17:09:09 crc kubenswrapper[5120]: I0316 17:09:09.300187 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="d8ee8115-84b1-4f8e-acce-1f745eb1a339" containerName="proxy-httpd" Mar 16 17:09:09 crc kubenswrapper[5120]: I0316 17:09:09.329669 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:09:09 crc kubenswrapper[5120]: I0316 17:09:09.335898 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 17:09:09 crc kubenswrapper[5120]: I0316 17:09:09.336353 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 17:09:09 crc kubenswrapper[5120]: I0316 17:09:09.336536 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ceilometer-internal-svc\"" Mar 16 17:09:09 crc kubenswrapper[5120]: I0316 17:09:09.357757 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:09:09 crc kubenswrapper[5120]: I0316 17:09:09.521551 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3c2d5679-277a-4f1f-94c7-4a37df9c29d3-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"3c2d5679-277a-4f1f-94c7-4a37df9c29d3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:09:09 crc kubenswrapper[5120]: I0316 17:09:09.525974 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3c2d5679-277a-4f1f-94c7-4a37df9c29d3-config-data\") pod \"ceilometer-0\" (UID: \"3c2d5679-277a-4f1f-94c7-4a37df9c29d3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:09:09 crc kubenswrapper[5120]: I0316 17:09:09.526221 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctmsr\" (UniqueName: \"kubernetes.io/projected/3c2d5679-277a-4f1f-94c7-4a37df9c29d3-kube-api-access-ctmsr\") pod \"ceilometer-0\" (UID: \"3c2d5679-277a-4f1f-94c7-4a37df9c29d3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:09:09 crc kubenswrapper[5120]: I0316 17:09:09.526494 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/3c2d5679-277a-4f1f-94c7-4a37df9c29d3-log-httpd\") pod \"ceilometer-0\" (UID: \"3c2d5679-277a-4f1f-94c7-4a37df9c29d3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:09:09 crc kubenswrapper[5120]: I0316 17:09:09.526719 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3c2d5679-277a-4f1f-94c7-4a37df9c29d3-scripts\") pod \"ceilometer-0\" (UID: \"3c2d5679-277a-4f1f-94c7-4a37df9c29d3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:09:09 crc kubenswrapper[5120]: I0316 17:09:09.526914 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/3c2d5679-277a-4f1f-94c7-4a37df9c29d3-run-httpd\") pod \"ceilometer-0\" (UID: \"3c2d5679-277a-4f1f-94c7-4a37df9c29d3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:09:09 crc kubenswrapper[5120]: I0316 17:09:09.527296 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/3c2d5679-277a-4f1f-94c7-4a37df9c29d3-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"3c2d5679-277a-4f1f-94c7-4a37df9c29d3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:09:09 crc kubenswrapper[5120]: I0316 17:09:09.527442 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/3c2d5679-277a-4f1f-94c7-4a37df9c29d3-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"3c2d5679-277a-4f1f-94c7-4a37df9c29d3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:09:09 crc kubenswrapper[5120]: I0316 17:09:09.629425 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3c2d5679-277a-4f1f-94c7-4a37df9c29d3-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"3c2d5679-277a-4f1f-94c7-4a37df9c29d3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:09:09 crc kubenswrapper[5120]: I0316 17:09:09.629665 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3c2d5679-277a-4f1f-94c7-4a37df9c29d3-config-data\") pod \"ceilometer-0\" (UID: \"3c2d5679-277a-4f1f-94c7-4a37df9c29d3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:09:09 crc kubenswrapper[5120]: I0316 17:09:09.629693 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ctmsr\" (UniqueName: \"kubernetes.io/projected/3c2d5679-277a-4f1f-94c7-4a37df9c29d3-kube-api-access-ctmsr\") pod \"ceilometer-0\" (UID: \"3c2d5679-277a-4f1f-94c7-4a37df9c29d3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:09:09 crc kubenswrapper[5120]: I0316 17:09:09.629804 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/3c2d5679-277a-4f1f-94c7-4a37df9c29d3-log-httpd\") pod \"ceilometer-0\" (UID: \"3c2d5679-277a-4f1f-94c7-4a37df9c29d3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:09:09 crc kubenswrapper[5120]: I0316 17:09:09.629870 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3c2d5679-277a-4f1f-94c7-4a37df9c29d3-scripts\") pod \"ceilometer-0\" (UID: \"3c2d5679-277a-4f1f-94c7-4a37df9c29d3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:09:09 crc kubenswrapper[5120]: I0316 17:09:09.629903 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/3c2d5679-277a-4f1f-94c7-4a37df9c29d3-run-httpd\") pod \"ceilometer-0\" (UID: \"3c2d5679-277a-4f1f-94c7-4a37df9c29d3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:09:09 crc kubenswrapper[5120]: I0316 17:09:09.630037 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/3c2d5679-277a-4f1f-94c7-4a37df9c29d3-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"3c2d5679-277a-4f1f-94c7-4a37df9c29d3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:09:09 crc kubenswrapper[5120]: I0316 17:09:09.630065 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/3c2d5679-277a-4f1f-94c7-4a37df9c29d3-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"3c2d5679-277a-4f1f-94c7-4a37df9c29d3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:09:09 crc kubenswrapper[5120]: I0316 17:09:09.632596 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/3c2d5679-277a-4f1f-94c7-4a37df9c29d3-run-httpd\") pod \"ceilometer-0\" (UID: \"3c2d5679-277a-4f1f-94c7-4a37df9c29d3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:09:09 crc kubenswrapper[5120]: I0316 17:09:09.632552 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/3c2d5679-277a-4f1f-94c7-4a37df9c29d3-log-httpd\") pod \"ceilometer-0\" (UID: \"3c2d5679-277a-4f1f-94c7-4a37df9c29d3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:09:09 crc kubenswrapper[5120]: I0316 17:09:09.638458 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3c2d5679-277a-4f1f-94c7-4a37df9c29d3-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"3c2d5679-277a-4f1f-94c7-4a37df9c29d3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:09:09 crc kubenswrapper[5120]: I0316 17:09:09.639257 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3c2d5679-277a-4f1f-94c7-4a37df9c29d3-config-data\") pod \"ceilometer-0\" (UID: \"3c2d5679-277a-4f1f-94c7-4a37df9c29d3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:09:09 crc kubenswrapper[5120]: I0316 17:09:09.639295 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/3c2d5679-277a-4f1f-94c7-4a37df9c29d3-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"3c2d5679-277a-4f1f-94c7-4a37df9c29d3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:09:09 crc kubenswrapper[5120]: I0316 17:09:09.639382 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/3c2d5679-277a-4f1f-94c7-4a37df9c29d3-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"3c2d5679-277a-4f1f-94c7-4a37df9c29d3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:09:09 crc kubenswrapper[5120]: I0316 17:09:09.641319 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3c2d5679-277a-4f1f-94c7-4a37df9c29d3-scripts\") pod \"ceilometer-0\" (UID: \"3c2d5679-277a-4f1f-94c7-4a37df9c29d3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:09:09 crc kubenswrapper[5120]: I0316 17:09:09.653642 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctmsr\" (UniqueName: \"kubernetes.io/projected/3c2d5679-277a-4f1f-94c7-4a37df9c29d3-kube-api-access-ctmsr\") pod \"ceilometer-0\" (UID: \"3c2d5679-277a-4f1f-94c7-4a37df9c29d3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:09:09 crc kubenswrapper[5120]: I0316 17:09:09.663675 5120 scope.go:117] "RemoveContainer" containerID="db39d192fa687a13805537d08ad22fed1ef362ef5027c920a616297dc55a8ea9" Mar 16 17:09:09 crc kubenswrapper[5120]: E0316 17:09:09.664068 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 17:09:09 crc kubenswrapper[5120]: I0316 17:09:09.666052 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:09:09 crc kubenswrapper[5120]: I0316 17:09:09.730987 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-64b7569b94-dxks6"] Mar 16 17:09:09 crc kubenswrapper[5120]: W0316 17:09:09.736958 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod76f0322f_b14b_4b9b_9665_2121e3b21629.slice/crio-0aefad752ed73cdf17e594cf88e7be5c7ddf7447851dbc78abecca7975d12a09 WatchSource:0}: Error finding container 0aefad752ed73cdf17e594cf88e7be5c7ddf7447851dbc78abecca7975d12a09: Status 404 returned error can't find the container with id 0aefad752ed73cdf17e594cf88e7be5c7ddf7447851dbc78abecca7975d12a09 Mar 16 17:09:09 crc kubenswrapper[5120]: I0316 17:09:09.862042 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-64b7569b94-dxks6" event={"ID":"76f0322f-b14b-4b9b-9665-2121e3b21629","Type":"ContainerStarted","Data":"0aefad752ed73cdf17e594cf88e7be5c7ddf7447851dbc78abecca7975d12a09"} Mar 16 17:09:09 crc kubenswrapper[5120]: I0316 17:09:09.886028 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 17:09:10 crc kubenswrapper[5120]: I0316 17:09:10.234628 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:09:10 crc kubenswrapper[5120]: W0316 17:09:10.266566 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3c2d5679_277a_4f1f_94c7_4a37df9c29d3.slice/crio-1c6d108ca5ff6167004775f98213649697146563a47739f53421c148ececccca WatchSource:0}: Error finding container 1c6d108ca5ff6167004775f98213649697146563a47739f53421c148ececccca: Status 404 returned error can't find the container with id 1c6d108ca5ff6167004775f98213649697146563a47739f53421c148ececccca Mar 16 17:09:10 crc kubenswrapper[5120]: I0316 17:09:10.469998 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openstack-kuttl-tests/barbican-api-5866f469b4-fczj7" podUID="bc40587b-0877-4370-bdcc-a56479bf99e6" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.0.10:9311/healthcheck\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Mar 16 17:09:10 crc kubenswrapper[5120]: I0316 17:09:10.470491 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openstack-kuttl-tests/barbican-api-5866f469b4-fczj7" podUID="bc40587b-0877-4370-bdcc-a56479bf99e6" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.0.10:9311/healthcheck\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Mar 16 17:09:10 crc kubenswrapper[5120]: I0316 17:09:10.501914 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="69bb2342-14e1-4c32-889a-e33f6ba42651" containerName="nova-api-log" probeResult="failure" output="Get \"https://10.217.1.243:8774/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Mar 16 17:09:10 crc kubenswrapper[5120]: I0316 17:09:10.504983 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="69bb2342-14e1-4c32-889a-e33f6ba42651" containerName="nova-api-api" probeResult="failure" output="Get \"https://10.217.1.243:8774/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Mar 16 17:09:10 crc kubenswrapper[5120]: I0316 17:09:10.679421 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d8ee8115-84b1-4f8e-acce-1f745eb1a339" path="/var/lib/kubelet/pods/d8ee8115-84b1-4f8e-acce-1f745eb1a339/volumes" Mar 16 17:09:10 crc kubenswrapper[5120]: I0316 17:09:10.891416 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"3c2d5679-277a-4f1f-94c7-4a37df9c29d3","Type":"ContainerStarted","Data":"1c6d108ca5ff6167004775f98213649697146563a47739f53421c148ececccca"} Mar 16 17:09:10 crc kubenswrapper[5120]: I0316 17:09:10.906145 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-64b7569b94-dxks6" event={"ID":"76f0322f-b14b-4b9b-9665-2121e3b21629","Type":"ContainerStarted","Data":"805349fcd73b71b77e0d612190a603fe69577f038e1cf9b0cd22a2788eaabb4f"} Mar 16 17:09:10 crc kubenswrapper[5120]: I0316 17:09:10.906211 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-64b7569b94-dxks6" event={"ID":"76f0322f-b14b-4b9b-9665-2121e3b21629","Type":"ContainerStarted","Data":"598d399875f1007c74ffb9a295384b67e42baa6c19d61a3bd91b82a9c3db6ecc"} Mar 16 17:09:10 crc kubenswrapper[5120]: I0316 17:09:10.906256 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/neutron-64b7569b94-dxks6" Mar 16 17:09:10 crc kubenswrapper[5120]: I0316 17:09:10.922611 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"8c67a3db-090c-4122-baa3-57a35abe4a77","Type":"ContainerStarted","Data":"ba90cd93acdcaf326c2686ffdf1ed1397f6bb727388d50974eefaab36e84d18e"} Mar 16 17:09:10 crc kubenswrapper[5120]: I0316 17:09:10.922654 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"8c67a3db-090c-4122-baa3-57a35abe4a77","Type":"ContainerStarted","Data":"b418d03d15ebb8bc5fd3fd000498ee8cffdf5be56ef3553a3937697d0337a694"} Mar 16 17:09:10 crc kubenswrapper[5120]: I0316 17:09:10.922662 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"8c67a3db-090c-4122-baa3-57a35abe4a77","Type":"ContainerStarted","Data":"cada37d138fe1100f7adc594e98ea94d57976e07351e011bc535d9982f6320a9"} Mar 16 17:09:10 crc kubenswrapper[5120]: I0316 17:09:10.922672 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"8c67a3db-090c-4122-baa3-57a35abe4a77","Type":"ContainerStarted","Data":"27711011e41d6feb93f1345f33642b751fa8ab04b23dfeccdf430f54ee4f5883"} Mar 16 17:09:10 crc kubenswrapper[5120]: I0316 17:09:10.936111 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-64b7569b94-dxks6" podStartSLOduration=34.936095008 podStartE2EDuration="34.936095008s" podCreationTimestamp="2026-03-16 17:08:36 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:09:10.935129092 +0000 UTC m=+5853.089060749" watchObservedRunningTime="2026-03-16 17:09:10.936095008 +0000 UTC m=+5853.090026665" Mar 16 17:09:11 crc kubenswrapper[5120]: I0316 17:09:11.009961 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="6e4e8c65-5607-4f79-ba90-208ca1a32521" containerName="cinder-scheduler" probeResult="failure" output="Get \"http://10.217.1.249:8080/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 17:09:11 crc kubenswrapper[5120]: I0316 17:09:11.226869 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:09:11 crc kubenswrapper[5120]: I0316 17:09:11.227287 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:09:11 crc kubenswrapper[5120]: I0316 17:09:11.236364 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:09:11 crc kubenswrapper[5120]: I0316 17:09:11.240243 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:09:11 crc kubenswrapper[5120]: I0316 17:09:11.432338 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/10bd837b-2e0d-460b-a254-20e23b6768f7-memcached-tls-certs\") pod \"memcached-0\" (UID: \"10bd837b-2e0d-460b-a254-20e23b6768f7\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 17:09:11 crc kubenswrapper[5120]: I0316 17:09:11.435364 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:09:11 crc kubenswrapper[5120]: I0316 17:09:11.441924 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/10bd837b-2e0d-460b-a254-20e23b6768f7-memcached-tls-certs\") pod \"memcached-0\" (UID: \"10bd837b-2e0d-460b-a254-20e23b6768f7\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 17:09:11 crc kubenswrapper[5120]: I0316 17:09:11.474262 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Mar 16 17:09:11 crc kubenswrapper[5120]: I0316 17:09:11.638915 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-5866f469b4-fczj7" podUID="bc40587b-0877-4370-bdcc-a56479bf99e6" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.0.10:9311/healthcheck\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Mar 16 17:09:11 crc kubenswrapper[5120]: I0316 17:09:11.639722 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-5866f469b4-fczj7" podUID="bc40587b-0877-4370-bdcc-a56479bf99e6" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.0.10:9311/healthcheck\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 17:09:11 crc kubenswrapper[5120]: I0316 17:09:11.974628 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 17:09:11 crc kubenswrapper[5120]: I0316 17:09:11.994685 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"3c2d5679-277a-4f1f-94c7-4a37df9c29d3","Type":"ContainerStarted","Data":"f59e3f589f2c744c0fec7c367ccaee441c0171f5289a91c4ed169f87e31a15dc"} Mar 16 17:09:12 crc kubenswrapper[5120]: I0316 17:09:12.071238 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"8c67a3db-090c-4122-baa3-57a35abe4a77","Type":"ContainerStarted","Data":"d65cca40b78acf38a924033770b7dddbe830b04f4b9481a7ae42afc4fe0148a7"} Mar 16 17:09:12 crc kubenswrapper[5120]: I0316 17:09:12.071292 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"8c67a3db-090c-4122-baa3-57a35abe4a77","Type":"ContainerStarted","Data":"f52dab27d76bec378b4e03ce3c968e616b175a12da052c7df1d412f7a7b105f3"} Mar 16 17:09:12 crc kubenswrapper[5120]: I0316 17:09:12.071308 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"8c67a3db-090c-4122-baa3-57a35abe4a77","Type":"ContainerStarted","Data":"1e20522ae176f0e3ccd3b88970db4d1da4912838989def622ce73c5a72a09fb7"} Mar 16 17:09:12 crc kubenswrapper[5120]: I0316 17:09:12.071322 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"8c67a3db-090c-4122-baa3-57a35abe4a77","Type":"ContainerStarted","Data":"f95d08633e13a2f886a5e2ffcf7ff8812d6b9d89d3404c7418c501f94509e1e5"} Mar 16 17:09:12 crc kubenswrapper[5120]: I0316 17:09:12.268865 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:09:12 crc kubenswrapper[5120]: I0316 17:09:12.269179 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:09:12 crc kubenswrapper[5120]: I0316 17:09:12.319009 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 17:09:12 crc kubenswrapper[5120]: I0316 17:09:12.488108 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:09:13 crc kubenswrapper[5120]: I0316 17:09:13.025920 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="f39a0edc-bfc5-400a-ad5e-4c83f2065778" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"https://10.217.1.244:8775/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Mar 16 17:09:13 crc kubenswrapper[5120]: I0316 17:09:13.031935 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="f39a0edc-bfc5-400a-ad5e-4c83f2065778" containerName="nova-metadata-log" probeResult="failure" output="Get \"https://10.217.1.244:8775/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Mar 16 17:09:13 crc kubenswrapper[5120]: I0316 17:09:13.130362 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"10bd837b-2e0d-460b-a254-20e23b6768f7","Type":"ContainerStarted","Data":"e19ce5213f51e39d0fe500fc1b09e0c84e9115038d851fdb05d0763df81163f5"} Mar 16 17:09:13 crc kubenswrapper[5120]: I0316 17:09:13.130713 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"10bd837b-2e0d-460b-a254-20e23b6768f7","Type":"ContainerStarted","Data":"baefced4d9c77c78e2d6c84beb74d1589a2d91b4e3cdc77b44124dd53354c531"} Mar 16 17:09:13 crc kubenswrapper[5120]: I0316 17:09:13.130811 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/memcached-0" Mar 16 17:09:13 crc kubenswrapper[5120]: I0316 17:09:13.149475 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"8c67a3db-090c-4122-baa3-57a35abe4a77","Type":"ContainerStarted","Data":"f2699a9dd63e448a62ece804e3ecad01c35e679180fa7733373a71fa9979801b"} Mar 16 17:09:13 crc kubenswrapper[5120]: I0316 17:09:13.149561 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"8c67a3db-090c-4122-baa3-57a35abe4a77","Type":"ContainerStarted","Data":"73ed0a55f7c6e413c01b8128322ec99568e0ead33b66931a7b20ec0e5c812b79"} Mar 16 17:09:13 crc kubenswrapper[5120]: I0316 17:09:13.149582 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"8c67a3db-090c-4122-baa3-57a35abe4a77","Type":"ContainerStarted","Data":"d7dc1b404bf2b4f2e0991e2c5df23d74605bd37f0234c83975a5462226173f4a"} Mar 16 17:09:13 crc kubenswrapper[5120]: I0316 17:09:13.154184 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3","Type":"ContainerStarted","Data":"9f702367fcb8fdb15ed6ae2bb41db1c73e6750e39028c97bce0790061b8107b4"} Mar 16 17:09:13 crc kubenswrapper[5120]: I0316 17:09:13.154250 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3","Type":"ContainerStarted","Data":"aecacfe477959636e92e884c67c3da1ce83a447b5c24ebdf4c3c399f899822bf"} Mar 16 17:09:13 crc kubenswrapper[5120]: I0316 17:09:13.160957 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/memcached-0" podStartSLOduration=34.16093288 podStartE2EDuration="34.16093288s" podCreationTimestamp="2026-03-16 17:08:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:09:13.148604999 +0000 UTC m=+5855.302536656" watchObservedRunningTime="2026-03-16 17:09:13.16093288 +0000 UTC m=+5855.314864537" Mar 16 17:09:13 crc kubenswrapper[5120]: I0316 17:09:13.167109 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"3c2d5679-277a-4f1f-94c7-4a37df9c29d3","Type":"ContainerStarted","Data":"2788323bc772d158b1df47da429e9be0f6a201d43f5d06c7ab4c0b0f99e0993a"} Mar 16 17:09:13 crc kubenswrapper[5120]: I0316 17:09:13.179127 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podStartSLOduration=34.179092001 podStartE2EDuration="34.179092001s" podCreationTimestamp="2026-03-16 17:08:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:09:13.17394617 +0000 UTC m=+5855.327877837" watchObservedRunningTime="2026-03-16 17:09:13.179092001 +0000 UTC m=+5855.333023658" Mar 16 17:09:13 crc kubenswrapper[5120]: I0316 17:09:13.322449 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:09:13 crc kubenswrapper[5120]: I0316 17:09:13.851259 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-5866f469b4-fczj7" Mar 16 17:09:13 crc kubenswrapper[5120]: I0316 17:09:13.869540 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-5866f469b4-fczj7" Mar 16 17:09:13 crc kubenswrapper[5120]: I0316 17:09:13.952506 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-b95589884-bsqwd"] Mar 16 17:09:13 crc kubenswrapper[5120]: I0316 17:09:13.952830 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-b95589884-bsqwd" podUID="040d2221-969e-4e00-8097-340b3c4a1b43" containerName="barbican-api-log" containerID="cri-o://d932a84914494f64428fea8a34e2f4f28444bbf97f75dac7e239cbfae42f21ad" gracePeriod=30 Mar 16 17:09:13 crc kubenswrapper[5120]: I0316 17:09:13.953003 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-b95589884-bsqwd" podUID="040d2221-969e-4e00-8097-340b3c4a1b43" containerName="barbican-api" containerID="cri-o://7bc5f449c2736601b6112b4a1aa0bd4ded20f0647daa7dca214d9f4a87b1e680" gracePeriod=30 Mar 16 17:09:14 crc kubenswrapper[5120]: I0316 17:09:14.196673 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"8c67a3db-090c-4122-baa3-57a35abe4a77","Type":"ContainerStarted","Data":"bd46718441dd3915f5bd2a71883fc7096ec17c6c243882c28d9b6633fc1f8f06"} Mar 16 17:09:14 crc kubenswrapper[5120]: I0316 17:09:14.196716 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"8c67a3db-090c-4122-baa3-57a35abe4a77","Type":"ContainerStarted","Data":"073581fad4fe5433c64fceb81b5027e86b37722dadca16ae342222f8c0f17ca8"} Mar 16 17:09:14 crc kubenswrapper[5120]: I0316 17:09:14.196725 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"8c67a3db-090c-4122-baa3-57a35abe4a77","Type":"ContainerStarted","Data":"42310681682e3dc01c949750585a1d651aab966cfcfea51537e5687aba6547b2"} Mar 16 17:09:14 crc kubenswrapper[5120]: I0316 17:09:14.196718 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/15200613-4843-450f-bf1e-e7b152c48f43-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"15200613-4843-450f-bf1e-e7b152c48f43\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:09:14 crc kubenswrapper[5120]: I0316 17:09:14.199666 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"3c2d5679-277a-4f1f-94c7-4a37df9c29d3","Type":"ContainerStarted","Data":"504da395b98af450c567ae2b9409fd2ac793973f3fd8e061134a19b143ef1898"} Mar 16 17:09:14 crc kubenswrapper[5120]: I0316 17:09:14.207671 5120 generic.go:358] "Generic (PLEG): container finished" podID="040d2221-969e-4e00-8097-340b3c4a1b43" containerID="d932a84914494f64428fea8a34e2f4f28444bbf97f75dac7e239cbfae42f21ad" exitCode=143 Mar 16 17:09:14 crc kubenswrapper[5120]: I0316 17:09:14.209260 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-b95589884-bsqwd" event={"ID":"040d2221-969e-4e00-8097-340b3c4a1b43","Type":"ContainerDied","Data":"d932a84914494f64428fea8a34e2f4f28444bbf97f75dac7e239cbfae42f21ad"} Mar 16 17:09:14 crc kubenswrapper[5120]: I0316 17:09:14.217646 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/15200613-4843-450f-bf1e-e7b152c48f43-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"15200613-4843-450f-bf1e-e7b152c48f43\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:09:14 crc kubenswrapper[5120]: I0316 17:09:14.378234 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:09:14 crc kubenswrapper[5120]: I0316 17:09:14.887924 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 17:09:14 crc kubenswrapper[5120]: W0316 17:09:14.888987 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod15200613_4843_450f_bf1e_e7b152c48f43.slice/crio-ee2e492f0398356f8fc8d1a55ebebaf93543b50629f55d23bb6e6a665cd412a7 WatchSource:0}: Error finding container ee2e492f0398356f8fc8d1a55ebebaf93543b50629f55d23bb6e6a665cd412a7: Status 404 returned error can't find the container with id ee2e492f0398356f8fc8d1a55ebebaf93543b50629f55d23bb6e6a665cd412a7 Mar 16 17:09:15 crc kubenswrapper[5120]: I0316 17:09:15.234012 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"8c67a3db-090c-4122-baa3-57a35abe4a77","Type":"ContainerStarted","Data":"399b6cf1eec5612bf777734fd2b34b2d83283c77f72adc4572e237b1f80a795a"} Mar 16 17:09:15 crc kubenswrapper[5120]: I0316 17:09:15.234087 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"8c67a3db-090c-4122-baa3-57a35abe4a77","Type":"ContainerStarted","Data":"0c8cea3043f2fce80ea7e250797bd2913e76ea0470fe9e12eca4dbc755f293a4"} Mar 16 17:09:15 crc kubenswrapper[5120]: I0316 17:09:15.241365 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"15200613-4843-450f-bf1e-e7b152c48f43","Type":"ContainerStarted","Data":"ee2e492f0398356f8fc8d1a55ebebaf93543b50629f55d23bb6e6a665cd412a7"} Mar 16 17:09:15 crc kubenswrapper[5120]: I0316 17:09:15.283446 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/swift-storage-0" podStartSLOduration=7.283424504 podStartE2EDuration="7.283424504s" podCreationTimestamp="2026-03-16 17:09:08 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:09:15.273018027 +0000 UTC m=+5857.426949684" watchObservedRunningTime="2026-03-16 17:09:15.283424504 +0000 UTC m=+5857.437356161" Mar 16 17:09:15 crc kubenswrapper[5120]: I0316 17:09:15.416988 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-58664f4b7c-kc5rb"] Mar 16 17:09:15 crc kubenswrapper[5120]: I0316 17:09:15.426982 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58664f4b7c-kc5rb" Mar 16 17:09:15 crc kubenswrapper[5120]: I0316 17:09:15.465561 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-58664f4b7c-kc5rb"] Mar 16 17:09:15 crc kubenswrapper[5120]: I0316 17:09:15.475734 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openstack-kuttl-tests/barbican-api-5866f469b4-fczj7" podUID="bc40587b-0877-4370-bdcc-a56479bf99e6" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.0.10:9311/healthcheck\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Mar 16 17:09:15 crc kubenswrapper[5120]: I0316 17:09:15.475966 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openstack-kuttl-tests/barbican-api-5866f469b4-fczj7" podUID="bc40587b-0877-4370-bdcc-a56479bf99e6" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.0.10:9311/healthcheck\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 17:09:15 crc kubenswrapper[5120]: I0316 17:09:15.543201 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfrmx\" (UniqueName: \"kubernetes.io/projected/01e18a65-5476-4eea-8420-5f6bc6f93cca-kube-api-access-vfrmx\") pod \"dnsmasq-dnsmasq-58664f4b7c-kc5rb\" (UID: \"01e18a65-5476-4eea-8420-5f6bc6f93cca\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58664f4b7c-kc5rb" Mar 16 17:09:15 crc kubenswrapper[5120]: I0316 17:09:15.543973 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/01e18a65-5476-4eea-8420-5f6bc6f93cca-config\") pod \"dnsmasq-dnsmasq-58664f4b7c-kc5rb\" (UID: \"01e18a65-5476-4eea-8420-5f6bc6f93cca\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58664f4b7c-kc5rb" Mar 16 17:09:15 crc kubenswrapper[5120]: I0316 17:09:15.545702 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/01e18a65-5476-4eea-8420-5f6bc6f93cca-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-58664f4b7c-kc5rb\" (UID: \"01e18a65-5476-4eea-8420-5f6bc6f93cca\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58664f4b7c-kc5rb" Mar 16 17:09:15 crc kubenswrapper[5120]: I0316 17:09:15.545896 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/01e18a65-5476-4eea-8420-5f6bc6f93cca-dns-swift-storage-0\") pod \"dnsmasq-dnsmasq-58664f4b7c-kc5rb\" (UID: \"01e18a65-5476-4eea-8420-5f6bc6f93cca\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58664f4b7c-kc5rb" Mar 16 17:09:15 crc kubenswrapper[5120]: I0316 17:09:15.651679 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/01e18a65-5476-4eea-8420-5f6bc6f93cca-config\") pod \"dnsmasq-dnsmasq-58664f4b7c-kc5rb\" (UID: \"01e18a65-5476-4eea-8420-5f6bc6f93cca\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58664f4b7c-kc5rb" Mar 16 17:09:15 crc kubenswrapper[5120]: I0316 17:09:15.651879 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/01e18a65-5476-4eea-8420-5f6bc6f93cca-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-58664f4b7c-kc5rb\" (UID: \"01e18a65-5476-4eea-8420-5f6bc6f93cca\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58664f4b7c-kc5rb" Mar 16 17:09:15 crc kubenswrapper[5120]: I0316 17:09:15.651993 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/01e18a65-5476-4eea-8420-5f6bc6f93cca-dns-swift-storage-0\") pod \"dnsmasq-dnsmasq-58664f4b7c-kc5rb\" (UID: \"01e18a65-5476-4eea-8420-5f6bc6f93cca\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58664f4b7c-kc5rb" Mar 16 17:09:15 crc kubenswrapper[5120]: I0316 17:09:15.652854 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/01e18a65-5476-4eea-8420-5f6bc6f93cca-config\") pod \"dnsmasq-dnsmasq-58664f4b7c-kc5rb\" (UID: \"01e18a65-5476-4eea-8420-5f6bc6f93cca\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58664f4b7c-kc5rb" Mar 16 17:09:15 crc kubenswrapper[5120]: I0316 17:09:15.652910 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/01e18a65-5476-4eea-8420-5f6bc6f93cca-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-58664f4b7c-kc5rb\" (UID: \"01e18a65-5476-4eea-8420-5f6bc6f93cca\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58664f4b7c-kc5rb" Mar 16 17:09:15 crc kubenswrapper[5120]: I0316 17:09:15.652991 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vfrmx\" (UniqueName: \"kubernetes.io/projected/01e18a65-5476-4eea-8420-5f6bc6f93cca-kube-api-access-vfrmx\") pod \"dnsmasq-dnsmasq-58664f4b7c-kc5rb\" (UID: \"01e18a65-5476-4eea-8420-5f6bc6f93cca\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58664f4b7c-kc5rb" Mar 16 17:09:15 crc kubenswrapper[5120]: I0316 17:09:15.653018 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/01e18a65-5476-4eea-8420-5f6bc6f93cca-dns-swift-storage-0\") pod \"dnsmasq-dnsmasq-58664f4b7c-kc5rb\" (UID: \"01e18a65-5476-4eea-8420-5f6bc6f93cca\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58664f4b7c-kc5rb" Mar 16 17:09:15 crc kubenswrapper[5120]: I0316 17:09:15.674897 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfrmx\" (UniqueName: \"kubernetes.io/projected/01e18a65-5476-4eea-8420-5f6bc6f93cca-kube-api-access-vfrmx\") pod \"dnsmasq-dnsmasq-58664f4b7c-kc5rb\" (UID: \"01e18a65-5476-4eea-8420-5f6bc6f93cca\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58664f4b7c-kc5rb" Mar 16 17:09:15 crc kubenswrapper[5120]: I0316 17:09:15.744025 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/cinder-api-0" podUID="f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee" containerName="cinder-api" probeResult="failure" output="Get \"https://10.217.0.21:8776/healthcheck\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 17:09:15 crc kubenswrapper[5120]: I0316 17:09:15.758729 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58664f4b7c-kc5rb" Mar 16 17:09:16 crc kubenswrapper[5120]: I0316 17:09:16.052227 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="6e4e8c65-5607-4f79-ba90-208ca1a32521" containerName="cinder-scheduler" probeResult="failure" output="Get \"http://10.217.1.249:8080/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 17:09:16 crc kubenswrapper[5120]: I0316 17:09:16.269889 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"15200613-4843-450f-bf1e-e7b152c48f43","Type":"ContainerStarted","Data":"66729d307f3c4ae64259d7994cb8ba5065ef7054bad2bce3f0f8c35286a85348"} Mar 16 17:09:16 crc kubenswrapper[5120]: I0316 17:09:16.282930 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"3c2d5679-277a-4f1f-94c7-4a37df9c29d3","Type":"ContainerStarted","Data":"1a25fa7cc0a3a476b2575d9cd316feb86b6d038ff5afcf61a2e03f181eb70016"} Mar 16 17:09:16 crc kubenswrapper[5120]: I0316 17:09:16.283000 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:09:16 crc kubenswrapper[5120]: I0316 17:09:16.286993 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:09:16 crc kubenswrapper[5120]: I0316 17:09:16.318878 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=1.869265722 podStartE2EDuration="7.318859189s" podCreationTimestamp="2026-03-16 17:09:09 +0000 UTC" firstStartedPulling="2026-03-16 17:09:10.269236365 +0000 UTC m=+5852.423168022" lastFinishedPulling="2026-03-16 17:09:15.718829832 +0000 UTC m=+5857.872761489" observedRunningTime="2026-03-16 17:09:16.312346498 +0000 UTC m=+5858.466278185" watchObservedRunningTime="2026-03-16 17:09:16.318859189 +0000 UTC m=+5858.472790846" Mar 16 17:09:16 crc kubenswrapper[5120]: I0316 17:09:16.394730 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-58664f4b7c-kc5rb"] Mar 16 17:09:16 crc kubenswrapper[5120]: I0316 17:09:16.436946 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:09:16 crc kubenswrapper[5120]: W0316 17:09:16.454817 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod01e18a65_5476_4eea_8420_5f6bc6f93cca.slice/crio-609259a42caf1a0215d002ced89e270e2f25f0e046ea3b96d979285462783204 WatchSource:0}: Error finding container 609259a42caf1a0215d002ced89e270e2f25f0e046ea3b96d979285462783204: Status 404 returned error can't find the container with id 609259a42caf1a0215d002ced89e270e2f25f0e046ea3b96d979285462783204 Mar 16 17:09:16 crc kubenswrapper[5120]: I0316 17:09:16.686995 5120 scope.go:117] "RemoveContainer" containerID="5113d15f8f41624447f1bdf582aecad1fb1c48fe4cd626381d844607c1670c0e" Mar 16 17:09:16 crc kubenswrapper[5120]: E0316 17:09:16.687937 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nova-cell0-conductor-conductor\" with CrashLoopBackOff: \"back-off 20s restarting failed container=nova-cell0-conductor-conductor pod=nova-cell0-conductor-0_openstack-kuttl-tests(9a997459-37ba-46a9-9cb8-075f77fa009f)\"" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="9a997459-37ba-46a9-9cb8-075f77fa009f" Mar 16 17:09:17 crc kubenswrapper[5120]: I0316 17:09:17.314067 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"15200613-4843-450f-bf1e-e7b152c48f43","Type":"ContainerStarted","Data":"f81997cba70489fb4a04b4ded448fff5d95a78a49c18354c122428489333973f"} Mar 16 17:09:17 crc kubenswrapper[5120]: I0316 17:09:17.326985 5120 generic.go:358] "Generic (PLEG): container finished" podID="01e18a65-5476-4eea-8420-5f6bc6f93cca" containerID="0a66e01db218811985b3e366c62db997c484029b1550da063a5173bd9d23a881" exitCode=0 Mar 16 17:09:17 crc kubenswrapper[5120]: I0316 17:09:17.327163 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58664f4b7c-kc5rb" event={"ID":"01e18a65-5476-4eea-8420-5f6bc6f93cca","Type":"ContainerDied","Data":"0a66e01db218811985b3e366c62db997c484029b1550da063a5173bd9d23a881"} Mar 16 17:09:17 crc kubenswrapper[5120]: I0316 17:09:17.327255 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58664f4b7c-kc5rb" event={"ID":"01e18a65-5476-4eea-8420-5f6bc6f93cca","Type":"ContainerStarted","Data":"609259a42caf1a0215d002ced89e270e2f25f0e046ea3b96d979285462783204"} Mar 16 17:09:17 crc kubenswrapper[5120]: I0316 17:09:17.361354 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-external-api-0" podStartSLOduration=35.361334757 podStartE2EDuration="35.361334757s" podCreationTimestamp="2026-03-16 17:08:42 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:09:17.360700089 +0000 UTC m=+5859.514631766" watchObservedRunningTime="2026-03-16 17:09:17.361334757 +0000 UTC m=+5859.515266414" Mar 16 17:09:17 crc kubenswrapper[5120]: I0316 17:09:17.443923 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-b95589884-bsqwd" podUID="040d2221-969e-4e00-8097-340b3c4a1b43" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.1.184:9311/healthcheck\": read tcp 10.217.0.2:45376->10.217.1.184:9311: read: connection reset by peer" Mar 16 17:09:17 crc kubenswrapper[5120]: I0316 17:09:17.808711 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-b95589884-bsqwd" Mar 16 17:09:17 crc kubenswrapper[5120]: I0316 17:09:17.859544 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/040d2221-969e-4e00-8097-340b3c4a1b43-combined-ca-bundle\") pod \"040d2221-969e-4e00-8097-340b3c4a1b43\" (UID: \"040d2221-969e-4e00-8097-340b3c4a1b43\") " Mar 16 17:09:17 crc kubenswrapper[5120]: I0316 17:09:17.859940 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/040d2221-969e-4e00-8097-340b3c4a1b43-logs\") pod \"040d2221-969e-4e00-8097-340b3c4a1b43\" (UID: \"040d2221-969e-4e00-8097-340b3c4a1b43\") " Mar 16 17:09:17 crc kubenswrapper[5120]: I0316 17:09:17.860572 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/040d2221-969e-4e00-8097-340b3c4a1b43-internal-tls-certs\") pod \"040d2221-969e-4e00-8097-340b3c4a1b43\" (UID: \"040d2221-969e-4e00-8097-340b3c4a1b43\") " Mar 16 17:09:17 crc kubenswrapper[5120]: I0316 17:09:17.860616 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/040d2221-969e-4e00-8097-340b3c4a1b43-config-data\") pod \"040d2221-969e-4e00-8097-340b3c4a1b43\" (UID: \"040d2221-969e-4e00-8097-340b3c4a1b43\") " Mar 16 17:09:17 crc kubenswrapper[5120]: I0316 17:09:17.860656 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/040d2221-969e-4e00-8097-340b3c4a1b43-config-data-custom\") pod \"040d2221-969e-4e00-8097-340b3c4a1b43\" (UID: \"040d2221-969e-4e00-8097-340b3c4a1b43\") " Mar 16 17:09:17 crc kubenswrapper[5120]: I0316 17:09:17.860717 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/040d2221-969e-4e00-8097-340b3c4a1b43-public-tls-certs\") pod \"040d2221-969e-4e00-8097-340b3c4a1b43\" (UID: \"040d2221-969e-4e00-8097-340b3c4a1b43\") " Mar 16 17:09:17 crc kubenswrapper[5120]: I0316 17:09:17.860856 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lct49\" (UniqueName: \"kubernetes.io/projected/040d2221-969e-4e00-8097-340b3c4a1b43-kube-api-access-lct49\") pod \"040d2221-969e-4e00-8097-340b3c4a1b43\" (UID: \"040d2221-969e-4e00-8097-340b3c4a1b43\") " Mar 16 17:09:17 crc kubenswrapper[5120]: I0316 17:09:17.864870 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/040d2221-969e-4e00-8097-340b3c4a1b43-logs" (OuterVolumeSpecName: "logs") pod "040d2221-969e-4e00-8097-340b3c4a1b43" (UID: "040d2221-969e-4e00-8097-340b3c4a1b43"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:09:17 crc kubenswrapper[5120]: I0316 17:09:17.865097 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/040d2221-969e-4e00-8097-340b3c4a1b43-logs\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:17 crc kubenswrapper[5120]: I0316 17:09:17.868920 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/040d2221-969e-4e00-8097-340b3c4a1b43-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "040d2221-969e-4e00-8097-340b3c4a1b43" (UID: "040d2221-969e-4e00-8097-340b3c4a1b43"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:09:17 crc kubenswrapper[5120]: I0316 17:09:17.870217 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/040d2221-969e-4e00-8097-340b3c4a1b43-kube-api-access-lct49" (OuterVolumeSpecName: "kube-api-access-lct49") pod "040d2221-969e-4e00-8097-340b3c4a1b43" (UID: "040d2221-969e-4e00-8097-340b3c4a1b43"). InnerVolumeSpecName "kube-api-access-lct49". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:09:17 crc kubenswrapper[5120]: I0316 17:09:17.894940 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/040d2221-969e-4e00-8097-340b3c4a1b43-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "040d2221-969e-4e00-8097-340b3c4a1b43" (UID: "040d2221-969e-4e00-8097-340b3c4a1b43"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:09:17 crc kubenswrapper[5120]: I0316 17:09:17.945887 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/040d2221-969e-4e00-8097-340b3c4a1b43-config-data" (OuterVolumeSpecName: "config-data") pod "040d2221-969e-4e00-8097-340b3c4a1b43" (UID: "040d2221-969e-4e00-8097-340b3c4a1b43"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:09:17 crc kubenswrapper[5120]: I0316 17:09:17.957423 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/040d2221-969e-4e00-8097-340b3c4a1b43-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "040d2221-969e-4e00-8097-340b3c4a1b43" (UID: "040d2221-969e-4e00-8097-340b3c4a1b43"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:09:17 crc kubenswrapper[5120]: I0316 17:09:17.960822 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/040d2221-969e-4e00-8097-340b3c4a1b43-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "040d2221-969e-4e00-8097-340b3c4a1b43" (UID: "040d2221-969e-4e00-8097-340b3c4a1b43"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:09:17 crc kubenswrapper[5120]: I0316 17:09:17.967415 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:09:17 crc kubenswrapper[5120]: I0316 17:09:17.968543 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/040d2221-969e-4e00-8097-340b3c4a1b43-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:17 crc kubenswrapper[5120]: I0316 17:09:17.969288 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/040d2221-969e-4e00-8097-340b3c4a1b43-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:17 crc kubenswrapper[5120]: I0316 17:09:17.969412 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/040d2221-969e-4e00-8097-340b3c4a1b43-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:17 crc kubenswrapper[5120]: I0316 17:09:17.969502 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/040d2221-969e-4e00-8097-340b3c4a1b43-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:17 crc kubenswrapper[5120]: I0316 17:09:17.969608 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lct49\" (UniqueName: \"kubernetes.io/projected/040d2221-969e-4e00-8097-340b3c4a1b43-kube-api-access-lct49\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:17 crc kubenswrapper[5120]: I0316 17:09:17.969702 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/040d2221-969e-4e00-8097-340b3c4a1b43-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:18 crc kubenswrapper[5120]: I0316 17:09:18.339071 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58664f4b7c-kc5rb" event={"ID":"01e18a65-5476-4eea-8420-5f6bc6f93cca","Type":"ContainerStarted","Data":"176db03fd6cd831432d9130458bd0779446d5f6b6eb96185d80dce91e5075fc5"} Mar 16 17:09:18 crc kubenswrapper[5120]: I0316 17:09:18.339150 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58664f4b7c-kc5rb" Mar 16 17:09:18 crc kubenswrapper[5120]: I0316 17:09:18.343060 5120 generic.go:358] "Generic (PLEG): container finished" podID="040d2221-969e-4e00-8097-340b3c4a1b43" containerID="7bc5f449c2736601b6112b4a1aa0bd4ded20f0647daa7dca214d9f4a87b1e680" exitCode=0 Mar 16 17:09:18 crc kubenswrapper[5120]: I0316 17:09:18.343117 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-b95589884-bsqwd" event={"ID":"040d2221-969e-4e00-8097-340b3c4a1b43","Type":"ContainerDied","Data":"7bc5f449c2736601b6112b4a1aa0bd4ded20f0647daa7dca214d9f4a87b1e680"} Mar 16 17:09:18 crc kubenswrapper[5120]: I0316 17:09:18.343165 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-b95589884-bsqwd" Mar 16 17:09:18 crc kubenswrapper[5120]: I0316 17:09:18.343175 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-b95589884-bsqwd" event={"ID":"040d2221-969e-4e00-8097-340b3c4a1b43","Type":"ContainerDied","Data":"b13a7cc96752773178f5fa8323baa006c7ceae9ccbd1738c628f2a229f9ec4ee"} Mar 16 17:09:18 crc kubenswrapper[5120]: I0316 17:09:18.343197 5120 scope.go:117] "RemoveContainer" containerID="7bc5f449c2736601b6112b4a1aa0bd4ded20f0647daa7dca214d9f4a87b1e680" Mar 16 17:09:18 crc kubenswrapper[5120]: I0316 17:09:18.362881 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58664f4b7c-kc5rb" podStartSLOduration=3.362555805 podStartE2EDuration="3.362555805s" podCreationTimestamp="2026-03-16 17:09:15 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:09:18.357805734 +0000 UTC m=+5860.511737401" watchObservedRunningTime="2026-03-16 17:09:18.362555805 +0000 UTC m=+5860.516487462" Mar 16 17:09:18 crc kubenswrapper[5120]: I0316 17:09:18.371001 5120 scope.go:117] "RemoveContainer" containerID="d932a84914494f64428fea8a34e2f4f28444bbf97f75dac7e239cbfae42f21ad" Mar 16 17:09:18 crc kubenswrapper[5120]: I0316 17:09:18.395042 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-b95589884-bsqwd"] Mar 16 17:09:18 crc kubenswrapper[5120]: I0316 17:09:18.397549 5120 scope.go:117] "RemoveContainer" containerID="7bc5f449c2736601b6112b4a1aa0bd4ded20f0647daa7dca214d9f4a87b1e680" Mar 16 17:09:18 crc kubenswrapper[5120]: E0316 17:09:18.400525 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7bc5f449c2736601b6112b4a1aa0bd4ded20f0647daa7dca214d9f4a87b1e680\": container with ID starting with 7bc5f449c2736601b6112b4a1aa0bd4ded20f0647daa7dca214d9f4a87b1e680 not found: ID does not exist" containerID="7bc5f449c2736601b6112b4a1aa0bd4ded20f0647daa7dca214d9f4a87b1e680" Mar 16 17:09:18 crc kubenswrapper[5120]: I0316 17:09:18.400735 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7bc5f449c2736601b6112b4a1aa0bd4ded20f0647daa7dca214d9f4a87b1e680"} err="failed to get container status \"7bc5f449c2736601b6112b4a1aa0bd4ded20f0647daa7dca214d9f4a87b1e680\": rpc error: code = NotFound desc = could not find container \"7bc5f449c2736601b6112b4a1aa0bd4ded20f0647daa7dca214d9f4a87b1e680\": container with ID starting with 7bc5f449c2736601b6112b4a1aa0bd4ded20f0647daa7dca214d9f4a87b1e680 not found: ID does not exist" Mar 16 17:09:18 crc kubenswrapper[5120]: I0316 17:09:18.400939 5120 scope.go:117] "RemoveContainer" containerID="d932a84914494f64428fea8a34e2f4f28444bbf97f75dac7e239cbfae42f21ad" Mar 16 17:09:18 crc kubenswrapper[5120]: E0316 17:09:18.401542 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d932a84914494f64428fea8a34e2f4f28444bbf97f75dac7e239cbfae42f21ad\": container with ID starting with d932a84914494f64428fea8a34e2f4f28444bbf97f75dac7e239cbfae42f21ad not found: ID does not exist" containerID="d932a84914494f64428fea8a34e2f4f28444bbf97f75dac7e239cbfae42f21ad" Mar 16 17:09:18 crc kubenswrapper[5120]: I0316 17:09:18.401666 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d932a84914494f64428fea8a34e2f4f28444bbf97f75dac7e239cbfae42f21ad"} err="failed to get container status \"d932a84914494f64428fea8a34e2f4f28444bbf97f75dac7e239cbfae42f21ad\": rpc error: code = NotFound desc = could not find container \"d932a84914494f64428fea8a34e2f4f28444bbf97f75dac7e239cbfae42f21ad\": container with ID starting with d932a84914494f64428fea8a34e2f4f28444bbf97f75dac7e239cbfae42f21ad not found: ID does not exist" Mar 16 17:09:18 crc kubenswrapper[5120]: I0316 17:09:18.406801 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-api-b95589884-bsqwd"] Mar 16 17:09:18 crc kubenswrapper[5120]: I0316 17:09:18.677193 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="040d2221-969e-4e00-8097-340b3c4a1b43" path="/var/lib/kubelet/pods/040d2221-969e-4e00-8097-340b3c4a1b43/volumes" Mar 16 17:09:19 crc kubenswrapper[5120]: I0316 17:09:19.211656 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/memcached-0" Mar 16 17:09:19 crc kubenswrapper[5120]: I0316 17:09:19.260782 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 17:09:19 crc kubenswrapper[5120]: I0316 17:09:19.357853 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/memcached-0" podUID="10bd837b-2e0d-460b-a254-20e23b6768f7" containerName="memcached" containerID="cri-o://e19ce5213f51e39d0fe500fc1b09e0c84e9115038d851fdb05d0763df81163f5" gracePeriod=30 Mar 16 17:09:19 crc kubenswrapper[5120]: I0316 17:09:19.363821 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 17:09:19 crc kubenswrapper[5120]: I0316 17:09:19.364751 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="15200613-4843-450f-bf1e-e7b152c48f43" containerName="glance-log" containerID="cri-o://66729d307f3c4ae64259d7994cb8ba5065ef7054bad2bce3f0f8c35286a85348" gracePeriod=30 Mar 16 17:09:19 crc kubenswrapper[5120]: I0316 17:09:19.364892 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="15200613-4843-450f-bf1e-e7b152c48f43" containerName="glance-httpd" containerID="cri-o://f81997cba70489fb4a04b4ded448fff5d95a78a49c18354c122428489333973f" gracePeriod=30 Mar 16 17:09:19 crc kubenswrapper[5120]: I0316 17:09:19.451981 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 17:09:19 crc kubenswrapper[5120]: I0316 17:09:19.452396 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="69bb2342-14e1-4c32-889a-e33f6ba42651" containerName="nova-api-log" containerID="cri-o://da449289366bc4a4a5ae59798a3049978cb54421e9beeb0f8d61e84b89a25756" gracePeriod=30 Mar 16 17:09:19 crc kubenswrapper[5120]: I0316 17:09:19.452494 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="69bb2342-14e1-4c32-889a-e33f6ba42651" containerName="nova-api-api" containerID="cri-o://c7f0ec29ac153c1aa743c1495484bf9605c92e2cea32e4a9b49c14f6df61dfbe" gracePeriod=30 Mar 16 17:09:19 crc kubenswrapper[5120]: I0316 17:09:19.471901 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 17:09:19 crc kubenswrapper[5120]: I0316 17:09:19.472243 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podUID="eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3" containerName="nova-cell1-novncproxy-novncproxy" containerID="cri-o://9f702367fcb8fdb15ed6ae2bb41db1c73e6750e39028c97bce0790061b8107b4" gracePeriod=30 Mar 16 17:09:19 crc kubenswrapper[5120]: I0316 17:09:19.498669 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 17:09:19 crc kubenswrapper[5120]: I0316 17:09:19.499114 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="431c87cc-4a05-421e-a7d6-74fa09328220" containerName="glance-log" containerID="cri-o://cbd76d8c28f83ef8bd43cd5bd6f08ee3a70f86373be2df33f85e4b2f6e009395" gracePeriod=30 Mar 16 17:09:19 crc kubenswrapper[5120]: I0316 17:09:19.499698 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="431c87cc-4a05-421e-a7d6-74fa09328220" containerName="glance-httpd" containerID="cri-o://33661e25e8fa4b583a11c440c5312f2c3e50e752530fcc9b7fd8fcd89222eb0b" gracePeriod=30 Mar 16 17:09:19 crc kubenswrapper[5120]: I0316 17:09:19.529865 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 17:09:19 crc kubenswrapper[5120]: I0316 17:09:19.530283 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="dfe74d0c-e886-4057-8cb1-0bdb487b317c" containerName="nova-cell1-conductor-conductor" containerID="cri-o://f68243cf4325c812ddc49bff1063df157769dc8e1e0e4bf7bb8137f1da918e6d" gracePeriod=30 Mar 16 17:09:19 crc kubenswrapper[5120]: I0316 17:09:19.582832 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-75fdb7754b-cb728"] Mar 16 17:09:19 crc kubenswrapper[5120]: I0316 17:09:19.584221 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="040d2221-969e-4e00-8097-340b3c4a1b43" containerName="barbican-api-log" Mar 16 17:09:19 crc kubenswrapper[5120]: I0316 17:09:19.584234 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="040d2221-969e-4e00-8097-340b3c4a1b43" containerName="barbican-api-log" Mar 16 17:09:19 crc kubenswrapper[5120]: I0316 17:09:19.584251 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="040d2221-969e-4e00-8097-340b3c4a1b43" containerName="barbican-api" Mar 16 17:09:19 crc kubenswrapper[5120]: I0316 17:09:19.584258 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="040d2221-969e-4e00-8097-340b3c4a1b43" containerName="barbican-api" Mar 16 17:09:19 crc kubenswrapper[5120]: I0316 17:09:19.584477 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="040d2221-969e-4e00-8097-340b3c4a1b43" containerName="barbican-api" Mar 16 17:09:19 crc kubenswrapper[5120]: I0316 17:09:19.584498 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="040d2221-969e-4e00-8097-340b3c4a1b43" containerName="barbican-api-log" Mar 16 17:09:19 crc kubenswrapper[5120]: I0316 17:09:19.600485 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-75fdb7754b-cb728" Mar 16 17:09:19 crc kubenswrapper[5120]: I0316 17:09:19.627916 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-64b7569b94-dxks6"] Mar 16 17:09:19 crc kubenswrapper[5120]: I0316 17:09:19.628201 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-64b7569b94-dxks6" podUID="76f0322f-b14b-4b9b-9665-2121e3b21629" containerName="neutron-api" containerID="cri-o://598d399875f1007c74ffb9a295384b67e42baa6c19d61a3bd91b82a9c3db6ecc" gracePeriod=30 Mar 16 17:09:19 crc kubenswrapper[5120]: I0316 17:09:19.628685 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-64b7569b94-dxks6" podUID="76f0322f-b14b-4b9b-9665-2121e3b21629" containerName="neutron-httpd" containerID="cri-o://805349fcd73b71b77e0d612190a603fe69577f038e1cf9b0cd22a2788eaabb4f" gracePeriod=30 Mar 16 17:09:19 crc kubenswrapper[5120]: I0316 17:09:19.655362 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-75fdb7754b-cb728"] Mar 16 17:09:19 crc kubenswrapper[5120]: I0316 17:09:19.685128 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-6448f564f4-flpdw"] Mar 16 17:09:19 crc kubenswrapper[5120]: I0316 17:09:19.756794 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/neutron-64b7569b94-dxks6" Mar 16 17:09:19 crc kubenswrapper[5120]: I0316 17:09:19.760233 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-6448f564f4-flpdw"] Mar 16 17:09:19 crc kubenswrapper[5120]: I0316 17:09:19.760322 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-6448f564f4-flpdw" Mar 16 17:09:19 crc kubenswrapper[5120]: I0316 17:09:19.805659 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a1b86673-6678-41ee-b073-f44c6d447fbc-combined-ca-bundle\") pod \"keystone-75fdb7754b-cb728\" (UID: \"a1b86673-6678-41ee-b073-f44c6d447fbc\") " pod="openstack-kuttl-tests/keystone-75fdb7754b-cb728" Mar 16 17:09:19 crc kubenswrapper[5120]: I0316 17:09:19.805790 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/a1b86673-6678-41ee-b073-f44c6d447fbc-public-tls-certs\") pod \"keystone-75fdb7754b-cb728\" (UID: \"a1b86673-6678-41ee-b073-f44c6d447fbc\") " pod="openstack-kuttl-tests/keystone-75fdb7754b-cb728" Mar 16 17:09:19 crc kubenswrapper[5120]: I0316 17:09:19.805855 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/a1b86673-6678-41ee-b073-f44c6d447fbc-fernet-keys\") pod \"keystone-75fdb7754b-cb728\" (UID: \"a1b86673-6678-41ee-b073-f44c6d447fbc\") " pod="openstack-kuttl-tests/keystone-75fdb7754b-cb728" Mar 16 17:09:19 crc kubenswrapper[5120]: I0316 17:09:19.805933 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/a1b86673-6678-41ee-b073-f44c6d447fbc-internal-tls-certs\") pod \"keystone-75fdb7754b-cb728\" (UID: \"a1b86673-6678-41ee-b073-f44c6d447fbc\") " pod="openstack-kuttl-tests/keystone-75fdb7754b-cb728" Mar 16 17:09:19 crc kubenswrapper[5120]: I0316 17:09:19.806050 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/a1b86673-6678-41ee-b073-f44c6d447fbc-credential-keys\") pod \"keystone-75fdb7754b-cb728\" (UID: \"a1b86673-6678-41ee-b073-f44c6d447fbc\") " pod="openstack-kuttl-tests/keystone-75fdb7754b-cb728" Mar 16 17:09:19 crc kubenswrapper[5120]: I0316 17:09:19.806143 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a1b86673-6678-41ee-b073-f44c6d447fbc-config-data\") pod \"keystone-75fdb7754b-cb728\" (UID: \"a1b86673-6678-41ee-b073-f44c6d447fbc\") " pod="openstack-kuttl-tests/keystone-75fdb7754b-cb728" Mar 16 17:09:19 crc kubenswrapper[5120]: I0316 17:09:19.806206 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a1b86673-6678-41ee-b073-f44c6d447fbc-scripts\") pod \"keystone-75fdb7754b-cb728\" (UID: \"a1b86673-6678-41ee-b073-f44c6d447fbc\") " pod="openstack-kuttl-tests/keystone-75fdb7754b-cb728" Mar 16 17:09:19 crc kubenswrapper[5120]: I0316 17:09:19.807308 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2c6mq\" (UniqueName: \"kubernetes.io/projected/a1b86673-6678-41ee-b073-f44c6d447fbc-kube-api-access-2c6mq\") pod \"keystone-75fdb7754b-cb728\" (UID: \"a1b86673-6678-41ee-b073-f44c6d447fbc\") " pod="openstack-kuttl-tests/keystone-75fdb7754b-cb728" Mar 16 17:09:19 crc kubenswrapper[5120]: I0316 17:09:19.910413 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2c6mq\" (UniqueName: \"kubernetes.io/projected/a1b86673-6678-41ee-b073-f44c6d447fbc-kube-api-access-2c6mq\") pod \"keystone-75fdb7754b-cb728\" (UID: \"a1b86673-6678-41ee-b073-f44c6d447fbc\") " pod="openstack-kuttl-tests/keystone-75fdb7754b-cb728" Mar 16 17:09:19 crc kubenswrapper[5120]: I0316 17:09:19.910482 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/3e60d330-61c0-4a9b-ac47-b35f12e5fd66-internal-tls-certs\") pod \"neutron-6448f564f4-flpdw\" (UID: \"3e60d330-61c0-4a9b-ac47-b35f12e5fd66\") " pod="openstack-kuttl-tests/neutron-6448f564f4-flpdw" Mar 16 17:09:19 crc kubenswrapper[5120]: I0316 17:09:19.910547 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3e60d330-61c0-4a9b-ac47-b35f12e5fd66-config\") pod \"neutron-6448f564f4-flpdw\" (UID: \"3e60d330-61c0-4a9b-ac47-b35f12e5fd66\") " pod="openstack-kuttl-tests/neutron-6448f564f4-flpdw" Mar 16 17:09:19 crc kubenswrapper[5120]: I0316 17:09:19.910638 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/3e60d330-61c0-4a9b-ac47-b35f12e5fd66-httpd-config\") pod \"neutron-6448f564f4-flpdw\" (UID: \"3e60d330-61c0-4a9b-ac47-b35f12e5fd66\") " pod="openstack-kuttl-tests/neutron-6448f564f4-flpdw" Mar 16 17:09:19 crc kubenswrapper[5120]: I0316 17:09:19.910725 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/3e60d330-61c0-4a9b-ac47-b35f12e5fd66-public-tls-certs\") pod \"neutron-6448f564f4-flpdw\" (UID: \"3e60d330-61c0-4a9b-ac47-b35f12e5fd66\") " pod="openstack-kuttl-tests/neutron-6448f564f4-flpdw" Mar 16 17:09:19 crc kubenswrapper[5120]: I0316 17:09:19.910928 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3e60d330-61c0-4a9b-ac47-b35f12e5fd66-combined-ca-bundle\") pod \"neutron-6448f564f4-flpdw\" (UID: \"3e60d330-61c0-4a9b-ac47-b35f12e5fd66\") " pod="openstack-kuttl-tests/neutron-6448f564f4-flpdw" Mar 16 17:09:19 crc kubenswrapper[5120]: I0316 17:09:19.911000 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a1b86673-6678-41ee-b073-f44c6d447fbc-combined-ca-bundle\") pod \"keystone-75fdb7754b-cb728\" (UID: \"a1b86673-6678-41ee-b073-f44c6d447fbc\") " pod="openstack-kuttl-tests/keystone-75fdb7754b-cb728" Mar 16 17:09:19 crc kubenswrapper[5120]: I0316 17:09:19.911031 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/a1b86673-6678-41ee-b073-f44c6d447fbc-public-tls-certs\") pod \"keystone-75fdb7754b-cb728\" (UID: \"a1b86673-6678-41ee-b073-f44c6d447fbc\") " pod="openstack-kuttl-tests/keystone-75fdb7754b-cb728" Mar 16 17:09:19 crc kubenswrapper[5120]: I0316 17:09:19.911094 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/a1b86673-6678-41ee-b073-f44c6d447fbc-fernet-keys\") pod \"keystone-75fdb7754b-cb728\" (UID: \"a1b86673-6678-41ee-b073-f44c6d447fbc\") " pod="openstack-kuttl-tests/keystone-75fdb7754b-cb728" Mar 16 17:09:19 crc kubenswrapper[5120]: I0316 17:09:19.911368 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/a1b86673-6678-41ee-b073-f44c6d447fbc-internal-tls-certs\") pod \"keystone-75fdb7754b-cb728\" (UID: \"a1b86673-6678-41ee-b073-f44c6d447fbc\") " pod="openstack-kuttl-tests/keystone-75fdb7754b-cb728" Mar 16 17:09:19 crc kubenswrapper[5120]: I0316 17:09:19.911429 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qvr8\" (UniqueName: \"kubernetes.io/projected/3e60d330-61c0-4a9b-ac47-b35f12e5fd66-kube-api-access-4qvr8\") pod \"neutron-6448f564f4-flpdw\" (UID: \"3e60d330-61c0-4a9b-ac47-b35f12e5fd66\") " pod="openstack-kuttl-tests/neutron-6448f564f4-flpdw" Mar 16 17:09:19 crc kubenswrapper[5120]: I0316 17:09:19.911538 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/a1b86673-6678-41ee-b073-f44c6d447fbc-credential-keys\") pod \"keystone-75fdb7754b-cb728\" (UID: \"a1b86673-6678-41ee-b073-f44c6d447fbc\") " pod="openstack-kuttl-tests/keystone-75fdb7754b-cb728" Mar 16 17:09:19 crc kubenswrapper[5120]: I0316 17:09:19.911653 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a1b86673-6678-41ee-b073-f44c6d447fbc-config-data\") pod \"keystone-75fdb7754b-cb728\" (UID: \"a1b86673-6678-41ee-b073-f44c6d447fbc\") " pod="openstack-kuttl-tests/keystone-75fdb7754b-cb728" Mar 16 17:09:19 crc kubenswrapper[5120]: I0316 17:09:19.911715 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/3e60d330-61c0-4a9b-ac47-b35f12e5fd66-ovndb-tls-certs\") pod \"neutron-6448f564f4-flpdw\" (UID: \"3e60d330-61c0-4a9b-ac47-b35f12e5fd66\") " pod="openstack-kuttl-tests/neutron-6448f564f4-flpdw" Mar 16 17:09:19 crc kubenswrapper[5120]: I0316 17:09:19.913233 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a1b86673-6678-41ee-b073-f44c6d447fbc-scripts\") pod \"keystone-75fdb7754b-cb728\" (UID: \"a1b86673-6678-41ee-b073-f44c6d447fbc\") " pod="openstack-kuttl-tests/keystone-75fdb7754b-cb728" Mar 16 17:09:19 crc kubenswrapper[5120]: I0316 17:09:19.920806 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/a1b86673-6678-41ee-b073-f44c6d447fbc-credential-keys\") pod \"keystone-75fdb7754b-cb728\" (UID: \"a1b86673-6678-41ee-b073-f44c6d447fbc\") " pod="openstack-kuttl-tests/keystone-75fdb7754b-cb728" Mar 16 17:09:19 crc kubenswrapper[5120]: I0316 17:09:19.921013 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a1b86673-6678-41ee-b073-f44c6d447fbc-config-data\") pod \"keystone-75fdb7754b-cb728\" (UID: \"a1b86673-6678-41ee-b073-f44c6d447fbc\") " pod="openstack-kuttl-tests/keystone-75fdb7754b-cb728" Mar 16 17:09:19 crc kubenswrapper[5120]: I0316 17:09:19.921063 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a1b86673-6678-41ee-b073-f44c6d447fbc-scripts\") pod \"keystone-75fdb7754b-cb728\" (UID: \"a1b86673-6678-41ee-b073-f44c6d447fbc\") " pod="openstack-kuttl-tests/keystone-75fdb7754b-cb728" Mar 16 17:09:19 crc kubenswrapper[5120]: I0316 17:09:19.923555 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/a1b86673-6678-41ee-b073-f44c6d447fbc-public-tls-certs\") pod \"keystone-75fdb7754b-cb728\" (UID: \"a1b86673-6678-41ee-b073-f44c6d447fbc\") " pod="openstack-kuttl-tests/keystone-75fdb7754b-cb728" Mar 16 17:09:19 crc kubenswrapper[5120]: I0316 17:09:19.923993 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a1b86673-6678-41ee-b073-f44c6d447fbc-combined-ca-bundle\") pod \"keystone-75fdb7754b-cb728\" (UID: \"a1b86673-6678-41ee-b073-f44c6d447fbc\") " pod="openstack-kuttl-tests/keystone-75fdb7754b-cb728" Mar 16 17:09:19 crc kubenswrapper[5120]: I0316 17:09:19.926561 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/a1b86673-6678-41ee-b073-f44c6d447fbc-fernet-keys\") pod \"keystone-75fdb7754b-cb728\" (UID: \"a1b86673-6678-41ee-b073-f44c6d447fbc\") " pod="openstack-kuttl-tests/keystone-75fdb7754b-cb728" Mar 16 17:09:19 crc kubenswrapper[5120]: I0316 17:09:19.930399 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/a1b86673-6678-41ee-b073-f44c6d447fbc-internal-tls-certs\") pod \"keystone-75fdb7754b-cb728\" (UID: \"a1b86673-6678-41ee-b073-f44c6d447fbc\") " pod="openstack-kuttl-tests/keystone-75fdb7754b-cb728" Mar 16 17:09:19 crc kubenswrapper[5120]: I0316 17:09:19.942424 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2c6mq\" (UniqueName: \"kubernetes.io/projected/a1b86673-6678-41ee-b073-f44c6d447fbc-kube-api-access-2c6mq\") pod \"keystone-75fdb7754b-cb728\" (UID: \"a1b86673-6678-41ee-b073-f44c6d447fbc\") " pod="openstack-kuttl-tests/keystone-75fdb7754b-cb728" Mar 16 17:09:19 crc kubenswrapper[5120]: I0316 17:09:19.993972 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-75fdb7754b-cb728" Mar 16 17:09:20 crc kubenswrapper[5120]: I0316 17:09:20.016545 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/3e60d330-61c0-4a9b-ac47-b35f12e5fd66-httpd-config\") pod \"neutron-6448f564f4-flpdw\" (UID: \"3e60d330-61c0-4a9b-ac47-b35f12e5fd66\") " pod="openstack-kuttl-tests/neutron-6448f564f4-flpdw" Mar 16 17:09:20 crc kubenswrapper[5120]: I0316 17:09:20.016678 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/3e60d330-61c0-4a9b-ac47-b35f12e5fd66-public-tls-certs\") pod \"neutron-6448f564f4-flpdw\" (UID: \"3e60d330-61c0-4a9b-ac47-b35f12e5fd66\") " pod="openstack-kuttl-tests/neutron-6448f564f4-flpdw" Mar 16 17:09:20 crc kubenswrapper[5120]: I0316 17:09:20.016905 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3e60d330-61c0-4a9b-ac47-b35f12e5fd66-combined-ca-bundle\") pod \"neutron-6448f564f4-flpdw\" (UID: \"3e60d330-61c0-4a9b-ac47-b35f12e5fd66\") " pod="openstack-kuttl-tests/neutron-6448f564f4-flpdw" Mar 16 17:09:20 crc kubenswrapper[5120]: I0316 17:09:20.017077 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4qvr8\" (UniqueName: \"kubernetes.io/projected/3e60d330-61c0-4a9b-ac47-b35f12e5fd66-kube-api-access-4qvr8\") pod \"neutron-6448f564f4-flpdw\" (UID: \"3e60d330-61c0-4a9b-ac47-b35f12e5fd66\") " pod="openstack-kuttl-tests/neutron-6448f564f4-flpdw" Mar 16 17:09:20 crc kubenswrapper[5120]: I0316 17:09:20.017287 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/3e60d330-61c0-4a9b-ac47-b35f12e5fd66-ovndb-tls-certs\") pod \"neutron-6448f564f4-flpdw\" (UID: \"3e60d330-61c0-4a9b-ac47-b35f12e5fd66\") " pod="openstack-kuttl-tests/neutron-6448f564f4-flpdw" Mar 16 17:09:20 crc kubenswrapper[5120]: I0316 17:09:20.017405 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/3e60d330-61c0-4a9b-ac47-b35f12e5fd66-internal-tls-certs\") pod \"neutron-6448f564f4-flpdw\" (UID: \"3e60d330-61c0-4a9b-ac47-b35f12e5fd66\") " pod="openstack-kuttl-tests/neutron-6448f564f4-flpdw" Mar 16 17:09:20 crc kubenswrapper[5120]: I0316 17:09:20.017478 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3e60d330-61c0-4a9b-ac47-b35f12e5fd66-config\") pod \"neutron-6448f564f4-flpdw\" (UID: \"3e60d330-61c0-4a9b-ac47-b35f12e5fd66\") " pod="openstack-kuttl-tests/neutron-6448f564f4-flpdw" Mar 16 17:09:20 crc kubenswrapper[5120]: I0316 17:09:20.022036 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/3e60d330-61c0-4a9b-ac47-b35f12e5fd66-httpd-config\") pod \"neutron-6448f564f4-flpdw\" (UID: \"3e60d330-61c0-4a9b-ac47-b35f12e5fd66\") " pod="openstack-kuttl-tests/neutron-6448f564f4-flpdw" Mar 16 17:09:20 crc kubenswrapper[5120]: I0316 17:09:20.024920 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/3e60d330-61c0-4a9b-ac47-b35f12e5fd66-ovndb-tls-certs\") pod \"neutron-6448f564f4-flpdw\" (UID: \"3e60d330-61c0-4a9b-ac47-b35f12e5fd66\") " pod="openstack-kuttl-tests/neutron-6448f564f4-flpdw" Mar 16 17:09:20 crc kubenswrapper[5120]: I0316 17:09:20.025295 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3e60d330-61c0-4a9b-ac47-b35f12e5fd66-combined-ca-bundle\") pod \"neutron-6448f564f4-flpdw\" (UID: \"3e60d330-61c0-4a9b-ac47-b35f12e5fd66\") " pod="openstack-kuttl-tests/neutron-6448f564f4-flpdw" Mar 16 17:09:20 crc kubenswrapper[5120]: I0316 17:09:20.026040 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/3e60d330-61c0-4a9b-ac47-b35f12e5fd66-public-tls-certs\") pod \"neutron-6448f564f4-flpdw\" (UID: \"3e60d330-61c0-4a9b-ac47-b35f12e5fd66\") " pod="openstack-kuttl-tests/neutron-6448f564f4-flpdw" Mar 16 17:09:20 crc kubenswrapper[5120]: I0316 17:09:20.026790 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/3e60d330-61c0-4a9b-ac47-b35f12e5fd66-config\") pod \"neutron-6448f564f4-flpdw\" (UID: \"3e60d330-61c0-4a9b-ac47-b35f12e5fd66\") " pod="openstack-kuttl-tests/neutron-6448f564f4-flpdw" Mar 16 17:09:20 crc kubenswrapper[5120]: I0316 17:09:20.038562 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/3e60d330-61c0-4a9b-ac47-b35f12e5fd66-internal-tls-certs\") pod \"neutron-6448f564f4-flpdw\" (UID: \"3e60d330-61c0-4a9b-ac47-b35f12e5fd66\") " pod="openstack-kuttl-tests/neutron-6448f564f4-flpdw" Mar 16 17:09:20 crc kubenswrapper[5120]: I0316 17:09:20.046876 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qvr8\" (UniqueName: \"kubernetes.io/projected/3e60d330-61c0-4a9b-ac47-b35f12e5fd66-kube-api-access-4qvr8\") pod \"neutron-6448f564f4-flpdw\" (UID: \"3e60d330-61c0-4a9b-ac47-b35f12e5fd66\") " pod="openstack-kuttl-tests/neutron-6448f564f4-flpdw" Mar 16 17:09:20 crc kubenswrapper[5120]: E0316 17:09:20.096285 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="f68243cf4325c812ddc49bff1063df157769dc8e1e0e4bf7bb8137f1da918e6d" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 17:09:20 crc kubenswrapper[5120]: E0316 17:09:20.110872 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="f68243cf4325c812ddc49bff1063df157769dc8e1e0e4bf7bb8137f1da918e6d" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 17:09:20 crc kubenswrapper[5120]: E0316 17:09:20.117484 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="f68243cf4325c812ddc49bff1063df157769dc8e1e0e4bf7bb8137f1da918e6d" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 17:09:20 crc kubenswrapper[5120]: E0316 17:09:20.117542 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="dfe74d0c-e886-4057-8cb1-0bdb487b317c" containerName="nova-cell1-conductor-conductor" probeResult="unknown" Mar 16 17:09:20 crc kubenswrapper[5120]: I0316 17:09:20.174424 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-6448f564f4-flpdw" Mar 16 17:09:20 crc kubenswrapper[5120]: I0316 17:09:20.417414 5120 generic.go:358] "Generic (PLEG): container finished" podID="15200613-4843-450f-bf1e-e7b152c48f43" containerID="f81997cba70489fb4a04b4ded448fff5d95a78a49c18354c122428489333973f" exitCode=0 Mar 16 17:09:20 crc kubenswrapper[5120]: I0316 17:09:20.417731 5120 generic.go:358] "Generic (PLEG): container finished" podID="15200613-4843-450f-bf1e-e7b152c48f43" containerID="66729d307f3c4ae64259d7994cb8ba5065ef7054bad2bce3f0f8c35286a85348" exitCode=143 Mar 16 17:09:20 crc kubenswrapper[5120]: I0316 17:09:20.418001 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"15200613-4843-450f-bf1e-e7b152c48f43","Type":"ContainerDied","Data":"f81997cba70489fb4a04b4ded448fff5d95a78a49c18354c122428489333973f"} Mar 16 17:09:20 crc kubenswrapper[5120]: I0316 17:09:20.418027 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"15200613-4843-450f-bf1e-e7b152c48f43","Type":"ContainerDied","Data":"66729d307f3c4ae64259d7994cb8ba5065ef7054bad2bce3f0f8c35286a85348"} Mar 16 17:09:20 crc kubenswrapper[5120]: I0316 17:09:20.438156 5120 generic.go:358] "Generic (PLEG): container finished" podID="76f0322f-b14b-4b9b-9665-2121e3b21629" containerID="805349fcd73b71b77e0d612190a603fe69577f038e1cf9b0cd22a2788eaabb4f" exitCode=0 Mar 16 17:09:20 crc kubenswrapper[5120]: I0316 17:09:20.438417 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-64b7569b94-dxks6" event={"ID":"76f0322f-b14b-4b9b-9665-2121e3b21629","Type":"ContainerDied","Data":"805349fcd73b71b77e0d612190a603fe69577f038e1cf9b0cd22a2788eaabb4f"} Mar 16 17:09:20 crc kubenswrapper[5120]: I0316 17:09:20.455467 5120 generic.go:358] "Generic (PLEG): container finished" podID="431c87cc-4a05-421e-a7d6-74fa09328220" containerID="cbd76d8c28f83ef8bd43cd5bd6f08ee3a70f86373be2df33f85e4b2f6e009395" exitCode=143 Mar 16 17:09:20 crc kubenswrapper[5120]: I0316 17:09:20.455660 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"431c87cc-4a05-421e-a7d6-74fa09328220","Type":"ContainerDied","Data":"cbd76d8c28f83ef8bd43cd5bd6f08ee3a70f86373be2df33f85e4b2f6e009395"} Mar 16 17:09:20 crc kubenswrapper[5120]: I0316 17:09:20.465895 5120 generic.go:358] "Generic (PLEG): container finished" podID="eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3" containerID="9f702367fcb8fdb15ed6ae2bb41db1c73e6750e39028c97bce0790061b8107b4" exitCode=0 Mar 16 17:09:20 crc kubenswrapper[5120]: I0316 17:09:20.466060 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3","Type":"ContainerDied","Data":"9f702367fcb8fdb15ed6ae2bb41db1c73e6750e39028c97bce0790061b8107b4"} Mar 16 17:09:20 crc kubenswrapper[5120]: I0316 17:09:20.475585 5120 generic.go:358] "Generic (PLEG): container finished" podID="69bb2342-14e1-4c32-889a-e33f6ba42651" containerID="da449289366bc4a4a5ae59798a3049978cb54421e9beeb0f8d61e84b89a25756" exitCode=143 Mar 16 17:09:20 crc kubenswrapper[5120]: I0316 17:09:20.475672 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"69bb2342-14e1-4c32-889a-e33f6ba42651","Type":"ContainerDied","Data":"da449289366bc4a4a5ae59798a3049978cb54421e9beeb0f8d61e84b89a25756"} Mar 16 17:09:20 crc kubenswrapper[5120]: I0316 17:09:20.533232 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:09:20 crc kubenswrapper[5120]: I0316 17:09:20.638445 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/15200613-4843-450f-bf1e-e7b152c48f43-httpd-run\") pod \"15200613-4843-450f-bf1e-e7b152c48f43\" (UID: \"15200613-4843-450f-bf1e-e7b152c48f43\") " Mar 16 17:09:20 crc kubenswrapper[5120]: I0316 17:09:20.638718 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/15200613-4843-450f-bf1e-e7b152c48f43-config-data\") pod \"15200613-4843-450f-bf1e-e7b152c48f43\" (UID: \"15200613-4843-450f-bf1e-e7b152c48f43\") " Mar 16 17:09:20 crc kubenswrapper[5120]: I0316 17:09:20.638937 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/15200613-4843-450f-bf1e-e7b152c48f43-scripts\") pod \"15200613-4843-450f-bf1e-e7b152c48f43\" (UID: \"15200613-4843-450f-bf1e-e7b152c48f43\") " Mar 16 17:09:20 crc kubenswrapper[5120]: I0316 17:09:20.639114 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j6xl9\" (UniqueName: \"kubernetes.io/projected/15200613-4843-450f-bf1e-e7b152c48f43-kube-api-access-j6xl9\") pod \"15200613-4843-450f-bf1e-e7b152c48f43\" (UID: \"15200613-4843-450f-bf1e-e7b152c48f43\") " Mar 16 17:09:20 crc kubenswrapper[5120]: I0316 17:09:20.639401 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/15200613-4843-450f-bf1e-e7b152c48f43-combined-ca-bundle\") pod \"15200613-4843-450f-bf1e-e7b152c48f43\" (UID: \"15200613-4843-450f-bf1e-e7b152c48f43\") " Mar 16 17:09:20 crc kubenswrapper[5120]: I0316 17:09:20.639436 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/15200613-4843-450f-bf1e-e7b152c48f43-logs\") pod \"15200613-4843-450f-bf1e-e7b152c48f43\" (UID: \"15200613-4843-450f-bf1e-e7b152c48f43\") " Mar 16 17:09:20 crc kubenswrapper[5120]: I0316 17:09:20.639578 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"15200613-4843-450f-bf1e-e7b152c48f43\" (UID: \"15200613-4843-450f-bf1e-e7b152c48f43\") " Mar 16 17:09:20 crc kubenswrapper[5120]: I0316 17:09:20.639664 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/15200613-4843-450f-bf1e-e7b152c48f43-public-tls-certs\") pod \"15200613-4843-450f-bf1e-e7b152c48f43\" (UID: \"15200613-4843-450f-bf1e-e7b152c48f43\") " Mar 16 17:09:20 crc kubenswrapper[5120]: I0316 17:09:20.639677 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15200613-4843-450f-bf1e-e7b152c48f43-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "15200613-4843-450f-bf1e-e7b152c48f43" (UID: "15200613-4843-450f-bf1e-e7b152c48f43"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:09:20 crc kubenswrapper[5120]: I0316 17:09:20.639801 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15200613-4843-450f-bf1e-e7b152c48f43-logs" (OuterVolumeSpecName: "logs") pod "15200613-4843-450f-bf1e-e7b152c48f43" (UID: "15200613-4843-450f-bf1e-e7b152c48f43"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:09:20 crc kubenswrapper[5120]: I0316 17:09:20.640726 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/15200613-4843-450f-bf1e-e7b152c48f43-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:20 crc kubenswrapper[5120]: I0316 17:09:20.640748 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/15200613-4843-450f-bf1e-e7b152c48f43-logs\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:20 crc kubenswrapper[5120]: I0316 17:09:20.652923 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage05-crc" (OuterVolumeSpecName: "glance") pod "15200613-4843-450f-bf1e-e7b152c48f43" (UID: "15200613-4843-450f-bf1e-e7b152c48f43"). InnerVolumeSpecName "local-storage05-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 17:09:20 crc kubenswrapper[5120]: I0316 17:09:20.655678 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/15200613-4843-450f-bf1e-e7b152c48f43-scripts" (OuterVolumeSpecName: "scripts") pod "15200613-4843-450f-bf1e-e7b152c48f43" (UID: "15200613-4843-450f-bf1e-e7b152c48f43"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:09:20 crc kubenswrapper[5120]: I0316 17:09:20.657032 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15200613-4843-450f-bf1e-e7b152c48f43-kube-api-access-j6xl9" (OuterVolumeSpecName: "kube-api-access-j6xl9") pod "15200613-4843-450f-bf1e-e7b152c48f43" (UID: "15200613-4843-450f-bf1e-e7b152c48f43"). InnerVolumeSpecName "kube-api-access-j6xl9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:09:20 crc kubenswrapper[5120]: I0316 17:09:20.744200 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") on node \"crc\" " Mar 16 17:09:20 crc kubenswrapper[5120]: I0316 17:09:20.744236 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/15200613-4843-450f-bf1e-e7b152c48f43-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:20 crc kubenswrapper[5120]: I0316 17:09:20.744250 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j6xl9\" (UniqueName: \"kubernetes.io/projected/15200613-4843-450f-bf1e-e7b152c48f43-kube-api-access-j6xl9\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:20 crc kubenswrapper[5120]: I0316 17:09:20.784803 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/15200613-4843-450f-bf1e-e7b152c48f43-config-data" (OuterVolumeSpecName: "config-data") pod "15200613-4843-450f-bf1e-e7b152c48f43" (UID: "15200613-4843-450f-bf1e-e7b152c48f43"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:09:20 crc kubenswrapper[5120]: I0316 17:09:20.793141 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/15200613-4843-450f-bf1e-e7b152c48f43-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "15200613-4843-450f-bf1e-e7b152c48f43" (UID: "15200613-4843-450f-bf1e-e7b152c48f43"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:09:20 crc kubenswrapper[5120]: I0316 17:09:20.799212 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/15200613-4843-450f-bf1e-e7b152c48f43-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "15200613-4843-450f-bf1e-e7b152c48f43" (UID: "15200613-4843-450f-bf1e-e7b152c48f43"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:09:20 crc kubenswrapper[5120]: I0316 17:09:20.827458 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage05-crc" (UniqueName: "kubernetes.io/local-volume/local-storage05-crc") on node "crc" Mar 16 17:09:20 crc kubenswrapper[5120]: I0316 17:09:20.848491 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/15200613-4843-450f-bf1e-e7b152c48f43-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:20 crc kubenswrapper[5120]: I0316 17:09:20.848534 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:20 crc kubenswrapper[5120]: I0316 17:09:20.848549 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/15200613-4843-450f-bf1e-e7b152c48f43-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:20 crc kubenswrapper[5120]: I0316 17:09:20.848561 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/15200613-4843-450f-bf1e-e7b152c48f43-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:21 crc kubenswrapper[5120]: I0316 17:09:21.049044 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-75fdb7754b-cb728"] Mar 16 17:09:21 crc kubenswrapper[5120]: I0316 17:09:21.049141 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-6448f564f4-flpdw"] Mar 16 17:09:21 crc kubenswrapper[5120]: W0316 17:09:21.061574 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3e60d330_61c0_4a9b_ac47_b35f12e5fd66.slice/crio-2aa333107c5033677f5bc47d7561674c10767c5586bf58b75bf82e054b9794df WatchSource:0}: Error finding container 2aa333107c5033677f5bc47d7561674c10767c5586bf58b75bf82e054b9794df: Status 404 returned error can't find the container with id 2aa333107c5033677f5bc47d7561674c10767c5586bf58b75bf82e054b9794df Mar 16 17:09:21 crc kubenswrapper[5120]: I0316 17:09:21.121218 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:09:21 crc kubenswrapper[5120]: I0316 17:09:21.158863 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 17:09:21 crc kubenswrapper[5120]: I0316 17:09:21.168982 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3-combined-ca-bundle\") pod \"eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3\" (UID: \"eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3\") " Mar 16 17:09:21 crc kubenswrapper[5120]: I0316 17:09:21.169238 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3-nova-novncproxy-tls-certs\") pod \"eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3\" (UID: \"eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3\") " Mar 16 17:09:21 crc kubenswrapper[5120]: I0316 17:09:21.169287 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jp84v\" (UniqueName: \"kubernetes.io/projected/eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3-kube-api-access-jp84v\") pod \"eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3\" (UID: \"eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3\") " Mar 16 17:09:21 crc kubenswrapper[5120]: I0316 17:09:21.169366 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3-vencrypt-tls-certs\") pod \"eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3\" (UID: \"eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3\") " Mar 16 17:09:21 crc kubenswrapper[5120]: I0316 17:09:21.169453 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3-config-data\") pod \"eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3\" (UID: \"eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3\") " Mar 16 17:09:21 crc kubenswrapper[5120]: I0316 17:09:21.186956 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3-kube-api-access-jp84v" (OuterVolumeSpecName: "kube-api-access-jp84v") pod "eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3" (UID: "eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3"). InnerVolumeSpecName "kube-api-access-jp84v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:09:21 crc kubenswrapper[5120]: I0316 17:09:21.249914 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3" (UID: "eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:09:21 crc kubenswrapper[5120]: I0316 17:09:21.269886 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3-config-data" (OuterVolumeSpecName: "config-data") pod "eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3" (UID: "eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:09:21 crc kubenswrapper[5120]: I0316 17:09:21.273589 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dfe74d0c-e886-4057-8cb1-0bdb487b317c-combined-ca-bundle\") pod \"dfe74d0c-e886-4057-8cb1-0bdb487b317c\" (UID: \"dfe74d0c-e886-4057-8cb1-0bdb487b317c\") " Mar 16 17:09:21 crc kubenswrapper[5120]: I0316 17:09:21.273697 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m4vst\" (UniqueName: \"kubernetes.io/projected/dfe74d0c-e886-4057-8cb1-0bdb487b317c-kube-api-access-m4vst\") pod \"dfe74d0c-e886-4057-8cb1-0bdb487b317c\" (UID: \"dfe74d0c-e886-4057-8cb1-0bdb487b317c\") " Mar 16 17:09:21 crc kubenswrapper[5120]: I0316 17:09:21.277973 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3-vencrypt-tls-certs" (OuterVolumeSpecName: "vencrypt-tls-certs") pod "eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3" (UID: "eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3"). InnerVolumeSpecName "vencrypt-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:09:21 crc kubenswrapper[5120]: I0316 17:09:21.279526 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dfe74d0c-e886-4057-8cb1-0bdb487b317c-kube-api-access-m4vst" (OuterVolumeSpecName: "kube-api-access-m4vst") pod "dfe74d0c-e886-4057-8cb1-0bdb487b317c" (UID: "dfe74d0c-e886-4057-8cb1-0bdb487b317c"). InnerVolumeSpecName "kube-api-access-m4vst". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:09:21 crc kubenswrapper[5120]: I0316 17:09:21.279698 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3-vencrypt-tls-certs\") pod \"eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3\" (UID: \"eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3\") " Mar 16 17:09:21 crc kubenswrapper[5120]: W0316 17:09:21.279812 5120 empty_dir.go:511] Warning: Unmount skipped because path does not exist: /var/lib/kubelet/pods/eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3/volumes/kubernetes.io~secret/vencrypt-tls-certs Mar 16 17:09:21 crc kubenswrapper[5120]: I0316 17:09:21.279826 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3-vencrypt-tls-certs" (OuterVolumeSpecName: "vencrypt-tls-certs") pod "eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3" (UID: "eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3"). InnerVolumeSpecName "vencrypt-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:09:21 crc kubenswrapper[5120]: I0316 17:09:21.281236 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dfe74d0c-e886-4057-8cb1-0bdb487b317c-config-data\") pod \"dfe74d0c-e886-4057-8cb1-0bdb487b317c\" (UID: \"dfe74d0c-e886-4057-8cb1-0bdb487b317c\") " Mar 16 17:09:21 crc kubenswrapper[5120]: I0316 17:09:21.282765 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:21 crc kubenswrapper[5120]: I0316 17:09:21.282799 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m4vst\" (UniqueName: \"kubernetes.io/projected/dfe74d0c-e886-4057-8cb1-0bdb487b317c-kube-api-access-m4vst\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:21 crc kubenswrapper[5120]: I0316 17:09:21.282818 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jp84v\" (UniqueName: \"kubernetes.io/projected/eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3-kube-api-access-jp84v\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:21 crc kubenswrapper[5120]: I0316 17:09:21.282831 5120 reconciler_common.go:299] "Volume detached for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3-vencrypt-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:21 crc kubenswrapper[5120]: I0316 17:09:21.282844 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:21 crc kubenswrapper[5120]: I0316 17:09:21.284638 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3-nova-novncproxy-tls-certs" (OuterVolumeSpecName: "nova-novncproxy-tls-certs") pod "eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3" (UID: "eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3"). InnerVolumeSpecName "nova-novncproxy-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:09:21 crc kubenswrapper[5120]: I0316 17:09:21.309625 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dfe74d0c-e886-4057-8cb1-0bdb487b317c-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "dfe74d0c-e886-4057-8cb1-0bdb487b317c" (UID: "dfe74d0c-e886-4057-8cb1-0bdb487b317c"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:09:21 crc kubenswrapper[5120]: I0316 17:09:21.332318 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dfe74d0c-e886-4057-8cb1-0bdb487b317c-config-data" (OuterVolumeSpecName: "config-data") pod "dfe74d0c-e886-4057-8cb1-0bdb487b317c" (UID: "dfe74d0c-e886-4057-8cb1-0bdb487b317c"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:09:21 crc kubenswrapper[5120]: I0316 17:09:21.346976 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-64b7569b94-dxks6" Mar 16 17:09:21 crc kubenswrapper[5120]: I0316 17:09:21.385880 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/76f0322f-b14b-4b9b-9665-2121e3b21629-httpd-config\") pod \"76f0322f-b14b-4b9b-9665-2121e3b21629\" (UID: \"76f0322f-b14b-4b9b-9665-2121e3b21629\") " Mar 16 17:09:21 crc kubenswrapper[5120]: I0316 17:09:21.386025 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/76f0322f-b14b-4b9b-9665-2121e3b21629-ovndb-tls-certs\") pod \"76f0322f-b14b-4b9b-9665-2121e3b21629\" (UID: \"76f0322f-b14b-4b9b-9665-2121e3b21629\") " Mar 16 17:09:21 crc kubenswrapper[5120]: I0316 17:09:21.386720 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/76f0322f-b14b-4b9b-9665-2121e3b21629-internal-tls-certs\") pod \"76f0322f-b14b-4b9b-9665-2121e3b21629\" (UID: \"76f0322f-b14b-4b9b-9665-2121e3b21629\") " Mar 16 17:09:21 crc kubenswrapper[5120]: I0316 17:09:21.386789 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/76f0322f-b14b-4b9b-9665-2121e3b21629-combined-ca-bundle\") pod \"76f0322f-b14b-4b9b-9665-2121e3b21629\" (UID: \"76f0322f-b14b-4b9b-9665-2121e3b21629\") " Mar 16 17:09:21 crc kubenswrapper[5120]: I0316 17:09:21.386887 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/76f0322f-b14b-4b9b-9665-2121e3b21629-public-tls-certs\") pod \"76f0322f-b14b-4b9b-9665-2121e3b21629\" (UID: \"76f0322f-b14b-4b9b-9665-2121e3b21629\") " Mar 16 17:09:21 crc kubenswrapper[5120]: I0316 17:09:21.386947 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/76f0322f-b14b-4b9b-9665-2121e3b21629-config\") pod \"76f0322f-b14b-4b9b-9665-2121e3b21629\" (UID: \"76f0322f-b14b-4b9b-9665-2121e3b21629\") " Mar 16 17:09:21 crc kubenswrapper[5120]: I0316 17:09:21.387139 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qq9nn\" (UniqueName: \"kubernetes.io/projected/76f0322f-b14b-4b9b-9665-2121e3b21629-kube-api-access-qq9nn\") pod \"76f0322f-b14b-4b9b-9665-2121e3b21629\" (UID: \"76f0322f-b14b-4b9b-9665-2121e3b21629\") " Mar 16 17:09:21 crc kubenswrapper[5120]: I0316 17:09:21.393949 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/76f0322f-b14b-4b9b-9665-2121e3b21629-httpd-config" (OuterVolumeSpecName: "httpd-config") pod "76f0322f-b14b-4b9b-9665-2121e3b21629" (UID: "76f0322f-b14b-4b9b-9665-2121e3b21629"). InnerVolumeSpecName "httpd-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:09:21 crc kubenswrapper[5120]: I0316 17:09:21.394027 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dfe74d0c-e886-4057-8cb1-0bdb487b317c-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:21 crc kubenswrapper[5120]: I0316 17:09:21.394069 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dfe74d0c-e886-4057-8cb1-0bdb487b317c-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:21 crc kubenswrapper[5120]: I0316 17:09:21.394087 5120 reconciler_common.go:299] "Volume detached for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3-nova-novncproxy-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:21 crc kubenswrapper[5120]: I0316 17:09:21.396036 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76f0322f-b14b-4b9b-9665-2121e3b21629-kube-api-access-qq9nn" (OuterVolumeSpecName: "kube-api-access-qq9nn") pod "76f0322f-b14b-4b9b-9665-2121e3b21629" (UID: "76f0322f-b14b-4b9b-9665-2121e3b21629"). InnerVolumeSpecName "kube-api-access-qq9nn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:09:21 crc kubenswrapper[5120]: I0316 17:09:21.465403 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/76f0322f-b14b-4b9b-9665-2121e3b21629-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "76f0322f-b14b-4b9b-9665-2121e3b21629" (UID: "76f0322f-b14b-4b9b-9665-2121e3b21629"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:09:21 crc kubenswrapper[5120]: I0316 17:09:21.477267 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/76f0322f-b14b-4b9b-9665-2121e3b21629-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "76f0322f-b14b-4b9b-9665-2121e3b21629" (UID: "76f0322f-b14b-4b9b-9665-2121e3b21629"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:09:21 crc kubenswrapper[5120]: I0316 17:09:21.493893 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/76f0322f-b14b-4b9b-9665-2121e3b21629-ovndb-tls-certs" (OuterVolumeSpecName: "ovndb-tls-certs") pod "76f0322f-b14b-4b9b-9665-2121e3b21629" (UID: "76f0322f-b14b-4b9b-9665-2121e3b21629"). InnerVolumeSpecName "ovndb-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:09:21 crc kubenswrapper[5120]: I0316 17:09:21.498272 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qq9nn\" (UniqueName: \"kubernetes.io/projected/76f0322f-b14b-4b9b-9665-2121e3b21629-kube-api-access-qq9nn\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:21 crc kubenswrapper[5120]: I0316 17:09:21.499173 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/76f0322f-b14b-4b9b-9665-2121e3b21629-httpd-config\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:21 crc kubenswrapper[5120]: I0316 17:09:21.500241 5120 reconciler_common.go:299] "Volume detached for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/76f0322f-b14b-4b9b-9665-2121e3b21629-ovndb-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:21 crc kubenswrapper[5120]: I0316 17:09:21.500281 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/76f0322f-b14b-4b9b-9665-2121e3b21629-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:21 crc kubenswrapper[5120]: I0316 17:09:21.500297 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/76f0322f-b14b-4b9b-9665-2121e3b21629-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:21 crc kubenswrapper[5120]: I0316 17:09:21.514492 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:09:21 crc kubenswrapper[5120]: I0316 17:09:21.514511 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"15200613-4843-450f-bf1e-e7b152c48f43","Type":"ContainerDied","Data":"ee2e492f0398356f8fc8d1a55ebebaf93543b50629f55d23bb6e6a665cd412a7"} Mar 16 17:09:21 crc kubenswrapper[5120]: I0316 17:09:21.514567 5120 scope.go:117] "RemoveContainer" containerID="f81997cba70489fb4a04b4ded448fff5d95a78a49c18354c122428489333973f" Mar 16 17:09:21 crc kubenswrapper[5120]: I0316 17:09:21.520054 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-6448f564f4-flpdw" event={"ID":"3e60d330-61c0-4a9b-ac47-b35f12e5fd66","Type":"ContainerStarted","Data":"3489de754964a0e3fed9cd51b42522048244f6ae68a976386a1ed47728c4cc46"} Mar 16 17:09:21 crc kubenswrapper[5120]: I0316 17:09:21.520098 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-6448f564f4-flpdw" event={"ID":"3e60d330-61c0-4a9b-ac47-b35f12e5fd66","Type":"ContainerStarted","Data":"2aa333107c5033677f5bc47d7561674c10767c5586bf58b75bf82e054b9794df"} Mar 16 17:09:21 crc kubenswrapper[5120]: I0316 17:09:21.523278 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-75fdb7754b-cb728" event={"ID":"a1b86673-6678-41ee-b073-f44c6d447fbc","Type":"ContainerStarted","Data":"21c3374fbc591159449ceb515f67c13006c5efb80bd8f427d0c0d4234d964f54"} Mar 16 17:09:21 crc kubenswrapper[5120]: I0316 17:09:21.523327 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-75fdb7754b-cb728" event={"ID":"a1b86673-6678-41ee-b073-f44c6d447fbc","Type":"ContainerStarted","Data":"279b28f00f54850c56acfbed8751352e849b1c8daf4504d4ff4a2d67eed83162"} Mar 16 17:09:21 crc kubenswrapper[5120]: I0316 17:09:21.524755 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/keystone-75fdb7754b-cb728" Mar 16 17:09:21 crc kubenswrapper[5120]: I0316 17:09:21.536591 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/76f0322f-b14b-4b9b-9665-2121e3b21629-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "76f0322f-b14b-4b9b-9665-2121e3b21629" (UID: "76f0322f-b14b-4b9b-9665-2121e3b21629"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:09:21 crc kubenswrapper[5120]: I0316 17:09:21.538058 5120 generic.go:358] "Generic (PLEG): container finished" podID="76f0322f-b14b-4b9b-9665-2121e3b21629" containerID="598d399875f1007c74ffb9a295384b67e42baa6c19d61a3bd91b82a9c3db6ecc" exitCode=0 Mar 16 17:09:21 crc kubenswrapper[5120]: I0316 17:09:21.538263 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-64b7569b94-dxks6" Mar 16 17:09:21 crc kubenswrapper[5120]: I0316 17:09:21.538325 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-64b7569b94-dxks6" event={"ID":"76f0322f-b14b-4b9b-9665-2121e3b21629","Type":"ContainerDied","Data":"598d399875f1007c74ffb9a295384b67e42baa6c19d61a3bd91b82a9c3db6ecc"} Mar 16 17:09:21 crc kubenswrapper[5120]: I0316 17:09:21.538368 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-64b7569b94-dxks6" event={"ID":"76f0322f-b14b-4b9b-9665-2121e3b21629","Type":"ContainerDied","Data":"0aefad752ed73cdf17e594cf88e7be5c7ddf7447851dbc78abecca7975d12a09"} Mar 16 17:09:21 crc kubenswrapper[5120]: I0316 17:09:21.540338 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/76f0322f-b14b-4b9b-9665-2121e3b21629-config" (OuterVolumeSpecName: "config") pod "76f0322f-b14b-4b9b-9665-2121e3b21629" (UID: "76f0322f-b14b-4b9b-9665-2121e3b21629"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:09:21 crc kubenswrapper[5120]: I0316 17:09:21.544178 5120 generic.go:358] "Generic (PLEG): container finished" podID="10bd837b-2e0d-460b-a254-20e23b6768f7" containerID="e19ce5213f51e39d0fe500fc1b09e0c84e9115038d851fdb05d0763df81163f5" exitCode=0 Mar 16 17:09:21 crc kubenswrapper[5120]: I0316 17:09:21.544357 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"10bd837b-2e0d-460b-a254-20e23b6768f7","Type":"ContainerDied","Data":"e19ce5213f51e39d0fe500fc1b09e0c84e9115038d851fdb05d0763df81163f5"} Mar 16 17:09:21 crc kubenswrapper[5120]: I0316 17:09:21.549478 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-75fdb7754b-cb728" podStartSLOduration=2.549454804 podStartE2EDuration="2.549454804s" podCreationTimestamp="2026-03-16 17:09:19 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:09:21.54351942 +0000 UTC m=+5863.697451077" watchObservedRunningTime="2026-03-16 17:09:21.549454804 +0000 UTC m=+5863.703386461" Mar 16 17:09:21 crc kubenswrapper[5120]: I0316 17:09:21.562147 5120 generic.go:358] "Generic (PLEG): container finished" podID="32194c8a-90a1-4132-9b75-3882418d7f7d" containerID="bbcffb8c84703cef27f1a9a537df36babdb550b7a8ff5473f1bb80d9395d63f6" exitCode=1 Mar 16 17:09:21 crc kubenswrapper[5120]: I0316 17:09:21.562304 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"32194c8a-90a1-4132-9b75-3882418d7f7d","Type":"ContainerDied","Data":"bbcffb8c84703cef27f1a9a537df36babdb550b7a8ff5473f1bb80d9395d63f6"} Mar 16 17:09:21 crc kubenswrapper[5120]: I0316 17:09:21.562985 5120 scope.go:117] "RemoveContainer" containerID="bbcffb8c84703cef27f1a9a537df36babdb550b7a8ff5473f1bb80d9395d63f6" Mar 16 17:09:21 crc kubenswrapper[5120]: I0316 17:09:21.577046 5120 generic.go:358] "Generic (PLEG): container finished" podID="dfe74d0c-e886-4057-8cb1-0bdb487b317c" containerID="f68243cf4325c812ddc49bff1063df157769dc8e1e0e4bf7bb8137f1da918e6d" exitCode=0 Mar 16 17:09:21 crc kubenswrapper[5120]: I0316 17:09:21.577428 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 17:09:21 crc kubenswrapper[5120]: I0316 17:09:21.577550 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"dfe74d0c-e886-4057-8cb1-0bdb487b317c","Type":"ContainerDied","Data":"f68243cf4325c812ddc49bff1063df157769dc8e1e0e4bf7bb8137f1da918e6d"} Mar 16 17:09:21 crc kubenswrapper[5120]: I0316 17:09:21.577611 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"dfe74d0c-e886-4057-8cb1-0bdb487b317c","Type":"ContainerDied","Data":"ba5bf3e7c62179ca7fe81d2569b4abfe1c8d21579e4a55fab2068d0bbff6024b"} Mar 16 17:09:21 crc kubenswrapper[5120]: I0316 17:09:21.589315 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3","Type":"ContainerDied","Data":"aecacfe477959636e92e884c67c3da1ce83a447b5c24ebdf4c3c399f899822bf"} Mar 16 17:09:21 crc kubenswrapper[5120]: I0316 17:09:21.589425 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:09:21 crc kubenswrapper[5120]: I0316 17:09:21.604752 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/76f0322f-b14b-4b9b-9665-2121e3b21629-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:21 crc kubenswrapper[5120]: I0316 17:09:21.605011 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/76f0322f-b14b-4b9b-9665-2121e3b21629-config\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:21 crc kubenswrapper[5120]: I0316 17:09:21.764719 5120 scope.go:117] "RemoveContainer" containerID="66729d307f3c4ae64259d7994cb8ba5065ef7054bad2bce3f0f8c35286a85348" Mar 16 17:09:21 crc kubenswrapper[5120]: I0316 17:09:21.808558 5120 scope.go:117] "RemoveContainer" containerID="805349fcd73b71b77e0d612190a603fe69577f038e1cf9b0cd22a2788eaabb4f" Mar 16 17:09:21 crc kubenswrapper[5120]: I0316 17:09:21.821811 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 17:09:21 crc kubenswrapper[5120]: I0316 17:09:21.905673 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 17:09:21 crc kubenswrapper[5120]: I0316 17:09:21.922461 5120 scope.go:117] "RemoveContainer" containerID="598d399875f1007c74ffb9a295384b67e42baa6c19d61a3bd91b82a9c3db6ecc" Mar 16 17:09:21 crc kubenswrapper[5120]: I0316 17:09:21.935673 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 17:09:21 crc kubenswrapper[5120]: I0316 17:09:21.942988 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 17:09:21 crc kubenswrapper[5120]: I0316 17:09:21.943029 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 17:09:21 crc kubenswrapper[5120]: I0316 17:09:21.943053 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76f0322f-b14b-4b9b-9665-2121e3b21629" containerName="neutron-api" Mar 16 17:09:21 crc kubenswrapper[5120]: I0316 17:09:21.943060 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="76f0322f-b14b-4b9b-9665-2121e3b21629" containerName="neutron-api" Mar 16 17:09:21 crc kubenswrapper[5120]: I0316 17:09:21.943087 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dfe74d0c-e886-4057-8cb1-0bdb487b317c" containerName="nova-cell1-conductor-conductor" Mar 16 17:09:21 crc kubenswrapper[5120]: I0316 17:09:21.943098 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="dfe74d0c-e886-4057-8cb1-0bdb487b317c" containerName="nova-cell1-conductor-conductor" Mar 16 17:09:21 crc kubenswrapper[5120]: I0316 17:09:21.948002 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15200613-4843-450f-bf1e-e7b152c48f43" containerName="glance-log" Mar 16 17:09:21 crc kubenswrapper[5120]: I0316 17:09:21.948037 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="15200613-4843-450f-bf1e-e7b152c48f43" containerName="glance-log" Mar 16 17:09:21 crc kubenswrapper[5120]: I0316 17:09:21.948085 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76f0322f-b14b-4b9b-9665-2121e3b21629" containerName="neutron-httpd" Mar 16 17:09:21 crc kubenswrapper[5120]: I0316 17:09:21.948093 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="76f0322f-b14b-4b9b-9665-2121e3b21629" containerName="neutron-httpd" Mar 16 17:09:21 crc kubenswrapper[5120]: I0316 17:09:21.948132 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15200613-4843-450f-bf1e-e7b152c48f43" containerName="glance-httpd" Mar 16 17:09:21 crc kubenswrapper[5120]: I0316 17:09:21.948140 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="15200613-4843-450f-bf1e-e7b152c48f43" containerName="glance-httpd" Mar 16 17:09:21 crc kubenswrapper[5120]: I0316 17:09:21.948818 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="76f0322f-b14b-4b9b-9665-2121e3b21629" containerName="neutron-api" Mar 16 17:09:21 crc kubenswrapper[5120]: I0316 17:09:21.948845 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 17:09:21 crc kubenswrapper[5120]: I0316 17:09:21.948862 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="15200613-4843-450f-bf1e-e7b152c48f43" containerName="glance-log" Mar 16 17:09:21 crc kubenswrapper[5120]: I0316 17:09:21.948875 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="76f0322f-b14b-4b9b-9665-2121e3b21629" containerName="neutron-httpd" Mar 16 17:09:21 crc kubenswrapper[5120]: I0316 17:09:21.948895 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="15200613-4843-450f-bf1e-e7b152c48f43" containerName="glance-httpd" Mar 16 17:09:21 crc kubenswrapper[5120]: I0316 17:09:21.948911 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="dfe74d0c-e886-4057-8cb1-0bdb487b317c" containerName="nova-cell1-conductor-conductor" Mar 16 17:09:21 crc kubenswrapper[5120]: I0316 17:09:21.965450 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 17:09:21 crc kubenswrapper[5120]: I0316 17:09:21.965902 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 17:09:21 crc kubenswrapper[5120]: I0316 17:09:21.974137 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 17:09:21 crc kubenswrapper[5120]: I0316 17:09:21.977239 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-conductor-config-data\"" Mar 16 17:09:21 crc kubenswrapper[5120]: I0316 17:09:21.984348 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 17:09:21 crc kubenswrapper[5120]: I0316 17:09:21.997073 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 17:09:22 crc kubenswrapper[5120]: I0316 17:09:22.006091 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 17:09:22 crc kubenswrapper[5120]: I0316 17:09:22.020408 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 17:09:22 crc kubenswrapper[5120]: I0316 17:09:22.026347 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d0852906-6351-45a9-a44c-0bf3f4c29496-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"d0852906-6351-45a9-a44c-0bf3f4c29496\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 17:09:22 crc kubenswrapper[5120]: I0316 17:09:22.026966 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d0852906-6351-45a9-a44c-0bf3f4c29496-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"d0852906-6351-45a9-a44c-0bf3f4c29496\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 17:09:22 crc kubenswrapper[5120]: I0316 17:09:22.027390 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5b7l\" (UniqueName: \"kubernetes.io/projected/d0852906-6351-45a9-a44c-0bf3f4c29496-kube-api-access-r5b7l\") pod \"nova-cell1-conductor-0\" (UID: \"d0852906-6351-45a9-a44c-0bf3f4c29496\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 17:09:22 crc kubenswrapper[5120]: I0316 17:09:22.030962 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 17:09:22 crc kubenswrapper[5120]: I0316 17:09:22.032447 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:09:22 crc kubenswrapper[5120]: I0316 17:09:22.034558 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-external-config-data\"" Mar 16 17:09:22 crc kubenswrapper[5120]: I0316 17:09:22.040511 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-public-svc\"" Mar 16 17:09:22 crc kubenswrapper[5120]: I0316 17:09:22.040871 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 17:09:22 crc kubenswrapper[5120]: I0316 17:09:22.041204 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:09:22 crc kubenswrapper[5120]: I0316 17:09:22.041369 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:09:22 crc kubenswrapper[5120]: I0316 17:09:22.042988 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:09:22 crc kubenswrapper[5120]: I0316 17:09:22.047576 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-novncproxy-cell1-public-svc\"" Mar 16 17:09:22 crc kubenswrapper[5120]: I0316 17:09:22.047966 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-novncproxy-cell1-vencrypt\"" Mar 16 17:09:22 crc kubenswrapper[5120]: I0316 17:09:22.049097 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-novncproxy-config-data\"" Mar 16 17:09:22 crc kubenswrapper[5120]: I0316 17:09:22.052848 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 17:09:22 crc kubenswrapper[5120]: I0316 17:09:22.053285 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:09:22 crc kubenswrapper[5120]: I0316 17:09:22.060082 5120 scope.go:117] "RemoveContainer" containerID="805349fcd73b71b77e0d612190a603fe69577f038e1cf9b0cd22a2788eaabb4f" Mar 16 17:09:22 crc kubenswrapper[5120]: E0316 17:09:22.061482 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"805349fcd73b71b77e0d612190a603fe69577f038e1cf9b0cd22a2788eaabb4f\": container with ID starting with 805349fcd73b71b77e0d612190a603fe69577f038e1cf9b0cd22a2788eaabb4f not found: ID does not exist" containerID="805349fcd73b71b77e0d612190a603fe69577f038e1cf9b0cd22a2788eaabb4f" Mar 16 17:09:22 crc kubenswrapper[5120]: I0316 17:09:22.061539 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"805349fcd73b71b77e0d612190a603fe69577f038e1cf9b0cd22a2788eaabb4f"} err="failed to get container status \"805349fcd73b71b77e0d612190a603fe69577f038e1cf9b0cd22a2788eaabb4f\": rpc error: code = NotFound desc = could not find container \"805349fcd73b71b77e0d612190a603fe69577f038e1cf9b0cd22a2788eaabb4f\": container with ID starting with 805349fcd73b71b77e0d612190a603fe69577f038e1cf9b0cd22a2788eaabb4f not found: ID does not exist" Mar 16 17:09:22 crc kubenswrapper[5120]: I0316 17:09:22.061571 5120 scope.go:117] "RemoveContainer" containerID="598d399875f1007c74ffb9a295384b67e42baa6c19d61a3bd91b82a9c3db6ecc" Mar 16 17:09:22 crc kubenswrapper[5120]: I0316 17:09:22.065784 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-64b7569b94-dxks6"] Mar 16 17:09:22 crc kubenswrapper[5120]: I0316 17:09:22.078569 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:09:22 crc kubenswrapper[5120]: E0316 17:09:22.078664 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"598d399875f1007c74ffb9a295384b67e42baa6c19d61a3bd91b82a9c3db6ecc\": container with ID starting with 598d399875f1007c74ffb9a295384b67e42baa6c19d61a3bd91b82a9c3db6ecc not found: ID does not exist" containerID="598d399875f1007c74ffb9a295384b67e42baa6c19d61a3bd91b82a9c3db6ecc" Mar 16 17:09:22 crc kubenswrapper[5120]: I0316 17:09:22.078698 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"598d399875f1007c74ffb9a295384b67e42baa6c19d61a3bd91b82a9c3db6ecc"} err="failed to get container status \"598d399875f1007c74ffb9a295384b67e42baa6c19d61a3bd91b82a9c3db6ecc\": rpc error: code = NotFound desc = could not find container \"598d399875f1007c74ffb9a295384b67e42baa6c19d61a3bd91b82a9c3db6ecc\": container with ID starting with 598d399875f1007c74ffb9a295384b67e42baa6c19d61a3bd91b82a9c3db6ecc not found: ID does not exist" Mar 16 17:09:22 crc kubenswrapper[5120]: I0316 17:09:22.078724 5120 scope.go:117] "RemoveContainer" containerID="f68243cf4325c812ddc49bff1063df157769dc8e1e0e4bf7bb8137f1da918e6d" Mar 16 17:09:22 crc kubenswrapper[5120]: I0316 17:09:22.080926 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Mar 16 17:09:22 crc kubenswrapper[5120]: I0316 17:09:22.119829 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-64b7569b94-dxks6"] Mar 16 17:09:22 crc kubenswrapper[5120]: I0316 17:09:22.157454 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/10bd837b-2e0d-460b-a254-20e23b6768f7-memcached-tls-certs\") pod \"10bd837b-2e0d-460b-a254-20e23b6768f7\" (UID: \"10bd837b-2e0d-460b-a254-20e23b6768f7\") " Mar 16 17:09:22 crc kubenswrapper[5120]: I0316 17:09:22.158158 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/10bd837b-2e0d-460b-a254-20e23b6768f7-config-data\") pod \"10bd837b-2e0d-460b-a254-20e23b6768f7\" (UID: \"10bd837b-2e0d-460b-a254-20e23b6768f7\") " Mar 16 17:09:22 crc kubenswrapper[5120]: I0316 17:09:22.158392 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-blklg\" (UniqueName: \"kubernetes.io/projected/10bd837b-2e0d-460b-a254-20e23b6768f7-kube-api-access-blklg\") pod \"10bd837b-2e0d-460b-a254-20e23b6768f7\" (UID: \"10bd837b-2e0d-460b-a254-20e23b6768f7\") " Mar 16 17:09:22 crc kubenswrapper[5120]: I0316 17:09:22.158539 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/10bd837b-2e0d-460b-a254-20e23b6768f7-kolla-config\") pod \"10bd837b-2e0d-460b-a254-20e23b6768f7\" (UID: \"10bd837b-2e0d-460b-a254-20e23b6768f7\") " Mar 16 17:09:22 crc kubenswrapper[5120]: I0316 17:09:22.159485 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/10bd837b-2e0d-460b-a254-20e23b6768f7-combined-ca-bundle\") pod \"10bd837b-2e0d-460b-a254-20e23b6768f7\" (UID: \"10bd837b-2e0d-460b-a254-20e23b6768f7\") " Mar 16 17:09:22 crc kubenswrapper[5120]: I0316 17:09:22.159924 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5f0f24cd-dbef-4a0a-9e2b-cb5a170982aa-scripts\") pod \"glance-default-external-api-0\" (UID: \"5f0f24cd-dbef-4a0a-9e2b-cb5a170982aa\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:09:22 crc kubenswrapper[5120]: I0316 17:09:22.160133 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d0852906-6351-45a9-a44c-0bf3f4c29496-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"d0852906-6351-45a9-a44c-0bf3f4c29496\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 17:09:22 crc kubenswrapper[5120]: I0316 17:09:22.161611 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5f0f24cd-dbef-4a0a-9e2b-cb5a170982aa-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"5f0f24cd-dbef-4a0a-9e2b-cb5a170982aa\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:09:22 crc kubenswrapper[5120]: I0316 17:09:22.161798 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5f0f24cd-dbef-4a0a-9e2b-cb5a170982aa-logs\") pod \"glance-default-external-api-0\" (UID: \"5f0f24cd-dbef-4a0a-9e2b-cb5a170982aa\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:09:22 crc kubenswrapper[5120]: I0316 17:09:22.162015 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4z6p\" (UniqueName: \"kubernetes.io/projected/5f0f24cd-dbef-4a0a-9e2b-cb5a170982aa-kube-api-access-m4z6p\") pod \"glance-default-external-api-0\" (UID: \"5f0f24cd-dbef-4a0a-9e2b-cb5a170982aa\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:09:22 crc kubenswrapper[5120]: I0316 17:09:22.162154 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r5b7l\" (UniqueName: \"kubernetes.io/projected/d0852906-6351-45a9-a44c-0bf3f4c29496-kube-api-access-r5b7l\") pod \"nova-cell1-conductor-0\" (UID: \"d0852906-6351-45a9-a44c-0bf3f4c29496\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 17:09:22 crc kubenswrapper[5120]: I0316 17:09:22.162310 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/d71c12b8-f085-4c19-99c6-f32186225f37-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"d71c12b8-f085-4c19-99c6-f32186225f37\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:09:22 crc kubenswrapper[5120]: I0316 17:09:22.162554 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/5f0f24cd-dbef-4a0a-9e2b-cb5a170982aa-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"5f0f24cd-dbef-4a0a-9e2b-cb5a170982aa\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:09:22 crc kubenswrapper[5120]: I0316 17:09:22.163079 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5f0f24cd-dbef-4a0a-9e2b-cb5a170982aa-config-data\") pod \"glance-default-external-api-0\" (UID: \"5f0f24cd-dbef-4a0a-9e2b-cb5a170982aa\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:09:22 crc kubenswrapper[5120]: I0316 17:09:22.163226 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/5f0f24cd-dbef-4a0a-9e2b-cb5a170982aa-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"5f0f24cd-dbef-4a0a-9e2b-cb5a170982aa\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:09:22 crc kubenswrapper[5120]: I0316 17:09:22.163378 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxvhs\" (UniqueName: \"kubernetes.io/projected/d71c12b8-f085-4c19-99c6-f32186225f37-kube-api-access-cxvhs\") pod \"nova-cell1-novncproxy-0\" (UID: \"d71c12b8-f085-4c19-99c6-f32186225f37\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:09:22 crc kubenswrapper[5120]: I0316 17:09:22.163598 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d0852906-6351-45a9-a44c-0bf3f4c29496-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"d0852906-6351-45a9-a44c-0bf3f4c29496\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 17:09:22 crc kubenswrapper[5120]: I0316 17:09:22.163851 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d71c12b8-f085-4c19-99c6-f32186225f37-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"d71c12b8-f085-4c19-99c6-f32186225f37\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:09:22 crc kubenswrapper[5120]: I0316 17:09:22.164124 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"glance-default-external-api-0\" (UID: \"5f0f24cd-dbef-4a0a-9e2b-cb5a170982aa\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:09:22 crc kubenswrapper[5120]: I0316 17:09:22.164285 5120 scope.go:117] "RemoveContainer" containerID="f68243cf4325c812ddc49bff1063df157769dc8e1e0e4bf7bb8137f1da918e6d" Mar 16 17:09:22 crc kubenswrapper[5120]: I0316 17:09:22.164447 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/d71c12b8-f085-4c19-99c6-f32186225f37-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"d71c12b8-f085-4c19-99c6-f32186225f37\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:09:22 crc kubenswrapper[5120]: I0316 17:09:22.164664 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d71c12b8-f085-4c19-99c6-f32186225f37-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"d71c12b8-f085-4c19-99c6-f32186225f37\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:09:22 crc kubenswrapper[5120]: E0316 17:09:22.165556 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f68243cf4325c812ddc49bff1063df157769dc8e1e0e4bf7bb8137f1da918e6d\": container with ID starting with f68243cf4325c812ddc49bff1063df157769dc8e1e0e4bf7bb8137f1da918e6d not found: ID does not exist" containerID="f68243cf4325c812ddc49bff1063df157769dc8e1e0e4bf7bb8137f1da918e6d" Mar 16 17:09:22 crc kubenswrapper[5120]: I0316 17:09:22.165603 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f68243cf4325c812ddc49bff1063df157769dc8e1e0e4bf7bb8137f1da918e6d"} err="failed to get container status \"f68243cf4325c812ddc49bff1063df157769dc8e1e0e4bf7bb8137f1da918e6d\": rpc error: code = NotFound desc = could not find container \"f68243cf4325c812ddc49bff1063df157769dc8e1e0e4bf7bb8137f1da918e6d\": container with ID starting with f68243cf4325c812ddc49bff1063df157769dc8e1e0e4bf7bb8137f1da918e6d not found: ID does not exist" Mar 16 17:09:22 crc kubenswrapper[5120]: I0316 17:09:22.165627 5120 scope.go:117] "RemoveContainer" containerID="9f702367fcb8fdb15ed6ae2bb41db1c73e6750e39028c97bce0790061b8107b4" Mar 16 17:09:22 crc kubenswrapper[5120]: I0316 17:09:22.169400 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/10bd837b-2e0d-460b-a254-20e23b6768f7-config-data" (OuterVolumeSpecName: "config-data") pod "10bd837b-2e0d-460b-a254-20e23b6768f7" (UID: "10bd837b-2e0d-460b-a254-20e23b6768f7"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:09:22 crc kubenswrapper[5120]: I0316 17:09:22.172467 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d0852906-6351-45a9-a44c-0bf3f4c29496-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"d0852906-6351-45a9-a44c-0bf3f4c29496\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 17:09:22 crc kubenswrapper[5120]: I0316 17:09:22.173127 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/10bd837b-2e0d-460b-a254-20e23b6768f7-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "10bd837b-2e0d-460b-a254-20e23b6768f7" (UID: "10bd837b-2e0d-460b-a254-20e23b6768f7"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:09:22 crc kubenswrapper[5120]: I0316 17:09:22.199714 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10bd837b-2e0d-460b-a254-20e23b6768f7-kube-api-access-blklg" (OuterVolumeSpecName: "kube-api-access-blklg") pod "10bd837b-2e0d-460b-a254-20e23b6768f7" (UID: "10bd837b-2e0d-460b-a254-20e23b6768f7"). InnerVolumeSpecName "kube-api-access-blklg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:09:22 crc kubenswrapper[5120]: I0316 17:09:22.208979 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d0852906-6351-45a9-a44c-0bf3f4c29496-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"d0852906-6351-45a9-a44c-0bf3f4c29496\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 17:09:22 crc kubenswrapper[5120]: I0316 17:09:22.267858 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"glance-default-external-api-0\" (UID: \"5f0f24cd-dbef-4a0a-9e2b-cb5a170982aa\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:09:22 crc kubenswrapper[5120]: I0316 17:09:22.268474 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"glance-default-external-api-0\" (UID: \"5f0f24cd-dbef-4a0a-9e2b-cb5a170982aa\") device mount path \"/mnt/openstack/pv05\"" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:09:22 crc kubenswrapper[5120]: I0316 17:09:22.269890 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/d71c12b8-f085-4c19-99c6-f32186225f37-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"d71c12b8-f085-4c19-99c6-f32186225f37\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:09:22 crc kubenswrapper[5120]: I0316 17:09:22.272883 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d71c12b8-f085-4c19-99c6-f32186225f37-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"d71c12b8-f085-4c19-99c6-f32186225f37\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:09:22 crc kubenswrapper[5120]: I0316 17:09:22.274512 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5f0f24cd-dbef-4a0a-9e2b-cb5a170982aa-scripts\") pod \"glance-default-external-api-0\" (UID: \"5f0f24cd-dbef-4a0a-9e2b-cb5a170982aa\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:09:22 crc kubenswrapper[5120]: I0316 17:09:22.275480 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5f0f24cd-dbef-4a0a-9e2b-cb5a170982aa-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"5f0f24cd-dbef-4a0a-9e2b-cb5a170982aa\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:09:22 crc kubenswrapper[5120]: I0316 17:09:22.275750 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5f0f24cd-dbef-4a0a-9e2b-cb5a170982aa-logs\") pod \"glance-default-external-api-0\" (UID: \"5f0f24cd-dbef-4a0a-9e2b-cb5a170982aa\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:09:22 crc kubenswrapper[5120]: I0316 17:09:22.276328 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m4z6p\" (UniqueName: \"kubernetes.io/projected/5f0f24cd-dbef-4a0a-9e2b-cb5a170982aa-kube-api-access-m4z6p\") pod \"glance-default-external-api-0\" (UID: \"5f0f24cd-dbef-4a0a-9e2b-cb5a170982aa\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:09:22 crc kubenswrapper[5120]: I0316 17:09:22.278175 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/d71c12b8-f085-4c19-99c6-f32186225f37-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"d71c12b8-f085-4c19-99c6-f32186225f37\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:09:22 crc kubenswrapper[5120]: I0316 17:09:22.278578 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/5f0f24cd-dbef-4a0a-9e2b-cb5a170982aa-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"5f0f24cd-dbef-4a0a-9e2b-cb5a170982aa\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:09:22 crc kubenswrapper[5120]: I0316 17:09:22.278825 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5f0f24cd-dbef-4a0a-9e2b-cb5a170982aa-config-data\") pod \"glance-default-external-api-0\" (UID: \"5f0f24cd-dbef-4a0a-9e2b-cb5a170982aa\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:09:22 crc kubenswrapper[5120]: I0316 17:09:22.279143 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/5f0f24cd-dbef-4a0a-9e2b-cb5a170982aa-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"5f0f24cd-dbef-4a0a-9e2b-cb5a170982aa\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:09:22 crc kubenswrapper[5120]: I0316 17:09:22.279392 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cxvhs\" (UniqueName: \"kubernetes.io/projected/d71c12b8-f085-4c19-99c6-f32186225f37-kube-api-access-cxvhs\") pod \"nova-cell1-novncproxy-0\" (UID: \"d71c12b8-f085-4c19-99c6-f32186225f37\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:09:22 crc kubenswrapper[5120]: I0316 17:09:22.282200 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d71c12b8-f085-4c19-99c6-f32186225f37-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"d71c12b8-f085-4c19-99c6-f32186225f37\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:09:22 crc kubenswrapper[5120]: I0316 17:09:22.282637 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/10bd837b-2e0d-460b-a254-20e23b6768f7-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:22 crc kubenswrapper[5120]: I0316 17:09:22.283585 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-blklg\" (UniqueName: \"kubernetes.io/projected/10bd837b-2e0d-460b-a254-20e23b6768f7-kube-api-access-blklg\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:22 crc kubenswrapper[5120]: I0316 17:09:22.283800 5120 reconciler_common.go:299] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/10bd837b-2e0d-460b-a254-20e23b6768f7-kolla-config\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:22 crc kubenswrapper[5120]: I0316 17:09:22.284403 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/5f0f24cd-dbef-4a0a-9e2b-cb5a170982aa-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"5f0f24cd-dbef-4a0a-9e2b-cb5a170982aa\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:09:22 crc kubenswrapper[5120]: I0316 17:09:22.289513 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5b7l\" (UniqueName: \"kubernetes.io/projected/d0852906-6351-45a9-a44c-0bf3f4c29496-kube-api-access-r5b7l\") pod \"nova-cell1-conductor-0\" (UID: \"d0852906-6351-45a9-a44c-0bf3f4c29496\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 17:09:22 crc kubenswrapper[5120]: I0316 17:09:22.291632 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5f0f24cd-dbef-4a0a-9e2b-cb5a170982aa-logs\") pod \"glance-default-external-api-0\" (UID: \"5f0f24cd-dbef-4a0a-9e2b-cb5a170982aa\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:09:22 crc kubenswrapper[5120]: I0316 17:09:22.296056 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5f0f24cd-dbef-4a0a-9e2b-cb5a170982aa-config-data\") pod \"glance-default-external-api-0\" (UID: \"5f0f24cd-dbef-4a0a-9e2b-cb5a170982aa\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:09:22 crc kubenswrapper[5120]: I0316 17:09:22.297585 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5f0f24cd-dbef-4a0a-9e2b-cb5a170982aa-scripts\") pod \"glance-default-external-api-0\" (UID: \"5f0f24cd-dbef-4a0a-9e2b-cb5a170982aa\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:09:22 crc kubenswrapper[5120]: I0316 17:09:22.307867 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/d71c12b8-f085-4c19-99c6-f32186225f37-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"d71c12b8-f085-4c19-99c6-f32186225f37\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:09:22 crc kubenswrapper[5120]: I0316 17:09:22.308463 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d71c12b8-f085-4c19-99c6-f32186225f37-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"d71c12b8-f085-4c19-99c6-f32186225f37\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:09:22 crc kubenswrapper[5120]: I0316 17:09:22.330433 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d71c12b8-f085-4c19-99c6-f32186225f37-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"d71c12b8-f085-4c19-99c6-f32186225f37\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:09:22 crc kubenswrapper[5120]: I0316 17:09:22.331902 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5f0f24cd-dbef-4a0a-9e2b-cb5a170982aa-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"5f0f24cd-dbef-4a0a-9e2b-cb5a170982aa\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:09:22 crc kubenswrapper[5120]: I0316 17:09:22.337501 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/5f0f24cd-dbef-4a0a-9e2b-cb5a170982aa-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"5f0f24cd-dbef-4a0a-9e2b-cb5a170982aa\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:09:22 crc kubenswrapper[5120]: I0316 17:09:22.340561 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/d71c12b8-f085-4c19-99c6-f32186225f37-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"d71c12b8-f085-4c19-99c6-f32186225f37\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:09:22 crc kubenswrapper[5120]: I0316 17:09:22.341203 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4z6p\" (UniqueName: \"kubernetes.io/projected/5f0f24cd-dbef-4a0a-9e2b-cb5a170982aa-kube-api-access-m4z6p\") pod \"glance-default-external-api-0\" (UID: \"5f0f24cd-dbef-4a0a-9e2b-cb5a170982aa\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:09:22 crc kubenswrapper[5120]: I0316 17:09:22.355846 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxvhs\" (UniqueName: \"kubernetes.io/projected/d71c12b8-f085-4c19-99c6-f32186225f37-kube-api-access-cxvhs\") pod \"nova-cell1-novncproxy-0\" (UID: \"d71c12b8-f085-4c19-99c6-f32186225f37\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:09:22 crc kubenswrapper[5120]: I0316 17:09:22.361435 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/10bd837b-2e0d-460b-a254-20e23b6768f7-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "10bd837b-2e0d-460b-a254-20e23b6768f7" (UID: "10bd837b-2e0d-460b-a254-20e23b6768f7"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:09:22 crc kubenswrapper[5120]: I0316 17:09:22.367333 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/10bd837b-2e0d-460b-a254-20e23b6768f7-memcached-tls-certs" (OuterVolumeSpecName: "memcached-tls-certs") pod "10bd837b-2e0d-460b-a254-20e23b6768f7" (UID: "10bd837b-2e0d-460b-a254-20e23b6768f7"). InnerVolumeSpecName "memcached-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:09:22 crc kubenswrapper[5120]: I0316 17:09:22.367350 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"glance-default-external-api-0\" (UID: \"5f0f24cd-dbef-4a0a-9e2b-cb5a170982aa\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:09:22 crc kubenswrapper[5120]: I0316 17:09:22.390382 5120 reconciler_common.go:299] "Volume detached for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/10bd837b-2e0d-460b-a254-20e23b6768f7-memcached-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:22 crc kubenswrapper[5120]: I0316 17:09:22.390435 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/10bd837b-2e0d-460b-a254-20e23b6768f7-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:22 crc kubenswrapper[5120]: I0316 17:09:22.417538 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 17:09:22 crc kubenswrapper[5120]: I0316 17:09:22.420434 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:09:22 crc kubenswrapper[5120]: I0316 17:09:22.470361 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:09:22 crc kubenswrapper[5120]: I0316 17:09:22.549993 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:09:22 crc kubenswrapper[5120]: I0316 17:09:22.707407 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="15200613-4843-450f-bf1e-e7b152c48f43" path="/var/lib/kubelet/pods/15200613-4843-450f-bf1e-e7b152c48f43/volumes" Mar 16 17:09:22 crc kubenswrapper[5120]: I0316 17:09:22.709430 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="76f0322f-b14b-4b9b-9665-2121e3b21629" path="/var/lib/kubelet/pods/76f0322f-b14b-4b9b-9665-2121e3b21629/volumes" Mar 16 17:09:22 crc kubenswrapper[5120]: I0316 17:09:22.710215 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dfe74d0c-e886-4057-8cb1-0bdb487b317c" path="/var/lib/kubelet/pods/dfe74d0c-e886-4057-8cb1-0bdb487b317c/volumes" Mar 16 17:09:22 crc kubenswrapper[5120]: I0316 17:09:22.710879 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3" path="/var/lib/kubelet/pods/eb0ce4b5-78cb-4998-aeca-0a15a6ae0ba3/volumes" Mar 16 17:09:22 crc kubenswrapper[5120]: I0316 17:09:22.726055 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"32194c8a-90a1-4132-9b75-3882418d7f7d","Type":"ContainerStarted","Data":"fdf922633e503ea36030a917a5229c04457ede652c006e23427353cdcb2f036a"} Mar 16 17:09:22 crc kubenswrapper[5120]: I0316 17:09:22.764066 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-6448f564f4-flpdw" event={"ID":"3e60d330-61c0-4a9b-ac47-b35f12e5fd66","Type":"ContainerStarted","Data":"ee89fe5fa4f1a948d6acb067c8ec91895dbd831d32a6ddad7d94acac43b34211"} Mar 16 17:09:22 crc kubenswrapper[5120]: I0316 17:09:22.765487 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/neutron-6448f564f4-flpdw" Mar 16 17:09:22 crc kubenswrapper[5120]: I0316 17:09:22.776281 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Mar 16 17:09:22 crc kubenswrapper[5120]: I0316 17:09:22.777082 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"10bd837b-2e0d-460b-a254-20e23b6768f7","Type":"ContainerDied","Data":"baefced4d9c77c78e2d6c84beb74d1589a2d91b4e3cdc77b44124dd53354c531"} Mar 16 17:09:22 crc kubenswrapper[5120]: I0316 17:09:22.777222 5120 scope.go:117] "RemoveContainer" containerID="e19ce5213f51e39d0fe500fc1b09e0c84e9115038d851fdb05d0763df81163f5" Mar 16 17:09:22 crc kubenswrapper[5120]: I0316 17:09:22.789839 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-6448f564f4-flpdw" podStartSLOduration=3.789821579 podStartE2EDuration="3.789821579s" podCreationTimestamp="2026-03-16 17:09:19 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:09:22.784271466 +0000 UTC m=+5864.938203123" watchObservedRunningTime="2026-03-16 17:09:22.789821579 +0000 UTC m=+5864.943753236" Mar 16 17:09:22 crc kubenswrapper[5120]: I0316 17:09:22.858397 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 17:09:22 crc kubenswrapper[5120]: I0316 17:09:22.898857 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 17:09:22 crc kubenswrapper[5120]: I0316 17:09:22.915860 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 17:09:22 crc kubenswrapper[5120]: I0316 17:09:22.917279 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10bd837b-2e0d-460b-a254-20e23b6768f7" containerName="memcached" Mar 16 17:09:22 crc kubenswrapper[5120]: I0316 17:09:22.917309 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="10bd837b-2e0d-460b-a254-20e23b6768f7" containerName="memcached" Mar 16 17:09:22 crc kubenswrapper[5120]: I0316 17:09:22.917579 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="10bd837b-2e0d-460b-a254-20e23b6768f7" containerName="memcached" Mar 16 17:09:22 crc kubenswrapper[5120]: I0316 17:09:22.939059 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 17:09:22 crc kubenswrapper[5120]: I0316 17:09:22.939224 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Mar 16 17:09:22 crc kubenswrapper[5120]: I0316 17:09:22.943103 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"memcached-memcached-dockercfg-ss77k\"" Mar 16 17:09:22 crc kubenswrapper[5120]: I0316 17:09:22.943451 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"memcached-config-data\"" Mar 16 17:09:22 crc kubenswrapper[5120]: I0316 17:09:22.943672 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-memcached-svc\"" Mar 16 17:09:22 crc kubenswrapper[5120]: I0316 17:09:22.945603 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/a2a1847f-6881-4af9-b38b-35fd23e3f85e-kolla-config\") pod \"memcached-0\" (UID: \"a2a1847f-6881-4af9-b38b-35fd23e3f85e\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 17:09:22 crc kubenswrapper[5120]: I0316 17:09:22.945633 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/a2a1847f-6881-4af9-b38b-35fd23e3f85e-config-data\") pod \"memcached-0\" (UID: \"a2a1847f-6881-4af9-b38b-35fd23e3f85e\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 17:09:22 crc kubenswrapper[5120]: I0316 17:09:22.945802 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2x7z\" (UniqueName: \"kubernetes.io/projected/a2a1847f-6881-4af9-b38b-35fd23e3f85e-kube-api-access-k2x7z\") pod \"memcached-0\" (UID: \"a2a1847f-6881-4af9-b38b-35fd23e3f85e\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 17:09:22 crc kubenswrapper[5120]: I0316 17:09:22.945962 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a2a1847f-6881-4af9-b38b-35fd23e3f85e-combined-ca-bundle\") pod \"memcached-0\" (UID: \"a2a1847f-6881-4af9-b38b-35fd23e3f85e\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 17:09:22 crc kubenswrapper[5120]: I0316 17:09:22.946246 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/a2a1847f-6881-4af9-b38b-35fd23e3f85e-memcached-tls-certs\") pod \"memcached-0\" (UID: \"a2a1847f-6881-4af9-b38b-35fd23e3f85e\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 17:09:23 crc kubenswrapper[5120]: I0316 17:09:23.049928 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a2a1847f-6881-4af9-b38b-35fd23e3f85e-combined-ca-bundle\") pod \"memcached-0\" (UID: \"a2a1847f-6881-4af9-b38b-35fd23e3f85e\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 17:09:23 crc kubenswrapper[5120]: I0316 17:09:23.050809 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/a2a1847f-6881-4af9-b38b-35fd23e3f85e-memcached-tls-certs\") pod \"memcached-0\" (UID: \"a2a1847f-6881-4af9-b38b-35fd23e3f85e\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 17:09:23 crc kubenswrapper[5120]: I0316 17:09:23.051121 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/a2a1847f-6881-4af9-b38b-35fd23e3f85e-kolla-config\") pod \"memcached-0\" (UID: \"a2a1847f-6881-4af9-b38b-35fd23e3f85e\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 17:09:23 crc kubenswrapper[5120]: I0316 17:09:23.051155 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/a2a1847f-6881-4af9-b38b-35fd23e3f85e-config-data\") pod \"memcached-0\" (UID: \"a2a1847f-6881-4af9-b38b-35fd23e3f85e\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 17:09:23 crc kubenswrapper[5120]: I0316 17:09:23.051297 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k2x7z\" (UniqueName: \"kubernetes.io/projected/a2a1847f-6881-4af9-b38b-35fd23e3f85e-kube-api-access-k2x7z\") pod \"memcached-0\" (UID: \"a2a1847f-6881-4af9-b38b-35fd23e3f85e\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 17:09:23 crc kubenswrapper[5120]: I0316 17:09:23.059633 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 17:09:23 crc kubenswrapper[5120]: I0316 17:09:23.062070 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/a2a1847f-6881-4af9-b38b-35fd23e3f85e-kolla-config\") pod \"memcached-0\" (UID: \"a2a1847f-6881-4af9-b38b-35fd23e3f85e\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 17:09:23 crc kubenswrapper[5120]: I0316 17:09:23.079362 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/a2a1847f-6881-4af9-b38b-35fd23e3f85e-config-data\") pod \"memcached-0\" (UID: \"a2a1847f-6881-4af9-b38b-35fd23e3f85e\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 17:09:23 crc kubenswrapper[5120]: I0316 17:09:23.088395 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/a2a1847f-6881-4af9-b38b-35fd23e3f85e-memcached-tls-certs\") pod \"memcached-0\" (UID: \"a2a1847f-6881-4af9-b38b-35fd23e3f85e\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 17:09:23 crc kubenswrapper[5120]: I0316 17:09:23.089242 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a2a1847f-6881-4af9-b38b-35fd23e3f85e-combined-ca-bundle\") pod \"memcached-0\" (UID: \"a2a1847f-6881-4af9-b38b-35fd23e3f85e\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 17:09:23 crc kubenswrapper[5120]: I0316 17:09:23.090937 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2x7z\" (UniqueName: \"kubernetes.io/projected/a2a1847f-6881-4af9-b38b-35fd23e3f85e-kube-api-access-k2x7z\") pod \"memcached-0\" (UID: \"a2a1847f-6881-4af9-b38b-35fd23e3f85e\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 17:09:23 crc kubenswrapper[5120]: I0316 17:09:23.236436 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 17:09:23 crc kubenswrapper[5120]: I0316 17:09:23.270408 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Mar 16 17:09:23 crc kubenswrapper[5120]: I0316 17:09:23.335287 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 17:09:23 crc kubenswrapper[5120]: I0316 17:09:23.790392 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"5f0f24cd-dbef-4a0a-9e2b-cb5a170982aa","Type":"ContainerStarted","Data":"df0284bfca2c24c9532505ac5ca4cef9f7d0ec93477366ecf2e2b4de8400f3c6"} Mar 16 17:09:23 crc kubenswrapper[5120]: I0316 17:09:23.798755 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"d0852906-6351-45a9-a44c-0bf3f4c29496","Type":"ContainerStarted","Data":"7479907e60cd45c57bb327c8525633c7e28e05280c1ebdf29bb22d846f52bca0"} Mar 16 17:09:23 crc kubenswrapper[5120]: I0316 17:09:23.798812 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"d0852906-6351-45a9-a44c-0bf3f4c29496","Type":"ContainerStarted","Data":"44336d0a6e95d9fba65aa5d6a8f53822a1ebc5ac0db6e5789d688d9552d78e49"} Mar 16 17:09:23 crc kubenswrapper[5120]: I0316 17:09:23.799872 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 17:09:23 crc kubenswrapper[5120]: I0316 17:09:23.809138 5120 generic.go:358] "Generic (PLEG): container finished" podID="431c87cc-4a05-421e-a7d6-74fa09328220" containerID="33661e25e8fa4b583a11c440c5312f2c3e50e752530fcc9b7fd8fcd89222eb0b" exitCode=0 Mar 16 17:09:23 crc kubenswrapper[5120]: I0316 17:09:23.809481 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"431c87cc-4a05-421e-a7d6-74fa09328220","Type":"ContainerDied","Data":"33661e25e8fa4b583a11c440c5312f2c3e50e752530fcc9b7fd8fcd89222eb0b"} Mar 16 17:09:23 crc kubenswrapper[5120]: I0316 17:09:23.809540 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"431c87cc-4a05-421e-a7d6-74fa09328220","Type":"ContainerDied","Data":"023ef7cb276d884a0b0822d7ca0c829887f4ff6e850fe7e26f26389090714167"} Mar 16 17:09:23 crc kubenswrapper[5120]: I0316 17:09:23.809555 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="023ef7cb276d884a0b0822d7ca0c829887f4ff6e850fe7e26f26389090714167" Mar 16 17:09:23 crc kubenswrapper[5120]: I0316 17:09:23.812466 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"d71c12b8-f085-4c19-99c6-f32186225f37","Type":"ContainerStarted","Data":"5a6b72810b988c074dd17bf982cf852010ef150f455ba52dd5f7d0b95de74f55"} Mar 16 17:09:23 crc kubenswrapper[5120]: I0316 17:09:23.828260 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podStartSLOduration=2.828237976 podStartE2EDuration="2.828237976s" podCreationTimestamp="2026-03-16 17:09:21 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:09:23.816221704 +0000 UTC m=+5865.970153361" watchObservedRunningTime="2026-03-16 17:09:23.828237976 +0000 UTC m=+5865.982169643" Mar 16 17:09:23 crc kubenswrapper[5120]: I0316 17:09:23.846154 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:09:23 crc kubenswrapper[5120]: I0316 17:09:23.902150 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"431c87cc-4a05-421e-a7d6-74fa09328220\" (UID: \"431c87cc-4a05-421e-a7d6-74fa09328220\") " Mar 16 17:09:23 crc kubenswrapper[5120]: I0316 17:09:23.902259 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/431c87cc-4a05-421e-a7d6-74fa09328220-config-data\") pod \"431c87cc-4a05-421e-a7d6-74fa09328220\" (UID: \"431c87cc-4a05-421e-a7d6-74fa09328220\") " Mar 16 17:09:23 crc kubenswrapper[5120]: I0316 17:09:23.902475 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/431c87cc-4a05-421e-a7d6-74fa09328220-scripts\") pod \"431c87cc-4a05-421e-a7d6-74fa09328220\" (UID: \"431c87cc-4a05-421e-a7d6-74fa09328220\") " Mar 16 17:09:23 crc kubenswrapper[5120]: I0316 17:09:23.902682 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/431c87cc-4a05-421e-a7d6-74fa09328220-internal-tls-certs\") pod \"431c87cc-4a05-421e-a7d6-74fa09328220\" (UID: \"431c87cc-4a05-421e-a7d6-74fa09328220\") " Mar 16 17:09:23 crc kubenswrapper[5120]: I0316 17:09:23.902888 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/431c87cc-4a05-421e-a7d6-74fa09328220-logs\") pod \"431c87cc-4a05-421e-a7d6-74fa09328220\" (UID: \"431c87cc-4a05-421e-a7d6-74fa09328220\") " Mar 16 17:09:23 crc kubenswrapper[5120]: I0316 17:09:23.903125 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/431c87cc-4a05-421e-a7d6-74fa09328220-combined-ca-bundle\") pod \"431c87cc-4a05-421e-a7d6-74fa09328220\" (UID: \"431c87cc-4a05-421e-a7d6-74fa09328220\") " Mar 16 17:09:23 crc kubenswrapper[5120]: I0316 17:09:23.903320 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qcmkl\" (UniqueName: \"kubernetes.io/projected/431c87cc-4a05-421e-a7d6-74fa09328220-kube-api-access-qcmkl\") pod \"431c87cc-4a05-421e-a7d6-74fa09328220\" (UID: \"431c87cc-4a05-421e-a7d6-74fa09328220\") " Mar 16 17:09:23 crc kubenswrapper[5120]: I0316 17:09:23.903451 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/431c87cc-4a05-421e-a7d6-74fa09328220-httpd-run\") pod \"431c87cc-4a05-421e-a7d6-74fa09328220\" (UID: \"431c87cc-4a05-421e-a7d6-74fa09328220\") " Mar 16 17:09:23 crc kubenswrapper[5120]: I0316 17:09:23.904617 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/431c87cc-4a05-421e-a7d6-74fa09328220-logs" (OuterVolumeSpecName: "logs") pod "431c87cc-4a05-421e-a7d6-74fa09328220" (UID: "431c87cc-4a05-421e-a7d6-74fa09328220"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:09:23 crc kubenswrapper[5120]: I0316 17:09:23.904797 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/431c87cc-4a05-421e-a7d6-74fa09328220-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "431c87cc-4a05-421e-a7d6-74fa09328220" (UID: "431c87cc-4a05-421e-a7d6-74fa09328220"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:09:23 crc kubenswrapper[5120]: I0316 17:09:23.908964 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/431c87cc-4a05-421e-a7d6-74fa09328220-logs\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:23 crc kubenswrapper[5120]: I0316 17:09:23.908993 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/431c87cc-4a05-421e-a7d6-74fa09328220-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:23 crc kubenswrapper[5120]: I0316 17:09:23.921904 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage06-crc" (OuterVolumeSpecName: "glance") pod "431c87cc-4a05-421e-a7d6-74fa09328220" (UID: "431c87cc-4a05-421e-a7d6-74fa09328220"). InnerVolumeSpecName "local-storage06-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 17:09:23 crc kubenswrapper[5120]: I0316 17:09:23.921969 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/431c87cc-4a05-421e-a7d6-74fa09328220-kube-api-access-qcmkl" (OuterVolumeSpecName: "kube-api-access-qcmkl") pod "431c87cc-4a05-421e-a7d6-74fa09328220" (UID: "431c87cc-4a05-421e-a7d6-74fa09328220"). InnerVolumeSpecName "kube-api-access-qcmkl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:09:23 crc kubenswrapper[5120]: I0316 17:09:23.942209 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/431c87cc-4a05-421e-a7d6-74fa09328220-scripts" (OuterVolumeSpecName: "scripts") pod "431c87cc-4a05-421e-a7d6-74fa09328220" (UID: "431c87cc-4a05-421e-a7d6-74fa09328220"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:09:23 crc kubenswrapper[5120]: I0316 17:09:23.957906 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/431c87cc-4a05-421e-a7d6-74fa09328220-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "431c87cc-4a05-421e-a7d6-74fa09328220" (UID: "431c87cc-4a05-421e-a7d6-74fa09328220"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:09:23 crc kubenswrapper[5120]: I0316 17:09:23.978161 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 17:09:24 crc kubenswrapper[5120]: I0316 17:09:24.012343 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/431c87cc-4a05-421e-a7d6-74fa09328220-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:24 crc kubenswrapper[5120]: I0316 17:09:24.012377 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qcmkl\" (UniqueName: \"kubernetes.io/projected/431c87cc-4a05-421e-a7d6-74fa09328220-kube-api-access-qcmkl\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:24 crc kubenswrapper[5120]: I0316 17:09:24.012410 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") on node \"crc\" " Mar 16 17:09:24 crc kubenswrapper[5120]: I0316 17:09:24.012419 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/431c87cc-4a05-421e-a7d6-74fa09328220-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:24 crc kubenswrapper[5120]: I0316 17:09:24.031801 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage06-crc" (UniqueName: "kubernetes.io/local-volume/local-storage06-crc") on node "crc" Mar 16 17:09:24 crc kubenswrapper[5120]: I0316 17:09:24.067931 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/431c87cc-4a05-421e-a7d6-74fa09328220-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "431c87cc-4a05-421e-a7d6-74fa09328220" (UID: "431c87cc-4a05-421e-a7d6-74fa09328220"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:09:24 crc kubenswrapper[5120]: I0316 17:09:24.082159 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/431c87cc-4a05-421e-a7d6-74fa09328220-config-data" (OuterVolumeSpecName: "config-data") pod "431c87cc-4a05-421e-a7d6-74fa09328220" (UID: "431c87cc-4a05-421e-a7d6-74fa09328220"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:09:24 crc kubenswrapper[5120]: I0316 17:09:24.116789 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/431c87cc-4a05-421e-a7d6-74fa09328220-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:24 crc kubenswrapper[5120]: I0316 17:09:24.116841 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:24 crc kubenswrapper[5120]: I0316 17:09:24.116851 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/431c87cc-4a05-421e-a7d6-74fa09328220-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:24 crc kubenswrapper[5120]: I0316 17:09:24.361404 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58664f4b7c-kc5rb" Mar 16 17:09:24 crc kubenswrapper[5120]: I0316 17:09:24.486224 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-77c6fdf6b9-g6qx5"] Mar 16 17:09:24 crc kubenswrapper[5120]: I0316 17:09:24.486519 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-77c6fdf6b9-g6qx5" podUID="01210506-f19f-4c41-9245-e8b287618649" containerName="dnsmasq-dns" containerID="cri-o://d8ce36678684ad10fdcc7f2a74aa9bb51ab1d711a3814757cc6a3a1c1aa05e09" gracePeriod=10 Mar 16 17:09:24 crc kubenswrapper[5120]: I0316 17:09:24.562175 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-77c6fdf6b9-g6qx5" podUID="01210506-f19f-4c41-9245-e8b287618649" containerName="dnsmasq-dns" probeResult="failure" output="dial tcp 10.217.1.152:5353: connect: connection refused" Mar 16 17:09:24 crc kubenswrapper[5120]: I0316 17:09:24.668337 5120 scope.go:117] "RemoveContainer" containerID="db39d192fa687a13805537d08ad22fed1ef362ef5027c920a616297dc55a8ea9" Mar 16 17:09:24 crc kubenswrapper[5120]: E0316 17:09:24.668587 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 17:09:24 crc kubenswrapper[5120]: I0316 17:09:24.687479 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="10bd837b-2e0d-460b-a254-20e23b6768f7" path="/var/lib/kubelet/pods/10bd837b-2e0d-460b-a254-20e23b6768f7/volumes" Mar 16 17:09:24 crc kubenswrapper[5120]: I0316 17:09:24.848054 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"a2a1847f-6881-4af9-b38b-35fd23e3f85e","Type":"ContainerStarted","Data":"57df3117bc5eda590570b6f64cf2888a4fefbb6ecab492edae999ed27aeffda7"} Mar 16 17:09:24 crc kubenswrapper[5120]: I0316 17:09:24.848104 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"a2a1847f-6881-4af9-b38b-35fd23e3f85e","Type":"ContainerStarted","Data":"98534bbbbf2a717eb7df1c0552eae61de4093f5511c68137c952bd45569646cc"} Mar 16 17:09:24 crc kubenswrapper[5120]: I0316 17:09:24.851406 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/memcached-0" Mar 16 17:09:24 crc kubenswrapper[5120]: I0316 17:09:24.860006 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"d71c12b8-f085-4c19-99c6-f32186225f37","Type":"ContainerStarted","Data":"cccaa42f1ab1de1bb520c971a2c5ed0d72121384b8eff62fa4e74f4362185505"} Mar 16 17:09:24 crc kubenswrapper[5120]: I0316 17:09:24.866377 5120 generic.go:358] "Generic (PLEG): container finished" podID="01210506-f19f-4c41-9245-e8b287618649" containerID="d8ce36678684ad10fdcc7f2a74aa9bb51ab1d711a3814757cc6a3a1c1aa05e09" exitCode=0 Mar 16 17:09:24 crc kubenswrapper[5120]: I0316 17:09:24.866539 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-77c6fdf6b9-g6qx5" event={"ID":"01210506-f19f-4c41-9245-e8b287618649","Type":"ContainerDied","Data":"d8ce36678684ad10fdcc7f2a74aa9bb51ab1d711a3814757cc6a3a1c1aa05e09"} Mar 16 17:09:24 crc kubenswrapper[5120]: I0316 17:09:24.907081 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:09:24 crc kubenswrapper[5120]: I0316 17:09:24.910382 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"5f0f24cd-dbef-4a0a-9e2b-cb5a170982aa","Type":"ContainerStarted","Data":"ab749e9165c3b32a457ee7d52df32d44bba16252b9d88677d4888b54e32947a7"} Mar 16 17:09:24 crc kubenswrapper[5120]: I0316 17:09:24.923982 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/memcached-0" podStartSLOduration=2.923958056 podStartE2EDuration="2.923958056s" podCreationTimestamp="2026-03-16 17:09:22 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:09:24.870290843 +0000 UTC m=+5867.024222520" watchObservedRunningTime="2026-03-16 17:09:24.923958056 +0000 UTC m=+5867.077889713" Mar 16 17:09:24 crc kubenswrapper[5120]: I0316 17:09:24.990648 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podStartSLOduration=3.9906296169999997 podStartE2EDuration="3.990629617s" podCreationTimestamp="2026-03-16 17:09:21 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:09:24.893899245 +0000 UTC m=+5867.047830932" watchObservedRunningTime="2026-03-16 17:09:24.990629617 +0000 UTC m=+5867.144561264" Mar 16 17:09:25 crc kubenswrapper[5120]: I0316 17:09:25.066671 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 17:09:25 crc kubenswrapper[5120]: I0316 17:09:25.103073 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 17:09:25 crc kubenswrapper[5120]: I0316 17:09:25.148818 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 17:09:25 crc kubenswrapper[5120]: I0316 17:09:25.149978 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="431c87cc-4a05-421e-a7d6-74fa09328220" containerName="glance-log" Mar 16 17:09:25 crc kubenswrapper[5120]: I0316 17:09:25.149992 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="431c87cc-4a05-421e-a7d6-74fa09328220" containerName="glance-log" Mar 16 17:09:25 crc kubenswrapper[5120]: I0316 17:09:25.150063 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="431c87cc-4a05-421e-a7d6-74fa09328220" containerName="glance-httpd" Mar 16 17:09:25 crc kubenswrapper[5120]: I0316 17:09:25.150075 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="431c87cc-4a05-421e-a7d6-74fa09328220" containerName="glance-httpd" Mar 16 17:09:25 crc kubenswrapper[5120]: I0316 17:09:25.150276 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="431c87cc-4a05-421e-a7d6-74fa09328220" containerName="glance-log" Mar 16 17:09:25 crc kubenswrapper[5120]: I0316 17:09:25.150298 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="431c87cc-4a05-421e-a7d6-74fa09328220" containerName="glance-httpd" Mar 16 17:09:25 crc kubenswrapper[5120]: I0316 17:09:25.162420 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:09:25 crc kubenswrapper[5120]: I0316 17:09:25.178134 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-internal-svc\"" Mar 16 17:09:25 crc kubenswrapper[5120]: I0316 17:09:25.178313 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-internal-config-data\"" Mar 16 17:09:25 crc kubenswrapper[5120]: I0316 17:09:25.179797 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 17:09:25 crc kubenswrapper[5120]: I0316 17:09:25.281402 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/30f9a0a6-4a77-4bfe-930e-2dc3961f78e2-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"30f9a0a6-4a77-4bfe-930e-2dc3961f78e2\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:09:25 crc kubenswrapper[5120]: I0316 17:09:25.281700 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/30f9a0a6-4a77-4bfe-930e-2dc3961f78e2-logs\") pod \"glance-default-internal-api-0\" (UID: \"30f9a0a6-4a77-4bfe-930e-2dc3961f78e2\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:09:25 crc kubenswrapper[5120]: I0316 17:09:25.281740 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/30f9a0a6-4a77-4bfe-930e-2dc3961f78e2-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"30f9a0a6-4a77-4bfe-930e-2dc3961f78e2\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:09:25 crc kubenswrapper[5120]: I0316 17:09:25.281920 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6v5ts\" (UniqueName: \"kubernetes.io/projected/30f9a0a6-4a77-4bfe-930e-2dc3961f78e2-kube-api-access-6v5ts\") pod \"glance-default-internal-api-0\" (UID: \"30f9a0a6-4a77-4bfe-930e-2dc3961f78e2\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:09:25 crc kubenswrapper[5120]: I0316 17:09:25.281965 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/30f9a0a6-4a77-4bfe-930e-2dc3961f78e2-scripts\") pod \"glance-default-internal-api-0\" (UID: \"30f9a0a6-4a77-4bfe-930e-2dc3961f78e2\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:09:25 crc kubenswrapper[5120]: I0316 17:09:25.282044 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/30f9a0a6-4a77-4bfe-930e-2dc3961f78e2-config-data\") pod \"glance-default-internal-api-0\" (UID: \"30f9a0a6-4a77-4bfe-930e-2dc3961f78e2\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:09:25 crc kubenswrapper[5120]: I0316 17:09:25.282094 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-77c6fdf6b9-g6qx5" Mar 16 17:09:25 crc kubenswrapper[5120]: I0316 17:09:25.282110 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"glance-default-internal-api-0\" (UID: \"30f9a0a6-4a77-4bfe-930e-2dc3961f78e2\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:09:25 crc kubenswrapper[5120]: I0316 17:09:25.282136 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/30f9a0a6-4a77-4bfe-930e-2dc3961f78e2-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"30f9a0a6-4a77-4bfe-930e-2dc3961f78e2\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:09:25 crc kubenswrapper[5120]: I0316 17:09:25.383586 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/01210506-f19f-4c41-9245-e8b287618649-config\") pod \"01210506-f19f-4c41-9245-e8b287618649\" (UID: \"01210506-f19f-4c41-9245-e8b287618649\") " Mar 16 17:09:25 crc kubenswrapper[5120]: I0316 17:09:25.383827 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/01210506-f19f-4c41-9245-e8b287618649-dnsmasq-svc\") pod \"01210506-f19f-4c41-9245-e8b287618649\" (UID: \"01210506-f19f-4c41-9245-e8b287618649\") " Mar 16 17:09:25 crc kubenswrapper[5120]: I0316 17:09:25.383859 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/01210506-f19f-4c41-9245-e8b287618649-dns-swift-storage-0\") pod \"01210506-f19f-4c41-9245-e8b287618649\" (UID: \"01210506-f19f-4c41-9245-e8b287618649\") " Mar 16 17:09:25 crc kubenswrapper[5120]: I0316 17:09:25.383932 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nmd9j\" (UniqueName: \"kubernetes.io/projected/01210506-f19f-4c41-9245-e8b287618649-kube-api-access-nmd9j\") pod \"01210506-f19f-4c41-9245-e8b287618649\" (UID: \"01210506-f19f-4c41-9245-e8b287618649\") " Mar 16 17:09:25 crc kubenswrapper[5120]: I0316 17:09:25.384574 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/30f9a0a6-4a77-4bfe-930e-2dc3961f78e2-scripts\") pod \"glance-default-internal-api-0\" (UID: \"30f9a0a6-4a77-4bfe-930e-2dc3961f78e2\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:09:25 crc kubenswrapper[5120]: I0316 17:09:25.384662 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/30f9a0a6-4a77-4bfe-930e-2dc3961f78e2-config-data\") pod \"glance-default-internal-api-0\" (UID: \"30f9a0a6-4a77-4bfe-930e-2dc3961f78e2\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:09:25 crc kubenswrapper[5120]: I0316 17:09:25.384722 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"glance-default-internal-api-0\" (UID: \"30f9a0a6-4a77-4bfe-930e-2dc3961f78e2\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:09:25 crc kubenswrapper[5120]: I0316 17:09:25.384747 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/30f9a0a6-4a77-4bfe-930e-2dc3961f78e2-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"30f9a0a6-4a77-4bfe-930e-2dc3961f78e2\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:09:25 crc kubenswrapper[5120]: I0316 17:09:25.384963 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/30f9a0a6-4a77-4bfe-930e-2dc3961f78e2-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"30f9a0a6-4a77-4bfe-930e-2dc3961f78e2\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:09:25 crc kubenswrapper[5120]: I0316 17:09:25.385005 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/30f9a0a6-4a77-4bfe-930e-2dc3961f78e2-logs\") pod \"glance-default-internal-api-0\" (UID: \"30f9a0a6-4a77-4bfe-930e-2dc3961f78e2\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:09:25 crc kubenswrapper[5120]: I0316 17:09:25.385068 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/30f9a0a6-4a77-4bfe-930e-2dc3961f78e2-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"30f9a0a6-4a77-4bfe-930e-2dc3961f78e2\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:09:25 crc kubenswrapper[5120]: I0316 17:09:25.385204 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6v5ts\" (UniqueName: \"kubernetes.io/projected/30f9a0a6-4a77-4bfe-930e-2dc3961f78e2-kube-api-access-6v5ts\") pod \"glance-default-internal-api-0\" (UID: \"30f9a0a6-4a77-4bfe-930e-2dc3961f78e2\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:09:25 crc kubenswrapper[5120]: I0316 17:09:25.387263 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"glance-default-internal-api-0\" (UID: \"30f9a0a6-4a77-4bfe-930e-2dc3961f78e2\") device mount path \"/mnt/openstack/pv06\"" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:09:25 crc kubenswrapper[5120]: I0316 17:09:25.397983 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/30f9a0a6-4a77-4bfe-930e-2dc3961f78e2-logs\") pod \"glance-default-internal-api-0\" (UID: \"30f9a0a6-4a77-4bfe-930e-2dc3961f78e2\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:09:25 crc kubenswrapper[5120]: I0316 17:09:25.404912 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/30f9a0a6-4a77-4bfe-930e-2dc3961f78e2-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"30f9a0a6-4a77-4bfe-930e-2dc3961f78e2\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:09:25 crc kubenswrapper[5120]: I0316 17:09:25.406962 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/30f9a0a6-4a77-4bfe-930e-2dc3961f78e2-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"30f9a0a6-4a77-4bfe-930e-2dc3961f78e2\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:09:25 crc kubenswrapper[5120]: I0316 17:09:25.408971 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01210506-f19f-4c41-9245-e8b287618649-kube-api-access-nmd9j" (OuterVolumeSpecName: "kube-api-access-nmd9j") pod "01210506-f19f-4c41-9245-e8b287618649" (UID: "01210506-f19f-4c41-9245-e8b287618649"). InnerVolumeSpecName "kube-api-access-nmd9j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:09:25 crc kubenswrapper[5120]: I0316 17:09:25.410158 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/30f9a0a6-4a77-4bfe-930e-2dc3961f78e2-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"30f9a0a6-4a77-4bfe-930e-2dc3961f78e2\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:09:25 crc kubenswrapper[5120]: I0316 17:09:25.414234 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/30f9a0a6-4a77-4bfe-930e-2dc3961f78e2-scripts\") pod \"glance-default-internal-api-0\" (UID: \"30f9a0a6-4a77-4bfe-930e-2dc3961f78e2\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:09:25 crc kubenswrapper[5120]: I0316 17:09:25.416485 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/30f9a0a6-4a77-4bfe-930e-2dc3961f78e2-config-data\") pod \"glance-default-internal-api-0\" (UID: \"30f9a0a6-4a77-4bfe-930e-2dc3961f78e2\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:09:25 crc kubenswrapper[5120]: I0316 17:09:25.421398 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6v5ts\" (UniqueName: \"kubernetes.io/projected/30f9a0a6-4a77-4bfe-930e-2dc3961f78e2-kube-api-access-6v5ts\") pod \"glance-default-internal-api-0\" (UID: \"30f9a0a6-4a77-4bfe-930e-2dc3961f78e2\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:09:25 crc kubenswrapper[5120]: I0316 17:09:25.466431 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/01210506-f19f-4c41-9245-e8b287618649-config" (OuterVolumeSpecName: "config") pod "01210506-f19f-4c41-9245-e8b287618649" (UID: "01210506-f19f-4c41-9245-e8b287618649"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:09:25 crc kubenswrapper[5120]: I0316 17:09:25.466885 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/01210506-f19f-4c41-9245-e8b287618649-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "01210506-f19f-4c41-9245-e8b287618649" (UID: "01210506-f19f-4c41-9245-e8b287618649"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:09:25 crc kubenswrapper[5120]: I0316 17:09:25.473466 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"glance-default-internal-api-0\" (UID: \"30f9a0a6-4a77-4bfe-930e-2dc3961f78e2\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:09:25 crc kubenswrapper[5120]: I0316 17:09:25.476534 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/01210506-f19f-4c41-9245-e8b287618649-dns-swift-storage-0" (OuterVolumeSpecName: "dns-swift-storage-0") pod "01210506-f19f-4c41-9245-e8b287618649" (UID: "01210506-f19f-4c41-9245-e8b287618649"). InnerVolumeSpecName "dns-swift-storage-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:09:25 crc kubenswrapper[5120]: I0316 17:09:25.489992 5120 reconciler_common.go:299] "Volume detached for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/01210506-f19f-4c41-9245-e8b287618649-dns-swift-storage-0\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:25 crc kubenswrapper[5120]: I0316 17:09:25.490039 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nmd9j\" (UniqueName: \"kubernetes.io/projected/01210506-f19f-4c41-9245-e8b287618649-kube-api-access-nmd9j\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:25 crc kubenswrapper[5120]: I0316 17:09:25.490051 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/01210506-f19f-4c41-9245-e8b287618649-config\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:25 crc kubenswrapper[5120]: I0316 17:09:25.490062 5120 reconciler_common.go:299] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/01210506-f19f-4c41-9245-e8b287618649-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:25 crc kubenswrapper[5120]: I0316 17:09:25.565269 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:09:25 crc kubenswrapper[5120]: I0316 17:09:25.921828 5120 generic.go:358] "Generic (PLEG): container finished" podID="32194c8a-90a1-4132-9b75-3882418d7f7d" containerID="fdf922633e503ea36030a917a5229c04457ede652c006e23427353cdcb2f036a" exitCode=1 Mar 16 17:09:25 crc kubenswrapper[5120]: I0316 17:09:25.921900 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"32194c8a-90a1-4132-9b75-3882418d7f7d","Type":"ContainerDied","Data":"fdf922633e503ea36030a917a5229c04457ede652c006e23427353cdcb2f036a"} Mar 16 17:09:25 crc kubenswrapper[5120]: I0316 17:09:25.922695 5120 scope.go:117] "RemoveContainer" containerID="bbcffb8c84703cef27f1a9a537df36babdb550b7a8ff5473f1bb80d9395d63f6" Mar 16 17:09:25 crc kubenswrapper[5120]: I0316 17:09:25.923354 5120 scope.go:117] "RemoveContainer" containerID="fdf922633e503ea36030a917a5229c04457ede652c006e23427353cdcb2f036a" Mar 16 17:09:25 crc kubenswrapper[5120]: E0316 17:09:25.923681 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nova-scheduler-scheduler\" with CrashLoopBackOff: \"back-off 10s restarting failed container=nova-scheduler-scheduler pod=nova-scheduler-0_openstack-kuttl-tests(32194c8a-90a1-4132-9b75-3882418d7f7d)\"" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="32194c8a-90a1-4132-9b75-3882418d7f7d" Mar 16 17:09:25 crc kubenswrapper[5120]: I0316 17:09:25.939547 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-77c6fdf6b9-g6qx5" Mar 16 17:09:25 crc kubenswrapper[5120]: I0316 17:09:25.939821 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-77c6fdf6b9-g6qx5" event={"ID":"01210506-f19f-4c41-9245-e8b287618649","Type":"ContainerDied","Data":"70f3578e00ca4c9ef1a3c3ee1ab0fff95a41059d2001a2a8cbbf8538f47d51ac"} Mar 16 17:09:25 crc kubenswrapper[5120]: I0316 17:09:25.952230 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"5f0f24cd-dbef-4a0a-9e2b-cb5a170982aa","Type":"ContainerStarted","Data":"3becf490b4bf28a84982a708edd2116d8bc113f71c16c14e0c56f117360c4d97"} Mar 16 17:09:25 crc kubenswrapper[5120]: I0316 17:09:25.985169 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-external-api-0" podStartSLOduration=4.985150491 podStartE2EDuration="4.985150491s" podCreationTimestamp="2026-03-16 17:09:21 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:09:25.972565673 +0000 UTC m=+5868.126497330" watchObservedRunningTime="2026-03-16 17:09:25.985150491 +0000 UTC m=+5868.139082148" Mar 16 17:09:26 crc kubenswrapper[5120]: I0316 17:09:26.003003 5120 scope.go:117] "RemoveContainer" containerID="d8ce36678684ad10fdcc7f2a74aa9bb51ab1d711a3814757cc6a3a1c1aa05e09" Mar 16 17:09:26 crc kubenswrapper[5120]: I0316 17:09:26.011714 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-77c6fdf6b9-g6qx5"] Mar 16 17:09:26 crc kubenswrapper[5120]: I0316 17:09:26.023432 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-77c6fdf6b9-g6qx5"] Mar 16 17:09:26 crc kubenswrapper[5120]: I0316 17:09:26.038969 5120 scope.go:117] "RemoveContainer" containerID="e18b7f5318a0899ff7447d43bcc97722b75931fc63f4eb188ef5750d34a03978" Mar 16 17:09:26 crc kubenswrapper[5120]: I0316 17:09:26.083407 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 17:09:26 crc kubenswrapper[5120]: W0316 17:09:26.095520 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod30f9a0a6_4a77_4bfe_930e_2dc3961f78e2.slice/crio-4268ce881ad08f4bc0d2662c9afe7dc075a0192af9b7397c767e35b8a010be66 WatchSource:0}: Error finding container 4268ce881ad08f4bc0d2662c9afe7dc075a0192af9b7397c767e35b8a010be66: Status 404 returned error can't find the container with id 4268ce881ad08f4bc0d2662c9afe7dc075a0192af9b7397c767e35b8a010be66 Mar 16 17:09:26 crc kubenswrapper[5120]: I0316 17:09:26.678743 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="01210506-f19f-4c41-9245-e8b287618649" path="/var/lib/kubelet/pods/01210506-f19f-4c41-9245-e8b287618649/volumes" Mar 16 17:09:26 crc kubenswrapper[5120]: I0316 17:09:26.679926 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="431c87cc-4a05-421e-a7d6-74fa09328220" path="/var/lib/kubelet/pods/431c87cc-4a05-421e-a7d6-74fa09328220/volumes" Mar 16 17:09:26 crc kubenswrapper[5120]: I0316 17:09:26.714445 5120 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:09:26 crc kubenswrapper[5120]: I0316 17:09:26.714495 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:09:26 crc kubenswrapper[5120]: I0316 17:09:26.714509 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:09:26 crc kubenswrapper[5120]: I0316 17:09:26.972724 5120 generic.go:358] "Generic (PLEG): container finished" podID="d0852906-6351-45a9-a44c-0bf3f4c29496" containerID="7479907e60cd45c57bb327c8525633c7e28e05280c1ebdf29bb22d846f52bca0" exitCode=1 Mar 16 17:09:26 crc kubenswrapper[5120]: I0316 17:09:26.972797 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"d0852906-6351-45a9-a44c-0bf3f4c29496","Type":"ContainerDied","Data":"7479907e60cd45c57bb327c8525633c7e28e05280c1ebdf29bb22d846f52bca0"} Mar 16 17:09:26 crc kubenswrapper[5120]: I0316 17:09:26.973533 5120 scope.go:117] "RemoveContainer" containerID="7479907e60cd45c57bb327c8525633c7e28e05280c1ebdf29bb22d846f52bca0" Mar 16 17:09:26 crc kubenswrapper[5120]: I0316 17:09:26.979041 5120 scope.go:117] "RemoveContainer" containerID="fdf922633e503ea36030a917a5229c04457ede652c006e23427353cdcb2f036a" Mar 16 17:09:26 crc kubenswrapper[5120]: E0316 17:09:26.979434 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nova-scheduler-scheduler\" with CrashLoopBackOff: \"back-off 10s restarting failed container=nova-scheduler-scheduler pod=nova-scheduler-0_openstack-kuttl-tests(32194c8a-90a1-4132-9b75-3882418d7f7d)\"" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="32194c8a-90a1-4132-9b75-3882418d7f7d" Mar 16 17:09:26 crc kubenswrapper[5120]: I0316 17:09:26.981725 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"30f9a0a6-4a77-4bfe-930e-2dc3961f78e2","Type":"ContainerStarted","Data":"8c0d177da95a98a26a16f19121b83ed6303a6727fef7034643c22469a24f9eaa"} Mar 16 17:09:26 crc kubenswrapper[5120]: I0316 17:09:26.981881 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"30f9a0a6-4a77-4bfe-930e-2dc3961f78e2","Type":"ContainerStarted","Data":"4268ce881ad08f4bc0d2662c9afe7dc075a0192af9b7397c767e35b8a010be66"} Mar 16 17:09:27 crc kubenswrapper[5120]: I0316 17:09:27.294093 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:09:27 crc kubenswrapper[5120]: I0316 17:09:27.466454 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/69bb2342-14e1-4c32-889a-e33f6ba42651-logs\") pod \"69bb2342-14e1-4c32-889a-e33f6ba42651\" (UID: \"69bb2342-14e1-4c32-889a-e33f6ba42651\") " Mar 16 17:09:27 crc kubenswrapper[5120]: I0316 17:09:27.466919 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-77mk6\" (UniqueName: \"kubernetes.io/projected/69bb2342-14e1-4c32-889a-e33f6ba42651-kube-api-access-77mk6\") pod \"69bb2342-14e1-4c32-889a-e33f6ba42651\" (UID: \"69bb2342-14e1-4c32-889a-e33f6ba42651\") " Mar 16 17:09:27 crc kubenswrapper[5120]: I0316 17:09:27.466983 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/69bb2342-14e1-4c32-889a-e33f6ba42651-config-data\") pod \"69bb2342-14e1-4c32-889a-e33f6ba42651\" (UID: \"69bb2342-14e1-4c32-889a-e33f6ba42651\") " Mar 16 17:09:27 crc kubenswrapper[5120]: I0316 17:09:27.467059 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69bb2342-14e1-4c32-889a-e33f6ba42651-logs" (OuterVolumeSpecName: "logs") pod "69bb2342-14e1-4c32-889a-e33f6ba42651" (UID: "69bb2342-14e1-4c32-889a-e33f6ba42651"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:09:27 crc kubenswrapper[5120]: I0316 17:09:27.467398 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/69bb2342-14e1-4c32-889a-e33f6ba42651-combined-ca-bundle\") pod \"69bb2342-14e1-4c32-889a-e33f6ba42651\" (UID: \"69bb2342-14e1-4c32-889a-e33f6ba42651\") " Mar 16 17:09:27 crc kubenswrapper[5120]: I0316 17:09:27.467544 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/69bb2342-14e1-4c32-889a-e33f6ba42651-public-tls-certs\") pod \"69bb2342-14e1-4c32-889a-e33f6ba42651\" (UID: \"69bb2342-14e1-4c32-889a-e33f6ba42651\") " Mar 16 17:09:27 crc kubenswrapper[5120]: I0316 17:09:27.467813 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/69bb2342-14e1-4c32-889a-e33f6ba42651-internal-tls-certs\") pod \"69bb2342-14e1-4c32-889a-e33f6ba42651\" (UID: \"69bb2342-14e1-4c32-889a-e33f6ba42651\") " Mar 16 17:09:27 crc kubenswrapper[5120]: I0316 17:09:27.469499 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/69bb2342-14e1-4c32-889a-e33f6ba42651-logs\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:27 crc kubenswrapper[5120]: I0316 17:09:27.471716 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:09:27 crc kubenswrapper[5120]: I0316 17:09:27.473775 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69bb2342-14e1-4c32-889a-e33f6ba42651-kube-api-access-77mk6" (OuterVolumeSpecName: "kube-api-access-77mk6") pod "69bb2342-14e1-4c32-889a-e33f6ba42651" (UID: "69bb2342-14e1-4c32-889a-e33f6ba42651"). InnerVolumeSpecName "kube-api-access-77mk6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:09:27 crc kubenswrapper[5120]: I0316 17:09:27.497202 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69bb2342-14e1-4c32-889a-e33f6ba42651-config-data" (OuterVolumeSpecName: "config-data") pod "69bb2342-14e1-4c32-889a-e33f6ba42651" (UID: "69bb2342-14e1-4c32-889a-e33f6ba42651"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:09:27 crc kubenswrapper[5120]: I0316 17:09:27.526077 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69bb2342-14e1-4c32-889a-e33f6ba42651-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "69bb2342-14e1-4c32-889a-e33f6ba42651" (UID: "69bb2342-14e1-4c32-889a-e33f6ba42651"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:09:27 crc kubenswrapper[5120]: I0316 17:09:27.547133 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:09:27 crc kubenswrapper[5120]: I0316 17:09:27.570234 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69bb2342-14e1-4c32-889a-e33f6ba42651-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "69bb2342-14e1-4c32-889a-e33f6ba42651" (UID: "69bb2342-14e1-4c32-889a-e33f6ba42651"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:09:27 crc kubenswrapper[5120]: I0316 17:09:27.571070 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69bb2342-14e1-4c32-889a-e33f6ba42651-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "69bb2342-14e1-4c32-889a-e33f6ba42651" (UID: "69bb2342-14e1-4c32-889a-e33f6ba42651"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:09:27 crc kubenswrapper[5120]: I0316 17:09:27.576518 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/placement-76c554b9b6-6szl6" Mar 16 17:09:27 crc kubenswrapper[5120]: I0316 17:09:27.576637 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/69bb2342-14e1-4c32-889a-e33f6ba42651-public-tls-certs\") pod \"69bb2342-14e1-4c32-889a-e33f6ba42651\" (UID: \"69bb2342-14e1-4c32-889a-e33f6ba42651\") " Mar 16 17:09:27 crc kubenswrapper[5120]: W0316 17:09:27.576816 5120 empty_dir.go:511] Warning: Unmount skipped because path does not exist: /var/lib/kubelet/pods/69bb2342-14e1-4c32-889a-e33f6ba42651/volumes/kubernetes.io~secret/public-tls-certs Mar 16 17:09:27 crc kubenswrapper[5120]: I0316 17:09:27.576840 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69bb2342-14e1-4c32-889a-e33f6ba42651-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "69bb2342-14e1-4c32-889a-e33f6ba42651" (UID: "69bb2342-14e1-4c32-889a-e33f6ba42651"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:09:27 crc kubenswrapper[5120]: I0316 17:09:27.578368 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/69bb2342-14e1-4c32-889a-e33f6ba42651-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:27 crc kubenswrapper[5120]: I0316 17:09:27.578390 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/69bb2342-14e1-4c32-889a-e33f6ba42651-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:27 crc kubenswrapper[5120]: I0316 17:09:27.578403 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/69bb2342-14e1-4c32-889a-e33f6ba42651-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:27 crc kubenswrapper[5120]: I0316 17:09:27.578415 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-77mk6\" (UniqueName: \"kubernetes.io/projected/69bb2342-14e1-4c32-889a-e33f6ba42651-kube-api-access-77mk6\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:27 crc kubenswrapper[5120]: I0316 17:09:27.578425 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/69bb2342-14e1-4c32-889a-e33f6ba42651-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:28 crc kubenswrapper[5120]: I0316 17:09:28.008464 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"30f9a0a6-4a77-4bfe-930e-2dc3961f78e2","Type":"ContainerStarted","Data":"6a6fc1c5f9aae7da9e29d096135b07faaeae9a6da216dd28c564055bcb6f3a91"} Mar 16 17:09:28 crc kubenswrapper[5120]: I0316 17:09:28.011497 5120 generic.go:358] "Generic (PLEG): container finished" podID="69bb2342-14e1-4c32-889a-e33f6ba42651" containerID="c7f0ec29ac153c1aa743c1495484bf9605c92e2cea32e4a9b49c14f6df61dfbe" exitCode=0 Mar 16 17:09:28 crc kubenswrapper[5120]: I0316 17:09:28.011613 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:09:28 crc kubenswrapper[5120]: I0316 17:09:28.011736 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"69bb2342-14e1-4c32-889a-e33f6ba42651","Type":"ContainerDied","Data":"c7f0ec29ac153c1aa743c1495484bf9605c92e2cea32e4a9b49c14f6df61dfbe"} Mar 16 17:09:28 crc kubenswrapper[5120]: I0316 17:09:28.011780 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"69bb2342-14e1-4c32-889a-e33f6ba42651","Type":"ContainerDied","Data":"6e5ff1c7a50af491dbf1f52d9c896f0ab29c54a6eae3986fa7a211092f8cf3b6"} Mar 16 17:09:28 crc kubenswrapper[5120]: I0316 17:09:28.011818 5120 scope.go:117] "RemoveContainer" containerID="c7f0ec29ac153c1aa743c1495484bf9605c92e2cea32e4a9b49c14f6df61dfbe" Mar 16 17:09:28 crc kubenswrapper[5120]: I0316 17:09:28.015040 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"d0852906-6351-45a9-a44c-0bf3f4c29496","Type":"ContainerStarted","Data":"6bd43d7d0d719d65c0531d4b2965651bfa9edc74190a29efd2b813f4082f049c"} Mar 16 17:09:28 crc kubenswrapper[5120]: I0316 17:09:28.015264 5120 scope.go:117] "RemoveContainer" containerID="fdf922633e503ea36030a917a5229c04457ede652c006e23427353cdcb2f036a" Mar 16 17:09:28 crc kubenswrapper[5120]: E0316 17:09:28.015556 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nova-scheduler-scheduler\" with CrashLoopBackOff: \"back-off 10s restarting failed container=nova-scheduler-scheduler pod=nova-scheduler-0_openstack-kuttl-tests(32194c8a-90a1-4132-9b75-3882418d7f7d)\"" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="32194c8a-90a1-4132-9b75-3882418d7f7d" Mar 16 17:09:28 crc kubenswrapper[5120]: I0316 17:09:28.016045 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 17:09:28 crc kubenswrapper[5120]: I0316 17:09:28.056509 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-internal-api-0" podStartSLOduration=3.056491832 podStartE2EDuration="3.056491832s" podCreationTimestamp="2026-03-16 17:09:25 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:09:28.037099516 +0000 UTC m=+5870.191031183" watchObservedRunningTime="2026-03-16 17:09:28.056491832 +0000 UTC m=+5870.210423489" Mar 16 17:09:28 crc kubenswrapper[5120]: I0316 17:09:28.061789 5120 scope.go:117] "RemoveContainer" containerID="da449289366bc4a4a5ae59798a3049978cb54421e9beeb0f8d61e84b89a25756" Mar 16 17:09:28 crc kubenswrapper[5120]: I0316 17:09:28.106259 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 17:09:28 crc kubenswrapper[5120]: I0316 17:09:28.119903 5120 scope.go:117] "RemoveContainer" containerID="c7f0ec29ac153c1aa743c1495484bf9605c92e2cea32e4a9b49c14f6df61dfbe" Mar 16 17:09:28 crc kubenswrapper[5120]: I0316 17:09:28.122167 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 17:09:28 crc kubenswrapper[5120]: E0316 17:09:28.124566 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c7f0ec29ac153c1aa743c1495484bf9605c92e2cea32e4a9b49c14f6df61dfbe\": container with ID starting with c7f0ec29ac153c1aa743c1495484bf9605c92e2cea32e4a9b49c14f6df61dfbe not found: ID does not exist" containerID="c7f0ec29ac153c1aa743c1495484bf9605c92e2cea32e4a9b49c14f6df61dfbe" Mar 16 17:09:28 crc kubenswrapper[5120]: I0316 17:09:28.124628 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7f0ec29ac153c1aa743c1495484bf9605c92e2cea32e4a9b49c14f6df61dfbe"} err="failed to get container status \"c7f0ec29ac153c1aa743c1495484bf9605c92e2cea32e4a9b49c14f6df61dfbe\": rpc error: code = NotFound desc = could not find container \"c7f0ec29ac153c1aa743c1495484bf9605c92e2cea32e4a9b49c14f6df61dfbe\": container with ID starting with c7f0ec29ac153c1aa743c1495484bf9605c92e2cea32e4a9b49c14f6df61dfbe not found: ID does not exist" Mar 16 17:09:28 crc kubenswrapper[5120]: I0316 17:09:28.124657 5120 scope.go:117] "RemoveContainer" containerID="da449289366bc4a4a5ae59798a3049978cb54421e9beeb0f8d61e84b89a25756" Mar 16 17:09:28 crc kubenswrapper[5120]: E0316 17:09:28.125069 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da449289366bc4a4a5ae59798a3049978cb54421e9beeb0f8d61e84b89a25756\": container with ID starting with da449289366bc4a4a5ae59798a3049978cb54421e9beeb0f8d61e84b89a25756 not found: ID does not exist" containerID="da449289366bc4a4a5ae59798a3049978cb54421e9beeb0f8d61e84b89a25756" Mar 16 17:09:28 crc kubenswrapper[5120]: I0316 17:09:28.125086 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da449289366bc4a4a5ae59798a3049978cb54421e9beeb0f8d61e84b89a25756"} err="failed to get container status \"da449289366bc4a4a5ae59798a3049978cb54421e9beeb0f8d61e84b89a25756\": rpc error: code = NotFound desc = could not find container \"da449289366bc4a4a5ae59798a3049978cb54421e9beeb0f8d61e84b89a25756\": container with ID starting with da449289366bc4a4a5ae59798a3049978cb54421e9beeb0f8d61e84b89a25756 not found: ID does not exist" Mar 16 17:09:28 crc kubenswrapper[5120]: I0316 17:09:28.136550 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 17:09:28 crc kubenswrapper[5120]: I0316 17:09:28.138359 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01210506-f19f-4c41-9245-e8b287618649" containerName="dnsmasq-dns" Mar 16 17:09:28 crc kubenswrapper[5120]: I0316 17:09:28.138561 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="01210506-f19f-4c41-9245-e8b287618649" containerName="dnsmasq-dns" Mar 16 17:09:28 crc kubenswrapper[5120]: I0316 17:09:28.138668 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01210506-f19f-4c41-9245-e8b287618649" containerName="init" Mar 16 17:09:28 crc kubenswrapper[5120]: I0316 17:09:28.138743 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="01210506-f19f-4c41-9245-e8b287618649" containerName="init" Mar 16 17:09:28 crc kubenswrapper[5120]: I0316 17:09:28.138861 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69bb2342-14e1-4c32-889a-e33f6ba42651" containerName="nova-api-log" Mar 16 17:09:28 crc kubenswrapper[5120]: I0316 17:09:28.138944 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="69bb2342-14e1-4c32-889a-e33f6ba42651" containerName="nova-api-log" Mar 16 17:09:28 crc kubenswrapper[5120]: I0316 17:09:28.139036 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69bb2342-14e1-4c32-889a-e33f6ba42651" containerName="nova-api-api" Mar 16 17:09:28 crc kubenswrapper[5120]: I0316 17:09:28.139107 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="69bb2342-14e1-4c32-889a-e33f6ba42651" containerName="nova-api-api" Mar 16 17:09:28 crc kubenswrapper[5120]: I0316 17:09:28.139435 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="01210506-f19f-4c41-9245-e8b287618649" containerName="dnsmasq-dns" Mar 16 17:09:28 crc kubenswrapper[5120]: I0316 17:09:28.139538 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="69bb2342-14e1-4c32-889a-e33f6ba42651" containerName="nova-api-api" Mar 16 17:09:28 crc kubenswrapper[5120]: I0316 17:09:28.139655 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="69bb2342-14e1-4c32-889a-e33f6ba42651" containerName="nova-api-log" Mar 16 17:09:28 crc kubenswrapper[5120]: I0316 17:09:28.155001 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 17:09:28 crc kubenswrapper[5120]: I0316 17:09:28.155202 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:09:28 crc kubenswrapper[5120]: I0316 17:09:28.158718 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-config-data\"" Mar 16 17:09:28 crc kubenswrapper[5120]: I0316 17:09:28.160181 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-internal-svc\"" Mar 16 17:09:28 crc kubenswrapper[5120]: I0316 17:09:28.161196 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-public-svc\"" Mar 16 17:09:28 crc kubenswrapper[5120]: I0316 17:09:28.303947 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wml7\" (UniqueName: \"kubernetes.io/projected/29ae5ff5-ba64-4802-b5bf-3a62e0940755-kube-api-access-2wml7\") pod \"nova-api-0\" (UID: \"29ae5ff5-ba64-4802-b5bf-3a62e0940755\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:09:28 crc kubenswrapper[5120]: I0316 17:09:28.304162 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/29ae5ff5-ba64-4802-b5bf-3a62e0940755-public-tls-certs\") pod \"nova-api-0\" (UID: \"29ae5ff5-ba64-4802-b5bf-3a62e0940755\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:09:28 crc kubenswrapper[5120]: I0316 17:09:28.304211 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/29ae5ff5-ba64-4802-b5bf-3a62e0940755-logs\") pod \"nova-api-0\" (UID: \"29ae5ff5-ba64-4802-b5bf-3a62e0940755\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:09:28 crc kubenswrapper[5120]: I0316 17:09:28.304274 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/29ae5ff5-ba64-4802-b5bf-3a62e0940755-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"29ae5ff5-ba64-4802-b5bf-3a62e0940755\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:09:28 crc kubenswrapper[5120]: I0316 17:09:28.304342 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/29ae5ff5-ba64-4802-b5bf-3a62e0940755-internal-tls-certs\") pod \"nova-api-0\" (UID: \"29ae5ff5-ba64-4802-b5bf-3a62e0940755\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:09:28 crc kubenswrapper[5120]: I0316 17:09:28.304466 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/29ae5ff5-ba64-4802-b5bf-3a62e0940755-config-data\") pod \"nova-api-0\" (UID: \"29ae5ff5-ba64-4802-b5bf-3a62e0940755\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:09:28 crc kubenswrapper[5120]: I0316 17:09:28.407214 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2wml7\" (UniqueName: \"kubernetes.io/projected/29ae5ff5-ba64-4802-b5bf-3a62e0940755-kube-api-access-2wml7\") pod \"nova-api-0\" (UID: \"29ae5ff5-ba64-4802-b5bf-3a62e0940755\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:09:28 crc kubenswrapper[5120]: I0316 17:09:28.407379 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/29ae5ff5-ba64-4802-b5bf-3a62e0940755-public-tls-certs\") pod \"nova-api-0\" (UID: \"29ae5ff5-ba64-4802-b5bf-3a62e0940755\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:09:28 crc kubenswrapper[5120]: I0316 17:09:28.407415 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/29ae5ff5-ba64-4802-b5bf-3a62e0940755-logs\") pod \"nova-api-0\" (UID: \"29ae5ff5-ba64-4802-b5bf-3a62e0940755\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:09:28 crc kubenswrapper[5120]: I0316 17:09:28.407478 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/29ae5ff5-ba64-4802-b5bf-3a62e0940755-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"29ae5ff5-ba64-4802-b5bf-3a62e0940755\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:09:28 crc kubenswrapper[5120]: I0316 17:09:28.407551 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/29ae5ff5-ba64-4802-b5bf-3a62e0940755-internal-tls-certs\") pod \"nova-api-0\" (UID: \"29ae5ff5-ba64-4802-b5bf-3a62e0940755\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:09:28 crc kubenswrapper[5120]: I0316 17:09:28.407650 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/29ae5ff5-ba64-4802-b5bf-3a62e0940755-config-data\") pod \"nova-api-0\" (UID: \"29ae5ff5-ba64-4802-b5bf-3a62e0940755\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:09:28 crc kubenswrapper[5120]: I0316 17:09:28.409144 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/29ae5ff5-ba64-4802-b5bf-3a62e0940755-logs\") pod \"nova-api-0\" (UID: \"29ae5ff5-ba64-4802-b5bf-3a62e0940755\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:09:28 crc kubenswrapper[5120]: I0316 17:09:28.413433 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/29ae5ff5-ba64-4802-b5bf-3a62e0940755-public-tls-certs\") pod \"nova-api-0\" (UID: \"29ae5ff5-ba64-4802-b5bf-3a62e0940755\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:09:28 crc kubenswrapper[5120]: I0316 17:09:28.413658 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/29ae5ff5-ba64-4802-b5bf-3a62e0940755-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"29ae5ff5-ba64-4802-b5bf-3a62e0940755\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:09:28 crc kubenswrapper[5120]: I0316 17:09:28.413785 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/29ae5ff5-ba64-4802-b5bf-3a62e0940755-internal-tls-certs\") pod \"nova-api-0\" (UID: \"29ae5ff5-ba64-4802-b5bf-3a62e0940755\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:09:28 crc kubenswrapper[5120]: I0316 17:09:28.414006 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/29ae5ff5-ba64-4802-b5bf-3a62e0940755-config-data\") pod \"nova-api-0\" (UID: \"29ae5ff5-ba64-4802-b5bf-3a62e0940755\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:09:28 crc kubenswrapper[5120]: I0316 17:09:28.434680 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wml7\" (UniqueName: \"kubernetes.io/projected/29ae5ff5-ba64-4802-b5bf-3a62e0940755-kube-api-access-2wml7\") pod \"nova-api-0\" (UID: \"29ae5ff5-ba64-4802-b5bf-3a62e0940755\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:09:28 crc kubenswrapper[5120]: I0316 17:09:28.485599 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:09:28 crc kubenswrapper[5120]: I0316 17:09:28.607345 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/placement-76c554b9b6-6szl6" Mar 16 17:09:28 crc kubenswrapper[5120]: I0316 17:09:28.699260 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="69bb2342-14e1-4c32-889a-e33f6ba42651" path="/var/lib/kubelet/pods/69bb2342-14e1-4c32-889a-e33f6ba42651/volumes" Mar 16 17:09:28 crc kubenswrapper[5120]: I0316 17:09:28.700374 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-654b89dc46-nkv85"] Mar 16 17:09:28 crc kubenswrapper[5120]: I0316 17:09:28.702036 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-654b89dc46-nkv85" podUID="f4f308ec-0dee-4238-817c-144d3f5f7f5d" containerName="placement-log" containerID="cri-o://aac663539a87a40563cdbc36f105c3f7f4a4f053d388b2533a21e308f1a9cede" gracePeriod=30 Mar 16 17:09:28 crc kubenswrapper[5120]: I0316 17:09:28.702058 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-654b89dc46-nkv85" podUID="f4f308ec-0dee-4238-817c-144d3f5f7f5d" containerName="placement-api" containerID="cri-o://8837ed0b6f7a64ac73ea321d7c483a04cb9a140f80591b89d2edbb6bb6e04b64" gracePeriod=30 Mar 16 17:09:29 crc kubenswrapper[5120]: I0316 17:09:29.026409 5120 generic.go:358] "Generic (PLEG): container finished" podID="f4f308ec-0dee-4238-817c-144d3f5f7f5d" containerID="aac663539a87a40563cdbc36f105c3f7f4a4f053d388b2533a21e308f1a9cede" exitCode=143 Mar 16 17:09:29 crc kubenswrapper[5120]: I0316 17:09:29.026547 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-654b89dc46-nkv85" event={"ID":"f4f308ec-0dee-4238-817c-144d3f5f7f5d","Type":"ContainerDied","Data":"aac663539a87a40563cdbc36f105c3f7f4a4f053d388b2533a21e308f1a9cede"} Mar 16 17:09:29 crc kubenswrapper[5120]: I0316 17:09:29.041500 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 17:09:29 crc kubenswrapper[5120]: W0316 17:09:29.042392 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod29ae5ff5_ba64_4802_b5bf_3a62e0940755.slice/crio-bc57875c7078cc938d7974bdd2b2a8acf5565dcf0fa814116bf1b22003dcc6a8 WatchSource:0}: Error finding container bc57875c7078cc938d7974bdd2b2a8acf5565dcf0fa814116bf1b22003dcc6a8: Status 404 returned error can't find the container with id bc57875c7078cc938d7974bdd2b2a8acf5565dcf0fa814116bf1b22003dcc6a8 Mar 16 17:09:29 crc kubenswrapper[5120]: I0316 17:09:29.664355 5120 scope.go:117] "RemoveContainer" containerID="5113d15f8f41624447f1bdf582aecad1fb1c48fe4cd626381d844607c1670c0e" Mar 16 17:09:30 crc kubenswrapper[5120]: I0316 17:09:30.043353 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"9a997459-37ba-46a9-9cb8-075f77fa009f","Type":"ContainerStarted","Data":"c95c639838ab0891241eeaedc65582a42fe56eb64e08e9942cc764c9beef0e20"} Mar 16 17:09:30 crc kubenswrapper[5120]: I0316 17:09:30.044857 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 17:09:30 crc kubenswrapper[5120]: I0316 17:09:30.046245 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"29ae5ff5-ba64-4802-b5bf-3a62e0940755","Type":"ContainerStarted","Data":"6aa27953707d5c4f984252682219bc8743d546a1dd26ee6446eb7b79de49b141"} Mar 16 17:09:30 crc kubenswrapper[5120]: I0316 17:09:30.046274 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"29ae5ff5-ba64-4802-b5bf-3a62e0940755","Type":"ContainerStarted","Data":"795e271388f1ee779baa8580299770571c69be920fa0a704294451a4f44a795a"} Mar 16 17:09:30 crc kubenswrapper[5120]: I0316 17:09:30.046284 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"29ae5ff5-ba64-4802-b5bf-3a62e0940755","Type":"ContainerStarted","Data":"bc57875c7078cc938d7974bdd2b2a8acf5565dcf0fa814116bf1b22003dcc6a8"} Mar 16 17:09:30 crc kubenswrapper[5120]: I0316 17:09:30.048779 5120 generic.go:358] "Generic (PLEG): container finished" podID="d0852906-6351-45a9-a44c-0bf3f4c29496" containerID="6bd43d7d0d719d65c0531d4b2965651bfa9edc74190a29efd2b813f4082f049c" exitCode=1 Mar 16 17:09:30 crc kubenswrapper[5120]: I0316 17:09:30.048911 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"d0852906-6351-45a9-a44c-0bf3f4c29496","Type":"ContainerDied","Data":"6bd43d7d0d719d65c0531d4b2965651bfa9edc74190a29efd2b813f4082f049c"} Mar 16 17:09:30 crc kubenswrapper[5120]: I0316 17:09:30.048950 5120 scope.go:117] "RemoveContainer" containerID="7479907e60cd45c57bb327c8525633c7e28e05280c1ebdf29bb22d846f52bca0" Mar 16 17:09:30 crc kubenswrapper[5120]: I0316 17:09:30.049288 5120 scope.go:117] "RemoveContainer" containerID="6bd43d7d0d719d65c0531d4b2965651bfa9edc74190a29efd2b813f4082f049c" Mar 16 17:09:30 crc kubenswrapper[5120]: E0316 17:09:30.049524 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nova-cell1-conductor-conductor\" with CrashLoopBackOff: \"back-off 10s restarting failed container=nova-cell1-conductor-conductor pod=nova-cell1-conductor-0_openstack-kuttl-tests(d0852906-6351-45a9-a44c-0bf3f4c29496)\"" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="d0852906-6351-45a9-a44c-0bf3f4c29496" Mar 16 17:09:30 crc kubenswrapper[5120]: I0316 17:09:30.119736 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=2.119717879 podStartE2EDuration="2.119717879s" podCreationTimestamp="2026-03-16 17:09:28 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:09:30.099940663 +0000 UTC m=+5872.253872370" watchObservedRunningTime="2026-03-16 17:09:30.119717879 +0000 UTC m=+5872.273649536" Mar 16 17:09:30 crc kubenswrapper[5120]: I0316 17:09:30.954740 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/memcached-0" Mar 16 17:09:31 crc kubenswrapper[5120]: I0316 17:09:31.062336 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 17:09:31 crc kubenswrapper[5120]: I0316 17:09:31.062857 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="5f0f24cd-dbef-4a0a-9e2b-cb5a170982aa" containerName="glance-log" containerID="cri-o://ab749e9165c3b32a457ee7d52df32d44bba16252b9d88677d4888b54e32947a7" gracePeriod=30 Mar 16 17:09:31 crc kubenswrapper[5120]: I0316 17:09:31.062990 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="5f0f24cd-dbef-4a0a-9e2b-cb5a170982aa" containerName="glance-httpd" containerID="cri-o://3becf490b4bf28a84982a708edd2116d8bc113f71c16c14e0c56f117360c4d97" gracePeriod=30 Mar 16 17:09:31 crc kubenswrapper[5120]: I0316 17:09:31.148885 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 17:09:31 crc kubenswrapper[5120]: I0316 17:09:31.149155 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="30f9a0a6-4a77-4bfe-930e-2dc3961f78e2" containerName="glance-log" containerID="cri-o://8c0d177da95a98a26a16f19121b83ed6303a6727fef7034643c22469a24f9eaa" gracePeriod=30 Mar 16 17:09:31 crc kubenswrapper[5120]: I0316 17:09:31.149249 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="30f9a0a6-4a77-4bfe-930e-2dc3961f78e2" containerName="glance-httpd" containerID="cri-o://6a6fc1c5f9aae7da9e29d096135b07faaeae9a6da216dd28c564055bcb6f3a91" gracePeriod=30 Mar 16 17:09:31 crc kubenswrapper[5120]: I0316 17:09:31.167486 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 17:09:31 crc kubenswrapper[5120]: I0316 17:09:31.253873 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-78cd6f6d9d-zhxpn"] Mar 16 17:09:31 crc kubenswrapper[5120]: I0316 17:09:31.266074 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-78cd6f6d9d-zhxpn" Mar 16 17:09:31 crc kubenswrapper[5120]: I0316 17:09:31.280363 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-78cd6f6d9d-zhxpn"] Mar 16 17:09:31 crc kubenswrapper[5120]: I0316 17:09:31.297574 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dcd050a7-3f66-4fb5-a7a3-5736ee13ce15-config-data\") pod \"placement-78cd6f6d9d-zhxpn\" (UID: \"dcd050a7-3f66-4fb5-a7a3-5736ee13ce15\") " pod="openstack-kuttl-tests/placement-78cd6f6d9d-zhxpn" Mar 16 17:09:31 crc kubenswrapper[5120]: I0316 17:09:31.297644 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvmk4\" (UniqueName: \"kubernetes.io/projected/dcd050a7-3f66-4fb5-a7a3-5736ee13ce15-kube-api-access-xvmk4\") pod \"placement-78cd6f6d9d-zhxpn\" (UID: \"dcd050a7-3f66-4fb5-a7a3-5736ee13ce15\") " pod="openstack-kuttl-tests/placement-78cd6f6d9d-zhxpn" Mar 16 17:09:31 crc kubenswrapper[5120]: I0316 17:09:31.297708 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/dcd050a7-3f66-4fb5-a7a3-5736ee13ce15-logs\") pod \"placement-78cd6f6d9d-zhxpn\" (UID: \"dcd050a7-3f66-4fb5-a7a3-5736ee13ce15\") " pod="openstack-kuttl-tests/placement-78cd6f6d9d-zhxpn" Mar 16 17:09:31 crc kubenswrapper[5120]: I0316 17:09:31.297770 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/dcd050a7-3f66-4fb5-a7a3-5736ee13ce15-internal-tls-certs\") pod \"placement-78cd6f6d9d-zhxpn\" (UID: \"dcd050a7-3f66-4fb5-a7a3-5736ee13ce15\") " pod="openstack-kuttl-tests/placement-78cd6f6d9d-zhxpn" Mar 16 17:09:31 crc kubenswrapper[5120]: I0316 17:09:31.297830 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dcd050a7-3f66-4fb5-a7a3-5736ee13ce15-combined-ca-bundle\") pod \"placement-78cd6f6d9d-zhxpn\" (UID: \"dcd050a7-3f66-4fb5-a7a3-5736ee13ce15\") " pod="openstack-kuttl-tests/placement-78cd6f6d9d-zhxpn" Mar 16 17:09:31 crc kubenswrapper[5120]: I0316 17:09:31.298085 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/dcd050a7-3f66-4fb5-a7a3-5736ee13ce15-scripts\") pod \"placement-78cd6f6d9d-zhxpn\" (UID: \"dcd050a7-3f66-4fb5-a7a3-5736ee13ce15\") " pod="openstack-kuttl-tests/placement-78cd6f6d9d-zhxpn" Mar 16 17:09:31 crc kubenswrapper[5120]: I0316 17:09:31.298129 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/dcd050a7-3f66-4fb5-a7a3-5736ee13ce15-public-tls-certs\") pod \"placement-78cd6f6d9d-zhxpn\" (UID: \"dcd050a7-3f66-4fb5-a7a3-5736ee13ce15\") " pod="openstack-kuttl-tests/placement-78cd6f6d9d-zhxpn" Mar 16 17:09:31 crc kubenswrapper[5120]: I0316 17:09:31.389949 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-6448f564f4-flpdw"] Mar 16 17:09:31 crc kubenswrapper[5120]: I0316 17:09:31.390271 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-6448f564f4-flpdw" podUID="3e60d330-61c0-4a9b-ac47-b35f12e5fd66" containerName="neutron-api" containerID="cri-o://3489de754964a0e3fed9cd51b42522048244f6ae68a976386a1ed47728c4cc46" gracePeriod=30 Mar 16 17:09:31 crc kubenswrapper[5120]: I0316 17:09:31.390435 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-6448f564f4-flpdw" podUID="3e60d330-61c0-4a9b-ac47-b35f12e5fd66" containerName="neutron-httpd" containerID="cri-o://ee89fe5fa4f1a948d6acb067c8ec91895dbd831d32a6ddad7d94acac43b34211" gracePeriod=30 Mar 16 17:09:31 crc kubenswrapper[5120]: I0316 17:09:31.404183 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dcd050a7-3f66-4fb5-a7a3-5736ee13ce15-config-data\") pod \"placement-78cd6f6d9d-zhxpn\" (UID: \"dcd050a7-3f66-4fb5-a7a3-5736ee13ce15\") " pod="openstack-kuttl-tests/placement-78cd6f6d9d-zhxpn" Mar 16 17:09:31 crc kubenswrapper[5120]: I0316 17:09:31.404553 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xvmk4\" (UniqueName: \"kubernetes.io/projected/dcd050a7-3f66-4fb5-a7a3-5736ee13ce15-kube-api-access-xvmk4\") pod \"placement-78cd6f6d9d-zhxpn\" (UID: \"dcd050a7-3f66-4fb5-a7a3-5736ee13ce15\") " pod="openstack-kuttl-tests/placement-78cd6f6d9d-zhxpn" Mar 16 17:09:31 crc kubenswrapper[5120]: I0316 17:09:31.404733 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/dcd050a7-3f66-4fb5-a7a3-5736ee13ce15-logs\") pod \"placement-78cd6f6d9d-zhxpn\" (UID: \"dcd050a7-3f66-4fb5-a7a3-5736ee13ce15\") " pod="openstack-kuttl-tests/placement-78cd6f6d9d-zhxpn" Mar 16 17:09:31 crc kubenswrapper[5120]: I0316 17:09:31.404909 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/dcd050a7-3f66-4fb5-a7a3-5736ee13ce15-internal-tls-certs\") pod \"placement-78cd6f6d9d-zhxpn\" (UID: \"dcd050a7-3f66-4fb5-a7a3-5736ee13ce15\") " pod="openstack-kuttl-tests/placement-78cd6f6d9d-zhxpn" Mar 16 17:09:31 crc kubenswrapper[5120]: I0316 17:09:31.405053 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dcd050a7-3f66-4fb5-a7a3-5736ee13ce15-combined-ca-bundle\") pod \"placement-78cd6f6d9d-zhxpn\" (UID: \"dcd050a7-3f66-4fb5-a7a3-5736ee13ce15\") " pod="openstack-kuttl-tests/placement-78cd6f6d9d-zhxpn" Mar 16 17:09:31 crc kubenswrapper[5120]: I0316 17:09:31.405451 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/dcd050a7-3f66-4fb5-a7a3-5736ee13ce15-scripts\") pod \"placement-78cd6f6d9d-zhxpn\" (UID: \"dcd050a7-3f66-4fb5-a7a3-5736ee13ce15\") " pod="openstack-kuttl-tests/placement-78cd6f6d9d-zhxpn" Mar 16 17:09:31 crc kubenswrapper[5120]: I0316 17:09:31.405587 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/dcd050a7-3f66-4fb5-a7a3-5736ee13ce15-public-tls-certs\") pod \"placement-78cd6f6d9d-zhxpn\" (UID: \"dcd050a7-3f66-4fb5-a7a3-5736ee13ce15\") " pod="openstack-kuttl-tests/placement-78cd6f6d9d-zhxpn" Mar 16 17:09:31 crc kubenswrapper[5120]: I0316 17:09:31.411061 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/dcd050a7-3f66-4fb5-a7a3-5736ee13ce15-logs\") pod \"placement-78cd6f6d9d-zhxpn\" (UID: \"dcd050a7-3f66-4fb5-a7a3-5736ee13ce15\") " pod="openstack-kuttl-tests/placement-78cd6f6d9d-zhxpn" Mar 16 17:09:31 crc kubenswrapper[5120]: I0316 17:09:31.415871 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/dcd050a7-3f66-4fb5-a7a3-5736ee13ce15-public-tls-certs\") pod \"placement-78cd6f6d9d-zhxpn\" (UID: \"dcd050a7-3f66-4fb5-a7a3-5736ee13ce15\") " pod="openstack-kuttl-tests/placement-78cd6f6d9d-zhxpn" Mar 16 17:09:31 crc kubenswrapper[5120]: I0316 17:09:31.417830 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/neutron-6448f564f4-flpdw" podUID="3e60d330-61c0-4a9b-ac47-b35f12e5fd66" containerName="neutron-httpd" probeResult="failure" output="Get \"https://10.217.0.50:9696/\": read tcp 10.217.0.2:59428->10.217.0.50:9696: read: connection reset by peer" Mar 16 17:09:31 crc kubenswrapper[5120]: I0316 17:09:31.418304 5120 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 17:09:31 crc kubenswrapper[5120]: I0316 17:09:31.419497 5120 scope.go:117] "RemoveContainer" containerID="6bd43d7d0d719d65c0531d4b2965651bfa9edc74190a29efd2b813f4082f049c" Mar 16 17:09:31 crc kubenswrapper[5120]: E0316 17:09:31.420136 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nova-cell1-conductor-conductor\" with CrashLoopBackOff: \"back-off 10s restarting failed container=nova-cell1-conductor-conductor pod=nova-cell1-conductor-0_openstack-kuttl-tests(d0852906-6351-45a9-a44c-0bf3f4c29496)\"" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="d0852906-6351-45a9-a44c-0bf3f4c29496" Mar 16 17:09:31 crc kubenswrapper[5120]: I0316 17:09:31.420824 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dcd050a7-3f66-4fb5-a7a3-5736ee13ce15-combined-ca-bundle\") pod \"placement-78cd6f6d9d-zhxpn\" (UID: \"dcd050a7-3f66-4fb5-a7a3-5736ee13ce15\") " pod="openstack-kuttl-tests/placement-78cd6f6d9d-zhxpn" Mar 16 17:09:31 crc kubenswrapper[5120]: I0316 17:09:31.429330 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dcd050a7-3f66-4fb5-a7a3-5736ee13ce15-config-data\") pod \"placement-78cd6f6d9d-zhxpn\" (UID: \"dcd050a7-3f66-4fb5-a7a3-5736ee13ce15\") " pod="openstack-kuttl-tests/placement-78cd6f6d9d-zhxpn" Mar 16 17:09:31 crc kubenswrapper[5120]: I0316 17:09:31.429397 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-7465cc7fb4-nnm87"] Mar 16 17:09:31 crc kubenswrapper[5120]: I0316 17:09:31.429431 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/dcd050a7-3f66-4fb5-a7a3-5736ee13ce15-internal-tls-certs\") pod \"placement-78cd6f6d9d-zhxpn\" (UID: \"dcd050a7-3f66-4fb5-a7a3-5736ee13ce15\") " pod="openstack-kuttl-tests/placement-78cd6f6d9d-zhxpn" Mar 16 17:09:31 crc kubenswrapper[5120]: I0316 17:09:31.437332 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/dcd050a7-3f66-4fb5-a7a3-5736ee13ce15-scripts\") pod \"placement-78cd6f6d9d-zhxpn\" (UID: \"dcd050a7-3f66-4fb5-a7a3-5736ee13ce15\") " pod="openstack-kuttl-tests/placement-78cd6f6d9d-zhxpn" Mar 16 17:09:31 crc kubenswrapper[5120]: I0316 17:09:31.442280 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-7465cc7fb4-nnm87" Mar 16 17:09:31 crc kubenswrapper[5120]: I0316 17:09:31.448083 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvmk4\" (UniqueName: \"kubernetes.io/projected/dcd050a7-3f66-4fb5-a7a3-5736ee13ce15-kube-api-access-xvmk4\") pod \"placement-78cd6f6d9d-zhxpn\" (UID: \"dcd050a7-3f66-4fb5-a7a3-5736ee13ce15\") " pod="openstack-kuttl-tests/placement-78cd6f6d9d-zhxpn" Mar 16 17:09:31 crc kubenswrapper[5120]: I0316 17:09:31.488536 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-7465cc7fb4-nnm87"] Mar 16 17:09:31 crc kubenswrapper[5120]: I0316 17:09:31.547897 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/c4f7000d-d4eb-4d8c-9fb8-f88d8304b970-internal-tls-certs\") pod \"neutron-7465cc7fb4-nnm87\" (UID: \"c4f7000d-d4eb-4d8c-9fb8-f88d8304b970\") " pod="openstack-kuttl-tests/neutron-7465cc7fb4-nnm87" Mar 16 17:09:31 crc kubenswrapper[5120]: I0316 17:09:31.548062 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c4f7000d-d4eb-4d8c-9fb8-f88d8304b970-combined-ca-bundle\") pod \"neutron-7465cc7fb4-nnm87\" (UID: \"c4f7000d-d4eb-4d8c-9fb8-f88d8304b970\") " pod="openstack-kuttl-tests/neutron-7465cc7fb4-nnm87" Mar 16 17:09:31 crc kubenswrapper[5120]: I0316 17:09:31.548243 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nc2fr\" (UniqueName: \"kubernetes.io/projected/c4f7000d-d4eb-4d8c-9fb8-f88d8304b970-kube-api-access-nc2fr\") pod \"neutron-7465cc7fb4-nnm87\" (UID: \"c4f7000d-d4eb-4d8c-9fb8-f88d8304b970\") " pod="openstack-kuttl-tests/neutron-7465cc7fb4-nnm87" Mar 16 17:09:31 crc kubenswrapper[5120]: I0316 17:09:31.548372 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/c4f7000d-d4eb-4d8c-9fb8-f88d8304b970-httpd-config\") pod \"neutron-7465cc7fb4-nnm87\" (UID: \"c4f7000d-d4eb-4d8c-9fb8-f88d8304b970\") " pod="openstack-kuttl-tests/neutron-7465cc7fb4-nnm87" Mar 16 17:09:31 crc kubenswrapper[5120]: I0316 17:09:31.548486 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/c4f7000d-d4eb-4d8c-9fb8-f88d8304b970-public-tls-certs\") pod \"neutron-7465cc7fb4-nnm87\" (UID: \"c4f7000d-d4eb-4d8c-9fb8-f88d8304b970\") " pod="openstack-kuttl-tests/neutron-7465cc7fb4-nnm87" Mar 16 17:09:31 crc kubenswrapper[5120]: I0316 17:09:31.548620 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c4f7000d-d4eb-4d8c-9fb8-f88d8304b970-config\") pod \"neutron-7465cc7fb4-nnm87\" (UID: \"c4f7000d-d4eb-4d8c-9fb8-f88d8304b970\") " pod="openstack-kuttl-tests/neutron-7465cc7fb4-nnm87" Mar 16 17:09:31 crc kubenswrapper[5120]: I0316 17:09:31.548724 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/c4f7000d-d4eb-4d8c-9fb8-f88d8304b970-ovndb-tls-certs\") pod \"neutron-7465cc7fb4-nnm87\" (UID: \"c4f7000d-d4eb-4d8c-9fb8-f88d8304b970\") " pod="openstack-kuttl-tests/neutron-7465cc7fb4-nnm87" Mar 16 17:09:31 crc kubenswrapper[5120]: I0316 17:09:31.630414 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-78cd6f6d9d-zhxpn" Mar 16 17:09:31 crc kubenswrapper[5120]: I0316 17:09:31.651029 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/c4f7000d-d4eb-4d8c-9fb8-f88d8304b970-httpd-config\") pod \"neutron-7465cc7fb4-nnm87\" (UID: \"c4f7000d-d4eb-4d8c-9fb8-f88d8304b970\") " pod="openstack-kuttl-tests/neutron-7465cc7fb4-nnm87" Mar 16 17:09:31 crc kubenswrapper[5120]: I0316 17:09:31.651121 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/c4f7000d-d4eb-4d8c-9fb8-f88d8304b970-public-tls-certs\") pod \"neutron-7465cc7fb4-nnm87\" (UID: \"c4f7000d-d4eb-4d8c-9fb8-f88d8304b970\") " pod="openstack-kuttl-tests/neutron-7465cc7fb4-nnm87" Mar 16 17:09:31 crc kubenswrapper[5120]: I0316 17:09:31.651172 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c4f7000d-d4eb-4d8c-9fb8-f88d8304b970-config\") pod \"neutron-7465cc7fb4-nnm87\" (UID: \"c4f7000d-d4eb-4d8c-9fb8-f88d8304b970\") " pod="openstack-kuttl-tests/neutron-7465cc7fb4-nnm87" Mar 16 17:09:31 crc kubenswrapper[5120]: I0316 17:09:31.651224 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/c4f7000d-d4eb-4d8c-9fb8-f88d8304b970-ovndb-tls-certs\") pod \"neutron-7465cc7fb4-nnm87\" (UID: \"c4f7000d-d4eb-4d8c-9fb8-f88d8304b970\") " pod="openstack-kuttl-tests/neutron-7465cc7fb4-nnm87" Mar 16 17:09:31 crc kubenswrapper[5120]: I0316 17:09:31.651421 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/c4f7000d-d4eb-4d8c-9fb8-f88d8304b970-internal-tls-certs\") pod \"neutron-7465cc7fb4-nnm87\" (UID: \"c4f7000d-d4eb-4d8c-9fb8-f88d8304b970\") " pod="openstack-kuttl-tests/neutron-7465cc7fb4-nnm87" Mar 16 17:09:31 crc kubenswrapper[5120]: I0316 17:09:31.651506 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c4f7000d-d4eb-4d8c-9fb8-f88d8304b970-combined-ca-bundle\") pod \"neutron-7465cc7fb4-nnm87\" (UID: \"c4f7000d-d4eb-4d8c-9fb8-f88d8304b970\") " pod="openstack-kuttl-tests/neutron-7465cc7fb4-nnm87" Mar 16 17:09:31 crc kubenswrapper[5120]: I0316 17:09:31.651610 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nc2fr\" (UniqueName: \"kubernetes.io/projected/c4f7000d-d4eb-4d8c-9fb8-f88d8304b970-kube-api-access-nc2fr\") pod \"neutron-7465cc7fb4-nnm87\" (UID: \"c4f7000d-d4eb-4d8c-9fb8-f88d8304b970\") " pod="openstack-kuttl-tests/neutron-7465cc7fb4-nnm87" Mar 16 17:09:31 crc kubenswrapper[5120]: I0316 17:09:31.662590 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/c4f7000d-d4eb-4d8c-9fb8-f88d8304b970-public-tls-certs\") pod \"neutron-7465cc7fb4-nnm87\" (UID: \"c4f7000d-d4eb-4d8c-9fb8-f88d8304b970\") " pod="openstack-kuttl-tests/neutron-7465cc7fb4-nnm87" Mar 16 17:09:31 crc kubenswrapper[5120]: I0316 17:09:31.662892 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/c4f7000d-d4eb-4d8c-9fb8-f88d8304b970-internal-tls-certs\") pod \"neutron-7465cc7fb4-nnm87\" (UID: \"c4f7000d-d4eb-4d8c-9fb8-f88d8304b970\") " pod="openstack-kuttl-tests/neutron-7465cc7fb4-nnm87" Mar 16 17:09:31 crc kubenswrapper[5120]: I0316 17:09:31.662892 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/c4f7000d-d4eb-4d8c-9fb8-f88d8304b970-config\") pod \"neutron-7465cc7fb4-nnm87\" (UID: \"c4f7000d-d4eb-4d8c-9fb8-f88d8304b970\") " pod="openstack-kuttl-tests/neutron-7465cc7fb4-nnm87" Mar 16 17:09:31 crc kubenswrapper[5120]: I0316 17:09:31.663555 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/c4f7000d-d4eb-4d8c-9fb8-f88d8304b970-ovndb-tls-certs\") pod \"neutron-7465cc7fb4-nnm87\" (UID: \"c4f7000d-d4eb-4d8c-9fb8-f88d8304b970\") " pod="openstack-kuttl-tests/neutron-7465cc7fb4-nnm87" Mar 16 17:09:31 crc kubenswrapper[5120]: I0316 17:09:31.664267 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/c4f7000d-d4eb-4d8c-9fb8-f88d8304b970-httpd-config\") pod \"neutron-7465cc7fb4-nnm87\" (UID: \"c4f7000d-d4eb-4d8c-9fb8-f88d8304b970\") " pod="openstack-kuttl-tests/neutron-7465cc7fb4-nnm87" Mar 16 17:09:31 crc kubenswrapper[5120]: I0316 17:09:31.665088 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c4f7000d-d4eb-4d8c-9fb8-f88d8304b970-combined-ca-bundle\") pod \"neutron-7465cc7fb4-nnm87\" (UID: \"c4f7000d-d4eb-4d8c-9fb8-f88d8304b970\") " pod="openstack-kuttl-tests/neutron-7465cc7fb4-nnm87" Mar 16 17:09:31 crc kubenswrapper[5120]: I0316 17:09:31.676448 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nc2fr\" (UniqueName: \"kubernetes.io/projected/c4f7000d-d4eb-4d8c-9fb8-f88d8304b970-kube-api-access-nc2fr\") pod \"neutron-7465cc7fb4-nnm87\" (UID: \"c4f7000d-d4eb-4d8c-9fb8-f88d8304b970\") " pod="openstack-kuttl-tests/neutron-7465cc7fb4-nnm87" Mar 16 17:09:31 crc kubenswrapper[5120]: I0316 17:09:31.868320 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-7465cc7fb4-nnm87" Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.036183 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.107468 5120 generic.go:358] "Generic (PLEG): container finished" podID="5f0f24cd-dbef-4a0a-9e2b-cb5a170982aa" containerID="3becf490b4bf28a84982a708edd2116d8bc113f71c16c14e0c56f117360c4d97" exitCode=0 Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.107504 5120 generic.go:358] "Generic (PLEG): container finished" podID="5f0f24cd-dbef-4a0a-9e2b-cb5a170982aa" containerID="ab749e9165c3b32a457ee7d52df32d44bba16252b9d88677d4888b54e32947a7" exitCode=143 Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.107705 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"5f0f24cd-dbef-4a0a-9e2b-cb5a170982aa","Type":"ContainerDied","Data":"3becf490b4bf28a84982a708edd2116d8bc113f71c16c14e0c56f117360c4d97"} Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.107738 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"5f0f24cd-dbef-4a0a-9e2b-cb5a170982aa","Type":"ContainerDied","Data":"ab749e9165c3b32a457ee7d52df32d44bba16252b9d88677d4888b54e32947a7"} Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.110083 5120 generic.go:358] "Generic (PLEG): container finished" podID="3e60d330-61c0-4a9b-ac47-b35f12e5fd66" containerID="ee89fe5fa4f1a948d6acb067c8ec91895dbd831d32a6ddad7d94acac43b34211" exitCode=0 Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.110232 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-6448f564f4-flpdw" event={"ID":"3e60d330-61c0-4a9b-ac47-b35f12e5fd66","Type":"ContainerDied","Data":"ee89fe5fa4f1a948d6acb067c8ec91895dbd831d32a6ddad7d94acac43b34211"} Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.119324 5120 generic.go:358] "Generic (PLEG): container finished" podID="f4f308ec-0dee-4238-817c-144d3f5f7f5d" containerID="8837ed0b6f7a64ac73ea321d7c483a04cb9a140f80591b89d2edbb6bb6e04b64" exitCode=0 Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.119403 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-654b89dc46-nkv85" event={"ID":"f4f308ec-0dee-4238-817c-144d3f5f7f5d","Type":"ContainerDied","Data":"8837ed0b6f7a64ac73ea321d7c483a04cb9a140f80591b89d2edbb6bb6e04b64"} Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.124865 5120 generic.go:358] "Generic (PLEG): container finished" podID="30f9a0a6-4a77-4bfe-930e-2dc3961f78e2" containerID="6a6fc1c5f9aae7da9e29d096135b07faaeae9a6da216dd28c564055bcb6f3a91" exitCode=0 Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.124891 5120 generic.go:358] "Generic (PLEG): container finished" podID="30f9a0a6-4a77-4bfe-930e-2dc3961f78e2" containerID="8c0d177da95a98a26a16f19121b83ed6303a6727fef7034643c22469a24f9eaa" exitCode=143 Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.124938 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"30f9a0a6-4a77-4bfe-930e-2dc3961f78e2","Type":"ContainerDied","Data":"6a6fc1c5f9aae7da9e29d096135b07faaeae9a6da216dd28c564055bcb6f3a91"} Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.125001 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"30f9a0a6-4a77-4bfe-930e-2dc3961f78e2","Type":"ContainerDied","Data":"8c0d177da95a98a26a16f19121b83ed6303a6727fef7034643c22469a24f9eaa"} Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.125018 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"30f9a0a6-4a77-4bfe-930e-2dc3961f78e2","Type":"ContainerDied","Data":"4268ce881ad08f4bc0d2662c9afe7dc075a0192af9b7397c767e35b8a010be66"} Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.125040 5120 scope.go:117] "RemoveContainer" containerID="6a6fc1c5f9aae7da9e29d096135b07faaeae9a6da216dd28c564055bcb6f3a91" Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.124965 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.125347 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="29ae5ff5-ba64-4802-b5bf-3a62e0940755" containerName="nova-api-log" containerID="cri-o://795e271388f1ee779baa8580299770571c69be920fa0a704294451a4f44a795a" gracePeriod=30 Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.125423 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="29ae5ff5-ba64-4802-b5bf-3a62e0940755" containerName="nova-api-api" containerID="cri-o://6aa27953707d5c4f984252682219bc8743d546a1dd26ee6446eb7b79de49b141" gracePeriod=30 Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.156561 5120 scope.go:117] "RemoveContainer" containerID="8c0d177da95a98a26a16f19121b83ed6303a6727fef7034643c22469a24f9eaa" Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.169851 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/30f9a0a6-4a77-4bfe-930e-2dc3961f78e2-config-data\") pod \"30f9a0a6-4a77-4bfe-930e-2dc3961f78e2\" (UID: \"30f9a0a6-4a77-4bfe-930e-2dc3961f78e2\") " Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.170008 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/30f9a0a6-4a77-4bfe-930e-2dc3961f78e2-httpd-run\") pod \"30f9a0a6-4a77-4bfe-930e-2dc3961f78e2\" (UID: \"30f9a0a6-4a77-4bfe-930e-2dc3961f78e2\") " Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.170063 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/30f9a0a6-4a77-4bfe-930e-2dc3961f78e2-scripts\") pod \"30f9a0a6-4a77-4bfe-930e-2dc3961f78e2\" (UID: \"30f9a0a6-4a77-4bfe-930e-2dc3961f78e2\") " Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.170161 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/30f9a0a6-4a77-4bfe-930e-2dc3961f78e2-logs\") pod \"30f9a0a6-4a77-4bfe-930e-2dc3961f78e2\" (UID: \"30f9a0a6-4a77-4bfe-930e-2dc3961f78e2\") " Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.170316 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/30f9a0a6-4a77-4bfe-930e-2dc3961f78e2-internal-tls-certs\") pod \"30f9a0a6-4a77-4bfe-930e-2dc3961f78e2\" (UID: \"30f9a0a6-4a77-4bfe-930e-2dc3961f78e2\") " Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.170650 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"30f9a0a6-4a77-4bfe-930e-2dc3961f78e2\" (UID: \"30f9a0a6-4a77-4bfe-930e-2dc3961f78e2\") " Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.171000 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/30f9a0a6-4a77-4bfe-930e-2dc3961f78e2-combined-ca-bundle\") pod \"30f9a0a6-4a77-4bfe-930e-2dc3961f78e2\" (UID: \"30f9a0a6-4a77-4bfe-930e-2dc3961f78e2\") " Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.171176 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6v5ts\" (UniqueName: \"kubernetes.io/projected/30f9a0a6-4a77-4bfe-930e-2dc3961f78e2-kube-api-access-6v5ts\") pod \"30f9a0a6-4a77-4bfe-930e-2dc3961f78e2\" (UID: \"30f9a0a6-4a77-4bfe-930e-2dc3961f78e2\") " Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.171814 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/30f9a0a6-4a77-4bfe-930e-2dc3961f78e2-logs" (OuterVolumeSpecName: "logs") pod "30f9a0a6-4a77-4bfe-930e-2dc3961f78e2" (UID: "30f9a0a6-4a77-4bfe-930e-2dc3961f78e2"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.172292 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/30f9a0a6-4a77-4bfe-930e-2dc3961f78e2-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "30f9a0a6-4a77-4bfe-930e-2dc3961f78e2" (UID: "30f9a0a6-4a77-4bfe-930e-2dc3961f78e2"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.172560 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/30f9a0a6-4a77-4bfe-930e-2dc3961f78e2-logs\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.172606 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/30f9a0a6-4a77-4bfe-930e-2dc3961f78e2-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.178098 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30f9a0a6-4a77-4bfe-930e-2dc3961f78e2-kube-api-access-6v5ts" (OuterVolumeSpecName: "kube-api-access-6v5ts") pod "30f9a0a6-4a77-4bfe-930e-2dc3961f78e2" (UID: "30f9a0a6-4a77-4bfe-930e-2dc3961f78e2"). InnerVolumeSpecName "kube-api-access-6v5ts". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.182077 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage06-crc" (OuterVolumeSpecName: "glance") pod "30f9a0a6-4a77-4bfe-930e-2dc3961f78e2" (UID: "30f9a0a6-4a77-4bfe-930e-2dc3961f78e2"). InnerVolumeSpecName "local-storage06-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.187984 5120 scope.go:117] "RemoveContainer" containerID="6a6fc1c5f9aae7da9e29d096135b07faaeae9a6da216dd28c564055bcb6f3a91" Mar 16 17:09:32 crc kubenswrapper[5120]: E0316 17:09:32.190003 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a6fc1c5f9aae7da9e29d096135b07faaeae9a6da216dd28c564055bcb6f3a91\": container with ID starting with 6a6fc1c5f9aae7da9e29d096135b07faaeae9a6da216dd28c564055bcb6f3a91 not found: ID does not exist" containerID="6a6fc1c5f9aae7da9e29d096135b07faaeae9a6da216dd28c564055bcb6f3a91" Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.190049 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a6fc1c5f9aae7da9e29d096135b07faaeae9a6da216dd28c564055bcb6f3a91"} err="failed to get container status \"6a6fc1c5f9aae7da9e29d096135b07faaeae9a6da216dd28c564055bcb6f3a91\": rpc error: code = NotFound desc = could not find container \"6a6fc1c5f9aae7da9e29d096135b07faaeae9a6da216dd28c564055bcb6f3a91\": container with ID starting with 6a6fc1c5f9aae7da9e29d096135b07faaeae9a6da216dd28c564055bcb6f3a91 not found: ID does not exist" Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.190076 5120 scope.go:117] "RemoveContainer" containerID="8c0d177da95a98a26a16f19121b83ed6303a6727fef7034643c22469a24f9eaa" Mar 16 17:09:32 crc kubenswrapper[5120]: E0316 17:09:32.191056 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c0d177da95a98a26a16f19121b83ed6303a6727fef7034643c22469a24f9eaa\": container with ID starting with 8c0d177da95a98a26a16f19121b83ed6303a6727fef7034643c22469a24f9eaa not found: ID does not exist" containerID="8c0d177da95a98a26a16f19121b83ed6303a6727fef7034643c22469a24f9eaa" Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.191088 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c0d177da95a98a26a16f19121b83ed6303a6727fef7034643c22469a24f9eaa"} err="failed to get container status \"8c0d177da95a98a26a16f19121b83ed6303a6727fef7034643c22469a24f9eaa\": rpc error: code = NotFound desc = could not find container \"8c0d177da95a98a26a16f19121b83ed6303a6727fef7034643c22469a24f9eaa\": container with ID starting with 8c0d177da95a98a26a16f19121b83ed6303a6727fef7034643c22469a24f9eaa not found: ID does not exist" Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.191106 5120 scope.go:117] "RemoveContainer" containerID="6a6fc1c5f9aae7da9e29d096135b07faaeae9a6da216dd28c564055bcb6f3a91" Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.194242 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a6fc1c5f9aae7da9e29d096135b07faaeae9a6da216dd28c564055bcb6f3a91"} err="failed to get container status \"6a6fc1c5f9aae7da9e29d096135b07faaeae9a6da216dd28c564055bcb6f3a91\": rpc error: code = NotFound desc = could not find container \"6a6fc1c5f9aae7da9e29d096135b07faaeae9a6da216dd28c564055bcb6f3a91\": container with ID starting with 6a6fc1c5f9aae7da9e29d096135b07faaeae9a6da216dd28c564055bcb6f3a91 not found: ID does not exist" Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.194276 5120 scope.go:117] "RemoveContainer" containerID="8c0d177da95a98a26a16f19121b83ed6303a6727fef7034643c22469a24f9eaa" Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.196034 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c0d177da95a98a26a16f19121b83ed6303a6727fef7034643c22469a24f9eaa"} err="failed to get container status \"8c0d177da95a98a26a16f19121b83ed6303a6727fef7034643c22469a24f9eaa\": rpc error: code = NotFound desc = could not find container \"8c0d177da95a98a26a16f19121b83ed6303a6727fef7034643c22469a24f9eaa\": container with ID starting with 8c0d177da95a98a26a16f19121b83ed6303a6727fef7034643c22469a24f9eaa not found: ID does not exist" Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.219973 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/30f9a0a6-4a77-4bfe-930e-2dc3961f78e2-scripts" (OuterVolumeSpecName: "scripts") pod "30f9a0a6-4a77-4bfe-930e-2dc3961f78e2" (UID: "30f9a0a6-4a77-4bfe-930e-2dc3961f78e2"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.253891 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/30f9a0a6-4a77-4bfe-930e-2dc3961f78e2-config-data" (OuterVolumeSpecName: "config-data") pod "30f9a0a6-4a77-4bfe-930e-2dc3961f78e2" (UID: "30f9a0a6-4a77-4bfe-930e-2dc3961f78e2"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.270192 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/30f9a0a6-4a77-4bfe-930e-2dc3961f78e2-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "30f9a0a6-4a77-4bfe-930e-2dc3961f78e2" (UID: "30f9a0a6-4a77-4bfe-930e-2dc3961f78e2"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.275346 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6v5ts\" (UniqueName: \"kubernetes.io/projected/30f9a0a6-4a77-4bfe-930e-2dc3961f78e2-kube-api-access-6v5ts\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.275386 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/30f9a0a6-4a77-4bfe-930e-2dc3961f78e2-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.275401 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/30f9a0a6-4a77-4bfe-930e-2dc3961f78e2-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.275416 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/30f9a0a6-4a77-4bfe-930e-2dc3961f78e2-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.275446 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") on node \"crc\" " Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.372873 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/30f9a0a6-4a77-4bfe-930e-2dc3961f78e2-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "30f9a0a6-4a77-4bfe-930e-2dc3961f78e2" (UID: "30f9a0a6-4a77-4bfe-930e-2dc3961f78e2"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.385047 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/30f9a0a6-4a77-4bfe-930e-2dc3961f78e2-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.418458 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage06-crc" (UniqueName: "kubernetes.io/local-volume/local-storage06-crc") on node "crc" Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.471986 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.490169 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.503687 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.521905 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.523086 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-654b89dc46-nkv85" Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.535097 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.574834 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.717097 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f4f308ec-0dee-4238-817c-144d3f5f7f5d-config-data\") pod \"f4f308ec-0dee-4238-817c-144d3f5f7f5d\" (UID: \"f4f308ec-0dee-4238-817c-144d3f5f7f5d\") " Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.717177 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f4f308ec-0dee-4238-817c-144d3f5f7f5d-combined-ca-bundle\") pod \"f4f308ec-0dee-4238-817c-144d3f5f7f5d\" (UID: \"f4f308ec-0dee-4238-817c-144d3f5f7f5d\") " Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.717241 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5f0f24cd-dbef-4a0a-9e2b-cb5a170982aa-logs\") pod \"5f0f24cd-dbef-4a0a-9e2b-cb5a170982aa\" (UID: \"5f0f24cd-dbef-4a0a-9e2b-cb5a170982aa\") " Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.717366 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"5f0f24cd-dbef-4a0a-9e2b-cb5a170982aa\" (UID: \"5f0f24cd-dbef-4a0a-9e2b-cb5a170982aa\") " Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.717443 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/5f0f24cd-dbef-4a0a-9e2b-cb5a170982aa-public-tls-certs\") pod \"5f0f24cd-dbef-4a0a-9e2b-cb5a170982aa\" (UID: \"5f0f24cd-dbef-4a0a-9e2b-cb5a170982aa\") " Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.717614 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f4f308ec-0dee-4238-817c-144d3f5f7f5d-internal-tls-certs\") pod \"f4f308ec-0dee-4238-817c-144d3f5f7f5d\" (UID: \"f4f308ec-0dee-4238-817c-144d3f5f7f5d\") " Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.717675 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t82hz\" (UniqueName: \"kubernetes.io/projected/f4f308ec-0dee-4238-817c-144d3f5f7f5d-kube-api-access-t82hz\") pod \"f4f308ec-0dee-4238-817c-144d3f5f7f5d\" (UID: \"f4f308ec-0dee-4238-817c-144d3f5f7f5d\") " Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.717821 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5f0f24cd-dbef-4a0a-9e2b-cb5a170982aa-config-data\") pod \"5f0f24cd-dbef-4a0a-9e2b-cb5a170982aa\" (UID: \"5f0f24cd-dbef-4a0a-9e2b-cb5a170982aa\") " Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.717977 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5f0f24cd-dbef-4a0a-9e2b-cb5a170982aa-scripts\") pod \"5f0f24cd-dbef-4a0a-9e2b-cb5a170982aa\" (UID: \"5f0f24cd-dbef-4a0a-9e2b-cb5a170982aa\") " Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.718029 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/5f0f24cd-dbef-4a0a-9e2b-cb5a170982aa-httpd-run\") pod \"5f0f24cd-dbef-4a0a-9e2b-cb5a170982aa\" (UID: \"5f0f24cd-dbef-4a0a-9e2b-cb5a170982aa\") " Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.718088 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f4f308ec-0dee-4238-817c-144d3f5f7f5d-scripts\") pod \"f4f308ec-0dee-4238-817c-144d3f5f7f5d\" (UID: \"f4f308ec-0dee-4238-817c-144d3f5f7f5d\") " Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.718134 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f4f308ec-0dee-4238-817c-144d3f5f7f5d-public-tls-certs\") pod \"f4f308ec-0dee-4238-817c-144d3f5f7f5d\" (UID: \"f4f308ec-0dee-4238-817c-144d3f5f7f5d\") " Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.718154 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f4f308ec-0dee-4238-817c-144d3f5f7f5d-logs\") pod \"f4f308ec-0dee-4238-817c-144d3f5f7f5d\" (UID: \"f4f308ec-0dee-4238-817c-144d3f5f7f5d\") " Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.718179 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m4z6p\" (UniqueName: \"kubernetes.io/projected/5f0f24cd-dbef-4a0a-9e2b-cb5a170982aa-kube-api-access-m4z6p\") pod \"5f0f24cd-dbef-4a0a-9e2b-cb5a170982aa\" (UID: \"5f0f24cd-dbef-4a0a-9e2b-cb5a170982aa\") " Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.718284 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5f0f24cd-dbef-4a0a-9e2b-cb5a170982aa-combined-ca-bundle\") pod \"5f0f24cd-dbef-4a0a-9e2b-cb5a170982aa\" (UID: \"5f0f24cd-dbef-4a0a-9e2b-cb5a170982aa\") " Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.719042 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="30f9a0a6-4a77-4bfe-930e-2dc3961f78e2" path="/var/lib/kubelet/pods/30f9a0a6-4a77-4bfe-930e-2dc3961f78e2/volumes" Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.721621 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f0f24cd-dbef-4a0a-9e2b-cb5a170982aa-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "5f0f24cd-dbef-4a0a-9e2b-cb5a170982aa" (UID: "5f0f24cd-dbef-4a0a-9e2b-cb5a170982aa"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.729364 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4f308ec-0dee-4238-817c-144d3f5f7f5d-logs" (OuterVolumeSpecName: "logs") pod "f4f308ec-0dee-4238-817c-144d3f5f7f5d" (UID: "f4f308ec-0dee-4238-817c-144d3f5f7f5d"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.729479 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f4f308ec-0dee-4238-817c-144d3f5f7f5d-scripts" (OuterVolumeSpecName: "scripts") pod "f4f308ec-0dee-4238-817c-144d3f5f7f5d" (UID: "f4f308ec-0dee-4238-817c-144d3f5f7f5d"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.731553 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.732494 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f0f24cd-dbef-4a0a-9e2b-cb5a170982aa-logs" (OuterVolumeSpecName: "logs") pod "5f0f24cd-dbef-4a0a-9e2b-cb5a170982aa" (UID: "5f0f24cd-dbef-4a0a-9e2b-cb5a170982aa"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.732626 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4f308ec-0dee-4238-817c-144d3f5f7f5d" containerName="placement-api" Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.732640 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4f308ec-0dee-4238-817c-144d3f5f7f5d" containerName="placement-api" Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.732654 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f0f24cd-dbef-4a0a-9e2b-cb5a170982aa" containerName="glance-log" Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.732674 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f0f24cd-dbef-4a0a-9e2b-cb5a170982aa" containerName="glance-log" Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.732706 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30f9a0a6-4a77-4bfe-930e-2dc3961f78e2" containerName="glance-log" Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.732712 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="30f9a0a6-4a77-4bfe-930e-2dc3961f78e2" containerName="glance-log" Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.732727 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30f9a0a6-4a77-4bfe-930e-2dc3961f78e2" containerName="glance-httpd" Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.732732 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="30f9a0a6-4a77-4bfe-930e-2dc3961f78e2" containerName="glance-httpd" Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.733263 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f0f24cd-dbef-4a0a-9e2b-cb5a170982aa" containerName="glance-httpd" Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.733349 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f0f24cd-dbef-4a0a-9e2b-cb5a170982aa" containerName="glance-httpd" Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.733436 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4f308ec-0dee-4238-817c-144d3f5f7f5d" containerName="placement-log" Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.733508 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4f308ec-0dee-4238-817c-144d3f5f7f5d" containerName="placement-log" Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.733997 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="5f0f24cd-dbef-4a0a-9e2b-cb5a170982aa" containerName="glance-httpd" Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.734132 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="30f9a0a6-4a77-4bfe-930e-2dc3961f78e2" containerName="glance-log" Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.734263 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f4f308ec-0dee-4238-817c-144d3f5f7f5d" containerName="placement-api" Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.734444 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="30f9a0a6-4a77-4bfe-930e-2dc3961f78e2" containerName="glance-httpd" Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.734531 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f4f308ec-0dee-4238-817c-144d3f5f7f5d" containerName="placement-log" Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.734655 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="5f0f24cd-dbef-4a0a-9e2b-cb5a170982aa" containerName="glance-log" Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.739740 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.739844 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.748995 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage05-crc" (OuterVolumeSpecName: "glance") pod "5f0f24cd-dbef-4a0a-9e2b-cb5a170982aa" (UID: "5f0f24cd-dbef-4a0a-9e2b-cb5a170982aa"). InnerVolumeSpecName "local-storage05-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.749325 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-internal-config-data\"" Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.749438 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-internal-svc\"" Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.757159 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f0f24cd-dbef-4a0a-9e2b-cb5a170982aa-scripts" (OuterVolumeSpecName: "scripts") pod "5f0f24cd-dbef-4a0a-9e2b-cb5a170982aa" (UID: "5f0f24cd-dbef-4a0a-9e2b-cb5a170982aa"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.766319 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4f308ec-0dee-4238-817c-144d3f5f7f5d-kube-api-access-t82hz" (OuterVolumeSpecName: "kube-api-access-t82hz") pod "f4f308ec-0dee-4238-817c-144d3f5f7f5d" (UID: "f4f308ec-0dee-4238-817c-144d3f5f7f5d"). InnerVolumeSpecName "kube-api-access-t82hz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.773530 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f0f24cd-dbef-4a0a-9e2b-cb5a170982aa-kube-api-access-m4z6p" (OuterVolumeSpecName: "kube-api-access-m4z6p") pod "5f0f24cd-dbef-4a0a-9e2b-cb5a170982aa" (UID: "5f0f24cd-dbef-4a0a-9e2b-cb5a170982aa"). InnerVolumeSpecName "kube-api-access-m4z6p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.779219 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.783169 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-7465cc7fb4-nnm87"] Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.809589 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-78cd6f6d9d-zhxpn"] Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.822568 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5f0f24cd-dbef-4a0a-9e2b-cb5a170982aa-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.822602 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/5f0f24cd-dbef-4a0a-9e2b-cb5a170982aa-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.822614 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f4f308ec-0dee-4238-817c-144d3f5f7f5d-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.822626 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f4f308ec-0dee-4238-817c-144d3f5f7f5d-logs\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.822635 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m4z6p\" (UniqueName: \"kubernetes.io/projected/5f0f24cd-dbef-4a0a-9e2b-cb5a170982aa-kube-api-access-m4z6p\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.822644 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5f0f24cd-dbef-4a0a-9e2b-cb5a170982aa-logs\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.822675 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") on node \"crc\" " Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.822684 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t82hz\" (UniqueName: \"kubernetes.io/projected/f4f308ec-0dee-4238-817c-144d3f5f7f5d-kube-api-access-t82hz\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.828374 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f0f24cd-dbef-4a0a-9e2b-cb5a170982aa-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "5f0f24cd-dbef-4a0a-9e2b-cb5a170982aa" (UID: "5f0f24cd-dbef-4a0a-9e2b-cb5a170982aa"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.852434 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f4f308ec-0dee-4238-817c-144d3f5f7f5d-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f4f308ec-0dee-4238-817c-144d3f5f7f5d" (UID: "f4f308ec-0dee-4238-817c-144d3f5f7f5d"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.855613 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage05-crc" (UniqueName: "kubernetes.io/local-volume/local-storage05-crc") on node "crc" Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.867579 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f4f308ec-0dee-4238-817c-144d3f5f7f5d-config-data" (OuterVolumeSpecName: "config-data") pod "f4f308ec-0dee-4238-817c-144d3f5f7f5d" (UID: "f4f308ec-0dee-4238-817c-144d3f5f7f5d"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.880458 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f0f24cd-dbef-4a0a-9e2b-cb5a170982aa-config-data" (OuterVolumeSpecName: "config-data") pod "5f0f24cd-dbef-4a0a-9e2b-cb5a170982aa" (UID: "5f0f24cd-dbef-4a0a-9e2b-cb5a170982aa"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.882971 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f0f24cd-dbef-4a0a-9e2b-cb5a170982aa-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "5f0f24cd-dbef-4a0a-9e2b-cb5a170982aa" (UID: "5f0f24cd-dbef-4a0a-9e2b-cb5a170982aa"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.924612 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/29ae5ff5-ba64-4802-b5bf-3a62e0940755-public-tls-certs\") pod \"29ae5ff5-ba64-4802-b5bf-3a62e0940755\" (UID: \"29ae5ff5-ba64-4802-b5bf-3a62e0940755\") " Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.924910 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/29ae5ff5-ba64-4802-b5bf-3a62e0940755-logs\") pod \"29ae5ff5-ba64-4802-b5bf-3a62e0940755\" (UID: \"29ae5ff5-ba64-4802-b5bf-3a62e0940755\") " Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.925287 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/29ae5ff5-ba64-4802-b5bf-3a62e0940755-internal-tls-certs\") pod \"29ae5ff5-ba64-4802-b5bf-3a62e0940755\" (UID: \"29ae5ff5-ba64-4802-b5bf-3a62e0940755\") " Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.925336 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/29ae5ff5-ba64-4802-b5bf-3a62e0940755-config-data\") pod \"29ae5ff5-ba64-4802-b5bf-3a62e0940755\" (UID: \"29ae5ff5-ba64-4802-b5bf-3a62e0940755\") " Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.925383 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29ae5ff5-ba64-4802-b5bf-3a62e0940755-logs" (OuterVolumeSpecName: "logs") pod "29ae5ff5-ba64-4802-b5bf-3a62e0940755" (UID: "29ae5ff5-ba64-4802-b5bf-3a62e0940755"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.925529 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2wml7\" (UniqueName: \"kubernetes.io/projected/29ae5ff5-ba64-4802-b5bf-3a62e0940755-kube-api-access-2wml7\") pod \"29ae5ff5-ba64-4802-b5bf-3a62e0940755\" (UID: \"29ae5ff5-ba64-4802-b5bf-3a62e0940755\") " Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.925929 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/29ae5ff5-ba64-4802-b5bf-3a62e0940755-combined-ca-bundle\") pod \"29ae5ff5-ba64-4802-b5bf-3a62e0940755\" (UID: \"29ae5ff5-ba64-4802-b5bf-3a62e0940755\") " Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.926299 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e7b10940-fda7-468a-8937-fd83bb366d34-config-data\") pod \"glance-default-internal-api-0\" (UID: \"e7b10940-fda7-468a-8937-fd83bb366d34\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.926330 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/e7b10940-fda7-468a-8937-fd83bb366d34-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"e7b10940-fda7-468a-8937-fd83bb366d34\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.926513 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"glance-default-internal-api-0\" (UID: \"e7b10940-fda7-468a-8937-fd83bb366d34\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.926789 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e7b10940-fda7-468a-8937-fd83bb366d34-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"e7b10940-fda7-468a-8937-fd83bb366d34\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.929037 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f4f308ec-0dee-4238-817c-144d3f5f7f5d-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "f4f308ec-0dee-4238-817c-144d3f5f7f5d" (UID: "f4f308ec-0dee-4238-817c-144d3f5f7f5d"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.930236 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29ae5ff5-ba64-4802-b5bf-3a62e0940755-kube-api-access-2wml7" (OuterVolumeSpecName: "kube-api-access-2wml7") pod "29ae5ff5-ba64-4802-b5bf-3a62e0940755" (UID: "29ae5ff5-ba64-4802-b5bf-3a62e0940755"). InnerVolumeSpecName "kube-api-access-2wml7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.930636 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkjw7\" (UniqueName: \"kubernetes.io/projected/e7b10940-fda7-468a-8937-fd83bb366d34-kube-api-access-nkjw7\") pod \"glance-default-internal-api-0\" (UID: \"e7b10940-fda7-468a-8937-fd83bb366d34\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.930997 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e7b10940-fda7-468a-8937-fd83bb366d34-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"e7b10940-fda7-468a-8937-fd83bb366d34\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.931062 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e7b10940-fda7-468a-8937-fd83bb366d34-logs\") pod \"glance-default-internal-api-0\" (UID: \"e7b10940-fda7-468a-8937-fd83bb366d34\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.931272 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e7b10940-fda7-468a-8937-fd83bb366d34-scripts\") pod \"glance-default-internal-api-0\" (UID: \"e7b10940-fda7-468a-8937-fd83bb366d34\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.931504 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.931530 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2wml7\" (UniqueName: \"kubernetes.io/projected/29ae5ff5-ba64-4802-b5bf-3a62e0940755-kube-api-access-2wml7\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.931561 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/5f0f24cd-dbef-4a0a-9e2b-cb5a170982aa-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.931577 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f4f308ec-0dee-4238-817c-144d3f5f7f5d-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.931589 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5f0f24cd-dbef-4a0a-9e2b-cb5a170982aa-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.931603 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/29ae5ff5-ba64-4802-b5bf-3a62e0940755-logs\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.931616 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5f0f24cd-dbef-4a0a-9e2b-cb5a170982aa-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.931628 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f4f308ec-0dee-4238-817c-144d3f5f7f5d-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.931639 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f4f308ec-0dee-4238-817c-144d3f5f7f5d-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.954548 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/29ae5ff5-ba64-4802-b5bf-3a62e0940755-config-data" (OuterVolumeSpecName: "config-data") pod "29ae5ff5-ba64-4802-b5bf-3a62e0940755" (UID: "29ae5ff5-ba64-4802-b5bf-3a62e0940755"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.964201 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f4f308ec-0dee-4238-817c-144d3f5f7f5d-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "f4f308ec-0dee-4238-817c-144d3f5f7f5d" (UID: "f4f308ec-0dee-4238-817c-144d3f5f7f5d"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:09:32 crc kubenswrapper[5120]: I0316 17:09:32.976487 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/29ae5ff5-ba64-4802-b5bf-3a62e0940755-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "29ae5ff5-ba64-4802-b5bf-3a62e0940755" (UID: "29ae5ff5-ba64-4802-b5bf-3a62e0940755"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.009333 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/29ae5ff5-ba64-4802-b5bf-3a62e0940755-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "29ae5ff5-ba64-4802-b5bf-3a62e0940755" (UID: "29ae5ff5-ba64-4802-b5bf-3a62e0940755"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.021834 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/29ae5ff5-ba64-4802-b5bf-3a62e0940755-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "29ae5ff5-ba64-4802-b5bf-3a62e0940755" (UID: "29ae5ff5-ba64-4802-b5bf-3a62e0940755"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.034406 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e7b10940-fda7-468a-8937-fd83bb366d34-scripts\") pod \"glance-default-internal-api-0\" (UID: \"e7b10940-fda7-468a-8937-fd83bb366d34\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.034539 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e7b10940-fda7-468a-8937-fd83bb366d34-config-data\") pod \"glance-default-internal-api-0\" (UID: \"e7b10940-fda7-468a-8937-fd83bb366d34\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.034558 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/e7b10940-fda7-468a-8937-fd83bb366d34-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"e7b10940-fda7-468a-8937-fd83bb366d34\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.034614 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"glance-default-internal-api-0\" (UID: \"e7b10940-fda7-468a-8937-fd83bb366d34\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.034724 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e7b10940-fda7-468a-8937-fd83bb366d34-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"e7b10940-fda7-468a-8937-fd83bb366d34\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.034860 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nkjw7\" (UniqueName: \"kubernetes.io/projected/e7b10940-fda7-468a-8937-fd83bb366d34-kube-api-access-nkjw7\") pod \"glance-default-internal-api-0\" (UID: \"e7b10940-fda7-468a-8937-fd83bb366d34\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.034992 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e7b10940-fda7-468a-8937-fd83bb366d34-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"e7b10940-fda7-468a-8937-fd83bb366d34\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.035026 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e7b10940-fda7-468a-8937-fd83bb366d34-logs\") pod \"glance-default-internal-api-0\" (UID: \"e7b10940-fda7-468a-8937-fd83bb366d34\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.035091 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/29ae5ff5-ba64-4802-b5bf-3a62e0940755-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.035104 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/29ae5ff5-ba64-4802-b5bf-3a62e0940755-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.035113 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f4f308ec-0dee-4238-817c-144d3f5f7f5d-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.035121 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/29ae5ff5-ba64-4802-b5bf-3a62e0940755-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.035130 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/29ae5ff5-ba64-4802-b5bf-3a62e0940755-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.035492 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e7b10940-fda7-468a-8937-fd83bb366d34-logs\") pod \"glance-default-internal-api-0\" (UID: \"e7b10940-fda7-468a-8937-fd83bb366d34\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.036113 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"glance-default-internal-api-0\" (UID: \"e7b10940-fda7-468a-8937-fd83bb366d34\") device mount path \"/mnt/openstack/pv06\"" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.044832 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/e7b10940-fda7-468a-8937-fd83bb366d34-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"e7b10940-fda7-468a-8937-fd83bb366d34\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.047693 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e7b10940-fda7-468a-8937-fd83bb366d34-scripts\") pod \"glance-default-internal-api-0\" (UID: \"e7b10940-fda7-468a-8937-fd83bb366d34\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.051099 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e7b10940-fda7-468a-8937-fd83bb366d34-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"e7b10940-fda7-468a-8937-fd83bb366d34\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.051398 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e7b10940-fda7-468a-8937-fd83bb366d34-config-data\") pod \"glance-default-internal-api-0\" (UID: \"e7b10940-fda7-468a-8937-fd83bb366d34\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.055040 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e7b10940-fda7-468a-8937-fd83bb366d34-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"e7b10940-fda7-468a-8937-fd83bb366d34\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.068820 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkjw7\" (UniqueName: \"kubernetes.io/projected/e7b10940-fda7-468a-8937-fd83bb366d34-kube-api-access-nkjw7\") pod \"glance-default-internal-api-0\" (UID: \"e7b10940-fda7-468a-8937-fd83bb366d34\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.088877 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"glance-default-internal-api-0\" (UID: \"e7b10940-fda7-468a-8937-fd83bb366d34\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.135642 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-654b89dc46-nkv85" event={"ID":"f4f308ec-0dee-4238-817c-144d3f5f7f5d","Type":"ContainerDied","Data":"dddba88f6a1dc30c27a67e43f37447def3057684a1f7e00524b527b6f6bdd877"} Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.135717 5120 scope.go:117] "RemoveContainer" containerID="8837ed0b6f7a64ac73ea321d7c483a04cb9a140f80591b89d2edbb6bb6e04b64" Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.135721 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-654b89dc46-nkv85" Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.140314 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-78cd6f6d9d-zhxpn" event={"ID":"dcd050a7-3f66-4fb5-a7a3-5736ee13ce15","Type":"ContainerStarted","Data":"8f88cb89a2baa2b245138ca6c55450c5b9754733563643cb3deddaeab7699367"} Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.140397 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-78cd6f6d9d-zhxpn" event={"ID":"dcd050a7-3f66-4fb5-a7a3-5736ee13ce15","Type":"ContainerStarted","Data":"67f6d06d883a60793980f22c7ba5a370605d4d4e567e60bc13e6ca0b2759e912"} Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.141809 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-7465cc7fb4-nnm87" event={"ID":"c4f7000d-d4eb-4d8c-9fb8-f88d8304b970","Type":"ContainerStarted","Data":"9aff746512bbba7759c95e67dcc4c8c1b2fedc8d2acd2e2bc22bd0cd81dccd4a"} Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.144484 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"5f0f24cd-dbef-4a0a-9e2b-cb5a170982aa","Type":"ContainerDied","Data":"df0284bfca2c24c9532505ac5ca4cef9f7d0ec93477366ecf2e2b4de8400f3c6"} Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.144517 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.153023 5120 generic.go:358] "Generic (PLEG): container finished" podID="9a997459-37ba-46a9-9cb8-075f77fa009f" containerID="c95c639838ab0891241eeaedc65582a42fe56eb64e08e9942cc764c9beef0e20" exitCode=1 Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.153101 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"9a997459-37ba-46a9-9cb8-075f77fa009f","Type":"ContainerDied","Data":"c95c639838ab0891241eeaedc65582a42fe56eb64e08e9942cc764c9beef0e20"} Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.153644 5120 scope.go:117] "RemoveContainer" containerID="c95c639838ab0891241eeaedc65582a42fe56eb64e08e9942cc764c9beef0e20" Mar 16 17:09:33 crc kubenswrapper[5120]: E0316 17:09:33.154279 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nova-cell0-conductor-conductor\" with CrashLoopBackOff: \"back-off 40s restarting failed container=nova-cell0-conductor-conductor pod=nova-cell0-conductor-0_openstack-kuttl-tests(9a997459-37ba-46a9-9cb8-075f77fa009f)\"" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="9a997459-37ba-46a9-9cb8-075f77fa009f" Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.155113 5120 generic.go:358] "Generic (PLEG): container finished" podID="29ae5ff5-ba64-4802-b5bf-3a62e0940755" containerID="6aa27953707d5c4f984252682219bc8743d546a1dd26ee6446eb7b79de49b141" exitCode=0 Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.155127 5120 generic.go:358] "Generic (PLEG): container finished" podID="29ae5ff5-ba64-4802-b5bf-3a62e0940755" containerID="795e271388f1ee779baa8580299770571c69be920fa0a704294451a4f44a795a" exitCode=143 Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.155153 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.155154 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"29ae5ff5-ba64-4802-b5bf-3a62e0940755","Type":"ContainerDied","Data":"6aa27953707d5c4f984252682219bc8743d546a1dd26ee6446eb7b79de49b141"} Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.155262 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"29ae5ff5-ba64-4802-b5bf-3a62e0940755","Type":"ContainerDied","Data":"795e271388f1ee779baa8580299770571c69be920fa0a704294451a4f44a795a"} Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.155280 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"29ae5ff5-ba64-4802-b5bf-3a62e0940755","Type":"ContainerDied","Data":"bc57875c7078cc938d7974bdd2b2a8acf5565dcf0fa814116bf1b22003dcc6a8"} Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.171598 5120 generic.go:358] "Generic (PLEG): container finished" podID="3e60d330-61c0-4a9b-ac47-b35f12e5fd66" containerID="3489de754964a0e3fed9cd51b42522048244f6ae68a976386a1ed47728c4cc46" exitCode=0 Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.172049 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-6448f564f4-flpdw" event={"ID":"3e60d330-61c0-4a9b-ac47-b35f12e5fd66","Type":"ContainerDied","Data":"3489de754964a0e3fed9cd51b42522048244f6ae68a976386a1ed47728c4cc46"} Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.185055 5120 scope.go:117] "RemoveContainer" containerID="aac663539a87a40563cdbc36f105c3f7f4a4f053d388b2533a21e308f1a9cede" Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.185916 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-654b89dc46-nkv85"] Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.192042 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.197902 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-654b89dc46-nkv85"] Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.250078 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.259393 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.284293 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.285397 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29ae5ff5-ba64-4802-b5bf-3a62e0940755" containerName="nova-api-api" Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.285418 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="29ae5ff5-ba64-4802-b5bf-3a62e0940755" containerName="nova-api-api" Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.285452 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29ae5ff5-ba64-4802-b5bf-3a62e0940755" containerName="nova-api-log" Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.285458 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="29ae5ff5-ba64-4802-b5bf-3a62e0940755" containerName="nova-api-log" Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.285627 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="29ae5ff5-ba64-4802-b5bf-3a62e0940755" containerName="nova-api-api" Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.285657 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="29ae5ff5-ba64-4802-b5bf-3a62e0940755" containerName="nova-api-log" Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.301175 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.304198 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-public-svc\"" Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.304475 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-external-config-data\"" Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.329953 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.344282 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29wbs\" (UniqueName: \"kubernetes.io/projected/2018b64c-7208-4c67-b4ec-6e336ca72e94-kube-api-access-29wbs\") pod \"glance-default-external-api-0\" (UID: \"2018b64c-7208-4c67-b4ec-6e336ca72e94\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.344378 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2018b64c-7208-4c67-b4ec-6e336ca72e94-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"2018b64c-7208-4c67-b4ec-6e336ca72e94\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.344409 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/2018b64c-7208-4c67-b4ec-6e336ca72e94-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"2018b64c-7208-4c67-b4ec-6e336ca72e94\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.344499 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2018b64c-7208-4c67-b4ec-6e336ca72e94-scripts\") pod \"glance-default-external-api-0\" (UID: \"2018b64c-7208-4c67-b4ec-6e336ca72e94\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.344841 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2018b64c-7208-4c67-b4ec-6e336ca72e94-config-data\") pod \"glance-default-external-api-0\" (UID: \"2018b64c-7208-4c67-b4ec-6e336ca72e94\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.344903 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"glance-default-external-api-0\" (UID: \"2018b64c-7208-4c67-b4ec-6e336ca72e94\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.345082 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/2018b64c-7208-4c67-b4ec-6e336ca72e94-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"2018b64c-7208-4c67-b4ec-6e336ca72e94\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.345233 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2018b64c-7208-4c67-b4ec-6e336ca72e94-logs\") pod \"glance-default-external-api-0\" (UID: \"2018b64c-7208-4c67-b4ec-6e336ca72e94\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.370859 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.412266 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-6448f564f4-flpdw" Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.446420 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/3e60d330-61c0-4a9b-ac47-b35f12e5fd66-public-tls-certs\") pod \"3e60d330-61c0-4a9b-ac47-b35f12e5fd66\" (UID: \"3e60d330-61c0-4a9b-ac47-b35f12e5fd66\") " Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.446583 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3e60d330-61c0-4a9b-ac47-b35f12e5fd66-combined-ca-bundle\") pod \"3e60d330-61c0-4a9b-ac47-b35f12e5fd66\" (UID: \"3e60d330-61c0-4a9b-ac47-b35f12e5fd66\") " Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.446671 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4qvr8\" (UniqueName: \"kubernetes.io/projected/3e60d330-61c0-4a9b-ac47-b35f12e5fd66-kube-api-access-4qvr8\") pod \"3e60d330-61c0-4a9b-ac47-b35f12e5fd66\" (UID: \"3e60d330-61c0-4a9b-ac47-b35f12e5fd66\") " Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.446897 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/3e60d330-61c0-4a9b-ac47-b35f12e5fd66-httpd-config\") pod \"3e60d330-61c0-4a9b-ac47-b35f12e5fd66\" (UID: \"3e60d330-61c0-4a9b-ac47-b35f12e5fd66\") " Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.446962 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3e60d330-61c0-4a9b-ac47-b35f12e5fd66-config\") pod \"3e60d330-61c0-4a9b-ac47-b35f12e5fd66\" (UID: \"3e60d330-61c0-4a9b-ac47-b35f12e5fd66\") " Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.447198 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/3e60d330-61c0-4a9b-ac47-b35f12e5fd66-internal-tls-certs\") pod \"3e60d330-61c0-4a9b-ac47-b35f12e5fd66\" (UID: \"3e60d330-61c0-4a9b-ac47-b35f12e5fd66\") " Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.447318 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/3e60d330-61c0-4a9b-ac47-b35f12e5fd66-ovndb-tls-certs\") pod \"3e60d330-61c0-4a9b-ac47-b35f12e5fd66\" (UID: \"3e60d330-61c0-4a9b-ac47-b35f12e5fd66\") " Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.447569 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/2018b64c-7208-4c67-b4ec-6e336ca72e94-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"2018b64c-7208-4c67-b4ec-6e336ca72e94\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.447655 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2018b64c-7208-4c67-b4ec-6e336ca72e94-logs\") pod \"glance-default-external-api-0\" (UID: \"2018b64c-7208-4c67-b4ec-6e336ca72e94\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.447756 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-29wbs\" (UniqueName: \"kubernetes.io/projected/2018b64c-7208-4c67-b4ec-6e336ca72e94-kube-api-access-29wbs\") pod \"glance-default-external-api-0\" (UID: \"2018b64c-7208-4c67-b4ec-6e336ca72e94\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.447854 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2018b64c-7208-4c67-b4ec-6e336ca72e94-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"2018b64c-7208-4c67-b4ec-6e336ca72e94\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.447884 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/2018b64c-7208-4c67-b4ec-6e336ca72e94-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"2018b64c-7208-4c67-b4ec-6e336ca72e94\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.447936 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2018b64c-7208-4c67-b4ec-6e336ca72e94-scripts\") pod \"glance-default-external-api-0\" (UID: \"2018b64c-7208-4c67-b4ec-6e336ca72e94\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.448108 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2018b64c-7208-4c67-b4ec-6e336ca72e94-config-data\") pod \"glance-default-external-api-0\" (UID: \"2018b64c-7208-4c67-b4ec-6e336ca72e94\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.448151 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"glance-default-external-api-0\" (UID: \"2018b64c-7208-4c67-b4ec-6e336ca72e94\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.448617 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"glance-default-external-api-0\" (UID: \"2018b64c-7208-4c67-b4ec-6e336ca72e94\") device mount path \"/mnt/openstack/pv05\"" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.449508 5120 scope.go:117] "RemoveContainer" containerID="3becf490b4bf28a84982a708edd2116d8bc113f71c16c14e0c56f117360c4d97" Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.463317 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2018b64c-7208-4c67-b4ec-6e336ca72e94-logs\") pod \"glance-default-external-api-0\" (UID: \"2018b64c-7208-4c67-b4ec-6e336ca72e94\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.463562 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/2018b64c-7208-4c67-b4ec-6e336ca72e94-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"2018b64c-7208-4c67-b4ec-6e336ca72e94\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.464034 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2018b64c-7208-4c67-b4ec-6e336ca72e94-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"2018b64c-7208-4c67-b4ec-6e336ca72e94\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.478420 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2018b64c-7208-4c67-b4ec-6e336ca72e94-config-data\") pod \"glance-default-external-api-0\" (UID: \"2018b64c-7208-4c67-b4ec-6e336ca72e94\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.481629 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.482982 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e60d330-61c0-4a9b-ac47-b35f12e5fd66-kube-api-access-4qvr8" (OuterVolumeSpecName: "kube-api-access-4qvr8") pod "3e60d330-61c0-4a9b-ac47-b35f12e5fd66" (UID: "3e60d330-61c0-4a9b-ac47-b35f12e5fd66"). InnerVolumeSpecName "kube-api-access-4qvr8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.485361 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2018b64c-7208-4c67-b4ec-6e336ca72e94-scripts\") pod \"glance-default-external-api-0\" (UID: \"2018b64c-7208-4c67-b4ec-6e336ca72e94\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.485598 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/2018b64c-7208-4c67-b4ec-6e336ca72e94-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"2018b64c-7208-4c67-b4ec-6e336ca72e94\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.510376 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e60d330-61c0-4a9b-ac47-b35f12e5fd66-httpd-config" (OuterVolumeSpecName: "httpd-config") pod "3e60d330-61c0-4a9b-ac47-b35f12e5fd66" (UID: "3e60d330-61c0-4a9b-ac47-b35f12e5fd66"). InnerVolumeSpecName "httpd-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.529838 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.535213 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-29wbs\" (UniqueName: \"kubernetes.io/projected/2018b64c-7208-4c67-b4ec-6e336ca72e94-kube-api-access-29wbs\") pod \"glance-default-external-api-0\" (UID: \"2018b64c-7208-4c67-b4ec-6e336ca72e94\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.542450 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.544600 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e60d330-61c0-4a9b-ac47-b35f12e5fd66" containerName="neutron-api" Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.544719 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e60d330-61c0-4a9b-ac47-b35f12e5fd66" containerName="neutron-api" Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.544795 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e60d330-61c0-4a9b-ac47-b35f12e5fd66" containerName="neutron-httpd" Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.544807 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e60d330-61c0-4a9b-ac47-b35f12e5fd66" containerName="neutron-httpd" Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.545436 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="3e60d330-61c0-4a9b-ac47-b35f12e5fd66" containerName="neutron-api" Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.545470 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="3e60d330-61c0-4a9b-ac47-b35f12e5fd66" containerName="neutron-httpd" Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.551890 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4qvr8\" (UniqueName: \"kubernetes.io/projected/3e60d330-61c0-4a9b-ac47-b35f12e5fd66-kube-api-access-4qvr8\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.551920 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/3e60d330-61c0-4a9b-ac47-b35f12e5fd66-httpd-config\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.568215 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.569227 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"glance-default-external-api-0\" (UID: \"2018b64c-7208-4c67-b4ec-6e336ca72e94\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.573696 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-internal-svc\"" Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.573753 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-public-svc\"" Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.574355 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-config-data\"" Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.578300 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.656426 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/d4da2790-525e-44f0-bddd-c5edbb04ae32-internal-tls-certs\") pod \"nova-api-0\" (UID: \"d4da2790-525e-44f0-bddd-c5edbb04ae32\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.656690 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbvfr\" (UniqueName: \"kubernetes.io/projected/d4da2790-525e-44f0-bddd-c5edbb04ae32-kube-api-access-pbvfr\") pod \"nova-api-0\" (UID: \"d4da2790-525e-44f0-bddd-c5edbb04ae32\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.656749 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/d4da2790-525e-44f0-bddd-c5edbb04ae32-public-tls-certs\") pod \"nova-api-0\" (UID: \"d4da2790-525e-44f0-bddd-c5edbb04ae32\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.657613 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d4da2790-525e-44f0-bddd-c5edbb04ae32-logs\") pod \"nova-api-0\" (UID: \"d4da2790-525e-44f0-bddd-c5edbb04ae32\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.657735 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d4da2790-525e-44f0-bddd-c5edbb04ae32-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"d4da2790-525e-44f0-bddd-c5edbb04ae32\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.657868 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d4da2790-525e-44f0-bddd-c5edbb04ae32-config-data\") pod \"nova-api-0\" (UID: \"d4da2790-525e-44f0-bddd-c5edbb04ae32\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.674351 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.706741 5120 scope.go:117] "RemoveContainer" containerID="ab749e9165c3b32a457ee7d52df32d44bba16252b9d88677d4888b54e32947a7" Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.740158 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.742661 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee" containerName="cinder-api" containerID="cri-o://32ee293ec5c5b79f5752c783b21343e79effbfa28a13f724be9cd5fff90f077f" gracePeriod=30 Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.742658 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee" containerName="cinder-api-log" containerID="cri-o://d62c1b34b409b862479ce97ceab32e16b55f5d2b09e9a3eda65f971385fa4b73" gracePeriod=30 Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.771394 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d4da2790-525e-44f0-bddd-c5edbb04ae32-logs\") pod \"nova-api-0\" (UID: \"d4da2790-525e-44f0-bddd-c5edbb04ae32\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.771491 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d4da2790-525e-44f0-bddd-c5edbb04ae32-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"d4da2790-525e-44f0-bddd-c5edbb04ae32\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.771590 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d4da2790-525e-44f0-bddd-c5edbb04ae32-config-data\") pod \"nova-api-0\" (UID: \"d4da2790-525e-44f0-bddd-c5edbb04ae32\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.771695 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/d4da2790-525e-44f0-bddd-c5edbb04ae32-internal-tls-certs\") pod \"nova-api-0\" (UID: \"d4da2790-525e-44f0-bddd-c5edbb04ae32\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.779627 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d4da2790-525e-44f0-bddd-c5edbb04ae32-logs\") pod \"nova-api-0\" (UID: \"d4da2790-525e-44f0-bddd-c5edbb04ae32\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.784354 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pbvfr\" (UniqueName: \"kubernetes.io/projected/d4da2790-525e-44f0-bddd-c5edbb04ae32-kube-api-access-pbvfr\") pod \"nova-api-0\" (UID: \"d4da2790-525e-44f0-bddd-c5edbb04ae32\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.784432 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/d4da2790-525e-44f0-bddd-c5edbb04ae32-public-tls-certs\") pod \"nova-api-0\" (UID: \"d4da2790-525e-44f0-bddd-c5edbb04ae32\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.788404 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d4da2790-525e-44f0-bddd-c5edbb04ae32-config-data\") pod \"nova-api-0\" (UID: \"d4da2790-525e-44f0-bddd-c5edbb04ae32\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.789863 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/d4da2790-525e-44f0-bddd-c5edbb04ae32-internal-tls-certs\") pod \"nova-api-0\" (UID: \"d4da2790-525e-44f0-bddd-c5edbb04ae32\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.792197 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d4da2790-525e-44f0-bddd-c5edbb04ae32-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"d4da2790-525e-44f0-bddd-c5edbb04ae32\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.794738 5120 scope.go:117] "RemoveContainer" containerID="5113d15f8f41624447f1bdf582aecad1fb1c48fe4cd626381d844607c1670c0e" Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.799015 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e60d330-61c0-4a9b-ac47-b35f12e5fd66-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "3e60d330-61c0-4a9b-ac47-b35f12e5fd66" (UID: "3e60d330-61c0-4a9b-ac47-b35f12e5fd66"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.810601 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/d4da2790-525e-44f0-bddd-c5edbb04ae32-public-tls-certs\") pod \"nova-api-0\" (UID: \"d4da2790-525e-44f0-bddd-c5edbb04ae32\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.812691 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbvfr\" (UniqueName: \"kubernetes.io/projected/d4da2790-525e-44f0-bddd-c5edbb04ae32-kube-api-access-pbvfr\") pod \"nova-api-0\" (UID: \"d4da2790-525e-44f0-bddd-c5edbb04ae32\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.821711 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e60d330-61c0-4a9b-ac47-b35f12e5fd66-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "3e60d330-61c0-4a9b-ac47-b35f12e5fd66" (UID: "3e60d330-61c0-4a9b-ac47-b35f12e5fd66"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.886765 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/3e60d330-61c0-4a9b-ac47-b35f12e5fd66-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.886810 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/3e60d330-61c0-4a9b-ac47-b35f12e5fd66-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.935978 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e60d330-61c0-4a9b-ac47-b35f12e5fd66-config" (OuterVolumeSpecName: "config") pod "3e60d330-61c0-4a9b-ac47-b35f12e5fd66" (UID: "3e60d330-61c0-4a9b-ac47-b35f12e5fd66"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.967944 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e60d330-61c0-4a9b-ac47-b35f12e5fd66-ovndb-tls-certs" (OuterVolumeSpecName: "ovndb-tls-certs") pod "3e60d330-61c0-4a9b-ac47-b35f12e5fd66" (UID: "3e60d330-61c0-4a9b-ac47-b35f12e5fd66"). InnerVolumeSpecName "ovndb-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.971265 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e60d330-61c0-4a9b-ac47-b35f12e5fd66-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "3e60d330-61c0-4a9b-ac47-b35f12e5fd66" (UID: "3e60d330-61c0-4a9b-ac47-b35f12e5fd66"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.989799 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3e60d330-61c0-4a9b-ac47-b35f12e5fd66-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.989840 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/3e60d330-61c0-4a9b-ac47-b35f12e5fd66-config\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:33 crc kubenswrapper[5120]: I0316 17:09:33.989853 5120 reconciler_common.go:299] "Volume detached for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/3e60d330-61c0-4a9b-ac47-b35f12e5fd66-ovndb-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:34 crc kubenswrapper[5120]: I0316 17:09:34.032099 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:09:34 crc kubenswrapper[5120]: I0316 17:09:34.083083 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 17:09:34 crc kubenswrapper[5120]: W0316 17:09:34.103189 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode7b10940_fda7_468a_8937_fd83bb366d34.slice/crio-4ed3e56c2b1fab5acea71079e783b6b8d8742d9e0be43445badfbc878759023c WatchSource:0}: Error finding container 4ed3e56c2b1fab5acea71079e783b6b8d8742d9e0be43445badfbc878759023c: Status 404 returned error can't find the container with id 4ed3e56c2b1fab5acea71079e783b6b8d8742d9e0be43445badfbc878759023c Mar 16 17:09:34 crc kubenswrapper[5120]: I0316 17:09:34.133815 5120 scope.go:117] "RemoveContainer" containerID="6aa27953707d5c4f984252682219bc8743d546a1dd26ee6446eb7b79de49b141" Mar 16 17:09:34 crc kubenswrapper[5120]: I0316 17:09:34.157442 5120 scope.go:117] "RemoveContainer" containerID="795e271388f1ee779baa8580299770571c69be920fa0a704294451a4f44a795a" Mar 16 17:09:34 crc kubenswrapper[5120]: I0316 17:09:34.212122 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"e7b10940-fda7-468a-8937-fd83bb366d34","Type":"ContainerStarted","Data":"4ed3e56c2b1fab5acea71079e783b6b8d8742d9e0be43445badfbc878759023c"} Mar 16 17:09:34 crc kubenswrapper[5120]: I0316 17:09:34.221075 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-6448f564f4-flpdw" event={"ID":"3e60d330-61c0-4a9b-ac47-b35f12e5fd66","Type":"ContainerDied","Data":"2aa333107c5033677f5bc47d7561674c10767c5586bf58b75bf82e054b9794df"} Mar 16 17:09:34 crc kubenswrapper[5120]: I0316 17:09:34.221209 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-6448f564f4-flpdw" Mar 16 17:09:34 crc kubenswrapper[5120]: I0316 17:09:34.236627 5120 generic.go:358] "Generic (PLEG): container finished" podID="f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee" containerID="d62c1b34b409b862479ce97ceab32e16b55f5d2b09e9a3eda65f971385fa4b73" exitCode=143 Mar 16 17:09:34 crc kubenswrapper[5120]: I0316 17:09:34.236725 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee","Type":"ContainerDied","Data":"d62c1b34b409b862479ce97ceab32e16b55f5d2b09e9a3eda65f971385fa4b73"} Mar 16 17:09:34 crc kubenswrapper[5120]: I0316 17:09:34.248094 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-78cd6f6d9d-zhxpn" event={"ID":"dcd050a7-3f66-4fb5-a7a3-5736ee13ce15","Type":"ContainerStarted","Data":"99b99b53dc0cd79216b383a2ab315dc8b8df88444a4b329a892f7a8f2d6e16dd"} Mar 16 17:09:34 crc kubenswrapper[5120]: I0316 17:09:34.248906 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-78cd6f6d9d-zhxpn" Mar 16 17:09:34 crc kubenswrapper[5120]: I0316 17:09:34.248931 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-78cd6f6d9d-zhxpn" Mar 16 17:09:34 crc kubenswrapper[5120]: I0316 17:09:34.266085 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-7465cc7fb4-nnm87" event={"ID":"c4f7000d-d4eb-4d8c-9fb8-f88d8304b970","Type":"ContainerStarted","Data":"d93c264fc36e771c9504140efad8afbcbd5602b5de8be501ada220aa581fc08e"} Mar 16 17:09:34 crc kubenswrapper[5120]: I0316 17:09:34.266135 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-7465cc7fb4-nnm87" event={"ID":"c4f7000d-d4eb-4d8c-9fb8-f88d8304b970","Type":"ContainerStarted","Data":"9993ec5c6b4f30c9d30dafdea7deb75c1a50d89140e90b70baf9a257151faf98"} Mar 16 17:09:34 crc kubenswrapper[5120]: I0316 17:09:34.267101 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/neutron-7465cc7fb4-nnm87" Mar 16 17:09:34 crc kubenswrapper[5120]: I0316 17:09:34.276199 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-78cd6f6d9d-zhxpn" podStartSLOduration=3.276181452 podStartE2EDuration="3.276181452s" podCreationTimestamp="2026-03-16 17:09:31 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:09:34.274613239 +0000 UTC m=+5876.428544896" watchObservedRunningTime="2026-03-16 17:09:34.276181452 +0000 UTC m=+5876.430113129" Mar 16 17:09:34 crc kubenswrapper[5120]: I0316 17:09:34.300935 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-7465cc7fb4-nnm87" podStartSLOduration=3.300918486 podStartE2EDuration="3.300918486s" podCreationTimestamp="2026-03-16 17:09:31 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:09:34.298466328 +0000 UTC m=+5876.452397985" watchObservedRunningTime="2026-03-16 17:09:34.300918486 +0000 UTC m=+5876.454850153" Mar 16 17:09:34 crc kubenswrapper[5120]: I0316 17:09:34.343714 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 17:09:34 crc kubenswrapper[5120]: I0316 17:09:34.362393 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-6448f564f4-flpdw"] Mar 16 17:09:34 crc kubenswrapper[5120]: I0316 17:09:34.381814 5120 scope.go:117] "RemoveContainer" containerID="6aa27953707d5c4f984252682219bc8743d546a1dd26ee6446eb7b79de49b141" Mar 16 17:09:34 crc kubenswrapper[5120]: I0316 17:09:34.383970 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-6448f564f4-flpdw"] Mar 16 17:09:34 crc kubenswrapper[5120]: E0316 17:09:34.392117 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6aa27953707d5c4f984252682219bc8743d546a1dd26ee6446eb7b79de49b141\": container with ID starting with 6aa27953707d5c4f984252682219bc8743d546a1dd26ee6446eb7b79de49b141 not found: ID does not exist" containerID="6aa27953707d5c4f984252682219bc8743d546a1dd26ee6446eb7b79de49b141" Mar 16 17:09:34 crc kubenswrapper[5120]: I0316 17:09:34.392178 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6aa27953707d5c4f984252682219bc8743d546a1dd26ee6446eb7b79de49b141"} err="failed to get container status \"6aa27953707d5c4f984252682219bc8743d546a1dd26ee6446eb7b79de49b141\": rpc error: code = NotFound desc = could not find container \"6aa27953707d5c4f984252682219bc8743d546a1dd26ee6446eb7b79de49b141\": container with ID starting with 6aa27953707d5c4f984252682219bc8743d546a1dd26ee6446eb7b79de49b141 not found: ID does not exist" Mar 16 17:09:34 crc kubenswrapper[5120]: I0316 17:09:34.392211 5120 scope.go:117] "RemoveContainer" containerID="795e271388f1ee779baa8580299770571c69be920fa0a704294451a4f44a795a" Mar 16 17:09:34 crc kubenswrapper[5120]: E0316 17:09:34.394211 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"795e271388f1ee779baa8580299770571c69be920fa0a704294451a4f44a795a\": container with ID starting with 795e271388f1ee779baa8580299770571c69be920fa0a704294451a4f44a795a not found: ID does not exist" containerID="795e271388f1ee779baa8580299770571c69be920fa0a704294451a4f44a795a" Mar 16 17:09:34 crc kubenswrapper[5120]: I0316 17:09:34.394252 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"795e271388f1ee779baa8580299770571c69be920fa0a704294451a4f44a795a"} err="failed to get container status \"795e271388f1ee779baa8580299770571c69be920fa0a704294451a4f44a795a\": rpc error: code = NotFound desc = could not find container \"795e271388f1ee779baa8580299770571c69be920fa0a704294451a4f44a795a\": container with ID starting with 795e271388f1ee779baa8580299770571c69be920fa0a704294451a4f44a795a not found: ID does not exist" Mar 16 17:09:34 crc kubenswrapper[5120]: I0316 17:09:34.394273 5120 scope.go:117] "RemoveContainer" containerID="6aa27953707d5c4f984252682219bc8743d546a1dd26ee6446eb7b79de49b141" Mar 16 17:09:34 crc kubenswrapper[5120]: I0316 17:09:34.394650 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6aa27953707d5c4f984252682219bc8743d546a1dd26ee6446eb7b79de49b141"} err="failed to get container status \"6aa27953707d5c4f984252682219bc8743d546a1dd26ee6446eb7b79de49b141\": rpc error: code = NotFound desc = could not find container \"6aa27953707d5c4f984252682219bc8743d546a1dd26ee6446eb7b79de49b141\": container with ID starting with 6aa27953707d5c4f984252682219bc8743d546a1dd26ee6446eb7b79de49b141 not found: ID does not exist" Mar 16 17:09:34 crc kubenswrapper[5120]: I0316 17:09:34.394691 5120 scope.go:117] "RemoveContainer" containerID="795e271388f1ee779baa8580299770571c69be920fa0a704294451a4f44a795a" Mar 16 17:09:34 crc kubenswrapper[5120]: I0316 17:09:34.395029 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"795e271388f1ee779baa8580299770571c69be920fa0a704294451a4f44a795a"} err="failed to get container status \"795e271388f1ee779baa8580299770571c69be920fa0a704294451a4f44a795a\": rpc error: code = NotFound desc = could not find container \"795e271388f1ee779baa8580299770571c69be920fa0a704294451a4f44a795a\": container with ID starting with 795e271388f1ee779baa8580299770571c69be920fa0a704294451a4f44a795a not found: ID does not exist" Mar 16 17:09:34 crc kubenswrapper[5120]: I0316 17:09:34.395082 5120 scope.go:117] "RemoveContainer" containerID="ee89fe5fa4f1a948d6acb067c8ec91895dbd831d32a6ddad7d94acac43b34211" Mar 16 17:09:34 crc kubenswrapper[5120]: I0316 17:09:34.489683 5120 scope.go:117] "RemoveContainer" containerID="3489de754964a0e3fed9cd51b42522048244f6ae68a976386a1ed47728c4cc46" Mar 16 17:09:34 crc kubenswrapper[5120]: I0316 17:09:34.683946 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="29ae5ff5-ba64-4802-b5bf-3a62e0940755" path="/var/lib/kubelet/pods/29ae5ff5-ba64-4802-b5bf-3a62e0940755/volumes" Mar 16 17:09:34 crc kubenswrapper[5120]: I0316 17:09:34.684887 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3e60d330-61c0-4a9b-ac47-b35f12e5fd66" path="/var/lib/kubelet/pods/3e60d330-61c0-4a9b-ac47-b35f12e5fd66/volumes" Mar 16 17:09:34 crc kubenswrapper[5120]: I0316 17:09:34.685587 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5f0f24cd-dbef-4a0a-9e2b-cb5a170982aa" path="/var/lib/kubelet/pods/5f0f24cd-dbef-4a0a-9e2b-cb5a170982aa/volumes" Mar 16 17:09:34 crc kubenswrapper[5120]: I0316 17:09:34.687148 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f4f308ec-0dee-4238-817c-144d3f5f7f5d" path="/var/lib/kubelet/pods/f4f308ec-0dee-4238-817c-144d3f5f7f5d/volumes" Mar 16 17:09:34 crc kubenswrapper[5120]: I0316 17:09:34.687796 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 17:09:35 crc kubenswrapper[5120]: I0316 17:09:35.309431 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"2018b64c-7208-4c67-b4ec-6e336ca72e94","Type":"ContainerStarted","Data":"6bb073a01c96eef1da19b76d216e5216781d9c8805e39d2c2651bb9ef84dc90b"} Mar 16 17:09:35 crc kubenswrapper[5120]: I0316 17:09:35.309941 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"2018b64c-7208-4c67-b4ec-6e336ca72e94","Type":"ContainerStarted","Data":"f7d84cb1e07b3af44d36c8a4f0ad268dea779a682dfb187b123c3805390ec196"} Mar 16 17:09:35 crc kubenswrapper[5120]: I0316 17:09:35.317725 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"d4da2790-525e-44f0-bddd-c5edbb04ae32","Type":"ContainerStarted","Data":"f2efc7da21335cdb240543f9916c5733bbfdf99fd99f425706ed593332a62064"} Mar 16 17:09:35 crc kubenswrapper[5120]: I0316 17:09:35.317841 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"d4da2790-525e-44f0-bddd-c5edbb04ae32","Type":"ContainerStarted","Data":"1e924a770f65d5ad514a8ac7bd29e74fcd80c4839b439debaf9aba0634fa1121"} Mar 16 17:09:35 crc kubenswrapper[5120]: I0316 17:09:35.317856 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"d4da2790-525e-44f0-bddd-c5edbb04ae32","Type":"ContainerStarted","Data":"ab5895d4594fc9dd2b6fcf8e8ee228215cdf60a0a1c804b47e4885c40fa21b85"} Mar 16 17:09:35 crc kubenswrapper[5120]: I0316 17:09:35.322432 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"e7b10940-fda7-468a-8937-fd83bb366d34","Type":"ContainerStarted","Data":"7d229d4a90d7e12f3dfc016d6b5ebcdcc002d8e3fd67e8f62fe2202b444410ff"} Mar 16 17:09:35 crc kubenswrapper[5120]: I0316 17:09:35.338139 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=2.338115718 podStartE2EDuration="2.338115718s" podCreationTimestamp="2026-03-16 17:09:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:09:35.334755995 +0000 UTC m=+5877.488687652" watchObservedRunningTime="2026-03-16 17:09:35.338115718 +0000 UTC m=+5877.492047385" Mar 16 17:09:35 crc kubenswrapper[5120]: I0316 17:09:35.572794 5120 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 17:09:35 crc kubenswrapper[5120]: I0316 17:09:35.573286 5120 scope.go:117] "RemoveContainer" containerID="c95c639838ab0891241eeaedc65582a42fe56eb64e08e9942cc764c9beef0e20" Mar 16 17:09:35 crc kubenswrapper[5120]: E0316 17:09:35.574118 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nova-cell0-conductor-conductor\" with CrashLoopBackOff: \"back-off 40s restarting failed container=nova-cell0-conductor-conductor pod=nova-cell0-conductor-0_openstack-kuttl-tests(9a997459-37ba-46a9-9cb8-075f77fa009f)\"" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="9a997459-37ba-46a9-9cb8-075f77fa009f" Mar 16 17:09:36 crc kubenswrapper[5120]: I0316 17:09:36.352888 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"e7b10940-fda7-468a-8937-fd83bb366d34","Type":"ContainerStarted","Data":"a1bb69956d1edd628b3b3c76712ce534b5124418bc79a860b504fffe24badfcb"} Mar 16 17:09:36 crc kubenswrapper[5120]: I0316 17:09:36.359978 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"2018b64c-7208-4c67-b4ec-6e336ca72e94","Type":"ContainerStarted","Data":"b7f9960864f2d86cfd72bc79ac062310e15b22ddad4c040c4f184bf9539ee4cd"} Mar 16 17:09:36 crc kubenswrapper[5120]: I0316 17:09:36.379422 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-internal-api-0" podStartSLOduration=4.379403274 podStartE2EDuration="4.379403274s" podCreationTimestamp="2026-03-16 17:09:32 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:09:36.378206271 +0000 UTC m=+5878.532137948" watchObservedRunningTime="2026-03-16 17:09:36.379403274 +0000 UTC m=+5878.533334931" Mar 16 17:09:36 crc kubenswrapper[5120]: I0316 17:09:36.403923 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-external-api-0" podStartSLOduration=3.403902521 podStartE2EDuration="3.403902521s" podCreationTimestamp="2026-03-16 17:09:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:09:36.398315267 +0000 UTC m=+5878.552246924" watchObservedRunningTime="2026-03-16 17:09:36.403902521 +0000 UTC m=+5878.557834178" Mar 16 17:09:36 crc kubenswrapper[5120]: I0316 17:09:36.471522 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-api-65b47b9b44-khswm"] Mar 16 17:09:36 crc kubenswrapper[5120]: I0316 17:09:36.483608 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-65b47b9b44-khswm" Mar 16 17:09:36 crc kubenswrapper[5120]: I0316 17:09:36.484930 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-65b47b9b44-khswm"] Mar 16 17:09:36 crc kubenswrapper[5120]: I0316 17:09:36.590507 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/eed6d812-3092-456e-8466-c6f875c06a54-logs\") pod \"barbican-api-65b47b9b44-khswm\" (UID: \"eed6d812-3092-456e-8466-c6f875c06a54\") " pod="openstack-kuttl-tests/barbican-api-65b47b9b44-khswm" Mar 16 17:09:36 crc kubenswrapper[5120]: I0316 17:09:36.590837 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/eed6d812-3092-456e-8466-c6f875c06a54-internal-tls-certs\") pod \"barbican-api-65b47b9b44-khswm\" (UID: \"eed6d812-3092-456e-8466-c6f875c06a54\") " pod="openstack-kuttl-tests/barbican-api-65b47b9b44-khswm" Mar 16 17:09:36 crc kubenswrapper[5120]: I0316 17:09:36.590906 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/eed6d812-3092-456e-8466-c6f875c06a54-config-data\") pod \"barbican-api-65b47b9b44-khswm\" (UID: \"eed6d812-3092-456e-8466-c6f875c06a54\") " pod="openstack-kuttl-tests/barbican-api-65b47b9b44-khswm" Mar 16 17:09:36 crc kubenswrapper[5120]: I0316 17:09:36.591023 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eed6d812-3092-456e-8466-c6f875c06a54-combined-ca-bundle\") pod \"barbican-api-65b47b9b44-khswm\" (UID: \"eed6d812-3092-456e-8466-c6f875c06a54\") " pod="openstack-kuttl-tests/barbican-api-65b47b9b44-khswm" Mar 16 17:09:36 crc kubenswrapper[5120]: I0316 17:09:36.591112 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/eed6d812-3092-456e-8466-c6f875c06a54-config-data-custom\") pod \"barbican-api-65b47b9b44-khswm\" (UID: \"eed6d812-3092-456e-8466-c6f875c06a54\") " pod="openstack-kuttl-tests/barbican-api-65b47b9b44-khswm" Mar 16 17:09:36 crc kubenswrapper[5120]: I0316 17:09:36.591398 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gflfw\" (UniqueName: \"kubernetes.io/projected/eed6d812-3092-456e-8466-c6f875c06a54-kube-api-access-gflfw\") pod \"barbican-api-65b47b9b44-khswm\" (UID: \"eed6d812-3092-456e-8466-c6f875c06a54\") " pod="openstack-kuttl-tests/barbican-api-65b47b9b44-khswm" Mar 16 17:09:36 crc kubenswrapper[5120]: I0316 17:09:36.591491 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/eed6d812-3092-456e-8466-c6f875c06a54-public-tls-certs\") pod \"barbican-api-65b47b9b44-khswm\" (UID: \"eed6d812-3092-456e-8466-c6f875c06a54\") " pod="openstack-kuttl-tests/barbican-api-65b47b9b44-khswm" Mar 16 17:09:36 crc kubenswrapper[5120]: I0316 17:09:36.693680 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/eed6d812-3092-456e-8466-c6f875c06a54-logs\") pod \"barbican-api-65b47b9b44-khswm\" (UID: \"eed6d812-3092-456e-8466-c6f875c06a54\") " pod="openstack-kuttl-tests/barbican-api-65b47b9b44-khswm" Mar 16 17:09:36 crc kubenswrapper[5120]: I0316 17:09:36.694039 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/eed6d812-3092-456e-8466-c6f875c06a54-internal-tls-certs\") pod \"barbican-api-65b47b9b44-khswm\" (UID: \"eed6d812-3092-456e-8466-c6f875c06a54\") " pod="openstack-kuttl-tests/barbican-api-65b47b9b44-khswm" Mar 16 17:09:36 crc kubenswrapper[5120]: I0316 17:09:36.694084 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/eed6d812-3092-456e-8466-c6f875c06a54-config-data\") pod \"barbican-api-65b47b9b44-khswm\" (UID: \"eed6d812-3092-456e-8466-c6f875c06a54\") " pod="openstack-kuttl-tests/barbican-api-65b47b9b44-khswm" Mar 16 17:09:36 crc kubenswrapper[5120]: I0316 17:09:36.694128 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eed6d812-3092-456e-8466-c6f875c06a54-combined-ca-bundle\") pod \"barbican-api-65b47b9b44-khswm\" (UID: \"eed6d812-3092-456e-8466-c6f875c06a54\") " pod="openstack-kuttl-tests/barbican-api-65b47b9b44-khswm" Mar 16 17:09:36 crc kubenswrapper[5120]: I0316 17:09:36.694235 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/eed6d812-3092-456e-8466-c6f875c06a54-logs\") pod \"barbican-api-65b47b9b44-khswm\" (UID: \"eed6d812-3092-456e-8466-c6f875c06a54\") " pod="openstack-kuttl-tests/barbican-api-65b47b9b44-khswm" Mar 16 17:09:36 crc kubenswrapper[5120]: I0316 17:09:36.694313 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/eed6d812-3092-456e-8466-c6f875c06a54-config-data-custom\") pod \"barbican-api-65b47b9b44-khswm\" (UID: \"eed6d812-3092-456e-8466-c6f875c06a54\") " pod="openstack-kuttl-tests/barbican-api-65b47b9b44-khswm" Mar 16 17:09:36 crc kubenswrapper[5120]: I0316 17:09:36.695508 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gflfw\" (UniqueName: \"kubernetes.io/projected/eed6d812-3092-456e-8466-c6f875c06a54-kube-api-access-gflfw\") pod \"barbican-api-65b47b9b44-khswm\" (UID: \"eed6d812-3092-456e-8466-c6f875c06a54\") " pod="openstack-kuttl-tests/barbican-api-65b47b9b44-khswm" Mar 16 17:09:36 crc kubenswrapper[5120]: I0316 17:09:36.695631 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/eed6d812-3092-456e-8466-c6f875c06a54-public-tls-certs\") pod \"barbican-api-65b47b9b44-khswm\" (UID: \"eed6d812-3092-456e-8466-c6f875c06a54\") " pod="openstack-kuttl-tests/barbican-api-65b47b9b44-khswm" Mar 16 17:09:36 crc kubenswrapper[5120]: I0316 17:09:36.708143 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/eed6d812-3092-456e-8466-c6f875c06a54-config-data-custom\") pod \"barbican-api-65b47b9b44-khswm\" (UID: \"eed6d812-3092-456e-8466-c6f875c06a54\") " pod="openstack-kuttl-tests/barbican-api-65b47b9b44-khswm" Mar 16 17:09:36 crc kubenswrapper[5120]: I0316 17:09:36.708199 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/eed6d812-3092-456e-8466-c6f875c06a54-internal-tls-certs\") pod \"barbican-api-65b47b9b44-khswm\" (UID: \"eed6d812-3092-456e-8466-c6f875c06a54\") " pod="openstack-kuttl-tests/barbican-api-65b47b9b44-khswm" Mar 16 17:09:36 crc kubenswrapper[5120]: I0316 17:09:36.708726 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/eed6d812-3092-456e-8466-c6f875c06a54-config-data\") pod \"barbican-api-65b47b9b44-khswm\" (UID: \"eed6d812-3092-456e-8466-c6f875c06a54\") " pod="openstack-kuttl-tests/barbican-api-65b47b9b44-khswm" Mar 16 17:09:36 crc kubenswrapper[5120]: I0316 17:09:36.708907 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eed6d812-3092-456e-8466-c6f875c06a54-combined-ca-bundle\") pod \"barbican-api-65b47b9b44-khswm\" (UID: \"eed6d812-3092-456e-8466-c6f875c06a54\") " pod="openstack-kuttl-tests/barbican-api-65b47b9b44-khswm" Mar 16 17:09:36 crc kubenswrapper[5120]: I0316 17:09:36.711393 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/eed6d812-3092-456e-8466-c6f875c06a54-public-tls-certs\") pod \"barbican-api-65b47b9b44-khswm\" (UID: \"eed6d812-3092-456e-8466-c6f875c06a54\") " pod="openstack-kuttl-tests/barbican-api-65b47b9b44-khswm" Mar 16 17:09:36 crc kubenswrapper[5120]: I0316 17:09:36.719220 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gflfw\" (UniqueName: \"kubernetes.io/projected/eed6d812-3092-456e-8466-c6f875c06a54-kube-api-access-gflfw\") pod \"barbican-api-65b47b9b44-khswm\" (UID: \"eed6d812-3092-456e-8466-c6f875c06a54\") " pod="openstack-kuttl-tests/barbican-api-65b47b9b44-khswm" Mar 16 17:09:36 crc kubenswrapper[5120]: I0316 17:09:36.808616 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-65b47b9b44-khswm" Mar 16 17:09:36 crc kubenswrapper[5120]: I0316 17:09:36.931608 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/cinder-api-0" podUID="f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee" containerName="cinder-api" probeResult="failure" output="Get \"https://10.217.0.21:8776/healthcheck\": read tcp 10.217.0.2:60864->10.217.0.21:8776: read: connection reset by peer" Mar 16 17:09:37 crc kubenswrapper[5120]: I0316 17:09:37.270838 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-65b47b9b44-khswm"] Mar 16 17:09:37 crc kubenswrapper[5120]: W0316 17:09:37.277420 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podeed6d812_3092_456e_8466_c6f875c06a54.slice/crio-cc60b918168b73985bd8091be55b9dce9591585f5b0abc17220c8f7004f0f036 WatchSource:0}: Error finding container cc60b918168b73985bd8091be55b9dce9591585f5b0abc17220c8f7004f0f036: Status 404 returned error can't find the container with id cc60b918168b73985bd8091be55b9dce9591585f5b0abc17220c8f7004f0f036 Mar 16 17:09:37 crc kubenswrapper[5120]: I0316 17:09:37.377687 5120 generic.go:358] "Generic (PLEG): container finished" podID="f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee" containerID="32ee293ec5c5b79f5752c783b21343e79effbfa28a13f724be9cd5fff90f077f" exitCode=0 Mar 16 17:09:37 crc kubenswrapper[5120]: I0316 17:09:37.377806 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee","Type":"ContainerDied","Data":"32ee293ec5c5b79f5752c783b21343e79effbfa28a13f724be9cd5fff90f077f"} Mar 16 17:09:37 crc kubenswrapper[5120]: I0316 17:09:37.377866 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee","Type":"ContainerDied","Data":"9e1f064a72d3e67659ab7a5a44caecdb144ee6fe67e5bdcee10a17b755660f81"} Mar 16 17:09:37 crc kubenswrapper[5120]: I0316 17:09:37.377880 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9e1f064a72d3e67659ab7a5a44caecdb144ee6fe67e5bdcee10a17b755660f81" Mar 16 17:09:37 crc kubenswrapper[5120]: I0316 17:09:37.380916 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-65b47b9b44-khswm" event={"ID":"eed6d812-3092-456e-8466-c6f875c06a54","Type":"ContainerStarted","Data":"cc60b918168b73985bd8091be55b9dce9591585f5b0abc17220c8f7004f0f036"} Mar 16 17:09:37 crc kubenswrapper[5120]: I0316 17:09:37.385786 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:09:37 crc kubenswrapper[5120]: I0316 17:09:37.531156 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee-etc-machine-id\") pod \"f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee\" (UID: \"f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee\") " Mar 16 17:09:37 crc kubenswrapper[5120]: I0316 17:09:37.531352 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee-config-data\") pod \"f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee\" (UID: \"f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee\") " Mar 16 17:09:37 crc kubenswrapper[5120]: I0316 17:09:37.531393 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee-combined-ca-bundle\") pod \"f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee\" (UID: \"f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee\") " Mar 16 17:09:37 crc kubenswrapper[5120]: I0316 17:09:37.531416 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee-public-tls-certs\") pod \"f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee\" (UID: \"f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee\") " Mar 16 17:09:37 crc kubenswrapper[5120]: I0316 17:09:37.531538 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee-scripts\") pod \"f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee\" (UID: \"f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee\") " Mar 16 17:09:37 crc kubenswrapper[5120]: I0316 17:09:37.531654 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2pkpk\" (UniqueName: \"kubernetes.io/projected/f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee-kube-api-access-2pkpk\") pod \"f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee\" (UID: \"f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee\") " Mar 16 17:09:37 crc kubenswrapper[5120]: I0316 17:09:37.531746 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee-internal-tls-certs\") pod \"f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee\" (UID: \"f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee\") " Mar 16 17:09:37 crc kubenswrapper[5120]: I0316 17:09:37.531974 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee-config-data-custom\") pod \"f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee\" (UID: \"f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee\") " Mar 16 17:09:37 crc kubenswrapper[5120]: I0316 17:09:37.532188 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee-logs\") pod \"f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee\" (UID: \"f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee\") " Mar 16 17:09:37 crc kubenswrapper[5120]: I0316 17:09:37.533077 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee" (UID: "f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 17:09:37 crc kubenswrapper[5120]: I0316 17:09:37.533706 5120 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:37 crc kubenswrapper[5120]: I0316 17:09:37.535432 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee-logs" (OuterVolumeSpecName: "logs") pod "f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee" (UID: "f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:09:37 crc kubenswrapper[5120]: I0316 17:09:37.538306 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee-scripts" (OuterVolumeSpecName: "scripts") pod "f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee" (UID: "f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:09:37 crc kubenswrapper[5120]: I0316 17:09:37.542988 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee" (UID: "f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:09:37 crc kubenswrapper[5120]: I0316 17:09:37.543277 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee-kube-api-access-2pkpk" (OuterVolumeSpecName: "kube-api-access-2pkpk") pod "f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee" (UID: "f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee"). InnerVolumeSpecName "kube-api-access-2pkpk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:09:37 crc kubenswrapper[5120]: I0316 17:09:37.577481 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee" (UID: "f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:09:37 crc kubenswrapper[5120]: I0316 17:09:37.611063 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee" (UID: "f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:09:37 crc kubenswrapper[5120]: I0316 17:09:37.628442 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee-config-data" (OuterVolumeSpecName: "config-data") pod "f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee" (UID: "f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:09:37 crc kubenswrapper[5120]: I0316 17:09:37.635280 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee" (UID: "f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:09:37 crc kubenswrapper[5120]: I0316 17:09:37.635479 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee-internal-tls-certs\") pod \"f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee\" (UID: \"f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee\") " Mar 16 17:09:37 crc kubenswrapper[5120]: W0316 17:09:37.635542 5120 empty_dir.go:511] Warning: Unmount skipped because path does not exist: /var/lib/kubelet/pods/f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee/volumes/kubernetes.io~secret/internal-tls-certs Mar 16 17:09:37 crc kubenswrapper[5120]: I0316 17:09:37.635555 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee" (UID: "f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:09:37 crc kubenswrapper[5120]: I0316 17:09:37.637314 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:37 crc kubenswrapper[5120]: I0316 17:09:37.637337 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:37 crc kubenswrapper[5120]: I0316 17:09:37.637354 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:37 crc kubenswrapper[5120]: I0316 17:09:37.637366 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:37 crc kubenswrapper[5120]: I0316 17:09:37.637378 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2pkpk\" (UniqueName: \"kubernetes.io/projected/f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee-kube-api-access-2pkpk\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:37 crc kubenswrapper[5120]: I0316 17:09:37.637390 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:37 crc kubenswrapper[5120]: I0316 17:09:37.637402 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:37 crc kubenswrapper[5120]: I0316 17:09:37.637414 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee-logs\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:38 crc kubenswrapper[5120]: I0316 17:09:38.392200 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-65b47b9b44-khswm" event={"ID":"eed6d812-3092-456e-8466-c6f875c06a54","Type":"ContainerStarted","Data":"74a87c3218b23e78bc7c968b0b2554c589b5b54ac4bba62c1eb24132231545d5"} Mar 16 17:09:38 crc kubenswrapper[5120]: I0316 17:09:38.392373 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:09:38 crc kubenswrapper[5120]: I0316 17:09:38.392754 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-65b47b9b44-khswm" Mar 16 17:09:38 crc kubenswrapper[5120]: I0316 17:09:38.392808 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-65b47b9b44-khswm" Mar 16 17:09:38 crc kubenswrapper[5120]: I0316 17:09:38.392818 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-65b47b9b44-khswm" event={"ID":"eed6d812-3092-456e-8466-c6f875c06a54","Type":"ContainerStarted","Data":"7311de92d62120cf0d27fb178a82d0c2fe9381838c224044fb33e9be38516dd9"} Mar 16 17:09:38 crc kubenswrapper[5120]: I0316 17:09:38.414172 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-api-65b47b9b44-khswm" podStartSLOduration=2.414156994 podStartE2EDuration="2.414156994s" podCreationTimestamp="2026-03-16 17:09:36 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:09:38.410464073 +0000 UTC m=+5880.564395730" watchObservedRunningTime="2026-03-16 17:09:38.414156994 +0000 UTC m=+5880.568088651" Mar 16 17:09:38 crc kubenswrapper[5120]: I0316 17:09:38.448970 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 17:09:38 crc kubenswrapper[5120]: I0316 17:09:38.466170 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 17:09:38 crc kubenswrapper[5120]: I0316 17:09:38.482517 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 17:09:38 crc kubenswrapper[5120]: I0316 17:09:38.487414 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee" containerName="cinder-api-log" Mar 16 17:09:38 crc kubenswrapper[5120]: I0316 17:09:38.487469 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee" containerName="cinder-api-log" Mar 16 17:09:38 crc kubenswrapper[5120]: I0316 17:09:38.487566 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee" containerName="cinder-api" Mar 16 17:09:38 crc kubenswrapper[5120]: I0316 17:09:38.487574 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee" containerName="cinder-api" Mar 16 17:09:38 crc kubenswrapper[5120]: I0316 17:09:38.487811 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee" containerName="cinder-api-log" Mar 16 17:09:38 crc kubenswrapper[5120]: I0316 17:09:38.487834 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee" containerName="cinder-api" Mar 16 17:09:38 crc kubenswrapper[5120]: I0316 17:09:38.495466 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:09:38 crc kubenswrapper[5120]: I0316 17:09:38.495683 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 17:09:38 crc kubenswrapper[5120]: I0316 17:09:38.498101 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-cinder-internal-svc\"" Mar 16 17:09:38 crc kubenswrapper[5120]: I0316 17:09:38.498262 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-cinder-public-svc\"" Mar 16 17:09:38 crc kubenswrapper[5120]: I0316 17:09:38.498477 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-api-config-data\"" Mar 16 17:09:38 crc kubenswrapper[5120]: I0316 17:09:38.565866 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ade246ff-09d5-4b25-a738-4733af58f79c-logs\") pod \"cinder-api-0\" (UID: \"ade246ff-09d5-4b25-a738-4733af58f79c\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:09:38 crc kubenswrapper[5120]: I0316 17:09:38.565949 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/ade246ff-09d5-4b25-a738-4733af58f79c-config-data-custom\") pod \"cinder-api-0\" (UID: \"ade246ff-09d5-4b25-a738-4733af58f79c\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:09:38 crc kubenswrapper[5120]: I0316 17:09:38.566077 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ade246ff-09d5-4b25-a738-4733af58f79c-public-tls-certs\") pod \"cinder-api-0\" (UID: \"ade246ff-09d5-4b25-a738-4733af58f79c\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:09:38 crc kubenswrapper[5120]: I0316 17:09:38.566216 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ade246ff-09d5-4b25-a738-4733af58f79c-scripts\") pod \"cinder-api-0\" (UID: \"ade246ff-09d5-4b25-a738-4733af58f79c\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:09:38 crc kubenswrapper[5120]: I0316 17:09:38.566295 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ade246ff-09d5-4b25-a738-4733af58f79c-config-data\") pod \"cinder-api-0\" (UID: \"ade246ff-09d5-4b25-a738-4733af58f79c\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:09:38 crc kubenswrapper[5120]: I0316 17:09:38.566416 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/ade246ff-09d5-4b25-a738-4733af58f79c-etc-machine-id\") pod \"cinder-api-0\" (UID: \"ade246ff-09d5-4b25-a738-4733af58f79c\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:09:38 crc kubenswrapper[5120]: I0316 17:09:38.566439 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpbc5\" (UniqueName: \"kubernetes.io/projected/ade246ff-09d5-4b25-a738-4733af58f79c-kube-api-access-wpbc5\") pod \"cinder-api-0\" (UID: \"ade246ff-09d5-4b25-a738-4733af58f79c\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:09:38 crc kubenswrapper[5120]: I0316 17:09:38.566868 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ade246ff-09d5-4b25-a738-4733af58f79c-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"ade246ff-09d5-4b25-a738-4733af58f79c\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:09:38 crc kubenswrapper[5120]: I0316 17:09:38.566942 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/ade246ff-09d5-4b25-a738-4733af58f79c-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"ade246ff-09d5-4b25-a738-4733af58f79c\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:09:38 crc kubenswrapper[5120]: I0316 17:09:38.670913 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/ade246ff-09d5-4b25-a738-4733af58f79c-etc-machine-id\") pod \"cinder-api-0\" (UID: \"ade246ff-09d5-4b25-a738-4733af58f79c\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:09:38 crc kubenswrapper[5120]: I0316 17:09:38.670970 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wpbc5\" (UniqueName: \"kubernetes.io/projected/ade246ff-09d5-4b25-a738-4733af58f79c-kube-api-access-wpbc5\") pod \"cinder-api-0\" (UID: \"ade246ff-09d5-4b25-a738-4733af58f79c\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:09:38 crc kubenswrapper[5120]: I0316 17:09:38.671023 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/ade246ff-09d5-4b25-a738-4733af58f79c-etc-machine-id\") pod \"cinder-api-0\" (UID: \"ade246ff-09d5-4b25-a738-4733af58f79c\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:09:38 crc kubenswrapper[5120]: I0316 17:09:38.671333 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ade246ff-09d5-4b25-a738-4733af58f79c-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"ade246ff-09d5-4b25-a738-4733af58f79c\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:09:38 crc kubenswrapper[5120]: I0316 17:09:38.671434 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/ade246ff-09d5-4b25-a738-4733af58f79c-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"ade246ff-09d5-4b25-a738-4733af58f79c\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:09:38 crc kubenswrapper[5120]: I0316 17:09:38.671541 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ade246ff-09d5-4b25-a738-4733af58f79c-logs\") pod \"cinder-api-0\" (UID: \"ade246ff-09d5-4b25-a738-4733af58f79c\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:09:38 crc kubenswrapper[5120]: I0316 17:09:38.671589 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/ade246ff-09d5-4b25-a738-4733af58f79c-config-data-custom\") pod \"cinder-api-0\" (UID: \"ade246ff-09d5-4b25-a738-4733af58f79c\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:09:38 crc kubenswrapper[5120]: I0316 17:09:38.671718 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ade246ff-09d5-4b25-a738-4733af58f79c-public-tls-certs\") pod \"cinder-api-0\" (UID: \"ade246ff-09d5-4b25-a738-4733af58f79c\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:09:38 crc kubenswrapper[5120]: I0316 17:09:38.672118 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ade246ff-09d5-4b25-a738-4733af58f79c-scripts\") pod \"cinder-api-0\" (UID: \"ade246ff-09d5-4b25-a738-4733af58f79c\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:09:38 crc kubenswrapper[5120]: I0316 17:09:38.672200 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ade246ff-09d5-4b25-a738-4733af58f79c-config-data\") pod \"cinder-api-0\" (UID: \"ade246ff-09d5-4b25-a738-4733af58f79c\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:09:38 crc kubenswrapper[5120]: I0316 17:09:38.672411 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ade246ff-09d5-4b25-a738-4733af58f79c-logs\") pod \"cinder-api-0\" (UID: \"ade246ff-09d5-4b25-a738-4733af58f79c\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:09:38 crc kubenswrapper[5120]: I0316 17:09:38.675597 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-cinder-internal-svc\"" Mar 16 17:09:38 crc kubenswrapper[5120]: I0316 17:09:38.675721 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-cinder-public-svc\"" Mar 16 17:09:38 crc kubenswrapper[5120]: I0316 17:09:38.676068 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-api-config-data\"" Mar 16 17:09:38 crc kubenswrapper[5120]: I0316 17:09:38.678114 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ade246ff-09d5-4b25-a738-4733af58f79c-config-data\") pod \"cinder-api-0\" (UID: \"ade246ff-09d5-4b25-a738-4733af58f79c\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:09:38 crc kubenswrapper[5120]: I0316 17:09:38.686082 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ade246ff-09d5-4b25-a738-4733af58f79c-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"ade246ff-09d5-4b25-a738-4733af58f79c\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:09:38 crc kubenswrapper[5120]: I0316 17:09:38.686452 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ade246ff-09d5-4b25-a738-4733af58f79c-public-tls-certs\") pod \"cinder-api-0\" (UID: \"ade246ff-09d5-4b25-a738-4733af58f79c\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:09:38 crc kubenswrapper[5120]: I0316 17:09:38.687618 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/ade246ff-09d5-4b25-a738-4733af58f79c-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"ade246ff-09d5-4b25-a738-4733af58f79c\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:09:38 crc kubenswrapper[5120]: I0316 17:09:38.688012 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/ade246ff-09d5-4b25-a738-4733af58f79c-config-data-custom\") pod \"cinder-api-0\" (UID: \"ade246ff-09d5-4b25-a738-4733af58f79c\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:09:38 crc kubenswrapper[5120]: I0316 17:09:38.690513 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee" path="/var/lib/kubelet/pods/f9a24ab4-ab9d-4bd4-b0b6-b0b8b66fd6ee/volumes" Mar 16 17:09:38 crc kubenswrapper[5120]: I0316 17:09:38.694973 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ade246ff-09d5-4b25-a738-4733af58f79c-scripts\") pod \"cinder-api-0\" (UID: \"ade246ff-09d5-4b25-a738-4733af58f79c\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:09:38 crc kubenswrapper[5120]: I0316 17:09:38.695892 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpbc5\" (UniqueName: \"kubernetes.io/projected/ade246ff-09d5-4b25-a738-4733af58f79c-kube-api-access-wpbc5\") pod \"cinder-api-0\" (UID: \"ade246ff-09d5-4b25-a738-4733af58f79c\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:09:38 crc kubenswrapper[5120]: I0316 17:09:38.820359 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:09:39 crc kubenswrapper[5120]: I0316 17:09:39.285012 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 17:09:39 crc kubenswrapper[5120]: W0316 17:09:39.293374 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podade246ff_09d5_4b25_a738_4733af58f79c.slice/crio-e334665c3aa87de45934a400cec8ebae7adf361e8c8ef6f9e375f052d0075e32 WatchSource:0}: Error finding container e334665c3aa87de45934a400cec8ebae7adf361e8c8ef6f9e375f052d0075e32: Status 404 returned error can't find the container with id e334665c3aa87de45934a400cec8ebae7adf361e8c8ef6f9e375f052d0075e32 Mar 16 17:09:39 crc kubenswrapper[5120]: I0316 17:09:39.416450 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"ade246ff-09d5-4b25-a738-4733af58f79c","Type":"ContainerStarted","Data":"e334665c3aa87de45934a400cec8ebae7adf361e8c8ef6f9e375f052d0075e32"} Mar 16 17:09:39 crc kubenswrapper[5120]: I0316 17:09:39.664145 5120 scope.go:117] "RemoveContainer" containerID="fdf922633e503ea36030a917a5229c04457ede652c006e23427353cdcb2f036a" Mar 16 17:09:39 crc kubenswrapper[5120]: I0316 17:09:39.664998 5120 scope.go:117] "RemoveContainer" containerID="db39d192fa687a13805537d08ad22fed1ef362ef5027c920a616297dc55a8ea9" Mar 16 17:09:39 crc kubenswrapper[5120]: E0316 17:09:39.665251 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 17:09:40 crc kubenswrapper[5120]: I0316 17:09:40.433138 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"ade246ff-09d5-4b25-a738-4733af58f79c","Type":"ContainerStarted","Data":"96191c9db8064f44d43499a27c2cf2ce04c6f59b84b263360523220cece5bbe2"} Mar 16 17:09:40 crc kubenswrapper[5120]: I0316 17:09:40.435909 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"32194c8a-90a1-4132-9b75-3882418d7f7d","Type":"ContainerStarted","Data":"9d97456af25763c438e0acd373c3bbf792a78ef48369d22d14aa11c723f2637b"} Mar 16 17:09:41 crc kubenswrapper[5120]: I0316 17:09:41.092892 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-78cd6f6d9d-zhxpn"] Mar 16 17:09:41 crc kubenswrapper[5120]: I0316 17:09:41.093194 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-78cd6f6d9d-zhxpn" podUID="dcd050a7-3f66-4fb5-a7a3-5736ee13ce15" containerName="placement-log" containerID="cri-o://8f88cb89a2baa2b245138ca6c55450c5b9754733563643cb3deddaeab7699367" gracePeriod=30 Mar 16 17:09:41 crc kubenswrapper[5120]: I0316 17:09:41.093343 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-78cd6f6d9d-zhxpn" podUID="dcd050a7-3f66-4fb5-a7a3-5736ee13ce15" containerName="placement-api" containerID="cri-o://99b99b53dc0cd79216b383a2ab315dc8b8df88444a4b329a892f7a8f2d6e16dd" gracePeriod=30 Mar 16 17:09:41 crc kubenswrapper[5120]: I0316 17:09:41.106236 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/placement-78cd6f6d9d-zhxpn" podUID="dcd050a7-3f66-4fb5-a7a3-5736ee13ce15" containerName="placement-api" probeResult="failure" output="Get \"https://10.217.0.72:8778/\": EOF" Mar 16 17:09:41 crc kubenswrapper[5120]: I0316 17:09:41.114181 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/placement-78cd6f6d9d-zhxpn" podUID="dcd050a7-3f66-4fb5-a7a3-5736ee13ce15" containerName="placement-log" probeResult="failure" output="Get \"https://10.217.0.72:8778/\": EOF" Mar 16 17:09:41 crc kubenswrapper[5120]: I0316 17:09:41.178810 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-858ffc7d86-rq6st"] Mar 16 17:09:41 crc kubenswrapper[5120]: I0316 17:09:41.189178 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-858ffc7d86-rq6st" Mar 16 17:09:41 crc kubenswrapper[5120]: I0316 17:09:41.193174 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-858ffc7d86-rq6st"] Mar 16 17:09:41 crc kubenswrapper[5120]: I0316 17:09:41.261539 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hv4d\" (UniqueName: \"kubernetes.io/projected/830abb7b-cab5-4a21-9e39-6dc0c0faf74e-kube-api-access-8hv4d\") pod \"placement-858ffc7d86-rq6st\" (UID: \"830abb7b-cab5-4a21-9e39-6dc0c0faf74e\") " pod="openstack-kuttl-tests/placement-858ffc7d86-rq6st" Mar 16 17:09:41 crc kubenswrapper[5120]: I0316 17:09:41.261857 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/830abb7b-cab5-4a21-9e39-6dc0c0faf74e-scripts\") pod \"placement-858ffc7d86-rq6st\" (UID: \"830abb7b-cab5-4a21-9e39-6dc0c0faf74e\") " pod="openstack-kuttl-tests/placement-858ffc7d86-rq6st" Mar 16 17:09:41 crc kubenswrapper[5120]: I0316 17:09:41.261914 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/830abb7b-cab5-4a21-9e39-6dc0c0faf74e-config-data\") pod \"placement-858ffc7d86-rq6st\" (UID: \"830abb7b-cab5-4a21-9e39-6dc0c0faf74e\") " pod="openstack-kuttl-tests/placement-858ffc7d86-rq6st" Mar 16 17:09:41 crc kubenswrapper[5120]: I0316 17:09:41.262494 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/830abb7b-cab5-4a21-9e39-6dc0c0faf74e-internal-tls-certs\") pod \"placement-858ffc7d86-rq6st\" (UID: \"830abb7b-cab5-4a21-9e39-6dc0c0faf74e\") " pod="openstack-kuttl-tests/placement-858ffc7d86-rq6st" Mar 16 17:09:41 crc kubenswrapper[5120]: I0316 17:09:41.262664 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/830abb7b-cab5-4a21-9e39-6dc0c0faf74e-combined-ca-bundle\") pod \"placement-858ffc7d86-rq6st\" (UID: \"830abb7b-cab5-4a21-9e39-6dc0c0faf74e\") " pod="openstack-kuttl-tests/placement-858ffc7d86-rq6st" Mar 16 17:09:41 crc kubenswrapper[5120]: I0316 17:09:41.262829 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/830abb7b-cab5-4a21-9e39-6dc0c0faf74e-logs\") pod \"placement-858ffc7d86-rq6st\" (UID: \"830abb7b-cab5-4a21-9e39-6dc0c0faf74e\") " pod="openstack-kuttl-tests/placement-858ffc7d86-rq6st" Mar 16 17:09:41 crc kubenswrapper[5120]: I0316 17:09:41.262931 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/830abb7b-cab5-4a21-9e39-6dc0c0faf74e-public-tls-certs\") pod \"placement-858ffc7d86-rq6st\" (UID: \"830abb7b-cab5-4a21-9e39-6dc0c0faf74e\") " pod="openstack-kuttl-tests/placement-858ffc7d86-rq6st" Mar 16 17:09:41 crc kubenswrapper[5120]: I0316 17:09:41.365671 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/830abb7b-cab5-4a21-9e39-6dc0c0faf74e-internal-tls-certs\") pod \"placement-858ffc7d86-rq6st\" (UID: \"830abb7b-cab5-4a21-9e39-6dc0c0faf74e\") " pod="openstack-kuttl-tests/placement-858ffc7d86-rq6st" Mar 16 17:09:41 crc kubenswrapper[5120]: I0316 17:09:41.365812 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/830abb7b-cab5-4a21-9e39-6dc0c0faf74e-combined-ca-bundle\") pod \"placement-858ffc7d86-rq6st\" (UID: \"830abb7b-cab5-4a21-9e39-6dc0c0faf74e\") " pod="openstack-kuttl-tests/placement-858ffc7d86-rq6st" Mar 16 17:09:41 crc kubenswrapper[5120]: I0316 17:09:41.365880 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/830abb7b-cab5-4a21-9e39-6dc0c0faf74e-logs\") pod \"placement-858ffc7d86-rq6st\" (UID: \"830abb7b-cab5-4a21-9e39-6dc0c0faf74e\") " pod="openstack-kuttl-tests/placement-858ffc7d86-rq6st" Mar 16 17:09:41 crc kubenswrapper[5120]: I0316 17:09:41.365950 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/830abb7b-cab5-4a21-9e39-6dc0c0faf74e-public-tls-certs\") pod \"placement-858ffc7d86-rq6st\" (UID: \"830abb7b-cab5-4a21-9e39-6dc0c0faf74e\") " pod="openstack-kuttl-tests/placement-858ffc7d86-rq6st" Mar 16 17:09:41 crc kubenswrapper[5120]: I0316 17:09:41.366136 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8hv4d\" (UniqueName: \"kubernetes.io/projected/830abb7b-cab5-4a21-9e39-6dc0c0faf74e-kube-api-access-8hv4d\") pod \"placement-858ffc7d86-rq6st\" (UID: \"830abb7b-cab5-4a21-9e39-6dc0c0faf74e\") " pod="openstack-kuttl-tests/placement-858ffc7d86-rq6st" Mar 16 17:09:41 crc kubenswrapper[5120]: I0316 17:09:41.366266 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/830abb7b-cab5-4a21-9e39-6dc0c0faf74e-scripts\") pod \"placement-858ffc7d86-rq6st\" (UID: \"830abb7b-cab5-4a21-9e39-6dc0c0faf74e\") " pod="openstack-kuttl-tests/placement-858ffc7d86-rq6st" Mar 16 17:09:41 crc kubenswrapper[5120]: I0316 17:09:41.366401 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/830abb7b-cab5-4a21-9e39-6dc0c0faf74e-logs\") pod \"placement-858ffc7d86-rq6st\" (UID: \"830abb7b-cab5-4a21-9e39-6dc0c0faf74e\") " pod="openstack-kuttl-tests/placement-858ffc7d86-rq6st" Mar 16 17:09:41 crc kubenswrapper[5120]: I0316 17:09:41.366473 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/830abb7b-cab5-4a21-9e39-6dc0c0faf74e-config-data\") pod \"placement-858ffc7d86-rq6st\" (UID: \"830abb7b-cab5-4a21-9e39-6dc0c0faf74e\") " pod="openstack-kuttl-tests/placement-858ffc7d86-rq6st" Mar 16 17:09:41 crc kubenswrapper[5120]: I0316 17:09:41.372033 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/830abb7b-cab5-4a21-9e39-6dc0c0faf74e-scripts\") pod \"placement-858ffc7d86-rq6st\" (UID: \"830abb7b-cab5-4a21-9e39-6dc0c0faf74e\") " pod="openstack-kuttl-tests/placement-858ffc7d86-rq6st" Mar 16 17:09:41 crc kubenswrapper[5120]: I0316 17:09:41.372455 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/830abb7b-cab5-4a21-9e39-6dc0c0faf74e-combined-ca-bundle\") pod \"placement-858ffc7d86-rq6st\" (UID: \"830abb7b-cab5-4a21-9e39-6dc0c0faf74e\") " pod="openstack-kuttl-tests/placement-858ffc7d86-rq6st" Mar 16 17:09:41 crc kubenswrapper[5120]: I0316 17:09:41.382674 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/830abb7b-cab5-4a21-9e39-6dc0c0faf74e-internal-tls-certs\") pod \"placement-858ffc7d86-rq6st\" (UID: \"830abb7b-cab5-4a21-9e39-6dc0c0faf74e\") " pod="openstack-kuttl-tests/placement-858ffc7d86-rq6st" Mar 16 17:09:41 crc kubenswrapper[5120]: I0316 17:09:41.391721 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/830abb7b-cab5-4a21-9e39-6dc0c0faf74e-config-data\") pod \"placement-858ffc7d86-rq6st\" (UID: \"830abb7b-cab5-4a21-9e39-6dc0c0faf74e\") " pod="openstack-kuttl-tests/placement-858ffc7d86-rq6st" Mar 16 17:09:41 crc kubenswrapper[5120]: I0316 17:09:41.393154 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/830abb7b-cab5-4a21-9e39-6dc0c0faf74e-public-tls-certs\") pod \"placement-858ffc7d86-rq6st\" (UID: \"830abb7b-cab5-4a21-9e39-6dc0c0faf74e\") " pod="openstack-kuttl-tests/placement-858ffc7d86-rq6st" Mar 16 17:09:41 crc kubenswrapper[5120]: I0316 17:09:41.396457 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hv4d\" (UniqueName: \"kubernetes.io/projected/830abb7b-cab5-4a21-9e39-6dc0c0faf74e-kube-api-access-8hv4d\") pod \"placement-858ffc7d86-rq6st\" (UID: \"830abb7b-cab5-4a21-9e39-6dc0c0faf74e\") " pod="openstack-kuttl-tests/placement-858ffc7d86-rq6st" Mar 16 17:09:41 crc kubenswrapper[5120]: I0316 17:09:41.457492 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"ade246ff-09d5-4b25-a738-4733af58f79c","Type":"ContainerStarted","Data":"74d99f4f7a3510db7bc9722100fd6e76b0483932aaa3a9d40fa5e81daf7d5b05"} Mar 16 17:09:41 crc kubenswrapper[5120]: I0316 17:09:41.458862 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:09:41 crc kubenswrapper[5120]: I0316 17:09:41.465396 5120 generic.go:358] "Generic (PLEG): container finished" podID="dcd050a7-3f66-4fb5-a7a3-5736ee13ce15" containerID="8f88cb89a2baa2b245138ca6c55450c5b9754733563643cb3deddaeab7699367" exitCode=143 Mar 16 17:09:41 crc kubenswrapper[5120]: I0316 17:09:41.465860 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-78cd6f6d9d-zhxpn" event={"ID":"dcd050a7-3f66-4fb5-a7a3-5736ee13ce15","Type":"ContainerDied","Data":"8f88cb89a2baa2b245138ca6c55450c5b9754733563643cb3deddaeab7699367"} Mar 16 17:09:41 crc kubenswrapper[5120]: I0316 17:09:41.520258 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-api-0" podStartSLOduration=3.5202340100000002 podStartE2EDuration="3.52023401s" podCreationTimestamp="2026-03-16 17:09:38 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:09:41.504363655 +0000 UTC m=+5883.658295322" watchObservedRunningTime="2026-03-16 17:09:41.52023401 +0000 UTC m=+5883.674165667" Mar 16 17:09:41 crc kubenswrapper[5120]: I0316 17:09:41.557453 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-858ffc7d86-rq6st" Mar 16 17:09:41 crc kubenswrapper[5120]: I0316 17:09:41.791607 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 17:09:41 crc kubenswrapper[5120]: I0316 17:09:41.792151 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="f39a0edc-bfc5-400a-ad5e-4c83f2065778" containerName="nova-metadata-log" containerID="cri-o://133a443bb923fc3f1efaf1d03003bc3a31940bc61076471810e08ec74c9bda24" gracePeriod=30 Mar 16 17:09:41 crc kubenswrapper[5120]: I0316 17:09:41.792751 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="f39a0edc-bfc5-400a-ad5e-4c83f2065778" containerName="nova-metadata-metadata" containerID="cri-o://70e5e2e54e67dd6e8b0b2a8d83ca632ba63c3a8a7def0c8c691e052b4afaa549" gracePeriod=30 Mar 16 17:09:42 crc kubenswrapper[5120]: I0316 17:09:42.124181 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-858ffc7d86-rq6st"] Mar 16 17:09:42 crc kubenswrapper[5120]: W0316 17:09:42.132184 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod830abb7b_cab5_4a21_9e39_6dc0c0faf74e.slice/crio-396d4263d7820972b4fbf94b313e9ccb80095bf60f5ff95b6bf4434933efd468 WatchSource:0}: Error finding container 396d4263d7820972b4fbf94b313e9ccb80095bf60f5ff95b6bf4434933efd468: Status 404 returned error can't find the container with id 396d4263d7820972b4fbf94b313e9ccb80095bf60f5ff95b6bf4434933efd468 Mar 16 17:09:42 crc kubenswrapper[5120]: I0316 17:09:42.493259 5120 generic.go:358] "Generic (PLEG): container finished" podID="f39a0edc-bfc5-400a-ad5e-4c83f2065778" containerID="133a443bb923fc3f1efaf1d03003bc3a31940bc61076471810e08ec74c9bda24" exitCode=143 Mar 16 17:09:42 crc kubenswrapper[5120]: I0316 17:09:42.493340 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"f39a0edc-bfc5-400a-ad5e-4c83f2065778","Type":"ContainerDied","Data":"133a443bb923fc3f1efaf1d03003bc3a31940bc61076471810e08ec74c9bda24"} Mar 16 17:09:42 crc kubenswrapper[5120]: I0316 17:09:42.497821 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-858ffc7d86-rq6st" event={"ID":"830abb7b-cab5-4a21-9e39-6dc0c0faf74e","Type":"ContainerStarted","Data":"346032f4d53ffd7e68156cf989237694dfdf9ec882a190b66580455212327093"} Mar 16 17:09:42 crc kubenswrapper[5120]: I0316 17:09:42.497856 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-858ffc7d86-rq6st" event={"ID":"830abb7b-cab5-4a21-9e39-6dc0c0faf74e","Type":"ContainerStarted","Data":"396d4263d7820972b4fbf94b313e9ccb80095bf60f5ff95b6bf4434933efd468"} Mar 16 17:09:42 crc kubenswrapper[5120]: I0316 17:09:42.546651 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:09:43 crc kubenswrapper[5120]: I0316 17:09:43.371998 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:09:43 crc kubenswrapper[5120]: I0316 17:09:43.372393 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:09:43 crc kubenswrapper[5120]: I0316 17:09:43.405164 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:09:43 crc kubenswrapper[5120]: I0316 17:09:43.422539 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:09:43 crc kubenswrapper[5120]: I0316 17:09:43.508942 5120 generic.go:358] "Generic (PLEG): container finished" podID="32194c8a-90a1-4132-9b75-3882418d7f7d" containerID="9d97456af25763c438e0acd373c3bbf792a78ef48369d22d14aa11c723f2637b" exitCode=1 Mar 16 17:09:43 crc kubenswrapper[5120]: I0316 17:09:43.509057 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"32194c8a-90a1-4132-9b75-3882418d7f7d","Type":"ContainerDied","Data":"9d97456af25763c438e0acd373c3bbf792a78ef48369d22d14aa11c723f2637b"} Mar 16 17:09:43 crc kubenswrapper[5120]: I0316 17:09:43.509129 5120 scope.go:117] "RemoveContainer" containerID="fdf922633e503ea36030a917a5229c04457ede652c006e23427353cdcb2f036a" Mar 16 17:09:43 crc kubenswrapper[5120]: I0316 17:09:43.509827 5120 scope.go:117] "RemoveContainer" containerID="9d97456af25763c438e0acd373c3bbf792a78ef48369d22d14aa11c723f2637b" Mar 16 17:09:43 crc kubenswrapper[5120]: E0316 17:09:43.510181 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nova-scheduler-scheduler\" with CrashLoopBackOff: \"back-off 20s restarting failed container=nova-scheduler-scheduler pod=nova-scheduler-0_openstack-kuttl-tests(32194c8a-90a1-4132-9b75-3882418d7f7d)\"" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="32194c8a-90a1-4132-9b75-3882418d7f7d" Mar 16 17:09:43 crc kubenswrapper[5120]: I0316 17:09:43.513987 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-858ffc7d86-rq6st" event={"ID":"830abb7b-cab5-4a21-9e39-6dc0c0faf74e","Type":"ContainerStarted","Data":"e01f3b903f2c40334db918671a2fd1e8b27432bd701053aace924d854491e7b0"} Mar 16 17:09:43 crc kubenswrapper[5120]: I0316 17:09:43.514113 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-858ffc7d86-rq6st" Mar 16 17:09:43 crc kubenswrapper[5120]: I0316 17:09:43.514453 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-858ffc7d86-rq6st" Mar 16 17:09:43 crc kubenswrapper[5120]: I0316 17:09:43.514483 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:09:43 crc kubenswrapper[5120]: I0316 17:09:43.514495 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:09:43 crc kubenswrapper[5120]: I0316 17:09:43.574073 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-858ffc7d86-rq6st" podStartSLOduration=2.57405393 podStartE2EDuration="2.57405393s" podCreationTimestamp="2026-03-16 17:09:41 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:09:43.571234463 +0000 UTC m=+5885.725166120" watchObservedRunningTime="2026-03-16 17:09:43.57405393 +0000 UTC m=+5885.727985587" Mar 16 17:09:43 crc kubenswrapper[5120]: I0316 17:09:43.675734 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:09:43 crc kubenswrapper[5120]: I0316 17:09:43.675799 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:09:43 crc kubenswrapper[5120]: I0316 17:09:43.710824 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:09:43 crc kubenswrapper[5120]: I0316 17:09:43.721856 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:09:44 crc kubenswrapper[5120]: I0316 17:09:44.032971 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:09:44 crc kubenswrapper[5120]: I0316 17:09:44.033048 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:09:44 crc kubenswrapper[5120]: I0316 17:09:44.535976 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:09:44 crc kubenswrapper[5120]: I0316 17:09:44.536305 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:09:44 crc kubenswrapper[5120]: I0316 17:09:44.665176 5120 scope.go:117] "RemoveContainer" containerID="6bd43d7d0d719d65c0531d4b2965651bfa9edc74190a29efd2b813f4082f049c" Mar 16 17:09:44 crc kubenswrapper[5120]: I0316 17:09:44.885594 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-65b47b9b44-khswm"] Mar 16 17:09:44 crc kubenswrapper[5120]: I0316 17:09:44.886405 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-65b47b9b44-khswm" podUID="eed6d812-3092-456e-8466-c6f875c06a54" containerName="barbican-api-log" containerID="cri-o://7311de92d62120cf0d27fb178a82d0c2fe9381838c224044fb33e9be38516dd9" gracePeriod=30 Mar 16 17:09:44 crc kubenswrapper[5120]: I0316 17:09:44.886915 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-65b47b9b44-khswm" podUID="eed6d812-3092-456e-8466-c6f875c06a54" containerName="barbican-api" containerID="cri-o://74a87c3218b23e78bc7c968b0b2554c589b5b54ac4bba62c1eb24132231545d5" gracePeriod=30 Mar 16 17:09:44 crc kubenswrapper[5120]: I0316 17:09:44.895545 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-65b47b9b44-khswm" podUID="eed6d812-3092-456e-8466-c6f875c06a54" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.0.102:9311/healthcheck\": EOF" Mar 16 17:09:44 crc kubenswrapper[5120]: I0316 17:09:44.895515 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-65b47b9b44-khswm" podUID="eed6d812-3092-456e-8466-c6f875c06a54" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.0.102:9311/healthcheck\": EOF" Mar 16 17:09:44 crc kubenswrapper[5120]: I0316 17:09:44.939994 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-api-7dd9fb87c6-wk9p7"] Mar 16 17:09:44 crc kubenswrapper[5120]: I0316 17:09:44.955744 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-7dd9fb87c6-wk9p7" Mar 16 17:09:44 crc kubenswrapper[5120]: I0316 17:09:44.959257 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-7dd9fb87c6-wk9p7"] Mar 16 17:09:45 crc kubenswrapper[5120]: I0316 17:09:45.039909 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="d4da2790-525e-44f0-bddd-c5edbb04ae32" containerName="nova-api-api" probeResult="failure" output="Get \"https://10.217.0.101:8774/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Mar 16 17:09:45 crc kubenswrapper[5120]: I0316 17:09:45.041867 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="d4da2790-525e-44f0-bddd-c5edbb04ae32" containerName="nova-api-log" probeResult="failure" output="Get \"https://10.217.0.101:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 17:09:45 crc kubenswrapper[5120]: I0316 17:09:45.091101 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/cb59b894-da6e-4bd0-85c3-2330d90f2fb9-internal-tls-certs\") pod \"barbican-api-7dd9fb87c6-wk9p7\" (UID: \"cb59b894-da6e-4bd0-85c3-2330d90f2fb9\") " pod="openstack-kuttl-tests/barbican-api-7dd9fb87c6-wk9p7" Mar 16 17:09:45 crc kubenswrapper[5120]: I0316 17:09:45.091162 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/cb59b894-da6e-4bd0-85c3-2330d90f2fb9-logs\") pod \"barbican-api-7dd9fb87c6-wk9p7\" (UID: \"cb59b894-da6e-4bd0-85c3-2330d90f2fb9\") " pod="openstack-kuttl-tests/barbican-api-7dd9fb87c6-wk9p7" Mar 16 17:09:45 crc kubenswrapper[5120]: I0316 17:09:45.091225 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/cb59b894-da6e-4bd0-85c3-2330d90f2fb9-public-tls-certs\") pod \"barbican-api-7dd9fb87c6-wk9p7\" (UID: \"cb59b894-da6e-4bd0-85c3-2330d90f2fb9\") " pod="openstack-kuttl-tests/barbican-api-7dd9fb87c6-wk9p7" Mar 16 17:09:45 crc kubenswrapper[5120]: I0316 17:09:45.091378 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cb59b894-da6e-4bd0-85c3-2330d90f2fb9-combined-ca-bundle\") pod \"barbican-api-7dd9fb87c6-wk9p7\" (UID: \"cb59b894-da6e-4bd0-85c3-2330d90f2fb9\") " pod="openstack-kuttl-tests/barbican-api-7dd9fb87c6-wk9p7" Mar 16 17:09:45 crc kubenswrapper[5120]: I0316 17:09:45.091476 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gm85\" (UniqueName: \"kubernetes.io/projected/cb59b894-da6e-4bd0-85c3-2330d90f2fb9-kube-api-access-4gm85\") pod \"barbican-api-7dd9fb87c6-wk9p7\" (UID: \"cb59b894-da6e-4bd0-85c3-2330d90f2fb9\") " pod="openstack-kuttl-tests/barbican-api-7dd9fb87c6-wk9p7" Mar 16 17:09:45 crc kubenswrapper[5120]: I0316 17:09:45.091560 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cb59b894-da6e-4bd0-85c3-2330d90f2fb9-config-data\") pod \"barbican-api-7dd9fb87c6-wk9p7\" (UID: \"cb59b894-da6e-4bd0-85c3-2330d90f2fb9\") " pod="openstack-kuttl-tests/barbican-api-7dd9fb87c6-wk9p7" Mar 16 17:09:45 crc kubenswrapper[5120]: I0316 17:09:45.091650 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/cb59b894-da6e-4bd0-85c3-2330d90f2fb9-config-data-custom\") pod \"barbican-api-7dd9fb87c6-wk9p7\" (UID: \"cb59b894-da6e-4bd0-85c3-2330d90f2fb9\") " pod="openstack-kuttl-tests/barbican-api-7dd9fb87c6-wk9p7" Mar 16 17:09:45 crc kubenswrapper[5120]: I0316 17:09:45.194032 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/cb59b894-da6e-4bd0-85c3-2330d90f2fb9-config-data-custom\") pod \"barbican-api-7dd9fb87c6-wk9p7\" (UID: \"cb59b894-da6e-4bd0-85c3-2330d90f2fb9\") " pod="openstack-kuttl-tests/barbican-api-7dd9fb87c6-wk9p7" Mar 16 17:09:45 crc kubenswrapper[5120]: I0316 17:09:45.194150 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/cb59b894-da6e-4bd0-85c3-2330d90f2fb9-internal-tls-certs\") pod \"barbican-api-7dd9fb87c6-wk9p7\" (UID: \"cb59b894-da6e-4bd0-85c3-2330d90f2fb9\") " pod="openstack-kuttl-tests/barbican-api-7dd9fb87c6-wk9p7" Mar 16 17:09:45 crc kubenswrapper[5120]: I0316 17:09:45.194176 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/cb59b894-da6e-4bd0-85c3-2330d90f2fb9-logs\") pod \"barbican-api-7dd9fb87c6-wk9p7\" (UID: \"cb59b894-da6e-4bd0-85c3-2330d90f2fb9\") " pod="openstack-kuttl-tests/barbican-api-7dd9fb87c6-wk9p7" Mar 16 17:09:45 crc kubenswrapper[5120]: I0316 17:09:45.194240 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/cb59b894-da6e-4bd0-85c3-2330d90f2fb9-public-tls-certs\") pod \"barbican-api-7dd9fb87c6-wk9p7\" (UID: \"cb59b894-da6e-4bd0-85c3-2330d90f2fb9\") " pod="openstack-kuttl-tests/barbican-api-7dd9fb87c6-wk9p7" Mar 16 17:09:45 crc kubenswrapper[5120]: I0316 17:09:45.194394 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cb59b894-da6e-4bd0-85c3-2330d90f2fb9-combined-ca-bundle\") pod \"barbican-api-7dd9fb87c6-wk9p7\" (UID: \"cb59b894-da6e-4bd0-85c3-2330d90f2fb9\") " pod="openstack-kuttl-tests/barbican-api-7dd9fb87c6-wk9p7" Mar 16 17:09:45 crc kubenswrapper[5120]: I0316 17:09:45.194494 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4gm85\" (UniqueName: \"kubernetes.io/projected/cb59b894-da6e-4bd0-85c3-2330d90f2fb9-kube-api-access-4gm85\") pod \"barbican-api-7dd9fb87c6-wk9p7\" (UID: \"cb59b894-da6e-4bd0-85c3-2330d90f2fb9\") " pod="openstack-kuttl-tests/barbican-api-7dd9fb87c6-wk9p7" Mar 16 17:09:45 crc kubenswrapper[5120]: I0316 17:09:45.194580 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cb59b894-da6e-4bd0-85c3-2330d90f2fb9-config-data\") pod \"barbican-api-7dd9fb87c6-wk9p7\" (UID: \"cb59b894-da6e-4bd0-85c3-2330d90f2fb9\") " pod="openstack-kuttl-tests/barbican-api-7dd9fb87c6-wk9p7" Mar 16 17:09:45 crc kubenswrapper[5120]: I0316 17:09:45.196195 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/cb59b894-da6e-4bd0-85c3-2330d90f2fb9-logs\") pod \"barbican-api-7dd9fb87c6-wk9p7\" (UID: \"cb59b894-da6e-4bd0-85c3-2330d90f2fb9\") " pod="openstack-kuttl-tests/barbican-api-7dd9fb87c6-wk9p7" Mar 16 17:09:45 crc kubenswrapper[5120]: I0316 17:09:45.203049 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cb59b894-da6e-4bd0-85c3-2330d90f2fb9-config-data\") pod \"barbican-api-7dd9fb87c6-wk9p7\" (UID: \"cb59b894-da6e-4bd0-85c3-2330d90f2fb9\") " pod="openstack-kuttl-tests/barbican-api-7dd9fb87c6-wk9p7" Mar 16 17:09:45 crc kubenswrapper[5120]: I0316 17:09:45.203594 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cb59b894-da6e-4bd0-85c3-2330d90f2fb9-combined-ca-bundle\") pod \"barbican-api-7dd9fb87c6-wk9p7\" (UID: \"cb59b894-da6e-4bd0-85c3-2330d90f2fb9\") " pod="openstack-kuttl-tests/barbican-api-7dd9fb87c6-wk9p7" Mar 16 17:09:45 crc kubenswrapper[5120]: I0316 17:09:45.210315 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/cb59b894-da6e-4bd0-85c3-2330d90f2fb9-public-tls-certs\") pod \"barbican-api-7dd9fb87c6-wk9p7\" (UID: \"cb59b894-da6e-4bd0-85c3-2330d90f2fb9\") " pod="openstack-kuttl-tests/barbican-api-7dd9fb87c6-wk9p7" Mar 16 17:09:45 crc kubenswrapper[5120]: I0316 17:09:45.210900 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/cb59b894-da6e-4bd0-85c3-2330d90f2fb9-config-data-custom\") pod \"barbican-api-7dd9fb87c6-wk9p7\" (UID: \"cb59b894-da6e-4bd0-85c3-2330d90f2fb9\") " pod="openstack-kuttl-tests/barbican-api-7dd9fb87c6-wk9p7" Mar 16 17:09:45 crc kubenswrapper[5120]: I0316 17:09:45.215440 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/cb59b894-da6e-4bd0-85c3-2330d90f2fb9-internal-tls-certs\") pod \"barbican-api-7dd9fb87c6-wk9p7\" (UID: \"cb59b894-da6e-4bd0-85c3-2330d90f2fb9\") " pod="openstack-kuttl-tests/barbican-api-7dd9fb87c6-wk9p7" Mar 16 17:09:45 crc kubenswrapper[5120]: I0316 17:09:45.223450 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gm85\" (UniqueName: \"kubernetes.io/projected/cb59b894-da6e-4bd0-85c3-2330d90f2fb9-kube-api-access-4gm85\") pod \"barbican-api-7dd9fb87c6-wk9p7\" (UID: \"cb59b894-da6e-4bd0-85c3-2330d90f2fb9\") " pod="openstack-kuttl-tests/barbican-api-7dd9fb87c6-wk9p7" Mar 16 17:09:45 crc kubenswrapper[5120]: I0316 17:09:45.274260 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-7dd9fb87c6-wk9p7" Mar 16 17:09:45 crc kubenswrapper[5120]: I0316 17:09:45.541056 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:09:45 crc kubenswrapper[5120]: I0316 17:09:45.574381 5120 generic.go:358] "Generic (PLEG): container finished" podID="eed6d812-3092-456e-8466-c6f875c06a54" containerID="7311de92d62120cf0d27fb178a82d0c2fe9381838c224044fb33e9be38516dd9" exitCode=143 Mar 16 17:09:45 crc kubenswrapper[5120]: I0316 17:09:45.574906 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-65b47b9b44-khswm" event={"ID":"eed6d812-3092-456e-8466-c6f875c06a54","Type":"ContainerDied","Data":"7311de92d62120cf0d27fb178a82d0c2fe9381838c224044fb33e9be38516dd9"} Mar 16 17:09:45 crc kubenswrapper[5120]: I0316 17:09:45.585872 5120 generic.go:358] "Generic (PLEG): container finished" podID="f39a0edc-bfc5-400a-ad5e-4c83f2065778" containerID="70e5e2e54e67dd6e8b0b2a8d83ca632ba63c3a8a7def0c8c691e052b4afaa549" exitCode=0 Mar 16 17:09:45 crc kubenswrapper[5120]: I0316 17:09:45.586482 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:09:45 crc kubenswrapper[5120]: I0316 17:09:45.587553 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"f39a0edc-bfc5-400a-ad5e-4c83f2065778","Type":"ContainerDied","Data":"70e5e2e54e67dd6e8b0b2a8d83ca632ba63c3a8a7def0c8c691e052b4afaa549"} Mar 16 17:09:45 crc kubenswrapper[5120]: I0316 17:09:45.587626 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"f39a0edc-bfc5-400a-ad5e-4c83f2065778","Type":"ContainerDied","Data":"cab6884efb8354c2caa071f67dd82ea67cfafad9173c180803035eec23da1c36"} Mar 16 17:09:45 crc kubenswrapper[5120]: I0316 17:09:45.587650 5120 scope.go:117] "RemoveContainer" containerID="70e5e2e54e67dd6e8b0b2a8d83ca632ba63c3a8a7def0c8c691e052b4afaa549" Mar 16 17:09:45 crc kubenswrapper[5120]: I0316 17:09:45.604318 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"d0852906-6351-45a9-a44c-0bf3f4c29496","Type":"ContainerStarted","Data":"c53e6084cd4784b416aa0905c6c812a19a8f42a1d13ab48bd906b62501da4219"} Mar 16 17:09:45 crc kubenswrapper[5120]: I0316 17:09:45.604632 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 17:09:45 crc kubenswrapper[5120]: I0316 17:09:45.703039 5120 scope.go:117] "RemoveContainer" containerID="133a443bb923fc3f1efaf1d03003bc3a31940bc61076471810e08ec74c9bda24" Mar 16 17:09:45 crc kubenswrapper[5120]: I0316 17:09:45.710035 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-48r92\" (UniqueName: \"kubernetes.io/projected/f39a0edc-bfc5-400a-ad5e-4c83f2065778-kube-api-access-48r92\") pod \"f39a0edc-bfc5-400a-ad5e-4c83f2065778\" (UID: \"f39a0edc-bfc5-400a-ad5e-4c83f2065778\") " Mar 16 17:09:45 crc kubenswrapper[5120]: I0316 17:09:45.710468 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/f39a0edc-bfc5-400a-ad5e-4c83f2065778-nova-metadata-tls-certs\") pod \"f39a0edc-bfc5-400a-ad5e-4c83f2065778\" (UID: \"f39a0edc-bfc5-400a-ad5e-4c83f2065778\") " Mar 16 17:09:45 crc kubenswrapper[5120]: I0316 17:09:45.710652 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f39a0edc-bfc5-400a-ad5e-4c83f2065778-logs\") pod \"f39a0edc-bfc5-400a-ad5e-4c83f2065778\" (UID: \"f39a0edc-bfc5-400a-ad5e-4c83f2065778\") " Mar 16 17:09:45 crc kubenswrapper[5120]: I0316 17:09:45.711143 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f39a0edc-bfc5-400a-ad5e-4c83f2065778-combined-ca-bundle\") pod \"f39a0edc-bfc5-400a-ad5e-4c83f2065778\" (UID: \"f39a0edc-bfc5-400a-ad5e-4c83f2065778\") " Mar 16 17:09:45 crc kubenswrapper[5120]: I0316 17:09:45.711191 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f39a0edc-bfc5-400a-ad5e-4c83f2065778-config-data\") pod \"f39a0edc-bfc5-400a-ad5e-4c83f2065778\" (UID: \"f39a0edc-bfc5-400a-ad5e-4c83f2065778\") " Mar 16 17:09:45 crc kubenswrapper[5120]: I0316 17:09:45.713877 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f39a0edc-bfc5-400a-ad5e-4c83f2065778-logs" (OuterVolumeSpecName: "logs") pod "f39a0edc-bfc5-400a-ad5e-4c83f2065778" (UID: "f39a0edc-bfc5-400a-ad5e-4c83f2065778"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:09:45 crc kubenswrapper[5120]: I0316 17:09:45.726181 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f39a0edc-bfc5-400a-ad5e-4c83f2065778-kube-api-access-48r92" (OuterVolumeSpecName: "kube-api-access-48r92") pod "f39a0edc-bfc5-400a-ad5e-4c83f2065778" (UID: "f39a0edc-bfc5-400a-ad5e-4c83f2065778"). InnerVolumeSpecName "kube-api-access-48r92". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:09:45 crc kubenswrapper[5120]: I0316 17:09:45.726423 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:09:45 crc kubenswrapper[5120]: I0316 17:09:45.726531 5120 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Mar 16 17:09:45 crc kubenswrapper[5120]: I0316 17:09:45.747958 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f39a0edc-bfc5-400a-ad5e-4c83f2065778-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f39a0edc-bfc5-400a-ad5e-4c83f2065778" (UID: "f39a0edc-bfc5-400a-ad5e-4c83f2065778"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:09:45 crc kubenswrapper[5120]: I0316 17:09:45.804699 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f39a0edc-bfc5-400a-ad5e-4c83f2065778-nova-metadata-tls-certs" (OuterVolumeSpecName: "nova-metadata-tls-certs") pod "f39a0edc-bfc5-400a-ad5e-4c83f2065778" (UID: "f39a0edc-bfc5-400a-ad5e-4c83f2065778"). InnerVolumeSpecName "nova-metadata-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:09:45 crc kubenswrapper[5120]: I0316 17:09:45.807192 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f39a0edc-bfc5-400a-ad5e-4c83f2065778-config-data" (OuterVolumeSpecName: "config-data") pod "f39a0edc-bfc5-400a-ad5e-4c83f2065778" (UID: "f39a0edc-bfc5-400a-ad5e-4c83f2065778"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:09:45 crc kubenswrapper[5120]: I0316 17:09:45.814638 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f39a0edc-bfc5-400a-ad5e-4c83f2065778-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:45 crc kubenswrapper[5120]: I0316 17:09:45.814676 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f39a0edc-bfc5-400a-ad5e-4c83f2065778-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:45 crc kubenswrapper[5120]: I0316 17:09:45.814687 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-48r92\" (UniqueName: \"kubernetes.io/projected/f39a0edc-bfc5-400a-ad5e-4c83f2065778-kube-api-access-48r92\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:45 crc kubenswrapper[5120]: I0316 17:09:45.814696 5120 reconciler_common.go:299] "Volume detached for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/f39a0edc-bfc5-400a-ad5e-4c83f2065778-nova-metadata-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:45 crc kubenswrapper[5120]: I0316 17:09:45.814706 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f39a0edc-bfc5-400a-ad5e-4c83f2065778-logs\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:45 crc kubenswrapper[5120]: I0316 17:09:45.898628 5120 scope.go:117] "RemoveContainer" containerID="70e5e2e54e67dd6e8b0b2a8d83ca632ba63c3a8a7def0c8c691e052b4afaa549" Mar 16 17:09:45 crc kubenswrapper[5120]: E0316 17:09:45.899353 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"70e5e2e54e67dd6e8b0b2a8d83ca632ba63c3a8a7def0c8c691e052b4afaa549\": container with ID starting with 70e5e2e54e67dd6e8b0b2a8d83ca632ba63c3a8a7def0c8c691e052b4afaa549 not found: ID does not exist" containerID="70e5e2e54e67dd6e8b0b2a8d83ca632ba63c3a8a7def0c8c691e052b4afaa549" Mar 16 17:09:45 crc kubenswrapper[5120]: I0316 17:09:45.899383 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70e5e2e54e67dd6e8b0b2a8d83ca632ba63c3a8a7def0c8c691e052b4afaa549"} err="failed to get container status \"70e5e2e54e67dd6e8b0b2a8d83ca632ba63c3a8a7def0c8c691e052b4afaa549\": rpc error: code = NotFound desc = could not find container \"70e5e2e54e67dd6e8b0b2a8d83ca632ba63c3a8a7def0c8c691e052b4afaa549\": container with ID starting with 70e5e2e54e67dd6e8b0b2a8d83ca632ba63c3a8a7def0c8c691e052b4afaa549 not found: ID does not exist" Mar 16 17:09:45 crc kubenswrapper[5120]: I0316 17:09:45.899405 5120 scope.go:117] "RemoveContainer" containerID="133a443bb923fc3f1efaf1d03003bc3a31940bc61076471810e08ec74c9bda24" Mar 16 17:09:45 crc kubenswrapper[5120]: E0316 17:09:45.899601 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"133a443bb923fc3f1efaf1d03003bc3a31940bc61076471810e08ec74c9bda24\": container with ID starting with 133a443bb923fc3f1efaf1d03003bc3a31940bc61076471810e08ec74c9bda24 not found: ID does not exist" containerID="133a443bb923fc3f1efaf1d03003bc3a31940bc61076471810e08ec74c9bda24" Mar 16 17:09:45 crc kubenswrapper[5120]: I0316 17:09:45.899622 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"133a443bb923fc3f1efaf1d03003bc3a31940bc61076471810e08ec74c9bda24"} err="failed to get container status \"133a443bb923fc3f1efaf1d03003bc3a31940bc61076471810e08ec74c9bda24\": rpc error: code = NotFound desc = could not find container \"133a443bb923fc3f1efaf1d03003bc3a31940bc61076471810e08ec74c9bda24\": container with ID starting with 133a443bb923fc3f1efaf1d03003bc3a31940bc61076471810e08ec74c9bda24 not found: ID does not exist" Mar 16 17:09:45 crc kubenswrapper[5120]: I0316 17:09:45.937975 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 17:09:45 crc kubenswrapper[5120]: I0316 17:09:45.953513 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 17:09:45 crc kubenswrapper[5120]: I0316 17:09:45.970278 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 17:09:45 crc kubenswrapper[5120]: I0316 17:09:45.973499 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f39a0edc-bfc5-400a-ad5e-4c83f2065778" containerName="nova-metadata-metadata" Mar 16 17:09:45 crc kubenswrapper[5120]: I0316 17:09:45.973550 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f39a0edc-bfc5-400a-ad5e-4c83f2065778" containerName="nova-metadata-metadata" Mar 16 17:09:45 crc kubenswrapper[5120]: I0316 17:09:45.973608 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f39a0edc-bfc5-400a-ad5e-4c83f2065778" containerName="nova-metadata-log" Mar 16 17:09:45 crc kubenswrapper[5120]: I0316 17:09:45.973619 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f39a0edc-bfc5-400a-ad5e-4c83f2065778" containerName="nova-metadata-log" Mar 16 17:09:45 crc kubenswrapper[5120]: I0316 17:09:45.973886 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f39a0edc-bfc5-400a-ad5e-4c83f2065778" containerName="nova-metadata-metadata" Mar 16 17:09:45 crc kubenswrapper[5120]: I0316 17:09:45.973910 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f39a0edc-bfc5-400a-ad5e-4c83f2065778" containerName="nova-metadata-log" Mar 16 17:09:45 crc kubenswrapper[5120]: I0316 17:09:45.986020 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 17:09:45 crc kubenswrapper[5120]: I0316 17:09:45.986152 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:09:45 crc kubenswrapper[5120]: I0316 17:09:45.991317 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-metadata-config-data\"" Mar 16 17:09:45 crc kubenswrapper[5120]: I0316 17:09:45.997624 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-metadata-internal-svc\"" Mar 16 17:09:46 crc kubenswrapper[5120]: I0316 17:09:46.002029 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-7dd9fb87c6-wk9p7"] Mar 16 17:09:46 crc kubenswrapper[5120]: I0316 17:09:46.123778 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgkq4\" (UniqueName: \"kubernetes.io/projected/f659fd59-18da-47e7-b57a-27e7d95a428e-kube-api-access-zgkq4\") pod \"nova-metadata-0\" (UID: \"f659fd59-18da-47e7-b57a-27e7d95a428e\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:09:46 crc kubenswrapper[5120]: I0316 17:09:46.123973 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f659fd59-18da-47e7-b57a-27e7d95a428e-config-data\") pod \"nova-metadata-0\" (UID: \"f659fd59-18da-47e7-b57a-27e7d95a428e\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:09:46 crc kubenswrapper[5120]: I0316 17:09:46.124107 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f659fd59-18da-47e7-b57a-27e7d95a428e-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"f659fd59-18da-47e7-b57a-27e7d95a428e\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:09:46 crc kubenswrapper[5120]: I0316 17:09:46.124266 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f659fd59-18da-47e7-b57a-27e7d95a428e-logs\") pod \"nova-metadata-0\" (UID: \"f659fd59-18da-47e7-b57a-27e7d95a428e\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:09:46 crc kubenswrapper[5120]: I0316 17:09:46.124513 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/f659fd59-18da-47e7-b57a-27e7d95a428e-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"f659fd59-18da-47e7-b57a-27e7d95a428e\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:09:46 crc kubenswrapper[5120]: I0316 17:09:46.170778 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:09:46 crc kubenswrapper[5120]: I0316 17:09:46.227554 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/f659fd59-18da-47e7-b57a-27e7d95a428e-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"f659fd59-18da-47e7-b57a-27e7d95a428e\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:09:46 crc kubenswrapper[5120]: I0316 17:09:46.227875 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zgkq4\" (UniqueName: \"kubernetes.io/projected/f659fd59-18da-47e7-b57a-27e7d95a428e-kube-api-access-zgkq4\") pod \"nova-metadata-0\" (UID: \"f659fd59-18da-47e7-b57a-27e7d95a428e\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:09:46 crc kubenswrapper[5120]: I0316 17:09:46.227982 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f659fd59-18da-47e7-b57a-27e7d95a428e-config-data\") pod \"nova-metadata-0\" (UID: \"f659fd59-18da-47e7-b57a-27e7d95a428e\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:09:46 crc kubenswrapper[5120]: I0316 17:09:46.228031 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f659fd59-18da-47e7-b57a-27e7d95a428e-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"f659fd59-18da-47e7-b57a-27e7d95a428e\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:09:46 crc kubenswrapper[5120]: I0316 17:09:46.228123 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f659fd59-18da-47e7-b57a-27e7d95a428e-logs\") pod \"nova-metadata-0\" (UID: \"f659fd59-18da-47e7-b57a-27e7d95a428e\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:09:46 crc kubenswrapper[5120]: I0316 17:09:46.228919 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f659fd59-18da-47e7-b57a-27e7d95a428e-logs\") pod \"nova-metadata-0\" (UID: \"f659fd59-18da-47e7-b57a-27e7d95a428e\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:09:46 crc kubenswrapper[5120]: I0316 17:09:46.238425 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/f659fd59-18da-47e7-b57a-27e7d95a428e-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"f659fd59-18da-47e7-b57a-27e7d95a428e\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:09:46 crc kubenswrapper[5120]: I0316 17:09:46.238497 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f659fd59-18da-47e7-b57a-27e7d95a428e-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"f659fd59-18da-47e7-b57a-27e7d95a428e\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:09:46 crc kubenswrapper[5120]: I0316 17:09:46.239371 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f659fd59-18da-47e7-b57a-27e7d95a428e-config-data\") pod \"nova-metadata-0\" (UID: \"f659fd59-18da-47e7-b57a-27e7d95a428e\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:09:46 crc kubenswrapper[5120]: I0316 17:09:46.248579 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgkq4\" (UniqueName: \"kubernetes.io/projected/f659fd59-18da-47e7-b57a-27e7d95a428e-kube-api-access-zgkq4\") pod \"nova-metadata-0\" (UID: \"f659fd59-18da-47e7-b57a-27e7d95a428e\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:09:46 crc kubenswrapper[5120]: I0316 17:09:46.361533 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:09:46 crc kubenswrapper[5120]: I0316 17:09:46.658686 5120 generic.go:358] "Generic (PLEG): container finished" podID="dcd050a7-3f66-4fb5-a7a3-5736ee13ce15" containerID="99b99b53dc0cd79216b383a2ab315dc8b8df88444a4b329a892f7a8f2d6e16dd" exitCode=0 Mar 16 17:09:46 crc kubenswrapper[5120]: I0316 17:09:46.659390 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-78cd6f6d9d-zhxpn" event={"ID":"dcd050a7-3f66-4fb5-a7a3-5736ee13ce15","Type":"ContainerDied","Data":"99b99b53dc0cd79216b383a2ab315dc8b8df88444a4b329a892f7a8f2d6e16dd"} Mar 16 17:09:46 crc kubenswrapper[5120]: I0316 17:09:46.678278 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f39a0edc-bfc5-400a-ad5e-4c83f2065778" path="/var/lib/kubelet/pods/f39a0edc-bfc5-400a-ad5e-4c83f2065778/volumes" Mar 16 17:09:46 crc kubenswrapper[5120]: I0316 17:09:46.690187 5120 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Mar 16 17:09:46 crc kubenswrapper[5120]: I0316 17:09:46.690213 5120 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Mar 16 17:09:46 crc kubenswrapper[5120]: I0316 17:09:46.691330 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-7dd9fb87c6-wk9p7" event={"ID":"cb59b894-da6e-4bd0-85c3-2330d90f2fb9","Type":"ContainerStarted","Data":"8bcc4d1eccd2cd8a10222f683f4348aa58be8aacd639247e66f7eb971210636b"} Mar 16 17:09:46 crc kubenswrapper[5120]: I0316 17:09:46.691418 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-7dd9fb87c6-wk9p7" event={"ID":"cb59b894-da6e-4bd0-85c3-2330d90f2fb9","Type":"ContainerStarted","Data":"e138fcb882caf1555726740300d536104bc205f3d2b52e58fcea1b748cb9ef6d"} Mar 16 17:09:46 crc kubenswrapper[5120]: I0316 17:09:46.714907 5120 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:09:46 crc kubenswrapper[5120]: I0316 17:09:46.715196 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:09:46 crc kubenswrapper[5120]: I0316 17:09:46.715272 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:09:46 crc kubenswrapper[5120]: I0316 17:09:46.715547 5120 scope.go:117] "RemoveContainer" containerID="9d97456af25763c438e0acd373c3bbf792a78ef48369d22d14aa11c723f2637b" Mar 16 17:09:46 crc kubenswrapper[5120]: E0316 17:09:46.715963 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nova-scheduler-scheduler\" with CrashLoopBackOff: \"back-off 20s restarting failed container=nova-scheduler-scheduler pod=nova-scheduler-0_openstack-kuttl-tests(32194c8a-90a1-4132-9b75-3882418d7f7d)\"" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="32194c8a-90a1-4132-9b75-3882418d7f7d" Mar 16 17:09:46 crc kubenswrapper[5120]: I0316 17:09:46.936658 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 17:09:47 crc kubenswrapper[5120]: I0316 17:09:47.090795 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-78cd6f6d9d-zhxpn" Mar 16 17:09:47 crc kubenswrapper[5120]: I0316 17:09:47.162509 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dcd050a7-3f66-4fb5-a7a3-5736ee13ce15-config-data\") pod \"dcd050a7-3f66-4fb5-a7a3-5736ee13ce15\" (UID: \"dcd050a7-3f66-4fb5-a7a3-5736ee13ce15\") " Mar 16 17:09:47 crc kubenswrapper[5120]: I0316 17:09:47.162575 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/dcd050a7-3f66-4fb5-a7a3-5736ee13ce15-public-tls-certs\") pod \"dcd050a7-3f66-4fb5-a7a3-5736ee13ce15\" (UID: \"dcd050a7-3f66-4fb5-a7a3-5736ee13ce15\") " Mar 16 17:09:47 crc kubenswrapper[5120]: I0316 17:09:47.162712 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xvmk4\" (UniqueName: \"kubernetes.io/projected/dcd050a7-3f66-4fb5-a7a3-5736ee13ce15-kube-api-access-xvmk4\") pod \"dcd050a7-3f66-4fb5-a7a3-5736ee13ce15\" (UID: \"dcd050a7-3f66-4fb5-a7a3-5736ee13ce15\") " Mar 16 17:09:47 crc kubenswrapper[5120]: I0316 17:09:47.162739 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/dcd050a7-3f66-4fb5-a7a3-5736ee13ce15-scripts\") pod \"dcd050a7-3f66-4fb5-a7a3-5736ee13ce15\" (UID: \"dcd050a7-3f66-4fb5-a7a3-5736ee13ce15\") " Mar 16 17:09:47 crc kubenswrapper[5120]: I0316 17:09:47.162883 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/dcd050a7-3f66-4fb5-a7a3-5736ee13ce15-logs\") pod \"dcd050a7-3f66-4fb5-a7a3-5736ee13ce15\" (UID: \"dcd050a7-3f66-4fb5-a7a3-5736ee13ce15\") " Mar 16 17:09:47 crc kubenswrapper[5120]: I0316 17:09:47.163080 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/dcd050a7-3f66-4fb5-a7a3-5736ee13ce15-internal-tls-certs\") pod \"dcd050a7-3f66-4fb5-a7a3-5736ee13ce15\" (UID: \"dcd050a7-3f66-4fb5-a7a3-5736ee13ce15\") " Mar 16 17:09:47 crc kubenswrapper[5120]: I0316 17:09:47.163109 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dcd050a7-3f66-4fb5-a7a3-5736ee13ce15-combined-ca-bundle\") pod \"dcd050a7-3f66-4fb5-a7a3-5736ee13ce15\" (UID: \"dcd050a7-3f66-4fb5-a7a3-5736ee13ce15\") " Mar 16 17:09:47 crc kubenswrapper[5120]: I0316 17:09:47.169373 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dcd050a7-3f66-4fb5-a7a3-5736ee13ce15-logs" (OuterVolumeSpecName: "logs") pod "dcd050a7-3f66-4fb5-a7a3-5736ee13ce15" (UID: "dcd050a7-3f66-4fb5-a7a3-5736ee13ce15"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:09:47 crc kubenswrapper[5120]: I0316 17:09:47.173353 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dcd050a7-3f66-4fb5-a7a3-5736ee13ce15-kube-api-access-xvmk4" (OuterVolumeSpecName: "kube-api-access-xvmk4") pod "dcd050a7-3f66-4fb5-a7a3-5736ee13ce15" (UID: "dcd050a7-3f66-4fb5-a7a3-5736ee13ce15"). InnerVolumeSpecName "kube-api-access-xvmk4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:09:47 crc kubenswrapper[5120]: I0316 17:09:47.182925 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dcd050a7-3f66-4fb5-a7a3-5736ee13ce15-scripts" (OuterVolumeSpecName: "scripts") pod "dcd050a7-3f66-4fb5-a7a3-5736ee13ce15" (UID: "dcd050a7-3f66-4fb5-a7a3-5736ee13ce15"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:09:47 crc kubenswrapper[5120]: I0316 17:09:47.278656 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xvmk4\" (UniqueName: \"kubernetes.io/projected/dcd050a7-3f66-4fb5-a7a3-5736ee13ce15-kube-api-access-xvmk4\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:47 crc kubenswrapper[5120]: I0316 17:09:47.278697 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/dcd050a7-3f66-4fb5-a7a3-5736ee13ce15-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:47 crc kubenswrapper[5120]: I0316 17:09:47.278707 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/dcd050a7-3f66-4fb5-a7a3-5736ee13ce15-logs\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:47 crc kubenswrapper[5120]: I0316 17:09:47.342384 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:09:47 crc kubenswrapper[5120]: I0316 17:09:47.446620 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dcd050a7-3f66-4fb5-a7a3-5736ee13ce15-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "dcd050a7-3f66-4fb5-a7a3-5736ee13ce15" (UID: "dcd050a7-3f66-4fb5-a7a3-5736ee13ce15"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:09:47 crc kubenswrapper[5120]: I0316 17:09:47.471309 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dcd050a7-3f66-4fb5-a7a3-5736ee13ce15-config-data" (OuterVolumeSpecName: "config-data") pod "dcd050a7-3f66-4fb5-a7a3-5736ee13ce15" (UID: "dcd050a7-3f66-4fb5-a7a3-5736ee13ce15"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:09:47 crc kubenswrapper[5120]: I0316 17:09:47.481924 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dcd050a7-3f66-4fb5-a7a3-5736ee13ce15-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "dcd050a7-3f66-4fb5-a7a3-5736ee13ce15" (UID: "dcd050a7-3f66-4fb5-a7a3-5736ee13ce15"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:09:47 crc kubenswrapper[5120]: I0316 17:09:47.491060 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dcd050a7-3f66-4fb5-a7a3-5736ee13ce15-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:47 crc kubenswrapper[5120]: I0316 17:09:47.491086 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/dcd050a7-3f66-4fb5-a7a3-5736ee13ce15-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:47 crc kubenswrapper[5120]: I0316 17:09:47.491098 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dcd050a7-3f66-4fb5-a7a3-5736ee13ce15-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:47 crc kubenswrapper[5120]: I0316 17:09:47.540240 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dcd050a7-3f66-4fb5-a7a3-5736ee13ce15-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "dcd050a7-3f66-4fb5-a7a3-5736ee13ce15" (UID: "dcd050a7-3f66-4fb5-a7a3-5736ee13ce15"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:09:47 crc kubenswrapper[5120]: I0316 17:09:47.555405 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:09:47 crc kubenswrapper[5120]: I0316 17:09:47.557934 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:09:47 crc kubenswrapper[5120]: I0316 17:09:47.598559 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/dcd050a7-3f66-4fb5-a7a3-5736ee13ce15-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:47 crc kubenswrapper[5120]: I0316 17:09:47.665743 5120 scope.go:117] "RemoveContainer" containerID="c95c639838ab0891241eeaedc65582a42fe56eb64e08e9942cc764c9beef0e20" Mar 16 17:09:47 crc kubenswrapper[5120]: E0316 17:09:47.666291 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nova-cell0-conductor-conductor\" with CrashLoopBackOff: \"back-off 40s restarting failed container=nova-cell0-conductor-conductor pod=nova-cell0-conductor-0_openstack-kuttl-tests(9a997459-37ba-46a9-9cb8-075f77fa009f)\"" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="9a997459-37ba-46a9-9cb8-075f77fa009f" Mar 16 17:09:47 crc kubenswrapper[5120]: I0316 17:09:47.724336 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-7dd9fb87c6-wk9p7" event={"ID":"cb59b894-da6e-4bd0-85c3-2330d90f2fb9","Type":"ContainerStarted","Data":"53704c7e7cb120a20abf7c23819ce05c411f207be9084dca48931c0a0f060df8"} Mar 16 17:09:47 crc kubenswrapper[5120]: I0316 17:09:47.724622 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-7dd9fb87c6-wk9p7" Mar 16 17:09:47 crc kubenswrapper[5120]: I0316 17:09:47.724718 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-7dd9fb87c6-wk9p7" Mar 16 17:09:47 crc kubenswrapper[5120]: I0316 17:09:47.730017 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"f659fd59-18da-47e7-b57a-27e7d95a428e","Type":"ContainerStarted","Data":"0b4187a33cd16e54176afbc1797048bc385a980bce807ea18a2f5bf975e838fa"} Mar 16 17:09:47 crc kubenswrapper[5120]: I0316 17:09:47.730061 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"f659fd59-18da-47e7-b57a-27e7d95a428e","Type":"ContainerStarted","Data":"0c146248ce5cbb6bb7f46de0476f492c6f08d7a03995c61381ee84ff5d9f071c"} Mar 16 17:09:47 crc kubenswrapper[5120]: I0316 17:09:47.743013 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-78cd6f6d9d-zhxpn" Mar 16 17:09:47 crc kubenswrapper[5120]: I0316 17:09:47.746429 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-78cd6f6d9d-zhxpn" event={"ID":"dcd050a7-3f66-4fb5-a7a3-5736ee13ce15","Type":"ContainerDied","Data":"67f6d06d883a60793980f22c7ba5a370605d4d4e567e60bc13e6ca0b2759e912"} Mar 16 17:09:47 crc kubenswrapper[5120]: I0316 17:09:47.746499 5120 scope.go:117] "RemoveContainer" containerID="99b99b53dc0cd79216b383a2ab315dc8b8df88444a4b329a892f7a8f2d6e16dd" Mar 16 17:09:47 crc kubenswrapper[5120]: I0316 17:09:47.747172 5120 scope.go:117] "RemoveContainer" containerID="9d97456af25763c438e0acd373c3bbf792a78ef48369d22d14aa11c723f2637b" Mar 16 17:09:47 crc kubenswrapper[5120]: E0316 17:09:47.747507 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nova-scheduler-scheduler\" with CrashLoopBackOff: \"back-off 20s restarting failed container=nova-scheduler-scheduler pod=nova-scheduler-0_openstack-kuttl-tests(32194c8a-90a1-4132-9b75-3882418d7f7d)\"" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="32194c8a-90a1-4132-9b75-3882418d7f7d" Mar 16 17:09:47 crc kubenswrapper[5120]: I0316 17:09:47.752865 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-api-7dd9fb87c6-wk9p7" podStartSLOduration=3.752843728 podStartE2EDuration="3.752843728s" podCreationTimestamp="2026-03-16 17:09:44 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:09:47.741517928 +0000 UTC m=+5889.895449595" watchObservedRunningTime="2026-03-16 17:09:47.752843728 +0000 UTC m=+5889.906775385" Mar 16 17:09:47 crc kubenswrapper[5120]: I0316 17:09:47.850522 5120 scope.go:117] "RemoveContainer" containerID="8f88cb89a2baa2b245138ca6c55450c5b9754733563643cb3deddaeab7699367" Mar 16 17:09:47 crc kubenswrapper[5120]: I0316 17:09:47.851321 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-78cd6f6d9d-zhxpn"] Mar 16 17:09:47 crc kubenswrapper[5120]: I0316 17:09:47.864389 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-78cd6f6d9d-zhxpn"] Mar 16 17:09:48 crc kubenswrapper[5120]: I0316 17:09:48.684035 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dcd050a7-3f66-4fb5-a7a3-5736ee13ce15" path="/var/lib/kubelet/pods/dcd050a7-3f66-4fb5-a7a3-5736ee13ce15/volumes" Mar 16 17:09:48 crc kubenswrapper[5120]: I0316 17:09:48.757268 5120 generic.go:358] "Generic (PLEG): container finished" podID="d0852906-6351-45a9-a44c-0bf3f4c29496" containerID="c53e6084cd4784b416aa0905c6c812a19a8f42a1d13ab48bd906b62501da4219" exitCode=1 Mar 16 17:09:48 crc kubenswrapper[5120]: I0316 17:09:48.757349 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"d0852906-6351-45a9-a44c-0bf3f4c29496","Type":"ContainerDied","Data":"c53e6084cd4784b416aa0905c6c812a19a8f42a1d13ab48bd906b62501da4219"} Mar 16 17:09:48 crc kubenswrapper[5120]: I0316 17:09:48.757455 5120 scope.go:117] "RemoveContainer" containerID="6bd43d7d0d719d65c0531d4b2965651bfa9edc74190a29efd2b813f4082f049c" Mar 16 17:09:48 crc kubenswrapper[5120]: I0316 17:09:48.758401 5120 scope.go:117] "RemoveContainer" containerID="c53e6084cd4784b416aa0905c6c812a19a8f42a1d13ab48bd906b62501da4219" Mar 16 17:09:48 crc kubenswrapper[5120]: E0316 17:09:48.760809 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nova-cell1-conductor-conductor\" with CrashLoopBackOff: \"back-off 20s restarting failed container=nova-cell1-conductor-conductor pod=nova-cell1-conductor-0_openstack-kuttl-tests(d0852906-6351-45a9-a44c-0bf3f4c29496)\"" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="d0852906-6351-45a9-a44c-0bf3f4c29496" Mar 16 17:09:48 crc kubenswrapper[5120]: I0316 17:09:48.762564 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"f659fd59-18da-47e7-b57a-27e7d95a428e","Type":"ContainerStarted","Data":"f0db20b2e6e0d68c181b06468ccd7637201488f5e2245e4f484f3e76b9ffe122"} Mar 16 17:09:48 crc kubenswrapper[5120]: I0316 17:09:48.806133 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=3.806111594 podStartE2EDuration="3.806111594s" podCreationTimestamp="2026-03-16 17:09:45 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:09:48.802017432 +0000 UTC m=+5890.955949089" watchObservedRunningTime="2026-03-16 17:09:48.806111594 +0000 UTC m=+5890.960043251" Mar 16 17:09:49 crc kubenswrapper[5120]: I0316 17:09:49.418786 5120 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 17:09:49 crc kubenswrapper[5120]: I0316 17:09:49.777650 5120 scope.go:117] "RemoveContainer" containerID="c53e6084cd4784b416aa0905c6c812a19a8f42a1d13ab48bd906b62501da4219" Mar 16 17:09:49 crc kubenswrapper[5120]: E0316 17:09:49.778121 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nova-cell1-conductor-conductor\" with CrashLoopBackOff: \"back-off 20s restarting failed container=nova-cell1-conductor-conductor pod=nova-cell1-conductor-0_openstack-kuttl-tests(d0852906-6351-45a9-a44c-0bf3f4c29496)\"" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="d0852906-6351-45a9-a44c-0bf3f4c29496" Mar 16 17:09:49 crc kubenswrapper[5120]: I0316 17:09:49.896647 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-65b47b9b44-khswm" podUID="eed6d812-3092-456e-8466-c6f875c06a54" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.0.102:9311/healthcheck\": context deadline exceeded" Mar 16 17:09:49 crc kubenswrapper[5120]: I0316 17:09:49.896718 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-65b47b9b44-khswm" podUID="eed6d812-3092-456e-8466-c6f875c06a54" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.0.102:9311/healthcheck\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Mar 16 17:09:50 crc kubenswrapper[5120]: I0316 17:09:50.312815 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-65b47b9b44-khswm" podUID="eed6d812-3092-456e-8466-c6f875c06a54" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.0.102:9311/healthcheck\": read tcp 10.217.0.2:54644->10.217.0.102:9311: read: connection reset by peer" Mar 16 17:09:50 crc kubenswrapper[5120]: I0316 17:09:50.312841 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-65b47b9b44-khswm" podUID="eed6d812-3092-456e-8466-c6f875c06a54" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.0.102:9311/healthcheck\": read tcp 10.217.0.2:54640->10.217.0.102:9311: read: connection reset by peer" Mar 16 17:09:50 crc kubenswrapper[5120]: I0316 17:09:50.572181 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:09:50 crc kubenswrapper[5120]: I0316 17:09:50.682265 5120 scope.go:117] "RemoveContainer" containerID="db39d192fa687a13805537d08ad22fed1ef362ef5027c920a616297dc55a8ea9" Mar 16 17:09:50 crc kubenswrapper[5120]: E0316 17:09:50.682934 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 17:09:50 crc kubenswrapper[5120]: I0316 17:09:50.773440 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-65b47b9b44-khswm" Mar 16 17:09:50 crc kubenswrapper[5120]: I0316 17:09:50.788103 5120 generic.go:358] "Generic (PLEG): container finished" podID="eed6d812-3092-456e-8466-c6f875c06a54" containerID="74a87c3218b23e78bc7c968b0b2554c589b5b54ac4bba62c1eb24132231545d5" exitCode=0 Mar 16 17:09:50 crc kubenswrapper[5120]: I0316 17:09:50.788264 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-65b47b9b44-khswm" Mar 16 17:09:50 crc kubenswrapper[5120]: I0316 17:09:50.788455 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-65b47b9b44-khswm" event={"ID":"eed6d812-3092-456e-8466-c6f875c06a54","Type":"ContainerDied","Data":"74a87c3218b23e78bc7c968b0b2554c589b5b54ac4bba62c1eb24132231545d5"} Mar 16 17:09:50 crc kubenswrapper[5120]: I0316 17:09:50.788485 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-65b47b9b44-khswm" event={"ID":"eed6d812-3092-456e-8466-c6f875c06a54","Type":"ContainerDied","Data":"cc60b918168b73985bd8091be55b9dce9591585f5b0abc17220c8f7004f0f036"} Mar 16 17:09:50 crc kubenswrapper[5120]: I0316 17:09:50.788502 5120 scope.go:117] "RemoveContainer" containerID="74a87c3218b23e78bc7c968b0b2554c589b5b54ac4bba62c1eb24132231545d5" Mar 16 17:09:50 crc kubenswrapper[5120]: I0316 17:09:50.794044 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gflfw\" (UniqueName: \"kubernetes.io/projected/eed6d812-3092-456e-8466-c6f875c06a54-kube-api-access-gflfw\") pod \"eed6d812-3092-456e-8466-c6f875c06a54\" (UID: \"eed6d812-3092-456e-8466-c6f875c06a54\") " Mar 16 17:09:50 crc kubenswrapper[5120]: I0316 17:09:50.794233 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/eed6d812-3092-456e-8466-c6f875c06a54-internal-tls-certs\") pod \"eed6d812-3092-456e-8466-c6f875c06a54\" (UID: \"eed6d812-3092-456e-8466-c6f875c06a54\") " Mar 16 17:09:50 crc kubenswrapper[5120]: I0316 17:09:50.794585 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/eed6d812-3092-456e-8466-c6f875c06a54-public-tls-certs\") pod \"eed6d812-3092-456e-8466-c6f875c06a54\" (UID: \"eed6d812-3092-456e-8466-c6f875c06a54\") " Mar 16 17:09:50 crc kubenswrapper[5120]: I0316 17:09:50.794829 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/eed6d812-3092-456e-8466-c6f875c06a54-logs\") pod \"eed6d812-3092-456e-8466-c6f875c06a54\" (UID: \"eed6d812-3092-456e-8466-c6f875c06a54\") " Mar 16 17:09:50 crc kubenswrapper[5120]: I0316 17:09:50.794971 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eed6d812-3092-456e-8466-c6f875c06a54-combined-ca-bundle\") pod \"eed6d812-3092-456e-8466-c6f875c06a54\" (UID: \"eed6d812-3092-456e-8466-c6f875c06a54\") " Mar 16 17:09:50 crc kubenswrapper[5120]: I0316 17:09:50.795048 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/eed6d812-3092-456e-8466-c6f875c06a54-config-data-custom\") pod \"eed6d812-3092-456e-8466-c6f875c06a54\" (UID: \"eed6d812-3092-456e-8466-c6f875c06a54\") " Mar 16 17:09:50 crc kubenswrapper[5120]: I0316 17:09:50.796379 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/eed6d812-3092-456e-8466-c6f875c06a54-config-data\") pod \"eed6d812-3092-456e-8466-c6f875c06a54\" (UID: \"eed6d812-3092-456e-8466-c6f875c06a54\") " Mar 16 17:09:50 crc kubenswrapper[5120]: I0316 17:09:50.799912 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eed6d812-3092-456e-8466-c6f875c06a54-logs" (OuterVolumeSpecName: "logs") pod "eed6d812-3092-456e-8466-c6f875c06a54" (UID: "eed6d812-3092-456e-8466-c6f875c06a54"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:09:50 crc kubenswrapper[5120]: I0316 17:09:50.803955 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eed6d812-3092-456e-8466-c6f875c06a54-kube-api-access-gflfw" (OuterVolumeSpecName: "kube-api-access-gflfw") pod "eed6d812-3092-456e-8466-c6f875c06a54" (UID: "eed6d812-3092-456e-8466-c6f875c06a54"). InnerVolumeSpecName "kube-api-access-gflfw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:09:50 crc kubenswrapper[5120]: I0316 17:09:50.804076 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eed6d812-3092-456e-8466-c6f875c06a54-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "eed6d812-3092-456e-8466-c6f875c06a54" (UID: "eed6d812-3092-456e-8466-c6f875c06a54"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:09:50 crc kubenswrapper[5120]: I0316 17:09:50.837731 5120 scope.go:117] "RemoveContainer" containerID="7311de92d62120cf0d27fb178a82d0c2fe9381838c224044fb33e9be38516dd9" Mar 16 17:09:50 crc kubenswrapper[5120]: I0316 17:09:50.841604 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eed6d812-3092-456e-8466-c6f875c06a54-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "eed6d812-3092-456e-8466-c6f875c06a54" (UID: "eed6d812-3092-456e-8466-c6f875c06a54"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:09:50 crc kubenswrapper[5120]: I0316 17:09:50.865463 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eed6d812-3092-456e-8466-c6f875c06a54-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "eed6d812-3092-456e-8466-c6f875c06a54" (UID: "eed6d812-3092-456e-8466-c6f875c06a54"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:09:50 crc kubenswrapper[5120]: I0316 17:09:50.892498 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eed6d812-3092-456e-8466-c6f875c06a54-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "eed6d812-3092-456e-8466-c6f875c06a54" (UID: "eed6d812-3092-456e-8466-c6f875c06a54"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:09:50 crc kubenswrapper[5120]: I0316 17:09:50.892837 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eed6d812-3092-456e-8466-c6f875c06a54-config-data" (OuterVolumeSpecName: "config-data") pod "eed6d812-3092-456e-8466-c6f875c06a54" (UID: "eed6d812-3092-456e-8466-c6f875c06a54"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:09:50 crc kubenswrapper[5120]: I0316 17:09:50.902578 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/eed6d812-3092-456e-8466-c6f875c06a54-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:50 crc kubenswrapper[5120]: I0316 17:09:50.902618 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gflfw\" (UniqueName: \"kubernetes.io/projected/eed6d812-3092-456e-8466-c6f875c06a54-kube-api-access-gflfw\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:50 crc kubenswrapper[5120]: I0316 17:09:50.902632 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/eed6d812-3092-456e-8466-c6f875c06a54-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:50 crc kubenswrapper[5120]: I0316 17:09:50.902646 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/eed6d812-3092-456e-8466-c6f875c06a54-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:50 crc kubenswrapper[5120]: I0316 17:09:50.902657 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/eed6d812-3092-456e-8466-c6f875c06a54-logs\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:50 crc kubenswrapper[5120]: I0316 17:09:50.902670 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eed6d812-3092-456e-8466-c6f875c06a54-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:50 crc kubenswrapper[5120]: I0316 17:09:50.902680 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/eed6d812-3092-456e-8466-c6f875c06a54-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:50 crc kubenswrapper[5120]: I0316 17:09:50.911844 5120 scope.go:117] "RemoveContainer" containerID="74a87c3218b23e78bc7c968b0b2554c589b5b54ac4bba62c1eb24132231545d5" Mar 16 17:09:50 crc kubenswrapper[5120]: E0316 17:09:50.912312 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"74a87c3218b23e78bc7c968b0b2554c589b5b54ac4bba62c1eb24132231545d5\": container with ID starting with 74a87c3218b23e78bc7c968b0b2554c589b5b54ac4bba62c1eb24132231545d5 not found: ID does not exist" containerID="74a87c3218b23e78bc7c968b0b2554c589b5b54ac4bba62c1eb24132231545d5" Mar 16 17:09:50 crc kubenswrapper[5120]: I0316 17:09:50.912428 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74a87c3218b23e78bc7c968b0b2554c589b5b54ac4bba62c1eb24132231545d5"} err="failed to get container status \"74a87c3218b23e78bc7c968b0b2554c589b5b54ac4bba62c1eb24132231545d5\": rpc error: code = NotFound desc = could not find container \"74a87c3218b23e78bc7c968b0b2554c589b5b54ac4bba62c1eb24132231545d5\": container with ID starting with 74a87c3218b23e78bc7c968b0b2554c589b5b54ac4bba62c1eb24132231545d5 not found: ID does not exist" Mar 16 17:09:50 crc kubenswrapper[5120]: I0316 17:09:50.912524 5120 scope.go:117] "RemoveContainer" containerID="7311de92d62120cf0d27fb178a82d0c2fe9381838c224044fb33e9be38516dd9" Mar 16 17:09:50 crc kubenswrapper[5120]: E0316 17:09:50.913176 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7311de92d62120cf0d27fb178a82d0c2fe9381838c224044fb33e9be38516dd9\": container with ID starting with 7311de92d62120cf0d27fb178a82d0c2fe9381838c224044fb33e9be38516dd9 not found: ID does not exist" containerID="7311de92d62120cf0d27fb178a82d0c2fe9381838c224044fb33e9be38516dd9" Mar 16 17:09:50 crc kubenswrapper[5120]: I0316 17:09:50.913211 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7311de92d62120cf0d27fb178a82d0c2fe9381838c224044fb33e9be38516dd9"} err="failed to get container status \"7311de92d62120cf0d27fb178a82d0c2fe9381838c224044fb33e9be38516dd9\": rpc error: code = NotFound desc = could not find container \"7311de92d62120cf0d27fb178a82d0c2fe9381838c224044fb33e9be38516dd9\": container with ID starting with 7311de92d62120cf0d27fb178a82d0c2fe9381838c224044fb33e9be38516dd9 not found: ID does not exist" Mar 16 17:09:51 crc kubenswrapper[5120]: I0316 17:09:51.135428 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-65b47b9b44-khswm"] Mar 16 17:09:51 crc kubenswrapper[5120]: I0316 17:09:51.147745 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-api-65b47b9b44-khswm"] Mar 16 17:09:52 crc kubenswrapper[5120]: I0316 17:09:52.033119 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:09:52 crc kubenswrapper[5120]: I0316 17:09:52.034404 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:09:52 crc kubenswrapper[5120]: I0316 17:09:52.675868 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eed6d812-3092-456e-8466-c6f875c06a54" path="/var/lib/kubelet/pods/eed6d812-3092-456e-8466-c6f875c06a54/volumes" Mar 16 17:09:52 crc kubenswrapper[5120]: I0316 17:09:52.904908 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:09:52 crc kubenswrapper[5120]: I0316 17:09:52.905689 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="3c2d5679-277a-4f1f-94c7-4a37df9c29d3" containerName="ceilometer-central-agent" containerID="cri-o://f59e3f589f2c744c0fec7c367ccaee441c0171f5289a91c4ed169f87e31a15dc" gracePeriod=30 Mar 16 17:09:52 crc kubenswrapper[5120]: I0316 17:09:52.906262 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="3c2d5679-277a-4f1f-94c7-4a37df9c29d3" containerName="proxy-httpd" containerID="cri-o://1a25fa7cc0a3a476b2575d9cd316feb86b6d038ff5afcf61a2e03f181eb70016" gracePeriod=30 Mar 16 17:09:52 crc kubenswrapper[5120]: I0316 17:09:52.906356 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="3c2d5679-277a-4f1f-94c7-4a37df9c29d3" containerName="ceilometer-notification-agent" containerID="cri-o://2788323bc772d158b1df47da429e9be0f6a201d43f5d06c7ab4c0b0f99e0993a" gracePeriod=30 Mar 16 17:09:52 crc kubenswrapper[5120]: I0316 17:09:52.906606 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="3c2d5679-277a-4f1f-94c7-4a37df9c29d3" containerName="sg-core" containerID="cri-o://504da395b98af450c567ae2b9409fd2ac793973f3fd8e061134a19b143ef1898" gracePeriod=30 Mar 16 17:09:53 crc kubenswrapper[5120]: I0316 17:09:53.823203 5120 generic.go:358] "Generic (PLEG): container finished" podID="3c2d5679-277a-4f1f-94c7-4a37df9c29d3" containerID="1a25fa7cc0a3a476b2575d9cd316feb86b6d038ff5afcf61a2e03f181eb70016" exitCode=0 Mar 16 17:09:53 crc kubenswrapper[5120]: I0316 17:09:53.823506 5120 generic.go:358] "Generic (PLEG): container finished" podID="3c2d5679-277a-4f1f-94c7-4a37df9c29d3" containerID="504da395b98af450c567ae2b9409fd2ac793973f3fd8e061134a19b143ef1898" exitCode=2 Mar 16 17:09:53 crc kubenswrapper[5120]: I0316 17:09:53.823518 5120 generic.go:358] "Generic (PLEG): container finished" podID="3c2d5679-277a-4f1f-94c7-4a37df9c29d3" containerID="f59e3f589f2c744c0fec7c367ccaee441c0171f5289a91c4ed169f87e31a15dc" exitCode=0 Mar 16 17:09:53 crc kubenswrapper[5120]: I0316 17:09:53.823253 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"3c2d5679-277a-4f1f-94c7-4a37df9c29d3","Type":"ContainerDied","Data":"1a25fa7cc0a3a476b2575d9cd316feb86b6d038ff5afcf61a2e03f181eb70016"} Mar 16 17:09:53 crc kubenswrapper[5120]: I0316 17:09:53.823626 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"3c2d5679-277a-4f1f-94c7-4a37df9c29d3","Type":"ContainerDied","Data":"504da395b98af450c567ae2b9409fd2ac793973f3fd8e061134a19b143ef1898"} Mar 16 17:09:53 crc kubenswrapper[5120]: I0316 17:09:53.823651 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"3c2d5679-277a-4f1f-94c7-4a37df9c29d3","Type":"ContainerDied","Data":"f59e3f589f2c744c0fec7c367ccaee441c0171f5289a91c4ed169f87e31a15dc"} Mar 16 17:09:54 crc kubenswrapper[5120]: I0316 17:09:54.043299 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:09:54 crc kubenswrapper[5120]: I0316 17:09:54.049590 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:09:54 crc kubenswrapper[5120]: I0316 17:09:54.050549 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:09:54 crc kubenswrapper[5120]: I0316 17:09:54.840179 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:09:55 crc kubenswrapper[5120]: I0316 17:09:55.184955 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-7dd9fb87c6-wk9p7" Mar 16 17:09:55 crc kubenswrapper[5120]: I0316 17:09:55.370027 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-7dd9fb87c6-wk9p7" Mar 16 17:09:55 crc kubenswrapper[5120]: I0316 17:09:55.447448 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-5866f469b4-fczj7"] Mar 16 17:09:55 crc kubenswrapper[5120]: I0316 17:09:55.447789 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-5866f469b4-fczj7" podUID="bc40587b-0877-4370-bdcc-a56479bf99e6" containerName="barbican-api-log" containerID="cri-o://de97a4d8d92d47af6b2c3179afe85e9468a8f5f8548789f8052a414b31dd9b1d" gracePeriod=30 Mar 16 17:09:55 crc kubenswrapper[5120]: I0316 17:09:55.447940 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-5866f469b4-fczj7" podUID="bc40587b-0877-4370-bdcc-a56479bf99e6" containerName="barbican-api" containerID="cri-o://7d73343d7be0ecf4e34e8548de8e689810358007288282c370dc697d0c48f215" gracePeriod=30 Mar 16 17:09:55 crc kubenswrapper[5120]: I0316 17:09:55.674965 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/keystone-75fdb7754b-cb728" Mar 16 17:09:55 crc kubenswrapper[5120]: I0316 17:09:55.746523 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-7df86b764c-bv9sm"] Mar 16 17:09:55 crc kubenswrapper[5120]: I0316 17:09:55.746892 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/keystone-7df86b764c-bv9sm" podUID="957ea161-cf8b-43d5-b464-24dc4ee777df" containerName="keystone-api" containerID="cri-o://74b7d9768e9239473cf544c5e604fd8d6d2571d55e0643f31939cb1dde6c4948" gracePeriod=30 Mar 16 17:09:55 crc kubenswrapper[5120]: I0316 17:09:55.850110 5120 generic.go:358] "Generic (PLEG): container finished" podID="bc40587b-0877-4370-bdcc-a56479bf99e6" containerID="de97a4d8d92d47af6b2c3179afe85e9468a8f5f8548789f8052a414b31dd9b1d" exitCode=143 Mar 16 17:09:55 crc kubenswrapper[5120]: I0316 17:09:55.850526 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-5866f469b4-fczj7" event={"ID":"bc40587b-0877-4370-bdcc-a56479bf99e6","Type":"ContainerDied","Data":"de97a4d8d92d47af6b2c3179afe85e9468a8f5f8548789f8052a414b31dd9b1d"} Mar 16 17:09:56 crc kubenswrapper[5120]: I0316 17:09:56.364951 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:09:56 crc kubenswrapper[5120]: I0316 17:09:56.365230 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:09:57 crc kubenswrapper[5120]: I0316 17:09:57.374987 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="f659fd59-18da-47e7-b57a-27e7d95a428e" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"https://10.217.0.106:8775/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 17:09:57 crc kubenswrapper[5120]: I0316 17:09:57.375012 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="f659fd59-18da-47e7-b57a-27e7d95a428e" containerName="nova-metadata-log" probeResult="failure" output="Get \"https://10.217.0.106:8775/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 17:09:58 crc kubenswrapper[5120]: I0316 17:09:58.481491 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:09:58 crc kubenswrapper[5120]: I0316 17:09:58.546527 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/3c2d5679-277a-4f1f-94c7-4a37df9c29d3-sg-core-conf-yaml\") pod \"3c2d5679-277a-4f1f-94c7-4a37df9c29d3\" (UID: \"3c2d5679-277a-4f1f-94c7-4a37df9c29d3\") " Mar 16 17:09:58 crc kubenswrapper[5120]: I0316 17:09:58.546989 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3c2d5679-277a-4f1f-94c7-4a37df9c29d3-config-data\") pod \"3c2d5679-277a-4f1f-94c7-4a37df9c29d3\" (UID: \"3c2d5679-277a-4f1f-94c7-4a37df9c29d3\") " Mar 16 17:09:58 crc kubenswrapper[5120]: I0316 17:09:58.547135 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3c2d5679-277a-4f1f-94c7-4a37df9c29d3-scripts\") pod \"3c2d5679-277a-4f1f-94c7-4a37df9c29d3\" (UID: \"3c2d5679-277a-4f1f-94c7-4a37df9c29d3\") " Mar 16 17:09:58 crc kubenswrapper[5120]: I0316 17:09:58.547720 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/3c2d5679-277a-4f1f-94c7-4a37df9c29d3-run-httpd\") pod \"3c2d5679-277a-4f1f-94c7-4a37df9c29d3\" (UID: \"3c2d5679-277a-4f1f-94c7-4a37df9c29d3\") " Mar 16 17:09:58 crc kubenswrapper[5120]: I0316 17:09:58.547947 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3c2d5679-277a-4f1f-94c7-4a37df9c29d3-combined-ca-bundle\") pod \"3c2d5679-277a-4f1f-94c7-4a37df9c29d3\" (UID: \"3c2d5679-277a-4f1f-94c7-4a37df9c29d3\") " Mar 16 17:09:58 crc kubenswrapper[5120]: I0316 17:09:58.548308 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ctmsr\" (UniqueName: \"kubernetes.io/projected/3c2d5679-277a-4f1f-94c7-4a37df9c29d3-kube-api-access-ctmsr\") pod \"3c2d5679-277a-4f1f-94c7-4a37df9c29d3\" (UID: \"3c2d5679-277a-4f1f-94c7-4a37df9c29d3\") " Mar 16 17:09:58 crc kubenswrapper[5120]: I0316 17:09:58.548620 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/3c2d5679-277a-4f1f-94c7-4a37df9c29d3-ceilometer-tls-certs\") pod \"3c2d5679-277a-4f1f-94c7-4a37df9c29d3\" (UID: \"3c2d5679-277a-4f1f-94c7-4a37df9c29d3\") " Mar 16 17:09:58 crc kubenswrapper[5120]: I0316 17:09:58.548740 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/3c2d5679-277a-4f1f-94c7-4a37df9c29d3-log-httpd\") pod \"3c2d5679-277a-4f1f-94c7-4a37df9c29d3\" (UID: \"3c2d5679-277a-4f1f-94c7-4a37df9c29d3\") " Mar 16 17:09:58 crc kubenswrapper[5120]: I0316 17:09:58.550926 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c2d5679-277a-4f1f-94c7-4a37df9c29d3-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "3c2d5679-277a-4f1f-94c7-4a37df9c29d3" (UID: "3c2d5679-277a-4f1f-94c7-4a37df9c29d3"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:09:58 crc kubenswrapper[5120]: I0316 17:09:58.551273 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c2d5679-277a-4f1f-94c7-4a37df9c29d3-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "3c2d5679-277a-4f1f-94c7-4a37df9c29d3" (UID: "3c2d5679-277a-4f1f-94c7-4a37df9c29d3"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:09:58 crc kubenswrapper[5120]: I0316 17:09:58.556461 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c2d5679-277a-4f1f-94c7-4a37df9c29d3-kube-api-access-ctmsr" (OuterVolumeSpecName: "kube-api-access-ctmsr") pod "3c2d5679-277a-4f1f-94c7-4a37df9c29d3" (UID: "3c2d5679-277a-4f1f-94c7-4a37df9c29d3"). InnerVolumeSpecName "kube-api-access-ctmsr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:09:58 crc kubenswrapper[5120]: I0316 17:09:58.587942 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c2d5679-277a-4f1f-94c7-4a37df9c29d3-scripts" (OuterVolumeSpecName: "scripts") pod "3c2d5679-277a-4f1f-94c7-4a37df9c29d3" (UID: "3c2d5679-277a-4f1f-94c7-4a37df9c29d3"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:09:58 crc kubenswrapper[5120]: I0316 17:09:58.608352 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c2d5679-277a-4f1f-94c7-4a37df9c29d3-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "3c2d5679-277a-4f1f-94c7-4a37df9c29d3" (UID: "3c2d5679-277a-4f1f-94c7-4a37df9c29d3"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:09:58 crc kubenswrapper[5120]: I0316 17:09:58.643860 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-5866f469b4-fczj7" podUID="bc40587b-0877-4370-bdcc-a56479bf99e6" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.0.10:9311/healthcheck\": read tcp 10.217.0.2:41918->10.217.0.10:9311: read: connection reset by peer" Mar 16 17:09:58 crc kubenswrapper[5120]: I0316 17:09:58.648535 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c2d5679-277a-4f1f-94c7-4a37df9c29d3-ceilometer-tls-certs" (OuterVolumeSpecName: "ceilometer-tls-certs") pod "3c2d5679-277a-4f1f-94c7-4a37df9c29d3" (UID: "3c2d5679-277a-4f1f-94c7-4a37df9c29d3"). InnerVolumeSpecName "ceilometer-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:09:58 crc kubenswrapper[5120]: I0316 17:09:58.652973 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ctmsr\" (UniqueName: \"kubernetes.io/projected/3c2d5679-277a-4f1f-94c7-4a37df9c29d3-kube-api-access-ctmsr\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:58 crc kubenswrapper[5120]: I0316 17:09:58.653015 5120 reconciler_common.go:299] "Volume detached for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/3c2d5679-277a-4f1f-94c7-4a37df9c29d3-ceilometer-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:58 crc kubenswrapper[5120]: I0316 17:09:58.653029 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/3c2d5679-277a-4f1f-94c7-4a37df9c29d3-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:58 crc kubenswrapper[5120]: I0316 17:09:58.653044 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/3c2d5679-277a-4f1f-94c7-4a37df9c29d3-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:58 crc kubenswrapper[5120]: I0316 17:09:58.653058 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3c2d5679-277a-4f1f-94c7-4a37df9c29d3-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:58 crc kubenswrapper[5120]: I0316 17:09:58.653069 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/3c2d5679-277a-4f1f-94c7-4a37df9c29d3-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:58 crc kubenswrapper[5120]: I0316 17:09:58.675443 5120 scope.go:117] "RemoveContainer" containerID="9d97456af25763c438e0acd373c3bbf792a78ef48369d22d14aa11c723f2637b" Mar 16 17:09:58 crc kubenswrapper[5120]: E0316 17:09:58.675906 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nova-scheduler-scheduler\" with CrashLoopBackOff: \"back-off 20s restarting failed container=nova-scheduler-scheduler pod=nova-scheduler-0_openstack-kuttl-tests(32194c8a-90a1-4132-9b75-3882418d7f7d)\"" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="32194c8a-90a1-4132-9b75-3882418d7f7d" Mar 16 17:09:58 crc kubenswrapper[5120]: I0316 17:09:58.714049 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c2d5679-277a-4f1f-94c7-4a37df9c29d3-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "3c2d5679-277a-4f1f-94c7-4a37df9c29d3" (UID: "3c2d5679-277a-4f1f-94c7-4a37df9c29d3"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:09:58 crc kubenswrapper[5120]: I0316 17:09:58.717416 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c2d5679-277a-4f1f-94c7-4a37df9c29d3-config-data" (OuterVolumeSpecName: "config-data") pod "3c2d5679-277a-4f1f-94c7-4a37df9c29d3" (UID: "3c2d5679-277a-4f1f-94c7-4a37df9c29d3"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:09:58 crc kubenswrapper[5120]: I0316 17:09:58.756835 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3c2d5679-277a-4f1f-94c7-4a37df9c29d3-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:58 crc kubenswrapper[5120]: I0316 17:09:58.756881 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3c2d5679-277a-4f1f-94c7-4a37df9c29d3-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:58 crc kubenswrapper[5120]: I0316 17:09:58.895976 5120 generic.go:358] "Generic (PLEG): container finished" podID="bc40587b-0877-4370-bdcc-a56479bf99e6" containerID="7d73343d7be0ecf4e34e8548de8e689810358007288282c370dc697d0c48f215" exitCode=0 Mar 16 17:09:58 crc kubenswrapper[5120]: I0316 17:09:58.896058 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-5866f469b4-fczj7" event={"ID":"bc40587b-0877-4370-bdcc-a56479bf99e6","Type":"ContainerDied","Data":"7d73343d7be0ecf4e34e8548de8e689810358007288282c370dc697d0c48f215"} Mar 16 17:09:58 crc kubenswrapper[5120]: I0316 17:09:58.898835 5120 generic.go:358] "Generic (PLEG): container finished" podID="3c2d5679-277a-4f1f-94c7-4a37df9c29d3" containerID="2788323bc772d158b1df47da429e9be0f6a201d43f5d06c7ab4c0b0f99e0993a" exitCode=0 Mar 16 17:09:58 crc kubenswrapper[5120]: I0316 17:09:58.899031 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"3c2d5679-277a-4f1f-94c7-4a37df9c29d3","Type":"ContainerDied","Data":"2788323bc772d158b1df47da429e9be0f6a201d43f5d06c7ab4c0b0f99e0993a"} Mar 16 17:09:58 crc kubenswrapper[5120]: I0316 17:09:58.899052 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"3c2d5679-277a-4f1f-94c7-4a37df9c29d3","Type":"ContainerDied","Data":"1c6d108ca5ff6167004775f98213649697146563a47739f53421c148ececccca"} Mar 16 17:09:58 crc kubenswrapper[5120]: I0316 17:09:58.899068 5120 scope.go:117] "RemoveContainer" containerID="1a25fa7cc0a3a476b2575d9cd316feb86b6d038ff5afcf61a2e03f181eb70016" Mar 16 17:09:58 crc kubenswrapper[5120]: I0316 17:09:58.899201 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:09:58 crc kubenswrapper[5120]: I0316 17:09:58.933822 5120 scope.go:117] "RemoveContainer" containerID="504da395b98af450c567ae2b9409fd2ac793973f3fd8e061134a19b143ef1898" Mar 16 17:09:58 crc kubenswrapper[5120]: I0316 17:09:58.948075 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:09:58 crc kubenswrapper[5120]: I0316 17:09:58.964972 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:09:58 crc kubenswrapper[5120]: I0316 17:09:58.980303 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:09:58 crc kubenswrapper[5120]: I0316 17:09:58.981844 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dcd050a7-3f66-4fb5-a7a3-5736ee13ce15" containerName="placement-log" Mar 16 17:09:58 crc kubenswrapper[5120]: I0316 17:09:58.981877 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="dcd050a7-3f66-4fb5-a7a3-5736ee13ce15" containerName="placement-log" Mar 16 17:09:58 crc kubenswrapper[5120]: I0316 17:09:58.981894 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eed6d812-3092-456e-8466-c6f875c06a54" containerName="barbican-api-log" Mar 16 17:09:58 crc kubenswrapper[5120]: I0316 17:09:58.981902 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="eed6d812-3092-456e-8466-c6f875c06a54" containerName="barbican-api-log" Mar 16 17:09:58 crc kubenswrapper[5120]: I0316 17:09:58.981922 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c2d5679-277a-4f1f-94c7-4a37df9c29d3" containerName="sg-core" Mar 16 17:09:58 crc kubenswrapper[5120]: I0316 17:09:58.981930 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c2d5679-277a-4f1f-94c7-4a37df9c29d3" containerName="sg-core" Mar 16 17:09:58 crc kubenswrapper[5120]: I0316 17:09:58.981949 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eed6d812-3092-456e-8466-c6f875c06a54" containerName="barbican-api" Mar 16 17:09:58 crc kubenswrapper[5120]: I0316 17:09:58.981956 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="eed6d812-3092-456e-8466-c6f875c06a54" containerName="barbican-api" Mar 16 17:09:58 crc kubenswrapper[5120]: I0316 17:09:58.981980 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dcd050a7-3f66-4fb5-a7a3-5736ee13ce15" containerName="placement-api" Mar 16 17:09:58 crc kubenswrapper[5120]: I0316 17:09:58.981988 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="dcd050a7-3f66-4fb5-a7a3-5736ee13ce15" containerName="placement-api" Mar 16 17:09:58 crc kubenswrapper[5120]: I0316 17:09:58.982026 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c2d5679-277a-4f1f-94c7-4a37df9c29d3" containerName="ceilometer-central-agent" Mar 16 17:09:58 crc kubenswrapper[5120]: I0316 17:09:58.982034 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c2d5679-277a-4f1f-94c7-4a37df9c29d3" containerName="ceilometer-central-agent" Mar 16 17:09:58 crc kubenswrapper[5120]: I0316 17:09:58.982048 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c2d5679-277a-4f1f-94c7-4a37df9c29d3" containerName="ceilometer-notification-agent" Mar 16 17:09:58 crc kubenswrapper[5120]: I0316 17:09:58.982057 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c2d5679-277a-4f1f-94c7-4a37df9c29d3" containerName="ceilometer-notification-agent" Mar 16 17:09:58 crc kubenswrapper[5120]: I0316 17:09:58.982074 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c2d5679-277a-4f1f-94c7-4a37df9c29d3" containerName="proxy-httpd" Mar 16 17:09:58 crc kubenswrapper[5120]: I0316 17:09:58.982080 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c2d5679-277a-4f1f-94c7-4a37df9c29d3" containerName="proxy-httpd" Mar 16 17:09:58 crc kubenswrapper[5120]: I0316 17:09:58.982289 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="3c2d5679-277a-4f1f-94c7-4a37df9c29d3" containerName="ceilometer-central-agent" Mar 16 17:09:58 crc kubenswrapper[5120]: I0316 17:09:58.982312 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="3c2d5679-277a-4f1f-94c7-4a37df9c29d3" containerName="proxy-httpd" Mar 16 17:09:58 crc kubenswrapper[5120]: I0316 17:09:58.982323 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="dcd050a7-3f66-4fb5-a7a3-5736ee13ce15" containerName="placement-api" Mar 16 17:09:58 crc kubenswrapper[5120]: I0316 17:09:58.982338 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="3c2d5679-277a-4f1f-94c7-4a37df9c29d3" containerName="ceilometer-notification-agent" Mar 16 17:09:58 crc kubenswrapper[5120]: I0316 17:09:58.982349 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="eed6d812-3092-456e-8466-c6f875c06a54" containerName="barbican-api" Mar 16 17:09:58 crc kubenswrapper[5120]: I0316 17:09:58.982364 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="eed6d812-3092-456e-8466-c6f875c06a54" containerName="barbican-api-log" Mar 16 17:09:58 crc kubenswrapper[5120]: I0316 17:09:58.982382 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="3c2d5679-277a-4f1f-94c7-4a37df9c29d3" containerName="sg-core" Mar 16 17:09:58 crc kubenswrapper[5120]: I0316 17:09:58.982391 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="dcd050a7-3f66-4fb5-a7a3-5736ee13ce15" containerName="placement-log" Mar 16 17:09:58 crc kubenswrapper[5120]: I0316 17:09:58.992220 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:09:58 crc kubenswrapper[5120]: I0316 17:09:58.992418 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:09:58 crc kubenswrapper[5120]: I0316 17:09:58.996670 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 17:09:58 crc kubenswrapper[5120]: I0316 17:09:58.997539 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ceilometer-internal-svc\"" Mar 16 17:09:58 crc kubenswrapper[5120]: I0316 17:09:58.997718 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 17:09:58 crc kubenswrapper[5120]: I0316 17:09:58.999087 5120 scope.go:117] "RemoveContainer" containerID="2788323bc772d158b1df47da429e9be0f6a201d43f5d06c7ab4c0b0f99e0993a" Mar 16 17:09:59 crc kubenswrapper[5120]: I0316 17:09:59.048096 5120 scope.go:117] "RemoveContainer" containerID="f59e3f589f2c744c0fec7c367ccaee441c0171f5289a91c4ed169f87e31a15dc" Mar 16 17:09:59 crc kubenswrapper[5120]: I0316 17:09:59.073652 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/edef0e3b-1367-4f3e-a5af-77c4bfce7483-config-data\") pod \"ceilometer-0\" (UID: \"edef0e3b-1367-4f3e-a5af-77c4bfce7483\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:09:59 crc kubenswrapper[5120]: I0316 17:09:59.073690 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/edef0e3b-1367-4f3e-a5af-77c4bfce7483-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"edef0e3b-1367-4f3e-a5af-77c4bfce7483\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:09:59 crc kubenswrapper[5120]: I0316 17:09:59.073713 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6khjh\" (UniqueName: \"kubernetes.io/projected/edef0e3b-1367-4f3e-a5af-77c4bfce7483-kube-api-access-6khjh\") pod \"ceilometer-0\" (UID: \"edef0e3b-1367-4f3e-a5af-77c4bfce7483\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:09:59 crc kubenswrapper[5120]: I0316 17:09:59.073777 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/edef0e3b-1367-4f3e-a5af-77c4bfce7483-scripts\") pod \"ceilometer-0\" (UID: \"edef0e3b-1367-4f3e-a5af-77c4bfce7483\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:09:59 crc kubenswrapper[5120]: I0316 17:09:59.073903 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/edef0e3b-1367-4f3e-a5af-77c4bfce7483-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"edef0e3b-1367-4f3e-a5af-77c4bfce7483\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:09:59 crc kubenswrapper[5120]: I0316 17:09:59.073929 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/edef0e3b-1367-4f3e-a5af-77c4bfce7483-run-httpd\") pod \"ceilometer-0\" (UID: \"edef0e3b-1367-4f3e-a5af-77c4bfce7483\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:09:59 crc kubenswrapper[5120]: I0316 17:09:59.074021 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/edef0e3b-1367-4f3e-a5af-77c4bfce7483-log-httpd\") pod \"ceilometer-0\" (UID: \"edef0e3b-1367-4f3e-a5af-77c4bfce7483\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:09:59 crc kubenswrapper[5120]: I0316 17:09:59.074066 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/edef0e3b-1367-4f3e-a5af-77c4bfce7483-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"edef0e3b-1367-4f3e-a5af-77c4bfce7483\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:09:59 crc kubenswrapper[5120]: I0316 17:09:59.074596 5120 scope.go:117] "RemoveContainer" containerID="1a25fa7cc0a3a476b2575d9cd316feb86b6d038ff5afcf61a2e03f181eb70016" Mar 16 17:09:59 crc kubenswrapper[5120]: E0316 17:09:59.074987 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a25fa7cc0a3a476b2575d9cd316feb86b6d038ff5afcf61a2e03f181eb70016\": container with ID starting with 1a25fa7cc0a3a476b2575d9cd316feb86b6d038ff5afcf61a2e03f181eb70016 not found: ID does not exist" containerID="1a25fa7cc0a3a476b2575d9cd316feb86b6d038ff5afcf61a2e03f181eb70016" Mar 16 17:09:59 crc kubenswrapper[5120]: I0316 17:09:59.075018 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a25fa7cc0a3a476b2575d9cd316feb86b6d038ff5afcf61a2e03f181eb70016"} err="failed to get container status \"1a25fa7cc0a3a476b2575d9cd316feb86b6d038ff5afcf61a2e03f181eb70016\": rpc error: code = NotFound desc = could not find container \"1a25fa7cc0a3a476b2575d9cd316feb86b6d038ff5afcf61a2e03f181eb70016\": container with ID starting with 1a25fa7cc0a3a476b2575d9cd316feb86b6d038ff5afcf61a2e03f181eb70016 not found: ID does not exist" Mar 16 17:09:59 crc kubenswrapper[5120]: I0316 17:09:59.075037 5120 scope.go:117] "RemoveContainer" containerID="504da395b98af450c567ae2b9409fd2ac793973f3fd8e061134a19b143ef1898" Mar 16 17:09:59 crc kubenswrapper[5120]: E0316 17:09:59.075209 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"504da395b98af450c567ae2b9409fd2ac793973f3fd8e061134a19b143ef1898\": container with ID starting with 504da395b98af450c567ae2b9409fd2ac793973f3fd8e061134a19b143ef1898 not found: ID does not exist" containerID="504da395b98af450c567ae2b9409fd2ac793973f3fd8e061134a19b143ef1898" Mar 16 17:09:59 crc kubenswrapper[5120]: I0316 17:09:59.075230 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"504da395b98af450c567ae2b9409fd2ac793973f3fd8e061134a19b143ef1898"} err="failed to get container status \"504da395b98af450c567ae2b9409fd2ac793973f3fd8e061134a19b143ef1898\": rpc error: code = NotFound desc = could not find container \"504da395b98af450c567ae2b9409fd2ac793973f3fd8e061134a19b143ef1898\": container with ID starting with 504da395b98af450c567ae2b9409fd2ac793973f3fd8e061134a19b143ef1898 not found: ID does not exist" Mar 16 17:09:59 crc kubenswrapper[5120]: I0316 17:09:59.075242 5120 scope.go:117] "RemoveContainer" containerID="2788323bc772d158b1df47da429e9be0f6a201d43f5d06c7ab4c0b0f99e0993a" Mar 16 17:09:59 crc kubenswrapper[5120]: E0316 17:09:59.075392 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2788323bc772d158b1df47da429e9be0f6a201d43f5d06c7ab4c0b0f99e0993a\": container with ID starting with 2788323bc772d158b1df47da429e9be0f6a201d43f5d06c7ab4c0b0f99e0993a not found: ID does not exist" containerID="2788323bc772d158b1df47da429e9be0f6a201d43f5d06c7ab4c0b0f99e0993a" Mar 16 17:09:59 crc kubenswrapper[5120]: I0316 17:09:59.075415 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2788323bc772d158b1df47da429e9be0f6a201d43f5d06c7ab4c0b0f99e0993a"} err="failed to get container status \"2788323bc772d158b1df47da429e9be0f6a201d43f5d06c7ab4c0b0f99e0993a\": rpc error: code = NotFound desc = could not find container \"2788323bc772d158b1df47da429e9be0f6a201d43f5d06c7ab4c0b0f99e0993a\": container with ID starting with 2788323bc772d158b1df47da429e9be0f6a201d43f5d06c7ab4c0b0f99e0993a not found: ID does not exist" Mar 16 17:09:59 crc kubenswrapper[5120]: I0316 17:09:59.075428 5120 scope.go:117] "RemoveContainer" containerID="f59e3f589f2c744c0fec7c367ccaee441c0171f5289a91c4ed169f87e31a15dc" Mar 16 17:09:59 crc kubenswrapper[5120]: E0316 17:09:59.075573 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f59e3f589f2c744c0fec7c367ccaee441c0171f5289a91c4ed169f87e31a15dc\": container with ID starting with f59e3f589f2c744c0fec7c367ccaee441c0171f5289a91c4ed169f87e31a15dc not found: ID does not exist" containerID="f59e3f589f2c744c0fec7c367ccaee441c0171f5289a91c4ed169f87e31a15dc" Mar 16 17:09:59 crc kubenswrapper[5120]: I0316 17:09:59.075595 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f59e3f589f2c744c0fec7c367ccaee441c0171f5289a91c4ed169f87e31a15dc"} err="failed to get container status \"f59e3f589f2c744c0fec7c367ccaee441c0171f5289a91c4ed169f87e31a15dc\": rpc error: code = NotFound desc = could not find container \"f59e3f589f2c744c0fec7c367ccaee441c0171f5289a91c4ed169f87e31a15dc\": container with ID starting with f59e3f589f2c744c0fec7c367ccaee441c0171f5289a91c4ed169f87e31a15dc not found: ID does not exist" Mar 16 17:09:59 crc kubenswrapper[5120]: I0316 17:09:59.097807 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-5866f469b4-fczj7" Mar 16 17:09:59 crc kubenswrapper[5120]: I0316 17:09:59.181584 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/bc40587b-0877-4370-bdcc-a56479bf99e6-config-data-custom\") pod \"bc40587b-0877-4370-bdcc-a56479bf99e6\" (UID: \"bc40587b-0877-4370-bdcc-a56479bf99e6\") " Mar 16 17:09:59 crc kubenswrapper[5120]: I0316 17:09:59.182479 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dkzlf\" (UniqueName: \"kubernetes.io/projected/bc40587b-0877-4370-bdcc-a56479bf99e6-kube-api-access-dkzlf\") pod \"bc40587b-0877-4370-bdcc-a56479bf99e6\" (UID: \"bc40587b-0877-4370-bdcc-a56479bf99e6\") " Mar 16 17:09:59 crc kubenswrapper[5120]: I0316 17:09:59.182539 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/bc40587b-0877-4370-bdcc-a56479bf99e6-logs\") pod \"bc40587b-0877-4370-bdcc-a56479bf99e6\" (UID: \"bc40587b-0877-4370-bdcc-a56479bf99e6\") " Mar 16 17:09:59 crc kubenswrapper[5120]: I0316 17:09:59.182619 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/bc40587b-0877-4370-bdcc-a56479bf99e6-public-tls-certs\") pod \"bc40587b-0877-4370-bdcc-a56479bf99e6\" (UID: \"bc40587b-0877-4370-bdcc-a56479bf99e6\") " Mar 16 17:09:59 crc kubenswrapper[5120]: I0316 17:09:59.182695 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/bc40587b-0877-4370-bdcc-a56479bf99e6-internal-tls-certs\") pod \"bc40587b-0877-4370-bdcc-a56479bf99e6\" (UID: \"bc40587b-0877-4370-bdcc-a56479bf99e6\") " Mar 16 17:09:59 crc kubenswrapper[5120]: I0316 17:09:59.182747 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bc40587b-0877-4370-bdcc-a56479bf99e6-config-data\") pod \"bc40587b-0877-4370-bdcc-a56479bf99e6\" (UID: \"bc40587b-0877-4370-bdcc-a56479bf99e6\") " Mar 16 17:09:59 crc kubenswrapper[5120]: I0316 17:09:59.183085 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc40587b-0877-4370-bdcc-a56479bf99e6-logs" (OuterVolumeSpecName: "logs") pod "bc40587b-0877-4370-bdcc-a56479bf99e6" (UID: "bc40587b-0877-4370-bdcc-a56479bf99e6"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:09:59 crc kubenswrapper[5120]: I0316 17:09:59.183104 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bc40587b-0877-4370-bdcc-a56479bf99e6-combined-ca-bundle\") pod \"bc40587b-0877-4370-bdcc-a56479bf99e6\" (UID: \"bc40587b-0877-4370-bdcc-a56479bf99e6\") " Mar 16 17:09:59 crc kubenswrapper[5120]: I0316 17:09:59.184492 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/edef0e3b-1367-4f3e-a5af-77c4bfce7483-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"edef0e3b-1367-4f3e-a5af-77c4bfce7483\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:09:59 crc kubenswrapper[5120]: I0316 17:09:59.185020 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/edef0e3b-1367-4f3e-a5af-77c4bfce7483-run-httpd\") pod \"ceilometer-0\" (UID: \"edef0e3b-1367-4f3e-a5af-77c4bfce7483\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:09:59 crc kubenswrapper[5120]: I0316 17:09:59.185210 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/edef0e3b-1367-4f3e-a5af-77c4bfce7483-log-httpd\") pod \"ceilometer-0\" (UID: \"edef0e3b-1367-4f3e-a5af-77c4bfce7483\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:09:59 crc kubenswrapper[5120]: I0316 17:09:59.185295 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/edef0e3b-1367-4f3e-a5af-77c4bfce7483-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"edef0e3b-1367-4f3e-a5af-77c4bfce7483\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:09:59 crc kubenswrapper[5120]: I0316 17:09:59.185794 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/edef0e3b-1367-4f3e-a5af-77c4bfce7483-config-data\") pod \"ceilometer-0\" (UID: \"edef0e3b-1367-4f3e-a5af-77c4bfce7483\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:09:59 crc kubenswrapper[5120]: I0316 17:09:59.185824 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/edef0e3b-1367-4f3e-a5af-77c4bfce7483-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"edef0e3b-1367-4f3e-a5af-77c4bfce7483\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:09:59 crc kubenswrapper[5120]: I0316 17:09:59.185853 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6khjh\" (UniqueName: \"kubernetes.io/projected/edef0e3b-1367-4f3e-a5af-77c4bfce7483-kube-api-access-6khjh\") pod \"ceilometer-0\" (UID: \"edef0e3b-1367-4f3e-a5af-77c4bfce7483\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:09:59 crc kubenswrapper[5120]: I0316 17:09:59.185929 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/edef0e3b-1367-4f3e-a5af-77c4bfce7483-scripts\") pod \"ceilometer-0\" (UID: \"edef0e3b-1367-4f3e-a5af-77c4bfce7483\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:09:59 crc kubenswrapper[5120]: I0316 17:09:59.185992 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/edef0e3b-1367-4f3e-a5af-77c4bfce7483-run-httpd\") pod \"ceilometer-0\" (UID: \"edef0e3b-1367-4f3e-a5af-77c4bfce7483\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:09:59 crc kubenswrapper[5120]: I0316 17:09:59.186230 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/bc40587b-0877-4370-bdcc-a56479bf99e6-logs\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:59 crc kubenswrapper[5120]: I0316 17:09:59.186335 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/edef0e3b-1367-4f3e-a5af-77c4bfce7483-log-httpd\") pod \"ceilometer-0\" (UID: \"edef0e3b-1367-4f3e-a5af-77c4bfce7483\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:09:59 crc kubenswrapper[5120]: I0316 17:09:59.190356 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/edef0e3b-1367-4f3e-a5af-77c4bfce7483-scripts\") pod \"ceilometer-0\" (UID: \"edef0e3b-1367-4f3e-a5af-77c4bfce7483\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:09:59 crc kubenswrapper[5120]: I0316 17:09:59.190856 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc40587b-0877-4370-bdcc-a56479bf99e6-kube-api-access-dkzlf" (OuterVolumeSpecName: "kube-api-access-dkzlf") pod "bc40587b-0877-4370-bdcc-a56479bf99e6" (UID: "bc40587b-0877-4370-bdcc-a56479bf99e6"). InnerVolumeSpecName "kube-api-access-dkzlf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:09:59 crc kubenswrapper[5120]: I0316 17:09:59.191589 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/edef0e3b-1367-4f3e-a5af-77c4bfce7483-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"edef0e3b-1367-4f3e-a5af-77c4bfce7483\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:09:59 crc kubenswrapper[5120]: I0316 17:09:59.191979 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bc40587b-0877-4370-bdcc-a56479bf99e6-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "bc40587b-0877-4370-bdcc-a56479bf99e6" (UID: "bc40587b-0877-4370-bdcc-a56479bf99e6"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:09:59 crc kubenswrapper[5120]: I0316 17:09:59.195050 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/edef0e3b-1367-4f3e-a5af-77c4bfce7483-config-data\") pod \"ceilometer-0\" (UID: \"edef0e3b-1367-4f3e-a5af-77c4bfce7483\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:09:59 crc kubenswrapper[5120]: I0316 17:09:59.198553 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/edef0e3b-1367-4f3e-a5af-77c4bfce7483-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"edef0e3b-1367-4f3e-a5af-77c4bfce7483\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:09:59 crc kubenswrapper[5120]: I0316 17:09:59.205546 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/edef0e3b-1367-4f3e-a5af-77c4bfce7483-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"edef0e3b-1367-4f3e-a5af-77c4bfce7483\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:09:59 crc kubenswrapper[5120]: I0316 17:09:59.207521 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6khjh\" (UniqueName: \"kubernetes.io/projected/edef0e3b-1367-4f3e-a5af-77c4bfce7483-kube-api-access-6khjh\") pod \"ceilometer-0\" (UID: \"edef0e3b-1367-4f3e-a5af-77c4bfce7483\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:09:59 crc kubenswrapper[5120]: I0316 17:09:59.240575 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bc40587b-0877-4370-bdcc-a56479bf99e6-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "bc40587b-0877-4370-bdcc-a56479bf99e6" (UID: "bc40587b-0877-4370-bdcc-a56479bf99e6"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:09:59 crc kubenswrapper[5120]: I0316 17:09:59.256704 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bc40587b-0877-4370-bdcc-a56479bf99e6-config-data" (OuterVolumeSpecName: "config-data") pod "bc40587b-0877-4370-bdcc-a56479bf99e6" (UID: "bc40587b-0877-4370-bdcc-a56479bf99e6"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:09:59 crc kubenswrapper[5120]: I0316 17:09:59.268411 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bc40587b-0877-4370-bdcc-a56479bf99e6-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "bc40587b-0877-4370-bdcc-a56479bf99e6" (UID: "bc40587b-0877-4370-bdcc-a56479bf99e6"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:09:59 crc kubenswrapper[5120]: I0316 17:09:59.279068 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bc40587b-0877-4370-bdcc-a56479bf99e6-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "bc40587b-0877-4370-bdcc-a56479bf99e6" (UID: "bc40587b-0877-4370-bdcc-a56479bf99e6"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:09:59 crc kubenswrapper[5120]: I0316 17:09:59.288307 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bc40587b-0877-4370-bdcc-a56479bf99e6-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:59 crc kubenswrapper[5120]: I0316 17:09:59.288342 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bc40587b-0877-4370-bdcc-a56479bf99e6-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:59 crc kubenswrapper[5120]: I0316 17:09:59.288352 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/bc40587b-0877-4370-bdcc-a56479bf99e6-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:59 crc kubenswrapper[5120]: I0316 17:09:59.288363 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dkzlf\" (UniqueName: \"kubernetes.io/projected/bc40587b-0877-4370-bdcc-a56479bf99e6-kube-api-access-dkzlf\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:59 crc kubenswrapper[5120]: I0316 17:09:59.288372 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/bc40587b-0877-4370-bdcc-a56479bf99e6-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:59 crc kubenswrapper[5120]: I0316 17:09:59.288380 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/bc40587b-0877-4370-bdcc-a56479bf99e6-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:59 crc kubenswrapper[5120]: I0316 17:09:59.345610 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:09:59 crc kubenswrapper[5120]: I0316 17:09:59.400235 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-7df86b764c-bv9sm" Mar 16 17:09:59 crc kubenswrapper[5120]: I0316 17:09:59.492248 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/957ea161-cf8b-43d5-b464-24dc4ee777df-public-tls-certs\") pod \"957ea161-cf8b-43d5-b464-24dc4ee777df\" (UID: \"957ea161-cf8b-43d5-b464-24dc4ee777df\") " Mar 16 17:09:59 crc kubenswrapper[5120]: I0316 17:09:59.492443 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/957ea161-cf8b-43d5-b464-24dc4ee777df-scripts\") pod \"957ea161-cf8b-43d5-b464-24dc4ee777df\" (UID: \"957ea161-cf8b-43d5-b464-24dc4ee777df\") " Mar 16 17:09:59 crc kubenswrapper[5120]: I0316 17:09:59.492872 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/957ea161-cf8b-43d5-b464-24dc4ee777df-internal-tls-certs\") pod \"957ea161-cf8b-43d5-b464-24dc4ee777df\" (UID: \"957ea161-cf8b-43d5-b464-24dc4ee777df\") " Mar 16 17:09:59 crc kubenswrapper[5120]: I0316 17:09:59.492958 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/957ea161-cf8b-43d5-b464-24dc4ee777df-config-data\") pod \"957ea161-cf8b-43d5-b464-24dc4ee777df\" (UID: \"957ea161-cf8b-43d5-b464-24dc4ee777df\") " Mar 16 17:09:59 crc kubenswrapper[5120]: I0316 17:09:59.493025 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/957ea161-cf8b-43d5-b464-24dc4ee777df-credential-keys\") pod \"957ea161-cf8b-43d5-b464-24dc4ee777df\" (UID: \"957ea161-cf8b-43d5-b464-24dc4ee777df\") " Mar 16 17:09:59 crc kubenswrapper[5120]: I0316 17:09:59.493087 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/957ea161-cf8b-43d5-b464-24dc4ee777df-fernet-keys\") pod \"957ea161-cf8b-43d5-b464-24dc4ee777df\" (UID: \"957ea161-cf8b-43d5-b464-24dc4ee777df\") " Mar 16 17:09:59 crc kubenswrapper[5120]: I0316 17:09:59.493151 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nhb5v\" (UniqueName: \"kubernetes.io/projected/957ea161-cf8b-43d5-b464-24dc4ee777df-kube-api-access-nhb5v\") pod \"957ea161-cf8b-43d5-b464-24dc4ee777df\" (UID: \"957ea161-cf8b-43d5-b464-24dc4ee777df\") " Mar 16 17:09:59 crc kubenswrapper[5120]: I0316 17:09:59.493238 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/957ea161-cf8b-43d5-b464-24dc4ee777df-combined-ca-bundle\") pod \"957ea161-cf8b-43d5-b464-24dc4ee777df\" (UID: \"957ea161-cf8b-43d5-b464-24dc4ee777df\") " Mar 16 17:09:59 crc kubenswrapper[5120]: I0316 17:09:59.497506 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/957ea161-cf8b-43d5-b464-24dc4ee777df-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "957ea161-cf8b-43d5-b464-24dc4ee777df" (UID: "957ea161-cf8b-43d5-b464-24dc4ee777df"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:09:59 crc kubenswrapper[5120]: I0316 17:09:59.497924 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/957ea161-cf8b-43d5-b464-24dc4ee777df-scripts" (OuterVolumeSpecName: "scripts") pod "957ea161-cf8b-43d5-b464-24dc4ee777df" (UID: "957ea161-cf8b-43d5-b464-24dc4ee777df"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:09:59 crc kubenswrapper[5120]: I0316 17:09:59.498052 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/957ea161-cf8b-43d5-b464-24dc4ee777df-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "957ea161-cf8b-43d5-b464-24dc4ee777df" (UID: "957ea161-cf8b-43d5-b464-24dc4ee777df"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:09:59 crc kubenswrapper[5120]: I0316 17:09:59.504146 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/957ea161-cf8b-43d5-b464-24dc4ee777df-kube-api-access-nhb5v" (OuterVolumeSpecName: "kube-api-access-nhb5v") pod "957ea161-cf8b-43d5-b464-24dc4ee777df" (UID: "957ea161-cf8b-43d5-b464-24dc4ee777df"). InnerVolumeSpecName "kube-api-access-nhb5v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:09:59 crc kubenswrapper[5120]: I0316 17:09:59.537325 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/957ea161-cf8b-43d5-b464-24dc4ee777df-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "957ea161-cf8b-43d5-b464-24dc4ee777df" (UID: "957ea161-cf8b-43d5-b464-24dc4ee777df"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:09:59 crc kubenswrapper[5120]: I0316 17:09:59.567523 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/957ea161-cf8b-43d5-b464-24dc4ee777df-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "957ea161-cf8b-43d5-b464-24dc4ee777df" (UID: "957ea161-cf8b-43d5-b464-24dc4ee777df"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:09:59 crc kubenswrapper[5120]: I0316 17:09:59.572149 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/957ea161-cf8b-43d5-b464-24dc4ee777df-config-data" (OuterVolumeSpecName: "config-data") pod "957ea161-cf8b-43d5-b464-24dc4ee777df" (UID: "957ea161-cf8b-43d5-b464-24dc4ee777df"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:09:59 crc kubenswrapper[5120]: I0316 17:09:59.576391 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/957ea161-cf8b-43d5-b464-24dc4ee777df-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "957ea161-cf8b-43d5-b464-24dc4ee777df" (UID: "957ea161-cf8b-43d5-b464-24dc4ee777df"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:09:59 crc kubenswrapper[5120]: I0316 17:09:59.597021 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/957ea161-cf8b-43d5-b464-24dc4ee777df-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:59 crc kubenswrapper[5120]: I0316 17:09:59.597075 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/957ea161-cf8b-43d5-b464-24dc4ee777df-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:59 crc kubenswrapper[5120]: I0316 17:09:59.597085 5120 reconciler_common.go:299] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/957ea161-cf8b-43d5-b464-24dc4ee777df-credential-keys\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:59 crc kubenswrapper[5120]: I0316 17:09:59.597094 5120 reconciler_common.go:299] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/957ea161-cf8b-43d5-b464-24dc4ee777df-fernet-keys\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:59 crc kubenswrapper[5120]: I0316 17:09:59.597103 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nhb5v\" (UniqueName: \"kubernetes.io/projected/957ea161-cf8b-43d5-b464-24dc4ee777df-kube-api-access-nhb5v\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:59 crc kubenswrapper[5120]: I0316 17:09:59.597136 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/957ea161-cf8b-43d5-b464-24dc4ee777df-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:59 crc kubenswrapper[5120]: I0316 17:09:59.597144 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/957ea161-cf8b-43d5-b464-24dc4ee777df-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:59 crc kubenswrapper[5120]: I0316 17:09:59.597153 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/957ea161-cf8b-43d5-b464-24dc4ee777df-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:09:59 crc kubenswrapper[5120]: I0316 17:09:59.809205 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:09:59 crc kubenswrapper[5120]: I0316 17:09:59.911371 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-5866f469b4-fczj7" Mar 16 17:09:59 crc kubenswrapper[5120]: I0316 17:09:59.911935 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-5866f469b4-fczj7" event={"ID":"bc40587b-0877-4370-bdcc-a56479bf99e6","Type":"ContainerDied","Data":"959fa3511d7e747bd3ff41c6639e595ac27b4a50154b39463bd4e88088d5dace"} Mar 16 17:09:59 crc kubenswrapper[5120]: I0316 17:09:59.912096 5120 scope.go:117] "RemoveContainer" containerID="7d73343d7be0ecf4e34e8548de8e689810358007288282c370dc697d0c48f215" Mar 16 17:09:59 crc kubenswrapper[5120]: I0316 17:09:59.913255 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"edef0e3b-1367-4f3e-a5af-77c4bfce7483","Type":"ContainerStarted","Data":"435e49da57c47fbe57dee77ea0378ff7b66119fcdf6328b7f18e3ef8ba67e791"} Mar 16 17:09:59 crc kubenswrapper[5120]: I0316 17:09:59.916286 5120 generic.go:358] "Generic (PLEG): container finished" podID="957ea161-cf8b-43d5-b464-24dc4ee777df" containerID="74b7d9768e9239473cf544c5e604fd8d6d2571d55e0643f31939cb1dde6c4948" exitCode=0 Mar 16 17:09:59 crc kubenswrapper[5120]: I0316 17:09:59.916419 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-7df86b764c-bv9sm" event={"ID":"957ea161-cf8b-43d5-b464-24dc4ee777df","Type":"ContainerDied","Data":"74b7d9768e9239473cf544c5e604fd8d6d2571d55e0643f31939cb1dde6c4948"} Mar 16 17:09:59 crc kubenswrapper[5120]: I0316 17:09:59.916456 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-7df86b764c-bv9sm" event={"ID":"957ea161-cf8b-43d5-b464-24dc4ee777df","Type":"ContainerDied","Data":"e85b051dc662e47e1d91c43d4c1b48a233490de98892d0d97a755dd05f330565"} Mar 16 17:09:59 crc kubenswrapper[5120]: I0316 17:09:59.916631 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-7df86b764c-bv9sm" Mar 16 17:09:59 crc kubenswrapper[5120]: I0316 17:09:59.950031 5120 scope.go:117] "RemoveContainer" containerID="de97a4d8d92d47af6b2c3179afe85e9468a8f5f8548789f8052a414b31dd9b1d" Mar 16 17:09:59 crc kubenswrapper[5120]: I0316 17:09:59.963631 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-5866f469b4-fczj7"] Mar 16 17:09:59 crc kubenswrapper[5120]: I0316 17:09:59.976641 5120 scope.go:117] "RemoveContainer" containerID="74b7d9768e9239473cf544c5e604fd8d6d2571d55e0643f31939cb1dde6c4948" Mar 16 17:09:59 crc kubenswrapper[5120]: I0316 17:09:59.978305 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-api-5866f469b4-fczj7"] Mar 16 17:09:59 crc kubenswrapper[5120]: I0316 17:09:59.987247 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-7df86b764c-bv9sm"] Mar 16 17:10:00 crc kubenswrapper[5120]: I0316 17:10:00.001675 5120 scope.go:117] "RemoveContainer" containerID="74b7d9768e9239473cf544c5e604fd8d6d2571d55e0643f31939cb1dde6c4948" Mar 16 17:10:00 crc kubenswrapper[5120]: E0316 17:10:00.002259 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"74b7d9768e9239473cf544c5e604fd8d6d2571d55e0643f31939cb1dde6c4948\": container with ID starting with 74b7d9768e9239473cf544c5e604fd8d6d2571d55e0643f31939cb1dde6c4948 not found: ID does not exist" containerID="74b7d9768e9239473cf544c5e604fd8d6d2571d55e0643f31939cb1dde6c4948" Mar 16 17:10:00 crc kubenswrapper[5120]: I0316 17:10:00.002308 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74b7d9768e9239473cf544c5e604fd8d6d2571d55e0643f31939cb1dde6c4948"} err="failed to get container status \"74b7d9768e9239473cf544c5e604fd8d6d2571d55e0643f31939cb1dde6c4948\": rpc error: code = NotFound desc = could not find container \"74b7d9768e9239473cf544c5e604fd8d6d2571d55e0643f31939cb1dde6c4948\": container with ID starting with 74b7d9768e9239473cf544c5e604fd8d6d2571d55e0643f31939cb1dde6c4948 not found: ID does not exist" Mar 16 17:10:00 crc kubenswrapper[5120]: I0316 17:10:00.006849 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-7df86b764c-bv9sm"] Mar 16 17:10:00 crc kubenswrapper[5120]: I0316 17:10:00.141923 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-infra/auto-csr-approver-29561350-z5wc4"] Mar 16 17:10:00 crc kubenswrapper[5120]: I0316 17:10:00.142975 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="957ea161-cf8b-43d5-b464-24dc4ee777df" containerName="keystone-api" Mar 16 17:10:00 crc kubenswrapper[5120]: I0316 17:10:00.142993 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="957ea161-cf8b-43d5-b464-24dc4ee777df" containerName="keystone-api" Mar 16 17:10:00 crc kubenswrapper[5120]: I0316 17:10:00.143023 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc40587b-0877-4370-bdcc-a56479bf99e6" containerName="barbican-api-log" Mar 16 17:10:00 crc kubenswrapper[5120]: I0316 17:10:00.143029 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc40587b-0877-4370-bdcc-a56479bf99e6" containerName="barbican-api-log" Mar 16 17:10:00 crc kubenswrapper[5120]: I0316 17:10:00.143041 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc40587b-0877-4370-bdcc-a56479bf99e6" containerName="barbican-api" Mar 16 17:10:00 crc kubenswrapper[5120]: I0316 17:10:00.143047 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc40587b-0877-4370-bdcc-a56479bf99e6" containerName="barbican-api" Mar 16 17:10:00 crc kubenswrapper[5120]: I0316 17:10:00.143237 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="bc40587b-0877-4370-bdcc-a56479bf99e6" containerName="barbican-api-log" Mar 16 17:10:00 crc kubenswrapper[5120]: I0316 17:10:00.143259 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="bc40587b-0877-4370-bdcc-a56479bf99e6" containerName="barbican-api" Mar 16 17:10:00 crc kubenswrapper[5120]: I0316 17:10:00.143272 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="957ea161-cf8b-43d5-b464-24dc4ee777df" containerName="keystone-api" Mar 16 17:10:00 crc kubenswrapper[5120]: I0316 17:10:00.150416 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561350-z5wc4" Mar 16 17:10:00 crc kubenswrapper[5120]: I0316 17:10:00.152742 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"openshift-service-ca.crt\"" Mar 16 17:10:00 crc kubenswrapper[5120]: I0316 17:10:00.152744 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-infra\"/\"csr-approver-sa-dockercfg-x2nsz\"" Mar 16 17:10:00 crc kubenswrapper[5120]: I0316 17:10:00.154194 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"kube-root-ca.crt\"" Mar 16 17:10:00 crc kubenswrapper[5120]: I0316 17:10:00.162278 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561350-z5wc4"] Mar 16 17:10:00 crc kubenswrapper[5120]: I0316 17:10:00.332054 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ns9vb\" (UniqueName: \"kubernetes.io/projected/36c840f9-b8cf-4aff-b328-7710c04683ad-kube-api-access-ns9vb\") pod \"auto-csr-approver-29561350-z5wc4\" (UID: \"36c840f9-b8cf-4aff-b328-7710c04683ad\") " pod="openshift-infra/auto-csr-approver-29561350-z5wc4" Mar 16 17:10:00 crc kubenswrapper[5120]: I0316 17:10:00.393445 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/swift-proxy-6d6f5fb946-cmmjt"] Mar 16 17:10:00 crc kubenswrapper[5120]: I0316 17:10:00.402643 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-6d6f5fb946-cmmjt" Mar 16 17:10:00 crc kubenswrapper[5120]: I0316 17:10:00.408109 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-proxy-6d6f5fb946-cmmjt"] Mar 16 17:10:00 crc kubenswrapper[5120]: I0316 17:10:00.435304 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ns9vb\" (UniqueName: \"kubernetes.io/projected/36c840f9-b8cf-4aff-b328-7710c04683ad-kube-api-access-ns9vb\") pod \"auto-csr-approver-29561350-z5wc4\" (UID: \"36c840f9-b8cf-4aff-b328-7710c04683ad\") " pod="openshift-infra/auto-csr-approver-29561350-z5wc4" Mar 16 17:10:00 crc kubenswrapper[5120]: I0316 17:10:00.457532 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ns9vb\" (UniqueName: \"kubernetes.io/projected/36c840f9-b8cf-4aff-b328-7710c04683ad-kube-api-access-ns9vb\") pod \"auto-csr-approver-29561350-z5wc4\" (UID: \"36c840f9-b8cf-4aff-b328-7710c04683ad\") " pod="openshift-infra/auto-csr-approver-29561350-z5wc4" Mar 16 17:10:00 crc kubenswrapper[5120]: I0316 17:10:00.525500 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561350-z5wc4" Mar 16 17:10:00 crc kubenswrapper[5120]: I0316 17:10:00.540581 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/4f3e991c-b99b-4665-b5df-a900935e3c99-log-httpd\") pod \"swift-proxy-6d6f5fb946-cmmjt\" (UID: \"4f3e991c-b99b-4665-b5df-a900935e3c99\") " pod="openstack-kuttl-tests/swift-proxy-6d6f5fb946-cmmjt" Mar 16 17:10:00 crc kubenswrapper[5120]: I0316 17:10:00.540752 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8487d\" (UniqueName: \"kubernetes.io/projected/4f3e991c-b99b-4665-b5df-a900935e3c99-kube-api-access-8487d\") pod \"swift-proxy-6d6f5fb946-cmmjt\" (UID: \"4f3e991c-b99b-4665-b5df-a900935e3c99\") " pod="openstack-kuttl-tests/swift-proxy-6d6f5fb946-cmmjt" Mar 16 17:10:00 crc kubenswrapper[5120]: I0316 17:10:00.540834 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/4f3e991c-b99b-4665-b5df-a900935e3c99-etc-swift\") pod \"swift-proxy-6d6f5fb946-cmmjt\" (UID: \"4f3e991c-b99b-4665-b5df-a900935e3c99\") " pod="openstack-kuttl-tests/swift-proxy-6d6f5fb946-cmmjt" Mar 16 17:10:00 crc kubenswrapper[5120]: I0316 17:10:00.540863 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/4f3e991c-b99b-4665-b5df-a900935e3c99-run-httpd\") pod \"swift-proxy-6d6f5fb946-cmmjt\" (UID: \"4f3e991c-b99b-4665-b5df-a900935e3c99\") " pod="openstack-kuttl-tests/swift-proxy-6d6f5fb946-cmmjt" Mar 16 17:10:00 crc kubenswrapper[5120]: I0316 17:10:00.540907 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/4f3e991c-b99b-4665-b5df-a900935e3c99-internal-tls-certs\") pod \"swift-proxy-6d6f5fb946-cmmjt\" (UID: \"4f3e991c-b99b-4665-b5df-a900935e3c99\") " pod="openstack-kuttl-tests/swift-proxy-6d6f5fb946-cmmjt" Mar 16 17:10:00 crc kubenswrapper[5120]: I0316 17:10:00.541148 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4f3e991c-b99b-4665-b5df-a900935e3c99-combined-ca-bundle\") pod \"swift-proxy-6d6f5fb946-cmmjt\" (UID: \"4f3e991c-b99b-4665-b5df-a900935e3c99\") " pod="openstack-kuttl-tests/swift-proxy-6d6f5fb946-cmmjt" Mar 16 17:10:00 crc kubenswrapper[5120]: I0316 17:10:00.541216 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/4f3e991c-b99b-4665-b5df-a900935e3c99-public-tls-certs\") pod \"swift-proxy-6d6f5fb946-cmmjt\" (UID: \"4f3e991c-b99b-4665-b5df-a900935e3c99\") " pod="openstack-kuttl-tests/swift-proxy-6d6f5fb946-cmmjt" Mar 16 17:10:00 crc kubenswrapper[5120]: I0316 17:10:00.541343 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4f3e991c-b99b-4665-b5df-a900935e3c99-config-data\") pod \"swift-proxy-6d6f5fb946-cmmjt\" (UID: \"4f3e991c-b99b-4665-b5df-a900935e3c99\") " pod="openstack-kuttl-tests/swift-proxy-6d6f5fb946-cmmjt" Mar 16 17:10:00 crc kubenswrapper[5120]: I0316 17:10:00.643746 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4f3e991c-b99b-4665-b5df-a900935e3c99-config-data\") pod \"swift-proxy-6d6f5fb946-cmmjt\" (UID: \"4f3e991c-b99b-4665-b5df-a900935e3c99\") " pod="openstack-kuttl-tests/swift-proxy-6d6f5fb946-cmmjt" Mar 16 17:10:00 crc kubenswrapper[5120]: I0316 17:10:00.644270 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/4f3e991c-b99b-4665-b5df-a900935e3c99-log-httpd\") pod \"swift-proxy-6d6f5fb946-cmmjt\" (UID: \"4f3e991c-b99b-4665-b5df-a900935e3c99\") " pod="openstack-kuttl-tests/swift-proxy-6d6f5fb946-cmmjt" Mar 16 17:10:00 crc kubenswrapper[5120]: I0316 17:10:00.644393 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8487d\" (UniqueName: \"kubernetes.io/projected/4f3e991c-b99b-4665-b5df-a900935e3c99-kube-api-access-8487d\") pod \"swift-proxy-6d6f5fb946-cmmjt\" (UID: \"4f3e991c-b99b-4665-b5df-a900935e3c99\") " pod="openstack-kuttl-tests/swift-proxy-6d6f5fb946-cmmjt" Mar 16 17:10:00 crc kubenswrapper[5120]: I0316 17:10:00.644449 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/4f3e991c-b99b-4665-b5df-a900935e3c99-etc-swift\") pod \"swift-proxy-6d6f5fb946-cmmjt\" (UID: \"4f3e991c-b99b-4665-b5df-a900935e3c99\") " pod="openstack-kuttl-tests/swift-proxy-6d6f5fb946-cmmjt" Mar 16 17:10:00 crc kubenswrapper[5120]: I0316 17:10:00.644479 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/4f3e991c-b99b-4665-b5df-a900935e3c99-run-httpd\") pod \"swift-proxy-6d6f5fb946-cmmjt\" (UID: \"4f3e991c-b99b-4665-b5df-a900935e3c99\") " pod="openstack-kuttl-tests/swift-proxy-6d6f5fb946-cmmjt" Mar 16 17:10:00 crc kubenswrapper[5120]: I0316 17:10:00.644531 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/4f3e991c-b99b-4665-b5df-a900935e3c99-internal-tls-certs\") pod \"swift-proxy-6d6f5fb946-cmmjt\" (UID: \"4f3e991c-b99b-4665-b5df-a900935e3c99\") " pod="openstack-kuttl-tests/swift-proxy-6d6f5fb946-cmmjt" Mar 16 17:10:00 crc kubenswrapper[5120]: I0316 17:10:00.644701 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4f3e991c-b99b-4665-b5df-a900935e3c99-combined-ca-bundle\") pod \"swift-proxy-6d6f5fb946-cmmjt\" (UID: \"4f3e991c-b99b-4665-b5df-a900935e3c99\") " pod="openstack-kuttl-tests/swift-proxy-6d6f5fb946-cmmjt" Mar 16 17:10:00 crc kubenswrapper[5120]: I0316 17:10:00.644750 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/4f3e991c-b99b-4665-b5df-a900935e3c99-public-tls-certs\") pod \"swift-proxy-6d6f5fb946-cmmjt\" (UID: \"4f3e991c-b99b-4665-b5df-a900935e3c99\") " pod="openstack-kuttl-tests/swift-proxy-6d6f5fb946-cmmjt" Mar 16 17:10:00 crc kubenswrapper[5120]: I0316 17:10:00.646274 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/4f3e991c-b99b-4665-b5df-a900935e3c99-run-httpd\") pod \"swift-proxy-6d6f5fb946-cmmjt\" (UID: \"4f3e991c-b99b-4665-b5df-a900935e3c99\") " pod="openstack-kuttl-tests/swift-proxy-6d6f5fb946-cmmjt" Mar 16 17:10:00 crc kubenswrapper[5120]: I0316 17:10:00.646517 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/4f3e991c-b99b-4665-b5df-a900935e3c99-log-httpd\") pod \"swift-proxy-6d6f5fb946-cmmjt\" (UID: \"4f3e991c-b99b-4665-b5df-a900935e3c99\") " pod="openstack-kuttl-tests/swift-proxy-6d6f5fb946-cmmjt" Mar 16 17:10:00 crc kubenswrapper[5120]: I0316 17:10:00.651616 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/4f3e991c-b99b-4665-b5df-a900935e3c99-public-tls-certs\") pod \"swift-proxy-6d6f5fb946-cmmjt\" (UID: \"4f3e991c-b99b-4665-b5df-a900935e3c99\") " pod="openstack-kuttl-tests/swift-proxy-6d6f5fb946-cmmjt" Mar 16 17:10:00 crc kubenswrapper[5120]: I0316 17:10:00.651669 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4f3e991c-b99b-4665-b5df-a900935e3c99-config-data\") pod \"swift-proxy-6d6f5fb946-cmmjt\" (UID: \"4f3e991c-b99b-4665-b5df-a900935e3c99\") " pod="openstack-kuttl-tests/swift-proxy-6d6f5fb946-cmmjt" Mar 16 17:10:00 crc kubenswrapper[5120]: I0316 17:10:00.652234 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4f3e991c-b99b-4665-b5df-a900935e3c99-combined-ca-bundle\") pod \"swift-proxy-6d6f5fb946-cmmjt\" (UID: \"4f3e991c-b99b-4665-b5df-a900935e3c99\") " pod="openstack-kuttl-tests/swift-proxy-6d6f5fb946-cmmjt" Mar 16 17:10:00 crc kubenswrapper[5120]: I0316 17:10:00.652749 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/4f3e991c-b99b-4665-b5df-a900935e3c99-internal-tls-certs\") pod \"swift-proxy-6d6f5fb946-cmmjt\" (UID: \"4f3e991c-b99b-4665-b5df-a900935e3c99\") " pod="openstack-kuttl-tests/swift-proxy-6d6f5fb946-cmmjt" Mar 16 17:10:00 crc kubenswrapper[5120]: I0316 17:10:00.654996 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/4f3e991c-b99b-4665-b5df-a900935e3c99-etc-swift\") pod \"swift-proxy-6d6f5fb946-cmmjt\" (UID: \"4f3e991c-b99b-4665-b5df-a900935e3c99\") " pod="openstack-kuttl-tests/swift-proxy-6d6f5fb946-cmmjt" Mar 16 17:10:00 crc kubenswrapper[5120]: I0316 17:10:00.671919 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8487d\" (UniqueName: \"kubernetes.io/projected/4f3e991c-b99b-4665-b5df-a900935e3c99-kube-api-access-8487d\") pod \"swift-proxy-6d6f5fb946-cmmjt\" (UID: \"4f3e991c-b99b-4665-b5df-a900935e3c99\") " pod="openstack-kuttl-tests/swift-proxy-6d6f5fb946-cmmjt" Mar 16 17:10:00 crc kubenswrapper[5120]: I0316 17:10:00.683943 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c2d5679-277a-4f1f-94c7-4a37df9c29d3" path="/var/lib/kubelet/pods/3c2d5679-277a-4f1f-94c7-4a37df9c29d3/volumes" Mar 16 17:10:00 crc kubenswrapper[5120]: I0316 17:10:00.684931 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="957ea161-cf8b-43d5-b464-24dc4ee777df" path="/var/lib/kubelet/pods/957ea161-cf8b-43d5-b464-24dc4ee777df/volumes" Mar 16 17:10:00 crc kubenswrapper[5120]: I0316 17:10:00.685448 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc40587b-0877-4370-bdcc-a56479bf99e6" path="/var/lib/kubelet/pods/bc40587b-0877-4370-bdcc-a56479bf99e6/volumes" Mar 16 17:10:00 crc kubenswrapper[5120]: I0316 17:10:00.721199 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-6d6f5fb946-cmmjt" Mar 16 17:10:00 crc kubenswrapper[5120]: I0316 17:10:00.937518 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"edef0e3b-1367-4f3e-a5af-77c4bfce7483","Type":"ContainerStarted","Data":"6e290ffcfc5bb5d5a4b34b1aa1f42c03f89a84b6dc27bf2d4c7d290a9b8d588c"} Mar 16 17:10:01 crc kubenswrapper[5120]: I0316 17:10:01.042269 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561350-z5wc4"] Mar 16 17:10:01 crc kubenswrapper[5120]: W0316 17:10:01.046265 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod36c840f9_b8cf_4aff_b328_7710c04683ad.slice/crio-2d53025e6cdd2c1a36cbfaaed1dbfe5d81907e2475788468e721a34eee59fca1 WatchSource:0}: Error finding container 2d53025e6cdd2c1a36cbfaaed1dbfe5d81907e2475788468e721a34eee59fca1: Status 404 returned error can't find the container with id 2d53025e6cdd2c1a36cbfaaed1dbfe5d81907e2475788468e721a34eee59fca1 Mar 16 17:10:01 crc kubenswrapper[5120]: I0316 17:10:01.133330 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:10:01 crc kubenswrapper[5120]: W0316 17:10:01.206098 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4f3e991c_b99b_4665_b5df_a900935e3c99.slice/crio-6b150ac7f6dae1cf5924cbb960f50bff0bc7739d5d8f1c80e605c630da985d35 WatchSource:0}: Error finding container 6b150ac7f6dae1cf5924cbb960f50bff0bc7739d5d8f1c80e605c630da985d35: Status 404 returned error can't find the container with id 6b150ac7f6dae1cf5924cbb960f50bff0bc7739d5d8f1c80e605c630da985d35 Mar 16 17:10:01 crc kubenswrapper[5120]: I0316 17:10:01.207373 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-proxy-6d6f5fb946-cmmjt"] Mar 16 17:10:01 crc kubenswrapper[5120]: I0316 17:10:01.954498 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-6d6f5fb946-cmmjt" event={"ID":"4f3e991c-b99b-4665-b5df-a900935e3c99","Type":"ContainerStarted","Data":"83333ee2767aae44602f3c8de136407f7f927fe1b5a6b91c23afde50bd3211f3"} Mar 16 17:10:01 crc kubenswrapper[5120]: I0316 17:10:01.957267 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-6d6f5fb946-cmmjt" event={"ID":"4f3e991c-b99b-4665-b5df-a900935e3c99","Type":"ContainerStarted","Data":"17ad1d58f4006f4071154741b686529cb6523ce7177fcd8c97be538f5ae1952f"} Mar 16 17:10:01 crc kubenswrapper[5120]: I0316 17:10:01.957445 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-6d6f5fb946-cmmjt" event={"ID":"4f3e991c-b99b-4665-b5df-a900935e3c99","Type":"ContainerStarted","Data":"6b150ac7f6dae1cf5924cbb960f50bff0bc7739d5d8f1c80e605c630da985d35"} Mar 16 17:10:01 crc kubenswrapper[5120]: I0316 17:10:01.957554 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/swift-proxy-6d6f5fb946-cmmjt" Mar 16 17:10:01 crc kubenswrapper[5120]: I0316 17:10:01.957648 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/swift-proxy-6d6f5fb946-cmmjt" Mar 16 17:10:01 crc kubenswrapper[5120]: I0316 17:10:01.964002 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"edef0e3b-1367-4f3e-a5af-77c4bfce7483","Type":"ContainerStarted","Data":"1d3f8bf1484d333d4c3f8d3ba0f318fd944c6b05df9a3aa624b59cafa40a7651"} Mar 16 17:10:01 crc kubenswrapper[5120]: I0316 17:10:01.966666 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561350-z5wc4" event={"ID":"36c840f9-b8cf-4aff-b328-7710c04683ad","Type":"ContainerStarted","Data":"2d53025e6cdd2c1a36cbfaaed1dbfe5d81907e2475788468e721a34eee59fca1"} Mar 16 17:10:01 crc kubenswrapper[5120]: I0316 17:10:01.992024 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/swift-proxy-6d6f5fb946-cmmjt" podStartSLOduration=1.9920021700000001 podStartE2EDuration="1.99200217s" podCreationTimestamp="2026-03-16 17:10:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:10:01.976005813 +0000 UTC m=+5904.129937480" watchObservedRunningTime="2026-03-16 17:10:01.99200217 +0000 UTC m=+5904.145933827" Mar 16 17:10:02 crc kubenswrapper[5120]: I0316 17:10:02.663654 5120 scope.go:117] "RemoveContainer" containerID="c53e6084cd4784b416aa0905c6c812a19a8f42a1d13ab48bd906b62501da4219" Mar 16 17:10:02 crc kubenswrapper[5120]: E0316 17:10:02.664244 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nova-cell1-conductor-conductor\" with CrashLoopBackOff: \"back-off 20s restarting failed container=nova-cell1-conductor-conductor pod=nova-cell1-conductor-0_openstack-kuttl-tests(d0852906-6351-45a9-a44c-0bf3f4c29496)\"" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="d0852906-6351-45a9-a44c-0bf3f4c29496" Mar 16 17:10:02 crc kubenswrapper[5120]: I0316 17:10:02.664372 5120 scope.go:117] "RemoveContainer" containerID="c95c639838ab0891241eeaedc65582a42fe56eb64e08e9942cc764c9beef0e20" Mar 16 17:10:02 crc kubenswrapper[5120]: E0316 17:10:02.664781 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nova-cell0-conductor-conductor\" with CrashLoopBackOff: \"back-off 40s restarting failed container=nova-cell0-conductor-conductor pod=nova-cell0-conductor-0_openstack-kuttl-tests(9a997459-37ba-46a9-9cb8-075f77fa009f)\"" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="9a997459-37ba-46a9-9cb8-075f77fa009f" Mar 16 17:10:02 crc kubenswrapper[5120]: I0316 17:10:02.980451 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"edef0e3b-1367-4f3e-a5af-77c4bfce7483","Type":"ContainerStarted","Data":"48e28f7239935ac43d1ec72a4197d39ff84aa16d95872ccbf9d1d5d3c7927029"} Mar 16 17:10:02 crc kubenswrapper[5120]: I0316 17:10:02.982470 5120 generic.go:358] "Generic (PLEG): container finished" podID="36c840f9-b8cf-4aff-b328-7710c04683ad" containerID="8d4a3d9b1283a01d167c75e4f66b2b01910574b906f4107af0cecaa34fecea8e" exitCode=0 Mar 16 17:10:02 crc kubenswrapper[5120]: I0316 17:10:02.982590 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561350-z5wc4" event={"ID":"36c840f9-b8cf-4aff-b328-7710c04683ad","Type":"ContainerDied","Data":"8d4a3d9b1283a01d167c75e4f66b2b01910574b906f4107af0cecaa34fecea8e"} Mar 16 17:10:03 crc kubenswrapper[5120]: I0316 17:10:03.665059 5120 scope.go:117] "RemoveContainer" containerID="db39d192fa687a13805537d08ad22fed1ef362ef5027c920a616297dc55a8ea9" Mar 16 17:10:03 crc kubenswrapper[5120]: E0316 17:10:03.665682 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 17:10:03 crc kubenswrapper[5120]: I0316 17:10:03.870387 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-5866f469b4-fczj7" podUID="bc40587b-0877-4370-bdcc-a56479bf99e6" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.0.10:9311/healthcheck\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Mar 16 17:10:04 crc kubenswrapper[5120]: I0316 17:10:04.363125 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:10:04 crc kubenswrapper[5120]: I0316 17:10:04.363446 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:10:04 crc kubenswrapper[5120]: I0316 17:10:04.376065 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561350-z5wc4" Mar 16 17:10:04 crc kubenswrapper[5120]: I0316 17:10:04.485379 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ns9vb\" (UniqueName: \"kubernetes.io/projected/36c840f9-b8cf-4aff-b328-7710c04683ad-kube-api-access-ns9vb\") pod \"36c840f9-b8cf-4aff-b328-7710c04683ad\" (UID: \"36c840f9-b8cf-4aff-b328-7710c04683ad\") " Mar 16 17:10:04 crc kubenswrapper[5120]: I0316 17:10:04.491900 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36c840f9-b8cf-4aff-b328-7710c04683ad-kube-api-access-ns9vb" (OuterVolumeSpecName: "kube-api-access-ns9vb") pod "36c840f9-b8cf-4aff-b328-7710c04683ad" (UID: "36c840f9-b8cf-4aff-b328-7710c04683ad"). InnerVolumeSpecName "kube-api-access-ns9vb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:10:04 crc kubenswrapper[5120]: I0316 17:10:04.589884 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ns9vb\" (UniqueName: \"kubernetes.io/projected/36c840f9-b8cf-4aff-b328-7710c04683ad-kube-api-access-ns9vb\") on node \"crc\" DevicePath \"\"" Mar 16 17:10:05 crc kubenswrapper[5120]: I0316 17:10:05.012276 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561350-z5wc4" Mar 16 17:10:05 crc kubenswrapper[5120]: I0316 17:10:05.012431 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561350-z5wc4" event={"ID":"36c840f9-b8cf-4aff-b328-7710c04683ad","Type":"ContainerDied","Data":"2d53025e6cdd2c1a36cbfaaed1dbfe5d81907e2475788468e721a34eee59fca1"} Mar 16 17:10:05 crc kubenswrapper[5120]: I0316 17:10:05.013043 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2d53025e6cdd2c1a36cbfaaed1dbfe5d81907e2475788468e721a34eee59fca1" Mar 16 17:10:05 crc kubenswrapper[5120]: I0316 17:10:05.450711 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-infra/auto-csr-approver-29561344-8gb27"] Mar 16 17:10:05 crc kubenswrapper[5120]: I0316 17:10:05.462074 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-infra/auto-csr-approver-29561344-8gb27"] Mar 16 17:10:06 crc kubenswrapper[5120]: I0316 17:10:06.028452 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"edef0e3b-1367-4f3e-a5af-77c4bfce7483","Type":"ContainerStarted","Data":"8f8d213298eb5552fca66ea12a52c41b450ddef3a7cd08f155fbd3af417ec011"} Mar 16 17:10:06 crc kubenswrapper[5120]: I0316 17:10:06.028663 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:10:06 crc kubenswrapper[5120]: I0316 17:10:06.028702 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="edef0e3b-1367-4f3e-a5af-77c4bfce7483" containerName="ceilometer-central-agent" containerID="cri-o://6e290ffcfc5bb5d5a4b34b1aa1f42c03f89a84b6dc27bf2d4c7d290a9b8d588c" gracePeriod=30 Mar 16 17:10:06 crc kubenswrapper[5120]: I0316 17:10:06.028747 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="edef0e3b-1367-4f3e-a5af-77c4bfce7483" containerName="proxy-httpd" containerID="cri-o://8f8d213298eb5552fca66ea12a52c41b450ddef3a7cd08f155fbd3af417ec011" gracePeriod=30 Mar 16 17:10:06 crc kubenswrapper[5120]: I0316 17:10:06.028811 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="edef0e3b-1367-4f3e-a5af-77c4bfce7483" containerName="ceilometer-notification-agent" containerID="cri-o://1d3f8bf1484d333d4c3f8d3ba0f318fd944c6b05df9a3aa624b59cafa40a7651" gracePeriod=30 Mar 16 17:10:06 crc kubenswrapper[5120]: I0316 17:10:06.028790 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="edef0e3b-1367-4f3e-a5af-77c4bfce7483" containerName="sg-core" containerID="cri-o://48e28f7239935ac43d1ec72a4197d39ff84aa16d95872ccbf9d1d5d3c7927029" gracePeriod=30 Mar 16 17:10:06 crc kubenswrapper[5120]: I0316 17:10:06.083204 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.922830149 podStartE2EDuration="8.083178952s" podCreationTimestamp="2026-03-16 17:09:58 +0000 UTC" firstStartedPulling="2026-03-16 17:09:59.812906902 +0000 UTC m=+5901.966838559" lastFinishedPulling="2026-03-16 17:10:04.973255705 +0000 UTC m=+5907.127187362" observedRunningTime="2026-03-16 17:10:06.063239347 +0000 UTC m=+5908.217171014" watchObservedRunningTime="2026-03-16 17:10:06.083178952 +0000 UTC m=+5908.237110609" Mar 16 17:10:06 crc kubenswrapper[5120]: I0316 17:10:06.367603 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:10:06 crc kubenswrapper[5120]: I0316 17:10:06.369578 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:10:06 crc kubenswrapper[5120]: I0316 17:10:06.372236 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/neutron-7465cc7fb4-nnm87" Mar 16 17:10:06 crc kubenswrapper[5120]: I0316 17:10:06.376363 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:10:06 crc kubenswrapper[5120]: I0316 17:10:06.485899 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-5bb4df7ffd-xw448"] Mar 16 17:10:06 crc kubenswrapper[5120]: I0316 17:10:06.486169 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-5bb4df7ffd-xw448" podUID="aadf64b4-9c41-4b13-be3a-4bb9172d06dd" containerName="neutron-api" containerID="cri-o://56403faf32f68846ceae22cf5e25eefebe5388a2c426b29ce462eac8315a559e" gracePeriod=30 Mar 16 17:10:06 crc kubenswrapper[5120]: I0316 17:10:06.486745 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-5bb4df7ffd-xw448" podUID="aadf64b4-9c41-4b13-be3a-4bb9172d06dd" containerName="neutron-httpd" containerID="cri-o://eda1116ec9b84caf5116448411997d10e50f93eefcee581f8f9dab7d32c1efd2" gracePeriod=30 Mar 16 17:10:06 crc kubenswrapper[5120]: I0316 17:10:06.675280 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b42179bd-7723-4c0f-b65b-b61d9cc5aab1" path="/var/lib/kubelet/pods/b42179bd-7723-4c0f-b65b-b61d9cc5aab1/volumes" Mar 16 17:10:07 crc kubenswrapper[5120]: I0316 17:10:07.047024 5120 generic.go:358] "Generic (PLEG): container finished" podID="aadf64b4-9c41-4b13-be3a-4bb9172d06dd" containerID="eda1116ec9b84caf5116448411997d10e50f93eefcee581f8f9dab7d32c1efd2" exitCode=0 Mar 16 17:10:07 crc kubenswrapper[5120]: I0316 17:10:07.047215 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-5bb4df7ffd-xw448" event={"ID":"aadf64b4-9c41-4b13-be3a-4bb9172d06dd","Type":"ContainerDied","Data":"eda1116ec9b84caf5116448411997d10e50f93eefcee581f8f9dab7d32c1efd2"} Mar 16 17:10:07 crc kubenswrapper[5120]: I0316 17:10:07.052986 5120 generic.go:358] "Generic (PLEG): container finished" podID="edef0e3b-1367-4f3e-a5af-77c4bfce7483" containerID="8f8d213298eb5552fca66ea12a52c41b450ddef3a7cd08f155fbd3af417ec011" exitCode=0 Mar 16 17:10:07 crc kubenswrapper[5120]: I0316 17:10:07.053022 5120 generic.go:358] "Generic (PLEG): container finished" podID="edef0e3b-1367-4f3e-a5af-77c4bfce7483" containerID="48e28f7239935ac43d1ec72a4197d39ff84aa16d95872ccbf9d1d5d3c7927029" exitCode=2 Mar 16 17:10:07 crc kubenswrapper[5120]: I0316 17:10:07.053029 5120 generic.go:358] "Generic (PLEG): container finished" podID="edef0e3b-1367-4f3e-a5af-77c4bfce7483" containerID="1d3f8bf1484d333d4c3f8d3ba0f318fd944c6b05df9a3aa624b59cafa40a7651" exitCode=0 Mar 16 17:10:07 crc kubenswrapper[5120]: I0316 17:10:07.053432 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"edef0e3b-1367-4f3e-a5af-77c4bfce7483","Type":"ContainerDied","Data":"8f8d213298eb5552fca66ea12a52c41b450ddef3a7cd08f155fbd3af417ec011"} Mar 16 17:10:07 crc kubenswrapper[5120]: I0316 17:10:07.053497 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"edef0e3b-1367-4f3e-a5af-77c4bfce7483","Type":"ContainerDied","Data":"48e28f7239935ac43d1ec72a4197d39ff84aa16d95872ccbf9d1d5d3c7927029"} Mar 16 17:10:07 crc kubenswrapper[5120]: I0316 17:10:07.053515 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"edef0e3b-1367-4f3e-a5af-77c4bfce7483","Type":"ContainerDied","Data":"1d3f8bf1484d333d4c3f8d3ba0f318fd944c6b05df9a3aa624b59cafa40a7651"} Mar 16 17:10:07 crc kubenswrapper[5120]: I0316 17:10:07.064862 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:10:08 crc kubenswrapper[5120]: E0316 17:10:08.819731 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1914210 actualBytes=10240 Mar 16 17:10:08 crc kubenswrapper[5120]: I0316 17:10:08.998463 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/swift-proxy-6d6f5fb946-cmmjt" Mar 16 17:10:09 crc kubenswrapper[5120]: I0316 17:10:09.006531 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/swift-proxy-6d6f5fb946-cmmjt" Mar 16 17:10:09 crc kubenswrapper[5120]: I0316 17:10:09.099957 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-proxy-664c964b6d-gxvmn"] Mar 16 17:10:09 crc kubenswrapper[5120]: I0316 17:10:09.100266 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-proxy-664c964b6d-gxvmn" podUID="c3ef2c2d-c556-439c-872c-c3e48ae34a71" containerName="proxy-httpd" containerID="cri-o://e4a1d46ba0e623133a190ddcb429fda2afa213c8683a469a7e30d5d5d4fcddfb" gracePeriod=30 Mar 16 17:10:09 crc kubenswrapper[5120]: I0316 17:10:09.100894 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-proxy-664c964b6d-gxvmn" podUID="c3ef2c2d-c556-439c-872c-c3e48ae34a71" containerName="proxy-server" containerID="cri-o://d80bc6369582c9774af68162d0f737c52bccd453f9b816c7e22bb11292caf25b" gracePeriod=30 Mar 16 17:10:09 crc kubenswrapper[5120]: I0316 17:10:09.664112 5120 scope.go:117] "RemoveContainer" containerID="9d97456af25763c438e0acd373c3bbf792a78ef48369d22d14aa11c723f2637b" Mar 16 17:10:10 crc kubenswrapper[5120]: I0316 17:10:10.109089 5120 generic.go:358] "Generic (PLEG): container finished" podID="c3ef2c2d-c556-439c-872c-c3e48ae34a71" containerID="d80bc6369582c9774af68162d0f737c52bccd453f9b816c7e22bb11292caf25b" exitCode=0 Mar 16 17:10:10 crc kubenswrapper[5120]: I0316 17:10:10.109408 5120 generic.go:358] "Generic (PLEG): container finished" podID="c3ef2c2d-c556-439c-872c-c3e48ae34a71" containerID="e4a1d46ba0e623133a190ddcb429fda2afa213c8683a469a7e30d5d5d4fcddfb" exitCode=0 Mar 16 17:10:10 crc kubenswrapper[5120]: I0316 17:10:10.109376 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-664c964b6d-gxvmn" event={"ID":"c3ef2c2d-c556-439c-872c-c3e48ae34a71","Type":"ContainerDied","Data":"d80bc6369582c9774af68162d0f737c52bccd453f9b816c7e22bb11292caf25b"} Mar 16 17:10:10 crc kubenswrapper[5120]: I0316 17:10:10.109473 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-664c964b6d-gxvmn" event={"ID":"c3ef2c2d-c556-439c-872c-c3e48ae34a71","Type":"ContainerDied","Data":"e4a1d46ba0e623133a190ddcb429fda2afa213c8683a469a7e30d5d5d4fcddfb"} Mar 16 17:10:10 crc kubenswrapper[5120]: I0316 17:10:10.114059 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"32194c8a-90a1-4132-9b75-3882418d7f7d","Type":"ContainerStarted","Data":"3318da5f8965a4f0071e38f2519bc938484ed88a240807dcc6be332ef0847740"} Mar 16 17:10:10 crc kubenswrapper[5120]: I0316 17:10:10.211730 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-664c964b6d-gxvmn" Mar 16 17:10:10 crc kubenswrapper[5120]: I0316 17:10:10.329801 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c3ef2c2d-c556-439c-872c-c3e48ae34a71-config-data\") pod \"c3ef2c2d-c556-439c-872c-c3e48ae34a71\" (UID: \"c3ef2c2d-c556-439c-872c-c3e48ae34a71\") " Mar 16 17:10:10 crc kubenswrapper[5120]: I0316 17:10:10.329954 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c3ef2c2d-c556-439c-872c-c3e48ae34a71-log-httpd\") pod \"c3ef2c2d-c556-439c-872c-c3e48ae34a71\" (UID: \"c3ef2c2d-c556-439c-872c-c3e48ae34a71\") " Mar 16 17:10:10 crc kubenswrapper[5120]: I0316 17:10:10.330017 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/c3ef2c2d-c556-439c-872c-c3e48ae34a71-internal-tls-certs\") pod \"c3ef2c2d-c556-439c-872c-c3e48ae34a71\" (UID: \"c3ef2c2d-c556-439c-872c-c3e48ae34a71\") " Mar 16 17:10:10 crc kubenswrapper[5120]: I0316 17:10:10.330157 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-whn4q\" (UniqueName: \"kubernetes.io/projected/c3ef2c2d-c556-439c-872c-c3e48ae34a71-kube-api-access-whn4q\") pod \"c3ef2c2d-c556-439c-872c-c3e48ae34a71\" (UID: \"c3ef2c2d-c556-439c-872c-c3e48ae34a71\") " Mar 16 17:10:10 crc kubenswrapper[5120]: I0316 17:10:10.330247 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/c3ef2c2d-c556-439c-872c-c3e48ae34a71-public-tls-certs\") pod \"c3ef2c2d-c556-439c-872c-c3e48ae34a71\" (UID: \"c3ef2c2d-c556-439c-872c-c3e48ae34a71\") " Mar 16 17:10:10 crc kubenswrapper[5120]: I0316 17:10:10.330601 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/c3ef2c2d-c556-439c-872c-c3e48ae34a71-etc-swift\") pod \"c3ef2c2d-c556-439c-872c-c3e48ae34a71\" (UID: \"c3ef2c2d-c556-439c-872c-c3e48ae34a71\") " Mar 16 17:10:10 crc kubenswrapper[5120]: I0316 17:10:10.330875 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c3ef2c2d-c556-439c-872c-c3e48ae34a71-combined-ca-bundle\") pod \"c3ef2c2d-c556-439c-872c-c3e48ae34a71\" (UID: \"c3ef2c2d-c556-439c-872c-c3e48ae34a71\") " Mar 16 17:10:10 crc kubenswrapper[5120]: I0316 17:10:10.330931 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c3ef2c2d-c556-439c-872c-c3e48ae34a71-run-httpd\") pod \"c3ef2c2d-c556-439c-872c-c3e48ae34a71\" (UID: \"c3ef2c2d-c556-439c-872c-c3e48ae34a71\") " Mar 16 17:10:10 crc kubenswrapper[5120]: I0316 17:10:10.330595 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3ef2c2d-c556-439c-872c-c3e48ae34a71-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "c3ef2c2d-c556-439c-872c-c3e48ae34a71" (UID: "c3ef2c2d-c556-439c-872c-c3e48ae34a71"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:10:10 crc kubenswrapper[5120]: I0316 17:10:10.331200 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3ef2c2d-c556-439c-872c-c3e48ae34a71-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "c3ef2c2d-c556-439c-872c-c3e48ae34a71" (UID: "c3ef2c2d-c556-439c-872c-c3e48ae34a71"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:10:10 crc kubenswrapper[5120]: I0316 17:10:10.331891 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c3ef2c2d-c556-439c-872c-c3e48ae34a71-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 17:10:10 crc kubenswrapper[5120]: I0316 17:10:10.331915 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c3ef2c2d-c556-439c-872c-c3e48ae34a71-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 17:10:10 crc kubenswrapper[5120]: I0316 17:10:10.343010 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3ef2c2d-c556-439c-872c-c3e48ae34a71-etc-swift" (OuterVolumeSpecName: "etc-swift") pod "c3ef2c2d-c556-439c-872c-c3e48ae34a71" (UID: "c3ef2c2d-c556-439c-872c-c3e48ae34a71"). InnerVolumeSpecName "etc-swift". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:10:10 crc kubenswrapper[5120]: I0316 17:10:10.343070 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3ef2c2d-c556-439c-872c-c3e48ae34a71-kube-api-access-whn4q" (OuterVolumeSpecName: "kube-api-access-whn4q") pod "c3ef2c2d-c556-439c-872c-c3e48ae34a71" (UID: "c3ef2c2d-c556-439c-872c-c3e48ae34a71"). InnerVolumeSpecName "kube-api-access-whn4q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:10:10 crc kubenswrapper[5120]: I0316 17:10:10.398881 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c3ef2c2d-c556-439c-872c-c3e48ae34a71-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "c3ef2c2d-c556-439c-872c-c3e48ae34a71" (UID: "c3ef2c2d-c556-439c-872c-c3e48ae34a71"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:10:10 crc kubenswrapper[5120]: I0316 17:10:10.412776 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c3ef2c2d-c556-439c-872c-c3e48ae34a71-config-data" (OuterVolumeSpecName: "config-data") pod "c3ef2c2d-c556-439c-872c-c3e48ae34a71" (UID: "c3ef2c2d-c556-439c-872c-c3e48ae34a71"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:10:10 crc kubenswrapper[5120]: I0316 17:10:10.413897 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c3ef2c2d-c556-439c-872c-c3e48ae34a71-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "c3ef2c2d-c556-439c-872c-c3e48ae34a71" (UID: "c3ef2c2d-c556-439c-872c-c3e48ae34a71"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:10:10 crc kubenswrapper[5120]: I0316 17:10:10.418923 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c3ef2c2d-c556-439c-872c-c3e48ae34a71-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "c3ef2c2d-c556-439c-872c-c3e48ae34a71" (UID: "c3ef2c2d-c556-439c-872c-c3e48ae34a71"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:10:10 crc kubenswrapper[5120]: I0316 17:10:10.435418 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c3ef2c2d-c556-439c-872c-c3e48ae34a71-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:10:10 crc kubenswrapper[5120]: I0316 17:10:10.435601 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/c3ef2c2d-c556-439c-872c-c3e48ae34a71-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:10:10 crc kubenswrapper[5120]: I0316 17:10:10.435753 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-whn4q\" (UniqueName: \"kubernetes.io/projected/c3ef2c2d-c556-439c-872c-c3e48ae34a71-kube-api-access-whn4q\") on node \"crc\" DevicePath \"\"" Mar 16 17:10:10 crc kubenswrapper[5120]: I0316 17:10:10.435909 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/c3ef2c2d-c556-439c-872c-c3e48ae34a71-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:10:10 crc kubenswrapper[5120]: I0316 17:10:10.435922 5120 reconciler_common.go:299] "Volume detached for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/c3ef2c2d-c556-439c-872c-c3e48ae34a71-etc-swift\") on node \"crc\" DevicePath \"\"" Mar 16 17:10:10 crc kubenswrapper[5120]: I0316 17:10:10.435930 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c3ef2c2d-c556-439c-872c-c3e48ae34a71-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:10:11 crc kubenswrapper[5120]: I0316 17:10:11.162135 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-664c964b6d-gxvmn" Mar 16 17:10:11 crc kubenswrapper[5120]: I0316 17:10:11.162164 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-664c964b6d-gxvmn" event={"ID":"c3ef2c2d-c556-439c-872c-c3e48ae34a71","Type":"ContainerDied","Data":"78e33624e40e941cd2cfd1aa9e8f0c80b64d5832dd2b2eeda8eccfdd956f6bc3"} Mar 16 17:10:11 crc kubenswrapper[5120]: I0316 17:10:11.162255 5120 scope.go:117] "RemoveContainer" containerID="d80bc6369582c9774af68162d0f737c52bccd453f9b816c7e22bb11292caf25b" Mar 16 17:10:11 crc kubenswrapper[5120]: I0316 17:10:11.167294 5120 generic.go:358] "Generic (PLEG): container finished" podID="edef0e3b-1367-4f3e-a5af-77c4bfce7483" containerID="6e290ffcfc5bb5d5a4b34b1aa1f42c03f89a84b6dc27bf2d4c7d290a9b8d588c" exitCode=0 Mar 16 17:10:11 crc kubenswrapper[5120]: I0316 17:10:11.167380 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"edef0e3b-1367-4f3e-a5af-77c4bfce7483","Type":"ContainerDied","Data":"6e290ffcfc5bb5d5a4b34b1aa1f42c03f89a84b6dc27bf2d4c7d290a9b8d588c"} Mar 16 17:10:11 crc kubenswrapper[5120]: I0316 17:10:11.205315 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-proxy-664c964b6d-gxvmn"] Mar 16 17:10:11 crc kubenswrapper[5120]: I0316 17:10:11.214093 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/swift-proxy-664c964b6d-gxvmn"] Mar 16 17:10:11 crc kubenswrapper[5120]: I0316 17:10:11.241302 5120 scope.go:117] "RemoveContainer" containerID="e4a1d46ba0e623133a190ddcb429fda2afa213c8683a469a7e30d5d5d4fcddfb" Mar 16 17:10:11 crc kubenswrapper[5120]: I0316 17:10:11.244163 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:10:11 crc kubenswrapper[5120]: I0316 17:10:11.366694 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/edef0e3b-1367-4f3e-a5af-77c4bfce7483-config-data\") pod \"edef0e3b-1367-4f3e-a5af-77c4bfce7483\" (UID: \"edef0e3b-1367-4f3e-a5af-77c4bfce7483\") " Mar 16 17:10:11 crc kubenswrapper[5120]: I0316 17:10:11.366790 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6khjh\" (UniqueName: \"kubernetes.io/projected/edef0e3b-1367-4f3e-a5af-77c4bfce7483-kube-api-access-6khjh\") pod \"edef0e3b-1367-4f3e-a5af-77c4bfce7483\" (UID: \"edef0e3b-1367-4f3e-a5af-77c4bfce7483\") " Mar 16 17:10:11 crc kubenswrapper[5120]: I0316 17:10:11.366914 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/edef0e3b-1367-4f3e-a5af-77c4bfce7483-run-httpd\") pod \"edef0e3b-1367-4f3e-a5af-77c4bfce7483\" (UID: \"edef0e3b-1367-4f3e-a5af-77c4bfce7483\") " Mar 16 17:10:11 crc kubenswrapper[5120]: I0316 17:10:11.367202 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/edef0e3b-1367-4f3e-a5af-77c4bfce7483-log-httpd\") pod \"edef0e3b-1367-4f3e-a5af-77c4bfce7483\" (UID: \"edef0e3b-1367-4f3e-a5af-77c4bfce7483\") " Mar 16 17:10:11 crc kubenswrapper[5120]: I0316 17:10:11.367258 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/edef0e3b-1367-4f3e-a5af-77c4bfce7483-combined-ca-bundle\") pod \"edef0e3b-1367-4f3e-a5af-77c4bfce7483\" (UID: \"edef0e3b-1367-4f3e-a5af-77c4bfce7483\") " Mar 16 17:10:11 crc kubenswrapper[5120]: I0316 17:10:11.367486 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/edef0e3b-1367-4f3e-a5af-77c4bfce7483-sg-core-conf-yaml\") pod \"edef0e3b-1367-4f3e-a5af-77c4bfce7483\" (UID: \"edef0e3b-1367-4f3e-a5af-77c4bfce7483\") " Mar 16 17:10:11 crc kubenswrapper[5120]: I0316 17:10:11.367524 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/edef0e3b-1367-4f3e-a5af-77c4bfce7483-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "edef0e3b-1367-4f3e-a5af-77c4bfce7483" (UID: "edef0e3b-1367-4f3e-a5af-77c4bfce7483"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:10:11 crc kubenswrapper[5120]: I0316 17:10:11.367617 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/edef0e3b-1367-4f3e-a5af-77c4bfce7483-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "edef0e3b-1367-4f3e-a5af-77c4bfce7483" (UID: "edef0e3b-1367-4f3e-a5af-77c4bfce7483"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:10:11 crc kubenswrapper[5120]: I0316 17:10:11.367677 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/edef0e3b-1367-4f3e-a5af-77c4bfce7483-scripts\") pod \"edef0e3b-1367-4f3e-a5af-77c4bfce7483\" (UID: \"edef0e3b-1367-4f3e-a5af-77c4bfce7483\") " Mar 16 17:10:11 crc kubenswrapper[5120]: I0316 17:10:11.367708 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/edef0e3b-1367-4f3e-a5af-77c4bfce7483-ceilometer-tls-certs\") pod \"edef0e3b-1367-4f3e-a5af-77c4bfce7483\" (UID: \"edef0e3b-1367-4f3e-a5af-77c4bfce7483\") " Mar 16 17:10:11 crc kubenswrapper[5120]: I0316 17:10:11.368781 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/edef0e3b-1367-4f3e-a5af-77c4bfce7483-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 17:10:11 crc kubenswrapper[5120]: I0316 17:10:11.368805 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/edef0e3b-1367-4f3e-a5af-77c4bfce7483-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 17:10:11 crc kubenswrapper[5120]: I0316 17:10:11.375932 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/edef0e3b-1367-4f3e-a5af-77c4bfce7483-scripts" (OuterVolumeSpecName: "scripts") pod "edef0e3b-1367-4f3e-a5af-77c4bfce7483" (UID: "edef0e3b-1367-4f3e-a5af-77c4bfce7483"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:10:11 crc kubenswrapper[5120]: I0316 17:10:11.375995 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/edef0e3b-1367-4f3e-a5af-77c4bfce7483-kube-api-access-6khjh" (OuterVolumeSpecName: "kube-api-access-6khjh") pod "edef0e3b-1367-4f3e-a5af-77c4bfce7483" (UID: "edef0e3b-1367-4f3e-a5af-77c4bfce7483"). InnerVolumeSpecName "kube-api-access-6khjh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:10:11 crc kubenswrapper[5120]: I0316 17:10:11.401074 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/edef0e3b-1367-4f3e-a5af-77c4bfce7483-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "edef0e3b-1367-4f3e-a5af-77c4bfce7483" (UID: "edef0e3b-1367-4f3e-a5af-77c4bfce7483"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:10:11 crc kubenswrapper[5120]: I0316 17:10:11.450355 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/edef0e3b-1367-4f3e-a5af-77c4bfce7483-ceilometer-tls-certs" (OuterVolumeSpecName: "ceilometer-tls-certs") pod "edef0e3b-1367-4f3e-a5af-77c4bfce7483" (UID: "edef0e3b-1367-4f3e-a5af-77c4bfce7483"). InnerVolumeSpecName "ceilometer-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:10:11 crc kubenswrapper[5120]: I0316 17:10:11.459651 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/edef0e3b-1367-4f3e-a5af-77c4bfce7483-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "edef0e3b-1367-4f3e-a5af-77c4bfce7483" (UID: "edef0e3b-1367-4f3e-a5af-77c4bfce7483"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:10:11 crc kubenswrapper[5120]: I0316 17:10:11.471175 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/edef0e3b-1367-4f3e-a5af-77c4bfce7483-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:10:11 crc kubenswrapper[5120]: I0316 17:10:11.471356 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/edef0e3b-1367-4f3e-a5af-77c4bfce7483-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 17:10:11 crc kubenswrapper[5120]: I0316 17:10:11.471450 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/edef0e3b-1367-4f3e-a5af-77c4bfce7483-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:10:11 crc kubenswrapper[5120]: I0316 17:10:11.471577 5120 reconciler_common.go:299] "Volume detached for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/edef0e3b-1367-4f3e-a5af-77c4bfce7483-ceilometer-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:10:11 crc kubenswrapper[5120]: I0316 17:10:11.471665 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6khjh\" (UniqueName: \"kubernetes.io/projected/edef0e3b-1367-4f3e-a5af-77c4bfce7483-kube-api-access-6khjh\") on node \"crc\" DevicePath \"\"" Mar 16 17:10:11 crc kubenswrapper[5120]: I0316 17:10:11.490233 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/edef0e3b-1367-4f3e-a5af-77c4bfce7483-config-data" (OuterVolumeSpecName: "config-data") pod "edef0e3b-1367-4f3e-a5af-77c4bfce7483" (UID: "edef0e3b-1367-4f3e-a5af-77c4bfce7483"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:10:11 crc kubenswrapper[5120]: I0316 17:10:11.574632 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/edef0e3b-1367-4f3e-a5af-77c4bfce7483-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:10:12 crc kubenswrapper[5120]: I0316 17:10:12.185485 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:10:12 crc kubenswrapper[5120]: I0316 17:10:12.185607 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"edef0e3b-1367-4f3e-a5af-77c4bfce7483","Type":"ContainerDied","Data":"435e49da57c47fbe57dee77ea0378ff7b66119fcdf6328b7f18e3ef8ba67e791"} Mar 16 17:10:12 crc kubenswrapper[5120]: I0316 17:10:12.185666 5120 scope.go:117] "RemoveContainer" containerID="8f8d213298eb5552fca66ea12a52c41b450ddef3a7cd08f155fbd3af417ec011" Mar 16 17:10:12 crc kubenswrapper[5120]: I0316 17:10:12.212929 5120 scope.go:117] "RemoveContainer" containerID="48e28f7239935ac43d1ec72a4197d39ff84aa16d95872ccbf9d1d5d3c7927029" Mar 16 17:10:12 crc kubenswrapper[5120]: I0316 17:10:12.230759 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:10:12 crc kubenswrapper[5120]: I0316 17:10:12.238049 5120 scope.go:117] "RemoveContainer" containerID="1d3f8bf1484d333d4c3f8d3ba0f318fd944c6b05df9a3aa624b59cafa40a7651" Mar 16 17:10:12 crc kubenswrapper[5120]: I0316 17:10:12.255693 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:10:12 crc kubenswrapper[5120]: I0316 17:10:12.264480 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:10:12 crc kubenswrapper[5120]: I0316 17:10:12.265739 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="edef0e3b-1367-4f3e-a5af-77c4bfce7483" containerName="sg-core" Mar 16 17:10:12 crc kubenswrapper[5120]: I0316 17:10:12.265776 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="edef0e3b-1367-4f3e-a5af-77c4bfce7483" containerName="sg-core" Mar 16 17:10:12 crc kubenswrapper[5120]: I0316 17:10:12.265796 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="edef0e3b-1367-4f3e-a5af-77c4bfce7483" containerName="ceilometer-notification-agent" Mar 16 17:10:12 crc kubenswrapper[5120]: I0316 17:10:12.265802 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="edef0e3b-1367-4f3e-a5af-77c4bfce7483" containerName="ceilometer-notification-agent" Mar 16 17:10:12 crc kubenswrapper[5120]: I0316 17:10:12.265812 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="edef0e3b-1367-4f3e-a5af-77c4bfce7483" containerName="ceilometer-central-agent" Mar 16 17:10:12 crc kubenswrapper[5120]: I0316 17:10:12.265818 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="edef0e3b-1367-4f3e-a5af-77c4bfce7483" containerName="ceilometer-central-agent" Mar 16 17:10:12 crc kubenswrapper[5120]: I0316 17:10:12.265825 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3ef2c2d-c556-439c-872c-c3e48ae34a71" containerName="proxy-server" Mar 16 17:10:12 crc kubenswrapper[5120]: I0316 17:10:12.265830 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3ef2c2d-c556-439c-872c-c3e48ae34a71" containerName="proxy-server" Mar 16 17:10:12 crc kubenswrapper[5120]: I0316 17:10:12.265853 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3ef2c2d-c556-439c-872c-c3e48ae34a71" containerName="proxy-httpd" Mar 16 17:10:12 crc kubenswrapper[5120]: I0316 17:10:12.265859 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3ef2c2d-c556-439c-872c-c3e48ae34a71" containerName="proxy-httpd" Mar 16 17:10:12 crc kubenswrapper[5120]: I0316 17:10:12.265880 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36c840f9-b8cf-4aff-b328-7710c04683ad" containerName="oc" Mar 16 17:10:12 crc kubenswrapper[5120]: I0316 17:10:12.265885 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="36c840f9-b8cf-4aff-b328-7710c04683ad" containerName="oc" Mar 16 17:10:12 crc kubenswrapper[5120]: I0316 17:10:12.265898 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="edef0e3b-1367-4f3e-a5af-77c4bfce7483" containerName="proxy-httpd" Mar 16 17:10:12 crc kubenswrapper[5120]: I0316 17:10:12.265903 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="edef0e3b-1367-4f3e-a5af-77c4bfce7483" containerName="proxy-httpd" Mar 16 17:10:12 crc kubenswrapper[5120]: I0316 17:10:12.266055 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="edef0e3b-1367-4f3e-a5af-77c4bfce7483" containerName="ceilometer-notification-agent" Mar 16 17:10:12 crc kubenswrapper[5120]: I0316 17:10:12.266066 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c3ef2c2d-c556-439c-872c-c3e48ae34a71" containerName="proxy-server" Mar 16 17:10:12 crc kubenswrapper[5120]: I0316 17:10:12.266077 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="36c840f9-b8cf-4aff-b328-7710c04683ad" containerName="oc" Mar 16 17:10:12 crc kubenswrapper[5120]: I0316 17:10:12.266087 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c3ef2c2d-c556-439c-872c-c3e48ae34a71" containerName="proxy-httpd" Mar 16 17:10:12 crc kubenswrapper[5120]: I0316 17:10:12.266098 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="edef0e3b-1367-4f3e-a5af-77c4bfce7483" containerName="ceilometer-central-agent" Mar 16 17:10:12 crc kubenswrapper[5120]: I0316 17:10:12.266108 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="edef0e3b-1367-4f3e-a5af-77c4bfce7483" containerName="proxy-httpd" Mar 16 17:10:12 crc kubenswrapper[5120]: I0316 17:10:12.266119 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="edef0e3b-1367-4f3e-a5af-77c4bfce7483" containerName="sg-core" Mar 16 17:10:12 crc kubenswrapper[5120]: I0316 17:10:12.283891 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:10:12 crc kubenswrapper[5120]: I0316 17:10:12.286570 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 17:10:12 crc kubenswrapper[5120]: I0316 17:10:12.286845 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ceilometer-internal-svc\"" Mar 16 17:10:12 crc kubenswrapper[5120]: I0316 17:10:12.291857 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 17:10:12 crc kubenswrapper[5120]: I0316 17:10:12.296154 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:10:12 crc kubenswrapper[5120]: I0316 17:10:12.313851 5120 scope.go:117] "RemoveContainer" containerID="6e290ffcfc5bb5d5a4b34b1aa1f42c03f89a84b6dc27bf2d4c7d290a9b8d588c" Mar 16 17:10:12 crc kubenswrapper[5120]: I0316 17:10:12.398221 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/20d69ce8-08cb-4036-9537-ee82df795777-log-httpd\") pod \"ceilometer-0\" (UID: \"20d69ce8-08cb-4036-9537-ee82df795777\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:10:12 crc kubenswrapper[5120]: I0316 17:10:12.398395 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/20d69ce8-08cb-4036-9537-ee82df795777-config-data\") pod \"ceilometer-0\" (UID: \"20d69ce8-08cb-4036-9537-ee82df795777\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:10:12 crc kubenswrapper[5120]: I0316 17:10:12.398443 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/20d69ce8-08cb-4036-9537-ee82df795777-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"20d69ce8-08cb-4036-9537-ee82df795777\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:10:12 crc kubenswrapper[5120]: I0316 17:10:12.398480 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/20d69ce8-08cb-4036-9537-ee82df795777-run-httpd\") pod \"ceilometer-0\" (UID: \"20d69ce8-08cb-4036-9537-ee82df795777\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:10:12 crc kubenswrapper[5120]: I0316 17:10:12.398528 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxcvh\" (UniqueName: \"kubernetes.io/projected/20d69ce8-08cb-4036-9537-ee82df795777-kube-api-access-wxcvh\") pod \"ceilometer-0\" (UID: \"20d69ce8-08cb-4036-9537-ee82df795777\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:10:12 crc kubenswrapper[5120]: I0316 17:10:12.399272 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/20d69ce8-08cb-4036-9537-ee82df795777-scripts\") pod \"ceilometer-0\" (UID: \"20d69ce8-08cb-4036-9537-ee82df795777\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:10:12 crc kubenswrapper[5120]: I0316 17:10:12.399354 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/20d69ce8-08cb-4036-9537-ee82df795777-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"20d69ce8-08cb-4036-9537-ee82df795777\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:10:12 crc kubenswrapper[5120]: I0316 17:10:12.399434 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/20d69ce8-08cb-4036-9537-ee82df795777-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"20d69ce8-08cb-4036-9537-ee82df795777\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:10:12 crc kubenswrapper[5120]: I0316 17:10:12.502409 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/20d69ce8-08cb-4036-9537-ee82df795777-scripts\") pod \"ceilometer-0\" (UID: \"20d69ce8-08cb-4036-9537-ee82df795777\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:10:12 crc kubenswrapper[5120]: I0316 17:10:12.502806 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/20d69ce8-08cb-4036-9537-ee82df795777-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"20d69ce8-08cb-4036-9537-ee82df795777\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:10:12 crc kubenswrapper[5120]: I0316 17:10:12.502854 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/20d69ce8-08cb-4036-9537-ee82df795777-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"20d69ce8-08cb-4036-9537-ee82df795777\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:10:12 crc kubenswrapper[5120]: I0316 17:10:12.502918 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/20d69ce8-08cb-4036-9537-ee82df795777-log-httpd\") pod \"ceilometer-0\" (UID: \"20d69ce8-08cb-4036-9537-ee82df795777\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:10:12 crc kubenswrapper[5120]: I0316 17:10:12.503086 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/20d69ce8-08cb-4036-9537-ee82df795777-config-data\") pod \"ceilometer-0\" (UID: \"20d69ce8-08cb-4036-9537-ee82df795777\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:10:12 crc kubenswrapper[5120]: I0316 17:10:12.503138 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/20d69ce8-08cb-4036-9537-ee82df795777-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"20d69ce8-08cb-4036-9537-ee82df795777\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:10:12 crc kubenswrapper[5120]: I0316 17:10:12.503219 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/20d69ce8-08cb-4036-9537-ee82df795777-run-httpd\") pod \"ceilometer-0\" (UID: \"20d69ce8-08cb-4036-9537-ee82df795777\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:10:12 crc kubenswrapper[5120]: I0316 17:10:12.503602 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/20d69ce8-08cb-4036-9537-ee82df795777-log-httpd\") pod \"ceilometer-0\" (UID: \"20d69ce8-08cb-4036-9537-ee82df795777\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:10:12 crc kubenswrapper[5120]: I0316 17:10:12.503623 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/20d69ce8-08cb-4036-9537-ee82df795777-run-httpd\") pod \"ceilometer-0\" (UID: \"20d69ce8-08cb-4036-9537-ee82df795777\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:10:12 crc kubenswrapper[5120]: I0316 17:10:12.503931 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wxcvh\" (UniqueName: \"kubernetes.io/projected/20d69ce8-08cb-4036-9537-ee82df795777-kube-api-access-wxcvh\") pod \"ceilometer-0\" (UID: \"20d69ce8-08cb-4036-9537-ee82df795777\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:10:12 crc kubenswrapper[5120]: I0316 17:10:12.507590 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/20d69ce8-08cb-4036-9537-ee82df795777-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"20d69ce8-08cb-4036-9537-ee82df795777\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:10:12 crc kubenswrapper[5120]: I0316 17:10:12.507591 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/20d69ce8-08cb-4036-9537-ee82df795777-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"20d69ce8-08cb-4036-9537-ee82df795777\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:10:12 crc kubenswrapper[5120]: I0316 17:10:12.509073 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/20d69ce8-08cb-4036-9537-ee82df795777-scripts\") pod \"ceilometer-0\" (UID: \"20d69ce8-08cb-4036-9537-ee82df795777\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:10:12 crc kubenswrapper[5120]: I0316 17:10:12.510006 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/20d69ce8-08cb-4036-9537-ee82df795777-config-data\") pod \"ceilometer-0\" (UID: \"20d69ce8-08cb-4036-9537-ee82df795777\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:10:12 crc kubenswrapper[5120]: I0316 17:10:12.511876 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/20d69ce8-08cb-4036-9537-ee82df795777-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"20d69ce8-08cb-4036-9537-ee82df795777\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:10:12 crc kubenswrapper[5120]: I0316 17:10:12.524176 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxcvh\" (UniqueName: \"kubernetes.io/projected/20d69ce8-08cb-4036-9537-ee82df795777-kube-api-access-wxcvh\") pod \"ceilometer-0\" (UID: \"20d69ce8-08cb-4036-9537-ee82df795777\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:10:12 crc kubenswrapper[5120]: I0316 17:10:12.547143 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:10:12 crc kubenswrapper[5120]: I0316 17:10:12.605716 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:10:12 crc kubenswrapper[5120]: I0316 17:10:12.679202 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c3ef2c2d-c556-439c-872c-c3e48ae34a71" path="/var/lib/kubelet/pods/c3ef2c2d-c556-439c-872c-c3e48ae34a71/volumes" Mar 16 17:10:12 crc kubenswrapper[5120]: I0316 17:10:12.680324 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="edef0e3b-1367-4f3e-a5af-77c4bfce7483" path="/var/lib/kubelet/pods/edef0e3b-1367-4f3e-a5af-77c4bfce7483/volumes" Mar 16 17:10:13 crc kubenswrapper[5120]: I0316 17:10:13.088597 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:10:13 crc kubenswrapper[5120]: W0316 17:10:13.090161 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod20d69ce8_08cb_4036_9537_ee82df795777.slice/crio-b7133332a4a321b6530d4d4946303a7e0bf57b0d0b428bc5d15901b22fb33d53 WatchSource:0}: Error finding container b7133332a4a321b6530d4d4946303a7e0bf57b0d0b428bc5d15901b22fb33d53: Status 404 returned error can't find the container with id b7133332a4a321b6530d4d4946303a7e0bf57b0d0b428bc5d15901b22fb33d53 Mar 16 17:10:13 crc kubenswrapper[5120]: I0316 17:10:13.203595 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"20d69ce8-08cb-4036-9537-ee82df795777","Type":"ContainerStarted","Data":"b7133332a4a321b6530d4d4946303a7e0bf57b0d0b428bc5d15901b22fb33d53"} Mar 16 17:10:14 crc kubenswrapper[5120]: I0316 17:10:14.216265 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"20d69ce8-08cb-4036-9537-ee82df795777","Type":"ContainerStarted","Data":"8ea5fa53ba53da2f8df0c5fe5630ab6fe1340d0e9e5454fd2daf2ed88e5284c3"} Mar 16 17:10:14 crc kubenswrapper[5120]: I0316 17:10:14.557160 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/placement-858ffc7d86-rq6st" Mar 16 17:10:14 crc kubenswrapper[5120]: I0316 17:10:14.664382 5120 scope.go:117] "RemoveContainer" containerID="c95c639838ab0891241eeaedc65582a42fe56eb64e08e9942cc764c9beef0e20" Mar 16 17:10:15 crc kubenswrapper[5120]: I0316 17:10:15.228749 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"9a997459-37ba-46a9-9cb8-075f77fa009f","Type":"ContainerStarted","Data":"5f0a1210752c571fbaca2dcbc5e5d9cf5e76f8f1d25ee4f7c4b2ade9932d7436"} Mar 16 17:10:15 crc kubenswrapper[5120]: I0316 17:10:15.229420 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 17:10:15 crc kubenswrapper[5120]: I0316 17:10:15.234208 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"20d69ce8-08cb-4036-9537-ee82df795777","Type":"ContainerStarted","Data":"190eefaa41770301d8094d2034f41290cb8b06d88ae11797bddb5c36b08e5075"} Mar 16 17:10:15 crc kubenswrapper[5120]: I0316 17:10:15.562871 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/placement-858ffc7d86-rq6st" Mar 16 17:10:15 crc kubenswrapper[5120]: I0316 17:10:15.640968 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-76c554b9b6-6szl6"] Mar 16 17:10:15 crc kubenswrapper[5120]: I0316 17:10:15.641243 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-76c554b9b6-6szl6" podUID="fccc0955-b4d6-488f-ae48-111ad10834ab" containerName="placement-log" containerID="cri-o://7abf5a6fafc6c51969fe53fdedc4a19b5eb7d795048b19a5a90cbc53b99fd23b" gracePeriod=30 Mar 16 17:10:15 crc kubenswrapper[5120]: I0316 17:10:15.643142 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-76c554b9b6-6szl6" podUID="fccc0955-b4d6-488f-ae48-111ad10834ab" containerName="placement-api" containerID="cri-o://90e5284168f77c3ac58e206d4b4e442855ec7c1ecb1ae74189deade63029f209" gracePeriod=30 Mar 16 17:10:16 crc kubenswrapper[5120]: I0316 17:10:16.247536 5120 generic.go:358] "Generic (PLEG): container finished" podID="fccc0955-b4d6-488f-ae48-111ad10834ab" containerID="7abf5a6fafc6c51969fe53fdedc4a19b5eb7d795048b19a5a90cbc53b99fd23b" exitCode=143 Mar 16 17:10:16 crc kubenswrapper[5120]: I0316 17:10:16.247651 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-76c554b9b6-6szl6" event={"ID":"fccc0955-b4d6-488f-ae48-111ad10834ab","Type":"ContainerDied","Data":"7abf5a6fafc6c51969fe53fdedc4a19b5eb7d795048b19a5a90cbc53b99fd23b"} Mar 16 17:10:16 crc kubenswrapper[5120]: I0316 17:10:16.250741 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"20d69ce8-08cb-4036-9537-ee82df795777","Type":"ContainerStarted","Data":"ed1f823e1481918cca7bdbd4ea81242468423c2660a6ebb3049cd622cc9e94c8"} Mar 16 17:10:16 crc kubenswrapper[5120]: I0316 17:10:16.664473 5120 scope.go:117] "RemoveContainer" containerID="c53e6084cd4784b416aa0905c6c812a19a8f42a1d13ab48bd906b62501da4219" Mar 16 17:10:16 crc kubenswrapper[5120]: I0316 17:10:16.710519 5120 scope.go:117] "RemoveContainer" containerID="bb08a4df642a778f0975079b5dcf2a213766a7068c8ac2b1c5b7b2eca73dc7e3" Mar 16 17:10:16 crc kubenswrapper[5120]: I0316 17:10:16.713878 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:10:16 crc kubenswrapper[5120]: I0316 17:10:16.747924 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:10:16 crc kubenswrapper[5120]: I0316 17:10:16.849969 5120 scope.go:117] "RemoveContainer" containerID="d8992622777e359a36bbb915f35144a1b6c0e1414ce53bc4cb034c1aed040645" Mar 16 17:10:17 crc kubenswrapper[5120]: I0316 17:10:17.262521 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"d0852906-6351-45a9-a44c-0bf3f4c29496","Type":"ContainerStarted","Data":"b4f2581124fb25de73fc35d6d1e068c0f8af119030bc9ac8f4b4c60b39198038"} Mar 16 17:10:17 crc kubenswrapper[5120]: I0316 17:10:17.263334 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 17:10:17 crc kubenswrapper[5120]: I0316 17:10:17.305299 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:10:17 crc kubenswrapper[5120]: I0316 17:10:17.665117 5120 scope.go:117] "RemoveContainer" containerID="db39d192fa687a13805537d08ad22fed1ef362ef5027c920a616297dc55a8ea9" Mar 16 17:10:17 crc kubenswrapper[5120]: E0316 17:10:17.665333 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 17:10:18 crc kubenswrapper[5120]: I0316 17:10:18.275433 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"20d69ce8-08cb-4036-9537-ee82df795777","Type":"ContainerStarted","Data":"51b07147fdbc2067c1ea52f1c6a60ec3678d5b78364f7d078f09ca7bdbd5c835"} Mar 16 17:10:18 crc kubenswrapper[5120]: I0316 17:10:18.276948 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:10:18 crc kubenswrapper[5120]: I0316 17:10:18.309475 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.085529769 podStartE2EDuration="6.309453083s" podCreationTimestamp="2026-03-16 17:10:12 +0000 UTC" firstStartedPulling="2026-03-16 17:10:13.091408621 +0000 UTC m=+5915.245340278" lastFinishedPulling="2026-03-16 17:10:17.315331935 +0000 UTC m=+5919.469263592" observedRunningTime="2026-03-16 17:10:18.296054036 +0000 UTC m=+5920.449985713" watchObservedRunningTime="2026-03-16 17:10:18.309453083 +0000 UTC m=+5920.463384740" Mar 16 17:10:19 crc kubenswrapper[5120]: I0316 17:10:19.250931 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-76c554b9b6-6szl6" Mar 16 17:10:19 crc kubenswrapper[5120]: I0316 17:10:19.288101 5120 generic.go:358] "Generic (PLEG): container finished" podID="fccc0955-b4d6-488f-ae48-111ad10834ab" containerID="90e5284168f77c3ac58e206d4b4e442855ec7c1ecb1ae74189deade63029f209" exitCode=0 Mar 16 17:10:19 crc kubenswrapper[5120]: I0316 17:10:19.288201 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-76c554b9b6-6szl6" Mar 16 17:10:19 crc kubenswrapper[5120]: I0316 17:10:19.288242 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-76c554b9b6-6szl6" event={"ID":"fccc0955-b4d6-488f-ae48-111ad10834ab","Type":"ContainerDied","Data":"90e5284168f77c3ac58e206d4b4e442855ec7c1ecb1ae74189deade63029f209"} Mar 16 17:10:19 crc kubenswrapper[5120]: I0316 17:10:19.288332 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-76c554b9b6-6szl6" event={"ID":"fccc0955-b4d6-488f-ae48-111ad10834ab","Type":"ContainerDied","Data":"3662dc514209f930277775d799abe9245c825b895dcf0cf030f559ffaadac52b"} Mar 16 17:10:19 crc kubenswrapper[5120]: I0316 17:10:19.288354 5120 scope.go:117] "RemoveContainer" containerID="90e5284168f77c3ac58e206d4b4e442855ec7c1ecb1ae74189deade63029f209" Mar 16 17:10:19 crc kubenswrapper[5120]: I0316 17:10:19.309977 5120 scope.go:117] "RemoveContainer" containerID="7abf5a6fafc6c51969fe53fdedc4a19b5eb7d795048b19a5a90cbc53b99fd23b" Mar 16 17:10:19 crc kubenswrapper[5120]: I0316 17:10:19.350705 5120 scope.go:117] "RemoveContainer" containerID="90e5284168f77c3ac58e206d4b4e442855ec7c1ecb1ae74189deade63029f209" Mar 16 17:10:19 crc kubenswrapper[5120]: E0316 17:10:19.352380 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"90e5284168f77c3ac58e206d4b4e442855ec7c1ecb1ae74189deade63029f209\": container with ID starting with 90e5284168f77c3ac58e206d4b4e442855ec7c1ecb1ae74189deade63029f209 not found: ID does not exist" containerID="90e5284168f77c3ac58e206d4b4e442855ec7c1ecb1ae74189deade63029f209" Mar 16 17:10:19 crc kubenswrapper[5120]: I0316 17:10:19.352438 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90e5284168f77c3ac58e206d4b4e442855ec7c1ecb1ae74189deade63029f209"} err="failed to get container status \"90e5284168f77c3ac58e206d4b4e442855ec7c1ecb1ae74189deade63029f209\": rpc error: code = NotFound desc = could not find container \"90e5284168f77c3ac58e206d4b4e442855ec7c1ecb1ae74189deade63029f209\": container with ID starting with 90e5284168f77c3ac58e206d4b4e442855ec7c1ecb1ae74189deade63029f209 not found: ID does not exist" Mar 16 17:10:19 crc kubenswrapper[5120]: I0316 17:10:19.352467 5120 scope.go:117] "RemoveContainer" containerID="7abf5a6fafc6c51969fe53fdedc4a19b5eb7d795048b19a5a90cbc53b99fd23b" Mar 16 17:10:19 crc kubenswrapper[5120]: E0316 17:10:19.352936 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7abf5a6fafc6c51969fe53fdedc4a19b5eb7d795048b19a5a90cbc53b99fd23b\": container with ID starting with 7abf5a6fafc6c51969fe53fdedc4a19b5eb7d795048b19a5a90cbc53b99fd23b not found: ID does not exist" containerID="7abf5a6fafc6c51969fe53fdedc4a19b5eb7d795048b19a5a90cbc53b99fd23b" Mar 16 17:10:19 crc kubenswrapper[5120]: I0316 17:10:19.352968 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7abf5a6fafc6c51969fe53fdedc4a19b5eb7d795048b19a5a90cbc53b99fd23b"} err="failed to get container status \"7abf5a6fafc6c51969fe53fdedc4a19b5eb7d795048b19a5a90cbc53b99fd23b\": rpc error: code = NotFound desc = could not find container \"7abf5a6fafc6c51969fe53fdedc4a19b5eb7d795048b19a5a90cbc53b99fd23b\": container with ID starting with 7abf5a6fafc6c51969fe53fdedc4a19b5eb7d795048b19a5a90cbc53b99fd23b not found: ID does not exist" Mar 16 17:10:19 crc kubenswrapper[5120]: I0316 17:10:19.408134 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/fccc0955-b4d6-488f-ae48-111ad10834ab-scripts\") pod \"fccc0955-b4d6-488f-ae48-111ad10834ab\" (UID: \"fccc0955-b4d6-488f-ae48-111ad10834ab\") " Mar 16 17:10:19 crc kubenswrapper[5120]: I0316 17:10:19.408468 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fccc0955-b4d6-488f-ae48-111ad10834ab-config-data\") pod \"fccc0955-b4d6-488f-ae48-111ad10834ab\" (UID: \"fccc0955-b4d6-488f-ae48-111ad10834ab\") " Mar 16 17:10:19 crc kubenswrapper[5120]: I0316 17:10:19.408595 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/fccc0955-b4d6-488f-ae48-111ad10834ab-public-tls-certs\") pod \"fccc0955-b4d6-488f-ae48-111ad10834ab\" (UID: \"fccc0955-b4d6-488f-ae48-111ad10834ab\") " Mar 16 17:10:19 crc kubenswrapper[5120]: I0316 17:10:19.409007 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dmh4w\" (UniqueName: \"kubernetes.io/projected/fccc0955-b4d6-488f-ae48-111ad10834ab-kube-api-access-dmh4w\") pod \"fccc0955-b4d6-488f-ae48-111ad10834ab\" (UID: \"fccc0955-b4d6-488f-ae48-111ad10834ab\") " Mar 16 17:10:19 crc kubenswrapper[5120]: I0316 17:10:19.409041 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/fccc0955-b4d6-488f-ae48-111ad10834ab-logs\") pod \"fccc0955-b4d6-488f-ae48-111ad10834ab\" (UID: \"fccc0955-b4d6-488f-ae48-111ad10834ab\") " Mar 16 17:10:19 crc kubenswrapper[5120]: I0316 17:10:19.409067 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/fccc0955-b4d6-488f-ae48-111ad10834ab-internal-tls-certs\") pod \"fccc0955-b4d6-488f-ae48-111ad10834ab\" (UID: \"fccc0955-b4d6-488f-ae48-111ad10834ab\") " Mar 16 17:10:19 crc kubenswrapper[5120]: I0316 17:10:19.409103 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fccc0955-b4d6-488f-ae48-111ad10834ab-combined-ca-bundle\") pod \"fccc0955-b4d6-488f-ae48-111ad10834ab\" (UID: \"fccc0955-b4d6-488f-ae48-111ad10834ab\") " Mar 16 17:10:19 crc kubenswrapper[5120]: I0316 17:10:19.411522 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fccc0955-b4d6-488f-ae48-111ad10834ab-logs" (OuterVolumeSpecName: "logs") pod "fccc0955-b4d6-488f-ae48-111ad10834ab" (UID: "fccc0955-b4d6-488f-ae48-111ad10834ab"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:10:19 crc kubenswrapper[5120]: I0316 17:10:19.429152 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fccc0955-b4d6-488f-ae48-111ad10834ab-scripts" (OuterVolumeSpecName: "scripts") pod "fccc0955-b4d6-488f-ae48-111ad10834ab" (UID: "fccc0955-b4d6-488f-ae48-111ad10834ab"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:10:19 crc kubenswrapper[5120]: I0316 17:10:19.440095 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fccc0955-b4d6-488f-ae48-111ad10834ab-kube-api-access-dmh4w" (OuterVolumeSpecName: "kube-api-access-dmh4w") pod "fccc0955-b4d6-488f-ae48-111ad10834ab" (UID: "fccc0955-b4d6-488f-ae48-111ad10834ab"). InnerVolumeSpecName "kube-api-access-dmh4w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:10:19 crc kubenswrapper[5120]: I0316 17:10:19.476455 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fccc0955-b4d6-488f-ae48-111ad10834ab-config-data" (OuterVolumeSpecName: "config-data") pod "fccc0955-b4d6-488f-ae48-111ad10834ab" (UID: "fccc0955-b4d6-488f-ae48-111ad10834ab"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:10:19 crc kubenswrapper[5120]: I0316 17:10:19.513575 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dmh4w\" (UniqueName: \"kubernetes.io/projected/fccc0955-b4d6-488f-ae48-111ad10834ab-kube-api-access-dmh4w\") on node \"crc\" DevicePath \"\"" Mar 16 17:10:19 crc kubenswrapper[5120]: I0316 17:10:19.513620 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/fccc0955-b4d6-488f-ae48-111ad10834ab-logs\") on node \"crc\" DevicePath \"\"" Mar 16 17:10:19 crc kubenswrapper[5120]: I0316 17:10:19.513634 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/fccc0955-b4d6-488f-ae48-111ad10834ab-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:10:19 crc kubenswrapper[5120]: I0316 17:10:19.513644 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fccc0955-b4d6-488f-ae48-111ad10834ab-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:10:19 crc kubenswrapper[5120]: I0316 17:10:19.533885 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fccc0955-b4d6-488f-ae48-111ad10834ab-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "fccc0955-b4d6-488f-ae48-111ad10834ab" (UID: "fccc0955-b4d6-488f-ae48-111ad10834ab"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:10:19 crc kubenswrapper[5120]: I0316 17:10:19.554845 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fccc0955-b4d6-488f-ae48-111ad10834ab-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "fccc0955-b4d6-488f-ae48-111ad10834ab" (UID: "fccc0955-b4d6-488f-ae48-111ad10834ab"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:10:19 crc kubenswrapper[5120]: I0316 17:10:19.556223 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fccc0955-b4d6-488f-ae48-111ad10834ab-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "fccc0955-b4d6-488f-ae48-111ad10834ab" (UID: "fccc0955-b4d6-488f-ae48-111ad10834ab"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:10:19 crc kubenswrapper[5120]: I0316 17:10:19.617654 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/fccc0955-b4d6-488f-ae48-111ad10834ab-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:10:19 crc kubenswrapper[5120]: I0316 17:10:19.617687 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/fccc0955-b4d6-488f-ae48-111ad10834ab-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:10:19 crc kubenswrapper[5120]: I0316 17:10:19.617700 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fccc0955-b4d6-488f-ae48-111ad10834ab-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:10:19 crc kubenswrapper[5120]: I0316 17:10:19.624406 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-76c554b9b6-6szl6"] Mar 16 17:10:19 crc kubenswrapper[5120]: I0316 17:10:19.633257 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-76c554b9b6-6szl6"] Mar 16 17:10:20 crc kubenswrapper[5120]: I0316 17:10:20.674752 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fccc0955-b4d6-488f-ae48-111ad10834ab" path="/var/lib/kubelet/pods/fccc0955-b4d6-488f-ae48-111ad10834ab/volumes" Mar 16 17:10:21 crc kubenswrapper[5120]: I0316 17:10:21.281572 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 17:10:23 crc kubenswrapper[5120]: I0316 17:10:23.354015 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 17:10:28 crc kubenswrapper[5120]: I0316 17:10:28.679898 5120 scope.go:117] "RemoveContainer" containerID="db39d192fa687a13805537d08ad22fed1ef362ef5027c920a616297dc55a8ea9" Mar 16 17:10:28 crc kubenswrapper[5120]: E0316 17:10:28.680989 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 17:10:31 crc kubenswrapper[5120]: I0316 17:10:31.038437 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/neutron-5bb4df7ffd-xw448" podUID="aadf64b4-9c41-4b13-be3a-4bb9172d06dd" containerName="neutron-httpd" probeResult="failure" output="Get \"https://10.217.1.180:9696/\": dial tcp 10.217.1.180:9696: connect: connection refused" Mar 16 17:10:36 crc kubenswrapper[5120]: I0316 17:10:36.992138 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-5bb4df7ffd-xw448_aadf64b4-9c41-4b13-be3a-4bb9172d06dd/neutron-api/0.log" Mar 16 17:10:36 crc kubenswrapper[5120]: I0316 17:10:36.992699 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-5bb4df7ffd-xw448" Mar 16 17:10:37 crc kubenswrapper[5120]: I0316 17:10:37.022488 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/aadf64b4-9c41-4b13-be3a-4bb9172d06dd-ovndb-tls-certs\") pod \"aadf64b4-9c41-4b13-be3a-4bb9172d06dd\" (UID: \"aadf64b4-9c41-4b13-be3a-4bb9172d06dd\") " Mar 16 17:10:37 crc kubenswrapper[5120]: I0316 17:10:37.022598 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-74m4f\" (UniqueName: \"kubernetes.io/projected/aadf64b4-9c41-4b13-be3a-4bb9172d06dd-kube-api-access-74m4f\") pod \"aadf64b4-9c41-4b13-be3a-4bb9172d06dd\" (UID: \"aadf64b4-9c41-4b13-be3a-4bb9172d06dd\") " Mar 16 17:10:37 crc kubenswrapper[5120]: I0316 17:10:37.022661 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/aadf64b4-9c41-4b13-be3a-4bb9172d06dd-public-tls-certs\") pod \"aadf64b4-9c41-4b13-be3a-4bb9172d06dd\" (UID: \"aadf64b4-9c41-4b13-be3a-4bb9172d06dd\") " Mar 16 17:10:37 crc kubenswrapper[5120]: I0316 17:10:37.022736 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/aadf64b4-9c41-4b13-be3a-4bb9172d06dd-combined-ca-bundle\") pod \"aadf64b4-9c41-4b13-be3a-4bb9172d06dd\" (UID: \"aadf64b4-9c41-4b13-be3a-4bb9172d06dd\") " Mar 16 17:10:37 crc kubenswrapper[5120]: I0316 17:10:37.022969 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/aadf64b4-9c41-4b13-be3a-4bb9172d06dd-httpd-config\") pod \"aadf64b4-9c41-4b13-be3a-4bb9172d06dd\" (UID: \"aadf64b4-9c41-4b13-be3a-4bb9172d06dd\") " Mar 16 17:10:37 crc kubenswrapper[5120]: I0316 17:10:37.023046 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/aadf64b4-9c41-4b13-be3a-4bb9172d06dd-internal-tls-certs\") pod \"aadf64b4-9c41-4b13-be3a-4bb9172d06dd\" (UID: \"aadf64b4-9c41-4b13-be3a-4bb9172d06dd\") " Mar 16 17:10:37 crc kubenswrapper[5120]: I0316 17:10:37.023120 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/aadf64b4-9c41-4b13-be3a-4bb9172d06dd-config\") pod \"aadf64b4-9c41-4b13-be3a-4bb9172d06dd\" (UID: \"aadf64b4-9c41-4b13-be3a-4bb9172d06dd\") " Mar 16 17:10:37 crc kubenswrapper[5120]: I0316 17:10:37.031141 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aadf64b4-9c41-4b13-be3a-4bb9172d06dd-httpd-config" (OuterVolumeSpecName: "httpd-config") pod "aadf64b4-9c41-4b13-be3a-4bb9172d06dd" (UID: "aadf64b4-9c41-4b13-be3a-4bb9172d06dd"). InnerVolumeSpecName "httpd-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:10:37 crc kubenswrapper[5120]: I0316 17:10:37.048070 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aadf64b4-9c41-4b13-be3a-4bb9172d06dd-kube-api-access-74m4f" (OuterVolumeSpecName: "kube-api-access-74m4f") pod "aadf64b4-9c41-4b13-be3a-4bb9172d06dd" (UID: "aadf64b4-9c41-4b13-be3a-4bb9172d06dd"). InnerVolumeSpecName "kube-api-access-74m4f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:10:37 crc kubenswrapper[5120]: I0316 17:10:37.091111 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aadf64b4-9c41-4b13-be3a-4bb9172d06dd-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "aadf64b4-9c41-4b13-be3a-4bb9172d06dd" (UID: "aadf64b4-9c41-4b13-be3a-4bb9172d06dd"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:10:37 crc kubenswrapper[5120]: I0316 17:10:37.091498 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aadf64b4-9c41-4b13-be3a-4bb9172d06dd-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "aadf64b4-9c41-4b13-be3a-4bb9172d06dd" (UID: "aadf64b4-9c41-4b13-be3a-4bb9172d06dd"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:10:37 crc kubenswrapper[5120]: I0316 17:10:37.094069 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aadf64b4-9c41-4b13-be3a-4bb9172d06dd-config" (OuterVolumeSpecName: "config") pod "aadf64b4-9c41-4b13-be3a-4bb9172d06dd" (UID: "aadf64b4-9c41-4b13-be3a-4bb9172d06dd"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:10:37 crc kubenswrapper[5120]: I0316 17:10:37.110871 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aadf64b4-9c41-4b13-be3a-4bb9172d06dd-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "aadf64b4-9c41-4b13-be3a-4bb9172d06dd" (UID: "aadf64b4-9c41-4b13-be3a-4bb9172d06dd"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:10:37 crc kubenswrapper[5120]: I0316 17:10:37.112287 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aadf64b4-9c41-4b13-be3a-4bb9172d06dd-ovndb-tls-certs" (OuterVolumeSpecName: "ovndb-tls-certs") pod "aadf64b4-9c41-4b13-be3a-4bb9172d06dd" (UID: "aadf64b4-9c41-4b13-be3a-4bb9172d06dd"). InnerVolumeSpecName "ovndb-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:10:37 crc kubenswrapper[5120]: I0316 17:10:37.127180 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-74m4f\" (UniqueName: \"kubernetes.io/projected/aadf64b4-9c41-4b13-be3a-4bb9172d06dd-kube-api-access-74m4f\") on node \"crc\" DevicePath \"\"" Mar 16 17:10:37 crc kubenswrapper[5120]: I0316 17:10:37.127238 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/aadf64b4-9c41-4b13-be3a-4bb9172d06dd-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:10:37 crc kubenswrapper[5120]: I0316 17:10:37.127251 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/aadf64b4-9c41-4b13-be3a-4bb9172d06dd-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:10:37 crc kubenswrapper[5120]: I0316 17:10:37.127262 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/aadf64b4-9c41-4b13-be3a-4bb9172d06dd-httpd-config\") on node \"crc\" DevicePath \"\"" Mar 16 17:10:37 crc kubenswrapper[5120]: I0316 17:10:37.127273 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/aadf64b4-9c41-4b13-be3a-4bb9172d06dd-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:10:37 crc kubenswrapper[5120]: I0316 17:10:37.127284 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/aadf64b4-9c41-4b13-be3a-4bb9172d06dd-config\") on node \"crc\" DevicePath \"\"" Mar 16 17:10:37 crc kubenswrapper[5120]: I0316 17:10:37.127293 5120 reconciler_common.go:299] "Volume detached for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/aadf64b4-9c41-4b13-be3a-4bb9172d06dd-ovndb-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:10:37 crc kubenswrapper[5120]: I0316 17:10:37.469839 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-5bb4df7ffd-xw448_aadf64b4-9c41-4b13-be3a-4bb9172d06dd/neutron-api/0.log" Mar 16 17:10:37 crc kubenswrapper[5120]: I0316 17:10:37.469900 5120 generic.go:358] "Generic (PLEG): container finished" podID="aadf64b4-9c41-4b13-be3a-4bb9172d06dd" containerID="56403faf32f68846ceae22cf5e25eefebe5388a2c426b29ce462eac8315a559e" exitCode=137 Mar 16 17:10:37 crc kubenswrapper[5120]: I0316 17:10:37.469965 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-5bb4df7ffd-xw448" Mar 16 17:10:37 crc kubenswrapper[5120]: I0316 17:10:37.470229 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-5bb4df7ffd-xw448" event={"ID":"aadf64b4-9c41-4b13-be3a-4bb9172d06dd","Type":"ContainerDied","Data":"56403faf32f68846ceae22cf5e25eefebe5388a2c426b29ce462eac8315a559e"} Mar 16 17:10:37 crc kubenswrapper[5120]: I0316 17:10:37.470261 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-5bb4df7ffd-xw448" event={"ID":"aadf64b4-9c41-4b13-be3a-4bb9172d06dd","Type":"ContainerDied","Data":"e889b6079176a26b38518263cbd9407b29fe9fbee04a202abc8bc8162dac1395"} Mar 16 17:10:37 crc kubenswrapper[5120]: I0316 17:10:37.470279 5120 scope.go:117] "RemoveContainer" containerID="eda1116ec9b84caf5116448411997d10e50f93eefcee581f8f9dab7d32c1efd2" Mar 16 17:10:37 crc kubenswrapper[5120]: I0316 17:10:37.492057 5120 scope.go:117] "RemoveContainer" containerID="56403faf32f68846ceae22cf5e25eefebe5388a2c426b29ce462eac8315a559e" Mar 16 17:10:37 crc kubenswrapper[5120]: I0316 17:10:37.510528 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-5bb4df7ffd-xw448"] Mar 16 17:10:37 crc kubenswrapper[5120]: I0316 17:10:37.515929 5120 scope.go:117] "RemoveContainer" containerID="eda1116ec9b84caf5116448411997d10e50f93eefcee581f8f9dab7d32c1efd2" Mar 16 17:10:37 crc kubenswrapper[5120]: E0316 17:10:37.517392 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eda1116ec9b84caf5116448411997d10e50f93eefcee581f8f9dab7d32c1efd2\": container with ID starting with eda1116ec9b84caf5116448411997d10e50f93eefcee581f8f9dab7d32c1efd2 not found: ID does not exist" containerID="eda1116ec9b84caf5116448411997d10e50f93eefcee581f8f9dab7d32c1efd2" Mar 16 17:10:37 crc kubenswrapper[5120]: I0316 17:10:37.517432 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eda1116ec9b84caf5116448411997d10e50f93eefcee581f8f9dab7d32c1efd2"} err="failed to get container status \"eda1116ec9b84caf5116448411997d10e50f93eefcee581f8f9dab7d32c1efd2\": rpc error: code = NotFound desc = could not find container \"eda1116ec9b84caf5116448411997d10e50f93eefcee581f8f9dab7d32c1efd2\": container with ID starting with eda1116ec9b84caf5116448411997d10e50f93eefcee581f8f9dab7d32c1efd2 not found: ID does not exist" Mar 16 17:10:37 crc kubenswrapper[5120]: I0316 17:10:37.517459 5120 scope.go:117] "RemoveContainer" containerID="56403faf32f68846ceae22cf5e25eefebe5388a2c426b29ce462eac8315a559e" Mar 16 17:10:37 crc kubenswrapper[5120]: E0316 17:10:37.518086 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"56403faf32f68846ceae22cf5e25eefebe5388a2c426b29ce462eac8315a559e\": container with ID starting with 56403faf32f68846ceae22cf5e25eefebe5388a2c426b29ce462eac8315a559e not found: ID does not exist" containerID="56403faf32f68846ceae22cf5e25eefebe5388a2c426b29ce462eac8315a559e" Mar 16 17:10:37 crc kubenswrapper[5120]: I0316 17:10:37.518177 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56403faf32f68846ceae22cf5e25eefebe5388a2c426b29ce462eac8315a559e"} err="failed to get container status \"56403faf32f68846ceae22cf5e25eefebe5388a2c426b29ce462eac8315a559e\": rpc error: code = NotFound desc = could not find container \"56403faf32f68846ceae22cf5e25eefebe5388a2c426b29ce462eac8315a559e\": container with ID starting with 56403faf32f68846ceae22cf5e25eefebe5388a2c426b29ce462eac8315a559e not found: ID does not exist" Mar 16 17:10:37 crc kubenswrapper[5120]: I0316 17:10:37.520407 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-5bb4df7ffd-xw448"] Mar 16 17:10:38 crc kubenswrapper[5120]: I0316 17:10:38.679408 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aadf64b4-9c41-4b13-be3a-4bb9172d06dd" path="/var/lib/kubelet/pods/aadf64b4-9c41-4b13-be3a-4bb9172d06dd/volumes" Mar 16 17:10:43 crc kubenswrapper[5120]: I0316 17:10:43.663588 5120 scope.go:117] "RemoveContainer" containerID="db39d192fa687a13805537d08ad22fed1ef362ef5027c920a616297dc55a8ea9" Mar 16 17:10:43 crc kubenswrapper[5120]: E0316 17:10:43.664363 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 17:10:50 crc kubenswrapper[5120]: I0316 17:10:50.314501 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:10:56 crc kubenswrapper[5120]: I0316 17:10:56.666283 5120 scope.go:117] "RemoveContainer" containerID="db39d192fa687a13805537d08ad22fed1ef362ef5027c920a616297dc55a8ea9" Mar 16 17:10:56 crc kubenswrapper[5120]: I0316 17:10:56.668540 5120 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Mar 16 17:10:57 crc kubenswrapper[5120]: I0316 17:10:57.716691 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" event={"ID":"e2275cb4-4905-4d66-a87e-8010120db2bd","Type":"ContainerStarted","Data":"75af251dd73a707ee66fa6a54cb0e7f3eed778d6679b855c53a50383854df1bd"} Mar 16 17:11:07 crc kubenswrapper[5120]: I0316 17:11:07.953410 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 17:11:07 crc kubenswrapper[5120]: I0316 17:11:07.954028 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/openstackclient" podUID="140a02f0-df36-49fb-b2bb-b267e350f5c5" containerName="openstackclient" containerID="cri-o://e2183bcba7b9ba237a63c8b8b38663b980601a86090e8c6ae375714527039f8d" gracePeriod=2 Mar 16 17:11:07 crc kubenswrapper[5120]: I0316 17:11:07.994677 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 17:11:08 crc kubenswrapper[5120]: I0316 17:11:08.126566 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 17:11:08 crc kubenswrapper[5120]: I0316 17:11:08.170836 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-34b5-account-create-update-qb955"] Mar 16 17:11:08 crc kubenswrapper[5120]: I0316 17:11:08.198829 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-34b5-account-create-update-qb955"] Mar 16 17:11:08 crc kubenswrapper[5120]: I0316 17:11:08.223288 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 17:11:08 crc kubenswrapper[5120]: I0316 17:11:08.224609 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podUID="6482e901-6b9d-4e99-b859-40ed46b549e1" containerName="openstack-network-exporter" containerID="cri-o://896a1fedb10dc78e3a5ec32e18c9e89730edd87bf0bf1ea066ac7fe083c294a2" gracePeriod=300 Mar 16 17:11:08 crc kubenswrapper[5120]: I0316 17:11:08.228937 5120 status_manager.go:895] "Failed to get status for pod" podUID="140a02f0-df36-49fb-b2bb-b267e350f5c5" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 17:11:08 crc kubenswrapper[5120]: I0316 17:11:08.276775 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-16fb-account-create-update-4lmvk"] Mar 16 17:11:08 crc kubenswrapper[5120]: I0316 17:11:08.325843 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-16fb-account-create-update-4lmvk"] Mar 16 17:11:08 crc kubenswrapper[5120]: I0316 17:11:08.636668 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 17:11:08 crc kubenswrapper[5120]: I0316 17:11:08.677591 5120 status_manager.go:895] "Failed to get status for pod" podUID="140a02f0-df36-49fb-b2bb-b267e350f5c5" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 17:11:08 crc kubenswrapper[5120]: I0316 17:11:08.731779 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1abe87e9-49d9-4da3-bfb2-e0aa5d891a71" path="/var/lib/kubelet/pods/1abe87e9-49d9-4da3-bfb2-e0aa5d891a71/volumes" Mar 16 17:11:08 crc kubenswrapper[5120]: I0316 17:11:08.732534 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="49651491-1f99-4112-8643-230b978a064d" path="/var/lib/kubelet/pods/49651491-1f99-4112-8643-230b978a064d/volumes" Mar 16 17:11:08 crc kubenswrapper[5120]: I0316 17:11:08.735746 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 17:11:08 crc kubenswrapper[5120]: I0316 17:11:08.736785 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovn-northd-0" podUID="45b8119e-70b5-45ad-9629-41a99f2f8ed0" containerName="ovn-northd" containerID="cri-o://c8b8353c7b4c0db1e4fca1851f4e10b0bf58243a8726401407c787fd457ff216" gracePeriod=30 Mar 16 17:11:08 crc kubenswrapper[5120]: I0316 17:11:08.737074 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovn-northd-0" podUID="45b8119e-70b5-45ad-9629-41a99f2f8ed0" containerName="openstack-network-exporter" containerID="cri-o://0f5d3fe3e143a4e70eb6ec298ec173e607da98d4085d398c54f81b39a2ff9614" gracePeriod=30 Mar 16 17:11:08 crc kubenswrapper[5120]: I0316 17:11:08.758044 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-64dd-account-create-update-t5j6r"] Mar 16 17:11:08 crc kubenswrapper[5120]: I0316 17:11:08.794304 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-34b5-account-create-update-l4fc7"] Mar 16 17:11:08 crc kubenswrapper[5120]: I0316 17:11:08.797265 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fccc0955-b4d6-488f-ae48-111ad10834ab" containerName="placement-log" Mar 16 17:11:08 crc kubenswrapper[5120]: I0316 17:11:08.797313 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="fccc0955-b4d6-488f-ae48-111ad10834ab" containerName="placement-log" Mar 16 17:11:08 crc kubenswrapper[5120]: I0316 17:11:08.797349 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aadf64b4-9c41-4b13-be3a-4bb9172d06dd" containerName="neutron-api" Mar 16 17:11:08 crc kubenswrapper[5120]: I0316 17:11:08.797357 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="aadf64b4-9c41-4b13-be3a-4bb9172d06dd" containerName="neutron-api" Mar 16 17:11:08 crc kubenswrapper[5120]: I0316 17:11:08.797424 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fccc0955-b4d6-488f-ae48-111ad10834ab" containerName="placement-api" Mar 16 17:11:08 crc kubenswrapper[5120]: I0316 17:11:08.797431 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="fccc0955-b4d6-488f-ae48-111ad10834ab" containerName="placement-api" Mar 16 17:11:08 crc kubenswrapper[5120]: I0316 17:11:08.797450 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="140a02f0-df36-49fb-b2bb-b267e350f5c5" containerName="openstackclient" Mar 16 17:11:08 crc kubenswrapper[5120]: I0316 17:11:08.797456 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="140a02f0-df36-49fb-b2bb-b267e350f5c5" containerName="openstackclient" Mar 16 17:11:08 crc kubenswrapper[5120]: I0316 17:11:08.797465 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aadf64b4-9c41-4b13-be3a-4bb9172d06dd" containerName="neutron-httpd" Mar 16 17:11:08 crc kubenswrapper[5120]: I0316 17:11:08.797473 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="aadf64b4-9c41-4b13-be3a-4bb9172d06dd" containerName="neutron-httpd" Mar 16 17:11:08 crc kubenswrapper[5120]: I0316 17:11:08.797766 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="fccc0955-b4d6-488f-ae48-111ad10834ab" containerName="placement-log" Mar 16 17:11:08 crc kubenswrapper[5120]: I0316 17:11:08.797787 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="140a02f0-df36-49fb-b2bb-b267e350f5c5" containerName="openstackclient" Mar 16 17:11:08 crc kubenswrapper[5120]: I0316 17:11:08.797801 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="fccc0955-b4d6-488f-ae48-111ad10834ab" containerName="placement-api" Mar 16 17:11:08 crc kubenswrapper[5120]: I0316 17:11:08.797819 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="aadf64b4-9c41-4b13-be3a-4bb9172d06dd" containerName="neutron-api" Mar 16 17:11:08 crc kubenswrapper[5120]: I0316 17:11:08.797848 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="aadf64b4-9c41-4b13-be3a-4bb9172d06dd" containerName="neutron-httpd" Mar 16 17:11:08 crc kubenswrapper[5120]: I0316 17:11:08.816932 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-34b5-account-create-update-l4fc7" Mar 16 17:11:08 crc kubenswrapper[5120]: I0316 17:11:08.817657 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podUID="6482e901-6b9d-4e99-b859-40ed46b549e1" containerName="ovsdbserver-sb" containerID="cri-o://c133cde2bb6de9540fd49f580d5a3c063dfae25ba05b7b2819f3fb0d3931f86a" gracePeriod=300 Mar 16 17:11:08 crc kubenswrapper[5120]: I0316 17:11:08.839329 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jdkt\" (UniqueName: \"kubernetes.io/projected/8ff3ccc4-2e31-4990-862a-98cbd428ae62-kube-api-access-6jdkt\") pod \"glance-34b5-account-create-update-l4fc7\" (UID: \"8ff3ccc4-2e31-4990-862a-98cbd428ae62\") " pod="openstack-kuttl-tests/glance-34b5-account-create-update-l4fc7" Mar 16 17:11:08 crc kubenswrapper[5120]: I0316 17:11:08.839614 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8ff3ccc4-2e31-4990-862a-98cbd428ae62-operator-scripts\") pod \"glance-34b5-account-create-update-l4fc7\" (UID: \"8ff3ccc4-2e31-4990-862a-98cbd428ae62\") " pod="openstack-kuttl-tests/glance-34b5-account-create-update-l4fc7" Mar 16 17:11:08 crc kubenswrapper[5120]: I0316 17:11:08.843416 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-db-secret\"" Mar 16 17:11:08 crc kubenswrapper[5120]: I0316 17:11:08.843832 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-64dd-account-create-update-t5j6r"] Mar 16 17:11:08 crc kubenswrapper[5120]: E0316 17:11:08.844043 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Mar 16 17:11:08 crc kubenswrapper[5120]: E0316 17:11:08.844174 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/259e8ab8-dfd3-414c-b392-951a9f770559-config-data podName:259e8ab8-dfd3-414c-b392-951a9f770559 nodeName:}" failed. No retries permitted until 2026-03-16 17:11:09.344155684 +0000 UTC m=+5971.498087341 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/259e8ab8-dfd3-414c-b392-951a9f770559-config-data") pod "rabbitmq-cell1-server-0" (UID: "259e8ab8-dfd3-414c-b392-951a9f770559") : configmap "rabbitmq-cell1-config-data" not found Mar 16 17:11:08 crc kubenswrapper[5120]: I0316 17:11:08.885414 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-qk75k"] Mar 16 17:11:08 crc kubenswrapper[5120]: I0316 17:11:08.942069 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6jdkt\" (UniqueName: \"kubernetes.io/projected/8ff3ccc4-2e31-4990-862a-98cbd428ae62-kube-api-access-6jdkt\") pod \"glance-34b5-account-create-update-l4fc7\" (UID: \"8ff3ccc4-2e31-4990-862a-98cbd428ae62\") " pod="openstack-kuttl-tests/glance-34b5-account-create-update-l4fc7" Mar 16 17:11:08 crc kubenswrapper[5120]: I0316 17:11:08.942455 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8ff3ccc4-2e31-4990-862a-98cbd428ae62-operator-scripts\") pod \"glance-34b5-account-create-update-l4fc7\" (UID: \"8ff3ccc4-2e31-4990-862a-98cbd428ae62\") " pod="openstack-kuttl-tests/glance-34b5-account-create-update-l4fc7" Mar 16 17:11:08 crc kubenswrapper[5120]: I0316 17:11:08.943295 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-34b5-account-create-update-l4fc7"] Mar 16 17:11:08 crc kubenswrapper[5120]: I0316 17:11:08.943580 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8ff3ccc4-2e31-4990-862a-98cbd428ae62-operator-scripts\") pod \"glance-34b5-account-create-update-l4fc7\" (UID: \"8ff3ccc4-2e31-4990-862a-98cbd428ae62\") " pod="openstack-kuttl-tests/glance-34b5-account-create-update-l4fc7" Mar 16 17:11:08 crc kubenswrapper[5120]: I0316 17:11:08.951550 5120 generic.go:358] "Generic (PLEG): container finished" podID="6482e901-6b9d-4e99-b859-40ed46b549e1" containerID="896a1fedb10dc78e3a5ec32e18c9e89730edd87bf0bf1ea066ac7fe083c294a2" exitCode=2 Mar 16 17:11:08 crc kubenswrapper[5120]: I0316 17:11:08.951739 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"6482e901-6b9d-4e99-b859-40ed46b549e1","Type":"ContainerDied","Data":"896a1fedb10dc78e3a5ec32e18c9e89730edd87bf0bf1ea066ac7fe083c294a2"} Mar 16 17:11:08 crc kubenswrapper[5120]: I0316 17:11:08.969838 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-qk75k"] Mar 16 17:11:09 crc kubenswrapper[5120]: I0316 17:11:09.016632 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-7ee8-account-create-update-8npng"] Mar 16 17:11:09 crc kubenswrapper[5120]: I0316 17:11:09.028054 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jdkt\" (UniqueName: \"kubernetes.io/projected/8ff3ccc4-2e31-4990-862a-98cbd428ae62-kube-api-access-6jdkt\") pod \"glance-34b5-account-create-update-l4fc7\" (UID: \"8ff3ccc4-2e31-4990-862a-98cbd428ae62\") " pod="openstack-kuttl-tests/glance-34b5-account-create-update-l4fc7" Mar 16 17:11:09 crc kubenswrapper[5120]: I0316 17:11:09.073502 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 17:11:09 crc kubenswrapper[5120]: I0316 17:11:09.073915 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podUID="fa8d6c88-cfc9-4ead-974d-005ae362769a" containerName="openstack-network-exporter" containerID="cri-o://48f695b820174f4434e930d86a102d88c95f5b423ba918f29f0e70dac0fe7545" gracePeriod=300 Mar 16 17:11:09 crc kubenswrapper[5120]: I0316 17:11:09.168858 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-7ee8-account-create-update-8npng"] Mar 16 17:11:09 crc kubenswrapper[5120]: I0316 17:11:09.221864 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-a4d9-account-create-update-wk6gm"] Mar 16 17:11:09 crc kubenswrapper[5120]: I0316 17:11:09.261397 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-34b5-account-create-update-l4fc7" Mar 16 17:11:09 crc kubenswrapper[5120]: I0316 17:11:09.463659 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-a4d9-account-create-update-wk6gm"] Mar 16 17:11:09 crc kubenswrapper[5120]: E0316 17:11:09.486046 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Mar 16 17:11:09 crc kubenswrapper[5120]: E0316 17:11:09.486166 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/259e8ab8-dfd3-414c-b392-951a9f770559-config-data podName:259e8ab8-dfd3-414c-b392-951a9f770559 nodeName:}" failed. No retries permitted until 2026-03-16 17:11:10.486137378 +0000 UTC m=+5972.640069035 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/259e8ab8-dfd3-414c-b392-951a9f770559-config-data") pod "rabbitmq-cell1-server-0" (UID: "259e8ab8-dfd3-414c-b392-951a9f770559") : configmap "rabbitmq-cell1-config-data" not found Mar 16 17:11:09 crc kubenswrapper[5120]: I0316 17:11:09.634085 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/root-account-create-update-74dg4"] Mar 16 17:11:09 crc kubenswrapper[5120]: I0316 17:11:09.649602 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-74dg4" Mar 16 17:11:09 crc kubenswrapper[5120]: I0316 17:11:09.661421 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"openstack-cell1-mariadb-root-db-secret\"" Mar 16 17:11:09 crc kubenswrapper[5120]: I0316 17:11:09.674711 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-fd2mn"] Mar 16 17:11:09 crc kubenswrapper[5120]: I0316 17:11:09.678483 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podUID="fa8d6c88-cfc9-4ead-974d-005ae362769a" containerName="ovsdbserver-nb" containerID="cri-o://1ffc97c292aa55c56c3a0b3eec9167bb3bdcfa607e015223082151d77e8b31c8" gracePeriod=300 Mar 16 17:11:09 crc kubenswrapper[5120]: I0316 17:11:09.713831 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-74dg4"] Mar 16 17:11:09 crc kubenswrapper[5120]: I0316 17:11:09.780314 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ec1fdc9d-ea9b-40bc-8f2b-a7287d275c5d-operator-scripts\") pod \"root-account-create-update-74dg4\" (UID: \"ec1fdc9d-ea9b-40bc-8f2b-a7287d275c5d\") " pod="openstack-kuttl-tests/root-account-create-update-74dg4" Mar 16 17:11:09 crc kubenswrapper[5120]: I0316 17:11:09.781249 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqp7q\" (UniqueName: \"kubernetes.io/projected/ec1fdc9d-ea9b-40bc-8f2b-a7287d275c5d-kube-api-access-wqp7q\") pod \"root-account-create-update-74dg4\" (UID: \"ec1fdc9d-ea9b-40bc-8f2b-a7287d275c5d\") " pod="openstack-kuttl-tests/root-account-create-update-74dg4" Mar 16 17:11:09 crc kubenswrapper[5120]: I0316 17:11:09.789890 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-fd2mn"] Mar 16 17:11:09 crc kubenswrapper[5120]: I0316 17:11:09.883407 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wqp7q\" (UniqueName: \"kubernetes.io/projected/ec1fdc9d-ea9b-40bc-8f2b-a7287d275c5d-kube-api-access-wqp7q\") pod \"root-account-create-update-74dg4\" (UID: \"ec1fdc9d-ea9b-40bc-8f2b-a7287d275c5d\") " pod="openstack-kuttl-tests/root-account-create-update-74dg4" Mar 16 17:11:09 crc kubenswrapper[5120]: I0316 17:11:09.883570 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ec1fdc9d-ea9b-40bc-8f2b-a7287d275c5d-operator-scripts\") pod \"root-account-create-update-74dg4\" (UID: \"ec1fdc9d-ea9b-40bc-8f2b-a7287d275c5d\") " pod="openstack-kuttl-tests/root-account-create-update-74dg4" Mar 16 17:11:09 crc kubenswrapper[5120]: E0316 17:11:09.893138 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-cell1-scripts: configmap "openstack-cell1-scripts" not found Mar 16 17:11:09 crc kubenswrapper[5120]: E0316 17:11:09.893229 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ec1fdc9d-ea9b-40bc-8f2b-a7287d275c5d-operator-scripts podName:ec1fdc9d-ea9b-40bc-8f2b-a7287d275c5d nodeName:}" failed. No retries permitted until 2026-03-16 17:11:10.393210255 +0000 UTC m=+5972.547141912 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/ec1fdc9d-ea9b-40bc-8f2b-a7287d275c5d-operator-scripts") pod "root-account-create-update-74dg4" (UID: "ec1fdc9d-ea9b-40bc-8f2b-a7287d275c5d") : configmap "openstack-cell1-scripts" not found Mar 16 17:11:09 crc kubenswrapper[5120]: E0316 17:11:09.898345 5120 projected.go:194] Error preparing data for projected volume kube-api-access-wqp7q for pod openstack-kuttl-tests/root-account-create-update-74dg4: failed to fetch token: serviceaccounts "galera-openstack-cell1" not found Mar 16 17:11:09 crc kubenswrapper[5120]: E0316 17:11:09.898435 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ec1fdc9d-ea9b-40bc-8f2b-a7287d275c5d-kube-api-access-wqp7q podName:ec1fdc9d-ea9b-40bc-8f2b-a7287d275c5d nodeName:}" failed. No retries permitted until 2026-03-16 17:11:10.398414057 +0000 UTC m=+5972.552345714 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-wqp7q" (UniqueName: "kubernetes.io/projected/ec1fdc9d-ea9b-40bc-8f2b-a7287d275c5d-kube-api-access-wqp7q") pod "root-account-create-update-74dg4" (UID: "ec1fdc9d-ea9b-40bc-8f2b-a7287d275c5d") : failed to fetch token: serviceaccounts "galera-openstack-cell1" not found Mar 16 17:11:09 crc kubenswrapper[5120]: I0316 17:11:09.911652 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-kxc4d"] Mar 16 17:11:09 crc kubenswrapper[5120]: I0316 17:11:09.922982 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-kxc4d"] Mar 16 17:11:09 crc kubenswrapper[5120]: I0316 17:11:09.932185 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-f4dc-account-create-update-j8gnr"] Mar 16 17:11:09 crc kubenswrapper[5120]: I0316 17:11:09.950693 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-zzp2r"] Mar 16 17:11:09 crc kubenswrapper[5120]: I0316 17:11:09.964824 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-zzp2r"] Mar 16 17:11:09 crc kubenswrapper[5120]: I0316 17:11:09.984910 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-f4dc-account-create-update-j8gnr"] Mar 16 17:11:09 crc kubenswrapper[5120]: I0316 17:11:09.992492 5120 generic.go:358] "Generic (PLEG): container finished" podID="45b8119e-70b5-45ad-9629-41a99f2f8ed0" containerID="0f5d3fe3e143a4e70eb6ec298ec173e607da98d4085d398c54f81b39a2ff9614" exitCode=2 Mar 16 17:11:09 crc kubenswrapper[5120]: I0316 17:11:09.992614 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"45b8119e-70b5-45ad-9629-41a99f2f8ed0","Type":"ContainerDied","Data":"0f5d3fe3e143a4e70eb6ec298ec173e607da98d4085d398c54f81b39a2ff9614"} Mar 16 17:11:10 crc kubenswrapper[5120]: I0316 17:11:10.005691 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_6482e901-6b9d-4e99-b859-40ed46b549e1/ovsdbserver-sb/0.log" Mar 16 17:11:10 crc kubenswrapper[5120]: I0316 17:11:10.005738 5120 generic.go:358] "Generic (PLEG): container finished" podID="6482e901-6b9d-4e99-b859-40ed46b549e1" containerID="c133cde2bb6de9540fd49f580d5a3c063dfae25ba05b7b2819f3fb0d3931f86a" exitCode=143 Mar 16 17:11:10 crc kubenswrapper[5120]: I0316 17:11:10.006179 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"6482e901-6b9d-4e99-b859-40ed46b549e1","Type":"ContainerDied","Data":"c133cde2bb6de9540fd49f580d5a3c063dfae25ba05b7b2819f3fb0d3931f86a"} Mar 16 17:11:10 crc kubenswrapper[5120]: I0316 17:11:10.007927 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-b8q8w"] Mar 16 17:11:10 crc kubenswrapper[5120]: I0316 17:11:10.016636 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_fa8d6c88-cfc9-4ead-974d-005ae362769a/ovsdbserver-nb/0.log" Mar 16 17:11:10 crc kubenswrapper[5120]: I0316 17:11:10.016682 5120 generic.go:358] "Generic (PLEG): container finished" podID="fa8d6c88-cfc9-4ead-974d-005ae362769a" containerID="48f695b820174f4434e930d86a102d88c95f5b423ba918f29f0e70dac0fe7545" exitCode=2 Mar 16 17:11:10 crc kubenswrapper[5120]: I0316 17:11:10.016695 5120 generic.go:358] "Generic (PLEG): container finished" podID="fa8d6c88-cfc9-4ead-974d-005ae362769a" containerID="1ffc97c292aa55c56c3a0b3eec9167bb3bdcfa607e015223082151d77e8b31c8" exitCode=143 Mar 16 17:11:10 crc kubenswrapper[5120]: I0316 17:11:10.017267 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"fa8d6c88-cfc9-4ead-974d-005ae362769a","Type":"ContainerDied","Data":"48f695b820174f4434e930d86a102d88c95f5b423ba918f29f0e70dac0fe7545"} Mar 16 17:11:10 crc kubenswrapper[5120]: I0316 17:11:10.017298 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"fa8d6c88-cfc9-4ead-974d-005ae362769a","Type":"ContainerDied","Data":"1ffc97c292aa55c56c3a0b3eec9167bb3bdcfa607e015223082151d77e8b31c8"} Mar 16 17:11:10 crc kubenswrapper[5120]: I0316 17:11:10.032115 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-b8q8w"] Mar 16 17:11:10 crc kubenswrapper[5120]: I0316 17:11:10.079233 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-hjq5d"] Mar 16 17:11:10 crc kubenswrapper[5120]: I0316 17:11:10.104884 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-hjq5d"] Mar 16 17:11:10 crc kubenswrapper[5120]: I0316 17:11:10.145188 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 17:11:10 crc kubenswrapper[5120]: I0316 17:11:10.145976 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="6e4e8c65-5607-4f79-ba90-208ca1a32521" containerName="cinder-scheduler" containerID="cri-o://3e8b71b950bf390402480c1399c32a4782772e498df0022e04eb4416ca056fdf" gracePeriod=30 Mar 16 17:11:10 crc kubenswrapper[5120]: I0316 17:11:10.146624 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="6e4e8c65-5607-4f79-ba90-208ca1a32521" containerName="probe" containerID="cri-o://8068446c44f56d29481ac3b9d2b0df62ffc47e46509fc2d2da921fb2004e7286" gracePeriod=30 Mar 16 17:11:10 crc kubenswrapper[5120]: I0316 17:11:10.182902 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-7465cc7fb4-nnm87"] Mar 16 17:11:10 crc kubenswrapper[5120]: I0316 17:11:10.183204 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-7465cc7fb4-nnm87" podUID="c4f7000d-d4eb-4d8c-9fb8-f88d8304b970" containerName="neutron-api" containerID="cri-o://9993ec5c6b4f30c9d30dafdea7deb75c1a50d89140e90b70baf9a257151faf98" gracePeriod=30 Mar 16 17:11:10 crc kubenswrapper[5120]: I0316 17:11:10.183386 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-7465cc7fb4-nnm87" podUID="c4f7000d-d4eb-4d8c-9fb8-f88d8304b970" containerName="neutron-httpd" containerID="cri-o://d93c264fc36e771c9504140efad8afbcbd5602b5de8be501ada220aa581fc08e" gracePeriod=30 Mar 16 17:11:10 crc kubenswrapper[5120]: E0316 17:11:10.200489 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1872347 actualBytes=10240 Mar 16 17:11:10 crc kubenswrapper[5120]: I0316 17:11:10.215733 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-dhrvt"] Mar 16 17:11:10 crc kubenswrapper[5120]: I0316 17:11:10.276881 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 17:11:10 crc kubenswrapper[5120]: I0316 17:11:10.278107 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="8c67a3db-090c-4122-baa3-57a35abe4a77" containerName="account-server" containerID="cri-o://cada37d138fe1100f7adc594e98ea94d57976e07351e011bc535d9982f6320a9" gracePeriod=30 Mar 16 17:11:10 crc kubenswrapper[5120]: I0316 17:11:10.279288 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="8c67a3db-090c-4122-baa3-57a35abe4a77" containerName="container-updater" containerID="cri-o://d7dc1b404bf2b4f2e0991e2c5df23d74605bd37f0234c83975a5462226173f4a" gracePeriod=30 Mar 16 17:11:10 crc kubenswrapper[5120]: I0316 17:11:10.279316 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="8c67a3db-090c-4122-baa3-57a35abe4a77" containerName="account-reaper" containerID="cri-o://d65cca40b78acf38a924033770b7dddbe830b04f4b9481a7ae42afc4fe0148a7" gracePeriod=30 Mar 16 17:11:10 crc kubenswrapper[5120]: I0316 17:11:10.279354 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="8c67a3db-090c-4122-baa3-57a35abe4a77" containerName="account-auditor" containerID="cri-o://ba90cd93acdcaf326c2686ffdf1ed1397f6bb727388d50974eefaab36e84d18e" gracePeriod=30 Mar 16 17:11:10 crc kubenswrapper[5120]: I0316 17:11:10.279436 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="8c67a3db-090c-4122-baa3-57a35abe4a77" containerName="swift-recon-cron" containerID="cri-o://399b6cf1eec5612bf777734fd2b34b2d83283c77f72adc4572e237b1f80a795a" gracePeriod=30 Mar 16 17:11:10 crc kubenswrapper[5120]: I0316 17:11:10.279446 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="8c67a3db-090c-4122-baa3-57a35abe4a77" containerName="container-auditor" containerID="cri-o://f52dab27d76bec378b4e03ce3c968e616b175a12da052c7df1d412f7a7b105f3" gracePeriod=30 Mar 16 17:11:10 crc kubenswrapper[5120]: I0316 17:11:10.279488 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="8c67a3db-090c-4122-baa3-57a35abe4a77" containerName="object-replicator" containerID="cri-o://f2699a9dd63e448a62ece804e3ecad01c35e679180fa7733373a71fa9979801b" gracePeriod=30 Mar 16 17:11:10 crc kubenswrapper[5120]: I0316 17:11:10.279507 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="8c67a3db-090c-4122-baa3-57a35abe4a77" containerName="rsync" containerID="cri-o://0c8cea3043f2fce80ea7e250797bd2913e76ea0470fe9e12eca4dbc755f293a4" gracePeriod=30 Mar 16 17:11:10 crc kubenswrapper[5120]: I0316 17:11:10.279483 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="8c67a3db-090c-4122-baa3-57a35abe4a77" containerName="object-auditor" containerID="cri-o://42310681682e3dc01c949750585a1d651aab966cfcfea51537e5687aba6547b2" gracePeriod=30 Mar 16 17:11:10 crc kubenswrapper[5120]: I0316 17:11:10.279533 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="8c67a3db-090c-4122-baa3-57a35abe4a77" containerName="object-server" containerID="cri-o://73ed0a55f7c6e413c01b8128322ec99568e0ead33b66931a7b20ec0e5c812b79" gracePeriod=30 Mar 16 17:11:10 crc kubenswrapper[5120]: I0316 17:11:10.279307 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="8c67a3db-090c-4122-baa3-57a35abe4a77" containerName="account-replicator" containerID="cri-o://b418d03d15ebb8bc5fd3fd000498ee8cffdf5be56ef3553a3937697d0337a694" gracePeriod=30 Mar 16 17:11:10 crc kubenswrapper[5120]: I0316 17:11:10.279533 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="8c67a3db-090c-4122-baa3-57a35abe4a77" containerName="container-server" containerID="cri-o://f95d08633e13a2f886a5e2ffcf7ff8812d6b9d89d3404c7418c501f94509e1e5" gracePeriod=30 Mar 16 17:11:10 crc kubenswrapper[5120]: I0316 17:11:10.279519 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="8c67a3db-090c-4122-baa3-57a35abe4a77" containerName="container-replicator" containerID="cri-o://1e20522ae176f0e3ccd3b88970db4d1da4912838989def622ce73c5a72a09fb7" gracePeriod=30 Mar 16 17:11:10 crc kubenswrapper[5120]: I0316 17:11:10.279597 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="8c67a3db-090c-4122-baa3-57a35abe4a77" containerName="object-expirer" containerID="cri-o://bd46718441dd3915f5bd2a71883fc7096ec17c6c243882c28d9b6633fc1f8f06" gracePeriod=30 Mar 16 17:11:10 crc kubenswrapper[5120]: I0316 17:11:10.279620 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="8c67a3db-090c-4122-baa3-57a35abe4a77" containerName="object-updater" containerID="cri-o://073581fad4fe5433c64fceb81b5027e86b37722dadca16ae342222f8c0f17ca8" gracePeriod=30 Mar 16 17:11:10 crc kubenswrapper[5120]: I0316 17:11:10.284871 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-dhrvt"] Mar 16 17:11:10 crc kubenswrapper[5120]: I0316 17:11:10.300205 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 17:11:10 crc kubenswrapper[5120]: I0316 17:11:10.300505 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="ade246ff-09d5-4b25-a738-4733af58f79c" containerName="cinder-api-log" containerID="cri-o://96191c9db8064f44d43499a27c2cf2ce04c6f59b84b263360523220cece5bbe2" gracePeriod=30 Mar 16 17:11:10 crc kubenswrapper[5120]: I0316 17:11:10.301026 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="ade246ff-09d5-4b25-a738-4733af58f79c" containerName="cinder-api" containerID="cri-o://74d99f4f7a3510db7bc9722100fd6e76b0483932aaa3a9d40fa5e81daf7d5b05" gracePeriod=30 Mar 16 17:11:10 crc kubenswrapper[5120]: I0316 17:11:10.335491 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-cgxw5"] Mar 16 17:11:10 crc kubenswrapper[5120]: I0316 17:11:10.339577 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-cgxw5"] Mar 16 17:11:10 crc kubenswrapper[5120]: I0316 17:11:10.352094 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-z74x9"] Mar 16 17:11:10 crc kubenswrapper[5120]: I0316 17:11:10.385664 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-z74x9"] Mar 16 17:11:10 crc kubenswrapper[5120]: I0316 17:11:10.407787 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 17:11:10 crc kubenswrapper[5120]: I0316 17:11:10.422714 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wqp7q\" (UniqueName: \"kubernetes.io/projected/ec1fdc9d-ea9b-40bc-8f2b-a7287d275c5d-kube-api-access-wqp7q\") pod \"root-account-create-update-74dg4\" (UID: \"ec1fdc9d-ea9b-40bc-8f2b-a7287d275c5d\") " pod="openstack-kuttl-tests/root-account-create-update-74dg4" Mar 16 17:11:10 crc kubenswrapper[5120]: I0316 17:11:10.423607 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ec1fdc9d-ea9b-40bc-8f2b-a7287d275c5d-operator-scripts\") pod \"root-account-create-update-74dg4\" (UID: \"ec1fdc9d-ea9b-40bc-8f2b-a7287d275c5d\") " pod="openstack-kuttl-tests/root-account-create-update-74dg4" Mar 16 17:11:10 crc kubenswrapper[5120]: E0316 17:11:10.424171 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-cell1-scripts: configmap "openstack-cell1-scripts" not found Mar 16 17:11:10 crc kubenswrapper[5120]: E0316 17:11:10.424330 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ec1fdc9d-ea9b-40bc-8f2b-a7287d275c5d-operator-scripts podName:ec1fdc9d-ea9b-40bc-8f2b-a7287d275c5d nodeName:}" failed. No retries permitted until 2026-03-16 17:11:11.424302795 +0000 UTC m=+5973.578234442 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/ec1fdc9d-ea9b-40bc-8f2b-a7287d275c5d-operator-scripts") pod "root-account-create-update-74dg4" (UID: "ec1fdc9d-ea9b-40bc-8f2b-a7287d275c5d") : configmap "openstack-cell1-scripts" not found Mar 16 17:11:10 crc kubenswrapper[5120]: E0316 17:11:10.427359 5120 projected.go:194] Error preparing data for projected volume kube-api-access-wqp7q for pod openstack-kuttl-tests/root-account-create-update-74dg4: failed to fetch token: serviceaccounts "galera-openstack-cell1" not found Mar 16 17:11:10 crc kubenswrapper[5120]: E0316 17:11:10.427446 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ec1fdc9d-ea9b-40bc-8f2b-a7287d275c5d-kube-api-access-wqp7q podName:ec1fdc9d-ea9b-40bc-8f2b-a7287d275c5d nodeName:}" failed. No retries permitted until 2026-03-16 17:11:11.42742283 +0000 UTC m=+5973.581354487 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-wqp7q" (UniqueName: "kubernetes.io/projected/ec1fdc9d-ea9b-40bc-8f2b-a7287d275c5d-kube-api-access-wqp7q") pod "root-account-create-update-74dg4" (UID: "ec1fdc9d-ea9b-40bc-8f2b-a7287d275c5d") : failed to fetch token: serviceaccounts "galera-openstack-cell1" not found Mar 16 17:11:10 crc kubenswrapper[5120]: I0316 17:11:10.429849 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-858ffc7d86-rq6st"] Mar 16 17:11:10 crc kubenswrapper[5120]: I0316 17:11:10.430135 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-858ffc7d86-rq6st" podUID="830abb7b-cab5-4a21-9e39-6dc0c0faf74e" containerName="placement-log" containerID="cri-o://346032f4d53ffd7e68156cf989237694dfdf9ec882a190b66580455212327093" gracePeriod=30 Mar 16 17:11:10 crc kubenswrapper[5120]: I0316 17:11:10.430686 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-858ffc7d86-rq6st" podUID="830abb7b-cab5-4a21-9e39-6dc0c0faf74e" containerName="placement-api" containerID="cri-o://e01f3b903f2c40334db918671a2fd1e8b27432bd701053aace924d854491e7b0" gracePeriod=30 Mar 16 17:11:10 crc kubenswrapper[5120]: I0316 17:11:10.446078 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-zc7hd"] Mar 16 17:11:10 crc kubenswrapper[5120]: I0316 17:11:10.450825 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_6482e901-6b9d-4e99-b859-40ed46b549e1/ovsdbserver-sb/0.log" Mar 16 17:11:10 crc kubenswrapper[5120]: I0316 17:11:10.450908 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:11:10 crc kubenswrapper[5120]: I0316 17:11:10.472419 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-zc7hd" Mar 16 17:11:10 crc kubenswrapper[5120]: I0316 17:11:10.476620 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 17:11:10 crc kubenswrapper[5120]: I0316 17:11:10.477008 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="2018b64c-7208-4c67-b4ec-6e336ca72e94" containerName="glance-log" containerID="cri-o://6bb073a01c96eef1da19b76d216e5216781d9c8805e39d2c2651bb9ef84dc90b" gracePeriod=30 Mar 16 17:11:10 crc kubenswrapper[5120]: I0316 17:11:10.477176 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="2018b64c-7208-4c67-b4ec-6e336ca72e94" containerName="glance-httpd" containerID="cri-o://b7f9960864f2d86cfd72bc79ac062310e15b22ddad4c040c4f184bf9539ee4cd" gracePeriod=30 Mar 16 17:11:10 crc kubenswrapper[5120]: I0316 17:11:10.500581 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-zc7hd"] Mar 16 17:11:10 crc kubenswrapper[5120]: I0316 17:11:10.526111 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/6482e901-6b9d-4e99-b859-40ed46b549e1-metrics-certs-tls-certs\") pod \"6482e901-6b9d-4e99-b859-40ed46b549e1\" (UID: \"6482e901-6b9d-4e99-b859-40ed46b549e1\") " Mar 16 17:11:10 crc kubenswrapper[5120]: I0316 17:11:10.526458 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/6482e901-6b9d-4e99-b859-40ed46b549e1-ovsdb-rundir\") pod \"6482e901-6b9d-4e99-b859-40ed46b549e1\" (UID: \"6482e901-6b9d-4e99-b859-40ed46b549e1\") " Mar 16 17:11:10 crc kubenswrapper[5120]: I0316 17:11:10.526524 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tpz28\" (UniqueName: \"kubernetes.io/projected/6482e901-6b9d-4e99-b859-40ed46b549e1-kube-api-access-tpz28\") pod \"6482e901-6b9d-4e99-b859-40ed46b549e1\" (UID: \"6482e901-6b9d-4e99-b859-40ed46b549e1\") " Mar 16 17:11:10 crc kubenswrapper[5120]: I0316 17:11:10.526630 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6482e901-6b9d-4e99-b859-40ed46b549e1-combined-ca-bundle\") pod \"6482e901-6b9d-4e99-b859-40ed46b549e1\" (UID: \"6482e901-6b9d-4e99-b859-40ed46b549e1\") " Mar 16 17:11:10 crc kubenswrapper[5120]: I0316 17:11:10.526655 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/6482e901-6b9d-4e99-b859-40ed46b549e1-scripts\") pod \"6482e901-6b9d-4e99-b859-40ed46b549e1\" (UID: \"6482e901-6b9d-4e99-b859-40ed46b549e1\") " Mar 16 17:11:10 crc kubenswrapper[5120]: I0316 17:11:10.526700 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/6482e901-6b9d-4e99-b859-40ed46b549e1-ovsdbserver-sb-tls-certs\") pod \"6482e901-6b9d-4e99-b859-40ed46b549e1\" (UID: \"6482e901-6b9d-4e99-b859-40ed46b549e1\") " Mar 16 17:11:10 crc kubenswrapper[5120]: I0316 17:11:10.526731 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6482e901-6b9d-4e99-b859-40ed46b549e1-config\") pod \"6482e901-6b9d-4e99-b859-40ed46b549e1\" (UID: \"6482e901-6b9d-4e99-b859-40ed46b549e1\") " Mar 16 17:11:10 crc kubenswrapper[5120]: I0316 17:11:10.526943 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovndbcluster-sb-etc-ovn\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"6482e901-6b9d-4e99-b859-40ed46b549e1\" (UID: \"6482e901-6b9d-4e99-b859-40ed46b549e1\") " Mar 16 17:11:10 crc kubenswrapper[5120]: E0316 17:11:10.527742 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Mar 16 17:11:10 crc kubenswrapper[5120]: E0316 17:11:10.527814 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/259e8ab8-dfd3-414c-b392-951a9f770559-config-data podName:259e8ab8-dfd3-414c-b392-951a9f770559 nodeName:}" failed. No retries permitted until 2026-03-16 17:11:12.527798527 +0000 UTC m=+5974.681730184 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/259e8ab8-dfd3-414c-b392-951a9f770559-config-data") pod "rabbitmq-cell1-server-0" (UID: "259e8ab8-dfd3-414c-b392-951a9f770559") : configmap "rabbitmq-cell1-config-data" not found Mar 16 17:11:10 crc kubenswrapper[5120]: I0316 17:11:10.528162 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6482e901-6b9d-4e99-b859-40ed46b549e1-ovsdb-rundir" (OuterVolumeSpecName: "ovsdb-rundir") pod "6482e901-6b9d-4e99-b859-40ed46b549e1" (UID: "6482e901-6b9d-4e99-b859-40ed46b549e1"). InnerVolumeSpecName "ovsdb-rundir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:11:10 crc kubenswrapper[5120]: I0316 17:11:10.528734 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6482e901-6b9d-4e99-b859-40ed46b549e1-scripts" (OuterVolumeSpecName: "scripts") pod "6482e901-6b9d-4e99-b859-40ed46b549e1" (UID: "6482e901-6b9d-4e99-b859-40ed46b549e1"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:11:10 crc kubenswrapper[5120]: I0316 17:11:10.529775 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6482e901-6b9d-4e99-b859-40ed46b549e1-config" (OuterVolumeSpecName: "config") pod "6482e901-6b9d-4e99-b859-40ed46b549e1" (UID: "6482e901-6b9d-4e99-b859-40ed46b549e1"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:11:10 crc kubenswrapper[5120]: I0316 17:11:10.529914 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 17:11:10 crc kubenswrapper[5120]: I0316 17:11:10.530299 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="e7b10940-fda7-468a-8937-fd83bb366d34" containerName="glance-log" containerID="cri-o://7d229d4a90d7e12f3dfc016d6b5ebcdcc002d8e3fd67e8f62fe2202b444410ff" gracePeriod=30 Mar 16 17:11:10 crc kubenswrapper[5120]: I0316 17:11:10.530529 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="e7b10940-fda7-468a-8937-fd83bb366d34" containerName="glance-httpd" containerID="cri-o://a1bb69956d1edd628b3b3c76712ce534b5124418bc79a860b504fffe24badfcb" gracePeriod=30 Mar 16 17:11:10 crc kubenswrapper[5120]: I0316 17:11:10.543353 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage01-crc" (OuterVolumeSpecName: "ovndbcluster-sb-etc-ovn") pod "6482e901-6b9d-4e99-b859-40ed46b549e1" (UID: "6482e901-6b9d-4e99-b859-40ed46b549e1"). InnerVolumeSpecName "local-storage01-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 17:11:10 crc kubenswrapper[5120]: I0316 17:11:10.549253 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/rabbitmq-server-0" podUID="ef2e55ac-292f-4242-b410-0eb4d2ff90d3" containerName="rabbitmq" containerID="cri-o://06fea802450630dea417ed7a0f1368308b9cfa3ae4a234fa4cd696d5b294abdc" gracePeriod=604800 Mar 16 17:11:10 crc kubenswrapper[5120]: I0316 17:11:10.553033 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6482e901-6b9d-4e99-b859-40ed46b549e1-kube-api-access-tpz28" (OuterVolumeSpecName: "kube-api-access-tpz28") pod "6482e901-6b9d-4e99-b859-40ed46b549e1" (UID: "6482e901-6b9d-4e99-b859-40ed46b549e1"). InnerVolumeSpecName "kube-api-access-tpz28". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:11:10 crc kubenswrapper[5120]: I0316 17:11:10.582653 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-db-create-xjpbh"] Mar 16 17:11:10 crc kubenswrapper[5120]: I0316 17:11:10.676475 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6482e901-6b9d-4e99-b859-40ed46b549e1-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "6482e901-6b9d-4e99-b859-40ed46b549e1" (UID: "6482e901-6b9d-4e99-b859-40ed46b549e1"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:11:10 crc kubenswrapper[5120]: I0316 17:11:10.687422 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/fd632cf1-9975-4595-bdb6-c33fc07f41a5-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-79dcd846c5-zc7hd\" (UID: \"fd632cf1-9975-4595-bdb6-c33fc07f41a5\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-zc7hd" Mar 16 17:11:10 crc kubenswrapper[5120]: I0316 17:11:10.688058 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fd632cf1-9975-4595-bdb6-c33fc07f41a5-config\") pod \"dnsmasq-dnsmasq-79dcd846c5-zc7hd\" (UID: \"fd632cf1-9975-4595-bdb6-c33fc07f41a5\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-zc7hd" Mar 16 17:11:10 crc kubenswrapper[5120]: I0316 17:11:10.688387 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4w9qj\" (UniqueName: \"kubernetes.io/projected/fd632cf1-9975-4595-bdb6-c33fc07f41a5-kube-api-access-4w9qj\") pod \"dnsmasq-dnsmasq-79dcd846c5-zc7hd\" (UID: \"fd632cf1-9975-4595-bdb6-c33fc07f41a5\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-zc7hd" Mar 16 17:11:10 crc kubenswrapper[5120]: I0316 17:11:10.688570 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") on node \"crc\" " Mar 16 17:11:10 crc kubenswrapper[5120]: I0316 17:11:10.688588 5120 reconciler_common.go:299] "Volume detached for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/6482e901-6b9d-4e99-b859-40ed46b549e1-ovsdb-rundir\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:10 crc kubenswrapper[5120]: I0316 17:11:10.688599 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tpz28\" (UniqueName: \"kubernetes.io/projected/6482e901-6b9d-4e99-b859-40ed46b549e1-kube-api-access-tpz28\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:10 crc kubenswrapper[5120]: I0316 17:11:10.700952 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6482e901-6b9d-4e99-b859-40ed46b549e1-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:10 crc kubenswrapper[5120]: I0316 17:11:10.701009 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/6482e901-6b9d-4e99-b859-40ed46b549e1-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:10 crc kubenswrapper[5120]: I0316 17:11:10.701027 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6482e901-6b9d-4e99-b859-40ed46b549e1-config\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:10 crc kubenswrapper[5120]: I0316 17:11:10.758912 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="12376f21-bf7b-4ee9-bafa-ecadf4d94c8a" path="/var/lib/kubelet/pods/12376f21-bf7b-4ee9-bafa-ecadf4d94c8a/volumes" Mar 16 17:11:10 crc kubenswrapper[5120]: I0316 17:11:10.759512 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="42ffc217-f12f-401c-a152-5be06f692da5" path="/var/lib/kubelet/pods/42ffc217-f12f-401c-a152-5be06f692da5/volumes" Mar 16 17:11:10 crc kubenswrapper[5120]: I0316 17:11:10.760127 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4acc93da-5600-4c0b-890d-8e2411d387bf" path="/var/lib/kubelet/pods/4acc93da-5600-4c0b-890d-8e2411d387bf/volumes" Mar 16 17:11:10 crc kubenswrapper[5120]: I0316 17:11:10.785215 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6482e901-6b9d-4e99-b859-40ed46b549e1-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "6482e901-6b9d-4e99-b859-40ed46b549e1" (UID: "6482e901-6b9d-4e99-b859-40ed46b549e1"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:11:10 crc kubenswrapper[5120]: I0316 17:11:10.789146 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4fd979d4-32ca-4d12-977d-e9afea46b929" path="/var/lib/kubelet/pods/4fd979d4-32ca-4d12-977d-e9afea46b929/volumes" Mar 16 17:11:10 crc kubenswrapper[5120]: I0316 17:11:10.790015 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6eeffada-e22e-43d1-b349-aab71bf994eb" path="/var/lib/kubelet/pods/6eeffada-e22e-43d1-b349-aab71bf994eb/volumes" Mar 16 17:11:10 crc kubenswrapper[5120]: I0316 17:11:10.790542 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="727c8c9a-fcc8-42c3-8a58-df87dc295191" path="/var/lib/kubelet/pods/727c8c9a-fcc8-42c3-8a58-df87dc295191/volumes" Mar 16 17:11:10 crc kubenswrapper[5120]: I0316 17:11:10.804095 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fd632cf1-9975-4595-bdb6-c33fc07f41a5-config\") pod \"dnsmasq-dnsmasq-79dcd846c5-zc7hd\" (UID: \"fd632cf1-9975-4595-bdb6-c33fc07f41a5\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-zc7hd" Mar 16 17:11:10 crc kubenswrapper[5120]: I0316 17:11:10.804489 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4w9qj\" (UniqueName: \"kubernetes.io/projected/fd632cf1-9975-4595-bdb6-c33fc07f41a5-kube-api-access-4w9qj\") pod \"dnsmasq-dnsmasq-79dcd846c5-zc7hd\" (UID: \"fd632cf1-9975-4595-bdb6-c33fc07f41a5\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-zc7hd" Mar 16 17:11:10 crc kubenswrapper[5120]: I0316 17:11:10.804660 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/fd632cf1-9975-4595-bdb6-c33fc07f41a5-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-79dcd846c5-zc7hd\" (UID: \"fd632cf1-9975-4595-bdb6-c33fc07f41a5\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-zc7hd" Mar 16 17:11:10 crc kubenswrapper[5120]: I0316 17:11:10.804786 5120 reconciler_common.go:299] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/6482e901-6b9d-4e99-b859-40ed46b549e1-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:10 crc kubenswrapper[5120]: I0316 17:11:10.807678 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fd632cf1-9975-4595-bdb6-c33fc07f41a5-config\") pod \"dnsmasq-dnsmasq-79dcd846c5-zc7hd\" (UID: \"fd632cf1-9975-4595-bdb6-c33fc07f41a5\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-zc7hd" Mar 16 17:11:10 crc kubenswrapper[5120]: I0316 17:11:10.816038 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/fd632cf1-9975-4595-bdb6-c33fc07f41a5-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-79dcd846c5-zc7hd\" (UID: \"fd632cf1-9975-4595-bdb6-c33fc07f41a5\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-zc7hd" Mar 16 17:11:10 crc kubenswrapper[5120]: I0316 17:11:10.846295 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="79a9c531-41a9-4754-91ee-697e1c3bdb44" path="/var/lib/kubelet/pods/79a9c531-41a9-4754-91ee-697e1c3bdb44/volumes" Mar 16 17:11:10 crc kubenswrapper[5120]: I0316 17:11:10.847343 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93dfd188-3406-4990-b8e2-423cfa2265fa" path="/var/lib/kubelet/pods/93dfd188-3406-4990-b8e2-423cfa2265fa/volumes" Mar 16 17:11:10 crc kubenswrapper[5120]: I0316 17:11:10.848149 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b09a0851-56c4-4871-be74-3dc7be582a80" path="/var/lib/kubelet/pods/b09a0851-56c4-4871-be74-3dc7be582a80/volumes" Mar 16 17:11:10 crc kubenswrapper[5120]: I0316 17:11:10.855221 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4w9qj\" (UniqueName: \"kubernetes.io/projected/fd632cf1-9975-4595-bdb6-c33fc07f41a5-kube-api-access-4w9qj\") pod \"dnsmasq-dnsmasq-79dcd846c5-zc7hd\" (UID: \"fd632cf1-9975-4595-bdb6-c33fc07f41a5\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-zc7hd" Mar 16 17:11:10 crc kubenswrapper[5120]: I0316 17:11:10.855483 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c43d22b4-7a33-42bc-9fcd-79cb1735c27e" path="/var/lib/kubelet/pods/c43d22b4-7a33-42bc-9fcd-79cb1735c27e/volumes" Mar 16 17:11:10 crc kubenswrapper[5120]: I0316 17:11:10.856481 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d09005bc-6e0f-4946-848c-ca47f6ad1401" path="/var/lib/kubelet/pods/d09005bc-6e0f-4946-848c-ca47f6ad1401/volumes" Mar 16 17:11:10 crc kubenswrapper[5120]: I0316 17:11:10.857034 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="de53f6e3-e1a7-49fd-8c2e-e57add0fe5eb" path="/var/lib/kubelet/pods/de53f6e3-e1a7-49fd-8c2e-e57add0fe5eb/volumes" Mar 16 17:11:10 crc kubenswrapper[5120]: I0316 17:11:10.857687 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef0e4aec-f4b7-43b1-9496-2b50031875a4" path="/var/lib/kubelet/pods/ef0e4aec-f4b7-43b1-9496-2b50031875a4/volumes" Mar 16 17:11:10 crc kubenswrapper[5120]: I0316 17:11:10.894323 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-db-create-xjpbh"] Mar 16 17:11:10 crc kubenswrapper[5120]: I0316 17:11:10.894437 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-db-create-s6gpg"] Mar 16 17:11:10 crc kubenswrapper[5120]: I0316 17:11:10.894448 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-db-create-s6gpg"] Mar 16 17:11:10 crc kubenswrapper[5120]: I0316 17:11:10.894459 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-db-create-h7w47"] Mar 16 17:11:10 crc kubenswrapper[5120]: I0316 17:11:10.895729 5120 kubelet_pods.go:1019] "Unable to retrieve pull secret, the image pull may not succeed." pod="openstack-kuttl-tests/nova-metadata-0" secret="" err="secret \"nova-nova-dockercfg-q5mt5\" not found" Mar 16 17:11:10 crc kubenswrapper[5120]: I0316 17:11:10.899858 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-db-create-h7w47"] Mar 16 17:11:10 crc kubenswrapper[5120]: I0316 17:11:10.903908 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage01-crc" (UniqueName: "kubernetes.io/local-volume/local-storage01-crc") on node "crc" Mar 16 17:11:10 crc kubenswrapper[5120]: I0316 17:11:10.910212 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:10.933310 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-proxy-6d6f5fb946-cmmjt"] Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.008873 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.009243 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-proxy-6d6f5fb946-cmmjt" podUID="4f3e991c-b99b-4665-b5df-a900935e3c99" containerName="proxy-httpd" containerID="cri-o://17ad1d58f4006f4071154741b686529cb6523ce7177fcd8c97be538f5ae1952f" gracePeriod=30 Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.009869 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-proxy-6d6f5fb946-cmmjt" podUID="4f3e991c-b99b-4665-b5df-a900935e3c99" containerName="proxy-server" containerID="cri-o://83333ee2767aae44602f3c8de136407f7f927fe1b5a6b91c23afde50bd3211f3" gracePeriod=30 Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.016305 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-zc7hd" Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.037570 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6482e901-6b9d-4e99-b859-40ed46b549e1-ovsdbserver-sb-tls-certs" (OuterVolumeSpecName: "ovsdbserver-sb-tls-certs") pod "6482e901-6b9d-4e99-b859-40ed46b549e1" (UID: "6482e901-6b9d-4e99-b859-40ed46b549e1"). InnerVolumeSpecName "ovsdbserver-sb-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:11:11 crc kubenswrapper[5120]: E0316 17:11:11.059859 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/nova-metadata-config-data: secret "nova-metadata-config-data" not found Mar 16 17:11:11 crc kubenswrapper[5120]: E0316 17:11:11.060080 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f659fd59-18da-47e7-b57a-27e7d95a428e-config-data podName:f659fd59-18da-47e7-b57a-27e7d95a428e nodeName:}" failed. No retries permitted until 2026-03-16 17:11:11.560049798 +0000 UTC m=+5973.713981455 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/secret/f659fd59-18da-47e7-b57a-27e7d95a428e-config-data") pod "nova-metadata-0" (UID: "f659fd59-18da-47e7-b57a-27e7d95a428e") : secret "nova-metadata-config-data" not found Mar 16 17:11:11 crc kubenswrapper[5120]: E0316 17:11:11.066030 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 17:11:11 crc kubenswrapper[5120]: E0316 17:11:11.066107 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f659fd59-18da-47e7-b57a-27e7d95a428e-combined-ca-bundle podName:f659fd59-18da-47e7-b57a-27e7d95a428e nodeName:}" failed. No retries permitted until 2026-03-16 17:11:11.566085753 +0000 UTC m=+5973.720017410 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/f659fd59-18da-47e7-b57a-27e7d95a428e-combined-ca-bundle") pod "nova-metadata-0" (UID: "f659fd59-18da-47e7-b57a-27e7d95a428e") : secret "combined-ca-bundle" not found Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.060847 5120 reconciler_common.go:299] "Volume detached for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/6482e901-6b9d-4e99-b859-40ed46b549e1-ovsdbserver-sb-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.090240 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.124126 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" podUID="259e8ab8-dfd3-414c-b392-951a9f770559" containerName="rabbitmq" containerID="cri-o://b67b7228974d46807a751b668298e02443b992e24f050797b1c8edbe101dc618" gracePeriod=604800 Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.214531 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.231237 5120 generic.go:358] "Generic (PLEG): container finished" podID="830abb7b-cab5-4a21-9e39-6dc0c0faf74e" containerID="346032f4d53ffd7e68156cf989237694dfdf9ec882a190b66580455212327093" exitCode=143 Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.231279 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_fa8d6c88-cfc9-4ead-974d-005ae362769a/ovsdbserver-nb/0.log" Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.231358 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.231371 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-858ffc7d86-rq6st" event={"ID":"830abb7b-cab5-4a21-9e39-6dc0c0faf74e","Type":"ContainerDied","Data":"346032f4d53ffd7e68156cf989237694dfdf9ec882a190b66580455212327093"} Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.243592 5120 generic.go:358] "Generic (PLEG): container finished" podID="c4f7000d-d4eb-4d8c-9fb8-f88d8304b970" containerID="d93c264fc36e771c9504140efad8afbcbd5602b5de8be501ada220aa581fc08e" exitCode=0 Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.243746 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-7465cc7fb4-nnm87" event={"ID":"c4f7000d-d4eb-4d8c-9fb8-f88d8304b970","Type":"ContainerDied","Data":"d93c264fc36e771c9504140efad8afbcbd5602b5de8be501ada220aa581fc08e"} Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.249922 5120 generic.go:358] "Generic (PLEG): container finished" podID="e7b10940-fda7-468a-8937-fd83bb366d34" containerID="7d229d4a90d7e12f3dfc016d6b5ebcdcc002d8e3fd67e8f62fe2202b444410ff" exitCode=143 Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.250113 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"e7b10940-fda7-468a-8937-fd83bb366d34","Type":"ContainerDied","Data":"7d229d4a90d7e12f3dfc016d6b5ebcdcc002d8e3fd67e8f62fe2202b444410ff"} Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.258809 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-6f95f9d4f9-4kmmn"] Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.259062 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-6f95f9d4f9-4kmmn" podUID="e491da9b-3bac-45f2-b9f5-41af945fe1eb" containerName="barbican-worker-log" containerID="cri-o://50ba6f99478a2553d827336920b5f82ff35d489c47d9082dbe0a248bce182ecc" gracePeriod=30 Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.259174 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-6f95f9d4f9-4kmmn" podUID="e491da9b-3bac-45f2-b9f5-41af945fe1eb" containerName="barbican-worker" containerID="cri-o://870c2a927bc2107b7a9af1bd4b1b5d380ffd03e113df8349bec56a3b69849df3" gracePeriod=30 Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.291233 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_6482e901-6b9d-4e99-b859-40ed46b549e1/ovsdbserver-sb/0.log" Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.291687 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.291679 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"6482e901-6b9d-4e99-b859-40ed46b549e1","Type":"ContainerDied","Data":"72e2351e62a7b0c48341123550ea7fcb804165ba61361f85d9fc0f7c0a0d0679"} Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.291956 5120 scope.go:117] "RemoveContainer" containerID="896a1fedb10dc78e3a5ec32e18c9e89730edd87bf0bf1ea066ac7fe083c294a2" Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.311113 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-7d8dcb56b8-42f9n"] Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.311412 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-7d8dcb56b8-42f9n" podUID="1b7d191f-d557-4a83-829b-bad5a5ed7dbb" containerName="barbican-keystone-listener-log" containerID="cri-o://7910ed697b40b1459f42e3b89f80666792021d8e9714d9012682a2dbde466be8" gracePeriod=30 Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.311749 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-7d8dcb56b8-42f9n" podUID="1b7d191f-d557-4a83-829b-bad5a5ed7dbb" containerName="barbican-keystone-listener" containerID="cri-o://93a02ab0690546f90261545a3915392e1acc235fe9f611e9496292d465c53236" gracePeriod=30 Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.315856 5120 generic.go:358] "Generic (PLEG): container finished" podID="ade246ff-09d5-4b25-a738-4733af58f79c" containerID="96191c9db8064f44d43499a27c2cf2ce04c6f59b84b263360523220cece5bbe2" exitCode=143 Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.315941 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"ade246ff-09d5-4b25-a738-4733af58f79c","Type":"ContainerDied","Data":"96191c9db8064f44d43499a27c2cf2ce04c6f59b84b263360523220cece5bbe2"} Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.335803 5120 generic.go:358] "Generic (PLEG): container finished" podID="140a02f0-df36-49fb-b2bb-b267e350f5c5" containerID="e2183bcba7b9ba237a63c8b8b38663b980601a86090e8c6ae375714527039f8d" exitCode=137 Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.346909 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.347226 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="d4da2790-525e-44f0-bddd-c5edbb04ae32" containerName="nova-api-log" containerID="cri-o://1e924a770f65d5ad514a8ac7bd29e74fcd80c4839b439debaf9aba0634fa1121" gracePeriod=30 Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.347547 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="d4da2790-525e-44f0-bddd-c5edbb04ae32" containerName="nova-api-api" containerID="cri-o://f2efc7da21335cdb240543f9916c5733bbfdf99fd99f425706ed593332a62064" gracePeriod=30 Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.359244 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-db-create-52gqt"] Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.369707 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-7dd9fb87c6-wk9p7"] Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.369990 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-7dd9fb87c6-wk9p7" podUID="cb59b894-da6e-4bd0-85c3-2330d90f2fb9" containerName="barbican-api-log" containerID="cri-o://8bcc4d1eccd2cd8a10222f683f4348aa58be8aacd639247e66f7eb971210636b" gracePeriod=30 Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.370101 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-7dd9fb87c6-wk9p7" podUID="cb59b894-da6e-4bd0-85c3-2330d90f2fb9" containerName="barbican-api" containerID="cri-o://53704c7e7cb120a20abf7c23819ce05c411f207be9084dca48931c0a0f060df8" gracePeriod=30 Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.370985 5120 generic.go:358] "Generic (PLEG): container finished" podID="8c67a3db-090c-4122-baa3-57a35abe4a77" containerID="0c8cea3043f2fce80ea7e250797bd2913e76ea0470fe9e12eca4dbc755f293a4" exitCode=0 Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.371005 5120 generic.go:358] "Generic (PLEG): container finished" podID="8c67a3db-090c-4122-baa3-57a35abe4a77" containerID="bd46718441dd3915f5bd2a71883fc7096ec17c6c243882c28d9b6633fc1f8f06" exitCode=0 Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.371014 5120 generic.go:358] "Generic (PLEG): container finished" podID="8c67a3db-090c-4122-baa3-57a35abe4a77" containerID="073581fad4fe5433c64fceb81b5027e86b37722dadca16ae342222f8c0f17ca8" exitCode=0 Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.371020 5120 generic.go:358] "Generic (PLEG): container finished" podID="8c67a3db-090c-4122-baa3-57a35abe4a77" containerID="42310681682e3dc01c949750585a1d651aab966cfcfea51537e5687aba6547b2" exitCode=0 Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.371025 5120 generic.go:358] "Generic (PLEG): container finished" podID="8c67a3db-090c-4122-baa3-57a35abe4a77" containerID="f2699a9dd63e448a62ece804e3ecad01c35e679180fa7733373a71fa9979801b" exitCode=0 Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.371031 5120 generic.go:358] "Generic (PLEG): container finished" podID="8c67a3db-090c-4122-baa3-57a35abe4a77" containerID="d7dc1b404bf2b4f2e0991e2c5df23d74605bd37f0234c83975a5462226173f4a" exitCode=0 Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.371036 5120 generic.go:358] "Generic (PLEG): container finished" podID="8c67a3db-090c-4122-baa3-57a35abe4a77" containerID="f52dab27d76bec378b4e03ce3c968e616b175a12da052c7df1d412f7a7b105f3" exitCode=0 Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.371041 5120 generic.go:358] "Generic (PLEG): container finished" podID="8c67a3db-090c-4122-baa3-57a35abe4a77" containerID="1e20522ae176f0e3ccd3b88970db4d1da4912838989def622ce73c5a72a09fb7" exitCode=0 Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.371046 5120 generic.go:358] "Generic (PLEG): container finished" podID="8c67a3db-090c-4122-baa3-57a35abe4a77" containerID="d65cca40b78acf38a924033770b7dddbe830b04f4b9481a7ae42afc4fe0148a7" exitCode=0 Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.371052 5120 generic.go:358] "Generic (PLEG): container finished" podID="8c67a3db-090c-4122-baa3-57a35abe4a77" containerID="ba90cd93acdcaf326c2686ffdf1ed1397f6bb727388d50974eefaab36e84d18e" exitCode=0 Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.371057 5120 generic.go:358] "Generic (PLEG): container finished" podID="8c67a3db-090c-4122-baa3-57a35abe4a77" containerID="b418d03d15ebb8bc5fd3fd000498ee8cffdf5be56ef3553a3937697d0337a694" exitCode=0 Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.371129 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"8c67a3db-090c-4122-baa3-57a35abe4a77","Type":"ContainerDied","Data":"0c8cea3043f2fce80ea7e250797bd2913e76ea0470fe9e12eca4dbc755f293a4"} Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.371150 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"8c67a3db-090c-4122-baa3-57a35abe4a77","Type":"ContainerDied","Data":"bd46718441dd3915f5bd2a71883fc7096ec17c6c243882c28d9b6633fc1f8f06"} Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.371159 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"8c67a3db-090c-4122-baa3-57a35abe4a77","Type":"ContainerDied","Data":"073581fad4fe5433c64fceb81b5027e86b37722dadca16ae342222f8c0f17ca8"} Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.371167 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"8c67a3db-090c-4122-baa3-57a35abe4a77","Type":"ContainerDied","Data":"42310681682e3dc01c949750585a1d651aab966cfcfea51537e5687aba6547b2"} Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.371175 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"8c67a3db-090c-4122-baa3-57a35abe4a77","Type":"ContainerDied","Data":"f2699a9dd63e448a62ece804e3ecad01c35e679180fa7733373a71fa9979801b"} Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.371184 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"8c67a3db-090c-4122-baa3-57a35abe4a77","Type":"ContainerDied","Data":"d7dc1b404bf2b4f2e0991e2c5df23d74605bd37f0234c83975a5462226173f4a"} Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.371192 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"8c67a3db-090c-4122-baa3-57a35abe4a77","Type":"ContainerDied","Data":"f52dab27d76bec378b4e03ce3c968e616b175a12da052c7df1d412f7a7b105f3"} Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.371200 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"8c67a3db-090c-4122-baa3-57a35abe4a77","Type":"ContainerDied","Data":"1e20522ae176f0e3ccd3b88970db4d1da4912838989def622ce73c5a72a09fb7"} Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.371209 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"8c67a3db-090c-4122-baa3-57a35abe4a77","Type":"ContainerDied","Data":"d65cca40b78acf38a924033770b7dddbe830b04f4b9481a7ae42afc4fe0148a7"} Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.371216 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"8c67a3db-090c-4122-baa3-57a35abe4a77","Type":"ContainerDied","Data":"ba90cd93acdcaf326c2686ffdf1ed1397f6bb727388d50974eefaab36e84d18e"} Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.371224 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"8c67a3db-090c-4122-baa3-57a35abe4a77","Type":"ContainerDied","Data":"b418d03d15ebb8bc5fd3fd000498ee8cffdf5be56ef3553a3937697d0337a694"} Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.382735 5120 generic.go:358] "Generic (PLEG): container finished" podID="2018b64c-7208-4c67-b4ec-6e336ca72e94" containerID="6bb073a01c96eef1da19b76d216e5216781d9c8805e39d2c2651bb9ef84dc90b" exitCode=143 Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.383155 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="f659fd59-18da-47e7-b57a-27e7d95a428e" containerName="nova-metadata-log" containerID="cri-o://0b4187a33cd16e54176afbc1797048bc385a980bce807ea18a2f5bf975e838fa" gracePeriod=30 Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.383257 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"2018b64c-7208-4c67-b4ec-6e336ca72e94","Type":"ContainerDied","Data":"6bb073a01c96eef1da19b76d216e5216781d9c8805e39d2c2651bb9ef84dc90b"} Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.383343 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="f659fd59-18da-47e7-b57a-27e7d95a428e" containerName="nova-metadata-metadata" containerID="cri-o://f0db20b2e6e0d68c181b06468ccd7637201488f5e2245e4f484f3e76b9ffe122" gracePeriod=30 Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.395568 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/fa8d6c88-cfc9-4ead-974d-005ae362769a-metrics-certs-tls-certs\") pod \"fa8d6c88-cfc9-4ead-974d-005ae362769a\" (UID: \"fa8d6c88-cfc9-4ead-974d-005ae362769a\") " Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.395936 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fa8d6c88-cfc9-4ead-974d-005ae362769a-config\") pod \"fa8d6c88-cfc9-4ead-974d-005ae362769a\" (UID: \"fa8d6c88-cfc9-4ead-974d-005ae362769a\") " Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.396119 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/fa8d6c88-cfc9-4ead-974d-005ae362769a-scripts\") pod \"fa8d6c88-cfc9-4ead-974d-005ae362769a\" (UID: \"fa8d6c88-cfc9-4ead-974d-005ae362769a\") " Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.396207 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fa8d6c88-cfc9-4ead-974d-005ae362769a-combined-ca-bundle\") pod \"fa8d6c88-cfc9-4ead-974d-005ae362769a\" (UID: \"fa8d6c88-cfc9-4ead-974d-005ae362769a\") " Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.396287 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/fa8d6c88-cfc9-4ead-974d-005ae362769a-ovsdb-rundir\") pod \"fa8d6c88-cfc9-4ead-974d-005ae362769a\" (UID: \"fa8d6c88-cfc9-4ead-974d-005ae362769a\") " Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.396333 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/fa8d6c88-cfc9-4ead-974d-005ae362769a-ovsdbserver-nb-tls-certs\") pod \"fa8d6c88-cfc9-4ead-974d-005ae362769a\" (UID: \"fa8d6c88-cfc9-4ead-974d-005ae362769a\") " Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.396478 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jfjr8\" (UniqueName: \"kubernetes.io/projected/fa8d6c88-cfc9-4ead-974d-005ae362769a-kube-api-access-jfjr8\") pod \"fa8d6c88-cfc9-4ead-974d-005ae362769a\" (UID: \"fa8d6c88-cfc9-4ead-974d-005ae362769a\") " Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.396529 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovndbcluster-nb-etc-ovn\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"fa8d6c88-cfc9-4ead-974d-005ae362769a\" (UID: \"fa8d6c88-cfc9-4ead-974d-005ae362769a\") " Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.398276 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa8d6c88-cfc9-4ead-974d-005ae362769a-ovsdb-rundir" (OuterVolumeSpecName: "ovsdb-rundir") pod "fa8d6c88-cfc9-4ead-974d-005ae362769a" (UID: "fa8d6c88-cfc9-4ead-974d-005ae362769a"). InnerVolumeSpecName "ovsdb-rundir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.399157 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fa8d6c88-cfc9-4ead-974d-005ae362769a-config" (OuterVolumeSpecName: "config") pod "fa8d6c88-cfc9-4ead-974d-005ae362769a" (UID: "fa8d6c88-cfc9-4ead-974d-005ae362769a"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.399387 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fa8d6c88-cfc9-4ead-974d-005ae362769a-scripts" (OuterVolumeSpecName: "scripts") pod "fa8d6c88-cfc9-4ead-974d-005ae362769a" (UID: "fa8d6c88-cfc9-4ead-974d-005ae362769a"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.413252 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa8d6c88-cfc9-4ead-974d-005ae362769a-kube-api-access-jfjr8" (OuterVolumeSpecName: "kube-api-access-jfjr8") pod "fa8d6c88-cfc9-4ead-974d-005ae362769a" (UID: "fa8d6c88-cfc9-4ead-974d-005ae362769a"). InnerVolumeSpecName "kube-api-access-jfjr8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.414631 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jfjr8\" (UniqueName: \"kubernetes.io/projected/fa8d6c88-cfc9-4ead-974d-005ae362769a-kube-api-access-jfjr8\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.414670 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fa8d6c88-cfc9-4ead-974d-005ae362769a-config\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.414685 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/fa8d6c88-cfc9-4ead-974d-005ae362769a-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.414699 5120 reconciler_common.go:299] "Volume detached for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/fa8d6c88-cfc9-4ead-974d-005ae362769a-ovsdb-rundir\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.425903 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage08-crc" (OuterVolumeSpecName: "ovndbcluster-nb-etc-ovn") pod "fa8d6c88-cfc9-4ead-974d-005ae362769a" (UID: "fa8d6c88-cfc9-4ead-974d-005ae362769a"). InnerVolumeSpecName "local-storage08-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.444060 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-db-create-52gqt"] Mar 16 17:11:11 crc kubenswrapper[5120]: E0316 17:11:11.457528 5120 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6e4e8c65_5607_4f79_ba90_208ca1a32521.slice/crio-conmon-8068446c44f56d29481ac3b9d2b0df62ffc47e46509fc2d2da921fb2004e7286.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode491da9b_3bac_45f2_b9f5_41af945fe1eb.slice/crio-conmon-50ba6f99478a2553d827336920b5f82ff35d489c47d9082dbe0a248bce182ecc.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8c67a3db_090c_4122_baa3_57a35abe4a77.slice/crio-cada37d138fe1100f7adc594e98ea94d57976e07351e011bc535d9982f6320a9.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1b7d191f_d557_4a83_829b_bad5a5ed7dbb.slice/crio-conmon-7910ed697b40b1459f42e3b89f80666792021d8e9714d9012682a2dbde466be8.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6482e901_6b9d_4e99_b859_40ed46b549e1.slice/crio-72e2351e62a7b0c48341123550ea7fcb804165ba61361f85d9fc0f7c0a0d0679\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8c67a3db_090c_4122_baa3_57a35abe4a77.slice/crio-conmon-cada37d138fe1100f7adc594e98ea94d57976e07351e011bc535d9982f6320a9.scope\": RecentStats: unable to find data in memory cache]" Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.462355 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa8d6c88-cfc9-4ead-974d-005ae362769a-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "fa8d6c88-cfc9-4ead-974d-005ae362769a" (UID: "fa8d6c88-cfc9-4ead-974d-005ae362769a"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.492613 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-tphh5"] Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.517130 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wqp7q\" (UniqueName: \"kubernetes.io/projected/ec1fdc9d-ea9b-40bc-8f2b-a7287d275c5d-kube-api-access-wqp7q\") pod \"root-account-create-update-74dg4\" (UID: \"ec1fdc9d-ea9b-40bc-8f2b-a7287d275c5d\") " pod="openstack-kuttl-tests/root-account-create-update-74dg4" Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.517288 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ec1fdc9d-ea9b-40bc-8f2b-a7287d275c5d-operator-scripts\") pod \"root-account-create-update-74dg4\" (UID: \"ec1fdc9d-ea9b-40bc-8f2b-a7287d275c5d\") " pod="openstack-kuttl-tests/root-account-create-update-74dg4" Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.517626 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") on node \"crc\" " Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.517646 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fa8d6c88-cfc9-4ead-974d-005ae362769a-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:11 crc kubenswrapper[5120]: E0316 17:11:11.518168 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-cell1-scripts: configmap "openstack-cell1-scripts" not found Mar 16 17:11:11 crc kubenswrapper[5120]: E0316 17:11:11.518233 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ec1fdc9d-ea9b-40bc-8f2b-a7287d275c5d-operator-scripts podName:ec1fdc9d-ea9b-40bc-8f2b-a7287d275c5d nodeName:}" failed. No retries permitted until 2026-03-16 17:11:13.518215573 +0000 UTC m=+5975.672147230 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/ec1fdc9d-ea9b-40bc-8f2b-a7287d275c5d-operator-scripts") pod "root-account-create-update-74dg4" (UID: "ec1fdc9d-ea9b-40bc-8f2b-a7287d275c5d") : configmap "openstack-cell1-scripts" not found Mar 16 17:11:11 crc kubenswrapper[5120]: E0316 17:11:11.521372 5120 projected.go:194] Error preparing data for projected volume kube-api-access-wqp7q for pod openstack-kuttl-tests/root-account-create-update-74dg4: failed to fetch token: serviceaccounts "galera-openstack-cell1" not found Mar 16 17:11:11 crc kubenswrapper[5120]: E0316 17:11:11.521467 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ec1fdc9d-ea9b-40bc-8f2b-a7287d275c5d-kube-api-access-wqp7q podName:ec1fdc9d-ea9b-40bc-8f2b-a7287d275c5d nodeName:}" failed. No retries permitted until 2026-03-16 17:11:13.521441752 +0000 UTC m=+5975.675373409 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-wqp7q" (UniqueName: "kubernetes.io/projected/ec1fdc9d-ea9b-40bc-8f2b-a7287d275c5d-kube-api-access-wqp7q") pod "root-account-create-update-74dg4" (UID: "ec1fdc9d-ea9b-40bc-8f2b-a7287d275c5d") : failed to fetch token: serviceaccounts "galera-openstack-cell1" not found Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.526670 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-tphh5"] Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.535594 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.535894 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podUID="d71c12b8-f085-4c19-99c6-f32186225f37" containerName="nova-cell1-novncproxy-novncproxy" containerID="cri-o://cccaa42f1ab1de1bb520c971a2c5ed0d72121384b8eff62fa4e74f4362185505" gracePeriod=30 Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.540112 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa8d6c88-cfc9-4ead-974d-005ae362769a-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "fa8d6c88-cfc9-4ead-974d-005ae362769a" (UID: "fa8d6c88-cfc9-4ead-974d-005ae362769a"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.547704 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage08-crc" (UniqueName: "kubernetes.io/local-volume/local-storage08-crc") on node "crc" Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.550248 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-34b5-account-create-update-l4fc7"] Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.550830 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/openstack-cell1-galera-0" podUID="9009d26a-9c60-48c3-981f-41e60a03545d" containerName="galera" containerID="cri-o://33961ef2975a425dd7210db90373c59aec60bdd5c1d85eaf062818262e6fb1af" gracePeriod=30 Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.555891 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa8d6c88-cfc9-4ead-974d-005ae362769a-ovsdbserver-nb-tls-certs" (OuterVolumeSpecName: "ovsdbserver-nb-tls-certs") pod "fa8d6c88-cfc9-4ead-974d-005ae362769a" (UID: "fa8d6c88-cfc9-4ead-974d-005ae362769a"). InnerVolumeSpecName "ovsdbserver-nb-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.560201 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-db-create-spg6n"] Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.568591 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-74dg4"] Mar 16 17:11:11 crc kubenswrapper[5120]: E0316 17:11:11.570115 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-wqp7q operator-scripts], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openstack-kuttl-tests/root-account-create-update-74dg4" podUID="ec1fdc9d-ea9b-40bc-8f2b-a7287d275c5d" Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.576428 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-db-create-spg6n"] Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.587646 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-92qrl"] Mar 16 17:11:11 crc kubenswrapper[5120]: E0316 17:11:11.604967 5120 kuberuntime_manager.go:1358] "Unhandled Error" err=< Mar 16 17:11:11 crc kubenswrapper[5120]: container &Container{Name:mariadb-account-create-update,Image:quay.io/podified-antelope-centos9/openstack-mariadb@sha256:4caef2b55e01b9a7ee88a22bc69db1893521a91d95c7ad4c8e593f14f17a5f95,Command:[/bin/sh -c #!/bin/bash Mar 16 17:11:11 crc kubenswrapper[5120]: Mar 16 17:11:11 crc kubenswrapper[5120]: MYSQL_REMOTE_HOST="" source /var/lib/operator-scripts/mysql_root_auth.sh Mar 16 17:11:11 crc kubenswrapper[5120]: Mar 16 17:11:11 crc kubenswrapper[5120]: export DatabasePassword=${DatabasePassword:?"Please specify a DatabasePassword variable."} Mar 16 17:11:11 crc kubenswrapper[5120]: Mar 16 17:11:11 crc kubenswrapper[5120]: MYSQL_CMD="mysql -h -u root -P 3306" Mar 16 17:11:11 crc kubenswrapper[5120]: Mar 16 17:11:11 crc kubenswrapper[5120]: if [ -n "glance" ]; then Mar 16 17:11:11 crc kubenswrapper[5120]: GRANT_DATABASE="glance" Mar 16 17:11:11 crc kubenswrapper[5120]: else Mar 16 17:11:11 crc kubenswrapper[5120]: GRANT_DATABASE="*" Mar 16 17:11:11 crc kubenswrapper[5120]: fi Mar 16 17:11:11 crc kubenswrapper[5120]: Mar 16 17:11:11 crc kubenswrapper[5120]: # going for maximum compatibility here: Mar 16 17:11:11 crc kubenswrapper[5120]: # 1. MySQL 8 no longer allows implicit create user when GRANT is used Mar 16 17:11:11 crc kubenswrapper[5120]: # 2. MariaDB has "CREATE OR REPLACE", but MySQL does not Mar 16 17:11:11 crc kubenswrapper[5120]: # 3. create user with CREATE but then do all password and TLS with ALTER to Mar 16 17:11:11 crc kubenswrapper[5120]: # support updates Mar 16 17:11:11 crc kubenswrapper[5120]: Mar 16 17:11:11 crc kubenswrapper[5120]: $MYSQL_CMD < logger="UnhandledError" Mar 16 17:11:11 crc kubenswrapper[5120]: E0316 17:11:11.606216 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"mariadb-account-create-update\" with CreateContainerConfigError: \"secret \\\"glance-db-secret\\\" not found\"" pod="openstack-kuttl-tests/glance-34b5-account-create-update-l4fc7" podUID="8ff3ccc4-2e31-4990-862a-98cbd428ae62" Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.616963 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-2cbe-account-create-update-46tlj"] Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.619939 5120 reconciler_common.go:299] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/fa8d6c88-cfc9-4ead-974d-005ae362769a-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.619970 5120 reconciler_common.go:299] "Volume detached for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/fa8d6c88-cfc9-4ead-974d-005ae362769a-ovsdbserver-nb-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.619972 5120 scope.go:117] "RemoveContainer" containerID="c133cde2bb6de9540fd49f580d5a3c063dfae25ba05b7b2819f3fb0d3931f86a" Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.619981 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:11 crc kubenswrapper[5120]: E0316 17:11:11.620062 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 17:11:11 crc kubenswrapper[5120]: E0316 17:11:11.620112 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f659fd59-18da-47e7-b57a-27e7d95a428e-combined-ca-bundle podName:f659fd59-18da-47e7-b57a-27e7d95a428e nodeName:}" failed. No retries permitted until 2026-03-16 17:11:12.620096061 +0000 UTC m=+5974.774027718 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/f659fd59-18da-47e7-b57a-27e7d95a428e-combined-ca-bundle") pod "nova-metadata-0" (UID: "f659fd59-18da-47e7-b57a-27e7d95a428e") : secret "combined-ca-bundle" not found Mar 16 17:11:11 crc kubenswrapper[5120]: E0316 17:11:11.620494 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/nova-metadata-config-data: secret "nova-metadata-config-data" not found Mar 16 17:11:11 crc kubenswrapper[5120]: E0316 17:11:11.620580 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f659fd59-18da-47e7-b57a-27e7d95a428e-config-data podName:f659fd59-18da-47e7-b57a-27e7d95a428e nodeName:}" failed. No retries permitted until 2026-03-16 17:11:12.620563573 +0000 UTC m=+5974.774495230 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/secret/f659fd59-18da-47e7-b57a-27e7d95a428e-config-data") pod "nova-metadata-0" (UID: "f659fd59-18da-47e7-b57a-27e7d95a428e") : secret "nova-metadata-config-data" not found Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.633914 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-2cbe-account-create-update-46tlj"] Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.644775 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-92qrl"] Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.656559 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-d22a-account-create-update-6c6wl"] Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.668178 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-75cx7"] Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.676597 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-d22a-account-create-update-6c6wl"] Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.688702 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-75cx7"] Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.704159 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.704430 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="20d69ce8-08cb-4036-9537-ee82df795777" containerName="ceilometer-central-agent" containerID="cri-o://8ea5fa53ba53da2f8df0c5fe5630ab6fe1340d0e9e5454fd2daf2ed88e5284c3" gracePeriod=30 Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.704892 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="20d69ce8-08cb-4036-9537-ee82df795777" containerName="proxy-httpd" containerID="cri-o://51b07147fdbc2067c1ea52f1c6a60ec3678d5b78364f7d078f09ca7bdbd5c835" gracePeriod=30 Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.704935 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="20d69ce8-08cb-4036-9537-ee82df795777" containerName="sg-core" containerID="cri-o://ed1f823e1481918cca7bdbd4ea81242468423c2660a6ebb3049cd622cc9e94c8" gracePeriod=30 Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.704965 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="20d69ce8-08cb-4036-9537-ee82df795777" containerName="ceilometer-notification-agent" containerID="cri-o://190eefaa41770301d8094d2034f41290cb8b06d88ae11797bddb5c36b08e5075" gracePeriod=30 Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.716109 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.716315 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/kube-state-metrics-0" podUID="483d872a-47d2-44f6-a80a-acf24e5f37c8" containerName="kube-state-metrics" containerID="cri-o://52f34ac885b11da9ee43ba4a878d1623997383148b6223e1da309b744d0c7ee3" gracePeriod=30 Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.725154 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-d475-account-create-update-wx6bw"] Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.733313 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-d475-account-create-update-wx6bw"] Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.740641 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-d475-account-create-update-lzq6q"] Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.744387 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa8d6c88-cfc9-4ead-974d-005ae362769a" containerName="ovsdbserver-nb" Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.744418 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa8d6c88-cfc9-4ead-974d-005ae362769a" containerName="ovsdbserver-nb" Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.744434 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6482e901-6b9d-4e99-b859-40ed46b549e1" containerName="ovsdbserver-sb" Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.744450 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="6482e901-6b9d-4e99-b859-40ed46b549e1" containerName="ovsdbserver-sb" Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.744489 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6482e901-6b9d-4e99-b859-40ed46b549e1" containerName="openstack-network-exporter" Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.744495 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="6482e901-6b9d-4e99-b859-40ed46b549e1" containerName="openstack-network-exporter" Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.744504 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa8d6c88-cfc9-4ead-974d-005ae362769a" containerName="openstack-network-exporter" Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.744511 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa8d6c88-cfc9-4ead-974d-005ae362769a" containerName="openstack-network-exporter" Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.745076 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="6482e901-6b9d-4e99-b859-40ed46b549e1" containerName="openstack-network-exporter" Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.745097 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="6482e901-6b9d-4e99-b859-40ed46b549e1" containerName="ovsdbserver-sb" Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.745108 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="fa8d6c88-cfc9-4ead-974d-005ae362769a" containerName="openstack-network-exporter" Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.745120 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="fa8d6c88-cfc9-4ead-974d-005ae362769a" containerName="ovsdbserver-nb" Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.752234 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-d475-account-create-update-lzq6q" Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.752912 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-d475-account-create-update-lzq6q"] Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.755617 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-db-secret\"" Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.761360 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-pps9b"] Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.798805 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-pps9b"] Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.812986 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-f26kx"] Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.822285 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.825659 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-f26kx"] Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.827436 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q482v\" (UniqueName: \"kubernetes.io/projected/10951fa2-f59a-4ac9-9de4-9a1c46ca5b98-kube-api-access-q482v\") pod \"keystone-d475-account-create-update-lzq6q\" (UID: \"10951fa2-f59a-4ac9-9de4-9a1c46ca5b98\") " pod="openstack-kuttl-tests/keystone-d475-account-create-update-lzq6q" Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.827689 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/10951fa2-f59a-4ac9-9de4-9a1c46ca5b98-operator-scripts\") pod \"keystone-d475-account-create-update-lzq6q\" (UID: \"10951fa2-f59a-4ac9-9de4-9a1c46ca5b98\") " pod="openstack-kuttl-tests/keystone-d475-account-create-update-lzq6q" Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.835464 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-75fdb7754b-cb728"] Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.836146 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/keystone-75fdb7754b-cb728" podUID="a1b86673-6678-41ee-b073-f44c6d447fbc" containerName="keystone-api" containerID="cri-o://21c3374fbc591159449ceb515f67c13006c5efb80bd8f427d0c0d4234d964f54" gracePeriod=30 Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.845600 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-34b5-account-create-update-l4fc7"] Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.862540 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.878674 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-db-create-9rxdh"] Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.904498 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-d475-account-create-update-lzq6q"] Mar 16 17:11:11 crc kubenswrapper[5120]: E0316 17:11:11.909332 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-q482v operator-scripts], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openstack-kuttl-tests/keystone-d475-account-create-update-lzq6q" podUID="10951fa2-f59a-4ac9-9de4-9a1c46ca5b98" Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.916906 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-db-create-9rxdh"] Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.920788 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.921250 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="32194c8a-90a1-4132-9b75-3882418d7f7d" containerName="nova-scheduler-scheduler" containerID="cri-o://3318da5f8965a4f0071e38f2519bc938484ed88a240807dcc6be332ef0847740" gracePeriod=30 Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.929063 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-964xx\" (UniqueName: \"kubernetes.io/projected/140a02f0-df36-49fb-b2bb-b267e350f5c5-kube-api-access-964xx\") pod \"140a02f0-df36-49fb-b2bb-b267e350f5c5\" (UID: \"140a02f0-df36-49fb-b2bb-b267e350f5c5\") " Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.929367 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/140a02f0-df36-49fb-b2bb-b267e350f5c5-combined-ca-bundle\") pod \"140a02f0-df36-49fb-b2bb-b267e350f5c5\" (UID: \"140a02f0-df36-49fb-b2bb-b267e350f5c5\") " Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.929478 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/140a02f0-df36-49fb-b2bb-b267e350f5c5-openstack-config\") pod \"140a02f0-df36-49fb-b2bb-b267e350f5c5\" (UID: \"140a02f0-df36-49fb-b2bb-b267e350f5c5\") " Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.929750 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/140a02f0-df36-49fb-b2bb-b267e350f5c5-openstack-config-secret\") pod \"140a02f0-df36-49fb-b2bb-b267e350f5c5\" (UID: \"140a02f0-df36-49fb-b2bb-b267e350f5c5\") " Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.930358 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q482v\" (UniqueName: \"kubernetes.io/projected/10951fa2-f59a-4ac9-9de4-9a1c46ca5b98-kube-api-access-q482v\") pod \"keystone-d475-account-create-update-lzq6q\" (UID: \"10951fa2-f59a-4ac9-9de4-9a1c46ca5b98\") " pod="openstack-kuttl-tests/keystone-d475-account-create-update-lzq6q" Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.930501 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/10951fa2-f59a-4ac9-9de4-9a1c46ca5b98-operator-scripts\") pod \"keystone-d475-account-create-update-lzq6q\" (UID: \"10951fa2-f59a-4ac9-9de4-9a1c46ca5b98\") " pod="openstack-kuttl-tests/keystone-d475-account-create-update-lzq6q" Mar 16 17:11:11 crc kubenswrapper[5120]: E0316 17:11:11.930686 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Mar 16 17:11:11 crc kubenswrapper[5120]: E0316 17:11:11.930741 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/10951fa2-f59a-4ac9-9de4-9a1c46ca5b98-operator-scripts podName:10951fa2-f59a-4ac9-9de4-9a1c46ca5b98 nodeName:}" failed. No retries permitted until 2026-03-16 17:11:12.430726 +0000 UTC m=+5974.584657657 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/10951fa2-f59a-4ac9-9de4-9a1c46ca5b98-operator-scripts") pod "keystone-d475-account-create-update-lzq6q" (UID: "10951fa2-f59a-4ac9-9de4-9a1c46ca5b98") : configmap "openstack-scripts" not found Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.940813 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.940892 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.941192 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="d0852906-6351-45a9-a44c-0bf3f4c29496" containerName="nova-cell1-conductor-conductor" containerID="cri-o://b4f2581124fb25de73fc35d6d1e068c0f8af119030bc9ac8f4b4c60b39198038" gracePeriod=30 Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.941456 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/memcached-0" podUID="a2a1847f-6881-4af9-b38b-35fd23e3f85e" containerName="memcached" containerID="cri-o://57df3117bc5eda590570b6f64cf2888a4fefbb6ecab492edae999ed27aeffda7" gracePeriod=30 Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.947532 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.947865 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="9a997459-37ba-46a9-9cb8-075f77fa009f" containerName="nova-cell0-conductor-conductor" containerID="cri-o://5f0a1210752c571fbaca2dcbc5e5d9cf5e76f8f1d25ee4f7c4b2ade9932d7436" gracePeriod=30 Mar 16 17:11:11 crc kubenswrapper[5120]: E0316 17:11:11.954802 5120 projected.go:194] Error preparing data for projected volume kube-api-access-q482v for pod openstack-kuttl-tests/keystone-d475-account-create-update-lzq6q: failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 17:11:11 crc kubenswrapper[5120]: E0316 17:11:11.954873 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/10951fa2-f59a-4ac9-9de4-9a1c46ca5b98-kube-api-access-q482v podName:10951fa2-f59a-4ac9-9de4-9a1c46ca5b98 nodeName:}" failed. No retries permitted until 2026-03-16 17:11:12.454854929 +0000 UTC m=+5974.608786576 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-q482v" (UniqueName: "kubernetes.io/projected/10951fa2-f59a-4ac9-9de4-9a1c46ca5b98-kube-api-access-q482v") pod "keystone-d475-account-create-update-lzq6q" (UID: "10951fa2-f59a-4ac9-9de4-9a1c46ca5b98") : failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.954904 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-st2nf"] Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.963171 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-v7jp2"] Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.964739 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/140a02f0-df36-49fb-b2bb-b267e350f5c5-kube-api-access-964xx" (OuterVolumeSpecName: "kube-api-access-964xx") pod "140a02f0-df36-49fb-b2bb-b267e350f5c5" (UID: "140a02f0-df36-49fb-b2bb-b267e350f5c5"). InnerVolumeSpecName "kube-api-access-964xx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.968810 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-st2nf"] Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.978427 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-v7jp2"] Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.988420 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/140a02f0-df36-49fb-b2bb-b267e350f5c5-openstack-config" (OuterVolumeSpecName: "openstack-config") pod "140a02f0-df36-49fb-b2bb-b267e350f5c5" (UID: "140a02f0-df36-49fb-b2bb-b267e350f5c5"). InnerVolumeSpecName "openstack-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.990349 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.997044 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/140a02f0-df36-49fb-b2bb-b267e350f5c5-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "140a02f0-df36-49fb-b2bb-b267e350f5c5" (UID: "140a02f0-df36-49fb-b2bb-b267e350f5c5"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:11:11 crc kubenswrapper[5120]: I0316 17:11:11.997293 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 17:11:12 crc kubenswrapper[5120]: I0316 17:11:12.035384 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-964xx\" (UniqueName: \"kubernetes.io/projected/140a02f0-df36-49fb-b2bb-b267e350f5c5-kube-api-access-964xx\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:12 crc kubenswrapper[5120]: I0316 17:11:12.037309 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/140a02f0-df36-49fb-b2bb-b267e350f5c5-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:12 crc kubenswrapper[5120]: I0316 17:11:12.037443 5120 reconciler_common.go:299] "Volume detached for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/140a02f0-df36-49fb-b2bb-b267e350f5c5-openstack-config\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:12 crc kubenswrapper[5120]: I0316 17:11:12.049955 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/140a02f0-df36-49fb-b2bb-b267e350f5c5-openstack-config-secret" (OuterVolumeSpecName: "openstack-config-secret") pod "140a02f0-df36-49fb-b2bb-b267e350f5c5" (UID: "140a02f0-df36-49fb-b2bb-b267e350f5c5"). InnerVolumeSpecName "openstack-config-secret". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:11:12 crc kubenswrapper[5120]: I0316 17:11:12.140194 5120 reconciler_common.go:299] "Volume detached for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/140a02f0-df36-49fb-b2bb-b267e350f5c5-openstack-config-secret\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:12 crc kubenswrapper[5120]: I0316 17:11:12.209370 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/openstack-galera-0" podUID="466bdf84-87d2-46ac-8f19-914a10b4ad63" containerName="galera" containerID="cri-o://4b969fe349f39efb2301e4ebf45ed1f29a97d12b0b7e6304273d199bd2f72fc7" gracePeriod=30 Mar 16 17:11:12 crc kubenswrapper[5120]: I0316 17:11:12.245998 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-6d6f5fb946-cmmjt" Mar 16 17:11:12 crc kubenswrapper[5120]: E0316 17:11:12.271626 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="3318da5f8965a4f0071e38f2519bc938484ed88a240807dcc6be332ef0847740" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 17:11:12 crc kubenswrapper[5120]: E0316 17:11:12.273468 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="3318da5f8965a4f0071e38f2519bc938484ed88a240807dcc6be332ef0847740" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 17:11:12 crc kubenswrapper[5120]: E0316 17:11:12.276306 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="3318da5f8965a4f0071e38f2519bc938484ed88a240807dcc6be332ef0847740" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 17:11:12 crc kubenswrapper[5120]: E0316 17:11:12.276360 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="32194c8a-90a1-4132-9b75-3882418d7f7d" containerName="nova-scheduler-scheduler" probeResult="unknown" Mar 16 17:11:12 crc kubenswrapper[5120]: I0316 17:11:12.344875 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/4f3e991c-b99b-4665-b5df-a900935e3c99-etc-swift\") pod \"4f3e991c-b99b-4665-b5df-a900935e3c99\" (UID: \"4f3e991c-b99b-4665-b5df-a900935e3c99\") " Mar 16 17:11:12 crc kubenswrapper[5120]: I0316 17:11:12.345002 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/4f3e991c-b99b-4665-b5df-a900935e3c99-public-tls-certs\") pod \"4f3e991c-b99b-4665-b5df-a900935e3c99\" (UID: \"4f3e991c-b99b-4665-b5df-a900935e3c99\") " Mar 16 17:11:12 crc kubenswrapper[5120]: I0316 17:11:12.345122 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/4f3e991c-b99b-4665-b5df-a900935e3c99-log-httpd\") pod \"4f3e991c-b99b-4665-b5df-a900935e3c99\" (UID: \"4f3e991c-b99b-4665-b5df-a900935e3c99\") " Mar 16 17:11:12 crc kubenswrapper[5120]: I0316 17:11:12.345200 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/4f3e991c-b99b-4665-b5df-a900935e3c99-run-httpd\") pod \"4f3e991c-b99b-4665-b5df-a900935e3c99\" (UID: \"4f3e991c-b99b-4665-b5df-a900935e3c99\") " Mar 16 17:11:12 crc kubenswrapper[5120]: I0316 17:11:12.345304 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4f3e991c-b99b-4665-b5df-a900935e3c99-config-data\") pod \"4f3e991c-b99b-4665-b5df-a900935e3c99\" (UID: \"4f3e991c-b99b-4665-b5df-a900935e3c99\") " Mar 16 17:11:12 crc kubenswrapper[5120]: I0316 17:11:12.345357 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8487d\" (UniqueName: \"kubernetes.io/projected/4f3e991c-b99b-4665-b5df-a900935e3c99-kube-api-access-8487d\") pod \"4f3e991c-b99b-4665-b5df-a900935e3c99\" (UID: \"4f3e991c-b99b-4665-b5df-a900935e3c99\") " Mar 16 17:11:12 crc kubenswrapper[5120]: I0316 17:11:12.345450 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4f3e991c-b99b-4665-b5df-a900935e3c99-combined-ca-bundle\") pod \"4f3e991c-b99b-4665-b5df-a900935e3c99\" (UID: \"4f3e991c-b99b-4665-b5df-a900935e3c99\") " Mar 16 17:11:12 crc kubenswrapper[5120]: I0316 17:11:12.346750 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/4f3e991c-b99b-4665-b5df-a900935e3c99-internal-tls-certs\") pod \"4f3e991c-b99b-4665-b5df-a900935e3c99\" (UID: \"4f3e991c-b99b-4665-b5df-a900935e3c99\") " Mar 16 17:11:12 crc kubenswrapper[5120]: I0316 17:11:12.350820 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f3e991c-b99b-4665-b5df-a900935e3c99-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "4f3e991c-b99b-4665-b5df-a900935e3c99" (UID: "4f3e991c-b99b-4665-b5df-a900935e3c99"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:11:12 crc kubenswrapper[5120]: I0316 17:11:12.360241 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f3e991c-b99b-4665-b5df-a900935e3c99-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "4f3e991c-b99b-4665-b5df-a900935e3c99" (UID: "4f3e991c-b99b-4665-b5df-a900935e3c99"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:11:12 crc kubenswrapper[5120]: I0316 17:11:12.373993 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f3e991c-b99b-4665-b5df-a900935e3c99-kube-api-access-8487d" (OuterVolumeSpecName: "kube-api-access-8487d") pod "4f3e991c-b99b-4665-b5df-a900935e3c99" (UID: "4f3e991c-b99b-4665-b5df-a900935e3c99"). InnerVolumeSpecName "kube-api-access-8487d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:11:12 crc kubenswrapper[5120]: I0316 17:11:12.381464 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f3e991c-b99b-4665-b5df-a900935e3c99-etc-swift" (OuterVolumeSpecName: "etc-swift") pod "4f3e991c-b99b-4665-b5df-a900935e3c99" (UID: "4f3e991c-b99b-4665-b5df-a900935e3c99"). InnerVolumeSpecName "etc-swift". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:11:12 crc kubenswrapper[5120]: I0316 17:11:12.400743 5120 generic.go:358] "Generic (PLEG): container finished" podID="cb59b894-da6e-4bd0-85c3-2330d90f2fb9" containerID="8bcc4d1eccd2cd8a10222f683f4348aa58be8aacd639247e66f7eb971210636b" exitCode=143 Mar 16 17:11:12 crc kubenswrapper[5120]: I0316 17:11:12.404147 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-7dd9fb87c6-wk9p7" event={"ID":"cb59b894-da6e-4bd0-85c3-2330d90f2fb9","Type":"ContainerDied","Data":"8bcc4d1eccd2cd8a10222f683f4348aa58be8aacd639247e66f7eb971210636b"} Mar 16 17:11:12 crc kubenswrapper[5120]: I0316 17:11:12.411664 5120 generic.go:358] "Generic (PLEG): container finished" podID="20d69ce8-08cb-4036-9537-ee82df795777" containerID="51b07147fdbc2067c1ea52f1c6a60ec3678d5b78364f7d078f09ca7bdbd5c835" exitCode=0 Mar 16 17:11:12 crc kubenswrapper[5120]: I0316 17:11:12.412388 5120 generic.go:358] "Generic (PLEG): container finished" podID="20d69ce8-08cb-4036-9537-ee82df795777" containerID="ed1f823e1481918cca7bdbd4ea81242468423c2660a6ebb3049cd622cc9e94c8" exitCode=2 Mar 16 17:11:12 crc kubenswrapper[5120]: I0316 17:11:12.413131 5120 generic.go:358] "Generic (PLEG): container finished" podID="20d69ce8-08cb-4036-9537-ee82df795777" containerID="8ea5fa53ba53da2f8df0c5fe5630ab6fe1340d0e9e5454fd2daf2ed88e5284c3" exitCode=0 Mar 16 17:11:12 crc kubenswrapper[5120]: I0316 17:11:12.411884 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"20d69ce8-08cb-4036-9537-ee82df795777","Type":"ContainerDied","Data":"51b07147fdbc2067c1ea52f1c6a60ec3678d5b78364f7d078f09ca7bdbd5c835"} Mar 16 17:11:12 crc kubenswrapper[5120]: I0316 17:11:12.413467 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"20d69ce8-08cb-4036-9537-ee82df795777","Type":"ContainerDied","Data":"ed1f823e1481918cca7bdbd4ea81242468423c2660a6ebb3049cd622cc9e94c8"} Mar 16 17:11:12 crc kubenswrapper[5120]: I0316 17:11:12.413569 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"20d69ce8-08cb-4036-9537-ee82df795777","Type":"ContainerDied","Data":"8ea5fa53ba53da2f8df0c5fe5630ab6fe1340d0e9e5454fd2daf2ed88e5284c3"} Mar 16 17:11:12 crc kubenswrapper[5120]: I0316 17:11:12.423101 5120 generic.go:358] "Generic (PLEG): container finished" podID="1b7d191f-d557-4a83-829b-bad5a5ed7dbb" containerID="7910ed697b40b1459f42e3b89f80666792021d8e9714d9012682a2dbde466be8" exitCode=143 Mar 16 17:11:12 crc kubenswrapper[5120]: I0316 17:11:12.423457 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-7d8dcb56b8-42f9n" event={"ID":"1b7d191f-d557-4a83-829b-bad5a5ed7dbb","Type":"ContainerDied","Data":"7910ed697b40b1459f42e3b89f80666792021d8e9714d9012682a2dbde466be8"} Mar 16 17:11:12 crc kubenswrapper[5120]: I0316 17:11:12.428822 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4f3e991c-b99b-4665-b5df-a900935e3c99-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "4f3e991c-b99b-4665-b5df-a900935e3c99" (UID: "4f3e991c-b99b-4665-b5df-a900935e3c99"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:11:12 crc kubenswrapper[5120]: I0316 17:11:12.429211 5120 generic.go:358] "Generic (PLEG): container finished" podID="483d872a-47d2-44f6-a80a-acf24e5f37c8" containerID="52f34ac885b11da9ee43ba4a878d1623997383148b6223e1da309b744d0c7ee3" exitCode=2 Mar 16 17:11:12 crc kubenswrapper[5120]: I0316 17:11:12.429265 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"483d872a-47d2-44f6-a80a-acf24e5f37c8","Type":"ContainerDied","Data":"52f34ac885b11da9ee43ba4a878d1623997383148b6223e1da309b744d0c7ee3"} Mar 16 17:11:12 crc kubenswrapper[5120]: I0316 17:11:12.431437 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Mar 16 17:11:12 crc kubenswrapper[5120]: I0316 17:11:12.431815 5120 scope.go:117] "RemoveContainer" containerID="e2183bcba7b9ba237a63c8b8b38663b980601a86090e8c6ae375714527039f8d" Mar 16 17:11:12 crc kubenswrapper[5120]: I0316 17:11:12.437672 5120 generic.go:358] "Generic (PLEG): container finished" podID="e491da9b-3bac-45f2-b9f5-41af945fe1eb" containerID="50ba6f99478a2553d827336920b5f82ff35d489c47d9082dbe0a248bce182ecc" exitCode=143 Mar 16 17:11:12 crc kubenswrapper[5120]: I0316 17:11:12.437749 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-6f95f9d4f9-4kmmn" event={"ID":"e491da9b-3bac-45f2-b9f5-41af945fe1eb","Type":"ContainerDied","Data":"50ba6f99478a2553d827336920b5f82ff35d489c47d9082dbe0a248bce182ecc"} Mar 16 17:11:12 crc kubenswrapper[5120]: I0316 17:11:12.452178 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/10951fa2-f59a-4ac9-9de4-9a1c46ca5b98-operator-scripts\") pod \"keystone-d475-account-create-update-lzq6q\" (UID: \"10951fa2-f59a-4ac9-9de4-9a1c46ca5b98\") " pod="openstack-kuttl-tests/keystone-d475-account-create-update-lzq6q" Mar 16 17:11:12 crc kubenswrapper[5120]: I0316 17:11:12.452477 5120 reconciler_common.go:299] "Volume detached for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/4f3e991c-b99b-4665-b5df-a900935e3c99-etc-swift\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:12 crc kubenswrapper[5120]: I0316 17:11:12.452497 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/4f3e991c-b99b-4665-b5df-a900935e3c99-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:12 crc kubenswrapper[5120]: I0316 17:11:12.452510 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/4f3e991c-b99b-4665-b5df-a900935e3c99-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:12 crc kubenswrapper[5120]: I0316 17:11:12.452520 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/4f3e991c-b99b-4665-b5df-a900935e3c99-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:12 crc kubenswrapper[5120]: I0316 17:11:12.452531 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8487d\" (UniqueName: \"kubernetes.io/projected/4f3e991c-b99b-4665-b5df-a900935e3c99-kube-api-access-8487d\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:12 crc kubenswrapper[5120]: E0316 17:11:12.452603 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Mar 16 17:11:12 crc kubenswrapper[5120]: E0316 17:11:12.452667 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/10951fa2-f59a-4ac9-9de4-9a1c46ca5b98-operator-scripts podName:10951fa2-f59a-4ac9-9de4-9a1c46ca5b98 nodeName:}" failed. No retries permitted until 2026-03-16 17:11:13.452649519 +0000 UTC m=+5975.606581176 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/10951fa2-f59a-4ac9-9de4-9a1c46ca5b98-operator-scripts") pod "keystone-d475-account-create-update-lzq6q" (UID: "10951fa2-f59a-4ac9-9de4-9a1c46ca5b98") : configmap "openstack-scripts" not found Mar 16 17:11:12 crc kubenswrapper[5120]: I0316 17:11:12.453618 5120 generic.go:358] "Generic (PLEG): container finished" podID="6e4e8c65-5607-4f79-ba90-208ca1a32521" containerID="8068446c44f56d29481ac3b9d2b0df62ffc47e46509fc2d2da921fb2004e7286" exitCode=0 Mar 16 17:11:12 crc kubenswrapper[5120]: I0316 17:11:12.453698 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"6e4e8c65-5607-4f79-ba90-208ca1a32521","Type":"ContainerDied","Data":"8068446c44f56d29481ac3b9d2b0df62ffc47e46509fc2d2da921fb2004e7286"} Mar 16 17:11:12 crc kubenswrapper[5120]: I0316 17:11:12.468938 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4f3e991c-b99b-4665-b5df-a900935e3c99-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "4f3e991c-b99b-4665-b5df-a900935e3c99" (UID: "4f3e991c-b99b-4665-b5df-a900935e3c99"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:11:12 crc kubenswrapper[5120]: I0316 17:11:12.479521 5120 generic.go:358] "Generic (PLEG): container finished" podID="f659fd59-18da-47e7-b57a-27e7d95a428e" containerID="0b4187a33cd16e54176afbc1797048bc385a980bce807ea18a2f5bf975e838fa" exitCode=143 Mar 16 17:11:12 crc kubenswrapper[5120]: I0316 17:11:12.479797 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"f659fd59-18da-47e7-b57a-27e7d95a428e","Type":"ContainerDied","Data":"0b4187a33cd16e54176afbc1797048bc385a980bce807ea18a2f5bf975e838fa"} Mar 16 17:11:12 crc kubenswrapper[5120]: I0316 17:11:12.480015 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4f3e991c-b99b-4665-b5df-a900935e3c99-config-data" (OuterVolumeSpecName: "config-data") pod "4f3e991c-b99b-4665-b5df-a900935e3c99" (UID: "4f3e991c-b99b-4665-b5df-a900935e3c99"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:11:12 crc kubenswrapper[5120]: I0316 17:11:12.495113 5120 generic.go:358] "Generic (PLEG): container finished" podID="9009d26a-9c60-48c3-981f-41e60a03545d" containerID="33961ef2975a425dd7210db90373c59aec60bdd5c1d85eaf062818262e6fb1af" exitCode=0 Mar 16 17:11:12 crc kubenswrapper[5120]: I0316 17:11:12.495365 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"9009d26a-9c60-48c3-981f-41e60a03545d","Type":"ContainerDied","Data":"33961ef2975a425dd7210db90373c59aec60bdd5c1d85eaf062818262e6fb1af"} Mar 16 17:11:12 crc kubenswrapper[5120]: I0316 17:11:12.500285 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4f3e991c-b99b-4665-b5df-a900935e3c99-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "4f3e991c-b99b-4665-b5df-a900935e3c99" (UID: "4f3e991c-b99b-4665-b5df-a900935e3c99"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:11:12 crc kubenswrapper[5120]: I0316 17:11:12.511817 5120 generic.go:358] "Generic (PLEG): container finished" podID="8c67a3db-090c-4122-baa3-57a35abe4a77" containerID="73ed0a55f7c6e413c01b8128322ec99568e0ead33b66931a7b20ec0e5c812b79" exitCode=0 Mar 16 17:11:12 crc kubenswrapper[5120]: I0316 17:11:12.511841 5120 generic.go:358] "Generic (PLEG): container finished" podID="8c67a3db-090c-4122-baa3-57a35abe4a77" containerID="f95d08633e13a2f886a5e2ffcf7ff8812d6b9d89d3404c7418c501f94509e1e5" exitCode=0 Mar 16 17:11:12 crc kubenswrapper[5120]: I0316 17:11:12.511849 5120 generic.go:358] "Generic (PLEG): container finished" podID="8c67a3db-090c-4122-baa3-57a35abe4a77" containerID="cada37d138fe1100f7adc594e98ea94d57976e07351e011bc535d9982f6320a9" exitCode=0 Mar 16 17:11:12 crc kubenswrapper[5120]: I0316 17:11:12.512037 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"8c67a3db-090c-4122-baa3-57a35abe4a77","Type":"ContainerDied","Data":"73ed0a55f7c6e413c01b8128322ec99568e0ead33b66931a7b20ec0e5c812b79"} Mar 16 17:11:12 crc kubenswrapper[5120]: I0316 17:11:12.512066 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"8c67a3db-090c-4122-baa3-57a35abe4a77","Type":"ContainerDied","Data":"f95d08633e13a2f886a5e2ffcf7ff8812d6b9d89d3404c7418c501f94509e1e5"} Mar 16 17:11:12 crc kubenswrapper[5120]: I0316 17:11:12.512076 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"8c67a3db-090c-4122-baa3-57a35abe4a77","Type":"ContainerDied","Data":"cada37d138fe1100f7adc594e98ea94d57976e07351e011bc535d9982f6320a9"} Mar 16 17:11:12 crc kubenswrapper[5120]: I0316 17:11:12.514481 5120 generic.go:358] "Generic (PLEG): container finished" podID="4f3e991c-b99b-4665-b5df-a900935e3c99" containerID="83333ee2767aae44602f3c8de136407f7f927fe1b5a6b91c23afde50bd3211f3" exitCode=0 Mar 16 17:11:12 crc kubenswrapper[5120]: I0316 17:11:12.514499 5120 generic.go:358] "Generic (PLEG): container finished" podID="4f3e991c-b99b-4665-b5df-a900935e3c99" containerID="17ad1d58f4006f4071154741b686529cb6523ce7177fcd8c97be538f5ae1952f" exitCode=0 Mar 16 17:11:12 crc kubenswrapper[5120]: I0316 17:11:12.514559 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-6d6f5fb946-cmmjt" event={"ID":"4f3e991c-b99b-4665-b5df-a900935e3c99","Type":"ContainerDied","Data":"83333ee2767aae44602f3c8de136407f7f927fe1b5a6b91c23afde50bd3211f3"} Mar 16 17:11:12 crc kubenswrapper[5120]: I0316 17:11:12.514582 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-6d6f5fb946-cmmjt" event={"ID":"4f3e991c-b99b-4665-b5df-a900935e3c99","Type":"ContainerDied","Data":"17ad1d58f4006f4071154741b686529cb6523ce7177fcd8c97be538f5ae1952f"} Mar 16 17:11:12 crc kubenswrapper[5120]: I0316 17:11:12.514592 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-6d6f5fb946-cmmjt" event={"ID":"4f3e991c-b99b-4665-b5df-a900935e3c99","Type":"ContainerDied","Data":"6b150ac7f6dae1cf5924cbb960f50bff0bc7739d5d8f1c80e605c630da985d35"} Mar 16 17:11:12 crc kubenswrapper[5120]: I0316 17:11:12.514656 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-6d6f5fb946-cmmjt" Mar 16 17:11:12 crc kubenswrapper[5120]: I0316 17:11:12.559911 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q482v\" (UniqueName: \"kubernetes.io/projected/10951fa2-f59a-4ac9-9de4-9a1c46ca5b98-kube-api-access-q482v\") pod \"keystone-d475-account-create-update-lzq6q\" (UID: \"10951fa2-f59a-4ac9-9de4-9a1c46ca5b98\") " pod="openstack-kuttl-tests/keystone-d475-account-create-update-lzq6q" Mar 16 17:11:12 crc kubenswrapper[5120]: E0316 17:11:12.560625 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Mar 16 17:11:12 crc kubenswrapper[5120]: E0316 17:11:12.560698 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/259e8ab8-dfd3-414c-b392-951a9f770559-config-data podName:259e8ab8-dfd3-414c-b392-951a9f770559 nodeName:}" failed. No retries permitted until 2026-03-16 17:11:16.560676945 +0000 UTC m=+5978.714608662 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/259e8ab8-dfd3-414c-b392-951a9f770559-config-data") pod "rabbitmq-cell1-server-0" (UID: "259e8ab8-dfd3-414c-b392-951a9f770559") : configmap "rabbitmq-cell1-config-data" not found Mar 16 17:11:12 crc kubenswrapper[5120]: I0316 17:11:12.560724 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/4f3e991c-b99b-4665-b5df-a900935e3c99-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:12 crc kubenswrapper[5120]: I0316 17:11:12.560745 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4f3e991c-b99b-4665-b5df-a900935e3c99-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:12 crc kubenswrapper[5120]: I0316 17:11:12.560754 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4f3e991c-b99b-4665-b5df-a900935e3c99-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:12 crc kubenswrapper[5120]: E0316 17:11:12.566267 5120 projected.go:194] Error preparing data for projected volume kube-api-access-q482v for pod openstack-kuttl-tests/keystone-d475-account-create-update-lzq6q: failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 17:11:12 crc kubenswrapper[5120]: E0316 17:11:12.566401 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/10951fa2-f59a-4ac9-9de4-9a1c46ca5b98-kube-api-access-q482v podName:10951fa2-f59a-4ac9-9de4-9a1c46ca5b98 nodeName:}" failed. No retries permitted until 2026-03-16 17:11:13.566377351 +0000 UTC m=+5975.720309008 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-q482v" (UniqueName: "kubernetes.io/projected/10951fa2-f59a-4ac9-9de4-9a1c46ca5b98-kube-api-access-q482v") pod "keystone-d475-account-create-update-lzq6q" (UID: "10951fa2-f59a-4ac9-9de4-9a1c46ca5b98") : failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 17:11:12 crc kubenswrapper[5120]: I0316 17:11:12.581270 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_fa8d6c88-cfc9-4ead-974d-005ae362769a/ovsdbserver-nb/0.log" Mar 16 17:11:12 crc kubenswrapper[5120]: I0316 17:11:12.582572 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"fa8d6c88-cfc9-4ead-974d-005ae362769a","Type":"ContainerDied","Data":"7b73922c63e780c288644e1cb66b743794cf0f68ca94a187cf062cab9c239364"} Mar 16 17:11:12 crc kubenswrapper[5120]: I0316 17:11:12.582782 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:11:12 crc kubenswrapper[5120]: I0316 17:11:12.603030 5120 generic.go:358] "Generic (PLEG): container finished" podID="d71c12b8-f085-4c19-99c6-f32186225f37" containerID="cccaa42f1ab1de1bb520c971a2c5ed0d72121384b8eff62fa4e74f4362185505" exitCode=0 Mar 16 17:11:12 crc kubenswrapper[5120]: I0316 17:11:12.603287 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"d71c12b8-f085-4c19-99c6-f32186225f37","Type":"ContainerDied","Data":"cccaa42f1ab1de1bb520c971a2c5ed0d72121384b8eff62fa4e74f4362185505"} Mar 16 17:11:12 crc kubenswrapper[5120]: I0316 17:11:12.606441 5120 generic.go:358] "Generic (PLEG): container finished" podID="d4da2790-525e-44f0-bddd-c5edbb04ae32" containerID="1e924a770f65d5ad514a8ac7bd29e74fcd80c4839b439debaf9aba0634fa1121" exitCode=143 Mar 16 17:11:12 crc kubenswrapper[5120]: I0316 17:11:12.606525 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"d4da2790-525e-44f0-bddd-c5edbb04ae32","Type":"ContainerDied","Data":"1e924a770f65d5ad514a8ac7bd29e74fcd80c4839b439debaf9aba0634fa1121"} Mar 16 17:11:12 crc kubenswrapper[5120]: I0316 17:11:12.612897 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-74dg4" Mar 16 17:11:12 crc kubenswrapper[5120]: I0316 17:11:12.613572 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-34b5-account-create-update-l4fc7" event={"ID":"8ff3ccc4-2e31-4990-862a-98cbd428ae62","Type":"ContainerStarted","Data":"0fd18b006a0bdf3e24770a2891437bdfbdfb3256e9b7d648c0f4e015a44c8417"} Mar 16 17:11:12 crc kubenswrapper[5120]: I0316 17:11:12.613623 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-d475-account-create-update-lzq6q" Mar 16 17:11:12 crc kubenswrapper[5120]: I0316 17:11:12.614648 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-zc7hd"] Mar 16 17:11:12 crc kubenswrapper[5120]: E0316 17:11:12.663254 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 17:11:12 crc kubenswrapper[5120]: E0316 17:11:12.663316 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f659fd59-18da-47e7-b57a-27e7d95a428e-combined-ca-bundle podName:f659fd59-18da-47e7-b57a-27e7d95a428e nodeName:}" failed. No retries permitted until 2026-03-16 17:11:14.663301222 +0000 UTC m=+5976.817232879 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/f659fd59-18da-47e7-b57a-27e7d95a428e-combined-ca-bundle") pod "nova-metadata-0" (UID: "f659fd59-18da-47e7-b57a-27e7d95a428e") : secret "combined-ca-bundle" not found Mar 16 17:11:12 crc kubenswrapper[5120]: E0316 17:11:12.663958 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/nova-metadata-config-data: secret "nova-metadata-config-data" not found Mar 16 17:11:12 crc kubenswrapper[5120]: E0316 17:11:12.664016 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f659fd59-18da-47e7-b57a-27e7d95a428e-config-data podName:f659fd59-18da-47e7-b57a-27e7d95a428e nodeName:}" failed. No retries permitted until 2026-03-16 17:11:14.664004082 +0000 UTC m=+5976.817935739 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/secret/f659fd59-18da-47e7-b57a-27e7d95a428e-config-data") pod "nova-metadata-0" (UID: "f659fd59-18da-47e7-b57a-27e7d95a428e") : secret "nova-metadata-config-data" not found Mar 16 17:11:12 crc kubenswrapper[5120]: I0316 17:11:12.684888 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="140a02f0-df36-49fb-b2bb-b267e350f5c5" path="/var/lib/kubelet/pods/140a02f0-df36-49fb-b2bb-b267e350f5c5/volumes" Mar 16 17:11:12 crc kubenswrapper[5120]: I0316 17:11:12.685490 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="18615479-af1d-4771-95d5-ef6581ecc5f7" path="/var/lib/kubelet/pods/18615479-af1d-4771-95d5-ef6581ecc5f7/volumes" Mar 16 17:11:12 crc kubenswrapper[5120]: I0316 17:11:12.686018 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e1e9b50-de11-457e-a169-242ab16075b2" path="/var/lib/kubelet/pods/2e1e9b50-de11-457e-a169-242ab16075b2/volumes" Mar 16 17:11:12 crc kubenswrapper[5120]: I0316 17:11:12.687225 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="35df4ab4-9f08-490e-a061-c219d8312906" path="/var/lib/kubelet/pods/35df4ab4-9f08-490e-a061-c219d8312906/volumes" Mar 16 17:11:12 crc kubenswrapper[5120]: I0316 17:11:12.690393 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3bc621ac-57fe-4689-ac4d-cd47b0909a03" path="/var/lib/kubelet/pods/3bc621ac-57fe-4689-ac4d-cd47b0909a03/volumes" Mar 16 17:11:12 crc kubenswrapper[5120]: I0316 17:11:12.691240 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="49bacc96-e90b-4510-b47a-5012b3d7988e" path="/var/lib/kubelet/pods/49bacc96-e90b-4510-b47a-5012b3d7988e/volumes" Mar 16 17:11:12 crc kubenswrapper[5120]: I0316 17:11:12.692128 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6482e901-6b9d-4e99-b859-40ed46b549e1" path="/var/lib/kubelet/pods/6482e901-6b9d-4e99-b859-40ed46b549e1/volumes" Mar 16 17:11:12 crc kubenswrapper[5120]: I0316 17:11:12.693638 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="83183a55-1c89-4496-b455-9c7e28bee8e3" path="/var/lib/kubelet/pods/83183a55-1c89-4496-b455-9c7e28bee8e3/volumes" Mar 16 17:11:12 crc kubenswrapper[5120]: I0316 17:11:12.694213 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a4ae208c-9690-4d37-bd09-f87420dbe1c1" path="/var/lib/kubelet/pods/a4ae208c-9690-4d37-bd09-f87420dbe1c1/volumes" Mar 16 17:11:12 crc kubenswrapper[5120]: I0316 17:11:12.695460 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a74632f0-ed16-437d-9ae7-509101abc460" path="/var/lib/kubelet/pods/a74632f0-ed16-437d-9ae7-509101abc460/volumes" Mar 16 17:11:12 crc kubenswrapper[5120]: I0316 17:11:12.697815 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="abe5ce91-c17a-44b5-8153-a8ffe8d440e9" path="/var/lib/kubelet/pods/abe5ce91-c17a-44b5-8153-a8ffe8d440e9/volumes" Mar 16 17:11:12 crc kubenswrapper[5120]: I0316 17:11:12.698632 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="df308c5a-dfce-4996-b129-fcc1f36e1743" path="/var/lib/kubelet/pods/df308c5a-dfce-4996-b129-fcc1f36e1743/volumes" Mar 16 17:11:12 crc kubenswrapper[5120]: I0316 17:11:12.699246 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e5b1ed14-6bc8-4405-8d3d-bb32cd972388" path="/var/lib/kubelet/pods/e5b1ed14-6bc8-4405-8d3d-bb32cd972388/volumes" Mar 16 17:11:12 crc kubenswrapper[5120]: I0316 17:11:12.700379 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ee5601d1-7c70-4816-a43f-c43030bcb640" path="/var/lib/kubelet/pods/ee5601d1-7c70-4816-a43f-c43030bcb640/volumes" Mar 16 17:11:12 crc kubenswrapper[5120]: I0316 17:11:12.701213 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ee822a71-2526-491c-bbe7-59b07e4d3218" path="/var/lib/kubelet/pods/ee822a71-2526-491c-bbe7-59b07e4d3218/volumes" Mar 16 17:11:12 crc kubenswrapper[5120]: I0316 17:11:12.702251 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f4aa434d-2a76-4cd1-b875-74b763ad15bd" path="/var/lib/kubelet/pods/f4aa434d-2a76-4cd1-b875-74b763ad15bd/volumes" Mar 16 17:11:12 crc kubenswrapper[5120]: I0316 17:11:12.703883 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f62fd214-379e-4288-be75-3cb17e6bfa0c" path="/var/lib/kubelet/pods/f62fd214-379e-4288-be75-3cb17e6bfa0c/volumes" Mar 16 17:11:12 crc kubenswrapper[5120]: I0316 17:11:12.704529 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f91eb2a7-c2b0-42c9-abf5-a3904c2b2eeb" path="/var/lib/kubelet/pods/f91eb2a7-c2b0-42c9-abf5-a3904c2b2eeb/volumes" Mar 16 17:11:12 crc kubenswrapper[5120]: I0316 17:11:12.962655 5120 scope.go:117] "RemoveContainer" containerID="83333ee2767aae44602f3c8de136407f7f927fe1b5a6b91c23afde50bd3211f3" Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:12.998966 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.025500 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.028891 5120 scope.go:117] "RemoveContainer" containerID="17ad1d58f4006f4071154741b686529cb6523ce7177fcd8c97be538f5ae1952f" Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.068914 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.075482 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-74dg4" Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.076897 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/d71c12b8-f085-4c19-99c6-f32186225f37-vencrypt-tls-certs\") pod \"d71c12b8-f085-4c19-99c6-f32186225f37\" (UID: \"d71c12b8-f085-4c19-99c6-f32186225f37\") " Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.076968 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/483d872a-47d2-44f6-a80a-acf24e5f37c8-kube-state-metrics-tls-config\") pod \"483d872a-47d2-44f6-a80a-acf24e5f37c8\" (UID: \"483d872a-47d2-44f6-a80a-acf24e5f37c8\") " Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.077040 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/d71c12b8-f085-4c19-99c6-f32186225f37-nova-novncproxy-tls-certs\") pod \"d71c12b8-f085-4c19-99c6-f32186225f37\" (UID: \"d71c12b8-f085-4c19-99c6-f32186225f37\") " Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.077060 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/483d872a-47d2-44f6-a80a-acf24e5f37c8-combined-ca-bundle\") pod \"483d872a-47d2-44f6-a80a-acf24e5f37c8\" (UID: \"483d872a-47d2-44f6-a80a-acf24e5f37c8\") " Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.079943 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cxvhs\" (UniqueName: \"kubernetes.io/projected/d71c12b8-f085-4c19-99c6-f32186225f37-kube-api-access-cxvhs\") pod \"d71c12b8-f085-4c19-99c6-f32186225f37\" (UID: \"d71c12b8-f085-4c19-99c6-f32186225f37\") " Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.080034 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d71c12b8-f085-4c19-99c6-f32186225f37-config-data\") pod \"d71c12b8-f085-4c19-99c6-f32186225f37\" (UID: \"d71c12b8-f085-4c19-99c6-f32186225f37\") " Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.080077 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sh4v7\" (UniqueName: \"kubernetes.io/projected/483d872a-47d2-44f6-a80a-acf24e5f37c8-kube-api-access-sh4v7\") pod \"483d872a-47d2-44f6-a80a-acf24e5f37c8\" (UID: \"483d872a-47d2-44f6-a80a-acf24e5f37c8\") " Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.080138 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d71c12b8-f085-4c19-99c6-f32186225f37-combined-ca-bundle\") pod \"d71c12b8-f085-4c19-99c6-f32186225f37\" (UID: \"d71c12b8-f085-4c19-99c6-f32186225f37\") " Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.080270 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/483d872a-47d2-44f6-a80a-acf24e5f37c8-kube-state-metrics-tls-certs\") pod \"483d872a-47d2-44f6-a80a-acf24e5f37c8\" (UID: \"483d872a-47d2-44f6-a80a-acf24e5f37c8\") " Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.081885 5120 scope.go:117] "RemoveContainer" containerID="83333ee2767aae44602f3c8de136407f7f927fe1b5a6b91c23afde50bd3211f3" Mar 16 17:11:13 crc kubenswrapper[5120]: E0316 17:11:13.085361 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"83333ee2767aae44602f3c8de136407f7f927fe1b5a6b91c23afde50bd3211f3\": container with ID starting with 83333ee2767aae44602f3c8de136407f7f927fe1b5a6b91c23afde50bd3211f3 not found: ID does not exist" containerID="83333ee2767aae44602f3c8de136407f7f927fe1b5a6b91c23afde50bd3211f3" Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.085402 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83333ee2767aae44602f3c8de136407f7f927fe1b5a6b91c23afde50bd3211f3"} err="failed to get container status \"83333ee2767aae44602f3c8de136407f7f927fe1b5a6b91c23afde50bd3211f3\": rpc error: code = NotFound desc = could not find container \"83333ee2767aae44602f3c8de136407f7f927fe1b5a6b91c23afde50bd3211f3\": container with ID starting with 83333ee2767aae44602f3c8de136407f7f927fe1b5a6b91c23afde50bd3211f3 not found: ID does not exist" Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.085472 5120 scope.go:117] "RemoveContainer" containerID="17ad1d58f4006f4071154741b686529cb6523ce7177fcd8c97be538f5ae1952f" Mar 16 17:11:13 crc kubenswrapper[5120]: E0316 17:11:13.086286 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"17ad1d58f4006f4071154741b686529cb6523ce7177fcd8c97be538f5ae1952f\": container with ID starting with 17ad1d58f4006f4071154741b686529cb6523ce7177fcd8c97be538f5ae1952f not found: ID does not exist" containerID="17ad1d58f4006f4071154741b686529cb6523ce7177fcd8c97be538f5ae1952f" Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.086328 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17ad1d58f4006f4071154741b686529cb6523ce7177fcd8c97be538f5ae1952f"} err="failed to get container status \"17ad1d58f4006f4071154741b686529cb6523ce7177fcd8c97be538f5ae1952f\": rpc error: code = NotFound desc = could not find container \"17ad1d58f4006f4071154741b686529cb6523ce7177fcd8c97be538f5ae1952f\": container with ID starting with 17ad1d58f4006f4071154741b686529cb6523ce7177fcd8c97be538f5ae1952f not found: ID does not exist" Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.086372 5120 scope.go:117] "RemoveContainer" containerID="83333ee2767aae44602f3c8de136407f7f927fe1b5a6b91c23afde50bd3211f3" Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.086555 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-d475-account-create-update-lzq6q" Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.086987 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83333ee2767aae44602f3c8de136407f7f927fe1b5a6b91c23afde50bd3211f3"} err="failed to get container status \"83333ee2767aae44602f3c8de136407f7f927fe1b5a6b91c23afde50bd3211f3\": rpc error: code = NotFound desc = could not find container \"83333ee2767aae44602f3c8de136407f7f927fe1b5a6b91c23afde50bd3211f3\": container with ID starting with 83333ee2767aae44602f3c8de136407f7f927fe1b5a6b91c23afde50bd3211f3 not found: ID does not exist" Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.087023 5120 scope.go:117] "RemoveContainer" containerID="17ad1d58f4006f4071154741b686529cb6523ce7177fcd8c97be538f5ae1952f" Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.088021 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17ad1d58f4006f4071154741b686529cb6523ce7177fcd8c97be538f5ae1952f"} err="failed to get container status \"17ad1d58f4006f4071154741b686529cb6523ce7177fcd8c97be538f5ae1952f\": rpc error: code = NotFound desc = could not find container \"17ad1d58f4006f4071154741b686529cb6523ce7177fcd8c97be538f5ae1952f\": container with ID starting with 17ad1d58f4006f4071154741b686529cb6523ce7177fcd8c97be538f5ae1952f not found: ID does not exist" Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.088050 5120 scope.go:117] "RemoveContainer" containerID="48f695b820174f4434e930d86a102d88c95f5b423ba918f29f0e70dac0fe7545" Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.113956 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-6f95f9d4f9-4kmmn" Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.116785 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-34b5-account-create-update-l4fc7" Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.133938 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/483d872a-47d2-44f6-a80a-acf24e5f37c8-kube-api-access-sh4v7" (OuterVolumeSpecName: "kube-api-access-sh4v7") pod "483d872a-47d2-44f6-a80a-acf24e5f37c8" (UID: "483d872a-47d2-44f6-a80a-acf24e5f37c8"). InnerVolumeSpecName "kube-api-access-sh4v7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.134115 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d71c12b8-f085-4c19-99c6-f32186225f37-kube-api-access-cxvhs" (OuterVolumeSpecName: "kube-api-access-cxvhs") pod "d71c12b8-f085-4c19-99c6-f32186225f37" (UID: "d71c12b8-f085-4c19-99c6-f32186225f37"). InnerVolumeSpecName "kube-api-access-cxvhs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.144418 5120 scope.go:117] "RemoveContainer" containerID="1ffc97c292aa55c56c3a0b3eec9167bb3bdcfa607e015223082151d77e8b31c8" Mar 16 17:11:13 crc kubenswrapper[5120]: E0316 17:11:13.169591 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 4b969fe349f39efb2301e4ebf45ed1f29a97d12b0b7e6304273d199bd2f72fc7 is running failed: container process not found" containerID="4b969fe349f39efb2301e4ebf45ed1f29a97d12b0b7e6304273d199bd2f72fc7" cmd=["/bin/bash","/var/lib/operator-scripts/mysql_probe.sh","readiness"] Mar 16 17:11:13 crc kubenswrapper[5120]: E0316 17:11:13.170997 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 4b969fe349f39efb2301e4ebf45ed1f29a97d12b0b7e6304273d199bd2f72fc7 is running failed: container process not found" containerID="4b969fe349f39efb2301e4ebf45ed1f29a97d12b0b7e6304273d199bd2f72fc7" cmd=["/bin/bash","/var/lib/operator-scripts/mysql_probe.sh","readiness"] Mar 16 17:11:13 crc kubenswrapper[5120]: E0316 17:11:13.172666 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 4b969fe349f39efb2301e4ebf45ed1f29a97d12b0b7e6304273d199bd2f72fc7 is running failed: container process not found" containerID="4b969fe349f39efb2301e4ebf45ed1f29a97d12b0b7e6304273d199bd2f72fc7" cmd=["/bin/bash","/var/lib/operator-scripts/mysql_probe.sh","readiness"] Mar 16 17:11:13 crc kubenswrapper[5120]: E0316 17:11:13.172726 5120 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 4b969fe349f39efb2301e4ebf45ed1f29a97d12b0b7e6304273d199bd2f72fc7 is running failed: container process not found" probeType="Readiness" pod="openstack-kuttl-tests/openstack-galera-0" podUID="466bdf84-87d2-46ac-8f19-914a10b4ad63" containerName="galera" probeResult="unknown" Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.182543 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/9009d26a-9c60-48c3-981f-41e60a03545d-galera-tls-certs\") pod \"9009d26a-9c60-48c3-981f-41e60a03545d\" (UID: \"9009d26a-9c60-48c3-981f-41e60a03545d\") " Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.182645 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/9009d26a-9c60-48c3-981f-41e60a03545d-config-data-default\") pod \"9009d26a-9c60-48c3-981f-41e60a03545d\" (UID: \"9009d26a-9c60-48c3-981f-41e60a03545d\") " Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.182708 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e491da9b-3bac-45f2-b9f5-41af945fe1eb-config-data\") pod \"e491da9b-3bac-45f2-b9f5-41af945fe1eb\" (UID: \"e491da9b-3bac-45f2-b9f5-41af945fe1eb\") " Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.182802 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/e491da9b-3bac-45f2-b9f5-41af945fe1eb-config-data-custom\") pod \"e491da9b-3bac-45f2-b9f5-41af945fe1eb\" (UID: \"e491da9b-3bac-45f2-b9f5-41af945fe1eb\") " Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.182828 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9009d26a-9c60-48c3-981f-41e60a03545d-operator-scripts\") pod \"9009d26a-9c60-48c3-981f-41e60a03545d\" (UID: \"9009d26a-9c60-48c3-981f-41e60a03545d\") " Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.184382 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"mysql-db\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"9009d26a-9c60-48c3-981f-41e60a03545d\" (UID: \"9009d26a-9c60-48c3-981f-41e60a03545d\") " Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.184462 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9009d26a-9c60-48c3-981f-41e60a03545d-combined-ca-bundle\") pod \"9009d26a-9c60-48c3-981f-41e60a03545d\" (UID: \"9009d26a-9c60-48c3-981f-41e60a03545d\") " Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.184488 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6jdkt\" (UniqueName: \"kubernetes.io/projected/8ff3ccc4-2e31-4990-862a-98cbd428ae62-kube-api-access-6jdkt\") pod \"8ff3ccc4-2e31-4990-862a-98cbd428ae62\" (UID: \"8ff3ccc4-2e31-4990-862a-98cbd428ae62\") " Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.184511 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/9009d26a-9c60-48c3-981f-41e60a03545d-kolla-config\") pod \"9009d26a-9c60-48c3-981f-41e60a03545d\" (UID: \"9009d26a-9c60-48c3-981f-41e60a03545d\") " Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.184564 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8ff3ccc4-2e31-4990-862a-98cbd428ae62-operator-scripts\") pod \"8ff3ccc4-2e31-4990-862a-98cbd428ae62\" (UID: \"8ff3ccc4-2e31-4990-862a-98cbd428ae62\") " Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.184689 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h7sp7\" (UniqueName: \"kubernetes.io/projected/9009d26a-9c60-48c3-981f-41e60a03545d-kube-api-access-h7sp7\") pod \"9009d26a-9c60-48c3-981f-41e60a03545d\" (UID: \"9009d26a-9c60-48c3-981f-41e60a03545d\") " Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.184767 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e491da9b-3bac-45f2-b9f5-41af945fe1eb-combined-ca-bundle\") pod \"e491da9b-3bac-45f2-b9f5-41af945fe1eb\" (UID: \"e491da9b-3bac-45f2-b9f5-41af945fe1eb\") " Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.184914 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7pprv\" (UniqueName: \"kubernetes.io/projected/e491da9b-3bac-45f2-b9f5-41af945fe1eb-kube-api-access-7pprv\") pod \"e491da9b-3bac-45f2-b9f5-41af945fe1eb\" (UID: \"e491da9b-3bac-45f2-b9f5-41af945fe1eb\") " Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.184954 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/9009d26a-9c60-48c3-981f-41e60a03545d-config-data-generated\") pod \"9009d26a-9c60-48c3-981f-41e60a03545d\" (UID: \"9009d26a-9c60-48c3-981f-41e60a03545d\") " Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.185024 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e491da9b-3bac-45f2-b9f5-41af945fe1eb-logs\") pod \"e491da9b-3bac-45f2-b9f5-41af945fe1eb\" (UID: \"e491da9b-3bac-45f2-b9f5-41af945fe1eb\") " Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.185959 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cxvhs\" (UniqueName: \"kubernetes.io/projected/d71c12b8-f085-4c19-99c6-f32186225f37-kube-api-access-cxvhs\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.185982 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sh4v7\" (UniqueName: \"kubernetes.io/projected/483d872a-47d2-44f6-a80a-acf24e5f37c8-kube-api-access-sh4v7\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.186506 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e491da9b-3bac-45f2-b9f5-41af945fe1eb-logs" (OuterVolumeSpecName: "logs") pod "e491da9b-3bac-45f2-b9f5-41af945fe1eb" (UID: "e491da9b-3bac-45f2-b9f5-41af945fe1eb"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.191968 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9009d26a-9c60-48c3-981f-41e60a03545d-config-data-default" (OuterVolumeSpecName: "config-data-default") pod "9009d26a-9c60-48c3-981f-41e60a03545d" (UID: "9009d26a-9c60-48c3-981f-41e60a03545d"). InnerVolumeSpecName "config-data-default". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.196452 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9009d26a-9c60-48c3-981f-41e60a03545d-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "9009d26a-9c60-48c3-981f-41e60a03545d" (UID: "9009d26a-9c60-48c3-981f-41e60a03545d"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.198945 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9009d26a-9c60-48c3-981f-41e60a03545d-kube-api-access-h7sp7" (OuterVolumeSpecName: "kube-api-access-h7sp7") pod "9009d26a-9c60-48c3-981f-41e60a03545d" (UID: "9009d26a-9c60-48c3-981f-41e60a03545d"). InnerVolumeSpecName "kube-api-access-h7sp7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.199525 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9009d26a-9c60-48c3-981f-41e60a03545d-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "9009d26a-9c60-48c3-981f-41e60a03545d" (UID: "9009d26a-9c60-48c3-981f-41e60a03545d"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.200342 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ff3ccc4-2e31-4990-862a-98cbd428ae62-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "8ff3ccc4-2e31-4990-862a-98cbd428ae62" (UID: "8ff3ccc4-2e31-4990-862a-98cbd428ae62"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.200608 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9009d26a-9c60-48c3-981f-41e60a03545d-config-data-generated" (OuterVolumeSpecName: "config-data-generated") pod "9009d26a-9c60-48c3-981f-41e60a03545d" (UID: "9009d26a-9c60-48c3-981f-41e60a03545d"). InnerVolumeSpecName "config-data-generated". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.207827 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ff3ccc4-2e31-4990-862a-98cbd428ae62-kube-api-access-6jdkt" (OuterVolumeSpecName: "kube-api-access-6jdkt") pod "8ff3ccc4-2e31-4990-862a-98cbd428ae62" (UID: "8ff3ccc4-2e31-4990-862a-98cbd428ae62"). InnerVolumeSpecName "kube-api-access-6jdkt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.212148 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e491da9b-3bac-45f2-b9f5-41af945fe1eb-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "e491da9b-3bac-45f2-b9f5-41af945fe1eb" (UID: "e491da9b-3bac-45f2-b9f5-41af945fe1eb"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.212403 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e491da9b-3bac-45f2-b9f5-41af945fe1eb-kube-api-access-7pprv" (OuterVolumeSpecName: "kube-api-access-7pprv") pod "e491da9b-3bac-45f2-b9f5-41af945fe1eb" (UID: "e491da9b-3bac-45f2-b9f5-41af945fe1eb"). InnerVolumeSpecName "kube-api-access-7pprv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.236174 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/483d872a-47d2-44f6-a80a-acf24e5f37c8-kube-state-metrics-tls-config" (OuterVolumeSpecName: "kube-state-metrics-tls-config") pod "483d872a-47d2-44f6-a80a-acf24e5f37c8" (UID: "483d872a-47d2-44f6-a80a-acf24e5f37c8"). InnerVolumeSpecName "kube-state-metrics-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.236775 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/483d872a-47d2-44f6-a80a-acf24e5f37c8-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "483d872a-47d2-44f6-a80a-acf24e5f37c8" (UID: "483d872a-47d2-44f6-a80a-acf24e5f37c8"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.245868 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage04-crc" (OuterVolumeSpecName: "mysql-db") pod "9009d26a-9c60-48c3-981f-41e60a03545d" (UID: "9009d26a-9c60-48c3-981f-41e60a03545d"). InnerVolumeSpecName "local-storage04-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 17:11:13 crc kubenswrapper[5120]: E0316 17:11:13.282628 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="b4f2581124fb25de73fc35d6d1e068c0f8af119030bc9ac8f4b4c60b39198038" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 17:11:13 crc kubenswrapper[5120]: E0316 17:11:13.287279 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="b4f2581124fb25de73fc35d6d1e068c0f8af119030bc9ac8f4b4c60b39198038" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.288960 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") on node \"crc\" " Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.289003 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6jdkt\" (UniqueName: \"kubernetes.io/projected/8ff3ccc4-2e31-4990-862a-98cbd428ae62-kube-api-access-6jdkt\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.289018 5120 reconciler_common.go:299] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/9009d26a-9c60-48c3-981f-41e60a03545d-kolla-config\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.289031 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8ff3ccc4-2e31-4990-862a-98cbd428ae62-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.289045 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h7sp7\" (UniqueName: \"kubernetes.io/projected/9009d26a-9c60-48c3-981f-41e60a03545d-kube-api-access-h7sp7\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.289058 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7pprv\" (UniqueName: \"kubernetes.io/projected/e491da9b-3bac-45f2-b9f5-41af945fe1eb-kube-api-access-7pprv\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.289070 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/9009d26a-9c60-48c3-981f-41e60a03545d-config-data-generated\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.289083 5120 reconciler_common.go:299] "Volume detached for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/483d872a-47d2-44f6-a80a-acf24e5f37c8-kube-state-metrics-tls-config\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.289098 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e491da9b-3bac-45f2-b9f5-41af945fe1eb-logs\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.289111 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/483d872a-47d2-44f6-a80a-acf24e5f37c8-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.289123 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/9009d26a-9c60-48c3-981f-41e60a03545d-config-data-default\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.289135 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/e491da9b-3bac-45f2-b9f5-41af945fe1eb-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.289149 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9009d26a-9c60-48c3-981f-41e60a03545d-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:13 crc kubenswrapper[5120]: E0316 17:11:13.291405 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="b4f2581124fb25de73fc35d6d1e068c0f8af119030bc9ac8f4b4c60b39198038" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 17:11:13 crc kubenswrapper[5120]: E0316 17:11:13.291451 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="d0852906-6351-45a9-a44c-0bf3f4c29496" containerName="nova-cell1-conductor-conductor" probeResult="unknown" Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.326199 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9009d26a-9c60-48c3-981f-41e60a03545d-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "9009d26a-9c60-48c3-981f-41e60a03545d" (UID: "9009d26a-9c60-48c3-981f-41e60a03545d"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.326781 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-7d8dcb56b8-42f9n" Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.334371 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/483d872a-47d2-44f6-a80a-acf24e5f37c8-kube-state-metrics-tls-certs" (OuterVolumeSpecName: "kube-state-metrics-tls-certs") pod "483d872a-47d2-44f6-a80a-acf24e5f37c8" (UID: "483d872a-47d2-44f6-a80a-acf24e5f37c8"). InnerVolumeSpecName "kube-state-metrics-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.340194 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9009d26a-9c60-48c3-981f-41e60a03545d-galera-tls-certs" (OuterVolumeSpecName: "galera-tls-certs") pod "9009d26a-9c60-48c3-981f-41e60a03545d" (UID: "9009d26a-9c60-48c3-981f-41e60a03545d"). InnerVolumeSpecName "galera-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.354844 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e491da9b-3bac-45f2-b9f5-41af945fe1eb-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e491da9b-3bac-45f2-b9f5-41af945fe1eb" (UID: "e491da9b-3bac-45f2-b9f5-41af945fe1eb"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.360084 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d71c12b8-f085-4c19-99c6-f32186225f37-nova-novncproxy-tls-certs" (OuterVolumeSpecName: "nova-novncproxy-tls-certs") pod "d71c12b8-f085-4c19-99c6-f32186225f37" (UID: "d71c12b8-f085-4c19-99c6-f32186225f37"). InnerVolumeSpecName "nova-novncproxy-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.362095 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e491da9b-3bac-45f2-b9f5-41af945fe1eb-config-data" (OuterVolumeSpecName: "config-data") pod "e491da9b-3bac-45f2-b9f5-41af945fe1eb" (UID: "e491da9b-3bac-45f2-b9f5-41af945fe1eb"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.372842 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.381024 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d71c12b8-f085-4c19-99c6-f32186225f37-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "d71c12b8-f085-4c19-99c6-f32186225f37" (UID: "d71c12b8-f085-4c19-99c6-f32186225f37"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.382180 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage04-crc" (UniqueName: "kubernetes.io/local-volume/local-storage04-crc") on node "crc" Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.390439 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rqqbp\" (UniqueName: \"kubernetes.io/projected/1b7d191f-d557-4a83-829b-bad5a5ed7dbb-kube-api-access-rqqbp\") pod \"1b7d191f-d557-4a83-829b-bad5a5ed7dbb\" (UID: \"1b7d191f-d557-4a83-829b-bad5a5ed7dbb\") " Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.390544 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1b7d191f-d557-4a83-829b-bad5a5ed7dbb-combined-ca-bundle\") pod \"1b7d191f-d557-4a83-829b-bad5a5ed7dbb\" (UID: \"1b7d191f-d557-4a83-829b-bad5a5ed7dbb\") " Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.390692 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1b7d191f-d557-4a83-829b-bad5a5ed7dbb-config-data\") pod \"1b7d191f-d557-4a83-829b-bad5a5ed7dbb\" (UID: \"1b7d191f-d557-4a83-829b-bad5a5ed7dbb\") " Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.390810 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/1b7d191f-d557-4a83-829b-bad5a5ed7dbb-logs\") pod \"1b7d191f-d557-4a83-829b-bad5a5ed7dbb\" (UID: \"1b7d191f-d557-4a83-829b-bad5a5ed7dbb\") " Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.390920 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/1b7d191f-d557-4a83-829b-bad5a5ed7dbb-config-data-custom\") pod \"1b7d191f-d557-4a83-829b-bad5a5ed7dbb\" (UID: \"1b7d191f-d557-4a83-829b-bad5a5ed7dbb\") " Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.396314 5120 reconciler_common.go:299] "Volume detached for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/483d872a-47d2-44f6-a80a-acf24e5f37c8-kube-state-metrics-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.396347 5120 reconciler_common.go:299] "Volume detached for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/d71c12b8-f085-4c19-99c6-f32186225f37-nova-novncproxy-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.396362 5120 reconciler_common.go:299] "Volume detached for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/9009d26a-9c60-48c3-981f-41e60a03545d-galera-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.396375 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e491da9b-3bac-45f2-b9f5-41af945fe1eb-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.396387 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.396400 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9009d26a-9c60-48c3-981f-41e60a03545d-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.396413 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e491da9b-3bac-45f2-b9f5-41af945fe1eb-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.396425 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d71c12b8-f085-4c19-99c6-f32186225f37-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.397788 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b7d191f-d557-4a83-829b-bad5a5ed7dbb-logs" (OuterVolumeSpecName: "logs") pod "1b7d191f-d557-4a83-829b-bad5a5ed7dbb" (UID: "1b7d191f-d557-4a83-829b-bad5a5ed7dbb"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.400369 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d71c12b8-f085-4c19-99c6-f32186225f37-config-data" (OuterVolumeSpecName: "config-data") pod "d71c12b8-f085-4c19-99c6-f32186225f37" (UID: "d71c12b8-f085-4c19-99c6-f32186225f37"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.402225 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1b7d191f-d557-4a83-829b-bad5a5ed7dbb-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "1b7d191f-d557-4a83-829b-bad5a5ed7dbb" (UID: "1b7d191f-d557-4a83-829b-bad5a5ed7dbb"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.407972 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b7d191f-d557-4a83-829b-bad5a5ed7dbb-kube-api-access-rqqbp" (OuterVolumeSpecName: "kube-api-access-rqqbp") pod "1b7d191f-d557-4a83-829b-bad5a5ed7dbb" (UID: "1b7d191f-d557-4a83-829b-bad5a5ed7dbb"). InnerVolumeSpecName "kube-api-access-rqqbp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.418345 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d71c12b8-f085-4c19-99c6-f32186225f37-vencrypt-tls-certs" (OuterVolumeSpecName: "vencrypt-tls-certs") pod "d71c12b8-f085-4c19-99c6-f32186225f37" (UID: "d71c12b8-f085-4c19-99c6-f32186225f37"). InnerVolumeSpecName "vencrypt-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.432494 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1b7d191f-d557-4a83-829b-bad5a5ed7dbb-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "1b7d191f-d557-4a83-829b-bad5a5ed7dbb" (UID: "1b7d191f-d557-4a83-829b-bad5a5ed7dbb"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.459539 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1b7d191f-d557-4a83-829b-bad5a5ed7dbb-config-data" (OuterVolumeSpecName: "config-data") pod "1b7d191f-d557-4a83-829b-bad5a5ed7dbb" (UID: "1b7d191f-d557-4a83-829b-bad5a5ed7dbb"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.497166 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/466bdf84-87d2-46ac-8f19-914a10b4ad63-config-data-generated\") pod \"466bdf84-87d2-46ac-8f19-914a10b4ad63\" (UID: \"466bdf84-87d2-46ac-8f19-914a10b4ad63\") " Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.497599 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/466bdf84-87d2-46ac-8f19-914a10b4ad63-combined-ca-bundle\") pod \"466bdf84-87d2-46ac-8f19-914a10b4ad63\" (UID: \"466bdf84-87d2-46ac-8f19-914a10b4ad63\") " Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.497686 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n5wk8\" (UniqueName: \"kubernetes.io/projected/466bdf84-87d2-46ac-8f19-914a10b4ad63-kube-api-access-n5wk8\") pod \"466bdf84-87d2-46ac-8f19-914a10b4ad63\" (UID: \"466bdf84-87d2-46ac-8f19-914a10b4ad63\") " Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.497723 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"mysql-db\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"466bdf84-87d2-46ac-8f19-914a10b4ad63\" (UID: \"466bdf84-87d2-46ac-8f19-914a10b4ad63\") " Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.497944 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/466bdf84-87d2-46ac-8f19-914a10b4ad63-kolla-config\") pod \"466bdf84-87d2-46ac-8f19-914a10b4ad63\" (UID: \"466bdf84-87d2-46ac-8f19-914a10b4ad63\") " Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.498169 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/466bdf84-87d2-46ac-8f19-914a10b4ad63-config-data-default\") pod \"466bdf84-87d2-46ac-8f19-914a10b4ad63\" (UID: \"466bdf84-87d2-46ac-8f19-914a10b4ad63\") " Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.498314 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/466bdf84-87d2-46ac-8f19-914a10b4ad63-operator-scripts\") pod \"466bdf84-87d2-46ac-8f19-914a10b4ad63\" (UID: \"466bdf84-87d2-46ac-8f19-914a10b4ad63\") " Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.498560 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/466bdf84-87d2-46ac-8f19-914a10b4ad63-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "466bdf84-87d2-46ac-8f19-914a10b4ad63" (UID: "466bdf84-87d2-46ac-8f19-914a10b4ad63"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.498652 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/466bdf84-87d2-46ac-8f19-914a10b4ad63-galera-tls-certs\") pod \"466bdf84-87d2-46ac-8f19-914a10b4ad63\" (UID: \"466bdf84-87d2-46ac-8f19-914a10b4ad63\") " Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.498720 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/466bdf84-87d2-46ac-8f19-914a10b4ad63-config-data-generated" (OuterVolumeSpecName: "config-data-generated") pod "466bdf84-87d2-46ac-8f19-914a10b4ad63" (UID: "466bdf84-87d2-46ac-8f19-914a10b4ad63"). InnerVolumeSpecName "config-data-generated". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.499232 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/466bdf84-87d2-46ac-8f19-914a10b4ad63-config-data-default" (OuterVolumeSpecName: "config-data-default") pod "466bdf84-87d2-46ac-8f19-914a10b4ad63" (UID: "466bdf84-87d2-46ac-8f19-914a10b4ad63"). InnerVolumeSpecName "config-data-default". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.499485 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/10951fa2-f59a-4ac9-9de4-9a1c46ca5b98-operator-scripts\") pod \"keystone-d475-account-create-update-lzq6q\" (UID: \"10951fa2-f59a-4ac9-9de4-9a1c46ca5b98\") " pod="openstack-kuttl-tests/keystone-d475-account-create-update-lzq6q" Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.499656 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/466bdf84-87d2-46ac-8f19-914a10b4ad63-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "466bdf84-87d2-46ac-8f19-914a10b4ad63" (UID: "466bdf84-87d2-46ac-8f19-914a10b4ad63"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:11:13 crc kubenswrapper[5120]: E0316 17:11:13.499721 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Mar 16 17:11:13 crc kubenswrapper[5120]: E0316 17:11:13.499791 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/10951fa2-f59a-4ac9-9de4-9a1c46ca5b98-operator-scripts podName:10951fa2-f59a-4ac9-9de4-9a1c46ca5b98 nodeName:}" failed. No retries permitted until 2026-03-16 17:11:15.499774838 +0000 UTC m=+5977.653706485 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/10951fa2-f59a-4ac9-9de4-9a1c46ca5b98-operator-scripts") pod "keystone-d475-account-create-update-lzq6q" (UID: "10951fa2-f59a-4ac9-9de4-9a1c46ca5b98") : configmap "openstack-scripts" not found Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.500564 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rqqbp\" (UniqueName: \"kubernetes.io/projected/1b7d191f-d557-4a83-829b-bad5a5ed7dbb-kube-api-access-rqqbp\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.500594 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1b7d191f-d557-4a83-829b-bad5a5ed7dbb-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.500611 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d71c12b8-f085-4c19-99c6-f32186225f37-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.500623 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1b7d191f-d557-4a83-829b-bad5a5ed7dbb-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.500634 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/1b7d191f-d557-4a83-829b-bad5a5ed7dbb-logs\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.500646 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/466bdf84-87d2-46ac-8f19-914a10b4ad63-config-data-generated\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.500658 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/1b7d191f-d557-4a83-829b-bad5a5ed7dbb-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.500669 5120 reconciler_common.go:299] "Volume detached for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/d71c12b8-f085-4c19-99c6-f32186225f37-vencrypt-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.500677 5120 reconciler_common.go:299] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/466bdf84-87d2-46ac-8f19-914a10b4ad63-kolla-config\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.500686 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/466bdf84-87d2-46ac-8f19-914a10b4ad63-config-data-default\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.500698 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/466bdf84-87d2-46ac-8f19-914a10b4ad63-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.503981 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/466bdf84-87d2-46ac-8f19-914a10b4ad63-kube-api-access-n5wk8" (OuterVolumeSpecName: "kube-api-access-n5wk8") pod "466bdf84-87d2-46ac-8f19-914a10b4ad63" (UID: "466bdf84-87d2-46ac-8f19-914a10b4ad63"). InnerVolumeSpecName "kube-api-access-n5wk8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.525853 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage20-crc" (OuterVolumeSpecName: "mysql-db") pod "466bdf84-87d2-46ac-8f19-914a10b4ad63" (UID: "466bdf84-87d2-46ac-8f19-914a10b4ad63"). InnerVolumeSpecName "local-storage20-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.529435 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/466bdf84-87d2-46ac-8f19-914a10b4ad63-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "466bdf84-87d2-46ac-8f19-914a10b4ad63" (UID: "466bdf84-87d2-46ac-8f19-914a10b4ad63"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.554450 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/466bdf84-87d2-46ac-8f19-914a10b4ad63-galera-tls-certs" (OuterVolumeSpecName: "galera-tls-certs") pod "466bdf84-87d2-46ac-8f19-914a10b4ad63" (UID: "466bdf84-87d2-46ac-8f19-914a10b4ad63"). InnerVolumeSpecName "galera-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.603071 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q482v\" (UniqueName: \"kubernetes.io/projected/10951fa2-f59a-4ac9-9de4-9a1c46ca5b98-kube-api-access-q482v\") pod \"keystone-d475-account-create-update-lzq6q\" (UID: \"10951fa2-f59a-4ac9-9de4-9a1c46ca5b98\") " pod="openstack-kuttl-tests/keystone-d475-account-create-update-lzq6q" Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.603370 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wqp7q\" (UniqueName: \"kubernetes.io/projected/ec1fdc9d-ea9b-40bc-8f2b-a7287d275c5d-kube-api-access-wqp7q\") pod \"root-account-create-update-74dg4\" (UID: \"ec1fdc9d-ea9b-40bc-8f2b-a7287d275c5d\") " pod="openstack-kuttl-tests/root-account-create-update-74dg4" Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.603919 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ec1fdc9d-ea9b-40bc-8f2b-a7287d275c5d-operator-scripts\") pod \"root-account-create-update-74dg4\" (UID: \"ec1fdc9d-ea9b-40bc-8f2b-a7287d275c5d\") " pod="openstack-kuttl-tests/root-account-create-update-74dg4" Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.604060 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/466bdf84-87d2-46ac-8f19-914a10b4ad63-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.604077 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n5wk8\" (UniqueName: \"kubernetes.io/projected/466bdf84-87d2-46ac-8f19-914a10b4ad63-kube-api-access-n5wk8\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.604136 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") on node \"crc\" " Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.604150 5120 reconciler_common.go:299] "Volume detached for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/466bdf84-87d2-46ac-8f19-914a10b4ad63-galera-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:13 crc kubenswrapper[5120]: E0316 17:11:13.604390 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-cell1-scripts: configmap "openstack-cell1-scripts" not found Mar 16 17:11:13 crc kubenswrapper[5120]: E0316 17:11:13.606048 5120 projected.go:194] Error preparing data for projected volume kube-api-access-q482v for pod openstack-kuttl-tests/keystone-d475-account-create-update-lzq6q: failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 17:11:13 crc kubenswrapper[5120]: E0316 17:11:13.606100 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ec1fdc9d-ea9b-40bc-8f2b-a7287d275c5d-operator-scripts podName:ec1fdc9d-ea9b-40bc-8f2b-a7287d275c5d nodeName:}" failed. No retries permitted until 2026-03-16 17:11:17.606062486 +0000 UTC m=+5979.759994153 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/ec1fdc9d-ea9b-40bc-8f2b-a7287d275c5d-operator-scripts") pod "root-account-create-update-74dg4" (UID: "ec1fdc9d-ea9b-40bc-8f2b-a7287d275c5d") : configmap "openstack-cell1-scripts" not found Mar 16 17:11:13 crc kubenswrapper[5120]: E0316 17:11:13.606140 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/10951fa2-f59a-4ac9-9de4-9a1c46ca5b98-kube-api-access-q482v podName:10951fa2-f59a-4ac9-9de4-9a1c46ca5b98 nodeName:}" failed. No retries permitted until 2026-03-16 17:11:15.606129668 +0000 UTC m=+5977.760061325 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-q482v" (UniqueName: "kubernetes.io/projected/10951fa2-f59a-4ac9-9de4-9a1c46ca5b98-kube-api-access-q482v") pod "keystone-d475-account-create-update-lzq6q" (UID: "10951fa2-f59a-4ac9-9de4-9a1c46ca5b98") : failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 17:11:13 crc kubenswrapper[5120]: E0316 17:11:13.606578 5120 projected.go:194] Error preparing data for projected volume kube-api-access-wqp7q for pod openstack-kuttl-tests/root-account-create-update-74dg4: failed to fetch token: serviceaccounts "galera-openstack-cell1" not found Mar 16 17:11:13 crc kubenswrapper[5120]: E0316 17:11:13.606658 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ec1fdc9d-ea9b-40bc-8f2b-a7287d275c5d-kube-api-access-wqp7q podName:ec1fdc9d-ea9b-40bc-8f2b-a7287d275c5d nodeName:}" failed. No retries permitted until 2026-03-16 17:11:17.606643351 +0000 UTC m=+5979.760575008 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-wqp7q" (UniqueName: "kubernetes.io/projected/ec1fdc9d-ea9b-40bc-8f2b-a7287d275c5d-kube-api-access-wqp7q") pod "root-account-create-update-74dg4" (UID: "ec1fdc9d-ea9b-40bc-8f2b-a7287d275c5d") : failed to fetch token: serviceaccounts "galera-openstack-cell1" not found Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.631187 5120 generic.go:358] "Generic (PLEG): container finished" podID="fd632cf1-9975-4595-bdb6-c33fc07f41a5" containerID="366d65c82164e4c899c9b53f7cea3f51f9fa8cf9d96fe4b2280741ae0fe7d0fd" exitCode=0 Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.631344 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-zc7hd" event={"ID":"fd632cf1-9975-4595-bdb6-c33fc07f41a5","Type":"ContainerDied","Data":"366d65c82164e4c899c9b53f7cea3f51f9fa8cf9d96fe4b2280741ae0fe7d0fd"} Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.631420 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-zc7hd" event={"ID":"fd632cf1-9975-4595-bdb6-c33fc07f41a5","Type":"ContainerStarted","Data":"040bbcbf6d994a67a4594c4d931a20aebde5df31b7eff16e7c9a85fb5cc04587"} Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.633120 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-34b5-account-create-update-l4fc7" event={"ID":"8ff3ccc4-2e31-4990-862a-98cbd428ae62","Type":"ContainerDied","Data":"0fd18b006a0bdf3e24770a2891437bdfbdfb3256e9b7d648c0f4e015a44c8417"} Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.633180 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-34b5-account-create-update-l4fc7" Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.651644 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage20-crc" (UniqueName: "kubernetes.io/local-volume/local-storage20-crc") on node "crc" Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.678337 5120 generic.go:358] "Generic (PLEG): container finished" podID="466bdf84-87d2-46ac-8f19-914a10b4ad63" containerID="4b969fe349f39efb2301e4ebf45ed1f29a97d12b0b7e6304273d199bd2f72fc7" exitCode=0 Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.678601 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"466bdf84-87d2-46ac-8f19-914a10b4ad63","Type":"ContainerDied","Data":"4b969fe349f39efb2301e4ebf45ed1f29a97d12b0b7e6304273d199bd2f72fc7"} Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.678641 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"466bdf84-87d2-46ac-8f19-914a10b4ad63","Type":"ContainerDied","Data":"79be26452cbbeb3d3287b432d1051e82e5e233d75e4245ec3037d170e07d3a90"} Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.678673 5120 scope.go:117] "RemoveContainer" containerID="4b969fe349f39efb2301e4ebf45ed1f29a97d12b0b7e6304273d199bd2f72fc7" Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.678714 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.694821 5120 generic.go:358] "Generic (PLEG): container finished" podID="1b7d191f-d557-4a83-829b-bad5a5ed7dbb" containerID="93a02ab0690546f90261545a3915392e1acc235fe9f611e9496292d465c53236" exitCode=0 Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.694944 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-7d8dcb56b8-42f9n" event={"ID":"1b7d191f-d557-4a83-829b-bad5a5ed7dbb","Type":"ContainerDied","Data":"93a02ab0690546f90261545a3915392e1acc235fe9f611e9496292d465c53236"} Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.695012 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-7d8dcb56b8-42f9n" event={"ID":"1b7d191f-d557-4a83-829b-bad5a5ed7dbb","Type":"ContainerDied","Data":"888cf3b04e22366bb61e30c15f80f6737f637d3d40cc21932cf1a9c6a7115eea"} Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.695111 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-7d8dcb56b8-42f9n" Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.701666 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"483d872a-47d2-44f6-a80a-acf24e5f37c8","Type":"ContainerDied","Data":"345202c89264508b76f31a00ca01230337139db561679a528e1127da136e279f"} Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.701703 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.710544 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.711042 5120 generic.go:358] "Generic (PLEG): container finished" podID="e491da9b-3bac-45f2-b9f5-41af945fe1eb" containerID="870c2a927bc2107b7a9af1bd4b1b5d380ffd03e113df8349bec56a3b69849df3" exitCode=0 Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.711147 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-6f95f9d4f9-4kmmn" event={"ID":"e491da9b-3bac-45f2-b9f5-41af945fe1eb","Type":"ContainerDied","Data":"870c2a927bc2107b7a9af1bd4b1b5d380ffd03e113df8349bec56a3b69849df3"} Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.711184 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-6f95f9d4f9-4kmmn" event={"ID":"e491da9b-3bac-45f2-b9f5-41af945fe1eb","Type":"ContainerDied","Data":"82d5a310e35e3b9b1dcc74a60d649c5700808537fad7321c1a5203c33e52168c"} Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.711914 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-6f95f9d4f9-4kmmn" Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.714417 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.714546 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"9009d26a-9c60-48c3-981f-41e60a03545d","Type":"ContainerDied","Data":"bc558bce5b50dd6107dff1ac3ba371642e0bc73e37596fbd0b59433f72a841bb"} Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.730743 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-d475-account-create-update-lzq6q" Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.732540 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.732819 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"d71c12b8-f085-4c19-99c6-f32186225f37","Type":"ContainerDied","Data":"5a6b72810b988c074dd17bf982cf852010ef150f455ba52dd5f7d0b95de74f55"} Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.732908 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-74dg4" Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.828019 5120 scope.go:117] "RemoveContainer" containerID="73773fc9b12d84b9a31c8dd6bdf7fab0c068e2a986b8cd569bb78748415e8adc" Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.888979 5120 scope.go:117] "RemoveContainer" containerID="4b969fe349f39efb2301e4ebf45ed1f29a97d12b0b7e6304273d199bd2f72fc7" Mar 16 17:11:13 crc kubenswrapper[5120]: E0316 17:11:13.889579 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b969fe349f39efb2301e4ebf45ed1f29a97d12b0b7e6304273d199bd2f72fc7\": container with ID starting with 4b969fe349f39efb2301e4ebf45ed1f29a97d12b0b7e6304273d199bd2f72fc7 not found: ID does not exist" containerID="4b969fe349f39efb2301e4ebf45ed1f29a97d12b0b7e6304273d199bd2f72fc7" Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.889619 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b969fe349f39efb2301e4ebf45ed1f29a97d12b0b7e6304273d199bd2f72fc7"} err="failed to get container status \"4b969fe349f39efb2301e4ebf45ed1f29a97d12b0b7e6304273d199bd2f72fc7\": rpc error: code = NotFound desc = could not find container \"4b969fe349f39efb2301e4ebf45ed1f29a97d12b0b7e6304273d199bd2f72fc7\": container with ID starting with 4b969fe349f39efb2301e4ebf45ed1f29a97d12b0b7e6304273d199bd2f72fc7 not found: ID does not exist" Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.889646 5120 scope.go:117] "RemoveContainer" containerID="73773fc9b12d84b9a31c8dd6bdf7fab0c068e2a986b8cd569bb78748415e8adc" Mar 16 17:11:13 crc kubenswrapper[5120]: E0316 17:11:13.892087 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"73773fc9b12d84b9a31c8dd6bdf7fab0c068e2a986b8cd569bb78748415e8adc\": container with ID starting with 73773fc9b12d84b9a31c8dd6bdf7fab0c068e2a986b8cd569bb78748415e8adc not found: ID does not exist" containerID="73773fc9b12d84b9a31c8dd6bdf7fab0c068e2a986b8cd569bb78748415e8adc" Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.892125 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73773fc9b12d84b9a31c8dd6bdf7fab0c068e2a986b8cd569bb78748415e8adc"} err="failed to get container status \"73773fc9b12d84b9a31c8dd6bdf7fab0c068e2a986b8cd569bb78748415e8adc\": rpc error: code = NotFound desc = could not find container \"73773fc9b12d84b9a31c8dd6bdf7fab0c068e2a986b8cd569bb78748415e8adc\": container with ID starting with 73773fc9b12d84b9a31c8dd6bdf7fab0c068e2a986b8cd569bb78748415e8adc not found: ID does not exist" Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.892147 5120 scope.go:117] "RemoveContainer" containerID="93a02ab0690546f90261545a3915392e1acc235fe9f611e9496292d465c53236" Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.918328 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.920279 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/cinder-api-0" podUID="ade246ff-09d5-4b25-a738-4733af58f79c" containerName="cinder-api" probeResult="failure" output="Get \"https://10.217.0.103:8776/healthcheck\": read tcp 10.217.0.2:36360->10.217.0.103:8776: read: connection reset by peer" Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.920856 5120 scope.go:117] "RemoveContainer" containerID="7910ed697b40b1459f42e3b89f80666792021d8e9714d9012682a2dbde466be8" Mar 16 17:11:13 crc kubenswrapper[5120]: I0316 17:11:13.959695 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.018838 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-74dg4"] Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.022280 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.033551 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-74dg4"] Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.054328 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-7d8dcb56b8-42f9n"] Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.065943 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-7d8dcb56b8-42f9n"] Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.093314 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-34b5-account-create-update-l4fc7"] Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.105874 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-34b5-account-create-update-l4fc7"] Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.112051 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-6f95f9d4f9-4kmmn"] Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.118219 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-worker-6f95f9d4f9-4kmmn"] Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.125828 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.130707 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.133420 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/a2a1847f-6881-4af9-b38b-35fd23e3f85e-memcached-tls-certs\") pod \"a2a1847f-6881-4af9-b38b-35fd23e3f85e\" (UID: \"a2a1847f-6881-4af9-b38b-35fd23e3f85e\") " Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.133491 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k2x7z\" (UniqueName: \"kubernetes.io/projected/a2a1847f-6881-4af9-b38b-35fd23e3f85e-kube-api-access-k2x7z\") pod \"a2a1847f-6881-4af9-b38b-35fd23e3f85e\" (UID: \"a2a1847f-6881-4af9-b38b-35fd23e3f85e\") " Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.133678 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/a2a1847f-6881-4af9-b38b-35fd23e3f85e-config-data\") pod \"a2a1847f-6881-4af9-b38b-35fd23e3f85e\" (UID: \"a2a1847f-6881-4af9-b38b-35fd23e3f85e\") " Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.134299 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a2a1847f-6881-4af9-b38b-35fd23e3f85e-combined-ca-bundle\") pod \"a2a1847f-6881-4af9-b38b-35fd23e3f85e\" (UID: \"a2a1847f-6881-4af9-b38b-35fd23e3f85e\") " Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.134351 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/a2a1847f-6881-4af9-b38b-35fd23e3f85e-kolla-config\") pod \"a2a1847f-6881-4af9-b38b-35fd23e3f85e\" (UID: \"a2a1847f-6881-4af9-b38b-35fd23e3f85e\") " Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.134506 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a2a1847f-6881-4af9-b38b-35fd23e3f85e-config-data" (OuterVolumeSpecName: "config-data") pod "a2a1847f-6881-4af9-b38b-35fd23e3f85e" (UID: "a2a1847f-6881-4af9-b38b-35fd23e3f85e"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.134752 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a2a1847f-6881-4af9-b38b-35fd23e3f85e-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "a2a1847f-6881-4af9-b38b-35fd23e3f85e" (UID: "a2a1847f-6881-4af9-b38b-35fd23e3f85e"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.135114 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ec1fdc9d-ea9b-40bc-8f2b-a7287d275c5d-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.135134 5120 reconciler_common.go:299] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/a2a1847f-6881-4af9-b38b-35fd23e3f85e-kolla-config\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.135144 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wqp7q\" (UniqueName: \"kubernetes.io/projected/ec1fdc9d-ea9b-40bc-8f2b-a7287d275c5d-kube-api-access-wqp7q\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.135155 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/a2a1847f-6881-4af9-b38b-35fd23e3f85e-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.140422 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a2a1847f-6881-4af9-b38b-35fd23e3f85e-kube-api-access-k2x7z" (OuterVolumeSpecName: "kube-api-access-k2x7z") pod "a2a1847f-6881-4af9-b38b-35fd23e3f85e" (UID: "a2a1847f-6881-4af9-b38b-35fd23e3f85e"). InnerVolumeSpecName "kube-api-access-k2x7z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.144003 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-d475-account-create-update-lzq6q"] Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.153317 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-d475-account-create-update-lzq6q"] Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.159513 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.166465 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a2a1847f-6881-4af9-b38b-35fd23e3f85e-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "a2a1847f-6881-4af9-b38b-35fd23e3f85e" (UID: "a2a1847f-6881-4af9-b38b-35fd23e3f85e"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.166507 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.174127 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.182201 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.198500 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a2a1847f-6881-4af9-b38b-35fd23e3f85e-memcached-tls-certs" (OuterVolumeSpecName: "memcached-tls-certs") pod "a2a1847f-6881-4af9-b38b-35fd23e3f85e" (UID: "a2a1847f-6881-4af9-b38b-35fd23e3f85e"). InnerVolumeSpecName "memcached-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.239047 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q482v\" (UniqueName: \"kubernetes.io/projected/10951fa2-f59a-4ac9-9de4-9a1c46ca5b98-kube-api-access-q482v\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.239093 5120 reconciler_common.go:299] "Volume detached for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/a2a1847f-6881-4af9-b38b-35fd23e3f85e-memcached-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.239109 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k2x7z\" (UniqueName: \"kubernetes.io/projected/a2a1847f-6881-4af9-b38b-35fd23e3f85e-kube-api-access-k2x7z\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.239121 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/10951fa2-f59a-4ac9-9de4-9a1c46ca5b98-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.239133 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a2a1847f-6881-4af9-b38b-35fd23e3f85e-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.314858 5120 scope.go:117] "RemoveContainer" containerID="93a02ab0690546f90261545a3915392e1acc235fe9f611e9496292d465c53236" Mar 16 17:11:14 crc kubenswrapper[5120]: E0316 17:11:14.315535 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93a02ab0690546f90261545a3915392e1acc235fe9f611e9496292d465c53236\": container with ID starting with 93a02ab0690546f90261545a3915392e1acc235fe9f611e9496292d465c53236 not found: ID does not exist" containerID="93a02ab0690546f90261545a3915392e1acc235fe9f611e9496292d465c53236" Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.315609 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93a02ab0690546f90261545a3915392e1acc235fe9f611e9496292d465c53236"} err="failed to get container status \"93a02ab0690546f90261545a3915392e1acc235fe9f611e9496292d465c53236\": rpc error: code = NotFound desc = could not find container \"93a02ab0690546f90261545a3915392e1acc235fe9f611e9496292d465c53236\": container with ID starting with 93a02ab0690546f90261545a3915392e1acc235fe9f611e9496292d465c53236 not found: ID does not exist" Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.315670 5120 scope.go:117] "RemoveContainer" containerID="7910ed697b40b1459f42e3b89f80666792021d8e9714d9012682a2dbde466be8" Mar 16 17:11:14 crc kubenswrapper[5120]: E0316 17:11:14.318051 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7910ed697b40b1459f42e3b89f80666792021d8e9714d9012682a2dbde466be8\": container with ID starting with 7910ed697b40b1459f42e3b89f80666792021d8e9714d9012682a2dbde466be8 not found: ID does not exist" containerID="7910ed697b40b1459f42e3b89f80666792021d8e9714d9012682a2dbde466be8" Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.318127 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7910ed697b40b1459f42e3b89f80666792021d8e9714d9012682a2dbde466be8"} err="failed to get container status \"7910ed697b40b1459f42e3b89f80666792021d8e9714d9012682a2dbde466be8\": rpc error: code = NotFound desc = could not find container \"7910ed697b40b1459f42e3b89f80666792021d8e9714d9012682a2dbde466be8\": container with ID starting with 7910ed697b40b1459f42e3b89f80666792021d8e9714d9012682a2dbde466be8 not found: ID does not exist" Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.318154 5120 scope.go:117] "RemoveContainer" containerID="52f34ac885b11da9ee43ba4a878d1623997383148b6223e1da309b744d0c7ee3" Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.363009 5120 scope.go:117] "RemoveContainer" containerID="870c2a927bc2107b7a9af1bd4b1b5d380ffd03e113df8349bec56a3b69849df3" Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.395258 5120 scope.go:117] "RemoveContainer" containerID="50ba6f99478a2553d827336920b5f82ff35d489c47d9082dbe0a248bce182ecc" Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.431950 5120 scope.go:117] "RemoveContainer" containerID="870c2a927bc2107b7a9af1bd4b1b5d380ffd03e113df8349bec56a3b69849df3" Mar 16 17:11:14 crc kubenswrapper[5120]: E0316 17:11:14.432500 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"870c2a927bc2107b7a9af1bd4b1b5d380ffd03e113df8349bec56a3b69849df3\": container with ID starting with 870c2a927bc2107b7a9af1bd4b1b5d380ffd03e113df8349bec56a3b69849df3 not found: ID does not exist" containerID="870c2a927bc2107b7a9af1bd4b1b5d380ffd03e113df8349bec56a3b69849df3" Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.432541 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"870c2a927bc2107b7a9af1bd4b1b5d380ffd03e113df8349bec56a3b69849df3"} err="failed to get container status \"870c2a927bc2107b7a9af1bd4b1b5d380ffd03e113df8349bec56a3b69849df3\": rpc error: code = NotFound desc = could not find container \"870c2a927bc2107b7a9af1bd4b1b5d380ffd03e113df8349bec56a3b69849df3\": container with ID starting with 870c2a927bc2107b7a9af1bd4b1b5d380ffd03e113df8349bec56a3b69849df3 not found: ID does not exist" Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.432566 5120 scope.go:117] "RemoveContainer" containerID="50ba6f99478a2553d827336920b5f82ff35d489c47d9082dbe0a248bce182ecc" Mar 16 17:11:14 crc kubenswrapper[5120]: E0316 17:11:14.433059 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"50ba6f99478a2553d827336920b5f82ff35d489c47d9082dbe0a248bce182ecc\": container with ID starting with 50ba6f99478a2553d827336920b5f82ff35d489c47d9082dbe0a248bce182ecc not found: ID does not exist" containerID="50ba6f99478a2553d827336920b5f82ff35d489c47d9082dbe0a248bce182ecc" Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.433097 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50ba6f99478a2553d827336920b5f82ff35d489c47d9082dbe0a248bce182ecc"} err="failed to get container status \"50ba6f99478a2553d827336920b5f82ff35d489c47d9082dbe0a248bce182ecc\": rpc error: code = NotFound desc = could not find container \"50ba6f99478a2553d827336920b5f82ff35d489c47d9082dbe0a248bce182ecc\": container with ID starting with 50ba6f99478a2553d827336920b5f82ff35d489c47d9082dbe0a248bce182ecc not found: ID does not exist" Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.433124 5120 scope.go:117] "RemoveContainer" containerID="33961ef2975a425dd7210db90373c59aec60bdd5c1d85eaf062818262e6fb1af" Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.479197 5120 scope.go:117] "RemoveContainer" containerID="15391224417c302e54e42e40b0f9c3068ad4bfa0470ea89ee0df220ceb40a6e2" Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.691149 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="10951fa2-f59a-4ac9-9de4-9a1c46ca5b98" path="/var/lib/kubelet/pods/10951fa2-f59a-4ac9-9de4-9a1c46ca5b98/volumes" Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.693057 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1b7d191f-d557-4a83-829b-bad5a5ed7dbb" path="/var/lib/kubelet/pods/1b7d191f-d557-4a83-829b-bad5a5ed7dbb/volumes" Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.693929 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="466bdf84-87d2-46ac-8f19-914a10b4ad63" path="/var/lib/kubelet/pods/466bdf84-87d2-46ac-8f19-914a10b4ad63/volumes" Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.694659 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="483d872a-47d2-44f6-a80a-acf24e5f37c8" path="/var/lib/kubelet/pods/483d872a-47d2-44f6-a80a-acf24e5f37c8/volumes" Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.695651 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ff3ccc4-2e31-4990-862a-98cbd428ae62" path="/var/lib/kubelet/pods/8ff3ccc4-2e31-4990-862a-98cbd428ae62/volumes" Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.696101 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9009d26a-9c60-48c3-981f-41e60a03545d" path="/var/lib/kubelet/pods/9009d26a-9c60-48c3-981f-41e60a03545d/volumes" Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.696743 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d71c12b8-f085-4c19-99c6-f32186225f37" path="/var/lib/kubelet/pods/d71c12b8-f085-4c19-99c6-f32186225f37/volumes" Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.698410 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e491da9b-3bac-45f2-b9f5-41af945fe1eb" path="/var/lib/kubelet/pods/e491da9b-3bac-45f2-b9f5-41af945fe1eb/volumes" Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.698935 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec1fdc9d-ea9b-40bc-8f2b-a7287d275c5d" path="/var/lib/kubelet/pods/ec1fdc9d-ea9b-40bc-8f2b-a7287d275c5d/volumes" Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.718927 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:11:14 crc kubenswrapper[5120]: E0316 17:11:14.755066 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/nova-metadata-config-data: secret "nova-metadata-config-data" not found Mar 16 17:11:14 crc kubenswrapper[5120]: E0316 17:11:14.755133 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f659fd59-18da-47e7-b57a-27e7d95a428e-config-data podName:f659fd59-18da-47e7-b57a-27e7d95a428e nodeName:}" failed. No retries permitted until 2026-03-16 17:11:18.755116603 +0000 UTC m=+5980.909048260 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/secret/f659fd59-18da-47e7-b57a-27e7d95a428e-config-data") pod "nova-metadata-0" (UID: "f659fd59-18da-47e7-b57a-27e7d95a428e") : secret "nova-metadata-config-data" not found Mar 16 17:11:14 crc kubenswrapper[5120]: E0316 17:11:14.755306 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 17:11:14 crc kubenswrapper[5120]: E0316 17:11:14.755377 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f659fd59-18da-47e7-b57a-27e7d95a428e-combined-ca-bundle podName:f659fd59-18da-47e7-b57a-27e7d95a428e nodeName:}" failed. No retries permitted until 2026-03-16 17:11:18.755360449 +0000 UTC m=+5980.909292106 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/f659fd59-18da-47e7-b57a-27e7d95a428e-combined-ca-bundle") pod "nova-metadata-0" (UID: "f659fd59-18da-47e7-b57a-27e7d95a428e") : secret "combined-ca-bundle" not found Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.757333 5120 generic.go:358] "Generic (PLEG): container finished" podID="d4da2790-525e-44f0-bddd-c5edbb04ae32" containerID="f2efc7da21335cdb240543f9916c5733bbfdf99fd99f425706ed593332a62064" exitCode=0 Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.757494 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"d4da2790-525e-44f0-bddd-c5edbb04ae32","Type":"ContainerDied","Data":"f2efc7da21335cdb240543f9916c5733bbfdf99fd99f425706ed593332a62064"} Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.764151 5120 scope.go:117] "RemoveContainer" containerID="cccaa42f1ab1de1bb520c971a2c5ed0d72121384b8eff62fa4e74f4362185505" Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.772154 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.773100 5120 generic.go:358] "Generic (PLEG): container finished" podID="ade246ff-09d5-4b25-a738-4733af58f79c" containerID="74d99f4f7a3510db7bc9722100fd6e76b0483932aaa3a9d40fa5e81daf7d5b05" exitCode=0 Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.773191 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"ade246ff-09d5-4b25-a738-4733af58f79c","Type":"ContainerDied","Data":"74d99f4f7a3510db7bc9722100fd6e76b0483932aaa3a9d40fa5e81daf7d5b05"} Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.773218 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"ade246ff-09d5-4b25-a738-4733af58f79c","Type":"ContainerDied","Data":"e334665c3aa87de45934a400cec8ebae7adf361e8c8ef6f9e375f052d0075e32"} Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.773272 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.782489 5120 generic.go:358] "Generic (PLEG): container finished" podID="f659fd59-18da-47e7-b57a-27e7d95a428e" containerID="f0db20b2e6e0d68c181b06468ccd7637201488f5e2245e4f484f3e76b9ffe122" exitCode=0 Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.782592 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"f659fd59-18da-47e7-b57a-27e7d95a428e","Type":"ContainerDied","Data":"f0db20b2e6e0d68c181b06468ccd7637201488f5e2245e4f484f3e76b9ffe122"} Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.787478 5120 generic.go:358] "Generic (PLEG): container finished" podID="2018b64c-7208-4c67-b4ec-6e336ca72e94" containerID="b7f9960864f2d86cfd72bc79ac062310e15b22ddad4c040c4f184bf9539ee4cd" exitCode=0 Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.787565 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.787630 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"2018b64c-7208-4c67-b4ec-6e336ca72e94","Type":"ContainerDied","Data":"b7f9960864f2d86cfd72bc79ac062310e15b22ddad4c040c4f184bf9539ee4cd"} Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.787657 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"2018b64c-7208-4c67-b4ec-6e336ca72e94","Type":"ContainerDied","Data":"f7d84cb1e07b3af44d36c8a4f0ad268dea779a682dfb187b123c3805390ec196"} Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.791788 5120 generic.go:358] "Generic (PLEG): container finished" podID="a2a1847f-6881-4af9-b38b-35fd23e3f85e" containerID="57df3117bc5eda590570b6f64cf2888a4fefbb6ecab492edae999ed27aeffda7" exitCode=0 Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.791819 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.791850 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"a2a1847f-6881-4af9-b38b-35fd23e3f85e","Type":"ContainerDied","Data":"57df3117bc5eda590570b6f64cf2888a4fefbb6ecab492edae999ed27aeffda7"} Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.791868 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"a2a1847f-6881-4af9-b38b-35fd23e3f85e","Type":"ContainerDied","Data":"98534bbbbf2a717eb7df1c0552eae61de4093f5511c68137c952bd45569646cc"} Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.807633 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-zc7hd" event={"ID":"fd632cf1-9975-4595-bdb6-c33fc07f41a5","Type":"ContainerStarted","Data":"6834cb76ad06acbbb019d4e422510862d386f4e3c12f1a1d6f923d2310544d1b"} Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.808906 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-zc7hd" Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.824735 5120 scope.go:117] "RemoveContainer" containerID="74d99f4f7a3510db7bc9722100fd6e76b0483932aaa3a9d40fa5e81daf7d5b05" Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.849160 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.857465 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ade246ff-09d5-4b25-a738-4733af58f79c-combined-ca-bundle\") pod \"ade246ff-09d5-4b25-a738-4733af58f79c\" (UID: \"ade246ff-09d5-4b25-a738-4733af58f79c\") " Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.857648 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wpbc5\" (UniqueName: \"kubernetes.io/projected/ade246ff-09d5-4b25-a738-4733af58f79c-kube-api-access-wpbc5\") pod \"ade246ff-09d5-4b25-a738-4733af58f79c\" (UID: \"ade246ff-09d5-4b25-a738-4733af58f79c\") " Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.857802 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2018b64c-7208-4c67-b4ec-6e336ca72e94-scripts\") pod \"2018b64c-7208-4c67-b4ec-6e336ca72e94\" (UID: \"2018b64c-7208-4c67-b4ec-6e336ca72e94\") " Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.857880 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/ade246ff-09d5-4b25-a738-4733af58f79c-config-data-custom\") pod \"ade246ff-09d5-4b25-a738-4733af58f79c\" (UID: \"ade246ff-09d5-4b25-a738-4733af58f79c\") " Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.857985 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/ade246ff-09d5-4b25-a738-4733af58f79c-internal-tls-certs\") pod \"ade246ff-09d5-4b25-a738-4733af58f79c\" (UID: \"ade246ff-09d5-4b25-a738-4733af58f79c\") " Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.858054 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/ade246ff-09d5-4b25-a738-4733af58f79c-etc-machine-id\") pod \"ade246ff-09d5-4b25-a738-4733af58f79c\" (UID: \"ade246ff-09d5-4b25-a738-4733af58f79c\") " Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.858160 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-29wbs\" (UniqueName: \"kubernetes.io/projected/2018b64c-7208-4c67-b4ec-6e336ca72e94-kube-api-access-29wbs\") pod \"2018b64c-7208-4c67-b4ec-6e336ca72e94\" (UID: \"2018b64c-7208-4c67-b4ec-6e336ca72e94\") " Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.858234 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ade246ff-09d5-4b25-a738-4733af58f79c-logs\") pod \"ade246ff-09d5-4b25-a738-4733af58f79c\" (UID: \"ade246ff-09d5-4b25-a738-4733af58f79c\") " Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.858275 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2018b64c-7208-4c67-b4ec-6e336ca72e94-config-data\") pod \"2018b64c-7208-4c67-b4ec-6e336ca72e94\" (UID: \"2018b64c-7208-4c67-b4ec-6e336ca72e94\") " Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.858391 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/2018b64c-7208-4c67-b4ec-6e336ca72e94-public-tls-certs\") pod \"2018b64c-7208-4c67-b4ec-6e336ca72e94\" (UID: \"2018b64c-7208-4c67-b4ec-6e336ca72e94\") " Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.858460 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ade246ff-09d5-4b25-a738-4733af58f79c-config-data\") pod \"ade246ff-09d5-4b25-a738-4733af58f79c\" (UID: \"ade246ff-09d5-4b25-a738-4733af58f79c\") " Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.858618 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/2018b64c-7208-4c67-b4ec-6e336ca72e94-httpd-run\") pod \"2018b64c-7208-4c67-b4ec-6e336ca72e94\" (UID: \"2018b64c-7208-4c67-b4ec-6e336ca72e94\") " Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.858688 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ade246ff-09d5-4b25-a738-4733af58f79c-scripts\") pod \"ade246ff-09d5-4b25-a738-4733af58f79c\" (UID: \"ade246ff-09d5-4b25-a738-4733af58f79c\") " Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.858720 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2018b64c-7208-4c67-b4ec-6e336ca72e94-combined-ca-bundle\") pod \"2018b64c-7208-4c67-b4ec-6e336ca72e94\" (UID: \"2018b64c-7208-4c67-b4ec-6e336ca72e94\") " Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.858854 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2018b64c-7208-4c67-b4ec-6e336ca72e94-logs\") pod \"2018b64c-7208-4c67-b4ec-6e336ca72e94\" (UID: \"2018b64c-7208-4c67-b4ec-6e336ca72e94\") " Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.858905 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ade246ff-09d5-4b25-a738-4733af58f79c-public-tls-certs\") pod \"ade246ff-09d5-4b25-a738-4733af58f79c\" (UID: \"ade246ff-09d5-4b25-a738-4733af58f79c\") " Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.858986 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"2018b64c-7208-4c67-b4ec-6e336ca72e94\" (UID: \"2018b64c-7208-4c67-b4ec-6e336ca72e94\") " Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.861723 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2018b64c-7208-4c67-b4ec-6e336ca72e94-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "2018b64c-7208-4c67-b4ec-6e336ca72e94" (UID: "2018b64c-7208-4c67-b4ec-6e336ca72e94"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.864999 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/placement-858ffc7d86-rq6st" podUID="830abb7b-cab5-4a21-9e39-6dc0c0faf74e" containerName="placement-log" probeResult="failure" output="Get \"https://10.217.0.104:8778/\": read tcp 10.217.0.2:47762->10.217.0.104:8778: read: connection reset by peer" Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.867018 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.867619 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ade246ff-09d5-4b25-a738-4733af58f79c-logs" (OuterVolumeSpecName: "logs") pod "ade246ff-09d5-4b25-a738-4733af58f79c" (UID: "ade246ff-09d5-4b25-a738-4733af58f79c"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.869639 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2018b64c-7208-4c67-b4ec-6e336ca72e94-logs" (OuterVolumeSpecName: "logs") pod "2018b64c-7208-4c67-b4ec-6e336ca72e94" (UID: "2018b64c-7208-4c67-b4ec-6e336ca72e94"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.875340 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-zc7hd" podStartSLOduration=5.87527393 podStartE2EDuration="5.87527393s" podCreationTimestamp="2026-03-16 17:11:09 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:11:14.838207417 +0000 UTC m=+5976.992139074" watchObservedRunningTime="2026-03-16 17:11:14.87527393 +0000 UTC m=+5977.029205587" Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.877917 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/ade246ff-09d5-4b25-a738-4733af58f79c-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "ade246ff-09d5-4b25-a738-4733af58f79c" (UID: "ade246ff-09d5-4b25-a738-4733af58f79c"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.887506 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ade246ff-09d5-4b25-a738-4733af58f79c-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "ade246ff-09d5-4b25-a738-4733af58f79c" (UID: "ade246ff-09d5-4b25-a738-4733af58f79c"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.887591 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ade246ff-09d5-4b25-a738-4733af58f79c-scripts" (OuterVolumeSpecName: "scripts") pod "ade246ff-09d5-4b25-a738-4733af58f79c" (UID: "ade246ff-09d5-4b25-a738-4733af58f79c"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.887722 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ade246ff-09d5-4b25-a738-4733af58f79c-kube-api-access-wpbc5" (OuterVolumeSpecName: "kube-api-access-wpbc5") pod "ade246ff-09d5-4b25-a738-4733af58f79c" (UID: "ade246ff-09d5-4b25-a738-4733af58f79c"). InnerVolumeSpecName "kube-api-access-wpbc5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.892923 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage05-crc" (OuterVolumeSpecName: "glance") pod "2018b64c-7208-4c67-b4ec-6e336ca72e94" (UID: "2018b64c-7208-4c67-b4ec-6e336ca72e94"). InnerVolumeSpecName "local-storage05-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.894054 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2018b64c-7208-4c67-b4ec-6e336ca72e94-kube-api-access-29wbs" (OuterVolumeSpecName: "kube-api-access-29wbs") pod "2018b64c-7208-4c67-b4ec-6e336ca72e94" (UID: "2018b64c-7208-4c67-b4ec-6e336ca72e94"). InnerVolumeSpecName "kube-api-access-29wbs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.896370 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2018b64c-7208-4c67-b4ec-6e336ca72e94-scripts" (OuterVolumeSpecName: "scripts") pod "2018b64c-7208-4c67-b4ec-6e336ca72e94" (UID: "2018b64c-7208-4c67-b4ec-6e336ca72e94"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.905627 5120 scope.go:117] "RemoveContainer" containerID="96191c9db8064f44d43499a27c2cf2ce04c6f59b84b263360523220cece5bbe2" Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.917378 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ade246ff-09d5-4b25-a738-4733af58f79c-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ade246ff-09d5-4b25-a738-4733af58f79c" (UID: "ade246ff-09d5-4b25-a738-4733af58f79c"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.925172 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-7dd9fb87c6-wk9p7" podUID="cb59b894-da6e-4bd0-85c3-2330d90f2fb9" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.0.105:9311/healthcheck\": read tcp 10.217.0.2:57492->10.217.0.105:9311: read: connection reset by peer" Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.957900 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2018b64c-7208-4c67-b4ec-6e336ca72e94-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "2018b64c-7208-4c67-b4ec-6e336ca72e94" (UID: "2018b64c-7208-4c67-b4ec-6e336ca72e94"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.963415 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2018b64c-7208-4c67-b4ec-6e336ca72e94-logs\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.963454 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") on node \"crc\" " Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.963466 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ade246ff-09d5-4b25-a738-4733af58f79c-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.963480 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wpbc5\" (UniqueName: \"kubernetes.io/projected/ade246ff-09d5-4b25-a738-4733af58f79c-kube-api-access-wpbc5\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.963490 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2018b64c-7208-4c67-b4ec-6e336ca72e94-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.963498 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/ade246ff-09d5-4b25-a738-4733af58f79c-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.963506 5120 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/ade246ff-09d5-4b25-a738-4733af58f79c-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.963516 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-29wbs\" (UniqueName: \"kubernetes.io/projected/2018b64c-7208-4c67-b4ec-6e336ca72e94-kube-api-access-29wbs\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.963524 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ade246ff-09d5-4b25-a738-4733af58f79c-logs\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.963533 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/2018b64c-7208-4c67-b4ec-6e336ca72e94-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.963541 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ade246ff-09d5-4b25-a738-4733af58f79c-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.963549 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2018b64c-7208-4c67-b4ec-6e336ca72e94-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:14 crc kubenswrapper[5120]: I0316 17:11:14.989330 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2018b64c-7208-4c67-b4ec-6e336ca72e94-config-data" (OuterVolumeSpecName: "config-data") pod "2018b64c-7208-4c67-b4ec-6e336ca72e94" (UID: "2018b64c-7208-4c67-b4ec-6e336ca72e94"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.024942 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ade246ff-09d5-4b25-a738-4733af58f79c-config-data" (OuterVolumeSpecName: "config-data") pod "ade246ff-09d5-4b25-a738-4733af58f79c" (UID: "ade246ff-09d5-4b25-a738-4733af58f79c"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.028011 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ade246ff-09d5-4b25-a738-4733af58f79c-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "ade246ff-09d5-4b25-a738-4733af58f79c" (UID: "ade246ff-09d5-4b25-a738-4733af58f79c"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.034883 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ade246ff-09d5-4b25-a738-4733af58f79c-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "ade246ff-09d5-4b25-a738-4733af58f79c" (UID: "ade246ff-09d5-4b25-a738-4733af58f79c"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.038731 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2018b64c-7208-4c67-b4ec-6e336ca72e94-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "2018b64c-7208-4c67-b4ec-6e336ca72e94" (UID: "2018b64c-7208-4c67-b4ec-6e336ca72e94"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.046860 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage05-crc" (UniqueName: "kubernetes.io/local-volume/local-storage05-crc") on node "crc" Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.069655 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ade246ff-09d5-4b25-a738-4733af58f79c-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.069695 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.069708 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/ade246ff-09d5-4b25-a738-4733af58f79c-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.069722 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2018b64c-7208-4c67-b4ec-6e336ca72e94-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.069734 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/2018b64c-7208-4c67-b4ec-6e336ca72e94-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.069745 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ade246ff-09d5-4b25-a738-4733af58f79c-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.218835 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.239285 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.286899 5120 scope.go:117] "RemoveContainer" containerID="74d99f4f7a3510db7bc9722100fd6e76b0483932aaa3a9d40fa5e81daf7d5b05" Mar 16 17:11:15 crc kubenswrapper[5120]: E0316 17:11:15.287397 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"74d99f4f7a3510db7bc9722100fd6e76b0483932aaa3a9d40fa5e81daf7d5b05\": container with ID starting with 74d99f4f7a3510db7bc9722100fd6e76b0483932aaa3a9d40fa5e81daf7d5b05 not found: ID does not exist" containerID="74d99f4f7a3510db7bc9722100fd6e76b0483932aaa3a9d40fa5e81daf7d5b05" Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.287432 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74d99f4f7a3510db7bc9722100fd6e76b0483932aaa3a9d40fa5e81daf7d5b05"} err="failed to get container status \"74d99f4f7a3510db7bc9722100fd6e76b0483932aaa3a9d40fa5e81daf7d5b05\": rpc error: code = NotFound desc = could not find container \"74d99f4f7a3510db7bc9722100fd6e76b0483932aaa3a9d40fa5e81daf7d5b05\": container with ID starting with 74d99f4f7a3510db7bc9722100fd6e76b0483932aaa3a9d40fa5e81daf7d5b05 not found: ID does not exist" Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.287453 5120 scope.go:117] "RemoveContainer" containerID="96191c9db8064f44d43499a27c2cf2ce04c6f59b84b263360523220cece5bbe2" Mar 16 17:11:15 crc kubenswrapper[5120]: E0316 17:11:15.287662 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"96191c9db8064f44d43499a27c2cf2ce04c6f59b84b263360523220cece5bbe2\": container with ID starting with 96191c9db8064f44d43499a27c2cf2ce04c6f59b84b263360523220cece5bbe2 not found: ID does not exist" containerID="96191c9db8064f44d43499a27c2cf2ce04c6f59b84b263360523220cece5bbe2" Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.287682 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96191c9db8064f44d43499a27c2cf2ce04c6f59b84b263360523220cece5bbe2"} err="failed to get container status \"96191c9db8064f44d43499a27c2cf2ce04c6f59b84b263360523220cece5bbe2\": rpc error: code = NotFound desc = could not find container \"96191c9db8064f44d43499a27c2cf2ce04c6f59b84b263360523220cece5bbe2\": container with ID starting with 96191c9db8064f44d43499a27c2cf2ce04c6f59b84b263360523220cece5bbe2 not found: ID does not exist" Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.287694 5120 scope.go:117] "RemoveContainer" containerID="b7f9960864f2d86cfd72bc79ac062310e15b22ddad4c040c4f184bf9539ee4cd" Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.305830 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.312235 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-northd-0_45b8119e-70b5-45ad-9629-41a99f2f8ed0/ovn-northd/0.log" Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.312321 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.330976 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.350826 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.373155 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.379422 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f659fd59-18da-47e7-b57a-27e7d95a428e-logs\") pod \"f659fd59-18da-47e7-b57a-27e7d95a428e\" (UID: \"f659fd59-18da-47e7-b57a-27e7d95a428e\") " Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.379534 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pbvfr\" (UniqueName: \"kubernetes.io/projected/d4da2790-525e-44f0-bddd-c5edbb04ae32-kube-api-access-pbvfr\") pod \"d4da2790-525e-44f0-bddd-c5edbb04ae32\" (UID: \"d4da2790-525e-44f0-bddd-c5edbb04ae32\") " Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.379927 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d4da2790-525e-44f0-bddd-c5edbb04ae32-config-data\") pod \"d4da2790-525e-44f0-bddd-c5edbb04ae32\" (UID: \"d4da2790-525e-44f0-bddd-c5edbb04ae32\") " Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.379988 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f659fd59-18da-47e7-b57a-27e7d95a428e-config-data\") pod \"f659fd59-18da-47e7-b57a-27e7d95a428e\" (UID: \"f659fd59-18da-47e7-b57a-27e7d95a428e\") " Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.380030 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zgkq4\" (UniqueName: \"kubernetes.io/projected/f659fd59-18da-47e7-b57a-27e7d95a428e-kube-api-access-zgkq4\") pod \"f659fd59-18da-47e7-b57a-27e7d95a428e\" (UID: \"f659fd59-18da-47e7-b57a-27e7d95a428e\") " Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.380175 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d4da2790-525e-44f0-bddd-c5edbb04ae32-logs\") pod \"d4da2790-525e-44f0-bddd-c5edbb04ae32\" (UID: \"d4da2790-525e-44f0-bddd-c5edbb04ae32\") " Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.380290 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f659fd59-18da-47e7-b57a-27e7d95a428e-combined-ca-bundle\") pod \"f659fd59-18da-47e7-b57a-27e7d95a428e\" (UID: \"f659fd59-18da-47e7-b57a-27e7d95a428e\") " Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.380363 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/f659fd59-18da-47e7-b57a-27e7d95a428e-nova-metadata-tls-certs\") pod \"f659fd59-18da-47e7-b57a-27e7d95a428e\" (UID: \"f659fd59-18da-47e7-b57a-27e7d95a428e\") " Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.380481 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/d4da2790-525e-44f0-bddd-c5edbb04ae32-internal-tls-certs\") pod \"d4da2790-525e-44f0-bddd-c5edbb04ae32\" (UID: \"d4da2790-525e-44f0-bddd-c5edbb04ae32\") " Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.380584 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/d4da2790-525e-44f0-bddd-c5edbb04ae32-public-tls-certs\") pod \"d4da2790-525e-44f0-bddd-c5edbb04ae32\" (UID: \"d4da2790-525e-44f0-bddd-c5edbb04ae32\") " Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.380613 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d4da2790-525e-44f0-bddd-c5edbb04ae32-combined-ca-bundle\") pod \"d4da2790-525e-44f0-bddd-c5edbb04ae32\" (UID: \"d4da2790-525e-44f0-bddd-c5edbb04ae32\") " Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.381439 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4da2790-525e-44f0-bddd-c5edbb04ae32-logs" (OuterVolumeSpecName: "logs") pod "d4da2790-525e-44f0-bddd-c5edbb04ae32" (UID: "d4da2790-525e-44f0-bddd-c5edbb04ae32"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.381631 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f659fd59-18da-47e7-b57a-27e7d95a428e-logs" (OuterVolumeSpecName: "logs") pod "f659fd59-18da-47e7-b57a-27e7d95a428e" (UID: "f659fd59-18da-47e7-b57a-27e7d95a428e"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.383308 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d4da2790-525e-44f0-bddd-c5edbb04ae32-logs\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.383328 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f659fd59-18da-47e7-b57a-27e7d95a428e-logs\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.383446 5120 scope.go:117] "RemoveContainer" containerID="6bb073a01c96eef1da19b76d216e5216781d9c8805e39d2c2651bb9ef84dc90b" Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.391461 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4da2790-525e-44f0-bddd-c5edbb04ae32-kube-api-access-pbvfr" (OuterVolumeSpecName: "kube-api-access-pbvfr") pod "d4da2790-525e-44f0-bddd-c5edbb04ae32" (UID: "d4da2790-525e-44f0-bddd-c5edbb04ae32"). InnerVolumeSpecName "kube-api-access-pbvfr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.404752 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f659fd59-18da-47e7-b57a-27e7d95a428e-kube-api-access-zgkq4" (OuterVolumeSpecName: "kube-api-access-zgkq4") pod "f659fd59-18da-47e7-b57a-27e7d95a428e" (UID: "f659fd59-18da-47e7-b57a-27e7d95a428e"). InnerVolumeSpecName "kube-api-access-zgkq4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.431843 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-858ffc7d86-rq6st" Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.436827 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4da2790-525e-44f0-bddd-c5edbb04ae32-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "d4da2790-525e-44f0-bddd-c5edbb04ae32" (UID: "d4da2790-525e-44f0-bddd-c5edbb04ae32"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.443900 5120 scope.go:117] "RemoveContainer" containerID="b7f9960864f2d86cfd72bc79ac062310e15b22ddad4c040c4f184bf9539ee4cd" Mar 16 17:11:15 crc kubenswrapper[5120]: E0316 17:11:15.444250 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b7f9960864f2d86cfd72bc79ac062310e15b22ddad4c040c4f184bf9539ee4cd\": container with ID starting with b7f9960864f2d86cfd72bc79ac062310e15b22ddad4c040c4f184bf9539ee4cd not found: ID does not exist" containerID="b7f9960864f2d86cfd72bc79ac062310e15b22ddad4c040c4f184bf9539ee4cd" Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.444292 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7f9960864f2d86cfd72bc79ac062310e15b22ddad4c040c4f184bf9539ee4cd"} err="failed to get container status \"b7f9960864f2d86cfd72bc79ac062310e15b22ddad4c040c4f184bf9539ee4cd\": rpc error: code = NotFound desc = could not find container \"b7f9960864f2d86cfd72bc79ac062310e15b22ddad4c040c4f184bf9539ee4cd\": container with ID starting with b7f9960864f2d86cfd72bc79ac062310e15b22ddad4c040c4f184bf9539ee4cd not found: ID does not exist" Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.444315 5120 scope.go:117] "RemoveContainer" containerID="6bb073a01c96eef1da19b76d216e5216781d9c8805e39d2c2651bb9ef84dc90b" Mar 16 17:11:15 crc kubenswrapper[5120]: E0316 17:11:15.444540 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6bb073a01c96eef1da19b76d216e5216781d9c8805e39d2c2651bb9ef84dc90b\": container with ID starting with 6bb073a01c96eef1da19b76d216e5216781d9c8805e39d2c2651bb9ef84dc90b not found: ID does not exist" containerID="6bb073a01c96eef1da19b76d216e5216781d9c8805e39d2c2651bb9ef84dc90b" Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.444561 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6bb073a01c96eef1da19b76d216e5216781d9c8805e39d2c2651bb9ef84dc90b"} err="failed to get container status \"6bb073a01c96eef1da19b76d216e5216781d9c8805e39d2c2651bb9ef84dc90b\": rpc error: code = NotFound desc = could not find container \"6bb073a01c96eef1da19b76d216e5216781d9c8805e39d2c2651bb9ef84dc90b\": container with ID starting with 6bb073a01c96eef1da19b76d216e5216781d9c8805e39d2c2651bb9ef84dc90b not found: ID does not exist" Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.444577 5120 scope.go:117] "RemoveContainer" containerID="57df3117bc5eda590570b6f64cf2888a4fefbb6ecab492edae999ed27aeffda7" Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.452912 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4da2790-525e-44f0-bddd-c5edbb04ae32-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "d4da2790-525e-44f0-bddd-c5edbb04ae32" (UID: "d4da2790-525e-44f0-bddd-c5edbb04ae32"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.474423 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f659fd59-18da-47e7-b57a-27e7d95a428e-config-data" (OuterVolumeSpecName: "config-data") pod "f659fd59-18da-47e7-b57a-27e7d95a428e" (UID: "f659fd59-18da-47e7-b57a-27e7d95a428e"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.484178 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/45b8119e-70b5-45ad-9629-41a99f2f8ed0-ovn-rundir\") pod \"45b8119e-70b5-45ad-9629-41a99f2f8ed0\" (UID: \"45b8119e-70b5-45ad-9629-41a99f2f8ed0\") " Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.484266 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/45b8119e-70b5-45ad-9629-41a99f2f8ed0-ovn-northd-tls-certs\") pod \"45b8119e-70b5-45ad-9629-41a99f2f8ed0\" (UID: \"45b8119e-70b5-45ad-9629-41a99f2f8ed0\") " Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.484327 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/45b8119e-70b5-45ad-9629-41a99f2f8ed0-config\") pod \"45b8119e-70b5-45ad-9629-41a99f2f8ed0\" (UID: \"45b8119e-70b5-45ad-9629-41a99f2f8ed0\") " Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.484701 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/45b8119e-70b5-45ad-9629-41a99f2f8ed0-metrics-certs-tls-certs\") pod \"45b8119e-70b5-45ad-9629-41a99f2f8ed0\" (UID: \"45b8119e-70b5-45ad-9629-41a99f2f8ed0\") " Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.484832 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/45b8119e-70b5-45ad-9629-41a99f2f8ed0-scripts\") pod \"45b8119e-70b5-45ad-9629-41a99f2f8ed0\" (UID: \"45b8119e-70b5-45ad-9629-41a99f2f8ed0\") " Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.484899 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/45b8119e-70b5-45ad-9629-41a99f2f8ed0-combined-ca-bundle\") pod \"45b8119e-70b5-45ad-9629-41a99f2f8ed0\" (UID: \"45b8119e-70b5-45ad-9629-41a99f2f8ed0\") " Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.485241 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9m92h\" (UniqueName: \"kubernetes.io/projected/45b8119e-70b5-45ad-9629-41a99f2f8ed0-kube-api-access-9m92h\") pod \"45b8119e-70b5-45ad-9629-41a99f2f8ed0\" (UID: \"45b8119e-70b5-45ad-9629-41a99f2f8ed0\") " Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.485541 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4da2790-525e-44f0-bddd-c5edbb04ae32-config-data" (OuterVolumeSpecName: "config-data") pod "d4da2790-525e-44f0-bddd-c5edbb04ae32" (UID: "d4da2790-525e-44f0-bddd-c5edbb04ae32"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.485848 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f659fd59-18da-47e7-b57a-27e7d95a428e-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f659fd59-18da-47e7-b57a-27e7d95a428e" (UID: "f659fd59-18da-47e7-b57a-27e7d95a428e"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.486111 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/45b8119e-70b5-45ad-9629-41a99f2f8ed0-config" (OuterVolumeSpecName: "config") pod "45b8119e-70b5-45ad-9629-41a99f2f8ed0" (UID: "45b8119e-70b5-45ad-9629-41a99f2f8ed0"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.486470 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f659fd59-18da-47e7-b57a-27e7d95a428e-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.486573 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/d4da2790-525e-44f0-bddd-c5edbb04ae32-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.486673 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d4da2790-525e-44f0-bddd-c5edbb04ae32-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.486809 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pbvfr\" (UniqueName: \"kubernetes.io/projected/d4da2790-525e-44f0-bddd-c5edbb04ae32-kube-api-access-pbvfr\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.486929 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d4da2790-525e-44f0-bddd-c5edbb04ae32-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.487019 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f659fd59-18da-47e7-b57a-27e7d95a428e-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.487119 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zgkq4\" (UniqueName: \"kubernetes.io/projected/f659fd59-18da-47e7-b57a-27e7d95a428e-kube-api-access-zgkq4\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.487201 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/45b8119e-70b5-45ad-9629-41a99f2f8ed0-config\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.488048 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45b8119e-70b5-45ad-9629-41a99f2f8ed0-ovn-rundir" (OuterVolumeSpecName: "ovn-rundir") pod "45b8119e-70b5-45ad-9629-41a99f2f8ed0" (UID: "45b8119e-70b5-45ad-9629-41a99f2f8ed0"). InnerVolumeSpecName "ovn-rundir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.488277 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/45b8119e-70b5-45ad-9629-41a99f2f8ed0-scripts" (OuterVolumeSpecName: "scripts") pod "45b8119e-70b5-45ad-9629-41a99f2f8ed0" (UID: "45b8119e-70b5-45ad-9629-41a99f2f8ed0"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.501447 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f659fd59-18da-47e7-b57a-27e7d95a428e-nova-metadata-tls-certs" (OuterVolumeSpecName: "nova-metadata-tls-certs") pod "f659fd59-18da-47e7-b57a-27e7d95a428e" (UID: "f659fd59-18da-47e7-b57a-27e7d95a428e"). InnerVolumeSpecName "nova-metadata-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.505068 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45b8119e-70b5-45ad-9629-41a99f2f8ed0-kube-api-access-9m92h" (OuterVolumeSpecName: "kube-api-access-9m92h") pod "45b8119e-70b5-45ad-9629-41a99f2f8ed0" (UID: "45b8119e-70b5-45ad-9629-41a99f2f8ed0"). InnerVolumeSpecName "kube-api-access-9m92h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.520872 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4da2790-525e-44f0-bddd-c5edbb04ae32-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "d4da2790-525e-44f0-bddd-c5edbb04ae32" (UID: "d4da2790-525e-44f0-bddd-c5edbb04ae32"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.539966 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45b8119e-70b5-45ad-9629-41a99f2f8ed0-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "45b8119e-70b5-45ad-9629-41a99f2f8ed0" (UID: "45b8119e-70b5-45ad-9629-41a99f2f8ed0"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.588300 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/830abb7b-cab5-4a21-9e39-6dc0c0faf74e-config-data\") pod \"830abb7b-cab5-4a21-9e39-6dc0c0faf74e\" (UID: \"830abb7b-cab5-4a21-9e39-6dc0c0faf74e\") " Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.588460 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/830abb7b-cab5-4a21-9e39-6dc0c0faf74e-scripts\") pod \"830abb7b-cab5-4a21-9e39-6dc0c0faf74e\" (UID: \"830abb7b-cab5-4a21-9e39-6dc0c0faf74e\") " Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.588571 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8hv4d\" (UniqueName: \"kubernetes.io/projected/830abb7b-cab5-4a21-9e39-6dc0c0faf74e-kube-api-access-8hv4d\") pod \"830abb7b-cab5-4a21-9e39-6dc0c0faf74e\" (UID: \"830abb7b-cab5-4a21-9e39-6dc0c0faf74e\") " Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.590063 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/830abb7b-cab5-4a21-9e39-6dc0c0faf74e-internal-tls-certs\") pod \"830abb7b-cab5-4a21-9e39-6dc0c0faf74e\" (UID: \"830abb7b-cab5-4a21-9e39-6dc0c0faf74e\") " Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.590560 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/830abb7b-cab5-4a21-9e39-6dc0c0faf74e-public-tls-certs\") pod \"830abb7b-cab5-4a21-9e39-6dc0c0faf74e\" (UID: \"830abb7b-cab5-4a21-9e39-6dc0c0faf74e\") " Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.590813 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/830abb7b-cab5-4a21-9e39-6dc0c0faf74e-logs\") pod \"830abb7b-cab5-4a21-9e39-6dc0c0faf74e\" (UID: \"830abb7b-cab5-4a21-9e39-6dc0c0faf74e\") " Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.590974 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/830abb7b-cab5-4a21-9e39-6dc0c0faf74e-combined-ca-bundle\") pod \"830abb7b-cab5-4a21-9e39-6dc0c0faf74e\" (UID: \"830abb7b-cab5-4a21-9e39-6dc0c0faf74e\") " Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.591824 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9m92h\" (UniqueName: \"kubernetes.io/projected/45b8119e-70b5-45ad-9629-41a99f2f8ed0-kube-api-access-9m92h\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.591844 5120 reconciler_common.go:299] "Volume detached for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/45b8119e-70b5-45ad-9629-41a99f2f8ed0-ovn-rundir\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.591853 5120 reconciler_common.go:299] "Volume detached for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/f659fd59-18da-47e7-b57a-27e7d95a428e-nova-metadata-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.591863 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/d4da2790-525e-44f0-bddd-c5edbb04ae32-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.591873 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/45b8119e-70b5-45ad-9629-41a99f2f8ed0-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.591882 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/45b8119e-70b5-45ad-9629-41a99f2f8ed0-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.592919 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/830abb7b-cab5-4a21-9e39-6dc0c0faf74e-logs" (OuterVolumeSpecName: "logs") pod "830abb7b-cab5-4a21-9e39-6dc0c0faf74e" (UID: "830abb7b-cab5-4a21-9e39-6dc0c0faf74e"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.598235 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/830abb7b-cab5-4a21-9e39-6dc0c0faf74e-kube-api-access-8hv4d" (OuterVolumeSpecName: "kube-api-access-8hv4d") pod "830abb7b-cab5-4a21-9e39-6dc0c0faf74e" (UID: "830abb7b-cab5-4a21-9e39-6dc0c0faf74e"). InnerVolumeSpecName "kube-api-access-8hv4d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.599873 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/830abb7b-cab5-4a21-9e39-6dc0c0faf74e-scripts" (OuterVolumeSpecName: "scripts") pod "830abb7b-cab5-4a21-9e39-6dc0c0faf74e" (UID: "830abb7b-cab5-4a21-9e39-6dc0c0faf74e"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.612124 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45b8119e-70b5-45ad-9629-41a99f2f8ed0-ovn-northd-tls-certs" (OuterVolumeSpecName: "ovn-northd-tls-certs") pod "45b8119e-70b5-45ad-9629-41a99f2f8ed0" (UID: "45b8119e-70b5-45ad-9629-41a99f2f8ed0"). InnerVolumeSpecName "ovn-northd-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.631889 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45b8119e-70b5-45ad-9629-41a99f2f8ed0-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "45b8119e-70b5-45ad-9629-41a99f2f8ed0" (UID: "45b8119e-70b5-45ad-9629-41a99f2f8ed0"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.664100 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/830abb7b-cab5-4a21-9e39-6dc0c0faf74e-config-data" (OuterVolumeSpecName: "config-data") pod "830abb7b-cab5-4a21-9e39-6dc0c0faf74e" (UID: "830abb7b-cab5-4a21-9e39-6dc0c0faf74e"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.665924 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/830abb7b-cab5-4a21-9e39-6dc0c0faf74e-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "830abb7b-cab5-4a21-9e39-6dc0c0faf74e" (UID: "830abb7b-cab5-4a21-9e39-6dc0c0faf74e"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.693621 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/830abb7b-cab5-4a21-9e39-6dc0c0faf74e-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.693656 5120 reconciler_common.go:299] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/45b8119e-70b5-45ad-9629-41a99f2f8ed0-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.693668 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/830abb7b-cab5-4a21-9e39-6dc0c0faf74e-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.693676 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/830abb7b-cab5-4a21-9e39-6dc0c0faf74e-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.693685 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8hv4d\" (UniqueName: \"kubernetes.io/projected/830abb7b-cab5-4a21-9e39-6dc0c0faf74e-kube-api-access-8hv4d\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.693693 5120 reconciler_common.go:299] "Volume detached for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/45b8119e-70b5-45ad-9629-41a99f2f8ed0-ovn-northd-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.693702 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/830abb7b-cab5-4a21-9e39-6dc0c0faf74e-logs\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.709258 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/830abb7b-cab5-4a21-9e39-6dc0c0faf74e-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "830abb7b-cab5-4a21-9e39-6dc0c0faf74e" (UID: "830abb7b-cab5-4a21-9e39-6dc0c0faf74e"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.743189 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/830abb7b-cab5-4a21-9e39-6dc0c0faf74e-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "830abb7b-cab5-4a21-9e39-6dc0c0faf74e" (UID: "830abb7b-cab5-4a21-9e39-6dc0c0faf74e"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.771031 5120 scope.go:117] "RemoveContainer" containerID="57df3117bc5eda590570b6f64cf2888a4fefbb6ecab492edae999ed27aeffda7" Mar 16 17:11:15 crc kubenswrapper[5120]: E0316 17:11:15.772589 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"57df3117bc5eda590570b6f64cf2888a4fefbb6ecab492edae999ed27aeffda7\": container with ID starting with 57df3117bc5eda590570b6f64cf2888a4fefbb6ecab492edae999ed27aeffda7 not found: ID does not exist" containerID="57df3117bc5eda590570b6f64cf2888a4fefbb6ecab492edae999ed27aeffda7" Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.772621 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57df3117bc5eda590570b6f64cf2888a4fefbb6ecab492edae999ed27aeffda7"} err="failed to get container status \"57df3117bc5eda590570b6f64cf2888a4fefbb6ecab492edae999ed27aeffda7\": rpc error: code = NotFound desc = could not find container \"57df3117bc5eda590570b6f64cf2888a4fefbb6ecab492edae999ed27aeffda7\": container with ID starting with 57df3117bc5eda590570b6f64cf2888a4fefbb6ecab492edae999ed27aeffda7 not found: ID does not exist" Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.773333 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-7dd9fb87c6-wk9p7" Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.778865 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.800279 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/830abb7b-cab5-4a21-9e39-6dc0c0faf74e-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.800317 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/830abb7b-cab5-4a21-9e39-6dc0c0faf74e-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.823185 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-75fdb7754b-cb728" Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.830381 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"f659fd59-18da-47e7-b57a-27e7d95a428e","Type":"ContainerDied","Data":"0c146248ce5cbb6bb7f46de0476f492c6f08d7a03995c61381ee84ff5d9f071c"} Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.830423 5120 scope.go:117] "RemoveContainer" containerID="f0db20b2e6e0d68c181b06468ccd7637201488f5e2245e4f484f3e76b9ffe122" Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.830552 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.861914 5120 generic.go:358] "Generic (PLEG): container finished" podID="830abb7b-cab5-4a21-9e39-6dc0c0faf74e" containerID="e01f3b903f2c40334db918671a2fd1e8b27432bd701053aace924d854491e7b0" exitCode=0 Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.861995 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-858ffc7d86-rq6st" event={"ID":"830abb7b-cab5-4a21-9e39-6dc0c0faf74e","Type":"ContainerDied","Data":"e01f3b903f2c40334db918671a2fd1e8b27432bd701053aace924d854491e7b0"} Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.862083 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-858ffc7d86-rq6st" event={"ID":"830abb7b-cab5-4a21-9e39-6dc0c0faf74e","Type":"ContainerDied","Data":"396d4263d7820972b4fbf94b313e9ccb80095bf60f5ff95b6bf4434933efd468"} Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.862100 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-858ffc7d86-rq6st" Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.871430 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"d4da2790-525e-44f0-bddd-c5edbb04ae32","Type":"ContainerDied","Data":"ab5895d4594fc9dd2b6fcf8e8ee228215cdf60a0a1c804b47e4885c40fa21b85"} Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.871499 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.873088 5120 generic.go:358] "Generic (PLEG): container finished" podID="e7b10940-fda7-468a-8937-fd83bb366d34" containerID="a1bb69956d1edd628b3b3c76712ce534b5124418bc79a860b504fffe24badfcb" exitCode=0 Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.873184 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"e7b10940-fda7-468a-8937-fd83bb366d34","Type":"ContainerDied","Data":"a1bb69956d1edd628b3b3c76712ce534b5124418bc79a860b504fffe24badfcb"} Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.873198 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.873202 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"e7b10940-fda7-468a-8937-fd83bb366d34","Type":"ContainerDied","Data":"4ed3e56c2b1fab5acea71079e783b6b8d8742d9e0be43445badfbc878759023c"} Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.875623 5120 scope.go:117] "RemoveContainer" containerID="0b4187a33cd16e54176afbc1797048bc385a980bce807ea18a2f5bf975e838fa" Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.875930 5120 generic.go:358] "Generic (PLEG): container finished" podID="cb59b894-da6e-4bd0-85c3-2330d90f2fb9" containerID="53704c7e7cb120a20abf7c23819ce05c411f207be9084dca48931c0a0f060df8" exitCode=0 Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.876039 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-7dd9fb87c6-wk9p7" event={"ID":"cb59b894-da6e-4bd0-85c3-2330d90f2fb9","Type":"ContainerDied","Data":"53704c7e7cb120a20abf7c23819ce05c411f207be9084dca48931c0a0f060df8"} Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.876072 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-7dd9fb87c6-wk9p7" event={"ID":"cb59b894-da6e-4bd0-85c3-2330d90f2fb9","Type":"ContainerDied","Data":"e138fcb882caf1555726740300d536104bc205f3d2b52e58fcea1b748cb9ef6d"} Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.876100 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-7dd9fb87c6-wk9p7" Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.880524 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-northd-0_45b8119e-70b5-45ad-9629-41a99f2f8ed0/ovn-northd/0.log" Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.880572 5120 generic.go:358] "Generic (PLEG): container finished" podID="45b8119e-70b5-45ad-9629-41a99f2f8ed0" containerID="c8b8353c7b4c0db1e4fca1851f4e10b0bf58243a8726401407c787fd457ff216" exitCode=139 Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.880772 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.881006 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"45b8119e-70b5-45ad-9629-41a99f2f8ed0","Type":"ContainerDied","Data":"c8b8353c7b4c0db1e4fca1851f4e10b0bf58243a8726401407c787fd457ff216"} Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.881123 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"45b8119e-70b5-45ad-9629-41a99f2f8ed0","Type":"ContainerDied","Data":"b4d73ce0f003b2eb700fd0a7258032d2b45a9c1c52da367cbbca780d6e6d9d4f"} Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.883189 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.885620 5120 generic.go:358] "Generic (PLEG): container finished" podID="a1b86673-6678-41ee-b073-f44c6d447fbc" containerID="21c3374fbc591159449ceb515f67c13006c5efb80bd8f427d0c0d4234d964f54" exitCode=0 Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.885713 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-75fdb7754b-cb728" Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.885719 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-75fdb7754b-cb728" event={"ID":"a1b86673-6678-41ee-b073-f44c6d447fbc","Type":"ContainerDied","Data":"21c3374fbc591159449ceb515f67c13006c5efb80bd8f427d0c0d4234d964f54"} Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.885829 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-75fdb7754b-cb728" event={"ID":"a1b86673-6678-41ee-b073-f44c6d447fbc","Type":"ContainerDied","Data":"279b28f00f54850c56acfbed8751352e849b1c8daf4504d4ff4a2d67eed83162"} Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.895307 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.905001 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cb59b894-da6e-4bd0-85c3-2330d90f2fb9-config-data\") pod \"cb59b894-da6e-4bd0-85c3-2330d90f2fb9\" (UID: \"cb59b894-da6e-4bd0-85c3-2330d90f2fb9\") " Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.905102 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/cb59b894-da6e-4bd0-85c3-2330d90f2fb9-logs\") pod \"cb59b894-da6e-4bd0-85c3-2330d90f2fb9\" (UID: \"cb59b894-da6e-4bd0-85c3-2330d90f2fb9\") " Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.905871 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/cb59b894-da6e-4bd0-85c3-2330d90f2fb9-config-data-custom\") pod \"cb59b894-da6e-4bd0-85c3-2330d90f2fb9\" (UID: \"cb59b894-da6e-4bd0-85c3-2330d90f2fb9\") " Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.906182 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e7b10940-fda7-468a-8937-fd83bb366d34-config-data\") pod \"e7b10940-fda7-468a-8937-fd83bb366d34\" (UID: \"e7b10940-fda7-468a-8937-fd83bb366d34\") " Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.906268 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a1b86673-6678-41ee-b073-f44c6d447fbc-combined-ca-bundle\") pod \"a1b86673-6678-41ee-b073-f44c6d447fbc\" (UID: \"a1b86673-6678-41ee-b073-f44c6d447fbc\") " Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.906411 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nkjw7\" (UniqueName: \"kubernetes.io/projected/e7b10940-fda7-468a-8937-fd83bb366d34-kube-api-access-nkjw7\") pod \"e7b10940-fda7-468a-8937-fd83bb366d34\" (UID: \"e7b10940-fda7-468a-8937-fd83bb366d34\") " Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.906451 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e7b10940-fda7-468a-8937-fd83bb366d34-internal-tls-certs\") pod \"e7b10940-fda7-468a-8937-fd83bb366d34\" (UID: \"e7b10940-fda7-468a-8937-fd83bb366d34\") " Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.906492 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/e7b10940-fda7-468a-8937-fd83bb366d34-httpd-run\") pod \"e7b10940-fda7-468a-8937-fd83bb366d34\" (UID: \"e7b10940-fda7-468a-8937-fd83bb366d34\") " Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.906538 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"e7b10940-fda7-468a-8937-fd83bb366d34\" (UID: \"e7b10940-fda7-468a-8937-fd83bb366d34\") " Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.906566 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/cb59b894-da6e-4bd0-85c3-2330d90f2fb9-public-tls-certs\") pod \"cb59b894-da6e-4bd0-85c3-2330d90f2fb9\" (UID: \"cb59b894-da6e-4bd0-85c3-2330d90f2fb9\") " Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.906585 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/a1b86673-6678-41ee-b073-f44c6d447fbc-fernet-keys\") pod \"a1b86673-6678-41ee-b073-f44c6d447fbc\" (UID: \"a1b86673-6678-41ee-b073-f44c6d447fbc\") " Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.906603 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2c6mq\" (UniqueName: \"kubernetes.io/projected/a1b86673-6678-41ee-b073-f44c6d447fbc-kube-api-access-2c6mq\") pod \"a1b86673-6678-41ee-b073-f44c6d447fbc\" (UID: \"a1b86673-6678-41ee-b073-f44c6d447fbc\") " Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.906737 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb59b894-da6e-4bd0-85c3-2330d90f2fb9-logs" (OuterVolumeSpecName: "logs") pod "cb59b894-da6e-4bd0-85c3-2330d90f2fb9" (UID: "cb59b894-da6e-4bd0-85c3-2330d90f2fb9"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.906920 5120 scope.go:117] "RemoveContainer" containerID="e01f3b903f2c40334db918671a2fd1e8b27432bd701053aace924d854491e7b0" Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.906629 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cb59b894-da6e-4bd0-85c3-2330d90f2fb9-combined-ca-bundle\") pod \"cb59b894-da6e-4bd0-85c3-2330d90f2fb9\" (UID: \"cb59b894-da6e-4bd0-85c3-2330d90f2fb9\") " Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.907199 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/a1b86673-6678-41ee-b073-f44c6d447fbc-public-tls-certs\") pod \"a1b86673-6678-41ee-b073-f44c6d447fbc\" (UID: \"a1b86673-6678-41ee-b073-f44c6d447fbc\") " Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.907225 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a1b86673-6678-41ee-b073-f44c6d447fbc-scripts\") pod \"a1b86673-6678-41ee-b073-f44c6d447fbc\" (UID: \"a1b86673-6678-41ee-b073-f44c6d447fbc\") " Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.907290 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e7b10940-fda7-468a-8937-fd83bb366d34-combined-ca-bundle\") pod \"e7b10940-fda7-468a-8937-fd83bb366d34\" (UID: \"e7b10940-fda7-468a-8937-fd83bb366d34\") " Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.907316 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/a1b86673-6678-41ee-b073-f44c6d447fbc-internal-tls-certs\") pod \"a1b86673-6678-41ee-b073-f44c6d447fbc\" (UID: \"a1b86673-6678-41ee-b073-f44c6d447fbc\") " Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.907336 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/a1b86673-6678-41ee-b073-f44c6d447fbc-credential-keys\") pod \"a1b86673-6678-41ee-b073-f44c6d447fbc\" (UID: \"a1b86673-6678-41ee-b073-f44c6d447fbc\") " Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.907355 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e7b10940-fda7-468a-8937-fd83bb366d34-logs\") pod \"e7b10940-fda7-468a-8937-fd83bb366d34\" (UID: \"e7b10940-fda7-468a-8937-fd83bb366d34\") " Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.907370 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e7b10940-fda7-468a-8937-fd83bb366d34-scripts\") pod \"e7b10940-fda7-468a-8937-fd83bb366d34\" (UID: \"e7b10940-fda7-468a-8937-fd83bb366d34\") " Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.907408 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a1b86673-6678-41ee-b073-f44c6d447fbc-config-data\") pod \"a1b86673-6678-41ee-b073-f44c6d447fbc\" (UID: \"a1b86673-6678-41ee-b073-f44c6d447fbc\") " Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.907426 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/cb59b894-da6e-4bd0-85c3-2330d90f2fb9-internal-tls-certs\") pod \"cb59b894-da6e-4bd0-85c3-2330d90f2fb9\" (UID: \"cb59b894-da6e-4bd0-85c3-2330d90f2fb9\") " Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.907449 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4gm85\" (UniqueName: \"kubernetes.io/projected/cb59b894-da6e-4bd0-85c3-2330d90f2fb9-kube-api-access-4gm85\") pod \"cb59b894-da6e-4bd0-85c3-2330d90f2fb9\" (UID: \"cb59b894-da6e-4bd0-85c3-2330d90f2fb9\") " Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.908145 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7b10940-fda7-468a-8937-fd83bb366d34-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "e7b10940-fda7-468a-8937-fd83bb366d34" (UID: "e7b10940-fda7-468a-8937-fd83bb366d34"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.908368 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/cb59b894-da6e-4bd0-85c3-2330d90f2fb9-logs\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.908424 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/e7b10940-fda7-468a-8937-fd83bb366d34-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.911967 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7b10940-fda7-468a-8937-fd83bb366d34-logs" (OuterVolumeSpecName: "logs") pod "e7b10940-fda7-468a-8937-fd83bb366d34" (UID: "e7b10940-fda7-468a-8937-fd83bb366d34"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.918022 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb59b894-da6e-4bd0-85c3-2330d90f2fb9-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "cb59b894-da6e-4bd0-85c3-2330d90f2fb9" (UID: "cb59b894-da6e-4bd0-85c3-2330d90f2fb9"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.941029 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.942508 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7b10940-fda7-468a-8937-fd83bb366d34-kube-api-access-nkjw7" (OuterVolumeSpecName: "kube-api-access-nkjw7") pod "e7b10940-fda7-468a-8937-fd83bb366d34" (UID: "e7b10940-fda7-468a-8937-fd83bb366d34"). InnerVolumeSpecName "kube-api-access-nkjw7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.957000 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1b86673-6678-41ee-b073-f44c6d447fbc-kube-api-access-2c6mq" (OuterVolumeSpecName: "kube-api-access-2c6mq") pod "a1b86673-6678-41ee-b073-f44c6d447fbc" (UID: "a1b86673-6678-41ee-b073-f44c6d447fbc"). InnerVolumeSpecName "kube-api-access-2c6mq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.958882 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage06-crc" (OuterVolumeSpecName: "glance") pod "e7b10940-fda7-468a-8937-fd83bb366d34" (UID: "e7b10940-fda7-468a-8937-fd83bb366d34"). InnerVolumeSpecName "local-storage06-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.959207 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a1b86673-6678-41ee-b073-f44c6d447fbc-scripts" (OuterVolumeSpecName: "scripts") pod "a1b86673-6678-41ee-b073-f44c6d447fbc" (UID: "a1b86673-6678-41ee-b073-f44c6d447fbc"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.961606 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb59b894-da6e-4bd0-85c3-2330d90f2fb9-kube-api-access-4gm85" (OuterVolumeSpecName: "kube-api-access-4gm85") pod "cb59b894-da6e-4bd0-85c3-2330d90f2fb9" (UID: "cb59b894-da6e-4bd0-85c3-2330d90f2fb9"). InnerVolumeSpecName "kube-api-access-4gm85". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.962425 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a1b86673-6678-41ee-b073-f44c6d447fbc-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "a1b86673-6678-41ee-b073-f44c6d447fbc" (UID: "a1b86673-6678-41ee-b073-f44c6d447fbc"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.966903 5120 scope.go:117] "RemoveContainer" containerID="346032f4d53ffd7e68156cf989237694dfdf9ec882a190b66580455212327093" Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.968718 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.970847 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e7b10940-fda7-468a-8937-fd83bb366d34-scripts" (OuterVolumeSpecName: "scripts") pod "e7b10940-fda7-468a-8937-fd83bb366d34" (UID: "e7b10940-fda7-468a-8937-fd83bb366d34"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.977869 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a1b86673-6678-41ee-b073-f44c6d447fbc-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "a1b86673-6678-41ee-b073-f44c6d447fbc" (UID: "a1b86673-6678-41ee-b073-f44c6d447fbc"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.979540 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-858ffc7d86-rq6st"] Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.986035 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-858ffc7d86-rq6st"] Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.993007 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.996190 5120 scope.go:117] "RemoveContainer" containerID="e01f3b903f2c40334db918671a2fd1e8b27432bd701053aace924d854491e7b0" Mar 16 17:11:15 crc kubenswrapper[5120]: E0316 17:11:15.996632 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e01f3b903f2c40334db918671a2fd1e8b27432bd701053aace924d854491e7b0\": container with ID starting with e01f3b903f2c40334db918671a2fd1e8b27432bd701053aace924d854491e7b0 not found: ID does not exist" containerID="e01f3b903f2c40334db918671a2fd1e8b27432bd701053aace924d854491e7b0" Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.996690 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e01f3b903f2c40334db918671a2fd1e8b27432bd701053aace924d854491e7b0"} err="failed to get container status \"e01f3b903f2c40334db918671a2fd1e8b27432bd701053aace924d854491e7b0\": rpc error: code = NotFound desc = could not find container \"e01f3b903f2c40334db918671a2fd1e8b27432bd701053aace924d854491e7b0\": container with ID starting with e01f3b903f2c40334db918671a2fd1e8b27432bd701053aace924d854491e7b0 not found: ID does not exist" Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.996876 5120 scope.go:117] "RemoveContainer" containerID="346032f4d53ffd7e68156cf989237694dfdf9ec882a190b66580455212327093" Mar 16 17:11:15 crc kubenswrapper[5120]: E0316 17:11:15.997421 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"346032f4d53ffd7e68156cf989237694dfdf9ec882a190b66580455212327093\": container with ID starting with 346032f4d53ffd7e68156cf989237694dfdf9ec882a190b66580455212327093 not found: ID does not exist" containerID="346032f4d53ffd7e68156cf989237694dfdf9ec882a190b66580455212327093" Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.997470 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"346032f4d53ffd7e68156cf989237694dfdf9ec882a190b66580455212327093"} err="failed to get container status \"346032f4d53ffd7e68156cf989237694dfdf9ec882a190b66580455212327093\": rpc error: code = NotFound desc = could not find container \"346032f4d53ffd7e68156cf989237694dfdf9ec882a190b66580455212327093\": container with ID starting with 346032f4d53ffd7e68156cf989237694dfdf9ec882a190b66580455212327093 not found: ID does not exist" Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.997526 5120 scope.go:117] "RemoveContainer" containerID="f2efc7da21335cdb240543f9916c5733bbfdf99fd99f425706ed593332a62064" Mar 16 17:11:15 crc kubenswrapper[5120]: I0316 17:11:15.997986 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a1b86673-6678-41ee-b073-f44c6d447fbc-config-data" (OuterVolumeSpecName: "config-data") pod "a1b86673-6678-41ee-b073-f44c6d447fbc" (UID: "a1b86673-6678-41ee-b073-f44c6d447fbc"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:11:16 crc kubenswrapper[5120]: I0316 17:11:16.000731 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 17:11:16 crc kubenswrapper[5120]: I0316 17:11:16.011014 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a1b86673-6678-41ee-b073-f44c6d447fbc-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "a1b86673-6678-41ee-b073-f44c6d447fbc" (UID: "a1b86673-6678-41ee-b073-f44c6d447fbc"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:11:16 crc kubenswrapper[5120]: I0316 17:11:16.012271 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a1b86673-6678-41ee-b073-f44c6d447fbc-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:16 crc kubenswrapper[5120]: I0316 17:11:16.012312 5120 reconciler_common.go:299] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/a1b86673-6678-41ee-b073-f44c6d447fbc-credential-keys\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:16 crc kubenswrapper[5120]: I0316 17:11:16.012332 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e7b10940-fda7-468a-8937-fd83bb366d34-logs\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:16 crc kubenswrapper[5120]: I0316 17:11:16.012343 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e7b10940-fda7-468a-8937-fd83bb366d34-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:16 crc kubenswrapper[5120]: I0316 17:11:16.012354 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a1b86673-6678-41ee-b073-f44c6d447fbc-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:16 crc kubenswrapper[5120]: I0316 17:11:16.012367 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4gm85\" (UniqueName: \"kubernetes.io/projected/cb59b894-da6e-4bd0-85c3-2330d90f2fb9-kube-api-access-4gm85\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:16 crc kubenswrapper[5120]: I0316 17:11:16.012380 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/cb59b894-da6e-4bd0-85c3-2330d90f2fb9-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:16 crc kubenswrapper[5120]: I0316 17:11:16.012419 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a1b86673-6678-41ee-b073-f44c6d447fbc-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:16 crc kubenswrapper[5120]: I0316 17:11:16.012433 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nkjw7\" (UniqueName: \"kubernetes.io/projected/e7b10940-fda7-468a-8937-fd83bb366d34-kube-api-access-nkjw7\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:16 crc kubenswrapper[5120]: I0316 17:11:16.012464 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") on node \"crc\" " Mar 16 17:11:16 crc kubenswrapper[5120]: I0316 17:11:16.012473 5120 reconciler_common.go:299] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/a1b86673-6678-41ee-b073-f44c6d447fbc-fernet-keys\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:16 crc kubenswrapper[5120]: I0316 17:11:16.012482 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2c6mq\" (UniqueName: \"kubernetes.io/projected/a1b86673-6678-41ee-b073-f44c6d447fbc-kube-api-access-2c6mq\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:16 crc kubenswrapper[5120]: I0316 17:11:16.026080 5120 scope.go:117] "RemoveContainer" containerID="1e924a770f65d5ad514a8ac7bd29e74fcd80c4839b439debaf9aba0634fa1121" Mar 16 17:11:16 crc kubenswrapper[5120]: I0316 17:11:16.041958 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e7b10940-fda7-468a-8937-fd83bb366d34-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "e7b10940-fda7-468a-8937-fd83bb366d34" (UID: "e7b10940-fda7-468a-8937-fd83bb366d34"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:11:16 crc kubenswrapper[5120]: I0316 17:11:16.052668 5120 scope.go:117] "RemoveContainer" containerID="a1bb69956d1edd628b3b3c76712ce534b5124418bc79a860b504fffe24badfcb" Mar 16 17:11:16 crc kubenswrapper[5120]: I0316 17:11:16.056855 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb59b894-da6e-4bd0-85c3-2330d90f2fb9-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "cb59b894-da6e-4bd0-85c3-2330d90f2fb9" (UID: "cb59b894-da6e-4bd0-85c3-2330d90f2fb9"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:11:16 crc kubenswrapper[5120]: I0316 17:11:16.061493 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage06-crc" (UniqueName: "kubernetes.io/local-volume/local-storage06-crc") on node "crc" Mar 16 17:11:16 crc kubenswrapper[5120]: I0316 17:11:16.061530 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a1b86673-6678-41ee-b073-f44c6d447fbc-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "a1b86673-6678-41ee-b073-f44c6d447fbc" (UID: "a1b86673-6678-41ee-b073-f44c6d447fbc"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:11:16 crc kubenswrapper[5120]: I0316 17:11:16.061547 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e7b10940-fda7-468a-8937-fd83bb366d34-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e7b10940-fda7-468a-8937-fd83bb366d34" (UID: "e7b10940-fda7-468a-8937-fd83bb366d34"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:11:16 crc kubenswrapper[5120]: I0316 17:11:16.065271 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb59b894-da6e-4bd0-85c3-2330d90f2fb9-config-data" (OuterVolumeSpecName: "config-data") pod "cb59b894-da6e-4bd0-85c3-2330d90f2fb9" (UID: "cb59b894-da6e-4bd0-85c3-2330d90f2fb9"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:11:16 crc kubenswrapper[5120]: I0316 17:11:16.068876 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a1b86673-6678-41ee-b073-f44c6d447fbc-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "a1b86673-6678-41ee-b073-f44c6d447fbc" (UID: "a1b86673-6678-41ee-b073-f44c6d447fbc"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:11:16 crc kubenswrapper[5120]: I0316 17:11:16.069901 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb59b894-da6e-4bd0-85c3-2330d90f2fb9-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "cb59b894-da6e-4bd0-85c3-2330d90f2fb9" (UID: "cb59b894-da6e-4bd0-85c3-2330d90f2fb9"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:11:16 crc kubenswrapper[5120]: I0316 17:11:16.077062 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb59b894-da6e-4bd0-85c3-2330d90f2fb9-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "cb59b894-da6e-4bd0-85c3-2330d90f2fb9" (UID: "cb59b894-da6e-4bd0-85c3-2330d90f2fb9"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:11:16 crc kubenswrapper[5120]: I0316 17:11:16.081714 5120 scope.go:117] "RemoveContainer" containerID="7d229d4a90d7e12f3dfc016d6b5ebcdcc002d8e3fd67e8f62fe2202b444410ff" Mar 16 17:11:16 crc kubenswrapper[5120]: I0316 17:11:16.086926 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e7b10940-fda7-468a-8937-fd83bb366d34-config-data" (OuterVolumeSpecName: "config-data") pod "e7b10940-fda7-468a-8937-fd83bb366d34" (UID: "e7b10940-fda7-468a-8937-fd83bb366d34"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:11:16 crc kubenswrapper[5120]: I0316 17:11:16.102207 5120 scope.go:117] "RemoveContainer" containerID="a1bb69956d1edd628b3b3c76712ce534b5124418bc79a860b504fffe24badfcb" Mar 16 17:11:16 crc kubenswrapper[5120]: E0316 17:11:16.102622 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a1bb69956d1edd628b3b3c76712ce534b5124418bc79a860b504fffe24badfcb\": container with ID starting with a1bb69956d1edd628b3b3c76712ce534b5124418bc79a860b504fffe24badfcb not found: ID does not exist" containerID="a1bb69956d1edd628b3b3c76712ce534b5124418bc79a860b504fffe24badfcb" Mar 16 17:11:16 crc kubenswrapper[5120]: I0316 17:11:16.102668 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1bb69956d1edd628b3b3c76712ce534b5124418bc79a860b504fffe24badfcb"} err="failed to get container status \"a1bb69956d1edd628b3b3c76712ce534b5124418bc79a860b504fffe24badfcb\": rpc error: code = NotFound desc = could not find container \"a1bb69956d1edd628b3b3c76712ce534b5124418bc79a860b504fffe24badfcb\": container with ID starting with a1bb69956d1edd628b3b3c76712ce534b5124418bc79a860b504fffe24badfcb not found: ID does not exist" Mar 16 17:11:16 crc kubenswrapper[5120]: I0316 17:11:16.102694 5120 scope.go:117] "RemoveContainer" containerID="7d229d4a90d7e12f3dfc016d6b5ebcdcc002d8e3fd67e8f62fe2202b444410ff" Mar 16 17:11:16 crc kubenswrapper[5120]: E0316 17:11:16.103116 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d229d4a90d7e12f3dfc016d6b5ebcdcc002d8e3fd67e8f62fe2202b444410ff\": container with ID starting with 7d229d4a90d7e12f3dfc016d6b5ebcdcc002d8e3fd67e8f62fe2202b444410ff not found: ID does not exist" containerID="7d229d4a90d7e12f3dfc016d6b5ebcdcc002d8e3fd67e8f62fe2202b444410ff" Mar 16 17:11:16 crc kubenswrapper[5120]: I0316 17:11:16.103156 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d229d4a90d7e12f3dfc016d6b5ebcdcc002d8e3fd67e8f62fe2202b444410ff"} err="failed to get container status \"7d229d4a90d7e12f3dfc016d6b5ebcdcc002d8e3fd67e8f62fe2202b444410ff\": rpc error: code = NotFound desc = could not find container \"7d229d4a90d7e12f3dfc016d6b5ebcdcc002d8e3fd67e8f62fe2202b444410ff\": container with ID starting with 7d229d4a90d7e12f3dfc016d6b5ebcdcc002d8e3fd67e8f62fe2202b444410ff not found: ID does not exist" Mar 16 17:11:16 crc kubenswrapper[5120]: I0316 17:11:16.103180 5120 scope.go:117] "RemoveContainer" containerID="53704c7e7cb120a20abf7c23819ce05c411f207be9084dca48931c0a0f060df8" Mar 16 17:11:16 crc kubenswrapper[5120]: I0316 17:11:16.114796 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e7b10940-fda7-468a-8937-fd83bb366d34-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:16 crc kubenswrapper[5120]: I0316 17:11:16.114828 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e7b10940-fda7-468a-8937-fd83bb366d34-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:16 crc kubenswrapper[5120]: I0316 17:11:16.114841 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:16 crc kubenswrapper[5120]: I0316 17:11:16.114851 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/cb59b894-da6e-4bd0-85c3-2330d90f2fb9-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:16 crc kubenswrapper[5120]: I0316 17:11:16.114861 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cb59b894-da6e-4bd0-85c3-2330d90f2fb9-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:16 crc kubenswrapper[5120]: I0316 17:11:16.124828 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/a1b86673-6678-41ee-b073-f44c6d447fbc-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:16 crc kubenswrapper[5120]: I0316 17:11:16.124895 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e7b10940-fda7-468a-8937-fd83bb366d34-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:16 crc kubenswrapper[5120]: I0316 17:11:16.124911 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/a1b86673-6678-41ee-b073-f44c6d447fbc-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:16 crc kubenswrapper[5120]: I0316 17:11:16.124927 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/cb59b894-da6e-4bd0-85c3-2330d90f2fb9-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:16 crc kubenswrapper[5120]: I0316 17:11:16.124942 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cb59b894-da6e-4bd0-85c3-2330d90f2fb9-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:16 crc kubenswrapper[5120]: I0316 17:11:16.130806 5120 scope.go:117] "RemoveContainer" containerID="8bcc4d1eccd2cd8a10222f683f4348aa58be8aacd639247e66f7eb971210636b" Mar 16 17:11:16 crc kubenswrapper[5120]: I0316 17:11:16.151989 5120 scope.go:117] "RemoveContainer" containerID="53704c7e7cb120a20abf7c23819ce05c411f207be9084dca48931c0a0f060df8" Mar 16 17:11:16 crc kubenswrapper[5120]: E0316 17:11:16.152310 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"53704c7e7cb120a20abf7c23819ce05c411f207be9084dca48931c0a0f060df8\": container with ID starting with 53704c7e7cb120a20abf7c23819ce05c411f207be9084dca48931c0a0f060df8 not found: ID does not exist" containerID="53704c7e7cb120a20abf7c23819ce05c411f207be9084dca48931c0a0f060df8" Mar 16 17:11:16 crc kubenswrapper[5120]: I0316 17:11:16.152344 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53704c7e7cb120a20abf7c23819ce05c411f207be9084dca48931c0a0f060df8"} err="failed to get container status \"53704c7e7cb120a20abf7c23819ce05c411f207be9084dca48931c0a0f060df8\": rpc error: code = NotFound desc = could not find container \"53704c7e7cb120a20abf7c23819ce05c411f207be9084dca48931c0a0f060df8\": container with ID starting with 53704c7e7cb120a20abf7c23819ce05c411f207be9084dca48931c0a0f060df8 not found: ID does not exist" Mar 16 17:11:16 crc kubenswrapper[5120]: I0316 17:11:16.152364 5120 scope.go:117] "RemoveContainer" containerID="8bcc4d1eccd2cd8a10222f683f4348aa58be8aacd639247e66f7eb971210636b" Mar 16 17:11:16 crc kubenswrapper[5120]: E0316 17:11:16.152579 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8bcc4d1eccd2cd8a10222f683f4348aa58be8aacd639247e66f7eb971210636b\": container with ID starting with 8bcc4d1eccd2cd8a10222f683f4348aa58be8aacd639247e66f7eb971210636b not found: ID does not exist" containerID="8bcc4d1eccd2cd8a10222f683f4348aa58be8aacd639247e66f7eb971210636b" Mar 16 17:11:16 crc kubenswrapper[5120]: I0316 17:11:16.152599 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8bcc4d1eccd2cd8a10222f683f4348aa58be8aacd639247e66f7eb971210636b"} err="failed to get container status \"8bcc4d1eccd2cd8a10222f683f4348aa58be8aacd639247e66f7eb971210636b\": rpc error: code = NotFound desc = could not find container \"8bcc4d1eccd2cd8a10222f683f4348aa58be8aacd639247e66f7eb971210636b\": container with ID starting with 8bcc4d1eccd2cd8a10222f683f4348aa58be8aacd639247e66f7eb971210636b not found: ID does not exist" Mar 16 17:11:16 crc kubenswrapper[5120]: I0316 17:11:16.152611 5120 scope.go:117] "RemoveContainer" containerID="0f5d3fe3e143a4e70eb6ec298ec173e607da98d4085d398c54f81b39a2ff9614" Mar 16 17:11:16 crc kubenswrapper[5120]: I0316 17:11:16.172032 5120 scope.go:117] "RemoveContainer" containerID="c8b8353c7b4c0db1e4fca1851f4e10b0bf58243a8726401407c787fd457ff216" Mar 16 17:11:16 crc kubenswrapper[5120]: I0316 17:11:16.207783 5120 scope.go:117] "RemoveContainer" containerID="0f5d3fe3e143a4e70eb6ec298ec173e607da98d4085d398c54f81b39a2ff9614" Mar 16 17:11:16 crc kubenswrapper[5120]: E0316 17:11:16.208121 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f5d3fe3e143a4e70eb6ec298ec173e607da98d4085d398c54f81b39a2ff9614\": container with ID starting with 0f5d3fe3e143a4e70eb6ec298ec173e607da98d4085d398c54f81b39a2ff9614 not found: ID does not exist" containerID="0f5d3fe3e143a4e70eb6ec298ec173e607da98d4085d398c54f81b39a2ff9614" Mar 16 17:11:16 crc kubenswrapper[5120]: I0316 17:11:16.208224 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f5d3fe3e143a4e70eb6ec298ec173e607da98d4085d398c54f81b39a2ff9614"} err="failed to get container status \"0f5d3fe3e143a4e70eb6ec298ec173e607da98d4085d398c54f81b39a2ff9614\": rpc error: code = NotFound desc = could not find container \"0f5d3fe3e143a4e70eb6ec298ec173e607da98d4085d398c54f81b39a2ff9614\": container with ID starting with 0f5d3fe3e143a4e70eb6ec298ec173e607da98d4085d398c54f81b39a2ff9614 not found: ID does not exist" Mar 16 17:11:16 crc kubenswrapper[5120]: I0316 17:11:16.208313 5120 scope.go:117] "RemoveContainer" containerID="c8b8353c7b4c0db1e4fca1851f4e10b0bf58243a8726401407c787fd457ff216" Mar 16 17:11:16 crc kubenswrapper[5120]: E0316 17:11:16.209076 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c8b8353c7b4c0db1e4fca1851f4e10b0bf58243a8726401407c787fd457ff216\": container with ID starting with c8b8353c7b4c0db1e4fca1851f4e10b0bf58243a8726401407c787fd457ff216 not found: ID does not exist" containerID="c8b8353c7b4c0db1e4fca1851f4e10b0bf58243a8726401407c787fd457ff216" Mar 16 17:11:16 crc kubenswrapper[5120]: I0316 17:11:16.209114 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8b8353c7b4c0db1e4fca1851f4e10b0bf58243a8726401407c787fd457ff216"} err="failed to get container status \"c8b8353c7b4c0db1e4fca1851f4e10b0bf58243a8726401407c787fd457ff216\": rpc error: code = NotFound desc = could not find container \"c8b8353c7b4c0db1e4fca1851f4e10b0bf58243a8726401407c787fd457ff216\": container with ID starting with c8b8353c7b4c0db1e4fca1851f4e10b0bf58243a8726401407c787fd457ff216 not found: ID does not exist" Mar 16 17:11:16 crc kubenswrapper[5120]: I0316 17:11:16.209135 5120 scope.go:117] "RemoveContainer" containerID="21c3374fbc591159449ceb515f67c13006c5efb80bd8f427d0c0d4234d964f54" Mar 16 17:11:16 crc kubenswrapper[5120]: I0316 17:11:16.227710 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 17:11:16 crc kubenswrapper[5120]: I0316 17:11:16.244180 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 17:11:16 crc kubenswrapper[5120]: I0316 17:11:16.248294 5120 scope.go:117] "RemoveContainer" containerID="21c3374fbc591159449ceb515f67c13006c5efb80bd8f427d0c0d4234d964f54" Mar 16 17:11:16 crc kubenswrapper[5120]: E0316 17:11:16.248811 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"21c3374fbc591159449ceb515f67c13006c5efb80bd8f427d0c0d4234d964f54\": container with ID starting with 21c3374fbc591159449ceb515f67c13006c5efb80bd8f427d0c0d4234d964f54 not found: ID does not exist" containerID="21c3374fbc591159449ceb515f67c13006c5efb80bd8f427d0c0d4234d964f54" Mar 16 17:11:16 crc kubenswrapper[5120]: I0316 17:11:16.248880 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21c3374fbc591159449ceb515f67c13006c5efb80bd8f427d0c0d4234d964f54"} err="failed to get container status \"21c3374fbc591159449ceb515f67c13006c5efb80bd8f427d0c0d4234d964f54\": rpc error: code = NotFound desc = could not find container \"21c3374fbc591159449ceb515f67c13006c5efb80bd8f427d0c0d4234d964f54\": container with ID starting with 21c3374fbc591159449ceb515f67c13006c5efb80bd8f427d0c0d4234d964f54 not found: ID does not exist" Mar 16 17:11:16 crc kubenswrapper[5120]: I0316 17:11:16.250262 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-7dd9fb87c6-wk9p7"] Mar 16 17:11:16 crc kubenswrapper[5120]: E0316 17:11:16.253569 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="5f0a1210752c571fbaca2dcbc5e5d9cf5e76f8f1d25ee4f7c4b2ade9932d7436" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 17:11:16 crc kubenswrapper[5120]: E0316 17:11:16.254587 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="5f0a1210752c571fbaca2dcbc5e5d9cf5e76f8f1d25ee4f7c4b2ade9932d7436" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 17:11:16 crc kubenswrapper[5120]: E0316 17:11:16.255775 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="5f0a1210752c571fbaca2dcbc5e5d9cf5e76f8f1d25ee4f7c4b2ade9932d7436" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 17:11:16 crc kubenswrapper[5120]: E0316 17:11:16.255819 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="9a997459-37ba-46a9-9cb8-075f77fa009f" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 17:11:16 crc kubenswrapper[5120]: I0316 17:11:16.256055 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-api-7dd9fb87c6-wk9p7"] Mar 16 17:11:16 crc kubenswrapper[5120]: I0316 17:11:16.263147 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-75fdb7754b-cb728"] Mar 16 17:11:16 crc kubenswrapper[5120]: I0316 17:11:16.268903 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-75fdb7754b-cb728"] Mar 16 17:11:16 crc kubenswrapper[5120]: E0316 17:11:16.637590 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Mar 16 17:11:16 crc kubenswrapper[5120]: E0316 17:11:16.638082 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/259e8ab8-dfd3-414c-b392-951a9f770559-config-data podName:259e8ab8-dfd3-414c-b392-951a9f770559 nodeName:}" failed. No retries permitted until 2026-03-16 17:11:24.637686499 +0000 UTC m=+5986.791618156 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/259e8ab8-dfd3-414c-b392-951a9f770559-config-data") pod "rabbitmq-cell1-server-0" (UID: "259e8ab8-dfd3-414c-b392-951a9f770559") : configmap "rabbitmq-cell1-config-data" not found Mar 16 17:11:16 crc kubenswrapper[5120]: I0316 17:11:16.677380 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2018b64c-7208-4c67-b4ec-6e336ca72e94" path="/var/lib/kubelet/pods/2018b64c-7208-4c67-b4ec-6e336ca72e94/volumes" Mar 16 17:11:16 crc kubenswrapper[5120]: I0316 17:11:16.678524 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="45b8119e-70b5-45ad-9629-41a99f2f8ed0" path="/var/lib/kubelet/pods/45b8119e-70b5-45ad-9629-41a99f2f8ed0/volumes" Mar 16 17:11:16 crc kubenswrapper[5120]: I0316 17:11:16.679225 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="830abb7b-cab5-4a21-9e39-6dc0c0faf74e" path="/var/lib/kubelet/pods/830abb7b-cab5-4a21-9e39-6dc0c0faf74e/volumes" Mar 16 17:11:16 crc kubenswrapper[5120]: I0316 17:11:16.680327 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a1b86673-6678-41ee-b073-f44c6d447fbc" path="/var/lib/kubelet/pods/a1b86673-6678-41ee-b073-f44c6d447fbc/volumes" Mar 16 17:11:16 crc kubenswrapper[5120]: I0316 17:11:16.680942 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a2a1847f-6881-4af9-b38b-35fd23e3f85e" path="/var/lib/kubelet/pods/a2a1847f-6881-4af9-b38b-35fd23e3f85e/volumes" Mar 16 17:11:16 crc kubenswrapper[5120]: I0316 17:11:16.681469 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ade246ff-09d5-4b25-a738-4733af58f79c" path="/var/lib/kubelet/pods/ade246ff-09d5-4b25-a738-4733af58f79c/volumes" Mar 16 17:11:16 crc kubenswrapper[5120]: I0316 17:11:16.682696 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb59b894-da6e-4bd0-85c3-2330d90f2fb9" path="/var/lib/kubelet/pods/cb59b894-da6e-4bd0-85c3-2330d90f2fb9/volumes" Mar 16 17:11:16 crc kubenswrapper[5120]: I0316 17:11:16.683328 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d4da2790-525e-44f0-bddd-c5edbb04ae32" path="/var/lib/kubelet/pods/d4da2790-525e-44f0-bddd-c5edbb04ae32/volumes" Mar 16 17:11:16 crc kubenswrapper[5120]: I0316 17:11:16.684495 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e7b10940-fda7-468a-8937-fd83bb366d34" path="/var/lib/kubelet/pods/e7b10940-fda7-468a-8937-fd83bb366d34/volumes" Mar 16 17:11:16 crc kubenswrapper[5120]: I0316 17:11:16.685193 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f659fd59-18da-47e7-b57a-27e7d95a428e" path="/var/lib/kubelet/pods/f659fd59-18da-47e7-b57a-27e7d95a428e/volumes" Mar 16 17:11:16 crc kubenswrapper[5120]: I0316 17:11:16.910080 5120 generic.go:358] "Generic (PLEG): container finished" podID="ef2e55ac-292f-4242-b410-0eb4d2ff90d3" containerID="06fea802450630dea417ed7a0f1368308b9cfa3ae4a234fa4cd696d5b294abdc" exitCode=0 Mar 16 17:11:16 crc kubenswrapper[5120]: I0316 17:11:16.910238 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"ef2e55ac-292f-4242-b410-0eb4d2ff90d3","Type":"ContainerDied","Data":"06fea802450630dea417ed7a0f1368308b9cfa3ae4a234fa4cd696d5b294abdc"} Mar 16 17:11:17 crc kubenswrapper[5120]: I0316 17:11:17.132067 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 17:11:17 crc kubenswrapper[5120]: I0316 17:11:17.258034 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/ef2e55ac-292f-4242-b410-0eb4d2ff90d3-rabbitmq-tls\") pod \"ef2e55ac-292f-4242-b410-0eb4d2ff90d3\" (UID: \"ef2e55ac-292f-4242-b410-0eb4d2ff90d3\") " Mar 16 17:11:17 crc kubenswrapper[5120]: I0316 17:11:17.258390 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/ef2e55ac-292f-4242-b410-0eb4d2ff90d3-pod-info\") pod \"ef2e55ac-292f-4242-b410-0eb4d2ff90d3\" (UID: \"ef2e55ac-292f-4242-b410-0eb4d2ff90d3\") " Mar 16 17:11:17 crc kubenswrapper[5120]: I0316 17:11:17.258790 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bnv8n\" (UniqueName: \"kubernetes.io/projected/ef2e55ac-292f-4242-b410-0eb4d2ff90d3-kube-api-access-bnv8n\") pod \"ef2e55ac-292f-4242-b410-0eb4d2ff90d3\" (UID: \"ef2e55ac-292f-4242-b410-0eb4d2ff90d3\") " Mar 16 17:11:17 crc kubenswrapper[5120]: I0316 17:11:17.258901 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/ef2e55ac-292f-4242-b410-0eb4d2ff90d3-server-conf\") pod \"ef2e55ac-292f-4242-b410-0eb4d2ff90d3\" (UID: \"ef2e55ac-292f-4242-b410-0eb4d2ff90d3\") " Mar 16 17:11:17 crc kubenswrapper[5120]: I0316 17:11:17.259035 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"persistence\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"ef2e55ac-292f-4242-b410-0eb4d2ff90d3\" (UID: \"ef2e55ac-292f-4242-b410-0eb4d2ff90d3\") " Mar 16 17:11:17 crc kubenswrapper[5120]: I0316 17:11:17.259105 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/ef2e55ac-292f-4242-b410-0eb4d2ff90d3-rabbitmq-plugins\") pod \"ef2e55ac-292f-4242-b410-0eb4d2ff90d3\" (UID: \"ef2e55ac-292f-4242-b410-0eb4d2ff90d3\") " Mar 16 17:11:17 crc kubenswrapper[5120]: I0316 17:11:17.259238 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/ef2e55ac-292f-4242-b410-0eb4d2ff90d3-config-data\") pod \"ef2e55ac-292f-4242-b410-0eb4d2ff90d3\" (UID: \"ef2e55ac-292f-4242-b410-0eb4d2ff90d3\") " Mar 16 17:11:17 crc kubenswrapper[5120]: I0316 17:11:17.259297 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/ef2e55ac-292f-4242-b410-0eb4d2ff90d3-rabbitmq-erlang-cookie\") pod \"ef2e55ac-292f-4242-b410-0eb4d2ff90d3\" (UID: \"ef2e55ac-292f-4242-b410-0eb4d2ff90d3\") " Mar 16 17:11:17 crc kubenswrapper[5120]: I0316 17:11:17.259400 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/ef2e55ac-292f-4242-b410-0eb4d2ff90d3-rabbitmq-confd\") pod \"ef2e55ac-292f-4242-b410-0eb4d2ff90d3\" (UID: \"ef2e55ac-292f-4242-b410-0eb4d2ff90d3\") " Mar 16 17:11:17 crc kubenswrapper[5120]: I0316 17:11:17.259421 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/ef2e55ac-292f-4242-b410-0eb4d2ff90d3-erlang-cookie-secret\") pod \"ef2e55ac-292f-4242-b410-0eb4d2ff90d3\" (UID: \"ef2e55ac-292f-4242-b410-0eb4d2ff90d3\") " Mar 16 17:11:17 crc kubenswrapper[5120]: I0316 17:11:17.259504 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/ef2e55ac-292f-4242-b410-0eb4d2ff90d3-plugins-conf\") pod \"ef2e55ac-292f-4242-b410-0eb4d2ff90d3\" (UID: \"ef2e55ac-292f-4242-b410-0eb4d2ff90d3\") " Mar 16 17:11:17 crc kubenswrapper[5120]: I0316 17:11:17.259805 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef2e55ac-292f-4242-b410-0eb4d2ff90d3-rabbitmq-plugins" (OuterVolumeSpecName: "rabbitmq-plugins") pod "ef2e55ac-292f-4242-b410-0eb4d2ff90d3" (UID: "ef2e55ac-292f-4242-b410-0eb4d2ff90d3"). InnerVolumeSpecName "rabbitmq-plugins". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:11:17 crc kubenswrapper[5120]: I0316 17:11:17.260600 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/ef2e55ac-292f-4242-b410-0eb4d2ff90d3-rabbitmq-plugins\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:17 crc kubenswrapper[5120]: I0316 17:11:17.260617 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ef2e55ac-292f-4242-b410-0eb4d2ff90d3-plugins-conf" (OuterVolumeSpecName: "plugins-conf") pod "ef2e55ac-292f-4242-b410-0eb4d2ff90d3" (UID: "ef2e55ac-292f-4242-b410-0eb4d2ff90d3"). InnerVolumeSpecName "plugins-conf". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:11:17 crc kubenswrapper[5120]: I0316 17:11:17.261271 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef2e55ac-292f-4242-b410-0eb4d2ff90d3-rabbitmq-erlang-cookie" (OuterVolumeSpecName: "rabbitmq-erlang-cookie") pod "ef2e55ac-292f-4242-b410-0eb4d2ff90d3" (UID: "ef2e55ac-292f-4242-b410-0eb4d2ff90d3"). InnerVolumeSpecName "rabbitmq-erlang-cookie". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:11:17 crc kubenswrapper[5120]: I0316 17:11:17.264286 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ef2e55ac-292f-4242-b410-0eb4d2ff90d3-pod-info" (OuterVolumeSpecName: "pod-info") pod "ef2e55ac-292f-4242-b410-0eb4d2ff90d3" (UID: "ef2e55ac-292f-4242-b410-0eb4d2ff90d3"). InnerVolumeSpecName "pod-info". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Mar 16 17:11:17 crc kubenswrapper[5120]: I0316 17:11:17.264282 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef2e55ac-292f-4242-b410-0eb4d2ff90d3-rabbitmq-tls" (OuterVolumeSpecName: "rabbitmq-tls") pod "ef2e55ac-292f-4242-b410-0eb4d2ff90d3" (UID: "ef2e55ac-292f-4242-b410-0eb4d2ff90d3"). InnerVolumeSpecName "rabbitmq-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:11:17 crc kubenswrapper[5120]: I0316 17:11:17.264856 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage13-crc" (OuterVolumeSpecName: "persistence") pod "ef2e55ac-292f-4242-b410-0eb4d2ff90d3" (UID: "ef2e55ac-292f-4242-b410-0eb4d2ff90d3"). InnerVolumeSpecName "local-storage13-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 17:11:17 crc kubenswrapper[5120]: E0316 17:11:17.265257 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="3318da5f8965a4f0071e38f2519bc938484ed88a240807dcc6be332ef0847740" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 17:11:17 crc kubenswrapper[5120]: I0316 17:11:17.265451 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef2e55ac-292f-4242-b410-0eb4d2ff90d3-erlang-cookie-secret" (OuterVolumeSpecName: "erlang-cookie-secret") pod "ef2e55ac-292f-4242-b410-0eb4d2ff90d3" (UID: "ef2e55ac-292f-4242-b410-0eb4d2ff90d3"). InnerVolumeSpecName "erlang-cookie-secret". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:11:17 crc kubenswrapper[5120]: I0316 17:11:17.266075 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef2e55ac-292f-4242-b410-0eb4d2ff90d3-kube-api-access-bnv8n" (OuterVolumeSpecName: "kube-api-access-bnv8n") pod "ef2e55ac-292f-4242-b410-0eb4d2ff90d3" (UID: "ef2e55ac-292f-4242-b410-0eb4d2ff90d3"). InnerVolumeSpecName "kube-api-access-bnv8n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:11:17 crc kubenswrapper[5120]: E0316 17:11:17.266732 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="3318da5f8965a4f0071e38f2519bc938484ed88a240807dcc6be332ef0847740" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 17:11:17 crc kubenswrapper[5120]: E0316 17:11:17.268057 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="3318da5f8965a4f0071e38f2519bc938484ed88a240807dcc6be332ef0847740" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 17:11:17 crc kubenswrapper[5120]: E0316 17:11:17.268104 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="32194c8a-90a1-4132-9b75-3882418d7f7d" containerName="nova-scheduler-scheduler" probeResult="unknown" Mar 16 17:11:17 crc kubenswrapper[5120]: I0316 17:11:17.282244 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ef2e55ac-292f-4242-b410-0eb4d2ff90d3-config-data" (OuterVolumeSpecName: "config-data") pod "ef2e55ac-292f-4242-b410-0eb4d2ff90d3" (UID: "ef2e55ac-292f-4242-b410-0eb4d2ff90d3"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:11:17 crc kubenswrapper[5120]: I0316 17:11:17.301294 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ef2e55ac-292f-4242-b410-0eb4d2ff90d3-server-conf" (OuterVolumeSpecName: "server-conf") pod "ef2e55ac-292f-4242-b410-0eb4d2ff90d3" (UID: "ef2e55ac-292f-4242-b410-0eb4d2ff90d3"). InnerVolumeSpecName "server-conf". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:11:17 crc kubenswrapper[5120]: I0316 17:11:17.345750 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef2e55ac-292f-4242-b410-0eb4d2ff90d3-rabbitmq-confd" (OuterVolumeSpecName: "rabbitmq-confd") pod "ef2e55ac-292f-4242-b410-0eb4d2ff90d3" (UID: "ef2e55ac-292f-4242-b410-0eb4d2ff90d3"). InnerVolumeSpecName "rabbitmq-confd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:11:17 crc kubenswrapper[5120]: I0316 17:11:17.346927 5120 scope.go:117] "RemoveContainer" containerID="94554d84ae0a270229130fd9933c51b22c8f24ecd4373c32ab36d2621bff039a" Mar 16 17:11:17 crc kubenswrapper[5120]: I0316 17:11:17.364263 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") on node \"crc\" " Mar 16 17:11:17 crc kubenswrapper[5120]: I0316 17:11:17.364299 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/ef2e55ac-292f-4242-b410-0eb4d2ff90d3-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:17 crc kubenswrapper[5120]: I0316 17:11:17.364314 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/ef2e55ac-292f-4242-b410-0eb4d2ff90d3-rabbitmq-erlang-cookie\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:17 crc kubenswrapper[5120]: I0316 17:11:17.364326 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/ef2e55ac-292f-4242-b410-0eb4d2ff90d3-rabbitmq-confd\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:17 crc kubenswrapper[5120]: I0316 17:11:17.364357 5120 reconciler_common.go:299] "Volume detached for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/ef2e55ac-292f-4242-b410-0eb4d2ff90d3-erlang-cookie-secret\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:17 crc kubenswrapper[5120]: I0316 17:11:17.364368 5120 reconciler_common.go:299] "Volume detached for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/ef2e55ac-292f-4242-b410-0eb4d2ff90d3-plugins-conf\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:17 crc kubenswrapper[5120]: I0316 17:11:17.364379 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/ef2e55ac-292f-4242-b410-0eb4d2ff90d3-rabbitmq-tls\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:17 crc kubenswrapper[5120]: I0316 17:11:17.364390 5120 reconciler_common.go:299] "Volume detached for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/ef2e55ac-292f-4242-b410-0eb4d2ff90d3-pod-info\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:17 crc kubenswrapper[5120]: I0316 17:11:17.364401 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bnv8n\" (UniqueName: \"kubernetes.io/projected/ef2e55ac-292f-4242-b410-0eb4d2ff90d3-kube-api-access-bnv8n\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:17 crc kubenswrapper[5120]: I0316 17:11:17.364413 5120 reconciler_common.go:299] "Volume detached for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/ef2e55ac-292f-4242-b410-0eb4d2ff90d3-server-conf\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:17 crc kubenswrapper[5120]: I0316 17:11:17.380301 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage13-crc" (UniqueName: "kubernetes.io/local-volume/local-storage13-crc") on node "crc" Mar 16 17:11:17 crc kubenswrapper[5120]: I0316 17:11:17.422954 5120 scope.go:117] "RemoveContainer" containerID="2eb8bab7956008f7ef95a842379b5930514b2b0af917b496712706bf21712297" Mar 16 17:11:17 crc kubenswrapper[5120]: I0316 17:11:17.444797 5120 scope.go:117] "RemoveContainer" containerID="01fbebd9c4cb489491d921e6832b1ae0c35350f3906fa4b6a6d70a5b654c439f" Mar 16 17:11:17 crc kubenswrapper[5120]: I0316 17:11:17.468495 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:17 crc kubenswrapper[5120]: I0316 17:11:17.525336 5120 scope.go:117] "RemoveContainer" containerID="ac31c458a23a7c88a468103329903e25f76c14611b2ee2fe488d13901859dba4" Mar 16 17:11:17 crc kubenswrapper[5120]: I0316 17:11:17.567979 5120 scope.go:117] "RemoveContainer" containerID="1fdd300bb1428e16cfede9bd5ea3086098c6706381ad7ad817f2f22bbaf5dd41" Mar 16 17:11:17 crc kubenswrapper[5120]: I0316 17:11:17.604792 5120 scope.go:117] "RemoveContainer" containerID="49d0fe703443d5c46a4dbd56ca15824de9b502e026cd2ba54e9f70fc748f91ee" Mar 16 17:11:17 crc kubenswrapper[5120]: I0316 17:11:17.655298 5120 scope.go:117] "RemoveContainer" containerID="5a021c077594081de548e79d15b87b604c22660a4b0c83508b50545f82c4fb3c" Mar 16 17:11:17 crc kubenswrapper[5120]: I0316 17:11:17.704480 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 17:11:17 crc kubenswrapper[5120]: I0316 17:11:17.720721 5120 scope.go:117] "RemoveContainer" containerID="2c2eebc8ed470bd67c51676be329387e1edf365b6cc130aa3ae3e37e7168f002" Mar 16 17:11:17 crc kubenswrapper[5120]: I0316 17:11:17.748309 5120 scope.go:117] "RemoveContainer" containerID="9af52bd4160e110b5dbee7df41625a71b1f855885bb069a59f279a7e651995ab" Mar 16 17:11:17 crc kubenswrapper[5120]: I0316 17:11:17.774515 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/259e8ab8-dfd3-414c-b392-951a9f770559-rabbitmq-plugins\") pod \"259e8ab8-dfd3-414c-b392-951a9f770559\" (UID: \"259e8ab8-dfd3-414c-b392-951a9f770559\") " Mar 16 17:11:17 crc kubenswrapper[5120]: I0316 17:11:17.774579 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/259e8ab8-dfd3-414c-b392-951a9f770559-server-conf\") pod \"259e8ab8-dfd3-414c-b392-951a9f770559\" (UID: \"259e8ab8-dfd3-414c-b392-951a9f770559\") " Mar 16 17:11:17 crc kubenswrapper[5120]: I0316 17:11:17.774650 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/259e8ab8-dfd3-414c-b392-951a9f770559-rabbitmq-erlang-cookie\") pod \"259e8ab8-dfd3-414c-b392-951a9f770559\" (UID: \"259e8ab8-dfd3-414c-b392-951a9f770559\") " Mar 16 17:11:17 crc kubenswrapper[5120]: I0316 17:11:17.774683 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/259e8ab8-dfd3-414c-b392-951a9f770559-plugins-conf\") pod \"259e8ab8-dfd3-414c-b392-951a9f770559\" (UID: \"259e8ab8-dfd3-414c-b392-951a9f770559\") " Mar 16 17:11:17 crc kubenswrapper[5120]: I0316 17:11:17.774822 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/259e8ab8-dfd3-414c-b392-951a9f770559-rabbitmq-confd\") pod \"259e8ab8-dfd3-414c-b392-951a9f770559\" (UID: \"259e8ab8-dfd3-414c-b392-951a9f770559\") " Mar 16 17:11:17 crc kubenswrapper[5120]: I0316 17:11:17.774851 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/259e8ab8-dfd3-414c-b392-951a9f770559-erlang-cookie-secret\") pod \"259e8ab8-dfd3-414c-b392-951a9f770559\" (UID: \"259e8ab8-dfd3-414c-b392-951a9f770559\") " Mar 16 17:11:17 crc kubenswrapper[5120]: I0316 17:11:17.774932 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/259e8ab8-dfd3-414c-b392-951a9f770559-config-data\") pod \"259e8ab8-dfd3-414c-b392-951a9f770559\" (UID: \"259e8ab8-dfd3-414c-b392-951a9f770559\") " Mar 16 17:11:17 crc kubenswrapper[5120]: I0316 17:11:17.775039 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/259e8ab8-dfd3-414c-b392-951a9f770559-rabbitmq-tls\") pod \"259e8ab8-dfd3-414c-b392-951a9f770559\" (UID: \"259e8ab8-dfd3-414c-b392-951a9f770559\") " Mar 16 17:11:17 crc kubenswrapper[5120]: I0316 17:11:17.775304 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"persistence\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") pod \"259e8ab8-dfd3-414c-b392-951a9f770559\" (UID: \"259e8ab8-dfd3-414c-b392-951a9f770559\") " Mar 16 17:11:17 crc kubenswrapper[5120]: I0316 17:11:17.775365 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/259e8ab8-dfd3-414c-b392-951a9f770559-rabbitmq-plugins" (OuterVolumeSpecName: "rabbitmq-plugins") pod "259e8ab8-dfd3-414c-b392-951a9f770559" (UID: "259e8ab8-dfd3-414c-b392-951a9f770559"). InnerVolumeSpecName "rabbitmq-plugins". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:11:17 crc kubenswrapper[5120]: I0316 17:11:17.775425 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/259e8ab8-dfd3-414c-b392-951a9f770559-plugins-conf" (OuterVolumeSpecName: "plugins-conf") pod "259e8ab8-dfd3-414c-b392-951a9f770559" (UID: "259e8ab8-dfd3-414c-b392-951a9f770559"). InnerVolumeSpecName "plugins-conf". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:11:17 crc kubenswrapper[5120]: I0316 17:11:17.775438 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/259e8ab8-dfd3-414c-b392-951a9f770559-pod-info\") pod \"259e8ab8-dfd3-414c-b392-951a9f770559\" (UID: \"259e8ab8-dfd3-414c-b392-951a9f770559\") " Mar 16 17:11:17 crc kubenswrapper[5120]: I0316 17:11:17.775589 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vtqrc\" (UniqueName: \"kubernetes.io/projected/259e8ab8-dfd3-414c-b392-951a9f770559-kube-api-access-vtqrc\") pod \"259e8ab8-dfd3-414c-b392-951a9f770559\" (UID: \"259e8ab8-dfd3-414c-b392-951a9f770559\") " Mar 16 17:11:17 crc kubenswrapper[5120]: I0316 17:11:17.778939 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/259e8ab8-dfd3-414c-b392-951a9f770559-rabbitmq-plugins\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:17 crc kubenswrapper[5120]: I0316 17:11:17.778974 5120 reconciler_common.go:299] "Volume detached for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/259e8ab8-dfd3-414c-b392-951a9f770559-plugins-conf\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:17 crc kubenswrapper[5120]: I0316 17:11:17.779213 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/259e8ab8-dfd3-414c-b392-951a9f770559-rabbitmq-erlang-cookie" (OuterVolumeSpecName: "rabbitmq-erlang-cookie") pod "259e8ab8-dfd3-414c-b392-951a9f770559" (UID: "259e8ab8-dfd3-414c-b392-951a9f770559"). InnerVolumeSpecName "rabbitmq-erlang-cookie". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:11:17 crc kubenswrapper[5120]: I0316 17:11:17.779628 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/259e8ab8-dfd3-414c-b392-951a9f770559-erlang-cookie-secret" (OuterVolumeSpecName: "erlang-cookie-secret") pod "259e8ab8-dfd3-414c-b392-951a9f770559" (UID: "259e8ab8-dfd3-414c-b392-951a9f770559"). InnerVolumeSpecName "erlang-cookie-secret". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:11:17 crc kubenswrapper[5120]: I0316 17:11:17.779886 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage07-crc" (OuterVolumeSpecName: "persistence") pod "259e8ab8-dfd3-414c-b392-951a9f770559" (UID: "259e8ab8-dfd3-414c-b392-951a9f770559"). InnerVolumeSpecName "local-storage07-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 17:11:17 crc kubenswrapper[5120]: I0316 17:11:17.781898 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/259e8ab8-dfd3-414c-b392-951a9f770559-pod-info" (OuterVolumeSpecName: "pod-info") pod "259e8ab8-dfd3-414c-b392-951a9f770559" (UID: "259e8ab8-dfd3-414c-b392-951a9f770559"). InnerVolumeSpecName "pod-info". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Mar 16 17:11:17 crc kubenswrapper[5120]: I0316 17:11:17.787090 5120 scope.go:117] "RemoveContainer" containerID="37396698e7652fbd338cc75da2ef41d2618aa93a7113c6d6f2bed1feb0b3a762" Mar 16 17:11:17 crc kubenswrapper[5120]: I0316 17:11:17.787634 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/259e8ab8-dfd3-414c-b392-951a9f770559-rabbitmq-tls" (OuterVolumeSpecName: "rabbitmq-tls") pod "259e8ab8-dfd3-414c-b392-951a9f770559" (UID: "259e8ab8-dfd3-414c-b392-951a9f770559"). InnerVolumeSpecName "rabbitmq-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:11:17 crc kubenswrapper[5120]: I0316 17:11:17.790403 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/259e8ab8-dfd3-414c-b392-951a9f770559-kube-api-access-vtqrc" (OuterVolumeSpecName: "kube-api-access-vtqrc") pod "259e8ab8-dfd3-414c-b392-951a9f770559" (UID: "259e8ab8-dfd3-414c-b392-951a9f770559"). InnerVolumeSpecName "kube-api-access-vtqrc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:11:17 crc kubenswrapper[5120]: I0316 17:11:17.802929 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/259e8ab8-dfd3-414c-b392-951a9f770559-config-data" (OuterVolumeSpecName: "config-data") pod "259e8ab8-dfd3-414c-b392-951a9f770559" (UID: "259e8ab8-dfd3-414c-b392-951a9f770559"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:11:17 crc kubenswrapper[5120]: I0316 17:11:17.819338 5120 scope.go:117] "RemoveContainer" containerID="b03c923ee5173cf2f5c215baaf2037300c95b3029a814fb8eff08aaad254ee85" Mar 16 17:11:17 crc kubenswrapper[5120]: I0316 17:11:17.821671 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/259e8ab8-dfd3-414c-b392-951a9f770559-server-conf" (OuterVolumeSpecName: "server-conf") pod "259e8ab8-dfd3-414c-b392-951a9f770559" (UID: "259e8ab8-dfd3-414c-b392-951a9f770559"). InnerVolumeSpecName "server-conf". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:11:17 crc kubenswrapper[5120]: I0316 17:11:17.870171 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/259e8ab8-dfd3-414c-b392-951a9f770559-rabbitmq-confd" (OuterVolumeSpecName: "rabbitmq-confd") pod "259e8ab8-dfd3-414c-b392-951a9f770559" (UID: "259e8ab8-dfd3-414c-b392-951a9f770559"). InnerVolumeSpecName "rabbitmq-confd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:11:17 crc kubenswrapper[5120]: I0316 17:11:17.881147 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/259e8ab8-dfd3-414c-b392-951a9f770559-rabbitmq-confd\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:17 crc kubenswrapper[5120]: I0316 17:11:17.881363 5120 reconciler_common.go:299] "Volume detached for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/259e8ab8-dfd3-414c-b392-951a9f770559-erlang-cookie-secret\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:17 crc kubenswrapper[5120]: I0316 17:11:17.881458 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/259e8ab8-dfd3-414c-b392-951a9f770559-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:17 crc kubenswrapper[5120]: I0316 17:11:17.881532 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/259e8ab8-dfd3-414c-b392-951a9f770559-rabbitmq-tls\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:17 crc kubenswrapper[5120]: I0316 17:11:17.881623 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage07-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") on node \"crc\" " Mar 16 17:11:17 crc kubenswrapper[5120]: I0316 17:11:17.881689 5120 reconciler_common.go:299] "Volume detached for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/259e8ab8-dfd3-414c-b392-951a9f770559-pod-info\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:17 crc kubenswrapper[5120]: I0316 17:11:17.881749 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vtqrc\" (UniqueName: \"kubernetes.io/projected/259e8ab8-dfd3-414c-b392-951a9f770559-kube-api-access-vtqrc\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:17 crc kubenswrapper[5120]: I0316 17:11:17.881866 5120 reconciler_common.go:299] "Volume detached for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/259e8ab8-dfd3-414c-b392-951a9f770559-server-conf\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:17 crc kubenswrapper[5120]: I0316 17:11:17.881951 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/259e8ab8-dfd3-414c-b392-951a9f770559-rabbitmq-erlang-cookie\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:17 crc kubenswrapper[5120]: I0316 17:11:17.916972 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage07-crc" (UniqueName: "kubernetes.io/local-volume/local-storage07-crc") on node "crc" Mar 16 17:11:17 crc kubenswrapper[5120]: I0316 17:11:17.933723 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"ef2e55ac-292f-4242-b410-0eb4d2ff90d3","Type":"ContainerDied","Data":"7d0da671e12ee7417a6c5b0bac1f7504c2fd2a59aa47cd6a1acce9cb288c37c0"} Mar 16 17:11:17 crc kubenswrapper[5120]: I0316 17:11:17.933901 5120 scope.go:117] "RemoveContainer" containerID="06fea802450630dea417ed7a0f1368308b9cfa3ae4a234fa4cd696d5b294abdc" Mar 16 17:11:17 crc kubenswrapper[5120]: I0316 17:11:17.934170 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 17:11:17 crc kubenswrapper[5120]: I0316 17:11:17.947164 5120 generic.go:358] "Generic (PLEG): container finished" podID="259e8ab8-dfd3-414c-b392-951a9f770559" containerID="b67b7228974d46807a751b668298e02443b992e24f050797b1c8edbe101dc618" exitCode=0 Mar 16 17:11:17 crc kubenswrapper[5120]: I0316 17:11:17.947227 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"259e8ab8-dfd3-414c-b392-951a9f770559","Type":"ContainerDied","Data":"b67b7228974d46807a751b668298e02443b992e24f050797b1c8edbe101dc618"} Mar 16 17:11:17 crc kubenswrapper[5120]: I0316 17:11:17.947251 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"259e8ab8-dfd3-414c-b392-951a9f770559","Type":"ContainerDied","Data":"824a9cdebaceb4238a2b74f53311169cfde00fc6ba8e52a8424ed5d8bd12c929"} Mar 16 17:11:17 crc kubenswrapper[5120]: I0316 17:11:17.947356 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 17:11:17 crc kubenswrapper[5120]: I0316 17:11:17.967604 5120 scope.go:117] "RemoveContainer" containerID="b94db45a50541559bdedc3c8aa62f31b1d4a3f0a3bfdb5aa16e8b980a8e658a1" Mar 16 17:11:17 crc kubenswrapper[5120]: I0316 17:11:17.980492 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 17:11:17 crc kubenswrapper[5120]: I0316 17:11:17.988203 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage07-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:17 crc kubenswrapper[5120]: I0316 17:11:17.992435 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 17:11:17 crc kubenswrapper[5120]: I0316 17:11:17.995888 5120 scope.go:117] "RemoveContainer" containerID="24e0ba9b36b8c8e69c25e031b104d209f612119e56f3f2a6862bfdac4178b943" Mar 16 17:11:18 crc kubenswrapper[5120]: I0316 17:11:18.000333 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 17:11:18 crc kubenswrapper[5120]: I0316 17:11:18.006804 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 17:11:18 crc kubenswrapper[5120]: I0316 17:11:18.012590 5120 scope.go:117] "RemoveContainer" containerID="0ca4518c674a9fcd5147789ec4f4ed26f8157453883a4e00412653726814f834" Mar 16 17:11:18 crc kubenswrapper[5120]: I0316 17:11:18.025053 5120 scope.go:117] "RemoveContainer" containerID="b67b7228974d46807a751b668298e02443b992e24f050797b1c8edbe101dc618" Mar 16 17:11:18 crc kubenswrapper[5120]: I0316 17:11:18.038359 5120 scope.go:117] "RemoveContainer" containerID="4cc160f72df41a9f00d1fb6b2a2de67301502f27dfe9f93c6bdcf983ec3fd934" Mar 16 17:11:18 crc kubenswrapper[5120]: I0316 17:11:18.048501 5120 scope.go:117] "RemoveContainer" containerID="14337f79a09b00109b153c607b179ada53efe4992d9f6a5e163d9cfcdcce5532" Mar 16 17:11:18 crc kubenswrapper[5120]: I0316 17:11:18.061869 5120 scope.go:117] "RemoveContainer" containerID="fdec3c8762d2f8d8ae47e970c4b3e0edbd6320b978c45c913213074531aab3da" Mar 16 17:11:18 crc kubenswrapper[5120]: I0316 17:11:18.089536 5120 scope.go:117] "RemoveContainer" containerID="b67b7228974d46807a751b668298e02443b992e24f050797b1c8edbe101dc618" Mar 16 17:11:18 crc kubenswrapper[5120]: E0316 17:11:18.090098 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b67b7228974d46807a751b668298e02443b992e24f050797b1c8edbe101dc618\": container with ID starting with b67b7228974d46807a751b668298e02443b992e24f050797b1c8edbe101dc618 not found: ID does not exist" containerID="b67b7228974d46807a751b668298e02443b992e24f050797b1c8edbe101dc618" Mar 16 17:11:18 crc kubenswrapper[5120]: I0316 17:11:18.090171 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b67b7228974d46807a751b668298e02443b992e24f050797b1c8edbe101dc618"} err="failed to get container status \"b67b7228974d46807a751b668298e02443b992e24f050797b1c8edbe101dc618\": rpc error: code = NotFound desc = could not find container \"b67b7228974d46807a751b668298e02443b992e24f050797b1c8edbe101dc618\": container with ID starting with b67b7228974d46807a751b668298e02443b992e24f050797b1c8edbe101dc618 not found: ID does not exist" Mar 16 17:11:18 crc kubenswrapper[5120]: I0316 17:11:18.090200 5120 scope.go:117] "RemoveContainer" containerID="14337f79a09b00109b153c607b179ada53efe4992d9f6a5e163d9cfcdcce5532" Mar 16 17:11:18 crc kubenswrapper[5120]: E0316 17:11:18.090535 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"14337f79a09b00109b153c607b179ada53efe4992d9f6a5e163d9cfcdcce5532\": container with ID starting with 14337f79a09b00109b153c607b179ada53efe4992d9f6a5e163d9cfcdcce5532 not found: ID does not exist" containerID="14337f79a09b00109b153c607b179ada53efe4992d9f6a5e163d9cfcdcce5532" Mar 16 17:11:18 crc kubenswrapper[5120]: I0316 17:11:18.090564 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14337f79a09b00109b153c607b179ada53efe4992d9f6a5e163d9cfcdcce5532"} err="failed to get container status \"14337f79a09b00109b153c607b179ada53efe4992d9f6a5e163d9cfcdcce5532\": rpc error: code = NotFound desc = could not find container \"14337f79a09b00109b153c607b179ada53efe4992d9f6a5e163d9cfcdcce5532\": container with ID starting with 14337f79a09b00109b153c607b179ada53efe4992d9f6a5e163d9cfcdcce5532 not found: ID does not exist" Mar 16 17:11:18 crc kubenswrapper[5120]: I0316 17:11:18.102228 5120 scope.go:117] "RemoveContainer" containerID="49ea0ac86a7b1dbc77c7c9a8507bd7eeae570e9fbbc82c79faa69b496986fa40" Mar 16 17:11:18 crc kubenswrapper[5120]: I0316 17:11:18.121087 5120 scope.go:117] "RemoveContainer" containerID="4ba10c753384bcd6c6df8154b987f5c33462bbab2b730af7b9575e307ee0f9a4" Mar 16 17:11:18 crc kubenswrapper[5120]: I0316 17:11:18.137480 5120 scope.go:117] "RemoveContainer" containerID="872bbebcb661fffcc8e13eb4398a4bf7f4c0d71bf43c1e67d9574cecdab4ca04" Mar 16 17:11:18 crc kubenswrapper[5120]: I0316 17:11:18.174154 5120 scope.go:117] "RemoveContainer" containerID="f8f1e81860d9d8e752ebcc95a60379adddcc03a54feb00474f4891bbb2eaed18" Mar 16 17:11:18 crc kubenswrapper[5120]: I0316 17:11:18.192914 5120 scope.go:117] "RemoveContainer" containerID="24e0ba9b36b8c8e69c25e031b104d209f612119e56f3f2a6862bfdac4178b943" Mar 16 17:11:18 crc kubenswrapper[5120]: E0316 17:11:18.193381 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"24e0ba9b36b8c8e69c25e031b104d209f612119e56f3f2a6862bfdac4178b943\": container with ID starting with 24e0ba9b36b8c8e69c25e031b104d209f612119e56f3f2a6862bfdac4178b943 not found: ID does not exist" containerID="24e0ba9b36b8c8e69c25e031b104d209f612119e56f3f2a6862bfdac4178b943" Mar 16 17:11:18 crc kubenswrapper[5120]: E0316 17:11:18.193439 5120 kuberuntime_gc.go:150] "Failed to remove container" err="failed to get container status \"24e0ba9b36b8c8e69c25e031b104d209f612119e56f3f2a6862bfdac4178b943\": rpc error: code = NotFound desc = could not find container \"24e0ba9b36b8c8e69c25e031b104d209f612119e56f3f2a6862bfdac4178b943\": container with ID starting with 24e0ba9b36b8c8e69c25e031b104d209f612119e56f3f2a6862bfdac4178b943 not found: ID does not exist" containerID="24e0ba9b36b8c8e69c25e031b104d209f612119e56f3f2a6862bfdac4178b943" Mar 16 17:11:18 crc kubenswrapper[5120]: I0316 17:11:18.193476 5120 scope.go:117] "RemoveContainer" containerID="6b92a7c8ef21eca1c42f0c68768f5875e49ca7306cf74cf2db4fd0b787c9798d" Mar 16 17:11:18 crc kubenswrapper[5120]: I0316 17:11:18.210183 5120 scope.go:117] "RemoveContainer" containerID="3775781460db8ee2f83339813fced0666ae8be36eb4e9f89396cc442f43f8177" Mar 16 17:11:18 crc kubenswrapper[5120]: E0316 17:11:18.279896 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="b4f2581124fb25de73fc35d6d1e068c0f8af119030bc9ac8f4b4c60b39198038" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 17:11:18 crc kubenswrapper[5120]: E0316 17:11:18.282137 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="b4f2581124fb25de73fc35d6d1e068c0f8af119030bc9ac8f4b4c60b39198038" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 17:11:18 crc kubenswrapper[5120]: E0316 17:11:18.283312 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="b4f2581124fb25de73fc35d6d1e068c0f8af119030bc9ac8f4b4c60b39198038" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 17:11:18 crc kubenswrapper[5120]: E0316 17:11:18.283353 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="d0852906-6351-45a9-a44c-0bf3f4c29496" containerName="nova-cell1-conductor-conductor" probeResult="unknown" Mar 16 17:11:18 crc kubenswrapper[5120]: I0316 17:11:18.326388 5120 scope.go:117] "RemoveContainer" containerID="06fea802450630dea417ed7a0f1368308b9cfa3ae4a234fa4cd696d5b294abdc" Mar 16 17:11:18 crc kubenswrapper[5120]: E0316 17:11:18.327091 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"06fea802450630dea417ed7a0f1368308b9cfa3ae4a234fa4cd696d5b294abdc\": container with ID starting with 06fea802450630dea417ed7a0f1368308b9cfa3ae4a234fa4cd696d5b294abdc not found: ID does not exist" containerID="06fea802450630dea417ed7a0f1368308b9cfa3ae4a234fa4cd696d5b294abdc" Mar 16 17:11:18 crc kubenswrapper[5120]: E0316 17:11:18.327141 5120 kuberuntime_gc.go:150] "Failed to remove container" err="failed to get container status \"06fea802450630dea417ed7a0f1368308b9cfa3ae4a234fa4cd696d5b294abdc\": rpc error: code = NotFound desc = could not find container \"06fea802450630dea417ed7a0f1368308b9cfa3ae4a234fa4cd696d5b294abdc\": container with ID starting with 06fea802450630dea417ed7a0f1368308b9cfa3ae4a234fa4cd696d5b294abdc not found: ID does not exist" containerID="06fea802450630dea417ed7a0f1368308b9cfa3ae4a234fa4cd696d5b294abdc" Mar 16 17:11:18 crc kubenswrapper[5120]: I0316 17:11:18.327193 5120 scope.go:117] "RemoveContainer" containerID="14337f79a09b00109b153c607b179ada53efe4992d9f6a5e163d9cfcdcce5532" Mar 16 17:11:18 crc kubenswrapper[5120]: E0316 17:11:18.327682 5120 kuberuntime_gc.go:150] "Failed to remove container" err="failed to get container status \"14337f79a09b00109b153c607b179ada53efe4992d9f6a5e163d9cfcdcce5532\": rpc error: code = NotFound desc = could not find container \"14337f79a09b00109b153c607b179ada53efe4992d9f6a5e163d9cfcdcce5532\": container with ID starting with 14337f79a09b00109b153c607b179ada53efe4992d9f6a5e163d9cfcdcce5532 not found: ID does not exist" containerID="14337f79a09b00109b153c607b179ada53efe4992d9f6a5e163d9cfcdcce5532" Mar 16 17:11:18 crc kubenswrapper[5120]: I0316 17:11:18.327708 5120 scope.go:117] "RemoveContainer" containerID="5de45d663659734bf67fea9f4b926f140bb82d2bd443138837c84671f787b1af" Mar 16 17:11:18 crc kubenswrapper[5120]: I0316 17:11:18.348363 5120 scope.go:117] "RemoveContainer" containerID="b67b7228974d46807a751b668298e02443b992e24f050797b1c8edbe101dc618" Mar 16 17:11:18 crc kubenswrapper[5120]: E0316 17:11:18.348833 5120 kuberuntime_gc.go:150] "Failed to remove container" err="failed to get container status \"b67b7228974d46807a751b668298e02443b992e24f050797b1c8edbe101dc618\": rpc error: code = NotFound desc = could not find container \"b67b7228974d46807a751b668298e02443b992e24f050797b1c8edbe101dc618\": container with ID starting with b67b7228974d46807a751b668298e02443b992e24f050797b1c8edbe101dc618 not found: ID does not exist" containerID="b67b7228974d46807a751b668298e02443b992e24f050797b1c8edbe101dc618" Mar 16 17:11:18 crc kubenswrapper[5120]: I0316 17:11:18.348891 5120 scope.go:117] "RemoveContainer" containerID="a801ff774ac57d46c7793df3794f49ee61fc297f51dc9e6284b121a7bde069f0" Mar 16 17:11:18 crc kubenswrapper[5120]: I0316 17:11:18.367490 5120 scope.go:117] "RemoveContainer" containerID="2639d28a5861875f09fc04a1d7456f74ed4ca9d395f83f21c6c1d464036a0b0f" Mar 16 17:11:18 crc kubenswrapper[5120]: I0316 17:11:18.387404 5120 scope.go:117] "RemoveContainer" containerID="d4fbec92f3dc1a4f9c6b9dee1448e97936aebfc047d4fd728d57a8c167fbfec7" Mar 16 17:11:18 crc kubenswrapper[5120]: I0316 17:11:18.411428 5120 scope.go:117] "RemoveContainer" containerID="f5a36233b998399b8509375b165a56525bdd7456350061623e0fe86d2c84166b" Mar 16 17:11:18 crc kubenswrapper[5120]: I0316 17:11:18.679189 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="259e8ab8-dfd3-414c-b392-951a9f770559" path="/var/lib/kubelet/pods/259e8ab8-dfd3-414c-b392-951a9f770559/volumes" Mar 16 17:11:18 crc kubenswrapper[5120]: I0316 17:11:18.680101 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef2e55ac-292f-4242-b410-0eb4d2ff90d3" path="/var/lib/kubelet/pods/ef2e55ac-292f-4242-b410-0eb4d2ff90d3/volumes" Mar 16 17:11:20 crc kubenswrapper[5120]: I0316 17:11:20.303805 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/ceilometer-0" podUID="20d69ce8-08cb-4036-9537-ee82df795777" containerName="proxy-httpd" probeResult="failure" output="Get \"https://10.217.0.110:3000/\": dial tcp 10.217.0.110:3000: connect: connection refused" Mar 16 17:11:20 crc kubenswrapper[5120]: I0316 17:11:20.375077 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-7dd9fb87c6-wk9p7" podUID="cb59b894-da6e-4bd0-85c3-2330d90f2fb9" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.0.105:9311/healthcheck\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Mar 16 17:11:20 crc kubenswrapper[5120]: I0316 17:11:20.888623 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-zc7hd" Mar 16 17:11:20 crc kubenswrapper[5120]: I0316 17:11:20.948602 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-58664f4b7c-kc5rb"] Mar 16 17:11:20 crc kubenswrapper[5120]: I0316 17:11:20.948936 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58664f4b7c-kc5rb" podUID="01e18a65-5476-4eea-8420-5f6bc6f93cca" containerName="dnsmasq-dns" containerID="cri-o://176db03fd6cd831432d9130458bd0779446d5f6b6eb96185d80dce91e5075fc5" gracePeriod=10 Mar 16 17:11:21 crc kubenswrapper[5120]: E0316 17:11:21.253699 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="5f0a1210752c571fbaca2dcbc5e5d9cf5e76f8f1d25ee4f7c4b2ade9932d7436" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 17:11:21 crc kubenswrapper[5120]: E0316 17:11:21.256050 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="5f0a1210752c571fbaca2dcbc5e5d9cf5e76f8f1d25ee4f7c4b2ade9932d7436" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 17:11:21 crc kubenswrapper[5120]: E0316 17:11:21.258903 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="5f0a1210752c571fbaca2dcbc5e5d9cf5e76f8f1d25ee4f7c4b2ade9932d7436" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 17:11:21 crc kubenswrapper[5120]: E0316 17:11:21.258977 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="9a997459-37ba-46a9-9cb8-075f77fa009f" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 17:11:21 crc kubenswrapper[5120]: I0316 17:11:21.341816 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58664f4b7c-kc5rb" Mar 16 17:11:21 crc kubenswrapper[5120]: I0316 17:11:21.379662 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/01e18a65-5476-4eea-8420-5f6bc6f93cca-dnsmasq-svc\") pod \"01e18a65-5476-4eea-8420-5f6bc6f93cca\" (UID: \"01e18a65-5476-4eea-8420-5f6bc6f93cca\") " Mar 16 17:11:21 crc kubenswrapper[5120]: I0316 17:11:21.380097 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/01e18a65-5476-4eea-8420-5f6bc6f93cca-dns-swift-storage-0\") pod \"01e18a65-5476-4eea-8420-5f6bc6f93cca\" (UID: \"01e18a65-5476-4eea-8420-5f6bc6f93cca\") " Mar 16 17:11:21 crc kubenswrapper[5120]: I0316 17:11:21.380304 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/01e18a65-5476-4eea-8420-5f6bc6f93cca-config\") pod \"01e18a65-5476-4eea-8420-5f6bc6f93cca\" (UID: \"01e18a65-5476-4eea-8420-5f6bc6f93cca\") " Mar 16 17:11:21 crc kubenswrapper[5120]: I0316 17:11:21.380517 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vfrmx\" (UniqueName: \"kubernetes.io/projected/01e18a65-5476-4eea-8420-5f6bc6f93cca-kube-api-access-vfrmx\") pod \"01e18a65-5476-4eea-8420-5f6bc6f93cca\" (UID: \"01e18a65-5476-4eea-8420-5f6bc6f93cca\") " Mar 16 17:11:21 crc kubenswrapper[5120]: I0316 17:11:21.385821 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01e18a65-5476-4eea-8420-5f6bc6f93cca-kube-api-access-vfrmx" (OuterVolumeSpecName: "kube-api-access-vfrmx") pod "01e18a65-5476-4eea-8420-5f6bc6f93cca" (UID: "01e18a65-5476-4eea-8420-5f6bc6f93cca"). InnerVolumeSpecName "kube-api-access-vfrmx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:11:21 crc kubenswrapper[5120]: I0316 17:11:21.422480 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/01e18a65-5476-4eea-8420-5f6bc6f93cca-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "01e18a65-5476-4eea-8420-5f6bc6f93cca" (UID: "01e18a65-5476-4eea-8420-5f6bc6f93cca"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:11:21 crc kubenswrapper[5120]: I0316 17:11:21.424716 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/01e18a65-5476-4eea-8420-5f6bc6f93cca-dns-swift-storage-0" (OuterVolumeSpecName: "dns-swift-storage-0") pod "01e18a65-5476-4eea-8420-5f6bc6f93cca" (UID: "01e18a65-5476-4eea-8420-5f6bc6f93cca"). InnerVolumeSpecName "dns-swift-storage-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:11:21 crc kubenswrapper[5120]: I0316 17:11:21.430473 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/01e18a65-5476-4eea-8420-5f6bc6f93cca-config" (OuterVolumeSpecName: "config") pod "01e18a65-5476-4eea-8420-5f6bc6f93cca" (UID: "01e18a65-5476-4eea-8420-5f6bc6f93cca"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:11:21 crc kubenswrapper[5120]: I0316 17:11:21.484230 5120 reconciler_common.go:299] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/01e18a65-5476-4eea-8420-5f6bc6f93cca-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:21 crc kubenswrapper[5120]: I0316 17:11:21.484254 5120 reconciler_common.go:299] "Volume detached for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/01e18a65-5476-4eea-8420-5f6bc6f93cca-dns-swift-storage-0\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:21 crc kubenswrapper[5120]: I0316 17:11:21.484266 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/01e18a65-5476-4eea-8420-5f6bc6f93cca-config\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:21 crc kubenswrapper[5120]: I0316 17:11:21.484275 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vfrmx\" (UniqueName: \"kubernetes.io/projected/01e18a65-5476-4eea-8420-5f6bc6f93cca-kube-api-access-vfrmx\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:21 crc kubenswrapper[5120]: I0316 17:11:21.996971 5120 generic.go:358] "Generic (PLEG): container finished" podID="01e18a65-5476-4eea-8420-5f6bc6f93cca" containerID="176db03fd6cd831432d9130458bd0779446d5f6b6eb96185d80dce91e5075fc5" exitCode=0 Mar 16 17:11:21 crc kubenswrapper[5120]: I0316 17:11:21.997109 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58664f4b7c-kc5rb" event={"ID":"01e18a65-5476-4eea-8420-5f6bc6f93cca","Type":"ContainerDied","Data":"176db03fd6cd831432d9130458bd0779446d5f6b6eb96185d80dce91e5075fc5"} Mar 16 17:11:21 crc kubenswrapper[5120]: I0316 17:11:21.997166 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58664f4b7c-kc5rb" event={"ID":"01e18a65-5476-4eea-8420-5f6bc6f93cca","Type":"ContainerDied","Data":"609259a42caf1a0215d002ced89e270e2f25f0e046ea3b96d979285462783204"} Mar 16 17:11:21 crc kubenswrapper[5120]: I0316 17:11:21.997200 5120 scope.go:117] "RemoveContainer" containerID="176db03fd6cd831432d9130458bd0779446d5f6b6eb96185d80dce91e5075fc5" Mar 16 17:11:21 crc kubenswrapper[5120]: I0316 17:11:21.997442 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58664f4b7c-kc5rb" Mar 16 17:11:22 crc kubenswrapper[5120]: I0316 17:11:22.022167 5120 scope.go:117] "RemoveContainer" containerID="0a66e01db218811985b3e366c62db997c484029b1550da063a5173bd9d23a881" Mar 16 17:11:22 crc kubenswrapper[5120]: I0316 17:11:22.055068 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-58664f4b7c-kc5rb"] Mar 16 17:11:22 crc kubenswrapper[5120]: I0316 17:11:22.062464 5120 scope.go:117] "RemoveContainer" containerID="176db03fd6cd831432d9130458bd0779446d5f6b6eb96185d80dce91e5075fc5" Mar 16 17:11:22 crc kubenswrapper[5120]: E0316 17:11:22.063075 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"176db03fd6cd831432d9130458bd0779446d5f6b6eb96185d80dce91e5075fc5\": container with ID starting with 176db03fd6cd831432d9130458bd0779446d5f6b6eb96185d80dce91e5075fc5 not found: ID does not exist" containerID="176db03fd6cd831432d9130458bd0779446d5f6b6eb96185d80dce91e5075fc5" Mar 16 17:11:22 crc kubenswrapper[5120]: I0316 17:11:22.063127 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"176db03fd6cd831432d9130458bd0779446d5f6b6eb96185d80dce91e5075fc5"} err="failed to get container status \"176db03fd6cd831432d9130458bd0779446d5f6b6eb96185d80dce91e5075fc5\": rpc error: code = NotFound desc = could not find container \"176db03fd6cd831432d9130458bd0779446d5f6b6eb96185d80dce91e5075fc5\": container with ID starting with 176db03fd6cd831432d9130458bd0779446d5f6b6eb96185d80dce91e5075fc5 not found: ID does not exist" Mar 16 17:11:22 crc kubenswrapper[5120]: I0316 17:11:22.063158 5120 scope.go:117] "RemoveContainer" containerID="0a66e01db218811985b3e366c62db997c484029b1550da063a5173bd9d23a881" Mar 16 17:11:22 crc kubenswrapper[5120]: E0316 17:11:22.063594 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a66e01db218811985b3e366c62db997c484029b1550da063a5173bd9d23a881\": container with ID starting with 0a66e01db218811985b3e366c62db997c484029b1550da063a5173bd9d23a881 not found: ID does not exist" containerID="0a66e01db218811985b3e366c62db997c484029b1550da063a5173bd9d23a881" Mar 16 17:11:22 crc kubenswrapper[5120]: I0316 17:11:22.063644 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a66e01db218811985b3e366c62db997c484029b1550da063a5173bd9d23a881"} err="failed to get container status \"0a66e01db218811985b3e366c62db997c484029b1550da063a5173bd9d23a881\": rpc error: code = NotFound desc = could not find container \"0a66e01db218811985b3e366c62db997c484029b1550da063a5173bd9d23a881\": container with ID starting with 0a66e01db218811985b3e366c62db997c484029b1550da063a5173bd9d23a881 not found: ID does not exist" Mar 16 17:11:22 crc kubenswrapper[5120]: I0316 17:11:22.070350 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-58664f4b7c-kc5rb"] Mar 16 17:11:22 crc kubenswrapper[5120]: E0316 17:11:22.264213 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="3318da5f8965a4f0071e38f2519bc938484ed88a240807dcc6be332ef0847740" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 17:11:22 crc kubenswrapper[5120]: E0316 17:11:22.265823 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="3318da5f8965a4f0071e38f2519bc938484ed88a240807dcc6be332ef0847740" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 17:11:22 crc kubenswrapper[5120]: E0316 17:11:22.267998 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="3318da5f8965a4f0071e38f2519bc938484ed88a240807dcc6be332ef0847740" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 17:11:22 crc kubenswrapper[5120]: E0316 17:11:22.268082 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="32194c8a-90a1-4132-9b75-3882418d7f7d" containerName="nova-scheduler-scheduler" probeResult="unknown" Mar 16 17:11:22 crc kubenswrapper[5120]: I0316 17:11:22.675971 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="01e18a65-5476-4eea-8420-5f6bc6f93cca" path="/var/lib/kubelet/pods/01e18a65-5476-4eea-8420-5f6bc6f93cca/volumes" Mar 16 17:11:23 crc kubenswrapper[5120]: E0316 17:11:23.279747 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="b4f2581124fb25de73fc35d6d1e068c0f8af119030bc9ac8f4b4c60b39198038" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 17:11:23 crc kubenswrapper[5120]: E0316 17:11:23.281163 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="b4f2581124fb25de73fc35d6d1e068c0f8af119030bc9ac8f4b4c60b39198038" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 17:11:23 crc kubenswrapper[5120]: E0316 17:11:23.282242 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="b4f2581124fb25de73fc35d6d1e068c0f8af119030bc9ac8f4b4c60b39198038" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 17:11:23 crc kubenswrapper[5120]: E0316 17:11:23.282386 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="d0852906-6351-45a9-a44c-0bf3f4c29496" containerName="nova-cell1-conductor-conductor" probeResult="unknown" Mar 16 17:11:26 crc kubenswrapper[5120]: E0316 17:11:26.252935 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="5f0a1210752c571fbaca2dcbc5e5d9cf5e76f8f1d25ee4f7c4b2ade9932d7436" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 17:11:26 crc kubenswrapper[5120]: E0316 17:11:26.255476 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="5f0a1210752c571fbaca2dcbc5e5d9cf5e76f8f1d25ee4f7c4b2ade9932d7436" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 17:11:26 crc kubenswrapper[5120]: E0316 17:11:26.257089 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="5f0a1210752c571fbaca2dcbc5e5d9cf5e76f8f1d25ee4f7c4b2ade9932d7436" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 17:11:26 crc kubenswrapper[5120]: E0316 17:11:26.257207 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="9a997459-37ba-46a9-9cb8-075f77fa009f" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 17:11:27 crc kubenswrapper[5120]: E0316 17:11:27.264524 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="3318da5f8965a4f0071e38f2519bc938484ed88a240807dcc6be332ef0847740" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 17:11:27 crc kubenswrapper[5120]: E0316 17:11:27.266115 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="3318da5f8965a4f0071e38f2519bc938484ed88a240807dcc6be332ef0847740" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 17:11:27 crc kubenswrapper[5120]: E0316 17:11:27.267612 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="3318da5f8965a4f0071e38f2519bc938484ed88a240807dcc6be332ef0847740" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 17:11:27 crc kubenswrapper[5120]: E0316 17:11:27.267655 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="32194c8a-90a1-4132-9b75-3882418d7f7d" containerName="nova-scheduler-scheduler" probeResult="unknown" Mar 16 17:11:28 crc kubenswrapper[5120]: E0316 17:11:28.279693 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="b4f2581124fb25de73fc35d6d1e068c0f8af119030bc9ac8f4b4c60b39198038" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 17:11:28 crc kubenswrapper[5120]: E0316 17:11:28.281554 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="b4f2581124fb25de73fc35d6d1e068c0f8af119030bc9ac8f4b4c60b39198038" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 17:11:28 crc kubenswrapper[5120]: E0316 17:11:28.283159 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="b4f2581124fb25de73fc35d6d1e068c0f8af119030bc9ac8f4b4c60b39198038" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 17:11:28 crc kubenswrapper[5120]: E0316 17:11:28.283201 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="d0852906-6351-45a9-a44c-0bf3f4c29496" containerName="nova-cell1-conductor-conductor" probeResult="unknown" Mar 16 17:11:31 crc kubenswrapper[5120]: E0316 17:11:31.254365 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="5f0a1210752c571fbaca2dcbc5e5d9cf5e76f8f1d25ee4f7c4b2ade9932d7436" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 17:11:31 crc kubenswrapper[5120]: E0316 17:11:31.256497 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="5f0a1210752c571fbaca2dcbc5e5d9cf5e76f8f1d25ee4f7c4b2ade9932d7436" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 17:11:31 crc kubenswrapper[5120]: E0316 17:11:31.257748 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="5f0a1210752c571fbaca2dcbc5e5d9cf5e76f8f1d25ee4f7c4b2ade9932d7436" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 17:11:31 crc kubenswrapper[5120]: E0316 17:11:31.257797 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="9a997459-37ba-46a9-9cb8-075f77fa009f" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 17:11:32 crc kubenswrapper[5120]: E0316 17:11:32.266691 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="3318da5f8965a4f0071e38f2519bc938484ed88a240807dcc6be332ef0847740" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 17:11:32 crc kubenswrapper[5120]: E0316 17:11:32.268430 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="3318da5f8965a4f0071e38f2519bc938484ed88a240807dcc6be332ef0847740" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 17:11:32 crc kubenswrapper[5120]: E0316 17:11:32.269526 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="3318da5f8965a4f0071e38f2519bc938484ed88a240807dcc6be332ef0847740" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 17:11:32 crc kubenswrapper[5120]: E0316 17:11:32.269563 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="32194c8a-90a1-4132-9b75-3882418d7f7d" containerName="nova-scheduler-scheduler" probeResult="unknown" Mar 16 17:11:33 crc kubenswrapper[5120]: E0316 17:11:33.279261 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="b4f2581124fb25de73fc35d6d1e068c0f8af119030bc9ac8f4b4c60b39198038" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 17:11:33 crc kubenswrapper[5120]: E0316 17:11:33.281274 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="b4f2581124fb25de73fc35d6d1e068c0f8af119030bc9ac8f4b4c60b39198038" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 17:11:33 crc kubenswrapper[5120]: E0316 17:11:33.282655 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="b4f2581124fb25de73fc35d6d1e068c0f8af119030bc9ac8f4b4c60b39198038" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 17:11:33 crc kubenswrapper[5120]: E0316 17:11:33.282731 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="d0852906-6351-45a9-a44c-0bf3f4c29496" containerName="nova-cell1-conductor-conductor" probeResult="unknown" Mar 16 17:11:36 crc kubenswrapper[5120]: E0316 17:11:36.253076 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="5f0a1210752c571fbaca2dcbc5e5d9cf5e76f8f1d25ee4f7c4b2ade9932d7436" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 17:11:36 crc kubenswrapper[5120]: E0316 17:11:36.254441 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="5f0a1210752c571fbaca2dcbc5e5d9cf5e76f8f1d25ee4f7c4b2ade9932d7436" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 17:11:36 crc kubenswrapper[5120]: E0316 17:11:36.256051 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="5f0a1210752c571fbaca2dcbc5e5d9cf5e76f8f1d25ee4f7c4b2ade9932d7436" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 17:11:36 crc kubenswrapper[5120]: E0316 17:11:36.256096 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="9a997459-37ba-46a9-9cb8-075f77fa009f" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 17:11:36 crc kubenswrapper[5120]: I0316 17:11:36.361981 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/neutron-7465cc7fb4-nnm87" podUID="c4f7000d-d4eb-4d8c-9fb8-f88d8304b970" containerName="neutron-httpd" probeResult="failure" output="Get \"https://10.217.0.74:9696/\": dial tcp 10.217.0.74:9696: connect: connection refused" Mar 16 17:11:37 crc kubenswrapper[5120]: E0316 17:11:37.265751 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="3318da5f8965a4f0071e38f2519bc938484ed88a240807dcc6be332ef0847740" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 17:11:37 crc kubenswrapper[5120]: E0316 17:11:37.267659 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="3318da5f8965a4f0071e38f2519bc938484ed88a240807dcc6be332ef0847740" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 17:11:37 crc kubenswrapper[5120]: E0316 17:11:37.269107 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="3318da5f8965a4f0071e38f2519bc938484ed88a240807dcc6be332ef0847740" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 17:11:37 crc kubenswrapper[5120]: E0316 17:11:37.269160 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="32194c8a-90a1-4132-9b75-3882418d7f7d" containerName="nova-scheduler-scheduler" probeResult="unknown" Mar 16 17:11:38 crc kubenswrapper[5120]: E0316 17:11:38.280388 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="b4f2581124fb25de73fc35d6d1e068c0f8af119030bc9ac8f4b4c60b39198038" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 17:11:38 crc kubenswrapper[5120]: E0316 17:11:38.282471 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="b4f2581124fb25de73fc35d6d1e068c0f8af119030bc9ac8f4b4c60b39198038" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 17:11:38 crc kubenswrapper[5120]: E0316 17:11:38.284180 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="b4f2581124fb25de73fc35d6d1e068c0f8af119030bc9ac8f4b4c60b39198038" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 17:11:38 crc kubenswrapper[5120]: E0316 17:11:38.284221 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="d0852906-6351-45a9-a44c-0bf3f4c29496" containerName="nova-cell1-conductor-conductor" probeResult="unknown" Mar 16 17:11:40 crc kubenswrapper[5120]: I0316 17:11:40.783727 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:11:40 crc kubenswrapper[5120]: I0316 17:11:40.796857 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-7465cc7fb4-nnm87_c4f7000d-d4eb-4d8c-9fb8-f88d8304b970/neutron-api/0.log" Mar 16 17:11:40 crc kubenswrapper[5120]: I0316 17:11:40.796939 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-7465cc7fb4-nnm87" Mar 16 17:11:40 crc kubenswrapper[5120]: I0316 17:11:40.811962 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Mar 16 17:11:40 crc kubenswrapper[5120]: I0316 17:11:40.837570 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6e4e8c65-5607-4f79-ba90-208ca1a32521-scripts\") pod \"6e4e8c65-5607-4f79-ba90-208ca1a32521\" (UID: \"6e4e8c65-5607-4f79-ba90-208ca1a32521\") " Mar 16 17:11:40 crc kubenswrapper[5120]: I0316 17:11:40.837636 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6e4e8c65-5607-4f79-ba90-208ca1a32521-combined-ca-bundle\") pod \"6e4e8c65-5607-4f79-ba90-208ca1a32521\" (UID: \"6e4e8c65-5607-4f79-ba90-208ca1a32521\") " Mar 16 17:11:40 crc kubenswrapper[5120]: I0316 17:11:40.837850 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vfm2g\" (UniqueName: \"kubernetes.io/projected/6e4e8c65-5607-4f79-ba90-208ca1a32521-kube-api-access-vfm2g\") pod \"6e4e8c65-5607-4f79-ba90-208ca1a32521\" (UID: \"6e4e8c65-5607-4f79-ba90-208ca1a32521\") " Mar 16 17:11:40 crc kubenswrapper[5120]: I0316 17:11:40.837931 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/6e4e8c65-5607-4f79-ba90-208ca1a32521-etc-machine-id\") pod \"6e4e8c65-5607-4f79-ba90-208ca1a32521\" (UID: \"6e4e8c65-5607-4f79-ba90-208ca1a32521\") " Mar 16 17:11:40 crc kubenswrapper[5120]: I0316 17:11:40.838133 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6e4e8c65-5607-4f79-ba90-208ca1a32521-config-data\") pod \"6e4e8c65-5607-4f79-ba90-208ca1a32521\" (UID: \"6e4e8c65-5607-4f79-ba90-208ca1a32521\") " Mar 16 17:11:40 crc kubenswrapper[5120]: I0316 17:11:40.838259 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/6e4e8c65-5607-4f79-ba90-208ca1a32521-config-data-custom\") pod \"6e4e8c65-5607-4f79-ba90-208ca1a32521\" (UID: \"6e4e8c65-5607-4f79-ba90-208ca1a32521\") " Mar 16 17:11:40 crc kubenswrapper[5120]: I0316 17:11:40.838727 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/6e4e8c65-5607-4f79-ba90-208ca1a32521-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "6e4e8c65-5607-4f79-ba90-208ca1a32521" (UID: "6e4e8c65-5607-4f79-ba90-208ca1a32521"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 17:11:40 crc kubenswrapper[5120]: I0316 17:11:40.839114 5120 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/6e4e8c65-5607-4f79-ba90-208ca1a32521-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:40 crc kubenswrapper[5120]: I0316 17:11:40.843146 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e4e8c65-5607-4f79-ba90-208ca1a32521-scripts" (OuterVolumeSpecName: "scripts") pod "6e4e8c65-5607-4f79-ba90-208ca1a32521" (UID: "6e4e8c65-5607-4f79-ba90-208ca1a32521"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:11:40 crc kubenswrapper[5120]: I0316 17:11:40.843232 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e4e8c65-5607-4f79-ba90-208ca1a32521-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "6e4e8c65-5607-4f79-ba90-208ca1a32521" (UID: "6e4e8c65-5607-4f79-ba90-208ca1a32521"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:11:40 crc kubenswrapper[5120]: I0316 17:11:40.843587 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e4e8c65-5607-4f79-ba90-208ca1a32521-kube-api-access-vfm2g" (OuterVolumeSpecName: "kube-api-access-vfm2g") pod "6e4e8c65-5607-4f79-ba90-208ca1a32521" (UID: "6e4e8c65-5607-4f79-ba90-208ca1a32521"). InnerVolumeSpecName "kube-api-access-vfm2g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:11:40 crc kubenswrapper[5120]: I0316 17:11:40.885807 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e4e8c65-5607-4f79-ba90-208ca1a32521-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "6e4e8c65-5607-4f79-ba90-208ca1a32521" (UID: "6e4e8c65-5607-4f79-ba90-208ca1a32521"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:11:40 crc kubenswrapper[5120]: I0316 17:11:40.917053 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e4e8c65-5607-4f79-ba90-208ca1a32521-config-data" (OuterVolumeSpecName: "config-data") pod "6e4e8c65-5607-4f79-ba90-208ca1a32521" (UID: "6e4e8c65-5607-4f79-ba90-208ca1a32521"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:11:40 crc kubenswrapper[5120]: I0316 17:11:40.940347 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/8c67a3db-090c-4122-baa3-57a35abe4a77-cache\") pod \"8c67a3db-090c-4122-baa3-57a35abe4a77\" (UID: \"8c67a3db-090c-4122-baa3-57a35abe4a77\") " Mar 16 17:11:40 crc kubenswrapper[5120]: I0316 17:11:40.940407 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"swift\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"8c67a3db-090c-4122-baa3-57a35abe4a77\" (UID: \"8c67a3db-090c-4122-baa3-57a35abe4a77\") " Mar 16 17:11:40 crc kubenswrapper[5120]: I0316 17:11:40.940507 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/c4f7000d-d4eb-4d8c-9fb8-f88d8304b970-httpd-config\") pod \"c4f7000d-d4eb-4d8c-9fb8-f88d8304b970\" (UID: \"c4f7000d-d4eb-4d8c-9fb8-f88d8304b970\") " Mar 16 17:11:40 crc kubenswrapper[5120]: I0316 17:11:40.940667 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/c4f7000d-d4eb-4d8c-9fb8-f88d8304b970-ovndb-tls-certs\") pod \"c4f7000d-d4eb-4d8c-9fb8-f88d8304b970\" (UID: \"c4f7000d-d4eb-4d8c-9fb8-f88d8304b970\") " Mar 16 17:11:40 crc kubenswrapper[5120]: I0316 17:11:40.940706 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/c4f7000d-d4eb-4d8c-9fb8-f88d8304b970-internal-tls-certs\") pod \"c4f7000d-d4eb-4d8c-9fb8-f88d8304b970\" (UID: \"c4f7000d-d4eb-4d8c-9fb8-f88d8304b970\") " Mar 16 17:11:40 crc kubenswrapper[5120]: I0316 17:11:40.940739 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/8c67a3db-090c-4122-baa3-57a35abe4a77-etc-swift\") pod \"8c67a3db-090c-4122-baa3-57a35abe4a77\" (UID: \"8c67a3db-090c-4122-baa3-57a35abe4a77\") " Mar 16 17:11:40 crc kubenswrapper[5120]: I0316 17:11:40.940763 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/8c67a3db-090c-4122-baa3-57a35abe4a77-lock\") pod \"8c67a3db-090c-4122-baa3-57a35abe4a77\" (UID: \"8c67a3db-090c-4122-baa3-57a35abe4a77\") " Mar 16 17:11:40 crc kubenswrapper[5120]: I0316 17:11:40.940812 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nc2fr\" (UniqueName: \"kubernetes.io/projected/c4f7000d-d4eb-4d8c-9fb8-f88d8304b970-kube-api-access-nc2fr\") pod \"c4f7000d-d4eb-4d8c-9fb8-f88d8304b970\" (UID: \"c4f7000d-d4eb-4d8c-9fb8-f88d8304b970\") " Mar 16 17:11:40 crc kubenswrapper[5120]: I0316 17:11:40.940835 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c4f7000d-d4eb-4d8c-9fb8-f88d8304b970-combined-ca-bundle\") pod \"c4f7000d-d4eb-4d8c-9fb8-f88d8304b970\" (UID: \"c4f7000d-d4eb-4d8c-9fb8-f88d8304b970\") " Mar 16 17:11:40 crc kubenswrapper[5120]: I0316 17:11:40.940929 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8c67a3db-090c-4122-baa3-57a35abe4a77-combined-ca-bundle\") pod \"8c67a3db-090c-4122-baa3-57a35abe4a77\" (UID: \"8c67a3db-090c-4122-baa3-57a35abe4a77\") " Mar 16 17:11:40 crc kubenswrapper[5120]: I0316 17:11:40.941005 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-87g2l\" (UniqueName: \"kubernetes.io/projected/8c67a3db-090c-4122-baa3-57a35abe4a77-kube-api-access-87g2l\") pod \"8c67a3db-090c-4122-baa3-57a35abe4a77\" (UID: \"8c67a3db-090c-4122-baa3-57a35abe4a77\") " Mar 16 17:11:40 crc kubenswrapper[5120]: I0316 17:11:40.941020 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c4f7000d-d4eb-4d8c-9fb8-f88d8304b970-config\") pod \"c4f7000d-d4eb-4d8c-9fb8-f88d8304b970\" (UID: \"c4f7000d-d4eb-4d8c-9fb8-f88d8304b970\") " Mar 16 17:11:40 crc kubenswrapper[5120]: I0316 17:11:40.941066 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/c4f7000d-d4eb-4d8c-9fb8-f88d8304b970-public-tls-certs\") pod \"c4f7000d-d4eb-4d8c-9fb8-f88d8304b970\" (UID: \"c4f7000d-d4eb-4d8c-9fb8-f88d8304b970\") " Mar 16 17:11:40 crc kubenswrapper[5120]: I0316 17:11:40.941371 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c67a3db-090c-4122-baa3-57a35abe4a77-cache" (OuterVolumeSpecName: "cache") pod "8c67a3db-090c-4122-baa3-57a35abe4a77" (UID: "8c67a3db-090c-4122-baa3-57a35abe4a77"). InnerVolumeSpecName "cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:11:40 crc kubenswrapper[5120]: I0316 17:11:40.942344 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6e4e8c65-5607-4f79-ba90-208ca1a32521-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:40 crc kubenswrapper[5120]: I0316 17:11:40.942374 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/6e4e8c65-5607-4f79-ba90-208ca1a32521-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:40 crc kubenswrapper[5120]: I0316 17:11:40.942387 5120 reconciler_common.go:299] "Volume detached for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/8c67a3db-090c-4122-baa3-57a35abe4a77-cache\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:40 crc kubenswrapper[5120]: I0316 17:11:40.942398 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6e4e8c65-5607-4f79-ba90-208ca1a32521-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:40 crc kubenswrapper[5120]: I0316 17:11:40.942411 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6e4e8c65-5607-4f79-ba90-208ca1a32521-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:40 crc kubenswrapper[5120]: I0316 17:11:40.942424 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vfm2g\" (UniqueName: \"kubernetes.io/projected/6e4e8c65-5607-4f79-ba90-208ca1a32521-kube-api-access-vfm2g\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:40 crc kubenswrapper[5120]: I0316 17:11:40.942980 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c67a3db-090c-4122-baa3-57a35abe4a77-lock" (OuterVolumeSpecName: "lock") pod "8c67a3db-090c-4122-baa3-57a35abe4a77" (UID: "8c67a3db-090c-4122-baa3-57a35abe4a77"). InnerVolumeSpecName "lock". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:11:40 crc kubenswrapper[5120]: I0316 17:11:40.945690 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage03-crc" (OuterVolumeSpecName: "swift") pod "8c67a3db-090c-4122-baa3-57a35abe4a77" (UID: "8c67a3db-090c-4122-baa3-57a35abe4a77"). InnerVolumeSpecName "local-storage03-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 17:11:40 crc kubenswrapper[5120]: I0316 17:11:40.945795 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4f7000d-d4eb-4d8c-9fb8-f88d8304b970-httpd-config" (OuterVolumeSpecName: "httpd-config") pod "c4f7000d-d4eb-4d8c-9fb8-f88d8304b970" (UID: "c4f7000d-d4eb-4d8c-9fb8-f88d8304b970"). InnerVolumeSpecName "httpd-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:11:40 crc kubenswrapper[5120]: I0316 17:11:40.945944 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c67a3db-090c-4122-baa3-57a35abe4a77-etc-swift" (OuterVolumeSpecName: "etc-swift") pod "8c67a3db-090c-4122-baa3-57a35abe4a77" (UID: "8c67a3db-090c-4122-baa3-57a35abe4a77"). InnerVolumeSpecName "etc-swift". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:11:40 crc kubenswrapper[5120]: I0316 17:11:40.945997 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c67a3db-090c-4122-baa3-57a35abe4a77-kube-api-access-87g2l" (OuterVolumeSpecName: "kube-api-access-87g2l") pod "8c67a3db-090c-4122-baa3-57a35abe4a77" (UID: "8c67a3db-090c-4122-baa3-57a35abe4a77"). InnerVolumeSpecName "kube-api-access-87g2l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:11:40 crc kubenswrapper[5120]: I0316 17:11:40.955010 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4f7000d-d4eb-4d8c-9fb8-f88d8304b970-kube-api-access-nc2fr" (OuterVolumeSpecName: "kube-api-access-nc2fr") pod "c4f7000d-d4eb-4d8c-9fb8-f88d8304b970" (UID: "c4f7000d-d4eb-4d8c-9fb8-f88d8304b970"). InnerVolumeSpecName "kube-api-access-nc2fr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:11:40 crc kubenswrapper[5120]: I0316 17:11:40.979812 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4f7000d-d4eb-4d8c-9fb8-f88d8304b970-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "c4f7000d-d4eb-4d8c-9fb8-f88d8304b970" (UID: "c4f7000d-d4eb-4d8c-9fb8-f88d8304b970"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:11:40 crc kubenswrapper[5120]: I0316 17:11:40.980231 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4f7000d-d4eb-4d8c-9fb8-f88d8304b970-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "c4f7000d-d4eb-4d8c-9fb8-f88d8304b970" (UID: "c4f7000d-d4eb-4d8c-9fb8-f88d8304b970"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:11:40 crc kubenswrapper[5120]: I0316 17:11:40.981017 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4f7000d-d4eb-4d8c-9fb8-f88d8304b970-config" (OuterVolumeSpecName: "config") pod "c4f7000d-d4eb-4d8c-9fb8-f88d8304b970" (UID: "c4f7000d-d4eb-4d8c-9fb8-f88d8304b970"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:11:40 crc kubenswrapper[5120]: I0316 17:11:40.988029 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4f7000d-d4eb-4d8c-9fb8-f88d8304b970-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "c4f7000d-d4eb-4d8c-9fb8-f88d8304b970" (UID: "c4f7000d-d4eb-4d8c-9fb8-f88d8304b970"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:11:41 crc kubenswrapper[5120]: I0316 17:11:41.001391 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4f7000d-d4eb-4d8c-9fb8-f88d8304b970-ovndb-tls-certs" (OuterVolumeSpecName: "ovndb-tls-certs") pod "c4f7000d-d4eb-4d8c-9fb8-f88d8304b970" (UID: "c4f7000d-d4eb-4d8c-9fb8-f88d8304b970"). InnerVolumeSpecName "ovndb-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:11:41 crc kubenswrapper[5120]: I0316 17:11:41.044361 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-87g2l\" (UniqueName: \"kubernetes.io/projected/8c67a3db-090c-4122-baa3-57a35abe4a77-kube-api-access-87g2l\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:41 crc kubenswrapper[5120]: I0316 17:11:41.044427 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/c4f7000d-d4eb-4d8c-9fb8-f88d8304b970-config\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:41 crc kubenswrapper[5120]: I0316 17:11:41.044442 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/c4f7000d-d4eb-4d8c-9fb8-f88d8304b970-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:41 crc kubenswrapper[5120]: I0316 17:11:41.044481 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") on node \"crc\" " Mar 16 17:11:41 crc kubenswrapper[5120]: I0316 17:11:41.044495 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/c4f7000d-d4eb-4d8c-9fb8-f88d8304b970-httpd-config\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:41 crc kubenswrapper[5120]: I0316 17:11:41.044507 5120 reconciler_common.go:299] "Volume detached for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/c4f7000d-d4eb-4d8c-9fb8-f88d8304b970-ovndb-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:41 crc kubenswrapper[5120]: I0316 17:11:41.044519 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/c4f7000d-d4eb-4d8c-9fb8-f88d8304b970-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:41 crc kubenswrapper[5120]: I0316 17:11:41.044536 5120 reconciler_common.go:299] "Volume detached for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/8c67a3db-090c-4122-baa3-57a35abe4a77-etc-swift\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:41 crc kubenswrapper[5120]: I0316 17:11:41.044548 5120 reconciler_common.go:299] "Volume detached for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/8c67a3db-090c-4122-baa3-57a35abe4a77-lock\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:41 crc kubenswrapper[5120]: I0316 17:11:41.044560 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nc2fr\" (UniqueName: \"kubernetes.io/projected/c4f7000d-d4eb-4d8c-9fb8-f88d8304b970-kube-api-access-nc2fr\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:41 crc kubenswrapper[5120]: I0316 17:11:41.044571 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c4f7000d-d4eb-4d8c-9fb8-f88d8304b970-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:41 crc kubenswrapper[5120]: I0316 17:11:41.058547 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage03-crc" (UniqueName: "kubernetes.io/local-volume/local-storage03-crc") on node "crc" Mar 16 17:11:41 crc kubenswrapper[5120]: I0316 17:11:41.146715 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:41 crc kubenswrapper[5120]: I0316 17:11:41.174539 5120 generic.go:358] "Generic (PLEG): container finished" podID="6e4e8c65-5607-4f79-ba90-208ca1a32521" containerID="3e8b71b950bf390402480c1399c32a4782772e498df0022e04eb4416ca056fdf" exitCode=137 Mar 16 17:11:41 crc kubenswrapper[5120]: I0316 17:11:41.174624 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"6e4e8c65-5607-4f79-ba90-208ca1a32521","Type":"ContainerDied","Data":"3e8b71b950bf390402480c1399c32a4782772e498df0022e04eb4416ca056fdf"} Mar 16 17:11:41 crc kubenswrapper[5120]: I0316 17:11:41.174652 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"6e4e8c65-5607-4f79-ba90-208ca1a32521","Type":"ContainerDied","Data":"31e30d7229add62f5f93ae2a06085a6b83f5b0d25512fb9ca09f0389c4ff6a62"} Mar 16 17:11:41 crc kubenswrapper[5120]: I0316 17:11:41.174667 5120 scope.go:117] "RemoveContainer" containerID="8068446c44f56d29481ac3b9d2b0df62ffc47e46509fc2d2da921fb2004e7286" Mar 16 17:11:41 crc kubenswrapper[5120]: I0316 17:11:41.174689 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:11:41 crc kubenswrapper[5120]: I0316 17:11:41.184235 5120 generic.go:358] "Generic (PLEG): container finished" podID="8c67a3db-090c-4122-baa3-57a35abe4a77" containerID="399b6cf1eec5612bf777734fd2b34b2d83283c77f72adc4572e237b1f80a795a" exitCode=137 Mar 16 17:11:41 crc kubenswrapper[5120]: I0316 17:11:41.184271 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"8c67a3db-090c-4122-baa3-57a35abe4a77","Type":"ContainerDied","Data":"399b6cf1eec5612bf777734fd2b34b2d83283c77f72adc4572e237b1f80a795a"} Mar 16 17:11:41 crc kubenswrapper[5120]: I0316 17:11:41.184502 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Mar 16 17:11:41 crc kubenswrapper[5120]: I0316 17:11:41.184731 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"8c67a3db-090c-4122-baa3-57a35abe4a77","Type":"ContainerDied","Data":"27711011e41d6feb93f1345f33642b751fa8ab04b23dfeccdf430f54ee4f5883"} Mar 16 17:11:41 crc kubenswrapper[5120]: I0316 17:11:41.188179 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-7465cc7fb4-nnm87_c4f7000d-d4eb-4d8c-9fb8-f88d8304b970/neutron-api/0.log" Mar 16 17:11:41 crc kubenswrapper[5120]: I0316 17:11:41.188228 5120 generic.go:358] "Generic (PLEG): container finished" podID="c4f7000d-d4eb-4d8c-9fb8-f88d8304b970" containerID="9993ec5c6b4f30c9d30dafdea7deb75c1a50d89140e90b70baf9a257151faf98" exitCode=137 Mar 16 17:11:41 crc kubenswrapper[5120]: I0316 17:11:41.188524 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-7465cc7fb4-nnm87" event={"ID":"c4f7000d-d4eb-4d8c-9fb8-f88d8304b970","Type":"ContainerDied","Data":"9993ec5c6b4f30c9d30dafdea7deb75c1a50d89140e90b70baf9a257151faf98"} Mar 16 17:11:41 crc kubenswrapper[5120]: I0316 17:11:41.188559 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-7465cc7fb4-nnm87" event={"ID":"c4f7000d-d4eb-4d8c-9fb8-f88d8304b970","Type":"ContainerDied","Data":"9aff746512bbba7759c95e67dcc4c8c1b2fedc8d2acd2e2bc22bd0cd81dccd4a"} Mar 16 17:11:41 crc kubenswrapper[5120]: I0316 17:11:41.188636 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-7465cc7fb4-nnm87" Mar 16 17:11:41 crc kubenswrapper[5120]: I0316 17:11:41.211316 5120 scope.go:117] "RemoveContainer" containerID="3e8b71b950bf390402480c1399c32a4782772e498df0022e04eb4416ca056fdf" Mar 16 17:11:41 crc kubenswrapper[5120]: I0316 17:11:41.219567 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c67a3db-090c-4122-baa3-57a35abe4a77-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "8c67a3db-090c-4122-baa3-57a35abe4a77" (UID: "8c67a3db-090c-4122-baa3-57a35abe4a77"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:11:41 crc kubenswrapper[5120]: I0316 17:11:41.220968 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 17:11:41 crc kubenswrapper[5120]: I0316 17:11:41.229196 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 17:11:41 crc kubenswrapper[5120]: I0316 17:11:41.252091 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8c67a3db-090c-4122-baa3-57a35abe4a77-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:41 crc kubenswrapper[5120]: E0316 17:11:41.253794 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="5f0a1210752c571fbaca2dcbc5e5d9cf5e76f8f1d25ee4f7c4b2ade9932d7436" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 17:11:41 crc kubenswrapper[5120]: E0316 17:11:41.255561 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="5f0a1210752c571fbaca2dcbc5e5d9cf5e76f8f1d25ee4f7c4b2ade9932d7436" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 17:11:41 crc kubenswrapper[5120]: E0316 17:11:41.256973 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="5f0a1210752c571fbaca2dcbc5e5d9cf5e76f8f1d25ee4f7c4b2ade9932d7436" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 17:11:41 crc kubenswrapper[5120]: E0316 17:11:41.257112 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="9a997459-37ba-46a9-9cb8-075f77fa009f" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 17:11:41 crc kubenswrapper[5120]: I0316 17:11:41.336895 5120 scope.go:117] "RemoveContainer" containerID="8068446c44f56d29481ac3b9d2b0df62ffc47e46509fc2d2da921fb2004e7286" Mar 16 17:11:41 crc kubenswrapper[5120]: E0316 17:11:41.337537 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8068446c44f56d29481ac3b9d2b0df62ffc47e46509fc2d2da921fb2004e7286\": container with ID starting with 8068446c44f56d29481ac3b9d2b0df62ffc47e46509fc2d2da921fb2004e7286 not found: ID does not exist" containerID="8068446c44f56d29481ac3b9d2b0df62ffc47e46509fc2d2da921fb2004e7286" Mar 16 17:11:41 crc kubenswrapper[5120]: I0316 17:11:41.337588 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8068446c44f56d29481ac3b9d2b0df62ffc47e46509fc2d2da921fb2004e7286"} err="failed to get container status \"8068446c44f56d29481ac3b9d2b0df62ffc47e46509fc2d2da921fb2004e7286\": rpc error: code = NotFound desc = could not find container \"8068446c44f56d29481ac3b9d2b0df62ffc47e46509fc2d2da921fb2004e7286\": container with ID starting with 8068446c44f56d29481ac3b9d2b0df62ffc47e46509fc2d2da921fb2004e7286 not found: ID does not exist" Mar 16 17:11:41 crc kubenswrapper[5120]: I0316 17:11:41.337622 5120 scope.go:117] "RemoveContainer" containerID="3e8b71b950bf390402480c1399c32a4782772e498df0022e04eb4416ca056fdf" Mar 16 17:11:41 crc kubenswrapper[5120]: E0316 17:11:41.337933 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e8b71b950bf390402480c1399c32a4782772e498df0022e04eb4416ca056fdf\": container with ID starting with 3e8b71b950bf390402480c1399c32a4782772e498df0022e04eb4416ca056fdf not found: ID does not exist" containerID="3e8b71b950bf390402480c1399c32a4782772e498df0022e04eb4416ca056fdf" Mar 16 17:11:41 crc kubenswrapper[5120]: I0316 17:11:41.337976 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e8b71b950bf390402480c1399c32a4782772e498df0022e04eb4416ca056fdf"} err="failed to get container status \"3e8b71b950bf390402480c1399c32a4782772e498df0022e04eb4416ca056fdf\": rpc error: code = NotFound desc = could not find container \"3e8b71b950bf390402480c1399c32a4782772e498df0022e04eb4416ca056fdf\": container with ID starting with 3e8b71b950bf390402480c1399c32a4782772e498df0022e04eb4416ca056fdf not found: ID does not exist" Mar 16 17:11:41 crc kubenswrapper[5120]: I0316 17:11:41.338010 5120 scope.go:117] "RemoveContainer" containerID="399b6cf1eec5612bf777734fd2b34b2d83283c77f72adc4572e237b1f80a795a" Mar 16 17:11:41 crc kubenswrapper[5120]: I0316 17:11:41.349429 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-7465cc7fb4-nnm87"] Mar 16 17:11:41 crc kubenswrapper[5120]: I0316 17:11:41.359340 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-7465cc7fb4-nnm87"] Mar 16 17:11:41 crc kubenswrapper[5120]: I0316 17:11:41.360608 5120 scope.go:117] "RemoveContainer" containerID="0c8cea3043f2fce80ea7e250797bd2913e76ea0470fe9e12eca4dbc755f293a4" Mar 16 17:11:41 crc kubenswrapper[5120]: I0316 17:11:41.379343 5120 scope.go:117] "RemoveContainer" containerID="bd46718441dd3915f5bd2a71883fc7096ec17c6c243882c28d9b6633fc1f8f06" Mar 16 17:11:41 crc kubenswrapper[5120]: I0316 17:11:41.407023 5120 scope.go:117] "RemoveContainer" containerID="073581fad4fe5433c64fceb81b5027e86b37722dadca16ae342222f8c0f17ca8" Mar 16 17:11:41 crc kubenswrapper[5120]: I0316 17:11:41.425838 5120 scope.go:117] "RemoveContainer" containerID="42310681682e3dc01c949750585a1d651aab966cfcfea51537e5687aba6547b2" Mar 16 17:11:41 crc kubenswrapper[5120]: I0316 17:11:41.449813 5120 scope.go:117] "RemoveContainer" containerID="f2699a9dd63e448a62ece804e3ecad01c35e679180fa7733373a71fa9979801b" Mar 16 17:11:41 crc kubenswrapper[5120]: I0316 17:11:41.472936 5120 scope.go:117] "RemoveContainer" containerID="73ed0a55f7c6e413c01b8128322ec99568e0ead33b66931a7b20ec0e5c812b79" Mar 16 17:11:41 crc kubenswrapper[5120]: I0316 17:11:41.493693 5120 scope.go:117] "RemoveContainer" containerID="d7dc1b404bf2b4f2e0991e2c5df23d74605bd37f0234c83975a5462226173f4a" Mar 16 17:11:41 crc kubenswrapper[5120]: I0316 17:11:41.534136 5120 scope.go:117] "RemoveContainer" containerID="f52dab27d76bec378b4e03ce3c968e616b175a12da052c7df1d412f7a7b105f3" Mar 16 17:11:41 crc kubenswrapper[5120]: I0316 17:11:41.551281 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 17:11:41 crc kubenswrapper[5120]: I0316 17:11:41.557133 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 17:11:41 crc kubenswrapper[5120]: I0316 17:11:41.558585 5120 scope.go:117] "RemoveContainer" containerID="1e20522ae176f0e3ccd3b88970db4d1da4912838989def622ce73c5a72a09fb7" Mar 16 17:11:41 crc kubenswrapper[5120]: I0316 17:11:41.574976 5120 scope.go:117] "RemoveContainer" containerID="f95d08633e13a2f886a5e2ffcf7ff8812d6b9d89d3404c7418c501f94509e1e5" Mar 16 17:11:41 crc kubenswrapper[5120]: I0316 17:11:41.590158 5120 scope.go:117] "RemoveContainer" containerID="d65cca40b78acf38a924033770b7dddbe830b04f4b9481a7ae42afc4fe0148a7" Mar 16 17:11:41 crc kubenswrapper[5120]: I0316 17:11:41.605348 5120 scope.go:117] "RemoveContainer" containerID="ba90cd93acdcaf326c2686ffdf1ed1397f6bb727388d50974eefaab36e84d18e" Mar 16 17:11:41 crc kubenswrapper[5120]: I0316 17:11:41.620807 5120 scope.go:117] "RemoveContainer" containerID="b418d03d15ebb8bc5fd3fd000498ee8cffdf5be56ef3553a3937697d0337a694" Mar 16 17:11:41 crc kubenswrapper[5120]: I0316 17:11:41.655751 5120 scope.go:117] "RemoveContainer" containerID="cada37d138fe1100f7adc594e98ea94d57976e07351e011bc535d9982f6320a9" Mar 16 17:11:41 crc kubenswrapper[5120]: I0316 17:11:41.672800 5120 scope.go:117] "RemoveContainer" containerID="399b6cf1eec5612bf777734fd2b34b2d83283c77f72adc4572e237b1f80a795a" Mar 16 17:11:41 crc kubenswrapper[5120]: E0316 17:11:41.673799 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"399b6cf1eec5612bf777734fd2b34b2d83283c77f72adc4572e237b1f80a795a\": container with ID starting with 399b6cf1eec5612bf777734fd2b34b2d83283c77f72adc4572e237b1f80a795a not found: ID does not exist" containerID="399b6cf1eec5612bf777734fd2b34b2d83283c77f72adc4572e237b1f80a795a" Mar 16 17:11:41 crc kubenswrapper[5120]: I0316 17:11:41.673849 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"399b6cf1eec5612bf777734fd2b34b2d83283c77f72adc4572e237b1f80a795a"} err="failed to get container status \"399b6cf1eec5612bf777734fd2b34b2d83283c77f72adc4572e237b1f80a795a\": rpc error: code = NotFound desc = could not find container \"399b6cf1eec5612bf777734fd2b34b2d83283c77f72adc4572e237b1f80a795a\": container with ID starting with 399b6cf1eec5612bf777734fd2b34b2d83283c77f72adc4572e237b1f80a795a not found: ID does not exist" Mar 16 17:11:41 crc kubenswrapper[5120]: I0316 17:11:41.673880 5120 scope.go:117] "RemoveContainer" containerID="0c8cea3043f2fce80ea7e250797bd2913e76ea0470fe9e12eca4dbc755f293a4" Mar 16 17:11:41 crc kubenswrapper[5120]: E0316 17:11:41.674235 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c8cea3043f2fce80ea7e250797bd2913e76ea0470fe9e12eca4dbc755f293a4\": container with ID starting with 0c8cea3043f2fce80ea7e250797bd2913e76ea0470fe9e12eca4dbc755f293a4 not found: ID does not exist" containerID="0c8cea3043f2fce80ea7e250797bd2913e76ea0470fe9e12eca4dbc755f293a4" Mar 16 17:11:41 crc kubenswrapper[5120]: I0316 17:11:41.674269 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c8cea3043f2fce80ea7e250797bd2913e76ea0470fe9e12eca4dbc755f293a4"} err="failed to get container status \"0c8cea3043f2fce80ea7e250797bd2913e76ea0470fe9e12eca4dbc755f293a4\": rpc error: code = NotFound desc = could not find container \"0c8cea3043f2fce80ea7e250797bd2913e76ea0470fe9e12eca4dbc755f293a4\": container with ID starting with 0c8cea3043f2fce80ea7e250797bd2913e76ea0470fe9e12eca4dbc755f293a4 not found: ID does not exist" Mar 16 17:11:41 crc kubenswrapper[5120]: I0316 17:11:41.674291 5120 scope.go:117] "RemoveContainer" containerID="bd46718441dd3915f5bd2a71883fc7096ec17c6c243882c28d9b6633fc1f8f06" Mar 16 17:11:41 crc kubenswrapper[5120]: E0316 17:11:41.674631 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd46718441dd3915f5bd2a71883fc7096ec17c6c243882c28d9b6633fc1f8f06\": container with ID starting with bd46718441dd3915f5bd2a71883fc7096ec17c6c243882c28d9b6633fc1f8f06 not found: ID does not exist" containerID="bd46718441dd3915f5bd2a71883fc7096ec17c6c243882c28d9b6633fc1f8f06" Mar 16 17:11:41 crc kubenswrapper[5120]: I0316 17:11:41.674663 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd46718441dd3915f5bd2a71883fc7096ec17c6c243882c28d9b6633fc1f8f06"} err="failed to get container status \"bd46718441dd3915f5bd2a71883fc7096ec17c6c243882c28d9b6633fc1f8f06\": rpc error: code = NotFound desc = could not find container \"bd46718441dd3915f5bd2a71883fc7096ec17c6c243882c28d9b6633fc1f8f06\": container with ID starting with bd46718441dd3915f5bd2a71883fc7096ec17c6c243882c28d9b6633fc1f8f06 not found: ID does not exist" Mar 16 17:11:41 crc kubenswrapper[5120]: I0316 17:11:41.674680 5120 scope.go:117] "RemoveContainer" containerID="073581fad4fe5433c64fceb81b5027e86b37722dadca16ae342222f8c0f17ca8" Mar 16 17:11:41 crc kubenswrapper[5120]: E0316 17:11:41.674935 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"073581fad4fe5433c64fceb81b5027e86b37722dadca16ae342222f8c0f17ca8\": container with ID starting with 073581fad4fe5433c64fceb81b5027e86b37722dadca16ae342222f8c0f17ca8 not found: ID does not exist" containerID="073581fad4fe5433c64fceb81b5027e86b37722dadca16ae342222f8c0f17ca8" Mar 16 17:11:41 crc kubenswrapper[5120]: I0316 17:11:41.674960 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"073581fad4fe5433c64fceb81b5027e86b37722dadca16ae342222f8c0f17ca8"} err="failed to get container status \"073581fad4fe5433c64fceb81b5027e86b37722dadca16ae342222f8c0f17ca8\": rpc error: code = NotFound desc = could not find container \"073581fad4fe5433c64fceb81b5027e86b37722dadca16ae342222f8c0f17ca8\": container with ID starting with 073581fad4fe5433c64fceb81b5027e86b37722dadca16ae342222f8c0f17ca8 not found: ID does not exist" Mar 16 17:11:41 crc kubenswrapper[5120]: I0316 17:11:41.674978 5120 scope.go:117] "RemoveContainer" containerID="42310681682e3dc01c949750585a1d651aab966cfcfea51537e5687aba6547b2" Mar 16 17:11:41 crc kubenswrapper[5120]: E0316 17:11:41.675512 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"42310681682e3dc01c949750585a1d651aab966cfcfea51537e5687aba6547b2\": container with ID starting with 42310681682e3dc01c949750585a1d651aab966cfcfea51537e5687aba6547b2 not found: ID does not exist" containerID="42310681682e3dc01c949750585a1d651aab966cfcfea51537e5687aba6547b2" Mar 16 17:11:41 crc kubenswrapper[5120]: I0316 17:11:41.675534 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42310681682e3dc01c949750585a1d651aab966cfcfea51537e5687aba6547b2"} err="failed to get container status \"42310681682e3dc01c949750585a1d651aab966cfcfea51537e5687aba6547b2\": rpc error: code = NotFound desc = could not find container \"42310681682e3dc01c949750585a1d651aab966cfcfea51537e5687aba6547b2\": container with ID starting with 42310681682e3dc01c949750585a1d651aab966cfcfea51537e5687aba6547b2 not found: ID does not exist" Mar 16 17:11:41 crc kubenswrapper[5120]: I0316 17:11:41.675548 5120 scope.go:117] "RemoveContainer" containerID="f2699a9dd63e448a62ece804e3ecad01c35e679180fa7733373a71fa9979801b" Mar 16 17:11:41 crc kubenswrapper[5120]: E0316 17:11:41.675934 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f2699a9dd63e448a62ece804e3ecad01c35e679180fa7733373a71fa9979801b\": container with ID starting with f2699a9dd63e448a62ece804e3ecad01c35e679180fa7733373a71fa9979801b not found: ID does not exist" containerID="f2699a9dd63e448a62ece804e3ecad01c35e679180fa7733373a71fa9979801b" Mar 16 17:11:41 crc kubenswrapper[5120]: I0316 17:11:41.675972 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2699a9dd63e448a62ece804e3ecad01c35e679180fa7733373a71fa9979801b"} err="failed to get container status \"f2699a9dd63e448a62ece804e3ecad01c35e679180fa7733373a71fa9979801b\": rpc error: code = NotFound desc = could not find container \"f2699a9dd63e448a62ece804e3ecad01c35e679180fa7733373a71fa9979801b\": container with ID starting with f2699a9dd63e448a62ece804e3ecad01c35e679180fa7733373a71fa9979801b not found: ID does not exist" Mar 16 17:11:41 crc kubenswrapper[5120]: I0316 17:11:41.675993 5120 scope.go:117] "RemoveContainer" containerID="73ed0a55f7c6e413c01b8128322ec99568e0ead33b66931a7b20ec0e5c812b79" Mar 16 17:11:41 crc kubenswrapper[5120]: E0316 17:11:41.676260 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"73ed0a55f7c6e413c01b8128322ec99568e0ead33b66931a7b20ec0e5c812b79\": container with ID starting with 73ed0a55f7c6e413c01b8128322ec99568e0ead33b66931a7b20ec0e5c812b79 not found: ID does not exist" containerID="73ed0a55f7c6e413c01b8128322ec99568e0ead33b66931a7b20ec0e5c812b79" Mar 16 17:11:41 crc kubenswrapper[5120]: I0316 17:11:41.676286 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73ed0a55f7c6e413c01b8128322ec99568e0ead33b66931a7b20ec0e5c812b79"} err="failed to get container status \"73ed0a55f7c6e413c01b8128322ec99568e0ead33b66931a7b20ec0e5c812b79\": rpc error: code = NotFound desc = could not find container \"73ed0a55f7c6e413c01b8128322ec99568e0ead33b66931a7b20ec0e5c812b79\": container with ID starting with 73ed0a55f7c6e413c01b8128322ec99568e0ead33b66931a7b20ec0e5c812b79 not found: ID does not exist" Mar 16 17:11:41 crc kubenswrapper[5120]: I0316 17:11:41.676301 5120 scope.go:117] "RemoveContainer" containerID="d7dc1b404bf2b4f2e0991e2c5df23d74605bd37f0234c83975a5462226173f4a" Mar 16 17:11:41 crc kubenswrapper[5120]: E0316 17:11:41.676649 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d7dc1b404bf2b4f2e0991e2c5df23d74605bd37f0234c83975a5462226173f4a\": container with ID starting with d7dc1b404bf2b4f2e0991e2c5df23d74605bd37f0234c83975a5462226173f4a not found: ID does not exist" containerID="d7dc1b404bf2b4f2e0991e2c5df23d74605bd37f0234c83975a5462226173f4a" Mar 16 17:11:41 crc kubenswrapper[5120]: I0316 17:11:41.676810 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7dc1b404bf2b4f2e0991e2c5df23d74605bd37f0234c83975a5462226173f4a"} err="failed to get container status \"d7dc1b404bf2b4f2e0991e2c5df23d74605bd37f0234c83975a5462226173f4a\": rpc error: code = NotFound desc = could not find container \"d7dc1b404bf2b4f2e0991e2c5df23d74605bd37f0234c83975a5462226173f4a\": container with ID starting with d7dc1b404bf2b4f2e0991e2c5df23d74605bd37f0234c83975a5462226173f4a not found: ID does not exist" Mar 16 17:11:41 crc kubenswrapper[5120]: I0316 17:11:41.676836 5120 scope.go:117] "RemoveContainer" containerID="f52dab27d76bec378b4e03ce3c968e616b175a12da052c7df1d412f7a7b105f3" Mar 16 17:11:41 crc kubenswrapper[5120]: E0316 17:11:41.677090 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f52dab27d76bec378b4e03ce3c968e616b175a12da052c7df1d412f7a7b105f3\": container with ID starting with f52dab27d76bec378b4e03ce3c968e616b175a12da052c7df1d412f7a7b105f3 not found: ID does not exist" containerID="f52dab27d76bec378b4e03ce3c968e616b175a12da052c7df1d412f7a7b105f3" Mar 16 17:11:41 crc kubenswrapper[5120]: I0316 17:11:41.677116 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f52dab27d76bec378b4e03ce3c968e616b175a12da052c7df1d412f7a7b105f3"} err="failed to get container status \"f52dab27d76bec378b4e03ce3c968e616b175a12da052c7df1d412f7a7b105f3\": rpc error: code = NotFound desc = could not find container \"f52dab27d76bec378b4e03ce3c968e616b175a12da052c7df1d412f7a7b105f3\": container with ID starting with f52dab27d76bec378b4e03ce3c968e616b175a12da052c7df1d412f7a7b105f3 not found: ID does not exist" Mar 16 17:11:41 crc kubenswrapper[5120]: I0316 17:11:41.677131 5120 scope.go:117] "RemoveContainer" containerID="1e20522ae176f0e3ccd3b88970db4d1da4912838989def622ce73c5a72a09fb7" Mar 16 17:11:41 crc kubenswrapper[5120]: E0316 17:11:41.677661 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e20522ae176f0e3ccd3b88970db4d1da4912838989def622ce73c5a72a09fb7\": container with ID starting with 1e20522ae176f0e3ccd3b88970db4d1da4912838989def622ce73c5a72a09fb7 not found: ID does not exist" containerID="1e20522ae176f0e3ccd3b88970db4d1da4912838989def622ce73c5a72a09fb7" Mar 16 17:11:41 crc kubenswrapper[5120]: I0316 17:11:41.677716 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e20522ae176f0e3ccd3b88970db4d1da4912838989def622ce73c5a72a09fb7"} err="failed to get container status \"1e20522ae176f0e3ccd3b88970db4d1da4912838989def622ce73c5a72a09fb7\": rpc error: code = NotFound desc = could not find container \"1e20522ae176f0e3ccd3b88970db4d1da4912838989def622ce73c5a72a09fb7\": container with ID starting with 1e20522ae176f0e3ccd3b88970db4d1da4912838989def622ce73c5a72a09fb7 not found: ID does not exist" Mar 16 17:11:41 crc kubenswrapper[5120]: I0316 17:11:41.677743 5120 scope.go:117] "RemoveContainer" containerID="f95d08633e13a2f886a5e2ffcf7ff8812d6b9d89d3404c7418c501f94509e1e5" Mar 16 17:11:41 crc kubenswrapper[5120]: E0316 17:11:41.678282 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f95d08633e13a2f886a5e2ffcf7ff8812d6b9d89d3404c7418c501f94509e1e5\": container with ID starting with f95d08633e13a2f886a5e2ffcf7ff8812d6b9d89d3404c7418c501f94509e1e5 not found: ID does not exist" containerID="f95d08633e13a2f886a5e2ffcf7ff8812d6b9d89d3404c7418c501f94509e1e5" Mar 16 17:11:41 crc kubenswrapper[5120]: I0316 17:11:41.678315 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f95d08633e13a2f886a5e2ffcf7ff8812d6b9d89d3404c7418c501f94509e1e5"} err="failed to get container status \"f95d08633e13a2f886a5e2ffcf7ff8812d6b9d89d3404c7418c501f94509e1e5\": rpc error: code = NotFound desc = could not find container \"f95d08633e13a2f886a5e2ffcf7ff8812d6b9d89d3404c7418c501f94509e1e5\": container with ID starting with f95d08633e13a2f886a5e2ffcf7ff8812d6b9d89d3404c7418c501f94509e1e5 not found: ID does not exist" Mar 16 17:11:41 crc kubenswrapper[5120]: I0316 17:11:41.678335 5120 scope.go:117] "RemoveContainer" containerID="d65cca40b78acf38a924033770b7dddbe830b04f4b9481a7ae42afc4fe0148a7" Mar 16 17:11:41 crc kubenswrapper[5120]: E0316 17:11:41.678745 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d65cca40b78acf38a924033770b7dddbe830b04f4b9481a7ae42afc4fe0148a7\": container with ID starting with d65cca40b78acf38a924033770b7dddbe830b04f4b9481a7ae42afc4fe0148a7 not found: ID does not exist" containerID="d65cca40b78acf38a924033770b7dddbe830b04f4b9481a7ae42afc4fe0148a7" Mar 16 17:11:41 crc kubenswrapper[5120]: I0316 17:11:41.678782 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d65cca40b78acf38a924033770b7dddbe830b04f4b9481a7ae42afc4fe0148a7"} err="failed to get container status \"d65cca40b78acf38a924033770b7dddbe830b04f4b9481a7ae42afc4fe0148a7\": rpc error: code = NotFound desc = could not find container \"d65cca40b78acf38a924033770b7dddbe830b04f4b9481a7ae42afc4fe0148a7\": container with ID starting with d65cca40b78acf38a924033770b7dddbe830b04f4b9481a7ae42afc4fe0148a7 not found: ID does not exist" Mar 16 17:11:41 crc kubenswrapper[5120]: I0316 17:11:41.678796 5120 scope.go:117] "RemoveContainer" containerID="ba90cd93acdcaf326c2686ffdf1ed1397f6bb727388d50974eefaab36e84d18e" Mar 16 17:11:41 crc kubenswrapper[5120]: E0316 17:11:41.679185 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba90cd93acdcaf326c2686ffdf1ed1397f6bb727388d50974eefaab36e84d18e\": container with ID starting with ba90cd93acdcaf326c2686ffdf1ed1397f6bb727388d50974eefaab36e84d18e not found: ID does not exist" containerID="ba90cd93acdcaf326c2686ffdf1ed1397f6bb727388d50974eefaab36e84d18e" Mar 16 17:11:41 crc kubenswrapper[5120]: I0316 17:11:41.679206 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba90cd93acdcaf326c2686ffdf1ed1397f6bb727388d50974eefaab36e84d18e"} err="failed to get container status \"ba90cd93acdcaf326c2686ffdf1ed1397f6bb727388d50974eefaab36e84d18e\": rpc error: code = NotFound desc = could not find container \"ba90cd93acdcaf326c2686ffdf1ed1397f6bb727388d50974eefaab36e84d18e\": container with ID starting with ba90cd93acdcaf326c2686ffdf1ed1397f6bb727388d50974eefaab36e84d18e not found: ID does not exist" Mar 16 17:11:41 crc kubenswrapper[5120]: I0316 17:11:41.679226 5120 scope.go:117] "RemoveContainer" containerID="b418d03d15ebb8bc5fd3fd000498ee8cffdf5be56ef3553a3937697d0337a694" Mar 16 17:11:41 crc kubenswrapper[5120]: E0316 17:11:41.679525 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b418d03d15ebb8bc5fd3fd000498ee8cffdf5be56ef3553a3937697d0337a694\": container with ID starting with b418d03d15ebb8bc5fd3fd000498ee8cffdf5be56ef3553a3937697d0337a694 not found: ID does not exist" containerID="b418d03d15ebb8bc5fd3fd000498ee8cffdf5be56ef3553a3937697d0337a694" Mar 16 17:11:41 crc kubenswrapper[5120]: I0316 17:11:41.679548 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b418d03d15ebb8bc5fd3fd000498ee8cffdf5be56ef3553a3937697d0337a694"} err="failed to get container status \"b418d03d15ebb8bc5fd3fd000498ee8cffdf5be56ef3553a3937697d0337a694\": rpc error: code = NotFound desc = could not find container \"b418d03d15ebb8bc5fd3fd000498ee8cffdf5be56ef3553a3937697d0337a694\": container with ID starting with b418d03d15ebb8bc5fd3fd000498ee8cffdf5be56ef3553a3937697d0337a694 not found: ID does not exist" Mar 16 17:11:41 crc kubenswrapper[5120]: I0316 17:11:41.679563 5120 scope.go:117] "RemoveContainer" containerID="cada37d138fe1100f7adc594e98ea94d57976e07351e011bc535d9982f6320a9" Mar 16 17:11:41 crc kubenswrapper[5120]: E0316 17:11:41.679857 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cada37d138fe1100f7adc594e98ea94d57976e07351e011bc535d9982f6320a9\": container with ID starting with cada37d138fe1100f7adc594e98ea94d57976e07351e011bc535d9982f6320a9 not found: ID does not exist" containerID="cada37d138fe1100f7adc594e98ea94d57976e07351e011bc535d9982f6320a9" Mar 16 17:11:41 crc kubenswrapper[5120]: I0316 17:11:41.679885 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cada37d138fe1100f7adc594e98ea94d57976e07351e011bc535d9982f6320a9"} err="failed to get container status \"cada37d138fe1100f7adc594e98ea94d57976e07351e011bc535d9982f6320a9\": rpc error: code = NotFound desc = could not find container \"cada37d138fe1100f7adc594e98ea94d57976e07351e011bc535d9982f6320a9\": container with ID starting with cada37d138fe1100f7adc594e98ea94d57976e07351e011bc535d9982f6320a9 not found: ID does not exist" Mar 16 17:11:41 crc kubenswrapper[5120]: I0316 17:11:41.679902 5120 scope.go:117] "RemoveContainer" containerID="d93c264fc36e771c9504140efad8afbcbd5602b5de8be501ada220aa581fc08e" Mar 16 17:11:41 crc kubenswrapper[5120]: I0316 17:11:41.698896 5120 scope.go:117] "RemoveContainer" containerID="9993ec5c6b4f30c9d30dafdea7deb75c1a50d89140e90b70baf9a257151faf98" Mar 16 17:11:41 crc kubenswrapper[5120]: I0316 17:11:41.717505 5120 scope.go:117] "RemoveContainer" containerID="d93c264fc36e771c9504140efad8afbcbd5602b5de8be501ada220aa581fc08e" Mar 16 17:11:41 crc kubenswrapper[5120]: E0316 17:11:41.718015 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d93c264fc36e771c9504140efad8afbcbd5602b5de8be501ada220aa581fc08e\": container with ID starting with d93c264fc36e771c9504140efad8afbcbd5602b5de8be501ada220aa581fc08e not found: ID does not exist" containerID="d93c264fc36e771c9504140efad8afbcbd5602b5de8be501ada220aa581fc08e" Mar 16 17:11:41 crc kubenswrapper[5120]: I0316 17:11:41.718044 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d93c264fc36e771c9504140efad8afbcbd5602b5de8be501ada220aa581fc08e"} err="failed to get container status \"d93c264fc36e771c9504140efad8afbcbd5602b5de8be501ada220aa581fc08e\": rpc error: code = NotFound desc = could not find container \"d93c264fc36e771c9504140efad8afbcbd5602b5de8be501ada220aa581fc08e\": container with ID starting with d93c264fc36e771c9504140efad8afbcbd5602b5de8be501ada220aa581fc08e not found: ID does not exist" Mar 16 17:11:41 crc kubenswrapper[5120]: I0316 17:11:41.718079 5120 scope.go:117] "RemoveContainer" containerID="9993ec5c6b4f30c9d30dafdea7deb75c1a50d89140e90b70baf9a257151faf98" Mar 16 17:11:41 crc kubenswrapper[5120]: E0316 17:11:41.718734 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9993ec5c6b4f30c9d30dafdea7deb75c1a50d89140e90b70baf9a257151faf98\": container with ID starting with 9993ec5c6b4f30c9d30dafdea7deb75c1a50d89140e90b70baf9a257151faf98 not found: ID does not exist" containerID="9993ec5c6b4f30c9d30dafdea7deb75c1a50d89140e90b70baf9a257151faf98" Mar 16 17:11:41 crc kubenswrapper[5120]: I0316 17:11:41.718860 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9993ec5c6b4f30c9d30dafdea7deb75c1a50d89140e90b70baf9a257151faf98"} err="failed to get container status \"9993ec5c6b4f30c9d30dafdea7deb75c1a50d89140e90b70baf9a257151faf98\": rpc error: code = NotFound desc = could not find container \"9993ec5c6b4f30c9d30dafdea7deb75c1a50d89140e90b70baf9a257151faf98\": container with ID starting with 9993ec5c6b4f30c9d30dafdea7deb75c1a50d89140e90b70baf9a257151faf98 not found: ID does not exist" Mar 16 17:11:42 crc kubenswrapper[5120]: E0316 17:11:42.083981 5120 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd0852906_6351_45a9_a44c_0bf3f4c29496.slice/crio-b4f2581124fb25de73fc35d6d1e068c0f8af119030bc9ac8f4b4c60b39198038.scope\": RecentStats: unable to find data in memory cache]" Mar 16 17:11:42 crc kubenswrapper[5120]: I0316 17:11:42.199361 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:11:42 crc kubenswrapper[5120]: I0316 17:11:42.211276 5120 generic.go:358] "Generic (PLEG): container finished" podID="9a997459-37ba-46a9-9cb8-075f77fa009f" containerID="5f0a1210752c571fbaca2dcbc5e5d9cf5e76f8f1d25ee4f7c4b2ade9932d7436" exitCode=137 Mar 16 17:11:42 crc kubenswrapper[5120]: I0316 17:11:42.211373 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"9a997459-37ba-46a9-9cb8-075f77fa009f","Type":"ContainerDied","Data":"5f0a1210752c571fbaca2dcbc5e5d9cf5e76f8f1d25ee4f7c4b2ade9932d7436"} Mar 16 17:11:42 crc kubenswrapper[5120]: I0316 17:11:42.211422 5120 scope.go:117] "RemoveContainer" containerID="c95c639838ab0891241eeaedc65582a42fe56eb64e08e9942cc764c9beef0e20" Mar 16 17:11:42 crc kubenswrapper[5120]: I0316 17:11:42.222258 5120 generic.go:358] "Generic (PLEG): container finished" podID="d0852906-6351-45a9-a44c-0bf3f4c29496" containerID="b4f2581124fb25de73fc35d6d1e068c0f8af119030bc9ac8f4b4c60b39198038" exitCode=137 Mar 16 17:11:42 crc kubenswrapper[5120]: I0316 17:11:42.222404 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"d0852906-6351-45a9-a44c-0bf3f4c29496","Type":"ContainerDied","Data":"b4f2581124fb25de73fc35d6d1e068c0f8af119030bc9ac8f4b4c60b39198038"} Mar 16 17:11:42 crc kubenswrapper[5120]: E0316 17:11:42.262789 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 3318da5f8965a4f0071e38f2519bc938484ed88a240807dcc6be332ef0847740 is running failed: container process not found" containerID="3318da5f8965a4f0071e38f2519bc938484ed88a240807dcc6be332ef0847740" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 17:11:42 crc kubenswrapper[5120]: E0316 17:11:42.263788 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 3318da5f8965a4f0071e38f2519bc938484ed88a240807dcc6be332ef0847740 is running failed: container process not found" containerID="3318da5f8965a4f0071e38f2519bc938484ed88a240807dcc6be332ef0847740" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 17:11:42 crc kubenswrapper[5120]: E0316 17:11:42.266474 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 3318da5f8965a4f0071e38f2519bc938484ed88a240807dcc6be332ef0847740 is running failed: container process not found" containerID="3318da5f8965a4f0071e38f2519bc938484ed88a240807dcc6be332ef0847740" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 17:11:42 crc kubenswrapper[5120]: E0316 17:11:42.266530 5120 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 3318da5f8965a4f0071e38f2519bc938484ed88a240807dcc6be332ef0847740 is running failed: container process not found" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="32194c8a-90a1-4132-9b75-3882418d7f7d" containerName="nova-scheduler-scheduler" probeResult="unknown" Mar 16 17:11:42 crc kubenswrapper[5120]: I0316 17:11:42.267088 5120 generic.go:358] "Generic (PLEG): container finished" podID="20d69ce8-08cb-4036-9537-ee82df795777" containerID="190eefaa41770301d8094d2034f41290cb8b06d88ae11797bddb5c36b08e5075" exitCode=137 Mar 16 17:11:42 crc kubenswrapper[5120]: I0316 17:11:42.267187 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:11:42 crc kubenswrapper[5120]: I0316 17:11:42.267341 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"20d69ce8-08cb-4036-9537-ee82df795777","Type":"ContainerDied","Data":"190eefaa41770301d8094d2034f41290cb8b06d88ae11797bddb5c36b08e5075"} Mar 16 17:11:42 crc kubenswrapper[5120]: I0316 17:11:42.267376 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"20d69ce8-08cb-4036-9537-ee82df795777","Type":"ContainerDied","Data":"b7133332a4a321b6530d4d4946303a7e0bf57b0d0b428bc5d15901b22fb33d53"} Mar 16 17:11:42 crc kubenswrapper[5120]: I0316 17:11:42.271690 5120 generic.go:358] "Generic (PLEG): container finished" podID="32194c8a-90a1-4132-9b75-3882418d7f7d" containerID="3318da5f8965a4f0071e38f2519bc938484ed88a240807dcc6be332ef0847740" exitCode=137 Mar 16 17:11:42 crc kubenswrapper[5120]: I0316 17:11:42.271753 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"32194c8a-90a1-4132-9b75-3882418d7f7d","Type":"ContainerDied","Data":"3318da5f8965a4f0071e38f2519bc938484ed88a240807dcc6be332ef0847740"} Mar 16 17:11:42 crc kubenswrapper[5120]: I0316 17:11:42.282220 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/20d69ce8-08cb-4036-9537-ee82df795777-config-data\") pod \"20d69ce8-08cb-4036-9537-ee82df795777\" (UID: \"20d69ce8-08cb-4036-9537-ee82df795777\") " Mar 16 17:11:42 crc kubenswrapper[5120]: I0316 17:11:42.282327 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wxcvh\" (UniqueName: \"kubernetes.io/projected/20d69ce8-08cb-4036-9537-ee82df795777-kube-api-access-wxcvh\") pod \"20d69ce8-08cb-4036-9537-ee82df795777\" (UID: \"20d69ce8-08cb-4036-9537-ee82df795777\") " Mar 16 17:11:42 crc kubenswrapper[5120]: I0316 17:11:42.282487 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/20d69ce8-08cb-4036-9537-ee82df795777-run-httpd\") pod \"20d69ce8-08cb-4036-9537-ee82df795777\" (UID: \"20d69ce8-08cb-4036-9537-ee82df795777\") " Mar 16 17:11:42 crc kubenswrapper[5120]: I0316 17:11:42.282593 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/20d69ce8-08cb-4036-9537-ee82df795777-combined-ca-bundle\") pod \"20d69ce8-08cb-4036-9537-ee82df795777\" (UID: \"20d69ce8-08cb-4036-9537-ee82df795777\") " Mar 16 17:11:42 crc kubenswrapper[5120]: I0316 17:11:42.282805 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/20d69ce8-08cb-4036-9537-ee82df795777-sg-core-conf-yaml\") pod \"20d69ce8-08cb-4036-9537-ee82df795777\" (UID: \"20d69ce8-08cb-4036-9537-ee82df795777\") " Mar 16 17:11:42 crc kubenswrapper[5120]: I0316 17:11:42.282842 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/20d69ce8-08cb-4036-9537-ee82df795777-log-httpd\") pod \"20d69ce8-08cb-4036-9537-ee82df795777\" (UID: \"20d69ce8-08cb-4036-9537-ee82df795777\") " Mar 16 17:11:42 crc kubenswrapper[5120]: I0316 17:11:42.282901 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/20d69ce8-08cb-4036-9537-ee82df795777-scripts\") pod \"20d69ce8-08cb-4036-9537-ee82df795777\" (UID: \"20d69ce8-08cb-4036-9537-ee82df795777\") " Mar 16 17:11:42 crc kubenswrapper[5120]: I0316 17:11:42.282936 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/20d69ce8-08cb-4036-9537-ee82df795777-ceilometer-tls-certs\") pod \"20d69ce8-08cb-4036-9537-ee82df795777\" (UID: \"20d69ce8-08cb-4036-9537-ee82df795777\") " Mar 16 17:11:42 crc kubenswrapper[5120]: I0316 17:11:42.288269 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20d69ce8-08cb-4036-9537-ee82df795777-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "20d69ce8-08cb-4036-9537-ee82df795777" (UID: "20d69ce8-08cb-4036-9537-ee82df795777"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:11:42 crc kubenswrapper[5120]: I0316 17:11:42.288481 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20d69ce8-08cb-4036-9537-ee82df795777-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "20d69ce8-08cb-4036-9537-ee82df795777" (UID: "20d69ce8-08cb-4036-9537-ee82df795777"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:11:42 crc kubenswrapper[5120]: I0316 17:11:42.292103 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/20d69ce8-08cb-4036-9537-ee82df795777-scripts" (OuterVolumeSpecName: "scripts") pod "20d69ce8-08cb-4036-9537-ee82df795777" (UID: "20d69ce8-08cb-4036-9537-ee82df795777"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:11:42 crc kubenswrapper[5120]: I0316 17:11:42.292518 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20d69ce8-08cb-4036-9537-ee82df795777-kube-api-access-wxcvh" (OuterVolumeSpecName: "kube-api-access-wxcvh") pod "20d69ce8-08cb-4036-9537-ee82df795777" (UID: "20d69ce8-08cb-4036-9537-ee82df795777"). InnerVolumeSpecName "kube-api-access-wxcvh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:11:42 crc kubenswrapper[5120]: I0316 17:11:42.299945 5120 scope.go:117] "RemoveContainer" containerID="c53e6084cd4784b416aa0905c6c812a19a8f42a1d13ab48bd906b62501da4219" Mar 16 17:11:42 crc kubenswrapper[5120]: I0316 17:11:42.325996 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/20d69ce8-08cb-4036-9537-ee82df795777-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "20d69ce8-08cb-4036-9537-ee82df795777" (UID: "20d69ce8-08cb-4036-9537-ee82df795777"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:11:42 crc kubenswrapper[5120]: I0316 17:11:42.366093 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/20d69ce8-08cb-4036-9537-ee82df795777-ceilometer-tls-certs" (OuterVolumeSpecName: "ceilometer-tls-certs") pod "20d69ce8-08cb-4036-9537-ee82df795777" (UID: "20d69ce8-08cb-4036-9537-ee82df795777"). InnerVolumeSpecName "ceilometer-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:11:42 crc kubenswrapper[5120]: I0316 17:11:42.385796 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wxcvh\" (UniqueName: \"kubernetes.io/projected/20d69ce8-08cb-4036-9537-ee82df795777-kube-api-access-wxcvh\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:42 crc kubenswrapper[5120]: I0316 17:11:42.385835 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/20d69ce8-08cb-4036-9537-ee82df795777-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:42 crc kubenswrapper[5120]: I0316 17:11:42.385851 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/20d69ce8-08cb-4036-9537-ee82df795777-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:42 crc kubenswrapper[5120]: I0316 17:11:42.385864 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/20d69ce8-08cb-4036-9537-ee82df795777-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:42 crc kubenswrapper[5120]: I0316 17:11:42.385876 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/20d69ce8-08cb-4036-9537-ee82df795777-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:42 crc kubenswrapper[5120]: I0316 17:11:42.385889 5120 reconciler_common.go:299] "Volume detached for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/20d69ce8-08cb-4036-9537-ee82df795777-ceilometer-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:42 crc kubenswrapper[5120]: I0316 17:11:42.394843 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:11:42 crc kubenswrapper[5120]: I0316 17:11:42.400179 5120 scope.go:117] "RemoveContainer" containerID="51b07147fdbc2067c1ea52f1c6a60ec3678d5b78364f7d078f09ca7bdbd5c835" Mar 16 17:11:42 crc kubenswrapper[5120]: I0316 17:11:42.408743 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/20d69ce8-08cb-4036-9537-ee82df795777-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "20d69ce8-08cb-4036-9537-ee82df795777" (UID: "20d69ce8-08cb-4036-9537-ee82df795777"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:11:42 crc kubenswrapper[5120]: I0316 17:11:42.421734 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/20d69ce8-08cb-4036-9537-ee82df795777-config-data" (OuterVolumeSpecName: "config-data") pod "20d69ce8-08cb-4036-9537-ee82df795777" (UID: "20d69ce8-08cb-4036-9537-ee82df795777"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:11:42 crc kubenswrapper[5120]: I0316 17:11:42.426229 5120 scope.go:117] "RemoveContainer" containerID="ed1f823e1481918cca7bdbd4ea81242468423c2660a6ebb3049cd622cc9e94c8" Mar 16 17:11:42 crc kubenswrapper[5120]: I0316 17:11:42.436095 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 17:11:42 crc kubenswrapper[5120]: I0316 17:11:42.452894 5120 scope.go:117] "RemoveContainer" containerID="190eefaa41770301d8094d2034f41290cb8b06d88ae11797bddb5c36b08e5075" Mar 16 17:11:42 crc kubenswrapper[5120]: I0316 17:11:42.471456 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 17:11:42 crc kubenswrapper[5120]: I0316 17:11:42.487589 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l45c5\" (UniqueName: \"kubernetes.io/projected/32194c8a-90a1-4132-9b75-3882418d7f7d-kube-api-access-l45c5\") pod \"32194c8a-90a1-4132-9b75-3882418d7f7d\" (UID: \"32194c8a-90a1-4132-9b75-3882418d7f7d\") " Mar 16 17:11:42 crc kubenswrapper[5120]: I0316 17:11:42.487831 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/32194c8a-90a1-4132-9b75-3882418d7f7d-combined-ca-bundle\") pod \"32194c8a-90a1-4132-9b75-3882418d7f7d\" (UID: \"32194c8a-90a1-4132-9b75-3882418d7f7d\") " Mar 16 17:11:42 crc kubenswrapper[5120]: I0316 17:11:42.488024 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/32194c8a-90a1-4132-9b75-3882418d7f7d-config-data\") pod \"32194c8a-90a1-4132-9b75-3882418d7f7d\" (UID: \"32194c8a-90a1-4132-9b75-3882418d7f7d\") " Mar 16 17:11:42 crc kubenswrapper[5120]: I0316 17:11:42.488555 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/20d69ce8-08cb-4036-9537-ee82df795777-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:42 crc kubenswrapper[5120]: I0316 17:11:42.488566 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/20d69ce8-08cb-4036-9537-ee82df795777-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:42 crc kubenswrapper[5120]: I0316 17:11:42.499081 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32194c8a-90a1-4132-9b75-3882418d7f7d-kube-api-access-l45c5" (OuterVolumeSpecName: "kube-api-access-l45c5") pod "32194c8a-90a1-4132-9b75-3882418d7f7d" (UID: "32194c8a-90a1-4132-9b75-3882418d7f7d"). InnerVolumeSpecName "kube-api-access-l45c5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:11:42 crc kubenswrapper[5120]: I0316 17:11:42.505256 5120 scope.go:117] "RemoveContainer" containerID="8ea5fa53ba53da2f8df0c5fe5630ab6fe1340d0e9e5454fd2daf2ed88e5284c3" Mar 16 17:11:42 crc kubenswrapper[5120]: I0316 17:11:42.519576 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/32194c8a-90a1-4132-9b75-3882418d7f7d-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "32194c8a-90a1-4132-9b75-3882418d7f7d" (UID: "32194c8a-90a1-4132-9b75-3882418d7f7d"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:11:42 crc kubenswrapper[5120]: I0316 17:11:42.522253 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/32194c8a-90a1-4132-9b75-3882418d7f7d-config-data" (OuterVolumeSpecName: "config-data") pod "32194c8a-90a1-4132-9b75-3882418d7f7d" (UID: "32194c8a-90a1-4132-9b75-3882418d7f7d"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:11:42 crc kubenswrapper[5120]: I0316 17:11:42.564319 5120 scope.go:117] "RemoveContainer" containerID="51b07147fdbc2067c1ea52f1c6a60ec3678d5b78364f7d078f09ca7bdbd5c835" Mar 16 17:11:42 crc kubenswrapper[5120]: E0316 17:11:42.568346 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"51b07147fdbc2067c1ea52f1c6a60ec3678d5b78364f7d078f09ca7bdbd5c835\": container with ID starting with 51b07147fdbc2067c1ea52f1c6a60ec3678d5b78364f7d078f09ca7bdbd5c835 not found: ID does not exist" containerID="51b07147fdbc2067c1ea52f1c6a60ec3678d5b78364f7d078f09ca7bdbd5c835" Mar 16 17:11:42 crc kubenswrapper[5120]: I0316 17:11:42.568421 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51b07147fdbc2067c1ea52f1c6a60ec3678d5b78364f7d078f09ca7bdbd5c835"} err="failed to get container status \"51b07147fdbc2067c1ea52f1c6a60ec3678d5b78364f7d078f09ca7bdbd5c835\": rpc error: code = NotFound desc = could not find container \"51b07147fdbc2067c1ea52f1c6a60ec3678d5b78364f7d078f09ca7bdbd5c835\": container with ID starting with 51b07147fdbc2067c1ea52f1c6a60ec3678d5b78364f7d078f09ca7bdbd5c835 not found: ID does not exist" Mar 16 17:11:42 crc kubenswrapper[5120]: I0316 17:11:42.568450 5120 scope.go:117] "RemoveContainer" containerID="ed1f823e1481918cca7bdbd4ea81242468423c2660a6ebb3049cd622cc9e94c8" Mar 16 17:11:42 crc kubenswrapper[5120]: E0316 17:11:42.569372 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ed1f823e1481918cca7bdbd4ea81242468423c2660a6ebb3049cd622cc9e94c8\": container with ID starting with ed1f823e1481918cca7bdbd4ea81242468423c2660a6ebb3049cd622cc9e94c8 not found: ID does not exist" containerID="ed1f823e1481918cca7bdbd4ea81242468423c2660a6ebb3049cd622cc9e94c8" Mar 16 17:11:42 crc kubenswrapper[5120]: I0316 17:11:42.569416 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed1f823e1481918cca7bdbd4ea81242468423c2660a6ebb3049cd622cc9e94c8"} err="failed to get container status \"ed1f823e1481918cca7bdbd4ea81242468423c2660a6ebb3049cd622cc9e94c8\": rpc error: code = NotFound desc = could not find container \"ed1f823e1481918cca7bdbd4ea81242468423c2660a6ebb3049cd622cc9e94c8\": container with ID starting with ed1f823e1481918cca7bdbd4ea81242468423c2660a6ebb3049cd622cc9e94c8 not found: ID does not exist" Mar 16 17:11:42 crc kubenswrapper[5120]: I0316 17:11:42.569445 5120 scope.go:117] "RemoveContainer" containerID="190eefaa41770301d8094d2034f41290cb8b06d88ae11797bddb5c36b08e5075" Mar 16 17:11:42 crc kubenswrapper[5120]: E0316 17:11:42.570022 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"190eefaa41770301d8094d2034f41290cb8b06d88ae11797bddb5c36b08e5075\": container with ID starting with 190eefaa41770301d8094d2034f41290cb8b06d88ae11797bddb5c36b08e5075 not found: ID does not exist" containerID="190eefaa41770301d8094d2034f41290cb8b06d88ae11797bddb5c36b08e5075" Mar 16 17:11:42 crc kubenswrapper[5120]: I0316 17:11:42.570052 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"190eefaa41770301d8094d2034f41290cb8b06d88ae11797bddb5c36b08e5075"} err="failed to get container status \"190eefaa41770301d8094d2034f41290cb8b06d88ae11797bddb5c36b08e5075\": rpc error: code = NotFound desc = could not find container \"190eefaa41770301d8094d2034f41290cb8b06d88ae11797bddb5c36b08e5075\": container with ID starting with 190eefaa41770301d8094d2034f41290cb8b06d88ae11797bddb5c36b08e5075 not found: ID does not exist" Mar 16 17:11:42 crc kubenswrapper[5120]: I0316 17:11:42.570073 5120 scope.go:117] "RemoveContainer" containerID="8ea5fa53ba53da2f8df0c5fe5630ab6fe1340d0e9e5454fd2daf2ed88e5284c3" Mar 16 17:11:42 crc kubenswrapper[5120]: E0316 17:11:42.570638 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ea5fa53ba53da2f8df0c5fe5630ab6fe1340d0e9e5454fd2daf2ed88e5284c3\": container with ID starting with 8ea5fa53ba53da2f8df0c5fe5630ab6fe1340d0e9e5454fd2daf2ed88e5284c3 not found: ID does not exist" containerID="8ea5fa53ba53da2f8df0c5fe5630ab6fe1340d0e9e5454fd2daf2ed88e5284c3" Mar 16 17:11:42 crc kubenswrapper[5120]: I0316 17:11:42.570745 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ea5fa53ba53da2f8df0c5fe5630ab6fe1340d0e9e5454fd2daf2ed88e5284c3"} err="failed to get container status \"8ea5fa53ba53da2f8df0c5fe5630ab6fe1340d0e9e5454fd2daf2ed88e5284c3\": rpc error: code = NotFound desc = could not find container \"8ea5fa53ba53da2f8df0c5fe5630ab6fe1340d0e9e5454fd2daf2ed88e5284c3\": container with ID starting with 8ea5fa53ba53da2f8df0c5fe5630ab6fe1340d0e9e5454fd2daf2ed88e5284c3 not found: ID does not exist" Mar 16 17:11:42 crc kubenswrapper[5120]: I0316 17:11:42.570819 5120 scope.go:117] "RemoveContainer" containerID="9d97456af25763c438e0acd373c3bbf792a78ef48369d22d14aa11c723f2637b" Mar 16 17:11:42 crc kubenswrapper[5120]: I0316 17:11:42.589902 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zrrl2\" (UniqueName: \"kubernetes.io/projected/9a997459-37ba-46a9-9cb8-075f77fa009f-kube-api-access-zrrl2\") pod \"9a997459-37ba-46a9-9cb8-075f77fa009f\" (UID: \"9a997459-37ba-46a9-9cb8-075f77fa009f\") " Mar 16 17:11:42 crc kubenswrapper[5120]: I0316 17:11:42.590005 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r5b7l\" (UniqueName: \"kubernetes.io/projected/d0852906-6351-45a9-a44c-0bf3f4c29496-kube-api-access-r5b7l\") pod \"d0852906-6351-45a9-a44c-0bf3f4c29496\" (UID: \"d0852906-6351-45a9-a44c-0bf3f4c29496\") " Mar 16 17:11:42 crc kubenswrapper[5120]: I0316 17:11:42.590030 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d0852906-6351-45a9-a44c-0bf3f4c29496-combined-ca-bundle\") pod \"d0852906-6351-45a9-a44c-0bf3f4c29496\" (UID: \"d0852906-6351-45a9-a44c-0bf3f4c29496\") " Mar 16 17:11:42 crc kubenswrapper[5120]: I0316 17:11:42.590088 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9a997459-37ba-46a9-9cb8-075f77fa009f-config-data\") pod \"9a997459-37ba-46a9-9cb8-075f77fa009f\" (UID: \"9a997459-37ba-46a9-9cb8-075f77fa009f\") " Mar 16 17:11:42 crc kubenswrapper[5120]: I0316 17:11:42.590136 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9a997459-37ba-46a9-9cb8-075f77fa009f-combined-ca-bundle\") pod \"9a997459-37ba-46a9-9cb8-075f77fa009f\" (UID: \"9a997459-37ba-46a9-9cb8-075f77fa009f\") " Mar 16 17:11:42 crc kubenswrapper[5120]: I0316 17:11:42.590273 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d0852906-6351-45a9-a44c-0bf3f4c29496-config-data\") pod \"d0852906-6351-45a9-a44c-0bf3f4c29496\" (UID: \"d0852906-6351-45a9-a44c-0bf3f4c29496\") " Mar 16 17:11:42 crc kubenswrapper[5120]: I0316 17:11:42.590953 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l45c5\" (UniqueName: \"kubernetes.io/projected/32194c8a-90a1-4132-9b75-3882418d7f7d-kube-api-access-l45c5\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:42 crc kubenswrapper[5120]: I0316 17:11:42.590972 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/32194c8a-90a1-4132-9b75-3882418d7f7d-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:42 crc kubenswrapper[5120]: I0316 17:11:42.591376 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/32194c8a-90a1-4132-9b75-3882418d7f7d-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:42 crc kubenswrapper[5120]: I0316 17:11:42.606887 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a997459-37ba-46a9-9cb8-075f77fa009f-kube-api-access-zrrl2" (OuterVolumeSpecName: "kube-api-access-zrrl2") pod "9a997459-37ba-46a9-9cb8-075f77fa009f" (UID: "9a997459-37ba-46a9-9cb8-075f77fa009f"). InnerVolumeSpecName "kube-api-access-zrrl2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:11:42 crc kubenswrapper[5120]: I0316 17:11:42.607602 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0852906-6351-45a9-a44c-0bf3f4c29496-kube-api-access-r5b7l" (OuterVolumeSpecName: "kube-api-access-r5b7l") pod "d0852906-6351-45a9-a44c-0bf3f4c29496" (UID: "d0852906-6351-45a9-a44c-0bf3f4c29496"). InnerVolumeSpecName "kube-api-access-r5b7l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:11:42 crc kubenswrapper[5120]: I0316 17:11:42.609986 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:11:42 crc kubenswrapper[5120]: I0316 17:11:42.616286 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:11:42 crc kubenswrapper[5120]: I0316 17:11:42.617903 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0852906-6351-45a9-a44c-0bf3f4c29496-config-data" (OuterVolumeSpecName: "config-data") pod "d0852906-6351-45a9-a44c-0bf3f4c29496" (UID: "d0852906-6351-45a9-a44c-0bf3f4c29496"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:11:42 crc kubenswrapper[5120]: I0316 17:11:42.619591 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a997459-37ba-46a9-9cb8-075f77fa009f-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "9a997459-37ba-46a9-9cb8-075f77fa009f" (UID: "9a997459-37ba-46a9-9cb8-075f77fa009f"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:11:42 crc kubenswrapper[5120]: I0316 17:11:42.620402 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a997459-37ba-46a9-9cb8-075f77fa009f-config-data" (OuterVolumeSpecName: "config-data") pod "9a997459-37ba-46a9-9cb8-075f77fa009f" (UID: "9a997459-37ba-46a9-9cb8-075f77fa009f"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:11:42 crc kubenswrapper[5120]: I0316 17:11:42.625051 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0852906-6351-45a9-a44c-0bf3f4c29496-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "d0852906-6351-45a9-a44c-0bf3f4c29496" (UID: "d0852906-6351-45a9-a44c-0bf3f4c29496"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:11:42 crc kubenswrapper[5120]: I0316 17:11:42.678324 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="20d69ce8-08cb-4036-9537-ee82df795777" path="/var/lib/kubelet/pods/20d69ce8-08cb-4036-9537-ee82df795777/volumes" Mar 16 17:11:42 crc kubenswrapper[5120]: I0316 17:11:42.679443 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6e4e8c65-5607-4f79-ba90-208ca1a32521" path="/var/lib/kubelet/pods/6e4e8c65-5607-4f79-ba90-208ca1a32521/volumes" Mar 16 17:11:42 crc kubenswrapper[5120]: I0316 17:11:42.680905 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8c67a3db-090c-4122-baa3-57a35abe4a77" path="/var/lib/kubelet/pods/8c67a3db-090c-4122-baa3-57a35abe4a77/volumes" Mar 16 17:11:42 crc kubenswrapper[5120]: I0316 17:11:42.682687 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c4f7000d-d4eb-4d8c-9fb8-f88d8304b970" path="/var/lib/kubelet/pods/c4f7000d-d4eb-4d8c-9fb8-f88d8304b970/volumes" Mar 16 17:11:42 crc kubenswrapper[5120]: I0316 17:11:42.693792 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zrrl2\" (UniqueName: \"kubernetes.io/projected/9a997459-37ba-46a9-9cb8-075f77fa009f-kube-api-access-zrrl2\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:42 crc kubenswrapper[5120]: I0316 17:11:42.693828 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r5b7l\" (UniqueName: \"kubernetes.io/projected/d0852906-6351-45a9-a44c-0bf3f4c29496-kube-api-access-r5b7l\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:42 crc kubenswrapper[5120]: I0316 17:11:42.693838 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d0852906-6351-45a9-a44c-0bf3f4c29496-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:42 crc kubenswrapper[5120]: I0316 17:11:42.693847 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9a997459-37ba-46a9-9cb8-075f77fa009f-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:42 crc kubenswrapper[5120]: I0316 17:11:42.693858 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9a997459-37ba-46a9-9cb8-075f77fa009f-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:42 crc kubenswrapper[5120]: I0316 17:11:42.693866 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d0852906-6351-45a9-a44c-0bf3f4c29496-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:42 crc kubenswrapper[5120]: I0316 17:11:42.927839 5120 pod_container_manager_linux.go:217] "Failed to delete cgroup paths" cgroupName=["kubepods","besteffort","pod140a02f0-df36-49fb-b2bb-b267e350f5c5"] err="unable to destroy cgroup paths for cgroup [kubepods besteffort pod140a02f0-df36-49fb-b2bb-b267e350f5c5] : Timed out while waiting for systemd to remove kubepods-besteffort-pod140a02f0_df36_49fb_b2bb_b267e350f5c5.slice" Mar 16 17:11:42 crc kubenswrapper[5120]: E0316 17:11:42.927906 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to delete cgroup paths for [kubepods besteffort pod140a02f0-df36-49fb-b2bb-b267e350f5c5] : unable to destroy cgroup paths for cgroup [kubepods besteffort pod140a02f0-df36-49fb-b2bb-b267e350f5c5] : Timed out while waiting for systemd to remove kubepods-besteffort-pod140a02f0_df36_49fb_b2bb_b267e350f5c5.slice" pod="openstack-kuttl-tests/openstackclient" podUID="140a02f0-df36-49fb-b2bb-b267e350f5c5" Mar 16 17:11:42 crc kubenswrapper[5120]: I0316 17:11:42.932112 5120 pod_container_manager_linux.go:217] "Failed to delete cgroup paths" cgroupName=["kubepods","besteffort","pod4f3e991c-b99b-4665-b5df-a900935e3c99"] err="unable to destroy cgroup paths for cgroup [kubepods besteffort pod4f3e991c-b99b-4665-b5df-a900935e3c99] : Timed out while waiting for systemd to remove kubepods-besteffort-pod4f3e991c_b99b_4665_b5df_a900935e3c99.slice" Mar 16 17:11:42 crc kubenswrapper[5120]: E0316 17:11:42.932136 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to delete cgroup paths for [kubepods besteffort pod4f3e991c-b99b-4665-b5df-a900935e3c99] : unable to destroy cgroup paths for cgroup [kubepods besteffort pod4f3e991c-b99b-4665-b5df-a900935e3c99] : Timed out while waiting for systemd to remove kubepods-besteffort-pod4f3e991c_b99b_4665_b5df_a900935e3c99.slice" pod="openstack-kuttl-tests/swift-proxy-6d6f5fb946-cmmjt" podUID="4f3e991c-b99b-4665-b5df-a900935e3c99" Mar 16 17:11:42 crc kubenswrapper[5120]: I0316 17:11:42.938580 5120 pod_container_manager_linux.go:217] "Failed to delete cgroup paths" cgroupName=["kubepods","besteffort","podfa8d6c88-cfc9-4ead-974d-005ae362769a"] err="unable to destroy cgroup paths for cgroup [kubepods besteffort podfa8d6c88-cfc9-4ead-974d-005ae362769a] : Timed out while waiting for systemd to remove kubepods-besteffort-podfa8d6c88_cfc9_4ead_974d_005ae362769a.slice" Mar 16 17:11:42 crc kubenswrapper[5120]: E0316 17:11:42.938643 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to delete cgroup paths for [kubepods besteffort podfa8d6c88-cfc9-4ead-974d-005ae362769a] : unable to destroy cgroup paths for cgroup [kubepods besteffort podfa8d6c88-cfc9-4ead-974d-005ae362769a] : Timed out while waiting for systemd to remove kubepods-besteffort-podfa8d6c88_cfc9_4ead_974d_005ae362769a.slice" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podUID="fa8d6c88-cfc9-4ead-974d-005ae362769a" Mar 16 17:11:43 crc kubenswrapper[5120]: I0316 17:11:43.282401 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"32194c8a-90a1-4132-9b75-3882418d7f7d","Type":"ContainerDied","Data":"e0365d1b14b4166167d9eecf9dcb3f90cd1da385a725c2311a91877bb496df23"} Mar 16 17:11:43 crc kubenswrapper[5120]: I0316 17:11:43.282859 5120 scope.go:117] "RemoveContainer" containerID="3318da5f8965a4f0071e38f2519bc938484ed88a240807dcc6be332ef0847740" Mar 16 17:11:43 crc kubenswrapper[5120]: I0316 17:11:43.283120 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:11:43 crc kubenswrapper[5120]: I0316 17:11:43.286085 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"9a997459-37ba-46a9-9cb8-075f77fa009f","Type":"ContainerDied","Data":"ff70156b44dee76c7728fe4ee09d8f1e85e30ab8d9e97476c53d0492ab6fca64"} Mar 16 17:11:43 crc kubenswrapper[5120]: I0316 17:11:43.286144 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 17:11:43 crc kubenswrapper[5120]: I0316 17:11:43.287707 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"d0852906-6351-45a9-a44c-0bf3f4c29496","Type":"ContainerDied","Data":"44336d0a6e95d9fba65aa5d6a8f53822a1ebc5ac0db6e5789d688d9552d78e49"} Mar 16 17:11:43 crc kubenswrapper[5120]: I0316 17:11:43.287838 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 17:11:43 crc kubenswrapper[5120]: I0316 17:11:43.289329 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:11:43 crc kubenswrapper[5120]: I0316 17:11:43.289369 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-6d6f5fb946-cmmjt" Mar 16 17:11:43 crc kubenswrapper[5120]: I0316 17:11:43.289338 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Mar 16 17:11:43 crc kubenswrapper[5120]: I0316 17:11:43.303709 5120 status_manager.go:895] "Failed to get status for pod" podUID="140a02f0-df36-49fb-b2bb-b267e350f5c5" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 17:11:43 crc kubenswrapper[5120]: I0316 17:11:43.313994 5120 scope.go:117] "RemoveContainer" containerID="5f0a1210752c571fbaca2dcbc5e5d9cf5e76f8f1d25ee4f7c4b2ade9932d7436" Mar 16 17:11:43 crc kubenswrapper[5120]: I0316 17:11:43.337004 5120 scope.go:117] "RemoveContainer" containerID="b4f2581124fb25de73fc35d6d1e068c0f8af119030bc9ac8f4b4c60b39198038" Mar 16 17:11:43 crc kubenswrapper[5120]: I0316 17:11:43.368464 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 17:11:43 crc kubenswrapper[5120]: I0316 17:11:43.381706 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 17:11:43 crc kubenswrapper[5120]: I0316 17:11:43.385082 5120 status_manager.go:895] "Failed to get status for pod" podUID="140a02f0-df36-49fb-b2bb-b267e350f5c5" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 17:11:43 crc kubenswrapper[5120]: I0316 17:11:43.392036 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-proxy-6d6f5fb946-cmmjt"] Mar 16 17:11:43 crc kubenswrapper[5120]: I0316 17:11:43.402273 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/swift-proxy-6d6f5fb946-cmmjt"] Mar 16 17:11:43 crc kubenswrapper[5120]: I0316 17:11:43.408407 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 17:11:43 crc kubenswrapper[5120]: I0316 17:11:43.413586 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 17:11:43 crc kubenswrapper[5120]: I0316 17:11:43.418403 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 17:11:43 crc kubenswrapper[5120]: I0316 17:11:43.423567 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 17:11:43 crc kubenswrapper[5120]: I0316 17:11:43.428667 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 17:11:43 crc kubenswrapper[5120]: I0316 17:11:43.435717 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 17:11:44 crc kubenswrapper[5120]: I0316 17:11:44.676472 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="32194c8a-90a1-4132-9b75-3882418d7f7d" path="/var/lib/kubelet/pods/32194c8a-90a1-4132-9b75-3882418d7f7d/volumes" Mar 16 17:11:44 crc kubenswrapper[5120]: I0316 17:11:44.677509 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4f3e991c-b99b-4665-b5df-a900935e3c99" path="/var/lib/kubelet/pods/4f3e991c-b99b-4665-b5df-a900935e3c99/volumes" Mar 16 17:11:44 crc kubenswrapper[5120]: I0316 17:11:44.678510 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a997459-37ba-46a9-9cb8-075f77fa009f" path="/var/lib/kubelet/pods/9a997459-37ba-46a9-9cb8-075f77fa009f/volumes" Mar 16 17:11:44 crc kubenswrapper[5120]: I0316 17:11:44.680602 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d0852906-6351-45a9-a44c-0bf3f4c29496" path="/var/lib/kubelet/pods/d0852906-6351-45a9-a44c-0bf3f4c29496/volumes" Mar 16 17:11:44 crc kubenswrapper[5120]: I0316 17:11:44.681880 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fa8d6c88-cfc9-4ead-974d-005ae362769a" path="/var/lib/kubelet/pods/fa8d6c88-cfc9-4ead-974d-005ae362769a/volumes" Mar 16 17:11:45 crc kubenswrapper[5120]: I0316 17:11:45.727855 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="e7b10940-fda7-468a-8937-fd83bb366d34" containerName="glance-httpd" probeResult="failure" output="Get \"https://10.217.0.99:9292/healthcheck\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Mar 16 17:11:47 crc kubenswrapper[5120]: I0316 17:11:47.014164 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-v822j_ac55471d-4e42-475f-a082-50f611571482/kube-multus/0.log" Mar 16 17:11:47 crc kubenswrapper[5120]: I0316 17:11:47.020738 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-crc_9f0bc7fcb0822a2c13eb2d22cd8c0641/kube-controller-manager/0.log" Mar 16 17:11:47 crc kubenswrapper[5120]: I0316 17:11:47.313739 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-v822j_ac55471d-4e42-475f-a082-50f611571482/kube-multus/0.log" Mar 16 17:11:47 crc kubenswrapper[5120]: I0316 17:11:47.319681 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-crc_9f0bc7fcb0822a2c13eb2d22cd8c0641/kube-controller-manager/0.log" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.026443 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["crc-storage/crc-storage-crc-j7v5h"] Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.034155 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["crc-storage/crc-storage-crc-j7v5h"] Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.147426 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["crc-storage/crc-storage-crc-7gshq"] Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.148411 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32194c8a-90a1-4132-9b75-3882418d7f7d" containerName="nova-scheduler-scheduler" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.148433 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="32194c8a-90a1-4132-9b75-3882418d7f7d" containerName="nova-scheduler-scheduler" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.148442 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c67a3db-090c-4122-baa3-57a35abe4a77" containerName="object-updater" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.148448 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c67a3db-090c-4122-baa3-57a35abe4a77" containerName="object-updater" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.148466 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a997459-37ba-46a9-9cb8-075f77fa009f" containerName="nova-cell0-conductor-conductor" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.148479 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a997459-37ba-46a9-9cb8-075f77fa009f" containerName="nova-cell0-conductor-conductor" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.148491 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32194c8a-90a1-4132-9b75-3882418d7f7d" containerName="nova-scheduler-scheduler" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.148498 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="32194c8a-90a1-4132-9b75-3882418d7f7d" containerName="nova-scheduler-scheduler" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.148512 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e4e8c65-5607-4f79-ba90-208ca1a32521" containerName="probe" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.148519 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e4e8c65-5607-4f79-ba90-208ca1a32521" containerName="probe" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.148530 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c67a3db-090c-4122-baa3-57a35abe4a77" containerName="container-replicator" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.148537 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c67a3db-090c-4122-baa3-57a35abe4a77" containerName="container-replicator" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.148544 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4da2790-525e-44f0-bddd-c5edbb04ae32" containerName="nova-api-log" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.148550 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4da2790-525e-44f0-bddd-c5edbb04ae32" containerName="nova-api-log" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.148558 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="259e8ab8-dfd3-414c-b392-951a9f770559" containerName="setup-container" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.148564 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="259e8ab8-dfd3-414c-b392-951a9f770559" containerName="setup-container" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.148573 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c67a3db-090c-4122-baa3-57a35abe4a77" containerName="object-expirer" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.148578 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c67a3db-090c-4122-baa3-57a35abe4a77" containerName="object-expirer" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.148587 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20d69ce8-08cb-4036-9537-ee82df795777" containerName="proxy-httpd" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.148593 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="20d69ce8-08cb-4036-9537-ee82df795777" containerName="proxy-httpd" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.148599 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="259e8ab8-dfd3-414c-b392-951a9f770559" containerName="rabbitmq" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.148604 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="259e8ab8-dfd3-414c-b392-951a9f770559" containerName="rabbitmq" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.148613 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45b8119e-70b5-45ad-9629-41a99f2f8ed0" containerName="ovn-northd" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.148618 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="45b8119e-70b5-45ad-9629-41a99f2f8ed0" containerName="ovn-northd" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.148627 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01e18a65-5476-4eea-8420-5f6bc6f93cca" containerName="dnsmasq-dns" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.148632 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="01e18a65-5476-4eea-8420-5f6bc6f93cca" containerName="dnsmasq-dns" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.148640 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0852906-6351-45a9-a44c-0bf3f4c29496" containerName="nova-cell1-conductor-conductor" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.148645 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0852906-6351-45a9-a44c-0bf3f4c29496" containerName="nova-cell1-conductor-conductor" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.148653 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20d69ce8-08cb-4036-9537-ee82df795777" containerName="ceilometer-central-agent" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.148661 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="20d69ce8-08cb-4036-9537-ee82df795777" containerName="ceilometer-central-agent" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.148668 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d71c12b8-f085-4c19-99c6-f32186225f37" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.148675 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="d71c12b8-f085-4c19-99c6-f32186225f37" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.148686 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4f7000d-d4eb-4d8c-9fb8-f88d8304b970" containerName="neutron-api" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.148691 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4f7000d-d4eb-4d8c-9fb8-f88d8304b970" containerName="neutron-api" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.148697 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9009d26a-9c60-48c3-981f-41e60a03545d" containerName="mysql-bootstrap" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.148702 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9009d26a-9c60-48c3-981f-41e60a03545d" containerName="mysql-bootstrap" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.148710 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb59b894-da6e-4bd0-85c3-2330d90f2fb9" containerName="barbican-api-log" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.148716 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb59b894-da6e-4bd0-85c3-2330d90f2fb9" containerName="barbican-api-log" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.148726 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0852906-6351-45a9-a44c-0bf3f4c29496" containerName="nova-cell1-conductor-conductor" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.148738 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0852906-6351-45a9-a44c-0bf3f4c29496" containerName="nova-cell1-conductor-conductor" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.148755 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c67a3db-090c-4122-baa3-57a35abe4a77" containerName="account-server" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.148780 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c67a3db-090c-4122-baa3-57a35abe4a77" containerName="account-server" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.148791 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c67a3db-090c-4122-baa3-57a35abe4a77" containerName="container-auditor" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.148800 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c67a3db-090c-4122-baa3-57a35abe4a77" containerName="container-auditor" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.148809 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7b10940-fda7-468a-8937-fd83bb366d34" containerName="glance-httpd" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.148815 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7b10940-fda7-468a-8937-fd83bb366d34" containerName="glance-httpd" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.148825 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32194c8a-90a1-4132-9b75-3882418d7f7d" containerName="nova-scheduler-scheduler" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.148831 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="32194c8a-90a1-4132-9b75-3882418d7f7d" containerName="nova-scheduler-scheduler" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.148839 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="830abb7b-cab5-4a21-9e39-6dc0c0faf74e" containerName="placement-api" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.148844 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="830abb7b-cab5-4a21-9e39-6dc0c0faf74e" containerName="placement-api" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.148852 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0852906-6351-45a9-a44c-0bf3f4c29496" containerName="nova-cell1-conductor-conductor" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.148860 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0852906-6351-45a9-a44c-0bf3f4c29496" containerName="nova-cell1-conductor-conductor" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.148871 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a997459-37ba-46a9-9cb8-075f77fa009f" containerName="nova-cell0-conductor-conductor" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.148876 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a997459-37ba-46a9-9cb8-075f77fa009f" containerName="nova-cell0-conductor-conductor" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.148882 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a997459-37ba-46a9-9cb8-075f77fa009f" containerName="nova-cell0-conductor-conductor" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.148887 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a997459-37ba-46a9-9cb8-075f77fa009f" containerName="nova-cell0-conductor-conductor" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.148894 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="483d872a-47d2-44f6-a80a-acf24e5f37c8" containerName="kube-state-metrics" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.148899 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="483d872a-47d2-44f6-a80a-acf24e5f37c8" containerName="kube-state-metrics" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.148908 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ade246ff-09d5-4b25-a738-4733af58f79c" containerName="cinder-api-log" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.148913 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ade246ff-09d5-4b25-a738-4733af58f79c" containerName="cinder-api-log" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.148922 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f659fd59-18da-47e7-b57a-27e7d95a428e" containerName="nova-metadata-log" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.148927 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f659fd59-18da-47e7-b57a-27e7d95a428e" containerName="nova-metadata-log" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.148935 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c67a3db-090c-4122-baa3-57a35abe4a77" containerName="object-server" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.148941 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c67a3db-090c-4122-baa3-57a35abe4a77" containerName="object-server" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.148946 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2a1847f-6881-4af9-b38b-35fd23e3f85e" containerName="memcached" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.148951 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2a1847f-6881-4af9-b38b-35fd23e3f85e" containerName="memcached" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.148960 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9009d26a-9c60-48c3-981f-41e60a03545d" containerName="galera" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.148965 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9009d26a-9c60-48c3-981f-41e60a03545d" containerName="galera" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.148972 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c67a3db-090c-4122-baa3-57a35abe4a77" containerName="account-auditor" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.148977 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c67a3db-090c-4122-baa3-57a35abe4a77" containerName="account-auditor" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.148984 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4da2790-525e-44f0-bddd-c5edbb04ae32" containerName="nova-api-api" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.148989 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4da2790-525e-44f0-bddd-c5edbb04ae32" containerName="nova-api-api" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.148996 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e491da9b-3bac-45f2-b9f5-41af945fe1eb" containerName="barbican-worker" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.149001 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e491da9b-3bac-45f2-b9f5-41af945fe1eb" containerName="barbican-worker" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.149009 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20d69ce8-08cb-4036-9537-ee82df795777" containerName="ceilometer-notification-agent" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.149014 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="20d69ce8-08cb-4036-9537-ee82df795777" containerName="ceilometer-notification-agent" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.149024 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="466bdf84-87d2-46ac-8f19-914a10b4ad63" containerName="galera" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.149029 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="466bdf84-87d2-46ac-8f19-914a10b4ad63" containerName="galera" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.149038 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7b10940-fda7-468a-8937-fd83bb366d34" containerName="glance-log" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.149043 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7b10940-fda7-468a-8937-fd83bb366d34" containerName="glance-log" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.149051 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c67a3db-090c-4122-baa3-57a35abe4a77" containerName="object-auditor" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.149056 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c67a3db-090c-4122-baa3-57a35abe4a77" containerName="object-auditor" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.149063 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c67a3db-090c-4122-baa3-57a35abe4a77" containerName="rsync" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.149068 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c67a3db-090c-4122-baa3-57a35abe4a77" containerName="rsync" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.149077 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4f7000d-d4eb-4d8c-9fb8-f88d8304b970" containerName="neutron-httpd" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.149082 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4f7000d-d4eb-4d8c-9fb8-f88d8304b970" containerName="neutron-httpd" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.149088 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2018b64c-7208-4c67-b4ec-6e336ca72e94" containerName="glance-httpd" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.149093 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="2018b64c-7208-4c67-b4ec-6e336ca72e94" containerName="glance-httpd" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.149102 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f659fd59-18da-47e7-b57a-27e7d95a428e" containerName="nova-metadata-metadata" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.149107 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f659fd59-18da-47e7-b57a-27e7d95a428e" containerName="nova-metadata-metadata" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.149117 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c67a3db-090c-4122-baa3-57a35abe4a77" containerName="account-reaper" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.149121 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c67a3db-090c-4122-baa3-57a35abe4a77" containerName="account-reaper" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.149129 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c67a3db-090c-4122-baa3-57a35abe4a77" containerName="container-updater" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.149135 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c67a3db-090c-4122-baa3-57a35abe4a77" containerName="container-updater" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.149146 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01e18a65-5476-4eea-8420-5f6bc6f93cca" containerName="init" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.149151 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="01e18a65-5476-4eea-8420-5f6bc6f93cca" containerName="init" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.149158 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b7d191f-d557-4a83-829b-bad5a5ed7dbb" containerName="barbican-keystone-listener-log" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.149164 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b7d191f-d557-4a83-829b-bad5a5ed7dbb" containerName="barbican-keystone-listener-log" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.149169 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="466bdf84-87d2-46ac-8f19-914a10b4ad63" containerName="mysql-bootstrap" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.149174 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="466bdf84-87d2-46ac-8f19-914a10b4ad63" containerName="mysql-bootstrap" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.149180 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef2e55ac-292f-4242-b410-0eb4d2ff90d3" containerName="setup-container" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.149185 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef2e55ac-292f-4242-b410-0eb4d2ff90d3" containerName="setup-container" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.149196 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f3e991c-b99b-4665-b5df-a900935e3c99" containerName="proxy-httpd" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.149201 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f3e991c-b99b-4665-b5df-a900935e3c99" containerName="proxy-httpd" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.149207 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef2e55ac-292f-4242-b410-0eb4d2ff90d3" containerName="rabbitmq" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.149213 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef2e55ac-292f-4242-b410-0eb4d2ff90d3" containerName="rabbitmq" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.149219 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b7d191f-d557-4a83-829b-bad5a5ed7dbb" containerName="barbican-keystone-listener" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.149225 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b7d191f-d557-4a83-829b-bad5a5ed7dbb" containerName="barbican-keystone-listener" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.149230 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c67a3db-090c-4122-baa3-57a35abe4a77" containerName="container-server" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.149235 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c67a3db-090c-4122-baa3-57a35abe4a77" containerName="container-server" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.149243 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e491da9b-3bac-45f2-b9f5-41af945fe1eb" containerName="barbican-worker-log" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.149250 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e491da9b-3bac-45f2-b9f5-41af945fe1eb" containerName="barbican-worker-log" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.149264 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f3e991c-b99b-4665-b5df-a900935e3c99" containerName="proxy-server" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.149274 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f3e991c-b99b-4665-b5df-a900935e3c99" containerName="proxy-server" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.149285 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1b86673-6678-41ee-b073-f44c6d447fbc" containerName="keystone-api" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.149290 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1b86673-6678-41ee-b073-f44c6d447fbc" containerName="keystone-api" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.149301 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ade246ff-09d5-4b25-a738-4733af58f79c" containerName="cinder-api" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.149311 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ade246ff-09d5-4b25-a738-4733af58f79c" containerName="cinder-api" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.149323 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20d69ce8-08cb-4036-9537-ee82df795777" containerName="sg-core" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.149328 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="20d69ce8-08cb-4036-9537-ee82df795777" containerName="sg-core" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.149337 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2018b64c-7208-4c67-b4ec-6e336ca72e94" containerName="glance-log" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.149342 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="2018b64c-7208-4c67-b4ec-6e336ca72e94" containerName="glance-log" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.149350 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45b8119e-70b5-45ad-9629-41a99f2f8ed0" containerName="openstack-network-exporter" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.149355 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="45b8119e-70b5-45ad-9629-41a99f2f8ed0" containerName="openstack-network-exporter" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.149364 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c67a3db-090c-4122-baa3-57a35abe4a77" containerName="swift-recon-cron" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.149370 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c67a3db-090c-4122-baa3-57a35abe4a77" containerName="swift-recon-cron" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.149380 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="830abb7b-cab5-4a21-9e39-6dc0c0faf74e" containerName="placement-log" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.149387 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="830abb7b-cab5-4a21-9e39-6dc0c0faf74e" containerName="placement-log" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.149418 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c67a3db-090c-4122-baa3-57a35abe4a77" containerName="account-replicator" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.149424 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c67a3db-090c-4122-baa3-57a35abe4a77" containerName="account-replicator" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.149431 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e4e8c65-5607-4f79-ba90-208ca1a32521" containerName="cinder-scheduler" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.149437 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e4e8c65-5607-4f79-ba90-208ca1a32521" containerName="cinder-scheduler" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.149444 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c67a3db-090c-4122-baa3-57a35abe4a77" containerName="object-replicator" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.149449 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c67a3db-090c-4122-baa3-57a35abe4a77" containerName="object-replicator" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.149459 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb59b894-da6e-4bd0-85c3-2330d90f2fb9" containerName="barbican-api" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.149466 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb59b894-da6e-4bd0-85c3-2330d90f2fb9" containerName="barbican-api" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.149600 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="9a997459-37ba-46a9-9cb8-075f77fa009f" containerName="nova-cell0-conductor-conductor" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.149612 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="259e8ab8-dfd3-414c-b392-951a9f770559" containerName="rabbitmq" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.149623 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="483d872a-47d2-44f6-a80a-acf24e5f37c8" containerName="kube-state-metrics" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.149636 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="20d69ce8-08cb-4036-9537-ee82df795777" containerName="ceilometer-central-agent" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.149646 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="8c67a3db-090c-4122-baa3-57a35abe4a77" containerName="rsync" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.149652 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="32194c8a-90a1-4132-9b75-3882418d7f7d" containerName="nova-scheduler-scheduler" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.149660 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="8c67a3db-090c-4122-baa3-57a35abe4a77" containerName="swift-recon-cron" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.149673 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="4f3e991c-b99b-4665-b5df-a900935e3c99" containerName="proxy-server" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.149684 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="20d69ce8-08cb-4036-9537-ee82df795777" containerName="proxy-httpd" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.149694 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="6e4e8c65-5607-4f79-ba90-208ca1a32521" containerName="probe" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.149702 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c4f7000d-d4eb-4d8c-9fb8-f88d8304b970" containerName="neutron-api" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.149710 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="830abb7b-cab5-4a21-9e39-6dc0c0faf74e" containerName="placement-log" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.149718 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="20d69ce8-08cb-4036-9537-ee82df795777" containerName="sg-core" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.149726 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e491da9b-3bac-45f2-b9f5-41af945fe1eb" containerName="barbican-worker" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.149735 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="9009d26a-9c60-48c3-981f-41e60a03545d" containerName="galera" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.149744 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="45b8119e-70b5-45ad-9629-41a99f2f8ed0" containerName="openstack-network-exporter" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.149753 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="d4da2790-525e-44f0-bddd-c5edbb04ae32" containerName="nova-api-log" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.149779 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1b7d191f-d557-4a83-829b-bad5a5ed7dbb" containerName="barbican-keystone-listener-log" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.149791 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="32194c8a-90a1-4132-9b75-3882418d7f7d" containerName="nova-scheduler-scheduler" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.149803 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="466bdf84-87d2-46ac-8f19-914a10b4ad63" containerName="galera" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.149814 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="8c67a3db-090c-4122-baa3-57a35abe4a77" containerName="container-updater" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.149822 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e7b10940-fda7-468a-8937-fd83bb366d34" containerName="glance-log" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.149832 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="2018b64c-7208-4c67-b4ec-6e336ca72e94" containerName="glance-log" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.149843 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="8c67a3db-090c-4122-baa3-57a35abe4a77" containerName="container-replicator" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.149856 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="d0852906-6351-45a9-a44c-0bf3f4c29496" containerName="nova-cell1-conductor-conductor" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.149865 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="8c67a3db-090c-4122-baa3-57a35abe4a77" containerName="account-server" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.149877 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="d0852906-6351-45a9-a44c-0bf3f4c29496" containerName="nova-cell1-conductor-conductor" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.149887 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f659fd59-18da-47e7-b57a-27e7d95a428e" containerName="nova-metadata-log" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.149895 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ef2e55ac-292f-4242-b410-0eb4d2ff90d3" containerName="rabbitmq" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.149905 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="8c67a3db-090c-4122-baa3-57a35abe4a77" containerName="account-auditor" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.149915 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="9a997459-37ba-46a9-9cb8-075f77fa009f" containerName="nova-cell0-conductor-conductor" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.149922 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="4f3e991c-b99b-4665-b5df-a900935e3c99" containerName="proxy-httpd" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.149933 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ade246ff-09d5-4b25-a738-4733af58f79c" containerName="cinder-api-log" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.149945 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="8c67a3db-090c-4122-baa3-57a35abe4a77" containerName="container-server" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.149954 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="cb59b894-da6e-4bd0-85c3-2330d90f2fb9" containerName="barbican-api" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.149963 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="6e4e8c65-5607-4f79-ba90-208ca1a32521" containerName="cinder-scheduler" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.149970 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="8c67a3db-090c-4122-baa3-57a35abe4a77" containerName="account-replicator" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.149980 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="45b8119e-70b5-45ad-9629-41a99f2f8ed0" containerName="ovn-northd" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.149989 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e7b10940-fda7-468a-8937-fd83bb366d34" containerName="glance-httpd" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.149998 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="8c67a3db-090c-4122-baa3-57a35abe4a77" containerName="object-replicator" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.150006 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1b7d191f-d557-4a83-829b-bad5a5ed7dbb" containerName="barbican-keystone-listener" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.150017 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="8c67a3db-090c-4122-baa3-57a35abe4a77" containerName="account-reaper" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.150025 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="d71c12b8-f085-4c19-99c6-f32186225f37" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.150037 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="d0852906-6351-45a9-a44c-0bf3f4c29496" containerName="nova-cell1-conductor-conductor" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.150047 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="20d69ce8-08cb-4036-9537-ee82df795777" containerName="ceilometer-notification-agent" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.150056 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="8c67a3db-090c-4122-baa3-57a35abe4a77" containerName="object-auditor" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.150065 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="8c67a3db-090c-4122-baa3-57a35abe4a77" containerName="object-expirer" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.150076 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="01e18a65-5476-4eea-8420-5f6bc6f93cca" containerName="dnsmasq-dns" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.150083 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="d0852906-6351-45a9-a44c-0bf3f4c29496" containerName="nova-cell1-conductor-conductor" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.150093 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="a2a1847f-6881-4af9-b38b-35fd23e3f85e" containerName="memcached" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.150102 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="d4da2790-525e-44f0-bddd-c5edbb04ae32" containerName="nova-api-api" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.150111 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="9a997459-37ba-46a9-9cb8-075f77fa009f" containerName="nova-cell0-conductor-conductor" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.150119 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="cb59b894-da6e-4bd0-85c3-2330d90f2fb9" containerName="barbican-api-log" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.150127 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f659fd59-18da-47e7-b57a-27e7d95a428e" containerName="nova-metadata-metadata" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.150137 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="8c67a3db-090c-4122-baa3-57a35abe4a77" containerName="object-server" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.150148 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="9a997459-37ba-46a9-9cb8-075f77fa009f" containerName="nova-cell0-conductor-conductor" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.150161 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ade246ff-09d5-4b25-a738-4733af58f79c" containerName="cinder-api" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.150169 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="8c67a3db-090c-4122-baa3-57a35abe4a77" containerName="object-updater" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.150182 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="a1b86673-6678-41ee-b073-f44c6d447fbc" containerName="keystone-api" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.150191 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="8c67a3db-090c-4122-baa3-57a35abe4a77" containerName="container-auditor" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.150211 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="830abb7b-cab5-4a21-9e39-6dc0c0faf74e" containerName="placement-api" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.150220 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c4f7000d-d4eb-4d8c-9fb8-f88d8304b970" containerName="neutron-httpd" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.150232 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="2018b64c-7208-4c67-b4ec-6e336ca72e94" containerName="glance-httpd" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.150243 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e491da9b-3bac-45f2-b9f5-41af945fe1eb" containerName="barbican-worker-log" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.176082 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-7gshq"] Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.176349 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-7gshq" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.179357 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"crc-storage\"/\"crc-storage-dockercfg-s2tht\"" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.179915 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"crc-storage\"" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.180222 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"openshift-service-ca.crt\"" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.182423 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"kube-root-ca.crt\"" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.309298 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/eeaf0d2c-3519-4817-93a0-17c97d12b1a8-node-mnt\") pod \"crc-storage-crc-7gshq\" (UID: \"eeaf0d2c-3519-4817-93a0-17c97d12b1a8\") " pod="crc-storage/crc-storage-crc-7gshq" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.309580 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqvx7\" (UniqueName: \"kubernetes.io/projected/eeaf0d2c-3519-4817-93a0-17c97d12b1a8-kube-api-access-dqvx7\") pod \"crc-storage-crc-7gshq\" (UID: \"eeaf0d2c-3519-4817-93a0-17c97d12b1a8\") " pod="crc-storage/crc-storage-crc-7gshq" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.309750 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/eeaf0d2c-3519-4817-93a0-17c97d12b1a8-crc-storage\") pod \"crc-storage-crc-7gshq\" (UID: \"eeaf0d2c-3519-4817-93a0-17c97d12b1a8\") " pod="crc-storage/crc-storage-crc-7gshq" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.411719 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/eeaf0d2c-3519-4817-93a0-17c97d12b1a8-node-mnt\") pod \"crc-storage-crc-7gshq\" (UID: \"eeaf0d2c-3519-4817-93a0-17c97d12b1a8\") " pod="crc-storage/crc-storage-crc-7gshq" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.411927 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dqvx7\" (UniqueName: \"kubernetes.io/projected/eeaf0d2c-3519-4817-93a0-17c97d12b1a8-kube-api-access-dqvx7\") pod \"crc-storage-crc-7gshq\" (UID: \"eeaf0d2c-3519-4817-93a0-17c97d12b1a8\") " pod="crc-storage/crc-storage-crc-7gshq" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.412011 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/eeaf0d2c-3519-4817-93a0-17c97d12b1a8-node-mnt\") pod \"crc-storage-crc-7gshq\" (UID: \"eeaf0d2c-3519-4817-93a0-17c97d12b1a8\") " pod="crc-storage/crc-storage-crc-7gshq" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.412072 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/eeaf0d2c-3519-4817-93a0-17c97d12b1a8-crc-storage\") pod \"crc-storage-crc-7gshq\" (UID: \"eeaf0d2c-3519-4817-93a0-17c97d12b1a8\") " pod="crc-storage/crc-storage-crc-7gshq" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.413897 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/eeaf0d2c-3519-4817-93a0-17c97d12b1a8-crc-storage\") pod \"crc-storage-crc-7gshq\" (UID: \"eeaf0d2c-3519-4817-93a0-17c97d12b1a8\") " pod="crc-storage/crc-storage-crc-7gshq" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.430879 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqvx7\" (UniqueName: \"kubernetes.io/projected/eeaf0d2c-3519-4817-93a0-17c97d12b1a8-kube-api-access-dqvx7\") pod \"crc-storage-crc-7gshq\" (UID: \"eeaf0d2c-3519-4817-93a0-17c97d12b1a8\") " pod="crc-storage/crc-storage-crc-7gshq" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.497070 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-7gshq" Mar 16 17:11:53 crc kubenswrapper[5120]: I0316 17:11:53.954613 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-7gshq"] Mar 16 17:11:54 crc kubenswrapper[5120]: I0316 17:11:54.385086 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-7gshq" event={"ID":"eeaf0d2c-3519-4817-93a0-17c97d12b1a8","Type":"ContainerStarted","Data":"a772113c1f9d2d9b689790ba3fc4f14d1f11400d464dcff3ff8e3262b207f1cd"} Mar 16 17:11:54 crc kubenswrapper[5120]: I0316 17:11:54.682807 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2951275c-5d51-4ae9-9641-0bd37442e8a1" path="/var/lib/kubelet/pods/2951275c-5d51-4ae9-9641-0bd37442e8a1/volumes" Mar 16 17:11:55 crc kubenswrapper[5120]: I0316 17:11:55.394571 5120 generic.go:358] "Generic (PLEG): container finished" podID="eeaf0d2c-3519-4817-93a0-17c97d12b1a8" containerID="dc58ff525e8f9a64ea0edf895c3a72965b20fec11d931193febb6ae201c3a62d" exitCode=0 Mar 16 17:11:55 crc kubenswrapper[5120]: I0316 17:11:55.394682 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-7gshq" event={"ID":"eeaf0d2c-3519-4817-93a0-17c97d12b1a8","Type":"ContainerDied","Data":"dc58ff525e8f9a64ea0edf895c3a72965b20fec11d931193febb6ae201c3a62d"} Mar 16 17:11:56 crc kubenswrapper[5120]: I0316 17:11:56.766968 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-7gshq" Mar 16 17:11:56 crc kubenswrapper[5120]: I0316 17:11:56.882978 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/eeaf0d2c-3519-4817-93a0-17c97d12b1a8-node-mnt\") pod \"eeaf0d2c-3519-4817-93a0-17c97d12b1a8\" (UID: \"eeaf0d2c-3519-4817-93a0-17c97d12b1a8\") " Mar 16 17:11:56 crc kubenswrapper[5120]: I0316 17:11:56.883082 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dqvx7\" (UniqueName: \"kubernetes.io/projected/eeaf0d2c-3519-4817-93a0-17c97d12b1a8-kube-api-access-dqvx7\") pod \"eeaf0d2c-3519-4817-93a0-17c97d12b1a8\" (UID: \"eeaf0d2c-3519-4817-93a0-17c97d12b1a8\") " Mar 16 17:11:56 crc kubenswrapper[5120]: I0316 17:11:56.883091 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/eeaf0d2c-3519-4817-93a0-17c97d12b1a8-node-mnt" (OuterVolumeSpecName: "node-mnt") pod "eeaf0d2c-3519-4817-93a0-17c97d12b1a8" (UID: "eeaf0d2c-3519-4817-93a0-17c97d12b1a8"). InnerVolumeSpecName "node-mnt". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 17:11:56 crc kubenswrapper[5120]: I0316 17:11:56.883266 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/eeaf0d2c-3519-4817-93a0-17c97d12b1a8-crc-storage\") pod \"eeaf0d2c-3519-4817-93a0-17c97d12b1a8\" (UID: \"eeaf0d2c-3519-4817-93a0-17c97d12b1a8\") " Mar 16 17:11:56 crc kubenswrapper[5120]: I0316 17:11:56.884133 5120 reconciler_common.go:299] "Volume detached for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/eeaf0d2c-3519-4817-93a0-17c97d12b1a8-node-mnt\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:56 crc kubenswrapper[5120]: I0316 17:11:56.889461 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eeaf0d2c-3519-4817-93a0-17c97d12b1a8-kube-api-access-dqvx7" (OuterVolumeSpecName: "kube-api-access-dqvx7") pod "eeaf0d2c-3519-4817-93a0-17c97d12b1a8" (UID: "eeaf0d2c-3519-4817-93a0-17c97d12b1a8"). InnerVolumeSpecName "kube-api-access-dqvx7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:11:56 crc kubenswrapper[5120]: I0316 17:11:56.903034 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eeaf0d2c-3519-4817-93a0-17c97d12b1a8-crc-storage" (OuterVolumeSpecName: "crc-storage") pod "eeaf0d2c-3519-4817-93a0-17c97d12b1a8" (UID: "eeaf0d2c-3519-4817-93a0-17c97d12b1a8"). InnerVolumeSpecName "crc-storage". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:11:56 crc kubenswrapper[5120]: I0316 17:11:56.986592 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dqvx7\" (UniqueName: \"kubernetes.io/projected/eeaf0d2c-3519-4817-93a0-17c97d12b1a8-kube-api-access-dqvx7\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:56 crc kubenswrapper[5120]: I0316 17:11:56.986645 5120 reconciler_common.go:299] "Volume detached for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/eeaf0d2c-3519-4817-93a0-17c97d12b1a8-crc-storage\") on node \"crc\" DevicePath \"\"" Mar 16 17:11:57 crc kubenswrapper[5120]: I0316 17:11:57.414265 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-7gshq" event={"ID":"eeaf0d2c-3519-4817-93a0-17c97d12b1a8","Type":"ContainerDied","Data":"a772113c1f9d2d9b689790ba3fc4f14d1f11400d464dcff3ff8e3262b207f1cd"} Mar 16 17:11:57 crc kubenswrapper[5120]: I0316 17:11:57.414311 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a772113c1f9d2d9b689790ba3fc4f14d1f11400d464dcff3ff8e3262b207f1cd" Mar 16 17:11:57 crc kubenswrapper[5120]: I0316 17:11:57.414279 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-7gshq" Mar 16 17:12:00 crc kubenswrapper[5120]: I0316 17:12:00.085247 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["crc-storage/crc-storage-crc-7gshq"] Mar 16 17:12:00 crc kubenswrapper[5120]: I0316 17:12:00.092934 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["crc-storage/crc-storage-crc-7gshq"] Mar 16 17:12:00 crc kubenswrapper[5120]: I0316 17:12:00.172135 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-infra/auto-csr-approver-29561352-8fhv4"] Mar 16 17:12:00 crc kubenswrapper[5120]: I0316 17:12:00.173040 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a997459-37ba-46a9-9cb8-075f77fa009f" containerName="nova-cell0-conductor-conductor" Mar 16 17:12:00 crc kubenswrapper[5120]: I0316 17:12:00.173055 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a997459-37ba-46a9-9cb8-075f77fa009f" containerName="nova-cell0-conductor-conductor" Mar 16 17:12:00 crc kubenswrapper[5120]: I0316 17:12:00.173080 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eeaf0d2c-3519-4817-93a0-17c97d12b1a8" containerName="storage" Mar 16 17:12:00 crc kubenswrapper[5120]: I0316 17:12:00.173087 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="eeaf0d2c-3519-4817-93a0-17c97d12b1a8" containerName="storage" Mar 16 17:12:00 crc kubenswrapper[5120]: I0316 17:12:00.173101 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32194c8a-90a1-4132-9b75-3882418d7f7d" containerName="nova-scheduler-scheduler" Mar 16 17:12:00 crc kubenswrapper[5120]: I0316 17:12:00.173107 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="32194c8a-90a1-4132-9b75-3882418d7f7d" containerName="nova-scheduler-scheduler" Mar 16 17:12:00 crc kubenswrapper[5120]: I0316 17:12:00.173117 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0852906-6351-45a9-a44c-0bf3f4c29496" containerName="nova-cell1-conductor-conductor" Mar 16 17:12:00 crc kubenswrapper[5120]: I0316 17:12:00.173125 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0852906-6351-45a9-a44c-0bf3f4c29496" containerName="nova-cell1-conductor-conductor" Mar 16 17:12:00 crc kubenswrapper[5120]: I0316 17:12:00.173137 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a997459-37ba-46a9-9cb8-075f77fa009f" containerName="nova-cell0-conductor-conductor" Mar 16 17:12:00 crc kubenswrapper[5120]: I0316 17:12:00.173144 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a997459-37ba-46a9-9cb8-075f77fa009f" containerName="nova-cell0-conductor-conductor" Mar 16 17:12:00 crc kubenswrapper[5120]: I0316 17:12:00.173285 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="9a997459-37ba-46a9-9cb8-075f77fa009f" containerName="nova-cell0-conductor-conductor" Mar 16 17:12:00 crc kubenswrapper[5120]: I0316 17:12:00.173302 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="32194c8a-90a1-4132-9b75-3882418d7f7d" containerName="nova-scheduler-scheduler" Mar 16 17:12:00 crc kubenswrapper[5120]: I0316 17:12:00.173314 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="32194c8a-90a1-4132-9b75-3882418d7f7d" containerName="nova-scheduler-scheduler" Mar 16 17:12:00 crc kubenswrapper[5120]: I0316 17:12:00.173329 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="eeaf0d2c-3519-4817-93a0-17c97d12b1a8" containerName="storage" Mar 16 17:12:00 crc kubenswrapper[5120]: I0316 17:12:00.177439 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561352-8fhv4" Mar 16 17:12:00 crc kubenswrapper[5120]: I0316 17:12:00.180082 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"kube-root-ca.crt\"" Mar 16 17:12:00 crc kubenswrapper[5120]: I0316 17:12:00.180151 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"openshift-service-ca.crt\"" Mar 16 17:12:00 crc kubenswrapper[5120]: I0316 17:12:00.182750 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561352-8fhv4"] Mar 16 17:12:00 crc kubenswrapper[5120]: I0316 17:12:00.185636 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-infra\"/\"csr-approver-sa-dockercfg-x2nsz\"" Mar 16 17:12:00 crc kubenswrapper[5120]: I0316 17:12:00.232420 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["crc-storage/crc-storage-crc-8gqms"] Mar 16 17:12:00 crc kubenswrapper[5120]: I0316 17:12:00.240827 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-8gqms" Mar 16 17:12:00 crc kubenswrapper[5120]: I0316 17:12:00.241957 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-8gqms"] Mar 16 17:12:00 crc kubenswrapper[5120]: I0316 17:12:00.244699 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"crc-storage\"/\"crc-storage-dockercfg-s2tht\"" Mar 16 17:12:00 crc kubenswrapper[5120]: I0316 17:12:00.244775 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"openshift-service-ca.crt\"" Mar 16 17:12:00 crc kubenswrapper[5120]: I0316 17:12:00.244916 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"kube-root-ca.crt\"" Mar 16 17:12:00 crc kubenswrapper[5120]: I0316 17:12:00.246834 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"crc-storage\"" Mar 16 17:12:00 crc kubenswrapper[5120]: I0316 17:12:00.255731 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ld6n9\" (UniqueName: \"kubernetes.io/projected/90a672ae-a2e9-4683-b159-6cc3ac6df4b4-kube-api-access-ld6n9\") pod \"auto-csr-approver-29561352-8fhv4\" (UID: \"90a672ae-a2e9-4683-b159-6cc3ac6df4b4\") " pod="openshift-infra/auto-csr-approver-29561352-8fhv4" Mar 16 17:12:00 crc kubenswrapper[5120]: I0316 17:12:00.358336 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ld6n9\" (UniqueName: \"kubernetes.io/projected/90a672ae-a2e9-4683-b159-6cc3ac6df4b4-kube-api-access-ld6n9\") pod \"auto-csr-approver-29561352-8fhv4\" (UID: \"90a672ae-a2e9-4683-b159-6cc3ac6df4b4\") " pod="openshift-infra/auto-csr-approver-29561352-8fhv4" Mar 16 17:12:00 crc kubenswrapper[5120]: I0316 17:12:00.358623 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wb7lh\" (UniqueName: \"kubernetes.io/projected/076ba57f-9d09-4123-957b-f756d2858434-kube-api-access-wb7lh\") pod \"crc-storage-crc-8gqms\" (UID: \"076ba57f-9d09-4123-957b-f756d2858434\") " pod="crc-storage/crc-storage-crc-8gqms" Mar 16 17:12:00 crc kubenswrapper[5120]: I0316 17:12:00.358906 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/076ba57f-9d09-4123-957b-f756d2858434-node-mnt\") pod \"crc-storage-crc-8gqms\" (UID: \"076ba57f-9d09-4123-957b-f756d2858434\") " pod="crc-storage/crc-storage-crc-8gqms" Mar 16 17:12:00 crc kubenswrapper[5120]: I0316 17:12:00.359323 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/076ba57f-9d09-4123-957b-f756d2858434-crc-storage\") pod \"crc-storage-crc-8gqms\" (UID: \"076ba57f-9d09-4123-957b-f756d2858434\") " pod="crc-storage/crc-storage-crc-8gqms" Mar 16 17:12:00 crc kubenswrapper[5120]: I0316 17:12:00.383256 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ld6n9\" (UniqueName: \"kubernetes.io/projected/90a672ae-a2e9-4683-b159-6cc3ac6df4b4-kube-api-access-ld6n9\") pod \"auto-csr-approver-29561352-8fhv4\" (UID: \"90a672ae-a2e9-4683-b159-6cc3ac6df4b4\") " pod="openshift-infra/auto-csr-approver-29561352-8fhv4" Mar 16 17:12:00 crc kubenswrapper[5120]: I0316 17:12:00.462263 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wb7lh\" (UniqueName: \"kubernetes.io/projected/076ba57f-9d09-4123-957b-f756d2858434-kube-api-access-wb7lh\") pod \"crc-storage-crc-8gqms\" (UID: \"076ba57f-9d09-4123-957b-f756d2858434\") " pod="crc-storage/crc-storage-crc-8gqms" Mar 16 17:12:00 crc kubenswrapper[5120]: I0316 17:12:00.462421 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/076ba57f-9d09-4123-957b-f756d2858434-node-mnt\") pod \"crc-storage-crc-8gqms\" (UID: \"076ba57f-9d09-4123-957b-f756d2858434\") " pod="crc-storage/crc-storage-crc-8gqms" Mar 16 17:12:00 crc kubenswrapper[5120]: I0316 17:12:00.462565 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/076ba57f-9d09-4123-957b-f756d2858434-crc-storage\") pod \"crc-storage-crc-8gqms\" (UID: \"076ba57f-9d09-4123-957b-f756d2858434\") " pod="crc-storage/crc-storage-crc-8gqms" Mar 16 17:12:00 crc kubenswrapper[5120]: I0316 17:12:00.463660 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/076ba57f-9d09-4123-957b-f756d2858434-node-mnt\") pod \"crc-storage-crc-8gqms\" (UID: \"076ba57f-9d09-4123-957b-f756d2858434\") " pod="crc-storage/crc-storage-crc-8gqms" Mar 16 17:12:00 crc kubenswrapper[5120]: I0316 17:12:00.464043 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/076ba57f-9d09-4123-957b-f756d2858434-crc-storage\") pod \"crc-storage-crc-8gqms\" (UID: \"076ba57f-9d09-4123-957b-f756d2858434\") " pod="crc-storage/crc-storage-crc-8gqms" Mar 16 17:12:00 crc kubenswrapper[5120]: I0316 17:12:00.481640 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wb7lh\" (UniqueName: \"kubernetes.io/projected/076ba57f-9d09-4123-957b-f756d2858434-kube-api-access-wb7lh\") pod \"crc-storage-crc-8gqms\" (UID: \"076ba57f-9d09-4123-957b-f756d2858434\") " pod="crc-storage/crc-storage-crc-8gqms" Mar 16 17:12:00 crc kubenswrapper[5120]: I0316 17:12:00.500640 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561352-8fhv4" Mar 16 17:12:00 crc kubenswrapper[5120]: I0316 17:12:00.556040 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-8gqms" Mar 16 17:12:00 crc kubenswrapper[5120]: I0316 17:12:00.678101 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eeaf0d2c-3519-4817-93a0-17c97d12b1a8" path="/var/lib/kubelet/pods/eeaf0d2c-3519-4817-93a0-17c97d12b1a8/volumes" Mar 16 17:12:00 crc kubenswrapper[5120]: I0316 17:12:00.837140 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-8gqms"] Mar 16 17:12:00 crc kubenswrapper[5120]: I0316 17:12:00.948813 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561352-8fhv4"] Mar 16 17:12:00 crc kubenswrapper[5120]: W0316 17:12:00.950094 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod90a672ae_a2e9_4683_b159_6cc3ac6df4b4.slice/crio-e0ce4024e82cb70e207c7526a080941f454d12819e829f0b68226beb7a668771 WatchSource:0}: Error finding container e0ce4024e82cb70e207c7526a080941f454d12819e829f0b68226beb7a668771: Status 404 returned error can't find the container with id e0ce4024e82cb70e207c7526a080941f454d12819e829f0b68226beb7a668771 Mar 16 17:12:01 crc kubenswrapper[5120]: I0316 17:12:01.448626 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561352-8fhv4" event={"ID":"90a672ae-a2e9-4683-b159-6cc3ac6df4b4","Type":"ContainerStarted","Data":"e0ce4024e82cb70e207c7526a080941f454d12819e829f0b68226beb7a668771"} Mar 16 17:12:01 crc kubenswrapper[5120]: I0316 17:12:01.450313 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-8gqms" event={"ID":"076ba57f-9d09-4123-957b-f756d2858434","Type":"ContainerStarted","Data":"114c01254e5a9c01d033f3f733d50b9d648e91846f1eebfe4b82c9f00736a3a1"} Mar 16 17:12:02 crc kubenswrapper[5120]: E0316 17:12:02.445086 5120 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod90a672ae_a2e9_4683_b159_6cc3ac6df4b4.slice/crio-conmon-cd2b5ef72fd2bb400ac948b2d6e054d128c94037c9f7d1ca2d8b360f1ab0d8e9.scope\": RecentStats: unable to find data in memory cache]" Mar 16 17:12:02 crc kubenswrapper[5120]: I0316 17:12:02.459516 5120 generic.go:358] "Generic (PLEG): container finished" podID="076ba57f-9d09-4123-957b-f756d2858434" containerID="a947c8afd45fa66fbd8df4075fde117b953cce66958b7fd25391f531cbbe8a10" exitCode=0 Mar 16 17:12:02 crc kubenswrapper[5120]: I0316 17:12:02.459597 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-8gqms" event={"ID":"076ba57f-9d09-4123-957b-f756d2858434","Type":"ContainerDied","Data":"a947c8afd45fa66fbd8df4075fde117b953cce66958b7fd25391f531cbbe8a10"} Mar 16 17:12:02 crc kubenswrapper[5120]: I0316 17:12:02.462500 5120 generic.go:358] "Generic (PLEG): container finished" podID="90a672ae-a2e9-4683-b159-6cc3ac6df4b4" containerID="cd2b5ef72fd2bb400ac948b2d6e054d128c94037c9f7d1ca2d8b360f1ab0d8e9" exitCode=0 Mar 16 17:12:02 crc kubenswrapper[5120]: I0316 17:12:02.462528 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561352-8fhv4" event={"ID":"90a672ae-a2e9-4683-b159-6cc3ac6df4b4","Type":"ContainerDied","Data":"cd2b5ef72fd2bb400ac948b2d6e054d128c94037c9f7d1ca2d8b360f1ab0d8e9"} Mar 16 17:12:03 crc kubenswrapper[5120]: I0316 17:12:03.817428 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561352-8fhv4" Mar 16 17:12:03 crc kubenswrapper[5120]: I0316 17:12:03.824175 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-8gqms" Mar 16 17:12:03 crc kubenswrapper[5120]: I0316 17:12:03.939305 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/076ba57f-9d09-4123-957b-f756d2858434-crc-storage\") pod \"076ba57f-9d09-4123-957b-f756d2858434\" (UID: \"076ba57f-9d09-4123-957b-f756d2858434\") " Mar 16 17:12:03 crc kubenswrapper[5120]: I0316 17:12:03.939535 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wb7lh\" (UniqueName: \"kubernetes.io/projected/076ba57f-9d09-4123-957b-f756d2858434-kube-api-access-wb7lh\") pod \"076ba57f-9d09-4123-957b-f756d2858434\" (UID: \"076ba57f-9d09-4123-957b-f756d2858434\") " Mar 16 17:12:03 crc kubenswrapper[5120]: I0316 17:12:03.940050 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ld6n9\" (UniqueName: \"kubernetes.io/projected/90a672ae-a2e9-4683-b159-6cc3ac6df4b4-kube-api-access-ld6n9\") pod \"90a672ae-a2e9-4683-b159-6cc3ac6df4b4\" (UID: \"90a672ae-a2e9-4683-b159-6cc3ac6df4b4\") " Mar 16 17:12:03 crc kubenswrapper[5120]: I0316 17:12:03.940337 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/076ba57f-9d09-4123-957b-f756d2858434-node-mnt\") pod \"076ba57f-9d09-4123-957b-f756d2858434\" (UID: \"076ba57f-9d09-4123-957b-f756d2858434\") " Mar 16 17:12:03 crc kubenswrapper[5120]: I0316 17:12:03.940480 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/076ba57f-9d09-4123-957b-f756d2858434-node-mnt" (OuterVolumeSpecName: "node-mnt") pod "076ba57f-9d09-4123-957b-f756d2858434" (UID: "076ba57f-9d09-4123-957b-f756d2858434"). InnerVolumeSpecName "node-mnt". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 17:12:03 crc kubenswrapper[5120]: I0316 17:12:03.941640 5120 reconciler_common.go:299] "Volume detached for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/076ba57f-9d09-4123-957b-f756d2858434-node-mnt\") on node \"crc\" DevicePath \"\"" Mar 16 17:12:03 crc kubenswrapper[5120]: I0316 17:12:03.946939 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90a672ae-a2e9-4683-b159-6cc3ac6df4b4-kube-api-access-ld6n9" (OuterVolumeSpecName: "kube-api-access-ld6n9") pod "90a672ae-a2e9-4683-b159-6cc3ac6df4b4" (UID: "90a672ae-a2e9-4683-b159-6cc3ac6df4b4"). InnerVolumeSpecName "kube-api-access-ld6n9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:12:03 crc kubenswrapper[5120]: I0316 17:12:03.948577 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/076ba57f-9d09-4123-957b-f756d2858434-kube-api-access-wb7lh" (OuterVolumeSpecName: "kube-api-access-wb7lh") pod "076ba57f-9d09-4123-957b-f756d2858434" (UID: "076ba57f-9d09-4123-957b-f756d2858434"). InnerVolumeSpecName "kube-api-access-wb7lh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:12:03 crc kubenswrapper[5120]: I0316 17:12:03.960395 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/076ba57f-9d09-4123-957b-f756d2858434-crc-storage" (OuterVolumeSpecName: "crc-storage") pod "076ba57f-9d09-4123-957b-f756d2858434" (UID: "076ba57f-9d09-4123-957b-f756d2858434"). InnerVolumeSpecName "crc-storage". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:12:04 crc kubenswrapper[5120]: I0316 17:12:04.043502 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ld6n9\" (UniqueName: \"kubernetes.io/projected/90a672ae-a2e9-4683-b159-6cc3ac6df4b4-kube-api-access-ld6n9\") on node \"crc\" DevicePath \"\"" Mar 16 17:12:04 crc kubenswrapper[5120]: I0316 17:12:04.043546 5120 reconciler_common.go:299] "Volume detached for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/076ba57f-9d09-4123-957b-f756d2858434-crc-storage\") on node \"crc\" DevicePath \"\"" Mar 16 17:12:04 crc kubenswrapper[5120]: I0316 17:12:04.043558 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wb7lh\" (UniqueName: \"kubernetes.io/projected/076ba57f-9d09-4123-957b-f756d2858434-kube-api-access-wb7lh\") on node \"crc\" DevicePath \"\"" Mar 16 17:12:04 crc kubenswrapper[5120]: I0316 17:12:04.477894 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-8gqms" Mar 16 17:12:04 crc kubenswrapper[5120]: I0316 17:12:04.477910 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-8gqms" event={"ID":"076ba57f-9d09-4123-957b-f756d2858434","Type":"ContainerDied","Data":"114c01254e5a9c01d033f3f733d50b9d648e91846f1eebfe4b82c9f00736a3a1"} Mar 16 17:12:04 crc kubenswrapper[5120]: I0316 17:12:04.477965 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="114c01254e5a9c01d033f3f733d50b9d648e91846f1eebfe4b82c9f00736a3a1" Mar 16 17:12:04 crc kubenswrapper[5120]: I0316 17:12:04.480034 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561352-8fhv4" Mar 16 17:12:04 crc kubenswrapper[5120]: I0316 17:12:04.480038 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561352-8fhv4" event={"ID":"90a672ae-a2e9-4683-b159-6cc3ac6df4b4","Type":"ContainerDied","Data":"e0ce4024e82cb70e207c7526a080941f454d12819e829f0b68226beb7a668771"} Mar 16 17:12:04 crc kubenswrapper[5120]: I0316 17:12:04.480148 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e0ce4024e82cb70e207c7526a080941f454d12819e829f0b68226beb7a668771" Mar 16 17:12:04 crc kubenswrapper[5120]: I0316 17:12:04.876312 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-infra/auto-csr-approver-29561346-4bglb"] Mar 16 17:12:04 crc kubenswrapper[5120]: I0316 17:12:04.883518 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-infra/auto-csr-approver-29561346-4bglb"] Mar 16 17:12:06 crc kubenswrapper[5120]: I0316 17:12:06.675457 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="25275544-fa2d-4ef6-9576-b49753a36b45" path="/var/lib/kubelet/pods/25275544-fa2d-4ef6-9576-b49753a36b45/volumes" Mar 16 17:12:07 crc kubenswrapper[5120]: E0316 17:12:07.608701 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1304880 actualBytes=10240 Mar 16 17:12:16 crc kubenswrapper[5120]: I0316 17:12:16.100950 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 17:12:16 crc kubenswrapper[5120]: I0316 17:12:16.102587 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="076ba57f-9d09-4123-957b-f756d2858434" containerName="storage" Mar 16 17:12:16 crc kubenswrapper[5120]: I0316 17:12:16.102606 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="076ba57f-9d09-4123-957b-f756d2858434" containerName="storage" Mar 16 17:12:16 crc kubenswrapper[5120]: I0316 17:12:16.102649 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90a672ae-a2e9-4683-b159-6cc3ac6df4b4" containerName="oc" Mar 16 17:12:16 crc kubenswrapper[5120]: I0316 17:12:16.102660 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="90a672ae-a2e9-4683-b159-6cc3ac6df4b4" containerName="oc" Mar 16 17:12:16 crc kubenswrapper[5120]: I0316 17:12:16.102837 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="90a672ae-a2e9-4683-b159-6cc3ac6df4b4" containerName="oc" Mar 16 17:12:16 crc kubenswrapper[5120]: I0316 17:12:16.102859 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="076ba57f-9d09-4123-957b-f756d2858434" containerName="storage" Mar 16 17:12:16 crc kubenswrapper[5120]: I0316 17:12:16.109215 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 17:12:16 crc kubenswrapper[5120]: I0316 17:12:16.114178 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-cell1-erlang-cookie\"" Mar 16 17:12:16 crc kubenswrapper[5120]: I0316 17:12:16.114450 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-cell1-config-data\"" Mar 16 17:12:16 crc kubenswrapper[5120]: I0316 17:12:16.114668 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-cell1-server-dockercfg-pqpdc\"" Mar 16 17:12:16 crc kubenswrapper[5120]: I0316 17:12:16.114863 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-cell1-plugins-conf\"" Mar 16 17:12:16 crc kubenswrapper[5120]: I0316 17:12:16.115062 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-cell1-server-conf\"" Mar 16 17:12:16 crc kubenswrapper[5120]: I0316 17:12:16.117510 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-cell1-default-user\"" Mar 16 17:12:16 crc kubenswrapper[5120]: I0316 17:12:16.117623 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-rabbitmq-cell1-svc\"" Mar 16 17:12:16 crc kubenswrapper[5120]: I0316 17:12:16.120033 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 17:12:16 crc kubenswrapper[5120]: I0316 17:12:16.193982 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4kbg\" (UniqueName: \"kubernetes.io/projected/d6906541-8dff-40ed-a064-5777f4b66f24-kube-api-access-w4kbg\") pod \"rabbitmq-cell1-server-0\" (UID: \"d6906541-8dff-40ed-a064-5777f4b66f24\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 17:12:16 crc kubenswrapper[5120]: I0316 17:12:16.194429 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/d6906541-8dff-40ed-a064-5777f4b66f24-plugins-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"d6906541-8dff-40ed-a064-5777f4b66f24\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 17:12:16 crc kubenswrapper[5120]: I0316 17:12:16.194512 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/d6906541-8dff-40ed-a064-5777f4b66f24-rabbitmq-tls\") pod \"rabbitmq-cell1-server-0\" (UID: \"d6906541-8dff-40ed-a064-5777f4b66f24\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 17:12:16 crc kubenswrapper[5120]: I0316 17:12:16.194572 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/d6906541-8dff-40ed-a064-5777f4b66f24-rabbitmq-plugins\") pod \"rabbitmq-cell1-server-0\" (UID: \"d6906541-8dff-40ed-a064-5777f4b66f24\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 17:12:16 crc kubenswrapper[5120]: I0316 17:12:16.194624 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/d6906541-8dff-40ed-a064-5777f4b66f24-pod-info\") pod \"rabbitmq-cell1-server-0\" (UID: \"d6906541-8dff-40ed-a064-5777f4b66f24\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 17:12:16 crc kubenswrapper[5120]: I0316 17:12:16.194665 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/d6906541-8dff-40ed-a064-5777f4b66f24-rabbitmq-confd\") pod \"rabbitmq-cell1-server-0\" (UID: \"d6906541-8dff-40ed-a064-5777f4b66f24\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 17:12:16 crc kubenswrapper[5120]: I0316 17:12:16.194693 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"d6906541-8dff-40ed-a064-5777f4b66f24\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 17:12:16 crc kubenswrapper[5120]: I0316 17:12:16.194788 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/d6906541-8dff-40ed-a064-5777f4b66f24-server-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"d6906541-8dff-40ed-a064-5777f4b66f24\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 17:12:16 crc kubenswrapper[5120]: I0316 17:12:16.194840 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/d6906541-8dff-40ed-a064-5777f4b66f24-rabbitmq-erlang-cookie\") pod \"rabbitmq-cell1-server-0\" (UID: \"d6906541-8dff-40ed-a064-5777f4b66f24\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 17:12:16 crc kubenswrapper[5120]: I0316 17:12:16.194902 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/d6906541-8dff-40ed-a064-5777f4b66f24-erlang-cookie-secret\") pod \"rabbitmq-cell1-server-0\" (UID: \"d6906541-8dff-40ed-a064-5777f4b66f24\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 17:12:16 crc kubenswrapper[5120]: I0316 17:12:16.195059 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/d6906541-8dff-40ed-a064-5777f4b66f24-config-data\") pod \"rabbitmq-cell1-server-0\" (UID: \"d6906541-8dff-40ed-a064-5777f4b66f24\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 17:12:16 crc kubenswrapper[5120]: I0316 17:12:16.296755 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/d6906541-8dff-40ed-a064-5777f4b66f24-config-data\") pod \"rabbitmq-cell1-server-0\" (UID: \"d6906541-8dff-40ed-a064-5777f4b66f24\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 17:12:16 crc kubenswrapper[5120]: I0316 17:12:16.296931 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w4kbg\" (UniqueName: \"kubernetes.io/projected/d6906541-8dff-40ed-a064-5777f4b66f24-kube-api-access-w4kbg\") pod \"rabbitmq-cell1-server-0\" (UID: \"d6906541-8dff-40ed-a064-5777f4b66f24\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 17:12:16 crc kubenswrapper[5120]: I0316 17:12:16.297013 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/d6906541-8dff-40ed-a064-5777f4b66f24-plugins-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"d6906541-8dff-40ed-a064-5777f4b66f24\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 17:12:16 crc kubenswrapper[5120]: I0316 17:12:16.297086 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/d6906541-8dff-40ed-a064-5777f4b66f24-rabbitmq-tls\") pod \"rabbitmq-cell1-server-0\" (UID: \"d6906541-8dff-40ed-a064-5777f4b66f24\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 17:12:16 crc kubenswrapper[5120]: I0316 17:12:16.297128 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/d6906541-8dff-40ed-a064-5777f4b66f24-rabbitmq-plugins\") pod \"rabbitmq-cell1-server-0\" (UID: \"d6906541-8dff-40ed-a064-5777f4b66f24\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 17:12:16 crc kubenswrapper[5120]: I0316 17:12:16.297184 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/d6906541-8dff-40ed-a064-5777f4b66f24-pod-info\") pod \"rabbitmq-cell1-server-0\" (UID: \"d6906541-8dff-40ed-a064-5777f4b66f24\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 17:12:16 crc kubenswrapper[5120]: I0316 17:12:16.297386 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/d6906541-8dff-40ed-a064-5777f4b66f24-rabbitmq-confd\") pod \"rabbitmq-cell1-server-0\" (UID: \"d6906541-8dff-40ed-a064-5777f4b66f24\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 17:12:16 crc kubenswrapper[5120]: I0316 17:12:16.297591 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/d6906541-8dff-40ed-a064-5777f4b66f24-rabbitmq-plugins\") pod \"rabbitmq-cell1-server-0\" (UID: \"d6906541-8dff-40ed-a064-5777f4b66f24\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 17:12:16 crc kubenswrapper[5120]: I0316 17:12:16.297956 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/d6906541-8dff-40ed-a064-5777f4b66f24-config-data\") pod \"rabbitmq-cell1-server-0\" (UID: \"d6906541-8dff-40ed-a064-5777f4b66f24\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 17:12:16 crc kubenswrapper[5120]: I0316 17:12:16.298423 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"d6906541-8dff-40ed-a064-5777f4b66f24\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 17:12:16 crc kubenswrapper[5120]: I0316 17:12:16.298500 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/d6906541-8dff-40ed-a064-5777f4b66f24-server-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"d6906541-8dff-40ed-a064-5777f4b66f24\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 17:12:16 crc kubenswrapper[5120]: I0316 17:12:16.298528 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/d6906541-8dff-40ed-a064-5777f4b66f24-plugins-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"d6906541-8dff-40ed-a064-5777f4b66f24\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 17:12:16 crc kubenswrapper[5120]: I0316 17:12:16.298557 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/d6906541-8dff-40ed-a064-5777f4b66f24-rabbitmq-erlang-cookie\") pod \"rabbitmq-cell1-server-0\" (UID: \"d6906541-8dff-40ed-a064-5777f4b66f24\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 17:12:16 crc kubenswrapper[5120]: I0316 17:12:16.298610 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/d6906541-8dff-40ed-a064-5777f4b66f24-erlang-cookie-secret\") pod \"rabbitmq-cell1-server-0\" (UID: \"d6906541-8dff-40ed-a064-5777f4b66f24\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 17:12:16 crc kubenswrapper[5120]: I0316 17:12:16.298718 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"d6906541-8dff-40ed-a064-5777f4b66f24\") device mount path \"/mnt/openstack/pv12\"" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 17:12:16 crc kubenswrapper[5120]: I0316 17:12:16.298998 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/d6906541-8dff-40ed-a064-5777f4b66f24-rabbitmq-erlang-cookie\") pod \"rabbitmq-cell1-server-0\" (UID: \"d6906541-8dff-40ed-a064-5777f4b66f24\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 17:12:16 crc kubenswrapper[5120]: I0316 17:12:16.300929 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/d6906541-8dff-40ed-a064-5777f4b66f24-server-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"d6906541-8dff-40ed-a064-5777f4b66f24\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 17:12:16 crc kubenswrapper[5120]: I0316 17:12:16.304906 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/d6906541-8dff-40ed-a064-5777f4b66f24-rabbitmq-confd\") pod \"rabbitmq-cell1-server-0\" (UID: \"d6906541-8dff-40ed-a064-5777f4b66f24\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 17:12:16 crc kubenswrapper[5120]: I0316 17:12:16.305217 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/d6906541-8dff-40ed-a064-5777f4b66f24-erlang-cookie-secret\") pod \"rabbitmq-cell1-server-0\" (UID: \"d6906541-8dff-40ed-a064-5777f4b66f24\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 17:12:16 crc kubenswrapper[5120]: I0316 17:12:16.305799 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/d6906541-8dff-40ed-a064-5777f4b66f24-pod-info\") pod \"rabbitmq-cell1-server-0\" (UID: \"d6906541-8dff-40ed-a064-5777f4b66f24\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 17:12:16 crc kubenswrapper[5120]: I0316 17:12:16.306139 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/d6906541-8dff-40ed-a064-5777f4b66f24-rabbitmq-tls\") pod \"rabbitmq-cell1-server-0\" (UID: \"d6906541-8dff-40ed-a064-5777f4b66f24\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 17:12:16 crc kubenswrapper[5120]: I0316 17:12:16.316962 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4kbg\" (UniqueName: \"kubernetes.io/projected/d6906541-8dff-40ed-a064-5777f4b66f24-kube-api-access-w4kbg\") pod \"rabbitmq-cell1-server-0\" (UID: \"d6906541-8dff-40ed-a064-5777f4b66f24\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 17:12:16 crc kubenswrapper[5120]: I0316 17:12:16.327519 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"d6906541-8dff-40ed-a064-5777f4b66f24\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 17:12:16 crc kubenswrapper[5120]: I0316 17:12:16.373554 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 17:12:16 crc kubenswrapper[5120]: I0316 17:12:16.381432 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 17:12:16 crc kubenswrapper[5120]: I0316 17:12:16.384226 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 17:12:16 crc kubenswrapper[5120]: I0316 17:12:16.384359 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-config-data\"" Mar 16 17:12:16 crc kubenswrapper[5120]: I0316 17:12:16.384450 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-rabbitmq-svc\"" Mar 16 17:12:16 crc kubenswrapper[5120]: I0316 17:12:16.384359 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-server-conf\"" Mar 16 17:12:16 crc kubenswrapper[5120]: I0316 17:12:16.385896 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-erlang-cookie\"" Mar 16 17:12:16 crc kubenswrapper[5120]: I0316 17:12:16.386252 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-default-user\"" Mar 16 17:12:16 crc kubenswrapper[5120]: I0316 17:12:16.386456 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-server-dockercfg-dhtdx\"" Mar 16 17:12:16 crc kubenswrapper[5120]: I0316 17:12:16.387167 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-plugins-conf\"" Mar 16 17:12:16 crc kubenswrapper[5120]: I0316 17:12:16.403591 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/dd339abc-691c-48f1-8674-430a5e806067-server-conf\") pod \"rabbitmq-server-0\" (UID: \"dd339abc-691c-48f1-8674-430a5e806067\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 17:12:16 crc kubenswrapper[5120]: I0316 17:12:16.403872 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/dd339abc-691c-48f1-8674-430a5e806067-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"dd339abc-691c-48f1-8674-430a5e806067\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 17:12:16 crc kubenswrapper[5120]: I0316 17:12:16.403949 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") pod \"rabbitmq-server-0\" (UID: \"dd339abc-691c-48f1-8674-430a5e806067\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 17:12:16 crc kubenswrapper[5120]: I0316 17:12:16.404007 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/dd339abc-691c-48f1-8674-430a5e806067-rabbitmq-tls\") pod \"rabbitmq-server-0\" (UID: \"dd339abc-691c-48f1-8674-430a5e806067\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 17:12:16 crc kubenswrapper[5120]: I0316 17:12:16.404123 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/dd339abc-691c-48f1-8674-430a5e806067-config-data\") pod \"rabbitmq-server-0\" (UID: \"dd339abc-691c-48f1-8674-430a5e806067\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 17:12:16 crc kubenswrapper[5120]: I0316 17:12:16.404214 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/dd339abc-691c-48f1-8674-430a5e806067-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"dd339abc-691c-48f1-8674-430a5e806067\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 17:12:16 crc kubenswrapper[5120]: I0316 17:12:16.404259 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/dd339abc-691c-48f1-8674-430a5e806067-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"dd339abc-691c-48f1-8674-430a5e806067\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 17:12:16 crc kubenswrapper[5120]: I0316 17:12:16.404490 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/dd339abc-691c-48f1-8674-430a5e806067-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"dd339abc-691c-48f1-8674-430a5e806067\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 17:12:16 crc kubenswrapper[5120]: I0316 17:12:16.404671 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/dd339abc-691c-48f1-8674-430a5e806067-pod-info\") pod \"rabbitmq-server-0\" (UID: \"dd339abc-691c-48f1-8674-430a5e806067\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 17:12:16 crc kubenswrapper[5120]: I0316 17:12:16.404776 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvrrf\" (UniqueName: \"kubernetes.io/projected/dd339abc-691c-48f1-8674-430a5e806067-kube-api-access-bvrrf\") pod \"rabbitmq-server-0\" (UID: \"dd339abc-691c-48f1-8674-430a5e806067\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 17:12:16 crc kubenswrapper[5120]: I0316 17:12:16.404879 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/dd339abc-691c-48f1-8674-430a5e806067-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"dd339abc-691c-48f1-8674-430a5e806067\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 17:12:16 crc kubenswrapper[5120]: I0316 17:12:16.430237 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 17:12:16 crc kubenswrapper[5120]: I0316 17:12:16.506930 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/dd339abc-691c-48f1-8674-430a5e806067-server-conf\") pod \"rabbitmq-server-0\" (UID: \"dd339abc-691c-48f1-8674-430a5e806067\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 17:12:16 crc kubenswrapper[5120]: I0316 17:12:16.507038 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/dd339abc-691c-48f1-8674-430a5e806067-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"dd339abc-691c-48f1-8674-430a5e806067\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 17:12:16 crc kubenswrapper[5120]: I0316 17:12:16.507065 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") pod \"rabbitmq-server-0\" (UID: \"dd339abc-691c-48f1-8674-430a5e806067\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 17:12:16 crc kubenswrapper[5120]: I0316 17:12:16.507098 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/dd339abc-691c-48f1-8674-430a5e806067-rabbitmq-tls\") pod \"rabbitmq-server-0\" (UID: \"dd339abc-691c-48f1-8674-430a5e806067\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 17:12:16 crc kubenswrapper[5120]: I0316 17:12:16.507158 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/dd339abc-691c-48f1-8674-430a5e806067-config-data\") pod \"rabbitmq-server-0\" (UID: \"dd339abc-691c-48f1-8674-430a5e806067\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 17:12:16 crc kubenswrapper[5120]: I0316 17:12:16.507196 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/dd339abc-691c-48f1-8674-430a5e806067-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"dd339abc-691c-48f1-8674-430a5e806067\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 17:12:16 crc kubenswrapper[5120]: I0316 17:12:16.507218 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/dd339abc-691c-48f1-8674-430a5e806067-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"dd339abc-691c-48f1-8674-430a5e806067\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 17:12:16 crc kubenswrapper[5120]: I0316 17:12:16.507412 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/dd339abc-691c-48f1-8674-430a5e806067-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"dd339abc-691c-48f1-8674-430a5e806067\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 17:12:16 crc kubenswrapper[5120]: I0316 17:12:16.507433 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") pod \"rabbitmq-server-0\" (UID: \"dd339abc-691c-48f1-8674-430a5e806067\") device mount path \"/mnt/openstack/pv14\"" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 17:12:16 crc kubenswrapper[5120]: I0316 17:12:16.508005 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/dd339abc-691c-48f1-8674-430a5e806067-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"dd339abc-691c-48f1-8674-430a5e806067\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 17:12:16 crc kubenswrapper[5120]: I0316 17:12:16.508088 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/dd339abc-691c-48f1-8674-430a5e806067-config-data\") pod \"rabbitmq-server-0\" (UID: \"dd339abc-691c-48f1-8674-430a5e806067\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 17:12:16 crc kubenswrapper[5120]: I0316 17:12:16.508184 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/dd339abc-691c-48f1-8674-430a5e806067-pod-info\") pod \"rabbitmq-server-0\" (UID: \"dd339abc-691c-48f1-8674-430a5e806067\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 17:12:16 crc kubenswrapper[5120]: I0316 17:12:16.508246 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bvrrf\" (UniqueName: \"kubernetes.io/projected/dd339abc-691c-48f1-8674-430a5e806067-kube-api-access-bvrrf\") pod \"rabbitmq-server-0\" (UID: \"dd339abc-691c-48f1-8674-430a5e806067\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 17:12:16 crc kubenswrapper[5120]: I0316 17:12:16.508339 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/dd339abc-691c-48f1-8674-430a5e806067-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"dd339abc-691c-48f1-8674-430a5e806067\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 17:12:16 crc kubenswrapper[5120]: I0316 17:12:16.508423 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/dd339abc-691c-48f1-8674-430a5e806067-server-conf\") pod \"rabbitmq-server-0\" (UID: \"dd339abc-691c-48f1-8674-430a5e806067\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 17:12:16 crc kubenswrapper[5120]: I0316 17:12:16.508779 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/dd339abc-691c-48f1-8674-430a5e806067-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"dd339abc-691c-48f1-8674-430a5e806067\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 17:12:16 crc kubenswrapper[5120]: I0316 17:12:16.508794 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/dd339abc-691c-48f1-8674-430a5e806067-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"dd339abc-691c-48f1-8674-430a5e806067\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 17:12:16 crc kubenswrapper[5120]: I0316 17:12:16.512776 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/dd339abc-691c-48f1-8674-430a5e806067-rabbitmq-tls\") pod \"rabbitmq-server-0\" (UID: \"dd339abc-691c-48f1-8674-430a5e806067\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 17:12:16 crc kubenswrapper[5120]: I0316 17:12:16.524591 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/dd339abc-691c-48f1-8674-430a5e806067-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"dd339abc-691c-48f1-8674-430a5e806067\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 17:12:16 crc kubenswrapper[5120]: I0316 17:12:16.524703 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/dd339abc-691c-48f1-8674-430a5e806067-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"dd339abc-691c-48f1-8674-430a5e806067\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 17:12:16 crc kubenswrapper[5120]: I0316 17:12:16.531524 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/dd339abc-691c-48f1-8674-430a5e806067-pod-info\") pod \"rabbitmq-server-0\" (UID: \"dd339abc-691c-48f1-8674-430a5e806067\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 17:12:16 crc kubenswrapper[5120]: I0316 17:12:16.534360 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvrrf\" (UniqueName: \"kubernetes.io/projected/dd339abc-691c-48f1-8674-430a5e806067-kube-api-access-bvrrf\") pod \"rabbitmq-server-0\" (UID: \"dd339abc-691c-48f1-8674-430a5e806067\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 17:12:16 crc kubenswrapper[5120]: I0316 17:12:16.540232 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") pod \"rabbitmq-server-0\" (UID: \"dd339abc-691c-48f1-8674-430a5e806067\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 17:12:16 crc kubenswrapper[5120]: I0316 17:12:16.710768 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 17:12:16 crc kubenswrapper[5120]: I0316 17:12:16.875419 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 17:12:17 crc kubenswrapper[5120]: I0316 17:12:17.204908 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 17:12:17 crc kubenswrapper[5120]: W0316 17:12:17.216381 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd339abc_691c_48f1_8674_430a5e806067.slice/crio-d959ed38ae84e0af5bbfeadc05d16cc4aeb7c6c857885a7b5c5ecffdd37dc99f WatchSource:0}: Error finding container d959ed38ae84e0af5bbfeadc05d16cc4aeb7c6c857885a7b5c5ecffdd37dc99f: Status 404 returned error can't find the container with id d959ed38ae84e0af5bbfeadc05d16cc4aeb7c6c857885a7b5c5ecffdd37dc99f Mar 16 17:12:17 crc kubenswrapper[5120]: I0316 17:12:17.586878 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"dd339abc-691c-48f1-8674-430a5e806067","Type":"ContainerStarted","Data":"d959ed38ae84e0af5bbfeadc05d16cc4aeb7c6c857885a7b5c5ecffdd37dc99f"} Mar 16 17:12:17 crc kubenswrapper[5120]: I0316 17:12:17.588286 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"d6906541-8dff-40ed-a064-5777f4b66f24","Type":"ContainerStarted","Data":"cbeab40388fac0d305b9ba2e8abe4bea4504164b12174e2afcb2ca1892a147ca"} Mar 16 17:12:17 crc kubenswrapper[5120]: I0316 17:12:17.944347 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 17:12:17 crc kubenswrapper[5120]: I0316 17:12:17.950342 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:12:17 crc kubenswrapper[5120]: I0316 17:12:17.953743 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-galera-openstack-svc\"" Mar 16 17:12:17 crc kubenswrapper[5120]: I0316 17:12:17.954063 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-config-data\"" Mar 16 17:12:17 crc kubenswrapper[5120]: I0316 17:12:17.954174 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"galera-openstack-dockercfg-hhd8c\"" Mar 16 17:12:17 crc kubenswrapper[5120]: I0316 17:12:17.954723 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-scripts\"" Mar 16 17:12:17 crc kubenswrapper[5120]: I0316 17:12:17.956483 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 17:12:17 crc kubenswrapper[5120]: I0316 17:12:17.962429 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"combined-ca-bundle\"" Mar 16 17:12:18 crc kubenswrapper[5120]: I0316 17:12:18.041046 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/0498c744-8606-4b08-b69f-28f80006c19c-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"0498c744-8606-4b08-b69f-28f80006c19c\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:12:18 crc kubenswrapper[5120]: I0316 17:12:18.041387 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"openstack-galera-0\" (UID: \"0498c744-8606-4b08-b69f-28f80006c19c\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:12:18 crc kubenswrapper[5120]: I0316 17:12:18.041434 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/0498c744-8606-4b08-b69f-28f80006c19c-kolla-config\") pod \"openstack-galera-0\" (UID: \"0498c744-8606-4b08-b69f-28f80006c19c\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:12:18 crc kubenswrapper[5120]: I0316 17:12:18.041574 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/0498c744-8606-4b08-b69f-28f80006c19c-config-data-default\") pod \"openstack-galera-0\" (UID: \"0498c744-8606-4b08-b69f-28f80006c19c\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:12:18 crc kubenswrapper[5120]: I0316 17:12:18.041620 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0498c744-8606-4b08-b69f-28f80006c19c-operator-scripts\") pod \"openstack-galera-0\" (UID: \"0498c744-8606-4b08-b69f-28f80006c19c\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:12:18 crc kubenswrapper[5120]: I0316 17:12:18.041784 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77lkb\" (UniqueName: \"kubernetes.io/projected/0498c744-8606-4b08-b69f-28f80006c19c-kube-api-access-77lkb\") pod \"openstack-galera-0\" (UID: \"0498c744-8606-4b08-b69f-28f80006c19c\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:12:18 crc kubenswrapper[5120]: I0316 17:12:18.041861 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0498c744-8606-4b08-b69f-28f80006c19c-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"0498c744-8606-4b08-b69f-28f80006c19c\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:12:18 crc kubenswrapper[5120]: I0316 17:12:18.041945 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/0498c744-8606-4b08-b69f-28f80006c19c-config-data-generated\") pod \"openstack-galera-0\" (UID: \"0498c744-8606-4b08-b69f-28f80006c19c\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:12:18 crc kubenswrapper[5120]: I0316 17:12:18.143637 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-77lkb\" (UniqueName: \"kubernetes.io/projected/0498c744-8606-4b08-b69f-28f80006c19c-kube-api-access-77lkb\") pod \"openstack-galera-0\" (UID: \"0498c744-8606-4b08-b69f-28f80006c19c\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:12:18 crc kubenswrapper[5120]: I0316 17:12:18.143691 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0498c744-8606-4b08-b69f-28f80006c19c-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"0498c744-8606-4b08-b69f-28f80006c19c\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:12:18 crc kubenswrapper[5120]: I0316 17:12:18.143743 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/0498c744-8606-4b08-b69f-28f80006c19c-config-data-generated\") pod \"openstack-galera-0\" (UID: \"0498c744-8606-4b08-b69f-28f80006c19c\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:12:18 crc kubenswrapper[5120]: I0316 17:12:18.143836 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/0498c744-8606-4b08-b69f-28f80006c19c-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"0498c744-8606-4b08-b69f-28f80006c19c\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:12:18 crc kubenswrapper[5120]: I0316 17:12:18.143998 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"openstack-galera-0\" (UID: \"0498c744-8606-4b08-b69f-28f80006c19c\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:12:18 crc kubenswrapper[5120]: I0316 17:12:18.144028 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/0498c744-8606-4b08-b69f-28f80006c19c-kolla-config\") pod \"openstack-galera-0\" (UID: \"0498c744-8606-4b08-b69f-28f80006c19c\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:12:18 crc kubenswrapper[5120]: I0316 17:12:18.144122 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/0498c744-8606-4b08-b69f-28f80006c19c-config-data-default\") pod \"openstack-galera-0\" (UID: \"0498c744-8606-4b08-b69f-28f80006c19c\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:12:18 crc kubenswrapper[5120]: I0316 17:12:18.144171 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0498c744-8606-4b08-b69f-28f80006c19c-operator-scripts\") pod \"openstack-galera-0\" (UID: \"0498c744-8606-4b08-b69f-28f80006c19c\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:12:18 crc kubenswrapper[5120]: I0316 17:12:18.144349 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"openstack-galera-0\" (UID: \"0498c744-8606-4b08-b69f-28f80006c19c\") device mount path \"/mnt/openstack/pv03\"" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:12:18 crc kubenswrapper[5120]: I0316 17:12:18.144409 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/0498c744-8606-4b08-b69f-28f80006c19c-config-data-generated\") pod \"openstack-galera-0\" (UID: \"0498c744-8606-4b08-b69f-28f80006c19c\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:12:18 crc kubenswrapper[5120]: I0316 17:12:18.144893 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/0498c744-8606-4b08-b69f-28f80006c19c-kolla-config\") pod \"openstack-galera-0\" (UID: \"0498c744-8606-4b08-b69f-28f80006c19c\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:12:18 crc kubenswrapper[5120]: I0316 17:12:18.145194 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/0498c744-8606-4b08-b69f-28f80006c19c-config-data-default\") pod \"openstack-galera-0\" (UID: \"0498c744-8606-4b08-b69f-28f80006c19c\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:12:18 crc kubenswrapper[5120]: I0316 17:12:18.145866 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0498c744-8606-4b08-b69f-28f80006c19c-operator-scripts\") pod \"openstack-galera-0\" (UID: \"0498c744-8606-4b08-b69f-28f80006c19c\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:12:18 crc kubenswrapper[5120]: I0316 17:12:18.151487 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/0498c744-8606-4b08-b69f-28f80006c19c-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"0498c744-8606-4b08-b69f-28f80006c19c\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:12:18 crc kubenswrapper[5120]: I0316 17:12:18.152049 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0498c744-8606-4b08-b69f-28f80006c19c-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"0498c744-8606-4b08-b69f-28f80006c19c\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:12:18 crc kubenswrapper[5120]: I0316 17:12:18.166256 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"openstack-galera-0\" (UID: \"0498c744-8606-4b08-b69f-28f80006c19c\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:12:18 crc kubenswrapper[5120]: I0316 17:12:18.166667 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-77lkb\" (UniqueName: \"kubernetes.io/projected/0498c744-8606-4b08-b69f-28f80006c19c-kube-api-access-77lkb\") pod \"openstack-galera-0\" (UID: \"0498c744-8606-4b08-b69f-28f80006c19c\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:12:18 crc kubenswrapper[5120]: I0316 17:12:18.270033 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:12:18 crc kubenswrapper[5120]: I0316 17:12:18.597075 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"dd339abc-691c-48f1-8674-430a5e806067","Type":"ContainerStarted","Data":"21c1f1009dd9301611e2a8c92eba97428d8b4eb942531017355ecebe87b77211"} Mar 16 17:12:18 crc kubenswrapper[5120]: I0316 17:12:18.598953 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"d6906541-8dff-40ed-a064-5777f4b66f24","Type":"ContainerStarted","Data":"48641c4ff11ddd43749ffe7662326076906b73bc16bab3455ff38bcd51f91ee9"} Mar 16 17:12:18 crc kubenswrapper[5120]: I0316 17:12:18.749681 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 17:12:19 crc kubenswrapper[5120]: I0316 17:12:19.104196 5120 scope.go:117] "RemoveContainer" containerID="e413c1b55f2d515ac2346254787e44bdb69ed1697dd63457ce33161c739d4b85" Mar 16 17:12:19 crc kubenswrapper[5120]: I0316 17:12:19.124636 5120 scope.go:117] "RemoveContainer" containerID="7f035182fc6202822643fd7fab4de5ea1ef2278ad874bffd7ecb67dcd27073c6" Mar 16 17:12:19 crc kubenswrapper[5120]: I0316 17:12:19.148703 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 17:12:19 crc kubenswrapper[5120]: I0316 17:12:19.165067 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:12:19 crc kubenswrapper[5120]: I0316 17:12:19.167871 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 17:12:19 crc kubenswrapper[5120]: I0316 17:12:19.173775 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"galera-openstack-cell1-dockercfg-rw2hj\"" Mar 16 17:12:19 crc kubenswrapper[5120]: I0316 17:12:19.173984 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-cell1-scripts\"" Mar 16 17:12:19 crc kubenswrapper[5120]: I0316 17:12:19.174226 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-cell1-config-data\"" Mar 16 17:12:19 crc kubenswrapper[5120]: I0316 17:12:19.174481 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-galera-openstack-cell1-svc\"" Mar 16 17:12:19 crc kubenswrapper[5120]: I0316 17:12:19.218942 5120 scope.go:117] "RemoveContainer" containerID="e53bfce3ac613f9572f3e64cff3234a3817a5ff8e5a3e56d3ca329d2a482bbe5" Mar 16 17:12:19 crc kubenswrapper[5120]: I0316 17:12:19.239912 5120 scope.go:117] "RemoveContainer" containerID="33661e25e8fa4b583a11c440c5312f2c3e50e752530fcc9b7fd8fcd89222eb0b" Mar 16 17:12:19 crc kubenswrapper[5120]: I0316 17:12:19.269271 5120 scope.go:117] "RemoveContainer" containerID="24729fcf1c0b649ba0cab170d265c4eeac4f015a4ef24e096631af5caa5bfe96" Mar 16 17:12:19 crc kubenswrapper[5120]: I0316 17:12:19.369663 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2dd828c2-16f2-4e69-b0b8-b953caf55f5b-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"2dd828c2-16f2-4e69-b0b8-b953caf55f5b\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:12:19 crc kubenswrapper[5120]: I0316 17:12:19.369718 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"openstack-cell1-galera-0\" (UID: \"2dd828c2-16f2-4e69-b0b8-b953caf55f5b\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:12:19 crc kubenswrapper[5120]: I0316 17:12:19.369738 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2dd828c2-16f2-4e69-b0b8-b953caf55f5b-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"2dd828c2-16f2-4e69-b0b8-b953caf55f5b\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:12:19 crc kubenswrapper[5120]: I0316 17:12:19.369774 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/2dd828c2-16f2-4e69-b0b8-b953caf55f5b-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"2dd828c2-16f2-4e69-b0b8-b953caf55f5b\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:12:19 crc kubenswrapper[5120]: I0316 17:12:19.370231 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/2dd828c2-16f2-4e69-b0b8-b953caf55f5b-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"2dd828c2-16f2-4e69-b0b8-b953caf55f5b\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:12:19 crc kubenswrapper[5120]: I0316 17:12:19.370298 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dnk5r\" (UniqueName: \"kubernetes.io/projected/2dd828c2-16f2-4e69-b0b8-b953caf55f5b-kube-api-access-dnk5r\") pod \"openstack-cell1-galera-0\" (UID: \"2dd828c2-16f2-4e69-b0b8-b953caf55f5b\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:12:19 crc kubenswrapper[5120]: I0316 17:12:19.370327 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/2dd828c2-16f2-4e69-b0b8-b953caf55f5b-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"2dd828c2-16f2-4e69-b0b8-b953caf55f5b\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:12:19 crc kubenswrapper[5120]: I0316 17:12:19.370441 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/2dd828c2-16f2-4e69-b0b8-b953caf55f5b-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"2dd828c2-16f2-4e69-b0b8-b953caf55f5b\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:12:19 crc kubenswrapper[5120]: I0316 17:12:19.381016 5120 scope.go:117] "RemoveContainer" containerID="000ae778638d01c693ec8a876b371b0f252038361297203e5b7cc7879f7671d2" Mar 16 17:12:19 crc kubenswrapper[5120]: I0316 17:12:19.411367 5120 scope.go:117] "RemoveContainer" containerID="be187fbdf2eeb50bf613fe5d86b6fd66dc403572e0f21c95382351f0b9dd6cff" Mar 16 17:12:19 crc kubenswrapper[5120]: I0316 17:12:19.446930 5120 scope.go:117] "RemoveContainer" containerID="c83720f0ab64d168c7d63f2774354f82ea2dabb1d007a18740bbdcf618972697" Mar 16 17:12:19 crc kubenswrapper[5120]: I0316 17:12:19.465350 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 17:12:19 crc kubenswrapper[5120]: I0316 17:12:19.472495 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/2dd828c2-16f2-4e69-b0b8-b953caf55f5b-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"2dd828c2-16f2-4e69-b0b8-b953caf55f5b\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:12:19 crc kubenswrapper[5120]: I0316 17:12:19.472596 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2dd828c2-16f2-4e69-b0b8-b953caf55f5b-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"2dd828c2-16f2-4e69-b0b8-b953caf55f5b\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:12:19 crc kubenswrapper[5120]: I0316 17:12:19.472638 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"openstack-cell1-galera-0\" (UID: \"2dd828c2-16f2-4e69-b0b8-b953caf55f5b\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:12:19 crc kubenswrapper[5120]: I0316 17:12:19.472669 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2dd828c2-16f2-4e69-b0b8-b953caf55f5b-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"2dd828c2-16f2-4e69-b0b8-b953caf55f5b\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:12:19 crc kubenswrapper[5120]: I0316 17:12:19.472708 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/2dd828c2-16f2-4e69-b0b8-b953caf55f5b-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"2dd828c2-16f2-4e69-b0b8-b953caf55f5b\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:12:19 crc kubenswrapper[5120]: I0316 17:12:19.472910 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/2dd828c2-16f2-4e69-b0b8-b953caf55f5b-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"2dd828c2-16f2-4e69-b0b8-b953caf55f5b\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:12:19 crc kubenswrapper[5120]: I0316 17:12:19.473000 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dnk5r\" (UniqueName: \"kubernetes.io/projected/2dd828c2-16f2-4e69-b0b8-b953caf55f5b-kube-api-access-dnk5r\") pod \"openstack-cell1-galera-0\" (UID: \"2dd828c2-16f2-4e69-b0b8-b953caf55f5b\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:12:19 crc kubenswrapper[5120]: I0316 17:12:19.473047 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/2dd828c2-16f2-4e69-b0b8-b953caf55f5b-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"2dd828c2-16f2-4e69-b0b8-b953caf55f5b\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:12:19 crc kubenswrapper[5120]: I0316 17:12:19.473782 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"openstack-cell1-galera-0\" (UID: \"2dd828c2-16f2-4e69-b0b8-b953caf55f5b\") device mount path \"/mnt/openstack/pv13\"" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:12:19 crc kubenswrapper[5120]: I0316 17:12:19.473831 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/2dd828c2-16f2-4e69-b0b8-b953caf55f5b-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"2dd828c2-16f2-4e69-b0b8-b953caf55f5b\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:12:19 crc kubenswrapper[5120]: I0316 17:12:19.474671 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/2dd828c2-16f2-4e69-b0b8-b953caf55f5b-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"2dd828c2-16f2-4e69-b0b8-b953caf55f5b\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:12:19 crc kubenswrapper[5120]: I0316 17:12:19.476974 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2dd828c2-16f2-4e69-b0b8-b953caf55f5b-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"2dd828c2-16f2-4e69-b0b8-b953caf55f5b\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:12:19 crc kubenswrapper[5120]: I0316 17:12:19.483141 5120 scope.go:117] "RemoveContainer" containerID="cb5b099e8c1325832f7d541bdef7d9c5ee362bf6d7ee63b77d215da30a14184e" Mar 16 17:12:19 crc kubenswrapper[5120]: I0316 17:12:19.487413 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2dd828c2-16f2-4e69-b0b8-b953caf55f5b-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"2dd828c2-16f2-4e69-b0b8-b953caf55f5b\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:12:19 crc kubenswrapper[5120]: I0316 17:12:19.491557 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/2dd828c2-16f2-4e69-b0b8-b953caf55f5b-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"2dd828c2-16f2-4e69-b0b8-b953caf55f5b\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:12:19 crc kubenswrapper[5120]: I0316 17:12:19.500647 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 17:12:19 crc kubenswrapper[5120]: I0316 17:12:19.501390 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/2dd828c2-16f2-4e69-b0b8-b953caf55f5b-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"2dd828c2-16f2-4e69-b0b8-b953caf55f5b\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:12:19 crc kubenswrapper[5120]: I0316 17:12:19.501872 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Mar 16 17:12:19 crc kubenswrapper[5120]: I0316 17:12:19.505089 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"memcached-memcached-dockercfg-9nkdl\"" Mar 16 17:12:19 crc kubenswrapper[5120]: I0316 17:12:19.505303 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"memcached-config-data\"" Mar 16 17:12:19 crc kubenswrapper[5120]: I0316 17:12:19.515262 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-memcached-svc\"" Mar 16 17:12:19 crc kubenswrapper[5120]: I0316 17:12:19.515369 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnk5r\" (UniqueName: \"kubernetes.io/projected/2dd828c2-16f2-4e69-b0b8-b953caf55f5b-kube-api-access-dnk5r\") pod \"openstack-cell1-galera-0\" (UID: \"2dd828c2-16f2-4e69-b0b8-b953caf55f5b\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:12:19 crc kubenswrapper[5120]: I0316 17:12:19.530638 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"openstack-cell1-galera-0\" (UID: \"2dd828c2-16f2-4e69-b0b8-b953caf55f5b\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:12:19 crc kubenswrapper[5120]: I0316 17:12:19.562232 5120 scope.go:117] "RemoveContainer" containerID="fa7c30386291cba51b9496e8301950e602444d271cb3d2ecf3d99150f08f1253" Mar 16 17:12:19 crc kubenswrapper[5120]: I0316 17:12:19.574508 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7f4ab831-1080-4b30-9b89-ddbd4d26bbb8-combined-ca-bundle\") pod \"memcached-0\" (UID: \"7f4ab831-1080-4b30-9b89-ddbd4d26bbb8\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 17:12:19 crc kubenswrapper[5120]: I0316 17:12:19.574595 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/7f4ab831-1080-4b30-9b89-ddbd4d26bbb8-config-data\") pod \"memcached-0\" (UID: \"7f4ab831-1080-4b30-9b89-ddbd4d26bbb8\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 17:12:19 crc kubenswrapper[5120]: I0316 17:12:19.574634 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/7f4ab831-1080-4b30-9b89-ddbd4d26bbb8-memcached-tls-certs\") pod \"memcached-0\" (UID: \"7f4ab831-1080-4b30-9b89-ddbd4d26bbb8\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 17:12:19 crc kubenswrapper[5120]: I0316 17:12:19.574685 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/7f4ab831-1080-4b30-9b89-ddbd4d26bbb8-kolla-config\") pod \"memcached-0\" (UID: \"7f4ab831-1080-4b30-9b89-ddbd4d26bbb8\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 17:12:19 crc kubenswrapper[5120]: I0316 17:12:19.574795 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwzpt\" (UniqueName: \"kubernetes.io/projected/7f4ab831-1080-4b30-9b89-ddbd4d26bbb8-kube-api-access-hwzpt\") pod \"memcached-0\" (UID: \"7f4ab831-1080-4b30-9b89-ddbd4d26bbb8\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 17:12:19 crc kubenswrapper[5120]: I0316 17:12:19.582844 5120 scope.go:117] "RemoveContainer" containerID="cbd76d8c28f83ef8bd43cd5bd6f08ee3a70f86373be2df33f85e4b2f6e009395" Mar 16 17:12:19 crc kubenswrapper[5120]: I0316 17:12:19.613004 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"0498c744-8606-4b08-b69f-28f80006c19c","Type":"ContainerStarted","Data":"1a3889ae28037fad7300c641e3e8acf006fc67c82e9ff4510500aa48074b4fee"} Mar 16 17:12:19 crc kubenswrapper[5120]: I0316 17:12:19.613067 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"0498c744-8606-4b08-b69f-28f80006c19c","Type":"ContainerStarted","Data":"f4b536147d4a29212b10471b1f6034ab3859f154607548e5494d9f735138c38d"} Mar 16 17:12:19 crc kubenswrapper[5120]: I0316 17:12:19.677587 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hwzpt\" (UniqueName: \"kubernetes.io/projected/7f4ab831-1080-4b30-9b89-ddbd4d26bbb8-kube-api-access-hwzpt\") pod \"memcached-0\" (UID: \"7f4ab831-1080-4b30-9b89-ddbd4d26bbb8\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 17:12:19 crc kubenswrapper[5120]: I0316 17:12:19.677942 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7f4ab831-1080-4b30-9b89-ddbd4d26bbb8-combined-ca-bundle\") pod \"memcached-0\" (UID: \"7f4ab831-1080-4b30-9b89-ddbd4d26bbb8\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 17:12:19 crc kubenswrapper[5120]: I0316 17:12:19.678114 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/7f4ab831-1080-4b30-9b89-ddbd4d26bbb8-config-data\") pod \"memcached-0\" (UID: \"7f4ab831-1080-4b30-9b89-ddbd4d26bbb8\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 17:12:19 crc kubenswrapper[5120]: I0316 17:12:19.678190 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/7f4ab831-1080-4b30-9b89-ddbd4d26bbb8-memcached-tls-certs\") pod \"memcached-0\" (UID: \"7f4ab831-1080-4b30-9b89-ddbd4d26bbb8\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 17:12:19 crc kubenswrapper[5120]: I0316 17:12:19.678288 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/7f4ab831-1080-4b30-9b89-ddbd4d26bbb8-kolla-config\") pod \"memcached-0\" (UID: \"7f4ab831-1080-4b30-9b89-ddbd4d26bbb8\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 17:12:19 crc kubenswrapper[5120]: I0316 17:12:19.679317 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/7f4ab831-1080-4b30-9b89-ddbd4d26bbb8-config-data\") pod \"memcached-0\" (UID: \"7f4ab831-1080-4b30-9b89-ddbd4d26bbb8\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 17:12:19 crc kubenswrapper[5120]: I0316 17:12:19.679617 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/7f4ab831-1080-4b30-9b89-ddbd4d26bbb8-kolla-config\") pod \"memcached-0\" (UID: \"7f4ab831-1080-4b30-9b89-ddbd4d26bbb8\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 17:12:19 crc kubenswrapper[5120]: I0316 17:12:19.690887 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/7f4ab831-1080-4b30-9b89-ddbd4d26bbb8-memcached-tls-certs\") pod \"memcached-0\" (UID: \"7f4ab831-1080-4b30-9b89-ddbd4d26bbb8\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 17:12:19 crc kubenswrapper[5120]: I0316 17:12:19.691078 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7f4ab831-1080-4b30-9b89-ddbd4d26bbb8-combined-ca-bundle\") pod \"memcached-0\" (UID: \"7f4ab831-1080-4b30-9b89-ddbd4d26bbb8\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 17:12:19 crc kubenswrapper[5120]: I0316 17:12:19.694720 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwzpt\" (UniqueName: \"kubernetes.io/projected/7f4ab831-1080-4b30-9b89-ddbd4d26bbb8-kube-api-access-hwzpt\") pod \"memcached-0\" (UID: \"7f4ab831-1080-4b30-9b89-ddbd4d26bbb8\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 17:12:19 crc kubenswrapper[5120]: I0316 17:12:19.786018 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:12:19 crc kubenswrapper[5120]: I0316 17:12:19.856137 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Mar 16 17:12:20 crc kubenswrapper[5120]: I0316 17:12:20.225445 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 17:12:20 crc kubenswrapper[5120]: I0316 17:12:20.322731 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 17:12:20 crc kubenswrapper[5120]: W0316 17:12:20.335968 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7f4ab831_1080_4b30_9b89_ddbd4d26bbb8.slice/crio-406371fd7248482b0c22f1be1888e141c6b7344ae3689d597a29bf885b43cb82 WatchSource:0}: Error finding container 406371fd7248482b0c22f1be1888e141c6b7344ae3689d597a29bf885b43cb82: Status 404 returned error can't find the container with id 406371fd7248482b0c22f1be1888e141c6b7344ae3689d597a29bf885b43cb82 Mar 16 17:12:20 crc kubenswrapper[5120]: I0316 17:12:20.639634 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"2dd828c2-16f2-4e69-b0b8-b953caf55f5b","Type":"ContainerStarted","Data":"3495744f601efe22901562bde3119b73cb250c8c0a894ebd85622b20fa7092a1"} Mar 16 17:12:20 crc kubenswrapper[5120]: I0316 17:12:20.639698 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"2dd828c2-16f2-4e69-b0b8-b953caf55f5b","Type":"ContainerStarted","Data":"10ef085caf240b4813c9b78ccb1d94edb6d1e49922d1883eda5da1a4a5e93e79"} Mar 16 17:12:20 crc kubenswrapper[5120]: I0316 17:12:20.641101 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"7f4ab831-1080-4b30-9b89-ddbd4d26bbb8","Type":"ContainerStarted","Data":"0cb75cd76e83c805136be2430ae92ab9ce0b6d500c761635d50c613f87fa59b7"} Mar 16 17:12:20 crc kubenswrapper[5120]: I0316 17:12:20.641154 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"7f4ab831-1080-4b30-9b89-ddbd4d26bbb8","Type":"ContainerStarted","Data":"406371fd7248482b0c22f1be1888e141c6b7344ae3689d597a29bf885b43cb82"} Mar 16 17:12:20 crc kubenswrapper[5120]: I0316 17:12:20.641206 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/memcached-0" Mar 16 17:12:20 crc kubenswrapper[5120]: I0316 17:12:20.683784 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/memcached-0" podStartSLOduration=1.683746387 podStartE2EDuration="1.683746387s" podCreationTimestamp="2026-03-16 17:12:19 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:12:20.67910152 +0000 UTC m=+6042.833033167" watchObservedRunningTime="2026-03-16 17:12:20.683746387 +0000 UTC m=+6042.837678044" Mar 16 17:12:21 crc kubenswrapper[5120]: I0316 17:12:21.616586 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 17:12:21 crc kubenswrapper[5120]: I0316 17:12:21.634463 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 17:12:21 crc kubenswrapper[5120]: I0316 17:12:21.634603 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 17:12:21 crc kubenswrapper[5120]: I0316 17:12:21.649409 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"telemetry-ceilometer-dockercfg-dt5qs\"" Mar 16 17:12:21 crc kubenswrapper[5120]: I0316 17:12:21.729267 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmwsv\" (UniqueName: \"kubernetes.io/projected/f2cddf24-c7ff-483a-8dfc-2fbc8a61c968-kube-api-access-mmwsv\") pod \"kube-state-metrics-0\" (UID: \"f2cddf24-c7ff-483a-8dfc-2fbc8a61c968\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 17:12:21 crc kubenswrapper[5120]: I0316 17:12:21.832324 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mmwsv\" (UniqueName: \"kubernetes.io/projected/f2cddf24-c7ff-483a-8dfc-2fbc8a61c968-kube-api-access-mmwsv\") pod \"kube-state-metrics-0\" (UID: \"f2cddf24-c7ff-483a-8dfc-2fbc8a61c968\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 17:12:21 crc kubenswrapper[5120]: I0316 17:12:21.853028 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmwsv\" (UniqueName: \"kubernetes.io/projected/f2cddf24-c7ff-483a-8dfc-2fbc8a61c968-kube-api-access-mmwsv\") pod \"kube-state-metrics-0\" (UID: \"f2cddf24-c7ff-483a-8dfc-2fbc8a61c968\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 17:12:21 crc kubenswrapper[5120]: I0316 17:12:21.963480 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 17:12:22 crc kubenswrapper[5120]: I0316 17:12:22.455256 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 17:12:22 crc kubenswrapper[5120]: I0316 17:12:22.673234 5120 generic.go:358] "Generic (PLEG): container finished" podID="0498c744-8606-4b08-b69f-28f80006c19c" containerID="1a3889ae28037fad7300c641e3e8acf006fc67c82e9ff4510500aa48074b4fee" exitCode=0 Mar 16 17:12:22 crc kubenswrapper[5120]: I0316 17:12:22.673332 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"0498c744-8606-4b08-b69f-28f80006c19c","Type":"ContainerDied","Data":"1a3889ae28037fad7300c641e3e8acf006fc67c82e9ff4510500aa48074b4fee"} Mar 16 17:12:22 crc kubenswrapper[5120]: I0316 17:12:22.676654 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"f2cddf24-c7ff-483a-8dfc-2fbc8a61c968","Type":"ContainerStarted","Data":"990955eed31eca86506eaea5ed854f7fef7e6e0f6398d3220caeb02577fa392b"} Mar 16 17:12:23 crc kubenswrapper[5120]: I0316 17:12:23.684057 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"f2cddf24-c7ff-483a-8dfc-2fbc8a61c968","Type":"ContainerStarted","Data":"5b2e410bae915a8a4bf9227182de7c8109a1844cb29cedb3c29e10ed1045229b"} Mar 16 17:12:23 crc kubenswrapper[5120]: I0316 17:12:23.684365 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 17:12:23 crc kubenswrapper[5120]: I0316 17:12:23.688044 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"0498c744-8606-4b08-b69f-28f80006c19c","Type":"ContainerStarted","Data":"6b1f38a50b1d436dc0420e3d24bcc3505027e09db725d3244026d9aa3d1d44bd"} Mar 16 17:12:23 crc kubenswrapper[5120]: I0316 17:12:23.707967 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/kube-state-metrics-0" podStartSLOduration=2.337488741 podStartE2EDuration="2.707779102s" podCreationTimestamp="2026-03-16 17:12:21 +0000 UTC" firstStartedPulling="2026-03-16 17:12:22.456725964 +0000 UTC m=+6044.610657611" lastFinishedPulling="2026-03-16 17:12:22.827016315 +0000 UTC m=+6044.980947972" observedRunningTime="2026-03-16 17:12:23.69490686 +0000 UTC m=+6045.848838517" watchObservedRunningTime="2026-03-16 17:12:23.707779102 +0000 UTC m=+6045.861710759" Mar 16 17:12:23 crc kubenswrapper[5120]: I0316 17:12:23.720753 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstack-galera-0" podStartSLOduration=7.720730806 podStartE2EDuration="7.720730806s" podCreationTimestamp="2026-03-16 17:12:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:12:23.714995109 +0000 UTC m=+6045.868926786" watchObservedRunningTime="2026-03-16 17:12:23.720730806 +0000 UTC m=+6045.874662463" Mar 16 17:12:24 crc kubenswrapper[5120]: I0316 17:12:24.700109 5120 generic.go:358] "Generic (PLEG): container finished" podID="2dd828c2-16f2-4e69-b0b8-b953caf55f5b" containerID="3495744f601efe22901562bde3119b73cb250c8c0a894ebd85622b20fa7092a1" exitCode=0 Mar 16 17:12:24 crc kubenswrapper[5120]: I0316 17:12:24.700194 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"2dd828c2-16f2-4e69-b0b8-b953caf55f5b","Type":"ContainerDied","Data":"3495744f601efe22901562bde3119b73cb250c8c0a894ebd85622b20fa7092a1"} Mar 16 17:12:24 crc kubenswrapper[5120]: I0316 17:12:24.983116 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 17:12:25 crc kubenswrapper[5120]: I0316 17:12:25.014982 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 17:12:25 crc kubenswrapper[5120]: I0316 17:12:25.015128 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:12:25 crc kubenswrapper[5120]: I0316 17:12:25.017843 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ovndbcluster-nb-ovndbs\"" Mar 16 17:12:25 crc kubenswrapper[5120]: I0316 17:12:25.017864 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovndbcluster-nb-config\"" Mar 16 17:12:25 crc kubenswrapper[5120]: I0316 17:12:25.018328 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovndbcluster-nb-scripts\"" Mar 16 17:12:25 crc kubenswrapper[5120]: I0316 17:12:25.018506 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ovncluster-ovndbcluster-nb-dockercfg-5dtf4\"" Mar 16 17:12:25 crc kubenswrapper[5120]: I0316 17:12:25.018665 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ovn-metrics\"" Mar 16 17:12:25 crc kubenswrapper[5120]: I0316 17:12:25.206848 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/75c97708-5716-4b9d-af7a-d442efb1c830-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"75c97708-5716-4b9d-af7a-d442efb1c830\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:12:25 crc kubenswrapper[5120]: I0316 17:12:25.207115 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/75c97708-5716-4b9d-af7a-d442efb1c830-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"75c97708-5716-4b9d-af7a-d442efb1c830\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:12:25 crc kubenswrapper[5120]: I0316 17:12:25.207343 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"ovsdbserver-nb-0\" (UID: \"75c97708-5716-4b9d-af7a-d442efb1c830\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:12:25 crc kubenswrapper[5120]: I0316 17:12:25.207409 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/75c97708-5716-4b9d-af7a-d442efb1c830-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"75c97708-5716-4b9d-af7a-d442efb1c830\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:12:25 crc kubenswrapper[5120]: I0316 17:12:25.207453 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9gq5\" (UniqueName: \"kubernetes.io/projected/75c97708-5716-4b9d-af7a-d442efb1c830-kube-api-access-m9gq5\") pod \"ovsdbserver-nb-0\" (UID: \"75c97708-5716-4b9d-af7a-d442efb1c830\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:12:25 crc kubenswrapper[5120]: I0316 17:12:25.207499 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/75c97708-5716-4b9d-af7a-d442efb1c830-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"75c97708-5716-4b9d-af7a-d442efb1c830\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:12:25 crc kubenswrapper[5120]: I0316 17:12:25.207539 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/75c97708-5716-4b9d-af7a-d442efb1c830-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"75c97708-5716-4b9d-af7a-d442efb1c830\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:12:25 crc kubenswrapper[5120]: I0316 17:12:25.207659 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/75c97708-5716-4b9d-af7a-d442efb1c830-config\") pod \"ovsdbserver-nb-0\" (UID: \"75c97708-5716-4b9d-af7a-d442efb1c830\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:12:25 crc kubenswrapper[5120]: I0316 17:12:25.309122 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/75c97708-5716-4b9d-af7a-d442efb1c830-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"75c97708-5716-4b9d-af7a-d442efb1c830\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:12:25 crc kubenswrapper[5120]: I0316 17:12:25.309254 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"ovsdbserver-nb-0\" (UID: \"75c97708-5716-4b9d-af7a-d442efb1c830\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:12:25 crc kubenswrapper[5120]: I0316 17:12:25.309300 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/75c97708-5716-4b9d-af7a-d442efb1c830-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"75c97708-5716-4b9d-af7a-d442efb1c830\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:12:25 crc kubenswrapper[5120]: I0316 17:12:25.309342 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m9gq5\" (UniqueName: \"kubernetes.io/projected/75c97708-5716-4b9d-af7a-d442efb1c830-kube-api-access-m9gq5\") pod \"ovsdbserver-nb-0\" (UID: \"75c97708-5716-4b9d-af7a-d442efb1c830\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:12:25 crc kubenswrapper[5120]: I0316 17:12:25.309393 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/75c97708-5716-4b9d-af7a-d442efb1c830-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"75c97708-5716-4b9d-af7a-d442efb1c830\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:12:25 crc kubenswrapper[5120]: I0316 17:12:25.309428 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/75c97708-5716-4b9d-af7a-d442efb1c830-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"75c97708-5716-4b9d-af7a-d442efb1c830\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:12:25 crc kubenswrapper[5120]: I0316 17:12:25.309510 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/75c97708-5716-4b9d-af7a-d442efb1c830-config\") pod \"ovsdbserver-nb-0\" (UID: \"75c97708-5716-4b9d-af7a-d442efb1c830\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:12:25 crc kubenswrapper[5120]: I0316 17:12:25.309690 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"ovsdbserver-nb-0\" (UID: \"75c97708-5716-4b9d-af7a-d442efb1c830\") device mount path \"/mnt/openstack/pv16\"" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:12:25 crc kubenswrapper[5120]: I0316 17:12:25.309695 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/75c97708-5716-4b9d-af7a-d442efb1c830-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"75c97708-5716-4b9d-af7a-d442efb1c830\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:12:25 crc kubenswrapper[5120]: I0316 17:12:25.309894 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/75c97708-5716-4b9d-af7a-d442efb1c830-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"75c97708-5716-4b9d-af7a-d442efb1c830\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:12:25 crc kubenswrapper[5120]: I0316 17:12:25.310998 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/75c97708-5716-4b9d-af7a-d442efb1c830-config\") pod \"ovsdbserver-nb-0\" (UID: \"75c97708-5716-4b9d-af7a-d442efb1c830\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:12:25 crc kubenswrapper[5120]: I0316 17:12:25.311068 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/75c97708-5716-4b9d-af7a-d442efb1c830-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"75c97708-5716-4b9d-af7a-d442efb1c830\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:12:25 crc kubenswrapper[5120]: I0316 17:12:25.318657 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/75c97708-5716-4b9d-af7a-d442efb1c830-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"75c97708-5716-4b9d-af7a-d442efb1c830\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:12:25 crc kubenswrapper[5120]: I0316 17:12:25.318706 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/75c97708-5716-4b9d-af7a-d442efb1c830-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"75c97708-5716-4b9d-af7a-d442efb1c830\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:12:25 crc kubenswrapper[5120]: I0316 17:12:25.319862 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/75c97708-5716-4b9d-af7a-d442efb1c830-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"75c97708-5716-4b9d-af7a-d442efb1c830\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:12:25 crc kubenswrapper[5120]: I0316 17:12:25.331644 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9gq5\" (UniqueName: \"kubernetes.io/projected/75c97708-5716-4b9d-af7a-d442efb1c830-kube-api-access-m9gq5\") pod \"ovsdbserver-nb-0\" (UID: \"75c97708-5716-4b9d-af7a-d442efb1c830\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:12:25 crc kubenswrapper[5120]: I0316 17:12:25.337179 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"ovsdbserver-nb-0\" (UID: \"75c97708-5716-4b9d-af7a-d442efb1c830\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:12:25 crc kubenswrapper[5120]: I0316 17:12:25.640948 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:12:25 crc kubenswrapper[5120]: I0316 17:12:25.716374 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"2dd828c2-16f2-4e69-b0b8-b953caf55f5b","Type":"ContainerStarted","Data":"7e2d9b8d74a0793fd3dc782decec5aecb43307447a1d0250a1484d0fd0e6e09d"} Mar 16 17:12:25 crc kubenswrapper[5120]: I0316 17:12:25.753266 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstack-cell1-galera-0" podStartSLOduration=7.753240194 podStartE2EDuration="7.753240194s" podCreationTimestamp="2026-03-16 17:12:18 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:12:25.747630961 +0000 UTC m=+6047.901562628" watchObservedRunningTime="2026-03-16 17:12:25.753240194 +0000 UTC m=+6047.907171851" Mar 16 17:12:26 crc kubenswrapper[5120]: I0316 17:12:26.105202 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 17:12:26 crc kubenswrapper[5120]: I0316 17:12:26.674422 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/memcached-0" Mar 16 17:12:26 crc kubenswrapper[5120]: I0316 17:12:26.726095 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"75c97708-5716-4b9d-af7a-d442efb1c830","Type":"ContainerStarted","Data":"a0d4bfc6c85daa1fcf1a87c1a6df3b7f339f491480a12e4b212421a42ce97347"} Mar 16 17:12:26 crc kubenswrapper[5120]: I0316 17:12:26.726136 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"75c97708-5716-4b9d-af7a-d442efb1c830","Type":"ContainerStarted","Data":"2b1f4a51e957de0117e8df83a8b490bb03c81acb532eec020956c1ef08405199"} Mar 16 17:12:26 crc kubenswrapper[5120]: I0316 17:12:26.726146 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"75c97708-5716-4b9d-af7a-d442efb1c830","Type":"ContainerStarted","Data":"275cf287bbfe8855420c90ffb10d954c233dc1e666d0fb74c0ee73ddb005ab42"} Mar 16 17:12:26 crc kubenswrapper[5120]: I0316 17:12:26.763681 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podStartSLOduration=3.763655719 podStartE2EDuration="3.763655719s" podCreationTimestamp="2026-03-16 17:12:23 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:12:26.756923585 +0000 UTC m=+6048.910855262" watchObservedRunningTime="2026-03-16 17:12:26.763655719 +0000 UTC m=+6048.917587376" Mar 16 17:12:27 crc kubenswrapper[5120]: I0316 17:12:27.753428 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 17:12:27 crc kubenswrapper[5120]: I0316 17:12:27.778085 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 17:12:27 crc kubenswrapper[5120]: I0316 17:12:27.778224 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:12:27 crc kubenswrapper[5120]: I0316 17:12:27.780311 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ovncluster-ovndbcluster-sb-dockercfg-fkn89\"" Mar 16 17:12:27 crc kubenswrapper[5120]: I0316 17:12:27.780637 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ovndbcluster-sb-ovndbs\"" Mar 16 17:12:27 crc kubenswrapper[5120]: I0316 17:12:27.781127 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovndbcluster-sb-scripts\"" Mar 16 17:12:27 crc kubenswrapper[5120]: I0316 17:12:27.781315 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovndbcluster-sb-config\"" Mar 16 17:12:27 crc kubenswrapper[5120]: I0316 17:12:27.972388 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5ba234a2-95db-4cf8-a7de-7ddc034f58b7-config\") pod \"ovsdbserver-sb-0\" (UID: \"5ba234a2-95db-4cf8-a7de-7ddc034f58b7\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:12:27 crc kubenswrapper[5120]: I0316 17:12:27.972648 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/5ba234a2-95db-4cf8-a7de-7ddc034f58b7-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"5ba234a2-95db-4cf8-a7de-7ddc034f58b7\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:12:27 crc kubenswrapper[5120]: I0316 17:12:27.972912 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9ljz\" (UniqueName: \"kubernetes.io/projected/5ba234a2-95db-4cf8-a7de-7ddc034f58b7-kube-api-access-z9ljz\") pod \"ovsdbserver-sb-0\" (UID: \"5ba234a2-95db-4cf8-a7de-7ddc034f58b7\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:12:27 crc kubenswrapper[5120]: I0316 17:12:27.972983 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/5ba234a2-95db-4cf8-a7de-7ddc034f58b7-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"5ba234a2-95db-4cf8-a7de-7ddc034f58b7\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:12:27 crc kubenswrapper[5120]: I0316 17:12:27.973067 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/5ba234a2-95db-4cf8-a7de-7ddc034f58b7-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"5ba234a2-95db-4cf8-a7de-7ddc034f58b7\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:12:27 crc kubenswrapper[5120]: I0316 17:12:27.973115 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"ovsdbserver-sb-0\" (UID: \"5ba234a2-95db-4cf8-a7de-7ddc034f58b7\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:12:27 crc kubenswrapper[5120]: I0316 17:12:27.973158 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/5ba234a2-95db-4cf8-a7de-7ddc034f58b7-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"5ba234a2-95db-4cf8-a7de-7ddc034f58b7\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:12:27 crc kubenswrapper[5120]: I0316 17:12:27.973200 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5ba234a2-95db-4cf8-a7de-7ddc034f58b7-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"5ba234a2-95db-4cf8-a7de-7ddc034f58b7\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:12:28 crc kubenswrapper[5120]: I0316 17:12:28.074311 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5ba234a2-95db-4cf8-a7de-7ddc034f58b7-config\") pod \"ovsdbserver-sb-0\" (UID: \"5ba234a2-95db-4cf8-a7de-7ddc034f58b7\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:12:28 crc kubenswrapper[5120]: I0316 17:12:28.074362 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/5ba234a2-95db-4cf8-a7de-7ddc034f58b7-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"5ba234a2-95db-4cf8-a7de-7ddc034f58b7\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:12:28 crc kubenswrapper[5120]: I0316 17:12:28.074454 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z9ljz\" (UniqueName: \"kubernetes.io/projected/5ba234a2-95db-4cf8-a7de-7ddc034f58b7-kube-api-access-z9ljz\") pod \"ovsdbserver-sb-0\" (UID: \"5ba234a2-95db-4cf8-a7de-7ddc034f58b7\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:12:28 crc kubenswrapper[5120]: I0316 17:12:28.074485 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/5ba234a2-95db-4cf8-a7de-7ddc034f58b7-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"5ba234a2-95db-4cf8-a7de-7ddc034f58b7\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:12:28 crc kubenswrapper[5120]: I0316 17:12:28.074533 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/5ba234a2-95db-4cf8-a7de-7ddc034f58b7-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"5ba234a2-95db-4cf8-a7de-7ddc034f58b7\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:12:28 crc kubenswrapper[5120]: I0316 17:12:28.074566 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"ovsdbserver-sb-0\" (UID: \"5ba234a2-95db-4cf8-a7de-7ddc034f58b7\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:12:28 crc kubenswrapper[5120]: I0316 17:12:28.074604 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/5ba234a2-95db-4cf8-a7de-7ddc034f58b7-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"5ba234a2-95db-4cf8-a7de-7ddc034f58b7\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:12:28 crc kubenswrapper[5120]: I0316 17:12:28.075051 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"ovsdbserver-sb-0\" (UID: \"5ba234a2-95db-4cf8-a7de-7ddc034f58b7\") device mount path \"/mnt/openstack/pv02\"" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:12:28 crc kubenswrapper[5120]: I0316 17:12:28.075216 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/5ba234a2-95db-4cf8-a7de-7ddc034f58b7-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"5ba234a2-95db-4cf8-a7de-7ddc034f58b7\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:12:28 crc kubenswrapper[5120]: I0316 17:12:28.075311 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5ba234a2-95db-4cf8-a7de-7ddc034f58b7-config\") pod \"ovsdbserver-sb-0\" (UID: \"5ba234a2-95db-4cf8-a7de-7ddc034f58b7\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:12:28 crc kubenswrapper[5120]: I0316 17:12:28.075563 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/5ba234a2-95db-4cf8-a7de-7ddc034f58b7-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"5ba234a2-95db-4cf8-a7de-7ddc034f58b7\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:12:28 crc kubenswrapper[5120]: I0316 17:12:28.079409 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5ba234a2-95db-4cf8-a7de-7ddc034f58b7-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"5ba234a2-95db-4cf8-a7de-7ddc034f58b7\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:12:28 crc kubenswrapper[5120]: I0316 17:12:28.080675 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/5ba234a2-95db-4cf8-a7de-7ddc034f58b7-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"5ba234a2-95db-4cf8-a7de-7ddc034f58b7\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:12:28 crc kubenswrapper[5120]: I0316 17:12:28.080749 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5ba234a2-95db-4cf8-a7de-7ddc034f58b7-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"5ba234a2-95db-4cf8-a7de-7ddc034f58b7\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:12:28 crc kubenswrapper[5120]: I0316 17:12:28.085954 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/5ba234a2-95db-4cf8-a7de-7ddc034f58b7-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"5ba234a2-95db-4cf8-a7de-7ddc034f58b7\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:12:28 crc kubenswrapper[5120]: I0316 17:12:28.099546 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"ovsdbserver-sb-0\" (UID: \"5ba234a2-95db-4cf8-a7de-7ddc034f58b7\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:12:28 crc kubenswrapper[5120]: I0316 17:12:28.100066 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9ljz\" (UniqueName: \"kubernetes.io/projected/5ba234a2-95db-4cf8-a7de-7ddc034f58b7-kube-api-access-z9ljz\") pod \"ovsdbserver-sb-0\" (UID: \"5ba234a2-95db-4cf8-a7de-7ddc034f58b7\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:12:28 crc kubenswrapper[5120]: I0316 17:12:28.271006 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:12:28 crc kubenswrapper[5120]: I0316 17:12:28.271588 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:12:28 crc kubenswrapper[5120]: I0316 17:12:28.403333 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:12:28 crc kubenswrapper[5120]: I0316 17:12:28.641839 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:12:28 crc kubenswrapper[5120]: I0316 17:12:28.874598 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 17:12:28 crc kubenswrapper[5120]: W0316 17:12:28.880277 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5ba234a2_95db_4cf8_a7de_7ddc034f58b7.slice/crio-243e4bbd2d5ec542c084e964319040db49730fc37d49376501f5b0ec41e43e4b WatchSource:0}: Error finding container 243e4bbd2d5ec542c084e964319040db49730fc37d49376501f5b0ec41e43e4b: Status 404 returned error can't find the container with id 243e4bbd2d5ec542c084e964319040db49730fc37d49376501f5b0ec41e43e4b Mar 16 17:12:29 crc kubenswrapper[5120]: I0316 17:12:29.751167 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"5ba234a2-95db-4cf8-a7de-7ddc034f58b7","Type":"ContainerStarted","Data":"40c8b7b52a9f3ac29bf620def0abc9ab43dd5e83ec58521a17628b610bddd54a"} Mar 16 17:12:29 crc kubenswrapper[5120]: I0316 17:12:29.751610 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"5ba234a2-95db-4cf8-a7de-7ddc034f58b7","Type":"ContainerStarted","Data":"6ca166115dd4eb9c50d15ae1ac4e26c4b343c58645a0e8a031bb2139d052a30a"} Mar 16 17:12:29 crc kubenswrapper[5120]: I0316 17:12:29.751620 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"5ba234a2-95db-4cf8-a7de-7ddc034f58b7","Type":"ContainerStarted","Data":"243e4bbd2d5ec542c084e964319040db49730fc37d49376501f5b0ec41e43e4b"} Mar 16 17:12:29 crc kubenswrapper[5120]: I0316 17:12:29.770538 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podStartSLOduration=3.770511934 podStartE2EDuration="3.770511934s" podCreationTimestamp="2026-03-16 17:12:26 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:12:29.768979062 +0000 UTC m=+6051.922910729" watchObservedRunningTime="2026-03-16 17:12:29.770511934 +0000 UTC m=+6051.924443591" Mar 16 17:12:29 crc kubenswrapper[5120]: I0316 17:12:29.786737 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:12:29 crc kubenswrapper[5120]: I0316 17:12:29.786839 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:12:29 crc kubenswrapper[5120]: I0316 17:12:29.864226 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:12:30 crc kubenswrapper[5120]: I0316 17:12:30.611250 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:12:30 crc kubenswrapper[5120]: I0316 17:12:30.641920 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:12:30 crc kubenswrapper[5120]: I0316 17:12:30.691151 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:12:30 crc kubenswrapper[5120]: I0316 17:12:30.849064 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:12:30 crc kubenswrapper[5120]: I0316 17:12:30.925366 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-2aa5-account-create-update-w4zdl"] Mar 16 17:12:30 crc kubenswrapper[5120]: I0316 17:12:30.933022 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-2aa5-account-create-update-w4zdl" Mar 16 17:12:30 crc kubenswrapper[5120]: I0316 17:12:30.935271 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-db-secret\"" Mar 16 17:12:30 crc kubenswrapper[5120]: I0316 17:12:30.947640 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-2aa5-account-create-update-w4zdl"] Mar 16 17:12:31 crc kubenswrapper[5120]: I0316 17:12:31.060729 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/01fff66f-9939-487a-b37b-74a413516937-operator-scripts\") pod \"keystone-2aa5-account-create-update-w4zdl\" (UID: \"01fff66f-9939-487a-b37b-74a413516937\") " pod="openstack-kuttl-tests/keystone-2aa5-account-create-update-w4zdl" Mar 16 17:12:31 crc kubenswrapper[5120]: I0316 17:12:31.061273 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tmml\" (UniqueName: \"kubernetes.io/projected/01fff66f-9939-487a-b37b-74a413516937-kube-api-access-5tmml\") pod \"keystone-2aa5-account-create-update-w4zdl\" (UID: \"01fff66f-9939-487a-b37b-74a413516937\") " pod="openstack-kuttl-tests/keystone-2aa5-account-create-update-w4zdl" Mar 16 17:12:31 crc kubenswrapper[5120]: I0316 17:12:31.065902 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-db-create-mgndp"] Mar 16 17:12:31 crc kubenswrapper[5120]: I0316 17:12:31.070944 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-create-mgndp" Mar 16 17:12:31 crc kubenswrapper[5120]: I0316 17:12:31.078392 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-db-create-mgndp"] Mar 16 17:12:31 crc kubenswrapper[5120]: I0316 17:12:31.164939 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5tmml\" (UniqueName: \"kubernetes.io/projected/01fff66f-9939-487a-b37b-74a413516937-kube-api-access-5tmml\") pod \"keystone-2aa5-account-create-update-w4zdl\" (UID: \"01fff66f-9939-487a-b37b-74a413516937\") " pod="openstack-kuttl-tests/keystone-2aa5-account-create-update-w4zdl" Mar 16 17:12:31 crc kubenswrapper[5120]: I0316 17:12:31.165296 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/01fff66f-9939-487a-b37b-74a413516937-operator-scripts\") pod \"keystone-2aa5-account-create-update-w4zdl\" (UID: \"01fff66f-9939-487a-b37b-74a413516937\") " pod="openstack-kuttl-tests/keystone-2aa5-account-create-update-w4zdl" Mar 16 17:12:31 crc kubenswrapper[5120]: I0316 17:12:31.166129 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/01fff66f-9939-487a-b37b-74a413516937-operator-scripts\") pod \"keystone-2aa5-account-create-update-w4zdl\" (UID: \"01fff66f-9939-487a-b37b-74a413516937\") " pod="openstack-kuttl-tests/keystone-2aa5-account-create-update-w4zdl" Mar 16 17:12:31 crc kubenswrapper[5120]: I0316 17:12:31.205485 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tmml\" (UniqueName: \"kubernetes.io/projected/01fff66f-9939-487a-b37b-74a413516937-kube-api-access-5tmml\") pod \"keystone-2aa5-account-create-update-w4zdl\" (UID: \"01fff66f-9939-487a-b37b-74a413516937\") " pod="openstack-kuttl-tests/keystone-2aa5-account-create-update-w4zdl" Mar 16 17:12:31 crc kubenswrapper[5120]: I0316 17:12:31.221180 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-2379-account-create-update-hxlvn"] Mar 16 17:12:31 crc kubenswrapper[5120]: I0316 17:12:31.228385 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-2379-account-create-update-hxlvn" Mar 16 17:12:31 crc kubenswrapper[5120]: I0316 17:12:31.230710 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-db-secret\"" Mar 16 17:12:31 crc kubenswrapper[5120]: I0316 17:12:31.250074 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-2379-account-create-update-hxlvn"] Mar 16 17:12:31 crc kubenswrapper[5120]: I0316 17:12:31.259398 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-2aa5-account-create-update-w4zdl" Mar 16 17:12:31 crc kubenswrapper[5120]: I0316 17:12:31.267483 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/98fe2454-3f99-4022-ba43-170883affe3d-operator-scripts\") pod \"placement-db-create-mgndp\" (UID: \"98fe2454-3f99-4022-ba43-170883affe3d\") " pod="openstack-kuttl-tests/placement-db-create-mgndp" Mar 16 17:12:31 crc kubenswrapper[5120]: I0316 17:12:31.268049 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqcxw\" (UniqueName: \"kubernetes.io/projected/98fe2454-3f99-4022-ba43-170883affe3d-kube-api-access-tqcxw\") pod \"placement-db-create-mgndp\" (UID: \"98fe2454-3f99-4022-ba43-170883affe3d\") " pod="openstack-kuttl-tests/placement-db-create-mgndp" Mar 16 17:12:31 crc kubenswrapper[5120]: I0316 17:12:31.371733 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/6e8fd7b0-4bfd-4f90-a8ec-063aaa83143f-operator-scripts\") pod \"placement-2379-account-create-update-hxlvn\" (UID: \"6e8fd7b0-4bfd-4f90-a8ec-063aaa83143f\") " pod="openstack-kuttl-tests/placement-2379-account-create-update-hxlvn" Mar 16 17:12:31 crc kubenswrapper[5120]: I0316 17:12:31.371878 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-km7gn\" (UniqueName: \"kubernetes.io/projected/6e8fd7b0-4bfd-4f90-a8ec-063aaa83143f-kube-api-access-km7gn\") pod \"placement-2379-account-create-update-hxlvn\" (UID: \"6e8fd7b0-4bfd-4f90-a8ec-063aaa83143f\") " pod="openstack-kuttl-tests/placement-2379-account-create-update-hxlvn" Mar 16 17:12:31 crc kubenswrapper[5120]: I0316 17:12:31.371944 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tqcxw\" (UniqueName: \"kubernetes.io/projected/98fe2454-3f99-4022-ba43-170883affe3d-kube-api-access-tqcxw\") pod \"placement-db-create-mgndp\" (UID: \"98fe2454-3f99-4022-ba43-170883affe3d\") " pod="openstack-kuttl-tests/placement-db-create-mgndp" Mar 16 17:12:31 crc kubenswrapper[5120]: I0316 17:12:31.372040 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/98fe2454-3f99-4022-ba43-170883affe3d-operator-scripts\") pod \"placement-db-create-mgndp\" (UID: \"98fe2454-3f99-4022-ba43-170883affe3d\") " pod="openstack-kuttl-tests/placement-db-create-mgndp" Mar 16 17:12:31 crc kubenswrapper[5120]: I0316 17:12:31.373222 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/98fe2454-3f99-4022-ba43-170883affe3d-operator-scripts\") pod \"placement-db-create-mgndp\" (UID: \"98fe2454-3f99-4022-ba43-170883affe3d\") " pod="openstack-kuttl-tests/placement-db-create-mgndp" Mar 16 17:12:31 crc kubenswrapper[5120]: I0316 17:12:31.395392 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqcxw\" (UniqueName: \"kubernetes.io/projected/98fe2454-3f99-4022-ba43-170883affe3d-kube-api-access-tqcxw\") pod \"placement-db-create-mgndp\" (UID: \"98fe2454-3f99-4022-ba43-170883affe3d\") " pod="openstack-kuttl-tests/placement-db-create-mgndp" Mar 16 17:12:31 crc kubenswrapper[5120]: I0316 17:12:31.403696 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:12:31 crc kubenswrapper[5120]: I0316 17:12:31.474463 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/6e8fd7b0-4bfd-4f90-a8ec-063aaa83143f-operator-scripts\") pod \"placement-2379-account-create-update-hxlvn\" (UID: \"6e8fd7b0-4bfd-4f90-a8ec-063aaa83143f\") " pod="openstack-kuttl-tests/placement-2379-account-create-update-hxlvn" Mar 16 17:12:31 crc kubenswrapper[5120]: I0316 17:12:31.474588 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-km7gn\" (UniqueName: \"kubernetes.io/projected/6e8fd7b0-4bfd-4f90-a8ec-063aaa83143f-kube-api-access-km7gn\") pod \"placement-2379-account-create-update-hxlvn\" (UID: \"6e8fd7b0-4bfd-4f90-a8ec-063aaa83143f\") " pod="openstack-kuttl-tests/placement-2379-account-create-update-hxlvn" Mar 16 17:12:31 crc kubenswrapper[5120]: I0316 17:12:31.475303 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/6e8fd7b0-4bfd-4f90-a8ec-063aaa83143f-operator-scripts\") pod \"placement-2379-account-create-update-hxlvn\" (UID: \"6e8fd7b0-4bfd-4f90-a8ec-063aaa83143f\") " pod="openstack-kuttl-tests/placement-2379-account-create-update-hxlvn" Mar 16 17:12:31 crc kubenswrapper[5120]: I0316 17:12:31.492855 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-km7gn\" (UniqueName: \"kubernetes.io/projected/6e8fd7b0-4bfd-4f90-a8ec-063aaa83143f-kube-api-access-km7gn\") pod \"placement-2379-account-create-update-hxlvn\" (UID: \"6e8fd7b0-4bfd-4f90-a8ec-063aaa83143f\") " pod="openstack-kuttl-tests/placement-2379-account-create-update-hxlvn" Mar 16 17:12:31 crc kubenswrapper[5120]: I0316 17:12:31.570952 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-2379-account-create-update-hxlvn" Mar 16 17:12:31 crc kubenswrapper[5120]: I0316 17:12:31.694913 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-create-mgndp" Mar 16 17:12:31 crc kubenswrapper[5120]: I0316 17:12:31.701940 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:12:31 crc kubenswrapper[5120]: I0316 17:12:31.727042 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-2aa5-account-create-update-w4zdl"] Mar 16 17:12:31 crc kubenswrapper[5120]: W0316 17:12:31.744583 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod01fff66f_9939_487a_b37b_74a413516937.slice/crio-11ee9b5b5dfb91ef74ddd2dd2bda427d37f1f7e776e806127df61c0356f1afb1 WatchSource:0}: Error finding container 11ee9b5b5dfb91ef74ddd2dd2bda427d37f1f7e776e806127df61c0356f1afb1: Status 404 returned error can't find the container with id 11ee9b5b5dfb91ef74ddd2dd2bda427d37f1f7e776e806127df61c0356f1afb1 Mar 16 17:12:31 crc kubenswrapper[5120]: I0316 17:12:31.753863 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:12:31 crc kubenswrapper[5120]: I0316 17:12:31.809050 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-2aa5-account-create-update-w4zdl" event={"ID":"01fff66f-9939-487a-b37b-74a413516937","Type":"ContainerStarted","Data":"11ee9b5b5dfb91ef74ddd2dd2bda427d37f1f7e776e806127df61c0356f1afb1"} Mar 16 17:12:32 crc kubenswrapper[5120]: W0316 17:12:32.019961 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6e8fd7b0_4bfd_4f90_a8ec_063aaa83143f.slice/crio-08e160a59f74a1634663d6cb2d82198ba18f9258e9fa518011ba088748450c06 WatchSource:0}: Error finding container 08e160a59f74a1634663d6cb2d82198ba18f9258e9fa518011ba088748450c06: Status 404 returned error can't find the container with id 08e160a59f74a1634663d6cb2d82198ba18f9258e9fa518011ba088748450c06 Mar 16 17:12:32 crc kubenswrapper[5120]: I0316 17:12:32.020092 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-2379-account-create-update-hxlvn"] Mar 16 17:12:32 crc kubenswrapper[5120]: I0316 17:12:32.309647 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-db-create-mgndp"] Mar 16 17:12:32 crc kubenswrapper[5120]: I0316 17:12:32.821603 5120 generic.go:358] "Generic (PLEG): container finished" podID="6e8fd7b0-4bfd-4f90-a8ec-063aaa83143f" containerID="8b042963358c68f21260174a979c8b5391ca04edf893e990a9f0f840643f14c0" exitCode=0 Mar 16 17:12:32 crc kubenswrapper[5120]: I0316 17:12:32.821656 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-2379-account-create-update-hxlvn" event={"ID":"6e8fd7b0-4bfd-4f90-a8ec-063aaa83143f","Type":"ContainerDied","Data":"8b042963358c68f21260174a979c8b5391ca04edf893e990a9f0f840643f14c0"} Mar 16 17:12:32 crc kubenswrapper[5120]: I0316 17:12:32.823272 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-2379-account-create-update-hxlvn" event={"ID":"6e8fd7b0-4bfd-4f90-a8ec-063aaa83143f","Type":"ContainerStarted","Data":"08e160a59f74a1634663d6cb2d82198ba18f9258e9fa518011ba088748450c06"} Mar 16 17:12:32 crc kubenswrapper[5120]: I0316 17:12:32.825662 5120 generic.go:358] "Generic (PLEG): container finished" podID="98fe2454-3f99-4022-ba43-170883affe3d" containerID="56d1057aacafb13d0c9477d7da43604cdb6a2b5cc1054b3958a6c858e53ff240" exitCode=0 Mar 16 17:12:32 crc kubenswrapper[5120]: I0316 17:12:32.825848 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-create-mgndp" event={"ID":"98fe2454-3f99-4022-ba43-170883affe3d","Type":"ContainerDied","Data":"56d1057aacafb13d0c9477d7da43604cdb6a2b5cc1054b3958a6c858e53ff240"} Mar 16 17:12:32 crc kubenswrapper[5120]: I0316 17:12:32.825912 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-create-mgndp" event={"ID":"98fe2454-3f99-4022-ba43-170883affe3d","Type":"ContainerStarted","Data":"2514fcbc90566f7e6bb15caa9671269fffaaca984cce10dfe2d0b232a7ab76c7"} Mar 16 17:12:32 crc kubenswrapper[5120]: I0316 17:12:32.827735 5120 generic.go:358] "Generic (PLEG): container finished" podID="01fff66f-9939-487a-b37b-74a413516937" containerID="e3b3a578631c8f7b15bb182a3013fa83b1cee01d09e79273b3cb85ef5ee1e0c4" exitCode=0 Mar 16 17:12:32 crc kubenswrapper[5120]: I0316 17:12:32.827938 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-2aa5-account-create-update-w4zdl" event={"ID":"01fff66f-9939-487a-b37b-74a413516937","Type":"ContainerDied","Data":"e3b3a578631c8f7b15bb182a3013fa83b1cee01d09e79273b3cb85ef5ee1e0c4"} Mar 16 17:12:33 crc kubenswrapper[5120]: I0316 17:12:33.022278 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 17:12:33 crc kubenswrapper[5120]: I0316 17:12:33.039975 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 17:12:33 crc kubenswrapper[5120]: I0316 17:12:33.040179 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Mar 16 17:12:33 crc kubenswrapper[5120]: I0316 17:12:33.043547 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"swift-swift-dockercfg-bfnfq\"" Mar 16 17:12:33 crc kubenswrapper[5120]: I0316 17:12:33.043602 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"swift-storage-config-data\"" Mar 16 17:12:33 crc kubenswrapper[5120]: I0316 17:12:33.044232 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"swift-conf\"" Mar 16 17:12:33 crc kubenswrapper[5120]: I0316 17:12:33.044531 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"swift-ring-files\"" Mar 16 17:12:33 crc kubenswrapper[5120]: I0316 17:12:33.117782 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"swift-storage-0\" (UID: \"453261b9-e47c-4e0b-b37d-4803c7ea4eab\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 17:12:33 crc kubenswrapper[5120]: I0316 17:12:33.117900 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gx55h\" (UniqueName: \"kubernetes.io/projected/453261b9-e47c-4e0b-b37d-4803c7ea4eab-kube-api-access-gx55h\") pod \"swift-storage-0\" (UID: \"453261b9-e47c-4e0b-b37d-4803c7ea4eab\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 17:12:33 crc kubenswrapper[5120]: I0316 17:12:33.117928 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/453261b9-e47c-4e0b-b37d-4803c7ea4eab-lock\") pod \"swift-storage-0\" (UID: \"453261b9-e47c-4e0b-b37d-4803c7ea4eab\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 17:12:33 crc kubenswrapper[5120]: I0316 17:12:33.117979 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/453261b9-e47c-4e0b-b37d-4803c7ea4eab-combined-ca-bundle\") pod \"swift-storage-0\" (UID: \"453261b9-e47c-4e0b-b37d-4803c7ea4eab\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 17:12:33 crc kubenswrapper[5120]: I0316 17:12:33.118041 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/453261b9-e47c-4e0b-b37d-4803c7ea4eab-etc-swift\") pod \"swift-storage-0\" (UID: \"453261b9-e47c-4e0b-b37d-4803c7ea4eab\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 17:12:33 crc kubenswrapper[5120]: I0316 17:12:33.118121 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/453261b9-e47c-4e0b-b37d-4803c7ea4eab-cache\") pod \"swift-storage-0\" (UID: \"453261b9-e47c-4e0b-b37d-4803c7ea4eab\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 17:12:33 crc kubenswrapper[5120]: I0316 17:12:33.220083 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"swift-storage-0\" (UID: \"453261b9-e47c-4e0b-b37d-4803c7ea4eab\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 17:12:33 crc kubenswrapper[5120]: I0316 17:12:33.220265 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gx55h\" (UniqueName: \"kubernetes.io/projected/453261b9-e47c-4e0b-b37d-4803c7ea4eab-kube-api-access-gx55h\") pod \"swift-storage-0\" (UID: \"453261b9-e47c-4e0b-b37d-4803c7ea4eab\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 17:12:33 crc kubenswrapper[5120]: I0316 17:12:33.220308 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/453261b9-e47c-4e0b-b37d-4803c7ea4eab-lock\") pod \"swift-storage-0\" (UID: \"453261b9-e47c-4e0b-b37d-4803c7ea4eab\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 17:12:33 crc kubenswrapper[5120]: I0316 17:12:33.220397 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/453261b9-e47c-4e0b-b37d-4803c7ea4eab-combined-ca-bundle\") pod \"swift-storage-0\" (UID: \"453261b9-e47c-4e0b-b37d-4803c7ea4eab\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 17:12:33 crc kubenswrapper[5120]: I0316 17:12:33.220482 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/453261b9-e47c-4e0b-b37d-4803c7ea4eab-etc-swift\") pod \"swift-storage-0\" (UID: \"453261b9-e47c-4e0b-b37d-4803c7ea4eab\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 17:12:33 crc kubenswrapper[5120]: I0316 17:12:33.220520 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"swift-storage-0\" (UID: \"453261b9-e47c-4e0b-b37d-4803c7ea4eab\") device mount path \"/mnt/openstack/pv20\"" pod="openstack-kuttl-tests/swift-storage-0" Mar 16 17:12:33 crc kubenswrapper[5120]: E0316 17:12:33.220672 5120 projected.go:289] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Mar 16 17:12:33 crc kubenswrapper[5120]: E0316 17:12:33.220691 5120 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Mar 16 17:12:33 crc kubenswrapper[5120]: E0316 17:12:33.220882 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/453261b9-e47c-4e0b-b37d-4803c7ea4eab-etc-swift podName:453261b9-e47c-4e0b-b37d-4803c7ea4eab nodeName:}" failed. No retries permitted until 2026-03-16 17:12:33.720735809 +0000 UTC m=+6055.874667466 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/453261b9-e47c-4e0b-b37d-4803c7ea4eab-etc-swift") pod "swift-storage-0" (UID: "453261b9-e47c-4e0b-b37d-4803c7ea4eab") : configmap "swift-ring-files" not found Mar 16 17:12:33 crc kubenswrapper[5120]: I0316 17:12:33.220975 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/453261b9-e47c-4e0b-b37d-4803c7ea4eab-cache\") pod \"swift-storage-0\" (UID: \"453261b9-e47c-4e0b-b37d-4803c7ea4eab\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 17:12:33 crc kubenswrapper[5120]: I0316 17:12:33.221033 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/453261b9-e47c-4e0b-b37d-4803c7ea4eab-lock\") pod \"swift-storage-0\" (UID: \"453261b9-e47c-4e0b-b37d-4803c7ea4eab\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 17:12:33 crc kubenswrapper[5120]: I0316 17:12:33.221405 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/453261b9-e47c-4e0b-b37d-4803c7ea4eab-cache\") pod \"swift-storage-0\" (UID: \"453261b9-e47c-4e0b-b37d-4803c7ea4eab\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 17:12:33 crc kubenswrapper[5120]: I0316 17:12:33.237459 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/453261b9-e47c-4e0b-b37d-4803c7ea4eab-combined-ca-bundle\") pod \"swift-storage-0\" (UID: \"453261b9-e47c-4e0b-b37d-4803c7ea4eab\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 17:12:33 crc kubenswrapper[5120]: I0316 17:12:33.238607 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gx55h\" (UniqueName: \"kubernetes.io/projected/453261b9-e47c-4e0b-b37d-4803c7ea4eab-kube-api-access-gx55h\") pod \"swift-storage-0\" (UID: \"453261b9-e47c-4e0b-b37d-4803c7ea4eab\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 17:12:33 crc kubenswrapper[5120]: I0316 17:12:33.249171 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"swift-storage-0\" (UID: \"453261b9-e47c-4e0b-b37d-4803c7ea4eab\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 17:12:33 crc kubenswrapper[5120]: I0316 17:12:33.403902 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:12:33 crc kubenswrapper[5120]: I0316 17:12:33.732545 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/453261b9-e47c-4e0b-b37d-4803c7ea4eab-etc-swift\") pod \"swift-storage-0\" (UID: \"453261b9-e47c-4e0b-b37d-4803c7ea4eab\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 17:12:33 crc kubenswrapper[5120]: E0316 17:12:33.732788 5120 projected.go:289] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Mar 16 17:12:33 crc kubenswrapper[5120]: E0316 17:12:33.732826 5120 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Mar 16 17:12:33 crc kubenswrapper[5120]: E0316 17:12:33.732897 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/453261b9-e47c-4e0b-b37d-4803c7ea4eab-etc-swift podName:453261b9-e47c-4e0b-b37d-4803c7ea4eab nodeName:}" failed. No retries permitted until 2026-03-16 17:12:34.732879111 +0000 UTC m=+6056.886810778 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/453261b9-e47c-4e0b-b37d-4803c7ea4eab-etc-swift") pod "swift-storage-0" (UID: "453261b9-e47c-4e0b-b37d-4803c7ea4eab") : configmap "swift-ring-files" not found Mar 16 17:12:34 crc kubenswrapper[5120]: I0316 17:12:34.356400 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-2aa5-account-create-update-w4zdl" Mar 16 17:12:34 crc kubenswrapper[5120]: I0316 17:12:34.364044 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-2379-account-create-update-hxlvn" Mar 16 17:12:34 crc kubenswrapper[5120]: I0316 17:12:34.367140 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-create-mgndp" Mar 16 17:12:34 crc kubenswrapper[5120]: I0316 17:12:34.449297 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5tmml\" (UniqueName: \"kubernetes.io/projected/01fff66f-9939-487a-b37b-74a413516937-kube-api-access-5tmml\") pod \"01fff66f-9939-487a-b37b-74a413516937\" (UID: \"01fff66f-9939-487a-b37b-74a413516937\") " Mar 16 17:12:34 crc kubenswrapper[5120]: I0316 17:12:34.449402 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:12:34 crc kubenswrapper[5120]: I0316 17:12:34.449546 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/01fff66f-9939-487a-b37b-74a413516937-operator-scripts\") pod \"01fff66f-9939-487a-b37b-74a413516937\" (UID: \"01fff66f-9939-487a-b37b-74a413516937\") " Mar 16 17:12:34 crc kubenswrapper[5120]: I0316 17:12:34.449581 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tqcxw\" (UniqueName: \"kubernetes.io/projected/98fe2454-3f99-4022-ba43-170883affe3d-kube-api-access-tqcxw\") pod \"98fe2454-3f99-4022-ba43-170883affe3d\" (UID: \"98fe2454-3f99-4022-ba43-170883affe3d\") " Mar 16 17:12:34 crc kubenswrapper[5120]: I0316 17:12:34.449632 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-km7gn\" (UniqueName: \"kubernetes.io/projected/6e8fd7b0-4bfd-4f90-a8ec-063aaa83143f-kube-api-access-km7gn\") pod \"6e8fd7b0-4bfd-4f90-a8ec-063aaa83143f\" (UID: \"6e8fd7b0-4bfd-4f90-a8ec-063aaa83143f\") " Mar 16 17:12:34 crc kubenswrapper[5120]: I0316 17:12:34.449683 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/6e8fd7b0-4bfd-4f90-a8ec-063aaa83143f-operator-scripts\") pod \"6e8fd7b0-4bfd-4f90-a8ec-063aaa83143f\" (UID: \"6e8fd7b0-4bfd-4f90-a8ec-063aaa83143f\") " Mar 16 17:12:34 crc kubenswrapper[5120]: I0316 17:12:34.449874 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/98fe2454-3f99-4022-ba43-170883affe3d-operator-scripts\") pod \"98fe2454-3f99-4022-ba43-170883affe3d\" (UID: \"98fe2454-3f99-4022-ba43-170883affe3d\") " Mar 16 17:12:34 crc kubenswrapper[5120]: I0316 17:12:34.450893 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/01fff66f-9939-487a-b37b-74a413516937-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "01fff66f-9939-487a-b37b-74a413516937" (UID: "01fff66f-9939-487a-b37b-74a413516937"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:12:34 crc kubenswrapper[5120]: I0316 17:12:34.451076 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e8fd7b0-4bfd-4f90-a8ec-063aaa83143f-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "6e8fd7b0-4bfd-4f90-a8ec-063aaa83143f" (UID: "6e8fd7b0-4bfd-4f90-a8ec-063aaa83143f"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:12:34 crc kubenswrapper[5120]: I0316 17:12:34.451123 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/98fe2454-3f99-4022-ba43-170883affe3d-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "98fe2454-3f99-4022-ba43-170883affe3d" (UID: "98fe2454-3f99-4022-ba43-170883affe3d"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:12:34 crc kubenswrapper[5120]: I0316 17:12:34.456716 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e8fd7b0-4bfd-4f90-a8ec-063aaa83143f-kube-api-access-km7gn" (OuterVolumeSpecName: "kube-api-access-km7gn") pod "6e8fd7b0-4bfd-4f90-a8ec-063aaa83143f" (UID: "6e8fd7b0-4bfd-4f90-a8ec-063aaa83143f"). InnerVolumeSpecName "kube-api-access-km7gn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:12:34 crc kubenswrapper[5120]: I0316 17:12:34.469374 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01fff66f-9939-487a-b37b-74a413516937-kube-api-access-5tmml" (OuterVolumeSpecName: "kube-api-access-5tmml") pod "01fff66f-9939-487a-b37b-74a413516937" (UID: "01fff66f-9939-487a-b37b-74a413516937"). InnerVolumeSpecName "kube-api-access-5tmml". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:12:34 crc kubenswrapper[5120]: I0316 17:12:34.475384 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98fe2454-3f99-4022-ba43-170883affe3d-kube-api-access-tqcxw" (OuterVolumeSpecName: "kube-api-access-tqcxw") pod "98fe2454-3f99-4022-ba43-170883affe3d" (UID: "98fe2454-3f99-4022-ba43-170883affe3d"). InnerVolumeSpecName "kube-api-access-tqcxw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:12:34 crc kubenswrapper[5120]: I0316 17:12:34.498610 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:12:34 crc kubenswrapper[5120]: I0316 17:12:34.555292 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/01fff66f-9939-487a-b37b-74a413516937-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:12:34 crc kubenswrapper[5120]: I0316 17:12:34.555452 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tqcxw\" (UniqueName: \"kubernetes.io/projected/98fe2454-3f99-4022-ba43-170883affe3d-kube-api-access-tqcxw\") on node \"crc\" DevicePath \"\"" Mar 16 17:12:34 crc kubenswrapper[5120]: I0316 17:12:34.555480 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-km7gn\" (UniqueName: \"kubernetes.io/projected/6e8fd7b0-4bfd-4f90-a8ec-063aaa83143f-kube-api-access-km7gn\") on node \"crc\" DevicePath \"\"" Mar 16 17:12:34 crc kubenswrapper[5120]: I0316 17:12:34.555494 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/6e8fd7b0-4bfd-4f90-a8ec-063aaa83143f-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:12:34 crc kubenswrapper[5120]: I0316 17:12:34.555509 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/98fe2454-3f99-4022-ba43-170883affe3d-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:12:34 crc kubenswrapper[5120]: I0316 17:12:34.555522 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5tmml\" (UniqueName: \"kubernetes.io/projected/01fff66f-9939-487a-b37b-74a413516937-kube-api-access-5tmml\") on node \"crc\" DevicePath \"\"" Mar 16 17:12:34 crc kubenswrapper[5120]: I0316 17:12:34.727096 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 17:12:34 crc kubenswrapper[5120]: I0316 17:12:34.731043 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 17:12:34 crc kubenswrapper[5120]: I0316 17:12:34.731915 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01fff66f-9939-487a-b37b-74a413516937" containerName="mariadb-account-create-update" Mar 16 17:12:34 crc kubenswrapper[5120]: I0316 17:12:34.731926 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="01fff66f-9939-487a-b37b-74a413516937" containerName="mariadb-account-create-update" Mar 16 17:12:34 crc kubenswrapper[5120]: I0316 17:12:34.731952 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e8fd7b0-4bfd-4f90-a8ec-063aaa83143f" containerName="mariadb-account-create-update" Mar 16 17:12:34 crc kubenswrapper[5120]: I0316 17:12:34.731957 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e8fd7b0-4bfd-4f90-a8ec-063aaa83143f" containerName="mariadb-account-create-update" Mar 16 17:12:34 crc kubenswrapper[5120]: I0316 17:12:34.731971 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98fe2454-3f99-4022-ba43-170883affe3d" containerName="mariadb-database-create" Mar 16 17:12:34 crc kubenswrapper[5120]: I0316 17:12:34.731976 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="98fe2454-3f99-4022-ba43-170883affe3d" containerName="mariadb-database-create" Mar 16 17:12:34 crc kubenswrapper[5120]: I0316 17:12:34.732152 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="98fe2454-3f99-4022-ba43-170883affe3d" containerName="mariadb-database-create" Mar 16 17:12:34 crc kubenswrapper[5120]: I0316 17:12:34.732164 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="01fff66f-9939-487a-b37b-74a413516937" containerName="mariadb-account-create-update" Mar 16 17:12:34 crc kubenswrapper[5120]: I0316 17:12:34.732182 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="6e8fd7b0-4bfd-4f90-a8ec-063aaa83143f" containerName="mariadb-account-create-update" Mar 16 17:12:34 crc kubenswrapper[5120]: I0316 17:12:34.741075 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:12:34 crc kubenswrapper[5120]: I0316 17:12:34.744574 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovnnorthd-scripts\"" Mar 16 17:12:34 crc kubenswrapper[5120]: I0316 17:12:34.744593 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ovnnorthd-ovndbs\"" Mar 16 17:12:34 crc kubenswrapper[5120]: I0316 17:12:34.745997 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ovnnorthd-ovnnorthd-dockercfg-82cbh\"" Mar 16 17:12:34 crc kubenswrapper[5120]: I0316 17:12:34.750667 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovnnorthd-config\"" Mar 16 17:12:34 crc kubenswrapper[5120]: I0316 17:12:34.763826 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/453261b9-e47c-4e0b-b37d-4803c7ea4eab-etc-swift\") pod \"swift-storage-0\" (UID: \"453261b9-e47c-4e0b-b37d-4803c7ea4eab\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 17:12:34 crc kubenswrapper[5120]: E0316 17:12:34.764033 5120 projected.go:289] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Mar 16 17:12:34 crc kubenswrapper[5120]: E0316 17:12:34.764045 5120 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Mar 16 17:12:34 crc kubenswrapper[5120]: E0316 17:12:34.764108 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/453261b9-e47c-4e0b-b37d-4803c7ea4eab-etc-swift podName:453261b9-e47c-4e0b-b37d-4803c7ea4eab nodeName:}" failed. No retries permitted until 2026-03-16 17:12:36.764091924 +0000 UTC m=+6058.918023581 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/453261b9-e47c-4e0b-b37d-4803c7ea4eab-etc-swift") pod "swift-storage-0" (UID: "453261b9-e47c-4e0b-b37d-4803c7ea4eab") : configmap "swift-ring-files" not found Mar 16 17:12:34 crc kubenswrapper[5120]: I0316 17:12:34.776243 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 17:12:34 crc kubenswrapper[5120]: I0316 17:12:34.845170 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-2aa5-account-create-update-w4zdl" Mar 16 17:12:34 crc kubenswrapper[5120]: I0316 17:12:34.845182 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-2aa5-account-create-update-w4zdl" event={"ID":"01fff66f-9939-487a-b37b-74a413516937","Type":"ContainerDied","Data":"11ee9b5b5dfb91ef74ddd2dd2bda427d37f1f7e776e806127df61c0356f1afb1"} Mar 16 17:12:34 crc kubenswrapper[5120]: I0316 17:12:34.845227 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="11ee9b5b5dfb91ef74ddd2dd2bda427d37f1f7e776e806127df61c0356f1afb1" Mar 16 17:12:34 crc kubenswrapper[5120]: I0316 17:12:34.849044 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-2379-account-create-update-hxlvn" event={"ID":"6e8fd7b0-4bfd-4f90-a8ec-063aaa83143f","Type":"ContainerDied","Data":"08e160a59f74a1634663d6cb2d82198ba18f9258e9fa518011ba088748450c06"} Mar 16 17:12:34 crc kubenswrapper[5120]: I0316 17:12:34.849091 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="08e160a59f74a1634663d6cb2d82198ba18f9258e9fa518011ba088748450c06" Mar 16 17:12:34 crc kubenswrapper[5120]: I0316 17:12:34.849389 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-2379-account-create-update-hxlvn" Mar 16 17:12:34 crc kubenswrapper[5120]: I0316 17:12:34.851642 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-create-mgndp" Mar 16 17:12:34 crc kubenswrapper[5120]: I0316 17:12:34.851679 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-create-mgndp" event={"ID":"98fe2454-3f99-4022-ba43-170883affe3d","Type":"ContainerDied","Data":"2514fcbc90566f7e6bb15caa9671269fffaaca984cce10dfe2d0b232a7ab76c7"} Mar 16 17:12:34 crc kubenswrapper[5120]: I0316 17:12:34.851701 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2514fcbc90566f7e6bb15caa9671269fffaaca984cce10dfe2d0b232a7ab76c7" Mar 16 17:12:34 crc kubenswrapper[5120]: I0316 17:12:34.865537 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/161d5626-9918-4847-96fd-f93d894bc230-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"161d5626-9918-4847-96fd-f93d894bc230\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:12:34 crc kubenswrapper[5120]: I0316 17:12:34.865666 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqdnt\" (UniqueName: \"kubernetes.io/projected/161d5626-9918-4847-96fd-f93d894bc230-kube-api-access-jqdnt\") pod \"ovn-northd-0\" (UID: \"161d5626-9918-4847-96fd-f93d894bc230\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:12:34 crc kubenswrapper[5120]: I0316 17:12:34.865744 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/161d5626-9918-4847-96fd-f93d894bc230-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"161d5626-9918-4847-96fd-f93d894bc230\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:12:34 crc kubenswrapper[5120]: I0316 17:12:34.865802 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/161d5626-9918-4847-96fd-f93d894bc230-config\") pod \"ovn-northd-0\" (UID: \"161d5626-9918-4847-96fd-f93d894bc230\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:12:34 crc kubenswrapper[5120]: I0316 17:12:34.865828 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/161d5626-9918-4847-96fd-f93d894bc230-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"161d5626-9918-4847-96fd-f93d894bc230\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:12:34 crc kubenswrapper[5120]: I0316 17:12:34.865876 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/161d5626-9918-4847-96fd-f93d894bc230-scripts\") pod \"ovn-northd-0\" (UID: \"161d5626-9918-4847-96fd-f93d894bc230\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:12:34 crc kubenswrapper[5120]: I0316 17:12:34.865922 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/161d5626-9918-4847-96fd-f93d894bc230-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"161d5626-9918-4847-96fd-f93d894bc230\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:12:34 crc kubenswrapper[5120]: I0316 17:12:34.968000 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/161d5626-9918-4847-96fd-f93d894bc230-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"161d5626-9918-4847-96fd-f93d894bc230\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:12:34 crc kubenswrapper[5120]: I0316 17:12:34.968085 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/161d5626-9918-4847-96fd-f93d894bc230-config\") pod \"ovn-northd-0\" (UID: \"161d5626-9918-4847-96fd-f93d894bc230\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:12:34 crc kubenswrapper[5120]: I0316 17:12:34.968116 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/161d5626-9918-4847-96fd-f93d894bc230-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"161d5626-9918-4847-96fd-f93d894bc230\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:12:34 crc kubenswrapper[5120]: I0316 17:12:34.968153 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/161d5626-9918-4847-96fd-f93d894bc230-scripts\") pod \"ovn-northd-0\" (UID: \"161d5626-9918-4847-96fd-f93d894bc230\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:12:34 crc kubenswrapper[5120]: I0316 17:12:34.968195 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/161d5626-9918-4847-96fd-f93d894bc230-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"161d5626-9918-4847-96fd-f93d894bc230\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:12:34 crc kubenswrapper[5120]: I0316 17:12:34.968407 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/161d5626-9918-4847-96fd-f93d894bc230-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"161d5626-9918-4847-96fd-f93d894bc230\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:12:34 crc kubenswrapper[5120]: I0316 17:12:34.968502 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jqdnt\" (UniqueName: \"kubernetes.io/projected/161d5626-9918-4847-96fd-f93d894bc230-kube-api-access-jqdnt\") pod \"ovn-northd-0\" (UID: \"161d5626-9918-4847-96fd-f93d894bc230\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:12:34 crc kubenswrapper[5120]: I0316 17:12:34.969168 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/161d5626-9918-4847-96fd-f93d894bc230-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"161d5626-9918-4847-96fd-f93d894bc230\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:12:34 crc kubenswrapper[5120]: I0316 17:12:34.969167 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/161d5626-9918-4847-96fd-f93d894bc230-config\") pod \"ovn-northd-0\" (UID: \"161d5626-9918-4847-96fd-f93d894bc230\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:12:34 crc kubenswrapper[5120]: I0316 17:12:34.969493 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/161d5626-9918-4847-96fd-f93d894bc230-scripts\") pod \"ovn-northd-0\" (UID: \"161d5626-9918-4847-96fd-f93d894bc230\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:12:34 crc kubenswrapper[5120]: I0316 17:12:34.973363 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/161d5626-9918-4847-96fd-f93d894bc230-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"161d5626-9918-4847-96fd-f93d894bc230\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:12:34 crc kubenswrapper[5120]: I0316 17:12:34.973501 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/161d5626-9918-4847-96fd-f93d894bc230-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"161d5626-9918-4847-96fd-f93d894bc230\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:12:34 crc kubenswrapper[5120]: I0316 17:12:34.973650 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/161d5626-9918-4847-96fd-f93d894bc230-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"161d5626-9918-4847-96fd-f93d894bc230\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:12:34 crc kubenswrapper[5120]: I0316 17:12:34.987383 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqdnt\" (UniqueName: \"kubernetes.io/projected/161d5626-9918-4847-96fd-f93d894bc230-kube-api-access-jqdnt\") pod \"ovn-northd-0\" (UID: \"161d5626-9918-4847-96fd-f93d894bc230\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:12:35 crc kubenswrapper[5120]: I0316 17:12:35.093193 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:12:35 crc kubenswrapper[5120]: I0316 17:12:35.525317 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 17:12:35 crc kubenswrapper[5120]: W0316 17:12:35.529975 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod161d5626_9918_4847_96fd_f93d894bc230.slice/crio-1b0b7d3e06d8620f79c8af00a60dd6b426036119a767ed60b5bb74e6a61db2b6 WatchSource:0}: Error finding container 1b0b7d3e06d8620f79c8af00a60dd6b426036119a767ed60b5bb74e6a61db2b6: Status 404 returned error can't find the container with id 1b0b7d3e06d8620f79c8af00a60dd6b426036119a767ed60b5bb74e6a61db2b6 Mar 16 17:12:35 crc kubenswrapper[5120]: I0316 17:12:35.862889 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"161d5626-9918-4847-96fd-f93d894bc230","Type":"ContainerStarted","Data":"24333b7cdb26c2e70048e18dcdaeac57a05c823200ef25ebc7bd2a0912464cf3"} Mar 16 17:12:35 crc kubenswrapper[5120]: I0316 17:12:35.863177 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"161d5626-9918-4847-96fd-f93d894bc230","Type":"ContainerStarted","Data":"1b0b7d3e06d8620f79c8af00a60dd6b426036119a767ed60b5bb74e6a61db2b6"} Mar 16 17:12:36 crc kubenswrapper[5120]: I0316 17:12:36.810781 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/453261b9-e47c-4e0b-b37d-4803c7ea4eab-etc-swift\") pod \"swift-storage-0\" (UID: \"453261b9-e47c-4e0b-b37d-4803c7ea4eab\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 17:12:36 crc kubenswrapper[5120]: E0316 17:12:36.810961 5120 projected.go:289] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Mar 16 17:12:36 crc kubenswrapper[5120]: E0316 17:12:36.811947 5120 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Mar 16 17:12:36 crc kubenswrapper[5120]: E0316 17:12:36.812015 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/453261b9-e47c-4e0b-b37d-4803c7ea4eab-etc-swift podName:453261b9-e47c-4e0b-b37d-4803c7ea4eab nodeName:}" failed. No retries permitted until 2026-03-16 17:12:40.811996013 +0000 UTC m=+6062.965927670 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/453261b9-e47c-4e0b-b37d-4803c7ea4eab-etc-swift") pod "swift-storage-0" (UID: "453261b9-e47c-4e0b-b37d-4803c7ea4eab") : configmap "swift-ring-files" not found Mar 16 17:12:36 crc kubenswrapper[5120]: I0316 17:12:36.869410 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-mp7zl"] Mar 16 17:12:36 crc kubenswrapper[5120]: I0316 17:12:36.876048 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:12:36 crc kubenswrapper[5120]: I0316 17:12:36.876290 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"161d5626-9918-4847-96fd-f93d894bc230","Type":"ContainerStarted","Data":"232557928a11f779afc7e7739d08c9c5eae278bdb6cad4018a9b79f28340ae03"} Mar 16 17:12:36 crc kubenswrapper[5120]: I0316 17:12:36.876293 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-mp7zl" Mar 16 17:12:36 crc kubenswrapper[5120]: I0316 17:12:36.883326 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"swift-proxy-config-data\"" Mar 16 17:12:36 crc kubenswrapper[5120]: I0316 17:12:36.883468 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"swift-ring-scripts\"" Mar 16 17:12:36 crc kubenswrapper[5120]: I0316 17:12:36.883726 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"swift-ring-config-data\"" Mar 16 17:12:36 crc kubenswrapper[5120]: I0316 17:12:36.892814 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-mp7zl"] Mar 16 17:12:36 crc kubenswrapper[5120]: I0316 17:12:36.918833 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovn-northd-0" podStartSLOduration=2.918815205 podStartE2EDuration="2.918815205s" podCreationTimestamp="2026-03-16 17:12:34 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:12:36.8894079 +0000 UTC m=+6059.043339557" watchObservedRunningTime="2026-03-16 17:12:36.918815205 +0000 UTC m=+6059.072746852" Mar 16 17:12:36 crc kubenswrapper[5120]: I0316 17:12:36.932361 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-1cd2-account-create-update-rs7cb"] Mar 16 17:12:36 crc kubenswrapper[5120]: I0316 17:12:36.937190 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-1cd2-account-create-update-rs7cb" Mar 16 17:12:36 crc kubenswrapper[5120]: I0316 17:12:36.939342 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-db-secret\"" Mar 16 17:12:36 crc kubenswrapper[5120]: I0316 17:12:36.948310 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-db-create-c7jh9"] Mar 16 17:12:36 crc kubenswrapper[5120]: I0316 17:12:36.954690 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-create-c7jh9" Mar 16 17:12:36 crc kubenswrapper[5120]: I0316 17:12:36.965608 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-1cd2-account-create-update-rs7cb"] Mar 16 17:12:36 crc kubenswrapper[5120]: I0316 17:12:36.974846 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-db-create-c7jh9"] Mar 16 17:12:37 crc kubenswrapper[5120]: I0316 17:12:37.011143 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/root-account-create-update-sdcsd"] Mar 16 17:12:37 crc kubenswrapper[5120]: I0316 17:12:37.016331 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-sdcsd" Mar 16 17:12:37 crc kubenswrapper[5120]: I0316 17:12:37.016325 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxksk\" (UniqueName: \"kubernetes.io/projected/39b9a721-a37f-492d-bda7-bcab36745d51-kube-api-access-xxksk\") pod \"glance-1cd2-account-create-update-rs7cb\" (UID: \"39b9a721-a37f-492d-bda7-bcab36745d51\") " pod="openstack-kuttl-tests/glance-1cd2-account-create-update-rs7cb" Mar 16 17:12:37 crc kubenswrapper[5120]: I0316 17:12:37.017111 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/39b9a721-a37f-492d-bda7-bcab36745d51-operator-scripts\") pod \"glance-1cd2-account-create-update-rs7cb\" (UID: \"39b9a721-a37f-492d-bda7-bcab36745d51\") " pod="openstack-kuttl-tests/glance-1cd2-account-create-update-rs7cb" Mar 16 17:12:37 crc kubenswrapper[5120]: I0316 17:12:37.017439 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/65750464-ddac-4787-86cc-48f32f31cd92-ring-data-devices\") pod \"swift-ring-rebalance-mp7zl\" (UID: \"65750464-ddac-4787-86cc-48f32f31cd92\") " pod="openstack-kuttl-tests/swift-ring-rebalance-mp7zl" Mar 16 17:12:37 crc kubenswrapper[5120]: I0316 17:12:37.017748 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/65750464-ddac-4787-86cc-48f32f31cd92-dispersionconf\") pod \"swift-ring-rebalance-mp7zl\" (UID: \"65750464-ddac-4787-86cc-48f32f31cd92\") " pod="openstack-kuttl-tests/swift-ring-rebalance-mp7zl" Mar 16 17:12:37 crc kubenswrapper[5120]: I0316 17:12:37.017881 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/65750464-ddac-4787-86cc-48f32f31cd92-scripts\") pod \"swift-ring-rebalance-mp7zl\" (UID: \"65750464-ddac-4787-86cc-48f32f31cd92\") " pod="openstack-kuttl-tests/swift-ring-rebalance-mp7zl" Mar 16 17:12:37 crc kubenswrapper[5120]: I0316 17:12:37.018130 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/65750464-ddac-4787-86cc-48f32f31cd92-combined-ca-bundle\") pod \"swift-ring-rebalance-mp7zl\" (UID: \"65750464-ddac-4787-86cc-48f32f31cd92\") " pod="openstack-kuttl-tests/swift-ring-rebalance-mp7zl" Mar 16 17:12:37 crc kubenswrapper[5120]: I0316 17:12:37.018172 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8m7l\" (UniqueName: \"kubernetes.io/projected/65750464-ddac-4787-86cc-48f32f31cd92-kube-api-access-c8m7l\") pod \"swift-ring-rebalance-mp7zl\" (UID: \"65750464-ddac-4787-86cc-48f32f31cd92\") " pod="openstack-kuttl-tests/swift-ring-rebalance-mp7zl" Mar 16 17:12:37 crc kubenswrapper[5120]: I0316 17:12:37.018245 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/65750464-ddac-4787-86cc-48f32f31cd92-etc-swift\") pod \"swift-ring-rebalance-mp7zl\" (UID: \"65750464-ddac-4787-86cc-48f32f31cd92\") " pod="openstack-kuttl-tests/swift-ring-rebalance-mp7zl" Mar 16 17:12:37 crc kubenswrapper[5120]: I0316 17:12:37.018290 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/65750464-ddac-4787-86cc-48f32f31cd92-swiftconf\") pod \"swift-ring-rebalance-mp7zl\" (UID: \"65750464-ddac-4787-86cc-48f32f31cd92\") " pod="openstack-kuttl-tests/swift-ring-rebalance-mp7zl" Mar 16 17:12:37 crc kubenswrapper[5120]: I0316 17:12:37.019668 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"openstack-mariadb-root-db-secret\"" Mar 16 17:12:37 crc kubenswrapper[5120]: I0316 17:12:37.021187 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-sdcsd"] Mar 16 17:12:37 crc kubenswrapper[5120]: I0316 17:12:37.120643 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/65750464-ddac-4787-86cc-48f32f31cd92-scripts\") pod \"swift-ring-rebalance-mp7zl\" (UID: \"65750464-ddac-4787-86cc-48f32f31cd92\") " pod="openstack-kuttl-tests/swift-ring-rebalance-mp7zl" Mar 16 17:12:37 crc kubenswrapper[5120]: I0316 17:12:37.121098 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/65750464-ddac-4787-86cc-48f32f31cd92-combined-ca-bundle\") pod \"swift-ring-rebalance-mp7zl\" (UID: \"65750464-ddac-4787-86cc-48f32f31cd92\") " pod="openstack-kuttl-tests/swift-ring-rebalance-mp7zl" Mar 16 17:12:37 crc kubenswrapper[5120]: I0316 17:12:37.121128 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c8m7l\" (UniqueName: \"kubernetes.io/projected/65750464-ddac-4787-86cc-48f32f31cd92-kube-api-access-c8m7l\") pod \"swift-ring-rebalance-mp7zl\" (UID: \"65750464-ddac-4787-86cc-48f32f31cd92\") " pod="openstack-kuttl-tests/swift-ring-rebalance-mp7zl" Mar 16 17:12:37 crc kubenswrapper[5120]: I0316 17:12:37.121164 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/65750464-ddac-4787-86cc-48f32f31cd92-etc-swift\") pod \"swift-ring-rebalance-mp7zl\" (UID: \"65750464-ddac-4787-86cc-48f32f31cd92\") " pod="openstack-kuttl-tests/swift-ring-rebalance-mp7zl" Mar 16 17:12:37 crc kubenswrapper[5120]: I0316 17:12:37.121196 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/65750464-ddac-4787-86cc-48f32f31cd92-swiftconf\") pod \"swift-ring-rebalance-mp7zl\" (UID: \"65750464-ddac-4787-86cc-48f32f31cd92\") " pod="openstack-kuttl-tests/swift-ring-rebalance-mp7zl" Mar 16 17:12:37 crc kubenswrapper[5120]: I0316 17:12:37.121281 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xxksk\" (UniqueName: \"kubernetes.io/projected/39b9a721-a37f-492d-bda7-bcab36745d51-kube-api-access-xxksk\") pod \"glance-1cd2-account-create-update-rs7cb\" (UID: \"39b9a721-a37f-492d-bda7-bcab36745d51\") " pod="openstack-kuttl-tests/glance-1cd2-account-create-update-rs7cb" Mar 16 17:12:37 crc kubenswrapper[5120]: I0316 17:12:37.121349 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/85361496-a0c1-4443-855e-3e90027ae687-operator-scripts\") pod \"root-account-create-update-sdcsd\" (UID: \"85361496-a0c1-4443-855e-3e90027ae687\") " pod="openstack-kuttl-tests/root-account-create-update-sdcsd" Mar 16 17:12:37 crc kubenswrapper[5120]: I0316 17:12:37.121375 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frmsg\" (UniqueName: \"kubernetes.io/projected/85361496-a0c1-4443-855e-3e90027ae687-kube-api-access-frmsg\") pod \"root-account-create-update-sdcsd\" (UID: \"85361496-a0c1-4443-855e-3e90027ae687\") " pod="openstack-kuttl-tests/root-account-create-update-sdcsd" Mar 16 17:12:37 crc kubenswrapper[5120]: I0316 17:12:37.121400 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/39b9a721-a37f-492d-bda7-bcab36745d51-operator-scripts\") pod \"glance-1cd2-account-create-update-rs7cb\" (UID: \"39b9a721-a37f-492d-bda7-bcab36745d51\") " pod="openstack-kuttl-tests/glance-1cd2-account-create-update-rs7cb" Mar 16 17:12:37 crc kubenswrapper[5120]: I0316 17:12:37.121473 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/65750464-ddac-4787-86cc-48f32f31cd92-ring-data-devices\") pod \"swift-ring-rebalance-mp7zl\" (UID: \"65750464-ddac-4787-86cc-48f32f31cd92\") " pod="openstack-kuttl-tests/swift-ring-rebalance-mp7zl" Mar 16 17:12:37 crc kubenswrapper[5120]: I0316 17:12:37.121541 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/665bd399-ccb7-4bf2-9191-2ce1b60e186f-operator-scripts\") pod \"glance-db-create-c7jh9\" (UID: \"665bd399-ccb7-4bf2-9191-2ce1b60e186f\") " pod="openstack-kuttl-tests/glance-db-create-c7jh9" Mar 16 17:12:37 crc kubenswrapper[5120]: I0316 17:12:37.121562 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwfxc\" (UniqueName: \"kubernetes.io/projected/665bd399-ccb7-4bf2-9191-2ce1b60e186f-kube-api-access-pwfxc\") pod \"glance-db-create-c7jh9\" (UID: \"665bd399-ccb7-4bf2-9191-2ce1b60e186f\") " pod="openstack-kuttl-tests/glance-db-create-c7jh9" Mar 16 17:12:37 crc kubenswrapper[5120]: I0316 17:12:37.121627 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/65750464-ddac-4787-86cc-48f32f31cd92-dispersionconf\") pod \"swift-ring-rebalance-mp7zl\" (UID: \"65750464-ddac-4787-86cc-48f32f31cd92\") " pod="openstack-kuttl-tests/swift-ring-rebalance-mp7zl" Mar 16 17:12:37 crc kubenswrapper[5120]: I0316 17:12:37.121894 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/65750464-ddac-4787-86cc-48f32f31cd92-scripts\") pod \"swift-ring-rebalance-mp7zl\" (UID: \"65750464-ddac-4787-86cc-48f32f31cd92\") " pod="openstack-kuttl-tests/swift-ring-rebalance-mp7zl" Mar 16 17:12:37 crc kubenswrapper[5120]: I0316 17:12:37.122747 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/65750464-ddac-4787-86cc-48f32f31cd92-etc-swift\") pod \"swift-ring-rebalance-mp7zl\" (UID: \"65750464-ddac-4787-86cc-48f32f31cd92\") " pod="openstack-kuttl-tests/swift-ring-rebalance-mp7zl" Mar 16 17:12:37 crc kubenswrapper[5120]: I0316 17:12:37.123106 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/39b9a721-a37f-492d-bda7-bcab36745d51-operator-scripts\") pod \"glance-1cd2-account-create-update-rs7cb\" (UID: \"39b9a721-a37f-492d-bda7-bcab36745d51\") " pod="openstack-kuttl-tests/glance-1cd2-account-create-update-rs7cb" Mar 16 17:12:37 crc kubenswrapper[5120]: I0316 17:12:37.124282 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/65750464-ddac-4787-86cc-48f32f31cd92-ring-data-devices\") pod \"swift-ring-rebalance-mp7zl\" (UID: \"65750464-ddac-4787-86cc-48f32f31cd92\") " pod="openstack-kuttl-tests/swift-ring-rebalance-mp7zl" Mar 16 17:12:37 crc kubenswrapper[5120]: I0316 17:12:37.135574 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/65750464-ddac-4787-86cc-48f32f31cd92-dispersionconf\") pod \"swift-ring-rebalance-mp7zl\" (UID: \"65750464-ddac-4787-86cc-48f32f31cd92\") " pod="openstack-kuttl-tests/swift-ring-rebalance-mp7zl" Mar 16 17:12:37 crc kubenswrapper[5120]: I0316 17:12:37.135691 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/65750464-ddac-4787-86cc-48f32f31cd92-combined-ca-bundle\") pod \"swift-ring-rebalance-mp7zl\" (UID: \"65750464-ddac-4787-86cc-48f32f31cd92\") " pod="openstack-kuttl-tests/swift-ring-rebalance-mp7zl" Mar 16 17:12:37 crc kubenswrapper[5120]: I0316 17:12:37.137613 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/65750464-ddac-4787-86cc-48f32f31cd92-swiftconf\") pod \"swift-ring-rebalance-mp7zl\" (UID: \"65750464-ddac-4787-86cc-48f32f31cd92\") " pod="openstack-kuttl-tests/swift-ring-rebalance-mp7zl" Mar 16 17:12:37 crc kubenswrapper[5120]: I0316 17:12:37.138998 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxksk\" (UniqueName: \"kubernetes.io/projected/39b9a721-a37f-492d-bda7-bcab36745d51-kube-api-access-xxksk\") pod \"glance-1cd2-account-create-update-rs7cb\" (UID: \"39b9a721-a37f-492d-bda7-bcab36745d51\") " pod="openstack-kuttl-tests/glance-1cd2-account-create-update-rs7cb" Mar 16 17:12:37 crc kubenswrapper[5120]: I0316 17:12:37.140745 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8m7l\" (UniqueName: \"kubernetes.io/projected/65750464-ddac-4787-86cc-48f32f31cd92-kube-api-access-c8m7l\") pod \"swift-ring-rebalance-mp7zl\" (UID: \"65750464-ddac-4787-86cc-48f32f31cd92\") " pod="openstack-kuttl-tests/swift-ring-rebalance-mp7zl" Mar 16 17:12:37 crc kubenswrapper[5120]: I0316 17:12:37.224115 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/85361496-a0c1-4443-855e-3e90027ae687-operator-scripts\") pod \"root-account-create-update-sdcsd\" (UID: \"85361496-a0c1-4443-855e-3e90027ae687\") " pod="openstack-kuttl-tests/root-account-create-update-sdcsd" Mar 16 17:12:37 crc kubenswrapper[5120]: I0316 17:12:37.224167 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-frmsg\" (UniqueName: \"kubernetes.io/projected/85361496-a0c1-4443-855e-3e90027ae687-kube-api-access-frmsg\") pod \"root-account-create-update-sdcsd\" (UID: \"85361496-a0c1-4443-855e-3e90027ae687\") " pod="openstack-kuttl-tests/root-account-create-update-sdcsd" Mar 16 17:12:37 crc kubenswrapper[5120]: I0316 17:12:37.224291 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/665bd399-ccb7-4bf2-9191-2ce1b60e186f-operator-scripts\") pod \"glance-db-create-c7jh9\" (UID: \"665bd399-ccb7-4bf2-9191-2ce1b60e186f\") " pod="openstack-kuttl-tests/glance-db-create-c7jh9" Mar 16 17:12:37 crc kubenswrapper[5120]: I0316 17:12:37.224322 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pwfxc\" (UniqueName: \"kubernetes.io/projected/665bd399-ccb7-4bf2-9191-2ce1b60e186f-kube-api-access-pwfxc\") pod \"glance-db-create-c7jh9\" (UID: \"665bd399-ccb7-4bf2-9191-2ce1b60e186f\") " pod="openstack-kuttl-tests/glance-db-create-c7jh9" Mar 16 17:12:37 crc kubenswrapper[5120]: I0316 17:12:37.225296 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/665bd399-ccb7-4bf2-9191-2ce1b60e186f-operator-scripts\") pod \"glance-db-create-c7jh9\" (UID: \"665bd399-ccb7-4bf2-9191-2ce1b60e186f\") " pod="openstack-kuttl-tests/glance-db-create-c7jh9" Mar 16 17:12:37 crc kubenswrapper[5120]: I0316 17:12:37.225308 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/85361496-a0c1-4443-855e-3e90027ae687-operator-scripts\") pod \"root-account-create-update-sdcsd\" (UID: \"85361496-a0c1-4443-855e-3e90027ae687\") " pod="openstack-kuttl-tests/root-account-create-update-sdcsd" Mar 16 17:12:37 crc kubenswrapper[5120]: I0316 17:12:37.236372 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-mp7zl" Mar 16 17:12:37 crc kubenswrapper[5120]: I0316 17:12:37.242852 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-frmsg\" (UniqueName: \"kubernetes.io/projected/85361496-a0c1-4443-855e-3e90027ae687-kube-api-access-frmsg\") pod \"root-account-create-update-sdcsd\" (UID: \"85361496-a0c1-4443-855e-3e90027ae687\") " pod="openstack-kuttl-tests/root-account-create-update-sdcsd" Mar 16 17:12:37 crc kubenswrapper[5120]: I0316 17:12:37.243955 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwfxc\" (UniqueName: \"kubernetes.io/projected/665bd399-ccb7-4bf2-9191-2ce1b60e186f-kube-api-access-pwfxc\") pod \"glance-db-create-c7jh9\" (UID: \"665bd399-ccb7-4bf2-9191-2ce1b60e186f\") " pod="openstack-kuttl-tests/glance-db-create-c7jh9" Mar 16 17:12:37 crc kubenswrapper[5120]: I0316 17:12:37.256453 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-1cd2-account-create-update-rs7cb" Mar 16 17:12:37 crc kubenswrapper[5120]: I0316 17:12:37.272895 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-create-c7jh9" Mar 16 17:12:37 crc kubenswrapper[5120]: I0316 17:12:37.331141 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-sdcsd" Mar 16 17:12:37 crc kubenswrapper[5120]: I0316 17:12:37.758883 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-mp7zl"] Mar 16 17:12:37 crc kubenswrapper[5120]: I0316 17:12:37.854597 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-1cd2-account-create-update-rs7cb"] Mar 16 17:12:37 crc kubenswrapper[5120]: W0316 17:12:37.858393 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod39b9a721_a37f_492d_bda7_bcab36745d51.slice/crio-a3120a30da9627bc3fb5b1028b356870950937d439578b4a05180e81888898bc WatchSource:0}: Error finding container a3120a30da9627bc3fb5b1028b356870950937d439578b4a05180e81888898bc: Status 404 returned error can't find the container with id a3120a30da9627bc3fb5b1028b356870950937d439578b4a05180e81888898bc Mar 16 17:12:37 crc kubenswrapper[5120]: I0316 17:12:37.888595 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-1cd2-account-create-update-rs7cb" event={"ID":"39b9a721-a37f-492d-bda7-bcab36745d51","Type":"ContainerStarted","Data":"a3120a30da9627bc3fb5b1028b356870950937d439578b4a05180e81888898bc"} Mar 16 17:12:37 crc kubenswrapper[5120]: I0316 17:12:37.890838 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-mp7zl" event={"ID":"65750464-ddac-4787-86cc-48f32f31cd92","Type":"ContainerStarted","Data":"48f6a8370d03bf767087304ae693802e313c8a6ed120490f16f2d04252897c76"} Mar 16 17:12:37 crc kubenswrapper[5120]: W0316 17:12:37.933290 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod85361496_a0c1_4443_855e_3e90027ae687.slice/crio-bf0be13d610bc3c1a2b44734d582855f9c64059c63ed18fd15b7b2096bf7846a WatchSource:0}: Error finding container bf0be13d610bc3c1a2b44734d582855f9c64059c63ed18fd15b7b2096bf7846a: Status 404 returned error can't find the container with id bf0be13d610bc3c1a2b44734d582855f9c64059c63ed18fd15b7b2096bf7846a Mar 16 17:12:37 crc kubenswrapper[5120]: I0316 17:12:37.934279 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-db-create-c7jh9"] Mar 16 17:12:37 crc kubenswrapper[5120]: W0316 17:12:37.941701 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod665bd399_ccb7_4bf2_9191_2ce1b60e186f.slice/crio-480d1e88e283ff714d5a5eb2475b5fe519ef5f450be6153f9c2794ab1657d841 WatchSource:0}: Error finding container 480d1e88e283ff714d5a5eb2475b5fe519ef5f450be6153f9c2794ab1657d841: Status 404 returned error can't find the container with id 480d1e88e283ff714d5a5eb2475b5fe519ef5f450be6153f9c2794ab1657d841 Mar 16 17:12:37 crc kubenswrapper[5120]: I0316 17:12:37.943453 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-sdcsd"] Mar 16 17:12:38 crc kubenswrapper[5120]: I0316 17:12:38.900928 5120 generic.go:358] "Generic (PLEG): container finished" podID="665bd399-ccb7-4bf2-9191-2ce1b60e186f" containerID="88180a4f67ed3bff905e1f6be167115e787ec8cccecd86c9e10de0d2f1ec9552" exitCode=0 Mar 16 17:12:38 crc kubenswrapper[5120]: I0316 17:12:38.901145 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-create-c7jh9" event={"ID":"665bd399-ccb7-4bf2-9191-2ce1b60e186f","Type":"ContainerDied","Data":"88180a4f67ed3bff905e1f6be167115e787ec8cccecd86c9e10de0d2f1ec9552"} Mar 16 17:12:38 crc kubenswrapper[5120]: I0316 17:12:38.901642 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-create-c7jh9" event={"ID":"665bd399-ccb7-4bf2-9191-2ce1b60e186f","Type":"ContainerStarted","Data":"480d1e88e283ff714d5a5eb2475b5fe519ef5f450be6153f9c2794ab1657d841"} Mar 16 17:12:38 crc kubenswrapper[5120]: I0316 17:12:38.903451 5120 generic.go:358] "Generic (PLEG): container finished" podID="85361496-a0c1-4443-855e-3e90027ae687" containerID="1f305d3cc6ba203f42b9f60916dd473f8ddf20a228d06deb7866482ffd229f4a" exitCode=0 Mar 16 17:12:38 crc kubenswrapper[5120]: I0316 17:12:38.903521 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-sdcsd" event={"ID":"85361496-a0c1-4443-855e-3e90027ae687","Type":"ContainerDied","Data":"1f305d3cc6ba203f42b9f60916dd473f8ddf20a228d06deb7866482ffd229f4a"} Mar 16 17:12:38 crc kubenswrapper[5120]: I0316 17:12:38.903556 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-sdcsd" event={"ID":"85361496-a0c1-4443-855e-3e90027ae687","Type":"ContainerStarted","Data":"bf0be13d610bc3c1a2b44734d582855f9c64059c63ed18fd15b7b2096bf7846a"} Mar 16 17:12:38 crc kubenswrapper[5120]: I0316 17:12:38.905734 5120 generic.go:358] "Generic (PLEG): container finished" podID="39b9a721-a37f-492d-bda7-bcab36745d51" containerID="e628fc912c1467db9883e28ceeac1aeef2784d2e81cf171898fdcd4591d9ff69" exitCode=0 Mar 16 17:12:38 crc kubenswrapper[5120]: I0316 17:12:38.905838 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-1cd2-account-create-update-rs7cb" event={"ID":"39b9a721-a37f-492d-bda7-bcab36745d51","Type":"ContainerDied","Data":"e628fc912c1467db9883e28ceeac1aeef2784d2e81cf171898fdcd4591d9ff69"} Mar 16 17:12:38 crc kubenswrapper[5120]: I0316 17:12:38.909311 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-mp7zl" event={"ID":"65750464-ddac-4787-86cc-48f32f31cd92","Type":"ContainerStarted","Data":"916f8fa8d131f943de104d80c229bd1697666761f8416620cd7bde98f09d18c5"} Mar 16 17:12:38 crc kubenswrapper[5120]: I0316 17:12:38.948787 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/swift-ring-rebalance-mp7zl" podStartSLOduration=2.948733472 podStartE2EDuration="2.948733472s" podCreationTimestamp="2026-03-16 17:12:36 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:12:38.934086772 +0000 UTC m=+6061.088018429" watchObservedRunningTime="2026-03-16 17:12:38.948733472 +0000 UTC m=+6061.102665139" Mar 16 17:12:40 crc kubenswrapper[5120]: I0316 17:12:40.457396 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-create-c7jh9" Mar 16 17:12:40 crc kubenswrapper[5120]: I0316 17:12:40.465622 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-1cd2-account-create-update-rs7cb" Mar 16 17:12:40 crc kubenswrapper[5120]: I0316 17:12:40.470816 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-sdcsd" Mar 16 17:12:40 crc kubenswrapper[5120]: I0316 17:12:40.519616 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-frmsg\" (UniqueName: \"kubernetes.io/projected/85361496-a0c1-4443-855e-3e90027ae687-kube-api-access-frmsg\") pod \"85361496-a0c1-4443-855e-3e90027ae687\" (UID: \"85361496-a0c1-4443-855e-3e90027ae687\") " Mar 16 17:12:40 crc kubenswrapper[5120]: I0316 17:12:40.520059 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/85361496-a0c1-4443-855e-3e90027ae687-operator-scripts\") pod \"85361496-a0c1-4443-855e-3e90027ae687\" (UID: \"85361496-a0c1-4443-855e-3e90027ae687\") " Mar 16 17:12:40 crc kubenswrapper[5120]: I0316 17:12:40.520309 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/665bd399-ccb7-4bf2-9191-2ce1b60e186f-operator-scripts\") pod \"665bd399-ccb7-4bf2-9191-2ce1b60e186f\" (UID: \"665bd399-ccb7-4bf2-9191-2ce1b60e186f\") " Mar 16 17:12:40 crc kubenswrapper[5120]: I0316 17:12:40.520416 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pwfxc\" (UniqueName: \"kubernetes.io/projected/665bd399-ccb7-4bf2-9191-2ce1b60e186f-kube-api-access-pwfxc\") pod \"665bd399-ccb7-4bf2-9191-2ce1b60e186f\" (UID: \"665bd399-ccb7-4bf2-9191-2ce1b60e186f\") " Mar 16 17:12:40 crc kubenswrapper[5120]: I0316 17:12:40.520529 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/39b9a721-a37f-492d-bda7-bcab36745d51-operator-scripts\") pod \"39b9a721-a37f-492d-bda7-bcab36745d51\" (UID: \"39b9a721-a37f-492d-bda7-bcab36745d51\") " Mar 16 17:12:40 crc kubenswrapper[5120]: I0316 17:12:40.520851 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xxksk\" (UniqueName: \"kubernetes.io/projected/39b9a721-a37f-492d-bda7-bcab36745d51-kube-api-access-xxksk\") pod \"39b9a721-a37f-492d-bda7-bcab36745d51\" (UID: \"39b9a721-a37f-492d-bda7-bcab36745d51\") " Mar 16 17:12:40 crc kubenswrapper[5120]: I0316 17:12:40.520544 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/85361496-a0c1-4443-855e-3e90027ae687-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "85361496-a0c1-4443-855e-3e90027ae687" (UID: "85361496-a0c1-4443-855e-3e90027ae687"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:12:40 crc kubenswrapper[5120]: I0316 17:12:40.521099 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/665bd399-ccb7-4bf2-9191-2ce1b60e186f-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "665bd399-ccb7-4bf2-9191-2ce1b60e186f" (UID: "665bd399-ccb7-4bf2-9191-2ce1b60e186f"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:12:40 crc kubenswrapper[5120]: I0316 17:12:40.521460 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39b9a721-a37f-492d-bda7-bcab36745d51-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "39b9a721-a37f-492d-bda7-bcab36745d51" (UID: "39b9a721-a37f-492d-bda7-bcab36745d51"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:12:40 crc kubenswrapper[5120]: I0316 17:12:40.522010 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/85361496-a0c1-4443-855e-3e90027ae687-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:12:40 crc kubenswrapper[5120]: I0316 17:12:40.522109 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/665bd399-ccb7-4bf2-9191-2ce1b60e186f-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:12:40 crc kubenswrapper[5120]: I0316 17:12:40.522179 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/39b9a721-a37f-492d-bda7-bcab36745d51-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:12:40 crc kubenswrapper[5120]: I0316 17:12:40.531424 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/665bd399-ccb7-4bf2-9191-2ce1b60e186f-kube-api-access-pwfxc" (OuterVolumeSpecName: "kube-api-access-pwfxc") pod "665bd399-ccb7-4bf2-9191-2ce1b60e186f" (UID: "665bd399-ccb7-4bf2-9191-2ce1b60e186f"). InnerVolumeSpecName "kube-api-access-pwfxc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:12:40 crc kubenswrapper[5120]: I0316 17:12:40.531489 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39b9a721-a37f-492d-bda7-bcab36745d51-kube-api-access-xxksk" (OuterVolumeSpecName: "kube-api-access-xxksk") pod "39b9a721-a37f-492d-bda7-bcab36745d51" (UID: "39b9a721-a37f-492d-bda7-bcab36745d51"). InnerVolumeSpecName "kube-api-access-xxksk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:12:40 crc kubenswrapper[5120]: I0316 17:12:40.531514 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85361496-a0c1-4443-855e-3e90027ae687-kube-api-access-frmsg" (OuterVolumeSpecName: "kube-api-access-frmsg") pod "85361496-a0c1-4443-855e-3e90027ae687" (UID: "85361496-a0c1-4443-855e-3e90027ae687"). InnerVolumeSpecName "kube-api-access-frmsg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:12:40 crc kubenswrapper[5120]: I0316 17:12:40.624990 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pwfxc\" (UniqueName: \"kubernetes.io/projected/665bd399-ccb7-4bf2-9191-2ce1b60e186f-kube-api-access-pwfxc\") on node \"crc\" DevicePath \"\"" Mar 16 17:12:40 crc kubenswrapper[5120]: I0316 17:12:40.625022 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xxksk\" (UniqueName: \"kubernetes.io/projected/39b9a721-a37f-492d-bda7-bcab36745d51-kube-api-access-xxksk\") on node \"crc\" DevicePath \"\"" Mar 16 17:12:40 crc kubenswrapper[5120]: I0316 17:12:40.625032 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-frmsg\" (UniqueName: \"kubernetes.io/projected/85361496-a0c1-4443-855e-3e90027ae687-kube-api-access-frmsg\") on node \"crc\" DevicePath \"\"" Mar 16 17:12:40 crc kubenswrapper[5120]: I0316 17:12:40.784192 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-db-create-kn6wh"] Mar 16 17:12:40 crc kubenswrapper[5120]: I0316 17:12:40.785341 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39b9a721-a37f-492d-bda7-bcab36745d51" containerName="mariadb-account-create-update" Mar 16 17:12:40 crc kubenswrapper[5120]: I0316 17:12:40.785356 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="39b9a721-a37f-492d-bda7-bcab36745d51" containerName="mariadb-account-create-update" Mar 16 17:12:40 crc kubenswrapper[5120]: I0316 17:12:40.785383 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85361496-a0c1-4443-855e-3e90027ae687" containerName="mariadb-account-create-update" Mar 16 17:12:40 crc kubenswrapper[5120]: I0316 17:12:40.785389 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="85361496-a0c1-4443-855e-3e90027ae687" containerName="mariadb-account-create-update" Mar 16 17:12:40 crc kubenswrapper[5120]: I0316 17:12:40.785408 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="665bd399-ccb7-4bf2-9191-2ce1b60e186f" containerName="mariadb-database-create" Mar 16 17:12:40 crc kubenswrapper[5120]: I0316 17:12:40.785414 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="665bd399-ccb7-4bf2-9191-2ce1b60e186f" containerName="mariadb-database-create" Mar 16 17:12:40 crc kubenswrapper[5120]: I0316 17:12:40.785572 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="85361496-a0c1-4443-855e-3e90027ae687" containerName="mariadb-account-create-update" Mar 16 17:12:40 crc kubenswrapper[5120]: I0316 17:12:40.785594 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="665bd399-ccb7-4bf2-9191-2ce1b60e186f" containerName="mariadb-database-create" Mar 16 17:12:40 crc kubenswrapper[5120]: I0316 17:12:40.785600 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="39b9a721-a37f-492d-bda7-bcab36745d51" containerName="mariadb-account-create-update" Mar 16 17:12:40 crc kubenswrapper[5120]: I0316 17:12:40.796451 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-create-kn6wh" Mar 16 17:12:40 crc kubenswrapper[5120]: I0316 17:12:40.796943 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-db-create-kn6wh"] Mar 16 17:12:40 crc kubenswrapper[5120]: I0316 17:12:40.845979 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/453261b9-e47c-4e0b-b37d-4803c7ea4eab-etc-swift\") pod \"swift-storage-0\" (UID: \"453261b9-e47c-4e0b-b37d-4803c7ea4eab\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 17:12:40 crc kubenswrapper[5120]: E0316 17:12:40.846148 5120 projected.go:289] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Mar 16 17:12:40 crc kubenswrapper[5120]: E0316 17:12:40.846171 5120 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Mar 16 17:12:40 crc kubenswrapper[5120]: E0316 17:12:40.846244 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/453261b9-e47c-4e0b-b37d-4803c7ea4eab-etc-swift podName:453261b9-e47c-4e0b-b37d-4803c7ea4eab nodeName:}" failed. No retries permitted until 2026-03-16 17:12:48.846221276 +0000 UTC m=+6071.000152943 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/453261b9-e47c-4e0b-b37d-4803c7ea4eab-etc-swift") pod "swift-storage-0" (UID: "453261b9-e47c-4e0b-b37d-4803c7ea4eab") : configmap "swift-ring-files" not found Mar 16 17:12:40 crc kubenswrapper[5120]: I0316 17:12:40.846322 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/87adc2e9-8943-4b49-a683-f929f03a8226-operator-scripts\") pod \"keystone-db-create-kn6wh\" (UID: \"87adc2e9-8943-4b49-a683-f929f03a8226\") " pod="openstack-kuttl-tests/keystone-db-create-kn6wh" Mar 16 17:12:40 crc kubenswrapper[5120]: I0316 17:12:40.846439 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ft9n\" (UniqueName: \"kubernetes.io/projected/87adc2e9-8943-4b49-a683-f929f03a8226-kube-api-access-5ft9n\") pod \"keystone-db-create-kn6wh\" (UID: \"87adc2e9-8943-4b49-a683-f929f03a8226\") " pod="openstack-kuttl-tests/keystone-db-create-kn6wh" Mar 16 17:12:40 crc kubenswrapper[5120]: I0316 17:12:40.925082 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-sdcsd" Mar 16 17:12:40 crc kubenswrapper[5120]: I0316 17:12:40.925080 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-sdcsd" event={"ID":"85361496-a0c1-4443-855e-3e90027ae687","Type":"ContainerDied","Data":"bf0be13d610bc3c1a2b44734d582855f9c64059c63ed18fd15b7b2096bf7846a"} Mar 16 17:12:40 crc kubenswrapper[5120]: I0316 17:12:40.925202 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bf0be13d610bc3c1a2b44734d582855f9c64059c63ed18fd15b7b2096bf7846a" Mar 16 17:12:40 crc kubenswrapper[5120]: I0316 17:12:40.926940 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-1cd2-account-create-update-rs7cb" Mar 16 17:12:40 crc kubenswrapper[5120]: I0316 17:12:40.927029 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-1cd2-account-create-update-rs7cb" event={"ID":"39b9a721-a37f-492d-bda7-bcab36745d51","Type":"ContainerDied","Data":"a3120a30da9627bc3fb5b1028b356870950937d439578b4a05180e81888898bc"} Mar 16 17:12:40 crc kubenswrapper[5120]: I0316 17:12:40.927095 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a3120a30da9627bc3fb5b1028b356870950937d439578b4a05180e81888898bc" Mar 16 17:12:40 crc kubenswrapper[5120]: I0316 17:12:40.928915 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-create-c7jh9" event={"ID":"665bd399-ccb7-4bf2-9191-2ce1b60e186f","Type":"ContainerDied","Data":"480d1e88e283ff714d5a5eb2475b5fe519ef5f450be6153f9c2794ab1657d841"} Mar 16 17:12:40 crc kubenswrapper[5120]: I0316 17:12:40.928942 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="480d1e88e283ff714d5a5eb2475b5fe519ef5f450be6153f9c2794ab1657d841" Mar 16 17:12:40 crc kubenswrapper[5120]: I0316 17:12:40.929022 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-create-c7jh9" Mar 16 17:12:40 crc kubenswrapper[5120]: I0316 17:12:40.949074 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/87adc2e9-8943-4b49-a683-f929f03a8226-operator-scripts\") pod \"keystone-db-create-kn6wh\" (UID: \"87adc2e9-8943-4b49-a683-f929f03a8226\") " pod="openstack-kuttl-tests/keystone-db-create-kn6wh" Mar 16 17:12:40 crc kubenswrapper[5120]: I0316 17:12:40.949423 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5ft9n\" (UniqueName: \"kubernetes.io/projected/87adc2e9-8943-4b49-a683-f929f03a8226-kube-api-access-5ft9n\") pod \"keystone-db-create-kn6wh\" (UID: \"87adc2e9-8943-4b49-a683-f929f03a8226\") " pod="openstack-kuttl-tests/keystone-db-create-kn6wh" Mar 16 17:12:40 crc kubenswrapper[5120]: I0316 17:12:40.950505 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/87adc2e9-8943-4b49-a683-f929f03a8226-operator-scripts\") pod \"keystone-db-create-kn6wh\" (UID: \"87adc2e9-8943-4b49-a683-f929f03a8226\") " pod="openstack-kuttl-tests/keystone-db-create-kn6wh" Mar 16 17:12:40 crc kubenswrapper[5120]: I0316 17:12:40.968865 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ft9n\" (UniqueName: \"kubernetes.io/projected/87adc2e9-8943-4b49-a683-f929f03a8226-kube-api-access-5ft9n\") pod \"keystone-db-create-kn6wh\" (UID: \"87adc2e9-8943-4b49-a683-f929f03a8226\") " pod="openstack-kuttl-tests/keystone-db-create-kn6wh" Mar 16 17:12:41 crc kubenswrapper[5120]: I0316 17:12:41.112654 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-create-kn6wh" Mar 16 17:12:41 crc kubenswrapper[5120]: I0316 17:12:41.571540 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-db-create-kn6wh"] Mar 16 17:12:41 crc kubenswrapper[5120]: I0316 17:12:41.939832 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-create-kn6wh" event={"ID":"87adc2e9-8943-4b49-a683-f929f03a8226","Type":"ContainerStarted","Data":"f6ec78841b79817c39e562a27445a24787a78a9398b9197a5b69eea49f13dc85"} Mar 16 17:12:41 crc kubenswrapper[5120]: I0316 17:12:41.940196 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-create-kn6wh" event={"ID":"87adc2e9-8943-4b49-a683-f929f03a8226","Type":"ContainerStarted","Data":"593569a43b91f89e8be2075a871411e5036cb9d0f3874c657135a92f1fec0df5"} Mar 16 17:12:41 crc kubenswrapper[5120]: I0316 17:12:41.955947 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-db-create-kn6wh" podStartSLOduration=1.9559287269999999 podStartE2EDuration="1.955928727s" podCreationTimestamp="2026-03-16 17:12:40 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:12:41.951692521 +0000 UTC m=+6064.105624198" watchObservedRunningTime="2026-03-16 17:12:41.955928727 +0000 UTC m=+6064.109860384" Mar 16 17:12:42 crc kubenswrapper[5120]: I0316 17:12:42.059662 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-db-sync-5jnpc"] Mar 16 17:12:42 crc kubenswrapper[5120]: I0316 17:12:42.066939 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-5jnpc" Mar 16 17:12:42 crc kubenswrapper[5120]: I0316 17:12:42.071828 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-glance-dockercfg-qdb94\"" Mar 16 17:12:42 crc kubenswrapper[5120]: I0316 17:12:42.072519 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-config-data\"" Mar 16 17:12:42 crc kubenswrapper[5120]: I0316 17:12:42.072634 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-5jnpc"] Mar 16 17:12:42 crc kubenswrapper[5120]: I0316 17:12:42.178603 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hc49\" (UniqueName: \"kubernetes.io/projected/5e487707-6cf9-42cb-924f-cc201ecbdb55-kube-api-access-7hc49\") pod \"glance-db-sync-5jnpc\" (UID: \"5e487707-6cf9-42cb-924f-cc201ecbdb55\") " pod="openstack-kuttl-tests/glance-db-sync-5jnpc" Mar 16 17:12:42 crc kubenswrapper[5120]: I0316 17:12:42.178711 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5e487707-6cf9-42cb-924f-cc201ecbdb55-config-data\") pod \"glance-db-sync-5jnpc\" (UID: \"5e487707-6cf9-42cb-924f-cc201ecbdb55\") " pod="openstack-kuttl-tests/glance-db-sync-5jnpc" Mar 16 17:12:42 crc kubenswrapper[5120]: I0316 17:12:42.179154 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/5e487707-6cf9-42cb-924f-cc201ecbdb55-db-sync-config-data\") pod \"glance-db-sync-5jnpc\" (UID: \"5e487707-6cf9-42cb-924f-cc201ecbdb55\") " pod="openstack-kuttl-tests/glance-db-sync-5jnpc" Mar 16 17:12:42 crc kubenswrapper[5120]: I0316 17:12:42.179315 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5e487707-6cf9-42cb-924f-cc201ecbdb55-combined-ca-bundle\") pod \"glance-db-sync-5jnpc\" (UID: \"5e487707-6cf9-42cb-924f-cc201ecbdb55\") " pod="openstack-kuttl-tests/glance-db-sync-5jnpc" Mar 16 17:12:42 crc kubenswrapper[5120]: I0316 17:12:42.281162 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/5e487707-6cf9-42cb-924f-cc201ecbdb55-db-sync-config-data\") pod \"glance-db-sync-5jnpc\" (UID: \"5e487707-6cf9-42cb-924f-cc201ecbdb55\") " pod="openstack-kuttl-tests/glance-db-sync-5jnpc" Mar 16 17:12:42 crc kubenswrapper[5120]: I0316 17:12:42.281340 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5e487707-6cf9-42cb-924f-cc201ecbdb55-combined-ca-bundle\") pod \"glance-db-sync-5jnpc\" (UID: \"5e487707-6cf9-42cb-924f-cc201ecbdb55\") " pod="openstack-kuttl-tests/glance-db-sync-5jnpc" Mar 16 17:12:42 crc kubenswrapper[5120]: I0316 17:12:42.281491 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7hc49\" (UniqueName: \"kubernetes.io/projected/5e487707-6cf9-42cb-924f-cc201ecbdb55-kube-api-access-7hc49\") pod \"glance-db-sync-5jnpc\" (UID: \"5e487707-6cf9-42cb-924f-cc201ecbdb55\") " pod="openstack-kuttl-tests/glance-db-sync-5jnpc" Mar 16 17:12:42 crc kubenswrapper[5120]: I0316 17:12:42.281584 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5e487707-6cf9-42cb-924f-cc201ecbdb55-config-data\") pod \"glance-db-sync-5jnpc\" (UID: \"5e487707-6cf9-42cb-924f-cc201ecbdb55\") " pod="openstack-kuttl-tests/glance-db-sync-5jnpc" Mar 16 17:12:42 crc kubenswrapper[5120]: I0316 17:12:42.287279 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/5e487707-6cf9-42cb-924f-cc201ecbdb55-db-sync-config-data\") pod \"glance-db-sync-5jnpc\" (UID: \"5e487707-6cf9-42cb-924f-cc201ecbdb55\") " pod="openstack-kuttl-tests/glance-db-sync-5jnpc" Mar 16 17:12:42 crc kubenswrapper[5120]: I0316 17:12:42.287399 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5e487707-6cf9-42cb-924f-cc201ecbdb55-config-data\") pod \"glance-db-sync-5jnpc\" (UID: \"5e487707-6cf9-42cb-924f-cc201ecbdb55\") " pod="openstack-kuttl-tests/glance-db-sync-5jnpc" Mar 16 17:12:42 crc kubenswrapper[5120]: I0316 17:12:42.289312 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5e487707-6cf9-42cb-924f-cc201ecbdb55-combined-ca-bundle\") pod \"glance-db-sync-5jnpc\" (UID: \"5e487707-6cf9-42cb-924f-cc201ecbdb55\") " pod="openstack-kuttl-tests/glance-db-sync-5jnpc" Mar 16 17:12:42 crc kubenswrapper[5120]: I0316 17:12:42.299853 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hc49\" (UniqueName: \"kubernetes.io/projected/5e487707-6cf9-42cb-924f-cc201ecbdb55-kube-api-access-7hc49\") pod \"glance-db-sync-5jnpc\" (UID: \"5e487707-6cf9-42cb-924f-cc201ecbdb55\") " pod="openstack-kuttl-tests/glance-db-sync-5jnpc" Mar 16 17:12:42 crc kubenswrapper[5120]: I0316 17:12:42.383141 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-5jnpc" Mar 16 17:12:42 crc kubenswrapper[5120]: I0316 17:12:42.803869 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-5jnpc"] Mar 16 17:12:42 crc kubenswrapper[5120]: W0316 17:12:42.806262 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5e487707_6cf9_42cb_924f_cc201ecbdb55.slice/crio-5da1780305cdab20fb5fcf53e6f84ff92cd42acb604fc47cc4ed7ffa5b5efbac WatchSource:0}: Error finding container 5da1780305cdab20fb5fcf53e6f84ff92cd42acb604fc47cc4ed7ffa5b5efbac: Status 404 returned error can't find the container with id 5da1780305cdab20fb5fcf53e6f84ff92cd42acb604fc47cc4ed7ffa5b5efbac Mar 16 17:12:42 crc kubenswrapper[5120]: I0316 17:12:42.959024 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-5jnpc" event={"ID":"5e487707-6cf9-42cb-924f-cc201ecbdb55","Type":"ContainerStarted","Data":"5da1780305cdab20fb5fcf53e6f84ff92cd42acb604fc47cc4ed7ffa5b5efbac"} Mar 16 17:12:42 crc kubenswrapper[5120]: I0316 17:12:42.962424 5120 generic.go:358] "Generic (PLEG): container finished" podID="87adc2e9-8943-4b49-a683-f929f03a8226" containerID="f6ec78841b79817c39e562a27445a24787a78a9398b9197a5b69eea49f13dc85" exitCode=0 Mar 16 17:12:42 crc kubenswrapper[5120]: I0316 17:12:42.962656 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-create-kn6wh" event={"ID":"87adc2e9-8943-4b49-a683-f929f03a8226","Type":"ContainerDied","Data":"f6ec78841b79817c39e562a27445a24787a78a9398b9197a5b69eea49f13dc85"} Mar 16 17:12:43 crc kubenswrapper[5120]: I0316 17:12:43.215276 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-sdcsd"] Mar 16 17:12:43 crc kubenswrapper[5120]: I0316 17:12:43.224840 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-sdcsd"] Mar 16 17:12:43 crc kubenswrapper[5120]: I0316 17:12:43.974797 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-5jnpc" event={"ID":"5e487707-6cf9-42cb-924f-cc201ecbdb55","Type":"ContainerStarted","Data":"200bbbe280bcacf20487461ecfc91d862b7f61454eb87ee1c78e3fae4984427d"} Mar 16 17:12:43 crc kubenswrapper[5120]: I0316 17:12:43.995935 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-db-sync-5jnpc" podStartSLOduration=1.995904419 podStartE2EDuration="1.995904419s" podCreationTimestamp="2026-03-16 17:12:42 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:12:43.995596881 +0000 UTC m=+6066.149528578" watchObservedRunningTime="2026-03-16 17:12:43.995904419 +0000 UTC m=+6066.149836116" Mar 16 17:12:44 crc kubenswrapper[5120]: I0316 17:12:44.365708 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-create-kn6wh" Mar 16 17:12:44 crc kubenswrapper[5120]: I0316 17:12:44.547045 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5ft9n\" (UniqueName: \"kubernetes.io/projected/87adc2e9-8943-4b49-a683-f929f03a8226-kube-api-access-5ft9n\") pod \"87adc2e9-8943-4b49-a683-f929f03a8226\" (UID: \"87adc2e9-8943-4b49-a683-f929f03a8226\") " Mar 16 17:12:44 crc kubenswrapper[5120]: I0316 17:12:44.547478 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/87adc2e9-8943-4b49-a683-f929f03a8226-operator-scripts\") pod \"87adc2e9-8943-4b49-a683-f929f03a8226\" (UID: \"87adc2e9-8943-4b49-a683-f929f03a8226\") " Mar 16 17:12:44 crc kubenswrapper[5120]: I0316 17:12:44.548494 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/87adc2e9-8943-4b49-a683-f929f03a8226-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "87adc2e9-8943-4b49-a683-f929f03a8226" (UID: "87adc2e9-8943-4b49-a683-f929f03a8226"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:12:44 crc kubenswrapper[5120]: I0316 17:12:44.554836 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87adc2e9-8943-4b49-a683-f929f03a8226-kube-api-access-5ft9n" (OuterVolumeSpecName: "kube-api-access-5ft9n") pod "87adc2e9-8943-4b49-a683-f929f03a8226" (UID: "87adc2e9-8943-4b49-a683-f929f03a8226"). InnerVolumeSpecName "kube-api-access-5ft9n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:12:44 crc kubenswrapper[5120]: I0316 17:12:44.650979 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5ft9n\" (UniqueName: \"kubernetes.io/projected/87adc2e9-8943-4b49-a683-f929f03a8226-kube-api-access-5ft9n\") on node \"crc\" DevicePath \"\"" Mar 16 17:12:44 crc kubenswrapper[5120]: I0316 17:12:44.651272 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/87adc2e9-8943-4b49-a683-f929f03a8226-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:12:44 crc kubenswrapper[5120]: I0316 17:12:44.680817 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="85361496-a0c1-4443-855e-3e90027ae687" path="/var/lib/kubelet/pods/85361496-a0c1-4443-855e-3e90027ae687/volumes" Mar 16 17:12:44 crc kubenswrapper[5120]: I0316 17:12:44.983901 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-create-kn6wh" Mar 16 17:12:44 crc kubenswrapper[5120]: I0316 17:12:44.983941 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-create-kn6wh" event={"ID":"87adc2e9-8943-4b49-a683-f929f03a8226","Type":"ContainerDied","Data":"593569a43b91f89e8be2075a871411e5036cb9d0f3874c657135a92f1fec0df5"} Mar 16 17:12:44 crc kubenswrapper[5120]: I0316 17:12:44.983973 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="593569a43b91f89e8be2075a871411e5036cb9d0f3874c657135a92f1fec0df5" Mar 16 17:12:44 crc kubenswrapper[5120]: I0316 17:12:44.986943 5120 generic.go:358] "Generic (PLEG): container finished" podID="65750464-ddac-4787-86cc-48f32f31cd92" containerID="916f8fa8d131f943de104d80c229bd1697666761f8416620cd7bde98f09d18c5" exitCode=0 Mar 16 17:12:44 crc kubenswrapper[5120]: I0316 17:12:44.986999 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-mp7zl" event={"ID":"65750464-ddac-4787-86cc-48f32f31cd92","Type":"ContainerDied","Data":"916f8fa8d131f943de104d80c229bd1697666761f8416620cd7bde98f09d18c5"} Mar 16 17:12:46 crc kubenswrapper[5120]: I0316 17:12:46.385829 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-mp7zl" Mar 16 17:12:46 crc kubenswrapper[5120]: I0316 17:12:46.502018 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/65750464-ddac-4787-86cc-48f32f31cd92-dispersionconf\") pod \"65750464-ddac-4787-86cc-48f32f31cd92\" (UID: \"65750464-ddac-4787-86cc-48f32f31cd92\") " Mar 16 17:12:46 crc kubenswrapper[5120]: I0316 17:12:46.502625 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/65750464-ddac-4787-86cc-48f32f31cd92-etc-swift\") pod \"65750464-ddac-4787-86cc-48f32f31cd92\" (UID: \"65750464-ddac-4787-86cc-48f32f31cd92\") " Mar 16 17:12:46 crc kubenswrapper[5120]: I0316 17:12:46.502808 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c8m7l\" (UniqueName: \"kubernetes.io/projected/65750464-ddac-4787-86cc-48f32f31cd92-kube-api-access-c8m7l\") pod \"65750464-ddac-4787-86cc-48f32f31cd92\" (UID: \"65750464-ddac-4787-86cc-48f32f31cd92\") " Mar 16 17:12:46 crc kubenswrapper[5120]: I0316 17:12:46.502962 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/65750464-ddac-4787-86cc-48f32f31cd92-scripts\") pod \"65750464-ddac-4787-86cc-48f32f31cd92\" (UID: \"65750464-ddac-4787-86cc-48f32f31cd92\") " Mar 16 17:12:46 crc kubenswrapper[5120]: I0316 17:12:46.503164 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/65750464-ddac-4787-86cc-48f32f31cd92-combined-ca-bundle\") pod \"65750464-ddac-4787-86cc-48f32f31cd92\" (UID: \"65750464-ddac-4787-86cc-48f32f31cd92\") " Mar 16 17:12:46 crc kubenswrapper[5120]: I0316 17:12:46.503454 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/65750464-ddac-4787-86cc-48f32f31cd92-ring-data-devices\") pod \"65750464-ddac-4787-86cc-48f32f31cd92\" (UID: \"65750464-ddac-4787-86cc-48f32f31cd92\") " Mar 16 17:12:46 crc kubenswrapper[5120]: I0316 17:12:46.504394 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/65750464-ddac-4787-86cc-48f32f31cd92-swiftconf\") pod \"65750464-ddac-4787-86cc-48f32f31cd92\" (UID: \"65750464-ddac-4787-86cc-48f32f31cd92\") " Mar 16 17:12:46 crc kubenswrapper[5120]: I0316 17:12:46.505100 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/65750464-ddac-4787-86cc-48f32f31cd92-ring-data-devices" (OuterVolumeSpecName: "ring-data-devices") pod "65750464-ddac-4787-86cc-48f32f31cd92" (UID: "65750464-ddac-4787-86cc-48f32f31cd92"). InnerVolumeSpecName "ring-data-devices". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:12:46 crc kubenswrapper[5120]: I0316 17:12:46.505688 5120 reconciler_common.go:299] "Volume detached for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/65750464-ddac-4787-86cc-48f32f31cd92-ring-data-devices\") on node \"crc\" DevicePath \"\"" Mar 16 17:12:46 crc kubenswrapper[5120]: I0316 17:12:46.505743 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65750464-ddac-4787-86cc-48f32f31cd92-etc-swift" (OuterVolumeSpecName: "etc-swift") pod "65750464-ddac-4787-86cc-48f32f31cd92" (UID: "65750464-ddac-4787-86cc-48f32f31cd92"). InnerVolumeSpecName "etc-swift". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:12:46 crc kubenswrapper[5120]: I0316 17:12:46.519294 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65750464-ddac-4787-86cc-48f32f31cd92-kube-api-access-c8m7l" (OuterVolumeSpecName: "kube-api-access-c8m7l") pod "65750464-ddac-4787-86cc-48f32f31cd92" (UID: "65750464-ddac-4787-86cc-48f32f31cd92"). InnerVolumeSpecName "kube-api-access-c8m7l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:12:46 crc kubenswrapper[5120]: I0316 17:12:46.523928 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/65750464-ddac-4787-86cc-48f32f31cd92-dispersionconf" (OuterVolumeSpecName: "dispersionconf") pod "65750464-ddac-4787-86cc-48f32f31cd92" (UID: "65750464-ddac-4787-86cc-48f32f31cd92"). InnerVolumeSpecName "dispersionconf". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:12:46 crc kubenswrapper[5120]: I0316 17:12:46.524340 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/65750464-ddac-4787-86cc-48f32f31cd92-scripts" (OuterVolumeSpecName: "scripts") pod "65750464-ddac-4787-86cc-48f32f31cd92" (UID: "65750464-ddac-4787-86cc-48f32f31cd92"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:12:46 crc kubenswrapper[5120]: I0316 17:12:46.529400 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/65750464-ddac-4787-86cc-48f32f31cd92-swiftconf" (OuterVolumeSpecName: "swiftconf") pod "65750464-ddac-4787-86cc-48f32f31cd92" (UID: "65750464-ddac-4787-86cc-48f32f31cd92"). InnerVolumeSpecName "swiftconf". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:12:46 crc kubenswrapper[5120]: I0316 17:12:46.530334 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/65750464-ddac-4787-86cc-48f32f31cd92-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "65750464-ddac-4787-86cc-48f32f31cd92" (UID: "65750464-ddac-4787-86cc-48f32f31cd92"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:12:46 crc kubenswrapper[5120]: I0316 17:12:46.609853 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/65750464-ddac-4787-86cc-48f32f31cd92-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:12:46 crc kubenswrapper[5120]: I0316 17:12:46.609904 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/65750464-ddac-4787-86cc-48f32f31cd92-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:12:46 crc kubenswrapper[5120]: I0316 17:12:46.609921 5120 reconciler_common.go:299] "Volume detached for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/65750464-ddac-4787-86cc-48f32f31cd92-swiftconf\") on node \"crc\" DevicePath \"\"" Mar 16 17:12:46 crc kubenswrapper[5120]: I0316 17:12:46.609935 5120 reconciler_common.go:299] "Volume detached for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/65750464-ddac-4787-86cc-48f32f31cd92-dispersionconf\") on node \"crc\" DevicePath \"\"" Mar 16 17:12:46 crc kubenswrapper[5120]: I0316 17:12:46.609945 5120 reconciler_common.go:299] "Volume detached for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/65750464-ddac-4787-86cc-48f32f31cd92-etc-swift\") on node \"crc\" DevicePath \"\"" Mar 16 17:12:46 crc kubenswrapper[5120]: I0316 17:12:46.609960 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c8m7l\" (UniqueName: \"kubernetes.io/projected/65750464-ddac-4787-86cc-48f32f31cd92-kube-api-access-c8m7l\") on node \"crc\" DevicePath \"\"" Mar 16 17:12:47 crc kubenswrapper[5120]: I0316 17:12:47.004383 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-mp7zl" event={"ID":"65750464-ddac-4787-86cc-48f32f31cd92","Type":"ContainerDied","Data":"48f6a8370d03bf767087304ae693802e313c8a6ed120490f16f2d04252897c76"} Mar 16 17:12:47 crc kubenswrapper[5120]: I0316 17:12:47.004424 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="48f6a8370d03bf767087304ae693802e313c8a6ed120490f16f2d04252897c76" Mar 16 17:12:47 crc kubenswrapper[5120]: I0316 17:12:47.004485 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-mp7zl" Mar 16 17:12:48 crc kubenswrapper[5120]: I0316 17:12:48.206791 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/root-account-create-update-tnpv8"] Mar 16 17:12:48 crc kubenswrapper[5120]: I0316 17:12:48.208085 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87adc2e9-8943-4b49-a683-f929f03a8226" containerName="mariadb-database-create" Mar 16 17:12:48 crc kubenswrapper[5120]: I0316 17:12:48.208107 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="87adc2e9-8943-4b49-a683-f929f03a8226" containerName="mariadb-database-create" Mar 16 17:12:48 crc kubenswrapper[5120]: I0316 17:12:48.208127 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65750464-ddac-4787-86cc-48f32f31cd92" containerName="swift-ring-rebalance" Mar 16 17:12:48 crc kubenswrapper[5120]: I0316 17:12:48.208135 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="65750464-ddac-4787-86cc-48f32f31cd92" containerName="swift-ring-rebalance" Mar 16 17:12:48 crc kubenswrapper[5120]: I0316 17:12:48.208299 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="87adc2e9-8943-4b49-a683-f929f03a8226" containerName="mariadb-database-create" Mar 16 17:12:48 crc kubenswrapper[5120]: I0316 17:12:48.208320 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="65750464-ddac-4787-86cc-48f32f31cd92" containerName="swift-ring-rebalance" Mar 16 17:12:48 crc kubenswrapper[5120]: I0316 17:12:48.212150 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-tnpv8" Mar 16 17:12:48 crc kubenswrapper[5120]: I0316 17:12:48.214085 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"openstack-cell1-mariadb-root-db-secret\"" Mar 16 17:12:48 crc kubenswrapper[5120]: I0316 17:12:48.220048 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-tnpv8"] Mar 16 17:12:48 crc kubenswrapper[5120]: I0316 17:12:48.348422 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/45f36096-a6d2-45e4-8fd7-61febd7eb8ae-operator-scripts\") pod \"root-account-create-update-tnpv8\" (UID: \"45f36096-a6d2-45e4-8fd7-61febd7eb8ae\") " pod="openstack-kuttl-tests/root-account-create-update-tnpv8" Mar 16 17:12:48 crc kubenswrapper[5120]: I0316 17:12:48.348583 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r87ld\" (UniqueName: \"kubernetes.io/projected/45f36096-a6d2-45e4-8fd7-61febd7eb8ae-kube-api-access-r87ld\") pod \"root-account-create-update-tnpv8\" (UID: \"45f36096-a6d2-45e4-8fd7-61febd7eb8ae\") " pod="openstack-kuttl-tests/root-account-create-update-tnpv8" Mar 16 17:12:48 crc kubenswrapper[5120]: I0316 17:12:48.452495 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/45f36096-a6d2-45e4-8fd7-61febd7eb8ae-operator-scripts\") pod \"root-account-create-update-tnpv8\" (UID: \"45f36096-a6d2-45e4-8fd7-61febd7eb8ae\") " pod="openstack-kuttl-tests/root-account-create-update-tnpv8" Mar 16 17:12:48 crc kubenswrapper[5120]: I0316 17:12:48.452720 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r87ld\" (UniqueName: \"kubernetes.io/projected/45f36096-a6d2-45e4-8fd7-61febd7eb8ae-kube-api-access-r87ld\") pod \"root-account-create-update-tnpv8\" (UID: \"45f36096-a6d2-45e4-8fd7-61febd7eb8ae\") " pod="openstack-kuttl-tests/root-account-create-update-tnpv8" Mar 16 17:12:48 crc kubenswrapper[5120]: I0316 17:12:48.453424 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/45f36096-a6d2-45e4-8fd7-61febd7eb8ae-operator-scripts\") pod \"root-account-create-update-tnpv8\" (UID: \"45f36096-a6d2-45e4-8fd7-61febd7eb8ae\") " pod="openstack-kuttl-tests/root-account-create-update-tnpv8" Mar 16 17:12:48 crc kubenswrapper[5120]: I0316 17:12:48.487012 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r87ld\" (UniqueName: \"kubernetes.io/projected/45f36096-a6d2-45e4-8fd7-61febd7eb8ae-kube-api-access-r87ld\") pod \"root-account-create-update-tnpv8\" (UID: \"45f36096-a6d2-45e4-8fd7-61febd7eb8ae\") " pod="openstack-kuttl-tests/root-account-create-update-tnpv8" Mar 16 17:12:48 crc kubenswrapper[5120]: I0316 17:12:48.531802 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-tnpv8" Mar 16 17:12:48 crc kubenswrapper[5120]: I0316 17:12:48.862339 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/453261b9-e47c-4e0b-b37d-4803c7ea4eab-etc-swift\") pod \"swift-storage-0\" (UID: \"453261b9-e47c-4e0b-b37d-4803c7ea4eab\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 17:12:48 crc kubenswrapper[5120]: I0316 17:12:48.869124 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/453261b9-e47c-4e0b-b37d-4803c7ea4eab-etc-swift\") pod \"swift-storage-0\" (UID: \"453261b9-e47c-4e0b-b37d-4803c7ea4eab\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 17:12:48 crc kubenswrapper[5120]: I0316 17:12:48.978563 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-tnpv8"] Mar 16 17:12:48 crc kubenswrapper[5120]: I0316 17:12:48.983549 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Mar 16 17:12:48 crc kubenswrapper[5120]: W0316 17:12:48.985572 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod45f36096_a6d2_45e4_8fd7_61febd7eb8ae.slice/crio-d54f339ecc45c3f5c0d3a114cc2cb6e1b477bbb24ba0e93b313d9467775123f7 WatchSource:0}: Error finding container d54f339ecc45c3f5c0d3a114cc2cb6e1b477bbb24ba0e93b313d9467775123f7: Status 404 returned error can't find the container with id d54f339ecc45c3f5c0d3a114cc2cb6e1b477bbb24ba0e93b313d9467775123f7 Mar 16 17:12:49 crc kubenswrapper[5120]: I0316 17:12:49.001378 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:12:49 crc kubenswrapper[5120]: I0316 17:12:49.040657 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-tnpv8" event={"ID":"45f36096-a6d2-45e4-8fd7-61febd7eb8ae","Type":"ContainerStarted","Data":"d54f339ecc45c3f5c0d3a114cc2cb6e1b477bbb24ba0e93b313d9467775123f7"} Mar 16 17:12:49 crc kubenswrapper[5120]: I0316 17:12:49.533597 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 17:12:50 crc kubenswrapper[5120]: I0316 17:12:50.051182 5120 generic.go:358] "Generic (PLEG): container finished" podID="45f36096-a6d2-45e4-8fd7-61febd7eb8ae" containerID="624ae52b1f995ebde13049c519bd35d8505845b4f77c6a708e9d5932ae8a65da" exitCode=0 Mar 16 17:12:50 crc kubenswrapper[5120]: I0316 17:12:50.051386 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-tnpv8" event={"ID":"45f36096-a6d2-45e4-8fd7-61febd7eb8ae","Type":"ContainerDied","Data":"624ae52b1f995ebde13049c519bd35d8505845b4f77c6a708e9d5932ae8a65da"} Mar 16 17:12:50 crc kubenswrapper[5120]: I0316 17:12:50.056049 5120 generic.go:358] "Generic (PLEG): container finished" podID="5e487707-6cf9-42cb-924f-cc201ecbdb55" containerID="200bbbe280bcacf20487461ecfc91d862b7f61454eb87ee1c78e3fae4984427d" exitCode=0 Mar 16 17:12:50 crc kubenswrapper[5120]: I0316 17:12:50.056374 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-5jnpc" event={"ID":"5e487707-6cf9-42cb-924f-cc201ecbdb55","Type":"ContainerDied","Data":"200bbbe280bcacf20487461ecfc91d862b7f61454eb87ee1c78e3fae4984427d"} Mar 16 17:12:50 crc kubenswrapper[5120]: I0316 17:12:50.061091 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"453261b9-e47c-4e0b-b37d-4803c7ea4eab","Type":"ContainerStarted","Data":"f450ab68730ad34b2967fa5253614c5b25a40a841fe623c369a1631922d89171"} Mar 16 17:12:50 crc kubenswrapper[5120]: I0316 17:12:50.061129 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"453261b9-e47c-4e0b-b37d-4803c7ea4eab","Type":"ContainerStarted","Data":"bfd438fe482625b6acaa98a3f3b1df39124d070d7c82b30f3b95847f5e4307eb"} Mar 16 17:12:50 crc kubenswrapper[5120]: I0316 17:12:50.061142 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"453261b9-e47c-4e0b-b37d-4803c7ea4eab","Type":"ContainerStarted","Data":"6eb65bf428d4c482f58b64b7e61af4b881274601e82001fcdf67e56d20afe5b8"} Mar 16 17:12:51 crc kubenswrapper[5120]: I0316 17:12:51.109467 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"453261b9-e47c-4e0b-b37d-4803c7ea4eab","Type":"ContainerStarted","Data":"d5fd97d3f54b33d918d40a1a213325ea152cca47586abb186341b0193714ad03"} Mar 16 17:12:51 crc kubenswrapper[5120]: I0316 17:12:51.109874 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"453261b9-e47c-4e0b-b37d-4803c7ea4eab","Type":"ContainerStarted","Data":"847cfa54fe526dabece95c278159d3228a748d5a41f03c0874e7e56a380b6047"} Mar 16 17:12:51 crc kubenswrapper[5120]: I0316 17:12:51.109893 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"453261b9-e47c-4e0b-b37d-4803c7ea4eab","Type":"ContainerStarted","Data":"12e294147acf3be6360a4168f01b6847c3952f8b1f777061c712b9dcddb549e9"} Mar 16 17:12:51 crc kubenswrapper[5120]: I0316 17:12:51.109905 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"453261b9-e47c-4e0b-b37d-4803c7ea4eab","Type":"ContainerStarted","Data":"7609d755e551179d21b21ae75424817749513f60f07273b47f02ee1165742636"} Mar 16 17:12:51 crc kubenswrapper[5120]: I0316 17:12:51.109937 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"453261b9-e47c-4e0b-b37d-4803c7ea4eab","Type":"ContainerStarted","Data":"f2a05b9a55ce5e5912e0e5ca27fa34a32cd099c2e9473cdafa26eef99b1aade8"} Mar 16 17:12:51 crc kubenswrapper[5120]: I0316 17:12:51.109948 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"453261b9-e47c-4e0b-b37d-4803c7ea4eab","Type":"ContainerStarted","Data":"2a68f298ec63891421aa48c2086b5969e7ccffebf4a9b32a37f55e9ca39b4362"} Mar 16 17:12:51 crc kubenswrapper[5120]: I0316 17:12:51.112049 5120 generic.go:358] "Generic (PLEG): container finished" podID="dd339abc-691c-48f1-8674-430a5e806067" containerID="21c1f1009dd9301611e2a8c92eba97428d8b4eb942531017355ecebe87b77211" exitCode=0 Mar 16 17:12:51 crc kubenswrapper[5120]: I0316 17:12:51.112313 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"dd339abc-691c-48f1-8674-430a5e806067","Type":"ContainerDied","Data":"21c1f1009dd9301611e2a8c92eba97428d8b4eb942531017355ecebe87b77211"} Mar 16 17:12:51 crc kubenswrapper[5120]: I0316 17:12:51.121041 5120 generic.go:358] "Generic (PLEG): container finished" podID="d6906541-8dff-40ed-a064-5777f4b66f24" containerID="48641c4ff11ddd43749ffe7662326076906b73bc16bab3455ff38bcd51f91ee9" exitCode=0 Mar 16 17:12:51 crc kubenswrapper[5120]: I0316 17:12:51.121292 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"d6906541-8dff-40ed-a064-5777f4b66f24","Type":"ContainerDied","Data":"48641c4ff11ddd43749ffe7662326076906b73bc16bab3455ff38bcd51f91ee9"} Mar 16 17:12:51 crc kubenswrapper[5120]: I0316 17:12:51.688536 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-5jnpc" Mar 16 17:12:51 crc kubenswrapper[5120]: I0316 17:12:51.696519 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-tnpv8" Mar 16 17:12:51 crc kubenswrapper[5120]: I0316 17:12:51.858194 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5e487707-6cf9-42cb-924f-cc201ecbdb55-combined-ca-bundle\") pod \"5e487707-6cf9-42cb-924f-cc201ecbdb55\" (UID: \"5e487707-6cf9-42cb-924f-cc201ecbdb55\") " Mar 16 17:12:51 crc kubenswrapper[5120]: I0316 17:12:51.858244 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r87ld\" (UniqueName: \"kubernetes.io/projected/45f36096-a6d2-45e4-8fd7-61febd7eb8ae-kube-api-access-r87ld\") pod \"45f36096-a6d2-45e4-8fd7-61febd7eb8ae\" (UID: \"45f36096-a6d2-45e4-8fd7-61febd7eb8ae\") " Mar 16 17:12:51 crc kubenswrapper[5120]: I0316 17:12:51.858539 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/5e487707-6cf9-42cb-924f-cc201ecbdb55-db-sync-config-data\") pod \"5e487707-6cf9-42cb-924f-cc201ecbdb55\" (UID: \"5e487707-6cf9-42cb-924f-cc201ecbdb55\") " Mar 16 17:12:51 crc kubenswrapper[5120]: I0316 17:12:51.858567 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/45f36096-a6d2-45e4-8fd7-61febd7eb8ae-operator-scripts\") pod \"45f36096-a6d2-45e4-8fd7-61febd7eb8ae\" (UID: \"45f36096-a6d2-45e4-8fd7-61febd7eb8ae\") " Mar 16 17:12:51 crc kubenswrapper[5120]: I0316 17:12:51.858629 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5e487707-6cf9-42cb-924f-cc201ecbdb55-config-data\") pod \"5e487707-6cf9-42cb-924f-cc201ecbdb55\" (UID: \"5e487707-6cf9-42cb-924f-cc201ecbdb55\") " Mar 16 17:12:51 crc kubenswrapper[5120]: I0316 17:12:51.858974 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7hc49\" (UniqueName: \"kubernetes.io/projected/5e487707-6cf9-42cb-924f-cc201ecbdb55-kube-api-access-7hc49\") pod \"5e487707-6cf9-42cb-924f-cc201ecbdb55\" (UID: \"5e487707-6cf9-42cb-924f-cc201ecbdb55\") " Mar 16 17:12:51 crc kubenswrapper[5120]: I0316 17:12:51.859170 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/45f36096-a6d2-45e4-8fd7-61febd7eb8ae-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "45f36096-a6d2-45e4-8fd7-61febd7eb8ae" (UID: "45f36096-a6d2-45e4-8fd7-61febd7eb8ae"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:12:51 crc kubenswrapper[5120]: I0316 17:12:51.862414 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e487707-6cf9-42cb-924f-cc201ecbdb55-db-sync-config-data" (OuterVolumeSpecName: "db-sync-config-data") pod "5e487707-6cf9-42cb-924f-cc201ecbdb55" (UID: "5e487707-6cf9-42cb-924f-cc201ecbdb55"). InnerVolumeSpecName "db-sync-config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:12:51 crc kubenswrapper[5120]: I0316 17:12:51.863414 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e487707-6cf9-42cb-924f-cc201ecbdb55-kube-api-access-7hc49" (OuterVolumeSpecName: "kube-api-access-7hc49") pod "5e487707-6cf9-42cb-924f-cc201ecbdb55" (UID: "5e487707-6cf9-42cb-924f-cc201ecbdb55"). InnerVolumeSpecName "kube-api-access-7hc49". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:12:51 crc kubenswrapper[5120]: I0316 17:12:51.875690 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45f36096-a6d2-45e4-8fd7-61febd7eb8ae-kube-api-access-r87ld" (OuterVolumeSpecName: "kube-api-access-r87ld") pod "45f36096-a6d2-45e4-8fd7-61febd7eb8ae" (UID: "45f36096-a6d2-45e4-8fd7-61febd7eb8ae"). InnerVolumeSpecName "kube-api-access-r87ld". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:12:51 crc kubenswrapper[5120]: I0316 17:12:51.883490 5120 reconciler_common.go:299] "Volume detached for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/5e487707-6cf9-42cb-924f-cc201ecbdb55-db-sync-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:12:51 crc kubenswrapper[5120]: I0316 17:12:51.883696 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/45f36096-a6d2-45e4-8fd7-61febd7eb8ae-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:12:51 crc kubenswrapper[5120]: I0316 17:12:51.883785 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7hc49\" (UniqueName: \"kubernetes.io/projected/5e487707-6cf9-42cb-924f-cc201ecbdb55-kube-api-access-7hc49\") on node \"crc\" DevicePath \"\"" Mar 16 17:12:51 crc kubenswrapper[5120]: I0316 17:12:51.883891 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r87ld\" (UniqueName: \"kubernetes.io/projected/45f36096-a6d2-45e4-8fd7-61febd7eb8ae-kube-api-access-r87ld\") on node \"crc\" DevicePath \"\"" Mar 16 17:12:51 crc kubenswrapper[5120]: I0316 17:12:51.885934 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e487707-6cf9-42cb-924f-cc201ecbdb55-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "5e487707-6cf9-42cb-924f-cc201ecbdb55" (UID: "5e487707-6cf9-42cb-924f-cc201ecbdb55"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:12:51 crc kubenswrapper[5120]: I0316 17:12:51.918069 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e487707-6cf9-42cb-924f-cc201ecbdb55-config-data" (OuterVolumeSpecName: "config-data") pod "5e487707-6cf9-42cb-924f-cc201ecbdb55" (UID: "5e487707-6cf9-42cb-924f-cc201ecbdb55"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:12:51 crc kubenswrapper[5120]: I0316 17:12:51.986526 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5e487707-6cf9-42cb-924f-cc201ecbdb55-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:12:51 crc kubenswrapper[5120]: I0316 17:12:51.986573 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5e487707-6cf9-42cb-924f-cc201ecbdb55-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:12:52 crc kubenswrapper[5120]: I0316 17:12:52.133684 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"453261b9-e47c-4e0b-b37d-4803c7ea4eab","Type":"ContainerStarted","Data":"aebd95ed2c80cf68f4a11d63e8a9c7417a4d2c89e19691fded4789fac5ae5ced"} Mar 16 17:12:52 crc kubenswrapper[5120]: I0316 17:12:52.133727 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"453261b9-e47c-4e0b-b37d-4803c7ea4eab","Type":"ContainerStarted","Data":"3df7a51b81f9adfb6f8812a838726626d4151033510e8139103925ba0a6c9636"} Mar 16 17:12:52 crc kubenswrapper[5120]: I0316 17:12:52.133741 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"453261b9-e47c-4e0b-b37d-4803c7ea4eab","Type":"ContainerStarted","Data":"22b3d482c1dbe9466b48add66f35c279c3a30492318c0515c5d724ca2e13919a"} Mar 16 17:12:52 crc kubenswrapper[5120]: I0316 17:12:52.133752 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"453261b9-e47c-4e0b-b37d-4803c7ea4eab","Type":"ContainerStarted","Data":"29984c871f3af037965519d7341a4a9f76503ecacedf63c951528b0c3f7621e3"} Mar 16 17:12:52 crc kubenswrapper[5120]: I0316 17:12:52.133819 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"453261b9-e47c-4e0b-b37d-4803c7ea4eab","Type":"ContainerStarted","Data":"3fdb66fbf7a3609693d5bb010ec8b7a9f831e0bc3f2074a737c8ffb1b1a0a870"} Mar 16 17:12:52 crc kubenswrapper[5120]: I0316 17:12:52.136431 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"dd339abc-691c-48f1-8674-430a5e806067","Type":"ContainerStarted","Data":"3dbccce89cd901c0416da3e41b60454cf2ab5860b9727c911dacea8d5361320b"} Mar 16 17:12:52 crc kubenswrapper[5120]: I0316 17:12:52.137650 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 17:12:52 crc kubenswrapper[5120]: I0316 17:12:52.139404 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-tnpv8" event={"ID":"45f36096-a6d2-45e4-8fd7-61febd7eb8ae","Type":"ContainerDied","Data":"d54f339ecc45c3f5c0d3a114cc2cb6e1b477bbb24ba0e93b313d9467775123f7"} Mar 16 17:12:52 crc kubenswrapper[5120]: I0316 17:12:52.139433 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d54f339ecc45c3f5c0d3a114cc2cb6e1b477bbb24ba0e93b313d9467775123f7" Mar 16 17:12:52 crc kubenswrapper[5120]: I0316 17:12:52.139488 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-tnpv8" Mar 16 17:12:52 crc kubenswrapper[5120]: I0316 17:12:52.142222 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"d6906541-8dff-40ed-a064-5777f4b66f24","Type":"ContainerStarted","Data":"318e43b1f673c7e18a9bf01910a8401b4e64194498bf8833ebd04325d7873d96"} Mar 16 17:12:52 crc kubenswrapper[5120]: I0316 17:12:52.142521 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 17:12:52 crc kubenswrapper[5120]: I0316 17:12:52.144614 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-5jnpc" event={"ID":"5e487707-6cf9-42cb-924f-cc201ecbdb55","Type":"ContainerDied","Data":"5da1780305cdab20fb5fcf53e6f84ff92cd42acb604fc47cc4ed7ffa5b5efbac"} Mar 16 17:12:52 crc kubenswrapper[5120]: I0316 17:12:52.144657 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5da1780305cdab20fb5fcf53e6f84ff92cd42acb604fc47cc4ed7ffa5b5efbac" Mar 16 17:12:52 crc kubenswrapper[5120]: I0316 17:12:52.144724 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-5jnpc" Mar 16 17:12:52 crc kubenswrapper[5120]: I0316 17:12:52.168279 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/rabbitmq-server-0" podStartSLOduration=37.168259279 podStartE2EDuration="37.168259279s" podCreationTimestamp="2026-03-16 17:12:15 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:12:52.166701406 +0000 UTC m=+6074.320633083" watchObservedRunningTime="2026-03-16 17:12:52.168259279 +0000 UTC m=+6074.322190936" Mar 16 17:12:52 crc kubenswrapper[5120]: I0316 17:12:52.206413 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" podStartSLOduration=37.206393032 podStartE2EDuration="37.206393032s" podCreationTimestamp="2026-03-16 17:12:15 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:12:52.203131663 +0000 UTC m=+6074.357063330" watchObservedRunningTime="2026-03-16 17:12:52.206393032 +0000 UTC m=+6074.360324689" Mar 16 17:12:53 crc kubenswrapper[5120]: I0316 17:12:53.161070 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"453261b9-e47c-4e0b-b37d-4803c7ea4eab","Type":"ContainerStarted","Data":"e70bc9242f954992b3712fa002a61869c3838299235abfea9c2b0e824a67d0e2"} Mar 16 17:12:53 crc kubenswrapper[5120]: I0316 17:12:53.162065 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"453261b9-e47c-4e0b-b37d-4803c7ea4eab","Type":"ContainerStarted","Data":"a1b10d99c0cdaf702b9aeb081186b9737661b9e1ad04908bd766605b4e038b52"} Mar 16 17:12:53 crc kubenswrapper[5120]: I0316 17:12:53.215864 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/swift-storage-0" podStartSLOduration=22.215833369 podStartE2EDuration="22.215833369s" podCreationTimestamp="2026-03-16 17:12:31 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:12:53.211261355 +0000 UTC m=+6075.365193032" watchObservedRunningTime="2026-03-16 17:12:53.215833369 +0000 UTC m=+6075.369765026" Mar 16 17:12:53 crc kubenswrapper[5120]: I0316 17:12:53.443577 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-7b8f685555-2m84v"] Mar 16 17:12:53 crc kubenswrapper[5120]: I0316 17:12:53.444886 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e487707-6cf9-42cb-924f-cc201ecbdb55" containerName="glance-db-sync" Mar 16 17:12:53 crc kubenswrapper[5120]: I0316 17:12:53.444914 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e487707-6cf9-42cb-924f-cc201ecbdb55" containerName="glance-db-sync" Mar 16 17:12:53 crc kubenswrapper[5120]: I0316 17:12:53.444939 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45f36096-a6d2-45e4-8fd7-61febd7eb8ae" containerName="mariadb-account-create-update" Mar 16 17:12:53 crc kubenswrapper[5120]: I0316 17:12:53.444948 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="45f36096-a6d2-45e4-8fd7-61febd7eb8ae" containerName="mariadb-account-create-update" Mar 16 17:12:53 crc kubenswrapper[5120]: I0316 17:12:53.445143 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="45f36096-a6d2-45e4-8fd7-61febd7eb8ae" containerName="mariadb-account-create-update" Mar 16 17:12:53 crc kubenswrapper[5120]: I0316 17:12:53.445168 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="5e487707-6cf9-42cb-924f-cc201ecbdb55" containerName="glance-db-sync" Mar 16 17:12:53 crc kubenswrapper[5120]: I0316 17:12:53.450144 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7b8f685555-2m84v" Mar 16 17:12:53 crc kubenswrapper[5120]: I0316 17:12:53.456344 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"dns-swift-storage-0\"" Mar 16 17:12:53 crc kubenswrapper[5120]: I0316 17:12:53.472496 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-7b8f685555-2m84v"] Mar 16 17:12:53 crc kubenswrapper[5120]: I0316 17:12:53.536569 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/4329933c-52f5-4a6d-a031-7c1658641f8f-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-7b8f685555-2m84v\" (UID: \"4329933c-52f5-4a6d-a031-7c1658641f8f\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7b8f685555-2m84v" Mar 16 17:12:53 crc kubenswrapper[5120]: I0316 17:12:53.536653 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8psw\" (UniqueName: \"kubernetes.io/projected/4329933c-52f5-4a6d-a031-7c1658641f8f-kube-api-access-v8psw\") pod \"dnsmasq-dnsmasq-7b8f685555-2m84v\" (UID: \"4329933c-52f5-4a6d-a031-7c1658641f8f\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7b8f685555-2m84v" Mar 16 17:12:53 crc kubenswrapper[5120]: I0316 17:12:53.536741 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/4329933c-52f5-4a6d-a031-7c1658641f8f-dns-swift-storage-0\") pod \"dnsmasq-dnsmasq-7b8f685555-2m84v\" (UID: \"4329933c-52f5-4a6d-a031-7c1658641f8f\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7b8f685555-2m84v" Mar 16 17:12:53 crc kubenswrapper[5120]: I0316 17:12:53.536777 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4329933c-52f5-4a6d-a031-7c1658641f8f-config\") pod \"dnsmasq-dnsmasq-7b8f685555-2m84v\" (UID: \"4329933c-52f5-4a6d-a031-7c1658641f8f\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7b8f685555-2m84v" Mar 16 17:12:53 crc kubenswrapper[5120]: I0316 17:12:53.639292 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/4329933c-52f5-4a6d-a031-7c1658641f8f-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-7b8f685555-2m84v\" (UID: \"4329933c-52f5-4a6d-a031-7c1658641f8f\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7b8f685555-2m84v" Mar 16 17:12:53 crc kubenswrapper[5120]: I0316 17:12:53.639391 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v8psw\" (UniqueName: \"kubernetes.io/projected/4329933c-52f5-4a6d-a031-7c1658641f8f-kube-api-access-v8psw\") pod \"dnsmasq-dnsmasq-7b8f685555-2m84v\" (UID: \"4329933c-52f5-4a6d-a031-7c1658641f8f\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7b8f685555-2m84v" Mar 16 17:12:53 crc kubenswrapper[5120]: I0316 17:12:53.639491 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/4329933c-52f5-4a6d-a031-7c1658641f8f-dns-swift-storage-0\") pod \"dnsmasq-dnsmasq-7b8f685555-2m84v\" (UID: \"4329933c-52f5-4a6d-a031-7c1658641f8f\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7b8f685555-2m84v" Mar 16 17:12:53 crc kubenswrapper[5120]: I0316 17:12:53.639517 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4329933c-52f5-4a6d-a031-7c1658641f8f-config\") pod \"dnsmasq-dnsmasq-7b8f685555-2m84v\" (UID: \"4329933c-52f5-4a6d-a031-7c1658641f8f\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7b8f685555-2m84v" Mar 16 17:12:53 crc kubenswrapper[5120]: I0316 17:12:53.640580 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4329933c-52f5-4a6d-a031-7c1658641f8f-config\") pod \"dnsmasq-dnsmasq-7b8f685555-2m84v\" (UID: \"4329933c-52f5-4a6d-a031-7c1658641f8f\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7b8f685555-2m84v" Mar 16 17:12:53 crc kubenswrapper[5120]: I0316 17:12:53.641197 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/4329933c-52f5-4a6d-a031-7c1658641f8f-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-7b8f685555-2m84v\" (UID: \"4329933c-52f5-4a6d-a031-7c1658641f8f\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7b8f685555-2m84v" Mar 16 17:12:53 crc kubenswrapper[5120]: I0316 17:12:53.642125 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/4329933c-52f5-4a6d-a031-7c1658641f8f-dns-swift-storage-0\") pod \"dnsmasq-dnsmasq-7b8f685555-2m84v\" (UID: \"4329933c-52f5-4a6d-a031-7c1658641f8f\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7b8f685555-2m84v" Mar 16 17:12:53 crc kubenswrapper[5120]: I0316 17:12:53.661112 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8psw\" (UniqueName: \"kubernetes.io/projected/4329933c-52f5-4a6d-a031-7c1658641f8f-kube-api-access-v8psw\") pod \"dnsmasq-dnsmasq-7b8f685555-2m84v\" (UID: \"4329933c-52f5-4a6d-a031-7c1658641f8f\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7b8f685555-2m84v" Mar 16 17:12:53 crc kubenswrapper[5120]: I0316 17:12:53.790145 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7b8f685555-2m84v" Mar 16 17:12:54 crc kubenswrapper[5120]: I0316 17:12:54.329024 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-7b8f685555-2m84v"] Mar 16 17:12:55 crc kubenswrapper[5120]: I0316 17:12:55.183029 5120 generic.go:358] "Generic (PLEG): container finished" podID="4329933c-52f5-4a6d-a031-7c1658641f8f" containerID="99efd612d9c5a2a93329f31e6ab1ecb1da8624723b867994d12bdd68ee046f00" exitCode=0 Mar 16 17:12:55 crc kubenswrapper[5120]: I0316 17:12:55.183079 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7b8f685555-2m84v" event={"ID":"4329933c-52f5-4a6d-a031-7c1658641f8f","Type":"ContainerDied","Data":"99efd612d9c5a2a93329f31e6ab1ecb1da8624723b867994d12bdd68ee046f00"} Mar 16 17:12:55 crc kubenswrapper[5120]: I0316 17:12:55.183630 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7b8f685555-2m84v" event={"ID":"4329933c-52f5-4a6d-a031-7c1658641f8f","Type":"ContainerStarted","Data":"95a99b7bc4b8efc583d6c5fc82da7aa5489a9eee14fff3ff87f9243b6d9876bd"} Mar 16 17:12:56 crc kubenswrapper[5120]: I0316 17:12:56.194028 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7b8f685555-2m84v" event={"ID":"4329933c-52f5-4a6d-a031-7c1658641f8f","Type":"ContainerStarted","Data":"b8361e4af75a0a1b5cc237b006a775549f7f7f8f6983dcee68d803cfea191549"} Mar 16 17:12:56 crc kubenswrapper[5120]: I0316 17:12:56.194382 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7b8f685555-2m84v" Mar 16 17:12:56 crc kubenswrapper[5120]: I0316 17:12:56.221910 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7b8f685555-2m84v" podStartSLOduration=3.221888453 podStartE2EDuration="3.221888453s" podCreationTimestamp="2026-03-16 17:12:53 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:12:56.216245709 +0000 UTC m=+6078.370177366" watchObservedRunningTime="2026-03-16 17:12:56.221888453 +0000 UTC m=+6078.375820110" Mar 16 17:13:02 crc kubenswrapper[5120]: I0316 17:13:02.202930 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7b8f685555-2m84v" Mar 16 17:13:02 crc kubenswrapper[5120]: I0316 17:13:02.278677 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-zc7hd"] Mar 16 17:13:02 crc kubenswrapper[5120]: I0316 17:13:02.279314 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-zc7hd" podUID="fd632cf1-9975-4595-bdb6-c33fc07f41a5" containerName="dnsmasq-dns" containerID="cri-o://6834cb76ad06acbbb019d4e422510862d386f4e3c12f1a1d6f923d2310544d1b" gracePeriod=10 Mar 16 17:13:02 crc kubenswrapper[5120]: I0316 17:13:02.688492 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-zc7hd" Mar 16 17:13:02 crc kubenswrapper[5120]: I0316 17:13:02.857063 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/fd632cf1-9975-4595-bdb6-c33fc07f41a5-dnsmasq-svc\") pod \"fd632cf1-9975-4595-bdb6-c33fc07f41a5\" (UID: \"fd632cf1-9975-4595-bdb6-c33fc07f41a5\") " Mar 16 17:13:02 crc kubenswrapper[5120]: I0316 17:13:02.857107 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4w9qj\" (UniqueName: \"kubernetes.io/projected/fd632cf1-9975-4595-bdb6-c33fc07f41a5-kube-api-access-4w9qj\") pod \"fd632cf1-9975-4595-bdb6-c33fc07f41a5\" (UID: \"fd632cf1-9975-4595-bdb6-c33fc07f41a5\") " Mar 16 17:13:02 crc kubenswrapper[5120]: I0316 17:13:02.857269 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fd632cf1-9975-4595-bdb6-c33fc07f41a5-config\") pod \"fd632cf1-9975-4595-bdb6-c33fc07f41a5\" (UID: \"fd632cf1-9975-4595-bdb6-c33fc07f41a5\") " Mar 16 17:13:02 crc kubenswrapper[5120]: I0316 17:13:02.863913 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd632cf1-9975-4595-bdb6-c33fc07f41a5-kube-api-access-4w9qj" (OuterVolumeSpecName: "kube-api-access-4w9qj") pod "fd632cf1-9975-4595-bdb6-c33fc07f41a5" (UID: "fd632cf1-9975-4595-bdb6-c33fc07f41a5"). InnerVolumeSpecName "kube-api-access-4w9qj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:13:02 crc kubenswrapper[5120]: I0316 17:13:02.902488 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd632cf1-9975-4595-bdb6-c33fc07f41a5-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "fd632cf1-9975-4595-bdb6-c33fc07f41a5" (UID: "fd632cf1-9975-4595-bdb6-c33fc07f41a5"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:13:02 crc kubenswrapper[5120]: I0316 17:13:02.907899 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd632cf1-9975-4595-bdb6-c33fc07f41a5-config" (OuterVolumeSpecName: "config") pod "fd632cf1-9975-4595-bdb6-c33fc07f41a5" (UID: "fd632cf1-9975-4595-bdb6-c33fc07f41a5"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:13:02 crc kubenswrapper[5120]: I0316 17:13:02.962016 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fd632cf1-9975-4595-bdb6-c33fc07f41a5-config\") on node \"crc\" DevicePath \"\"" Mar 16 17:13:02 crc kubenswrapper[5120]: I0316 17:13:02.962078 5120 reconciler_common.go:299] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/fd632cf1-9975-4595-bdb6-c33fc07f41a5-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Mar 16 17:13:02 crc kubenswrapper[5120]: I0316 17:13:02.962100 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4w9qj\" (UniqueName: \"kubernetes.io/projected/fd632cf1-9975-4595-bdb6-c33fc07f41a5-kube-api-access-4w9qj\") on node \"crc\" DevicePath \"\"" Mar 16 17:13:03 crc kubenswrapper[5120]: I0316 17:13:03.165937 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 17:13:03 crc kubenswrapper[5120]: I0316 17:13:03.168745 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 17:13:03 crc kubenswrapper[5120]: I0316 17:13:03.273649 5120 generic.go:358] "Generic (PLEG): container finished" podID="fd632cf1-9975-4595-bdb6-c33fc07f41a5" containerID="6834cb76ad06acbbb019d4e422510862d386f4e3c12f1a1d6f923d2310544d1b" exitCode=0 Mar 16 17:13:03 crc kubenswrapper[5120]: I0316 17:13:03.273994 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-zc7hd" Mar 16 17:13:03 crc kubenswrapper[5120]: I0316 17:13:03.274050 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-zc7hd" event={"ID":"fd632cf1-9975-4595-bdb6-c33fc07f41a5","Type":"ContainerDied","Data":"6834cb76ad06acbbb019d4e422510862d386f4e3c12f1a1d6f923d2310544d1b"} Mar 16 17:13:03 crc kubenswrapper[5120]: I0316 17:13:03.275047 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-zc7hd" event={"ID":"fd632cf1-9975-4595-bdb6-c33fc07f41a5","Type":"ContainerDied","Data":"040bbcbf6d994a67a4594c4d931a20aebde5df31b7eff16e7c9a85fb5cc04587"} Mar 16 17:13:03 crc kubenswrapper[5120]: I0316 17:13:03.275080 5120 scope.go:117] "RemoveContainer" containerID="6834cb76ad06acbbb019d4e422510862d386f4e3c12f1a1d6f923d2310544d1b" Mar 16 17:13:03 crc kubenswrapper[5120]: I0316 17:13:03.301603 5120 scope.go:117] "RemoveContainer" containerID="366d65c82164e4c899c9b53f7cea3f51f9fa8cf9d96fe4b2280741ae0fe7d0fd" Mar 16 17:13:03 crc kubenswrapper[5120]: I0316 17:13:03.324610 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-zc7hd"] Mar 16 17:13:03 crc kubenswrapper[5120]: I0316 17:13:03.333818 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-zc7hd"] Mar 16 17:13:03 crc kubenswrapper[5120]: I0316 17:13:03.351604 5120 scope.go:117] "RemoveContainer" containerID="6834cb76ad06acbbb019d4e422510862d386f4e3c12f1a1d6f923d2310544d1b" Mar 16 17:13:03 crc kubenswrapper[5120]: E0316 17:13:03.354932 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6834cb76ad06acbbb019d4e422510862d386f4e3c12f1a1d6f923d2310544d1b\": container with ID starting with 6834cb76ad06acbbb019d4e422510862d386f4e3c12f1a1d6f923d2310544d1b not found: ID does not exist" containerID="6834cb76ad06acbbb019d4e422510862d386f4e3c12f1a1d6f923d2310544d1b" Mar 16 17:13:03 crc kubenswrapper[5120]: I0316 17:13:03.354977 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6834cb76ad06acbbb019d4e422510862d386f4e3c12f1a1d6f923d2310544d1b"} err="failed to get container status \"6834cb76ad06acbbb019d4e422510862d386f4e3c12f1a1d6f923d2310544d1b\": rpc error: code = NotFound desc = could not find container \"6834cb76ad06acbbb019d4e422510862d386f4e3c12f1a1d6f923d2310544d1b\": container with ID starting with 6834cb76ad06acbbb019d4e422510862d386f4e3c12f1a1d6f923d2310544d1b not found: ID does not exist" Mar 16 17:13:03 crc kubenswrapper[5120]: I0316 17:13:03.354999 5120 scope.go:117] "RemoveContainer" containerID="366d65c82164e4c899c9b53f7cea3f51f9fa8cf9d96fe4b2280741ae0fe7d0fd" Mar 16 17:13:03 crc kubenswrapper[5120]: E0316 17:13:03.355491 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"366d65c82164e4c899c9b53f7cea3f51f9fa8cf9d96fe4b2280741ae0fe7d0fd\": container with ID starting with 366d65c82164e4c899c9b53f7cea3f51f9fa8cf9d96fe4b2280741ae0fe7d0fd not found: ID does not exist" containerID="366d65c82164e4c899c9b53f7cea3f51f9fa8cf9d96fe4b2280741ae0fe7d0fd" Mar 16 17:13:03 crc kubenswrapper[5120]: I0316 17:13:03.355538 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"366d65c82164e4c899c9b53f7cea3f51f9fa8cf9d96fe4b2280741ae0fe7d0fd"} err="failed to get container status \"366d65c82164e4c899c9b53f7cea3f51f9fa8cf9d96fe4b2280741ae0fe7d0fd\": rpc error: code = NotFound desc = could not find container \"366d65c82164e4c899c9b53f7cea3f51f9fa8cf9d96fe4b2280741ae0fe7d0fd\": container with ID starting with 366d65c82164e4c899c9b53f7cea3f51f9fa8cf9d96fe4b2280741ae0fe7d0fd not found: ID does not exist" Mar 16 17:13:03 crc kubenswrapper[5120]: I0316 17:13:03.470931 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-db-create-492cm"] Mar 16 17:13:03 crc kubenswrapper[5120]: I0316 17:13:03.472195 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd632cf1-9975-4595-bdb6-c33fc07f41a5" containerName="dnsmasq-dns" Mar 16 17:13:03 crc kubenswrapper[5120]: I0316 17:13:03.472220 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd632cf1-9975-4595-bdb6-c33fc07f41a5" containerName="dnsmasq-dns" Mar 16 17:13:03 crc kubenswrapper[5120]: I0316 17:13:03.472279 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd632cf1-9975-4595-bdb6-c33fc07f41a5" containerName="init" Mar 16 17:13:03 crc kubenswrapper[5120]: I0316 17:13:03.472288 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd632cf1-9975-4595-bdb6-c33fc07f41a5" containerName="init" Mar 16 17:13:03 crc kubenswrapper[5120]: I0316 17:13:03.472482 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="fd632cf1-9975-4595-bdb6-c33fc07f41a5" containerName="dnsmasq-dns" Mar 16 17:13:03 crc kubenswrapper[5120]: I0316 17:13:03.481808 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-create-492cm" Mar 16 17:13:03 crc kubenswrapper[5120]: I0316 17:13:03.487183 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-db-create-492cm"] Mar 16 17:13:03 crc kubenswrapper[5120]: I0316 17:13:03.578315 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ec0fbee9-412d-4f41-bf44-1316a4ccd5ca-operator-scripts\") pod \"cinder-db-create-492cm\" (UID: \"ec0fbee9-412d-4f41-bf44-1316a4ccd5ca\") " pod="openstack-kuttl-tests/cinder-db-create-492cm" Mar 16 17:13:03 crc kubenswrapper[5120]: I0316 17:13:03.578356 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9r6gb\" (UniqueName: \"kubernetes.io/projected/ec0fbee9-412d-4f41-bf44-1316a4ccd5ca-kube-api-access-9r6gb\") pod \"cinder-db-create-492cm\" (UID: \"ec0fbee9-412d-4f41-bf44-1316a4ccd5ca\") " pod="openstack-kuttl-tests/cinder-db-create-492cm" Mar 16 17:13:03 crc kubenswrapper[5120]: I0316 17:13:03.680838 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-db-create-gj7s7"] Mar 16 17:13:03 crc kubenswrapper[5120]: I0316 17:13:03.683332 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ec0fbee9-412d-4f41-bf44-1316a4ccd5ca-operator-scripts\") pod \"cinder-db-create-492cm\" (UID: \"ec0fbee9-412d-4f41-bf44-1316a4ccd5ca\") " pod="openstack-kuttl-tests/cinder-db-create-492cm" Mar 16 17:13:03 crc kubenswrapper[5120]: I0316 17:13:03.683377 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9r6gb\" (UniqueName: \"kubernetes.io/projected/ec0fbee9-412d-4f41-bf44-1316a4ccd5ca-kube-api-access-9r6gb\") pod \"cinder-db-create-492cm\" (UID: \"ec0fbee9-412d-4f41-bf44-1316a4ccd5ca\") " pod="openstack-kuttl-tests/cinder-db-create-492cm" Mar 16 17:13:03 crc kubenswrapper[5120]: I0316 17:13:03.684525 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ec0fbee9-412d-4f41-bf44-1316a4ccd5ca-operator-scripts\") pod \"cinder-db-create-492cm\" (UID: \"ec0fbee9-412d-4f41-bf44-1316a4ccd5ca\") " pod="openstack-kuttl-tests/cinder-db-create-492cm" Mar 16 17:13:03 crc kubenswrapper[5120]: I0316 17:13:03.691413 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-create-gj7s7" Mar 16 17:13:03 crc kubenswrapper[5120]: I0316 17:13:03.693930 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-db-create-gj7s7"] Mar 16 17:13:03 crc kubenswrapper[5120]: I0316 17:13:03.712016 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-8685-account-create-update-5zjjt"] Mar 16 17:13:03 crc kubenswrapper[5120]: I0316 17:13:03.728118 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9r6gb\" (UniqueName: \"kubernetes.io/projected/ec0fbee9-412d-4f41-bf44-1316a4ccd5ca-kube-api-access-9r6gb\") pod \"cinder-db-create-492cm\" (UID: \"ec0fbee9-412d-4f41-bf44-1316a4ccd5ca\") " pod="openstack-kuttl-tests/cinder-db-create-492cm" Mar 16 17:13:03 crc kubenswrapper[5120]: I0316 17:13:03.743976 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-8685-account-create-update-5zjjt"] Mar 16 17:13:03 crc kubenswrapper[5120]: I0316 17:13:03.744355 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-8685-account-create-update-5zjjt" Mar 16 17:13:03 crc kubenswrapper[5120]: I0316 17:13:03.754323 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-db-secret\"" Mar 16 17:13:03 crc kubenswrapper[5120]: I0316 17:13:03.778092 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-db-create-ghtjt"] Mar 16 17:13:03 crc kubenswrapper[5120]: I0316 17:13:03.785259 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5d98a227-166a-4c9f-b446-5f8655bdfa26-operator-scripts\") pod \"neutron-db-create-gj7s7\" (UID: \"5d98a227-166a-4c9f-b446-5f8655bdfa26\") " pod="openstack-kuttl-tests/neutron-db-create-gj7s7" Mar 16 17:13:03 crc kubenswrapper[5120]: I0316 17:13:03.785696 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9g8js\" (UniqueName: \"kubernetes.io/projected/5d98a227-166a-4c9f-b446-5f8655bdfa26-kube-api-access-9g8js\") pod \"neutron-db-create-gj7s7\" (UID: \"5d98a227-166a-4c9f-b446-5f8655bdfa26\") " pod="openstack-kuttl-tests/neutron-db-create-gj7s7" Mar 16 17:13:03 crc kubenswrapper[5120]: I0316 17:13:03.793435 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-db-create-ghtjt"] Mar 16 17:13:03 crc kubenswrapper[5120]: I0316 17:13:03.793561 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-create-ghtjt" Mar 16 17:13:03 crc kubenswrapper[5120]: I0316 17:13:03.798884 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-create-492cm" Mar 16 17:13:03 crc kubenswrapper[5120]: I0316 17:13:03.804566 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-3030-account-create-update-kwtzw"] Mar 16 17:13:03 crc kubenswrapper[5120]: I0316 17:13:03.826014 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-3030-account-create-update-kwtzw"] Mar 16 17:13:03 crc kubenswrapper[5120]: I0316 17:13:03.826172 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-3030-account-create-update-kwtzw" Mar 16 17:13:03 crc kubenswrapper[5120]: I0316 17:13:03.828180 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-db-secret\"" Mar 16 17:13:03 crc kubenswrapper[5120]: I0316 17:13:03.883235 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-vf5nd"] Mar 16 17:13:03 crc kubenswrapper[5120]: I0316 17:13:03.890168 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9g8js\" (UniqueName: \"kubernetes.io/projected/5d98a227-166a-4c9f-b446-5f8655bdfa26-kube-api-access-9g8js\") pod \"neutron-db-create-gj7s7\" (UID: \"5d98a227-166a-4c9f-b446-5f8655bdfa26\") " pod="openstack-kuttl-tests/neutron-db-create-gj7s7" Mar 16 17:13:03 crc kubenswrapper[5120]: I0316 17:13:03.892118 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mmkp\" (UniqueName: \"kubernetes.io/projected/e390938f-0d81-4a22-af72-9be8abab5a41-kube-api-access-9mmkp\") pod \"barbican-db-create-ghtjt\" (UID: \"e390938f-0d81-4a22-af72-9be8abab5a41\") " pod="openstack-kuttl-tests/barbican-db-create-ghtjt" Mar 16 17:13:03 crc kubenswrapper[5120]: I0316 17:13:03.900012 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-vf5nd"] Mar 16 17:13:03 crc kubenswrapper[5120]: I0316 17:13:03.900139 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-vf5nd" Mar 16 17:13:03 crc kubenswrapper[5120]: I0316 17:13:03.906934 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-scripts\"" Mar 16 17:13:03 crc kubenswrapper[5120]: I0316 17:13:03.917683 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5d98a227-166a-4c9f-b446-5f8655bdfa26-operator-scripts\") pod \"neutron-db-create-gj7s7\" (UID: \"5d98a227-166a-4c9f-b446-5f8655bdfa26\") " pod="openstack-kuttl-tests/neutron-db-create-gj7s7" Mar 16 17:13:03 crc kubenswrapper[5120]: I0316 17:13:03.918003 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbqn6\" (UniqueName: \"kubernetes.io/projected/62ffd5af-996f-414a-bf84-daf4cc0fe7e0-kube-api-access-gbqn6\") pod \"neutron-8685-account-create-update-5zjjt\" (UID: \"62ffd5af-996f-414a-bf84-daf4cc0fe7e0\") " pod="openstack-kuttl-tests/neutron-8685-account-create-update-5zjjt" Mar 16 17:13:03 crc kubenswrapper[5120]: I0316 17:13:03.918211 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/62ffd5af-996f-414a-bf84-daf4cc0fe7e0-operator-scripts\") pod \"neutron-8685-account-create-update-5zjjt\" (UID: \"62ffd5af-996f-414a-bf84-daf4cc0fe7e0\") " pod="openstack-kuttl-tests/neutron-8685-account-create-update-5zjjt" Mar 16 17:13:03 crc kubenswrapper[5120]: I0316 17:13:03.918433 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e390938f-0d81-4a22-af72-9be8abab5a41-operator-scripts\") pod \"barbican-db-create-ghtjt\" (UID: \"e390938f-0d81-4a22-af72-9be8abab5a41\") " pod="openstack-kuttl-tests/barbican-db-create-ghtjt" Mar 16 17:13:03 crc kubenswrapper[5120]: I0316 17:13:03.919153 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-keystone-dockercfg-s57zl\"" Mar 16 17:13:03 crc kubenswrapper[5120]: I0316 17:13:03.919337 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-config-data\"" Mar 16 17:13:03 crc kubenswrapper[5120]: I0316 17:13:03.919544 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone\"" Mar 16 17:13:03 crc kubenswrapper[5120]: I0316 17:13:03.919992 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5d98a227-166a-4c9f-b446-5f8655bdfa26-operator-scripts\") pod \"neutron-db-create-gj7s7\" (UID: \"5d98a227-166a-4c9f-b446-5f8655bdfa26\") " pod="openstack-kuttl-tests/neutron-db-create-gj7s7" Mar 16 17:13:03 crc kubenswrapper[5120]: I0316 17:13:03.936478 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9g8js\" (UniqueName: \"kubernetes.io/projected/5d98a227-166a-4c9f-b446-5f8655bdfa26-kube-api-access-9g8js\") pod \"neutron-db-create-gj7s7\" (UID: \"5d98a227-166a-4c9f-b446-5f8655bdfa26\") " pod="openstack-kuttl-tests/neutron-db-create-gj7s7" Mar 16 17:13:04 crc kubenswrapper[5120]: I0316 17:13:04.020210 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9mmkp\" (UniqueName: \"kubernetes.io/projected/e390938f-0d81-4a22-af72-9be8abab5a41-kube-api-access-9mmkp\") pod \"barbican-db-create-ghtjt\" (UID: \"e390938f-0d81-4a22-af72-9be8abab5a41\") " pod="openstack-kuttl-tests/barbican-db-create-ghtjt" Mar 16 17:13:04 crc kubenswrapper[5120]: I0316 17:13:04.020550 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzvlh\" (UniqueName: \"kubernetes.io/projected/ef3c62c1-6067-4615-b80f-864bbd13fa7f-kube-api-access-vzvlh\") pod \"keystone-db-sync-vf5nd\" (UID: \"ef3c62c1-6067-4615-b80f-864bbd13fa7f\") " pod="openstack-kuttl-tests/keystone-db-sync-vf5nd" Mar 16 17:13:04 crc kubenswrapper[5120]: I0316 17:13:04.020600 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ef3c62c1-6067-4615-b80f-864bbd13fa7f-config-data\") pod \"keystone-db-sync-vf5nd\" (UID: \"ef3c62c1-6067-4615-b80f-864bbd13fa7f\") " pod="openstack-kuttl-tests/keystone-db-sync-vf5nd" Mar 16 17:13:04 crc kubenswrapper[5120]: I0316 17:13:04.020639 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gbqn6\" (UniqueName: \"kubernetes.io/projected/62ffd5af-996f-414a-bf84-daf4cc0fe7e0-kube-api-access-gbqn6\") pod \"neutron-8685-account-create-update-5zjjt\" (UID: \"62ffd5af-996f-414a-bf84-daf4cc0fe7e0\") " pod="openstack-kuttl-tests/neutron-8685-account-create-update-5zjjt" Mar 16 17:13:04 crc kubenswrapper[5120]: I0316 17:13:04.020700 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/62ffd5af-996f-414a-bf84-daf4cc0fe7e0-operator-scripts\") pod \"neutron-8685-account-create-update-5zjjt\" (UID: \"62ffd5af-996f-414a-bf84-daf4cc0fe7e0\") " pod="openstack-kuttl-tests/neutron-8685-account-create-update-5zjjt" Mar 16 17:13:04 crc kubenswrapper[5120]: I0316 17:13:04.020772 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ef3c62c1-6067-4615-b80f-864bbd13fa7f-combined-ca-bundle\") pod \"keystone-db-sync-vf5nd\" (UID: \"ef3c62c1-6067-4615-b80f-864bbd13fa7f\") " pod="openstack-kuttl-tests/keystone-db-sync-vf5nd" Mar 16 17:13:04 crc kubenswrapper[5120]: I0316 17:13:04.020863 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e390938f-0d81-4a22-af72-9be8abab5a41-operator-scripts\") pod \"barbican-db-create-ghtjt\" (UID: \"e390938f-0d81-4a22-af72-9be8abab5a41\") " pod="openstack-kuttl-tests/barbican-db-create-ghtjt" Mar 16 17:13:04 crc kubenswrapper[5120]: I0316 17:13:04.020945 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmhbf\" (UniqueName: \"kubernetes.io/projected/999a6ca6-faad-41e9-8109-ac171d5061ef-kube-api-access-zmhbf\") pod \"cinder-3030-account-create-update-kwtzw\" (UID: \"999a6ca6-faad-41e9-8109-ac171d5061ef\") " pod="openstack-kuttl-tests/cinder-3030-account-create-update-kwtzw" Mar 16 17:13:04 crc kubenswrapper[5120]: I0316 17:13:04.020985 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/999a6ca6-faad-41e9-8109-ac171d5061ef-operator-scripts\") pod \"cinder-3030-account-create-update-kwtzw\" (UID: \"999a6ca6-faad-41e9-8109-ac171d5061ef\") " pod="openstack-kuttl-tests/cinder-3030-account-create-update-kwtzw" Mar 16 17:13:04 crc kubenswrapper[5120]: I0316 17:13:04.023030 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/62ffd5af-996f-414a-bf84-daf4cc0fe7e0-operator-scripts\") pod \"neutron-8685-account-create-update-5zjjt\" (UID: \"62ffd5af-996f-414a-bf84-daf4cc0fe7e0\") " pod="openstack-kuttl-tests/neutron-8685-account-create-update-5zjjt" Mar 16 17:13:04 crc kubenswrapper[5120]: I0316 17:13:04.023741 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e390938f-0d81-4a22-af72-9be8abab5a41-operator-scripts\") pod \"barbican-db-create-ghtjt\" (UID: \"e390938f-0d81-4a22-af72-9be8abab5a41\") " pod="openstack-kuttl-tests/barbican-db-create-ghtjt" Mar 16 17:13:04 crc kubenswrapper[5120]: I0316 17:13:04.025660 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-create-gj7s7" Mar 16 17:13:04 crc kubenswrapper[5120]: I0316 17:13:04.044033 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbqn6\" (UniqueName: \"kubernetes.io/projected/62ffd5af-996f-414a-bf84-daf4cc0fe7e0-kube-api-access-gbqn6\") pod \"neutron-8685-account-create-update-5zjjt\" (UID: \"62ffd5af-996f-414a-bf84-daf4cc0fe7e0\") " pod="openstack-kuttl-tests/neutron-8685-account-create-update-5zjjt" Mar 16 17:13:04 crc kubenswrapper[5120]: I0316 17:13:04.048913 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mmkp\" (UniqueName: \"kubernetes.io/projected/e390938f-0d81-4a22-af72-9be8abab5a41-kube-api-access-9mmkp\") pod \"barbican-db-create-ghtjt\" (UID: \"e390938f-0d81-4a22-af72-9be8abab5a41\") " pod="openstack-kuttl-tests/barbican-db-create-ghtjt" Mar 16 17:13:04 crc kubenswrapper[5120]: I0316 17:13:04.073148 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-8685-account-create-update-5zjjt" Mar 16 17:13:04 crc kubenswrapper[5120]: I0316 17:13:04.094668 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-4ea4-account-create-update-xv79b"] Mar 16 17:13:04 crc kubenswrapper[5120]: I0316 17:13:04.102953 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-4ea4-account-create-update-xv79b" Mar 16 17:13:04 crc kubenswrapper[5120]: I0316 17:13:04.103331 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-4ea4-account-create-update-xv79b"] Mar 16 17:13:04 crc kubenswrapper[5120]: I0316 17:13:04.108354 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-db-secret\"" Mar 16 17:13:04 crc kubenswrapper[5120]: I0316 17:13:04.119850 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-create-ghtjt" Mar 16 17:13:04 crc kubenswrapper[5120]: I0316 17:13:04.123395 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vzvlh\" (UniqueName: \"kubernetes.io/projected/ef3c62c1-6067-4615-b80f-864bbd13fa7f-kube-api-access-vzvlh\") pod \"keystone-db-sync-vf5nd\" (UID: \"ef3c62c1-6067-4615-b80f-864bbd13fa7f\") " pod="openstack-kuttl-tests/keystone-db-sync-vf5nd" Mar 16 17:13:04 crc kubenswrapper[5120]: I0316 17:13:04.123460 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/395a908b-e313-45e5-b42d-5fbf7eb4ac61-operator-scripts\") pod \"barbican-4ea4-account-create-update-xv79b\" (UID: \"395a908b-e313-45e5-b42d-5fbf7eb4ac61\") " pod="openstack-kuttl-tests/barbican-4ea4-account-create-update-xv79b" Mar 16 17:13:04 crc kubenswrapper[5120]: I0316 17:13:04.123543 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ef3c62c1-6067-4615-b80f-864bbd13fa7f-config-data\") pod \"keystone-db-sync-vf5nd\" (UID: \"ef3c62c1-6067-4615-b80f-864bbd13fa7f\") " pod="openstack-kuttl-tests/keystone-db-sync-vf5nd" Mar 16 17:13:04 crc kubenswrapper[5120]: I0316 17:13:04.123755 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ef3c62c1-6067-4615-b80f-864bbd13fa7f-combined-ca-bundle\") pod \"keystone-db-sync-vf5nd\" (UID: \"ef3c62c1-6067-4615-b80f-864bbd13fa7f\") " pod="openstack-kuttl-tests/keystone-db-sync-vf5nd" Mar 16 17:13:04 crc kubenswrapper[5120]: I0316 17:13:04.124181 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zmhbf\" (UniqueName: \"kubernetes.io/projected/999a6ca6-faad-41e9-8109-ac171d5061ef-kube-api-access-zmhbf\") pod \"cinder-3030-account-create-update-kwtzw\" (UID: \"999a6ca6-faad-41e9-8109-ac171d5061ef\") " pod="openstack-kuttl-tests/cinder-3030-account-create-update-kwtzw" Mar 16 17:13:04 crc kubenswrapper[5120]: I0316 17:13:04.124252 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/999a6ca6-faad-41e9-8109-ac171d5061ef-operator-scripts\") pod \"cinder-3030-account-create-update-kwtzw\" (UID: \"999a6ca6-faad-41e9-8109-ac171d5061ef\") " pod="openstack-kuttl-tests/cinder-3030-account-create-update-kwtzw" Mar 16 17:13:04 crc kubenswrapper[5120]: I0316 17:13:04.124305 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5x2kc\" (UniqueName: \"kubernetes.io/projected/395a908b-e313-45e5-b42d-5fbf7eb4ac61-kube-api-access-5x2kc\") pod \"barbican-4ea4-account-create-update-xv79b\" (UID: \"395a908b-e313-45e5-b42d-5fbf7eb4ac61\") " pod="openstack-kuttl-tests/barbican-4ea4-account-create-update-xv79b" Mar 16 17:13:04 crc kubenswrapper[5120]: I0316 17:13:04.126900 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/999a6ca6-faad-41e9-8109-ac171d5061ef-operator-scripts\") pod \"cinder-3030-account-create-update-kwtzw\" (UID: \"999a6ca6-faad-41e9-8109-ac171d5061ef\") " pod="openstack-kuttl-tests/cinder-3030-account-create-update-kwtzw" Mar 16 17:13:04 crc kubenswrapper[5120]: I0316 17:13:04.128263 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ef3c62c1-6067-4615-b80f-864bbd13fa7f-config-data\") pod \"keystone-db-sync-vf5nd\" (UID: \"ef3c62c1-6067-4615-b80f-864bbd13fa7f\") " pod="openstack-kuttl-tests/keystone-db-sync-vf5nd" Mar 16 17:13:04 crc kubenswrapper[5120]: I0316 17:13:04.144105 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzvlh\" (UniqueName: \"kubernetes.io/projected/ef3c62c1-6067-4615-b80f-864bbd13fa7f-kube-api-access-vzvlh\") pod \"keystone-db-sync-vf5nd\" (UID: \"ef3c62c1-6067-4615-b80f-864bbd13fa7f\") " pod="openstack-kuttl-tests/keystone-db-sync-vf5nd" Mar 16 17:13:04 crc kubenswrapper[5120]: I0316 17:13:04.149099 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ef3c62c1-6067-4615-b80f-864bbd13fa7f-combined-ca-bundle\") pod \"keystone-db-sync-vf5nd\" (UID: \"ef3c62c1-6067-4615-b80f-864bbd13fa7f\") " pod="openstack-kuttl-tests/keystone-db-sync-vf5nd" Mar 16 17:13:04 crc kubenswrapper[5120]: I0316 17:13:04.160296 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmhbf\" (UniqueName: \"kubernetes.io/projected/999a6ca6-faad-41e9-8109-ac171d5061ef-kube-api-access-zmhbf\") pod \"cinder-3030-account-create-update-kwtzw\" (UID: \"999a6ca6-faad-41e9-8109-ac171d5061ef\") " pod="openstack-kuttl-tests/cinder-3030-account-create-update-kwtzw" Mar 16 17:13:04 crc kubenswrapper[5120]: I0316 17:13:04.224041 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-3030-account-create-update-kwtzw" Mar 16 17:13:04 crc kubenswrapper[5120]: I0316 17:13:04.225669 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5x2kc\" (UniqueName: \"kubernetes.io/projected/395a908b-e313-45e5-b42d-5fbf7eb4ac61-kube-api-access-5x2kc\") pod \"barbican-4ea4-account-create-update-xv79b\" (UID: \"395a908b-e313-45e5-b42d-5fbf7eb4ac61\") " pod="openstack-kuttl-tests/barbican-4ea4-account-create-update-xv79b" Mar 16 17:13:04 crc kubenswrapper[5120]: I0316 17:13:04.225962 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/395a908b-e313-45e5-b42d-5fbf7eb4ac61-operator-scripts\") pod \"barbican-4ea4-account-create-update-xv79b\" (UID: \"395a908b-e313-45e5-b42d-5fbf7eb4ac61\") " pod="openstack-kuttl-tests/barbican-4ea4-account-create-update-xv79b" Mar 16 17:13:04 crc kubenswrapper[5120]: I0316 17:13:04.226653 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/395a908b-e313-45e5-b42d-5fbf7eb4ac61-operator-scripts\") pod \"barbican-4ea4-account-create-update-xv79b\" (UID: \"395a908b-e313-45e5-b42d-5fbf7eb4ac61\") " pod="openstack-kuttl-tests/barbican-4ea4-account-create-update-xv79b" Mar 16 17:13:04 crc kubenswrapper[5120]: I0316 17:13:04.249813 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5x2kc\" (UniqueName: \"kubernetes.io/projected/395a908b-e313-45e5-b42d-5fbf7eb4ac61-kube-api-access-5x2kc\") pod \"barbican-4ea4-account-create-update-xv79b\" (UID: \"395a908b-e313-45e5-b42d-5fbf7eb4ac61\") " pod="openstack-kuttl-tests/barbican-4ea4-account-create-update-xv79b" Mar 16 17:13:04 crc kubenswrapper[5120]: I0316 17:13:04.280076 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-vf5nd" Mar 16 17:13:04 crc kubenswrapper[5120]: I0316 17:13:04.331681 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-db-create-492cm"] Mar 16 17:13:04 crc kubenswrapper[5120]: W0316 17:13:04.355282 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podec0fbee9_412d_4f41_bf44_1316a4ccd5ca.slice/crio-5627351abbb834093a325714e55e7310832afcf0abc2ddaeba474a598d6e6642 WatchSource:0}: Error finding container 5627351abbb834093a325714e55e7310832afcf0abc2ddaeba474a598d6e6642: Status 404 returned error can't find the container with id 5627351abbb834093a325714e55e7310832afcf0abc2ddaeba474a598d6e6642 Mar 16 17:13:04 crc kubenswrapper[5120]: I0316 17:13:04.425346 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-4ea4-account-create-update-xv79b" Mar 16 17:13:04 crc kubenswrapper[5120]: I0316 17:13:04.579393 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-db-create-gj7s7"] Mar 16 17:13:04 crc kubenswrapper[5120]: I0316 17:13:04.689363 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd632cf1-9975-4595-bdb6-c33fc07f41a5" path="/var/lib/kubelet/pods/fd632cf1-9975-4595-bdb6-c33fc07f41a5/volumes" Mar 16 17:13:04 crc kubenswrapper[5120]: I0316 17:13:04.692029 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-db-create-ghtjt"] Mar 16 17:13:04 crc kubenswrapper[5120]: W0316 17:13:04.718227 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode390938f_0d81_4a22_af72_9be8abab5a41.slice/crio-29962c8f54337cda0aa10d496b195ed41685ae7b9835bf24de07fe17faab4fda WatchSource:0}: Error finding container 29962c8f54337cda0aa10d496b195ed41685ae7b9835bf24de07fe17faab4fda: Status 404 returned error can't find the container with id 29962c8f54337cda0aa10d496b195ed41685ae7b9835bf24de07fe17faab4fda Mar 16 17:13:04 crc kubenswrapper[5120]: I0316 17:13:04.746979 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-8685-account-create-update-5zjjt"] Mar 16 17:13:04 crc kubenswrapper[5120]: W0316 17:13:04.770930 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod62ffd5af_996f_414a_bf84_daf4cc0fe7e0.slice/crio-78f6b12e8839dea15d264c0c0f5a5398343d602908787615d96db901bc6fc001 WatchSource:0}: Error finding container 78f6b12e8839dea15d264c0c0f5a5398343d602908787615d96db901bc6fc001: Status 404 returned error can't find the container with id 78f6b12e8839dea15d264c0c0f5a5398343d602908787615d96db901bc6fc001 Mar 16 17:13:04 crc kubenswrapper[5120]: I0316 17:13:04.966816 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-vf5nd"] Mar 16 17:13:04 crc kubenswrapper[5120]: I0316 17:13:04.991486 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-3030-account-create-update-kwtzw"] Mar 16 17:13:05 crc kubenswrapper[5120]: I0316 17:13:05.160511 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-4ea4-account-create-update-xv79b"] Mar 16 17:13:05 crc kubenswrapper[5120]: I0316 17:13:05.302581 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-create-ghtjt" event={"ID":"e390938f-0d81-4a22-af72-9be8abab5a41","Type":"ContainerStarted","Data":"c7a15f2dd536b583d840c10d08618ee37e6801a618d7575bc6b9fb9b1e7d8be4"} Mar 16 17:13:05 crc kubenswrapper[5120]: I0316 17:13:05.302643 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-create-ghtjt" event={"ID":"e390938f-0d81-4a22-af72-9be8abab5a41","Type":"ContainerStarted","Data":"29962c8f54337cda0aa10d496b195ed41685ae7b9835bf24de07fe17faab4fda"} Mar 16 17:13:05 crc kubenswrapper[5120]: I0316 17:13:05.305429 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-create-gj7s7" event={"ID":"5d98a227-166a-4c9f-b446-5f8655bdfa26","Type":"ContainerStarted","Data":"1ab4100590d5d8e4fa9e54686cd48c0965b7121e2cde22d518c0e42a5bb377df"} Mar 16 17:13:05 crc kubenswrapper[5120]: I0316 17:13:05.305471 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-create-gj7s7" event={"ID":"5d98a227-166a-4c9f-b446-5f8655bdfa26","Type":"ContainerStarted","Data":"4b4e7caffc03a18d5fe6dd80ac7f630099d5047827bd65168e2728ab195dc242"} Mar 16 17:13:05 crc kubenswrapper[5120]: I0316 17:13:05.306855 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-vf5nd" event={"ID":"ef3c62c1-6067-4615-b80f-864bbd13fa7f","Type":"ContainerStarted","Data":"dbe80d378b18bf73479fb7d0fdf0e3d7c15b8cd061b00e3a2673a3bbabae99c1"} Mar 16 17:13:05 crc kubenswrapper[5120]: I0316 17:13:05.309346 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-3030-account-create-update-kwtzw" event={"ID":"999a6ca6-faad-41e9-8109-ac171d5061ef","Type":"ContainerStarted","Data":"9eca1b5e4ab9db9d09aa2ebac256f4fe9d2169217b774dc5d6e8d6acf6e63f95"} Mar 16 17:13:05 crc kubenswrapper[5120]: I0316 17:13:05.313376 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-create-492cm" event={"ID":"ec0fbee9-412d-4f41-bf44-1316a4ccd5ca","Type":"ContainerStarted","Data":"e2e5cba0bca7902561e2a9258c62d939245b084a6ca01022a356aa26dd638533"} Mar 16 17:13:05 crc kubenswrapper[5120]: I0316 17:13:05.313426 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-create-492cm" event={"ID":"ec0fbee9-412d-4f41-bf44-1316a4ccd5ca","Type":"ContainerStarted","Data":"5627351abbb834093a325714e55e7310832afcf0abc2ddaeba474a598d6e6642"} Mar 16 17:13:05 crc kubenswrapper[5120]: I0316 17:13:05.315612 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-4ea4-account-create-update-xv79b" event={"ID":"395a908b-e313-45e5-b42d-5fbf7eb4ac61","Type":"ContainerStarted","Data":"5395c11e097ed1bd27c9c0f17e22165db2e464728d71ee3ffca691e5edb8c2e2"} Mar 16 17:13:05 crc kubenswrapper[5120]: I0316 17:13:05.318486 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-8685-account-create-update-5zjjt" event={"ID":"62ffd5af-996f-414a-bf84-daf4cc0fe7e0","Type":"ContainerStarted","Data":"c6b6afe464f39d47838ecf9cba30e2a424d34b117bad13b505276f6588700973"} Mar 16 17:13:05 crc kubenswrapper[5120]: I0316 17:13:05.318735 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-8685-account-create-update-5zjjt" event={"ID":"62ffd5af-996f-414a-bf84-daf4cc0fe7e0","Type":"ContainerStarted","Data":"78f6b12e8839dea15d264c0c0f5a5398343d602908787615d96db901bc6fc001"} Mar 16 17:13:05 crc kubenswrapper[5120]: I0316 17:13:05.326007 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-db-create-ghtjt" podStartSLOduration=2.325989174 podStartE2EDuration="2.325989174s" podCreationTimestamp="2026-03-16 17:13:03 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:13:05.323688392 +0000 UTC m=+6087.477620049" watchObservedRunningTime="2026-03-16 17:13:05.325989174 +0000 UTC m=+6087.479920831" Mar 16 17:13:05 crc kubenswrapper[5120]: I0316 17:13:05.352292 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-db-create-gj7s7" podStartSLOduration=2.352264263 podStartE2EDuration="2.352264263s" podCreationTimestamp="2026-03-16 17:13:03 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:13:05.346256149 +0000 UTC m=+6087.500187806" watchObservedRunningTime="2026-03-16 17:13:05.352264263 +0000 UTC m=+6087.506195920" Mar 16 17:13:05 crc kubenswrapper[5120]: I0316 17:13:05.399164 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-db-create-492cm" podStartSLOduration=2.399141515 podStartE2EDuration="2.399141515s" podCreationTimestamp="2026-03-16 17:13:03 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:13:05.377961606 +0000 UTC m=+6087.531893263" watchObservedRunningTime="2026-03-16 17:13:05.399141515 +0000 UTC m=+6087.553073172" Mar 16 17:13:05 crc kubenswrapper[5120]: I0316 17:13:05.401070 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-8685-account-create-update-5zjjt" podStartSLOduration=2.401055798 podStartE2EDuration="2.401055798s" podCreationTimestamp="2026-03-16 17:13:03 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:13:05.399883166 +0000 UTC m=+6087.553814823" watchObservedRunningTime="2026-03-16 17:13:05.401055798 +0000 UTC m=+6087.554987455" Mar 16 17:13:06 crc kubenswrapper[5120]: I0316 17:13:06.333958 5120 generic.go:358] "Generic (PLEG): container finished" podID="5d98a227-166a-4c9f-b446-5f8655bdfa26" containerID="1ab4100590d5d8e4fa9e54686cd48c0965b7121e2cde22d518c0e42a5bb377df" exitCode=0 Mar 16 17:13:06 crc kubenswrapper[5120]: I0316 17:13:06.334020 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-create-gj7s7" event={"ID":"5d98a227-166a-4c9f-b446-5f8655bdfa26","Type":"ContainerDied","Data":"1ab4100590d5d8e4fa9e54686cd48c0965b7121e2cde22d518c0e42a5bb377df"} Mar 16 17:13:06 crc kubenswrapper[5120]: I0316 17:13:06.337221 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-vf5nd" event={"ID":"ef3c62c1-6067-4615-b80f-864bbd13fa7f","Type":"ContainerStarted","Data":"81a6cc53b93730662569cd29e06dc1b386c364839efe1a339b666a72f63805a7"} Mar 16 17:13:06 crc kubenswrapper[5120]: I0316 17:13:06.339923 5120 generic.go:358] "Generic (PLEG): container finished" podID="999a6ca6-faad-41e9-8109-ac171d5061ef" containerID="f2fd4118710864ad06cc20a55c6ae43fbe323625383cc78fc6cbcc1237aa7f72" exitCode=0 Mar 16 17:13:06 crc kubenswrapper[5120]: I0316 17:13:06.339967 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-3030-account-create-update-kwtzw" event={"ID":"999a6ca6-faad-41e9-8109-ac171d5061ef","Type":"ContainerDied","Data":"f2fd4118710864ad06cc20a55c6ae43fbe323625383cc78fc6cbcc1237aa7f72"} Mar 16 17:13:06 crc kubenswrapper[5120]: I0316 17:13:06.341960 5120 generic.go:358] "Generic (PLEG): container finished" podID="ec0fbee9-412d-4f41-bf44-1316a4ccd5ca" containerID="e2e5cba0bca7902561e2a9258c62d939245b084a6ca01022a356aa26dd638533" exitCode=0 Mar 16 17:13:06 crc kubenswrapper[5120]: I0316 17:13:06.342084 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-create-492cm" event={"ID":"ec0fbee9-412d-4f41-bf44-1316a4ccd5ca","Type":"ContainerDied","Data":"e2e5cba0bca7902561e2a9258c62d939245b084a6ca01022a356aa26dd638533"} Mar 16 17:13:06 crc kubenswrapper[5120]: I0316 17:13:06.344473 5120 generic.go:358] "Generic (PLEG): container finished" podID="395a908b-e313-45e5-b42d-5fbf7eb4ac61" containerID="1e9cd00e86a07ced8e5890ac53aac6c8f28d7dec2aa0d42f36303e867bab0e57" exitCode=0 Mar 16 17:13:06 crc kubenswrapper[5120]: I0316 17:13:06.344516 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-4ea4-account-create-update-xv79b" event={"ID":"395a908b-e313-45e5-b42d-5fbf7eb4ac61","Type":"ContainerDied","Data":"1e9cd00e86a07ced8e5890ac53aac6c8f28d7dec2aa0d42f36303e867bab0e57"} Mar 16 17:13:06 crc kubenswrapper[5120]: I0316 17:13:06.346827 5120 generic.go:358] "Generic (PLEG): container finished" podID="62ffd5af-996f-414a-bf84-daf4cc0fe7e0" containerID="c6b6afe464f39d47838ecf9cba30e2a424d34b117bad13b505276f6588700973" exitCode=0 Mar 16 17:13:06 crc kubenswrapper[5120]: I0316 17:13:06.347105 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-8685-account-create-update-5zjjt" event={"ID":"62ffd5af-996f-414a-bf84-daf4cc0fe7e0","Type":"ContainerDied","Data":"c6b6afe464f39d47838ecf9cba30e2a424d34b117bad13b505276f6588700973"} Mar 16 17:13:06 crc kubenswrapper[5120]: I0316 17:13:06.350161 5120 generic.go:358] "Generic (PLEG): container finished" podID="e390938f-0d81-4a22-af72-9be8abab5a41" containerID="c7a15f2dd536b583d840c10d08618ee37e6801a618d7575bc6b9fb9b1e7d8be4" exitCode=0 Mar 16 17:13:06 crc kubenswrapper[5120]: I0316 17:13:06.350227 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-create-ghtjt" event={"ID":"e390938f-0d81-4a22-af72-9be8abab5a41","Type":"ContainerDied","Data":"c7a15f2dd536b583d840c10d08618ee37e6801a618d7575bc6b9fb9b1e7d8be4"} Mar 16 17:13:06 crc kubenswrapper[5120]: I0316 17:13:06.455053 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-db-sync-vf5nd" podStartSLOduration=3.455033884 podStartE2EDuration="3.455033884s" podCreationTimestamp="2026-03-16 17:13:03 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:13:06.452192477 +0000 UTC m=+6088.606124134" watchObservedRunningTime="2026-03-16 17:13:06.455033884 +0000 UTC m=+6088.608965541" Mar 16 17:13:07 crc kubenswrapper[5120]: I0316 17:13:07.797904 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-4ea4-account-create-update-xv79b" Mar 16 17:13:07 crc kubenswrapper[5120]: I0316 17:13:07.924174 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/395a908b-e313-45e5-b42d-5fbf7eb4ac61-operator-scripts\") pod \"395a908b-e313-45e5-b42d-5fbf7eb4ac61\" (UID: \"395a908b-e313-45e5-b42d-5fbf7eb4ac61\") " Mar 16 17:13:07 crc kubenswrapper[5120]: I0316 17:13:07.924785 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/395a908b-e313-45e5-b42d-5fbf7eb4ac61-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "395a908b-e313-45e5-b42d-5fbf7eb4ac61" (UID: "395a908b-e313-45e5-b42d-5fbf7eb4ac61"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:13:07 crc kubenswrapper[5120]: I0316 17:13:07.924905 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5x2kc\" (UniqueName: \"kubernetes.io/projected/395a908b-e313-45e5-b42d-5fbf7eb4ac61-kube-api-access-5x2kc\") pod \"395a908b-e313-45e5-b42d-5fbf7eb4ac61\" (UID: \"395a908b-e313-45e5-b42d-5fbf7eb4ac61\") " Mar 16 17:13:07 crc kubenswrapper[5120]: I0316 17:13:07.926137 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/395a908b-e313-45e5-b42d-5fbf7eb4ac61-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:13:07 crc kubenswrapper[5120]: I0316 17:13:07.935962 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/395a908b-e313-45e5-b42d-5fbf7eb4ac61-kube-api-access-5x2kc" (OuterVolumeSpecName: "kube-api-access-5x2kc") pod "395a908b-e313-45e5-b42d-5fbf7eb4ac61" (UID: "395a908b-e313-45e5-b42d-5fbf7eb4ac61"). InnerVolumeSpecName "kube-api-access-5x2kc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:13:07 crc kubenswrapper[5120]: I0316 17:13:07.963564 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-3030-account-create-update-kwtzw" Mar 16 17:13:07 crc kubenswrapper[5120]: I0316 17:13:07.976849 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-create-ghtjt" Mar 16 17:13:07 crc kubenswrapper[5120]: I0316 17:13:07.992237 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-create-492cm" Mar 16 17:13:08 crc kubenswrapper[5120]: I0316 17:13:08.006228 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-create-gj7s7" Mar 16 17:13:08 crc kubenswrapper[5120]: I0316 17:13:08.020087 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-8685-account-create-update-5zjjt" Mar 16 17:13:08 crc kubenswrapper[5120]: I0316 17:13:08.027238 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9mmkp\" (UniqueName: \"kubernetes.io/projected/e390938f-0d81-4a22-af72-9be8abab5a41-kube-api-access-9mmkp\") pod \"e390938f-0d81-4a22-af72-9be8abab5a41\" (UID: \"e390938f-0d81-4a22-af72-9be8abab5a41\") " Mar 16 17:13:08 crc kubenswrapper[5120]: I0316 17:13:08.027346 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/999a6ca6-faad-41e9-8109-ac171d5061ef-operator-scripts\") pod \"999a6ca6-faad-41e9-8109-ac171d5061ef\" (UID: \"999a6ca6-faad-41e9-8109-ac171d5061ef\") " Mar 16 17:13:08 crc kubenswrapper[5120]: I0316 17:13:08.028142 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e390938f-0d81-4a22-af72-9be8abab5a41-operator-scripts\") pod \"e390938f-0d81-4a22-af72-9be8abab5a41\" (UID: \"e390938f-0d81-4a22-af72-9be8abab5a41\") " Mar 16 17:13:08 crc kubenswrapper[5120]: I0316 17:13:08.028182 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zmhbf\" (UniqueName: \"kubernetes.io/projected/999a6ca6-faad-41e9-8109-ac171d5061ef-kube-api-access-zmhbf\") pod \"999a6ca6-faad-41e9-8109-ac171d5061ef\" (UID: \"999a6ca6-faad-41e9-8109-ac171d5061ef\") " Mar 16 17:13:08 crc kubenswrapper[5120]: I0316 17:13:08.028793 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e390938f-0d81-4a22-af72-9be8abab5a41-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "e390938f-0d81-4a22-af72-9be8abab5a41" (UID: "e390938f-0d81-4a22-af72-9be8abab5a41"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:13:08 crc kubenswrapper[5120]: I0316 17:13:08.029164 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/999a6ca6-faad-41e9-8109-ac171d5061ef-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "999a6ca6-faad-41e9-8109-ac171d5061ef" (UID: "999a6ca6-faad-41e9-8109-ac171d5061ef"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:13:08 crc kubenswrapper[5120]: I0316 17:13:08.029428 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/999a6ca6-faad-41e9-8109-ac171d5061ef-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:13:08 crc kubenswrapper[5120]: I0316 17:13:08.029447 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5x2kc\" (UniqueName: \"kubernetes.io/projected/395a908b-e313-45e5-b42d-5fbf7eb4ac61-kube-api-access-5x2kc\") on node \"crc\" DevicePath \"\"" Mar 16 17:13:08 crc kubenswrapper[5120]: I0316 17:13:08.029459 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e390938f-0d81-4a22-af72-9be8abab5a41-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:13:08 crc kubenswrapper[5120]: I0316 17:13:08.036154 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e390938f-0d81-4a22-af72-9be8abab5a41-kube-api-access-9mmkp" (OuterVolumeSpecName: "kube-api-access-9mmkp") pod "e390938f-0d81-4a22-af72-9be8abab5a41" (UID: "e390938f-0d81-4a22-af72-9be8abab5a41"). InnerVolumeSpecName "kube-api-access-9mmkp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:13:08 crc kubenswrapper[5120]: I0316 17:13:08.039122 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/999a6ca6-faad-41e9-8109-ac171d5061ef-kube-api-access-zmhbf" (OuterVolumeSpecName: "kube-api-access-zmhbf") pod "999a6ca6-faad-41e9-8109-ac171d5061ef" (UID: "999a6ca6-faad-41e9-8109-ac171d5061ef"). InnerVolumeSpecName "kube-api-access-zmhbf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:13:08 crc kubenswrapper[5120]: E0316 17:13:08.090732 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1596846 actualBytes=10240 Mar 16 17:13:08 crc kubenswrapper[5120]: I0316 17:13:08.130196 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9g8js\" (UniqueName: \"kubernetes.io/projected/5d98a227-166a-4c9f-b446-5f8655bdfa26-kube-api-access-9g8js\") pod \"5d98a227-166a-4c9f-b446-5f8655bdfa26\" (UID: \"5d98a227-166a-4c9f-b446-5f8655bdfa26\") " Mar 16 17:13:08 crc kubenswrapper[5120]: I0316 17:13:08.130578 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gbqn6\" (UniqueName: \"kubernetes.io/projected/62ffd5af-996f-414a-bf84-daf4cc0fe7e0-kube-api-access-gbqn6\") pod \"62ffd5af-996f-414a-bf84-daf4cc0fe7e0\" (UID: \"62ffd5af-996f-414a-bf84-daf4cc0fe7e0\") " Mar 16 17:13:08 crc kubenswrapper[5120]: I0316 17:13:08.131070 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ec0fbee9-412d-4f41-bf44-1316a4ccd5ca-operator-scripts\") pod \"ec0fbee9-412d-4f41-bf44-1316a4ccd5ca\" (UID: \"ec0fbee9-412d-4f41-bf44-1316a4ccd5ca\") " Mar 16 17:13:08 crc kubenswrapper[5120]: I0316 17:13:08.131273 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/62ffd5af-996f-414a-bf84-daf4cc0fe7e0-operator-scripts\") pod \"62ffd5af-996f-414a-bf84-daf4cc0fe7e0\" (UID: \"62ffd5af-996f-414a-bf84-daf4cc0fe7e0\") " Mar 16 17:13:08 crc kubenswrapper[5120]: I0316 17:13:08.131476 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec0fbee9-412d-4f41-bf44-1316a4ccd5ca-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "ec0fbee9-412d-4f41-bf44-1316a4ccd5ca" (UID: "ec0fbee9-412d-4f41-bf44-1316a4ccd5ca"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:13:08 crc kubenswrapper[5120]: I0316 17:13:08.131635 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9r6gb\" (UniqueName: \"kubernetes.io/projected/ec0fbee9-412d-4f41-bf44-1316a4ccd5ca-kube-api-access-9r6gb\") pod \"ec0fbee9-412d-4f41-bf44-1316a4ccd5ca\" (UID: \"ec0fbee9-412d-4f41-bf44-1316a4ccd5ca\") " Mar 16 17:13:08 crc kubenswrapper[5120]: I0316 17:13:08.131912 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5d98a227-166a-4c9f-b446-5f8655bdfa26-operator-scripts\") pod \"5d98a227-166a-4c9f-b446-5f8655bdfa26\" (UID: \"5d98a227-166a-4c9f-b446-5f8655bdfa26\") " Mar 16 17:13:08 crc kubenswrapper[5120]: I0316 17:13:08.132022 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/62ffd5af-996f-414a-bf84-daf4cc0fe7e0-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "62ffd5af-996f-414a-bf84-daf4cc0fe7e0" (UID: "62ffd5af-996f-414a-bf84-daf4cc0fe7e0"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:13:08 crc kubenswrapper[5120]: I0316 17:13:08.132378 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d98a227-166a-4c9f-b446-5f8655bdfa26-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "5d98a227-166a-4c9f-b446-5f8655bdfa26" (UID: "5d98a227-166a-4c9f-b446-5f8655bdfa26"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:13:08 crc kubenswrapper[5120]: I0316 17:13:08.132823 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ec0fbee9-412d-4f41-bf44-1316a4ccd5ca-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:13:08 crc kubenswrapper[5120]: I0316 17:13:08.132915 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zmhbf\" (UniqueName: \"kubernetes.io/projected/999a6ca6-faad-41e9-8109-ac171d5061ef-kube-api-access-zmhbf\") on node \"crc\" DevicePath \"\"" Mar 16 17:13:08 crc kubenswrapper[5120]: I0316 17:13:08.133000 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/62ffd5af-996f-414a-bf84-daf4cc0fe7e0-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:13:08 crc kubenswrapper[5120]: I0316 17:13:08.133253 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9mmkp\" (UniqueName: \"kubernetes.io/projected/e390938f-0d81-4a22-af72-9be8abab5a41-kube-api-access-9mmkp\") on node \"crc\" DevicePath \"\"" Mar 16 17:13:08 crc kubenswrapper[5120]: I0316 17:13:08.133348 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5d98a227-166a-4c9f-b446-5f8655bdfa26-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:13:08 crc kubenswrapper[5120]: I0316 17:13:08.133900 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d98a227-166a-4c9f-b446-5f8655bdfa26-kube-api-access-9g8js" (OuterVolumeSpecName: "kube-api-access-9g8js") pod "5d98a227-166a-4c9f-b446-5f8655bdfa26" (UID: "5d98a227-166a-4c9f-b446-5f8655bdfa26"). InnerVolumeSpecName "kube-api-access-9g8js". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:13:08 crc kubenswrapper[5120]: I0316 17:13:08.134411 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62ffd5af-996f-414a-bf84-daf4cc0fe7e0-kube-api-access-gbqn6" (OuterVolumeSpecName: "kube-api-access-gbqn6") pod "62ffd5af-996f-414a-bf84-daf4cc0fe7e0" (UID: "62ffd5af-996f-414a-bf84-daf4cc0fe7e0"). InnerVolumeSpecName "kube-api-access-gbqn6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:13:08 crc kubenswrapper[5120]: I0316 17:13:08.134966 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec0fbee9-412d-4f41-bf44-1316a4ccd5ca-kube-api-access-9r6gb" (OuterVolumeSpecName: "kube-api-access-9r6gb") pod "ec0fbee9-412d-4f41-bf44-1316a4ccd5ca" (UID: "ec0fbee9-412d-4f41-bf44-1316a4ccd5ca"). InnerVolumeSpecName "kube-api-access-9r6gb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:13:08 crc kubenswrapper[5120]: I0316 17:13:08.235975 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9r6gb\" (UniqueName: \"kubernetes.io/projected/ec0fbee9-412d-4f41-bf44-1316a4ccd5ca-kube-api-access-9r6gb\") on node \"crc\" DevicePath \"\"" Mar 16 17:13:08 crc kubenswrapper[5120]: I0316 17:13:08.236006 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9g8js\" (UniqueName: \"kubernetes.io/projected/5d98a227-166a-4c9f-b446-5f8655bdfa26-kube-api-access-9g8js\") on node \"crc\" DevicePath \"\"" Mar 16 17:13:08 crc kubenswrapper[5120]: I0316 17:13:08.236015 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gbqn6\" (UniqueName: \"kubernetes.io/projected/62ffd5af-996f-414a-bf84-daf4cc0fe7e0-kube-api-access-gbqn6\") on node \"crc\" DevicePath \"\"" Mar 16 17:13:08 crc kubenswrapper[5120]: I0316 17:13:08.370176 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-3030-account-create-update-kwtzw" Mar 16 17:13:08 crc kubenswrapper[5120]: I0316 17:13:08.370786 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-3030-account-create-update-kwtzw" event={"ID":"999a6ca6-faad-41e9-8109-ac171d5061ef","Type":"ContainerDied","Data":"9eca1b5e4ab9db9d09aa2ebac256f4fe9d2169217b774dc5d6e8d6acf6e63f95"} Mar 16 17:13:08 crc kubenswrapper[5120]: I0316 17:13:08.370958 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9eca1b5e4ab9db9d09aa2ebac256f4fe9d2169217b774dc5d6e8d6acf6e63f95" Mar 16 17:13:08 crc kubenswrapper[5120]: I0316 17:13:08.372189 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-create-492cm" Mar 16 17:13:08 crc kubenswrapper[5120]: I0316 17:13:08.372190 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-create-492cm" event={"ID":"ec0fbee9-412d-4f41-bf44-1316a4ccd5ca","Type":"ContainerDied","Data":"5627351abbb834093a325714e55e7310832afcf0abc2ddaeba474a598d6e6642"} Mar 16 17:13:08 crc kubenswrapper[5120]: I0316 17:13:08.372374 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5627351abbb834093a325714e55e7310832afcf0abc2ddaeba474a598d6e6642" Mar 16 17:13:08 crc kubenswrapper[5120]: I0316 17:13:08.374078 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-4ea4-account-create-update-xv79b" event={"ID":"395a908b-e313-45e5-b42d-5fbf7eb4ac61","Type":"ContainerDied","Data":"5395c11e097ed1bd27c9c0f17e22165db2e464728d71ee3ffca691e5edb8c2e2"} Mar 16 17:13:08 crc kubenswrapper[5120]: I0316 17:13:08.374200 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5395c11e097ed1bd27c9c0f17e22165db2e464728d71ee3ffca691e5edb8c2e2" Mar 16 17:13:08 crc kubenswrapper[5120]: I0316 17:13:08.374246 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-4ea4-account-create-update-xv79b" Mar 16 17:13:08 crc kubenswrapper[5120]: I0316 17:13:08.377266 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-8685-account-create-update-5zjjt" Mar 16 17:13:08 crc kubenswrapper[5120]: I0316 17:13:08.377347 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-8685-account-create-update-5zjjt" event={"ID":"62ffd5af-996f-414a-bf84-daf4cc0fe7e0","Type":"ContainerDied","Data":"78f6b12e8839dea15d264c0c0f5a5398343d602908787615d96db901bc6fc001"} Mar 16 17:13:08 crc kubenswrapper[5120]: I0316 17:13:08.379666 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="78f6b12e8839dea15d264c0c0f5a5398343d602908787615d96db901bc6fc001" Mar 16 17:13:08 crc kubenswrapper[5120]: I0316 17:13:08.382584 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-create-ghtjt" event={"ID":"e390938f-0d81-4a22-af72-9be8abab5a41","Type":"ContainerDied","Data":"29962c8f54337cda0aa10d496b195ed41685ae7b9835bf24de07fe17faab4fda"} Mar 16 17:13:08 crc kubenswrapper[5120]: I0316 17:13:08.382636 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="29962c8f54337cda0aa10d496b195ed41685ae7b9835bf24de07fe17faab4fda" Mar 16 17:13:08 crc kubenswrapper[5120]: I0316 17:13:08.382459 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-create-ghtjt" Mar 16 17:13:08 crc kubenswrapper[5120]: I0316 17:13:08.389847 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-create-gj7s7" event={"ID":"5d98a227-166a-4c9f-b446-5f8655bdfa26","Type":"ContainerDied","Data":"4b4e7caffc03a18d5fe6dd80ac7f630099d5047827bd65168e2728ab195dc242"} Mar 16 17:13:08 crc kubenswrapper[5120]: I0316 17:13:08.390114 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4b4e7caffc03a18d5fe6dd80ac7f630099d5047827bd65168e2728ab195dc242" Mar 16 17:13:08 crc kubenswrapper[5120]: I0316 17:13:08.390054 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-create-gj7s7" Mar 16 17:13:09 crc kubenswrapper[5120]: I0316 17:13:09.399716 5120 generic.go:358] "Generic (PLEG): container finished" podID="ef3c62c1-6067-4615-b80f-864bbd13fa7f" containerID="81a6cc53b93730662569cd29e06dc1b386c364839efe1a339b666a72f63805a7" exitCode=0 Mar 16 17:13:09 crc kubenswrapper[5120]: I0316 17:13:09.399806 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-vf5nd" event={"ID":"ef3c62c1-6067-4615-b80f-864bbd13fa7f","Type":"ContainerDied","Data":"81a6cc53b93730662569cd29e06dc1b386c364839efe1a339b666a72f63805a7"} Mar 16 17:13:10 crc kubenswrapper[5120]: I0316 17:13:10.754454 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-vf5nd" Mar 16 17:13:10 crc kubenswrapper[5120]: I0316 17:13:10.895322 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vzvlh\" (UniqueName: \"kubernetes.io/projected/ef3c62c1-6067-4615-b80f-864bbd13fa7f-kube-api-access-vzvlh\") pod \"ef3c62c1-6067-4615-b80f-864bbd13fa7f\" (UID: \"ef3c62c1-6067-4615-b80f-864bbd13fa7f\") " Mar 16 17:13:10 crc kubenswrapper[5120]: I0316 17:13:10.895424 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ef3c62c1-6067-4615-b80f-864bbd13fa7f-config-data\") pod \"ef3c62c1-6067-4615-b80f-864bbd13fa7f\" (UID: \"ef3c62c1-6067-4615-b80f-864bbd13fa7f\") " Mar 16 17:13:10 crc kubenswrapper[5120]: I0316 17:13:10.895743 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ef3c62c1-6067-4615-b80f-864bbd13fa7f-combined-ca-bundle\") pod \"ef3c62c1-6067-4615-b80f-864bbd13fa7f\" (UID: \"ef3c62c1-6067-4615-b80f-864bbd13fa7f\") " Mar 16 17:13:10 crc kubenswrapper[5120]: I0316 17:13:10.905912 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef3c62c1-6067-4615-b80f-864bbd13fa7f-kube-api-access-vzvlh" (OuterVolumeSpecName: "kube-api-access-vzvlh") pod "ef3c62c1-6067-4615-b80f-864bbd13fa7f" (UID: "ef3c62c1-6067-4615-b80f-864bbd13fa7f"). InnerVolumeSpecName "kube-api-access-vzvlh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:13:10 crc kubenswrapper[5120]: I0316 17:13:10.923862 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef3c62c1-6067-4615-b80f-864bbd13fa7f-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ef3c62c1-6067-4615-b80f-864bbd13fa7f" (UID: "ef3c62c1-6067-4615-b80f-864bbd13fa7f"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:13:10 crc kubenswrapper[5120]: I0316 17:13:10.937900 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef3c62c1-6067-4615-b80f-864bbd13fa7f-config-data" (OuterVolumeSpecName: "config-data") pod "ef3c62c1-6067-4615-b80f-864bbd13fa7f" (UID: "ef3c62c1-6067-4615-b80f-864bbd13fa7f"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:13:10 crc kubenswrapper[5120]: I0316 17:13:10.998136 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vzvlh\" (UniqueName: \"kubernetes.io/projected/ef3c62c1-6067-4615-b80f-864bbd13fa7f-kube-api-access-vzvlh\") on node \"crc\" DevicePath \"\"" Mar 16 17:13:10 crc kubenswrapper[5120]: I0316 17:13:10.998168 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ef3c62c1-6067-4615-b80f-864bbd13fa7f-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:13:10 crc kubenswrapper[5120]: I0316 17:13:10.998177 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ef3c62c1-6067-4615-b80f-864bbd13fa7f-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:13:11 crc kubenswrapper[5120]: I0316 17:13:11.421623 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-vf5nd" event={"ID":"ef3c62c1-6067-4615-b80f-864bbd13fa7f","Type":"ContainerDied","Data":"dbe80d378b18bf73479fb7d0fdf0e3d7c15b8cd061b00e3a2673a3bbabae99c1"} Mar 16 17:13:11 crc kubenswrapper[5120]: I0316 17:13:11.421658 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dbe80d378b18bf73479fb7d0fdf0e3d7c15b8cd061b00e3a2673a3bbabae99c1" Mar 16 17:13:11 crc kubenswrapper[5120]: I0316 17:13:11.421720 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-vf5nd" Mar 16 17:13:11 crc kubenswrapper[5120]: I0316 17:13:11.603396 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-lt5c7"] Mar 16 17:13:11 crc kubenswrapper[5120]: I0316 17:13:11.604560 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec0fbee9-412d-4f41-bf44-1316a4ccd5ca" containerName="mariadb-database-create" Mar 16 17:13:11 crc kubenswrapper[5120]: I0316 17:13:11.604582 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec0fbee9-412d-4f41-bf44-1316a4ccd5ca" containerName="mariadb-database-create" Mar 16 17:13:11 crc kubenswrapper[5120]: I0316 17:13:11.604595 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="999a6ca6-faad-41e9-8109-ac171d5061ef" containerName="mariadb-account-create-update" Mar 16 17:13:11 crc kubenswrapper[5120]: I0316 17:13:11.604602 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="999a6ca6-faad-41e9-8109-ac171d5061ef" containerName="mariadb-account-create-update" Mar 16 17:13:11 crc kubenswrapper[5120]: I0316 17:13:11.604630 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="395a908b-e313-45e5-b42d-5fbf7eb4ac61" containerName="mariadb-account-create-update" Mar 16 17:13:11 crc kubenswrapper[5120]: I0316 17:13:11.604638 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="395a908b-e313-45e5-b42d-5fbf7eb4ac61" containerName="mariadb-account-create-update" Mar 16 17:13:11 crc kubenswrapper[5120]: I0316 17:13:11.604653 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e390938f-0d81-4a22-af72-9be8abab5a41" containerName="mariadb-database-create" Mar 16 17:13:11 crc kubenswrapper[5120]: I0316 17:13:11.604660 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e390938f-0d81-4a22-af72-9be8abab5a41" containerName="mariadb-database-create" Mar 16 17:13:11 crc kubenswrapper[5120]: I0316 17:13:11.604671 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d98a227-166a-4c9f-b446-5f8655bdfa26" containerName="mariadb-database-create" Mar 16 17:13:11 crc kubenswrapper[5120]: I0316 17:13:11.604678 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d98a227-166a-4c9f-b446-5f8655bdfa26" containerName="mariadb-database-create" Mar 16 17:13:11 crc kubenswrapper[5120]: I0316 17:13:11.604691 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62ffd5af-996f-414a-bf84-daf4cc0fe7e0" containerName="mariadb-account-create-update" Mar 16 17:13:11 crc kubenswrapper[5120]: I0316 17:13:11.604700 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="62ffd5af-996f-414a-bf84-daf4cc0fe7e0" containerName="mariadb-account-create-update" Mar 16 17:13:11 crc kubenswrapper[5120]: I0316 17:13:11.604723 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef3c62c1-6067-4615-b80f-864bbd13fa7f" containerName="keystone-db-sync" Mar 16 17:13:11 crc kubenswrapper[5120]: I0316 17:13:11.604730 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef3c62c1-6067-4615-b80f-864bbd13fa7f" containerName="keystone-db-sync" Mar 16 17:13:11 crc kubenswrapper[5120]: I0316 17:13:11.604895 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ec0fbee9-412d-4f41-bf44-1316a4ccd5ca" containerName="mariadb-database-create" Mar 16 17:13:11 crc kubenswrapper[5120]: I0316 17:13:11.604914 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="5d98a227-166a-4c9f-b446-5f8655bdfa26" containerName="mariadb-database-create" Mar 16 17:13:11 crc kubenswrapper[5120]: I0316 17:13:11.604925 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="62ffd5af-996f-414a-bf84-daf4cc0fe7e0" containerName="mariadb-account-create-update" Mar 16 17:13:11 crc kubenswrapper[5120]: I0316 17:13:11.605052 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="999a6ca6-faad-41e9-8109-ac171d5061ef" containerName="mariadb-account-create-update" Mar 16 17:13:11 crc kubenswrapper[5120]: I0316 17:13:11.605065 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="395a908b-e313-45e5-b42d-5fbf7eb4ac61" containerName="mariadb-account-create-update" Mar 16 17:13:11 crc kubenswrapper[5120]: I0316 17:13:11.605082 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e390938f-0d81-4a22-af72-9be8abab5a41" containerName="mariadb-database-create" Mar 16 17:13:11 crc kubenswrapper[5120]: I0316 17:13:11.605092 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ef3c62c1-6067-4615-b80f-864bbd13fa7f" containerName="keystone-db-sync" Mar 16 17:13:11 crc kubenswrapper[5120]: I0316 17:13:11.611940 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-lt5c7" Mar 16 17:13:11 crc kubenswrapper[5120]: I0316 17:13:11.615012 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone\"" Mar 16 17:13:11 crc kubenswrapper[5120]: I0316 17:13:11.615508 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-lt5c7"] Mar 16 17:13:11 crc kubenswrapper[5120]: I0316 17:13:11.622679 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-keystone-dockercfg-s57zl\"" Mar 16 17:13:11 crc kubenswrapper[5120]: I0316 17:13:11.623335 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"osp-secret\"" Mar 16 17:13:11 crc kubenswrapper[5120]: I0316 17:13:11.623654 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-scripts\"" Mar 16 17:13:11 crc kubenswrapper[5120]: I0316 17:13:11.625051 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-config-data\"" Mar 16 17:13:11 crc kubenswrapper[5120]: I0316 17:13:11.717086 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/78897b1d-0d3f-4635-807d-3013a628ddfc-config-data\") pod \"keystone-bootstrap-lt5c7\" (UID: \"78897b1d-0d3f-4635-807d-3013a628ddfc\") " pod="openstack-kuttl-tests/keystone-bootstrap-lt5c7" Mar 16 17:13:11 crc kubenswrapper[5120]: I0316 17:13:11.717134 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqx2x\" (UniqueName: \"kubernetes.io/projected/78897b1d-0d3f-4635-807d-3013a628ddfc-kube-api-access-xqx2x\") pod \"keystone-bootstrap-lt5c7\" (UID: \"78897b1d-0d3f-4635-807d-3013a628ddfc\") " pod="openstack-kuttl-tests/keystone-bootstrap-lt5c7" Mar 16 17:13:11 crc kubenswrapper[5120]: I0316 17:13:11.717191 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/78897b1d-0d3f-4635-807d-3013a628ddfc-scripts\") pod \"keystone-bootstrap-lt5c7\" (UID: \"78897b1d-0d3f-4635-807d-3013a628ddfc\") " pod="openstack-kuttl-tests/keystone-bootstrap-lt5c7" Mar 16 17:13:11 crc kubenswrapper[5120]: I0316 17:13:11.717295 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/78897b1d-0d3f-4635-807d-3013a628ddfc-credential-keys\") pod \"keystone-bootstrap-lt5c7\" (UID: \"78897b1d-0d3f-4635-807d-3013a628ddfc\") " pod="openstack-kuttl-tests/keystone-bootstrap-lt5c7" Mar 16 17:13:11 crc kubenswrapper[5120]: I0316 17:13:11.717440 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/78897b1d-0d3f-4635-807d-3013a628ddfc-fernet-keys\") pod \"keystone-bootstrap-lt5c7\" (UID: \"78897b1d-0d3f-4635-807d-3013a628ddfc\") " pod="openstack-kuttl-tests/keystone-bootstrap-lt5c7" Mar 16 17:13:11 crc kubenswrapper[5120]: I0316 17:13:11.717505 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/78897b1d-0d3f-4635-807d-3013a628ddfc-combined-ca-bundle\") pod \"keystone-bootstrap-lt5c7\" (UID: \"78897b1d-0d3f-4635-807d-3013a628ddfc\") " pod="openstack-kuttl-tests/keystone-bootstrap-lt5c7" Mar 16 17:13:11 crc kubenswrapper[5120]: I0316 17:13:11.805877 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:13:11 crc kubenswrapper[5120]: I0316 17:13:11.822021 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/78897b1d-0d3f-4635-807d-3013a628ddfc-fernet-keys\") pod \"keystone-bootstrap-lt5c7\" (UID: \"78897b1d-0d3f-4635-807d-3013a628ddfc\") " pod="openstack-kuttl-tests/keystone-bootstrap-lt5c7" Mar 16 17:13:11 crc kubenswrapper[5120]: I0316 17:13:11.822169 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/78897b1d-0d3f-4635-807d-3013a628ddfc-combined-ca-bundle\") pod \"keystone-bootstrap-lt5c7\" (UID: \"78897b1d-0d3f-4635-807d-3013a628ddfc\") " pod="openstack-kuttl-tests/keystone-bootstrap-lt5c7" Mar 16 17:13:11 crc kubenswrapper[5120]: I0316 17:13:11.822294 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/78897b1d-0d3f-4635-807d-3013a628ddfc-config-data\") pod \"keystone-bootstrap-lt5c7\" (UID: \"78897b1d-0d3f-4635-807d-3013a628ddfc\") " pod="openstack-kuttl-tests/keystone-bootstrap-lt5c7" Mar 16 17:13:11 crc kubenswrapper[5120]: I0316 17:13:11.822334 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xqx2x\" (UniqueName: \"kubernetes.io/projected/78897b1d-0d3f-4635-807d-3013a628ddfc-kube-api-access-xqx2x\") pod \"keystone-bootstrap-lt5c7\" (UID: \"78897b1d-0d3f-4635-807d-3013a628ddfc\") " pod="openstack-kuttl-tests/keystone-bootstrap-lt5c7" Mar 16 17:13:11 crc kubenswrapper[5120]: I0316 17:13:11.822427 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/78897b1d-0d3f-4635-807d-3013a628ddfc-scripts\") pod \"keystone-bootstrap-lt5c7\" (UID: \"78897b1d-0d3f-4635-807d-3013a628ddfc\") " pod="openstack-kuttl-tests/keystone-bootstrap-lt5c7" Mar 16 17:13:11 crc kubenswrapper[5120]: I0316 17:13:11.822620 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/78897b1d-0d3f-4635-807d-3013a628ddfc-credential-keys\") pod \"keystone-bootstrap-lt5c7\" (UID: \"78897b1d-0d3f-4635-807d-3013a628ddfc\") " pod="openstack-kuttl-tests/keystone-bootstrap-lt5c7" Mar 16 17:13:11 crc kubenswrapper[5120]: I0316 17:13:11.837502 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/78897b1d-0d3f-4635-807d-3013a628ddfc-config-data\") pod \"keystone-bootstrap-lt5c7\" (UID: \"78897b1d-0d3f-4635-807d-3013a628ddfc\") " pod="openstack-kuttl-tests/keystone-bootstrap-lt5c7" Mar 16 17:13:11 crc kubenswrapper[5120]: I0316 17:13:11.839522 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/78897b1d-0d3f-4635-807d-3013a628ddfc-fernet-keys\") pod \"keystone-bootstrap-lt5c7\" (UID: \"78897b1d-0d3f-4635-807d-3013a628ddfc\") " pod="openstack-kuttl-tests/keystone-bootstrap-lt5c7" Mar 16 17:13:11 crc kubenswrapper[5120]: I0316 17:13:11.859402 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/78897b1d-0d3f-4635-807d-3013a628ddfc-credential-keys\") pod \"keystone-bootstrap-lt5c7\" (UID: \"78897b1d-0d3f-4635-807d-3013a628ddfc\") " pod="openstack-kuttl-tests/keystone-bootstrap-lt5c7" Mar 16 17:13:11 crc kubenswrapper[5120]: I0316 17:13:11.860482 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:13:11 crc kubenswrapper[5120]: I0316 17:13:11.862041 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/78897b1d-0d3f-4635-807d-3013a628ddfc-combined-ca-bundle\") pod \"keystone-bootstrap-lt5c7\" (UID: \"78897b1d-0d3f-4635-807d-3013a628ddfc\") " pod="openstack-kuttl-tests/keystone-bootstrap-lt5c7" Mar 16 17:13:11 crc kubenswrapper[5120]: I0316 17:13:11.868654 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:13:11 crc kubenswrapper[5120]: I0316 17:13:11.873366 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/78897b1d-0d3f-4635-807d-3013a628ddfc-scripts\") pod \"keystone-bootstrap-lt5c7\" (UID: \"78897b1d-0d3f-4635-807d-3013a628ddfc\") " pod="openstack-kuttl-tests/keystone-bootstrap-lt5c7" Mar 16 17:13:11 crc kubenswrapper[5120]: I0316 17:13:11.873706 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 17:13:11 crc kubenswrapper[5120]: I0316 17:13:11.874085 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 17:13:11 crc kubenswrapper[5120]: I0316 17:13:11.887567 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqx2x\" (UniqueName: \"kubernetes.io/projected/78897b1d-0d3f-4635-807d-3013a628ddfc-kube-api-access-xqx2x\") pod \"keystone-bootstrap-lt5c7\" (UID: \"78897b1d-0d3f-4635-807d-3013a628ddfc\") " pod="openstack-kuttl-tests/keystone-bootstrap-lt5c7" Mar 16 17:13:11 crc kubenswrapper[5120]: I0316 17:13:11.910391 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-db-sync-p5rds"] Mar 16 17:13:11 crc kubenswrapper[5120]: I0316 17:13:11.931048 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-p5rds" Mar 16 17:13:11 crc kubenswrapper[5120]: I0316 17:13:11.933459 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-config-data\"" Mar 16 17:13:11 crc kubenswrapper[5120]: I0316 17:13:11.934829 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-scripts\"" Mar 16 17:13:11 crc kubenswrapper[5120]: I0316 17:13:11.935546 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-placement-dockercfg-5fj28\"" Mar 16 17:13:11 crc kubenswrapper[5120]: I0316 17:13:11.943173 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-lt5c7" Mar 16 17:13:11 crc kubenswrapper[5120]: I0316 17:13:11.956058 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-p5rds"] Mar 16 17:13:12 crc kubenswrapper[5120]: I0316 17:13:12.005847 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-cdsvl"] Mar 16 17:13:12 crc kubenswrapper[5120]: I0316 17:13:12.021778 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-cdsvl" Mar 16 17:13:12 crc kubenswrapper[5120]: I0316 17:13:12.023132 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-cdsvl"] Mar 16 17:13:12 crc kubenswrapper[5120]: I0316 17:13:12.023724 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-barbican-dockercfg-mf25w\"" Mar 16 17:13:12 crc kubenswrapper[5120]: I0316 17:13:12.026634 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-config-data\"" Mar 16 17:13:12 crc kubenswrapper[5120]: I0316 17:13:12.029995 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4c3e034d-e36c-4df9-b612-9bc3c8322880-combined-ca-bundle\") pod \"placement-db-sync-p5rds\" (UID: \"4c3e034d-e36c-4df9-b612-9bc3c8322880\") " pod="openstack-kuttl-tests/placement-db-sync-p5rds" Mar 16 17:13:12 crc kubenswrapper[5120]: I0316 17:13:12.030399 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/d9d46705-f61e-4b8b-be7f-15ca7141d198-log-httpd\") pod \"ceilometer-0\" (UID: \"d9d46705-f61e-4b8b-be7f-15ca7141d198\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:13:12 crc kubenswrapper[5120]: I0316 17:13:12.030489 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4c3e034d-e36c-4df9-b612-9bc3c8322880-scripts\") pod \"placement-db-sync-p5rds\" (UID: \"4c3e034d-e36c-4df9-b612-9bc3c8322880\") " pod="openstack-kuttl-tests/placement-db-sync-p5rds" Mar 16 17:13:12 crc kubenswrapper[5120]: I0316 17:13:12.030603 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/d9d46705-f61e-4b8b-be7f-15ca7141d198-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"d9d46705-f61e-4b8b-be7f-15ca7141d198\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:13:12 crc kubenswrapper[5120]: I0316 17:13:12.030700 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d9d46705-f61e-4b8b-be7f-15ca7141d198-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"d9d46705-f61e-4b8b-be7f-15ca7141d198\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:13:12 crc kubenswrapper[5120]: I0316 17:13:12.030776 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tq5vm\" (UniqueName: \"kubernetes.io/projected/d9d46705-f61e-4b8b-be7f-15ca7141d198-kube-api-access-tq5vm\") pod \"ceilometer-0\" (UID: \"d9d46705-f61e-4b8b-be7f-15ca7141d198\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:13:12 crc kubenswrapper[5120]: I0316 17:13:12.030897 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4c3e034d-e36c-4df9-b612-9bc3c8322880-logs\") pod \"placement-db-sync-p5rds\" (UID: \"4c3e034d-e36c-4df9-b612-9bc3c8322880\") " pod="openstack-kuttl-tests/placement-db-sync-p5rds" Mar 16 17:13:12 crc kubenswrapper[5120]: I0316 17:13:12.030973 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/d9d46705-f61e-4b8b-be7f-15ca7141d198-run-httpd\") pod \"ceilometer-0\" (UID: \"d9d46705-f61e-4b8b-be7f-15ca7141d198\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:13:12 crc kubenswrapper[5120]: I0316 17:13:12.031178 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d9d46705-f61e-4b8b-be7f-15ca7141d198-config-data\") pod \"ceilometer-0\" (UID: \"d9d46705-f61e-4b8b-be7f-15ca7141d198\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:13:12 crc kubenswrapper[5120]: I0316 17:13:12.031333 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4c3e034d-e36c-4df9-b612-9bc3c8322880-config-data\") pod \"placement-db-sync-p5rds\" (UID: \"4c3e034d-e36c-4df9-b612-9bc3c8322880\") " pod="openstack-kuttl-tests/placement-db-sync-p5rds" Mar 16 17:13:12 crc kubenswrapper[5120]: I0316 17:13:12.031356 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bm9wp\" (UniqueName: \"kubernetes.io/projected/4c3e034d-e36c-4df9-b612-9bc3c8322880-kube-api-access-bm9wp\") pod \"placement-db-sync-p5rds\" (UID: \"4c3e034d-e36c-4df9-b612-9bc3c8322880\") " pod="openstack-kuttl-tests/placement-db-sync-p5rds" Mar 16 17:13:12 crc kubenswrapper[5120]: I0316 17:13:12.031670 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d9d46705-f61e-4b8b-be7f-15ca7141d198-scripts\") pod \"ceilometer-0\" (UID: \"d9d46705-f61e-4b8b-be7f-15ca7141d198\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:13:12 crc kubenswrapper[5120]: I0316 17:13:12.133745 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d9d46705-f61e-4b8b-be7f-15ca7141d198-scripts\") pod \"ceilometer-0\" (UID: \"d9d46705-f61e-4b8b-be7f-15ca7141d198\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:13:12 crc kubenswrapper[5120]: I0316 17:13:12.133812 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4c3e034d-e36c-4df9-b612-9bc3c8322880-combined-ca-bundle\") pod \"placement-db-sync-p5rds\" (UID: \"4c3e034d-e36c-4df9-b612-9bc3c8322880\") " pod="openstack-kuttl-tests/placement-db-sync-p5rds" Mar 16 17:13:12 crc kubenswrapper[5120]: I0316 17:13:12.134009 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/d9d46705-f61e-4b8b-be7f-15ca7141d198-log-httpd\") pod \"ceilometer-0\" (UID: \"d9d46705-f61e-4b8b-be7f-15ca7141d198\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:13:12 crc kubenswrapper[5120]: I0316 17:13:12.134034 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4c3e034d-e36c-4df9-b612-9bc3c8322880-scripts\") pod \"placement-db-sync-p5rds\" (UID: \"4c3e034d-e36c-4df9-b612-9bc3c8322880\") " pod="openstack-kuttl-tests/placement-db-sync-p5rds" Mar 16 17:13:12 crc kubenswrapper[5120]: I0316 17:13:12.134076 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/d9d46705-f61e-4b8b-be7f-15ca7141d198-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"d9d46705-f61e-4b8b-be7f-15ca7141d198\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:13:12 crc kubenswrapper[5120]: I0316 17:13:12.134116 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d9d46705-f61e-4b8b-be7f-15ca7141d198-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"d9d46705-f61e-4b8b-be7f-15ca7141d198\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:13:12 crc kubenswrapper[5120]: I0316 17:13:12.134138 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tq5vm\" (UniqueName: \"kubernetes.io/projected/d9d46705-f61e-4b8b-be7f-15ca7141d198-kube-api-access-tq5vm\") pod \"ceilometer-0\" (UID: \"d9d46705-f61e-4b8b-be7f-15ca7141d198\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:13:12 crc kubenswrapper[5120]: I0316 17:13:12.134162 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzcjq\" (UniqueName: \"kubernetes.io/projected/40adeacf-10ac-43fe-be98-7ab309206d9e-kube-api-access-hzcjq\") pod \"barbican-db-sync-cdsvl\" (UID: \"40adeacf-10ac-43fe-be98-7ab309206d9e\") " pod="openstack-kuttl-tests/barbican-db-sync-cdsvl" Mar 16 17:13:12 crc kubenswrapper[5120]: I0316 17:13:12.134215 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4c3e034d-e36c-4df9-b612-9bc3c8322880-logs\") pod \"placement-db-sync-p5rds\" (UID: \"4c3e034d-e36c-4df9-b612-9bc3c8322880\") " pod="openstack-kuttl-tests/placement-db-sync-p5rds" Mar 16 17:13:12 crc kubenswrapper[5120]: I0316 17:13:12.134255 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/d9d46705-f61e-4b8b-be7f-15ca7141d198-run-httpd\") pod \"ceilometer-0\" (UID: \"d9d46705-f61e-4b8b-be7f-15ca7141d198\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:13:12 crc kubenswrapper[5120]: I0316 17:13:12.134283 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/40adeacf-10ac-43fe-be98-7ab309206d9e-combined-ca-bundle\") pod \"barbican-db-sync-cdsvl\" (UID: \"40adeacf-10ac-43fe-be98-7ab309206d9e\") " pod="openstack-kuttl-tests/barbican-db-sync-cdsvl" Mar 16 17:13:12 crc kubenswrapper[5120]: I0316 17:13:12.134306 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d9d46705-f61e-4b8b-be7f-15ca7141d198-config-data\") pod \"ceilometer-0\" (UID: \"d9d46705-f61e-4b8b-be7f-15ca7141d198\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:13:12 crc kubenswrapper[5120]: I0316 17:13:12.134354 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/40adeacf-10ac-43fe-be98-7ab309206d9e-db-sync-config-data\") pod \"barbican-db-sync-cdsvl\" (UID: \"40adeacf-10ac-43fe-be98-7ab309206d9e\") " pod="openstack-kuttl-tests/barbican-db-sync-cdsvl" Mar 16 17:13:12 crc kubenswrapper[5120]: I0316 17:13:12.134391 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4c3e034d-e36c-4df9-b612-9bc3c8322880-config-data\") pod \"placement-db-sync-p5rds\" (UID: \"4c3e034d-e36c-4df9-b612-9bc3c8322880\") " pod="openstack-kuttl-tests/placement-db-sync-p5rds" Mar 16 17:13:12 crc kubenswrapper[5120]: I0316 17:13:12.134412 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bm9wp\" (UniqueName: \"kubernetes.io/projected/4c3e034d-e36c-4df9-b612-9bc3c8322880-kube-api-access-bm9wp\") pod \"placement-db-sync-p5rds\" (UID: \"4c3e034d-e36c-4df9-b612-9bc3c8322880\") " pod="openstack-kuttl-tests/placement-db-sync-p5rds" Mar 16 17:13:12 crc kubenswrapper[5120]: I0316 17:13:12.134555 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/d9d46705-f61e-4b8b-be7f-15ca7141d198-log-httpd\") pod \"ceilometer-0\" (UID: \"d9d46705-f61e-4b8b-be7f-15ca7141d198\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:13:12 crc kubenswrapper[5120]: I0316 17:13:12.134908 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4c3e034d-e36c-4df9-b612-9bc3c8322880-logs\") pod \"placement-db-sync-p5rds\" (UID: \"4c3e034d-e36c-4df9-b612-9bc3c8322880\") " pod="openstack-kuttl-tests/placement-db-sync-p5rds" Mar 16 17:13:12 crc kubenswrapper[5120]: I0316 17:13:12.135464 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/d9d46705-f61e-4b8b-be7f-15ca7141d198-run-httpd\") pod \"ceilometer-0\" (UID: \"d9d46705-f61e-4b8b-be7f-15ca7141d198\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:13:12 crc kubenswrapper[5120]: I0316 17:13:12.139283 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4c3e034d-e36c-4df9-b612-9bc3c8322880-scripts\") pod \"placement-db-sync-p5rds\" (UID: \"4c3e034d-e36c-4df9-b612-9bc3c8322880\") " pod="openstack-kuttl-tests/placement-db-sync-p5rds" Mar 16 17:13:12 crc kubenswrapper[5120]: I0316 17:13:12.139789 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/d9d46705-f61e-4b8b-be7f-15ca7141d198-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"d9d46705-f61e-4b8b-be7f-15ca7141d198\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:13:12 crc kubenswrapper[5120]: I0316 17:13:12.140078 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4c3e034d-e36c-4df9-b612-9bc3c8322880-config-data\") pod \"placement-db-sync-p5rds\" (UID: \"4c3e034d-e36c-4df9-b612-9bc3c8322880\") " pod="openstack-kuttl-tests/placement-db-sync-p5rds" Mar 16 17:13:12 crc kubenswrapper[5120]: I0316 17:13:12.140881 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d9d46705-f61e-4b8b-be7f-15ca7141d198-config-data\") pod \"ceilometer-0\" (UID: \"d9d46705-f61e-4b8b-be7f-15ca7141d198\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:13:12 crc kubenswrapper[5120]: I0316 17:13:12.140947 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d9d46705-f61e-4b8b-be7f-15ca7141d198-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"d9d46705-f61e-4b8b-be7f-15ca7141d198\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:13:12 crc kubenswrapper[5120]: I0316 17:13:12.144557 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d9d46705-f61e-4b8b-be7f-15ca7141d198-scripts\") pod \"ceilometer-0\" (UID: \"d9d46705-f61e-4b8b-be7f-15ca7141d198\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:13:12 crc kubenswrapper[5120]: I0316 17:13:12.146854 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4c3e034d-e36c-4df9-b612-9bc3c8322880-combined-ca-bundle\") pod \"placement-db-sync-p5rds\" (UID: \"4c3e034d-e36c-4df9-b612-9bc3c8322880\") " pod="openstack-kuttl-tests/placement-db-sync-p5rds" Mar 16 17:13:12 crc kubenswrapper[5120]: I0316 17:13:12.152232 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bm9wp\" (UniqueName: \"kubernetes.io/projected/4c3e034d-e36c-4df9-b612-9bc3c8322880-kube-api-access-bm9wp\") pod \"placement-db-sync-p5rds\" (UID: \"4c3e034d-e36c-4df9-b612-9bc3c8322880\") " pod="openstack-kuttl-tests/placement-db-sync-p5rds" Mar 16 17:13:12 crc kubenswrapper[5120]: I0316 17:13:12.155561 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tq5vm\" (UniqueName: \"kubernetes.io/projected/d9d46705-f61e-4b8b-be7f-15ca7141d198-kube-api-access-tq5vm\") pod \"ceilometer-0\" (UID: \"d9d46705-f61e-4b8b-be7f-15ca7141d198\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:13:12 crc kubenswrapper[5120]: I0316 17:13:12.237187 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hzcjq\" (UniqueName: \"kubernetes.io/projected/40adeacf-10ac-43fe-be98-7ab309206d9e-kube-api-access-hzcjq\") pod \"barbican-db-sync-cdsvl\" (UID: \"40adeacf-10ac-43fe-be98-7ab309206d9e\") " pod="openstack-kuttl-tests/barbican-db-sync-cdsvl" Mar 16 17:13:12 crc kubenswrapper[5120]: I0316 17:13:12.237418 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/40adeacf-10ac-43fe-be98-7ab309206d9e-combined-ca-bundle\") pod \"barbican-db-sync-cdsvl\" (UID: \"40adeacf-10ac-43fe-be98-7ab309206d9e\") " pod="openstack-kuttl-tests/barbican-db-sync-cdsvl" Mar 16 17:13:12 crc kubenswrapper[5120]: I0316 17:13:12.237548 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/40adeacf-10ac-43fe-be98-7ab309206d9e-db-sync-config-data\") pod \"barbican-db-sync-cdsvl\" (UID: \"40adeacf-10ac-43fe-be98-7ab309206d9e\") " pod="openstack-kuttl-tests/barbican-db-sync-cdsvl" Mar 16 17:13:12 crc kubenswrapper[5120]: I0316 17:13:12.241822 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/40adeacf-10ac-43fe-be98-7ab309206d9e-db-sync-config-data\") pod \"barbican-db-sync-cdsvl\" (UID: \"40adeacf-10ac-43fe-be98-7ab309206d9e\") " pod="openstack-kuttl-tests/barbican-db-sync-cdsvl" Mar 16 17:13:12 crc kubenswrapper[5120]: I0316 17:13:12.243783 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/40adeacf-10ac-43fe-be98-7ab309206d9e-combined-ca-bundle\") pod \"barbican-db-sync-cdsvl\" (UID: \"40adeacf-10ac-43fe-be98-7ab309206d9e\") " pod="openstack-kuttl-tests/barbican-db-sync-cdsvl" Mar 16 17:13:12 crc kubenswrapper[5120]: I0316 17:13:12.259309 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzcjq\" (UniqueName: \"kubernetes.io/projected/40adeacf-10ac-43fe-be98-7ab309206d9e-kube-api-access-hzcjq\") pod \"barbican-db-sync-cdsvl\" (UID: \"40adeacf-10ac-43fe-be98-7ab309206d9e\") " pod="openstack-kuttl-tests/barbican-db-sync-cdsvl" Mar 16 17:13:12 crc kubenswrapper[5120]: I0316 17:13:12.356249 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:13:12 crc kubenswrapper[5120]: I0316 17:13:12.371694 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-p5rds" Mar 16 17:13:12 crc kubenswrapper[5120]: I0316 17:13:12.385884 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-cdsvl" Mar 16 17:13:12 crc kubenswrapper[5120]: I0316 17:13:12.489781 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-lt5c7"] Mar 16 17:13:12 crc kubenswrapper[5120]: W0316 17:13:12.507682 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod78897b1d_0d3f_4635_807d_3013a628ddfc.slice/crio-2ccd39d3aca3f74d74f87d92425e3615f99207eb70814c7f1d14563b6b4c2647 WatchSource:0}: Error finding container 2ccd39d3aca3f74d74f87d92425e3615f99207eb70814c7f1d14563b6b4c2647: Status 404 returned error can't find the container with id 2ccd39d3aca3f74d74f87d92425e3615f99207eb70814c7f1d14563b6b4c2647 Mar 16 17:13:12 crc kubenswrapper[5120]: I0316 17:13:12.686988 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 17:13:12 crc kubenswrapper[5120]: I0316 17:13:12.694393 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:13:12 crc kubenswrapper[5120]: I0316 17:13:12.698173 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-scripts\"" Mar 16 17:13:12 crc kubenswrapper[5120]: I0316 17:13:12.698546 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-public-svc\"" Mar 16 17:13:12 crc kubenswrapper[5120]: I0316 17:13:12.698774 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-external-config-data\"" Mar 16 17:13:12 crc kubenswrapper[5120]: I0316 17:13:12.698962 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-glance-dockercfg-qdb94\"" Mar 16 17:13:12 crc kubenswrapper[5120]: I0316 17:13:12.702811 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 17:13:12 crc kubenswrapper[5120]: W0316 17:13:12.742872 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4c3e034d_e36c_4df9_b612_9bc3c8322880.slice/crio-b26f7db4ab711e9de82e638eddb56cecfafbf4bfb18dbca3f3764ab56462b645 WatchSource:0}: Error finding container b26f7db4ab711e9de82e638eddb56cecfafbf4bfb18dbca3f3764ab56462b645: Status 404 returned error can't find the container with id b26f7db4ab711e9de82e638eddb56cecfafbf4bfb18dbca3f3764ab56462b645 Mar 16 17:13:12 crc kubenswrapper[5120]: I0316 17:13:12.760038 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-p5rds"] Mar 16 17:13:12 crc kubenswrapper[5120]: I0316 17:13:12.776581 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 17:13:12 crc kubenswrapper[5120]: I0316 17:13:12.790060 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 17:13:12 crc kubenswrapper[5120]: I0316 17:13:12.790920 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:13:12 crc kubenswrapper[5120]: I0316 17:13:12.794940 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-internal-config-data\"" Mar 16 17:13:12 crc kubenswrapper[5120]: I0316 17:13:12.795211 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-internal-svc\"" Mar 16 17:13:12 crc kubenswrapper[5120]: I0316 17:13:12.838838 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:13:12 crc kubenswrapper[5120]: I0316 17:13:12.864959 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/92df489c-b716-464e-b53e-7c16e778d2e3-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"92df489c-b716-464e-b53e-7c16e778d2e3\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:13:12 crc kubenswrapper[5120]: I0316 17:13:12.865126 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/92df489c-b716-464e-b53e-7c16e778d2e3-config-data\") pod \"glance-default-external-api-0\" (UID: \"92df489c-b716-464e-b53e-7c16e778d2e3\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:13:12 crc kubenswrapper[5120]: I0316 17:13:12.865197 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/92df489c-b716-464e-b53e-7c16e778d2e3-logs\") pod \"glance-default-external-api-0\" (UID: \"92df489c-b716-464e-b53e-7c16e778d2e3\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:13:12 crc kubenswrapper[5120]: I0316 17:13:12.865320 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/92df489c-b716-464e-b53e-7c16e778d2e3-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"92df489c-b716-464e-b53e-7c16e778d2e3\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:13:12 crc kubenswrapper[5120]: I0316 17:13:12.865349 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"glance-default-external-api-0\" (UID: \"92df489c-b716-464e-b53e-7c16e778d2e3\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:13:12 crc kubenswrapper[5120]: I0316 17:13:12.865579 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2zm2g\" (UniqueName: \"kubernetes.io/projected/92df489c-b716-464e-b53e-7c16e778d2e3-kube-api-access-2zm2g\") pod \"glance-default-external-api-0\" (UID: \"92df489c-b716-464e-b53e-7c16e778d2e3\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:13:12 crc kubenswrapper[5120]: I0316 17:13:12.865648 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/92df489c-b716-464e-b53e-7c16e778d2e3-scripts\") pod \"glance-default-external-api-0\" (UID: \"92df489c-b716-464e-b53e-7c16e778d2e3\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:13:12 crc kubenswrapper[5120]: I0316 17:13:12.865708 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/92df489c-b716-464e-b53e-7c16e778d2e3-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"92df489c-b716-464e-b53e-7c16e778d2e3\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:13:12 crc kubenswrapper[5120]: I0316 17:13:12.967720 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/92df489c-b716-464e-b53e-7c16e778d2e3-scripts\") pod \"glance-default-external-api-0\" (UID: \"92df489c-b716-464e-b53e-7c16e778d2e3\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:13:12 crc kubenswrapper[5120]: I0316 17:13:12.968091 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/92df489c-b716-464e-b53e-7c16e778d2e3-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"92df489c-b716-464e-b53e-7c16e778d2e3\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:13:12 crc kubenswrapper[5120]: I0316 17:13:12.968214 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/87f4fd51-d665-4ec8-be75-f9cf77acdd20-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"87f4fd51-d665-4ec8-be75-f9cf77acdd20\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:13:12 crc kubenswrapper[5120]: I0316 17:13:12.968326 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/87f4fd51-d665-4ec8-be75-f9cf77acdd20-config-data\") pod \"glance-default-internal-api-0\" (UID: \"87f4fd51-d665-4ec8-be75-f9cf77acdd20\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:13:12 crc kubenswrapper[5120]: I0316 17:13:12.968389 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/92df489c-b716-464e-b53e-7c16e778d2e3-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"92df489c-b716-464e-b53e-7c16e778d2e3\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:13:12 crc kubenswrapper[5120]: I0316 17:13:12.968471 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/92df489c-b716-464e-b53e-7c16e778d2e3-config-data\") pod \"glance-default-external-api-0\" (UID: \"92df489c-b716-464e-b53e-7c16e778d2e3\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:13:12 crc kubenswrapper[5120]: I0316 17:13:12.968499 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/92df489c-b716-464e-b53e-7c16e778d2e3-logs\") pod \"glance-default-external-api-0\" (UID: \"92df489c-b716-464e-b53e-7c16e778d2e3\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:13:12 crc kubenswrapper[5120]: I0316 17:13:12.968531 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/87f4fd51-d665-4ec8-be75-f9cf77acdd20-logs\") pod \"glance-default-internal-api-0\" (UID: \"87f4fd51-d665-4ec8-be75-f9cf77acdd20\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:13:12 crc kubenswrapper[5120]: I0316 17:13:12.968560 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9lr99\" (UniqueName: \"kubernetes.io/projected/87f4fd51-d665-4ec8-be75-f9cf77acdd20-kube-api-access-9lr99\") pod \"glance-default-internal-api-0\" (UID: \"87f4fd51-d665-4ec8-be75-f9cf77acdd20\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:13:12 crc kubenswrapper[5120]: I0316 17:13:12.968636 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/92df489c-b716-464e-b53e-7c16e778d2e3-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"92df489c-b716-464e-b53e-7c16e778d2e3\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:13:12 crc kubenswrapper[5120]: I0316 17:13:12.968719 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"glance-default-external-api-0\" (UID: \"92df489c-b716-464e-b53e-7c16e778d2e3\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:13:12 crc kubenswrapper[5120]: I0316 17:13:12.968798 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/87f4fd51-d665-4ec8-be75-f9cf77acdd20-scripts\") pod \"glance-default-internal-api-0\" (UID: \"87f4fd51-d665-4ec8-be75-f9cf77acdd20\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:13:12 crc kubenswrapper[5120]: I0316 17:13:12.968853 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/87f4fd51-d665-4ec8-be75-f9cf77acdd20-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"87f4fd51-d665-4ec8-be75-f9cf77acdd20\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:13:12 crc kubenswrapper[5120]: I0316 17:13:12.970008 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/92df489c-b716-464e-b53e-7c16e778d2e3-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"92df489c-b716-464e-b53e-7c16e778d2e3\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:13:12 crc kubenswrapper[5120]: I0316 17:13:12.970596 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"glance-default-external-api-0\" (UID: \"92df489c-b716-464e-b53e-7c16e778d2e3\") device mount path \"/mnt/openstack/pv08\"" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:13:12 crc kubenswrapper[5120]: I0316 17:13:12.968905 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/87f4fd51-d665-4ec8-be75-f9cf77acdd20-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"87f4fd51-d665-4ec8-be75-f9cf77acdd20\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:13:12 crc kubenswrapper[5120]: I0316 17:13:12.972096 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"glance-default-internal-api-0\" (UID: \"87f4fd51-d665-4ec8-be75-f9cf77acdd20\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:13:12 crc kubenswrapper[5120]: I0316 17:13:12.972137 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2zm2g\" (UniqueName: \"kubernetes.io/projected/92df489c-b716-464e-b53e-7c16e778d2e3-kube-api-access-2zm2g\") pod \"glance-default-external-api-0\" (UID: \"92df489c-b716-464e-b53e-7c16e778d2e3\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:13:12 crc kubenswrapper[5120]: I0316 17:13:12.972595 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/92df489c-b716-464e-b53e-7c16e778d2e3-logs\") pod \"glance-default-external-api-0\" (UID: \"92df489c-b716-464e-b53e-7c16e778d2e3\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:13:12 crc kubenswrapper[5120]: I0316 17:13:12.976216 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/92df489c-b716-464e-b53e-7c16e778d2e3-scripts\") pod \"glance-default-external-api-0\" (UID: \"92df489c-b716-464e-b53e-7c16e778d2e3\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:13:12 crc kubenswrapper[5120]: I0316 17:13:12.976989 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/92df489c-b716-464e-b53e-7c16e778d2e3-config-data\") pod \"glance-default-external-api-0\" (UID: \"92df489c-b716-464e-b53e-7c16e778d2e3\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:13:12 crc kubenswrapper[5120]: I0316 17:13:12.980587 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/92df489c-b716-464e-b53e-7c16e778d2e3-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"92df489c-b716-464e-b53e-7c16e778d2e3\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:13:12 crc kubenswrapper[5120]: I0316 17:13:12.985441 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/92df489c-b716-464e-b53e-7c16e778d2e3-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"92df489c-b716-464e-b53e-7c16e778d2e3\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:13:12 crc kubenswrapper[5120]: I0316 17:13:12.989700 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2zm2g\" (UniqueName: \"kubernetes.io/projected/92df489c-b716-464e-b53e-7c16e778d2e3-kube-api-access-2zm2g\") pod \"glance-default-external-api-0\" (UID: \"92df489c-b716-464e-b53e-7c16e778d2e3\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:13:13 crc kubenswrapper[5120]: I0316 17:13:13.012121 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"glance-default-external-api-0\" (UID: \"92df489c-b716-464e-b53e-7c16e778d2e3\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:13:13 crc kubenswrapper[5120]: I0316 17:13:13.017468 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:13:13 crc kubenswrapper[5120]: I0316 17:13:13.025605 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-cdsvl"] Mar 16 17:13:13 crc kubenswrapper[5120]: W0316 17:13:13.033827 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod40adeacf_10ac_43fe_be98_7ab309206d9e.slice/crio-7dd9350f33d743524e2743c7bf5828c605a5859fd52980cd6b56c4bdcf0c201d WatchSource:0}: Error finding container 7dd9350f33d743524e2743c7bf5828c605a5859fd52980cd6b56c4bdcf0c201d: Status 404 returned error can't find the container with id 7dd9350f33d743524e2743c7bf5828c605a5859fd52980cd6b56c4bdcf0c201d Mar 16 17:13:13 crc kubenswrapper[5120]: I0316 17:13:13.074454 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/87f4fd51-d665-4ec8-be75-f9cf77acdd20-config-data\") pod \"glance-default-internal-api-0\" (UID: \"87f4fd51-d665-4ec8-be75-f9cf77acdd20\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:13:13 crc kubenswrapper[5120]: I0316 17:13:13.074629 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/87f4fd51-d665-4ec8-be75-f9cf77acdd20-logs\") pod \"glance-default-internal-api-0\" (UID: \"87f4fd51-d665-4ec8-be75-f9cf77acdd20\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:13:13 crc kubenswrapper[5120]: I0316 17:13:13.074675 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9lr99\" (UniqueName: \"kubernetes.io/projected/87f4fd51-d665-4ec8-be75-f9cf77acdd20-kube-api-access-9lr99\") pod \"glance-default-internal-api-0\" (UID: \"87f4fd51-d665-4ec8-be75-f9cf77acdd20\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:13:13 crc kubenswrapper[5120]: I0316 17:13:13.074850 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/87f4fd51-d665-4ec8-be75-f9cf77acdd20-scripts\") pod \"glance-default-internal-api-0\" (UID: \"87f4fd51-d665-4ec8-be75-f9cf77acdd20\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:13:13 crc kubenswrapper[5120]: I0316 17:13:13.074944 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/87f4fd51-d665-4ec8-be75-f9cf77acdd20-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"87f4fd51-d665-4ec8-be75-f9cf77acdd20\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:13:13 crc kubenswrapper[5120]: I0316 17:13:13.075016 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/87f4fd51-d665-4ec8-be75-f9cf77acdd20-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"87f4fd51-d665-4ec8-be75-f9cf77acdd20\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:13:13 crc kubenswrapper[5120]: I0316 17:13:13.075050 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"glance-default-internal-api-0\" (UID: \"87f4fd51-d665-4ec8-be75-f9cf77acdd20\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:13:13 crc kubenswrapper[5120]: I0316 17:13:13.075295 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/87f4fd51-d665-4ec8-be75-f9cf77acdd20-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"87f4fd51-d665-4ec8-be75-f9cf77acdd20\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:13:13 crc kubenswrapper[5120]: I0316 17:13:13.075611 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/87f4fd51-d665-4ec8-be75-f9cf77acdd20-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"87f4fd51-d665-4ec8-be75-f9cf77acdd20\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:13:13 crc kubenswrapper[5120]: I0316 17:13:13.075694 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/87f4fd51-d665-4ec8-be75-f9cf77acdd20-logs\") pod \"glance-default-internal-api-0\" (UID: \"87f4fd51-d665-4ec8-be75-f9cf77acdd20\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:13:13 crc kubenswrapper[5120]: I0316 17:13:13.075926 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"glance-default-internal-api-0\" (UID: \"87f4fd51-d665-4ec8-be75-f9cf77acdd20\") device mount path \"/mnt/openstack/pv01\"" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:13:13 crc kubenswrapper[5120]: I0316 17:13:13.082007 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/87f4fd51-d665-4ec8-be75-f9cf77acdd20-config-data\") pod \"glance-default-internal-api-0\" (UID: \"87f4fd51-d665-4ec8-be75-f9cf77acdd20\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:13:13 crc kubenswrapper[5120]: I0316 17:13:13.093390 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/87f4fd51-d665-4ec8-be75-f9cf77acdd20-scripts\") pod \"glance-default-internal-api-0\" (UID: \"87f4fd51-d665-4ec8-be75-f9cf77acdd20\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:13:13 crc kubenswrapper[5120]: I0316 17:13:13.098815 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/87f4fd51-d665-4ec8-be75-f9cf77acdd20-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"87f4fd51-d665-4ec8-be75-f9cf77acdd20\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:13:13 crc kubenswrapper[5120]: I0316 17:13:13.099340 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/87f4fd51-d665-4ec8-be75-f9cf77acdd20-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"87f4fd51-d665-4ec8-be75-f9cf77acdd20\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:13:13 crc kubenswrapper[5120]: I0316 17:13:13.106393 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9lr99\" (UniqueName: \"kubernetes.io/projected/87f4fd51-d665-4ec8-be75-f9cf77acdd20-kube-api-access-9lr99\") pod \"glance-default-internal-api-0\" (UID: \"87f4fd51-d665-4ec8-be75-f9cf77acdd20\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:13:13 crc kubenswrapper[5120]: I0316 17:13:13.118247 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"glance-default-internal-api-0\" (UID: \"87f4fd51-d665-4ec8-be75-f9cf77acdd20\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:13:13 crc kubenswrapper[5120]: I0316 17:13:13.421919 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:13:13 crc kubenswrapper[5120]: I0316 17:13:13.481867 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-cdsvl" event={"ID":"40adeacf-10ac-43fe-be98-7ab309206d9e","Type":"ContainerStarted","Data":"8b8d8b3ebed5d19b23cc98f96796bb80d7479f737f822df0f537a98805318f0a"} Mar 16 17:13:13 crc kubenswrapper[5120]: I0316 17:13:13.481915 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-cdsvl" event={"ID":"40adeacf-10ac-43fe-be98-7ab309206d9e","Type":"ContainerStarted","Data":"7dd9350f33d743524e2743c7bf5828c605a5859fd52980cd6b56c4bdcf0c201d"} Mar 16 17:13:13 crc kubenswrapper[5120]: I0316 17:13:13.491700 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-p5rds" event={"ID":"4c3e034d-e36c-4df9-b612-9bc3c8322880","Type":"ContainerStarted","Data":"4c238dc73669ee956af220f43150c9d8707dae698fb75a26d7edb22aea825b6b"} Mar 16 17:13:13 crc kubenswrapper[5120]: I0316 17:13:13.491989 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-p5rds" event={"ID":"4c3e034d-e36c-4df9-b612-9bc3c8322880","Type":"ContainerStarted","Data":"b26f7db4ab711e9de82e638eddb56cecfafbf4bfb18dbca3f3764ab56462b645"} Mar 16 17:13:13 crc kubenswrapper[5120]: I0316 17:13:13.496988 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-lt5c7" event={"ID":"78897b1d-0d3f-4635-807d-3013a628ddfc","Type":"ContainerStarted","Data":"6ba4c616a5de603f57ad4bf98bda9b313a8b0afd5fe20a7725ca348dc07e395a"} Mar 16 17:13:13 crc kubenswrapper[5120]: I0316 17:13:13.497037 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-lt5c7" event={"ID":"78897b1d-0d3f-4635-807d-3013a628ddfc","Type":"ContainerStarted","Data":"2ccd39d3aca3f74d74f87d92425e3615f99207eb70814c7f1d14563b6b4c2647"} Mar 16 17:13:13 crc kubenswrapper[5120]: I0316 17:13:13.508178 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"d9d46705-f61e-4b8b-be7f-15ca7141d198","Type":"ContainerStarted","Data":"3b466e187a49fbd42579982bd2a02b23ac1002fd4c80b78c90bfd7d815e0d8ea"} Mar 16 17:13:13 crc kubenswrapper[5120]: I0316 17:13:13.508444 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"d9d46705-f61e-4b8b-be7f-15ca7141d198","Type":"ContainerStarted","Data":"ca893faa191480929ad7527f540068500aa72e1be6dc51cfc2d985a422136749"} Mar 16 17:13:13 crc kubenswrapper[5120]: I0316 17:13:13.509075 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 17:13:13 crc kubenswrapper[5120]: I0316 17:13:13.511796 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-db-sync-cdsvl" podStartSLOduration=2.5117749209999998 podStartE2EDuration="2.511774921s" podCreationTimestamp="2026-03-16 17:13:11 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:13:13.505157099 +0000 UTC m=+6095.659088746" watchObservedRunningTime="2026-03-16 17:13:13.511774921 +0000 UTC m=+6095.665706578" Mar 16 17:13:13 crc kubenswrapper[5120]: I0316 17:13:13.539428 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-db-sync-p5rds" podStartSLOduration=2.539403896 podStartE2EDuration="2.539403896s" podCreationTimestamp="2026-03-16 17:13:11 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:13:13.528778156 +0000 UTC m=+6095.682709803" watchObservedRunningTime="2026-03-16 17:13:13.539403896 +0000 UTC m=+6095.693335553" Mar 16 17:13:13 crc kubenswrapper[5120]: I0316 17:13:13.553222 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-bootstrap-lt5c7" podStartSLOduration=2.553206264 podStartE2EDuration="2.553206264s" podCreationTimestamp="2026-03-16 17:13:11 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:13:13.548781593 +0000 UTC m=+6095.702713250" watchObservedRunningTime="2026-03-16 17:13:13.553206264 +0000 UTC m=+6095.707137921" Mar 16 17:13:13 crc kubenswrapper[5120]: I0316 17:13:13.934178 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 17:13:14 crc kubenswrapper[5120]: I0316 17:13:14.058521 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-59pw4"] Mar 16 17:13:14 crc kubenswrapper[5120]: I0316 17:13:14.065716 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-59pw4" Mar 16 17:13:14 crc kubenswrapper[5120]: I0316 17:13:14.072321 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-fb5jp"] Mar 16 17:13:14 crc kubenswrapper[5120]: I0316 17:13:14.095274 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-httpd-config\"" Mar 16 17:13:14 crc kubenswrapper[5120]: I0316 17:13:14.095681 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-config\"" Mar 16 17:13:14 crc kubenswrapper[5120]: I0316 17:13:14.119965 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-neutron-dockercfg-f8t2x\"" Mar 16 17:13:14 crc kubenswrapper[5120]: I0316 17:13:14.122751 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-fb5jp" Mar 16 17:13:14 crc kubenswrapper[5120]: I0316 17:13:14.129915 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-config-data\"" Mar 16 17:13:14 crc kubenswrapper[5120]: I0316 17:13:14.134014 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-cinder-dockercfg-sv6d7\"" Mar 16 17:13:14 crc kubenswrapper[5120]: I0316 17:13:14.134372 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-scripts\"" Mar 16 17:13:14 crc kubenswrapper[5120]: I0316 17:13:14.146491 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/9ead6a88-e81b-482d-b510-f5ac67e0018a-config\") pod \"neutron-db-sync-59pw4\" (UID: \"9ead6a88-e81b-482d-b510-f5ac67e0018a\") " pod="openstack-kuttl-tests/neutron-db-sync-59pw4" Mar 16 17:13:14 crc kubenswrapper[5120]: I0316 17:13:14.146614 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9ead6a88-e81b-482d-b510-f5ac67e0018a-combined-ca-bundle\") pod \"neutron-db-sync-59pw4\" (UID: \"9ead6a88-e81b-482d-b510-f5ac67e0018a\") " pod="openstack-kuttl-tests/neutron-db-sync-59pw4" Mar 16 17:13:14 crc kubenswrapper[5120]: I0316 17:13:14.146993 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vlkdt\" (UniqueName: \"kubernetes.io/projected/9ead6a88-e81b-482d-b510-f5ac67e0018a-kube-api-access-vlkdt\") pod \"neutron-db-sync-59pw4\" (UID: \"9ead6a88-e81b-482d-b510-f5ac67e0018a\") " pod="openstack-kuttl-tests/neutron-db-sync-59pw4" Mar 16 17:13:14 crc kubenswrapper[5120]: I0316 17:13:14.192619 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-59pw4"] Mar 16 17:13:14 crc kubenswrapper[5120]: I0316 17:13:14.240021 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-fb5jp"] Mar 16 17:13:14 crc kubenswrapper[5120]: I0316 17:13:14.248735 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-scp82\" (UniqueName: \"kubernetes.io/projected/dd9b9ccd-51eb-4f86-864b-e19b9f40e043-kube-api-access-scp82\") pod \"cinder-db-sync-fb5jp\" (UID: \"dd9b9ccd-51eb-4f86-864b-e19b9f40e043\") " pod="openstack-kuttl-tests/cinder-db-sync-fb5jp" Mar 16 17:13:14 crc kubenswrapper[5120]: I0316 17:13:14.249081 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vlkdt\" (UniqueName: \"kubernetes.io/projected/9ead6a88-e81b-482d-b510-f5ac67e0018a-kube-api-access-vlkdt\") pod \"neutron-db-sync-59pw4\" (UID: \"9ead6a88-e81b-482d-b510-f5ac67e0018a\") " pod="openstack-kuttl-tests/neutron-db-sync-59pw4" Mar 16 17:13:14 crc kubenswrapper[5120]: I0316 17:13:14.249200 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/dd9b9ccd-51eb-4f86-864b-e19b9f40e043-db-sync-config-data\") pod \"cinder-db-sync-fb5jp\" (UID: \"dd9b9ccd-51eb-4f86-864b-e19b9f40e043\") " pod="openstack-kuttl-tests/cinder-db-sync-fb5jp" Mar 16 17:13:14 crc kubenswrapper[5120]: I0316 17:13:14.249237 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/dd9b9ccd-51eb-4f86-864b-e19b9f40e043-etc-machine-id\") pod \"cinder-db-sync-fb5jp\" (UID: \"dd9b9ccd-51eb-4f86-864b-e19b9f40e043\") " pod="openstack-kuttl-tests/cinder-db-sync-fb5jp" Mar 16 17:13:14 crc kubenswrapper[5120]: I0316 17:13:14.249301 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/dd9b9ccd-51eb-4f86-864b-e19b9f40e043-scripts\") pod \"cinder-db-sync-fb5jp\" (UID: \"dd9b9ccd-51eb-4f86-864b-e19b9f40e043\") " pod="openstack-kuttl-tests/cinder-db-sync-fb5jp" Mar 16 17:13:14 crc kubenswrapper[5120]: I0316 17:13:14.249316 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dd9b9ccd-51eb-4f86-864b-e19b9f40e043-combined-ca-bundle\") pod \"cinder-db-sync-fb5jp\" (UID: \"dd9b9ccd-51eb-4f86-864b-e19b9f40e043\") " pod="openstack-kuttl-tests/cinder-db-sync-fb5jp" Mar 16 17:13:14 crc kubenswrapper[5120]: I0316 17:13:14.249445 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dd9b9ccd-51eb-4f86-864b-e19b9f40e043-config-data\") pod \"cinder-db-sync-fb5jp\" (UID: \"dd9b9ccd-51eb-4f86-864b-e19b9f40e043\") " pod="openstack-kuttl-tests/cinder-db-sync-fb5jp" Mar 16 17:13:14 crc kubenswrapper[5120]: I0316 17:13:14.249494 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/9ead6a88-e81b-482d-b510-f5ac67e0018a-config\") pod \"neutron-db-sync-59pw4\" (UID: \"9ead6a88-e81b-482d-b510-f5ac67e0018a\") " pod="openstack-kuttl-tests/neutron-db-sync-59pw4" Mar 16 17:13:14 crc kubenswrapper[5120]: I0316 17:13:14.249615 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9ead6a88-e81b-482d-b510-f5ac67e0018a-combined-ca-bundle\") pod \"neutron-db-sync-59pw4\" (UID: \"9ead6a88-e81b-482d-b510-f5ac67e0018a\") " pod="openstack-kuttl-tests/neutron-db-sync-59pw4" Mar 16 17:13:14 crc kubenswrapper[5120]: I0316 17:13:14.257872 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9ead6a88-e81b-482d-b510-f5ac67e0018a-combined-ca-bundle\") pod \"neutron-db-sync-59pw4\" (UID: \"9ead6a88-e81b-482d-b510-f5ac67e0018a\") " pod="openstack-kuttl-tests/neutron-db-sync-59pw4" Mar 16 17:13:14 crc kubenswrapper[5120]: I0316 17:13:14.258481 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/9ead6a88-e81b-482d-b510-f5ac67e0018a-config\") pod \"neutron-db-sync-59pw4\" (UID: \"9ead6a88-e81b-482d-b510-f5ac67e0018a\") " pod="openstack-kuttl-tests/neutron-db-sync-59pw4" Mar 16 17:13:14 crc kubenswrapper[5120]: I0316 17:13:14.280449 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vlkdt\" (UniqueName: \"kubernetes.io/projected/9ead6a88-e81b-482d-b510-f5ac67e0018a-kube-api-access-vlkdt\") pod \"neutron-db-sync-59pw4\" (UID: \"9ead6a88-e81b-482d-b510-f5ac67e0018a\") " pod="openstack-kuttl-tests/neutron-db-sync-59pw4" Mar 16 17:13:14 crc kubenswrapper[5120]: I0316 17:13:14.352591 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/dd9b9ccd-51eb-4f86-864b-e19b9f40e043-db-sync-config-data\") pod \"cinder-db-sync-fb5jp\" (UID: \"dd9b9ccd-51eb-4f86-864b-e19b9f40e043\") " pod="openstack-kuttl-tests/cinder-db-sync-fb5jp" Mar 16 17:13:14 crc kubenswrapper[5120]: I0316 17:13:14.352744 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/dd9b9ccd-51eb-4f86-864b-e19b9f40e043-etc-machine-id\") pod \"cinder-db-sync-fb5jp\" (UID: \"dd9b9ccd-51eb-4f86-864b-e19b9f40e043\") " pod="openstack-kuttl-tests/cinder-db-sync-fb5jp" Mar 16 17:13:14 crc kubenswrapper[5120]: I0316 17:13:14.352818 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/dd9b9ccd-51eb-4f86-864b-e19b9f40e043-scripts\") pod \"cinder-db-sync-fb5jp\" (UID: \"dd9b9ccd-51eb-4f86-864b-e19b9f40e043\") " pod="openstack-kuttl-tests/cinder-db-sync-fb5jp" Mar 16 17:13:14 crc kubenswrapper[5120]: I0316 17:13:14.352837 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dd9b9ccd-51eb-4f86-864b-e19b9f40e043-combined-ca-bundle\") pod \"cinder-db-sync-fb5jp\" (UID: \"dd9b9ccd-51eb-4f86-864b-e19b9f40e043\") " pod="openstack-kuttl-tests/cinder-db-sync-fb5jp" Mar 16 17:13:14 crc kubenswrapper[5120]: I0316 17:13:14.352957 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dd9b9ccd-51eb-4f86-864b-e19b9f40e043-config-data\") pod \"cinder-db-sync-fb5jp\" (UID: \"dd9b9ccd-51eb-4f86-864b-e19b9f40e043\") " pod="openstack-kuttl-tests/cinder-db-sync-fb5jp" Mar 16 17:13:14 crc kubenswrapper[5120]: I0316 17:13:14.353107 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-scp82\" (UniqueName: \"kubernetes.io/projected/dd9b9ccd-51eb-4f86-864b-e19b9f40e043-kube-api-access-scp82\") pod \"cinder-db-sync-fb5jp\" (UID: \"dd9b9ccd-51eb-4f86-864b-e19b9f40e043\") " pod="openstack-kuttl-tests/cinder-db-sync-fb5jp" Mar 16 17:13:14 crc kubenswrapper[5120]: I0316 17:13:14.353930 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/dd9b9ccd-51eb-4f86-864b-e19b9f40e043-etc-machine-id\") pod \"cinder-db-sync-fb5jp\" (UID: \"dd9b9ccd-51eb-4f86-864b-e19b9f40e043\") " pod="openstack-kuttl-tests/cinder-db-sync-fb5jp" Mar 16 17:13:14 crc kubenswrapper[5120]: I0316 17:13:14.357536 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/dd9b9ccd-51eb-4f86-864b-e19b9f40e043-db-sync-config-data\") pod \"cinder-db-sync-fb5jp\" (UID: \"dd9b9ccd-51eb-4f86-864b-e19b9f40e043\") " pod="openstack-kuttl-tests/cinder-db-sync-fb5jp" Mar 16 17:13:14 crc kubenswrapper[5120]: I0316 17:13:14.357591 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/dd9b9ccd-51eb-4f86-864b-e19b9f40e043-scripts\") pod \"cinder-db-sync-fb5jp\" (UID: \"dd9b9ccd-51eb-4f86-864b-e19b9f40e043\") " pod="openstack-kuttl-tests/cinder-db-sync-fb5jp" Mar 16 17:13:14 crc kubenswrapper[5120]: I0316 17:13:14.357941 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dd9b9ccd-51eb-4f86-864b-e19b9f40e043-combined-ca-bundle\") pod \"cinder-db-sync-fb5jp\" (UID: \"dd9b9ccd-51eb-4f86-864b-e19b9f40e043\") " pod="openstack-kuttl-tests/cinder-db-sync-fb5jp" Mar 16 17:13:14 crc kubenswrapper[5120]: I0316 17:13:14.360330 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dd9b9ccd-51eb-4f86-864b-e19b9f40e043-config-data\") pod \"cinder-db-sync-fb5jp\" (UID: \"dd9b9ccd-51eb-4f86-864b-e19b9f40e043\") " pod="openstack-kuttl-tests/cinder-db-sync-fb5jp" Mar 16 17:13:14 crc kubenswrapper[5120]: I0316 17:13:14.374012 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-scp82\" (UniqueName: \"kubernetes.io/projected/dd9b9ccd-51eb-4f86-864b-e19b9f40e043-kube-api-access-scp82\") pod \"cinder-db-sync-fb5jp\" (UID: \"dd9b9ccd-51eb-4f86-864b-e19b9f40e043\") " pod="openstack-kuttl-tests/cinder-db-sync-fb5jp" Mar 16 17:13:14 crc kubenswrapper[5120]: I0316 17:13:14.425182 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-59pw4" Mar 16 17:13:14 crc kubenswrapper[5120]: I0316 17:13:14.484132 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-fb5jp" Mar 16 17:13:14 crc kubenswrapper[5120]: I0316 17:13:14.518267 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"87f4fd51-d665-4ec8-be75-f9cf77acdd20","Type":"ContainerStarted","Data":"314825c381ba24fbcdf13b63003ce108013a4424bf850958f391618e9ce6e6d9"} Mar 16 17:13:14 crc kubenswrapper[5120]: I0316 17:13:14.524607 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"d9d46705-f61e-4b8b-be7f-15ca7141d198","Type":"ContainerStarted","Data":"fef931fff031120618c4aa05944e6fc9d4da77119d454a06cf87c1725c31dbc3"} Mar 16 17:13:14 crc kubenswrapper[5120]: I0316 17:13:14.526500 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"92df489c-b716-464e-b53e-7c16e778d2e3","Type":"ContainerStarted","Data":"deb5c38c9d9ca914c819a3d8252c184a4ad39f5fe180fa6c4cd433131b90846d"} Mar 16 17:13:14 crc kubenswrapper[5120]: I0316 17:13:14.710327 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 17:13:14 crc kubenswrapper[5120]: I0316 17:13:14.816213 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 17:13:14 crc kubenswrapper[5120]: I0316 17:13:14.953991 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:13:15 crc kubenswrapper[5120]: I0316 17:13:15.051602 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-59pw4"] Mar 16 17:13:15 crc kubenswrapper[5120]: I0316 17:13:15.208219 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-fb5jp"] Mar 16 17:13:15 crc kubenswrapper[5120]: I0316 17:13:15.553789 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"92df489c-b716-464e-b53e-7c16e778d2e3","Type":"ContainerStarted","Data":"a8c0067af964945dbd54bc6ec80e3914859e3f3c592365af658c9e30d57d5a0f"} Mar 16 17:13:15 crc kubenswrapper[5120]: I0316 17:13:15.563536 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"87f4fd51-d665-4ec8-be75-f9cf77acdd20","Type":"ContainerStarted","Data":"ccb15caa77759c42a664c5378ab0bd5d9159c0e0ec17e2b0a29f547d9707af4d"} Mar 16 17:13:15 crc kubenswrapper[5120]: I0316 17:13:15.567547 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-59pw4" event={"ID":"9ead6a88-e81b-482d-b510-f5ac67e0018a","Type":"ContainerStarted","Data":"43c8a7153b84c826a75f8426d150a3e21304ab2c4678c238ce60d8e1835763b5"} Mar 16 17:13:15 crc kubenswrapper[5120]: I0316 17:13:15.567586 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-59pw4" event={"ID":"9ead6a88-e81b-482d-b510-f5ac67e0018a","Type":"ContainerStarted","Data":"cbe46132eba895973a66a41da841567b3461d58cba9334d195d2672d887141d8"} Mar 16 17:13:15 crc kubenswrapper[5120]: I0316 17:13:15.574177 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"d9d46705-f61e-4b8b-be7f-15ca7141d198","Type":"ContainerStarted","Data":"2a67f0c90baa03df45b6238127060046b213f56e1a7af7ade7401bbefb0739bf"} Mar 16 17:13:15 crc kubenswrapper[5120]: I0316 17:13:15.595270 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-fb5jp" event={"ID":"dd9b9ccd-51eb-4f86-864b-e19b9f40e043","Type":"ContainerStarted","Data":"32204eeb43939d7de1c9cac479292d9f663fa570a37802f0d6e8a1e67665f7bd"} Mar 16 17:13:15 crc kubenswrapper[5120]: I0316 17:13:15.601523 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-db-sync-59pw4" podStartSLOduration=1.6015052440000002 podStartE2EDuration="1.601505244s" podCreationTimestamp="2026-03-16 17:13:14 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:13:15.589451074 +0000 UTC m=+6097.743382731" watchObservedRunningTime="2026-03-16 17:13:15.601505244 +0000 UTC m=+6097.755436901" Mar 16 17:13:16 crc kubenswrapper[5120]: I0316 17:13:16.634269 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"92df489c-b716-464e-b53e-7c16e778d2e3","Type":"ContainerStarted","Data":"9696fcbd86bc6de862982965f6ebb57f79a699f7e671f2be21c8805c4a9c7da8"} Mar 16 17:13:16 crc kubenswrapper[5120]: I0316 17:13:16.634585 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="92df489c-b716-464e-b53e-7c16e778d2e3" containerName="glance-log" containerID="cri-o://a8c0067af964945dbd54bc6ec80e3914859e3f3c592365af658c9e30d57d5a0f" gracePeriod=30 Mar 16 17:13:16 crc kubenswrapper[5120]: I0316 17:13:16.636014 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="92df489c-b716-464e-b53e-7c16e778d2e3" containerName="glance-httpd" containerID="cri-o://9696fcbd86bc6de862982965f6ebb57f79a699f7e671f2be21c8805c4a9c7da8" gracePeriod=30 Mar 16 17:13:16 crc kubenswrapper[5120]: I0316 17:13:16.642898 5120 generic.go:358] "Generic (PLEG): container finished" podID="4c3e034d-e36c-4df9-b612-9bc3c8322880" containerID="4c238dc73669ee956af220f43150c9d8707dae698fb75a26d7edb22aea825b6b" exitCode=0 Mar 16 17:13:16 crc kubenswrapper[5120]: I0316 17:13:16.642984 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-p5rds" event={"ID":"4c3e034d-e36c-4df9-b612-9bc3c8322880","Type":"ContainerDied","Data":"4c238dc73669ee956af220f43150c9d8707dae698fb75a26d7edb22aea825b6b"} Mar 16 17:13:16 crc kubenswrapper[5120]: I0316 17:13:16.646015 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="87f4fd51-d665-4ec8-be75-f9cf77acdd20" containerName="glance-log" containerID="cri-o://ccb15caa77759c42a664c5378ab0bd5d9159c0e0ec17e2b0a29f547d9707af4d" gracePeriod=30 Mar 16 17:13:16 crc kubenswrapper[5120]: I0316 17:13:16.646152 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="87f4fd51-d665-4ec8-be75-f9cf77acdd20" containerName="glance-httpd" containerID="cri-o://d907ee487b0ebc4109489ed1f1404e46d54b2fb599318dc5c7a5428912b04422" gracePeriod=30 Mar 16 17:13:16 crc kubenswrapper[5120]: I0316 17:13:16.646361 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"87f4fd51-d665-4ec8-be75-f9cf77acdd20","Type":"ContainerStarted","Data":"d907ee487b0ebc4109489ed1f1404e46d54b2fb599318dc5c7a5428912b04422"} Mar 16 17:13:16 crc kubenswrapper[5120]: I0316 17:13:16.660251 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-external-api-0" podStartSLOduration=5.660230399 podStartE2EDuration="5.660230399s" podCreationTimestamp="2026-03-16 17:13:11 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:13:16.659333605 +0000 UTC m=+6098.813265262" watchObservedRunningTime="2026-03-16 17:13:16.660230399 +0000 UTC m=+6098.814162066" Mar 16 17:13:16 crc kubenswrapper[5120]: I0316 17:13:16.685311 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-internal-api-0" podStartSLOduration=5.685286875 podStartE2EDuration="5.685286875s" podCreationTimestamp="2026-03-16 17:13:11 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:13:16.679409644 +0000 UTC m=+6098.833341301" watchObservedRunningTime="2026-03-16 17:13:16.685286875 +0000 UTC m=+6098.839218552" Mar 16 17:13:17 crc kubenswrapper[5120]: I0316 17:13:17.643914 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:13:17 crc kubenswrapper[5120]: I0316 17:13:17.663924 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:13:17 crc kubenswrapper[5120]: I0316 17:13:17.665268 5120 generic.go:358] "Generic (PLEG): container finished" podID="92df489c-b716-464e-b53e-7c16e778d2e3" containerID="9696fcbd86bc6de862982965f6ebb57f79a699f7e671f2be21c8805c4a9c7da8" exitCode=0 Mar 16 17:13:17 crc kubenswrapper[5120]: I0316 17:13:17.665294 5120 generic.go:358] "Generic (PLEG): container finished" podID="92df489c-b716-464e-b53e-7c16e778d2e3" containerID="a8c0067af964945dbd54bc6ec80e3914859e3f3c592365af658c9e30d57d5a0f" exitCode=143 Mar 16 17:13:17 crc kubenswrapper[5120]: I0316 17:13:17.665401 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"92df489c-b716-464e-b53e-7c16e778d2e3","Type":"ContainerDied","Data":"9696fcbd86bc6de862982965f6ebb57f79a699f7e671f2be21c8805c4a9c7da8"} Mar 16 17:13:17 crc kubenswrapper[5120]: I0316 17:13:17.665425 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"92df489c-b716-464e-b53e-7c16e778d2e3","Type":"ContainerDied","Data":"a8c0067af964945dbd54bc6ec80e3914859e3f3c592365af658c9e30d57d5a0f"} Mar 16 17:13:17 crc kubenswrapper[5120]: I0316 17:13:17.665436 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"92df489c-b716-464e-b53e-7c16e778d2e3","Type":"ContainerDied","Data":"deb5c38c9d9ca914c819a3d8252c184a4ad39f5fe180fa6c4cd433131b90846d"} Mar 16 17:13:17 crc kubenswrapper[5120]: I0316 17:13:17.665452 5120 scope.go:117] "RemoveContainer" containerID="9696fcbd86bc6de862982965f6ebb57f79a699f7e671f2be21c8805c4a9c7da8" Mar 16 17:13:17 crc kubenswrapper[5120]: I0316 17:13:17.665561 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:13:17 crc kubenswrapper[5120]: I0316 17:13:17.673898 5120 generic.go:358] "Generic (PLEG): container finished" podID="87f4fd51-d665-4ec8-be75-f9cf77acdd20" containerID="d907ee487b0ebc4109489ed1f1404e46d54b2fb599318dc5c7a5428912b04422" exitCode=0 Mar 16 17:13:17 crc kubenswrapper[5120]: I0316 17:13:17.673933 5120 generic.go:358] "Generic (PLEG): container finished" podID="87f4fd51-d665-4ec8-be75-f9cf77acdd20" containerID="ccb15caa77759c42a664c5378ab0bd5d9159c0e0ec17e2b0a29f547d9707af4d" exitCode=143 Mar 16 17:13:17 crc kubenswrapper[5120]: I0316 17:13:17.674144 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"87f4fd51-d665-4ec8-be75-f9cf77acdd20","Type":"ContainerDied","Data":"d907ee487b0ebc4109489ed1f1404e46d54b2fb599318dc5c7a5428912b04422"} Mar 16 17:13:17 crc kubenswrapper[5120]: I0316 17:13:17.674170 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"87f4fd51-d665-4ec8-be75-f9cf77acdd20","Type":"ContainerDied","Data":"ccb15caa77759c42a664c5378ab0bd5d9159c0e0ec17e2b0a29f547d9707af4d"} Mar 16 17:13:17 crc kubenswrapper[5120]: I0316 17:13:17.674180 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"87f4fd51-d665-4ec8-be75-f9cf77acdd20","Type":"ContainerDied","Data":"314825c381ba24fbcdf13b63003ce108013a4424bf850958f391618e9ce6e6d9"} Mar 16 17:13:17 crc kubenswrapper[5120]: I0316 17:13:17.674250 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:13:17 crc kubenswrapper[5120]: I0316 17:13:17.680750 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-fb5jp" event={"ID":"dd9b9ccd-51eb-4f86-864b-e19b9f40e043","Type":"ContainerStarted","Data":"75231ca2d85100c637728df7e1a3143c7285ad90c7ee8e87a5e29de664e2a0b9"} Mar 16 17:13:17 crc kubenswrapper[5120]: I0316 17:13:17.726028 5120 scope.go:117] "RemoveContainer" containerID="a8c0067af964945dbd54bc6ec80e3914859e3f3c592365af658c9e30d57d5a0f" Mar 16 17:13:17 crc kubenswrapper[5120]: I0316 17:13:17.731637 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-db-sync-fb5jp" podStartSLOduration=3.731615871 podStartE2EDuration="3.731615871s" podCreationTimestamp="2026-03-16 17:13:14 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:13:17.726316917 +0000 UTC m=+6099.880248574" watchObservedRunningTime="2026-03-16 17:13:17.731615871 +0000 UTC m=+6099.885547518" Mar 16 17:13:17 crc kubenswrapper[5120]: I0316 17:13:17.765857 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/92df489c-b716-464e-b53e-7c16e778d2e3-httpd-run\") pod \"92df489c-b716-464e-b53e-7c16e778d2e3\" (UID: \"92df489c-b716-464e-b53e-7c16e778d2e3\") " Mar 16 17:13:17 crc kubenswrapper[5120]: I0316 17:13:17.765966 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/92df489c-b716-464e-b53e-7c16e778d2e3-logs\") pod \"92df489c-b716-464e-b53e-7c16e778d2e3\" (UID: \"92df489c-b716-464e-b53e-7c16e778d2e3\") " Mar 16 17:13:17 crc kubenswrapper[5120]: I0316 17:13:17.766051 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/92df489c-b716-464e-b53e-7c16e778d2e3-public-tls-certs\") pod \"92df489c-b716-464e-b53e-7c16e778d2e3\" (UID: \"92df489c-b716-464e-b53e-7c16e778d2e3\") " Mar 16 17:13:17 crc kubenswrapper[5120]: I0316 17:13:17.766110 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9lr99\" (UniqueName: \"kubernetes.io/projected/87f4fd51-d665-4ec8-be75-f9cf77acdd20-kube-api-access-9lr99\") pod \"87f4fd51-d665-4ec8-be75-f9cf77acdd20\" (UID: \"87f4fd51-d665-4ec8-be75-f9cf77acdd20\") " Mar 16 17:13:17 crc kubenswrapper[5120]: I0316 17:13:17.766164 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/87f4fd51-d665-4ec8-be75-f9cf77acdd20-scripts\") pod \"87f4fd51-d665-4ec8-be75-f9cf77acdd20\" (UID: \"87f4fd51-d665-4ec8-be75-f9cf77acdd20\") " Mar 16 17:13:17 crc kubenswrapper[5120]: I0316 17:13:17.766201 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/87f4fd51-d665-4ec8-be75-f9cf77acdd20-httpd-run\") pod \"87f4fd51-d665-4ec8-be75-f9cf77acdd20\" (UID: \"87f4fd51-d665-4ec8-be75-f9cf77acdd20\") " Mar 16 17:13:17 crc kubenswrapper[5120]: I0316 17:13:17.766353 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/92df489c-b716-464e-b53e-7c16e778d2e3-scripts\") pod \"92df489c-b716-464e-b53e-7c16e778d2e3\" (UID: \"92df489c-b716-464e-b53e-7c16e778d2e3\") " Mar 16 17:13:17 crc kubenswrapper[5120]: I0316 17:13:17.766529 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"92df489c-b716-464e-b53e-7c16e778d2e3\" (UID: \"92df489c-b716-464e-b53e-7c16e778d2e3\") " Mar 16 17:13:17 crc kubenswrapper[5120]: I0316 17:13:17.766590 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/87f4fd51-d665-4ec8-be75-f9cf77acdd20-internal-tls-certs\") pod \"87f4fd51-d665-4ec8-be75-f9cf77acdd20\" (UID: \"87f4fd51-d665-4ec8-be75-f9cf77acdd20\") " Mar 16 17:13:17 crc kubenswrapper[5120]: I0316 17:13:17.766668 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2zm2g\" (UniqueName: \"kubernetes.io/projected/92df489c-b716-464e-b53e-7c16e778d2e3-kube-api-access-2zm2g\") pod \"92df489c-b716-464e-b53e-7c16e778d2e3\" (UID: \"92df489c-b716-464e-b53e-7c16e778d2e3\") " Mar 16 17:13:17 crc kubenswrapper[5120]: I0316 17:13:17.766701 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/87f4fd51-d665-4ec8-be75-f9cf77acdd20-config-data\") pod \"87f4fd51-d665-4ec8-be75-f9cf77acdd20\" (UID: \"87f4fd51-d665-4ec8-be75-f9cf77acdd20\") " Mar 16 17:13:17 crc kubenswrapper[5120]: I0316 17:13:17.766720 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/87f4fd51-d665-4ec8-be75-f9cf77acdd20-combined-ca-bundle\") pod \"87f4fd51-d665-4ec8-be75-f9cf77acdd20\" (UID: \"87f4fd51-d665-4ec8-be75-f9cf77acdd20\") " Mar 16 17:13:17 crc kubenswrapper[5120]: I0316 17:13:17.766745 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"87f4fd51-d665-4ec8-be75-f9cf77acdd20\" (UID: \"87f4fd51-d665-4ec8-be75-f9cf77acdd20\") " Mar 16 17:13:17 crc kubenswrapper[5120]: I0316 17:13:17.766805 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/92df489c-b716-464e-b53e-7c16e778d2e3-combined-ca-bundle\") pod \"92df489c-b716-464e-b53e-7c16e778d2e3\" (UID: \"92df489c-b716-464e-b53e-7c16e778d2e3\") " Mar 16 17:13:17 crc kubenswrapper[5120]: I0316 17:13:17.766892 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/92df489c-b716-464e-b53e-7c16e778d2e3-config-data\") pod \"92df489c-b716-464e-b53e-7c16e778d2e3\" (UID: \"92df489c-b716-464e-b53e-7c16e778d2e3\") " Mar 16 17:13:17 crc kubenswrapper[5120]: I0316 17:13:17.766919 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/87f4fd51-d665-4ec8-be75-f9cf77acdd20-logs\") pod \"87f4fd51-d665-4ec8-be75-f9cf77acdd20\" (UID: \"87f4fd51-d665-4ec8-be75-f9cf77acdd20\") " Mar 16 17:13:17 crc kubenswrapper[5120]: I0316 17:13:17.770973 5120 scope.go:117] "RemoveContainer" containerID="9696fcbd86bc6de862982965f6ebb57f79a699f7e671f2be21c8805c4a9c7da8" Mar 16 17:13:17 crc kubenswrapper[5120]: I0316 17:13:17.771561 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92df489c-b716-464e-b53e-7c16e778d2e3-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "92df489c-b716-464e-b53e-7c16e778d2e3" (UID: "92df489c-b716-464e-b53e-7c16e778d2e3"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:13:17 crc kubenswrapper[5120]: I0316 17:13:17.771709 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87f4fd51-d665-4ec8-be75-f9cf77acdd20-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "87f4fd51-d665-4ec8-be75-f9cf77acdd20" (UID: "87f4fd51-d665-4ec8-be75-f9cf77acdd20"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:13:17 crc kubenswrapper[5120]: E0316 17:13:17.772573 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9696fcbd86bc6de862982965f6ebb57f79a699f7e671f2be21c8805c4a9c7da8\": container with ID starting with 9696fcbd86bc6de862982965f6ebb57f79a699f7e671f2be21c8805c4a9c7da8 not found: ID does not exist" containerID="9696fcbd86bc6de862982965f6ebb57f79a699f7e671f2be21c8805c4a9c7da8" Mar 16 17:13:17 crc kubenswrapper[5120]: I0316 17:13:17.772619 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9696fcbd86bc6de862982965f6ebb57f79a699f7e671f2be21c8805c4a9c7da8"} err="failed to get container status \"9696fcbd86bc6de862982965f6ebb57f79a699f7e671f2be21c8805c4a9c7da8\": rpc error: code = NotFound desc = could not find container \"9696fcbd86bc6de862982965f6ebb57f79a699f7e671f2be21c8805c4a9c7da8\": container with ID starting with 9696fcbd86bc6de862982965f6ebb57f79a699f7e671f2be21c8805c4a9c7da8 not found: ID does not exist" Mar 16 17:13:17 crc kubenswrapper[5120]: I0316 17:13:17.772646 5120 scope.go:117] "RemoveContainer" containerID="a8c0067af964945dbd54bc6ec80e3914859e3f3c592365af658c9e30d57d5a0f" Mar 16 17:13:17 crc kubenswrapper[5120]: I0316 17:13:17.774266 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/87f4fd51-d665-4ec8-be75-f9cf77acdd20-scripts" (OuterVolumeSpecName: "scripts") pod "87f4fd51-d665-4ec8-be75-f9cf77acdd20" (UID: "87f4fd51-d665-4ec8-be75-f9cf77acdd20"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:13:17 crc kubenswrapper[5120]: E0316 17:13:17.774388 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a8c0067af964945dbd54bc6ec80e3914859e3f3c592365af658c9e30d57d5a0f\": container with ID starting with a8c0067af964945dbd54bc6ec80e3914859e3f3c592365af658c9e30d57d5a0f not found: ID does not exist" containerID="a8c0067af964945dbd54bc6ec80e3914859e3f3c592365af658c9e30d57d5a0f" Mar 16 17:13:17 crc kubenswrapper[5120]: I0316 17:13:17.774415 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8c0067af964945dbd54bc6ec80e3914859e3f3c592365af658c9e30d57d5a0f"} err="failed to get container status \"a8c0067af964945dbd54bc6ec80e3914859e3f3c592365af658c9e30d57d5a0f\": rpc error: code = NotFound desc = could not find container \"a8c0067af964945dbd54bc6ec80e3914859e3f3c592365af658c9e30d57d5a0f\": container with ID starting with a8c0067af964945dbd54bc6ec80e3914859e3f3c592365af658c9e30d57d5a0f not found: ID does not exist" Mar 16 17:13:17 crc kubenswrapper[5120]: I0316 17:13:17.774433 5120 scope.go:117] "RemoveContainer" containerID="9696fcbd86bc6de862982965f6ebb57f79a699f7e671f2be21c8805c4a9c7da8" Mar 16 17:13:17 crc kubenswrapper[5120]: I0316 17:13:17.775380 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87f4fd51-d665-4ec8-be75-f9cf77acdd20-logs" (OuterVolumeSpecName: "logs") pod "87f4fd51-d665-4ec8-be75-f9cf77acdd20" (UID: "87f4fd51-d665-4ec8-be75-f9cf77acdd20"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:13:17 crc kubenswrapper[5120]: I0316 17:13:17.782278 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9696fcbd86bc6de862982965f6ebb57f79a699f7e671f2be21c8805c4a9c7da8"} err="failed to get container status \"9696fcbd86bc6de862982965f6ebb57f79a699f7e671f2be21c8805c4a9c7da8\": rpc error: code = NotFound desc = could not find container \"9696fcbd86bc6de862982965f6ebb57f79a699f7e671f2be21c8805c4a9c7da8\": container with ID starting with 9696fcbd86bc6de862982965f6ebb57f79a699f7e671f2be21c8805c4a9c7da8 not found: ID does not exist" Mar 16 17:13:17 crc kubenswrapper[5120]: I0316 17:13:17.782337 5120 scope.go:117] "RemoveContainer" containerID="a8c0067af964945dbd54bc6ec80e3914859e3f3c592365af658c9e30d57d5a0f" Mar 16 17:13:17 crc kubenswrapper[5120]: I0316 17:13:17.785913 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8c0067af964945dbd54bc6ec80e3914859e3f3c592365af658c9e30d57d5a0f"} err="failed to get container status \"a8c0067af964945dbd54bc6ec80e3914859e3f3c592365af658c9e30d57d5a0f\": rpc error: code = NotFound desc = could not find container \"a8c0067af964945dbd54bc6ec80e3914859e3f3c592365af658c9e30d57d5a0f\": container with ID starting with a8c0067af964945dbd54bc6ec80e3914859e3f3c592365af658c9e30d57d5a0f not found: ID does not exist" Mar 16 17:13:17 crc kubenswrapper[5120]: I0316 17:13:17.785964 5120 scope.go:117] "RemoveContainer" containerID="d907ee487b0ebc4109489ed1f1404e46d54b2fb599318dc5c7a5428912b04422" Mar 16 17:13:17 crc kubenswrapper[5120]: I0316 17:13:17.795632 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92df489c-b716-464e-b53e-7c16e778d2e3-logs" (OuterVolumeSpecName: "logs") pod "92df489c-b716-464e-b53e-7c16e778d2e3" (UID: "92df489c-b716-464e-b53e-7c16e778d2e3"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:13:17 crc kubenswrapper[5120]: I0316 17:13:17.797320 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage08-crc" (OuterVolumeSpecName: "glance") pod "92df489c-b716-464e-b53e-7c16e778d2e3" (UID: "92df489c-b716-464e-b53e-7c16e778d2e3"). InnerVolumeSpecName "local-storage08-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 17:13:17 crc kubenswrapper[5120]: I0316 17:13:17.808022 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87f4fd51-d665-4ec8-be75-f9cf77acdd20-kube-api-access-9lr99" (OuterVolumeSpecName: "kube-api-access-9lr99") pod "87f4fd51-d665-4ec8-be75-f9cf77acdd20" (UID: "87f4fd51-d665-4ec8-be75-f9cf77acdd20"). InnerVolumeSpecName "kube-api-access-9lr99". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:13:17 crc kubenswrapper[5120]: I0316 17:13:17.810341 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage01-crc" (OuterVolumeSpecName: "glance") pod "87f4fd51-d665-4ec8-be75-f9cf77acdd20" (UID: "87f4fd51-d665-4ec8-be75-f9cf77acdd20"). InnerVolumeSpecName "local-storage01-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 17:13:17 crc kubenswrapper[5120]: I0316 17:13:17.814864 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92df489c-b716-464e-b53e-7c16e778d2e3-kube-api-access-2zm2g" (OuterVolumeSpecName: "kube-api-access-2zm2g") pod "92df489c-b716-464e-b53e-7c16e778d2e3" (UID: "92df489c-b716-464e-b53e-7c16e778d2e3"). InnerVolumeSpecName "kube-api-access-2zm2g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:13:17 crc kubenswrapper[5120]: I0316 17:13:17.816376 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92df489c-b716-464e-b53e-7c16e778d2e3-scripts" (OuterVolumeSpecName: "scripts") pod "92df489c-b716-464e-b53e-7c16e778d2e3" (UID: "92df489c-b716-464e-b53e-7c16e778d2e3"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:13:17 crc kubenswrapper[5120]: I0316 17:13:17.827040 5120 scope.go:117] "RemoveContainer" containerID="ccb15caa77759c42a664c5378ab0bd5d9159c0e0ec17e2b0a29f547d9707af4d" Mar 16 17:13:17 crc kubenswrapper[5120]: I0316 17:13:17.855157 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/87f4fd51-d665-4ec8-be75-f9cf77acdd20-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "87f4fd51-d665-4ec8-be75-f9cf77acdd20" (UID: "87f4fd51-d665-4ec8-be75-f9cf77acdd20"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:13:17 crc kubenswrapper[5120]: I0316 17:13:17.858109 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92df489c-b716-464e-b53e-7c16e778d2e3-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "92df489c-b716-464e-b53e-7c16e778d2e3" (UID: "92df489c-b716-464e-b53e-7c16e778d2e3"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:13:17 crc kubenswrapper[5120]: I0316 17:13:17.883834 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/92df489c-b716-464e-b53e-7c16e778d2e3-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 17:13:17 crc kubenswrapper[5120]: I0316 17:13:17.883878 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/92df489c-b716-464e-b53e-7c16e778d2e3-logs\") on node \"crc\" DevicePath \"\"" Mar 16 17:13:17 crc kubenswrapper[5120]: I0316 17:13:17.883890 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9lr99\" (UniqueName: \"kubernetes.io/projected/87f4fd51-d665-4ec8-be75-f9cf77acdd20-kube-api-access-9lr99\") on node \"crc\" DevicePath \"\"" Mar 16 17:13:17 crc kubenswrapper[5120]: I0316 17:13:17.883902 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/87f4fd51-d665-4ec8-be75-f9cf77acdd20-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:13:17 crc kubenswrapper[5120]: I0316 17:13:17.883911 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/87f4fd51-d665-4ec8-be75-f9cf77acdd20-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 17:13:17 crc kubenswrapper[5120]: I0316 17:13:17.883920 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/92df489c-b716-464e-b53e-7c16e778d2e3-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:13:17 crc kubenswrapper[5120]: I0316 17:13:17.883954 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") on node \"crc\" " Mar 16 17:13:17 crc kubenswrapper[5120]: I0316 17:13:17.883964 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2zm2g\" (UniqueName: \"kubernetes.io/projected/92df489c-b716-464e-b53e-7c16e778d2e3-kube-api-access-2zm2g\") on node \"crc\" DevicePath \"\"" Mar 16 17:13:17 crc kubenswrapper[5120]: I0316 17:13:17.883973 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/87f4fd51-d665-4ec8-be75-f9cf77acdd20-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:13:17 crc kubenswrapper[5120]: I0316 17:13:17.883987 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") on node \"crc\" " Mar 16 17:13:17 crc kubenswrapper[5120]: I0316 17:13:17.883997 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/92df489c-b716-464e-b53e-7c16e778d2e3-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:13:17 crc kubenswrapper[5120]: I0316 17:13:17.884006 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/87f4fd51-d665-4ec8-be75-f9cf77acdd20-logs\") on node \"crc\" DevicePath \"\"" Mar 16 17:13:17 crc kubenswrapper[5120]: I0316 17:13:17.901577 5120 scope.go:117] "RemoveContainer" containerID="d907ee487b0ebc4109489ed1f1404e46d54b2fb599318dc5c7a5428912b04422" Mar 16 17:13:17 crc kubenswrapper[5120]: I0316 17:13:17.902900 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92df489c-b716-464e-b53e-7c16e778d2e3-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "92df489c-b716-464e-b53e-7c16e778d2e3" (UID: "92df489c-b716-464e-b53e-7c16e778d2e3"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:13:17 crc kubenswrapper[5120]: E0316 17:13:17.903787 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d907ee487b0ebc4109489ed1f1404e46d54b2fb599318dc5c7a5428912b04422\": container with ID starting with d907ee487b0ebc4109489ed1f1404e46d54b2fb599318dc5c7a5428912b04422 not found: ID does not exist" containerID="d907ee487b0ebc4109489ed1f1404e46d54b2fb599318dc5c7a5428912b04422" Mar 16 17:13:17 crc kubenswrapper[5120]: I0316 17:13:17.903889 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d907ee487b0ebc4109489ed1f1404e46d54b2fb599318dc5c7a5428912b04422"} err="failed to get container status \"d907ee487b0ebc4109489ed1f1404e46d54b2fb599318dc5c7a5428912b04422\": rpc error: code = NotFound desc = could not find container \"d907ee487b0ebc4109489ed1f1404e46d54b2fb599318dc5c7a5428912b04422\": container with ID starting with d907ee487b0ebc4109489ed1f1404e46d54b2fb599318dc5c7a5428912b04422 not found: ID does not exist" Mar 16 17:13:17 crc kubenswrapper[5120]: I0316 17:13:17.903992 5120 scope.go:117] "RemoveContainer" containerID="ccb15caa77759c42a664c5378ab0bd5d9159c0e0ec17e2b0a29f547d9707af4d" Mar 16 17:13:17 crc kubenswrapper[5120]: E0316 17:13:17.904937 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ccb15caa77759c42a664c5378ab0bd5d9159c0e0ec17e2b0a29f547d9707af4d\": container with ID starting with ccb15caa77759c42a664c5378ab0bd5d9159c0e0ec17e2b0a29f547d9707af4d not found: ID does not exist" containerID="ccb15caa77759c42a664c5378ab0bd5d9159c0e0ec17e2b0a29f547d9707af4d" Mar 16 17:13:17 crc kubenswrapper[5120]: I0316 17:13:17.904993 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ccb15caa77759c42a664c5378ab0bd5d9159c0e0ec17e2b0a29f547d9707af4d"} err="failed to get container status \"ccb15caa77759c42a664c5378ab0bd5d9159c0e0ec17e2b0a29f547d9707af4d\": rpc error: code = NotFound desc = could not find container \"ccb15caa77759c42a664c5378ab0bd5d9159c0e0ec17e2b0a29f547d9707af4d\": container with ID starting with ccb15caa77759c42a664c5378ab0bd5d9159c0e0ec17e2b0a29f547d9707af4d not found: ID does not exist" Mar 16 17:13:17 crc kubenswrapper[5120]: I0316 17:13:17.905020 5120 scope.go:117] "RemoveContainer" containerID="d907ee487b0ebc4109489ed1f1404e46d54b2fb599318dc5c7a5428912b04422" Mar 16 17:13:17 crc kubenswrapper[5120]: I0316 17:13:17.906874 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d907ee487b0ebc4109489ed1f1404e46d54b2fb599318dc5c7a5428912b04422"} err="failed to get container status \"d907ee487b0ebc4109489ed1f1404e46d54b2fb599318dc5c7a5428912b04422\": rpc error: code = NotFound desc = could not find container \"d907ee487b0ebc4109489ed1f1404e46d54b2fb599318dc5c7a5428912b04422\": container with ID starting with d907ee487b0ebc4109489ed1f1404e46d54b2fb599318dc5c7a5428912b04422 not found: ID does not exist" Mar 16 17:13:17 crc kubenswrapper[5120]: I0316 17:13:17.906901 5120 scope.go:117] "RemoveContainer" containerID="ccb15caa77759c42a664c5378ab0bd5d9159c0e0ec17e2b0a29f547d9707af4d" Mar 16 17:13:17 crc kubenswrapper[5120]: I0316 17:13:17.911931 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ccb15caa77759c42a664c5378ab0bd5d9159c0e0ec17e2b0a29f547d9707af4d"} err="failed to get container status \"ccb15caa77759c42a664c5378ab0bd5d9159c0e0ec17e2b0a29f547d9707af4d\": rpc error: code = NotFound desc = could not find container \"ccb15caa77759c42a664c5378ab0bd5d9159c0e0ec17e2b0a29f547d9707af4d\": container with ID starting with ccb15caa77759c42a664c5378ab0bd5d9159c0e0ec17e2b0a29f547d9707af4d not found: ID does not exist" Mar 16 17:13:17 crc kubenswrapper[5120]: I0316 17:13:17.986879 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/92df489c-b716-464e-b53e-7c16e778d2e3-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.057689 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage01-crc" (UniqueName: "kubernetes.io/local-volume/local-storage01-crc") on node "crc" Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.081783 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/87f4fd51-d665-4ec8-be75-f9cf77acdd20-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "87f4fd51-d665-4ec8-be75-f9cf77acdd20" (UID: "87f4fd51-d665-4ec8-be75-f9cf77acdd20"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.096030 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/87f4fd51-d665-4ec8-be75-f9cf77acdd20-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.096067 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") on node \"crc\" DevicePath \"\"" Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.108821 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/87f4fd51-d665-4ec8-be75-f9cf77acdd20-config-data" (OuterVolumeSpecName: "config-data") pod "87f4fd51-d665-4ec8-be75-f9cf77acdd20" (UID: "87f4fd51-d665-4ec8-be75-f9cf77acdd20"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.124132 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage08-crc" (UniqueName: "kubernetes.io/local-volume/local-storage08-crc") on node "crc" Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.131978 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92df489c-b716-464e-b53e-7c16e778d2e3-config-data" (OuterVolumeSpecName: "config-data") pod "92df489c-b716-464e-b53e-7c16e778d2e3" (UID: "92df489c-b716-464e-b53e-7c16e778d2e3"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.198612 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") on node \"crc\" DevicePath \"\"" Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.198651 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/87f4fd51-d665-4ec8-be75-f9cf77acdd20-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.198663 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/92df489c-b716-464e-b53e-7c16e778d2e3-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.232859 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-p5rds" Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.323728 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.333537 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.349490 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.360416 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.370868 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.371897 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92df489c-b716-464e-b53e-7c16e778d2e3" containerName="glance-log" Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.371922 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="92df489c-b716-464e-b53e-7c16e778d2e3" containerName="glance-log" Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.371948 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87f4fd51-d665-4ec8-be75-f9cf77acdd20" containerName="glance-httpd" Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.371957 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="87f4fd51-d665-4ec8-be75-f9cf77acdd20" containerName="glance-httpd" Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.371982 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c3e034d-e36c-4df9-b612-9bc3c8322880" containerName="placement-db-sync" Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.371990 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c3e034d-e36c-4df9-b612-9bc3c8322880" containerName="placement-db-sync" Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.372018 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87f4fd51-d665-4ec8-be75-f9cf77acdd20" containerName="glance-log" Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.372024 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="87f4fd51-d665-4ec8-be75-f9cf77acdd20" containerName="glance-log" Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.372043 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92df489c-b716-464e-b53e-7c16e778d2e3" containerName="glance-httpd" Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.372050 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="92df489c-b716-464e-b53e-7c16e778d2e3" containerName="glance-httpd" Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.372238 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="87f4fd51-d665-4ec8-be75-f9cf77acdd20" containerName="glance-httpd" Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.372254 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="92df489c-b716-464e-b53e-7c16e778d2e3" containerName="glance-httpd" Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.372267 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="92df489c-b716-464e-b53e-7c16e778d2e3" containerName="glance-log" Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.372287 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="4c3e034d-e36c-4df9-b612-9bc3c8322880" containerName="placement-db-sync" Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.372301 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="87f4fd51-d665-4ec8-be75-f9cf77acdd20" containerName="glance-log" Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.381884 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.382005 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.394178 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.403149 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-public-svc\"" Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.404021 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-scripts\"" Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.406876 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bm9wp\" (UniqueName: \"kubernetes.io/projected/4c3e034d-e36c-4df9-b612-9bc3c8322880-kube-api-access-bm9wp\") pod \"4c3e034d-e36c-4df9-b612-9bc3c8322880\" (UID: \"4c3e034d-e36c-4df9-b612-9bc3c8322880\") " Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.406960 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4c3e034d-e36c-4df9-b612-9bc3c8322880-logs\") pod \"4c3e034d-e36c-4df9-b612-9bc3c8322880\" (UID: \"4c3e034d-e36c-4df9-b612-9bc3c8322880\") " Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.406988 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4c3e034d-e36c-4df9-b612-9bc3c8322880-config-data\") pod \"4c3e034d-e36c-4df9-b612-9bc3c8322880\" (UID: \"4c3e034d-e36c-4df9-b612-9bc3c8322880\") " Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.407334 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4c3e034d-e36c-4df9-b612-9bc3c8322880-scripts\") pod \"4c3e034d-e36c-4df9-b612-9bc3c8322880\" (UID: \"4c3e034d-e36c-4df9-b612-9bc3c8322880\") " Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.407515 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4c3e034d-e36c-4df9-b612-9bc3c8322880-combined-ca-bundle\") pod \"4c3e034d-e36c-4df9-b612-9bc3c8322880\" (UID: \"4c3e034d-e36c-4df9-b612-9bc3c8322880\") " Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.411184 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c3e034d-e36c-4df9-b612-9bc3c8322880-logs" (OuterVolumeSpecName: "logs") pod "4c3e034d-e36c-4df9-b612-9bc3c8322880" (UID: "4c3e034d-e36c-4df9-b612-9bc3c8322880"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.414431 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.414556 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.417066 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-glance-dockercfg-qdb94\"" Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.417412 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-external-config-data\"" Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.421636 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-internal-svc\"" Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.430155 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c3e034d-e36c-4df9-b612-9bc3c8322880-kube-api-access-bm9wp" (OuterVolumeSpecName: "kube-api-access-bm9wp") pod "4c3e034d-e36c-4df9-b612-9bc3c8322880" (UID: "4c3e034d-e36c-4df9-b612-9bc3c8322880"). InnerVolumeSpecName "kube-api-access-bm9wp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.436231 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-internal-config-data\"" Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.457936 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c3e034d-e36c-4df9-b612-9bc3c8322880-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "4c3e034d-e36c-4df9-b612-9bc3c8322880" (UID: "4c3e034d-e36c-4df9-b612-9bc3c8322880"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.458908 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c3e034d-e36c-4df9-b612-9bc3c8322880-scripts" (OuterVolumeSpecName: "scripts") pod "4c3e034d-e36c-4df9-b612-9bc3c8322880" (UID: "4c3e034d-e36c-4df9-b612-9bc3c8322880"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.470023 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c3e034d-e36c-4df9-b612-9bc3c8322880-config-data" (OuterVolumeSpecName: "config-data") pod "4c3e034d-e36c-4df9-b612-9bc3c8322880" (UID: "4c3e034d-e36c-4df9-b612-9bc3c8322880"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.510172 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bbfbf4e9-d150-4503-a4c0-8b14a69df4df-config-data\") pod \"glance-default-internal-api-0\" (UID: \"bbfbf4e9-d150-4503-a4c0-8b14a69df4df\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.510284 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7ba88a08-571b-4c0c-ac5f-83f603d3ad93-config-data\") pod \"glance-default-external-api-0\" (UID: \"7ba88a08-571b-4c0c-ac5f-83f603d3ad93\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.510348 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7ba88a08-571b-4c0c-ac5f-83f603d3ad93-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"7ba88a08-571b-4c0c-ac5f-83f603d3ad93\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.510459 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/7ba88a08-571b-4c0c-ac5f-83f603d3ad93-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"7ba88a08-571b-4c0c-ac5f-83f603d3ad93\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.510501 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7ba88a08-571b-4c0c-ac5f-83f603d3ad93-logs\") pod \"glance-default-external-api-0\" (UID: \"7ba88a08-571b-4c0c-ac5f-83f603d3ad93\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.510538 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/bbfbf4e9-d150-4503-a4c0-8b14a69df4df-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"bbfbf4e9-d150-4503-a4c0-8b14a69df4df\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.510562 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7ba88a08-571b-4c0c-ac5f-83f603d3ad93-scripts\") pod \"glance-default-external-api-0\" (UID: \"7ba88a08-571b-4c0c-ac5f-83f603d3ad93\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.510590 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjjw4\" (UniqueName: \"kubernetes.io/projected/7ba88a08-571b-4c0c-ac5f-83f603d3ad93-kube-api-access-gjjw4\") pod \"glance-default-external-api-0\" (UID: \"7ba88a08-571b-4c0c-ac5f-83f603d3ad93\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.510652 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/7ba88a08-571b-4c0c-ac5f-83f603d3ad93-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"7ba88a08-571b-4c0c-ac5f-83f603d3ad93\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.510778 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"glance-default-external-api-0\" (UID: \"7ba88a08-571b-4c0c-ac5f-83f603d3ad93\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.510968 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/bbfbf4e9-d150-4503-a4c0-8b14a69df4df-logs\") pod \"glance-default-internal-api-0\" (UID: \"bbfbf4e9-d150-4503-a4c0-8b14a69df4df\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.511049 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85jxl\" (UniqueName: \"kubernetes.io/projected/bbfbf4e9-d150-4503-a4c0-8b14a69df4df-kube-api-access-85jxl\") pod \"glance-default-internal-api-0\" (UID: \"bbfbf4e9-d150-4503-a4c0-8b14a69df4df\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.511136 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/bbfbf4e9-d150-4503-a4c0-8b14a69df4df-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"bbfbf4e9-d150-4503-a4c0-8b14a69df4df\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.511213 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/bbfbf4e9-d150-4503-a4c0-8b14a69df4df-scripts\") pod \"glance-default-internal-api-0\" (UID: \"bbfbf4e9-d150-4503-a4c0-8b14a69df4df\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.511253 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bbfbf4e9-d150-4503-a4c0-8b14a69df4df-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"bbfbf4e9-d150-4503-a4c0-8b14a69df4df\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.511287 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"glance-default-internal-api-0\" (UID: \"bbfbf4e9-d150-4503-a4c0-8b14a69df4df\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.511404 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4c3e034d-e36c-4df9-b612-9bc3c8322880-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.511422 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bm9wp\" (UniqueName: \"kubernetes.io/projected/4c3e034d-e36c-4df9-b612-9bc3c8322880-kube-api-access-bm9wp\") on node \"crc\" DevicePath \"\"" Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.511432 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4c3e034d-e36c-4df9-b612-9bc3c8322880-logs\") on node \"crc\" DevicePath \"\"" Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.511440 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4c3e034d-e36c-4df9-b612-9bc3c8322880-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.511449 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4c3e034d-e36c-4df9-b612-9bc3c8322880-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.613709 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"glance-default-external-api-0\" (UID: \"7ba88a08-571b-4c0c-ac5f-83f603d3ad93\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.613837 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/bbfbf4e9-d150-4503-a4c0-8b14a69df4df-logs\") pod \"glance-default-internal-api-0\" (UID: \"bbfbf4e9-d150-4503-a4c0-8b14a69df4df\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.613879 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-85jxl\" (UniqueName: \"kubernetes.io/projected/bbfbf4e9-d150-4503-a4c0-8b14a69df4df-kube-api-access-85jxl\") pod \"glance-default-internal-api-0\" (UID: \"bbfbf4e9-d150-4503-a4c0-8b14a69df4df\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.613924 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/bbfbf4e9-d150-4503-a4c0-8b14a69df4df-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"bbfbf4e9-d150-4503-a4c0-8b14a69df4df\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.613974 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/bbfbf4e9-d150-4503-a4c0-8b14a69df4df-scripts\") pod \"glance-default-internal-api-0\" (UID: \"bbfbf4e9-d150-4503-a4c0-8b14a69df4df\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.614013 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bbfbf4e9-d150-4503-a4c0-8b14a69df4df-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"bbfbf4e9-d150-4503-a4c0-8b14a69df4df\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.614052 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"glance-default-internal-api-0\" (UID: \"bbfbf4e9-d150-4503-a4c0-8b14a69df4df\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.614104 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bbfbf4e9-d150-4503-a4c0-8b14a69df4df-config-data\") pod \"glance-default-internal-api-0\" (UID: \"bbfbf4e9-d150-4503-a4c0-8b14a69df4df\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.614189 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7ba88a08-571b-4c0c-ac5f-83f603d3ad93-config-data\") pod \"glance-default-external-api-0\" (UID: \"7ba88a08-571b-4c0c-ac5f-83f603d3ad93\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.614253 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7ba88a08-571b-4c0c-ac5f-83f603d3ad93-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"7ba88a08-571b-4c0c-ac5f-83f603d3ad93\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.614376 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/7ba88a08-571b-4c0c-ac5f-83f603d3ad93-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"7ba88a08-571b-4c0c-ac5f-83f603d3ad93\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.614430 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7ba88a08-571b-4c0c-ac5f-83f603d3ad93-logs\") pod \"glance-default-external-api-0\" (UID: \"7ba88a08-571b-4c0c-ac5f-83f603d3ad93\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.614471 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/bbfbf4e9-d150-4503-a4c0-8b14a69df4df-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"bbfbf4e9-d150-4503-a4c0-8b14a69df4df\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.614501 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7ba88a08-571b-4c0c-ac5f-83f603d3ad93-scripts\") pod \"glance-default-external-api-0\" (UID: \"7ba88a08-571b-4c0c-ac5f-83f603d3ad93\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.614530 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gjjw4\" (UniqueName: \"kubernetes.io/projected/7ba88a08-571b-4c0c-ac5f-83f603d3ad93-kube-api-access-gjjw4\") pod \"glance-default-external-api-0\" (UID: \"7ba88a08-571b-4c0c-ac5f-83f603d3ad93\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.614599 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/7ba88a08-571b-4c0c-ac5f-83f603d3ad93-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"7ba88a08-571b-4c0c-ac5f-83f603d3ad93\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.615152 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/7ba88a08-571b-4c0c-ac5f-83f603d3ad93-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"7ba88a08-571b-4c0c-ac5f-83f603d3ad93\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.615455 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"glance-default-external-api-0\" (UID: \"7ba88a08-571b-4c0c-ac5f-83f603d3ad93\") device mount path \"/mnt/openstack/pv08\"" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.625944 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7ba88a08-571b-4c0c-ac5f-83f603d3ad93-logs\") pod \"glance-default-external-api-0\" (UID: \"7ba88a08-571b-4c0c-ac5f-83f603d3ad93\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.626017 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/bbfbf4e9-d150-4503-a4c0-8b14a69df4df-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"bbfbf4e9-d150-4503-a4c0-8b14a69df4df\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.626323 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/bbfbf4e9-d150-4503-a4c0-8b14a69df4df-logs\") pod \"glance-default-internal-api-0\" (UID: \"bbfbf4e9-d150-4503-a4c0-8b14a69df4df\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.627616 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"glance-default-internal-api-0\" (UID: \"bbfbf4e9-d150-4503-a4c0-8b14a69df4df\") device mount path \"/mnt/openstack/pv01\"" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.659595 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7ba88a08-571b-4c0c-ac5f-83f603d3ad93-scripts\") pod \"glance-default-external-api-0\" (UID: \"7ba88a08-571b-4c0c-ac5f-83f603d3ad93\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.660685 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bbfbf4e9-d150-4503-a4c0-8b14a69df4df-config-data\") pod \"glance-default-internal-api-0\" (UID: \"bbfbf4e9-d150-4503-a4c0-8b14a69df4df\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.661497 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/bbfbf4e9-d150-4503-a4c0-8b14a69df4df-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"bbfbf4e9-d150-4503-a4c0-8b14a69df4df\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.672214 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjjw4\" (UniqueName: \"kubernetes.io/projected/7ba88a08-571b-4c0c-ac5f-83f603d3ad93-kube-api-access-gjjw4\") pod \"glance-default-external-api-0\" (UID: \"7ba88a08-571b-4c0c-ac5f-83f603d3ad93\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.672694 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/7ba88a08-571b-4c0c-ac5f-83f603d3ad93-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"7ba88a08-571b-4c0c-ac5f-83f603d3ad93\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.673455 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/bbfbf4e9-d150-4503-a4c0-8b14a69df4df-scripts\") pod \"glance-default-internal-api-0\" (UID: \"bbfbf4e9-d150-4503-a4c0-8b14a69df4df\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.673581 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7ba88a08-571b-4c0c-ac5f-83f603d3ad93-config-data\") pod \"glance-default-external-api-0\" (UID: \"7ba88a08-571b-4c0c-ac5f-83f603d3ad93\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.673908 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-85jxl\" (UniqueName: \"kubernetes.io/projected/bbfbf4e9-d150-4503-a4c0-8b14a69df4df-kube-api-access-85jxl\") pod \"glance-default-internal-api-0\" (UID: \"bbfbf4e9-d150-4503-a4c0-8b14a69df4df\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.674163 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7ba88a08-571b-4c0c-ac5f-83f603d3ad93-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"7ba88a08-571b-4c0c-ac5f-83f603d3ad93\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.687640 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="87f4fd51-d665-4ec8-be75-f9cf77acdd20" path="/var/lib/kubelet/pods/87f4fd51-d665-4ec8-be75-f9cf77acdd20/volumes" Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.689119 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="92df489c-b716-464e-b53e-7c16e778d2e3" path="/var/lib/kubelet/pods/92df489c-b716-464e-b53e-7c16e778d2e3/volumes" Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.696575 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bbfbf4e9-d150-4503-a4c0-8b14a69df4df-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"bbfbf4e9-d150-4503-a4c0-8b14a69df4df\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.700578 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"glance-default-external-api-0\" (UID: \"7ba88a08-571b-4c0c-ac5f-83f603d3ad93\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.701165 5120 generic.go:358] "Generic (PLEG): container finished" podID="40adeacf-10ac-43fe-be98-7ab309206d9e" containerID="8b8d8b3ebed5d19b23cc98f96796bb80d7479f737f822df0f537a98805318f0a" exitCode=0 Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.701432 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-cdsvl" event={"ID":"40adeacf-10ac-43fe-be98-7ab309206d9e","Type":"ContainerDied","Data":"8b8d8b3ebed5d19b23cc98f96796bb80d7479f737f822df0f537a98805318f0a"} Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.710545 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-p5rds" event={"ID":"4c3e034d-e36c-4df9-b612-9bc3c8322880","Type":"ContainerDied","Data":"b26f7db4ab711e9de82e638eddb56cecfafbf4bfb18dbca3f3764ab56462b645"} Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.710598 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b26f7db4ab711e9de82e638eddb56cecfafbf4bfb18dbca3f3764ab56462b645" Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.710690 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-p5rds" Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.723022 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"glance-default-internal-api-0\" (UID: \"bbfbf4e9-d150-4503-a4c0-8b14a69df4df\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.756206 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="d9d46705-f61e-4b8b-be7f-15ca7141d198" containerName="ceilometer-central-agent" containerID="cri-o://3b466e187a49fbd42579982bd2a02b23ac1002fd4c80b78c90bfd7d815e0d8ea" gracePeriod=30 Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.756377 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="d9d46705-f61e-4b8b-be7f-15ca7141d198" containerName="proxy-httpd" containerID="cri-o://1dffa3063d4b1d5f700618803bd419782747ec225f0689fa2d5e576780e85059" gracePeriod=30 Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.756432 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="d9d46705-f61e-4b8b-be7f-15ca7141d198" containerName="sg-core" containerID="cri-o://2a67f0c90baa03df45b6238127060046b213f56e1a7af7ade7401bbefb0739bf" gracePeriod=30 Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.756483 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="d9d46705-f61e-4b8b-be7f-15ca7141d198" containerName="ceilometer-notification-agent" containerID="cri-o://fef931fff031120618c4aa05944e6fc9d4da77119d454a06cf87c1725c31dbc3" gracePeriod=30 Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.756753 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"d9d46705-f61e-4b8b-be7f-15ca7141d198","Type":"ContainerStarted","Data":"1dffa3063d4b1d5f700618803bd419782747ec225f0689fa2d5e576780e85059"} Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.756804 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.802906 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=3.033245029 podStartE2EDuration="7.802887952s" podCreationTimestamp="2026-03-16 17:13:11 +0000 UTC" firstStartedPulling="2026-03-16 17:13:12.839714964 +0000 UTC m=+6094.993646621" lastFinishedPulling="2026-03-16 17:13:17.609357897 +0000 UTC m=+6099.763289544" observedRunningTime="2026-03-16 17:13:18.797202166 +0000 UTC m=+6100.951133823" watchObservedRunningTime="2026-03-16 17:13:18.802887952 +0000 UTC m=+6100.956819609" Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.809466 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.825489 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.883792 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-659df787f4-kl54p"] Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.890588 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-659df787f4-kl54p" Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.909083 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-placement-public-svc\"" Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.909516 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-placement-internal-svc\"" Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.909747 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-config-data\"" Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.909976 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-placement-dockercfg-5fj28\"" Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.910107 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-scripts\"" Mar 16 17:13:18 crc kubenswrapper[5120]: I0316 17:13:18.922329 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-659df787f4-kl54p"] Mar 16 17:13:19 crc kubenswrapper[5120]: I0316 17:13:19.023515 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b4e419a5-c358-422b-bfa1-64fe3dac8379-scripts\") pod \"placement-659df787f4-kl54p\" (UID: \"b4e419a5-c358-422b-bfa1-64fe3dac8379\") " pod="openstack-kuttl-tests/placement-659df787f4-kl54p" Mar 16 17:13:19 crc kubenswrapper[5120]: I0316 17:13:19.023887 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/b4e419a5-c358-422b-bfa1-64fe3dac8379-public-tls-certs\") pod \"placement-659df787f4-kl54p\" (UID: \"b4e419a5-c358-422b-bfa1-64fe3dac8379\") " pod="openstack-kuttl-tests/placement-659df787f4-kl54p" Mar 16 17:13:19 crc kubenswrapper[5120]: I0316 17:13:19.023971 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b4e419a5-c358-422b-bfa1-64fe3dac8379-combined-ca-bundle\") pod \"placement-659df787f4-kl54p\" (UID: \"b4e419a5-c358-422b-bfa1-64fe3dac8379\") " pod="openstack-kuttl-tests/placement-659df787f4-kl54p" Mar 16 17:13:19 crc kubenswrapper[5120]: I0316 17:13:19.024079 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b4e419a5-c358-422b-bfa1-64fe3dac8379-config-data\") pod \"placement-659df787f4-kl54p\" (UID: \"b4e419a5-c358-422b-bfa1-64fe3dac8379\") " pod="openstack-kuttl-tests/placement-659df787f4-kl54p" Mar 16 17:13:19 crc kubenswrapper[5120]: I0316 17:13:19.024217 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b4e419a5-c358-422b-bfa1-64fe3dac8379-logs\") pod \"placement-659df787f4-kl54p\" (UID: \"b4e419a5-c358-422b-bfa1-64fe3dac8379\") " pod="openstack-kuttl-tests/placement-659df787f4-kl54p" Mar 16 17:13:19 crc kubenswrapper[5120]: I0316 17:13:19.024267 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/b4e419a5-c358-422b-bfa1-64fe3dac8379-internal-tls-certs\") pod \"placement-659df787f4-kl54p\" (UID: \"b4e419a5-c358-422b-bfa1-64fe3dac8379\") " pod="openstack-kuttl-tests/placement-659df787f4-kl54p" Mar 16 17:13:19 crc kubenswrapper[5120]: I0316 17:13:19.024304 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6h4pv\" (UniqueName: \"kubernetes.io/projected/b4e419a5-c358-422b-bfa1-64fe3dac8379-kube-api-access-6h4pv\") pod \"placement-659df787f4-kl54p\" (UID: \"b4e419a5-c358-422b-bfa1-64fe3dac8379\") " pod="openstack-kuttl-tests/placement-659df787f4-kl54p" Mar 16 17:13:19 crc kubenswrapper[5120]: I0316 17:13:19.126095 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b4e419a5-c358-422b-bfa1-64fe3dac8379-scripts\") pod \"placement-659df787f4-kl54p\" (UID: \"b4e419a5-c358-422b-bfa1-64fe3dac8379\") " pod="openstack-kuttl-tests/placement-659df787f4-kl54p" Mar 16 17:13:19 crc kubenswrapper[5120]: I0316 17:13:19.126158 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/b4e419a5-c358-422b-bfa1-64fe3dac8379-public-tls-certs\") pod \"placement-659df787f4-kl54p\" (UID: \"b4e419a5-c358-422b-bfa1-64fe3dac8379\") " pod="openstack-kuttl-tests/placement-659df787f4-kl54p" Mar 16 17:13:19 crc kubenswrapper[5120]: I0316 17:13:19.126441 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b4e419a5-c358-422b-bfa1-64fe3dac8379-combined-ca-bundle\") pod \"placement-659df787f4-kl54p\" (UID: \"b4e419a5-c358-422b-bfa1-64fe3dac8379\") " pod="openstack-kuttl-tests/placement-659df787f4-kl54p" Mar 16 17:13:19 crc kubenswrapper[5120]: I0316 17:13:19.127330 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b4e419a5-c358-422b-bfa1-64fe3dac8379-config-data\") pod \"placement-659df787f4-kl54p\" (UID: \"b4e419a5-c358-422b-bfa1-64fe3dac8379\") " pod="openstack-kuttl-tests/placement-659df787f4-kl54p" Mar 16 17:13:19 crc kubenswrapper[5120]: I0316 17:13:19.127672 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b4e419a5-c358-422b-bfa1-64fe3dac8379-logs\") pod \"placement-659df787f4-kl54p\" (UID: \"b4e419a5-c358-422b-bfa1-64fe3dac8379\") " pod="openstack-kuttl-tests/placement-659df787f4-kl54p" Mar 16 17:13:19 crc kubenswrapper[5120]: I0316 17:13:19.128614 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/b4e419a5-c358-422b-bfa1-64fe3dac8379-internal-tls-certs\") pod \"placement-659df787f4-kl54p\" (UID: \"b4e419a5-c358-422b-bfa1-64fe3dac8379\") " pod="openstack-kuttl-tests/placement-659df787f4-kl54p" Mar 16 17:13:19 crc kubenswrapper[5120]: I0316 17:13:19.128306 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b4e419a5-c358-422b-bfa1-64fe3dac8379-logs\") pod \"placement-659df787f4-kl54p\" (UID: \"b4e419a5-c358-422b-bfa1-64fe3dac8379\") " pod="openstack-kuttl-tests/placement-659df787f4-kl54p" Mar 16 17:13:19 crc kubenswrapper[5120]: I0316 17:13:19.128813 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6h4pv\" (UniqueName: \"kubernetes.io/projected/b4e419a5-c358-422b-bfa1-64fe3dac8379-kube-api-access-6h4pv\") pod \"placement-659df787f4-kl54p\" (UID: \"b4e419a5-c358-422b-bfa1-64fe3dac8379\") " pod="openstack-kuttl-tests/placement-659df787f4-kl54p" Mar 16 17:13:19 crc kubenswrapper[5120]: I0316 17:13:19.131299 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/b4e419a5-c358-422b-bfa1-64fe3dac8379-public-tls-certs\") pod \"placement-659df787f4-kl54p\" (UID: \"b4e419a5-c358-422b-bfa1-64fe3dac8379\") " pod="openstack-kuttl-tests/placement-659df787f4-kl54p" Mar 16 17:13:19 crc kubenswrapper[5120]: I0316 17:13:19.131747 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b4e419a5-c358-422b-bfa1-64fe3dac8379-scripts\") pod \"placement-659df787f4-kl54p\" (UID: \"b4e419a5-c358-422b-bfa1-64fe3dac8379\") " pod="openstack-kuttl-tests/placement-659df787f4-kl54p" Mar 16 17:13:19 crc kubenswrapper[5120]: I0316 17:13:19.132989 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b4e419a5-c358-422b-bfa1-64fe3dac8379-combined-ca-bundle\") pod \"placement-659df787f4-kl54p\" (UID: \"b4e419a5-c358-422b-bfa1-64fe3dac8379\") " pod="openstack-kuttl-tests/placement-659df787f4-kl54p" Mar 16 17:13:19 crc kubenswrapper[5120]: I0316 17:13:19.153900 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b4e419a5-c358-422b-bfa1-64fe3dac8379-config-data\") pod \"placement-659df787f4-kl54p\" (UID: \"b4e419a5-c358-422b-bfa1-64fe3dac8379\") " pod="openstack-kuttl-tests/placement-659df787f4-kl54p" Mar 16 17:13:19 crc kubenswrapper[5120]: I0316 17:13:19.157496 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6h4pv\" (UniqueName: \"kubernetes.io/projected/b4e419a5-c358-422b-bfa1-64fe3dac8379-kube-api-access-6h4pv\") pod \"placement-659df787f4-kl54p\" (UID: \"b4e419a5-c358-422b-bfa1-64fe3dac8379\") " pod="openstack-kuttl-tests/placement-659df787f4-kl54p" Mar 16 17:13:19 crc kubenswrapper[5120]: I0316 17:13:19.157603 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/b4e419a5-c358-422b-bfa1-64fe3dac8379-internal-tls-certs\") pod \"placement-659df787f4-kl54p\" (UID: \"b4e419a5-c358-422b-bfa1-64fe3dac8379\") " pod="openstack-kuttl-tests/placement-659df787f4-kl54p" Mar 16 17:13:19 crc kubenswrapper[5120]: I0316 17:13:19.212236 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-659df787f4-kl54p" Mar 16 17:13:19 crc kubenswrapper[5120]: I0316 17:13:19.368426 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 17:13:19 crc kubenswrapper[5120]: W0316 17:13:19.396203 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7ba88a08_571b_4c0c_ac5f_83f603d3ad93.slice/crio-056f1eec81fe4e00a2a68b9a58db70d2176eff20cd3a0bd5d694eb3b89e15573 WatchSource:0}: Error finding container 056f1eec81fe4e00a2a68b9a58db70d2176eff20cd3a0bd5d694eb3b89e15573: Status 404 returned error can't find the container with id 056f1eec81fe4e00a2a68b9a58db70d2176eff20cd3a0bd5d694eb3b89e15573 Mar 16 17:13:19 crc kubenswrapper[5120]: I0316 17:13:19.495699 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 17:13:19 crc kubenswrapper[5120]: I0316 17:13:19.679742 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-659df787f4-kl54p"] Mar 16 17:13:19 crc kubenswrapper[5120]: I0316 17:13:19.712373 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:13:19 crc kubenswrapper[5120]: I0316 17:13:19.746702 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/d9d46705-f61e-4b8b-be7f-15ca7141d198-run-httpd\") pod \"d9d46705-f61e-4b8b-be7f-15ca7141d198\" (UID: \"d9d46705-f61e-4b8b-be7f-15ca7141d198\") " Mar 16 17:13:19 crc kubenswrapper[5120]: I0316 17:13:19.746807 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d9d46705-f61e-4b8b-be7f-15ca7141d198-scripts\") pod \"d9d46705-f61e-4b8b-be7f-15ca7141d198\" (UID: \"d9d46705-f61e-4b8b-be7f-15ca7141d198\") " Mar 16 17:13:19 crc kubenswrapper[5120]: I0316 17:13:19.746892 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/d9d46705-f61e-4b8b-be7f-15ca7141d198-log-httpd\") pod \"d9d46705-f61e-4b8b-be7f-15ca7141d198\" (UID: \"d9d46705-f61e-4b8b-be7f-15ca7141d198\") " Mar 16 17:13:19 crc kubenswrapper[5120]: I0316 17:13:19.746932 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/d9d46705-f61e-4b8b-be7f-15ca7141d198-sg-core-conf-yaml\") pod \"d9d46705-f61e-4b8b-be7f-15ca7141d198\" (UID: \"d9d46705-f61e-4b8b-be7f-15ca7141d198\") " Mar 16 17:13:19 crc kubenswrapper[5120]: I0316 17:13:19.747260 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tq5vm\" (UniqueName: \"kubernetes.io/projected/d9d46705-f61e-4b8b-be7f-15ca7141d198-kube-api-access-tq5vm\") pod \"d9d46705-f61e-4b8b-be7f-15ca7141d198\" (UID: \"d9d46705-f61e-4b8b-be7f-15ca7141d198\") " Mar 16 17:13:19 crc kubenswrapper[5120]: I0316 17:13:19.747474 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d9d46705-f61e-4b8b-be7f-15ca7141d198-combined-ca-bundle\") pod \"d9d46705-f61e-4b8b-be7f-15ca7141d198\" (UID: \"d9d46705-f61e-4b8b-be7f-15ca7141d198\") " Mar 16 17:13:19 crc kubenswrapper[5120]: I0316 17:13:19.747614 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d9d46705-f61e-4b8b-be7f-15ca7141d198-config-data\") pod \"d9d46705-f61e-4b8b-be7f-15ca7141d198\" (UID: \"d9d46705-f61e-4b8b-be7f-15ca7141d198\") " Mar 16 17:13:19 crc kubenswrapper[5120]: I0316 17:13:19.748984 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9d46705-f61e-4b8b-be7f-15ca7141d198-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "d9d46705-f61e-4b8b-be7f-15ca7141d198" (UID: "d9d46705-f61e-4b8b-be7f-15ca7141d198"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:13:19 crc kubenswrapper[5120]: I0316 17:13:19.752491 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9d46705-f61e-4b8b-be7f-15ca7141d198-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "d9d46705-f61e-4b8b-be7f-15ca7141d198" (UID: "d9d46705-f61e-4b8b-be7f-15ca7141d198"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:13:19 crc kubenswrapper[5120]: I0316 17:13:19.752942 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9d46705-f61e-4b8b-be7f-15ca7141d198-kube-api-access-tq5vm" (OuterVolumeSpecName: "kube-api-access-tq5vm") pod "d9d46705-f61e-4b8b-be7f-15ca7141d198" (UID: "d9d46705-f61e-4b8b-be7f-15ca7141d198"). InnerVolumeSpecName "kube-api-access-tq5vm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:13:19 crc kubenswrapper[5120]: I0316 17:13:19.759897 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d9d46705-f61e-4b8b-be7f-15ca7141d198-scripts" (OuterVolumeSpecName: "scripts") pod "d9d46705-f61e-4b8b-be7f-15ca7141d198" (UID: "d9d46705-f61e-4b8b-be7f-15ca7141d198"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:13:19 crc kubenswrapper[5120]: I0316 17:13:19.790689 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d9d46705-f61e-4b8b-be7f-15ca7141d198-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "d9d46705-f61e-4b8b-be7f-15ca7141d198" (UID: "d9d46705-f61e-4b8b-be7f-15ca7141d198"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:13:19 crc kubenswrapper[5120]: I0316 17:13:19.820430 5120 generic.go:358] "Generic (PLEG): container finished" podID="d9d46705-f61e-4b8b-be7f-15ca7141d198" containerID="1dffa3063d4b1d5f700618803bd419782747ec225f0689fa2d5e576780e85059" exitCode=0 Mar 16 17:13:19 crc kubenswrapper[5120]: I0316 17:13:19.820462 5120 generic.go:358] "Generic (PLEG): container finished" podID="d9d46705-f61e-4b8b-be7f-15ca7141d198" containerID="2a67f0c90baa03df45b6238127060046b213f56e1a7af7ade7401bbefb0739bf" exitCode=2 Mar 16 17:13:19 crc kubenswrapper[5120]: I0316 17:13:19.820471 5120 generic.go:358] "Generic (PLEG): container finished" podID="d9d46705-f61e-4b8b-be7f-15ca7141d198" containerID="fef931fff031120618c4aa05944e6fc9d4da77119d454a06cf87c1725c31dbc3" exitCode=0 Mar 16 17:13:19 crc kubenswrapper[5120]: I0316 17:13:19.820478 5120 generic.go:358] "Generic (PLEG): container finished" podID="d9d46705-f61e-4b8b-be7f-15ca7141d198" containerID="3b466e187a49fbd42579982bd2a02b23ac1002fd4c80b78c90bfd7d815e0d8ea" exitCode=0 Mar 16 17:13:19 crc kubenswrapper[5120]: I0316 17:13:19.820619 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:13:19 crc kubenswrapper[5120]: I0316 17:13:19.820692 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"d9d46705-f61e-4b8b-be7f-15ca7141d198","Type":"ContainerDied","Data":"1dffa3063d4b1d5f700618803bd419782747ec225f0689fa2d5e576780e85059"} Mar 16 17:13:19 crc kubenswrapper[5120]: I0316 17:13:19.820749 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"d9d46705-f61e-4b8b-be7f-15ca7141d198","Type":"ContainerDied","Data":"2a67f0c90baa03df45b6238127060046b213f56e1a7af7ade7401bbefb0739bf"} Mar 16 17:13:19 crc kubenswrapper[5120]: I0316 17:13:19.820776 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"d9d46705-f61e-4b8b-be7f-15ca7141d198","Type":"ContainerDied","Data":"fef931fff031120618c4aa05944e6fc9d4da77119d454a06cf87c1725c31dbc3"} Mar 16 17:13:19 crc kubenswrapper[5120]: I0316 17:13:19.820786 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"d9d46705-f61e-4b8b-be7f-15ca7141d198","Type":"ContainerDied","Data":"3b466e187a49fbd42579982bd2a02b23ac1002fd4c80b78c90bfd7d815e0d8ea"} Mar 16 17:13:19 crc kubenswrapper[5120]: I0316 17:13:19.820796 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"d9d46705-f61e-4b8b-be7f-15ca7141d198","Type":"ContainerDied","Data":"ca893faa191480929ad7527f540068500aa72e1be6dc51cfc2d985a422136749"} Mar 16 17:13:19 crc kubenswrapper[5120]: I0316 17:13:19.820814 5120 scope.go:117] "RemoveContainer" containerID="1dffa3063d4b1d5f700618803bd419782747ec225f0689fa2d5e576780e85059" Mar 16 17:13:19 crc kubenswrapper[5120]: I0316 17:13:19.825189 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"7ba88a08-571b-4c0c-ac5f-83f603d3ad93","Type":"ContainerStarted","Data":"056f1eec81fe4e00a2a68b9a58db70d2176eff20cd3a0bd5d694eb3b89e15573"} Mar 16 17:13:19 crc kubenswrapper[5120]: I0316 17:13:19.828714 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-659df787f4-kl54p" event={"ID":"b4e419a5-c358-422b-bfa1-64fe3dac8379","Type":"ContainerStarted","Data":"547b033c7c50f36e8c1126974a7ab04458e14beb20561c4d7ae35cb843729532"} Mar 16 17:13:19 crc kubenswrapper[5120]: I0316 17:13:19.833540 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"bbfbf4e9-d150-4503-a4c0-8b14a69df4df","Type":"ContainerStarted","Data":"5ebeb818fef0335be6911d7f454868d5ee5928fdd11852b00899d1b70d2b4699"} Mar 16 17:13:19 crc kubenswrapper[5120]: I0316 17:13:19.844428 5120 generic.go:358] "Generic (PLEG): container finished" podID="78897b1d-0d3f-4635-807d-3013a628ddfc" containerID="6ba4c616a5de603f57ad4bf98bda9b313a8b0afd5fe20a7725ca348dc07e395a" exitCode=0 Mar 16 17:13:19 crc kubenswrapper[5120]: I0316 17:13:19.844539 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-lt5c7" event={"ID":"78897b1d-0d3f-4635-807d-3013a628ddfc","Type":"ContainerDied","Data":"6ba4c616a5de603f57ad4bf98bda9b313a8b0afd5fe20a7725ca348dc07e395a"} Mar 16 17:13:19 crc kubenswrapper[5120]: I0316 17:13:19.851479 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tq5vm\" (UniqueName: \"kubernetes.io/projected/d9d46705-f61e-4b8b-be7f-15ca7141d198-kube-api-access-tq5vm\") on node \"crc\" DevicePath \"\"" Mar 16 17:13:19 crc kubenswrapper[5120]: I0316 17:13:19.851588 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/d9d46705-f61e-4b8b-be7f-15ca7141d198-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 17:13:19 crc kubenswrapper[5120]: I0316 17:13:19.851607 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d9d46705-f61e-4b8b-be7f-15ca7141d198-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:13:19 crc kubenswrapper[5120]: I0316 17:13:19.851619 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/d9d46705-f61e-4b8b-be7f-15ca7141d198-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 17:13:19 crc kubenswrapper[5120]: I0316 17:13:19.851632 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/d9d46705-f61e-4b8b-be7f-15ca7141d198-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 17:13:19 crc kubenswrapper[5120]: I0316 17:13:19.865431 5120 scope.go:117] "RemoveContainer" containerID="2a67f0c90baa03df45b6238127060046b213f56e1a7af7ade7401bbefb0739bf" Mar 16 17:13:19 crc kubenswrapper[5120]: I0316 17:13:19.867320 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d9d46705-f61e-4b8b-be7f-15ca7141d198-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "d9d46705-f61e-4b8b-be7f-15ca7141d198" (UID: "d9d46705-f61e-4b8b-be7f-15ca7141d198"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:13:19 crc kubenswrapper[5120]: I0316 17:13:19.901991 5120 scope.go:117] "RemoveContainer" containerID="fef931fff031120618c4aa05944e6fc9d4da77119d454a06cf87c1725c31dbc3" Mar 16 17:13:19 crc kubenswrapper[5120]: I0316 17:13:19.904651 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d9d46705-f61e-4b8b-be7f-15ca7141d198-config-data" (OuterVolumeSpecName: "config-data") pod "d9d46705-f61e-4b8b-be7f-15ca7141d198" (UID: "d9d46705-f61e-4b8b-be7f-15ca7141d198"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:13:19 crc kubenswrapper[5120]: I0316 17:13:19.914999 5120 scope.go:117] "RemoveContainer" containerID="0bcd0282304ca4ed1e673f7299d69b14cead794f843cc3e09c09a70628b6aee4" Mar 16 17:13:19 crc kubenswrapper[5120]: I0316 17:13:19.953697 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d9d46705-f61e-4b8b-be7f-15ca7141d198-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:13:19 crc kubenswrapper[5120]: I0316 17:13:19.953734 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d9d46705-f61e-4b8b-be7f-15ca7141d198-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:13:20 crc kubenswrapper[5120]: I0316 17:13:20.085211 5120 scope.go:117] "RemoveContainer" containerID="c7dea1965a80cb2989e9f401e59d00f0a34ace41781d462763f621d9f8898d96" Mar 16 17:13:20 crc kubenswrapper[5120]: I0316 17:13:20.122445 5120 scope.go:117] "RemoveContainer" containerID="3b466e187a49fbd42579982bd2a02b23ac1002fd4c80b78c90bfd7d815e0d8ea" Mar 16 17:13:20 crc kubenswrapper[5120]: I0316 17:13:20.189742 5120 scope.go:117] "RemoveContainer" containerID="1c22580c851343e8b19eb347321deb3137a86e53ef649ed430e0c0ee54117213" Mar 16 17:13:20 crc kubenswrapper[5120]: I0316 17:13:20.209077 5120 scope.go:117] "RemoveContainer" containerID="1dffa3063d4b1d5f700618803bd419782747ec225f0689fa2d5e576780e85059" Mar 16 17:13:20 crc kubenswrapper[5120]: E0316 17:13:20.209540 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1dffa3063d4b1d5f700618803bd419782747ec225f0689fa2d5e576780e85059\": container with ID starting with 1dffa3063d4b1d5f700618803bd419782747ec225f0689fa2d5e576780e85059 not found: ID does not exist" containerID="1dffa3063d4b1d5f700618803bd419782747ec225f0689fa2d5e576780e85059" Mar 16 17:13:20 crc kubenswrapper[5120]: I0316 17:13:20.209579 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1dffa3063d4b1d5f700618803bd419782747ec225f0689fa2d5e576780e85059"} err="failed to get container status \"1dffa3063d4b1d5f700618803bd419782747ec225f0689fa2d5e576780e85059\": rpc error: code = NotFound desc = could not find container \"1dffa3063d4b1d5f700618803bd419782747ec225f0689fa2d5e576780e85059\": container with ID starting with 1dffa3063d4b1d5f700618803bd419782747ec225f0689fa2d5e576780e85059 not found: ID does not exist" Mar 16 17:13:20 crc kubenswrapper[5120]: I0316 17:13:20.209602 5120 scope.go:117] "RemoveContainer" containerID="2a67f0c90baa03df45b6238127060046b213f56e1a7af7ade7401bbefb0739bf" Mar 16 17:13:20 crc kubenswrapper[5120]: E0316 17:13:20.210150 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2a67f0c90baa03df45b6238127060046b213f56e1a7af7ade7401bbefb0739bf\": container with ID starting with 2a67f0c90baa03df45b6238127060046b213f56e1a7af7ade7401bbefb0739bf not found: ID does not exist" containerID="2a67f0c90baa03df45b6238127060046b213f56e1a7af7ade7401bbefb0739bf" Mar 16 17:13:20 crc kubenswrapper[5120]: I0316 17:13:20.210253 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a67f0c90baa03df45b6238127060046b213f56e1a7af7ade7401bbefb0739bf"} err="failed to get container status \"2a67f0c90baa03df45b6238127060046b213f56e1a7af7ade7401bbefb0739bf\": rpc error: code = NotFound desc = could not find container \"2a67f0c90baa03df45b6238127060046b213f56e1a7af7ade7401bbefb0739bf\": container with ID starting with 2a67f0c90baa03df45b6238127060046b213f56e1a7af7ade7401bbefb0739bf not found: ID does not exist" Mar 16 17:13:20 crc kubenswrapper[5120]: I0316 17:13:20.210270 5120 scope.go:117] "RemoveContainer" containerID="fef931fff031120618c4aa05944e6fc9d4da77119d454a06cf87c1725c31dbc3" Mar 16 17:13:20 crc kubenswrapper[5120]: E0316 17:13:20.210550 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fef931fff031120618c4aa05944e6fc9d4da77119d454a06cf87c1725c31dbc3\": container with ID starting with fef931fff031120618c4aa05944e6fc9d4da77119d454a06cf87c1725c31dbc3 not found: ID does not exist" containerID="fef931fff031120618c4aa05944e6fc9d4da77119d454a06cf87c1725c31dbc3" Mar 16 17:13:20 crc kubenswrapper[5120]: I0316 17:13:20.210591 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fef931fff031120618c4aa05944e6fc9d4da77119d454a06cf87c1725c31dbc3"} err="failed to get container status \"fef931fff031120618c4aa05944e6fc9d4da77119d454a06cf87c1725c31dbc3\": rpc error: code = NotFound desc = could not find container \"fef931fff031120618c4aa05944e6fc9d4da77119d454a06cf87c1725c31dbc3\": container with ID starting with fef931fff031120618c4aa05944e6fc9d4da77119d454a06cf87c1725c31dbc3 not found: ID does not exist" Mar 16 17:13:20 crc kubenswrapper[5120]: I0316 17:13:20.210617 5120 scope.go:117] "RemoveContainer" containerID="3b466e187a49fbd42579982bd2a02b23ac1002fd4c80b78c90bfd7d815e0d8ea" Mar 16 17:13:20 crc kubenswrapper[5120]: E0316 17:13:20.211037 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b466e187a49fbd42579982bd2a02b23ac1002fd4c80b78c90bfd7d815e0d8ea\": container with ID starting with 3b466e187a49fbd42579982bd2a02b23ac1002fd4c80b78c90bfd7d815e0d8ea not found: ID does not exist" containerID="3b466e187a49fbd42579982bd2a02b23ac1002fd4c80b78c90bfd7d815e0d8ea" Mar 16 17:13:20 crc kubenswrapper[5120]: I0316 17:13:20.211061 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b466e187a49fbd42579982bd2a02b23ac1002fd4c80b78c90bfd7d815e0d8ea"} err="failed to get container status \"3b466e187a49fbd42579982bd2a02b23ac1002fd4c80b78c90bfd7d815e0d8ea\": rpc error: code = NotFound desc = could not find container \"3b466e187a49fbd42579982bd2a02b23ac1002fd4c80b78c90bfd7d815e0d8ea\": container with ID starting with 3b466e187a49fbd42579982bd2a02b23ac1002fd4c80b78c90bfd7d815e0d8ea not found: ID does not exist" Mar 16 17:13:20 crc kubenswrapper[5120]: I0316 17:13:20.211077 5120 scope.go:117] "RemoveContainer" containerID="1dffa3063d4b1d5f700618803bd419782747ec225f0689fa2d5e576780e85059" Mar 16 17:13:20 crc kubenswrapper[5120]: I0316 17:13:20.212523 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1dffa3063d4b1d5f700618803bd419782747ec225f0689fa2d5e576780e85059"} err="failed to get container status \"1dffa3063d4b1d5f700618803bd419782747ec225f0689fa2d5e576780e85059\": rpc error: code = NotFound desc = could not find container \"1dffa3063d4b1d5f700618803bd419782747ec225f0689fa2d5e576780e85059\": container with ID starting with 1dffa3063d4b1d5f700618803bd419782747ec225f0689fa2d5e576780e85059 not found: ID does not exist" Mar 16 17:13:20 crc kubenswrapper[5120]: I0316 17:13:20.212560 5120 scope.go:117] "RemoveContainer" containerID="2a67f0c90baa03df45b6238127060046b213f56e1a7af7ade7401bbefb0739bf" Mar 16 17:13:20 crc kubenswrapper[5120]: I0316 17:13:20.212971 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a67f0c90baa03df45b6238127060046b213f56e1a7af7ade7401bbefb0739bf"} err="failed to get container status \"2a67f0c90baa03df45b6238127060046b213f56e1a7af7ade7401bbefb0739bf\": rpc error: code = NotFound desc = could not find container \"2a67f0c90baa03df45b6238127060046b213f56e1a7af7ade7401bbefb0739bf\": container with ID starting with 2a67f0c90baa03df45b6238127060046b213f56e1a7af7ade7401bbefb0739bf not found: ID does not exist" Mar 16 17:13:20 crc kubenswrapper[5120]: I0316 17:13:20.213000 5120 scope.go:117] "RemoveContainer" containerID="fef931fff031120618c4aa05944e6fc9d4da77119d454a06cf87c1725c31dbc3" Mar 16 17:13:20 crc kubenswrapper[5120]: I0316 17:13:20.213712 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fef931fff031120618c4aa05944e6fc9d4da77119d454a06cf87c1725c31dbc3"} err="failed to get container status \"fef931fff031120618c4aa05944e6fc9d4da77119d454a06cf87c1725c31dbc3\": rpc error: code = NotFound desc = could not find container \"fef931fff031120618c4aa05944e6fc9d4da77119d454a06cf87c1725c31dbc3\": container with ID starting with fef931fff031120618c4aa05944e6fc9d4da77119d454a06cf87c1725c31dbc3 not found: ID does not exist" Mar 16 17:13:20 crc kubenswrapper[5120]: I0316 17:13:20.213754 5120 scope.go:117] "RemoveContainer" containerID="3b466e187a49fbd42579982bd2a02b23ac1002fd4c80b78c90bfd7d815e0d8ea" Mar 16 17:13:20 crc kubenswrapper[5120]: I0316 17:13:20.214176 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b466e187a49fbd42579982bd2a02b23ac1002fd4c80b78c90bfd7d815e0d8ea"} err="failed to get container status \"3b466e187a49fbd42579982bd2a02b23ac1002fd4c80b78c90bfd7d815e0d8ea\": rpc error: code = NotFound desc = could not find container \"3b466e187a49fbd42579982bd2a02b23ac1002fd4c80b78c90bfd7d815e0d8ea\": container with ID starting with 3b466e187a49fbd42579982bd2a02b23ac1002fd4c80b78c90bfd7d815e0d8ea not found: ID does not exist" Mar 16 17:13:20 crc kubenswrapper[5120]: I0316 17:13:20.214200 5120 scope.go:117] "RemoveContainer" containerID="1dffa3063d4b1d5f700618803bd419782747ec225f0689fa2d5e576780e85059" Mar 16 17:13:20 crc kubenswrapper[5120]: I0316 17:13:20.214573 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1dffa3063d4b1d5f700618803bd419782747ec225f0689fa2d5e576780e85059"} err="failed to get container status \"1dffa3063d4b1d5f700618803bd419782747ec225f0689fa2d5e576780e85059\": rpc error: code = NotFound desc = could not find container \"1dffa3063d4b1d5f700618803bd419782747ec225f0689fa2d5e576780e85059\": container with ID starting with 1dffa3063d4b1d5f700618803bd419782747ec225f0689fa2d5e576780e85059 not found: ID does not exist" Mar 16 17:13:20 crc kubenswrapper[5120]: I0316 17:13:20.214591 5120 scope.go:117] "RemoveContainer" containerID="2a67f0c90baa03df45b6238127060046b213f56e1a7af7ade7401bbefb0739bf" Mar 16 17:13:20 crc kubenswrapper[5120]: I0316 17:13:20.214996 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a67f0c90baa03df45b6238127060046b213f56e1a7af7ade7401bbefb0739bf"} err="failed to get container status \"2a67f0c90baa03df45b6238127060046b213f56e1a7af7ade7401bbefb0739bf\": rpc error: code = NotFound desc = could not find container \"2a67f0c90baa03df45b6238127060046b213f56e1a7af7ade7401bbefb0739bf\": container with ID starting with 2a67f0c90baa03df45b6238127060046b213f56e1a7af7ade7401bbefb0739bf not found: ID does not exist" Mar 16 17:13:20 crc kubenswrapper[5120]: I0316 17:13:20.215020 5120 scope.go:117] "RemoveContainer" containerID="fef931fff031120618c4aa05944e6fc9d4da77119d454a06cf87c1725c31dbc3" Mar 16 17:13:20 crc kubenswrapper[5120]: I0316 17:13:20.215331 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fef931fff031120618c4aa05944e6fc9d4da77119d454a06cf87c1725c31dbc3"} err="failed to get container status \"fef931fff031120618c4aa05944e6fc9d4da77119d454a06cf87c1725c31dbc3\": rpc error: code = NotFound desc = could not find container \"fef931fff031120618c4aa05944e6fc9d4da77119d454a06cf87c1725c31dbc3\": container with ID starting with fef931fff031120618c4aa05944e6fc9d4da77119d454a06cf87c1725c31dbc3 not found: ID does not exist" Mar 16 17:13:20 crc kubenswrapper[5120]: I0316 17:13:20.215355 5120 scope.go:117] "RemoveContainer" containerID="3b466e187a49fbd42579982bd2a02b23ac1002fd4c80b78c90bfd7d815e0d8ea" Mar 16 17:13:20 crc kubenswrapper[5120]: I0316 17:13:20.215717 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b466e187a49fbd42579982bd2a02b23ac1002fd4c80b78c90bfd7d815e0d8ea"} err="failed to get container status \"3b466e187a49fbd42579982bd2a02b23ac1002fd4c80b78c90bfd7d815e0d8ea\": rpc error: code = NotFound desc = could not find container \"3b466e187a49fbd42579982bd2a02b23ac1002fd4c80b78c90bfd7d815e0d8ea\": container with ID starting with 3b466e187a49fbd42579982bd2a02b23ac1002fd4c80b78c90bfd7d815e0d8ea not found: ID does not exist" Mar 16 17:13:20 crc kubenswrapper[5120]: I0316 17:13:20.215744 5120 scope.go:117] "RemoveContainer" containerID="1dffa3063d4b1d5f700618803bd419782747ec225f0689fa2d5e576780e85059" Mar 16 17:13:20 crc kubenswrapper[5120]: I0316 17:13:20.216057 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1dffa3063d4b1d5f700618803bd419782747ec225f0689fa2d5e576780e85059"} err="failed to get container status \"1dffa3063d4b1d5f700618803bd419782747ec225f0689fa2d5e576780e85059\": rpc error: code = NotFound desc = could not find container \"1dffa3063d4b1d5f700618803bd419782747ec225f0689fa2d5e576780e85059\": container with ID starting with 1dffa3063d4b1d5f700618803bd419782747ec225f0689fa2d5e576780e85059 not found: ID does not exist" Mar 16 17:13:20 crc kubenswrapper[5120]: I0316 17:13:20.216077 5120 scope.go:117] "RemoveContainer" containerID="2a67f0c90baa03df45b6238127060046b213f56e1a7af7ade7401bbefb0739bf" Mar 16 17:13:20 crc kubenswrapper[5120]: I0316 17:13:20.218136 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a67f0c90baa03df45b6238127060046b213f56e1a7af7ade7401bbefb0739bf"} err="failed to get container status \"2a67f0c90baa03df45b6238127060046b213f56e1a7af7ade7401bbefb0739bf\": rpc error: code = NotFound desc = could not find container \"2a67f0c90baa03df45b6238127060046b213f56e1a7af7ade7401bbefb0739bf\": container with ID starting with 2a67f0c90baa03df45b6238127060046b213f56e1a7af7ade7401bbefb0739bf not found: ID does not exist" Mar 16 17:13:20 crc kubenswrapper[5120]: I0316 17:13:20.218171 5120 scope.go:117] "RemoveContainer" containerID="fef931fff031120618c4aa05944e6fc9d4da77119d454a06cf87c1725c31dbc3" Mar 16 17:13:20 crc kubenswrapper[5120]: I0316 17:13:20.218493 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fef931fff031120618c4aa05944e6fc9d4da77119d454a06cf87c1725c31dbc3"} err="failed to get container status \"fef931fff031120618c4aa05944e6fc9d4da77119d454a06cf87c1725c31dbc3\": rpc error: code = NotFound desc = could not find container \"fef931fff031120618c4aa05944e6fc9d4da77119d454a06cf87c1725c31dbc3\": container with ID starting with fef931fff031120618c4aa05944e6fc9d4da77119d454a06cf87c1725c31dbc3 not found: ID does not exist" Mar 16 17:13:20 crc kubenswrapper[5120]: I0316 17:13:20.218544 5120 scope.go:117] "RemoveContainer" containerID="3b466e187a49fbd42579982bd2a02b23ac1002fd4c80b78c90bfd7d815e0d8ea" Mar 16 17:13:20 crc kubenswrapper[5120]: I0316 17:13:20.220397 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b466e187a49fbd42579982bd2a02b23ac1002fd4c80b78c90bfd7d815e0d8ea"} err="failed to get container status \"3b466e187a49fbd42579982bd2a02b23ac1002fd4c80b78c90bfd7d815e0d8ea\": rpc error: code = NotFound desc = could not find container \"3b466e187a49fbd42579982bd2a02b23ac1002fd4c80b78c90bfd7d815e0d8ea\": container with ID starting with 3b466e187a49fbd42579982bd2a02b23ac1002fd4c80b78c90bfd7d815e0d8ea not found: ID does not exist" Mar 16 17:13:20 crc kubenswrapper[5120]: I0316 17:13:20.291581 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:13:20 crc kubenswrapper[5120]: I0316 17:13:20.296252 5120 scope.go:117] "RemoveContainer" containerID="ce83778e363bf737ec9123e9b6f6ab14c486b01e00aa784b7adccb3e06348981" Mar 16 17:13:20 crc kubenswrapper[5120]: I0316 17:13:20.303124 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:13:20 crc kubenswrapper[5120]: I0316 17:13:20.315366 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:13:20 crc kubenswrapper[5120]: I0316 17:13:20.316594 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9d46705-f61e-4b8b-be7f-15ca7141d198" containerName="ceilometer-central-agent" Mar 16 17:13:20 crc kubenswrapper[5120]: I0316 17:13:20.316623 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9d46705-f61e-4b8b-be7f-15ca7141d198" containerName="ceilometer-central-agent" Mar 16 17:13:20 crc kubenswrapper[5120]: I0316 17:13:20.316657 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9d46705-f61e-4b8b-be7f-15ca7141d198" containerName="ceilometer-notification-agent" Mar 16 17:13:20 crc kubenswrapper[5120]: I0316 17:13:20.316668 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9d46705-f61e-4b8b-be7f-15ca7141d198" containerName="ceilometer-notification-agent" Mar 16 17:13:20 crc kubenswrapper[5120]: I0316 17:13:20.316683 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9d46705-f61e-4b8b-be7f-15ca7141d198" containerName="proxy-httpd" Mar 16 17:13:20 crc kubenswrapper[5120]: I0316 17:13:20.316690 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9d46705-f61e-4b8b-be7f-15ca7141d198" containerName="proxy-httpd" Mar 16 17:13:20 crc kubenswrapper[5120]: I0316 17:13:20.316738 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9d46705-f61e-4b8b-be7f-15ca7141d198" containerName="sg-core" Mar 16 17:13:20 crc kubenswrapper[5120]: I0316 17:13:20.316746 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9d46705-f61e-4b8b-be7f-15ca7141d198" containerName="sg-core" Mar 16 17:13:20 crc kubenswrapper[5120]: I0316 17:13:20.316964 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="d9d46705-f61e-4b8b-be7f-15ca7141d198" containerName="sg-core" Mar 16 17:13:20 crc kubenswrapper[5120]: I0316 17:13:20.316982 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="d9d46705-f61e-4b8b-be7f-15ca7141d198" containerName="proxy-httpd" Mar 16 17:13:20 crc kubenswrapper[5120]: I0316 17:13:20.316997 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="d9d46705-f61e-4b8b-be7f-15ca7141d198" containerName="ceilometer-notification-agent" Mar 16 17:13:20 crc kubenswrapper[5120]: I0316 17:13:20.317009 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="d9d46705-f61e-4b8b-be7f-15ca7141d198" containerName="ceilometer-central-agent" Mar 16 17:13:20 crc kubenswrapper[5120]: I0316 17:13:20.339219 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-cdsvl" Mar 16 17:13:20 crc kubenswrapper[5120]: I0316 17:13:20.341282 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:13:20 crc kubenswrapper[5120]: I0316 17:13:20.341397 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:13:20 crc kubenswrapper[5120]: I0316 17:13:20.344475 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 17:13:20 crc kubenswrapper[5120]: I0316 17:13:20.344695 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 17:13:20 crc kubenswrapper[5120]: I0316 17:13:20.362722 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/40adeacf-10ac-43fe-be98-7ab309206d9e-combined-ca-bundle\") pod \"40adeacf-10ac-43fe-be98-7ab309206d9e\" (UID: \"40adeacf-10ac-43fe-be98-7ab309206d9e\") " Mar 16 17:13:20 crc kubenswrapper[5120]: I0316 17:13:20.362960 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hzcjq\" (UniqueName: \"kubernetes.io/projected/40adeacf-10ac-43fe-be98-7ab309206d9e-kube-api-access-hzcjq\") pod \"40adeacf-10ac-43fe-be98-7ab309206d9e\" (UID: \"40adeacf-10ac-43fe-be98-7ab309206d9e\") " Mar 16 17:13:20 crc kubenswrapper[5120]: I0316 17:13:20.363395 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/40adeacf-10ac-43fe-be98-7ab309206d9e-db-sync-config-data\") pod \"40adeacf-10ac-43fe-be98-7ab309206d9e\" (UID: \"40adeacf-10ac-43fe-be98-7ab309206d9e\") " Mar 16 17:13:20 crc kubenswrapper[5120]: I0316 17:13:20.363571 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c977fa4c-2763-4ab0-8485-4a1a352be4ba-scripts\") pod \"ceilometer-0\" (UID: \"c977fa4c-2763-4ab0-8485-4a1a352be4ba\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:13:20 crc kubenswrapper[5120]: I0316 17:13:20.363617 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c977fa4c-2763-4ab0-8485-4a1a352be4ba-log-httpd\") pod \"ceilometer-0\" (UID: \"c977fa4c-2763-4ab0-8485-4a1a352be4ba\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:13:20 crc kubenswrapper[5120]: I0316 17:13:20.363738 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c977fa4c-2763-4ab0-8485-4a1a352be4ba-config-data\") pod \"ceilometer-0\" (UID: \"c977fa4c-2763-4ab0-8485-4a1a352be4ba\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:13:20 crc kubenswrapper[5120]: I0316 17:13:20.363906 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qb8qv\" (UniqueName: \"kubernetes.io/projected/c977fa4c-2763-4ab0-8485-4a1a352be4ba-kube-api-access-qb8qv\") pod \"ceilometer-0\" (UID: \"c977fa4c-2763-4ab0-8485-4a1a352be4ba\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:13:20 crc kubenswrapper[5120]: I0316 17:13:20.364070 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c977fa4c-2763-4ab0-8485-4a1a352be4ba-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"c977fa4c-2763-4ab0-8485-4a1a352be4ba\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:13:20 crc kubenswrapper[5120]: I0316 17:13:20.364152 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/c977fa4c-2763-4ab0-8485-4a1a352be4ba-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"c977fa4c-2763-4ab0-8485-4a1a352be4ba\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:13:20 crc kubenswrapper[5120]: I0316 17:13:20.366322 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c977fa4c-2763-4ab0-8485-4a1a352be4ba-run-httpd\") pod \"ceilometer-0\" (UID: \"c977fa4c-2763-4ab0-8485-4a1a352be4ba\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:13:20 crc kubenswrapper[5120]: I0316 17:13:20.368432 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40adeacf-10ac-43fe-be98-7ab309206d9e-kube-api-access-hzcjq" (OuterVolumeSpecName: "kube-api-access-hzcjq") pod "40adeacf-10ac-43fe-be98-7ab309206d9e" (UID: "40adeacf-10ac-43fe-be98-7ab309206d9e"). InnerVolumeSpecName "kube-api-access-hzcjq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:13:20 crc kubenswrapper[5120]: I0316 17:13:20.375034 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/40adeacf-10ac-43fe-be98-7ab309206d9e-db-sync-config-data" (OuterVolumeSpecName: "db-sync-config-data") pod "40adeacf-10ac-43fe-be98-7ab309206d9e" (UID: "40adeacf-10ac-43fe-be98-7ab309206d9e"). InnerVolumeSpecName "db-sync-config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:13:20 crc kubenswrapper[5120]: I0316 17:13:20.414107 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/40adeacf-10ac-43fe-be98-7ab309206d9e-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "40adeacf-10ac-43fe-be98-7ab309206d9e" (UID: "40adeacf-10ac-43fe-be98-7ab309206d9e"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:13:20 crc kubenswrapper[5120]: I0316 17:13:20.468919 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c977fa4c-2763-4ab0-8485-4a1a352be4ba-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"c977fa4c-2763-4ab0-8485-4a1a352be4ba\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:13:20 crc kubenswrapper[5120]: I0316 17:13:20.474031 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/c977fa4c-2763-4ab0-8485-4a1a352be4ba-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"c977fa4c-2763-4ab0-8485-4a1a352be4ba\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:13:20 crc kubenswrapper[5120]: I0316 17:13:20.474505 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c977fa4c-2763-4ab0-8485-4a1a352be4ba-run-httpd\") pod \"ceilometer-0\" (UID: \"c977fa4c-2763-4ab0-8485-4a1a352be4ba\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:13:20 crc kubenswrapper[5120]: I0316 17:13:20.474913 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c977fa4c-2763-4ab0-8485-4a1a352be4ba-scripts\") pod \"ceilometer-0\" (UID: \"c977fa4c-2763-4ab0-8485-4a1a352be4ba\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:13:20 crc kubenswrapper[5120]: I0316 17:13:20.475079 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c977fa4c-2763-4ab0-8485-4a1a352be4ba-log-httpd\") pod \"ceilometer-0\" (UID: \"c977fa4c-2763-4ab0-8485-4a1a352be4ba\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:13:20 crc kubenswrapper[5120]: I0316 17:13:20.475299 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c977fa4c-2763-4ab0-8485-4a1a352be4ba-config-data\") pod \"ceilometer-0\" (UID: \"c977fa4c-2763-4ab0-8485-4a1a352be4ba\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:13:20 crc kubenswrapper[5120]: I0316 17:13:20.475517 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qb8qv\" (UniqueName: \"kubernetes.io/projected/c977fa4c-2763-4ab0-8485-4a1a352be4ba-kube-api-access-qb8qv\") pod \"ceilometer-0\" (UID: \"c977fa4c-2763-4ab0-8485-4a1a352be4ba\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:13:20 crc kubenswrapper[5120]: I0316 17:13:20.475685 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hzcjq\" (UniqueName: \"kubernetes.io/projected/40adeacf-10ac-43fe-be98-7ab309206d9e-kube-api-access-hzcjq\") on node \"crc\" DevicePath \"\"" Mar 16 17:13:20 crc kubenswrapper[5120]: I0316 17:13:20.476108 5120 reconciler_common.go:299] "Volume detached for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/40adeacf-10ac-43fe-be98-7ab309206d9e-db-sync-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:13:20 crc kubenswrapper[5120]: I0316 17:13:20.476224 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/40adeacf-10ac-43fe-be98-7ab309206d9e-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:13:20 crc kubenswrapper[5120]: I0316 17:13:20.477200 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c977fa4c-2763-4ab0-8485-4a1a352be4ba-run-httpd\") pod \"ceilometer-0\" (UID: \"c977fa4c-2763-4ab0-8485-4a1a352be4ba\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:13:20 crc kubenswrapper[5120]: I0316 17:13:20.478209 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c977fa4c-2763-4ab0-8485-4a1a352be4ba-log-httpd\") pod \"ceilometer-0\" (UID: \"c977fa4c-2763-4ab0-8485-4a1a352be4ba\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:13:20 crc kubenswrapper[5120]: I0316 17:13:20.482669 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c977fa4c-2763-4ab0-8485-4a1a352be4ba-scripts\") pod \"ceilometer-0\" (UID: \"c977fa4c-2763-4ab0-8485-4a1a352be4ba\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:13:20 crc kubenswrapper[5120]: I0316 17:13:20.484800 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c977fa4c-2763-4ab0-8485-4a1a352be4ba-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"c977fa4c-2763-4ab0-8485-4a1a352be4ba\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:13:20 crc kubenswrapper[5120]: I0316 17:13:20.485715 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/c977fa4c-2763-4ab0-8485-4a1a352be4ba-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"c977fa4c-2763-4ab0-8485-4a1a352be4ba\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:13:20 crc kubenswrapper[5120]: I0316 17:13:20.486240 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c977fa4c-2763-4ab0-8485-4a1a352be4ba-config-data\") pod \"ceilometer-0\" (UID: \"c977fa4c-2763-4ab0-8485-4a1a352be4ba\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:13:20 crc kubenswrapper[5120]: I0316 17:13:20.505171 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qb8qv\" (UniqueName: \"kubernetes.io/projected/c977fa4c-2763-4ab0-8485-4a1a352be4ba-kube-api-access-qb8qv\") pod \"ceilometer-0\" (UID: \"c977fa4c-2763-4ab0-8485-4a1a352be4ba\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:13:20 crc kubenswrapper[5120]: I0316 17:13:20.678555 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d9d46705-f61e-4b8b-be7f-15ca7141d198" path="/var/lib/kubelet/pods/d9d46705-f61e-4b8b-be7f-15ca7141d198/volumes" Mar 16 17:13:20 crc kubenswrapper[5120]: I0316 17:13:20.691184 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:13:20 crc kubenswrapper[5120]: I0316 17:13:20.892097 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"bbfbf4e9-d150-4503-a4c0-8b14a69df4df","Type":"ContainerStarted","Data":"2eed823221a09ad2c0fa2339feadeb66bc2b67e0c290b8deb917754ac315f27b"} Mar 16 17:13:20 crc kubenswrapper[5120]: I0316 17:13:20.896956 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-cdsvl" event={"ID":"40adeacf-10ac-43fe-be98-7ab309206d9e","Type":"ContainerDied","Data":"7dd9350f33d743524e2743c7bf5828c605a5859fd52980cd6b56c4bdcf0c201d"} Mar 16 17:13:20 crc kubenswrapper[5120]: I0316 17:13:20.896998 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7dd9350f33d743524e2743c7bf5828c605a5859fd52980cd6b56c4bdcf0c201d" Mar 16 17:13:20 crc kubenswrapper[5120]: I0316 17:13:20.897071 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-cdsvl" Mar 16 17:13:20 crc kubenswrapper[5120]: I0316 17:13:20.905378 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"7ba88a08-571b-4c0c-ac5f-83f603d3ad93","Type":"ContainerStarted","Data":"1ed9c53a6746c3dc8754c0f99816d11037ff980e3d1ca772d5df562eaafea0f1"} Mar 16 17:13:20 crc kubenswrapper[5120]: I0316 17:13:20.932218 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-659df787f4-kl54p" event={"ID":"b4e419a5-c358-422b-bfa1-64fe3dac8379","Type":"ContainerStarted","Data":"30a61807cc8cd03eac35985c32d432eeb0e9d8c7cb11a86c4469af2f08952738"} Mar 16 17:13:20 crc kubenswrapper[5120]: I0316 17:13:20.932252 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-659df787f4-kl54p" event={"ID":"b4e419a5-c358-422b-bfa1-64fe3dac8379","Type":"ContainerStarted","Data":"54ff405b70053abcc7ea2970d05cfd6e855792ad8dca4383b946f22647de4a03"} Mar 16 17:13:20 crc kubenswrapper[5120]: I0316 17:13:20.932270 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-659df787f4-kl54p" Mar 16 17:13:20 crc kubenswrapper[5120]: I0316 17:13:20.932281 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-659df787f4-kl54p" Mar 16 17:13:20 crc kubenswrapper[5120]: I0316 17:13:20.961185 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-659df787f4-kl54p" podStartSLOduration=2.96116864 podStartE2EDuration="2.96116864s" podCreationTimestamp="2026-03-16 17:13:18 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:13:20.959972617 +0000 UTC m=+6103.113904274" watchObservedRunningTime="2026-03-16 17:13:20.96116864 +0000 UTC m=+6103.115100297" Mar 16 17:13:21 crc kubenswrapper[5120]: I0316 17:13:21.022802 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-worker-7c959f78ff-5lv92"] Mar 16 17:13:21 crc kubenswrapper[5120]: I0316 17:13:21.031081 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40adeacf-10ac-43fe-be98-7ab309206d9e" containerName="barbican-db-sync" Mar 16 17:13:21 crc kubenswrapper[5120]: I0316 17:13:21.031113 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="40adeacf-10ac-43fe-be98-7ab309206d9e" containerName="barbican-db-sync" Mar 16 17:13:21 crc kubenswrapper[5120]: I0316 17:13:21.031345 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="40adeacf-10ac-43fe-be98-7ab309206d9e" containerName="barbican-db-sync" Mar 16 17:13:21 crc kubenswrapper[5120]: I0316 17:13:21.042548 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-7c959f78ff-5lv92" Mar 16 17:13:21 crc kubenswrapper[5120]: I0316 17:13:21.045673 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-barbican-dockercfg-mf25w\"" Mar 16 17:13:21 crc kubenswrapper[5120]: I0316 17:13:21.048336 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-config-data\"" Mar 16 17:13:21 crc kubenswrapper[5120]: I0316 17:13:21.048505 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-worker-config-data\"" Mar 16 17:13:21 crc kubenswrapper[5120]: I0316 17:13:21.072725 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-7c959f78ff-5lv92"] Mar 16 17:13:21 crc kubenswrapper[5120]: I0316 17:13:21.096918 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/1ae5285c-173c-4162-9610-3f9c3a4ef47b-logs\") pod \"barbican-worker-7c959f78ff-5lv92\" (UID: \"1ae5285c-173c-4162-9610-3f9c3a4ef47b\") " pod="openstack-kuttl-tests/barbican-worker-7c959f78ff-5lv92" Mar 16 17:13:21 crc kubenswrapper[5120]: I0316 17:13:21.097079 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1ae5285c-173c-4162-9610-3f9c3a4ef47b-config-data\") pod \"barbican-worker-7c959f78ff-5lv92\" (UID: \"1ae5285c-173c-4162-9610-3f9c3a4ef47b\") " pod="openstack-kuttl-tests/barbican-worker-7c959f78ff-5lv92" Mar 16 17:13:21 crc kubenswrapper[5120]: I0316 17:13:21.097138 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1ae5285c-173c-4162-9610-3f9c3a4ef47b-combined-ca-bundle\") pod \"barbican-worker-7c959f78ff-5lv92\" (UID: \"1ae5285c-173c-4162-9610-3f9c3a4ef47b\") " pod="openstack-kuttl-tests/barbican-worker-7c959f78ff-5lv92" Mar 16 17:13:21 crc kubenswrapper[5120]: I0316 17:13:21.097178 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/1ae5285c-173c-4162-9610-3f9c3a4ef47b-config-data-custom\") pod \"barbican-worker-7c959f78ff-5lv92\" (UID: \"1ae5285c-173c-4162-9610-3f9c3a4ef47b\") " pod="openstack-kuttl-tests/barbican-worker-7c959f78ff-5lv92" Mar 16 17:13:21 crc kubenswrapper[5120]: I0316 17:13:21.097391 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mr57\" (UniqueName: \"kubernetes.io/projected/1ae5285c-173c-4162-9610-3f9c3a4ef47b-kube-api-access-8mr57\") pod \"barbican-worker-7c959f78ff-5lv92\" (UID: \"1ae5285c-173c-4162-9610-3f9c3a4ef47b\") " pod="openstack-kuttl-tests/barbican-worker-7c959f78ff-5lv92" Mar 16 17:13:21 crc kubenswrapper[5120]: I0316 17:13:21.113699 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-75c7b8c84b-ckzdf"] Mar 16 17:13:21 crc kubenswrapper[5120]: I0316 17:13:21.121522 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-75c7b8c84b-ckzdf" Mar 16 17:13:21 crc kubenswrapper[5120]: I0316 17:13:21.124039 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-keystone-listener-config-data\"" Mar 16 17:13:21 crc kubenswrapper[5120]: W0316 17:13:21.179660 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc977fa4c_2763_4ab0_8485_4a1a352be4ba.slice/crio-6d2eef5a255185e854f4f695ccc8ae614a3459ca82393da20e249f7ac4d1a0e4 WatchSource:0}: Error finding container 6d2eef5a255185e854f4f695ccc8ae614a3459ca82393da20e249f7ac4d1a0e4: Status 404 returned error can't find the container with id 6d2eef5a255185e854f4f695ccc8ae614a3459ca82393da20e249f7ac4d1a0e4 Mar 16 17:13:21 crc kubenswrapper[5120]: I0316 17:13:21.192365 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-75c7b8c84b-ckzdf"] Mar 16 17:13:21 crc kubenswrapper[5120]: I0316 17:13:21.199629 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1ae5285c-173c-4162-9610-3f9c3a4ef47b-config-data\") pod \"barbican-worker-7c959f78ff-5lv92\" (UID: \"1ae5285c-173c-4162-9610-3f9c3a4ef47b\") " pod="openstack-kuttl-tests/barbican-worker-7c959f78ff-5lv92" Mar 16 17:13:21 crc kubenswrapper[5120]: I0316 17:13:21.199714 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1ae5285c-173c-4162-9610-3f9c3a4ef47b-combined-ca-bundle\") pod \"barbican-worker-7c959f78ff-5lv92\" (UID: \"1ae5285c-173c-4162-9610-3f9c3a4ef47b\") " pod="openstack-kuttl-tests/barbican-worker-7c959f78ff-5lv92" Mar 16 17:13:21 crc kubenswrapper[5120]: I0316 17:13:21.199754 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/1ae5285c-173c-4162-9610-3f9c3a4ef47b-config-data-custom\") pod \"barbican-worker-7c959f78ff-5lv92\" (UID: \"1ae5285c-173c-4162-9610-3f9c3a4ef47b\") " pod="openstack-kuttl-tests/barbican-worker-7c959f78ff-5lv92" Mar 16 17:13:21 crc kubenswrapper[5120]: I0316 17:13:21.199788 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgn2g\" (UniqueName: \"kubernetes.io/projected/59a6de62-1f3e-48b3-b377-4a582f759b5b-kube-api-access-vgn2g\") pod \"barbican-keystone-listener-75c7b8c84b-ckzdf\" (UID: \"59a6de62-1f3e-48b3-b377-4a582f759b5b\") " pod="openstack-kuttl-tests/barbican-keystone-listener-75c7b8c84b-ckzdf" Mar 16 17:13:21 crc kubenswrapper[5120]: I0316 17:13:21.199918 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/59a6de62-1f3e-48b3-b377-4a582f759b5b-config-data\") pod \"barbican-keystone-listener-75c7b8c84b-ckzdf\" (UID: \"59a6de62-1f3e-48b3-b377-4a582f759b5b\") " pod="openstack-kuttl-tests/barbican-keystone-listener-75c7b8c84b-ckzdf" Mar 16 17:13:21 crc kubenswrapper[5120]: I0316 17:13:21.200004 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/59a6de62-1f3e-48b3-b377-4a582f759b5b-combined-ca-bundle\") pod \"barbican-keystone-listener-75c7b8c84b-ckzdf\" (UID: \"59a6de62-1f3e-48b3-b377-4a582f759b5b\") " pod="openstack-kuttl-tests/barbican-keystone-listener-75c7b8c84b-ckzdf" Mar 16 17:13:21 crc kubenswrapper[5120]: I0316 17:13:21.200080 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8mr57\" (UniqueName: \"kubernetes.io/projected/1ae5285c-173c-4162-9610-3f9c3a4ef47b-kube-api-access-8mr57\") pod \"barbican-worker-7c959f78ff-5lv92\" (UID: \"1ae5285c-173c-4162-9610-3f9c3a4ef47b\") " pod="openstack-kuttl-tests/barbican-worker-7c959f78ff-5lv92" Mar 16 17:13:21 crc kubenswrapper[5120]: I0316 17:13:21.200126 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/59a6de62-1f3e-48b3-b377-4a582f759b5b-logs\") pod \"barbican-keystone-listener-75c7b8c84b-ckzdf\" (UID: \"59a6de62-1f3e-48b3-b377-4a582f759b5b\") " pod="openstack-kuttl-tests/barbican-keystone-listener-75c7b8c84b-ckzdf" Mar 16 17:13:21 crc kubenswrapper[5120]: I0316 17:13:21.200157 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/1ae5285c-173c-4162-9610-3f9c3a4ef47b-logs\") pod \"barbican-worker-7c959f78ff-5lv92\" (UID: \"1ae5285c-173c-4162-9610-3f9c3a4ef47b\") " pod="openstack-kuttl-tests/barbican-worker-7c959f78ff-5lv92" Mar 16 17:13:21 crc kubenswrapper[5120]: I0316 17:13:21.200211 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/59a6de62-1f3e-48b3-b377-4a582f759b5b-config-data-custom\") pod \"barbican-keystone-listener-75c7b8c84b-ckzdf\" (UID: \"59a6de62-1f3e-48b3-b377-4a582f759b5b\") " pod="openstack-kuttl-tests/barbican-keystone-listener-75c7b8c84b-ckzdf" Mar 16 17:13:21 crc kubenswrapper[5120]: I0316 17:13:21.205292 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/1ae5285c-173c-4162-9610-3f9c3a4ef47b-logs\") pod \"barbican-worker-7c959f78ff-5lv92\" (UID: \"1ae5285c-173c-4162-9610-3f9c3a4ef47b\") " pod="openstack-kuttl-tests/barbican-worker-7c959f78ff-5lv92" Mar 16 17:13:21 crc kubenswrapper[5120]: I0316 17:13:21.214885 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1ae5285c-173c-4162-9610-3f9c3a4ef47b-combined-ca-bundle\") pod \"barbican-worker-7c959f78ff-5lv92\" (UID: \"1ae5285c-173c-4162-9610-3f9c3a4ef47b\") " pod="openstack-kuttl-tests/barbican-worker-7c959f78ff-5lv92" Mar 16 17:13:21 crc kubenswrapper[5120]: I0316 17:13:21.216050 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1ae5285c-173c-4162-9610-3f9c3a4ef47b-config-data\") pod \"barbican-worker-7c959f78ff-5lv92\" (UID: \"1ae5285c-173c-4162-9610-3f9c3a4ef47b\") " pod="openstack-kuttl-tests/barbican-worker-7c959f78ff-5lv92" Mar 16 17:13:21 crc kubenswrapper[5120]: I0316 17:13:21.236706 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:13:21 crc kubenswrapper[5120]: I0316 17:13:21.246840 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mr57\" (UniqueName: \"kubernetes.io/projected/1ae5285c-173c-4162-9610-3f9c3a4ef47b-kube-api-access-8mr57\") pod \"barbican-worker-7c959f78ff-5lv92\" (UID: \"1ae5285c-173c-4162-9610-3f9c3a4ef47b\") " pod="openstack-kuttl-tests/barbican-worker-7c959f78ff-5lv92" Mar 16 17:13:21 crc kubenswrapper[5120]: I0316 17:13:21.247384 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/1ae5285c-173c-4162-9610-3f9c3a4ef47b-config-data-custom\") pod \"barbican-worker-7c959f78ff-5lv92\" (UID: \"1ae5285c-173c-4162-9610-3f9c3a4ef47b\") " pod="openstack-kuttl-tests/barbican-worker-7c959f78ff-5lv92" Mar 16 17:13:21 crc kubenswrapper[5120]: I0316 17:13:21.250636 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-api-6b57b99b96-6qzq2"] Mar 16 17:13:21 crc kubenswrapper[5120]: I0316 17:13:21.267485 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-6b57b99b96-6qzq2" Mar 16 17:13:21 crc kubenswrapper[5120]: I0316 17:13:21.271395 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-api-config-data\"" Mar 16 17:13:21 crc kubenswrapper[5120]: I0316 17:13:21.280322 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-6b57b99b96-6qzq2"] Mar 16 17:13:21 crc kubenswrapper[5120]: I0316 17:13:21.304416 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/59a6de62-1f3e-48b3-b377-4a582f759b5b-config-data\") pod \"barbican-keystone-listener-75c7b8c84b-ckzdf\" (UID: \"59a6de62-1f3e-48b3-b377-4a582f759b5b\") " pod="openstack-kuttl-tests/barbican-keystone-listener-75c7b8c84b-ckzdf" Mar 16 17:13:21 crc kubenswrapper[5120]: I0316 17:13:21.304491 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/59a6de62-1f3e-48b3-b377-4a582f759b5b-combined-ca-bundle\") pod \"barbican-keystone-listener-75c7b8c84b-ckzdf\" (UID: \"59a6de62-1f3e-48b3-b377-4a582f759b5b\") " pod="openstack-kuttl-tests/barbican-keystone-listener-75c7b8c84b-ckzdf" Mar 16 17:13:21 crc kubenswrapper[5120]: I0316 17:13:21.304534 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a9bb962d-330a-45a0-9bb0-09b134c425f5-combined-ca-bundle\") pod \"barbican-api-6b57b99b96-6qzq2\" (UID: \"a9bb962d-330a-45a0-9bb0-09b134c425f5\") " pod="openstack-kuttl-tests/barbican-api-6b57b99b96-6qzq2" Mar 16 17:13:21 crc kubenswrapper[5120]: I0316 17:13:21.304604 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a9bb962d-330a-45a0-9bb0-09b134c425f5-config-data\") pod \"barbican-api-6b57b99b96-6qzq2\" (UID: \"a9bb962d-330a-45a0-9bb0-09b134c425f5\") " pod="openstack-kuttl-tests/barbican-api-6b57b99b96-6qzq2" Mar 16 17:13:21 crc kubenswrapper[5120]: I0316 17:13:21.304624 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvscc\" (UniqueName: \"kubernetes.io/projected/a9bb962d-330a-45a0-9bb0-09b134c425f5-kube-api-access-nvscc\") pod \"barbican-api-6b57b99b96-6qzq2\" (UID: \"a9bb962d-330a-45a0-9bb0-09b134c425f5\") " pod="openstack-kuttl-tests/barbican-api-6b57b99b96-6qzq2" Mar 16 17:13:21 crc kubenswrapper[5120]: I0316 17:13:21.304646 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/59a6de62-1f3e-48b3-b377-4a582f759b5b-logs\") pod \"barbican-keystone-listener-75c7b8c84b-ckzdf\" (UID: \"59a6de62-1f3e-48b3-b377-4a582f759b5b\") " pod="openstack-kuttl-tests/barbican-keystone-listener-75c7b8c84b-ckzdf" Mar 16 17:13:21 crc kubenswrapper[5120]: I0316 17:13:21.304713 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/59a6de62-1f3e-48b3-b377-4a582f759b5b-config-data-custom\") pod \"barbican-keystone-listener-75c7b8c84b-ckzdf\" (UID: \"59a6de62-1f3e-48b3-b377-4a582f759b5b\") " pod="openstack-kuttl-tests/barbican-keystone-listener-75c7b8c84b-ckzdf" Mar 16 17:13:21 crc kubenswrapper[5120]: I0316 17:13:21.304732 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a9bb962d-330a-45a0-9bb0-09b134c425f5-logs\") pod \"barbican-api-6b57b99b96-6qzq2\" (UID: \"a9bb962d-330a-45a0-9bb0-09b134c425f5\") " pod="openstack-kuttl-tests/barbican-api-6b57b99b96-6qzq2" Mar 16 17:13:21 crc kubenswrapper[5120]: I0316 17:13:21.304801 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/a9bb962d-330a-45a0-9bb0-09b134c425f5-config-data-custom\") pod \"barbican-api-6b57b99b96-6qzq2\" (UID: \"a9bb962d-330a-45a0-9bb0-09b134c425f5\") " pod="openstack-kuttl-tests/barbican-api-6b57b99b96-6qzq2" Mar 16 17:13:21 crc kubenswrapper[5120]: I0316 17:13:21.304892 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vgn2g\" (UniqueName: \"kubernetes.io/projected/59a6de62-1f3e-48b3-b377-4a582f759b5b-kube-api-access-vgn2g\") pod \"barbican-keystone-listener-75c7b8c84b-ckzdf\" (UID: \"59a6de62-1f3e-48b3-b377-4a582f759b5b\") " pod="openstack-kuttl-tests/barbican-keystone-listener-75c7b8c84b-ckzdf" Mar 16 17:13:21 crc kubenswrapper[5120]: I0316 17:13:21.309447 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/59a6de62-1f3e-48b3-b377-4a582f759b5b-logs\") pod \"barbican-keystone-listener-75c7b8c84b-ckzdf\" (UID: \"59a6de62-1f3e-48b3-b377-4a582f759b5b\") " pod="openstack-kuttl-tests/barbican-keystone-listener-75c7b8c84b-ckzdf" Mar 16 17:13:21 crc kubenswrapper[5120]: I0316 17:13:21.312733 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/59a6de62-1f3e-48b3-b377-4a582f759b5b-config-data\") pod \"barbican-keystone-listener-75c7b8c84b-ckzdf\" (UID: \"59a6de62-1f3e-48b3-b377-4a582f759b5b\") " pod="openstack-kuttl-tests/barbican-keystone-listener-75c7b8c84b-ckzdf" Mar 16 17:13:21 crc kubenswrapper[5120]: I0316 17:13:21.328402 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/59a6de62-1f3e-48b3-b377-4a582f759b5b-combined-ca-bundle\") pod \"barbican-keystone-listener-75c7b8c84b-ckzdf\" (UID: \"59a6de62-1f3e-48b3-b377-4a582f759b5b\") " pod="openstack-kuttl-tests/barbican-keystone-listener-75c7b8c84b-ckzdf" Mar 16 17:13:21 crc kubenswrapper[5120]: I0316 17:13:21.336084 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgn2g\" (UniqueName: \"kubernetes.io/projected/59a6de62-1f3e-48b3-b377-4a582f759b5b-kube-api-access-vgn2g\") pod \"barbican-keystone-listener-75c7b8c84b-ckzdf\" (UID: \"59a6de62-1f3e-48b3-b377-4a582f759b5b\") " pod="openstack-kuttl-tests/barbican-keystone-listener-75c7b8c84b-ckzdf" Mar 16 17:13:21 crc kubenswrapper[5120]: I0316 17:13:21.359363 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/59a6de62-1f3e-48b3-b377-4a582f759b5b-config-data-custom\") pod \"barbican-keystone-listener-75c7b8c84b-ckzdf\" (UID: \"59a6de62-1f3e-48b3-b377-4a582f759b5b\") " pod="openstack-kuttl-tests/barbican-keystone-listener-75c7b8c84b-ckzdf" Mar 16 17:13:21 crc kubenswrapper[5120]: I0316 17:13:21.380438 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-7c959f78ff-5lv92" Mar 16 17:13:21 crc kubenswrapper[5120]: I0316 17:13:21.406814 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a9bb962d-330a-45a0-9bb0-09b134c425f5-combined-ca-bundle\") pod \"barbican-api-6b57b99b96-6qzq2\" (UID: \"a9bb962d-330a-45a0-9bb0-09b134c425f5\") " pod="openstack-kuttl-tests/barbican-api-6b57b99b96-6qzq2" Mar 16 17:13:21 crc kubenswrapper[5120]: I0316 17:13:21.407167 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a9bb962d-330a-45a0-9bb0-09b134c425f5-config-data\") pod \"barbican-api-6b57b99b96-6qzq2\" (UID: \"a9bb962d-330a-45a0-9bb0-09b134c425f5\") " pod="openstack-kuttl-tests/barbican-api-6b57b99b96-6qzq2" Mar 16 17:13:21 crc kubenswrapper[5120]: I0316 17:13:21.407191 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nvscc\" (UniqueName: \"kubernetes.io/projected/a9bb962d-330a-45a0-9bb0-09b134c425f5-kube-api-access-nvscc\") pod \"barbican-api-6b57b99b96-6qzq2\" (UID: \"a9bb962d-330a-45a0-9bb0-09b134c425f5\") " pod="openstack-kuttl-tests/barbican-api-6b57b99b96-6qzq2" Mar 16 17:13:21 crc kubenswrapper[5120]: I0316 17:13:21.407262 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a9bb962d-330a-45a0-9bb0-09b134c425f5-logs\") pod \"barbican-api-6b57b99b96-6qzq2\" (UID: \"a9bb962d-330a-45a0-9bb0-09b134c425f5\") " pod="openstack-kuttl-tests/barbican-api-6b57b99b96-6qzq2" Mar 16 17:13:21 crc kubenswrapper[5120]: I0316 17:13:21.407320 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/a9bb962d-330a-45a0-9bb0-09b134c425f5-config-data-custom\") pod \"barbican-api-6b57b99b96-6qzq2\" (UID: \"a9bb962d-330a-45a0-9bb0-09b134c425f5\") " pod="openstack-kuttl-tests/barbican-api-6b57b99b96-6qzq2" Mar 16 17:13:21 crc kubenswrapper[5120]: I0316 17:13:21.407790 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a9bb962d-330a-45a0-9bb0-09b134c425f5-logs\") pod \"barbican-api-6b57b99b96-6qzq2\" (UID: \"a9bb962d-330a-45a0-9bb0-09b134c425f5\") " pod="openstack-kuttl-tests/barbican-api-6b57b99b96-6qzq2" Mar 16 17:13:21 crc kubenswrapper[5120]: I0316 17:13:21.410886 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a9bb962d-330a-45a0-9bb0-09b134c425f5-combined-ca-bundle\") pod \"barbican-api-6b57b99b96-6qzq2\" (UID: \"a9bb962d-330a-45a0-9bb0-09b134c425f5\") " pod="openstack-kuttl-tests/barbican-api-6b57b99b96-6qzq2" Mar 16 17:13:21 crc kubenswrapper[5120]: I0316 17:13:21.413157 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/a9bb962d-330a-45a0-9bb0-09b134c425f5-config-data-custom\") pod \"barbican-api-6b57b99b96-6qzq2\" (UID: \"a9bb962d-330a-45a0-9bb0-09b134c425f5\") " pod="openstack-kuttl-tests/barbican-api-6b57b99b96-6qzq2" Mar 16 17:13:21 crc kubenswrapper[5120]: I0316 17:13:21.413449 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a9bb962d-330a-45a0-9bb0-09b134c425f5-config-data\") pod \"barbican-api-6b57b99b96-6qzq2\" (UID: \"a9bb962d-330a-45a0-9bb0-09b134c425f5\") " pod="openstack-kuttl-tests/barbican-api-6b57b99b96-6qzq2" Mar 16 17:13:21 crc kubenswrapper[5120]: I0316 17:13:21.431284 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvscc\" (UniqueName: \"kubernetes.io/projected/a9bb962d-330a-45a0-9bb0-09b134c425f5-kube-api-access-nvscc\") pod \"barbican-api-6b57b99b96-6qzq2\" (UID: \"a9bb962d-330a-45a0-9bb0-09b134c425f5\") " pod="openstack-kuttl-tests/barbican-api-6b57b99b96-6qzq2" Mar 16 17:13:21 crc kubenswrapper[5120]: I0316 17:13:21.456262 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-6b57b99b96-6qzq2" Mar 16 17:13:21 crc kubenswrapper[5120]: I0316 17:13:21.467511 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-75c7b8c84b-ckzdf" Mar 16 17:13:21 crc kubenswrapper[5120]: I0316 17:13:21.469244 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-lt5c7" Mar 16 17:13:21 crc kubenswrapper[5120]: I0316 17:13:21.510978 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/78897b1d-0d3f-4635-807d-3013a628ddfc-fernet-keys\") pod \"78897b1d-0d3f-4635-807d-3013a628ddfc\" (UID: \"78897b1d-0d3f-4635-807d-3013a628ddfc\") " Mar 16 17:13:21 crc kubenswrapper[5120]: I0316 17:13:21.511068 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/78897b1d-0d3f-4635-807d-3013a628ddfc-config-data\") pod \"78897b1d-0d3f-4635-807d-3013a628ddfc\" (UID: \"78897b1d-0d3f-4635-807d-3013a628ddfc\") " Mar 16 17:13:21 crc kubenswrapper[5120]: I0316 17:13:21.511439 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xqx2x\" (UniqueName: \"kubernetes.io/projected/78897b1d-0d3f-4635-807d-3013a628ddfc-kube-api-access-xqx2x\") pod \"78897b1d-0d3f-4635-807d-3013a628ddfc\" (UID: \"78897b1d-0d3f-4635-807d-3013a628ddfc\") " Mar 16 17:13:21 crc kubenswrapper[5120]: I0316 17:13:21.512032 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/78897b1d-0d3f-4635-807d-3013a628ddfc-combined-ca-bundle\") pod \"78897b1d-0d3f-4635-807d-3013a628ddfc\" (UID: \"78897b1d-0d3f-4635-807d-3013a628ddfc\") " Mar 16 17:13:21 crc kubenswrapper[5120]: I0316 17:13:21.512074 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/78897b1d-0d3f-4635-807d-3013a628ddfc-scripts\") pod \"78897b1d-0d3f-4635-807d-3013a628ddfc\" (UID: \"78897b1d-0d3f-4635-807d-3013a628ddfc\") " Mar 16 17:13:21 crc kubenswrapper[5120]: I0316 17:13:21.512113 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/78897b1d-0d3f-4635-807d-3013a628ddfc-credential-keys\") pod \"78897b1d-0d3f-4635-807d-3013a628ddfc\" (UID: \"78897b1d-0d3f-4635-807d-3013a628ddfc\") " Mar 16 17:13:21 crc kubenswrapper[5120]: I0316 17:13:21.533851 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/78897b1d-0d3f-4635-807d-3013a628ddfc-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "78897b1d-0d3f-4635-807d-3013a628ddfc" (UID: "78897b1d-0d3f-4635-807d-3013a628ddfc"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:13:21 crc kubenswrapper[5120]: I0316 17:13:21.539187 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/78897b1d-0d3f-4635-807d-3013a628ddfc-kube-api-access-xqx2x" (OuterVolumeSpecName: "kube-api-access-xqx2x") pod "78897b1d-0d3f-4635-807d-3013a628ddfc" (UID: "78897b1d-0d3f-4635-807d-3013a628ddfc"). InnerVolumeSpecName "kube-api-access-xqx2x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:13:21 crc kubenswrapper[5120]: I0316 17:13:21.546856 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/78897b1d-0d3f-4635-807d-3013a628ddfc-scripts" (OuterVolumeSpecName: "scripts") pod "78897b1d-0d3f-4635-807d-3013a628ddfc" (UID: "78897b1d-0d3f-4635-807d-3013a628ddfc"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:13:21 crc kubenswrapper[5120]: I0316 17:13:21.576182 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/78897b1d-0d3f-4635-807d-3013a628ddfc-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "78897b1d-0d3f-4635-807d-3013a628ddfc" (UID: "78897b1d-0d3f-4635-807d-3013a628ddfc"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:13:21 crc kubenswrapper[5120]: I0316 17:13:21.619591 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/78897b1d-0d3f-4635-807d-3013a628ddfc-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:13:21 crc kubenswrapper[5120]: I0316 17:13:21.619929 5120 reconciler_common.go:299] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/78897b1d-0d3f-4635-807d-3013a628ddfc-credential-keys\") on node \"crc\" DevicePath \"\"" Mar 16 17:13:21 crc kubenswrapper[5120]: I0316 17:13:21.619948 5120 reconciler_common.go:299] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/78897b1d-0d3f-4635-807d-3013a628ddfc-fernet-keys\") on node \"crc\" DevicePath \"\"" Mar 16 17:13:21 crc kubenswrapper[5120]: I0316 17:13:21.619963 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xqx2x\" (UniqueName: \"kubernetes.io/projected/78897b1d-0d3f-4635-807d-3013a628ddfc-kube-api-access-xqx2x\") on node \"crc\" DevicePath \"\"" Mar 16 17:13:21 crc kubenswrapper[5120]: I0316 17:13:21.659857 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/78897b1d-0d3f-4635-807d-3013a628ddfc-config-data" (OuterVolumeSpecName: "config-data") pod "78897b1d-0d3f-4635-807d-3013a628ddfc" (UID: "78897b1d-0d3f-4635-807d-3013a628ddfc"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:13:21 crc kubenswrapper[5120]: I0316 17:13:21.681282 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/78897b1d-0d3f-4635-807d-3013a628ddfc-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "78897b1d-0d3f-4635-807d-3013a628ddfc" (UID: "78897b1d-0d3f-4635-807d-3013a628ddfc"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:13:21 crc kubenswrapper[5120]: I0316 17:13:21.723235 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/78897b1d-0d3f-4635-807d-3013a628ddfc-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:13:21 crc kubenswrapper[5120]: I0316 17:13:21.723273 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/78897b1d-0d3f-4635-807d-3013a628ddfc-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:13:21 crc kubenswrapper[5120]: I0316 17:13:21.926773 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-7c959f78ff-5lv92"] Mar 16 17:13:22 crc kubenswrapper[5120]: I0316 17:13:22.006150 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-lt5c7" event={"ID":"78897b1d-0d3f-4635-807d-3013a628ddfc","Type":"ContainerDied","Data":"2ccd39d3aca3f74d74f87d92425e3615f99207eb70814c7f1d14563b6b4c2647"} Mar 16 17:13:22 crc kubenswrapper[5120]: I0316 17:13:22.006191 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2ccd39d3aca3f74d74f87d92425e3615f99207eb70814c7f1d14563b6b4c2647" Mar 16 17:13:22 crc kubenswrapper[5120]: I0316 17:13:22.006275 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-lt5c7" Mar 16 17:13:22 crc kubenswrapper[5120]: I0316 17:13:22.010048 5120 patch_prober.go:28] interesting pod/machine-config-daemon-7bf76 container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 17:13:22 crc kubenswrapper[5120]: I0316 17:13:22.010088 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 17:13:22 crc kubenswrapper[5120]: I0316 17:13:22.033995 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-lt5c7"] Mar 16 17:13:22 crc kubenswrapper[5120]: I0316 17:13:22.037141 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"c977fa4c-2763-4ab0-8485-4a1a352be4ba","Type":"ContainerStarted","Data":"6d2eef5a255185e854f4f695ccc8ae614a3459ca82393da20e249f7ac4d1a0e4"} Mar 16 17:13:22 crc kubenswrapper[5120]: I0316 17:13:22.039473 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"7ba88a08-571b-4c0c-ac5f-83f603d3ad93","Type":"ContainerStarted","Data":"54e729471c57221e9ec716b84ee8370905d0bbb88e60b3b95314d8aefd076e1c"} Mar 16 17:13:22 crc kubenswrapper[5120]: I0316 17:13:22.041101 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"bbfbf4e9-d150-4503-a4c0-8b14a69df4df","Type":"ContainerStarted","Data":"165cb675ff60493ed7f2f63380d0a54cce174c472205e9a50516b951f274ac29"} Mar 16 17:13:22 crc kubenswrapper[5120]: I0316 17:13:22.044676 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-7c959f78ff-5lv92" event={"ID":"1ae5285c-173c-4162-9610-3f9c3a4ef47b","Type":"ContainerStarted","Data":"bb64514d7236b7a064ac10e3b2162c6729627e29389a7ddee92bb99a060608ff"} Mar 16 17:13:22 crc kubenswrapper[5120]: I0316 17:13:22.058016 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-lt5c7"] Mar 16 17:13:22 crc kubenswrapper[5120]: I0316 17:13:22.067805 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-external-api-0" podStartSLOduration=4.067789586 podStartE2EDuration="4.067789586s" podCreationTimestamp="2026-03-16 17:13:18 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:13:22.061121184 +0000 UTC m=+6104.215052841" watchObservedRunningTime="2026-03-16 17:13:22.067789586 +0000 UTC m=+6104.221721243" Mar 16 17:13:22 crc kubenswrapper[5120]: I0316 17:13:22.094846 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-6b57b99b96-6qzq2"] Mar 16 17:13:22 crc kubenswrapper[5120]: I0316 17:13:22.103811 5120 status_manager.go:895] "Failed to get status for pod" podUID="78897b1d-0d3f-4635-807d-3013a628ddfc" pod="openstack-kuttl-tests/keystone-bootstrap-lt5c7" err="pods \"keystone-bootstrap-lt5c7\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 17:13:22 crc kubenswrapper[5120]: I0316 17:13:22.112573 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-internal-api-0" podStartSLOduration=4.11254752 podStartE2EDuration="4.11254752s" podCreationTimestamp="2026-03-16 17:13:18 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:13:22.089175112 +0000 UTC m=+6104.243106789" watchObservedRunningTime="2026-03-16 17:13:22.11254752 +0000 UTC m=+6104.266479177" Mar 16 17:13:22 crc kubenswrapper[5120]: I0316 17:13:22.127391 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-75c7b8c84b-ckzdf"] Mar 16 17:13:22 crc kubenswrapper[5120]: I0316 17:13:22.135959 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-7dqr4"] Mar 16 17:13:22 crc kubenswrapper[5120]: I0316 17:13:22.137043 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78897b1d-0d3f-4635-807d-3013a628ddfc" containerName="keystone-bootstrap" Mar 16 17:13:22 crc kubenswrapper[5120]: I0316 17:13:22.137061 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="78897b1d-0d3f-4635-807d-3013a628ddfc" containerName="keystone-bootstrap" Mar 16 17:13:22 crc kubenswrapper[5120]: I0316 17:13:22.137263 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="78897b1d-0d3f-4635-807d-3013a628ddfc" containerName="keystone-bootstrap" Mar 16 17:13:22 crc kubenswrapper[5120]: I0316 17:13:22.152390 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-7dqr4"] Mar 16 17:13:22 crc kubenswrapper[5120]: I0316 17:13:22.152626 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-7dqr4" Mar 16 17:13:22 crc kubenswrapper[5120]: I0316 17:13:22.154369 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-scripts\"" Mar 16 17:13:22 crc kubenswrapper[5120]: I0316 17:13:22.154791 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"osp-secret\"" Mar 16 17:13:22 crc kubenswrapper[5120]: I0316 17:13:22.154928 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-config-data\"" Mar 16 17:13:22 crc kubenswrapper[5120]: I0316 17:13:22.155058 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-keystone-dockercfg-s57zl\"" Mar 16 17:13:22 crc kubenswrapper[5120]: I0316 17:13:22.155171 5120 status_manager.go:895] "Failed to get status for pod" podUID="78897b1d-0d3f-4635-807d-3013a628ddfc" pod="openstack-kuttl-tests/keystone-bootstrap-lt5c7" err="pods \"keystone-bootstrap-lt5c7\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 17:13:22 crc kubenswrapper[5120]: I0316 17:13:22.155287 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone\"" Mar 16 17:13:22 crc kubenswrapper[5120]: I0316 17:13:22.236057 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fd245417-d366-4c4b-814d-08860c23f880-combined-ca-bundle\") pod \"keystone-bootstrap-7dqr4\" (UID: \"fd245417-d366-4c4b-814d-08860c23f880\") " pod="openstack-kuttl-tests/keystone-bootstrap-7dqr4" Mar 16 17:13:22 crc kubenswrapper[5120]: I0316 17:13:22.236255 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/fd245417-d366-4c4b-814d-08860c23f880-fernet-keys\") pod \"keystone-bootstrap-7dqr4\" (UID: \"fd245417-d366-4c4b-814d-08860c23f880\") " pod="openstack-kuttl-tests/keystone-bootstrap-7dqr4" Mar 16 17:13:22 crc kubenswrapper[5120]: I0316 17:13:22.236285 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/fd245417-d366-4c4b-814d-08860c23f880-scripts\") pod \"keystone-bootstrap-7dqr4\" (UID: \"fd245417-d366-4c4b-814d-08860c23f880\") " pod="openstack-kuttl-tests/keystone-bootstrap-7dqr4" Mar 16 17:13:22 crc kubenswrapper[5120]: I0316 17:13:22.236305 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/fd245417-d366-4c4b-814d-08860c23f880-credential-keys\") pod \"keystone-bootstrap-7dqr4\" (UID: \"fd245417-d366-4c4b-814d-08860c23f880\") " pod="openstack-kuttl-tests/keystone-bootstrap-7dqr4" Mar 16 17:13:22 crc kubenswrapper[5120]: I0316 17:13:22.236327 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fd245417-d366-4c4b-814d-08860c23f880-config-data\") pod \"keystone-bootstrap-7dqr4\" (UID: \"fd245417-d366-4c4b-814d-08860c23f880\") " pod="openstack-kuttl-tests/keystone-bootstrap-7dqr4" Mar 16 17:13:22 crc kubenswrapper[5120]: I0316 17:13:22.236393 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snl79\" (UniqueName: \"kubernetes.io/projected/fd245417-d366-4c4b-814d-08860c23f880-kube-api-access-snl79\") pod \"keystone-bootstrap-7dqr4\" (UID: \"fd245417-d366-4c4b-814d-08860c23f880\") " pod="openstack-kuttl-tests/keystone-bootstrap-7dqr4" Mar 16 17:13:22 crc kubenswrapper[5120]: I0316 17:13:22.339168 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/fd245417-d366-4c4b-814d-08860c23f880-fernet-keys\") pod \"keystone-bootstrap-7dqr4\" (UID: \"fd245417-d366-4c4b-814d-08860c23f880\") " pod="openstack-kuttl-tests/keystone-bootstrap-7dqr4" Mar 16 17:13:22 crc kubenswrapper[5120]: I0316 17:13:22.339225 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/fd245417-d366-4c4b-814d-08860c23f880-scripts\") pod \"keystone-bootstrap-7dqr4\" (UID: \"fd245417-d366-4c4b-814d-08860c23f880\") " pod="openstack-kuttl-tests/keystone-bootstrap-7dqr4" Mar 16 17:13:22 crc kubenswrapper[5120]: I0316 17:13:22.339253 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/fd245417-d366-4c4b-814d-08860c23f880-credential-keys\") pod \"keystone-bootstrap-7dqr4\" (UID: \"fd245417-d366-4c4b-814d-08860c23f880\") " pod="openstack-kuttl-tests/keystone-bootstrap-7dqr4" Mar 16 17:13:22 crc kubenswrapper[5120]: I0316 17:13:22.339297 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fd245417-d366-4c4b-814d-08860c23f880-config-data\") pod \"keystone-bootstrap-7dqr4\" (UID: \"fd245417-d366-4c4b-814d-08860c23f880\") " pod="openstack-kuttl-tests/keystone-bootstrap-7dqr4" Mar 16 17:13:22 crc kubenswrapper[5120]: I0316 17:13:22.339398 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-snl79\" (UniqueName: \"kubernetes.io/projected/fd245417-d366-4c4b-814d-08860c23f880-kube-api-access-snl79\") pod \"keystone-bootstrap-7dqr4\" (UID: \"fd245417-d366-4c4b-814d-08860c23f880\") " pod="openstack-kuttl-tests/keystone-bootstrap-7dqr4" Mar 16 17:13:22 crc kubenswrapper[5120]: I0316 17:13:22.339846 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fd245417-d366-4c4b-814d-08860c23f880-combined-ca-bundle\") pod \"keystone-bootstrap-7dqr4\" (UID: \"fd245417-d366-4c4b-814d-08860c23f880\") " pod="openstack-kuttl-tests/keystone-bootstrap-7dqr4" Mar 16 17:13:22 crc kubenswrapper[5120]: I0316 17:13:22.345267 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/fd245417-d366-4c4b-814d-08860c23f880-credential-keys\") pod \"keystone-bootstrap-7dqr4\" (UID: \"fd245417-d366-4c4b-814d-08860c23f880\") " pod="openstack-kuttl-tests/keystone-bootstrap-7dqr4" Mar 16 17:13:22 crc kubenswrapper[5120]: I0316 17:13:22.345294 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/fd245417-d366-4c4b-814d-08860c23f880-scripts\") pod \"keystone-bootstrap-7dqr4\" (UID: \"fd245417-d366-4c4b-814d-08860c23f880\") " pod="openstack-kuttl-tests/keystone-bootstrap-7dqr4" Mar 16 17:13:22 crc kubenswrapper[5120]: I0316 17:13:22.345514 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fd245417-d366-4c4b-814d-08860c23f880-config-data\") pod \"keystone-bootstrap-7dqr4\" (UID: \"fd245417-d366-4c4b-814d-08860c23f880\") " pod="openstack-kuttl-tests/keystone-bootstrap-7dqr4" Mar 16 17:13:22 crc kubenswrapper[5120]: I0316 17:13:22.347229 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fd245417-d366-4c4b-814d-08860c23f880-combined-ca-bundle\") pod \"keystone-bootstrap-7dqr4\" (UID: \"fd245417-d366-4c4b-814d-08860c23f880\") " pod="openstack-kuttl-tests/keystone-bootstrap-7dqr4" Mar 16 17:13:22 crc kubenswrapper[5120]: I0316 17:13:22.352946 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/fd245417-d366-4c4b-814d-08860c23f880-fernet-keys\") pod \"keystone-bootstrap-7dqr4\" (UID: \"fd245417-d366-4c4b-814d-08860c23f880\") " pod="openstack-kuttl-tests/keystone-bootstrap-7dqr4" Mar 16 17:13:22 crc kubenswrapper[5120]: I0316 17:13:22.355349 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-snl79\" (UniqueName: \"kubernetes.io/projected/fd245417-d366-4c4b-814d-08860c23f880-kube-api-access-snl79\") pod \"keystone-bootstrap-7dqr4\" (UID: \"fd245417-d366-4c4b-814d-08860c23f880\") " pod="openstack-kuttl-tests/keystone-bootstrap-7dqr4" Mar 16 17:13:22 crc kubenswrapper[5120]: I0316 17:13:22.507734 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-7dqr4" Mar 16 17:13:22 crc kubenswrapper[5120]: I0316 17:13:22.685644 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="78897b1d-0d3f-4635-807d-3013a628ddfc" path="/var/lib/kubelet/pods/78897b1d-0d3f-4635-807d-3013a628ddfc/volumes" Mar 16 17:13:22 crc kubenswrapper[5120]: I0316 17:13:22.992866 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-7dqr4"] Mar 16 17:13:23 crc kubenswrapper[5120]: W0316 17:13:23.006682 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfd245417_d366_4c4b_814d_08860c23f880.slice/crio-61f05e8cb27db52e6356fb8a610f2e6bdafb8ce61483bc9deb701b7192127f69 WatchSource:0}: Error finding container 61f05e8cb27db52e6356fb8a610f2e6bdafb8ce61483bc9deb701b7192127f69: Status 404 returned error can't find the container with id 61f05e8cb27db52e6356fb8a610f2e6bdafb8ce61483bc9deb701b7192127f69 Mar 16 17:13:23 crc kubenswrapper[5120]: I0316 17:13:23.060601 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-7c959f78ff-5lv92" event={"ID":"1ae5285c-173c-4162-9610-3f9c3a4ef47b","Type":"ContainerStarted","Data":"294a45e764273363d5c21b3cadd1204356e4035b46b616bebe50cd478a038435"} Mar 16 17:13:23 crc kubenswrapper[5120]: I0316 17:13:23.060660 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-7c959f78ff-5lv92" event={"ID":"1ae5285c-173c-4162-9610-3f9c3a4ef47b","Type":"ContainerStarted","Data":"43c66043e906f70f9409ae93a14e15c6f5b22c5773198f562df0de0765be8326"} Mar 16 17:13:23 crc kubenswrapper[5120]: I0316 17:13:23.083312 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-worker-7c959f78ff-5lv92" podStartSLOduration=3.08329369 podStartE2EDuration="3.08329369s" podCreationTimestamp="2026-03-16 17:13:20 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:13:23.080176584 +0000 UTC m=+6105.234108251" watchObservedRunningTime="2026-03-16 17:13:23.08329369 +0000 UTC m=+6105.237225347" Mar 16 17:13:23 crc kubenswrapper[5120]: I0316 17:13:23.088454 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-6b57b99b96-6qzq2" event={"ID":"a9bb962d-330a-45a0-9bb0-09b134c425f5","Type":"ContainerStarted","Data":"2f6708333611c2d7bdd7b4ca94b08a184cdecc3f31c8b78dac891fa8efb9b0f3"} Mar 16 17:13:23 crc kubenswrapper[5120]: I0316 17:13:23.088547 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-6b57b99b96-6qzq2" event={"ID":"a9bb962d-330a-45a0-9bb0-09b134c425f5","Type":"ContainerStarted","Data":"2569aa75c70aca643652bd7b638e6bdabbab1b8e50c71792e0c8d61b43402474"} Mar 16 17:13:23 crc kubenswrapper[5120]: I0316 17:13:23.088568 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-6b57b99b96-6qzq2" event={"ID":"a9bb962d-330a-45a0-9bb0-09b134c425f5","Type":"ContainerStarted","Data":"2b59428e8ae0b29306b81c1c8271c1cbbbc0b50a99601f280f92bfce2d84e8e0"} Mar 16 17:13:23 crc kubenswrapper[5120]: I0316 17:13:23.088776 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-6b57b99b96-6qzq2" Mar 16 17:13:23 crc kubenswrapper[5120]: I0316 17:13:23.089424 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-6b57b99b96-6qzq2" Mar 16 17:13:23 crc kubenswrapper[5120]: I0316 17:13:23.096829 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"c977fa4c-2763-4ab0-8485-4a1a352be4ba","Type":"ContainerStarted","Data":"2b79273a58a77a92f773616e582f0045dd755cd4e4190c7b66f622825d0c44fe"} Mar 16 17:13:23 crc kubenswrapper[5120]: I0316 17:13:23.097111 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"c977fa4c-2763-4ab0-8485-4a1a352be4ba","Type":"ContainerStarted","Data":"a1ceb8dd748c8c52178f987c7b62681275ac116d9ea201bab52bfb1dc8096418"} Mar 16 17:13:23 crc kubenswrapper[5120]: I0316 17:13:23.098576 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-7dqr4" event={"ID":"fd245417-d366-4c4b-814d-08860c23f880","Type":"ContainerStarted","Data":"61f05e8cb27db52e6356fb8a610f2e6bdafb8ce61483bc9deb701b7192127f69"} Mar 16 17:13:23 crc kubenswrapper[5120]: I0316 17:13:23.101622 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-75c7b8c84b-ckzdf" event={"ID":"59a6de62-1f3e-48b3-b377-4a582f759b5b","Type":"ContainerStarted","Data":"baed72a6239409dd140c1260daff487672bacf7c3d16715b6e4af9d1ad0321a8"} Mar 16 17:13:23 crc kubenswrapper[5120]: I0316 17:13:23.101809 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-75c7b8c84b-ckzdf" event={"ID":"59a6de62-1f3e-48b3-b377-4a582f759b5b","Type":"ContainerStarted","Data":"9685938fad2613a5505b0b2539c08389dfeddd3eaefd68d93e1d3acf1eaa8047"} Mar 16 17:13:23 crc kubenswrapper[5120]: I0316 17:13:23.101894 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-75c7b8c84b-ckzdf" event={"ID":"59a6de62-1f3e-48b3-b377-4a582f759b5b","Type":"ContainerStarted","Data":"ff70c65256a60c336e8c5e3c5eb495d25d969b6ac4f09a24b197af843bfb2755"} Mar 16 17:13:23 crc kubenswrapper[5120]: I0316 17:13:23.127778 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-api-6b57b99b96-6qzq2" podStartSLOduration=2.127734565 podStartE2EDuration="2.127734565s" podCreationTimestamp="2026-03-16 17:13:21 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:13:23.1110765 +0000 UTC m=+6105.265008167" watchObservedRunningTime="2026-03-16 17:13:23.127734565 +0000 UTC m=+6105.281666232" Mar 16 17:13:23 crc kubenswrapper[5120]: I0316 17:13:23.140382 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-keystone-listener-75c7b8c84b-ckzdf" podStartSLOduration=2.140365031 podStartE2EDuration="2.140365031s" podCreationTimestamp="2026-03-16 17:13:21 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:13:23.138588942 +0000 UTC m=+6105.292520629" watchObservedRunningTime="2026-03-16 17:13:23.140365031 +0000 UTC m=+6105.294296688" Mar 16 17:13:24 crc kubenswrapper[5120]: I0316 17:13:24.116825 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"c977fa4c-2763-4ab0-8485-4a1a352be4ba","Type":"ContainerStarted","Data":"bac3a3f45e8e1926a12ebdfa9b7e4c91e3f6894466094c639d35c11a4e5e822c"} Mar 16 17:13:24 crc kubenswrapper[5120]: I0316 17:13:24.121504 5120 generic.go:358] "Generic (PLEG): container finished" podID="dd9b9ccd-51eb-4f86-864b-e19b9f40e043" containerID="75231ca2d85100c637728df7e1a3143c7285ad90c7ee8e87a5e29de664e2a0b9" exitCode=0 Mar 16 17:13:24 crc kubenswrapper[5120]: I0316 17:13:24.121599 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-fb5jp" event={"ID":"dd9b9ccd-51eb-4f86-864b-e19b9f40e043","Type":"ContainerDied","Data":"75231ca2d85100c637728df7e1a3143c7285ad90c7ee8e87a5e29de664e2a0b9"} Mar 16 17:13:24 crc kubenswrapper[5120]: I0316 17:13:24.123570 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-7dqr4" event={"ID":"fd245417-d366-4c4b-814d-08860c23f880","Type":"ContainerStarted","Data":"d6fb5db0545d3a192d7d97f43821fe460f21562edeb502a39499c7c3d66a82b0"} Mar 16 17:13:24 crc kubenswrapper[5120]: I0316 17:13:24.165461 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-bootstrap-7dqr4" podStartSLOduration=2.165440827 podStartE2EDuration="2.165440827s" podCreationTimestamp="2026-03-16 17:13:22 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:13:24.158897127 +0000 UTC m=+6106.312828774" watchObservedRunningTime="2026-03-16 17:13:24.165440827 +0000 UTC m=+6106.319372484" Mar 16 17:13:24 crc kubenswrapper[5120]: I0316 17:13:24.738754 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-api-67f6766cc8-lpvm7"] Mar 16 17:13:24 crc kubenswrapper[5120]: I0316 17:13:24.748672 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-67f6766cc8-lpvm7" Mar 16 17:13:24 crc kubenswrapper[5120]: I0316 17:13:24.750505 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-barbican-internal-svc\"" Mar 16 17:13:24 crc kubenswrapper[5120]: I0316 17:13:24.750628 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-barbican-public-svc\"" Mar 16 17:13:24 crc kubenswrapper[5120]: I0316 17:13:24.769371 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-67f6766cc8-lpvm7"] Mar 16 17:13:24 crc kubenswrapper[5120]: I0316 17:13:24.853150 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/24f83ac4-b285-47e8-94e0-9b47da8c5928-public-tls-certs\") pod \"barbican-api-67f6766cc8-lpvm7\" (UID: \"24f83ac4-b285-47e8-94e0-9b47da8c5928\") " pod="openstack-kuttl-tests/barbican-api-67f6766cc8-lpvm7" Mar 16 17:13:24 crc kubenswrapper[5120]: I0316 17:13:24.853387 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/24f83ac4-b285-47e8-94e0-9b47da8c5928-internal-tls-certs\") pod \"barbican-api-67f6766cc8-lpvm7\" (UID: \"24f83ac4-b285-47e8-94e0-9b47da8c5928\") " pod="openstack-kuttl-tests/barbican-api-67f6766cc8-lpvm7" Mar 16 17:13:24 crc kubenswrapper[5120]: I0316 17:13:24.853608 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/24f83ac4-b285-47e8-94e0-9b47da8c5928-logs\") pod \"barbican-api-67f6766cc8-lpvm7\" (UID: \"24f83ac4-b285-47e8-94e0-9b47da8c5928\") " pod="openstack-kuttl-tests/barbican-api-67f6766cc8-lpvm7" Mar 16 17:13:24 crc kubenswrapper[5120]: I0316 17:13:24.853678 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/24f83ac4-b285-47e8-94e0-9b47da8c5928-combined-ca-bundle\") pod \"barbican-api-67f6766cc8-lpvm7\" (UID: \"24f83ac4-b285-47e8-94e0-9b47da8c5928\") " pod="openstack-kuttl-tests/barbican-api-67f6766cc8-lpvm7" Mar 16 17:13:24 crc kubenswrapper[5120]: I0316 17:13:24.853918 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/24f83ac4-b285-47e8-94e0-9b47da8c5928-config-data-custom\") pod \"barbican-api-67f6766cc8-lpvm7\" (UID: \"24f83ac4-b285-47e8-94e0-9b47da8c5928\") " pod="openstack-kuttl-tests/barbican-api-67f6766cc8-lpvm7" Mar 16 17:13:24 crc kubenswrapper[5120]: I0316 17:13:24.854017 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/24f83ac4-b285-47e8-94e0-9b47da8c5928-config-data\") pod \"barbican-api-67f6766cc8-lpvm7\" (UID: \"24f83ac4-b285-47e8-94e0-9b47da8c5928\") " pod="openstack-kuttl-tests/barbican-api-67f6766cc8-lpvm7" Mar 16 17:13:24 crc kubenswrapper[5120]: I0316 17:13:24.854296 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzggx\" (UniqueName: \"kubernetes.io/projected/24f83ac4-b285-47e8-94e0-9b47da8c5928-kube-api-access-dzggx\") pod \"barbican-api-67f6766cc8-lpvm7\" (UID: \"24f83ac4-b285-47e8-94e0-9b47da8c5928\") " pod="openstack-kuttl-tests/barbican-api-67f6766cc8-lpvm7" Mar 16 17:13:24 crc kubenswrapper[5120]: I0316 17:13:24.956005 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/24f83ac4-b285-47e8-94e0-9b47da8c5928-combined-ca-bundle\") pod \"barbican-api-67f6766cc8-lpvm7\" (UID: \"24f83ac4-b285-47e8-94e0-9b47da8c5928\") " pod="openstack-kuttl-tests/barbican-api-67f6766cc8-lpvm7" Mar 16 17:13:24 crc kubenswrapper[5120]: I0316 17:13:24.956203 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/24f83ac4-b285-47e8-94e0-9b47da8c5928-config-data-custom\") pod \"barbican-api-67f6766cc8-lpvm7\" (UID: \"24f83ac4-b285-47e8-94e0-9b47da8c5928\") " pod="openstack-kuttl-tests/barbican-api-67f6766cc8-lpvm7" Mar 16 17:13:24 crc kubenswrapper[5120]: I0316 17:13:24.956290 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/24f83ac4-b285-47e8-94e0-9b47da8c5928-config-data\") pod \"barbican-api-67f6766cc8-lpvm7\" (UID: \"24f83ac4-b285-47e8-94e0-9b47da8c5928\") " pod="openstack-kuttl-tests/barbican-api-67f6766cc8-lpvm7" Mar 16 17:13:24 crc kubenswrapper[5120]: I0316 17:13:24.956383 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dzggx\" (UniqueName: \"kubernetes.io/projected/24f83ac4-b285-47e8-94e0-9b47da8c5928-kube-api-access-dzggx\") pod \"barbican-api-67f6766cc8-lpvm7\" (UID: \"24f83ac4-b285-47e8-94e0-9b47da8c5928\") " pod="openstack-kuttl-tests/barbican-api-67f6766cc8-lpvm7" Mar 16 17:13:24 crc kubenswrapper[5120]: I0316 17:13:24.956470 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/24f83ac4-b285-47e8-94e0-9b47da8c5928-public-tls-certs\") pod \"barbican-api-67f6766cc8-lpvm7\" (UID: \"24f83ac4-b285-47e8-94e0-9b47da8c5928\") " pod="openstack-kuttl-tests/barbican-api-67f6766cc8-lpvm7" Mar 16 17:13:24 crc kubenswrapper[5120]: I0316 17:13:24.956581 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/24f83ac4-b285-47e8-94e0-9b47da8c5928-internal-tls-certs\") pod \"barbican-api-67f6766cc8-lpvm7\" (UID: \"24f83ac4-b285-47e8-94e0-9b47da8c5928\") " pod="openstack-kuttl-tests/barbican-api-67f6766cc8-lpvm7" Mar 16 17:13:24 crc kubenswrapper[5120]: I0316 17:13:24.956745 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/24f83ac4-b285-47e8-94e0-9b47da8c5928-logs\") pod \"barbican-api-67f6766cc8-lpvm7\" (UID: \"24f83ac4-b285-47e8-94e0-9b47da8c5928\") " pod="openstack-kuttl-tests/barbican-api-67f6766cc8-lpvm7" Mar 16 17:13:24 crc kubenswrapper[5120]: I0316 17:13:24.957216 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/24f83ac4-b285-47e8-94e0-9b47da8c5928-logs\") pod \"barbican-api-67f6766cc8-lpvm7\" (UID: \"24f83ac4-b285-47e8-94e0-9b47da8c5928\") " pod="openstack-kuttl-tests/barbican-api-67f6766cc8-lpvm7" Mar 16 17:13:24 crc kubenswrapper[5120]: I0316 17:13:24.963645 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/24f83ac4-b285-47e8-94e0-9b47da8c5928-public-tls-certs\") pod \"barbican-api-67f6766cc8-lpvm7\" (UID: \"24f83ac4-b285-47e8-94e0-9b47da8c5928\") " pod="openstack-kuttl-tests/barbican-api-67f6766cc8-lpvm7" Mar 16 17:13:24 crc kubenswrapper[5120]: I0316 17:13:24.963680 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/24f83ac4-b285-47e8-94e0-9b47da8c5928-config-data-custom\") pod \"barbican-api-67f6766cc8-lpvm7\" (UID: \"24f83ac4-b285-47e8-94e0-9b47da8c5928\") " pod="openstack-kuttl-tests/barbican-api-67f6766cc8-lpvm7" Mar 16 17:13:24 crc kubenswrapper[5120]: I0316 17:13:24.964045 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/24f83ac4-b285-47e8-94e0-9b47da8c5928-internal-tls-certs\") pod \"barbican-api-67f6766cc8-lpvm7\" (UID: \"24f83ac4-b285-47e8-94e0-9b47da8c5928\") " pod="openstack-kuttl-tests/barbican-api-67f6766cc8-lpvm7" Mar 16 17:13:24 crc kubenswrapper[5120]: I0316 17:13:24.964539 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/24f83ac4-b285-47e8-94e0-9b47da8c5928-combined-ca-bundle\") pod \"barbican-api-67f6766cc8-lpvm7\" (UID: \"24f83ac4-b285-47e8-94e0-9b47da8c5928\") " pod="openstack-kuttl-tests/barbican-api-67f6766cc8-lpvm7" Mar 16 17:13:24 crc kubenswrapper[5120]: I0316 17:13:24.966525 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/24f83ac4-b285-47e8-94e0-9b47da8c5928-config-data\") pod \"barbican-api-67f6766cc8-lpvm7\" (UID: \"24f83ac4-b285-47e8-94e0-9b47da8c5928\") " pod="openstack-kuttl-tests/barbican-api-67f6766cc8-lpvm7" Mar 16 17:13:24 crc kubenswrapper[5120]: I0316 17:13:24.976155 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzggx\" (UniqueName: \"kubernetes.io/projected/24f83ac4-b285-47e8-94e0-9b47da8c5928-kube-api-access-dzggx\") pod \"barbican-api-67f6766cc8-lpvm7\" (UID: \"24f83ac4-b285-47e8-94e0-9b47da8c5928\") " pod="openstack-kuttl-tests/barbican-api-67f6766cc8-lpvm7" Mar 16 17:13:25 crc kubenswrapper[5120]: I0316 17:13:25.073515 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-67f6766cc8-lpvm7" Mar 16 17:13:25 crc kubenswrapper[5120]: I0316 17:13:25.560109 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-67f6766cc8-lpvm7"] Mar 16 17:13:25 crc kubenswrapper[5120]: I0316 17:13:25.561880 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-fb5jp" Mar 16 17:13:25 crc kubenswrapper[5120]: I0316 17:13:25.677013 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/dd9b9ccd-51eb-4f86-864b-e19b9f40e043-etc-machine-id\") pod \"dd9b9ccd-51eb-4f86-864b-e19b9f40e043\" (UID: \"dd9b9ccd-51eb-4f86-864b-e19b9f40e043\") " Mar 16 17:13:25 crc kubenswrapper[5120]: I0316 17:13:25.677098 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-scp82\" (UniqueName: \"kubernetes.io/projected/dd9b9ccd-51eb-4f86-864b-e19b9f40e043-kube-api-access-scp82\") pod \"dd9b9ccd-51eb-4f86-864b-e19b9f40e043\" (UID: \"dd9b9ccd-51eb-4f86-864b-e19b9f40e043\") " Mar 16 17:13:25 crc kubenswrapper[5120]: I0316 17:13:25.677167 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/dd9b9ccd-51eb-4f86-864b-e19b9f40e043-scripts\") pod \"dd9b9ccd-51eb-4f86-864b-e19b9f40e043\" (UID: \"dd9b9ccd-51eb-4f86-864b-e19b9f40e043\") " Mar 16 17:13:25 crc kubenswrapper[5120]: I0316 17:13:25.677198 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dd9b9ccd-51eb-4f86-864b-e19b9f40e043-config-data\") pod \"dd9b9ccd-51eb-4f86-864b-e19b9f40e043\" (UID: \"dd9b9ccd-51eb-4f86-864b-e19b9f40e043\") " Mar 16 17:13:25 crc kubenswrapper[5120]: I0316 17:13:25.677233 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/dd9b9ccd-51eb-4f86-864b-e19b9f40e043-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "dd9b9ccd-51eb-4f86-864b-e19b9f40e043" (UID: "dd9b9ccd-51eb-4f86-864b-e19b9f40e043"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 17:13:25 crc kubenswrapper[5120]: I0316 17:13:25.678308 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/dd9b9ccd-51eb-4f86-864b-e19b9f40e043-db-sync-config-data\") pod \"dd9b9ccd-51eb-4f86-864b-e19b9f40e043\" (UID: \"dd9b9ccd-51eb-4f86-864b-e19b9f40e043\") " Mar 16 17:13:25 crc kubenswrapper[5120]: I0316 17:13:25.679085 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dd9b9ccd-51eb-4f86-864b-e19b9f40e043-combined-ca-bundle\") pod \"dd9b9ccd-51eb-4f86-864b-e19b9f40e043\" (UID: \"dd9b9ccd-51eb-4f86-864b-e19b9f40e043\") " Mar 16 17:13:25 crc kubenswrapper[5120]: I0316 17:13:25.683190 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd9b9ccd-51eb-4f86-864b-e19b9f40e043-kube-api-access-scp82" (OuterVolumeSpecName: "kube-api-access-scp82") pod "dd9b9ccd-51eb-4f86-864b-e19b9f40e043" (UID: "dd9b9ccd-51eb-4f86-864b-e19b9f40e043"). InnerVolumeSpecName "kube-api-access-scp82". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:13:25 crc kubenswrapper[5120]: I0316 17:13:25.683293 5120 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/dd9b9ccd-51eb-4f86-864b-e19b9f40e043-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 17:13:25 crc kubenswrapper[5120]: I0316 17:13:25.686655 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd9b9ccd-51eb-4f86-864b-e19b9f40e043-scripts" (OuterVolumeSpecName: "scripts") pod "dd9b9ccd-51eb-4f86-864b-e19b9f40e043" (UID: "dd9b9ccd-51eb-4f86-864b-e19b9f40e043"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:13:25 crc kubenswrapper[5120]: I0316 17:13:25.686926 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd9b9ccd-51eb-4f86-864b-e19b9f40e043-db-sync-config-data" (OuterVolumeSpecName: "db-sync-config-data") pod "dd9b9ccd-51eb-4f86-864b-e19b9f40e043" (UID: "dd9b9ccd-51eb-4f86-864b-e19b9f40e043"). InnerVolumeSpecName "db-sync-config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:13:25 crc kubenswrapper[5120]: I0316 17:13:25.712541 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd9b9ccd-51eb-4f86-864b-e19b9f40e043-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "dd9b9ccd-51eb-4f86-864b-e19b9f40e043" (UID: "dd9b9ccd-51eb-4f86-864b-e19b9f40e043"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:13:25 crc kubenswrapper[5120]: I0316 17:13:25.741726 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd9b9ccd-51eb-4f86-864b-e19b9f40e043-config-data" (OuterVolumeSpecName: "config-data") pod "dd9b9ccd-51eb-4f86-864b-e19b9f40e043" (UID: "dd9b9ccd-51eb-4f86-864b-e19b9f40e043"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:13:25 crc kubenswrapper[5120]: I0316 17:13:25.786133 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-scp82\" (UniqueName: \"kubernetes.io/projected/dd9b9ccd-51eb-4f86-864b-e19b9f40e043-kube-api-access-scp82\") on node \"crc\" DevicePath \"\"" Mar 16 17:13:25 crc kubenswrapper[5120]: I0316 17:13:25.786168 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/dd9b9ccd-51eb-4f86-864b-e19b9f40e043-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:13:25 crc kubenswrapper[5120]: I0316 17:13:25.786180 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dd9b9ccd-51eb-4f86-864b-e19b9f40e043-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:13:25 crc kubenswrapper[5120]: I0316 17:13:25.786190 5120 reconciler_common.go:299] "Volume detached for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/dd9b9ccd-51eb-4f86-864b-e19b9f40e043-db-sync-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:13:25 crc kubenswrapper[5120]: I0316 17:13:25.786200 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dd9b9ccd-51eb-4f86-864b-e19b9f40e043-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:13:26 crc kubenswrapper[5120]: I0316 17:13:26.153350 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"c977fa4c-2763-4ab0-8485-4a1a352be4ba","Type":"ContainerStarted","Data":"0e7dcc83886e7b4d4c3871eefcb6ec5dc38fcd307a14b3a4b098bf28b024754b"} Mar 16 17:13:26 crc kubenswrapper[5120]: I0316 17:13:26.153874 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:13:26 crc kubenswrapper[5120]: I0316 17:13:26.156953 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-fb5jp" Mar 16 17:13:26 crc kubenswrapper[5120]: I0316 17:13:26.157218 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-fb5jp" event={"ID":"dd9b9ccd-51eb-4f86-864b-e19b9f40e043","Type":"ContainerDied","Data":"32204eeb43939d7de1c9cac479292d9f663fa570a37802f0d6e8a1e67665f7bd"} Mar 16 17:13:26 crc kubenswrapper[5120]: I0316 17:13:26.157273 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="32204eeb43939d7de1c9cac479292d9f663fa570a37802f0d6e8a1e67665f7bd" Mar 16 17:13:26 crc kubenswrapper[5120]: I0316 17:13:26.160067 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-67f6766cc8-lpvm7" event={"ID":"24f83ac4-b285-47e8-94e0-9b47da8c5928","Type":"ContainerStarted","Data":"a5c5a79296326184b8165b774fab8b1a1e69e2ec576ffafb6d5a426e531e7910"} Mar 16 17:13:26 crc kubenswrapper[5120]: I0316 17:13:26.160106 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-67f6766cc8-lpvm7" event={"ID":"24f83ac4-b285-47e8-94e0-9b47da8c5928","Type":"ContainerStarted","Data":"3edc568db612fad0b01bc312a6630be1d7ff70d8485d636c8539653e799955c5"} Mar 16 17:13:26 crc kubenswrapper[5120]: I0316 17:13:26.160120 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-67f6766cc8-lpvm7" event={"ID":"24f83ac4-b285-47e8-94e0-9b47da8c5928","Type":"ContainerStarted","Data":"c9fff68f6735308dfd796c0693f89511bf0e80400cb56bab4dcbae4277b51e02"} Mar 16 17:13:26 crc kubenswrapper[5120]: I0316 17:13:26.160273 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-67f6766cc8-lpvm7" Mar 16 17:13:26 crc kubenswrapper[5120]: I0316 17:13:26.160313 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-67f6766cc8-lpvm7" Mar 16 17:13:26 crc kubenswrapper[5120]: I0316 17:13:26.226267 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=1.995932191 podStartE2EDuration="6.226241738s" podCreationTimestamp="2026-03-16 17:13:20 +0000 UTC" firstStartedPulling="2026-03-16 17:13:21.187697378 +0000 UTC m=+6103.341629035" lastFinishedPulling="2026-03-16 17:13:25.418006925 +0000 UTC m=+6107.571938582" observedRunningTime="2026-03-16 17:13:26.19488122 +0000 UTC m=+6108.348812877" watchObservedRunningTime="2026-03-16 17:13:26.226241738 +0000 UTC m=+6108.380173395" Mar 16 17:13:26 crc kubenswrapper[5120]: I0316 17:13:26.231576 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-api-67f6766cc8-lpvm7" podStartSLOduration=2.231554093 podStartE2EDuration="2.231554093s" podCreationTimestamp="2026-03-16 17:13:24 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:13:26.22192284 +0000 UTC m=+6108.375854507" watchObservedRunningTime="2026-03-16 17:13:26.231554093 +0000 UTC m=+6108.385485750" Mar 16 17:13:26 crc kubenswrapper[5120]: I0316 17:13:26.416121 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 17:13:26 crc kubenswrapper[5120]: I0316 17:13:26.421676 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd9b9ccd-51eb-4f86-864b-e19b9f40e043" containerName="cinder-db-sync" Mar 16 17:13:26 crc kubenswrapper[5120]: I0316 17:13:26.421713 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd9b9ccd-51eb-4f86-864b-e19b9f40e043" containerName="cinder-db-sync" Mar 16 17:13:26 crc kubenswrapper[5120]: I0316 17:13:26.421951 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="dd9b9ccd-51eb-4f86-864b-e19b9f40e043" containerName="cinder-db-sync" Mar 16 17:13:26 crc kubenswrapper[5120]: I0316 17:13:26.425706 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:13:26 crc kubenswrapper[5120]: I0316 17:13:26.429776 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-scheduler-config-data\"" Mar 16 17:13:26 crc kubenswrapper[5120]: I0316 17:13:26.430189 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-scripts\"" Mar 16 17:13:26 crc kubenswrapper[5120]: I0316 17:13:26.430695 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-config-data\"" Mar 16 17:13:26 crc kubenswrapper[5120]: I0316 17:13:26.431875 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-cinder-dockercfg-sv6d7\"" Mar 16 17:13:26 crc kubenswrapper[5120]: I0316 17:13:26.466751 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 17:13:26 crc kubenswrapper[5120]: I0316 17:13:26.516995 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/eb3d95a7-f6af-46bc-a343-959b4a348c8e-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"eb3d95a7-f6af-46bc-a343-959b4a348c8e\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:13:26 crc kubenswrapper[5120]: I0316 17:13:26.517063 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5p7h\" (UniqueName: \"kubernetes.io/projected/eb3d95a7-f6af-46bc-a343-959b4a348c8e-kube-api-access-n5p7h\") pod \"cinder-scheduler-0\" (UID: \"eb3d95a7-f6af-46bc-a343-959b4a348c8e\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:13:26 crc kubenswrapper[5120]: I0316 17:13:26.517132 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/eb3d95a7-f6af-46bc-a343-959b4a348c8e-scripts\") pod \"cinder-scheduler-0\" (UID: \"eb3d95a7-f6af-46bc-a343-959b4a348c8e\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:13:26 crc kubenswrapper[5120]: I0316 17:13:26.517202 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/eb3d95a7-f6af-46bc-a343-959b4a348c8e-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"eb3d95a7-f6af-46bc-a343-959b4a348c8e\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:13:26 crc kubenswrapper[5120]: I0316 17:13:26.517359 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/eb3d95a7-f6af-46bc-a343-959b4a348c8e-config-data\") pod \"cinder-scheduler-0\" (UID: \"eb3d95a7-f6af-46bc-a343-959b4a348c8e\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:13:26 crc kubenswrapper[5120]: I0316 17:13:26.517396 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eb3d95a7-f6af-46bc-a343-959b4a348c8e-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"eb3d95a7-f6af-46bc-a343-959b4a348c8e\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:13:26 crc kubenswrapper[5120]: I0316 17:13:26.531356 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 17:13:26 crc kubenswrapper[5120]: I0316 17:13:26.537326 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:13:26 crc kubenswrapper[5120]: I0316 17:13:26.552024 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-api-config-data\"" Mar 16 17:13:26 crc kubenswrapper[5120]: I0316 17:13:26.556383 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 17:13:26 crc kubenswrapper[5120]: I0316 17:13:26.618953 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ca23d8a6-614a-40fd-97ab-7e719c0e62ca-scripts\") pod \"cinder-api-0\" (UID: \"ca23d8a6-614a-40fd-97ab-7e719c0e62ca\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:13:26 crc kubenswrapper[5120]: I0316 17:13:26.619004 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n5p7h\" (UniqueName: \"kubernetes.io/projected/eb3d95a7-f6af-46bc-a343-959b4a348c8e-kube-api-access-n5p7h\") pod \"cinder-scheduler-0\" (UID: \"eb3d95a7-f6af-46bc-a343-959b4a348c8e\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:13:26 crc kubenswrapper[5120]: I0316 17:13:26.619072 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/eb3d95a7-f6af-46bc-a343-959b4a348c8e-scripts\") pod \"cinder-scheduler-0\" (UID: \"eb3d95a7-f6af-46bc-a343-959b4a348c8e\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:13:26 crc kubenswrapper[5120]: I0316 17:13:26.619131 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/ca23d8a6-614a-40fd-97ab-7e719c0e62ca-config-data-custom\") pod \"cinder-api-0\" (UID: \"ca23d8a6-614a-40fd-97ab-7e719c0e62ca\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:13:26 crc kubenswrapper[5120]: I0316 17:13:26.619156 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/eb3d95a7-f6af-46bc-a343-959b4a348c8e-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"eb3d95a7-f6af-46bc-a343-959b4a348c8e\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:13:26 crc kubenswrapper[5120]: I0316 17:13:26.619221 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vzr4\" (UniqueName: \"kubernetes.io/projected/ca23d8a6-614a-40fd-97ab-7e719c0e62ca-kube-api-access-2vzr4\") pod \"cinder-api-0\" (UID: \"ca23d8a6-614a-40fd-97ab-7e719c0e62ca\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:13:26 crc kubenswrapper[5120]: I0316 17:13:26.619302 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ca23d8a6-614a-40fd-97ab-7e719c0e62ca-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"ca23d8a6-614a-40fd-97ab-7e719c0e62ca\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:13:26 crc kubenswrapper[5120]: I0316 17:13:26.619347 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/eb3d95a7-f6af-46bc-a343-959b4a348c8e-config-data\") pod \"cinder-scheduler-0\" (UID: \"eb3d95a7-f6af-46bc-a343-959b4a348c8e\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:13:26 crc kubenswrapper[5120]: I0316 17:13:26.619384 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eb3d95a7-f6af-46bc-a343-959b4a348c8e-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"eb3d95a7-f6af-46bc-a343-959b4a348c8e\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:13:26 crc kubenswrapper[5120]: I0316 17:13:26.619402 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ca23d8a6-614a-40fd-97ab-7e719c0e62ca-logs\") pod \"cinder-api-0\" (UID: \"ca23d8a6-614a-40fd-97ab-7e719c0e62ca\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:13:26 crc kubenswrapper[5120]: I0316 17:13:26.619427 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/ca23d8a6-614a-40fd-97ab-7e719c0e62ca-etc-machine-id\") pod \"cinder-api-0\" (UID: \"ca23d8a6-614a-40fd-97ab-7e719c0e62ca\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:13:26 crc kubenswrapper[5120]: I0316 17:13:26.619568 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/eb3d95a7-f6af-46bc-a343-959b4a348c8e-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"eb3d95a7-f6af-46bc-a343-959b4a348c8e\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:13:26 crc kubenswrapper[5120]: I0316 17:13:26.619595 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ca23d8a6-614a-40fd-97ab-7e719c0e62ca-config-data\") pod \"cinder-api-0\" (UID: \"ca23d8a6-614a-40fd-97ab-7e719c0e62ca\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:13:26 crc kubenswrapper[5120]: I0316 17:13:26.625091 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/eb3d95a7-f6af-46bc-a343-959b4a348c8e-scripts\") pod \"cinder-scheduler-0\" (UID: \"eb3d95a7-f6af-46bc-a343-959b4a348c8e\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:13:26 crc kubenswrapper[5120]: I0316 17:13:26.626864 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/eb3d95a7-f6af-46bc-a343-959b4a348c8e-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"eb3d95a7-f6af-46bc-a343-959b4a348c8e\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:13:26 crc kubenswrapper[5120]: I0316 17:13:26.627745 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/eb3d95a7-f6af-46bc-a343-959b4a348c8e-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"eb3d95a7-f6af-46bc-a343-959b4a348c8e\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:13:26 crc kubenswrapper[5120]: I0316 17:13:26.628184 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/eb3d95a7-f6af-46bc-a343-959b4a348c8e-config-data\") pod \"cinder-scheduler-0\" (UID: \"eb3d95a7-f6af-46bc-a343-959b4a348c8e\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:13:26 crc kubenswrapper[5120]: I0316 17:13:26.637426 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eb3d95a7-f6af-46bc-a343-959b4a348c8e-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"eb3d95a7-f6af-46bc-a343-959b4a348c8e\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:13:26 crc kubenswrapper[5120]: I0316 17:13:26.639899 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5p7h\" (UniqueName: \"kubernetes.io/projected/eb3d95a7-f6af-46bc-a343-959b4a348c8e-kube-api-access-n5p7h\") pod \"cinder-scheduler-0\" (UID: \"eb3d95a7-f6af-46bc-a343-959b4a348c8e\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:13:26 crc kubenswrapper[5120]: I0316 17:13:26.724279 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ca23d8a6-614a-40fd-97ab-7e719c0e62ca-config-data\") pod \"cinder-api-0\" (UID: \"ca23d8a6-614a-40fd-97ab-7e719c0e62ca\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:13:26 crc kubenswrapper[5120]: I0316 17:13:26.724364 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ca23d8a6-614a-40fd-97ab-7e719c0e62ca-scripts\") pod \"cinder-api-0\" (UID: \"ca23d8a6-614a-40fd-97ab-7e719c0e62ca\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:13:26 crc kubenswrapper[5120]: I0316 17:13:26.724604 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/ca23d8a6-614a-40fd-97ab-7e719c0e62ca-config-data-custom\") pod \"cinder-api-0\" (UID: \"ca23d8a6-614a-40fd-97ab-7e719c0e62ca\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:13:26 crc kubenswrapper[5120]: I0316 17:13:26.724965 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2vzr4\" (UniqueName: \"kubernetes.io/projected/ca23d8a6-614a-40fd-97ab-7e719c0e62ca-kube-api-access-2vzr4\") pod \"cinder-api-0\" (UID: \"ca23d8a6-614a-40fd-97ab-7e719c0e62ca\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:13:26 crc kubenswrapper[5120]: I0316 17:13:26.725146 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ca23d8a6-614a-40fd-97ab-7e719c0e62ca-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"ca23d8a6-614a-40fd-97ab-7e719c0e62ca\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:13:26 crc kubenswrapper[5120]: I0316 17:13:26.725287 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ca23d8a6-614a-40fd-97ab-7e719c0e62ca-logs\") pod \"cinder-api-0\" (UID: \"ca23d8a6-614a-40fd-97ab-7e719c0e62ca\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:13:26 crc kubenswrapper[5120]: I0316 17:13:26.725330 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/ca23d8a6-614a-40fd-97ab-7e719c0e62ca-etc-machine-id\") pod \"cinder-api-0\" (UID: \"ca23d8a6-614a-40fd-97ab-7e719c0e62ca\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:13:26 crc kubenswrapper[5120]: I0316 17:13:26.725974 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ca23d8a6-614a-40fd-97ab-7e719c0e62ca-logs\") pod \"cinder-api-0\" (UID: \"ca23d8a6-614a-40fd-97ab-7e719c0e62ca\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:13:26 crc kubenswrapper[5120]: I0316 17:13:26.726024 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/ca23d8a6-614a-40fd-97ab-7e719c0e62ca-etc-machine-id\") pod \"cinder-api-0\" (UID: \"ca23d8a6-614a-40fd-97ab-7e719c0e62ca\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:13:26 crc kubenswrapper[5120]: I0316 17:13:26.730867 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/ca23d8a6-614a-40fd-97ab-7e719c0e62ca-config-data-custom\") pod \"cinder-api-0\" (UID: \"ca23d8a6-614a-40fd-97ab-7e719c0e62ca\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:13:26 crc kubenswrapper[5120]: I0316 17:13:26.730991 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ca23d8a6-614a-40fd-97ab-7e719c0e62ca-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"ca23d8a6-614a-40fd-97ab-7e719c0e62ca\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:13:26 crc kubenswrapper[5120]: I0316 17:13:26.731331 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ca23d8a6-614a-40fd-97ab-7e719c0e62ca-scripts\") pod \"cinder-api-0\" (UID: \"ca23d8a6-614a-40fd-97ab-7e719c0e62ca\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:13:26 crc kubenswrapper[5120]: I0316 17:13:26.731538 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ca23d8a6-614a-40fd-97ab-7e719c0e62ca-config-data\") pod \"cinder-api-0\" (UID: \"ca23d8a6-614a-40fd-97ab-7e719c0e62ca\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:13:26 crc kubenswrapper[5120]: I0316 17:13:26.760282 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:13:26 crc kubenswrapper[5120]: I0316 17:13:26.781668 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vzr4\" (UniqueName: \"kubernetes.io/projected/ca23d8a6-614a-40fd-97ab-7e719c0e62ca-kube-api-access-2vzr4\") pod \"cinder-api-0\" (UID: \"ca23d8a6-614a-40fd-97ab-7e719c0e62ca\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:13:26 crc kubenswrapper[5120]: I0316 17:13:26.876282 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:13:27 crc kubenswrapper[5120]: I0316 17:13:27.059546 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 17:13:27 crc kubenswrapper[5120]: I0316 17:13:27.170724 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"eb3d95a7-f6af-46bc-a343-959b4a348c8e","Type":"ContainerStarted","Data":"0f440fa1e5f574b2fc25fc575c80bc91418c7afa153263bbc5f887408ef13987"} Mar 16 17:13:27 crc kubenswrapper[5120]: I0316 17:13:27.173454 5120 generic.go:358] "Generic (PLEG): container finished" podID="fd245417-d366-4c4b-814d-08860c23f880" containerID="d6fb5db0545d3a192d7d97f43821fe460f21562edeb502a39499c7c3d66a82b0" exitCode=0 Mar 16 17:13:27 crc kubenswrapper[5120]: I0316 17:13:27.174869 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-7dqr4" event={"ID":"fd245417-d366-4c4b-814d-08860c23f880","Type":"ContainerDied","Data":"d6fb5db0545d3a192d7d97f43821fe460f21562edeb502a39499c7c3d66a82b0"} Mar 16 17:13:27 crc kubenswrapper[5120]: I0316 17:13:27.430979 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 17:13:28 crc kubenswrapper[5120]: I0316 17:13:28.221993 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"eb3d95a7-f6af-46bc-a343-959b4a348c8e","Type":"ContainerStarted","Data":"d5e28dd72ea37fb2433469185534c4d71e392b29110df6cf8da1aa8e148a6deb"} Mar 16 17:13:28 crc kubenswrapper[5120]: I0316 17:13:28.225671 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"ca23d8a6-614a-40fd-97ab-7e719c0e62ca","Type":"ContainerStarted","Data":"24bc80bb2482c5bab93b39ea50dc976ed94a7f91c18be3c899525e6d314cd271"} Mar 16 17:13:28 crc kubenswrapper[5120]: I0316 17:13:28.273587 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 17:13:28 crc kubenswrapper[5120]: I0316 17:13:28.632420 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-7dqr4" Mar 16 17:13:28 crc kubenswrapper[5120]: I0316 17:13:28.688134 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fd245417-d366-4c4b-814d-08860c23f880-config-data\") pod \"fd245417-d366-4c4b-814d-08860c23f880\" (UID: \"fd245417-d366-4c4b-814d-08860c23f880\") " Mar 16 17:13:28 crc kubenswrapper[5120]: I0316 17:13:28.688299 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fd245417-d366-4c4b-814d-08860c23f880-combined-ca-bundle\") pod \"fd245417-d366-4c4b-814d-08860c23f880\" (UID: \"fd245417-d366-4c4b-814d-08860c23f880\") " Mar 16 17:13:28 crc kubenswrapper[5120]: I0316 17:13:28.688504 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/fd245417-d366-4c4b-814d-08860c23f880-scripts\") pod \"fd245417-d366-4c4b-814d-08860c23f880\" (UID: \"fd245417-d366-4c4b-814d-08860c23f880\") " Mar 16 17:13:28 crc kubenswrapper[5120]: I0316 17:13:28.688560 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/fd245417-d366-4c4b-814d-08860c23f880-fernet-keys\") pod \"fd245417-d366-4c4b-814d-08860c23f880\" (UID: \"fd245417-d366-4c4b-814d-08860c23f880\") " Mar 16 17:13:28 crc kubenswrapper[5120]: I0316 17:13:28.689405 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/fd245417-d366-4c4b-814d-08860c23f880-credential-keys\") pod \"fd245417-d366-4c4b-814d-08860c23f880\" (UID: \"fd245417-d366-4c4b-814d-08860c23f880\") " Mar 16 17:13:28 crc kubenswrapper[5120]: I0316 17:13:28.689671 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-snl79\" (UniqueName: \"kubernetes.io/projected/fd245417-d366-4c4b-814d-08860c23f880-kube-api-access-snl79\") pod \"fd245417-d366-4c4b-814d-08860c23f880\" (UID: \"fd245417-d366-4c4b-814d-08860c23f880\") " Mar 16 17:13:28 crc kubenswrapper[5120]: I0316 17:13:28.696951 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd245417-d366-4c4b-814d-08860c23f880-kube-api-access-snl79" (OuterVolumeSpecName: "kube-api-access-snl79") pod "fd245417-d366-4c4b-814d-08860c23f880" (UID: "fd245417-d366-4c4b-814d-08860c23f880"). InnerVolumeSpecName "kube-api-access-snl79". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:13:28 crc kubenswrapper[5120]: I0316 17:13:28.697789 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fd245417-d366-4c4b-814d-08860c23f880-scripts" (OuterVolumeSpecName: "scripts") pod "fd245417-d366-4c4b-814d-08860c23f880" (UID: "fd245417-d366-4c4b-814d-08860c23f880"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:13:28 crc kubenswrapper[5120]: I0316 17:13:28.698910 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fd245417-d366-4c4b-814d-08860c23f880-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "fd245417-d366-4c4b-814d-08860c23f880" (UID: "fd245417-d366-4c4b-814d-08860c23f880"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:13:28 crc kubenswrapper[5120]: I0316 17:13:28.698928 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fd245417-d366-4c4b-814d-08860c23f880-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "fd245417-d366-4c4b-814d-08860c23f880" (UID: "fd245417-d366-4c4b-814d-08860c23f880"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:13:28 crc kubenswrapper[5120]: I0316 17:13:28.732687 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fd245417-d366-4c4b-814d-08860c23f880-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "fd245417-d366-4c4b-814d-08860c23f880" (UID: "fd245417-d366-4c4b-814d-08860c23f880"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:13:28 crc kubenswrapper[5120]: I0316 17:13:28.735147 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fd245417-d366-4c4b-814d-08860c23f880-config-data" (OuterVolumeSpecName: "config-data") pod "fd245417-d366-4c4b-814d-08860c23f880" (UID: "fd245417-d366-4c4b-814d-08860c23f880"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:13:28 crc kubenswrapper[5120]: I0316 17:13:28.793650 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fd245417-d366-4c4b-814d-08860c23f880-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:13:28 crc kubenswrapper[5120]: I0316 17:13:28.793688 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fd245417-d366-4c4b-814d-08860c23f880-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:13:28 crc kubenswrapper[5120]: I0316 17:13:28.793698 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/fd245417-d366-4c4b-814d-08860c23f880-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:13:28 crc kubenswrapper[5120]: I0316 17:13:28.793706 5120 reconciler_common.go:299] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/fd245417-d366-4c4b-814d-08860c23f880-fernet-keys\") on node \"crc\" DevicePath \"\"" Mar 16 17:13:28 crc kubenswrapper[5120]: I0316 17:13:28.793717 5120 reconciler_common.go:299] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/fd245417-d366-4c4b-814d-08860c23f880-credential-keys\") on node \"crc\" DevicePath \"\"" Mar 16 17:13:28 crc kubenswrapper[5120]: I0316 17:13:28.793726 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-snl79\" (UniqueName: \"kubernetes.io/projected/fd245417-d366-4c4b-814d-08860c23f880-kube-api-access-snl79\") on node \"crc\" DevicePath \"\"" Mar 16 17:13:28 crc kubenswrapper[5120]: I0316 17:13:28.810677 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:13:28 crc kubenswrapper[5120]: I0316 17:13:28.810738 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:13:28 crc kubenswrapper[5120]: I0316 17:13:28.826819 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:13:28 crc kubenswrapper[5120]: I0316 17:13:28.826875 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:13:28 crc kubenswrapper[5120]: I0316 17:13:28.875281 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:13:28 crc kubenswrapper[5120]: I0316 17:13:28.879628 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:13:28 crc kubenswrapper[5120]: I0316 17:13:28.880331 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:13:28 crc kubenswrapper[5120]: I0316 17:13:28.914998 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:13:29 crc kubenswrapper[5120]: I0316 17:13:29.248929 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"eb3d95a7-f6af-46bc-a343-959b4a348c8e","Type":"ContainerStarted","Data":"3ee553c64803dc362cb962dfc738d60a7745b099dca56113882d251bfa601e39"} Mar 16 17:13:29 crc kubenswrapper[5120]: I0316 17:13:29.263137 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-7dqr4" event={"ID":"fd245417-d366-4c4b-814d-08860c23f880","Type":"ContainerDied","Data":"61f05e8cb27db52e6356fb8a610f2e6bdafb8ce61483bc9deb701b7192127f69"} Mar 16 17:13:29 crc kubenswrapper[5120]: I0316 17:13:29.263190 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="61f05e8cb27db52e6356fb8a610f2e6bdafb8ce61483bc9deb701b7192127f69" Mar 16 17:13:29 crc kubenswrapper[5120]: I0316 17:13:29.263284 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-7dqr4" Mar 16 17:13:29 crc kubenswrapper[5120]: I0316 17:13:29.272868 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-scheduler-0" podStartSLOduration=3.272854191 podStartE2EDuration="3.272854191s" podCreationTimestamp="2026-03-16 17:13:26 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:13:29.272348018 +0000 UTC m=+6111.426279685" watchObservedRunningTime="2026-03-16 17:13:29.272854191 +0000 UTC m=+6111.426785848" Mar 16 17:13:29 crc kubenswrapper[5120]: I0316 17:13:29.292027 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"ca23d8a6-614a-40fd-97ab-7e719c0e62ca","Type":"ContainerStarted","Data":"b6c231778dd15aebed9fb870e796cb89b77d2ff3169e003abcd34bdc5db41f23"} Mar 16 17:13:29 crc kubenswrapper[5120]: I0316 17:13:29.293332 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:13:29 crc kubenswrapper[5120]: I0316 17:13:29.293563 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:13:29 crc kubenswrapper[5120]: I0316 17:13:29.293728 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:13:29 crc kubenswrapper[5120]: I0316 17:13:29.294014 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:13:29 crc kubenswrapper[5120]: I0316 17:13:29.326771 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-77d7b5cd69-lf8gf"] Mar 16 17:13:29 crc kubenswrapper[5120]: I0316 17:13:29.328020 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd245417-d366-4c4b-814d-08860c23f880" containerName="keystone-bootstrap" Mar 16 17:13:29 crc kubenswrapper[5120]: I0316 17:13:29.328040 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd245417-d366-4c4b-814d-08860c23f880" containerName="keystone-bootstrap" Mar 16 17:13:29 crc kubenswrapper[5120]: I0316 17:13:29.328330 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="fd245417-d366-4c4b-814d-08860c23f880" containerName="keystone-bootstrap" Mar 16 17:13:29 crc kubenswrapper[5120]: I0316 17:13:29.357405 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-77d7b5cd69-lf8gf" Mar 16 17:13:29 crc kubenswrapper[5120]: I0316 17:13:29.361125 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone\"" Mar 16 17:13:29 crc kubenswrapper[5120]: I0316 17:13:29.361691 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-keystone-dockercfg-s57zl\"" Mar 16 17:13:29 crc kubenswrapper[5120]: I0316 17:13:29.361865 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-config-data\"" Mar 16 17:13:29 crc kubenswrapper[5120]: I0316 17:13:29.361984 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-keystone-internal-svc\"" Mar 16 17:13:29 crc kubenswrapper[5120]: I0316 17:13:29.362270 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-keystone-public-svc\"" Mar 16 17:13:29 crc kubenswrapper[5120]: I0316 17:13:29.371181 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-scripts\"" Mar 16 17:13:29 crc kubenswrapper[5120]: I0316 17:13:29.381827 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-77d7b5cd69-lf8gf"] Mar 16 17:13:29 crc kubenswrapper[5120]: I0316 17:13:29.436294 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/3b01ec67-66ba-469f-9eba-1df99165b135-public-tls-certs\") pod \"keystone-77d7b5cd69-lf8gf\" (UID: \"3b01ec67-66ba-469f-9eba-1df99165b135\") " pod="openstack-kuttl-tests/keystone-77d7b5cd69-lf8gf" Mar 16 17:13:29 crc kubenswrapper[5120]: I0316 17:13:29.436472 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3b01ec67-66ba-469f-9eba-1df99165b135-scripts\") pod \"keystone-77d7b5cd69-lf8gf\" (UID: \"3b01ec67-66ba-469f-9eba-1df99165b135\") " pod="openstack-kuttl-tests/keystone-77d7b5cd69-lf8gf" Mar 16 17:13:29 crc kubenswrapper[5120]: I0316 17:13:29.436655 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9wlc\" (UniqueName: \"kubernetes.io/projected/3b01ec67-66ba-469f-9eba-1df99165b135-kube-api-access-h9wlc\") pod \"keystone-77d7b5cd69-lf8gf\" (UID: \"3b01ec67-66ba-469f-9eba-1df99165b135\") " pod="openstack-kuttl-tests/keystone-77d7b5cd69-lf8gf" Mar 16 17:13:29 crc kubenswrapper[5120]: I0316 17:13:29.436975 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/3b01ec67-66ba-469f-9eba-1df99165b135-internal-tls-certs\") pod \"keystone-77d7b5cd69-lf8gf\" (UID: \"3b01ec67-66ba-469f-9eba-1df99165b135\") " pod="openstack-kuttl-tests/keystone-77d7b5cd69-lf8gf" Mar 16 17:13:29 crc kubenswrapper[5120]: I0316 17:13:29.441924 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3b01ec67-66ba-469f-9eba-1df99165b135-config-data\") pod \"keystone-77d7b5cd69-lf8gf\" (UID: \"3b01ec67-66ba-469f-9eba-1df99165b135\") " pod="openstack-kuttl-tests/keystone-77d7b5cd69-lf8gf" Mar 16 17:13:29 crc kubenswrapper[5120]: I0316 17:13:29.442017 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3b01ec67-66ba-469f-9eba-1df99165b135-combined-ca-bundle\") pod \"keystone-77d7b5cd69-lf8gf\" (UID: \"3b01ec67-66ba-469f-9eba-1df99165b135\") " pod="openstack-kuttl-tests/keystone-77d7b5cd69-lf8gf" Mar 16 17:13:29 crc kubenswrapper[5120]: I0316 17:13:29.442093 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/3b01ec67-66ba-469f-9eba-1df99165b135-fernet-keys\") pod \"keystone-77d7b5cd69-lf8gf\" (UID: \"3b01ec67-66ba-469f-9eba-1df99165b135\") " pod="openstack-kuttl-tests/keystone-77d7b5cd69-lf8gf" Mar 16 17:13:29 crc kubenswrapper[5120]: I0316 17:13:29.442250 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/3b01ec67-66ba-469f-9eba-1df99165b135-credential-keys\") pod \"keystone-77d7b5cd69-lf8gf\" (UID: \"3b01ec67-66ba-469f-9eba-1df99165b135\") " pod="openstack-kuttl-tests/keystone-77d7b5cd69-lf8gf" Mar 16 17:13:29 crc kubenswrapper[5120]: I0316 17:13:29.544112 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/3b01ec67-66ba-469f-9eba-1df99165b135-credential-keys\") pod \"keystone-77d7b5cd69-lf8gf\" (UID: \"3b01ec67-66ba-469f-9eba-1df99165b135\") " pod="openstack-kuttl-tests/keystone-77d7b5cd69-lf8gf" Mar 16 17:13:29 crc kubenswrapper[5120]: I0316 17:13:29.544188 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/3b01ec67-66ba-469f-9eba-1df99165b135-public-tls-certs\") pod \"keystone-77d7b5cd69-lf8gf\" (UID: \"3b01ec67-66ba-469f-9eba-1df99165b135\") " pod="openstack-kuttl-tests/keystone-77d7b5cd69-lf8gf" Mar 16 17:13:29 crc kubenswrapper[5120]: I0316 17:13:29.544262 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3b01ec67-66ba-469f-9eba-1df99165b135-scripts\") pod \"keystone-77d7b5cd69-lf8gf\" (UID: \"3b01ec67-66ba-469f-9eba-1df99165b135\") " pod="openstack-kuttl-tests/keystone-77d7b5cd69-lf8gf" Mar 16 17:13:29 crc kubenswrapper[5120]: I0316 17:13:29.544355 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h9wlc\" (UniqueName: \"kubernetes.io/projected/3b01ec67-66ba-469f-9eba-1df99165b135-kube-api-access-h9wlc\") pod \"keystone-77d7b5cd69-lf8gf\" (UID: \"3b01ec67-66ba-469f-9eba-1df99165b135\") " pod="openstack-kuttl-tests/keystone-77d7b5cd69-lf8gf" Mar 16 17:13:29 crc kubenswrapper[5120]: I0316 17:13:29.544497 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/3b01ec67-66ba-469f-9eba-1df99165b135-internal-tls-certs\") pod \"keystone-77d7b5cd69-lf8gf\" (UID: \"3b01ec67-66ba-469f-9eba-1df99165b135\") " pod="openstack-kuttl-tests/keystone-77d7b5cd69-lf8gf" Mar 16 17:13:29 crc kubenswrapper[5120]: I0316 17:13:29.544577 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3b01ec67-66ba-469f-9eba-1df99165b135-config-data\") pod \"keystone-77d7b5cd69-lf8gf\" (UID: \"3b01ec67-66ba-469f-9eba-1df99165b135\") " pod="openstack-kuttl-tests/keystone-77d7b5cd69-lf8gf" Mar 16 17:13:29 crc kubenswrapper[5120]: I0316 17:13:29.544831 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3b01ec67-66ba-469f-9eba-1df99165b135-combined-ca-bundle\") pod \"keystone-77d7b5cd69-lf8gf\" (UID: \"3b01ec67-66ba-469f-9eba-1df99165b135\") " pod="openstack-kuttl-tests/keystone-77d7b5cd69-lf8gf" Mar 16 17:13:29 crc kubenswrapper[5120]: I0316 17:13:29.544914 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/3b01ec67-66ba-469f-9eba-1df99165b135-fernet-keys\") pod \"keystone-77d7b5cd69-lf8gf\" (UID: \"3b01ec67-66ba-469f-9eba-1df99165b135\") " pod="openstack-kuttl-tests/keystone-77d7b5cd69-lf8gf" Mar 16 17:13:29 crc kubenswrapper[5120]: I0316 17:13:29.564640 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/3b01ec67-66ba-469f-9eba-1df99165b135-credential-keys\") pod \"keystone-77d7b5cd69-lf8gf\" (UID: \"3b01ec67-66ba-469f-9eba-1df99165b135\") " pod="openstack-kuttl-tests/keystone-77d7b5cd69-lf8gf" Mar 16 17:13:29 crc kubenswrapper[5120]: I0316 17:13:29.567330 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3b01ec67-66ba-469f-9eba-1df99165b135-scripts\") pod \"keystone-77d7b5cd69-lf8gf\" (UID: \"3b01ec67-66ba-469f-9eba-1df99165b135\") " pod="openstack-kuttl-tests/keystone-77d7b5cd69-lf8gf" Mar 16 17:13:29 crc kubenswrapper[5120]: I0316 17:13:29.568208 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3b01ec67-66ba-469f-9eba-1df99165b135-combined-ca-bundle\") pod \"keystone-77d7b5cd69-lf8gf\" (UID: \"3b01ec67-66ba-469f-9eba-1df99165b135\") " pod="openstack-kuttl-tests/keystone-77d7b5cd69-lf8gf" Mar 16 17:13:29 crc kubenswrapper[5120]: I0316 17:13:29.571166 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/3b01ec67-66ba-469f-9eba-1df99165b135-public-tls-certs\") pod \"keystone-77d7b5cd69-lf8gf\" (UID: \"3b01ec67-66ba-469f-9eba-1df99165b135\") " pod="openstack-kuttl-tests/keystone-77d7b5cd69-lf8gf" Mar 16 17:13:29 crc kubenswrapper[5120]: I0316 17:13:29.572070 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3b01ec67-66ba-469f-9eba-1df99165b135-config-data\") pod \"keystone-77d7b5cd69-lf8gf\" (UID: \"3b01ec67-66ba-469f-9eba-1df99165b135\") " pod="openstack-kuttl-tests/keystone-77d7b5cd69-lf8gf" Mar 16 17:13:29 crc kubenswrapper[5120]: I0316 17:13:29.581513 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9wlc\" (UniqueName: \"kubernetes.io/projected/3b01ec67-66ba-469f-9eba-1df99165b135-kube-api-access-h9wlc\") pod \"keystone-77d7b5cd69-lf8gf\" (UID: \"3b01ec67-66ba-469f-9eba-1df99165b135\") " pod="openstack-kuttl-tests/keystone-77d7b5cd69-lf8gf" Mar 16 17:13:29 crc kubenswrapper[5120]: I0316 17:13:29.587691 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/3b01ec67-66ba-469f-9eba-1df99165b135-fernet-keys\") pod \"keystone-77d7b5cd69-lf8gf\" (UID: \"3b01ec67-66ba-469f-9eba-1df99165b135\") " pod="openstack-kuttl-tests/keystone-77d7b5cd69-lf8gf" Mar 16 17:13:29 crc kubenswrapper[5120]: I0316 17:13:29.588040 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/3b01ec67-66ba-469f-9eba-1df99165b135-internal-tls-certs\") pod \"keystone-77d7b5cd69-lf8gf\" (UID: \"3b01ec67-66ba-469f-9eba-1df99165b135\") " pod="openstack-kuttl-tests/keystone-77d7b5cd69-lf8gf" Mar 16 17:13:29 crc kubenswrapper[5120]: I0316 17:13:29.698266 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-77d7b5cd69-lf8gf" Mar 16 17:13:30 crc kubenswrapper[5120]: I0316 17:13:30.282048 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-77d7b5cd69-lf8gf"] Mar 16 17:13:30 crc kubenswrapper[5120]: I0316 17:13:30.327064 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"ca23d8a6-614a-40fd-97ab-7e719c0e62ca","Type":"ContainerStarted","Data":"9c9905a333902e25b68b55fff06bdb4628e4e052ecefab7116e4ce62f8850691"} Mar 16 17:13:30 crc kubenswrapper[5120]: I0316 17:13:30.327236 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="ca23d8a6-614a-40fd-97ab-7e719c0e62ca" containerName="cinder-api-log" containerID="cri-o://b6c231778dd15aebed9fb870e796cb89b77d2ff3169e003abcd34bdc5db41f23" gracePeriod=30 Mar 16 17:13:30 crc kubenswrapper[5120]: I0316 17:13:30.327509 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:13:30 crc kubenswrapper[5120]: I0316 17:13:30.327824 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="ca23d8a6-614a-40fd-97ab-7e719c0e62ca" containerName="cinder-api" containerID="cri-o://9c9905a333902e25b68b55fff06bdb4628e4e052ecefab7116e4ce62f8850691" gracePeriod=30 Mar 16 17:13:30 crc kubenswrapper[5120]: I0316 17:13:30.339153 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-77d7b5cd69-lf8gf" event={"ID":"3b01ec67-66ba-469f-9eba-1df99165b135","Type":"ContainerStarted","Data":"b2de174870b68b8699e088c4216d450c8f77454ff051d1d968b8daeeb8244af1"} Mar 16 17:13:31 crc kubenswrapper[5120]: I0316 17:13:31.350050 5120 generic.go:358] "Generic (PLEG): container finished" podID="ca23d8a6-614a-40fd-97ab-7e719c0e62ca" containerID="9c9905a333902e25b68b55fff06bdb4628e4e052ecefab7116e4ce62f8850691" exitCode=0 Mar 16 17:13:31 crc kubenswrapper[5120]: I0316 17:13:31.350557 5120 generic.go:358] "Generic (PLEG): container finished" podID="ca23d8a6-614a-40fd-97ab-7e719c0e62ca" containerID="b6c231778dd15aebed9fb870e796cb89b77d2ff3169e003abcd34bdc5db41f23" exitCode=143 Mar 16 17:13:31 crc kubenswrapper[5120]: I0316 17:13:31.350932 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"ca23d8a6-614a-40fd-97ab-7e719c0e62ca","Type":"ContainerDied","Data":"9c9905a333902e25b68b55fff06bdb4628e4e052ecefab7116e4ce62f8850691"} Mar 16 17:13:31 crc kubenswrapper[5120]: I0316 17:13:31.350961 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"ca23d8a6-614a-40fd-97ab-7e719c0e62ca","Type":"ContainerDied","Data":"b6c231778dd15aebed9fb870e796cb89b77d2ff3169e003abcd34bdc5db41f23"} Mar 16 17:13:31 crc kubenswrapper[5120]: I0316 17:13:31.352947 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-77d7b5cd69-lf8gf" event={"ID":"3b01ec67-66ba-469f-9eba-1df99165b135","Type":"ContainerStarted","Data":"989a7f158ffb3d42b5d6a2c0845df1cbac6bacb3154bade47643d37307c9560d"} Mar 16 17:13:31 crc kubenswrapper[5120]: I0316 17:13:31.353682 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/keystone-77d7b5cd69-lf8gf" Mar 16 17:13:31 crc kubenswrapper[5120]: I0316 17:13:31.382725 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-api-0" podStartSLOduration=5.382700595 podStartE2EDuration="5.382700595s" podCreationTimestamp="2026-03-16 17:13:26 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:13:30.35724189 +0000 UTC m=+6112.511173547" watchObservedRunningTime="2026-03-16 17:13:31.382700595 +0000 UTC m=+6113.536632252" Mar 16 17:13:31 crc kubenswrapper[5120]: I0316 17:13:31.481099 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:13:31 crc kubenswrapper[5120]: I0316 17:13:31.510060 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-77d7b5cd69-lf8gf" podStartSLOduration=2.510037789 podStartE2EDuration="2.510037789s" podCreationTimestamp="2026-03-16 17:13:29 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:13:31.390943071 +0000 UTC m=+6113.544874728" watchObservedRunningTime="2026-03-16 17:13:31.510037789 +0000 UTC m=+6113.663969446" Mar 16 17:13:31 crc kubenswrapper[5120]: I0316 17:13:31.518842 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ca23d8a6-614a-40fd-97ab-7e719c0e62ca-combined-ca-bundle\") pod \"ca23d8a6-614a-40fd-97ab-7e719c0e62ca\" (UID: \"ca23d8a6-614a-40fd-97ab-7e719c0e62ca\") " Mar 16 17:13:31 crc kubenswrapper[5120]: I0316 17:13:31.518994 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ca23d8a6-614a-40fd-97ab-7e719c0e62ca-logs\") pod \"ca23d8a6-614a-40fd-97ab-7e719c0e62ca\" (UID: \"ca23d8a6-614a-40fd-97ab-7e719c0e62ca\") " Mar 16 17:13:31 crc kubenswrapper[5120]: I0316 17:13:31.519054 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/ca23d8a6-614a-40fd-97ab-7e719c0e62ca-etc-machine-id\") pod \"ca23d8a6-614a-40fd-97ab-7e719c0e62ca\" (UID: \"ca23d8a6-614a-40fd-97ab-7e719c0e62ca\") " Mar 16 17:13:31 crc kubenswrapper[5120]: I0316 17:13:31.519222 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ca23d8a6-614a-40fd-97ab-7e719c0e62ca-scripts\") pod \"ca23d8a6-614a-40fd-97ab-7e719c0e62ca\" (UID: \"ca23d8a6-614a-40fd-97ab-7e719c0e62ca\") " Mar 16 17:13:31 crc kubenswrapper[5120]: I0316 17:13:31.519264 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ca23d8a6-614a-40fd-97ab-7e719c0e62ca-config-data\") pod \"ca23d8a6-614a-40fd-97ab-7e719c0e62ca\" (UID: \"ca23d8a6-614a-40fd-97ab-7e719c0e62ca\") " Mar 16 17:13:31 crc kubenswrapper[5120]: I0316 17:13:31.519298 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/ca23d8a6-614a-40fd-97ab-7e719c0e62ca-config-data-custom\") pod \"ca23d8a6-614a-40fd-97ab-7e719c0e62ca\" (UID: \"ca23d8a6-614a-40fd-97ab-7e719c0e62ca\") " Mar 16 17:13:31 crc kubenswrapper[5120]: I0316 17:13:31.519429 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2vzr4\" (UniqueName: \"kubernetes.io/projected/ca23d8a6-614a-40fd-97ab-7e719c0e62ca-kube-api-access-2vzr4\") pod \"ca23d8a6-614a-40fd-97ab-7e719c0e62ca\" (UID: \"ca23d8a6-614a-40fd-97ab-7e719c0e62ca\") " Mar 16 17:13:31 crc kubenswrapper[5120]: I0316 17:13:31.540410 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca23d8a6-614a-40fd-97ab-7e719c0e62ca-kube-api-access-2vzr4" (OuterVolumeSpecName: "kube-api-access-2vzr4") pod "ca23d8a6-614a-40fd-97ab-7e719c0e62ca" (UID: "ca23d8a6-614a-40fd-97ab-7e719c0e62ca"). InnerVolumeSpecName "kube-api-access-2vzr4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:13:31 crc kubenswrapper[5120]: I0316 17:13:31.541119 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/ca23d8a6-614a-40fd-97ab-7e719c0e62ca-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "ca23d8a6-614a-40fd-97ab-7e719c0e62ca" (UID: "ca23d8a6-614a-40fd-97ab-7e719c0e62ca"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 17:13:31 crc kubenswrapper[5120]: I0316 17:13:31.541415 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca23d8a6-614a-40fd-97ab-7e719c0e62ca-logs" (OuterVolumeSpecName: "logs") pod "ca23d8a6-614a-40fd-97ab-7e719c0e62ca" (UID: "ca23d8a6-614a-40fd-97ab-7e719c0e62ca"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:13:31 crc kubenswrapper[5120]: I0316 17:13:31.544383 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca23d8a6-614a-40fd-97ab-7e719c0e62ca-scripts" (OuterVolumeSpecName: "scripts") pod "ca23d8a6-614a-40fd-97ab-7e719c0e62ca" (UID: "ca23d8a6-614a-40fd-97ab-7e719c0e62ca"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:13:31 crc kubenswrapper[5120]: I0316 17:13:31.550198 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca23d8a6-614a-40fd-97ab-7e719c0e62ca-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "ca23d8a6-614a-40fd-97ab-7e719c0e62ca" (UID: "ca23d8a6-614a-40fd-97ab-7e719c0e62ca"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:13:31 crc kubenswrapper[5120]: I0316 17:13:31.612907 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca23d8a6-614a-40fd-97ab-7e719c0e62ca-config-data" (OuterVolumeSpecName: "config-data") pod "ca23d8a6-614a-40fd-97ab-7e719c0e62ca" (UID: "ca23d8a6-614a-40fd-97ab-7e719c0e62ca"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:13:31 crc kubenswrapper[5120]: I0316 17:13:31.613004 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca23d8a6-614a-40fd-97ab-7e719c0e62ca-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ca23d8a6-614a-40fd-97ab-7e719c0e62ca" (UID: "ca23d8a6-614a-40fd-97ab-7e719c0e62ca"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:13:31 crc kubenswrapper[5120]: I0316 17:13:31.622265 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2vzr4\" (UniqueName: \"kubernetes.io/projected/ca23d8a6-614a-40fd-97ab-7e719c0e62ca-kube-api-access-2vzr4\") on node \"crc\" DevicePath \"\"" Mar 16 17:13:31 crc kubenswrapper[5120]: I0316 17:13:31.622588 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ca23d8a6-614a-40fd-97ab-7e719c0e62ca-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:13:31 crc kubenswrapper[5120]: I0316 17:13:31.622723 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ca23d8a6-614a-40fd-97ab-7e719c0e62ca-logs\") on node \"crc\" DevicePath \"\"" Mar 16 17:13:31 crc kubenswrapper[5120]: I0316 17:13:31.622862 5120 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/ca23d8a6-614a-40fd-97ab-7e719c0e62ca-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 17:13:31 crc kubenswrapper[5120]: I0316 17:13:31.622941 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ca23d8a6-614a-40fd-97ab-7e719c0e62ca-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:13:31 crc kubenswrapper[5120]: I0316 17:13:31.623014 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ca23d8a6-614a-40fd-97ab-7e719c0e62ca-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:13:31 crc kubenswrapper[5120]: I0316 17:13:31.623074 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/ca23d8a6-614a-40fd-97ab-7e719c0e62ca-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 17:13:31 crc kubenswrapper[5120]: I0316 17:13:31.762099 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:13:32 crc kubenswrapper[5120]: I0316 17:13:32.022330 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-6b57b99b96-6qzq2" Mar 16 17:13:32 crc kubenswrapper[5120]: I0316 17:13:32.362836 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:13:32 crc kubenswrapper[5120]: I0316 17:13:32.362867 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"ca23d8a6-614a-40fd-97ab-7e719c0e62ca","Type":"ContainerDied","Data":"24bc80bb2482c5bab93b39ea50dc976ed94a7f91c18be3c899525e6d314cd271"} Mar 16 17:13:32 crc kubenswrapper[5120]: I0316 17:13:32.362934 5120 scope.go:117] "RemoveContainer" containerID="9c9905a333902e25b68b55fff06bdb4628e4e052ecefab7116e4ce62f8850691" Mar 16 17:13:32 crc kubenswrapper[5120]: I0316 17:13:32.386432 5120 scope.go:117] "RemoveContainer" containerID="b6c231778dd15aebed9fb870e796cb89b77d2ff3169e003abcd34bdc5db41f23" Mar 16 17:13:32 crc kubenswrapper[5120]: I0316 17:13:32.407423 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 17:13:32 crc kubenswrapper[5120]: I0316 17:13:32.425610 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 17:13:32 crc kubenswrapper[5120]: I0316 17:13:32.444835 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 17:13:32 crc kubenswrapper[5120]: I0316 17:13:32.446494 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca23d8a6-614a-40fd-97ab-7e719c0e62ca" containerName="cinder-api-log" Mar 16 17:13:32 crc kubenswrapper[5120]: I0316 17:13:32.446516 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca23d8a6-614a-40fd-97ab-7e719c0e62ca" containerName="cinder-api-log" Mar 16 17:13:32 crc kubenswrapper[5120]: I0316 17:13:32.446549 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca23d8a6-614a-40fd-97ab-7e719c0e62ca" containerName="cinder-api" Mar 16 17:13:32 crc kubenswrapper[5120]: I0316 17:13:32.446555 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca23d8a6-614a-40fd-97ab-7e719c0e62ca" containerName="cinder-api" Mar 16 17:13:32 crc kubenswrapper[5120]: I0316 17:13:32.446731 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ca23d8a6-614a-40fd-97ab-7e719c0e62ca" containerName="cinder-api-log" Mar 16 17:13:32 crc kubenswrapper[5120]: I0316 17:13:32.446770 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ca23d8a6-614a-40fd-97ab-7e719c0e62ca" containerName="cinder-api" Mar 16 17:13:32 crc kubenswrapper[5120]: I0316 17:13:32.455422 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 17:13:32 crc kubenswrapper[5120]: I0316 17:13:32.455556 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:13:32 crc kubenswrapper[5120]: I0316 17:13:32.459941 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-api-config-data\"" Mar 16 17:13:32 crc kubenswrapper[5120]: I0316 17:13:32.460103 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-cinder-public-svc\"" Mar 16 17:13:32 crc kubenswrapper[5120]: I0316 17:13:32.460186 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-cinder-internal-svc\"" Mar 16 17:13:32 crc kubenswrapper[5120]: I0316 17:13:32.555992 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/015b50a4-d550-48a4-a72b-b73b038d7319-etc-machine-id\") pod \"cinder-api-0\" (UID: \"015b50a4-d550-48a4-a72b-b73b038d7319\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:13:32 crc kubenswrapper[5120]: I0316 17:13:32.556075 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/015b50a4-d550-48a4-a72b-b73b038d7319-scripts\") pod \"cinder-api-0\" (UID: \"015b50a4-d550-48a4-a72b-b73b038d7319\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:13:32 crc kubenswrapper[5120]: I0316 17:13:32.556255 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/015b50a4-d550-48a4-a72b-b73b038d7319-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"015b50a4-d550-48a4-a72b-b73b038d7319\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:13:32 crc kubenswrapper[5120]: I0316 17:13:32.556393 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/015b50a4-d550-48a4-a72b-b73b038d7319-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"015b50a4-d550-48a4-a72b-b73b038d7319\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:13:32 crc kubenswrapper[5120]: I0316 17:13:32.556509 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/015b50a4-d550-48a4-a72b-b73b038d7319-config-data\") pod \"cinder-api-0\" (UID: \"015b50a4-d550-48a4-a72b-b73b038d7319\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:13:32 crc kubenswrapper[5120]: I0316 17:13:32.556590 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/015b50a4-d550-48a4-a72b-b73b038d7319-logs\") pod \"cinder-api-0\" (UID: \"015b50a4-d550-48a4-a72b-b73b038d7319\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:13:32 crc kubenswrapper[5120]: I0316 17:13:32.556609 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tbxf\" (UniqueName: \"kubernetes.io/projected/015b50a4-d550-48a4-a72b-b73b038d7319-kube-api-access-9tbxf\") pod \"cinder-api-0\" (UID: \"015b50a4-d550-48a4-a72b-b73b038d7319\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:13:32 crc kubenswrapper[5120]: I0316 17:13:32.556788 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/015b50a4-d550-48a4-a72b-b73b038d7319-config-data-custom\") pod \"cinder-api-0\" (UID: \"015b50a4-d550-48a4-a72b-b73b038d7319\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:13:32 crc kubenswrapper[5120]: I0316 17:13:32.556813 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/015b50a4-d550-48a4-a72b-b73b038d7319-public-tls-certs\") pod \"cinder-api-0\" (UID: \"015b50a4-d550-48a4-a72b-b73b038d7319\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:13:32 crc kubenswrapper[5120]: I0316 17:13:32.658449 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:13:32 crc kubenswrapper[5120]: I0316 17:13:32.658582 5120 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Mar 16 17:13:32 crc kubenswrapper[5120]: I0316 17:13:32.658825 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/015b50a4-d550-48a4-a72b-b73b038d7319-etc-machine-id\") pod \"cinder-api-0\" (UID: \"015b50a4-d550-48a4-a72b-b73b038d7319\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:13:32 crc kubenswrapper[5120]: I0316 17:13:32.658896 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/015b50a4-d550-48a4-a72b-b73b038d7319-scripts\") pod \"cinder-api-0\" (UID: \"015b50a4-d550-48a4-a72b-b73b038d7319\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:13:32 crc kubenswrapper[5120]: I0316 17:13:32.659007 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/015b50a4-d550-48a4-a72b-b73b038d7319-etc-machine-id\") pod \"cinder-api-0\" (UID: \"015b50a4-d550-48a4-a72b-b73b038d7319\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:13:32 crc kubenswrapper[5120]: I0316 17:13:32.659030 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/015b50a4-d550-48a4-a72b-b73b038d7319-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"015b50a4-d550-48a4-a72b-b73b038d7319\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:13:32 crc kubenswrapper[5120]: I0316 17:13:32.659375 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/015b50a4-d550-48a4-a72b-b73b038d7319-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"015b50a4-d550-48a4-a72b-b73b038d7319\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:13:32 crc kubenswrapper[5120]: I0316 17:13:32.659481 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/015b50a4-d550-48a4-a72b-b73b038d7319-config-data\") pod \"cinder-api-0\" (UID: \"015b50a4-d550-48a4-a72b-b73b038d7319\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:13:32 crc kubenswrapper[5120]: I0316 17:13:32.659595 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/015b50a4-d550-48a4-a72b-b73b038d7319-logs\") pod \"cinder-api-0\" (UID: \"015b50a4-d550-48a4-a72b-b73b038d7319\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:13:32 crc kubenswrapper[5120]: I0316 17:13:32.659627 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9tbxf\" (UniqueName: \"kubernetes.io/projected/015b50a4-d550-48a4-a72b-b73b038d7319-kube-api-access-9tbxf\") pod \"cinder-api-0\" (UID: \"015b50a4-d550-48a4-a72b-b73b038d7319\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:13:32 crc kubenswrapper[5120]: I0316 17:13:32.659855 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/015b50a4-d550-48a4-a72b-b73b038d7319-config-data-custom\") pod \"cinder-api-0\" (UID: \"015b50a4-d550-48a4-a72b-b73b038d7319\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:13:32 crc kubenswrapper[5120]: I0316 17:13:32.659890 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/015b50a4-d550-48a4-a72b-b73b038d7319-public-tls-certs\") pod \"cinder-api-0\" (UID: \"015b50a4-d550-48a4-a72b-b73b038d7319\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:13:32 crc kubenswrapper[5120]: I0316 17:13:32.660673 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/015b50a4-d550-48a4-a72b-b73b038d7319-logs\") pod \"cinder-api-0\" (UID: \"015b50a4-d550-48a4-a72b-b73b038d7319\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:13:32 crc kubenswrapper[5120]: I0316 17:13:32.676088 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/015b50a4-d550-48a4-a72b-b73b038d7319-scripts\") pod \"cinder-api-0\" (UID: \"015b50a4-d550-48a4-a72b-b73b038d7319\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:13:32 crc kubenswrapper[5120]: I0316 17:13:32.676429 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tbxf\" (UniqueName: \"kubernetes.io/projected/015b50a4-d550-48a4-a72b-b73b038d7319-kube-api-access-9tbxf\") pod \"cinder-api-0\" (UID: \"015b50a4-d550-48a4-a72b-b73b038d7319\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:13:32 crc kubenswrapper[5120]: I0316 17:13:32.677345 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/015b50a4-d550-48a4-a72b-b73b038d7319-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"015b50a4-d550-48a4-a72b-b73b038d7319\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:13:32 crc kubenswrapper[5120]: I0316 17:13:32.682443 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/015b50a4-d550-48a4-a72b-b73b038d7319-config-data-custom\") pod \"cinder-api-0\" (UID: \"015b50a4-d550-48a4-a72b-b73b038d7319\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:13:32 crc kubenswrapper[5120]: I0316 17:13:32.686525 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/015b50a4-d550-48a4-a72b-b73b038d7319-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"015b50a4-d550-48a4-a72b-b73b038d7319\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:13:32 crc kubenswrapper[5120]: I0316 17:13:32.695491 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca23d8a6-614a-40fd-97ab-7e719c0e62ca" path="/var/lib/kubelet/pods/ca23d8a6-614a-40fd-97ab-7e719c0e62ca/volumes" Mar 16 17:13:32 crc kubenswrapper[5120]: I0316 17:13:32.714842 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/015b50a4-d550-48a4-a72b-b73b038d7319-config-data\") pod \"cinder-api-0\" (UID: \"015b50a4-d550-48a4-a72b-b73b038d7319\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:13:32 crc kubenswrapper[5120]: I0316 17:13:32.719346 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/015b50a4-d550-48a4-a72b-b73b038d7319-public-tls-certs\") pod \"cinder-api-0\" (UID: \"015b50a4-d550-48a4-a72b-b73b038d7319\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:13:32 crc kubenswrapper[5120]: I0316 17:13:32.754845 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:13:32 crc kubenswrapper[5120]: I0316 17:13:32.755046 5120 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Mar 16 17:13:32 crc kubenswrapper[5120]: I0316 17:13:32.785839 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:13:32 crc kubenswrapper[5120]: I0316 17:13:32.913701 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-6b57b99b96-6qzq2" Mar 16 17:13:32 crc kubenswrapper[5120]: I0316 17:13:32.955552 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:13:33 crc kubenswrapper[5120]: I0316 17:13:33.112804 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-5c4bd8b884-fjd8f"] Mar 16 17:13:33 crc kubenswrapper[5120]: I0316 17:13:33.118170 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-5c4bd8b884-fjd8f" Mar 16 17:13:33 crc kubenswrapper[5120]: I0316 17:13:33.140290 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-5c4bd8b884-fjd8f"] Mar 16 17:13:33 crc kubenswrapper[5120]: I0316 17:13:33.165876 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-worker-5d6b4bc659-md7vt"] Mar 16 17:13:33 crc kubenswrapper[5120]: I0316 17:13:33.176311 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jcj6\" (UniqueName: \"kubernetes.io/projected/fcf5af95-be92-4701-9e16-491dbbea165d-kube-api-access-5jcj6\") pod \"barbican-keystone-listener-5c4bd8b884-fjd8f\" (UID: \"fcf5af95-be92-4701-9e16-491dbbea165d\") " pod="openstack-kuttl-tests/barbican-keystone-listener-5c4bd8b884-fjd8f" Mar 16 17:13:33 crc kubenswrapper[5120]: I0316 17:13:33.176610 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-5d6b4bc659-md7vt" Mar 16 17:13:33 crc kubenswrapper[5120]: I0316 17:13:33.177563 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fcf5af95-be92-4701-9e16-491dbbea165d-config-data\") pod \"barbican-keystone-listener-5c4bd8b884-fjd8f\" (UID: \"fcf5af95-be92-4701-9e16-491dbbea165d\") " pod="openstack-kuttl-tests/barbican-keystone-listener-5c4bd8b884-fjd8f" Mar 16 17:13:33 crc kubenswrapper[5120]: I0316 17:13:33.177677 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/fcf5af95-be92-4701-9e16-491dbbea165d-logs\") pod \"barbican-keystone-listener-5c4bd8b884-fjd8f\" (UID: \"fcf5af95-be92-4701-9e16-491dbbea165d\") " pod="openstack-kuttl-tests/barbican-keystone-listener-5c4bd8b884-fjd8f" Mar 16 17:13:33 crc kubenswrapper[5120]: I0316 17:13:33.177716 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fcf5af95-be92-4701-9e16-491dbbea165d-combined-ca-bundle\") pod \"barbican-keystone-listener-5c4bd8b884-fjd8f\" (UID: \"fcf5af95-be92-4701-9e16-491dbbea165d\") " pod="openstack-kuttl-tests/barbican-keystone-listener-5c4bd8b884-fjd8f" Mar 16 17:13:33 crc kubenswrapper[5120]: I0316 17:13:33.177794 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/fcf5af95-be92-4701-9e16-491dbbea165d-config-data-custom\") pod \"barbican-keystone-listener-5c4bd8b884-fjd8f\" (UID: \"fcf5af95-be92-4701-9e16-491dbbea165d\") " pod="openstack-kuttl-tests/barbican-keystone-listener-5c4bd8b884-fjd8f" Mar 16 17:13:33 crc kubenswrapper[5120]: I0316 17:13:33.207712 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-5d6b4bc659-md7vt"] Mar 16 17:13:33 crc kubenswrapper[5120]: I0316 17:13:33.270916 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-67f6766cc8-lpvm7"] Mar 16 17:13:33 crc kubenswrapper[5120]: I0316 17:13:33.271227 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-67f6766cc8-lpvm7" podUID="24f83ac4-b285-47e8-94e0-9b47da8c5928" containerName="barbican-api-log" containerID="cri-o://3edc568db612fad0b01bc312a6630be1d7ff70d8485d636c8539653e799955c5" gracePeriod=30 Mar 16 17:13:33 crc kubenswrapper[5120]: I0316 17:13:33.271741 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-67f6766cc8-lpvm7" podUID="24f83ac4-b285-47e8-94e0-9b47da8c5928" containerName="barbican-api" containerID="cri-o://a5c5a79296326184b8165b774fab8b1a1e69e2ec576ffafb6d5a426e531e7910" gracePeriod=30 Mar 16 17:13:33 crc kubenswrapper[5120]: I0316 17:13:33.279716 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openstack-kuttl-tests/barbican-api-67f6766cc8-lpvm7" podUID="24f83ac4-b285-47e8-94e0-9b47da8c5928" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.0.162:9311/healthcheck\": EOF" Mar 16 17:13:33 crc kubenswrapper[5120]: I0316 17:13:33.279903 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-67f6766cc8-lpvm7" podUID="24f83ac4-b285-47e8-94e0-9b47da8c5928" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.0.162:9311/healthcheck\": EOF" Mar 16 17:13:33 crc kubenswrapper[5120]: I0316 17:13:33.281732 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-67f6766cc8-lpvm7" podUID="24f83ac4-b285-47e8-94e0-9b47da8c5928" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.0.162:9311/healthcheck\": EOF" Mar 16 17:13:33 crc kubenswrapper[5120]: I0316 17:13:33.281887 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openstack-kuttl-tests/barbican-api-67f6766cc8-lpvm7" podUID="24f83ac4-b285-47e8-94e0-9b47da8c5928" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.0.162:9311/healthcheck\": EOF" Mar 16 17:13:33 crc kubenswrapper[5120]: I0316 17:13:33.287934 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3ce6e6cf-688e-4f59-8ca2-f3c79e2a1857-logs\") pod \"barbican-worker-5d6b4bc659-md7vt\" (UID: \"3ce6e6cf-688e-4f59-8ca2-f3c79e2a1857\") " pod="openstack-kuttl-tests/barbican-worker-5d6b4bc659-md7vt" Mar 16 17:13:33 crc kubenswrapper[5120]: I0316 17:13:33.288088 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fcf5af95-be92-4701-9e16-491dbbea165d-config-data\") pod \"barbican-keystone-listener-5c4bd8b884-fjd8f\" (UID: \"fcf5af95-be92-4701-9e16-491dbbea165d\") " pod="openstack-kuttl-tests/barbican-keystone-listener-5c4bd8b884-fjd8f" Mar 16 17:13:33 crc kubenswrapper[5120]: I0316 17:13:33.288176 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3ce6e6cf-688e-4f59-8ca2-f3c79e2a1857-config-data\") pod \"barbican-worker-5d6b4bc659-md7vt\" (UID: \"3ce6e6cf-688e-4f59-8ca2-f3c79e2a1857\") " pod="openstack-kuttl-tests/barbican-worker-5d6b4bc659-md7vt" Mar 16 17:13:33 crc kubenswrapper[5120]: I0316 17:13:33.288200 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/fcf5af95-be92-4701-9e16-491dbbea165d-logs\") pod \"barbican-keystone-listener-5c4bd8b884-fjd8f\" (UID: \"fcf5af95-be92-4701-9e16-491dbbea165d\") " pod="openstack-kuttl-tests/barbican-keystone-listener-5c4bd8b884-fjd8f" Mar 16 17:13:33 crc kubenswrapper[5120]: I0316 17:13:33.288242 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fcf5af95-be92-4701-9e16-491dbbea165d-combined-ca-bundle\") pod \"barbican-keystone-listener-5c4bd8b884-fjd8f\" (UID: \"fcf5af95-be92-4701-9e16-491dbbea165d\") " pod="openstack-kuttl-tests/barbican-keystone-listener-5c4bd8b884-fjd8f" Mar 16 17:13:33 crc kubenswrapper[5120]: I0316 17:13:33.288294 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/fcf5af95-be92-4701-9e16-491dbbea165d-config-data-custom\") pod \"barbican-keystone-listener-5c4bd8b884-fjd8f\" (UID: \"fcf5af95-be92-4701-9e16-491dbbea165d\") " pod="openstack-kuttl-tests/barbican-keystone-listener-5c4bd8b884-fjd8f" Mar 16 17:13:33 crc kubenswrapper[5120]: I0316 17:13:33.288448 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3ce6e6cf-688e-4f59-8ca2-f3c79e2a1857-combined-ca-bundle\") pod \"barbican-worker-5d6b4bc659-md7vt\" (UID: \"3ce6e6cf-688e-4f59-8ca2-f3c79e2a1857\") " pod="openstack-kuttl-tests/barbican-worker-5d6b4bc659-md7vt" Mar 16 17:13:33 crc kubenswrapper[5120]: I0316 17:13:33.288485 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9v4m\" (UniqueName: \"kubernetes.io/projected/3ce6e6cf-688e-4f59-8ca2-f3c79e2a1857-kube-api-access-g9v4m\") pod \"barbican-worker-5d6b4bc659-md7vt\" (UID: \"3ce6e6cf-688e-4f59-8ca2-f3c79e2a1857\") " pod="openstack-kuttl-tests/barbican-worker-5d6b4bc659-md7vt" Mar 16 17:13:33 crc kubenswrapper[5120]: I0316 17:13:33.288698 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5jcj6\" (UniqueName: \"kubernetes.io/projected/fcf5af95-be92-4701-9e16-491dbbea165d-kube-api-access-5jcj6\") pod \"barbican-keystone-listener-5c4bd8b884-fjd8f\" (UID: \"fcf5af95-be92-4701-9e16-491dbbea165d\") " pod="openstack-kuttl-tests/barbican-keystone-listener-5c4bd8b884-fjd8f" Mar 16 17:13:33 crc kubenswrapper[5120]: I0316 17:13:33.288741 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/3ce6e6cf-688e-4f59-8ca2-f3c79e2a1857-config-data-custom\") pod \"barbican-worker-5d6b4bc659-md7vt\" (UID: \"3ce6e6cf-688e-4f59-8ca2-f3c79e2a1857\") " pod="openstack-kuttl-tests/barbican-worker-5d6b4bc659-md7vt" Mar 16 17:13:33 crc kubenswrapper[5120]: I0316 17:13:33.289731 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/fcf5af95-be92-4701-9e16-491dbbea165d-logs\") pod \"barbican-keystone-listener-5c4bd8b884-fjd8f\" (UID: \"fcf5af95-be92-4701-9e16-491dbbea165d\") " pod="openstack-kuttl-tests/barbican-keystone-listener-5c4bd8b884-fjd8f" Mar 16 17:13:33 crc kubenswrapper[5120]: I0316 17:13:33.311382 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fcf5af95-be92-4701-9e16-491dbbea165d-config-data\") pod \"barbican-keystone-listener-5c4bd8b884-fjd8f\" (UID: \"fcf5af95-be92-4701-9e16-491dbbea165d\") " pod="openstack-kuttl-tests/barbican-keystone-listener-5c4bd8b884-fjd8f" Mar 16 17:13:33 crc kubenswrapper[5120]: I0316 17:13:33.314916 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/fcf5af95-be92-4701-9e16-491dbbea165d-config-data-custom\") pod \"barbican-keystone-listener-5c4bd8b884-fjd8f\" (UID: \"fcf5af95-be92-4701-9e16-491dbbea165d\") " pod="openstack-kuttl-tests/barbican-keystone-listener-5c4bd8b884-fjd8f" Mar 16 17:13:33 crc kubenswrapper[5120]: I0316 17:13:33.315474 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fcf5af95-be92-4701-9e16-491dbbea165d-combined-ca-bundle\") pod \"barbican-keystone-listener-5c4bd8b884-fjd8f\" (UID: \"fcf5af95-be92-4701-9e16-491dbbea165d\") " pod="openstack-kuttl-tests/barbican-keystone-listener-5c4bd8b884-fjd8f" Mar 16 17:13:33 crc kubenswrapper[5120]: I0316 17:13:33.320609 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-api-5b49d5d76-5r44p"] Mar 16 17:13:33 crc kubenswrapper[5120]: I0316 17:13:33.330667 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jcj6\" (UniqueName: \"kubernetes.io/projected/fcf5af95-be92-4701-9e16-491dbbea165d-kube-api-access-5jcj6\") pod \"barbican-keystone-listener-5c4bd8b884-fjd8f\" (UID: \"fcf5af95-be92-4701-9e16-491dbbea165d\") " pod="openstack-kuttl-tests/barbican-keystone-listener-5c4bd8b884-fjd8f" Mar 16 17:13:33 crc kubenswrapper[5120]: I0316 17:13:33.344206 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-5b49d5d76-5r44p" Mar 16 17:13:33 crc kubenswrapper[5120]: I0316 17:13:33.383934 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-5b49d5d76-5r44p"] Mar 16 17:13:33 crc kubenswrapper[5120]: I0316 17:13:33.395318 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3ce6e6cf-688e-4f59-8ca2-f3c79e2a1857-combined-ca-bundle\") pod \"barbican-worker-5d6b4bc659-md7vt\" (UID: \"3ce6e6cf-688e-4f59-8ca2-f3c79e2a1857\") " pod="openstack-kuttl-tests/barbican-worker-5d6b4bc659-md7vt" Mar 16 17:13:33 crc kubenswrapper[5120]: I0316 17:13:33.395364 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g9v4m\" (UniqueName: \"kubernetes.io/projected/3ce6e6cf-688e-4f59-8ca2-f3c79e2a1857-kube-api-access-g9v4m\") pod \"barbican-worker-5d6b4bc659-md7vt\" (UID: \"3ce6e6cf-688e-4f59-8ca2-f3c79e2a1857\") " pod="openstack-kuttl-tests/barbican-worker-5d6b4bc659-md7vt" Mar 16 17:13:33 crc kubenswrapper[5120]: I0316 17:13:33.395404 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/c2e33bc1-ee7f-461d-9faa-b5678f7cb416-config-data-custom\") pod \"barbican-api-5b49d5d76-5r44p\" (UID: \"c2e33bc1-ee7f-461d-9faa-b5678f7cb416\") " pod="openstack-kuttl-tests/barbican-api-5b49d5d76-5r44p" Mar 16 17:13:33 crc kubenswrapper[5120]: I0316 17:13:33.395552 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/3ce6e6cf-688e-4f59-8ca2-f3c79e2a1857-config-data-custom\") pod \"barbican-worker-5d6b4bc659-md7vt\" (UID: \"3ce6e6cf-688e-4f59-8ca2-f3c79e2a1857\") " pod="openstack-kuttl-tests/barbican-worker-5d6b4bc659-md7vt" Mar 16 17:13:33 crc kubenswrapper[5120]: I0316 17:13:33.395587 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c2e33bc1-ee7f-461d-9faa-b5678f7cb416-logs\") pod \"barbican-api-5b49d5d76-5r44p\" (UID: \"c2e33bc1-ee7f-461d-9faa-b5678f7cb416\") " pod="openstack-kuttl-tests/barbican-api-5b49d5d76-5r44p" Mar 16 17:13:33 crc kubenswrapper[5120]: I0316 17:13:33.395640 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3ce6e6cf-688e-4f59-8ca2-f3c79e2a1857-logs\") pod \"barbican-worker-5d6b4bc659-md7vt\" (UID: \"3ce6e6cf-688e-4f59-8ca2-f3c79e2a1857\") " pod="openstack-kuttl-tests/barbican-worker-5d6b4bc659-md7vt" Mar 16 17:13:33 crc kubenswrapper[5120]: I0316 17:13:33.395711 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/c2e33bc1-ee7f-461d-9faa-b5678f7cb416-public-tls-certs\") pod \"barbican-api-5b49d5d76-5r44p\" (UID: \"c2e33bc1-ee7f-461d-9faa-b5678f7cb416\") " pod="openstack-kuttl-tests/barbican-api-5b49d5d76-5r44p" Mar 16 17:13:33 crc kubenswrapper[5120]: I0316 17:13:33.395802 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3ce6e6cf-688e-4f59-8ca2-f3c79e2a1857-config-data\") pod \"barbican-worker-5d6b4bc659-md7vt\" (UID: \"3ce6e6cf-688e-4f59-8ca2-f3c79e2a1857\") " pod="openstack-kuttl-tests/barbican-worker-5d6b4bc659-md7vt" Mar 16 17:13:33 crc kubenswrapper[5120]: I0316 17:13:33.395824 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gn67c\" (UniqueName: \"kubernetes.io/projected/c2e33bc1-ee7f-461d-9faa-b5678f7cb416-kube-api-access-gn67c\") pod \"barbican-api-5b49d5d76-5r44p\" (UID: \"c2e33bc1-ee7f-461d-9faa-b5678f7cb416\") " pod="openstack-kuttl-tests/barbican-api-5b49d5d76-5r44p" Mar 16 17:13:33 crc kubenswrapper[5120]: I0316 17:13:33.395888 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/c2e33bc1-ee7f-461d-9faa-b5678f7cb416-internal-tls-certs\") pod \"barbican-api-5b49d5d76-5r44p\" (UID: \"c2e33bc1-ee7f-461d-9faa-b5678f7cb416\") " pod="openstack-kuttl-tests/barbican-api-5b49d5d76-5r44p" Mar 16 17:13:33 crc kubenswrapper[5120]: I0316 17:13:33.395944 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c2e33bc1-ee7f-461d-9faa-b5678f7cb416-config-data\") pod \"barbican-api-5b49d5d76-5r44p\" (UID: \"c2e33bc1-ee7f-461d-9faa-b5678f7cb416\") " pod="openstack-kuttl-tests/barbican-api-5b49d5d76-5r44p" Mar 16 17:13:33 crc kubenswrapper[5120]: I0316 17:13:33.395992 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c2e33bc1-ee7f-461d-9faa-b5678f7cb416-combined-ca-bundle\") pod \"barbican-api-5b49d5d76-5r44p\" (UID: \"c2e33bc1-ee7f-461d-9faa-b5678f7cb416\") " pod="openstack-kuttl-tests/barbican-api-5b49d5d76-5r44p" Mar 16 17:13:33 crc kubenswrapper[5120]: I0316 17:13:33.398805 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3ce6e6cf-688e-4f59-8ca2-f3c79e2a1857-logs\") pod \"barbican-worker-5d6b4bc659-md7vt\" (UID: \"3ce6e6cf-688e-4f59-8ca2-f3c79e2a1857\") " pod="openstack-kuttl-tests/barbican-worker-5d6b4bc659-md7vt" Mar 16 17:13:33 crc kubenswrapper[5120]: I0316 17:13:33.405816 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3ce6e6cf-688e-4f59-8ca2-f3c79e2a1857-config-data\") pod \"barbican-worker-5d6b4bc659-md7vt\" (UID: \"3ce6e6cf-688e-4f59-8ca2-f3c79e2a1857\") " pod="openstack-kuttl-tests/barbican-worker-5d6b4bc659-md7vt" Mar 16 17:13:33 crc kubenswrapper[5120]: I0316 17:13:33.432748 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3ce6e6cf-688e-4f59-8ca2-f3c79e2a1857-combined-ca-bundle\") pod \"barbican-worker-5d6b4bc659-md7vt\" (UID: \"3ce6e6cf-688e-4f59-8ca2-f3c79e2a1857\") " pod="openstack-kuttl-tests/barbican-worker-5d6b4bc659-md7vt" Mar 16 17:13:33 crc kubenswrapper[5120]: I0316 17:13:33.433267 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/3ce6e6cf-688e-4f59-8ca2-f3c79e2a1857-config-data-custom\") pod \"barbican-worker-5d6b4bc659-md7vt\" (UID: \"3ce6e6cf-688e-4f59-8ca2-f3c79e2a1857\") " pod="openstack-kuttl-tests/barbican-worker-5d6b4bc659-md7vt" Mar 16 17:13:33 crc kubenswrapper[5120]: I0316 17:13:33.445894 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9v4m\" (UniqueName: \"kubernetes.io/projected/3ce6e6cf-688e-4f59-8ca2-f3c79e2a1857-kube-api-access-g9v4m\") pod \"barbican-worker-5d6b4bc659-md7vt\" (UID: \"3ce6e6cf-688e-4f59-8ca2-f3c79e2a1857\") " pod="openstack-kuttl-tests/barbican-worker-5d6b4bc659-md7vt" Mar 16 17:13:33 crc kubenswrapper[5120]: I0316 17:13:33.446603 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"015b50a4-d550-48a4-a72b-b73b038d7319","Type":"ContainerStarted","Data":"405eba6c3dac0aac47b2593a466380bab7ec7a654d4027fd63512f4e6ed8c038"} Mar 16 17:13:33 crc kubenswrapper[5120]: I0316 17:13:33.452425 5120 generic.go:358] "Generic (PLEG): container finished" podID="9ead6a88-e81b-482d-b510-f5ac67e0018a" containerID="43c8a7153b84c826a75f8426d150a3e21304ab2c4678c238ce60d8e1835763b5" exitCode=0 Mar 16 17:13:33 crc kubenswrapper[5120]: I0316 17:13:33.452499 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-59pw4" event={"ID":"9ead6a88-e81b-482d-b510-f5ac67e0018a","Type":"ContainerDied","Data":"43c8a7153b84c826a75f8426d150a3e21304ab2c4678c238ce60d8e1835763b5"} Mar 16 17:13:33 crc kubenswrapper[5120]: I0316 17:13:33.478264 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-5c4bd8b884-fjd8f" Mar 16 17:13:33 crc kubenswrapper[5120]: I0316 17:13:33.490950 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 17:13:33 crc kubenswrapper[5120]: I0316 17:13:33.503643 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c2e33bc1-ee7f-461d-9faa-b5678f7cb416-logs\") pod \"barbican-api-5b49d5d76-5r44p\" (UID: \"c2e33bc1-ee7f-461d-9faa-b5678f7cb416\") " pod="openstack-kuttl-tests/barbican-api-5b49d5d76-5r44p" Mar 16 17:13:33 crc kubenswrapper[5120]: I0316 17:13:33.503882 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/c2e33bc1-ee7f-461d-9faa-b5678f7cb416-public-tls-certs\") pod \"barbican-api-5b49d5d76-5r44p\" (UID: \"c2e33bc1-ee7f-461d-9faa-b5678f7cb416\") " pod="openstack-kuttl-tests/barbican-api-5b49d5d76-5r44p" Mar 16 17:13:33 crc kubenswrapper[5120]: I0316 17:13:33.504046 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gn67c\" (UniqueName: \"kubernetes.io/projected/c2e33bc1-ee7f-461d-9faa-b5678f7cb416-kube-api-access-gn67c\") pod \"barbican-api-5b49d5d76-5r44p\" (UID: \"c2e33bc1-ee7f-461d-9faa-b5678f7cb416\") " pod="openstack-kuttl-tests/barbican-api-5b49d5d76-5r44p" Mar 16 17:13:33 crc kubenswrapper[5120]: I0316 17:13:33.504147 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/c2e33bc1-ee7f-461d-9faa-b5678f7cb416-internal-tls-certs\") pod \"barbican-api-5b49d5d76-5r44p\" (UID: \"c2e33bc1-ee7f-461d-9faa-b5678f7cb416\") " pod="openstack-kuttl-tests/barbican-api-5b49d5d76-5r44p" Mar 16 17:13:33 crc kubenswrapper[5120]: I0316 17:13:33.506262 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c2e33bc1-ee7f-461d-9faa-b5678f7cb416-logs\") pod \"barbican-api-5b49d5d76-5r44p\" (UID: \"c2e33bc1-ee7f-461d-9faa-b5678f7cb416\") " pod="openstack-kuttl-tests/barbican-api-5b49d5d76-5r44p" Mar 16 17:13:33 crc kubenswrapper[5120]: I0316 17:13:33.516128 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c2e33bc1-ee7f-461d-9faa-b5678f7cb416-config-data\") pod \"barbican-api-5b49d5d76-5r44p\" (UID: \"c2e33bc1-ee7f-461d-9faa-b5678f7cb416\") " pod="openstack-kuttl-tests/barbican-api-5b49d5d76-5r44p" Mar 16 17:13:33 crc kubenswrapper[5120]: I0316 17:13:33.516306 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c2e33bc1-ee7f-461d-9faa-b5678f7cb416-combined-ca-bundle\") pod \"barbican-api-5b49d5d76-5r44p\" (UID: \"c2e33bc1-ee7f-461d-9faa-b5678f7cb416\") " pod="openstack-kuttl-tests/barbican-api-5b49d5d76-5r44p" Mar 16 17:13:33 crc kubenswrapper[5120]: I0316 17:13:33.516419 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/c2e33bc1-ee7f-461d-9faa-b5678f7cb416-config-data-custom\") pod \"barbican-api-5b49d5d76-5r44p\" (UID: \"c2e33bc1-ee7f-461d-9faa-b5678f7cb416\") " pod="openstack-kuttl-tests/barbican-api-5b49d5d76-5r44p" Mar 16 17:13:33 crc kubenswrapper[5120]: I0316 17:13:33.508109 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-5d6b4bc659-md7vt" Mar 16 17:13:33 crc kubenswrapper[5120]: I0316 17:13:33.522112 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/c2e33bc1-ee7f-461d-9faa-b5678f7cb416-public-tls-certs\") pod \"barbican-api-5b49d5d76-5r44p\" (UID: \"c2e33bc1-ee7f-461d-9faa-b5678f7cb416\") " pod="openstack-kuttl-tests/barbican-api-5b49d5d76-5r44p" Mar 16 17:13:33 crc kubenswrapper[5120]: I0316 17:13:33.530391 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/c2e33bc1-ee7f-461d-9faa-b5678f7cb416-config-data-custom\") pod \"barbican-api-5b49d5d76-5r44p\" (UID: \"c2e33bc1-ee7f-461d-9faa-b5678f7cb416\") " pod="openstack-kuttl-tests/barbican-api-5b49d5d76-5r44p" Mar 16 17:13:33 crc kubenswrapper[5120]: I0316 17:13:33.530751 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c2e33bc1-ee7f-461d-9faa-b5678f7cb416-config-data\") pod \"barbican-api-5b49d5d76-5r44p\" (UID: \"c2e33bc1-ee7f-461d-9faa-b5678f7cb416\") " pod="openstack-kuttl-tests/barbican-api-5b49d5d76-5r44p" Mar 16 17:13:33 crc kubenswrapper[5120]: I0316 17:13:33.551168 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/c2e33bc1-ee7f-461d-9faa-b5678f7cb416-internal-tls-certs\") pod \"barbican-api-5b49d5d76-5r44p\" (UID: \"c2e33bc1-ee7f-461d-9faa-b5678f7cb416\") " pod="openstack-kuttl-tests/barbican-api-5b49d5d76-5r44p" Mar 16 17:13:33 crc kubenswrapper[5120]: I0316 17:13:33.551964 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gn67c\" (UniqueName: \"kubernetes.io/projected/c2e33bc1-ee7f-461d-9faa-b5678f7cb416-kube-api-access-gn67c\") pod \"barbican-api-5b49d5d76-5r44p\" (UID: \"c2e33bc1-ee7f-461d-9faa-b5678f7cb416\") " pod="openstack-kuttl-tests/barbican-api-5b49d5d76-5r44p" Mar 16 17:13:33 crc kubenswrapper[5120]: I0316 17:13:33.552464 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c2e33bc1-ee7f-461d-9faa-b5678f7cb416-combined-ca-bundle\") pod \"barbican-api-5b49d5d76-5r44p\" (UID: \"c2e33bc1-ee7f-461d-9faa-b5678f7cb416\") " pod="openstack-kuttl-tests/barbican-api-5b49d5d76-5r44p" Mar 16 17:13:33 crc kubenswrapper[5120]: I0316 17:13:33.558363 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-5b49d5d76-5r44p" Mar 16 17:13:33 crc kubenswrapper[5120]: I0316 17:13:33.971952 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:13:34 crc kubenswrapper[5120]: I0316 17:13:34.109298 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-5c4bd8b884-fjd8f"] Mar 16 17:13:34 crc kubenswrapper[5120]: I0316 17:13:34.144283 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-5d6b4bc659-md7vt"] Mar 16 17:13:34 crc kubenswrapper[5120]: W0316 17:13:34.171998 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfcf5af95_be92_4701_9e16_491dbbea165d.slice/crio-e3c4e932ab34eb11acc27a3f8fbc015f11ac25214932d8401549085750ffaab7 WatchSource:0}: Error finding container e3c4e932ab34eb11acc27a3f8fbc015f11ac25214932d8401549085750ffaab7: Status 404 returned error can't find the container with id e3c4e932ab34eb11acc27a3f8fbc015f11ac25214932d8401549085750ffaab7 Mar 16 17:13:34 crc kubenswrapper[5120]: I0316 17:13:34.380619 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-5b49d5d76-5r44p"] Mar 16 17:13:34 crc kubenswrapper[5120]: W0316 17:13:34.432152 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc2e33bc1_ee7f_461d_9faa_b5678f7cb416.slice/crio-5289ad176f72ac318ad6aba7bd10f14c42a070c205ad39b8a0f1f10bf0cc0bfb WatchSource:0}: Error finding container 5289ad176f72ac318ad6aba7bd10f14c42a070c205ad39b8a0f1f10bf0cc0bfb: Status 404 returned error can't find the container with id 5289ad176f72ac318ad6aba7bd10f14c42a070c205ad39b8a0f1f10bf0cc0bfb Mar 16 17:13:34 crc kubenswrapper[5120]: I0316 17:13:34.478355 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-5b49d5d76-5r44p" event={"ID":"c2e33bc1-ee7f-461d-9faa-b5678f7cb416","Type":"ContainerStarted","Data":"5289ad176f72ac318ad6aba7bd10f14c42a070c205ad39b8a0f1f10bf0cc0bfb"} Mar 16 17:13:34 crc kubenswrapper[5120]: I0316 17:13:34.488538 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-5c4bd8b884-fjd8f" event={"ID":"fcf5af95-be92-4701-9e16-491dbbea165d","Type":"ContainerStarted","Data":"e3c4e932ab34eb11acc27a3f8fbc015f11ac25214932d8401549085750ffaab7"} Mar 16 17:13:34 crc kubenswrapper[5120]: I0316 17:13:34.491024 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-5d6b4bc659-md7vt" event={"ID":"3ce6e6cf-688e-4f59-8ca2-f3c79e2a1857","Type":"ContainerStarted","Data":"b924c5c53f9c77c99fc6cb113d520ee644454aca96d90626146c58d00c8bf96b"} Mar 16 17:13:34 crc kubenswrapper[5120]: I0316 17:13:34.518106 5120 generic.go:358] "Generic (PLEG): container finished" podID="24f83ac4-b285-47e8-94e0-9b47da8c5928" containerID="3edc568db612fad0b01bc312a6630be1d7ff70d8485d636c8539653e799955c5" exitCode=143 Mar 16 17:13:34 crc kubenswrapper[5120]: I0316 17:13:34.518389 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-67f6766cc8-lpvm7" event={"ID":"24f83ac4-b285-47e8-94e0-9b47da8c5928","Type":"ContainerDied","Data":"3edc568db612fad0b01bc312a6630be1d7ff70d8485d636c8539653e799955c5"} Mar 16 17:13:35 crc kubenswrapper[5120]: I0316 17:13:35.009099 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-59pw4" Mar 16 17:13:35 crc kubenswrapper[5120]: I0316 17:13:35.093706 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vlkdt\" (UniqueName: \"kubernetes.io/projected/9ead6a88-e81b-482d-b510-f5ac67e0018a-kube-api-access-vlkdt\") pod \"9ead6a88-e81b-482d-b510-f5ac67e0018a\" (UID: \"9ead6a88-e81b-482d-b510-f5ac67e0018a\") " Mar 16 17:13:35 crc kubenswrapper[5120]: I0316 17:13:35.094061 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/9ead6a88-e81b-482d-b510-f5ac67e0018a-config\") pod \"9ead6a88-e81b-482d-b510-f5ac67e0018a\" (UID: \"9ead6a88-e81b-482d-b510-f5ac67e0018a\") " Mar 16 17:13:35 crc kubenswrapper[5120]: I0316 17:13:35.094152 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9ead6a88-e81b-482d-b510-f5ac67e0018a-combined-ca-bundle\") pod \"9ead6a88-e81b-482d-b510-f5ac67e0018a\" (UID: \"9ead6a88-e81b-482d-b510-f5ac67e0018a\") " Mar 16 17:13:35 crc kubenswrapper[5120]: I0316 17:13:35.100633 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ead6a88-e81b-482d-b510-f5ac67e0018a-kube-api-access-vlkdt" (OuterVolumeSpecName: "kube-api-access-vlkdt") pod "9ead6a88-e81b-482d-b510-f5ac67e0018a" (UID: "9ead6a88-e81b-482d-b510-f5ac67e0018a"). InnerVolumeSpecName "kube-api-access-vlkdt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:13:35 crc kubenswrapper[5120]: I0316 17:13:35.200392 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vlkdt\" (UniqueName: \"kubernetes.io/projected/9ead6a88-e81b-482d-b510-f5ac67e0018a-kube-api-access-vlkdt\") on node \"crc\" DevicePath \"\"" Mar 16 17:13:35 crc kubenswrapper[5120]: I0316 17:13:35.227246 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ead6a88-e81b-482d-b510-f5ac67e0018a-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "9ead6a88-e81b-482d-b510-f5ac67e0018a" (UID: "9ead6a88-e81b-482d-b510-f5ac67e0018a"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:13:35 crc kubenswrapper[5120]: I0316 17:13:35.246910 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ead6a88-e81b-482d-b510-f5ac67e0018a-config" (OuterVolumeSpecName: "config") pod "9ead6a88-e81b-482d-b510-f5ac67e0018a" (UID: "9ead6a88-e81b-482d-b510-f5ac67e0018a"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:13:35 crc kubenswrapper[5120]: I0316 17:13:35.303384 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/9ead6a88-e81b-482d-b510-f5ac67e0018a-config\") on node \"crc\" DevicePath \"\"" Mar 16 17:13:35 crc kubenswrapper[5120]: I0316 17:13:35.303416 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9ead6a88-e81b-482d-b510-f5ac67e0018a-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:13:35 crc kubenswrapper[5120]: I0316 17:13:35.537099 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-5d6b4bc659-md7vt" event={"ID":"3ce6e6cf-688e-4f59-8ca2-f3c79e2a1857","Type":"ContainerStarted","Data":"48ca29deeb5b87ce933a4ad925ce32bca80c4d92aaa4dcb028add038eef91294"} Mar 16 17:13:35 crc kubenswrapper[5120]: I0316 17:13:35.537461 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-5d6b4bc659-md7vt" event={"ID":"3ce6e6cf-688e-4f59-8ca2-f3c79e2a1857","Type":"ContainerStarted","Data":"880d0ca08b00931b006e4aa507711a2f5a37cf65567008eb271716928427a38d"} Mar 16 17:13:35 crc kubenswrapper[5120]: I0316 17:13:35.549959 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"015b50a4-d550-48a4-a72b-b73b038d7319","Type":"ContainerStarted","Data":"65347cc7ac37e345bf4d0b8360039f1b9c493b684433c44ebb97b3fa9d240de5"} Mar 16 17:13:35 crc kubenswrapper[5120]: I0316 17:13:35.553607 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-59pw4" event={"ID":"9ead6a88-e81b-482d-b510-f5ac67e0018a","Type":"ContainerDied","Data":"cbe46132eba895973a66a41da841567b3461d58cba9334d195d2672d887141d8"} Mar 16 17:13:35 crc kubenswrapper[5120]: I0316 17:13:35.553676 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cbe46132eba895973a66a41da841567b3461d58cba9334d195d2672d887141d8" Mar 16 17:13:35 crc kubenswrapper[5120]: I0316 17:13:35.553799 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-59pw4" Mar 16 17:13:35 crc kubenswrapper[5120]: I0316 17:13:35.582130 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-worker-5d6b4bc659-md7vt" podStartSLOduration=2.5821078269999997 podStartE2EDuration="2.582107827s" podCreationTimestamp="2026-03-16 17:13:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:13:35.575474027 +0000 UTC m=+6117.729405694" watchObservedRunningTime="2026-03-16 17:13:35.582107827 +0000 UTC m=+6117.736039484" Mar 16 17:13:35 crc kubenswrapper[5120]: I0316 17:13:35.636787 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-5b49d5d76-5r44p" event={"ID":"c2e33bc1-ee7f-461d-9faa-b5678f7cb416","Type":"ContainerStarted","Data":"94b5a95d3401ba6aca2c4eea6b8e4a63e4758571456a4be6ec2da46ee9dfd215"} Mar 16 17:13:35 crc kubenswrapper[5120]: I0316 17:13:35.636846 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-5b49d5d76-5r44p" event={"ID":"c2e33bc1-ee7f-461d-9faa-b5678f7cb416","Type":"ContainerStarted","Data":"5a608768c816e759b1547b4e7085b9239ee5a3b88e54a9ac9ed87d76d8f06f24"} Mar 16 17:13:35 crc kubenswrapper[5120]: I0316 17:13:35.639623 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-5b49d5d76-5r44p" Mar 16 17:13:35 crc kubenswrapper[5120]: I0316 17:13:35.639942 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-5b49d5d76-5r44p" Mar 16 17:13:35 crc kubenswrapper[5120]: I0316 17:13:35.654516 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-7c959f78ff-5lv92"] Mar 16 17:13:35 crc kubenswrapper[5120]: I0316 17:13:35.654884 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-7c959f78ff-5lv92" podUID="1ae5285c-173c-4162-9610-3f9c3a4ef47b" containerName="barbican-worker-log" containerID="cri-o://43c66043e906f70f9409ae93a14e15c6f5b22c5773198f562df0de0765be8326" gracePeriod=30 Mar 16 17:13:35 crc kubenswrapper[5120]: I0316 17:13:35.655036 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-7c959f78ff-5lv92" podUID="1ae5285c-173c-4162-9610-3f9c3a4ef47b" containerName="barbican-worker" containerID="cri-o://294a45e764273363d5c21b3cadd1204356e4035b46b616bebe50cd478a038435" gracePeriod=30 Mar 16 17:13:35 crc kubenswrapper[5120]: I0316 17:13:35.681212 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-7d8bb7fd99-qr5kw"] Mar 16 17:13:35 crc kubenswrapper[5120]: I0316 17:13:35.682434 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ead6a88-e81b-482d-b510-f5ac67e0018a" containerName="neutron-db-sync" Mar 16 17:13:35 crc kubenswrapper[5120]: I0316 17:13:35.682454 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ead6a88-e81b-482d-b510-f5ac67e0018a" containerName="neutron-db-sync" Mar 16 17:13:35 crc kubenswrapper[5120]: I0316 17:13:35.682631 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="9ead6a88-e81b-482d-b510-f5ac67e0018a" containerName="neutron-db-sync" Mar 16 17:13:35 crc kubenswrapper[5120]: I0316 17:13:35.688872 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-7d8bb7fd99-qr5kw" Mar 16 17:13:35 crc kubenswrapper[5120]: I0316 17:13:35.698434 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-5c4bd8b884-fjd8f" event={"ID":"fcf5af95-be92-4701-9e16-491dbbea165d","Type":"ContainerStarted","Data":"8c1773e53f9dc1cdc250238927d3be0667d25036b8ce26c49878ed36ef7c810b"} Mar 16 17:13:35 crc kubenswrapper[5120]: I0316 17:13:35.698475 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-5c4bd8b884-fjd8f" event={"ID":"fcf5af95-be92-4701-9e16-491dbbea165d","Type":"ContainerStarted","Data":"66383c38399360c6ccf172717731d52c81d8ad01696fcdb9c511bd983f463335"} Mar 16 17:13:35 crc kubenswrapper[5120]: I0316 17:13:35.700118 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-httpd-config\"" Mar 16 17:13:35 crc kubenswrapper[5120]: I0316 17:13:35.700331 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-config\"" Mar 16 17:13:35 crc kubenswrapper[5120]: I0316 17:13:35.700500 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-neutron-dockercfg-f8t2x\"" Mar 16 17:13:35 crc kubenswrapper[5120]: I0316 17:13:35.700877 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-neutron-ovndbs\"" Mar 16 17:13:35 crc kubenswrapper[5120]: I0316 17:13:35.703967 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-7d8bb7fd99-qr5kw"] Mar 16 17:13:35 crc kubenswrapper[5120]: I0316 17:13:35.760026 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-api-5b49d5d76-5r44p" podStartSLOduration=2.760000335 podStartE2EDuration="2.760000335s" podCreationTimestamp="2026-03-16 17:13:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:13:35.678812864 +0000 UTC m=+6117.832744541" watchObservedRunningTime="2026-03-16 17:13:35.760000335 +0000 UTC m=+6117.913932002" Mar 16 17:13:35 crc kubenswrapper[5120]: I0316 17:13:35.783600 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-keystone-listener-5c4bd8b884-fjd8f" podStartSLOduration=2.783578 podStartE2EDuration="2.783578s" podCreationTimestamp="2026-03-16 17:13:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:13:35.723723883 +0000 UTC m=+6117.877655540" watchObservedRunningTime="2026-03-16 17:13:35.783578 +0000 UTC m=+6117.937509667" Mar 16 17:13:35 crc kubenswrapper[5120]: I0316 17:13:35.821481 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/afbb203b-f5f2-4850-83de-e37987e383c9-combined-ca-bundle\") pod \"neutron-7d8bb7fd99-qr5kw\" (UID: \"afbb203b-f5f2-4850-83de-e37987e383c9\") " pod="openstack-kuttl-tests/neutron-7d8bb7fd99-qr5kw" Mar 16 17:13:35 crc kubenswrapper[5120]: I0316 17:13:35.821710 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/afbb203b-f5f2-4850-83de-e37987e383c9-httpd-config\") pod \"neutron-7d8bb7fd99-qr5kw\" (UID: \"afbb203b-f5f2-4850-83de-e37987e383c9\") " pod="openstack-kuttl-tests/neutron-7d8bb7fd99-qr5kw" Mar 16 17:13:35 crc kubenswrapper[5120]: I0316 17:13:35.821856 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/afbb203b-f5f2-4850-83de-e37987e383c9-ovndb-tls-certs\") pod \"neutron-7d8bb7fd99-qr5kw\" (UID: \"afbb203b-f5f2-4850-83de-e37987e383c9\") " pod="openstack-kuttl-tests/neutron-7d8bb7fd99-qr5kw" Mar 16 17:13:35 crc kubenswrapper[5120]: I0316 17:13:35.822218 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vd6hf\" (UniqueName: \"kubernetes.io/projected/afbb203b-f5f2-4850-83de-e37987e383c9-kube-api-access-vd6hf\") pod \"neutron-7d8bb7fd99-qr5kw\" (UID: \"afbb203b-f5f2-4850-83de-e37987e383c9\") " pod="openstack-kuttl-tests/neutron-7d8bb7fd99-qr5kw" Mar 16 17:13:35 crc kubenswrapper[5120]: I0316 17:13:35.822254 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/afbb203b-f5f2-4850-83de-e37987e383c9-config\") pod \"neutron-7d8bb7fd99-qr5kw\" (UID: \"afbb203b-f5f2-4850-83de-e37987e383c9\") " pod="openstack-kuttl-tests/neutron-7d8bb7fd99-qr5kw" Mar 16 17:13:35 crc kubenswrapper[5120]: I0316 17:13:35.866521 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-75c7b8c84b-ckzdf"] Mar 16 17:13:35 crc kubenswrapper[5120]: I0316 17:13:35.866859 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-75c7b8c84b-ckzdf" podUID="59a6de62-1f3e-48b3-b377-4a582f759b5b" containerName="barbican-keystone-listener-log" containerID="cri-o://9685938fad2613a5505b0b2539c08389dfeddd3eaefd68d93e1d3acf1eaa8047" gracePeriod=30 Mar 16 17:13:35 crc kubenswrapper[5120]: I0316 17:13:35.871083 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-75c7b8c84b-ckzdf" podUID="59a6de62-1f3e-48b3-b377-4a582f759b5b" containerName="barbican-keystone-listener" containerID="cri-o://baed72a6239409dd140c1260daff487672bacf7c3d16715b6e4af9d1ad0321a8" gracePeriod=30 Mar 16 17:13:35 crc kubenswrapper[5120]: I0316 17:13:35.882018 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:13:35 crc kubenswrapper[5120]: I0316 17:13:35.882341 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="c977fa4c-2763-4ab0-8485-4a1a352be4ba" containerName="ceilometer-central-agent" containerID="cri-o://a1ceb8dd748c8c52178f987c7b62681275ac116d9ea201bab52bfb1dc8096418" gracePeriod=30 Mar 16 17:13:35 crc kubenswrapper[5120]: I0316 17:13:35.882873 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="c977fa4c-2763-4ab0-8485-4a1a352be4ba" containerName="proxy-httpd" containerID="cri-o://0e7dcc83886e7b4d4c3871eefcb6ec5dc38fcd307a14b3a4b098bf28b024754b" gracePeriod=30 Mar 16 17:13:35 crc kubenswrapper[5120]: I0316 17:13:35.883057 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="c977fa4c-2763-4ab0-8485-4a1a352be4ba" containerName="ceilometer-notification-agent" containerID="cri-o://2b79273a58a77a92f773616e582f0045dd755cd4e4190c7b66f622825d0c44fe" gracePeriod=30 Mar 16 17:13:35 crc kubenswrapper[5120]: I0316 17:13:35.883097 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="c977fa4c-2763-4ab0-8485-4a1a352be4ba" containerName="sg-core" containerID="cri-o://bac3a3f45e8e1926a12ebdfa9b7e4c91e3f6894466094c639d35c11a4e5e822c" gracePeriod=30 Mar 16 17:13:35 crc kubenswrapper[5120]: I0316 17:13:35.905357 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/ceilometer-0" podUID="c977fa4c-2763-4ab0-8485-4a1a352be4ba" containerName="proxy-httpd" probeResult="failure" output="HTTP probe failed with statuscode: 502" Mar 16 17:13:35 crc kubenswrapper[5120]: I0316 17:13:35.924977 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/afbb203b-f5f2-4850-83de-e37987e383c9-httpd-config\") pod \"neutron-7d8bb7fd99-qr5kw\" (UID: \"afbb203b-f5f2-4850-83de-e37987e383c9\") " pod="openstack-kuttl-tests/neutron-7d8bb7fd99-qr5kw" Mar 16 17:13:35 crc kubenswrapper[5120]: I0316 17:13:35.925055 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/afbb203b-f5f2-4850-83de-e37987e383c9-ovndb-tls-certs\") pod \"neutron-7d8bb7fd99-qr5kw\" (UID: \"afbb203b-f5f2-4850-83de-e37987e383c9\") " pod="openstack-kuttl-tests/neutron-7d8bb7fd99-qr5kw" Mar 16 17:13:35 crc kubenswrapper[5120]: I0316 17:13:35.925192 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vd6hf\" (UniqueName: \"kubernetes.io/projected/afbb203b-f5f2-4850-83de-e37987e383c9-kube-api-access-vd6hf\") pod \"neutron-7d8bb7fd99-qr5kw\" (UID: \"afbb203b-f5f2-4850-83de-e37987e383c9\") " pod="openstack-kuttl-tests/neutron-7d8bb7fd99-qr5kw" Mar 16 17:13:35 crc kubenswrapper[5120]: I0316 17:13:35.925215 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/afbb203b-f5f2-4850-83de-e37987e383c9-config\") pod \"neutron-7d8bb7fd99-qr5kw\" (UID: \"afbb203b-f5f2-4850-83de-e37987e383c9\") " pod="openstack-kuttl-tests/neutron-7d8bb7fd99-qr5kw" Mar 16 17:13:35 crc kubenswrapper[5120]: I0316 17:13:35.925404 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/afbb203b-f5f2-4850-83de-e37987e383c9-combined-ca-bundle\") pod \"neutron-7d8bb7fd99-qr5kw\" (UID: \"afbb203b-f5f2-4850-83de-e37987e383c9\") " pod="openstack-kuttl-tests/neutron-7d8bb7fd99-qr5kw" Mar 16 17:13:35 crc kubenswrapper[5120]: I0316 17:13:35.931537 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/afbb203b-f5f2-4850-83de-e37987e383c9-combined-ca-bundle\") pod \"neutron-7d8bb7fd99-qr5kw\" (UID: \"afbb203b-f5f2-4850-83de-e37987e383c9\") " pod="openstack-kuttl-tests/neutron-7d8bb7fd99-qr5kw" Mar 16 17:13:35 crc kubenswrapper[5120]: I0316 17:13:35.931712 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/afbb203b-f5f2-4850-83de-e37987e383c9-ovndb-tls-certs\") pod \"neutron-7d8bb7fd99-qr5kw\" (UID: \"afbb203b-f5f2-4850-83de-e37987e383c9\") " pod="openstack-kuttl-tests/neutron-7d8bb7fd99-qr5kw" Mar 16 17:13:35 crc kubenswrapper[5120]: I0316 17:13:35.937641 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/afbb203b-f5f2-4850-83de-e37987e383c9-httpd-config\") pod \"neutron-7d8bb7fd99-qr5kw\" (UID: \"afbb203b-f5f2-4850-83de-e37987e383c9\") " pod="openstack-kuttl-tests/neutron-7d8bb7fd99-qr5kw" Mar 16 17:13:35 crc kubenswrapper[5120]: I0316 17:13:35.946667 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vd6hf\" (UniqueName: \"kubernetes.io/projected/afbb203b-f5f2-4850-83de-e37987e383c9-kube-api-access-vd6hf\") pod \"neutron-7d8bb7fd99-qr5kw\" (UID: \"afbb203b-f5f2-4850-83de-e37987e383c9\") " pod="openstack-kuttl-tests/neutron-7d8bb7fd99-qr5kw" Mar 16 17:13:35 crc kubenswrapper[5120]: I0316 17:13:35.966576 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/afbb203b-f5f2-4850-83de-e37987e383c9-config\") pod \"neutron-7d8bb7fd99-qr5kw\" (UID: \"afbb203b-f5f2-4850-83de-e37987e383c9\") " pod="openstack-kuttl-tests/neutron-7d8bb7fd99-qr5kw" Mar 16 17:13:36 crc kubenswrapper[5120]: I0316 17:13:36.040181 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-7d8bb7fd99-qr5kw" Mar 16 17:13:36 crc kubenswrapper[5120]: W0316 17:13:36.590506 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podafbb203b_f5f2_4850_83de_e37987e383c9.slice/crio-e2a76b08b7b18bb2b6aec4489a172dd48665f2029986a9cbc13b443e9ca82e9f WatchSource:0}: Error finding container e2a76b08b7b18bb2b6aec4489a172dd48665f2029986a9cbc13b443e9ca82e9f: Status 404 returned error can't find the container with id e2a76b08b7b18bb2b6aec4489a172dd48665f2029986a9cbc13b443e9ca82e9f Mar 16 17:13:36 crc kubenswrapper[5120]: I0316 17:13:36.591123 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-7d8bb7fd99-qr5kw"] Mar 16 17:13:36 crc kubenswrapper[5120]: I0316 17:13:36.721741 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-7d8bb7fd99-qr5kw" event={"ID":"afbb203b-f5f2-4850-83de-e37987e383c9","Type":"ContainerStarted","Data":"e2a76b08b7b18bb2b6aec4489a172dd48665f2029986a9cbc13b443e9ca82e9f"} Mar 16 17:13:36 crc kubenswrapper[5120]: I0316 17:13:36.724691 5120 generic.go:358] "Generic (PLEG): container finished" podID="1ae5285c-173c-4162-9610-3f9c3a4ef47b" containerID="43c66043e906f70f9409ae93a14e15c6f5b22c5773198f562df0de0765be8326" exitCode=143 Mar 16 17:13:36 crc kubenswrapper[5120]: I0316 17:13:36.724838 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-7c959f78ff-5lv92" event={"ID":"1ae5285c-173c-4162-9610-3f9c3a4ef47b","Type":"ContainerDied","Data":"43c66043e906f70f9409ae93a14e15c6f5b22c5773198f562df0de0765be8326"} Mar 16 17:13:36 crc kubenswrapper[5120]: I0316 17:13:36.727010 5120 generic.go:358] "Generic (PLEG): container finished" podID="c977fa4c-2763-4ab0-8485-4a1a352be4ba" containerID="0e7dcc83886e7b4d4c3871eefcb6ec5dc38fcd307a14b3a4b098bf28b024754b" exitCode=0 Mar 16 17:13:36 crc kubenswrapper[5120]: I0316 17:13:36.727028 5120 generic.go:358] "Generic (PLEG): container finished" podID="c977fa4c-2763-4ab0-8485-4a1a352be4ba" containerID="bac3a3f45e8e1926a12ebdfa9b7e4c91e3f6894466094c639d35c11a4e5e822c" exitCode=2 Mar 16 17:13:36 crc kubenswrapper[5120]: I0316 17:13:36.727036 5120 generic.go:358] "Generic (PLEG): container finished" podID="c977fa4c-2763-4ab0-8485-4a1a352be4ba" containerID="a1ceb8dd748c8c52178f987c7b62681275ac116d9ea201bab52bfb1dc8096418" exitCode=0 Mar 16 17:13:36 crc kubenswrapper[5120]: I0316 17:13:36.727305 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"c977fa4c-2763-4ab0-8485-4a1a352be4ba","Type":"ContainerDied","Data":"0e7dcc83886e7b4d4c3871eefcb6ec5dc38fcd307a14b3a4b098bf28b024754b"} Mar 16 17:13:36 crc kubenswrapper[5120]: I0316 17:13:36.727327 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"c977fa4c-2763-4ab0-8485-4a1a352be4ba","Type":"ContainerDied","Data":"bac3a3f45e8e1926a12ebdfa9b7e4c91e3f6894466094c639d35c11a4e5e822c"} Mar 16 17:13:36 crc kubenswrapper[5120]: I0316 17:13:36.727336 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"c977fa4c-2763-4ab0-8485-4a1a352be4ba","Type":"ContainerDied","Data":"a1ceb8dd748c8c52178f987c7b62681275ac116d9ea201bab52bfb1dc8096418"} Mar 16 17:13:36 crc kubenswrapper[5120]: I0316 17:13:36.732409 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"015b50a4-d550-48a4-a72b-b73b038d7319","Type":"ContainerStarted","Data":"264741933cb9afb14a33b8204211f72d0e94ada20e39cd620593694396a63ed3"} Mar 16 17:13:36 crc kubenswrapper[5120]: I0316 17:13:36.734055 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:13:36 crc kubenswrapper[5120]: I0316 17:13:36.739697 5120 generic.go:358] "Generic (PLEG): container finished" podID="59a6de62-1f3e-48b3-b377-4a582f759b5b" containerID="9685938fad2613a5505b0b2539c08389dfeddd3eaefd68d93e1d3acf1eaa8047" exitCode=143 Mar 16 17:13:36 crc kubenswrapper[5120]: I0316 17:13:36.740797 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-75c7b8c84b-ckzdf" event={"ID":"59a6de62-1f3e-48b3-b377-4a582f759b5b","Type":"ContainerDied","Data":"9685938fad2613a5505b0b2539c08389dfeddd3eaefd68d93e1d3acf1eaa8047"} Mar 16 17:13:36 crc kubenswrapper[5120]: I0316 17:13:36.781200 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-api-0" podStartSLOduration=4.781178354 podStartE2EDuration="4.781178354s" podCreationTimestamp="2026-03-16 17:13:32 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:13:36.755928193 +0000 UTC m=+6118.909859870" watchObservedRunningTime="2026-03-16 17:13:36.781178354 +0000 UTC m=+6118.935110011" Mar 16 17:13:37 crc kubenswrapper[5120]: I0316 17:13:37.048281 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:13:37 crc kubenswrapper[5120]: I0316 17:13:37.104410 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 17:13:37 crc kubenswrapper[5120]: I0316 17:13:37.145966 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:13:37 crc kubenswrapper[5120]: I0316 17:13:37.183018 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c977fa4c-2763-4ab0-8485-4a1a352be4ba-run-httpd\") pod \"c977fa4c-2763-4ab0-8485-4a1a352be4ba\" (UID: \"c977fa4c-2763-4ab0-8485-4a1a352be4ba\") " Mar 16 17:13:37 crc kubenswrapper[5120]: I0316 17:13:37.183254 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c977fa4c-2763-4ab0-8485-4a1a352be4ba-scripts\") pod \"c977fa4c-2763-4ab0-8485-4a1a352be4ba\" (UID: \"c977fa4c-2763-4ab0-8485-4a1a352be4ba\") " Mar 16 17:13:37 crc kubenswrapper[5120]: I0316 17:13:37.183290 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c977fa4c-2763-4ab0-8485-4a1a352be4ba-log-httpd\") pod \"c977fa4c-2763-4ab0-8485-4a1a352be4ba\" (UID: \"c977fa4c-2763-4ab0-8485-4a1a352be4ba\") " Mar 16 17:13:37 crc kubenswrapper[5120]: I0316 17:13:37.183661 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c977fa4c-2763-4ab0-8485-4a1a352be4ba-combined-ca-bundle\") pod \"c977fa4c-2763-4ab0-8485-4a1a352be4ba\" (UID: \"c977fa4c-2763-4ab0-8485-4a1a352be4ba\") " Mar 16 17:13:37 crc kubenswrapper[5120]: I0316 17:13:37.183813 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/c977fa4c-2763-4ab0-8485-4a1a352be4ba-sg-core-conf-yaml\") pod \"c977fa4c-2763-4ab0-8485-4a1a352be4ba\" (UID: \"c977fa4c-2763-4ab0-8485-4a1a352be4ba\") " Mar 16 17:13:37 crc kubenswrapper[5120]: I0316 17:13:37.184028 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qb8qv\" (UniqueName: \"kubernetes.io/projected/c977fa4c-2763-4ab0-8485-4a1a352be4ba-kube-api-access-qb8qv\") pod \"c977fa4c-2763-4ab0-8485-4a1a352be4ba\" (UID: \"c977fa4c-2763-4ab0-8485-4a1a352be4ba\") " Mar 16 17:13:37 crc kubenswrapper[5120]: I0316 17:13:37.184257 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c977fa4c-2763-4ab0-8485-4a1a352be4ba-config-data\") pod \"c977fa4c-2763-4ab0-8485-4a1a352be4ba\" (UID: \"c977fa4c-2763-4ab0-8485-4a1a352be4ba\") " Mar 16 17:13:37 crc kubenswrapper[5120]: I0316 17:13:37.184861 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c977fa4c-2763-4ab0-8485-4a1a352be4ba-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "c977fa4c-2763-4ab0-8485-4a1a352be4ba" (UID: "c977fa4c-2763-4ab0-8485-4a1a352be4ba"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:13:37 crc kubenswrapper[5120]: I0316 17:13:37.185393 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c977fa4c-2763-4ab0-8485-4a1a352be4ba-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 17:13:37 crc kubenswrapper[5120]: I0316 17:13:37.185554 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c977fa4c-2763-4ab0-8485-4a1a352be4ba-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "c977fa4c-2763-4ab0-8485-4a1a352be4ba" (UID: "c977fa4c-2763-4ab0-8485-4a1a352be4ba"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:13:37 crc kubenswrapper[5120]: I0316 17:13:37.194934 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c977fa4c-2763-4ab0-8485-4a1a352be4ba-scripts" (OuterVolumeSpecName: "scripts") pod "c977fa4c-2763-4ab0-8485-4a1a352be4ba" (UID: "c977fa4c-2763-4ab0-8485-4a1a352be4ba"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:13:37 crc kubenswrapper[5120]: I0316 17:13:37.217700 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c977fa4c-2763-4ab0-8485-4a1a352be4ba-kube-api-access-qb8qv" (OuterVolumeSpecName: "kube-api-access-qb8qv") pod "c977fa4c-2763-4ab0-8485-4a1a352be4ba" (UID: "c977fa4c-2763-4ab0-8485-4a1a352be4ba"). InnerVolumeSpecName "kube-api-access-qb8qv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:13:37 crc kubenswrapper[5120]: I0316 17:13:37.251554 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c977fa4c-2763-4ab0-8485-4a1a352be4ba-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "c977fa4c-2763-4ab0-8485-4a1a352be4ba" (UID: "c977fa4c-2763-4ab0-8485-4a1a352be4ba"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:13:37 crc kubenswrapper[5120]: I0316 17:13:37.288521 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c977fa4c-2763-4ab0-8485-4a1a352be4ba-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:13:37 crc kubenswrapper[5120]: I0316 17:13:37.288565 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/c977fa4c-2763-4ab0-8485-4a1a352be4ba-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 17:13:37 crc kubenswrapper[5120]: I0316 17:13:37.288584 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qb8qv\" (UniqueName: \"kubernetes.io/projected/c977fa4c-2763-4ab0-8485-4a1a352be4ba-kube-api-access-qb8qv\") on node \"crc\" DevicePath \"\"" Mar 16 17:13:37 crc kubenswrapper[5120]: I0316 17:13:37.288596 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c977fa4c-2763-4ab0-8485-4a1a352be4ba-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 17:13:37 crc kubenswrapper[5120]: I0316 17:13:37.312541 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c977fa4c-2763-4ab0-8485-4a1a352be4ba-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "c977fa4c-2763-4ab0-8485-4a1a352be4ba" (UID: "c977fa4c-2763-4ab0-8485-4a1a352be4ba"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:13:37 crc kubenswrapper[5120]: I0316 17:13:37.373990 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c977fa4c-2763-4ab0-8485-4a1a352be4ba-config-data" (OuterVolumeSpecName: "config-data") pod "c977fa4c-2763-4ab0-8485-4a1a352be4ba" (UID: "c977fa4c-2763-4ab0-8485-4a1a352be4ba"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:13:37 crc kubenswrapper[5120]: I0316 17:13:37.378993 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 17:13:37 crc kubenswrapper[5120]: I0316 17:13:37.391838 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c977fa4c-2763-4ab0-8485-4a1a352be4ba-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:13:37 crc kubenswrapper[5120]: I0316 17:13:37.391885 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c977fa4c-2763-4ab0-8485-4a1a352be4ba-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:13:37 crc kubenswrapper[5120]: I0316 17:13:37.780338 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-7d8bb7fd99-qr5kw" event={"ID":"afbb203b-f5f2-4850-83de-e37987e383c9","Type":"ContainerStarted","Data":"96165a2d847ec7587a1c221b258473f64e660e2d48830e90eded046360c68adf"} Mar 16 17:13:37 crc kubenswrapper[5120]: I0316 17:13:37.780946 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/neutron-7d8bb7fd99-qr5kw" Mar 16 17:13:37 crc kubenswrapper[5120]: I0316 17:13:37.780985 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-7d8bb7fd99-qr5kw" event={"ID":"afbb203b-f5f2-4850-83de-e37987e383c9","Type":"ContainerStarted","Data":"e05a433f16dc8224732a75f21bd8552a793c5d7cf2cf319ee8c5d76a5a380f34"} Mar 16 17:13:37 crc kubenswrapper[5120]: I0316 17:13:37.785963 5120 generic.go:358] "Generic (PLEG): container finished" podID="c977fa4c-2763-4ab0-8485-4a1a352be4ba" containerID="2b79273a58a77a92f773616e582f0045dd755cd4e4190c7b66f622825d0c44fe" exitCode=0 Mar 16 17:13:37 crc kubenswrapper[5120]: I0316 17:13:37.786056 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:13:37 crc kubenswrapper[5120]: I0316 17:13:37.786096 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"c977fa4c-2763-4ab0-8485-4a1a352be4ba","Type":"ContainerDied","Data":"2b79273a58a77a92f773616e582f0045dd755cd4e4190c7b66f622825d0c44fe"} Mar 16 17:13:37 crc kubenswrapper[5120]: I0316 17:13:37.786202 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"c977fa4c-2763-4ab0-8485-4a1a352be4ba","Type":"ContainerDied","Data":"6d2eef5a255185e854f4f695ccc8ae614a3459ca82393da20e249f7ac4d1a0e4"} Mar 16 17:13:37 crc kubenswrapper[5120]: I0316 17:13:37.786228 5120 scope.go:117] "RemoveContainer" containerID="0e7dcc83886e7b4d4c3871eefcb6ec5dc38fcd307a14b3a4b098bf28b024754b" Mar 16 17:13:37 crc kubenswrapper[5120]: I0316 17:13:37.786231 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="eb3d95a7-f6af-46bc-a343-959b4a348c8e" containerName="cinder-scheduler" containerID="cri-o://d5e28dd72ea37fb2433469185534c4d71e392b29110df6cf8da1aa8e148a6deb" gracePeriod=30 Mar 16 17:13:37 crc kubenswrapper[5120]: I0316 17:13:37.786400 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="eb3d95a7-f6af-46bc-a343-959b4a348c8e" containerName="probe" containerID="cri-o://3ee553c64803dc362cb962dfc738d60a7745b099dca56113882d251bfa601e39" gracePeriod=30 Mar 16 17:13:37 crc kubenswrapper[5120]: I0316 17:13:37.810816 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-7d8bb7fd99-qr5kw" podStartSLOduration=2.810793773 podStartE2EDuration="2.810793773s" podCreationTimestamp="2026-03-16 17:13:35 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:13:37.797400927 +0000 UTC m=+6119.951332584" watchObservedRunningTime="2026-03-16 17:13:37.810793773 +0000 UTC m=+6119.964725430" Mar 16 17:13:37 crc kubenswrapper[5120]: I0316 17:13:37.882025 5120 scope.go:117] "RemoveContainer" containerID="bac3a3f45e8e1926a12ebdfa9b7e4c91e3f6894466094c639d35c11a4e5e822c" Mar 16 17:13:37 crc kubenswrapper[5120]: I0316 17:13:37.912813 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:13:37 crc kubenswrapper[5120]: I0316 17:13:37.915495 5120 scope.go:117] "RemoveContainer" containerID="2b79273a58a77a92f773616e582f0045dd755cd4e4190c7b66f622825d0c44fe" Mar 16 17:13:37 crc kubenswrapper[5120]: I0316 17:13:37.941833 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:13:37 crc kubenswrapper[5120]: I0316 17:13:37.951356 5120 scope.go:117] "RemoveContainer" containerID="a1ceb8dd748c8c52178f987c7b62681275ac116d9ea201bab52bfb1dc8096418" Mar 16 17:13:37 crc kubenswrapper[5120]: I0316 17:13:37.958297 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:13:37 crc kubenswrapper[5120]: I0316 17:13:37.959518 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c977fa4c-2763-4ab0-8485-4a1a352be4ba" containerName="sg-core" Mar 16 17:13:37 crc kubenswrapper[5120]: I0316 17:13:37.959536 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c977fa4c-2763-4ab0-8485-4a1a352be4ba" containerName="sg-core" Mar 16 17:13:37 crc kubenswrapper[5120]: I0316 17:13:37.959561 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c977fa4c-2763-4ab0-8485-4a1a352be4ba" containerName="ceilometer-notification-agent" Mar 16 17:13:37 crc kubenswrapper[5120]: I0316 17:13:37.959571 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c977fa4c-2763-4ab0-8485-4a1a352be4ba" containerName="ceilometer-notification-agent" Mar 16 17:13:37 crc kubenswrapper[5120]: I0316 17:13:37.959633 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c977fa4c-2763-4ab0-8485-4a1a352be4ba" containerName="ceilometer-central-agent" Mar 16 17:13:37 crc kubenswrapper[5120]: I0316 17:13:37.959640 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c977fa4c-2763-4ab0-8485-4a1a352be4ba" containerName="ceilometer-central-agent" Mar 16 17:13:37 crc kubenswrapper[5120]: I0316 17:13:37.959675 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c977fa4c-2763-4ab0-8485-4a1a352be4ba" containerName="proxy-httpd" Mar 16 17:13:37 crc kubenswrapper[5120]: I0316 17:13:37.959681 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c977fa4c-2763-4ab0-8485-4a1a352be4ba" containerName="proxy-httpd" Mar 16 17:13:37 crc kubenswrapper[5120]: I0316 17:13:37.959882 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c977fa4c-2763-4ab0-8485-4a1a352be4ba" containerName="ceilometer-central-agent" Mar 16 17:13:37 crc kubenswrapper[5120]: I0316 17:13:37.959907 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c977fa4c-2763-4ab0-8485-4a1a352be4ba" containerName="sg-core" Mar 16 17:13:37 crc kubenswrapper[5120]: I0316 17:13:37.959920 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c977fa4c-2763-4ab0-8485-4a1a352be4ba" containerName="proxy-httpd" Mar 16 17:13:37 crc kubenswrapper[5120]: I0316 17:13:37.959933 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c977fa4c-2763-4ab0-8485-4a1a352be4ba" containerName="ceilometer-notification-agent" Mar 16 17:13:37 crc kubenswrapper[5120]: I0316 17:13:37.975773 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:13:37 crc kubenswrapper[5120]: I0316 17:13:37.976408 5120 scope.go:117] "RemoveContainer" containerID="0e7dcc83886e7b4d4c3871eefcb6ec5dc38fcd307a14b3a4b098bf28b024754b" Mar 16 17:13:37 crc kubenswrapper[5120]: I0316 17:13:37.978391 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 17:13:37 crc kubenswrapper[5120]: I0316 17:13:37.978731 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 17:13:37 crc kubenswrapper[5120]: E0316 17:13:37.982567 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0e7dcc83886e7b4d4c3871eefcb6ec5dc38fcd307a14b3a4b098bf28b024754b\": container with ID starting with 0e7dcc83886e7b4d4c3871eefcb6ec5dc38fcd307a14b3a4b098bf28b024754b not found: ID does not exist" containerID="0e7dcc83886e7b4d4c3871eefcb6ec5dc38fcd307a14b3a4b098bf28b024754b" Mar 16 17:13:37 crc kubenswrapper[5120]: I0316 17:13:37.983038 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e7dcc83886e7b4d4c3871eefcb6ec5dc38fcd307a14b3a4b098bf28b024754b"} err="failed to get container status \"0e7dcc83886e7b4d4c3871eefcb6ec5dc38fcd307a14b3a4b098bf28b024754b\": rpc error: code = NotFound desc = could not find container \"0e7dcc83886e7b4d4c3871eefcb6ec5dc38fcd307a14b3a4b098bf28b024754b\": container with ID starting with 0e7dcc83886e7b4d4c3871eefcb6ec5dc38fcd307a14b3a4b098bf28b024754b not found: ID does not exist" Mar 16 17:13:37 crc kubenswrapper[5120]: I0316 17:13:37.983067 5120 scope.go:117] "RemoveContainer" containerID="bac3a3f45e8e1926a12ebdfa9b7e4c91e3f6894466094c639d35c11a4e5e822c" Mar 16 17:13:37 crc kubenswrapper[5120]: E0316 17:13:37.985928 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bac3a3f45e8e1926a12ebdfa9b7e4c91e3f6894466094c639d35c11a4e5e822c\": container with ID starting with bac3a3f45e8e1926a12ebdfa9b7e4c91e3f6894466094c639d35c11a4e5e822c not found: ID does not exist" containerID="bac3a3f45e8e1926a12ebdfa9b7e4c91e3f6894466094c639d35c11a4e5e822c" Mar 16 17:13:37 crc kubenswrapper[5120]: I0316 17:13:37.985969 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bac3a3f45e8e1926a12ebdfa9b7e4c91e3f6894466094c639d35c11a4e5e822c"} err="failed to get container status \"bac3a3f45e8e1926a12ebdfa9b7e4c91e3f6894466094c639d35c11a4e5e822c\": rpc error: code = NotFound desc = could not find container \"bac3a3f45e8e1926a12ebdfa9b7e4c91e3f6894466094c639d35c11a4e5e822c\": container with ID starting with bac3a3f45e8e1926a12ebdfa9b7e4c91e3f6894466094c639d35c11a4e5e822c not found: ID does not exist" Mar 16 17:13:37 crc kubenswrapper[5120]: I0316 17:13:37.985993 5120 scope.go:117] "RemoveContainer" containerID="2b79273a58a77a92f773616e582f0045dd755cd4e4190c7b66f622825d0c44fe" Mar 16 17:13:37 crc kubenswrapper[5120]: E0316 17:13:37.986987 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b79273a58a77a92f773616e582f0045dd755cd4e4190c7b66f622825d0c44fe\": container with ID starting with 2b79273a58a77a92f773616e582f0045dd755cd4e4190c7b66f622825d0c44fe not found: ID does not exist" containerID="2b79273a58a77a92f773616e582f0045dd755cd4e4190c7b66f622825d0c44fe" Mar 16 17:13:37 crc kubenswrapper[5120]: I0316 17:13:37.987023 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b79273a58a77a92f773616e582f0045dd755cd4e4190c7b66f622825d0c44fe"} err="failed to get container status \"2b79273a58a77a92f773616e582f0045dd755cd4e4190c7b66f622825d0c44fe\": rpc error: code = NotFound desc = could not find container \"2b79273a58a77a92f773616e582f0045dd755cd4e4190c7b66f622825d0c44fe\": container with ID starting with 2b79273a58a77a92f773616e582f0045dd755cd4e4190c7b66f622825d0c44fe not found: ID does not exist" Mar 16 17:13:37 crc kubenswrapper[5120]: I0316 17:13:37.987060 5120 scope.go:117] "RemoveContainer" containerID="a1ceb8dd748c8c52178f987c7b62681275ac116d9ea201bab52bfb1dc8096418" Mar 16 17:13:37 crc kubenswrapper[5120]: E0316 17:13:37.987889 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a1ceb8dd748c8c52178f987c7b62681275ac116d9ea201bab52bfb1dc8096418\": container with ID starting with a1ceb8dd748c8c52178f987c7b62681275ac116d9ea201bab52bfb1dc8096418 not found: ID does not exist" containerID="a1ceb8dd748c8c52178f987c7b62681275ac116d9ea201bab52bfb1dc8096418" Mar 16 17:13:37 crc kubenswrapper[5120]: I0316 17:13:37.987915 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1ceb8dd748c8c52178f987c7b62681275ac116d9ea201bab52bfb1dc8096418"} err="failed to get container status \"a1ceb8dd748c8c52178f987c7b62681275ac116d9ea201bab52bfb1dc8096418\": rpc error: code = NotFound desc = could not find container \"a1ceb8dd748c8c52178f987c7b62681275ac116d9ea201bab52bfb1dc8096418\": container with ID starting with a1ceb8dd748c8c52178f987c7b62681275ac116d9ea201bab52bfb1dc8096418 not found: ID does not exist" Mar 16 17:13:37 crc kubenswrapper[5120]: I0316 17:13:37.992495 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:13:38 crc kubenswrapper[5120]: I0316 17:13:38.013817 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e653cf48-8db9-4fe8-9478-a3207ab76c97-log-httpd\") pod \"ceilometer-0\" (UID: \"e653cf48-8db9-4fe8-9478-a3207ab76c97\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:13:38 crc kubenswrapper[5120]: I0316 17:13:38.013926 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e653cf48-8db9-4fe8-9478-a3207ab76c97-config-data\") pod \"ceilometer-0\" (UID: \"e653cf48-8db9-4fe8-9478-a3207ab76c97\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:13:38 crc kubenswrapper[5120]: I0316 17:13:38.014073 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e653cf48-8db9-4fe8-9478-a3207ab76c97-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"e653cf48-8db9-4fe8-9478-a3207ab76c97\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:13:38 crc kubenswrapper[5120]: I0316 17:13:38.014160 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e653cf48-8db9-4fe8-9478-a3207ab76c97-scripts\") pod \"ceilometer-0\" (UID: \"e653cf48-8db9-4fe8-9478-a3207ab76c97\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:13:38 crc kubenswrapper[5120]: I0316 17:13:38.014261 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/e653cf48-8db9-4fe8-9478-a3207ab76c97-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"e653cf48-8db9-4fe8-9478-a3207ab76c97\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:13:38 crc kubenswrapper[5120]: I0316 17:13:38.014508 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e653cf48-8db9-4fe8-9478-a3207ab76c97-run-httpd\") pod \"ceilometer-0\" (UID: \"e653cf48-8db9-4fe8-9478-a3207ab76c97\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:13:38 crc kubenswrapper[5120]: I0316 17:13:38.014555 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tk8qv\" (UniqueName: \"kubernetes.io/projected/e653cf48-8db9-4fe8-9478-a3207ab76c97-kube-api-access-tk8qv\") pod \"ceilometer-0\" (UID: \"e653cf48-8db9-4fe8-9478-a3207ab76c97\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:13:38 crc kubenswrapper[5120]: I0316 17:13:38.117221 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e653cf48-8db9-4fe8-9478-a3207ab76c97-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"e653cf48-8db9-4fe8-9478-a3207ab76c97\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:13:38 crc kubenswrapper[5120]: I0316 17:13:38.117307 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e653cf48-8db9-4fe8-9478-a3207ab76c97-scripts\") pod \"ceilometer-0\" (UID: \"e653cf48-8db9-4fe8-9478-a3207ab76c97\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:13:38 crc kubenswrapper[5120]: I0316 17:13:38.117408 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/e653cf48-8db9-4fe8-9478-a3207ab76c97-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"e653cf48-8db9-4fe8-9478-a3207ab76c97\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:13:38 crc kubenswrapper[5120]: I0316 17:13:38.117640 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e653cf48-8db9-4fe8-9478-a3207ab76c97-run-httpd\") pod \"ceilometer-0\" (UID: \"e653cf48-8db9-4fe8-9478-a3207ab76c97\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:13:38 crc kubenswrapper[5120]: I0316 17:13:38.117680 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tk8qv\" (UniqueName: \"kubernetes.io/projected/e653cf48-8db9-4fe8-9478-a3207ab76c97-kube-api-access-tk8qv\") pod \"ceilometer-0\" (UID: \"e653cf48-8db9-4fe8-9478-a3207ab76c97\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:13:38 crc kubenswrapper[5120]: I0316 17:13:38.118098 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e653cf48-8db9-4fe8-9478-a3207ab76c97-log-httpd\") pod \"ceilometer-0\" (UID: \"e653cf48-8db9-4fe8-9478-a3207ab76c97\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:13:38 crc kubenswrapper[5120]: I0316 17:13:38.118181 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e653cf48-8db9-4fe8-9478-a3207ab76c97-config-data\") pod \"ceilometer-0\" (UID: \"e653cf48-8db9-4fe8-9478-a3207ab76c97\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:13:38 crc kubenswrapper[5120]: I0316 17:13:38.119109 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e653cf48-8db9-4fe8-9478-a3207ab76c97-run-httpd\") pod \"ceilometer-0\" (UID: \"e653cf48-8db9-4fe8-9478-a3207ab76c97\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:13:38 crc kubenswrapper[5120]: I0316 17:13:38.123390 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e653cf48-8db9-4fe8-9478-a3207ab76c97-log-httpd\") pod \"ceilometer-0\" (UID: \"e653cf48-8db9-4fe8-9478-a3207ab76c97\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:13:38 crc kubenswrapper[5120]: I0316 17:13:38.127536 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/e653cf48-8db9-4fe8-9478-a3207ab76c97-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"e653cf48-8db9-4fe8-9478-a3207ab76c97\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:13:38 crc kubenswrapper[5120]: I0316 17:13:38.127675 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e653cf48-8db9-4fe8-9478-a3207ab76c97-scripts\") pod \"ceilometer-0\" (UID: \"e653cf48-8db9-4fe8-9478-a3207ab76c97\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:13:38 crc kubenswrapper[5120]: I0316 17:13:38.131409 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e653cf48-8db9-4fe8-9478-a3207ab76c97-config-data\") pod \"ceilometer-0\" (UID: \"e653cf48-8db9-4fe8-9478-a3207ab76c97\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:13:38 crc kubenswrapper[5120]: I0316 17:13:38.139424 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e653cf48-8db9-4fe8-9478-a3207ab76c97-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"e653cf48-8db9-4fe8-9478-a3207ab76c97\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:13:38 crc kubenswrapper[5120]: I0316 17:13:38.140710 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tk8qv\" (UniqueName: \"kubernetes.io/projected/e653cf48-8db9-4fe8-9478-a3207ab76c97-kube-api-access-tk8qv\") pod \"ceilometer-0\" (UID: \"e653cf48-8db9-4fe8-9478-a3207ab76c97\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:13:38 crc kubenswrapper[5120]: I0316 17:13:38.163241 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-7c959f78ff-5lv92" Mar 16 17:13:38 crc kubenswrapper[5120]: I0316 17:13:38.219246 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/1ae5285c-173c-4162-9610-3f9c3a4ef47b-config-data-custom\") pod \"1ae5285c-173c-4162-9610-3f9c3a4ef47b\" (UID: \"1ae5285c-173c-4162-9610-3f9c3a4ef47b\") " Mar 16 17:13:38 crc kubenswrapper[5120]: I0316 17:13:38.219333 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1ae5285c-173c-4162-9610-3f9c3a4ef47b-config-data\") pod \"1ae5285c-173c-4162-9610-3f9c3a4ef47b\" (UID: \"1ae5285c-173c-4162-9610-3f9c3a4ef47b\") " Mar 16 17:13:38 crc kubenswrapper[5120]: I0316 17:13:38.219568 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8mr57\" (UniqueName: \"kubernetes.io/projected/1ae5285c-173c-4162-9610-3f9c3a4ef47b-kube-api-access-8mr57\") pod \"1ae5285c-173c-4162-9610-3f9c3a4ef47b\" (UID: \"1ae5285c-173c-4162-9610-3f9c3a4ef47b\") " Mar 16 17:13:38 crc kubenswrapper[5120]: I0316 17:13:38.220124 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/1ae5285c-173c-4162-9610-3f9c3a4ef47b-logs\") pod \"1ae5285c-173c-4162-9610-3f9c3a4ef47b\" (UID: \"1ae5285c-173c-4162-9610-3f9c3a4ef47b\") " Mar 16 17:13:38 crc kubenswrapper[5120]: I0316 17:13:38.220266 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1ae5285c-173c-4162-9610-3f9c3a4ef47b-combined-ca-bundle\") pod \"1ae5285c-173c-4162-9610-3f9c3a4ef47b\" (UID: \"1ae5285c-173c-4162-9610-3f9c3a4ef47b\") " Mar 16 17:13:38 crc kubenswrapper[5120]: I0316 17:13:38.220503 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ae5285c-173c-4162-9610-3f9c3a4ef47b-logs" (OuterVolumeSpecName: "logs") pod "1ae5285c-173c-4162-9610-3f9c3a4ef47b" (UID: "1ae5285c-173c-4162-9610-3f9c3a4ef47b"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:13:38 crc kubenswrapper[5120]: I0316 17:13:38.221616 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/1ae5285c-173c-4162-9610-3f9c3a4ef47b-logs\") on node \"crc\" DevicePath \"\"" Mar 16 17:13:38 crc kubenswrapper[5120]: I0316 17:13:38.230469 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ae5285c-173c-4162-9610-3f9c3a4ef47b-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "1ae5285c-173c-4162-9610-3f9c3a4ef47b" (UID: "1ae5285c-173c-4162-9610-3f9c3a4ef47b"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:13:38 crc kubenswrapper[5120]: I0316 17:13:38.232007 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ae5285c-173c-4162-9610-3f9c3a4ef47b-kube-api-access-8mr57" (OuterVolumeSpecName: "kube-api-access-8mr57") pod "1ae5285c-173c-4162-9610-3f9c3a4ef47b" (UID: "1ae5285c-173c-4162-9610-3f9c3a4ef47b"). InnerVolumeSpecName "kube-api-access-8mr57". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:13:38 crc kubenswrapper[5120]: I0316 17:13:38.257699 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ae5285c-173c-4162-9610-3f9c3a4ef47b-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "1ae5285c-173c-4162-9610-3f9c3a4ef47b" (UID: "1ae5285c-173c-4162-9610-3f9c3a4ef47b"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:13:38 crc kubenswrapper[5120]: I0316 17:13:38.270100 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ae5285c-173c-4162-9610-3f9c3a4ef47b-config-data" (OuterVolumeSpecName: "config-data") pod "1ae5285c-173c-4162-9610-3f9c3a4ef47b" (UID: "1ae5285c-173c-4162-9610-3f9c3a4ef47b"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:13:38 crc kubenswrapper[5120]: I0316 17:13:38.280471 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-67f6766cc8-lpvm7" podUID="24f83ac4-b285-47e8-94e0-9b47da8c5928" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.0.162:9311/healthcheck\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Mar 16 17:13:38 crc kubenswrapper[5120]: I0316 17:13:38.281837 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-67f6766cc8-lpvm7" podUID="24f83ac4-b285-47e8-94e0-9b47da8c5928" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.0.162:9311/healthcheck\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Mar 16 17:13:38 crc kubenswrapper[5120]: I0316 17:13:38.297272 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:13:38 crc kubenswrapper[5120]: I0316 17:13:38.324748 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/1ae5285c-173c-4162-9610-3f9c3a4ef47b-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 17:13:38 crc kubenswrapper[5120]: I0316 17:13:38.324927 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1ae5285c-173c-4162-9610-3f9c3a4ef47b-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:13:38 crc kubenswrapper[5120]: I0316 17:13:38.324941 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8mr57\" (UniqueName: \"kubernetes.io/projected/1ae5285c-173c-4162-9610-3f9c3a4ef47b-kube-api-access-8mr57\") on node \"crc\" DevicePath \"\"" Mar 16 17:13:38 crc kubenswrapper[5120]: I0316 17:13:38.324951 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1ae5285c-173c-4162-9610-3f9c3a4ef47b-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:13:38 crc kubenswrapper[5120]: I0316 17:13:38.679820 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c977fa4c-2763-4ab0-8485-4a1a352be4ba" path="/var/lib/kubelet/pods/c977fa4c-2763-4ab0-8485-4a1a352be4ba/volumes" Mar 16 17:13:38 crc kubenswrapper[5120]: I0316 17:13:38.710631 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-67f6766cc8-lpvm7" podUID="24f83ac4-b285-47e8-94e0-9b47da8c5928" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.0.162:9311/healthcheck\": read tcp 10.217.0.2:60976->10.217.0.162:9311: read: connection reset by peer" Mar 16 17:13:38 crc kubenswrapper[5120]: I0316 17:13:38.710630 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-67f6766cc8-lpvm7" podUID="24f83ac4-b285-47e8-94e0-9b47da8c5928" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.0.162:9311/healthcheck\": read tcp 10.217.0.2:60972->10.217.0.162:9311: read: connection reset by peer" Mar 16 17:13:38 crc kubenswrapper[5120]: I0316 17:13:38.772340 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:13:38 crc kubenswrapper[5120]: W0316 17:13:38.806539 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode653cf48_8db9_4fe8_9478_a3207ab76c97.slice/crio-0eb1303dee5321d6d3edf3955900d7ff811271b8ae5e4c01ebd704b2444f9e6d WatchSource:0}: Error finding container 0eb1303dee5321d6d3edf3955900d7ff811271b8ae5e4c01ebd704b2444f9e6d: Status 404 returned error can't find the container with id 0eb1303dee5321d6d3edf3955900d7ff811271b8ae5e4c01ebd704b2444f9e6d Mar 16 17:13:38 crc kubenswrapper[5120]: I0316 17:13:38.806800 5120 generic.go:358] "Generic (PLEG): container finished" podID="eb3d95a7-f6af-46bc-a343-959b4a348c8e" containerID="3ee553c64803dc362cb962dfc738d60a7745b099dca56113882d251bfa601e39" exitCode=0 Mar 16 17:13:38 crc kubenswrapper[5120]: I0316 17:13:38.807140 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"eb3d95a7-f6af-46bc-a343-959b4a348c8e","Type":"ContainerDied","Data":"3ee553c64803dc362cb962dfc738d60a7745b099dca56113882d251bfa601e39"} Mar 16 17:13:38 crc kubenswrapper[5120]: I0316 17:13:38.821307 5120 generic.go:358] "Generic (PLEG): container finished" podID="1ae5285c-173c-4162-9610-3f9c3a4ef47b" containerID="294a45e764273363d5c21b3cadd1204356e4035b46b616bebe50cd478a038435" exitCode=0 Mar 16 17:13:38 crc kubenswrapper[5120]: I0316 17:13:38.821413 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-7c959f78ff-5lv92" event={"ID":"1ae5285c-173c-4162-9610-3f9c3a4ef47b","Type":"ContainerDied","Data":"294a45e764273363d5c21b3cadd1204356e4035b46b616bebe50cd478a038435"} Mar 16 17:13:38 crc kubenswrapper[5120]: I0316 17:13:38.821460 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-7c959f78ff-5lv92" event={"ID":"1ae5285c-173c-4162-9610-3f9c3a4ef47b","Type":"ContainerDied","Data":"bb64514d7236b7a064ac10e3b2162c6729627e29389a7ddee92bb99a060608ff"} Mar 16 17:13:38 crc kubenswrapper[5120]: I0316 17:13:38.821473 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-7c959f78ff-5lv92" Mar 16 17:13:38 crc kubenswrapper[5120]: I0316 17:13:38.821486 5120 scope.go:117] "RemoveContainer" containerID="294a45e764273363d5c21b3cadd1204356e4035b46b616bebe50cd478a038435" Mar 16 17:13:38 crc kubenswrapper[5120]: I0316 17:13:38.823851 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="015b50a4-d550-48a4-a72b-b73b038d7319" containerName="cinder-api-log" containerID="cri-o://65347cc7ac37e345bf4d0b8360039f1b9c493b684433c44ebb97b3fa9d240de5" gracePeriod=30 Mar 16 17:13:38 crc kubenswrapper[5120]: I0316 17:13:38.823969 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="015b50a4-d550-48a4-a72b-b73b038d7319" containerName="cinder-api" containerID="cri-o://264741933cb9afb14a33b8204211f72d0e94ada20e39cd620593694396a63ed3" gracePeriod=30 Mar 16 17:13:38 crc kubenswrapper[5120]: I0316 17:13:38.859563 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-7c959f78ff-5lv92"] Mar 16 17:13:38 crc kubenswrapper[5120]: I0316 17:13:38.869896 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-worker-7c959f78ff-5lv92"] Mar 16 17:13:38 crc kubenswrapper[5120]: I0316 17:13:38.877856 5120 scope.go:117] "RemoveContainer" containerID="43c66043e906f70f9409ae93a14e15c6f5b22c5773198f562df0de0765be8326" Mar 16 17:13:38 crc kubenswrapper[5120]: I0316 17:13:38.902045 5120 scope.go:117] "RemoveContainer" containerID="294a45e764273363d5c21b3cadd1204356e4035b46b616bebe50cd478a038435" Mar 16 17:13:38 crc kubenswrapper[5120]: E0316 17:13:38.902572 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"294a45e764273363d5c21b3cadd1204356e4035b46b616bebe50cd478a038435\": container with ID starting with 294a45e764273363d5c21b3cadd1204356e4035b46b616bebe50cd478a038435 not found: ID does not exist" containerID="294a45e764273363d5c21b3cadd1204356e4035b46b616bebe50cd478a038435" Mar 16 17:13:38 crc kubenswrapper[5120]: I0316 17:13:38.902644 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"294a45e764273363d5c21b3cadd1204356e4035b46b616bebe50cd478a038435"} err="failed to get container status \"294a45e764273363d5c21b3cadd1204356e4035b46b616bebe50cd478a038435\": rpc error: code = NotFound desc = could not find container \"294a45e764273363d5c21b3cadd1204356e4035b46b616bebe50cd478a038435\": container with ID starting with 294a45e764273363d5c21b3cadd1204356e4035b46b616bebe50cd478a038435 not found: ID does not exist" Mar 16 17:13:38 crc kubenswrapper[5120]: I0316 17:13:38.902675 5120 scope.go:117] "RemoveContainer" containerID="43c66043e906f70f9409ae93a14e15c6f5b22c5773198f562df0de0765be8326" Mar 16 17:13:38 crc kubenswrapper[5120]: E0316 17:13:38.903125 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"43c66043e906f70f9409ae93a14e15c6f5b22c5773198f562df0de0765be8326\": container with ID starting with 43c66043e906f70f9409ae93a14e15c6f5b22c5773198f562df0de0765be8326 not found: ID does not exist" containerID="43c66043e906f70f9409ae93a14e15c6f5b22c5773198f562df0de0765be8326" Mar 16 17:13:38 crc kubenswrapper[5120]: I0316 17:13:38.903161 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43c66043e906f70f9409ae93a14e15c6f5b22c5773198f562df0de0765be8326"} err="failed to get container status \"43c66043e906f70f9409ae93a14e15c6f5b22c5773198f562df0de0765be8326\": rpc error: code = NotFound desc = could not find container \"43c66043e906f70f9409ae93a14e15c6f5b22c5773198f562df0de0765be8326\": container with ID starting with 43c66043e906f70f9409ae93a14e15c6f5b22c5773198f562df0de0765be8326 not found: ID does not exist" Mar 16 17:13:39 crc kubenswrapper[5120]: I0316 17:13:39.199342 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-54b8764f4-w5thh"] Mar 16 17:13:39 crc kubenswrapper[5120]: I0316 17:13:39.200658 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ae5285c-173c-4162-9610-3f9c3a4ef47b" containerName="barbican-worker" Mar 16 17:13:39 crc kubenswrapper[5120]: I0316 17:13:39.200677 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ae5285c-173c-4162-9610-3f9c3a4ef47b" containerName="barbican-worker" Mar 16 17:13:39 crc kubenswrapper[5120]: I0316 17:13:39.200708 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ae5285c-173c-4162-9610-3f9c3a4ef47b" containerName="barbican-worker-log" Mar 16 17:13:39 crc kubenswrapper[5120]: I0316 17:13:39.200715 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ae5285c-173c-4162-9610-3f9c3a4ef47b" containerName="barbican-worker-log" Mar 16 17:13:39 crc kubenswrapper[5120]: I0316 17:13:39.200934 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1ae5285c-173c-4162-9610-3f9c3a4ef47b" containerName="barbican-worker" Mar 16 17:13:39 crc kubenswrapper[5120]: I0316 17:13:39.200964 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1ae5285c-173c-4162-9610-3f9c3a4ef47b" containerName="barbican-worker-log" Mar 16 17:13:39 crc kubenswrapper[5120]: I0316 17:13:39.207652 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-54b8764f4-w5thh" Mar 16 17:13:39 crc kubenswrapper[5120]: I0316 17:13:39.211303 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-neutron-public-svc\"" Mar 16 17:13:39 crc kubenswrapper[5120]: I0316 17:13:39.211505 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-neutron-internal-svc\"" Mar 16 17:13:39 crc kubenswrapper[5120]: I0316 17:13:39.225869 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-54b8764f4-w5thh"] Mar 16 17:13:39 crc kubenswrapper[5120]: I0316 17:13:39.356197 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhs4m\" (UniqueName: \"kubernetes.io/projected/35eb763c-5d62-4401-a5b6-da3c538709ab-kube-api-access-lhs4m\") pod \"neutron-54b8764f4-w5thh\" (UID: \"35eb763c-5d62-4401-a5b6-da3c538709ab\") " pod="openstack-kuttl-tests/neutron-54b8764f4-w5thh" Mar 16 17:13:39 crc kubenswrapper[5120]: I0316 17:13:39.356451 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/35eb763c-5d62-4401-a5b6-da3c538709ab-ovndb-tls-certs\") pod \"neutron-54b8764f4-w5thh\" (UID: \"35eb763c-5d62-4401-a5b6-da3c538709ab\") " pod="openstack-kuttl-tests/neutron-54b8764f4-w5thh" Mar 16 17:13:39 crc kubenswrapper[5120]: I0316 17:13:39.356921 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/35eb763c-5d62-4401-a5b6-da3c538709ab-config\") pod \"neutron-54b8764f4-w5thh\" (UID: \"35eb763c-5d62-4401-a5b6-da3c538709ab\") " pod="openstack-kuttl-tests/neutron-54b8764f4-w5thh" Mar 16 17:13:39 crc kubenswrapper[5120]: I0316 17:13:39.357007 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/35eb763c-5d62-4401-a5b6-da3c538709ab-httpd-config\") pod \"neutron-54b8764f4-w5thh\" (UID: \"35eb763c-5d62-4401-a5b6-da3c538709ab\") " pod="openstack-kuttl-tests/neutron-54b8764f4-w5thh" Mar 16 17:13:39 crc kubenswrapper[5120]: I0316 17:13:39.357084 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/35eb763c-5d62-4401-a5b6-da3c538709ab-internal-tls-certs\") pod \"neutron-54b8764f4-w5thh\" (UID: \"35eb763c-5d62-4401-a5b6-da3c538709ab\") " pod="openstack-kuttl-tests/neutron-54b8764f4-w5thh" Mar 16 17:13:39 crc kubenswrapper[5120]: I0316 17:13:39.357241 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/35eb763c-5d62-4401-a5b6-da3c538709ab-combined-ca-bundle\") pod \"neutron-54b8764f4-w5thh\" (UID: \"35eb763c-5d62-4401-a5b6-da3c538709ab\") " pod="openstack-kuttl-tests/neutron-54b8764f4-w5thh" Mar 16 17:13:39 crc kubenswrapper[5120]: I0316 17:13:39.357340 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/35eb763c-5d62-4401-a5b6-da3c538709ab-public-tls-certs\") pod \"neutron-54b8764f4-w5thh\" (UID: \"35eb763c-5d62-4401-a5b6-da3c538709ab\") " pod="openstack-kuttl-tests/neutron-54b8764f4-w5thh" Mar 16 17:13:39 crc kubenswrapper[5120]: I0316 17:13:39.459814 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/35eb763c-5d62-4401-a5b6-da3c538709ab-config\") pod \"neutron-54b8764f4-w5thh\" (UID: \"35eb763c-5d62-4401-a5b6-da3c538709ab\") " pod="openstack-kuttl-tests/neutron-54b8764f4-w5thh" Mar 16 17:13:39 crc kubenswrapper[5120]: I0316 17:13:39.459872 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/35eb763c-5d62-4401-a5b6-da3c538709ab-httpd-config\") pod \"neutron-54b8764f4-w5thh\" (UID: \"35eb763c-5d62-4401-a5b6-da3c538709ab\") " pod="openstack-kuttl-tests/neutron-54b8764f4-w5thh" Mar 16 17:13:39 crc kubenswrapper[5120]: I0316 17:13:39.459905 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/35eb763c-5d62-4401-a5b6-da3c538709ab-internal-tls-certs\") pod \"neutron-54b8764f4-w5thh\" (UID: \"35eb763c-5d62-4401-a5b6-da3c538709ab\") " pod="openstack-kuttl-tests/neutron-54b8764f4-w5thh" Mar 16 17:13:39 crc kubenswrapper[5120]: I0316 17:13:39.459980 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/35eb763c-5d62-4401-a5b6-da3c538709ab-combined-ca-bundle\") pod \"neutron-54b8764f4-w5thh\" (UID: \"35eb763c-5d62-4401-a5b6-da3c538709ab\") " pod="openstack-kuttl-tests/neutron-54b8764f4-w5thh" Mar 16 17:13:39 crc kubenswrapper[5120]: I0316 17:13:39.460052 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/35eb763c-5d62-4401-a5b6-da3c538709ab-public-tls-certs\") pod \"neutron-54b8764f4-w5thh\" (UID: \"35eb763c-5d62-4401-a5b6-da3c538709ab\") " pod="openstack-kuttl-tests/neutron-54b8764f4-w5thh" Mar 16 17:13:39 crc kubenswrapper[5120]: I0316 17:13:39.460132 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lhs4m\" (UniqueName: \"kubernetes.io/projected/35eb763c-5d62-4401-a5b6-da3c538709ab-kube-api-access-lhs4m\") pod \"neutron-54b8764f4-w5thh\" (UID: \"35eb763c-5d62-4401-a5b6-da3c538709ab\") " pod="openstack-kuttl-tests/neutron-54b8764f4-w5thh" Mar 16 17:13:39 crc kubenswrapper[5120]: I0316 17:13:39.460249 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/35eb763c-5d62-4401-a5b6-da3c538709ab-ovndb-tls-certs\") pod \"neutron-54b8764f4-w5thh\" (UID: \"35eb763c-5d62-4401-a5b6-da3c538709ab\") " pod="openstack-kuttl-tests/neutron-54b8764f4-w5thh" Mar 16 17:13:39 crc kubenswrapper[5120]: I0316 17:13:39.469722 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/35eb763c-5d62-4401-a5b6-da3c538709ab-internal-tls-certs\") pod \"neutron-54b8764f4-w5thh\" (UID: \"35eb763c-5d62-4401-a5b6-da3c538709ab\") " pod="openstack-kuttl-tests/neutron-54b8764f4-w5thh" Mar 16 17:13:39 crc kubenswrapper[5120]: I0316 17:13:39.474505 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/35eb763c-5d62-4401-a5b6-da3c538709ab-combined-ca-bundle\") pod \"neutron-54b8764f4-w5thh\" (UID: \"35eb763c-5d62-4401-a5b6-da3c538709ab\") " pod="openstack-kuttl-tests/neutron-54b8764f4-w5thh" Mar 16 17:13:39 crc kubenswrapper[5120]: I0316 17:13:39.502245 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/35eb763c-5d62-4401-a5b6-da3c538709ab-httpd-config\") pod \"neutron-54b8764f4-w5thh\" (UID: \"35eb763c-5d62-4401-a5b6-da3c538709ab\") " pod="openstack-kuttl-tests/neutron-54b8764f4-w5thh" Mar 16 17:13:39 crc kubenswrapper[5120]: I0316 17:13:39.502383 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/35eb763c-5d62-4401-a5b6-da3c538709ab-ovndb-tls-certs\") pod \"neutron-54b8764f4-w5thh\" (UID: \"35eb763c-5d62-4401-a5b6-da3c538709ab\") " pod="openstack-kuttl-tests/neutron-54b8764f4-w5thh" Mar 16 17:13:39 crc kubenswrapper[5120]: I0316 17:13:39.502492 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/35eb763c-5d62-4401-a5b6-da3c538709ab-config\") pod \"neutron-54b8764f4-w5thh\" (UID: \"35eb763c-5d62-4401-a5b6-da3c538709ab\") " pod="openstack-kuttl-tests/neutron-54b8764f4-w5thh" Mar 16 17:13:39 crc kubenswrapper[5120]: I0316 17:13:39.503052 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/35eb763c-5d62-4401-a5b6-da3c538709ab-public-tls-certs\") pod \"neutron-54b8764f4-w5thh\" (UID: \"35eb763c-5d62-4401-a5b6-da3c538709ab\") " pod="openstack-kuttl-tests/neutron-54b8764f4-w5thh" Mar 16 17:13:39 crc kubenswrapper[5120]: I0316 17:13:39.509123 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhs4m\" (UniqueName: \"kubernetes.io/projected/35eb763c-5d62-4401-a5b6-da3c538709ab-kube-api-access-lhs4m\") pod \"neutron-54b8764f4-w5thh\" (UID: \"35eb763c-5d62-4401-a5b6-da3c538709ab\") " pod="openstack-kuttl-tests/neutron-54b8764f4-w5thh" Mar 16 17:13:39 crc kubenswrapper[5120]: I0316 17:13:39.538187 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-54b8764f4-w5thh" Mar 16 17:13:39 crc kubenswrapper[5120]: I0316 17:13:39.695364 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-67f6766cc8-lpvm7" Mar 16 17:13:39 crc kubenswrapper[5120]: I0316 17:13:39.775715 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:13:39 crc kubenswrapper[5120]: I0316 17:13:39.795212 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/24f83ac4-b285-47e8-94e0-9b47da8c5928-public-tls-certs\") pod \"24f83ac4-b285-47e8-94e0-9b47da8c5928\" (UID: \"24f83ac4-b285-47e8-94e0-9b47da8c5928\") " Mar 16 17:13:39 crc kubenswrapper[5120]: I0316 17:13:39.795529 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/24f83ac4-b285-47e8-94e0-9b47da8c5928-logs\") pod \"24f83ac4-b285-47e8-94e0-9b47da8c5928\" (UID: \"24f83ac4-b285-47e8-94e0-9b47da8c5928\") " Mar 16 17:13:39 crc kubenswrapper[5120]: I0316 17:13:39.796960 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/24f83ac4-b285-47e8-94e0-9b47da8c5928-config-data\") pod \"24f83ac4-b285-47e8-94e0-9b47da8c5928\" (UID: \"24f83ac4-b285-47e8-94e0-9b47da8c5928\") " Mar 16 17:13:39 crc kubenswrapper[5120]: I0316 17:13:39.797031 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/24f83ac4-b285-47e8-94e0-9b47da8c5928-combined-ca-bundle\") pod \"24f83ac4-b285-47e8-94e0-9b47da8c5928\" (UID: \"24f83ac4-b285-47e8-94e0-9b47da8c5928\") " Mar 16 17:13:39 crc kubenswrapper[5120]: I0316 17:13:39.797160 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/24f83ac4-b285-47e8-94e0-9b47da8c5928-internal-tls-certs\") pod \"24f83ac4-b285-47e8-94e0-9b47da8c5928\" (UID: \"24f83ac4-b285-47e8-94e0-9b47da8c5928\") " Mar 16 17:13:39 crc kubenswrapper[5120]: I0316 17:13:39.797188 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dzggx\" (UniqueName: \"kubernetes.io/projected/24f83ac4-b285-47e8-94e0-9b47da8c5928-kube-api-access-dzggx\") pod \"24f83ac4-b285-47e8-94e0-9b47da8c5928\" (UID: \"24f83ac4-b285-47e8-94e0-9b47da8c5928\") " Mar 16 17:13:39 crc kubenswrapper[5120]: I0316 17:13:39.798095 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/24f83ac4-b285-47e8-94e0-9b47da8c5928-config-data-custom\") pod \"24f83ac4-b285-47e8-94e0-9b47da8c5928\" (UID: \"24f83ac4-b285-47e8-94e0-9b47da8c5928\") " Mar 16 17:13:39 crc kubenswrapper[5120]: I0316 17:13:39.803059 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24f83ac4-b285-47e8-94e0-9b47da8c5928-logs" (OuterVolumeSpecName: "logs") pod "24f83ac4-b285-47e8-94e0-9b47da8c5928" (UID: "24f83ac4-b285-47e8-94e0-9b47da8c5928"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:13:39 crc kubenswrapper[5120]: I0316 17:13:39.815734 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24f83ac4-b285-47e8-94e0-9b47da8c5928-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "24f83ac4-b285-47e8-94e0-9b47da8c5928" (UID: "24f83ac4-b285-47e8-94e0-9b47da8c5928"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:13:39 crc kubenswrapper[5120]: I0316 17:13:39.819481 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24f83ac4-b285-47e8-94e0-9b47da8c5928-kube-api-access-dzggx" (OuterVolumeSpecName: "kube-api-access-dzggx") pod "24f83ac4-b285-47e8-94e0-9b47da8c5928" (UID: "24f83ac4-b285-47e8-94e0-9b47da8c5928"). InnerVolumeSpecName "kube-api-access-dzggx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:13:39 crc kubenswrapper[5120]: I0316 17:13:39.836557 5120 generic.go:358] "Generic (PLEG): container finished" podID="24f83ac4-b285-47e8-94e0-9b47da8c5928" containerID="a5c5a79296326184b8165b774fab8b1a1e69e2ec576ffafb6d5a426e531e7910" exitCode=0 Mar 16 17:13:39 crc kubenswrapper[5120]: I0316 17:13:39.836628 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-67f6766cc8-lpvm7" event={"ID":"24f83ac4-b285-47e8-94e0-9b47da8c5928","Type":"ContainerDied","Data":"a5c5a79296326184b8165b774fab8b1a1e69e2ec576ffafb6d5a426e531e7910"} Mar 16 17:13:39 crc kubenswrapper[5120]: I0316 17:13:39.836653 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-67f6766cc8-lpvm7" event={"ID":"24f83ac4-b285-47e8-94e0-9b47da8c5928","Type":"ContainerDied","Data":"c9fff68f6735308dfd796c0693f89511bf0e80400cb56bab4dcbae4277b51e02"} Mar 16 17:13:39 crc kubenswrapper[5120]: I0316 17:13:39.836668 5120 scope.go:117] "RemoveContainer" containerID="a5c5a79296326184b8165b774fab8b1a1e69e2ec576ffafb6d5a426e531e7910" Mar 16 17:13:39 crc kubenswrapper[5120]: I0316 17:13:39.836880 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-67f6766cc8-lpvm7" Mar 16 17:13:39 crc kubenswrapper[5120]: I0316 17:13:39.846364 5120 generic.go:358] "Generic (PLEG): container finished" podID="015b50a4-d550-48a4-a72b-b73b038d7319" containerID="264741933cb9afb14a33b8204211f72d0e94ada20e39cd620593694396a63ed3" exitCode=0 Mar 16 17:13:39 crc kubenswrapper[5120]: I0316 17:13:39.846387 5120 generic.go:358] "Generic (PLEG): container finished" podID="015b50a4-d550-48a4-a72b-b73b038d7319" containerID="65347cc7ac37e345bf4d0b8360039f1b9c493b684433c44ebb97b3fa9d240de5" exitCode=143 Mar 16 17:13:39 crc kubenswrapper[5120]: I0316 17:13:39.846501 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"015b50a4-d550-48a4-a72b-b73b038d7319","Type":"ContainerDied","Data":"264741933cb9afb14a33b8204211f72d0e94ada20e39cd620593694396a63ed3"} Mar 16 17:13:39 crc kubenswrapper[5120]: I0316 17:13:39.846526 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"015b50a4-d550-48a4-a72b-b73b038d7319","Type":"ContainerDied","Data":"65347cc7ac37e345bf4d0b8360039f1b9c493b684433c44ebb97b3fa9d240de5"} Mar 16 17:13:39 crc kubenswrapper[5120]: I0316 17:13:39.846537 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"015b50a4-d550-48a4-a72b-b73b038d7319","Type":"ContainerDied","Data":"405eba6c3dac0aac47b2593a466380bab7ec7a654d4027fd63512f4e6ed8c038"} Mar 16 17:13:39 crc kubenswrapper[5120]: I0316 17:13:39.846630 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:13:39 crc kubenswrapper[5120]: I0316 17:13:39.848849 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24f83ac4-b285-47e8-94e0-9b47da8c5928-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "24f83ac4-b285-47e8-94e0-9b47da8c5928" (UID: "24f83ac4-b285-47e8-94e0-9b47da8c5928"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:13:39 crc kubenswrapper[5120]: I0316 17:13:39.849913 5120 generic.go:358] "Generic (PLEG): container finished" podID="59a6de62-1f3e-48b3-b377-4a582f759b5b" containerID="baed72a6239409dd140c1260daff487672bacf7c3d16715b6e4af9d1ad0321a8" exitCode=0 Mar 16 17:13:39 crc kubenswrapper[5120]: I0316 17:13:39.849993 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-75c7b8c84b-ckzdf" event={"ID":"59a6de62-1f3e-48b3-b377-4a582f759b5b","Type":"ContainerDied","Data":"baed72a6239409dd140c1260daff487672bacf7c3d16715b6e4af9d1ad0321a8"} Mar 16 17:13:39 crc kubenswrapper[5120]: I0316 17:13:39.853775 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"e653cf48-8db9-4fe8-9478-a3207ab76c97","Type":"ContainerStarted","Data":"0eb1303dee5321d6d3edf3955900d7ff811271b8ae5e4c01ebd704b2444f9e6d"} Mar 16 17:13:39 crc kubenswrapper[5120]: I0316 17:13:39.877043 5120 scope.go:117] "RemoveContainer" containerID="3edc568db612fad0b01bc312a6630be1d7ff70d8485d636c8539653e799955c5" Mar 16 17:13:39 crc kubenswrapper[5120]: I0316 17:13:39.877826 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24f83ac4-b285-47e8-94e0-9b47da8c5928-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "24f83ac4-b285-47e8-94e0-9b47da8c5928" (UID: "24f83ac4-b285-47e8-94e0-9b47da8c5928"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:13:39 crc kubenswrapper[5120]: I0316 17:13:39.896233 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24f83ac4-b285-47e8-94e0-9b47da8c5928-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "24f83ac4-b285-47e8-94e0-9b47da8c5928" (UID: "24f83ac4-b285-47e8-94e0-9b47da8c5928"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:13:39 crc kubenswrapper[5120]: I0316 17:13:39.903476 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9tbxf\" (UniqueName: \"kubernetes.io/projected/015b50a4-d550-48a4-a72b-b73b038d7319-kube-api-access-9tbxf\") pod \"015b50a4-d550-48a4-a72b-b73b038d7319\" (UID: \"015b50a4-d550-48a4-a72b-b73b038d7319\") " Mar 16 17:13:39 crc kubenswrapper[5120]: I0316 17:13:39.903581 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/015b50a4-d550-48a4-a72b-b73b038d7319-config-data\") pod \"015b50a4-d550-48a4-a72b-b73b038d7319\" (UID: \"015b50a4-d550-48a4-a72b-b73b038d7319\") " Mar 16 17:13:39 crc kubenswrapper[5120]: I0316 17:13:39.903707 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/015b50a4-d550-48a4-a72b-b73b038d7319-logs\") pod \"015b50a4-d550-48a4-a72b-b73b038d7319\" (UID: \"015b50a4-d550-48a4-a72b-b73b038d7319\") " Mar 16 17:13:39 crc kubenswrapper[5120]: I0316 17:13:39.904005 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/015b50a4-d550-48a4-a72b-b73b038d7319-scripts\") pod \"015b50a4-d550-48a4-a72b-b73b038d7319\" (UID: \"015b50a4-d550-48a4-a72b-b73b038d7319\") " Mar 16 17:13:39 crc kubenswrapper[5120]: I0316 17:13:39.904081 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/015b50a4-d550-48a4-a72b-b73b038d7319-etc-machine-id\") pod \"015b50a4-d550-48a4-a72b-b73b038d7319\" (UID: \"015b50a4-d550-48a4-a72b-b73b038d7319\") " Mar 16 17:13:39 crc kubenswrapper[5120]: I0316 17:13:39.904120 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/015b50a4-d550-48a4-a72b-b73b038d7319-combined-ca-bundle\") pod \"015b50a4-d550-48a4-a72b-b73b038d7319\" (UID: \"015b50a4-d550-48a4-a72b-b73b038d7319\") " Mar 16 17:13:39 crc kubenswrapper[5120]: I0316 17:13:39.904236 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/015b50a4-d550-48a4-a72b-b73b038d7319-internal-tls-certs\") pod \"015b50a4-d550-48a4-a72b-b73b038d7319\" (UID: \"015b50a4-d550-48a4-a72b-b73b038d7319\") " Mar 16 17:13:39 crc kubenswrapper[5120]: I0316 17:13:39.904266 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/015b50a4-d550-48a4-a72b-b73b038d7319-config-data-custom\") pod \"015b50a4-d550-48a4-a72b-b73b038d7319\" (UID: \"015b50a4-d550-48a4-a72b-b73b038d7319\") " Mar 16 17:13:39 crc kubenswrapper[5120]: I0316 17:13:39.904352 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/015b50a4-d550-48a4-a72b-b73b038d7319-public-tls-certs\") pod \"015b50a4-d550-48a4-a72b-b73b038d7319\" (UID: \"015b50a4-d550-48a4-a72b-b73b038d7319\") " Mar 16 17:13:39 crc kubenswrapper[5120]: I0316 17:13:39.905827 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/24f83ac4-b285-47e8-94e0-9b47da8c5928-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:13:39 crc kubenswrapper[5120]: I0316 17:13:39.905851 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/24f83ac4-b285-47e8-94e0-9b47da8c5928-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:13:39 crc kubenswrapper[5120]: I0316 17:13:39.905861 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dzggx\" (UniqueName: \"kubernetes.io/projected/24f83ac4-b285-47e8-94e0-9b47da8c5928-kube-api-access-dzggx\") on node \"crc\" DevicePath \"\"" Mar 16 17:13:39 crc kubenswrapper[5120]: I0316 17:13:39.905872 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/24f83ac4-b285-47e8-94e0-9b47da8c5928-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 17:13:39 crc kubenswrapper[5120]: I0316 17:13:39.905881 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/24f83ac4-b285-47e8-94e0-9b47da8c5928-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:13:39 crc kubenswrapper[5120]: I0316 17:13:39.905890 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/24f83ac4-b285-47e8-94e0-9b47da8c5928-logs\") on node \"crc\" DevicePath \"\"" Mar 16 17:13:39 crc kubenswrapper[5120]: I0316 17:13:39.906698 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/015b50a4-d550-48a4-a72b-b73b038d7319-logs" (OuterVolumeSpecName: "logs") pod "015b50a4-d550-48a4-a72b-b73b038d7319" (UID: "015b50a4-d550-48a4-a72b-b73b038d7319"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:13:39 crc kubenswrapper[5120]: I0316 17:13:39.906777 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/015b50a4-d550-48a4-a72b-b73b038d7319-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "015b50a4-d550-48a4-a72b-b73b038d7319" (UID: "015b50a4-d550-48a4-a72b-b73b038d7319"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 17:13:39 crc kubenswrapper[5120]: I0316 17:13:39.912299 5120 scope.go:117] "RemoveContainer" containerID="a5c5a79296326184b8165b774fab8b1a1e69e2ec576ffafb6d5a426e531e7910" Mar 16 17:13:39 crc kubenswrapper[5120]: I0316 17:13:39.912645 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/015b50a4-d550-48a4-a72b-b73b038d7319-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "015b50a4-d550-48a4-a72b-b73b038d7319" (UID: "015b50a4-d550-48a4-a72b-b73b038d7319"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:13:39 crc kubenswrapper[5120]: E0316 17:13:39.913305 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a5c5a79296326184b8165b774fab8b1a1e69e2ec576ffafb6d5a426e531e7910\": container with ID starting with a5c5a79296326184b8165b774fab8b1a1e69e2ec576ffafb6d5a426e531e7910 not found: ID does not exist" containerID="a5c5a79296326184b8165b774fab8b1a1e69e2ec576ffafb6d5a426e531e7910" Mar 16 17:13:39 crc kubenswrapper[5120]: I0316 17:13:39.913338 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5c5a79296326184b8165b774fab8b1a1e69e2ec576ffafb6d5a426e531e7910"} err="failed to get container status \"a5c5a79296326184b8165b774fab8b1a1e69e2ec576ffafb6d5a426e531e7910\": rpc error: code = NotFound desc = could not find container \"a5c5a79296326184b8165b774fab8b1a1e69e2ec576ffafb6d5a426e531e7910\": container with ID starting with a5c5a79296326184b8165b774fab8b1a1e69e2ec576ffafb6d5a426e531e7910 not found: ID does not exist" Mar 16 17:13:39 crc kubenswrapper[5120]: I0316 17:13:39.913382 5120 scope.go:117] "RemoveContainer" containerID="3edc568db612fad0b01bc312a6630be1d7ff70d8485d636c8539653e799955c5" Mar 16 17:13:39 crc kubenswrapper[5120]: E0316 17:13:39.917179 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3edc568db612fad0b01bc312a6630be1d7ff70d8485d636c8539653e799955c5\": container with ID starting with 3edc568db612fad0b01bc312a6630be1d7ff70d8485d636c8539653e799955c5 not found: ID does not exist" containerID="3edc568db612fad0b01bc312a6630be1d7ff70d8485d636c8539653e799955c5" Mar 16 17:13:39 crc kubenswrapper[5120]: I0316 17:13:39.923877 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3edc568db612fad0b01bc312a6630be1d7ff70d8485d636c8539653e799955c5"} err="failed to get container status \"3edc568db612fad0b01bc312a6630be1d7ff70d8485d636c8539653e799955c5\": rpc error: code = NotFound desc = could not find container \"3edc568db612fad0b01bc312a6630be1d7ff70d8485d636c8539653e799955c5\": container with ID starting with 3edc568db612fad0b01bc312a6630be1d7ff70d8485d636c8539653e799955c5 not found: ID does not exist" Mar 16 17:13:39 crc kubenswrapper[5120]: I0316 17:13:39.923926 5120 scope.go:117] "RemoveContainer" containerID="264741933cb9afb14a33b8204211f72d0e94ada20e39cd620593694396a63ed3" Mar 16 17:13:39 crc kubenswrapper[5120]: I0316 17:13:39.917678 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/015b50a4-d550-48a4-a72b-b73b038d7319-kube-api-access-9tbxf" (OuterVolumeSpecName: "kube-api-access-9tbxf") pod "015b50a4-d550-48a4-a72b-b73b038d7319" (UID: "015b50a4-d550-48a4-a72b-b73b038d7319"). InnerVolumeSpecName "kube-api-access-9tbxf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:13:39 crc kubenswrapper[5120]: I0316 17:13:39.924936 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/015b50a4-d550-48a4-a72b-b73b038d7319-scripts" (OuterVolumeSpecName: "scripts") pod "015b50a4-d550-48a4-a72b-b73b038d7319" (UID: "015b50a4-d550-48a4-a72b-b73b038d7319"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:13:39 crc kubenswrapper[5120]: I0316 17:13:39.945275 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24f83ac4-b285-47e8-94e0-9b47da8c5928-config-data" (OuterVolumeSpecName: "config-data") pod "24f83ac4-b285-47e8-94e0-9b47da8c5928" (UID: "24f83ac4-b285-47e8-94e0-9b47da8c5928"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:13:39 crc kubenswrapper[5120]: I0316 17:13:39.968633 5120 scope.go:117] "RemoveContainer" containerID="65347cc7ac37e345bf4d0b8360039f1b9c493b684433c44ebb97b3fa9d240de5" Mar 16 17:13:39 crc kubenswrapper[5120]: I0316 17:13:39.980055 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/015b50a4-d550-48a4-a72b-b73b038d7319-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "015b50a4-d550-48a4-a72b-b73b038d7319" (UID: "015b50a4-d550-48a4-a72b-b73b038d7319"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:13:39 crc kubenswrapper[5120]: I0316 17:13:39.980200 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/015b50a4-d550-48a4-a72b-b73b038d7319-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "015b50a4-d550-48a4-a72b-b73b038d7319" (UID: "015b50a4-d550-48a4-a72b-b73b038d7319"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:13:39 crc kubenswrapper[5120]: I0316 17:13:39.988018 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/015b50a4-d550-48a4-a72b-b73b038d7319-config-data" (OuterVolumeSpecName: "config-data") pod "015b50a4-d550-48a4-a72b-b73b038d7319" (UID: "015b50a4-d550-48a4-a72b-b73b038d7319"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:13:39 crc kubenswrapper[5120]: I0316 17:13:39.999592 5120 scope.go:117] "RemoveContainer" containerID="264741933cb9afb14a33b8204211f72d0e94ada20e39cd620593694396a63ed3" Mar 16 17:13:40 crc kubenswrapper[5120]: E0316 17:13:40.001398 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"264741933cb9afb14a33b8204211f72d0e94ada20e39cd620593694396a63ed3\": container with ID starting with 264741933cb9afb14a33b8204211f72d0e94ada20e39cd620593694396a63ed3 not found: ID does not exist" containerID="264741933cb9afb14a33b8204211f72d0e94ada20e39cd620593694396a63ed3" Mar 16 17:13:40 crc kubenswrapper[5120]: I0316 17:13:40.001437 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"264741933cb9afb14a33b8204211f72d0e94ada20e39cd620593694396a63ed3"} err="failed to get container status \"264741933cb9afb14a33b8204211f72d0e94ada20e39cd620593694396a63ed3\": rpc error: code = NotFound desc = could not find container \"264741933cb9afb14a33b8204211f72d0e94ada20e39cd620593694396a63ed3\": container with ID starting with 264741933cb9afb14a33b8204211f72d0e94ada20e39cd620593694396a63ed3 not found: ID does not exist" Mar 16 17:13:40 crc kubenswrapper[5120]: I0316 17:13:40.001462 5120 scope.go:117] "RemoveContainer" containerID="65347cc7ac37e345bf4d0b8360039f1b9c493b684433c44ebb97b3fa9d240de5" Mar 16 17:13:40 crc kubenswrapper[5120]: I0316 17:13:40.001895 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/015b50a4-d550-48a4-a72b-b73b038d7319-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "015b50a4-d550-48a4-a72b-b73b038d7319" (UID: "015b50a4-d550-48a4-a72b-b73b038d7319"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:13:40 crc kubenswrapper[5120]: E0316 17:13:40.011459 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"65347cc7ac37e345bf4d0b8360039f1b9c493b684433c44ebb97b3fa9d240de5\": container with ID starting with 65347cc7ac37e345bf4d0b8360039f1b9c493b684433c44ebb97b3fa9d240de5 not found: ID does not exist" containerID="65347cc7ac37e345bf4d0b8360039f1b9c493b684433c44ebb97b3fa9d240de5" Mar 16 17:13:40 crc kubenswrapper[5120]: I0316 17:13:40.011531 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65347cc7ac37e345bf4d0b8360039f1b9c493b684433c44ebb97b3fa9d240de5"} err="failed to get container status \"65347cc7ac37e345bf4d0b8360039f1b9c493b684433c44ebb97b3fa9d240de5\": rpc error: code = NotFound desc = could not find container \"65347cc7ac37e345bf4d0b8360039f1b9c493b684433c44ebb97b3fa9d240de5\": container with ID starting with 65347cc7ac37e345bf4d0b8360039f1b9c493b684433c44ebb97b3fa9d240de5 not found: ID does not exist" Mar 16 17:13:40 crc kubenswrapper[5120]: I0316 17:13:40.011558 5120 scope.go:117] "RemoveContainer" containerID="264741933cb9afb14a33b8204211f72d0e94ada20e39cd620593694396a63ed3" Mar 16 17:13:40 crc kubenswrapper[5120]: I0316 17:13:40.013571 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"264741933cb9afb14a33b8204211f72d0e94ada20e39cd620593694396a63ed3"} err="failed to get container status \"264741933cb9afb14a33b8204211f72d0e94ada20e39cd620593694396a63ed3\": rpc error: code = NotFound desc = could not find container \"264741933cb9afb14a33b8204211f72d0e94ada20e39cd620593694396a63ed3\": container with ID starting with 264741933cb9afb14a33b8204211f72d0e94ada20e39cd620593694396a63ed3 not found: ID does not exist" Mar 16 17:13:40 crc kubenswrapper[5120]: I0316 17:13:40.013616 5120 scope.go:117] "RemoveContainer" containerID="65347cc7ac37e345bf4d0b8360039f1b9c493b684433c44ebb97b3fa9d240de5" Mar 16 17:13:40 crc kubenswrapper[5120]: I0316 17:13:40.014453 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9tbxf\" (UniqueName: \"kubernetes.io/projected/015b50a4-d550-48a4-a72b-b73b038d7319-kube-api-access-9tbxf\") on node \"crc\" DevicePath \"\"" Mar 16 17:13:40 crc kubenswrapper[5120]: I0316 17:13:40.014501 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/015b50a4-d550-48a4-a72b-b73b038d7319-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:13:40 crc kubenswrapper[5120]: I0316 17:13:40.014514 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/24f83ac4-b285-47e8-94e0-9b47da8c5928-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:13:40 crc kubenswrapper[5120]: I0316 17:13:40.014527 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/015b50a4-d550-48a4-a72b-b73b038d7319-logs\") on node \"crc\" DevicePath \"\"" Mar 16 17:13:40 crc kubenswrapper[5120]: I0316 17:13:40.014538 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/015b50a4-d550-48a4-a72b-b73b038d7319-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:13:40 crc kubenswrapper[5120]: I0316 17:13:40.014549 5120 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/015b50a4-d550-48a4-a72b-b73b038d7319-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 17:13:40 crc kubenswrapper[5120]: I0316 17:13:40.014563 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/015b50a4-d550-48a4-a72b-b73b038d7319-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:13:40 crc kubenswrapper[5120]: I0316 17:13:40.014574 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/015b50a4-d550-48a4-a72b-b73b038d7319-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:13:40 crc kubenswrapper[5120]: I0316 17:13:40.014583 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/015b50a4-d550-48a4-a72b-b73b038d7319-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 17:13:40 crc kubenswrapper[5120]: I0316 17:13:40.014595 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/015b50a4-d550-48a4-a72b-b73b038d7319-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:13:40 crc kubenswrapper[5120]: I0316 17:13:40.016859 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65347cc7ac37e345bf4d0b8360039f1b9c493b684433c44ebb97b3fa9d240de5"} err="failed to get container status \"65347cc7ac37e345bf4d0b8360039f1b9c493b684433c44ebb97b3fa9d240de5\": rpc error: code = NotFound desc = could not find container \"65347cc7ac37e345bf4d0b8360039f1b9c493b684433c44ebb97b3fa9d240de5\": container with ID starting with 65347cc7ac37e345bf4d0b8360039f1b9c493b684433c44ebb97b3fa9d240de5 not found: ID does not exist" Mar 16 17:13:40 crc kubenswrapper[5120]: I0316 17:13:40.113313 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-54b8764f4-w5thh"] Mar 16 17:13:40 crc kubenswrapper[5120]: I0316 17:13:40.199369 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-67f6766cc8-lpvm7"] Mar 16 17:13:40 crc kubenswrapper[5120]: I0316 17:13:40.214156 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-api-67f6766cc8-lpvm7"] Mar 16 17:13:40 crc kubenswrapper[5120]: I0316 17:13:40.237307 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 17:13:40 crc kubenswrapper[5120]: I0316 17:13:40.269732 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 17:13:40 crc kubenswrapper[5120]: I0316 17:13:40.280021 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 17:13:40 crc kubenswrapper[5120]: I0316 17:13:40.281220 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="015b50a4-d550-48a4-a72b-b73b038d7319" containerName="cinder-api-log" Mar 16 17:13:40 crc kubenswrapper[5120]: I0316 17:13:40.281241 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="015b50a4-d550-48a4-a72b-b73b038d7319" containerName="cinder-api-log" Mar 16 17:13:40 crc kubenswrapper[5120]: I0316 17:13:40.281250 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="015b50a4-d550-48a4-a72b-b73b038d7319" containerName="cinder-api" Mar 16 17:13:40 crc kubenswrapper[5120]: I0316 17:13:40.281256 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="015b50a4-d550-48a4-a72b-b73b038d7319" containerName="cinder-api" Mar 16 17:13:40 crc kubenswrapper[5120]: I0316 17:13:40.281268 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24f83ac4-b285-47e8-94e0-9b47da8c5928" containerName="barbican-api-log" Mar 16 17:13:40 crc kubenswrapper[5120]: I0316 17:13:40.281273 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="24f83ac4-b285-47e8-94e0-9b47da8c5928" containerName="barbican-api-log" Mar 16 17:13:40 crc kubenswrapper[5120]: I0316 17:13:40.281288 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24f83ac4-b285-47e8-94e0-9b47da8c5928" containerName="barbican-api" Mar 16 17:13:40 crc kubenswrapper[5120]: I0316 17:13:40.281293 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="24f83ac4-b285-47e8-94e0-9b47da8c5928" containerName="barbican-api" Mar 16 17:13:40 crc kubenswrapper[5120]: I0316 17:13:40.281492 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="24f83ac4-b285-47e8-94e0-9b47da8c5928" containerName="barbican-api-log" Mar 16 17:13:40 crc kubenswrapper[5120]: I0316 17:13:40.281504 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="24f83ac4-b285-47e8-94e0-9b47da8c5928" containerName="barbican-api" Mar 16 17:13:40 crc kubenswrapper[5120]: I0316 17:13:40.281515 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="015b50a4-d550-48a4-a72b-b73b038d7319" containerName="cinder-api" Mar 16 17:13:40 crc kubenswrapper[5120]: I0316 17:13:40.281527 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="015b50a4-d550-48a4-a72b-b73b038d7319" containerName="cinder-api-log" Mar 16 17:13:40 crc kubenswrapper[5120]: I0316 17:13:40.298292 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 17:13:40 crc kubenswrapper[5120]: I0316 17:13:40.298551 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:13:40 crc kubenswrapper[5120]: I0316 17:13:40.303247 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-cinder-public-svc\"" Mar 16 17:13:40 crc kubenswrapper[5120]: I0316 17:13:40.303654 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-cinder-internal-svc\"" Mar 16 17:13:40 crc kubenswrapper[5120]: I0316 17:13:40.306093 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-api-config-data\"" Mar 16 17:13:40 crc kubenswrapper[5120]: I0316 17:13:40.429068 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/d14c3978-d254-4ec4-baa0-f011eaef745e-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"d14c3978-d254-4ec4-baa0-f011eaef745e\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:13:40 crc kubenswrapper[5120]: I0316 17:13:40.429163 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/d14c3978-d254-4ec4-baa0-f011eaef745e-config-data-custom\") pod \"cinder-api-0\" (UID: \"d14c3978-d254-4ec4-baa0-f011eaef745e\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:13:40 crc kubenswrapper[5120]: I0316 17:13:40.429223 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d14c3978-d254-4ec4-baa0-f011eaef745e-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"d14c3978-d254-4ec4-baa0-f011eaef745e\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:13:40 crc kubenswrapper[5120]: I0316 17:13:40.429268 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/d14c3978-d254-4ec4-baa0-f011eaef745e-etc-machine-id\") pod \"cinder-api-0\" (UID: \"d14c3978-d254-4ec4-baa0-f011eaef745e\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:13:40 crc kubenswrapper[5120]: I0316 17:13:40.429313 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d14c3978-d254-4ec4-baa0-f011eaef745e-logs\") pod \"cinder-api-0\" (UID: \"d14c3978-d254-4ec4-baa0-f011eaef745e\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:13:40 crc kubenswrapper[5120]: I0316 17:13:40.429342 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/d14c3978-d254-4ec4-baa0-f011eaef745e-public-tls-certs\") pod \"cinder-api-0\" (UID: \"d14c3978-d254-4ec4-baa0-f011eaef745e\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:13:40 crc kubenswrapper[5120]: I0316 17:13:40.429394 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d14c3978-d254-4ec4-baa0-f011eaef745e-scripts\") pod \"cinder-api-0\" (UID: \"d14c3978-d254-4ec4-baa0-f011eaef745e\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:13:40 crc kubenswrapper[5120]: I0316 17:13:40.429499 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rp5n\" (UniqueName: \"kubernetes.io/projected/d14c3978-d254-4ec4-baa0-f011eaef745e-kube-api-access-9rp5n\") pod \"cinder-api-0\" (UID: \"d14c3978-d254-4ec4-baa0-f011eaef745e\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:13:40 crc kubenswrapper[5120]: I0316 17:13:40.429620 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d14c3978-d254-4ec4-baa0-f011eaef745e-config-data\") pod \"cinder-api-0\" (UID: \"d14c3978-d254-4ec4-baa0-f011eaef745e\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:13:40 crc kubenswrapper[5120]: I0316 17:13:40.531405 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d14c3978-d254-4ec4-baa0-f011eaef745e-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"d14c3978-d254-4ec4-baa0-f011eaef745e\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:13:40 crc kubenswrapper[5120]: I0316 17:13:40.531479 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/d14c3978-d254-4ec4-baa0-f011eaef745e-etc-machine-id\") pod \"cinder-api-0\" (UID: \"d14c3978-d254-4ec4-baa0-f011eaef745e\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:13:40 crc kubenswrapper[5120]: I0316 17:13:40.531523 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d14c3978-d254-4ec4-baa0-f011eaef745e-logs\") pod \"cinder-api-0\" (UID: \"d14c3978-d254-4ec4-baa0-f011eaef745e\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:13:40 crc kubenswrapper[5120]: I0316 17:13:40.531558 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/d14c3978-d254-4ec4-baa0-f011eaef745e-public-tls-certs\") pod \"cinder-api-0\" (UID: \"d14c3978-d254-4ec4-baa0-f011eaef745e\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:13:40 crc kubenswrapper[5120]: I0316 17:13:40.531635 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d14c3978-d254-4ec4-baa0-f011eaef745e-scripts\") pod \"cinder-api-0\" (UID: \"d14c3978-d254-4ec4-baa0-f011eaef745e\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:13:40 crc kubenswrapper[5120]: I0316 17:13:40.531815 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9rp5n\" (UniqueName: \"kubernetes.io/projected/d14c3978-d254-4ec4-baa0-f011eaef745e-kube-api-access-9rp5n\") pod \"cinder-api-0\" (UID: \"d14c3978-d254-4ec4-baa0-f011eaef745e\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:13:40 crc kubenswrapper[5120]: I0316 17:13:40.531998 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d14c3978-d254-4ec4-baa0-f011eaef745e-config-data\") pod \"cinder-api-0\" (UID: \"d14c3978-d254-4ec4-baa0-f011eaef745e\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:13:40 crc kubenswrapper[5120]: I0316 17:13:40.532165 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/d14c3978-d254-4ec4-baa0-f011eaef745e-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"d14c3978-d254-4ec4-baa0-f011eaef745e\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:13:40 crc kubenswrapper[5120]: I0316 17:13:40.532219 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/d14c3978-d254-4ec4-baa0-f011eaef745e-config-data-custom\") pod \"cinder-api-0\" (UID: \"d14c3978-d254-4ec4-baa0-f011eaef745e\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:13:40 crc kubenswrapper[5120]: I0316 17:13:40.538092 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d14c3978-d254-4ec4-baa0-f011eaef745e-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"d14c3978-d254-4ec4-baa0-f011eaef745e\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:13:40 crc kubenswrapper[5120]: I0316 17:13:40.538204 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/d14c3978-d254-4ec4-baa0-f011eaef745e-config-data-custom\") pod \"cinder-api-0\" (UID: \"d14c3978-d254-4ec4-baa0-f011eaef745e\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:13:40 crc kubenswrapper[5120]: I0316 17:13:40.538213 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/d14c3978-d254-4ec4-baa0-f011eaef745e-etc-machine-id\") pod \"cinder-api-0\" (UID: \"d14c3978-d254-4ec4-baa0-f011eaef745e\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:13:40 crc kubenswrapper[5120]: I0316 17:13:40.538590 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d14c3978-d254-4ec4-baa0-f011eaef745e-logs\") pod \"cinder-api-0\" (UID: \"d14c3978-d254-4ec4-baa0-f011eaef745e\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:13:40 crc kubenswrapper[5120]: I0316 17:13:40.545138 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d14c3978-d254-4ec4-baa0-f011eaef745e-scripts\") pod \"cinder-api-0\" (UID: \"d14c3978-d254-4ec4-baa0-f011eaef745e\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:13:40 crc kubenswrapper[5120]: I0316 17:13:40.554781 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d14c3978-d254-4ec4-baa0-f011eaef745e-config-data\") pod \"cinder-api-0\" (UID: \"d14c3978-d254-4ec4-baa0-f011eaef745e\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:13:40 crc kubenswrapper[5120]: I0316 17:13:40.557520 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/d14c3978-d254-4ec4-baa0-f011eaef745e-public-tls-certs\") pod \"cinder-api-0\" (UID: \"d14c3978-d254-4ec4-baa0-f011eaef745e\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:13:40 crc kubenswrapper[5120]: I0316 17:13:40.564907 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rp5n\" (UniqueName: \"kubernetes.io/projected/d14c3978-d254-4ec4-baa0-f011eaef745e-kube-api-access-9rp5n\") pod \"cinder-api-0\" (UID: \"d14c3978-d254-4ec4-baa0-f011eaef745e\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:13:40 crc kubenswrapper[5120]: I0316 17:13:40.564950 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/d14c3978-d254-4ec4-baa0-f011eaef745e-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"d14c3978-d254-4ec4-baa0-f011eaef745e\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:13:40 crc kubenswrapper[5120]: I0316 17:13:40.641539 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:13:40 crc kubenswrapper[5120]: I0316 17:13:40.667289 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-75c7b8c84b-ckzdf" Mar 16 17:13:40 crc kubenswrapper[5120]: I0316 17:13:40.678121 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="015b50a4-d550-48a4-a72b-b73b038d7319" path="/var/lib/kubelet/pods/015b50a4-d550-48a4-a72b-b73b038d7319/volumes" Mar 16 17:13:40 crc kubenswrapper[5120]: I0316 17:13:40.679444 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ae5285c-173c-4162-9610-3f9c3a4ef47b" path="/var/lib/kubelet/pods/1ae5285c-173c-4162-9610-3f9c3a4ef47b/volumes" Mar 16 17:13:40 crc kubenswrapper[5120]: I0316 17:13:40.680279 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="24f83ac4-b285-47e8-94e0-9b47da8c5928" path="/var/lib/kubelet/pods/24f83ac4-b285-47e8-94e0-9b47da8c5928/volumes" Mar 16 17:13:40 crc kubenswrapper[5120]: I0316 17:13:40.748896 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:13:40 crc kubenswrapper[5120]: I0316 17:13:40.843337 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/eb3d95a7-f6af-46bc-a343-959b4a348c8e-config-data-custom\") pod \"eb3d95a7-f6af-46bc-a343-959b4a348c8e\" (UID: \"eb3d95a7-f6af-46bc-a343-959b4a348c8e\") " Mar 16 17:13:40 crc kubenswrapper[5120]: I0316 17:13:40.843812 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/59a6de62-1f3e-48b3-b377-4a582f759b5b-combined-ca-bundle\") pod \"59a6de62-1f3e-48b3-b377-4a582f759b5b\" (UID: \"59a6de62-1f3e-48b3-b377-4a582f759b5b\") " Mar 16 17:13:40 crc kubenswrapper[5120]: I0316 17:13:40.843908 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/eb3d95a7-f6af-46bc-a343-959b4a348c8e-etc-machine-id\") pod \"eb3d95a7-f6af-46bc-a343-959b4a348c8e\" (UID: \"eb3d95a7-f6af-46bc-a343-959b4a348c8e\") " Mar 16 17:13:40 crc kubenswrapper[5120]: I0316 17:13:40.843939 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/59a6de62-1f3e-48b3-b377-4a582f759b5b-config-data-custom\") pod \"59a6de62-1f3e-48b3-b377-4a582f759b5b\" (UID: \"59a6de62-1f3e-48b3-b377-4a582f759b5b\") " Mar 16 17:13:40 crc kubenswrapper[5120]: I0316 17:13:40.844018 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/eb3d95a7-f6af-46bc-a343-959b4a348c8e-config-data\") pod \"eb3d95a7-f6af-46bc-a343-959b4a348c8e\" (UID: \"eb3d95a7-f6af-46bc-a343-959b4a348c8e\") " Mar 16 17:13:40 crc kubenswrapper[5120]: I0316 17:13:40.844067 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eb3d95a7-f6af-46bc-a343-959b4a348c8e-combined-ca-bundle\") pod \"eb3d95a7-f6af-46bc-a343-959b4a348c8e\" (UID: \"eb3d95a7-f6af-46bc-a343-959b4a348c8e\") " Mar 16 17:13:40 crc kubenswrapper[5120]: I0316 17:13:40.844155 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/eb3d95a7-f6af-46bc-a343-959b4a348c8e-scripts\") pod \"eb3d95a7-f6af-46bc-a343-959b4a348c8e\" (UID: \"eb3d95a7-f6af-46bc-a343-959b4a348c8e\") " Mar 16 17:13:40 crc kubenswrapper[5120]: I0316 17:13:40.844203 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/59a6de62-1f3e-48b3-b377-4a582f759b5b-logs\") pod \"59a6de62-1f3e-48b3-b377-4a582f759b5b\" (UID: \"59a6de62-1f3e-48b3-b377-4a582f759b5b\") " Mar 16 17:13:40 crc kubenswrapper[5120]: I0316 17:13:40.844272 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n5p7h\" (UniqueName: \"kubernetes.io/projected/eb3d95a7-f6af-46bc-a343-959b4a348c8e-kube-api-access-n5p7h\") pod \"eb3d95a7-f6af-46bc-a343-959b4a348c8e\" (UID: \"eb3d95a7-f6af-46bc-a343-959b4a348c8e\") " Mar 16 17:13:40 crc kubenswrapper[5120]: I0316 17:13:40.844643 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/eb3d95a7-f6af-46bc-a343-959b4a348c8e-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "eb3d95a7-f6af-46bc-a343-959b4a348c8e" (UID: "eb3d95a7-f6af-46bc-a343-959b4a348c8e"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 17:13:40 crc kubenswrapper[5120]: I0316 17:13:40.844693 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/59a6de62-1f3e-48b3-b377-4a582f759b5b-config-data\") pod \"59a6de62-1f3e-48b3-b377-4a582f759b5b\" (UID: \"59a6de62-1f3e-48b3-b377-4a582f759b5b\") " Mar 16 17:13:40 crc kubenswrapper[5120]: I0316 17:13:40.845345 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59a6de62-1f3e-48b3-b377-4a582f759b5b-logs" (OuterVolumeSpecName: "logs") pod "59a6de62-1f3e-48b3-b377-4a582f759b5b" (UID: "59a6de62-1f3e-48b3-b377-4a582f759b5b"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:13:40 crc kubenswrapper[5120]: I0316 17:13:40.846485 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vgn2g\" (UniqueName: \"kubernetes.io/projected/59a6de62-1f3e-48b3-b377-4a582f759b5b-kube-api-access-vgn2g\") pod \"59a6de62-1f3e-48b3-b377-4a582f759b5b\" (UID: \"59a6de62-1f3e-48b3-b377-4a582f759b5b\") " Mar 16 17:13:40 crc kubenswrapper[5120]: I0316 17:13:40.847953 5120 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/eb3d95a7-f6af-46bc-a343-959b4a348c8e-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 17:13:40 crc kubenswrapper[5120]: I0316 17:13:40.847979 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/59a6de62-1f3e-48b3-b377-4a582f759b5b-logs\") on node \"crc\" DevicePath \"\"" Mar 16 17:13:40 crc kubenswrapper[5120]: I0316 17:13:40.852008 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eb3d95a7-f6af-46bc-a343-959b4a348c8e-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "eb3d95a7-f6af-46bc-a343-959b4a348c8e" (UID: "eb3d95a7-f6af-46bc-a343-959b4a348c8e"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:13:40 crc kubenswrapper[5120]: I0316 17:13:40.853081 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb3d95a7-f6af-46bc-a343-959b4a348c8e-kube-api-access-n5p7h" (OuterVolumeSpecName: "kube-api-access-n5p7h") pod "eb3d95a7-f6af-46bc-a343-959b4a348c8e" (UID: "eb3d95a7-f6af-46bc-a343-959b4a348c8e"). InnerVolumeSpecName "kube-api-access-n5p7h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:13:40 crc kubenswrapper[5120]: I0316 17:13:40.853241 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/59a6de62-1f3e-48b3-b377-4a582f759b5b-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "59a6de62-1f3e-48b3-b377-4a582f759b5b" (UID: "59a6de62-1f3e-48b3-b377-4a582f759b5b"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:13:40 crc kubenswrapper[5120]: I0316 17:13:40.859162 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eb3d95a7-f6af-46bc-a343-959b4a348c8e-scripts" (OuterVolumeSpecName: "scripts") pod "eb3d95a7-f6af-46bc-a343-959b4a348c8e" (UID: "eb3d95a7-f6af-46bc-a343-959b4a348c8e"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:13:40 crc kubenswrapper[5120]: I0316 17:13:40.859367 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59a6de62-1f3e-48b3-b377-4a582f759b5b-kube-api-access-vgn2g" (OuterVolumeSpecName: "kube-api-access-vgn2g") pod "59a6de62-1f3e-48b3-b377-4a582f759b5b" (UID: "59a6de62-1f3e-48b3-b377-4a582f759b5b"). InnerVolumeSpecName "kube-api-access-vgn2g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:13:40 crc kubenswrapper[5120]: I0316 17:13:40.881162 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"e653cf48-8db9-4fe8-9478-a3207ab76c97","Type":"ContainerStarted","Data":"8989093cd2b31486c0447902c228c679bdf019f2265ec9159f2c17f23921c256"} Mar 16 17:13:40 crc kubenswrapper[5120]: I0316 17:13:40.887371 5120 generic.go:358] "Generic (PLEG): container finished" podID="eb3d95a7-f6af-46bc-a343-959b4a348c8e" containerID="d5e28dd72ea37fb2433469185534c4d71e392b29110df6cf8da1aa8e148a6deb" exitCode=0 Mar 16 17:13:40 crc kubenswrapper[5120]: I0316 17:13:40.887680 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"eb3d95a7-f6af-46bc-a343-959b4a348c8e","Type":"ContainerDied","Data":"d5e28dd72ea37fb2433469185534c4d71e392b29110df6cf8da1aa8e148a6deb"} Mar 16 17:13:40 crc kubenswrapper[5120]: I0316 17:13:40.888836 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"eb3d95a7-f6af-46bc-a343-959b4a348c8e","Type":"ContainerDied","Data":"0f440fa1e5f574b2fc25fc575c80bc91418c7afa153263bbc5f887408ef13987"} Mar 16 17:13:40 crc kubenswrapper[5120]: I0316 17:13:40.888880 5120 scope.go:117] "RemoveContainer" containerID="3ee553c64803dc362cb962dfc738d60a7745b099dca56113882d251bfa601e39" Mar 16 17:13:40 crc kubenswrapper[5120]: I0316 17:13:40.889053 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:13:40 crc kubenswrapper[5120]: I0316 17:13:40.909575 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-54b8764f4-w5thh" event={"ID":"35eb763c-5d62-4401-a5b6-da3c538709ab","Type":"ContainerStarted","Data":"e4a638cbed60817301f57976644cbe4df50aed911247759003265d9dbc556dc2"} Mar 16 17:13:40 crc kubenswrapper[5120]: I0316 17:13:40.909623 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-54b8764f4-w5thh" event={"ID":"35eb763c-5d62-4401-a5b6-da3c538709ab","Type":"ContainerStarted","Data":"b4380370accac18f804b76da99f6148bb5bc26af5ff445037eeaf4e7170351ed"} Mar 16 17:13:40 crc kubenswrapper[5120]: I0316 17:13:40.952107 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-75c7b8c84b-ckzdf" event={"ID":"59a6de62-1f3e-48b3-b377-4a582f759b5b","Type":"ContainerDied","Data":"ff70c65256a60c336e8c5e3c5eb495d25d969b6ac4f09a24b197af843bfb2755"} Mar 16 17:13:40 crc kubenswrapper[5120]: I0316 17:13:40.952177 5120 scope.go:117] "RemoveContainer" containerID="d5e28dd72ea37fb2433469185534c4d71e392b29110df6cf8da1aa8e148a6deb" Mar 16 17:13:40 crc kubenswrapper[5120]: I0316 17:13:40.952208 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-75c7b8c84b-ckzdf" Mar 16 17:13:40 crc kubenswrapper[5120]: I0316 17:13:40.952820 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/eb3d95a7-f6af-46bc-a343-959b4a348c8e-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:13:40 crc kubenswrapper[5120]: I0316 17:13:40.952859 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n5p7h\" (UniqueName: \"kubernetes.io/projected/eb3d95a7-f6af-46bc-a343-959b4a348c8e-kube-api-access-n5p7h\") on node \"crc\" DevicePath \"\"" Mar 16 17:13:40 crc kubenswrapper[5120]: I0316 17:13:40.952878 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vgn2g\" (UniqueName: \"kubernetes.io/projected/59a6de62-1f3e-48b3-b377-4a582f759b5b-kube-api-access-vgn2g\") on node \"crc\" DevicePath \"\"" Mar 16 17:13:40 crc kubenswrapper[5120]: I0316 17:13:40.952891 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/eb3d95a7-f6af-46bc-a343-959b4a348c8e-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 17:13:40 crc kubenswrapper[5120]: I0316 17:13:40.952904 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/59a6de62-1f3e-48b3-b377-4a582f759b5b-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 17:13:40 crc kubenswrapper[5120]: I0316 17:13:40.970997 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/59a6de62-1f3e-48b3-b377-4a582f759b5b-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "59a6de62-1f3e-48b3-b377-4a582f759b5b" (UID: "59a6de62-1f3e-48b3-b377-4a582f759b5b"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:13:40 crc kubenswrapper[5120]: I0316 17:13:40.977873 5120 scope.go:117] "RemoveContainer" containerID="3ee553c64803dc362cb962dfc738d60a7745b099dca56113882d251bfa601e39" Mar 16 17:13:40 crc kubenswrapper[5120]: E0316 17:13:40.978265 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ee553c64803dc362cb962dfc738d60a7745b099dca56113882d251bfa601e39\": container with ID starting with 3ee553c64803dc362cb962dfc738d60a7745b099dca56113882d251bfa601e39 not found: ID does not exist" containerID="3ee553c64803dc362cb962dfc738d60a7745b099dca56113882d251bfa601e39" Mar 16 17:13:40 crc kubenswrapper[5120]: I0316 17:13:40.978305 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ee553c64803dc362cb962dfc738d60a7745b099dca56113882d251bfa601e39"} err="failed to get container status \"3ee553c64803dc362cb962dfc738d60a7745b099dca56113882d251bfa601e39\": rpc error: code = NotFound desc = could not find container \"3ee553c64803dc362cb962dfc738d60a7745b099dca56113882d251bfa601e39\": container with ID starting with 3ee553c64803dc362cb962dfc738d60a7745b099dca56113882d251bfa601e39 not found: ID does not exist" Mar 16 17:13:40 crc kubenswrapper[5120]: I0316 17:13:40.978330 5120 scope.go:117] "RemoveContainer" containerID="d5e28dd72ea37fb2433469185534c4d71e392b29110df6cf8da1aa8e148a6deb" Mar 16 17:13:40 crc kubenswrapper[5120]: E0316 17:13:40.978602 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d5e28dd72ea37fb2433469185534c4d71e392b29110df6cf8da1aa8e148a6deb\": container with ID starting with d5e28dd72ea37fb2433469185534c4d71e392b29110df6cf8da1aa8e148a6deb not found: ID does not exist" containerID="d5e28dd72ea37fb2433469185534c4d71e392b29110df6cf8da1aa8e148a6deb" Mar 16 17:13:40 crc kubenswrapper[5120]: I0316 17:13:40.978641 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5e28dd72ea37fb2433469185534c4d71e392b29110df6cf8da1aa8e148a6deb"} err="failed to get container status \"d5e28dd72ea37fb2433469185534c4d71e392b29110df6cf8da1aa8e148a6deb\": rpc error: code = NotFound desc = could not find container \"d5e28dd72ea37fb2433469185534c4d71e392b29110df6cf8da1aa8e148a6deb\": container with ID starting with d5e28dd72ea37fb2433469185534c4d71e392b29110df6cf8da1aa8e148a6deb not found: ID does not exist" Mar 16 17:13:40 crc kubenswrapper[5120]: I0316 17:13:40.978660 5120 scope.go:117] "RemoveContainer" containerID="baed72a6239409dd140c1260daff487672bacf7c3d16715b6e4af9d1ad0321a8" Mar 16 17:13:40 crc kubenswrapper[5120]: I0316 17:13:40.994584 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eb3d95a7-f6af-46bc-a343-959b4a348c8e-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "eb3d95a7-f6af-46bc-a343-959b4a348c8e" (UID: "eb3d95a7-f6af-46bc-a343-959b4a348c8e"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:13:41 crc kubenswrapper[5120]: I0316 17:13:41.010415 5120 scope.go:117] "RemoveContainer" containerID="9685938fad2613a5505b0b2539c08389dfeddd3eaefd68d93e1d3acf1eaa8047" Mar 16 17:13:41 crc kubenswrapper[5120]: I0316 17:13:41.013920 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/59a6de62-1f3e-48b3-b377-4a582f759b5b-config-data" (OuterVolumeSpecName: "config-data") pod "59a6de62-1f3e-48b3-b377-4a582f759b5b" (UID: "59a6de62-1f3e-48b3-b377-4a582f759b5b"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:13:41 crc kubenswrapper[5120]: I0316 17:13:41.050192 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eb3d95a7-f6af-46bc-a343-959b4a348c8e-config-data" (OuterVolumeSpecName: "config-data") pod "eb3d95a7-f6af-46bc-a343-959b4a348c8e" (UID: "eb3d95a7-f6af-46bc-a343-959b4a348c8e"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:13:41 crc kubenswrapper[5120]: I0316 17:13:41.055432 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/59a6de62-1f3e-48b3-b377-4a582f759b5b-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:13:41 crc kubenswrapper[5120]: I0316 17:13:41.055464 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/eb3d95a7-f6af-46bc-a343-959b4a348c8e-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:13:41 crc kubenswrapper[5120]: I0316 17:13:41.055475 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eb3d95a7-f6af-46bc-a343-959b4a348c8e-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:13:41 crc kubenswrapper[5120]: I0316 17:13:41.055484 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/59a6de62-1f3e-48b3-b377-4a582f759b5b-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:13:41 crc kubenswrapper[5120]: I0316 17:13:41.222048 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 17:13:41 crc kubenswrapper[5120]: I0316 17:13:41.231649 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 17:13:41 crc kubenswrapper[5120]: I0316 17:13:41.258253 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 17:13:41 crc kubenswrapper[5120]: I0316 17:13:41.309127 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 17:13:41 crc kubenswrapper[5120]: I0316 17:13:41.310220 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59a6de62-1f3e-48b3-b377-4a582f759b5b" containerName="barbican-keystone-listener" Mar 16 17:13:41 crc kubenswrapper[5120]: I0316 17:13:41.310233 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="59a6de62-1f3e-48b3-b377-4a582f759b5b" containerName="barbican-keystone-listener" Mar 16 17:13:41 crc kubenswrapper[5120]: I0316 17:13:41.310249 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb3d95a7-f6af-46bc-a343-959b4a348c8e" containerName="cinder-scheduler" Mar 16 17:13:41 crc kubenswrapper[5120]: I0316 17:13:41.310255 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb3d95a7-f6af-46bc-a343-959b4a348c8e" containerName="cinder-scheduler" Mar 16 17:13:41 crc kubenswrapper[5120]: I0316 17:13:41.310263 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb3d95a7-f6af-46bc-a343-959b4a348c8e" containerName="probe" Mar 16 17:13:41 crc kubenswrapper[5120]: I0316 17:13:41.310268 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb3d95a7-f6af-46bc-a343-959b4a348c8e" containerName="probe" Mar 16 17:13:41 crc kubenswrapper[5120]: I0316 17:13:41.310301 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59a6de62-1f3e-48b3-b377-4a582f759b5b" containerName="barbican-keystone-listener-log" Mar 16 17:13:41 crc kubenswrapper[5120]: I0316 17:13:41.310307 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="59a6de62-1f3e-48b3-b377-4a582f759b5b" containerName="barbican-keystone-listener-log" Mar 16 17:13:41 crc kubenswrapper[5120]: I0316 17:13:41.310460 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="59a6de62-1f3e-48b3-b377-4a582f759b5b" containerName="barbican-keystone-listener" Mar 16 17:13:41 crc kubenswrapper[5120]: I0316 17:13:41.310476 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="59a6de62-1f3e-48b3-b377-4a582f759b5b" containerName="barbican-keystone-listener-log" Mar 16 17:13:41 crc kubenswrapper[5120]: I0316 17:13:41.310490 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="eb3d95a7-f6af-46bc-a343-959b4a348c8e" containerName="cinder-scheduler" Mar 16 17:13:41 crc kubenswrapper[5120]: I0316 17:13:41.310498 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="eb3d95a7-f6af-46bc-a343-959b4a348c8e" containerName="probe" Mar 16 17:13:41 crc kubenswrapper[5120]: I0316 17:13:41.315631 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:13:41 crc kubenswrapper[5120]: I0316 17:13:41.317843 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-scheduler-config-data\"" Mar 16 17:13:41 crc kubenswrapper[5120]: I0316 17:13:41.335968 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 17:13:41 crc kubenswrapper[5120]: I0316 17:13:41.381037 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/57e08e60-42d1-4b58-9892-c2aa5bbae2cf-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"57e08e60-42d1-4b58-9892-c2aa5bbae2cf\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:13:41 crc kubenswrapper[5120]: I0316 17:13:41.381464 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrwbk\" (UniqueName: \"kubernetes.io/projected/57e08e60-42d1-4b58-9892-c2aa5bbae2cf-kube-api-access-qrwbk\") pod \"cinder-scheduler-0\" (UID: \"57e08e60-42d1-4b58-9892-c2aa5bbae2cf\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:13:41 crc kubenswrapper[5120]: I0316 17:13:41.381528 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/57e08e60-42d1-4b58-9892-c2aa5bbae2cf-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"57e08e60-42d1-4b58-9892-c2aa5bbae2cf\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:13:41 crc kubenswrapper[5120]: I0316 17:13:41.381729 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/57e08e60-42d1-4b58-9892-c2aa5bbae2cf-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"57e08e60-42d1-4b58-9892-c2aa5bbae2cf\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:13:41 crc kubenswrapper[5120]: I0316 17:13:41.381805 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/57e08e60-42d1-4b58-9892-c2aa5bbae2cf-config-data\") pod \"cinder-scheduler-0\" (UID: \"57e08e60-42d1-4b58-9892-c2aa5bbae2cf\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:13:41 crc kubenswrapper[5120]: I0316 17:13:41.382085 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/57e08e60-42d1-4b58-9892-c2aa5bbae2cf-scripts\") pod \"cinder-scheduler-0\" (UID: \"57e08e60-42d1-4b58-9892-c2aa5bbae2cf\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:13:41 crc kubenswrapper[5120]: I0316 17:13:41.406669 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-75c7b8c84b-ckzdf"] Mar 16 17:13:41 crc kubenswrapper[5120]: I0316 17:13:41.422900 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-75c7b8c84b-ckzdf"] Mar 16 17:13:41 crc kubenswrapper[5120]: I0316 17:13:41.498065 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/57e08e60-42d1-4b58-9892-c2aa5bbae2cf-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"57e08e60-42d1-4b58-9892-c2aa5bbae2cf\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:13:41 crc kubenswrapper[5120]: I0316 17:13:41.498257 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qrwbk\" (UniqueName: \"kubernetes.io/projected/57e08e60-42d1-4b58-9892-c2aa5bbae2cf-kube-api-access-qrwbk\") pod \"cinder-scheduler-0\" (UID: \"57e08e60-42d1-4b58-9892-c2aa5bbae2cf\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:13:41 crc kubenswrapper[5120]: I0316 17:13:41.498340 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/57e08e60-42d1-4b58-9892-c2aa5bbae2cf-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"57e08e60-42d1-4b58-9892-c2aa5bbae2cf\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:13:41 crc kubenswrapper[5120]: I0316 17:13:41.498588 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/57e08e60-42d1-4b58-9892-c2aa5bbae2cf-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"57e08e60-42d1-4b58-9892-c2aa5bbae2cf\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:13:41 crc kubenswrapper[5120]: I0316 17:13:41.498701 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/57e08e60-42d1-4b58-9892-c2aa5bbae2cf-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"57e08e60-42d1-4b58-9892-c2aa5bbae2cf\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:13:41 crc kubenswrapper[5120]: I0316 17:13:41.498999 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/57e08e60-42d1-4b58-9892-c2aa5bbae2cf-config-data\") pod \"cinder-scheduler-0\" (UID: \"57e08e60-42d1-4b58-9892-c2aa5bbae2cf\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:13:41 crc kubenswrapper[5120]: I0316 17:13:41.499221 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/57e08e60-42d1-4b58-9892-c2aa5bbae2cf-scripts\") pod \"cinder-scheduler-0\" (UID: \"57e08e60-42d1-4b58-9892-c2aa5bbae2cf\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:13:41 crc kubenswrapper[5120]: I0316 17:13:41.504068 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/57e08e60-42d1-4b58-9892-c2aa5bbae2cf-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"57e08e60-42d1-4b58-9892-c2aa5bbae2cf\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:13:41 crc kubenswrapper[5120]: I0316 17:13:41.504557 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/57e08e60-42d1-4b58-9892-c2aa5bbae2cf-scripts\") pod \"cinder-scheduler-0\" (UID: \"57e08e60-42d1-4b58-9892-c2aa5bbae2cf\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:13:41 crc kubenswrapper[5120]: I0316 17:13:41.506792 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/57e08e60-42d1-4b58-9892-c2aa5bbae2cf-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"57e08e60-42d1-4b58-9892-c2aa5bbae2cf\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:13:41 crc kubenswrapper[5120]: I0316 17:13:41.510320 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/57e08e60-42d1-4b58-9892-c2aa5bbae2cf-config-data\") pod \"cinder-scheduler-0\" (UID: \"57e08e60-42d1-4b58-9892-c2aa5bbae2cf\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:13:41 crc kubenswrapper[5120]: I0316 17:13:41.517687 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrwbk\" (UniqueName: \"kubernetes.io/projected/57e08e60-42d1-4b58-9892-c2aa5bbae2cf-kube-api-access-qrwbk\") pod \"cinder-scheduler-0\" (UID: \"57e08e60-42d1-4b58-9892-c2aa5bbae2cf\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:13:41 crc kubenswrapper[5120]: I0316 17:13:41.615877 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:13:41 crc kubenswrapper[5120]: I0316 17:13:41.972656 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"d14c3978-d254-4ec4-baa0-f011eaef745e","Type":"ContainerStarted","Data":"0c606db5335af0f99b8f3a48b265f9589d826d63f49a78bcf37f852ffc338db4"} Mar 16 17:13:41 crc kubenswrapper[5120]: I0316 17:13:41.985399 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"e653cf48-8db9-4fe8-9478-a3207ab76c97","Type":"ContainerStarted","Data":"6ed9051ec8823bfbf22ce1272643a6e138dece8ee338be178cec39b284aafecb"} Mar 16 17:13:41 crc kubenswrapper[5120]: I0316 17:13:41.991922 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-54b8764f4-w5thh" event={"ID":"35eb763c-5d62-4401-a5b6-da3c538709ab","Type":"ContainerStarted","Data":"8761461c33c67611245395eb53b183f8ce91a3a0f2ea958ac3ad5d1fcb3bc8b7"} Mar 16 17:13:41 crc kubenswrapper[5120]: I0316 17:13:41.993311 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/neutron-54b8764f4-w5thh" Mar 16 17:13:42 crc kubenswrapper[5120]: I0316 17:13:42.012666 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-54b8764f4-w5thh" podStartSLOduration=3.012644442 podStartE2EDuration="3.012644442s" podCreationTimestamp="2026-03-16 17:13:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:13:42.008486488 +0000 UTC m=+6124.162418145" watchObservedRunningTime="2026-03-16 17:13:42.012644442 +0000 UTC m=+6124.166576099" Mar 16 17:13:42 crc kubenswrapper[5120]: I0316 17:13:42.132996 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 17:13:42 crc kubenswrapper[5120]: I0316 17:13:42.677551 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="59a6de62-1f3e-48b3-b377-4a582f759b5b" path="/var/lib/kubelet/pods/59a6de62-1f3e-48b3-b377-4a582f759b5b/volumes" Mar 16 17:13:42 crc kubenswrapper[5120]: I0316 17:13:42.679066 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eb3d95a7-f6af-46bc-a343-959b4a348c8e" path="/var/lib/kubelet/pods/eb3d95a7-f6af-46bc-a343-959b4a348c8e/volumes" Mar 16 17:13:43 crc kubenswrapper[5120]: I0316 17:13:43.018240 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"57e08e60-42d1-4b58-9892-c2aa5bbae2cf","Type":"ContainerStarted","Data":"a437b88eaedda344c6a65e0ac3eb74f5c61f12ef04b598a292fa32c018d0d536"} Mar 16 17:13:43 crc kubenswrapper[5120]: I0316 17:13:43.031997 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"d14c3978-d254-4ec4-baa0-f011eaef745e","Type":"ContainerStarted","Data":"1e11ae8d54987876ff5eee468abe7e70824cb0497d72bcb53bdc81aed418c318"} Mar 16 17:13:43 crc kubenswrapper[5120]: I0316 17:13:43.034969 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"e653cf48-8db9-4fe8-9478-a3207ab76c97","Type":"ContainerStarted","Data":"ad6f4cf61cb3feac4417796aa1dded828003e1cc426a18dfdeaada2e2db23204"} Mar 16 17:13:43 crc kubenswrapper[5120]: I0316 17:13:43.820878 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-5b49d5d76-5r44p" Mar 16 17:13:44 crc kubenswrapper[5120]: I0316 17:13:44.000882 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-5b49d5d76-5r44p" Mar 16 17:13:44 crc kubenswrapper[5120]: I0316 17:13:44.078380 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"57e08e60-42d1-4b58-9892-c2aa5bbae2cf","Type":"ContainerStarted","Data":"6d193e9b3e72813100bb0dd0568015bdb73ff4460f0f8eabcee9b6e240ce5d85"} Mar 16 17:13:44 crc kubenswrapper[5120]: I0316 17:13:44.080793 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-6b57b99b96-6qzq2"] Mar 16 17:13:44 crc kubenswrapper[5120]: I0316 17:13:44.081091 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-6b57b99b96-6qzq2" podUID="a9bb962d-330a-45a0-9bb0-09b134c425f5" containerName="barbican-api-log" containerID="cri-o://2569aa75c70aca643652bd7b638e6bdabbab1b8e50c71792e0c8d61b43402474" gracePeriod=30 Mar 16 17:13:44 crc kubenswrapper[5120]: I0316 17:13:44.081670 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-6b57b99b96-6qzq2" podUID="a9bb962d-330a-45a0-9bb0-09b134c425f5" containerName="barbican-api" containerID="cri-o://2f6708333611c2d7bdd7b4ca94b08a184cdecc3f31c8b78dac891fa8efb9b0f3" gracePeriod=30 Mar 16 17:13:44 crc kubenswrapper[5120]: I0316 17:13:44.103020 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"d14c3978-d254-4ec4-baa0-f011eaef745e","Type":"ContainerStarted","Data":"64455790d468e852fe6069aaee149c1ccbf41669030eb68f8c6c996c4885896e"} Mar 16 17:13:44 crc kubenswrapper[5120]: I0316 17:13:44.104686 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:13:44 crc kubenswrapper[5120]: I0316 17:13:44.148174 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-api-0" podStartSLOduration=4.148152008 podStartE2EDuration="4.148152008s" podCreationTimestamp="2026-03-16 17:13:40 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:13:44.131534584 +0000 UTC m=+6126.285466231" watchObservedRunningTime="2026-03-16 17:13:44.148152008 +0000 UTC m=+6126.302083665" Mar 16 17:13:45 crc kubenswrapper[5120]: I0316 17:13:45.114141 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"57e08e60-42d1-4b58-9892-c2aa5bbae2cf","Type":"ContainerStarted","Data":"e45a713f90daea3dfb25bc19fbe35a5087a998babd98c6f27853be3e15ff43a6"} Mar 16 17:13:45 crc kubenswrapper[5120]: I0316 17:13:45.118969 5120 generic.go:358] "Generic (PLEG): container finished" podID="a9bb962d-330a-45a0-9bb0-09b134c425f5" containerID="2569aa75c70aca643652bd7b638e6bdabbab1b8e50c71792e0c8d61b43402474" exitCode=143 Mar 16 17:13:45 crc kubenswrapper[5120]: I0316 17:13:45.119566 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-6b57b99b96-6qzq2" event={"ID":"a9bb962d-330a-45a0-9bb0-09b134c425f5","Type":"ContainerDied","Data":"2569aa75c70aca643652bd7b638e6bdabbab1b8e50c71792e0c8d61b43402474"} Mar 16 17:13:45 crc kubenswrapper[5120]: I0316 17:13:45.146684 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-scheduler-0" podStartSLOduration=4.1466640869999996 podStartE2EDuration="4.146664087s" podCreationTimestamp="2026-03-16 17:13:41 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:13:45.140952961 +0000 UTC m=+6127.294884618" watchObservedRunningTime="2026-03-16 17:13:45.146664087 +0000 UTC m=+6127.300595744" Mar 16 17:13:45 crc kubenswrapper[5120]: E0316 17:13:45.303200 5120 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1ae5285c_173c_4162_9610_3f9c3a4ef47b.slice\": RecentStats: unable to find data in memory cache]" Mar 16 17:13:46 crc kubenswrapper[5120]: I0316 17:13:46.135604 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"e653cf48-8db9-4fe8-9478-a3207ab76c97","Type":"ContainerStarted","Data":"b8326165cdd8aa171a07bf7a235f392a4c768dec9ed42d972cea9cd5c29116f3"} Mar 16 17:13:46 crc kubenswrapper[5120]: I0316 17:13:46.136153 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:13:46 crc kubenswrapper[5120]: I0316 17:13:46.154310 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.887522731 podStartE2EDuration="9.154291354s" podCreationTimestamp="2026-03-16 17:13:37 +0000 UTC" firstStartedPulling="2026-03-16 17:13:38.810906966 +0000 UTC m=+6120.964838623" lastFinishedPulling="2026-03-16 17:13:45.077675589 +0000 UTC m=+6127.231607246" observedRunningTime="2026-03-16 17:13:46.152227288 +0000 UTC m=+6128.306158945" watchObservedRunningTime="2026-03-16 17:13:46.154291354 +0000 UTC m=+6128.308223021" Mar 16 17:13:46 crc kubenswrapper[5120]: I0316 17:13:46.617060 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:13:47 crc kubenswrapper[5120]: I0316 17:13:47.503503 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-6b57b99b96-6qzq2" podUID="a9bb962d-330a-45a0-9bb0-09b134c425f5" containerName="barbican-api-log" probeResult="failure" output="Get \"http://10.217.0.160:9311/healthcheck\": read tcp 10.217.0.2:43434->10.217.0.160:9311: read: connection reset by peer" Mar 16 17:13:47 crc kubenswrapper[5120]: I0316 17:13:47.925746 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-6b57b99b96-6qzq2" Mar 16 17:13:48 crc kubenswrapper[5120]: I0316 17:13:48.027954 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a9bb962d-330a-45a0-9bb0-09b134c425f5-config-data\") pod \"a9bb962d-330a-45a0-9bb0-09b134c425f5\" (UID: \"a9bb962d-330a-45a0-9bb0-09b134c425f5\") " Mar 16 17:13:48 crc kubenswrapper[5120]: I0316 17:13:48.028210 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/a9bb962d-330a-45a0-9bb0-09b134c425f5-config-data-custom\") pod \"a9bb962d-330a-45a0-9bb0-09b134c425f5\" (UID: \"a9bb962d-330a-45a0-9bb0-09b134c425f5\") " Mar 16 17:13:48 crc kubenswrapper[5120]: I0316 17:13:48.028403 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nvscc\" (UniqueName: \"kubernetes.io/projected/a9bb962d-330a-45a0-9bb0-09b134c425f5-kube-api-access-nvscc\") pod \"a9bb962d-330a-45a0-9bb0-09b134c425f5\" (UID: \"a9bb962d-330a-45a0-9bb0-09b134c425f5\") " Mar 16 17:13:48 crc kubenswrapper[5120]: I0316 17:13:48.028594 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a9bb962d-330a-45a0-9bb0-09b134c425f5-combined-ca-bundle\") pod \"a9bb962d-330a-45a0-9bb0-09b134c425f5\" (UID: \"a9bb962d-330a-45a0-9bb0-09b134c425f5\") " Mar 16 17:13:48 crc kubenswrapper[5120]: I0316 17:13:48.028686 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a9bb962d-330a-45a0-9bb0-09b134c425f5-logs\") pod \"a9bb962d-330a-45a0-9bb0-09b134c425f5\" (UID: \"a9bb962d-330a-45a0-9bb0-09b134c425f5\") " Mar 16 17:13:48 crc kubenswrapper[5120]: I0316 17:13:48.029902 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a9bb962d-330a-45a0-9bb0-09b134c425f5-logs" (OuterVolumeSpecName: "logs") pod "a9bb962d-330a-45a0-9bb0-09b134c425f5" (UID: "a9bb962d-330a-45a0-9bb0-09b134c425f5"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:13:48 crc kubenswrapper[5120]: I0316 17:13:48.035698 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a9bb962d-330a-45a0-9bb0-09b134c425f5-kube-api-access-nvscc" (OuterVolumeSpecName: "kube-api-access-nvscc") pod "a9bb962d-330a-45a0-9bb0-09b134c425f5" (UID: "a9bb962d-330a-45a0-9bb0-09b134c425f5"). InnerVolumeSpecName "kube-api-access-nvscc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:13:48 crc kubenswrapper[5120]: I0316 17:13:48.040069 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a9bb962d-330a-45a0-9bb0-09b134c425f5-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "a9bb962d-330a-45a0-9bb0-09b134c425f5" (UID: "a9bb962d-330a-45a0-9bb0-09b134c425f5"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:13:48 crc kubenswrapper[5120]: I0316 17:13:48.071227 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a9bb962d-330a-45a0-9bb0-09b134c425f5-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "a9bb962d-330a-45a0-9bb0-09b134c425f5" (UID: "a9bb962d-330a-45a0-9bb0-09b134c425f5"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:13:48 crc kubenswrapper[5120]: I0316 17:13:48.096292 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a9bb962d-330a-45a0-9bb0-09b134c425f5-config-data" (OuterVolumeSpecName: "config-data") pod "a9bb962d-330a-45a0-9bb0-09b134c425f5" (UID: "a9bb962d-330a-45a0-9bb0-09b134c425f5"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:13:48 crc kubenswrapper[5120]: I0316 17:13:48.131733 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a9bb962d-330a-45a0-9bb0-09b134c425f5-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:13:48 crc kubenswrapper[5120]: I0316 17:13:48.131783 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a9bb962d-330a-45a0-9bb0-09b134c425f5-logs\") on node \"crc\" DevicePath \"\"" Mar 16 17:13:48 crc kubenswrapper[5120]: I0316 17:13:48.131799 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a9bb962d-330a-45a0-9bb0-09b134c425f5-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:13:48 crc kubenswrapper[5120]: I0316 17:13:48.131810 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/a9bb962d-330a-45a0-9bb0-09b134c425f5-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 17:13:48 crc kubenswrapper[5120]: I0316 17:13:48.131823 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nvscc\" (UniqueName: \"kubernetes.io/projected/a9bb962d-330a-45a0-9bb0-09b134c425f5-kube-api-access-nvscc\") on node \"crc\" DevicePath \"\"" Mar 16 17:13:48 crc kubenswrapper[5120]: I0316 17:13:48.154669 5120 generic.go:358] "Generic (PLEG): container finished" podID="a9bb962d-330a-45a0-9bb0-09b134c425f5" containerID="2f6708333611c2d7bdd7b4ca94b08a184cdecc3f31c8b78dac891fa8efb9b0f3" exitCode=0 Mar 16 17:13:48 crc kubenswrapper[5120]: I0316 17:13:48.154745 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-6b57b99b96-6qzq2" Mar 16 17:13:48 crc kubenswrapper[5120]: I0316 17:13:48.154808 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-6b57b99b96-6qzq2" event={"ID":"a9bb962d-330a-45a0-9bb0-09b134c425f5","Type":"ContainerDied","Data":"2f6708333611c2d7bdd7b4ca94b08a184cdecc3f31c8b78dac891fa8efb9b0f3"} Mar 16 17:13:48 crc kubenswrapper[5120]: I0316 17:13:48.154873 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-6b57b99b96-6qzq2" event={"ID":"a9bb962d-330a-45a0-9bb0-09b134c425f5","Type":"ContainerDied","Data":"2b59428e8ae0b29306b81c1c8271c1cbbbc0b50a99601f280f92bfce2d84e8e0"} Mar 16 17:13:48 crc kubenswrapper[5120]: I0316 17:13:48.154895 5120 scope.go:117] "RemoveContainer" containerID="2f6708333611c2d7bdd7b4ca94b08a184cdecc3f31c8b78dac891fa8efb9b0f3" Mar 16 17:13:48 crc kubenswrapper[5120]: I0316 17:13:48.189314 5120 scope.go:117] "RemoveContainer" containerID="2569aa75c70aca643652bd7b638e6bdabbab1b8e50c71792e0c8d61b43402474" Mar 16 17:13:48 crc kubenswrapper[5120]: I0316 17:13:48.189461 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-6b57b99b96-6qzq2"] Mar 16 17:13:48 crc kubenswrapper[5120]: I0316 17:13:48.197744 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-api-6b57b99b96-6qzq2"] Mar 16 17:13:48 crc kubenswrapper[5120]: I0316 17:13:48.209068 5120 scope.go:117] "RemoveContainer" containerID="2f6708333611c2d7bdd7b4ca94b08a184cdecc3f31c8b78dac891fa8efb9b0f3" Mar 16 17:13:48 crc kubenswrapper[5120]: E0316 17:13:48.209572 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2f6708333611c2d7bdd7b4ca94b08a184cdecc3f31c8b78dac891fa8efb9b0f3\": container with ID starting with 2f6708333611c2d7bdd7b4ca94b08a184cdecc3f31c8b78dac891fa8efb9b0f3 not found: ID does not exist" containerID="2f6708333611c2d7bdd7b4ca94b08a184cdecc3f31c8b78dac891fa8efb9b0f3" Mar 16 17:13:48 crc kubenswrapper[5120]: I0316 17:13:48.209622 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f6708333611c2d7bdd7b4ca94b08a184cdecc3f31c8b78dac891fa8efb9b0f3"} err="failed to get container status \"2f6708333611c2d7bdd7b4ca94b08a184cdecc3f31c8b78dac891fa8efb9b0f3\": rpc error: code = NotFound desc = could not find container \"2f6708333611c2d7bdd7b4ca94b08a184cdecc3f31c8b78dac891fa8efb9b0f3\": container with ID starting with 2f6708333611c2d7bdd7b4ca94b08a184cdecc3f31c8b78dac891fa8efb9b0f3 not found: ID does not exist" Mar 16 17:13:48 crc kubenswrapper[5120]: I0316 17:13:48.209642 5120 scope.go:117] "RemoveContainer" containerID="2569aa75c70aca643652bd7b638e6bdabbab1b8e50c71792e0c8d61b43402474" Mar 16 17:13:48 crc kubenswrapper[5120]: E0316 17:13:48.210004 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2569aa75c70aca643652bd7b638e6bdabbab1b8e50c71792e0c8d61b43402474\": container with ID starting with 2569aa75c70aca643652bd7b638e6bdabbab1b8e50c71792e0c8d61b43402474 not found: ID does not exist" containerID="2569aa75c70aca643652bd7b638e6bdabbab1b8e50c71792e0c8d61b43402474" Mar 16 17:13:48 crc kubenswrapper[5120]: I0316 17:13:48.210050 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2569aa75c70aca643652bd7b638e6bdabbab1b8e50c71792e0c8d61b43402474"} err="failed to get container status \"2569aa75c70aca643652bd7b638e6bdabbab1b8e50c71792e0c8d61b43402474\": rpc error: code = NotFound desc = could not find container \"2569aa75c70aca643652bd7b638e6bdabbab1b8e50c71792e0c8d61b43402474\": container with ID starting with 2569aa75c70aca643652bd7b638e6bdabbab1b8e50c71792e0c8d61b43402474 not found: ID does not exist" Mar 16 17:13:48 crc kubenswrapper[5120]: I0316 17:13:48.681004 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a9bb962d-330a-45a0-9bb0-09b134c425f5" path="/var/lib/kubelet/pods/a9bb962d-330a-45a0-9bb0-09b134c425f5/volumes" Mar 16 17:13:51 crc kubenswrapper[5120]: I0316 17:13:51.814229 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:13:52 crc kubenswrapper[5120]: I0316 17:13:52.007965 5120 patch_prober.go:28] interesting pod/machine-config-daemon-7bf76 container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 17:13:52 crc kubenswrapper[5120]: I0316 17:13:52.008036 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 17:13:52 crc kubenswrapper[5120]: I0316 17:13:52.051943 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/placement-659df787f4-kl54p" Mar 16 17:13:52 crc kubenswrapper[5120]: I0316 17:13:52.914437 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-6b57b99b96-6qzq2" podUID="a9bb962d-330a-45a0-9bb0-09b134c425f5" containerName="barbican-api" probeResult="failure" output="Get \"http://10.217.0.160:9311/healthcheck\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 17:13:53 crc kubenswrapper[5120]: I0316 17:13:53.009719 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:13:53 crc kubenswrapper[5120]: I0316 17:13:53.060604 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/placement-659df787f4-kl54p" Mar 16 17:13:53 crc kubenswrapper[5120]: I0316 17:13:53.266568 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-5b79cc5b54-db2hd"] Mar 16 17:13:53 crc kubenswrapper[5120]: I0316 17:13:53.267714 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9bb962d-330a-45a0-9bb0-09b134c425f5" containerName="barbican-api" Mar 16 17:13:53 crc kubenswrapper[5120]: I0316 17:13:53.267734 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9bb962d-330a-45a0-9bb0-09b134c425f5" containerName="barbican-api" Mar 16 17:13:53 crc kubenswrapper[5120]: I0316 17:13:53.267752 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9bb962d-330a-45a0-9bb0-09b134c425f5" containerName="barbican-api-log" Mar 16 17:13:53 crc kubenswrapper[5120]: I0316 17:13:53.269263 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9bb962d-330a-45a0-9bb0-09b134c425f5" containerName="barbican-api-log" Mar 16 17:13:53 crc kubenswrapper[5120]: I0316 17:13:53.269605 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="a9bb962d-330a-45a0-9bb0-09b134c425f5" containerName="barbican-api-log" Mar 16 17:13:53 crc kubenswrapper[5120]: I0316 17:13:53.269646 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="a9bb962d-330a-45a0-9bb0-09b134c425f5" containerName="barbican-api" Mar 16 17:13:53 crc kubenswrapper[5120]: I0316 17:13:53.279116 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-5b79cc5b54-db2hd" Mar 16 17:13:53 crc kubenswrapper[5120]: I0316 17:13:53.280852 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-5b79cc5b54-db2hd"] Mar 16 17:13:53 crc kubenswrapper[5120]: I0316 17:13:53.303153 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/1976af1c-93c9-487c-9852-752bb5c1234d-public-tls-certs\") pod \"placement-5b79cc5b54-db2hd\" (UID: \"1976af1c-93c9-487c-9852-752bb5c1234d\") " pod="openstack-kuttl-tests/placement-5b79cc5b54-db2hd" Mar 16 17:13:53 crc kubenswrapper[5120]: I0316 17:13:53.303279 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/1976af1c-93c9-487c-9852-752bb5c1234d-logs\") pod \"placement-5b79cc5b54-db2hd\" (UID: \"1976af1c-93c9-487c-9852-752bb5c1234d\") " pod="openstack-kuttl-tests/placement-5b79cc5b54-db2hd" Mar 16 17:13:53 crc kubenswrapper[5120]: I0316 17:13:53.303500 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1976af1c-93c9-487c-9852-752bb5c1234d-config-data\") pod \"placement-5b79cc5b54-db2hd\" (UID: \"1976af1c-93c9-487c-9852-752bb5c1234d\") " pod="openstack-kuttl-tests/placement-5b79cc5b54-db2hd" Mar 16 17:13:53 crc kubenswrapper[5120]: I0316 17:13:53.303592 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1976af1c-93c9-487c-9852-752bb5c1234d-combined-ca-bundle\") pod \"placement-5b79cc5b54-db2hd\" (UID: \"1976af1c-93c9-487c-9852-752bb5c1234d\") " pod="openstack-kuttl-tests/placement-5b79cc5b54-db2hd" Mar 16 17:13:53 crc kubenswrapper[5120]: I0316 17:13:53.303661 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1976af1c-93c9-487c-9852-752bb5c1234d-scripts\") pod \"placement-5b79cc5b54-db2hd\" (UID: \"1976af1c-93c9-487c-9852-752bb5c1234d\") " pod="openstack-kuttl-tests/placement-5b79cc5b54-db2hd" Mar 16 17:13:53 crc kubenswrapper[5120]: I0316 17:13:53.303852 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/1976af1c-93c9-487c-9852-752bb5c1234d-internal-tls-certs\") pod \"placement-5b79cc5b54-db2hd\" (UID: \"1976af1c-93c9-487c-9852-752bb5c1234d\") " pod="openstack-kuttl-tests/placement-5b79cc5b54-db2hd" Mar 16 17:13:53 crc kubenswrapper[5120]: I0316 17:13:53.304092 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8v9n\" (UniqueName: \"kubernetes.io/projected/1976af1c-93c9-487c-9852-752bb5c1234d-kube-api-access-f8v9n\") pod \"placement-5b79cc5b54-db2hd\" (UID: \"1976af1c-93c9-487c-9852-752bb5c1234d\") " pod="openstack-kuttl-tests/placement-5b79cc5b54-db2hd" Mar 16 17:13:53 crc kubenswrapper[5120]: I0316 17:13:53.406475 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/1976af1c-93c9-487c-9852-752bb5c1234d-public-tls-certs\") pod \"placement-5b79cc5b54-db2hd\" (UID: \"1976af1c-93c9-487c-9852-752bb5c1234d\") " pod="openstack-kuttl-tests/placement-5b79cc5b54-db2hd" Mar 16 17:13:53 crc kubenswrapper[5120]: I0316 17:13:53.406647 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/1976af1c-93c9-487c-9852-752bb5c1234d-logs\") pod \"placement-5b79cc5b54-db2hd\" (UID: \"1976af1c-93c9-487c-9852-752bb5c1234d\") " pod="openstack-kuttl-tests/placement-5b79cc5b54-db2hd" Mar 16 17:13:53 crc kubenswrapper[5120]: I0316 17:13:53.406818 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1976af1c-93c9-487c-9852-752bb5c1234d-config-data\") pod \"placement-5b79cc5b54-db2hd\" (UID: \"1976af1c-93c9-487c-9852-752bb5c1234d\") " pod="openstack-kuttl-tests/placement-5b79cc5b54-db2hd" Mar 16 17:13:53 crc kubenswrapper[5120]: I0316 17:13:53.406925 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1976af1c-93c9-487c-9852-752bb5c1234d-combined-ca-bundle\") pod \"placement-5b79cc5b54-db2hd\" (UID: \"1976af1c-93c9-487c-9852-752bb5c1234d\") " pod="openstack-kuttl-tests/placement-5b79cc5b54-db2hd" Mar 16 17:13:53 crc kubenswrapper[5120]: I0316 17:13:53.407003 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1976af1c-93c9-487c-9852-752bb5c1234d-scripts\") pod \"placement-5b79cc5b54-db2hd\" (UID: \"1976af1c-93c9-487c-9852-752bb5c1234d\") " pod="openstack-kuttl-tests/placement-5b79cc5b54-db2hd" Mar 16 17:13:53 crc kubenswrapper[5120]: I0316 17:13:53.407081 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/1976af1c-93c9-487c-9852-752bb5c1234d-internal-tls-certs\") pod \"placement-5b79cc5b54-db2hd\" (UID: \"1976af1c-93c9-487c-9852-752bb5c1234d\") " pod="openstack-kuttl-tests/placement-5b79cc5b54-db2hd" Mar 16 17:13:53 crc kubenswrapper[5120]: I0316 17:13:53.407228 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f8v9n\" (UniqueName: \"kubernetes.io/projected/1976af1c-93c9-487c-9852-752bb5c1234d-kube-api-access-f8v9n\") pod \"placement-5b79cc5b54-db2hd\" (UID: \"1976af1c-93c9-487c-9852-752bb5c1234d\") " pod="openstack-kuttl-tests/placement-5b79cc5b54-db2hd" Mar 16 17:13:53 crc kubenswrapper[5120]: I0316 17:13:53.416262 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1976af1c-93c9-487c-9852-752bb5c1234d-combined-ca-bundle\") pod \"placement-5b79cc5b54-db2hd\" (UID: \"1976af1c-93c9-487c-9852-752bb5c1234d\") " pod="openstack-kuttl-tests/placement-5b79cc5b54-db2hd" Mar 16 17:13:53 crc kubenswrapper[5120]: I0316 17:13:53.417877 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1976af1c-93c9-487c-9852-752bb5c1234d-scripts\") pod \"placement-5b79cc5b54-db2hd\" (UID: \"1976af1c-93c9-487c-9852-752bb5c1234d\") " pod="openstack-kuttl-tests/placement-5b79cc5b54-db2hd" Mar 16 17:13:53 crc kubenswrapper[5120]: I0316 17:13:53.418792 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1976af1c-93c9-487c-9852-752bb5c1234d-config-data\") pod \"placement-5b79cc5b54-db2hd\" (UID: \"1976af1c-93c9-487c-9852-752bb5c1234d\") " pod="openstack-kuttl-tests/placement-5b79cc5b54-db2hd" Mar 16 17:13:53 crc kubenswrapper[5120]: I0316 17:13:53.420516 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/1976af1c-93c9-487c-9852-752bb5c1234d-logs\") pod \"placement-5b79cc5b54-db2hd\" (UID: \"1976af1c-93c9-487c-9852-752bb5c1234d\") " pod="openstack-kuttl-tests/placement-5b79cc5b54-db2hd" Mar 16 17:13:53 crc kubenswrapper[5120]: I0316 17:13:53.421320 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/1976af1c-93c9-487c-9852-752bb5c1234d-public-tls-certs\") pod \"placement-5b79cc5b54-db2hd\" (UID: \"1976af1c-93c9-487c-9852-752bb5c1234d\") " pod="openstack-kuttl-tests/placement-5b79cc5b54-db2hd" Mar 16 17:13:53 crc kubenswrapper[5120]: I0316 17:13:53.421642 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/1976af1c-93c9-487c-9852-752bb5c1234d-internal-tls-certs\") pod \"placement-5b79cc5b54-db2hd\" (UID: \"1976af1c-93c9-487c-9852-752bb5c1234d\") " pod="openstack-kuttl-tests/placement-5b79cc5b54-db2hd" Mar 16 17:13:53 crc kubenswrapper[5120]: I0316 17:13:53.425861 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8v9n\" (UniqueName: \"kubernetes.io/projected/1976af1c-93c9-487c-9852-752bb5c1234d-kube-api-access-f8v9n\") pod \"placement-5b79cc5b54-db2hd\" (UID: \"1976af1c-93c9-487c-9852-752bb5c1234d\") " pod="openstack-kuttl-tests/placement-5b79cc5b54-db2hd" Mar 16 17:13:53 crc kubenswrapper[5120]: I0316 17:13:53.602466 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-5b79cc5b54-db2hd" Mar 16 17:13:54 crc kubenswrapper[5120]: I0316 17:13:54.048950 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-5b79cc5b54-db2hd"] Mar 16 17:13:54 crc kubenswrapper[5120]: W0316 17:13:54.053985 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1976af1c_93c9_487c_9852_752bb5c1234d.slice/crio-ad6f86260c58d0c55204ba9d3f79d3e45fd23f6705dd17f068d7c0f6ab2439b8 WatchSource:0}: Error finding container ad6f86260c58d0c55204ba9d3f79d3e45fd23f6705dd17f068d7c0f6ab2439b8: Status 404 returned error can't find the container with id ad6f86260c58d0c55204ba9d3f79d3e45fd23f6705dd17f068d7c0f6ab2439b8 Mar 16 17:13:54 crc kubenswrapper[5120]: I0316 17:13:54.220091 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-5b79cc5b54-db2hd" event={"ID":"1976af1c-93c9-487c-9852-752bb5c1234d","Type":"ContainerStarted","Data":"ad6f86260c58d0c55204ba9d3f79d3e45fd23f6705dd17f068d7c0f6ab2439b8"} Mar 16 17:13:55 crc kubenswrapper[5120]: I0316 17:13:55.238209 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-5b79cc5b54-db2hd" event={"ID":"1976af1c-93c9-487c-9852-752bb5c1234d","Type":"ContainerStarted","Data":"c5fef62b06d8256f82c76b40b8a78f4431b6cbe5fe68d35ce041bf7aec63df7c"} Mar 16 17:13:55 crc kubenswrapper[5120]: I0316 17:13:55.238499 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-5b79cc5b54-db2hd" event={"ID":"1976af1c-93c9-487c-9852-752bb5c1234d","Type":"ContainerStarted","Data":"4e6c0f66786b5e3b4a73599395a4b0251b018a5b233eaa26d6632468ef6db93c"} Mar 16 17:13:55 crc kubenswrapper[5120]: I0316 17:13:55.238570 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-5b79cc5b54-db2hd" Mar 16 17:13:55 crc kubenswrapper[5120]: I0316 17:13:55.238590 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-5b79cc5b54-db2hd" Mar 16 17:13:55 crc kubenswrapper[5120]: I0316 17:13:55.271131 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-5b79cc5b54-db2hd" podStartSLOduration=2.271111994 podStartE2EDuration="2.271111994s" podCreationTimestamp="2026-03-16 17:13:53 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:13:55.261797859 +0000 UTC m=+6137.415729526" watchObservedRunningTime="2026-03-16 17:13:55.271111994 +0000 UTC m=+6137.425043651" Mar 16 17:13:55 crc kubenswrapper[5120]: E0316 17:13:55.557396 5120 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1ae5285c_173c_4162_9610_3f9c3a4ef47b.slice\": RecentStats: unable to find data in memory cache]" Mar 16 17:14:00 crc kubenswrapper[5120]: I0316 17:14:00.139972 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-infra/auto-csr-approver-29561354-wp79g"] Mar 16 17:14:00 crc kubenswrapper[5120]: I0316 17:14:00.151225 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561354-wp79g"] Mar 16 17:14:00 crc kubenswrapper[5120]: I0316 17:14:00.151372 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561354-wp79g" Mar 16 17:14:00 crc kubenswrapper[5120]: I0316 17:14:00.156018 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-infra\"/\"csr-approver-sa-dockercfg-x2nsz\"" Mar 16 17:14:00 crc kubenswrapper[5120]: I0316 17:14:00.157811 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"openshift-service-ca.crt\"" Mar 16 17:14:00 crc kubenswrapper[5120]: I0316 17:14:00.158083 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"kube-root-ca.crt\"" Mar 16 17:14:00 crc kubenswrapper[5120]: I0316 17:14:00.182470 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vlwfj\" (UniqueName: \"kubernetes.io/projected/f398ab9a-6e18-44d4-8a49-22cb9d7e7f3f-kube-api-access-vlwfj\") pod \"auto-csr-approver-29561354-wp79g\" (UID: \"f398ab9a-6e18-44d4-8a49-22cb9d7e7f3f\") " pod="openshift-infra/auto-csr-approver-29561354-wp79g" Mar 16 17:14:00 crc kubenswrapper[5120]: I0316 17:14:00.285397 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vlwfj\" (UniqueName: \"kubernetes.io/projected/f398ab9a-6e18-44d4-8a49-22cb9d7e7f3f-kube-api-access-vlwfj\") pod \"auto-csr-approver-29561354-wp79g\" (UID: \"f398ab9a-6e18-44d4-8a49-22cb9d7e7f3f\") " pod="openshift-infra/auto-csr-approver-29561354-wp79g" Mar 16 17:14:00 crc kubenswrapper[5120]: I0316 17:14:00.305258 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vlwfj\" (UniqueName: \"kubernetes.io/projected/f398ab9a-6e18-44d4-8a49-22cb9d7e7f3f-kube-api-access-vlwfj\") pod \"auto-csr-approver-29561354-wp79g\" (UID: \"f398ab9a-6e18-44d4-8a49-22cb9d7e7f3f\") " pod="openshift-infra/auto-csr-approver-29561354-wp79g" Mar 16 17:14:00 crc kubenswrapper[5120]: I0316 17:14:00.475968 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561354-wp79g" Mar 16 17:14:00 crc kubenswrapper[5120]: I0316 17:14:00.924952 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561354-wp79g"] Mar 16 17:14:01 crc kubenswrapper[5120]: I0316 17:14:01.291856 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561354-wp79g" event={"ID":"f398ab9a-6e18-44d4-8a49-22cb9d7e7f3f","Type":"ContainerStarted","Data":"ccc6a4ca380ee8d7f52766cf2ac7daeafa9703240b7913099570fe6f4dc227b9"} Mar 16 17:14:02 crc kubenswrapper[5120]: I0316 17:14:02.313710 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561354-wp79g" event={"ID":"f398ab9a-6e18-44d4-8a49-22cb9d7e7f3f","Type":"ContainerStarted","Data":"332d8a8119619d4e075777df9bea346c6e4c6f1db10ae7a73e35a01395d94e8d"} Mar 16 17:14:02 crc kubenswrapper[5120]: I0316 17:14:02.334368 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-infra/auto-csr-approver-29561354-wp79g" podStartSLOduration=1.38994771 podStartE2EDuration="2.334349138s" podCreationTimestamp="2026-03-16 17:14:00 +0000 UTC" firstStartedPulling="2026-03-16 17:14:00.925830082 +0000 UTC m=+6143.079761739" lastFinishedPulling="2026-03-16 17:14:01.87023151 +0000 UTC m=+6144.024163167" observedRunningTime="2026-03-16 17:14:02.325755463 +0000 UTC m=+6144.479687120" watchObservedRunningTime="2026-03-16 17:14:02.334349138 +0000 UTC m=+6144.488280785" Mar 16 17:14:03 crc kubenswrapper[5120]: I0316 17:14:03.323481 5120 generic.go:358] "Generic (PLEG): container finished" podID="f398ab9a-6e18-44d4-8a49-22cb9d7e7f3f" containerID="332d8a8119619d4e075777df9bea346c6e4c6f1db10ae7a73e35a01395d94e8d" exitCode=0 Mar 16 17:14:03 crc kubenswrapper[5120]: I0316 17:14:03.323662 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561354-wp79g" event={"ID":"f398ab9a-6e18-44d4-8a49-22cb9d7e7f3f","Type":"ContainerDied","Data":"332d8a8119619d4e075777df9bea346c6e4c6f1db10ae7a73e35a01395d94e8d"} Mar 16 17:14:04 crc kubenswrapper[5120]: I0316 17:14:03.997289 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/keystone-77d7b5cd69-lf8gf" Mar 16 17:14:04 crc kubenswrapper[5120]: I0316 17:14:04.688658 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561354-wp79g" Mar 16 17:14:04 crc kubenswrapper[5120]: I0316 17:14:04.810178 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vlwfj\" (UniqueName: \"kubernetes.io/projected/f398ab9a-6e18-44d4-8a49-22cb9d7e7f3f-kube-api-access-vlwfj\") pod \"f398ab9a-6e18-44d4-8a49-22cb9d7e7f3f\" (UID: \"f398ab9a-6e18-44d4-8a49-22cb9d7e7f3f\") " Mar 16 17:14:04 crc kubenswrapper[5120]: I0316 17:14:04.817405 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f398ab9a-6e18-44d4-8a49-22cb9d7e7f3f-kube-api-access-vlwfj" (OuterVolumeSpecName: "kube-api-access-vlwfj") pod "f398ab9a-6e18-44d4-8a49-22cb9d7e7f3f" (UID: "f398ab9a-6e18-44d4-8a49-22cb9d7e7f3f"). InnerVolumeSpecName "kube-api-access-vlwfj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:14:04 crc kubenswrapper[5120]: I0316 17:14:04.913355 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vlwfj\" (UniqueName: \"kubernetes.io/projected/f398ab9a-6e18-44d4-8a49-22cb9d7e7f3f-kube-api-access-vlwfj\") on node \"crc\" DevicePath \"\"" Mar 16 17:14:05 crc kubenswrapper[5120]: I0316 17:14:05.343994 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561354-wp79g" Mar 16 17:14:05 crc kubenswrapper[5120]: I0316 17:14:05.343996 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561354-wp79g" event={"ID":"f398ab9a-6e18-44d4-8a49-22cb9d7e7f3f","Type":"ContainerDied","Data":"ccc6a4ca380ee8d7f52766cf2ac7daeafa9703240b7913099570fe6f4dc227b9"} Mar 16 17:14:05 crc kubenswrapper[5120]: I0316 17:14:05.344157 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ccc6a4ca380ee8d7f52766cf2ac7daeafa9703240b7913099570fe6f4dc227b9" Mar 16 17:14:05 crc kubenswrapper[5120]: I0316 17:14:05.406175 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-infra/auto-csr-approver-29561348-4k2jn"] Mar 16 17:14:05 crc kubenswrapper[5120]: I0316 17:14:05.413418 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-infra/auto-csr-approver-29561348-4k2jn"] Mar 16 17:14:05 crc kubenswrapper[5120]: E0316 17:14:05.794361 5120 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1ae5285c_173c_4162_9610_3f9c3a4ef47b.slice\": RecentStats: unable to find data in memory cache]" Mar 16 17:14:06 crc kubenswrapper[5120]: I0316 17:14:06.343924 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 17:14:06 crc kubenswrapper[5120]: I0316 17:14:06.344995 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f398ab9a-6e18-44d4-8a49-22cb9d7e7f3f" containerName="oc" Mar 16 17:14:06 crc kubenswrapper[5120]: I0316 17:14:06.345016 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f398ab9a-6e18-44d4-8a49-22cb9d7e7f3f" containerName="oc" Mar 16 17:14:06 crc kubenswrapper[5120]: I0316 17:14:06.345170 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f398ab9a-6e18-44d4-8a49-22cb9d7e7f3f" containerName="oc" Mar 16 17:14:06 crc kubenswrapper[5120]: I0316 17:14:06.353217 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Mar 16 17:14:06 crc kubenswrapper[5120]: I0316 17:14:06.354937 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"openstack-config-secret\"" Mar 16 17:14:06 crc kubenswrapper[5120]: I0316 17:14:06.357009 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"openstackclient-openstackclient-dockercfg-6l4cr\"" Mar 16 17:14:06 crc kubenswrapper[5120]: I0316 17:14:06.364539 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-config\"" Mar 16 17:14:06 crc kubenswrapper[5120]: I0316 17:14:06.364548 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 17:14:06 crc kubenswrapper[5120]: I0316 17:14:06.454128 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/13336088-ad41-4ff2-afab-b0f1f8bb0e75-openstack-config-secret\") pod \"openstackclient\" (UID: \"13336088-ad41-4ff2-afab-b0f1f8bb0e75\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 17:14:06 crc kubenswrapper[5120]: I0316 17:14:06.454627 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/13336088-ad41-4ff2-afab-b0f1f8bb0e75-combined-ca-bundle\") pod \"openstackclient\" (UID: \"13336088-ad41-4ff2-afab-b0f1f8bb0e75\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 17:14:06 crc kubenswrapper[5120]: I0316 17:14:06.455021 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/13336088-ad41-4ff2-afab-b0f1f8bb0e75-openstack-config\") pod \"openstackclient\" (UID: \"13336088-ad41-4ff2-afab-b0f1f8bb0e75\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 17:14:06 crc kubenswrapper[5120]: I0316 17:14:06.455136 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfk9q\" (UniqueName: \"kubernetes.io/projected/13336088-ad41-4ff2-afab-b0f1f8bb0e75-kube-api-access-nfk9q\") pod \"openstackclient\" (UID: \"13336088-ad41-4ff2-afab-b0f1f8bb0e75\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 17:14:06 crc kubenswrapper[5120]: I0316 17:14:06.557078 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/13336088-ad41-4ff2-afab-b0f1f8bb0e75-combined-ca-bundle\") pod \"openstackclient\" (UID: \"13336088-ad41-4ff2-afab-b0f1f8bb0e75\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 17:14:06 crc kubenswrapper[5120]: I0316 17:14:06.557330 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/13336088-ad41-4ff2-afab-b0f1f8bb0e75-openstack-config\") pod \"openstackclient\" (UID: \"13336088-ad41-4ff2-afab-b0f1f8bb0e75\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 17:14:06 crc kubenswrapper[5120]: I0316 17:14:06.557401 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nfk9q\" (UniqueName: \"kubernetes.io/projected/13336088-ad41-4ff2-afab-b0f1f8bb0e75-kube-api-access-nfk9q\") pod \"openstackclient\" (UID: \"13336088-ad41-4ff2-afab-b0f1f8bb0e75\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 17:14:06 crc kubenswrapper[5120]: I0316 17:14:06.557465 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/13336088-ad41-4ff2-afab-b0f1f8bb0e75-openstack-config-secret\") pod \"openstackclient\" (UID: \"13336088-ad41-4ff2-afab-b0f1f8bb0e75\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 17:14:06 crc kubenswrapper[5120]: I0316 17:14:06.558947 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/13336088-ad41-4ff2-afab-b0f1f8bb0e75-openstack-config\") pod \"openstackclient\" (UID: \"13336088-ad41-4ff2-afab-b0f1f8bb0e75\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 17:14:06 crc kubenswrapper[5120]: I0316 17:14:06.565158 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/13336088-ad41-4ff2-afab-b0f1f8bb0e75-openstack-config-secret\") pod \"openstackclient\" (UID: \"13336088-ad41-4ff2-afab-b0f1f8bb0e75\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 17:14:06 crc kubenswrapper[5120]: I0316 17:14:06.566375 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/13336088-ad41-4ff2-afab-b0f1f8bb0e75-combined-ca-bundle\") pod \"openstackclient\" (UID: \"13336088-ad41-4ff2-afab-b0f1f8bb0e75\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 17:14:06 crc kubenswrapper[5120]: I0316 17:14:06.591754 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfk9q\" (UniqueName: \"kubernetes.io/projected/13336088-ad41-4ff2-afab-b0f1f8bb0e75-kube-api-access-nfk9q\") pod \"openstackclient\" (UID: \"13336088-ad41-4ff2-afab-b0f1f8bb0e75\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 17:14:06 crc kubenswrapper[5120]: I0316 17:14:06.673520 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="70f669ba-f1f0-4d96-b7c5-1bc940ae0040" path="/var/lib/kubelet/pods/70f669ba-f1f0-4d96-b7c5-1bc940ae0040/volumes" Mar 16 17:14:06 crc kubenswrapper[5120]: I0316 17:14:06.676688 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Mar 16 17:14:07 crc kubenswrapper[5120]: I0316 17:14:07.215969 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 17:14:07 crc kubenswrapper[5120]: I0316 17:14:07.370676 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstackclient" event={"ID":"13336088-ad41-4ff2-afab-b0f1f8bb0e75","Type":"ContainerStarted","Data":"3fdf11f4fca88523a7a1455023fd317f0c57d3412dab1a2b82397382b2b67841"} Mar 16 17:14:08 crc kubenswrapper[5120]: E0316 17:14:08.289748 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1757651 actualBytes=10240 Mar 16 17:14:08 crc kubenswrapper[5120]: I0316 17:14:08.381888 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstackclient" event={"ID":"13336088-ad41-4ff2-afab-b0f1f8bb0e75","Type":"ContainerStarted","Data":"d48240109d0a3c34c694d1bce1876d5c9a3e15e50367c9d12627dc968eddbf49"} Mar 16 17:14:08 crc kubenswrapper[5120]: I0316 17:14:08.400857 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstackclient" podStartSLOduration=2.400832043 podStartE2EDuration="2.400832043s" podCreationTimestamp="2026-03-16 17:14:06 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:14:08.397655656 +0000 UTC m=+6150.551587313" watchObservedRunningTime="2026-03-16 17:14:08.400832043 +0000 UTC m=+6150.554763720" Mar 16 17:14:08 crc kubenswrapper[5120]: I0316 17:14:08.828446 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/neutron-7d8bb7fd99-qr5kw" Mar 16 17:14:11 crc kubenswrapper[5120]: I0316 17:14:11.413903 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/swift-proxy-5749bb5d-544mw"] Mar 16 17:14:11 crc kubenswrapper[5120]: I0316 17:14:11.422019 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-5749bb5d-544mw" Mar 16 17:14:11 crc kubenswrapper[5120]: I0316 17:14:11.424510 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"swift-proxy-config-data\"" Mar 16 17:14:11 crc kubenswrapper[5120]: I0316 17:14:11.424522 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-swift-internal-svc\"" Mar 16 17:14:11 crc kubenswrapper[5120]: I0316 17:14:11.436235 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-swift-public-svc\"" Mar 16 17:14:11 crc kubenswrapper[5120]: I0316 17:14:11.440470 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-proxy-5749bb5d-544mw"] Mar 16 17:14:11 crc kubenswrapper[5120]: I0316 17:14:11.454745 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/682f1065-f1df-4d72-9a81-3ddb581743ca-combined-ca-bundle\") pod \"swift-proxy-5749bb5d-544mw\" (UID: \"682f1065-f1df-4d72-9a81-3ddb581743ca\") " pod="openstack-kuttl-tests/swift-proxy-5749bb5d-544mw" Mar 16 17:14:11 crc kubenswrapper[5120]: I0316 17:14:11.454814 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wtqv\" (UniqueName: \"kubernetes.io/projected/682f1065-f1df-4d72-9a81-3ddb581743ca-kube-api-access-2wtqv\") pod \"swift-proxy-5749bb5d-544mw\" (UID: \"682f1065-f1df-4d72-9a81-3ddb581743ca\") " pod="openstack-kuttl-tests/swift-proxy-5749bb5d-544mw" Mar 16 17:14:11 crc kubenswrapper[5120]: I0316 17:14:11.454953 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/682f1065-f1df-4d72-9a81-3ddb581743ca-etc-swift\") pod \"swift-proxy-5749bb5d-544mw\" (UID: \"682f1065-f1df-4d72-9a81-3ddb581743ca\") " pod="openstack-kuttl-tests/swift-proxy-5749bb5d-544mw" Mar 16 17:14:11 crc kubenswrapper[5120]: I0316 17:14:11.455187 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/682f1065-f1df-4d72-9a81-3ddb581743ca-log-httpd\") pod \"swift-proxy-5749bb5d-544mw\" (UID: \"682f1065-f1df-4d72-9a81-3ddb581743ca\") " pod="openstack-kuttl-tests/swift-proxy-5749bb5d-544mw" Mar 16 17:14:11 crc kubenswrapper[5120]: I0316 17:14:11.455265 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/682f1065-f1df-4d72-9a81-3ddb581743ca-internal-tls-certs\") pod \"swift-proxy-5749bb5d-544mw\" (UID: \"682f1065-f1df-4d72-9a81-3ddb581743ca\") " pod="openstack-kuttl-tests/swift-proxy-5749bb5d-544mw" Mar 16 17:14:11 crc kubenswrapper[5120]: I0316 17:14:11.455403 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/682f1065-f1df-4d72-9a81-3ddb581743ca-public-tls-certs\") pod \"swift-proxy-5749bb5d-544mw\" (UID: \"682f1065-f1df-4d72-9a81-3ddb581743ca\") " pod="openstack-kuttl-tests/swift-proxy-5749bb5d-544mw" Mar 16 17:14:11 crc kubenswrapper[5120]: I0316 17:14:11.455459 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/682f1065-f1df-4d72-9a81-3ddb581743ca-run-httpd\") pod \"swift-proxy-5749bb5d-544mw\" (UID: \"682f1065-f1df-4d72-9a81-3ddb581743ca\") " pod="openstack-kuttl-tests/swift-proxy-5749bb5d-544mw" Mar 16 17:14:11 crc kubenswrapper[5120]: I0316 17:14:11.455668 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/682f1065-f1df-4d72-9a81-3ddb581743ca-config-data\") pod \"swift-proxy-5749bb5d-544mw\" (UID: \"682f1065-f1df-4d72-9a81-3ddb581743ca\") " pod="openstack-kuttl-tests/swift-proxy-5749bb5d-544mw" Mar 16 17:14:11 crc kubenswrapper[5120]: I0316 17:14:11.558118 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/682f1065-f1df-4d72-9a81-3ddb581743ca-log-httpd\") pod \"swift-proxy-5749bb5d-544mw\" (UID: \"682f1065-f1df-4d72-9a81-3ddb581743ca\") " pod="openstack-kuttl-tests/swift-proxy-5749bb5d-544mw" Mar 16 17:14:11 crc kubenswrapper[5120]: I0316 17:14:11.558229 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/682f1065-f1df-4d72-9a81-3ddb581743ca-internal-tls-certs\") pod \"swift-proxy-5749bb5d-544mw\" (UID: \"682f1065-f1df-4d72-9a81-3ddb581743ca\") " pod="openstack-kuttl-tests/swift-proxy-5749bb5d-544mw" Mar 16 17:14:11 crc kubenswrapper[5120]: I0316 17:14:11.558319 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/682f1065-f1df-4d72-9a81-3ddb581743ca-public-tls-certs\") pod \"swift-proxy-5749bb5d-544mw\" (UID: \"682f1065-f1df-4d72-9a81-3ddb581743ca\") " pod="openstack-kuttl-tests/swift-proxy-5749bb5d-544mw" Mar 16 17:14:11 crc kubenswrapper[5120]: I0316 17:14:11.558354 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/682f1065-f1df-4d72-9a81-3ddb581743ca-run-httpd\") pod \"swift-proxy-5749bb5d-544mw\" (UID: \"682f1065-f1df-4d72-9a81-3ddb581743ca\") " pod="openstack-kuttl-tests/swift-proxy-5749bb5d-544mw" Mar 16 17:14:11 crc kubenswrapper[5120]: I0316 17:14:11.558473 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/682f1065-f1df-4d72-9a81-3ddb581743ca-config-data\") pod \"swift-proxy-5749bb5d-544mw\" (UID: \"682f1065-f1df-4d72-9a81-3ddb581743ca\") " pod="openstack-kuttl-tests/swift-proxy-5749bb5d-544mw" Mar 16 17:14:11 crc kubenswrapper[5120]: I0316 17:14:11.558519 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/682f1065-f1df-4d72-9a81-3ddb581743ca-combined-ca-bundle\") pod \"swift-proxy-5749bb5d-544mw\" (UID: \"682f1065-f1df-4d72-9a81-3ddb581743ca\") " pod="openstack-kuttl-tests/swift-proxy-5749bb5d-544mw" Mar 16 17:14:11 crc kubenswrapper[5120]: I0316 17:14:11.558538 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2wtqv\" (UniqueName: \"kubernetes.io/projected/682f1065-f1df-4d72-9a81-3ddb581743ca-kube-api-access-2wtqv\") pod \"swift-proxy-5749bb5d-544mw\" (UID: \"682f1065-f1df-4d72-9a81-3ddb581743ca\") " pod="openstack-kuttl-tests/swift-proxy-5749bb5d-544mw" Mar 16 17:14:11 crc kubenswrapper[5120]: I0316 17:14:11.558606 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/682f1065-f1df-4d72-9a81-3ddb581743ca-etc-swift\") pod \"swift-proxy-5749bb5d-544mw\" (UID: \"682f1065-f1df-4d72-9a81-3ddb581743ca\") " pod="openstack-kuttl-tests/swift-proxy-5749bb5d-544mw" Mar 16 17:14:11 crc kubenswrapper[5120]: I0316 17:14:11.559737 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/682f1065-f1df-4d72-9a81-3ddb581743ca-log-httpd\") pod \"swift-proxy-5749bb5d-544mw\" (UID: \"682f1065-f1df-4d72-9a81-3ddb581743ca\") " pod="openstack-kuttl-tests/swift-proxy-5749bb5d-544mw" Mar 16 17:14:11 crc kubenswrapper[5120]: I0316 17:14:11.559935 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/682f1065-f1df-4d72-9a81-3ddb581743ca-run-httpd\") pod \"swift-proxy-5749bb5d-544mw\" (UID: \"682f1065-f1df-4d72-9a81-3ddb581743ca\") " pod="openstack-kuttl-tests/swift-proxy-5749bb5d-544mw" Mar 16 17:14:11 crc kubenswrapper[5120]: I0316 17:14:11.565568 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/682f1065-f1df-4d72-9a81-3ddb581743ca-combined-ca-bundle\") pod \"swift-proxy-5749bb5d-544mw\" (UID: \"682f1065-f1df-4d72-9a81-3ddb581743ca\") " pod="openstack-kuttl-tests/swift-proxy-5749bb5d-544mw" Mar 16 17:14:11 crc kubenswrapper[5120]: I0316 17:14:11.565584 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/682f1065-f1df-4d72-9a81-3ddb581743ca-public-tls-certs\") pod \"swift-proxy-5749bb5d-544mw\" (UID: \"682f1065-f1df-4d72-9a81-3ddb581743ca\") " pod="openstack-kuttl-tests/swift-proxy-5749bb5d-544mw" Mar 16 17:14:11 crc kubenswrapper[5120]: I0316 17:14:11.566251 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/682f1065-f1df-4d72-9a81-3ddb581743ca-internal-tls-certs\") pod \"swift-proxy-5749bb5d-544mw\" (UID: \"682f1065-f1df-4d72-9a81-3ddb581743ca\") " pod="openstack-kuttl-tests/swift-proxy-5749bb5d-544mw" Mar 16 17:14:11 crc kubenswrapper[5120]: I0316 17:14:11.574626 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/682f1065-f1df-4d72-9a81-3ddb581743ca-config-data\") pod \"swift-proxy-5749bb5d-544mw\" (UID: \"682f1065-f1df-4d72-9a81-3ddb581743ca\") " pod="openstack-kuttl-tests/swift-proxy-5749bb5d-544mw" Mar 16 17:14:11 crc kubenswrapper[5120]: I0316 17:14:11.575146 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/682f1065-f1df-4d72-9a81-3ddb581743ca-etc-swift\") pod \"swift-proxy-5749bb5d-544mw\" (UID: \"682f1065-f1df-4d72-9a81-3ddb581743ca\") " pod="openstack-kuttl-tests/swift-proxy-5749bb5d-544mw" Mar 16 17:14:11 crc kubenswrapper[5120]: I0316 17:14:11.578034 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wtqv\" (UniqueName: \"kubernetes.io/projected/682f1065-f1df-4d72-9a81-3ddb581743ca-kube-api-access-2wtqv\") pod \"swift-proxy-5749bb5d-544mw\" (UID: \"682f1065-f1df-4d72-9a81-3ddb581743ca\") " pod="openstack-kuttl-tests/swift-proxy-5749bb5d-544mw" Mar 16 17:14:11 crc kubenswrapper[5120]: I0316 17:14:11.747960 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-5749bb5d-544mw" Mar 16 17:14:12 crc kubenswrapper[5120]: I0316 17:14:12.186486 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-proxy-5749bb5d-544mw"] Mar 16 17:14:12 crc kubenswrapper[5120]: I0316 17:14:12.296211 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:14:12 crc kubenswrapper[5120]: I0316 17:14:12.296787 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="e653cf48-8db9-4fe8-9478-a3207ab76c97" containerName="ceilometer-central-agent" containerID="cri-o://8989093cd2b31486c0447902c228c679bdf019f2265ec9159f2c17f23921c256" gracePeriod=30 Mar 16 17:14:12 crc kubenswrapper[5120]: I0316 17:14:12.297217 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="e653cf48-8db9-4fe8-9478-a3207ab76c97" containerName="sg-core" containerID="cri-o://ad6f4cf61cb3feac4417796aa1dded828003e1cc426a18dfdeaada2e2db23204" gracePeriod=30 Mar 16 17:14:12 crc kubenswrapper[5120]: I0316 17:14:12.297211 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="e653cf48-8db9-4fe8-9478-a3207ab76c97" containerName="proxy-httpd" containerID="cri-o://b8326165cdd8aa171a07bf7a235f392a4c768dec9ed42d972cea9cd5c29116f3" gracePeriod=30 Mar 16 17:14:12 crc kubenswrapper[5120]: I0316 17:14:12.297347 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="e653cf48-8db9-4fe8-9478-a3207ab76c97" containerName="ceilometer-notification-agent" containerID="cri-o://6ed9051ec8823bfbf22ce1272643a6e138dece8ee338be178cec39b284aafecb" gracePeriod=30 Mar 16 17:14:12 crc kubenswrapper[5120]: I0316 17:14:12.402933 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/ceilometer-0" podUID="e653cf48-8db9-4fe8-9478-a3207ab76c97" containerName="proxy-httpd" probeResult="failure" output="Get \"http://10.217.0.171:3000/\": read tcp 10.217.0.2:48730->10.217.0.171:3000: read: connection reset by peer" Mar 16 17:14:12 crc kubenswrapper[5120]: I0316 17:14:12.429506 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-5749bb5d-544mw" event={"ID":"682f1065-f1df-4d72-9a81-3ddb581743ca","Type":"ContainerStarted","Data":"d257e455f44815bc70b70b250adae15178e2f5403a73948086124a31aef5864c"} Mar 16 17:14:12 crc kubenswrapper[5120]: I0316 17:14:12.432574 5120 generic.go:358] "Generic (PLEG): container finished" podID="e653cf48-8db9-4fe8-9478-a3207ab76c97" containerID="ad6f4cf61cb3feac4417796aa1dded828003e1cc426a18dfdeaada2e2db23204" exitCode=2 Mar 16 17:14:12 crc kubenswrapper[5120]: I0316 17:14:12.432779 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"e653cf48-8db9-4fe8-9478-a3207ab76c97","Type":"ContainerDied","Data":"ad6f4cf61cb3feac4417796aa1dded828003e1cc426a18dfdeaada2e2db23204"} Mar 16 17:14:13 crc kubenswrapper[5120]: I0316 17:14:13.447849 5120 generic.go:358] "Generic (PLEG): container finished" podID="e653cf48-8db9-4fe8-9478-a3207ab76c97" containerID="b8326165cdd8aa171a07bf7a235f392a4c768dec9ed42d972cea9cd5c29116f3" exitCode=0 Mar 16 17:14:13 crc kubenswrapper[5120]: I0316 17:14:13.448183 5120 generic.go:358] "Generic (PLEG): container finished" podID="e653cf48-8db9-4fe8-9478-a3207ab76c97" containerID="6ed9051ec8823bfbf22ce1272643a6e138dece8ee338be178cec39b284aafecb" exitCode=0 Mar 16 17:14:13 crc kubenswrapper[5120]: I0316 17:14:13.448193 5120 generic.go:358] "Generic (PLEG): container finished" podID="e653cf48-8db9-4fe8-9478-a3207ab76c97" containerID="8989093cd2b31486c0447902c228c679bdf019f2265ec9159f2c17f23921c256" exitCode=0 Mar 16 17:14:13 crc kubenswrapper[5120]: I0316 17:14:13.447937 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"e653cf48-8db9-4fe8-9478-a3207ab76c97","Type":"ContainerDied","Data":"b8326165cdd8aa171a07bf7a235f392a4c768dec9ed42d972cea9cd5c29116f3"} Mar 16 17:14:13 crc kubenswrapper[5120]: I0316 17:14:13.448690 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"e653cf48-8db9-4fe8-9478-a3207ab76c97","Type":"ContainerDied","Data":"6ed9051ec8823bfbf22ce1272643a6e138dece8ee338be178cec39b284aafecb"} Mar 16 17:14:13 crc kubenswrapper[5120]: I0316 17:14:13.448710 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"e653cf48-8db9-4fe8-9478-a3207ab76c97","Type":"ContainerDied","Data":"8989093cd2b31486c0447902c228c679bdf019f2265ec9159f2c17f23921c256"} Mar 16 17:14:13 crc kubenswrapper[5120]: I0316 17:14:13.448722 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"e653cf48-8db9-4fe8-9478-a3207ab76c97","Type":"ContainerDied","Data":"0eb1303dee5321d6d3edf3955900d7ff811271b8ae5e4c01ebd704b2444f9e6d"} Mar 16 17:14:13 crc kubenswrapper[5120]: I0316 17:14:13.448733 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0eb1303dee5321d6d3edf3955900d7ff811271b8ae5e4c01ebd704b2444f9e6d" Mar 16 17:14:13 crc kubenswrapper[5120]: I0316 17:14:13.452694 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-5749bb5d-544mw" event={"ID":"682f1065-f1df-4d72-9a81-3ddb581743ca","Type":"ContainerStarted","Data":"fdf02cc413ba820b43576d699f107caa1ca5ce3be93360df557fd570bbf0baa7"} Mar 16 17:14:13 crc kubenswrapper[5120]: I0316 17:14:13.452904 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-5749bb5d-544mw" event={"ID":"682f1065-f1df-4d72-9a81-3ddb581743ca","Type":"ContainerStarted","Data":"bf112b12ea9fcf672dfef9c231fc9ff0ad24272de8f0ee8e3b3d3f8056137682"} Mar 16 17:14:13 crc kubenswrapper[5120]: I0316 17:14:13.453085 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/swift-proxy-5749bb5d-544mw" Mar 16 17:14:13 crc kubenswrapper[5120]: I0316 17:14:13.453354 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/swift-proxy-5749bb5d-544mw" Mar 16 17:14:13 crc kubenswrapper[5120]: I0316 17:14:13.488534 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:14:13 crc kubenswrapper[5120]: I0316 17:14:13.510944 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/swift-proxy-5749bb5d-544mw" podStartSLOduration=2.510926251 podStartE2EDuration="2.510926251s" podCreationTimestamp="2026-03-16 17:14:11 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:14:13.501153213 +0000 UTC m=+6155.655084880" watchObservedRunningTime="2026-03-16 17:14:13.510926251 +0000 UTC m=+6155.664857908" Mar 16 17:14:13 crc kubenswrapper[5120]: I0316 17:14:13.632991 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e653cf48-8db9-4fe8-9478-a3207ab76c97-log-httpd\") pod \"e653cf48-8db9-4fe8-9478-a3207ab76c97\" (UID: \"e653cf48-8db9-4fe8-9478-a3207ab76c97\") " Mar 16 17:14:13 crc kubenswrapper[5120]: I0316 17:14:13.633071 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e653cf48-8db9-4fe8-9478-a3207ab76c97-run-httpd\") pod \"e653cf48-8db9-4fe8-9478-a3207ab76c97\" (UID: \"e653cf48-8db9-4fe8-9478-a3207ab76c97\") " Mar 16 17:14:13 crc kubenswrapper[5120]: I0316 17:14:13.633346 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e653cf48-8db9-4fe8-9478-a3207ab76c97-combined-ca-bundle\") pod \"e653cf48-8db9-4fe8-9478-a3207ab76c97\" (UID: \"e653cf48-8db9-4fe8-9478-a3207ab76c97\") " Mar 16 17:14:13 crc kubenswrapper[5120]: I0316 17:14:13.633422 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e653cf48-8db9-4fe8-9478-a3207ab76c97-config-data\") pod \"e653cf48-8db9-4fe8-9478-a3207ab76c97\" (UID: \"e653cf48-8db9-4fe8-9478-a3207ab76c97\") " Mar 16 17:14:13 crc kubenswrapper[5120]: I0316 17:14:13.633451 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/e653cf48-8db9-4fe8-9478-a3207ab76c97-sg-core-conf-yaml\") pod \"e653cf48-8db9-4fe8-9478-a3207ab76c97\" (UID: \"e653cf48-8db9-4fe8-9478-a3207ab76c97\") " Mar 16 17:14:13 crc kubenswrapper[5120]: I0316 17:14:13.633500 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e653cf48-8db9-4fe8-9478-a3207ab76c97-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "e653cf48-8db9-4fe8-9478-a3207ab76c97" (UID: "e653cf48-8db9-4fe8-9478-a3207ab76c97"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:14:13 crc kubenswrapper[5120]: I0316 17:14:13.633534 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e653cf48-8db9-4fe8-9478-a3207ab76c97-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "e653cf48-8db9-4fe8-9478-a3207ab76c97" (UID: "e653cf48-8db9-4fe8-9478-a3207ab76c97"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:14:13 crc kubenswrapper[5120]: I0316 17:14:13.634080 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tk8qv\" (UniqueName: \"kubernetes.io/projected/e653cf48-8db9-4fe8-9478-a3207ab76c97-kube-api-access-tk8qv\") pod \"e653cf48-8db9-4fe8-9478-a3207ab76c97\" (UID: \"e653cf48-8db9-4fe8-9478-a3207ab76c97\") " Mar 16 17:14:13 crc kubenswrapper[5120]: I0316 17:14:13.634733 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e653cf48-8db9-4fe8-9478-a3207ab76c97-scripts\") pod \"e653cf48-8db9-4fe8-9478-a3207ab76c97\" (UID: \"e653cf48-8db9-4fe8-9478-a3207ab76c97\") " Mar 16 17:14:13 crc kubenswrapper[5120]: I0316 17:14:13.636018 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e653cf48-8db9-4fe8-9478-a3207ab76c97-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 17:14:13 crc kubenswrapper[5120]: I0316 17:14:13.636039 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e653cf48-8db9-4fe8-9478-a3207ab76c97-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 17:14:13 crc kubenswrapper[5120]: I0316 17:14:13.639048 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e653cf48-8db9-4fe8-9478-a3207ab76c97-scripts" (OuterVolumeSpecName: "scripts") pod "e653cf48-8db9-4fe8-9478-a3207ab76c97" (UID: "e653cf48-8db9-4fe8-9478-a3207ab76c97"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:14:13 crc kubenswrapper[5120]: I0316 17:14:13.639063 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e653cf48-8db9-4fe8-9478-a3207ab76c97-kube-api-access-tk8qv" (OuterVolumeSpecName: "kube-api-access-tk8qv") pod "e653cf48-8db9-4fe8-9478-a3207ab76c97" (UID: "e653cf48-8db9-4fe8-9478-a3207ab76c97"). InnerVolumeSpecName "kube-api-access-tk8qv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:14:13 crc kubenswrapper[5120]: I0316 17:14:13.666578 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e653cf48-8db9-4fe8-9478-a3207ab76c97-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "e653cf48-8db9-4fe8-9478-a3207ab76c97" (UID: "e653cf48-8db9-4fe8-9478-a3207ab76c97"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:14:13 crc kubenswrapper[5120]: I0316 17:14:13.715571 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e653cf48-8db9-4fe8-9478-a3207ab76c97-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e653cf48-8db9-4fe8-9478-a3207ab76c97" (UID: "e653cf48-8db9-4fe8-9478-a3207ab76c97"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:14:13 crc kubenswrapper[5120]: I0316 17:14:13.737984 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e653cf48-8db9-4fe8-9478-a3207ab76c97-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:14:13 crc kubenswrapper[5120]: I0316 17:14:13.738012 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/e653cf48-8db9-4fe8-9478-a3207ab76c97-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 17:14:13 crc kubenswrapper[5120]: I0316 17:14:13.738022 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tk8qv\" (UniqueName: \"kubernetes.io/projected/e653cf48-8db9-4fe8-9478-a3207ab76c97-kube-api-access-tk8qv\") on node \"crc\" DevicePath \"\"" Mar 16 17:14:13 crc kubenswrapper[5120]: I0316 17:14:13.738032 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e653cf48-8db9-4fe8-9478-a3207ab76c97-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:14:13 crc kubenswrapper[5120]: I0316 17:14:13.789520 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e653cf48-8db9-4fe8-9478-a3207ab76c97-config-data" (OuterVolumeSpecName: "config-data") pod "e653cf48-8db9-4fe8-9478-a3207ab76c97" (UID: "e653cf48-8db9-4fe8-9478-a3207ab76c97"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:14:13 crc kubenswrapper[5120]: I0316 17:14:13.842153 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e653cf48-8db9-4fe8-9478-a3207ab76c97-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:14:14 crc kubenswrapper[5120]: I0316 17:14:14.115909 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/neutron-54b8764f4-w5thh" Mar 16 17:14:14 crc kubenswrapper[5120]: I0316 17:14:14.179413 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-7d8bb7fd99-qr5kw"] Mar 16 17:14:14 crc kubenswrapper[5120]: I0316 17:14:14.179899 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-7d8bb7fd99-qr5kw" podUID="afbb203b-f5f2-4850-83de-e37987e383c9" containerName="neutron-api" containerID="cri-o://e05a433f16dc8224732a75f21bd8552a793c5d7cf2cf319ee8c5d76a5a380f34" gracePeriod=30 Mar 16 17:14:14 crc kubenswrapper[5120]: I0316 17:14:14.180427 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-7d8bb7fd99-qr5kw" podUID="afbb203b-f5f2-4850-83de-e37987e383c9" containerName="neutron-httpd" containerID="cri-o://96165a2d847ec7587a1c221b258473f64e660e2d48830e90eded046360c68adf" gracePeriod=30 Mar 16 17:14:14 crc kubenswrapper[5120]: I0316 17:14:14.464793 5120 generic.go:358] "Generic (PLEG): container finished" podID="afbb203b-f5f2-4850-83de-e37987e383c9" containerID="96165a2d847ec7587a1c221b258473f64e660e2d48830e90eded046360c68adf" exitCode=0 Mar 16 17:14:14 crc kubenswrapper[5120]: I0316 17:14:14.464880 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-7d8bb7fd99-qr5kw" event={"ID":"afbb203b-f5f2-4850-83de-e37987e383c9","Type":"ContainerDied","Data":"96165a2d847ec7587a1c221b258473f64e660e2d48830e90eded046360c68adf"} Mar 16 17:14:14 crc kubenswrapper[5120]: I0316 17:14:14.465548 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:14:14 crc kubenswrapper[5120]: I0316 17:14:14.507623 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:14:14 crc kubenswrapper[5120]: I0316 17:14:14.520841 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:14:14 crc kubenswrapper[5120]: I0316 17:14:14.532809 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:14:14 crc kubenswrapper[5120]: I0316 17:14:14.533858 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e653cf48-8db9-4fe8-9478-a3207ab76c97" containerName="ceilometer-central-agent" Mar 16 17:14:14 crc kubenswrapper[5120]: I0316 17:14:14.533878 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e653cf48-8db9-4fe8-9478-a3207ab76c97" containerName="ceilometer-central-agent" Mar 16 17:14:14 crc kubenswrapper[5120]: I0316 17:14:14.533915 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e653cf48-8db9-4fe8-9478-a3207ab76c97" containerName="proxy-httpd" Mar 16 17:14:14 crc kubenswrapper[5120]: I0316 17:14:14.533920 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e653cf48-8db9-4fe8-9478-a3207ab76c97" containerName="proxy-httpd" Mar 16 17:14:14 crc kubenswrapper[5120]: I0316 17:14:14.533952 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e653cf48-8db9-4fe8-9478-a3207ab76c97" containerName="ceilometer-notification-agent" Mar 16 17:14:14 crc kubenswrapper[5120]: I0316 17:14:14.533960 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e653cf48-8db9-4fe8-9478-a3207ab76c97" containerName="ceilometer-notification-agent" Mar 16 17:14:14 crc kubenswrapper[5120]: I0316 17:14:14.533971 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e653cf48-8db9-4fe8-9478-a3207ab76c97" containerName="sg-core" Mar 16 17:14:14 crc kubenswrapper[5120]: I0316 17:14:14.533977 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e653cf48-8db9-4fe8-9478-a3207ab76c97" containerName="sg-core" Mar 16 17:14:14 crc kubenswrapper[5120]: I0316 17:14:14.537247 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e653cf48-8db9-4fe8-9478-a3207ab76c97" containerName="ceilometer-notification-agent" Mar 16 17:14:14 crc kubenswrapper[5120]: I0316 17:14:14.537310 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e653cf48-8db9-4fe8-9478-a3207ab76c97" containerName="ceilometer-central-agent" Mar 16 17:14:14 crc kubenswrapper[5120]: I0316 17:14:14.537322 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e653cf48-8db9-4fe8-9478-a3207ab76c97" containerName="proxy-httpd" Mar 16 17:14:14 crc kubenswrapper[5120]: I0316 17:14:14.537331 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e653cf48-8db9-4fe8-9478-a3207ab76c97" containerName="sg-core" Mar 16 17:14:14 crc kubenswrapper[5120]: I0316 17:14:14.543328 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:14:14 crc kubenswrapper[5120]: I0316 17:14:14.546845 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 17:14:14 crc kubenswrapper[5120]: I0316 17:14:14.547079 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 17:14:14 crc kubenswrapper[5120]: I0316 17:14:14.547186 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:14:14 crc kubenswrapper[5120]: I0316 17:14:14.669568 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7c99a61d-0e3f-4dcd-a6bb-54f5a28697a4-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"7c99a61d-0e3f-4dcd-a6bb-54f5a28697a4\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:14:14 crc kubenswrapper[5120]: I0316 17:14:14.669810 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7c99a61d-0e3f-4dcd-a6bb-54f5a28697a4-scripts\") pod \"ceilometer-0\" (UID: \"7c99a61d-0e3f-4dcd-a6bb-54f5a28697a4\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:14:14 crc kubenswrapper[5120]: I0316 17:14:14.669890 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7c99a61d-0e3f-4dcd-a6bb-54f5a28697a4-run-httpd\") pod \"ceilometer-0\" (UID: \"7c99a61d-0e3f-4dcd-a6bb-54f5a28697a4\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:14:14 crc kubenswrapper[5120]: I0316 17:14:14.670389 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7c99a61d-0e3f-4dcd-a6bb-54f5a28697a4-config-data\") pod \"ceilometer-0\" (UID: \"7c99a61d-0e3f-4dcd-a6bb-54f5a28697a4\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:14:14 crc kubenswrapper[5120]: I0316 17:14:14.670617 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7c99a61d-0e3f-4dcd-a6bb-54f5a28697a4-log-httpd\") pod \"ceilometer-0\" (UID: \"7c99a61d-0e3f-4dcd-a6bb-54f5a28697a4\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:14:14 crc kubenswrapper[5120]: I0316 17:14:14.670702 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/7c99a61d-0e3f-4dcd-a6bb-54f5a28697a4-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"7c99a61d-0e3f-4dcd-a6bb-54f5a28697a4\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:14:14 crc kubenswrapper[5120]: I0316 17:14:14.671138 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w294l\" (UniqueName: \"kubernetes.io/projected/7c99a61d-0e3f-4dcd-a6bb-54f5a28697a4-kube-api-access-w294l\") pod \"ceilometer-0\" (UID: \"7c99a61d-0e3f-4dcd-a6bb-54f5a28697a4\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:14:14 crc kubenswrapper[5120]: I0316 17:14:14.676683 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e653cf48-8db9-4fe8-9478-a3207ab76c97" path="/var/lib/kubelet/pods/e653cf48-8db9-4fe8-9478-a3207ab76c97/volumes" Mar 16 17:14:14 crc kubenswrapper[5120]: I0316 17:14:14.773257 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7c99a61d-0e3f-4dcd-a6bb-54f5a28697a4-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"7c99a61d-0e3f-4dcd-a6bb-54f5a28697a4\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:14:14 crc kubenswrapper[5120]: I0316 17:14:14.773415 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7c99a61d-0e3f-4dcd-a6bb-54f5a28697a4-scripts\") pod \"ceilometer-0\" (UID: \"7c99a61d-0e3f-4dcd-a6bb-54f5a28697a4\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:14:14 crc kubenswrapper[5120]: I0316 17:14:14.773457 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7c99a61d-0e3f-4dcd-a6bb-54f5a28697a4-run-httpd\") pod \"ceilometer-0\" (UID: \"7c99a61d-0e3f-4dcd-a6bb-54f5a28697a4\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:14:14 crc kubenswrapper[5120]: I0316 17:14:14.773948 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7c99a61d-0e3f-4dcd-a6bb-54f5a28697a4-config-data\") pod \"ceilometer-0\" (UID: \"7c99a61d-0e3f-4dcd-a6bb-54f5a28697a4\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:14:14 crc kubenswrapper[5120]: I0316 17:14:14.774149 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7c99a61d-0e3f-4dcd-a6bb-54f5a28697a4-log-httpd\") pod \"ceilometer-0\" (UID: \"7c99a61d-0e3f-4dcd-a6bb-54f5a28697a4\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:14:14 crc kubenswrapper[5120]: I0316 17:14:14.774186 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/7c99a61d-0e3f-4dcd-a6bb-54f5a28697a4-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"7c99a61d-0e3f-4dcd-a6bb-54f5a28697a4\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:14:14 crc kubenswrapper[5120]: I0316 17:14:14.774206 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7c99a61d-0e3f-4dcd-a6bb-54f5a28697a4-run-httpd\") pod \"ceilometer-0\" (UID: \"7c99a61d-0e3f-4dcd-a6bb-54f5a28697a4\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:14:14 crc kubenswrapper[5120]: I0316 17:14:14.774405 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w294l\" (UniqueName: \"kubernetes.io/projected/7c99a61d-0e3f-4dcd-a6bb-54f5a28697a4-kube-api-access-w294l\") pod \"ceilometer-0\" (UID: \"7c99a61d-0e3f-4dcd-a6bb-54f5a28697a4\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:14:14 crc kubenswrapper[5120]: I0316 17:14:14.774602 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7c99a61d-0e3f-4dcd-a6bb-54f5a28697a4-log-httpd\") pod \"ceilometer-0\" (UID: \"7c99a61d-0e3f-4dcd-a6bb-54f5a28697a4\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:14:14 crc kubenswrapper[5120]: I0316 17:14:14.777723 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/7c99a61d-0e3f-4dcd-a6bb-54f5a28697a4-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"7c99a61d-0e3f-4dcd-a6bb-54f5a28697a4\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:14:14 crc kubenswrapper[5120]: I0316 17:14:14.778232 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7c99a61d-0e3f-4dcd-a6bb-54f5a28697a4-scripts\") pod \"ceilometer-0\" (UID: \"7c99a61d-0e3f-4dcd-a6bb-54f5a28697a4\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:14:14 crc kubenswrapper[5120]: I0316 17:14:14.778749 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7c99a61d-0e3f-4dcd-a6bb-54f5a28697a4-config-data\") pod \"ceilometer-0\" (UID: \"7c99a61d-0e3f-4dcd-a6bb-54f5a28697a4\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:14:14 crc kubenswrapper[5120]: I0316 17:14:14.789319 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7c99a61d-0e3f-4dcd-a6bb-54f5a28697a4-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"7c99a61d-0e3f-4dcd-a6bb-54f5a28697a4\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:14:14 crc kubenswrapper[5120]: I0316 17:14:14.789662 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w294l\" (UniqueName: \"kubernetes.io/projected/7c99a61d-0e3f-4dcd-a6bb-54f5a28697a4-kube-api-access-w294l\") pod \"ceilometer-0\" (UID: \"7c99a61d-0e3f-4dcd-a6bb-54f5a28697a4\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:14:14 crc kubenswrapper[5120]: I0316 17:14:14.885837 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:14:15 crc kubenswrapper[5120]: I0316 17:14:15.334536 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:14:15 crc kubenswrapper[5120]: I0316 17:14:15.476824 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7c99a61d-0e3f-4dcd-a6bb-54f5a28697a4","Type":"ContainerStarted","Data":"e16fe475d920420279e95b47322e0b5531715ae19ca4953635b31d5a2414231e"} Mar 16 17:14:16 crc kubenswrapper[5120]: E0316 17:14:16.061581 5120 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1ae5285c_173c_4162_9610_3f9c3a4ef47b.slice\": RecentStats: unable to find data in memory cache]" Mar 16 17:14:16 crc kubenswrapper[5120]: I0316 17:14:16.234838 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-djqq9"] Mar 16 17:14:16 crc kubenswrapper[5120]: I0316 17:14:16.245011 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-db-create-djqq9" Mar 16 17:14:16 crc kubenswrapper[5120]: I0316 17:14:16.245366 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-djqq9"] Mar 16 17:14:16 crc kubenswrapper[5120]: I0316 17:14:16.316156 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/98cc37e9-8b48-4455-9254-4d83ccdc12e9-operator-scripts\") pod \"nova-api-db-create-djqq9\" (UID: \"98cc37e9-8b48-4455-9254-4d83ccdc12e9\") " pod="openstack-kuttl-tests/nova-api-db-create-djqq9" Mar 16 17:14:16 crc kubenswrapper[5120]: I0316 17:14:16.316597 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2cw4\" (UniqueName: \"kubernetes.io/projected/98cc37e9-8b48-4455-9254-4d83ccdc12e9-kube-api-access-p2cw4\") pod \"nova-api-db-create-djqq9\" (UID: \"98cc37e9-8b48-4455-9254-4d83ccdc12e9\") " pod="openstack-kuttl-tests/nova-api-db-create-djqq9" Mar 16 17:14:16 crc kubenswrapper[5120]: I0316 17:14:16.340171 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-xnzdl"] Mar 16 17:14:16 crc kubenswrapper[5120]: I0316 17:14:16.347601 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-db-create-xnzdl" Mar 16 17:14:16 crc kubenswrapper[5120]: I0316 17:14:16.349877 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-xnzdl"] Mar 16 17:14:16 crc kubenswrapper[5120]: I0316 17:14:16.419356 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vx5h\" (UniqueName: \"kubernetes.io/projected/02abd7be-4fc2-4452-9ab1-ca63cc1881b8-kube-api-access-6vx5h\") pod \"nova-cell0-db-create-xnzdl\" (UID: \"02abd7be-4fc2-4452-9ab1-ca63cc1881b8\") " pod="openstack-kuttl-tests/nova-cell0-db-create-xnzdl" Mar 16 17:14:16 crc kubenswrapper[5120]: I0316 17:14:16.419483 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p2cw4\" (UniqueName: \"kubernetes.io/projected/98cc37e9-8b48-4455-9254-4d83ccdc12e9-kube-api-access-p2cw4\") pod \"nova-api-db-create-djqq9\" (UID: \"98cc37e9-8b48-4455-9254-4d83ccdc12e9\") " pod="openstack-kuttl-tests/nova-api-db-create-djqq9" Mar 16 17:14:16 crc kubenswrapper[5120]: I0316 17:14:16.419868 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/98cc37e9-8b48-4455-9254-4d83ccdc12e9-operator-scripts\") pod \"nova-api-db-create-djqq9\" (UID: \"98cc37e9-8b48-4455-9254-4d83ccdc12e9\") " pod="openstack-kuttl-tests/nova-api-db-create-djqq9" Mar 16 17:14:16 crc kubenswrapper[5120]: I0316 17:14:16.420053 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/02abd7be-4fc2-4452-9ab1-ca63cc1881b8-operator-scripts\") pod \"nova-cell0-db-create-xnzdl\" (UID: \"02abd7be-4fc2-4452-9ab1-ca63cc1881b8\") " pod="openstack-kuttl-tests/nova-cell0-db-create-xnzdl" Mar 16 17:14:16 crc kubenswrapper[5120]: I0316 17:14:16.421374 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/98cc37e9-8b48-4455-9254-4d83ccdc12e9-operator-scripts\") pod \"nova-api-db-create-djqq9\" (UID: \"98cc37e9-8b48-4455-9254-4d83ccdc12e9\") " pod="openstack-kuttl-tests/nova-api-db-create-djqq9" Mar 16 17:14:16 crc kubenswrapper[5120]: I0316 17:14:16.443585 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2cw4\" (UniqueName: \"kubernetes.io/projected/98cc37e9-8b48-4455-9254-4d83ccdc12e9-kube-api-access-p2cw4\") pod \"nova-api-db-create-djqq9\" (UID: \"98cc37e9-8b48-4455-9254-4d83ccdc12e9\") " pod="openstack-kuttl-tests/nova-api-db-create-djqq9" Mar 16 17:14:16 crc kubenswrapper[5120]: I0316 17:14:16.446708 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-eb52-account-create-update-rkbs2"] Mar 16 17:14:16 crc kubenswrapper[5120]: I0316 17:14:16.455889 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-eb52-account-create-update-rkbs2" Mar 16 17:14:16 crc kubenswrapper[5120]: I0316 17:14:16.459425 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-db-secret\"" Mar 16 17:14:16 crc kubenswrapper[5120]: I0316 17:14:16.461945 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-eb52-account-create-update-rkbs2"] Mar 16 17:14:16 crc kubenswrapper[5120]: I0316 17:14:16.494141 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7c99a61d-0e3f-4dcd-a6bb-54f5a28697a4","Type":"ContainerStarted","Data":"a6f13758e529b43d0ea3275a928bb35c5d5b4b38e699e4aaf031706c63dbc8ad"} Mar 16 17:14:16 crc kubenswrapper[5120]: I0316 17:14:16.523789 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dz8b8\" (UniqueName: \"kubernetes.io/projected/6ede1efb-38ea-42e1-87b9-fd608faec542-kube-api-access-dz8b8\") pod \"nova-api-eb52-account-create-update-rkbs2\" (UID: \"6ede1efb-38ea-42e1-87b9-fd608faec542\") " pod="openstack-kuttl-tests/nova-api-eb52-account-create-update-rkbs2" Mar 16 17:14:16 crc kubenswrapper[5120]: I0316 17:14:16.524136 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/02abd7be-4fc2-4452-9ab1-ca63cc1881b8-operator-scripts\") pod \"nova-cell0-db-create-xnzdl\" (UID: \"02abd7be-4fc2-4452-9ab1-ca63cc1881b8\") " pod="openstack-kuttl-tests/nova-cell0-db-create-xnzdl" Mar 16 17:14:16 crc kubenswrapper[5120]: I0316 17:14:16.524312 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6vx5h\" (UniqueName: \"kubernetes.io/projected/02abd7be-4fc2-4452-9ab1-ca63cc1881b8-kube-api-access-6vx5h\") pod \"nova-cell0-db-create-xnzdl\" (UID: \"02abd7be-4fc2-4452-9ab1-ca63cc1881b8\") " pod="openstack-kuttl-tests/nova-cell0-db-create-xnzdl" Mar 16 17:14:16 crc kubenswrapper[5120]: I0316 17:14:16.524737 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/6ede1efb-38ea-42e1-87b9-fd608faec542-operator-scripts\") pod \"nova-api-eb52-account-create-update-rkbs2\" (UID: \"6ede1efb-38ea-42e1-87b9-fd608faec542\") " pod="openstack-kuttl-tests/nova-api-eb52-account-create-update-rkbs2" Mar 16 17:14:16 crc kubenswrapper[5120]: I0316 17:14:16.525283 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/02abd7be-4fc2-4452-9ab1-ca63cc1881b8-operator-scripts\") pod \"nova-cell0-db-create-xnzdl\" (UID: \"02abd7be-4fc2-4452-9ab1-ca63cc1881b8\") " pod="openstack-kuttl-tests/nova-cell0-db-create-xnzdl" Mar 16 17:14:16 crc kubenswrapper[5120]: I0316 17:14:16.553890 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vx5h\" (UniqueName: \"kubernetes.io/projected/02abd7be-4fc2-4452-9ab1-ca63cc1881b8-kube-api-access-6vx5h\") pod \"nova-cell0-db-create-xnzdl\" (UID: \"02abd7be-4fc2-4452-9ab1-ca63cc1881b8\") " pod="openstack-kuttl-tests/nova-cell0-db-create-xnzdl" Mar 16 17:14:16 crc kubenswrapper[5120]: I0316 17:14:16.572943 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-g7qpg"] Mar 16 17:14:16 crc kubenswrapper[5120]: I0316 17:14:16.593531 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-db-create-djqq9" Mar 16 17:14:16 crc kubenswrapper[5120]: I0316 17:14:16.600855 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-db-create-g7qpg" Mar 16 17:14:16 crc kubenswrapper[5120]: I0316 17:14:16.602616 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-g7qpg"] Mar 16 17:14:16 crc kubenswrapper[5120]: I0316 17:14:16.628167 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/6ede1efb-38ea-42e1-87b9-fd608faec542-operator-scripts\") pod \"nova-api-eb52-account-create-update-rkbs2\" (UID: \"6ede1efb-38ea-42e1-87b9-fd608faec542\") " pod="openstack-kuttl-tests/nova-api-eb52-account-create-update-rkbs2" Mar 16 17:14:16 crc kubenswrapper[5120]: I0316 17:14:16.628354 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dz8b8\" (UniqueName: \"kubernetes.io/projected/6ede1efb-38ea-42e1-87b9-fd608faec542-kube-api-access-dz8b8\") pod \"nova-api-eb52-account-create-update-rkbs2\" (UID: \"6ede1efb-38ea-42e1-87b9-fd608faec542\") " pod="openstack-kuttl-tests/nova-api-eb52-account-create-update-rkbs2" Mar 16 17:14:16 crc kubenswrapper[5120]: I0316 17:14:16.630419 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/6ede1efb-38ea-42e1-87b9-fd608faec542-operator-scripts\") pod \"nova-api-eb52-account-create-update-rkbs2\" (UID: \"6ede1efb-38ea-42e1-87b9-fd608faec542\") " pod="openstack-kuttl-tests/nova-api-eb52-account-create-update-rkbs2" Mar 16 17:14:16 crc kubenswrapper[5120]: I0316 17:14:16.649804 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dz8b8\" (UniqueName: \"kubernetes.io/projected/6ede1efb-38ea-42e1-87b9-fd608faec542-kube-api-access-dz8b8\") pod \"nova-api-eb52-account-create-update-rkbs2\" (UID: \"6ede1efb-38ea-42e1-87b9-fd608faec542\") " pod="openstack-kuttl-tests/nova-api-eb52-account-create-update-rkbs2" Mar 16 17:14:16 crc kubenswrapper[5120]: I0316 17:14:16.656020 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-54d5-account-create-update-lgn6q"] Mar 16 17:14:16 crc kubenswrapper[5120]: I0316 17:14:16.668432 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-db-create-xnzdl" Mar 16 17:14:16 crc kubenswrapper[5120]: I0316 17:14:16.670112 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-54d5-account-create-update-lgn6q" Mar 16 17:14:16 crc kubenswrapper[5120]: I0316 17:14:16.673291 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-db-secret\"" Mar 16 17:14:16 crc kubenswrapper[5120]: I0316 17:14:16.709509 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-54d5-account-create-update-lgn6q"] Mar 16 17:14:16 crc kubenswrapper[5120]: I0316 17:14:16.731503 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxcgj\" (UniqueName: \"kubernetes.io/projected/f3c221d1-880b-4ee9-aee6-b256334793c9-kube-api-access-xxcgj\") pod \"nova-cell1-db-create-g7qpg\" (UID: \"f3c221d1-880b-4ee9-aee6-b256334793c9\") " pod="openstack-kuttl-tests/nova-cell1-db-create-g7qpg" Mar 16 17:14:16 crc kubenswrapper[5120]: I0316 17:14:16.731978 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f3c221d1-880b-4ee9-aee6-b256334793c9-operator-scripts\") pod \"nova-cell1-db-create-g7qpg\" (UID: \"f3c221d1-880b-4ee9-aee6-b256334793c9\") " pod="openstack-kuttl-tests/nova-cell1-db-create-g7qpg" Mar 16 17:14:16 crc kubenswrapper[5120]: I0316 17:14:16.732767 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s492l\" (UniqueName: \"kubernetes.io/projected/69aeb71a-453a-4d4f-bdd2-3e0541c12060-kube-api-access-s492l\") pod \"nova-cell0-54d5-account-create-update-lgn6q\" (UID: \"69aeb71a-453a-4d4f-bdd2-3e0541c12060\") " pod="openstack-kuttl-tests/nova-cell0-54d5-account-create-update-lgn6q" Mar 16 17:14:16 crc kubenswrapper[5120]: I0316 17:14:16.732964 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/69aeb71a-453a-4d4f-bdd2-3e0541c12060-operator-scripts\") pod \"nova-cell0-54d5-account-create-update-lgn6q\" (UID: \"69aeb71a-453a-4d4f-bdd2-3e0541c12060\") " pod="openstack-kuttl-tests/nova-cell0-54d5-account-create-update-lgn6q" Mar 16 17:14:16 crc kubenswrapper[5120]: I0316 17:14:16.763987 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-645b-account-create-update-lgc2j"] Mar 16 17:14:16 crc kubenswrapper[5120]: I0316 17:14:16.807057 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-645b-account-create-update-lgc2j"] Mar 16 17:14:16 crc kubenswrapper[5120]: I0316 17:14:16.807253 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-645b-account-create-update-lgc2j" Mar 16 17:14:16 crc kubenswrapper[5120]: I0316 17:14:16.810288 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-db-secret\"" Mar 16 17:14:16 crc kubenswrapper[5120]: I0316 17:14:16.812420 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-eb52-account-create-update-rkbs2" Mar 16 17:14:16 crc kubenswrapper[5120]: I0316 17:14:16.847514 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f3c221d1-880b-4ee9-aee6-b256334793c9-operator-scripts\") pod \"nova-cell1-db-create-g7qpg\" (UID: \"f3c221d1-880b-4ee9-aee6-b256334793c9\") " pod="openstack-kuttl-tests/nova-cell1-db-create-g7qpg" Mar 16 17:14:16 crc kubenswrapper[5120]: I0316 17:14:16.848111 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s492l\" (UniqueName: \"kubernetes.io/projected/69aeb71a-453a-4d4f-bdd2-3e0541c12060-kube-api-access-s492l\") pod \"nova-cell0-54d5-account-create-update-lgn6q\" (UID: \"69aeb71a-453a-4d4f-bdd2-3e0541c12060\") " pod="openstack-kuttl-tests/nova-cell0-54d5-account-create-update-lgn6q" Mar 16 17:14:16 crc kubenswrapper[5120]: I0316 17:14:16.848348 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/69aeb71a-453a-4d4f-bdd2-3e0541c12060-operator-scripts\") pod \"nova-cell0-54d5-account-create-update-lgn6q\" (UID: \"69aeb71a-453a-4d4f-bdd2-3e0541c12060\") " pod="openstack-kuttl-tests/nova-cell0-54d5-account-create-update-lgn6q" Mar 16 17:14:16 crc kubenswrapper[5120]: I0316 17:14:16.848385 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/87effe7f-90d5-4885-aa36-77b807c0057e-operator-scripts\") pod \"nova-cell1-645b-account-create-update-lgc2j\" (UID: \"87effe7f-90d5-4885-aa36-77b807c0057e\") " pod="openstack-kuttl-tests/nova-cell1-645b-account-create-update-lgc2j" Mar 16 17:14:16 crc kubenswrapper[5120]: I0316 17:14:16.848413 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4dx8\" (UniqueName: \"kubernetes.io/projected/87effe7f-90d5-4885-aa36-77b807c0057e-kube-api-access-g4dx8\") pod \"nova-cell1-645b-account-create-update-lgc2j\" (UID: \"87effe7f-90d5-4885-aa36-77b807c0057e\") " pod="openstack-kuttl-tests/nova-cell1-645b-account-create-update-lgc2j" Mar 16 17:14:16 crc kubenswrapper[5120]: I0316 17:14:16.848481 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xxcgj\" (UniqueName: \"kubernetes.io/projected/f3c221d1-880b-4ee9-aee6-b256334793c9-kube-api-access-xxcgj\") pod \"nova-cell1-db-create-g7qpg\" (UID: \"f3c221d1-880b-4ee9-aee6-b256334793c9\") " pod="openstack-kuttl-tests/nova-cell1-db-create-g7qpg" Mar 16 17:14:16 crc kubenswrapper[5120]: I0316 17:14:16.849751 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f3c221d1-880b-4ee9-aee6-b256334793c9-operator-scripts\") pod \"nova-cell1-db-create-g7qpg\" (UID: \"f3c221d1-880b-4ee9-aee6-b256334793c9\") " pod="openstack-kuttl-tests/nova-cell1-db-create-g7qpg" Mar 16 17:14:16 crc kubenswrapper[5120]: I0316 17:14:16.849787 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/69aeb71a-453a-4d4f-bdd2-3e0541c12060-operator-scripts\") pod \"nova-cell0-54d5-account-create-update-lgn6q\" (UID: \"69aeb71a-453a-4d4f-bdd2-3e0541c12060\") " pod="openstack-kuttl-tests/nova-cell0-54d5-account-create-update-lgn6q" Mar 16 17:14:16 crc kubenswrapper[5120]: I0316 17:14:16.886901 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s492l\" (UniqueName: \"kubernetes.io/projected/69aeb71a-453a-4d4f-bdd2-3e0541c12060-kube-api-access-s492l\") pod \"nova-cell0-54d5-account-create-update-lgn6q\" (UID: \"69aeb71a-453a-4d4f-bdd2-3e0541c12060\") " pod="openstack-kuttl-tests/nova-cell0-54d5-account-create-update-lgn6q" Mar 16 17:14:16 crc kubenswrapper[5120]: I0316 17:14:16.899320 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxcgj\" (UniqueName: \"kubernetes.io/projected/f3c221d1-880b-4ee9-aee6-b256334793c9-kube-api-access-xxcgj\") pod \"nova-cell1-db-create-g7qpg\" (UID: \"f3c221d1-880b-4ee9-aee6-b256334793c9\") " pod="openstack-kuttl-tests/nova-cell1-db-create-g7qpg" Mar 16 17:14:16 crc kubenswrapper[5120]: I0316 17:14:16.953118 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/87effe7f-90d5-4885-aa36-77b807c0057e-operator-scripts\") pod \"nova-cell1-645b-account-create-update-lgc2j\" (UID: \"87effe7f-90d5-4885-aa36-77b807c0057e\") " pod="openstack-kuttl-tests/nova-cell1-645b-account-create-update-lgc2j" Mar 16 17:14:16 crc kubenswrapper[5120]: I0316 17:14:16.953186 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g4dx8\" (UniqueName: \"kubernetes.io/projected/87effe7f-90d5-4885-aa36-77b807c0057e-kube-api-access-g4dx8\") pod \"nova-cell1-645b-account-create-update-lgc2j\" (UID: \"87effe7f-90d5-4885-aa36-77b807c0057e\") " pod="openstack-kuttl-tests/nova-cell1-645b-account-create-update-lgc2j" Mar 16 17:14:16 crc kubenswrapper[5120]: I0316 17:14:16.954651 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/87effe7f-90d5-4885-aa36-77b807c0057e-operator-scripts\") pod \"nova-cell1-645b-account-create-update-lgc2j\" (UID: \"87effe7f-90d5-4885-aa36-77b807c0057e\") " pod="openstack-kuttl-tests/nova-cell1-645b-account-create-update-lgc2j" Mar 16 17:14:16 crc kubenswrapper[5120]: I0316 17:14:16.954884 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-db-create-g7qpg" Mar 16 17:14:16 crc kubenswrapper[5120]: I0316 17:14:16.980891 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4dx8\" (UniqueName: \"kubernetes.io/projected/87effe7f-90d5-4885-aa36-77b807c0057e-kube-api-access-g4dx8\") pod \"nova-cell1-645b-account-create-update-lgc2j\" (UID: \"87effe7f-90d5-4885-aa36-77b807c0057e\") " pod="openstack-kuttl-tests/nova-cell1-645b-account-create-update-lgc2j" Mar 16 17:14:17 crc kubenswrapper[5120]: I0316 17:14:17.023208 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-54d5-account-create-update-lgn6q" Mar 16 17:14:17 crc kubenswrapper[5120]: I0316 17:14:17.091486 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-645b-account-create-update-lgc2j" Mar 16 17:14:17 crc kubenswrapper[5120]: I0316 17:14:17.271617 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-xnzdl"] Mar 16 17:14:17 crc kubenswrapper[5120]: I0316 17:14:17.340240 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-djqq9"] Mar 16 17:14:17 crc kubenswrapper[5120]: I0316 17:14:17.535103 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-db-create-djqq9" event={"ID":"98cc37e9-8b48-4455-9254-4d83ccdc12e9","Type":"ContainerStarted","Data":"d9c9f76efe1da55ef9d9e5f3da1cf36263ec764ec171ddd825bd97c2c3005c94"} Mar 16 17:14:17 crc kubenswrapper[5120]: I0316 17:14:17.548442 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7c99a61d-0e3f-4dcd-a6bb-54f5a28697a4","Type":"ContainerStarted","Data":"4f4269a9f15d7023d975614200d98a20f522c5b88d249bb93279596ce8a3984d"} Mar 16 17:14:17 crc kubenswrapper[5120]: I0316 17:14:17.551713 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-db-create-xnzdl" event={"ID":"02abd7be-4fc2-4452-9ab1-ca63cc1881b8","Type":"ContainerStarted","Data":"372efc3906fa2e4af2cf094c15567db6c1e2954d2088443f236e805e56e280f1"} Mar 16 17:14:17 crc kubenswrapper[5120]: I0316 17:14:17.551778 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-db-create-xnzdl" event={"ID":"02abd7be-4fc2-4452-9ab1-ca63cc1881b8","Type":"ContainerStarted","Data":"5f1701a622651d07cff2959cef9a32af67ac62930ab2c9ffe3efb26c503442fe"} Mar 16 17:14:17 crc kubenswrapper[5120]: I0316 17:14:17.593869 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-eb52-account-create-update-rkbs2"] Mar 16 17:14:17 crc kubenswrapper[5120]: I0316 17:14:17.600156 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-db-create-xnzdl" podStartSLOduration=1.6001363579999999 podStartE2EDuration="1.600136358s" podCreationTimestamp="2026-03-16 17:14:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:14:17.582045453 +0000 UTC m=+6159.735977110" watchObservedRunningTime="2026-03-16 17:14:17.600136358 +0000 UTC m=+6159.754068015" Mar 16 17:14:17 crc kubenswrapper[5120]: I0316 17:14:17.626158 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-g7qpg"] Mar 16 17:14:17 crc kubenswrapper[5120]: I0316 17:14:17.853927 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-54d5-account-create-update-lgn6q"] Mar 16 17:14:17 crc kubenswrapper[5120]: I0316 17:14:17.894721 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-645b-account-create-update-lgc2j"] Mar 16 17:14:18 crc kubenswrapper[5120]: I0316 17:14:18.569789 5120 generic.go:358] "Generic (PLEG): container finished" podID="87effe7f-90d5-4885-aa36-77b807c0057e" containerID="40629dd0d3c60a17d6216d22b679f572b39fc0af6c6ec56f7975429633a51360" exitCode=0 Mar 16 17:14:18 crc kubenswrapper[5120]: I0316 17:14:18.569973 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-645b-account-create-update-lgc2j" event={"ID":"87effe7f-90d5-4885-aa36-77b807c0057e","Type":"ContainerDied","Data":"40629dd0d3c60a17d6216d22b679f572b39fc0af6c6ec56f7975429633a51360"} Mar 16 17:14:18 crc kubenswrapper[5120]: I0316 17:14:18.570269 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-645b-account-create-update-lgc2j" event={"ID":"87effe7f-90d5-4885-aa36-77b807c0057e","Type":"ContainerStarted","Data":"1c37d15f6025786f50ca8edd80dadd3d6d43e0416c02d5378f38a5fab06a075c"} Mar 16 17:14:18 crc kubenswrapper[5120]: I0316 17:14:18.572341 5120 generic.go:358] "Generic (PLEG): container finished" podID="69aeb71a-453a-4d4f-bdd2-3e0541c12060" containerID="c488500facf2a43af1b9d21af7057a21ff3941510d5b87671ffafb7a3741ab33" exitCode=0 Mar 16 17:14:18 crc kubenswrapper[5120]: I0316 17:14:18.572448 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-54d5-account-create-update-lgn6q" event={"ID":"69aeb71a-453a-4d4f-bdd2-3e0541c12060","Type":"ContainerDied","Data":"c488500facf2a43af1b9d21af7057a21ff3941510d5b87671ffafb7a3741ab33"} Mar 16 17:14:18 crc kubenswrapper[5120]: I0316 17:14:18.572484 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-54d5-account-create-update-lgn6q" event={"ID":"69aeb71a-453a-4d4f-bdd2-3e0541c12060","Type":"ContainerStarted","Data":"b13fe2e2f8a0ed556c24964732822a758036ed729d9f8f1490a37b0329146649"} Mar 16 17:14:18 crc kubenswrapper[5120]: I0316 17:14:18.589201 5120 generic.go:358] "Generic (PLEG): container finished" podID="98cc37e9-8b48-4455-9254-4d83ccdc12e9" containerID="ec4062b394d56862e1ae3bad938c3fcf69b02aa1d4cf1b6ee7609e0c9ded8ba3" exitCode=0 Mar 16 17:14:18 crc kubenswrapper[5120]: I0316 17:14:18.589503 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-db-create-djqq9" event={"ID":"98cc37e9-8b48-4455-9254-4d83ccdc12e9","Type":"ContainerDied","Data":"ec4062b394d56862e1ae3bad938c3fcf69b02aa1d4cf1b6ee7609e0c9ded8ba3"} Mar 16 17:14:18 crc kubenswrapper[5120]: I0316 17:14:18.598805 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7c99a61d-0e3f-4dcd-a6bb-54f5a28697a4","Type":"ContainerStarted","Data":"93c9edec0a49b72430e28f78af13dc7a2990d543fa1813f71727d81d5b7800a6"} Mar 16 17:14:18 crc kubenswrapper[5120]: I0316 17:14:18.601250 5120 generic.go:358] "Generic (PLEG): container finished" podID="02abd7be-4fc2-4452-9ab1-ca63cc1881b8" containerID="372efc3906fa2e4af2cf094c15567db6c1e2954d2088443f236e805e56e280f1" exitCode=0 Mar 16 17:14:18 crc kubenswrapper[5120]: I0316 17:14:18.601457 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-db-create-xnzdl" event={"ID":"02abd7be-4fc2-4452-9ab1-ca63cc1881b8","Type":"ContainerDied","Data":"372efc3906fa2e4af2cf094c15567db6c1e2954d2088443f236e805e56e280f1"} Mar 16 17:14:18 crc kubenswrapper[5120]: I0316 17:14:18.611452 5120 generic.go:358] "Generic (PLEG): container finished" podID="f3c221d1-880b-4ee9-aee6-b256334793c9" containerID="b238a32cf48132d7f92857ce9002d00388e302772145a1e6263f979c4738435f" exitCode=0 Mar 16 17:14:18 crc kubenswrapper[5120]: I0316 17:14:18.611587 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-db-create-g7qpg" event={"ID":"f3c221d1-880b-4ee9-aee6-b256334793c9","Type":"ContainerDied","Data":"b238a32cf48132d7f92857ce9002d00388e302772145a1e6263f979c4738435f"} Mar 16 17:14:18 crc kubenswrapper[5120]: I0316 17:14:18.611616 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-db-create-g7qpg" event={"ID":"f3c221d1-880b-4ee9-aee6-b256334793c9","Type":"ContainerStarted","Data":"eb0a60a2ecaf0b1d090dcf1428e71aa9d8ed1e00bae9b1b484be4eba24135120"} Mar 16 17:14:18 crc kubenswrapper[5120]: I0316 17:14:18.615300 5120 generic.go:358] "Generic (PLEG): container finished" podID="6ede1efb-38ea-42e1-87b9-fd608faec542" containerID="2fc3e403e6330ac6fbe973cbd165e0c7e03d0b3ecbbc2615e12f28cf90e0be45" exitCode=0 Mar 16 17:14:18 crc kubenswrapper[5120]: I0316 17:14:18.615350 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-eb52-account-create-update-rkbs2" event={"ID":"6ede1efb-38ea-42e1-87b9-fd608faec542","Type":"ContainerDied","Data":"2fc3e403e6330ac6fbe973cbd165e0c7e03d0b3ecbbc2615e12f28cf90e0be45"} Mar 16 17:14:18 crc kubenswrapper[5120]: I0316 17:14:18.615371 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-eb52-account-create-update-rkbs2" event={"ID":"6ede1efb-38ea-42e1-87b9-fd608faec542","Type":"ContainerStarted","Data":"a560aa14a27e3540cbd6a96b3240ba08c3d75e51768227911bfaa0e246161d02"} Mar 16 17:14:19 crc kubenswrapper[5120]: I0316 17:14:19.472724 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/swift-proxy-5749bb5d-544mw" Mar 16 17:14:19 crc kubenswrapper[5120]: I0316 17:14:19.473201 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/swift-proxy-5749bb5d-544mw" Mar 16 17:14:20 crc kubenswrapper[5120]: I0316 17:14:20.093027 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-db-create-djqq9" Mar 16 17:14:20 crc kubenswrapper[5120]: I0316 17:14:20.183368 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/98cc37e9-8b48-4455-9254-4d83ccdc12e9-operator-scripts\") pod \"98cc37e9-8b48-4455-9254-4d83ccdc12e9\" (UID: \"98cc37e9-8b48-4455-9254-4d83ccdc12e9\") " Mar 16 17:14:20 crc kubenswrapper[5120]: I0316 17:14:20.184248 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/98cc37e9-8b48-4455-9254-4d83ccdc12e9-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "98cc37e9-8b48-4455-9254-4d83ccdc12e9" (UID: "98cc37e9-8b48-4455-9254-4d83ccdc12e9"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:14:20 crc kubenswrapper[5120]: I0316 17:14:20.184336 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p2cw4\" (UniqueName: \"kubernetes.io/projected/98cc37e9-8b48-4455-9254-4d83ccdc12e9-kube-api-access-p2cw4\") pod \"98cc37e9-8b48-4455-9254-4d83ccdc12e9\" (UID: \"98cc37e9-8b48-4455-9254-4d83ccdc12e9\") " Mar 16 17:14:20 crc kubenswrapper[5120]: I0316 17:14:20.185880 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/98cc37e9-8b48-4455-9254-4d83ccdc12e9-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:14:20 crc kubenswrapper[5120]: I0316 17:14:20.214198 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98cc37e9-8b48-4455-9254-4d83ccdc12e9-kube-api-access-p2cw4" (OuterVolumeSpecName: "kube-api-access-p2cw4") pod "98cc37e9-8b48-4455-9254-4d83ccdc12e9" (UID: "98cc37e9-8b48-4455-9254-4d83ccdc12e9"). InnerVolumeSpecName "kube-api-access-p2cw4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:14:20 crc kubenswrapper[5120]: I0316 17:14:20.294321 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p2cw4\" (UniqueName: \"kubernetes.io/projected/98cc37e9-8b48-4455-9254-4d83ccdc12e9-kube-api-access-p2cw4\") on node \"crc\" DevicePath \"\"" Mar 16 17:14:20 crc kubenswrapper[5120]: I0316 17:14:20.364376 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-54d5-account-create-update-lgn6q" Mar 16 17:14:20 crc kubenswrapper[5120]: I0316 17:14:20.374661 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-eb52-account-create-update-rkbs2" Mar 16 17:14:20 crc kubenswrapper[5120]: I0316 17:14:20.391954 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-db-create-g7qpg" Mar 16 17:14:20 crc kubenswrapper[5120]: I0316 17:14:20.401504 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-db-create-xnzdl" Mar 16 17:14:20 crc kubenswrapper[5120]: I0316 17:14:20.416730 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-645b-account-create-update-lgc2j" Mar 16 17:14:20 crc kubenswrapper[5120]: I0316 17:14:20.509920 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dz8b8\" (UniqueName: \"kubernetes.io/projected/6ede1efb-38ea-42e1-87b9-fd608faec542-kube-api-access-dz8b8\") pod \"6ede1efb-38ea-42e1-87b9-fd608faec542\" (UID: \"6ede1efb-38ea-42e1-87b9-fd608faec542\") " Mar 16 17:14:20 crc kubenswrapper[5120]: I0316 17:14:20.509976 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s492l\" (UniqueName: \"kubernetes.io/projected/69aeb71a-453a-4d4f-bdd2-3e0541c12060-kube-api-access-s492l\") pod \"69aeb71a-453a-4d4f-bdd2-3e0541c12060\" (UID: \"69aeb71a-453a-4d4f-bdd2-3e0541c12060\") " Mar 16 17:14:20 crc kubenswrapper[5120]: I0316 17:14:20.510138 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/87effe7f-90d5-4885-aa36-77b807c0057e-operator-scripts\") pod \"87effe7f-90d5-4885-aa36-77b807c0057e\" (UID: \"87effe7f-90d5-4885-aa36-77b807c0057e\") " Mar 16 17:14:20 crc kubenswrapper[5120]: I0316 17:14:20.510166 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xxcgj\" (UniqueName: \"kubernetes.io/projected/f3c221d1-880b-4ee9-aee6-b256334793c9-kube-api-access-xxcgj\") pod \"f3c221d1-880b-4ee9-aee6-b256334793c9\" (UID: \"f3c221d1-880b-4ee9-aee6-b256334793c9\") " Mar 16 17:14:20 crc kubenswrapper[5120]: I0316 17:14:20.510269 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/69aeb71a-453a-4d4f-bdd2-3e0541c12060-operator-scripts\") pod \"69aeb71a-453a-4d4f-bdd2-3e0541c12060\" (UID: \"69aeb71a-453a-4d4f-bdd2-3e0541c12060\") " Mar 16 17:14:20 crc kubenswrapper[5120]: I0316 17:14:20.510322 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g4dx8\" (UniqueName: \"kubernetes.io/projected/87effe7f-90d5-4885-aa36-77b807c0057e-kube-api-access-g4dx8\") pod \"87effe7f-90d5-4885-aa36-77b807c0057e\" (UID: \"87effe7f-90d5-4885-aa36-77b807c0057e\") " Mar 16 17:14:20 crc kubenswrapper[5120]: I0316 17:14:20.510628 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/02abd7be-4fc2-4452-9ab1-ca63cc1881b8-operator-scripts\") pod \"02abd7be-4fc2-4452-9ab1-ca63cc1881b8\" (UID: \"02abd7be-4fc2-4452-9ab1-ca63cc1881b8\") " Mar 16 17:14:20 crc kubenswrapper[5120]: I0316 17:14:20.510695 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f3c221d1-880b-4ee9-aee6-b256334793c9-operator-scripts\") pod \"f3c221d1-880b-4ee9-aee6-b256334793c9\" (UID: \"f3c221d1-880b-4ee9-aee6-b256334793c9\") " Mar 16 17:14:20 crc kubenswrapper[5120]: I0316 17:14:20.510924 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/6ede1efb-38ea-42e1-87b9-fd608faec542-operator-scripts\") pod \"6ede1efb-38ea-42e1-87b9-fd608faec542\" (UID: \"6ede1efb-38ea-42e1-87b9-fd608faec542\") " Mar 16 17:14:20 crc kubenswrapper[5120]: I0316 17:14:20.511055 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6vx5h\" (UniqueName: \"kubernetes.io/projected/02abd7be-4fc2-4452-9ab1-ca63cc1881b8-kube-api-access-6vx5h\") pod \"02abd7be-4fc2-4452-9ab1-ca63cc1881b8\" (UID: \"02abd7be-4fc2-4452-9ab1-ca63cc1881b8\") " Mar 16 17:14:20 crc kubenswrapper[5120]: I0316 17:14:20.512606 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02abd7be-4fc2-4452-9ab1-ca63cc1881b8-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "02abd7be-4fc2-4452-9ab1-ca63cc1881b8" (UID: "02abd7be-4fc2-4452-9ab1-ca63cc1881b8"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:14:20 crc kubenswrapper[5120]: I0316 17:14:20.513211 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f3c221d1-880b-4ee9-aee6-b256334793c9-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "f3c221d1-880b-4ee9-aee6-b256334793c9" (UID: "f3c221d1-880b-4ee9-aee6-b256334793c9"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:14:20 crc kubenswrapper[5120]: I0316 17:14:20.513255 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/87effe7f-90d5-4885-aa36-77b807c0057e-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "87effe7f-90d5-4885-aa36-77b807c0057e" (UID: "87effe7f-90d5-4885-aa36-77b807c0057e"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:14:20 crc kubenswrapper[5120]: I0316 17:14:20.513383 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ede1efb-38ea-42e1-87b9-fd608faec542-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "6ede1efb-38ea-42e1-87b9-fd608faec542" (UID: "6ede1efb-38ea-42e1-87b9-fd608faec542"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:14:20 crc kubenswrapper[5120]: I0316 17:14:20.513752 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69aeb71a-453a-4d4f-bdd2-3e0541c12060-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "69aeb71a-453a-4d4f-bdd2-3e0541c12060" (UID: "69aeb71a-453a-4d4f-bdd2-3e0541c12060"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:14:20 crc kubenswrapper[5120]: I0316 17:14:20.515463 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69aeb71a-453a-4d4f-bdd2-3e0541c12060-kube-api-access-s492l" (OuterVolumeSpecName: "kube-api-access-s492l") pod "69aeb71a-453a-4d4f-bdd2-3e0541c12060" (UID: "69aeb71a-453a-4d4f-bdd2-3e0541c12060"). InnerVolumeSpecName "kube-api-access-s492l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:14:20 crc kubenswrapper[5120]: I0316 17:14:20.516455 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3c221d1-880b-4ee9-aee6-b256334793c9-kube-api-access-xxcgj" (OuterVolumeSpecName: "kube-api-access-xxcgj") pod "f3c221d1-880b-4ee9-aee6-b256334793c9" (UID: "f3c221d1-880b-4ee9-aee6-b256334793c9"). InnerVolumeSpecName "kube-api-access-xxcgj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:14:20 crc kubenswrapper[5120]: I0316 17:14:20.516574 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87effe7f-90d5-4885-aa36-77b807c0057e-kube-api-access-g4dx8" (OuterVolumeSpecName: "kube-api-access-g4dx8") pod "87effe7f-90d5-4885-aa36-77b807c0057e" (UID: "87effe7f-90d5-4885-aa36-77b807c0057e"). InnerVolumeSpecName "kube-api-access-g4dx8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:14:20 crc kubenswrapper[5120]: I0316 17:14:20.517140 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02abd7be-4fc2-4452-9ab1-ca63cc1881b8-kube-api-access-6vx5h" (OuterVolumeSpecName: "kube-api-access-6vx5h") pod "02abd7be-4fc2-4452-9ab1-ca63cc1881b8" (UID: "02abd7be-4fc2-4452-9ab1-ca63cc1881b8"). InnerVolumeSpecName "kube-api-access-6vx5h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:14:20 crc kubenswrapper[5120]: I0316 17:14:20.520074 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ede1efb-38ea-42e1-87b9-fd608faec542-kube-api-access-dz8b8" (OuterVolumeSpecName: "kube-api-access-dz8b8") pod "6ede1efb-38ea-42e1-87b9-fd608faec542" (UID: "6ede1efb-38ea-42e1-87b9-fd608faec542"). InnerVolumeSpecName "kube-api-access-dz8b8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:14:20 crc kubenswrapper[5120]: I0316 17:14:20.549617 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-7d8bb7fd99-qr5kw" Mar 16 17:14:20 crc kubenswrapper[5120]: I0316 17:14:20.553159 5120 scope.go:117] "RemoveContainer" containerID="2aa4c0e3d1ed0755af2cf0f201d22247aedd0b245fdba62d7c8b06139cdce0cc" Mar 16 17:14:20 crc kubenswrapper[5120]: I0316 17:14:20.612922 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/afbb203b-f5f2-4850-83de-e37987e383c9-ovndb-tls-certs\") pod \"afbb203b-f5f2-4850-83de-e37987e383c9\" (UID: \"afbb203b-f5f2-4850-83de-e37987e383c9\") " Mar 16 17:14:20 crc kubenswrapper[5120]: I0316 17:14:20.613138 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vd6hf\" (UniqueName: \"kubernetes.io/projected/afbb203b-f5f2-4850-83de-e37987e383c9-kube-api-access-vd6hf\") pod \"afbb203b-f5f2-4850-83de-e37987e383c9\" (UID: \"afbb203b-f5f2-4850-83de-e37987e383c9\") " Mar 16 17:14:20 crc kubenswrapper[5120]: I0316 17:14:20.613184 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/afbb203b-f5f2-4850-83de-e37987e383c9-httpd-config\") pod \"afbb203b-f5f2-4850-83de-e37987e383c9\" (UID: \"afbb203b-f5f2-4850-83de-e37987e383c9\") " Mar 16 17:14:20 crc kubenswrapper[5120]: I0316 17:14:20.613820 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/afbb203b-f5f2-4850-83de-e37987e383c9-config\") pod \"afbb203b-f5f2-4850-83de-e37987e383c9\" (UID: \"afbb203b-f5f2-4850-83de-e37987e383c9\") " Mar 16 17:14:20 crc kubenswrapper[5120]: I0316 17:14:20.613885 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/afbb203b-f5f2-4850-83de-e37987e383c9-combined-ca-bundle\") pod \"afbb203b-f5f2-4850-83de-e37987e383c9\" (UID: \"afbb203b-f5f2-4850-83de-e37987e383c9\") " Mar 16 17:14:20 crc kubenswrapper[5120]: I0316 17:14:20.615039 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dz8b8\" (UniqueName: \"kubernetes.io/projected/6ede1efb-38ea-42e1-87b9-fd608faec542-kube-api-access-dz8b8\") on node \"crc\" DevicePath \"\"" Mar 16 17:14:20 crc kubenswrapper[5120]: I0316 17:14:20.615068 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s492l\" (UniqueName: \"kubernetes.io/projected/69aeb71a-453a-4d4f-bdd2-3e0541c12060-kube-api-access-s492l\") on node \"crc\" DevicePath \"\"" Mar 16 17:14:20 crc kubenswrapper[5120]: I0316 17:14:20.615082 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/87effe7f-90d5-4885-aa36-77b807c0057e-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:14:20 crc kubenswrapper[5120]: I0316 17:14:20.615095 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xxcgj\" (UniqueName: \"kubernetes.io/projected/f3c221d1-880b-4ee9-aee6-b256334793c9-kube-api-access-xxcgj\") on node \"crc\" DevicePath \"\"" Mar 16 17:14:20 crc kubenswrapper[5120]: I0316 17:14:20.615109 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/69aeb71a-453a-4d4f-bdd2-3e0541c12060-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:14:20 crc kubenswrapper[5120]: I0316 17:14:20.615120 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g4dx8\" (UniqueName: \"kubernetes.io/projected/87effe7f-90d5-4885-aa36-77b807c0057e-kube-api-access-g4dx8\") on node \"crc\" DevicePath \"\"" Mar 16 17:14:20 crc kubenswrapper[5120]: I0316 17:14:20.615132 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/02abd7be-4fc2-4452-9ab1-ca63cc1881b8-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:14:20 crc kubenswrapper[5120]: I0316 17:14:20.615144 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f3c221d1-880b-4ee9-aee6-b256334793c9-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:14:20 crc kubenswrapper[5120]: I0316 17:14:20.615156 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/6ede1efb-38ea-42e1-87b9-fd608faec542-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:14:20 crc kubenswrapper[5120]: I0316 17:14:20.615170 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6vx5h\" (UniqueName: \"kubernetes.io/projected/02abd7be-4fc2-4452-9ab1-ca63cc1881b8-kube-api-access-6vx5h\") on node \"crc\" DevicePath \"\"" Mar 16 17:14:20 crc kubenswrapper[5120]: I0316 17:14:20.622920 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/afbb203b-f5f2-4850-83de-e37987e383c9-httpd-config" (OuterVolumeSpecName: "httpd-config") pod "afbb203b-f5f2-4850-83de-e37987e383c9" (UID: "afbb203b-f5f2-4850-83de-e37987e383c9"). InnerVolumeSpecName "httpd-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:14:20 crc kubenswrapper[5120]: I0316 17:14:20.623079 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/afbb203b-f5f2-4850-83de-e37987e383c9-kube-api-access-vd6hf" (OuterVolumeSpecName: "kube-api-access-vd6hf") pod "afbb203b-f5f2-4850-83de-e37987e383c9" (UID: "afbb203b-f5f2-4850-83de-e37987e383c9"). InnerVolumeSpecName "kube-api-access-vd6hf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:14:20 crc kubenswrapper[5120]: I0316 17:14:20.642640 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-54d5-account-create-update-lgn6q" Mar 16 17:14:20 crc kubenswrapper[5120]: I0316 17:14:20.642862 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-54d5-account-create-update-lgn6q" event={"ID":"69aeb71a-453a-4d4f-bdd2-3e0541c12060","Type":"ContainerDied","Data":"b13fe2e2f8a0ed556c24964732822a758036ed729d9f8f1490a37b0329146649"} Mar 16 17:14:20 crc kubenswrapper[5120]: I0316 17:14:20.642906 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b13fe2e2f8a0ed556c24964732822a758036ed729d9f8f1490a37b0329146649" Mar 16 17:14:20 crc kubenswrapper[5120]: I0316 17:14:20.645672 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-db-create-djqq9" event={"ID":"98cc37e9-8b48-4455-9254-4d83ccdc12e9","Type":"ContainerDied","Data":"d9c9f76efe1da55ef9d9e5f3da1cf36263ec764ec171ddd825bd97c2c3005c94"} Mar 16 17:14:20 crc kubenswrapper[5120]: I0316 17:14:20.645733 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d9c9f76efe1da55ef9d9e5f3da1cf36263ec764ec171ddd825bd97c2c3005c94" Mar 16 17:14:20 crc kubenswrapper[5120]: I0316 17:14:20.645858 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-db-create-djqq9" Mar 16 17:14:20 crc kubenswrapper[5120]: I0316 17:14:20.654153 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-db-create-xnzdl" event={"ID":"02abd7be-4fc2-4452-9ab1-ca63cc1881b8","Type":"ContainerDied","Data":"5f1701a622651d07cff2959cef9a32af67ac62930ab2c9ffe3efb26c503442fe"} Mar 16 17:14:20 crc kubenswrapper[5120]: I0316 17:14:20.654193 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5f1701a622651d07cff2959cef9a32af67ac62930ab2c9ffe3efb26c503442fe" Mar 16 17:14:20 crc kubenswrapper[5120]: I0316 17:14:20.654167 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-db-create-xnzdl" Mar 16 17:14:20 crc kubenswrapper[5120]: I0316 17:14:20.663235 5120 generic.go:358] "Generic (PLEG): container finished" podID="afbb203b-f5f2-4850-83de-e37987e383c9" containerID="e05a433f16dc8224732a75f21bd8552a793c5d7cf2cf319ee8c5d76a5a380f34" exitCode=0 Mar 16 17:14:20 crc kubenswrapper[5120]: I0316 17:14:20.664132 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-7d8bb7fd99-qr5kw" Mar 16 17:14:20 crc kubenswrapper[5120]: I0316 17:14:20.668602 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/afbb203b-f5f2-4850-83de-e37987e383c9-config" (OuterVolumeSpecName: "config") pod "afbb203b-f5f2-4850-83de-e37987e383c9" (UID: "afbb203b-f5f2-4850-83de-e37987e383c9"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:14:20 crc kubenswrapper[5120]: I0316 17:14:20.669983 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-db-create-g7qpg" Mar 16 17:14:20 crc kubenswrapper[5120]: I0316 17:14:20.676238 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-eb52-account-create-update-rkbs2" Mar 16 17:14:20 crc kubenswrapper[5120]: I0316 17:14:20.681368 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-645b-account-create-update-lgc2j" Mar 16 17:14:20 crc kubenswrapper[5120]: I0316 17:14:20.681889 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/afbb203b-f5f2-4850-83de-e37987e383c9-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "afbb203b-f5f2-4850-83de-e37987e383c9" (UID: "afbb203b-f5f2-4850-83de-e37987e383c9"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:14:20 crc kubenswrapper[5120]: I0316 17:14:20.718801 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/afbb203b-f5f2-4850-83de-e37987e383c9-config\") on node \"crc\" DevicePath \"\"" Mar 16 17:14:20 crc kubenswrapper[5120]: I0316 17:14:20.718826 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/afbb203b-f5f2-4850-83de-e37987e383c9-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:14:20 crc kubenswrapper[5120]: I0316 17:14:20.718838 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vd6hf\" (UniqueName: \"kubernetes.io/projected/afbb203b-f5f2-4850-83de-e37987e383c9-kube-api-access-vd6hf\") on node \"crc\" DevicePath \"\"" Mar 16 17:14:20 crc kubenswrapper[5120]: I0316 17:14:20.718847 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/afbb203b-f5f2-4850-83de-e37987e383c9-httpd-config\") on node \"crc\" DevicePath \"\"" Mar 16 17:14:20 crc kubenswrapper[5120]: I0316 17:14:20.734047 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-7d8bb7fd99-qr5kw" event={"ID":"afbb203b-f5f2-4850-83de-e37987e383c9","Type":"ContainerDied","Data":"e05a433f16dc8224732a75f21bd8552a793c5d7cf2cf319ee8c5d76a5a380f34"} Mar 16 17:14:20 crc kubenswrapper[5120]: I0316 17:14:20.734122 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-7d8bb7fd99-qr5kw" event={"ID":"afbb203b-f5f2-4850-83de-e37987e383c9","Type":"ContainerDied","Data":"e2a76b08b7b18bb2b6aec4489a172dd48665f2029986a9cbc13b443e9ca82e9f"} Mar 16 17:14:20 crc kubenswrapper[5120]: I0316 17:14:20.734138 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-db-create-g7qpg" event={"ID":"f3c221d1-880b-4ee9-aee6-b256334793c9","Type":"ContainerDied","Data":"eb0a60a2ecaf0b1d090dcf1428e71aa9d8ed1e00bae9b1b484be4eba24135120"} Mar 16 17:14:20 crc kubenswrapper[5120]: I0316 17:14:20.734166 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="eb0a60a2ecaf0b1d090dcf1428e71aa9d8ed1e00bae9b1b484be4eba24135120" Mar 16 17:14:20 crc kubenswrapper[5120]: I0316 17:14:20.734176 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-eb52-account-create-update-rkbs2" event={"ID":"6ede1efb-38ea-42e1-87b9-fd608faec542","Type":"ContainerDied","Data":"a560aa14a27e3540cbd6a96b3240ba08c3d75e51768227911bfaa0e246161d02"} Mar 16 17:14:20 crc kubenswrapper[5120]: I0316 17:14:20.734186 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a560aa14a27e3540cbd6a96b3240ba08c3d75e51768227911bfaa0e246161d02" Mar 16 17:14:20 crc kubenswrapper[5120]: I0316 17:14:20.734195 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-645b-account-create-update-lgc2j" event={"ID":"87effe7f-90d5-4885-aa36-77b807c0057e","Type":"ContainerDied","Data":"1c37d15f6025786f50ca8edd80dadd3d6d43e0416c02d5378f38a5fab06a075c"} Mar 16 17:14:20 crc kubenswrapper[5120]: I0316 17:14:20.734205 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1c37d15f6025786f50ca8edd80dadd3d6d43e0416c02d5378f38a5fab06a075c" Mar 16 17:14:20 crc kubenswrapper[5120]: I0316 17:14:20.734224 5120 scope.go:117] "RemoveContainer" containerID="96165a2d847ec7587a1c221b258473f64e660e2d48830e90eded046360c68adf" Mar 16 17:14:20 crc kubenswrapper[5120]: I0316 17:14:20.758851 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/afbb203b-f5f2-4850-83de-e37987e383c9-ovndb-tls-certs" (OuterVolumeSpecName: "ovndb-tls-certs") pod "afbb203b-f5f2-4850-83de-e37987e383c9" (UID: "afbb203b-f5f2-4850-83de-e37987e383c9"). InnerVolumeSpecName "ovndb-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:14:20 crc kubenswrapper[5120]: I0316 17:14:20.767458 5120 scope.go:117] "RemoveContainer" containerID="e05a433f16dc8224732a75f21bd8552a793c5d7cf2cf319ee8c5d76a5a380f34" Mar 16 17:14:20 crc kubenswrapper[5120]: I0316 17:14:20.792281 5120 scope.go:117] "RemoveContainer" containerID="96165a2d847ec7587a1c221b258473f64e660e2d48830e90eded046360c68adf" Mar 16 17:14:20 crc kubenswrapper[5120]: E0316 17:14:20.792612 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"96165a2d847ec7587a1c221b258473f64e660e2d48830e90eded046360c68adf\": container with ID starting with 96165a2d847ec7587a1c221b258473f64e660e2d48830e90eded046360c68adf not found: ID does not exist" containerID="96165a2d847ec7587a1c221b258473f64e660e2d48830e90eded046360c68adf" Mar 16 17:14:20 crc kubenswrapper[5120]: I0316 17:14:20.792638 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96165a2d847ec7587a1c221b258473f64e660e2d48830e90eded046360c68adf"} err="failed to get container status \"96165a2d847ec7587a1c221b258473f64e660e2d48830e90eded046360c68adf\": rpc error: code = NotFound desc = could not find container \"96165a2d847ec7587a1c221b258473f64e660e2d48830e90eded046360c68adf\": container with ID starting with 96165a2d847ec7587a1c221b258473f64e660e2d48830e90eded046360c68adf not found: ID does not exist" Mar 16 17:14:20 crc kubenswrapper[5120]: I0316 17:14:20.792658 5120 scope.go:117] "RemoveContainer" containerID="e05a433f16dc8224732a75f21bd8552a793c5d7cf2cf319ee8c5d76a5a380f34" Mar 16 17:14:20 crc kubenswrapper[5120]: E0316 17:14:20.793060 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e05a433f16dc8224732a75f21bd8552a793c5d7cf2cf319ee8c5d76a5a380f34\": container with ID starting with e05a433f16dc8224732a75f21bd8552a793c5d7cf2cf319ee8c5d76a5a380f34 not found: ID does not exist" containerID="e05a433f16dc8224732a75f21bd8552a793c5d7cf2cf319ee8c5d76a5a380f34" Mar 16 17:14:20 crc kubenswrapper[5120]: I0316 17:14:20.793084 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e05a433f16dc8224732a75f21bd8552a793c5d7cf2cf319ee8c5d76a5a380f34"} err="failed to get container status \"e05a433f16dc8224732a75f21bd8552a793c5d7cf2cf319ee8c5d76a5a380f34\": rpc error: code = NotFound desc = could not find container \"e05a433f16dc8224732a75f21bd8552a793c5d7cf2cf319ee8c5d76a5a380f34\": container with ID starting with e05a433f16dc8224732a75f21bd8552a793c5d7cf2cf319ee8c5d76a5a380f34 not found: ID does not exist" Mar 16 17:14:20 crc kubenswrapper[5120]: I0316 17:14:20.823461 5120 reconciler_common.go:299] "Volume detached for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/afbb203b-f5f2-4850-83de-e37987e383c9-ovndb-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:14:21 crc kubenswrapper[5120]: I0316 17:14:21.000393 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-7d8bb7fd99-qr5kw"] Mar 16 17:14:21 crc kubenswrapper[5120]: I0316 17:14:21.009219 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-7d8bb7fd99-qr5kw"] Mar 16 17:14:21 crc kubenswrapper[5120]: I0316 17:14:21.694590 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7c99a61d-0e3f-4dcd-a6bb-54f5a28697a4","Type":"ContainerStarted","Data":"afa4657b18227ebb6aae69cd475321ce0c7cefd096b6ecf5939e28059dcf4554"} Mar 16 17:14:21 crc kubenswrapper[5120]: I0316 17:14:21.694922 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:14:21 crc kubenswrapper[5120]: I0316 17:14:21.731711 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=1.6772008280000001 podStartE2EDuration="7.731689694s" podCreationTimestamp="2026-03-16 17:14:14 +0000 UTC" firstStartedPulling="2026-03-16 17:14:15.343267972 +0000 UTC m=+6157.497199629" lastFinishedPulling="2026-03-16 17:14:21.397756838 +0000 UTC m=+6163.551688495" observedRunningTime="2026-03-16 17:14:21.716451317 +0000 UTC m=+6163.870382974" watchObservedRunningTime="2026-03-16 17:14:21.731689694 +0000 UTC m=+6163.885621351" Mar 16 17:14:21 crc kubenswrapper[5120]: I0316 17:14:21.839906 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-dkgmb"] Mar 16 17:14:21 crc kubenswrapper[5120]: I0316 17:14:21.842104 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98cc37e9-8b48-4455-9254-4d83ccdc12e9" containerName="mariadb-database-create" Mar 16 17:14:21 crc kubenswrapper[5120]: I0316 17:14:21.842134 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="98cc37e9-8b48-4455-9254-4d83ccdc12e9" containerName="mariadb-database-create" Mar 16 17:14:21 crc kubenswrapper[5120]: I0316 17:14:21.842186 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="afbb203b-f5f2-4850-83de-e37987e383c9" containerName="neutron-api" Mar 16 17:14:21 crc kubenswrapper[5120]: I0316 17:14:21.842194 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="afbb203b-f5f2-4850-83de-e37987e383c9" containerName="neutron-api" Mar 16 17:14:21 crc kubenswrapper[5120]: I0316 17:14:21.842235 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02abd7be-4fc2-4452-9ab1-ca63cc1881b8" containerName="mariadb-database-create" Mar 16 17:14:21 crc kubenswrapper[5120]: I0316 17:14:21.842245 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="02abd7be-4fc2-4452-9ab1-ca63cc1881b8" containerName="mariadb-database-create" Mar 16 17:14:21 crc kubenswrapper[5120]: I0316 17:14:21.842255 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69aeb71a-453a-4d4f-bdd2-3e0541c12060" containerName="mariadb-account-create-update" Mar 16 17:14:21 crc kubenswrapper[5120]: I0316 17:14:21.842263 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="69aeb71a-453a-4d4f-bdd2-3e0541c12060" containerName="mariadb-account-create-update" Mar 16 17:14:21 crc kubenswrapper[5120]: I0316 17:14:21.842289 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ede1efb-38ea-42e1-87b9-fd608faec542" containerName="mariadb-account-create-update" Mar 16 17:14:21 crc kubenswrapper[5120]: I0316 17:14:21.842296 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ede1efb-38ea-42e1-87b9-fd608faec542" containerName="mariadb-account-create-update" Mar 16 17:14:21 crc kubenswrapper[5120]: I0316 17:14:21.842377 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="afbb203b-f5f2-4850-83de-e37987e383c9" containerName="neutron-httpd" Mar 16 17:14:21 crc kubenswrapper[5120]: I0316 17:14:21.842387 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="afbb203b-f5f2-4850-83de-e37987e383c9" containerName="neutron-httpd" Mar 16 17:14:21 crc kubenswrapper[5120]: I0316 17:14:21.842398 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87effe7f-90d5-4885-aa36-77b807c0057e" containerName="mariadb-account-create-update" Mar 16 17:14:21 crc kubenswrapper[5120]: I0316 17:14:21.842406 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="87effe7f-90d5-4885-aa36-77b807c0057e" containerName="mariadb-account-create-update" Mar 16 17:14:21 crc kubenswrapper[5120]: I0316 17:14:21.842484 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3c221d1-880b-4ee9-aee6-b256334793c9" containerName="mariadb-database-create" Mar 16 17:14:21 crc kubenswrapper[5120]: I0316 17:14:21.842890 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3c221d1-880b-4ee9-aee6-b256334793c9" containerName="mariadb-database-create" Mar 16 17:14:21 crc kubenswrapper[5120]: I0316 17:14:21.846861 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="02abd7be-4fc2-4452-9ab1-ca63cc1881b8" containerName="mariadb-database-create" Mar 16 17:14:21 crc kubenswrapper[5120]: I0316 17:14:21.846915 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="afbb203b-f5f2-4850-83de-e37987e383c9" containerName="neutron-api" Mar 16 17:14:21 crc kubenswrapper[5120]: I0316 17:14:21.846953 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f3c221d1-880b-4ee9-aee6-b256334793c9" containerName="mariadb-database-create" Mar 16 17:14:21 crc kubenswrapper[5120]: I0316 17:14:21.846972 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="afbb203b-f5f2-4850-83de-e37987e383c9" containerName="neutron-httpd" Mar 16 17:14:21 crc kubenswrapper[5120]: I0316 17:14:21.846989 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="69aeb71a-453a-4d4f-bdd2-3e0541c12060" containerName="mariadb-account-create-update" Mar 16 17:14:21 crc kubenswrapper[5120]: I0316 17:14:21.847014 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="87effe7f-90d5-4885-aa36-77b807c0057e" containerName="mariadb-account-create-update" Mar 16 17:14:21 crc kubenswrapper[5120]: I0316 17:14:21.847031 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="6ede1efb-38ea-42e1-87b9-fd608faec542" containerName="mariadb-account-create-update" Mar 16 17:14:21 crc kubenswrapper[5120]: I0316 17:14:21.847054 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="98cc37e9-8b48-4455-9254-4d83ccdc12e9" containerName="mariadb-database-create" Mar 16 17:14:21 crc kubenswrapper[5120]: I0316 17:14:21.863253 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-dkgmb" Mar 16 17:14:21 crc kubenswrapper[5120]: I0316 17:14:21.882460 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-nova-dockercfg-xwfdb\"" Mar 16 17:14:21 crc kubenswrapper[5120]: I0316 17:14:21.882662 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-conductor-scripts\"" Mar 16 17:14:21 crc kubenswrapper[5120]: I0316 17:14:21.883278 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-conductor-config-data\"" Mar 16 17:14:21 crc kubenswrapper[5120]: I0316 17:14:21.919867 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-dkgmb"] Mar 16 17:14:21 crc kubenswrapper[5120]: I0316 17:14:21.975390 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f0ed456c-3662-445f-b52b-d39cec513aa8-scripts\") pod \"nova-cell0-conductor-db-sync-dkgmb\" (UID: \"f0ed456c-3662-445f-b52b-d39cec513aa8\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-dkgmb" Mar 16 17:14:21 crc kubenswrapper[5120]: I0316 17:14:21.975482 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f0ed456c-3662-445f-b52b-d39cec513aa8-combined-ca-bundle\") pod \"nova-cell0-conductor-db-sync-dkgmb\" (UID: \"f0ed456c-3662-445f-b52b-d39cec513aa8\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-dkgmb" Mar 16 17:14:21 crc kubenswrapper[5120]: I0316 17:14:21.975704 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f0ed456c-3662-445f-b52b-d39cec513aa8-config-data\") pod \"nova-cell0-conductor-db-sync-dkgmb\" (UID: \"f0ed456c-3662-445f-b52b-d39cec513aa8\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-dkgmb" Mar 16 17:14:21 crc kubenswrapper[5120]: I0316 17:14:21.975820 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5x74\" (UniqueName: \"kubernetes.io/projected/f0ed456c-3662-445f-b52b-d39cec513aa8-kube-api-access-s5x74\") pod \"nova-cell0-conductor-db-sync-dkgmb\" (UID: \"f0ed456c-3662-445f-b52b-d39cec513aa8\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-dkgmb" Mar 16 17:14:22 crc kubenswrapper[5120]: I0316 17:14:22.007727 5120 patch_prober.go:28] interesting pod/machine-config-daemon-7bf76 container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 17:14:22 crc kubenswrapper[5120]: I0316 17:14:22.007845 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 17:14:22 crc kubenswrapper[5120]: I0316 17:14:22.007914 5120 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" Mar 16 17:14:22 crc kubenswrapper[5120]: I0316 17:14:22.008602 5120 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="machine-config-daemon" containerStatusID={"Type":"cri-o","ID":"75af251dd73a707ee66fa6a54cb0e7f3eed778d6679b855c53a50383854df1bd"} pod="openshift-machine-config-operator/machine-config-daemon-7bf76" containerMessage="Container machine-config-daemon failed liveness probe, will be restarted" Mar 16 17:14:22 crc kubenswrapper[5120]: I0316 17:14:22.008661 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" containerID="cri-o://75af251dd73a707ee66fa6a54cb0e7f3eed778d6679b855c53a50383854df1bd" gracePeriod=600 Mar 16 17:14:22 crc kubenswrapper[5120]: I0316 17:14:22.078631 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f0ed456c-3662-445f-b52b-d39cec513aa8-combined-ca-bundle\") pod \"nova-cell0-conductor-db-sync-dkgmb\" (UID: \"f0ed456c-3662-445f-b52b-d39cec513aa8\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-dkgmb" Mar 16 17:14:22 crc kubenswrapper[5120]: I0316 17:14:22.079340 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f0ed456c-3662-445f-b52b-d39cec513aa8-config-data\") pod \"nova-cell0-conductor-db-sync-dkgmb\" (UID: \"f0ed456c-3662-445f-b52b-d39cec513aa8\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-dkgmb" Mar 16 17:14:22 crc kubenswrapper[5120]: I0316 17:14:22.079498 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s5x74\" (UniqueName: \"kubernetes.io/projected/f0ed456c-3662-445f-b52b-d39cec513aa8-kube-api-access-s5x74\") pod \"nova-cell0-conductor-db-sync-dkgmb\" (UID: \"f0ed456c-3662-445f-b52b-d39cec513aa8\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-dkgmb" Mar 16 17:14:22 crc kubenswrapper[5120]: I0316 17:14:22.079807 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f0ed456c-3662-445f-b52b-d39cec513aa8-scripts\") pod \"nova-cell0-conductor-db-sync-dkgmb\" (UID: \"f0ed456c-3662-445f-b52b-d39cec513aa8\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-dkgmb" Mar 16 17:14:22 crc kubenswrapper[5120]: I0316 17:14:22.085522 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f0ed456c-3662-445f-b52b-d39cec513aa8-config-data\") pod \"nova-cell0-conductor-db-sync-dkgmb\" (UID: \"f0ed456c-3662-445f-b52b-d39cec513aa8\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-dkgmb" Mar 16 17:14:22 crc kubenswrapper[5120]: I0316 17:14:22.090718 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f0ed456c-3662-445f-b52b-d39cec513aa8-scripts\") pod \"nova-cell0-conductor-db-sync-dkgmb\" (UID: \"f0ed456c-3662-445f-b52b-d39cec513aa8\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-dkgmb" Mar 16 17:14:22 crc kubenswrapper[5120]: I0316 17:14:22.093512 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f0ed456c-3662-445f-b52b-d39cec513aa8-combined-ca-bundle\") pod \"nova-cell0-conductor-db-sync-dkgmb\" (UID: \"f0ed456c-3662-445f-b52b-d39cec513aa8\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-dkgmb" Mar 16 17:14:22 crc kubenswrapper[5120]: I0316 17:14:22.099847 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5x74\" (UniqueName: \"kubernetes.io/projected/f0ed456c-3662-445f-b52b-d39cec513aa8-kube-api-access-s5x74\") pod \"nova-cell0-conductor-db-sync-dkgmb\" (UID: \"f0ed456c-3662-445f-b52b-d39cec513aa8\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-dkgmb" Mar 16 17:14:22 crc kubenswrapper[5120]: I0316 17:14:22.197063 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-dkgmb" Mar 16 17:14:22 crc kubenswrapper[5120]: I0316 17:14:22.282484 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:14:22 crc kubenswrapper[5120]: W0316 17:14:22.673486 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf0ed456c_3662_445f_b52b_d39cec513aa8.slice/crio-374e206b19da2b674132d2a433cb838f4a98c8ed5eccf0093adad5129a09e1e0 WatchSource:0}: Error finding container 374e206b19da2b674132d2a433cb838f4a98c8ed5eccf0093adad5129a09e1e0: Status 404 returned error can't find the container with id 374e206b19da2b674132d2a433cb838f4a98c8ed5eccf0093adad5129a09e1e0 Mar 16 17:14:22 crc kubenswrapper[5120]: I0316 17:14:22.681602 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="afbb203b-f5f2-4850-83de-e37987e383c9" path="/var/lib/kubelet/pods/afbb203b-f5f2-4850-83de-e37987e383c9/volumes" Mar 16 17:14:22 crc kubenswrapper[5120]: I0316 17:14:22.682272 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-dkgmb"] Mar 16 17:14:22 crc kubenswrapper[5120]: I0316 17:14:22.722719 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-dkgmb" event={"ID":"f0ed456c-3662-445f-b52b-d39cec513aa8","Type":"ContainerStarted","Data":"374e206b19da2b674132d2a433cb838f4a98c8ed5eccf0093adad5129a09e1e0"} Mar 16 17:14:22 crc kubenswrapper[5120]: I0316 17:14:22.728193 5120 generic.go:358] "Generic (PLEG): container finished" podID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerID="75af251dd73a707ee66fa6a54cb0e7f3eed778d6679b855c53a50383854df1bd" exitCode=0 Mar 16 17:14:22 crc kubenswrapper[5120]: I0316 17:14:22.728979 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" event={"ID":"e2275cb4-4905-4d66-a87e-8010120db2bd","Type":"ContainerDied","Data":"75af251dd73a707ee66fa6a54cb0e7f3eed778d6679b855c53a50383854df1bd"} Mar 16 17:14:22 crc kubenswrapper[5120]: I0316 17:14:22.729066 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" event={"ID":"e2275cb4-4905-4d66-a87e-8010120db2bd","Type":"ContainerStarted","Data":"2ca61165dca6fdb30458423ef74c44c42b1b273e8fa504e89f5f9e186e516cc3"} Mar 16 17:14:22 crc kubenswrapper[5120]: I0316 17:14:22.729109 5120 scope.go:117] "RemoveContainer" containerID="db39d192fa687a13805537d08ad22fed1ef362ef5027c920a616297dc55a8ea9" Mar 16 17:14:23 crc kubenswrapper[5120]: I0316 17:14:23.739971 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-dkgmb" event={"ID":"f0ed456c-3662-445f-b52b-d39cec513aa8","Type":"ContainerStarted","Data":"fb67d148059bfc4eacc0403df2280ae59beca37b8486e74770730596695c5a9c"} Mar 16 17:14:23 crc kubenswrapper[5120]: I0316 17:14:23.748570 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="7c99a61d-0e3f-4dcd-a6bb-54f5a28697a4" containerName="ceilometer-central-agent" containerID="cri-o://a6f13758e529b43d0ea3275a928bb35c5d5b4b38e699e4aaf031706c63dbc8ad" gracePeriod=30 Mar 16 17:14:23 crc kubenswrapper[5120]: I0316 17:14:23.748963 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="7c99a61d-0e3f-4dcd-a6bb-54f5a28697a4" containerName="proxy-httpd" containerID="cri-o://afa4657b18227ebb6aae69cd475321ce0c7cefd096b6ecf5939e28059dcf4554" gracePeriod=30 Mar 16 17:14:23 crc kubenswrapper[5120]: I0316 17:14:23.749043 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="7c99a61d-0e3f-4dcd-a6bb-54f5a28697a4" containerName="sg-core" containerID="cri-o://93c9edec0a49b72430e28f78af13dc7a2990d543fa1813f71727d81d5b7800a6" gracePeriod=30 Mar 16 17:14:23 crc kubenswrapper[5120]: I0316 17:14:23.749086 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="7c99a61d-0e3f-4dcd-a6bb-54f5a28697a4" containerName="ceilometer-notification-agent" containerID="cri-o://4f4269a9f15d7023d975614200d98a20f522c5b88d249bb93279596ce8a3984d" gracePeriod=30 Mar 16 17:14:23 crc kubenswrapper[5120]: I0316 17:14:23.764215 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-dkgmb" podStartSLOduration=2.764192782 podStartE2EDuration="2.764192782s" podCreationTimestamp="2026-03-16 17:14:21 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:14:23.758377833 +0000 UTC m=+6165.912309490" watchObservedRunningTime="2026-03-16 17:14:23.764192782 +0000 UTC m=+6165.918124439" Mar 16 17:14:24 crc kubenswrapper[5120]: I0316 17:14:24.642530 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:14:24 crc kubenswrapper[5120]: I0316 17:14:24.758620 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7c99a61d-0e3f-4dcd-a6bb-54f5a28697a4-combined-ca-bundle\") pod \"7c99a61d-0e3f-4dcd-a6bb-54f5a28697a4\" (UID: \"7c99a61d-0e3f-4dcd-a6bb-54f5a28697a4\") " Mar 16 17:14:24 crc kubenswrapper[5120]: I0316 17:14:24.758697 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/7c99a61d-0e3f-4dcd-a6bb-54f5a28697a4-sg-core-conf-yaml\") pod \"7c99a61d-0e3f-4dcd-a6bb-54f5a28697a4\" (UID: \"7c99a61d-0e3f-4dcd-a6bb-54f5a28697a4\") " Mar 16 17:14:24 crc kubenswrapper[5120]: I0316 17:14:24.758924 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7c99a61d-0e3f-4dcd-a6bb-54f5a28697a4-run-httpd\") pod \"7c99a61d-0e3f-4dcd-a6bb-54f5a28697a4\" (UID: \"7c99a61d-0e3f-4dcd-a6bb-54f5a28697a4\") " Mar 16 17:14:24 crc kubenswrapper[5120]: I0316 17:14:24.758945 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7c99a61d-0e3f-4dcd-a6bb-54f5a28697a4-config-data\") pod \"7c99a61d-0e3f-4dcd-a6bb-54f5a28697a4\" (UID: \"7c99a61d-0e3f-4dcd-a6bb-54f5a28697a4\") " Mar 16 17:14:24 crc kubenswrapper[5120]: I0316 17:14:24.759422 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c99a61d-0e3f-4dcd-a6bb-54f5a28697a4-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "7c99a61d-0e3f-4dcd-a6bb-54f5a28697a4" (UID: "7c99a61d-0e3f-4dcd-a6bb-54f5a28697a4"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:14:24 crc kubenswrapper[5120]: I0316 17:14:24.759491 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w294l\" (UniqueName: \"kubernetes.io/projected/7c99a61d-0e3f-4dcd-a6bb-54f5a28697a4-kube-api-access-w294l\") pod \"7c99a61d-0e3f-4dcd-a6bb-54f5a28697a4\" (UID: \"7c99a61d-0e3f-4dcd-a6bb-54f5a28697a4\") " Mar 16 17:14:24 crc kubenswrapper[5120]: I0316 17:14:24.759667 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7c99a61d-0e3f-4dcd-a6bb-54f5a28697a4-scripts\") pod \"7c99a61d-0e3f-4dcd-a6bb-54f5a28697a4\" (UID: \"7c99a61d-0e3f-4dcd-a6bb-54f5a28697a4\") " Mar 16 17:14:24 crc kubenswrapper[5120]: I0316 17:14:24.759852 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7c99a61d-0e3f-4dcd-a6bb-54f5a28697a4-log-httpd\") pod \"7c99a61d-0e3f-4dcd-a6bb-54f5a28697a4\" (UID: \"7c99a61d-0e3f-4dcd-a6bb-54f5a28697a4\") " Mar 16 17:14:24 crc kubenswrapper[5120]: I0316 17:14:24.761438 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c99a61d-0e3f-4dcd-a6bb-54f5a28697a4-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "7c99a61d-0e3f-4dcd-a6bb-54f5a28697a4" (UID: "7c99a61d-0e3f-4dcd-a6bb-54f5a28697a4"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:14:24 crc kubenswrapper[5120]: I0316 17:14:24.762132 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7c99a61d-0e3f-4dcd-a6bb-54f5a28697a4-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 17:14:24 crc kubenswrapper[5120]: I0316 17:14:24.762151 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7c99a61d-0e3f-4dcd-a6bb-54f5a28697a4-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 17:14:24 crc kubenswrapper[5120]: I0316 17:14:24.767482 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c99a61d-0e3f-4dcd-a6bb-54f5a28697a4-scripts" (OuterVolumeSpecName: "scripts") pod "7c99a61d-0e3f-4dcd-a6bb-54f5a28697a4" (UID: "7c99a61d-0e3f-4dcd-a6bb-54f5a28697a4"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:14:24 crc kubenswrapper[5120]: I0316 17:14:24.769290 5120 generic.go:358] "Generic (PLEG): container finished" podID="7c99a61d-0e3f-4dcd-a6bb-54f5a28697a4" containerID="afa4657b18227ebb6aae69cd475321ce0c7cefd096b6ecf5939e28059dcf4554" exitCode=0 Mar 16 17:14:24 crc kubenswrapper[5120]: I0316 17:14:24.769308 5120 generic.go:358] "Generic (PLEG): container finished" podID="7c99a61d-0e3f-4dcd-a6bb-54f5a28697a4" containerID="93c9edec0a49b72430e28f78af13dc7a2990d543fa1813f71727d81d5b7800a6" exitCode=2 Mar 16 17:14:24 crc kubenswrapper[5120]: I0316 17:14:24.769316 5120 generic.go:358] "Generic (PLEG): container finished" podID="7c99a61d-0e3f-4dcd-a6bb-54f5a28697a4" containerID="4f4269a9f15d7023d975614200d98a20f522c5b88d249bb93279596ce8a3984d" exitCode=0 Mar 16 17:14:24 crc kubenswrapper[5120]: I0316 17:14:24.769323 5120 generic.go:358] "Generic (PLEG): container finished" podID="7c99a61d-0e3f-4dcd-a6bb-54f5a28697a4" containerID="a6f13758e529b43d0ea3275a928bb35c5d5b4b38e699e4aaf031706c63dbc8ad" exitCode=0 Mar 16 17:14:24 crc kubenswrapper[5120]: I0316 17:14:24.770603 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:14:24 crc kubenswrapper[5120]: I0316 17:14:24.770831 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7c99a61d-0e3f-4dcd-a6bb-54f5a28697a4","Type":"ContainerDied","Data":"afa4657b18227ebb6aae69cd475321ce0c7cefd096b6ecf5939e28059dcf4554"} Mar 16 17:14:24 crc kubenswrapper[5120]: I0316 17:14:24.770885 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7c99a61d-0e3f-4dcd-a6bb-54f5a28697a4","Type":"ContainerDied","Data":"93c9edec0a49b72430e28f78af13dc7a2990d543fa1813f71727d81d5b7800a6"} Mar 16 17:14:24 crc kubenswrapper[5120]: I0316 17:14:24.770896 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7c99a61d-0e3f-4dcd-a6bb-54f5a28697a4","Type":"ContainerDied","Data":"4f4269a9f15d7023d975614200d98a20f522c5b88d249bb93279596ce8a3984d"} Mar 16 17:14:24 crc kubenswrapper[5120]: I0316 17:14:24.770905 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7c99a61d-0e3f-4dcd-a6bb-54f5a28697a4","Type":"ContainerDied","Data":"a6f13758e529b43d0ea3275a928bb35c5d5b4b38e699e4aaf031706c63dbc8ad"} Mar 16 17:14:24 crc kubenswrapper[5120]: I0316 17:14:24.770917 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7c99a61d-0e3f-4dcd-a6bb-54f5a28697a4","Type":"ContainerDied","Data":"e16fe475d920420279e95b47322e0b5531715ae19ca4953635b31d5a2414231e"} Mar 16 17:14:24 crc kubenswrapper[5120]: I0316 17:14:24.770935 5120 scope.go:117] "RemoveContainer" containerID="afa4657b18227ebb6aae69cd475321ce0c7cefd096b6ecf5939e28059dcf4554" Mar 16 17:14:24 crc kubenswrapper[5120]: I0316 17:14:24.796402 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c99a61d-0e3f-4dcd-a6bb-54f5a28697a4-kube-api-access-w294l" (OuterVolumeSpecName: "kube-api-access-w294l") pod "7c99a61d-0e3f-4dcd-a6bb-54f5a28697a4" (UID: "7c99a61d-0e3f-4dcd-a6bb-54f5a28697a4"). InnerVolumeSpecName "kube-api-access-w294l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:14:24 crc kubenswrapper[5120]: I0316 17:14:24.837840 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c99a61d-0e3f-4dcd-a6bb-54f5a28697a4-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "7c99a61d-0e3f-4dcd-a6bb-54f5a28697a4" (UID: "7c99a61d-0e3f-4dcd-a6bb-54f5a28697a4"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:14:24 crc kubenswrapper[5120]: I0316 17:14:24.861174 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c99a61d-0e3f-4dcd-a6bb-54f5a28697a4-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "7c99a61d-0e3f-4dcd-a6bb-54f5a28697a4" (UID: "7c99a61d-0e3f-4dcd-a6bb-54f5a28697a4"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:14:24 crc kubenswrapper[5120]: I0316 17:14:24.865142 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w294l\" (UniqueName: \"kubernetes.io/projected/7c99a61d-0e3f-4dcd-a6bb-54f5a28697a4-kube-api-access-w294l\") on node \"crc\" DevicePath \"\"" Mar 16 17:14:24 crc kubenswrapper[5120]: I0316 17:14:24.865177 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7c99a61d-0e3f-4dcd-a6bb-54f5a28697a4-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:14:24 crc kubenswrapper[5120]: I0316 17:14:24.865187 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7c99a61d-0e3f-4dcd-a6bb-54f5a28697a4-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:14:24 crc kubenswrapper[5120]: I0316 17:14:24.865196 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/7c99a61d-0e3f-4dcd-a6bb-54f5a28697a4-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 17:14:24 crc kubenswrapper[5120]: I0316 17:14:24.894058 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c99a61d-0e3f-4dcd-a6bb-54f5a28697a4-config-data" (OuterVolumeSpecName: "config-data") pod "7c99a61d-0e3f-4dcd-a6bb-54f5a28697a4" (UID: "7c99a61d-0e3f-4dcd-a6bb-54f5a28697a4"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:14:24 crc kubenswrapper[5120]: I0316 17:14:24.896044 5120 scope.go:117] "RemoveContainer" containerID="93c9edec0a49b72430e28f78af13dc7a2990d543fa1813f71727d81d5b7800a6" Mar 16 17:14:24 crc kubenswrapper[5120]: I0316 17:14:24.922630 5120 scope.go:117] "RemoveContainer" containerID="4f4269a9f15d7023d975614200d98a20f522c5b88d249bb93279596ce8a3984d" Mar 16 17:14:24 crc kubenswrapper[5120]: I0316 17:14:24.947887 5120 scope.go:117] "RemoveContainer" containerID="a6f13758e529b43d0ea3275a928bb35c5d5b4b38e699e4aaf031706c63dbc8ad" Mar 16 17:14:24 crc kubenswrapper[5120]: I0316 17:14:24.970922 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7c99a61d-0e3f-4dcd-a6bb-54f5a28697a4-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:14:24 crc kubenswrapper[5120]: I0316 17:14:24.979644 5120 scope.go:117] "RemoveContainer" containerID="afa4657b18227ebb6aae69cd475321ce0c7cefd096b6ecf5939e28059dcf4554" Mar 16 17:14:24 crc kubenswrapper[5120]: E0316 17:14:24.980052 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"afa4657b18227ebb6aae69cd475321ce0c7cefd096b6ecf5939e28059dcf4554\": container with ID starting with afa4657b18227ebb6aae69cd475321ce0c7cefd096b6ecf5939e28059dcf4554 not found: ID does not exist" containerID="afa4657b18227ebb6aae69cd475321ce0c7cefd096b6ecf5939e28059dcf4554" Mar 16 17:14:24 crc kubenswrapper[5120]: I0316 17:14:24.980093 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"afa4657b18227ebb6aae69cd475321ce0c7cefd096b6ecf5939e28059dcf4554"} err="failed to get container status \"afa4657b18227ebb6aae69cd475321ce0c7cefd096b6ecf5939e28059dcf4554\": rpc error: code = NotFound desc = could not find container \"afa4657b18227ebb6aae69cd475321ce0c7cefd096b6ecf5939e28059dcf4554\": container with ID starting with afa4657b18227ebb6aae69cd475321ce0c7cefd096b6ecf5939e28059dcf4554 not found: ID does not exist" Mar 16 17:14:24 crc kubenswrapper[5120]: I0316 17:14:24.980117 5120 scope.go:117] "RemoveContainer" containerID="93c9edec0a49b72430e28f78af13dc7a2990d543fa1813f71727d81d5b7800a6" Mar 16 17:14:24 crc kubenswrapper[5120]: E0316 17:14:24.980615 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93c9edec0a49b72430e28f78af13dc7a2990d543fa1813f71727d81d5b7800a6\": container with ID starting with 93c9edec0a49b72430e28f78af13dc7a2990d543fa1813f71727d81d5b7800a6 not found: ID does not exist" containerID="93c9edec0a49b72430e28f78af13dc7a2990d543fa1813f71727d81d5b7800a6" Mar 16 17:14:24 crc kubenswrapper[5120]: I0316 17:14:24.980667 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93c9edec0a49b72430e28f78af13dc7a2990d543fa1813f71727d81d5b7800a6"} err="failed to get container status \"93c9edec0a49b72430e28f78af13dc7a2990d543fa1813f71727d81d5b7800a6\": rpc error: code = NotFound desc = could not find container \"93c9edec0a49b72430e28f78af13dc7a2990d543fa1813f71727d81d5b7800a6\": container with ID starting with 93c9edec0a49b72430e28f78af13dc7a2990d543fa1813f71727d81d5b7800a6 not found: ID does not exist" Mar 16 17:14:24 crc kubenswrapper[5120]: I0316 17:14:24.980697 5120 scope.go:117] "RemoveContainer" containerID="4f4269a9f15d7023d975614200d98a20f522c5b88d249bb93279596ce8a3984d" Mar 16 17:14:24 crc kubenswrapper[5120]: E0316 17:14:24.981031 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f4269a9f15d7023d975614200d98a20f522c5b88d249bb93279596ce8a3984d\": container with ID starting with 4f4269a9f15d7023d975614200d98a20f522c5b88d249bb93279596ce8a3984d not found: ID does not exist" containerID="4f4269a9f15d7023d975614200d98a20f522c5b88d249bb93279596ce8a3984d" Mar 16 17:14:24 crc kubenswrapper[5120]: I0316 17:14:24.981066 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f4269a9f15d7023d975614200d98a20f522c5b88d249bb93279596ce8a3984d"} err="failed to get container status \"4f4269a9f15d7023d975614200d98a20f522c5b88d249bb93279596ce8a3984d\": rpc error: code = NotFound desc = could not find container \"4f4269a9f15d7023d975614200d98a20f522c5b88d249bb93279596ce8a3984d\": container with ID starting with 4f4269a9f15d7023d975614200d98a20f522c5b88d249bb93279596ce8a3984d not found: ID does not exist" Mar 16 17:14:24 crc kubenswrapper[5120]: I0316 17:14:24.981092 5120 scope.go:117] "RemoveContainer" containerID="a6f13758e529b43d0ea3275a928bb35c5d5b4b38e699e4aaf031706c63dbc8ad" Mar 16 17:14:24 crc kubenswrapper[5120]: E0316 17:14:24.981308 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a6f13758e529b43d0ea3275a928bb35c5d5b4b38e699e4aaf031706c63dbc8ad\": container with ID starting with a6f13758e529b43d0ea3275a928bb35c5d5b4b38e699e4aaf031706c63dbc8ad not found: ID does not exist" containerID="a6f13758e529b43d0ea3275a928bb35c5d5b4b38e699e4aaf031706c63dbc8ad" Mar 16 17:14:24 crc kubenswrapper[5120]: I0316 17:14:24.981333 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6f13758e529b43d0ea3275a928bb35c5d5b4b38e699e4aaf031706c63dbc8ad"} err="failed to get container status \"a6f13758e529b43d0ea3275a928bb35c5d5b4b38e699e4aaf031706c63dbc8ad\": rpc error: code = NotFound desc = could not find container \"a6f13758e529b43d0ea3275a928bb35c5d5b4b38e699e4aaf031706c63dbc8ad\": container with ID starting with a6f13758e529b43d0ea3275a928bb35c5d5b4b38e699e4aaf031706c63dbc8ad not found: ID does not exist" Mar 16 17:14:24 crc kubenswrapper[5120]: I0316 17:14:24.981372 5120 scope.go:117] "RemoveContainer" containerID="afa4657b18227ebb6aae69cd475321ce0c7cefd096b6ecf5939e28059dcf4554" Mar 16 17:14:24 crc kubenswrapper[5120]: I0316 17:14:24.981616 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"afa4657b18227ebb6aae69cd475321ce0c7cefd096b6ecf5939e28059dcf4554"} err="failed to get container status \"afa4657b18227ebb6aae69cd475321ce0c7cefd096b6ecf5939e28059dcf4554\": rpc error: code = NotFound desc = could not find container \"afa4657b18227ebb6aae69cd475321ce0c7cefd096b6ecf5939e28059dcf4554\": container with ID starting with afa4657b18227ebb6aae69cd475321ce0c7cefd096b6ecf5939e28059dcf4554 not found: ID does not exist" Mar 16 17:14:24 crc kubenswrapper[5120]: I0316 17:14:24.981641 5120 scope.go:117] "RemoveContainer" containerID="93c9edec0a49b72430e28f78af13dc7a2990d543fa1813f71727d81d5b7800a6" Mar 16 17:14:24 crc kubenswrapper[5120]: I0316 17:14:24.981844 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93c9edec0a49b72430e28f78af13dc7a2990d543fa1813f71727d81d5b7800a6"} err="failed to get container status \"93c9edec0a49b72430e28f78af13dc7a2990d543fa1813f71727d81d5b7800a6\": rpc error: code = NotFound desc = could not find container \"93c9edec0a49b72430e28f78af13dc7a2990d543fa1813f71727d81d5b7800a6\": container with ID starting with 93c9edec0a49b72430e28f78af13dc7a2990d543fa1813f71727d81d5b7800a6 not found: ID does not exist" Mar 16 17:14:24 crc kubenswrapper[5120]: I0316 17:14:24.981866 5120 scope.go:117] "RemoveContainer" containerID="4f4269a9f15d7023d975614200d98a20f522c5b88d249bb93279596ce8a3984d" Mar 16 17:14:24 crc kubenswrapper[5120]: I0316 17:14:24.982098 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f4269a9f15d7023d975614200d98a20f522c5b88d249bb93279596ce8a3984d"} err="failed to get container status \"4f4269a9f15d7023d975614200d98a20f522c5b88d249bb93279596ce8a3984d\": rpc error: code = NotFound desc = could not find container \"4f4269a9f15d7023d975614200d98a20f522c5b88d249bb93279596ce8a3984d\": container with ID starting with 4f4269a9f15d7023d975614200d98a20f522c5b88d249bb93279596ce8a3984d not found: ID does not exist" Mar 16 17:14:24 crc kubenswrapper[5120]: I0316 17:14:24.982120 5120 scope.go:117] "RemoveContainer" containerID="a6f13758e529b43d0ea3275a928bb35c5d5b4b38e699e4aaf031706c63dbc8ad" Mar 16 17:14:24 crc kubenswrapper[5120]: I0316 17:14:24.982377 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6f13758e529b43d0ea3275a928bb35c5d5b4b38e699e4aaf031706c63dbc8ad"} err="failed to get container status \"a6f13758e529b43d0ea3275a928bb35c5d5b4b38e699e4aaf031706c63dbc8ad\": rpc error: code = NotFound desc = could not find container \"a6f13758e529b43d0ea3275a928bb35c5d5b4b38e699e4aaf031706c63dbc8ad\": container with ID starting with a6f13758e529b43d0ea3275a928bb35c5d5b4b38e699e4aaf031706c63dbc8ad not found: ID does not exist" Mar 16 17:14:24 crc kubenswrapper[5120]: I0316 17:14:24.982406 5120 scope.go:117] "RemoveContainer" containerID="afa4657b18227ebb6aae69cd475321ce0c7cefd096b6ecf5939e28059dcf4554" Mar 16 17:14:24 crc kubenswrapper[5120]: I0316 17:14:24.982618 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"afa4657b18227ebb6aae69cd475321ce0c7cefd096b6ecf5939e28059dcf4554"} err="failed to get container status \"afa4657b18227ebb6aae69cd475321ce0c7cefd096b6ecf5939e28059dcf4554\": rpc error: code = NotFound desc = could not find container \"afa4657b18227ebb6aae69cd475321ce0c7cefd096b6ecf5939e28059dcf4554\": container with ID starting with afa4657b18227ebb6aae69cd475321ce0c7cefd096b6ecf5939e28059dcf4554 not found: ID does not exist" Mar 16 17:14:24 crc kubenswrapper[5120]: I0316 17:14:24.982646 5120 scope.go:117] "RemoveContainer" containerID="93c9edec0a49b72430e28f78af13dc7a2990d543fa1813f71727d81d5b7800a6" Mar 16 17:14:24 crc kubenswrapper[5120]: I0316 17:14:24.983024 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93c9edec0a49b72430e28f78af13dc7a2990d543fa1813f71727d81d5b7800a6"} err="failed to get container status \"93c9edec0a49b72430e28f78af13dc7a2990d543fa1813f71727d81d5b7800a6\": rpc error: code = NotFound desc = could not find container \"93c9edec0a49b72430e28f78af13dc7a2990d543fa1813f71727d81d5b7800a6\": container with ID starting with 93c9edec0a49b72430e28f78af13dc7a2990d543fa1813f71727d81d5b7800a6 not found: ID does not exist" Mar 16 17:14:24 crc kubenswrapper[5120]: I0316 17:14:24.983049 5120 scope.go:117] "RemoveContainer" containerID="4f4269a9f15d7023d975614200d98a20f522c5b88d249bb93279596ce8a3984d" Mar 16 17:14:24 crc kubenswrapper[5120]: I0316 17:14:24.983515 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f4269a9f15d7023d975614200d98a20f522c5b88d249bb93279596ce8a3984d"} err="failed to get container status \"4f4269a9f15d7023d975614200d98a20f522c5b88d249bb93279596ce8a3984d\": rpc error: code = NotFound desc = could not find container \"4f4269a9f15d7023d975614200d98a20f522c5b88d249bb93279596ce8a3984d\": container with ID starting with 4f4269a9f15d7023d975614200d98a20f522c5b88d249bb93279596ce8a3984d not found: ID does not exist" Mar 16 17:14:24 crc kubenswrapper[5120]: I0316 17:14:24.983537 5120 scope.go:117] "RemoveContainer" containerID="a6f13758e529b43d0ea3275a928bb35c5d5b4b38e699e4aaf031706c63dbc8ad" Mar 16 17:14:24 crc kubenswrapper[5120]: I0316 17:14:24.983915 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6f13758e529b43d0ea3275a928bb35c5d5b4b38e699e4aaf031706c63dbc8ad"} err="failed to get container status \"a6f13758e529b43d0ea3275a928bb35c5d5b4b38e699e4aaf031706c63dbc8ad\": rpc error: code = NotFound desc = could not find container \"a6f13758e529b43d0ea3275a928bb35c5d5b4b38e699e4aaf031706c63dbc8ad\": container with ID starting with a6f13758e529b43d0ea3275a928bb35c5d5b4b38e699e4aaf031706c63dbc8ad not found: ID does not exist" Mar 16 17:14:24 crc kubenswrapper[5120]: I0316 17:14:24.983946 5120 scope.go:117] "RemoveContainer" containerID="afa4657b18227ebb6aae69cd475321ce0c7cefd096b6ecf5939e28059dcf4554" Mar 16 17:14:24 crc kubenswrapper[5120]: I0316 17:14:24.984205 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"afa4657b18227ebb6aae69cd475321ce0c7cefd096b6ecf5939e28059dcf4554"} err="failed to get container status \"afa4657b18227ebb6aae69cd475321ce0c7cefd096b6ecf5939e28059dcf4554\": rpc error: code = NotFound desc = could not find container \"afa4657b18227ebb6aae69cd475321ce0c7cefd096b6ecf5939e28059dcf4554\": container with ID starting with afa4657b18227ebb6aae69cd475321ce0c7cefd096b6ecf5939e28059dcf4554 not found: ID does not exist" Mar 16 17:14:24 crc kubenswrapper[5120]: I0316 17:14:24.984232 5120 scope.go:117] "RemoveContainer" containerID="93c9edec0a49b72430e28f78af13dc7a2990d543fa1813f71727d81d5b7800a6" Mar 16 17:14:24 crc kubenswrapper[5120]: I0316 17:14:24.984540 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93c9edec0a49b72430e28f78af13dc7a2990d543fa1813f71727d81d5b7800a6"} err="failed to get container status \"93c9edec0a49b72430e28f78af13dc7a2990d543fa1813f71727d81d5b7800a6\": rpc error: code = NotFound desc = could not find container \"93c9edec0a49b72430e28f78af13dc7a2990d543fa1813f71727d81d5b7800a6\": container with ID starting with 93c9edec0a49b72430e28f78af13dc7a2990d543fa1813f71727d81d5b7800a6 not found: ID does not exist" Mar 16 17:14:24 crc kubenswrapper[5120]: I0316 17:14:24.984561 5120 scope.go:117] "RemoveContainer" containerID="4f4269a9f15d7023d975614200d98a20f522c5b88d249bb93279596ce8a3984d" Mar 16 17:14:24 crc kubenswrapper[5120]: I0316 17:14:24.984980 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f4269a9f15d7023d975614200d98a20f522c5b88d249bb93279596ce8a3984d"} err="failed to get container status \"4f4269a9f15d7023d975614200d98a20f522c5b88d249bb93279596ce8a3984d\": rpc error: code = NotFound desc = could not find container \"4f4269a9f15d7023d975614200d98a20f522c5b88d249bb93279596ce8a3984d\": container with ID starting with 4f4269a9f15d7023d975614200d98a20f522c5b88d249bb93279596ce8a3984d not found: ID does not exist" Mar 16 17:14:24 crc kubenswrapper[5120]: I0316 17:14:24.985028 5120 scope.go:117] "RemoveContainer" containerID="a6f13758e529b43d0ea3275a928bb35c5d5b4b38e699e4aaf031706c63dbc8ad" Mar 16 17:14:24 crc kubenswrapper[5120]: I0316 17:14:24.985321 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6f13758e529b43d0ea3275a928bb35c5d5b4b38e699e4aaf031706c63dbc8ad"} err="failed to get container status \"a6f13758e529b43d0ea3275a928bb35c5d5b4b38e699e4aaf031706c63dbc8ad\": rpc error: code = NotFound desc = could not find container \"a6f13758e529b43d0ea3275a928bb35c5d5b4b38e699e4aaf031706c63dbc8ad\": container with ID starting with a6f13758e529b43d0ea3275a928bb35c5d5b4b38e699e4aaf031706c63dbc8ad not found: ID does not exist" Mar 16 17:14:25 crc kubenswrapper[5120]: I0316 17:14:25.118616 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:14:25 crc kubenswrapper[5120]: I0316 17:14:25.139813 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:14:25 crc kubenswrapper[5120]: I0316 17:14:25.159582 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:14:25 crc kubenswrapper[5120]: I0316 17:14:25.160599 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c99a61d-0e3f-4dcd-a6bb-54f5a28697a4" containerName="proxy-httpd" Mar 16 17:14:25 crc kubenswrapper[5120]: I0316 17:14:25.160613 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c99a61d-0e3f-4dcd-a6bb-54f5a28697a4" containerName="proxy-httpd" Mar 16 17:14:25 crc kubenswrapper[5120]: I0316 17:14:25.160641 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c99a61d-0e3f-4dcd-a6bb-54f5a28697a4" containerName="ceilometer-central-agent" Mar 16 17:14:25 crc kubenswrapper[5120]: I0316 17:14:25.160648 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c99a61d-0e3f-4dcd-a6bb-54f5a28697a4" containerName="ceilometer-central-agent" Mar 16 17:14:25 crc kubenswrapper[5120]: I0316 17:14:25.160659 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c99a61d-0e3f-4dcd-a6bb-54f5a28697a4" containerName="sg-core" Mar 16 17:14:25 crc kubenswrapper[5120]: I0316 17:14:25.160665 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c99a61d-0e3f-4dcd-a6bb-54f5a28697a4" containerName="sg-core" Mar 16 17:14:25 crc kubenswrapper[5120]: I0316 17:14:25.160703 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c99a61d-0e3f-4dcd-a6bb-54f5a28697a4" containerName="ceilometer-notification-agent" Mar 16 17:14:25 crc kubenswrapper[5120]: I0316 17:14:25.160710 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c99a61d-0e3f-4dcd-a6bb-54f5a28697a4" containerName="ceilometer-notification-agent" Mar 16 17:14:25 crc kubenswrapper[5120]: I0316 17:14:25.160877 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7c99a61d-0e3f-4dcd-a6bb-54f5a28697a4" containerName="sg-core" Mar 16 17:14:25 crc kubenswrapper[5120]: I0316 17:14:25.160893 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7c99a61d-0e3f-4dcd-a6bb-54f5a28697a4" containerName="ceilometer-central-agent" Mar 16 17:14:25 crc kubenswrapper[5120]: I0316 17:14:25.160926 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7c99a61d-0e3f-4dcd-a6bb-54f5a28697a4" containerName="ceilometer-notification-agent" Mar 16 17:14:25 crc kubenswrapper[5120]: I0316 17:14:25.160949 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7c99a61d-0e3f-4dcd-a6bb-54f5a28697a4" containerName="proxy-httpd" Mar 16 17:14:25 crc kubenswrapper[5120]: I0316 17:14:25.166003 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:14:25 crc kubenswrapper[5120]: I0316 17:14:25.166108 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:14:25 crc kubenswrapper[5120]: I0316 17:14:25.176583 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 17:14:25 crc kubenswrapper[5120]: I0316 17:14:25.178877 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 17:14:25 crc kubenswrapper[5120]: I0316 17:14:25.278918 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0785abc6-13c2-4534-867f-170bb324d5d6-log-httpd\") pod \"ceilometer-0\" (UID: \"0785abc6-13c2-4534-867f-170bb324d5d6\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:14:25 crc kubenswrapper[5120]: I0316 17:14:25.279162 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0785abc6-13c2-4534-867f-170bb324d5d6-config-data\") pod \"ceilometer-0\" (UID: \"0785abc6-13c2-4534-867f-170bb324d5d6\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:14:25 crc kubenswrapper[5120]: I0316 17:14:25.279401 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0785abc6-13c2-4534-867f-170bb324d5d6-run-httpd\") pod \"ceilometer-0\" (UID: \"0785abc6-13c2-4534-867f-170bb324d5d6\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:14:25 crc kubenswrapper[5120]: I0316 17:14:25.279483 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0785abc6-13c2-4534-867f-170bb324d5d6-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"0785abc6-13c2-4534-867f-170bb324d5d6\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:14:25 crc kubenswrapper[5120]: I0316 17:14:25.279655 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9jb6\" (UniqueName: \"kubernetes.io/projected/0785abc6-13c2-4534-867f-170bb324d5d6-kube-api-access-h9jb6\") pod \"ceilometer-0\" (UID: \"0785abc6-13c2-4534-867f-170bb324d5d6\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:14:25 crc kubenswrapper[5120]: I0316 17:14:25.279752 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0785abc6-13c2-4534-867f-170bb324d5d6-scripts\") pod \"ceilometer-0\" (UID: \"0785abc6-13c2-4534-867f-170bb324d5d6\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:14:25 crc kubenswrapper[5120]: I0316 17:14:25.279829 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/0785abc6-13c2-4534-867f-170bb324d5d6-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"0785abc6-13c2-4534-867f-170bb324d5d6\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:14:25 crc kubenswrapper[5120]: I0316 17:14:25.382048 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0785abc6-13c2-4534-867f-170bb324d5d6-config-data\") pod \"ceilometer-0\" (UID: \"0785abc6-13c2-4534-867f-170bb324d5d6\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:14:25 crc kubenswrapper[5120]: I0316 17:14:25.382190 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0785abc6-13c2-4534-867f-170bb324d5d6-run-httpd\") pod \"ceilometer-0\" (UID: \"0785abc6-13c2-4534-867f-170bb324d5d6\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:14:25 crc kubenswrapper[5120]: I0316 17:14:25.382241 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0785abc6-13c2-4534-867f-170bb324d5d6-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"0785abc6-13c2-4534-867f-170bb324d5d6\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:14:25 crc kubenswrapper[5120]: I0316 17:14:25.382339 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h9jb6\" (UniqueName: \"kubernetes.io/projected/0785abc6-13c2-4534-867f-170bb324d5d6-kube-api-access-h9jb6\") pod \"ceilometer-0\" (UID: \"0785abc6-13c2-4534-867f-170bb324d5d6\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:14:25 crc kubenswrapper[5120]: I0316 17:14:25.382402 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0785abc6-13c2-4534-867f-170bb324d5d6-scripts\") pod \"ceilometer-0\" (UID: \"0785abc6-13c2-4534-867f-170bb324d5d6\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:14:25 crc kubenswrapper[5120]: I0316 17:14:25.382437 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/0785abc6-13c2-4534-867f-170bb324d5d6-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"0785abc6-13c2-4534-867f-170bb324d5d6\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:14:25 crc kubenswrapper[5120]: I0316 17:14:25.382839 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0785abc6-13c2-4534-867f-170bb324d5d6-run-httpd\") pod \"ceilometer-0\" (UID: \"0785abc6-13c2-4534-867f-170bb324d5d6\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:14:25 crc kubenswrapper[5120]: I0316 17:14:25.383140 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0785abc6-13c2-4534-867f-170bb324d5d6-log-httpd\") pod \"ceilometer-0\" (UID: \"0785abc6-13c2-4534-867f-170bb324d5d6\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:14:25 crc kubenswrapper[5120]: I0316 17:14:25.383441 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0785abc6-13c2-4534-867f-170bb324d5d6-log-httpd\") pod \"ceilometer-0\" (UID: \"0785abc6-13c2-4534-867f-170bb324d5d6\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:14:25 crc kubenswrapper[5120]: I0316 17:14:25.387662 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0785abc6-13c2-4534-867f-170bb324d5d6-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"0785abc6-13c2-4534-867f-170bb324d5d6\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:14:25 crc kubenswrapper[5120]: I0316 17:14:25.387889 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0785abc6-13c2-4534-867f-170bb324d5d6-scripts\") pod \"ceilometer-0\" (UID: \"0785abc6-13c2-4534-867f-170bb324d5d6\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:14:25 crc kubenswrapper[5120]: I0316 17:14:25.388872 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0785abc6-13c2-4534-867f-170bb324d5d6-config-data\") pod \"ceilometer-0\" (UID: \"0785abc6-13c2-4534-867f-170bb324d5d6\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:14:25 crc kubenswrapper[5120]: I0316 17:14:25.394833 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/0785abc6-13c2-4534-867f-170bb324d5d6-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"0785abc6-13c2-4534-867f-170bb324d5d6\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:14:25 crc kubenswrapper[5120]: I0316 17:14:25.405436 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9jb6\" (UniqueName: \"kubernetes.io/projected/0785abc6-13c2-4534-867f-170bb324d5d6-kube-api-access-h9jb6\") pod \"ceilometer-0\" (UID: \"0785abc6-13c2-4534-867f-170bb324d5d6\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:14:25 crc kubenswrapper[5120]: I0316 17:14:25.494586 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:14:25 crc kubenswrapper[5120]: W0316 17:14:25.989354 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0785abc6_13c2_4534_867f_170bb324d5d6.slice/crio-139bf5dd26a85024f584bc598b9279ad10d3121d3121c593c0cf8f67c18b1e12 WatchSource:0}: Error finding container 139bf5dd26a85024f584bc598b9279ad10d3121d3121c593c0cf8f67c18b1e12: Status 404 returned error can't find the container with id 139bf5dd26a85024f584bc598b9279ad10d3121d3121c593c0cf8f67c18b1e12 Mar 16 17:14:25 crc kubenswrapper[5120]: I0316 17:14:25.993373 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:14:26 crc kubenswrapper[5120]: I0316 17:14:26.275338 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/placement-5b79cc5b54-db2hd" Mar 16 17:14:26 crc kubenswrapper[5120]: E0316 17:14:26.289478 5120 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1ae5285c_173c_4162_9610_3f9c3a4ef47b.slice\": RecentStats: unable to find data in memory cache]" Mar 16 17:14:26 crc kubenswrapper[5120]: I0316 17:14:26.676523 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c99a61d-0e3f-4dcd-a6bb-54f5a28697a4" path="/var/lib/kubelet/pods/7c99a61d-0e3f-4dcd-a6bb-54f5a28697a4/volumes" Mar 16 17:14:26 crc kubenswrapper[5120]: I0316 17:14:26.795182 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"0785abc6-13c2-4534-867f-170bb324d5d6","Type":"ContainerStarted","Data":"86824a60fab7b90b37ef3d561362472cf2de977caad406f95a206f4fd1feda9d"} Mar 16 17:14:26 crc kubenswrapper[5120]: I0316 17:14:26.795227 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"0785abc6-13c2-4534-867f-170bb324d5d6","Type":"ContainerStarted","Data":"139bf5dd26a85024f584bc598b9279ad10d3121d3121c593c0cf8f67c18b1e12"} Mar 16 17:14:27 crc kubenswrapper[5120]: I0316 17:14:27.230227 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/placement-5b79cc5b54-db2hd" Mar 16 17:14:27 crc kubenswrapper[5120]: I0316 17:14:27.326370 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-659df787f4-kl54p"] Mar 16 17:14:27 crc kubenswrapper[5120]: I0316 17:14:27.327041 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-659df787f4-kl54p" podUID="b4e419a5-c358-422b-bfa1-64fe3dac8379" containerName="placement-log" containerID="cri-o://54ff405b70053abcc7ea2970d05cfd6e855792ad8dca4383b946f22647de4a03" gracePeriod=30 Mar 16 17:14:27 crc kubenswrapper[5120]: I0316 17:14:27.327178 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-659df787f4-kl54p" podUID="b4e419a5-c358-422b-bfa1-64fe3dac8379" containerName="placement-api" containerID="cri-o://30a61807cc8cd03eac35985c32d432eeb0e9d8c7cb11a86c4469af2f08952738" gracePeriod=30 Mar 16 17:14:27 crc kubenswrapper[5120]: I0316 17:14:27.806299 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"0785abc6-13c2-4534-867f-170bb324d5d6","Type":"ContainerStarted","Data":"aae6e0b176505fcf344df64b17a50907e422466f6ad1d5b8eb3b5d5e418c8193"} Mar 16 17:14:27 crc kubenswrapper[5120]: I0316 17:14:27.808500 5120 generic.go:358] "Generic (PLEG): container finished" podID="b4e419a5-c358-422b-bfa1-64fe3dac8379" containerID="54ff405b70053abcc7ea2970d05cfd6e855792ad8dca4383b946f22647de4a03" exitCode=143 Mar 16 17:14:27 crc kubenswrapper[5120]: I0316 17:14:27.808636 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-659df787f4-kl54p" event={"ID":"b4e419a5-c358-422b-bfa1-64fe3dac8379","Type":"ContainerDied","Data":"54ff405b70053abcc7ea2970d05cfd6e855792ad8dca4383b946f22647de4a03"} Mar 16 17:14:28 crc kubenswrapper[5120]: I0316 17:14:28.820298 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"0785abc6-13c2-4534-867f-170bb324d5d6","Type":"ContainerStarted","Data":"16d23aafd72bce44025efac11300340650bc53a81264363a1ad25864941220d3"} Mar 16 17:14:30 crc kubenswrapper[5120]: I0316 17:14:30.843388 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"0785abc6-13c2-4534-867f-170bb324d5d6","Type":"ContainerStarted","Data":"cb3f459a8e5ac8780e857c1212b903df67f99300094a482dfccb73ec72eeeacf"} Mar 16 17:14:30 crc kubenswrapper[5120]: I0316 17:14:30.844740 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:14:30 crc kubenswrapper[5120]: I0316 17:14:30.846219 5120 generic.go:358] "Generic (PLEG): container finished" podID="b4e419a5-c358-422b-bfa1-64fe3dac8379" containerID="30a61807cc8cd03eac35985c32d432eeb0e9d8c7cb11a86c4469af2f08952738" exitCode=0 Mar 16 17:14:30 crc kubenswrapper[5120]: I0316 17:14:30.846358 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-659df787f4-kl54p" event={"ID":"b4e419a5-c358-422b-bfa1-64fe3dac8379","Type":"ContainerDied","Data":"30a61807cc8cd03eac35985c32d432eeb0e9d8c7cb11a86c4469af2f08952738"} Mar 16 17:14:30 crc kubenswrapper[5120]: I0316 17:14:30.846454 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-659df787f4-kl54p" event={"ID":"b4e419a5-c358-422b-bfa1-64fe3dac8379","Type":"ContainerDied","Data":"547b033c7c50f36e8c1126974a7ab04458e14beb20561c4d7ae35cb843729532"} Mar 16 17:14:30 crc kubenswrapper[5120]: I0316 17:14:30.846558 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="547b033c7c50f36e8c1126974a7ab04458e14beb20561c4d7ae35cb843729532" Mar 16 17:14:30 crc kubenswrapper[5120]: I0316 17:14:30.869246 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=1.883279087 podStartE2EDuration="5.869224389s" podCreationTimestamp="2026-03-16 17:14:25 +0000 UTC" firstStartedPulling="2026-03-16 17:14:25.991323154 +0000 UTC m=+6168.145254811" lastFinishedPulling="2026-03-16 17:14:29.977268456 +0000 UTC m=+6172.131200113" observedRunningTime="2026-03-16 17:14:30.862812185 +0000 UTC m=+6173.016743842" watchObservedRunningTime="2026-03-16 17:14:30.869224389 +0000 UTC m=+6173.023156046" Mar 16 17:14:30 crc kubenswrapper[5120]: I0316 17:14:30.877506 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-659df787f4-kl54p" Mar 16 17:14:30 crc kubenswrapper[5120]: I0316 17:14:30.943885 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b4e419a5-c358-422b-bfa1-64fe3dac8379-config-data\") pod \"b4e419a5-c358-422b-bfa1-64fe3dac8379\" (UID: \"b4e419a5-c358-422b-bfa1-64fe3dac8379\") " Mar 16 17:14:30 crc kubenswrapper[5120]: I0316 17:14:30.943946 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/b4e419a5-c358-422b-bfa1-64fe3dac8379-internal-tls-certs\") pod \"b4e419a5-c358-422b-bfa1-64fe3dac8379\" (UID: \"b4e419a5-c358-422b-bfa1-64fe3dac8379\") " Mar 16 17:14:30 crc kubenswrapper[5120]: I0316 17:14:30.944057 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b4e419a5-c358-422b-bfa1-64fe3dac8379-scripts\") pod \"b4e419a5-c358-422b-bfa1-64fe3dac8379\" (UID: \"b4e419a5-c358-422b-bfa1-64fe3dac8379\") " Mar 16 17:14:30 crc kubenswrapper[5120]: I0316 17:14:30.944174 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6h4pv\" (UniqueName: \"kubernetes.io/projected/b4e419a5-c358-422b-bfa1-64fe3dac8379-kube-api-access-6h4pv\") pod \"b4e419a5-c358-422b-bfa1-64fe3dac8379\" (UID: \"b4e419a5-c358-422b-bfa1-64fe3dac8379\") " Mar 16 17:14:30 crc kubenswrapper[5120]: I0316 17:14:30.944366 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b4e419a5-c358-422b-bfa1-64fe3dac8379-combined-ca-bundle\") pod \"b4e419a5-c358-422b-bfa1-64fe3dac8379\" (UID: \"b4e419a5-c358-422b-bfa1-64fe3dac8379\") " Mar 16 17:14:30 crc kubenswrapper[5120]: I0316 17:14:30.944463 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/b4e419a5-c358-422b-bfa1-64fe3dac8379-public-tls-certs\") pod \"b4e419a5-c358-422b-bfa1-64fe3dac8379\" (UID: \"b4e419a5-c358-422b-bfa1-64fe3dac8379\") " Mar 16 17:14:30 crc kubenswrapper[5120]: I0316 17:14:30.944495 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b4e419a5-c358-422b-bfa1-64fe3dac8379-logs\") pod \"b4e419a5-c358-422b-bfa1-64fe3dac8379\" (UID: \"b4e419a5-c358-422b-bfa1-64fe3dac8379\") " Mar 16 17:14:30 crc kubenswrapper[5120]: I0316 17:14:30.944989 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4e419a5-c358-422b-bfa1-64fe3dac8379-logs" (OuterVolumeSpecName: "logs") pod "b4e419a5-c358-422b-bfa1-64fe3dac8379" (UID: "b4e419a5-c358-422b-bfa1-64fe3dac8379"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:14:30 crc kubenswrapper[5120]: I0316 17:14:30.947302 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b4e419a5-c358-422b-bfa1-64fe3dac8379-logs\") on node \"crc\" DevicePath \"\"" Mar 16 17:14:30 crc kubenswrapper[5120]: I0316 17:14:30.952353 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b4e419a5-c358-422b-bfa1-64fe3dac8379-scripts" (OuterVolumeSpecName: "scripts") pod "b4e419a5-c358-422b-bfa1-64fe3dac8379" (UID: "b4e419a5-c358-422b-bfa1-64fe3dac8379"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:14:30 crc kubenswrapper[5120]: I0316 17:14:30.953819 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4e419a5-c358-422b-bfa1-64fe3dac8379-kube-api-access-6h4pv" (OuterVolumeSpecName: "kube-api-access-6h4pv") pod "b4e419a5-c358-422b-bfa1-64fe3dac8379" (UID: "b4e419a5-c358-422b-bfa1-64fe3dac8379"). InnerVolumeSpecName "kube-api-access-6h4pv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:14:31 crc kubenswrapper[5120]: I0316 17:14:31.004463 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b4e419a5-c358-422b-bfa1-64fe3dac8379-config-data" (OuterVolumeSpecName: "config-data") pod "b4e419a5-c358-422b-bfa1-64fe3dac8379" (UID: "b4e419a5-c358-422b-bfa1-64fe3dac8379"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:14:31 crc kubenswrapper[5120]: I0316 17:14:31.005930 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b4e419a5-c358-422b-bfa1-64fe3dac8379-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "b4e419a5-c358-422b-bfa1-64fe3dac8379" (UID: "b4e419a5-c358-422b-bfa1-64fe3dac8379"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:14:31 crc kubenswrapper[5120]: I0316 17:14:31.050281 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6h4pv\" (UniqueName: \"kubernetes.io/projected/b4e419a5-c358-422b-bfa1-64fe3dac8379-kube-api-access-6h4pv\") on node \"crc\" DevicePath \"\"" Mar 16 17:14:31 crc kubenswrapper[5120]: I0316 17:14:31.050326 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b4e419a5-c358-422b-bfa1-64fe3dac8379-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:14:31 crc kubenswrapper[5120]: I0316 17:14:31.050343 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b4e419a5-c358-422b-bfa1-64fe3dac8379-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:14:31 crc kubenswrapper[5120]: I0316 17:14:31.050356 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b4e419a5-c358-422b-bfa1-64fe3dac8379-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:14:31 crc kubenswrapper[5120]: I0316 17:14:31.071636 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b4e419a5-c358-422b-bfa1-64fe3dac8379-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "b4e419a5-c358-422b-bfa1-64fe3dac8379" (UID: "b4e419a5-c358-422b-bfa1-64fe3dac8379"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:14:31 crc kubenswrapper[5120]: I0316 17:14:31.088232 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b4e419a5-c358-422b-bfa1-64fe3dac8379-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "b4e419a5-c358-422b-bfa1-64fe3dac8379" (UID: "b4e419a5-c358-422b-bfa1-64fe3dac8379"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:14:31 crc kubenswrapper[5120]: I0316 17:14:31.153281 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/b4e419a5-c358-422b-bfa1-64fe3dac8379-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:14:31 crc kubenswrapper[5120]: I0316 17:14:31.153512 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/b4e419a5-c358-422b-bfa1-64fe3dac8379-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:14:31 crc kubenswrapper[5120]: I0316 17:14:31.855398 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-659df787f4-kl54p" Mar 16 17:14:31 crc kubenswrapper[5120]: I0316 17:14:31.893660 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-659df787f4-kl54p"] Mar 16 17:14:31 crc kubenswrapper[5120]: I0316 17:14:31.905582 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-659df787f4-kl54p"] Mar 16 17:14:31 crc kubenswrapper[5120]: I0316 17:14:31.916110 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:14:32 crc kubenswrapper[5120]: I0316 17:14:32.674938 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b4e419a5-c358-422b-bfa1-64fe3dac8379" path="/var/lib/kubelet/pods/b4e419a5-c358-422b-bfa1-64fe3dac8379/volumes" Mar 16 17:14:32 crc kubenswrapper[5120]: I0316 17:14:32.865904 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="0785abc6-13c2-4534-867f-170bb324d5d6" containerName="ceilometer-central-agent" containerID="cri-o://86824a60fab7b90b37ef3d561362472cf2de977caad406f95a206f4fd1feda9d" gracePeriod=30 Mar 16 17:14:32 crc kubenswrapper[5120]: I0316 17:14:32.866000 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="0785abc6-13c2-4534-867f-170bb324d5d6" containerName="sg-core" containerID="cri-o://16d23aafd72bce44025efac11300340650bc53a81264363a1ad25864941220d3" gracePeriod=30 Mar 16 17:14:32 crc kubenswrapper[5120]: I0316 17:14:32.866024 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="0785abc6-13c2-4534-867f-170bb324d5d6" containerName="ceilometer-notification-agent" containerID="cri-o://aae6e0b176505fcf344df64b17a50907e422466f6ad1d5b8eb3b5d5e418c8193" gracePeriod=30 Mar 16 17:14:32 crc kubenswrapper[5120]: I0316 17:14:32.866181 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="0785abc6-13c2-4534-867f-170bb324d5d6" containerName="proxy-httpd" containerID="cri-o://cb3f459a8e5ac8780e857c1212b903df67f99300094a482dfccb73ec72eeeacf" gracePeriod=30 Mar 16 17:14:33 crc kubenswrapper[5120]: I0316 17:14:33.875322 5120 generic.go:358] "Generic (PLEG): container finished" podID="f0ed456c-3662-445f-b52b-d39cec513aa8" containerID="fb67d148059bfc4eacc0403df2280ae59beca37b8486e74770730596695c5a9c" exitCode=0 Mar 16 17:14:33 crc kubenswrapper[5120]: I0316 17:14:33.875540 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-dkgmb" event={"ID":"f0ed456c-3662-445f-b52b-d39cec513aa8","Type":"ContainerDied","Data":"fb67d148059bfc4eacc0403df2280ae59beca37b8486e74770730596695c5a9c"} Mar 16 17:14:33 crc kubenswrapper[5120]: I0316 17:14:33.879178 5120 generic.go:358] "Generic (PLEG): container finished" podID="0785abc6-13c2-4534-867f-170bb324d5d6" containerID="cb3f459a8e5ac8780e857c1212b903df67f99300094a482dfccb73ec72eeeacf" exitCode=0 Mar 16 17:14:33 crc kubenswrapper[5120]: I0316 17:14:33.879277 5120 generic.go:358] "Generic (PLEG): container finished" podID="0785abc6-13c2-4534-867f-170bb324d5d6" containerID="16d23aafd72bce44025efac11300340650bc53a81264363a1ad25864941220d3" exitCode=2 Mar 16 17:14:33 crc kubenswrapper[5120]: I0316 17:14:33.879287 5120 generic.go:358] "Generic (PLEG): container finished" podID="0785abc6-13c2-4534-867f-170bb324d5d6" containerID="aae6e0b176505fcf344df64b17a50907e422466f6ad1d5b8eb3b5d5e418c8193" exitCode=0 Mar 16 17:14:33 crc kubenswrapper[5120]: I0316 17:14:33.879236 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"0785abc6-13c2-4534-867f-170bb324d5d6","Type":"ContainerDied","Data":"cb3f459a8e5ac8780e857c1212b903df67f99300094a482dfccb73ec72eeeacf"} Mar 16 17:14:33 crc kubenswrapper[5120]: I0316 17:14:33.879330 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"0785abc6-13c2-4534-867f-170bb324d5d6","Type":"ContainerDied","Data":"16d23aafd72bce44025efac11300340650bc53a81264363a1ad25864941220d3"} Mar 16 17:14:33 crc kubenswrapper[5120]: I0316 17:14:33.879344 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"0785abc6-13c2-4534-867f-170bb324d5d6","Type":"ContainerDied","Data":"aae6e0b176505fcf344df64b17a50907e422466f6ad1d5b8eb3b5d5e418c8193"} Mar 16 17:14:34 crc kubenswrapper[5120]: I0316 17:14:34.048852 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 17:14:34 crc kubenswrapper[5120]: I0316 17:14:34.050001 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="7ba88a08-571b-4c0c-ac5f-83f603d3ad93" containerName="glance-log" containerID="cri-o://1ed9c53a6746c3dc8754c0f99816d11037ff980e3d1ca772d5df562eaafea0f1" gracePeriod=30 Mar 16 17:14:34 crc kubenswrapper[5120]: I0316 17:14:34.050035 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="7ba88a08-571b-4c0c-ac5f-83f603d3ad93" containerName="glance-httpd" containerID="cri-o://54e729471c57221e9ec716b84ee8370905d0bbb88e60b3b95314d8aefd076e1c" gracePeriod=30 Mar 16 17:14:34 crc kubenswrapper[5120]: I0316 17:14:34.897310 5120 generic.go:358] "Generic (PLEG): container finished" podID="7ba88a08-571b-4c0c-ac5f-83f603d3ad93" containerID="1ed9c53a6746c3dc8754c0f99816d11037ff980e3d1ca772d5df562eaafea0f1" exitCode=143 Mar 16 17:14:34 crc kubenswrapper[5120]: I0316 17:14:34.898100 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"7ba88a08-571b-4c0c-ac5f-83f603d3ad93","Type":"ContainerDied","Data":"1ed9c53a6746c3dc8754c0f99816d11037ff980e3d1ca772d5df562eaafea0f1"} Mar 16 17:14:34 crc kubenswrapper[5120]: I0316 17:14:34.914610 5120 generic.go:358] "Generic (PLEG): container finished" podID="0785abc6-13c2-4534-867f-170bb324d5d6" containerID="86824a60fab7b90b37ef3d561362472cf2de977caad406f95a206f4fd1feda9d" exitCode=0 Mar 16 17:14:34 crc kubenswrapper[5120]: I0316 17:14:34.915022 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"0785abc6-13c2-4534-867f-170bb324d5d6","Type":"ContainerDied","Data":"86824a60fab7b90b37ef3d561362472cf2de977caad406f95a206f4fd1feda9d"} Mar 16 17:14:34 crc kubenswrapper[5120]: I0316 17:14:34.932573 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 17:14:34 crc kubenswrapper[5120]: I0316 17:14:34.932845 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="bbfbf4e9-d150-4503-a4c0-8b14a69df4df" containerName="glance-log" containerID="cri-o://2eed823221a09ad2c0fa2339feadeb66bc2b67e0c290b8deb917754ac315f27b" gracePeriod=30 Mar 16 17:14:34 crc kubenswrapper[5120]: I0316 17:14:34.933314 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="bbfbf4e9-d150-4503-a4c0-8b14a69df4df" containerName="glance-httpd" containerID="cri-o://165cb675ff60493ed7f2f63380d0a54cce174c472205e9a50516b951f274ac29" gracePeriod=30 Mar 16 17:14:35 crc kubenswrapper[5120]: I0316 17:14:35.296479 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:14:35 crc kubenswrapper[5120]: I0316 17:14:35.373003 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0785abc6-13c2-4534-867f-170bb324d5d6-combined-ca-bundle\") pod \"0785abc6-13c2-4534-867f-170bb324d5d6\" (UID: \"0785abc6-13c2-4534-867f-170bb324d5d6\") " Mar 16 17:14:35 crc kubenswrapper[5120]: I0316 17:14:35.373550 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h9jb6\" (UniqueName: \"kubernetes.io/projected/0785abc6-13c2-4534-867f-170bb324d5d6-kube-api-access-h9jb6\") pod \"0785abc6-13c2-4534-867f-170bb324d5d6\" (UID: \"0785abc6-13c2-4534-867f-170bb324d5d6\") " Mar 16 17:14:35 crc kubenswrapper[5120]: I0316 17:14:35.373714 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/0785abc6-13c2-4534-867f-170bb324d5d6-sg-core-conf-yaml\") pod \"0785abc6-13c2-4534-867f-170bb324d5d6\" (UID: \"0785abc6-13c2-4534-867f-170bb324d5d6\") " Mar 16 17:14:35 crc kubenswrapper[5120]: I0316 17:14:35.373937 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0785abc6-13c2-4534-867f-170bb324d5d6-config-data\") pod \"0785abc6-13c2-4534-867f-170bb324d5d6\" (UID: \"0785abc6-13c2-4534-867f-170bb324d5d6\") " Mar 16 17:14:35 crc kubenswrapper[5120]: I0316 17:14:35.374087 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0785abc6-13c2-4534-867f-170bb324d5d6-log-httpd\") pod \"0785abc6-13c2-4534-867f-170bb324d5d6\" (UID: \"0785abc6-13c2-4534-867f-170bb324d5d6\") " Mar 16 17:14:35 crc kubenswrapper[5120]: I0316 17:14:35.374487 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0785abc6-13c2-4534-867f-170bb324d5d6-scripts\") pod \"0785abc6-13c2-4534-867f-170bb324d5d6\" (UID: \"0785abc6-13c2-4534-867f-170bb324d5d6\") " Mar 16 17:14:35 crc kubenswrapper[5120]: I0316 17:14:35.374687 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0785abc6-13c2-4534-867f-170bb324d5d6-run-httpd\") pod \"0785abc6-13c2-4534-867f-170bb324d5d6\" (UID: \"0785abc6-13c2-4534-867f-170bb324d5d6\") " Mar 16 17:14:35 crc kubenswrapper[5120]: I0316 17:14:35.381143 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0785abc6-13c2-4534-867f-170bb324d5d6-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "0785abc6-13c2-4534-867f-170bb324d5d6" (UID: "0785abc6-13c2-4534-867f-170bb324d5d6"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:14:35 crc kubenswrapper[5120]: I0316 17:14:35.381817 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0785abc6-13c2-4534-867f-170bb324d5d6-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "0785abc6-13c2-4534-867f-170bb324d5d6" (UID: "0785abc6-13c2-4534-867f-170bb324d5d6"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:14:35 crc kubenswrapper[5120]: I0316 17:14:35.382445 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0785abc6-13c2-4534-867f-170bb324d5d6-kube-api-access-h9jb6" (OuterVolumeSpecName: "kube-api-access-h9jb6") pod "0785abc6-13c2-4534-867f-170bb324d5d6" (UID: "0785abc6-13c2-4534-867f-170bb324d5d6"). InnerVolumeSpecName "kube-api-access-h9jb6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:14:35 crc kubenswrapper[5120]: I0316 17:14:35.401979 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0785abc6-13c2-4534-867f-170bb324d5d6-scripts" (OuterVolumeSpecName: "scripts") pod "0785abc6-13c2-4534-867f-170bb324d5d6" (UID: "0785abc6-13c2-4534-867f-170bb324d5d6"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:14:35 crc kubenswrapper[5120]: I0316 17:14:35.442165 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0785abc6-13c2-4534-867f-170bb324d5d6-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "0785abc6-13c2-4534-867f-170bb324d5d6" (UID: "0785abc6-13c2-4534-867f-170bb324d5d6"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:14:35 crc kubenswrapper[5120]: I0316 17:14:35.472069 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-dkgmb" Mar 16 17:14:35 crc kubenswrapper[5120]: I0316 17:14:35.478026 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h9jb6\" (UniqueName: \"kubernetes.io/projected/0785abc6-13c2-4534-867f-170bb324d5d6-kube-api-access-h9jb6\") on node \"crc\" DevicePath \"\"" Mar 16 17:14:35 crc kubenswrapper[5120]: I0316 17:14:35.478065 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/0785abc6-13c2-4534-867f-170bb324d5d6-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 17:14:35 crc kubenswrapper[5120]: I0316 17:14:35.478075 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0785abc6-13c2-4534-867f-170bb324d5d6-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 17:14:35 crc kubenswrapper[5120]: I0316 17:14:35.478084 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0785abc6-13c2-4534-867f-170bb324d5d6-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:14:35 crc kubenswrapper[5120]: I0316 17:14:35.478096 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0785abc6-13c2-4534-867f-170bb324d5d6-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 17:14:35 crc kubenswrapper[5120]: I0316 17:14:35.488170 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0785abc6-13c2-4534-867f-170bb324d5d6-config-data" (OuterVolumeSpecName: "config-data") pod "0785abc6-13c2-4534-867f-170bb324d5d6" (UID: "0785abc6-13c2-4534-867f-170bb324d5d6"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:14:35 crc kubenswrapper[5120]: I0316 17:14:35.518692 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0785abc6-13c2-4534-867f-170bb324d5d6-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "0785abc6-13c2-4534-867f-170bb324d5d6" (UID: "0785abc6-13c2-4534-867f-170bb324d5d6"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:14:35 crc kubenswrapper[5120]: I0316 17:14:35.579032 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s5x74\" (UniqueName: \"kubernetes.io/projected/f0ed456c-3662-445f-b52b-d39cec513aa8-kube-api-access-s5x74\") pod \"f0ed456c-3662-445f-b52b-d39cec513aa8\" (UID: \"f0ed456c-3662-445f-b52b-d39cec513aa8\") " Mar 16 17:14:35 crc kubenswrapper[5120]: I0316 17:14:35.579364 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f0ed456c-3662-445f-b52b-d39cec513aa8-scripts\") pod \"f0ed456c-3662-445f-b52b-d39cec513aa8\" (UID: \"f0ed456c-3662-445f-b52b-d39cec513aa8\") " Mar 16 17:14:35 crc kubenswrapper[5120]: I0316 17:14:35.579812 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f0ed456c-3662-445f-b52b-d39cec513aa8-config-data\") pod \"f0ed456c-3662-445f-b52b-d39cec513aa8\" (UID: \"f0ed456c-3662-445f-b52b-d39cec513aa8\") " Mar 16 17:14:35 crc kubenswrapper[5120]: I0316 17:14:35.579843 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f0ed456c-3662-445f-b52b-d39cec513aa8-combined-ca-bundle\") pod \"f0ed456c-3662-445f-b52b-d39cec513aa8\" (UID: \"f0ed456c-3662-445f-b52b-d39cec513aa8\") " Mar 16 17:14:35 crc kubenswrapper[5120]: I0316 17:14:35.580429 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0785abc6-13c2-4534-867f-170bb324d5d6-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:14:35 crc kubenswrapper[5120]: I0316 17:14:35.580448 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0785abc6-13c2-4534-867f-170bb324d5d6-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:14:35 crc kubenswrapper[5120]: I0316 17:14:35.593945 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0ed456c-3662-445f-b52b-d39cec513aa8-scripts" (OuterVolumeSpecName: "scripts") pod "f0ed456c-3662-445f-b52b-d39cec513aa8" (UID: "f0ed456c-3662-445f-b52b-d39cec513aa8"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:14:35 crc kubenswrapper[5120]: I0316 17:14:35.594153 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0ed456c-3662-445f-b52b-d39cec513aa8-kube-api-access-s5x74" (OuterVolumeSpecName: "kube-api-access-s5x74") pod "f0ed456c-3662-445f-b52b-d39cec513aa8" (UID: "f0ed456c-3662-445f-b52b-d39cec513aa8"). InnerVolumeSpecName "kube-api-access-s5x74". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:14:35 crc kubenswrapper[5120]: I0316 17:14:35.613470 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0ed456c-3662-445f-b52b-d39cec513aa8-config-data" (OuterVolumeSpecName: "config-data") pod "f0ed456c-3662-445f-b52b-d39cec513aa8" (UID: "f0ed456c-3662-445f-b52b-d39cec513aa8"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:14:35 crc kubenswrapper[5120]: I0316 17:14:35.616711 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0ed456c-3662-445f-b52b-d39cec513aa8-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f0ed456c-3662-445f-b52b-d39cec513aa8" (UID: "f0ed456c-3662-445f-b52b-d39cec513aa8"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:14:35 crc kubenswrapper[5120]: I0316 17:14:35.682584 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f0ed456c-3662-445f-b52b-d39cec513aa8-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:14:35 crc kubenswrapper[5120]: I0316 17:14:35.682619 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f0ed456c-3662-445f-b52b-d39cec513aa8-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:14:35 crc kubenswrapper[5120]: I0316 17:14:35.682629 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f0ed456c-3662-445f-b52b-d39cec513aa8-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:14:35 crc kubenswrapper[5120]: I0316 17:14:35.682639 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s5x74\" (UniqueName: \"kubernetes.io/projected/f0ed456c-3662-445f-b52b-d39cec513aa8-kube-api-access-s5x74\") on node \"crc\" DevicePath \"\"" Mar 16 17:14:35 crc kubenswrapper[5120]: I0316 17:14:35.927027 5120 generic.go:358] "Generic (PLEG): container finished" podID="bbfbf4e9-d150-4503-a4c0-8b14a69df4df" containerID="2eed823221a09ad2c0fa2339feadeb66bc2b67e0c290b8deb917754ac315f27b" exitCode=143 Mar 16 17:14:35 crc kubenswrapper[5120]: I0316 17:14:35.927140 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"bbfbf4e9-d150-4503-a4c0-8b14a69df4df","Type":"ContainerDied","Data":"2eed823221a09ad2c0fa2339feadeb66bc2b67e0c290b8deb917754ac315f27b"} Mar 16 17:14:35 crc kubenswrapper[5120]: I0316 17:14:35.930368 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-dkgmb" Mar 16 17:14:35 crc kubenswrapper[5120]: I0316 17:14:35.930376 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-dkgmb" event={"ID":"f0ed456c-3662-445f-b52b-d39cec513aa8","Type":"ContainerDied","Data":"374e206b19da2b674132d2a433cb838f4a98c8ed5eccf0093adad5129a09e1e0"} Mar 16 17:14:35 crc kubenswrapper[5120]: I0316 17:14:35.930414 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="374e206b19da2b674132d2a433cb838f4a98c8ed5eccf0093adad5129a09e1e0" Mar 16 17:14:35 crc kubenswrapper[5120]: I0316 17:14:35.933785 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"0785abc6-13c2-4534-867f-170bb324d5d6","Type":"ContainerDied","Data":"139bf5dd26a85024f584bc598b9279ad10d3121d3121c593c0cf8f67c18b1e12"} Mar 16 17:14:35 crc kubenswrapper[5120]: I0316 17:14:35.933830 5120 scope.go:117] "RemoveContainer" containerID="cb3f459a8e5ac8780e857c1212b903df67f99300094a482dfccb73ec72eeeacf" Mar 16 17:14:35 crc kubenswrapper[5120]: I0316 17:14:35.933959 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:14:35 crc kubenswrapper[5120]: I0316 17:14:35.972927 5120 scope.go:117] "RemoveContainer" containerID="16d23aafd72bce44025efac11300340650bc53a81264363a1ad25864941220d3" Mar 16 17:14:35 crc kubenswrapper[5120]: I0316 17:14:35.983976 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 17:14:35 crc kubenswrapper[5120]: I0316 17:14:35.985369 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0785abc6-13c2-4534-867f-170bb324d5d6" containerName="ceilometer-notification-agent" Mar 16 17:14:35 crc kubenswrapper[5120]: I0316 17:14:35.985394 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="0785abc6-13c2-4534-867f-170bb324d5d6" containerName="ceilometer-notification-agent" Mar 16 17:14:35 crc kubenswrapper[5120]: I0316 17:14:35.985427 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4e419a5-c358-422b-bfa1-64fe3dac8379" containerName="placement-log" Mar 16 17:14:35 crc kubenswrapper[5120]: I0316 17:14:35.985434 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4e419a5-c358-422b-bfa1-64fe3dac8379" containerName="placement-log" Mar 16 17:14:35 crc kubenswrapper[5120]: I0316 17:14:35.985449 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0ed456c-3662-445f-b52b-d39cec513aa8" containerName="nova-cell0-conductor-db-sync" Mar 16 17:14:35 crc kubenswrapper[5120]: I0316 17:14:35.985455 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0ed456c-3662-445f-b52b-d39cec513aa8" containerName="nova-cell0-conductor-db-sync" Mar 16 17:14:35 crc kubenswrapper[5120]: I0316 17:14:35.985466 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4e419a5-c358-422b-bfa1-64fe3dac8379" containerName="placement-api" Mar 16 17:14:35 crc kubenswrapper[5120]: I0316 17:14:35.985473 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4e419a5-c358-422b-bfa1-64fe3dac8379" containerName="placement-api" Mar 16 17:14:35 crc kubenswrapper[5120]: I0316 17:14:35.985484 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0785abc6-13c2-4534-867f-170bb324d5d6" containerName="proxy-httpd" Mar 16 17:14:35 crc kubenswrapper[5120]: I0316 17:14:35.985490 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="0785abc6-13c2-4534-867f-170bb324d5d6" containerName="proxy-httpd" Mar 16 17:14:35 crc kubenswrapper[5120]: I0316 17:14:35.985550 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0785abc6-13c2-4534-867f-170bb324d5d6" containerName="ceilometer-central-agent" Mar 16 17:14:35 crc kubenswrapper[5120]: I0316 17:14:35.985558 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="0785abc6-13c2-4534-867f-170bb324d5d6" containerName="ceilometer-central-agent" Mar 16 17:14:35 crc kubenswrapper[5120]: I0316 17:14:35.985571 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0785abc6-13c2-4534-867f-170bb324d5d6" containerName="sg-core" Mar 16 17:14:35 crc kubenswrapper[5120]: I0316 17:14:35.985576 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="0785abc6-13c2-4534-867f-170bb324d5d6" containerName="sg-core" Mar 16 17:14:35 crc kubenswrapper[5120]: I0316 17:14:35.985810 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="0785abc6-13c2-4534-867f-170bb324d5d6" containerName="ceilometer-notification-agent" Mar 16 17:14:35 crc kubenswrapper[5120]: I0316 17:14:35.985824 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="b4e419a5-c358-422b-bfa1-64fe3dac8379" containerName="placement-api" Mar 16 17:14:35 crc kubenswrapper[5120]: I0316 17:14:35.985843 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="0785abc6-13c2-4534-867f-170bb324d5d6" containerName="ceilometer-central-agent" Mar 16 17:14:35 crc kubenswrapper[5120]: I0316 17:14:35.985852 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="0785abc6-13c2-4534-867f-170bb324d5d6" containerName="proxy-httpd" Mar 16 17:14:35 crc kubenswrapper[5120]: I0316 17:14:35.985862 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="0785abc6-13c2-4534-867f-170bb324d5d6" containerName="sg-core" Mar 16 17:14:35 crc kubenswrapper[5120]: I0316 17:14:35.985873 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="b4e419a5-c358-422b-bfa1-64fe3dac8379" containerName="placement-log" Mar 16 17:14:35 crc kubenswrapper[5120]: I0316 17:14:35.985882 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f0ed456c-3662-445f-b52b-d39cec513aa8" containerName="nova-cell0-conductor-db-sync" Mar 16 17:14:36 crc kubenswrapper[5120]: I0316 17:14:35.997550 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:14:36 crc kubenswrapper[5120]: I0316 17:14:35.997685 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 17:14:36 crc kubenswrapper[5120]: I0316 17:14:36.002356 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-conductor-config-data\"" Mar 16 17:14:36 crc kubenswrapper[5120]: I0316 17:14:36.003817 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-nova-dockercfg-xwfdb\"" Mar 16 17:14:36 crc kubenswrapper[5120]: I0316 17:14:36.018606 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 17:14:36 crc kubenswrapper[5120]: I0316 17:14:36.024566 5120 scope.go:117] "RemoveContainer" containerID="aae6e0b176505fcf344df64b17a50907e422466f6ad1d5b8eb3b5d5e418c8193" Mar 16 17:14:36 crc kubenswrapper[5120]: I0316 17:14:36.039842 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:14:36 crc kubenswrapper[5120]: I0316 17:14:36.077211 5120 scope.go:117] "RemoveContainer" containerID="86824a60fab7b90b37ef3d561362472cf2de977caad406f95a206f4fd1feda9d" Mar 16 17:14:36 crc kubenswrapper[5120]: I0316 17:14:36.079965 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:14:36 crc kubenswrapper[5120]: I0316 17:14:36.095049 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c0fcea62-ce96-4685-b87d-14c1c88f6018-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"c0fcea62-ce96-4685-b87d-14c1c88f6018\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 17:14:36 crc kubenswrapper[5120]: I0316 17:14:36.096206 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qh2rb\" (UniqueName: \"kubernetes.io/projected/c0fcea62-ce96-4685-b87d-14c1c88f6018-kube-api-access-qh2rb\") pod \"nova-cell0-conductor-0\" (UID: \"c0fcea62-ce96-4685-b87d-14c1c88f6018\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 17:14:36 crc kubenswrapper[5120]: I0316 17:14:36.096530 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c0fcea62-ce96-4685-b87d-14c1c88f6018-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"c0fcea62-ce96-4685-b87d-14c1c88f6018\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 17:14:36 crc kubenswrapper[5120]: I0316 17:14:36.099426 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:14:36 crc kubenswrapper[5120]: I0316 17:14:36.107254 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 17:14:36 crc kubenswrapper[5120]: I0316 17:14:36.107514 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 17:14:36 crc kubenswrapper[5120]: I0316 17:14:36.137261 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:14:36 crc kubenswrapper[5120]: I0316 17:14:36.199316 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wc7p\" (UniqueName: \"kubernetes.io/projected/992e69a3-0dcd-4c36-a4b0-9237e72b40d8-kube-api-access-6wc7p\") pod \"ceilometer-0\" (UID: \"992e69a3-0dcd-4c36-a4b0-9237e72b40d8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:14:36 crc kubenswrapper[5120]: I0316 17:14:36.199379 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/992e69a3-0dcd-4c36-a4b0-9237e72b40d8-scripts\") pod \"ceilometer-0\" (UID: \"992e69a3-0dcd-4c36-a4b0-9237e72b40d8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:14:36 crc kubenswrapper[5120]: I0316 17:14:36.199440 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/992e69a3-0dcd-4c36-a4b0-9237e72b40d8-run-httpd\") pod \"ceilometer-0\" (UID: \"992e69a3-0dcd-4c36-a4b0-9237e72b40d8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:14:36 crc kubenswrapper[5120]: I0316 17:14:36.199610 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/992e69a3-0dcd-4c36-a4b0-9237e72b40d8-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"992e69a3-0dcd-4c36-a4b0-9237e72b40d8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:14:36 crc kubenswrapper[5120]: I0316 17:14:36.199656 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/992e69a3-0dcd-4c36-a4b0-9237e72b40d8-log-httpd\") pod \"ceilometer-0\" (UID: \"992e69a3-0dcd-4c36-a4b0-9237e72b40d8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:14:36 crc kubenswrapper[5120]: I0316 17:14:36.199683 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/992e69a3-0dcd-4c36-a4b0-9237e72b40d8-config-data\") pod \"ceilometer-0\" (UID: \"992e69a3-0dcd-4c36-a4b0-9237e72b40d8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:14:36 crc kubenswrapper[5120]: I0316 17:14:36.199870 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qh2rb\" (UniqueName: \"kubernetes.io/projected/c0fcea62-ce96-4685-b87d-14c1c88f6018-kube-api-access-qh2rb\") pod \"nova-cell0-conductor-0\" (UID: \"c0fcea62-ce96-4685-b87d-14c1c88f6018\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 17:14:36 crc kubenswrapper[5120]: I0316 17:14:36.200081 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c0fcea62-ce96-4685-b87d-14c1c88f6018-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"c0fcea62-ce96-4685-b87d-14c1c88f6018\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 17:14:36 crc kubenswrapper[5120]: I0316 17:14:36.200110 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/992e69a3-0dcd-4c36-a4b0-9237e72b40d8-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"992e69a3-0dcd-4c36-a4b0-9237e72b40d8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:14:36 crc kubenswrapper[5120]: I0316 17:14:36.200241 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c0fcea62-ce96-4685-b87d-14c1c88f6018-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"c0fcea62-ce96-4685-b87d-14c1c88f6018\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 17:14:36 crc kubenswrapper[5120]: I0316 17:14:36.206246 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c0fcea62-ce96-4685-b87d-14c1c88f6018-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"c0fcea62-ce96-4685-b87d-14c1c88f6018\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 17:14:36 crc kubenswrapper[5120]: I0316 17:14:36.211066 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c0fcea62-ce96-4685-b87d-14c1c88f6018-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"c0fcea62-ce96-4685-b87d-14c1c88f6018\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 17:14:36 crc kubenswrapper[5120]: I0316 17:14:36.218816 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qh2rb\" (UniqueName: \"kubernetes.io/projected/c0fcea62-ce96-4685-b87d-14c1c88f6018-kube-api-access-qh2rb\") pod \"nova-cell0-conductor-0\" (UID: \"c0fcea62-ce96-4685-b87d-14c1c88f6018\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 17:14:36 crc kubenswrapper[5120]: I0316 17:14:36.302185 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6wc7p\" (UniqueName: \"kubernetes.io/projected/992e69a3-0dcd-4c36-a4b0-9237e72b40d8-kube-api-access-6wc7p\") pod \"ceilometer-0\" (UID: \"992e69a3-0dcd-4c36-a4b0-9237e72b40d8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:14:36 crc kubenswrapper[5120]: I0316 17:14:36.302556 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/992e69a3-0dcd-4c36-a4b0-9237e72b40d8-scripts\") pod \"ceilometer-0\" (UID: \"992e69a3-0dcd-4c36-a4b0-9237e72b40d8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:14:36 crc kubenswrapper[5120]: I0316 17:14:36.303430 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/992e69a3-0dcd-4c36-a4b0-9237e72b40d8-run-httpd\") pod \"ceilometer-0\" (UID: \"992e69a3-0dcd-4c36-a4b0-9237e72b40d8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:14:36 crc kubenswrapper[5120]: I0316 17:14:36.303653 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/992e69a3-0dcd-4c36-a4b0-9237e72b40d8-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"992e69a3-0dcd-4c36-a4b0-9237e72b40d8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:14:36 crc kubenswrapper[5120]: I0316 17:14:36.303704 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/992e69a3-0dcd-4c36-a4b0-9237e72b40d8-log-httpd\") pod \"ceilometer-0\" (UID: \"992e69a3-0dcd-4c36-a4b0-9237e72b40d8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:14:36 crc kubenswrapper[5120]: I0316 17:14:36.303739 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/992e69a3-0dcd-4c36-a4b0-9237e72b40d8-config-data\") pod \"ceilometer-0\" (UID: \"992e69a3-0dcd-4c36-a4b0-9237e72b40d8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:14:36 crc kubenswrapper[5120]: I0316 17:14:36.304053 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/992e69a3-0dcd-4c36-a4b0-9237e72b40d8-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"992e69a3-0dcd-4c36-a4b0-9237e72b40d8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:14:36 crc kubenswrapper[5120]: I0316 17:14:36.304248 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/992e69a3-0dcd-4c36-a4b0-9237e72b40d8-run-httpd\") pod \"ceilometer-0\" (UID: \"992e69a3-0dcd-4c36-a4b0-9237e72b40d8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:14:36 crc kubenswrapper[5120]: I0316 17:14:36.304661 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/992e69a3-0dcd-4c36-a4b0-9237e72b40d8-log-httpd\") pod \"ceilometer-0\" (UID: \"992e69a3-0dcd-4c36-a4b0-9237e72b40d8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:14:36 crc kubenswrapper[5120]: I0316 17:14:36.307362 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/992e69a3-0dcd-4c36-a4b0-9237e72b40d8-scripts\") pod \"ceilometer-0\" (UID: \"992e69a3-0dcd-4c36-a4b0-9237e72b40d8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:14:36 crc kubenswrapper[5120]: I0316 17:14:36.308104 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/992e69a3-0dcd-4c36-a4b0-9237e72b40d8-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"992e69a3-0dcd-4c36-a4b0-9237e72b40d8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:14:36 crc kubenswrapper[5120]: I0316 17:14:36.308271 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/992e69a3-0dcd-4c36-a4b0-9237e72b40d8-config-data\") pod \"ceilometer-0\" (UID: \"992e69a3-0dcd-4c36-a4b0-9237e72b40d8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:14:36 crc kubenswrapper[5120]: I0316 17:14:36.308843 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/992e69a3-0dcd-4c36-a4b0-9237e72b40d8-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"992e69a3-0dcd-4c36-a4b0-9237e72b40d8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:14:36 crc kubenswrapper[5120]: I0316 17:14:36.325664 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wc7p\" (UniqueName: \"kubernetes.io/projected/992e69a3-0dcd-4c36-a4b0-9237e72b40d8-kube-api-access-6wc7p\") pod \"ceilometer-0\" (UID: \"992e69a3-0dcd-4c36-a4b0-9237e72b40d8\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:14:36 crc kubenswrapper[5120]: I0316 17:14:36.333180 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 17:14:36 crc kubenswrapper[5120]: I0316 17:14:36.437640 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:14:36 crc kubenswrapper[5120]: E0316 17:14:36.578253 5120 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1ae5285c_173c_4162_9610_3f9c3a4ef47b.slice\": RecentStats: unable to find data in memory cache]" Mar 16 17:14:36 crc kubenswrapper[5120]: I0316 17:14:36.676175 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0785abc6-13c2-4534-867f-170bb324d5d6" path="/var/lib/kubelet/pods/0785abc6-13c2-4534-867f-170bb324d5d6/volumes" Mar 16 17:14:36 crc kubenswrapper[5120]: I0316 17:14:36.807574 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 17:14:36 crc kubenswrapper[5120]: W0316 17:14:36.808701 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc0fcea62_ce96_4685_b87d_14c1c88f6018.slice/crio-ea20dacfe43ea105585cbd1c984ad545308ec8cdeb9adff9254dd2d179cba76d WatchSource:0}: Error finding container ea20dacfe43ea105585cbd1c984ad545308ec8cdeb9adff9254dd2d179cba76d: Status 404 returned error can't find the container with id ea20dacfe43ea105585cbd1c984ad545308ec8cdeb9adff9254dd2d179cba76d Mar 16 17:14:36 crc kubenswrapper[5120]: I0316 17:14:36.946978 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"c0fcea62-ce96-4685-b87d-14c1c88f6018","Type":"ContainerStarted","Data":"ea20dacfe43ea105585cbd1c984ad545308ec8cdeb9adff9254dd2d179cba76d"} Mar 16 17:14:36 crc kubenswrapper[5120]: W0316 17:14:36.981018 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod992e69a3_0dcd_4c36_a4b0_9237e72b40d8.slice/crio-c221fd7948ce727fd6fb813ed6b6e0dffad70228f40b2ab443cd30f560607250 WatchSource:0}: Error finding container c221fd7948ce727fd6fb813ed6b6e0dffad70228f40b2ab443cd30f560607250: Status 404 returned error can't find the container with id c221fd7948ce727fd6fb813ed6b6e0dffad70228f40b2ab443cd30f560607250 Mar 16 17:14:36 crc kubenswrapper[5120]: I0316 17:14:36.988045 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:14:37 crc kubenswrapper[5120]: I0316 17:14:37.025465 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:14:37 crc kubenswrapper[5120]: I0316 17:14:37.696273 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:14:37 crc kubenswrapper[5120]: I0316 17:14:37.853313 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/7ba88a08-571b-4c0c-ac5f-83f603d3ad93-public-tls-certs\") pod \"7ba88a08-571b-4c0c-ac5f-83f603d3ad93\" (UID: \"7ba88a08-571b-4c0c-ac5f-83f603d3ad93\") " Mar 16 17:14:37 crc kubenswrapper[5120]: I0316 17:14:37.853564 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7ba88a08-571b-4c0c-ac5f-83f603d3ad93-config-data\") pod \"7ba88a08-571b-4c0c-ac5f-83f603d3ad93\" (UID: \"7ba88a08-571b-4c0c-ac5f-83f603d3ad93\") " Mar 16 17:14:37 crc kubenswrapper[5120]: I0316 17:14:37.853951 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"7ba88a08-571b-4c0c-ac5f-83f603d3ad93\" (UID: \"7ba88a08-571b-4c0c-ac5f-83f603d3ad93\") " Mar 16 17:14:37 crc kubenswrapper[5120]: I0316 17:14:37.854064 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7ba88a08-571b-4c0c-ac5f-83f603d3ad93-scripts\") pod \"7ba88a08-571b-4c0c-ac5f-83f603d3ad93\" (UID: \"7ba88a08-571b-4c0c-ac5f-83f603d3ad93\") " Mar 16 17:14:37 crc kubenswrapper[5120]: I0316 17:14:37.854137 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/7ba88a08-571b-4c0c-ac5f-83f603d3ad93-httpd-run\") pod \"7ba88a08-571b-4c0c-ac5f-83f603d3ad93\" (UID: \"7ba88a08-571b-4c0c-ac5f-83f603d3ad93\") " Mar 16 17:14:37 crc kubenswrapper[5120]: I0316 17:14:37.854171 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7ba88a08-571b-4c0c-ac5f-83f603d3ad93-combined-ca-bundle\") pod \"7ba88a08-571b-4c0c-ac5f-83f603d3ad93\" (UID: \"7ba88a08-571b-4c0c-ac5f-83f603d3ad93\") " Mar 16 17:14:37 crc kubenswrapper[5120]: I0316 17:14:37.854193 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gjjw4\" (UniqueName: \"kubernetes.io/projected/7ba88a08-571b-4c0c-ac5f-83f603d3ad93-kube-api-access-gjjw4\") pod \"7ba88a08-571b-4c0c-ac5f-83f603d3ad93\" (UID: \"7ba88a08-571b-4c0c-ac5f-83f603d3ad93\") " Mar 16 17:14:37 crc kubenswrapper[5120]: I0316 17:14:37.854295 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7ba88a08-571b-4c0c-ac5f-83f603d3ad93-logs\") pod \"7ba88a08-571b-4c0c-ac5f-83f603d3ad93\" (UID: \"7ba88a08-571b-4c0c-ac5f-83f603d3ad93\") " Mar 16 17:14:37 crc kubenswrapper[5120]: I0316 17:14:37.855558 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ba88a08-571b-4c0c-ac5f-83f603d3ad93-logs" (OuterVolumeSpecName: "logs") pod "7ba88a08-571b-4c0c-ac5f-83f603d3ad93" (UID: "7ba88a08-571b-4c0c-ac5f-83f603d3ad93"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:14:37 crc kubenswrapper[5120]: I0316 17:14:37.859367 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ba88a08-571b-4c0c-ac5f-83f603d3ad93-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "7ba88a08-571b-4c0c-ac5f-83f603d3ad93" (UID: "7ba88a08-571b-4c0c-ac5f-83f603d3ad93"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:14:37 crc kubenswrapper[5120]: I0316 17:14:37.860748 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7ba88a08-571b-4c0c-ac5f-83f603d3ad93-scripts" (OuterVolumeSpecName: "scripts") pod "7ba88a08-571b-4c0c-ac5f-83f603d3ad93" (UID: "7ba88a08-571b-4c0c-ac5f-83f603d3ad93"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:14:37 crc kubenswrapper[5120]: I0316 17:14:37.861882 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage08-crc" (OuterVolumeSpecName: "glance") pod "7ba88a08-571b-4c0c-ac5f-83f603d3ad93" (UID: "7ba88a08-571b-4c0c-ac5f-83f603d3ad93"). InnerVolumeSpecName "local-storage08-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 17:14:37 crc kubenswrapper[5120]: I0316 17:14:37.863579 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ba88a08-571b-4c0c-ac5f-83f603d3ad93-kube-api-access-gjjw4" (OuterVolumeSpecName: "kube-api-access-gjjw4") pod "7ba88a08-571b-4c0c-ac5f-83f603d3ad93" (UID: "7ba88a08-571b-4c0c-ac5f-83f603d3ad93"). InnerVolumeSpecName "kube-api-access-gjjw4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:14:37 crc kubenswrapper[5120]: I0316 17:14:37.888997 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7ba88a08-571b-4c0c-ac5f-83f603d3ad93-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "7ba88a08-571b-4c0c-ac5f-83f603d3ad93" (UID: "7ba88a08-571b-4c0c-ac5f-83f603d3ad93"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:14:37 crc kubenswrapper[5120]: E0316 17:14:37.908214 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ba88a08-571b-4c0c-ac5f-83f603d3ad93-config-data podName:7ba88a08-571b-4c0c-ac5f-83f603d3ad93 nodeName:}" failed. No retries permitted until 2026-03-16 17:14:38.40818219 +0000 UTC m=+6180.562113847 (durationBeforeRetry 500ms). Error: error cleaning subPath mounts for volume "config-data" (UniqueName: "kubernetes.io/secret/7ba88a08-571b-4c0c-ac5f-83f603d3ad93-config-data") pod "7ba88a08-571b-4c0c-ac5f-83f603d3ad93" (UID: "7ba88a08-571b-4c0c-ac5f-83f603d3ad93") : error deleting /var/lib/kubelet/pods/7ba88a08-571b-4c0c-ac5f-83f603d3ad93/volume-subpaths: remove /var/lib/kubelet/pods/7ba88a08-571b-4c0c-ac5f-83f603d3ad93/volume-subpaths: no such file or directory Mar 16 17:14:37 crc kubenswrapper[5120]: I0316 17:14:37.911935 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7ba88a08-571b-4c0c-ac5f-83f603d3ad93-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "7ba88a08-571b-4c0c-ac5f-83f603d3ad93" (UID: "7ba88a08-571b-4c0c-ac5f-83f603d3ad93"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:14:37 crc kubenswrapper[5120]: I0316 17:14:37.956815 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") on node \"crc\" " Mar 16 17:14:37 crc kubenswrapper[5120]: I0316 17:14:37.956855 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7ba88a08-571b-4c0c-ac5f-83f603d3ad93-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:14:37 crc kubenswrapper[5120]: I0316 17:14:37.956866 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/7ba88a08-571b-4c0c-ac5f-83f603d3ad93-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 17:14:37 crc kubenswrapper[5120]: I0316 17:14:37.956876 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7ba88a08-571b-4c0c-ac5f-83f603d3ad93-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:14:37 crc kubenswrapper[5120]: I0316 17:14:37.956890 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gjjw4\" (UniqueName: \"kubernetes.io/projected/7ba88a08-571b-4c0c-ac5f-83f603d3ad93-kube-api-access-gjjw4\") on node \"crc\" DevicePath \"\"" Mar 16 17:14:37 crc kubenswrapper[5120]: I0316 17:14:37.956901 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7ba88a08-571b-4c0c-ac5f-83f603d3ad93-logs\") on node \"crc\" DevicePath \"\"" Mar 16 17:14:37 crc kubenswrapper[5120]: I0316 17:14:37.956910 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/7ba88a08-571b-4c0c-ac5f-83f603d3ad93-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:14:37 crc kubenswrapper[5120]: I0316 17:14:37.961961 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"c0fcea62-ce96-4685-b87d-14c1c88f6018","Type":"ContainerStarted","Data":"09697be63c3ff809ef058e7c47fb33335e0f92dbd8a8ca4429e77b3110c5e460"} Mar 16 17:14:37 crc kubenswrapper[5120]: I0316 17:14:37.963153 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 17:14:37 crc kubenswrapper[5120]: I0316 17:14:37.966482 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"992e69a3-0dcd-4c36-a4b0-9237e72b40d8","Type":"ContainerStarted","Data":"791f05e72472a3b286ce1a6c955b334bd9ecd78d1a994ca55d1193aedae7e79e"} Mar 16 17:14:37 crc kubenswrapper[5120]: I0316 17:14:37.966525 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"992e69a3-0dcd-4c36-a4b0-9237e72b40d8","Type":"ContainerStarted","Data":"c221fd7948ce727fd6fb813ed6b6e0dffad70228f40b2ab443cd30f560607250"} Mar 16 17:14:37 crc kubenswrapper[5120]: I0316 17:14:37.969336 5120 generic.go:358] "Generic (PLEG): container finished" podID="7ba88a08-571b-4c0c-ac5f-83f603d3ad93" containerID="54e729471c57221e9ec716b84ee8370905d0bbb88e60b3b95314d8aefd076e1c" exitCode=0 Mar 16 17:14:37 crc kubenswrapper[5120]: I0316 17:14:37.969468 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"7ba88a08-571b-4c0c-ac5f-83f603d3ad93","Type":"ContainerDied","Data":"54e729471c57221e9ec716b84ee8370905d0bbb88e60b3b95314d8aefd076e1c"} Mar 16 17:14:37 crc kubenswrapper[5120]: I0316 17:14:37.969497 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"7ba88a08-571b-4c0c-ac5f-83f603d3ad93","Type":"ContainerDied","Data":"056f1eec81fe4e00a2a68b9a58db70d2176eff20cd3a0bd5d694eb3b89e15573"} Mar 16 17:14:37 crc kubenswrapper[5120]: I0316 17:14:37.969518 5120 scope.go:117] "RemoveContainer" containerID="54e729471c57221e9ec716b84ee8370905d0bbb88e60b3b95314d8aefd076e1c" Mar 16 17:14:37 crc kubenswrapper[5120]: I0316 17:14:37.969657 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:14:37 crc kubenswrapper[5120]: I0316 17:14:37.982925 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage08-crc" (UniqueName: "kubernetes.io/local-volume/local-storage08-crc") on node "crc" Mar 16 17:14:37 crc kubenswrapper[5120]: I0316 17:14:37.986597 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podStartSLOduration=2.986574665 podStartE2EDuration="2.986574665s" podCreationTimestamp="2026-03-16 17:14:35 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:14:37.980598931 +0000 UTC m=+6180.134530598" watchObservedRunningTime="2026-03-16 17:14:37.986574665 +0000 UTC m=+6180.140506322" Mar 16 17:14:37 crc kubenswrapper[5120]: I0316 17:14:37.996607 5120 scope.go:117] "RemoveContainer" containerID="1ed9c53a6746c3dc8754c0f99816d11037ff980e3d1ca772d5df562eaafea0f1" Mar 16 17:14:38 crc kubenswrapper[5120]: I0316 17:14:38.017740 5120 scope.go:117] "RemoveContainer" containerID="54e729471c57221e9ec716b84ee8370905d0bbb88e60b3b95314d8aefd076e1c" Mar 16 17:14:38 crc kubenswrapper[5120]: E0316 17:14:38.018151 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"54e729471c57221e9ec716b84ee8370905d0bbb88e60b3b95314d8aefd076e1c\": container with ID starting with 54e729471c57221e9ec716b84ee8370905d0bbb88e60b3b95314d8aefd076e1c not found: ID does not exist" containerID="54e729471c57221e9ec716b84ee8370905d0bbb88e60b3b95314d8aefd076e1c" Mar 16 17:14:38 crc kubenswrapper[5120]: I0316 17:14:38.018209 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54e729471c57221e9ec716b84ee8370905d0bbb88e60b3b95314d8aefd076e1c"} err="failed to get container status \"54e729471c57221e9ec716b84ee8370905d0bbb88e60b3b95314d8aefd076e1c\": rpc error: code = NotFound desc = could not find container \"54e729471c57221e9ec716b84ee8370905d0bbb88e60b3b95314d8aefd076e1c\": container with ID starting with 54e729471c57221e9ec716b84ee8370905d0bbb88e60b3b95314d8aefd076e1c not found: ID does not exist" Mar 16 17:14:38 crc kubenswrapper[5120]: I0316 17:14:38.018237 5120 scope.go:117] "RemoveContainer" containerID="1ed9c53a6746c3dc8754c0f99816d11037ff980e3d1ca772d5df562eaafea0f1" Mar 16 17:14:38 crc kubenswrapper[5120]: E0316 17:14:38.018569 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ed9c53a6746c3dc8754c0f99816d11037ff980e3d1ca772d5df562eaafea0f1\": container with ID starting with 1ed9c53a6746c3dc8754c0f99816d11037ff980e3d1ca772d5df562eaafea0f1 not found: ID does not exist" containerID="1ed9c53a6746c3dc8754c0f99816d11037ff980e3d1ca772d5df562eaafea0f1" Mar 16 17:14:38 crc kubenswrapper[5120]: I0316 17:14:38.018600 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ed9c53a6746c3dc8754c0f99816d11037ff980e3d1ca772d5df562eaafea0f1"} err="failed to get container status \"1ed9c53a6746c3dc8754c0f99816d11037ff980e3d1ca772d5df562eaafea0f1\": rpc error: code = NotFound desc = could not find container \"1ed9c53a6746c3dc8754c0f99816d11037ff980e3d1ca772d5df562eaafea0f1\": container with ID starting with 1ed9c53a6746c3dc8754c0f99816d11037ff980e3d1ca772d5df562eaafea0f1 not found: ID does not exist" Mar 16 17:14:38 crc kubenswrapper[5120]: I0316 17:14:38.059370 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") on node \"crc\" DevicePath \"\"" Mar 16 17:14:38 crc kubenswrapper[5120]: I0316 17:14:38.469104 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7ba88a08-571b-4c0c-ac5f-83f603d3ad93-config-data\") pod \"7ba88a08-571b-4c0c-ac5f-83f603d3ad93\" (UID: \"7ba88a08-571b-4c0c-ac5f-83f603d3ad93\") " Mar 16 17:14:38 crc kubenswrapper[5120]: I0316 17:14:38.473863 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7ba88a08-571b-4c0c-ac5f-83f603d3ad93-config-data" (OuterVolumeSpecName: "config-data") pod "7ba88a08-571b-4c0c-ac5f-83f603d3ad93" (UID: "7ba88a08-571b-4c0c-ac5f-83f603d3ad93"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:14:38 crc kubenswrapper[5120]: I0316 17:14:38.582493 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7ba88a08-571b-4c0c-ac5f-83f603d3ad93-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:14:38 crc kubenswrapper[5120]: I0316 17:14:38.774067 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:14:38 crc kubenswrapper[5120]: I0316 17:14:38.788175 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 17:14:38 crc kubenswrapper[5120]: I0316 17:14:38.794288 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-85jxl\" (UniqueName: \"kubernetes.io/projected/bbfbf4e9-d150-4503-a4c0-8b14a69df4df-kube-api-access-85jxl\") pod \"bbfbf4e9-d150-4503-a4c0-8b14a69df4df\" (UID: \"bbfbf4e9-d150-4503-a4c0-8b14a69df4df\") " Mar 16 17:14:38 crc kubenswrapper[5120]: I0316 17:14:38.794348 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bbfbf4e9-d150-4503-a4c0-8b14a69df4df-combined-ca-bundle\") pod \"bbfbf4e9-d150-4503-a4c0-8b14a69df4df\" (UID: \"bbfbf4e9-d150-4503-a4c0-8b14a69df4df\") " Mar 16 17:14:38 crc kubenswrapper[5120]: I0316 17:14:38.794487 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/bbfbf4e9-d150-4503-a4c0-8b14a69df4df-logs\") pod \"bbfbf4e9-d150-4503-a4c0-8b14a69df4df\" (UID: \"bbfbf4e9-d150-4503-a4c0-8b14a69df4df\") " Mar 16 17:14:38 crc kubenswrapper[5120]: I0316 17:14:38.794606 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/bbfbf4e9-d150-4503-a4c0-8b14a69df4df-scripts\") pod \"bbfbf4e9-d150-4503-a4c0-8b14a69df4df\" (UID: \"bbfbf4e9-d150-4503-a4c0-8b14a69df4df\") " Mar 16 17:14:38 crc kubenswrapper[5120]: I0316 17:14:38.794880 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bbfbf4e9-d150-4503-a4c0-8b14a69df4df-config-data\") pod \"bbfbf4e9-d150-4503-a4c0-8b14a69df4df\" (UID: \"bbfbf4e9-d150-4503-a4c0-8b14a69df4df\") " Mar 16 17:14:38 crc kubenswrapper[5120]: I0316 17:14:38.794928 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/bbfbf4e9-d150-4503-a4c0-8b14a69df4df-internal-tls-certs\") pod \"bbfbf4e9-d150-4503-a4c0-8b14a69df4df\" (UID: \"bbfbf4e9-d150-4503-a4c0-8b14a69df4df\") " Mar 16 17:14:38 crc kubenswrapper[5120]: I0316 17:14:38.796394 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/bbfbf4e9-d150-4503-a4c0-8b14a69df4df-httpd-run\") pod \"bbfbf4e9-d150-4503-a4c0-8b14a69df4df\" (UID: \"bbfbf4e9-d150-4503-a4c0-8b14a69df4df\") " Mar 16 17:14:38 crc kubenswrapper[5120]: I0316 17:14:38.797544 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"bbfbf4e9-d150-4503-a4c0-8b14a69df4df\" (UID: \"bbfbf4e9-d150-4503-a4c0-8b14a69df4df\") " Mar 16 17:14:38 crc kubenswrapper[5120]: I0316 17:14:38.797875 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bbfbf4e9-d150-4503-a4c0-8b14a69df4df-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "bbfbf4e9-d150-4503-a4c0-8b14a69df4df" (UID: "bbfbf4e9-d150-4503-a4c0-8b14a69df4df"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:14:38 crc kubenswrapper[5120]: I0316 17:14:38.803095 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bbfbf4e9-d150-4503-a4c0-8b14a69df4df-logs" (OuterVolumeSpecName: "logs") pod "bbfbf4e9-d150-4503-a4c0-8b14a69df4df" (UID: "bbfbf4e9-d150-4503-a4c0-8b14a69df4df"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:14:38 crc kubenswrapper[5120]: I0316 17:14:38.803146 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/bbfbf4e9-d150-4503-a4c0-8b14a69df4df-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 17:14:38 crc kubenswrapper[5120]: I0316 17:14:38.814467 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bbfbf4e9-d150-4503-a4c0-8b14a69df4df-kube-api-access-85jxl" (OuterVolumeSpecName: "kube-api-access-85jxl") pod "bbfbf4e9-d150-4503-a4c0-8b14a69df4df" (UID: "bbfbf4e9-d150-4503-a4c0-8b14a69df4df"). InnerVolumeSpecName "kube-api-access-85jxl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:14:38 crc kubenswrapper[5120]: I0316 17:14:38.835466 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage01-crc" (OuterVolumeSpecName: "glance") pod "bbfbf4e9-d150-4503-a4c0-8b14a69df4df" (UID: "bbfbf4e9-d150-4503-a4c0-8b14a69df4df"). InnerVolumeSpecName "local-storage01-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 17:14:38 crc kubenswrapper[5120]: I0316 17:14:38.845494 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bbfbf4e9-d150-4503-a4c0-8b14a69df4df-scripts" (OuterVolumeSpecName: "scripts") pod "bbfbf4e9-d150-4503-a4c0-8b14a69df4df" (UID: "bbfbf4e9-d150-4503-a4c0-8b14a69df4df"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:14:38 crc kubenswrapper[5120]: I0316 17:14:38.849258 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 17:14:38 crc kubenswrapper[5120]: I0316 17:14:38.876941 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 17:14:38 crc kubenswrapper[5120]: I0316 17:14:38.887126 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ba88a08-571b-4c0c-ac5f-83f603d3ad93" containerName="glance-httpd" Mar 16 17:14:38 crc kubenswrapper[5120]: I0316 17:14:38.887182 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ba88a08-571b-4c0c-ac5f-83f603d3ad93" containerName="glance-httpd" Mar 16 17:14:38 crc kubenswrapper[5120]: I0316 17:14:38.887255 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bbfbf4e9-d150-4503-a4c0-8b14a69df4df" containerName="glance-httpd" Mar 16 17:14:38 crc kubenswrapper[5120]: I0316 17:14:38.887265 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="bbfbf4e9-d150-4503-a4c0-8b14a69df4df" containerName="glance-httpd" Mar 16 17:14:38 crc kubenswrapper[5120]: I0316 17:14:38.887352 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bbfbf4e9-d150-4503-a4c0-8b14a69df4df" containerName="glance-log" Mar 16 17:14:38 crc kubenswrapper[5120]: I0316 17:14:38.887358 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="bbfbf4e9-d150-4503-a4c0-8b14a69df4df" containerName="glance-log" Mar 16 17:14:38 crc kubenswrapper[5120]: I0316 17:14:38.887392 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ba88a08-571b-4c0c-ac5f-83f603d3ad93" containerName="glance-log" Mar 16 17:14:38 crc kubenswrapper[5120]: I0316 17:14:38.887398 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ba88a08-571b-4c0c-ac5f-83f603d3ad93" containerName="glance-log" Mar 16 17:14:38 crc kubenswrapper[5120]: I0316 17:14:38.887999 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="bbfbf4e9-d150-4503-a4c0-8b14a69df4df" containerName="glance-httpd" Mar 16 17:14:38 crc kubenswrapper[5120]: I0316 17:14:38.888027 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7ba88a08-571b-4c0c-ac5f-83f603d3ad93" containerName="glance-httpd" Mar 16 17:14:38 crc kubenswrapper[5120]: I0316 17:14:38.888050 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7ba88a08-571b-4c0c-ac5f-83f603d3ad93" containerName="glance-log" Mar 16 17:14:38 crc kubenswrapper[5120]: I0316 17:14:38.888067 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="bbfbf4e9-d150-4503-a4c0-8b14a69df4df" containerName="glance-log" Mar 16 17:14:38 crc kubenswrapper[5120]: I0316 17:14:38.905828 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:14:38 crc kubenswrapper[5120]: I0316 17:14:38.912627 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-external-config-data\"" Mar 16 17:14:38 crc kubenswrapper[5120]: I0316 17:14:38.913037 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-public-svc\"" Mar 16 17:14:38 crc kubenswrapper[5120]: I0316 17:14:38.926929 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-85jxl\" (UniqueName: \"kubernetes.io/projected/bbfbf4e9-d150-4503-a4c0-8b14a69df4df-kube-api-access-85jxl\") on node \"crc\" DevicePath \"\"" Mar 16 17:14:38 crc kubenswrapper[5120]: I0316 17:14:38.926969 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/bbfbf4e9-d150-4503-a4c0-8b14a69df4df-logs\") on node \"crc\" DevicePath \"\"" Mar 16 17:14:38 crc kubenswrapper[5120]: I0316 17:14:38.926982 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/bbfbf4e9-d150-4503-a4c0-8b14a69df4df-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:14:38 crc kubenswrapper[5120]: I0316 17:14:38.927033 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") on node \"crc\" " Mar 16 17:14:38 crc kubenswrapper[5120]: I0316 17:14:38.968954 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 17:14:38 crc kubenswrapper[5120]: I0316 17:14:38.985886 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage01-crc" (UniqueName: "kubernetes.io/local-volume/local-storage01-crc") on node "crc" Mar 16 17:14:38 crc kubenswrapper[5120]: I0316 17:14:38.989926 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bbfbf4e9-d150-4503-a4c0-8b14a69df4df-config-data" (OuterVolumeSpecName: "config-data") pod "bbfbf4e9-d150-4503-a4c0-8b14a69df4df" (UID: "bbfbf4e9-d150-4503-a4c0-8b14a69df4df"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:14:38 crc kubenswrapper[5120]: I0316 17:14:38.991653 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bbfbf4e9-d150-4503-a4c0-8b14a69df4df-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "bbfbf4e9-d150-4503-a4c0-8b14a69df4df" (UID: "bbfbf4e9-d150-4503-a4c0-8b14a69df4df"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:14:39 crc kubenswrapper[5120]: I0316 17:14:39.004467 5120 generic.go:358] "Generic (PLEG): container finished" podID="bbfbf4e9-d150-4503-a4c0-8b14a69df4df" containerID="165cb675ff60493ed7f2f63380d0a54cce174c472205e9a50516b951f274ac29" exitCode=0 Mar 16 17:14:39 crc kubenswrapper[5120]: I0316 17:14:39.004992 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"bbfbf4e9-d150-4503-a4c0-8b14a69df4df","Type":"ContainerDied","Data":"165cb675ff60493ed7f2f63380d0a54cce174c472205e9a50516b951f274ac29"} Mar 16 17:14:39 crc kubenswrapper[5120]: I0316 17:14:39.005038 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"bbfbf4e9-d150-4503-a4c0-8b14a69df4df","Type":"ContainerDied","Data":"5ebeb818fef0335be6911d7f454868d5ee5928fdd11852b00899d1b70d2b4699"} Mar 16 17:14:39 crc kubenswrapper[5120]: I0316 17:14:39.005058 5120 scope.go:117] "RemoveContainer" containerID="165cb675ff60493ed7f2f63380d0a54cce174c472205e9a50516b951f274ac29" Mar 16 17:14:39 crc kubenswrapper[5120]: I0316 17:14:39.005253 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:14:39 crc kubenswrapper[5120]: I0316 17:14:39.016453 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bbfbf4e9-d150-4503-a4c0-8b14a69df4df-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "bbfbf4e9-d150-4503-a4c0-8b14a69df4df" (UID: "bbfbf4e9-d150-4503-a4c0-8b14a69df4df"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:14:39 crc kubenswrapper[5120]: I0316 17:14:39.030101 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/62f72752-1070-4856-aec8-5d8c07039d97-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"62f72752-1070-4856-aec8-5d8c07039d97\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:14:39 crc kubenswrapper[5120]: I0316 17:14:39.030143 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"glance-default-external-api-0\" (UID: \"62f72752-1070-4856-aec8-5d8c07039d97\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:14:39 crc kubenswrapper[5120]: I0316 17:14:39.030182 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/62f72752-1070-4856-aec8-5d8c07039d97-config-data\") pod \"glance-default-external-api-0\" (UID: \"62f72752-1070-4856-aec8-5d8c07039d97\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:14:39 crc kubenswrapper[5120]: I0316 17:14:39.030262 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9bwcm\" (UniqueName: \"kubernetes.io/projected/62f72752-1070-4856-aec8-5d8c07039d97-kube-api-access-9bwcm\") pod \"glance-default-external-api-0\" (UID: \"62f72752-1070-4856-aec8-5d8c07039d97\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:14:39 crc kubenswrapper[5120]: I0316 17:14:39.030333 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/62f72752-1070-4856-aec8-5d8c07039d97-logs\") pod \"glance-default-external-api-0\" (UID: \"62f72752-1070-4856-aec8-5d8c07039d97\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:14:39 crc kubenswrapper[5120]: I0316 17:14:39.030831 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/62f72752-1070-4856-aec8-5d8c07039d97-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"62f72752-1070-4856-aec8-5d8c07039d97\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:14:39 crc kubenswrapper[5120]: I0316 17:14:39.031205 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/62f72752-1070-4856-aec8-5d8c07039d97-scripts\") pod \"glance-default-external-api-0\" (UID: \"62f72752-1070-4856-aec8-5d8c07039d97\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:14:39 crc kubenswrapper[5120]: I0316 17:14:39.031574 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/62f72752-1070-4856-aec8-5d8c07039d97-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"62f72752-1070-4856-aec8-5d8c07039d97\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:14:39 crc kubenswrapper[5120]: I0316 17:14:39.032125 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bbfbf4e9-d150-4503-a4c0-8b14a69df4df-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:14:39 crc kubenswrapper[5120]: I0316 17:14:39.032142 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/bbfbf4e9-d150-4503-a4c0-8b14a69df4df-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:14:39 crc kubenswrapper[5120]: I0316 17:14:39.032666 5120 scope.go:117] "RemoveContainer" containerID="2eed823221a09ad2c0fa2339feadeb66bc2b67e0c290b8deb917754ac315f27b" Mar 16 17:14:39 crc kubenswrapper[5120]: I0316 17:14:39.033066 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") on node \"crc\" DevicePath \"\"" Mar 16 17:14:39 crc kubenswrapper[5120]: I0316 17:14:39.033090 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bbfbf4e9-d150-4503-a4c0-8b14a69df4df-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:14:39 crc kubenswrapper[5120]: I0316 17:14:39.065450 5120 scope.go:117] "RemoveContainer" containerID="165cb675ff60493ed7f2f63380d0a54cce174c472205e9a50516b951f274ac29" Mar 16 17:14:39 crc kubenswrapper[5120]: E0316 17:14:39.065968 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"165cb675ff60493ed7f2f63380d0a54cce174c472205e9a50516b951f274ac29\": container with ID starting with 165cb675ff60493ed7f2f63380d0a54cce174c472205e9a50516b951f274ac29 not found: ID does not exist" containerID="165cb675ff60493ed7f2f63380d0a54cce174c472205e9a50516b951f274ac29" Mar 16 17:14:39 crc kubenswrapper[5120]: I0316 17:14:39.066022 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"165cb675ff60493ed7f2f63380d0a54cce174c472205e9a50516b951f274ac29"} err="failed to get container status \"165cb675ff60493ed7f2f63380d0a54cce174c472205e9a50516b951f274ac29\": rpc error: code = NotFound desc = could not find container \"165cb675ff60493ed7f2f63380d0a54cce174c472205e9a50516b951f274ac29\": container with ID starting with 165cb675ff60493ed7f2f63380d0a54cce174c472205e9a50516b951f274ac29 not found: ID does not exist" Mar 16 17:14:39 crc kubenswrapper[5120]: I0316 17:14:39.066048 5120 scope.go:117] "RemoveContainer" containerID="2eed823221a09ad2c0fa2339feadeb66bc2b67e0c290b8deb917754ac315f27b" Mar 16 17:14:39 crc kubenswrapper[5120]: E0316 17:14:39.066424 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2eed823221a09ad2c0fa2339feadeb66bc2b67e0c290b8deb917754ac315f27b\": container with ID starting with 2eed823221a09ad2c0fa2339feadeb66bc2b67e0c290b8deb917754ac315f27b not found: ID does not exist" containerID="2eed823221a09ad2c0fa2339feadeb66bc2b67e0c290b8deb917754ac315f27b" Mar 16 17:14:39 crc kubenswrapper[5120]: I0316 17:14:39.066481 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2eed823221a09ad2c0fa2339feadeb66bc2b67e0c290b8deb917754ac315f27b"} err="failed to get container status \"2eed823221a09ad2c0fa2339feadeb66bc2b67e0c290b8deb917754ac315f27b\": rpc error: code = NotFound desc = could not find container \"2eed823221a09ad2c0fa2339feadeb66bc2b67e0c290b8deb917754ac315f27b\": container with ID starting with 2eed823221a09ad2c0fa2339feadeb66bc2b67e0c290b8deb917754ac315f27b not found: ID does not exist" Mar 16 17:14:39 crc kubenswrapper[5120]: I0316 17:14:39.135004 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/62f72752-1070-4856-aec8-5d8c07039d97-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"62f72752-1070-4856-aec8-5d8c07039d97\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:14:39 crc kubenswrapper[5120]: I0316 17:14:39.135108 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/62f72752-1070-4856-aec8-5d8c07039d97-scripts\") pod \"glance-default-external-api-0\" (UID: \"62f72752-1070-4856-aec8-5d8c07039d97\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:14:39 crc kubenswrapper[5120]: I0316 17:14:39.135156 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/62f72752-1070-4856-aec8-5d8c07039d97-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"62f72752-1070-4856-aec8-5d8c07039d97\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:14:39 crc kubenswrapper[5120]: I0316 17:14:39.135251 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/62f72752-1070-4856-aec8-5d8c07039d97-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"62f72752-1070-4856-aec8-5d8c07039d97\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:14:39 crc kubenswrapper[5120]: I0316 17:14:39.135282 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"glance-default-external-api-0\" (UID: \"62f72752-1070-4856-aec8-5d8c07039d97\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:14:39 crc kubenswrapper[5120]: I0316 17:14:39.135327 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/62f72752-1070-4856-aec8-5d8c07039d97-config-data\") pod \"glance-default-external-api-0\" (UID: \"62f72752-1070-4856-aec8-5d8c07039d97\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:14:39 crc kubenswrapper[5120]: I0316 17:14:39.135364 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9bwcm\" (UniqueName: \"kubernetes.io/projected/62f72752-1070-4856-aec8-5d8c07039d97-kube-api-access-9bwcm\") pod \"glance-default-external-api-0\" (UID: \"62f72752-1070-4856-aec8-5d8c07039d97\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:14:39 crc kubenswrapper[5120]: I0316 17:14:39.135389 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/62f72752-1070-4856-aec8-5d8c07039d97-logs\") pod \"glance-default-external-api-0\" (UID: \"62f72752-1070-4856-aec8-5d8c07039d97\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:14:39 crc kubenswrapper[5120]: I0316 17:14:39.136060 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/62f72752-1070-4856-aec8-5d8c07039d97-logs\") pod \"glance-default-external-api-0\" (UID: \"62f72752-1070-4856-aec8-5d8c07039d97\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:14:39 crc kubenswrapper[5120]: I0316 17:14:39.136371 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"glance-default-external-api-0\" (UID: \"62f72752-1070-4856-aec8-5d8c07039d97\") device mount path \"/mnt/openstack/pv08\"" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:14:39 crc kubenswrapper[5120]: I0316 17:14:39.136468 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/62f72752-1070-4856-aec8-5d8c07039d97-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"62f72752-1070-4856-aec8-5d8c07039d97\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:14:39 crc kubenswrapper[5120]: I0316 17:14:39.139493 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/62f72752-1070-4856-aec8-5d8c07039d97-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"62f72752-1070-4856-aec8-5d8c07039d97\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:14:39 crc kubenswrapper[5120]: I0316 17:14:39.139967 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/62f72752-1070-4856-aec8-5d8c07039d97-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"62f72752-1070-4856-aec8-5d8c07039d97\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:14:39 crc kubenswrapper[5120]: I0316 17:14:39.140079 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/62f72752-1070-4856-aec8-5d8c07039d97-scripts\") pod \"glance-default-external-api-0\" (UID: \"62f72752-1070-4856-aec8-5d8c07039d97\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:14:39 crc kubenswrapper[5120]: I0316 17:14:39.141405 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/62f72752-1070-4856-aec8-5d8c07039d97-config-data\") pod \"glance-default-external-api-0\" (UID: \"62f72752-1070-4856-aec8-5d8c07039d97\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:14:39 crc kubenswrapper[5120]: I0316 17:14:39.160562 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9bwcm\" (UniqueName: \"kubernetes.io/projected/62f72752-1070-4856-aec8-5d8c07039d97-kube-api-access-9bwcm\") pod \"glance-default-external-api-0\" (UID: \"62f72752-1070-4856-aec8-5d8c07039d97\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:14:39 crc kubenswrapper[5120]: I0316 17:14:39.175833 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"glance-default-external-api-0\" (UID: \"62f72752-1070-4856-aec8-5d8c07039d97\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:14:39 crc kubenswrapper[5120]: I0316 17:14:39.265333 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:14:39 crc kubenswrapper[5120]: I0316 17:14:39.414161 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 17:14:39 crc kubenswrapper[5120]: I0316 17:14:39.428744 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 17:14:39 crc kubenswrapper[5120]: I0316 17:14:39.460241 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 17:14:39 crc kubenswrapper[5120]: I0316 17:14:39.469932 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:14:39 crc kubenswrapper[5120]: I0316 17:14:39.478550 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-internal-svc\"" Mar 16 17:14:39 crc kubenswrapper[5120]: I0316 17:14:39.478831 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-internal-config-data\"" Mar 16 17:14:39 crc kubenswrapper[5120]: I0316 17:14:39.498466 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 17:14:39 crc kubenswrapper[5120]: I0316 17:14:39.547179 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cb2bdc0a-77bc-488e-b188-7b24ac191d5a-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"cb2bdc0a-77bc-488e-b188-7b24ac191d5a\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:14:39 crc kubenswrapper[5120]: I0316 17:14:39.547327 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cb2bdc0a-77bc-488e-b188-7b24ac191d5a-config-data\") pod \"glance-default-internal-api-0\" (UID: \"cb2bdc0a-77bc-488e-b188-7b24ac191d5a\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:14:39 crc kubenswrapper[5120]: I0316 17:14:39.547570 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/cb2bdc0a-77bc-488e-b188-7b24ac191d5a-logs\") pod \"glance-default-internal-api-0\" (UID: \"cb2bdc0a-77bc-488e-b188-7b24ac191d5a\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:14:39 crc kubenswrapper[5120]: I0316 17:14:39.547644 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/cb2bdc0a-77bc-488e-b188-7b24ac191d5a-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"cb2bdc0a-77bc-488e-b188-7b24ac191d5a\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:14:39 crc kubenswrapper[5120]: I0316 17:14:39.547707 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/cb2bdc0a-77bc-488e-b188-7b24ac191d5a-scripts\") pod \"glance-default-internal-api-0\" (UID: \"cb2bdc0a-77bc-488e-b188-7b24ac191d5a\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:14:39 crc kubenswrapper[5120]: I0316 17:14:39.547738 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9l245\" (UniqueName: \"kubernetes.io/projected/cb2bdc0a-77bc-488e-b188-7b24ac191d5a-kube-api-access-9l245\") pod \"glance-default-internal-api-0\" (UID: \"cb2bdc0a-77bc-488e-b188-7b24ac191d5a\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:14:39 crc kubenswrapper[5120]: I0316 17:14:39.547794 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"glance-default-internal-api-0\" (UID: \"cb2bdc0a-77bc-488e-b188-7b24ac191d5a\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:14:39 crc kubenswrapper[5120]: I0316 17:14:39.547828 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/cb2bdc0a-77bc-488e-b188-7b24ac191d5a-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"cb2bdc0a-77bc-488e-b188-7b24ac191d5a\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:14:39 crc kubenswrapper[5120]: I0316 17:14:39.651147 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/cb2bdc0a-77bc-488e-b188-7b24ac191d5a-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"cb2bdc0a-77bc-488e-b188-7b24ac191d5a\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:14:39 crc kubenswrapper[5120]: I0316 17:14:39.651296 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/cb2bdc0a-77bc-488e-b188-7b24ac191d5a-scripts\") pod \"glance-default-internal-api-0\" (UID: \"cb2bdc0a-77bc-488e-b188-7b24ac191d5a\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:14:39 crc kubenswrapper[5120]: I0316 17:14:39.651345 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9l245\" (UniqueName: \"kubernetes.io/projected/cb2bdc0a-77bc-488e-b188-7b24ac191d5a-kube-api-access-9l245\") pod \"glance-default-internal-api-0\" (UID: \"cb2bdc0a-77bc-488e-b188-7b24ac191d5a\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:14:39 crc kubenswrapper[5120]: I0316 17:14:39.651416 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"glance-default-internal-api-0\" (UID: \"cb2bdc0a-77bc-488e-b188-7b24ac191d5a\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:14:39 crc kubenswrapper[5120]: I0316 17:14:39.651470 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/cb2bdc0a-77bc-488e-b188-7b24ac191d5a-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"cb2bdc0a-77bc-488e-b188-7b24ac191d5a\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:14:39 crc kubenswrapper[5120]: I0316 17:14:39.651731 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cb2bdc0a-77bc-488e-b188-7b24ac191d5a-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"cb2bdc0a-77bc-488e-b188-7b24ac191d5a\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:14:39 crc kubenswrapper[5120]: I0316 17:14:39.652066 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cb2bdc0a-77bc-488e-b188-7b24ac191d5a-config-data\") pod \"glance-default-internal-api-0\" (UID: \"cb2bdc0a-77bc-488e-b188-7b24ac191d5a\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:14:39 crc kubenswrapper[5120]: I0316 17:14:39.652222 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/cb2bdc0a-77bc-488e-b188-7b24ac191d5a-logs\") pod \"glance-default-internal-api-0\" (UID: \"cb2bdc0a-77bc-488e-b188-7b24ac191d5a\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:14:39 crc kubenswrapper[5120]: I0316 17:14:39.652914 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"glance-default-internal-api-0\" (UID: \"cb2bdc0a-77bc-488e-b188-7b24ac191d5a\") device mount path \"/mnt/openstack/pv01\"" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:14:39 crc kubenswrapper[5120]: I0316 17:14:39.664209 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/cb2bdc0a-77bc-488e-b188-7b24ac191d5a-logs\") pod \"glance-default-internal-api-0\" (UID: \"cb2bdc0a-77bc-488e-b188-7b24ac191d5a\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:14:39 crc kubenswrapper[5120]: I0316 17:14:39.664410 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/cb2bdc0a-77bc-488e-b188-7b24ac191d5a-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"cb2bdc0a-77bc-488e-b188-7b24ac191d5a\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:14:39 crc kubenswrapper[5120]: I0316 17:14:39.665334 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/cb2bdc0a-77bc-488e-b188-7b24ac191d5a-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"cb2bdc0a-77bc-488e-b188-7b24ac191d5a\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:14:39 crc kubenswrapper[5120]: I0316 17:14:39.665438 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cb2bdc0a-77bc-488e-b188-7b24ac191d5a-config-data\") pod \"glance-default-internal-api-0\" (UID: \"cb2bdc0a-77bc-488e-b188-7b24ac191d5a\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:14:39 crc kubenswrapper[5120]: I0316 17:14:39.665947 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cb2bdc0a-77bc-488e-b188-7b24ac191d5a-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"cb2bdc0a-77bc-488e-b188-7b24ac191d5a\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:14:39 crc kubenswrapper[5120]: I0316 17:14:39.666408 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/cb2bdc0a-77bc-488e-b188-7b24ac191d5a-scripts\") pod \"glance-default-internal-api-0\" (UID: \"cb2bdc0a-77bc-488e-b188-7b24ac191d5a\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:14:39 crc kubenswrapper[5120]: I0316 17:14:39.673487 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9l245\" (UniqueName: \"kubernetes.io/projected/cb2bdc0a-77bc-488e-b188-7b24ac191d5a-kube-api-access-9l245\") pod \"glance-default-internal-api-0\" (UID: \"cb2bdc0a-77bc-488e-b188-7b24ac191d5a\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:14:39 crc kubenswrapper[5120]: I0316 17:14:39.690334 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"glance-default-internal-api-0\" (UID: \"cb2bdc0a-77bc-488e-b188-7b24ac191d5a\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:14:39 crc kubenswrapper[5120]: I0316 17:14:39.759629 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 17:14:39 crc kubenswrapper[5120]: I0316 17:14:39.869305 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:14:40 crc kubenswrapper[5120]: I0316 17:14:40.051923 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"992e69a3-0dcd-4c36-a4b0-9237e72b40d8","Type":"ContainerStarted","Data":"55505d97116e532650afe38eb13ae4c750df44e60325799083de6d7f35108f80"} Mar 16 17:14:40 crc kubenswrapper[5120]: I0316 17:14:40.052304 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"992e69a3-0dcd-4c36-a4b0-9237e72b40d8","Type":"ContainerStarted","Data":"c3a482b53aad03821db999b91fb95eace5652c47e8061eb81c6e4157794dbed0"} Mar 16 17:14:40 crc kubenswrapper[5120]: I0316 17:14:40.057487 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"62f72752-1070-4856-aec8-5d8c07039d97","Type":"ContainerStarted","Data":"f9b905efdc4791ea2da530e7d659bd7656fb4bf0fd651a8c7dab77feaf04aa20"} Mar 16 17:14:40 crc kubenswrapper[5120]: I0316 17:14:40.319940 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 17:14:40 crc kubenswrapper[5120]: W0316 17:14:40.328405 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcb2bdc0a_77bc_488e_b188_7b24ac191d5a.slice/crio-e4e4012bfa365091d8d01567a0a876d1fe067607075f90c91a428b5da542fb09 WatchSource:0}: Error finding container e4e4012bfa365091d8d01567a0a876d1fe067607075f90c91a428b5da542fb09: Status 404 returned error can't find the container with id e4e4012bfa365091d8d01567a0a876d1fe067607075f90c91a428b5da542fb09 Mar 16 17:14:40 crc kubenswrapper[5120]: I0316 17:14:40.680363 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7ba88a08-571b-4c0c-ac5f-83f603d3ad93" path="/var/lib/kubelet/pods/7ba88a08-571b-4c0c-ac5f-83f603d3ad93/volumes" Mar 16 17:14:40 crc kubenswrapper[5120]: I0316 17:14:40.681429 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bbfbf4e9-d150-4503-a4c0-8b14a69df4df" path="/var/lib/kubelet/pods/bbfbf4e9-d150-4503-a4c0-8b14a69df4df/volumes" Mar 16 17:14:41 crc kubenswrapper[5120]: I0316 17:14:41.067967 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"62f72752-1070-4856-aec8-5d8c07039d97","Type":"ContainerStarted","Data":"0e110ef2792718360be3ee1663482cb6f5cc62b4790878591732d8863f4f7e26"} Mar 16 17:14:41 crc kubenswrapper[5120]: I0316 17:14:41.072730 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"cb2bdc0a-77bc-488e-b188-7b24ac191d5a","Type":"ContainerStarted","Data":"2ca16c8a2100af38c2f2f32b05d02ec4bd230df464049dbad13abfbaf9e81bfd"} Mar 16 17:14:41 crc kubenswrapper[5120]: I0316 17:14:41.072809 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"cb2bdc0a-77bc-488e-b188-7b24ac191d5a","Type":"ContainerStarted","Data":"e4e4012bfa365091d8d01567a0a876d1fe067607075f90c91a428b5da542fb09"} Mar 16 17:14:42 crc kubenswrapper[5120]: I0316 17:14:42.085041 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"992e69a3-0dcd-4c36-a4b0-9237e72b40d8","Type":"ContainerStarted","Data":"5bd45b8803399f906a61baa6e3d7f92f95af07fd4663b4e286836b615197ef3d"} Mar 16 17:14:42 crc kubenswrapper[5120]: I0316 17:14:42.085565 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:14:42 crc kubenswrapper[5120]: I0316 17:14:42.085153 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="992e69a3-0dcd-4c36-a4b0-9237e72b40d8" containerName="ceilometer-notification-agent" containerID="cri-o://c3a482b53aad03821db999b91fb95eace5652c47e8061eb81c6e4157794dbed0" gracePeriod=30 Mar 16 17:14:42 crc kubenswrapper[5120]: I0316 17:14:42.085131 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="992e69a3-0dcd-4c36-a4b0-9237e72b40d8" containerName="ceilometer-central-agent" containerID="cri-o://791f05e72472a3b286ce1a6c955b334bd9ecd78d1a994ca55d1193aedae7e79e" gracePeriod=30 Mar 16 17:14:42 crc kubenswrapper[5120]: I0316 17:14:42.085148 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="992e69a3-0dcd-4c36-a4b0-9237e72b40d8" containerName="sg-core" containerID="cri-o://55505d97116e532650afe38eb13ae4c750df44e60325799083de6d7f35108f80" gracePeriod=30 Mar 16 17:14:42 crc kubenswrapper[5120]: I0316 17:14:42.085179 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="992e69a3-0dcd-4c36-a4b0-9237e72b40d8" containerName="proxy-httpd" containerID="cri-o://5bd45b8803399f906a61baa6e3d7f92f95af07fd4663b4e286836b615197ef3d" gracePeriod=30 Mar 16 17:14:42 crc kubenswrapper[5120]: I0316 17:14:42.095721 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"cb2bdc0a-77bc-488e-b188-7b24ac191d5a","Type":"ContainerStarted","Data":"929557ee53c06ee6a62396db9c05cee3c027bea6a01f146959a43bff603e7e02"} Mar 16 17:14:42 crc kubenswrapper[5120]: I0316 17:14:42.101698 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"62f72752-1070-4856-aec8-5d8c07039d97","Type":"ContainerStarted","Data":"06604bb2c03297dccc451cd8484387f58b33faae3ce7c0addf37f2c72a32bbd0"} Mar 16 17:14:42 crc kubenswrapper[5120]: I0316 17:14:42.115126 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.87603245 podStartE2EDuration="7.115106638s" podCreationTimestamp="2026-03-16 17:14:35 +0000 UTC" firstStartedPulling="2026-03-16 17:14:36.982592726 +0000 UTC m=+6179.136524383" lastFinishedPulling="2026-03-16 17:14:41.221666914 +0000 UTC m=+6183.375598571" observedRunningTime="2026-03-16 17:14:42.108309402 +0000 UTC m=+6184.262241059" watchObservedRunningTime="2026-03-16 17:14:42.115106638 +0000 UTC m=+6184.269038295" Mar 16 17:14:42 crc kubenswrapper[5120]: I0316 17:14:42.131832 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-internal-api-0" podStartSLOduration=3.131808665 podStartE2EDuration="3.131808665s" podCreationTimestamp="2026-03-16 17:14:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:14:42.128187335 +0000 UTC m=+6184.282118992" watchObservedRunningTime="2026-03-16 17:14:42.131808665 +0000 UTC m=+6184.285740322" Mar 16 17:14:42 crc kubenswrapper[5120]: I0316 17:14:42.149585 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-external-api-0" podStartSLOduration=4.149562231 podStartE2EDuration="4.149562231s" podCreationTimestamp="2026-03-16 17:14:38 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:14:42.149204371 +0000 UTC m=+6184.303136028" watchObservedRunningTime="2026-03-16 17:14:42.149562231 +0000 UTC m=+6184.303493888" Mar 16 17:14:42 crc kubenswrapper[5120]: I0316 17:14:42.578234 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-marketplace-4hff7"] Mar 16 17:14:42 crc kubenswrapper[5120]: I0316 17:14:42.595550 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-4hff7" Mar 16 17:14:42 crc kubenswrapper[5120]: I0316 17:14:42.622861 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-4hff7"] Mar 16 17:14:42 crc kubenswrapper[5120]: I0316 17:14:42.642620 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smlk5\" (UniqueName: \"kubernetes.io/projected/cc6c9a09-f17f-4ebc-a57d-d440091fcad8-kube-api-access-smlk5\") pod \"redhat-marketplace-4hff7\" (UID: \"cc6c9a09-f17f-4ebc-a57d-d440091fcad8\") " pod="openshift-marketplace/redhat-marketplace-4hff7" Mar 16 17:14:42 crc kubenswrapper[5120]: I0316 17:14:42.643172 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/cc6c9a09-f17f-4ebc-a57d-d440091fcad8-catalog-content\") pod \"redhat-marketplace-4hff7\" (UID: \"cc6c9a09-f17f-4ebc-a57d-d440091fcad8\") " pod="openshift-marketplace/redhat-marketplace-4hff7" Mar 16 17:14:42 crc kubenswrapper[5120]: I0316 17:14:42.643448 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/cc6c9a09-f17f-4ebc-a57d-d440091fcad8-utilities\") pod \"redhat-marketplace-4hff7\" (UID: \"cc6c9a09-f17f-4ebc-a57d-d440091fcad8\") " pod="openshift-marketplace/redhat-marketplace-4hff7" Mar 16 17:14:42 crc kubenswrapper[5120]: I0316 17:14:42.746335 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/cc6c9a09-f17f-4ebc-a57d-d440091fcad8-catalog-content\") pod \"redhat-marketplace-4hff7\" (UID: \"cc6c9a09-f17f-4ebc-a57d-d440091fcad8\") " pod="openshift-marketplace/redhat-marketplace-4hff7" Mar 16 17:14:42 crc kubenswrapper[5120]: I0316 17:14:42.746474 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/cc6c9a09-f17f-4ebc-a57d-d440091fcad8-utilities\") pod \"redhat-marketplace-4hff7\" (UID: \"cc6c9a09-f17f-4ebc-a57d-d440091fcad8\") " pod="openshift-marketplace/redhat-marketplace-4hff7" Mar 16 17:14:42 crc kubenswrapper[5120]: I0316 17:14:42.746692 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-smlk5\" (UniqueName: \"kubernetes.io/projected/cc6c9a09-f17f-4ebc-a57d-d440091fcad8-kube-api-access-smlk5\") pod \"redhat-marketplace-4hff7\" (UID: \"cc6c9a09-f17f-4ebc-a57d-d440091fcad8\") " pod="openshift-marketplace/redhat-marketplace-4hff7" Mar 16 17:14:42 crc kubenswrapper[5120]: I0316 17:14:42.747607 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/cc6c9a09-f17f-4ebc-a57d-d440091fcad8-catalog-content\") pod \"redhat-marketplace-4hff7\" (UID: \"cc6c9a09-f17f-4ebc-a57d-d440091fcad8\") " pod="openshift-marketplace/redhat-marketplace-4hff7" Mar 16 17:14:42 crc kubenswrapper[5120]: I0316 17:14:42.747702 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/cc6c9a09-f17f-4ebc-a57d-d440091fcad8-utilities\") pod \"redhat-marketplace-4hff7\" (UID: \"cc6c9a09-f17f-4ebc-a57d-d440091fcad8\") " pod="openshift-marketplace/redhat-marketplace-4hff7" Mar 16 17:14:42 crc kubenswrapper[5120]: I0316 17:14:42.767826 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-smlk5\" (UniqueName: \"kubernetes.io/projected/cc6c9a09-f17f-4ebc-a57d-d440091fcad8-kube-api-access-smlk5\") pod \"redhat-marketplace-4hff7\" (UID: \"cc6c9a09-f17f-4ebc-a57d-d440091fcad8\") " pod="openshift-marketplace/redhat-marketplace-4hff7" Mar 16 17:14:42 crc kubenswrapper[5120]: I0316 17:14:42.930147 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-4hff7" Mar 16 17:14:43 crc kubenswrapper[5120]: I0316 17:14:43.125238 5120 generic.go:358] "Generic (PLEG): container finished" podID="992e69a3-0dcd-4c36-a4b0-9237e72b40d8" containerID="5bd45b8803399f906a61baa6e3d7f92f95af07fd4663b4e286836b615197ef3d" exitCode=0 Mar 16 17:14:43 crc kubenswrapper[5120]: I0316 17:14:43.125504 5120 generic.go:358] "Generic (PLEG): container finished" podID="992e69a3-0dcd-4c36-a4b0-9237e72b40d8" containerID="55505d97116e532650afe38eb13ae4c750df44e60325799083de6d7f35108f80" exitCode=2 Mar 16 17:14:43 crc kubenswrapper[5120]: I0316 17:14:43.125515 5120 generic.go:358] "Generic (PLEG): container finished" podID="992e69a3-0dcd-4c36-a4b0-9237e72b40d8" containerID="c3a482b53aad03821db999b91fb95eace5652c47e8061eb81c6e4157794dbed0" exitCode=0 Mar 16 17:14:43 crc kubenswrapper[5120]: I0316 17:14:43.127597 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"992e69a3-0dcd-4c36-a4b0-9237e72b40d8","Type":"ContainerDied","Data":"5bd45b8803399f906a61baa6e3d7f92f95af07fd4663b4e286836b615197ef3d"} Mar 16 17:14:43 crc kubenswrapper[5120]: I0316 17:14:43.127635 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"992e69a3-0dcd-4c36-a4b0-9237e72b40d8","Type":"ContainerDied","Data":"55505d97116e532650afe38eb13ae4c750df44e60325799083de6d7f35108f80"} Mar 16 17:14:43 crc kubenswrapper[5120]: I0316 17:14:43.127645 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"992e69a3-0dcd-4c36-a4b0-9237e72b40d8","Type":"ContainerDied","Data":"c3a482b53aad03821db999b91fb95eace5652c47e8061eb81c6e4157794dbed0"} Mar 16 17:14:43 crc kubenswrapper[5120]: I0316 17:14:43.394935 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-4hff7"] Mar 16 17:14:43 crc kubenswrapper[5120]: W0316 17:14:43.408191 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc6c9a09_f17f_4ebc_a57d_d440091fcad8.slice/crio-0de132a8749f443ea62766917d6a8ef66142918c4c1862ff522b50d13e12db93 WatchSource:0}: Error finding container 0de132a8749f443ea62766917d6a8ef66142918c4c1862ff522b50d13e12db93: Status 404 returned error can't find the container with id 0de132a8749f443ea62766917d6a8ef66142918c4c1862ff522b50d13e12db93 Mar 16 17:14:43 crc kubenswrapper[5120]: I0316 17:14:43.722731 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:14:43 crc kubenswrapper[5120]: I0316 17:14:43.776246 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/992e69a3-0dcd-4c36-a4b0-9237e72b40d8-scripts\") pod \"992e69a3-0dcd-4c36-a4b0-9237e72b40d8\" (UID: \"992e69a3-0dcd-4c36-a4b0-9237e72b40d8\") " Mar 16 17:14:43 crc kubenswrapper[5120]: I0316 17:14:43.776339 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/992e69a3-0dcd-4c36-a4b0-9237e72b40d8-sg-core-conf-yaml\") pod \"992e69a3-0dcd-4c36-a4b0-9237e72b40d8\" (UID: \"992e69a3-0dcd-4c36-a4b0-9237e72b40d8\") " Mar 16 17:14:43 crc kubenswrapper[5120]: I0316 17:14:43.776368 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/992e69a3-0dcd-4c36-a4b0-9237e72b40d8-log-httpd\") pod \"992e69a3-0dcd-4c36-a4b0-9237e72b40d8\" (UID: \"992e69a3-0dcd-4c36-a4b0-9237e72b40d8\") " Mar 16 17:14:43 crc kubenswrapper[5120]: I0316 17:14:43.776383 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/992e69a3-0dcd-4c36-a4b0-9237e72b40d8-combined-ca-bundle\") pod \"992e69a3-0dcd-4c36-a4b0-9237e72b40d8\" (UID: \"992e69a3-0dcd-4c36-a4b0-9237e72b40d8\") " Mar 16 17:14:43 crc kubenswrapper[5120]: I0316 17:14:43.776418 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6wc7p\" (UniqueName: \"kubernetes.io/projected/992e69a3-0dcd-4c36-a4b0-9237e72b40d8-kube-api-access-6wc7p\") pod \"992e69a3-0dcd-4c36-a4b0-9237e72b40d8\" (UID: \"992e69a3-0dcd-4c36-a4b0-9237e72b40d8\") " Mar 16 17:14:43 crc kubenswrapper[5120]: I0316 17:14:43.776499 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/992e69a3-0dcd-4c36-a4b0-9237e72b40d8-run-httpd\") pod \"992e69a3-0dcd-4c36-a4b0-9237e72b40d8\" (UID: \"992e69a3-0dcd-4c36-a4b0-9237e72b40d8\") " Mar 16 17:14:43 crc kubenswrapper[5120]: I0316 17:14:43.776654 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/992e69a3-0dcd-4c36-a4b0-9237e72b40d8-config-data\") pod \"992e69a3-0dcd-4c36-a4b0-9237e72b40d8\" (UID: \"992e69a3-0dcd-4c36-a4b0-9237e72b40d8\") " Mar 16 17:14:43 crc kubenswrapper[5120]: I0316 17:14:43.777870 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/992e69a3-0dcd-4c36-a4b0-9237e72b40d8-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "992e69a3-0dcd-4c36-a4b0-9237e72b40d8" (UID: "992e69a3-0dcd-4c36-a4b0-9237e72b40d8"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:14:43 crc kubenswrapper[5120]: I0316 17:14:43.780963 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/992e69a3-0dcd-4c36-a4b0-9237e72b40d8-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "992e69a3-0dcd-4c36-a4b0-9237e72b40d8" (UID: "992e69a3-0dcd-4c36-a4b0-9237e72b40d8"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:14:43 crc kubenswrapper[5120]: I0316 17:14:43.783030 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/992e69a3-0dcd-4c36-a4b0-9237e72b40d8-scripts" (OuterVolumeSpecName: "scripts") pod "992e69a3-0dcd-4c36-a4b0-9237e72b40d8" (UID: "992e69a3-0dcd-4c36-a4b0-9237e72b40d8"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:14:43 crc kubenswrapper[5120]: I0316 17:14:43.783188 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/992e69a3-0dcd-4c36-a4b0-9237e72b40d8-kube-api-access-6wc7p" (OuterVolumeSpecName: "kube-api-access-6wc7p") pod "992e69a3-0dcd-4c36-a4b0-9237e72b40d8" (UID: "992e69a3-0dcd-4c36-a4b0-9237e72b40d8"). InnerVolumeSpecName "kube-api-access-6wc7p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:14:43 crc kubenswrapper[5120]: I0316 17:14:43.783594 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/992e69a3-0dcd-4c36-a4b0-9237e72b40d8-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 17:14:43 crc kubenswrapper[5120]: I0316 17:14:43.783622 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/992e69a3-0dcd-4c36-a4b0-9237e72b40d8-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 17:14:43 crc kubenswrapper[5120]: I0316 17:14:43.806861 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/992e69a3-0dcd-4c36-a4b0-9237e72b40d8-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "992e69a3-0dcd-4c36-a4b0-9237e72b40d8" (UID: "992e69a3-0dcd-4c36-a4b0-9237e72b40d8"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:14:43 crc kubenswrapper[5120]: I0316 17:14:43.846800 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/992e69a3-0dcd-4c36-a4b0-9237e72b40d8-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "992e69a3-0dcd-4c36-a4b0-9237e72b40d8" (UID: "992e69a3-0dcd-4c36-a4b0-9237e72b40d8"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:14:43 crc kubenswrapper[5120]: I0316 17:14:43.877373 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/992e69a3-0dcd-4c36-a4b0-9237e72b40d8-config-data" (OuterVolumeSpecName: "config-data") pod "992e69a3-0dcd-4c36-a4b0-9237e72b40d8" (UID: "992e69a3-0dcd-4c36-a4b0-9237e72b40d8"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:14:43 crc kubenswrapper[5120]: I0316 17:14:43.888061 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/992e69a3-0dcd-4c36-a4b0-9237e72b40d8-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:14:43 crc kubenswrapper[5120]: I0316 17:14:43.888111 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/992e69a3-0dcd-4c36-a4b0-9237e72b40d8-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 17:14:43 crc kubenswrapper[5120]: I0316 17:14:43.888128 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/992e69a3-0dcd-4c36-a4b0-9237e72b40d8-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:14:43 crc kubenswrapper[5120]: I0316 17:14:43.888144 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6wc7p\" (UniqueName: \"kubernetes.io/projected/992e69a3-0dcd-4c36-a4b0-9237e72b40d8-kube-api-access-6wc7p\") on node \"crc\" DevicePath \"\"" Mar 16 17:14:43 crc kubenswrapper[5120]: I0316 17:14:43.888156 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/992e69a3-0dcd-4c36-a4b0-9237e72b40d8-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:14:44 crc kubenswrapper[5120]: I0316 17:14:44.136462 5120 generic.go:358] "Generic (PLEG): container finished" podID="cc6c9a09-f17f-4ebc-a57d-d440091fcad8" containerID="b1d959d190d2cd211dc9f459028e441190a07290beddffc44a1ab8330d0bbc03" exitCode=0 Mar 16 17:14:44 crc kubenswrapper[5120]: I0316 17:14:44.136581 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-4hff7" event={"ID":"cc6c9a09-f17f-4ebc-a57d-d440091fcad8","Type":"ContainerDied","Data":"b1d959d190d2cd211dc9f459028e441190a07290beddffc44a1ab8330d0bbc03"} Mar 16 17:14:44 crc kubenswrapper[5120]: I0316 17:14:44.136624 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-4hff7" event={"ID":"cc6c9a09-f17f-4ebc-a57d-d440091fcad8","Type":"ContainerStarted","Data":"0de132a8749f443ea62766917d6a8ef66142918c4c1862ff522b50d13e12db93"} Mar 16 17:14:44 crc kubenswrapper[5120]: I0316 17:14:44.141402 5120 generic.go:358] "Generic (PLEG): container finished" podID="992e69a3-0dcd-4c36-a4b0-9237e72b40d8" containerID="791f05e72472a3b286ce1a6c955b334bd9ecd78d1a994ca55d1193aedae7e79e" exitCode=0 Mar 16 17:14:44 crc kubenswrapper[5120]: I0316 17:14:44.141510 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:14:44 crc kubenswrapper[5120]: I0316 17:14:44.141541 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"992e69a3-0dcd-4c36-a4b0-9237e72b40d8","Type":"ContainerDied","Data":"791f05e72472a3b286ce1a6c955b334bd9ecd78d1a994ca55d1193aedae7e79e"} Mar 16 17:14:44 crc kubenswrapper[5120]: I0316 17:14:44.141613 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"992e69a3-0dcd-4c36-a4b0-9237e72b40d8","Type":"ContainerDied","Data":"c221fd7948ce727fd6fb813ed6b6e0dffad70228f40b2ab443cd30f560607250"} Mar 16 17:14:44 crc kubenswrapper[5120]: I0316 17:14:44.141652 5120 scope.go:117] "RemoveContainer" containerID="5bd45b8803399f906a61baa6e3d7f92f95af07fd4663b4e286836b615197ef3d" Mar 16 17:14:44 crc kubenswrapper[5120]: I0316 17:14:44.169104 5120 scope.go:117] "RemoveContainer" containerID="55505d97116e532650afe38eb13ae4c750df44e60325799083de6d7f35108f80" Mar 16 17:14:44 crc kubenswrapper[5120]: I0316 17:14:44.206038 5120 scope.go:117] "RemoveContainer" containerID="c3a482b53aad03821db999b91fb95eace5652c47e8061eb81c6e4157794dbed0" Mar 16 17:14:44 crc kubenswrapper[5120]: I0316 17:14:44.218922 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:14:44 crc kubenswrapper[5120]: I0316 17:14:44.234429 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:14:44 crc kubenswrapper[5120]: I0316 17:14:44.247559 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:14:44 crc kubenswrapper[5120]: I0316 17:14:44.249413 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="992e69a3-0dcd-4c36-a4b0-9237e72b40d8" containerName="ceilometer-notification-agent" Mar 16 17:14:44 crc kubenswrapper[5120]: I0316 17:14:44.249439 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="992e69a3-0dcd-4c36-a4b0-9237e72b40d8" containerName="ceilometer-notification-agent" Mar 16 17:14:44 crc kubenswrapper[5120]: I0316 17:14:44.249453 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="992e69a3-0dcd-4c36-a4b0-9237e72b40d8" containerName="sg-core" Mar 16 17:14:44 crc kubenswrapper[5120]: I0316 17:14:44.249462 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="992e69a3-0dcd-4c36-a4b0-9237e72b40d8" containerName="sg-core" Mar 16 17:14:44 crc kubenswrapper[5120]: I0316 17:14:44.249493 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="992e69a3-0dcd-4c36-a4b0-9237e72b40d8" containerName="ceilometer-central-agent" Mar 16 17:14:44 crc kubenswrapper[5120]: I0316 17:14:44.249500 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="992e69a3-0dcd-4c36-a4b0-9237e72b40d8" containerName="ceilometer-central-agent" Mar 16 17:14:44 crc kubenswrapper[5120]: I0316 17:14:44.249539 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="992e69a3-0dcd-4c36-a4b0-9237e72b40d8" containerName="proxy-httpd" Mar 16 17:14:44 crc kubenswrapper[5120]: I0316 17:14:44.249550 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="992e69a3-0dcd-4c36-a4b0-9237e72b40d8" containerName="proxy-httpd" Mar 16 17:14:44 crc kubenswrapper[5120]: I0316 17:14:44.249745 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="992e69a3-0dcd-4c36-a4b0-9237e72b40d8" containerName="ceilometer-notification-agent" Mar 16 17:14:44 crc kubenswrapper[5120]: I0316 17:14:44.249840 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="992e69a3-0dcd-4c36-a4b0-9237e72b40d8" containerName="proxy-httpd" Mar 16 17:14:44 crc kubenswrapper[5120]: I0316 17:14:44.249852 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="992e69a3-0dcd-4c36-a4b0-9237e72b40d8" containerName="sg-core" Mar 16 17:14:44 crc kubenswrapper[5120]: I0316 17:14:44.249865 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="992e69a3-0dcd-4c36-a4b0-9237e72b40d8" containerName="ceilometer-central-agent" Mar 16 17:14:44 crc kubenswrapper[5120]: I0316 17:14:44.269049 5120 scope.go:117] "RemoveContainer" containerID="791f05e72472a3b286ce1a6c955b334bd9ecd78d1a994ca55d1193aedae7e79e" Mar 16 17:14:44 crc kubenswrapper[5120]: I0316 17:14:44.271177 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:14:44 crc kubenswrapper[5120]: I0316 17:14:44.271392 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:14:44 crc kubenswrapper[5120]: I0316 17:14:44.273921 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 17:14:44 crc kubenswrapper[5120]: I0316 17:14:44.274202 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 17:14:44 crc kubenswrapper[5120]: I0316 17:14:44.315276 5120 scope.go:117] "RemoveContainer" containerID="5bd45b8803399f906a61baa6e3d7f92f95af07fd4663b4e286836b615197ef3d" Mar 16 17:14:44 crc kubenswrapper[5120]: E0316 17:14:44.315814 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5bd45b8803399f906a61baa6e3d7f92f95af07fd4663b4e286836b615197ef3d\": container with ID starting with 5bd45b8803399f906a61baa6e3d7f92f95af07fd4663b4e286836b615197ef3d not found: ID does not exist" containerID="5bd45b8803399f906a61baa6e3d7f92f95af07fd4663b4e286836b615197ef3d" Mar 16 17:14:44 crc kubenswrapper[5120]: I0316 17:14:44.315916 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5bd45b8803399f906a61baa6e3d7f92f95af07fd4663b4e286836b615197ef3d"} err="failed to get container status \"5bd45b8803399f906a61baa6e3d7f92f95af07fd4663b4e286836b615197ef3d\": rpc error: code = NotFound desc = could not find container \"5bd45b8803399f906a61baa6e3d7f92f95af07fd4663b4e286836b615197ef3d\": container with ID starting with 5bd45b8803399f906a61baa6e3d7f92f95af07fd4663b4e286836b615197ef3d not found: ID does not exist" Mar 16 17:14:44 crc kubenswrapper[5120]: I0316 17:14:44.315941 5120 scope.go:117] "RemoveContainer" containerID="55505d97116e532650afe38eb13ae4c750df44e60325799083de6d7f35108f80" Mar 16 17:14:44 crc kubenswrapper[5120]: E0316 17:14:44.318287 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"55505d97116e532650afe38eb13ae4c750df44e60325799083de6d7f35108f80\": container with ID starting with 55505d97116e532650afe38eb13ae4c750df44e60325799083de6d7f35108f80 not found: ID does not exist" containerID="55505d97116e532650afe38eb13ae4c750df44e60325799083de6d7f35108f80" Mar 16 17:14:44 crc kubenswrapper[5120]: I0316 17:14:44.318323 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55505d97116e532650afe38eb13ae4c750df44e60325799083de6d7f35108f80"} err="failed to get container status \"55505d97116e532650afe38eb13ae4c750df44e60325799083de6d7f35108f80\": rpc error: code = NotFound desc = could not find container \"55505d97116e532650afe38eb13ae4c750df44e60325799083de6d7f35108f80\": container with ID starting with 55505d97116e532650afe38eb13ae4c750df44e60325799083de6d7f35108f80 not found: ID does not exist" Mar 16 17:14:44 crc kubenswrapper[5120]: I0316 17:14:44.318371 5120 scope.go:117] "RemoveContainer" containerID="c3a482b53aad03821db999b91fb95eace5652c47e8061eb81c6e4157794dbed0" Mar 16 17:14:44 crc kubenswrapper[5120]: E0316 17:14:44.322904 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c3a482b53aad03821db999b91fb95eace5652c47e8061eb81c6e4157794dbed0\": container with ID starting with c3a482b53aad03821db999b91fb95eace5652c47e8061eb81c6e4157794dbed0 not found: ID does not exist" containerID="c3a482b53aad03821db999b91fb95eace5652c47e8061eb81c6e4157794dbed0" Mar 16 17:14:44 crc kubenswrapper[5120]: I0316 17:14:44.322961 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3a482b53aad03821db999b91fb95eace5652c47e8061eb81c6e4157794dbed0"} err="failed to get container status \"c3a482b53aad03821db999b91fb95eace5652c47e8061eb81c6e4157794dbed0\": rpc error: code = NotFound desc = could not find container \"c3a482b53aad03821db999b91fb95eace5652c47e8061eb81c6e4157794dbed0\": container with ID starting with c3a482b53aad03821db999b91fb95eace5652c47e8061eb81c6e4157794dbed0 not found: ID does not exist" Mar 16 17:14:44 crc kubenswrapper[5120]: I0316 17:14:44.322985 5120 scope.go:117] "RemoveContainer" containerID="791f05e72472a3b286ce1a6c955b334bd9ecd78d1a994ca55d1193aedae7e79e" Mar 16 17:14:44 crc kubenswrapper[5120]: E0316 17:14:44.327895 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"791f05e72472a3b286ce1a6c955b334bd9ecd78d1a994ca55d1193aedae7e79e\": container with ID starting with 791f05e72472a3b286ce1a6c955b334bd9ecd78d1a994ca55d1193aedae7e79e not found: ID does not exist" containerID="791f05e72472a3b286ce1a6c955b334bd9ecd78d1a994ca55d1193aedae7e79e" Mar 16 17:14:44 crc kubenswrapper[5120]: I0316 17:14:44.327937 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"791f05e72472a3b286ce1a6c955b334bd9ecd78d1a994ca55d1193aedae7e79e"} err="failed to get container status \"791f05e72472a3b286ce1a6c955b334bd9ecd78d1a994ca55d1193aedae7e79e\": rpc error: code = NotFound desc = could not find container \"791f05e72472a3b286ce1a6c955b334bd9ecd78d1a994ca55d1193aedae7e79e\": container with ID starting with 791f05e72472a3b286ce1a6c955b334bd9ecd78d1a994ca55d1193aedae7e79e not found: ID does not exist" Mar 16 17:14:44 crc kubenswrapper[5120]: I0316 17:14:44.403703 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7pfv6\" (UniqueName: \"kubernetes.io/projected/374d764f-88f9-46d8-96f8-c905404c071d-kube-api-access-7pfv6\") pod \"ceilometer-0\" (UID: \"374d764f-88f9-46d8-96f8-c905404c071d\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:14:44 crc kubenswrapper[5120]: I0316 17:14:44.403919 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/374d764f-88f9-46d8-96f8-c905404c071d-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"374d764f-88f9-46d8-96f8-c905404c071d\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:14:44 crc kubenswrapper[5120]: I0316 17:14:44.403979 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/374d764f-88f9-46d8-96f8-c905404c071d-run-httpd\") pod \"ceilometer-0\" (UID: \"374d764f-88f9-46d8-96f8-c905404c071d\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:14:44 crc kubenswrapper[5120]: I0316 17:14:44.404067 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/374d764f-88f9-46d8-96f8-c905404c071d-config-data\") pod \"ceilometer-0\" (UID: \"374d764f-88f9-46d8-96f8-c905404c071d\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:14:44 crc kubenswrapper[5120]: I0316 17:14:44.404429 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/374d764f-88f9-46d8-96f8-c905404c071d-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"374d764f-88f9-46d8-96f8-c905404c071d\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:14:44 crc kubenswrapper[5120]: I0316 17:14:44.404497 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/374d764f-88f9-46d8-96f8-c905404c071d-scripts\") pod \"ceilometer-0\" (UID: \"374d764f-88f9-46d8-96f8-c905404c071d\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:14:44 crc kubenswrapper[5120]: I0316 17:14:44.404612 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/374d764f-88f9-46d8-96f8-c905404c071d-log-httpd\") pod \"ceilometer-0\" (UID: \"374d764f-88f9-46d8-96f8-c905404c071d\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:14:44 crc kubenswrapper[5120]: I0316 17:14:44.507892 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/374d764f-88f9-46d8-96f8-c905404c071d-log-httpd\") pod \"ceilometer-0\" (UID: \"374d764f-88f9-46d8-96f8-c905404c071d\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:14:44 crc kubenswrapper[5120]: I0316 17:14:44.508681 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7pfv6\" (UniqueName: \"kubernetes.io/projected/374d764f-88f9-46d8-96f8-c905404c071d-kube-api-access-7pfv6\") pod \"ceilometer-0\" (UID: \"374d764f-88f9-46d8-96f8-c905404c071d\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:14:44 crc kubenswrapper[5120]: I0316 17:14:44.508852 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/374d764f-88f9-46d8-96f8-c905404c071d-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"374d764f-88f9-46d8-96f8-c905404c071d\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:14:44 crc kubenswrapper[5120]: I0316 17:14:44.508923 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/374d764f-88f9-46d8-96f8-c905404c071d-run-httpd\") pod \"ceilometer-0\" (UID: \"374d764f-88f9-46d8-96f8-c905404c071d\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:14:44 crc kubenswrapper[5120]: I0316 17:14:44.509022 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/374d764f-88f9-46d8-96f8-c905404c071d-config-data\") pod \"ceilometer-0\" (UID: \"374d764f-88f9-46d8-96f8-c905404c071d\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:14:44 crc kubenswrapper[5120]: I0316 17:14:44.509282 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/374d764f-88f9-46d8-96f8-c905404c071d-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"374d764f-88f9-46d8-96f8-c905404c071d\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:14:44 crc kubenswrapper[5120]: I0316 17:14:44.509329 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/374d764f-88f9-46d8-96f8-c905404c071d-scripts\") pod \"ceilometer-0\" (UID: \"374d764f-88f9-46d8-96f8-c905404c071d\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:14:44 crc kubenswrapper[5120]: I0316 17:14:44.508472 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/374d764f-88f9-46d8-96f8-c905404c071d-log-httpd\") pod \"ceilometer-0\" (UID: \"374d764f-88f9-46d8-96f8-c905404c071d\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:14:44 crc kubenswrapper[5120]: I0316 17:14:44.510806 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/374d764f-88f9-46d8-96f8-c905404c071d-run-httpd\") pod \"ceilometer-0\" (UID: \"374d764f-88f9-46d8-96f8-c905404c071d\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:14:44 crc kubenswrapper[5120]: I0316 17:14:44.518819 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/374d764f-88f9-46d8-96f8-c905404c071d-config-data\") pod \"ceilometer-0\" (UID: \"374d764f-88f9-46d8-96f8-c905404c071d\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:14:44 crc kubenswrapper[5120]: I0316 17:14:44.520971 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/374d764f-88f9-46d8-96f8-c905404c071d-scripts\") pod \"ceilometer-0\" (UID: \"374d764f-88f9-46d8-96f8-c905404c071d\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:14:44 crc kubenswrapper[5120]: I0316 17:14:44.521239 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/374d764f-88f9-46d8-96f8-c905404c071d-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"374d764f-88f9-46d8-96f8-c905404c071d\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:14:44 crc kubenswrapper[5120]: I0316 17:14:44.521577 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/374d764f-88f9-46d8-96f8-c905404c071d-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"374d764f-88f9-46d8-96f8-c905404c071d\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:14:44 crc kubenswrapper[5120]: I0316 17:14:44.531630 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7pfv6\" (UniqueName: \"kubernetes.io/projected/374d764f-88f9-46d8-96f8-c905404c071d-kube-api-access-7pfv6\") pod \"ceilometer-0\" (UID: \"374d764f-88f9-46d8-96f8-c905404c071d\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:14:44 crc kubenswrapper[5120]: I0316 17:14:44.594370 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:14:44 crc kubenswrapper[5120]: I0316 17:14:44.680242 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="992e69a3-0dcd-4c36-a4b0-9237e72b40d8" path="/var/lib/kubelet/pods/992e69a3-0dcd-4c36-a4b0-9237e72b40d8/volumes" Mar 16 17:14:45 crc kubenswrapper[5120]: I0316 17:14:45.060916 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:14:45 crc kubenswrapper[5120]: W0316 17:14:45.062937 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod374d764f_88f9_46d8_96f8_c905404c071d.slice/crio-fa69a3644b7024c7e250cfdbc079f20f8d0821288645c9f8f6d695309ae95ad9 WatchSource:0}: Error finding container fa69a3644b7024c7e250cfdbc079f20f8d0821288645c9f8f6d695309ae95ad9: Status 404 returned error can't find the container with id fa69a3644b7024c7e250cfdbc079f20f8d0821288645c9f8f6d695309ae95ad9 Mar 16 17:14:45 crc kubenswrapper[5120]: I0316 17:14:45.098193 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 17:14:45 crc kubenswrapper[5120]: I0316 17:14:45.158880 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-4hff7" event={"ID":"cc6c9a09-f17f-4ebc-a57d-d440091fcad8","Type":"ContainerStarted","Data":"1ae1e725168f2398254c253eceda369dd008827b3d10501f0988dc115141d4f8"} Mar 16 17:14:45 crc kubenswrapper[5120]: I0316 17:14:45.161412 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"374d764f-88f9-46d8-96f8-c905404c071d","Type":"ContainerStarted","Data":"fa69a3644b7024c7e250cfdbc079f20f8d0821288645c9f8f6d695309ae95ad9"} Mar 16 17:14:45 crc kubenswrapper[5120]: I0316 17:14:45.687998 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-jsgxw"] Mar 16 17:14:45 crc kubenswrapper[5120]: I0316 17:14:45.694244 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-jsgxw" Mar 16 17:14:45 crc kubenswrapper[5120]: I0316 17:14:45.699700 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-manage-config-data\"" Mar 16 17:14:45 crc kubenswrapper[5120]: I0316 17:14:45.699842 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-manage-scripts\"" Mar 16 17:14:45 crc kubenswrapper[5120]: I0316 17:14:45.712801 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-jsgxw"] Mar 16 17:14:45 crc kubenswrapper[5120]: I0316 17:14:45.791835 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 17:14:45 crc kubenswrapper[5120]: I0316 17:14:45.801713 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:14:45 crc kubenswrapper[5120]: I0316 17:14:45.808732 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-config-data\"" Mar 16 17:14:45 crc kubenswrapper[5120]: I0316 17:14:45.841397 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 17:14:45 crc kubenswrapper[5120]: I0316 17:14:45.859507 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8588f057-79ea-4d0e-b37b-ee267ab3edb6-combined-ca-bundle\") pod \"nova-cell0-cell-mapping-jsgxw\" (UID: \"8588f057-79ea-4d0e-b37b-ee267ab3edb6\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-jsgxw" Mar 16 17:14:45 crc kubenswrapper[5120]: I0316 17:14:45.859663 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8588f057-79ea-4d0e-b37b-ee267ab3edb6-scripts\") pod \"nova-cell0-cell-mapping-jsgxw\" (UID: \"8588f057-79ea-4d0e-b37b-ee267ab3edb6\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-jsgxw" Mar 16 17:14:45 crc kubenswrapper[5120]: I0316 17:14:45.859969 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8588f057-79ea-4d0e-b37b-ee267ab3edb6-config-data\") pod \"nova-cell0-cell-mapping-jsgxw\" (UID: \"8588f057-79ea-4d0e-b37b-ee267ab3edb6\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-jsgxw" Mar 16 17:14:45 crc kubenswrapper[5120]: I0316 17:14:45.860070 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mb69n\" (UniqueName: \"kubernetes.io/projected/8588f057-79ea-4d0e-b37b-ee267ab3edb6-kube-api-access-mb69n\") pod \"nova-cell0-cell-mapping-jsgxw\" (UID: \"8588f057-79ea-4d0e-b37b-ee267ab3edb6\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-jsgxw" Mar 16 17:14:46 crc kubenswrapper[5120]: I0316 17:14:46.045380 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8588f057-79ea-4d0e-b37b-ee267ab3edb6-combined-ca-bundle\") pod \"nova-cell0-cell-mapping-jsgxw\" (UID: \"8588f057-79ea-4d0e-b37b-ee267ab3edb6\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-jsgxw" Mar 16 17:14:46 crc kubenswrapper[5120]: I0316 17:14:46.045504 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e4489a73-64a4-4585-a873-aa42a0f6eb5f-logs\") pod \"nova-api-0\" (UID: \"e4489a73-64a4-4585-a873-aa42a0f6eb5f\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:14:46 crc kubenswrapper[5120]: I0316 17:14:46.045635 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8588f057-79ea-4d0e-b37b-ee267ab3edb6-scripts\") pod \"nova-cell0-cell-mapping-jsgxw\" (UID: \"8588f057-79ea-4d0e-b37b-ee267ab3edb6\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-jsgxw" Mar 16 17:14:46 crc kubenswrapper[5120]: I0316 17:14:46.046014 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8588f057-79ea-4d0e-b37b-ee267ab3edb6-config-data\") pod \"nova-cell0-cell-mapping-jsgxw\" (UID: \"8588f057-79ea-4d0e-b37b-ee267ab3edb6\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-jsgxw" Mar 16 17:14:46 crc kubenswrapper[5120]: I0316 17:14:46.046050 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnmbn\" (UniqueName: \"kubernetes.io/projected/e4489a73-64a4-4585-a873-aa42a0f6eb5f-kube-api-access-jnmbn\") pod \"nova-api-0\" (UID: \"e4489a73-64a4-4585-a873-aa42a0f6eb5f\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:14:46 crc kubenswrapper[5120]: I0316 17:14:46.046181 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mb69n\" (UniqueName: \"kubernetes.io/projected/8588f057-79ea-4d0e-b37b-ee267ab3edb6-kube-api-access-mb69n\") pod \"nova-cell0-cell-mapping-jsgxw\" (UID: \"8588f057-79ea-4d0e-b37b-ee267ab3edb6\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-jsgxw" Mar 16 17:14:46 crc kubenswrapper[5120]: I0316 17:14:46.046229 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e4489a73-64a4-4585-a873-aa42a0f6eb5f-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"e4489a73-64a4-4585-a873-aa42a0f6eb5f\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:14:46 crc kubenswrapper[5120]: I0316 17:14:46.046308 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e4489a73-64a4-4585-a873-aa42a0f6eb5f-config-data\") pod \"nova-api-0\" (UID: \"e4489a73-64a4-4585-a873-aa42a0f6eb5f\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:14:46 crc kubenswrapper[5120]: I0316 17:14:46.048643 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 17:14:46 crc kubenswrapper[5120]: I0316 17:14:46.088323 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8588f057-79ea-4d0e-b37b-ee267ab3edb6-combined-ca-bundle\") pod \"nova-cell0-cell-mapping-jsgxw\" (UID: \"8588f057-79ea-4d0e-b37b-ee267ab3edb6\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-jsgxw" Mar 16 17:14:46 crc kubenswrapper[5120]: I0316 17:14:46.100367 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8588f057-79ea-4d0e-b37b-ee267ab3edb6-scripts\") pod \"nova-cell0-cell-mapping-jsgxw\" (UID: \"8588f057-79ea-4d0e-b37b-ee267ab3edb6\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-jsgxw" Mar 16 17:14:46 crc kubenswrapper[5120]: I0316 17:14:46.123697 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8588f057-79ea-4d0e-b37b-ee267ab3edb6-config-data\") pod \"nova-cell0-cell-mapping-jsgxw\" (UID: \"8588f057-79ea-4d0e-b37b-ee267ab3edb6\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-jsgxw" Mar 16 17:14:46 crc kubenswrapper[5120]: I0316 17:14:46.125527 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mb69n\" (UniqueName: \"kubernetes.io/projected/8588f057-79ea-4d0e-b37b-ee267ab3edb6-kube-api-access-mb69n\") pod \"nova-cell0-cell-mapping-jsgxw\" (UID: \"8588f057-79ea-4d0e-b37b-ee267ab3edb6\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-jsgxw" Mar 16 17:14:46 crc kubenswrapper[5120]: I0316 17:14:46.144376 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 17:14:46 crc kubenswrapper[5120]: I0316 17:14:46.144423 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 17:14:46 crc kubenswrapper[5120]: I0316 17:14:46.148807 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:14:46 crc kubenswrapper[5120]: I0316 17:14:46.197291 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e4489a73-64a4-4585-a873-aa42a0f6eb5f-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"e4489a73-64a4-4585-a873-aa42a0f6eb5f\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:14:46 crc kubenswrapper[5120]: I0316 17:14:46.197364 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e4489a73-64a4-4585-a873-aa42a0f6eb5f-config-data\") pod \"nova-api-0\" (UID: \"e4489a73-64a4-4585-a873-aa42a0f6eb5f\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:14:46 crc kubenswrapper[5120]: I0316 17:14:46.197545 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e4489a73-64a4-4585-a873-aa42a0f6eb5f-logs\") pod \"nova-api-0\" (UID: \"e4489a73-64a4-4585-a873-aa42a0f6eb5f\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:14:46 crc kubenswrapper[5120]: I0316 17:14:46.197778 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jnmbn\" (UniqueName: \"kubernetes.io/projected/e4489a73-64a4-4585-a873-aa42a0f6eb5f-kube-api-access-jnmbn\") pod \"nova-api-0\" (UID: \"e4489a73-64a4-4585-a873-aa42a0f6eb5f\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:14:46 crc kubenswrapper[5120]: I0316 17:14:46.198044 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:14:46 crc kubenswrapper[5120]: I0316 17:14:46.198704 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e4489a73-64a4-4585-a873-aa42a0f6eb5f-logs\") pod \"nova-api-0\" (UID: \"e4489a73-64a4-4585-a873-aa42a0f6eb5f\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:14:46 crc kubenswrapper[5120]: I0316 17:14:46.220780 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 17:14:46 crc kubenswrapper[5120]: I0316 17:14:46.221327 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e4489a73-64a4-4585-a873-aa42a0f6eb5f-config-data\") pod \"nova-api-0\" (UID: \"e4489a73-64a4-4585-a873-aa42a0f6eb5f\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:14:46 crc kubenswrapper[5120]: I0316 17:14:46.248271 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-novncproxy-config-data\"" Mar 16 17:14:46 crc kubenswrapper[5120]: I0316 17:14:46.249000 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-metadata-config-data\"" Mar 16 17:14:46 crc kubenswrapper[5120]: I0316 17:14:46.252960 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e4489a73-64a4-4585-a873-aa42a0f6eb5f-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"e4489a73-64a4-4585-a873-aa42a0f6eb5f\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:14:46 crc kubenswrapper[5120]: I0316 17:14:46.280351 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 17:14:46 crc kubenswrapper[5120]: I0316 17:14:46.290217 5120 generic.go:358] "Generic (PLEG): container finished" podID="cc6c9a09-f17f-4ebc-a57d-d440091fcad8" containerID="1ae1e725168f2398254c253eceda369dd008827b3d10501f0988dc115141d4f8" exitCode=0 Mar 16 17:14:46 crc kubenswrapper[5120]: I0316 17:14:46.291792 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnmbn\" (UniqueName: \"kubernetes.io/projected/e4489a73-64a4-4585-a873-aa42a0f6eb5f-kube-api-access-jnmbn\") pod \"nova-api-0\" (UID: \"e4489a73-64a4-4585-a873-aa42a0f6eb5f\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:14:46 crc kubenswrapper[5120]: I0316 17:14:46.306924 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-4hff7" event={"ID":"cc6c9a09-f17f-4ebc-a57d-d440091fcad8","Type":"ContainerDied","Data":"1ae1e725168f2398254c253eceda369dd008827b3d10501f0988dc115141d4f8"} Mar 16 17:14:46 crc kubenswrapper[5120]: I0316 17:14:46.307189 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 17:14:46 crc kubenswrapper[5120]: I0316 17:14:46.307000 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnzn7\" (UniqueName: \"kubernetes.io/projected/134f4125-32e6-4735-8415-6abe03a532ca-kube-api-access-gnzn7\") pod \"nova-metadata-0\" (UID: \"134f4125-32e6-4735-8415-6abe03a532ca\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:14:46 crc kubenswrapper[5120]: I0316 17:14:46.307503 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/134f4125-32e6-4735-8415-6abe03a532ca-config-data\") pod \"nova-metadata-0\" (UID: \"134f4125-32e6-4735-8415-6abe03a532ca\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:14:46 crc kubenswrapper[5120]: I0316 17:14:46.307697 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvhfw\" (UniqueName: \"kubernetes.io/projected/f022b20c-74d0-4409-9852-318b67aeeae2-kube-api-access-zvhfw\") pod \"nova-cell1-novncproxy-0\" (UID: \"f022b20c-74d0-4409-9852-318b67aeeae2\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:14:46 crc kubenswrapper[5120]: I0316 17:14:46.307955 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f022b20c-74d0-4409-9852-318b67aeeae2-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"f022b20c-74d0-4409-9852-318b67aeeae2\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:14:46 crc kubenswrapper[5120]: I0316 17:14:46.308097 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/134f4125-32e6-4735-8415-6abe03a532ca-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"134f4125-32e6-4735-8415-6abe03a532ca\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:14:46 crc kubenswrapper[5120]: I0316 17:14:46.308185 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/134f4125-32e6-4735-8415-6abe03a532ca-logs\") pod \"nova-metadata-0\" (UID: \"134f4125-32e6-4735-8415-6abe03a532ca\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:14:46 crc kubenswrapper[5120]: I0316 17:14:46.308408 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f022b20c-74d0-4409-9852-318b67aeeae2-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"f022b20c-74d0-4409-9852-318b67aeeae2\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:14:46 crc kubenswrapper[5120]: I0316 17:14:46.308706 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:14:46 crc kubenswrapper[5120]: I0316 17:14:46.312648 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-scheduler-config-data\"" Mar 16 17:14:46 crc kubenswrapper[5120]: I0316 17:14:46.313960 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:14:46 crc kubenswrapper[5120]: I0316 17:14:46.365445 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-jsgxw" Mar 16 17:14:46 crc kubenswrapper[5120]: I0316 17:14:46.411748 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l864r\" (UniqueName: \"kubernetes.io/projected/af7aac1b-70e7-445c-8e51-8e6b01d77c69-kube-api-access-l864r\") pod \"nova-scheduler-0\" (UID: \"af7aac1b-70e7-445c-8e51-8e6b01d77c69\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:14:46 crc kubenswrapper[5120]: I0316 17:14:46.412189 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gnzn7\" (UniqueName: \"kubernetes.io/projected/134f4125-32e6-4735-8415-6abe03a532ca-kube-api-access-gnzn7\") pod \"nova-metadata-0\" (UID: \"134f4125-32e6-4735-8415-6abe03a532ca\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:14:46 crc kubenswrapper[5120]: I0316 17:14:46.412413 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/134f4125-32e6-4735-8415-6abe03a532ca-config-data\") pod \"nova-metadata-0\" (UID: \"134f4125-32e6-4735-8415-6abe03a532ca\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:14:46 crc kubenswrapper[5120]: I0316 17:14:46.412658 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zvhfw\" (UniqueName: \"kubernetes.io/projected/f022b20c-74d0-4409-9852-318b67aeeae2-kube-api-access-zvhfw\") pod \"nova-cell1-novncproxy-0\" (UID: \"f022b20c-74d0-4409-9852-318b67aeeae2\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:14:46 crc kubenswrapper[5120]: I0316 17:14:46.412877 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/af7aac1b-70e7-445c-8e51-8e6b01d77c69-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"af7aac1b-70e7-445c-8e51-8e6b01d77c69\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:14:46 crc kubenswrapper[5120]: I0316 17:14:46.413263 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/af7aac1b-70e7-445c-8e51-8e6b01d77c69-config-data\") pod \"nova-scheduler-0\" (UID: \"af7aac1b-70e7-445c-8e51-8e6b01d77c69\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:14:46 crc kubenswrapper[5120]: I0316 17:14:46.413371 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f022b20c-74d0-4409-9852-318b67aeeae2-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"f022b20c-74d0-4409-9852-318b67aeeae2\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:14:46 crc kubenswrapper[5120]: I0316 17:14:46.413537 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/134f4125-32e6-4735-8415-6abe03a532ca-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"134f4125-32e6-4735-8415-6abe03a532ca\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:14:46 crc kubenswrapper[5120]: I0316 17:14:46.413641 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/134f4125-32e6-4735-8415-6abe03a532ca-logs\") pod \"nova-metadata-0\" (UID: \"134f4125-32e6-4735-8415-6abe03a532ca\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:14:46 crc kubenswrapper[5120]: I0316 17:14:46.414021 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f022b20c-74d0-4409-9852-318b67aeeae2-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"f022b20c-74d0-4409-9852-318b67aeeae2\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:14:46 crc kubenswrapper[5120]: I0316 17:14:46.415317 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/134f4125-32e6-4735-8415-6abe03a532ca-logs\") pod \"nova-metadata-0\" (UID: \"134f4125-32e6-4735-8415-6abe03a532ca\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:14:46 crc kubenswrapper[5120]: I0316 17:14:46.432924 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f022b20c-74d0-4409-9852-318b67aeeae2-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"f022b20c-74d0-4409-9852-318b67aeeae2\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:14:46 crc kubenswrapper[5120]: I0316 17:14:46.433099 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/134f4125-32e6-4735-8415-6abe03a532ca-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"134f4125-32e6-4735-8415-6abe03a532ca\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:14:46 crc kubenswrapper[5120]: I0316 17:14:46.433327 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f022b20c-74d0-4409-9852-318b67aeeae2-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"f022b20c-74d0-4409-9852-318b67aeeae2\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:14:46 crc kubenswrapper[5120]: I0316 17:14:46.436103 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/134f4125-32e6-4735-8415-6abe03a532ca-config-data\") pod \"nova-metadata-0\" (UID: \"134f4125-32e6-4735-8415-6abe03a532ca\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:14:46 crc kubenswrapper[5120]: I0316 17:14:46.445551 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvhfw\" (UniqueName: \"kubernetes.io/projected/f022b20c-74d0-4409-9852-318b67aeeae2-kube-api-access-zvhfw\") pod \"nova-cell1-novncproxy-0\" (UID: \"f022b20c-74d0-4409-9852-318b67aeeae2\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:14:46 crc kubenswrapper[5120]: I0316 17:14:46.463245 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnzn7\" (UniqueName: \"kubernetes.io/projected/134f4125-32e6-4735-8415-6abe03a532ca-kube-api-access-gnzn7\") pod \"nova-metadata-0\" (UID: \"134f4125-32e6-4735-8415-6abe03a532ca\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:14:46 crc kubenswrapper[5120]: I0316 17:14:46.517476 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l864r\" (UniqueName: \"kubernetes.io/projected/af7aac1b-70e7-445c-8e51-8e6b01d77c69-kube-api-access-l864r\") pod \"nova-scheduler-0\" (UID: \"af7aac1b-70e7-445c-8e51-8e6b01d77c69\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:14:46 crc kubenswrapper[5120]: I0316 17:14:46.518195 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/af7aac1b-70e7-445c-8e51-8e6b01d77c69-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"af7aac1b-70e7-445c-8e51-8e6b01d77c69\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:14:46 crc kubenswrapper[5120]: I0316 17:14:46.518243 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/af7aac1b-70e7-445c-8e51-8e6b01d77c69-config-data\") pod \"nova-scheduler-0\" (UID: \"af7aac1b-70e7-445c-8e51-8e6b01d77c69\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:14:46 crc kubenswrapper[5120]: I0316 17:14:46.531631 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/af7aac1b-70e7-445c-8e51-8e6b01d77c69-config-data\") pod \"nova-scheduler-0\" (UID: \"af7aac1b-70e7-445c-8e51-8e6b01d77c69\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:14:46 crc kubenswrapper[5120]: I0316 17:14:46.544958 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/af7aac1b-70e7-445c-8e51-8e6b01d77c69-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"af7aac1b-70e7-445c-8e51-8e6b01d77c69\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:14:46 crc kubenswrapper[5120]: I0316 17:14:46.552898 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l864r\" (UniqueName: \"kubernetes.io/projected/af7aac1b-70e7-445c-8e51-8e6b01d77c69-kube-api-access-l864r\") pod \"nova-scheduler-0\" (UID: \"af7aac1b-70e7-445c-8e51-8e6b01d77c69\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:14:46 crc kubenswrapper[5120]: I0316 17:14:46.594405 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:14:46 crc kubenswrapper[5120]: I0316 17:14:46.665626 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:14:46 crc kubenswrapper[5120]: I0316 17:14:46.844254 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:14:46 crc kubenswrapper[5120]: I0316 17:14:46.955905 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 17:14:47 crc kubenswrapper[5120]: I0316 17:14:47.008925 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-4mxdb"] Mar 16 17:14:47 crc kubenswrapper[5120]: I0316 17:14:47.034987 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-4mxdb"] Mar 16 17:14:47 crc kubenswrapper[5120]: I0316 17:14:47.035115 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-4mxdb" Mar 16 17:14:47 crc kubenswrapper[5120]: I0316 17:14:47.038780 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-conductor-config-data\"" Mar 16 17:14:47 crc kubenswrapper[5120]: I0316 17:14:47.039002 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-conductor-scripts\"" Mar 16 17:14:47 crc kubenswrapper[5120]: I0316 17:14:47.044217 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6tnr7\" (UniqueName: \"kubernetes.io/projected/c26dcfcc-eff1-4daf-ad94-a46b19f3ef19-kube-api-access-6tnr7\") pod \"nova-cell1-conductor-db-sync-4mxdb\" (UID: \"c26dcfcc-eff1-4daf-ad94-a46b19f3ef19\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-4mxdb" Mar 16 17:14:47 crc kubenswrapper[5120]: I0316 17:14:47.044345 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c26dcfcc-eff1-4daf-ad94-a46b19f3ef19-scripts\") pod \"nova-cell1-conductor-db-sync-4mxdb\" (UID: \"c26dcfcc-eff1-4daf-ad94-a46b19f3ef19\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-4mxdb" Mar 16 17:14:47 crc kubenswrapper[5120]: I0316 17:14:47.044452 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c26dcfcc-eff1-4daf-ad94-a46b19f3ef19-combined-ca-bundle\") pod \"nova-cell1-conductor-db-sync-4mxdb\" (UID: \"c26dcfcc-eff1-4daf-ad94-a46b19f3ef19\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-4mxdb" Mar 16 17:14:47 crc kubenswrapper[5120]: I0316 17:14:47.044652 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c26dcfcc-eff1-4daf-ad94-a46b19f3ef19-config-data\") pod \"nova-cell1-conductor-db-sync-4mxdb\" (UID: \"c26dcfcc-eff1-4daf-ad94-a46b19f3ef19\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-4mxdb" Mar 16 17:14:47 crc kubenswrapper[5120]: W0316 17:14:47.133479 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8588f057_79ea_4d0e_b37b_ee267ab3edb6.slice/crio-c1191fe7f89f05bc89a6bf69e3c6feec40cae343bc12d8b6d1052de8e54f20ac WatchSource:0}: Error finding container c1191fe7f89f05bc89a6bf69e3c6feec40cae343bc12d8b6d1052de8e54f20ac: Status 404 returned error can't find the container with id c1191fe7f89f05bc89a6bf69e3c6feec40cae343bc12d8b6d1052de8e54f20ac Mar 16 17:14:47 crc kubenswrapper[5120]: I0316 17:14:47.147532 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c26dcfcc-eff1-4daf-ad94-a46b19f3ef19-config-data\") pod \"nova-cell1-conductor-db-sync-4mxdb\" (UID: \"c26dcfcc-eff1-4daf-ad94-a46b19f3ef19\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-4mxdb" Mar 16 17:14:47 crc kubenswrapper[5120]: I0316 17:14:47.147915 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6tnr7\" (UniqueName: \"kubernetes.io/projected/c26dcfcc-eff1-4daf-ad94-a46b19f3ef19-kube-api-access-6tnr7\") pod \"nova-cell1-conductor-db-sync-4mxdb\" (UID: \"c26dcfcc-eff1-4daf-ad94-a46b19f3ef19\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-4mxdb" Mar 16 17:14:47 crc kubenswrapper[5120]: I0316 17:14:47.147965 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c26dcfcc-eff1-4daf-ad94-a46b19f3ef19-scripts\") pod \"nova-cell1-conductor-db-sync-4mxdb\" (UID: \"c26dcfcc-eff1-4daf-ad94-a46b19f3ef19\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-4mxdb" Mar 16 17:14:47 crc kubenswrapper[5120]: I0316 17:14:47.148023 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c26dcfcc-eff1-4daf-ad94-a46b19f3ef19-combined-ca-bundle\") pod \"nova-cell1-conductor-db-sync-4mxdb\" (UID: \"c26dcfcc-eff1-4daf-ad94-a46b19f3ef19\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-4mxdb" Mar 16 17:14:47 crc kubenswrapper[5120]: I0316 17:14:47.154261 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-jsgxw"] Mar 16 17:14:47 crc kubenswrapper[5120]: I0316 17:14:47.165038 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c26dcfcc-eff1-4daf-ad94-a46b19f3ef19-config-data\") pod \"nova-cell1-conductor-db-sync-4mxdb\" (UID: \"c26dcfcc-eff1-4daf-ad94-a46b19f3ef19\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-4mxdb" Mar 16 17:14:47 crc kubenswrapper[5120]: I0316 17:14:47.166656 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c26dcfcc-eff1-4daf-ad94-a46b19f3ef19-scripts\") pod \"nova-cell1-conductor-db-sync-4mxdb\" (UID: \"c26dcfcc-eff1-4daf-ad94-a46b19f3ef19\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-4mxdb" Mar 16 17:14:47 crc kubenswrapper[5120]: I0316 17:14:47.167944 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c26dcfcc-eff1-4daf-ad94-a46b19f3ef19-combined-ca-bundle\") pod \"nova-cell1-conductor-db-sync-4mxdb\" (UID: \"c26dcfcc-eff1-4daf-ad94-a46b19f3ef19\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-4mxdb" Mar 16 17:14:47 crc kubenswrapper[5120]: I0316 17:14:47.173918 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6tnr7\" (UniqueName: \"kubernetes.io/projected/c26dcfcc-eff1-4daf-ad94-a46b19f3ef19-kube-api-access-6tnr7\") pod \"nova-cell1-conductor-db-sync-4mxdb\" (UID: \"c26dcfcc-eff1-4daf-ad94-a46b19f3ef19\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-4mxdb" Mar 16 17:14:47 crc kubenswrapper[5120]: I0316 17:14:47.213663 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 17:14:47 crc kubenswrapper[5120]: I0316 17:14:47.310158 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-jsgxw" event={"ID":"8588f057-79ea-4d0e-b37b-ee267ab3edb6","Type":"ContainerStarted","Data":"c1191fe7f89f05bc89a6bf69e3c6feec40cae343bc12d8b6d1052de8e54f20ac"} Mar 16 17:14:47 crc kubenswrapper[5120]: I0316 17:14:47.320740 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-4hff7" event={"ID":"cc6c9a09-f17f-4ebc-a57d-d440091fcad8","Type":"ContainerStarted","Data":"bc54d7297fec7d5ba25a593cc8c260f3d404052b9f9f185c7ab132a21204ed12"} Mar 16 17:14:47 crc kubenswrapper[5120]: I0316 17:14:47.334166 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"374d764f-88f9-46d8-96f8-c905404c071d","Type":"ContainerStarted","Data":"e9d2558fe759da1191e8f42584de1e58e647f5ca0b84813e7a5b48d57a0e22ea"} Mar 16 17:14:47 crc kubenswrapper[5120]: I0316 17:14:47.342009 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"f022b20c-74d0-4409-9852-318b67aeeae2","Type":"ContainerStarted","Data":"ff862298178fe1af7d5a454bb643e1712035f8841baaf2c852db0ba04bb1c9c4"} Mar 16 17:14:47 crc kubenswrapper[5120]: I0316 17:14:47.344905 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"e4489a73-64a4-4585-a873-aa42a0f6eb5f","Type":"ContainerStarted","Data":"bfdffbc80c5fbdf1f1f2a57a2c6e7011b4a74c4ee2ad7a4c0be7b18560a69f4c"} Mar 16 17:14:47 crc kubenswrapper[5120]: I0316 17:14:47.345876 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/redhat-marketplace-4hff7" podStartSLOduration=4.499629775 podStartE2EDuration="5.345856777s" podCreationTimestamp="2026-03-16 17:14:42 +0000 UTC" firstStartedPulling="2026-03-16 17:14:44.13792375 +0000 UTC m=+6186.291855407" lastFinishedPulling="2026-03-16 17:14:44.984150752 +0000 UTC m=+6187.138082409" observedRunningTime="2026-03-16 17:14:47.339074991 +0000 UTC m=+6189.493006648" watchObservedRunningTime="2026-03-16 17:14:47.345856777 +0000 UTC m=+6189.499788434" Mar 16 17:14:47 crc kubenswrapper[5120]: I0316 17:14:47.383722 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-4mxdb" Mar 16 17:14:47 crc kubenswrapper[5120]: I0316 17:14:47.420976 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 17:14:47 crc kubenswrapper[5120]: I0316 17:14:47.572490 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 17:14:47 crc kubenswrapper[5120]: I0316 17:14:47.991314 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-4mxdb"] Mar 16 17:14:48 crc kubenswrapper[5120]: I0316 17:14:48.428312 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"af7aac1b-70e7-445c-8e51-8e6b01d77c69","Type":"ContainerStarted","Data":"34d58d1c51613caebcb9181a1f0cbfb83a07c577dc43c879b4d6686f82178f90"} Mar 16 17:14:48 crc kubenswrapper[5120]: I0316 17:14:48.428686 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"af7aac1b-70e7-445c-8e51-8e6b01d77c69","Type":"ContainerStarted","Data":"46125ec3eb308400049db8fefce31696e5dea54de211e7fa2550d94911cc722c"} Mar 16 17:14:48 crc kubenswrapper[5120]: I0316 17:14:48.452925 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"374d764f-88f9-46d8-96f8-c905404c071d","Type":"ContainerStarted","Data":"be42cb006fb2f331a8e83910a29e2ab5d8f6c83161668efd74291c643180e62f"} Mar 16 17:14:48 crc kubenswrapper[5120]: I0316 17:14:48.466000 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-scheduler-0" podStartSLOduration=2.465983143 podStartE2EDuration="2.465983143s" podCreationTimestamp="2026-03-16 17:14:46 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:14:48.449550793 +0000 UTC m=+6190.603482450" watchObservedRunningTime="2026-03-16 17:14:48.465983143 +0000 UTC m=+6190.619914800" Mar 16 17:14:48 crc kubenswrapper[5120]: I0316 17:14:48.467047 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-4mxdb" event={"ID":"c26dcfcc-eff1-4daf-ad94-a46b19f3ef19","Type":"ContainerStarted","Data":"d2d1984e8f336bf15aaabdb3ab94e9958586677a69ccab41ee3bc77397c1d236"} Mar 16 17:14:48 crc kubenswrapper[5120]: I0316 17:14:48.467094 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-4mxdb" event={"ID":"c26dcfcc-eff1-4daf-ad94-a46b19f3ef19","Type":"ContainerStarted","Data":"47e169a200fc429d7cc279c93d0dc1158033400b4d5ac389228822929c0540ab"} Mar 16 17:14:48 crc kubenswrapper[5120]: I0316 17:14:48.480254 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"f022b20c-74d0-4409-9852-318b67aeeae2","Type":"ContainerStarted","Data":"a77afd9f201fec7f881611d039ada22572126bc8bb32cd868301c3b70b41000f"} Mar 16 17:14:48 crc kubenswrapper[5120]: I0316 17:14:48.510146 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-4mxdb" podStartSLOduration=2.510125521 podStartE2EDuration="2.510125521s" podCreationTimestamp="2026-03-16 17:14:46 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:14:48.486043391 +0000 UTC m=+6190.639975058" watchObservedRunningTime="2026-03-16 17:14:48.510125521 +0000 UTC m=+6190.664057178" Mar 16 17:14:48 crc kubenswrapper[5120]: I0316 17:14:48.513084 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"e4489a73-64a4-4585-a873-aa42a0f6eb5f","Type":"ContainerStarted","Data":"7e355e83980207b8f0bade05ab089db81952541efe6bc1556798d30b9d61da20"} Mar 16 17:14:48 crc kubenswrapper[5120]: I0316 17:14:48.513163 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"e4489a73-64a4-4585-a873-aa42a0f6eb5f","Type":"ContainerStarted","Data":"f309f0cef0d4bb21b192ee5bd707364514cb781f159c042592fa64e4452cc66e"} Mar 16 17:14:48 crc kubenswrapper[5120]: I0316 17:14:48.522108 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podStartSLOduration=3.5220906579999998 podStartE2EDuration="3.522090658s" podCreationTimestamp="2026-03-16 17:14:45 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:14:48.502367708 +0000 UTC m=+6190.656299365" watchObservedRunningTime="2026-03-16 17:14:48.522090658 +0000 UTC m=+6190.676022315" Mar 16 17:14:48 crc kubenswrapper[5120]: I0316 17:14:48.524172 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-jsgxw" event={"ID":"8588f057-79ea-4d0e-b37b-ee267ab3edb6","Type":"ContainerStarted","Data":"4d5201645c90c320c938b67420b0e5657c14656d543ebc83b0e5396f29bec71b"} Mar 16 17:14:48 crc kubenswrapper[5120]: I0316 17:14:48.542882 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"134f4125-32e6-4735-8415-6abe03a532ca","Type":"ContainerStarted","Data":"6b0ca533c3546079afafe2cdf8b631d4230ee01aab4a28ead62d4bc4b5f4d03a"} Mar 16 17:14:48 crc kubenswrapper[5120]: I0316 17:14:48.542948 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"134f4125-32e6-4735-8415-6abe03a532ca","Type":"ContainerStarted","Data":"f5bfd76a556e229d29be3100db302fcfdf964225457977f3d11492ac1dd9186d"} Mar 16 17:14:48 crc kubenswrapper[5120]: I0316 17:14:48.542962 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"134f4125-32e6-4735-8415-6abe03a532ca","Type":"ContainerStarted","Data":"88905cd585fcf8ca58cdc29fcd1ccb6c7410a17630bcf3e4619f72618105af1e"} Mar 16 17:14:48 crc kubenswrapper[5120]: I0316 17:14:48.543836 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=3.543817683 podStartE2EDuration="3.543817683s" podCreationTimestamp="2026-03-16 17:14:45 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:14:48.541235532 +0000 UTC m=+6190.695167189" watchObservedRunningTime="2026-03-16 17:14:48.543817683 +0000 UTC m=+6190.697749350" Mar 16 17:14:48 crc kubenswrapper[5120]: I0316 17:14:48.595658 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-jsgxw" podStartSLOduration=3.59563083 podStartE2EDuration="3.59563083s" podCreationTimestamp="2026-03-16 17:14:45 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:14:48.562422791 +0000 UTC m=+6190.716354448" watchObservedRunningTime="2026-03-16 17:14:48.59563083 +0000 UTC m=+6190.749562497" Mar 16 17:14:48 crc kubenswrapper[5120]: I0316 17:14:48.618462 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=3.618438274 podStartE2EDuration="3.618438274s" podCreationTimestamp="2026-03-16 17:14:45 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:14:48.57733991 +0000 UTC m=+6190.731271567" watchObservedRunningTime="2026-03-16 17:14:48.618438274 +0000 UTC m=+6190.772369941" Mar 16 17:14:49 crc kubenswrapper[5120]: I0316 17:14:49.266589 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:14:49 crc kubenswrapper[5120]: I0316 17:14:49.266645 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:14:49 crc kubenswrapper[5120]: I0316 17:14:49.308215 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:14:49 crc kubenswrapper[5120]: I0316 17:14:49.330171 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:14:49 crc kubenswrapper[5120]: I0316 17:14:49.555980 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"374d764f-88f9-46d8-96f8-c905404c071d","Type":"ContainerStarted","Data":"8ed72a094e22dea94a8c30757e60373f243c6f8ac66e7e009ba0bd9251639c7c"} Mar 16 17:14:49 crc kubenswrapper[5120]: I0316 17:14:49.558364 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:14:49 crc kubenswrapper[5120]: I0316 17:14:49.558402 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:14:49 crc kubenswrapper[5120]: I0316 17:14:49.585487 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 17:14:49 crc kubenswrapper[5120]: I0316 17:14:49.592066 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 17:14:49 crc kubenswrapper[5120]: I0316 17:14:49.870431 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:14:49 crc kubenswrapper[5120]: I0316 17:14:49.872251 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:14:49 crc kubenswrapper[5120]: I0316 17:14:49.914297 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:14:49 crc kubenswrapper[5120]: I0316 17:14:49.941417 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:14:50 crc kubenswrapper[5120]: I0316 17:14:50.082434 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 17:14:50 crc kubenswrapper[5120]: I0316 17:14:50.082703 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="c0fcea62-ce96-4685-b87d-14c1c88f6018" containerName="nova-cell0-conductor-conductor" containerID="cri-o://09697be63c3ff809ef058e7c47fb33335e0f92dbd8a8ca4429e77b3110c5e460" gracePeriod=30 Mar 16 17:14:50 crc kubenswrapper[5120]: I0316 17:14:50.138040 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 17:14:50 crc kubenswrapper[5120]: I0316 17:14:50.153398 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 17:14:50 crc kubenswrapper[5120]: I0316 17:14:50.565449 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="e4489a73-64a4-4585-a873-aa42a0f6eb5f" containerName="nova-api-log" containerID="cri-o://f309f0cef0d4bb21b192ee5bd707364514cb781f159c042592fa64e4452cc66e" gracePeriod=30 Mar 16 17:14:50 crc kubenswrapper[5120]: I0316 17:14:50.566167 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="e4489a73-64a4-4585-a873-aa42a0f6eb5f" containerName="nova-api-api" containerID="cri-o://7e355e83980207b8f0bade05ab089db81952541efe6bc1556798d30b9d61da20" gracePeriod=30 Mar 16 17:14:50 crc kubenswrapper[5120]: I0316 17:14:50.566431 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="134f4125-32e6-4735-8415-6abe03a532ca" containerName="nova-metadata-log" containerID="cri-o://f5bfd76a556e229d29be3100db302fcfdf964225457977f3d11492ac1dd9186d" gracePeriod=30 Mar 16 17:14:50 crc kubenswrapper[5120]: I0316 17:14:50.566514 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podUID="f022b20c-74d0-4409-9852-318b67aeeae2" containerName="nova-cell1-novncproxy-novncproxy" containerID="cri-o://a77afd9f201fec7f881611d039ada22572126bc8bb32cd868301c3b70b41000f" gracePeriod=30 Mar 16 17:14:50 crc kubenswrapper[5120]: I0316 17:14:50.566586 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="134f4125-32e6-4735-8415-6abe03a532ca" containerName="nova-metadata-metadata" containerID="cri-o://6b0ca533c3546079afafe2cdf8b631d4230ee01aab4a28ead62d4bc4b5f4d03a" gracePeriod=30 Mar 16 17:14:50 crc kubenswrapper[5120]: I0316 17:14:50.567017 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:14:50 crc kubenswrapper[5120]: I0316 17:14:50.567038 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:14:50 crc kubenswrapper[5120]: I0316 17:14:50.570969 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="af7aac1b-70e7-445c-8e51-8e6b01d77c69" containerName="nova-scheduler-scheduler" containerID="cri-o://34d58d1c51613caebcb9181a1f0cbfb83a07c577dc43c879b4d6686f82178f90" gracePeriod=30 Mar 16 17:14:51 crc kubenswrapper[5120]: I0316 17:14:51.356121 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:14:51 crc kubenswrapper[5120]: I0316 17:14:51.450454 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jnmbn\" (UniqueName: \"kubernetes.io/projected/e4489a73-64a4-4585-a873-aa42a0f6eb5f-kube-api-access-jnmbn\") pod \"e4489a73-64a4-4585-a873-aa42a0f6eb5f\" (UID: \"e4489a73-64a4-4585-a873-aa42a0f6eb5f\") " Mar 16 17:14:51 crc kubenswrapper[5120]: I0316 17:14:51.450561 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e4489a73-64a4-4585-a873-aa42a0f6eb5f-logs\") pod \"e4489a73-64a4-4585-a873-aa42a0f6eb5f\" (UID: \"e4489a73-64a4-4585-a873-aa42a0f6eb5f\") " Mar 16 17:14:51 crc kubenswrapper[5120]: I0316 17:14:51.450747 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e4489a73-64a4-4585-a873-aa42a0f6eb5f-combined-ca-bundle\") pod \"e4489a73-64a4-4585-a873-aa42a0f6eb5f\" (UID: \"e4489a73-64a4-4585-a873-aa42a0f6eb5f\") " Mar 16 17:14:51 crc kubenswrapper[5120]: I0316 17:14:51.451093 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e4489a73-64a4-4585-a873-aa42a0f6eb5f-config-data\") pod \"e4489a73-64a4-4585-a873-aa42a0f6eb5f\" (UID: \"e4489a73-64a4-4585-a873-aa42a0f6eb5f\") " Mar 16 17:14:51 crc kubenswrapper[5120]: I0316 17:14:51.451320 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4489a73-64a4-4585-a873-aa42a0f6eb5f-logs" (OuterVolumeSpecName: "logs") pod "e4489a73-64a4-4585-a873-aa42a0f6eb5f" (UID: "e4489a73-64a4-4585-a873-aa42a0f6eb5f"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:14:51 crc kubenswrapper[5120]: I0316 17:14:51.452041 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e4489a73-64a4-4585-a873-aa42a0f6eb5f-logs\") on node \"crc\" DevicePath \"\"" Mar 16 17:14:51 crc kubenswrapper[5120]: I0316 17:14:51.457454 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e4489a73-64a4-4585-a873-aa42a0f6eb5f-kube-api-access-jnmbn" (OuterVolumeSpecName: "kube-api-access-jnmbn") pod "e4489a73-64a4-4585-a873-aa42a0f6eb5f" (UID: "e4489a73-64a4-4585-a873-aa42a0f6eb5f"). InnerVolumeSpecName "kube-api-access-jnmbn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:14:51 crc kubenswrapper[5120]: I0316 17:14:51.466778 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:14:51 crc kubenswrapper[5120]: I0316 17:14:51.504970 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e4489a73-64a4-4585-a873-aa42a0f6eb5f-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e4489a73-64a4-4585-a873-aa42a0f6eb5f" (UID: "e4489a73-64a4-4585-a873-aa42a0f6eb5f"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:14:51 crc kubenswrapper[5120]: I0316 17:14:51.518671 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e4489a73-64a4-4585-a873-aa42a0f6eb5f-config-data" (OuterVolumeSpecName: "config-data") pod "e4489a73-64a4-4585-a873-aa42a0f6eb5f" (UID: "e4489a73-64a4-4585-a873-aa42a0f6eb5f"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:14:51 crc kubenswrapper[5120]: I0316 17:14:51.555473 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/134f4125-32e6-4735-8415-6abe03a532ca-logs\") pod \"134f4125-32e6-4735-8415-6abe03a532ca\" (UID: \"134f4125-32e6-4735-8415-6abe03a532ca\") " Mar 16 17:14:51 crc kubenswrapper[5120]: I0316 17:14:51.555551 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gnzn7\" (UniqueName: \"kubernetes.io/projected/134f4125-32e6-4735-8415-6abe03a532ca-kube-api-access-gnzn7\") pod \"134f4125-32e6-4735-8415-6abe03a532ca\" (UID: \"134f4125-32e6-4735-8415-6abe03a532ca\") " Mar 16 17:14:51 crc kubenswrapper[5120]: I0316 17:14:51.555930 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/134f4125-32e6-4735-8415-6abe03a532ca-combined-ca-bundle\") pod \"134f4125-32e6-4735-8415-6abe03a532ca\" (UID: \"134f4125-32e6-4735-8415-6abe03a532ca\") " Mar 16 17:14:51 crc kubenswrapper[5120]: I0316 17:14:51.555925 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/134f4125-32e6-4735-8415-6abe03a532ca-logs" (OuterVolumeSpecName: "logs") pod "134f4125-32e6-4735-8415-6abe03a532ca" (UID: "134f4125-32e6-4735-8415-6abe03a532ca"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:14:51 crc kubenswrapper[5120]: I0316 17:14:51.555966 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/134f4125-32e6-4735-8415-6abe03a532ca-config-data\") pod \"134f4125-32e6-4735-8415-6abe03a532ca\" (UID: \"134f4125-32e6-4735-8415-6abe03a532ca\") " Mar 16 17:14:51 crc kubenswrapper[5120]: I0316 17:14:51.556603 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e4489a73-64a4-4585-a873-aa42a0f6eb5f-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:14:51 crc kubenswrapper[5120]: I0316 17:14:51.556615 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/134f4125-32e6-4735-8415-6abe03a532ca-logs\") on node \"crc\" DevicePath \"\"" Mar 16 17:14:51 crc kubenswrapper[5120]: I0316 17:14:51.556624 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jnmbn\" (UniqueName: \"kubernetes.io/projected/e4489a73-64a4-4585-a873-aa42a0f6eb5f-kube-api-access-jnmbn\") on node \"crc\" DevicePath \"\"" Mar 16 17:14:51 crc kubenswrapper[5120]: I0316 17:14:51.556635 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e4489a73-64a4-4585-a873-aa42a0f6eb5f-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:14:51 crc kubenswrapper[5120]: I0316 17:14:51.559582 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/134f4125-32e6-4735-8415-6abe03a532ca-kube-api-access-gnzn7" (OuterVolumeSpecName: "kube-api-access-gnzn7") pod "134f4125-32e6-4735-8415-6abe03a532ca" (UID: "134f4125-32e6-4735-8415-6abe03a532ca"). InnerVolumeSpecName "kube-api-access-gnzn7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:14:51 crc kubenswrapper[5120]: I0316 17:14:51.588523 5120 generic.go:358] "Generic (PLEG): container finished" podID="f022b20c-74d0-4409-9852-318b67aeeae2" containerID="a77afd9f201fec7f881611d039ada22572126bc8bb32cd868301c3b70b41000f" exitCode=0 Mar 16 17:14:51 crc kubenswrapper[5120]: I0316 17:14:51.588835 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"f022b20c-74d0-4409-9852-318b67aeeae2","Type":"ContainerDied","Data":"a77afd9f201fec7f881611d039ada22572126bc8bb32cd868301c3b70b41000f"} Mar 16 17:14:51 crc kubenswrapper[5120]: I0316 17:14:51.591790 5120 generic.go:358] "Generic (PLEG): container finished" podID="e4489a73-64a4-4585-a873-aa42a0f6eb5f" containerID="7e355e83980207b8f0bade05ab089db81952541efe6bc1556798d30b9d61da20" exitCode=0 Mar 16 17:14:51 crc kubenswrapper[5120]: I0316 17:14:51.591813 5120 generic.go:358] "Generic (PLEG): container finished" podID="e4489a73-64a4-4585-a873-aa42a0f6eb5f" containerID="f309f0cef0d4bb21b192ee5bd707364514cb781f159c042592fa64e4452cc66e" exitCode=143 Mar 16 17:14:51 crc kubenswrapper[5120]: I0316 17:14:51.591973 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"e4489a73-64a4-4585-a873-aa42a0f6eb5f","Type":"ContainerDied","Data":"7e355e83980207b8f0bade05ab089db81952541efe6bc1556798d30b9d61da20"} Mar 16 17:14:51 crc kubenswrapper[5120]: I0316 17:14:51.591999 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"e4489a73-64a4-4585-a873-aa42a0f6eb5f","Type":"ContainerDied","Data":"f309f0cef0d4bb21b192ee5bd707364514cb781f159c042592fa64e4452cc66e"} Mar 16 17:14:51 crc kubenswrapper[5120]: I0316 17:14:51.592008 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"e4489a73-64a4-4585-a873-aa42a0f6eb5f","Type":"ContainerDied","Data":"bfdffbc80c5fbdf1f1f2a57a2c6e7011b4a74c4ee2ad7a4c0be7b18560a69f4c"} Mar 16 17:14:51 crc kubenswrapper[5120]: I0316 17:14:51.592023 5120 scope.go:117] "RemoveContainer" containerID="7e355e83980207b8f0bade05ab089db81952541efe6bc1556798d30b9d61da20" Mar 16 17:14:51 crc kubenswrapper[5120]: I0316 17:14:51.592160 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:14:51 crc kubenswrapper[5120]: I0316 17:14:51.623016 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:14:51 crc kubenswrapper[5120]: I0316 17:14:51.658387 5120 generic.go:358] "Generic (PLEG): container finished" podID="134f4125-32e6-4735-8415-6abe03a532ca" containerID="6b0ca533c3546079afafe2cdf8b631d4230ee01aab4a28ead62d4bc4b5f4d03a" exitCode=0 Mar 16 17:14:51 crc kubenswrapper[5120]: I0316 17:14:51.658430 5120 generic.go:358] "Generic (PLEG): container finished" podID="134f4125-32e6-4735-8415-6abe03a532ca" containerID="f5bfd76a556e229d29be3100db302fcfdf964225457977f3d11492ac1dd9186d" exitCode=143 Mar 16 17:14:51 crc kubenswrapper[5120]: I0316 17:14:51.658888 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"134f4125-32e6-4735-8415-6abe03a532ca","Type":"ContainerDied","Data":"6b0ca533c3546079afafe2cdf8b631d4230ee01aab4a28ead62d4bc4b5f4d03a"} Mar 16 17:14:51 crc kubenswrapper[5120]: I0316 17:14:51.658926 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"134f4125-32e6-4735-8415-6abe03a532ca","Type":"ContainerDied","Data":"f5bfd76a556e229d29be3100db302fcfdf964225457977f3d11492ac1dd9186d"} Mar 16 17:14:51 crc kubenswrapper[5120]: I0316 17:14:51.658940 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"134f4125-32e6-4735-8415-6abe03a532ca","Type":"ContainerDied","Data":"88905cd585fcf8ca58cdc29fcd1ccb6c7410a17630bcf3e4619f72618105af1e"} Mar 16 17:14:51 crc kubenswrapper[5120]: I0316 17:14:51.659364 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:14:51 crc kubenswrapper[5120]: I0316 17:14:51.672801 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 17:14:51 crc kubenswrapper[5120]: I0316 17:14:51.678334 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/134f4125-32e6-4735-8415-6abe03a532ca-config-data" (OuterVolumeSpecName: "config-data") pod "134f4125-32e6-4735-8415-6abe03a532ca" (UID: "134f4125-32e6-4735-8415-6abe03a532ca"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:14:51 crc kubenswrapper[5120]: I0316 17:14:51.681102 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/134f4125-32e6-4735-8415-6abe03a532ca-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "134f4125-32e6-4735-8415-6abe03a532ca" (UID: "134f4125-32e6-4735-8415-6abe03a532ca"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:14:51 crc kubenswrapper[5120]: I0316 17:14:51.689036 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gnzn7\" (UniqueName: \"kubernetes.io/projected/134f4125-32e6-4735-8415-6abe03a532ca-kube-api-access-gnzn7\") on node \"crc\" DevicePath \"\"" Mar 16 17:14:51 crc kubenswrapper[5120]: I0316 17:14:51.689065 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/134f4125-32e6-4735-8415-6abe03a532ca-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:14:51 crc kubenswrapper[5120]: I0316 17:14:51.689082 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/134f4125-32e6-4735-8415-6abe03a532ca-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:14:51 crc kubenswrapper[5120]: I0316 17:14:51.689085 5120 scope.go:117] "RemoveContainer" containerID="f309f0cef0d4bb21b192ee5bd707364514cb781f159c042592fa64e4452cc66e" Mar 16 17:14:51 crc kubenswrapper[5120]: I0316 17:14:51.689108 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 17:14:51 crc kubenswrapper[5120]: I0316 17:14:51.729593 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"374d764f-88f9-46d8-96f8-c905404c071d","Type":"ContainerStarted","Data":"3e8727a737dce589dc33ea4512264860e071807d9a0b5d49ffb54328ba5172d4"} Mar 16 17:14:51 crc kubenswrapper[5120]: I0316 17:14:51.729667 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:14:51 crc kubenswrapper[5120]: I0316 17:14:51.741734 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 17:14:51 crc kubenswrapper[5120]: I0316 17:14:51.743629 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4489a73-64a4-4585-a873-aa42a0f6eb5f" containerName="nova-api-api" Mar 16 17:14:51 crc kubenswrapper[5120]: I0316 17:14:51.743651 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4489a73-64a4-4585-a873-aa42a0f6eb5f" containerName="nova-api-api" Mar 16 17:14:51 crc kubenswrapper[5120]: I0316 17:14:51.743785 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4489a73-64a4-4585-a873-aa42a0f6eb5f" containerName="nova-api-log" Mar 16 17:14:51 crc kubenswrapper[5120]: I0316 17:14:51.743793 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4489a73-64a4-4585-a873-aa42a0f6eb5f" containerName="nova-api-log" Mar 16 17:14:51 crc kubenswrapper[5120]: I0316 17:14:51.743824 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="134f4125-32e6-4735-8415-6abe03a532ca" containerName="nova-metadata-log" Mar 16 17:14:51 crc kubenswrapper[5120]: I0316 17:14:51.743833 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="134f4125-32e6-4735-8415-6abe03a532ca" containerName="nova-metadata-log" Mar 16 17:14:51 crc kubenswrapper[5120]: I0316 17:14:51.743868 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="134f4125-32e6-4735-8415-6abe03a532ca" containerName="nova-metadata-metadata" Mar 16 17:14:51 crc kubenswrapper[5120]: I0316 17:14:51.743874 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="134f4125-32e6-4735-8415-6abe03a532ca" containerName="nova-metadata-metadata" Mar 16 17:14:51 crc kubenswrapper[5120]: I0316 17:14:51.744179 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e4489a73-64a4-4585-a873-aa42a0f6eb5f" containerName="nova-api-api" Mar 16 17:14:51 crc kubenswrapper[5120]: I0316 17:14:51.744212 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e4489a73-64a4-4585-a873-aa42a0f6eb5f" containerName="nova-api-log" Mar 16 17:14:51 crc kubenswrapper[5120]: I0316 17:14:51.744221 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="134f4125-32e6-4735-8415-6abe03a532ca" containerName="nova-metadata-metadata" Mar 16 17:14:51 crc kubenswrapper[5120]: I0316 17:14:51.744247 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="134f4125-32e6-4735-8415-6abe03a532ca" containerName="nova-metadata-log" Mar 16 17:14:51 crc kubenswrapper[5120]: I0316 17:14:51.750892 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:14:51 crc kubenswrapper[5120]: I0316 17:14:51.760877 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-config-data\"" Mar 16 17:14:51 crc kubenswrapper[5120]: I0316 17:14:51.774893 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 17:14:51 crc kubenswrapper[5120]: I0316 17:14:51.775446 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.143655836 podStartE2EDuration="7.775423557s" podCreationTimestamp="2026-03-16 17:14:44 +0000 UTC" firstStartedPulling="2026-03-16 17:14:45.064688376 +0000 UTC m=+6187.218620033" lastFinishedPulling="2026-03-16 17:14:50.696456097 +0000 UTC m=+6192.850387754" observedRunningTime="2026-03-16 17:14:51.76129215 +0000 UTC m=+6193.915223817" watchObservedRunningTime="2026-03-16 17:14:51.775423557 +0000 UTC m=+6193.929355204" Mar 16 17:14:51 crc kubenswrapper[5120]: I0316 17:14:51.801024 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b787b31b-bfd4-4268-a8fe-9887e4822a9b-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"b787b31b-bfd4-4268-a8fe-9887e4822a9b\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:14:51 crc kubenswrapper[5120]: I0316 17:14:51.801383 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b787b31b-bfd4-4268-a8fe-9887e4822a9b-logs\") pod \"nova-api-0\" (UID: \"b787b31b-bfd4-4268-a8fe-9887e4822a9b\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:14:51 crc kubenswrapper[5120]: I0316 17:14:51.802372 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b787b31b-bfd4-4268-a8fe-9887e4822a9b-config-data\") pod \"nova-api-0\" (UID: \"b787b31b-bfd4-4268-a8fe-9887e4822a9b\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:14:51 crc kubenswrapper[5120]: I0316 17:14:51.802568 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9l2m\" (UniqueName: \"kubernetes.io/projected/b787b31b-bfd4-4268-a8fe-9887e4822a9b-kube-api-access-v9l2m\") pod \"nova-api-0\" (UID: \"b787b31b-bfd4-4268-a8fe-9887e4822a9b\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:14:51 crc kubenswrapper[5120]: I0316 17:14:51.845608 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:14:51 crc kubenswrapper[5120]: I0316 17:14:51.882940 5120 scope.go:117] "RemoveContainer" containerID="7e355e83980207b8f0bade05ab089db81952541efe6bc1556798d30b9d61da20" Mar 16 17:14:51 crc kubenswrapper[5120]: E0316 17:14:51.888041 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e355e83980207b8f0bade05ab089db81952541efe6bc1556798d30b9d61da20\": container with ID starting with 7e355e83980207b8f0bade05ab089db81952541efe6bc1556798d30b9d61da20 not found: ID does not exist" containerID="7e355e83980207b8f0bade05ab089db81952541efe6bc1556798d30b9d61da20" Mar 16 17:14:51 crc kubenswrapper[5120]: I0316 17:14:51.888337 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e355e83980207b8f0bade05ab089db81952541efe6bc1556798d30b9d61da20"} err="failed to get container status \"7e355e83980207b8f0bade05ab089db81952541efe6bc1556798d30b9d61da20\": rpc error: code = NotFound desc = could not find container \"7e355e83980207b8f0bade05ab089db81952541efe6bc1556798d30b9d61da20\": container with ID starting with 7e355e83980207b8f0bade05ab089db81952541efe6bc1556798d30b9d61da20 not found: ID does not exist" Mar 16 17:14:51 crc kubenswrapper[5120]: I0316 17:14:51.888362 5120 scope.go:117] "RemoveContainer" containerID="f309f0cef0d4bb21b192ee5bd707364514cb781f159c042592fa64e4452cc66e" Mar 16 17:14:51 crc kubenswrapper[5120]: E0316 17:14:51.897011 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f309f0cef0d4bb21b192ee5bd707364514cb781f159c042592fa64e4452cc66e\": container with ID starting with f309f0cef0d4bb21b192ee5bd707364514cb781f159c042592fa64e4452cc66e not found: ID does not exist" containerID="f309f0cef0d4bb21b192ee5bd707364514cb781f159c042592fa64e4452cc66e" Mar 16 17:14:51 crc kubenswrapper[5120]: I0316 17:14:51.897096 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f309f0cef0d4bb21b192ee5bd707364514cb781f159c042592fa64e4452cc66e"} err="failed to get container status \"f309f0cef0d4bb21b192ee5bd707364514cb781f159c042592fa64e4452cc66e\": rpc error: code = NotFound desc = could not find container \"f309f0cef0d4bb21b192ee5bd707364514cb781f159c042592fa64e4452cc66e\": container with ID starting with f309f0cef0d4bb21b192ee5bd707364514cb781f159c042592fa64e4452cc66e not found: ID does not exist" Mar 16 17:14:51 crc kubenswrapper[5120]: I0316 17:14:51.897132 5120 scope.go:117] "RemoveContainer" containerID="7e355e83980207b8f0bade05ab089db81952541efe6bc1556798d30b9d61da20" Mar 16 17:14:51 crc kubenswrapper[5120]: I0316 17:14:51.902958 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e355e83980207b8f0bade05ab089db81952541efe6bc1556798d30b9d61da20"} err="failed to get container status \"7e355e83980207b8f0bade05ab089db81952541efe6bc1556798d30b9d61da20\": rpc error: code = NotFound desc = could not find container \"7e355e83980207b8f0bade05ab089db81952541efe6bc1556798d30b9d61da20\": container with ID starting with 7e355e83980207b8f0bade05ab089db81952541efe6bc1556798d30b9d61da20 not found: ID does not exist" Mar 16 17:14:51 crc kubenswrapper[5120]: I0316 17:14:51.903013 5120 scope.go:117] "RemoveContainer" containerID="f309f0cef0d4bb21b192ee5bd707364514cb781f159c042592fa64e4452cc66e" Mar 16 17:14:51 crc kubenswrapper[5120]: I0316 17:14:51.904321 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b787b31b-bfd4-4268-a8fe-9887e4822a9b-config-data\") pod \"nova-api-0\" (UID: \"b787b31b-bfd4-4268-a8fe-9887e4822a9b\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:14:51 crc kubenswrapper[5120]: I0316 17:14:51.904411 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v9l2m\" (UniqueName: \"kubernetes.io/projected/b787b31b-bfd4-4268-a8fe-9887e4822a9b-kube-api-access-v9l2m\") pod \"nova-api-0\" (UID: \"b787b31b-bfd4-4268-a8fe-9887e4822a9b\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:14:51 crc kubenswrapper[5120]: I0316 17:14:51.904720 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b787b31b-bfd4-4268-a8fe-9887e4822a9b-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"b787b31b-bfd4-4268-a8fe-9887e4822a9b\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:14:51 crc kubenswrapper[5120]: I0316 17:14:51.904804 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b787b31b-bfd4-4268-a8fe-9887e4822a9b-logs\") pod \"nova-api-0\" (UID: \"b787b31b-bfd4-4268-a8fe-9887e4822a9b\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:14:51 crc kubenswrapper[5120]: I0316 17:14:51.906667 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f309f0cef0d4bb21b192ee5bd707364514cb781f159c042592fa64e4452cc66e"} err="failed to get container status \"f309f0cef0d4bb21b192ee5bd707364514cb781f159c042592fa64e4452cc66e\": rpc error: code = NotFound desc = could not find container \"f309f0cef0d4bb21b192ee5bd707364514cb781f159c042592fa64e4452cc66e\": container with ID starting with f309f0cef0d4bb21b192ee5bd707364514cb781f159c042592fa64e4452cc66e not found: ID does not exist" Mar 16 17:14:51 crc kubenswrapper[5120]: I0316 17:14:51.906711 5120 scope.go:117] "RemoveContainer" containerID="6b0ca533c3546079afafe2cdf8b631d4230ee01aab4a28ead62d4bc4b5f4d03a" Mar 16 17:14:51 crc kubenswrapper[5120]: I0316 17:14:51.908808 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:14:51 crc kubenswrapper[5120]: I0316 17:14:51.909628 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b787b31b-bfd4-4268-a8fe-9887e4822a9b-logs\") pod \"nova-api-0\" (UID: \"b787b31b-bfd4-4268-a8fe-9887e4822a9b\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:14:51 crc kubenswrapper[5120]: I0316 17:14:51.918205 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b787b31b-bfd4-4268-a8fe-9887e4822a9b-config-data\") pod \"nova-api-0\" (UID: \"b787b31b-bfd4-4268-a8fe-9887e4822a9b\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:14:51 crc kubenswrapper[5120]: I0316 17:14:51.923750 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b787b31b-bfd4-4268-a8fe-9887e4822a9b-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"b787b31b-bfd4-4268-a8fe-9887e4822a9b\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:14:51 crc kubenswrapper[5120]: I0316 17:14:51.945376 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9l2m\" (UniqueName: \"kubernetes.io/projected/b787b31b-bfd4-4268-a8fe-9887e4822a9b-kube-api-access-v9l2m\") pod \"nova-api-0\" (UID: \"b787b31b-bfd4-4268-a8fe-9887e4822a9b\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:14:51 crc kubenswrapper[5120]: I0316 17:14:51.982929 5120 scope.go:117] "RemoveContainer" containerID="f5bfd76a556e229d29be3100db302fcfdf964225457977f3d11492ac1dd9186d" Mar 16 17:14:52 crc kubenswrapper[5120]: I0316 17:14:52.009458 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zvhfw\" (UniqueName: \"kubernetes.io/projected/f022b20c-74d0-4409-9852-318b67aeeae2-kube-api-access-zvhfw\") pod \"f022b20c-74d0-4409-9852-318b67aeeae2\" (UID: \"f022b20c-74d0-4409-9852-318b67aeeae2\") " Mar 16 17:14:52 crc kubenswrapper[5120]: I0316 17:14:52.009940 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f022b20c-74d0-4409-9852-318b67aeeae2-config-data\") pod \"f022b20c-74d0-4409-9852-318b67aeeae2\" (UID: \"f022b20c-74d0-4409-9852-318b67aeeae2\") " Mar 16 17:14:52 crc kubenswrapper[5120]: I0316 17:14:52.009972 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f022b20c-74d0-4409-9852-318b67aeeae2-combined-ca-bundle\") pod \"f022b20c-74d0-4409-9852-318b67aeeae2\" (UID: \"f022b20c-74d0-4409-9852-318b67aeeae2\") " Mar 16 17:14:52 crc kubenswrapper[5120]: I0316 17:14:52.012574 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 17:14:52 crc kubenswrapper[5120]: I0316 17:14:52.019471 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f022b20c-74d0-4409-9852-318b67aeeae2-kube-api-access-zvhfw" (OuterVolumeSpecName: "kube-api-access-zvhfw") pod "f022b20c-74d0-4409-9852-318b67aeeae2" (UID: "f022b20c-74d0-4409-9852-318b67aeeae2"). InnerVolumeSpecName "kube-api-access-zvhfw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:14:52 crc kubenswrapper[5120]: I0316 17:14:52.029855 5120 scope.go:117] "RemoveContainer" containerID="6b0ca533c3546079afafe2cdf8b631d4230ee01aab4a28ead62d4bc4b5f4d03a" Mar 16 17:14:52 crc kubenswrapper[5120]: E0316 17:14:52.034720 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b0ca533c3546079afafe2cdf8b631d4230ee01aab4a28ead62d4bc4b5f4d03a\": container with ID starting with 6b0ca533c3546079afafe2cdf8b631d4230ee01aab4a28ead62d4bc4b5f4d03a not found: ID does not exist" containerID="6b0ca533c3546079afafe2cdf8b631d4230ee01aab4a28ead62d4bc4b5f4d03a" Mar 16 17:14:52 crc kubenswrapper[5120]: I0316 17:14:52.034780 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b0ca533c3546079afafe2cdf8b631d4230ee01aab4a28ead62d4bc4b5f4d03a"} err="failed to get container status \"6b0ca533c3546079afafe2cdf8b631d4230ee01aab4a28ead62d4bc4b5f4d03a\": rpc error: code = NotFound desc = could not find container \"6b0ca533c3546079afafe2cdf8b631d4230ee01aab4a28ead62d4bc4b5f4d03a\": container with ID starting with 6b0ca533c3546079afafe2cdf8b631d4230ee01aab4a28ead62d4bc4b5f4d03a not found: ID does not exist" Mar 16 17:14:52 crc kubenswrapper[5120]: I0316 17:14:52.034802 5120 scope.go:117] "RemoveContainer" containerID="f5bfd76a556e229d29be3100db302fcfdf964225457977f3d11492ac1dd9186d" Mar 16 17:14:52 crc kubenswrapper[5120]: E0316 17:14:52.035467 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f5bfd76a556e229d29be3100db302fcfdf964225457977f3d11492ac1dd9186d\": container with ID starting with f5bfd76a556e229d29be3100db302fcfdf964225457977f3d11492ac1dd9186d not found: ID does not exist" containerID="f5bfd76a556e229d29be3100db302fcfdf964225457977f3d11492ac1dd9186d" Mar 16 17:14:52 crc kubenswrapper[5120]: I0316 17:14:52.035500 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5bfd76a556e229d29be3100db302fcfdf964225457977f3d11492ac1dd9186d"} err="failed to get container status \"f5bfd76a556e229d29be3100db302fcfdf964225457977f3d11492ac1dd9186d\": rpc error: code = NotFound desc = could not find container \"f5bfd76a556e229d29be3100db302fcfdf964225457977f3d11492ac1dd9186d\": container with ID starting with f5bfd76a556e229d29be3100db302fcfdf964225457977f3d11492ac1dd9186d not found: ID does not exist" Mar 16 17:14:52 crc kubenswrapper[5120]: I0316 17:14:52.035513 5120 scope.go:117] "RemoveContainer" containerID="6b0ca533c3546079afafe2cdf8b631d4230ee01aab4a28ead62d4bc4b5f4d03a" Mar 16 17:14:52 crc kubenswrapper[5120]: I0316 17:14:52.035934 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b0ca533c3546079afafe2cdf8b631d4230ee01aab4a28ead62d4bc4b5f4d03a"} err="failed to get container status \"6b0ca533c3546079afafe2cdf8b631d4230ee01aab4a28ead62d4bc4b5f4d03a\": rpc error: code = NotFound desc = could not find container \"6b0ca533c3546079afafe2cdf8b631d4230ee01aab4a28ead62d4bc4b5f4d03a\": container with ID starting with 6b0ca533c3546079afafe2cdf8b631d4230ee01aab4a28ead62d4bc4b5f4d03a not found: ID does not exist" Mar 16 17:14:52 crc kubenswrapper[5120]: I0316 17:14:52.035955 5120 scope.go:117] "RemoveContainer" containerID="f5bfd76a556e229d29be3100db302fcfdf964225457977f3d11492ac1dd9186d" Mar 16 17:14:52 crc kubenswrapper[5120]: I0316 17:14:52.037572 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5bfd76a556e229d29be3100db302fcfdf964225457977f3d11492ac1dd9186d"} err="failed to get container status \"f5bfd76a556e229d29be3100db302fcfdf964225457977f3d11492ac1dd9186d\": rpc error: code = NotFound desc = could not find container \"f5bfd76a556e229d29be3100db302fcfdf964225457977f3d11492ac1dd9186d\": container with ID starting with f5bfd76a556e229d29be3100db302fcfdf964225457977f3d11492ac1dd9186d not found: ID does not exist" Mar 16 17:14:52 crc kubenswrapper[5120]: I0316 17:14:52.045834 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 17:14:52 crc kubenswrapper[5120]: I0316 17:14:52.059888 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f022b20c-74d0-4409-9852-318b67aeeae2-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f022b20c-74d0-4409-9852-318b67aeeae2" (UID: "f022b20c-74d0-4409-9852-318b67aeeae2"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:14:52 crc kubenswrapper[5120]: I0316 17:14:52.072427 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f022b20c-74d0-4409-9852-318b67aeeae2-config-data" (OuterVolumeSpecName: "config-data") pod "f022b20c-74d0-4409-9852-318b67aeeae2" (UID: "f022b20c-74d0-4409-9852-318b67aeeae2"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:14:52 crc kubenswrapper[5120]: I0316 17:14:52.082433 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 17:14:52 crc kubenswrapper[5120]: I0316 17:14:52.083921 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f022b20c-74d0-4409-9852-318b67aeeae2" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 17:14:52 crc kubenswrapper[5120]: I0316 17:14:52.084039 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f022b20c-74d0-4409-9852-318b67aeeae2" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 17:14:52 crc kubenswrapper[5120]: I0316 17:14:52.084305 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f022b20c-74d0-4409-9852-318b67aeeae2" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 17:14:52 crc kubenswrapper[5120]: I0316 17:14:52.088631 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:14:52 crc kubenswrapper[5120]: I0316 17:14:52.092630 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-metadata-config-data\"" Mar 16 17:14:52 crc kubenswrapper[5120]: I0316 17:14:52.092654 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-metadata-internal-svc\"" Mar 16 17:14:52 crc kubenswrapper[5120]: I0316 17:14:52.095722 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 17:14:52 crc kubenswrapper[5120]: I0316 17:14:52.115881 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zvhfw\" (UniqueName: \"kubernetes.io/projected/f022b20c-74d0-4409-9852-318b67aeeae2-kube-api-access-zvhfw\") on node \"crc\" DevicePath \"\"" Mar 16 17:14:52 crc kubenswrapper[5120]: I0316 17:14:52.115909 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f022b20c-74d0-4409-9852-318b67aeeae2-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:14:52 crc kubenswrapper[5120]: I0316 17:14:52.115920 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f022b20c-74d0-4409-9852-318b67aeeae2-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:14:52 crc kubenswrapper[5120]: I0316 17:14:52.204103 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:14:52 crc kubenswrapper[5120]: I0316 17:14:52.218526 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b99r2\" (UniqueName: \"kubernetes.io/projected/57c93f23-dca4-4b4a-8412-cc906209adb1-kube-api-access-b99r2\") pod \"nova-metadata-0\" (UID: \"57c93f23-dca4-4b4a-8412-cc906209adb1\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:14:52 crc kubenswrapper[5120]: I0316 17:14:52.218654 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/57c93f23-dca4-4b4a-8412-cc906209adb1-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"57c93f23-dca4-4b4a-8412-cc906209adb1\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:14:52 crc kubenswrapper[5120]: I0316 17:14:52.218969 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/57c93f23-dca4-4b4a-8412-cc906209adb1-config-data\") pod \"nova-metadata-0\" (UID: \"57c93f23-dca4-4b4a-8412-cc906209adb1\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:14:52 crc kubenswrapper[5120]: I0316 17:14:52.219582 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/57c93f23-dca4-4b4a-8412-cc906209adb1-logs\") pod \"nova-metadata-0\" (UID: \"57c93f23-dca4-4b4a-8412-cc906209adb1\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:14:52 crc kubenswrapper[5120]: I0316 17:14:52.219644 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/57c93f23-dca4-4b4a-8412-cc906209adb1-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"57c93f23-dca4-4b4a-8412-cc906209adb1\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:14:52 crc kubenswrapper[5120]: I0316 17:14:52.323850 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/57c93f23-dca4-4b4a-8412-cc906209adb1-logs\") pod \"nova-metadata-0\" (UID: \"57c93f23-dca4-4b4a-8412-cc906209adb1\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:14:52 crc kubenswrapper[5120]: I0316 17:14:52.324112 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/57c93f23-dca4-4b4a-8412-cc906209adb1-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"57c93f23-dca4-4b4a-8412-cc906209adb1\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:14:52 crc kubenswrapper[5120]: I0316 17:14:52.324213 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b99r2\" (UniqueName: \"kubernetes.io/projected/57c93f23-dca4-4b4a-8412-cc906209adb1-kube-api-access-b99r2\") pod \"nova-metadata-0\" (UID: \"57c93f23-dca4-4b4a-8412-cc906209adb1\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:14:52 crc kubenswrapper[5120]: I0316 17:14:52.324253 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/57c93f23-dca4-4b4a-8412-cc906209adb1-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"57c93f23-dca4-4b4a-8412-cc906209adb1\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:14:52 crc kubenswrapper[5120]: I0316 17:14:52.324383 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/57c93f23-dca4-4b4a-8412-cc906209adb1-config-data\") pod \"nova-metadata-0\" (UID: \"57c93f23-dca4-4b4a-8412-cc906209adb1\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:14:52 crc kubenswrapper[5120]: I0316 17:14:52.326227 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/57c93f23-dca4-4b4a-8412-cc906209adb1-logs\") pod \"nova-metadata-0\" (UID: \"57c93f23-dca4-4b4a-8412-cc906209adb1\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:14:52 crc kubenswrapper[5120]: I0316 17:14:52.330556 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/57c93f23-dca4-4b4a-8412-cc906209adb1-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"57c93f23-dca4-4b4a-8412-cc906209adb1\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:14:52 crc kubenswrapper[5120]: I0316 17:14:52.331154 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/57c93f23-dca4-4b4a-8412-cc906209adb1-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"57c93f23-dca4-4b4a-8412-cc906209adb1\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:14:52 crc kubenswrapper[5120]: I0316 17:14:52.335094 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/57c93f23-dca4-4b4a-8412-cc906209adb1-config-data\") pod \"nova-metadata-0\" (UID: \"57c93f23-dca4-4b4a-8412-cc906209adb1\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:14:52 crc kubenswrapper[5120]: I0316 17:14:52.349482 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b99r2\" (UniqueName: \"kubernetes.io/projected/57c93f23-dca4-4b4a-8412-cc906209adb1-kube-api-access-b99r2\") pod \"nova-metadata-0\" (UID: \"57c93f23-dca4-4b4a-8412-cc906209adb1\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:14:52 crc kubenswrapper[5120]: I0316 17:14:52.425552 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:14:52 crc kubenswrapper[5120]: I0316 17:14:52.702397 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="134f4125-32e6-4735-8415-6abe03a532ca" path="/var/lib/kubelet/pods/134f4125-32e6-4735-8415-6abe03a532ca/volumes" Mar 16 17:14:52 crc kubenswrapper[5120]: I0316 17:14:52.713030 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e4489a73-64a4-4585-a873-aa42a0f6eb5f" path="/var/lib/kubelet/pods/e4489a73-64a4-4585-a873-aa42a0f6eb5f/volumes" Mar 16 17:14:52 crc kubenswrapper[5120]: I0316 17:14:52.724311 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 17:14:52 crc kubenswrapper[5120]: I0316 17:14:52.765559 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"f022b20c-74d0-4409-9852-318b67aeeae2","Type":"ContainerDied","Data":"ff862298178fe1af7d5a454bb643e1712035f8841baaf2c852db0ba04bb1c9c4"} Mar 16 17:14:52 crc kubenswrapper[5120]: I0316 17:14:52.765664 5120 scope.go:117] "RemoveContainer" containerID="a77afd9f201fec7f881611d039ada22572126bc8bb32cd868301c3b70b41000f" Mar 16 17:14:52 crc kubenswrapper[5120]: I0316 17:14:52.765799 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:14:52 crc kubenswrapper[5120]: I0316 17:14:52.807008 5120 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Mar 16 17:14:52 crc kubenswrapper[5120]: I0316 17:14:52.807042 5120 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Mar 16 17:14:52 crc kubenswrapper[5120]: I0316 17:14:52.851865 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 17:14:52 crc kubenswrapper[5120]: I0316 17:14:52.866826 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 17:14:52 crc kubenswrapper[5120]: I0316 17:14:52.872049 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 17:14:52 crc kubenswrapper[5120]: I0316 17:14:52.887512 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 17:14:52 crc kubenswrapper[5120]: I0316 17:14:52.887856 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:14:52 crc kubenswrapper[5120]: I0316 17:14:52.895675 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-novncproxy-config-data\"" Mar 16 17:14:52 crc kubenswrapper[5120]: I0316 17:14:52.895898 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-novncproxy-cell1-public-svc\"" Mar 16 17:14:52 crc kubenswrapper[5120]: I0316 17:14:52.896022 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-novncproxy-cell1-vencrypt\"" Mar 16 17:14:52 crc kubenswrapper[5120]: I0316 17:14:52.931876 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-marketplace/redhat-marketplace-4hff7" Mar 16 17:14:52 crc kubenswrapper[5120]: I0316 17:14:52.932246 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-marketplace-4hff7" Mar 16 17:14:52 crc kubenswrapper[5120]: I0316 17:14:52.949014 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cb3173e3-1b17-4c3d-8e21-4630211b46ef-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"cb3173e3-1b17-4c3d-8e21-4630211b46ef\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:14:52 crc kubenswrapper[5120]: I0316 17:14:52.965069 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/cb3173e3-1b17-4c3d-8e21-4630211b46ef-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"cb3173e3-1b17-4c3d-8e21-4630211b46ef\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:14:52 crc kubenswrapper[5120]: I0316 17:14:52.965159 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cb3173e3-1b17-4c3d-8e21-4630211b46ef-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"cb3173e3-1b17-4c3d-8e21-4630211b46ef\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:14:52 crc kubenswrapper[5120]: I0316 17:14:52.965216 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/cb3173e3-1b17-4c3d-8e21-4630211b46ef-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"cb3173e3-1b17-4c3d-8e21-4630211b46ef\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:14:52 crc kubenswrapper[5120]: I0316 17:14:52.965712 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wm8gg\" (UniqueName: \"kubernetes.io/projected/cb3173e3-1b17-4c3d-8e21-4630211b46ef-kube-api-access-wm8gg\") pod \"nova-cell1-novncproxy-0\" (UID: \"cb3173e3-1b17-4c3d-8e21-4630211b46ef\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:14:52 crc kubenswrapper[5120]: I0316 17:14:52.973475 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 17:14:53 crc kubenswrapper[5120]: I0316 17:14:53.030417 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:14:53 crc kubenswrapper[5120]: I0316 17:14:53.030557 5120 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Mar 16 17:14:53 crc kubenswrapper[5120]: I0316 17:14:53.046213 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:14:53 crc kubenswrapper[5120]: I0316 17:14:53.048815 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-marketplace-4hff7" Mar 16 17:14:53 crc kubenswrapper[5120]: I0316 17:14:53.068447 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cb3173e3-1b17-4c3d-8e21-4630211b46ef-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"cb3173e3-1b17-4c3d-8e21-4630211b46ef\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:14:53 crc kubenswrapper[5120]: I0316 17:14:53.068740 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/cb3173e3-1b17-4c3d-8e21-4630211b46ef-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"cb3173e3-1b17-4c3d-8e21-4630211b46ef\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:14:53 crc kubenswrapper[5120]: I0316 17:14:53.068819 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cb3173e3-1b17-4c3d-8e21-4630211b46ef-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"cb3173e3-1b17-4c3d-8e21-4630211b46ef\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:14:53 crc kubenswrapper[5120]: I0316 17:14:53.068857 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/cb3173e3-1b17-4c3d-8e21-4630211b46ef-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"cb3173e3-1b17-4c3d-8e21-4630211b46ef\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:14:53 crc kubenswrapper[5120]: I0316 17:14:53.069093 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wm8gg\" (UniqueName: \"kubernetes.io/projected/cb3173e3-1b17-4c3d-8e21-4630211b46ef-kube-api-access-wm8gg\") pod \"nova-cell1-novncproxy-0\" (UID: \"cb3173e3-1b17-4c3d-8e21-4630211b46ef\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:14:53 crc kubenswrapper[5120]: I0316 17:14:53.078719 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/cb3173e3-1b17-4c3d-8e21-4630211b46ef-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"cb3173e3-1b17-4c3d-8e21-4630211b46ef\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:14:53 crc kubenswrapper[5120]: I0316 17:14:53.080432 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cb3173e3-1b17-4c3d-8e21-4630211b46ef-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"cb3173e3-1b17-4c3d-8e21-4630211b46ef\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:14:53 crc kubenswrapper[5120]: I0316 17:14:53.081852 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/cb3173e3-1b17-4c3d-8e21-4630211b46ef-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"cb3173e3-1b17-4c3d-8e21-4630211b46ef\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:14:53 crc kubenswrapper[5120]: I0316 17:14:53.084618 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cb3173e3-1b17-4c3d-8e21-4630211b46ef-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"cb3173e3-1b17-4c3d-8e21-4630211b46ef\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:14:53 crc kubenswrapper[5120]: I0316 17:14:53.108650 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wm8gg\" (UniqueName: \"kubernetes.io/projected/cb3173e3-1b17-4c3d-8e21-4630211b46ef-kube-api-access-wm8gg\") pod \"nova-cell1-novncproxy-0\" (UID: \"cb3173e3-1b17-4c3d-8e21-4630211b46ef\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:14:53 crc kubenswrapper[5120]: I0316 17:14:53.229316 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:14:53 crc kubenswrapper[5120]: I0316 17:14:53.305527 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:14:53 crc kubenswrapper[5120]: I0316 17:14:53.732214 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 17:14:53 crc kubenswrapper[5120]: W0316 17:14:53.733057 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcb3173e3_1b17_4c3d_8e21_4630211b46ef.slice/crio-b64630373a36be012055bda1e3ca40fa873059b2970edf073995c357b641076b WatchSource:0}: Error finding container b64630373a36be012055bda1e3ca40fa873059b2970edf073995c357b641076b: Status 404 returned error can't find the container with id b64630373a36be012055bda1e3ca40fa873059b2970edf073995c357b641076b Mar 16 17:14:53 crc kubenswrapper[5120]: I0316 17:14:53.833979 5120 generic.go:358] "Generic (PLEG): container finished" podID="c0fcea62-ce96-4685-b87d-14c1c88f6018" containerID="09697be63c3ff809ef058e7c47fb33335e0f92dbd8a8ca4429e77b3110c5e460" exitCode=0 Mar 16 17:14:53 crc kubenswrapper[5120]: I0316 17:14:53.834552 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"c0fcea62-ce96-4685-b87d-14c1c88f6018","Type":"ContainerDied","Data":"09697be63c3ff809ef058e7c47fb33335e0f92dbd8a8ca4429e77b3110c5e460"} Mar 16 17:14:53 crc kubenswrapper[5120]: I0316 17:14:53.843375 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"cb3173e3-1b17-4c3d-8e21-4630211b46ef","Type":"ContainerStarted","Data":"b64630373a36be012055bda1e3ca40fa873059b2970edf073995c357b641076b"} Mar 16 17:14:53 crc kubenswrapper[5120]: I0316 17:14:53.853015 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"57c93f23-dca4-4b4a-8412-cc906209adb1","Type":"ContainerStarted","Data":"68f6b9614a1178fe51a0a639372c28f4268575571e05bbb95f950f5f93965be9"} Mar 16 17:14:53 crc kubenswrapper[5120]: I0316 17:14:53.853053 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"57c93f23-dca4-4b4a-8412-cc906209adb1","Type":"ContainerStarted","Data":"74c588d53f7977da271f46a4eb5f34b231625e8a52c1e5f5ee4767d4bfbf96a1"} Mar 16 17:14:53 crc kubenswrapper[5120]: I0316 17:14:53.853062 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"57c93f23-dca4-4b4a-8412-cc906209adb1","Type":"ContainerStarted","Data":"cb01bafea458ae169cef76e7b2bf16b2bc7a2aa3e6a42b06be40938032b1aef1"} Mar 16 17:14:53 crc kubenswrapper[5120]: I0316 17:14:53.858635 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"b787b31b-bfd4-4268-a8fe-9887e4822a9b","Type":"ContainerStarted","Data":"b50a4886d3be5dc70b195557d66f6828da34608e971ae4dd1b68bf82f0eacfc7"} Mar 16 17:14:53 crc kubenswrapper[5120]: I0316 17:14:53.858677 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"b787b31b-bfd4-4268-a8fe-9887e4822a9b","Type":"ContainerStarted","Data":"a0c252932a4d2c93df7720df2366edc5aaa8e0a0a20f09f5d300fb7f6f137a1a"} Mar 16 17:14:53 crc kubenswrapper[5120]: I0316 17:14:53.858691 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"b787b31b-bfd4-4268-a8fe-9887e4822a9b","Type":"ContainerStarted","Data":"ff91680289da249e54dd9a48c3cb9ae348b712eb3b4957bc894940025529f055"} Mar 16 17:14:53 crc kubenswrapper[5120]: I0316 17:14:53.859600 5120 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Mar 16 17:14:53 crc kubenswrapper[5120]: I0316 17:14:53.886498 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=1.8864743229999998 podStartE2EDuration="1.886474323s" podCreationTimestamp="2026-03-16 17:14:52 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:14:53.877063866 +0000 UTC m=+6196.030995523" watchObservedRunningTime="2026-03-16 17:14:53.886474323 +0000 UTC m=+6196.040405980" Mar 16 17:14:53 crc kubenswrapper[5120]: I0316 17:14:53.900300 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=2.90027639 podStartE2EDuration="2.90027639s" podCreationTimestamp="2026-03-16 17:14:51 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:14:53.897311709 +0000 UTC m=+6196.051243386" watchObservedRunningTime="2026-03-16 17:14:53.90027639 +0000 UTC m=+6196.054208047" Mar 16 17:14:53 crc kubenswrapper[5120]: I0316 17:14:53.936316 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-marketplace-4hff7" Mar 16 17:14:54 crc kubenswrapper[5120]: I0316 17:14:54.028974 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:14:54 crc kubenswrapper[5120]: I0316 17:14:54.035964 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-marketplace-4hff7"] Mar 16 17:14:54 crc kubenswrapper[5120]: I0316 17:14:54.283275 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 17:14:54 crc kubenswrapper[5120]: I0316 17:14:54.353931 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c0fcea62-ce96-4685-b87d-14c1c88f6018-config-data\") pod \"c0fcea62-ce96-4685-b87d-14c1c88f6018\" (UID: \"c0fcea62-ce96-4685-b87d-14c1c88f6018\") " Mar 16 17:14:54 crc kubenswrapper[5120]: I0316 17:14:54.354520 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qh2rb\" (UniqueName: \"kubernetes.io/projected/c0fcea62-ce96-4685-b87d-14c1c88f6018-kube-api-access-qh2rb\") pod \"c0fcea62-ce96-4685-b87d-14c1c88f6018\" (UID: \"c0fcea62-ce96-4685-b87d-14c1c88f6018\") " Mar 16 17:14:54 crc kubenswrapper[5120]: I0316 17:14:54.354725 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c0fcea62-ce96-4685-b87d-14c1c88f6018-combined-ca-bundle\") pod \"c0fcea62-ce96-4685-b87d-14c1c88f6018\" (UID: \"c0fcea62-ce96-4685-b87d-14c1c88f6018\") " Mar 16 17:14:54 crc kubenswrapper[5120]: I0316 17:14:54.364079 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0fcea62-ce96-4685-b87d-14c1c88f6018-kube-api-access-qh2rb" (OuterVolumeSpecName: "kube-api-access-qh2rb") pod "c0fcea62-ce96-4685-b87d-14c1c88f6018" (UID: "c0fcea62-ce96-4685-b87d-14c1c88f6018"). InnerVolumeSpecName "kube-api-access-qh2rb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:14:54 crc kubenswrapper[5120]: I0316 17:14:54.385045 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c0fcea62-ce96-4685-b87d-14c1c88f6018-config-data" (OuterVolumeSpecName: "config-data") pod "c0fcea62-ce96-4685-b87d-14c1c88f6018" (UID: "c0fcea62-ce96-4685-b87d-14c1c88f6018"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:14:54 crc kubenswrapper[5120]: I0316 17:14:54.394908 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c0fcea62-ce96-4685-b87d-14c1c88f6018-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "c0fcea62-ce96-4685-b87d-14c1c88f6018" (UID: "c0fcea62-ce96-4685-b87d-14c1c88f6018"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:14:54 crc kubenswrapper[5120]: I0316 17:14:54.458984 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c0fcea62-ce96-4685-b87d-14c1c88f6018-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:14:54 crc kubenswrapper[5120]: I0316 17:14:54.459022 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qh2rb\" (UniqueName: \"kubernetes.io/projected/c0fcea62-ce96-4685-b87d-14c1c88f6018-kube-api-access-qh2rb\") on node \"crc\" DevicePath \"\"" Mar 16 17:14:54 crc kubenswrapper[5120]: I0316 17:14:54.459035 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c0fcea62-ce96-4685-b87d-14c1c88f6018-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:14:54 crc kubenswrapper[5120]: I0316 17:14:54.681702 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f022b20c-74d0-4409-9852-318b67aeeae2" path="/var/lib/kubelet/pods/f022b20c-74d0-4409-9852-318b67aeeae2/volumes" Mar 16 17:14:54 crc kubenswrapper[5120]: I0316 17:14:54.691382 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:14:54 crc kubenswrapper[5120]: I0316 17:14:54.871526 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"c0fcea62-ce96-4685-b87d-14c1c88f6018","Type":"ContainerDied","Data":"ea20dacfe43ea105585cbd1c984ad545308ec8cdeb9adff9254dd2d179cba76d"} Mar 16 17:14:54 crc kubenswrapper[5120]: I0316 17:14:54.871586 5120 scope.go:117] "RemoveContainer" containerID="09697be63c3ff809ef058e7c47fb33335e0f92dbd8a8ca4429e77b3110c5e460" Mar 16 17:14:54 crc kubenswrapper[5120]: I0316 17:14:54.871726 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 17:14:54 crc kubenswrapper[5120]: I0316 17:14:54.875220 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"cb3173e3-1b17-4c3d-8e21-4630211b46ef","Type":"ContainerStarted","Data":"b7ab168e4ea48b09e0f18db61cc58ec37ef63c1289f8c33b63d1b101400816cf"} Mar 16 17:14:54 crc kubenswrapper[5120]: I0316 17:14:54.875487 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="374d764f-88f9-46d8-96f8-c905404c071d" containerName="ceilometer-central-agent" containerID="cri-o://e9d2558fe759da1191e8f42584de1e58e647f5ca0b84813e7a5b48d57a0e22ea" gracePeriod=30 Mar 16 17:14:54 crc kubenswrapper[5120]: I0316 17:14:54.875602 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="374d764f-88f9-46d8-96f8-c905404c071d" containerName="proxy-httpd" containerID="cri-o://3e8727a737dce589dc33ea4512264860e071807d9a0b5d49ffb54328ba5172d4" gracePeriod=30 Mar 16 17:14:54 crc kubenswrapper[5120]: I0316 17:14:54.875663 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="374d764f-88f9-46d8-96f8-c905404c071d" containerName="sg-core" containerID="cri-o://8ed72a094e22dea94a8c30757e60373f243c6f8ac66e7e009ba0bd9251639c7c" gracePeriod=30 Mar 16 17:14:54 crc kubenswrapper[5120]: I0316 17:14:54.875708 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="374d764f-88f9-46d8-96f8-c905404c071d" containerName="ceilometer-notification-agent" containerID="cri-o://be42cb006fb2f331a8e83910a29e2ab5d8f6c83161668efd74291c643180e62f" gracePeriod=30 Mar 16 17:14:54 crc kubenswrapper[5120]: I0316 17:14:54.908701 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podStartSLOduration=2.908663479 podStartE2EDuration="2.908663479s" podCreationTimestamp="2026-03-16 17:14:52 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:14:54.899025916 +0000 UTC m=+6197.052957573" watchObservedRunningTime="2026-03-16 17:14:54.908663479 +0000 UTC m=+6197.062595136" Mar 16 17:14:54 crc kubenswrapper[5120]: I0316 17:14:54.927528 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 17:14:54 crc kubenswrapper[5120]: I0316 17:14:54.935965 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 17:14:54 crc kubenswrapper[5120]: I0316 17:14:54.945538 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 17:14:54 crc kubenswrapper[5120]: I0316 17:14:54.947300 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0fcea62-ce96-4685-b87d-14c1c88f6018" containerName="nova-cell0-conductor-conductor" Mar 16 17:14:54 crc kubenswrapper[5120]: I0316 17:14:54.947326 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0fcea62-ce96-4685-b87d-14c1c88f6018" containerName="nova-cell0-conductor-conductor" Mar 16 17:14:54 crc kubenswrapper[5120]: I0316 17:14:54.947573 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c0fcea62-ce96-4685-b87d-14c1c88f6018" containerName="nova-cell0-conductor-conductor" Mar 16 17:14:54 crc kubenswrapper[5120]: I0316 17:14:54.964077 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 17:14:54 crc kubenswrapper[5120]: I0316 17:14:54.964219 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 17:14:54 crc kubenswrapper[5120]: I0316 17:14:54.975208 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-conductor-config-data\"" Mar 16 17:14:55 crc kubenswrapper[5120]: I0316 17:14:55.086156 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bb48cc0c-a6cd-4fc7-9599-1ed43e3eb216-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"bb48cc0c-a6cd-4fc7-9599-1ed43e3eb216\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 17:14:55 crc kubenswrapper[5120]: I0316 17:14:55.086281 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nm64w\" (UniqueName: \"kubernetes.io/projected/bb48cc0c-a6cd-4fc7-9599-1ed43e3eb216-kube-api-access-nm64w\") pod \"nova-cell0-conductor-0\" (UID: \"bb48cc0c-a6cd-4fc7-9599-1ed43e3eb216\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 17:14:55 crc kubenswrapper[5120]: I0316 17:14:55.086423 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bb48cc0c-a6cd-4fc7-9599-1ed43e3eb216-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"bb48cc0c-a6cd-4fc7-9599-1ed43e3eb216\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 17:14:55 crc kubenswrapper[5120]: I0316 17:14:55.188829 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bb48cc0c-a6cd-4fc7-9599-1ed43e3eb216-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"bb48cc0c-a6cd-4fc7-9599-1ed43e3eb216\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 17:14:55 crc kubenswrapper[5120]: I0316 17:14:55.189186 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nm64w\" (UniqueName: \"kubernetes.io/projected/bb48cc0c-a6cd-4fc7-9599-1ed43e3eb216-kube-api-access-nm64w\") pod \"nova-cell0-conductor-0\" (UID: \"bb48cc0c-a6cd-4fc7-9599-1ed43e3eb216\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 17:14:55 crc kubenswrapper[5120]: I0316 17:14:55.189640 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bb48cc0c-a6cd-4fc7-9599-1ed43e3eb216-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"bb48cc0c-a6cd-4fc7-9599-1ed43e3eb216\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 17:14:55 crc kubenswrapper[5120]: I0316 17:14:55.195285 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bb48cc0c-a6cd-4fc7-9599-1ed43e3eb216-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"bb48cc0c-a6cd-4fc7-9599-1ed43e3eb216\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 17:14:55 crc kubenswrapper[5120]: I0316 17:14:55.202589 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bb48cc0c-a6cd-4fc7-9599-1ed43e3eb216-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"bb48cc0c-a6cd-4fc7-9599-1ed43e3eb216\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 17:14:55 crc kubenswrapper[5120]: I0316 17:14:55.217363 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nm64w\" (UniqueName: \"kubernetes.io/projected/bb48cc0c-a6cd-4fc7-9599-1ed43e3eb216-kube-api-access-nm64w\") pod \"nova-cell0-conductor-0\" (UID: \"bb48cc0c-a6cd-4fc7-9599-1ed43e3eb216\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 17:14:55 crc kubenswrapper[5120]: I0316 17:14:55.398481 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 17:14:55 crc kubenswrapper[5120]: I0316 17:14:55.853056 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 17:14:55 crc kubenswrapper[5120]: W0316 17:14:55.863120 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbb48cc0c_a6cd_4fc7_9599_1ed43e3eb216.slice/crio-523f6335422bb22600fbd2598000fc22900c656024da4c6c2c229a0d1d8d61df WatchSource:0}: Error finding container 523f6335422bb22600fbd2598000fc22900c656024da4c6c2c229a0d1d8d61df: Status 404 returned error can't find the container with id 523f6335422bb22600fbd2598000fc22900c656024da4c6c2c229a0d1d8d61df Mar 16 17:14:55 crc kubenswrapper[5120]: I0316 17:14:55.896503 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"bb48cc0c-a6cd-4fc7-9599-1ed43e3eb216","Type":"ContainerStarted","Data":"523f6335422bb22600fbd2598000fc22900c656024da4c6c2c229a0d1d8d61df"} Mar 16 17:14:55 crc kubenswrapper[5120]: I0316 17:14:55.902880 5120 generic.go:358] "Generic (PLEG): container finished" podID="374d764f-88f9-46d8-96f8-c905404c071d" containerID="3e8727a737dce589dc33ea4512264860e071807d9a0b5d49ffb54328ba5172d4" exitCode=0 Mar 16 17:14:55 crc kubenswrapper[5120]: I0316 17:14:55.902921 5120 generic.go:358] "Generic (PLEG): container finished" podID="374d764f-88f9-46d8-96f8-c905404c071d" containerID="8ed72a094e22dea94a8c30757e60373f243c6f8ac66e7e009ba0bd9251639c7c" exitCode=2 Mar 16 17:14:55 crc kubenswrapper[5120]: I0316 17:14:55.902931 5120 generic.go:358] "Generic (PLEG): container finished" podID="374d764f-88f9-46d8-96f8-c905404c071d" containerID="be42cb006fb2f331a8e83910a29e2ab5d8f6c83161668efd74291c643180e62f" exitCode=0 Mar 16 17:14:55 crc kubenswrapper[5120]: I0316 17:14:55.903071 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"374d764f-88f9-46d8-96f8-c905404c071d","Type":"ContainerDied","Data":"3e8727a737dce589dc33ea4512264860e071807d9a0b5d49ffb54328ba5172d4"} Mar 16 17:14:55 crc kubenswrapper[5120]: I0316 17:14:55.903103 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"374d764f-88f9-46d8-96f8-c905404c071d","Type":"ContainerDied","Data":"8ed72a094e22dea94a8c30757e60373f243c6f8ac66e7e009ba0bd9251639c7c"} Mar 16 17:14:55 crc kubenswrapper[5120]: I0316 17:14:55.903117 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"374d764f-88f9-46d8-96f8-c905404c071d","Type":"ContainerDied","Data":"be42cb006fb2f331a8e83910a29e2ab5d8f6c83161668efd74291c643180e62f"} Mar 16 17:14:55 crc kubenswrapper[5120]: I0316 17:14:55.906476 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-marketplace/redhat-marketplace-4hff7" podUID="cc6c9a09-f17f-4ebc-a57d-d440091fcad8" containerName="registry-server" containerID="cri-o://bc54d7297fec7d5ba25a593cc8c260f3d404052b9f9f185c7ab132a21204ed12" gracePeriod=2 Mar 16 17:14:56 crc kubenswrapper[5120]: I0316 17:14:56.344027 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-4hff7" Mar 16 17:14:56 crc kubenswrapper[5120]: I0316 17:14:56.423647 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/cc6c9a09-f17f-4ebc-a57d-d440091fcad8-utilities\") pod \"cc6c9a09-f17f-4ebc-a57d-d440091fcad8\" (UID: \"cc6c9a09-f17f-4ebc-a57d-d440091fcad8\") " Mar 16 17:14:56 crc kubenswrapper[5120]: I0316 17:14:56.424264 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/cc6c9a09-f17f-4ebc-a57d-d440091fcad8-catalog-content\") pod \"cc6c9a09-f17f-4ebc-a57d-d440091fcad8\" (UID: \"cc6c9a09-f17f-4ebc-a57d-d440091fcad8\") " Mar 16 17:14:56 crc kubenswrapper[5120]: I0316 17:14:56.424616 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-smlk5\" (UniqueName: \"kubernetes.io/projected/cc6c9a09-f17f-4ebc-a57d-d440091fcad8-kube-api-access-smlk5\") pod \"cc6c9a09-f17f-4ebc-a57d-d440091fcad8\" (UID: \"cc6c9a09-f17f-4ebc-a57d-d440091fcad8\") " Mar 16 17:14:56 crc kubenswrapper[5120]: I0316 17:14:56.424804 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc6c9a09-f17f-4ebc-a57d-d440091fcad8-utilities" (OuterVolumeSpecName: "utilities") pod "cc6c9a09-f17f-4ebc-a57d-d440091fcad8" (UID: "cc6c9a09-f17f-4ebc-a57d-d440091fcad8"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:14:56 crc kubenswrapper[5120]: I0316 17:14:56.425414 5120 reconciler_common.go:299] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/cc6c9a09-f17f-4ebc-a57d-d440091fcad8-utilities\") on node \"crc\" DevicePath \"\"" Mar 16 17:14:56 crc kubenswrapper[5120]: I0316 17:14:56.432923 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc6c9a09-f17f-4ebc-a57d-d440091fcad8-kube-api-access-smlk5" (OuterVolumeSpecName: "kube-api-access-smlk5") pod "cc6c9a09-f17f-4ebc-a57d-d440091fcad8" (UID: "cc6c9a09-f17f-4ebc-a57d-d440091fcad8"). InnerVolumeSpecName "kube-api-access-smlk5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:14:56 crc kubenswrapper[5120]: I0316 17:14:56.456083 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc6c9a09-f17f-4ebc-a57d-d440091fcad8-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "cc6c9a09-f17f-4ebc-a57d-d440091fcad8" (UID: "cc6c9a09-f17f-4ebc-a57d-d440091fcad8"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:14:56 crc kubenswrapper[5120]: I0316 17:14:56.528704 5120 reconciler_common.go:299] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/cc6c9a09-f17f-4ebc-a57d-d440091fcad8-catalog-content\") on node \"crc\" DevicePath \"\"" Mar 16 17:14:56 crc kubenswrapper[5120]: I0316 17:14:56.528750 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-smlk5\" (UniqueName: \"kubernetes.io/projected/cc6c9a09-f17f-4ebc-a57d-d440091fcad8-kube-api-access-smlk5\") on node \"crc\" DevicePath \"\"" Mar 16 17:14:56 crc kubenswrapper[5120]: I0316 17:14:56.686536 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c0fcea62-ce96-4685-b87d-14c1c88f6018" path="/var/lib/kubelet/pods/c0fcea62-ce96-4685-b87d-14c1c88f6018/volumes" Mar 16 17:14:56 crc kubenswrapper[5120]: I0316 17:14:56.916652 5120 generic.go:358] "Generic (PLEG): container finished" podID="cc6c9a09-f17f-4ebc-a57d-d440091fcad8" containerID="bc54d7297fec7d5ba25a593cc8c260f3d404052b9f9f185c7ab132a21204ed12" exitCode=0 Mar 16 17:14:56 crc kubenswrapper[5120]: I0316 17:14:56.916729 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-4hff7" Mar 16 17:14:56 crc kubenswrapper[5120]: I0316 17:14:56.916733 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-4hff7" event={"ID":"cc6c9a09-f17f-4ebc-a57d-d440091fcad8","Type":"ContainerDied","Data":"bc54d7297fec7d5ba25a593cc8c260f3d404052b9f9f185c7ab132a21204ed12"} Mar 16 17:14:56 crc kubenswrapper[5120]: I0316 17:14:56.918419 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-4hff7" event={"ID":"cc6c9a09-f17f-4ebc-a57d-d440091fcad8","Type":"ContainerDied","Data":"0de132a8749f443ea62766917d6a8ef66142918c4c1862ff522b50d13e12db93"} Mar 16 17:14:56 crc kubenswrapper[5120]: I0316 17:14:56.918444 5120 scope.go:117] "RemoveContainer" containerID="bc54d7297fec7d5ba25a593cc8c260f3d404052b9f9f185c7ab132a21204ed12" Mar 16 17:14:56 crc kubenswrapper[5120]: I0316 17:14:56.924191 5120 generic.go:358] "Generic (PLEG): container finished" podID="c26dcfcc-eff1-4daf-ad94-a46b19f3ef19" containerID="d2d1984e8f336bf15aaabdb3ab94e9958586677a69ccab41ee3bc77397c1d236" exitCode=0 Mar 16 17:14:56 crc kubenswrapper[5120]: I0316 17:14:56.924828 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-4mxdb" event={"ID":"c26dcfcc-eff1-4daf-ad94-a46b19f3ef19","Type":"ContainerDied","Data":"d2d1984e8f336bf15aaabdb3ab94e9958586677a69ccab41ee3bc77397c1d236"} Mar 16 17:14:56 crc kubenswrapper[5120]: I0316 17:14:56.928279 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"bb48cc0c-a6cd-4fc7-9599-1ed43e3eb216","Type":"ContainerStarted","Data":"908c72eb1629fa11a71f6778174b3a20818464a6614bf7943723c08961af3886"} Mar 16 17:14:56 crc kubenswrapper[5120]: I0316 17:14:56.928409 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 17:14:56 crc kubenswrapper[5120]: I0316 17:14:56.954814 5120 scope.go:117] "RemoveContainer" containerID="1ae1e725168f2398254c253eceda369dd008827b3d10501f0988dc115141d4f8" Mar 16 17:14:56 crc kubenswrapper[5120]: I0316 17:14:56.972380 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-marketplace-4hff7"] Mar 16 17:14:56 crc kubenswrapper[5120]: I0316 17:14:56.982609 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/redhat-marketplace-4hff7"] Mar 16 17:14:56 crc kubenswrapper[5120]: I0316 17:14:56.983178 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podStartSLOduration=2.983161526 podStartE2EDuration="2.983161526s" podCreationTimestamp="2026-03-16 17:14:54 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:14:56.96248109 +0000 UTC m=+6199.116412757" watchObservedRunningTime="2026-03-16 17:14:56.983161526 +0000 UTC m=+6199.137093183" Mar 16 17:14:56 crc kubenswrapper[5120]: I0316 17:14:56.999565 5120 scope.go:117] "RemoveContainer" containerID="b1d959d190d2cd211dc9f459028e441190a07290beddffc44a1ab8330d0bbc03" Mar 16 17:14:57 crc kubenswrapper[5120]: I0316 17:14:57.035028 5120 scope.go:117] "RemoveContainer" containerID="bc54d7297fec7d5ba25a593cc8c260f3d404052b9f9f185c7ab132a21204ed12" Mar 16 17:14:57 crc kubenswrapper[5120]: E0316 17:14:57.035616 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc54d7297fec7d5ba25a593cc8c260f3d404052b9f9f185c7ab132a21204ed12\": container with ID starting with bc54d7297fec7d5ba25a593cc8c260f3d404052b9f9f185c7ab132a21204ed12 not found: ID does not exist" containerID="bc54d7297fec7d5ba25a593cc8c260f3d404052b9f9f185c7ab132a21204ed12" Mar 16 17:14:57 crc kubenswrapper[5120]: I0316 17:14:57.035652 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc54d7297fec7d5ba25a593cc8c260f3d404052b9f9f185c7ab132a21204ed12"} err="failed to get container status \"bc54d7297fec7d5ba25a593cc8c260f3d404052b9f9f185c7ab132a21204ed12\": rpc error: code = NotFound desc = could not find container \"bc54d7297fec7d5ba25a593cc8c260f3d404052b9f9f185c7ab132a21204ed12\": container with ID starting with bc54d7297fec7d5ba25a593cc8c260f3d404052b9f9f185c7ab132a21204ed12 not found: ID does not exist" Mar 16 17:14:57 crc kubenswrapper[5120]: I0316 17:14:57.035703 5120 scope.go:117] "RemoveContainer" containerID="1ae1e725168f2398254c253eceda369dd008827b3d10501f0988dc115141d4f8" Mar 16 17:14:57 crc kubenswrapper[5120]: E0316 17:14:57.035922 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ae1e725168f2398254c253eceda369dd008827b3d10501f0988dc115141d4f8\": container with ID starting with 1ae1e725168f2398254c253eceda369dd008827b3d10501f0988dc115141d4f8 not found: ID does not exist" containerID="1ae1e725168f2398254c253eceda369dd008827b3d10501f0988dc115141d4f8" Mar 16 17:14:57 crc kubenswrapper[5120]: I0316 17:14:57.035937 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ae1e725168f2398254c253eceda369dd008827b3d10501f0988dc115141d4f8"} err="failed to get container status \"1ae1e725168f2398254c253eceda369dd008827b3d10501f0988dc115141d4f8\": rpc error: code = NotFound desc = could not find container \"1ae1e725168f2398254c253eceda369dd008827b3d10501f0988dc115141d4f8\": container with ID starting with 1ae1e725168f2398254c253eceda369dd008827b3d10501f0988dc115141d4f8 not found: ID does not exist" Mar 16 17:14:57 crc kubenswrapper[5120]: I0316 17:14:57.035951 5120 scope.go:117] "RemoveContainer" containerID="b1d959d190d2cd211dc9f459028e441190a07290beddffc44a1ab8330d0bbc03" Mar 16 17:14:57 crc kubenswrapper[5120]: E0316 17:14:57.036118 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b1d959d190d2cd211dc9f459028e441190a07290beddffc44a1ab8330d0bbc03\": container with ID starting with b1d959d190d2cd211dc9f459028e441190a07290beddffc44a1ab8330d0bbc03 not found: ID does not exist" containerID="b1d959d190d2cd211dc9f459028e441190a07290beddffc44a1ab8330d0bbc03" Mar 16 17:14:57 crc kubenswrapper[5120]: I0316 17:14:57.036137 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1d959d190d2cd211dc9f459028e441190a07290beddffc44a1ab8330d0bbc03"} err="failed to get container status \"b1d959d190d2cd211dc9f459028e441190a07290beddffc44a1ab8330d0bbc03\": rpc error: code = NotFound desc = could not find container \"b1d959d190d2cd211dc9f459028e441190a07290beddffc44a1ab8330d0bbc03\": container with ID starting with b1d959d190d2cd211dc9f459028e441190a07290beddffc44a1ab8330d0bbc03 not found: ID does not exist" Mar 16 17:14:57 crc kubenswrapper[5120]: I0316 17:14:57.940826 5120 generic.go:358] "Generic (PLEG): container finished" podID="8588f057-79ea-4d0e-b37b-ee267ab3edb6" containerID="4d5201645c90c320c938b67420b0e5657c14656d543ebc83b0e5396f29bec71b" exitCode=0 Mar 16 17:14:57 crc kubenswrapper[5120]: I0316 17:14:57.940921 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-jsgxw" event={"ID":"8588f057-79ea-4d0e-b37b-ee267ab3edb6","Type":"ContainerDied","Data":"4d5201645c90c320c938b67420b0e5657c14656d543ebc83b0e5396f29bec71b"} Mar 16 17:14:58 crc kubenswrapper[5120]: I0316 17:14:58.230354 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:14:58 crc kubenswrapper[5120]: I0316 17:14:58.295154 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-4mxdb" Mar 16 17:14:58 crc kubenswrapper[5120]: I0316 17:14:58.409619 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c26dcfcc-eff1-4daf-ad94-a46b19f3ef19-scripts\") pod \"c26dcfcc-eff1-4daf-ad94-a46b19f3ef19\" (UID: \"c26dcfcc-eff1-4daf-ad94-a46b19f3ef19\") " Mar 16 17:14:58 crc kubenswrapper[5120]: I0316 17:14:58.410027 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6tnr7\" (UniqueName: \"kubernetes.io/projected/c26dcfcc-eff1-4daf-ad94-a46b19f3ef19-kube-api-access-6tnr7\") pod \"c26dcfcc-eff1-4daf-ad94-a46b19f3ef19\" (UID: \"c26dcfcc-eff1-4daf-ad94-a46b19f3ef19\") " Mar 16 17:14:58 crc kubenswrapper[5120]: I0316 17:14:58.410054 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c26dcfcc-eff1-4daf-ad94-a46b19f3ef19-config-data\") pod \"c26dcfcc-eff1-4daf-ad94-a46b19f3ef19\" (UID: \"c26dcfcc-eff1-4daf-ad94-a46b19f3ef19\") " Mar 16 17:14:58 crc kubenswrapper[5120]: I0316 17:14:58.410391 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c26dcfcc-eff1-4daf-ad94-a46b19f3ef19-combined-ca-bundle\") pod \"c26dcfcc-eff1-4daf-ad94-a46b19f3ef19\" (UID: \"c26dcfcc-eff1-4daf-ad94-a46b19f3ef19\") " Mar 16 17:14:58 crc kubenswrapper[5120]: I0316 17:14:58.421483 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c26dcfcc-eff1-4daf-ad94-a46b19f3ef19-scripts" (OuterVolumeSpecName: "scripts") pod "c26dcfcc-eff1-4daf-ad94-a46b19f3ef19" (UID: "c26dcfcc-eff1-4daf-ad94-a46b19f3ef19"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:14:58 crc kubenswrapper[5120]: I0316 17:14:58.425942 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c26dcfcc-eff1-4daf-ad94-a46b19f3ef19-kube-api-access-6tnr7" (OuterVolumeSpecName: "kube-api-access-6tnr7") pod "c26dcfcc-eff1-4daf-ad94-a46b19f3ef19" (UID: "c26dcfcc-eff1-4daf-ad94-a46b19f3ef19"). InnerVolumeSpecName "kube-api-access-6tnr7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:14:58 crc kubenswrapper[5120]: I0316 17:14:58.437974 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c26dcfcc-eff1-4daf-ad94-a46b19f3ef19-config-data" (OuterVolumeSpecName: "config-data") pod "c26dcfcc-eff1-4daf-ad94-a46b19f3ef19" (UID: "c26dcfcc-eff1-4daf-ad94-a46b19f3ef19"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:14:58 crc kubenswrapper[5120]: I0316 17:14:58.439926 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c26dcfcc-eff1-4daf-ad94-a46b19f3ef19-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "c26dcfcc-eff1-4daf-ad94-a46b19f3ef19" (UID: "c26dcfcc-eff1-4daf-ad94-a46b19f3ef19"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:14:58 crc kubenswrapper[5120]: I0316 17:14:58.513257 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6tnr7\" (UniqueName: \"kubernetes.io/projected/c26dcfcc-eff1-4daf-ad94-a46b19f3ef19-kube-api-access-6tnr7\") on node \"crc\" DevicePath \"\"" Mar 16 17:14:58 crc kubenswrapper[5120]: I0316 17:14:58.513296 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c26dcfcc-eff1-4daf-ad94-a46b19f3ef19-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:14:58 crc kubenswrapper[5120]: I0316 17:14:58.513307 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c26dcfcc-eff1-4daf-ad94-a46b19f3ef19-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:14:58 crc kubenswrapper[5120]: I0316 17:14:58.513316 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c26dcfcc-eff1-4daf-ad94-a46b19f3ef19-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:14:58 crc kubenswrapper[5120]: I0316 17:14:58.687125 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc6c9a09-f17f-4ebc-a57d-d440091fcad8" path="/var/lib/kubelet/pods/cc6c9a09-f17f-4ebc-a57d-d440091fcad8/volumes" Mar 16 17:14:58 crc kubenswrapper[5120]: I0316 17:14:58.957674 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-4mxdb" Mar 16 17:14:58 crc kubenswrapper[5120]: I0316 17:14:58.960659 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-4mxdb" event={"ID":"c26dcfcc-eff1-4daf-ad94-a46b19f3ef19","Type":"ContainerDied","Data":"47e169a200fc429d7cc279c93d0dc1158033400b4d5ac389228822929c0540ab"} Mar 16 17:14:58 crc kubenswrapper[5120]: I0316 17:14:58.960777 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="47e169a200fc429d7cc279c93d0dc1158033400b4d5ac389228822929c0540ab" Mar 16 17:14:59 crc kubenswrapper[5120]: I0316 17:14:59.057404 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 17:14:59 crc kubenswrapper[5120]: I0316 17:14:59.058527 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc6c9a09-f17f-4ebc-a57d-d440091fcad8" containerName="registry-server" Mar 16 17:14:59 crc kubenswrapper[5120]: I0316 17:14:59.058555 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc6c9a09-f17f-4ebc-a57d-d440091fcad8" containerName="registry-server" Mar 16 17:14:59 crc kubenswrapper[5120]: I0316 17:14:59.058597 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc6c9a09-f17f-4ebc-a57d-d440091fcad8" containerName="extract-utilities" Mar 16 17:14:59 crc kubenswrapper[5120]: I0316 17:14:59.058606 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc6c9a09-f17f-4ebc-a57d-d440091fcad8" containerName="extract-utilities" Mar 16 17:14:59 crc kubenswrapper[5120]: I0316 17:14:59.058630 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c26dcfcc-eff1-4daf-ad94-a46b19f3ef19" containerName="nova-cell1-conductor-db-sync" Mar 16 17:14:59 crc kubenswrapper[5120]: I0316 17:14:59.058639 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c26dcfcc-eff1-4daf-ad94-a46b19f3ef19" containerName="nova-cell1-conductor-db-sync" Mar 16 17:14:59 crc kubenswrapper[5120]: I0316 17:14:59.058680 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc6c9a09-f17f-4ebc-a57d-d440091fcad8" containerName="extract-content" Mar 16 17:14:59 crc kubenswrapper[5120]: I0316 17:14:59.058689 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc6c9a09-f17f-4ebc-a57d-d440091fcad8" containerName="extract-content" Mar 16 17:14:59 crc kubenswrapper[5120]: I0316 17:14:59.058943 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c26dcfcc-eff1-4daf-ad94-a46b19f3ef19" containerName="nova-cell1-conductor-db-sync" Mar 16 17:14:59 crc kubenswrapper[5120]: I0316 17:14:59.058972 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="cc6c9a09-f17f-4ebc-a57d-d440091fcad8" containerName="registry-server" Mar 16 17:14:59 crc kubenswrapper[5120]: I0316 17:14:59.064163 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 17:14:59 crc kubenswrapper[5120]: I0316 17:14:59.068254 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-conductor-config-data\"" Mar 16 17:14:59 crc kubenswrapper[5120]: I0316 17:14:59.082403 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 17:14:59 crc kubenswrapper[5120]: I0316 17:14:59.132933 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/71a73270-e23b-42a7-a1f4-ad174eab2ac7-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"71a73270-e23b-42a7-a1f4-ad174eab2ac7\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 17:14:59 crc kubenswrapper[5120]: I0316 17:14:59.133010 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jvdz\" (UniqueName: \"kubernetes.io/projected/71a73270-e23b-42a7-a1f4-ad174eab2ac7-kube-api-access-9jvdz\") pod \"nova-cell1-conductor-0\" (UID: \"71a73270-e23b-42a7-a1f4-ad174eab2ac7\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 17:14:59 crc kubenswrapper[5120]: I0316 17:14:59.133347 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/71a73270-e23b-42a7-a1f4-ad174eab2ac7-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"71a73270-e23b-42a7-a1f4-ad174eab2ac7\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 17:14:59 crc kubenswrapper[5120]: I0316 17:14:59.235705 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/71a73270-e23b-42a7-a1f4-ad174eab2ac7-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"71a73270-e23b-42a7-a1f4-ad174eab2ac7\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 17:14:59 crc kubenswrapper[5120]: I0316 17:14:59.236138 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9jvdz\" (UniqueName: \"kubernetes.io/projected/71a73270-e23b-42a7-a1f4-ad174eab2ac7-kube-api-access-9jvdz\") pod \"nova-cell1-conductor-0\" (UID: \"71a73270-e23b-42a7-a1f4-ad174eab2ac7\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 17:14:59 crc kubenswrapper[5120]: I0316 17:14:59.236871 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/71a73270-e23b-42a7-a1f4-ad174eab2ac7-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"71a73270-e23b-42a7-a1f4-ad174eab2ac7\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 17:14:59 crc kubenswrapper[5120]: I0316 17:14:59.241646 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/71a73270-e23b-42a7-a1f4-ad174eab2ac7-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"71a73270-e23b-42a7-a1f4-ad174eab2ac7\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 17:14:59 crc kubenswrapper[5120]: I0316 17:14:59.247971 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/71a73270-e23b-42a7-a1f4-ad174eab2ac7-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"71a73270-e23b-42a7-a1f4-ad174eab2ac7\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 17:14:59 crc kubenswrapper[5120]: I0316 17:14:59.252016 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jvdz\" (UniqueName: \"kubernetes.io/projected/71a73270-e23b-42a7-a1f4-ad174eab2ac7-kube-api-access-9jvdz\") pod \"nova-cell1-conductor-0\" (UID: \"71a73270-e23b-42a7-a1f4-ad174eab2ac7\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 17:14:59 crc kubenswrapper[5120]: I0316 17:14:59.341439 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-jsgxw" Mar 16 17:14:59 crc kubenswrapper[5120]: I0316 17:14:59.396788 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 17:14:59 crc kubenswrapper[5120]: I0316 17:14:59.440914 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mb69n\" (UniqueName: \"kubernetes.io/projected/8588f057-79ea-4d0e-b37b-ee267ab3edb6-kube-api-access-mb69n\") pod \"8588f057-79ea-4d0e-b37b-ee267ab3edb6\" (UID: \"8588f057-79ea-4d0e-b37b-ee267ab3edb6\") " Mar 16 17:14:59 crc kubenswrapper[5120]: I0316 17:14:59.441004 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8588f057-79ea-4d0e-b37b-ee267ab3edb6-combined-ca-bundle\") pod \"8588f057-79ea-4d0e-b37b-ee267ab3edb6\" (UID: \"8588f057-79ea-4d0e-b37b-ee267ab3edb6\") " Mar 16 17:14:59 crc kubenswrapper[5120]: I0316 17:14:59.442203 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8588f057-79ea-4d0e-b37b-ee267ab3edb6-scripts\") pod \"8588f057-79ea-4d0e-b37b-ee267ab3edb6\" (UID: \"8588f057-79ea-4d0e-b37b-ee267ab3edb6\") " Mar 16 17:14:59 crc kubenswrapper[5120]: I0316 17:14:59.442657 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8588f057-79ea-4d0e-b37b-ee267ab3edb6-config-data\") pod \"8588f057-79ea-4d0e-b37b-ee267ab3edb6\" (UID: \"8588f057-79ea-4d0e-b37b-ee267ab3edb6\") " Mar 16 17:14:59 crc kubenswrapper[5120]: I0316 17:14:59.446479 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8588f057-79ea-4d0e-b37b-ee267ab3edb6-scripts" (OuterVolumeSpecName: "scripts") pod "8588f057-79ea-4d0e-b37b-ee267ab3edb6" (UID: "8588f057-79ea-4d0e-b37b-ee267ab3edb6"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:14:59 crc kubenswrapper[5120]: I0316 17:14:59.446887 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8588f057-79ea-4d0e-b37b-ee267ab3edb6-kube-api-access-mb69n" (OuterVolumeSpecName: "kube-api-access-mb69n") pod "8588f057-79ea-4d0e-b37b-ee267ab3edb6" (UID: "8588f057-79ea-4d0e-b37b-ee267ab3edb6"). InnerVolumeSpecName "kube-api-access-mb69n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:14:59 crc kubenswrapper[5120]: I0316 17:14:59.469307 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8588f057-79ea-4d0e-b37b-ee267ab3edb6-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "8588f057-79ea-4d0e-b37b-ee267ab3edb6" (UID: "8588f057-79ea-4d0e-b37b-ee267ab3edb6"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:14:59 crc kubenswrapper[5120]: I0316 17:14:59.469904 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8588f057-79ea-4d0e-b37b-ee267ab3edb6-config-data" (OuterVolumeSpecName: "config-data") pod "8588f057-79ea-4d0e-b37b-ee267ab3edb6" (UID: "8588f057-79ea-4d0e-b37b-ee267ab3edb6"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:14:59 crc kubenswrapper[5120]: I0316 17:14:59.546176 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mb69n\" (UniqueName: \"kubernetes.io/projected/8588f057-79ea-4d0e-b37b-ee267ab3edb6-kube-api-access-mb69n\") on node \"crc\" DevicePath \"\"" Mar 16 17:14:59 crc kubenswrapper[5120]: I0316 17:14:59.546434 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8588f057-79ea-4d0e-b37b-ee267ab3edb6-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:14:59 crc kubenswrapper[5120]: I0316 17:14:59.546443 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8588f057-79ea-4d0e-b37b-ee267ab3edb6-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:14:59 crc kubenswrapper[5120]: I0316 17:14:59.546453 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8588f057-79ea-4d0e-b37b-ee267ab3edb6-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:14:59 crc kubenswrapper[5120]: I0316 17:14:59.823059 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 17:14:59 crc kubenswrapper[5120]: W0316 17:14:59.832674 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod71a73270_e23b_42a7_a1f4_ad174eab2ac7.slice/crio-adcb718ed722f1f10411bca1ae38ed10303688caa308f60d36b3c7b5a914be69 WatchSource:0}: Error finding container adcb718ed722f1f10411bca1ae38ed10303688caa308f60d36b3c7b5a914be69: Status 404 returned error can't find the container with id adcb718ed722f1f10411bca1ae38ed10303688caa308f60d36b3c7b5a914be69 Mar 16 17:14:59 crc kubenswrapper[5120]: I0316 17:14:59.969484 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"71a73270-e23b-42a7-a1f4-ad174eab2ac7","Type":"ContainerStarted","Data":"adcb718ed722f1f10411bca1ae38ed10303688caa308f60d36b3c7b5a914be69"} Mar 16 17:14:59 crc kubenswrapper[5120]: I0316 17:14:59.971700 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-jsgxw" event={"ID":"8588f057-79ea-4d0e-b37b-ee267ab3edb6","Type":"ContainerDied","Data":"c1191fe7f89f05bc89a6bf69e3c6feec40cae343bc12d8b6d1052de8e54f20ac"} Mar 16 17:14:59 crc kubenswrapper[5120]: I0316 17:14:59.971737 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c1191fe7f89f05bc89a6bf69e3c6feec40cae343bc12d8b6d1052de8e54f20ac" Mar 16 17:14:59 crc kubenswrapper[5120]: I0316 17:14:59.971836 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-jsgxw" Mar 16 17:15:00 crc kubenswrapper[5120]: I0316 17:15:00.150012 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29561355-cp2zm"] Mar 16 17:15:00 crc kubenswrapper[5120]: I0316 17:15:00.152264 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8588f057-79ea-4d0e-b37b-ee267ab3edb6" containerName="nova-manage" Mar 16 17:15:00 crc kubenswrapper[5120]: I0316 17:15:00.152298 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8588f057-79ea-4d0e-b37b-ee267ab3edb6" containerName="nova-manage" Mar 16 17:15:00 crc kubenswrapper[5120]: I0316 17:15:00.152569 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="8588f057-79ea-4d0e-b37b-ee267ab3edb6" containerName="nova-manage" Mar 16 17:15:00 crc kubenswrapper[5120]: I0316 17:15:00.161224 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29561355-cp2zm" Mar 16 17:15:00 crc kubenswrapper[5120]: I0316 17:15:00.165495 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operator-lifecycle-manager\"/\"collect-profiles-config\"" Mar 16 17:15:00 crc kubenswrapper[5120]: I0316 17:15:00.165810 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operator-lifecycle-manager\"/\"collect-profiles-dockercfg-vfqp6\"" Mar 16 17:15:00 crc kubenswrapper[5120]: I0316 17:15:00.171578 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29561355-cp2zm"] Mar 16 17:15:00 crc kubenswrapper[5120]: I0316 17:15:00.271929 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6ffa780f-a662-4e17-be7b-8cb2d4e75b29-config-volume\") pod \"collect-profiles-29561355-cp2zm\" (UID: \"6ffa780f-a662-4e17-be7b-8cb2d4e75b29\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561355-cp2zm" Mar 16 17:15:00 crc kubenswrapper[5120]: I0316 17:15:00.272171 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/6ffa780f-a662-4e17-be7b-8cb2d4e75b29-secret-volume\") pod \"collect-profiles-29561355-cp2zm\" (UID: \"6ffa780f-a662-4e17-be7b-8cb2d4e75b29\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561355-cp2zm" Mar 16 17:15:00 crc kubenswrapper[5120]: I0316 17:15:00.272207 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrjlh\" (UniqueName: \"kubernetes.io/projected/6ffa780f-a662-4e17-be7b-8cb2d4e75b29-kube-api-access-vrjlh\") pod \"collect-profiles-29561355-cp2zm\" (UID: \"6ffa780f-a662-4e17-be7b-8cb2d4e75b29\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561355-cp2zm" Mar 16 17:15:00 crc kubenswrapper[5120]: I0316 17:15:00.375109 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/6ffa780f-a662-4e17-be7b-8cb2d4e75b29-secret-volume\") pod \"collect-profiles-29561355-cp2zm\" (UID: \"6ffa780f-a662-4e17-be7b-8cb2d4e75b29\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561355-cp2zm" Mar 16 17:15:00 crc kubenswrapper[5120]: I0316 17:15:00.375201 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vrjlh\" (UniqueName: \"kubernetes.io/projected/6ffa780f-a662-4e17-be7b-8cb2d4e75b29-kube-api-access-vrjlh\") pod \"collect-profiles-29561355-cp2zm\" (UID: \"6ffa780f-a662-4e17-be7b-8cb2d4e75b29\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561355-cp2zm" Mar 16 17:15:00 crc kubenswrapper[5120]: I0316 17:15:00.375516 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6ffa780f-a662-4e17-be7b-8cb2d4e75b29-config-volume\") pod \"collect-profiles-29561355-cp2zm\" (UID: \"6ffa780f-a662-4e17-be7b-8cb2d4e75b29\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561355-cp2zm" Mar 16 17:15:00 crc kubenswrapper[5120]: I0316 17:15:00.376444 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6ffa780f-a662-4e17-be7b-8cb2d4e75b29-config-volume\") pod \"collect-profiles-29561355-cp2zm\" (UID: \"6ffa780f-a662-4e17-be7b-8cb2d4e75b29\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561355-cp2zm" Mar 16 17:15:00 crc kubenswrapper[5120]: I0316 17:15:00.381381 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/6ffa780f-a662-4e17-be7b-8cb2d4e75b29-secret-volume\") pod \"collect-profiles-29561355-cp2zm\" (UID: \"6ffa780f-a662-4e17-be7b-8cb2d4e75b29\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561355-cp2zm" Mar 16 17:15:00 crc kubenswrapper[5120]: I0316 17:15:00.395007 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrjlh\" (UniqueName: \"kubernetes.io/projected/6ffa780f-a662-4e17-be7b-8cb2d4e75b29-kube-api-access-vrjlh\") pod \"collect-profiles-29561355-cp2zm\" (UID: \"6ffa780f-a662-4e17-be7b-8cb2d4e75b29\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561355-cp2zm" Mar 16 17:15:00 crc kubenswrapper[5120]: I0316 17:15:00.532037 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29561355-cp2zm" Mar 16 17:15:00 crc kubenswrapper[5120]: I0316 17:15:00.982099 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29561355-cp2zm"] Mar 16 17:15:00 crc kubenswrapper[5120]: I0316 17:15:00.985109 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"71a73270-e23b-42a7-a1f4-ad174eab2ac7","Type":"ContainerStarted","Data":"bd045fa777b0ca425826b20941db498f3c9fc6247b98751b1ce64168b1b98e09"} Mar 16 17:15:00 crc kubenswrapper[5120]: I0316 17:15:00.985366 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 17:15:00 crc kubenswrapper[5120]: I0316 17:15:00.988803 5120 generic.go:358] "Generic (PLEG): container finished" podID="374d764f-88f9-46d8-96f8-c905404c071d" containerID="e9d2558fe759da1191e8f42584de1e58e647f5ca0b84813e7a5b48d57a0e22ea" exitCode=0 Mar 16 17:15:00 crc kubenswrapper[5120]: I0316 17:15:00.988930 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"374d764f-88f9-46d8-96f8-c905404c071d","Type":"ContainerDied","Data":"e9d2558fe759da1191e8f42584de1e58e647f5ca0b84813e7a5b48d57a0e22ea"} Mar 16 17:15:00 crc kubenswrapper[5120]: W0316 17:15:00.997488 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ffa780f_a662_4e17_be7b_8cb2d4e75b29.slice/crio-f38d960a4e4f232f1751c977153f758faf7b74b25242d7d2d818cc94da8700e4 WatchSource:0}: Error finding container f38d960a4e4f232f1751c977153f758faf7b74b25242d7d2d818cc94da8700e4: Status 404 returned error can't find the container with id f38d960a4e4f232f1751c977153f758faf7b74b25242d7d2d818cc94da8700e4 Mar 16 17:15:01 crc kubenswrapper[5120]: I0316 17:15:01.008228 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podStartSLOduration=2.008208529 podStartE2EDuration="2.008208529s" podCreationTimestamp="2026-03-16 17:14:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:15:00.998039241 +0000 UTC m=+6203.151970908" watchObservedRunningTime="2026-03-16 17:15:01.008208529 +0000 UTC m=+6203.162140186" Mar 16 17:15:01 crc kubenswrapper[5120]: I0316 17:15:01.022741 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:15:01 crc kubenswrapper[5120]: I0316 17:15:01.092916 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/374d764f-88f9-46d8-96f8-c905404c071d-sg-core-conf-yaml\") pod \"374d764f-88f9-46d8-96f8-c905404c071d\" (UID: \"374d764f-88f9-46d8-96f8-c905404c071d\") " Mar 16 17:15:01 crc kubenswrapper[5120]: I0316 17:15:01.093064 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/374d764f-88f9-46d8-96f8-c905404c071d-run-httpd\") pod \"374d764f-88f9-46d8-96f8-c905404c071d\" (UID: \"374d764f-88f9-46d8-96f8-c905404c071d\") " Mar 16 17:15:01 crc kubenswrapper[5120]: I0316 17:15:01.093099 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7pfv6\" (UniqueName: \"kubernetes.io/projected/374d764f-88f9-46d8-96f8-c905404c071d-kube-api-access-7pfv6\") pod \"374d764f-88f9-46d8-96f8-c905404c071d\" (UID: \"374d764f-88f9-46d8-96f8-c905404c071d\") " Mar 16 17:15:01 crc kubenswrapper[5120]: I0316 17:15:01.093180 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/374d764f-88f9-46d8-96f8-c905404c071d-combined-ca-bundle\") pod \"374d764f-88f9-46d8-96f8-c905404c071d\" (UID: \"374d764f-88f9-46d8-96f8-c905404c071d\") " Mar 16 17:15:01 crc kubenswrapper[5120]: I0316 17:15:01.093265 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/374d764f-88f9-46d8-96f8-c905404c071d-config-data\") pod \"374d764f-88f9-46d8-96f8-c905404c071d\" (UID: \"374d764f-88f9-46d8-96f8-c905404c071d\") " Mar 16 17:15:01 crc kubenswrapper[5120]: I0316 17:15:01.093716 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/374d764f-88f9-46d8-96f8-c905404c071d-log-httpd\") pod \"374d764f-88f9-46d8-96f8-c905404c071d\" (UID: \"374d764f-88f9-46d8-96f8-c905404c071d\") " Mar 16 17:15:01 crc kubenswrapper[5120]: I0316 17:15:01.094291 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/374d764f-88f9-46d8-96f8-c905404c071d-scripts\") pod \"374d764f-88f9-46d8-96f8-c905404c071d\" (UID: \"374d764f-88f9-46d8-96f8-c905404c071d\") " Mar 16 17:15:01 crc kubenswrapper[5120]: I0316 17:15:01.096195 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/374d764f-88f9-46d8-96f8-c905404c071d-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "374d764f-88f9-46d8-96f8-c905404c071d" (UID: "374d764f-88f9-46d8-96f8-c905404c071d"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:15:01 crc kubenswrapper[5120]: I0316 17:15:01.096300 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/374d764f-88f9-46d8-96f8-c905404c071d-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "374d764f-88f9-46d8-96f8-c905404c071d" (UID: "374d764f-88f9-46d8-96f8-c905404c071d"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:15:01 crc kubenswrapper[5120]: I0316 17:15:01.103079 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/374d764f-88f9-46d8-96f8-c905404c071d-kube-api-access-7pfv6" (OuterVolumeSpecName: "kube-api-access-7pfv6") pod "374d764f-88f9-46d8-96f8-c905404c071d" (UID: "374d764f-88f9-46d8-96f8-c905404c071d"). InnerVolumeSpecName "kube-api-access-7pfv6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:15:01 crc kubenswrapper[5120]: I0316 17:15:01.109258 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/374d764f-88f9-46d8-96f8-c905404c071d-scripts" (OuterVolumeSpecName: "scripts") pod "374d764f-88f9-46d8-96f8-c905404c071d" (UID: "374d764f-88f9-46d8-96f8-c905404c071d"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:15:01 crc kubenswrapper[5120]: I0316 17:15:01.126117 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/374d764f-88f9-46d8-96f8-c905404c071d-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "374d764f-88f9-46d8-96f8-c905404c071d" (UID: "374d764f-88f9-46d8-96f8-c905404c071d"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:15:01 crc kubenswrapper[5120]: I0316 17:15:01.197981 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/374d764f-88f9-46d8-96f8-c905404c071d-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:15:01 crc kubenswrapper[5120]: I0316 17:15:01.198351 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/374d764f-88f9-46d8-96f8-c905404c071d-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 17:15:01 crc kubenswrapper[5120]: I0316 17:15:01.198361 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/374d764f-88f9-46d8-96f8-c905404c071d-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 17:15:01 crc kubenswrapper[5120]: I0316 17:15:01.198372 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7pfv6\" (UniqueName: \"kubernetes.io/projected/374d764f-88f9-46d8-96f8-c905404c071d-kube-api-access-7pfv6\") on node \"crc\" DevicePath \"\"" Mar 16 17:15:01 crc kubenswrapper[5120]: I0316 17:15:01.198381 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/374d764f-88f9-46d8-96f8-c905404c071d-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 17:15:01 crc kubenswrapper[5120]: I0316 17:15:01.202196 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/374d764f-88f9-46d8-96f8-c905404c071d-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "374d764f-88f9-46d8-96f8-c905404c071d" (UID: "374d764f-88f9-46d8-96f8-c905404c071d"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:15:01 crc kubenswrapper[5120]: I0316 17:15:01.216013 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/374d764f-88f9-46d8-96f8-c905404c071d-config-data" (OuterVolumeSpecName: "config-data") pod "374d764f-88f9-46d8-96f8-c905404c071d" (UID: "374d764f-88f9-46d8-96f8-c905404c071d"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:15:01 crc kubenswrapper[5120]: I0316 17:15:01.301900 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/374d764f-88f9-46d8-96f8-c905404c071d-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:15:01 crc kubenswrapper[5120]: I0316 17:15:01.301952 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/374d764f-88f9-46d8-96f8-c905404c071d-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:15:01 crc kubenswrapper[5120]: I0316 17:15:01.999276 5120 generic.go:358] "Generic (PLEG): container finished" podID="6ffa780f-a662-4e17-be7b-8cb2d4e75b29" containerID="7b04d4caef16772dfbcc026f1ec9eac9ac62d6b4b6ee6f1c75a21027575021b1" exitCode=0 Mar 16 17:15:02 crc kubenswrapper[5120]: I0316 17:15:01.999726 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/collect-profiles-29561355-cp2zm" event={"ID":"6ffa780f-a662-4e17-be7b-8cb2d4e75b29","Type":"ContainerDied","Data":"7b04d4caef16772dfbcc026f1ec9eac9ac62d6b4b6ee6f1c75a21027575021b1"} Mar 16 17:15:02 crc kubenswrapper[5120]: I0316 17:15:01.999752 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/collect-profiles-29561355-cp2zm" event={"ID":"6ffa780f-a662-4e17-be7b-8cb2d4e75b29","Type":"ContainerStarted","Data":"f38d960a4e4f232f1751c977153f758faf7b74b25242d7d2d818cc94da8700e4"} Mar 16 17:15:02 crc kubenswrapper[5120]: I0316 17:15:02.010013 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"374d764f-88f9-46d8-96f8-c905404c071d","Type":"ContainerDied","Data":"fa69a3644b7024c7e250cfdbc079f20f8d0821288645c9f8f6d695309ae95ad9"} Mar 16 17:15:02 crc kubenswrapper[5120]: I0316 17:15:02.010077 5120 scope.go:117] "RemoveContainer" containerID="3e8727a737dce589dc33ea4512264860e071807d9a0b5d49ffb54328ba5172d4" Mar 16 17:15:02 crc kubenswrapper[5120]: I0316 17:15:02.010026 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:15:02 crc kubenswrapper[5120]: I0316 17:15:02.036551 5120 scope.go:117] "RemoveContainer" containerID="8ed72a094e22dea94a8c30757e60373f243c6f8ac66e7e009ba0bd9251639c7c" Mar 16 17:15:02 crc kubenswrapper[5120]: I0316 17:15:02.063515 5120 scope.go:117] "RemoveContainer" containerID="be42cb006fb2f331a8e83910a29e2ab5d8f6c83161668efd74291c643180e62f" Mar 16 17:15:02 crc kubenswrapper[5120]: I0316 17:15:02.068063 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:15:02 crc kubenswrapper[5120]: I0316 17:15:02.079649 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:15:02 crc kubenswrapper[5120]: I0316 17:15:02.091117 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:15:02 crc kubenswrapper[5120]: I0316 17:15:02.092371 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="374d764f-88f9-46d8-96f8-c905404c071d" containerName="sg-core" Mar 16 17:15:02 crc kubenswrapper[5120]: I0316 17:15:02.092388 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="374d764f-88f9-46d8-96f8-c905404c071d" containerName="sg-core" Mar 16 17:15:02 crc kubenswrapper[5120]: I0316 17:15:02.092400 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="374d764f-88f9-46d8-96f8-c905404c071d" containerName="ceilometer-central-agent" Mar 16 17:15:02 crc kubenswrapper[5120]: I0316 17:15:02.092407 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="374d764f-88f9-46d8-96f8-c905404c071d" containerName="ceilometer-central-agent" Mar 16 17:15:02 crc kubenswrapper[5120]: I0316 17:15:02.092426 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="374d764f-88f9-46d8-96f8-c905404c071d" containerName="ceilometer-notification-agent" Mar 16 17:15:02 crc kubenswrapper[5120]: I0316 17:15:02.092432 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="374d764f-88f9-46d8-96f8-c905404c071d" containerName="ceilometer-notification-agent" Mar 16 17:15:02 crc kubenswrapper[5120]: I0316 17:15:02.092469 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="374d764f-88f9-46d8-96f8-c905404c071d" containerName="proxy-httpd" Mar 16 17:15:02 crc kubenswrapper[5120]: I0316 17:15:02.092474 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="374d764f-88f9-46d8-96f8-c905404c071d" containerName="proxy-httpd" Mar 16 17:15:02 crc kubenswrapper[5120]: I0316 17:15:02.092651 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="374d764f-88f9-46d8-96f8-c905404c071d" containerName="proxy-httpd" Mar 16 17:15:02 crc kubenswrapper[5120]: I0316 17:15:02.092668 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="374d764f-88f9-46d8-96f8-c905404c071d" containerName="ceilometer-central-agent" Mar 16 17:15:02 crc kubenswrapper[5120]: I0316 17:15:02.092679 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="374d764f-88f9-46d8-96f8-c905404c071d" containerName="sg-core" Mar 16 17:15:02 crc kubenswrapper[5120]: I0316 17:15:02.092697 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="374d764f-88f9-46d8-96f8-c905404c071d" containerName="ceilometer-notification-agent" Mar 16 17:15:02 crc kubenswrapper[5120]: I0316 17:15:02.097555 5120 scope.go:117] "RemoveContainer" containerID="e9d2558fe759da1191e8f42584de1e58e647f5ca0b84813e7a5b48d57a0e22ea" Mar 16 17:15:02 crc kubenswrapper[5120]: I0316 17:15:02.106160 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:15:02 crc kubenswrapper[5120]: I0316 17:15:02.106407 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:15:02 crc kubenswrapper[5120]: I0316 17:15:02.109072 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 17:15:02 crc kubenswrapper[5120]: I0316 17:15:02.109306 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 17:15:02 crc kubenswrapper[5120]: I0316 17:15:02.206508 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:15:02 crc kubenswrapper[5120]: I0316 17:15:02.206551 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:15:02 crc kubenswrapper[5120]: I0316 17:15:02.230058 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e9e25236-8106-4c76-a3c5-132b0b3cfebb-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"e9e25236-8106-4c76-a3c5-132b0b3cfebb\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:15:02 crc kubenswrapper[5120]: I0316 17:15:02.230464 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e9e25236-8106-4c76-a3c5-132b0b3cfebb-run-httpd\") pod \"ceilometer-0\" (UID: \"e9e25236-8106-4c76-a3c5-132b0b3cfebb\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:15:02 crc kubenswrapper[5120]: I0316 17:15:02.230729 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e9e25236-8106-4c76-a3c5-132b0b3cfebb-scripts\") pod \"ceilometer-0\" (UID: \"e9e25236-8106-4c76-a3c5-132b0b3cfebb\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:15:02 crc kubenswrapper[5120]: I0316 17:15:02.230975 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wcrnm\" (UniqueName: \"kubernetes.io/projected/e9e25236-8106-4c76-a3c5-132b0b3cfebb-kube-api-access-wcrnm\") pod \"ceilometer-0\" (UID: \"e9e25236-8106-4c76-a3c5-132b0b3cfebb\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:15:02 crc kubenswrapper[5120]: I0316 17:15:02.231118 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/e9e25236-8106-4c76-a3c5-132b0b3cfebb-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"e9e25236-8106-4c76-a3c5-132b0b3cfebb\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:15:02 crc kubenswrapper[5120]: I0316 17:15:02.231223 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e9e25236-8106-4c76-a3c5-132b0b3cfebb-config-data\") pod \"ceilometer-0\" (UID: \"e9e25236-8106-4c76-a3c5-132b0b3cfebb\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:15:02 crc kubenswrapper[5120]: I0316 17:15:02.231361 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e9e25236-8106-4c76-a3c5-132b0b3cfebb-log-httpd\") pod \"ceilometer-0\" (UID: \"e9e25236-8106-4c76-a3c5-132b0b3cfebb\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:15:02 crc kubenswrapper[5120]: I0316 17:15:02.336906 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e9e25236-8106-4c76-a3c5-132b0b3cfebb-log-httpd\") pod \"ceilometer-0\" (UID: \"e9e25236-8106-4c76-a3c5-132b0b3cfebb\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:15:02 crc kubenswrapper[5120]: I0316 17:15:02.338231 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e9e25236-8106-4c76-a3c5-132b0b3cfebb-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"e9e25236-8106-4c76-a3c5-132b0b3cfebb\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:15:02 crc kubenswrapper[5120]: I0316 17:15:02.338813 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e9e25236-8106-4c76-a3c5-132b0b3cfebb-log-httpd\") pod \"ceilometer-0\" (UID: \"e9e25236-8106-4c76-a3c5-132b0b3cfebb\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:15:02 crc kubenswrapper[5120]: I0316 17:15:02.339109 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e9e25236-8106-4c76-a3c5-132b0b3cfebb-run-httpd\") pod \"ceilometer-0\" (UID: \"e9e25236-8106-4c76-a3c5-132b0b3cfebb\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:15:02 crc kubenswrapper[5120]: I0316 17:15:02.339696 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e9e25236-8106-4c76-a3c5-132b0b3cfebb-scripts\") pod \"ceilometer-0\" (UID: \"e9e25236-8106-4c76-a3c5-132b0b3cfebb\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:15:02 crc kubenswrapper[5120]: I0316 17:15:02.340017 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wcrnm\" (UniqueName: \"kubernetes.io/projected/e9e25236-8106-4c76-a3c5-132b0b3cfebb-kube-api-access-wcrnm\") pod \"ceilometer-0\" (UID: \"e9e25236-8106-4c76-a3c5-132b0b3cfebb\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:15:02 crc kubenswrapper[5120]: I0316 17:15:02.340335 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/e9e25236-8106-4c76-a3c5-132b0b3cfebb-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"e9e25236-8106-4c76-a3c5-132b0b3cfebb\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:15:02 crc kubenswrapper[5120]: I0316 17:15:02.340616 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e9e25236-8106-4c76-a3c5-132b0b3cfebb-config-data\") pod \"ceilometer-0\" (UID: \"e9e25236-8106-4c76-a3c5-132b0b3cfebb\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:15:02 crc kubenswrapper[5120]: I0316 17:15:02.342469 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e9e25236-8106-4c76-a3c5-132b0b3cfebb-run-httpd\") pod \"ceilometer-0\" (UID: \"e9e25236-8106-4c76-a3c5-132b0b3cfebb\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:15:02 crc kubenswrapper[5120]: I0316 17:15:02.345092 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e9e25236-8106-4c76-a3c5-132b0b3cfebb-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"e9e25236-8106-4c76-a3c5-132b0b3cfebb\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:15:02 crc kubenswrapper[5120]: I0316 17:15:02.345495 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/e9e25236-8106-4c76-a3c5-132b0b3cfebb-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"e9e25236-8106-4c76-a3c5-132b0b3cfebb\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:15:02 crc kubenswrapper[5120]: I0316 17:15:02.349576 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e9e25236-8106-4c76-a3c5-132b0b3cfebb-config-data\") pod \"ceilometer-0\" (UID: \"e9e25236-8106-4c76-a3c5-132b0b3cfebb\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:15:02 crc kubenswrapper[5120]: I0316 17:15:02.354622 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e9e25236-8106-4c76-a3c5-132b0b3cfebb-scripts\") pod \"ceilometer-0\" (UID: \"e9e25236-8106-4c76-a3c5-132b0b3cfebb\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:15:02 crc kubenswrapper[5120]: I0316 17:15:02.366539 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wcrnm\" (UniqueName: \"kubernetes.io/projected/e9e25236-8106-4c76-a3c5-132b0b3cfebb-kube-api-access-wcrnm\") pod \"ceilometer-0\" (UID: \"e9e25236-8106-4c76-a3c5-132b0b3cfebb\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:15:02 crc kubenswrapper[5120]: I0316 17:15:02.427046 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:15:02 crc kubenswrapper[5120]: I0316 17:15:02.427389 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:15:02 crc kubenswrapper[5120]: I0316 17:15:02.429082 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:15:02 crc kubenswrapper[5120]: I0316 17:15:02.684918 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="374d764f-88f9-46d8-96f8-c905404c071d" path="/var/lib/kubelet/pods/374d764f-88f9-46d8-96f8-c905404c071d/volumes" Mar 16 17:15:02 crc kubenswrapper[5120]: I0316 17:15:02.932232 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:15:02 crc kubenswrapper[5120]: W0316 17:15:02.934198 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode9e25236_8106_4c76_a3c5_132b0b3cfebb.slice/crio-e84af5ccffd8d476d292e62a0c794f57d59bc978646acf3788e6201baa25da64 WatchSource:0}: Error finding container e84af5ccffd8d476d292e62a0c794f57d59bc978646acf3788e6201baa25da64: Status 404 returned error can't find the container with id e84af5ccffd8d476d292e62a0c794f57d59bc978646acf3788e6201baa25da64 Mar 16 17:15:02 crc kubenswrapper[5120]: I0316 17:15:02.982653 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 17:15:03 crc kubenswrapper[5120]: I0316 17:15:03.038190 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"e9e25236-8106-4c76-a3c5-132b0b3cfebb","Type":"ContainerStarted","Data":"e84af5ccffd8d476d292e62a0c794f57d59bc978646acf3788e6201baa25da64"} Mar 16 17:15:03 crc kubenswrapper[5120]: I0316 17:15:03.232147 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:15:03 crc kubenswrapper[5120]: I0316 17:15:03.247989 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="b787b31b-bfd4-4268-a8fe-9887e4822a9b" containerName="nova-api-log" probeResult="failure" output="Get \"http://10.217.0.200:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 17:15:03 crc kubenswrapper[5120]: I0316 17:15:03.248182 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="b787b31b-bfd4-4268-a8fe-9887e4822a9b" containerName="nova-api-api" probeResult="failure" output="Get \"http://10.217.0.200:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 17:15:03 crc kubenswrapper[5120]: I0316 17:15:03.262271 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:15:03 crc kubenswrapper[5120]: I0316 17:15:03.347566 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29561355-cp2zm" Mar 16 17:15:03 crc kubenswrapper[5120]: I0316 17:15:03.431933 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="57c93f23-dca4-4b4a-8412-cc906209adb1" containerName="nova-metadata-log" probeResult="failure" output="Get \"https://10.217.0.201:8775/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Mar 16 17:15:03 crc kubenswrapper[5120]: I0316 17:15:03.432976 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="57c93f23-dca4-4b4a-8412-cc906209adb1" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"https://10.217.0.201:8775/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Mar 16 17:15:03 crc kubenswrapper[5120]: I0316 17:15:03.481776 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/6ffa780f-a662-4e17-be7b-8cb2d4e75b29-secret-volume\") pod \"6ffa780f-a662-4e17-be7b-8cb2d4e75b29\" (UID: \"6ffa780f-a662-4e17-be7b-8cb2d4e75b29\") " Mar 16 17:15:03 crc kubenswrapper[5120]: I0316 17:15:03.481919 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6ffa780f-a662-4e17-be7b-8cb2d4e75b29-config-volume\") pod \"6ffa780f-a662-4e17-be7b-8cb2d4e75b29\" (UID: \"6ffa780f-a662-4e17-be7b-8cb2d4e75b29\") " Mar 16 17:15:03 crc kubenswrapper[5120]: I0316 17:15:03.482374 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vrjlh\" (UniqueName: \"kubernetes.io/projected/6ffa780f-a662-4e17-be7b-8cb2d4e75b29-kube-api-access-vrjlh\") pod \"6ffa780f-a662-4e17-be7b-8cb2d4e75b29\" (UID: \"6ffa780f-a662-4e17-be7b-8cb2d4e75b29\") " Mar 16 17:15:03 crc kubenswrapper[5120]: I0316 17:15:03.483565 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ffa780f-a662-4e17-be7b-8cb2d4e75b29-config-volume" (OuterVolumeSpecName: "config-volume") pod "6ffa780f-a662-4e17-be7b-8cb2d4e75b29" (UID: "6ffa780f-a662-4e17-be7b-8cb2d4e75b29"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:15:03 crc kubenswrapper[5120]: I0316 17:15:03.488125 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ffa780f-a662-4e17-be7b-8cb2d4e75b29-kube-api-access-vrjlh" (OuterVolumeSpecName: "kube-api-access-vrjlh") pod "6ffa780f-a662-4e17-be7b-8cb2d4e75b29" (UID: "6ffa780f-a662-4e17-be7b-8cb2d4e75b29"). InnerVolumeSpecName "kube-api-access-vrjlh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:15:03 crc kubenswrapper[5120]: I0316 17:15:03.510443 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ffa780f-a662-4e17-be7b-8cb2d4e75b29-secret-volume" (OuterVolumeSpecName: "secret-volume") pod "6ffa780f-a662-4e17-be7b-8cb2d4e75b29" (UID: "6ffa780f-a662-4e17-be7b-8cb2d4e75b29"). InnerVolumeSpecName "secret-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:15:03 crc kubenswrapper[5120]: I0316 17:15:03.586633 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vrjlh\" (UniqueName: \"kubernetes.io/projected/6ffa780f-a662-4e17-be7b-8cb2d4e75b29-kube-api-access-vrjlh\") on node \"crc\" DevicePath \"\"" Mar 16 17:15:03 crc kubenswrapper[5120]: I0316 17:15:03.586696 5120 reconciler_common.go:299] "Volume detached for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/6ffa780f-a662-4e17-be7b-8cb2d4e75b29-secret-volume\") on node \"crc\" DevicePath \"\"" Mar 16 17:15:03 crc kubenswrapper[5120]: I0316 17:15:03.586710 5120 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6ffa780f-a662-4e17-be7b-8cb2d4e75b29-config-volume\") on node \"crc\" DevicePath \"\"" Mar 16 17:15:03 crc kubenswrapper[5120]: I0316 17:15:03.613984 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 17:15:03 crc kubenswrapper[5120]: I0316 17:15:03.614248 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="b787b31b-bfd4-4268-a8fe-9887e4822a9b" containerName="nova-api-log" containerID="cri-o://a0c252932a4d2c93df7720df2366edc5aaa8e0a0a20f09f5d300fb7f6f137a1a" gracePeriod=30 Mar 16 17:15:03 crc kubenswrapper[5120]: I0316 17:15:03.614420 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="b787b31b-bfd4-4268-a8fe-9887e4822a9b" containerName="nova-api-api" containerID="cri-o://b50a4886d3be5dc70b195557d66f6828da34608e971ae4dd1b68bf82f0eacfc7" gracePeriod=30 Mar 16 17:15:03 crc kubenswrapper[5120]: I0316 17:15:03.646983 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 17:15:03 crc kubenswrapper[5120]: I0316 17:15:03.647275 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="57c93f23-dca4-4b4a-8412-cc906209adb1" containerName="nova-metadata-log" containerID="cri-o://74c588d53f7977da271f46a4eb5f34b231625e8a52c1e5f5ee4767d4bfbf96a1" gracePeriod=30 Mar 16 17:15:03 crc kubenswrapper[5120]: I0316 17:15:03.647450 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="57c93f23-dca4-4b4a-8412-cc906209adb1" containerName="nova-metadata-metadata" containerID="cri-o://68f6b9614a1178fe51a0a639372c28f4268575571e05bbb95f950f5f93965be9" gracePeriod=30 Mar 16 17:15:04 crc kubenswrapper[5120]: I0316 17:15:04.062980 5120 generic.go:358] "Generic (PLEG): container finished" podID="b787b31b-bfd4-4268-a8fe-9887e4822a9b" containerID="a0c252932a4d2c93df7720df2366edc5aaa8e0a0a20f09f5d300fb7f6f137a1a" exitCode=143 Mar 16 17:15:04 crc kubenswrapper[5120]: I0316 17:15:04.063640 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"b787b31b-bfd4-4268-a8fe-9887e4822a9b","Type":"ContainerDied","Data":"a0c252932a4d2c93df7720df2366edc5aaa8e0a0a20f09f5d300fb7f6f137a1a"} Mar 16 17:15:04 crc kubenswrapper[5120]: I0316 17:15:04.069280 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/collect-profiles-29561355-cp2zm" event={"ID":"6ffa780f-a662-4e17-be7b-8cb2d4e75b29","Type":"ContainerDied","Data":"f38d960a4e4f232f1751c977153f758faf7b74b25242d7d2d818cc94da8700e4"} Mar 16 17:15:04 crc kubenswrapper[5120]: I0316 17:15:04.069305 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f38d960a4e4f232f1751c977153f758faf7b74b25242d7d2d818cc94da8700e4" Mar 16 17:15:04 crc kubenswrapper[5120]: I0316 17:15:04.069410 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29561355-cp2zm" Mar 16 17:15:04 crc kubenswrapper[5120]: I0316 17:15:04.085173 5120 generic.go:358] "Generic (PLEG): container finished" podID="57c93f23-dca4-4b4a-8412-cc906209adb1" containerID="74c588d53f7977da271f46a4eb5f34b231625e8a52c1e5f5ee4767d4bfbf96a1" exitCode=143 Mar 16 17:15:04 crc kubenswrapper[5120]: I0316 17:15:04.086992 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"57c93f23-dca4-4b4a-8412-cc906209adb1","Type":"ContainerDied","Data":"74c588d53f7977da271f46a4eb5f34b231625e8a52c1e5f5ee4767d4bfbf96a1"} Mar 16 17:15:04 crc kubenswrapper[5120]: I0316 17:15:04.115138 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:15:04 crc kubenswrapper[5120]: I0316 17:15:04.495249 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29561310-46dmp"] Mar 16 17:15:04 crc kubenswrapper[5120]: I0316 17:15:04.507971 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29561310-46dmp"] Mar 16 17:15:04 crc kubenswrapper[5120]: I0316 17:15:04.676462 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6064853b-89f3-446e-8810-bded0e3841ce" path="/var/lib/kubelet/pods/6064853b-89f3-446e-8810-bded0e3841ce/volumes" Mar 16 17:15:05 crc kubenswrapper[5120]: I0316 17:15:05.107210 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"e9e25236-8106-4c76-a3c5-132b0b3cfebb","Type":"ContainerStarted","Data":"726f62d922c6ac0a5818719fb7d74d5d3556703437962935d269bd302590e6e2"} Mar 16 17:15:06 crc kubenswrapper[5120]: I0316 17:15:06.120518 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"e9e25236-8106-4c76-a3c5-132b0b3cfebb","Type":"ContainerStarted","Data":"535a7dd03c9a0ed1f949374deb52bc4d3b86d88a01b8e07f732ef79450e9ecba"} Mar 16 17:15:07 crc kubenswrapper[5120]: I0316 17:15:07.052787 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 17:15:07 crc kubenswrapper[5120]: I0316 17:15:07.139090 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"e9e25236-8106-4c76-a3c5-132b0b3cfebb","Type":"ContainerStarted","Data":"dcca787fc6ee3274f8176eacd1d011e5cb179a2d0a58a0996379ea8eb5e292b2"} Mar 16 17:15:07 crc kubenswrapper[5120]: I0316 17:15:07.540798 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-8lvrl"] Mar 16 17:15:07 crc kubenswrapper[5120]: I0316 17:15:07.597544 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ffa780f-a662-4e17-be7b-8cb2d4e75b29" containerName="collect-profiles" Mar 16 17:15:07 crc kubenswrapper[5120]: I0316 17:15:07.598060 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ffa780f-a662-4e17-be7b-8cb2d4e75b29" containerName="collect-profiles" Mar 16 17:15:07 crc kubenswrapper[5120]: I0316 17:15:07.599603 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="6ffa780f-a662-4e17-be7b-8cb2d4e75b29" containerName="collect-profiles" Mar 16 17:15:07 crc kubenswrapper[5120]: I0316 17:15:07.606953 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-8lvrl"] Mar 16 17:15:07 crc kubenswrapper[5120]: I0316 17:15:07.607064 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-8lvrl" Mar 16 17:15:07 crc kubenswrapper[5120]: I0316 17:15:07.609544 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-manage-scripts\"" Mar 16 17:15:07 crc kubenswrapper[5120]: I0316 17:15:07.609653 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-manage-config-data\"" Mar 16 17:15:07 crc kubenswrapper[5120]: I0316 17:15:07.733426 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ea5aaac8-9646-4c80-8b0a-bafb1a03bd20-config-data\") pod \"nova-cell1-cell-mapping-8lvrl\" (UID: \"ea5aaac8-9646-4c80-8b0a-bafb1a03bd20\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-8lvrl" Mar 16 17:15:07 crc kubenswrapper[5120]: I0316 17:15:07.733625 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ea5aaac8-9646-4c80-8b0a-bafb1a03bd20-scripts\") pod \"nova-cell1-cell-mapping-8lvrl\" (UID: \"ea5aaac8-9646-4c80-8b0a-bafb1a03bd20\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-8lvrl" Mar 16 17:15:07 crc kubenswrapper[5120]: I0316 17:15:07.734533 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ea5aaac8-9646-4c80-8b0a-bafb1a03bd20-combined-ca-bundle\") pod \"nova-cell1-cell-mapping-8lvrl\" (UID: \"ea5aaac8-9646-4c80-8b0a-bafb1a03bd20\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-8lvrl" Mar 16 17:15:07 crc kubenswrapper[5120]: I0316 17:15:07.734783 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwjm9\" (UniqueName: \"kubernetes.io/projected/ea5aaac8-9646-4c80-8b0a-bafb1a03bd20-kube-api-access-gwjm9\") pod \"nova-cell1-cell-mapping-8lvrl\" (UID: \"ea5aaac8-9646-4c80-8b0a-bafb1a03bd20\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-8lvrl" Mar 16 17:15:07 crc kubenswrapper[5120]: I0316 17:15:07.837686 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gwjm9\" (UniqueName: \"kubernetes.io/projected/ea5aaac8-9646-4c80-8b0a-bafb1a03bd20-kube-api-access-gwjm9\") pod \"nova-cell1-cell-mapping-8lvrl\" (UID: \"ea5aaac8-9646-4c80-8b0a-bafb1a03bd20\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-8lvrl" Mar 16 17:15:07 crc kubenswrapper[5120]: I0316 17:15:07.838061 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ea5aaac8-9646-4c80-8b0a-bafb1a03bd20-config-data\") pod \"nova-cell1-cell-mapping-8lvrl\" (UID: \"ea5aaac8-9646-4c80-8b0a-bafb1a03bd20\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-8lvrl" Mar 16 17:15:07 crc kubenswrapper[5120]: I0316 17:15:07.839151 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ea5aaac8-9646-4c80-8b0a-bafb1a03bd20-scripts\") pod \"nova-cell1-cell-mapping-8lvrl\" (UID: \"ea5aaac8-9646-4c80-8b0a-bafb1a03bd20\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-8lvrl" Mar 16 17:15:07 crc kubenswrapper[5120]: I0316 17:15:07.841140 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ea5aaac8-9646-4c80-8b0a-bafb1a03bd20-combined-ca-bundle\") pod \"nova-cell1-cell-mapping-8lvrl\" (UID: \"ea5aaac8-9646-4c80-8b0a-bafb1a03bd20\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-8lvrl" Mar 16 17:15:07 crc kubenswrapper[5120]: I0316 17:15:07.847025 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ea5aaac8-9646-4c80-8b0a-bafb1a03bd20-scripts\") pod \"nova-cell1-cell-mapping-8lvrl\" (UID: \"ea5aaac8-9646-4c80-8b0a-bafb1a03bd20\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-8lvrl" Mar 16 17:15:07 crc kubenswrapper[5120]: I0316 17:15:07.847176 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ea5aaac8-9646-4c80-8b0a-bafb1a03bd20-combined-ca-bundle\") pod \"nova-cell1-cell-mapping-8lvrl\" (UID: \"ea5aaac8-9646-4c80-8b0a-bafb1a03bd20\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-8lvrl" Mar 16 17:15:07 crc kubenswrapper[5120]: I0316 17:15:07.847804 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ea5aaac8-9646-4c80-8b0a-bafb1a03bd20-config-data\") pod \"nova-cell1-cell-mapping-8lvrl\" (UID: \"ea5aaac8-9646-4c80-8b0a-bafb1a03bd20\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-8lvrl" Mar 16 17:15:07 crc kubenswrapper[5120]: I0316 17:15:07.863553 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwjm9\" (UniqueName: \"kubernetes.io/projected/ea5aaac8-9646-4c80-8b0a-bafb1a03bd20-kube-api-access-gwjm9\") pod \"nova-cell1-cell-mapping-8lvrl\" (UID: \"ea5aaac8-9646-4c80-8b0a-bafb1a03bd20\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-8lvrl" Mar 16 17:15:07 crc kubenswrapper[5120]: I0316 17:15:07.946053 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-8lvrl" Mar 16 17:15:08 crc kubenswrapper[5120]: E0316 17:15:08.527573 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1873699 actualBytes=10240 Mar 16 17:15:08 crc kubenswrapper[5120]: I0316 17:15:08.528940 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-8lvrl"] Mar 16 17:15:09 crc kubenswrapper[5120]: I0316 17:15:09.168986 5120 generic.go:358] "Generic (PLEG): container finished" podID="57c93f23-dca4-4b4a-8412-cc906209adb1" containerID="68f6b9614a1178fe51a0a639372c28f4268575571e05bbb95f950f5f93965be9" exitCode=0 Mar 16 17:15:09 crc kubenswrapper[5120]: I0316 17:15:09.169535 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"57c93f23-dca4-4b4a-8412-cc906209adb1","Type":"ContainerDied","Data":"68f6b9614a1178fe51a0a639372c28f4268575571e05bbb95f950f5f93965be9"} Mar 16 17:15:09 crc kubenswrapper[5120]: I0316 17:15:09.171893 5120 generic.go:358] "Generic (PLEG): container finished" podID="b787b31b-bfd4-4268-a8fe-9887e4822a9b" containerID="b50a4886d3be5dc70b195557d66f6828da34608e971ae4dd1b68bf82f0eacfc7" exitCode=0 Mar 16 17:15:09 crc kubenswrapper[5120]: I0316 17:15:09.172013 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"b787b31b-bfd4-4268-a8fe-9887e4822a9b","Type":"ContainerDied","Data":"b50a4886d3be5dc70b195557d66f6828da34608e971ae4dd1b68bf82f0eacfc7"} Mar 16 17:15:09 crc kubenswrapper[5120]: I0316 17:15:09.178089 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-8lvrl" event={"ID":"ea5aaac8-9646-4c80-8b0a-bafb1a03bd20","Type":"ContainerStarted","Data":"35ba2e32f1219544208d3844bf0654ef2effacbd5d493e238c7a99b1c6f328e3"} Mar 16 17:15:09 crc kubenswrapper[5120]: I0316 17:15:09.178147 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-8lvrl" event={"ID":"ea5aaac8-9646-4c80-8b0a-bafb1a03bd20","Type":"ContainerStarted","Data":"ec8fbb3f18e129b77caa76d26791554af7b23a7f1718319414ff3e64c7b0d60a"} Mar 16 17:15:09 crc kubenswrapper[5120]: I0316 17:15:09.202183 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-8lvrl" podStartSLOduration=2.202164599 podStartE2EDuration="2.202164599s" podCreationTimestamp="2026-03-16 17:15:07 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:15:09.19708853 +0000 UTC m=+6211.351020187" watchObservedRunningTime="2026-03-16 17:15:09.202164599 +0000 UTC m=+6211.356096256" Mar 16 17:15:09 crc kubenswrapper[5120]: I0316 17:15:09.497025 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:15:09 crc kubenswrapper[5120]: I0316 17:15:09.537636 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:15:09 crc kubenswrapper[5120]: I0316 17:15:09.587385 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b787b31b-bfd4-4268-a8fe-9887e4822a9b-config-data\") pod \"b787b31b-bfd4-4268-a8fe-9887e4822a9b\" (UID: \"b787b31b-bfd4-4268-a8fe-9887e4822a9b\") " Mar 16 17:15:09 crc kubenswrapper[5120]: I0316 17:15:09.587451 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b787b31b-bfd4-4268-a8fe-9887e4822a9b-logs\") pod \"b787b31b-bfd4-4268-a8fe-9887e4822a9b\" (UID: \"b787b31b-bfd4-4268-a8fe-9887e4822a9b\") " Mar 16 17:15:09 crc kubenswrapper[5120]: I0316 17:15:09.587814 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v9l2m\" (UniqueName: \"kubernetes.io/projected/b787b31b-bfd4-4268-a8fe-9887e4822a9b-kube-api-access-v9l2m\") pod \"b787b31b-bfd4-4268-a8fe-9887e4822a9b\" (UID: \"b787b31b-bfd4-4268-a8fe-9887e4822a9b\") " Mar 16 17:15:09 crc kubenswrapper[5120]: I0316 17:15:09.587920 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b787b31b-bfd4-4268-a8fe-9887e4822a9b-combined-ca-bundle\") pod \"b787b31b-bfd4-4268-a8fe-9887e4822a9b\" (UID: \"b787b31b-bfd4-4268-a8fe-9887e4822a9b\") " Mar 16 17:15:09 crc kubenswrapper[5120]: I0316 17:15:09.588151 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b787b31b-bfd4-4268-a8fe-9887e4822a9b-logs" (OuterVolumeSpecName: "logs") pod "b787b31b-bfd4-4268-a8fe-9887e4822a9b" (UID: "b787b31b-bfd4-4268-a8fe-9887e4822a9b"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:15:09 crc kubenswrapper[5120]: I0316 17:15:09.589492 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b787b31b-bfd4-4268-a8fe-9887e4822a9b-logs\") on node \"crc\" DevicePath \"\"" Mar 16 17:15:09 crc kubenswrapper[5120]: I0316 17:15:09.593596 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b787b31b-bfd4-4268-a8fe-9887e4822a9b-kube-api-access-v9l2m" (OuterVolumeSpecName: "kube-api-access-v9l2m") pod "b787b31b-bfd4-4268-a8fe-9887e4822a9b" (UID: "b787b31b-bfd4-4268-a8fe-9887e4822a9b"). InnerVolumeSpecName "kube-api-access-v9l2m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:15:09 crc kubenswrapper[5120]: I0316 17:15:09.615706 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b787b31b-bfd4-4268-a8fe-9887e4822a9b-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "b787b31b-bfd4-4268-a8fe-9887e4822a9b" (UID: "b787b31b-bfd4-4268-a8fe-9887e4822a9b"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:15:09 crc kubenswrapper[5120]: I0316 17:15:09.629369 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b787b31b-bfd4-4268-a8fe-9887e4822a9b-config-data" (OuterVolumeSpecName: "config-data") pod "b787b31b-bfd4-4268-a8fe-9887e4822a9b" (UID: "b787b31b-bfd4-4268-a8fe-9887e4822a9b"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:15:09 crc kubenswrapper[5120]: I0316 17:15:09.691649 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/57c93f23-dca4-4b4a-8412-cc906209adb1-config-data\") pod \"57c93f23-dca4-4b4a-8412-cc906209adb1\" (UID: \"57c93f23-dca4-4b4a-8412-cc906209adb1\") " Mar 16 17:15:09 crc kubenswrapper[5120]: I0316 17:15:09.691729 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/57c93f23-dca4-4b4a-8412-cc906209adb1-nova-metadata-tls-certs\") pod \"57c93f23-dca4-4b4a-8412-cc906209adb1\" (UID: \"57c93f23-dca4-4b4a-8412-cc906209adb1\") " Mar 16 17:15:09 crc kubenswrapper[5120]: I0316 17:15:09.691826 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/57c93f23-dca4-4b4a-8412-cc906209adb1-logs\") pod \"57c93f23-dca4-4b4a-8412-cc906209adb1\" (UID: \"57c93f23-dca4-4b4a-8412-cc906209adb1\") " Mar 16 17:15:09 crc kubenswrapper[5120]: I0316 17:15:09.691987 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/57c93f23-dca4-4b4a-8412-cc906209adb1-combined-ca-bundle\") pod \"57c93f23-dca4-4b4a-8412-cc906209adb1\" (UID: \"57c93f23-dca4-4b4a-8412-cc906209adb1\") " Mar 16 17:15:09 crc kubenswrapper[5120]: I0316 17:15:09.692286 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b99r2\" (UniqueName: \"kubernetes.io/projected/57c93f23-dca4-4b4a-8412-cc906209adb1-kube-api-access-b99r2\") pod \"57c93f23-dca4-4b4a-8412-cc906209adb1\" (UID: \"57c93f23-dca4-4b4a-8412-cc906209adb1\") " Mar 16 17:15:09 crc kubenswrapper[5120]: I0316 17:15:09.692716 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57c93f23-dca4-4b4a-8412-cc906209adb1-logs" (OuterVolumeSpecName: "logs") pod "57c93f23-dca4-4b4a-8412-cc906209adb1" (UID: "57c93f23-dca4-4b4a-8412-cc906209adb1"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:15:09 crc kubenswrapper[5120]: I0316 17:15:09.693546 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b787b31b-bfd4-4268-a8fe-9887e4822a9b-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:15:09 crc kubenswrapper[5120]: I0316 17:15:09.693568 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/57c93f23-dca4-4b4a-8412-cc906209adb1-logs\") on node \"crc\" DevicePath \"\"" Mar 16 17:15:09 crc kubenswrapper[5120]: I0316 17:15:09.693582 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b787b31b-bfd4-4268-a8fe-9887e4822a9b-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:15:09 crc kubenswrapper[5120]: I0316 17:15:09.693596 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v9l2m\" (UniqueName: \"kubernetes.io/projected/b787b31b-bfd4-4268-a8fe-9887e4822a9b-kube-api-access-v9l2m\") on node \"crc\" DevicePath \"\"" Mar 16 17:15:09 crc kubenswrapper[5120]: I0316 17:15:09.695614 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57c93f23-dca4-4b4a-8412-cc906209adb1-kube-api-access-b99r2" (OuterVolumeSpecName: "kube-api-access-b99r2") pod "57c93f23-dca4-4b4a-8412-cc906209adb1" (UID: "57c93f23-dca4-4b4a-8412-cc906209adb1"). InnerVolumeSpecName "kube-api-access-b99r2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:15:09 crc kubenswrapper[5120]: I0316 17:15:09.720978 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/57c93f23-dca4-4b4a-8412-cc906209adb1-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "57c93f23-dca4-4b4a-8412-cc906209adb1" (UID: "57c93f23-dca4-4b4a-8412-cc906209adb1"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:15:09 crc kubenswrapper[5120]: I0316 17:15:09.721479 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/57c93f23-dca4-4b4a-8412-cc906209adb1-config-data" (OuterVolumeSpecName: "config-data") pod "57c93f23-dca4-4b4a-8412-cc906209adb1" (UID: "57c93f23-dca4-4b4a-8412-cc906209adb1"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:15:09 crc kubenswrapper[5120]: I0316 17:15:09.740004 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/57c93f23-dca4-4b4a-8412-cc906209adb1-nova-metadata-tls-certs" (OuterVolumeSpecName: "nova-metadata-tls-certs") pod "57c93f23-dca4-4b4a-8412-cc906209adb1" (UID: "57c93f23-dca4-4b4a-8412-cc906209adb1"). InnerVolumeSpecName "nova-metadata-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:15:09 crc kubenswrapper[5120]: I0316 17:15:09.795828 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/57c93f23-dca4-4b4a-8412-cc906209adb1-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:15:09 crc kubenswrapper[5120]: I0316 17:15:09.795861 5120 reconciler_common.go:299] "Volume detached for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/57c93f23-dca4-4b4a-8412-cc906209adb1-nova-metadata-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:15:09 crc kubenswrapper[5120]: I0316 17:15:09.795873 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/57c93f23-dca4-4b4a-8412-cc906209adb1-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:15:09 crc kubenswrapper[5120]: I0316 17:15:09.795884 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b99r2\" (UniqueName: \"kubernetes.io/projected/57c93f23-dca4-4b4a-8412-cc906209adb1-kube-api-access-b99r2\") on node \"crc\" DevicePath \"\"" Mar 16 17:15:10 crc kubenswrapper[5120]: I0316 17:15:10.190103 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"e9e25236-8106-4c76-a3c5-132b0b3cfebb","Type":"ContainerStarted","Data":"d7b905d21e84ee131f8a49f7ac31554239a73dd345c455d0f9a0817abd0cc1e1"} Mar 16 17:15:10 crc kubenswrapper[5120]: I0316 17:15:10.190492 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:15:10 crc kubenswrapper[5120]: I0316 17:15:10.194059 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:15:10 crc kubenswrapper[5120]: I0316 17:15:10.194090 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"57c93f23-dca4-4b4a-8412-cc906209adb1","Type":"ContainerDied","Data":"cb01bafea458ae169cef76e7b2bf16b2bc7a2aa3e6a42b06be40938032b1aef1"} Mar 16 17:15:10 crc kubenswrapper[5120]: I0316 17:15:10.194287 5120 scope.go:117] "RemoveContainer" containerID="68f6b9614a1178fe51a0a639372c28f4268575571e05bbb95f950f5f93965be9" Mar 16 17:15:10 crc kubenswrapper[5120]: I0316 17:15:10.198660 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:15:10 crc kubenswrapper[5120]: I0316 17:15:10.199253 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"b787b31b-bfd4-4268-a8fe-9887e4822a9b","Type":"ContainerDied","Data":"ff91680289da249e54dd9a48c3cb9ae348b712eb3b4957bc894940025529f055"} Mar 16 17:15:10 crc kubenswrapper[5120]: I0316 17:15:10.228614 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.3024822670000002 podStartE2EDuration="8.228593311s" podCreationTimestamp="2026-03-16 17:15:02 +0000 UTC" firstStartedPulling="2026-03-16 17:15:02.937907854 +0000 UTC m=+6205.091839511" lastFinishedPulling="2026-03-16 17:15:08.864018898 +0000 UTC m=+6211.017950555" observedRunningTime="2026-03-16 17:15:10.217565069 +0000 UTC m=+6212.371496726" watchObservedRunningTime="2026-03-16 17:15:10.228593311 +0000 UTC m=+6212.382524968" Mar 16 17:15:10 crc kubenswrapper[5120]: I0316 17:15:10.244831 5120 scope.go:117] "RemoveContainer" containerID="74c588d53f7977da271f46a4eb5f34b231625e8a52c1e5f5ee4767d4bfbf96a1" Mar 16 17:15:10 crc kubenswrapper[5120]: I0316 17:15:10.253989 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 17:15:10 crc kubenswrapper[5120]: I0316 17:15:10.266146 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 17:15:10 crc kubenswrapper[5120]: I0316 17:15:10.285897 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 17:15:10 crc kubenswrapper[5120]: I0316 17:15:10.286519 5120 scope.go:117] "RemoveContainer" containerID="b50a4886d3be5dc70b195557d66f6828da34608e971ae4dd1b68bf82f0eacfc7" Mar 16 17:15:10 crc kubenswrapper[5120]: I0316 17:15:10.301736 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 17:15:10 crc kubenswrapper[5120]: I0316 17:15:10.310977 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 17:15:10 crc kubenswrapper[5120]: I0316 17:15:10.312253 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b787b31b-bfd4-4268-a8fe-9887e4822a9b" containerName="nova-api-log" Mar 16 17:15:10 crc kubenswrapper[5120]: I0316 17:15:10.312285 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="b787b31b-bfd4-4268-a8fe-9887e4822a9b" containerName="nova-api-log" Mar 16 17:15:10 crc kubenswrapper[5120]: I0316 17:15:10.312325 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57c93f23-dca4-4b4a-8412-cc906209adb1" containerName="nova-metadata-metadata" Mar 16 17:15:10 crc kubenswrapper[5120]: I0316 17:15:10.312333 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="57c93f23-dca4-4b4a-8412-cc906209adb1" containerName="nova-metadata-metadata" Mar 16 17:15:10 crc kubenswrapper[5120]: I0316 17:15:10.312362 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57c93f23-dca4-4b4a-8412-cc906209adb1" containerName="nova-metadata-log" Mar 16 17:15:10 crc kubenswrapper[5120]: I0316 17:15:10.312369 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="57c93f23-dca4-4b4a-8412-cc906209adb1" containerName="nova-metadata-log" Mar 16 17:15:10 crc kubenswrapper[5120]: I0316 17:15:10.312381 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b787b31b-bfd4-4268-a8fe-9887e4822a9b" containerName="nova-api-api" Mar 16 17:15:10 crc kubenswrapper[5120]: I0316 17:15:10.312387 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="b787b31b-bfd4-4268-a8fe-9887e4822a9b" containerName="nova-api-api" Mar 16 17:15:10 crc kubenswrapper[5120]: I0316 17:15:10.312566 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="57c93f23-dca4-4b4a-8412-cc906209adb1" containerName="nova-metadata-log" Mar 16 17:15:10 crc kubenswrapper[5120]: I0316 17:15:10.312586 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="57c93f23-dca4-4b4a-8412-cc906209adb1" containerName="nova-metadata-metadata" Mar 16 17:15:10 crc kubenswrapper[5120]: I0316 17:15:10.312604 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="b787b31b-bfd4-4268-a8fe-9887e4822a9b" containerName="nova-api-log" Mar 16 17:15:10 crc kubenswrapper[5120]: I0316 17:15:10.312616 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="b787b31b-bfd4-4268-a8fe-9887e4822a9b" containerName="nova-api-api" Mar 16 17:15:10 crc kubenswrapper[5120]: I0316 17:15:10.323155 5120 scope.go:117] "RemoveContainer" containerID="a0c252932a4d2c93df7720df2366edc5aaa8e0a0a20f09f5d300fb7f6f137a1a" Mar 16 17:15:10 crc kubenswrapper[5120]: I0316 17:15:10.327012 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 17:15:10 crc kubenswrapper[5120]: I0316 17:15:10.327124 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:15:10 crc kubenswrapper[5120]: I0316 17:15:10.329926 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-metadata-config-data\"" Mar 16 17:15:10 crc kubenswrapper[5120]: I0316 17:15:10.330096 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-metadata-internal-svc\"" Mar 16 17:15:10 crc kubenswrapper[5120]: I0316 17:15:10.334795 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 17:15:10 crc kubenswrapper[5120]: I0316 17:15:10.340486 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:15:10 crc kubenswrapper[5120]: I0316 17:15:10.342418 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-config-data\"" Mar 16 17:15:10 crc kubenswrapper[5120]: I0316 17:15:10.348842 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 17:15:10 crc kubenswrapper[5120]: I0316 17:15:10.418181 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a4da02b7-bd14-4361-8d8b-8ce59af4b98f-config-data\") pod \"nova-metadata-0\" (UID: \"a4da02b7-bd14-4361-8d8b-8ce59af4b98f\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:15:10 crc kubenswrapper[5120]: I0316 17:15:10.418514 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a4da02b7-bd14-4361-8d8b-8ce59af4b98f-logs\") pod \"nova-metadata-0\" (UID: \"a4da02b7-bd14-4361-8d8b-8ce59af4b98f\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:15:10 crc kubenswrapper[5120]: I0316 17:15:10.419430 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/a4da02b7-bd14-4361-8d8b-8ce59af4b98f-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"a4da02b7-bd14-4361-8d8b-8ce59af4b98f\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:15:10 crc kubenswrapper[5120]: I0316 17:15:10.419624 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2n2d4\" (UniqueName: \"kubernetes.io/projected/a4da02b7-bd14-4361-8d8b-8ce59af4b98f-kube-api-access-2n2d4\") pod \"nova-metadata-0\" (UID: \"a4da02b7-bd14-4361-8d8b-8ce59af4b98f\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:15:10 crc kubenswrapper[5120]: I0316 17:15:10.419910 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a4da02b7-bd14-4361-8d8b-8ce59af4b98f-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"a4da02b7-bd14-4361-8d8b-8ce59af4b98f\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:15:10 crc kubenswrapper[5120]: I0316 17:15:10.521889 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a4da02b7-bd14-4361-8d8b-8ce59af4b98f-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"a4da02b7-bd14-4361-8d8b-8ce59af4b98f\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:15:10 crc kubenswrapper[5120]: I0316 17:15:10.522003 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a4da02b7-bd14-4361-8d8b-8ce59af4b98f-config-data\") pod \"nova-metadata-0\" (UID: \"a4da02b7-bd14-4361-8d8b-8ce59af4b98f\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:15:10 crc kubenswrapper[5120]: I0316 17:15:10.522308 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/29395a19-e377-41f6-9c0e-73fbd34fe162-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"29395a19-e377-41f6-9c0e-73fbd34fe162\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:15:10 crc kubenswrapper[5120]: I0316 17:15:10.522426 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a4da02b7-bd14-4361-8d8b-8ce59af4b98f-logs\") pod \"nova-metadata-0\" (UID: \"a4da02b7-bd14-4361-8d8b-8ce59af4b98f\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:15:10 crc kubenswrapper[5120]: I0316 17:15:10.522597 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/29395a19-e377-41f6-9c0e-73fbd34fe162-logs\") pod \"nova-api-0\" (UID: \"29395a19-e377-41f6-9c0e-73fbd34fe162\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:15:10 crc kubenswrapper[5120]: I0316 17:15:10.522721 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9256b\" (UniqueName: \"kubernetes.io/projected/29395a19-e377-41f6-9c0e-73fbd34fe162-kube-api-access-9256b\") pod \"nova-api-0\" (UID: \"29395a19-e377-41f6-9c0e-73fbd34fe162\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:15:10 crc kubenswrapper[5120]: I0316 17:15:10.522860 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a4da02b7-bd14-4361-8d8b-8ce59af4b98f-logs\") pod \"nova-metadata-0\" (UID: \"a4da02b7-bd14-4361-8d8b-8ce59af4b98f\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:15:10 crc kubenswrapper[5120]: I0316 17:15:10.523031 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/a4da02b7-bd14-4361-8d8b-8ce59af4b98f-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"a4da02b7-bd14-4361-8d8b-8ce59af4b98f\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:15:10 crc kubenswrapper[5120]: I0316 17:15:10.523176 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2n2d4\" (UniqueName: \"kubernetes.io/projected/a4da02b7-bd14-4361-8d8b-8ce59af4b98f-kube-api-access-2n2d4\") pod \"nova-metadata-0\" (UID: \"a4da02b7-bd14-4361-8d8b-8ce59af4b98f\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:15:10 crc kubenswrapper[5120]: I0316 17:15:10.523532 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/29395a19-e377-41f6-9c0e-73fbd34fe162-config-data\") pod \"nova-api-0\" (UID: \"29395a19-e377-41f6-9c0e-73fbd34fe162\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:15:10 crc kubenswrapper[5120]: I0316 17:15:10.527004 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/a4da02b7-bd14-4361-8d8b-8ce59af4b98f-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"a4da02b7-bd14-4361-8d8b-8ce59af4b98f\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:15:10 crc kubenswrapper[5120]: I0316 17:15:10.527928 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a4da02b7-bd14-4361-8d8b-8ce59af4b98f-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"a4da02b7-bd14-4361-8d8b-8ce59af4b98f\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:15:10 crc kubenswrapper[5120]: I0316 17:15:10.539113 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a4da02b7-bd14-4361-8d8b-8ce59af4b98f-config-data\") pod \"nova-metadata-0\" (UID: \"a4da02b7-bd14-4361-8d8b-8ce59af4b98f\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:15:10 crc kubenswrapper[5120]: I0316 17:15:10.539249 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2n2d4\" (UniqueName: \"kubernetes.io/projected/a4da02b7-bd14-4361-8d8b-8ce59af4b98f-kube-api-access-2n2d4\") pod \"nova-metadata-0\" (UID: \"a4da02b7-bd14-4361-8d8b-8ce59af4b98f\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:15:10 crc kubenswrapper[5120]: I0316 17:15:10.627561 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/29395a19-e377-41f6-9c0e-73fbd34fe162-config-data\") pod \"nova-api-0\" (UID: \"29395a19-e377-41f6-9c0e-73fbd34fe162\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:15:10 crc kubenswrapper[5120]: I0316 17:15:10.628058 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/29395a19-e377-41f6-9c0e-73fbd34fe162-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"29395a19-e377-41f6-9c0e-73fbd34fe162\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:15:10 crc kubenswrapper[5120]: I0316 17:15:10.628178 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/29395a19-e377-41f6-9c0e-73fbd34fe162-logs\") pod \"nova-api-0\" (UID: \"29395a19-e377-41f6-9c0e-73fbd34fe162\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:15:10 crc kubenswrapper[5120]: I0316 17:15:10.628454 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9256b\" (UniqueName: \"kubernetes.io/projected/29395a19-e377-41f6-9c0e-73fbd34fe162-kube-api-access-9256b\") pod \"nova-api-0\" (UID: \"29395a19-e377-41f6-9c0e-73fbd34fe162\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:15:10 crc kubenswrapper[5120]: I0316 17:15:10.629163 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/29395a19-e377-41f6-9c0e-73fbd34fe162-logs\") pod \"nova-api-0\" (UID: \"29395a19-e377-41f6-9c0e-73fbd34fe162\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:15:10 crc kubenswrapper[5120]: I0316 17:15:10.632365 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/29395a19-e377-41f6-9c0e-73fbd34fe162-config-data\") pod \"nova-api-0\" (UID: \"29395a19-e377-41f6-9c0e-73fbd34fe162\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:15:10 crc kubenswrapper[5120]: I0316 17:15:10.634326 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/29395a19-e377-41f6-9c0e-73fbd34fe162-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"29395a19-e377-41f6-9c0e-73fbd34fe162\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:15:10 crc kubenswrapper[5120]: I0316 17:15:10.646957 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9256b\" (UniqueName: \"kubernetes.io/projected/29395a19-e377-41f6-9c0e-73fbd34fe162-kube-api-access-9256b\") pod \"nova-api-0\" (UID: \"29395a19-e377-41f6-9c0e-73fbd34fe162\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:15:10 crc kubenswrapper[5120]: I0316 17:15:10.651318 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:15:10 crc kubenswrapper[5120]: I0316 17:15:10.663727 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:15:10 crc kubenswrapper[5120]: I0316 17:15:10.676158 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="57c93f23-dca4-4b4a-8412-cc906209adb1" path="/var/lib/kubelet/pods/57c93f23-dca4-4b4a-8412-cc906209adb1/volumes" Mar 16 17:15:10 crc kubenswrapper[5120]: I0316 17:15:10.676957 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b787b31b-bfd4-4268-a8fe-9887e4822a9b" path="/var/lib/kubelet/pods/b787b31b-bfd4-4268-a8fe-9887e4822a9b/volumes" Mar 16 17:15:11 crc kubenswrapper[5120]: I0316 17:15:11.135796 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 17:15:11 crc kubenswrapper[5120]: W0316 17:15:11.135947 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda4da02b7_bd14_4361_8d8b_8ce59af4b98f.slice/crio-2259be5e91b4390824ca6a1aa745381143dcbd78c45f3ea85a126c1f3f7db402 WatchSource:0}: Error finding container 2259be5e91b4390824ca6a1aa745381143dcbd78c45f3ea85a126c1f3f7db402: Status 404 returned error can't find the container with id 2259be5e91b4390824ca6a1aa745381143dcbd78c45f3ea85a126c1f3f7db402 Mar 16 17:15:11 crc kubenswrapper[5120]: I0316 17:15:11.214255 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"a4da02b7-bd14-4361-8d8b-8ce59af4b98f","Type":"ContainerStarted","Data":"2259be5e91b4390824ca6a1aa745381143dcbd78c45f3ea85a126c1f3f7db402"} Mar 16 17:15:11 crc kubenswrapper[5120]: I0316 17:15:11.257501 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 17:15:12 crc kubenswrapper[5120]: I0316 17:15:12.228174 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"a4da02b7-bd14-4361-8d8b-8ce59af4b98f","Type":"ContainerStarted","Data":"26ef4b40f8193c41977c74a43e3fd7404ec128394d37e90386b4fb6dc48aca9c"} Mar 16 17:15:12 crc kubenswrapper[5120]: I0316 17:15:12.228471 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"a4da02b7-bd14-4361-8d8b-8ce59af4b98f","Type":"ContainerStarted","Data":"47d1400f22bea49c377ebdc347f760559c2ca6c9e62b29a34f95956285404b24"} Mar 16 17:15:12 crc kubenswrapper[5120]: I0316 17:15:12.232263 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"29395a19-e377-41f6-9c0e-73fbd34fe162","Type":"ContainerStarted","Data":"0ac081ebe89370edd198c46f9a1921397ede6ffd7b62de4a752221f77cb6bdeb"} Mar 16 17:15:12 crc kubenswrapper[5120]: I0316 17:15:12.232303 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"29395a19-e377-41f6-9c0e-73fbd34fe162","Type":"ContainerStarted","Data":"f969554745d77abe8b027f1edc92892167bbbc2b7001ab1cd739e958996aec7b"} Mar 16 17:15:12 crc kubenswrapper[5120]: I0316 17:15:12.232316 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"29395a19-e377-41f6-9c0e-73fbd34fe162","Type":"ContainerStarted","Data":"ab5961df25d0db6c47f73ff21f273776ae2196b9f010c5b9a9107e890b633963"} Mar 16 17:15:12 crc kubenswrapper[5120]: I0316 17:15:12.252523 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=2.252503104 podStartE2EDuration="2.252503104s" podCreationTimestamp="2026-03-16 17:15:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:15:12.243982721 +0000 UTC m=+6214.397914398" watchObservedRunningTime="2026-03-16 17:15:12.252503104 +0000 UTC m=+6214.406434761" Mar 16 17:15:12 crc kubenswrapper[5120]: I0316 17:15:12.264742 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=2.264722848 podStartE2EDuration="2.264722848s" podCreationTimestamp="2026-03-16 17:15:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:15:12.264704027 +0000 UTC m=+6214.418635684" watchObservedRunningTime="2026-03-16 17:15:12.264722848 +0000 UTC m=+6214.418654505" Mar 16 17:15:14 crc kubenswrapper[5120]: I0316 17:15:14.261003 5120 generic.go:358] "Generic (PLEG): container finished" podID="ea5aaac8-9646-4c80-8b0a-bafb1a03bd20" containerID="35ba2e32f1219544208d3844bf0654ef2effacbd5d493e238c7a99b1c6f328e3" exitCode=0 Mar 16 17:15:14 crc kubenswrapper[5120]: I0316 17:15:14.261108 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-8lvrl" event={"ID":"ea5aaac8-9646-4c80-8b0a-bafb1a03bd20","Type":"ContainerDied","Data":"35ba2e32f1219544208d3844bf0654ef2effacbd5d493e238c7a99b1c6f328e3"} Mar 16 17:15:15 crc kubenswrapper[5120]: I0316 17:15:15.626120 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-8lvrl" Mar 16 17:15:15 crc kubenswrapper[5120]: I0316 17:15:15.781013 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gwjm9\" (UniqueName: \"kubernetes.io/projected/ea5aaac8-9646-4c80-8b0a-bafb1a03bd20-kube-api-access-gwjm9\") pod \"ea5aaac8-9646-4c80-8b0a-bafb1a03bd20\" (UID: \"ea5aaac8-9646-4c80-8b0a-bafb1a03bd20\") " Mar 16 17:15:15 crc kubenswrapper[5120]: I0316 17:15:15.781361 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ea5aaac8-9646-4c80-8b0a-bafb1a03bd20-combined-ca-bundle\") pod \"ea5aaac8-9646-4c80-8b0a-bafb1a03bd20\" (UID: \"ea5aaac8-9646-4c80-8b0a-bafb1a03bd20\") " Mar 16 17:15:15 crc kubenswrapper[5120]: I0316 17:15:15.781395 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ea5aaac8-9646-4c80-8b0a-bafb1a03bd20-config-data\") pod \"ea5aaac8-9646-4c80-8b0a-bafb1a03bd20\" (UID: \"ea5aaac8-9646-4c80-8b0a-bafb1a03bd20\") " Mar 16 17:15:15 crc kubenswrapper[5120]: I0316 17:15:15.781723 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ea5aaac8-9646-4c80-8b0a-bafb1a03bd20-scripts\") pod \"ea5aaac8-9646-4c80-8b0a-bafb1a03bd20\" (UID: \"ea5aaac8-9646-4c80-8b0a-bafb1a03bd20\") " Mar 16 17:15:15 crc kubenswrapper[5120]: I0316 17:15:15.787580 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea5aaac8-9646-4c80-8b0a-bafb1a03bd20-scripts" (OuterVolumeSpecName: "scripts") pod "ea5aaac8-9646-4c80-8b0a-bafb1a03bd20" (UID: "ea5aaac8-9646-4c80-8b0a-bafb1a03bd20"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:15:15 crc kubenswrapper[5120]: I0316 17:15:15.788174 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea5aaac8-9646-4c80-8b0a-bafb1a03bd20-kube-api-access-gwjm9" (OuterVolumeSpecName: "kube-api-access-gwjm9") pod "ea5aaac8-9646-4c80-8b0a-bafb1a03bd20" (UID: "ea5aaac8-9646-4c80-8b0a-bafb1a03bd20"). InnerVolumeSpecName "kube-api-access-gwjm9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:15:15 crc kubenswrapper[5120]: I0316 17:15:15.808661 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea5aaac8-9646-4c80-8b0a-bafb1a03bd20-config-data" (OuterVolumeSpecName: "config-data") pod "ea5aaac8-9646-4c80-8b0a-bafb1a03bd20" (UID: "ea5aaac8-9646-4c80-8b0a-bafb1a03bd20"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:15:15 crc kubenswrapper[5120]: I0316 17:15:15.808872 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea5aaac8-9646-4c80-8b0a-bafb1a03bd20-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ea5aaac8-9646-4c80-8b0a-bafb1a03bd20" (UID: "ea5aaac8-9646-4c80-8b0a-bafb1a03bd20"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:15:15 crc kubenswrapper[5120]: I0316 17:15:15.887111 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gwjm9\" (UniqueName: \"kubernetes.io/projected/ea5aaac8-9646-4c80-8b0a-bafb1a03bd20-kube-api-access-gwjm9\") on node \"crc\" DevicePath \"\"" Mar 16 17:15:15 crc kubenswrapper[5120]: I0316 17:15:15.887171 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ea5aaac8-9646-4c80-8b0a-bafb1a03bd20-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:15:15 crc kubenswrapper[5120]: I0316 17:15:15.887187 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ea5aaac8-9646-4c80-8b0a-bafb1a03bd20-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:15:15 crc kubenswrapper[5120]: I0316 17:15:15.887200 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ea5aaac8-9646-4c80-8b0a-bafb1a03bd20-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:15:16 crc kubenswrapper[5120]: I0316 17:15:16.286788 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-8lvrl" Mar 16 17:15:16 crc kubenswrapper[5120]: I0316 17:15:16.286814 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-8lvrl" event={"ID":"ea5aaac8-9646-4c80-8b0a-bafb1a03bd20","Type":"ContainerDied","Data":"ec8fbb3f18e129b77caa76d26791554af7b23a7f1718319414ff3e64c7b0d60a"} Mar 16 17:15:16 crc kubenswrapper[5120]: I0316 17:15:16.286845 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ec8fbb3f18e129b77caa76d26791554af7b23a7f1718319414ff3e64c7b0d60a" Mar 16 17:15:16 crc kubenswrapper[5120]: I0316 17:15:16.392650 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 17:15:16 crc kubenswrapper[5120]: I0316 17:15:16.392918 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="29395a19-e377-41f6-9c0e-73fbd34fe162" containerName="nova-api-log" containerID="cri-o://f969554745d77abe8b027f1edc92892167bbbc2b7001ab1cd739e958996aec7b" gracePeriod=30 Mar 16 17:15:16 crc kubenswrapper[5120]: I0316 17:15:16.392996 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="29395a19-e377-41f6-9c0e-73fbd34fe162" containerName="nova-api-api" containerID="cri-o://0ac081ebe89370edd198c46f9a1921397ede6ffd7b62de4a752221f77cb6bdeb" gracePeriod=30 Mar 16 17:15:16 crc kubenswrapper[5120]: I0316 17:15:16.453748 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 17:15:16 crc kubenswrapper[5120]: I0316 17:15:16.453993 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="a4da02b7-bd14-4361-8d8b-8ce59af4b98f" containerName="nova-metadata-log" containerID="cri-o://47d1400f22bea49c377ebdc347f760559c2ca6c9e62b29a34f95956285404b24" gracePeriod=30 Mar 16 17:15:16 crc kubenswrapper[5120]: I0316 17:15:16.454414 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="a4da02b7-bd14-4361-8d8b-8ce59af4b98f" containerName="nova-metadata-metadata" containerID="cri-o://26ef4b40f8193c41977c74a43e3fd7404ec128394d37e90386b4fb6dc48aca9c" gracePeriod=30 Mar 16 17:15:16 crc kubenswrapper[5120]: I0316 17:15:16.987583 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:15:17 crc kubenswrapper[5120]: I0316 17:15:17.005307 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:15:17 crc kubenswrapper[5120]: I0316 17:15:17.028494 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/29395a19-e377-41f6-9c0e-73fbd34fe162-config-data\") pod \"29395a19-e377-41f6-9c0e-73fbd34fe162\" (UID: \"29395a19-e377-41f6-9c0e-73fbd34fe162\") " Mar 16 17:15:17 crc kubenswrapper[5120]: I0316 17:15:17.028620 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a4da02b7-bd14-4361-8d8b-8ce59af4b98f-logs\") pod \"a4da02b7-bd14-4361-8d8b-8ce59af4b98f\" (UID: \"a4da02b7-bd14-4361-8d8b-8ce59af4b98f\") " Mar 16 17:15:17 crc kubenswrapper[5120]: I0316 17:15:17.028931 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a4da02b7-bd14-4361-8d8b-8ce59af4b98f-combined-ca-bundle\") pod \"a4da02b7-bd14-4361-8d8b-8ce59af4b98f\" (UID: \"a4da02b7-bd14-4361-8d8b-8ce59af4b98f\") " Mar 16 17:15:17 crc kubenswrapper[5120]: I0316 17:15:17.028970 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a4da02b7-bd14-4361-8d8b-8ce59af4b98f-config-data\") pod \"a4da02b7-bd14-4361-8d8b-8ce59af4b98f\" (UID: \"a4da02b7-bd14-4361-8d8b-8ce59af4b98f\") " Mar 16 17:15:17 crc kubenswrapper[5120]: I0316 17:15:17.028990 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9256b\" (UniqueName: \"kubernetes.io/projected/29395a19-e377-41f6-9c0e-73fbd34fe162-kube-api-access-9256b\") pod \"29395a19-e377-41f6-9c0e-73fbd34fe162\" (UID: \"29395a19-e377-41f6-9c0e-73fbd34fe162\") " Mar 16 17:15:17 crc kubenswrapper[5120]: I0316 17:15:17.029022 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/29395a19-e377-41f6-9c0e-73fbd34fe162-combined-ca-bundle\") pod \"29395a19-e377-41f6-9c0e-73fbd34fe162\" (UID: \"29395a19-e377-41f6-9c0e-73fbd34fe162\") " Mar 16 17:15:17 crc kubenswrapper[5120]: I0316 17:15:17.029058 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/29395a19-e377-41f6-9c0e-73fbd34fe162-logs\") pod \"29395a19-e377-41f6-9c0e-73fbd34fe162\" (UID: \"29395a19-e377-41f6-9c0e-73fbd34fe162\") " Mar 16 17:15:17 crc kubenswrapper[5120]: I0316 17:15:17.029168 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2n2d4\" (UniqueName: \"kubernetes.io/projected/a4da02b7-bd14-4361-8d8b-8ce59af4b98f-kube-api-access-2n2d4\") pod \"a4da02b7-bd14-4361-8d8b-8ce59af4b98f\" (UID: \"a4da02b7-bd14-4361-8d8b-8ce59af4b98f\") " Mar 16 17:15:17 crc kubenswrapper[5120]: I0316 17:15:17.029327 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/a4da02b7-bd14-4361-8d8b-8ce59af4b98f-nova-metadata-tls-certs\") pod \"a4da02b7-bd14-4361-8d8b-8ce59af4b98f\" (UID: \"a4da02b7-bd14-4361-8d8b-8ce59af4b98f\") " Mar 16 17:15:17 crc kubenswrapper[5120]: I0316 17:15:17.030653 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a4da02b7-bd14-4361-8d8b-8ce59af4b98f-logs" (OuterVolumeSpecName: "logs") pod "a4da02b7-bd14-4361-8d8b-8ce59af4b98f" (UID: "a4da02b7-bd14-4361-8d8b-8ce59af4b98f"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:15:17 crc kubenswrapper[5120]: I0316 17:15:17.031952 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29395a19-e377-41f6-9c0e-73fbd34fe162-logs" (OuterVolumeSpecName: "logs") pod "29395a19-e377-41f6-9c0e-73fbd34fe162" (UID: "29395a19-e377-41f6-9c0e-73fbd34fe162"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:15:17 crc kubenswrapper[5120]: I0316 17:15:17.038520 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29395a19-e377-41f6-9c0e-73fbd34fe162-kube-api-access-9256b" (OuterVolumeSpecName: "kube-api-access-9256b") pod "29395a19-e377-41f6-9c0e-73fbd34fe162" (UID: "29395a19-e377-41f6-9c0e-73fbd34fe162"). InnerVolumeSpecName "kube-api-access-9256b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:15:17 crc kubenswrapper[5120]: I0316 17:15:17.045900 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a4da02b7-bd14-4361-8d8b-8ce59af4b98f-kube-api-access-2n2d4" (OuterVolumeSpecName: "kube-api-access-2n2d4") pod "a4da02b7-bd14-4361-8d8b-8ce59af4b98f" (UID: "a4da02b7-bd14-4361-8d8b-8ce59af4b98f"). InnerVolumeSpecName "kube-api-access-2n2d4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:15:17 crc kubenswrapper[5120]: I0316 17:15:17.060173 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a4da02b7-bd14-4361-8d8b-8ce59af4b98f-config-data" (OuterVolumeSpecName: "config-data") pod "a4da02b7-bd14-4361-8d8b-8ce59af4b98f" (UID: "a4da02b7-bd14-4361-8d8b-8ce59af4b98f"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:15:17 crc kubenswrapper[5120]: I0316 17:15:17.065003 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/29395a19-e377-41f6-9c0e-73fbd34fe162-config-data" (OuterVolumeSpecName: "config-data") pod "29395a19-e377-41f6-9c0e-73fbd34fe162" (UID: "29395a19-e377-41f6-9c0e-73fbd34fe162"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:15:17 crc kubenswrapper[5120]: I0316 17:15:17.068982 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a4da02b7-bd14-4361-8d8b-8ce59af4b98f-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "a4da02b7-bd14-4361-8d8b-8ce59af4b98f" (UID: "a4da02b7-bd14-4361-8d8b-8ce59af4b98f"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:15:17 crc kubenswrapper[5120]: I0316 17:15:17.080672 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/29395a19-e377-41f6-9c0e-73fbd34fe162-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "29395a19-e377-41f6-9c0e-73fbd34fe162" (UID: "29395a19-e377-41f6-9c0e-73fbd34fe162"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:15:17 crc kubenswrapper[5120]: I0316 17:15:17.091815 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a4da02b7-bd14-4361-8d8b-8ce59af4b98f-nova-metadata-tls-certs" (OuterVolumeSpecName: "nova-metadata-tls-certs") pod "a4da02b7-bd14-4361-8d8b-8ce59af4b98f" (UID: "a4da02b7-bd14-4361-8d8b-8ce59af4b98f"). InnerVolumeSpecName "nova-metadata-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:15:17 crc kubenswrapper[5120]: I0316 17:15:17.132475 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a4da02b7-bd14-4361-8d8b-8ce59af4b98f-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:15:17 crc kubenswrapper[5120]: I0316 17:15:17.132509 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a4da02b7-bd14-4361-8d8b-8ce59af4b98f-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:15:17 crc kubenswrapper[5120]: I0316 17:15:17.132520 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9256b\" (UniqueName: \"kubernetes.io/projected/29395a19-e377-41f6-9c0e-73fbd34fe162-kube-api-access-9256b\") on node \"crc\" DevicePath \"\"" Mar 16 17:15:17 crc kubenswrapper[5120]: I0316 17:15:17.132530 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/29395a19-e377-41f6-9c0e-73fbd34fe162-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:15:17 crc kubenswrapper[5120]: I0316 17:15:17.132539 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/29395a19-e377-41f6-9c0e-73fbd34fe162-logs\") on node \"crc\" DevicePath \"\"" Mar 16 17:15:17 crc kubenswrapper[5120]: I0316 17:15:17.132549 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2n2d4\" (UniqueName: \"kubernetes.io/projected/a4da02b7-bd14-4361-8d8b-8ce59af4b98f-kube-api-access-2n2d4\") on node \"crc\" DevicePath \"\"" Mar 16 17:15:17 crc kubenswrapper[5120]: I0316 17:15:17.132558 5120 reconciler_common.go:299] "Volume detached for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/a4da02b7-bd14-4361-8d8b-8ce59af4b98f-nova-metadata-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:15:17 crc kubenswrapper[5120]: I0316 17:15:17.132566 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/29395a19-e377-41f6-9c0e-73fbd34fe162-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:15:17 crc kubenswrapper[5120]: I0316 17:15:17.132577 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a4da02b7-bd14-4361-8d8b-8ce59af4b98f-logs\") on node \"crc\" DevicePath \"\"" Mar 16 17:15:17 crc kubenswrapper[5120]: I0316 17:15:17.300990 5120 generic.go:358] "Generic (PLEG): container finished" podID="a4da02b7-bd14-4361-8d8b-8ce59af4b98f" containerID="26ef4b40f8193c41977c74a43e3fd7404ec128394d37e90386b4fb6dc48aca9c" exitCode=0 Mar 16 17:15:17 crc kubenswrapper[5120]: I0316 17:15:17.301366 5120 generic.go:358] "Generic (PLEG): container finished" podID="a4da02b7-bd14-4361-8d8b-8ce59af4b98f" containerID="47d1400f22bea49c377ebdc347f760559c2ca6c9e62b29a34f95956285404b24" exitCode=143 Mar 16 17:15:17 crc kubenswrapper[5120]: I0316 17:15:17.301038 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"a4da02b7-bd14-4361-8d8b-8ce59af4b98f","Type":"ContainerDied","Data":"26ef4b40f8193c41977c74a43e3fd7404ec128394d37e90386b4fb6dc48aca9c"} Mar 16 17:15:17 crc kubenswrapper[5120]: I0316 17:15:17.301439 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"a4da02b7-bd14-4361-8d8b-8ce59af4b98f","Type":"ContainerDied","Data":"47d1400f22bea49c377ebdc347f760559c2ca6c9e62b29a34f95956285404b24"} Mar 16 17:15:17 crc kubenswrapper[5120]: I0316 17:15:17.301468 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"a4da02b7-bd14-4361-8d8b-8ce59af4b98f","Type":"ContainerDied","Data":"2259be5e91b4390824ca6a1aa745381143dcbd78c45f3ea85a126c1f3f7db402"} Mar 16 17:15:17 crc kubenswrapper[5120]: I0316 17:15:17.301498 5120 scope.go:117] "RemoveContainer" containerID="26ef4b40f8193c41977c74a43e3fd7404ec128394d37e90386b4fb6dc48aca9c" Mar 16 17:15:17 crc kubenswrapper[5120]: I0316 17:15:17.301089 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:15:17 crc kubenswrapper[5120]: I0316 17:15:17.305665 5120 generic.go:358] "Generic (PLEG): container finished" podID="29395a19-e377-41f6-9c0e-73fbd34fe162" containerID="0ac081ebe89370edd198c46f9a1921397ede6ffd7b62de4a752221f77cb6bdeb" exitCode=0 Mar 16 17:15:17 crc kubenswrapper[5120]: I0316 17:15:17.305683 5120 generic.go:358] "Generic (PLEG): container finished" podID="29395a19-e377-41f6-9c0e-73fbd34fe162" containerID="f969554745d77abe8b027f1edc92892167bbbc2b7001ab1cd739e958996aec7b" exitCode=143 Mar 16 17:15:17 crc kubenswrapper[5120]: I0316 17:15:17.305718 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"29395a19-e377-41f6-9c0e-73fbd34fe162","Type":"ContainerDied","Data":"0ac081ebe89370edd198c46f9a1921397ede6ffd7b62de4a752221f77cb6bdeb"} Mar 16 17:15:17 crc kubenswrapper[5120]: I0316 17:15:17.305744 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"29395a19-e377-41f6-9c0e-73fbd34fe162","Type":"ContainerDied","Data":"f969554745d77abe8b027f1edc92892167bbbc2b7001ab1cd739e958996aec7b"} Mar 16 17:15:17 crc kubenswrapper[5120]: I0316 17:15:17.305774 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"29395a19-e377-41f6-9c0e-73fbd34fe162","Type":"ContainerDied","Data":"ab5961df25d0db6c47f73ff21f273776ae2196b9f010c5b9a9107e890b633963"} Mar 16 17:15:17 crc kubenswrapper[5120]: I0316 17:15:17.305743 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:15:17 crc kubenswrapper[5120]: I0316 17:15:17.335448 5120 scope.go:117] "RemoveContainer" containerID="47d1400f22bea49c377ebdc347f760559c2ca6c9e62b29a34f95956285404b24" Mar 16 17:15:17 crc kubenswrapper[5120]: I0316 17:15:17.341400 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 17:15:17 crc kubenswrapper[5120]: I0316 17:15:17.358398 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 17:15:17 crc kubenswrapper[5120]: I0316 17:15:17.363589 5120 scope.go:117] "RemoveContainer" containerID="26ef4b40f8193c41977c74a43e3fd7404ec128394d37e90386b4fb6dc48aca9c" Mar 16 17:15:17 crc kubenswrapper[5120]: E0316 17:15:17.364884 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"26ef4b40f8193c41977c74a43e3fd7404ec128394d37e90386b4fb6dc48aca9c\": container with ID starting with 26ef4b40f8193c41977c74a43e3fd7404ec128394d37e90386b4fb6dc48aca9c not found: ID does not exist" containerID="26ef4b40f8193c41977c74a43e3fd7404ec128394d37e90386b4fb6dc48aca9c" Mar 16 17:15:17 crc kubenswrapper[5120]: I0316 17:15:17.364930 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26ef4b40f8193c41977c74a43e3fd7404ec128394d37e90386b4fb6dc48aca9c"} err="failed to get container status \"26ef4b40f8193c41977c74a43e3fd7404ec128394d37e90386b4fb6dc48aca9c\": rpc error: code = NotFound desc = could not find container \"26ef4b40f8193c41977c74a43e3fd7404ec128394d37e90386b4fb6dc48aca9c\": container with ID starting with 26ef4b40f8193c41977c74a43e3fd7404ec128394d37e90386b4fb6dc48aca9c not found: ID does not exist" Mar 16 17:15:17 crc kubenswrapper[5120]: I0316 17:15:17.364960 5120 scope.go:117] "RemoveContainer" containerID="47d1400f22bea49c377ebdc347f760559c2ca6c9e62b29a34f95956285404b24" Mar 16 17:15:17 crc kubenswrapper[5120]: E0316 17:15:17.365421 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"47d1400f22bea49c377ebdc347f760559c2ca6c9e62b29a34f95956285404b24\": container with ID starting with 47d1400f22bea49c377ebdc347f760559c2ca6c9e62b29a34f95956285404b24 not found: ID does not exist" containerID="47d1400f22bea49c377ebdc347f760559c2ca6c9e62b29a34f95956285404b24" Mar 16 17:15:17 crc kubenswrapper[5120]: I0316 17:15:17.365463 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47d1400f22bea49c377ebdc347f760559c2ca6c9e62b29a34f95956285404b24"} err="failed to get container status \"47d1400f22bea49c377ebdc347f760559c2ca6c9e62b29a34f95956285404b24\": rpc error: code = NotFound desc = could not find container \"47d1400f22bea49c377ebdc347f760559c2ca6c9e62b29a34f95956285404b24\": container with ID starting with 47d1400f22bea49c377ebdc347f760559c2ca6c9e62b29a34f95956285404b24 not found: ID does not exist" Mar 16 17:15:17 crc kubenswrapper[5120]: I0316 17:15:17.365490 5120 scope.go:117] "RemoveContainer" containerID="26ef4b40f8193c41977c74a43e3fd7404ec128394d37e90386b4fb6dc48aca9c" Mar 16 17:15:17 crc kubenswrapper[5120]: I0316 17:15:17.365828 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26ef4b40f8193c41977c74a43e3fd7404ec128394d37e90386b4fb6dc48aca9c"} err="failed to get container status \"26ef4b40f8193c41977c74a43e3fd7404ec128394d37e90386b4fb6dc48aca9c\": rpc error: code = NotFound desc = could not find container \"26ef4b40f8193c41977c74a43e3fd7404ec128394d37e90386b4fb6dc48aca9c\": container with ID starting with 26ef4b40f8193c41977c74a43e3fd7404ec128394d37e90386b4fb6dc48aca9c not found: ID does not exist" Mar 16 17:15:17 crc kubenswrapper[5120]: I0316 17:15:17.365860 5120 scope.go:117] "RemoveContainer" containerID="47d1400f22bea49c377ebdc347f760559c2ca6c9e62b29a34f95956285404b24" Mar 16 17:15:17 crc kubenswrapper[5120]: I0316 17:15:17.366295 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47d1400f22bea49c377ebdc347f760559c2ca6c9e62b29a34f95956285404b24"} err="failed to get container status \"47d1400f22bea49c377ebdc347f760559c2ca6c9e62b29a34f95956285404b24\": rpc error: code = NotFound desc = could not find container \"47d1400f22bea49c377ebdc347f760559c2ca6c9e62b29a34f95956285404b24\": container with ID starting with 47d1400f22bea49c377ebdc347f760559c2ca6c9e62b29a34f95956285404b24 not found: ID does not exist" Mar 16 17:15:17 crc kubenswrapper[5120]: I0316 17:15:17.366316 5120 scope.go:117] "RemoveContainer" containerID="0ac081ebe89370edd198c46f9a1921397ede6ffd7b62de4a752221f77cb6bdeb" Mar 16 17:15:17 crc kubenswrapper[5120]: I0316 17:15:17.378944 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 17:15:17 crc kubenswrapper[5120]: I0316 17:15:17.393351 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 17:15:17 crc kubenswrapper[5120]: I0316 17:15:17.405014 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 17:15:17 crc kubenswrapper[5120]: I0316 17:15:17.406228 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4da02b7-bd14-4361-8d8b-8ce59af4b98f" containerName="nova-metadata-log" Mar 16 17:15:17 crc kubenswrapper[5120]: I0316 17:15:17.406251 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4da02b7-bd14-4361-8d8b-8ce59af4b98f" containerName="nova-metadata-log" Mar 16 17:15:17 crc kubenswrapper[5120]: I0316 17:15:17.406274 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29395a19-e377-41f6-9c0e-73fbd34fe162" containerName="nova-api-log" Mar 16 17:15:17 crc kubenswrapper[5120]: I0316 17:15:17.406282 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="29395a19-e377-41f6-9c0e-73fbd34fe162" containerName="nova-api-log" Mar 16 17:15:17 crc kubenswrapper[5120]: I0316 17:15:17.406310 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4da02b7-bd14-4361-8d8b-8ce59af4b98f" containerName="nova-metadata-metadata" Mar 16 17:15:17 crc kubenswrapper[5120]: I0316 17:15:17.406316 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4da02b7-bd14-4361-8d8b-8ce59af4b98f" containerName="nova-metadata-metadata" Mar 16 17:15:17 crc kubenswrapper[5120]: I0316 17:15:17.406333 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea5aaac8-9646-4c80-8b0a-bafb1a03bd20" containerName="nova-manage" Mar 16 17:15:17 crc kubenswrapper[5120]: I0316 17:15:17.406339 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea5aaac8-9646-4c80-8b0a-bafb1a03bd20" containerName="nova-manage" Mar 16 17:15:17 crc kubenswrapper[5120]: I0316 17:15:17.406377 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29395a19-e377-41f6-9c0e-73fbd34fe162" containerName="nova-api-api" Mar 16 17:15:17 crc kubenswrapper[5120]: I0316 17:15:17.406382 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="29395a19-e377-41f6-9c0e-73fbd34fe162" containerName="nova-api-api" Mar 16 17:15:17 crc kubenswrapper[5120]: I0316 17:15:17.406552 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="a4da02b7-bd14-4361-8d8b-8ce59af4b98f" containerName="nova-metadata-log" Mar 16 17:15:17 crc kubenswrapper[5120]: I0316 17:15:17.406565 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ea5aaac8-9646-4c80-8b0a-bafb1a03bd20" containerName="nova-manage" Mar 16 17:15:17 crc kubenswrapper[5120]: I0316 17:15:17.406585 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="29395a19-e377-41f6-9c0e-73fbd34fe162" containerName="nova-api-api" Mar 16 17:15:17 crc kubenswrapper[5120]: I0316 17:15:17.406594 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="29395a19-e377-41f6-9c0e-73fbd34fe162" containerName="nova-api-log" Mar 16 17:15:17 crc kubenswrapper[5120]: I0316 17:15:17.406608 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="a4da02b7-bd14-4361-8d8b-8ce59af4b98f" containerName="nova-metadata-metadata" Mar 16 17:15:17 crc kubenswrapper[5120]: I0316 17:15:17.420532 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 17:15:17 crc kubenswrapper[5120]: I0316 17:15:17.420724 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:15:17 crc kubenswrapper[5120]: I0316 17:15:17.423318 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-config-data\"" Mar 16 17:15:17 crc kubenswrapper[5120]: I0316 17:15:17.426717 5120 scope.go:117] "RemoveContainer" containerID="f969554745d77abe8b027f1edc92892167bbbc2b7001ab1cd739e958996aec7b" Mar 16 17:15:17 crc kubenswrapper[5120]: I0316 17:15:17.429004 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 17:15:17 crc kubenswrapper[5120]: I0316 17:15:17.429122 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:15:17 crc kubenswrapper[5120]: I0316 17:15:17.432558 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-metadata-internal-svc\"" Mar 16 17:15:17 crc kubenswrapper[5120]: I0316 17:15:17.432868 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-metadata-config-data\"" Mar 16 17:15:17 crc kubenswrapper[5120]: I0316 17:15:17.441605 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 17:15:17 crc kubenswrapper[5120]: I0316 17:15:17.442549 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/a9215705-d766-4151-b079-62d304603586-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"a9215705-d766-4151-b079-62d304603586\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:15:17 crc kubenswrapper[5120]: I0316 17:15:17.442617 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a9215705-d766-4151-b079-62d304603586-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"a9215705-d766-4151-b079-62d304603586\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:15:17 crc kubenswrapper[5120]: I0316 17:15:17.442898 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a9215705-d766-4151-b079-62d304603586-logs\") pod \"nova-metadata-0\" (UID: \"a9215705-d766-4151-b079-62d304603586\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:15:17 crc kubenswrapper[5120]: I0316 17:15:17.442976 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdlkq\" (UniqueName: \"kubernetes.io/projected/a9215705-d766-4151-b079-62d304603586-kube-api-access-gdlkq\") pod \"nova-metadata-0\" (UID: \"a9215705-d766-4151-b079-62d304603586\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:15:17 crc kubenswrapper[5120]: I0316 17:15:17.443189 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/03022ddd-dd32-4310-9a94-fc349f3d905e-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"03022ddd-dd32-4310-9a94-fc349f3d905e\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:15:17 crc kubenswrapper[5120]: I0316 17:15:17.443273 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/03022ddd-dd32-4310-9a94-fc349f3d905e-logs\") pod \"nova-api-0\" (UID: \"03022ddd-dd32-4310-9a94-fc349f3d905e\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:15:17 crc kubenswrapper[5120]: I0316 17:15:17.443360 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a9215705-d766-4151-b079-62d304603586-config-data\") pod \"nova-metadata-0\" (UID: \"a9215705-d766-4151-b079-62d304603586\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:15:17 crc kubenswrapper[5120]: I0316 17:15:17.443484 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qpcr\" (UniqueName: \"kubernetes.io/projected/03022ddd-dd32-4310-9a94-fc349f3d905e-kube-api-access-2qpcr\") pod \"nova-api-0\" (UID: \"03022ddd-dd32-4310-9a94-fc349f3d905e\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:15:17 crc kubenswrapper[5120]: I0316 17:15:17.443542 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/03022ddd-dd32-4310-9a94-fc349f3d905e-config-data\") pod \"nova-api-0\" (UID: \"03022ddd-dd32-4310-9a94-fc349f3d905e\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:15:17 crc kubenswrapper[5120]: I0316 17:15:17.455996 5120 scope.go:117] "RemoveContainer" containerID="0ac081ebe89370edd198c46f9a1921397ede6ffd7b62de4a752221f77cb6bdeb" Mar 16 17:15:17 crc kubenswrapper[5120]: E0316 17:15:17.456534 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0ac081ebe89370edd198c46f9a1921397ede6ffd7b62de4a752221f77cb6bdeb\": container with ID starting with 0ac081ebe89370edd198c46f9a1921397ede6ffd7b62de4a752221f77cb6bdeb not found: ID does not exist" containerID="0ac081ebe89370edd198c46f9a1921397ede6ffd7b62de4a752221f77cb6bdeb" Mar 16 17:15:17 crc kubenswrapper[5120]: I0316 17:15:17.456705 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ac081ebe89370edd198c46f9a1921397ede6ffd7b62de4a752221f77cb6bdeb"} err="failed to get container status \"0ac081ebe89370edd198c46f9a1921397ede6ffd7b62de4a752221f77cb6bdeb\": rpc error: code = NotFound desc = could not find container \"0ac081ebe89370edd198c46f9a1921397ede6ffd7b62de4a752221f77cb6bdeb\": container with ID starting with 0ac081ebe89370edd198c46f9a1921397ede6ffd7b62de4a752221f77cb6bdeb not found: ID does not exist" Mar 16 17:15:17 crc kubenswrapper[5120]: I0316 17:15:17.456869 5120 scope.go:117] "RemoveContainer" containerID="f969554745d77abe8b027f1edc92892167bbbc2b7001ab1cd739e958996aec7b" Mar 16 17:15:17 crc kubenswrapper[5120]: E0316 17:15:17.457343 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f969554745d77abe8b027f1edc92892167bbbc2b7001ab1cd739e958996aec7b\": container with ID starting with f969554745d77abe8b027f1edc92892167bbbc2b7001ab1cd739e958996aec7b not found: ID does not exist" containerID="f969554745d77abe8b027f1edc92892167bbbc2b7001ab1cd739e958996aec7b" Mar 16 17:15:17 crc kubenswrapper[5120]: I0316 17:15:17.457363 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f969554745d77abe8b027f1edc92892167bbbc2b7001ab1cd739e958996aec7b"} err="failed to get container status \"f969554745d77abe8b027f1edc92892167bbbc2b7001ab1cd739e958996aec7b\": rpc error: code = NotFound desc = could not find container \"f969554745d77abe8b027f1edc92892167bbbc2b7001ab1cd739e958996aec7b\": container with ID starting with f969554745d77abe8b027f1edc92892167bbbc2b7001ab1cd739e958996aec7b not found: ID does not exist" Mar 16 17:15:17 crc kubenswrapper[5120]: I0316 17:15:17.457377 5120 scope.go:117] "RemoveContainer" containerID="0ac081ebe89370edd198c46f9a1921397ede6ffd7b62de4a752221f77cb6bdeb" Mar 16 17:15:17 crc kubenswrapper[5120]: I0316 17:15:17.457731 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ac081ebe89370edd198c46f9a1921397ede6ffd7b62de4a752221f77cb6bdeb"} err="failed to get container status \"0ac081ebe89370edd198c46f9a1921397ede6ffd7b62de4a752221f77cb6bdeb\": rpc error: code = NotFound desc = could not find container \"0ac081ebe89370edd198c46f9a1921397ede6ffd7b62de4a752221f77cb6bdeb\": container with ID starting with 0ac081ebe89370edd198c46f9a1921397ede6ffd7b62de4a752221f77cb6bdeb not found: ID does not exist" Mar 16 17:15:17 crc kubenswrapper[5120]: I0316 17:15:17.457786 5120 scope.go:117] "RemoveContainer" containerID="f969554745d77abe8b027f1edc92892167bbbc2b7001ab1cd739e958996aec7b" Mar 16 17:15:17 crc kubenswrapper[5120]: I0316 17:15:17.459474 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f969554745d77abe8b027f1edc92892167bbbc2b7001ab1cd739e958996aec7b"} err="failed to get container status \"f969554745d77abe8b027f1edc92892167bbbc2b7001ab1cd739e958996aec7b\": rpc error: code = NotFound desc = could not find container \"f969554745d77abe8b027f1edc92892167bbbc2b7001ab1cd739e958996aec7b\": container with ID starting with f969554745d77abe8b027f1edc92892167bbbc2b7001ab1cd739e958996aec7b not found: ID does not exist" Mar 16 17:15:17 crc kubenswrapper[5120]: I0316 17:15:17.545746 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2qpcr\" (UniqueName: \"kubernetes.io/projected/03022ddd-dd32-4310-9a94-fc349f3d905e-kube-api-access-2qpcr\") pod \"nova-api-0\" (UID: \"03022ddd-dd32-4310-9a94-fc349f3d905e\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:15:17 crc kubenswrapper[5120]: I0316 17:15:17.545841 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/03022ddd-dd32-4310-9a94-fc349f3d905e-config-data\") pod \"nova-api-0\" (UID: \"03022ddd-dd32-4310-9a94-fc349f3d905e\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:15:17 crc kubenswrapper[5120]: I0316 17:15:17.546024 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/a9215705-d766-4151-b079-62d304603586-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"a9215705-d766-4151-b079-62d304603586\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:15:17 crc kubenswrapper[5120]: I0316 17:15:17.546079 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a9215705-d766-4151-b079-62d304603586-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"a9215705-d766-4151-b079-62d304603586\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:15:17 crc kubenswrapper[5120]: I0316 17:15:17.546172 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a9215705-d766-4151-b079-62d304603586-logs\") pod \"nova-metadata-0\" (UID: \"a9215705-d766-4151-b079-62d304603586\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:15:17 crc kubenswrapper[5120]: I0316 17:15:17.546206 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gdlkq\" (UniqueName: \"kubernetes.io/projected/a9215705-d766-4151-b079-62d304603586-kube-api-access-gdlkq\") pod \"nova-metadata-0\" (UID: \"a9215705-d766-4151-b079-62d304603586\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:15:17 crc kubenswrapper[5120]: I0316 17:15:17.546308 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/03022ddd-dd32-4310-9a94-fc349f3d905e-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"03022ddd-dd32-4310-9a94-fc349f3d905e\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:15:17 crc kubenswrapper[5120]: I0316 17:15:17.546353 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/03022ddd-dd32-4310-9a94-fc349f3d905e-logs\") pod \"nova-api-0\" (UID: \"03022ddd-dd32-4310-9a94-fc349f3d905e\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:15:17 crc kubenswrapper[5120]: I0316 17:15:17.546411 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a9215705-d766-4151-b079-62d304603586-config-data\") pod \"nova-metadata-0\" (UID: \"a9215705-d766-4151-b079-62d304603586\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:15:17 crc kubenswrapper[5120]: I0316 17:15:17.547030 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/03022ddd-dd32-4310-9a94-fc349f3d905e-logs\") pod \"nova-api-0\" (UID: \"03022ddd-dd32-4310-9a94-fc349f3d905e\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:15:17 crc kubenswrapper[5120]: I0316 17:15:17.547244 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a9215705-d766-4151-b079-62d304603586-logs\") pod \"nova-metadata-0\" (UID: \"a9215705-d766-4151-b079-62d304603586\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:15:17 crc kubenswrapper[5120]: I0316 17:15:17.551621 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/03022ddd-dd32-4310-9a94-fc349f3d905e-config-data\") pod \"nova-api-0\" (UID: \"03022ddd-dd32-4310-9a94-fc349f3d905e\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:15:17 crc kubenswrapper[5120]: I0316 17:15:17.551701 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a9215705-d766-4151-b079-62d304603586-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"a9215705-d766-4151-b079-62d304603586\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:15:17 crc kubenswrapper[5120]: I0316 17:15:17.552585 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/a9215705-d766-4151-b079-62d304603586-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"a9215705-d766-4151-b079-62d304603586\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:15:17 crc kubenswrapper[5120]: I0316 17:15:17.552965 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/03022ddd-dd32-4310-9a94-fc349f3d905e-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"03022ddd-dd32-4310-9a94-fc349f3d905e\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:15:17 crc kubenswrapper[5120]: I0316 17:15:17.554001 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a9215705-d766-4151-b079-62d304603586-config-data\") pod \"nova-metadata-0\" (UID: \"a9215705-d766-4151-b079-62d304603586\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:15:17 crc kubenswrapper[5120]: I0316 17:15:17.564686 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdlkq\" (UniqueName: \"kubernetes.io/projected/a9215705-d766-4151-b079-62d304603586-kube-api-access-gdlkq\") pod \"nova-metadata-0\" (UID: \"a9215705-d766-4151-b079-62d304603586\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:15:17 crc kubenswrapper[5120]: I0316 17:15:17.564916 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qpcr\" (UniqueName: \"kubernetes.io/projected/03022ddd-dd32-4310-9a94-fc349f3d905e-kube-api-access-2qpcr\") pod \"nova-api-0\" (UID: \"03022ddd-dd32-4310-9a94-fc349f3d905e\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:15:17 crc kubenswrapper[5120]: I0316 17:15:17.751344 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:15:17 crc kubenswrapper[5120]: I0316 17:15:17.753604 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:15:18 crc kubenswrapper[5120]: I0316 17:15:18.226717 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 17:15:18 crc kubenswrapper[5120]: I0316 17:15:18.287630 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 17:15:18 crc kubenswrapper[5120]: W0316 17:15:18.292123 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda9215705_d766_4151_b079_62d304603586.slice/crio-5b88f643d4f23c9eee2a366e90d7289a352aa7fe708ab675919c2875188433c8 WatchSource:0}: Error finding container 5b88f643d4f23c9eee2a366e90d7289a352aa7fe708ab675919c2875188433c8: Status 404 returned error can't find the container with id 5b88f643d4f23c9eee2a366e90d7289a352aa7fe708ab675919c2875188433c8 Mar 16 17:15:18 crc kubenswrapper[5120]: I0316 17:15:18.322331 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"a9215705-d766-4151-b079-62d304603586","Type":"ContainerStarted","Data":"5b88f643d4f23c9eee2a366e90d7289a352aa7fe708ab675919c2875188433c8"} Mar 16 17:15:18 crc kubenswrapper[5120]: I0316 17:15:18.328901 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"03022ddd-dd32-4310-9a94-fc349f3d905e","Type":"ContainerStarted","Data":"0549bd6a3b3540ad281b8702d0b0df2f0446b9146fbe5ffad1e157c59376e22d"} Mar 16 17:15:18 crc kubenswrapper[5120]: I0316 17:15:18.683612 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="29395a19-e377-41f6-9c0e-73fbd34fe162" path="/var/lib/kubelet/pods/29395a19-e377-41f6-9c0e-73fbd34fe162/volumes" Mar 16 17:15:18 crc kubenswrapper[5120]: I0316 17:15:18.684611 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a4da02b7-bd14-4361-8d8b-8ce59af4b98f" path="/var/lib/kubelet/pods/a4da02b7-bd14-4361-8d8b-8ce59af4b98f/volumes" Mar 16 17:15:19 crc kubenswrapper[5120]: I0316 17:15:19.340447 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"a9215705-d766-4151-b079-62d304603586","Type":"ContainerStarted","Data":"e3755f35f9a681410c6077b20fb86fa8d207825ea9e789bf539fe7e07f0d9847"} Mar 16 17:15:19 crc kubenswrapper[5120]: I0316 17:15:19.340512 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"a9215705-d766-4151-b079-62d304603586","Type":"ContainerStarted","Data":"8f0a5cfda44fa0469d5667988c40b5fa21d4bc25c03c32374a9002107e112cf6"} Mar 16 17:15:19 crc kubenswrapper[5120]: I0316 17:15:19.343797 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"03022ddd-dd32-4310-9a94-fc349f3d905e","Type":"ContainerStarted","Data":"1bcaf644fb6657a97c0fc39fd9a4ef4847b196211944f8358de9a1707620c0c9"} Mar 16 17:15:19 crc kubenswrapper[5120]: I0316 17:15:19.343869 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"03022ddd-dd32-4310-9a94-fc349f3d905e","Type":"ContainerStarted","Data":"323b731c130b39fb1ff31c1fcefd4166e4a010492117878d7fed8c9bf46b76ef"} Mar 16 17:15:19 crc kubenswrapper[5120]: I0316 17:15:19.369479 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=2.369452318 podStartE2EDuration="2.369452318s" podCreationTimestamp="2026-03-16 17:15:17 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:15:19.361356087 +0000 UTC m=+6221.515287744" watchObservedRunningTime="2026-03-16 17:15:19.369452318 +0000 UTC m=+6221.523383975" Mar 16 17:15:19 crc kubenswrapper[5120]: I0316 17:15:19.391200 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=2.391175772 podStartE2EDuration="2.391175772s" podCreationTimestamp="2026-03-16 17:15:17 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:15:19.382495115 +0000 UTC m=+6221.536426772" watchObservedRunningTime="2026-03-16 17:15:19.391175772 +0000 UTC m=+6221.545107429" Mar 16 17:15:20 crc kubenswrapper[5120]: I0316 17:15:20.380235 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/certified-operators-fq2dt"] Mar 16 17:15:20 crc kubenswrapper[5120]: I0316 17:15:20.388834 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-fq2dt" Mar 16 17:15:20 crc kubenswrapper[5120]: I0316 17:15:20.390778 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/certified-operators-fq2dt"] Mar 16 17:15:20 crc kubenswrapper[5120]: I0316 17:15:20.456837 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bw8hb\" (UniqueName: \"kubernetes.io/projected/4f564416-4a49-4427-8d2b-fbd466e7598a-kube-api-access-bw8hb\") pod \"certified-operators-fq2dt\" (UID: \"4f564416-4a49-4427-8d2b-fbd466e7598a\") " pod="openshift-marketplace/certified-operators-fq2dt" Mar 16 17:15:20 crc kubenswrapper[5120]: I0316 17:15:20.457461 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/4f564416-4a49-4427-8d2b-fbd466e7598a-utilities\") pod \"certified-operators-fq2dt\" (UID: \"4f564416-4a49-4427-8d2b-fbd466e7598a\") " pod="openshift-marketplace/certified-operators-fq2dt" Mar 16 17:15:20 crc kubenswrapper[5120]: I0316 17:15:20.457702 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/4f564416-4a49-4427-8d2b-fbd466e7598a-catalog-content\") pod \"certified-operators-fq2dt\" (UID: \"4f564416-4a49-4427-8d2b-fbd466e7598a\") " pod="openshift-marketplace/certified-operators-fq2dt" Mar 16 17:15:20 crc kubenswrapper[5120]: I0316 17:15:20.561457 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/4f564416-4a49-4427-8d2b-fbd466e7598a-utilities\") pod \"certified-operators-fq2dt\" (UID: \"4f564416-4a49-4427-8d2b-fbd466e7598a\") " pod="openshift-marketplace/certified-operators-fq2dt" Mar 16 17:15:20 crc kubenswrapper[5120]: I0316 17:15:20.561649 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/4f564416-4a49-4427-8d2b-fbd466e7598a-catalog-content\") pod \"certified-operators-fq2dt\" (UID: \"4f564416-4a49-4427-8d2b-fbd466e7598a\") " pod="openshift-marketplace/certified-operators-fq2dt" Mar 16 17:15:20 crc kubenswrapper[5120]: I0316 17:15:20.561902 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bw8hb\" (UniqueName: \"kubernetes.io/projected/4f564416-4a49-4427-8d2b-fbd466e7598a-kube-api-access-bw8hb\") pod \"certified-operators-fq2dt\" (UID: \"4f564416-4a49-4427-8d2b-fbd466e7598a\") " pod="openshift-marketplace/certified-operators-fq2dt" Mar 16 17:15:20 crc kubenswrapper[5120]: I0316 17:15:20.562182 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/4f564416-4a49-4427-8d2b-fbd466e7598a-utilities\") pod \"certified-operators-fq2dt\" (UID: \"4f564416-4a49-4427-8d2b-fbd466e7598a\") " pod="openshift-marketplace/certified-operators-fq2dt" Mar 16 17:15:20 crc kubenswrapper[5120]: I0316 17:15:20.562604 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/4f564416-4a49-4427-8d2b-fbd466e7598a-catalog-content\") pod \"certified-operators-fq2dt\" (UID: \"4f564416-4a49-4427-8d2b-fbd466e7598a\") " pod="openshift-marketplace/certified-operators-fq2dt" Mar 16 17:15:20 crc kubenswrapper[5120]: I0316 17:15:20.608472 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bw8hb\" (UniqueName: \"kubernetes.io/projected/4f564416-4a49-4427-8d2b-fbd466e7598a-kube-api-access-bw8hb\") pod \"certified-operators-fq2dt\" (UID: \"4f564416-4a49-4427-8d2b-fbd466e7598a\") " pod="openshift-marketplace/certified-operators-fq2dt" Mar 16 17:15:20 crc kubenswrapper[5120]: I0316 17:15:20.718592 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-fq2dt" Mar 16 17:15:20 crc kubenswrapper[5120]: I0316 17:15:20.925173 5120 scope.go:117] "RemoveContainer" containerID="32ee293ec5c5b79f5752c783b21343e79effbfa28a13f724be9cd5fff90f077f" Mar 16 17:15:20 crc kubenswrapper[5120]: I0316 17:15:20.972896 5120 scope.go:117] "RemoveContainer" containerID="d62c1b34b409b862479ce97ceab32e16b55f5d2b09e9a3eda65f971385fa4b73" Mar 16 17:15:21 crc kubenswrapper[5120]: I0316 17:15:21.008812 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:15:21 crc kubenswrapper[5120]: I0316 17:15:21.012940 5120 scope.go:117] "RemoveContainer" containerID="039e995a001dd01ac406fe88fd7c6a4e0cee00e7bd95a63b42b63ac30864905b" Mar 16 17:15:21 crc kubenswrapper[5120]: I0316 17:15:21.178908 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l864r\" (UniqueName: \"kubernetes.io/projected/af7aac1b-70e7-445c-8e51-8e6b01d77c69-kube-api-access-l864r\") pod \"af7aac1b-70e7-445c-8e51-8e6b01d77c69\" (UID: \"af7aac1b-70e7-445c-8e51-8e6b01d77c69\") " Mar 16 17:15:21 crc kubenswrapper[5120]: I0316 17:15:21.179319 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/af7aac1b-70e7-445c-8e51-8e6b01d77c69-config-data\") pod \"af7aac1b-70e7-445c-8e51-8e6b01d77c69\" (UID: \"af7aac1b-70e7-445c-8e51-8e6b01d77c69\") " Mar 16 17:15:21 crc kubenswrapper[5120]: I0316 17:15:21.179799 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/af7aac1b-70e7-445c-8e51-8e6b01d77c69-combined-ca-bundle\") pod \"af7aac1b-70e7-445c-8e51-8e6b01d77c69\" (UID: \"af7aac1b-70e7-445c-8e51-8e6b01d77c69\") " Mar 16 17:15:21 crc kubenswrapper[5120]: I0316 17:15:21.184978 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af7aac1b-70e7-445c-8e51-8e6b01d77c69-kube-api-access-l864r" (OuterVolumeSpecName: "kube-api-access-l864r") pod "af7aac1b-70e7-445c-8e51-8e6b01d77c69" (UID: "af7aac1b-70e7-445c-8e51-8e6b01d77c69"). InnerVolumeSpecName "kube-api-access-l864r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:15:21 crc kubenswrapper[5120]: I0316 17:15:21.212087 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/af7aac1b-70e7-445c-8e51-8e6b01d77c69-config-data" (OuterVolumeSpecName: "config-data") pod "af7aac1b-70e7-445c-8e51-8e6b01d77c69" (UID: "af7aac1b-70e7-445c-8e51-8e6b01d77c69"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:15:21 crc kubenswrapper[5120]: I0316 17:15:21.221963 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/af7aac1b-70e7-445c-8e51-8e6b01d77c69-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "af7aac1b-70e7-445c-8e51-8e6b01d77c69" (UID: "af7aac1b-70e7-445c-8e51-8e6b01d77c69"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:15:21 crc kubenswrapper[5120]: I0316 17:15:21.251783 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/certified-operators-fq2dt"] Mar 16 17:15:21 crc kubenswrapper[5120]: W0316 17:15:21.254107 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f564416_4a49_4427_8d2b_fbd466e7598a.slice/crio-4ef2932f35be65f27401557735a72d4f7bd1443924c4965dea5610f81951592d WatchSource:0}: Error finding container 4ef2932f35be65f27401557735a72d4f7bd1443924c4965dea5610f81951592d: Status 404 returned error can't find the container with id 4ef2932f35be65f27401557735a72d4f7bd1443924c4965dea5610f81951592d Mar 16 17:15:21 crc kubenswrapper[5120]: I0316 17:15:21.282720 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/af7aac1b-70e7-445c-8e51-8e6b01d77c69-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:15:21 crc kubenswrapper[5120]: I0316 17:15:21.282747 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/af7aac1b-70e7-445c-8e51-8e6b01d77c69-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:15:21 crc kubenswrapper[5120]: I0316 17:15:21.282769 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l864r\" (UniqueName: \"kubernetes.io/projected/af7aac1b-70e7-445c-8e51-8e6b01d77c69-kube-api-access-l864r\") on node \"crc\" DevicePath \"\"" Mar 16 17:15:21 crc kubenswrapper[5120]: I0316 17:15:21.371448 5120 generic.go:358] "Generic (PLEG): container finished" podID="af7aac1b-70e7-445c-8e51-8e6b01d77c69" containerID="34d58d1c51613caebcb9181a1f0cbfb83a07c577dc43c879b4d6686f82178f90" exitCode=137 Mar 16 17:15:21 crc kubenswrapper[5120]: I0316 17:15:21.371510 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:15:21 crc kubenswrapper[5120]: I0316 17:15:21.371543 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"af7aac1b-70e7-445c-8e51-8e6b01d77c69","Type":"ContainerDied","Data":"34d58d1c51613caebcb9181a1f0cbfb83a07c577dc43c879b4d6686f82178f90"} Mar 16 17:15:21 crc kubenswrapper[5120]: I0316 17:15:21.371589 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"af7aac1b-70e7-445c-8e51-8e6b01d77c69","Type":"ContainerDied","Data":"46125ec3eb308400049db8fefce31696e5dea54de211e7fa2550d94911cc722c"} Mar 16 17:15:21 crc kubenswrapper[5120]: I0316 17:15:21.371612 5120 scope.go:117] "RemoveContainer" containerID="34d58d1c51613caebcb9181a1f0cbfb83a07c577dc43c879b4d6686f82178f90" Mar 16 17:15:21 crc kubenswrapper[5120]: I0316 17:15:21.373776 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-fq2dt" event={"ID":"4f564416-4a49-4427-8d2b-fbd466e7598a","Type":"ContainerStarted","Data":"4ef2932f35be65f27401557735a72d4f7bd1443924c4965dea5610f81951592d"} Mar 16 17:15:21 crc kubenswrapper[5120]: I0316 17:15:21.391318 5120 scope.go:117] "RemoveContainer" containerID="34d58d1c51613caebcb9181a1f0cbfb83a07c577dc43c879b4d6686f82178f90" Mar 16 17:15:21 crc kubenswrapper[5120]: E0316 17:15:21.391677 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"34d58d1c51613caebcb9181a1f0cbfb83a07c577dc43c879b4d6686f82178f90\": container with ID starting with 34d58d1c51613caebcb9181a1f0cbfb83a07c577dc43c879b4d6686f82178f90 not found: ID does not exist" containerID="34d58d1c51613caebcb9181a1f0cbfb83a07c577dc43c879b4d6686f82178f90" Mar 16 17:15:21 crc kubenswrapper[5120]: I0316 17:15:21.391712 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34d58d1c51613caebcb9181a1f0cbfb83a07c577dc43c879b4d6686f82178f90"} err="failed to get container status \"34d58d1c51613caebcb9181a1f0cbfb83a07c577dc43c879b4d6686f82178f90\": rpc error: code = NotFound desc = could not find container \"34d58d1c51613caebcb9181a1f0cbfb83a07c577dc43c879b4d6686f82178f90\": container with ID starting with 34d58d1c51613caebcb9181a1f0cbfb83a07c577dc43c879b4d6686f82178f90 not found: ID does not exist" Mar 16 17:15:21 crc kubenswrapper[5120]: I0316 17:15:21.423698 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 17:15:21 crc kubenswrapper[5120]: I0316 17:15:21.438033 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 17:15:21 crc kubenswrapper[5120]: I0316 17:15:21.461693 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 17:15:21 crc kubenswrapper[5120]: I0316 17:15:21.463067 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af7aac1b-70e7-445c-8e51-8e6b01d77c69" containerName="nova-scheduler-scheduler" Mar 16 17:15:21 crc kubenswrapper[5120]: I0316 17:15:21.463097 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="af7aac1b-70e7-445c-8e51-8e6b01d77c69" containerName="nova-scheduler-scheduler" Mar 16 17:15:21 crc kubenswrapper[5120]: I0316 17:15:21.463342 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="af7aac1b-70e7-445c-8e51-8e6b01d77c69" containerName="nova-scheduler-scheduler" Mar 16 17:15:21 crc kubenswrapper[5120]: I0316 17:15:21.468530 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:15:21 crc kubenswrapper[5120]: I0316 17:15:21.473153 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-scheduler-config-data\"" Mar 16 17:15:21 crc kubenswrapper[5120]: I0316 17:15:21.473455 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 17:15:21 crc kubenswrapper[5120]: I0316 17:15:21.591230 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a1dfcf19-aecf-49e7-9024-2e8b517fecfb-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"a1dfcf19-aecf-49e7-9024-2e8b517fecfb\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:15:21 crc kubenswrapper[5120]: I0316 17:15:21.591549 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a1dfcf19-aecf-49e7-9024-2e8b517fecfb-config-data\") pod \"nova-scheduler-0\" (UID: \"a1dfcf19-aecf-49e7-9024-2e8b517fecfb\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:15:21 crc kubenswrapper[5120]: I0316 17:15:21.592409 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7mbw\" (UniqueName: \"kubernetes.io/projected/a1dfcf19-aecf-49e7-9024-2e8b517fecfb-kube-api-access-s7mbw\") pod \"nova-scheduler-0\" (UID: \"a1dfcf19-aecf-49e7-9024-2e8b517fecfb\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:15:21 crc kubenswrapper[5120]: I0316 17:15:21.696294 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s7mbw\" (UniqueName: \"kubernetes.io/projected/a1dfcf19-aecf-49e7-9024-2e8b517fecfb-kube-api-access-s7mbw\") pod \"nova-scheduler-0\" (UID: \"a1dfcf19-aecf-49e7-9024-2e8b517fecfb\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:15:21 crc kubenswrapper[5120]: I0316 17:15:21.696733 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a1dfcf19-aecf-49e7-9024-2e8b517fecfb-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"a1dfcf19-aecf-49e7-9024-2e8b517fecfb\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:15:21 crc kubenswrapper[5120]: I0316 17:15:21.697236 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a1dfcf19-aecf-49e7-9024-2e8b517fecfb-config-data\") pod \"nova-scheduler-0\" (UID: \"a1dfcf19-aecf-49e7-9024-2e8b517fecfb\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:15:21 crc kubenswrapper[5120]: I0316 17:15:21.701925 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a1dfcf19-aecf-49e7-9024-2e8b517fecfb-config-data\") pod \"nova-scheduler-0\" (UID: \"a1dfcf19-aecf-49e7-9024-2e8b517fecfb\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:15:21 crc kubenswrapper[5120]: I0316 17:15:21.702228 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a1dfcf19-aecf-49e7-9024-2e8b517fecfb-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"a1dfcf19-aecf-49e7-9024-2e8b517fecfb\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:15:21 crc kubenswrapper[5120]: I0316 17:15:21.714140 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7mbw\" (UniqueName: \"kubernetes.io/projected/a1dfcf19-aecf-49e7-9024-2e8b517fecfb-kube-api-access-s7mbw\") pod \"nova-scheduler-0\" (UID: \"a1dfcf19-aecf-49e7-9024-2e8b517fecfb\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:15:21 crc kubenswrapper[5120]: I0316 17:15:21.853809 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:15:22 crc kubenswrapper[5120]: I0316 17:15:22.294948 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 17:15:22 crc kubenswrapper[5120]: W0316 17:15:22.298743 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda1dfcf19_aecf_49e7_9024_2e8b517fecfb.slice/crio-3f7dcb119ebe11d1c1ac576f5f279b3ec5b7ac8d0496ca3ec1c07587a2adc098 WatchSource:0}: Error finding container 3f7dcb119ebe11d1c1ac576f5f279b3ec5b7ac8d0496ca3ec1c07587a2adc098: Status 404 returned error can't find the container with id 3f7dcb119ebe11d1c1ac576f5f279b3ec5b7ac8d0496ca3ec1c07587a2adc098 Mar 16 17:15:22 crc kubenswrapper[5120]: I0316 17:15:22.386545 5120 generic.go:358] "Generic (PLEG): container finished" podID="4f564416-4a49-4427-8d2b-fbd466e7598a" containerID="4e5f12e32c401ff61cf0010bdd3e98267aebf68f5d7464448f66d4959ea6f636" exitCode=0 Mar 16 17:15:22 crc kubenswrapper[5120]: I0316 17:15:22.386663 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-fq2dt" event={"ID":"4f564416-4a49-4427-8d2b-fbd466e7598a","Type":"ContainerDied","Data":"4e5f12e32c401ff61cf0010bdd3e98267aebf68f5d7464448f66d4959ea6f636"} Mar 16 17:15:22 crc kubenswrapper[5120]: I0316 17:15:22.389793 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"a1dfcf19-aecf-49e7-9024-2e8b517fecfb","Type":"ContainerStarted","Data":"3f7dcb119ebe11d1c1ac576f5f279b3ec5b7ac8d0496ca3ec1c07587a2adc098"} Mar 16 17:15:22 crc kubenswrapper[5120]: I0316 17:15:22.676281 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="af7aac1b-70e7-445c-8e51-8e6b01d77c69" path="/var/lib/kubelet/pods/af7aac1b-70e7-445c-8e51-8e6b01d77c69/volumes" Mar 16 17:15:22 crc kubenswrapper[5120]: I0316 17:15:22.808324 5120 pod_container_manager_linux.go:217] "Failed to delete cgroup paths" cgroupName=["kubepods","besteffort","podf022b20c-74d0-4409-9852-318b67aeeae2"] err="unable to destroy cgroup paths for cgroup [kubepods besteffort podf022b20c-74d0-4409-9852-318b67aeeae2] : Timed out while waiting for systemd to remove kubepods-besteffort-podf022b20c_74d0_4409_9852_318b67aeeae2.slice" Mar 16 17:15:23 crc kubenswrapper[5120]: I0316 17:15:23.399483 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-fq2dt" event={"ID":"4f564416-4a49-4427-8d2b-fbd466e7598a","Type":"ContainerStarted","Data":"c4f2b29954f3438b88717ca73b602db8be5745ba5f64bfd89a8317257895e4c4"} Mar 16 17:15:23 crc kubenswrapper[5120]: I0316 17:15:23.402573 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"a1dfcf19-aecf-49e7-9024-2e8b517fecfb","Type":"ContainerStarted","Data":"225427a7164236eebc876d896eb6bae3e01836e1b1bbff01894a12e5711cbebe"} Mar 16 17:15:23 crc kubenswrapper[5120]: I0316 17:15:23.442312 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-scheduler-0" podStartSLOduration=2.4422865480000002 podStartE2EDuration="2.442286548s" podCreationTimestamp="2026-03-16 17:15:21 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:15:23.436394296 +0000 UTC m=+6225.590325973" watchObservedRunningTime="2026-03-16 17:15:23.442286548 +0000 UTC m=+6225.596218205" Mar 16 17:15:24 crc kubenswrapper[5120]: I0316 17:15:24.413692 5120 generic.go:358] "Generic (PLEG): container finished" podID="4f564416-4a49-4427-8d2b-fbd466e7598a" containerID="c4f2b29954f3438b88717ca73b602db8be5745ba5f64bfd89a8317257895e4c4" exitCode=0 Mar 16 17:15:24 crc kubenswrapper[5120]: I0316 17:15:24.413745 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-fq2dt" event={"ID":"4f564416-4a49-4427-8d2b-fbd466e7598a","Type":"ContainerDied","Data":"c4f2b29954f3438b88717ca73b602db8be5745ba5f64bfd89a8317257895e4c4"} Mar 16 17:15:25 crc kubenswrapper[5120]: I0316 17:15:25.429748 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-fq2dt" event={"ID":"4f564416-4a49-4427-8d2b-fbd466e7598a","Type":"ContainerStarted","Data":"10f151ab67f72eab38d5e1892d37a84ef5c6d08145135f56dd0475d05aece1a4"} Mar 16 17:15:25 crc kubenswrapper[5120]: I0316 17:15:25.459075 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/certified-operators-fq2dt" podStartSLOduration=4.880541046 podStartE2EDuration="5.459049684s" podCreationTimestamp="2026-03-16 17:15:20 +0000 UTC" firstStartedPulling="2026-03-16 17:15:22.387624702 +0000 UTC m=+6224.541556349" lastFinishedPulling="2026-03-16 17:15:22.96613333 +0000 UTC m=+6225.120064987" observedRunningTime="2026-03-16 17:15:25.447102707 +0000 UTC m=+6227.601034364" watchObservedRunningTime="2026-03-16 17:15:25.459049684 +0000 UTC m=+6227.612981351" Mar 16 17:15:26 crc kubenswrapper[5120]: I0316 17:15:26.854289 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:15:27 crc kubenswrapper[5120]: I0316 17:15:27.752315 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:15:27 crc kubenswrapper[5120]: I0316 17:15:27.752940 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:15:27 crc kubenswrapper[5120]: I0316 17:15:27.754330 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:15:27 crc kubenswrapper[5120]: I0316 17:15:27.754364 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:15:28 crc kubenswrapper[5120]: I0316 17:15:28.760945 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="a9215705-d766-4151-b079-62d304603586" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"https://10.217.0.211:8775/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 17:15:28 crc kubenswrapper[5120]: I0316 17:15:28.761928 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="a9215705-d766-4151-b079-62d304603586" containerName="nova-metadata-log" probeResult="failure" output="Get \"https://10.217.0.211:8775/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 17:15:28 crc kubenswrapper[5120]: I0316 17:15:28.794006 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="03022ddd-dd32-4310-9a94-fc349f3d905e" containerName="nova-api-log" probeResult="failure" output="Get \"http://10.217.0.210:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 17:15:28 crc kubenswrapper[5120]: I0316 17:15:28.794109 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="03022ddd-dd32-4310-9a94-fc349f3d905e" containerName="nova-api-api" probeResult="failure" output="Get \"http://10.217.0.210:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 17:15:30 crc kubenswrapper[5120]: I0316 17:15:30.719168 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/certified-operators-fq2dt" Mar 16 17:15:30 crc kubenswrapper[5120]: I0316 17:15:30.719225 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-marketplace/certified-operators-fq2dt" Mar 16 17:15:30 crc kubenswrapper[5120]: I0316 17:15:30.764034 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/certified-operators-fq2dt" Mar 16 17:15:31 crc kubenswrapper[5120]: I0316 17:15:31.546714 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/certified-operators-fq2dt" Mar 16 17:15:31 crc kubenswrapper[5120]: I0316 17:15:31.588981 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/certified-operators-fq2dt"] Mar 16 17:15:31 crc kubenswrapper[5120]: I0316 17:15:31.854657 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:15:31 crc kubenswrapper[5120]: I0316 17:15:31.884777 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:15:32 crc kubenswrapper[5120]: I0316 17:15:32.548371 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:15:33 crc kubenswrapper[5120]: I0316 17:15:33.523600 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-marketplace/certified-operators-fq2dt" podUID="4f564416-4a49-4427-8d2b-fbd466e7598a" containerName="registry-server" containerID="cri-o://10f151ab67f72eab38d5e1892d37a84ef5c6d08145135f56dd0475d05aece1a4" gracePeriod=2 Mar 16 17:15:33 crc kubenswrapper[5120]: I0316 17:15:33.949850 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-fq2dt" Mar 16 17:15:34 crc kubenswrapper[5120]: I0316 17:15:34.074665 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bw8hb\" (UniqueName: \"kubernetes.io/projected/4f564416-4a49-4427-8d2b-fbd466e7598a-kube-api-access-bw8hb\") pod \"4f564416-4a49-4427-8d2b-fbd466e7598a\" (UID: \"4f564416-4a49-4427-8d2b-fbd466e7598a\") " Mar 16 17:15:34 crc kubenswrapper[5120]: I0316 17:15:34.075212 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/4f564416-4a49-4427-8d2b-fbd466e7598a-catalog-content\") pod \"4f564416-4a49-4427-8d2b-fbd466e7598a\" (UID: \"4f564416-4a49-4427-8d2b-fbd466e7598a\") " Mar 16 17:15:34 crc kubenswrapper[5120]: I0316 17:15:34.075247 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/4f564416-4a49-4427-8d2b-fbd466e7598a-utilities\") pod \"4f564416-4a49-4427-8d2b-fbd466e7598a\" (UID: \"4f564416-4a49-4427-8d2b-fbd466e7598a\") " Mar 16 17:15:34 crc kubenswrapper[5120]: I0316 17:15:34.076575 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f564416-4a49-4427-8d2b-fbd466e7598a-utilities" (OuterVolumeSpecName: "utilities") pod "4f564416-4a49-4427-8d2b-fbd466e7598a" (UID: "4f564416-4a49-4427-8d2b-fbd466e7598a"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:15:34 crc kubenswrapper[5120]: I0316 17:15:34.082013 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f564416-4a49-4427-8d2b-fbd466e7598a-kube-api-access-bw8hb" (OuterVolumeSpecName: "kube-api-access-bw8hb") pod "4f564416-4a49-4427-8d2b-fbd466e7598a" (UID: "4f564416-4a49-4427-8d2b-fbd466e7598a"). InnerVolumeSpecName "kube-api-access-bw8hb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:15:34 crc kubenswrapper[5120]: I0316 17:15:34.178880 5120 reconciler_common.go:299] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/4f564416-4a49-4427-8d2b-fbd466e7598a-utilities\") on node \"crc\" DevicePath \"\"" Mar 16 17:15:34 crc kubenswrapper[5120]: I0316 17:15:34.178924 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bw8hb\" (UniqueName: \"kubernetes.io/projected/4f564416-4a49-4427-8d2b-fbd466e7598a-kube-api-access-bw8hb\") on node \"crc\" DevicePath \"\"" Mar 16 17:15:34 crc kubenswrapper[5120]: I0316 17:15:34.277937 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f564416-4a49-4427-8d2b-fbd466e7598a-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "4f564416-4a49-4427-8d2b-fbd466e7598a" (UID: "4f564416-4a49-4427-8d2b-fbd466e7598a"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:15:34 crc kubenswrapper[5120]: I0316 17:15:34.281728 5120 reconciler_common.go:299] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/4f564416-4a49-4427-8d2b-fbd466e7598a-catalog-content\") on node \"crc\" DevicePath \"\"" Mar 16 17:15:34 crc kubenswrapper[5120]: I0316 17:15:34.534602 5120 generic.go:358] "Generic (PLEG): container finished" podID="4f564416-4a49-4427-8d2b-fbd466e7598a" containerID="10f151ab67f72eab38d5e1892d37a84ef5c6d08145135f56dd0475d05aece1a4" exitCode=0 Mar 16 17:15:34 crc kubenswrapper[5120]: I0316 17:15:34.534653 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-fq2dt" event={"ID":"4f564416-4a49-4427-8d2b-fbd466e7598a","Type":"ContainerDied","Data":"10f151ab67f72eab38d5e1892d37a84ef5c6d08145135f56dd0475d05aece1a4"} Mar 16 17:15:34 crc kubenswrapper[5120]: I0316 17:15:34.534712 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-fq2dt" event={"ID":"4f564416-4a49-4427-8d2b-fbd466e7598a","Type":"ContainerDied","Data":"4ef2932f35be65f27401557735a72d4f7bd1443924c4965dea5610f81951592d"} Mar 16 17:15:34 crc kubenswrapper[5120]: I0316 17:15:34.534733 5120 scope.go:117] "RemoveContainer" containerID="10f151ab67f72eab38d5e1892d37a84ef5c6d08145135f56dd0475d05aece1a4" Mar 16 17:15:34 crc kubenswrapper[5120]: I0316 17:15:34.535646 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-fq2dt" Mar 16 17:15:34 crc kubenswrapper[5120]: I0316 17:15:34.577227 5120 scope.go:117] "RemoveContainer" containerID="c4f2b29954f3438b88717ca73b602db8be5745ba5f64bfd89a8317257895e4c4" Mar 16 17:15:34 crc kubenswrapper[5120]: I0316 17:15:34.577386 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/certified-operators-fq2dt"] Mar 16 17:15:34 crc kubenswrapper[5120]: I0316 17:15:34.584848 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/certified-operators-fq2dt"] Mar 16 17:15:34 crc kubenswrapper[5120]: I0316 17:15:34.610608 5120 scope.go:117] "RemoveContainer" containerID="4e5f12e32c401ff61cf0010bdd3e98267aebf68f5d7464448f66d4959ea6f636" Mar 16 17:15:34 crc kubenswrapper[5120]: I0316 17:15:34.641412 5120 scope.go:117] "RemoveContainer" containerID="10f151ab67f72eab38d5e1892d37a84ef5c6d08145135f56dd0475d05aece1a4" Mar 16 17:15:34 crc kubenswrapper[5120]: E0316 17:15:34.642644 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"10f151ab67f72eab38d5e1892d37a84ef5c6d08145135f56dd0475d05aece1a4\": container with ID starting with 10f151ab67f72eab38d5e1892d37a84ef5c6d08145135f56dd0475d05aece1a4 not found: ID does not exist" containerID="10f151ab67f72eab38d5e1892d37a84ef5c6d08145135f56dd0475d05aece1a4" Mar 16 17:15:34 crc kubenswrapper[5120]: I0316 17:15:34.642694 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10f151ab67f72eab38d5e1892d37a84ef5c6d08145135f56dd0475d05aece1a4"} err="failed to get container status \"10f151ab67f72eab38d5e1892d37a84ef5c6d08145135f56dd0475d05aece1a4\": rpc error: code = NotFound desc = could not find container \"10f151ab67f72eab38d5e1892d37a84ef5c6d08145135f56dd0475d05aece1a4\": container with ID starting with 10f151ab67f72eab38d5e1892d37a84ef5c6d08145135f56dd0475d05aece1a4 not found: ID does not exist" Mar 16 17:15:34 crc kubenswrapper[5120]: I0316 17:15:34.642724 5120 scope.go:117] "RemoveContainer" containerID="c4f2b29954f3438b88717ca73b602db8be5745ba5f64bfd89a8317257895e4c4" Mar 16 17:15:34 crc kubenswrapper[5120]: E0316 17:15:34.643046 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c4f2b29954f3438b88717ca73b602db8be5745ba5f64bfd89a8317257895e4c4\": container with ID starting with c4f2b29954f3438b88717ca73b602db8be5745ba5f64bfd89a8317257895e4c4 not found: ID does not exist" containerID="c4f2b29954f3438b88717ca73b602db8be5745ba5f64bfd89a8317257895e4c4" Mar 16 17:15:34 crc kubenswrapper[5120]: I0316 17:15:34.643083 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4f2b29954f3438b88717ca73b602db8be5745ba5f64bfd89a8317257895e4c4"} err="failed to get container status \"c4f2b29954f3438b88717ca73b602db8be5745ba5f64bfd89a8317257895e4c4\": rpc error: code = NotFound desc = could not find container \"c4f2b29954f3438b88717ca73b602db8be5745ba5f64bfd89a8317257895e4c4\": container with ID starting with c4f2b29954f3438b88717ca73b602db8be5745ba5f64bfd89a8317257895e4c4 not found: ID does not exist" Mar 16 17:15:34 crc kubenswrapper[5120]: I0316 17:15:34.643100 5120 scope.go:117] "RemoveContainer" containerID="4e5f12e32c401ff61cf0010bdd3e98267aebf68f5d7464448f66d4959ea6f636" Mar 16 17:15:34 crc kubenswrapper[5120]: E0316 17:15:34.643365 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e5f12e32c401ff61cf0010bdd3e98267aebf68f5d7464448f66d4959ea6f636\": container with ID starting with 4e5f12e32c401ff61cf0010bdd3e98267aebf68f5d7464448f66d4959ea6f636 not found: ID does not exist" containerID="4e5f12e32c401ff61cf0010bdd3e98267aebf68f5d7464448f66d4959ea6f636" Mar 16 17:15:34 crc kubenswrapper[5120]: I0316 17:15:34.643402 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e5f12e32c401ff61cf0010bdd3e98267aebf68f5d7464448f66d4959ea6f636"} err="failed to get container status \"4e5f12e32c401ff61cf0010bdd3e98267aebf68f5d7464448f66d4959ea6f636\": rpc error: code = NotFound desc = could not find container \"4e5f12e32c401ff61cf0010bdd3e98267aebf68f5d7464448f66d4959ea6f636\": container with ID starting with 4e5f12e32c401ff61cf0010bdd3e98267aebf68f5d7464448f66d4959ea6f636 not found: ID does not exist" Mar 16 17:15:34 crc kubenswrapper[5120]: I0316 17:15:34.681594 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4f564416-4a49-4427-8d2b-fbd466e7598a" path="/var/lib/kubelet/pods/4f564416-4a49-4427-8d2b-fbd466e7598a/volumes" Mar 16 17:15:35 crc kubenswrapper[5120]: I0316 17:15:35.751427 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:15:35 crc kubenswrapper[5120]: I0316 17:15:35.751786 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:15:35 crc kubenswrapper[5120]: I0316 17:15:35.754443 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:15:35 crc kubenswrapper[5120]: I0316 17:15:35.754485 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:15:37 crc kubenswrapper[5120]: I0316 17:15:37.756304 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:15:37 crc kubenswrapper[5120]: I0316 17:15:37.756819 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:15:37 crc kubenswrapper[5120]: I0316 17:15:37.760240 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:15:37 crc kubenswrapper[5120]: I0316 17:15:37.760300 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:15:37 crc kubenswrapper[5120]: I0316 17:15:37.762663 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:15:37 crc kubenswrapper[5120]: I0316 17:15:37.763364 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:15:37 crc kubenswrapper[5120]: I0316 17:15:37.772103 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:15:38 crc kubenswrapper[5120]: I0316 17:15:38.577517 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:15:39 crc kubenswrapper[5120]: I0316 17:15:39.869736 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:15:39 crc kubenswrapper[5120]: I0316 17:15:39.873014 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="e9e25236-8106-4c76-a3c5-132b0b3cfebb" containerName="ceilometer-central-agent" containerID="cri-o://726f62d922c6ac0a5818719fb7d74d5d3556703437962935d269bd302590e6e2" gracePeriod=30 Mar 16 17:15:39 crc kubenswrapper[5120]: I0316 17:15:39.873127 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="e9e25236-8106-4c76-a3c5-132b0b3cfebb" containerName="proxy-httpd" containerID="cri-o://d7b905d21e84ee131f8a49f7ac31554239a73dd345c455d0f9a0817abd0cc1e1" gracePeriod=30 Mar 16 17:15:39 crc kubenswrapper[5120]: I0316 17:15:39.873085 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="e9e25236-8106-4c76-a3c5-132b0b3cfebb" containerName="ceilometer-notification-agent" containerID="cri-o://535a7dd03c9a0ed1f949374deb52bc4d3b86d88a01b8e07f732ef79450e9ecba" gracePeriod=30 Mar 16 17:15:39 crc kubenswrapper[5120]: I0316 17:15:39.873360 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="e9e25236-8106-4c76-a3c5-132b0b3cfebb" containerName="sg-core" containerID="cri-o://dcca787fc6ee3274f8176eacd1d011e5cb179a2d0a58a0996379ea8eb5e292b2" gracePeriod=30 Mar 16 17:15:39 crc kubenswrapper[5120]: I0316 17:15:39.904434 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/ceilometer-0" podUID="e9e25236-8106-4c76-a3c5-132b0b3cfebb" containerName="proxy-httpd" probeResult="failure" output="HTTP probe failed with statuscode: 502" Mar 16 17:15:40 crc kubenswrapper[5120]: I0316 17:15:40.341472 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 17:15:40 crc kubenswrapper[5120]: I0316 17:15:40.341782 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="03022ddd-dd32-4310-9a94-fc349f3d905e" containerName="nova-api-log" containerID="cri-o://323b731c130b39fb1ff31c1fcefd4166e4a010492117878d7fed8c9bf46b76ef" gracePeriod=30 Mar 16 17:15:40 crc kubenswrapper[5120]: I0316 17:15:40.342189 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="03022ddd-dd32-4310-9a94-fc349f3d905e" containerName="nova-api-api" containerID="cri-o://1bcaf644fb6657a97c0fc39fd9a4ef4847b196211944f8358de9a1707620c0c9" gracePeriod=30 Mar 16 17:15:40 crc kubenswrapper[5120]: I0316 17:15:40.596487 5120 generic.go:358] "Generic (PLEG): container finished" podID="03022ddd-dd32-4310-9a94-fc349f3d905e" containerID="323b731c130b39fb1ff31c1fcefd4166e4a010492117878d7fed8c9bf46b76ef" exitCode=143 Mar 16 17:15:40 crc kubenswrapper[5120]: I0316 17:15:40.597107 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"03022ddd-dd32-4310-9a94-fc349f3d905e","Type":"ContainerDied","Data":"323b731c130b39fb1ff31c1fcefd4166e4a010492117878d7fed8c9bf46b76ef"} Mar 16 17:15:40 crc kubenswrapper[5120]: I0316 17:15:40.606362 5120 generic.go:358] "Generic (PLEG): container finished" podID="e9e25236-8106-4c76-a3c5-132b0b3cfebb" containerID="d7b905d21e84ee131f8a49f7ac31554239a73dd345c455d0f9a0817abd0cc1e1" exitCode=0 Mar 16 17:15:40 crc kubenswrapper[5120]: I0316 17:15:40.606390 5120 generic.go:358] "Generic (PLEG): container finished" podID="e9e25236-8106-4c76-a3c5-132b0b3cfebb" containerID="dcca787fc6ee3274f8176eacd1d011e5cb179a2d0a58a0996379ea8eb5e292b2" exitCode=2 Mar 16 17:15:40 crc kubenswrapper[5120]: I0316 17:15:40.606397 5120 generic.go:358] "Generic (PLEG): container finished" podID="e9e25236-8106-4c76-a3c5-132b0b3cfebb" containerID="535a7dd03c9a0ed1f949374deb52bc4d3b86d88a01b8e07f732ef79450e9ecba" exitCode=0 Mar 16 17:15:40 crc kubenswrapper[5120]: I0316 17:15:40.606404 5120 generic.go:358] "Generic (PLEG): container finished" podID="e9e25236-8106-4c76-a3c5-132b0b3cfebb" containerID="726f62d922c6ac0a5818719fb7d74d5d3556703437962935d269bd302590e6e2" exitCode=0 Mar 16 17:15:40 crc kubenswrapper[5120]: I0316 17:15:40.607445 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"e9e25236-8106-4c76-a3c5-132b0b3cfebb","Type":"ContainerDied","Data":"d7b905d21e84ee131f8a49f7ac31554239a73dd345c455d0f9a0817abd0cc1e1"} Mar 16 17:15:40 crc kubenswrapper[5120]: I0316 17:15:40.607475 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"e9e25236-8106-4c76-a3c5-132b0b3cfebb","Type":"ContainerDied","Data":"dcca787fc6ee3274f8176eacd1d011e5cb179a2d0a58a0996379ea8eb5e292b2"} Mar 16 17:15:40 crc kubenswrapper[5120]: I0316 17:15:40.607485 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"e9e25236-8106-4c76-a3c5-132b0b3cfebb","Type":"ContainerDied","Data":"535a7dd03c9a0ed1f949374deb52bc4d3b86d88a01b8e07f732ef79450e9ecba"} Mar 16 17:15:40 crc kubenswrapper[5120]: I0316 17:15:40.607528 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"e9e25236-8106-4c76-a3c5-132b0b3cfebb","Type":"ContainerDied","Data":"726f62d922c6ac0a5818719fb7d74d5d3556703437962935d269bd302590e6e2"} Mar 16 17:15:40 crc kubenswrapper[5120]: I0316 17:15:40.720406 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:15:40 crc kubenswrapper[5120]: I0316 17:15:40.798362 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wcrnm\" (UniqueName: \"kubernetes.io/projected/e9e25236-8106-4c76-a3c5-132b0b3cfebb-kube-api-access-wcrnm\") pod \"e9e25236-8106-4c76-a3c5-132b0b3cfebb\" (UID: \"e9e25236-8106-4c76-a3c5-132b0b3cfebb\") " Mar 16 17:15:40 crc kubenswrapper[5120]: I0316 17:15:40.798595 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e9e25236-8106-4c76-a3c5-132b0b3cfebb-run-httpd\") pod \"e9e25236-8106-4c76-a3c5-132b0b3cfebb\" (UID: \"e9e25236-8106-4c76-a3c5-132b0b3cfebb\") " Mar 16 17:15:40 crc kubenswrapper[5120]: I0316 17:15:40.798702 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e9e25236-8106-4c76-a3c5-132b0b3cfebb-combined-ca-bundle\") pod \"e9e25236-8106-4c76-a3c5-132b0b3cfebb\" (UID: \"e9e25236-8106-4c76-a3c5-132b0b3cfebb\") " Mar 16 17:15:40 crc kubenswrapper[5120]: I0316 17:15:40.798832 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e9e25236-8106-4c76-a3c5-132b0b3cfebb-log-httpd\") pod \"e9e25236-8106-4c76-a3c5-132b0b3cfebb\" (UID: \"e9e25236-8106-4c76-a3c5-132b0b3cfebb\") " Mar 16 17:15:40 crc kubenswrapper[5120]: I0316 17:15:40.798872 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e9e25236-8106-4c76-a3c5-132b0b3cfebb-scripts\") pod \"e9e25236-8106-4c76-a3c5-132b0b3cfebb\" (UID: \"e9e25236-8106-4c76-a3c5-132b0b3cfebb\") " Mar 16 17:15:40 crc kubenswrapper[5120]: I0316 17:15:40.798931 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e9e25236-8106-4c76-a3c5-132b0b3cfebb-config-data\") pod \"e9e25236-8106-4c76-a3c5-132b0b3cfebb\" (UID: \"e9e25236-8106-4c76-a3c5-132b0b3cfebb\") " Mar 16 17:15:40 crc kubenswrapper[5120]: I0316 17:15:40.799025 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/e9e25236-8106-4c76-a3c5-132b0b3cfebb-sg-core-conf-yaml\") pod \"e9e25236-8106-4c76-a3c5-132b0b3cfebb\" (UID: \"e9e25236-8106-4c76-a3c5-132b0b3cfebb\") " Mar 16 17:15:40 crc kubenswrapper[5120]: I0316 17:15:40.799551 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9e25236-8106-4c76-a3c5-132b0b3cfebb-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "e9e25236-8106-4c76-a3c5-132b0b3cfebb" (UID: "e9e25236-8106-4c76-a3c5-132b0b3cfebb"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:15:40 crc kubenswrapper[5120]: I0316 17:15:40.800219 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9e25236-8106-4c76-a3c5-132b0b3cfebb-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "e9e25236-8106-4c76-a3c5-132b0b3cfebb" (UID: "e9e25236-8106-4c76-a3c5-132b0b3cfebb"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:15:40 crc kubenswrapper[5120]: I0316 17:15:40.800575 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e9e25236-8106-4c76-a3c5-132b0b3cfebb-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 17:15:40 crc kubenswrapper[5120]: I0316 17:15:40.800599 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e9e25236-8106-4c76-a3c5-132b0b3cfebb-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 17:15:40 crc kubenswrapper[5120]: I0316 17:15:40.804508 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9e25236-8106-4c76-a3c5-132b0b3cfebb-kube-api-access-wcrnm" (OuterVolumeSpecName: "kube-api-access-wcrnm") pod "e9e25236-8106-4c76-a3c5-132b0b3cfebb" (UID: "e9e25236-8106-4c76-a3c5-132b0b3cfebb"). InnerVolumeSpecName "kube-api-access-wcrnm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:15:40 crc kubenswrapper[5120]: I0316 17:15:40.805261 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9e25236-8106-4c76-a3c5-132b0b3cfebb-scripts" (OuterVolumeSpecName: "scripts") pod "e9e25236-8106-4c76-a3c5-132b0b3cfebb" (UID: "e9e25236-8106-4c76-a3c5-132b0b3cfebb"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:15:40 crc kubenswrapper[5120]: I0316 17:15:40.833332 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9e25236-8106-4c76-a3c5-132b0b3cfebb-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "e9e25236-8106-4c76-a3c5-132b0b3cfebb" (UID: "e9e25236-8106-4c76-a3c5-132b0b3cfebb"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:15:40 crc kubenswrapper[5120]: I0316 17:15:40.882881 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9e25236-8106-4c76-a3c5-132b0b3cfebb-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e9e25236-8106-4c76-a3c5-132b0b3cfebb" (UID: "e9e25236-8106-4c76-a3c5-132b0b3cfebb"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:15:40 crc kubenswrapper[5120]: I0316 17:15:40.905739 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wcrnm\" (UniqueName: \"kubernetes.io/projected/e9e25236-8106-4c76-a3c5-132b0b3cfebb-kube-api-access-wcrnm\") on node \"crc\" DevicePath \"\"" Mar 16 17:15:40 crc kubenswrapper[5120]: I0316 17:15:40.905807 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e9e25236-8106-4c76-a3c5-132b0b3cfebb-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:15:40 crc kubenswrapper[5120]: I0316 17:15:40.905819 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e9e25236-8106-4c76-a3c5-132b0b3cfebb-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:15:40 crc kubenswrapper[5120]: I0316 17:15:40.905831 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/e9e25236-8106-4c76-a3c5-132b0b3cfebb-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 17:15:40 crc kubenswrapper[5120]: I0316 17:15:40.924632 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9e25236-8106-4c76-a3c5-132b0b3cfebb-config-data" (OuterVolumeSpecName: "config-data") pod "e9e25236-8106-4c76-a3c5-132b0b3cfebb" (UID: "e9e25236-8106-4c76-a3c5-132b0b3cfebb"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:15:41 crc kubenswrapper[5120]: I0316 17:15:41.008799 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e9e25236-8106-4c76-a3c5-132b0b3cfebb-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:15:41 crc kubenswrapper[5120]: I0316 17:15:41.621114 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"e9e25236-8106-4c76-a3c5-132b0b3cfebb","Type":"ContainerDied","Data":"e84af5ccffd8d476d292e62a0c794f57d59bc978646acf3788e6201baa25da64"} Mar 16 17:15:41 crc kubenswrapper[5120]: I0316 17:15:41.621374 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:15:41 crc kubenswrapper[5120]: I0316 17:15:41.621628 5120 scope.go:117] "RemoveContainer" containerID="d7b905d21e84ee131f8a49f7ac31554239a73dd345c455d0f9a0817abd0cc1e1" Mar 16 17:15:41 crc kubenswrapper[5120]: I0316 17:15:41.660494 5120 scope.go:117] "RemoveContainer" containerID="dcca787fc6ee3274f8176eacd1d011e5cb179a2d0a58a0996379ea8eb5e292b2" Mar 16 17:15:41 crc kubenswrapper[5120]: I0316 17:15:41.668672 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:15:41 crc kubenswrapper[5120]: I0316 17:15:41.686440 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:15:41 crc kubenswrapper[5120]: I0316 17:15:41.687281 5120 scope.go:117] "RemoveContainer" containerID="535a7dd03c9a0ed1f949374deb52bc4d3b86d88a01b8e07f732ef79450e9ecba" Mar 16 17:15:41 crc kubenswrapper[5120]: I0316 17:15:41.698488 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:15:41 crc kubenswrapper[5120]: I0316 17:15:41.699855 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9e25236-8106-4c76-a3c5-132b0b3cfebb" containerName="ceilometer-notification-agent" Mar 16 17:15:41 crc kubenswrapper[5120]: I0316 17:15:41.699881 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9e25236-8106-4c76-a3c5-132b0b3cfebb" containerName="ceilometer-notification-agent" Mar 16 17:15:41 crc kubenswrapper[5120]: I0316 17:15:41.699907 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9e25236-8106-4c76-a3c5-132b0b3cfebb" containerName="sg-core" Mar 16 17:15:41 crc kubenswrapper[5120]: I0316 17:15:41.699916 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9e25236-8106-4c76-a3c5-132b0b3cfebb" containerName="sg-core" Mar 16 17:15:41 crc kubenswrapper[5120]: I0316 17:15:41.699949 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9e25236-8106-4c76-a3c5-132b0b3cfebb" containerName="proxy-httpd" Mar 16 17:15:41 crc kubenswrapper[5120]: I0316 17:15:41.699957 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9e25236-8106-4c76-a3c5-132b0b3cfebb" containerName="proxy-httpd" Mar 16 17:15:41 crc kubenswrapper[5120]: I0316 17:15:41.699988 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f564416-4a49-4427-8d2b-fbd466e7598a" containerName="registry-server" Mar 16 17:15:41 crc kubenswrapper[5120]: I0316 17:15:41.699995 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f564416-4a49-4427-8d2b-fbd466e7598a" containerName="registry-server" Mar 16 17:15:41 crc kubenswrapper[5120]: I0316 17:15:41.700013 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f564416-4a49-4427-8d2b-fbd466e7598a" containerName="extract-content" Mar 16 17:15:41 crc kubenswrapper[5120]: I0316 17:15:41.700020 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f564416-4a49-4427-8d2b-fbd466e7598a" containerName="extract-content" Mar 16 17:15:41 crc kubenswrapper[5120]: I0316 17:15:41.700034 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9e25236-8106-4c76-a3c5-132b0b3cfebb" containerName="ceilometer-central-agent" Mar 16 17:15:41 crc kubenswrapper[5120]: I0316 17:15:41.700042 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9e25236-8106-4c76-a3c5-132b0b3cfebb" containerName="ceilometer-central-agent" Mar 16 17:15:41 crc kubenswrapper[5120]: I0316 17:15:41.700059 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f564416-4a49-4427-8d2b-fbd466e7598a" containerName="extract-utilities" Mar 16 17:15:41 crc kubenswrapper[5120]: I0316 17:15:41.700067 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f564416-4a49-4427-8d2b-fbd466e7598a" containerName="extract-utilities" Mar 16 17:15:41 crc kubenswrapper[5120]: I0316 17:15:41.700265 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e9e25236-8106-4c76-a3c5-132b0b3cfebb" containerName="proxy-httpd" Mar 16 17:15:41 crc kubenswrapper[5120]: I0316 17:15:41.700281 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e9e25236-8106-4c76-a3c5-132b0b3cfebb" containerName="sg-core" Mar 16 17:15:41 crc kubenswrapper[5120]: I0316 17:15:41.700304 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="4f564416-4a49-4427-8d2b-fbd466e7598a" containerName="registry-server" Mar 16 17:15:41 crc kubenswrapper[5120]: I0316 17:15:41.700318 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e9e25236-8106-4c76-a3c5-132b0b3cfebb" containerName="ceilometer-notification-agent" Mar 16 17:15:41 crc kubenswrapper[5120]: I0316 17:15:41.700338 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e9e25236-8106-4c76-a3c5-132b0b3cfebb" containerName="ceilometer-central-agent" Mar 16 17:15:41 crc kubenswrapper[5120]: I0316 17:15:41.728990 5120 scope.go:117] "RemoveContainer" containerID="726f62d922c6ac0a5818719fb7d74d5d3556703437962935d269bd302590e6e2" Mar 16 17:15:41 crc kubenswrapper[5120]: I0316 17:15:41.739674 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:15:41 crc kubenswrapper[5120]: I0316 17:15:41.739869 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:15:41 crc kubenswrapper[5120]: I0316 17:15:41.751881 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 17:15:41 crc kubenswrapper[5120]: I0316 17:15:41.752141 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 17:15:41 crc kubenswrapper[5120]: I0316 17:15:41.835143 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2ce2acf8-ebf6-4d0f-b85e-939686bd7484-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"2ce2acf8-ebf6-4d0f-b85e-939686bd7484\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:15:41 crc kubenswrapper[5120]: I0316 17:15:41.835190 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7z4zv\" (UniqueName: \"kubernetes.io/projected/2ce2acf8-ebf6-4d0f-b85e-939686bd7484-kube-api-access-7z4zv\") pod \"ceilometer-0\" (UID: \"2ce2acf8-ebf6-4d0f-b85e-939686bd7484\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:15:41 crc kubenswrapper[5120]: I0316 17:15:41.835413 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2ce2acf8-ebf6-4d0f-b85e-939686bd7484-log-httpd\") pod \"ceilometer-0\" (UID: \"2ce2acf8-ebf6-4d0f-b85e-939686bd7484\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:15:41 crc kubenswrapper[5120]: I0316 17:15:41.835691 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2ce2acf8-ebf6-4d0f-b85e-939686bd7484-run-httpd\") pod \"ceilometer-0\" (UID: \"2ce2acf8-ebf6-4d0f-b85e-939686bd7484\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:15:41 crc kubenswrapper[5120]: I0316 17:15:41.835922 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2ce2acf8-ebf6-4d0f-b85e-939686bd7484-scripts\") pod \"ceilometer-0\" (UID: \"2ce2acf8-ebf6-4d0f-b85e-939686bd7484\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:15:41 crc kubenswrapper[5120]: I0316 17:15:41.836036 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/2ce2acf8-ebf6-4d0f-b85e-939686bd7484-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"2ce2acf8-ebf6-4d0f-b85e-939686bd7484\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:15:41 crc kubenswrapper[5120]: I0316 17:15:41.836112 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2ce2acf8-ebf6-4d0f-b85e-939686bd7484-config-data\") pod \"ceilometer-0\" (UID: \"2ce2acf8-ebf6-4d0f-b85e-939686bd7484\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:15:41 crc kubenswrapper[5120]: I0316 17:15:41.938023 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2ce2acf8-ebf6-4d0f-b85e-939686bd7484-scripts\") pod \"ceilometer-0\" (UID: \"2ce2acf8-ebf6-4d0f-b85e-939686bd7484\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:15:41 crc kubenswrapper[5120]: I0316 17:15:41.938456 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/2ce2acf8-ebf6-4d0f-b85e-939686bd7484-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"2ce2acf8-ebf6-4d0f-b85e-939686bd7484\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:15:41 crc kubenswrapper[5120]: I0316 17:15:41.938530 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2ce2acf8-ebf6-4d0f-b85e-939686bd7484-config-data\") pod \"ceilometer-0\" (UID: \"2ce2acf8-ebf6-4d0f-b85e-939686bd7484\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:15:41 crc kubenswrapper[5120]: I0316 17:15:41.938641 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2ce2acf8-ebf6-4d0f-b85e-939686bd7484-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"2ce2acf8-ebf6-4d0f-b85e-939686bd7484\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:15:41 crc kubenswrapper[5120]: I0316 17:15:41.938670 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7z4zv\" (UniqueName: \"kubernetes.io/projected/2ce2acf8-ebf6-4d0f-b85e-939686bd7484-kube-api-access-7z4zv\") pod \"ceilometer-0\" (UID: \"2ce2acf8-ebf6-4d0f-b85e-939686bd7484\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:15:41 crc kubenswrapper[5120]: I0316 17:15:41.938883 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2ce2acf8-ebf6-4d0f-b85e-939686bd7484-log-httpd\") pod \"ceilometer-0\" (UID: \"2ce2acf8-ebf6-4d0f-b85e-939686bd7484\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:15:41 crc kubenswrapper[5120]: I0316 17:15:41.939039 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2ce2acf8-ebf6-4d0f-b85e-939686bd7484-run-httpd\") pod \"ceilometer-0\" (UID: \"2ce2acf8-ebf6-4d0f-b85e-939686bd7484\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:15:41 crc kubenswrapper[5120]: I0316 17:15:41.939486 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2ce2acf8-ebf6-4d0f-b85e-939686bd7484-log-httpd\") pod \"ceilometer-0\" (UID: \"2ce2acf8-ebf6-4d0f-b85e-939686bd7484\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:15:41 crc kubenswrapper[5120]: I0316 17:15:41.942206 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2ce2acf8-ebf6-4d0f-b85e-939686bd7484-run-httpd\") pod \"ceilometer-0\" (UID: \"2ce2acf8-ebf6-4d0f-b85e-939686bd7484\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:15:41 crc kubenswrapper[5120]: I0316 17:15:41.944138 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/2ce2acf8-ebf6-4d0f-b85e-939686bd7484-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"2ce2acf8-ebf6-4d0f-b85e-939686bd7484\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:15:41 crc kubenswrapper[5120]: I0316 17:15:41.945362 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2ce2acf8-ebf6-4d0f-b85e-939686bd7484-config-data\") pod \"ceilometer-0\" (UID: \"2ce2acf8-ebf6-4d0f-b85e-939686bd7484\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:15:41 crc kubenswrapper[5120]: I0316 17:15:41.947193 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2ce2acf8-ebf6-4d0f-b85e-939686bd7484-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"2ce2acf8-ebf6-4d0f-b85e-939686bd7484\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:15:41 crc kubenswrapper[5120]: I0316 17:15:41.959980 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2ce2acf8-ebf6-4d0f-b85e-939686bd7484-scripts\") pod \"ceilometer-0\" (UID: \"2ce2acf8-ebf6-4d0f-b85e-939686bd7484\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:15:41 crc kubenswrapper[5120]: I0316 17:15:41.967418 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7z4zv\" (UniqueName: \"kubernetes.io/projected/2ce2acf8-ebf6-4d0f-b85e-939686bd7484-kube-api-access-7z4zv\") pod \"ceilometer-0\" (UID: \"2ce2acf8-ebf6-4d0f-b85e-939686bd7484\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:15:41 crc kubenswrapper[5120]: I0316 17:15:41.973910 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:15:41 crc kubenswrapper[5120]: I0316 17:15:41.974747 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:15:42 crc kubenswrapper[5120]: I0316 17:15:42.420999 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:15:42 crc kubenswrapper[5120]: W0316 17:15:42.431406 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2ce2acf8_ebf6_4d0f_b85e_939686bd7484.slice/crio-f8eca8d2622f43cdaeb17949a4a7ef4b43c43d0dcd3dfcbd6db1344cdd20bbce WatchSource:0}: Error finding container f8eca8d2622f43cdaeb17949a4a7ef4b43c43d0dcd3dfcbd6db1344cdd20bbce: Status 404 returned error can't find the container with id f8eca8d2622f43cdaeb17949a4a7ef4b43c43d0dcd3dfcbd6db1344cdd20bbce Mar 16 17:15:42 crc kubenswrapper[5120]: I0316 17:15:42.632485 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"2ce2acf8-ebf6-4d0f-b85e-939686bd7484","Type":"ContainerStarted","Data":"f8eca8d2622f43cdaeb17949a4a7ef4b43c43d0dcd3dfcbd6db1344cdd20bbce"} Mar 16 17:15:42 crc kubenswrapper[5120]: I0316 17:15:42.673694 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e9e25236-8106-4c76-a3c5-132b0b3cfebb" path="/var/lib/kubelet/pods/e9e25236-8106-4c76-a3c5-132b0b3cfebb/volumes" Mar 16 17:15:43 crc kubenswrapper[5120]: I0316 17:15:43.666609 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"2ce2acf8-ebf6-4d0f-b85e-939686bd7484","Type":"ContainerStarted","Data":"4eadf2e7c4aeaf895f2cd11656a17ec21e58c35a64023fcfaff86590d98d5678"} Mar 16 17:15:43 crc kubenswrapper[5120]: I0316 17:15:43.690384 5120 generic.go:358] "Generic (PLEG): container finished" podID="03022ddd-dd32-4310-9a94-fc349f3d905e" containerID="1bcaf644fb6657a97c0fc39fd9a4ef4847b196211944f8358de9a1707620c0c9" exitCode=0 Mar 16 17:15:43 crc kubenswrapper[5120]: I0316 17:15:43.690508 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"03022ddd-dd32-4310-9a94-fc349f3d905e","Type":"ContainerDied","Data":"1bcaf644fb6657a97c0fc39fd9a4ef4847b196211944f8358de9a1707620c0c9"} Mar 16 17:15:43 crc kubenswrapper[5120]: I0316 17:15:43.927358 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:15:44 crc kubenswrapper[5120]: I0316 17:15:44.014632 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/03022ddd-dd32-4310-9a94-fc349f3d905e-combined-ca-bundle\") pod \"03022ddd-dd32-4310-9a94-fc349f3d905e\" (UID: \"03022ddd-dd32-4310-9a94-fc349f3d905e\") " Mar 16 17:15:44 crc kubenswrapper[5120]: I0316 17:15:44.014974 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/03022ddd-dd32-4310-9a94-fc349f3d905e-config-data\") pod \"03022ddd-dd32-4310-9a94-fc349f3d905e\" (UID: \"03022ddd-dd32-4310-9a94-fc349f3d905e\") " Mar 16 17:15:44 crc kubenswrapper[5120]: I0316 17:15:44.015159 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2qpcr\" (UniqueName: \"kubernetes.io/projected/03022ddd-dd32-4310-9a94-fc349f3d905e-kube-api-access-2qpcr\") pod \"03022ddd-dd32-4310-9a94-fc349f3d905e\" (UID: \"03022ddd-dd32-4310-9a94-fc349f3d905e\") " Mar 16 17:15:44 crc kubenswrapper[5120]: I0316 17:15:44.015358 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/03022ddd-dd32-4310-9a94-fc349f3d905e-logs\") pod \"03022ddd-dd32-4310-9a94-fc349f3d905e\" (UID: \"03022ddd-dd32-4310-9a94-fc349f3d905e\") " Mar 16 17:15:44 crc kubenswrapper[5120]: I0316 17:15:44.016913 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03022ddd-dd32-4310-9a94-fc349f3d905e-logs" (OuterVolumeSpecName: "logs") pod "03022ddd-dd32-4310-9a94-fc349f3d905e" (UID: "03022ddd-dd32-4310-9a94-fc349f3d905e"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:15:44 crc kubenswrapper[5120]: I0316 17:15:44.030694 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03022ddd-dd32-4310-9a94-fc349f3d905e-kube-api-access-2qpcr" (OuterVolumeSpecName: "kube-api-access-2qpcr") pod "03022ddd-dd32-4310-9a94-fc349f3d905e" (UID: "03022ddd-dd32-4310-9a94-fc349f3d905e"). InnerVolumeSpecName "kube-api-access-2qpcr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:15:44 crc kubenswrapper[5120]: I0316 17:15:44.062100 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/03022ddd-dd32-4310-9a94-fc349f3d905e-config-data" (OuterVolumeSpecName: "config-data") pod "03022ddd-dd32-4310-9a94-fc349f3d905e" (UID: "03022ddd-dd32-4310-9a94-fc349f3d905e"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:15:44 crc kubenswrapper[5120]: I0316 17:15:44.078912 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/03022ddd-dd32-4310-9a94-fc349f3d905e-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "03022ddd-dd32-4310-9a94-fc349f3d905e" (UID: "03022ddd-dd32-4310-9a94-fc349f3d905e"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:15:44 crc kubenswrapper[5120]: I0316 17:15:44.119385 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/03022ddd-dd32-4310-9a94-fc349f3d905e-logs\") on node \"crc\" DevicePath \"\"" Mar 16 17:15:44 crc kubenswrapper[5120]: I0316 17:15:44.119426 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/03022ddd-dd32-4310-9a94-fc349f3d905e-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:15:44 crc kubenswrapper[5120]: I0316 17:15:44.119438 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/03022ddd-dd32-4310-9a94-fc349f3d905e-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:15:44 crc kubenswrapper[5120]: I0316 17:15:44.119450 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2qpcr\" (UniqueName: \"kubernetes.io/projected/03022ddd-dd32-4310-9a94-fc349f3d905e-kube-api-access-2qpcr\") on node \"crc\" DevicePath \"\"" Mar 16 17:15:44 crc kubenswrapper[5120]: I0316 17:15:44.714445 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"03022ddd-dd32-4310-9a94-fc349f3d905e","Type":"ContainerDied","Data":"0549bd6a3b3540ad281b8702d0b0df2f0446b9146fbe5ffad1e157c59376e22d"} Mar 16 17:15:44 crc kubenswrapper[5120]: I0316 17:15:44.714832 5120 scope.go:117] "RemoveContainer" containerID="1bcaf644fb6657a97c0fc39fd9a4ef4847b196211944f8358de9a1707620c0c9" Mar 16 17:15:44 crc kubenswrapper[5120]: I0316 17:15:44.714966 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:15:44 crc kubenswrapper[5120]: I0316 17:15:44.720916 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"2ce2acf8-ebf6-4d0f-b85e-939686bd7484","Type":"ContainerStarted","Data":"f08567ac288344a97a0a01a88918a9059d1c3092af31f1ab3d794bb7cbcf07bb"} Mar 16 17:15:44 crc kubenswrapper[5120]: I0316 17:15:44.720960 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"2ce2acf8-ebf6-4d0f-b85e-939686bd7484","Type":"ContainerStarted","Data":"b18ca64131d930b835cf26cc5fb6f3b73bab634a2e236aad0a2b5d544af5762c"} Mar 16 17:15:44 crc kubenswrapper[5120]: I0316 17:15:44.749258 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 17:15:44 crc kubenswrapper[5120]: I0316 17:15:44.758890 5120 scope.go:117] "RemoveContainer" containerID="323b731c130b39fb1ff31c1fcefd4166e4a010492117878d7fed8c9bf46b76ef" Mar 16 17:15:44 crc kubenswrapper[5120]: I0316 17:15:44.774973 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 17:15:44 crc kubenswrapper[5120]: I0316 17:15:44.789493 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 17:15:44 crc kubenswrapper[5120]: I0316 17:15:44.790843 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03022ddd-dd32-4310-9a94-fc349f3d905e" containerName="nova-api-log" Mar 16 17:15:44 crc kubenswrapper[5120]: I0316 17:15:44.790871 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="03022ddd-dd32-4310-9a94-fc349f3d905e" containerName="nova-api-log" Mar 16 17:15:44 crc kubenswrapper[5120]: I0316 17:15:44.790927 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03022ddd-dd32-4310-9a94-fc349f3d905e" containerName="nova-api-api" Mar 16 17:15:44 crc kubenswrapper[5120]: I0316 17:15:44.790937 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="03022ddd-dd32-4310-9a94-fc349f3d905e" containerName="nova-api-api" Mar 16 17:15:44 crc kubenswrapper[5120]: I0316 17:15:44.791233 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="03022ddd-dd32-4310-9a94-fc349f3d905e" containerName="nova-api-api" Mar 16 17:15:44 crc kubenswrapper[5120]: I0316 17:15:44.791272 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="03022ddd-dd32-4310-9a94-fc349f3d905e" containerName="nova-api-log" Mar 16 17:15:44 crc kubenswrapper[5120]: I0316 17:15:44.813440 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 17:15:44 crc kubenswrapper[5120]: I0316 17:15:44.814933 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:15:44 crc kubenswrapper[5120]: I0316 17:15:44.817234 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-public-svc\"" Mar 16 17:15:44 crc kubenswrapper[5120]: I0316 17:15:44.817951 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-internal-svc\"" Mar 16 17:15:44 crc kubenswrapper[5120]: I0316 17:15:44.822405 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-config-data\"" Mar 16 17:15:44 crc kubenswrapper[5120]: I0316 17:15:44.946171 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ef7c6f1d-0e78-43bf-99c4-9200f5e67136-logs\") pod \"nova-api-0\" (UID: \"ef7c6f1d-0e78-43bf-99c4-9200f5e67136\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:15:44 crc kubenswrapper[5120]: I0316 17:15:44.946254 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ef7c6f1d-0e78-43bf-99c4-9200f5e67136-config-data\") pod \"nova-api-0\" (UID: \"ef7c6f1d-0e78-43bf-99c4-9200f5e67136\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:15:44 crc kubenswrapper[5120]: I0316 17:15:44.946324 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzp26\" (UniqueName: \"kubernetes.io/projected/ef7c6f1d-0e78-43bf-99c4-9200f5e67136-kube-api-access-zzp26\") pod \"nova-api-0\" (UID: \"ef7c6f1d-0e78-43bf-99c4-9200f5e67136\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:15:44 crc kubenswrapper[5120]: I0316 17:15:44.946668 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/ef7c6f1d-0e78-43bf-99c4-9200f5e67136-internal-tls-certs\") pod \"nova-api-0\" (UID: \"ef7c6f1d-0e78-43bf-99c4-9200f5e67136\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:15:44 crc kubenswrapper[5120]: I0316 17:15:44.946805 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ef7c6f1d-0e78-43bf-99c4-9200f5e67136-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"ef7c6f1d-0e78-43bf-99c4-9200f5e67136\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:15:44 crc kubenswrapper[5120]: I0316 17:15:44.947195 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ef7c6f1d-0e78-43bf-99c4-9200f5e67136-public-tls-certs\") pod \"nova-api-0\" (UID: \"ef7c6f1d-0e78-43bf-99c4-9200f5e67136\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:15:45 crc kubenswrapper[5120]: I0316 17:15:45.079653 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ef7c6f1d-0e78-43bf-99c4-9200f5e67136-public-tls-certs\") pod \"nova-api-0\" (UID: \"ef7c6f1d-0e78-43bf-99c4-9200f5e67136\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:15:45 crc kubenswrapper[5120]: I0316 17:15:45.079910 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ef7c6f1d-0e78-43bf-99c4-9200f5e67136-logs\") pod \"nova-api-0\" (UID: \"ef7c6f1d-0e78-43bf-99c4-9200f5e67136\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:15:45 crc kubenswrapper[5120]: I0316 17:15:45.079949 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ef7c6f1d-0e78-43bf-99c4-9200f5e67136-config-data\") pod \"nova-api-0\" (UID: \"ef7c6f1d-0e78-43bf-99c4-9200f5e67136\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:15:45 crc kubenswrapper[5120]: I0316 17:15:45.079973 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zzp26\" (UniqueName: \"kubernetes.io/projected/ef7c6f1d-0e78-43bf-99c4-9200f5e67136-kube-api-access-zzp26\") pod \"nova-api-0\" (UID: \"ef7c6f1d-0e78-43bf-99c4-9200f5e67136\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:15:45 crc kubenswrapper[5120]: I0316 17:15:45.080176 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/ef7c6f1d-0e78-43bf-99c4-9200f5e67136-internal-tls-certs\") pod \"nova-api-0\" (UID: \"ef7c6f1d-0e78-43bf-99c4-9200f5e67136\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:15:45 crc kubenswrapper[5120]: I0316 17:15:45.080530 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ef7c6f1d-0e78-43bf-99c4-9200f5e67136-logs\") pod \"nova-api-0\" (UID: \"ef7c6f1d-0e78-43bf-99c4-9200f5e67136\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:15:45 crc kubenswrapper[5120]: I0316 17:15:45.080751 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ef7c6f1d-0e78-43bf-99c4-9200f5e67136-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"ef7c6f1d-0e78-43bf-99c4-9200f5e67136\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:15:45 crc kubenswrapper[5120]: I0316 17:15:45.085716 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ef7c6f1d-0e78-43bf-99c4-9200f5e67136-public-tls-certs\") pod \"nova-api-0\" (UID: \"ef7c6f1d-0e78-43bf-99c4-9200f5e67136\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:15:45 crc kubenswrapper[5120]: I0316 17:15:45.086480 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ef7c6f1d-0e78-43bf-99c4-9200f5e67136-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"ef7c6f1d-0e78-43bf-99c4-9200f5e67136\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:15:45 crc kubenswrapper[5120]: I0316 17:15:45.090423 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/ef7c6f1d-0e78-43bf-99c4-9200f5e67136-internal-tls-certs\") pod \"nova-api-0\" (UID: \"ef7c6f1d-0e78-43bf-99c4-9200f5e67136\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:15:45 crc kubenswrapper[5120]: I0316 17:15:45.090910 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ef7c6f1d-0e78-43bf-99c4-9200f5e67136-config-data\") pod \"nova-api-0\" (UID: \"ef7c6f1d-0e78-43bf-99c4-9200f5e67136\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:15:45 crc kubenswrapper[5120]: I0316 17:15:45.102936 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzp26\" (UniqueName: \"kubernetes.io/projected/ef7c6f1d-0e78-43bf-99c4-9200f5e67136-kube-api-access-zzp26\") pod \"nova-api-0\" (UID: \"ef7c6f1d-0e78-43bf-99c4-9200f5e67136\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:15:45 crc kubenswrapper[5120]: I0316 17:15:45.136556 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:15:45 crc kubenswrapper[5120]: I0316 17:15:45.618426 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 17:15:45 crc kubenswrapper[5120]: I0316 17:15:45.734661 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"ef7c6f1d-0e78-43bf-99c4-9200f5e67136","Type":"ContainerStarted","Data":"af09ebdfa23718ae5c64ad8b270c24365af00babcf8420d7d4cc07e2f0870812"} Mar 16 17:15:46 crc kubenswrapper[5120]: I0316 17:15:46.676538 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="03022ddd-dd32-4310-9a94-fc349f3d905e" path="/var/lib/kubelet/pods/03022ddd-dd32-4310-9a94-fc349f3d905e/volumes" Mar 16 17:15:46 crc kubenswrapper[5120]: I0316 17:15:46.745798 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"ef7c6f1d-0e78-43bf-99c4-9200f5e67136","Type":"ContainerStarted","Data":"1d86c8a64a5053fae6269345960dc10f867eed9fabe6851c22755daab8918cf7"} Mar 16 17:15:46 crc kubenswrapper[5120]: I0316 17:15:46.745846 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"ef7c6f1d-0e78-43bf-99c4-9200f5e67136","Type":"ContainerStarted","Data":"a1aa89d0956d7cc1f2770a8dab38997b4d225b5aa9872ace287bcdf25277bee6"} Mar 16 17:15:46 crc kubenswrapper[5120]: I0316 17:15:46.775972 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=2.7759527779999997 podStartE2EDuration="2.775952778s" podCreationTimestamp="2026-03-16 17:15:44 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:15:46.763571969 +0000 UTC m=+6248.917503626" watchObservedRunningTime="2026-03-16 17:15:46.775952778 +0000 UTC m=+6248.929884435" Mar 16 17:15:51 crc kubenswrapper[5120]: I0316 17:15:51.793354 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"2ce2acf8-ebf6-4d0f-b85e-939686bd7484","Type":"ContainerStarted","Data":"53e1794b854124fc61b3fd45102195ac9a1534adc3bdd8e2c371479d288d5a23"} Mar 16 17:15:51 crc kubenswrapper[5120]: I0316 17:15:51.794004 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:15:51 crc kubenswrapper[5120]: I0316 17:15:51.793528 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="2ce2acf8-ebf6-4d0f-b85e-939686bd7484" containerName="sg-core" containerID="cri-o://f08567ac288344a97a0a01a88918a9059d1c3092af31f1ab3d794bb7cbcf07bb" gracePeriod=30 Mar 16 17:15:51 crc kubenswrapper[5120]: I0316 17:15:51.793385 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="2ce2acf8-ebf6-4d0f-b85e-939686bd7484" containerName="ceilometer-central-agent" containerID="cri-o://4eadf2e7c4aeaf895f2cd11656a17ec21e58c35a64023fcfaff86590d98d5678" gracePeriod=30 Mar 16 17:15:51 crc kubenswrapper[5120]: I0316 17:15:51.793638 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="2ce2acf8-ebf6-4d0f-b85e-939686bd7484" containerName="ceilometer-notification-agent" containerID="cri-o://b18ca64131d930b835cf26cc5fb6f3b73bab634a2e236aad0a2b5d544af5762c" gracePeriod=30 Mar 16 17:15:51 crc kubenswrapper[5120]: I0316 17:15:51.793611 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="2ce2acf8-ebf6-4d0f-b85e-939686bd7484" containerName="proxy-httpd" containerID="cri-o://53e1794b854124fc61b3fd45102195ac9a1534adc3bdd8e2c371479d288d5a23" gracePeriod=30 Mar 16 17:15:51 crc kubenswrapper[5120]: I0316 17:15:51.818137 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.3262899790000002 podStartE2EDuration="10.818116248s" podCreationTimestamp="2026-03-16 17:15:41 +0000 UTC" firstStartedPulling="2026-03-16 17:15:42.433011749 +0000 UTC m=+6244.586943406" lastFinishedPulling="2026-03-16 17:15:50.924838008 +0000 UTC m=+6253.078769675" observedRunningTime="2026-03-16 17:15:51.815158907 +0000 UTC m=+6253.969090564" watchObservedRunningTime="2026-03-16 17:15:51.818116248 +0000 UTC m=+6253.972047905" Mar 16 17:15:52 crc kubenswrapper[5120]: I0316 17:15:52.699200 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:15:52 crc kubenswrapper[5120]: I0316 17:15:52.803565 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2ce2acf8-ebf6-4d0f-b85e-939686bd7484-config-data\") pod \"2ce2acf8-ebf6-4d0f-b85e-939686bd7484\" (UID: \"2ce2acf8-ebf6-4d0f-b85e-939686bd7484\") " Mar 16 17:15:52 crc kubenswrapper[5120]: I0316 17:15:52.803691 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2ce2acf8-ebf6-4d0f-b85e-939686bd7484-combined-ca-bundle\") pod \"2ce2acf8-ebf6-4d0f-b85e-939686bd7484\" (UID: \"2ce2acf8-ebf6-4d0f-b85e-939686bd7484\") " Mar 16 17:15:52 crc kubenswrapper[5120]: I0316 17:15:52.803743 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2ce2acf8-ebf6-4d0f-b85e-939686bd7484-log-httpd\") pod \"2ce2acf8-ebf6-4d0f-b85e-939686bd7484\" (UID: \"2ce2acf8-ebf6-4d0f-b85e-939686bd7484\") " Mar 16 17:15:52 crc kubenswrapper[5120]: I0316 17:15:52.803783 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7z4zv\" (UniqueName: \"kubernetes.io/projected/2ce2acf8-ebf6-4d0f-b85e-939686bd7484-kube-api-access-7z4zv\") pod \"2ce2acf8-ebf6-4d0f-b85e-939686bd7484\" (UID: \"2ce2acf8-ebf6-4d0f-b85e-939686bd7484\") " Mar 16 17:15:52 crc kubenswrapper[5120]: I0316 17:15:52.803818 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2ce2acf8-ebf6-4d0f-b85e-939686bd7484-run-httpd\") pod \"2ce2acf8-ebf6-4d0f-b85e-939686bd7484\" (UID: \"2ce2acf8-ebf6-4d0f-b85e-939686bd7484\") " Mar 16 17:15:52 crc kubenswrapper[5120]: I0316 17:15:52.803881 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/2ce2acf8-ebf6-4d0f-b85e-939686bd7484-sg-core-conf-yaml\") pod \"2ce2acf8-ebf6-4d0f-b85e-939686bd7484\" (UID: \"2ce2acf8-ebf6-4d0f-b85e-939686bd7484\") " Mar 16 17:15:52 crc kubenswrapper[5120]: I0316 17:15:52.804188 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2ce2acf8-ebf6-4d0f-b85e-939686bd7484-scripts\") pod \"2ce2acf8-ebf6-4d0f-b85e-939686bd7484\" (UID: \"2ce2acf8-ebf6-4d0f-b85e-939686bd7484\") " Mar 16 17:15:52 crc kubenswrapper[5120]: I0316 17:15:52.804440 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ce2acf8-ebf6-4d0f-b85e-939686bd7484-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "2ce2acf8-ebf6-4d0f-b85e-939686bd7484" (UID: "2ce2acf8-ebf6-4d0f-b85e-939686bd7484"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:15:52 crc kubenswrapper[5120]: I0316 17:15:52.805203 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2ce2acf8-ebf6-4d0f-b85e-939686bd7484-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 17:15:52 crc kubenswrapper[5120]: I0316 17:15:52.805197 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ce2acf8-ebf6-4d0f-b85e-939686bd7484-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "2ce2acf8-ebf6-4d0f-b85e-939686bd7484" (UID: "2ce2acf8-ebf6-4d0f-b85e-939686bd7484"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:15:52 crc kubenswrapper[5120]: I0316 17:15:52.809779 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ce2acf8-ebf6-4d0f-b85e-939686bd7484-kube-api-access-7z4zv" (OuterVolumeSpecName: "kube-api-access-7z4zv") pod "2ce2acf8-ebf6-4d0f-b85e-939686bd7484" (UID: "2ce2acf8-ebf6-4d0f-b85e-939686bd7484"). InnerVolumeSpecName "kube-api-access-7z4zv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:15:52 crc kubenswrapper[5120]: I0316 17:15:52.809894 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2ce2acf8-ebf6-4d0f-b85e-939686bd7484-scripts" (OuterVolumeSpecName: "scripts") pod "2ce2acf8-ebf6-4d0f-b85e-939686bd7484" (UID: "2ce2acf8-ebf6-4d0f-b85e-939686bd7484"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:15:52 crc kubenswrapper[5120]: I0316 17:15:52.811986 5120 generic.go:358] "Generic (PLEG): container finished" podID="2ce2acf8-ebf6-4d0f-b85e-939686bd7484" containerID="53e1794b854124fc61b3fd45102195ac9a1534adc3bdd8e2c371479d288d5a23" exitCode=0 Mar 16 17:15:52 crc kubenswrapper[5120]: I0316 17:15:52.812022 5120 generic.go:358] "Generic (PLEG): container finished" podID="2ce2acf8-ebf6-4d0f-b85e-939686bd7484" containerID="f08567ac288344a97a0a01a88918a9059d1c3092af31f1ab3d794bb7cbcf07bb" exitCode=2 Mar 16 17:15:52 crc kubenswrapper[5120]: I0316 17:15:52.812032 5120 generic.go:358] "Generic (PLEG): container finished" podID="2ce2acf8-ebf6-4d0f-b85e-939686bd7484" containerID="b18ca64131d930b835cf26cc5fb6f3b73bab634a2e236aad0a2b5d544af5762c" exitCode=0 Mar 16 17:15:52 crc kubenswrapper[5120]: I0316 17:15:52.812038 5120 generic.go:358] "Generic (PLEG): container finished" podID="2ce2acf8-ebf6-4d0f-b85e-939686bd7484" containerID="4eadf2e7c4aeaf895f2cd11656a17ec21e58c35a64023fcfaff86590d98d5678" exitCode=0 Mar 16 17:15:52 crc kubenswrapper[5120]: I0316 17:15:52.812058 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"2ce2acf8-ebf6-4d0f-b85e-939686bd7484","Type":"ContainerDied","Data":"53e1794b854124fc61b3fd45102195ac9a1534adc3bdd8e2c371479d288d5a23"} Mar 16 17:15:52 crc kubenswrapper[5120]: I0316 17:15:52.812118 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:15:52 crc kubenswrapper[5120]: I0316 17:15:52.812201 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"2ce2acf8-ebf6-4d0f-b85e-939686bd7484","Type":"ContainerDied","Data":"f08567ac288344a97a0a01a88918a9059d1c3092af31f1ab3d794bb7cbcf07bb"} Mar 16 17:15:52 crc kubenswrapper[5120]: I0316 17:15:52.812253 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"2ce2acf8-ebf6-4d0f-b85e-939686bd7484","Type":"ContainerDied","Data":"b18ca64131d930b835cf26cc5fb6f3b73bab634a2e236aad0a2b5d544af5762c"} Mar 16 17:15:52 crc kubenswrapper[5120]: I0316 17:15:52.812267 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"2ce2acf8-ebf6-4d0f-b85e-939686bd7484","Type":"ContainerDied","Data":"4eadf2e7c4aeaf895f2cd11656a17ec21e58c35a64023fcfaff86590d98d5678"} Mar 16 17:15:52 crc kubenswrapper[5120]: I0316 17:15:52.812278 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"2ce2acf8-ebf6-4d0f-b85e-939686bd7484","Type":"ContainerDied","Data":"f8eca8d2622f43cdaeb17949a4a7ef4b43c43d0dcd3dfcbd6db1344cdd20bbce"} Mar 16 17:15:52 crc kubenswrapper[5120]: I0316 17:15:52.812329 5120 scope.go:117] "RemoveContainer" containerID="53e1794b854124fc61b3fd45102195ac9a1534adc3bdd8e2c371479d288d5a23" Mar 16 17:15:52 crc kubenswrapper[5120]: I0316 17:15:52.835318 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2ce2acf8-ebf6-4d0f-b85e-939686bd7484-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "2ce2acf8-ebf6-4d0f-b85e-939686bd7484" (UID: "2ce2acf8-ebf6-4d0f-b85e-939686bd7484"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:15:52 crc kubenswrapper[5120]: I0316 17:15:52.837246 5120 scope.go:117] "RemoveContainer" containerID="f08567ac288344a97a0a01a88918a9059d1c3092af31f1ab3d794bb7cbcf07bb" Mar 16 17:15:52 crc kubenswrapper[5120]: I0316 17:15:52.859972 5120 scope.go:117] "RemoveContainer" containerID="b18ca64131d930b835cf26cc5fb6f3b73bab634a2e236aad0a2b5d544af5762c" Mar 16 17:15:52 crc kubenswrapper[5120]: I0316 17:15:52.888594 5120 scope.go:117] "RemoveContainer" containerID="4eadf2e7c4aeaf895f2cd11656a17ec21e58c35a64023fcfaff86590d98d5678" Mar 16 17:15:52 crc kubenswrapper[5120]: I0316 17:15:52.893029 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2ce2acf8-ebf6-4d0f-b85e-939686bd7484-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "2ce2acf8-ebf6-4d0f-b85e-939686bd7484" (UID: "2ce2acf8-ebf6-4d0f-b85e-939686bd7484"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:15:52 crc kubenswrapper[5120]: I0316 17:15:52.909055 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2ce2acf8-ebf6-4d0f-b85e-939686bd7484-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:15:52 crc kubenswrapper[5120]: I0316 17:15:52.909103 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2ce2acf8-ebf6-4d0f-b85e-939686bd7484-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:15:52 crc kubenswrapper[5120]: I0316 17:15:52.909121 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2ce2acf8-ebf6-4d0f-b85e-939686bd7484-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 17:15:52 crc kubenswrapper[5120]: I0316 17:15:52.909135 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7z4zv\" (UniqueName: \"kubernetes.io/projected/2ce2acf8-ebf6-4d0f-b85e-939686bd7484-kube-api-access-7z4zv\") on node \"crc\" DevicePath \"\"" Mar 16 17:15:52 crc kubenswrapper[5120]: I0316 17:15:52.909146 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/2ce2acf8-ebf6-4d0f-b85e-939686bd7484-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 17:15:52 crc kubenswrapper[5120]: I0316 17:15:52.910932 5120 scope.go:117] "RemoveContainer" containerID="53e1794b854124fc61b3fd45102195ac9a1534adc3bdd8e2c371479d288d5a23" Mar 16 17:15:52 crc kubenswrapper[5120]: E0316 17:15:52.911382 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"53e1794b854124fc61b3fd45102195ac9a1534adc3bdd8e2c371479d288d5a23\": container with ID starting with 53e1794b854124fc61b3fd45102195ac9a1534adc3bdd8e2c371479d288d5a23 not found: ID does not exist" containerID="53e1794b854124fc61b3fd45102195ac9a1534adc3bdd8e2c371479d288d5a23" Mar 16 17:15:52 crc kubenswrapper[5120]: I0316 17:15:52.911437 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53e1794b854124fc61b3fd45102195ac9a1534adc3bdd8e2c371479d288d5a23"} err="failed to get container status \"53e1794b854124fc61b3fd45102195ac9a1534adc3bdd8e2c371479d288d5a23\": rpc error: code = NotFound desc = could not find container \"53e1794b854124fc61b3fd45102195ac9a1534adc3bdd8e2c371479d288d5a23\": container with ID starting with 53e1794b854124fc61b3fd45102195ac9a1534adc3bdd8e2c371479d288d5a23 not found: ID does not exist" Mar 16 17:15:52 crc kubenswrapper[5120]: I0316 17:15:52.911474 5120 scope.go:117] "RemoveContainer" containerID="f08567ac288344a97a0a01a88918a9059d1c3092af31f1ab3d794bb7cbcf07bb" Mar 16 17:15:52 crc kubenswrapper[5120]: E0316 17:15:52.911823 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f08567ac288344a97a0a01a88918a9059d1c3092af31f1ab3d794bb7cbcf07bb\": container with ID starting with f08567ac288344a97a0a01a88918a9059d1c3092af31f1ab3d794bb7cbcf07bb not found: ID does not exist" containerID="f08567ac288344a97a0a01a88918a9059d1c3092af31f1ab3d794bb7cbcf07bb" Mar 16 17:15:52 crc kubenswrapper[5120]: I0316 17:15:52.911862 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f08567ac288344a97a0a01a88918a9059d1c3092af31f1ab3d794bb7cbcf07bb"} err="failed to get container status \"f08567ac288344a97a0a01a88918a9059d1c3092af31f1ab3d794bb7cbcf07bb\": rpc error: code = NotFound desc = could not find container \"f08567ac288344a97a0a01a88918a9059d1c3092af31f1ab3d794bb7cbcf07bb\": container with ID starting with f08567ac288344a97a0a01a88918a9059d1c3092af31f1ab3d794bb7cbcf07bb not found: ID does not exist" Mar 16 17:15:52 crc kubenswrapper[5120]: I0316 17:15:52.911887 5120 scope.go:117] "RemoveContainer" containerID="b18ca64131d930b835cf26cc5fb6f3b73bab634a2e236aad0a2b5d544af5762c" Mar 16 17:15:52 crc kubenswrapper[5120]: E0316 17:15:52.912115 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b18ca64131d930b835cf26cc5fb6f3b73bab634a2e236aad0a2b5d544af5762c\": container with ID starting with b18ca64131d930b835cf26cc5fb6f3b73bab634a2e236aad0a2b5d544af5762c not found: ID does not exist" containerID="b18ca64131d930b835cf26cc5fb6f3b73bab634a2e236aad0a2b5d544af5762c" Mar 16 17:15:52 crc kubenswrapper[5120]: I0316 17:15:52.912148 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b18ca64131d930b835cf26cc5fb6f3b73bab634a2e236aad0a2b5d544af5762c"} err="failed to get container status \"b18ca64131d930b835cf26cc5fb6f3b73bab634a2e236aad0a2b5d544af5762c\": rpc error: code = NotFound desc = could not find container \"b18ca64131d930b835cf26cc5fb6f3b73bab634a2e236aad0a2b5d544af5762c\": container with ID starting with b18ca64131d930b835cf26cc5fb6f3b73bab634a2e236aad0a2b5d544af5762c not found: ID does not exist" Mar 16 17:15:52 crc kubenswrapper[5120]: I0316 17:15:52.912165 5120 scope.go:117] "RemoveContainer" containerID="4eadf2e7c4aeaf895f2cd11656a17ec21e58c35a64023fcfaff86590d98d5678" Mar 16 17:15:52 crc kubenswrapper[5120]: E0316 17:15:52.912578 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4eadf2e7c4aeaf895f2cd11656a17ec21e58c35a64023fcfaff86590d98d5678\": container with ID starting with 4eadf2e7c4aeaf895f2cd11656a17ec21e58c35a64023fcfaff86590d98d5678 not found: ID does not exist" containerID="4eadf2e7c4aeaf895f2cd11656a17ec21e58c35a64023fcfaff86590d98d5678" Mar 16 17:15:52 crc kubenswrapper[5120]: I0316 17:15:52.912629 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4eadf2e7c4aeaf895f2cd11656a17ec21e58c35a64023fcfaff86590d98d5678"} err="failed to get container status \"4eadf2e7c4aeaf895f2cd11656a17ec21e58c35a64023fcfaff86590d98d5678\": rpc error: code = NotFound desc = could not find container \"4eadf2e7c4aeaf895f2cd11656a17ec21e58c35a64023fcfaff86590d98d5678\": container with ID starting with 4eadf2e7c4aeaf895f2cd11656a17ec21e58c35a64023fcfaff86590d98d5678 not found: ID does not exist" Mar 16 17:15:52 crc kubenswrapper[5120]: I0316 17:15:52.912694 5120 scope.go:117] "RemoveContainer" containerID="53e1794b854124fc61b3fd45102195ac9a1534adc3bdd8e2c371479d288d5a23" Mar 16 17:15:52 crc kubenswrapper[5120]: I0316 17:15:52.913070 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53e1794b854124fc61b3fd45102195ac9a1534adc3bdd8e2c371479d288d5a23"} err="failed to get container status \"53e1794b854124fc61b3fd45102195ac9a1534adc3bdd8e2c371479d288d5a23\": rpc error: code = NotFound desc = could not find container \"53e1794b854124fc61b3fd45102195ac9a1534adc3bdd8e2c371479d288d5a23\": container with ID starting with 53e1794b854124fc61b3fd45102195ac9a1534adc3bdd8e2c371479d288d5a23 not found: ID does not exist" Mar 16 17:15:52 crc kubenswrapper[5120]: I0316 17:15:52.913094 5120 scope.go:117] "RemoveContainer" containerID="f08567ac288344a97a0a01a88918a9059d1c3092af31f1ab3d794bb7cbcf07bb" Mar 16 17:15:52 crc kubenswrapper[5120]: I0316 17:15:52.913386 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f08567ac288344a97a0a01a88918a9059d1c3092af31f1ab3d794bb7cbcf07bb"} err="failed to get container status \"f08567ac288344a97a0a01a88918a9059d1c3092af31f1ab3d794bb7cbcf07bb\": rpc error: code = NotFound desc = could not find container \"f08567ac288344a97a0a01a88918a9059d1c3092af31f1ab3d794bb7cbcf07bb\": container with ID starting with f08567ac288344a97a0a01a88918a9059d1c3092af31f1ab3d794bb7cbcf07bb not found: ID does not exist" Mar 16 17:15:52 crc kubenswrapper[5120]: I0316 17:15:52.913415 5120 scope.go:117] "RemoveContainer" containerID="b18ca64131d930b835cf26cc5fb6f3b73bab634a2e236aad0a2b5d544af5762c" Mar 16 17:15:52 crc kubenswrapper[5120]: I0316 17:15:52.913721 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b18ca64131d930b835cf26cc5fb6f3b73bab634a2e236aad0a2b5d544af5762c"} err="failed to get container status \"b18ca64131d930b835cf26cc5fb6f3b73bab634a2e236aad0a2b5d544af5762c\": rpc error: code = NotFound desc = could not find container \"b18ca64131d930b835cf26cc5fb6f3b73bab634a2e236aad0a2b5d544af5762c\": container with ID starting with b18ca64131d930b835cf26cc5fb6f3b73bab634a2e236aad0a2b5d544af5762c not found: ID does not exist" Mar 16 17:15:52 crc kubenswrapper[5120]: I0316 17:15:52.913751 5120 scope.go:117] "RemoveContainer" containerID="4eadf2e7c4aeaf895f2cd11656a17ec21e58c35a64023fcfaff86590d98d5678" Mar 16 17:15:52 crc kubenswrapper[5120]: I0316 17:15:52.914018 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4eadf2e7c4aeaf895f2cd11656a17ec21e58c35a64023fcfaff86590d98d5678"} err="failed to get container status \"4eadf2e7c4aeaf895f2cd11656a17ec21e58c35a64023fcfaff86590d98d5678\": rpc error: code = NotFound desc = could not find container \"4eadf2e7c4aeaf895f2cd11656a17ec21e58c35a64023fcfaff86590d98d5678\": container with ID starting with 4eadf2e7c4aeaf895f2cd11656a17ec21e58c35a64023fcfaff86590d98d5678 not found: ID does not exist" Mar 16 17:15:52 crc kubenswrapper[5120]: I0316 17:15:52.914044 5120 scope.go:117] "RemoveContainer" containerID="53e1794b854124fc61b3fd45102195ac9a1534adc3bdd8e2c371479d288d5a23" Mar 16 17:15:52 crc kubenswrapper[5120]: I0316 17:15:52.914274 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53e1794b854124fc61b3fd45102195ac9a1534adc3bdd8e2c371479d288d5a23"} err="failed to get container status \"53e1794b854124fc61b3fd45102195ac9a1534adc3bdd8e2c371479d288d5a23\": rpc error: code = NotFound desc = could not find container \"53e1794b854124fc61b3fd45102195ac9a1534adc3bdd8e2c371479d288d5a23\": container with ID starting with 53e1794b854124fc61b3fd45102195ac9a1534adc3bdd8e2c371479d288d5a23 not found: ID does not exist" Mar 16 17:15:52 crc kubenswrapper[5120]: I0316 17:15:52.914302 5120 scope.go:117] "RemoveContainer" containerID="f08567ac288344a97a0a01a88918a9059d1c3092af31f1ab3d794bb7cbcf07bb" Mar 16 17:15:52 crc kubenswrapper[5120]: I0316 17:15:52.914540 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f08567ac288344a97a0a01a88918a9059d1c3092af31f1ab3d794bb7cbcf07bb"} err="failed to get container status \"f08567ac288344a97a0a01a88918a9059d1c3092af31f1ab3d794bb7cbcf07bb\": rpc error: code = NotFound desc = could not find container \"f08567ac288344a97a0a01a88918a9059d1c3092af31f1ab3d794bb7cbcf07bb\": container with ID starting with f08567ac288344a97a0a01a88918a9059d1c3092af31f1ab3d794bb7cbcf07bb not found: ID does not exist" Mar 16 17:15:52 crc kubenswrapper[5120]: I0316 17:15:52.914566 5120 scope.go:117] "RemoveContainer" containerID="b18ca64131d930b835cf26cc5fb6f3b73bab634a2e236aad0a2b5d544af5762c" Mar 16 17:15:52 crc kubenswrapper[5120]: I0316 17:15:52.914859 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b18ca64131d930b835cf26cc5fb6f3b73bab634a2e236aad0a2b5d544af5762c"} err="failed to get container status \"b18ca64131d930b835cf26cc5fb6f3b73bab634a2e236aad0a2b5d544af5762c\": rpc error: code = NotFound desc = could not find container \"b18ca64131d930b835cf26cc5fb6f3b73bab634a2e236aad0a2b5d544af5762c\": container with ID starting with b18ca64131d930b835cf26cc5fb6f3b73bab634a2e236aad0a2b5d544af5762c not found: ID does not exist" Mar 16 17:15:52 crc kubenswrapper[5120]: I0316 17:15:52.914883 5120 scope.go:117] "RemoveContainer" containerID="4eadf2e7c4aeaf895f2cd11656a17ec21e58c35a64023fcfaff86590d98d5678" Mar 16 17:15:52 crc kubenswrapper[5120]: I0316 17:15:52.915508 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4eadf2e7c4aeaf895f2cd11656a17ec21e58c35a64023fcfaff86590d98d5678"} err="failed to get container status \"4eadf2e7c4aeaf895f2cd11656a17ec21e58c35a64023fcfaff86590d98d5678\": rpc error: code = NotFound desc = could not find container \"4eadf2e7c4aeaf895f2cd11656a17ec21e58c35a64023fcfaff86590d98d5678\": container with ID starting with 4eadf2e7c4aeaf895f2cd11656a17ec21e58c35a64023fcfaff86590d98d5678 not found: ID does not exist" Mar 16 17:15:52 crc kubenswrapper[5120]: I0316 17:15:52.915542 5120 scope.go:117] "RemoveContainer" containerID="53e1794b854124fc61b3fd45102195ac9a1534adc3bdd8e2c371479d288d5a23" Mar 16 17:15:52 crc kubenswrapper[5120]: I0316 17:15:52.915809 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53e1794b854124fc61b3fd45102195ac9a1534adc3bdd8e2c371479d288d5a23"} err="failed to get container status \"53e1794b854124fc61b3fd45102195ac9a1534adc3bdd8e2c371479d288d5a23\": rpc error: code = NotFound desc = could not find container \"53e1794b854124fc61b3fd45102195ac9a1534adc3bdd8e2c371479d288d5a23\": container with ID starting with 53e1794b854124fc61b3fd45102195ac9a1534adc3bdd8e2c371479d288d5a23 not found: ID does not exist" Mar 16 17:15:52 crc kubenswrapper[5120]: I0316 17:15:52.915835 5120 scope.go:117] "RemoveContainer" containerID="f08567ac288344a97a0a01a88918a9059d1c3092af31f1ab3d794bb7cbcf07bb" Mar 16 17:15:52 crc kubenswrapper[5120]: I0316 17:15:52.916186 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f08567ac288344a97a0a01a88918a9059d1c3092af31f1ab3d794bb7cbcf07bb"} err="failed to get container status \"f08567ac288344a97a0a01a88918a9059d1c3092af31f1ab3d794bb7cbcf07bb\": rpc error: code = NotFound desc = could not find container \"f08567ac288344a97a0a01a88918a9059d1c3092af31f1ab3d794bb7cbcf07bb\": container with ID starting with f08567ac288344a97a0a01a88918a9059d1c3092af31f1ab3d794bb7cbcf07bb not found: ID does not exist" Mar 16 17:15:52 crc kubenswrapper[5120]: I0316 17:15:52.916214 5120 scope.go:117] "RemoveContainer" containerID="b18ca64131d930b835cf26cc5fb6f3b73bab634a2e236aad0a2b5d544af5762c" Mar 16 17:15:52 crc kubenswrapper[5120]: I0316 17:15:52.916436 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b18ca64131d930b835cf26cc5fb6f3b73bab634a2e236aad0a2b5d544af5762c"} err="failed to get container status \"b18ca64131d930b835cf26cc5fb6f3b73bab634a2e236aad0a2b5d544af5762c\": rpc error: code = NotFound desc = could not find container \"b18ca64131d930b835cf26cc5fb6f3b73bab634a2e236aad0a2b5d544af5762c\": container with ID starting with b18ca64131d930b835cf26cc5fb6f3b73bab634a2e236aad0a2b5d544af5762c not found: ID does not exist" Mar 16 17:15:52 crc kubenswrapper[5120]: I0316 17:15:52.916458 5120 scope.go:117] "RemoveContainer" containerID="4eadf2e7c4aeaf895f2cd11656a17ec21e58c35a64023fcfaff86590d98d5678" Mar 16 17:15:52 crc kubenswrapper[5120]: I0316 17:15:52.916687 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4eadf2e7c4aeaf895f2cd11656a17ec21e58c35a64023fcfaff86590d98d5678"} err="failed to get container status \"4eadf2e7c4aeaf895f2cd11656a17ec21e58c35a64023fcfaff86590d98d5678\": rpc error: code = NotFound desc = could not find container \"4eadf2e7c4aeaf895f2cd11656a17ec21e58c35a64023fcfaff86590d98d5678\": container with ID starting with 4eadf2e7c4aeaf895f2cd11656a17ec21e58c35a64023fcfaff86590d98d5678 not found: ID does not exist" Mar 16 17:15:52 crc kubenswrapper[5120]: I0316 17:15:52.924385 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2ce2acf8-ebf6-4d0f-b85e-939686bd7484-config-data" (OuterVolumeSpecName: "config-data") pod "2ce2acf8-ebf6-4d0f-b85e-939686bd7484" (UID: "2ce2acf8-ebf6-4d0f-b85e-939686bd7484"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:15:53 crc kubenswrapper[5120]: I0316 17:15:53.011534 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2ce2acf8-ebf6-4d0f-b85e-939686bd7484-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:15:53 crc kubenswrapper[5120]: I0316 17:15:53.148787 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:15:53 crc kubenswrapper[5120]: I0316 17:15:53.162221 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:15:53 crc kubenswrapper[5120]: I0316 17:15:53.174834 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:15:53 crc kubenswrapper[5120]: I0316 17:15:53.176010 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ce2acf8-ebf6-4d0f-b85e-939686bd7484" containerName="sg-core" Mar 16 17:15:53 crc kubenswrapper[5120]: I0316 17:15:53.176032 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ce2acf8-ebf6-4d0f-b85e-939686bd7484" containerName="sg-core" Mar 16 17:15:53 crc kubenswrapper[5120]: I0316 17:15:53.176052 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ce2acf8-ebf6-4d0f-b85e-939686bd7484" containerName="ceilometer-notification-agent" Mar 16 17:15:53 crc kubenswrapper[5120]: I0316 17:15:53.176059 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ce2acf8-ebf6-4d0f-b85e-939686bd7484" containerName="ceilometer-notification-agent" Mar 16 17:15:53 crc kubenswrapper[5120]: I0316 17:15:53.176072 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ce2acf8-ebf6-4d0f-b85e-939686bd7484" containerName="ceilometer-central-agent" Mar 16 17:15:53 crc kubenswrapper[5120]: I0316 17:15:53.176078 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ce2acf8-ebf6-4d0f-b85e-939686bd7484" containerName="ceilometer-central-agent" Mar 16 17:15:53 crc kubenswrapper[5120]: I0316 17:15:53.176088 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ce2acf8-ebf6-4d0f-b85e-939686bd7484" containerName="proxy-httpd" Mar 16 17:15:53 crc kubenswrapper[5120]: I0316 17:15:53.176093 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ce2acf8-ebf6-4d0f-b85e-939686bd7484" containerName="proxy-httpd" Mar 16 17:15:53 crc kubenswrapper[5120]: I0316 17:15:53.176304 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="2ce2acf8-ebf6-4d0f-b85e-939686bd7484" containerName="sg-core" Mar 16 17:15:53 crc kubenswrapper[5120]: I0316 17:15:53.176323 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="2ce2acf8-ebf6-4d0f-b85e-939686bd7484" containerName="ceilometer-central-agent" Mar 16 17:15:53 crc kubenswrapper[5120]: I0316 17:15:53.176333 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="2ce2acf8-ebf6-4d0f-b85e-939686bd7484" containerName="proxy-httpd" Mar 16 17:15:53 crc kubenswrapper[5120]: I0316 17:15:53.176339 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="2ce2acf8-ebf6-4d0f-b85e-939686bd7484" containerName="ceilometer-notification-agent" Mar 16 17:15:53 crc kubenswrapper[5120]: I0316 17:15:53.189546 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:15:53 crc kubenswrapper[5120]: I0316 17:15:53.189698 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:15:53 crc kubenswrapper[5120]: I0316 17:15:53.192173 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 17:15:53 crc kubenswrapper[5120]: I0316 17:15:53.192693 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 17:15:53 crc kubenswrapper[5120]: I0316 17:15:53.319588 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cee976d8-b886-4c83-8338-dec65593db27-config-data\") pod \"ceilometer-0\" (UID: \"cee976d8-b886-4c83-8338-dec65593db27\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:15:53 crc kubenswrapper[5120]: I0316 17:15:53.319673 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/cee976d8-b886-4c83-8338-dec65593db27-run-httpd\") pod \"ceilometer-0\" (UID: \"cee976d8-b886-4c83-8338-dec65593db27\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:15:53 crc kubenswrapper[5120]: I0316 17:15:53.319726 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/cee976d8-b886-4c83-8338-dec65593db27-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"cee976d8-b886-4c83-8338-dec65593db27\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:15:53 crc kubenswrapper[5120]: I0316 17:15:53.319832 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/cee976d8-b886-4c83-8338-dec65593db27-scripts\") pod \"ceilometer-0\" (UID: \"cee976d8-b886-4c83-8338-dec65593db27\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:15:53 crc kubenswrapper[5120]: I0316 17:15:53.319857 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7t9k\" (UniqueName: \"kubernetes.io/projected/cee976d8-b886-4c83-8338-dec65593db27-kube-api-access-k7t9k\") pod \"ceilometer-0\" (UID: \"cee976d8-b886-4c83-8338-dec65593db27\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:15:53 crc kubenswrapper[5120]: I0316 17:15:53.320616 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/cee976d8-b886-4c83-8338-dec65593db27-log-httpd\") pod \"ceilometer-0\" (UID: \"cee976d8-b886-4c83-8338-dec65593db27\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:15:53 crc kubenswrapper[5120]: I0316 17:15:53.321095 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cee976d8-b886-4c83-8338-dec65593db27-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"cee976d8-b886-4c83-8338-dec65593db27\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:15:53 crc kubenswrapper[5120]: I0316 17:15:53.423547 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cee976d8-b886-4c83-8338-dec65593db27-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"cee976d8-b886-4c83-8338-dec65593db27\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:15:53 crc kubenswrapper[5120]: I0316 17:15:53.423681 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cee976d8-b886-4c83-8338-dec65593db27-config-data\") pod \"ceilometer-0\" (UID: \"cee976d8-b886-4c83-8338-dec65593db27\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:15:53 crc kubenswrapper[5120]: I0316 17:15:53.423751 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/cee976d8-b886-4c83-8338-dec65593db27-run-httpd\") pod \"ceilometer-0\" (UID: \"cee976d8-b886-4c83-8338-dec65593db27\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:15:53 crc kubenswrapper[5120]: I0316 17:15:53.423823 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/cee976d8-b886-4c83-8338-dec65593db27-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"cee976d8-b886-4c83-8338-dec65593db27\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:15:53 crc kubenswrapper[5120]: I0316 17:15:53.423915 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/cee976d8-b886-4c83-8338-dec65593db27-scripts\") pod \"ceilometer-0\" (UID: \"cee976d8-b886-4c83-8338-dec65593db27\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:15:53 crc kubenswrapper[5120]: I0316 17:15:53.423938 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k7t9k\" (UniqueName: \"kubernetes.io/projected/cee976d8-b886-4c83-8338-dec65593db27-kube-api-access-k7t9k\") pod \"ceilometer-0\" (UID: \"cee976d8-b886-4c83-8338-dec65593db27\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:15:53 crc kubenswrapper[5120]: I0316 17:15:53.423997 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/cee976d8-b886-4c83-8338-dec65593db27-log-httpd\") pod \"ceilometer-0\" (UID: \"cee976d8-b886-4c83-8338-dec65593db27\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:15:53 crc kubenswrapper[5120]: I0316 17:15:53.424594 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/cee976d8-b886-4c83-8338-dec65593db27-log-httpd\") pod \"ceilometer-0\" (UID: \"cee976d8-b886-4c83-8338-dec65593db27\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:15:53 crc kubenswrapper[5120]: I0316 17:15:53.424867 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/cee976d8-b886-4c83-8338-dec65593db27-run-httpd\") pod \"ceilometer-0\" (UID: \"cee976d8-b886-4c83-8338-dec65593db27\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:15:53 crc kubenswrapper[5120]: I0316 17:15:53.428694 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cee976d8-b886-4c83-8338-dec65593db27-config-data\") pod \"ceilometer-0\" (UID: \"cee976d8-b886-4c83-8338-dec65593db27\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:15:53 crc kubenswrapper[5120]: I0316 17:15:53.435505 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/cee976d8-b886-4c83-8338-dec65593db27-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"cee976d8-b886-4c83-8338-dec65593db27\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:15:53 crc kubenswrapper[5120]: I0316 17:15:53.436832 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/cee976d8-b886-4c83-8338-dec65593db27-scripts\") pod \"ceilometer-0\" (UID: \"cee976d8-b886-4c83-8338-dec65593db27\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:15:53 crc kubenswrapper[5120]: I0316 17:15:53.440493 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cee976d8-b886-4c83-8338-dec65593db27-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"cee976d8-b886-4c83-8338-dec65593db27\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:15:53 crc kubenswrapper[5120]: I0316 17:15:53.444756 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7t9k\" (UniqueName: \"kubernetes.io/projected/cee976d8-b886-4c83-8338-dec65593db27-kube-api-access-k7t9k\") pod \"ceilometer-0\" (UID: \"cee976d8-b886-4c83-8338-dec65593db27\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:15:53 crc kubenswrapper[5120]: I0316 17:15:53.554841 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:15:54 crc kubenswrapper[5120]: I0316 17:15:54.011543 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:15:54 crc kubenswrapper[5120]: I0316 17:15:54.680488 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2ce2acf8-ebf6-4d0f-b85e-939686bd7484" path="/var/lib/kubelet/pods/2ce2acf8-ebf6-4d0f-b85e-939686bd7484/volumes" Mar 16 17:15:54 crc kubenswrapper[5120]: I0316 17:15:54.832802 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"cee976d8-b886-4c83-8338-dec65593db27","Type":"ContainerStarted","Data":"8e966e7a3db58c0ea0cbcd320352f7c37ff60c65ba460cbea2a206ae8bc85a03"} Mar 16 17:15:54 crc kubenswrapper[5120]: I0316 17:15:54.833188 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"cee976d8-b886-4c83-8338-dec65593db27","Type":"ContainerStarted","Data":"abed367bd104af7765ed2ff613f1677358faa58d59f446060c2e27562d56c7f1"} Mar 16 17:15:55 crc kubenswrapper[5120]: I0316 17:15:55.136963 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:15:55 crc kubenswrapper[5120]: I0316 17:15:55.137019 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:15:55 crc kubenswrapper[5120]: I0316 17:15:55.844719 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"cee976d8-b886-4c83-8338-dec65593db27","Type":"ContainerStarted","Data":"53dee9ec6f61b3c2fe3a98dba73419658c1a5e8068004e03d249fb113db99fb1"} Mar 16 17:15:56 crc kubenswrapper[5120]: I0316 17:15:56.149076 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="ef7c6f1d-0e78-43bf-99c4-9200f5e67136" containerName="nova-api-api" probeResult="failure" output="Get \"https://10.217.0.215:8774/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Mar 16 17:15:56 crc kubenswrapper[5120]: I0316 17:15:56.149077 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="ef7c6f1d-0e78-43bf-99c4-9200f5e67136" containerName="nova-api-log" probeResult="failure" output="Get \"https://10.217.0.215:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 17:15:56 crc kubenswrapper[5120]: I0316 17:15:56.855975 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"cee976d8-b886-4c83-8338-dec65593db27","Type":"ContainerStarted","Data":"b1bb1b4ab057a25df9b631fc57e4802bf0bba47050f57936fc34c73572f29c74"} Mar 16 17:15:59 crc kubenswrapper[5120]: I0316 17:15:59.885771 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"cee976d8-b886-4c83-8338-dec65593db27","Type":"ContainerStarted","Data":"7b3605121dfcb41904c93ec2bbb8ad37d6a6e38ef76cb5f399e9242f155e315c"} Mar 16 17:15:59 crc kubenswrapper[5120]: I0316 17:15:59.886367 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:15:59 crc kubenswrapper[5120]: I0316 17:15:59.915115 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.259359907 podStartE2EDuration="6.915090084s" podCreationTimestamp="2026-03-16 17:15:53 +0000 UTC" firstStartedPulling="2026-03-16 17:15:54.015197978 +0000 UTC m=+6256.169129635" lastFinishedPulling="2026-03-16 17:15:58.670928155 +0000 UTC m=+6260.824859812" observedRunningTime="2026-03-16 17:15:59.902341046 +0000 UTC m=+6262.056272703" watchObservedRunningTime="2026-03-16 17:15:59.915090084 +0000 UTC m=+6262.069021741" Mar 16 17:16:00 crc kubenswrapper[5120]: I0316 17:16:00.149890 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-infra/auto-csr-approver-29561356-xzfvc"] Mar 16 17:16:00 crc kubenswrapper[5120]: I0316 17:16:00.156708 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561356-xzfvc" Mar 16 17:16:00 crc kubenswrapper[5120]: I0316 17:16:00.158954 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"kube-root-ca.crt\"" Mar 16 17:16:00 crc kubenswrapper[5120]: I0316 17:16:00.160252 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"openshift-service-ca.crt\"" Mar 16 17:16:00 crc kubenswrapper[5120]: I0316 17:16:00.160464 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-infra\"/\"csr-approver-sa-dockercfg-x2nsz\"" Mar 16 17:16:00 crc kubenswrapper[5120]: I0316 17:16:00.164218 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561356-xzfvc"] Mar 16 17:16:00 crc kubenswrapper[5120]: I0316 17:16:00.249750 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d87j9\" (UniqueName: \"kubernetes.io/projected/4a90b6ba-7b58-4ed4-bce7-a09a38c07811-kube-api-access-d87j9\") pod \"auto-csr-approver-29561356-xzfvc\" (UID: \"4a90b6ba-7b58-4ed4-bce7-a09a38c07811\") " pod="openshift-infra/auto-csr-approver-29561356-xzfvc" Mar 16 17:16:00 crc kubenswrapper[5120]: I0316 17:16:00.353082 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d87j9\" (UniqueName: \"kubernetes.io/projected/4a90b6ba-7b58-4ed4-bce7-a09a38c07811-kube-api-access-d87j9\") pod \"auto-csr-approver-29561356-xzfvc\" (UID: \"4a90b6ba-7b58-4ed4-bce7-a09a38c07811\") " pod="openshift-infra/auto-csr-approver-29561356-xzfvc" Mar 16 17:16:00 crc kubenswrapper[5120]: I0316 17:16:00.372022 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d87j9\" (UniqueName: \"kubernetes.io/projected/4a90b6ba-7b58-4ed4-bce7-a09a38c07811-kube-api-access-d87j9\") pod \"auto-csr-approver-29561356-xzfvc\" (UID: \"4a90b6ba-7b58-4ed4-bce7-a09a38c07811\") " pod="openshift-infra/auto-csr-approver-29561356-xzfvc" Mar 16 17:16:00 crc kubenswrapper[5120]: I0316 17:16:00.484073 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561356-xzfvc" Mar 16 17:16:00 crc kubenswrapper[5120]: I0316 17:16:00.927298 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561356-xzfvc"] Mar 16 17:16:00 crc kubenswrapper[5120]: W0316 17:16:00.930752 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4a90b6ba_7b58_4ed4_bce7_a09a38c07811.slice/crio-66a223abf7f959074d56952943867686aaf08ebb65ecc976f1c8c6f1d07f8b12 WatchSource:0}: Error finding container 66a223abf7f959074d56952943867686aaf08ebb65ecc976f1c8c6f1d07f8b12: Status 404 returned error can't find the container with id 66a223abf7f959074d56952943867686aaf08ebb65ecc976f1c8c6f1d07f8b12 Mar 16 17:16:00 crc kubenswrapper[5120]: I0316 17:16:00.932512 5120 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Mar 16 17:16:01 crc kubenswrapper[5120]: I0316 17:16:01.915045 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561356-xzfvc" event={"ID":"4a90b6ba-7b58-4ed4-bce7-a09a38c07811","Type":"ContainerStarted","Data":"66a223abf7f959074d56952943867686aaf08ebb65ecc976f1c8c6f1d07f8b12"} Mar 16 17:16:02 crc kubenswrapper[5120]: I0316 17:16:02.927906 5120 generic.go:358] "Generic (PLEG): container finished" podID="4a90b6ba-7b58-4ed4-bce7-a09a38c07811" containerID="1f033c1078ab366c878ef0f91d47853f19b234f5aabc572bf79644c1cbe72955" exitCode=0 Mar 16 17:16:02 crc kubenswrapper[5120]: I0316 17:16:02.928057 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561356-xzfvc" event={"ID":"4a90b6ba-7b58-4ed4-bce7-a09a38c07811","Type":"ContainerDied","Data":"1f033c1078ab366c878ef0f91d47853f19b234f5aabc572bf79644c1cbe72955"} Mar 16 17:16:03 crc kubenswrapper[5120]: I0316 17:16:03.137248 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:16:03 crc kubenswrapper[5120]: I0316 17:16:03.137567 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:16:04 crc kubenswrapper[5120]: I0316 17:16:04.350423 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561356-xzfvc" Mar 16 17:16:04 crc kubenswrapper[5120]: I0316 17:16:04.379536 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d87j9\" (UniqueName: \"kubernetes.io/projected/4a90b6ba-7b58-4ed4-bce7-a09a38c07811-kube-api-access-d87j9\") pod \"4a90b6ba-7b58-4ed4-bce7-a09a38c07811\" (UID: \"4a90b6ba-7b58-4ed4-bce7-a09a38c07811\") " Mar 16 17:16:04 crc kubenswrapper[5120]: I0316 17:16:04.388211 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a90b6ba-7b58-4ed4-bce7-a09a38c07811-kube-api-access-d87j9" (OuterVolumeSpecName: "kube-api-access-d87j9") pod "4a90b6ba-7b58-4ed4-bce7-a09a38c07811" (UID: "4a90b6ba-7b58-4ed4-bce7-a09a38c07811"). InnerVolumeSpecName "kube-api-access-d87j9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:16:04 crc kubenswrapper[5120]: I0316 17:16:04.482746 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d87j9\" (UniqueName: \"kubernetes.io/projected/4a90b6ba-7b58-4ed4-bce7-a09a38c07811-kube-api-access-d87j9\") on node \"crc\" DevicePath \"\"" Mar 16 17:16:04 crc kubenswrapper[5120]: I0316 17:16:04.954379 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561356-xzfvc" event={"ID":"4a90b6ba-7b58-4ed4-bce7-a09a38c07811","Type":"ContainerDied","Data":"66a223abf7f959074d56952943867686aaf08ebb65ecc976f1c8c6f1d07f8b12"} Mar 16 17:16:04 crc kubenswrapper[5120]: I0316 17:16:04.954445 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="66a223abf7f959074d56952943867686aaf08ebb65ecc976f1c8c6f1d07f8b12" Mar 16 17:16:04 crc kubenswrapper[5120]: I0316 17:16:04.954417 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561356-xzfvc" Mar 16 17:16:05 crc kubenswrapper[5120]: I0316 17:16:05.146705 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:16:05 crc kubenswrapper[5120]: I0316 17:16:05.148809 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:16:05 crc kubenswrapper[5120]: I0316 17:16:05.154345 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:16:05 crc kubenswrapper[5120]: I0316 17:16:05.424549 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-infra/auto-csr-approver-29561350-z5wc4"] Mar 16 17:16:05 crc kubenswrapper[5120]: I0316 17:16:05.434823 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-infra/auto-csr-approver-29561350-z5wc4"] Mar 16 17:16:05 crc kubenswrapper[5120]: I0316 17:16:05.971925 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:16:07 crc kubenswrapper[5120]: I0316 17:16:07.541358 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="36c840f9-b8cf-4aff-b328-7710c04683ad" path="/var/lib/kubelet/pods/36c840f9-b8cf-4aff-b328-7710c04683ad/volumes" Mar 16 17:16:07 crc kubenswrapper[5120]: E0316 17:16:07.858471 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1873669 actualBytes=10240 Mar 16 17:16:13 crc kubenswrapper[5120]: I0316 17:16:13.292106 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/community-operators-wdlhp"] Mar 16 17:16:13 crc kubenswrapper[5120]: I0316 17:16:13.294922 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a90b6ba-7b58-4ed4-bce7-a09a38c07811" containerName="oc" Mar 16 17:16:13 crc kubenswrapper[5120]: I0316 17:16:13.295031 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a90b6ba-7b58-4ed4-bce7-a09a38c07811" containerName="oc" Mar 16 17:16:13 crc kubenswrapper[5120]: I0316 17:16:13.295354 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="4a90b6ba-7b58-4ed4-bce7-a09a38c07811" containerName="oc" Mar 16 17:16:13 crc kubenswrapper[5120]: I0316 17:16:13.312087 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/community-operators-wdlhp"] Mar 16 17:16:13 crc kubenswrapper[5120]: I0316 17:16:13.312270 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-wdlhp" Mar 16 17:16:13 crc kubenswrapper[5120]: I0316 17:16:13.350421 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/becedcd4-1438-43f9-9395-33bef0e28231-catalog-content\") pod \"community-operators-wdlhp\" (UID: \"becedcd4-1438-43f9-9395-33bef0e28231\") " pod="openshift-marketplace/community-operators-wdlhp" Mar 16 17:16:13 crc kubenswrapper[5120]: I0316 17:16:13.350620 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/becedcd4-1438-43f9-9395-33bef0e28231-utilities\") pod \"community-operators-wdlhp\" (UID: \"becedcd4-1438-43f9-9395-33bef0e28231\") " pod="openshift-marketplace/community-operators-wdlhp" Mar 16 17:16:13 crc kubenswrapper[5120]: I0316 17:16:13.350826 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thqqq\" (UniqueName: \"kubernetes.io/projected/becedcd4-1438-43f9-9395-33bef0e28231-kube-api-access-thqqq\") pod \"community-operators-wdlhp\" (UID: \"becedcd4-1438-43f9-9395-33bef0e28231\") " pod="openshift-marketplace/community-operators-wdlhp" Mar 16 17:16:13 crc kubenswrapper[5120]: I0316 17:16:13.453579 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/becedcd4-1438-43f9-9395-33bef0e28231-catalog-content\") pod \"community-operators-wdlhp\" (UID: \"becedcd4-1438-43f9-9395-33bef0e28231\") " pod="openshift-marketplace/community-operators-wdlhp" Mar 16 17:16:13 crc kubenswrapper[5120]: I0316 17:16:13.453949 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/becedcd4-1438-43f9-9395-33bef0e28231-utilities\") pod \"community-operators-wdlhp\" (UID: \"becedcd4-1438-43f9-9395-33bef0e28231\") " pod="openshift-marketplace/community-operators-wdlhp" Mar 16 17:16:13 crc kubenswrapper[5120]: I0316 17:16:13.454101 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-thqqq\" (UniqueName: \"kubernetes.io/projected/becedcd4-1438-43f9-9395-33bef0e28231-kube-api-access-thqqq\") pod \"community-operators-wdlhp\" (UID: \"becedcd4-1438-43f9-9395-33bef0e28231\") " pod="openshift-marketplace/community-operators-wdlhp" Mar 16 17:16:13 crc kubenswrapper[5120]: I0316 17:16:13.455498 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/becedcd4-1438-43f9-9395-33bef0e28231-catalog-content\") pod \"community-operators-wdlhp\" (UID: \"becedcd4-1438-43f9-9395-33bef0e28231\") " pod="openshift-marketplace/community-operators-wdlhp" Mar 16 17:16:13 crc kubenswrapper[5120]: I0316 17:16:13.455882 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/becedcd4-1438-43f9-9395-33bef0e28231-utilities\") pod \"community-operators-wdlhp\" (UID: \"becedcd4-1438-43f9-9395-33bef0e28231\") " pod="openshift-marketplace/community-operators-wdlhp" Mar 16 17:16:13 crc kubenswrapper[5120]: I0316 17:16:13.475690 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-thqqq\" (UniqueName: \"kubernetes.io/projected/becedcd4-1438-43f9-9395-33bef0e28231-kube-api-access-thqqq\") pod \"community-operators-wdlhp\" (UID: \"becedcd4-1438-43f9-9395-33bef0e28231\") " pod="openshift-marketplace/community-operators-wdlhp" Mar 16 17:16:13 crc kubenswrapper[5120]: I0316 17:16:13.638870 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-wdlhp" Mar 16 17:16:14 crc kubenswrapper[5120]: I0316 17:16:14.243179 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/community-operators-wdlhp"] Mar 16 17:16:14 crc kubenswrapper[5120]: W0316 17:16:14.248644 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbecedcd4_1438_43f9_9395_33bef0e28231.slice/crio-87b05a9aac547cf26d32eac445d4113bf64ed2393cad87a4ec36746738a6044c WatchSource:0}: Error finding container 87b05a9aac547cf26d32eac445d4113bf64ed2393cad87a4ec36746738a6044c: Status 404 returned error can't find the container with id 87b05a9aac547cf26d32eac445d4113bf64ed2393cad87a4ec36746738a6044c Mar 16 17:16:14 crc kubenswrapper[5120]: I0316 17:16:14.274715 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-wdlhp" event={"ID":"becedcd4-1438-43f9-9395-33bef0e28231","Type":"ContainerStarted","Data":"87b05a9aac547cf26d32eac445d4113bf64ed2393cad87a4ec36746738a6044c"} Mar 16 17:16:15 crc kubenswrapper[5120]: I0316 17:16:15.284813 5120 generic.go:358] "Generic (PLEG): container finished" podID="becedcd4-1438-43f9-9395-33bef0e28231" containerID="cc2650180635635104954693d98cc422a95b54d2195b392668dad1c48c5d95eb" exitCode=0 Mar 16 17:16:15 crc kubenswrapper[5120]: I0316 17:16:15.284866 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-wdlhp" event={"ID":"becedcd4-1438-43f9-9395-33bef0e28231","Type":"ContainerDied","Data":"cc2650180635635104954693d98cc422a95b54d2195b392668dad1c48c5d95eb"} Mar 16 17:16:17 crc kubenswrapper[5120]: I0316 17:16:17.308538 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-wdlhp" event={"ID":"becedcd4-1438-43f9-9395-33bef0e28231","Type":"ContainerStarted","Data":"95a92e1d8fd65e347df31c081ceedd0c546848910e9e7529c896f5971be41c84"} Mar 16 17:16:19 crc kubenswrapper[5120]: I0316 17:16:19.329435 5120 generic.go:358] "Generic (PLEG): container finished" podID="becedcd4-1438-43f9-9395-33bef0e28231" containerID="95a92e1d8fd65e347df31c081ceedd0c546848910e9e7529c896f5971be41c84" exitCode=0 Mar 16 17:16:19 crc kubenswrapper[5120]: I0316 17:16:19.329485 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-wdlhp" event={"ID":"becedcd4-1438-43f9-9395-33bef0e28231","Type":"ContainerDied","Data":"95a92e1d8fd65e347df31c081ceedd0c546848910e9e7529c896f5971be41c84"} Mar 16 17:16:20 crc kubenswrapper[5120]: I0316 17:16:20.343435 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-wdlhp" event={"ID":"becedcd4-1438-43f9-9395-33bef0e28231","Type":"ContainerStarted","Data":"8df33b13807c5ac02e11bd4385d4e70cf07b4286cc2813d46ea9e1d894607b2d"} Mar 16 17:16:20 crc kubenswrapper[5120]: I0316 17:16:20.375746 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/community-operators-wdlhp" podStartSLOduration=6.490738618 podStartE2EDuration="7.375723681s" podCreationTimestamp="2026-03-16 17:16:13 +0000 UTC" firstStartedPulling="2026-03-16 17:16:15.286081212 +0000 UTC m=+6277.440012869" lastFinishedPulling="2026-03-16 17:16:16.171066275 +0000 UTC m=+6278.324997932" observedRunningTime="2026-03-16 17:16:20.367148677 +0000 UTC m=+6282.521080344" watchObservedRunningTime="2026-03-16 17:16:20.375723681 +0000 UTC m=+6282.529655338" Mar 16 17:16:21 crc kubenswrapper[5120]: I0316 17:16:21.349721 5120 scope.go:117] "RemoveContainer" containerID="8d4a3d9b1283a01d167c75e4f66b2b01910574b906f4107af0cecaa34fecea8e" Mar 16 17:16:22 crc kubenswrapper[5120]: I0316 17:16:22.008035 5120 patch_prober.go:28] interesting pod/machine-config-daemon-7bf76 container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 17:16:22 crc kubenswrapper[5120]: I0316 17:16:22.008460 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 17:16:23 crc kubenswrapper[5120]: I0316 17:16:23.639061 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/community-operators-wdlhp" Mar 16 17:16:23 crc kubenswrapper[5120]: I0316 17:16:23.639584 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-marketplace/community-operators-wdlhp" Mar 16 17:16:23 crc kubenswrapper[5120]: I0316 17:16:23.695799 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/community-operators-wdlhp" Mar 16 17:16:24 crc kubenswrapper[5120]: I0316 17:16:24.450866 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/community-operators-wdlhp" Mar 16 17:16:24 crc kubenswrapper[5120]: I0316 17:16:24.495845 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/community-operators-wdlhp"] Mar 16 17:16:26 crc kubenswrapper[5120]: I0316 17:16:26.420385 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-marketplace/community-operators-wdlhp" podUID="becedcd4-1438-43f9-9395-33bef0e28231" containerName="registry-server" containerID="cri-o://8df33b13807c5ac02e11bd4385d4e70cf07b4286cc2813d46ea9e1d894607b2d" gracePeriod=2 Mar 16 17:16:26 crc kubenswrapper[5120]: I0316 17:16:26.902830 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-wdlhp" Mar 16 17:16:26 crc kubenswrapper[5120]: I0316 17:16:26.975970 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/becedcd4-1438-43f9-9395-33bef0e28231-utilities\") pod \"becedcd4-1438-43f9-9395-33bef0e28231\" (UID: \"becedcd4-1438-43f9-9395-33bef0e28231\") " Mar 16 17:16:26 crc kubenswrapper[5120]: I0316 17:16:26.976073 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-thqqq\" (UniqueName: \"kubernetes.io/projected/becedcd4-1438-43f9-9395-33bef0e28231-kube-api-access-thqqq\") pod \"becedcd4-1438-43f9-9395-33bef0e28231\" (UID: \"becedcd4-1438-43f9-9395-33bef0e28231\") " Mar 16 17:16:26 crc kubenswrapper[5120]: I0316 17:16:26.977069 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/becedcd4-1438-43f9-9395-33bef0e28231-utilities" (OuterVolumeSpecName: "utilities") pod "becedcd4-1438-43f9-9395-33bef0e28231" (UID: "becedcd4-1438-43f9-9395-33bef0e28231"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:16:26 crc kubenswrapper[5120]: I0316 17:16:26.977366 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/becedcd4-1438-43f9-9395-33bef0e28231-catalog-content\") pod \"becedcd4-1438-43f9-9395-33bef0e28231\" (UID: \"becedcd4-1438-43f9-9395-33bef0e28231\") " Mar 16 17:16:26 crc kubenswrapper[5120]: I0316 17:16:26.978308 5120 reconciler_common.go:299] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/becedcd4-1438-43f9-9395-33bef0e28231-utilities\") on node \"crc\" DevicePath \"\"" Mar 16 17:16:26 crc kubenswrapper[5120]: I0316 17:16:26.983534 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/becedcd4-1438-43f9-9395-33bef0e28231-kube-api-access-thqqq" (OuterVolumeSpecName: "kube-api-access-thqqq") pod "becedcd4-1438-43f9-9395-33bef0e28231" (UID: "becedcd4-1438-43f9-9395-33bef0e28231"). InnerVolumeSpecName "kube-api-access-thqqq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:16:27 crc kubenswrapper[5120]: I0316 17:16:27.031486 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/becedcd4-1438-43f9-9395-33bef0e28231-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "becedcd4-1438-43f9-9395-33bef0e28231" (UID: "becedcd4-1438-43f9-9395-33bef0e28231"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:16:27 crc kubenswrapper[5120]: I0316 17:16:27.080858 5120 reconciler_common.go:299] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/becedcd4-1438-43f9-9395-33bef0e28231-catalog-content\") on node \"crc\" DevicePath \"\"" Mar 16 17:16:27 crc kubenswrapper[5120]: I0316 17:16:27.080935 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-thqqq\" (UniqueName: \"kubernetes.io/projected/becedcd4-1438-43f9-9395-33bef0e28231-kube-api-access-thqqq\") on node \"crc\" DevicePath \"\"" Mar 16 17:16:27 crc kubenswrapper[5120]: I0316 17:16:27.432670 5120 generic.go:358] "Generic (PLEG): container finished" podID="becedcd4-1438-43f9-9395-33bef0e28231" containerID="8df33b13807c5ac02e11bd4385d4e70cf07b4286cc2813d46ea9e1d894607b2d" exitCode=0 Mar 16 17:16:27 crc kubenswrapper[5120]: I0316 17:16:27.432768 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-wdlhp" event={"ID":"becedcd4-1438-43f9-9395-33bef0e28231","Type":"ContainerDied","Data":"8df33b13807c5ac02e11bd4385d4e70cf07b4286cc2813d46ea9e1d894607b2d"} Mar 16 17:16:27 crc kubenswrapper[5120]: I0316 17:16:27.433237 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-wdlhp" event={"ID":"becedcd4-1438-43f9-9395-33bef0e28231","Type":"ContainerDied","Data":"87b05a9aac547cf26d32eac445d4113bf64ed2393cad87a4ec36746738a6044c"} Mar 16 17:16:27 crc kubenswrapper[5120]: I0316 17:16:27.432842 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-wdlhp" Mar 16 17:16:27 crc kubenswrapper[5120]: I0316 17:16:27.433256 5120 scope.go:117] "RemoveContainer" containerID="8df33b13807c5ac02e11bd4385d4e70cf07b4286cc2813d46ea9e1d894607b2d" Mar 16 17:16:27 crc kubenswrapper[5120]: I0316 17:16:27.458340 5120 scope.go:117] "RemoveContainer" containerID="95a92e1d8fd65e347df31c081ceedd0c546848910e9e7529c896f5971be41c84" Mar 16 17:16:27 crc kubenswrapper[5120]: I0316 17:16:27.477830 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/community-operators-wdlhp"] Mar 16 17:16:27 crc kubenswrapper[5120]: I0316 17:16:27.485824 5120 scope.go:117] "RemoveContainer" containerID="cc2650180635635104954693d98cc422a95b54d2195b392668dad1c48c5d95eb" Mar 16 17:16:27 crc kubenswrapper[5120]: I0316 17:16:27.493297 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/community-operators-wdlhp"] Mar 16 17:16:27 crc kubenswrapper[5120]: I0316 17:16:27.526642 5120 scope.go:117] "RemoveContainer" containerID="8df33b13807c5ac02e11bd4385d4e70cf07b4286cc2813d46ea9e1d894607b2d" Mar 16 17:16:27 crc kubenswrapper[5120]: E0316 17:16:27.527133 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8df33b13807c5ac02e11bd4385d4e70cf07b4286cc2813d46ea9e1d894607b2d\": container with ID starting with 8df33b13807c5ac02e11bd4385d4e70cf07b4286cc2813d46ea9e1d894607b2d not found: ID does not exist" containerID="8df33b13807c5ac02e11bd4385d4e70cf07b4286cc2813d46ea9e1d894607b2d" Mar 16 17:16:27 crc kubenswrapper[5120]: I0316 17:16:27.527176 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8df33b13807c5ac02e11bd4385d4e70cf07b4286cc2813d46ea9e1d894607b2d"} err="failed to get container status \"8df33b13807c5ac02e11bd4385d4e70cf07b4286cc2813d46ea9e1d894607b2d\": rpc error: code = NotFound desc = could not find container \"8df33b13807c5ac02e11bd4385d4e70cf07b4286cc2813d46ea9e1d894607b2d\": container with ID starting with 8df33b13807c5ac02e11bd4385d4e70cf07b4286cc2813d46ea9e1d894607b2d not found: ID does not exist" Mar 16 17:16:27 crc kubenswrapper[5120]: I0316 17:16:27.527202 5120 scope.go:117] "RemoveContainer" containerID="95a92e1d8fd65e347df31c081ceedd0c546848910e9e7529c896f5971be41c84" Mar 16 17:16:27 crc kubenswrapper[5120]: E0316 17:16:27.527705 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"95a92e1d8fd65e347df31c081ceedd0c546848910e9e7529c896f5971be41c84\": container with ID starting with 95a92e1d8fd65e347df31c081ceedd0c546848910e9e7529c896f5971be41c84 not found: ID does not exist" containerID="95a92e1d8fd65e347df31c081ceedd0c546848910e9e7529c896f5971be41c84" Mar 16 17:16:27 crc kubenswrapper[5120]: I0316 17:16:27.527735 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95a92e1d8fd65e347df31c081ceedd0c546848910e9e7529c896f5971be41c84"} err="failed to get container status \"95a92e1d8fd65e347df31c081ceedd0c546848910e9e7529c896f5971be41c84\": rpc error: code = NotFound desc = could not find container \"95a92e1d8fd65e347df31c081ceedd0c546848910e9e7529c896f5971be41c84\": container with ID starting with 95a92e1d8fd65e347df31c081ceedd0c546848910e9e7529c896f5971be41c84 not found: ID does not exist" Mar 16 17:16:27 crc kubenswrapper[5120]: I0316 17:16:27.527773 5120 scope.go:117] "RemoveContainer" containerID="cc2650180635635104954693d98cc422a95b54d2195b392668dad1c48c5d95eb" Mar 16 17:16:27 crc kubenswrapper[5120]: E0316 17:16:27.528106 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc2650180635635104954693d98cc422a95b54d2195b392668dad1c48c5d95eb\": container with ID starting with cc2650180635635104954693d98cc422a95b54d2195b392668dad1c48c5d95eb not found: ID does not exist" containerID="cc2650180635635104954693d98cc422a95b54d2195b392668dad1c48c5d95eb" Mar 16 17:16:27 crc kubenswrapper[5120]: I0316 17:16:27.528133 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc2650180635635104954693d98cc422a95b54d2195b392668dad1c48c5d95eb"} err="failed to get container status \"cc2650180635635104954693d98cc422a95b54d2195b392668dad1c48c5d95eb\": rpc error: code = NotFound desc = could not find container \"cc2650180635635104954693d98cc422a95b54d2195b392668dad1c48c5d95eb\": container with ID starting with cc2650180635635104954693d98cc422a95b54d2195b392668dad1c48c5d95eb not found: ID does not exist" Mar 16 17:16:28 crc kubenswrapper[5120]: I0316 17:16:28.676157 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="becedcd4-1438-43f9-9395-33bef0e28231" path="/var/lib/kubelet/pods/becedcd4-1438-43f9-9395-33bef0e28231/volumes" Mar 16 17:16:30 crc kubenswrapper[5120]: I0316 17:16:30.909855 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:16:34 crc kubenswrapper[5120]: I0316 17:16:34.771739 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 17:16:34 crc kubenswrapper[5120]: I0316 17:16:34.772483 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/kube-state-metrics-0" podUID="f2cddf24-c7ff-483a-8dfc-2fbc8a61c968" containerName="kube-state-metrics" containerID="cri-o://5b2e410bae915a8a4bf9227182de7c8109a1844cb29cedb3c29e10ed1045229b" gracePeriod=30 Mar 16 17:16:35 crc kubenswrapper[5120]: I0316 17:16:35.275618 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 17:16:35 crc kubenswrapper[5120]: I0316 17:16:35.340896 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mmwsv\" (UniqueName: \"kubernetes.io/projected/f2cddf24-c7ff-483a-8dfc-2fbc8a61c968-kube-api-access-mmwsv\") pod \"f2cddf24-c7ff-483a-8dfc-2fbc8a61c968\" (UID: \"f2cddf24-c7ff-483a-8dfc-2fbc8a61c968\") " Mar 16 17:16:35 crc kubenswrapper[5120]: I0316 17:16:35.348994 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2cddf24-c7ff-483a-8dfc-2fbc8a61c968-kube-api-access-mmwsv" (OuterVolumeSpecName: "kube-api-access-mmwsv") pod "f2cddf24-c7ff-483a-8dfc-2fbc8a61c968" (UID: "f2cddf24-c7ff-483a-8dfc-2fbc8a61c968"). InnerVolumeSpecName "kube-api-access-mmwsv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:16:35 crc kubenswrapper[5120]: I0316 17:16:35.444728 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mmwsv\" (UniqueName: \"kubernetes.io/projected/f2cddf24-c7ff-483a-8dfc-2fbc8a61c968-kube-api-access-mmwsv\") on node \"crc\" DevicePath \"\"" Mar 16 17:16:35 crc kubenswrapper[5120]: I0316 17:16:35.511618 5120 generic.go:358] "Generic (PLEG): container finished" podID="f2cddf24-c7ff-483a-8dfc-2fbc8a61c968" containerID="5b2e410bae915a8a4bf9227182de7c8109a1844cb29cedb3c29e10ed1045229b" exitCode=2 Mar 16 17:16:35 crc kubenswrapper[5120]: I0316 17:16:35.511821 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"f2cddf24-c7ff-483a-8dfc-2fbc8a61c968","Type":"ContainerDied","Data":"5b2e410bae915a8a4bf9227182de7c8109a1844cb29cedb3c29e10ed1045229b"} Mar 16 17:16:35 crc kubenswrapper[5120]: I0316 17:16:35.511855 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"f2cddf24-c7ff-483a-8dfc-2fbc8a61c968","Type":"ContainerDied","Data":"990955eed31eca86506eaea5ed854f7fef7e6e0f6398d3220caeb02577fa392b"} Mar 16 17:16:35 crc kubenswrapper[5120]: I0316 17:16:35.511874 5120 scope.go:117] "RemoveContainer" containerID="5b2e410bae915a8a4bf9227182de7c8109a1844cb29cedb3c29e10ed1045229b" Mar 16 17:16:35 crc kubenswrapper[5120]: I0316 17:16:35.512023 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 17:16:35 crc kubenswrapper[5120]: I0316 17:16:35.547453 5120 scope.go:117] "RemoveContainer" containerID="5b2e410bae915a8a4bf9227182de7c8109a1844cb29cedb3c29e10ed1045229b" Mar 16 17:16:35 crc kubenswrapper[5120]: E0316 17:16:35.548251 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b2e410bae915a8a4bf9227182de7c8109a1844cb29cedb3c29e10ed1045229b\": container with ID starting with 5b2e410bae915a8a4bf9227182de7c8109a1844cb29cedb3c29e10ed1045229b not found: ID does not exist" containerID="5b2e410bae915a8a4bf9227182de7c8109a1844cb29cedb3c29e10ed1045229b" Mar 16 17:16:35 crc kubenswrapper[5120]: I0316 17:16:35.548304 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b2e410bae915a8a4bf9227182de7c8109a1844cb29cedb3c29e10ed1045229b"} err="failed to get container status \"5b2e410bae915a8a4bf9227182de7c8109a1844cb29cedb3c29e10ed1045229b\": rpc error: code = NotFound desc = could not find container \"5b2e410bae915a8a4bf9227182de7c8109a1844cb29cedb3c29e10ed1045229b\": container with ID starting with 5b2e410bae915a8a4bf9227182de7c8109a1844cb29cedb3c29e10ed1045229b not found: ID does not exist" Mar 16 17:16:35 crc kubenswrapper[5120]: I0316 17:16:35.558750 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 17:16:35 crc kubenswrapper[5120]: I0316 17:16:35.575380 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 17:16:35 crc kubenswrapper[5120]: I0316 17:16:35.585849 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 17:16:35 crc kubenswrapper[5120]: I0316 17:16:35.587030 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="becedcd4-1438-43f9-9395-33bef0e28231" containerName="registry-server" Mar 16 17:16:35 crc kubenswrapper[5120]: I0316 17:16:35.587049 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="becedcd4-1438-43f9-9395-33bef0e28231" containerName="registry-server" Mar 16 17:16:35 crc kubenswrapper[5120]: I0316 17:16:35.587077 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="becedcd4-1438-43f9-9395-33bef0e28231" containerName="extract-utilities" Mar 16 17:16:35 crc kubenswrapper[5120]: I0316 17:16:35.587084 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="becedcd4-1438-43f9-9395-33bef0e28231" containerName="extract-utilities" Mar 16 17:16:35 crc kubenswrapper[5120]: I0316 17:16:35.587094 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2cddf24-c7ff-483a-8dfc-2fbc8a61c968" containerName="kube-state-metrics" Mar 16 17:16:35 crc kubenswrapper[5120]: I0316 17:16:35.587100 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2cddf24-c7ff-483a-8dfc-2fbc8a61c968" containerName="kube-state-metrics" Mar 16 17:16:35 crc kubenswrapper[5120]: I0316 17:16:35.587123 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="becedcd4-1438-43f9-9395-33bef0e28231" containerName="extract-content" Mar 16 17:16:35 crc kubenswrapper[5120]: I0316 17:16:35.587129 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="becedcd4-1438-43f9-9395-33bef0e28231" containerName="extract-content" Mar 16 17:16:35 crc kubenswrapper[5120]: I0316 17:16:35.587318 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="becedcd4-1438-43f9-9395-33bef0e28231" containerName="registry-server" Mar 16 17:16:35 crc kubenswrapper[5120]: I0316 17:16:35.587332 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f2cddf24-c7ff-483a-8dfc-2fbc8a61c968" containerName="kube-state-metrics" Mar 16 17:16:35 crc kubenswrapper[5120]: I0316 17:16:35.595015 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 17:16:35 crc kubenswrapper[5120]: I0316 17:16:35.595516 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 17:16:35 crc kubenswrapper[5120]: I0316 17:16:35.597031 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"kube-state-metrics-tls-config\"" Mar 16 17:16:35 crc kubenswrapper[5120]: I0316 17:16:35.599091 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-kube-state-metrics-svc\"" Mar 16 17:16:35 crc kubenswrapper[5120]: I0316 17:16:35.649693 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmd5d\" (UniqueName: \"kubernetes.io/projected/0e67d4b1-e52a-47e3-a212-d301d9160bc0-kube-api-access-lmd5d\") pod \"kube-state-metrics-0\" (UID: \"0e67d4b1-e52a-47e3-a212-d301d9160bc0\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 17:16:35 crc kubenswrapper[5120]: I0316 17:16:35.649780 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0e67d4b1-e52a-47e3-a212-d301d9160bc0-combined-ca-bundle\") pod \"kube-state-metrics-0\" (UID: \"0e67d4b1-e52a-47e3-a212-d301d9160bc0\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 17:16:35 crc kubenswrapper[5120]: I0316 17:16:35.649822 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/0e67d4b1-e52a-47e3-a212-d301d9160bc0-kube-state-metrics-tls-config\") pod \"kube-state-metrics-0\" (UID: \"0e67d4b1-e52a-47e3-a212-d301d9160bc0\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 17:16:35 crc kubenswrapper[5120]: I0316 17:16:35.649869 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/0e67d4b1-e52a-47e3-a212-d301d9160bc0-kube-state-metrics-tls-certs\") pod \"kube-state-metrics-0\" (UID: \"0e67d4b1-e52a-47e3-a212-d301d9160bc0\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 17:16:35 crc kubenswrapper[5120]: I0316 17:16:35.752338 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/0e67d4b1-e52a-47e3-a212-d301d9160bc0-kube-state-metrics-tls-certs\") pod \"kube-state-metrics-0\" (UID: \"0e67d4b1-e52a-47e3-a212-d301d9160bc0\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 17:16:35 crc kubenswrapper[5120]: I0316 17:16:35.752843 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lmd5d\" (UniqueName: \"kubernetes.io/projected/0e67d4b1-e52a-47e3-a212-d301d9160bc0-kube-api-access-lmd5d\") pod \"kube-state-metrics-0\" (UID: \"0e67d4b1-e52a-47e3-a212-d301d9160bc0\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 17:16:35 crc kubenswrapper[5120]: I0316 17:16:35.752915 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0e67d4b1-e52a-47e3-a212-d301d9160bc0-combined-ca-bundle\") pod \"kube-state-metrics-0\" (UID: \"0e67d4b1-e52a-47e3-a212-d301d9160bc0\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 17:16:35 crc kubenswrapper[5120]: I0316 17:16:35.752951 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/0e67d4b1-e52a-47e3-a212-d301d9160bc0-kube-state-metrics-tls-config\") pod \"kube-state-metrics-0\" (UID: \"0e67d4b1-e52a-47e3-a212-d301d9160bc0\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 17:16:35 crc kubenswrapper[5120]: I0316 17:16:35.758540 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/0e67d4b1-e52a-47e3-a212-d301d9160bc0-kube-state-metrics-tls-certs\") pod \"kube-state-metrics-0\" (UID: \"0e67d4b1-e52a-47e3-a212-d301d9160bc0\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 17:16:35 crc kubenswrapper[5120]: I0316 17:16:35.770956 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/0e67d4b1-e52a-47e3-a212-d301d9160bc0-kube-state-metrics-tls-config\") pod \"kube-state-metrics-0\" (UID: \"0e67d4b1-e52a-47e3-a212-d301d9160bc0\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 17:16:35 crc kubenswrapper[5120]: I0316 17:16:35.771003 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0e67d4b1-e52a-47e3-a212-d301d9160bc0-combined-ca-bundle\") pod \"kube-state-metrics-0\" (UID: \"0e67d4b1-e52a-47e3-a212-d301d9160bc0\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 17:16:35 crc kubenswrapper[5120]: I0316 17:16:35.781608 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmd5d\" (UniqueName: \"kubernetes.io/projected/0e67d4b1-e52a-47e3-a212-d301d9160bc0-kube-api-access-lmd5d\") pod \"kube-state-metrics-0\" (UID: \"0e67d4b1-e52a-47e3-a212-d301d9160bc0\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 17:16:35 crc kubenswrapper[5120]: I0316 17:16:35.916919 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 17:16:36 crc kubenswrapper[5120]: I0316 17:16:36.352486 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 17:16:36 crc kubenswrapper[5120]: I0316 17:16:36.525140 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"0e67d4b1-e52a-47e3-a212-d301d9160bc0","Type":"ContainerStarted","Data":"80844e38cb3ca8bf55f9ab851d6c2ca82c8b196ffc48b61492d1a9a5cc35f458"} Mar 16 17:16:36 crc kubenswrapper[5120]: I0316 17:16:36.534623 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:16:36 crc kubenswrapper[5120]: I0316 17:16:36.535117 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="cee976d8-b886-4c83-8338-dec65593db27" containerName="ceilometer-central-agent" containerID="cri-o://8e966e7a3db58c0ea0cbcd320352f7c37ff60c65ba460cbea2a206ae8bc85a03" gracePeriod=30 Mar 16 17:16:36 crc kubenswrapper[5120]: I0316 17:16:36.535249 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="cee976d8-b886-4c83-8338-dec65593db27" containerName="sg-core" containerID="cri-o://b1bb1b4ab057a25df9b631fc57e4802bf0bba47050f57936fc34c73572f29c74" gracePeriod=30 Mar 16 17:16:36 crc kubenswrapper[5120]: I0316 17:16:36.535237 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="cee976d8-b886-4c83-8338-dec65593db27" containerName="ceilometer-notification-agent" containerID="cri-o://53dee9ec6f61b3c2fe3a98dba73419658c1a5e8068004e03d249fb113db99fb1" gracePeriod=30 Mar 16 17:16:36 crc kubenswrapper[5120]: I0316 17:16:36.535536 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="cee976d8-b886-4c83-8338-dec65593db27" containerName="proxy-httpd" containerID="cri-o://7b3605121dfcb41904c93ec2bbb8ad37d6a6e38ef76cb5f399e9242f155e315c" gracePeriod=30 Mar 16 17:16:36 crc kubenswrapper[5120]: I0316 17:16:36.673986 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f2cddf24-c7ff-483a-8dfc-2fbc8a61c968" path="/var/lib/kubelet/pods/f2cddf24-c7ff-483a-8dfc-2fbc8a61c968/volumes" Mar 16 17:16:37 crc kubenswrapper[5120]: I0316 17:16:37.539657 5120 generic.go:358] "Generic (PLEG): container finished" podID="cee976d8-b886-4c83-8338-dec65593db27" containerID="7b3605121dfcb41904c93ec2bbb8ad37d6a6e38ef76cb5f399e9242f155e315c" exitCode=0 Mar 16 17:16:37 crc kubenswrapper[5120]: I0316 17:16:37.539952 5120 generic.go:358] "Generic (PLEG): container finished" podID="cee976d8-b886-4c83-8338-dec65593db27" containerID="b1bb1b4ab057a25df9b631fc57e4802bf0bba47050f57936fc34c73572f29c74" exitCode=2 Mar 16 17:16:37 crc kubenswrapper[5120]: I0316 17:16:37.539960 5120 generic.go:358] "Generic (PLEG): container finished" podID="cee976d8-b886-4c83-8338-dec65593db27" containerID="8e966e7a3db58c0ea0cbcd320352f7c37ff60c65ba460cbea2a206ae8bc85a03" exitCode=0 Mar 16 17:16:37 crc kubenswrapper[5120]: I0316 17:16:37.540091 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"cee976d8-b886-4c83-8338-dec65593db27","Type":"ContainerDied","Data":"7b3605121dfcb41904c93ec2bbb8ad37d6a6e38ef76cb5f399e9242f155e315c"} Mar 16 17:16:37 crc kubenswrapper[5120]: I0316 17:16:37.540116 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"cee976d8-b886-4c83-8338-dec65593db27","Type":"ContainerDied","Data":"b1bb1b4ab057a25df9b631fc57e4802bf0bba47050f57936fc34c73572f29c74"} Mar 16 17:16:37 crc kubenswrapper[5120]: I0316 17:16:37.540127 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"cee976d8-b886-4c83-8338-dec65593db27","Type":"ContainerDied","Data":"8e966e7a3db58c0ea0cbcd320352f7c37ff60c65ba460cbea2a206ae8bc85a03"} Mar 16 17:16:37 crc kubenswrapper[5120]: I0316 17:16:37.543122 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"0e67d4b1-e52a-47e3-a212-d301d9160bc0","Type":"ContainerStarted","Data":"f0f7f3da22765c2510e787c90ba13d3a36d1f6e6b7e23c075df10a2d4e61a95b"} Mar 16 17:16:37 crc kubenswrapper[5120]: I0316 17:16:37.544136 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 17:16:37 crc kubenswrapper[5120]: I0316 17:16:37.572564 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/kube-state-metrics-0" podStartSLOduration=2.12831099 podStartE2EDuration="2.572545163s" podCreationTimestamp="2026-03-16 17:16:35 +0000 UTC" firstStartedPulling="2026-03-16 17:16:36.359093745 +0000 UTC m=+6298.513025402" lastFinishedPulling="2026-03-16 17:16:36.803327918 +0000 UTC m=+6298.957259575" observedRunningTime="2026-03-16 17:16:37.559144407 +0000 UTC m=+6299.713076064" watchObservedRunningTime="2026-03-16 17:16:37.572545163 +0000 UTC m=+6299.726476820" Mar 16 17:16:38 crc kubenswrapper[5120]: I0316 17:16:38.555268 5120 generic.go:358] "Generic (PLEG): container finished" podID="cee976d8-b886-4c83-8338-dec65593db27" containerID="53dee9ec6f61b3c2fe3a98dba73419658c1a5e8068004e03d249fb113db99fb1" exitCode=0 Mar 16 17:16:38 crc kubenswrapper[5120]: I0316 17:16:38.555355 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"cee976d8-b886-4c83-8338-dec65593db27","Type":"ContainerDied","Data":"53dee9ec6f61b3c2fe3a98dba73419658c1a5e8068004e03d249fb113db99fb1"} Mar 16 17:16:38 crc kubenswrapper[5120]: I0316 17:16:38.556272 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"cee976d8-b886-4c83-8338-dec65593db27","Type":"ContainerDied","Data":"abed367bd104af7765ed2ff613f1677358faa58d59f446060c2e27562d56c7f1"} Mar 16 17:16:38 crc kubenswrapper[5120]: I0316 17:16:38.556295 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="abed367bd104af7765ed2ff613f1677358faa58d59f446060c2e27562d56c7f1" Mar 16 17:16:38 crc kubenswrapper[5120]: I0316 17:16:38.628609 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:16:38 crc kubenswrapper[5120]: I0316 17:16:38.734541 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/cee976d8-b886-4c83-8338-dec65593db27-sg-core-conf-yaml\") pod \"cee976d8-b886-4c83-8338-dec65593db27\" (UID: \"cee976d8-b886-4c83-8338-dec65593db27\") " Mar 16 17:16:38 crc kubenswrapper[5120]: I0316 17:16:38.734904 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cee976d8-b886-4c83-8338-dec65593db27-config-data\") pod \"cee976d8-b886-4c83-8338-dec65593db27\" (UID: \"cee976d8-b886-4c83-8338-dec65593db27\") " Mar 16 17:16:38 crc kubenswrapper[5120]: I0316 17:16:38.735012 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k7t9k\" (UniqueName: \"kubernetes.io/projected/cee976d8-b886-4c83-8338-dec65593db27-kube-api-access-k7t9k\") pod \"cee976d8-b886-4c83-8338-dec65593db27\" (UID: \"cee976d8-b886-4c83-8338-dec65593db27\") " Mar 16 17:16:38 crc kubenswrapper[5120]: I0316 17:16:38.735134 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cee976d8-b886-4c83-8338-dec65593db27-combined-ca-bundle\") pod \"cee976d8-b886-4c83-8338-dec65593db27\" (UID: \"cee976d8-b886-4c83-8338-dec65593db27\") " Mar 16 17:16:38 crc kubenswrapper[5120]: I0316 17:16:38.735430 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/cee976d8-b886-4c83-8338-dec65593db27-scripts\") pod \"cee976d8-b886-4c83-8338-dec65593db27\" (UID: \"cee976d8-b886-4c83-8338-dec65593db27\") " Mar 16 17:16:38 crc kubenswrapper[5120]: I0316 17:16:38.735538 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/cee976d8-b886-4c83-8338-dec65593db27-log-httpd\") pod \"cee976d8-b886-4c83-8338-dec65593db27\" (UID: \"cee976d8-b886-4c83-8338-dec65593db27\") " Mar 16 17:16:38 crc kubenswrapper[5120]: I0316 17:16:38.735949 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/cee976d8-b886-4c83-8338-dec65593db27-run-httpd\") pod \"cee976d8-b886-4c83-8338-dec65593db27\" (UID: \"cee976d8-b886-4c83-8338-dec65593db27\") " Mar 16 17:16:38 crc kubenswrapper[5120]: I0316 17:16:38.737038 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cee976d8-b886-4c83-8338-dec65593db27-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "cee976d8-b886-4c83-8338-dec65593db27" (UID: "cee976d8-b886-4c83-8338-dec65593db27"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:16:38 crc kubenswrapper[5120]: I0316 17:16:38.737246 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cee976d8-b886-4c83-8338-dec65593db27-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "cee976d8-b886-4c83-8338-dec65593db27" (UID: "cee976d8-b886-4c83-8338-dec65593db27"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:16:38 crc kubenswrapper[5120]: I0316 17:16:38.743088 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cee976d8-b886-4c83-8338-dec65593db27-kube-api-access-k7t9k" (OuterVolumeSpecName: "kube-api-access-k7t9k") pod "cee976d8-b886-4c83-8338-dec65593db27" (UID: "cee976d8-b886-4c83-8338-dec65593db27"). InnerVolumeSpecName "kube-api-access-k7t9k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:16:38 crc kubenswrapper[5120]: I0316 17:16:38.749648 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cee976d8-b886-4c83-8338-dec65593db27-scripts" (OuterVolumeSpecName: "scripts") pod "cee976d8-b886-4c83-8338-dec65593db27" (UID: "cee976d8-b886-4c83-8338-dec65593db27"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:16:38 crc kubenswrapper[5120]: I0316 17:16:38.770842 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cee976d8-b886-4c83-8338-dec65593db27-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "cee976d8-b886-4c83-8338-dec65593db27" (UID: "cee976d8-b886-4c83-8338-dec65593db27"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:16:38 crc kubenswrapper[5120]: I0316 17:16:38.822842 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cee976d8-b886-4c83-8338-dec65593db27-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "cee976d8-b886-4c83-8338-dec65593db27" (UID: "cee976d8-b886-4c83-8338-dec65593db27"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:16:38 crc kubenswrapper[5120]: I0316 17:16:38.841602 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/cee976d8-b886-4c83-8338-dec65593db27-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:16:38 crc kubenswrapper[5120]: I0316 17:16:38.841980 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/cee976d8-b886-4c83-8338-dec65593db27-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 17:16:38 crc kubenswrapper[5120]: I0316 17:16:38.842077 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/cee976d8-b886-4c83-8338-dec65593db27-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 17:16:38 crc kubenswrapper[5120]: I0316 17:16:38.842151 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/cee976d8-b886-4c83-8338-dec65593db27-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 17:16:38 crc kubenswrapper[5120]: I0316 17:16:38.842222 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k7t9k\" (UniqueName: \"kubernetes.io/projected/cee976d8-b886-4c83-8338-dec65593db27-kube-api-access-k7t9k\") on node \"crc\" DevicePath \"\"" Mar 16 17:16:38 crc kubenswrapper[5120]: I0316 17:16:38.842298 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cee976d8-b886-4c83-8338-dec65593db27-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:16:38 crc kubenswrapper[5120]: I0316 17:16:38.849940 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cee976d8-b886-4c83-8338-dec65593db27-config-data" (OuterVolumeSpecName: "config-data") pod "cee976d8-b886-4c83-8338-dec65593db27" (UID: "cee976d8-b886-4c83-8338-dec65593db27"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:16:38 crc kubenswrapper[5120]: I0316 17:16:38.944937 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cee976d8-b886-4c83-8338-dec65593db27-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:16:39 crc kubenswrapper[5120]: I0316 17:16:39.564827 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:16:39 crc kubenswrapper[5120]: I0316 17:16:39.604253 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:16:39 crc kubenswrapper[5120]: I0316 17:16:39.611059 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:16:39 crc kubenswrapper[5120]: I0316 17:16:39.630989 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:16:39 crc kubenswrapper[5120]: I0316 17:16:39.631999 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cee976d8-b886-4c83-8338-dec65593db27" containerName="ceilometer-notification-agent" Mar 16 17:16:39 crc kubenswrapper[5120]: I0316 17:16:39.632020 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="cee976d8-b886-4c83-8338-dec65593db27" containerName="ceilometer-notification-agent" Mar 16 17:16:39 crc kubenswrapper[5120]: I0316 17:16:39.632062 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cee976d8-b886-4c83-8338-dec65593db27" containerName="ceilometer-central-agent" Mar 16 17:16:39 crc kubenswrapper[5120]: I0316 17:16:39.632068 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="cee976d8-b886-4c83-8338-dec65593db27" containerName="ceilometer-central-agent" Mar 16 17:16:39 crc kubenswrapper[5120]: I0316 17:16:39.632089 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cee976d8-b886-4c83-8338-dec65593db27" containerName="sg-core" Mar 16 17:16:39 crc kubenswrapper[5120]: I0316 17:16:39.632095 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="cee976d8-b886-4c83-8338-dec65593db27" containerName="sg-core" Mar 16 17:16:39 crc kubenswrapper[5120]: I0316 17:16:39.632115 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cee976d8-b886-4c83-8338-dec65593db27" containerName="proxy-httpd" Mar 16 17:16:39 crc kubenswrapper[5120]: I0316 17:16:39.632121 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="cee976d8-b886-4c83-8338-dec65593db27" containerName="proxy-httpd" Mar 16 17:16:39 crc kubenswrapper[5120]: I0316 17:16:39.632275 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="cee976d8-b886-4c83-8338-dec65593db27" containerName="proxy-httpd" Mar 16 17:16:39 crc kubenswrapper[5120]: I0316 17:16:39.632295 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="cee976d8-b886-4c83-8338-dec65593db27" containerName="ceilometer-notification-agent" Mar 16 17:16:39 crc kubenswrapper[5120]: I0316 17:16:39.632305 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="cee976d8-b886-4c83-8338-dec65593db27" containerName="ceilometer-central-agent" Mar 16 17:16:39 crc kubenswrapper[5120]: I0316 17:16:39.632314 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="cee976d8-b886-4c83-8338-dec65593db27" containerName="sg-core" Mar 16 17:16:39 crc kubenswrapper[5120]: I0316 17:16:39.643262 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:16:39 crc kubenswrapper[5120]: I0316 17:16:39.646005 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 17:16:39 crc kubenswrapper[5120]: I0316 17:16:39.646249 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 17:16:39 crc kubenswrapper[5120]: I0316 17:16:39.647998 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ceilometer-internal-svc\"" Mar 16 17:16:39 crc kubenswrapper[5120]: I0316 17:16:39.666435 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:16:39 crc kubenswrapper[5120]: I0316 17:16:39.767003 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlfqg\" (UniqueName: \"kubernetes.io/projected/18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62-kube-api-access-jlfqg\") pod \"ceilometer-0\" (UID: \"18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:16:39 crc kubenswrapper[5120]: I0316 17:16:39.767061 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62-run-httpd\") pod \"ceilometer-0\" (UID: \"18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:16:39 crc kubenswrapper[5120]: I0316 17:16:39.767091 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:16:39 crc kubenswrapper[5120]: I0316 17:16:39.767128 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62-scripts\") pod \"ceilometer-0\" (UID: \"18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:16:39 crc kubenswrapper[5120]: I0316 17:16:39.767191 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:16:39 crc kubenswrapper[5120]: I0316 17:16:39.767272 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:16:39 crc kubenswrapper[5120]: I0316 17:16:39.767290 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62-config-data\") pod \"ceilometer-0\" (UID: \"18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:16:39 crc kubenswrapper[5120]: I0316 17:16:39.767658 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62-log-httpd\") pod \"ceilometer-0\" (UID: \"18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:16:39 crc kubenswrapper[5120]: I0316 17:16:39.870983 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jlfqg\" (UniqueName: \"kubernetes.io/projected/18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62-kube-api-access-jlfqg\") pod \"ceilometer-0\" (UID: \"18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:16:39 crc kubenswrapper[5120]: I0316 17:16:39.871407 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62-run-httpd\") pod \"ceilometer-0\" (UID: \"18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:16:39 crc kubenswrapper[5120]: I0316 17:16:39.871447 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:16:39 crc kubenswrapper[5120]: I0316 17:16:39.871508 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62-scripts\") pod \"ceilometer-0\" (UID: \"18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:16:39 crc kubenswrapper[5120]: I0316 17:16:39.871602 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:16:39 crc kubenswrapper[5120]: I0316 17:16:39.871714 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:16:39 crc kubenswrapper[5120]: I0316 17:16:39.871744 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62-config-data\") pod \"ceilometer-0\" (UID: \"18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:16:39 crc kubenswrapper[5120]: I0316 17:16:39.872139 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62-log-httpd\") pod \"ceilometer-0\" (UID: \"18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:16:39 crc kubenswrapper[5120]: I0316 17:16:39.872627 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62-run-httpd\") pod \"ceilometer-0\" (UID: \"18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:16:39 crc kubenswrapper[5120]: I0316 17:16:39.872775 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62-log-httpd\") pod \"ceilometer-0\" (UID: \"18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:16:39 crc kubenswrapper[5120]: I0316 17:16:39.877617 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62-config-data\") pod \"ceilometer-0\" (UID: \"18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:16:39 crc kubenswrapper[5120]: I0316 17:16:39.877618 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:16:39 crc kubenswrapper[5120]: I0316 17:16:39.878520 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:16:39 crc kubenswrapper[5120]: I0316 17:16:39.878701 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:16:39 crc kubenswrapper[5120]: I0316 17:16:39.878750 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62-scripts\") pod \"ceilometer-0\" (UID: \"18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:16:39 crc kubenswrapper[5120]: I0316 17:16:39.894708 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlfqg\" (UniqueName: \"kubernetes.io/projected/18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62-kube-api-access-jlfqg\") pod \"ceilometer-0\" (UID: \"18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:16:39 crc kubenswrapper[5120]: I0316 17:16:39.964440 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:16:40 crc kubenswrapper[5120]: I0316 17:16:40.484925 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:16:40 crc kubenswrapper[5120]: I0316 17:16:40.575830 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62","Type":"ContainerStarted","Data":"b9e893172914ea3674476dad64f77ea21062feede5d6f4c91f5aad8706ebce11"} Mar 16 17:16:40 crc kubenswrapper[5120]: I0316 17:16:40.674020 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cee976d8-b886-4c83-8338-dec65593db27" path="/var/lib/kubelet/pods/cee976d8-b886-4c83-8338-dec65593db27/volumes" Mar 16 17:16:41 crc kubenswrapper[5120]: I0316 17:16:41.590948 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62","Type":"ContainerStarted","Data":"e7a5ecad2365023f5d54577d059406a821a96c82ee276fd4ed93a27749e6fcc7"} Mar 16 17:16:42 crc kubenswrapper[5120]: I0316 17:16:42.613391 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62","Type":"ContainerStarted","Data":"907c314ee3239ecff601279e58a9e3aba6e65a29cf05a0d75fa660f2b00df61d"} Mar 16 17:16:42 crc kubenswrapper[5120]: I0316 17:16:42.613752 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62","Type":"ContainerStarted","Data":"8e39abe514cf4d6f8c28475560f3e3a9681167a84d81cdfc9d44be0b89c1cec0"} Mar 16 17:16:44 crc kubenswrapper[5120]: I0316 17:16:44.640354 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62","Type":"ContainerStarted","Data":"b0ce2e25aded94ccf86a0ddfe51c2ff4f864b1998250d60f71f24ade3a195c35"} Mar 16 17:16:44 crc kubenswrapper[5120]: I0316 17:16:44.640965 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:16:44 crc kubenswrapper[5120]: I0316 17:16:44.673992 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.092766064 podStartE2EDuration="5.673973852s" podCreationTimestamp="2026-03-16 17:16:39 +0000 UTC" firstStartedPulling="2026-03-16 17:16:40.485406497 +0000 UTC m=+6302.639338154" lastFinishedPulling="2026-03-16 17:16:44.066614285 +0000 UTC m=+6306.220545942" observedRunningTime="2026-03-16 17:16:44.6625638 +0000 UTC m=+6306.816495467" watchObservedRunningTime="2026-03-16 17:16:44.673973852 +0000 UTC m=+6306.827905509" Mar 16 17:16:47 crc kubenswrapper[5120]: I0316 17:16:47.241552 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-v822j_ac55471d-4e42-475f-a082-50f611571482/kube-multus/0.log" Mar 16 17:16:47 crc kubenswrapper[5120]: I0316 17:16:47.260115 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-crc_9f0bc7fcb0822a2c13eb2d22cd8c0641/kube-controller-manager/0.log" Mar 16 17:16:47 crc kubenswrapper[5120]: I0316 17:16:47.528534 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-v822j_ac55471d-4e42-475f-a082-50f611571482/kube-multus/0.log" Mar 16 17:16:47 crc kubenswrapper[5120]: I0316 17:16:47.534042 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-crc_9f0bc7fcb0822a2c13eb2d22cd8c0641/kube-controller-manager/0.log" Mar 16 17:16:49 crc kubenswrapper[5120]: I0316 17:16:49.569962 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 17:16:52 crc kubenswrapper[5120]: I0316 17:16:52.008350 5120 patch_prober.go:28] interesting pod/machine-config-daemon-7bf76 container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 17:16:52 crc kubenswrapper[5120]: I0316 17:16:52.009188 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 17:17:08 crc kubenswrapper[5120]: E0316 17:17:08.053718 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1873270 actualBytes=10240 Mar 16 17:17:15 crc kubenswrapper[5120]: I0316 17:17:15.659073 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:17:20 crc kubenswrapper[5120]: I0316 17:17:20.976824 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 17:17:21 crc kubenswrapper[5120]: I0316 17:17:21.066326 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 17:17:21 crc kubenswrapper[5120]: I0316 17:17:21.066637 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/openstackclient" podUID="13336088-ad41-4ff2-afab-b0f1f8bb0e75" containerName="openstackclient" containerID="cri-o://d48240109d0a3c34c694d1bce1876d5c9a3e15e50367c9d12627dc968eddbf49" gracePeriod=2 Mar 16 17:17:21 crc kubenswrapper[5120]: I0316 17:17:21.068849 5120 status_manager.go:895] "Failed to get status for pod" podUID="13336088-ad41-4ff2-afab-b0f1f8bb0e75" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 17:17:21 crc kubenswrapper[5120]: I0316 17:17:21.102106 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 17:17:21 crc kubenswrapper[5120]: I0316 17:17:21.133570 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-2379-account-create-update-wkb97"] Mar 16 17:17:21 crc kubenswrapper[5120]: I0316 17:17:21.134827 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13336088-ad41-4ff2-afab-b0f1f8bb0e75" containerName="openstackclient" Mar 16 17:17:21 crc kubenswrapper[5120]: I0316 17:17:21.134848 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="13336088-ad41-4ff2-afab-b0f1f8bb0e75" containerName="openstackclient" Mar 16 17:17:21 crc kubenswrapper[5120]: I0316 17:17:21.135075 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="13336088-ad41-4ff2-afab-b0f1f8bb0e75" containerName="openstackclient" Mar 16 17:17:21 crc kubenswrapper[5120]: I0316 17:17:21.139652 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-2379-account-create-update-wkb97" Mar 16 17:17:21 crc kubenswrapper[5120]: I0316 17:17:21.147133 5120 status_manager.go:895] "Failed to get status for pod" podUID="13336088-ad41-4ff2-afab-b0f1f8bb0e75" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 17:17:21 crc kubenswrapper[5120]: I0316 17:17:21.147356 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-db-secret\"" Mar 16 17:17:21 crc kubenswrapper[5120]: I0316 17:17:21.153304 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-2379-account-create-update-hxlvn"] Mar 16 17:17:21 crc kubenswrapper[5120]: I0316 17:17:21.189316 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-2379-account-create-update-hxlvn"] Mar 16 17:17:21 crc kubenswrapper[5120]: I0316 17:17:21.220835 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-2379-account-create-update-wkb97"] Mar 16 17:17:21 crc kubenswrapper[5120]: I0316 17:17:21.231134 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/root-account-create-update-xbcxw"] Mar 16 17:17:21 crc kubenswrapper[5120]: I0316 17:17:21.260115 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-xbcxw" Mar 16 17:17:21 crc kubenswrapper[5120]: I0316 17:17:21.269869 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-tnpv8"] Mar 16 17:17:21 crc kubenswrapper[5120]: I0316 17:17:21.279660 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"openstack-mariadb-root-db-secret\"" Mar 16 17:17:21 crc kubenswrapper[5120]: I0316 17:17:21.280474 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/976307a4-0f5c-4e50-946f-682511e8e3bf-operator-scripts\") pod \"placement-2379-account-create-update-wkb97\" (UID: \"976307a4-0f5c-4e50-946f-682511e8e3bf\") " pod="openstack-kuttl-tests/placement-2379-account-create-update-wkb97" Mar 16 17:17:21 crc kubenswrapper[5120]: I0316 17:17:21.280805 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5hsk\" (UniqueName: \"kubernetes.io/projected/976307a4-0f5c-4e50-946f-682511e8e3bf-kube-api-access-g5hsk\") pod \"placement-2379-account-create-update-wkb97\" (UID: \"976307a4-0f5c-4e50-946f-682511e8e3bf\") " pod="openstack-kuttl-tests/placement-2379-account-create-update-wkb97" Mar 16 17:17:21 crc kubenswrapper[5120]: I0316 17:17:21.292209 5120 status_manager.go:895] "Failed to get status for pod" podUID="13336088-ad41-4ff2-afab-b0f1f8bb0e75" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 17:17:21 crc kubenswrapper[5120]: I0316 17:17:21.304114 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-xbcxw"] Mar 16 17:17:21 crc kubenswrapper[5120]: I0316 17:17:21.318181 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-tnpv8"] Mar 16 17:17:21 crc kubenswrapper[5120]: I0316 17:17:21.348815 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-4ea4-account-create-update-tp4sf"] Mar 16 17:17:21 crc kubenswrapper[5120]: I0316 17:17:21.363511 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-8685-account-create-update-xhm9x"] Mar 16 17:17:21 crc kubenswrapper[5120]: I0316 17:17:21.370142 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-4ea4-account-create-update-tp4sf" Mar 16 17:17:21 crc kubenswrapper[5120]: I0316 17:17:21.375998 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-db-secret\"" Mar 16 17:17:21 crc kubenswrapper[5120]: I0316 17:17:21.379129 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-8685-account-create-update-xhm9x" Mar 16 17:17:21 crc kubenswrapper[5120]: I0316 17:17:21.383066 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/976307a4-0f5c-4e50-946f-682511e8e3bf-operator-scripts\") pod \"placement-2379-account-create-update-wkb97\" (UID: \"976307a4-0f5c-4e50-946f-682511e8e3bf\") " pod="openstack-kuttl-tests/placement-2379-account-create-update-wkb97" Mar 16 17:17:21 crc kubenswrapper[5120]: I0316 17:17:21.383164 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c66rv\" (UniqueName: \"kubernetes.io/projected/54551b0a-84c0-40c7-a1d1-64dfbf2fd0d6-kube-api-access-c66rv\") pod \"root-account-create-update-xbcxw\" (UID: \"54551b0a-84c0-40c7-a1d1-64dfbf2fd0d6\") " pod="openstack-kuttl-tests/root-account-create-update-xbcxw" Mar 16 17:17:21 crc kubenswrapper[5120]: I0316 17:17:21.383397 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/54551b0a-84c0-40c7-a1d1-64dfbf2fd0d6-operator-scripts\") pod \"root-account-create-update-xbcxw\" (UID: \"54551b0a-84c0-40c7-a1d1-64dfbf2fd0d6\") " pod="openstack-kuttl-tests/root-account-create-update-xbcxw" Mar 16 17:17:21 crc kubenswrapper[5120]: I0316 17:17:21.383438 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g5hsk\" (UniqueName: \"kubernetes.io/projected/976307a4-0f5c-4e50-946f-682511e8e3bf-kube-api-access-g5hsk\") pod \"placement-2379-account-create-update-wkb97\" (UID: \"976307a4-0f5c-4e50-946f-682511e8e3bf\") " pod="openstack-kuttl-tests/placement-2379-account-create-update-wkb97" Mar 16 17:17:21 crc kubenswrapper[5120]: I0316 17:17:21.384565 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/976307a4-0f5c-4e50-946f-682511e8e3bf-operator-scripts\") pod \"placement-2379-account-create-update-wkb97\" (UID: \"976307a4-0f5c-4e50-946f-682511e8e3bf\") " pod="openstack-kuttl-tests/placement-2379-account-create-update-wkb97" Mar 16 17:17:21 crc kubenswrapper[5120]: I0316 17:17:21.393607 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-db-secret\"" Mar 16 17:17:21 crc kubenswrapper[5120]: I0316 17:17:21.396128 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-4ea4-account-create-update-tp4sf"] Mar 16 17:17:21 crc kubenswrapper[5120]: I0316 17:17:21.406321 5120 status_manager.go:895] "Failed to get status for pod" podUID="13336088-ad41-4ff2-afab-b0f1f8bb0e75" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 17:17:21 crc kubenswrapper[5120]: I0316 17:17:21.411694 5120 status_manager.go:895] "Failed to get status for pod" podUID="13336088-ad41-4ff2-afab-b0f1f8bb0e75" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 17:17:21 crc kubenswrapper[5120]: I0316 17:17:21.425824 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 17:17:21 crc kubenswrapper[5120]: I0316 17:17:21.453552 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-8685-account-create-update-xhm9x"] Mar 16 17:17:21 crc kubenswrapper[5120]: I0316 17:17:21.457252 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5hsk\" (UniqueName: \"kubernetes.io/projected/976307a4-0f5c-4e50-946f-682511e8e3bf-kube-api-access-g5hsk\") pod \"placement-2379-account-create-update-wkb97\" (UID: \"976307a4-0f5c-4e50-946f-682511e8e3bf\") " pod="openstack-kuttl-tests/placement-2379-account-create-update-wkb97" Mar 16 17:17:21 crc kubenswrapper[5120]: I0316 17:17:21.478652 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-4ea4-account-create-update-xv79b"] Mar 16 17:17:21 crc kubenswrapper[5120]: I0316 17:17:21.488313 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0a59e429-ba97-491f-91d4-9b1b063fc15b-operator-scripts\") pod \"barbican-4ea4-account-create-update-tp4sf\" (UID: \"0a59e429-ba97-491f-91d4-9b1b063fc15b\") " pod="openstack-kuttl-tests/barbican-4ea4-account-create-update-tp4sf" Mar 16 17:17:21 crc kubenswrapper[5120]: I0316 17:17:21.488476 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/54551b0a-84c0-40c7-a1d1-64dfbf2fd0d6-operator-scripts\") pod \"root-account-create-update-xbcxw\" (UID: \"54551b0a-84c0-40c7-a1d1-64dfbf2fd0d6\") " pod="openstack-kuttl-tests/root-account-create-update-xbcxw" Mar 16 17:17:21 crc kubenswrapper[5120]: I0316 17:17:21.488562 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5ab53d7f-0e81-4c07-b2d3-24404dcbcc16-operator-scripts\") pod \"neutron-8685-account-create-update-xhm9x\" (UID: \"5ab53d7f-0e81-4c07-b2d3-24404dcbcc16\") " pod="openstack-kuttl-tests/neutron-8685-account-create-update-xhm9x" Mar 16 17:17:21 crc kubenswrapper[5120]: I0316 17:17:21.488861 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vfhl\" (UniqueName: \"kubernetes.io/projected/5ab53d7f-0e81-4c07-b2d3-24404dcbcc16-kube-api-access-5vfhl\") pod \"neutron-8685-account-create-update-xhm9x\" (UID: \"5ab53d7f-0e81-4c07-b2d3-24404dcbcc16\") " pod="openstack-kuttl-tests/neutron-8685-account-create-update-xhm9x" Mar 16 17:17:21 crc kubenswrapper[5120]: I0316 17:17:21.488900 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c66rv\" (UniqueName: \"kubernetes.io/projected/54551b0a-84c0-40c7-a1d1-64dfbf2fd0d6-kube-api-access-c66rv\") pod \"root-account-create-update-xbcxw\" (UID: \"54551b0a-84c0-40c7-a1d1-64dfbf2fd0d6\") " pod="openstack-kuttl-tests/root-account-create-update-xbcxw" Mar 16 17:17:21 crc kubenswrapper[5120]: I0316 17:17:21.488967 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqnfg\" (UniqueName: \"kubernetes.io/projected/0a59e429-ba97-491f-91d4-9b1b063fc15b-kube-api-access-cqnfg\") pod \"barbican-4ea4-account-create-update-tp4sf\" (UID: \"0a59e429-ba97-491f-91d4-9b1b063fc15b\") " pod="openstack-kuttl-tests/barbican-4ea4-account-create-update-tp4sf" Mar 16 17:17:21 crc kubenswrapper[5120]: I0316 17:17:21.491014 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-2379-account-create-update-wkb97" Mar 16 17:17:21 crc kubenswrapper[5120]: I0316 17:17:21.491552 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-4ea4-account-create-update-xv79b"] Mar 16 17:17:21 crc kubenswrapper[5120]: I0316 17:17:21.504349 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/54551b0a-84c0-40c7-a1d1-64dfbf2fd0d6-operator-scripts\") pod \"root-account-create-update-xbcxw\" (UID: \"54551b0a-84c0-40c7-a1d1-64dfbf2fd0d6\") " pod="openstack-kuttl-tests/root-account-create-update-xbcxw" Mar 16 17:17:21 crc kubenswrapper[5120]: I0316 17:17:21.536518 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c66rv\" (UniqueName: \"kubernetes.io/projected/54551b0a-84c0-40c7-a1d1-64dfbf2fd0d6-kube-api-access-c66rv\") pod \"root-account-create-update-xbcxw\" (UID: \"54551b0a-84c0-40c7-a1d1-64dfbf2fd0d6\") " pod="openstack-kuttl-tests/root-account-create-update-xbcxw" Mar 16 17:17:21 crc kubenswrapper[5120]: I0316 17:17:21.540699 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 17:17:21 crc kubenswrapper[5120]: I0316 17:17:21.541505 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podUID="5ba234a2-95db-4cf8-a7de-7ddc034f58b7" containerName="openstack-network-exporter" containerID="cri-o://40c8b7b52a9f3ac29bf620def0abc9ab43dd5e83ec58521a17628b610bddd54a" gracePeriod=300 Mar 16 17:17:21 crc kubenswrapper[5120]: I0316 17:17:21.561863 5120 status_manager.go:895] "Failed to get status for pod" podUID="13336088-ad41-4ff2-afab-b0f1f8bb0e75" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 17:17:21 crc kubenswrapper[5120]: I0316 17:17:21.584775 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-1cd2-account-create-update-xklg9"] Mar 16 17:17:21 crc kubenswrapper[5120]: I0316 17:17:21.591702 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0a59e429-ba97-491f-91d4-9b1b063fc15b-operator-scripts\") pod \"barbican-4ea4-account-create-update-tp4sf\" (UID: \"0a59e429-ba97-491f-91d4-9b1b063fc15b\") " pod="openstack-kuttl-tests/barbican-4ea4-account-create-update-tp4sf" Mar 16 17:17:21 crc kubenswrapper[5120]: I0316 17:17:21.591886 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5ab53d7f-0e81-4c07-b2d3-24404dcbcc16-operator-scripts\") pod \"neutron-8685-account-create-update-xhm9x\" (UID: \"5ab53d7f-0e81-4c07-b2d3-24404dcbcc16\") " pod="openstack-kuttl-tests/neutron-8685-account-create-update-xhm9x" Mar 16 17:17:21 crc kubenswrapper[5120]: I0316 17:17:21.592128 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5vfhl\" (UniqueName: \"kubernetes.io/projected/5ab53d7f-0e81-4c07-b2d3-24404dcbcc16-kube-api-access-5vfhl\") pod \"neutron-8685-account-create-update-xhm9x\" (UID: \"5ab53d7f-0e81-4c07-b2d3-24404dcbcc16\") " pod="openstack-kuttl-tests/neutron-8685-account-create-update-xhm9x" Mar 16 17:17:21 crc kubenswrapper[5120]: I0316 17:17:21.592207 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cqnfg\" (UniqueName: \"kubernetes.io/projected/0a59e429-ba97-491f-91d4-9b1b063fc15b-kube-api-access-cqnfg\") pod \"barbican-4ea4-account-create-update-tp4sf\" (UID: \"0a59e429-ba97-491f-91d4-9b1b063fc15b\") " pod="openstack-kuttl-tests/barbican-4ea4-account-create-update-tp4sf" Mar 16 17:17:21 crc kubenswrapper[5120]: I0316 17:17:21.593201 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0a59e429-ba97-491f-91d4-9b1b063fc15b-operator-scripts\") pod \"barbican-4ea4-account-create-update-tp4sf\" (UID: \"0a59e429-ba97-491f-91d4-9b1b063fc15b\") " pod="openstack-kuttl-tests/barbican-4ea4-account-create-update-tp4sf" Mar 16 17:17:21 crc kubenswrapper[5120]: I0316 17:17:21.593682 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5ab53d7f-0e81-4c07-b2d3-24404dcbcc16-operator-scripts\") pod \"neutron-8685-account-create-update-xhm9x\" (UID: \"5ab53d7f-0e81-4c07-b2d3-24404dcbcc16\") " pod="openstack-kuttl-tests/neutron-8685-account-create-update-xhm9x" Mar 16 17:17:21 crc kubenswrapper[5120]: I0316 17:17:21.600601 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-1cd2-account-create-update-xklg9" Mar 16 17:17:21 crc kubenswrapper[5120]: I0316 17:17:21.603233 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-xbcxw" Mar 16 17:17:21 crc kubenswrapper[5120]: I0316 17:17:21.606567 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-1cd2-account-create-update-xklg9"] Mar 16 17:17:21 crc kubenswrapper[5120]: I0316 17:17:21.617203 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-db-secret\"" Mar 16 17:17:21 crc kubenswrapper[5120]: I0316 17:17:21.651482 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vfhl\" (UniqueName: \"kubernetes.io/projected/5ab53d7f-0e81-4c07-b2d3-24404dcbcc16-kube-api-access-5vfhl\") pod \"neutron-8685-account-create-update-xhm9x\" (UID: \"5ab53d7f-0e81-4c07-b2d3-24404dcbcc16\") " pod="openstack-kuttl-tests/neutron-8685-account-create-update-xhm9x" Mar 16 17:17:21 crc kubenswrapper[5120]: I0316 17:17:21.655385 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 17:17:21 crc kubenswrapper[5120]: I0316 17:17:21.655740 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podUID="75c97708-5716-4b9d-af7a-d442efb1c830" containerName="openstack-network-exporter" containerID="cri-o://a0d4bfc6c85daa1fcf1a87c1a6df3b7f339f491480a12e4b212421a42ce97347" gracePeriod=300 Mar 16 17:17:21 crc kubenswrapper[5120]: I0316 17:17:21.659652 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqnfg\" (UniqueName: \"kubernetes.io/projected/0a59e429-ba97-491f-91d4-9b1b063fc15b-kube-api-access-cqnfg\") pod \"barbican-4ea4-account-create-update-tp4sf\" (UID: \"0a59e429-ba97-491f-91d4-9b1b063fc15b\") " pod="openstack-kuttl-tests/barbican-4ea4-account-create-update-tp4sf" Mar 16 17:17:21 crc kubenswrapper[5120]: I0316 17:17:21.679541 5120 status_manager.go:895] "Failed to get status for pod" podUID="13336088-ad41-4ff2-afab-b0f1f8bb0e75" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 17:17:21 crc kubenswrapper[5120]: I0316 17:17:21.690842 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-8685-account-create-update-5zjjt"] Mar 16 17:17:21 crc kubenswrapper[5120]: I0316 17:17:21.691162 5120 status_manager.go:895] "Failed to get status for pod" podUID="13336088-ad41-4ff2-afab-b0f1f8bb0e75" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 17:17:21 crc kubenswrapper[5120]: I0316 17:17:21.694000 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmzdr\" (UniqueName: \"kubernetes.io/projected/8b695735-ad55-4ce9-ac75-42381bcaffbf-kube-api-access-cmzdr\") pod \"glance-1cd2-account-create-update-xklg9\" (UID: \"8b695735-ad55-4ce9-ac75-42381bcaffbf\") " pod="openstack-kuttl-tests/glance-1cd2-account-create-update-xklg9" Mar 16 17:17:21 crc kubenswrapper[5120]: I0316 17:17:21.694173 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8b695735-ad55-4ce9-ac75-42381bcaffbf-operator-scripts\") pod \"glance-1cd2-account-create-update-xklg9\" (UID: \"8b695735-ad55-4ce9-ac75-42381bcaffbf\") " pod="openstack-kuttl-tests/glance-1cd2-account-create-update-xklg9" Mar 16 17:17:21 crc kubenswrapper[5120]: I0316 17:17:21.720672 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-4ea4-account-create-update-tp4sf" Mar 16 17:17:21 crc kubenswrapper[5120]: I0316 17:17:21.736380 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-8685-account-create-update-xhm9x" Mar 16 17:17:21 crc kubenswrapper[5120]: I0316 17:17:21.759748 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-8685-account-create-update-5zjjt"] Mar 16 17:17:21 crc kubenswrapper[5120]: I0316 17:17:21.799619 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8b695735-ad55-4ce9-ac75-42381bcaffbf-operator-scripts\") pod \"glance-1cd2-account-create-update-xklg9\" (UID: \"8b695735-ad55-4ce9-ac75-42381bcaffbf\") " pod="openstack-kuttl-tests/glance-1cd2-account-create-update-xklg9" Mar 16 17:17:21 crc kubenswrapper[5120]: I0316 17:17:21.800326 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cmzdr\" (UniqueName: \"kubernetes.io/projected/8b695735-ad55-4ce9-ac75-42381bcaffbf-kube-api-access-cmzdr\") pod \"glance-1cd2-account-create-update-xklg9\" (UID: \"8b695735-ad55-4ce9-ac75-42381bcaffbf\") " pod="openstack-kuttl-tests/glance-1cd2-account-create-update-xklg9" Mar 16 17:17:21 crc kubenswrapper[5120]: I0316 17:17:21.802623 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8b695735-ad55-4ce9-ac75-42381bcaffbf-operator-scripts\") pod \"glance-1cd2-account-create-update-xklg9\" (UID: \"8b695735-ad55-4ce9-ac75-42381bcaffbf\") " pod="openstack-kuttl-tests/glance-1cd2-account-create-update-xklg9" Mar 16 17:17:21 crc kubenswrapper[5120]: I0316 17:17:21.805892 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-1cd2-account-create-update-rs7cb"] Mar 16 17:17:21 crc kubenswrapper[5120]: I0316 17:17:21.827256 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/openstack-cell1-galera-0" podUID="2dd828c2-16f2-4e69-b0b8-b953caf55f5b" containerName="galera" probeResult="failure" output="command timed out" Mar 16 17:17:21 crc kubenswrapper[5120]: I0316 17:17:21.866207 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmzdr\" (UniqueName: \"kubernetes.io/projected/8b695735-ad55-4ce9-ac75-42381bcaffbf-kube-api-access-cmzdr\") pod \"glance-1cd2-account-create-update-xklg9\" (UID: \"8b695735-ad55-4ce9-ac75-42381bcaffbf\") " pod="openstack-kuttl-tests/glance-1cd2-account-create-update-xklg9" Mar 16 17:17:21 crc kubenswrapper[5120]: I0316 17:17:21.870409 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podUID="5ba234a2-95db-4cf8-a7de-7ddc034f58b7" containerName="ovsdbserver-sb" containerID="cri-o://6ca166115dd4eb9c50d15ae1ac4e26c4b343c58645a0e8a031bb2139d052a30a" gracePeriod=300 Mar 16 17:17:21 crc kubenswrapper[5120]: I0316 17:17:21.870567 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-1cd2-account-create-update-rs7cb"] Mar 16 17:17:21 crc kubenswrapper[5120]: I0316 17:17:21.919304 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-fb5jp"] Mar 16 17:17:21 crc kubenswrapper[5120]: I0316 17:17:21.922373 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podUID="75c97708-5716-4b9d-af7a-d442efb1c830" containerName="ovsdbserver-nb" containerID="cri-o://2b1f4a51e957de0117e8df83a8b490bb03c81acb532eec020956c1ef08405199" gracePeriod=300 Mar 16 17:17:21 crc kubenswrapper[5120]: I0316 17:17:21.945117 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-fb5jp"] Mar 16 17:17:21 crc kubenswrapper[5120]: I0316 17:17:21.995679 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podUID="75c97708-5716-4b9d-af7a-d442efb1c830" containerName="ovsdbserver-nb" probeResult="failure" output="" Mar 16 17:17:22 crc kubenswrapper[5120]: I0316 17:17:22.025189 5120 patch_prober.go:28] interesting pod/machine-config-daemon-7bf76 container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 17:17:22 crc kubenswrapper[5120]: I0316 17:17:22.025251 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 17:17:22 crc kubenswrapper[5120]: I0316 17:17:22.025306 5120 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" Mar 16 17:17:22 crc kubenswrapper[5120]: I0316 17:17:22.027104 5120 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="machine-config-daemon" containerStatusID={"Type":"cri-o","ID":"2ca61165dca6fdb30458423ef74c44c42b1b273e8fa504e89f5f9e186e516cc3"} pod="openshift-machine-config-operator/machine-config-daemon-7bf76" containerMessage="Container machine-config-daemon failed liveness probe, will be restarted" Mar 16 17:17:22 crc kubenswrapper[5120]: I0316 17:17:22.027192 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" containerID="cri-o://2ca61165dca6fdb30458423ef74c44c42b1b273e8fa504e89f5f9e186e516cc3" gracePeriod=600 Mar 16 17:17:22 crc kubenswrapper[5120]: I0316 17:17:22.046381 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-p5rds"] Mar 16 17:17:22 crc kubenswrapper[5120]: I0316 17:17:22.093623 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-1cd2-account-create-update-xklg9" Mar 16 17:17:22 crc kubenswrapper[5120]: I0316 17:17:22.137254 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-p5rds"] Mar 16 17:17:22 crc kubenswrapper[5120]: I0316 17:17:22.229518 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_5ba234a2-95db-4cf8-a7de-7ddc034f58b7/ovsdbserver-sb/0.log" Mar 16 17:17:22 crc kubenswrapper[5120]: I0316 17:17:22.229595 5120 generic.go:358] "Generic (PLEG): container finished" podID="5ba234a2-95db-4cf8-a7de-7ddc034f58b7" containerID="40c8b7b52a9f3ac29bf620def0abc9ab43dd5e83ec58521a17628b610bddd54a" exitCode=2 Mar 16 17:17:22 crc kubenswrapper[5120]: I0316 17:17:22.229746 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"5ba234a2-95db-4cf8-a7de-7ddc034f58b7","Type":"ContainerDied","Data":"40c8b7b52a9f3ac29bf620def0abc9ab43dd5e83ec58521a17628b610bddd54a"} Mar 16 17:17:22 crc kubenswrapper[5120]: I0316 17:17:22.236404 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_75c97708-5716-4b9d-af7a-d442efb1c830/ovsdbserver-nb/0.log" Mar 16 17:17:22 crc kubenswrapper[5120]: I0316 17:17:22.236465 5120 generic.go:358] "Generic (PLEG): container finished" podID="75c97708-5716-4b9d-af7a-d442efb1c830" containerID="a0d4bfc6c85daa1fcf1a87c1a6df3b7f339f491480a12e4b212421a42ce97347" exitCode=2 Mar 16 17:17:22 crc kubenswrapper[5120]: I0316 17:17:22.237052 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"75c97708-5716-4b9d-af7a-d442efb1c830","Type":"ContainerDied","Data":"a0d4bfc6c85daa1fcf1a87c1a6df3b7f339f491480a12e4b212421a42ce97347"} Mar 16 17:17:22 crc kubenswrapper[5120]: I0316 17:17:22.255442 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 17:17:22 crc kubenswrapper[5120]: I0316 17:17:22.255934 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovn-northd-0" podUID="161d5626-9918-4847-96fd-f93d894bc230" containerName="ovn-northd" containerID="cri-o://24333b7cdb26c2e70048e18dcdaeac57a05c823200ef25ebc7bd2a0912464cf3" gracePeriod=30 Mar 16 17:17:22 crc kubenswrapper[5120]: I0316 17:17:22.256120 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovn-northd-0" podUID="161d5626-9918-4847-96fd-f93d894bc230" containerName="openstack-network-exporter" containerID="cri-o://232557928a11f779afc7e7739d08c9c5eae278bdb6cad4018a9b79f28340ae03" gracePeriod=30 Mar 16 17:17:22 crc kubenswrapper[5120]: I0316 17:17:22.257912 5120 status_manager.go:895] "Failed to get status for pod" podUID="13336088-ad41-4ff2-afab-b0f1f8bb0e75" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 17:17:22 crc kubenswrapper[5120]: E0316 17:17:22.263601 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 17:17:22 crc kubenswrapper[5120]: I0316 17:17:22.270852 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-eb52-account-create-update-rkbs2"] Mar 16 17:17:22 crc kubenswrapper[5120]: I0316 17:17:22.285589 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-59pw4"] Mar 16 17:17:22 crc kubenswrapper[5120]: I0316 17:17:22.298663 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-59pw4"] Mar 16 17:17:22 crc kubenswrapper[5120]: I0316 17:17:22.307106 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-eb52-account-create-update-rkbs2"] Mar 16 17:17:22 crc kubenswrapper[5120]: I0316 17:17:22.319833 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-5jnpc"] Mar 16 17:17:22 crc kubenswrapper[5120]: I0316 17:17:22.337354 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-5jnpc"] Mar 16 17:17:22 crc kubenswrapper[5120]: I0316 17:17:22.366730 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-cdsvl"] Mar 16 17:17:22 crc kubenswrapper[5120]: I0316 17:17:22.378198 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-cdsvl"] Mar 16 17:17:22 crc kubenswrapper[5120]: I0316 17:17:22.439841 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-54d5-account-create-update-lgn6q"] Mar 16 17:17:22 crc kubenswrapper[5120]: I0316 17:17:22.518322 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-54d5-account-create-update-lgn6q"] Mar 16 17:17:22 crc kubenswrapper[5120]: I0316 17:17:22.576535 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 17:17:22 crc kubenswrapper[5120]: I0316 17:17:22.576874 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="d14c3978-d254-4ec4-baa0-f011eaef745e" containerName="cinder-api-log" containerID="cri-o://1e11ae8d54987876ff5eee468abe7e70824cb0497d72bcb53bdc81aed418c318" gracePeriod=30 Mar 16 17:17:22 crc kubenswrapper[5120]: I0316 17:17:22.577399 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="d14c3978-d254-4ec4-baa0-f011eaef745e" containerName="cinder-api" containerID="cri-o://64455790d468e852fe6069aaee149c1ccbf41669030eb68f8c6c996c4885896e" gracePeriod=30 Mar 16 17:17:22 crc kubenswrapper[5120]: I0316 17:17:22.592501 5120 status_manager.go:895] "Failed to get status for pod" podUID="13336088-ad41-4ff2-afab-b0f1f8bb0e75" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 17:17:22 crc kubenswrapper[5120]: I0316 17:17:22.609010 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 17:17:22 crc kubenswrapper[5120]: I0316 17:17:22.609282 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="57e08e60-42d1-4b58-9892-c2aa5bbae2cf" containerName="cinder-scheduler" containerID="cri-o://6d193e9b3e72813100bb0dd0568015bdb73ff4460f0f8eabcee9b6e240ce5d85" gracePeriod=30 Mar 16 17:17:22 crc kubenswrapper[5120]: I0316 17:17:22.609438 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="57e08e60-42d1-4b58-9892-c2aa5bbae2cf" containerName="probe" containerID="cri-o://e45a713f90daea3dfb25bc19fbe35a5087a998babd98c6f27853be3e15ff43a6" gracePeriod=30 Mar 16 17:17:22 crc kubenswrapper[5120]: I0316 17:17:22.618553 5120 status_manager.go:895] "Failed to get status for pod" podUID="13336088-ad41-4ff2-afab-b0f1f8bb0e75" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 17:17:22 crc kubenswrapper[5120]: I0316 17:17:22.630933 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 17:17:22 crc kubenswrapper[5120]: I0316 17:17:22.644147 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-5b79cc5b54-db2hd"] Mar 16 17:17:22 crc kubenswrapper[5120]: I0316 17:17:22.644437 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-5b79cc5b54-db2hd" podUID="1976af1c-93c9-487c-9852-752bb5c1234d" containerName="placement-log" containerID="cri-o://4e6c0f66786b5e3b4a73599395a4b0251b018a5b233eaa26d6632468ef6db93c" gracePeriod=30 Mar 16 17:17:22 crc kubenswrapper[5120]: I0316 17:17:22.644598 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-5b79cc5b54-db2hd" podUID="1976af1c-93c9-487c-9852-752bb5c1234d" containerName="placement-api" containerID="cri-o://c5fef62b06d8256f82c76b40b8a78f4431b6cbe5fe68d35ce041bf7aec63df7c" gracePeriod=30 Mar 16 17:17:22 crc kubenswrapper[5120]: I0316 17:17:22.655193 5120 status_manager.go:895] "Failed to get status for pod" podUID="13336088-ad41-4ff2-afab-b0f1f8bb0e75" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 17:17:22 crc kubenswrapper[5120]: I0316 17:17:22.679727 5120 status_manager.go:895] "Failed to get status for pod" podUID="13336088-ad41-4ff2-afab-b0f1f8bb0e75" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 17:17:22 crc kubenswrapper[5120]: I0316 17:17:22.804152 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="395a908b-e313-45e5-b42d-5fbf7eb4ac61" path="/var/lib/kubelet/pods/395a908b-e313-45e5-b42d-5fbf7eb4ac61/volumes" Mar 16 17:17:22 crc kubenswrapper[5120]: I0316 17:17:22.804737 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="39b9a721-a37f-492d-bda7-bcab36745d51" path="/var/lib/kubelet/pods/39b9a721-a37f-492d-bda7-bcab36745d51/volumes" Mar 16 17:17:22 crc kubenswrapper[5120]: I0316 17:17:22.805288 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="40adeacf-10ac-43fe-be98-7ab309206d9e" path="/var/lib/kubelet/pods/40adeacf-10ac-43fe-be98-7ab309206d9e/volumes" Mar 16 17:17:22 crc kubenswrapper[5120]: I0316 17:17:22.807667 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="45f36096-a6d2-45e4-8fd7-61febd7eb8ae" path="/var/lib/kubelet/pods/45f36096-a6d2-45e4-8fd7-61febd7eb8ae/volumes" Mar 16 17:17:22 crc kubenswrapper[5120]: I0316 17:17:22.808434 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c3e034d-e36c-4df9-b612-9bc3c8322880" path="/var/lib/kubelet/pods/4c3e034d-e36c-4df9-b612-9bc3c8322880/volumes" Mar 16 17:17:22 crc kubenswrapper[5120]: I0316 17:17:22.808854 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/rabbitmq-server-0" podUID="dd339abc-691c-48f1-8674-430a5e806067" containerName="rabbitmq" containerID="cri-o://3dbccce89cd901c0416da3e41b60454cf2ab5860b9727c911dacea8d5361320b" gracePeriod=604800 Mar 16 17:17:22 crc kubenswrapper[5120]: I0316 17:17:22.808975 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5e487707-6cf9-42cb-924f-cc201ecbdb55" path="/var/lib/kubelet/pods/5e487707-6cf9-42cb-924f-cc201ecbdb55/volumes" Mar 16 17:17:22 crc kubenswrapper[5120]: I0316 17:17:22.810334 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="62ffd5af-996f-414a-bf84-daf4cc0fe7e0" path="/var/lib/kubelet/pods/62ffd5af-996f-414a-bf84-daf4cc0fe7e0/volumes" Mar 16 17:17:22 crc kubenswrapper[5120]: I0316 17:17:22.810905 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="69aeb71a-453a-4d4f-bdd2-3e0541c12060" path="/var/lib/kubelet/pods/69aeb71a-453a-4d4f-bdd2-3e0541c12060/volumes" Mar 16 17:17:22 crc kubenswrapper[5120]: I0316 17:17:22.811469 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6e8fd7b0-4bfd-4f90-a8ec-063aaa83143f" path="/var/lib/kubelet/pods/6e8fd7b0-4bfd-4f90-a8ec-063aaa83143f/volumes" Mar 16 17:17:22 crc kubenswrapper[5120]: I0316 17:17:22.812068 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ede1efb-38ea-42e1-87b9-fd608faec542" path="/var/lib/kubelet/pods/6ede1efb-38ea-42e1-87b9-fd608faec542/volumes" Mar 16 17:17:22 crc kubenswrapper[5120]: I0316 17:17:22.813082 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ead6a88-e81b-482d-b510-f5ac67e0018a" path="/var/lib/kubelet/pods/9ead6a88-e81b-482d-b510-f5ac67e0018a/volumes" Mar 16 17:17:22 crc kubenswrapper[5120]: I0316 17:17:22.813592 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dd9b9ccd-51eb-4f86-864b-e19b9f40e043" path="/var/lib/kubelet/pods/dd9b9ccd-51eb-4f86-864b-e19b9f40e043/volumes" Mar 16 17:17:22 crc kubenswrapper[5120]: I0316 17:17:22.814395 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-645b-account-create-update-lgc2j"] Mar 16 17:17:22 crc kubenswrapper[5120]: I0316 17:17:22.814451 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-645b-account-create-update-lgc2j"] Mar 16 17:17:22 crc kubenswrapper[5120]: I0316 17:17:22.814476 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 17:17:22 crc kubenswrapper[5120]: I0316 17:17:22.814495 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-3030-account-create-update-kwtzw"] Mar 16 17:17:22 crc kubenswrapper[5120]: I0316 17:17:22.814505 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-mp7zl"] Mar 16 17:17:22 crc kubenswrapper[5120]: I0316 17:17:22.815001 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="453261b9-e47c-4e0b-b37d-4803c7ea4eab" containerName="account-server" containerID="cri-o://bfd438fe482625b6acaa98a3f3b1df39124d070d7c82b30f3b95847f5e4307eb" gracePeriod=30 Mar 16 17:17:22 crc kubenswrapper[5120]: I0316 17:17:22.815115 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="453261b9-e47c-4e0b-b37d-4803c7ea4eab" containerName="object-server" containerID="cri-o://aebd95ed2c80cf68f4a11d63e8a9c7417a4d2c89e19691fded4789fac5ae5ced" gracePeriod=30 Mar 16 17:17:22 crc kubenswrapper[5120]: I0316 17:17:22.815154 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="453261b9-e47c-4e0b-b37d-4803c7ea4eab" containerName="container-updater" containerID="cri-o://d5fd97d3f54b33d918d40a1a213325ea152cca47586abb186341b0193714ad03" gracePeriod=30 Mar 16 17:17:22 crc kubenswrapper[5120]: I0316 17:17:22.815183 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="453261b9-e47c-4e0b-b37d-4803c7ea4eab" containerName="container-auditor" containerID="cri-o://847cfa54fe526dabece95c278159d3228a748d5a41f03c0874e7e56a380b6047" gracePeriod=30 Mar 16 17:17:22 crc kubenswrapper[5120]: I0316 17:17:22.815211 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="453261b9-e47c-4e0b-b37d-4803c7ea4eab" containerName="container-replicator" containerID="cri-o://12e294147acf3be6360a4168f01b6847c3952f8b1f777061c712b9dcddb549e9" gracePeriod=30 Mar 16 17:17:22 crc kubenswrapper[5120]: I0316 17:17:22.815239 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="453261b9-e47c-4e0b-b37d-4803c7ea4eab" containerName="container-server" containerID="cri-o://7609d755e551179d21b21ae75424817749513f60f07273b47f02ee1165742636" gracePeriod=30 Mar 16 17:17:22 crc kubenswrapper[5120]: I0316 17:17:22.815271 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="453261b9-e47c-4e0b-b37d-4803c7ea4eab" containerName="account-reaper" containerID="cri-o://f2a05b9a55ce5e5912e0e5ca27fa34a32cd099c2e9473cdafa26eef99b1aade8" gracePeriod=30 Mar 16 17:17:22 crc kubenswrapper[5120]: I0316 17:17:22.815302 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="453261b9-e47c-4e0b-b37d-4803c7ea4eab" containerName="account-auditor" containerID="cri-o://2a68f298ec63891421aa48c2086b5969e7ccffebf4a9b32a37f55e9ca39b4362" gracePeriod=30 Mar 16 17:17:22 crc kubenswrapper[5120]: I0316 17:17:22.815332 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="453261b9-e47c-4e0b-b37d-4803c7ea4eab" containerName="account-replicator" containerID="cri-o://f450ab68730ad34b2967fa5253614c5b25a40a841fe623c369a1631922d89171" gracePeriod=30 Mar 16 17:17:22 crc kubenswrapper[5120]: I0316 17:17:22.815013 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="453261b9-e47c-4e0b-b37d-4803c7ea4eab" containerName="rsync" containerID="cri-o://a1b10d99c0cdaf702b9aeb081186b9737661b9e1ad04908bd766605b4e038b52" gracePeriod=30 Mar 16 17:17:22 crc kubenswrapper[5120]: I0316 17:17:22.815597 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="453261b9-e47c-4e0b-b37d-4803c7ea4eab" containerName="swift-recon-cron" containerID="cri-o://e70bc9242f954992b3712fa002a61869c3838299235abfea9c2b0e824a67d0e2" gracePeriod=30 Mar 16 17:17:22 crc kubenswrapper[5120]: I0316 17:17:22.815895 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="453261b9-e47c-4e0b-b37d-4803c7ea4eab" containerName="object-updater" containerID="cri-o://22b3d482c1dbe9466b48add66f35c279c3a30492318c0515c5d724ca2e13919a" gracePeriod=30 Mar 16 17:17:22 crc kubenswrapper[5120]: I0316 17:17:22.816006 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="453261b9-e47c-4e0b-b37d-4803c7ea4eab" containerName="object-expirer" containerID="cri-o://3df7a51b81f9adfb6f8812a838726626d4151033510e8139103925ba0a6c9636" gracePeriod=30 Mar 16 17:17:22 crc kubenswrapper[5120]: I0316 17:17:22.816218 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="453261b9-e47c-4e0b-b37d-4803c7ea4eab" containerName="object-auditor" containerID="cri-o://29984c871f3af037965519d7341a4a9f76503ecacedf63c951528b0c3f7621e3" gracePeriod=30 Mar 16 17:17:22 crc kubenswrapper[5120]: I0316 17:17:22.816479 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="453261b9-e47c-4e0b-b37d-4803c7ea4eab" containerName="object-replicator" containerID="cri-o://3fdb66fbf7a3609693d5bb010ec8b7a9f831e0bc3f2074a737c8ffb1b1a0a870" gracePeriod=30 Mar 16 17:17:22 crc kubenswrapper[5120]: I0316 17:17:22.821473 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-3030-account-create-update-kwtzw"] Mar 16 17:17:22 crc kubenswrapper[5120]: I0316 17:17:22.850192 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-mp7zl"] Mar 16 17:17:22 crc kubenswrapper[5120]: I0316 17:17:22.871726 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-54b8764f4-w5thh"] Mar 16 17:17:22 crc kubenswrapper[5120]: I0316 17:17:22.872024 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-54b8764f4-w5thh" podUID="35eb763c-5d62-4401-a5b6-da3c538709ab" containerName="neutron-api" containerID="cri-o://e4a638cbed60817301f57976644cbe4df50aed911247759003265d9dbc556dc2" gracePeriod=30 Mar 16 17:17:22 crc kubenswrapper[5120]: I0316 17:17:22.873232 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-54b8764f4-w5thh" podUID="35eb763c-5d62-4401-a5b6-da3c538709ab" containerName="neutron-httpd" containerID="cri-o://8761461c33c67611245395eb53b183f8ce91a3a0f2ea958ac3ad5d1fcb3bc8b7" gracePeriod=30 Mar 16 17:17:22 crc kubenswrapper[5120]: I0316 17:17:22.909879 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-8lvrl"] Mar 16 17:17:22 crc kubenswrapper[5120]: I0316 17:17:22.935401 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-8lvrl"] Mar 16 17:17:22 crc kubenswrapper[5120]: I0316 17:17:22.967855 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-5r7xg"] Mar 16 17:17:22 crc kubenswrapper[5120]: I0316 17:17:22.979855 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-5r7xg"] Mar 16 17:17:22 crc kubenswrapper[5120]: I0316 17:17:22.981967 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-5r7xg" Mar 16 17:17:23 crc kubenswrapper[5120]: I0316 17:17:23.063072 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gs94\" (UniqueName: \"kubernetes.io/projected/05faed40-e1aa-44be-bae7-49459da3dc79-kube-api-access-7gs94\") pod \"dnsmasq-dnsmasq-79dcd846c5-5r7xg\" (UID: \"05faed40-e1aa-44be-bae7-49459da3dc79\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-5r7xg" Mar 16 17:17:23 crc kubenswrapper[5120]: I0316 17:17:23.063218 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/05faed40-e1aa-44be-bae7-49459da3dc79-config\") pod \"dnsmasq-dnsmasq-79dcd846c5-5r7xg\" (UID: \"05faed40-e1aa-44be-bae7-49459da3dc79\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-5r7xg" Mar 16 17:17:23 crc kubenswrapper[5120]: I0316 17:17:23.063328 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/05faed40-e1aa-44be-bae7-49459da3dc79-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-79dcd846c5-5r7xg\" (UID: \"05faed40-e1aa-44be-bae7-49459da3dc79\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-5r7xg" Mar 16 17:17:23 crc kubenswrapper[5120]: I0316 17:17:23.117880 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-jsgxw"] Mar 16 17:17:23 crc kubenswrapper[5120]: I0316 17:17:23.163961 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/rabbitmq-server-0" podUID="dd339abc-691c-48f1-8674-430a5e806067" containerName="rabbitmq" probeResult="failure" output="dial tcp 10.217.0.119:5671: connect: connection refused" Mar 16 17:17:23 crc kubenswrapper[5120]: I0316 17:17:23.166128 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/05faed40-e1aa-44be-bae7-49459da3dc79-config\") pod \"dnsmasq-dnsmasq-79dcd846c5-5r7xg\" (UID: \"05faed40-e1aa-44be-bae7-49459da3dc79\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-5r7xg" Mar 16 17:17:23 crc kubenswrapper[5120]: I0316 17:17:23.166324 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/05faed40-e1aa-44be-bae7-49459da3dc79-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-79dcd846c5-5r7xg\" (UID: \"05faed40-e1aa-44be-bae7-49459da3dc79\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-5r7xg" Mar 16 17:17:23 crc kubenswrapper[5120]: I0316 17:17:23.166724 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7gs94\" (UniqueName: \"kubernetes.io/projected/05faed40-e1aa-44be-bae7-49459da3dc79-kube-api-access-7gs94\") pod \"dnsmasq-dnsmasq-79dcd846c5-5r7xg\" (UID: \"05faed40-e1aa-44be-bae7-49459da3dc79\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-5r7xg" Mar 16 17:17:23 crc kubenswrapper[5120]: I0316 17:17:23.167363 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/05faed40-e1aa-44be-bae7-49459da3dc79-config\") pod \"dnsmasq-dnsmasq-79dcd846c5-5r7xg\" (UID: \"05faed40-e1aa-44be-bae7-49459da3dc79\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-5r7xg" Mar 16 17:17:23 crc kubenswrapper[5120]: I0316 17:17:23.168059 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/05faed40-e1aa-44be-bae7-49459da3dc79-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-79dcd846c5-5r7xg\" (UID: \"05faed40-e1aa-44be-bae7-49459da3dc79\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-5r7xg" Mar 16 17:17:23 crc kubenswrapper[5120]: I0316 17:17:23.183845 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-jsgxw"] Mar 16 17:17:23 crc kubenswrapper[5120]: I0316 17:17:23.213794 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-2379-account-create-update-wkb97"] Mar 16 17:17:23 crc kubenswrapper[5120]: I0316 17:17:23.218331 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gs94\" (UniqueName: \"kubernetes.io/projected/05faed40-e1aa-44be-bae7-49459da3dc79-kube-api-access-7gs94\") pod \"dnsmasq-dnsmasq-79dcd846c5-5r7xg\" (UID: \"05faed40-e1aa-44be-bae7-49459da3dc79\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-5r7xg" Mar 16 17:17:23 crc kubenswrapper[5120]: I0316 17:17:23.221862 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 17:17:23 crc kubenswrapper[5120]: I0316 17:17:23.222111 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="62f72752-1070-4856-aec8-5d8c07039d97" containerName="glance-log" containerID="cri-o://0e110ef2792718360be3ee1663482cb6f5cc62b4790878591732d8863f4f7e26" gracePeriod=30 Mar 16 17:17:23 crc kubenswrapper[5120]: I0316 17:17:23.222691 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="62f72752-1070-4856-aec8-5d8c07039d97" containerName="glance-httpd" containerID="cri-o://06604bb2c03297dccc451cd8484387f58b33faae3ce7c0addf37f2c72a32bbd0" gracePeriod=30 Mar 16 17:17:23 crc kubenswrapper[5120]: I0316 17:17:23.240199 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-db-create-492cm"] Mar 16 17:17:23 crc kubenswrapper[5120]: I0316 17:17:23.261737 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-db-create-492cm"] Mar 16 17:17:23 crc kubenswrapper[5120]: I0316 17:17:23.273280 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 17:17:23 crc kubenswrapper[5120]: I0316 17:17:23.285276 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 17:17:23 crc kubenswrapper[5120]: I0316 17:17:23.285516 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="cb2bdc0a-77bc-488e-b188-7b24ac191d5a" containerName="glance-log" containerID="cri-o://2ca16c8a2100af38c2f2f32b05d02ec4bd230df464049dbad13abfbaf9e81bfd" gracePeriod=30 Mar 16 17:17:23 crc kubenswrapper[5120]: I0316 17:17:23.285665 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="cb2bdc0a-77bc-488e-b188-7b24ac191d5a" containerName="glance-httpd" containerID="cri-o://929557ee53c06ee6a62396db9c05cee3c027bea6a01f146959a43bff603e7e02" gracePeriod=30 Mar 16 17:17:23 crc kubenswrapper[5120]: I0316 17:17:23.293471 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="62f72752-1070-4856-aec8-5d8c07039d97" containerName="glance-log" probeResult="failure" output="Get \"https://10.217.0.190:9292/healthcheck\": EOF" Mar 16 17:17:23 crc kubenswrapper[5120]: I0316 17:17:23.304835 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-db-create-gj7s7"] Mar 16 17:17:23 crc kubenswrapper[5120]: I0316 17:17:23.325501 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-db-create-gj7s7"] Mar 16 17:17:23 crc kubenswrapper[5120]: I0316 17:17:23.325550 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-db-create-mgndp"] Mar 16 17:17:23 crc kubenswrapper[5120]: I0316 17:17:23.334813 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-db-create-mgndp"] Mar 16 17:17:23 crc kubenswrapper[5120]: I0316 17:17:23.368390 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_5ba234a2-95db-4cf8-a7de-7ddc034f58b7/ovsdbserver-sb/0.log" Mar 16 17:17:23 crc kubenswrapper[5120]: I0316 17:17:23.368432 5120 generic.go:358] "Generic (PLEG): container finished" podID="5ba234a2-95db-4cf8-a7de-7ddc034f58b7" containerID="6ca166115dd4eb9c50d15ae1ac4e26c4b343c58645a0e8a031bb2139d052a30a" exitCode=143 Mar 16 17:17:23 crc kubenswrapper[5120]: I0316 17:17:23.368531 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"5ba234a2-95db-4cf8-a7de-7ddc034f58b7","Type":"ContainerDied","Data":"6ca166115dd4eb9c50d15ae1ac4e26c4b343c58645a0e8a031bb2139d052a30a"} Mar 16 17:17:23 crc kubenswrapper[5120]: I0316 17:17:23.371051 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-8685-account-create-update-xhm9x"] Mar 16 17:17:23 crc kubenswrapper[5120]: I0316 17:17:23.382879 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_75c97708-5716-4b9d-af7a-d442efb1c830/ovsdbserver-nb/0.log" Mar 16 17:17:23 crc kubenswrapper[5120]: I0316 17:17:23.382946 5120 generic.go:358] "Generic (PLEG): container finished" podID="75c97708-5716-4b9d-af7a-d442efb1c830" containerID="2b1f4a51e957de0117e8df83a8b490bb03c81acb532eec020956c1ef08405199" exitCode=143 Mar 16 17:17:23 crc kubenswrapper[5120]: I0316 17:17:23.383138 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"75c97708-5716-4b9d-af7a-d442efb1c830","Type":"ContainerDied","Data":"2b1f4a51e957de0117e8df83a8b490bb03c81acb532eec020956c1ef08405199"} Mar 16 17:17:23 crc kubenswrapper[5120]: I0316 17:17:23.412869 5120 generic.go:358] "Generic (PLEG): container finished" podID="35eb763c-5d62-4401-a5b6-da3c538709ab" containerID="8761461c33c67611245395eb53b183f8ce91a3a0f2ea958ac3ad5d1fcb3bc8b7" exitCode=0 Mar 16 17:17:23 crc kubenswrapper[5120]: I0316 17:17:23.413148 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-54b8764f4-w5thh" event={"ID":"35eb763c-5d62-4401-a5b6-da3c538709ab","Type":"ContainerDied","Data":"8761461c33c67611245395eb53b183f8ce91a3a0f2ea958ac3ad5d1fcb3bc8b7"} Mar 16 17:17:23 crc kubenswrapper[5120]: I0316 17:17:23.422313 5120 generic.go:358] "Generic (PLEG): container finished" podID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerID="2ca61165dca6fdb30458423ef74c44c42b1b273e8fa504e89f5f9e186e516cc3" exitCode=0 Mar 16 17:17:23 crc kubenswrapper[5120]: I0316 17:17:23.422575 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" event={"ID":"e2275cb4-4905-4d66-a87e-8010120db2bd","Type":"ContainerDied","Data":"2ca61165dca6fdb30458423ef74c44c42b1b273e8fa504e89f5f9e186e516cc3"} Mar 16 17:17:23 crc kubenswrapper[5120]: I0316 17:17:23.422619 5120 scope.go:117] "RemoveContainer" containerID="75af251dd73a707ee66fa6a54cb0e7f3eed778d6679b855c53a50383854df1bd" Mar 16 17:17:23 crc kubenswrapper[5120]: I0316 17:17:23.423272 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-db-create-c7jh9"] Mar 16 17:17:23 crc kubenswrapper[5120]: I0316 17:17:23.423649 5120 scope.go:117] "RemoveContainer" containerID="2ca61165dca6fdb30458423ef74c44c42b1b273e8fa504e89f5f9e186e516cc3" Mar 16 17:17:23 crc kubenswrapper[5120]: E0316 17:17:23.424358 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 17:17:23 crc kubenswrapper[5120]: I0316 17:17:23.434379 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" podUID="d6906541-8dff-40ed-a064-5777f4b66f24" containerName="rabbitmq" containerID="cri-o://318e43b1f673c7e18a9bf01910a8401b4e64194498bf8833ebd04325d7873d96" gracePeriod=604800 Mar 16 17:17:23 crc kubenswrapper[5120]: I0316 17:17:23.446961 5120 generic.go:358] "Generic (PLEG): container finished" podID="d14c3978-d254-4ec4-baa0-f011eaef745e" containerID="1e11ae8d54987876ff5eee468abe7e70824cb0497d72bcb53bdc81aed418c318" exitCode=143 Mar 16 17:17:23 crc kubenswrapper[5120]: I0316 17:17:23.447035 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"d14c3978-d254-4ec4-baa0-f011eaef745e","Type":"ContainerDied","Data":"1e11ae8d54987876ff5eee468abe7e70824cb0497d72bcb53bdc81aed418c318"} Mar 16 17:17:23 crc kubenswrapper[5120]: I0316 17:17:23.449434 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-db-create-c7jh9"] Mar 16 17:17:23 crc kubenswrapper[5120]: I0316 17:17:23.462323 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-1cd2-account-create-update-xklg9"] Mar 16 17:17:23 crc kubenswrapper[5120]: I0316 17:17:23.509250 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 17:17:23 crc kubenswrapper[5120]: I0316 17:17:23.510043 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="ef7c6f1d-0e78-43bf-99c4-9200f5e67136" containerName="nova-api-log" containerID="cri-o://a1aa89d0956d7cc1f2770a8dab38997b4d225b5aa9872ace287bcdf25277bee6" gracePeriod=30 Mar 16 17:17:23 crc kubenswrapper[5120]: I0316 17:17:23.510657 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="ef7c6f1d-0e78-43bf-99c4-9200f5e67136" containerName="nova-api-api" containerID="cri-o://1d86c8a64a5053fae6269345960dc10f867eed9fabe6851c22755daab8918cf7" gracePeriod=30 Mar 16 17:17:23 crc kubenswrapper[5120]: I0316 17:17:23.525800 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-5r7xg" Mar 16 17:17:23 crc kubenswrapper[5120]: I0316 17:17:23.525995 5120 generic.go:358] "Generic (PLEG): container finished" podID="161d5626-9918-4847-96fd-f93d894bc230" containerID="232557928a11f779afc7e7739d08c9c5eae278bdb6cad4018a9b79f28340ae03" exitCode=2 Mar 16 17:17:23 crc kubenswrapper[5120]: I0316 17:17:23.526152 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"161d5626-9918-4847-96fd-f93d894bc230","Type":"ContainerDied","Data":"232557928a11f779afc7e7739d08c9c5eae278bdb6cad4018a9b79f28340ae03"} Mar 16 17:17:23 crc kubenswrapper[5120]: I0316 17:17:23.534851 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-db-create-ghtjt"] Mar 16 17:17:23 crc kubenswrapper[5120]: I0316 17:17:23.548057 5120 generic.go:358] "Generic (PLEG): container finished" podID="1976af1c-93c9-487c-9852-752bb5c1234d" containerID="4e6c0f66786b5e3b4a73599395a4b0251b018a5b233eaa26d6632468ef6db93c" exitCode=143 Mar 16 17:17:23 crc kubenswrapper[5120]: I0316 17:17:23.548206 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-5b79cc5b54-db2hd" event={"ID":"1976af1c-93c9-487c-9852-752bb5c1234d","Type":"ContainerDied","Data":"4e6c0f66786b5e3b4a73599395a4b0251b018a5b233eaa26d6632468ef6db93c"} Mar 16 17:17:23 crc kubenswrapper[5120]: I0316 17:17:23.564112 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-db-create-ghtjt"] Mar 16 17:17:23 crc kubenswrapper[5120]: I0316 17:17:23.578902 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-djqq9"] Mar 16 17:17:23 crc kubenswrapper[5120]: I0316 17:17:23.614003 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-djqq9"] Mar 16 17:17:23 crc kubenswrapper[5120]: I0316 17:17:23.631499 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 17:17:23 crc kubenswrapper[5120]: I0316 17:17:23.631651 5120 generic.go:358] "Generic (PLEG): container finished" podID="453261b9-e47c-4e0b-b37d-4803c7ea4eab" containerID="3df7a51b81f9adfb6f8812a838726626d4151033510e8139103925ba0a6c9636" exitCode=0 Mar 16 17:17:23 crc kubenswrapper[5120]: I0316 17:17:23.631673 5120 generic.go:358] "Generic (PLEG): container finished" podID="453261b9-e47c-4e0b-b37d-4803c7ea4eab" containerID="22b3d482c1dbe9466b48add66f35c279c3a30492318c0515c5d724ca2e13919a" exitCode=0 Mar 16 17:17:23 crc kubenswrapper[5120]: I0316 17:17:23.631679 5120 generic.go:358] "Generic (PLEG): container finished" podID="453261b9-e47c-4e0b-b37d-4803c7ea4eab" containerID="29984c871f3af037965519d7341a4a9f76503ecacedf63c951528b0c3f7621e3" exitCode=0 Mar 16 17:17:23 crc kubenswrapper[5120]: I0316 17:17:23.631686 5120 generic.go:358] "Generic (PLEG): container finished" podID="453261b9-e47c-4e0b-b37d-4803c7ea4eab" containerID="3fdb66fbf7a3609693d5bb010ec8b7a9f831e0bc3f2074a737c8ffb1b1a0a870" exitCode=0 Mar 16 17:17:23 crc kubenswrapper[5120]: I0316 17:17:23.631692 5120 generic.go:358] "Generic (PLEG): container finished" podID="453261b9-e47c-4e0b-b37d-4803c7ea4eab" containerID="d5fd97d3f54b33d918d40a1a213325ea152cca47586abb186341b0193714ad03" exitCode=0 Mar 16 17:17:23 crc kubenswrapper[5120]: I0316 17:17:23.631698 5120 generic.go:358] "Generic (PLEG): container finished" podID="453261b9-e47c-4e0b-b37d-4803c7ea4eab" containerID="847cfa54fe526dabece95c278159d3228a748d5a41f03c0874e7e56a380b6047" exitCode=0 Mar 16 17:17:23 crc kubenswrapper[5120]: I0316 17:17:23.631703 5120 generic.go:358] "Generic (PLEG): container finished" podID="453261b9-e47c-4e0b-b37d-4803c7ea4eab" containerID="12e294147acf3be6360a4168f01b6847c3952f8b1f777061c712b9dcddb549e9" exitCode=0 Mar 16 17:17:23 crc kubenswrapper[5120]: I0316 17:17:23.631709 5120 generic.go:358] "Generic (PLEG): container finished" podID="453261b9-e47c-4e0b-b37d-4803c7ea4eab" containerID="f2a05b9a55ce5e5912e0e5ca27fa34a32cd099c2e9473cdafa26eef99b1aade8" exitCode=0 Mar 16 17:17:23 crc kubenswrapper[5120]: I0316 17:17:23.631714 5120 generic.go:358] "Generic (PLEG): container finished" podID="453261b9-e47c-4e0b-b37d-4803c7ea4eab" containerID="2a68f298ec63891421aa48c2086b5969e7ccffebf4a9b32a37f55e9ca39b4362" exitCode=0 Mar 16 17:17:23 crc kubenswrapper[5120]: I0316 17:17:23.631719 5120 generic.go:358] "Generic (PLEG): container finished" podID="453261b9-e47c-4e0b-b37d-4803c7ea4eab" containerID="f450ab68730ad34b2967fa5253614c5b25a40a841fe623c369a1631922d89171" exitCode=0 Mar 16 17:17:23 crc kubenswrapper[5120]: I0316 17:17:23.631837 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="a9215705-d766-4151-b079-62d304603586" containerName="nova-metadata-log" containerID="cri-o://8f0a5cfda44fa0469d5667988c40b5fa21d4bc25c03c32374a9002107e112cf6" gracePeriod=30 Mar 16 17:17:23 crc kubenswrapper[5120]: I0316 17:17:23.633714 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="a9215705-d766-4151-b079-62d304603586" containerName="nova-metadata-metadata" containerID="cri-o://e3755f35f9a681410c6077b20fb86fa8d207825ea9e789bf539fe7e07f0d9847" gracePeriod=30 Mar 16 17:17:23 crc kubenswrapper[5120]: I0316 17:17:23.633882 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"453261b9-e47c-4e0b-b37d-4803c7ea4eab","Type":"ContainerDied","Data":"3df7a51b81f9adfb6f8812a838726626d4151033510e8139103925ba0a6c9636"} Mar 16 17:17:23 crc kubenswrapper[5120]: I0316 17:17:23.633917 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"453261b9-e47c-4e0b-b37d-4803c7ea4eab","Type":"ContainerDied","Data":"22b3d482c1dbe9466b48add66f35c279c3a30492318c0515c5d724ca2e13919a"} Mar 16 17:17:23 crc kubenswrapper[5120]: I0316 17:17:23.633927 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"453261b9-e47c-4e0b-b37d-4803c7ea4eab","Type":"ContainerDied","Data":"29984c871f3af037965519d7341a4a9f76503ecacedf63c951528b0c3f7621e3"} Mar 16 17:17:23 crc kubenswrapper[5120]: I0316 17:17:23.633966 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"453261b9-e47c-4e0b-b37d-4803c7ea4eab","Type":"ContainerDied","Data":"3fdb66fbf7a3609693d5bb010ec8b7a9f831e0bc3f2074a737c8ffb1b1a0a870"} Mar 16 17:17:23 crc kubenswrapper[5120]: I0316 17:17:23.633979 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"453261b9-e47c-4e0b-b37d-4803c7ea4eab","Type":"ContainerDied","Data":"d5fd97d3f54b33d918d40a1a213325ea152cca47586abb186341b0193714ad03"} Mar 16 17:17:23 crc kubenswrapper[5120]: I0316 17:17:23.633989 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"453261b9-e47c-4e0b-b37d-4803c7ea4eab","Type":"ContainerDied","Data":"847cfa54fe526dabece95c278159d3228a748d5a41f03c0874e7e56a380b6047"} Mar 16 17:17:23 crc kubenswrapper[5120]: I0316 17:17:23.633998 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"453261b9-e47c-4e0b-b37d-4803c7ea4eab","Type":"ContainerDied","Data":"12e294147acf3be6360a4168f01b6847c3952f8b1f777061c712b9dcddb549e9"} Mar 16 17:17:23 crc kubenswrapper[5120]: I0316 17:17:23.634007 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"453261b9-e47c-4e0b-b37d-4803c7ea4eab","Type":"ContainerDied","Data":"f2a05b9a55ce5e5912e0e5ca27fa34a32cd099c2e9473cdafa26eef99b1aade8"} Mar 16 17:17:23 crc kubenswrapper[5120]: I0316 17:17:23.634042 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"453261b9-e47c-4e0b-b37d-4803c7ea4eab","Type":"ContainerDied","Data":"2a68f298ec63891421aa48c2086b5969e7ccffebf4a9b32a37f55e9ca39b4362"} Mar 16 17:17:23 crc kubenswrapper[5120]: I0316 17:17:23.634054 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"453261b9-e47c-4e0b-b37d-4803c7ea4eab","Type":"ContainerDied","Data":"f450ab68730ad34b2967fa5253614c5b25a40a841fe623c369a1631922d89171"} Mar 16 17:17:23 crc kubenswrapper[5120]: I0316 17:17:23.640345 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-4ea4-account-create-update-tp4sf"] Mar 16 17:17:23 crc kubenswrapper[5120]: I0316 17:17:23.663457 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-5c4bd8b884-fjd8f"] Mar 16 17:17:23 crc kubenswrapper[5120]: I0316 17:17:23.664044 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-5c4bd8b884-fjd8f" podUID="fcf5af95-be92-4701-9e16-491dbbea165d" containerName="barbican-keystone-listener-log" containerID="cri-o://66383c38399360c6ccf172717731d52c81d8ad01696fcdb9c511bd983f463335" gracePeriod=30 Mar 16 17:17:23 crc kubenswrapper[5120]: I0316 17:17:23.664195 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-5c4bd8b884-fjd8f" podUID="fcf5af95-be92-4701-9e16-491dbbea165d" containerName="barbican-keystone-listener" containerID="cri-o://8c1773e53f9dc1cdc250238927d3be0667d25036b8ce26c49878ed36ef7c810b" gracePeriod=30 Mar 16 17:17:23 crc kubenswrapper[5120]: I0316 17:17:23.672289 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 17:17:23 crc kubenswrapper[5120]: I0316 17:17:23.685184 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-xnzdl"] Mar 16 17:17:23 crc kubenswrapper[5120]: I0316 17:17:23.694577 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-xnzdl"] Mar 16 17:17:23 crc kubenswrapper[5120]: I0316 17:17:23.705549 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-g7qpg"] Mar 16 17:17:23 crc kubenswrapper[5120]: I0316 17:17:23.717634 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-g7qpg"] Mar 16 17:17:23 crc kubenswrapper[5120]: I0316 17:17:23.725807 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-5d6b4bc659-md7vt"] Mar 16 17:17:23 crc kubenswrapper[5120]: I0316 17:17:23.726093 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-5d6b4bc659-md7vt" podUID="3ce6e6cf-688e-4f59-8ca2-f3c79e2a1857" containerName="barbican-worker-log" containerID="cri-o://880d0ca08b00931b006e4aa507711a2f5a37cf65567008eb271716928427a38d" gracePeriod=30 Mar 16 17:17:23 crc kubenswrapper[5120]: I0316 17:17:23.726246 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-5d6b4bc659-md7vt" podUID="3ce6e6cf-688e-4f59-8ca2-f3c79e2a1857" containerName="barbican-worker" containerID="cri-o://48ca29deeb5b87ce933a4ad925ce32bca80c4d92aaa4dcb028add038eef91294" gracePeriod=30 Mar 16 17:17:23 crc kubenswrapper[5120]: I0316 17:17:23.749119 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-5b49d5d76-5r44p"] Mar 16 17:17:23 crc kubenswrapper[5120]: I0316 17:17:23.749647 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-5b49d5d76-5r44p" podUID="c2e33bc1-ee7f-461d-9faa-b5678f7cb416" containerName="barbican-api-log" containerID="cri-o://5a608768c816e759b1547b4e7085b9239ee5a3b88e54a9ac9ed87d76d8f06f24" gracePeriod=30 Mar 16 17:17:23 crc kubenswrapper[5120]: I0316 17:17:23.750090 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-5b49d5d76-5r44p" podUID="c2e33bc1-ee7f-461d-9faa-b5678f7cb416" containerName="barbican-api" containerID="cri-o://94b5a95d3401ba6aca2c4eea6b8e4a63e4758571456a4be6ec2da46ee9dfd215" gracePeriod=30 Mar 16 17:17:23 crc kubenswrapper[5120]: I0316 17:17:23.779339 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 17:17:23 crc kubenswrapper[5120]: I0316 17:17:23.779651 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="71a73270-e23b-42a7-a1f4-ad174eab2ac7" containerName="nova-cell1-conductor-conductor" containerID="cri-o://bd045fa777b0ca425826b20941db498f3c9fc6247b98751b1ce64168b1b98e09" gracePeriod=30 Mar 16 17:17:23 crc kubenswrapper[5120]: I0316 17:17:23.795481 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-4mxdb"] Mar 16 17:17:23 crc kubenswrapper[5120]: I0316 17:17:23.807618 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-4mxdb"] Mar 16 17:17:23 crc kubenswrapper[5120]: I0316 17:17:23.817174 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 17:17:23 crc kubenswrapper[5120]: I0316 17:17:23.817391 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podUID="cb3173e3-1b17-4c3d-8e21-4630211b46ef" containerName="nova-cell1-novncproxy-novncproxy" containerID="cri-o://b7ab168e4ea48b09e0f18db61cc58ec37ef63c1289f8c33b63d1b101400816cf" gracePeriod=30 Mar 16 17:17:23 crc kubenswrapper[5120]: I0316 17:17:23.831885 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-dkgmb"] Mar 16 17:17:23 crc kubenswrapper[5120]: I0316 17:17:23.844834 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 17:17:23 crc kubenswrapper[5120]: I0316 17:17:23.845118 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="bb48cc0c-a6cd-4fc7-9599-1ed43e3eb216" containerName="nova-cell0-conductor-conductor" containerID="cri-o://908c72eb1629fa11a71f6778174b3a20818464a6614bf7943723c08961af3886" gracePeriod=30 Mar 16 17:17:23 crc kubenswrapper[5120]: I0316 17:17:23.855175 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-dkgmb"] Mar 16 17:17:23 crc kubenswrapper[5120]: I0316 17:17:23.893490 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 17:17:23 crc kubenswrapper[5120]: I0316 17:17:23.893804 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="a1dfcf19-aecf-49e7-9024-2e8b517fecfb" containerName="nova-scheduler-scheduler" containerID="cri-o://225427a7164236eebc876d896eb6bae3e01836e1b1bbff01894a12e5711cbebe" gracePeriod=30 Mar 16 17:17:23 crc kubenswrapper[5120]: I0316 17:17:23.974968 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 17:17:23 crc kubenswrapper[5120]: I0316 17:17:23.975278 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/kube-state-metrics-0" podUID="0e67d4b1-e52a-47e3-a212-d301d9160bc0" containerName="kube-state-metrics" containerID="cri-o://f0f7f3da22765c2510e787c90ba13d3a36d1f6e6b7e23c075df10a2d4e61a95b" gracePeriod=30 Mar 16 17:17:24 crc kubenswrapper[5120]: I0316 17:17:23.998963 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-2379-account-create-update-wkb97"] Mar 16 17:17:24 crc kubenswrapper[5120]: I0316 17:17:24.078692 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:17:24 crc kubenswrapper[5120]: I0316 17:17:24.079104 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62" containerName="ceilometer-central-agent" containerID="cri-o://e7a5ecad2365023f5d54577d059406a821a96c82ee276fd4ed93a27749e6fcc7" gracePeriod=30 Mar 16 17:17:24 crc kubenswrapper[5120]: I0316 17:17:24.079680 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62" containerName="proxy-httpd" containerID="cri-o://b0ce2e25aded94ccf86a0ddfe51c2ff4f864b1998250d60f71f24ade3a195c35" gracePeriod=30 Mar 16 17:17:24 crc kubenswrapper[5120]: I0316 17:17:24.079809 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62" containerName="sg-core" containerID="cri-o://907c314ee3239ecff601279e58a9e3aba6e65a29cf05a0d75fa660f2b00df61d" gracePeriod=30 Mar 16 17:17:24 crc kubenswrapper[5120]: I0316 17:17:24.079869 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62" containerName="ceilometer-notification-agent" containerID="cri-o://8e39abe514cf4d6f8c28475560f3e3a9681167a84d81cdfc9d44be0b89c1cec0" gracePeriod=30 Mar 16 17:17:24 crc kubenswrapper[5120]: I0316 17:17:24.093843 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podUID="cb3173e3-1b17-4c3d-8e21-4630211b46ef" containerName="nova-cell1-novncproxy-novncproxy" probeResult="failure" output="Get \"https://10.217.0.202:6080/vnc_lite.html\": dial tcp 10.217.0.202:6080: connect: connection refused" Mar 16 17:17:24 crc kubenswrapper[5120]: I0316 17:17:24.096906 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-xbcxw"] Mar 16 17:17:24 crc kubenswrapper[5120]: I0316 17:17:24.149676 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/openstack-cell1-galera-0" podUID="2dd828c2-16f2-4e69-b0b8-b953caf55f5b" containerName="galera" containerID="cri-o://7e2d9b8d74a0793fd3dc782decec5aecb43307447a1d0250a1484d0fd0e6e09d" gracePeriod=30 Mar 16 17:17:24 crc kubenswrapper[5120]: I0316 17:17:24.316755 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-1cd2-account-create-update-xklg9"] Mar 16 17:17:24 crc kubenswrapper[5120]: I0316 17:17:24.339190 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-8685-account-create-update-xhm9x"] Mar 16 17:17:24 crc kubenswrapper[5120]: I0316 17:17:24.342318 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_5ba234a2-95db-4cf8-a7de-7ddc034f58b7/ovsdbserver-sb/0.log" Mar 16 17:17:24 crc kubenswrapper[5120]: I0316 17:17:24.342391 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:17:24 crc kubenswrapper[5120]: I0316 17:17:24.462027 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovndbcluster-sb-etc-ovn\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"5ba234a2-95db-4cf8-a7de-7ddc034f58b7\" (UID: \"5ba234a2-95db-4cf8-a7de-7ddc034f58b7\") " Mar 16 17:17:24 crc kubenswrapper[5120]: I0316 17:17:24.462403 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/5ba234a2-95db-4cf8-a7de-7ddc034f58b7-ovsdb-rundir\") pod \"5ba234a2-95db-4cf8-a7de-7ddc034f58b7\" (UID: \"5ba234a2-95db-4cf8-a7de-7ddc034f58b7\") " Mar 16 17:17:24 crc kubenswrapper[5120]: I0316 17:17:24.462454 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5ba234a2-95db-4cf8-a7de-7ddc034f58b7-combined-ca-bundle\") pod \"5ba234a2-95db-4cf8-a7de-7ddc034f58b7\" (UID: \"5ba234a2-95db-4cf8-a7de-7ddc034f58b7\") " Mar 16 17:17:24 crc kubenswrapper[5120]: I0316 17:17:24.464839 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ba234a2-95db-4cf8-a7de-7ddc034f58b7-ovsdb-rundir" (OuterVolumeSpecName: "ovsdb-rundir") pod "5ba234a2-95db-4cf8-a7de-7ddc034f58b7" (UID: "5ba234a2-95db-4cf8-a7de-7ddc034f58b7"). InnerVolumeSpecName "ovsdb-rundir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:17:24 crc kubenswrapper[5120]: I0316 17:17:24.468694 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/5ba234a2-95db-4cf8-a7de-7ddc034f58b7-ovsdbserver-sb-tls-certs\") pod \"5ba234a2-95db-4cf8-a7de-7ddc034f58b7\" (UID: \"5ba234a2-95db-4cf8-a7de-7ddc034f58b7\") " Mar 16 17:17:24 crc kubenswrapper[5120]: I0316 17:17:24.469447 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5ba234a2-95db-4cf8-a7de-7ddc034f58b7-config\") pod \"5ba234a2-95db-4cf8-a7de-7ddc034f58b7\" (UID: \"5ba234a2-95db-4cf8-a7de-7ddc034f58b7\") " Mar 16 17:17:24 crc kubenswrapper[5120]: I0316 17:17:24.469537 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/5ba234a2-95db-4cf8-a7de-7ddc034f58b7-metrics-certs-tls-certs\") pod \"5ba234a2-95db-4cf8-a7de-7ddc034f58b7\" (UID: \"5ba234a2-95db-4cf8-a7de-7ddc034f58b7\") " Mar 16 17:17:24 crc kubenswrapper[5120]: I0316 17:17:24.470663 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ba234a2-95db-4cf8-a7de-7ddc034f58b7-config" (OuterVolumeSpecName: "config") pod "5ba234a2-95db-4cf8-a7de-7ddc034f58b7" (UID: "5ba234a2-95db-4cf8-a7de-7ddc034f58b7"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:17:24 crc kubenswrapper[5120]: I0316 17:17:24.472256 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z9ljz\" (UniqueName: \"kubernetes.io/projected/5ba234a2-95db-4cf8-a7de-7ddc034f58b7-kube-api-access-z9ljz\") pod \"5ba234a2-95db-4cf8-a7de-7ddc034f58b7\" (UID: \"5ba234a2-95db-4cf8-a7de-7ddc034f58b7\") " Mar 16 17:17:24 crc kubenswrapper[5120]: I0316 17:17:24.472300 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/5ba234a2-95db-4cf8-a7de-7ddc034f58b7-scripts\") pod \"5ba234a2-95db-4cf8-a7de-7ddc034f58b7\" (UID: \"5ba234a2-95db-4cf8-a7de-7ddc034f58b7\") " Mar 16 17:17:24 crc kubenswrapper[5120]: I0316 17:17:24.474996 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage02-crc" (OuterVolumeSpecName: "ovndbcluster-sb-etc-ovn") pod "5ba234a2-95db-4cf8-a7de-7ddc034f58b7" (UID: "5ba234a2-95db-4cf8-a7de-7ddc034f58b7"). InnerVolumeSpecName "local-storage02-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 17:17:24 crc kubenswrapper[5120]: I0316 17:17:24.480328 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ba234a2-95db-4cf8-a7de-7ddc034f58b7-kube-api-access-z9ljz" (OuterVolumeSpecName: "kube-api-access-z9ljz") pod "5ba234a2-95db-4cf8-a7de-7ddc034f58b7" (UID: "5ba234a2-95db-4cf8-a7de-7ddc034f58b7"). InnerVolumeSpecName "kube-api-access-z9ljz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:17:24 crc kubenswrapper[5120]: I0316 17:17:24.484630 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z9ljz\" (UniqueName: \"kubernetes.io/projected/5ba234a2-95db-4cf8-a7de-7ddc034f58b7-kube-api-access-z9ljz\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:24 crc kubenswrapper[5120]: I0316 17:17:24.484685 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") on node \"crc\" " Mar 16 17:17:24 crc kubenswrapper[5120]: I0316 17:17:24.484696 5120 reconciler_common.go:299] "Volume detached for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/5ba234a2-95db-4cf8-a7de-7ddc034f58b7-ovsdb-rundir\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:24 crc kubenswrapper[5120]: I0316 17:17:24.484707 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5ba234a2-95db-4cf8-a7de-7ddc034f58b7-config\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:24 crc kubenswrapper[5120]: I0316 17:17:24.486783 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ba234a2-95db-4cf8-a7de-7ddc034f58b7-scripts" (OuterVolumeSpecName: "scripts") pod "5ba234a2-95db-4cf8-a7de-7ddc034f58b7" (UID: "5ba234a2-95db-4cf8-a7de-7ddc034f58b7"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:17:24 crc kubenswrapper[5120]: E0316 17:17:24.571366 5120 kuberuntime_manager.go:1358] "Unhandled Error" err=< Mar 16 17:17:24 crc kubenswrapper[5120]: container &Container{Name:mariadb-account-create-update,Image:quay.io/podified-antelope-centos9/openstack-mariadb@sha256:4caef2b55e01b9a7ee88a22bc69db1893521a91d95c7ad4c8e593f14f17a5f95,Command:[/bin/sh -c #!/bin/bash Mar 16 17:17:24 crc kubenswrapper[5120]: Mar 16 17:17:24 crc kubenswrapper[5120]: MYSQL_REMOTE_HOST="" source /var/lib/operator-scripts/mysql_root_auth.sh Mar 16 17:17:24 crc kubenswrapper[5120]: Mar 16 17:17:24 crc kubenswrapper[5120]: export DatabasePassword=${DatabasePassword:?"Please specify a DatabasePassword variable."} Mar 16 17:17:24 crc kubenswrapper[5120]: Mar 16 17:17:24 crc kubenswrapper[5120]: MYSQL_CMD="mysql -h -u root -P 3306" Mar 16 17:17:24 crc kubenswrapper[5120]: Mar 16 17:17:24 crc kubenswrapper[5120]: if [ -n "placement" ]; then Mar 16 17:17:24 crc kubenswrapper[5120]: GRANT_DATABASE="placement" Mar 16 17:17:24 crc kubenswrapper[5120]: else Mar 16 17:17:24 crc kubenswrapper[5120]: GRANT_DATABASE="*" Mar 16 17:17:24 crc kubenswrapper[5120]: fi Mar 16 17:17:24 crc kubenswrapper[5120]: Mar 16 17:17:24 crc kubenswrapper[5120]: # going for maximum compatibility here: Mar 16 17:17:24 crc kubenswrapper[5120]: # 1. MySQL 8 no longer allows implicit create user when GRANT is used Mar 16 17:17:24 crc kubenswrapper[5120]: # 2. MariaDB has "CREATE OR REPLACE", but MySQL does not Mar 16 17:17:24 crc kubenswrapper[5120]: # 3. create user with CREATE but then do all password and TLS with ALTER to Mar 16 17:17:24 crc kubenswrapper[5120]: # support updates Mar 16 17:17:24 crc kubenswrapper[5120]: Mar 16 17:17:24 crc kubenswrapper[5120]: $MYSQL_CMD < logger="UnhandledError" Mar 16 17:17:24 crc kubenswrapper[5120]: E0316 17:17:24.572875 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"mariadb-account-create-update\" with CreateContainerConfigError: \"secret \\\"placement-db-secret\\\" not found\"" pod="openstack-kuttl-tests/placement-2379-account-create-update-wkb97" podUID="976307a4-0f5c-4e50-946f-682511e8e3bf" Mar 16 17:17:24 crc kubenswrapper[5120]: I0316 17:17:24.597609 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage02-crc" (UniqueName: "kubernetes.io/local-volume/local-storage02-crc") on node "crc" Mar 16 17:17:24 crc kubenswrapper[5120]: I0316 17:17:24.606251 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/5ba234a2-95db-4cf8-a7de-7ddc034f58b7-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:24 crc kubenswrapper[5120]: I0316 17:17:24.606287 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:24 crc kubenswrapper[5120]: E0316 17:17:24.619716 5120 kuberuntime_manager.go:1358] "Unhandled Error" err=< Mar 16 17:17:24 crc kubenswrapper[5120]: container &Container{Name:mariadb-account-create-update,Image:quay.io/podified-antelope-centos9/openstack-mariadb@sha256:4caef2b55e01b9a7ee88a22bc69db1893521a91d95c7ad4c8e593f14f17a5f95,Command:[/bin/sh -c #!/bin/bash Mar 16 17:17:24 crc kubenswrapper[5120]: Mar 16 17:17:24 crc kubenswrapper[5120]: MYSQL_REMOTE_HOST="" source /var/lib/operator-scripts/mysql_root_auth.sh Mar 16 17:17:24 crc kubenswrapper[5120]: Mar 16 17:17:24 crc kubenswrapper[5120]: export DatabasePassword=${DatabasePassword:?"Please specify a DatabasePassword variable."} Mar 16 17:17:24 crc kubenswrapper[5120]: Mar 16 17:17:24 crc kubenswrapper[5120]: MYSQL_CMD="mysql -h -u root -P 3306" Mar 16 17:17:24 crc kubenswrapper[5120]: Mar 16 17:17:24 crc kubenswrapper[5120]: if [ -n "neutron" ]; then Mar 16 17:17:24 crc kubenswrapper[5120]: GRANT_DATABASE="neutron" Mar 16 17:17:24 crc kubenswrapper[5120]: else Mar 16 17:17:24 crc kubenswrapper[5120]: GRANT_DATABASE="*" Mar 16 17:17:24 crc kubenswrapper[5120]: fi Mar 16 17:17:24 crc kubenswrapper[5120]: Mar 16 17:17:24 crc kubenswrapper[5120]: # going for maximum compatibility here: Mar 16 17:17:24 crc kubenswrapper[5120]: # 1. MySQL 8 no longer allows implicit create user when GRANT is used Mar 16 17:17:24 crc kubenswrapper[5120]: # 2. MariaDB has "CREATE OR REPLACE", but MySQL does not Mar 16 17:17:24 crc kubenswrapper[5120]: # 3. create user with CREATE but then do all password and TLS with ALTER to Mar 16 17:17:24 crc kubenswrapper[5120]: # support updates Mar 16 17:17:24 crc kubenswrapper[5120]: Mar 16 17:17:24 crc kubenswrapper[5120]: $MYSQL_CMD < logger="UnhandledError" Mar 16 17:17:24 crc kubenswrapper[5120]: I0316 17:17:24.621685 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-4ea4-account-create-update-tp4sf"] Mar 16 17:17:24 crc kubenswrapper[5120]: E0316 17:17:24.621778 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"mariadb-account-create-update\" with CreateContainerConfigError: \"secret \\\"neutron-db-secret\\\" not found\"" pod="openstack-kuttl-tests/neutron-8685-account-create-update-xhm9x" podUID="5ab53d7f-0e81-4c07-b2d3-24404dcbcc16" Mar 16 17:17:24 crc kubenswrapper[5120]: E0316 17:17:24.624315 5120 kuberuntime_manager.go:1358] "Unhandled Error" err=< Mar 16 17:17:24 crc kubenswrapper[5120]: container &Container{Name:mariadb-account-create-update,Image:quay.io/podified-antelope-centos9/openstack-mariadb@sha256:4caef2b55e01b9a7ee88a22bc69db1893521a91d95c7ad4c8e593f14f17a5f95,Command:[/bin/sh -c #!/bin/bash Mar 16 17:17:24 crc kubenswrapper[5120]: Mar 16 17:17:24 crc kubenswrapper[5120]: MYSQL_REMOTE_HOST="" source /var/lib/operator-scripts/mysql_root_auth.sh Mar 16 17:17:24 crc kubenswrapper[5120]: Mar 16 17:17:24 crc kubenswrapper[5120]: export DatabasePassword=${DatabasePassword:?"Please specify a DatabasePassword variable."} Mar 16 17:17:24 crc kubenswrapper[5120]: Mar 16 17:17:24 crc kubenswrapper[5120]: MYSQL_CMD="mysql -h -u root -P 3306" Mar 16 17:17:24 crc kubenswrapper[5120]: Mar 16 17:17:24 crc kubenswrapper[5120]: if [ -n "glance" ]; then Mar 16 17:17:24 crc kubenswrapper[5120]: GRANT_DATABASE="glance" Mar 16 17:17:24 crc kubenswrapper[5120]: else Mar 16 17:17:24 crc kubenswrapper[5120]: GRANT_DATABASE="*" Mar 16 17:17:24 crc kubenswrapper[5120]: fi Mar 16 17:17:24 crc kubenswrapper[5120]: Mar 16 17:17:24 crc kubenswrapper[5120]: # going for maximum compatibility here: Mar 16 17:17:24 crc kubenswrapper[5120]: # 1. MySQL 8 no longer allows implicit create user when GRANT is used Mar 16 17:17:24 crc kubenswrapper[5120]: # 2. MariaDB has "CREATE OR REPLACE", but MySQL does not Mar 16 17:17:24 crc kubenswrapper[5120]: # 3. create user with CREATE but then do all password and TLS with ALTER to Mar 16 17:17:24 crc kubenswrapper[5120]: # support updates Mar 16 17:17:24 crc kubenswrapper[5120]: Mar 16 17:17:24 crc kubenswrapper[5120]: $MYSQL_CMD < logger="UnhandledError" Mar 16 17:17:24 crc kubenswrapper[5120]: E0316 17:17:24.626835 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"mariadb-account-create-update\" with CreateContainerConfigError: \"secret \\\"glance-db-secret\\\" not found\"" pod="openstack-kuttl-tests/glance-1cd2-account-create-update-xklg9" podUID="8b695735-ad55-4ce9-ac75-42381bcaffbf" Mar 16 17:17:24 crc kubenswrapper[5120]: I0316 17:17:24.641535 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ba234a2-95db-4cf8-a7de-7ddc034f58b7-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "5ba234a2-95db-4cf8-a7de-7ddc034f58b7" (UID: "5ba234a2-95db-4cf8-a7de-7ddc034f58b7"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:17:24 crc kubenswrapper[5120]: I0316 17:17:24.716241 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5ba234a2-95db-4cf8-a7de-7ddc034f58b7-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:24 crc kubenswrapper[5120]: I0316 17:17:24.743909 5120 generic.go:358] "Generic (PLEG): container finished" podID="13336088-ad41-4ff2-afab-b0f1f8bb0e75" containerID="d48240109d0a3c34c694d1bce1876d5c9a3e15e50367c9d12627dc968eddbf49" exitCode=137 Mar 16 17:17:24 crc kubenswrapper[5120]: E0316 17:17:24.744403 5120 kuberuntime_manager.go:1358] "Unhandled Error" err=< Mar 16 17:17:24 crc kubenswrapper[5120]: container &Container{Name:mariadb-account-create-update,Image:quay.io/podified-antelope-centos9/openstack-mariadb@sha256:4caef2b55e01b9a7ee88a22bc69db1893521a91d95c7ad4c8e593f14f17a5f95,Command:[/bin/sh -c #!/bin/bash Mar 16 17:17:24 crc kubenswrapper[5120]: Mar 16 17:17:24 crc kubenswrapper[5120]: MYSQL_REMOTE_HOST="" source /var/lib/operator-scripts/mysql_root_auth.sh Mar 16 17:17:24 crc kubenswrapper[5120]: Mar 16 17:17:24 crc kubenswrapper[5120]: export DatabasePassword=${DatabasePassword:?"Please specify a DatabasePassword variable."} Mar 16 17:17:24 crc kubenswrapper[5120]: Mar 16 17:17:24 crc kubenswrapper[5120]: MYSQL_CMD="mysql -h -u root -P 3306" Mar 16 17:17:24 crc kubenswrapper[5120]: Mar 16 17:17:24 crc kubenswrapper[5120]: if [ -n "barbican" ]; then Mar 16 17:17:24 crc kubenswrapper[5120]: GRANT_DATABASE="barbican" Mar 16 17:17:24 crc kubenswrapper[5120]: else Mar 16 17:17:24 crc kubenswrapper[5120]: GRANT_DATABASE="*" Mar 16 17:17:24 crc kubenswrapper[5120]: fi Mar 16 17:17:24 crc kubenswrapper[5120]: Mar 16 17:17:24 crc kubenswrapper[5120]: # going for maximum compatibility here: Mar 16 17:17:24 crc kubenswrapper[5120]: # 1. MySQL 8 no longer allows implicit create user when GRANT is used Mar 16 17:17:24 crc kubenswrapper[5120]: # 2. MariaDB has "CREATE OR REPLACE", but MySQL does not Mar 16 17:17:24 crc kubenswrapper[5120]: # 3. create user with CREATE but then do all password and TLS with ALTER to Mar 16 17:17:24 crc kubenswrapper[5120]: # support updates Mar 16 17:17:24 crc kubenswrapper[5120]: Mar 16 17:17:24 crc kubenswrapper[5120]: $MYSQL_CMD < logger="UnhandledError" Mar 16 17:17:24 crc kubenswrapper[5120]: E0316 17:17:24.746316 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"mariadb-account-create-update\" with CreateContainerConfigError: \"secret \\\"barbican-db-secret\\\" not found\"" pod="openstack-kuttl-tests/barbican-4ea4-account-create-update-tp4sf" podUID="0a59e429-ba97-491f-91d4-9b1b063fc15b" Mar 16 17:17:24 crc kubenswrapper[5120]: I0316 17:17:24.755695 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="02abd7be-4fc2-4452-9ab1-ca63cc1881b8" path="/var/lib/kubelet/pods/02abd7be-4fc2-4452-9ab1-ca63cc1881b8/volumes" Mar 16 17:17:24 crc kubenswrapper[5120]: I0316 17:17:24.764212 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d98a227-166a-4c9f-b446-5f8655bdfa26" path="/var/lib/kubelet/pods/5d98a227-166a-4c9f-b446-5f8655bdfa26/volumes" Mar 16 17:17:24 crc kubenswrapper[5120]: I0316 17:17:24.765274 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="65750464-ddac-4787-86cc-48f32f31cd92" path="/var/lib/kubelet/pods/65750464-ddac-4787-86cc-48f32f31cd92/volumes" Mar 16 17:17:24 crc kubenswrapper[5120]: I0316 17:17:24.769355 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="665bd399-ccb7-4bf2-9191-2ce1b60e186f" path="/var/lib/kubelet/pods/665bd399-ccb7-4bf2-9191-2ce1b60e186f/volumes" Mar 16 17:17:24 crc kubenswrapper[5120]: I0316 17:17:24.773637 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8588f057-79ea-4d0e-b37b-ee267ab3edb6" path="/var/lib/kubelet/pods/8588f057-79ea-4d0e-b37b-ee267ab3edb6/volumes" Mar 16 17:17:24 crc kubenswrapper[5120]: I0316 17:17:24.775665 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="87effe7f-90d5-4885-aa36-77b807c0057e" path="/var/lib/kubelet/pods/87effe7f-90d5-4885-aa36-77b807c0057e/volumes" Mar 16 17:17:24 crc kubenswrapper[5120]: I0316 17:17:24.776378 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="98cc37e9-8b48-4455-9254-4d83ccdc12e9" path="/var/lib/kubelet/pods/98cc37e9-8b48-4455-9254-4d83ccdc12e9/volumes" Mar 16 17:17:24 crc kubenswrapper[5120]: I0316 17:17:24.777086 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="98fe2454-3f99-4022-ba43-170883affe3d" path="/var/lib/kubelet/pods/98fe2454-3f99-4022-ba43-170883affe3d/volumes" Mar 16 17:17:24 crc kubenswrapper[5120]: I0316 17:17:24.778388 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="999a6ca6-faad-41e9-8109-ac171d5061ef" path="/var/lib/kubelet/pods/999a6ca6-faad-41e9-8109-ac171d5061ef/volumes" Mar 16 17:17:24 crc kubenswrapper[5120]: I0316 17:17:24.780210 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c26dcfcc-eff1-4daf-ad94-a46b19f3ef19" path="/var/lib/kubelet/pods/c26dcfcc-eff1-4daf-ad94-a46b19f3ef19/volumes" Mar 16 17:17:24 crc kubenswrapper[5120]: I0316 17:17:24.780831 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e390938f-0d81-4a22-af72-9be8abab5a41" path="/var/lib/kubelet/pods/e390938f-0d81-4a22-af72-9be8abab5a41/volumes" Mar 16 17:17:24 crc kubenswrapper[5120]: I0316 17:17:24.784494 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ea5aaac8-9646-4c80-8b0a-bafb1a03bd20" path="/var/lib/kubelet/pods/ea5aaac8-9646-4c80-8b0a-bafb1a03bd20/volumes" Mar 16 17:17:24 crc kubenswrapper[5120]: I0316 17:17:24.787415 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec0fbee9-412d-4f41-bf44-1316a4ccd5ca" path="/var/lib/kubelet/pods/ec0fbee9-412d-4f41-bf44-1316a4ccd5ca/volumes" Mar 16 17:17:24 crc kubenswrapper[5120]: I0316 17:17:24.792380 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f0ed456c-3662-445f-b52b-d39cec513aa8" path="/var/lib/kubelet/pods/f0ed456c-3662-445f-b52b-d39cec513aa8/volumes" Mar 16 17:17:24 crc kubenswrapper[5120]: I0316 17:17:24.793054 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f3c221d1-880b-4ee9-aee6-b256334793c9" path="/var/lib/kubelet/pods/f3c221d1-880b-4ee9-aee6-b256334793c9/volumes" Mar 16 17:17:24 crc kubenswrapper[5120]: I0316 17:17:24.813124 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-proxy-5749bb5d-544mw"] Mar 16 17:17:24 crc kubenswrapper[5120]: I0316 17:17:24.813372 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-proxy-5749bb5d-544mw" podUID="682f1065-f1df-4d72-9a81-3ddb581743ca" containerName="proxy-httpd" containerID="cri-o://bf112b12ea9fcf672dfef9c231fc9ff0ad24272de8f0ee8e3b3d3f8056137682" gracePeriod=30 Mar 16 17:17:24 crc kubenswrapper[5120]: I0316 17:17:24.813872 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-proxy-5749bb5d-544mw" podUID="682f1065-f1df-4d72-9a81-3ddb581743ca" containerName="proxy-server" containerID="cri-o://fdf02cc413ba820b43576d699f107caa1ca5ce3be93360df557fd570bbf0baa7" gracePeriod=30 Mar 16 17:17:24 crc kubenswrapper[5120]: I0316 17:17:24.822167 5120 generic.go:358] "Generic (PLEG): container finished" podID="fcf5af95-be92-4701-9e16-491dbbea165d" containerID="66383c38399360c6ccf172717731d52c81d8ad01696fcdb9c511bd983f463335" exitCode=143 Mar 16 17:17:24 crc kubenswrapper[5120]: I0316 17:17:24.822373 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-5c4bd8b884-fjd8f" event={"ID":"fcf5af95-be92-4701-9e16-491dbbea165d","Type":"ContainerDied","Data":"66383c38399360c6ccf172717731d52c81d8ad01696fcdb9c511bd983f463335"} Mar 16 17:17:24 crc kubenswrapper[5120]: I0316 17:17:24.828627 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_75c97708-5716-4b9d-af7a-d442efb1c830/ovsdbserver-nb/0.log" Mar 16 17:17:24 crc kubenswrapper[5120]: I0316 17:17:24.828729 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:17:24 crc kubenswrapper[5120]: I0316 17:17:24.834935 5120 generic.go:358] "Generic (PLEG): container finished" podID="3ce6e6cf-688e-4f59-8ca2-f3c79e2a1857" containerID="880d0ca08b00931b006e4aa507711a2f5a37cf65567008eb271716928427a38d" exitCode=143 Mar 16 17:17:24 crc kubenswrapper[5120]: I0316 17:17:24.835062 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-5d6b4bc659-md7vt" event={"ID":"3ce6e6cf-688e-4f59-8ca2-f3c79e2a1857","Type":"ContainerDied","Data":"880d0ca08b00931b006e4aa507711a2f5a37cf65567008eb271716928427a38d"} Mar 16 17:17:24 crc kubenswrapper[5120]: I0316 17:17:24.843103 5120 generic.go:358] "Generic (PLEG): container finished" podID="62f72752-1070-4856-aec8-5d8c07039d97" containerID="0e110ef2792718360be3ee1663482cb6f5cc62b4790878591732d8863f4f7e26" exitCode=143 Mar 16 17:17:24 crc kubenswrapper[5120]: I0316 17:17:24.843190 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"62f72752-1070-4856-aec8-5d8c07039d97","Type":"ContainerDied","Data":"0e110ef2792718360be3ee1663482cb6f5cc62b4790878591732d8863f4f7e26"} Mar 16 17:17:24 crc kubenswrapper[5120]: I0316 17:17:24.846456 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_5ba234a2-95db-4cf8-a7de-7ddc034f58b7/ovsdbserver-sb/0.log" Mar 16 17:17:24 crc kubenswrapper[5120]: I0316 17:17:24.846677 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"5ba234a2-95db-4cf8-a7de-7ddc034f58b7","Type":"ContainerDied","Data":"243e4bbd2d5ec542c084e964319040db49730fc37d49376501f5b0ec41e43e4b"} Mar 16 17:17:24 crc kubenswrapper[5120]: I0316 17:17:24.846722 5120 scope.go:117] "RemoveContainer" containerID="40c8b7b52a9f3ac29bf620def0abc9ab43dd5e83ec58521a17628b610bddd54a" Mar 16 17:17:24 crc kubenswrapper[5120]: I0316 17:17:24.846734 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 17:17:24 crc kubenswrapper[5120]: I0316 17:17:24.872633 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_75c97708-5716-4b9d-af7a-d442efb1c830/ovsdbserver-nb/0.log" Mar 16 17:17:24 crc kubenswrapper[5120]: I0316 17:17:24.872834 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"75c97708-5716-4b9d-af7a-d442efb1c830","Type":"ContainerDied","Data":"275cf287bbfe8855420c90ffb10d954c233dc1e666d0fb74c0ee73ddb005ab42"} Mar 16 17:17:24 crc kubenswrapper[5120]: I0316 17:17:24.873200 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 17:17:24 crc kubenswrapper[5120]: I0316 17:17:24.876248 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Mar 16 17:17:24 crc kubenswrapper[5120]: I0316 17:17:24.876400 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-8685-account-create-update-xhm9x" event={"ID":"5ab53d7f-0e81-4c07-b2d3-24404dcbcc16","Type":"ContainerStarted","Data":"c3951fbdbfdede3fdb704c168ca5fdc108b0aeaeef36b5f1f1be1694c371873c"} Mar 16 17:17:24 crc kubenswrapper[5120]: I0316 17:17:24.906210 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ba234a2-95db-4cf8-a7de-7ddc034f58b7-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "5ba234a2-95db-4cf8-a7de-7ddc034f58b7" (UID: "5ba234a2-95db-4cf8-a7de-7ddc034f58b7"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:17:24 crc kubenswrapper[5120]: I0316 17:17:24.922955 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ba234a2-95db-4cf8-a7de-7ddc034f58b7-ovsdbserver-sb-tls-certs" (OuterVolumeSpecName: "ovsdbserver-sb-tls-certs") pod "5ba234a2-95db-4cf8-a7de-7ddc034f58b7" (UID: "5ba234a2-95db-4cf8-a7de-7ddc034f58b7"). InnerVolumeSpecName "ovsdbserver-sb-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:17:24 crc kubenswrapper[5120]: I0316 17:17:24.932450 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/75c97708-5716-4b9d-af7a-d442efb1c830-ovsdbserver-nb-tls-certs\") pod \"75c97708-5716-4b9d-af7a-d442efb1c830\" (UID: \"75c97708-5716-4b9d-af7a-d442efb1c830\") " Mar 16 17:17:24 crc kubenswrapper[5120]: I0316 17:17:24.932652 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/75c97708-5716-4b9d-af7a-d442efb1c830-metrics-certs-tls-certs\") pod \"75c97708-5716-4b9d-af7a-d442efb1c830\" (UID: \"75c97708-5716-4b9d-af7a-d442efb1c830\") " Mar 16 17:17:24 crc kubenswrapper[5120]: I0316 17:17:24.932726 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/75c97708-5716-4b9d-af7a-d442efb1c830-combined-ca-bundle\") pod \"75c97708-5716-4b9d-af7a-d442efb1c830\" (UID: \"75c97708-5716-4b9d-af7a-d442efb1c830\") " Mar 16 17:17:24 crc kubenswrapper[5120]: I0316 17:17:24.932821 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/75c97708-5716-4b9d-af7a-d442efb1c830-scripts\") pod \"75c97708-5716-4b9d-af7a-d442efb1c830\" (UID: \"75c97708-5716-4b9d-af7a-d442efb1c830\") " Mar 16 17:17:24 crc kubenswrapper[5120]: I0316 17:17:24.934172 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/75c97708-5716-4b9d-af7a-d442efb1c830-scripts" (OuterVolumeSpecName: "scripts") pod "75c97708-5716-4b9d-af7a-d442efb1c830" (UID: "75c97708-5716-4b9d-af7a-d442efb1c830"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:17:24 crc kubenswrapper[5120]: I0316 17:17:24.934325 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/13336088-ad41-4ff2-afab-b0f1f8bb0e75-openstack-config-secret\") pod \"13336088-ad41-4ff2-afab-b0f1f8bb0e75\" (UID: \"13336088-ad41-4ff2-afab-b0f1f8bb0e75\") " Mar 16 17:17:24 crc kubenswrapper[5120]: I0316 17:17:24.934412 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/75c97708-5716-4b9d-af7a-d442efb1c830-config\") pod \"75c97708-5716-4b9d-af7a-d442efb1c830\" (UID: \"75c97708-5716-4b9d-af7a-d442efb1c830\") " Mar 16 17:17:24 crc kubenswrapper[5120]: I0316 17:17:24.934573 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/13336088-ad41-4ff2-afab-b0f1f8bb0e75-openstack-config\") pod \"13336088-ad41-4ff2-afab-b0f1f8bb0e75\" (UID: \"13336088-ad41-4ff2-afab-b0f1f8bb0e75\") " Mar 16 17:17:24 crc kubenswrapper[5120]: I0316 17:17:24.934656 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nfk9q\" (UniqueName: \"kubernetes.io/projected/13336088-ad41-4ff2-afab-b0f1f8bb0e75-kube-api-access-nfk9q\") pod \"13336088-ad41-4ff2-afab-b0f1f8bb0e75\" (UID: \"13336088-ad41-4ff2-afab-b0f1f8bb0e75\") " Mar 16 17:17:24 crc kubenswrapper[5120]: I0316 17:17:24.934707 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m9gq5\" (UniqueName: \"kubernetes.io/projected/75c97708-5716-4b9d-af7a-d442efb1c830-kube-api-access-m9gq5\") pod \"75c97708-5716-4b9d-af7a-d442efb1c830\" (UID: \"75c97708-5716-4b9d-af7a-d442efb1c830\") " Mar 16 17:17:24 crc kubenswrapper[5120]: I0316 17:17:24.934789 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/13336088-ad41-4ff2-afab-b0f1f8bb0e75-combined-ca-bundle\") pod \"13336088-ad41-4ff2-afab-b0f1f8bb0e75\" (UID: \"13336088-ad41-4ff2-afab-b0f1f8bb0e75\") " Mar 16 17:17:24 crc kubenswrapper[5120]: I0316 17:17:24.934853 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovndbcluster-nb-etc-ovn\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"75c97708-5716-4b9d-af7a-d442efb1c830\" (UID: \"75c97708-5716-4b9d-af7a-d442efb1c830\") " Mar 16 17:17:24 crc kubenswrapper[5120]: I0316 17:17:24.935062 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/75c97708-5716-4b9d-af7a-d442efb1c830-ovsdb-rundir\") pod \"75c97708-5716-4b9d-af7a-d442efb1c830\" (UID: \"75c97708-5716-4b9d-af7a-d442efb1c830\") " Mar 16 17:17:24 crc kubenswrapper[5120]: I0316 17:17:24.938752 5120 reconciler_common.go:299] "Volume detached for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/5ba234a2-95db-4cf8-a7de-7ddc034f58b7-ovsdbserver-sb-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:24 crc kubenswrapper[5120]: I0316 17:17:24.938786 5120 reconciler_common.go:299] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/5ba234a2-95db-4cf8-a7de-7ddc034f58b7-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:24 crc kubenswrapper[5120]: I0316 17:17:24.938797 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/75c97708-5716-4b9d-af7a-d442efb1c830-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:24 crc kubenswrapper[5120]: I0316 17:17:24.944423 5120 generic.go:358] "Generic (PLEG): container finished" podID="ef7c6f1d-0e78-43bf-99c4-9200f5e67136" containerID="a1aa89d0956d7cc1f2770a8dab38997b4d225b5aa9872ace287bcdf25277bee6" exitCode=143 Mar 16 17:17:24 crc kubenswrapper[5120]: I0316 17:17:24.944895 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"ef7c6f1d-0e78-43bf-99c4-9200f5e67136","Type":"ContainerDied","Data":"a1aa89d0956d7cc1f2770a8dab38997b4d225b5aa9872ace287bcdf25277bee6"} Mar 16 17:17:24 crc kubenswrapper[5120]: I0316 17:17:24.946685 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75c97708-5716-4b9d-af7a-d442efb1c830-ovsdb-rundir" (OuterVolumeSpecName: "ovsdb-rundir") pod "75c97708-5716-4b9d-af7a-d442efb1c830" (UID: "75c97708-5716-4b9d-af7a-d442efb1c830"). InnerVolumeSpecName "ovsdb-rundir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:17:24 crc kubenswrapper[5120]: I0316 17:17:24.947575 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/75c97708-5716-4b9d-af7a-d442efb1c830-config" (OuterVolumeSpecName: "config") pod "75c97708-5716-4b9d-af7a-d442efb1c830" (UID: "75c97708-5716-4b9d-af7a-d442efb1c830"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:17:24 crc kubenswrapper[5120]: I0316 17:17:24.954634 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75c97708-5716-4b9d-af7a-d442efb1c830-kube-api-access-m9gq5" (OuterVolumeSpecName: "kube-api-access-m9gq5") pod "75c97708-5716-4b9d-af7a-d442efb1c830" (UID: "75c97708-5716-4b9d-af7a-d442efb1c830"). InnerVolumeSpecName "kube-api-access-m9gq5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:17:24 crc kubenswrapper[5120]: I0316 17:17:24.959223 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13336088-ad41-4ff2-afab-b0f1f8bb0e75-kube-api-access-nfk9q" (OuterVolumeSpecName: "kube-api-access-nfk9q") pod "13336088-ad41-4ff2-afab-b0f1f8bb0e75" (UID: "13336088-ad41-4ff2-afab-b0f1f8bb0e75"). InnerVolumeSpecName "kube-api-access-nfk9q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:17:24 crc kubenswrapper[5120]: I0316 17:17:24.960055 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-2379-account-create-update-wkb97" event={"ID":"976307a4-0f5c-4e50-946f-682511e8e3bf","Type":"ContainerStarted","Data":"3ea76afc443e59cc5af2728791d2d074af243574d8ae1097d1f053ee9add1293"} Mar 16 17:17:24 crc kubenswrapper[5120]: I0316 17:17:24.962193 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage16-crc" (OuterVolumeSpecName: "ovndbcluster-nb-etc-ovn") pod "75c97708-5716-4b9d-af7a-d442efb1c830" (UID: "75c97708-5716-4b9d-af7a-d442efb1c830"). InnerVolumeSpecName "local-storage16-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 17:17:24 crc kubenswrapper[5120]: I0316 17:17:24.994236 5120 generic.go:358] "Generic (PLEG): container finished" podID="18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62" containerID="b0ce2e25aded94ccf86a0ddfe51c2ff4f864b1998250d60f71f24ade3a195c35" exitCode=0 Mar 16 17:17:24 crc kubenswrapper[5120]: I0316 17:17:24.994267 5120 generic.go:358] "Generic (PLEG): container finished" podID="18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62" containerID="907c314ee3239ecff601279e58a9e3aba6e65a29cf05a0d75fa660f2b00df61d" exitCode=2 Mar 16 17:17:24 crc kubenswrapper[5120]: I0316 17:17:24.994359 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62","Type":"ContainerDied","Data":"b0ce2e25aded94ccf86a0ddfe51c2ff4f864b1998250d60f71f24ade3a195c35"} Mar 16 17:17:24 crc kubenswrapper[5120]: I0316 17:17:24.994385 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62","Type":"ContainerDied","Data":"907c314ee3239ecff601279e58a9e3aba6e65a29cf05a0d75fa660f2b00df61d"} Mar 16 17:17:25 crc kubenswrapper[5120]: I0316 17:17:25.001827 5120 generic.go:358] "Generic (PLEG): container finished" podID="57e08e60-42d1-4b58-9892-c2aa5bbae2cf" containerID="e45a713f90daea3dfb25bc19fbe35a5087a998babd98c6f27853be3e15ff43a6" exitCode=0 Mar 16 17:17:25 crc kubenswrapper[5120]: I0316 17:17:25.001970 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"57e08e60-42d1-4b58-9892-c2aa5bbae2cf","Type":"ContainerDied","Data":"e45a713f90daea3dfb25bc19fbe35a5087a998babd98c6f27853be3e15ff43a6"} Mar 16 17:17:25 crc kubenswrapper[5120]: I0316 17:17:25.006901 5120 scope.go:117] "RemoveContainer" containerID="6ca166115dd4eb9c50d15ae1ac4e26c4b343c58645a0e8a031bb2139d052a30a" Mar 16 17:17:25 crc kubenswrapper[5120]: I0316 17:17:25.009107 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-1cd2-account-create-update-xklg9" event={"ID":"8b695735-ad55-4ce9-ac75-42381bcaffbf","Type":"ContainerStarted","Data":"28cfcdbf213b5c4b830d0ab5e7ae4150ca6c3707ea218cb56f5a51060cb668af"} Mar 16 17:17:25 crc kubenswrapper[5120]: I0316 17:17:25.010020 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75c97708-5716-4b9d-af7a-d442efb1c830-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "75c97708-5716-4b9d-af7a-d442efb1c830" (UID: "75c97708-5716-4b9d-af7a-d442efb1c830"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:17:25 crc kubenswrapper[5120]: I0316 17:17:25.045193 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/75c97708-5716-4b9d-af7a-d442efb1c830-config\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:25 crc kubenswrapper[5120]: I0316 17:17:25.045251 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nfk9q\" (UniqueName: \"kubernetes.io/projected/13336088-ad41-4ff2-afab-b0f1f8bb0e75-kube-api-access-nfk9q\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:25 crc kubenswrapper[5120]: I0316 17:17:25.045265 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m9gq5\" (UniqueName: \"kubernetes.io/projected/75c97708-5716-4b9d-af7a-d442efb1c830-kube-api-access-m9gq5\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:25 crc kubenswrapper[5120]: I0316 17:17:25.045302 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") on node \"crc\" " Mar 16 17:17:25 crc kubenswrapper[5120]: I0316 17:17:25.045316 5120 reconciler_common.go:299] "Volume detached for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/75c97708-5716-4b9d-af7a-d442efb1c830-ovsdb-rundir\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:25 crc kubenswrapper[5120]: I0316 17:17:25.045361 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/75c97708-5716-4b9d-af7a-d442efb1c830-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:25 crc kubenswrapper[5120]: I0316 17:17:25.048169 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/13336088-ad41-4ff2-afab-b0f1f8bb0e75-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "13336088-ad41-4ff2-afab-b0f1f8bb0e75" (UID: "13336088-ad41-4ff2-afab-b0f1f8bb0e75"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:17:25 crc kubenswrapper[5120]: I0316 17:17:25.050302 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 17:17:25 crc kubenswrapper[5120]: I0316 17:17:25.063228 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/13336088-ad41-4ff2-afab-b0f1f8bb0e75-openstack-config" (OuterVolumeSpecName: "openstack-config") pod "13336088-ad41-4ff2-afab-b0f1f8bb0e75" (UID: "13336088-ad41-4ff2-afab-b0f1f8bb0e75"). InnerVolumeSpecName "openstack-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:17:25 crc kubenswrapper[5120]: I0316 17:17:25.078144 5120 generic.go:358] "Generic (PLEG): container finished" podID="453261b9-e47c-4e0b-b37d-4803c7ea4eab" containerID="a1b10d99c0cdaf702b9aeb081186b9737661b9e1ad04908bd766605b4e038b52" exitCode=0 Mar 16 17:17:25 crc kubenswrapper[5120]: I0316 17:17:25.078177 5120 generic.go:358] "Generic (PLEG): container finished" podID="453261b9-e47c-4e0b-b37d-4803c7ea4eab" containerID="aebd95ed2c80cf68f4a11d63e8a9c7417a4d2c89e19691fded4789fac5ae5ced" exitCode=0 Mar 16 17:17:25 crc kubenswrapper[5120]: I0316 17:17:25.078184 5120 generic.go:358] "Generic (PLEG): container finished" podID="453261b9-e47c-4e0b-b37d-4803c7ea4eab" containerID="7609d755e551179d21b21ae75424817749513f60f07273b47f02ee1165742636" exitCode=0 Mar 16 17:17:25 crc kubenswrapper[5120]: I0316 17:17:25.078190 5120 generic.go:358] "Generic (PLEG): container finished" podID="453261b9-e47c-4e0b-b37d-4803c7ea4eab" containerID="bfd438fe482625b6acaa98a3f3b1df39124d070d7c82b30f3b95847f5e4307eb" exitCode=0 Mar 16 17:17:25 crc kubenswrapper[5120]: I0316 17:17:25.078238 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"453261b9-e47c-4e0b-b37d-4803c7ea4eab","Type":"ContainerDied","Data":"a1b10d99c0cdaf702b9aeb081186b9737661b9e1ad04908bd766605b4e038b52"} Mar 16 17:17:25 crc kubenswrapper[5120]: I0316 17:17:25.078263 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"453261b9-e47c-4e0b-b37d-4803c7ea4eab","Type":"ContainerDied","Data":"aebd95ed2c80cf68f4a11d63e8a9c7417a4d2c89e19691fded4789fac5ae5ced"} Mar 16 17:17:25 crc kubenswrapper[5120]: I0316 17:17:25.078273 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"453261b9-e47c-4e0b-b37d-4803c7ea4eab","Type":"ContainerDied","Data":"7609d755e551179d21b21ae75424817749513f60f07273b47f02ee1165742636"} Mar 16 17:17:25 crc kubenswrapper[5120]: I0316 17:17:25.078281 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"453261b9-e47c-4e0b-b37d-4803c7ea4eab","Type":"ContainerDied","Data":"bfd438fe482625b6acaa98a3f3b1df39124d070d7c82b30f3b95847f5e4307eb"} Mar 16 17:17:25 crc kubenswrapper[5120]: I0316 17:17:25.080095 5120 scope.go:117] "RemoveContainer" containerID="a0d4bfc6c85daa1fcf1a87c1a6df3b7f339f491480a12e4b212421a42ce97347" Mar 16 17:17:25 crc kubenswrapper[5120]: I0316 17:17:25.088109 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage16-crc" (UniqueName: "kubernetes.io/local-volume/local-storage16-crc") on node "crc" Mar 16 17:17:25 crc kubenswrapper[5120]: I0316 17:17:25.088269 5120 generic.go:358] "Generic (PLEG): container finished" podID="a9215705-d766-4151-b079-62d304603586" containerID="8f0a5cfda44fa0469d5667988c40b5fa21d4bc25c03c32374a9002107e112cf6" exitCode=143 Mar 16 17:17:25 crc kubenswrapper[5120]: I0316 17:17:25.088363 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"a9215705-d766-4151-b079-62d304603586","Type":"ContainerDied","Data":"8f0a5cfda44fa0469d5667988c40b5fa21d4bc25c03c32374a9002107e112cf6"} Mar 16 17:17:25 crc kubenswrapper[5120]: I0316 17:17:25.090605 5120 generic.go:358] "Generic (PLEG): container finished" podID="cb3173e3-1b17-4c3d-8e21-4630211b46ef" containerID="b7ab168e4ea48b09e0f18db61cc58ec37ef63c1289f8c33b63d1b101400816cf" exitCode=0 Mar 16 17:17:25 crc kubenswrapper[5120]: I0316 17:17:25.090702 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"cb3173e3-1b17-4c3d-8e21-4630211b46ef","Type":"ContainerDied","Data":"b7ab168e4ea48b09e0f18db61cc58ec37ef63c1289f8c33b63d1b101400816cf"} Mar 16 17:17:25 crc kubenswrapper[5120]: I0316 17:17:25.092493 5120 generic.go:358] "Generic (PLEG): container finished" podID="cb2bdc0a-77bc-488e-b188-7b24ac191d5a" containerID="2ca16c8a2100af38c2f2f32b05d02ec4bd230df464049dbad13abfbaf9e81bfd" exitCode=143 Mar 16 17:17:25 crc kubenswrapper[5120]: I0316 17:17:25.092671 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"cb2bdc0a-77bc-488e-b188-7b24ac191d5a","Type":"ContainerDied","Data":"2ca16c8a2100af38c2f2f32b05d02ec4bd230df464049dbad13abfbaf9e81bfd"} Mar 16 17:17:25 crc kubenswrapper[5120]: I0316 17:17:25.101943 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75c97708-5716-4b9d-af7a-d442efb1c830-ovsdbserver-nb-tls-certs" (OuterVolumeSpecName: "ovsdbserver-nb-tls-certs") pod "75c97708-5716-4b9d-af7a-d442efb1c830" (UID: "75c97708-5716-4b9d-af7a-d442efb1c830"). InnerVolumeSpecName "ovsdbserver-nb-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:17:25 crc kubenswrapper[5120]: I0316 17:17:25.102154 5120 generic.go:358] "Generic (PLEG): container finished" podID="0e67d4b1-e52a-47e3-a212-d301d9160bc0" containerID="f0f7f3da22765c2510e787c90ba13d3a36d1f6e6b7e23c075df10a2d4e61a95b" exitCode=2 Mar 16 17:17:25 crc kubenswrapper[5120]: I0316 17:17:25.102270 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"0e67d4b1-e52a-47e3-a212-d301d9160bc0","Type":"ContainerDied","Data":"f0f7f3da22765c2510e787c90ba13d3a36d1f6e6b7e23c075df10a2d4e61a95b"} Mar 16 17:17:25 crc kubenswrapper[5120]: I0316 17:17:25.102454 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 17:17:25 crc kubenswrapper[5120]: I0316 17:17:25.127618 5120 scope.go:117] "RemoveContainer" containerID="2b1f4a51e957de0117e8df83a8b490bb03c81acb532eec020956c1ef08405199" Mar 16 17:17:25 crc kubenswrapper[5120]: I0316 17:17:25.132278 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/13336088-ad41-4ff2-afab-b0f1f8bb0e75-openstack-config-secret" (OuterVolumeSpecName: "openstack-config-secret") pod "13336088-ad41-4ff2-afab-b0f1f8bb0e75" (UID: "13336088-ad41-4ff2-afab-b0f1f8bb0e75"). InnerVolumeSpecName "openstack-config-secret". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:17:25 crc kubenswrapper[5120]: I0316 17:17:25.135465 5120 generic.go:358] "Generic (PLEG): container finished" podID="c2e33bc1-ee7f-461d-9faa-b5678f7cb416" containerID="5a608768c816e759b1547b4e7085b9239ee5a3b88e54a9ac9ed87d76d8f06f24" exitCode=143 Mar 16 17:17:25 crc kubenswrapper[5120]: I0316 17:17:25.135566 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-5b49d5d76-5r44p" event={"ID":"c2e33bc1-ee7f-461d-9faa-b5678f7cb416","Type":"ContainerDied","Data":"5a608768c816e759b1547b4e7085b9239ee5a3b88e54a9ac9ed87d76d8f06f24"} Mar 16 17:17:25 crc kubenswrapper[5120]: I0316 17:17:25.143461 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-xbcxw" event={"ID":"54551b0a-84c0-40c7-a1d1-64dfbf2fd0d6","Type":"ContainerStarted","Data":"9627250a31bcadc610ffeca00339a8b1f9e99eb4997e84640fc8c70c9b76471c"} Mar 16 17:17:25 crc kubenswrapper[5120]: I0316 17:17:25.173356 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/0e67d4b1-e52a-47e3-a212-d301d9160bc0-kube-state-metrics-tls-config\") pod \"0e67d4b1-e52a-47e3-a212-d301d9160bc0\" (UID: \"0e67d4b1-e52a-47e3-a212-d301d9160bc0\") " Mar 16 17:17:25 crc kubenswrapper[5120]: I0316 17:17:25.173497 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0e67d4b1-e52a-47e3-a212-d301d9160bc0-combined-ca-bundle\") pod \"0e67d4b1-e52a-47e3-a212-d301d9160bc0\" (UID: \"0e67d4b1-e52a-47e3-a212-d301d9160bc0\") " Mar 16 17:17:25 crc kubenswrapper[5120]: I0316 17:17:25.173724 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/0e67d4b1-e52a-47e3-a212-d301d9160bc0-kube-state-metrics-tls-certs\") pod \"0e67d4b1-e52a-47e3-a212-d301d9160bc0\" (UID: \"0e67d4b1-e52a-47e3-a212-d301d9160bc0\") " Mar 16 17:17:25 crc kubenswrapper[5120]: I0316 17:17:25.173983 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lmd5d\" (UniqueName: \"kubernetes.io/projected/0e67d4b1-e52a-47e3-a212-d301d9160bc0-kube-api-access-lmd5d\") pod \"0e67d4b1-e52a-47e3-a212-d301d9160bc0\" (UID: \"0e67d4b1-e52a-47e3-a212-d301d9160bc0\") " Mar 16 17:17:25 crc kubenswrapper[5120]: I0316 17:17:25.178347 5120 reconciler_common.go:299] "Volume detached for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/75c97708-5716-4b9d-af7a-d442efb1c830-ovsdbserver-nb-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:25 crc kubenswrapper[5120]: I0316 17:17:25.178377 5120 reconciler_common.go:299] "Volume detached for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/13336088-ad41-4ff2-afab-b0f1f8bb0e75-openstack-config-secret\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:25 crc kubenswrapper[5120]: I0316 17:17:25.178393 5120 reconciler_common.go:299] "Volume detached for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/13336088-ad41-4ff2-afab-b0f1f8bb0e75-openstack-config\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:25 crc kubenswrapper[5120]: I0316 17:17:25.178402 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/13336088-ad41-4ff2-afab-b0f1f8bb0e75-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:25 crc kubenswrapper[5120]: I0316 17:17:25.178412 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:25 crc kubenswrapper[5120]: I0316 17:17:25.179220 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e67d4b1-e52a-47e3-a212-d301d9160bc0-kube-api-access-lmd5d" (OuterVolumeSpecName: "kube-api-access-lmd5d") pod "0e67d4b1-e52a-47e3-a212-d301d9160bc0" (UID: "0e67d4b1-e52a-47e3-a212-d301d9160bc0"). InnerVolumeSpecName "kube-api-access-lmd5d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:17:25 crc kubenswrapper[5120]: I0316 17:17:25.228987 5120 scope.go:117] "RemoveContainer" containerID="f0f7f3da22765c2510e787c90ba13d3a36d1f6e6b7e23c075df10a2d4e61a95b" Mar 16 17:17:25 crc kubenswrapper[5120]: I0316 17:17:25.233052 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e67d4b1-e52a-47e3-a212-d301d9160bc0-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "0e67d4b1-e52a-47e3-a212-d301d9160bc0" (UID: "0e67d4b1-e52a-47e3-a212-d301d9160bc0"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:17:25 crc kubenswrapper[5120]: I0316 17:17:25.246968 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e67d4b1-e52a-47e3-a212-d301d9160bc0-kube-state-metrics-tls-config" (OuterVolumeSpecName: "kube-state-metrics-tls-config") pod "0e67d4b1-e52a-47e3-a212-d301d9160bc0" (UID: "0e67d4b1-e52a-47e3-a212-d301d9160bc0"). InnerVolumeSpecName "kube-state-metrics-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:17:25 crc kubenswrapper[5120]: I0316 17:17:25.268268 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 17:17:25 crc kubenswrapper[5120]: I0316 17:17:25.285440 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 17:17:25 crc kubenswrapper[5120]: I0316 17:17:25.290544 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lmd5d\" (UniqueName: \"kubernetes.io/projected/0e67d4b1-e52a-47e3-a212-d301d9160bc0-kube-api-access-lmd5d\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:25 crc kubenswrapper[5120]: I0316 17:17:25.290626 5120 reconciler_common.go:299] "Volume detached for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/0e67d4b1-e52a-47e3-a212-d301d9160bc0-kube-state-metrics-tls-config\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:25 crc kubenswrapper[5120]: I0316 17:17:25.290676 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0e67d4b1-e52a-47e3-a212-d301d9160bc0-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:25 crc kubenswrapper[5120]: I0316 17:17:25.298847 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e67d4b1-e52a-47e3-a212-d301d9160bc0-kube-state-metrics-tls-certs" (OuterVolumeSpecName: "kube-state-metrics-tls-certs") pod "0e67d4b1-e52a-47e3-a212-d301d9160bc0" (UID: "0e67d4b1-e52a-47e3-a212-d301d9160bc0"). InnerVolumeSpecName "kube-state-metrics-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:17:25 crc kubenswrapper[5120]: I0316 17:17:25.320500 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75c97708-5716-4b9d-af7a-d442efb1c830-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "75c97708-5716-4b9d-af7a-d442efb1c830" (UID: "75c97708-5716-4b9d-af7a-d442efb1c830"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:17:25 crc kubenswrapper[5120]: I0316 17:17:25.397446 5120 reconciler_common.go:299] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/75c97708-5716-4b9d-af7a-d442efb1c830-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:25 crc kubenswrapper[5120]: I0316 17:17:25.397473 5120 reconciler_common.go:299] "Volume detached for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/0e67d4b1-e52a-47e3-a212-d301d9160bc0-kube-state-metrics-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:25 crc kubenswrapper[5120]: I0316 17:17:25.460298 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 17:17:25 crc kubenswrapper[5120]: I0316 17:17:25.476621 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 17:17:25 crc kubenswrapper[5120]: I0316 17:17:25.750809 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 17:17:25 crc kubenswrapper[5120]: I0316 17:17:25.758849 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-8685-account-create-update-xhm9x" Mar 16 17:17:25 crc kubenswrapper[5120]: I0316 17:17:25.765125 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-2379-account-create-update-wkb97" Mar 16 17:17:25 crc kubenswrapper[5120]: I0316 17:17:25.777672 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:17:25 crc kubenswrapper[5120]: I0316 17:17:25.782683 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 17:17:25 crc kubenswrapper[5120]: I0316 17:17:25.807481 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wm8gg\" (UniqueName: \"kubernetes.io/projected/cb3173e3-1b17-4c3d-8e21-4630211b46ef-kube-api-access-wm8gg\") pod \"cb3173e3-1b17-4c3d-8e21-4630211b46ef\" (UID: \"cb3173e3-1b17-4c3d-8e21-4630211b46ef\") " Mar 16 17:17:25 crc kubenswrapper[5120]: I0316 17:17:25.807600 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/976307a4-0f5c-4e50-946f-682511e8e3bf-operator-scripts\") pod \"976307a4-0f5c-4e50-946f-682511e8e3bf\" (UID: \"976307a4-0f5c-4e50-946f-682511e8e3bf\") " Mar 16 17:17:25 crc kubenswrapper[5120]: I0316 17:17:25.807655 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/cb3173e3-1b17-4c3d-8e21-4630211b46ef-vencrypt-tls-certs\") pod \"cb3173e3-1b17-4c3d-8e21-4630211b46ef\" (UID: \"cb3173e3-1b17-4c3d-8e21-4630211b46ef\") " Mar 16 17:17:25 crc kubenswrapper[5120]: I0316 17:17:25.807747 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cb3173e3-1b17-4c3d-8e21-4630211b46ef-config-data\") pod \"cb3173e3-1b17-4c3d-8e21-4630211b46ef\" (UID: \"cb3173e3-1b17-4c3d-8e21-4630211b46ef\") " Mar 16 17:17:25 crc kubenswrapper[5120]: I0316 17:17:25.807845 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5ab53d7f-0e81-4c07-b2d3-24404dcbcc16-operator-scripts\") pod \"5ab53d7f-0e81-4c07-b2d3-24404dcbcc16\" (UID: \"5ab53d7f-0e81-4c07-b2d3-24404dcbcc16\") " Mar 16 17:17:25 crc kubenswrapper[5120]: I0316 17:17:25.807894 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5vfhl\" (UniqueName: \"kubernetes.io/projected/5ab53d7f-0e81-4c07-b2d3-24404dcbcc16-kube-api-access-5vfhl\") pod \"5ab53d7f-0e81-4c07-b2d3-24404dcbcc16\" (UID: \"5ab53d7f-0e81-4c07-b2d3-24404dcbcc16\") " Mar 16 17:17:25 crc kubenswrapper[5120]: I0316 17:17:25.808206 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/cb3173e3-1b17-4c3d-8e21-4630211b46ef-nova-novncproxy-tls-certs\") pod \"cb3173e3-1b17-4c3d-8e21-4630211b46ef\" (UID: \"cb3173e3-1b17-4c3d-8e21-4630211b46ef\") " Mar 16 17:17:25 crc kubenswrapper[5120]: I0316 17:17:25.808467 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cb3173e3-1b17-4c3d-8e21-4630211b46ef-combined-ca-bundle\") pod \"cb3173e3-1b17-4c3d-8e21-4630211b46ef\" (UID: \"cb3173e3-1b17-4c3d-8e21-4630211b46ef\") " Mar 16 17:17:25 crc kubenswrapper[5120]: I0316 17:17:25.808557 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ab53d7f-0e81-4c07-b2d3-24404dcbcc16-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "5ab53d7f-0e81-4c07-b2d3-24404dcbcc16" (UID: "5ab53d7f-0e81-4c07-b2d3-24404dcbcc16"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:17:25 crc kubenswrapper[5120]: I0316 17:17:25.808590 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g5hsk\" (UniqueName: \"kubernetes.io/projected/976307a4-0f5c-4e50-946f-682511e8e3bf-kube-api-access-g5hsk\") pod \"976307a4-0f5c-4e50-946f-682511e8e3bf\" (UID: \"976307a4-0f5c-4e50-946f-682511e8e3bf\") " Mar 16 17:17:25 crc kubenswrapper[5120]: I0316 17:17:25.808938 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/976307a4-0f5c-4e50-946f-682511e8e3bf-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "976307a4-0f5c-4e50-946f-682511e8e3bf" (UID: "976307a4-0f5c-4e50-946f-682511e8e3bf"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:17:25 crc kubenswrapper[5120]: I0316 17:17:25.816647 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ab53d7f-0e81-4c07-b2d3-24404dcbcc16-kube-api-access-5vfhl" (OuterVolumeSpecName: "kube-api-access-5vfhl") pod "5ab53d7f-0e81-4c07-b2d3-24404dcbcc16" (UID: "5ab53d7f-0e81-4c07-b2d3-24404dcbcc16"). InnerVolumeSpecName "kube-api-access-5vfhl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:17:25 crc kubenswrapper[5120]: I0316 17:17:25.817284 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/976307a4-0f5c-4e50-946f-682511e8e3bf-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:25 crc kubenswrapper[5120]: I0316 17:17:25.817317 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5ab53d7f-0e81-4c07-b2d3-24404dcbcc16-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:25 crc kubenswrapper[5120]: I0316 17:17:25.817330 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5vfhl\" (UniqueName: \"kubernetes.io/projected/5ab53d7f-0e81-4c07-b2d3-24404dcbcc16-kube-api-access-5vfhl\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:25 crc kubenswrapper[5120]: I0316 17:17:25.839303 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/976307a4-0f5c-4e50-946f-682511e8e3bf-kube-api-access-g5hsk" (OuterVolumeSpecName: "kube-api-access-g5hsk") pod "976307a4-0f5c-4e50-946f-682511e8e3bf" (UID: "976307a4-0f5c-4e50-946f-682511e8e3bf"). InnerVolumeSpecName "kube-api-access-g5hsk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:17:25 crc kubenswrapper[5120]: I0316 17:17:25.842865 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb3173e3-1b17-4c3d-8e21-4630211b46ef-config-data" (OuterVolumeSpecName: "config-data") pod "cb3173e3-1b17-4c3d-8e21-4630211b46ef" (UID: "cb3173e3-1b17-4c3d-8e21-4630211b46ef"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:17:25 crc kubenswrapper[5120]: I0316 17:17:25.859122 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb3173e3-1b17-4c3d-8e21-4630211b46ef-kube-api-access-wm8gg" (OuterVolumeSpecName: "kube-api-access-wm8gg") pod "cb3173e3-1b17-4c3d-8e21-4630211b46ef" (UID: "cb3173e3-1b17-4c3d-8e21-4630211b46ef"). InnerVolumeSpecName "kube-api-access-wm8gg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:17:25 crc kubenswrapper[5120]: I0316 17:17:25.892952 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb3173e3-1b17-4c3d-8e21-4630211b46ef-vencrypt-tls-certs" (OuterVolumeSpecName: "vencrypt-tls-certs") pod "cb3173e3-1b17-4c3d-8e21-4630211b46ef" (UID: "cb3173e3-1b17-4c3d-8e21-4630211b46ef"). InnerVolumeSpecName "vencrypt-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:17:25 crc kubenswrapper[5120]: I0316 17:17:25.907986 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb3173e3-1b17-4c3d-8e21-4630211b46ef-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "cb3173e3-1b17-4c3d-8e21-4630211b46ef" (UID: "cb3173e3-1b17-4c3d-8e21-4630211b46ef"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:17:25 crc kubenswrapper[5120]: I0316 17:17:25.920248 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cb3173e3-1b17-4c3d-8e21-4630211b46ef-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:25 crc kubenswrapper[5120]: I0316 17:17:25.920475 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g5hsk\" (UniqueName: \"kubernetes.io/projected/976307a4-0f5c-4e50-946f-682511e8e3bf-kube-api-access-g5hsk\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:25 crc kubenswrapper[5120]: I0316 17:17:25.920550 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wm8gg\" (UniqueName: \"kubernetes.io/projected/cb3173e3-1b17-4c3d-8e21-4630211b46ef-kube-api-access-wm8gg\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:25 crc kubenswrapper[5120]: I0316 17:17:25.920632 5120 reconciler_common.go:299] "Volume detached for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/cb3173e3-1b17-4c3d-8e21-4630211b46ef-vencrypt-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:25 crc kubenswrapper[5120]: I0316 17:17:25.920696 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cb3173e3-1b17-4c3d-8e21-4630211b46ef-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:25 crc kubenswrapper[5120]: I0316 17:17:25.946261 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb3173e3-1b17-4c3d-8e21-4630211b46ef-nova-novncproxy-tls-certs" (OuterVolumeSpecName: "nova-novncproxy-tls-certs") pod "cb3173e3-1b17-4c3d-8e21-4630211b46ef" (UID: "cb3173e3-1b17-4c3d-8e21-4630211b46ef"). InnerVolumeSpecName "nova-novncproxy-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.023480 5120 reconciler_common.go:299] "Volume detached for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/cb3173e3-1b17-4c3d-8e21-4630211b46ef-nova-novncproxy-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.048317 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-1cd2-account-create-update-xklg9" Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.089616 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.125410 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-5r7xg"] Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.126517 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/2dd828c2-16f2-4e69-b0b8-b953caf55f5b-kolla-config\") pod \"2dd828c2-16f2-4e69-b0b8-b953caf55f5b\" (UID: \"2dd828c2-16f2-4e69-b0b8-b953caf55f5b\") " Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.126609 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cmzdr\" (UniqueName: \"kubernetes.io/projected/8b695735-ad55-4ce9-ac75-42381bcaffbf-kube-api-access-cmzdr\") pod \"8b695735-ad55-4ce9-ac75-42381bcaffbf\" (UID: \"8b695735-ad55-4ce9-ac75-42381bcaffbf\") " Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.126688 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/2dd828c2-16f2-4e69-b0b8-b953caf55f5b-galera-tls-certs\") pod \"2dd828c2-16f2-4e69-b0b8-b953caf55f5b\" (UID: \"2dd828c2-16f2-4e69-b0b8-b953caf55f5b\") " Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.126986 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dnk5r\" (UniqueName: \"kubernetes.io/projected/2dd828c2-16f2-4e69-b0b8-b953caf55f5b-kube-api-access-dnk5r\") pod \"2dd828c2-16f2-4e69-b0b8-b953caf55f5b\" (UID: \"2dd828c2-16f2-4e69-b0b8-b953caf55f5b\") " Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.127134 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"mysql-db\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"2dd828c2-16f2-4e69-b0b8-b953caf55f5b\" (UID: \"2dd828c2-16f2-4e69-b0b8-b953caf55f5b\") " Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.127189 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/2dd828c2-16f2-4e69-b0b8-b953caf55f5b-config-data-default\") pod \"2dd828c2-16f2-4e69-b0b8-b953caf55f5b\" (UID: \"2dd828c2-16f2-4e69-b0b8-b953caf55f5b\") " Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.127237 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2dd828c2-16f2-4e69-b0b8-b953caf55f5b-operator-scripts\") pod \"2dd828c2-16f2-4e69-b0b8-b953caf55f5b\" (UID: \"2dd828c2-16f2-4e69-b0b8-b953caf55f5b\") " Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.127260 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2dd828c2-16f2-4e69-b0b8-b953caf55f5b-combined-ca-bundle\") pod \"2dd828c2-16f2-4e69-b0b8-b953caf55f5b\" (UID: \"2dd828c2-16f2-4e69-b0b8-b953caf55f5b\") " Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.127390 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8b695735-ad55-4ce9-ac75-42381bcaffbf-operator-scripts\") pod \"8b695735-ad55-4ce9-ac75-42381bcaffbf\" (UID: \"8b695735-ad55-4ce9-ac75-42381bcaffbf\") " Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.127449 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/2dd828c2-16f2-4e69-b0b8-b953caf55f5b-config-data-generated\") pod \"2dd828c2-16f2-4e69-b0b8-b953caf55f5b\" (UID: \"2dd828c2-16f2-4e69-b0b8-b953caf55f5b\") " Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.130938 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2dd828c2-16f2-4e69-b0b8-b953caf55f5b-config-data-default" (OuterVolumeSpecName: "config-data-default") pod "2dd828c2-16f2-4e69-b0b8-b953caf55f5b" (UID: "2dd828c2-16f2-4e69-b0b8-b953caf55f5b"). InnerVolumeSpecName "config-data-default". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.131733 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2dd828c2-16f2-4e69-b0b8-b953caf55f5b-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "2dd828c2-16f2-4e69-b0b8-b953caf55f5b" (UID: "2dd828c2-16f2-4e69-b0b8-b953caf55f5b"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.137237 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8b695735-ad55-4ce9-ac75-42381bcaffbf-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "8b695735-ad55-4ce9-ac75-42381bcaffbf" (UID: "8b695735-ad55-4ce9-ac75-42381bcaffbf"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.137517 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2dd828c2-16f2-4e69-b0b8-b953caf55f5b-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "2dd828c2-16f2-4e69-b0b8-b953caf55f5b" (UID: "2dd828c2-16f2-4e69-b0b8-b953caf55f5b"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.138909 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2dd828c2-16f2-4e69-b0b8-b953caf55f5b-config-data-generated" (OuterVolumeSpecName: "config-data-generated") pod "2dd828c2-16f2-4e69-b0b8-b953caf55f5b" (UID: "2dd828c2-16f2-4e69-b0b8-b953caf55f5b"). InnerVolumeSpecName "config-data-generated". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.139002 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b695735-ad55-4ce9-ac75-42381bcaffbf-kube-api-access-cmzdr" (OuterVolumeSpecName: "kube-api-access-cmzdr") pod "8b695735-ad55-4ce9-ac75-42381bcaffbf" (UID: "8b695735-ad55-4ce9-ac75-42381bcaffbf"). InnerVolumeSpecName "kube-api-access-cmzdr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.152007 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2dd828c2-16f2-4e69-b0b8-b953caf55f5b-kube-api-access-dnk5r" (OuterVolumeSpecName: "kube-api-access-dnk5r") pod "2dd828c2-16f2-4e69-b0b8-b953caf55f5b" (UID: "2dd828c2-16f2-4e69-b0b8-b953caf55f5b"). InnerVolumeSpecName "kube-api-access-dnk5r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.183703 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-5749bb5d-544mw" Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.200163 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-8685-account-create-update-xhm9x" event={"ID":"5ab53d7f-0e81-4c07-b2d3-24404dcbcc16","Type":"ContainerDied","Data":"c3951fbdbfdede3fdb704c168ca5fdc108b0aeaeef36b5f1f1be1694c371873c"} Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.200321 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-8685-account-create-update-xhm9x" Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.201586 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage13-crc" (OuterVolumeSpecName: "mysql-db") pod "2dd828c2-16f2-4e69-b0b8-b953caf55f5b" (UID: "2dd828c2-16f2-4e69-b0b8-b953caf55f5b"). InnerVolumeSpecName "local-storage13-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.219298 5120 generic.go:358] "Generic (PLEG): container finished" podID="2dd828c2-16f2-4e69-b0b8-b953caf55f5b" containerID="7e2d9b8d74a0793fd3dc782decec5aecb43307447a1d0250a1484d0fd0e6e09d" exitCode=0 Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.219456 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"2dd828c2-16f2-4e69-b0b8-b953caf55f5b","Type":"ContainerDied","Data":"7e2d9b8d74a0793fd3dc782decec5aecb43307447a1d0250a1484d0fd0e6e09d"} Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.219484 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"2dd828c2-16f2-4e69-b0b8-b953caf55f5b","Type":"ContainerDied","Data":"10ef085caf240b4813c9b78ccb1d94edb6d1e49922d1883eda5da1a4a5e93e79"} Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.219503 5120 scope.go:117] "RemoveContainer" containerID="7e2d9b8d74a0793fd3dc782decec5aecb43307447a1d0250a1484d0fd0e6e09d" Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.219997 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2dd828c2-16f2-4e69-b0b8-b953caf55f5b-galera-tls-certs" (OuterVolumeSpecName: "galera-tls-certs") pod "2dd828c2-16f2-4e69-b0b8-b953caf55f5b" (UID: "2dd828c2-16f2-4e69-b0b8-b953caf55f5b"). InnerVolumeSpecName "galera-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.220907 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.231161 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2wtqv\" (UniqueName: \"kubernetes.io/projected/682f1065-f1df-4d72-9a81-3ddb581743ca-kube-api-access-2wtqv\") pod \"682f1065-f1df-4d72-9a81-3ddb581743ca\" (UID: \"682f1065-f1df-4d72-9a81-3ddb581743ca\") " Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.231239 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/682f1065-f1df-4d72-9a81-3ddb581743ca-internal-tls-certs\") pod \"682f1065-f1df-4d72-9a81-3ddb581743ca\" (UID: \"682f1065-f1df-4d72-9a81-3ddb581743ca\") " Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.231377 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/682f1065-f1df-4d72-9a81-3ddb581743ca-run-httpd\") pod \"682f1065-f1df-4d72-9a81-3ddb581743ca\" (UID: \"682f1065-f1df-4d72-9a81-3ddb581743ca\") " Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.231521 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/682f1065-f1df-4d72-9a81-3ddb581743ca-etc-swift\") pod \"682f1065-f1df-4d72-9a81-3ddb581743ca\" (UID: \"682f1065-f1df-4d72-9a81-3ddb581743ca\") " Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.231845 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/682f1065-f1df-4d72-9a81-3ddb581743ca-combined-ca-bundle\") pod \"682f1065-f1df-4d72-9a81-3ddb581743ca\" (UID: \"682f1065-f1df-4d72-9a81-3ddb581743ca\") " Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.232073 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/682f1065-f1df-4d72-9a81-3ddb581743ca-config-data\") pod \"682f1065-f1df-4d72-9a81-3ddb581743ca\" (UID: \"682f1065-f1df-4d72-9a81-3ddb581743ca\") " Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.232249 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/682f1065-f1df-4d72-9a81-3ddb581743ca-log-httpd\") pod \"682f1065-f1df-4d72-9a81-3ddb581743ca\" (UID: \"682f1065-f1df-4d72-9a81-3ddb581743ca\") " Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.232304 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/682f1065-f1df-4d72-9a81-3ddb581743ca-public-tls-certs\") pod \"682f1065-f1df-4d72-9a81-3ddb581743ca\" (UID: \"682f1065-f1df-4d72-9a81-3ddb581743ca\") " Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.233324 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dnk5r\" (UniqueName: \"kubernetes.io/projected/2dd828c2-16f2-4e69-b0b8-b953caf55f5b-kube-api-access-dnk5r\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.233360 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") on node \"crc\" " Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.233373 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/2dd828c2-16f2-4e69-b0b8-b953caf55f5b-config-data-default\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.233387 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2dd828c2-16f2-4e69-b0b8-b953caf55f5b-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.233400 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8b695735-ad55-4ce9-ac75-42381bcaffbf-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.233417 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/2dd828c2-16f2-4e69-b0b8-b953caf55f5b-config-data-generated\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.233429 5120 reconciler_common.go:299] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/2dd828c2-16f2-4e69-b0b8-b953caf55f5b-kolla-config\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.233441 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cmzdr\" (UniqueName: \"kubernetes.io/projected/8b695735-ad55-4ce9-ac75-42381bcaffbf-kube-api-access-cmzdr\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.233452 5120 reconciler_common.go:299] "Volume detached for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/2dd828c2-16f2-4e69-b0b8-b953caf55f5b-galera-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.234404 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-2379-account-create-update-wkb97" event={"ID":"976307a4-0f5c-4e50-946f-682511e8e3bf","Type":"ContainerDied","Data":"3ea76afc443e59cc5af2728791d2d074af243574d8ae1097d1f053ee9add1293"} Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.234892 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-2379-account-create-update-wkb97" Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.238461 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/682f1065-f1df-4d72-9a81-3ddb581743ca-kube-api-access-2wtqv" (OuterVolumeSpecName: "kube-api-access-2wtqv") pod "682f1065-f1df-4d72-9a81-3ddb581743ca" (UID: "682f1065-f1df-4d72-9a81-3ddb581743ca"). InnerVolumeSpecName "kube-api-access-2wtqv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.241665 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/682f1065-f1df-4d72-9a81-3ddb581743ca-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "682f1065-f1df-4d72-9a81-3ddb581743ca" (UID: "682f1065-f1df-4d72-9a81-3ddb581743ca"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.249089 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/682f1065-f1df-4d72-9a81-3ddb581743ca-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "682f1065-f1df-4d72-9a81-3ddb581743ca" (UID: "682f1065-f1df-4d72-9a81-3ddb581743ca"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.252052 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/placement-5b79cc5b54-db2hd" podUID="1976af1c-93c9-487c-9852-752bb5c1234d" containerName="placement-api" probeResult="failure" output="Get \"https://10.217.0.175:8778/\": dial tcp 10.217.0.175:8778: connect: connection refused" Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.267613 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/682f1065-f1df-4d72-9a81-3ddb581743ca-etc-swift" (OuterVolumeSpecName: "etc-swift") pod "682f1065-f1df-4d72-9a81-3ddb581743ca" (UID: "682f1065-f1df-4d72-9a81-3ddb581743ca"). InnerVolumeSpecName "etc-swift". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.294429 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage13-crc" (UniqueName: "kubernetes.io/local-volume/local-storage13-crc") on node "crc" Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.299196 5120 scope.go:117] "RemoveContainer" containerID="3495744f601efe22901562bde3119b73cb250c8c0a894ebd85622b20fa7092a1" Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.309185 5120 generic.go:358] "Generic (PLEG): container finished" podID="18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62" containerID="e7a5ecad2365023f5d54577d059406a821a96c82ee276fd4ed93a27749e6fcc7" exitCode=0 Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.311935 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-8685-account-create-update-xhm9x"] Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.312001 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62","Type":"ContainerDied","Data":"e7a5ecad2365023f5d54577d059406a821a96c82ee276fd4ed93a27749e6fcc7"} Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.313938 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/682f1065-f1df-4d72-9a81-3ddb581743ca-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "682f1065-f1df-4d72-9a81-3ddb581743ca" (UID: "682f1065-f1df-4d72-9a81-3ddb581743ca"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.326390 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-5r7xg" event={"ID":"05faed40-e1aa-44be-bae7-49459da3dc79","Type":"ContainerStarted","Data":"2a9d3fb080c1e1f4af6d04f269e5a905eb3b390814632e0053628985859c3224"} Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.328230 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-8685-account-create-update-xhm9x"] Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.331410 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-1cd2-account-create-update-xklg9" event={"ID":"8b695735-ad55-4ce9-ac75-42381bcaffbf","Type":"ContainerDied","Data":"28cfcdbf213b5c4b830d0ab5e7ae4150ca6c3707ea218cb56f5a51060cb668af"} Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.331490 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-1cd2-account-create-update-xklg9" Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.348567 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.348594 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"cb3173e3-1b17-4c3d-8e21-4630211b46ef","Type":"ContainerDied","Data":"b64630373a36be012055bda1e3ca40fa873059b2970edf073995c357b641076b"} Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.352264 5120 scope.go:117] "RemoveContainer" containerID="7e2d9b8d74a0793fd3dc782decec5aecb43307447a1d0250a1484d0fd0e6e09d" Mar 16 17:17:26 crc kubenswrapper[5120]: E0316 17:17:26.357195 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e2d9b8d74a0793fd3dc782decec5aecb43307447a1d0250a1484d0fd0e6e09d\": container with ID starting with 7e2d9b8d74a0793fd3dc782decec5aecb43307447a1d0250a1484d0fd0e6e09d not found: ID does not exist" containerID="7e2d9b8d74a0793fd3dc782decec5aecb43307447a1d0250a1484d0fd0e6e09d" Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.357267 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e2d9b8d74a0793fd3dc782decec5aecb43307447a1d0250a1484d0fd0e6e09d"} err="failed to get container status \"7e2d9b8d74a0793fd3dc782decec5aecb43307447a1d0250a1484d0fd0e6e09d\": rpc error: code = NotFound desc = could not find container \"7e2d9b8d74a0793fd3dc782decec5aecb43307447a1d0250a1484d0fd0e6e09d\": container with ID starting with 7e2d9b8d74a0793fd3dc782decec5aecb43307447a1d0250a1484d0fd0e6e09d not found: ID does not exist" Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.357291 5120 scope.go:117] "RemoveContainer" containerID="3495744f601efe22901562bde3119b73cb250c8c0a894ebd85622b20fa7092a1" Mar 16 17:17:26 crc kubenswrapper[5120]: E0316 17:17:26.357857 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3495744f601efe22901562bde3119b73cb250c8c0a894ebd85622b20fa7092a1\": container with ID starting with 3495744f601efe22901562bde3119b73cb250c8c0a894ebd85622b20fa7092a1 not found: ID does not exist" containerID="3495744f601efe22901562bde3119b73cb250c8c0a894ebd85622b20fa7092a1" Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.357904 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3495744f601efe22901562bde3119b73cb250c8c0a894ebd85622b20fa7092a1"} err="failed to get container status \"3495744f601efe22901562bde3119b73cb250c8c0a894ebd85622b20fa7092a1\": rpc error: code = NotFound desc = could not find container \"3495744f601efe22901562bde3119b73cb250c8c0a894ebd85622b20fa7092a1\": container with ID starting with 3495744f601efe22901562bde3119b73cb250c8c0a894ebd85622b20fa7092a1 not found: ID does not exist" Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.357953 5120 scope.go:117] "RemoveContainer" containerID="b7ab168e4ea48b09e0f18db61cc58ec37ef63c1289f8c33b63d1b101400816cf" Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.361897 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/682f1065-f1df-4d72-9a81-3ddb581743ca-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "682f1065-f1df-4d72-9a81-3ddb581743ca" (UID: "682f1065-f1df-4d72-9a81-3ddb581743ca"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.363703 5120 generic.go:358] "Generic (PLEG): container finished" podID="54551b0a-84c0-40c7-a1d1-64dfbf2fd0d6" containerID="6a0c6ad8632a2e4381f6d9e14ae012bdf8c057b6396c717785fda31fa5fcd085" exitCode=1 Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.364079 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-xbcxw" event={"ID":"54551b0a-84c0-40c7-a1d1-64dfbf2fd0d6","Type":"ContainerDied","Data":"6a0c6ad8632a2e4381f6d9e14ae012bdf8c057b6396c717785fda31fa5fcd085"} Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.371679 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2wtqv\" (UniqueName: \"kubernetes.io/projected/682f1065-f1df-4d72-9a81-3ddb581743ca-kube-api-access-2wtqv\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.371752 5120 scope.go:117] "RemoveContainer" containerID="6a0c6ad8632a2e4381f6d9e14ae012bdf8c057b6396c717785fda31fa5fcd085" Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.371893 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/682f1065-f1df-4d72-9a81-3ddb581743ca-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.372153 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/682f1065-f1df-4d72-9a81-3ddb581743ca-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.372166 5120 reconciler_common.go:299] "Volume detached for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/682f1065-f1df-4d72-9a81-3ddb581743ca-etc-swift\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.372175 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/682f1065-f1df-4d72-9a81-3ddb581743ca-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.372185 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.372194 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/682f1065-f1df-4d72-9a81-3ddb581743ca-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.379504 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.386062 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-4ea4-account-create-update-tp4sf" event={"ID":"0a59e429-ba97-491f-91d4-9b1b063fc15b","Type":"ContainerStarted","Data":"b836d82008edeb2a98310c07ce88205db2105ff9e97b7c93f82483a885161a4b"} Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.387543 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-2379-account-create-update-wkb97"] Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.419072 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2dd828c2-16f2-4e69-b0b8-b953caf55f5b-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "2dd828c2-16f2-4e69-b0b8-b953caf55f5b" (UID: "2dd828c2-16f2-4e69-b0b8-b953caf55f5b"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.419133 5120 scope.go:117] "RemoveContainer" containerID="d48240109d0a3c34c694d1bce1876d5c9a3e15e50367c9d12627dc968eddbf49" Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.419189 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/682f1065-f1df-4d72-9a81-3ddb581743ca-config-data" (OuterVolumeSpecName: "config-data") pod "682f1065-f1df-4d72-9a81-3ddb581743ca" (UID: "682f1065-f1df-4d72-9a81-3ddb581743ca"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.424911 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-2379-account-create-update-wkb97"] Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.442827 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-1cd2-account-create-update-xklg9"] Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.444180 5120 generic.go:358] "Generic (PLEG): container finished" podID="682f1065-f1df-4d72-9a81-3ddb581743ca" containerID="fdf02cc413ba820b43576d699f107caa1ca5ce3be93360df557fd570bbf0baa7" exitCode=0 Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.444200 5120 generic.go:358] "Generic (PLEG): container finished" podID="682f1065-f1df-4d72-9a81-3ddb581743ca" containerID="bf112b12ea9fcf672dfef9c231fc9ff0ad24272de8f0ee8e3b3d3f8056137682" exitCode=0 Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.444256 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-5749bb5d-544mw" event={"ID":"682f1065-f1df-4d72-9a81-3ddb581743ca","Type":"ContainerDied","Data":"fdf02cc413ba820b43576d699f107caa1ca5ce3be93360df557fd570bbf0baa7"} Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.444282 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-5749bb5d-544mw" event={"ID":"682f1065-f1df-4d72-9a81-3ddb581743ca","Type":"ContainerDied","Data":"bf112b12ea9fcf672dfef9c231fc9ff0ad24272de8f0ee8e3b3d3f8056137682"} Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.444292 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-5749bb5d-544mw" event={"ID":"682f1065-f1df-4d72-9a81-3ddb581743ca","Type":"ContainerDied","Data":"d257e455f44815bc70b70b250adae15178e2f5403a73948086124a31aef5864c"} Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.444370 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-5749bb5d-544mw" Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.448211 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/682f1065-f1df-4d72-9a81-3ddb581743ca-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "682f1065-f1df-4d72-9a81-3ddb581743ca" (UID: "682f1065-f1df-4d72-9a81-3ddb581743ca"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.449542 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-1cd2-account-create-update-xklg9"] Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.462296 5120 scope.go:117] "RemoveContainer" containerID="fdf02cc413ba820b43576d699f107caa1ca5ce3be93360df557fd570bbf0baa7" Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.480400 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2dd828c2-16f2-4e69-b0b8-b953caf55f5b-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.480433 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/682f1065-f1df-4d72-9a81-3ddb581743ca-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.480446 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/682f1065-f1df-4d72-9a81-3ddb581743ca-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.498815 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/cinder-api-0" podUID="d14c3978-d254-4ec4-baa0-f011eaef745e" containerName="cinder-api" probeResult="failure" output="Get \"https://10.217.0.173:8776/healthcheck\": read tcp 10.217.0.2:35490->10.217.0.173:8776: read: connection reset by peer" Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.536840 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.578073 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.645359 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-2aa5-account-create-update-w4zdl"] Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.662453 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.662680 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/memcached-0" podUID="7f4ab831-1080-4b30-9b89-ddbd4d26bbb8" containerName="memcached" containerID="cri-o://0cb75cd76e83c805136be2430ae92ab9ce0b6d500c761635d50c613f87fa59b7" gracePeriod=30 Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.695263 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0e67d4b1-e52a-47e3-a212-d301d9160bc0" path="/var/lib/kubelet/pods/0e67d4b1-e52a-47e3-a212-d301d9160bc0/volumes" Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.697002 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="13336088-ad41-4ff2-afab-b0f1f8bb0e75" path="/var/lib/kubelet/pods/13336088-ad41-4ff2-afab-b0f1f8bb0e75/volumes" Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.706024 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ab53d7f-0e81-4c07-b2d3-24404dcbcc16" path="/var/lib/kubelet/pods/5ab53d7f-0e81-4c07-b2d3-24404dcbcc16/volumes" Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.706938 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ba234a2-95db-4cf8-a7de-7ddc034f58b7" path="/var/lib/kubelet/pods/5ba234a2-95db-4cf8-a7de-7ddc034f58b7/volumes" Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.707636 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="75c97708-5716-4b9d-af7a-d442efb1c830" path="/var/lib/kubelet/pods/75c97708-5716-4b9d-af7a-d442efb1c830/volumes" Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.752585 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8b695735-ad55-4ce9-ac75-42381bcaffbf" path="/var/lib/kubelet/pods/8b695735-ad55-4ce9-ac75-42381bcaffbf/volumes" Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.753050 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="976307a4-0f5c-4e50-946f-682511e8e3bf" path="/var/lib/kubelet/pods/976307a4-0f5c-4e50-946f-682511e8e3bf/volumes" Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.753469 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb3173e3-1b17-4c3d-8e21-4630211b46ef" path="/var/lib/kubelet/pods/cb3173e3-1b17-4c3d-8e21-4630211b46ef/volumes" Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.758295 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-2aa5-account-create-update-w4zdl"] Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.762787 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-2aa5-account-create-update-hwk8n"] Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.777123 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ba234a2-95db-4cf8-a7de-7ddc034f58b7" containerName="ovsdbserver-sb" Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.777152 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ba234a2-95db-4cf8-a7de-7ddc034f58b7" containerName="ovsdbserver-sb" Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.777213 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="682f1065-f1df-4d72-9a81-3ddb581743ca" containerName="proxy-httpd" Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.777227 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="682f1065-f1df-4d72-9a81-3ddb581743ca" containerName="proxy-httpd" Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.777293 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e67d4b1-e52a-47e3-a212-d301d9160bc0" containerName="kube-state-metrics" Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.777301 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e67d4b1-e52a-47e3-a212-d301d9160bc0" containerName="kube-state-metrics" Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.777339 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb3173e3-1b17-4c3d-8e21-4630211b46ef" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.777345 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb3173e3-1b17-4c3d-8e21-4630211b46ef" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.777394 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ba234a2-95db-4cf8-a7de-7ddc034f58b7" containerName="openstack-network-exporter" Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.777400 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ba234a2-95db-4cf8-a7de-7ddc034f58b7" containerName="openstack-network-exporter" Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.777474 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75c97708-5716-4b9d-af7a-d442efb1c830" containerName="openstack-network-exporter" Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.777483 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="75c97708-5716-4b9d-af7a-d442efb1c830" containerName="openstack-network-exporter" Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.777552 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2dd828c2-16f2-4e69-b0b8-b953caf55f5b" containerName="mysql-bootstrap" Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.777559 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="2dd828c2-16f2-4e69-b0b8-b953caf55f5b" containerName="mysql-bootstrap" Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.777578 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2dd828c2-16f2-4e69-b0b8-b953caf55f5b" containerName="galera" Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.777585 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="2dd828c2-16f2-4e69-b0b8-b953caf55f5b" containerName="galera" Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.777607 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75c97708-5716-4b9d-af7a-d442efb1c830" containerName="ovsdbserver-nb" Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.777635 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="75c97708-5716-4b9d-af7a-d442efb1c830" containerName="ovsdbserver-nb" Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.778088 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="682f1065-f1df-4d72-9a81-3ddb581743ca" containerName="proxy-server" Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.778099 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="682f1065-f1df-4d72-9a81-3ddb581743ca" containerName="proxy-server" Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.784689 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="0e67d4b1-e52a-47e3-a212-d301d9160bc0" containerName="kube-state-metrics" Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.784741 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="cb3173e3-1b17-4c3d-8e21-4630211b46ef" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.784780 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="2dd828c2-16f2-4e69-b0b8-b953caf55f5b" containerName="galera" Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.784808 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="75c97708-5716-4b9d-af7a-d442efb1c830" containerName="openstack-network-exporter" Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.784825 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="682f1065-f1df-4d72-9a81-3ddb581743ca" containerName="proxy-server" Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.784861 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="5ba234a2-95db-4cf8-a7de-7ddc034f58b7" containerName="ovsdbserver-sb" Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.784877 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="5ba234a2-95db-4cf8-a7de-7ddc034f58b7" containerName="openstack-network-exporter" Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.784898 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="75c97708-5716-4b9d-af7a-d442efb1c830" containerName="ovsdbserver-nb" Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.784934 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="682f1065-f1df-4d72-9a81-3ddb581743ca" containerName="proxy-httpd" Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.835138 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-2aa5-account-create-update-hwk8n"] Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.835745 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-2aa5-account-create-update-hwk8n" Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.843003 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-db-secret\"" Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.855318 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-7dqr4"] Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.876710 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="cb2bdc0a-77bc-488e-b188-7b24ac191d5a" containerName="glance-httpd" probeResult="failure" output="Get \"https://10.217.0.191:9292/healthcheck\": read tcp 10.217.0.2:58094->10.217.0.191:9292: read: connection reset by peer" Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.877150 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="cb2bdc0a-77bc-488e-b188-7b24ac191d5a" containerName="glance-log" probeResult="failure" output="Get \"https://10.217.0.191:9292/healthcheck\": read tcp 10.217.0.2:58088->10.217.0.191:9292: read: connection reset by peer" Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.882282 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-7dqr4"] Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.885977 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bn7mm\" (UniqueName: \"kubernetes.io/projected/3fae0e8f-e6a0-4031-a030-3e380aaf68a8-kube-api-access-bn7mm\") pod \"keystone-2aa5-account-create-update-hwk8n\" (UID: \"3fae0e8f-e6a0-4031-a030-3e380aaf68a8\") " pod="openstack-kuttl-tests/keystone-2aa5-account-create-update-hwk8n" Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.886584 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3fae0e8f-e6a0-4031-a030-3e380aaf68a8-operator-scripts\") pod \"keystone-2aa5-account-create-update-hwk8n\" (UID: \"3fae0e8f-e6a0-4031-a030-3e380aaf68a8\") " pod="openstack-kuttl-tests/keystone-2aa5-account-create-update-hwk8n" Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.903018 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-vf5nd"] Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.912136 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-vf5nd"] Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.918473 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-77d7b5cd69-lf8gf"] Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.919651 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/keystone-77d7b5cd69-lf8gf" podUID="3b01ec67-66ba-469f-9eba-1df99165b135" containerName="keystone-api" containerID="cri-o://989a7f158ffb3d42b5d6a2c0845df1cbac6bacb3154bade47643d37307c9560d" gracePeriod=30 Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.961067 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-2aa5-account-create-update-hwk8n"] Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.981992 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-db-create-kn6wh"] Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.992695 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3fae0e8f-e6a0-4031-a030-3e380aaf68a8-operator-scripts\") pod \"keystone-2aa5-account-create-update-hwk8n\" (UID: \"3fae0e8f-e6a0-4031-a030-3e380aaf68a8\") " pod="openstack-kuttl-tests/keystone-2aa5-account-create-update-hwk8n" Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.993999 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bn7mm\" (UniqueName: \"kubernetes.io/projected/3fae0e8f-e6a0-4031-a030-3e380aaf68a8-kube-api-access-bn7mm\") pod \"keystone-2aa5-account-create-update-hwk8n\" (UID: \"3fae0e8f-e6a0-4031-a030-3e380aaf68a8\") " pod="openstack-kuttl-tests/keystone-2aa5-account-create-update-hwk8n" Mar 16 17:17:26 crc kubenswrapper[5120]: I0316 17:17:26.995570 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 17:17:26 crc kubenswrapper[5120]: E0316 17:17:26.995673 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Mar 16 17:17:26 crc kubenswrapper[5120]: E0316 17:17:26.995796 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3fae0e8f-e6a0-4031-a030-3e380aaf68a8-operator-scripts podName:3fae0e8f-e6a0-4031-a030-3e380aaf68a8 nodeName:}" failed. No retries permitted until 2026-03-16 17:17:27.495734624 +0000 UTC m=+6349.649666281 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/3fae0e8f-e6a0-4031-a030-3e380aaf68a8-operator-scripts") pod "keystone-2aa5-account-create-update-hwk8n" (UID: "3fae0e8f-e6a0-4031-a030-3e380aaf68a8") : configmap "openstack-scripts" not found Mar 16 17:17:27 crc kubenswrapper[5120]: E0316 17:17:27.001019 5120 projected.go:194] Error preparing data for projected volume kube-api-access-bn7mm for pod openstack-kuttl-tests/keystone-2aa5-account-create-update-hwk8n: failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 17:17:27 crc kubenswrapper[5120]: E0316 17:17:27.001092 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3fae0e8f-e6a0-4031-a030-3e380aaf68a8-kube-api-access-bn7mm podName:3fae0e8f-e6a0-4031-a030-3e380aaf68a8 nodeName:}" failed. No retries permitted until 2026-03-16 17:17:27.50107544 +0000 UTC m=+6349.655007087 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-bn7mm" (UniqueName: "kubernetes.io/projected/3fae0e8f-e6a0-4031-a030-3e380aaf68a8-kube-api-access-bn7mm") pod "keystone-2aa5-account-create-update-hwk8n" (UID: "3fae0e8f-e6a0-4031-a030-3e380aaf68a8") : failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 17:17:27 crc kubenswrapper[5120]: I0316 17:17:27.035887 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-db-create-kn6wh"] Mar 16 17:17:27 crc kubenswrapper[5120]: I0316 17:17:27.059402 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-xbcxw"] Mar 16 17:17:27 crc kubenswrapper[5120]: E0316 17:17:27.061442 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="bd045fa777b0ca425826b20941db498f3c9fc6247b98751b1ce64168b1b98e09" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 17:17:27 crc kubenswrapper[5120]: E0316 17:17:27.066753 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="bd045fa777b0ca425826b20941db498f3c9fc6247b98751b1ce64168b1b98e09" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 17:17:27 crc kubenswrapper[5120]: E0316 17:17:27.095966 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="bd045fa777b0ca425826b20941db498f3c9fc6247b98751b1ce64168b1b98e09" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 17:17:27 crc kubenswrapper[5120]: E0316 17:17:27.096058 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="71a73270-e23b-42a7-a1f4-ad174eab2ac7" containerName="nova-cell1-conductor-conductor" probeResult="unknown" Mar 16 17:17:27 crc kubenswrapper[5120]: I0316 17:17:27.139693 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/nova-metadata-0" podUID="a9215705-d766-4151-b079-62d304603586" containerName="nova-metadata-log" probeResult="failure" output="Get \"https://10.217.0.211:8775/\": read tcp 10.217.0.2:58346->10.217.0.211:8775: read: connection reset by peer" Mar 16 17:17:27 crc kubenswrapper[5120]: I0316 17:17:27.140310 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/nova-metadata-0" podUID="a9215705-d766-4151-b079-62d304603586" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"https://10.217.0.211:8775/\": read tcp 10.217.0.2:58348->10.217.0.211:8775: read: connection reset by peer" Mar 16 17:17:27 crc kubenswrapper[5120]: I0316 17:17:27.279792 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-5b49d5d76-5r44p" podUID="c2e33bc1-ee7f-461d-9faa-b5678f7cb416" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.0.169:9311/healthcheck\": read tcp 10.217.0.2:58626->10.217.0.169:9311: read: connection reset by peer" Mar 16 17:17:27 crc kubenswrapper[5120]: I0316 17:17:27.280067 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-5b49d5d76-5r44p" podUID="c2e33bc1-ee7f-461d-9faa-b5678f7cb416" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.0.169:9311/healthcheck\": read tcp 10.217.0.2:58614->10.217.0.169:9311: read: connection reset by peer" Mar 16 17:17:27 crc kubenswrapper[5120]: I0316 17:17:27.402139 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/openstack-galera-0" podUID="0498c744-8606-4b08-b69f-28f80006c19c" containerName="galera" containerID="cri-o://6b1f38a50b1d436dc0420e3d24bcc3505027e09db725d3244026d9aa3d1d44bd" gracePeriod=30 Mar 16 17:17:27 crc kubenswrapper[5120]: I0316 17:17:27.498793 5120 generic.go:358] "Generic (PLEG): container finished" podID="62f72752-1070-4856-aec8-5d8c07039d97" containerID="06604bb2c03297dccc451cd8484387f58b33faae3ce7c0addf37f2c72a32bbd0" exitCode=0 Mar 16 17:17:27 crc kubenswrapper[5120]: I0316 17:17:27.498830 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"62f72752-1070-4856-aec8-5d8c07039d97","Type":"ContainerDied","Data":"06604bb2c03297dccc451cd8484387f58b33faae3ce7c0addf37f2c72a32bbd0"} Mar 16 17:17:27 crc kubenswrapper[5120]: I0316 17:17:27.500836 5120 generic.go:358] "Generic (PLEG): container finished" podID="ef7c6f1d-0e78-43bf-99c4-9200f5e67136" containerID="1d86c8a64a5053fae6269345960dc10f867eed9fabe6851c22755daab8918cf7" exitCode=0 Mar 16 17:17:27 crc kubenswrapper[5120]: I0316 17:17:27.500990 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"ef7c6f1d-0e78-43bf-99c4-9200f5e67136","Type":"ContainerDied","Data":"1d86c8a64a5053fae6269345960dc10f867eed9fabe6851c22755daab8918cf7"} Mar 16 17:17:27 crc kubenswrapper[5120]: I0316 17:17:27.504682 5120 generic.go:358] "Generic (PLEG): container finished" podID="a1dfcf19-aecf-49e7-9024-2e8b517fecfb" containerID="225427a7164236eebc876d896eb6bae3e01836e1b1bbff01894a12e5711cbebe" exitCode=0 Mar 16 17:17:27 crc kubenswrapper[5120]: I0316 17:17:27.504965 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"a1dfcf19-aecf-49e7-9024-2e8b517fecfb","Type":"ContainerDied","Data":"225427a7164236eebc876d896eb6bae3e01836e1b1bbff01894a12e5711cbebe"} Mar 16 17:17:27 crc kubenswrapper[5120]: I0316 17:17:27.508404 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bn7mm\" (UniqueName: \"kubernetes.io/projected/3fae0e8f-e6a0-4031-a030-3e380aaf68a8-kube-api-access-bn7mm\") pod \"keystone-2aa5-account-create-update-hwk8n\" (UID: \"3fae0e8f-e6a0-4031-a030-3e380aaf68a8\") " pod="openstack-kuttl-tests/keystone-2aa5-account-create-update-hwk8n" Mar 16 17:17:27 crc kubenswrapper[5120]: I0316 17:17:27.509080 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3fae0e8f-e6a0-4031-a030-3e380aaf68a8-operator-scripts\") pod \"keystone-2aa5-account-create-update-hwk8n\" (UID: \"3fae0e8f-e6a0-4031-a030-3e380aaf68a8\") " pod="openstack-kuttl-tests/keystone-2aa5-account-create-update-hwk8n" Mar 16 17:17:27 crc kubenswrapper[5120]: E0316 17:17:27.509235 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Mar 16 17:17:27 crc kubenswrapper[5120]: E0316 17:17:27.509684 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3fae0e8f-e6a0-4031-a030-3e380aaf68a8-operator-scripts podName:3fae0e8f-e6a0-4031-a030-3e380aaf68a8 nodeName:}" failed. No retries permitted until 2026-03-16 17:17:28.509638124 +0000 UTC m=+6350.663569781 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/3fae0e8f-e6a0-4031-a030-3e380aaf68a8-operator-scripts") pod "keystone-2aa5-account-create-update-hwk8n" (UID: "3fae0e8f-e6a0-4031-a030-3e380aaf68a8") : configmap "openstack-scripts" not found Mar 16 17:17:27 crc kubenswrapper[5120]: E0316 17:17:27.511628 5120 projected.go:194] Error preparing data for projected volume kube-api-access-bn7mm for pod openstack-kuttl-tests/keystone-2aa5-account-create-update-hwk8n: failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 17:17:27 crc kubenswrapper[5120]: E0316 17:17:27.511730 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3fae0e8f-e6a0-4031-a030-3e380aaf68a8-kube-api-access-bn7mm podName:3fae0e8f-e6a0-4031-a030-3e380aaf68a8 nodeName:}" failed. No retries permitted until 2026-03-16 17:17:28.51170585 +0000 UTC m=+6350.665637507 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-bn7mm" (UniqueName: "kubernetes.io/projected/3fae0e8f-e6a0-4031-a030-3e380aaf68a8-kube-api-access-bn7mm") pod "keystone-2aa5-account-create-update-hwk8n" (UID: "3fae0e8f-e6a0-4031-a030-3e380aaf68a8") : failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 17:17:27 crc kubenswrapper[5120]: E0316 17:17:27.514622 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 225427a7164236eebc876d896eb6bae3e01836e1b1bbff01894a12e5711cbebe is running failed: container process not found" containerID="225427a7164236eebc876d896eb6bae3e01836e1b1bbff01894a12e5711cbebe" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 17:17:27 crc kubenswrapper[5120]: E0316 17:17:27.515957 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 225427a7164236eebc876d896eb6bae3e01836e1b1bbff01894a12e5711cbebe is running failed: container process not found" containerID="225427a7164236eebc876d896eb6bae3e01836e1b1bbff01894a12e5711cbebe" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 17:17:27 crc kubenswrapper[5120]: I0316 17:17:27.515972 5120 generic.go:358] "Generic (PLEG): container finished" podID="05faed40-e1aa-44be-bae7-49459da3dc79" containerID="0703b4acaf71ddbc1f33326a39f35c524a08ac0a4c5efa84ac95c95a07ef24b8" exitCode=0 Mar 16 17:17:27 crc kubenswrapper[5120]: I0316 17:17:27.516366 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-5r7xg" event={"ID":"05faed40-e1aa-44be-bae7-49459da3dc79","Type":"ContainerDied","Data":"0703b4acaf71ddbc1f33326a39f35c524a08ac0a4c5efa84ac95c95a07ef24b8"} Mar 16 17:17:27 crc kubenswrapper[5120]: E0316 17:17:27.518652 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 225427a7164236eebc876d896eb6bae3e01836e1b1bbff01894a12e5711cbebe is running failed: container process not found" containerID="225427a7164236eebc876d896eb6bae3e01836e1b1bbff01894a12e5711cbebe" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 17:17:27 crc kubenswrapper[5120]: E0316 17:17:27.518728 5120 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 225427a7164236eebc876d896eb6bae3e01836e1b1bbff01894a12e5711cbebe is running failed: container process not found" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="a1dfcf19-aecf-49e7-9024-2e8b517fecfb" containerName="nova-scheduler-scheduler" probeResult="unknown" Mar 16 17:17:27 crc kubenswrapper[5120]: I0316 17:17:27.530528 5120 generic.go:358] "Generic (PLEG): container finished" podID="57e08e60-42d1-4b58-9892-c2aa5bbae2cf" containerID="6d193e9b3e72813100bb0dd0568015bdb73ff4460f0f8eabcee9b6e240ce5d85" exitCode=0 Mar 16 17:17:27 crc kubenswrapper[5120]: I0316 17:17:27.530699 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"57e08e60-42d1-4b58-9892-c2aa5bbae2cf","Type":"ContainerDied","Data":"6d193e9b3e72813100bb0dd0568015bdb73ff4460f0f8eabcee9b6e240ce5d85"} Mar 16 17:17:27 crc kubenswrapper[5120]: I0316 17:17:27.564077 5120 generic.go:358] "Generic (PLEG): container finished" podID="d14c3978-d254-4ec4-baa0-f011eaef745e" containerID="64455790d468e852fe6069aaee149c1ccbf41669030eb68f8c6c996c4885896e" exitCode=0 Mar 16 17:17:27 crc kubenswrapper[5120]: I0316 17:17:27.564229 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"d14c3978-d254-4ec4-baa0-f011eaef745e","Type":"ContainerDied","Data":"64455790d468e852fe6069aaee149c1ccbf41669030eb68f8c6c996c4885896e"} Mar 16 17:17:27 crc kubenswrapper[5120]: I0316 17:17:27.571469 5120 generic.go:358] "Generic (PLEG): container finished" podID="1976af1c-93c9-487c-9852-752bb5c1234d" containerID="c5fef62b06d8256f82c76b40b8a78f4431b6cbe5fe68d35ce041bf7aec63df7c" exitCode=0 Mar 16 17:17:27 crc kubenswrapper[5120]: I0316 17:17:27.571597 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-5b79cc5b54-db2hd" event={"ID":"1976af1c-93c9-487c-9852-752bb5c1234d","Type":"ContainerDied","Data":"c5fef62b06d8256f82c76b40b8a78f4431b6cbe5fe68d35ce041bf7aec63df7c"} Mar 16 17:17:27 crc kubenswrapper[5120]: I0316 17:17:27.571626 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-5b79cc5b54-db2hd" event={"ID":"1976af1c-93c9-487c-9852-752bb5c1234d","Type":"ContainerDied","Data":"ad6f86260c58d0c55204ba9d3f79d3e45fd23f6705dd17f068d7c0f6ab2439b8"} Mar 16 17:17:27 crc kubenswrapper[5120]: I0316 17:17:27.571636 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ad6f86260c58d0c55204ba9d3f79d3e45fd23f6705dd17f068d7c0f6ab2439b8" Mar 16 17:17:27 crc kubenswrapper[5120]: I0316 17:17:27.585865 5120 generic.go:358] "Generic (PLEG): container finished" podID="a9215705-d766-4151-b079-62d304603586" containerID="e3755f35f9a681410c6077b20fb86fa8d207825ea9e789bf539fe7e07f0d9847" exitCode=0 Mar 16 17:17:27 crc kubenswrapper[5120]: I0316 17:17:27.585966 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"a9215705-d766-4151-b079-62d304603586","Type":"ContainerDied","Data":"e3755f35f9a681410c6077b20fb86fa8d207825ea9e789bf539fe7e07f0d9847"} Mar 16 17:17:27 crc kubenswrapper[5120]: I0316 17:17:27.592195 5120 generic.go:358] "Generic (PLEG): container finished" podID="cb2bdc0a-77bc-488e-b188-7b24ac191d5a" containerID="929557ee53c06ee6a62396db9c05cee3c027bea6a01f146959a43bff603e7e02" exitCode=0 Mar 16 17:17:27 crc kubenswrapper[5120]: I0316 17:17:27.592322 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"cb2bdc0a-77bc-488e-b188-7b24ac191d5a","Type":"ContainerDied","Data":"929557ee53c06ee6a62396db9c05cee3c027bea6a01f146959a43bff603e7e02"} Mar 16 17:17:27 crc kubenswrapper[5120]: I0316 17:17:27.595902 5120 generic.go:358] "Generic (PLEG): container finished" podID="bb48cc0c-a6cd-4fc7-9599-1ed43e3eb216" containerID="908c72eb1629fa11a71f6778174b3a20818464a6614bf7943723c08961af3886" exitCode=0 Mar 16 17:17:27 crc kubenswrapper[5120]: I0316 17:17:27.595948 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"bb48cc0c-a6cd-4fc7-9599-1ed43e3eb216","Type":"ContainerDied","Data":"908c72eb1629fa11a71f6778174b3a20818464a6614bf7943723c08961af3886"} Mar 16 17:17:27 crc kubenswrapper[5120]: I0316 17:17:27.600557 5120 generic.go:358] "Generic (PLEG): container finished" podID="c2e33bc1-ee7f-461d-9faa-b5678f7cb416" containerID="94b5a95d3401ba6aca2c4eea6b8e4a63e4758571456a4be6ec2da46ee9dfd215" exitCode=0 Mar 16 17:17:27 crc kubenswrapper[5120]: I0316 17:17:27.600689 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-5b49d5d76-5r44p" event={"ID":"c2e33bc1-ee7f-461d-9faa-b5678f7cb416","Type":"ContainerDied","Data":"94b5a95d3401ba6aca2c4eea6b8e4a63e4758571456a4be6ec2da46ee9dfd215"} Mar 16 17:17:27 crc kubenswrapper[5120]: E0316 17:17:27.946434 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 908c72eb1629fa11a71f6778174b3a20818464a6614bf7943723c08961af3886 is running failed: container process not found" containerID="908c72eb1629fa11a71f6778174b3a20818464a6614bf7943723c08961af3886" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 17:17:27 crc kubenswrapper[5120]: E0316 17:17:27.947290 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 908c72eb1629fa11a71f6778174b3a20818464a6614bf7943723c08961af3886 is running failed: container process not found" containerID="908c72eb1629fa11a71f6778174b3a20818464a6614bf7943723c08961af3886" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 17:17:27 crc kubenswrapper[5120]: E0316 17:17:27.948751 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 908c72eb1629fa11a71f6778174b3a20818464a6614bf7943723c08961af3886 is running failed: container process not found" containerID="908c72eb1629fa11a71f6778174b3a20818464a6614bf7943723c08961af3886" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 17:17:27 crc kubenswrapper[5120]: E0316 17:17:27.948803 5120 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 908c72eb1629fa11a71f6778174b3a20818464a6614bf7943723c08961af3886 is running failed: container process not found" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="bb48cc0c-a6cd-4fc7-9599-1ed43e3eb216" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.032648 5120 scope.go:117] "RemoveContainer" containerID="bf112b12ea9fcf672dfef9c231fc9ff0ad24272de8f0ee8e3b3d3f8056137682" Mar 16 17:17:28 crc kubenswrapper[5120]: E0316 17:17:28.120163 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-bn7mm operator-scripts], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openstack-kuttl-tests/keystone-2aa5-account-create-update-hwk8n" podUID="3fae0e8f-e6a0-4031-a030-3e380aaf68a8" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.152602 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-5b79cc5b54-db2hd" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.154355 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-proxy-5749bb5d-544mw"] Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.167247 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-4ea4-account-create-update-tp4sf" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.170397 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.170579 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.170717 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/swift-proxy-5749bb5d-544mw"] Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.204390 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.218170 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.233501 5120 scope.go:117] "RemoveContainer" containerID="fdf02cc413ba820b43576d699f107caa1ca5ce3be93360df557fd570bbf0baa7" Mar 16 17:17:28 crc kubenswrapper[5120]: E0316 17:17:28.234619 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fdf02cc413ba820b43576d699f107caa1ca5ce3be93360df557fd570bbf0baa7\": container with ID starting with fdf02cc413ba820b43576d699f107caa1ca5ce3be93360df557fd570bbf0baa7 not found: ID does not exist" containerID="fdf02cc413ba820b43576d699f107caa1ca5ce3be93360df557fd570bbf0baa7" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.234657 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fdf02cc413ba820b43576d699f107caa1ca5ce3be93360df557fd570bbf0baa7"} err="failed to get container status \"fdf02cc413ba820b43576d699f107caa1ca5ce3be93360df557fd570bbf0baa7\": rpc error: code = NotFound desc = could not find container \"fdf02cc413ba820b43576d699f107caa1ca5ce3be93360df557fd570bbf0baa7\": container with ID starting with fdf02cc413ba820b43576d699f107caa1ca5ce3be93360df557fd570bbf0baa7 not found: ID does not exist" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.234681 5120 scope.go:117] "RemoveContainer" containerID="bf112b12ea9fcf672dfef9c231fc9ff0ad24272de8f0ee8e3b3d3f8056137682" Mar 16 17:17:28 crc kubenswrapper[5120]: E0316 17:17:28.243108 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf112b12ea9fcf672dfef9c231fc9ff0ad24272de8f0ee8e3b3d3f8056137682\": container with ID starting with bf112b12ea9fcf672dfef9c231fc9ff0ad24272de8f0ee8e3b3d3f8056137682 not found: ID does not exist" containerID="bf112b12ea9fcf672dfef9c231fc9ff0ad24272de8f0ee8e3b3d3f8056137682" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.243149 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf112b12ea9fcf672dfef9c231fc9ff0ad24272de8f0ee8e3b3d3f8056137682"} err="failed to get container status \"bf112b12ea9fcf672dfef9c231fc9ff0ad24272de8f0ee8e3b3d3f8056137682\": rpc error: code = NotFound desc = could not find container \"bf112b12ea9fcf672dfef9c231fc9ff0ad24272de8f0ee8e3b3d3f8056137682\": container with ID starting with bf112b12ea9fcf672dfef9c231fc9ff0ad24272de8f0ee8e3b3d3f8056137682 not found: ID does not exist" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.243169 5120 scope.go:117] "RemoveContainer" containerID="fdf02cc413ba820b43576d699f107caa1ca5ce3be93360df557fd570bbf0baa7" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.243714 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fdf02cc413ba820b43576d699f107caa1ca5ce3be93360df557fd570bbf0baa7"} err="failed to get container status \"fdf02cc413ba820b43576d699f107caa1ca5ce3be93360df557fd570bbf0baa7\": rpc error: code = NotFound desc = could not find container \"fdf02cc413ba820b43576d699f107caa1ca5ce3be93360df557fd570bbf0baa7\": container with ID starting with fdf02cc413ba820b43576d699f107caa1ca5ce3be93360df557fd570bbf0baa7 not found: ID does not exist" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.243801 5120 scope.go:117] "RemoveContainer" containerID="bf112b12ea9fcf672dfef9c231fc9ff0ad24272de8f0ee8e3b3d3f8056137682" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.244131 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf112b12ea9fcf672dfef9c231fc9ff0ad24272de8f0ee8e3b3d3f8056137682"} err="failed to get container status \"bf112b12ea9fcf672dfef9c231fc9ff0ad24272de8f0ee8e3b3d3f8056137682\": rpc error: code = NotFound desc = could not find container \"bf112b12ea9fcf672dfef9c231fc9ff0ad24272de8f0ee8e3b3d3f8056137682\": container with ID starting with bf112b12ea9fcf672dfef9c231fc9ff0ad24272de8f0ee8e3b3d3f8056137682 not found: ID does not exist" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.248536 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1976af1c-93c9-487c-9852-752bb5c1234d-config-data\") pod \"1976af1c-93c9-487c-9852-752bb5c1234d\" (UID: \"1976af1c-93c9-487c-9852-752bb5c1234d\") " Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.248613 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f8v9n\" (UniqueName: \"kubernetes.io/projected/1976af1c-93c9-487c-9852-752bb5c1234d-kube-api-access-f8v9n\") pod \"1976af1c-93c9-487c-9852-752bb5c1234d\" (UID: \"1976af1c-93c9-487c-9852-752bb5c1234d\") " Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.249891 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a1dfcf19-aecf-49e7-9024-2e8b517fecfb-combined-ca-bundle\") pod \"a1dfcf19-aecf-49e7-9024-2e8b517fecfb\" (UID: \"a1dfcf19-aecf-49e7-9024-2e8b517fecfb\") " Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.249929 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/57e08e60-42d1-4b58-9892-c2aa5bbae2cf-scripts\") pod \"57e08e60-42d1-4b58-9892-c2aa5bbae2cf\" (UID: \"57e08e60-42d1-4b58-9892-c2aa5bbae2cf\") " Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.249996 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a1dfcf19-aecf-49e7-9024-2e8b517fecfb-config-data\") pod \"a1dfcf19-aecf-49e7-9024-2e8b517fecfb\" (UID: \"a1dfcf19-aecf-49e7-9024-2e8b517fecfb\") " Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.250053 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/1976af1c-93c9-487c-9852-752bb5c1234d-internal-tls-certs\") pod \"1976af1c-93c9-487c-9852-752bb5c1234d\" (UID: \"1976af1c-93c9-487c-9852-752bb5c1234d\") " Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.250085 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/57e08e60-42d1-4b58-9892-c2aa5bbae2cf-combined-ca-bundle\") pod \"57e08e60-42d1-4b58-9892-c2aa5bbae2cf\" (UID: \"57e08e60-42d1-4b58-9892-c2aa5bbae2cf\") " Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.250158 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/1976af1c-93c9-487c-9852-752bb5c1234d-logs\") pod \"1976af1c-93c9-487c-9852-752bb5c1234d\" (UID: \"1976af1c-93c9-487c-9852-752bb5c1234d\") " Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.250231 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1976af1c-93c9-487c-9852-752bb5c1234d-combined-ca-bundle\") pod \"1976af1c-93c9-487c-9852-752bb5c1234d\" (UID: \"1976af1c-93c9-487c-9852-752bb5c1234d\") " Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.250308 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s7mbw\" (UniqueName: \"kubernetes.io/projected/a1dfcf19-aecf-49e7-9024-2e8b517fecfb-kube-api-access-s7mbw\") pod \"a1dfcf19-aecf-49e7-9024-2e8b517fecfb\" (UID: \"a1dfcf19-aecf-49e7-9024-2e8b517fecfb\") " Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.250341 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/1976af1c-93c9-487c-9852-752bb5c1234d-public-tls-certs\") pod \"1976af1c-93c9-487c-9852-752bb5c1234d\" (UID: \"1976af1c-93c9-487c-9852-752bb5c1234d\") " Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.250376 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1976af1c-93c9-487c-9852-752bb5c1234d-scripts\") pod \"1976af1c-93c9-487c-9852-752bb5c1234d\" (UID: \"1976af1c-93c9-487c-9852-752bb5c1234d\") " Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.250421 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cqnfg\" (UniqueName: \"kubernetes.io/projected/0a59e429-ba97-491f-91d4-9b1b063fc15b-kube-api-access-cqnfg\") pod \"0a59e429-ba97-491f-91d4-9b1b063fc15b\" (UID: \"0a59e429-ba97-491f-91d4-9b1b063fc15b\") " Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.250457 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/57e08e60-42d1-4b58-9892-c2aa5bbae2cf-config-data\") pod \"57e08e60-42d1-4b58-9892-c2aa5bbae2cf\" (UID: \"57e08e60-42d1-4b58-9892-c2aa5bbae2cf\") " Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.250618 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qrwbk\" (UniqueName: \"kubernetes.io/projected/57e08e60-42d1-4b58-9892-c2aa5bbae2cf-kube-api-access-qrwbk\") pod \"57e08e60-42d1-4b58-9892-c2aa5bbae2cf\" (UID: \"57e08e60-42d1-4b58-9892-c2aa5bbae2cf\") " Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.250644 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/57e08e60-42d1-4b58-9892-c2aa5bbae2cf-etc-machine-id\") pod \"57e08e60-42d1-4b58-9892-c2aa5bbae2cf\" (UID: \"57e08e60-42d1-4b58-9892-c2aa5bbae2cf\") " Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.250707 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0a59e429-ba97-491f-91d4-9b1b063fc15b-operator-scripts\") pod \"0a59e429-ba97-491f-91d4-9b1b063fc15b\" (UID: \"0a59e429-ba97-491f-91d4-9b1b063fc15b\") " Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.250845 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/57e08e60-42d1-4b58-9892-c2aa5bbae2cf-config-data-custom\") pod \"57e08e60-42d1-4b58-9892-c2aa5bbae2cf\" (UID: \"57e08e60-42d1-4b58-9892-c2aa5bbae2cf\") " Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.260564 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1976af1c-93c9-487c-9852-752bb5c1234d-kube-api-access-f8v9n" (OuterVolumeSpecName: "kube-api-access-f8v9n") pod "1976af1c-93c9-487c-9852-752bb5c1234d" (UID: "1976af1c-93c9-487c-9852-752bb5c1234d"). InnerVolumeSpecName "kube-api-access-f8v9n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.263639 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/57e08e60-42d1-4b58-9892-c2aa5bbae2cf-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "57e08e60-42d1-4b58-9892-c2aa5bbae2cf" (UID: "57e08e60-42d1-4b58-9892-c2aa5bbae2cf"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.264178 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0a59e429-ba97-491f-91d4-9b1b063fc15b-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "0a59e429-ba97-491f-91d4-9b1b063fc15b" (UID: "0a59e429-ba97-491f-91d4-9b1b063fc15b"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.265803 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1976af1c-93c9-487c-9852-752bb5c1234d-logs" (OuterVolumeSpecName: "logs") pod "1976af1c-93c9-487c-9852-752bb5c1234d" (UID: "1976af1c-93c9-487c-9852-752bb5c1234d"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.298306 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/57e08e60-42d1-4b58-9892-c2aa5bbae2cf-scripts" (OuterVolumeSpecName: "scripts") pod "57e08e60-42d1-4b58-9892-c2aa5bbae2cf" (UID: "57e08e60-42d1-4b58-9892-c2aa5bbae2cf"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.301915 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1dfcf19-aecf-49e7-9024-2e8b517fecfb-kube-api-access-s7mbw" (OuterVolumeSpecName: "kube-api-access-s7mbw") pod "a1dfcf19-aecf-49e7-9024-2e8b517fecfb" (UID: "a1dfcf19-aecf-49e7-9024-2e8b517fecfb"). InnerVolumeSpecName "kube-api-access-s7mbw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.302536 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1976af1c-93c9-487c-9852-752bb5c1234d-scripts" (OuterVolumeSpecName: "scripts") pod "1976af1c-93c9-487c-9852-752bb5c1234d" (UID: "1976af1c-93c9-487c-9852-752bb5c1234d"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.315459 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/57e08e60-42d1-4b58-9892-c2aa5bbae2cf-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "57e08e60-42d1-4b58-9892-c2aa5bbae2cf" (UID: "57e08e60-42d1-4b58-9892-c2aa5bbae2cf"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.315740 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57e08e60-42d1-4b58-9892-c2aa5bbae2cf-kube-api-access-qrwbk" (OuterVolumeSpecName: "kube-api-access-qrwbk") pod "57e08e60-42d1-4b58-9892-c2aa5bbae2cf" (UID: "57e08e60-42d1-4b58-9892-c2aa5bbae2cf"). InnerVolumeSpecName "kube-api-access-qrwbk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.320974 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a59e429-ba97-491f-91d4-9b1b063fc15b-kube-api-access-cqnfg" (OuterVolumeSpecName: "kube-api-access-cqnfg") pod "0a59e429-ba97-491f-91d4-9b1b063fc15b" (UID: "0a59e429-ba97-491f-91d4-9b1b063fc15b"). InnerVolumeSpecName "kube-api-access-cqnfg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.344629 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.352387 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.354523 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9rp5n\" (UniqueName: \"kubernetes.io/projected/d14c3978-d254-4ec4-baa0-f011eaef745e-kube-api-access-9rp5n\") pod \"d14c3978-d254-4ec4-baa0-f011eaef745e\" (UID: \"d14c3978-d254-4ec4-baa0-f011eaef745e\") " Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.354927 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d14c3978-d254-4ec4-baa0-f011eaef745e-logs\") pod \"d14c3978-d254-4ec4-baa0-f011eaef745e\" (UID: \"d14c3978-d254-4ec4-baa0-f011eaef745e\") " Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.355158 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/d14c3978-d254-4ec4-baa0-f011eaef745e-etc-machine-id\") pod \"d14c3978-d254-4ec4-baa0-f011eaef745e\" (UID: \"d14c3978-d254-4ec4-baa0-f011eaef745e\") " Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.355572 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/d14c3978-d254-4ec4-baa0-f011eaef745e-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "d14c3978-d254-4ec4-baa0-f011eaef745e" (UID: "d14c3978-d254-4ec4-baa0-f011eaef745e"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.355710 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d14c3978-d254-4ec4-baa0-f011eaef745e-combined-ca-bundle\") pod \"d14c3978-d254-4ec4-baa0-f011eaef745e\" (UID: \"d14c3978-d254-4ec4-baa0-f011eaef745e\") " Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.356060 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d14c3978-d254-4ec4-baa0-f011eaef745e-config-data\") pod \"d14c3978-d254-4ec4-baa0-f011eaef745e\" (UID: \"d14c3978-d254-4ec4-baa0-f011eaef745e\") " Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.356178 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bb48cc0c-a6cd-4fc7-9599-1ed43e3eb216-combined-ca-bundle\") pod \"bb48cc0c-a6cd-4fc7-9599-1ed43e3eb216\" (UID: \"bb48cc0c-a6cd-4fc7-9599-1ed43e3eb216\") " Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.356493 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bb48cc0c-a6cd-4fc7-9599-1ed43e3eb216-config-data\") pod \"bb48cc0c-a6cd-4fc7-9599-1ed43e3eb216\" (UID: \"bb48cc0c-a6cd-4fc7-9599-1ed43e3eb216\") " Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.356624 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nm64w\" (UniqueName: \"kubernetes.io/projected/bb48cc0c-a6cd-4fc7-9599-1ed43e3eb216-kube-api-access-nm64w\") pod \"bb48cc0c-a6cd-4fc7-9599-1ed43e3eb216\" (UID: \"bb48cc0c-a6cd-4fc7-9599-1ed43e3eb216\") " Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.356828 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d14c3978-d254-4ec4-baa0-f011eaef745e-scripts\") pod \"d14c3978-d254-4ec4-baa0-f011eaef745e\" (UID: \"d14c3978-d254-4ec4-baa0-f011eaef745e\") " Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.357057 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/d14c3978-d254-4ec4-baa0-f011eaef745e-public-tls-certs\") pod \"d14c3978-d254-4ec4-baa0-f011eaef745e\" (UID: \"d14c3978-d254-4ec4-baa0-f011eaef745e\") " Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.357339 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/d14c3978-d254-4ec4-baa0-f011eaef745e-internal-tls-certs\") pod \"d14c3978-d254-4ec4-baa0-f011eaef745e\" (UID: \"d14c3978-d254-4ec4-baa0-f011eaef745e\") " Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.357955 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d14c3978-d254-4ec4-baa0-f011eaef745e-logs" (OuterVolumeSpecName: "logs") pod "d14c3978-d254-4ec4-baa0-f011eaef745e" (UID: "d14c3978-d254-4ec4-baa0-f011eaef745e"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.358194 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/d14c3978-d254-4ec4-baa0-f011eaef745e-config-data-custom\") pod \"d14c3978-d254-4ec4-baa0-f011eaef745e\" (UID: \"d14c3978-d254-4ec4-baa0-f011eaef745e\") " Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.362847 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d14c3978-d254-4ec4-baa0-f011eaef745e-logs\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.362890 5120 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/d14c3978-d254-4ec4-baa0-f011eaef745e-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.362905 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/1976af1c-93c9-487c-9852-752bb5c1234d-logs\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.362918 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s7mbw\" (UniqueName: \"kubernetes.io/projected/a1dfcf19-aecf-49e7-9024-2e8b517fecfb-kube-api-access-s7mbw\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.362930 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1976af1c-93c9-487c-9852-752bb5c1234d-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.362942 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cqnfg\" (UniqueName: \"kubernetes.io/projected/0a59e429-ba97-491f-91d4-9b1b063fc15b-kube-api-access-cqnfg\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.362954 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qrwbk\" (UniqueName: \"kubernetes.io/projected/57e08e60-42d1-4b58-9892-c2aa5bbae2cf-kube-api-access-qrwbk\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.362971 5120 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/57e08e60-42d1-4b58-9892-c2aa5bbae2cf-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.369698 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0a59e429-ba97-491f-91d4-9b1b063fc15b-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.369721 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/57e08e60-42d1-4b58-9892-c2aa5bbae2cf-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.371032 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f8v9n\" (UniqueName: \"kubernetes.io/projected/1976af1c-93c9-487c-9852-752bb5c1234d-kube-api-access-f8v9n\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.371049 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/57e08e60-42d1-4b58-9892-c2aa5bbae2cf-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.406121 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.433000 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d14c3978-d254-4ec4-baa0-f011eaef745e-kube-api-access-9rp5n" (OuterVolumeSpecName: "kube-api-access-9rp5n") pod "d14c3978-d254-4ec4-baa0-f011eaef745e" (UID: "d14c3978-d254-4ec4-baa0-f011eaef745e"). InnerVolumeSpecName "kube-api-access-9rp5n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.435345 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d14c3978-d254-4ec4-baa0-f011eaef745e-scripts" (OuterVolumeSpecName: "scripts") pod "d14c3978-d254-4ec4-baa0-f011eaef745e" (UID: "d14c3978-d254-4ec4-baa0-f011eaef745e"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.439005 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb48cc0c-a6cd-4fc7-9599-1ed43e3eb216-kube-api-access-nm64w" (OuterVolumeSpecName: "kube-api-access-nm64w") pod "bb48cc0c-a6cd-4fc7-9599-1ed43e3eb216" (UID: "bb48cc0c-a6cd-4fc7-9599-1ed43e3eb216"). InnerVolumeSpecName "kube-api-access-nm64w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.441934 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d14c3978-d254-4ec4-baa0-f011eaef745e-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "d14c3978-d254-4ec4-baa0-f011eaef745e" (UID: "d14c3978-d254-4ec4-baa0-f011eaef745e"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.476468 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"cb2bdc0a-77bc-488e-b188-7b24ac191d5a\" (UID: \"cb2bdc0a-77bc-488e-b188-7b24ac191d5a\") " Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.477310 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/cb2bdc0a-77bc-488e-b188-7b24ac191d5a-internal-tls-certs\") pod \"cb2bdc0a-77bc-488e-b188-7b24ac191d5a\" (UID: \"cb2bdc0a-77bc-488e-b188-7b24ac191d5a\") " Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.477357 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/cb2bdc0a-77bc-488e-b188-7b24ac191d5a-logs\") pod \"cb2bdc0a-77bc-488e-b188-7b24ac191d5a\" (UID: \"cb2bdc0a-77bc-488e-b188-7b24ac191d5a\") " Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.477402 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cb2bdc0a-77bc-488e-b188-7b24ac191d5a-combined-ca-bundle\") pod \"cb2bdc0a-77bc-488e-b188-7b24ac191d5a\" (UID: \"cb2bdc0a-77bc-488e-b188-7b24ac191d5a\") " Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.477535 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cb2bdc0a-77bc-488e-b188-7b24ac191d5a-config-data\") pod \"cb2bdc0a-77bc-488e-b188-7b24ac191d5a\" (UID: \"cb2bdc0a-77bc-488e-b188-7b24ac191d5a\") " Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.477631 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ef7c6f1d-0e78-43bf-99c4-9200f5e67136-config-data\") pod \"ef7c6f1d-0e78-43bf-99c4-9200f5e67136\" (UID: \"ef7c6f1d-0e78-43bf-99c4-9200f5e67136\") " Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.477659 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/cb2bdc0a-77bc-488e-b188-7b24ac191d5a-httpd-run\") pod \"cb2bdc0a-77bc-488e-b188-7b24ac191d5a\" (UID: \"cb2bdc0a-77bc-488e-b188-7b24ac191d5a\") " Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.477739 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9l245\" (UniqueName: \"kubernetes.io/projected/cb2bdc0a-77bc-488e-b188-7b24ac191d5a-kube-api-access-9l245\") pod \"cb2bdc0a-77bc-488e-b188-7b24ac191d5a\" (UID: \"cb2bdc0a-77bc-488e-b188-7b24ac191d5a\") " Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.477886 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/cb2bdc0a-77bc-488e-b188-7b24ac191d5a-scripts\") pod \"cb2bdc0a-77bc-488e-b188-7b24ac191d5a\" (UID: \"cb2bdc0a-77bc-488e-b188-7b24ac191d5a\") " Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.478029 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ef7c6f1d-0e78-43bf-99c4-9200f5e67136-public-tls-certs\") pod \"ef7c6f1d-0e78-43bf-99c4-9200f5e67136\" (UID: \"ef7c6f1d-0e78-43bf-99c4-9200f5e67136\") " Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.478103 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ef7c6f1d-0e78-43bf-99c4-9200f5e67136-combined-ca-bundle\") pod \"ef7c6f1d-0e78-43bf-99c4-9200f5e67136\" (UID: \"ef7c6f1d-0e78-43bf-99c4-9200f5e67136\") " Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.478229 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/ef7c6f1d-0e78-43bf-99c4-9200f5e67136-internal-tls-certs\") pod \"ef7c6f1d-0e78-43bf-99c4-9200f5e67136\" (UID: \"ef7c6f1d-0e78-43bf-99c4-9200f5e67136\") " Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.478287 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zzp26\" (UniqueName: \"kubernetes.io/projected/ef7c6f1d-0e78-43bf-99c4-9200f5e67136-kube-api-access-zzp26\") pod \"ef7c6f1d-0e78-43bf-99c4-9200f5e67136\" (UID: \"ef7c6f1d-0e78-43bf-99c4-9200f5e67136\") " Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.478321 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ef7c6f1d-0e78-43bf-99c4-9200f5e67136-logs\") pod \"ef7c6f1d-0e78-43bf-99c4-9200f5e67136\" (UID: \"ef7c6f1d-0e78-43bf-99c4-9200f5e67136\") " Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.478807 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb2bdc0a-77bc-488e-b188-7b24ac191d5a-logs" (OuterVolumeSpecName: "logs") pod "cb2bdc0a-77bc-488e-b188-7b24ac191d5a" (UID: "cb2bdc0a-77bc-488e-b188-7b24ac191d5a"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.479084 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef7c6f1d-0e78-43bf-99c4-9200f5e67136-logs" (OuterVolumeSpecName: "logs") pod "ef7c6f1d-0e78-43bf-99c4-9200f5e67136" (UID: "ef7c6f1d-0e78-43bf-99c4-9200f5e67136"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.479279 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nm64w\" (UniqueName: \"kubernetes.io/projected/bb48cc0c-a6cd-4fc7-9599-1ed43e3eb216-kube-api-access-nm64w\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.479294 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d14c3978-d254-4ec4-baa0-f011eaef745e-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.479303 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ef7c6f1d-0e78-43bf-99c4-9200f5e67136-logs\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.479313 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/cb2bdc0a-77bc-488e-b188-7b24ac191d5a-logs\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.479322 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/d14c3978-d254-4ec4-baa0-f011eaef745e-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.479332 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9rp5n\" (UniqueName: \"kubernetes.io/projected/d14c3978-d254-4ec4-baa0-f011eaef745e-kube-api-access-9rp5n\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.479838 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb2bdc0a-77bc-488e-b188-7b24ac191d5a-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "cb2bdc0a-77bc-488e-b188-7b24ac191d5a" (UID: "cb2bdc0a-77bc-488e-b188-7b24ac191d5a"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.484047 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage01-crc" (OuterVolumeSpecName: "glance") pod "cb2bdc0a-77bc-488e-b188-7b24ac191d5a" (UID: "cb2bdc0a-77bc-488e-b188-7b24ac191d5a"). InnerVolumeSpecName "local-storage01-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.484047 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb2bdc0a-77bc-488e-b188-7b24ac191d5a-scripts" (OuterVolumeSpecName: "scripts") pod "cb2bdc0a-77bc-488e-b188-7b24ac191d5a" (UID: "cb2bdc0a-77bc-488e-b188-7b24ac191d5a"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.489902 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb2bdc0a-77bc-488e-b188-7b24ac191d5a-kube-api-access-9l245" (OuterVolumeSpecName: "kube-api-access-9l245") pod "cb2bdc0a-77bc-488e-b188-7b24ac191d5a" (UID: "cb2bdc0a-77bc-488e-b188-7b24ac191d5a"). InnerVolumeSpecName "kube-api-access-9l245". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.501973 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef7c6f1d-0e78-43bf-99c4-9200f5e67136-kube-api-access-zzp26" (OuterVolumeSpecName: "kube-api-access-zzp26") pod "ef7c6f1d-0e78-43bf-99c4-9200f5e67136" (UID: "ef7c6f1d-0e78-43bf-99c4-9200f5e67136"). InnerVolumeSpecName "kube-api-access-zzp26". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.535728 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a1dfcf19-aecf-49e7-9024-2e8b517fecfb-config-data" (OuterVolumeSpecName: "config-data") pod "a1dfcf19-aecf-49e7-9024-2e8b517fecfb" (UID: "a1dfcf19-aecf-49e7-9024-2e8b517fecfb"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.563735 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bb48cc0c-a6cd-4fc7-9599-1ed43e3eb216-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "bb48cc0c-a6cd-4fc7-9599-1ed43e3eb216" (UID: "bb48cc0c-a6cd-4fc7-9599-1ed43e3eb216"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.564276 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef7c6f1d-0e78-43bf-99c4-9200f5e67136-config-data" (OuterVolumeSpecName: "config-data") pod "ef7c6f1d-0e78-43bf-99c4-9200f5e67136" (UID: "ef7c6f1d-0e78-43bf-99c4-9200f5e67136"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.564439 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d14c3978-d254-4ec4-baa0-f011eaef745e-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "d14c3978-d254-4ec4-baa0-f011eaef745e" (UID: "d14c3978-d254-4ec4-baa0-f011eaef745e"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.564696 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/57e08e60-42d1-4b58-9892-c2aa5bbae2cf-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "57e08e60-42d1-4b58-9892-c2aa5bbae2cf" (UID: "57e08e60-42d1-4b58-9892-c2aa5bbae2cf"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.571839 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a1dfcf19-aecf-49e7-9024-2e8b517fecfb-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "a1dfcf19-aecf-49e7-9024-2e8b517fecfb" (UID: "a1dfcf19-aecf-49e7-9024-2e8b517fecfb"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.581128 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/62f72752-1070-4856-aec8-5d8c07039d97-combined-ca-bundle\") pod \"62f72752-1070-4856-aec8-5d8c07039d97\" (UID: \"62f72752-1070-4856-aec8-5d8c07039d97\") " Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.581416 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/62f72752-1070-4856-aec8-5d8c07039d97-public-tls-certs\") pod \"62f72752-1070-4856-aec8-5d8c07039d97\" (UID: \"62f72752-1070-4856-aec8-5d8c07039d97\") " Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.581527 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"62f72752-1070-4856-aec8-5d8c07039d97\" (UID: \"62f72752-1070-4856-aec8-5d8c07039d97\") " Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.581669 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/62f72752-1070-4856-aec8-5d8c07039d97-httpd-run\") pod \"62f72752-1070-4856-aec8-5d8c07039d97\" (UID: \"62f72752-1070-4856-aec8-5d8c07039d97\") " Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.581705 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/62f72752-1070-4856-aec8-5d8c07039d97-scripts\") pod \"62f72752-1070-4856-aec8-5d8c07039d97\" (UID: \"62f72752-1070-4856-aec8-5d8c07039d97\") " Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.581857 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/62f72752-1070-4856-aec8-5d8c07039d97-config-data\") pod \"62f72752-1070-4856-aec8-5d8c07039d97\" (UID: \"62f72752-1070-4856-aec8-5d8c07039d97\") " Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.581943 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9bwcm\" (UniqueName: \"kubernetes.io/projected/62f72752-1070-4856-aec8-5d8c07039d97-kube-api-access-9bwcm\") pod \"62f72752-1070-4856-aec8-5d8c07039d97\" (UID: \"62f72752-1070-4856-aec8-5d8c07039d97\") " Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.582067 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/62f72752-1070-4856-aec8-5d8c07039d97-logs\") pod \"62f72752-1070-4856-aec8-5d8c07039d97\" (UID: \"62f72752-1070-4856-aec8-5d8c07039d97\") " Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.582550 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bn7mm\" (UniqueName: \"kubernetes.io/projected/3fae0e8f-e6a0-4031-a030-3e380aaf68a8-kube-api-access-bn7mm\") pod \"keystone-2aa5-account-create-update-hwk8n\" (UID: \"3fae0e8f-e6a0-4031-a030-3e380aaf68a8\") " pod="openstack-kuttl-tests/keystone-2aa5-account-create-update-hwk8n" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.583352 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3fae0e8f-e6a0-4031-a030-3e380aaf68a8-operator-scripts\") pod \"keystone-2aa5-account-create-update-hwk8n\" (UID: \"3fae0e8f-e6a0-4031-a030-3e380aaf68a8\") " pod="openstack-kuttl-tests/keystone-2aa5-account-create-update-hwk8n" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.583527 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a1dfcf19-aecf-49e7-9024-2e8b517fecfb-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.583551 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ef7c6f1d-0e78-43bf-99c4-9200f5e67136-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.583567 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/cb2bdc0a-77bc-488e-b188-7b24ac191d5a-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.583579 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/57e08e60-42d1-4b58-9892-c2aa5bbae2cf-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.583594 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9l245\" (UniqueName: \"kubernetes.io/projected/cb2bdc0a-77bc-488e-b188-7b24ac191d5a-kube-api-access-9l245\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.583606 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d14c3978-d254-4ec4-baa0-f011eaef745e-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.583618 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/cb2bdc0a-77bc-488e-b188-7b24ac191d5a-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.583630 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bb48cc0c-a6cd-4fc7-9599-1ed43e3eb216-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.583643 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zzp26\" (UniqueName: \"kubernetes.io/projected/ef7c6f1d-0e78-43bf-99c4-9200f5e67136-kube-api-access-zzp26\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.583668 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") on node \"crc\" " Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.583681 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a1dfcf19-aecf-49e7-9024-2e8b517fecfb-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:28 crc kubenswrapper[5120]: E0316 17:17:28.584633 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Mar 16 17:17:28 crc kubenswrapper[5120]: E0316 17:17:28.584701 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3fae0e8f-e6a0-4031-a030-3e380aaf68a8-operator-scripts podName:3fae0e8f-e6a0-4031-a030-3e380aaf68a8 nodeName:}" failed. No retries permitted until 2026-03-16 17:17:30.584684427 +0000 UTC m=+6352.738616084 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/3fae0e8f-e6a0-4031-a030-3e380aaf68a8-operator-scripts") pod "keystone-2aa5-account-create-update-hwk8n" (UID: "3fae0e8f-e6a0-4031-a030-3e380aaf68a8") : configmap "openstack-scripts" not found Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.586911 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62f72752-1070-4856-aec8-5d8c07039d97-logs" (OuterVolumeSpecName: "logs") pod "62f72752-1070-4856-aec8-5d8c07039d97" (UID: "62f72752-1070-4856-aec8-5d8c07039d97"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.586865 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62f72752-1070-4856-aec8-5d8c07039d97-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "62f72752-1070-4856-aec8-5d8c07039d97" (UID: "62f72752-1070-4856-aec8-5d8c07039d97"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:17:28 crc kubenswrapper[5120]: E0316 17:17:28.587708 5120 projected.go:194] Error preparing data for projected volume kube-api-access-bn7mm for pod openstack-kuttl-tests/keystone-2aa5-account-create-update-hwk8n: failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 17:17:28 crc kubenswrapper[5120]: E0316 17:17:28.587912 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3fae0e8f-e6a0-4031-a030-3e380aaf68a8-kube-api-access-bn7mm podName:3fae0e8f-e6a0-4031-a030-3e380aaf68a8 nodeName:}" failed. No retries permitted until 2026-03-16 17:17:30.587894074 +0000 UTC m=+6352.741825731 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-bn7mm" (UniqueName: "kubernetes.io/projected/3fae0e8f-e6a0-4031-a030-3e380aaf68a8-kube-api-access-bn7mm") pod "keystone-2aa5-account-create-update-hwk8n" (UID: "3fae0e8f-e6a0-4031-a030-3e380aaf68a8") : failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.595273 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62f72752-1070-4856-aec8-5d8c07039d97-kube-api-access-9bwcm" (OuterVolumeSpecName: "kube-api-access-9bwcm") pod "62f72752-1070-4856-aec8-5d8c07039d97" (UID: "62f72752-1070-4856-aec8-5d8c07039d97"). InnerVolumeSpecName "kube-api-access-9bwcm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.599846 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb2bdc0a-77bc-488e-b188-7b24ac191d5a-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "cb2bdc0a-77bc-488e-b188-7b24ac191d5a" (UID: "cb2bdc0a-77bc-488e-b188-7b24ac191d5a"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.607635 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/62f72752-1070-4856-aec8-5d8c07039d97-scripts" (OuterVolumeSpecName: "scripts") pod "62f72752-1070-4856-aec8-5d8c07039d97" (UID: "62f72752-1070-4856-aec8-5d8c07039d97"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.614383 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage08-crc" (OuterVolumeSpecName: "glance") pod "62f72752-1070-4856-aec8-5d8c07039d97" (UID: "62f72752-1070-4856-aec8-5d8c07039d97"). InnerVolumeSpecName "local-storage08-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.621103 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-5r7xg" event={"ID":"05faed40-e1aa-44be-bae7-49459da3dc79","Type":"ContainerStarted","Data":"83878088a4253eded0a5f82814cef033d0121f60cdc7867f4769ded7f714e6e1"} Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.621310 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-5r7xg" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.623512 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.623812 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"57e08e60-42d1-4b58-9892-c2aa5bbae2cf","Type":"ContainerDied","Data":"a437b88eaedda344c6a65e0ac3eb74f5c61f12ef04b598a292fa32c018d0d536"} Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.623849 5120 scope.go:117] "RemoveContainer" containerID="e45a713f90daea3dfb25bc19fbe35a5087a998babd98c6f27853be3e15ff43a6" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.631809 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef7c6f1d-0e78-43bf-99c4-9200f5e67136-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "ef7c6f1d-0e78-43bf-99c4-9200f5e67136" (UID: "ef7c6f1d-0e78-43bf-99c4-9200f5e67136"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.642703 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bb48cc0c-a6cd-4fc7-9599-1ed43e3eb216-config-data" (OuterVolumeSpecName: "config-data") pod "bb48cc0c-a6cd-4fc7-9599-1ed43e3eb216" (UID: "bb48cc0c-a6cd-4fc7-9599-1ed43e3eb216"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.646360 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"d14c3978-d254-4ec4-baa0-f011eaef745e","Type":"ContainerDied","Data":"0c606db5335af0f99b8f3a48b265f9589d826d63f49a78bcf37f852ffc338db4"} Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.646474 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.647548 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-5r7xg" podStartSLOduration=6.647540066 podStartE2EDuration="6.647540066s" podCreationTimestamp="2026-03-16 17:17:22 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:17:28.640569886 +0000 UTC m=+6350.794501543" watchObservedRunningTime="2026-03-16 17:17:28.647540066 +0000 UTC m=+6350.801471723" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.655251 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb2bdc0a-77bc-488e-b188-7b24ac191d5a-config-data" (OuterVolumeSpecName: "config-data") pod "cb2bdc0a-77bc-488e-b188-7b24ac191d5a" (UID: "cb2bdc0a-77bc-488e-b188-7b24ac191d5a"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.657074 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"a9215705-d766-4151-b079-62d304603586","Type":"ContainerDied","Data":"5b88f643d4f23c9eee2a366e90d7289a352aa7fe708ab675919c2875188433c8"} Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.657126 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5b88f643d4f23c9eee2a366e90d7289a352aa7fe708ab675919c2875188433c8" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.659316 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage01-crc" (UniqueName: "kubernetes.io/local-volume/local-storage01-crc") on node "crc" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.674774 5120 generic.go:358] "Generic (PLEG): container finished" podID="54551b0a-84c0-40c7-a1d1-64dfbf2fd0d6" containerID="1c888e1bf36153dbf6a4f93c8017fd1758b86095191da4b03dcef06e933c34bf" exitCode=1 Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.679111 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d14c3978-d254-4ec4-baa0-f011eaef745e-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "d14c3978-d254-4ec4-baa0-f011eaef745e" (UID: "d14c3978-d254-4ec4-baa0-f011eaef745e"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.684059 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef7c6f1d-0e78-43bf-99c4-9200f5e67136-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ef7c6f1d-0e78-43bf-99c4-9200f5e67136" (UID: "ef7c6f1d-0e78-43bf-99c4-9200f5e67136"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.684313 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d14c3978-d254-4ec4-baa0-f011eaef745e-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "d14c3978-d254-4ec4-baa0-f011eaef745e" (UID: "d14c3978-d254-4ec4-baa0-f011eaef745e"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.684906 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ef7c6f1d-0e78-43bf-99c4-9200f5e67136-combined-ca-bundle\") pod \"ef7c6f1d-0e78-43bf-99c4-9200f5e67136\" (UID: \"ef7c6f1d-0e78-43bf-99c4-9200f5e67136\") " Mar 16 17:17:28 crc kubenswrapper[5120]: W0316 17:17:28.685059 5120 empty_dir.go:511] Warning: Unmount skipped because path does not exist: /var/lib/kubelet/pods/ef7c6f1d-0e78-43bf-99c4-9200f5e67136/volumes/kubernetes.io~secret/combined-ca-bundle Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.685076 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef7c6f1d-0e78-43bf-99c4-9200f5e67136-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ef7c6f1d-0e78-43bf-99c4-9200f5e67136" (UID: "ef7c6f1d-0e78-43bf-99c4-9200f5e67136"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.685266 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/d14c3978-d254-4ec4-baa0-f011eaef745e-internal-tls-certs\") pod \"d14c3978-d254-4ec4-baa0-f011eaef745e\" (UID: \"d14c3978-d254-4ec4-baa0-f011eaef745e\") " Mar 16 17:17:28 crc kubenswrapper[5120]: W0316 17:17:28.685396 5120 empty_dir.go:511] Warning: Unmount skipped because path does not exist: /var/lib/kubelet/pods/d14c3978-d254-4ec4-baa0-f011eaef745e/volumes/kubernetes.io~secret/internal-tls-certs Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.685411 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d14c3978-d254-4ec4-baa0-f011eaef745e-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "d14c3978-d254-4ec4-baa0-f011eaef745e" (UID: "d14c3978-d254-4ec4-baa0-f011eaef745e"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.686350 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/d14c3978-d254-4ec4-baa0-f011eaef745e-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.686372 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/d14c3978-d254-4ec4-baa0-f011eaef745e-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.686414 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") on node \"crc\" " Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.686426 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/62f72752-1070-4856-aec8-5d8c07039d97-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.686435 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/62f72752-1070-4856-aec8-5d8c07039d97-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.686445 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.686454 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cb2bdc0a-77bc-488e-b188-7b24ac191d5a-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.686464 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9bwcm\" (UniqueName: \"kubernetes.io/projected/62f72752-1070-4856-aec8-5d8c07039d97-kube-api-access-9bwcm\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.686492 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cb2bdc0a-77bc-488e-b188-7b24ac191d5a-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.686501 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/62f72752-1070-4856-aec8-5d8c07039d97-logs\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.686509 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ef7c6f1d-0e78-43bf-99c4-9200f5e67136-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.686518 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bb48cc0c-a6cd-4fc7-9599-1ed43e3eb216-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.686528 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/ef7c6f1d-0e78-43bf-99c4-9200f5e67136-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.687399 5120 generic.go:358] "Generic (PLEG): container finished" podID="7f4ab831-1080-4b30-9b89-ddbd4d26bbb8" containerID="0cb75cd76e83c805136be2430ae92ab9ce0b6d500c761635d50c613f87fa59b7" exitCode=0 Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.689124 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1976af1c-93c9-487c-9852-752bb5c1234d-config-data" (OuterVolumeSpecName: "config-data") pod "1976af1c-93c9-487c-9852-752bb5c1234d" (UID: "1976af1c-93c9-487c-9852-752bb5c1234d"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.695355 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-2aa5-account-create-update-hwk8n" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.695378 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/62f72752-1070-4856-aec8-5d8c07039d97-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "62f72752-1070-4856-aec8-5d8c07039d97" (UID: "62f72752-1070-4856-aec8-5d8c07039d97"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.695481 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.696151 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.696278 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-5b79cc5b54-db2hd" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.696306 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.696318 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb2bdc0a-77bc-488e-b188-7b24ac191d5a-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "cb2bdc0a-77bc-488e-b188-7b24ac191d5a" (UID: "cb2bdc0a-77bc-488e-b188-7b24ac191d5a"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.696680 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.697566 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-4ea4-account-create-update-tp4sf" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.698802 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.707539 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1976af1c-93c9-487c-9852-752bb5c1234d-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "1976af1c-93c9-487c-9852-752bb5c1234d" (UID: "1976af1c-93c9-487c-9852-752bb5c1234d"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.709124 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="01fff66f-9939-487a-b37b-74a413516937" path="/var/lib/kubelet/pods/01fff66f-9939-487a-b37b-74a413516937/volumes" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.711064 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="682f1065-f1df-4d72-9a81-3ddb581743ca" path="/var/lib/kubelet/pods/682f1065-f1df-4d72-9a81-3ddb581743ca/volumes" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.714448 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage08-crc" (UniqueName: "kubernetes.io/local-volume/local-storage08-crc") on node "crc" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.716096 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="87adc2e9-8943-4b49-a683-f929f03a8226" path="/var/lib/kubelet/pods/87adc2e9-8943-4b49-a683-f929f03a8226/volumes" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.716653 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d14c3978-d254-4ec4-baa0-f011eaef745e-config-data" (OuterVolumeSpecName: "config-data") pod "d14c3978-d254-4ec4-baa0-f011eaef745e" (UID: "d14c3978-d254-4ec4-baa0-f011eaef745e"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.718489 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef3c62c1-6067-4615-b80f-864bbd13fa7f" path="/var/lib/kubelet/pods/ef3c62c1-6067-4615-b80f-864bbd13fa7f/volumes" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.719004 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd245417-d366-4c4b-814d-08860c23f880" path="/var/lib/kubelet/pods/fd245417-d366-4c4b-814d-08860c23f880/volumes" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.729599 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef7c6f1d-0e78-43bf-99c4-9200f5e67136-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "ef7c6f1d-0e78-43bf-99c4-9200f5e67136" (UID: "ef7c6f1d-0e78-43bf-99c4-9200f5e67136"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.739151 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/62f72752-1070-4856-aec8-5d8c07039d97-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "62f72752-1070-4856-aec8-5d8c07039d97" (UID: "62f72752-1070-4856-aec8-5d8c07039d97"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.742440 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1976af1c-93c9-487c-9852-752bb5c1234d-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "1976af1c-93c9-487c-9852-752bb5c1234d" (UID: "1976af1c-93c9-487c-9852-752bb5c1234d"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.749110 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/57e08e60-42d1-4b58-9892-c2aa5bbae2cf-config-data" (OuterVolumeSpecName: "config-data") pod "57e08e60-42d1-4b58-9892-c2aa5bbae2cf" (UID: "57e08e60-42d1-4b58-9892-c2aa5bbae2cf"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.772228 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1976af1c-93c9-487c-9852-752bb5c1234d-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "1976af1c-93c9-487c-9852-752bb5c1234d" (UID: "1976af1c-93c9-487c-9852-752bb5c1234d"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.772583 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/62f72752-1070-4856-aec8-5d8c07039d97-config-data" (OuterVolumeSpecName: "config-data") pod "62f72752-1070-4856-aec8-5d8c07039d97" (UID: "62f72752-1070-4856-aec8-5d8c07039d97"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.790623 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/62f72752-1070-4856-aec8-5d8c07039d97-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.790661 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/57e08e60-42d1-4b58-9892-c2aa5bbae2cf-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.790671 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/62f72752-1070-4856-aec8-5d8c07039d97-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.790680 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.790689 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1976af1c-93c9-487c-9852-752bb5c1234d-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.790698 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/cb2bdc0a-77bc-488e-b188-7b24ac191d5a-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.790707 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/62f72752-1070-4856-aec8-5d8c07039d97-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.790715 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/1976af1c-93c9-487c-9852-752bb5c1234d-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.790724 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1976af1c-93c9-487c-9852-752bb5c1234d-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.790732 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/1976af1c-93c9-487c-9852-752bb5c1234d-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.790742 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ef7c6f1d-0e78-43bf-99c4-9200f5e67136-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.790750 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d14c3978-d254-4ec4-baa0-f011eaef745e-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:28 crc kubenswrapper[5120]: E0316 17:17:28.915755 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="24333b7cdb26c2e70048e18dcdaeac57a05c823200ef25ebc7bd2a0912464cf3" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Mar 16 17:17:28 crc kubenswrapper[5120]: E0316 17:17:28.925677 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="24333b7cdb26c2e70048e18dcdaeac57a05c823200ef25ebc7bd2a0912464cf3" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Mar 16 17:17:28 crc kubenswrapper[5120]: E0316 17:17:28.927175 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="24333b7cdb26c2e70048e18dcdaeac57a05c823200ef25ebc7bd2a0912464cf3" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Mar 16 17:17:28 crc kubenswrapper[5120]: E0316 17:17:28.927213 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/ovn-northd-0" podUID="161d5626-9918-4847-96fd-f93d894bc230" containerName="ovn-northd" probeResult="unknown" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.963067 5120 scope.go:117] "RemoveContainer" containerID="6d193e9b3e72813100bb0dd0568015bdb73ff4460f0f8eabcee9b6e240ce5d85" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.964842 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"cb2bdc0a-77bc-488e-b188-7b24ac191d5a","Type":"ContainerDied","Data":"e4e4012bfa365091d8d01567a0a876d1fe067607075f90c91a428b5da542fb09"} Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.964895 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"bb48cc0c-a6cd-4fc7-9599-1ed43e3eb216","Type":"ContainerDied","Data":"523f6335422bb22600fbd2598000fc22900c656024da4c6c2c229a0d1d8d61df"} Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.964910 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-5b49d5d76-5r44p" event={"ID":"c2e33bc1-ee7f-461d-9faa-b5678f7cb416","Type":"ContainerDied","Data":"5289ad176f72ac318ad6aba7bd10f14c42a070c205ad39b8a0f1f10bf0cc0bfb"} Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.964927 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5289ad176f72ac318ad6aba7bd10f14c42a070c205ad39b8a0f1f10bf0cc0bfb" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.964937 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-xbcxw" event={"ID":"54551b0a-84c0-40c7-a1d1-64dfbf2fd0d6","Type":"ContainerDied","Data":"1c888e1bf36153dbf6a4f93c8017fd1758b86095191da4b03dcef06e933c34bf"} Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.964960 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"62f72752-1070-4856-aec8-5d8c07039d97","Type":"ContainerDied","Data":"f9b905efdc4791ea2da530e7d659bd7656fb4bf0fd651a8c7dab77feaf04aa20"} Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.964975 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-4ea4-account-create-update-tp4sf" event={"ID":"0a59e429-ba97-491f-91d4-9b1b063fc15b","Type":"ContainerDied","Data":"b836d82008edeb2a98310c07ce88205db2105ff9e97b7c93f82483a885161a4b"} Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.964989 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"ef7c6f1d-0e78-43bf-99c4-9200f5e67136","Type":"ContainerDied","Data":"af09ebdfa23718ae5c64ad8b270c24365af00babcf8420d7d4cc07e2f0870812"} Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.965003 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"7f4ab831-1080-4b30-9b89-ddbd4d26bbb8","Type":"ContainerDied","Data":"0cb75cd76e83c805136be2430ae92ab9ce0b6d500c761635d50c613f87fa59b7"} Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.965017 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"7f4ab831-1080-4b30-9b89-ddbd4d26bbb8","Type":"ContainerDied","Data":"406371fd7248482b0c22f1be1888e141c6b7344ae3689d597a29bf885b43cb82"} Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.965026 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="406371fd7248482b0c22f1be1888e141c6b7344ae3689d597a29bf885b43cb82" Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.965035 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"a1dfcf19-aecf-49e7-9024-2e8b517fecfb","Type":"ContainerDied","Data":"3f7dcb119ebe11d1c1ac576f5f279b3ec5b7ac8d0496ca3ec1c07587a2adc098"} Mar 16 17:17:28 crc kubenswrapper[5120]: I0316 17:17:28.990055 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.045658 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a9215705-d766-4151-b079-62d304603586-combined-ca-bundle\") pod \"a9215705-d766-4151-b079-62d304603586\" (UID: \"a9215705-d766-4151-b079-62d304603586\") " Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.046306 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gdlkq\" (UniqueName: \"kubernetes.io/projected/a9215705-d766-4151-b079-62d304603586-kube-api-access-gdlkq\") pod \"a9215705-d766-4151-b079-62d304603586\" (UID: \"a9215705-d766-4151-b079-62d304603586\") " Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.046396 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/a9215705-d766-4151-b079-62d304603586-nova-metadata-tls-certs\") pod \"a9215705-d766-4151-b079-62d304603586\" (UID: \"a9215705-d766-4151-b079-62d304603586\") " Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.046531 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a9215705-d766-4151-b079-62d304603586-logs\") pod \"a9215705-d766-4151-b079-62d304603586\" (UID: \"a9215705-d766-4151-b079-62d304603586\") " Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.046554 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a9215705-d766-4151-b079-62d304603586-config-data\") pod \"a9215705-d766-4151-b079-62d304603586\" (UID: \"a9215705-d766-4151-b079-62d304603586\") " Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.048353 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a9215705-d766-4151-b079-62d304603586-logs" (OuterVolumeSpecName: "logs") pod "a9215705-d766-4151-b079-62d304603586" (UID: "a9215705-d766-4151-b079-62d304603586"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.049673 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a9215705-d766-4151-b079-62d304603586-logs\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.086370 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a9215705-d766-4151-b079-62d304603586-kube-api-access-gdlkq" (OuterVolumeSpecName: "kube-api-access-gdlkq") pod "a9215705-d766-4151-b079-62d304603586" (UID: "a9215705-d766-4151-b079-62d304603586"). InnerVolumeSpecName "kube-api-access-gdlkq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.092482 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a9215705-d766-4151-b079-62d304603586-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "a9215705-d766-4151-b079-62d304603586" (UID: "a9215705-d766-4151-b079-62d304603586"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.106205 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a9215705-d766-4151-b079-62d304603586-config-data" (OuterVolumeSpecName: "config-data") pod "a9215705-d766-4151-b079-62d304603586" (UID: "a9215705-d766-4151-b079-62d304603586"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.117885 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a9215705-d766-4151-b079-62d304603586-nova-metadata-tls-certs" (OuterVolumeSpecName: "nova-metadata-tls-certs") pod "a9215705-d766-4151-b079-62d304603586" (UID: "a9215705-d766-4151-b079-62d304603586"). InnerVolumeSpecName "nova-metadata-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.153160 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gdlkq\" (UniqueName: \"kubernetes.io/projected/a9215705-d766-4151-b079-62d304603586-kube-api-access-gdlkq\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.153197 5120 reconciler_common.go:299] "Volume detached for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/a9215705-d766-4151-b079-62d304603586-nova-metadata-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.153210 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a9215705-d766-4151-b079-62d304603586-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.153228 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a9215705-d766-4151-b079-62d304603586-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.247423 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-5b49d5d76-5r44p" Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.249325 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.261980 5120 scope.go:117] "RemoveContainer" containerID="64455790d468e852fe6069aaee149c1ccbf41669030eb68f8c6c996c4885896e" Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.262179 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.317624 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.330891 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.357740 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c2e33bc1-ee7f-461d-9faa-b5678f7cb416-combined-ca-bundle\") pod \"c2e33bc1-ee7f-461d-9faa-b5678f7cb416\" (UID: \"c2e33bc1-ee7f-461d-9faa-b5678f7cb416\") " Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.357867 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c2e33bc1-ee7f-461d-9faa-b5678f7cb416-config-data\") pod \"c2e33bc1-ee7f-461d-9faa-b5678f7cb416\" (UID: \"c2e33bc1-ee7f-461d-9faa-b5678f7cb416\") " Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.358056 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/c2e33bc1-ee7f-461d-9faa-b5678f7cb416-internal-tls-certs\") pod \"c2e33bc1-ee7f-461d-9faa-b5678f7cb416\" (UID: \"c2e33bc1-ee7f-461d-9faa-b5678f7cb416\") " Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.358101 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/c2e33bc1-ee7f-461d-9faa-b5678f7cb416-public-tls-certs\") pod \"c2e33bc1-ee7f-461d-9faa-b5678f7cb416\" (UID: \"c2e33bc1-ee7f-461d-9faa-b5678f7cb416\") " Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.358833 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gn67c\" (UniqueName: \"kubernetes.io/projected/c2e33bc1-ee7f-461d-9faa-b5678f7cb416-kube-api-access-gn67c\") pod \"c2e33bc1-ee7f-461d-9faa-b5678f7cb416\" (UID: \"c2e33bc1-ee7f-461d-9faa-b5678f7cb416\") " Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.359058 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c2e33bc1-ee7f-461d-9faa-b5678f7cb416-logs\") pod \"c2e33bc1-ee7f-461d-9faa-b5678f7cb416\" (UID: \"c2e33bc1-ee7f-461d-9faa-b5678f7cb416\") " Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.359096 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/c2e33bc1-ee7f-461d-9faa-b5678f7cb416-config-data-custom\") pod \"c2e33bc1-ee7f-461d-9faa-b5678f7cb416\" (UID: \"c2e33bc1-ee7f-461d-9faa-b5678f7cb416\") " Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.360331 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2e33bc1-ee7f-461d-9faa-b5678f7cb416-logs" (OuterVolumeSpecName: "logs") pod "c2e33bc1-ee7f-461d-9faa-b5678f7cb416" (UID: "c2e33bc1-ee7f-461d-9faa-b5678f7cb416"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.360439 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c2e33bc1-ee7f-461d-9faa-b5678f7cb416-logs\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.367928 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c2e33bc1-ee7f-461d-9faa-b5678f7cb416-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "c2e33bc1-ee7f-461d-9faa-b5678f7cb416" (UID: "c2e33bc1-ee7f-461d-9faa-b5678f7cb416"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.373019 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2e33bc1-ee7f-461d-9faa-b5678f7cb416-kube-api-access-gn67c" (OuterVolumeSpecName: "kube-api-access-gn67c") pod "c2e33bc1-ee7f-461d-9faa-b5678f7cb416" (UID: "c2e33bc1-ee7f-461d-9faa-b5678f7cb416"). InnerVolumeSpecName "kube-api-access-gn67c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.407691 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c2e33bc1-ee7f-461d-9faa-b5678f7cb416-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "c2e33bc1-ee7f-461d-9faa-b5678f7cb416" (UID: "c2e33bc1-ee7f-461d-9faa-b5678f7cb416"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.413504 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.425732 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.428078 5120 scope.go:117] "RemoveContainer" containerID="1e11ae8d54987876ff5eee468abe7e70824cb0497d72bcb53bdc81aed418c318" Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.439136 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c2e33bc1-ee7f-461d-9faa-b5678f7cb416-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "c2e33bc1-ee7f-461d-9faa-b5678f7cb416" (UID: "c2e33bc1-ee7f-461d-9faa-b5678f7cb416"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.440069 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-2aa5-account-create-update-hwk8n" Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.443864 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.457842 5120 scope.go:117] "RemoveContainer" containerID="929557ee53c06ee6a62396db9c05cee3c027bea6a01f146959a43bff603e7e02" Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.459842 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c2e33bc1-ee7f-461d-9faa-b5678f7cb416-config-data" (OuterVolumeSpecName: "config-data") pod "c2e33bc1-ee7f-461d-9faa-b5678f7cb416" (UID: "c2e33bc1-ee7f-461d-9faa-b5678f7cb416"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.460957 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7f4ab831-1080-4b30-9b89-ddbd4d26bbb8-combined-ca-bundle\") pod \"7f4ab831-1080-4b30-9b89-ddbd4d26bbb8\" (UID: \"7f4ab831-1080-4b30-9b89-ddbd4d26bbb8\") " Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.461611 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/7f4ab831-1080-4b30-9b89-ddbd4d26bbb8-memcached-tls-certs\") pod \"7f4ab831-1080-4b30-9b89-ddbd4d26bbb8\" (UID: \"7f4ab831-1080-4b30-9b89-ddbd4d26bbb8\") " Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.466509 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/7f4ab831-1080-4b30-9b89-ddbd4d26bbb8-kolla-config\") pod \"7f4ab831-1080-4b30-9b89-ddbd4d26bbb8\" (UID: \"7f4ab831-1080-4b30-9b89-ddbd4d26bbb8\") " Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.466656 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/7f4ab831-1080-4b30-9b89-ddbd4d26bbb8-config-data\") pod \"7f4ab831-1080-4b30-9b89-ddbd4d26bbb8\" (UID: \"7f4ab831-1080-4b30-9b89-ddbd4d26bbb8\") " Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.466847 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hwzpt\" (UniqueName: \"kubernetes.io/projected/7f4ab831-1080-4b30-9b89-ddbd4d26bbb8-kube-api-access-hwzpt\") pod \"7f4ab831-1080-4b30-9b89-ddbd4d26bbb8\" (UID: \"7f4ab831-1080-4b30-9b89-ddbd4d26bbb8\") " Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.467931 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/c2e33bc1-ee7f-461d-9faa-b5678f7cb416-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.468015 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gn67c\" (UniqueName: \"kubernetes.io/projected/c2e33bc1-ee7f-461d-9faa-b5678f7cb416-kube-api-access-gn67c\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.468095 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/c2e33bc1-ee7f-461d-9faa-b5678f7cb416-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.468159 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c2e33bc1-ee7f-461d-9faa-b5678f7cb416-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.468220 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c2e33bc1-ee7f-461d-9faa-b5678f7cb416-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.470589 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f4ab831-1080-4b30-9b89-ddbd4d26bbb8-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "7f4ab831-1080-4b30-9b89-ddbd4d26bbb8" (UID: "7f4ab831-1080-4b30-9b89-ddbd4d26bbb8"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.470804 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f4ab831-1080-4b30-9b89-ddbd4d26bbb8-config-data" (OuterVolumeSpecName: "config-data") pod "7f4ab831-1080-4b30-9b89-ddbd4d26bbb8" (UID: "7f4ab831-1080-4b30-9b89-ddbd4d26bbb8"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.471189 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-xbcxw" Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.471908 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f4ab831-1080-4b30-9b89-ddbd4d26bbb8-kube-api-access-hwzpt" (OuterVolumeSpecName: "kube-api-access-hwzpt") pod "7f4ab831-1080-4b30-9b89-ddbd4d26bbb8" (UID: "7f4ab831-1080-4b30-9b89-ddbd4d26bbb8"). InnerVolumeSpecName "kube-api-access-hwzpt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.476264 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c2e33bc1-ee7f-461d-9faa-b5678f7cb416-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "c2e33bc1-ee7f-461d-9faa-b5678f7cb416" (UID: "c2e33bc1-ee7f-461d-9faa-b5678f7cb416"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.503124 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7f4ab831-1080-4b30-9b89-ddbd4d26bbb8-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "7f4ab831-1080-4b30-9b89-ddbd4d26bbb8" (UID: "7f4ab831-1080-4b30-9b89-ddbd4d26bbb8"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.534967 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-4ea4-account-create-update-tp4sf"] Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.537266 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7f4ab831-1080-4b30-9b89-ddbd4d26bbb8-memcached-tls-certs" (OuterVolumeSpecName: "memcached-tls-certs") pod "7f4ab831-1080-4b30-9b89-ddbd4d26bbb8" (UID: "7f4ab831-1080-4b30-9b89-ddbd4d26bbb8"). InnerVolumeSpecName "memcached-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.544943 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-4ea4-account-create-update-tp4sf"] Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.552892 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.563497 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.569532 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c66rv\" (UniqueName: \"kubernetes.io/projected/54551b0a-84c0-40c7-a1d1-64dfbf2fd0d6-kube-api-access-c66rv\") pod \"54551b0a-84c0-40c7-a1d1-64dfbf2fd0d6\" (UID: \"54551b0a-84c0-40c7-a1d1-64dfbf2fd0d6\") " Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.570009 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/54551b0a-84c0-40c7-a1d1-64dfbf2fd0d6-operator-scripts\") pod \"54551b0a-84c0-40c7-a1d1-64dfbf2fd0d6\" (UID: \"54551b0a-84c0-40c7-a1d1-64dfbf2fd0d6\") " Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.570558 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/54551b0a-84c0-40c7-a1d1-64dfbf2fd0d6-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "54551b0a-84c0-40c7-a1d1-64dfbf2fd0d6" (UID: "54551b0a-84c0-40c7-a1d1-64dfbf2fd0d6"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.571330 5120 reconciler_common.go:299] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/7f4ab831-1080-4b30-9b89-ddbd4d26bbb8-kolla-config\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.571357 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/7f4ab831-1080-4b30-9b89-ddbd4d26bbb8-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.571369 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/54551b0a-84c0-40c7-a1d1-64dfbf2fd0d6-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.571382 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hwzpt\" (UniqueName: \"kubernetes.io/projected/7f4ab831-1080-4b30-9b89-ddbd4d26bbb8-kube-api-access-hwzpt\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.571395 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7f4ab831-1080-4b30-9b89-ddbd4d26bbb8-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.571408 5120 reconciler_common.go:299] "Volume detached for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/7f4ab831-1080-4b30-9b89-ddbd4d26bbb8-memcached-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.571420 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/c2e33bc1-ee7f-461d-9faa-b5678f7cb416-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.575495 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54551b0a-84c0-40c7-a1d1-64dfbf2fd0d6-kube-api-access-c66rv" (OuterVolumeSpecName: "kube-api-access-c66rv") pod "54551b0a-84c0-40c7-a1d1-64dfbf2fd0d6" (UID: "54551b0a-84c0-40c7-a1d1-64dfbf2fd0d6"). InnerVolumeSpecName "kube-api-access-c66rv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.673486 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c66rv\" (UniqueName: \"kubernetes.io/projected/54551b0a-84c0-40c7-a1d1-64dfbf2fd0d6-kube-api-access-c66rv\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.706422 5120 generic.go:358] "Generic (PLEG): container finished" podID="dd339abc-691c-48f1-8674-430a5e806067" containerID="3dbccce89cd901c0416da3e41b60454cf2ab5860b9727c911dacea8d5361320b" exitCode=0 Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.706518 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"dd339abc-691c-48f1-8674-430a5e806067","Type":"ContainerDied","Data":"3dbccce89cd901c0416da3e41b60454cf2ab5860b9727c911dacea8d5361320b"} Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.706539 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"dd339abc-691c-48f1-8674-430a5e806067","Type":"ContainerDied","Data":"d959ed38ae84e0af5bbfeadc05d16cc4aeb7c6c857885a7b5c5ecffdd37dc99f"} Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.706550 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d959ed38ae84e0af5bbfeadc05d16cc4aeb7c6c857885a7b5c5ecffdd37dc99f" Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.708460 5120 generic.go:358] "Generic (PLEG): container finished" podID="0498c744-8606-4b08-b69f-28f80006c19c" containerID="6b1f38a50b1d436dc0420e3d24bcc3505027e09db725d3244026d9aa3d1d44bd" exitCode=0 Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.708534 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"0498c744-8606-4b08-b69f-28f80006c19c","Type":"ContainerDied","Data":"6b1f38a50b1d436dc0420e3d24bcc3505027e09db725d3244026d9aa3d1d44bd"} Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.708552 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"0498c744-8606-4b08-b69f-28f80006c19c","Type":"ContainerDied","Data":"f4b536147d4a29212b10471b1f6034ab3859f154607548e5494d9f735138c38d"} Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.708571 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f4b536147d4a29212b10471b1f6034ab3859f154607548e5494d9f735138c38d" Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.710449 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-xbcxw" event={"ID":"54551b0a-84c0-40c7-a1d1-64dfbf2fd0d6","Type":"ContainerDied","Data":"9627250a31bcadc610ffeca00339a8b1f9e99eb4997e84640fc8c70c9b76471c"} Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.710555 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-xbcxw" Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.726121 5120 generic.go:358] "Generic (PLEG): container finished" podID="d6906541-8dff-40ed-a064-5777f4b66f24" containerID="318e43b1f673c7e18a9bf01910a8401b4e64194498bf8833ebd04325d7873d96" exitCode=0 Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.726784 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-5b49d5d76-5r44p" Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.727007 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.727964 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.728003 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"d6906541-8dff-40ed-a064-5777f4b66f24","Type":"ContainerDied","Data":"318e43b1f673c7e18a9bf01910a8401b4e64194498bf8833ebd04325d7873d96"} Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.728314 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-2aa5-account-create-update-hwk8n" Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.739252 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.754384 5120 scope.go:117] "RemoveContainer" containerID="2ca16c8a2100af38c2f2f32b05d02ec4bd230df464049dbad13abfbaf9e81bfd" Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.756626 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-5b79cc5b54-db2hd"] Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.767478 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-5b79cc5b54-db2hd"] Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.775652 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.779087 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.788640 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.838345 5120 scope.go:117] "RemoveContainer" containerID="908c72eb1629fa11a71f6778174b3a20818464a6614bf7943723c08961af3886" Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.856184 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-xbcxw"] Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.882824 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/dd339abc-691c-48f1-8674-430a5e806067-server-conf\") pod \"dd339abc-691c-48f1-8674-430a5e806067\" (UID: \"dd339abc-691c-48f1-8674-430a5e806067\") " Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.882872 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/0498c744-8606-4b08-b69f-28f80006c19c-config-data-default\") pod \"0498c744-8606-4b08-b69f-28f80006c19c\" (UID: \"0498c744-8606-4b08-b69f-28f80006c19c\") " Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.882938 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"mysql-db\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"0498c744-8606-4b08-b69f-28f80006c19c\" (UID: \"0498c744-8606-4b08-b69f-28f80006c19c\") " Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.883162 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/dd339abc-691c-48f1-8674-430a5e806067-plugins-conf\") pod \"dd339abc-691c-48f1-8674-430a5e806067\" (UID: \"dd339abc-691c-48f1-8674-430a5e806067\") " Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.883244 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/dd339abc-691c-48f1-8674-430a5e806067-rabbitmq-confd\") pod \"dd339abc-691c-48f1-8674-430a5e806067\" (UID: \"dd339abc-691c-48f1-8674-430a5e806067\") " Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.883311 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/dd339abc-691c-48f1-8674-430a5e806067-erlang-cookie-secret\") pod \"dd339abc-691c-48f1-8674-430a5e806067\" (UID: \"dd339abc-691c-48f1-8674-430a5e806067\") " Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.883347 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"persistence\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") pod \"dd339abc-691c-48f1-8674-430a5e806067\" (UID: \"dd339abc-691c-48f1-8674-430a5e806067\") " Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.883387 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0498c744-8606-4b08-b69f-28f80006c19c-combined-ca-bundle\") pod \"0498c744-8606-4b08-b69f-28f80006c19c\" (UID: \"0498c744-8606-4b08-b69f-28f80006c19c\") " Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.883444 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bvrrf\" (UniqueName: \"kubernetes.io/projected/dd339abc-691c-48f1-8674-430a5e806067-kube-api-access-bvrrf\") pod \"dd339abc-691c-48f1-8674-430a5e806067\" (UID: \"dd339abc-691c-48f1-8674-430a5e806067\") " Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.883470 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/dd339abc-691c-48f1-8674-430a5e806067-rabbitmq-plugins\") pod \"dd339abc-691c-48f1-8674-430a5e806067\" (UID: \"dd339abc-691c-48f1-8674-430a5e806067\") " Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.883608 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/dd339abc-691c-48f1-8674-430a5e806067-rabbitmq-tls\") pod \"dd339abc-691c-48f1-8674-430a5e806067\" (UID: \"dd339abc-691c-48f1-8674-430a5e806067\") " Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.883634 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0498c744-8606-4b08-b69f-28f80006c19c-operator-scripts\") pod \"0498c744-8606-4b08-b69f-28f80006c19c\" (UID: \"0498c744-8606-4b08-b69f-28f80006c19c\") " Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.883776 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/0498c744-8606-4b08-b69f-28f80006c19c-config-data-generated\") pod \"0498c744-8606-4b08-b69f-28f80006c19c\" (UID: \"0498c744-8606-4b08-b69f-28f80006c19c\") " Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.883862 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/dd339abc-691c-48f1-8674-430a5e806067-config-data\") pod \"dd339abc-691c-48f1-8674-430a5e806067\" (UID: \"dd339abc-691c-48f1-8674-430a5e806067\") " Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.883936 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-77lkb\" (UniqueName: \"kubernetes.io/projected/0498c744-8606-4b08-b69f-28f80006c19c-kube-api-access-77lkb\") pod \"0498c744-8606-4b08-b69f-28f80006c19c\" (UID: \"0498c744-8606-4b08-b69f-28f80006c19c\") " Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.883968 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/dd339abc-691c-48f1-8674-430a5e806067-rabbitmq-erlang-cookie\") pod \"dd339abc-691c-48f1-8674-430a5e806067\" (UID: \"dd339abc-691c-48f1-8674-430a5e806067\") " Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.884101 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/0498c744-8606-4b08-b69f-28f80006c19c-galera-tls-certs\") pod \"0498c744-8606-4b08-b69f-28f80006c19c\" (UID: \"0498c744-8606-4b08-b69f-28f80006c19c\") " Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.884159 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/dd339abc-691c-48f1-8674-430a5e806067-pod-info\") pod \"dd339abc-691c-48f1-8674-430a5e806067\" (UID: \"dd339abc-691c-48f1-8674-430a5e806067\") " Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.884245 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/0498c744-8606-4b08-b69f-28f80006c19c-kolla-config\") pod \"0498c744-8606-4b08-b69f-28f80006c19c\" (UID: \"0498c744-8606-4b08-b69f-28f80006c19c\") " Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.884904 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dd339abc-691c-48f1-8674-430a5e806067-plugins-conf" (OuterVolumeSpecName: "plugins-conf") pod "dd339abc-691c-48f1-8674-430a5e806067" (UID: "dd339abc-691c-48f1-8674-430a5e806067"). InnerVolumeSpecName "plugins-conf". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.884897 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0498c744-8606-4b08-b69f-28f80006c19c-config-data-default" (OuterVolumeSpecName: "config-data-default") pod "0498c744-8606-4b08-b69f-28f80006c19c" (UID: "0498c744-8606-4b08-b69f-28f80006c19c"). InnerVolumeSpecName "config-data-default". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.885158 5120 reconciler_common.go:299] "Volume detached for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/dd339abc-691c-48f1-8674-430a5e806067-plugins-conf\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.885181 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/0498c744-8606-4b08-b69f-28f80006c19c-config-data-default\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.882207 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-xbcxw"] Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.886278 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd339abc-691c-48f1-8674-430a5e806067-rabbitmq-plugins" (OuterVolumeSpecName: "rabbitmq-plugins") pod "dd339abc-691c-48f1-8674-430a5e806067" (UID: "dd339abc-691c-48f1-8674-430a5e806067"). InnerVolumeSpecName "rabbitmq-plugins". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.891248 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage14-crc" (OuterVolumeSpecName: "persistence") pod "dd339abc-691c-48f1-8674-430a5e806067" (UID: "dd339abc-691c-48f1-8674-430a5e806067"). InnerVolumeSpecName "local-storage14-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.891722 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd339abc-691c-48f1-8674-430a5e806067-rabbitmq-erlang-cookie" (OuterVolumeSpecName: "rabbitmq-erlang-cookie") pod "dd339abc-691c-48f1-8674-430a5e806067" (UID: "dd339abc-691c-48f1-8674-430a5e806067"). InnerVolumeSpecName "rabbitmq-erlang-cookie". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.896646 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0498c744-8606-4b08-b69f-28f80006c19c-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "0498c744-8606-4b08-b69f-28f80006c19c" (UID: "0498c744-8606-4b08-b69f-28f80006c19c"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.898093 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0498c744-8606-4b08-b69f-28f80006c19c-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "0498c744-8606-4b08-b69f-28f80006c19c" (UID: "0498c744-8606-4b08-b69f-28f80006c19c"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.898928 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0498c744-8606-4b08-b69f-28f80006c19c-config-data-generated" (OuterVolumeSpecName: "config-data-generated") pod "0498c744-8606-4b08-b69f-28f80006c19c" (UID: "0498c744-8606-4b08-b69f-28f80006c19c"). InnerVolumeSpecName "config-data-generated". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.907073 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd339abc-691c-48f1-8674-430a5e806067-erlang-cookie-secret" (OuterVolumeSpecName: "erlang-cookie-secret") pod "dd339abc-691c-48f1-8674-430a5e806067" (UID: "dd339abc-691c-48f1-8674-430a5e806067"). InnerVolumeSpecName "erlang-cookie-secret". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.917959 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/dd339abc-691c-48f1-8674-430a5e806067-pod-info" (OuterVolumeSpecName: "pod-info") pod "dd339abc-691c-48f1-8674-430a5e806067" (UID: "dd339abc-691c-48f1-8674-430a5e806067"). InnerVolumeSpecName "pod-info". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.918145 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd339abc-691c-48f1-8674-430a5e806067-kube-api-access-bvrrf" (OuterVolumeSpecName: "kube-api-access-bvrrf") pod "dd339abc-691c-48f1-8674-430a5e806067" (UID: "dd339abc-691c-48f1-8674-430a5e806067"). InnerVolumeSpecName "kube-api-access-bvrrf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.918244 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0498c744-8606-4b08-b69f-28f80006c19c-kube-api-access-77lkb" (OuterVolumeSpecName: "kube-api-access-77lkb") pod "0498c744-8606-4b08-b69f-28f80006c19c" (UID: "0498c744-8606-4b08-b69f-28f80006c19c"). InnerVolumeSpecName "kube-api-access-77lkb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.927701 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd339abc-691c-48f1-8674-430a5e806067-rabbitmq-tls" (OuterVolumeSpecName: "rabbitmq-tls") pod "dd339abc-691c-48f1-8674-430a5e806067" (UID: "dd339abc-691c-48f1-8674-430a5e806067"). InnerVolumeSpecName "rabbitmq-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.950129 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage03-crc" (OuterVolumeSpecName: "mysql-db") pod "0498c744-8606-4b08-b69f-28f80006c19c" (UID: "0498c744-8606-4b08-b69f-28f80006c19c"). InnerVolumeSpecName "local-storage03-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.957019 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0498c744-8606-4b08-b69f-28f80006c19c-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "0498c744-8606-4b08-b69f-28f80006c19c" (UID: "0498c744-8606-4b08-b69f-28f80006c19c"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.972702 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dd339abc-691c-48f1-8674-430a5e806067-server-conf" (OuterVolumeSpecName: "server-conf") pod "dd339abc-691c-48f1-8674-430a5e806067" (UID: "dd339abc-691c-48f1-8674-430a5e806067"). InnerVolumeSpecName "server-conf". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:17:29 crc kubenswrapper[5120]: I0316 17:17:29.997075 5120 scope.go:117] "RemoveContainer" containerID="6a0c6ad8632a2e4381f6d9e14ae012bdf8c057b6396c717785fda31fa5fcd085" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.008843 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0498c744-8606-4b08-b69f-28f80006c19c-galera-tls-certs" (OuterVolumeSpecName: "galera-tls-certs") pod "0498c744-8606-4b08-b69f-28f80006c19c" (UID: "0498c744-8606-4b08-b69f-28f80006c19c"). InnerVolumeSpecName "galera-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.011040 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-5b49d5d76-5r44p"] Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.021149 5120 reconciler_common.go:299] "Volume detached for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/0498c744-8606-4b08-b69f-28f80006c19c-galera-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.021180 5120 reconciler_common.go:299] "Volume detached for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/dd339abc-691c-48f1-8674-430a5e806067-pod-info\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.021191 5120 reconciler_common.go:299] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/0498c744-8606-4b08-b69f-28f80006c19c-kolla-config\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.021200 5120 reconciler_common.go:299] "Volume detached for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/dd339abc-691c-48f1-8674-430a5e806067-server-conf\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.021225 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") on node \"crc\" " Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.021234 5120 reconciler_common.go:299] "Volume detached for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/dd339abc-691c-48f1-8674-430a5e806067-erlang-cookie-secret\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.021253 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") on node \"crc\" " Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.021264 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0498c744-8606-4b08-b69f-28f80006c19c-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.021273 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bvrrf\" (UniqueName: \"kubernetes.io/projected/dd339abc-691c-48f1-8674-430a5e806067-kube-api-access-bvrrf\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.021281 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/dd339abc-691c-48f1-8674-430a5e806067-rabbitmq-plugins\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.021289 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/dd339abc-691c-48f1-8674-430a5e806067-rabbitmq-tls\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.021298 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0498c744-8606-4b08-b69f-28f80006c19c-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.021307 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/0498c744-8606-4b08-b69f-28f80006c19c-config-data-generated\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.021319 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-77lkb\" (UniqueName: \"kubernetes.io/projected/0498c744-8606-4b08-b69f-28f80006c19c-kube-api-access-77lkb\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.021328 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/dd339abc-691c-48f1-8674-430a5e806067-rabbitmq-erlang-cookie\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.028900 5120 scope.go:117] "RemoveContainer" containerID="06604bb2c03297dccc451cd8484387f58b33faae3ce7c0addf37f2c72a32bbd0" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.053058 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage03-crc" (UniqueName: "kubernetes.io/local-volume/local-storage03-crc") on node "crc" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.057529 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-api-5b49d5d76-5r44p"] Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.059326 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dd339abc-691c-48f1-8674-430a5e806067-config-data" (OuterVolumeSpecName: "config-data") pod "dd339abc-691c-48f1-8674-430a5e806067" (UID: "dd339abc-691c-48f1-8674-430a5e806067"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.060989 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage14-crc" (UniqueName: "kubernetes.io/local-volume/local-storage14-crc") on node "crc" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.061387 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.064566 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd339abc-691c-48f1-8674-430a5e806067-rabbitmq-confd" (OuterVolumeSpecName: "rabbitmq-confd") pod "dd339abc-691c-48f1-8674-430a5e806067" (UID: "dd339abc-691c-48f1-8674-430a5e806067"). InnerVolumeSpecName "rabbitmq-confd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.068126 5120 scope.go:117] "RemoveContainer" containerID="0e110ef2792718360be3ee1663482cb6f5cc62b4790878591732d8863f4f7e26" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.068585 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.124789 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.124842 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/dd339abc-691c-48f1-8674-430a5e806067-rabbitmq-confd\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.124859 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.124879 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/dd339abc-691c-48f1-8674-430a5e806067-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.135367 5120 scope.go:117] "RemoveContainer" containerID="1d86c8a64a5053fae6269345960dc10f867eed9fabe6851c22755daab8918cf7" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.139631 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.140833 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-2aa5-account-create-update-hwk8n"] Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.158988 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-2aa5-account-create-update-hwk8n"] Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.162221 5120 scope.go:117] "RemoveContainer" containerID="a1aa89d0956d7cc1f2770a8dab38997b4d225b5aa9872ace287bcdf25277bee6" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.172243 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.185729 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.242520 5120 scope.go:117] "RemoveContainer" containerID="225427a7164236eebc876d896eb6bae3e01836e1b1bbff01894a12e5711cbebe" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.284204 5120 scope.go:117] "RemoveContainer" containerID="1c888e1bf36153dbf6a4f93c8017fd1758b86095191da4b03dcef06e933c34bf" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.328847 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"persistence\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"d6906541-8dff-40ed-a064-5777f4b66f24\" (UID: \"d6906541-8dff-40ed-a064-5777f4b66f24\") " Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.328949 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/d6906541-8dff-40ed-a064-5777f4b66f24-rabbitmq-plugins\") pod \"d6906541-8dff-40ed-a064-5777f4b66f24\" (UID: \"d6906541-8dff-40ed-a064-5777f4b66f24\") " Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.328995 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/d6906541-8dff-40ed-a064-5777f4b66f24-rabbitmq-confd\") pod \"d6906541-8dff-40ed-a064-5777f4b66f24\" (UID: \"d6906541-8dff-40ed-a064-5777f4b66f24\") " Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.329013 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/d6906541-8dff-40ed-a064-5777f4b66f24-server-conf\") pod \"d6906541-8dff-40ed-a064-5777f4b66f24\" (UID: \"d6906541-8dff-40ed-a064-5777f4b66f24\") " Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.329094 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/d6906541-8dff-40ed-a064-5777f4b66f24-erlang-cookie-secret\") pod \"d6906541-8dff-40ed-a064-5777f4b66f24\" (UID: \"d6906541-8dff-40ed-a064-5777f4b66f24\") " Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.329318 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/d6906541-8dff-40ed-a064-5777f4b66f24-plugins-conf\") pod \"d6906541-8dff-40ed-a064-5777f4b66f24\" (UID: \"d6906541-8dff-40ed-a064-5777f4b66f24\") " Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.329456 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/d6906541-8dff-40ed-a064-5777f4b66f24-config-data\") pod \"d6906541-8dff-40ed-a064-5777f4b66f24\" (UID: \"d6906541-8dff-40ed-a064-5777f4b66f24\") " Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.329546 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/d6906541-8dff-40ed-a064-5777f4b66f24-rabbitmq-erlang-cookie\") pod \"d6906541-8dff-40ed-a064-5777f4b66f24\" (UID: \"d6906541-8dff-40ed-a064-5777f4b66f24\") " Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.329567 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6906541-8dff-40ed-a064-5777f4b66f24-rabbitmq-plugins" (OuterVolumeSpecName: "rabbitmq-plugins") pod "d6906541-8dff-40ed-a064-5777f4b66f24" (UID: "d6906541-8dff-40ed-a064-5777f4b66f24"). InnerVolumeSpecName "rabbitmq-plugins". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.329598 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w4kbg\" (UniqueName: \"kubernetes.io/projected/d6906541-8dff-40ed-a064-5777f4b66f24-kube-api-access-w4kbg\") pod \"d6906541-8dff-40ed-a064-5777f4b66f24\" (UID: \"d6906541-8dff-40ed-a064-5777f4b66f24\") " Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.329684 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/d6906541-8dff-40ed-a064-5777f4b66f24-pod-info\") pod \"d6906541-8dff-40ed-a064-5777f4b66f24\" (UID: \"d6906541-8dff-40ed-a064-5777f4b66f24\") " Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.330235 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6906541-8dff-40ed-a064-5777f4b66f24-plugins-conf" (OuterVolumeSpecName: "plugins-conf") pod "d6906541-8dff-40ed-a064-5777f4b66f24" (UID: "d6906541-8dff-40ed-a064-5777f4b66f24"). InnerVolumeSpecName "plugins-conf". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.330245 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/d6906541-8dff-40ed-a064-5777f4b66f24-rabbitmq-tls\") pod \"d6906541-8dff-40ed-a064-5777f4b66f24\" (UID: \"d6906541-8dff-40ed-a064-5777f4b66f24\") " Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.331169 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6906541-8dff-40ed-a064-5777f4b66f24-rabbitmq-erlang-cookie" (OuterVolumeSpecName: "rabbitmq-erlang-cookie") pod "d6906541-8dff-40ed-a064-5777f4b66f24" (UID: "d6906541-8dff-40ed-a064-5777f4b66f24"). InnerVolumeSpecName "rabbitmq-erlang-cookie". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.331865 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3fae0e8f-e6a0-4031-a030-3e380aaf68a8-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.331888 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/d6906541-8dff-40ed-a064-5777f4b66f24-rabbitmq-plugins\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.331901 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bn7mm\" (UniqueName: \"kubernetes.io/projected/3fae0e8f-e6a0-4031-a030-3e380aaf68a8-kube-api-access-bn7mm\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.331917 5120 reconciler_common.go:299] "Volume detached for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/d6906541-8dff-40ed-a064-5777f4b66f24-plugins-conf\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.331928 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/d6906541-8dff-40ed-a064-5777f4b66f24-rabbitmq-erlang-cookie\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.336697 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage12-crc" (OuterVolumeSpecName: "persistence") pod "d6906541-8dff-40ed-a064-5777f4b66f24" (UID: "d6906541-8dff-40ed-a064-5777f4b66f24"). InnerVolumeSpecName "local-storage12-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.337973 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6906541-8dff-40ed-a064-5777f4b66f24-erlang-cookie-secret" (OuterVolumeSpecName: "erlang-cookie-secret") pod "d6906541-8dff-40ed-a064-5777f4b66f24" (UID: "d6906541-8dff-40ed-a064-5777f4b66f24"). InnerVolumeSpecName "erlang-cookie-secret". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.338083 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d6906541-8dff-40ed-a064-5777f4b66f24-pod-info" (OuterVolumeSpecName: "pod-info") pod "d6906541-8dff-40ed-a064-5777f4b66f24" (UID: "d6906541-8dff-40ed-a064-5777f4b66f24"). InnerVolumeSpecName "pod-info". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.338150 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6906541-8dff-40ed-a064-5777f4b66f24-rabbitmq-tls" (OuterVolumeSpecName: "rabbitmq-tls") pod "d6906541-8dff-40ed-a064-5777f4b66f24" (UID: "d6906541-8dff-40ed-a064-5777f4b66f24"). InnerVolumeSpecName "rabbitmq-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.378569 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6906541-8dff-40ed-a064-5777f4b66f24-kube-api-access-w4kbg" (OuterVolumeSpecName: "kube-api-access-w4kbg") pod "d6906541-8dff-40ed-a064-5777f4b66f24" (UID: "d6906541-8dff-40ed-a064-5777f4b66f24"). InnerVolumeSpecName "kube-api-access-w4kbg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.380512 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6906541-8dff-40ed-a064-5777f4b66f24-config-data" (OuterVolumeSpecName: "config-data") pod "d6906541-8dff-40ed-a064-5777f4b66f24" (UID: "d6906541-8dff-40ed-a064-5777f4b66f24"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.417023 5120 scope.go:117] "RemoveContainer" containerID="6a0c6ad8632a2e4381f6d9e14ae012bdf8c057b6396c717785fda31fa5fcd085" Mar 16 17:17:30 crc kubenswrapper[5120]: E0316 17:17:30.417603 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a0c6ad8632a2e4381f6d9e14ae012bdf8c057b6396c717785fda31fa5fcd085\": container with ID starting with 6a0c6ad8632a2e4381f6d9e14ae012bdf8c057b6396c717785fda31fa5fcd085 not found: ID does not exist" containerID="6a0c6ad8632a2e4381f6d9e14ae012bdf8c057b6396c717785fda31fa5fcd085" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.417684 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a0c6ad8632a2e4381f6d9e14ae012bdf8c057b6396c717785fda31fa5fcd085"} err="failed to get container status \"6a0c6ad8632a2e4381f6d9e14ae012bdf8c057b6396c717785fda31fa5fcd085\": rpc error: code = NotFound desc = could not find container \"6a0c6ad8632a2e4381f6d9e14ae012bdf8c057b6396c717785fda31fa5fcd085\": container with ID starting with 6a0c6ad8632a2e4381f6d9e14ae012bdf8c057b6396c717785fda31fa5fcd085 not found: ID does not exist" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.419343 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6906541-8dff-40ed-a064-5777f4b66f24-server-conf" (OuterVolumeSpecName: "server-conf") pod "d6906541-8dff-40ed-a064-5777f4b66f24" (UID: "d6906541-8dff-40ed-a064-5777f4b66f24"). InnerVolumeSpecName "server-conf". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.433426 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-northd-0_161d5626-9918-4847-96fd-f93d894bc230/ovn-northd/0.log" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.433504 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.434753 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") on node \"crc\" " Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.434863 5120 reconciler_common.go:299] "Volume detached for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/d6906541-8dff-40ed-a064-5777f4b66f24-server-conf\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.434879 5120 reconciler_common.go:299] "Volume detached for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/d6906541-8dff-40ed-a064-5777f4b66f24-erlang-cookie-secret\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.434894 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/d6906541-8dff-40ed-a064-5777f4b66f24-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.434907 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w4kbg\" (UniqueName: \"kubernetes.io/projected/d6906541-8dff-40ed-a064-5777f4b66f24-kube-api-access-w4kbg\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.434918 5120 reconciler_common.go:299] "Volume detached for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/d6906541-8dff-40ed-a064-5777f4b66f24-pod-info\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.434929 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/d6906541-8dff-40ed-a064-5777f4b66f24-rabbitmq-tls\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.452218 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6906541-8dff-40ed-a064-5777f4b66f24-rabbitmq-confd" (OuterVolumeSpecName: "rabbitmq-confd") pod "d6906541-8dff-40ed-a064-5777f4b66f24" (UID: "d6906541-8dff-40ed-a064-5777f4b66f24"). InnerVolumeSpecName "rabbitmq-confd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.463877 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage12-crc" (UniqueName: "kubernetes.io/local-volume/local-storage12-crc") on node "crc" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.539241 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/161d5626-9918-4847-96fd-f93d894bc230-combined-ca-bundle\") pod \"161d5626-9918-4847-96fd-f93d894bc230\" (UID: \"161d5626-9918-4847-96fd-f93d894bc230\") " Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.539618 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/161d5626-9918-4847-96fd-f93d894bc230-ovn-rundir\") pod \"161d5626-9918-4847-96fd-f93d894bc230\" (UID: \"161d5626-9918-4847-96fd-f93d894bc230\") " Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.539722 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/161d5626-9918-4847-96fd-f93d894bc230-ovn-northd-tls-certs\") pod \"161d5626-9918-4847-96fd-f93d894bc230\" (UID: \"161d5626-9918-4847-96fd-f93d894bc230\") " Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.539852 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/161d5626-9918-4847-96fd-f93d894bc230-scripts\") pod \"161d5626-9918-4847-96fd-f93d894bc230\" (UID: \"161d5626-9918-4847-96fd-f93d894bc230\") " Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.539897 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/161d5626-9918-4847-96fd-f93d894bc230-config\") pod \"161d5626-9918-4847-96fd-f93d894bc230\" (UID: \"161d5626-9918-4847-96fd-f93d894bc230\") " Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.540299 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/161d5626-9918-4847-96fd-f93d894bc230-metrics-certs-tls-certs\") pod \"161d5626-9918-4847-96fd-f93d894bc230\" (UID: \"161d5626-9918-4847-96fd-f93d894bc230\") " Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.540378 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jqdnt\" (UniqueName: \"kubernetes.io/projected/161d5626-9918-4847-96fd-f93d894bc230-kube-api-access-jqdnt\") pod \"161d5626-9918-4847-96fd-f93d894bc230\" (UID: \"161d5626-9918-4847-96fd-f93d894bc230\") " Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.541713 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.541733 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/d6906541-8dff-40ed-a064-5777f4b66f24-rabbitmq-confd\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.542172 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/161d5626-9918-4847-96fd-f93d894bc230-ovn-rundir" (OuterVolumeSpecName: "ovn-rundir") pod "161d5626-9918-4847-96fd-f93d894bc230" (UID: "161d5626-9918-4847-96fd-f93d894bc230"). InnerVolumeSpecName "ovn-rundir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.542409 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/161d5626-9918-4847-96fd-f93d894bc230-config" (OuterVolumeSpecName: "config") pod "161d5626-9918-4847-96fd-f93d894bc230" (UID: "161d5626-9918-4847-96fd-f93d894bc230"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.542635 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/161d5626-9918-4847-96fd-f93d894bc230-scripts" (OuterVolumeSpecName: "scripts") pod "161d5626-9918-4847-96fd-f93d894bc230" (UID: "161d5626-9918-4847-96fd-f93d894bc230"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.549904 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/161d5626-9918-4847-96fd-f93d894bc230-kube-api-access-jqdnt" (OuterVolumeSpecName: "kube-api-access-jqdnt") pod "161d5626-9918-4847-96fd-f93d894bc230" (UID: "161d5626-9918-4847-96fd-f93d894bc230"). InnerVolumeSpecName "kube-api-access-jqdnt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.609022 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/161d5626-9918-4847-96fd-f93d894bc230-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "161d5626-9918-4847-96fd-f93d894bc230" (UID: "161d5626-9918-4847-96fd-f93d894bc230"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.619391 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/161d5626-9918-4847-96fd-f93d894bc230-ovn-northd-tls-certs" (OuterVolumeSpecName: "ovn-northd-tls-certs") pod "161d5626-9918-4847-96fd-f93d894bc230" (UID: "161d5626-9918-4847-96fd-f93d894bc230"). InnerVolumeSpecName "ovn-northd-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.626839 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/161d5626-9918-4847-96fd-f93d894bc230-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "161d5626-9918-4847-96fd-f93d894bc230" (UID: "161d5626-9918-4847-96fd-f93d894bc230"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.647959 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jqdnt\" (UniqueName: \"kubernetes.io/projected/161d5626-9918-4847-96fd-f93d894bc230-kube-api-access-jqdnt\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.647994 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/161d5626-9918-4847-96fd-f93d894bc230-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.648004 5120 reconciler_common.go:299] "Volume detached for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/161d5626-9918-4847-96fd-f93d894bc230-ovn-rundir\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.648014 5120 reconciler_common.go:299] "Volume detached for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/161d5626-9918-4847-96fd-f93d894bc230-ovn-northd-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.648022 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/161d5626-9918-4847-96fd-f93d894bc230-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.648031 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/161d5626-9918-4847-96fd-f93d894bc230-config\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.648039 5120 reconciler_common.go:299] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/161d5626-9918-4847-96fd-f93d894bc230-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.687328 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0a59e429-ba97-491f-91d4-9b1b063fc15b" path="/var/lib/kubelet/pods/0a59e429-ba97-491f-91d4-9b1b063fc15b/volumes" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.687926 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1976af1c-93c9-487c-9852-752bb5c1234d" path="/var/lib/kubelet/pods/1976af1c-93c9-487c-9852-752bb5c1234d/volumes" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.688374 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3fae0e8f-e6a0-4031-a030-3e380aaf68a8" path="/var/lib/kubelet/pods/3fae0e8f-e6a0-4031-a030-3e380aaf68a8/volumes" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.688720 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="54551b0a-84c0-40c7-a1d1-64dfbf2fd0d6" path="/var/lib/kubelet/pods/54551b0a-84c0-40c7-a1d1-64dfbf2fd0d6/volumes" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.690362 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="57e08e60-42d1-4b58-9892-c2aa5bbae2cf" path="/var/lib/kubelet/pods/57e08e60-42d1-4b58-9892-c2aa5bbae2cf/volumes" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.691141 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7f4ab831-1080-4b30-9b89-ddbd4d26bbb8" path="/var/lib/kubelet/pods/7f4ab831-1080-4b30-9b89-ddbd4d26bbb8/volumes" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.691750 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a1dfcf19-aecf-49e7-9024-2e8b517fecfb" path="/var/lib/kubelet/pods/a1dfcf19-aecf-49e7-9024-2e8b517fecfb/volumes" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.692856 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a9215705-d766-4151-b079-62d304603586" path="/var/lib/kubelet/pods/a9215705-d766-4151-b079-62d304603586/volumes" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.693375 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bb48cc0c-a6cd-4fc7-9599-1ed43e3eb216" path="/var/lib/kubelet/pods/bb48cc0c-a6cd-4fc7-9599-1ed43e3eb216/volumes" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.693897 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c2e33bc1-ee7f-461d-9faa-b5678f7cb416" path="/var/lib/kubelet/pods/c2e33bc1-ee7f-461d-9faa-b5678f7cb416/volumes" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.695657 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-77d7b5cd69-lf8gf" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.696787 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d14c3978-d254-4ec4-baa0-f011eaef745e" path="/var/lib/kubelet/pods/d14c3978-d254-4ec4-baa0-f011eaef745e/volumes" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.700335 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef7c6f1d-0e78-43bf-99c4-9200f5e67136" path="/var/lib/kubelet/pods/ef7c6f1d-0e78-43bf-99c4-9200f5e67136/volumes" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.773969 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"d6906541-8dff-40ed-a064-5777f4b66f24","Type":"ContainerDied","Data":"cbeab40388fac0d305b9ba2e8abe4bea4504164b12174e2afcb2ca1892a147ca"} Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.774018 5120 scope.go:117] "RemoveContainer" containerID="318e43b1f673c7e18a9bf01910a8401b4e64194498bf8833ebd04325d7873d96" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.774218 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.779216 5120 generic.go:358] "Generic (PLEG): container finished" podID="fcf5af95-be92-4701-9e16-491dbbea165d" containerID="8c1773e53f9dc1cdc250238927d3be0667d25036b8ce26c49878ed36ef7c810b" exitCode=0 Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.779299 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-5c4bd8b884-fjd8f" event={"ID":"fcf5af95-be92-4701-9e16-491dbbea165d","Type":"ContainerDied","Data":"8c1773e53f9dc1cdc250238927d3be0667d25036b8ce26c49878ed36ef7c810b"} Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.781310 5120 generic.go:358] "Generic (PLEG): container finished" podID="3b01ec67-66ba-469f-9eba-1df99165b135" containerID="989a7f158ffb3d42b5d6a2c0845df1cbac6bacb3154bade47643d37307c9560d" exitCode=0 Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.781388 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-77d7b5cd69-lf8gf" event={"ID":"3b01ec67-66ba-469f-9eba-1df99165b135","Type":"ContainerDied","Data":"989a7f158ffb3d42b5d6a2c0845df1cbac6bacb3154bade47643d37307c9560d"} Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.781418 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-77d7b5cd69-lf8gf" event={"ID":"3b01ec67-66ba-469f-9eba-1df99165b135","Type":"ContainerDied","Data":"b2de174870b68b8699e088c4216d450c8f77454ff051d1d968b8daeeb8244af1"} Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.781458 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-77d7b5cd69-lf8gf" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.785512 5120 generic.go:358] "Generic (PLEG): container finished" podID="3ce6e6cf-688e-4f59-8ca2-f3c79e2a1857" containerID="48ca29deeb5b87ce933a4ad925ce32bca80c4d92aaa4dcb028add038eef91294" exitCode=0 Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.785587 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-5d6b4bc659-md7vt" event={"ID":"3ce6e6cf-688e-4f59-8ca2-f3c79e2a1857","Type":"ContainerDied","Data":"48ca29deeb5b87ce933a4ad925ce32bca80c4d92aaa4dcb028add038eef91294"} Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.820459 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.829077 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.831439 5120 scope.go:117] "RemoveContainer" containerID="48641c4ff11ddd43749ffe7662326076906b73bc16bab3455ff38bcd51f91ee9" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.831829 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-northd-0_161d5626-9918-4847-96fd-f93d894bc230/ovn-northd/0.log" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.831871 5120 generic.go:358] "Generic (PLEG): container finished" podID="161d5626-9918-4847-96fd-f93d894bc230" containerID="24333b7cdb26c2e70048e18dcdaeac57a05c823200ef25ebc7bd2a0912464cf3" exitCode=139 Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.831998 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.832031 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"161d5626-9918-4847-96fd-f93d894bc230","Type":"ContainerDied","Data":"24333b7cdb26c2e70048e18dcdaeac57a05c823200ef25ebc7bd2a0912464cf3"} Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.832052 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"161d5626-9918-4847-96fd-f93d894bc230","Type":"ContainerDied","Data":"1b0b7d3e06d8620f79c8af00a60dd6b426036119a767ed60b5bb74e6a61db2b6"} Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.851913 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.853158 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.854201 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h9wlc\" (UniqueName: \"kubernetes.io/projected/3b01ec67-66ba-469f-9eba-1df99165b135-kube-api-access-h9wlc\") pod \"3b01ec67-66ba-469f-9eba-1df99165b135\" (UID: \"3b01ec67-66ba-469f-9eba-1df99165b135\") " Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.855008 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3b01ec67-66ba-469f-9eba-1df99165b135-scripts\") pod \"3b01ec67-66ba-469f-9eba-1df99165b135\" (UID: \"3b01ec67-66ba-469f-9eba-1df99165b135\") " Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.855081 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3b01ec67-66ba-469f-9eba-1df99165b135-combined-ca-bundle\") pod \"3b01ec67-66ba-469f-9eba-1df99165b135\" (UID: \"3b01ec67-66ba-469f-9eba-1df99165b135\") " Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.855177 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/3b01ec67-66ba-469f-9eba-1df99165b135-internal-tls-certs\") pod \"3b01ec67-66ba-469f-9eba-1df99165b135\" (UID: \"3b01ec67-66ba-469f-9eba-1df99165b135\") " Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.856352 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3b01ec67-66ba-469f-9eba-1df99165b135-config-data\") pod \"3b01ec67-66ba-469f-9eba-1df99165b135\" (UID: \"3b01ec67-66ba-469f-9eba-1df99165b135\") " Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.856383 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/3b01ec67-66ba-469f-9eba-1df99165b135-public-tls-certs\") pod \"3b01ec67-66ba-469f-9eba-1df99165b135\" (UID: \"3b01ec67-66ba-469f-9eba-1df99165b135\") " Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.856474 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/3b01ec67-66ba-469f-9eba-1df99165b135-credential-keys\") pod \"3b01ec67-66ba-469f-9eba-1df99165b135\" (UID: \"3b01ec67-66ba-469f-9eba-1df99165b135\") " Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.856632 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/3b01ec67-66ba-469f-9eba-1df99165b135-fernet-keys\") pod \"3b01ec67-66ba-469f-9eba-1df99165b135\" (UID: \"3b01ec67-66ba-469f-9eba-1df99165b135\") " Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.857601 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b01ec67-66ba-469f-9eba-1df99165b135-kube-api-access-h9wlc" (OuterVolumeSpecName: "kube-api-access-h9wlc") pod "3b01ec67-66ba-469f-9eba-1df99165b135" (UID: "3b01ec67-66ba-469f-9eba-1df99165b135"). InnerVolumeSpecName "kube-api-access-h9wlc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.857926 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-5d6b4bc659-md7vt" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.859902 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.862529 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b01ec67-66ba-469f-9eba-1df99165b135-scripts" (OuterVolumeSpecName: "scripts") pod "3b01ec67-66ba-469f-9eba-1df99165b135" (UID: "3b01ec67-66ba-469f-9eba-1df99165b135"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.867941 5120 scope.go:117] "RemoveContainer" containerID="989a7f158ffb3d42b5d6a2c0845df1cbac6bacb3154bade47643d37307c9560d" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.867942 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b01ec67-66ba-469f-9eba-1df99165b135-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "3b01ec67-66ba-469f-9eba-1df99165b135" (UID: "3b01ec67-66ba-469f-9eba-1df99165b135"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.867984 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b01ec67-66ba-469f-9eba-1df99165b135-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "3b01ec67-66ba-469f-9eba-1df99165b135" (UID: "3b01ec67-66ba-469f-9eba-1df99165b135"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.873112 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.882866 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-5c4bd8b884-fjd8f" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.896248 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b01ec67-66ba-469f-9eba-1df99165b135-config-data" (OuterVolumeSpecName: "config-data") pod "3b01ec67-66ba-469f-9eba-1df99165b135" (UID: "3b01ec67-66ba-469f-9eba-1df99165b135"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.903438 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.906136 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b01ec67-66ba-469f-9eba-1df99165b135-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "3b01ec67-66ba-469f-9eba-1df99165b135" (UID: "3b01ec67-66ba-469f-9eba-1df99165b135"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.906187 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.920023 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.926462 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.931992 5120 scope.go:117] "RemoveContainer" containerID="989a7f158ffb3d42b5d6a2c0845df1cbac6bacb3154bade47643d37307c9560d" Mar 16 17:17:30 crc kubenswrapper[5120]: E0316 17:17:30.932429 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"989a7f158ffb3d42b5d6a2c0845df1cbac6bacb3154bade47643d37307c9560d\": container with ID starting with 989a7f158ffb3d42b5d6a2c0845df1cbac6bacb3154bade47643d37307c9560d not found: ID does not exist" containerID="989a7f158ffb3d42b5d6a2c0845df1cbac6bacb3154bade47643d37307c9560d" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.932488 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"989a7f158ffb3d42b5d6a2c0845df1cbac6bacb3154bade47643d37307c9560d"} err="failed to get container status \"989a7f158ffb3d42b5d6a2c0845df1cbac6bacb3154bade47643d37307c9560d\": rpc error: code = NotFound desc = could not find container \"989a7f158ffb3d42b5d6a2c0845df1cbac6bacb3154bade47643d37307c9560d\": container with ID starting with 989a7f158ffb3d42b5d6a2c0845df1cbac6bacb3154bade47643d37307c9560d not found: ID does not exist" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.932510 5120 scope.go:117] "RemoveContainer" containerID="232557928a11f779afc7e7739d08c9c5eae278bdb6cad4018a9b79f28340ae03" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.942906 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b01ec67-66ba-469f-9eba-1df99165b135-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "3b01ec67-66ba-469f-9eba-1df99165b135" (UID: "3b01ec67-66ba-469f-9eba-1df99165b135"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.952994 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b01ec67-66ba-469f-9eba-1df99165b135-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "3b01ec67-66ba-469f-9eba-1df99165b135" (UID: "3b01ec67-66ba-469f-9eba-1df99165b135"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.958814 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3ce6e6cf-688e-4f59-8ca2-f3c79e2a1857-config-data\") pod \"3ce6e6cf-688e-4f59-8ca2-f3c79e2a1857\" (UID: \"3ce6e6cf-688e-4f59-8ca2-f3c79e2a1857\") " Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.958885 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fcf5af95-be92-4701-9e16-491dbbea165d-config-data\") pod \"fcf5af95-be92-4701-9e16-491dbbea165d\" (UID: \"fcf5af95-be92-4701-9e16-491dbbea165d\") " Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.958948 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/fcf5af95-be92-4701-9e16-491dbbea165d-logs\") pod \"fcf5af95-be92-4701-9e16-491dbbea165d\" (UID: \"fcf5af95-be92-4701-9e16-491dbbea165d\") " Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.958994 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/fcf5af95-be92-4701-9e16-491dbbea165d-config-data-custom\") pod \"fcf5af95-be92-4701-9e16-491dbbea165d\" (UID: \"fcf5af95-be92-4701-9e16-491dbbea165d\") " Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.959104 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5jcj6\" (UniqueName: \"kubernetes.io/projected/fcf5af95-be92-4701-9e16-491dbbea165d-kube-api-access-5jcj6\") pod \"fcf5af95-be92-4701-9e16-491dbbea165d\" (UID: \"fcf5af95-be92-4701-9e16-491dbbea165d\") " Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.959197 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fcf5af95-be92-4701-9e16-491dbbea165d-combined-ca-bundle\") pod \"fcf5af95-be92-4701-9e16-491dbbea165d\" (UID: \"fcf5af95-be92-4701-9e16-491dbbea165d\") " Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.959294 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/3ce6e6cf-688e-4f59-8ca2-f3c79e2a1857-config-data-custom\") pod \"3ce6e6cf-688e-4f59-8ca2-f3c79e2a1857\" (UID: \"3ce6e6cf-688e-4f59-8ca2-f3c79e2a1857\") " Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.959318 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3ce6e6cf-688e-4f59-8ca2-f3c79e2a1857-logs\") pod \"3ce6e6cf-688e-4f59-8ca2-f3c79e2a1857\" (UID: \"3ce6e6cf-688e-4f59-8ca2-f3c79e2a1857\") " Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.959373 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g9v4m\" (UniqueName: \"kubernetes.io/projected/3ce6e6cf-688e-4f59-8ca2-f3c79e2a1857-kube-api-access-g9v4m\") pod \"3ce6e6cf-688e-4f59-8ca2-f3c79e2a1857\" (UID: \"3ce6e6cf-688e-4f59-8ca2-f3c79e2a1857\") " Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.959515 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3ce6e6cf-688e-4f59-8ca2-f3c79e2a1857-combined-ca-bundle\") pod \"3ce6e6cf-688e-4f59-8ca2-f3c79e2a1857\" (UID: \"3ce6e6cf-688e-4f59-8ca2-f3c79e2a1857\") " Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.960683 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3b01ec67-66ba-469f-9eba-1df99165b135-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.960707 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3b01ec67-66ba-469f-9eba-1df99165b135-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.960717 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/3b01ec67-66ba-469f-9eba-1df99165b135-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.960726 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3b01ec67-66ba-469f-9eba-1df99165b135-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.960736 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/3b01ec67-66ba-469f-9eba-1df99165b135-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.960744 5120 reconciler_common.go:299] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/3b01ec67-66ba-469f-9eba-1df99165b135-credential-keys\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.960766 5120 reconciler_common.go:299] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/3b01ec67-66ba-469f-9eba-1df99165b135-fernet-keys\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.960778 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h9wlc\" (UniqueName: \"kubernetes.io/projected/3b01ec67-66ba-469f-9eba-1df99165b135-kube-api-access-h9wlc\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.963481 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ce6e6cf-688e-4f59-8ca2-f3c79e2a1857-logs" (OuterVolumeSpecName: "logs") pod "3ce6e6cf-688e-4f59-8ca2-f3c79e2a1857" (UID: "3ce6e6cf-688e-4f59-8ca2-f3c79e2a1857"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.964526 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fcf5af95-be92-4701-9e16-491dbbea165d-logs" (OuterVolumeSpecName: "logs") pod "fcf5af95-be92-4701-9e16-491dbbea165d" (UID: "fcf5af95-be92-4701-9e16-491dbbea165d"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.967098 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fcf5af95-be92-4701-9e16-491dbbea165d-kube-api-access-5jcj6" (OuterVolumeSpecName: "kube-api-access-5jcj6") pod "fcf5af95-be92-4701-9e16-491dbbea165d" (UID: "fcf5af95-be92-4701-9e16-491dbbea165d"). InnerVolumeSpecName "kube-api-access-5jcj6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.967322 5120 scope.go:117] "RemoveContainer" containerID="24333b7cdb26c2e70048e18dcdaeac57a05c823200ef25ebc7bd2a0912464cf3" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.973087 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ce6e6cf-688e-4f59-8ca2-f3c79e2a1857-kube-api-access-g9v4m" (OuterVolumeSpecName: "kube-api-access-g9v4m") pod "3ce6e6cf-688e-4f59-8ca2-f3c79e2a1857" (UID: "3ce6e6cf-688e-4f59-8ca2-f3c79e2a1857"). InnerVolumeSpecName "kube-api-access-g9v4m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.975483 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fcf5af95-be92-4701-9e16-491dbbea165d-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "fcf5af95-be92-4701-9e16-491dbbea165d" (UID: "fcf5af95-be92-4701-9e16-491dbbea165d"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.977320 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3ce6e6cf-688e-4f59-8ca2-f3c79e2a1857-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "3ce6e6cf-688e-4f59-8ca2-f3c79e2a1857" (UID: "3ce6e6cf-688e-4f59-8ca2-f3c79e2a1857"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.990973 5120 scope.go:117] "RemoveContainer" containerID="232557928a11f779afc7e7739d08c9c5eae278bdb6cad4018a9b79f28340ae03" Mar 16 17:17:30 crc kubenswrapper[5120]: E0316 17:17:30.995750 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"232557928a11f779afc7e7739d08c9c5eae278bdb6cad4018a9b79f28340ae03\": container with ID starting with 232557928a11f779afc7e7739d08c9c5eae278bdb6cad4018a9b79f28340ae03 not found: ID does not exist" containerID="232557928a11f779afc7e7739d08c9c5eae278bdb6cad4018a9b79f28340ae03" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.995820 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"232557928a11f779afc7e7739d08c9c5eae278bdb6cad4018a9b79f28340ae03"} err="failed to get container status \"232557928a11f779afc7e7739d08c9c5eae278bdb6cad4018a9b79f28340ae03\": rpc error: code = NotFound desc = could not find container \"232557928a11f779afc7e7739d08c9c5eae278bdb6cad4018a9b79f28340ae03\": container with ID starting with 232557928a11f779afc7e7739d08c9c5eae278bdb6cad4018a9b79f28340ae03 not found: ID does not exist" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.995850 5120 scope.go:117] "RemoveContainer" containerID="24333b7cdb26c2e70048e18dcdaeac57a05c823200ef25ebc7bd2a0912464cf3" Mar 16 17:17:30 crc kubenswrapper[5120]: E0316 17:17:30.996349 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"24333b7cdb26c2e70048e18dcdaeac57a05c823200ef25ebc7bd2a0912464cf3\": container with ID starting with 24333b7cdb26c2e70048e18dcdaeac57a05c823200ef25ebc7bd2a0912464cf3 not found: ID does not exist" containerID="24333b7cdb26c2e70048e18dcdaeac57a05c823200ef25ebc7bd2a0912464cf3" Mar 16 17:17:30 crc kubenswrapper[5120]: I0316 17:17:30.996384 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24333b7cdb26c2e70048e18dcdaeac57a05c823200ef25ebc7bd2a0912464cf3"} err="failed to get container status \"24333b7cdb26c2e70048e18dcdaeac57a05c823200ef25ebc7bd2a0912464cf3\": rpc error: code = NotFound desc = could not find container \"24333b7cdb26c2e70048e18dcdaeac57a05c823200ef25ebc7bd2a0912464cf3\": container with ID starting with 24333b7cdb26c2e70048e18dcdaeac57a05c823200ef25ebc7bd2a0912464cf3 not found: ID does not exist" Mar 16 17:17:31 crc kubenswrapper[5120]: I0316 17:17:31.006037 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3ce6e6cf-688e-4f59-8ca2-f3c79e2a1857-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "3ce6e6cf-688e-4f59-8ca2-f3c79e2a1857" (UID: "3ce6e6cf-688e-4f59-8ca2-f3c79e2a1857"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:17:31 crc kubenswrapper[5120]: I0316 17:17:31.017681 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3ce6e6cf-688e-4f59-8ca2-f3c79e2a1857-config-data" (OuterVolumeSpecName: "config-data") pod "3ce6e6cf-688e-4f59-8ca2-f3c79e2a1857" (UID: "3ce6e6cf-688e-4f59-8ca2-f3c79e2a1857"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:17:31 crc kubenswrapper[5120]: I0316 17:17:31.020201 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fcf5af95-be92-4701-9e16-491dbbea165d-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "fcf5af95-be92-4701-9e16-491dbbea165d" (UID: "fcf5af95-be92-4701-9e16-491dbbea165d"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:17:31 crc kubenswrapper[5120]: I0316 17:17:31.023454 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fcf5af95-be92-4701-9e16-491dbbea165d-config-data" (OuterVolumeSpecName: "config-data") pod "fcf5af95-be92-4701-9e16-491dbbea165d" (UID: "fcf5af95-be92-4701-9e16-491dbbea165d"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:17:31 crc kubenswrapper[5120]: I0316 17:17:31.062389 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/fcf5af95-be92-4701-9e16-491dbbea165d-logs\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:31 crc kubenswrapper[5120]: I0316 17:17:31.062434 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/fcf5af95-be92-4701-9e16-491dbbea165d-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:31 crc kubenswrapper[5120]: I0316 17:17:31.062446 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5jcj6\" (UniqueName: \"kubernetes.io/projected/fcf5af95-be92-4701-9e16-491dbbea165d-kube-api-access-5jcj6\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:31 crc kubenswrapper[5120]: I0316 17:17:31.062456 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fcf5af95-be92-4701-9e16-491dbbea165d-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:31 crc kubenswrapper[5120]: I0316 17:17:31.062465 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/3ce6e6cf-688e-4f59-8ca2-f3c79e2a1857-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:31 crc kubenswrapper[5120]: I0316 17:17:31.062474 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3ce6e6cf-688e-4f59-8ca2-f3c79e2a1857-logs\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:31 crc kubenswrapper[5120]: I0316 17:17:31.062483 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g9v4m\" (UniqueName: \"kubernetes.io/projected/3ce6e6cf-688e-4f59-8ca2-f3c79e2a1857-kube-api-access-g9v4m\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:31 crc kubenswrapper[5120]: I0316 17:17:31.062491 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3ce6e6cf-688e-4f59-8ca2-f3c79e2a1857-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:31 crc kubenswrapper[5120]: I0316 17:17:31.062500 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3ce6e6cf-688e-4f59-8ca2-f3c79e2a1857-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:31 crc kubenswrapper[5120]: I0316 17:17:31.062534 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fcf5af95-be92-4701-9e16-491dbbea165d-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:31 crc kubenswrapper[5120]: I0316 17:17:31.132955 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-77d7b5cd69-lf8gf"] Mar 16 17:17:31 crc kubenswrapper[5120]: I0316 17:17:31.140898 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-77d7b5cd69-lf8gf"] Mar 16 17:17:31 crc kubenswrapper[5120]: E0316 17:17:31.162532 5120 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod71a73270_e23b_42a7_a1f4_ad174eab2ac7.slice/crio-bd045fa777b0ca425826b20941db498f3c9fc6247b98751b1ce64168b1b98e09.scope\": RecentStats: unable to find data in memory cache]" Mar 16 17:17:31 crc kubenswrapper[5120]: I0316 17:17:31.910499 5120 generic.go:358] "Generic (PLEG): container finished" podID="71a73270-e23b-42a7-a1f4-ad174eab2ac7" containerID="bd045fa777b0ca425826b20941db498f3c9fc6247b98751b1ce64168b1b98e09" exitCode=0 Mar 16 17:17:31 crc kubenswrapper[5120]: I0316 17:17:31.910949 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"71a73270-e23b-42a7-a1f4-ad174eab2ac7","Type":"ContainerDied","Data":"bd045fa777b0ca425826b20941db498f3c9fc6247b98751b1ce64168b1b98e09"} Mar 16 17:17:31 crc kubenswrapper[5120]: I0316 17:17:31.915483 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-5c4bd8b884-fjd8f" event={"ID":"fcf5af95-be92-4701-9e16-491dbbea165d","Type":"ContainerDied","Data":"e3c4e932ab34eb11acc27a3f8fbc015f11ac25214932d8401549085750ffaab7"} Mar 16 17:17:31 crc kubenswrapper[5120]: I0316 17:17:31.915542 5120 scope.go:117] "RemoveContainer" containerID="8c1773e53f9dc1cdc250238927d3be0667d25036b8ce26c49878ed36ef7c810b" Mar 16 17:17:31 crc kubenswrapper[5120]: I0316 17:17:31.915749 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-5c4bd8b884-fjd8f" Mar 16 17:17:31 crc kubenswrapper[5120]: I0316 17:17:31.985235 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-5d6b4bc659-md7vt" Mar 16 17:17:31 crc kubenswrapper[5120]: I0316 17:17:31.985270 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-5d6b4bc659-md7vt" event={"ID":"3ce6e6cf-688e-4f59-8ca2-f3c79e2a1857","Type":"ContainerDied","Data":"b924c5c53f9c77c99fc6cb113d520ee644454aca96d90626146c58d00c8bf96b"} Mar 16 17:17:31 crc kubenswrapper[5120]: I0316 17:17:31.996185 5120 generic.go:358] "Generic (PLEG): container finished" podID="18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62" containerID="8e39abe514cf4d6f8c28475560f3e3a9681167a84d81cdfc9d44be0b89c1cec0" exitCode=0 Mar 16 17:17:31 crc kubenswrapper[5120]: I0316 17:17:31.996352 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62","Type":"ContainerDied","Data":"8e39abe514cf4d6f8c28475560f3e3a9681167a84d81cdfc9d44be0b89c1cec0"} Mar 16 17:17:32 crc kubenswrapper[5120]: I0316 17:17:31.999307 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-5c4bd8b884-fjd8f"] Mar 16 17:17:32 crc kubenswrapper[5120]: I0316 17:17:32.004181 5120 scope.go:117] "RemoveContainer" containerID="66383c38399360c6ccf172717731d52c81d8ad01696fcdb9c511bd983f463335" Mar 16 17:17:32 crc kubenswrapper[5120]: E0316 17:17:32.045629 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of bd045fa777b0ca425826b20941db498f3c9fc6247b98751b1ce64168b1b98e09 is running failed: container process not found" containerID="bd045fa777b0ca425826b20941db498f3c9fc6247b98751b1ce64168b1b98e09" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 17:17:32 crc kubenswrapper[5120]: I0316 17:17:32.047364 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-5c4bd8b884-fjd8f"] Mar 16 17:17:32 crc kubenswrapper[5120]: E0316 17:17:32.050409 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of bd045fa777b0ca425826b20941db498f3c9fc6247b98751b1ce64168b1b98e09 is running failed: container process not found" containerID="bd045fa777b0ca425826b20941db498f3c9fc6247b98751b1ce64168b1b98e09" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 17:17:32 crc kubenswrapper[5120]: E0316 17:17:32.051388 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of bd045fa777b0ca425826b20941db498f3c9fc6247b98751b1ce64168b1b98e09 is running failed: container process not found" containerID="bd045fa777b0ca425826b20941db498f3c9fc6247b98751b1ce64168b1b98e09" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 17:17:32 crc kubenswrapper[5120]: E0316 17:17:32.051568 5120 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of bd045fa777b0ca425826b20941db498f3c9fc6247b98751b1ce64168b1b98e09 is running failed: container process not found" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="71a73270-e23b-42a7-a1f4-ad174eab2ac7" containerName="nova-cell1-conductor-conductor" probeResult="unknown" Mar 16 17:17:32 crc kubenswrapper[5120]: I0316 17:17:32.143396 5120 scope.go:117] "RemoveContainer" containerID="48ca29deeb5b87ce933a4ad925ce32bca80c4d92aaa4dcb028add038eef91294" Mar 16 17:17:32 crc kubenswrapper[5120]: I0316 17:17:32.159809 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-5d6b4bc659-md7vt"] Mar 16 17:17:32 crc kubenswrapper[5120]: I0316 17:17:32.163385 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 17:17:32 crc kubenswrapper[5120]: I0316 17:17:32.169382 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-worker-5d6b4bc659-md7vt"] Mar 16 17:17:32 crc kubenswrapper[5120]: I0316 17:17:32.221322 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/71a73270-e23b-42a7-a1f4-ad174eab2ac7-combined-ca-bundle\") pod \"71a73270-e23b-42a7-a1f4-ad174eab2ac7\" (UID: \"71a73270-e23b-42a7-a1f4-ad174eab2ac7\") " Mar 16 17:17:32 crc kubenswrapper[5120]: I0316 17:17:32.221436 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/71a73270-e23b-42a7-a1f4-ad174eab2ac7-config-data\") pod \"71a73270-e23b-42a7-a1f4-ad174eab2ac7\" (UID: \"71a73270-e23b-42a7-a1f4-ad174eab2ac7\") " Mar 16 17:17:32 crc kubenswrapper[5120]: I0316 17:17:32.221602 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9jvdz\" (UniqueName: \"kubernetes.io/projected/71a73270-e23b-42a7-a1f4-ad174eab2ac7-kube-api-access-9jvdz\") pod \"71a73270-e23b-42a7-a1f4-ad174eab2ac7\" (UID: \"71a73270-e23b-42a7-a1f4-ad174eab2ac7\") " Mar 16 17:17:32 crc kubenswrapper[5120]: I0316 17:17:32.233105 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71a73270-e23b-42a7-a1f4-ad174eab2ac7-kube-api-access-9jvdz" (OuterVolumeSpecName: "kube-api-access-9jvdz") pod "71a73270-e23b-42a7-a1f4-ad174eab2ac7" (UID: "71a73270-e23b-42a7-a1f4-ad174eab2ac7"). InnerVolumeSpecName "kube-api-access-9jvdz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:17:32 crc kubenswrapper[5120]: I0316 17:17:32.245808 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/71a73270-e23b-42a7-a1f4-ad174eab2ac7-config-data" (OuterVolumeSpecName: "config-data") pod "71a73270-e23b-42a7-a1f4-ad174eab2ac7" (UID: "71a73270-e23b-42a7-a1f4-ad174eab2ac7"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:17:32 crc kubenswrapper[5120]: I0316 17:17:32.249817 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/71a73270-e23b-42a7-a1f4-ad174eab2ac7-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "71a73270-e23b-42a7-a1f4-ad174eab2ac7" (UID: "71a73270-e23b-42a7-a1f4-ad174eab2ac7"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:17:32 crc kubenswrapper[5120]: I0316 17:17:32.261084 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:17:32 crc kubenswrapper[5120]: I0316 17:17:32.265425 5120 scope.go:117] "RemoveContainer" containerID="880d0ca08b00931b006e4aa507711a2f5a37cf65567008eb271716928427a38d" Mar 16 17:17:32 crc kubenswrapper[5120]: I0316 17:17:32.323657 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62-combined-ca-bundle\") pod \"18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62\" (UID: \"18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62\") " Mar 16 17:17:32 crc kubenswrapper[5120]: I0316 17:17:32.323711 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62-log-httpd\") pod \"18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62\" (UID: \"18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62\") " Mar 16 17:17:32 crc kubenswrapper[5120]: I0316 17:17:32.323918 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jlfqg\" (UniqueName: \"kubernetes.io/projected/18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62-kube-api-access-jlfqg\") pod \"18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62\" (UID: \"18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62\") " Mar 16 17:17:32 crc kubenswrapper[5120]: I0316 17:17:32.324013 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62-config-data\") pod \"18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62\" (UID: \"18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62\") " Mar 16 17:17:32 crc kubenswrapper[5120]: I0316 17:17:32.324137 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62-sg-core-conf-yaml\") pod \"18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62\" (UID: \"18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62\") " Mar 16 17:17:32 crc kubenswrapper[5120]: I0316 17:17:32.324219 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62-run-httpd\") pod \"18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62\" (UID: \"18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62\") " Mar 16 17:17:32 crc kubenswrapper[5120]: I0316 17:17:32.324291 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62-ceilometer-tls-certs\") pod \"18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62\" (UID: \"18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62\") " Mar 16 17:17:32 crc kubenswrapper[5120]: I0316 17:17:32.324351 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62-scripts\") pod \"18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62\" (UID: \"18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62\") " Mar 16 17:17:32 crc kubenswrapper[5120]: I0316 17:17:32.324866 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/71a73270-e23b-42a7-a1f4-ad174eab2ac7-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:32 crc kubenswrapper[5120]: I0316 17:17:32.324887 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/71a73270-e23b-42a7-a1f4-ad174eab2ac7-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:32 crc kubenswrapper[5120]: I0316 17:17:32.324896 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9jvdz\" (UniqueName: \"kubernetes.io/projected/71a73270-e23b-42a7-a1f4-ad174eab2ac7-kube-api-access-9jvdz\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:32 crc kubenswrapper[5120]: I0316 17:17:32.325647 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62" (UID: "18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:17:32 crc kubenswrapper[5120]: I0316 17:17:32.325866 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62" (UID: "18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:17:32 crc kubenswrapper[5120]: I0316 17:17:32.327946 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62-scripts" (OuterVolumeSpecName: "scripts") pod "18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62" (UID: "18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:17:32 crc kubenswrapper[5120]: I0316 17:17:32.328429 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62-kube-api-access-jlfqg" (OuterVolumeSpecName: "kube-api-access-jlfqg") pod "18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62" (UID: "18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62"). InnerVolumeSpecName "kube-api-access-jlfqg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:17:32 crc kubenswrapper[5120]: I0316 17:17:32.350914 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62" (UID: "18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:17:32 crc kubenswrapper[5120]: I0316 17:17:32.374035 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62-ceilometer-tls-certs" (OuterVolumeSpecName: "ceilometer-tls-certs") pod "18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62" (UID: "18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62"). InnerVolumeSpecName "ceilometer-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:17:32 crc kubenswrapper[5120]: I0316 17:17:32.392019 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62" (UID: "18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:17:32 crc kubenswrapper[5120]: I0316 17:17:32.409738 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62-config-data" (OuterVolumeSpecName: "config-data") pod "18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62" (UID: "18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:17:32 crc kubenswrapper[5120]: I0316 17:17:32.427342 5120 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:32 crc kubenswrapper[5120]: I0316 17:17:32.427378 5120 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:32 crc kubenswrapper[5120]: I0316 17:17:32.427388 5120 reconciler_common.go:299] "Volume detached for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62-ceilometer-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:32 crc kubenswrapper[5120]: I0316 17:17:32.427399 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:32 crc kubenswrapper[5120]: I0316 17:17:32.427409 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:32 crc kubenswrapper[5120]: I0316 17:17:32.427417 5120 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:32 crc kubenswrapper[5120]: I0316 17:17:32.427426 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jlfqg\" (UniqueName: \"kubernetes.io/projected/18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62-kube-api-access-jlfqg\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:32 crc kubenswrapper[5120]: I0316 17:17:32.427437 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:32 crc kubenswrapper[5120]: I0316 17:17:32.672853 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0498c744-8606-4b08-b69f-28f80006c19c" path="/var/lib/kubelet/pods/0498c744-8606-4b08-b69f-28f80006c19c/volumes" Mar 16 17:17:32 crc kubenswrapper[5120]: I0316 17:17:32.673494 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="161d5626-9918-4847-96fd-f93d894bc230" path="/var/lib/kubelet/pods/161d5626-9918-4847-96fd-f93d894bc230/volumes" Mar 16 17:17:32 crc kubenswrapper[5120]: I0316 17:17:32.674033 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3b01ec67-66ba-469f-9eba-1df99165b135" path="/var/lib/kubelet/pods/3b01ec67-66ba-469f-9eba-1df99165b135/volumes" Mar 16 17:17:32 crc kubenswrapper[5120]: I0316 17:17:32.674993 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3ce6e6cf-688e-4f59-8ca2-f3c79e2a1857" path="/var/lib/kubelet/pods/3ce6e6cf-688e-4f59-8ca2-f3c79e2a1857/volumes" Mar 16 17:17:32 crc kubenswrapper[5120]: I0316 17:17:32.675669 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d6906541-8dff-40ed-a064-5777f4b66f24" path="/var/lib/kubelet/pods/d6906541-8dff-40ed-a064-5777f4b66f24/volumes" Mar 16 17:17:32 crc kubenswrapper[5120]: I0316 17:17:32.677030 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dd339abc-691c-48f1-8674-430a5e806067" path="/var/lib/kubelet/pods/dd339abc-691c-48f1-8674-430a5e806067/volumes" Mar 16 17:17:32 crc kubenswrapper[5120]: I0316 17:17:32.677722 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fcf5af95-be92-4701-9e16-491dbbea165d" path="/var/lib/kubelet/pods/fcf5af95-be92-4701-9e16-491dbbea165d/volumes" Mar 16 17:17:33 crc kubenswrapper[5120]: I0316 17:17:33.029829 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62","Type":"ContainerDied","Data":"b9e893172914ea3674476dad64f77ea21062feede5d6f4c91f5aad8706ebce11"} Mar 16 17:17:33 crc kubenswrapper[5120]: I0316 17:17:33.029880 5120 scope.go:117] "RemoveContainer" containerID="b0ce2e25aded94ccf86a0ddfe51c2ff4f864b1998250d60f71f24ade3a195c35" Mar 16 17:17:33 crc kubenswrapper[5120]: I0316 17:17:33.030006 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 17:17:33 crc kubenswrapper[5120]: I0316 17:17:33.033575 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"71a73270-e23b-42a7-a1f4-ad174eab2ac7","Type":"ContainerDied","Data":"adcb718ed722f1f10411bca1ae38ed10303688caa308f60d36b3c7b5a914be69"} Mar 16 17:17:33 crc kubenswrapper[5120]: I0316 17:17:33.033633 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 17:17:33 crc kubenswrapper[5120]: I0316 17:17:33.058117 5120 scope.go:117] "RemoveContainer" containerID="907c314ee3239ecff601279e58a9e3aba6e65a29cf05a0d75fa660f2b00df61d" Mar 16 17:17:33 crc kubenswrapper[5120]: I0316 17:17:33.058166 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 17:17:33 crc kubenswrapper[5120]: I0316 17:17:33.067445 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 17:17:33 crc kubenswrapper[5120]: I0316 17:17:33.078970 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:17:33 crc kubenswrapper[5120]: I0316 17:17:33.079156 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 17:17:33 crc kubenswrapper[5120]: I0316 17:17:33.107033 5120 scope.go:117] "RemoveContainer" containerID="8e39abe514cf4d6f8c28475560f3e3a9681167a84d81cdfc9d44be0b89c1cec0" Mar 16 17:17:33 crc kubenswrapper[5120]: I0316 17:17:33.131850 5120 scope.go:117] "RemoveContainer" containerID="e7a5ecad2365023f5d54577d059406a821a96c82ee276fd4ed93a27749e6fcc7" Mar 16 17:17:33 crc kubenswrapper[5120]: I0316 17:17:33.154056 5120 scope.go:117] "RemoveContainer" containerID="bd045fa777b0ca425826b20941db498f3c9fc6247b98751b1ce64168b1b98e09" Mar 16 17:17:34 crc kubenswrapper[5120]: I0316 17:17:34.002024 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-5b49d5d76-5r44p" podUID="c2e33bc1-ee7f-461d-9faa-b5678f7cb416" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.0.169:9311/healthcheck\": context deadline exceeded" Mar 16 17:17:34 crc kubenswrapper[5120]: I0316 17:17:34.674818 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62" path="/var/lib/kubelet/pods/18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62/volumes" Mar 16 17:17:34 crc kubenswrapper[5120]: I0316 17:17:34.676000 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="71a73270-e23b-42a7-a1f4-ad174eab2ac7" path="/var/lib/kubelet/pods/71a73270-e23b-42a7-a1f4-ad174eab2ac7/volumes" Mar 16 17:17:34 crc kubenswrapper[5120]: I0316 17:17:34.732067 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-5r7xg" Mar 16 17:17:34 crc kubenswrapper[5120]: I0316 17:17:34.839630 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-7b8f685555-2m84v"] Mar 16 17:17:34 crc kubenswrapper[5120]: I0316 17:17:34.839954 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7b8f685555-2m84v" podUID="4329933c-52f5-4a6d-a031-7c1658641f8f" containerName="dnsmasq-dns" containerID="cri-o://b8361e4af75a0a1b5cc237b006a775549f7f7f8f6983dcee68d803cfea191549" gracePeriod=10 Mar 16 17:17:35 crc kubenswrapper[5120]: I0316 17:17:35.058505 5120 generic.go:358] "Generic (PLEG): container finished" podID="4329933c-52f5-4a6d-a031-7c1658641f8f" containerID="b8361e4af75a0a1b5cc237b006a775549f7f7f8f6983dcee68d803cfea191549" exitCode=0 Mar 16 17:17:35 crc kubenswrapper[5120]: I0316 17:17:35.058548 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7b8f685555-2m84v" event={"ID":"4329933c-52f5-4a6d-a031-7c1658641f8f","Type":"ContainerDied","Data":"b8361e4af75a0a1b5cc237b006a775549f7f7f8f6983dcee68d803cfea191549"} Mar 16 17:17:35 crc kubenswrapper[5120]: I0316 17:17:35.279576 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7b8f685555-2m84v" Mar 16 17:17:35 crc kubenswrapper[5120]: I0316 17:17:35.383978 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4329933c-52f5-4a6d-a031-7c1658641f8f-config\") pod \"4329933c-52f5-4a6d-a031-7c1658641f8f\" (UID: \"4329933c-52f5-4a6d-a031-7c1658641f8f\") " Mar 16 17:17:35 crc kubenswrapper[5120]: I0316 17:17:35.384085 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/4329933c-52f5-4a6d-a031-7c1658641f8f-dns-swift-storage-0\") pod \"4329933c-52f5-4a6d-a031-7c1658641f8f\" (UID: \"4329933c-52f5-4a6d-a031-7c1658641f8f\") " Mar 16 17:17:35 crc kubenswrapper[5120]: I0316 17:17:35.384542 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/4329933c-52f5-4a6d-a031-7c1658641f8f-dnsmasq-svc\") pod \"4329933c-52f5-4a6d-a031-7c1658641f8f\" (UID: \"4329933c-52f5-4a6d-a031-7c1658641f8f\") " Mar 16 17:17:35 crc kubenswrapper[5120]: I0316 17:17:35.384723 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v8psw\" (UniqueName: \"kubernetes.io/projected/4329933c-52f5-4a6d-a031-7c1658641f8f-kube-api-access-v8psw\") pod \"4329933c-52f5-4a6d-a031-7c1658641f8f\" (UID: \"4329933c-52f5-4a6d-a031-7c1658641f8f\") " Mar 16 17:17:35 crc kubenswrapper[5120]: I0316 17:17:35.395989 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4329933c-52f5-4a6d-a031-7c1658641f8f-kube-api-access-v8psw" (OuterVolumeSpecName: "kube-api-access-v8psw") pod "4329933c-52f5-4a6d-a031-7c1658641f8f" (UID: "4329933c-52f5-4a6d-a031-7c1658641f8f"). InnerVolumeSpecName "kube-api-access-v8psw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:17:35 crc kubenswrapper[5120]: I0316 17:17:35.435611 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4329933c-52f5-4a6d-a031-7c1658641f8f-config" (OuterVolumeSpecName: "config") pod "4329933c-52f5-4a6d-a031-7c1658641f8f" (UID: "4329933c-52f5-4a6d-a031-7c1658641f8f"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:17:35 crc kubenswrapper[5120]: I0316 17:17:35.437004 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4329933c-52f5-4a6d-a031-7c1658641f8f-dns-swift-storage-0" (OuterVolumeSpecName: "dns-swift-storage-0") pod "4329933c-52f5-4a6d-a031-7c1658641f8f" (UID: "4329933c-52f5-4a6d-a031-7c1658641f8f"). InnerVolumeSpecName "dns-swift-storage-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:17:35 crc kubenswrapper[5120]: I0316 17:17:35.440659 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4329933c-52f5-4a6d-a031-7c1658641f8f-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "4329933c-52f5-4a6d-a031-7c1658641f8f" (UID: "4329933c-52f5-4a6d-a031-7c1658641f8f"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:17:35 crc kubenswrapper[5120]: I0316 17:17:35.487580 5120 reconciler_common.go:299] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/4329933c-52f5-4a6d-a031-7c1658641f8f-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:35 crc kubenswrapper[5120]: I0316 17:17:35.487629 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v8psw\" (UniqueName: \"kubernetes.io/projected/4329933c-52f5-4a6d-a031-7c1658641f8f-kube-api-access-v8psw\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:35 crc kubenswrapper[5120]: I0316 17:17:35.487645 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4329933c-52f5-4a6d-a031-7c1658641f8f-config\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:35 crc kubenswrapper[5120]: I0316 17:17:35.487657 5120 reconciler_common.go:299] "Volume detached for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/4329933c-52f5-4a6d-a031-7c1658641f8f-dns-swift-storage-0\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:36 crc kubenswrapper[5120]: I0316 17:17:36.069776 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7b8f685555-2m84v" event={"ID":"4329933c-52f5-4a6d-a031-7c1658641f8f","Type":"ContainerDied","Data":"95a99b7bc4b8efc583d6c5fc82da7aa5489a9eee14fff3ff87f9243b6d9876bd"} Mar 16 17:17:36 crc kubenswrapper[5120]: I0316 17:17:36.069831 5120 scope.go:117] "RemoveContainer" containerID="b8361e4af75a0a1b5cc237b006a775549f7f7f8f6983dcee68d803cfea191549" Mar 16 17:17:36 crc kubenswrapper[5120]: I0316 17:17:36.069833 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7b8f685555-2m84v" Mar 16 17:17:36 crc kubenswrapper[5120]: I0316 17:17:36.101175 5120 scope.go:117] "RemoveContainer" containerID="99efd612d9c5a2a93329f31e6ab1ecb1da8624723b867994d12bdd68ee046f00" Mar 16 17:17:36 crc kubenswrapper[5120]: I0316 17:17:36.113586 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-7b8f685555-2m84v"] Mar 16 17:17:36 crc kubenswrapper[5120]: I0316 17:17:36.119818 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-7b8f685555-2m84v"] Mar 16 17:17:36 crc kubenswrapper[5120]: I0316 17:17:36.663467 5120 scope.go:117] "RemoveContainer" containerID="2ca61165dca6fdb30458423ef74c44c42b1b273e8fa504e89f5f9e186e516cc3" Mar 16 17:17:36 crc kubenswrapper[5120]: E0316 17:17:36.663988 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 17:17:36 crc kubenswrapper[5120]: I0316 17:17:36.672504 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4329933c-52f5-4a6d-a031-7c1658641f8f" path="/var/lib/kubelet/pods/4329933c-52f5-4a6d-a031-7c1658641f8f/volumes" Mar 16 17:17:44 crc kubenswrapper[5120]: I0316 17:17:44.107992 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/neutron-54b8764f4-w5thh" podUID="35eb763c-5d62-4401-a5b6-da3c538709ab" containerName="neutron-httpd" probeResult="failure" output="Get \"https://10.217.0.172:9696/\": dial tcp 10.217.0.172:9696: connect: connection refused" Mar 16 17:17:44 crc kubenswrapper[5120]: I0316 17:17:44.167735 5120 generic.go:358] "Generic (PLEG): container finished" podID="35eb763c-5d62-4401-a5b6-da3c538709ab" containerID="e4a638cbed60817301f57976644cbe4df50aed911247759003265d9dbc556dc2" exitCode=0 Mar 16 17:17:44 crc kubenswrapper[5120]: I0316 17:17:44.167794 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-54b8764f4-w5thh" event={"ID":"35eb763c-5d62-4401-a5b6-da3c538709ab","Type":"ContainerDied","Data":"e4a638cbed60817301f57976644cbe4df50aed911247759003265d9dbc556dc2"} Mar 16 17:17:44 crc kubenswrapper[5120]: I0316 17:17:44.431283 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-54b8764f4-w5thh" Mar 16 17:17:44 crc kubenswrapper[5120]: I0316 17:17:44.606479 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/35eb763c-5d62-4401-a5b6-da3c538709ab-httpd-config\") pod \"35eb763c-5d62-4401-a5b6-da3c538709ab\" (UID: \"35eb763c-5d62-4401-a5b6-da3c538709ab\") " Mar 16 17:17:44 crc kubenswrapper[5120]: I0316 17:17:44.606643 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/35eb763c-5d62-4401-a5b6-da3c538709ab-ovndb-tls-certs\") pod \"35eb763c-5d62-4401-a5b6-da3c538709ab\" (UID: \"35eb763c-5d62-4401-a5b6-da3c538709ab\") " Mar 16 17:17:44 crc kubenswrapper[5120]: I0316 17:17:44.609069 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lhs4m\" (UniqueName: \"kubernetes.io/projected/35eb763c-5d62-4401-a5b6-da3c538709ab-kube-api-access-lhs4m\") pod \"35eb763c-5d62-4401-a5b6-da3c538709ab\" (UID: \"35eb763c-5d62-4401-a5b6-da3c538709ab\") " Mar 16 17:17:44 crc kubenswrapper[5120]: I0316 17:17:44.609688 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/35eb763c-5d62-4401-a5b6-da3c538709ab-internal-tls-certs\") pod \"35eb763c-5d62-4401-a5b6-da3c538709ab\" (UID: \"35eb763c-5d62-4401-a5b6-da3c538709ab\") " Mar 16 17:17:44 crc kubenswrapper[5120]: I0316 17:17:44.610150 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/35eb763c-5d62-4401-a5b6-da3c538709ab-config\") pod \"35eb763c-5d62-4401-a5b6-da3c538709ab\" (UID: \"35eb763c-5d62-4401-a5b6-da3c538709ab\") " Mar 16 17:17:44 crc kubenswrapper[5120]: I0316 17:17:44.610206 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/35eb763c-5d62-4401-a5b6-da3c538709ab-combined-ca-bundle\") pod \"35eb763c-5d62-4401-a5b6-da3c538709ab\" (UID: \"35eb763c-5d62-4401-a5b6-da3c538709ab\") " Mar 16 17:17:44 crc kubenswrapper[5120]: I0316 17:17:44.610251 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/35eb763c-5d62-4401-a5b6-da3c538709ab-public-tls-certs\") pod \"35eb763c-5d62-4401-a5b6-da3c538709ab\" (UID: \"35eb763c-5d62-4401-a5b6-da3c538709ab\") " Mar 16 17:17:44 crc kubenswrapper[5120]: I0316 17:17:44.612304 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/35eb763c-5d62-4401-a5b6-da3c538709ab-httpd-config" (OuterVolumeSpecName: "httpd-config") pod "35eb763c-5d62-4401-a5b6-da3c538709ab" (UID: "35eb763c-5d62-4401-a5b6-da3c538709ab"). InnerVolumeSpecName "httpd-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:17:44 crc kubenswrapper[5120]: I0316 17:17:44.612641 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35eb763c-5d62-4401-a5b6-da3c538709ab-kube-api-access-lhs4m" (OuterVolumeSpecName: "kube-api-access-lhs4m") pod "35eb763c-5d62-4401-a5b6-da3c538709ab" (UID: "35eb763c-5d62-4401-a5b6-da3c538709ab"). InnerVolumeSpecName "kube-api-access-lhs4m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:17:44 crc kubenswrapper[5120]: I0316 17:17:44.647634 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/35eb763c-5d62-4401-a5b6-da3c538709ab-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "35eb763c-5d62-4401-a5b6-da3c538709ab" (UID: "35eb763c-5d62-4401-a5b6-da3c538709ab"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:17:44 crc kubenswrapper[5120]: I0316 17:17:44.648559 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/35eb763c-5d62-4401-a5b6-da3c538709ab-config" (OuterVolumeSpecName: "config") pod "35eb763c-5d62-4401-a5b6-da3c538709ab" (UID: "35eb763c-5d62-4401-a5b6-da3c538709ab"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:17:44 crc kubenswrapper[5120]: I0316 17:17:44.648951 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/35eb763c-5d62-4401-a5b6-da3c538709ab-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "35eb763c-5d62-4401-a5b6-da3c538709ab" (UID: "35eb763c-5d62-4401-a5b6-da3c538709ab"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:17:44 crc kubenswrapper[5120]: I0316 17:17:44.650623 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/35eb763c-5d62-4401-a5b6-da3c538709ab-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "35eb763c-5d62-4401-a5b6-da3c538709ab" (UID: "35eb763c-5d62-4401-a5b6-da3c538709ab"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:17:44 crc kubenswrapper[5120]: I0316 17:17:44.660912 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/35eb763c-5d62-4401-a5b6-da3c538709ab-ovndb-tls-certs" (OuterVolumeSpecName: "ovndb-tls-certs") pod "35eb763c-5d62-4401-a5b6-da3c538709ab" (UID: "35eb763c-5d62-4401-a5b6-da3c538709ab"). InnerVolumeSpecName "ovndb-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:17:44 crc kubenswrapper[5120]: I0316 17:17:44.714983 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/35eb763c-5d62-4401-a5b6-da3c538709ab-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:44 crc kubenswrapper[5120]: I0316 17:17:44.715015 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/35eb763c-5d62-4401-a5b6-da3c538709ab-config\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:44 crc kubenswrapper[5120]: I0316 17:17:44.715025 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/35eb763c-5d62-4401-a5b6-da3c538709ab-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:44 crc kubenswrapper[5120]: I0316 17:17:44.715033 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/35eb763c-5d62-4401-a5b6-da3c538709ab-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:44 crc kubenswrapper[5120]: I0316 17:17:44.715041 5120 reconciler_common.go:299] "Volume detached for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/35eb763c-5d62-4401-a5b6-da3c538709ab-httpd-config\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:44 crc kubenswrapper[5120]: I0316 17:17:44.715051 5120 reconciler_common.go:299] "Volume detached for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/35eb763c-5d62-4401-a5b6-da3c538709ab-ovndb-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:44 crc kubenswrapper[5120]: I0316 17:17:44.715060 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lhs4m\" (UniqueName: \"kubernetes.io/projected/35eb763c-5d62-4401-a5b6-da3c538709ab-kube-api-access-lhs4m\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:45 crc kubenswrapper[5120]: I0316 17:17:45.180799 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-54b8764f4-w5thh" event={"ID":"35eb763c-5d62-4401-a5b6-da3c538709ab","Type":"ContainerDied","Data":"b4380370accac18f804b76da99f6148bb5bc26af5ff445037eeaf4e7170351ed"} Mar 16 17:17:45 crc kubenswrapper[5120]: I0316 17:17:45.180854 5120 scope.go:117] "RemoveContainer" containerID="8761461c33c67611245395eb53b183f8ce91a3a0f2ea958ac3ad5d1fcb3bc8b7" Mar 16 17:17:45 crc kubenswrapper[5120]: I0316 17:17:45.180824 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-54b8764f4-w5thh" Mar 16 17:17:45 crc kubenswrapper[5120]: I0316 17:17:45.202674 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-54b8764f4-w5thh"] Mar 16 17:17:45 crc kubenswrapper[5120]: I0316 17:17:45.210043 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-54b8764f4-w5thh"] Mar 16 17:17:45 crc kubenswrapper[5120]: I0316 17:17:45.211431 5120 scope.go:117] "RemoveContainer" containerID="e4a638cbed60817301f57976644cbe4df50aed911247759003265d9dbc556dc2" Mar 16 17:17:46 crc kubenswrapper[5120]: I0316 17:17:46.675558 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="35eb763c-5d62-4401-a5b6-da3c538709ab" path="/var/lib/kubelet/pods/35eb763c-5d62-4401-a5b6-da3c538709ab/volumes" Mar 16 17:17:47 crc kubenswrapper[5120]: I0316 17:17:47.663797 5120 scope.go:117] "RemoveContainer" containerID="2ca61165dca6fdb30458423ef74c44c42b1b273e8fa504e89f5f9e186e516cc3" Mar 16 17:17:47 crc kubenswrapper[5120]: E0316 17:17:47.664455 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 17:17:53 crc kubenswrapper[5120]: I0316 17:17:53.188992 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Mar 16 17:17:53 crc kubenswrapper[5120]: I0316 17:17:53.204564 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/453261b9-e47c-4e0b-b37d-4803c7ea4eab-lock\") pod \"453261b9-e47c-4e0b-b37d-4803c7ea4eab\" (UID: \"453261b9-e47c-4e0b-b37d-4803c7ea4eab\") " Mar 16 17:17:53 crc kubenswrapper[5120]: I0316 17:17:53.204677 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"swift\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"453261b9-e47c-4e0b-b37d-4803c7ea4eab\" (UID: \"453261b9-e47c-4e0b-b37d-4803c7ea4eab\") " Mar 16 17:17:53 crc kubenswrapper[5120]: I0316 17:17:53.204712 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/453261b9-e47c-4e0b-b37d-4803c7ea4eab-cache\") pod \"453261b9-e47c-4e0b-b37d-4803c7ea4eab\" (UID: \"453261b9-e47c-4e0b-b37d-4803c7ea4eab\") " Mar 16 17:17:53 crc kubenswrapper[5120]: I0316 17:17:53.204737 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/453261b9-e47c-4e0b-b37d-4803c7ea4eab-combined-ca-bundle\") pod \"453261b9-e47c-4e0b-b37d-4803c7ea4eab\" (UID: \"453261b9-e47c-4e0b-b37d-4803c7ea4eab\") " Mar 16 17:17:53 crc kubenswrapper[5120]: I0316 17:17:53.205011 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gx55h\" (UniqueName: \"kubernetes.io/projected/453261b9-e47c-4e0b-b37d-4803c7ea4eab-kube-api-access-gx55h\") pod \"453261b9-e47c-4e0b-b37d-4803c7ea4eab\" (UID: \"453261b9-e47c-4e0b-b37d-4803c7ea4eab\") " Mar 16 17:17:53 crc kubenswrapper[5120]: I0316 17:17:53.205125 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/453261b9-e47c-4e0b-b37d-4803c7ea4eab-etc-swift\") pod \"453261b9-e47c-4e0b-b37d-4803c7ea4eab\" (UID: \"453261b9-e47c-4e0b-b37d-4803c7ea4eab\") " Mar 16 17:17:53 crc kubenswrapper[5120]: I0316 17:17:53.206445 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/453261b9-e47c-4e0b-b37d-4803c7ea4eab-cache" (OuterVolumeSpecName: "cache") pod "453261b9-e47c-4e0b-b37d-4803c7ea4eab" (UID: "453261b9-e47c-4e0b-b37d-4803c7ea4eab"). InnerVolumeSpecName "cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:17:53 crc kubenswrapper[5120]: I0316 17:17:53.206598 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/453261b9-e47c-4e0b-b37d-4803c7ea4eab-lock" (OuterVolumeSpecName: "lock") pod "453261b9-e47c-4e0b-b37d-4803c7ea4eab" (UID: "453261b9-e47c-4e0b-b37d-4803c7ea4eab"). InnerVolumeSpecName "lock". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:17:53 crc kubenswrapper[5120]: I0316 17:17:53.213274 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/453261b9-e47c-4e0b-b37d-4803c7ea4eab-kube-api-access-gx55h" (OuterVolumeSpecName: "kube-api-access-gx55h") pod "453261b9-e47c-4e0b-b37d-4803c7ea4eab" (UID: "453261b9-e47c-4e0b-b37d-4803c7ea4eab"). InnerVolumeSpecName "kube-api-access-gx55h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:17:53 crc kubenswrapper[5120]: I0316 17:17:53.213811 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage20-crc" (OuterVolumeSpecName: "swift") pod "453261b9-e47c-4e0b-b37d-4803c7ea4eab" (UID: "453261b9-e47c-4e0b-b37d-4803c7ea4eab"). InnerVolumeSpecName "local-storage20-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 17:17:53 crc kubenswrapper[5120]: I0316 17:17:53.213793 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/453261b9-e47c-4e0b-b37d-4803c7ea4eab-etc-swift" (OuterVolumeSpecName: "etc-swift") pod "453261b9-e47c-4e0b-b37d-4803c7ea4eab" (UID: "453261b9-e47c-4e0b-b37d-4803c7ea4eab"). InnerVolumeSpecName "etc-swift". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:17:53 crc kubenswrapper[5120]: I0316 17:17:53.266841 5120 generic.go:358] "Generic (PLEG): container finished" podID="453261b9-e47c-4e0b-b37d-4803c7ea4eab" containerID="e70bc9242f954992b3712fa002a61869c3838299235abfea9c2b0e824a67d0e2" exitCode=137 Mar 16 17:17:53 crc kubenswrapper[5120]: I0316 17:17:53.266878 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"453261b9-e47c-4e0b-b37d-4803c7ea4eab","Type":"ContainerDied","Data":"e70bc9242f954992b3712fa002a61869c3838299235abfea9c2b0e824a67d0e2"} Mar 16 17:17:53 crc kubenswrapper[5120]: I0316 17:17:53.266957 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"453261b9-e47c-4e0b-b37d-4803c7ea4eab","Type":"ContainerDied","Data":"6eb65bf428d4c482f58b64b7e61af4b881274601e82001fcdf67e56d20afe5b8"} Mar 16 17:17:53 crc kubenswrapper[5120]: I0316 17:17:53.266979 5120 scope.go:117] "RemoveContainer" containerID="e70bc9242f954992b3712fa002a61869c3838299235abfea9c2b0e824a67d0e2" Mar 16 17:17:53 crc kubenswrapper[5120]: I0316 17:17:53.267276 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Mar 16 17:17:53 crc kubenswrapper[5120]: I0316 17:17:53.292469 5120 scope.go:117] "RemoveContainer" containerID="a1b10d99c0cdaf702b9aeb081186b9737661b9e1ad04908bd766605b4e038b52" Mar 16 17:17:53 crc kubenswrapper[5120]: I0316 17:17:53.306974 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gx55h\" (UniqueName: \"kubernetes.io/projected/453261b9-e47c-4e0b-b37d-4803c7ea4eab-kube-api-access-gx55h\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:53 crc kubenswrapper[5120]: I0316 17:17:53.307015 5120 reconciler_common.go:299] "Volume detached for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/453261b9-e47c-4e0b-b37d-4803c7ea4eab-etc-swift\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:53 crc kubenswrapper[5120]: I0316 17:17:53.307027 5120 reconciler_common.go:299] "Volume detached for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/453261b9-e47c-4e0b-b37d-4803c7ea4eab-lock\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:53 crc kubenswrapper[5120]: I0316 17:17:53.307061 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") on node \"crc\" " Mar 16 17:17:53 crc kubenswrapper[5120]: I0316 17:17:53.307071 5120 reconciler_common.go:299] "Volume detached for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/453261b9-e47c-4e0b-b37d-4803c7ea4eab-cache\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:53 crc kubenswrapper[5120]: I0316 17:17:53.322132 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage20-crc" (UniqueName: "kubernetes.io/local-volume/local-storage20-crc") on node "crc" Mar 16 17:17:53 crc kubenswrapper[5120]: I0316 17:17:53.324644 5120 scope.go:117] "RemoveContainer" containerID="3df7a51b81f9adfb6f8812a838726626d4151033510e8139103925ba0a6c9636" Mar 16 17:17:53 crc kubenswrapper[5120]: I0316 17:17:53.343767 5120 scope.go:117] "RemoveContainer" containerID="22b3d482c1dbe9466b48add66f35c279c3a30492318c0515c5d724ca2e13919a" Mar 16 17:17:53 crc kubenswrapper[5120]: I0316 17:17:53.364149 5120 scope.go:117] "RemoveContainer" containerID="29984c871f3af037965519d7341a4a9f76503ecacedf63c951528b0c3f7621e3" Mar 16 17:17:53 crc kubenswrapper[5120]: I0316 17:17:53.383114 5120 scope.go:117] "RemoveContainer" containerID="3fdb66fbf7a3609693d5bb010ec8b7a9f831e0bc3f2074a737c8ffb1b1a0a870" Mar 16 17:17:53 crc kubenswrapper[5120]: I0316 17:17:53.401833 5120 scope.go:117] "RemoveContainer" containerID="aebd95ed2c80cf68f4a11d63e8a9c7417a4d2c89e19691fded4789fac5ae5ced" Mar 16 17:17:53 crc kubenswrapper[5120]: I0316 17:17:53.411145 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:53 crc kubenswrapper[5120]: I0316 17:17:53.427409 5120 scope.go:117] "RemoveContainer" containerID="d5fd97d3f54b33d918d40a1a213325ea152cca47586abb186341b0193714ad03" Mar 16 17:17:53 crc kubenswrapper[5120]: I0316 17:17:53.452638 5120 scope.go:117] "RemoveContainer" containerID="847cfa54fe526dabece95c278159d3228a748d5a41f03c0874e7e56a380b6047" Mar 16 17:17:53 crc kubenswrapper[5120]: I0316 17:17:53.473615 5120 scope.go:117] "RemoveContainer" containerID="12e294147acf3be6360a4168f01b6847c3952f8b1f777061c712b9dcddb549e9" Mar 16 17:17:53 crc kubenswrapper[5120]: I0316 17:17:53.499477 5120 scope.go:117] "RemoveContainer" containerID="7609d755e551179d21b21ae75424817749513f60f07273b47f02ee1165742636" Mar 16 17:17:53 crc kubenswrapper[5120]: I0316 17:17:53.523251 5120 scope.go:117] "RemoveContainer" containerID="f2a05b9a55ce5e5912e0e5ca27fa34a32cd099c2e9473cdafa26eef99b1aade8" Mar 16 17:17:53 crc kubenswrapper[5120]: I0316 17:17:53.524148 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/453261b9-e47c-4e0b-b37d-4803c7ea4eab-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "453261b9-e47c-4e0b-b37d-4803c7ea4eab" (UID: "453261b9-e47c-4e0b-b37d-4803c7ea4eab"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:17:53 crc kubenswrapper[5120]: I0316 17:17:53.542412 5120 scope.go:117] "RemoveContainer" containerID="2a68f298ec63891421aa48c2086b5969e7ccffebf4a9b32a37f55e9ca39b4362" Mar 16 17:17:53 crc kubenswrapper[5120]: I0316 17:17:53.566447 5120 scope.go:117] "RemoveContainer" containerID="f450ab68730ad34b2967fa5253614c5b25a40a841fe623c369a1631922d89171" Mar 16 17:17:53 crc kubenswrapper[5120]: I0316 17:17:53.583630 5120 scope.go:117] "RemoveContainer" containerID="bfd438fe482625b6acaa98a3f3b1df39124d070d7c82b30f3b95847f5e4307eb" Mar 16 17:17:53 crc kubenswrapper[5120]: I0316 17:17:53.602746 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 17:17:53 crc kubenswrapper[5120]: I0316 17:17:53.608032 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 17:17:53 crc kubenswrapper[5120]: I0316 17:17:53.609577 5120 scope.go:117] "RemoveContainer" containerID="e70bc9242f954992b3712fa002a61869c3838299235abfea9c2b0e824a67d0e2" Mar 16 17:17:53 crc kubenswrapper[5120]: E0316 17:17:53.609999 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e70bc9242f954992b3712fa002a61869c3838299235abfea9c2b0e824a67d0e2\": container with ID starting with e70bc9242f954992b3712fa002a61869c3838299235abfea9c2b0e824a67d0e2 not found: ID does not exist" containerID="e70bc9242f954992b3712fa002a61869c3838299235abfea9c2b0e824a67d0e2" Mar 16 17:17:53 crc kubenswrapper[5120]: I0316 17:17:53.610034 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e70bc9242f954992b3712fa002a61869c3838299235abfea9c2b0e824a67d0e2"} err="failed to get container status \"e70bc9242f954992b3712fa002a61869c3838299235abfea9c2b0e824a67d0e2\": rpc error: code = NotFound desc = could not find container \"e70bc9242f954992b3712fa002a61869c3838299235abfea9c2b0e824a67d0e2\": container with ID starting with e70bc9242f954992b3712fa002a61869c3838299235abfea9c2b0e824a67d0e2 not found: ID does not exist" Mar 16 17:17:53 crc kubenswrapper[5120]: I0316 17:17:53.610061 5120 scope.go:117] "RemoveContainer" containerID="a1b10d99c0cdaf702b9aeb081186b9737661b9e1ad04908bd766605b4e038b52" Mar 16 17:17:53 crc kubenswrapper[5120]: E0316 17:17:53.610389 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a1b10d99c0cdaf702b9aeb081186b9737661b9e1ad04908bd766605b4e038b52\": container with ID starting with a1b10d99c0cdaf702b9aeb081186b9737661b9e1ad04908bd766605b4e038b52 not found: ID does not exist" containerID="a1b10d99c0cdaf702b9aeb081186b9737661b9e1ad04908bd766605b4e038b52" Mar 16 17:17:53 crc kubenswrapper[5120]: I0316 17:17:53.610420 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1b10d99c0cdaf702b9aeb081186b9737661b9e1ad04908bd766605b4e038b52"} err="failed to get container status \"a1b10d99c0cdaf702b9aeb081186b9737661b9e1ad04908bd766605b4e038b52\": rpc error: code = NotFound desc = could not find container \"a1b10d99c0cdaf702b9aeb081186b9737661b9e1ad04908bd766605b4e038b52\": container with ID starting with a1b10d99c0cdaf702b9aeb081186b9737661b9e1ad04908bd766605b4e038b52 not found: ID does not exist" Mar 16 17:17:53 crc kubenswrapper[5120]: I0316 17:17:53.610440 5120 scope.go:117] "RemoveContainer" containerID="3df7a51b81f9adfb6f8812a838726626d4151033510e8139103925ba0a6c9636" Mar 16 17:17:53 crc kubenswrapper[5120]: E0316 17:17:53.610655 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3df7a51b81f9adfb6f8812a838726626d4151033510e8139103925ba0a6c9636\": container with ID starting with 3df7a51b81f9adfb6f8812a838726626d4151033510e8139103925ba0a6c9636 not found: ID does not exist" containerID="3df7a51b81f9adfb6f8812a838726626d4151033510e8139103925ba0a6c9636" Mar 16 17:17:53 crc kubenswrapper[5120]: I0316 17:17:53.610679 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3df7a51b81f9adfb6f8812a838726626d4151033510e8139103925ba0a6c9636"} err="failed to get container status \"3df7a51b81f9adfb6f8812a838726626d4151033510e8139103925ba0a6c9636\": rpc error: code = NotFound desc = could not find container \"3df7a51b81f9adfb6f8812a838726626d4151033510e8139103925ba0a6c9636\": container with ID starting with 3df7a51b81f9adfb6f8812a838726626d4151033510e8139103925ba0a6c9636 not found: ID does not exist" Mar 16 17:17:53 crc kubenswrapper[5120]: I0316 17:17:53.610692 5120 scope.go:117] "RemoveContainer" containerID="22b3d482c1dbe9466b48add66f35c279c3a30492318c0515c5d724ca2e13919a" Mar 16 17:17:53 crc kubenswrapper[5120]: E0316 17:17:53.610896 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"22b3d482c1dbe9466b48add66f35c279c3a30492318c0515c5d724ca2e13919a\": container with ID starting with 22b3d482c1dbe9466b48add66f35c279c3a30492318c0515c5d724ca2e13919a not found: ID does not exist" containerID="22b3d482c1dbe9466b48add66f35c279c3a30492318c0515c5d724ca2e13919a" Mar 16 17:17:53 crc kubenswrapper[5120]: I0316 17:17:53.610922 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22b3d482c1dbe9466b48add66f35c279c3a30492318c0515c5d724ca2e13919a"} err="failed to get container status \"22b3d482c1dbe9466b48add66f35c279c3a30492318c0515c5d724ca2e13919a\": rpc error: code = NotFound desc = could not find container \"22b3d482c1dbe9466b48add66f35c279c3a30492318c0515c5d724ca2e13919a\": container with ID starting with 22b3d482c1dbe9466b48add66f35c279c3a30492318c0515c5d724ca2e13919a not found: ID does not exist" Mar 16 17:17:53 crc kubenswrapper[5120]: I0316 17:17:53.610938 5120 scope.go:117] "RemoveContainer" containerID="29984c871f3af037965519d7341a4a9f76503ecacedf63c951528b0c3f7621e3" Mar 16 17:17:53 crc kubenswrapper[5120]: E0316 17:17:53.611105 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"29984c871f3af037965519d7341a4a9f76503ecacedf63c951528b0c3f7621e3\": container with ID starting with 29984c871f3af037965519d7341a4a9f76503ecacedf63c951528b0c3f7621e3 not found: ID does not exist" containerID="29984c871f3af037965519d7341a4a9f76503ecacedf63c951528b0c3f7621e3" Mar 16 17:17:53 crc kubenswrapper[5120]: I0316 17:17:53.611126 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29984c871f3af037965519d7341a4a9f76503ecacedf63c951528b0c3f7621e3"} err="failed to get container status \"29984c871f3af037965519d7341a4a9f76503ecacedf63c951528b0c3f7621e3\": rpc error: code = NotFound desc = could not find container \"29984c871f3af037965519d7341a4a9f76503ecacedf63c951528b0c3f7621e3\": container with ID starting with 29984c871f3af037965519d7341a4a9f76503ecacedf63c951528b0c3f7621e3 not found: ID does not exist" Mar 16 17:17:53 crc kubenswrapper[5120]: I0316 17:17:53.611139 5120 scope.go:117] "RemoveContainer" containerID="3fdb66fbf7a3609693d5bb010ec8b7a9f831e0bc3f2074a737c8ffb1b1a0a870" Mar 16 17:17:53 crc kubenswrapper[5120]: E0316 17:17:53.611330 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3fdb66fbf7a3609693d5bb010ec8b7a9f831e0bc3f2074a737c8ffb1b1a0a870\": container with ID starting with 3fdb66fbf7a3609693d5bb010ec8b7a9f831e0bc3f2074a737c8ffb1b1a0a870 not found: ID does not exist" containerID="3fdb66fbf7a3609693d5bb010ec8b7a9f831e0bc3f2074a737c8ffb1b1a0a870" Mar 16 17:17:53 crc kubenswrapper[5120]: I0316 17:17:53.611356 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3fdb66fbf7a3609693d5bb010ec8b7a9f831e0bc3f2074a737c8ffb1b1a0a870"} err="failed to get container status \"3fdb66fbf7a3609693d5bb010ec8b7a9f831e0bc3f2074a737c8ffb1b1a0a870\": rpc error: code = NotFound desc = could not find container \"3fdb66fbf7a3609693d5bb010ec8b7a9f831e0bc3f2074a737c8ffb1b1a0a870\": container with ID starting with 3fdb66fbf7a3609693d5bb010ec8b7a9f831e0bc3f2074a737c8ffb1b1a0a870 not found: ID does not exist" Mar 16 17:17:53 crc kubenswrapper[5120]: I0316 17:17:53.611370 5120 scope.go:117] "RemoveContainer" containerID="aebd95ed2c80cf68f4a11d63e8a9c7417a4d2c89e19691fded4789fac5ae5ced" Mar 16 17:17:53 crc kubenswrapper[5120]: E0316 17:17:53.611562 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aebd95ed2c80cf68f4a11d63e8a9c7417a4d2c89e19691fded4789fac5ae5ced\": container with ID starting with aebd95ed2c80cf68f4a11d63e8a9c7417a4d2c89e19691fded4789fac5ae5ced not found: ID does not exist" containerID="aebd95ed2c80cf68f4a11d63e8a9c7417a4d2c89e19691fded4789fac5ae5ced" Mar 16 17:17:53 crc kubenswrapper[5120]: I0316 17:17:53.611588 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aebd95ed2c80cf68f4a11d63e8a9c7417a4d2c89e19691fded4789fac5ae5ced"} err="failed to get container status \"aebd95ed2c80cf68f4a11d63e8a9c7417a4d2c89e19691fded4789fac5ae5ced\": rpc error: code = NotFound desc = could not find container \"aebd95ed2c80cf68f4a11d63e8a9c7417a4d2c89e19691fded4789fac5ae5ced\": container with ID starting with aebd95ed2c80cf68f4a11d63e8a9c7417a4d2c89e19691fded4789fac5ae5ced not found: ID does not exist" Mar 16 17:17:53 crc kubenswrapper[5120]: I0316 17:17:53.611607 5120 scope.go:117] "RemoveContainer" containerID="d5fd97d3f54b33d918d40a1a213325ea152cca47586abb186341b0193714ad03" Mar 16 17:17:53 crc kubenswrapper[5120]: E0316 17:17:53.611875 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d5fd97d3f54b33d918d40a1a213325ea152cca47586abb186341b0193714ad03\": container with ID starting with d5fd97d3f54b33d918d40a1a213325ea152cca47586abb186341b0193714ad03 not found: ID does not exist" containerID="d5fd97d3f54b33d918d40a1a213325ea152cca47586abb186341b0193714ad03" Mar 16 17:17:53 crc kubenswrapper[5120]: I0316 17:17:53.611896 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5fd97d3f54b33d918d40a1a213325ea152cca47586abb186341b0193714ad03"} err="failed to get container status \"d5fd97d3f54b33d918d40a1a213325ea152cca47586abb186341b0193714ad03\": rpc error: code = NotFound desc = could not find container \"d5fd97d3f54b33d918d40a1a213325ea152cca47586abb186341b0193714ad03\": container with ID starting with d5fd97d3f54b33d918d40a1a213325ea152cca47586abb186341b0193714ad03 not found: ID does not exist" Mar 16 17:17:53 crc kubenswrapper[5120]: I0316 17:17:53.611938 5120 scope.go:117] "RemoveContainer" containerID="847cfa54fe526dabece95c278159d3228a748d5a41f03c0874e7e56a380b6047" Mar 16 17:17:53 crc kubenswrapper[5120]: E0316 17:17:53.612142 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"847cfa54fe526dabece95c278159d3228a748d5a41f03c0874e7e56a380b6047\": container with ID starting with 847cfa54fe526dabece95c278159d3228a748d5a41f03c0874e7e56a380b6047 not found: ID does not exist" containerID="847cfa54fe526dabece95c278159d3228a748d5a41f03c0874e7e56a380b6047" Mar 16 17:17:53 crc kubenswrapper[5120]: I0316 17:17:53.612164 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"847cfa54fe526dabece95c278159d3228a748d5a41f03c0874e7e56a380b6047"} err="failed to get container status \"847cfa54fe526dabece95c278159d3228a748d5a41f03c0874e7e56a380b6047\": rpc error: code = NotFound desc = could not find container \"847cfa54fe526dabece95c278159d3228a748d5a41f03c0874e7e56a380b6047\": container with ID starting with 847cfa54fe526dabece95c278159d3228a748d5a41f03c0874e7e56a380b6047 not found: ID does not exist" Mar 16 17:17:53 crc kubenswrapper[5120]: I0316 17:17:53.612177 5120 scope.go:117] "RemoveContainer" containerID="12e294147acf3be6360a4168f01b6847c3952f8b1f777061c712b9dcddb549e9" Mar 16 17:17:53 crc kubenswrapper[5120]: E0316 17:17:53.612353 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"12e294147acf3be6360a4168f01b6847c3952f8b1f777061c712b9dcddb549e9\": container with ID starting with 12e294147acf3be6360a4168f01b6847c3952f8b1f777061c712b9dcddb549e9 not found: ID does not exist" containerID="12e294147acf3be6360a4168f01b6847c3952f8b1f777061c712b9dcddb549e9" Mar 16 17:17:53 crc kubenswrapper[5120]: I0316 17:17:53.612384 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"12e294147acf3be6360a4168f01b6847c3952f8b1f777061c712b9dcddb549e9"} err="failed to get container status \"12e294147acf3be6360a4168f01b6847c3952f8b1f777061c712b9dcddb549e9\": rpc error: code = NotFound desc = could not find container \"12e294147acf3be6360a4168f01b6847c3952f8b1f777061c712b9dcddb549e9\": container with ID starting with 12e294147acf3be6360a4168f01b6847c3952f8b1f777061c712b9dcddb549e9 not found: ID does not exist" Mar 16 17:17:53 crc kubenswrapper[5120]: I0316 17:17:53.612400 5120 scope.go:117] "RemoveContainer" containerID="7609d755e551179d21b21ae75424817749513f60f07273b47f02ee1165742636" Mar 16 17:17:53 crc kubenswrapper[5120]: E0316 17:17:53.612648 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7609d755e551179d21b21ae75424817749513f60f07273b47f02ee1165742636\": container with ID starting with 7609d755e551179d21b21ae75424817749513f60f07273b47f02ee1165742636 not found: ID does not exist" containerID="7609d755e551179d21b21ae75424817749513f60f07273b47f02ee1165742636" Mar 16 17:17:53 crc kubenswrapper[5120]: I0316 17:17:53.612668 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7609d755e551179d21b21ae75424817749513f60f07273b47f02ee1165742636"} err="failed to get container status \"7609d755e551179d21b21ae75424817749513f60f07273b47f02ee1165742636\": rpc error: code = NotFound desc = could not find container \"7609d755e551179d21b21ae75424817749513f60f07273b47f02ee1165742636\": container with ID starting with 7609d755e551179d21b21ae75424817749513f60f07273b47f02ee1165742636 not found: ID does not exist" Mar 16 17:17:53 crc kubenswrapper[5120]: I0316 17:17:53.612681 5120 scope.go:117] "RemoveContainer" containerID="f2a05b9a55ce5e5912e0e5ca27fa34a32cd099c2e9473cdafa26eef99b1aade8" Mar 16 17:17:53 crc kubenswrapper[5120]: E0316 17:17:53.612924 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f2a05b9a55ce5e5912e0e5ca27fa34a32cd099c2e9473cdafa26eef99b1aade8\": container with ID starting with f2a05b9a55ce5e5912e0e5ca27fa34a32cd099c2e9473cdafa26eef99b1aade8 not found: ID does not exist" containerID="f2a05b9a55ce5e5912e0e5ca27fa34a32cd099c2e9473cdafa26eef99b1aade8" Mar 16 17:17:53 crc kubenswrapper[5120]: I0316 17:17:53.612945 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2a05b9a55ce5e5912e0e5ca27fa34a32cd099c2e9473cdafa26eef99b1aade8"} err="failed to get container status \"f2a05b9a55ce5e5912e0e5ca27fa34a32cd099c2e9473cdafa26eef99b1aade8\": rpc error: code = NotFound desc = could not find container \"f2a05b9a55ce5e5912e0e5ca27fa34a32cd099c2e9473cdafa26eef99b1aade8\": container with ID starting with f2a05b9a55ce5e5912e0e5ca27fa34a32cd099c2e9473cdafa26eef99b1aade8 not found: ID does not exist" Mar 16 17:17:53 crc kubenswrapper[5120]: I0316 17:17:53.612979 5120 scope.go:117] "RemoveContainer" containerID="2a68f298ec63891421aa48c2086b5969e7ccffebf4a9b32a37f55e9ca39b4362" Mar 16 17:17:53 crc kubenswrapper[5120]: E0316 17:17:53.613169 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2a68f298ec63891421aa48c2086b5969e7ccffebf4a9b32a37f55e9ca39b4362\": container with ID starting with 2a68f298ec63891421aa48c2086b5969e7ccffebf4a9b32a37f55e9ca39b4362 not found: ID does not exist" containerID="2a68f298ec63891421aa48c2086b5969e7ccffebf4a9b32a37f55e9ca39b4362" Mar 16 17:17:53 crc kubenswrapper[5120]: I0316 17:17:53.613191 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a68f298ec63891421aa48c2086b5969e7ccffebf4a9b32a37f55e9ca39b4362"} err="failed to get container status \"2a68f298ec63891421aa48c2086b5969e7ccffebf4a9b32a37f55e9ca39b4362\": rpc error: code = NotFound desc = could not find container \"2a68f298ec63891421aa48c2086b5969e7ccffebf4a9b32a37f55e9ca39b4362\": container with ID starting with 2a68f298ec63891421aa48c2086b5969e7ccffebf4a9b32a37f55e9ca39b4362 not found: ID does not exist" Mar 16 17:17:53 crc kubenswrapper[5120]: I0316 17:17:53.613204 5120 scope.go:117] "RemoveContainer" containerID="f450ab68730ad34b2967fa5253614c5b25a40a841fe623c369a1631922d89171" Mar 16 17:17:53 crc kubenswrapper[5120]: E0316 17:17:53.613571 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f450ab68730ad34b2967fa5253614c5b25a40a841fe623c369a1631922d89171\": container with ID starting with f450ab68730ad34b2967fa5253614c5b25a40a841fe623c369a1631922d89171 not found: ID does not exist" containerID="f450ab68730ad34b2967fa5253614c5b25a40a841fe623c369a1631922d89171" Mar 16 17:17:53 crc kubenswrapper[5120]: I0316 17:17:53.613595 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f450ab68730ad34b2967fa5253614c5b25a40a841fe623c369a1631922d89171"} err="failed to get container status \"f450ab68730ad34b2967fa5253614c5b25a40a841fe623c369a1631922d89171\": rpc error: code = NotFound desc = could not find container \"f450ab68730ad34b2967fa5253614c5b25a40a841fe623c369a1631922d89171\": container with ID starting with f450ab68730ad34b2967fa5253614c5b25a40a841fe623c369a1631922d89171 not found: ID does not exist" Mar 16 17:17:53 crc kubenswrapper[5120]: I0316 17:17:53.613609 5120 scope.go:117] "RemoveContainer" containerID="bfd438fe482625b6acaa98a3f3b1df39124d070d7c82b30f3b95847f5e4307eb" Mar 16 17:17:53 crc kubenswrapper[5120]: E0316 17:17:53.613888 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bfd438fe482625b6acaa98a3f3b1df39124d070d7c82b30f3b95847f5e4307eb\": container with ID starting with bfd438fe482625b6acaa98a3f3b1df39124d070d7c82b30f3b95847f5e4307eb not found: ID does not exist" containerID="bfd438fe482625b6acaa98a3f3b1df39124d070d7c82b30f3b95847f5e4307eb" Mar 16 17:17:53 crc kubenswrapper[5120]: I0316 17:17:53.613930 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bfd438fe482625b6acaa98a3f3b1df39124d070d7c82b30f3b95847f5e4307eb"} err="failed to get container status \"bfd438fe482625b6acaa98a3f3b1df39124d070d7c82b30f3b95847f5e4307eb\": rpc error: code = NotFound desc = could not find container \"bfd438fe482625b6acaa98a3f3b1df39124d070d7c82b30f3b95847f5e4307eb\": container with ID starting with bfd438fe482625b6acaa98a3f3b1df39124d070d7c82b30f3b95847f5e4307eb not found: ID does not exist" Mar 16 17:17:53 crc kubenswrapper[5120]: I0316 17:17:53.614973 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/453261b9-e47c-4e0b-b37d-4803c7ea4eab-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:17:54 crc kubenswrapper[5120]: I0316 17:17:54.674325 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="453261b9-e47c-4e0b-b37d-4803c7ea4eab" path="/var/lib/kubelet/pods/453261b9-e47c-4e0b-b37d-4803c7ea4eab/volumes" Mar 16 17:17:57 crc kubenswrapper[5120]: I0316 17:17:57.233042 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/placement-5b79cc5b54-db2hd" podUID="1976af1c-93c9-487c-9852-752bb5c1234d" containerName="placement-log" probeResult="failure" output="Get \"https://10.217.0.175:8778/\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Mar 16 17:17:58 crc kubenswrapper[5120]: I0316 17:17:58.005710 5120 pod_container_manager_linux.go:217] "Failed to delete cgroup paths" cgroupName=["kubepods","besteffort","pod2dd828c2-16f2-4e69-b0b8-b953caf55f5b"] err="unable to destroy cgroup paths for cgroup [kubepods besteffort pod2dd828c2-16f2-4e69-b0b8-b953caf55f5b] : Timed out while waiting for systemd to remove kubepods-besteffort-pod2dd828c2_16f2_4e69_b0b8_b953caf55f5b.slice" Mar 16 17:17:58 crc kubenswrapper[5120]: E0316 17:17:58.006172 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to delete cgroup paths for [kubepods besteffort pod2dd828c2-16f2-4e69-b0b8-b953caf55f5b] : unable to destroy cgroup paths for cgroup [kubepods besteffort pod2dd828c2-16f2-4e69-b0b8-b953caf55f5b] : Timed out while waiting for systemd to remove kubepods-besteffort-pod2dd828c2_16f2_4e69_b0b8_b953caf55f5b.slice" pod="openstack-kuttl-tests/openstack-cell1-galera-0" podUID="2dd828c2-16f2-4e69-b0b8-b953caf55f5b" Mar 16 17:17:58 crc kubenswrapper[5120]: I0316 17:17:58.312159 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 17:17:58 crc kubenswrapper[5120]: I0316 17:17:58.337794 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 17:17:58 crc kubenswrapper[5120]: I0316 17:17:58.343350 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 17:17:58 crc kubenswrapper[5120]: I0316 17:17:58.669970 5120 scope.go:117] "RemoveContainer" containerID="2ca61165dca6fdb30458423ef74c44c42b1b273e8fa504e89f5f9e186e516cc3" Mar 16 17:17:58 crc kubenswrapper[5120]: E0316 17:17:58.670285 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 17:17:58 crc kubenswrapper[5120]: I0316 17:17:58.679102 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2dd828c2-16f2-4e69-b0b8-b953caf55f5b" path="/var/lib/kubelet/pods/2dd828c2-16f2-4e69-b0b8-b953caf55f5b/volumes" Mar 16 17:17:59 crc kubenswrapper[5120]: I0316 17:17:59.430667 5120 pod_container_manager_linux.go:217] "Failed to delete cgroup paths" cgroupName=["kubepods","besteffort","podcb2bdc0a-77bc-488e-b188-7b24ac191d5a"] err="unable to destroy cgroup paths for cgroup [kubepods besteffort podcb2bdc0a-77bc-488e-b188-7b24ac191d5a] : Timed out while waiting for systemd to remove kubepods-besteffort-podcb2bdc0a_77bc_488e_b188_7b24ac191d5a.slice" Mar 16 17:17:59 crc kubenswrapper[5120]: E0316 17:17:59.431343 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to delete cgroup paths for [kubepods besteffort podcb2bdc0a-77bc-488e-b188-7b24ac191d5a] : unable to destroy cgroup paths for cgroup [kubepods besteffort podcb2bdc0a-77bc-488e-b188-7b24ac191d5a] : Timed out while waiting for systemd to remove kubepods-besteffort-podcb2bdc0a_77bc_488e_b188_7b24ac191d5a.slice" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="cb2bdc0a-77bc-488e-b188-7b24ac191d5a" Mar 16 17:17:59 crc kubenswrapper[5120]: I0316 17:17:59.434075 5120 pod_container_manager_linux.go:217] "Failed to delete cgroup paths" cgroupName=["kubepods","besteffort","pod62f72752-1070-4856-aec8-5d8c07039d97"] err="unable to destroy cgroup paths for cgroup [kubepods besteffort pod62f72752-1070-4856-aec8-5d8c07039d97] : Timed out while waiting for systemd to remove kubepods-besteffort-pod62f72752_1070_4856_aec8_5d8c07039d97.slice" Mar 16 17:17:59 crc kubenswrapper[5120]: E0316 17:17:59.434222 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to delete cgroup paths for [kubepods besteffort pod62f72752-1070-4856-aec8-5d8c07039d97] : unable to destroy cgroup paths for cgroup [kubepods besteffort pod62f72752-1070-4856-aec8-5d8c07039d97] : Timed out while waiting for systemd to remove kubepods-besteffort-pod62f72752_1070_4856_aec8_5d8c07039d97.slice" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="62f72752-1070-4856-aec8-5d8c07039d97" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.142366 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-infra/auto-csr-approver-29561358-jmrct"] Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.143225 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9215705-d766-4151-b079-62d304603586" containerName="nova-metadata-log" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.143242 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9215705-d766-4151-b079-62d304603586" containerName="nova-metadata-log" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.143263 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="453261b9-e47c-4e0b-b37d-4803c7ea4eab" containerName="account-auditor" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.143268 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="453261b9-e47c-4e0b-b37d-4803c7ea4eab" containerName="account-auditor" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.143280 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35eb763c-5d62-4401-a5b6-da3c538709ab" containerName="neutron-httpd" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.143285 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="35eb763c-5d62-4401-a5b6-da3c538709ab" containerName="neutron-httpd" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.143293 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="161d5626-9918-4847-96fd-f93d894bc230" containerName="openstack-network-exporter" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.143299 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="161d5626-9918-4847-96fd-f93d894bc230" containerName="openstack-network-exporter" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.143307 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="453261b9-e47c-4e0b-b37d-4803c7ea4eab" containerName="account-server" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.143313 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="453261b9-e47c-4e0b-b37d-4803c7ea4eab" containerName="account-server" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.143319 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef7c6f1d-0e78-43bf-99c4-9200f5e67136" containerName="nova-api-api" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.143324 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef7c6f1d-0e78-43bf-99c4-9200f5e67136" containerName="nova-api-api" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.143332 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62" containerName="sg-core" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.143337 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62" containerName="sg-core" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.143343 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4329933c-52f5-4a6d-a031-7c1658641f8f" containerName="dnsmasq-dns" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.143349 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="4329933c-52f5-4a6d-a031-7c1658641f8f" containerName="dnsmasq-dns" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.143355 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2e33bc1-ee7f-461d-9faa-b5678f7cb416" containerName="barbican-api" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.143362 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2e33bc1-ee7f-461d-9faa-b5678f7cb416" containerName="barbican-api" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.143373 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="453261b9-e47c-4e0b-b37d-4803c7ea4eab" containerName="container-server" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.143378 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="453261b9-e47c-4e0b-b37d-4803c7ea4eab" containerName="container-server" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.143386 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ce6e6cf-688e-4f59-8ca2-f3c79e2a1857" containerName="barbican-worker" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.143392 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ce6e6cf-688e-4f59-8ca2-f3c79e2a1857" containerName="barbican-worker" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.143400 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54551b0a-84c0-40c7-a1d1-64dfbf2fd0d6" containerName="mariadb-account-create-update" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.143408 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="54551b0a-84c0-40c7-a1d1-64dfbf2fd0d6" containerName="mariadb-account-create-update" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.143416 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="453261b9-e47c-4e0b-b37d-4803c7ea4eab" containerName="account-replicator" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.143422 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="453261b9-e47c-4e0b-b37d-4803c7ea4eab" containerName="account-replicator" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.143434 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62f72752-1070-4856-aec8-5d8c07039d97" containerName="glance-httpd" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.143440 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="62f72752-1070-4856-aec8-5d8c07039d97" containerName="glance-httpd" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.143449 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fcf5af95-be92-4701-9e16-491dbbea165d" containerName="barbican-keystone-listener-log" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.143455 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="fcf5af95-be92-4701-9e16-491dbbea165d" containerName="barbican-keystone-listener-log" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.143465 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="453261b9-e47c-4e0b-b37d-4803c7ea4eab" containerName="object-auditor" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.143471 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="453261b9-e47c-4e0b-b37d-4803c7ea4eab" containerName="object-auditor" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.143479 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fcf5af95-be92-4701-9e16-491dbbea165d" containerName="barbican-keystone-listener" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.143484 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="fcf5af95-be92-4701-9e16-491dbbea165d" containerName="barbican-keystone-listener" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.143491 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd339abc-691c-48f1-8674-430a5e806067" containerName="setup-container" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.143496 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd339abc-691c-48f1-8674-430a5e806067" containerName="setup-container" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.143509 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="453261b9-e47c-4e0b-b37d-4803c7ea4eab" containerName="rsync" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.143514 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="453261b9-e47c-4e0b-b37d-4803c7ea4eab" containerName="rsync" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.143523 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1976af1c-93c9-487c-9852-752bb5c1234d" containerName="placement-log" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.143529 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1976af1c-93c9-487c-9852-752bb5c1234d" containerName="placement-log" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.143538 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="453261b9-e47c-4e0b-b37d-4803c7ea4eab" containerName="container-updater" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.143543 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="453261b9-e47c-4e0b-b37d-4803c7ea4eab" containerName="container-updater" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.143553 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0498c744-8606-4b08-b69f-28f80006c19c" containerName="mysql-bootstrap" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.143558 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="0498c744-8606-4b08-b69f-28f80006c19c" containerName="mysql-bootstrap" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.143566 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62" containerName="ceilometer-central-agent" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.143571 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62" containerName="ceilometer-central-agent" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.143579 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="453261b9-e47c-4e0b-b37d-4803c7ea4eab" containerName="account-reaper" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.143602 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="453261b9-e47c-4e0b-b37d-4803c7ea4eab" containerName="account-reaper" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.143612 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="453261b9-e47c-4e0b-b37d-4803c7ea4eab" containerName="object-updater" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.143618 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="453261b9-e47c-4e0b-b37d-4803c7ea4eab" containerName="object-updater" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.143624 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62" containerName="proxy-httpd" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.143629 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62" containerName="proxy-httpd" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.143636 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="453261b9-e47c-4e0b-b37d-4803c7ea4eab" containerName="container-replicator" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.143641 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="453261b9-e47c-4e0b-b37d-4803c7ea4eab" containerName="container-replicator" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.143652 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d14c3978-d254-4ec4-baa0-f011eaef745e" containerName="cinder-api-log" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.143657 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="d14c3978-d254-4ec4-baa0-f011eaef745e" containerName="cinder-api-log" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.143666 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="453261b9-e47c-4e0b-b37d-4803c7ea4eab" containerName="object-server" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.143671 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="453261b9-e47c-4e0b-b37d-4803c7ea4eab" containerName="object-server" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.143678 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4329933c-52f5-4a6d-a031-7c1658641f8f" containerName="init" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.143684 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="4329933c-52f5-4a6d-a031-7c1658641f8f" containerName="init" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.143694 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1dfcf19-aecf-49e7-9024-2e8b517fecfb" containerName="nova-scheduler-scheduler" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.143699 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1dfcf19-aecf-49e7-9024-2e8b517fecfb" containerName="nova-scheduler-scheduler" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.143707 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="453261b9-e47c-4e0b-b37d-4803c7ea4eab" containerName="object-expirer" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.143712 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="453261b9-e47c-4e0b-b37d-4803c7ea4eab" containerName="object-expirer" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.143723 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="453261b9-e47c-4e0b-b37d-4803c7ea4eab" containerName="swift-recon-cron" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.143728 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="453261b9-e47c-4e0b-b37d-4803c7ea4eab" containerName="swift-recon-cron" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.143737 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62f72752-1070-4856-aec8-5d8c07039d97" containerName="glance-log" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.143742 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="62f72752-1070-4856-aec8-5d8c07039d97" containerName="glance-log" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.143747 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb2bdc0a-77bc-488e-b188-7b24ac191d5a" containerName="glance-httpd" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.143752 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb2bdc0a-77bc-488e-b188-7b24ac191d5a" containerName="glance-httpd" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.143775 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2e33bc1-ee7f-461d-9faa-b5678f7cb416" containerName="barbican-api-log" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.143781 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2e33bc1-ee7f-461d-9faa-b5678f7cb416" containerName="barbican-api-log" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.143787 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb2bdc0a-77bc-488e-b188-7b24ac191d5a" containerName="glance-log" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.143792 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb2bdc0a-77bc-488e-b188-7b24ac191d5a" containerName="glance-log" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.143800 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb48cc0c-a6cd-4fc7-9599-1ed43e3eb216" containerName="nova-cell0-conductor-conductor" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.143805 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb48cc0c-a6cd-4fc7-9599-1ed43e3eb216" containerName="nova-cell0-conductor-conductor" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.143812 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6906541-8dff-40ed-a064-5777f4b66f24" containerName="rabbitmq" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.143817 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6906541-8dff-40ed-a064-5777f4b66f24" containerName="rabbitmq" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.143826 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="161d5626-9918-4847-96fd-f93d894bc230" containerName="ovn-northd" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.143831 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="161d5626-9918-4847-96fd-f93d894bc230" containerName="ovn-northd" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.143837 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9215705-d766-4151-b079-62d304603586" containerName="nova-metadata-metadata" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.143842 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9215705-d766-4151-b079-62d304603586" containerName="nova-metadata-metadata" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.143849 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35eb763c-5d62-4401-a5b6-da3c538709ab" containerName="neutron-api" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.143854 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="35eb763c-5d62-4401-a5b6-da3c538709ab" containerName="neutron-api" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.143862 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ce6e6cf-688e-4f59-8ca2-f3c79e2a1857" containerName="barbican-worker-log" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.143867 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ce6e6cf-688e-4f59-8ca2-f3c79e2a1857" containerName="barbican-worker-log" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.143873 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f4ab831-1080-4b30-9b89-ddbd4d26bbb8" containerName="memcached" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.143879 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f4ab831-1080-4b30-9b89-ddbd4d26bbb8" containerName="memcached" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.143885 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b01ec67-66ba-469f-9eba-1df99165b135" containerName="keystone-api" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.143890 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b01ec67-66ba-469f-9eba-1df99165b135" containerName="keystone-api" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.143898 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="453261b9-e47c-4e0b-b37d-4803c7ea4eab" containerName="container-auditor" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.143903 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="453261b9-e47c-4e0b-b37d-4803c7ea4eab" containerName="container-auditor" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.143911 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="453261b9-e47c-4e0b-b37d-4803c7ea4eab" containerName="object-replicator" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.143916 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="453261b9-e47c-4e0b-b37d-4803c7ea4eab" containerName="object-replicator" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.143922 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6906541-8dff-40ed-a064-5777f4b66f24" containerName="setup-container" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.143928 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6906541-8dff-40ed-a064-5777f4b66f24" containerName="setup-container" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.143936 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62" containerName="ceilometer-notification-agent" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.143942 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62" containerName="ceilometer-notification-agent" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.143951 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0498c744-8606-4b08-b69f-28f80006c19c" containerName="galera" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.143958 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="0498c744-8606-4b08-b69f-28f80006c19c" containerName="galera" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.143965 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57e08e60-42d1-4b58-9892-c2aa5bbae2cf" containerName="probe" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.143970 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="57e08e60-42d1-4b58-9892-c2aa5bbae2cf" containerName="probe" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.143978 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd339abc-691c-48f1-8674-430a5e806067" containerName="rabbitmq" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.143984 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd339abc-691c-48f1-8674-430a5e806067" containerName="rabbitmq" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.143990 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57e08e60-42d1-4b58-9892-c2aa5bbae2cf" containerName="cinder-scheduler" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.143995 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="57e08e60-42d1-4b58-9892-c2aa5bbae2cf" containerName="cinder-scheduler" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.144000 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71a73270-e23b-42a7-a1f4-ad174eab2ac7" containerName="nova-cell1-conductor-conductor" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.144006 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="71a73270-e23b-42a7-a1f4-ad174eab2ac7" containerName="nova-cell1-conductor-conductor" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.144014 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1976af1c-93c9-487c-9852-752bb5c1234d" containerName="placement-api" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.144019 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1976af1c-93c9-487c-9852-752bb5c1234d" containerName="placement-api" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.144027 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d14c3978-d254-4ec4-baa0-f011eaef745e" containerName="cinder-api" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.144031 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="d14c3978-d254-4ec4-baa0-f011eaef745e" containerName="cinder-api" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.144038 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef7c6f1d-0e78-43bf-99c4-9200f5e67136" containerName="nova-api-log" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.144044 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef7c6f1d-0e78-43bf-99c4-9200f5e67136" containerName="nova-api-log" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.144161 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="35eb763c-5d62-4401-a5b6-da3c538709ab" containerName="neutron-httpd" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.144174 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="a9215705-d766-4151-b079-62d304603586" containerName="nova-metadata-log" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.144183 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="453261b9-e47c-4e0b-b37d-4803c7ea4eab" containerName="account-replicator" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.144193 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="62f72752-1070-4856-aec8-5d8c07039d97" containerName="glance-log" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.144202 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="35eb763c-5d62-4401-a5b6-da3c538709ab" containerName="neutron-api" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.144212 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="a1dfcf19-aecf-49e7-9024-2e8b517fecfb" containerName="nova-scheduler-scheduler" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.144236 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62" containerName="proxy-httpd" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.144243 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="453261b9-e47c-4e0b-b37d-4803c7ea4eab" containerName="swift-recon-cron" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.144249 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="453261b9-e47c-4e0b-b37d-4803c7ea4eab" containerName="container-server" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.144255 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="3ce6e6cf-688e-4f59-8ca2-f3c79e2a1857" containerName="barbican-worker" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.144264 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="fcf5af95-be92-4701-9e16-491dbbea165d" containerName="barbican-keystone-listener" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.144273 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="453261b9-e47c-4e0b-b37d-4803c7ea4eab" containerName="object-auditor" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.144283 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="161d5626-9918-4847-96fd-f93d894bc230" containerName="openstack-network-exporter" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.144289 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="453261b9-e47c-4e0b-b37d-4803c7ea4eab" containerName="container-replicator" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.144297 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="57e08e60-42d1-4b58-9892-c2aa5bbae2cf" containerName="probe" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.144307 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="62f72752-1070-4856-aec8-5d8c07039d97" containerName="glance-httpd" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.144317 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1976af1c-93c9-487c-9852-752bb5c1234d" containerName="placement-api" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.144323 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="54551b0a-84c0-40c7-a1d1-64dfbf2fd0d6" containerName="mariadb-account-create-update" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.144331 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="54551b0a-84c0-40c7-a1d1-64dfbf2fd0d6" containerName="mariadb-account-create-update" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.144339 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="d14c3978-d254-4ec4-baa0-f011eaef745e" containerName="cinder-api-log" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.144345 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="3ce6e6cf-688e-4f59-8ca2-f3c79e2a1857" containerName="barbican-worker-log" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.144354 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="453261b9-e47c-4e0b-b37d-4803c7ea4eab" containerName="account-reaper" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.144360 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="4329933c-52f5-4a6d-a031-7c1658641f8f" containerName="dnsmasq-dns" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.144372 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="453261b9-e47c-4e0b-b37d-4803c7ea4eab" containerName="account-server" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.144379 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="453261b9-e47c-4e0b-b37d-4803c7ea4eab" containerName="rsync" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.144385 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c2e33bc1-ee7f-461d-9faa-b5678f7cb416" containerName="barbican-api-log" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.144395 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="453261b9-e47c-4e0b-b37d-4803c7ea4eab" containerName="account-auditor" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.144404 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="fcf5af95-be92-4701-9e16-491dbbea165d" containerName="barbican-keystone-listener-log" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.144410 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="57e08e60-42d1-4b58-9892-c2aa5bbae2cf" containerName="cinder-scheduler" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.144417 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="d14c3978-d254-4ec4-baa0-f011eaef745e" containerName="cinder-api" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.144426 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1976af1c-93c9-487c-9852-752bb5c1234d" containerName="placement-log" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.144432 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="0498c744-8606-4b08-b69f-28f80006c19c" containerName="galera" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.144438 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="d6906541-8dff-40ed-a064-5777f4b66f24" containerName="rabbitmq" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.144445 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c2e33bc1-ee7f-461d-9faa-b5678f7cb416" containerName="barbican-api" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.144453 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="71a73270-e23b-42a7-a1f4-ad174eab2ac7" containerName="nova-cell1-conductor-conductor" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.144459 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62" containerName="ceilometer-notification-agent" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.144466 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="161d5626-9918-4847-96fd-f93d894bc230" containerName="ovn-northd" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.144474 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="cb2bdc0a-77bc-488e-b188-7b24ac191d5a" containerName="glance-httpd" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.144481 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62" containerName="ceilometer-central-agent" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.144490 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="453261b9-e47c-4e0b-b37d-4803c7ea4eab" containerName="container-updater" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.144502 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="a9215705-d766-4151-b079-62d304603586" containerName="nova-metadata-metadata" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.144512 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ef7c6f1d-0e78-43bf-99c4-9200f5e67136" containerName="nova-api-log" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.144520 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="cb2bdc0a-77bc-488e-b188-7b24ac191d5a" containerName="glance-log" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.144528 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="453261b9-e47c-4e0b-b37d-4803c7ea4eab" containerName="object-server" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.144534 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="bb48cc0c-a6cd-4fc7-9599-1ed43e3eb216" containerName="nova-cell0-conductor-conductor" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.144543 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="453261b9-e47c-4e0b-b37d-4803c7ea4eab" containerName="object-replicator" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.144551 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="dd339abc-691c-48f1-8674-430a5e806067" containerName="rabbitmq" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.144557 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="3b01ec67-66ba-469f-9eba-1df99165b135" containerName="keystone-api" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.144564 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ef7c6f1d-0e78-43bf-99c4-9200f5e67136" containerName="nova-api-api" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.144572 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="453261b9-e47c-4e0b-b37d-4803c7ea4eab" containerName="object-expirer" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.144579 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7f4ab831-1080-4b30-9b89-ddbd4d26bbb8" containerName="memcached" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.144586 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="18f8bfe1-b2e3-4d5c-bc2a-44489ec2de62" containerName="sg-core" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.144603 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="453261b9-e47c-4e0b-b37d-4803c7ea4eab" containerName="object-updater" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.144611 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="453261b9-e47c-4e0b-b37d-4803c7ea4eab" containerName="container-auditor" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.155620 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561358-jmrct" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.160516 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561358-jmrct"] Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.161946 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"kube-root-ca.crt\"" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.162190 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-infra\"/\"csr-approver-sa-dockercfg-x2nsz\"" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.164245 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"openshift-service-ca.crt\"" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.255262 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kxd7\" (UniqueName: \"kubernetes.io/projected/46885d57-43f7-41f0-832e-3ee4c1f4a456-kube-api-access-6kxd7\") pod \"auto-csr-approver-29561358-jmrct\" (UID: \"46885d57-43f7-41f0-832e-3ee4c1f4a456\") " pod="openshift-infra/auto-csr-approver-29561358-jmrct" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.333293 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.333329 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.356655 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.356924 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6kxd7\" (UniqueName: \"kubernetes.io/projected/46885d57-43f7-41f0-832e-3ee4c1f4a456-kube-api-access-6kxd7\") pod \"auto-csr-approver-29561358-jmrct\" (UID: \"46885d57-43f7-41f0-832e-3ee4c1f4a456\") " pod="openshift-infra/auto-csr-approver-29561358-jmrct" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.364698 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.373658 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.379825 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.384771 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kxd7\" (UniqueName: \"kubernetes.io/projected/46885d57-43f7-41f0-832e-3ee4c1f4a456-kube-api-access-6kxd7\") pod \"auto-csr-approver-29561358-jmrct\" (UID: \"46885d57-43f7-41f0-832e-3ee4c1f4a456\") " pod="openshift-infra/auto-csr-approver-29561358-jmrct" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.472727 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561358-jmrct" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.676337 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="62f72752-1070-4856-aec8-5d8c07039d97" path="/var/lib/kubelet/pods/62f72752-1070-4856-aec8-5d8c07039d97/volumes" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.677621 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb2bdc0a-77bc-488e-b188-7b24ac191d5a" path="/var/lib/kubelet/pods/cb2bdc0a-77bc-488e-b188-7b24ac191d5a/volumes" Mar 16 17:18:00 crc kubenswrapper[5120]: I0316 17:18:00.898659 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561358-jmrct"] Mar 16 17:18:01 crc kubenswrapper[5120]: I0316 17:18:01.348449 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561358-jmrct" event={"ID":"46885d57-43f7-41f0-832e-3ee4c1f4a456","Type":"ContainerStarted","Data":"940dc0f2d13264b0ca1e6851c97e4fac8f553bcee26a08f75da0d3699bbe594b"} Mar 16 17:18:02 crc kubenswrapper[5120]: I0316 17:18:02.359158 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561358-jmrct" event={"ID":"46885d57-43f7-41f0-832e-3ee4c1f4a456","Type":"ContainerStarted","Data":"81947b04127136171912ff1b77489d536432fb3741a5520af68d98d822b16299"} Mar 16 17:18:02 crc kubenswrapper[5120]: I0316 17:18:02.375902 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-infra/auto-csr-approver-29561358-jmrct" podStartSLOduration=1.2141384849999999 podStartE2EDuration="2.375883888s" podCreationTimestamp="2026-03-16 17:18:00 +0000 UTC" firstStartedPulling="2026-03-16 17:18:00.902749745 +0000 UTC m=+6383.056681402" lastFinishedPulling="2026-03-16 17:18:02.064495148 +0000 UTC m=+6384.218426805" observedRunningTime="2026-03-16 17:18:02.370887441 +0000 UTC m=+6384.524819098" watchObservedRunningTime="2026-03-16 17:18:02.375883888 +0000 UTC m=+6384.529815545" Mar 16 17:18:03 crc kubenswrapper[5120]: I0316 17:18:03.369548 5120 generic.go:358] "Generic (PLEG): container finished" podID="46885d57-43f7-41f0-832e-3ee4c1f4a456" containerID="81947b04127136171912ff1b77489d536432fb3741a5520af68d98d822b16299" exitCode=0 Mar 16 17:18:03 crc kubenswrapper[5120]: I0316 17:18:03.369806 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561358-jmrct" event={"ID":"46885d57-43f7-41f0-832e-3ee4c1f4a456","Type":"ContainerDied","Data":"81947b04127136171912ff1b77489d536432fb3741a5520af68d98d822b16299"} Mar 16 17:18:04 crc kubenswrapper[5120]: I0316 17:18:04.649208 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561358-jmrct" Mar 16 17:18:04 crc kubenswrapper[5120]: I0316 17:18:04.747926 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6kxd7\" (UniqueName: \"kubernetes.io/projected/46885d57-43f7-41f0-832e-3ee4c1f4a456-kube-api-access-6kxd7\") pod \"46885d57-43f7-41f0-832e-3ee4c1f4a456\" (UID: \"46885d57-43f7-41f0-832e-3ee4c1f4a456\") " Mar 16 17:18:04 crc kubenswrapper[5120]: I0316 17:18:04.754451 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46885d57-43f7-41f0-832e-3ee4c1f4a456-kube-api-access-6kxd7" (OuterVolumeSpecName: "kube-api-access-6kxd7") pod "46885d57-43f7-41f0-832e-3ee4c1f4a456" (UID: "46885d57-43f7-41f0-832e-3ee4c1f4a456"). InnerVolumeSpecName "kube-api-access-6kxd7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:18:04 crc kubenswrapper[5120]: I0316 17:18:04.850179 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6kxd7\" (UniqueName: \"kubernetes.io/projected/46885d57-43f7-41f0-832e-3ee4c1f4a456-kube-api-access-6kxd7\") on node \"crc\" DevicePath \"\"" Mar 16 17:18:05 crc kubenswrapper[5120]: I0316 17:18:05.391842 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561358-jmrct" event={"ID":"46885d57-43f7-41f0-832e-3ee4c1f4a456","Type":"ContainerDied","Data":"940dc0f2d13264b0ca1e6851c97e4fac8f553bcee26a08f75da0d3699bbe594b"} Mar 16 17:18:05 crc kubenswrapper[5120]: I0316 17:18:05.391898 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="940dc0f2d13264b0ca1e6851c97e4fac8f553bcee26a08f75da0d3699bbe594b" Mar 16 17:18:05 crc kubenswrapper[5120]: I0316 17:18:05.391972 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561358-jmrct" Mar 16 17:18:05 crc kubenswrapper[5120]: I0316 17:18:05.438231 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-infra/auto-csr-approver-29561352-8fhv4"] Mar 16 17:18:05 crc kubenswrapper[5120]: I0316 17:18:05.444450 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-infra/auto-csr-approver-29561352-8fhv4"] Mar 16 17:18:06 crc kubenswrapper[5120]: I0316 17:18:06.673852 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="90a672ae-a2e9-4683-b159-6cc3ac6df4b4" path="/var/lib/kubelet/pods/90a672ae-a2e9-4683-b159-6cc3ac6df4b4/volumes" Mar 16 17:18:07 crc kubenswrapper[5120]: E0316 17:18:07.492116 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1304887 actualBytes=10240 Mar 16 17:18:07 crc kubenswrapper[5120]: I0316 17:18:07.854677 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["crc-storage/crc-storage-crc-8gqms"] Mar 16 17:18:07 crc kubenswrapper[5120]: I0316 17:18:07.860086 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["crc-storage/crc-storage-crc-8gqms"] Mar 16 17:18:07 crc kubenswrapper[5120]: I0316 17:18:07.986358 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["crc-storage/crc-storage-crc-plp8x"] Mar 16 17:18:07 crc kubenswrapper[5120]: I0316 17:18:07.987348 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46885d57-43f7-41f0-832e-3ee4c1f4a456" containerName="oc" Mar 16 17:18:07 crc kubenswrapper[5120]: I0316 17:18:07.987374 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="46885d57-43f7-41f0-832e-3ee4c1f4a456" containerName="oc" Mar 16 17:18:07 crc kubenswrapper[5120]: I0316 17:18:07.987400 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54551b0a-84c0-40c7-a1d1-64dfbf2fd0d6" containerName="mariadb-account-create-update" Mar 16 17:18:07 crc kubenswrapper[5120]: I0316 17:18:07.987408 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="54551b0a-84c0-40c7-a1d1-64dfbf2fd0d6" containerName="mariadb-account-create-update" Mar 16 17:18:07 crc kubenswrapper[5120]: I0316 17:18:07.987578 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="46885d57-43f7-41f0-832e-3ee4c1f4a456" containerName="oc" Mar 16 17:18:07 crc kubenswrapper[5120]: I0316 17:18:07.999268 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-plp8x"] Mar 16 17:18:07 crc kubenswrapper[5120]: I0316 17:18:07.999399 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-plp8x" Mar 16 17:18:08 crc kubenswrapper[5120]: I0316 17:18:08.002295 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"kube-root-ca.crt\"" Mar 16 17:18:08 crc kubenswrapper[5120]: I0316 17:18:08.002602 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"crc-storage\"/\"crc-storage-dockercfg-s2tht\"" Mar 16 17:18:08 crc kubenswrapper[5120]: I0316 17:18:08.002721 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"openshift-service-ca.crt\"" Mar 16 17:18:08 crc kubenswrapper[5120]: I0316 17:18:08.002801 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"crc-storage\"" Mar 16 17:18:08 crc kubenswrapper[5120]: I0316 17:18:08.117733 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/52635e9e-07a9-4350-a53b-4ca9b6ddf3c7-crc-storage\") pod \"crc-storage-crc-plp8x\" (UID: \"52635e9e-07a9-4350-a53b-4ca9b6ddf3c7\") " pod="crc-storage/crc-storage-crc-plp8x" Mar 16 17:18:08 crc kubenswrapper[5120]: I0316 17:18:08.118313 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/52635e9e-07a9-4350-a53b-4ca9b6ddf3c7-node-mnt\") pod \"crc-storage-crc-plp8x\" (UID: \"52635e9e-07a9-4350-a53b-4ca9b6ddf3c7\") " pod="crc-storage/crc-storage-crc-plp8x" Mar 16 17:18:08 crc kubenswrapper[5120]: I0316 17:18:08.118403 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kknv2\" (UniqueName: \"kubernetes.io/projected/52635e9e-07a9-4350-a53b-4ca9b6ddf3c7-kube-api-access-kknv2\") pod \"crc-storage-crc-plp8x\" (UID: \"52635e9e-07a9-4350-a53b-4ca9b6ddf3c7\") " pod="crc-storage/crc-storage-crc-plp8x" Mar 16 17:18:08 crc kubenswrapper[5120]: I0316 17:18:08.220400 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/52635e9e-07a9-4350-a53b-4ca9b6ddf3c7-crc-storage\") pod \"crc-storage-crc-plp8x\" (UID: \"52635e9e-07a9-4350-a53b-4ca9b6ddf3c7\") " pod="crc-storage/crc-storage-crc-plp8x" Mar 16 17:18:08 crc kubenswrapper[5120]: I0316 17:18:08.220716 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/52635e9e-07a9-4350-a53b-4ca9b6ddf3c7-node-mnt\") pod \"crc-storage-crc-plp8x\" (UID: \"52635e9e-07a9-4350-a53b-4ca9b6ddf3c7\") " pod="crc-storage/crc-storage-crc-plp8x" Mar 16 17:18:08 crc kubenswrapper[5120]: I0316 17:18:08.220792 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kknv2\" (UniqueName: \"kubernetes.io/projected/52635e9e-07a9-4350-a53b-4ca9b6ddf3c7-kube-api-access-kknv2\") pod \"crc-storage-crc-plp8x\" (UID: \"52635e9e-07a9-4350-a53b-4ca9b6ddf3c7\") " pod="crc-storage/crc-storage-crc-plp8x" Mar 16 17:18:08 crc kubenswrapper[5120]: I0316 17:18:08.221001 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/52635e9e-07a9-4350-a53b-4ca9b6ddf3c7-node-mnt\") pod \"crc-storage-crc-plp8x\" (UID: \"52635e9e-07a9-4350-a53b-4ca9b6ddf3c7\") " pod="crc-storage/crc-storage-crc-plp8x" Mar 16 17:18:08 crc kubenswrapper[5120]: I0316 17:18:08.221192 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/52635e9e-07a9-4350-a53b-4ca9b6ddf3c7-crc-storage\") pod \"crc-storage-crc-plp8x\" (UID: \"52635e9e-07a9-4350-a53b-4ca9b6ddf3c7\") " pod="crc-storage/crc-storage-crc-plp8x" Mar 16 17:18:08 crc kubenswrapper[5120]: I0316 17:18:08.237345 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kknv2\" (UniqueName: \"kubernetes.io/projected/52635e9e-07a9-4350-a53b-4ca9b6ddf3c7-kube-api-access-kknv2\") pod \"crc-storage-crc-plp8x\" (UID: \"52635e9e-07a9-4350-a53b-4ca9b6ddf3c7\") " pod="crc-storage/crc-storage-crc-plp8x" Mar 16 17:18:08 crc kubenswrapper[5120]: I0316 17:18:08.320573 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-plp8x" Mar 16 17:18:08 crc kubenswrapper[5120]: I0316 17:18:08.674045 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="076ba57f-9d09-4123-957b-f756d2858434" path="/var/lib/kubelet/pods/076ba57f-9d09-4123-957b-f756d2858434/volumes" Mar 16 17:18:08 crc kubenswrapper[5120]: I0316 17:18:08.758331 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-plp8x"] Mar 16 17:18:09 crc kubenswrapper[5120]: I0316 17:18:09.437927 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-plp8x" event={"ID":"52635e9e-07a9-4350-a53b-4ca9b6ddf3c7","Type":"ContainerStarted","Data":"882757027d6601b088c798dfefa154df85dd1d7bb847781376b5e4f34df92a9c"} Mar 16 17:18:09 crc kubenswrapper[5120]: I0316 17:18:09.438203 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-plp8x" event={"ID":"52635e9e-07a9-4350-a53b-4ca9b6ddf3c7","Type":"ContainerStarted","Data":"c837c80483eec86de0d14145ec1ca3b34f07cfaf81f3160c5a276354cf480a88"} Mar 16 17:18:09 crc kubenswrapper[5120]: I0316 17:18:09.457876 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="crc-storage/crc-storage-crc-plp8x" podStartSLOduration=1.984184935 podStartE2EDuration="2.457859114s" podCreationTimestamp="2026-03-16 17:18:07 +0000 UTC" firstStartedPulling="2026-03-16 17:18:08.763165458 +0000 UTC m=+6390.917097115" lastFinishedPulling="2026-03-16 17:18:09.236839637 +0000 UTC m=+6391.390771294" observedRunningTime="2026-03-16 17:18:09.454276906 +0000 UTC m=+6391.608208563" watchObservedRunningTime="2026-03-16 17:18:09.457859114 +0000 UTC m=+6391.611790771" Mar 16 17:18:09 crc kubenswrapper[5120]: I0316 17:18:09.664290 5120 scope.go:117] "RemoveContainer" containerID="2ca61165dca6fdb30458423ef74c44c42b1b273e8fa504e89f5f9e186e516cc3" Mar 16 17:18:09 crc kubenswrapper[5120]: E0316 17:18:09.664549 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 17:18:10 crc kubenswrapper[5120]: I0316 17:18:10.451088 5120 generic.go:358] "Generic (PLEG): container finished" podID="52635e9e-07a9-4350-a53b-4ca9b6ddf3c7" containerID="882757027d6601b088c798dfefa154df85dd1d7bb847781376b5e4f34df92a9c" exitCode=0 Mar 16 17:18:10 crc kubenswrapper[5120]: I0316 17:18:10.451197 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-plp8x" event={"ID":"52635e9e-07a9-4350-a53b-4ca9b6ddf3c7","Type":"ContainerDied","Data":"882757027d6601b088c798dfefa154df85dd1d7bb847781376b5e4f34df92a9c"} Mar 16 17:18:11 crc kubenswrapper[5120]: I0316 17:18:11.719976 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-plp8x" Mar 16 17:18:11 crc kubenswrapper[5120]: I0316 17:18:11.898572 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/52635e9e-07a9-4350-a53b-4ca9b6ddf3c7-crc-storage\") pod \"52635e9e-07a9-4350-a53b-4ca9b6ddf3c7\" (UID: \"52635e9e-07a9-4350-a53b-4ca9b6ddf3c7\") " Mar 16 17:18:11 crc kubenswrapper[5120]: I0316 17:18:11.898917 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/52635e9e-07a9-4350-a53b-4ca9b6ddf3c7-node-mnt\") pod \"52635e9e-07a9-4350-a53b-4ca9b6ddf3c7\" (UID: \"52635e9e-07a9-4350-a53b-4ca9b6ddf3c7\") " Mar 16 17:18:11 crc kubenswrapper[5120]: I0316 17:18:11.899074 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kknv2\" (UniqueName: \"kubernetes.io/projected/52635e9e-07a9-4350-a53b-4ca9b6ddf3c7-kube-api-access-kknv2\") pod \"52635e9e-07a9-4350-a53b-4ca9b6ddf3c7\" (UID: \"52635e9e-07a9-4350-a53b-4ca9b6ddf3c7\") " Mar 16 17:18:11 crc kubenswrapper[5120]: I0316 17:18:11.899121 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/52635e9e-07a9-4350-a53b-4ca9b6ddf3c7-node-mnt" (OuterVolumeSpecName: "node-mnt") pod "52635e9e-07a9-4350-a53b-4ca9b6ddf3c7" (UID: "52635e9e-07a9-4350-a53b-4ca9b6ddf3c7"). InnerVolumeSpecName "node-mnt". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 17:18:11 crc kubenswrapper[5120]: I0316 17:18:11.900389 5120 reconciler_common.go:299] "Volume detached for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/52635e9e-07a9-4350-a53b-4ca9b6ddf3c7-node-mnt\") on node \"crc\" DevicePath \"\"" Mar 16 17:18:11 crc kubenswrapper[5120]: I0316 17:18:11.904937 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/52635e9e-07a9-4350-a53b-4ca9b6ddf3c7-kube-api-access-kknv2" (OuterVolumeSpecName: "kube-api-access-kknv2") pod "52635e9e-07a9-4350-a53b-4ca9b6ddf3c7" (UID: "52635e9e-07a9-4350-a53b-4ca9b6ddf3c7"). InnerVolumeSpecName "kube-api-access-kknv2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:18:11 crc kubenswrapper[5120]: I0316 17:18:11.923728 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/52635e9e-07a9-4350-a53b-4ca9b6ddf3c7-crc-storage" (OuterVolumeSpecName: "crc-storage") pod "52635e9e-07a9-4350-a53b-4ca9b6ddf3c7" (UID: "52635e9e-07a9-4350-a53b-4ca9b6ddf3c7"). InnerVolumeSpecName "crc-storage". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:18:12 crc kubenswrapper[5120]: I0316 17:18:12.002283 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kknv2\" (UniqueName: \"kubernetes.io/projected/52635e9e-07a9-4350-a53b-4ca9b6ddf3c7-kube-api-access-kknv2\") on node \"crc\" DevicePath \"\"" Mar 16 17:18:12 crc kubenswrapper[5120]: I0316 17:18:12.002317 5120 reconciler_common.go:299] "Volume detached for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/52635e9e-07a9-4350-a53b-4ca9b6ddf3c7-crc-storage\") on node \"crc\" DevicePath \"\"" Mar 16 17:18:12 crc kubenswrapper[5120]: I0316 17:18:12.473235 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-plp8x" event={"ID":"52635e9e-07a9-4350-a53b-4ca9b6ddf3c7","Type":"ContainerDied","Data":"c837c80483eec86de0d14145ec1ca3b34f07cfaf81f3160c5a276354cf480a88"} Mar 16 17:18:12 crc kubenswrapper[5120]: I0316 17:18:12.473295 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c837c80483eec86de0d14145ec1ca3b34f07cfaf81f3160c5a276354cf480a88" Mar 16 17:18:12 crc kubenswrapper[5120]: I0316 17:18:12.473384 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-plp8x" Mar 16 17:18:14 crc kubenswrapper[5120]: I0316 17:18:14.679871 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["crc-storage/crc-storage-crc-plp8x"] Mar 16 17:18:14 crc kubenswrapper[5120]: I0316 17:18:14.683750 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["crc-storage/crc-storage-crc-plp8x"] Mar 16 17:18:14 crc kubenswrapper[5120]: I0316 17:18:14.816508 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["crc-storage/crc-storage-crc-rbsxb"] Mar 16 17:18:14 crc kubenswrapper[5120]: I0316 17:18:14.817986 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52635e9e-07a9-4350-a53b-4ca9b6ddf3c7" containerName="storage" Mar 16 17:18:14 crc kubenswrapper[5120]: I0316 17:18:14.818035 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="52635e9e-07a9-4350-a53b-4ca9b6ddf3c7" containerName="storage" Mar 16 17:18:14 crc kubenswrapper[5120]: I0316 17:18:14.818239 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="52635e9e-07a9-4350-a53b-4ca9b6ddf3c7" containerName="storage" Mar 16 17:18:14 crc kubenswrapper[5120]: I0316 17:18:14.874380 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-rbsxb"] Mar 16 17:18:14 crc kubenswrapper[5120]: I0316 17:18:14.874536 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-rbsxb" Mar 16 17:18:14 crc kubenswrapper[5120]: I0316 17:18:14.880066 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"kube-root-ca.crt\"" Mar 16 17:18:14 crc kubenswrapper[5120]: I0316 17:18:14.880301 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"openshift-service-ca.crt\"" Mar 16 17:18:14 crc kubenswrapper[5120]: I0316 17:18:14.880356 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"crc-storage\"/\"crc-storage-dockercfg-s2tht\"" Mar 16 17:18:14 crc kubenswrapper[5120]: I0316 17:18:14.880581 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"crc-storage\"" Mar 16 17:18:14 crc kubenswrapper[5120]: I0316 17:18:14.975424 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sp5r5\" (UniqueName: \"kubernetes.io/projected/ec357416-19c3-4a61-9bf3-1a122932a3d7-kube-api-access-sp5r5\") pod \"crc-storage-crc-rbsxb\" (UID: \"ec357416-19c3-4a61-9bf3-1a122932a3d7\") " pod="crc-storage/crc-storage-crc-rbsxb" Mar 16 17:18:14 crc kubenswrapper[5120]: I0316 17:18:14.975505 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/ec357416-19c3-4a61-9bf3-1a122932a3d7-node-mnt\") pod \"crc-storage-crc-rbsxb\" (UID: \"ec357416-19c3-4a61-9bf3-1a122932a3d7\") " pod="crc-storage/crc-storage-crc-rbsxb" Mar 16 17:18:14 crc kubenswrapper[5120]: I0316 17:18:14.975620 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/ec357416-19c3-4a61-9bf3-1a122932a3d7-crc-storage\") pod \"crc-storage-crc-rbsxb\" (UID: \"ec357416-19c3-4a61-9bf3-1a122932a3d7\") " pod="crc-storage/crc-storage-crc-rbsxb" Mar 16 17:18:15 crc kubenswrapper[5120]: I0316 17:18:15.078260 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sp5r5\" (UniqueName: \"kubernetes.io/projected/ec357416-19c3-4a61-9bf3-1a122932a3d7-kube-api-access-sp5r5\") pod \"crc-storage-crc-rbsxb\" (UID: \"ec357416-19c3-4a61-9bf3-1a122932a3d7\") " pod="crc-storage/crc-storage-crc-rbsxb" Mar 16 17:18:15 crc kubenswrapper[5120]: I0316 17:18:15.078389 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/ec357416-19c3-4a61-9bf3-1a122932a3d7-node-mnt\") pod \"crc-storage-crc-rbsxb\" (UID: \"ec357416-19c3-4a61-9bf3-1a122932a3d7\") " pod="crc-storage/crc-storage-crc-rbsxb" Mar 16 17:18:15 crc kubenswrapper[5120]: I0316 17:18:15.078440 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/ec357416-19c3-4a61-9bf3-1a122932a3d7-crc-storage\") pod \"crc-storage-crc-rbsxb\" (UID: \"ec357416-19c3-4a61-9bf3-1a122932a3d7\") " pod="crc-storage/crc-storage-crc-rbsxb" Mar 16 17:18:15 crc kubenswrapper[5120]: I0316 17:18:15.078825 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/ec357416-19c3-4a61-9bf3-1a122932a3d7-node-mnt\") pod \"crc-storage-crc-rbsxb\" (UID: \"ec357416-19c3-4a61-9bf3-1a122932a3d7\") " pod="crc-storage/crc-storage-crc-rbsxb" Mar 16 17:18:15 crc kubenswrapper[5120]: I0316 17:18:15.079361 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/ec357416-19c3-4a61-9bf3-1a122932a3d7-crc-storage\") pod \"crc-storage-crc-rbsxb\" (UID: \"ec357416-19c3-4a61-9bf3-1a122932a3d7\") " pod="crc-storage/crc-storage-crc-rbsxb" Mar 16 17:18:15 crc kubenswrapper[5120]: I0316 17:18:15.097601 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sp5r5\" (UniqueName: \"kubernetes.io/projected/ec357416-19c3-4a61-9bf3-1a122932a3d7-kube-api-access-sp5r5\") pod \"crc-storage-crc-rbsxb\" (UID: \"ec357416-19c3-4a61-9bf3-1a122932a3d7\") " pod="crc-storage/crc-storage-crc-rbsxb" Mar 16 17:18:15 crc kubenswrapper[5120]: I0316 17:18:15.190583 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-rbsxb" Mar 16 17:18:15 crc kubenswrapper[5120]: I0316 17:18:15.648448 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-rbsxb"] Mar 16 17:18:16 crc kubenswrapper[5120]: I0316 17:18:16.516749 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-rbsxb" event={"ID":"ec357416-19c3-4a61-9bf3-1a122932a3d7","Type":"ContainerStarted","Data":"ed88c9646f6b81d6df10256d70c26a344c2af94efe1137d72d74b373da3c2a8e"} Mar 16 17:18:16 crc kubenswrapper[5120]: I0316 17:18:16.517137 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-rbsxb" event={"ID":"ec357416-19c3-4a61-9bf3-1a122932a3d7","Type":"ContainerStarted","Data":"bee857534d1f1de40f93d4f960d6c242ffefe2ea823ba7c2cd32fa6ee06e7bc1"} Mar 16 17:18:16 crc kubenswrapper[5120]: I0316 17:18:16.673417 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="52635e9e-07a9-4350-a53b-4ca9b6ddf3c7" path="/var/lib/kubelet/pods/52635e9e-07a9-4350-a53b-4ca9b6ddf3c7/volumes" Mar 16 17:18:17 crc kubenswrapper[5120]: I0316 17:18:17.530623 5120 generic.go:358] "Generic (PLEG): container finished" podID="ec357416-19c3-4a61-9bf3-1a122932a3d7" containerID="ed88c9646f6b81d6df10256d70c26a344c2af94efe1137d72d74b373da3c2a8e" exitCode=0 Mar 16 17:18:17 crc kubenswrapper[5120]: I0316 17:18:17.530730 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-rbsxb" event={"ID":"ec357416-19c3-4a61-9bf3-1a122932a3d7","Type":"ContainerDied","Data":"ed88c9646f6b81d6df10256d70c26a344c2af94efe1137d72d74b373da3c2a8e"} Mar 16 17:18:17 crc kubenswrapper[5120]: I0316 17:18:17.820229 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-rbsxb" Mar 16 17:18:17 crc kubenswrapper[5120]: I0316 17:18:17.936172 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sp5r5\" (UniqueName: \"kubernetes.io/projected/ec357416-19c3-4a61-9bf3-1a122932a3d7-kube-api-access-sp5r5\") pod \"ec357416-19c3-4a61-9bf3-1a122932a3d7\" (UID: \"ec357416-19c3-4a61-9bf3-1a122932a3d7\") " Mar 16 17:18:17 crc kubenswrapper[5120]: I0316 17:18:17.936599 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/ec357416-19c3-4a61-9bf3-1a122932a3d7-node-mnt\") pod \"ec357416-19c3-4a61-9bf3-1a122932a3d7\" (UID: \"ec357416-19c3-4a61-9bf3-1a122932a3d7\") " Mar 16 17:18:17 crc kubenswrapper[5120]: I0316 17:18:17.936667 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/ec357416-19c3-4a61-9bf3-1a122932a3d7-node-mnt" (OuterVolumeSpecName: "node-mnt") pod "ec357416-19c3-4a61-9bf3-1a122932a3d7" (UID: "ec357416-19c3-4a61-9bf3-1a122932a3d7"). InnerVolumeSpecName "node-mnt". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 17:18:17 crc kubenswrapper[5120]: I0316 17:18:17.936965 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/ec357416-19c3-4a61-9bf3-1a122932a3d7-crc-storage\") pod \"ec357416-19c3-4a61-9bf3-1a122932a3d7\" (UID: \"ec357416-19c3-4a61-9bf3-1a122932a3d7\") " Mar 16 17:18:17 crc kubenswrapper[5120]: I0316 17:18:17.937547 5120 reconciler_common.go:299] "Volume detached for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/ec357416-19c3-4a61-9bf3-1a122932a3d7-node-mnt\") on node \"crc\" DevicePath \"\"" Mar 16 17:18:17 crc kubenswrapper[5120]: I0316 17:18:17.941991 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec357416-19c3-4a61-9bf3-1a122932a3d7-kube-api-access-sp5r5" (OuterVolumeSpecName: "kube-api-access-sp5r5") pod "ec357416-19c3-4a61-9bf3-1a122932a3d7" (UID: "ec357416-19c3-4a61-9bf3-1a122932a3d7"). InnerVolumeSpecName "kube-api-access-sp5r5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:18:17 crc kubenswrapper[5120]: I0316 17:18:17.954128 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec357416-19c3-4a61-9bf3-1a122932a3d7-crc-storage" (OuterVolumeSpecName: "crc-storage") pod "ec357416-19c3-4a61-9bf3-1a122932a3d7" (UID: "ec357416-19c3-4a61-9bf3-1a122932a3d7"). InnerVolumeSpecName "crc-storage". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:18:18 crc kubenswrapper[5120]: I0316 17:18:18.039687 5120 reconciler_common.go:299] "Volume detached for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/ec357416-19c3-4a61-9bf3-1a122932a3d7-crc-storage\") on node \"crc\" DevicePath \"\"" Mar 16 17:18:18 crc kubenswrapper[5120]: I0316 17:18:18.039738 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sp5r5\" (UniqueName: \"kubernetes.io/projected/ec357416-19c3-4a61-9bf3-1a122932a3d7-kube-api-access-sp5r5\") on node \"crc\" DevicePath \"\"" Mar 16 17:18:18 crc kubenswrapper[5120]: I0316 17:18:18.541138 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-rbsxb" Mar 16 17:18:18 crc kubenswrapper[5120]: I0316 17:18:18.541131 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-rbsxb" event={"ID":"ec357416-19c3-4a61-9bf3-1a122932a3d7","Type":"ContainerDied","Data":"bee857534d1f1de40f93d4f960d6c242ffefe2ea823ba7c2cd32fa6ee06e7bc1"} Mar 16 17:18:18 crc kubenswrapper[5120]: I0316 17:18:18.541270 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bee857534d1f1de40f93d4f960d6c242ffefe2ea823ba7c2cd32fa6ee06e7bc1" Mar 16 17:18:21 crc kubenswrapper[5120]: I0316 17:18:21.765420 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-68cbfccb49-cvdsc"] Mar 16 17:18:21 crc kubenswrapper[5120]: I0316 17:18:21.767593 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec357416-19c3-4a61-9bf3-1a122932a3d7" containerName="storage" Mar 16 17:18:21 crc kubenswrapper[5120]: I0316 17:18:21.767728 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec357416-19c3-4a61-9bf3-1a122932a3d7" containerName="storage" Mar 16 17:18:21 crc kubenswrapper[5120]: I0316 17:18:21.768026 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ec357416-19c3-4a61-9bf3-1a122932a3d7" containerName="storage" Mar 16 17:18:21 crc kubenswrapper[5120]: I0316 17:18:21.776154 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-68cbfccb49-cvdsc"] Mar 16 17:18:21 crc kubenswrapper[5120]: I0316 17:18:21.776323 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-68cbfccb49-cvdsc" Mar 16 17:18:21 crc kubenswrapper[5120]: I0316 17:18:21.779100 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-edpm-ipam\"" Mar 16 17:18:21 crc kubenswrapper[5120]: I0316 17:18:21.829859 5120 scope.go:117] "RemoveContainer" containerID="21c1f1009dd9301611e2a8c92eba97428d8b4eb942531017355ecebe87b77211" Mar 16 17:18:21 crc kubenswrapper[5120]: I0316 17:18:21.858790 5120 scope.go:117] "RemoveContainer" containerID="a947c8afd45fa66fbd8df4075fde117b953cce66958b7fd25391f531cbbe8a10" Mar 16 17:18:21 crc kubenswrapper[5120]: I0316 17:18:21.887477 5120 scope.go:117] "RemoveContainer" containerID="dc58ff525e8f9a64ea0edf895c3a72965b20fec11d931193febb6ae201c3a62d" Mar 16 17:18:21 crc kubenswrapper[5120]: I0316 17:18:21.917233 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/430f9063-d353-4310-b760-cd90e5a1d6b7-config\") pod \"dnsmasq-dnsmasq-68cbfccb49-cvdsc\" (UID: \"430f9063-d353-4310-b760-cd90e5a1d6b7\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-68cbfccb49-cvdsc" Mar 16 17:18:21 crc kubenswrapper[5120]: I0316 17:18:21.917389 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-edpm-ipam\" (UniqueName: \"kubernetes.io/configmap/430f9063-d353-4310-b760-cd90e5a1d6b7-openstack-edpm-ipam\") pod \"dnsmasq-dnsmasq-68cbfccb49-cvdsc\" (UID: \"430f9063-d353-4310-b760-cd90e5a1d6b7\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-68cbfccb49-cvdsc" Mar 16 17:18:21 crc kubenswrapper[5120]: I0316 17:18:21.917492 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2zsw4\" (UniqueName: \"kubernetes.io/projected/430f9063-d353-4310-b760-cd90e5a1d6b7-kube-api-access-2zsw4\") pod \"dnsmasq-dnsmasq-68cbfccb49-cvdsc\" (UID: \"430f9063-d353-4310-b760-cd90e5a1d6b7\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-68cbfccb49-cvdsc" Mar 16 17:18:21 crc kubenswrapper[5120]: I0316 17:18:21.917694 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/430f9063-d353-4310-b760-cd90e5a1d6b7-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-68cbfccb49-cvdsc\" (UID: \"430f9063-d353-4310-b760-cd90e5a1d6b7\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-68cbfccb49-cvdsc" Mar 16 17:18:21 crc kubenswrapper[5120]: I0316 17:18:21.918407 5120 scope.go:117] "RemoveContainer" containerID="0cb75cd76e83c805136be2430ae92ab9ce0b6d500c761635d50c613f87fa59b7" Mar 16 17:18:21 crc kubenswrapper[5120]: I0316 17:18:21.939368 5120 scope.go:117] "RemoveContainer" containerID="cd2b5ef72fd2bb400ac948b2d6e054d128c94037c9f7d1ca2d8b360f1ab0d8e9" Mar 16 17:18:22 crc kubenswrapper[5120]: I0316 17:18:22.028544 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/430f9063-d353-4310-b760-cd90e5a1d6b7-config\") pod \"dnsmasq-dnsmasq-68cbfccb49-cvdsc\" (UID: \"430f9063-d353-4310-b760-cd90e5a1d6b7\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-68cbfccb49-cvdsc" Mar 16 17:18:22 crc kubenswrapper[5120]: I0316 17:18:22.028606 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openstack-edpm-ipam\" (UniqueName: \"kubernetes.io/configmap/430f9063-d353-4310-b760-cd90e5a1d6b7-openstack-edpm-ipam\") pod \"dnsmasq-dnsmasq-68cbfccb49-cvdsc\" (UID: \"430f9063-d353-4310-b760-cd90e5a1d6b7\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-68cbfccb49-cvdsc" Mar 16 17:18:22 crc kubenswrapper[5120]: I0316 17:18:22.028697 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2zsw4\" (UniqueName: \"kubernetes.io/projected/430f9063-d353-4310-b760-cd90e5a1d6b7-kube-api-access-2zsw4\") pod \"dnsmasq-dnsmasq-68cbfccb49-cvdsc\" (UID: \"430f9063-d353-4310-b760-cd90e5a1d6b7\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-68cbfccb49-cvdsc" Mar 16 17:18:22 crc kubenswrapper[5120]: I0316 17:18:22.028945 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/430f9063-d353-4310-b760-cd90e5a1d6b7-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-68cbfccb49-cvdsc\" (UID: \"430f9063-d353-4310-b760-cd90e5a1d6b7\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-68cbfccb49-cvdsc" Mar 16 17:18:22 crc kubenswrapper[5120]: I0316 17:18:22.029644 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openstack-edpm-ipam\" (UniqueName: \"kubernetes.io/configmap/430f9063-d353-4310-b760-cd90e5a1d6b7-openstack-edpm-ipam\") pod \"dnsmasq-dnsmasq-68cbfccb49-cvdsc\" (UID: \"430f9063-d353-4310-b760-cd90e5a1d6b7\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-68cbfccb49-cvdsc" Mar 16 17:18:22 crc kubenswrapper[5120]: I0316 17:18:22.029676 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/430f9063-d353-4310-b760-cd90e5a1d6b7-config\") pod \"dnsmasq-dnsmasq-68cbfccb49-cvdsc\" (UID: \"430f9063-d353-4310-b760-cd90e5a1d6b7\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-68cbfccb49-cvdsc" Mar 16 17:18:22 crc kubenswrapper[5120]: I0316 17:18:22.030015 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/430f9063-d353-4310-b760-cd90e5a1d6b7-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-68cbfccb49-cvdsc\" (UID: \"430f9063-d353-4310-b760-cd90e5a1d6b7\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-68cbfccb49-cvdsc" Mar 16 17:18:22 crc kubenswrapper[5120]: I0316 17:18:22.035336 5120 scope.go:117] "RemoveContainer" containerID="1a3889ae28037fad7300c641e3e8acf006fc67c82e9ff4510500aa48074b4fee" Mar 16 17:18:22 crc kubenswrapper[5120]: I0316 17:18:22.047736 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2zsw4\" (UniqueName: \"kubernetes.io/projected/430f9063-d353-4310-b760-cd90e5a1d6b7-kube-api-access-2zsw4\") pod \"dnsmasq-dnsmasq-68cbfccb49-cvdsc\" (UID: \"430f9063-d353-4310-b760-cd90e5a1d6b7\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-68cbfccb49-cvdsc" Mar 16 17:18:22 crc kubenswrapper[5120]: I0316 17:18:22.093549 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-68cbfccb49-cvdsc" Mar 16 17:18:22 crc kubenswrapper[5120]: I0316 17:18:22.593162 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-68cbfccb49-cvdsc"] Mar 16 17:18:22 crc kubenswrapper[5120]: W0316 17:18:22.597631 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod430f9063_d353_4310_b760_cd90e5a1d6b7.slice/crio-2d064efbc9107fbd44868443a77beb723ae92aa57dca14319d9a58577a3c3c3f WatchSource:0}: Error finding container 2d064efbc9107fbd44868443a77beb723ae92aa57dca14319d9a58577a3c3c3f: Status 404 returned error can't find the container with id 2d064efbc9107fbd44868443a77beb723ae92aa57dca14319d9a58577a3c3c3f Mar 16 17:18:23 crc kubenswrapper[5120]: I0316 17:18:23.589684 5120 generic.go:358] "Generic (PLEG): container finished" podID="430f9063-d353-4310-b760-cd90e5a1d6b7" containerID="0d1ca4fde3b70ea4b71212d2689b5d860daffd0fc3cdd2093ed84747a20362db" exitCode=0 Mar 16 17:18:23 crc kubenswrapper[5120]: I0316 17:18:23.589773 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-68cbfccb49-cvdsc" event={"ID":"430f9063-d353-4310-b760-cd90e5a1d6b7","Type":"ContainerDied","Data":"0d1ca4fde3b70ea4b71212d2689b5d860daffd0fc3cdd2093ed84747a20362db"} Mar 16 17:18:23 crc kubenswrapper[5120]: I0316 17:18:23.590133 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-68cbfccb49-cvdsc" event={"ID":"430f9063-d353-4310-b760-cd90e5a1d6b7","Type":"ContainerStarted","Data":"2d064efbc9107fbd44868443a77beb723ae92aa57dca14319d9a58577a3c3c3f"} Mar 16 17:18:23 crc kubenswrapper[5120]: I0316 17:18:23.664136 5120 scope.go:117] "RemoveContainer" containerID="2ca61165dca6fdb30458423ef74c44c42b1b273e8fa504e89f5f9e186e516cc3" Mar 16 17:18:23 crc kubenswrapper[5120]: E0316 17:18:23.664777 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 17:18:24 crc kubenswrapper[5120]: I0316 17:18:24.601535 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-68cbfccb49-cvdsc" event={"ID":"430f9063-d353-4310-b760-cd90e5a1d6b7","Type":"ContainerStarted","Data":"548f160d841bf3cd298aea9361893a5c9d953e7985b5b7177258aef709ad6bb0"} Mar 16 17:18:24 crc kubenswrapper[5120]: I0316 17:18:24.602422 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-68cbfccb49-cvdsc" Mar 16 17:18:24 crc kubenswrapper[5120]: I0316 17:18:24.626340 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-68cbfccb49-cvdsc" podStartSLOduration=3.626321477 podStartE2EDuration="3.626321477s" podCreationTimestamp="2026-03-16 17:18:21 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:18:24.619378757 +0000 UTC m=+6406.773310414" watchObservedRunningTime="2026-03-16 17:18:24.626321477 +0000 UTC m=+6406.780253124" Mar 16 17:18:31 crc kubenswrapper[5120]: I0316 17:18:31.623040 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-68cbfccb49-cvdsc" Mar 16 17:18:31 crc kubenswrapper[5120]: I0316 17:18:31.668008 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-5r7xg"] Mar 16 17:18:31 crc kubenswrapper[5120]: I0316 17:18:31.668259 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-5r7xg" podUID="05faed40-e1aa-44be-bae7-49459da3dc79" containerName="dnsmasq-dns" containerID="cri-o://83878088a4253eded0a5f82814cef033d0121f60cdc7867f4769ded7f714e6e1" gracePeriod=10 Mar 16 17:18:31 crc kubenswrapper[5120]: I0316 17:18:31.844724 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-6b68bc58cc-dj8kn"] Mar 16 17:18:31 crc kubenswrapper[5120]: I0316 17:18:31.854050 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6b68bc58cc-dj8kn" Mar 16 17:18:31 crc kubenswrapper[5120]: I0316 17:18:31.862270 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-6b68bc58cc-dj8kn"] Mar 16 17:18:32 crc kubenswrapper[5120]: I0316 17:18:32.039839 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5eb00ac0-0ba5-4d30-ac7a-02d59b5dc6d3-config\") pod \"dnsmasq-dnsmasq-6b68bc58cc-dj8kn\" (UID: \"5eb00ac0-0ba5-4d30-ac7a-02d59b5dc6d3\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6b68bc58cc-dj8kn" Mar 16 17:18:32 crc kubenswrapper[5120]: I0316 17:18:32.040410 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/5eb00ac0-0ba5-4d30-ac7a-02d59b5dc6d3-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-6b68bc58cc-dj8kn\" (UID: \"5eb00ac0-0ba5-4d30-ac7a-02d59b5dc6d3\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6b68bc58cc-dj8kn" Mar 16 17:18:32 crc kubenswrapper[5120]: I0316 17:18:32.040576 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9vmq\" (UniqueName: \"kubernetes.io/projected/5eb00ac0-0ba5-4d30-ac7a-02d59b5dc6d3-kube-api-access-p9vmq\") pod \"dnsmasq-dnsmasq-6b68bc58cc-dj8kn\" (UID: \"5eb00ac0-0ba5-4d30-ac7a-02d59b5dc6d3\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6b68bc58cc-dj8kn" Mar 16 17:18:32 crc kubenswrapper[5120]: I0316 17:18:32.040751 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-edpm-ipam\" (UniqueName: \"kubernetes.io/configmap/5eb00ac0-0ba5-4d30-ac7a-02d59b5dc6d3-openstack-edpm-ipam\") pod \"dnsmasq-dnsmasq-6b68bc58cc-dj8kn\" (UID: \"5eb00ac0-0ba5-4d30-ac7a-02d59b5dc6d3\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6b68bc58cc-dj8kn" Mar 16 17:18:32 crc kubenswrapper[5120]: I0316 17:18:32.145503 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-5r7xg" Mar 16 17:18:32 crc kubenswrapper[5120]: I0316 17:18:32.145825 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openstack-edpm-ipam\" (UniqueName: \"kubernetes.io/configmap/5eb00ac0-0ba5-4d30-ac7a-02d59b5dc6d3-openstack-edpm-ipam\") pod \"dnsmasq-dnsmasq-6b68bc58cc-dj8kn\" (UID: \"5eb00ac0-0ba5-4d30-ac7a-02d59b5dc6d3\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6b68bc58cc-dj8kn" Mar 16 17:18:32 crc kubenswrapper[5120]: E0316 17:18:32.145915 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-edpm-ipam: configmap "openstack-edpm-ipam" not found Mar 16 17:18:32 crc kubenswrapper[5120]: E0316 17:18:32.146868 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5eb00ac0-0ba5-4d30-ac7a-02d59b5dc6d3-openstack-edpm-ipam podName:5eb00ac0-0ba5-4d30-ac7a-02d59b5dc6d3 nodeName:}" failed. No retries permitted until 2026-03-16 17:18:32.646119188 +0000 UTC m=+6414.800050845 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openstack-edpm-ipam" (UniqueName: "kubernetes.io/configmap/5eb00ac0-0ba5-4d30-ac7a-02d59b5dc6d3-openstack-edpm-ipam") pod "dnsmasq-dnsmasq-6b68bc58cc-dj8kn" (UID: "5eb00ac0-0ba5-4d30-ac7a-02d59b5dc6d3") : configmap "openstack-edpm-ipam" not found Mar 16 17:18:32 crc kubenswrapper[5120]: I0316 17:18:32.147218 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5eb00ac0-0ba5-4d30-ac7a-02d59b5dc6d3-config\") pod \"dnsmasq-dnsmasq-6b68bc58cc-dj8kn\" (UID: \"5eb00ac0-0ba5-4d30-ac7a-02d59b5dc6d3\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6b68bc58cc-dj8kn" Mar 16 17:18:32 crc kubenswrapper[5120]: I0316 17:18:32.147246 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/5eb00ac0-0ba5-4d30-ac7a-02d59b5dc6d3-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-6b68bc58cc-dj8kn\" (UID: \"5eb00ac0-0ba5-4d30-ac7a-02d59b5dc6d3\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6b68bc58cc-dj8kn" Mar 16 17:18:32 crc kubenswrapper[5120]: I0316 17:18:32.147378 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p9vmq\" (UniqueName: \"kubernetes.io/projected/5eb00ac0-0ba5-4d30-ac7a-02d59b5dc6d3-kube-api-access-p9vmq\") pod \"dnsmasq-dnsmasq-6b68bc58cc-dj8kn\" (UID: \"5eb00ac0-0ba5-4d30-ac7a-02d59b5dc6d3\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6b68bc58cc-dj8kn" Mar 16 17:18:32 crc kubenswrapper[5120]: I0316 17:18:32.148641 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/5eb00ac0-0ba5-4d30-ac7a-02d59b5dc6d3-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-6b68bc58cc-dj8kn\" (UID: \"5eb00ac0-0ba5-4d30-ac7a-02d59b5dc6d3\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6b68bc58cc-dj8kn" Mar 16 17:18:32 crc kubenswrapper[5120]: I0316 17:18:32.148734 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5eb00ac0-0ba5-4d30-ac7a-02d59b5dc6d3-config\") pod \"dnsmasq-dnsmasq-6b68bc58cc-dj8kn\" (UID: \"5eb00ac0-0ba5-4d30-ac7a-02d59b5dc6d3\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6b68bc58cc-dj8kn" Mar 16 17:18:32 crc kubenswrapper[5120]: I0316 17:18:32.170690 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9vmq\" (UniqueName: \"kubernetes.io/projected/5eb00ac0-0ba5-4d30-ac7a-02d59b5dc6d3-kube-api-access-p9vmq\") pod \"dnsmasq-dnsmasq-6b68bc58cc-dj8kn\" (UID: \"5eb00ac0-0ba5-4d30-ac7a-02d59b5dc6d3\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6b68bc58cc-dj8kn" Mar 16 17:18:32 crc kubenswrapper[5120]: I0316 17:18:32.224840 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-6b68bc58cc-dj8kn"] Mar 16 17:18:32 crc kubenswrapper[5120]: E0316 17:18:32.225523 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[openstack-edpm-ipam], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6b68bc58cc-dj8kn" podUID="5eb00ac0-0ba5-4d30-ac7a-02d59b5dc6d3" Mar 16 17:18:32 crc kubenswrapper[5120]: I0316 17:18:32.237709 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-v9czz"] Mar 16 17:18:32 crc kubenswrapper[5120]: I0316 17:18:32.238977 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05faed40-e1aa-44be-bae7-49459da3dc79" containerName="dnsmasq-dns" Mar 16 17:18:32 crc kubenswrapper[5120]: I0316 17:18:32.239003 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="05faed40-e1aa-44be-bae7-49459da3dc79" containerName="dnsmasq-dns" Mar 16 17:18:32 crc kubenswrapper[5120]: I0316 17:18:32.239018 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05faed40-e1aa-44be-bae7-49459da3dc79" containerName="init" Mar 16 17:18:32 crc kubenswrapper[5120]: I0316 17:18:32.239026 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="05faed40-e1aa-44be-bae7-49459da3dc79" containerName="init" Mar 16 17:18:32 crc kubenswrapper[5120]: I0316 17:18:32.239263 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="05faed40-e1aa-44be-bae7-49459da3dc79" containerName="dnsmasq-dns" Mar 16 17:18:32 crc kubenswrapper[5120]: I0316 17:18:32.249422 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/05faed40-e1aa-44be-bae7-49459da3dc79-config\") pod \"05faed40-e1aa-44be-bae7-49459da3dc79\" (UID: \"05faed40-e1aa-44be-bae7-49459da3dc79\") " Mar 16 17:18:32 crc kubenswrapper[5120]: I0316 17:18:32.249727 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7gs94\" (UniqueName: \"kubernetes.io/projected/05faed40-e1aa-44be-bae7-49459da3dc79-kube-api-access-7gs94\") pod \"05faed40-e1aa-44be-bae7-49459da3dc79\" (UID: \"05faed40-e1aa-44be-bae7-49459da3dc79\") " Mar 16 17:18:32 crc kubenswrapper[5120]: I0316 17:18:32.249805 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/05faed40-e1aa-44be-bae7-49459da3dc79-dnsmasq-svc\") pod \"05faed40-e1aa-44be-bae7-49459da3dc79\" (UID: \"05faed40-e1aa-44be-bae7-49459da3dc79\") " Mar 16 17:18:32 crc kubenswrapper[5120]: I0316 17:18:32.252004 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-v9czz"] Mar 16 17:18:32 crc kubenswrapper[5120]: I0316 17:18:32.252126 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-v9czz" Mar 16 17:18:32 crc kubenswrapper[5120]: I0316 17:18:32.273873 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05faed40-e1aa-44be-bae7-49459da3dc79-kube-api-access-7gs94" (OuterVolumeSpecName: "kube-api-access-7gs94") pod "05faed40-e1aa-44be-bae7-49459da3dc79" (UID: "05faed40-e1aa-44be-bae7-49459da3dc79"). InnerVolumeSpecName "kube-api-access-7gs94". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:18:32 crc kubenswrapper[5120]: I0316 17:18:32.302098 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/05faed40-e1aa-44be-bae7-49459da3dc79-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "05faed40-e1aa-44be-bae7-49459da3dc79" (UID: "05faed40-e1aa-44be-bae7-49459da3dc79"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:18:32 crc kubenswrapper[5120]: I0316 17:18:32.310028 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/05faed40-e1aa-44be-bae7-49459da3dc79-config" (OuterVolumeSpecName: "config") pod "05faed40-e1aa-44be-bae7-49459da3dc79" (UID: "05faed40-e1aa-44be-bae7-49459da3dc79"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:18:32 crc kubenswrapper[5120]: I0316 17:18:32.357804 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmhvr\" (UniqueName: \"kubernetes.io/projected/813225e2-fc35-4474-8fb3-3d5232b6b983-kube-api-access-zmhvr\") pod \"dnsmasq-dnsmasq-79dcd846c5-v9czz\" (UID: \"813225e2-fc35-4474-8fb3-3d5232b6b983\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-v9czz" Mar 16 17:18:32 crc kubenswrapper[5120]: I0316 17:18:32.358023 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/813225e2-fc35-4474-8fb3-3d5232b6b983-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-79dcd846c5-v9czz\" (UID: \"813225e2-fc35-4474-8fb3-3d5232b6b983\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-v9czz" Mar 16 17:18:32 crc kubenswrapper[5120]: I0316 17:18:32.358146 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/813225e2-fc35-4474-8fb3-3d5232b6b983-config\") pod \"dnsmasq-dnsmasq-79dcd846c5-v9czz\" (UID: \"813225e2-fc35-4474-8fb3-3d5232b6b983\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-v9czz" Mar 16 17:18:32 crc kubenswrapper[5120]: I0316 17:18:32.358214 5120 reconciler_common.go:299] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/05faed40-e1aa-44be-bae7-49459da3dc79-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Mar 16 17:18:32 crc kubenswrapper[5120]: I0316 17:18:32.358235 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/05faed40-e1aa-44be-bae7-49459da3dc79-config\") on node \"crc\" DevicePath \"\"" Mar 16 17:18:32 crc kubenswrapper[5120]: I0316 17:18:32.358249 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7gs94\" (UniqueName: \"kubernetes.io/projected/05faed40-e1aa-44be-bae7-49459da3dc79-kube-api-access-7gs94\") on node \"crc\" DevicePath \"\"" Mar 16 17:18:32 crc kubenswrapper[5120]: I0316 17:18:32.459541 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zmhvr\" (UniqueName: \"kubernetes.io/projected/813225e2-fc35-4474-8fb3-3d5232b6b983-kube-api-access-zmhvr\") pod \"dnsmasq-dnsmasq-79dcd846c5-v9czz\" (UID: \"813225e2-fc35-4474-8fb3-3d5232b6b983\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-v9czz" Mar 16 17:18:32 crc kubenswrapper[5120]: I0316 17:18:32.460062 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/813225e2-fc35-4474-8fb3-3d5232b6b983-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-79dcd846c5-v9czz\" (UID: \"813225e2-fc35-4474-8fb3-3d5232b6b983\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-v9czz" Mar 16 17:18:32 crc kubenswrapper[5120]: I0316 17:18:32.460175 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/813225e2-fc35-4474-8fb3-3d5232b6b983-config\") pod \"dnsmasq-dnsmasq-79dcd846c5-v9czz\" (UID: \"813225e2-fc35-4474-8fb3-3d5232b6b983\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-v9czz" Mar 16 17:18:32 crc kubenswrapper[5120]: I0316 17:18:32.461639 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/813225e2-fc35-4474-8fb3-3d5232b6b983-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-79dcd846c5-v9czz\" (UID: \"813225e2-fc35-4474-8fb3-3d5232b6b983\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-v9czz" Mar 16 17:18:32 crc kubenswrapper[5120]: I0316 17:18:32.461717 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/813225e2-fc35-4474-8fb3-3d5232b6b983-config\") pod \"dnsmasq-dnsmasq-79dcd846c5-v9czz\" (UID: \"813225e2-fc35-4474-8fb3-3d5232b6b983\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-v9czz" Mar 16 17:18:32 crc kubenswrapper[5120]: I0316 17:18:32.480095 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmhvr\" (UniqueName: \"kubernetes.io/projected/813225e2-fc35-4474-8fb3-3d5232b6b983-kube-api-access-zmhvr\") pod \"dnsmasq-dnsmasq-79dcd846c5-v9czz\" (UID: \"813225e2-fc35-4474-8fb3-3d5232b6b983\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-v9czz" Mar 16 17:18:32 crc kubenswrapper[5120]: I0316 17:18:32.601806 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-v9czz" Mar 16 17:18:32 crc kubenswrapper[5120]: I0316 17:18:32.663664 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openstack-edpm-ipam\" (UniqueName: \"kubernetes.io/configmap/5eb00ac0-0ba5-4d30-ac7a-02d59b5dc6d3-openstack-edpm-ipam\") pod \"dnsmasq-dnsmasq-6b68bc58cc-dj8kn\" (UID: \"5eb00ac0-0ba5-4d30-ac7a-02d59b5dc6d3\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6b68bc58cc-dj8kn" Mar 16 17:18:32 crc kubenswrapper[5120]: E0316 17:18:32.663844 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-edpm-ipam: configmap "openstack-edpm-ipam" not found Mar 16 17:18:32 crc kubenswrapper[5120]: E0316 17:18:32.663981 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5eb00ac0-0ba5-4d30-ac7a-02d59b5dc6d3-openstack-edpm-ipam podName:5eb00ac0-0ba5-4d30-ac7a-02d59b5dc6d3 nodeName:}" failed. No retries permitted until 2026-03-16 17:18:33.663956668 +0000 UTC m=+6415.817888325 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "openstack-edpm-ipam" (UniqueName: "kubernetes.io/configmap/5eb00ac0-0ba5-4d30-ac7a-02d59b5dc6d3-openstack-edpm-ipam") pod "dnsmasq-dnsmasq-6b68bc58cc-dj8kn" (UID: "5eb00ac0-0ba5-4d30-ac7a-02d59b5dc6d3") : configmap "openstack-edpm-ipam" not found Mar 16 17:18:32 crc kubenswrapper[5120]: I0316 17:18:32.718880 5120 generic.go:358] "Generic (PLEG): container finished" podID="05faed40-e1aa-44be-bae7-49459da3dc79" containerID="83878088a4253eded0a5f82814cef033d0121f60cdc7867f4769ded7f714e6e1" exitCode=0 Mar 16 17:18:32 crc kubenswrapper[5120]: I0316 17:18:32.719626 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6b68bc58cc-dj8kn" Mar 16 17:18:32 crc kubenswrapper[5120]: I0316 17:18:32.719742 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-5r7xg" event={"ID":"05faed40-e1aa-44be-bae7-49459da3dc79","Type":"ContainerDied","Data":"83878088a4253eded0a5f82814cef033d0121f60cdc7867f4769ded7f714e6e1"} Mar 16 17:18:32 crc kubenswrapper[5120]: I0316 17:18:32.719939 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-5r7xg" Mar 16 17:18:32 crc kubenswrapper[5120]: I0316 17:18:32.719965 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-5r7xg" event={"ID":"05faed40-e1aa-44be-bae7-49459da3dc79","Type":"ContainerDied","Data":"2a9d3fb080c1e1f4af6d04f269e5a905eb3b390814632e0053628985859c3224"} Mar 16 17:18:32 crc kubenswrapper[5120]: I0316 17:18:32.720007 5120 scope.go:117] "RemoveContainer" containerID="83878088a4253eded0a5f82814cef033d0121f60cdc7867f4769ded7f714e6e1" Mar 16 17:18:32 crc kubenswrapper[5120]: I0316 17:18:32.752829 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6b68bc58cc-dj8kn" Mar 16 17:18:32 crc kubenswrapper[5120]: I0316 17:18:32.764416 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p9vmq\" (UniqueName: \"kubernetes.io/projected/5eb00ac0-0ba5-4d30-ac7a-02d59b5dc6d3-kube-api-access-p9vmq\") pod \"5eb00ac0-0ba5-4d30-ac7a-02d59b5dc6d3\" (UID: \"5eb00ac0-0ba5-4d30-ac7a-02d59b5dc6d3\") " Mar 16 17:18:32 crc kubenswrapper[5120]: I0316 17:18:32.765828 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5eb00ac0-0ba5-4d30-ac7a-02d59b5dc6d3-config\") pod \"5eb00ac0-0ba5-4d30-ac7a-02d59b5dc6d3\" (UID: \"5eb00ac0-0ba5-4d30-ac7a-02d59b5dc6d3\") " Mar 16 17:18:32 crc kubenswrapper[5120]: I0316 17:18:32.765934 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/5eb00ac0-0ba5-4d30-ac7a-02d59b5dc6d3-dnsmasq-svc\") pod \"5eb00ac0-0ba5-4d30-ac7a-02d59b5dc6d3\" (UID: \"5eb00ac0-0ba5-4d30-ac7a-02d59b5dc6d3\") " Mar 16 17:18:32 crc kubenswrapper[5120]: I0316 17:18:32.766438 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5eb00ac0-0ba5-4d30-ac7a-02d59b5dc6d3-config" (OuterVolumeSpecName: "config") pod "5eb00ac0-0ba5-4d30-ac7a-02d59b5dc6d3" (UID: "5eb00ac0-0ba5-4d30-ac7a-02d59b5dc6d3"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:18:32 crc kubenswrapper[5120]: I0316 17:18:32.766571 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5eb00ac0-0ba5-4d30-ac7a-02d59b5dc6d3-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "5eb00ac0-0ba5-4d30-ac7a-02d59b5dc6d3" (UID: "5eb00ac0-0ba5-4d30-ac7a-02d59b5dc6d3"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:18:32 crc kubenswrapper[5120]: I0316 17:18:32.767102 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5eb00ac0-0ba5-4d30-ac7a-02d59b5dc6d3-config\") on node \"crc\" DevicePath \"\"" Mar 16 17:18:32 crc kubenswrapper[5120]: I0316 17:18:32.767130 5120 reconciler_common.go:299] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/5eb00ac0-0ba5-4d30-ac7a-02d59b5dc6d3-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Mar 16 17:18:32 crc kubenswrapper[5120]: I0316 17:18:32.769043 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-5r7xg"] Mar 16 17:18:32 crc kubenswrapper[5120]: I0316 17:18:32.770073 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5eb00ac0-0ba5-4d30-ac7a-02d59b5dc6d3-kube-api-access-p9vmq" (OuterVolumeSpecName: "kube-api-access-p9vmq") pod "5eb00ac0-0ba5-4d30-ac7a-02d59b5dc6d3" (UID: "5eb00ac0-0ba5-4d30-ac7a-02d59b5dc6d3"). InnerVolumeSpecName "kube-api-access-p9vmq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:18:32 crc kubenswrapper[5120]: I0316 17:18:32.777059 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-5r7xg"] Mar 16 17:18:32 crc kubenswrapper[5120]: I0316 17:18:32.778641 5120 scope.go:117] "RemoveContainer" containerID="0703b4acaf71ddbc1f33326a39f35c524a08ac0a4c5efa84ac95c95a07ef24b8" Mar 16 17:18:32 crc kubenswrapper[5120]: I0316 17:18:32.800983 5120 scope.go:117] "RemoveContainer" containerID="83878088a4253eded0a5f82814cef033d0121f60cdc7867f4769ded7f714e6e1" Mar 16 17:18:32 crc kubenswrapper[5120]: E0316 17:18:32.803339 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"83878088a4253eded0a5f82814cef033d0121f60cdc7867f4769ded7f714e6e1\": container with ID starting with 83878088a4253eded0a5f82814cef033d0121f60cdc7867f4769ded7f714e6e1 not found: ID does not exist" containerID="83878088a4253eded0a5f82814cef033d0121f60cdc7867f4769ded7f714e6e1" Mar 16 17:18:32 crc kubenswrapper[5120]: I0316 17:18:32.803405 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83878088a4253eded0a5f82814cef033d0121f60cdc7867f4769ded7f714e6e1"} err="failed to get container status \"83878088a4253eded0a5f82814cef033d0121f60cdc7867f4769ded7f714e6e1\": rpc error: code = NotFound desc = could not find container \"83878088a4253eded0a5f82814cef033d0121f60cdc7867f4769ded7f714e6e1\": container with ID starting with 83878088a4253eded0a5f82814cef033d0121f60cdc7867f4769ded7f714e6e1 not found: ID does not exist" Mar 16 17:18:32 crc kubenswrapper[5120]: I0316 17:18:32.803434 5120 scope.go:117] "RemoveContainer" containerID="0703b4acaf71ddbc1f33326a39f35c524a08ac0a4c5efa84ac95c95a07ef24b8" Mar 16 17:18:32 crc kubenswrapper[5120]: E0316 17:18:32.804161 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0703b4acaf71ddbc1f33326a39f35c524a08ac0a4c5efa84ac95c95a07ef24b8\": container with ID starting with 0703b4acaf71ddbc1f33326a39f35c524a08ac0a4c5efa84ac95c95a07ef24b8 not found: ID does not exist" containerID="0703b4acaf71ddbc1f33326a39f35c524a08ac0a4c5efa84ac95c95a07ef24b8" Mar 16 17:18:32 crc kubenswrapper[5120]: I0316 17:18:32.804185 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0703b4acaf71ddbc1f33326a39f35c524a08ac0a4c5efa84ac95c95a07ef24b8"} err="failed to get container status \"0703b4acaf71ddbc1f33326a39f35c524a08ac0a4c5efa84ac95c95a07ef24b8\": rpc error: code = NotFound desc = could not find container \"0703b4acaf71ddbc1f33326a39f35c524a08ac0a4c5efa84ac95c95a07ef24b8\": container with ID starting with 0703b4acaf71ddbc1f33326a39f35c524a08ac0a4c5efa84ac95c95a07ef24b8 not found: ID does not exist" Mar 16 17:18:32 crc kubenswrapper[5120]: I0316 17:18:32.868817 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p9vmq\" (UniqueName: \"kubernetes.io/projected/5eb00ac0-0ba5-4d30-ac7a-02d59b5dc6d3-kube-api-access-p9vmq\") on node \"crc\" DevicePath \"\"" Mar 16 17:18:33 crc kubenswrapper[5120]: I0316 17:18:33.082218 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-v9czz"] Mar 16 17:18:33 crc kubenswrapper[5120]: I0316 17:18:33.686937 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openstack-edpm-ipam\" (UniqueName: \"kubernetes.io/configmap/5eb00ac0-0ba5-4d30-ac7a-02d59b5dc6d3-openstack-edpm-ipam\") pod \"dnsmasq-dnsmasq-6b68bc58cc-dj8kn\" (UID: \"5eb00ac0-0ba5-4d30-ac7a-02d59b5dc6d3\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6b68bc58cc-dj8kn" Mar 16 17:18:33 crc kubenswrapper[5120]: E0316 17:18:33.687069 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-edpm-ipam: configmap "openstack-edpm-ipam" not found Mar 16 17:18:33 crc kubenswrapper[5120]: E0316 17:18:33.687329 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5eb00ac0-0ba5-4d30-ac7a-02d59b5dc6d3-openstack-edpm-ipam podName:5eb00ac0-0ba5-4d30-ac7a-02d59b5dc6d3 nodeName:}" failed. No retries permitted until 2026-03-16 17:18:35.687309392 +0000 UTC m=+6417.841241059 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "openstack-edpm-ipam" (UniqueName: "kubernetes.io/configmap/5eb00ac0-0ba5-4d30-ac7a-02d59b5dc6d3-openstack-edpm-ipam") pod "dnsmasq-dnsmasq-6b68bc58cc-dj8kn" (UID: "5eb00ac0-0ba5-4d30-ac7a-02d59b5dc6d3") : configmap "openstack-edpm-ipam" not found Mar 16 17:18:33 crc kubenswrapper[5120]: I0316 17:18:33.730743 5120 generic.go:358] "Generic (PLEG): container finished" podID="813225e2-fc35-4474-8fb3-3d5232b6b983" containerID="21456858d698ae20a1401f0352d079c83dd95e5118f3e1e4dc31f200fb03dee0" exitCode=0 Mar 16 17:18:33 crc kubenswrapper[5120]: I0316 17:18:33.730816 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-v9czz" event={"ID":"813225e2-fc35-4474-8fb3-3d5232b6b983","Type":"ContainerDied","Data":"21456858d698ae20a1401f0352d079c83dd95e5118f3e1e4dc31f200fb03dee0"} Mar 16 17:18:33 crc kubenswrapper[5120]: I0316 17:18:33.730861 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-v9czz" event={"ID":"813225e2-fc35-4474-8fb3-3d5232b6b983","Type":"ContainerStarted","Data":"293c1077fac3dc1bb3c27f7c24304343777e5be58f27e0b7472fd28daeb6b42d"} Mar 16 17:18:33 crc kubenswrapper[5120]: I0316 17:18:33.731008 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6b68bc58cc-dj8kn" Mar 16 17:18:33 crc kubenswrapper[5120]: I0316 17:18:33.818141 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-6b68bc58cc-dj8kn"] Mar 16 17:18:33 crc kubenswrapper[5120]: I0316 17:18:33.826502 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-6b68bc58cc-dj8kn"] Mar 16 17:18:33 crc kubenswrapper[5120]: I0316 17:18:33.900792 5120 reconciler_common.go:299] "Volume detached for volume \"openstack-edpm-ipam\" (UniqueName: \"kubernetes.io/configmap/5eb00ac0-0ba5-4d30-ac7a-02d59b5dc6d3-openstack-edpm-ipam\") on node \"crc\" DevicePath \"\"" Mar 16 17:18:34 crc kubenswrapper[5120]: I0316 17:18:34.663461 5120 scope.go:117] "RemoveContainer" containerID="2ca61165dca6fdb30458423ef74c44c42b1b273e8fa504e89f5f9e186e516cc3" Mar 16 17:18:34 crc kubenswrapper[5120]: E0316 17:18:34.663703 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 17:18:34 crc kubenswrapper[5120]: I0316 17:18:34.673663 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="05faed40-e1aa-44be-bae7-49459da3dc79" path="/var/lib/kubelet/pods/05faed40-e1aa-44be-bae7-49459da3dc79/volumes" Mar 16 17:18:34 crc kubenswrapper[5120]: I0316 17:18:34.674211 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5eb00ac0-0ba5-4d30-ac7a-02d59b5dc6d3" path="/var/lib/kubelet/pods/5eb00ac0-0ba5-4d30-ac7a-02d59b5dc6d3/volumes" Mar 16 17:18:34 crc kubenswrapper[5120]: I0316 17:18:34.745431 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-v9czz" event={"ID":"813225e2-fc35-4474-8fb3-3d5232b6b983","Type":"ContainerStarted","Data":"64b128e00a201a7186f18975d102e9bbc72d32c9d119dee6e1771c140858a42e"} Mar 16 17:18:34 crc kubenswrapper[5120]: I0316 17:18:34.745579 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-v9czz" Mar 16 17:18:34 crc kubenswrapper[5120]: I0316 17:18:34.766068 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-v9czz" podStartSLOduration=2.766047288 podStartE2EDuration="2.766047288s" podCreationTimestamp="2026-03-16 17:18:32 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:18:34.762940723 +0000 UTC m=+6416.916872380" watchObservedRunningTime="2026-03-16 17:18:34.766047288 +0000 UTC m=+6416.919978945" Mar 16 17:18:39 crc kubenswrapper[5120]: I0316 17:18:39.686529 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["crc-storage/crc-storage-crc-rbsxb"] Mar 16 17:18:39 crc kubenswrapper[5120]: I0316 17:18:39.693361 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["crc-storage/crc-storage-crc-rbsxb"] Mar 16 17:18:39 crc kubenswrapper[5120]: I0316 17:18:39.831025 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["crc-storage/crc-storage-crc-grnpf"] Mar 16 17:18:39 crc kubenswrapper[5120]: I0316 17:18:39.835403 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-grnpf" Mar 16 17:18:39 crc kubenswrapper[5120]: I0316 17:18:39.837301 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"crc-storage\"" Mar 16 17:18:39 crc kubenswrapper[5120]: I0316 17:18:39.837610 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"kube-root-ca.crt\"" Mar 16 17:18:39 crc kubenswrapper[5120]: I0316 17:18:39.837923 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"openshift-service-ca.crt\"" Mar 16 17:18:39 crc kubenswrapper[5120]: I0316 17:18:39.838133 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"crc-storage\"/\"crc-storage-dockercfg-s2tht\"" Mar 16 17:18:39 crc kubenswrapper[5120]: I0316 17:18:39.839099 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-grnpf"] Mar 16 17:18:39 crc kubenswrapper[5120]: I0316 17:18:39.929670 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9l4lw\" (UniqueName: \"kubernetes.io/projected/2a3b9174-89d5-4f06-8ef2-27bc850efa54-kube-api-access-9l4lw\") pod \"crc-storage-crc-grnpf\" (UID: \"2a3b9174-89d5-4f06-8ef2-27bc850efa54\") " pod="crc-storage/crc-storage-crc-grnpf" Mar 16 17:18:39 crc kubenswrapper[5120]: I0316 17:18:39.929837 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/2a3b9174-89d5-4f06-8ef2-27bc850efa54-crc-storage\") pod \"crc-storage-crc-grnpf\" (UID: \"2a3b9174-89d5-4f06-8ef2-27bc850efa54\") " pod="crc-storage/crc-storage-crc-grnpf" Mar 16 17:18:39 crc kubenswrapper[5120]: I0316 17:18:39.930122 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/2a3b9174-89d5-4f06-8ef2-27bc850efa54-node-mnt\") pod \"crc-storage-crc-grnpf\" (UID: \"2a3b9174-89d5-4f06-8ef2-27bc850efa54\") " pod="crc-storage/crc-storage-crc-grnpf" Mar 16 17:18:40 crc kubenswrapper[5120]: I0316 17:18:40.032472 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9l4lw\" (UniqueName: \"kubernetes.io/projected/2a3b9174-89d5-4f06-8ef2-27bc850efa54-kube-api-access-9l4lw\") pod \"crc-storage-crc-grnpf\" (UID: \"2a3b9174-89d5-4f06-8ef2-27bc850efa54\") " pod="crc-storage/crc-storage-crc-grnpf" Mar 16 17:18:40 crc kubenswrapper[5120]: I0316 17:18:40.033241 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/2a3b9174-89d5-4f06-8ef2-27bc850efa54-crc-storage\") pod \"crc-storage-crc-grnpf\" (UID: \"2a3b9174-89d5-4f06-8ef2-27bc850efa54\") " pod="crc-storage/crc-storage-crc-grnpf" Mar 16 17:18:40 crc kubenswrapper[5120]: I0316 17:18:40.033494 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/2a3b9174-89d5-4f06-8ef2-27bc850efa54-node-mnt\") pod \"crc-storage-crc-grnpf\" (UID: \"2a3b9174-89d5-4f06-8ef2-27bc850efa54\") " pod="crc-storage/crc-storage-crc-grnpf" Mar 16 17:18:40 crc kubenswrapper[5120]: I0316 17:18:40.034048 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/2a3b9174-89d5-4f06-8ef2-27bc850efa54-node-mnt\") pod \"crc-storage-crc-grnpf\" (UID: \"2a3b9174-89d5-4f06-8ef2-27bc850efa54\") " pod="crc-storage/crc-storage-crc-grnpf" Mar 16 17:18:40 crc kubenswrapper[5120]: I0316 17:18:40.035009 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/2a3b9174-89d5-4f06-8ef2-27bc850efa54-crc-storage\") pod \"crc-storage-crc-grnpf\" (UID: \"2a3b9174-89d5-4f06-8ef2-27bc850efa54\") " pod="crc-storage/crc-storage-crc-grnpf" Mar 16 17:18:40 crc kubenswrapper[5120]: I0316 17:18:40.054625 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9l4lw\" (UniqueName: \"kubernetes.io/projected/2a3b9174-89d5-4f06-8ef2-27bc850efa54-kube-api-access-9l4lw\") pod \"crc-storage-crc-grnpf\" (UID: \"2a3b9174-89d5-4f06-8ef2-27bc850efa54\") " pod="crc-storage/crc-storage-crc-grnpf" Mar 16 17:18:40 crc kubenswrapper[5120]: I0316 17:18:40.154782 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-grnpf" Mar 16 17:18:40 crc kubenswrapper[5120]: I0316 17:18:40.611663 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-grnpf"] Mar 16 17:18:40 crc kubenswrapper[5120]: W0316 17:18:40.624228 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2a3b9174_89d5_4f06_8ef2_27bc850efa54.slice/crio-924576172c3ba64773186a71426f8db321c6ec65c9fc1f5c2f7dda853c6c96ae WatchSource:0}: Error finding container 924576172c3ba64773186a71426f8db321c6ec65c9fc1f5c2f7dda853c6c96ae: Status 404 returned error can't find the container with id 924576172c3ba64773186a71426f8db321c6ec65c9fc1f5c2f7dda853c6c96ae Mar 16 17:18:40 crc kubenswrapper[5120]: I0316 17:18:40.673784 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec357416-19c3-4a61-9bf3-1a122932a3d7" path="/var/lib/kubelet/pods/ec357416-19c3-4a61-9bf3-1a122932a3d7/volumes" Mar 16 17:18:40 crc kubenswrapper[5120]: I0316 17:18:40.757048 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-v9czz" Mar 16 17:18:40 crc kubenswrapper[5120]: I0316 17:18:40.807369 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-grnpf" event={"ID":"2a3b9174-89d5-4f06-8ef2-27bc850efa54","Type":"ContainerStarted","Data":"924576172c3ba64773186a71426f8db321c6ec65c9fc1f5c2f7dda853c6c96ae"} Mar 16 17:18:40 crc kubenswrapper[5120]: I0316 17:18:40.817842 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-68cbfccb49-cvdsc"] Mar 16 17:18:40 crc kubenswrapper[5120]: I0316 17:18:40.818105 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-68cbfccb49-cvdsc" podUID="430f9063-d353-4310-b760-cd90e5a1d6b7" containerName="dnsmasq-dns" containerID="cri-o://548f160d841bf3cd298aea9361893a5c9d953e7985b5b7177258aef709ad6bb0" gracePeriod=10 Mar 16 17:18:41 crc kubenswrapper[5120]: I0316 17:18:41.250701 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-68cbfccb49-cvdsc" Mar 16 17:18:41 crc kubenswrapper[5120]: I0316 17:18:41.363829 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2zsw4\" (UniqueName: \"kubernetes.io/projected/430f9063-d353-4310-b760-cd90e5a1d6b7-kube-api-access-2zsw4\") pod \"430f9063-d353-4310-b760-cd90e5a1d6b7\" (UID: \"430f9063-d353-4310-b760-cd90e5a1d6b7\") " Mar 16 17:18:41 crc kubenswrapper[5120]: I0316 17:18:41.364085 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/430f9063-d353-4310-b760-cd90e5a1d6b7-config\") pod \"430f9063-d353-4310-b760-cd90e5a1d6b7\" (UID: \"430f9063-d353-4310-b760-cd90e5a1d6b7\") " Mar 16 17:18:41 crc kubenswrapper[5120]: I0316 17:18:41.364146 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"openstack-edpm-ipam\" (UniqueName: \"kubernetes.io/configmap/430f9063-d353-4310-b760-cd90e5a1d6b7-openstack-edpm-ipam\") pod \"430f9063-d353-4310-b760-cd90e5a1d6b7\" (UID: \"430f9063-d353-4310-b760-cd90e5a1d6b7\") " Mar 16 17:18:41 crc kubenswrapper[5120]: I0316 17:18:41.364217 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/430f9063-d353-4310-b760-cd90e5a1d6b7-dnsmasq-svc\") pod \"430f9063-d353-4310-b760-cd90e5a1d6b7\" (UID: \"430f9063-d353-4310-b760-cd90e5a1d6b7\") " Mar 16 17:18:41 crc kubenswrapper[5120]: I0316 17:18:41.368271 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/430f9063-d353-4310-b760-cd90e5a1d6b7-kube-api-access-2zsw4" (OuterVolumeSpecName: "kube-api-access-2zsw4") pod "430f9063-d353-4310-b760-cd90e5a1d6b7" (UID: "430f9063-d353-4310-b760-cd90e5a1d6b7"). InnerVolumeSpecName "kube-api-access-2zsw4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:18:41 crc kubenswrapper[5120]: I0316 17:18:41.399100 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/430f9063-d353-4310-b760-cd90e5a1d6b7-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "430f9063-d353-4310-b760-cd90e5a1d6b7" (UID: "430f9063-d353-4310-b760-cd90e5a1d6b7"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:18:41 crc kubenswrapper[5120]: I0316 17:18:41.398705 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/430f9063-d353-4310-b760-cd90e5a1d6b7-config" (OuterVolumeSpecName: "config") pod "430f9063-d353-4310-b760-cd90e5a1d6b7" (UID: "430f9063-d353-4310-b760-cd90e5a1d6b7"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:18:41 crc kubenswrapper[5120]: I0316 17:18:41.404141 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/430f9063-d353-4310-b760-cd90e5a1d6b7-openstack-edpm-ipam" (OuterVolumeSpecName: "openstack-edpm-ipam") pod "430f9063-d353-4310-b760-cd90e5a1d6b7" (UID: "430f9063-d353-4310-b760-cd90e5a1d6b7"). InnerVolumeSpecName "openstack-edpm-ipam". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:18:41 crc kubenswrapper[5120]: I0316 17:18:41.467311 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2zsw4\" (UniqueName: \"kubernetes.io/projected/430f9063-d353-4310-b760-cd90e5a1d6b7-kube-api-access-2zsw4\") on node \"crc\" DevicePath \"\"" Mar 16 17:18:41 crc kubenswrapper[5120]: I0316 17:18:41.467345 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/430f9063-d353-4310-b760-cd90e5a1d6b7-config\") on node \"crc\" DevicePath \"\"" Mar 16 17:18:41 crc kubenswrapper[5120]: I0316 17:18:41.467354 5120 reconciler_common.go:299] "Volume detached for volume \"openstack-edpm-ipam\" (UniqueName: \"kubernetes.io/configmap/430f9063-d353-4310-b760-cd90e5a1d6b7-openstack-edpm-ipam\") on node \"crc\" DevicePath \"\"" Mar 16 17:18:41 crc kubenswrapper[5120]: I0316 17:18:41.467366 5120 reconciler_common.go:299] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/430f9063-d353-4310-b760-cd90e5a1d6b7-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Mar 16 17:18:41 crc kubenswrapper[5120]: I0316 17:18:41.818655 5120 generic.go:358] "Generic (PLEG): container finished" podID="430f9063-d353-4310-b760-cd90e5a1d6b7" containerID="548f160d841bf3cd298aea9361893a5c9d953e7985b5b7177258aef709ad6bb0" exitCode=0 Mar 16 17:18:41 crc kubenswrapper[5120]: I0316 17:18:41.818701 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-68cbfccb49-cvdsc" event={"ID":"430f9063-d353-4310-b760-cd90e5a1d6b7","Type":"ContainerDied","Data":"548f160d841bf3cd298aea9361893a5c9d953e7985b5b7177258aef709ad6bb0"} Mar 16 17:18:41 crc kubenswrapper[5120]: I0316 17:18:41.818745 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-68cbfccb49-cvdsc" event={"ID":"430f9063-d353-4310-b760-cd90e5a1d6b7","Type":"ContainerDied","Data":"2d064efbc9107fbd44868443a77beb723ae92aa57dca14319d9a58577a3c3c3f"} Mar 16 17:18:41 crc kubenswrapper[5120]: I0316 17:18:41.818779 5120 scope.go:117] "RemoveContainer" containerID="548f160d841bf3cd298aea9361893a5c9d953e7985b5b7177258aef709ad6bb0" Mar 16 17:18:41 crc kubenswrapper[5120]: I0316 17:18:41.818665 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-68cbfccb49-cvdsc" Mar 16 17:18:41 crc kubenswrapper[5120]: I0316 17:18:41.821678 5120 generic.go:358] "Generic (PLEG): container finished" podID="2a3b9174-89d5-4f06-8ef2-27bc850efa54" containerID="573b2ed01d63aeb033c6967418e782b072d2d3d4f5bd773a11c79d86a5808c25" exitCode=0 Mar 16 17:18:41 crc kubenswrapper[5120]: I0316 17:18:41.821845 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-grnpf" event={"ID":"2a3b9174-89d5-4f06-8ef2-27bc850efa54","Type":"ContainerDied","Data":"573b2ed01d63aeb033c6967418e782b072d2d3d4f5bd773a11c79d86a5808c25"} Mar 16 17:18:41 crc kubenswrapper[5120]: I0316 17:18:41.860917 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-68cbfccb49-cvdsc"] Mar 16 17:18:41 crc kubenswrapper[5120]: I0316 17:18:41.864121 5120 scope.go:117] "RemoveContainer" containerID="0d1ca4fde3b70ea4b71212d2689b5d860daffd0fc3cdd2093ed84747a20362db" Mar 16 17:18:41 crc kubenswrapper[5120]: I0316 17:18:41.867401 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-68cbfccb49-cvdsc"] Mar 16 17:18:41 crc kubenswrapper[5120]: I0316 17:18:41.896041 5120 scope.go:117] "RemoveContainer" containerID="548f160d841bf3cd298aea9361893a5c9d953e7985b5b7177258aef709ad6bb0" Mar 16 17:18:41 crc kubenswrapper[5120]: E0316 17:18:41.896627 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"548f160d841bf3cd298aea9361893a5c9d953e7985b5b7177258aef709ad6bb0\": container with ID starting with 548f160d841bf3cd298aea9361893a5c9d953e7985b5b7177258aef709ad6bb0 not found: ID does not exist" containerID="548f160d841bf3cd298aea9361893a5c9d953e7985b5b7177258aef709ad6bb0" Mar 16 17:18:41 crc kubenswrapper[5120]: I0316 17:18:41.896680 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"548f160d841bf3cd298aea9361893a5c9d953e7985b5b7177258aef709ad6bb0"} err="failed to get container status \"548f160d841bf3cd298aea9361893a5c9d953e7985b5b7177258aef709ad6bb0\": rpc error: code = NotFound desc = could not find container \"548f160d841bf3cd298aea9361893a5c9d953e7985b5b7177258aef709ad6bb0\": container with ID starting with 548f160d841bf3cd298aea9361893a5c9d953e7985b5b7177258aef709ad6bb0 not found: ID does not exist" Mar 16 17:18:41 crc kubenswrapper[5120]: I0316 17:18:41.896711 5120 scope.go:117] "RemoveContainer" containerID="0d1ca4fde3b70ea4b71212d2689b5d860daffd0fc3cdd2093ed84747a20362db" Mar 16 17:18:41 crc kubenswrapper[5120]: E0316 17:18:41.897140 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d1ca4fde3b70ea4b71212d2689b5d860daffd0fc3cdd2093ed84747a20362db\": container with ID starting with 0d1ca4fde3b70ea4b71212d2689b5d860daffd0fc3cdd2093ed84747a20362db not found: ID does not exist" containerID="0d1ca4fde3b70ea4b71212d2689b5d860daffd0fc3cdd2093ed84747a20362db" Mar 16 17:18:41 crc kubenswrapper[5120]: I0316 17:18:41.897191 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d1ca4fde3b70ea4b71212d2689b5d860daffd0fc3cdd2093ed84747a20362db"} err="failed to get container status \"0d1ca4fde3b70ea4b71212d2689b5d860daffd0fc3cdd2093ed84747a20362db\": rpc error: code = NotFound desc = could not find container \"0d1ca4fde3b70ea4b71212d2689b5d860daffd0fc3cdd2093ed84747a20362db\": container with ID starting with 0d1ca4fde3b70ea4b71212d2689b5d860daffd0fc3cdd2093ed84747a20362db not found: ID does not exist" Mar 16 17:18:42 crc kubenswrapper[5120]: I0316 17:18:42.674577 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="430f9063-d353-4310-b760-cd90e5a1d6b7" path="/var/lib/kubelet/pods/430f9063-d353-4310-b760-cd90e5a1d6b7/volumes" Mar 16 17:18:43 crc kubenswrapper[5120]: I0316 17:18:43.112197 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-grnpf" Mar 16 17:18:43 crc kubenswrapper[5120]: I0316 17:18:43.202483 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/2a3b9174-89d5-4f06-8ef2-27bc850efa54-node-mnt\") pod \"2a3b9174-89d5-4f06-8ef2-27bc850efa54\" (UID: \"2a3b9174-89d5-4f06-8ef2-27bc850efa54\") " Mar 16 17:18:43 crc kubenswrapper[5120]: I0316 17:18:43.202543 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9l4lw\" (UniqueName: \"kubernetes.io/projected/2a3b9174-89d5-4f06-8ef2-27bc850efa54-kube-api-access-9l4lw\") pod \"2a3b9174-89d5-4f06-8ef2-27bc850efa54\" (UID: \"2a3b9174-89d5-4f06-8ef2-27bc850efa54\") " Mar 16 17:18:43 crc kubenswrapper[5120]: I0316 17:18:43.202591 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/2a3b9174-89d5-4f06-8ef2-27bc850efa54-crc-storage\") pod \"2a3b9174-89d5-4f06-8ef2-27bc850efa54\" (UID: \"2a3b9174-89d5-4f06-8ef2-27bc850efa54\") " Mar 16 17:18:43 crc kubenswrapper[5120]: I0316 17:18:43.202603 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/2a3b9174-89d5-4f06-8ef2-27bc850efa54-node-mnt" (OuterVolumeSpecName: "node-mnt") pod "2a3b9174-89d5-4f06-8ef2-27bc850efa54" (UID: "2a3b9174-89d5-4f06-8ef2-27bc850efa54"). InnerVolumeSpecName "node-mnt". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 17:18:43 crc kubenswrapper[5120]: I0316 17:18:43.203851 5120 reconciler_common.go:299] "Volume detached for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/2a3b9174-89d5-4f06-8ef2-27bc850efa54-node-mnt\") on node \"crc\" DevicePath \"\"" Mar 16 17:18:43 crc kubenswrapper[5120]: I0316 17:18:43.208514 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a3b9174-89d5-4f06-8ef2-27bc850efa54-kube-api-access-9l4lw" (OuterVolumeSpecName: "kube-api-access-9l4lw") pod "2a3b9174-89d5-4f06-8ef2-27bc850efa54" (UID: "2a3b9174-89d5-4f06-8ef2-27bc850efa54"). InnerVolumeSpecName "kube-api-access-9l4lw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:18:43 crc kubenswrapper[5120]: I0316 17:18:43.229429 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2a3b9174-89d5-4f06-8ef2-27bc850efa54-crc-storage" (OuterVolumeSpecName: "crc-storage") pod "2a3b9174-89d5-4f06-8ef2-27bc850efa54" (UID: "2a3b9174-89d5-4f06-8ef2-27bc850efa54"). InnerVolumeSpecName "crc-storage". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:18:43 crc kubenswrapper[5120]: I0316 17:18:43.306191 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9l4lw\" (UniqueName: \"kubernetes.io/projected/2a3b9174-89d5-4f06-8ef2-27bc850efa54-kube-api-access-9l4lw\") on node \"crc\" DevicePath \"\"" Mar 16 17:18:43 crc kubenswrapper[5120]: I0316 17:18:43.306488 5120 reconciler_common.go:299] "Volume detached for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/2a3b9174-89d5-4f06-8ef2-27bc850efa54-crc-storage\") on node \"crc\" DevicePath \"\"" Mar 16 17:18:43 crc kubenswrapper[5120]: I0316 17:18:43.844683 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-grnpf" Mar 16 17:18:43 crc kubenswrapper[5120]: I0316 17:18:43.844770 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-grnpf" event={"ID":"2a3b9174-89d5-4f06-8ef2-27bc850efa54","Type":"ContainerDied","Data":"924576172c3ba64773186a71426f8db321c6ec65c9fc1f5c2f7dda853c6c96ae"} Mar 16 17:18:43 crc kubenswrapper[5120]: I0316 17:18:43.844848 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="924576172c3ba64773186a71426f8db321c6ec65c9fc1f5c2f7dda853c6c96ae" Mar 16 17:18:46 crc kubenswrapper[5120]: I0316 17:18:46.371334 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["crc-storage/crc-storage-crc-grnpf"] Mar 16 17:18:46 crc kubenswrapper[5120]: I0316 17:18:46.377156 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["crc-storage/crc-storage-crc-grnpf"] Mar 16 17:18:46 crc kubenswrapper[5120]: I0316 17:18:46.488158 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["crc-storage/crc-storage-crc-7756s"] Mar 16 17:18:46 crc kubenswrapper[5120]: I0316 17:18:46.489052 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="430f9063-d353-4310-b760-cd90e5a1d6b7" containerName="init" Mar 16 17:18:46 crc kubenswrapper[5120]: I0316 17:18:46.489072 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="430f9063-d353-4310-b760-cd90e5a1d6b7" containerName="init" Mar 16 17:18:46 crc kubenswrapper[5120]: I0316 17:18:46.489085 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a3b9174-89d5-4f06-8ef2-27bc850efa54" containerName="storage" Mar 16 17:18:46 crc kubenswrapper[5120]: I0316 17:18:46.489091 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a3b9174-89d5-4f06-8ef2-27bc850efa54" containerName="storage" Mar 16 17:18:46 crc kubenswrapper[5120]: I0316 17:18:46.489106 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="430f9063-d353-4310-b760-cd90e5a1d6b7" containerName="dnsmasq-dns" Mar 16 17:18:46 crc kubenswrapper[5120]: I0316 17:18:46.489111 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="430f9063-d353-4310-b760-cd90e5a1d6b7" containerName="dnsmasq-dns" Mar 16 17:18:46 crc kubenswrapper[5120]: I0316 17:18:46.489258 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="430f9063-d353-4310-b760-cd90e5a1d6b7" containerName="dnsmasq-dns" Mar 16 17:18:46 crc kubenswrapper[5120]: I0316 17:18:46.489271 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="2a3b9174-89d5-4f06-8ef2-27bc850efa54" containerName="storage" Mar 16 17:18:46 crc kubenswrapper[5120]: I0316 17:18:46.493568 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-7756s" Mar 16 17:18:46 crc kubenswrapper[5120]: I0316 17:18:46.495964 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"crc-storage\"" Mar 16 17:18:46 crc kubenswrapper[5120]: I0316 17:18:46.496968 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"openshift-service-ca.crt\"" Mar 16 17:18:46 crc kubenswrapper[5120]: I0316 17:18:46.497292 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"crc-storage\"/\"crc-storage-dockercfg-s2tht\"" Mar 16 17:18:46 crc kubenswrapper[5120]: I0316 17:18:46.497388 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"kube-root-ca.crt\"" Mar 16 17:18:46 crc kubenswrapper[5120]: I0316 17:18:46.497836 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-7756s"] Mar 16 17:18:46 crc kubenswrapper[5120]: I0316 17:18:46.578043 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/7b4ef419-2944-418b-9d08-306c8f39f7a7-node-mnt\") pod \"crc-storage-crc-7756s\" (UID: \"7b4ef419-2944-418b-9d08-306c8f39f7a7\") " pod="crc-storage/crc-storage-crc-7756s" Mar 16 17:18:46 crc kubenswrapper[5120]: I0316 17:18:46.578100 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4mjn\" (UniqueName: \"kubernetes.io/projected/7b4ef419-2944-418b-9d08-306c8f39f7a7-kube-api-access-c4mjn\") pod \"crc-storage-crc-7756s\" (UID: \"7b4ef419-2944-418b-9d08-306c8f39f7a7\") " pod="crc-storage/crc-storage-crc-7756s" Mar 16 17:18:46 crc kubenswrapper[5120]: I0316 17:18:46.578622 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/7b4ef419-2944-418b-9d08-306c8f39f7a7-crc-storage\") pod \"crc-storage-crc-7756s\" (UID: \"7b4ef419-2944-418b-9d08-306c8f39f7a7\") " pod="crc-storage/crc-storage-crc-7756s" Mar 16 17:18:46 crc kubenswrapper[5120]: I0316 17:18:46.675309 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2a3b9174-89d5-4f06-8ef2-27bc850efa54" path="/var/lib/kubelet/pods/2a3b9174-89d5-4f06-8ef2-27bc850efa54/volumes" Mar 16 17:18:46 crc kubenswrapper[5120]: I0316 17:18:46.680838 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/7b4ef419-2944-418b-9d08-306c8f39f7a7-crc-storage\") pod \"crc-storage-crc-7756s\" (UID: \"7b4ef419-2944-418b-9d08-306c8f39f7a7\") " pod="crc-storage/crc-storage-crc-7756s" Mar 16 17:18:46 crc kubenswrapper[5120]: I0316 17:18:46.680926 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/7b4ef419-2944-418b-9d08-306c8f39f7a7-node-mnt\") pod \"crc-storage-crc-7756s\" (UID: \"7b4ef419-2944-418b-9d08-306c8f39f7a7\") " pod="crc-storage/crc-storage-crc-7756s" Mar 16 17:18:46 crc kubenswrapper[5120]: I0316 17:18:46.680955 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c4mjn\" (UniqueName: \"kubernetes.io/projected/7b4ef419-2944-418b-9d08-306c8f39f7a7-kube-api-access-c4mjn\") pod \"crc-storage-crc-7756s\" (UID: \"7b4ef419-2944-418b-9d08-306c8f39f7a7\") " pod="crc-storage/crc-storage-crc-7756s" Mar 16 17:18:46 crc kubenswrapper[5120]: I0316 17:18:46.681289 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/7b4ef419-2944-418b-9d08-306c8f39f7a7-node-mnt\") pod \"crc-storage-crc-7756s\" (UID: \"7b4ef419-2944-418b-9d08-306c8f39f7a7\") " pod="crc-storage/crc-storage-crc-7756s" Mar 16 17:18:46 crc kubenswrapper[5120]: I0316 17:18:46.683232 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/7b4ef419-2944-418b-9d08-306c8f39f7a7-crc-storage\") pod \"crc-storage-crc-7756s\" (UID: \"7b4ef419-2944-418b-9d08-306c8f39f7a7\") " pod="crc-storage/crc-storage-crc-7756s" Mar 16 17:18:46 crc kubenswrapper[5120]: I0316 17:18:46.704673 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4mjn\" (UniqueName: \"kubernetes.io/projected/7b4ef419-2944-418b-9d08-306c8f39f7a7-kube-api-access-c4mjn\") pod \"crc-storage-crc-7756s\" (UID: \"7b4ef419-2944-418b-9d08-306c8f39f7a7\") " pod="crc-storage/crc-storage-crc-7756s" Mar 16 17:18:46 crc kubenswrapper[5120]: I0316 17:18:46.809970 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-7756s" Mar 16 17:18:47 crc kubenswrapper[5120]: I0316 17:18:47.222282 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-7756s"] Mar 16 17:18:47 crc kubenswrapper[5120]: I0316 17:18:47.879047 5120 generic.go:358] "Generic (PLEG): container finished" podID="7b4ef419-2944-418b-9d08-306c8f39f7a7" containerID="56c208ca7047dd7530b048f2e52514c22d2f99fb699ca5ce4124f7baeed7d274" exitCode=0 Mar 16 17:18:47 crc kubenswrapper[5120]: I0316 17:18:47.879126 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-7756s" event={"ID":"7b4ef419-2944-418b-9d08-306c8f39f7a7","Type":"ContainerDied","Data":"56c208ca7047dd7530b048f2e52514c22d2f99fb699ca5ce4124f7baeed7d274"} Mar 16 17:18:47 crc kubenswrapper[5120]: I0316 17:18:47.879400 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-7756s" event={"ID":"7b4ef419-2944-418b-9d08-306c8f39f7a7","Type":"ContainerStarted","Data":"d4c67ec695b55c807bb0c1282b2d2180f5f78262fc83e17208def5cea4cf9651"} Mar 16 17:18:48 crc kubenswrapper[5120]: I0316 17:18:48.673172 5120 scope.go:117] "RemoveContainer" containerID="2ca61165dca6fdb30458423ef74c44c42b1b273e8fa504e89f5f9e186e516cc3" Mar 16 17:18:48 crc kubenswrapper[5120]: E0316 17:18:48.674000 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 17:18:49 crc kubenswrapper[5120]: I0316 17:18:49.279633 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-7756s" Mar 16 17:18:49 crc kubenswrapper[5120]: I0316 17:18:49.338833 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c4mjn\" (UniqueName: \"kubernetes.io/projected/7b4ef419-2944-418b-9d08-306c8f39f7a7-kube-api-access-c4mjn\") pod \"7b4ef419-2944-418b-9d08-306c8f39f7a7\" (UID: \"7b4ef419-2944-418b-9d08-306c8f39f7a7\") " Mar 16 17:18:49 crc kubenswrapper[5120]: I0316 17:18:49.338983 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/7b4ef419-2944-418b-9d08-306c8f39f7a7-crc-storage\") pod \"7b4ef419-2944-418b-9d08-306c8f39f7a7\" (UID: \"7b4ef419-2944-418b-9d08-306c8f39f7a7\") " Mar 16 17:18:49 crc kubenswrapper[5120]: I0316 17:18:49.339325 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/7b4ef419-2944-418b-9d08-306c8f39f7a7-node-mnt\") pod \"7b4ef419-2944-418b-9d08-306c8f39f7a7\" (UID: \"7b4ef419-2944-418b-9d08-306c8f39f7a7\") " Mar 16 17:18:49 crc kubenswrapper[5120]: I0316 17:18:49.339504 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/7b4ef419-2944-418b-9d08-306c8f39f7a7-node-mnt" (OuterVolumeSpecName: "node-mnt") pod "7b4ef419-2944-418b-9d08-306c8f39f7a7" (UID: "7b4ef419-2944-418b-9d08-306c8f39f7a7"). InnerVolumeSpecName "node-mnt". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 17:18:49 crc kubenswrapper[5120]: I0316 17:18:49.340136 5120 reconciler_common.go:299] "Volume detached for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/7b4ef419-2944-418b-9d08-306c8f39f7a7-node-mnt\") on node \"crc\" DevicePath \"\"" Mar 16 17:18:49 crc kubenswrapper[5120]: I0316 17:18:49.347215 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b4ef419-2944-418b-9d08-306c8f39f7a7-kube-api-access-c4mjn" (OuterVolumeSpecName: "kube-api-access-c4mjn") pod "7b4ef419-2944-418b-9d08-306c8f39f7a7" (UID: "7b4ef419-2944-418b-9d08-306c8f39f7a7"). InnerVolumeSpecName "kube-api-access-c4mjn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:18:49 crc kubenswrapper[5120]: I0316 17:18:49.364657 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7b4ef419-2944-418b-9d08-306c8f39f7a7-crc-storage" (OuterVolumeSpecName: "crc-storage") pod "7b4ef419-2944-418b-9d08-306c8f39f7a7" (UID: "7b4ef419-2944-418b-9d08-306c8f39f7a7"). InnerVolumeSpecName "crc-storage". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:18:49 crc kubenswrapper[5120]: I0316 17:18:49.442428 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c4mjn\" (UniqueName: \"kubernetes.io/projected/7b4ef419-2944-418b-9d08-306c8f39f7a7-kube-api-access-c4mjn\") on node \"crc\" DevicePath \"\"" Mar 16 17:18:49 crc kubenswrapper[5120]: I0316 17:18:49.442460 5120 reconciler_common.go:299] "Volume detached for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/7b4ef419-2944-418b-9d08-306c8f39f7a7-crc-storage\") on node \"crc\" DevicePath \"\"" Mar 16 17:18:49 crc kubenswrapper[5120]: I0316 17:18:49.901634 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-7756s" Mar 16 17:18:49 crc kubenswrapper[5120]: I0316 17:18:49.901684 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-7756s" event={"ID":"7b4ef419-2944-418b-9d08-306c8f39f7a7","Type":"ContainerDied","Data":"d4c67ec695b55c807bb0c1282b2d2180f5f78262fc83e17208def5cea4cf9651"} Mar 16 17:18:49 crc kubenswrapper[5120]: I0316 17:18:49.901722 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d4c67ec695b55c807bb0c1282b2d2180f5f78262fc83e17208def5cea4cf9651" Mar 16 17:18:52 crc kubenswrapper[5120]: I0316 17:18:52.491597 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-67bb796bf-hrqrl"] Mar 16 17:18:52 crc kubenswrapper[5120]: I0316 17:18:52.492791 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b4ef419-2944-418b-9d08-306c8f39f7a7" containerName="storage" Mar 16 17:18:52 crc kubenswrapper[5120]: I0316 17:18:52.492803 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b4ef419-2944-418b-9d08-306c8f39f7a7" containerName="storage" Mar 16 17:18:52 crc kubenswrapper[5120]: I0316 17:18:52.492935 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7b4ef419-2944-418b-9d08-306c8f39f7a7" containerName="storage" Mar 16 17:18:52 crc kubenswrapper[5120]: I0316 17:18:52.509955 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-67bb796bf-hrqrl" Mar 16 17:18:52 crc kubenswrapper[5120]: I0316 17:18:52.512434 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"edpm-compute-global\"" Mar 16 17:18:52 crc kubenswrapper[5120]: I0316 17:18:52.515240 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-67bb796bf-hrqrl"] Mar 16 17:18:52 crc kubenswrapper[5120]: I0316 17:18:52.608862 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/fce8c087-0b1c-428f-bdff-734cba235234-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-67bb796bf-hrqrl\" (UID: \"fce8c087-0b1c-428f-bdff-734cba235234\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-67bb796bf-hrqrl" Mar 16 17:18:52 crc kubenswrapper[5120]: I0316 17:18:52.609084 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zlppd\" (UniqueName: \"kubernetes.io/projected/fce8c087-0b1c-428f-bdff-734cba235234-kube-api-access-zlppd\") pod \"dnsmasq-dnsmasq-67bb796bf-hrqrl\" (UID: \"fce8c087-0b1c-428f-bdff-734cba235234\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-67bb796bf-hrqrl" Mar 16 17:18:52 crc kubenswrapper[5120]: I0316 17:18:52.609170 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fce8c087-0b1c-428f-bdff-734cba235234-config\") pod \"dnsmasq-dnsmasq-67bb796bf-hrqrl\" (UID: \"fce8c087-0b1c-428f-bdff-734cba235234\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-67bb796bf-hrqrl" Mar 16 17:18:52 crc kubenswrapper[5120]: I0316 17:18:52.609246 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"edpm-compute-global\" (UniqueName: \"kubernetes.io/configmap/fce8c087-0b1c-428f-bdff-734cba235234-edpm-compute-global\") pod \"dnsmasq-dnsmasq-67bb796bf-hrqrl\" (UID: \"fce8c087-0b1c-428f-bdff-734cba235234\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-67bb796bf-hrqrl" Mar 16 17:18:52 crc kubenswrapper[5120]: I0316 17:18:52.711545 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"edpm-compute-global\" (UniqueName: \"kubernetes.io/configmap/fce8c087-0b1c-428f-bdff-734cba235234-edpm-compute-global\") pod \"dnsmasq-dnsmasq-67bb796bf-hrqrl\" (UID: \"fce8c087-0b1c-428f-bdff-734cba235234\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-67bb796bf-hrqrl" Mar 16 17:18:52 crc kubenswrapper[5120]: I0316 17:18:52.712255 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/fce8c087-0b1c-428f-bdff-734cba235234-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-67bb796bf-hrqrl\" (UID: \"fce8c087-0b1c-428f-bdff-734cba235234\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-67bb796bf-hrqrl" Mar 16 17:18:52 crc kubenswrapper[5120]: I0316 17:18:52.712626 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zlppd\" (UniqueName: \"kubernetes.io/projected/fce8c087-0b1c-428f-bdff-734cba235234-kube-api-access-zlppd\") pod \"dnsmasq-dnsmasq-67bb796bf-hrqrl\" (UID: \"fce8c087-0b1c-428f-bdff-734cba235234\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-67bb796bf-hrqrl" Mar 16 17:18:52 crc kubenswrapper[5120]: I0316 17:18:52.712724 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fce8c087-0b1c-428f-bdff-734cba235234-config\") pod \"dnsmasq-dnsmasq-67bb796bf-hrqrl\" (UID: \"fce8c087-0b1c-428f-bdff-734cba235234\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-67bb796bf-hrqrl" Mar 16 17:18:52 crc kubenswrapper[5120]: I0316 17:18:52.712875 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"edpm-compute-global\" (UniqueName: \"kubernetes.io/configmap/fce8c087-0b1c-428f-bdff-734cba235234-edpm-compute-global\") pod \"dnsmasq-dnsmasq-67bb796bf-hrqrl\" (UID: \"fce8c087-0b1c-428f-bdff-734cba235234\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-67bb796bf-hrqrl" Mar 16 17:18:52 crc kubenswrapper[5120]: I0316 17:18:52.713339 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fce8c087-0b1c-428f-bdff-734cba235234-config\") pod \"dnsmasq-dnsmasq-67bb796bf-hrqrl\" (UID: \"fce8c087-0b1c-428f-bdff-734cba235234\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-67bb796bf-hrqrl" Mar 16 17:18:52 crc kubenswrapper[5120]: I0316 17:18:52.713463 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/fce8c087-0b1c-428f-bdff-734cba235234-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-67bb796bf-hrqrl\" (UID: \"fce8c087-0b1c-428f-bdff-734cba235234\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-67bb796bf-hrqrl" Mar 16 17:18:52 crc kubenswrapper[5120]: I0316 17:18:52.735207 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zlppd\" (UniqueName: \"kubernetes.io/projected/fce8c087-0b1c-428f-bdff-734cba235234-kube-api-access-zlppd\") pod \"dnsmasq-dnsmasq-67bb796bf-hrqrl\" (UID: \"fce8c087-0b1c-428f-bdff-734cba235234\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-67bb796bf-hrqrl" Mar 16 17:18:52 crc kubenswrapper[5120]: I0316 17:18:52.835601 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-67bb796bf-hrqrl" Mar 16 17:18:53 crc kubenswrapper[5120]: I0316 17:18:53.248217 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-67bb796bf-hrqrl"] Mar 16 17:18:53 crc kubenswrapper[5120]: I0316 17:18:53.938341 5120 generic.go:358] "Generic (PLEG): container finished" podID="fce8c087-0b1c-428f-bdff-734cba235234" containerID="545bba89e45b5c1f8b8407921abfaf73289949049fba4d94a339e7aa18067b40" exitCode=0 Mar 16 17:18:53 crc kubenswrapper[5120]: I0316 17:18:53.938594 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-67bb796bf-hrqrl" event={"ID":"fce8c087-0b1c-428f-bdff-734cba235234","Type":"ContainerDied","Data":"545bba89e45b5c1f8b8407921abfaf73289949049fba4d94a339e7aa18067b40"} Mar 16 17:18:53 crc kubenswrapper[5120]: I0316 17:18:53.938652 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-67bb796bf-hrqrl" event={"ID":"fce8c087-0b1c-428f-bdff-734cba235234","Type":"ContainerStarted","Data":"049bcac2edecaf55867fc688415323b334f95fc5267a2f54db6821cee44bc505"} Mar 16 17:18:54 crc kubenswrapper[5120]: I0316 17:18:54.948971 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-67bb796bf-hrqrl" event={"ID":"fce8c087-0b1c-428f-bdff-734cba235234","Type":"ContainerStarted","Data":"77fb7bd4d2cc43955f1e96bce491366263d9057ecdb373f532f67c9047e93ab8"} Mar 16 17:18:54 crc kubenswrapper[5120]: I0316 17:18:54.949329 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-67bb796bf-hrqrl" Mar 16 17:18:54 crc kubenswrapper[5120]: I0316 17:18:54.977254 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-67bb796bf-hrqrl" podStartSLOduration=2.977235013 podStartE2EDuration="2.977235013s" podCreationTimestamp="2026-03-16 17:18:52 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:18:54.971929518 +0000 UTC m=+6437.125861185" watchObservedRunningTime="2026-03-16 17:18:54.977235013 +0000 UTC m=+6437.131166670" Mar 16 17:19:00 crc kubenswrapper[5120]: I0316 17:19:00.958061 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-67bb796bf-hrqrl" Mar 16 17:19:01 crc kubenswrapper[5120]: I0316 17:19:01.031362 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-v9czz"] Mar 16 17:19:01 crc kubenswrapper[5120]: I0316 17:19:01.031698 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-v9czz" podUID="813225e2-fc35-4474-8fb3-3d5232b6b983" containerName="dnsmasq-dns" containerID="cri-o://64b128e00a201a7186f18975d102e9bbc72d32c9d119dee6e1771c140858a42e" gracePeriod=10 Mar 16 17:19:01 crc kubenswrapper[5120]: I0316 17:19:01.420372 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-v9czz" Mar 16 17:19:01 crc kubenswrapper[5120]: I0316 17:19:01.488019 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/download-cache-edpm-compute-global-edpm-compute-global-4z24m"] Mar 16 17:19:01 crc kubenswrapper[5120]: I0316 17:19:01.488901 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="813225e2-fc35-4474-8fb3-3d5232b6b983" containerName="dnsmasq-dns" Mar 16 17:19:01 crc kubenswrapper[5120]: I0316 17:19:01.488925 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="813225e2-fc35-4474-8fb3-3d5232b6b983" containerName="dnsmasq-dns" Mar 16 17:19:01 crc kubenswrapper[5120]: I0316 17:19:01.488935 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="813225e2-fc35-4474-8fb3-3d5232b6b983" containerName="init" Mar 16 17:19:01 crc kubenswrapper[5120]: I0316 17:19:01.488942 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="813225e2-fc35-4474-8fb3-3d5232b6b983" containerName="init" Mar 16 17:19:01 crc kubenswrapper[5120]: I0316 17:19:01.489117 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="813225e2-fc35-4474-8fb3-3d5232b6b983" containerName="dnsmasq-dns" Mar 16 17:19:01 crc kubenswrapper[5120]: I0316 17:19:01.492893 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/download-cache-edpm-compute-global-edpm-compute-global-4z24m" Mar 16 17:19:01 crc kubenswrapper[5120]: I0316 17:19:01.494057 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/download-cache-edpm-compute-global-edpm-compute-global-4z24m"] Mar 16 17:19:01 crc kubenswrapper[5120]: I0316 17:19:01.527990 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplane-ansible-ssh-private-key-secret\"" Mar 16 17:19:01 crc kubenswrapper[5120]: I0316 17:19:01.528290 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"edpm-compute-global-dockercfg-5hp85\"" Mar 16 17:19:01 crc kubenswrapper[5120]: I0316 17:19:01.528411 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/813225e2-fc35-4474-8fb3-3d5232b6b983-config\") pod \"813225e2-fc35-4474-8fb3-3d5232b6b983\" (UID: \"813225e2-fc35-4474-8fb3-3d5232b6b983\") " Mar 16 17:19:01 crc kubenswrapper[5120]: I0316 17:19:01.528449 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplanenodeset-edpm-compute-global\"" Mar 16 17:19:01 crc kubenswrapper[5120]: I0316 17:19:01.528491 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zmhvr\" (UniqueName: \"kubernetes.io/projected/813225e2-fc35-4474-8fb3-3d5232b6b983-kube-api-access-zmhvr\") pod \"813225e2-fc35-4474-8fb3-3d5232b6b983\" (UID: \"813225e2-fc35-4474-8fb3-3d5232b6b983\") " Mar 16 17:19:01 crc kubenswrapper[5120]: I0316 17:19:01.528420 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-aee-default-env\"" Mar 16 17:19:01 crc kubenswrapper[5120]: I0316 17:19:01.528700 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/813225e2-fc35-4474-8fb3-3d5232b6b983-dnsmasq-svc\") pod \"813225e2-fc35-4474-8fb3-3d5232b6b983\" (UID: \"813225e2-fc35-4474-8fb3-3d5232b6b983\") " Mar 16 17:19:01 crc kubenswrapper[5120]: I0316 17:19:01.539128 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/813225e2-fc35-4474-8fb3-3d5232b6b983-kube-api-access-zmhvr" (OuterVolumeSpecName: "kube-api-access-zmhvr") pod "813225e2-fc35-4474-8fb3-3d5232b6b983" (UID: "813225e2-fc35-4474-8fb3-3d5232b6b983"). InnerVolumeSpecName "kube-api-access-zmhvr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:19:01 crc kubenswrapper[5120]: I0316 17:19:01.570868 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/813225e2-fc35-4474-8fb3-3d5232b6b983-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "813225e2-fc35-4474-8fb3-3d5232b6b983" (UID: "813225e2-fc35-4474-8fb3-3d5232b6b983"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:19:01 crc kubenswrapper[5120]: I0316 17:19:01.578813 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/813225e2-fc35-4474-8fb3-3d5232b6b983-config" (OuterVolumeSpecName: "config") pod "813225e2-fc35-4474-8fb3-3d5232b6b983" (UID: "813225e2-fc35-4474-8fb3-3d5232b6b983"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:19:01 crc kubenswrapper[5120]: I0316 17:19:01.631468 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/b824f0e6-549f-464b-89a2-f90732d13799-inventory\") pod \"download-cache-edpm-compute-global-edpm-compute-global-4z24m\" (UID: \"b824f0e6-549f-464b-89a2-f90732d13799\") " pod="openstack-kuttl-tests/download-cache-edpm-compute-global-edpm-compute-global-4z24m" Mar 16 17:19:01 crc kubenswrapper[5120]: I0316 17:19:01.631697 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xh8cp\" (UniqueName: \"kubernetes.io/projected/b824f0e6-549f-464b-89a2-f90732d13799-kube-api-access-xh8cp\") pod \"download-cache-edpm-compute-global-edpm-compute-global-4z24m\" (UID: \"b824f0e6-549f-464b-89a2-f90732d13799\") " pod="openstack-kuttl-tests/download-cache-edpm-compute-global-edpm-compute-global-4z24m" Mar 16 17:19:01 crc kubenswrapper[5120]: I0316 17:19:01.631797 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/b824f0e6-549f-464b-89a2-f90732d13799-ssh-key-edpm-compute-global\") pod \"download-cache-edpm-compute-global-edpm-compute-global-4z24m\" (UID: \"b824f0e6-549f-464b-89a2-f90732d13799\") " pod="openstack-kuttl-tests/download-cache-edpm-compute-global-edpm-compute-global-4z24m" Mar 16 17:19:01 crc kubenswrapper[5120]: I0316 17:19:01.631953 5120 reconciler_common.go:299] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/813225e2-fc35-4474-8fb3-3d5232b6b983-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Mar 16 17:19:01 crc kubenswrapper[5120]: I0316 17:19:01.631970 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/813225e2-fc35-4474-8fb3-3d5232b6b983-config\") on node \"crc\" DevicePath \"\"" Mar 16 17:19:01 crc kubenswrapper[5120]: I0316 17:19:01.631983 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zmhvr\" (UniqueName: \"kubernetes.io/projected/813225e2-fc35-4474-8fb3-3d5232b6b983-kube-api-access-zmhvr\") on node \"crc\" DevicePath \"\"" Mar 16 17:19:01 crc kubenswrapper[5120]: I0316 17:19:01.733482 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/b824f0e6-549f-464b-89a2-f90732d13799-inventory\") pod \"download-cache-edpm-compute-global-edpm-compute-global-4z24m\" (UID: \"b824f0e6-549f-464b-89a2-f90732d13799\") " pod="openstack-kuttl-tests/download-cache-edpm-compute-global-edpm-compute-global-4z24m" Mar 16 17:19:01 crc kubenswrapper[5120]: I0316 17:19:01.733574 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xh8cp\" (UniqueName: \"kubernetes.io/projected/b824f0e6-549f-464b-89a2-f90732d13799-kube-api-access-xh8cp\") pod \"download-cache-edpm-compute-global-edpm-compute-global-4z24m\" (UID: \"b824f0e6-549f-464b-89a2-f90732d13799\") " pod="openstack-kuttl-tests/download-cache-edpm-compute-global-edpm-compute-global-4z24m" Mar 16 17:19:01 crc kubenswrapper[5120]: I0316 17:19:01.733609 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/b824f0e6-549f-464b-89a2-f90732d13799-ssh-key-edpm-compute-global\") pod \"download-cache-edpm-compute-global-edpm-compute-global-4z24m\" (UID: \"b824f0e6-549f-464b-89a2-f90732d13799\") " pod="openstack-kuttl-tests/download-cache-edpm-compute-global-edpm-compute-global-4z24m" Mar 16 17:19:01 crc kubenswrapper[5120]: I0316 17:19:01.739019 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/b824f0e6-549f-464b-89a2-f90732d13799-ssh-key-edpm-compute-global\") pod \"download-cache-edpm-compute-global-edpm-compute-global-4z24m\" (UID: \"b824f0e6-549f-464b-89a2-f90732d13799\") " pod="openstack-kuttl-tests/download-cache-edpm-compute-global-edpm-compute-global-4z24m" Mar 16 17:19:01 crc kubenswrapper[5120]: I0316 17:19:01.740015 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/b824f0e6-549f-464b-89a2-f90732d13799-inventory\") pod \"download-cache-edpm-compute-global-edpm-compute-global-4z24m\" (UID: \"b824f0e6-549f-464b-89a2-f90732d13799\") " pod="openstack-kuttl-tests/download-cache-edpm-compute-global-edpm-compute-global-4z24m" Mar 16 17:19:01 crc kubenswrapper[5120]: I0316 17:19:01.748598 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xh8cp\" (UniqueName: \"kubernetes.io/projected/b824f0e6-549f-464b-89a2-f90732d13799-kube-api-access-xh8cp\") pod \"download-cache-edpm-compute-global-edpm-compute-global-4z24m\" (UID: \"b824f0e6-549f-464b-89a2-f90732d13799\") " pod="openstack-kuttl-tests/download-cache-edpm-compute-global-edpm-compute-global-4z24m" Mar 16 17:19:01 crc kubenswrapper[5120]: I0316 17:19:01.890004 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/download-cache-edpm-compute-global-edpm-compute-global-4z24m" Mar 16 17:19:02 crc kubenswrapper[5120]: I0316 17:19:02.028520 5120 generic.go:358] "Generic (PLEG): container finished" podID="813225e2-fc35-4474-8fb3-3d5232b6b983" containerID="64b128e00a201a7186f18975d102e9bbc72d32c9d119dee6e1771c140858a42e" exitCode=0 Mar 16 17:19:02 crc kubenswrapper[5120]: I0316 17:19:02.028591 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-v9czz" Mar 16 17:19:02 crc kubenswrapper[5120]: I0316 17:19:02.029006 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-v9czz" event={"ID":"813225e2-fc35-4474-8fb3-3d5232b6b983","Type":"ContainerDied","Data":"64b128e00a201a7186f18975d102e9bbc72d32c9d119dee6e1771c140858a42e"} Mar 16 17:19:02 crc kubenswrapper[5120]: I0316 17:19:02.029042 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-v9czz" event={"ID":"813225e2-fc35-4474-8fb3-3d5232b6b983","Type":"ContainerDied","Data":"293c1077fac3dc1bb3c27f7c24304343777e5be58f27e0b7472fd28daeb6b42d"} Mar 16 17:19:02 crc kubenswrapper[5120]: I0316 17:19:02.029062 5120 scope.go:117] "RemoveContainer" containerID="64b128e00a201a7186f18975d102e9bbc72d32c9d119dee6e1771c140858a42e" Mar 16 17:19:02 crc kubenswrapper[5120]: I0316 17:19:02.052959 5120 scope.go:117] "RemoveContainer" containerID="21456858d698ae20a1401f0352d079c83dd95e5118f3e1e4dc31f200fb03dee0" Mar 16 17:19:02 crc kubenswrapper[5120]: I0316 17:19:02.079186 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-v9czz"] Mar 16 17:19:02 crc kubenswrapper[5120]: I0316 17:19:02.087694 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-v9czz"] Mar 16 17:19:02 crc kubenswrapper[5120]: I0316 17:19:02.102243 5120 scope.go:117] "RemoveContainer" containerID="64b128e00a201a7186f18975d102e9bbc72d32c9d119dee6e1771c140858a42e" Mar 16 17:19:02 crc kubenswrapper[5120]: E0316 17:19:02.103149 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"64b128e00a201a7186f18975d102e9bbc72d32c9d119dee6e1771c140858a42e\": container with ID starting with 64b128e00a201a7186f18975d102e9bbc72d32c9d119dee6e1771c140858a42e not found: ID does not exist" containerID="64b128e00a201a7186f18975d102e9bbc72d32c9d119dee6e1771c140858a42e" Mar 16 17:19:02 crc kubenswrapper[5120]: I0316 17:19:02.103199 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64b128e00a201a7186f18975d102e9bbc72d32c9d119dee6e1771c140858a42e"} err="failed to get container status \"64b128e00a201a7186f18975d102e9bbc72d32c9d119dee6e1771c140858a42e\": rpc error: code = NotFound desc = could not find container \"64b128e00a201a7186f18975d102e9bbc72d32c9d119dee6e1771c140858a42e\": container with ID starting with 64b128e00a201a7186f18975d102e9bbc72d32c9d119dee6e1771c140858a42e not found: ID does not exist" Mar 16 17:19:02 crc kubenswrapper[5120]: I0316 17:19:02.103234 5120 scope.go:117] "RemoveContainer" containerID="21456858d698ae20a1401f0352d079c83dd95e5118f3e1e4dc31f200fb03dee0" Mar 16 17:19:02 crc kubenswrapper[5120]: E0316 17:19:02.103946 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"21456858d698ae20a1401f0352d079c83dd95e5118f3e1e4dc31f200fb03dee0\": container with ID starting with 21456858d698ae20a1401f0352d079c83dd95e5118f3e1e4dc31f200fb03dee0 not found: ID does not exist" containerID="21456858d698ae20a1401f0352d079c83dd95e5118f3e1e4dc31f200fb03dee0" Mar 16 17:19:02 crc kubenswrapper[5120]: I0316 17:19:02.103978 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21456858d698ae20a1401f0352d079c83dd95e5118f3e1e4dc31f200fb03dee0"} err="failed to get container status \"21456858d698ae20a1401f0352d079c83dd95e5118f3e1e4dc31f200fb03dee0\": rpc error: code = NotFound desc = could not find container \"21456858d698ae20a1401f0352d079c83dd95e5118f3e1e4dc31f200fb03dee0\": container with ID starting with 21456858d698ae20a1401f0352d079c83dd95e5118f3e1e4dc31f200fb03dee0 not found: ID does not exist" Mar 16 17:19:02 crc kubenswrapper[5120]: I0316 17:19:02.349928 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/download-cache-edpm-compute-global-edpm-compute-global-4z24m"] Mar 16 17:19:02 crc kubenswrapper[5120]: I0316 17:19:02.673183 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="813225e2-fc35-4474-8fb3-3d5232b6b983" path="/var/lib/kubelet/pods/813225e2-fc35-4474-8fb3-3d5232b6b983/volumes" Mar 16 17:19:03 crc kubenswrapper[5120]: I0316 17:19:03.037992 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/download-cache-edpm-compute-global-edpm-compute-global-4z24m" event={"ID":"b824f0e6-549f-464b-89a2-f90732d13799","Type":"ContainerStarted","Data":"47f0d3003a221b94861441cd6633439d0ab42d98f322d49bbc4a80385389a359"} Mar 16 17:19:03 crc kubenswrapper[5120]: I0316 17:19:03.663899 5120 scope.go:117] "RemoveContainer" containerID="2ca61165dca6fdb30458423ef74c44c42b1b273e8fa504e89f5f9e186e516cc3" Mar 16 17:19:03 crc kubenswrapper[5120]: E0316 17:19:03.664181 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 17:19:07 crc kubenswrapper[5120]: E0316 17:19:07.479298 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1313266 actualBytes=10240 Mar 16 17:19:11 crc kubenswrapper[5120]: I0316 17:19:11.109350 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/download-cache-edpm-compute-global-edpm-compute-global-4z24m" event={"ID":"b824f0e6-549f-464b-89a2-f90732d13799","Type":"ContainerStarted","Data":"383b854ebc03a050f158311a471e9a7596df61897a7bb8232d9921d4fbb3ce53"} Mar 16 17:19:11 crc kubenswrapper[5120]: I0316 17:19:11.123037 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/download-cache-edpm-compute-global-edpm-compute-global-4z24m" podStartSLOduration=2.144435602 podStartE2EDuration="10.123020328s" podCreationTimestamp="2026-03-16 17:19:01 +0000 UTC" firstStartedPulling="2026-03-16 17:19:02.356160323 +0000 UTC m=+6444.510091980" lastFinishedPulling="2026-03-16 17:19:10.334745039 +0000 UTC m=+6452.488676706" observedRunningTime="2026-03-16 17:19:11.12236463 +0000 UTC m=+6453.276296297" watchObservedRunningTime="2026-03-16 17:19:11.123020328 +0000 UTC m=+6453.276951985" Mar 16 17:19:12 crc kubenswrapper[5120]: I0316 17:19:12.122190 5120 generic.go:358] "Generic (PLEG): container finished" podID="b824f0e6-549f-464b-89a2-f90732d13799" containerID="383b854ebc03a050f158311a471e9a7596df61897a7bb8232d9921d4fbb3ce53" exitCode=0 Mar 16 17:19:12 crc kubenswrapper[5120]: I0316 17:19:12.122348 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/download-cache-edpm-compute-global-edpm-compute-global-4z24m" event={"ID":"b824f0e6-549f-464b-89a2-f90732d13799","Type":"ContainerDied","Data":"383b854ebc03a050f158311a471e9a7596df61897a7bb8232d9921d4fbb3ce53"} Mar 16 17:19:13 crc kubenswrapper[5120]: I0316 17:19:13.434313 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/download-cache-edpm-compute-global-edpm-compute-global-4z24m" Mar 16 17:19:13 crc kubenswrapper[5120]: I0316 17:19:13.500291 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xh8cp\" (UniqueName: \"kubernetes.io/projected/b824f0e6-549f-464b-89a2-f90732d13799-kube-api-access-xh8cp\") pod \"b824f0e6-549f-464b-89a2-f90732d13799\" (UID: \"b824f0e6-549f-464b-89a2-f90732d13799\") " Mar 16 17:19:13 crc kubenswrapper[5120]: I0316 17:19:13.500518 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/b824f0e6-549f-464b-89a2-f90732d13799-inventory\") pod \"b824f0e6-549f-464b-89a2-f90732d13799\" (UID: \"b824f0e6-549f-464b-89a2-f90732d13799\") " Mar 16 17:19:13 crc kubenswrapper[5120]: I0316 17:19:13.500778 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/b824f0e6-549f-464b-89a2-f90732d13799-ssh-key-edpm-compute-global\") pod \"b824f0e6-549f-464b-89a2-f90732d13799\" (UID: \"b824f0e6-549f-464b-89a2-f90732d13799\") " Mar 16 17:19:13 crc kubenswrapper[5120]: I0316 17:19:13.508894 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b824f0e6-549f-464b-89a2-f90732d13799-kube-api-access-xh8cp" (OuterVolumeSpecName: "kube-api-access-xh8cp") pod "b824f0e6-549f-464b-89a2-f90732d13799" (UID: "b824f0e6-549f-464b-89a2-f90732d13799"). InnerVolumeSpecName "kube-api-access-xh8cp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:19:13 crc kubenswrapper[5120]: I0316 17:19:13.525676 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b824f0e6-549f-464b-89a2-f90732d13799-inventory" (OuterVolumeSpecName: "inventory") pod "b824f0e6-549f-464b-89a2-f90732d13799" (UID: "b824f0e6-549f-464b-89a2-f90732d13799"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:19:13 crc kubenswrapper[5120]: I0316 17:19:13.525690 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b824f0e6-549f-464b-89a2-f90732d13799-ssh-key-edpm-compute-global" (OuterVolumeSpecName: "ssh-key-edpm-compute-global") pod "b824f0e6-549f-464b-89a2-f90732d13799" (UID: "b824f0e6-549f-464b-89a2-f90732d13799"). InnerVolumeSpecName "ssh-key-edpm-compute-global". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:19:13 crc kubenswrapper[5120]: I0316 17:19:13.603401 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xh8cp\" (UniqueName: \"kubernetes.io/projected/b824f0e6-549f-464b-89a2-f90732d13799-kube-api-access-xh8cp\") on node \"crc\" DevicePath \"\"" Mar 16 17:19:13 crc kubenswrapper[5120]: I0316 17:19:13.603692 5120 reconciler_common.go:299] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/b824f0e6-549f-464b-89a2-f90732d13799-inventory\") on node \"crc\" DevicePath \"\"" Mar 16 17:19:13 crc kubenswrapper[5120]: I0316 17:19:13.603795 5120 reconciler_common.go:299] "Volume detached for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/b824f0e6-549f-464b-89a2-f90732d13799-ssh-key-edpm-compute-global\") on node \"crc\" DevicePath \"\"" Mar 16 17:19:14 crc kubenswrapper[5120]: I0316 17:19:14.140788 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/download-cache-edpm-compute-global-edpm-compute-global-4z24m" Mar 16 17:19:14 crc kubenswrapper[5120]: I0316 17:19:14.140969 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/download-cache-edpm-compute-global-edpm-compute-global-4z24m" event={"ID":"b824f0e6-549f-464b-89a2-f90732d13799","Type":"ContainerDied","Data":"47f0d3003a221b94861441cd6633439d0ab42d98f322d49bbc4a80385389a359"} Mar 16 17:19:14 crc kubenswrapper[5120]: I0316 17:19:14.141501 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="47f0d3003a221b94861441cd6633439d0ab42d98f322d49bbc4a80385389a359" Mar 16 17:19:14 crc kubenswrapper[5120]: I0316 17:19:14.200263 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/bootstrap-edpm-compute-global-edpm-compute-global-wzq2k"] Mar 16 17:19:14 crc kubenswrapper[5120]: I0316 17:19:14.201243 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b824f0e6-549f-464b-89a2-f90732d13799" containerName="download-cache-edpm-compute-global-edpm-compute-global" Mar 16 17:19:14 crc kubenswrapper[5120]: I0316 17:19:14.201265 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="b824f0e6-549f-464b-89a2-f90732d13799" containerName="download-cache-edpm-compute-global-edpm-compute-global" Mar 16 17:19:14 crc kubenswrapper[5120]: I0316 17:19:14.201444 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="b824f0e6-549f-464b-89a2-f90732d13799" containerName="download-cache-edpm-compute-global-edpm-compute-global" Mar 16 17:19:14 crc kubenswrapper[5120]: I0316 17:19:14.208222 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/bootstrap-edpm-compute-global-edpm-compute-global-wzq2k" Mar 16 17:19:14 crc kubenswrapper[5120]: I0316 17:19:14.208248 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/bootstrap-edpm-compute-global-edpm-compute-global-wzq2k"] Mar 16 17:19:14 crc kubenswrapper[5120]: I0316 17:19:14.210170 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-aee-default-env\"" Mar 16 17:19:14 crc kubenswrapper[5120]: I0316 17:19:14.211033 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplanenodeset-edpm-compute-global\"" Mar 16 17:19:14 crc kubenswrapper[5120]: I0316 17:19:14.211360 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplane-ansible-ssh-private-key-secret\"" Mar 16 17:19:14 crc kubenswrapper[5120]: I0316 17:19:14.211630 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"edpm-compute-global-dockercfg-5hp85\"" Mar 16 17:19:14 crc kubenswrapper[5120]: I0316 17:19:14.211858 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"combined-ca-bundle\"" Mar 16 17:19:14 crc kubenswrapper[5120]: I0316 17:19:14.318284 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/29090232-2003-44d6-bd82-596011902d6c-inventory\") pod \"bootstrap-edpm-compute-global-edpm-compute-global-wzq2k\" (UID: \"29090232-2003-44d6-bd82-596011902d6c\") " pod="openstack-kuttl-tests/bootstrap-edpm-compute-global-edpm-compute-global-wzq2k" Mar 16 17:19:14 crc kubenswrapper[5120]: I0316 17:19:14.318649 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8cgf4\" (UniqueName: \"kubernetes.io/projected/29090232-2003-44d6-bd82-596011902d6c-kube-api-access-8cgf4\") pod \"bootstrap-edpm-compute-global-edpm-compute-global-wzq2k\" (UID: \"29090232-2003-44d6-bd82-596011902d6c\") " pod="openstack-kuttl-tests/bootstrap-edpm-compute-global-edpm-compute-global-wzq2k" Mar 16 17:19:14 crc kubenswrapper[5120]: I0316 17:19:14.318873 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bootstrap-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/29090232-2003-44d6-bd82-596011902d6c-bootstrap-combined-ca-bundle\") pod \"bootstrap-edpm-compute-global-edpm-compute-global-wzq2k\" (UID: \"29090232-2003-44d6-bd82-596011902d6c\") " pod="openstack-kuttl-tests/bootstrap-edpm-compute-global-edpm-compute-global-wzq2k" Mar 16 17:19:14 crc kubenswrapper[5120]: I0316 17:19:14.319089 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/29090232-2003-44d6-bd82-596011902d6c-ssh-key-edpm-compute-global\") pod \"bootstrap-edpm-compute-global-edpm-compute-global-wzq2k\" (UID: \"29090232-2003-44d6-bd82-596011902d6c\") " pod="openstack-kuttl-tests/bootstrap-edpm-compute-global-edpm-compute-global-wzq2k" Mar 16 17:19:14 crc kubenswrapper[5120]: I0316 17:19:14.421781 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/29090232-2003-44d6-bd82-596011902d6c-inventory\") pod \"bootstrap-edpm-compute-global-edpm-compute-global-wzq2k\" (UID: \"29090232-2003-44d6-bd82-596011902d6c\") " pod="openstack-kuttl-tests/bootstrap-edpm-compute-global-edpm-compute-global-wzq2k" Mar 16 17:19:14 crc kubenswrapper[5120]: I0316 17:19:14.422116 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8cgf4\" (UniqueName: \"kubernetes.io/projected/29090232-2003-44d6-bd82-596011902d6c-kube-api-access-8cgf4\") pod \"bootstrap-edpm-compute-global-edpm-compute-global-wzq2k\" (UID: \"29090232-2003-44d6-bd82-596011902d6c\") " pod="openstack-kuttl-tests/bootstrap-edpm-compute-global-edpm-compute-global-wzq2k" Mar 16 17:19:14 crc kubenswrapper[5120]: I0316 17:19:14.422361 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bootstrap-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/29090232-2003-44d6-bd82-596011902d6c-bootstrap-combined-ca-bundle\") pod \"bootstrap-edpm-compute-global-edpm-compute-global-wzq2k\" (UID: \"29090232-2003-44d6-bd82-596011902d6c\") " pod="openstack-kuttl-tests/bootstrap-edpm-compute-global-edpm-compute-global-wzq2k" Mar 16 17:19:14 crc kubenswrapper[5120]: I0316 17:19:14.422570 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/29090232-2003-44d6-bd82-596011902d6c-ssh-key-edpm-compute-global\") pod \"bootstrap-edpm-compute-global-edpm-compute-global-wzq2k\" (UID: \"29090232-2003-44d6-bd82-596011902d6c\") " pod="openstack-kuttl-tests/bootstrap-edpm-compute-global-edpm-compute-global-wzq2k" Mar 16 17:19:14 crc kubenswrapper[5120]: I0316 17:19:14.426643 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/29090232-2003-44d6-bd82-596011902d6c-ssh-key-edpm-compute-global\") pod \"bootstrap-edpm-compute-global-edpm-compute-global-wzq2k\" (UID: \"29090232-2003-44d6-bd82-596011902d6c\") " pod="openstack-kuttl-tests/bootstrap-edpm-compute-global-edpm-compute-global-wzq2k" Mar 16 17:19:14 crc kubenswrapper[5120]: I0316 17:19:14.436342 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bootstrap-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/29090232-2003-44d6-bd82-596011902d6c-bootstrap-combined-ca-bundle\") pod \"bootstrap-edpm-compute-global-edpm-compute-global-wzq2k\" (UID: \"29090232-2003-44d6-bd82-596011902d6c\") " pod="openstack-kuttl-tests/bootstrap-edpm-compute-global-edpm-compute-global-wzq2k" Mar 16 17:19:14 crc kubenswrapper[5120]: I0316 17:19:14.439270 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/29090232-2003-44d6-bd82-596011902d6c-inventory\") pod \"bootstrap-edpm-compute-global-edpm-compute-global-wzq2k\" (UID: \"29090232-2003-44d6-bd82-596011902d6c\") " pod="openstack-kuttl-tests/bootstrap-edpm-compute-global-edpm-compute-global-wzq2k" Mar 16 17:19:14 crc kubenswrapper[5120]: I0316 17:19:14.439899 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8cgf4\" (UniqueName: \"kubernetes.io/projected/29090232-2003-44d6-bd82-596011902d6c-kube-api-access-8cgf4\") pod \"bootstrap-edpm-compute-global-edpm-compute-global-wzq2k\" (UID: \"29090232-2003-44d6-bd82-596011902d6c\") " pod="openstack-kuttl-tests/bootstrap-edpm-compute-global-edpm-compute-global-wzq2k" Mar 16 17:19:14 crc kubenswrapper[5120]: I0316 17:19:14.527148 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/bootstrap-edpm-compute-global-edpm-compute-global-wzq2k" Mar 16 17:19:14 crc kubenswrapper[5120]: I0316 17:19:14.663989 5120 scope.go:117] "RemoveContainer" containerID="2ca61165dca6fdb30458423ef74c44c42b1b273e8fa504e89f5f9e186e516cc3" Mar 16 17:19:14 crc kubenswrapper[5120]: E0316 17:19:14.664211 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 17:19:14 crc kubenswrapper[5120]: I0316 17:19:14.940165 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/bootstrap-edpm-compute-global-edpm-compute-global-wzq2k"] Mar 16 17:19:14 crc kubenswrapper[5120]: W0316 17:19:14.944063 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod29090232_2003_44d6_bd82_596011902d6c.slice/crio-bcc6f82f1a23613eafb2abbc2a22b04980731d7bcebe9dcc2c327ace33afd5ca WatchSource:0}: Error finding container bcc6f82f1a23613eafb2abbc2a22b04980731d7bcebe9dcc2c327ace33afd5ca: Status 404 returned error can't find the container with id bcc6f82f1a23613eafb2abbc2a22b04980731d7bcebe9dcc2c327ace33afd5ca Mar 16 17:19:15 crc kubenswrapper[5120]: I0316 17:19:15.151976 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/bootstrap-edpm-compute-global-edpm-compute-global-wzq2k" event={"ID":"29090232-2003-44d6-bd82-596011902d6c","Type":"ContainerStarted","Data":"bcc6f82f1a23613eafb2abbc2a22b04980731d7bcebe9dcc2c327ace33afd5ca"} Mar 16 17:19:16 crc kubenswrapper[5120]: I0316 17:19:16.162329 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/bootstrap-edpm-compute-global-edpm-compute-global-wzq2k" event={"ID":"29090232-2003-44d6-bd82-596011902d6c","Type":"ContainerStarted","Data":"a3219456479c58d1c73310670060bcbbb12f96868ce6dc571cf91e49d5038d2b"} Mar 16 17:19:16 crc kubenswrapper[5120]: I0316 17:19:16.191301 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/bootstrap-edpm-compute-global-edpm-compute-global-wzq2k" podStartSLOduration=1.31885784 podStartE2EDuration="2.191253829s" podCreationTimestamp="2026-03-16 17:19:14 +0000 UTC" firstStartedPulling="2026-03-16 17:19:14.947530863 +0000 UTC m=+6457.101462520" lastFinishedPulling="2026-03-16 17:19:15.819926852 +0000 UTC m=+6457.973858509" observedRunningTime="2026-03-16 17:19:16.181913023 +0000 UTC m=+6458.335844720" watchObservedRunningTime="2026-03-16 17:19:16.191253829 +0000 UTC m=+6458.345185496" Mar 16 17:19:18 crc kubenswrapper[5120]: I0316 17:19:18.182937 5120 generic.go:358] "Generic (PLEG): container finished" podID="29090232-2003-44d6-bd82-596011902d6c" containerID="a3219456479c58d1c73310670060bcbbb12f96868ce6dc571cf91e49d5038d2b" exitCode=0 Mar 16 17:19:18 crc kubenswrapper[5120]: I0316 17:19:18.183019 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/bootstrap-edpm-compute-global-edpm-compute-global-wzq2k" event={"ID":"29090232-2003-44d6-bd82-596011902d6c","Type":"ContainerDied","Data":"a3219456479c58d1c73310670060bcbbb12f96868ce6dc571cf91e49d5038d2b"} Mar 16 17:19:19 crc kubenswrapper[5120]: I0316 17:19:19.470522 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/bootstrap-edpm-compute-global-edpm-compute-global-wzq2k" Mar 16 17:19:19 crc kubenswrapper[5120]: I0316 17:19:19.555930 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/29090232-2003-44d6-bd82-596011902d6c-inventory\") pod \"29090232-2003-44d6-bd82-596011902d6c\" (UID: \"29090232-2003-44d6-bd82-596011902d6c\") " Mar 16 17:19:19 crc kubenswrapper[5120]: I0316 17:19:19.556258 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8cgf4\" (UniqueName: \"kubernetes.io/projected/29090232-2003-44d6-bd82-596011902d6c-kube-api-access-8cgf4\") pod \"29090232-2003-44d6-bd82-596011902d6c\" (UID: \"29090232-2003-44d6-bd82-596011902d6c\") " Mar 16 17:19:19 crc kubenswrapper[5120]: I0316 17:19:19.556380 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/29090232-2003-44d6-bd82-596011902d6c-ssh-key-edpm-compute-global\") pod \"29090232-2003-44d6-bd82-596011902d6c\" (UID: \"29090232-2003-44d6-bd82-596011902d6c\") " Mar 16 17:19:19 crc kubenswrapper[5120]: I0316 17:19:19.556401 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bootstrap-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/29090232-2003-44d6-bd82-596011902d6c-bootstrap-combined-ca-bundle\") pod \"29090232-2003-44d6-bd82-596011902d6c\" (UID: \"29090232-2003-44d6-bd82-596011902d6c\") " Mar 16 17:19:19 crc kubenswrapper[5120]: I0316 17:19:19.562057 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29090232-2003-44d6-bd82-596011902d6c-kube-api-access-8cgf4" (OuterVolumeSpecName: "kube-api-access-8cgf4") pod "29090232-2003-44d6-bd82-596011902d6c" (UID: "29090232-2003-44d6-bd82-596011902d6c"). InnerVolumeSpecName "kube-api-access-8cgf4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:19:19 crc kubenswrapper[5120]: I0316 17:19:19.562131 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/29090232-2003-44d6-bd82-596011902d6c-bootstrap-combined-ca-bundle" (OuterVolumeSpecName: "bootstrap-combined-ca-bundle") pod "29090232-2003-44d6-bd82-596011902d6c" (UID: "29090232-2003-44d6-bd82-596011902d6c"). InnerVolumeSpecName "bootstrap-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:19:19 crc kubenswrapper[5120]: I0316 17:19:19.602212 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/29090232-2003-44d6-bd82-596011902d6c-ssh-key-edpm-compute-global" (OuterVolumeSpecName: "ssh-key-edpm-compute-global") pod "29090232-2003-44d6-bd82-596011902d6c" (UID: "29090232-2003-44d6-bd82-596011902d6c"). InnerVolumeSpecName "ssh-key-edpm-compute-global". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:19:19 crc kubenswrapper[5120]: I0316 17:19:19.603431 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/29090232-2003-44d6-bd82-596011902d6c-inventory" (OuterVolumeSpecName: "inventory") pod "29090232-2003-44d6-bd82-596011902d6c" (UID: "29090232-2003-44d6-bd82-596011902d6c"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:19:19 crc kubenswrapper[5120]: I0316 17:19:19.659346 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8cgf4\" (UniqueName: \"kubernetes.io/projected/29090232-2003-44d6-bd82-596011902d6c-kube-api-access-8cgf4\") on node \"crc\" DevicePath \"\"" Mar 16 17:19:19 crc kubenswrapper[5120]: I0316 17:19:19.659407 5120 reconciler_common.go:299] "Volume detached for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/29090232-2003-44d6-bd82-596011902d6c-ssh-key-edpm-compute-global\") on node \"crc\" DevicePath \"\"" Mar 16 17:19:19 crc kubenswrapper[5120]: I0316 17:19:19.659423 5120 reconciler_common.go:299] "Volume detached for volume \"bootstrap-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/29090232-2003-44d6-bd82-596011902d6c-bootstrap-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:19:19 crc kubenswrapper[5120]: I0316 17:19:19.659437 5120 reconciler_common.go:299] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/29090232-2003-44d6-bd82-596011902d6c-inventory\") on node \"crc\" DevicePath \"\"" Mar 16 17:19:20 crc kubenswrapper[5120]: I0316 17:19:20.203300 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/bootstrap-edpm-compute-global-edpm-compute-global-wzq2k" Mar 16 17:19:20 crc kubenswrapper[5120]: I0316 17:19:20.203353 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/bootstrap-edpm-compute-global-edpm-compute-global-wzq2k" event={"ID":"29090232-2003-44d6-bd82-596011902d6c","Type":"ContainerDied","Data":"bcc6f82f1a23613eafb2abbc2a22b04980731d7bcebe9dcc2c327ace33afd5ca"} Mar 16 17:19:20 crc kubenswrapper[5120]: I0316 17:19:20.203678 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bcc6f82f1a23613eafb2abbc2a22b04980731d7bcebe9dcc2c327ace33afd5ca" Mar 16 17:19:20 crc kubenswrapper[5120]: I0316 17:19:20.259649 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/configure-network-edpm-compute-global-edpm-compute-global-9ss2s"] Mar 16 17:19:20 crc kubenswrapper[5120]: I0316 17:19:20.260533 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29090232-2003-44d6-bd82-596011902d6c" containerName="bootstrap-edpm-compute-global-edpm-compute-global" Mar 16 17:19:20 crc kubenswrapper[5120]: I0316 17:19:20.260556 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="29090232-2003-44d6-bd82-596011902d6c" containerName="bootstrap-edpm-compute-global-edpm-compute-global" Mar 16 17:19:20 crc kubenswrapper[5120]: I0316 17:19:20.260716 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="29090232-2003-44d6-bd82-596011902d6c" containerName="bootstrap-edpm-compute-global-edpm-compute-global" Mar 16 17:19:20 crc kubenswrapper[5120]: I0316 17:19:20.307065 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/configure-network-edpm-compute-global-edpm-compute-global-9ss2s"] Mar 16 17:19:20 crc kubenswrapper[5120]: I0316 17:19:20.307175 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/configure-network-edpm-compute-global-edpm-compute-global-9ss2s" Mar 16 17:19:20 crc kubenswrapper[5120]: I0316 17:19:20.309156 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplane-ansible-ssh-private-key-secret\"" Mar 16 17:19:20 crc kubenswrapper[5120]: I0316 17:19:20.309205 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-aee-default-env\"" Mar 16 17:19:20 crc kubenswrapper[5120]: I0316 17:19:20.309424 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplanenodeset-edpm-compute-global\"" Mar 16 17:19:20 crc kubenswrapper[5120]: I0316 17:19:20.309433 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"edpm-compute-global-dockercfg-5hp85\"" Mar 16 17:19:20 crc kubenswrapper[5120]: I0316 17:19:20.374080 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/16d1cbb9-7339-4170-827c-1ff72424a7e6-ssh-key-edpm-compute-global\") pod \"configure-network-edpm-compute-global-edpm-compute-global-9ss2s\" (UID: \"16d1cbb9-7339-4170-827c-1ff72424a7e6\") " pod="openstack-kuttl-tests/configure-network-edpm-compute-global-edpm-compute-global-9ss2s" Mar 16 17:19:20 crc kubenswrapper[5120]: I0316 17:19:20.374148 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/16d1cbb9-7339-4170-827c-1ff72424a7e6-inventory\") pod \"configure-network-edpm-compute-global-edpm-compute-global-9ss2s\" (UID: \"16d1cbb9-7339-4170-827c-1ff72424a7e6\") " pod="openstack-kuttl-tests/configure-network-edpm-compute-global-edpm-compute-global-9ss2s" Mar 16 17:19:20 crc kubenswrapper[5120]: I0316 17:19:20.374216 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4wt9\" (UniqueName: \"kubernetes.io/projected/16d1cbb9-7339-4170-827c-1ff72424a7e6-kube-api-access-d4wt9\") pod \"configure-network-edpm-compute-global-edpm-compute-global-9ss2s\" (UID: \"16d1cbb9-7339-4170-827c-1ff72424a7e6\") " pod="openstack-kuttl-tests/configure-network-edpm-compute-global-edpm-compute-global-9ss2s" Mar 16 17:19:20 crc kubenswrapper[5120]: I0316 17:19:20.476038 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d4wt9\" (UniqueName: \"kubernetes.io/projected/16d1cbb9-7339-4170-827c-1ff72424a7e6-kube-api-access-d4wt9\") pod \"configure-network-edpm-compute-global-edpm-compute-global-9ss2s\" (UID: \"16d1cbb9-7339-4170-827c-1ff72424a7e6\") " pod="openstack-kuttl-tests/configure-network-edpm-compute-global-edpm-compute-global-9ss2s" Mar 16 17:19:20 crc kubenswrapper[5120]: I0316 17:19:20.476338 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/16d1cbb9-7339-4170-827c-1ff72424a7e6-ssh-key-edpm-compute-global\") pod \"configure-network-edpm-compute-global-edpm-compute-global-9ss2s\" (UID: \"16d1cbb9-7339-4170-827c-1ff72424a7e6\") " pod="openstack-kuttl-tests/configure-network-edpm-compute-global-edpm-compute-global-9ss2s" Mar 16 17:19:20 crc kubenswrapper[5120]: I0316 17:19:20.476411 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/16d1cbb9-7339-4170-827c-1ff72424a7e6-inventory\") pod \"configure-network-edpm-compute-global-edpm-compute-global-9ss2s\" (UID: \"16d1cbb9-7339-4170-827c-1ff72424a7e6\") " pod="openstack-kuttl-tests/configure-network-edpm-compute-global-edpm-compute-global-9ss2s" Mar 16 17:19:20 crc kubenswrapper[5120]: I0316 17:19:20.481503 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/16d1cbb9-7339-4170-827c-1ff72424a7e6-ssh-key-edpm-compute-global\") pod \"configure-network-edpm-compute-global-edpm-compute-global-9ss2s\" (UID: \"16d1cbb9-7339-4170-827c-1ff72424a7e6\") " pod="openstack-kuttl-tests/configure-network-edpm-compute-global-edpm-compute-global-9ss2s" Mar 16 17:19:20 crc kubenswrapper[5120]: I0316 17:19:20.482648 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/16d1cbb9-7339-4170-827c-1ff72424a7e6-inventory\") pod \"configure-network-edpm-compute-global-edpm-compute-global-9ss2s\" (UID: \"16d1cbb9-7339-4170-827c-1ff72424a7e6\") " pod="openstack-kuttl-tests/configure-network-edpm-compute-global-edpm-compute-global-9ss2s" Mar 16 17:19:20 crc kubenswrapper[5120]: I0316 17:19:20.493010 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4wt9\" (UniqueName: \"kubernetes.io/projected/16d1cbb9-7339-4170-827c-1ff72424a7e6-kube-api-access-d4wt9\") pod \"configure-network-edpm-compute-global-edpm-compute-global-9ss2s\" (UID: \"16d1cbb9-7339-4170-827c-1ff72424a7e6\") " pod="openstack-kuttl-tests/configure-network-edpm-compute-global-edpm-compute-global-9ss2s" Mar 16 17:19:20 crc kubenswrapper[5120]: I0316 17:19:20.627032 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/configure-network-edpm-compute-global-edpm-compute-global-9ss2s" Mar 16 17:19:21 crc kubenswrapper[5120]: I0316 17:19:21.090176 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/configure-network-edpm-compute-global-edpm-compute-global-9ss2s"] Mar 16 17:19:21 crc kubenswrapper[5120]: I0316 17:19:21.218084 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/configure-network-edpm-compute-global-edpm-compute-global-9ss2s" event={"ID":"16d1cbb9-7339-4170-827c-1ff72424a7e6","Type":"ContainerStarted","Data":"09b9f792d590cc6a1a050c39415ccdf39cb3d8ae644e353ce5116740841506c3"} Mar 16 17:19:22 crc kubenswrapper[5120]: I0316 17:19:22.229179 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/configure-network-edpm-compute-global-edpm-compute-global-9ss2s" event={"ID":"16d1cbb9-7339-4170-827c-1ff72424a7e6","Type":"ContainerStarted","Data":"8c8bfd3d4b500e1a51c417dde958249bc67da6c7b4636c44742b3a2b0394818b"} Mar 16 17:19:22 crc kubenswrapper[5120]: I0316 17:19:22.248895 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/configure-network-edpm-compute-global-edpm-compute-global-9ss2s" podStartSLOduration=1.853455589 podStartE2EDuration="2.248870133s" podCreationTimestamp="2026-03-16 17:19:20 +0000 UTC" firstStartedPulling="2026-03-16 17:19:21.088091895 +0000 UTC m=+6463.242023552" lastFinishedPulling="2026-03-16 17:19:21.483506429 +0000 UTC m=+6463.637438096" observedRunningTime="2026-03-16 17:19:22.242576091 +0000 UTC m=+6464.396507758" watchObservedRunningTime="2026-03-16 17:19:22.248870133 +0000 UTC m=+6464.402801790" Mar 16 17:19:22 crc kubenswrapper[5120]: I0316 17:19:22.536074 5120 scope.go:117] "RemoveContainer" containerID="8b8d8b3ebed5d19b23cc98f96796bb80d7479f737f822df0f537a98805318f0a" Mar 16 17:19:22 crc kubenswrapper[5120]: I0316 17:19:22.561941 5120 scope.go:117] "RemoveContainer" containerID="88180a4f67ed3bff905e1f6be167115e787ec8cccecd86c9e10de0d2f1ec9552" Mar 16 17:19:22 crc kubenswrapper[5120]: I0316 17:19:22.585637 5120 scope.go:117] "RemoveContainer" containerID="8b042963358c68f21260174a979c8b5391ca04edf893e990a9f0f840643f14c0" Mar 16 17:19:22 crc kubenswrapper[5120]: I0316 17:19:22.613680 5120 scope.go:117] "RemoveContainer" containerID="6b1f38a50b1d436dc0420e3d24bcc3505027e09db725d3244026d9aa3d1d44bd" Mar 16 17:19:22 crc kubenswrapper[5120]: I0316 17:19:22.641472 5120 scope.go:117] "RemoveContainer" containerID="916f8fa8d131f943de104d80c229bd1697666761f8416620cd7bde98f09d18c5" Mar 16 17:19:22 crc kubenswrapper[5120]: I0316 17:19:22.675063 5120 scope.go:117] "RemoveContainer" containerID="c6b6afe464f39d47838ecf9cba30e2a424d34b117bad13b505276f6588700973" Mar 16 17:19:22 crc kubenswrapper[5120]: I0316 17:19:22.696290 5120 scope.go:117] "RemoveContainer" containerID="624ae52b1f995ebde13049c519bd35d8505845b4f77c6a708e9d5932ae8a65da" Mar 16 17:19:22 crc kubenswrapper[5120]: I0316 17:19:22.725110 5120 scope.go:117] "RemoveContainer" containerID="200bbbe280bcacf20487461ecfc91d862b7f61454eb87ee1c78e3fae4984427d" Mar 16 17:19:22 crc kubenswrapper[5120]: I0316 17:19:22.870268 5120 scope.go:117] "RemoveContainer" containerID="f6ec78841b79817c39e562a27445a24787a78a9398b9197a5b69eea49f13dc85" Mar 16 17:19:22 crc kubenswrapper[5120]: I0316 17:19:22.916277 5120 scope.go:117] "RemoveContainer" containerID="e628fc912c1467db9883e28ceeac1aeef2784d2e81cf171898fdcd4591d9ff69" Mar 16 17:19:22 crc kubenswrapper[5120]: I0316 17:19:22.940366 5120 scope.go:117] "RemoveContainer" containerID="f2fd4118710864ad06cc20a55c6ae43fbe323625383cc78fc6cbcc1237aa7f72" Mar 16 17:19:22 crc kubenswrapper[5120]: I0316 17:19:22.960535 5120 scope.go:117] "RemoveContainer" containerID="6ba4c616a5de603f57ad4bf98bda9b313a8b0afd5fe20a7725ca348dc07e395a" Mar 16 17:19:22 crc kubenswrapper[5120]: I0316 17:19:22.999307 5120 scope.go:117] "RemoveContainer" containerID="e2e5cba0bca7902561e2a9258c62d939245b084a6ca01022a356aa26dd638533" Mar 16 17:19:23 crc kubenswrapper[5120]: I0316 17:19:23.022272 5120 scope.go:117] "RemoveContainer" containerID="1ab4100590d5d8e4fa9e54686cd48c0965b7121e2cde22d518c0e42a5bb377df" Mar 16 17:19:23 crc kubenswrapper[5120]: I0316 17:19:23.038725 5120 scope.go:117] "RemoveContainer" containerID="3dbccce89cd901c0416da3e41b60454cf2ab5860b9727c911dacea8d5361320b" Mar 16 17:19:23 crc kubenswrapper[5120]: I0316 17:19:23.058129 5120 scope.go:117] "RemoveContainer" containerID="1e9cd00e86a07ced8e5890ac53aac6c8f28d7dec2aa0d42f36303e867bab0e57" Mar 16 17:19:23 crc kubenswrapper[5120]: I0316 17:19:23.078623 5120 scope.go:117] "RemoveContainer" containerID="81a6cc53b93730662569cd29e06dc1b386c364839efe1a339b666a72f63805a7" Mar 16 17:19:23 crc kubenswrapper[5120]: I0316 17:19:23.105853 5120 scope.go:117] "RemoveContainer" containerID="e3b3a578631c8f7b15bb182a3013fa83b1cee01d09e79273b3cb85ef5ee1e0c4" Mar 16 17:19:23 crc kubenswrapper[5120]: I0316 17:19:23.126638 5120 scope.go:117] "RemoveContainer" containerID="30a61807cc8cd03eac35985c32d432eeb0e9d8c7cb11a86c4469af2f08952738" Mar 16 17:19:23 crc kubenswrapper[5120]: I0316 17:19:23.147289 5120 scope.go:117] "RemoveContainer" containerID="75231ca2d85100c637728df7e1a3143c7285ad90c7ee8e87a5e29de664e2a0b9" Mar 16 17:19:23 crc kubenswrapper[5120]: I0316 17:19:23.258774 5120 generic.go:358] "Generic (PLEG): container finished" podID="16d1cbb9-7339-4170-827c-1ff72424a7e6" containerID="8c8bfd3d4b500e1a51c417dde958249bc67da6c7b4636c44742b3a2b0394818b" exitCode=0 Mar 16 17:19:23 crc kubenswrapper[5120]: I0316 17:19:23.258897 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/configure-network-edpm-compute-global-edpm-compute-global-9ss2s" event={"ID":"16d1cbb9-7339-4170-827c-1ff72424a7e6","Type":"ContainerDied","Data":"8c8bfd3d4b500e1a51c417dde958249bc67da6c7b4636c44742b3a2b0394818b"} Mar 16 17:19:23 crc kubenswrapper[5120]: I0316 17:19:23.328904 5120 scope.go:117] "RemoveContainer" containerID="4c238dc73669ee956af220f43150c9d8707dae698fb75a26d7edb22aea825b6b" Mar 16 17:19:23 crc kubenswrapper[5120]: I0316 17:19:23.355686 5120 scope.go:117] "RemoveContainer" containerID="c7a15f2dd536b583d840c10d08618ee37e6801a618d7575bc6b9fb9b1e7d8be4" Mar 16 17:19:23 crc kubenswrapper[5120]: I0316 17:19:23.378042 5120 scope.go:117] "RemoveContainer" containerID="43c8a7153b84c826a75f8426d150a3e21304ab2c4678c238ce60d8e1835763b5" Mar 16 17:19:23 crc kubenswrapper[5120]: I0316 17:19:23.418170 5120 scope.go:117] "RemoveContainer" containerID="56d1057aacafb13d0c9477d7da43604cdb6a2b5cc1054b3958a6c858e53ff240" Mar 16 17:19:23 crc kubenswrapper[5120]: I0316 17:19:23.440349 5120 scope.go:117] "RemoveContainer" containerID="54ff405b70053abcc7ea2970d05cfd6e855792ad8dca4383b946f22647de4a03" Mar 16 17:19:23 crc kubenswrapper[5120]: I0316 17:19:23.457744 5120 scope.go:117] "RemoveContainer" containerID="1f305d3cc6ba203f42b9f60916dd473f8ddf20a228d06deb7866482ffd229f4a" Mar 16 17:19:24 crc kubenswrapper[5120]: I0316 17:19:24.563070 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/configure-network-edpm-compute-global-edpm-compute-global-9ss2s" Mar 16 17:19:24 crc kubenswrapper[5120]: I0316 17:19:24.669935 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/16d1cbb9-7339-4170-827c-1ff72424a7e6-inventory\") pod \"16d1cbb9-7339-4170-827c-1ff72424a7e6\" (UID: \"16d1cbb9-7339-4170-827c-1ff72424a7e6\") " Mar 16 17:19:24 crc kubenswrapper[5120]: I0316 17:19:24.670252 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d4wt9\" (UniqueName: \"kubernetes.io/projected/16d1cbb9-7339-4170-827c-1ff72424a7e6-kube-api-access-d4wt9\") pod \"16d1cbb9-7339-4170-827c-1ff72424a7e6\" (UID: \"16d1cbb9-7339-4170-827c-1ff72424a7e6\") " Mar 16 17:19:24 crc kubenswrapper[5120]: I0316 17:19:24.670418 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/16d1cbb9-7339-4170-827c-1ff72424a7e6-ssh-key-edpm-compute-global\") pod \"16d1cbb9-7339-4170-827c-1ff72424a7e6\" (UID: \"16d1cbb9-7339-4170-827c-1ff72424a7e6\") " Mar 16 17:19:24 crc kubenswrapper[5120]: I0316 17:19:24.677078 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16d1cbb9-7339-4170-827c-1ff72424a7e6-kube-api-access-d4wt9" (OuterVolumeSpecName: "kube-api-access-d4wt9") pod "16d1cbb9-7339-4170-827c-1ff72424a7e6" (UID: "16d1cbb9-7339-4170-827c-1ff72424a7e6"). InnerVolumeSpecName "kube-api-access-d4wt9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:19:24 crc kubenswrapper[5120]: I0316 17:19:24.689442 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/16d1cbb9-7339-4170-827c-1ff72424a7e6-ssh-key-edpm-compute-global" (OuterVolumeSpecName: "ssh-key-edpm-compute-global") pod "16d1cbb9-7339-4170-827c-1ff72424a7e6" (UID: "16d1cbb9-7339-4170-827c-1ff72424a7e6"). InnerVolumeSpecName "ssh-key-edpm-compute-global". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:19:24 crc kubenswrapper[5120]: I0316 17:19:24.692122 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/16d1cbb9-7339-4170-827c-1ff72424a7e6-inventory" (OuterVolumeSpecName: "inventory") pod "16d1cbb9-7339-4170-827c-1ff72424a7e6" (UID: "16d1cbb9-7339-4170-827c-1ff72424a7e6"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:19:24 crc kubenswrapper[5120]: I0316 17:19:24.773682 5120 reconciler_common.go:299] "Volume detached for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/16d1cbb9-7339-4170-827c-1ff72424a7e6-ssh-key-edpm-compute-global\") on node \"crc\" DevicePath \"\"" Mar 16 17:19:24 crc kubenswrapper[5120]: I0316 17:19:24.773714 5120 reconciler_common.go:299] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/16d1cbb9-7339-4170-827c-1ff72424a7e6-inventory\") on node \"crc\" DevicePath \"\"" Mar 16 17:19:24 crc kubenswrapper[5120]: I0316 17:19:24.773727 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d4wt9\" (UniqueName: \"kubernetes.io/projected/16d1cbb9-7339-4170-827c-1ff72424a7e6-kube-api-access-d4wt9\") on node \"crc\" DevicePath \"\"" Mar 16 17:19:25 crc kubenswrapper[5120]: I0316 17:19:25.305386 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/configure-network-edpm-compute-global-edpm-compute-global-9ss2s" event={"ID":"16d1cbb9-7339-4170-827c-1ff72424a7e6","Type":"ContainerDied","Data":"09b9f792d590cc6a1a050c39415ccdf39cb3d8ae644e353ce5116740841506c3"} Mar 16 17:19:25 crc kubenswrapper[5120]: I0316 17:19:25.305434 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="09b9f792d590cc6a1a050c39415ccdf39cb3d8ae644e353ce5116740841506c3" Mar 16 17:19:25 crc kubenswrapper[5120]: I0316 17:19:25.305453 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/configure-network-edpm-compute-global-edpm-compute-global-9ss2s" Mar 16 17:19:25 crc kubenswrapper[5120]: I0316 17:19:25.336396 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/validate-network-edpm-compute-global-edpm-compute-global-nqmf9"] Mar 16 17:19:25 crc kubenswrapper[5120]: I0316 17:19:25.337501 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16d1cbb9-7339-4170-827c-1ff72424a7e6" containerName="configure-network-edpm-compute-global-edpm-compute-global" Mar 16 17:19:25 crc kubenswrapper[5120]: I0316 17:19:25.337528 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="16d1cbb9-7339-4170-827c-1ff72424a7e6" containerName="configure-network-edpm-compute-global-edpm-compute-global" Mar 16 17:19:25 crc kubenswrapper[5120]: I0316 17:19:25.337775 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="16d1cbb9-7339-4170-827c-1ff72424a7e6" containerName="configure-network-edpm-compute-global-edpm-compute-global" Mar 16 17:19:25 crc kubenswrapper[5120]: I0316 17:19:25.362335 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/validate-network-edpm-compute-global-edpm-compute-global-nqmf9"] Mar 16 17:19:25 crc kubenswrapper[5120]: I0316 17:19:25.362459 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/validate-network-edpm-compute-global-edpm-compute-global-nqmf9" Mar 16 17:19:25 crc kubenswrapper[5120]: I0316 17:19:25.364732 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-aee-default-env\"" Mar 16 17:19:25 crc kubenswrapper[5120]: I0316 17:19:25.364970 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplane-ansible-ssh-private-key-secret\"" Mar 16 17:19:25 crc kubenswrapper[5120]: I0316 17:19:25.365701 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"edpm-compute-global-dockercfg-5hp85\"" Mar 16 17:19:25 crc kubenswrapper[5120]: I0316 17:19:25.365873 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplanenodeset-edpm-compute-global\"" Mar 16 17:19:25 crc kubenswrapper[5120]: I0316 17:19:25.485931 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/9751110f-a380-4ff1-b960-ec8ab627c38b-inventory\") pod \"validate-network-edpm-compute-global-edpm-compute-global-nqmf9\" (UID: \"9751110f-a380-4ff1-b960-ec8ab627c38b\") " pod="openstack-kuttl-tests/validate-network-edpm-compute-global-edpm-compute-global-nqmf9" Mar 16 17:19:25 crc kubenswrapper[5120]: I0316 17:19:25.486118 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/9751110f-a380-4ff1-b960-ec8ab627c38b-ssh-key-edpm-compute-global\") pod \"validate-network-edpm-compute-global-edpm-compute-global-nqmf9\" (UID: \"9751110f-a380-4ff1-b960-ec8ab627c38b\") " pod="openstack-kuttl-tests/validate-network-edpm-compute-global-edpm-compute-global-nqmf9" Mar 16 17:19:25 crc kubenswrapper[5120]: I0316 17:19:25.486577 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5hdm\" (UniqueName: \"kubernetes.io/projected/9751110f-a380-4ff1-b960-ec8ab627c38b-kube-api-access-m5hdm\") pod \"validate-network-edpm-compute-global-edpm-compute-global-nqmf9\" (UID: \"9751110f-a380-4ff1-b960-ec8ab627c38b\") " pod="openstack-kuttl-tests/validate-network-edpm-compute-global-edpm-compute-global-nqmf9" Mar 16 17:19:25 crc kubenswrapper[5120]: I0316 17:19:25.589060 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/9751110f-a380-4ff1-b960-ec8ab627c38b-inventory\") pod \"validate-network-edpm-compute-global-edpm-compute-global-nqmf9\" (UID: \"9751110f-a380-4ff1-b960-ec8ab627c38b\") " pod="openstack-kuttl-tests/validate-network-edpm-compute-global-edpm-compute-global-nqmf9" Mar 16 17:19:25 crc kubenswrapper[5120]: I0316 17:19:25.589376 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/9751110f-a380-4ff1-b960-ec8ab627c38b-ssh-key-edpm-compute-global\") pod \"validate-network-edpm-compute-global-edpm-compute-global-nqmf9\" (UID: \"9751110f-a380-4ff1-b960-ec8ab627c38b\") " pod="openstack-kuttl-tests/validate-network-edpm-compute-global-edpm-compute-global-nqmf9" Mar 16 17:19:25 crc kubenswrapper[5120]: I0316 17:19:25.589749 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m5hdm\" (UniqueName: \"kubernetes.io/projected/9751110f-a380-4ff1-b960-ec8ab627c38b-kube-api-access-m5hdm\") pod \"validate-network-edpm-compute-global-edpm-compute-global-nqmf9\" (UID: \"9751110f-a380-4ff1-b960-ec8ab627c38b\") " pod="openstack-kuttl-tests/validate-network-edpm-compute-global-edpm-compute-global-nqmf9" Mar 16 17:19:25 crc kubenswrapper[5120]: I0316 17:19:25.593525 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/9751110f-a380-4ff1-b960-ec8ab627c38b-inventory\") pod \"validate-network-edpm-compute-global-edpm-compute-global-nqmf9\" (UID: \"9751110f-a380-4ff1-b960-ec8ab627c38b\") " pod="openstack-kuttl-tests/validate-network-edpm-compute-global-edpm-compute-global-nqmf9" Mar 16 17:19:25 crc kubenswrapper[5120]: I0316 17:19:25.593637 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/9751110f-a380-4ff1-b960-ec8ab627c38b-ssh-key-edpm-compute-global\") pod \"validate-network-edpm-compute-global-edpm-compute-global-nqmf9\" (UID: \"9751110f-a380-4ff1-b960-ec8ab627c38b\") " pod="openstack-kuttl-tests/validate-network-edpm-compute-global-edpm-compute-global-nqmf9" Mar 16 17:19:25 crc kubenswrapper[5120]: I0316 17:19:25.609290 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5hdm\" (UniqueName: \"kubernetes.io/projected/9751110f-a380-4ff1-b960-ec8ab627c38b-kube-api-access-m5hdm\") pod \"validate-network-edpm-compute-global-edpm-compute-global-nqmf9\" (UID: \"9751110f-a380-4ff1-b960-ec8ab627c38b\") " pod="openstack-kuttl-tests/validate-network-edpm-compute-global-edpm-compute-global-nqmf9" Mar 16 17:19:25 crc kubenswrapper[5120]: I0316 17:19:25.678958 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/validate-network-edpm-compute-global-edpm-compute-global-nqmf9" Mar 16 17:19:26 crc kubenswrapper[5120]: I0316 17:19:26.092169 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/validate-network-edpm-compute-global-edpm-compute-global-nqmf9"] Mar 16 17:19:26 crc kubenswrapper[5120]: I0316 17:19:26.314108 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/validate-network-edpm-compute-global-edpm-compute-global-nqmf9" event={"ID":"9751110f-a380-4ff1-b960-ec8ab627c38b","Type":"ContainerStarted","Data":"bb9272e0bff6e090c2b0ec7332fe9686dc542d5c72950b8699aa2153ad965bce"} Mar 16 17:19:27 crc kubenswrapper[5120]: I0316 17:19:27.327292 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/validate-network-edpm-compute-global-edpm-compute-global-nqmf9" event={"ID":"9751110f-a380-4ff1-b960-ec8ab627c38b","Type":"ContainerStarted","Data":"edf0142e43bf0653aede30db255bd4e35294389f21bf03ada5c25f3e8881fa96"} Mar 16 17:19:27 crc kubenswrapper[5120]: I0316 17:19:27.344552 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/validate-network-edpm-compute-global-edpm-compute-global-nqmf9" podStartSLOduration=1.931257908 podStartE2EDuration="2.344528162s" podCreationTimestamp="2026-03-16 17:19:25 +0000 UTC" firstStartedPulling="2026-03-16 17:19:26.098403532 +0000 UTC m=+6468.252335189" lastFinishedPulling="2026-03-16 17:19:26.511673786 +0000 UTC m=+6468.665605443" observedRunningTime="2026-03-16 17:19:27.34223617 +0000 UTC m=+6469.496167827" watchObservedRunningTime="2026-03-16 17:19:27.344528162 +0000 UTC m=+6469.498459819" Mar 16 17:19:28 crc kubenswrapper[5120]: I0316 17:19:28.339586 5120 generic.go:358] "Generic (PLEG): container finished" podID="9751110f-a380-4ff1-b960-ec8ab627c38b" containerID="edf0142e43bf0653aede30db255bd4e35294389f21bf03ada5c25f3e8881fa96" exitCode=0 Mar 16 17:19:28 crc kubenswrapper[5120]: I0316 17:19:28.339914 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/validate-network-edpm-compute-global-edpm-compute-global-nqmf9" event={"ID":"9751110f-a380-4ff1-b960-ec8ab627c38b","Type":"ContainerDied","Data":"edf0142e43bf0653aede30db255bd4e35294389f21bf03ada5c25f3e8881fa96"} Mar 16 17:19:28 crc kubenswrapper[5120]: I0316 17:19:28.674377 5120 scope.go:117] "RemoveContainer" containerID="2ca61165dca6fdb30458423ef74c44c42b1b273e8fa504e89f5f9e186e516cc3" Mar 16 17:19:28 crc kubenswrapper[5120]: E0316 17:19:28.675175 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 17:19:29 crc kubenswrapper[5120]: I0316 17:19:29.648151 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/validate-network-edpm-compute-global-edpm-compute-global-nqmf9" Mar 16 17:19:29 crc kubenswrapper[5120]: I0316 17:19:29.676778 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m5hdm\" (UniqueName: \"kubernetes.io/projected/9751110f-a380-4ff1-b960-ec8ab627c38b-kube-api-access-m5hdm\") pod \"9751110f-a380-4ff1-b960-ec8ab627c38b\" (UID: \"9751110f-a380-4ff1-b960-ec8ab627c38b\") " Mar 16 17:19:29 crc kubenswrapper[5120]: I0316 17:19:29.676906 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/9751110f-a380-4ff1-b960-ec8ab627c38b-ssh-key-edpm-compute-global\") pod \"9751110f-a380-4ff1-b960-ec8ab627c38b\" (UID: \"9751110f-a380-4ff1-b960-ec8ab627c38b\") " Mar 16 17:19:29 crc kubenswrapper[5120]: I0316 17:19:29.677293 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/9751110f-a380-4ff1-b960-ec8ab627c38b-inventory\") pod \"9751110f-a380-4ff1-b960-ec8ab627c38b\" (UID: \"9751110f-a380-4ff1-b960-ec8ab627c38b\") " Mar 16 17:19:29 crc kubenswrapper[5120]: I0316 17:19:29.686201 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9751110f-a380-4ff1-b960-ec8ab627c38b-kube-api-access-m5hdm" (OuterVolumeSpecName: "kube-api-access-m5hdm") pod "9751110f-a380-4ff1-b960-ec8ab627c38b" (UID: "9751110f-a380-4ff1-b960-ec8ab627c38b"). InnerVolumeSpecName "kube-api-access-m5hdm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:19:29 crc kubenswrapper[5120]: I0316 17:19:29.701440 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9751110f-a380-4ff1-b960-ec8ab627c38b-inventory" (OuterVolumeSpecName: "inventory") pod "9751110f-a380-4ff1-b960-ec8ab627c38b" (UID: "9751110f-a380-4ff1-b960-ec8ab627c38b"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:19:29 crc kubenswrapper[5120]: I0316 17:19:29.704990 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9751110f-a380-4ff1-b960-ec8ab627c38b-ssh-key-edpm-compute-global" (OuterVolumeSpecName: "ssh-key-edpm-compute-global") pod "9751110f-a380-4ff1-b960-ec8ab627c38b" (UID: "9751110f-a380-4ff1-b960-ec8ab627c38b"). InnerVolumeSpecName "ssh-key-edpm-compute-global". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:19:29 crc kubenswrapper[5120]: I0316 17:19:29.780983 5120 reconciler_common.go:299] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/9751110f-a380-4ff1-b960-ec8ab627c38b-inventory\") on node \"crc\" DevicePath \"\"" Mar 16 17:19:29 crc kubenswrapper[5120]: I0316 17:19:29.781037 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m5hdm\" (UniqueName: \"kubernetes.io/projected/9751110f-a380-4ff1-b960-ec8ab627c38b-kube-api-access-m5hdm\") on node \"crc\" DevicePath \"\"" Mar 16 17:19:29 crc kubenswrapper[5120]: I0316 17:19:29.781058 5120 reconciler_common.go:299] "Volume detached for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/9751110f-a380-4ff1-b960-ec8ab627c38b-ssh-key-edpm-compute-global\") on node \"crc\" DevicePath \"\"" Mar 16 17:19:30 crc kubenswrapper[5120]: I0316 17:19:30.373844 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/validate-network-edpm-compute-global-edpm-compute-global-nqmf9" event={"ID":"9751110f-a380-4ff1-b960-ec8ab627c38b","Type":"ContainerDied","Data":"bb9272e0bff6e090c2b0ec7332fe9686dc542d5c72950b8699aa2153ad965bce"} Mar 16 17:19:30 crc kubenswrapper[5120]: I0316 17:19:30.374144 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bb9272e0bff6e090c2b0ec7332fe9686dc542d5c72950b8699aa2153ad965bce" Mar 16 17:19:30 crc kubenswrapper[5120]: I0316 17:19:30.374274 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/validate-network-edpm-compute-global-edpm-compute-global-nqmf9" Mar 16 17:19:30 crc kubenswrapper[5120]: I0316 17:19:30.430962 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/install-os-edpm-compute-global-edpm-compute-global-k8htx"] Mar 16 17:19:30 crc kubenswrapper[5120]: I0316 17:19:30.433419 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9751110f-a380-4ff1-b960-ec8ab627c38b" containerName="validate-network-edpm-compute-global-edpm-compute-global" Mar 16 17:19:30 crc kubenswrapper[5120]: I0316 17:19:30.433452 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9751110f-a380-4ff1-b960-ec8ab627c38b" containerName="validate-network-edpm-compute-global-edpm-compute-global" Mar 16 17:19:30 crc kubenswrapper[5120]: I0316 17:19:30.433637 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="9751110f-a380-4ff1-b960-ec8ab627c38b" containerName="validate-network-edpm-compute-global-edpm-compute-global" Mar 16 17:19:30 crc kubenswrapper[5120]: I0316 17:19:30.439738 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/install-os-edpm-compute-global-edpm-compute-global-k8htx" Mar 16 17:19:30 crc kubenswrapper[5120]: I0316 17:19:30.440727 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/install-os-edpm-compute-global-edpm-compute-global-k8htx"] Mar 16 17:19:30 crc kubenswrapper[5120]: I0316 17:19:30.442315 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-aee-default-env\"" Mar 16 17:19:30 crc kubenswrapper[5120]: I0316 17:19:30.443367 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplane-ansible-ssh-private-key-secret\"" Mar 16 17:19:30 crc kubenswrapper[5120]: I0316 17:19:30.443630 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"edpm-compute-global-dockercfg-5hp85\"" Mar 16 17:19:30 crc kubenswrapper[5120]: I0316 17:19:30.443800 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplanenodeset-edpm-compute-global\"" Mar 16 17:19:30 crc kubenswrapper[5120]: I0316 17:19:30.496958 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/baa0fd9c-149b-4767-862c-ee0d588d8508-ssh-key-edpm-compute-global\") pod \"install-os-edpm-compute-global-edpm-compute-global-k8htx\" (UID: \"baa0fd9c-149b-4767-862c-ee0d588d8508\") " pod="openstack-kuttl-tests/install-os-edpm-compute-global-edpm-compute-global-k8htx" Mar 16 17:19:30 crc kubenswrapper[5120]: I0316 17:19:30.497198 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/baa0fd9c-149b-4767-862c-ee0d588d8508-inventory\") pod \"install-os-edpm-compute-global-edpm-compute-global-k8htx\" (UID: \"baa0fd9c-149b-4767-862c-ee0d588d8508\") " pod="openstack-kuttl-tests/install-os-edpm-compute-global-edpm-compute-global-k8htx" Mar 16 17:19:30 crc kubenswrapper[5120]: I0316 17:19:30.497444 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fh96r\" (UniqueName: \"kubernetes.io/projected/baa0fd9c-149b-4767-862c-ee0d588d8508-kube-api-access-fh96r\") pod \"install-os-edpm-compute-global-edpm-compute-global-k8htx\" (UID: \"baa0fd9c-149b-4767-862c-ee0d588d8508\") " pod="openstack-kuttl-tests/install-os-edpm-compute-global-edpm-compute-global-k8htx" Mar 16 17:19:30 crc kubenswrapper[5120]: I0316 17:19:30.600899 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fh96r\" (UniqueName: \"kubernetes.io/projected/baa0fd9c-149b-4767-862c-ee0d588d8508-kube-api-access-fh96r\") pod \"install-os-edpm-compute-global-edpm-compute-global-k8htx\" (UID: \"baa0fd9c-149b-4767-862c-ee0d588d8508\") " pod="openstack-kuttl-tests/install-os-edpm-compute-global-edpm-compute-global-k8htx" Mar 16 17:19:30 crc kubenswrapper[5120]: I0316 17:19:30.601316 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/baa0fd9c-149b-4767-862c-ee0d588d8508-ssh-key-edpm-compute-global\") pod \"install-os-edpm-compute-global-edpm-compute-global-k8htx\" (UID: \"baa0fd9c-149b-4767-862c-ee0d588d8508\") " pod="openstack-kuttl-tests/install-os-edpm-compute-global-edpm-compute-global-k8htx" Mar 16 17:19:30 crc kubenswrapper[5120]: I0316 17:19:30.601467 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/baa0fd9c-149b-4767-862c-ee0d588d8508-inventory\") pod \"install-os-edpm-compute-global-edpm-compute-global-k8htx\" (UID: \"baa0fd9c-149b-4767-862c-ee0d588d8508\") " pod="openstack-kuttl-tests/install-os-edpm-compute-global-edpm-compute-global-k8htx" Mar 16 17:19:30 crc kubenswrapper[5120]: I0316 17:19:30.607429 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/baa0fd9c-149b-4767-862c-ee0d588d8508-ssh-key-edpm-compute-global\") pod \"install-os-edpm-compute-global-edpm-compute-global-k8htx\" (UID: \"baa0fd9c-149b-4767-862c-ee0d588d8508\") " pod="openstack-kuttl-tests/install-os-edpm-compute-global-edpm-compute-global-k8htx" Mar 16 17:19:30 crc kubenswrapper[5120]: I0316 17:19:30.607437 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/baa0fd9c-149b-4767-862c-ee0d588d8508-inventory\") pod \"install-os-edpm-compute-global-edpm-compute-global-k8htx\" (UID: \"baa0fd9c-149b-4767-862c-ee0d588d8508\") " pod="openstack-kuttl-tests/install-os-edpm-compute-global-edpm-compute-global-k8htx" Mar 16 17:19:30 crc kubenswrapper[5120]: I0316 17:19:30.622027 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fh96r\" (UniqueName: \"kubernetes.io/projected/baa0fd9c-149b-4767-862c-ee0d588d8508-kube-api-access-fh96r\") pod \"install-os-edpm-compute-global-edpm-compute-global-k8htx\" (UID: \"baa0fd9c-149b-4767-862c-ee0d588d8508\") " pod="openstack-kuttl-tests/install-os-edpm-compute-global-edpm-compute-global-k8htx" Mar 16 17:19:30 crc kubenswrapper[5120]: I0316 17:19:30.757646 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/install-os-edpm-compute-global-edpm-compute-global-k8htx" Mar 16 17:19:31 crc kubenswrapper[5120]: I0316 17:19:31.229285 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/install-os-edpm-compute-global-edpm-compute-global-k8htx"] Mar 16 17:19:31 crc kubenswrapper[5120]: W0316 17:19:31.233185 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbaa0fd9c_149b_4767_862c_ee0d588d8508.slice/crio-6537b39aa27bde23ae773b73606368f1eadb6a37a64ba2b76d54a4ddc64c50d5 WatchSource:0}: Error finding container 6537b39aa27bde23ae773b73606368f1eadb6a37a64ba2b76d54a4ddc64c50d5: Status 404 returned error can't find the container with id 6537b39aa27bde23ae773b73606368f1eadb6a37a64ba2b76d54a4ddc64c50d5 Mar 16 17:19:31 crc kubenswrapper[5120]: I0316 17:19:31.383364 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/install-os-edpm-compute-global-edpm-compute-global-k8htx" event={"ID":"baa0fd9c-149b-4767-862c-ee0d588d8508","Type":"ContainerStarted","Data":"6537b39aa27bde23ae773b73606368f1eadb6a37a64ba2b76d54a4ddc64c50d5"} Mar 16 17:19:32 crc kubenswrapper[5120]: I0316 17:19:32.396466 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/install-os-edpm-compute-global-edpm-compute-global-k8htx" event={"ID":"baa0fd9c-149b-4767-862c-ee0d588d8508","Type":"ContainerStarted","Data":"322747eda9006ff7d4e59e8a9356f5618021dd3ac30ec9a64b848d4659e0faa8"} Mar 16 17:19:32 crc kubenswrapper[5120]: I0316 17:19:32.422694 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/install-os-edpm-compute-global-edpm-compute-global-k8htx" podStartSLOduration=2.019113156 podStartE2EDuration="2.422668893s" podCreationTimestamp="2026-03-16 17:19:30 +0000 UTC" firstStartedPulling="2026-03-16 17:19:31.234804935 +0000 UTC m=+6473.388736592" lastFinishedPulling="2026-03-16 17:19:31.638360672 +0000 UTC m=+6473.792292329" observedRunningTime="2026-03-16 17:19:32.414878841 +0000 UTC m=+6474.568810508" watchObservedRunningTime="2026-03-16 17:19:32.422668893 +0000 UTC m=+6474.576600550" Mar 16 17:19:33 crc kubenswrapper[5120]: I0316 17:19:33.406537 5120 generic.go:358] "Generic (PLEG): container finished" podID="baa0fd9c-149b-4767-862c-ee0d588d8508" containerID="322747eda9006ff7d4e59e8a9356f5618021dd3ac30ec9a64b848d4659e0faa8" exitCode=0 Mar 16 17:19:33 crc kubenswrapper[5120]: I0316 17:19:33.406607 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/install-os-edpm-compute-global-edpm-compute-global-k8htx" event={"ID":"baa0fd9c-149b-4767-862c-ee0d588d8508","Type":"ContainerDied","Data":"322747eda9006ff7d4e59e8a9356f5618021dd3ac30ec9a64b848d4659e0faa8"} Mar 16 17:19:34 crc kubenswrapper[5120]: I0316 17:19:34.689787 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/install-os-edpm-compute-global-edpm-compute-global-k8htx" Mar 16 17:19:34 crc kubenswrapper[5120]: I0316 17:19:34.797309 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/baa0fd9c-149b-4767-862c-ee0d588d8508-inventory\") pod \"baa0fd9c-149b-4767-862c-ee0d588d8508\" (UID: \"baa0fd9c-149b-4767-862c-ee0d588d8508\") " Mar 16 17:19:34 crc kubenswrapper[5120]: I0316 17:19:34.797612 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fh96r\" (UniqueName: \"kubernetes.io/projected/baa0fd9c-149b-4767-862c-ee0d588d8508-kube-api-access-fh96r\") pod \"baa0fd9c-149b-4767-862c-ee0d588d8508\" (UID: \"baa0fd9c-149b-4767-862c-ee0d588d8508\") " Mar 16 17:19:34 crc kubenswrapper[5120]: I0316 17:19:34.798443 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/baa0fd9c-149b-4767-862c-ee0d588d8508-ssh-key-edpm-compute-global\") pod \"baa0fd9c-149b-4767-862c-ee0d588d8508\" (UID: \"baa0fd9c-149b-4767-862c-ee0d588d8508\") " Mar 16 17:19:34 crc kubenswrapper[5120]: I0316 17:19:34.803740 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/baa0fd9c-149b-4767-862c-ee0d588d8508-kube-api-access-fh96r" (OuterVolumeSpecName: "kube-api-access-fh96r") pod "baa0fd9c-149b-4767-862c-ee0d588d8508" (UID: "baa0fd9c-149b-4767-862c-ee0d588d8508"). InnerVolumeSpecName "kube-api-access-fh96r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:19:34 crc kubenswrapper[5120]: I0316 17:19:34.818782 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/baa0fd9c-149b-4767-862c-ee0d588d8508-inventory" (OuterVolumeSpecName: "inventory") pod "baa0fd9c-149b-4767-862c-ee0d588d8508" (UID: "baa0fd9c-149b-4767-862c-ee0d588d8508"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:19:34 crc kubenswrapper[5120]: I0316 17:19:34.820772 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/baa0fd9c-149b-4767-862c-ee0d588d8508-ssh-key-edpm-compute-global" (OuterVolumeSpecName: "ssh-key-edpm-compute-global") pod "baa0fd9c-149b-4767-862c-ee0d588d8508" (UID: "baa0fd9c-149b-4767-862c-ee0d588d8508"). InnerVolumeSpecName "ssh-key-edpm-compute-global". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:19:34 crc kubenswrapper[5120]: I0316 17:19:34.901436 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fh96r\" (UniqueName: \"kubernetes.io/projected/baa0fd9c-149b-4767-862c-ee0d588d8508-kube-api-access-fh96r\") on node \"crc\" DevicePath \"\"" Mar 16 17:19:34 crc kubenswrapper[5120]: I0316 17:19:34.901500 5120 reconciler_common.go:299] "Volume detached for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/baa0fd9c-149b-4767-862c-ee0d588d8508-ssh-key-edpm-compute-global\") on node \"crc\" DevicePath \"\"" Mar 16 17:19:34 crc kubenswrapper[5120]: I0316 17:19:34.901516 5120 reconciler_common.go:299] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/baa0fd9c-149b-4767-862c-ee0d588d8508-inventory\") on node \"crc\" DevicePath \"\"" Mar 16 17:19:35 crc kubenswrapper[5120]: I0316 17:19:35.428788 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/install-os-edpm-compute-global-edpm-compute-global-k8htx" Mar 16 17:19:35 crc kubenswrapper[5120]: I0316 17:19:35.428981 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/install-os-edpm-compute-global-edpm-compute-global-k8htx" event={"ID":"baa0fd9c-149b-4767-862c-ee0d588d8508","Type":"ContainerDied","Data":"6537b39aa27bde23ae773b73606368f1eadb6a37a64ba2b76d54a4ddc64c50d5"} Mar 16 17:19:35 crc kubenswrapper[5120]: I0316 17:19:35.429355 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6537b39aa27bde23ae773b73606368f1eadb6a37a64ba2b76d54a4ddc64c50d5" Mar 16 17:19:35 crc kubenswrapper[5120]: I0316 17:19:35.496253 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/configure-os-edpm-compute-global-edpm-compute-global-2q8w6"] Mar 16 17:19:35 crc kubenswrapper[5120]: I0316 17:19:35.497393 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="baa0fd9c-149b-4767-862c-ee0d588d8508" containerName="install-os-edpm-compute-global-edpm-compute-global" Mar 16 17:19:35 crc kubenswrapper[5120]: I0316 17:19:35.497419 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="baa0fd9c-149b-4767-862c-ee0d588d8508" containerName="install-os-edpm-compute-global-edpm-compute-global" Mar 16 17:19:35 crc kubenswrapper[5120]: I0316 17:19:35.497628 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="baa0fd9c-149b-4767-862c-ee0d588d8508" containerName="install-os-edpm-compute-global-edpm-compute-global" Mar 16 17:19:35 crc kubenswrapper[5120]: I0316 17:19:35.557136 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/configure-os-edpm-compute-global-edpm-compute-global-2q8w6" Mar 16 17:19:35 crc kubenswrapper[5120]: I0316 17:19:35.561219 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplane-ansible-ssh-private-key-secret\"" Mar 16 17:19:35 crc kubenswrapper[5120]: I0316 17:19:35.561306 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplanenodeset-edpm-compute-global\"" Mar 16 17:19:35 crc kubenswrapper[5120]: I0316 17:19:35.561454 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-aee-default-env\"" Mar 16 17:19:35 crc kubenswrapper[5120]: I0316 17:19:35.561603 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"edpm-compute-global-dockercfg-5hp85\"" Mar 16 17:19:35 crc kubenswrapper[5120]: I0316 17:19:35.567882 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/configure-os-edpm-compute-global-edpm-compute-global-2q8w6"] Mar 16 17:19:35 crc kubenswrapper[5120]: I0316 17:19:35.750436 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjmsv\" (UniqueName: \"kubernetes.io/projected/300a1e4b-8fc3-42f8-9188-ff87d21d71bc-kube-api-access-bjmsv\") pod \"configure-os-edpm-compute-global-edpm-compute-global-2q8w6\" (UID: \"300a1e4b-8fc3-42f8-9188-ff87d21d71bc\") " pod="openstack-kuttl-tests/configure-os-edpm-compute-global-edpm-compute-global-2q8w6" Mar 16 17:19:35 crc kubenswrapper[5120]: I0316 17:19:35.750505 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/300a1e4b-8fc3-42f8-9188-ff87d21d71bc-inventory\") pod \"configure-os-edpm-compute-global-edpm-compute-global-2q8w6\" (UID: \"300a1e4b-8fc3-42f8-9188-ff87d21d71bc\") " pod="openstack-kuttl-tests/configure-os-edpm-compute-global-edpm-compute-global-2q8w6" Mar 16 17:19:35 crc kubenswrapper[5120]: I0316 17:19:35.750529 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/300a1e4b-8fc3-42f8-9188-ff87d21d71bc-ssh-key-edpm-compute-global\") pod \"configure-os-edpm-compute-global-edpm-compute-global-2q8w6\" (UID: \"300a1e4b-8fc3-42f8-9188-ff87d21d71bc\") " pod="openstack-kuttl-tests/configure-os-edpm-compute-global-edpm-compute-global-2q8w6" Mar 16 17:19:35 crc kubenswrapper[5120]: I0316 17:19:35.853182 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bjmsv\" (UniqueName: \"kubernetes.io/projected/300a1e4b-8fc3-42f8-9188-ff87d21d71bc-kube-api-access-bjmsv\") pod \"configure-os-edpm-compute-global-edpm-compute-global-2q8w6\" (UID: \"300a1e4b-8fc3-42f8-9188-ff87d21d71bc\") " pod="openstack-kuttl-tests/configure-os-edpm-compute-global-edpm-compute-global-2q8w6" Mar 16 17:19:35 crc kubenswrapper[5120]: I0316 17:19:35.853291 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/300a1e4b-8fc3-42f8-9188-ff87d21d71bc-inventory\") pod \"configure-os-edpm-compute-global-edpm-compute-global-2q8w6\" (UID: \"300a1e4b-8fc3-42f8-9188-ff87d21d71bc\") " pod="openstack-kuttl-tests/configure-os-edpm-compute-global-edpm-compute-global-2q8w6" Mar 16 17:19:35 crc kubenswrapper[5120]: I0316 17:19:35.853326 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/300a1e4b-8fc3-42f8-9188-ff87d21d71bc-ssh-key-edpm-compute-global\") pod \"configure-os-edpm-compute-global-edpm-compute-global-2q8w6\" (UID: \"300a1e4b-8fc3-42f8-9188-ff87d21d71bc\") " pod="openstack-kuttl-tests/configure-os-edpm-compute-global-edpm-compute-global-2q8w6" Mar 16 17:19:35 crc kubenswrapper[5120]: I0316 17:19:35.860681 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/300a1e4b-8fc3-42f8-9188-ff87d21d71bc-inventory\") pod \"configure-os-edpm-compute-global-edpm-compute-global-2q8w6\" (UID: \"300a1e4b-8fc3-42f8-9188-ff87d21d71bc\") " pod="openstack-kuttl-tests/configure-os-edpm-compute-global-edpm-compute-global-2q8w6" Mar 16 17:19:35 crc kubenswrapper[5120]: I0316 17:19:35.870192 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjmsv\" (UniqueName: \"kubernetes.io/projected/300a1e4b-8fc3-42f8-9188-ff87d21d71bc-kube-api-access-bjmsv\") pod \"configure-os-edpm-compute-global-edpm-compute-global-2q8w6\" (UID: \"300a1e4b-8fc3-42f8-9188-ff87d21d71bc\") " pod="openstack-kuttl-tests/configure-os-edpm-compute-global-edpm-compute-global-2q8w6" Mar 16 17:19:35 crc kubenswrapper[5120]: I0316 17:19:35.875821 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/300a1e4b-8fc3-42f8-9188-ff87d21d71bc-ssh-key-edpm-compute-global\") pod \"configure-os-edpm-compute-global-edpm-compute-global-2q8w6\" (UID: \"300a1e4b-8fc3-42f8-9188-ff87d21d71bc\") " pod="openstack-kuttl-tests/configure-os-edpm-compute-global-edpm-compute-global-2q8w6" Mar 16 17:19:35 crc kubenswrapper[5120]: I0316 17:19:35.876145 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/configure-os-edpm-compute-global-edpm-compute-global-2q8w6" Mar 16 17:19:36 crc kubenswrapper[5120]: I0316 17:19:36.110659 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/configure-os-edpm-compute-global-edpm-compute-global-2q8w6"] Mar 16 17:19:36 crc kubenswrapper[5120]: W0316 17:19:36.116150 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod300a1e4b_8fc3_42f8_9188_ff87d21d71bc.slice/crio-2827992b0364aba209eb353466c4b1ac128d144b1a13ab11ae597603d0b8c70c WatchSource:0}: Error finding container 2827992b0364aba209eb353466c4b1ac128d144b1a13ab11ae597603d0b8c70c: Status 404 returned error can't find the container with id 2827992b0364aba209eb353466c4b1ac128d144b1a13ab11ae597603d0b8c70c Mar 16 17:19:36 crc kubenswrapper[5120]: I0316 17:19:36.438184 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/configure-os-edpm-compute-global-edpm-compute-global-2q8w6" event={"ID":"300a1e4b-8fc3-42f8-9188-ff87d21d71bc","Type":"ContainerStarted","Data":"2827992b0364aba209eb353466c4b1ac128d144b1a13ab11ae597603d0b8c70c"} Mar 16 17:19:37 crc kubenswrapper[5120]: I0316 17:19:37.449813 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/configure-os-edpm-compute-global-edpm-compute-global-2q8w6" event={"ID":"300a1e4b-8fc3-42f8-9188-ff87d21d71bc","Type":"ContainerStarted","Data":"041aa7f84ae7bfe944b6f83c5472e2c8858b115a6774424595ed0bb7b87d32d0"} Mar 16 17:19:37 crc kubenswrapper[5120]: I0316 17:19:37.474461 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/configure-os-edpm-compute-global-edpm-compute-global-2q8w6" podStartSLOduration=2.081999239 podStartE2EDuration="2.474441223s" podCreationTimestamp="2026-03-16 17:19:35 +0000 UTC" firstStartedPulling="2026-03-16 17:19:36.118453011 +0000 UTC m=+6478.272384678" lastFinishedPulling="2026-03-16 17:19:36.510895005 +0000 UTC m=+6478.664826662" observedRunningTime="2026-03-16 17:19:37.470901797 +0000 UTC m=+6479.624833454" watchObservedRunningTime="2026-03-16 17:19:37.474441223 +0000 UTC m=+6479.628372880" Mar 16 17:19:38 crc kubenswrapper[5120]: I0316 17:19:38.458519 5120 generic.go:358] "Generic (PLEG): container finished" podID="300a1e4b-8fc3-42f8-9188-ff87d21d71bc" containerID="041aa7f84ae7bfe944b6f83c5472e2c8858b115a6774424595ed0bb7b87d32d0" exitCode=0 Mar 16 17:19:38 crc kubenswrapper[5120]: I0316 17:19:38.458728 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/configure-os-edpm-compute-global-edpm-compute-global-2q8w6" event={"ID":"300a1e4b-8fc3-42f8-9188-ff87d21d71bc","Type":"ContainerDied","Data":"041aa7f84ae7bfe944b6f83c5472e2c8858b115a6774424595ed0bb7b87d32d0"} Mar 16 17:19:39 crc kubenswrapper[5120]: I0316 17:19:39.720799 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/configure-os-edpm-compute-global-edpm-compute-global-2q8w6" Mar 16 17:19:39 crc kubenswrapper[5120]: I0316 17:19:39.836925 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/300a1e4b-8fc3-42f8-9188-ff87d21d71bc-inventory\") pod \"300a1e4b-8fc3-42f8-9188-ff87d21d71bc\" (UID: \"300a1e4b-8fc3-42f8-9188-ff87d21d71bc\") " Mar 16 17:19:39 crc kubenswrapper[5120]: I0316 17:19:39.837218 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/300a1e4b-8fc3-42f8-9188-ff87d21d71bc-ssh-key-edpm-compute-global\") pod \"300a1e4b-8fc3-42f8-9188-ff87d21d71bc\" (UID: \"300a1e4b-8fc3-42f8-9188-ff87d21d71bc\") " Mar 16 17:19:39 crc kubenswrapper[5120]: I0316 17:19:39.837484 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bjmsv\" (UniqueName: \"kubernetes.io/projected/300a1e4b-8fc3-42f8-9188-ff87d21d71bc-kube-api-access-bjmsv\") pod \"300a1e4b-8fc3-42f8-9188-ff87d21d71bc\" (UID: \"300a1e4b-8fc3-42f8-9188-ff87d21d71bc\") " Mar 16 17:19:39 crc kubenswrapper[5120]: I0316 17:19:39.842691 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/300a1e4b-8fc3-42f8-9188-ff87d21d71bc-kube-api-access-bjmsv" (OuterVolumeSpecName: "kube-api-access-bjmsv") pod "300a1e4b-8fc3-42f8-9188-ff87d21d71bc" (UID: "300a1e4b-8fc3-42f8-9188-ff87d21d71bc"). InnerVolumeSpecName "kube-api-access-bjmsv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:19:39 crc kubenswrapper[5120]: I0316 17:19:39.857415 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/300a1e4b-8fc3-42f8-9188-ff87d21d71bc-inventory" (OuterVolumeSpecName: "inventory") pod "300a1e4b-8fc3-42f8-9188-ff87d21d71bc" (UID: "300a1e4b-8fc3-42f8-9188-ff87d21d71bc"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:19:39 crc kubenswrapper[5120]: I0316 17:19:39.858558 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/300a1e4b-8fc3-42f8-9188-ff87d21d71bc-ssh-key-edpm-compute-global" (OuterVolumeSpecName: "ssh-key-edpm-compute-global") pod "300a1e4b-8fc3-42f8-9188-ff87d21d71bc" (UID: "300a1e4b-8fc3-42f8-9188-ff87d21d71bc"). InnerVolumeSpecName "ssh-key-edpm-compute-global". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:19:39 crc kubenswrapper[5120]: I0316 17:19:39.939833 5120 reconciler_common.go:299] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/300a1e4b-8fc3-42f8-9188-ff87d21d71bc-inventory\") on node \"crc\" DevicePath \"\"" Mar 16 17:19:39 crc kubenswrapper[5120]: I0316 17:19:39.939868 5120 reconciler_common.go:299] "Volume detached for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/300a1e4b-8fc3-42f8-9188-ff87d21d71bc-ssh-key-edpm-compute-global\") on node \"crc\" DevicePath \"\"" Mar 16 17:19:39 crc kubenswrapper[5120]: I0316 17:19:39.939880 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bjmsv\" (UniqueName: \"kubernetes.io/projected/300a1e4b-8fc3-42f8-9188-ff87d21d71bc-kube-api-access-bjmsv\") on node \"crc\" DevicePath \"\"" Mar 16 17:19:40 crc kubenswrapper[5120]: I0316 17:19:40.479234 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/configure-os-edpm-compute-global-edpm-compute-global-2q8w6" Mar 16 17:19:40 crc kubenswrapper[5120]: I0316 17:19:40.479281 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/configure-os-edpm-compute-global-edpm-compute-global-2q8w6" event={"ID":"300a1e4b-8fc3-42f8-9188-ff87d21d71bc","Type":"ContainerDied","Data":"2827992b0364aba209eb353466c4b1ac128d144b1a13ab11ae597603d0b8c70c"} Mar 16 17:19:40 crc kubenswrapper[5120]: I0316 17:19:40.479324 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2827992b0364aba209eb353466c4b1ac128d144b1a13ab11ae597603d0b8c70c" Mar 16 17:19:40 crc kubenswrapper[5120]: I0316 17:19:40.786306 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/run-os-edpm-compute-global-edpm-compute-global-ph77t"] Mar 16 17:19:40 crc kubenswrapper[5120]: I0316 17:19:40.787444 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="300a1e4b-8fc3-42f8-9188-ff87d21d71bc" containerName="configure-os-edpm-compute-global-edpm-compute-global" Mar 16 17:19:40 crc kubenswrapper[5120]: I0316 17:19:40.787466 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="300a1e4b-8fc3-42f8-9188-ff87d21d71bc" containerName="configure-os-edpm-compute-global-edpm-compute-global" Mar 16 17:19:40 crc kubenswrapper[5120]: I0316 17:19:40.787645 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="300a1e4b-8fc3-42f8-9188-ff87d21d71bc" containerName="configure-os-edpm-compute-global-edpm-compute-global" Mar 16 17:19:40 crc kubenswrapper[5120]: I0316 17:19:40.798298 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/run-os-edpm-compute-global-edpm-compute-global-ph77t"] Mar 16 17:19:40 crc kubenswrapper[5120]: I0316 17:19:40.798451 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/run-os-edpm-compute-global-edpm-compute-global-ph77t" Mar 16 17:19:40 crc kubenswrapper[5120]: I0316 17:19:40.804121 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-aee-default-env\"" Mar 16 17:19:40 crc kubenswrapper[5120]: I0316 17:19:40.804300 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplane-ansible-ssh-private-key-secret\"" Mar 16 17:19:40 crc kubenswrapper[5120]: I0316 17:19:40.804477 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"edpm-compute-global-dockercfg-5hp85\"" Mar 16 17:19:40 crc kubenswrapper[5120]: I0316 17:19:40.804711 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplanenodeset-edpm-compute-global\"" Mar 16 17:19:40 crc kubenswrapper[5120]: I0316 17:19:40.863195 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzhms\" (UniqueName: \"kubernetes.io/projected/aa71ee8f-8be3-47d7-ad6c-2d1dd72e0d45-kube-api-access-tzhms\") pod \"run-os-edpm-compute-global-edpm-compute-global-ph77t\" (UID: \"aa71ee8f-8be3-47d7-ad6c-2d1dd72e0d45\") " pod="openstack-kuttl-tests/run-os-edpm-compute-global-edpm-compute-global-ph77t" Mar 16 17:19:40 crc kubenswrapper[5120]: I0316 17:19:40.863249 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/aa71ee8f-8be3-47d7-ad6c-2d1dd72e0d45-inventory\") pod \"run-os-edpm-compute-global-edpm-compute-global-ph77t\" (UID: \"aa71ee8f-8be3-47d7-ad6c-2d1dd72e0d45\") " pod="openstack-kuttl-tests/run-os-edpm-compute-global-edpm-compute-global-ph77t" Mar 16 17:19:40 crc kubenswrapper[5120]: I0316 17:19:40.863396 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/aa71ee8f-8be3-47d7-ad6c-2d1dd72e0d45-ssh-key-edpm-compute-global\") pod \"run-os-edpm-compute-global-edpm-compute-global-ph77t\" (UID: \"aa71ee8f-8be3-47d7-ad6c-2d1dd72e0d45\") " pod="openstack-kuttl-tests/run-os-edpm-compute-global-edpm-compute-global-ph77t" Mar 16 17:19:40 crc kubenswrapper[5120]: I0316 17:19:40.965070 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/aa71ee8f-8be3-47d7-ad6c-2d1dd72e0d45-ssh-key-edpm-compute-global\") pod \"run-os-edpm-compute-global-edpm-compute-global-ph77t\" (UID: \"aa71ee8f-8be3-47d7-ad6c-2d1dd72e0d45\") " pod="openstack-kuttl-tests/run-os-edpm-compute-global-edpm-compute-global-ph77t" Mar 16 17:19:40 crc kubenswrapper[5120]: I0316 17:19:40.965304 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tzhms\" (UniqueName: \"kubernetes.io/projected/aa71ee8f-8be3-47d7-ad6c-2d1dd72e0d45-kube-api-access-tzhms\") pod \"run-os-edpm-compute-global-edpm-compute-global-ph77t\" (UID: \"aa71ee8f-8be3-47d7-ad6c-2d1dd72e0d45\") " pod="openstack-kuttl-tests/run-os-edpm-compute-global-edpm-compute-global-ph77t" Mar 16 17:19:40 crc kubenswrapper[5120]: I0316 17:19:40.965353 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/aa71ee8f-8be3-47d7-ad6c-2d1dd72e0d45-inventory\") pod \"run-os-edpm-compute-global-edpm-compute-global-ph77t\" (UID: \"aa71ee8f-8be3-47d7-ad6c-2d1dd72e0d45\") " pod="openstack-kuttl-tests/run-os-edpm-compute-global-edpm-compute-global-ph77t" Mar 16 17:19:40 crc kubenswrapper[5120]: I0316 17:19:40.969638 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/aa71ee8f-8be3-47d7-ad6c-2d1dd72e0d45-ssh-key-edpm-compute-global\") pod \"run-os-edpm-compute-global-edpm-compute-global-ph77t\" (UID: \"aa71ee8f-8be3-47d7-ad6c-2d1dd72e0d45\") " pod="openstack-kuttl-tests/run-os-edpm-compute-global-edpm-compute-global-ph77t" Mar 16 17:19:40 crc kubenswrapper[5120]: I0316 17:19:40.970370 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/aa71ee8f-8be3-47d7-ad6c-2d1dd72e0d45-inventory\") pod \"run-os-edpm-compute-global-edpm-compute-global-ph77t\" (UID: \"aa71ee8f-8be3-47d7-ad6c-2d1dd72e0d45\") " pod="openstack-kuttl-tests/run-os-edpm-compute-global-edpm-compute-global-ph77t" Mar 16 17:19:40 crc kubenswrapper[5120]: I0316 17:19:40.982752 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzhms\" (UniqueName: \"kubernetes.io/projected/aa71ee8f-8be3-47d7-ad6c-2d1dd72e0d45-kube-api-access-tzhms\") pod \"run-os-edpm-compute-global-edpm-compute-global-ph77t\" (UID: \"aa71ee8f-8be3-47d7-ad6c-2d1dd72e0d45\") " pod="openstack-kuttl-tests/run-os-edpm-compute-global-edpm-compute-global-ph77t" Mar 16 17:19:41 crc kubenswrapper[5120]: I0316 17:19:41.122419 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/run-os-edpm-compute-global-edpm-compute-global-ph77t" Mar 16 17:19:41 crc kubenswrapper[5120]: I0316 17:19:41.365129 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/run-os-edpm-compute-global-edpm-compute-global-ph77t"] Mar 16 17:19:41 crc kubenswrapper[5120]: W0316 17:19:41.369495 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaa71ee8f_8be3_47d7_ad6c_2d1dd72e0d45.slice/crio-9998712dd4ddee1becae2d7154e752ffe26aa26bee5e905491051edfe760ee91 WatchSource:0}: Error finding container 9998712dd4ddee1becae2d7154e752ffe26aa26bee5e905491051edfe760ee91: Status 404 returned error can't find the container with id 9998712dd4ddee1becae2d7154e752ffe26aa26bee5e905491051edfe760ee91 Mar 16 17:19:41 crc kubenswrapper[5120]: I0316 17:19:41.487400 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/run-os-edpm-compute-global-edpm-compute-global-ph77t" event={"ID":"aa71ee8f-8be3-47d7-ad6c-2d1dd72e0d45","Type":"ContainerStarted","Data":"9998712dd4ddee1becae2d7154e752ffe26aa26bee5e905491051edfe760ee91"} Mar 16 17:19:42 crc kubenswrapper[5120]: I0316 17:19:42.518490 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/run-os-edpm-compute-global-edpm-compute-global-ph77t" event={"ID":"aa71ee8f-8be3-47d7-ad6c-2d1dd72e0d45","Type":"ContainerStarted","Data":"5de07ced2092009f24435a75e942a466fe117b36b986a84740cbae9ef7397abb"} Mar 16 17:19:42 crc kubenswrapper[5120]: I0316 17:19:42.536612 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/run-os-edpm-compute-global-edpm-compute-global-ph77t" podStartSLOduration=2.119306236 podStartE2EDuration="2.536593828s" podCreationTimestamp="2026-03-16 17:19:40 +0000 UTC" firstStartedPulling="2026-03-16 17:19:41.371169482 +0000 UTC m=+6483.525101129" lastFinishedPulling="2026-03-16 17:19:41.788457064 +0000 UTC m=+6483.942388721" observedRunningTime="2026-03-16 17:19:42.532218938 +0000 UTC m=+6484.686150595" watchObservedRunningTime="2026-03-16 17:19:42.536593828 +0000 UTC m=+6484.690525485" Mar 16 17:19:43 crc kubenswrapper[5120]: I0316 17:19:43.526889 5120 generic.go:358] "Generic (PLEG): container finished" podID="aa71ee8f-8be3-47d7-ad6c-2d1dd72e0d45" containerID="5de07ced2092009f24435a75e942a466fe117b36b986a84740cbae9ef7397abb" exitCode=0 Mar 16 17:19:43 crc kubenswrapper[5120]: I0316 17:19:43.526947 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/run-os-edpm-compute-global-edpm-compute-global-ph77t" event={"ID":"aa71ee8f-8be3-47d7-ad6c-2d1dd72e0d45","Type":"ContainerDied","Data":"5de07ced2092009f24435a75e942a466fe117b36b986a84740cbae9ef7397abb"} Mar 16 17:19:43 crc kubenswrapper[5120]: I0316 17:19:43.664175 5120 scope.go:117] "RemoveContainer" containerID="2ca61165dca6fdb30458423ef74c44c42b1b273e8fa504e89f5f9e186e516cc3" Mar 16 17:19:43 crc kubenswrapper[5120]: E0316 17:19:43.664469 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 17:19:44 crc kubenswrapper[5120]: I0316 17:19:44.825024 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/run-os-edpm-compute-global-edpm-compute-global-ph77t" Mar 16 17:19:44 crc kubenswrapper[5120]: I0316 17:19:44.904255 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/aa71ee8f-8be3-47d7-ad6c-2d1dd72e0d45-inventory\") pod \"aa71ee8f-8be3-47d7-ad6c-2d1dd72e0d45\" (UID: \"aa71ee8f-8be3-47d7-ad6c-2d1dd72e0d45\") " Mar 16 17:19:44 crc kubenswrapper[5120]: I0316 17:19:44.904369 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/aa71ee8f-8be3-47d7-ad6c-2d1dd72e0d45-ssh-key-edpm-compute-global\") pod \"aa71ee8f-8be3-47d7-ad6c-2d1dd72e0d45\" (UID: \"aa71ee8f-8be3-47d7-ad6c-2d1dd72e0d45\") " Mar 16 17:19:44 crc kubenswrapper[5120]: I0316 17:19:44.904661 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tzhms\" (UniqueName: \"kubernetes.io/projected/aa71ee8f-8be3-47d7-ad6c-2d1dd72e0d45-kube-api-access-tzhms\") pod \"aa71ee8f-8be3-47d7-ad6c-2d1dd72e0d45\" (UID: \"aa71ee8f-8be3-47d7-ad6c-2d1dd72e0d45\") " Mar 16 17:19:44 crc kubenswrapper[5120]: I0316 17:19:44.917393 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa71ee8f-8be3-47d7-ad6c-2d1dd72e0d45-kube-api-access-tzhms" (OuterVolumeSpecName: "kube-api-access-tzhms") pod "aa71ee8f-8be3-47d7-ad6c-2d1dd72e0d45" (UID: "aa71ee8f-8be3-47d7-ad6c-2d1dd72e0d45"). InnerVolumeSpecName "kube-api-access-tzhms". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:19:44 crc kubenswrapper[5120]: I0316 17:19:44.926743 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aa71ee8f-8be3-47d7-ad6c-2d1dd72e0d45-inventory" (OuterVolumeSpecName: "inventory") pod "aa71ee8f-8be3-47d7-ad6c-2d1dd72e0d45" (UID: "aa71ee8f-8be3-47d7-ad6c-2d1dd72e0d45"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:19:44 crc kubenswrapper[5120]: I0316 17:19:44.930803 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aa71ee8f-8be3-47d7-ad6c-2d1dd72e0d45-ssh-key-edpm-compute-global" (OuterVolumeSpecName: "ssh-key-edpm-compute-global") pod "aa71ee8f-8be3-47d7-ad6c-2d1dd72e0d45" (UID: "aa71ee8f-8be3-47d7-ad6c-2d1dd72e0d45"). InnerVolumeSpecName "ssh-key-edpm-compute-global". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:19:45 crc kubenswrapper[5120]: I0316 17:19:45.007258 5120 reconciler_common.go:299] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/aa71ee8f-8be3-47d7-ad6c-2d1dd72e0d45-inventory\") on node \"crc\" DevicePath \"\"" Mar 16 17:19:45 crc kubenswrapper[5120]: I0316 17:19:45.007290 5120 reconciler_common.go:299] "Volume detached for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/aa71ee8f-8be3-47d7-ad6c-2d1dd72e0d45-ssh-key-edpm-compute-global\") on node \"crc\" DevicePath \"\"" Mar 16 17:19:45 crc kubenswrapper[5120]: I0316 17:19:45.007301 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tzhms\" (UniqueName: \"kubernetes.io/projected/aa71ee8f-8be3-47d7-ad6c-2d1dd72e0d45-kube-api-access-tzhms\") on node \"crc\" DevicePath \"\"" Mar 16 17:19:45 crc kubenswrapper[5120]: I0316 17:19:45.543243 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/run-os-edpm-compute-global-edpm-compute-global-ph77t" event={"ID":"aa71ee8f-8be3-47d7-ad6c-2d1dd72e0d45","Type":"ContainerDied","Data":"9998712dd4ddee1becae2d7154e752ffe26aa26bee5e905491051edfe760ee91"} Mar 16 17:19:45 crc kubenswrapper[5120]: I0316 17:19:45.543286 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9998712dd4ddee1becae2d7154e752ffe26aa26bee5e905491051edfe760ee91" Mar 16 17:19:45 crc kubenswrapper[5120]: I0316 17:19:45.543354 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/run-os-edpm-compute-global-edpm-compute-global-ph77t" Mar 16 17:19:45 crc kubenswrapper[5120]: I0316 17:19:45.606164 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/install-certs-edpm-compute-global-edpm-compute-global-wld47"] Mar 16 17:19:45 crc kubenswrapper[5120]: I0316 17:19:45.607119 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa71ee8f-8be3-47d7-ad6c-2d1dd72e0d45" containerName="run-os-edpm-compute-global-edpm-compute-global" Mar 16 17:19:45 crc kubenswrapper[5120]: I0316 17:19:45.607143 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa71ee8f-8be3-47d7-ad6c-2d1dd72e0d45" containerName="run-os-edpm-compute-global-edpm-compute-global" Mar 16 17:19:45 crc kubenswrapper[5120]: I0316 17:19:45.607297 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="aa71ee8f-8be3-47d7-ad6c-2d1dd72e0d45" containerName="run-os-edpm-compute-global-edpm-compute-global" Mar 16 17:19:45 crc kubenswrapper[5120]: I0316 17:19:45.692459 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/install-certs-edpm-compute-global-edpm-compute-global-wld47"] Mar 16 17:19:45 crc kubenswrapper[5120]: I0316 17:19:45.692565 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/install-certs-edpm-compute-global-edpm-compute-global-wld47" Mar 16 17:19:45 crc kubenswrapper[5120]: I0316 17:19:45.694631 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"combined-ca-bundle\"" Mar 16 17:19:45 crc kubenswrapper[5120]: I0316 17:19:45.694628 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplanenodeset-edpm-compute-global\"" Mar 16 17:19:45 crc kubenswrapper[5120]: I0316 17:19:45.694700 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"edpm-compute-global-dockercfg-5hp85\"" Mar 16 17:19:45 crc kubenswrapper[5120]: I0316 17:19:45.695112 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-aee-default-env\"" Mar 16 17:19:45 crc kubenswrapper[5120]: I0316 17:19:45.696414 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplane-ansible-ssh-private-key-secret\"" Mar 16 17:19:45 crc kubenswrapper[5120]: I0316 17:19:45.721423 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7hq7\" (UniqueName: \"kubernetes.io/projected/527acda8-28c9-412c-b3a8-ce5749238659-kube-api-access-w7hq7\") pod \"install-certs-edpm-compute-global-edpm-compute-global-wld47\" (UID: \"527acda8-28c9-412c-b3a8-ce5749238659\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-global-edpm-compute-global-wld47" Mar 16 17:19:45 crc kubenswrapper[5120]: I0316 17:19:45.721466 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"neutron-ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/527acda8-28c9-412c-b3a8-ce5749238659-neutron-ovn-combined-ca-bundle\") pod \"install-certs-edpm-compute-global-edpm-compute-global-wld47\" (UID: \"527acda8-28c9-412c-b3a8-ce5749238659\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-global-edpm-compute-global-wld47" Mar 16 17:19:45 crc kubenswrapper[5120]: I0316 17:19:45.721494 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/527acda8-28c9-412c-b3a8-ce5749238659-ovn-combined-ca-bundle\") pod \"install-certs-edpm-compute-global-edpm-compute-global-wld47\" (UID: \"527acda8-28c9-412c-b3a8-ce5749238659\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-global-edpm-compute-global-wld47" Mar 16 17:19:45 crc kubenswrapper[5120]: I0316 17:19:45.721528 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/527acda8-28c9-412c-b3a8-ce5749238659-ssh-key-edpm-compute-global\") pod \"install-certs-edpm-compute-global-edpm-compute-global-wld47\" (UID: \"527acda8-28c9-412c-b3a8-ce5749238659\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-global-edpm-compute-global-wld47" Mar 16 17:19:45 crc kubenswrapper[5120]: I0316 17:19:45.721565 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/527acda8-28c9-412c-b3a8-ce5749238659-nova-combined-ca-bundle\") pod \"install-certs-edpm-compute-global-edpm-compute-global-wld47\" (UID: \"527acda8-28c9-412c-b3a8-ce5749238659\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-global-edpm-compute-global-wld47" Mar 16 17:19:45 crc kubenswrapper[5120]: I0316 17:19:45.721692 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"neutron-dhcp-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/527acda8-28c9-412c-b3a8-ce5749238659-neutron-dhcp-combined-ca-bundle\") pod \"install-certs-edpm-compute-global-edpm-compute-global-wld47\" (UID: \"527acda8-28c9-412c-b3a8-ce5749238659\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-global-edpm-compute-global-wld47" Mar 16 17:19:45 crc kubenswrapper[5120]: I0316 17:19:45.721788 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bootstrap-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/527acda8-28c9-412c-b3a8-ce5749238659-bootstrap-combined-ca-bundle\") pod \"install-certs-edpm-compute-global-edpm-compute-global-wld47\" (UID: \"527acda8-28c9-412c-b3a8-ce5749238659\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-global-edpm-compute-global-wld47" Mar 16 17:19:45 crc kubenswrapper[5120]: I0316 17:19:45.721846 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"neutron-sriov-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/527acda8-28c9-412c-b3a8-ce5749238659-neutron-sriov-combined-ca-bundle\") pod \"install-certs-edpm-compute-global-edpm-compute-global-wld47\" (UID: \"527acda8-28c9-412c-b3a8-ce5749238659\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-global-edpm-compute-global-wld47" Mar 16 17:19:45 crc kubenswrapper[5120]: I0316 17:19:45.721883 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"libvirt-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/527acda8-28c9-412c-b3a8-ce5749238659-libvirt-combined-ca-bundle\") pod \"install-certs-edpm-compute-global-edpm-compute-global-wld47\" (UID: \"527acda8-28c9-412c-b3a8-ce5749238659\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-global-edpm-compute-global-wld47" Mar 16 17:19:45 crc kubenswrapper[5120]: I0316 17:19:45.721931 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/527acda8-28c9-412c-b3a8-ce5749238659-inventory\") pod \"install-certs-edpm-compute-global-edpm-compute-global-wld47\" (UID: \"527acda8-28c9-412c-b3a8-ce5749238659\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-global-edpm-compute-global-wld47" Mar 16 17:19:45 crc kubenswrapper[5120]: I0316 17:19:45.722062 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"custom-global-service-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/527acda8-28c9-412c-b3a8-ce5749238659-custom-global-service-combined-ca-bundle\") pod \"install-certs-edpm-compute-global-edpm-compute-global-wld47\" (UID: \"527acda8-28c9-412c-b3a8-ce5749238659\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-global-edpm-compute-global-wld47" Mar 16 17:19:45 crc kubenswrapper[5120]: I0316 17:19:45.722098 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"neutron-metadata-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/527acda8-28c9-412c-b3a8-ce5749238659-neutron-metadata-combined-ca-bundle\") pod \"install-certs-edpm-compute-global-edpm-compute-global-wld47\" (UID: \"527acda8-28c9-412c-b3a8-ce5749238659\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-global-edpm-compute-global-wld47" Mar 16 17:19:45 crc kubenswrapper[5120]: I0316 17:19:45.824595 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"neutron-dhcp-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/527acda8-28c9-412c-b3a8-ce5749238659-neutron-dhcp-combined-ca-bundle\") pod \"install-certs-edpm-compute-global-edpm-compute-global-wld47\" (UID: \"527acda8-28c9-412c-b3a8-ce5749238659\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-global-edpm-compute-global-wld47" Mar 16 17:19:45 crc kubenswrapper[5120]: I0316 17:19:45.824747 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bootstrap-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/527acda8-28c9-412c-b3a8-ce5749238659-bootstrap-combined-ca-bundle\") pod \"install-certs-edpm-compute-global-edpm-compute-global-wld47\" (UID: \"527acda8-28c9-412c-b3a8-ce5749238659\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-global-edpm-compute-global-wld47" Mar 16 17:19:45 crc kubenswrapper[5120]: I0316 17:19:45.824859 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"neutron-sriov-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/527acda8-28c9-412c-b3a8-ce5749238659-neutron-sriov-combined-ca-bundle\") pod \"install-certs-edpm-compute-global-edpm-compute-global-wld47\" (UID: \"527acda8-28c9-412c-b3a8-ce5749238659\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-global-edpm-compute-global-wld47" Mar 16 17:19:45 crc kubenswrapper[5120]: I0316 17:19:45.824914 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"libvirt-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/527acda8-28c9-412c-b3a8-ce5749238659-libvirt-combined-ca-bundle\") pod \"install-certs-edpm-compute-global-edpm-compute-global-wld47\" (UID: \"527acda8-28c9-412c-b3a8-ce5749238659\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-global-edpm-compute-global-wld47" Mar 16 17:19:45 crc kubenswrapper[5120]: I0316 17:19:45.824964 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/527acda8-28c9-412c-b3a8-ce5749238659-inventory\") pod \"install-certs-edpm-compute-global-edpm-compute-global-wld47\" (UID: \"527acda8-28c9-412c-b3a8-ce5749238659\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-global-edpm-compute-global-wld47" Mar 16 17:19:45 crc kubenswrapper[5120]: I0316 17:19:45.825010 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"custom-global-service-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/527acda8-28c9-412c-b3a8-ce5749238659-custom-global-service-combined-ca-bundle\") pod \"install-certs-edpm-compute-global-edpm-compute-global-wld47\" (UID: \"527acda8-28c9-412c-b3a8-ce5749238659\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-global-edpm-compute-global-wld47" Mar 16 17:19:45 crc kubenswrapper[5120]: I0316 17:19:45.825040 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"neutron-metadata-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/527acda8-28c9-412c-b3a8-ce5749238659-neutron-metadata-combined-ca-bundle\") pod \"install-certs-edpm-compute-global-edpm-compute-global-wld47\" (UID: \"527acda8-28c9-412c-b3a8-ce5749238659\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-global-edpm-compute-global-wld47" Mar 16 17:19:45 crc kubenswrapper[5120]: I0316 17:19:45.825064 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w7hq7\" (UniqueName: \"kubernetes.io/projected/527acda8-28c9-412c-b3a8-ce5749238659-kube-api-access-w7hq7\") pod \"install-certs-edpm-compute-global-edpm-compute-global-wld47\" (UID: \"527acda8-28c9-412c-b3a8-ce5749238659\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-global-edpm-compute-global-wld47" Mar 16 17:19:45 crc kubenswrapper[5120]: I0316 17:19:45.825093 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"neutron-ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/527acda8-28c9-412c-b3a8-ce5749238659-neutron-ovn-combined-ca-bundle\") pod \"install-certs-edpm-compute-global-edpm-compute-global-wld47\" (UID: \"527acda8-28c9-412c-b3a8-ce5749238659\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-global-edpm-compute-global-wld47" Mar 16 17:19:45 crc kubenswrapper[5120]: I0316 17:19:45.825125 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/527acda8-28c9-412c-b3a8-ce5749238659-ovn-combined-ca-bundle\") pod \"install-certs-edpm-compute-global-edpm-compute-global-wld47\" (UID: \"527acda8-28c9-412c-b3a8-ce5749238659\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-global-edpm-compute-global-wld47" Mar 16 17:19:45 crc kubenswrapper[5120]: I0316 17:19:45.825184 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/527acda8-28c9-412c-b3a8-ce5749238659-ssh-key-edpm-compute-global\") pod \"install-certs-edpm-compute-global-edpm-compute-global-wld47\" (UID: \"527acda8-28c9-412c-b3a8-ce5749238659\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-global-edpm-compute-global-wld47" Mar 16 17:19:45 crc kubenswrapper[5120]: I0316 17:19:45.825250 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/527acda8-28c9-412c-b3a8-ce5749238659-nova-combined-ca-bundle\") pod \"install-certs-edpm-compute-global-edpm-compute-global-wld47\" (UID: \"527acda8-28c9-412c-b3a8-ce5749238659\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-global-edpm-compute-global-wld47" Mar 16 17:19:45 crc kubenswrapper[5120]: I0316 17:19:45.829568 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/527acda8-28c9-412c-b3a8-ce5749238659-inventory\") pod \"install-certs-edpm-compute-global-edpm-compute-global-wld47\" (UID: \"527acda8-28c9-412c-b3a8-ce5749238659\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-global-edpm-compute-global-wld47" Mar 16 17:19:45 crc kubenswrapper[5120]: I0316 17:19:45.829568 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"custom-global-service-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/527acda8-28c9-412c-b3a8-ce5749238659-custom-global-service-combined-ca-bundle\") pod \"install-certs-edpm-compute-global-edpm-compute-global-wld47\" (UID: \"527acda8-28c9-412c-b3a8-ce5749238659\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-global-edpm-compute-global-wld47" Mar 16 17:19:45 crc kubenswrapper[5120]: I0316 17:19:45.830010 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"neutron-dhcp-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/527acda8-28c9-412c-b3a8-ce5749238659-neutron-dhcp-combined-ca-bundle\") pod \"install-certs-edpm-compute-global-edpm-compute-global-wld47\" (UID: \"527acda8-28c9-412c-b3a8-ce5749238659\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-global-edpm-compute-global-wld47" Mar 16 17:19:45 crc kubenswrapper[5120]: I0316 17:19:45.830215 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"libvirt-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/527acda8-28c9-412c-b3a8-ce5749238659-libvirt-combined-ca-bundle\") pod \"install-certs-edpm-compute-global-edpm-compute-global-wld47\" (UID: \"527acda8-28c9-412c-b3a8-ce5749238659\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-global-edpm-compute-global-wld47" Mar 16 17:19:45 crc kubenswrapper[5120]: I0316 17:19:45.831061 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/527acda8-28c9-412c-b3a8-ce5749238659-ovn-combined-ca-bundle\") pod \"install-certs-edpm-compute-global-edpm-compute-global-wld47\" (UID: \"527acda8-28c9-412c-b3a8-ce5749238659\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-global-edpm-compute-global-wld47" Mar 16 17:19:45 crc kubenswrapper[5120]: I0316 17:19:45.832421 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/527acda8-28c9-412c-b3a8-ce5749238659-nova-combined-ca-bundle\") pod \"install-certs-edpm-compute-global-edpm-compute-global-wld47\" (UID: \"527acda8-28c9-412c-b3a8-ce5749238659\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-global-edpm-compute-global-wld47" Mar 16 17:19:45 crc kubenswrapper[5120]: I0316 17:19:45.832670 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bootstrap-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/527acda8-28c9-412c-b3a8-ce5749238659-bootstrap-combined-ca-bundle\") pod \"install-certs-edpm-compute-global-edpm-compute-global-wld47\" (UID: \"527acda8-28c9-412c-b3a8-ce5749238659\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-global-edpm-compute-global-wld47" Mar 16 17:19:45 crc kubenswrapper[5120]: I0316 17:19:45.832875 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/527acda8-28c9-412c-b3a8-ce5749238659-ssh-key-edpm-compute-global\") pod \"install-certs-edpm-compute-global-edpm-compute-global-wld47\" (UID: \"527acda8-28c9-412c-b3a8-ce5749238659\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-global-edpm-compute-global-wld47" Mar 16 17:19:45 crc kubenswrapper[5120]: I0316 17:19:45.837598 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"neutron-sriov-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/527acda8-28c9-412c-b3a8-ce5749238659-neutron-sriov-combined-ca-bundle\") pod \"install-certs-edpm-compute-global-edpm-compute-global-wld47\" (UID: \"527acda8-28c9-412c-b3a8-ce5749238659\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-global-edpm-compute-global-wld47" Mar 16 17:19:45 crc kubenswrapper[5120]: I0316 17:19:45.844539 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"neutron-ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/527acda8-28c9-412c-b3a8-ce5749238659-neutron-ovn-combined-ca-bundle\") pod \"install-certs-edpm-compute-global-edpm-compute-global-wld47\" (UID: \"527acda8-28c9-412c-b3a8-ce5749238659\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-global-edpm-compute-global-wld47" Mar 16 17:19:45 crc kubenswrapper[5120]: I0316 17:19:45.849056 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"neutron-metadata-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/527acda8-28c9-412c-b3a8-ce5749238659-neutron-metadata-combined-ca-bundle\") pod \"install-certs-edpm-compute-global-edpm-compute-global-wld47\" (UID: \"527acda8-28c9-412c-b3a8-ce5749238659\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-global-edpm-compute-global-wld47" Mar 16 17:19:45 crc kubenswrapper[5120]: I0316 17:19:45.858201 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7hq7\" (UniqueName: \"kubernetes.io/projected/527acda8-28c9-412c-b3a8-ce5749238659-kube-api-access-w7hq7\") pod \"install-certs-edpm-compute-global-edpm-compute-global-wld47\" (UID: \"527acda8-28c9-412c-b3a8-ce5749238659\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-global-edpm-compute-global-wld47" Mar 16 17:19:46 crc kubenswrapper[5120]: I0316 17:19:46.012051 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/install-certs-edpm-compute-global-edpm-compute-global-wld47" Mar 16 17:19:46 crc kubenswrapper[5120]: I0316 17:19:46.445483 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/install-certs-edpm-compute-global-edpm-compute-global-wld47"] Mar 16 17:19:46 crc kubenswrapper[5120]: I0316 17:19:46.552348 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/install-certs-edpm-compute-global-edpm-compute-global-wld47" event={"ID":"527acda8-28c9-412c-b3a8-ce5749238659","Type":"ContainerStarted","Data":"d47b9805a4f42d04c6f57bff30605f37152264d8776fd601e59ac193a9ce5652"} Mar 16 17:19:47 crc kubenswrapper[5120]: I0316 17:19:47.562179 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/install-certs-edpm-compute-global-edpm-compute-global-wld47" event={"ID":"527acda8-28c9-412c-b3a8-ce5749238659","Type":"ContainerStarted","Data":"4389fa3288353f00799a73ddeb8671c7e21f898ea7d60403340362f56599f173"} Mar 16 17:19:47 crc kubenswrapper[5120]: I0316 17:19:47.579599 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/install-certs-edpm-compute-global-edpm-compute-global-wld47" podStartSLOduration=1.765923216 podStartE2EDuration="2.579583609s" podCreationTimestamp="2026-03-16 17:19:45 +0000 UTC" firstStartedPulling="2026-03-16 17:19:46.45465551 +0000 UTC m=+6488.608587167" lastFinishedPulling="2026-03-16 17:19:47.268315893 +0000 UTC m=+6489.422247560" observedRunningTime="2026-03-16 17:19:47.577651176 +0000 UTC m=+6489.731582823" watchObservedRunningTime="2026-03-16 17:19:47.579583609 +0000 UTC m=+6489.733515276" Mar 16 17:19:48 crc kubenswrapper[5120]: I0316 17:19:48.571349 5120 generic.go:358] "Generic (PLEG): container finished" podID="527acda8-28c9-412c-b3a8-ce5749238659" containerID="4389fa3288353f00799a73ddeb8671c7e21f898ea7d60403340362f56599f173" exitCode=0 Mar 16 17:19:48 crc kubenswrapper[5120]: I0316 17:19:48.571410 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/install-certs-edpm-compute-global-edpm-compute-global-wld47" event={"ID":"527acda8-28c9-412c-b3a8-ce5749238659","Type":"ContainerDied","Data":"4389fa3288353f00799a73ddeb8671c7e21f898ea7d60403340362f56599f173"} Mar 16 17:19:49 crc kubenswrapper[5120]: I0316 17:19:49.869906 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/install-certs-edpm-compute-global-edpm-compute-global-wld47" Mar 16 17:19:50 crc kubenswrapper[5120]: I0316 17:19:50.005495 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"neutron-dhcp-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/527acda8-28c9-412c-b3a8-ce5749238659-neutron-dhcp-combined-ca-bundle\") pod \"527acda8-28c9-412c-b3a8-ce5749238659\" (UID: \"527acda8-28c9-412c-b3a8-ce5749238659\") " Mar 16 17:19:50 crc kubenswrapper[5120]: I0316 17:19:50.005553 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"custom-global-service-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/527acda8-28c9-412c-b3a8-ce5749238659-custom-global-service-combined-ca-bundle\") pod \"527acda8-28c9-412c-b3a8-ce5749238659\" (UID: \"527acda8-28c9-412c-b3a8-ce5749238659\") " Mar 16 17:19:50 crc kubenswrapper[5120]: I0316 17:19:50.005618 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/527acda8-28c9-412c-b3a8-ce5749238659-nova-combined-ca-bundle\") pod \"527acda8-28c9-412c-b3a8-ce5749238659\" (UID: \"527acda8-28c9-412c-b3a8-ce5749238659\") " Mar 16 17:19:50 crc kubenswrapper[5120]: I0316 17:19:50.006504 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"neutron-ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/527acda8-28c9-412c-b3a8-ce5749238659-neutron-ovn-combined-ca-bundle\") pod \"527acda8-28c9-412c-b3a8-ce5749238659\" (UID: \"527acda8-28c9-412c-b3a8-ce5749238659\") " Mar 16 17:19:50 crc kubenswrapper[5120]: I0316 17:19:50.006605 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/527acda8-28c9-412c-b3a8-ce5749238659-inventory\") pod \"527acda8-28c9-412c-b3a8-ce5749238659\" (UID: \"527acda8-28c9-412c-b3a8-ce5749238659\") " Mar 16 17:19:50 crc kubenswrapper[5120]: I0316 17:19:50.007137 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"libvirt-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/527acda8-28c9-412c-b3a8-ce5749238659-libvirt-combined-ca-bundle\") pod \"527acda8-28c9-412c-b3a8-ce5749238659\" (UID: \"527acda8-28c9-412c-b3a8-ce5749238659\") " Mar 16 17:19:50 crc kubenswrapper[5120]: I0316 17:19:50.007811 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"neutron-metadata-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/527acda8-28c9-412c-b3a8-ce5749238659-neutron-metadata-combined-ca-bundle\") pod \"527acda8-28c9-412c-b3a8-ce5749238659\" (UID: \"527acda8-28c9-412c-b3a8-ce5749238659\") " Mar 16 17:19:50 crc kubenswrapper[5120]: I0316 17:19:50.007871 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"neutron-sriov-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/527acda8-28c9-412c-b3a8-ce5749238659-neutron-sriov-combined-ca-bundle\") pod \"527acda8-28c9-412c-b3a8-ce5749238659\" (UID: \"527acda8-28c9-412c-b3a8-ce5749238659\") " Mar 16 17:19:50 crc kubenswrapper[5120]: I0316 17:19:50.008032 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w7hq7\" (UniqueName: \"kubernetes.io/projected/527acda8-28c9-412c-b3a8-ce5749238659-kube-api-access-w7hq7\") pod \"527acda8-28c9-412c-b3a8-ce5749238659\" (UID: \"527acda8-28c9-412c-b3a8-ce5749238659\") " Mar 16 17:19:50 crc kubenswrapper[5120]: I0316 17:19:50.008166 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/527acda8-28c9-412c-b3a8-ce5749238659-ssh-key-edpm-compute-global\") pod \"527acda8-28c9-412c-b3a8-ce5749238659\" (UID: \"527acda8-28c9-412c-b3a8-ce5749238659\") " Mar 16 17:19:50 crc kubenswrapper[5120]: I0316 17:19:50.008309 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bootstrap-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/527acda8-28c9-412c-b3a8-ce5749238659-bootstrap-combined-ca-bundle\") pod \"527acda8-28c9-412c-b3a8-ce5749238659\" (UID: \"527acda8-28c9-412c-b3a8-ce5749238659\") " Mar 16 17:19:50 crc kubenswrapper[5120]: I0316 17:19:50.008646 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/527acda8-28c9-412c-b3a8-ce5749238659-ovn-combined-ca-bundle\") pod \"527acda8-28c9-412c-b3a8-ce5749238659\" (UID: \"527acda8-28c9-412c-b3a8-ce5749238659\") " Mar 16 17:19:50 crc kubenswrapper[5120]: I0316 17:19:50.011925 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/527acda8-28c9-412c-b3a8-ce5749238659-custom-global-service-combined-ca-bundle" (OuterVolumeSpecName: "custom-global-service-combined-ca-bundle") pod "527acda8-28c9-412c-b3a8-ce5749238659" (UID: "527acda8-28c9-412c-b3a8-ce5749238659"). InnerVolumeSpecName "custom-global-service-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:19:50 crc kubenswrapper[5120]: I0316 17:19:50.011974 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/527acda8-28c9-412c-b3a8-ce5749238659-neutron-ovn-combined-ca-bundle" (OuterVolumeSpecName: "neutron-ovn-combined-ca-bundle") pod "527acda8-28c9-412c-b3a8-ce5749238659" (UID: "527acda8-28c9-412c-b3a8-ce5749238659"). InnerVolumeSpecName "neutron-ovn-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:19:50 crc kubenswrapper[5120]: I0316 17:19:50.012205 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/527acda8-28c9-412c-b3a8-ce5749238659-neutron-dhcp-combined-ca-bundle" (OuterVolumeSpecName: "neutron-dhcp-combined-ca-bundle") pod "527acda8-28c9-412c-b3a8-ce5749238659" (UID: "527acda8-28c9-412c-b3a8-ce5749238659"). InnerVolumeSpecName "neutron-dhcp-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:19:50 crc kubenswrapper[5120]: I0316 17:19:50.012675 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/527acda8-28c9-412c-b3a8-ce5749238659-neutron-metadata-combined-ca-bundle" (OuterVolumeSpecName: "neutron-metadata-combined-ca-bundle") pod "527acda8-28c9-412c-b3a8-ce5749238659" (UID: "527acda8-28c9-412c-b3a8-ce5749238659"). InnerVolumeSpecName "neutron-metadata-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:19:50 crc kubenswrapper[5120]: I0316 17:19:50.012716 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/527acda8-28c9-412c-b3a8-ce5749238659-bootstrap-combined-ca-bundle" (OuterVolumeSpecName: "bootstrap-combined-ca-bundle") pod "527acda8-28c9-412c-b3a8-ce5749238659" (UID: "527acda8-28c9-412c-b3a8-ce5749238659"). InnerVolumeSpecName "bootstrap-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:19:50 crc kubenswrapper[5120]: I0316 17:19:50.012945 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/527acda8-28c9-412c-b3a8-ce5749238659-libvirt-combined-ca-bundle" (OuterVolumeSpecName: "libvirt-combined-ca-bundle") pod "527acda8-28c9-412c-b3a8-ce5749238659" (UID: "527acda8-28c9-412c-b3a8-ce5749238659"). InnerVolumeSpecName "libvirt-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:19:50 crc kubenswrapper[5120]: I0316 17:19:50.013115 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/527acda8-28c9-412c-b3a8-ce5749238659-ovn-combined-ca-bundle" (OuterVolumeSpecName: "ovn-combined-ca-bundle") pod "527acda8-28c9-412c-b3a8-ce5749238659" (UID: "527acda8-28c9-412c-b3a8-ce5749238659"). InnerVolumeSpecName "ovn-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:19:50 crc kubenswrapper[5120]: I0316 17:19:50.013257 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/527acda8-28c9-412c-b3a8-ce5749238659-nova-combined-ca-bundle" (OuterVolumeSpecName: "nova-combined-ca-bundle") pod "527acda8-28c9-412c-b3a8-ce5749238659" (UID: "527acda8-28c9-412c-b3a8-ce5749238659"). InnerVolumeSpecName "nova-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:19:50 crc kubenswrapper[5120]: I0316 17:19:50.014937 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/527acda8-28c9-412c-b3a8-ce5749238659-neutron-sriov-combined-ca-bundle" (OuterVolumeSpecName: "neutron-sriov-combined-ca-bundle") pod "527acda8-28c9-412c-b3a8-ce5749238659" (UID: "527acda8-28c9-412c-b3a8-ce5749238659"). InnerVolumeSpecName "neutron-sriov-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:19:50 crc kubenswrapper[5120]: I0316 17:19:50.016133 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/527acda8-28c9-412c-b3a8-ce5749238659-kube-api-access-w7hq7" (OuterVolumeSpecName: "kube-api-access-w7hq7") pod "527acda8-28c9-412c-b3a8-ce5749238659" (UID: "527acda8-28c9-412c-b3a8-ce5749238659"). InnerVolumeSpecName "kube-api-access-w7hq7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:19:50 crc kubenswrapper[5120]: I0316 17:19:50.032509 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/527acda8-28c9-412c-b3a8-ce5749238659-ssh-key-edpm-compute-global" (OuterVolumeSpecName: "ssh-key-edpm-compute-global") pod "527acda8-28c9-412c-b3a8-ce5749238659" (UID: "527acda8-28c9-412c-b3a8-ce5749238659"). InnerVolumeSpecName "ssh-key-edpm-compute-global". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:19:50 crc kubenswrapper[5120]: I0316 17:19:50.034116 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/527acda8-28c9-412c-b3a8-ce5749238659-inventory" (OuterVolumeSpecName: "inventory") pod "527acda8-28c9-412c-b3a8-ce5749238659" (UID: "527acda8-28c9-412c-b3a8-ce5749238659"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:19:50 crc kubenswrapper[5120]: I0316 17:19:50.110737 5120 reconciler_common.go:299] "Volume detached for volume \"ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/527acda8-28c9-412c-b3a8-ce5749238659-ovn-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:19:50 crc kubenswrapper[5120]: I0316 17:19:50.110777 5120 reconciler_common.go:299] "Volume detached for volume \"neutron-dhcp-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/527acda8-28c9-412c-b3a8-ce5749238659-neutron-dhcp-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:19:50 crc kubenswrapper[5120]: I0316 17:19:50.110789 5120 reconciler_common.go:299] "Volume detached for volume \"custom-global-service-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/527acda8-28c9-412c-b3a8-ce5749238659-custom-global-service-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:19:50 crc kubenswrapper[5120]: I0316 17:19:50.110802 5120 reconciler_common.go:299] "Volume detached for volume \"nova-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/527acda8-28c9-412c-b3a8-ce5749238659-nova-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:19:50 crc kubenswrapper[5120]: I0316 17:19:50.110811 5120 reconciler_common.go:299] "Volume detached for volume \"neutron-ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/527acda8-28c9-412c-b3a8-ce5749238659-neutron-ovn-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:19:50 crc kubenswrapper[5120]: I0316 17:19:50.110820 5120 reconciler_common.go:299] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/527acda8-28c9-412c-b3a8-ce5749238659-inventory\") on node \"crc\" DevicePath \"\"" Mar 16 17:19:50 crc kubenswrapper[5120]: I0316 17:19:50.110829 5120 reconciler_common.go:299] "Volume detached for volume \"libvirt-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/527acda8-28c9-412c-b3a8-ce5749238659-libvirt-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:19:50 crc kubenswrapper[5120]: I0316 17:19:50.110838 5120 reconciler_common.go:299] "Volume detached for volume \"neutron-metadata-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/527acda8-28c9-412c-b3a8-ce5749238659-neutron-metadata-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:19:50 crc kubenswrapper[5120]: I0316 17:19:50.110847 5120 reconciler_common.go:299] "Volume detached for volume \"neutron-sriov-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/527acda8-28c9-412c-b3a8-ce5749238659-neutron-sriov-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:19:50 crc kubenswrapper[5120]: I0316 17:19:50.110856 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w7hq7\" (UniqueName: \"kubernetes.io/projected/527acda8-28c9-412c-b3a8-ce5749238659-kube-api-access-w7hq7\") on node \"crc\" DevicePath \"\"" Mar 16 17:19:50 crc kubenswrapper[5120]: I0316 17:19:50.110864 5120 reconciler_common.go:299] "Volume detached for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/527acda8-28c9-412c-b3a8-ce5749238659-ssh-key-edpm-compute-global\") on node \"crc\" DevicePath \"\"" Mar 16 17:19:50 crc kubenswrapper[5120]: I0316 17:19:50.110874 5120 reconciler_common.go:299] "Volume detached for volume \"bootstrap-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/527acda8-28c9-412c-b3a8-ce5749238659-bootstrap-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:19:50 crc kubenswrapper[5120]: I0316 17:19:50.595775 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/install-certs-edpm-compute-global-edpm-compute-global-wld47" Mar 16 17:19:50 crc kubenswrapper[5120]: I0316 17:19:50.595746 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/install-certs-edpm-compute-global-edpm-compute-global-wld47" event={"ID":"527acda8-28c9-412c-b3a8-ce5749238659","Type":"ContainerDied","Data":"d47b9805a4f42d04c6f57bff30605f37152264d8776fd601e59ac193a9ce5652"} Mar 16 17:19:50 crc kubenswrapper[5120]: I0316 17:19:50.595932 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d47b9805a4f42d04c6f57bff30605f37152264d8776fd601e59ac193a9ce5652" Mar 16 17:19:50 crc kubenswrapper[5120]: I0316 17:19:50.676891 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovn-edpm-compute-global-edpm-compute-global-55bs7"] Mar 16 17:19:50 crc kubenswrapper[5120]: I0316 17:19:50.677989 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="527acda8-28c9-412c-b3a8-ce5749238659" containerName="install-certs-edpm-compute-global-edpm-compute-global" Mar 16 17:19:50 crc kubenswrapper[5120]: I0316 17:19:50.678012 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="527acda8-28c9-412c-b3a8-ce5749238659" containerName="install-certs-edpm-compute-global-edpm-compute-global" Mar 16 17:19:50 crc kubenswrapper[5120]: I0316 17:19:50.678190 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="527acda8-28c9-412c-b3a8-ce5749238659" containerName="install-certs-edpm-compute-global-edpm-compute-global" Mar 16 17:19:50 crc kubenswrapper[5120]: I0316 17:19:50.686061 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-edpm-compute-global-edpm-compute-global-55bs7" Mar 16 17:19:50 crc kubenswrapper[5120]: I0316 17:19:50.687027 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-edpm-compute-global-edpm-compute-global-55bs7"] Mar 16 17:19:50 crc kubenswrapper[5120]: I0316 17:19:50.688230 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"combined-ca-bundle\"" Mar 16 17:19:50 crc kubenswrapper[5120]: I0316 17:19:50.690400 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovncontroller-config\"" Mar 16 17:19:50 crc kubenswrapper[5120]: I0316 17:19:50.690708 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplanenodeset-edpm-compute-global\"" Mar 16 17:19:50 crc kubenswrapper[5120]: I0316 17:19:50.691131 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"edpm-compute-global-dockercfg-5hp85\"" Mar 16 17:19:50 crc kubenswrapper[5120]: I0316 17:19:50.691863 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplane-ansible-ssh-private-key-secret\"" Mar 16 17:19:50 crc kubenswrapper[5120]: I0316 17:19:50.692107 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-aee-default-env\"" Mar 16 17:19:50 crc kubenswrapper[5120]: I0316 17:19:50.828349 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqvv6\" (UniqueName: \"kubernetes.io/projected/482a9a9b-501b-4009-a558-9c7a9e30a05d-kube-api-access-lqvv6\") pod \"ovn-edpm-compute-global-edpm-compute-global-55bs7\" (UID: \"482a9a9b-501b-4009-a558-9c7a9e30a05d\") " pod="openstack-kuttl-tests/ovn-edpm-compute-global-edpm-compute-global-55bs7" Mar 16 17:19:50 crc kubenswrapper[5120]: I0316 17:19:50.828582 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovncontroller-config-0\" (UniqueName: \"kubernetes.io/configmap/482a9a9b-501b-4009-a558-9c7a9e30a05d-ovncontroller-config-0\") pod \"ovn-edpm-compute-global-edpm-compute-global-55bs7\" (UID: \"482a9a9b-501b-4009-a558-9c7a9e30a05d\") " pod="openstack-kuttl-tests/ovn-edpm-compute-global-edpm-compute-global-55bs7" Mar 16 17:19:50 crc kubenswrapper[5120]: I0316 17:19:50.828675 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/482a9a9b-501b-4009-a558-9c7a9e30a05d-ovn-combined-ca-bundle\") pod \"ovn-edpm-compute-global-edpm-compute-global-55bs7\" (UID: \"482a9a9b-501b-4009-a558-9c7a9e30a05d\") " pod="openstack-kuttl-tests/ovn-edpm-compute-global-edpm-compute-global-55bs7" Mar 16 17:19:50 crc kubenswrapper[5120]: I0316 17:19:50.828713 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/482a9a9b-501b-4009-a558-9c7a9e30a05d-inventory\") pod \"ovn-edpm-compute-global-edpm-compute-global-55bs7\" (UID: \"482a9a9b-501b-4009-a558-9c7a9e30a05d\") " pod="openstack-kuttl-tests/ovn-edpm-compute-global-edpm-compute-global-55bs7" Mar 16 17:19:50 crc kubenswrapper[5120]: I0316 17:19:50.828915 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/482a9a9b-501b-4009-a558-9c7a9e30a05d-ssh-key-edpm-compute-global\") pod \"ovn-edpm-compute-global-edpm-compute-global-55bs7\" (UID: \"482a9a9b-501b-4009-a558-9c7a9e30a05d\") " pod="openstack-kuttl-tests/ovn-edpm-compute-global-edpm-compute-global-55bs7" Mar 16 17:19:50 crc kubenswrapper[5120]: I0316 17:19:50.931040 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lqvv6\" (UniqueName: \"kubernetes.io/projected/482a9a9b-501b-4009-a558-9c7a9e30a05d-kube-api-access-lqvv6\") pod \"ovn-edpm-compute-global-edpm-compute-global-55bs7\" (UID: \"482a9a9b-501b-4009-a558-9c7a9e30a05d\") " pod="openstack-kuttl-tests/ovn-edpm-compute-global-edpm-compute-global-55bs7" Mar 16 17:19:50 crc kubenswrapper[5120]: I0316 17:19:50.931249 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovncontroller-config-0\" (UniqueName: \"kubernetes.io/configmap/482a9a9b-501b-4009-a558-9c7a9e30a05d-ovncontroller-config-0\") pod \"ovn-edpm-compute-global-edpm-compute-global-55bs7\" (UID: \"482a9a9b-501b-4009-a558-9c7a9e30a05d\") " pod="openstack-kuttl-tests/ovn-edpm-compute-global-edpm-compute-global-55bs7" Mar 16 17:19:50 crc kubenswrapper[5120]: I0316 17:19:50.931632 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/482a9a9b-501b-4009-a558-9c7a9e30a05d-ovn-combined-ca-bundle\") pod \"ovn-edpm-compute-global-edpm-compute-global-55bs7\" (UID: \"482a9a9b-501b-4009-a558-9c7a9e30a05d\") " pod="openstack-kuttl-tests/ovn-edpm-compute-global-edpm-compute-global-55bs7" Mar 16 17:19:50 crc kubenswrapper[5120]: I0316 17:19:50.931887 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/482a9a9b-501b-4009-a558-9c7a9e30a05d-inventory\") pod \"ovn-edpm-compute-global-edpm-compute-global-55bs7\" (UID: \"482a9a9b-501b-4009-a558-9c7a9e30a05d\") " pod="openstack-kuttl-tests/ovn-edpm-compute-global-edpm-compute-global-55bs7" Mar 16 17:19:50 crc kubenswrapper[5120]: I0316 17:19:50.932086 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/482a9a9b-501b-4009-a558-9c7a9e30a05d-ssh-key-edpm-compute-global\") pod \"ovn-edpm-compute-global-edpm-compute-global-55bs7\" (UID: \"482a9a9b-501b-4009-a558-9c7a9e30a05d\") " pod="openstack-kuttl-tests/ovn-edpm-compute-global-edpm-compute-global-55bs7" Mar 16 17:19:50 crc kubenswrapper[5120]: I0316 17:19:50.932353 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovncontroller-config-0\" (UniqueName: \"kubernetes.io/configmap/482a9a9b-501b-4009-a558-9c7a9e30a05d-ovncontroller-config-0\") pod \"ovn-edpm-compute-global-edpm-compute-global-55bs7\" (UID: \"482a9a9b-501b-4009-a558-9c7a9e30a05d\") " pod="openstack-kuttl-tests/ovn-edpm-compute-global-edpm-compute-global-55bs7" Mar 16 17:19:50 crc kubenswrapper[5120]: I0316 17:19:50.936293 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/482a9a9b-501b-4009-a558-9c7a9e30a05d-ovn-combined-ca-bundle\") pod \"ovn-edpm-compute-global-edpm-compute-global-55bs7\" (UID: \"482a9a9b-501b-4009-a558-9c7a9e30a05d\") " pod="openstack-kuttl-tests/ovn-edpm-compute-global-edpm-compute-global-55bs7" Mar 16 17:19:50 crc kubenswrapper[5120]: I0316 17:19:50.936293 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/482a9a9b-501b-4009-a558-9c7a9e30a05d-inventory\") pod \"ovn-edpm-compute-global-edpm-compute-global-55bs7\" (UID: \"482a9a9b-501b-4009-a558-9c7a9e30a05d\") " pod="openstack-kuttl-tests/ovn-edpm-compute-global-edpm-compute-global-55bs7" Mar 16 17:19:50 crc kubenswrapper[5120]: I0316 17:19:50.936389 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/482a9a9b-501b-4009-a558-9c7a9e30a05d-ssh-key-edpm-compute-global\") pod \"ovn-edpm-compute-global-edpm-compute-global-55bs7\" (UID: \"482a9a9b-501b-4009-a558-9c7a9e30a05d\") " pod="openstack-kuttl-tests/ovn-edpm-compute-global-edpm-compute-global-55bs7" Mar 16 17:19:50 crc kubenswrapper[5120]: I0316 17:19:50.948224 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqvv6\" (UniqueName: \"kubernetes.io/projected/482a9a9b-501b-4009-a558-9c7a9e30a05d-kube-api-access-lqvv6\") pod \"ovn-edpm-compute-global-edpm-compute-global-55bs7\" (UID: \"482a9a9b-501b-4009-a558-9c7a9e30a05d\") " pod="openstack-kuttl-tests/ovn-edpm-compute-global-edpm-compute-global-55bs7" Mar 16 17:19:51 crc kubenswrapper[5120]: I0316 17:19:51.005330 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-edpm-compute-global-edpm-compute-global-55bs7" Mar 16 17:19:51 crc kubenswrapper[5120]: I0316 17:19:51.412965 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-edpm-compute-global-edpm-compute-global-55bs7"] Mar 16 17:19:51 crc kubenswrapper[5120]: I0316 17:19:51.606682 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-edpm-compute-global-edpm-compute-global-55bs7" event={"ID":"482a9a9b-501b-4009-a558-9c7a9e30a05d","Type":"ContainerStarted","Data":"2462b7becc58f0b8b82b14966e8e7e102bb9c836330073b34cfa9cb813aa4024"} Mar 16 17:19:52 crc kubenswrapper[5120]: I0316 17:19:52.623452 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-edpm-compute-global-edpm-compute-global-55bs7" event={"ID":"482a9a9b-501b-4009-a558-9c7a9e30a05d","Type":"ContainerStarted","Data":"3efe3ba1329558a789748eeced2fb833e2fcb37c31820d947b4864ad64467d5f"} Mar 16 17:19:52 crc kubenswrapper[5120]: I0316 17:19:52.641061 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovn-edpm-compute-global-edpm-compute-global-55bs7" podStartSLOduration=2.145442841 podStartE2EDuration="2.641038933s" podCreationTimestamp="2026-03-16 17:19:50 +0000 UTC" firstStartedPulling="2026-03-16 17:19:51.422086166 +0000 UTC m=+6493.576017833" lastFinishedPulling="2026-03-16 17:19:51.917682258 +0000 UTC m=+6494.071613925" observedRunningTime="2026-03-16 17:19:52.640311034 +0000 UTC m=+6494.794242691" watchObservedRunningTime="2026-03-16 17:19:52.641038933 +0000 UTC m=+6494.794970590" Mar 16 17:19:53 crc kubenswrapper[5120]: I0316 17:19:53.648420 5120 generic.go:358] "Generic (PLEG): container finished" podID="482a9a9b-501b-4009-a558-9c7a9e30a05d" containerID="3efe3ba1329558a789748eeced2fb833e2fcb37c31820d947b4864ad64467d5f" exitCode=0 Mar 16 17:19:53 crc kubenswrapper[5120]: I0316 17:19:53.648635 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-edpm-compute-global-edpm-compute-global-55bs7" event={"ID":"482a9a9b-501b-4009-a558-9c7a9e30a05d","Type":"ContainerDied","Data":"3efe3ba1329558a789748eeced2fb833e2fcb37c31820d947b4864ad64467d5f"} Mar 16 17:19:54 crc kubenswrapper[5120]: I0316 17:19:54.664290 5120 scope.go:117] "RemoveContainer" containerID="2ca61165dca6fdb30458423ef74c44c42b1b273e8fa504e89f5f9e186e516cc3" Mar 16 17:19:54 crc kubenswrapper[5120]: E0316 17:19:54.665109 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 17:19:54 crc kubenswrapper[5120]: I0316 17:19:54.930661 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-edpm-compute-global-edpm-compute-global-55bs7" Mar 16 17:19:55 crc kubenswrapper[5120]: I0316 17:19:55.018641 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovncontroller-config-0\" (UniqueName: \"kubernetes.io/configmap/482a9a9b-501b-4009-a558-9c7a9e30a05d-ovncontroller-config-0\") pod \"482a9a9b-501b-4009-a558-9c7a9e30a05d\" (UID: \"482a9a9b-501b-4009-a558-9c7a9e30a05d\") " Mar 16 17:19:55 crc kubenswrapper[5120]: I0316 17:19:55.019186 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lqvv6\" (UniqueName: \"kubernetes.io/projected/482a9a9b-501b-4009-a558-9c7a9e30a05d-kube-api-access-lqvv6\") pod \"482a9a9b-501b-4009-a558-9c7a9e30a05d\" (UID: \"482a9a9b-501b-4009-a558-9c7a9e30a05d\") " Mar 16 17:19:55 crc kubenswrapper[5120]: I0316 17:19:55.019240 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/482a9a9b-501b-4009-a558-9c7a9e30a05d-ovn-combined-ca-bundle\") pod \"482a9a9b-501b-4009-a558-9c7a9e30a05d\" (UID: \"482a9a9b-501b-4009-a558-9c7a9e30a05d\") " Mar 16 17:19:55 crc kubenswrapper[5120]: I0316 17:19:55.019421 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/482a9a9b-501b-4009-a558-9c7a9e30a05d-ssh-key-edpm-compute-global\") pod \"482a9a9b-501b-4009-a558-9c7a9e30a05d\" (UID: \"482a9a9b-501b-4009-a558-9c7a9e30a05d\") " Mar 16 17:19:55 crc kubenswrapper[5120]: I0316 17:19:55.019500 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/482a9a9b-501b-4009-a558-9c7a9e30a05d-inventory\") pod \"482a9a9b-501b-4009-a558-9c7a9e30a05d\" (UID: \"482a9a9b-501b-4009-a558-9c7a9e30a05d\") " Mar 16 17:19:55 crc kubenswrapper[5120]: I0316 17:19:55.024400 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/482a9a9b-501b-4009-a558-9c7a9e30a05d-kube-api-access-lqvv6" (OuterVolumeSpecName: "kube-api-access-lqvv6") pod "482a9a9b-501b-4009-a558-9c7a9e30a05d" (UID: "482a9a9b-501b-4009-a558-9c7a9e30a05d"). InnerVolumeSpecName "kube-api-access-lqvv6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:19:55 crc kubenswrapper[5120]: I0316 17:19:55.036191 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/482a9a9b-501b-4009-a558-9c7a9e30a05d-ovn-combined-ca-bundle" (OuterVolumeSpecName: "ovn-combined-ca-bundle") pod "482a9a9b-501b-4009-a558-9c7a9e30a05d" (UID: "482a9a9b-501b-4009-a558-9c7a9e30a05d"). InnerVolumeSpecName "ovn-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:19:55 crc kubenswrapper[5120]: I0316 17:19:55.036424 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/482a9a9b-501b-4009-a558-9c7a9e30a05d-ovncontroller-config-0" (OuterVolumeSpecName: "ovncontroller-config-0") pod "482a9a9b-501b-4009-a558-9c7a9e30a05d" (UID: "482a9a9b-501b-4009-a558-9c7a9e30a05d"). InnerVolumeSpecName "ovncontroller-config-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:19:55 crc kubenswrapper[5120]: I0316 17:19:55.039288 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/482a9a9b-501b-4009-a558-9c7a9e30a05d-inventory" (OuterVolumeSpecName: "inventory") pod "482a9a9b-501b-4009-a558-9c7a9e30a05d" (UID: "482a9a9b-501b-4009-a558-9c7a9e30a05d"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:19:55 crc kubenswrapper[5120]: I0316 17:19:55.040947 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/482a9a9b-501b-4009-a558-9c7a9e30a05d-ssh-key-edpm-compute-global" (OuterVolumeSpecName: "ssh-key-edpm-compute-global") pod "482a9a9b-501b-4009-a558-9c7a9e30a05d" (UID: "482a9a9b-501b-4009-a558-9c7a9e30a05d"). InnerVolumeSpecName "ssh-key-edpm-compute-global". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:19:55 crc kubenswrapper[5120]: I0316 17:19:55.121999 5120 reconciler_common.go:299] "Volume detached for volume \"ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/482a9a9b-501b-4009-a558-9c7a9e30a05d-ovn-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:19:55 crc kubenswrapper[5120]: I0316 17:19:55.122063 5120 reconciler_common.go:299] "Volume detached for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/482a9a9b-501b-4009-a558-9c7a9e30a05d-ssh-key-edpm-compute-global\") on node \"crc\" DevicePath \"\"" Mar 16 17:19:55 crc kubenswrapper[5120]: I0316 17:19:55.122074 5120 reconciler_common.go:299] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/482a9a9b-501b-4009-a558-9c7a9e30a05d-inventory\") on node \"crc\" DevicePath \"\"" Mar 16 17:19:55 crc kubenswrapper[5120]: I0316 17:19:55.122083 5120 reconciler_common.go:299] "Volume detached for volume \"ovncontroller-config-0\" (UniqueName: \"kubernetes.io/configmap/482a9a9b-501b-4009-a558-9c7a9e30a05d-ovncontroller-config-0\") on node \"crc\" DevicePath \"\"" Mar 16 17:19:55 crc kubenswrapper[5120]: I0316 17:19:55.122093 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lqvv6\" (UniqueName: \"kubernetes.io/projected/482a9a9b-501b-4009-a558-9c7a9e30a05d-kube-api-access-lqvv6\") on node \"crc\" DevicePath \"\"" Mar 16 17:19:55 crc kubenswrapper[5120]: I0316 17:19:55.668535 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-edpm-compute-global-edpm-compute-global-55bs7" Mar 16 17:19:55 crc kubenswrapper[5120]: I0316 17:19:55.668554 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-edpm-compute-global-edpm-compute-global-55bs7" event={"ID":"482a9a9b-501b-4009-a558-9c7a9e30a05d","Type":"ContainerDied","Data":"2462b7becc58f0b8b82b14966e8e7e102bb9c836330073b34cfa9cb813aa4024"} Mar 16 17:19:55 crc kubenswrapper[5120]: I0316 17:19:55.668595 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2462b7becc58f0b8b82b14966e8e7e102bb9c836330073b34cfa9cb813aa4024" Mar 16 17:19:55 crc kubenswrapper[5120]: I0316 17:19:55.721867 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-metadata-edpm-compute-global-edpm-compute-global-ptgv2"] Mar 16 17:19:55 crc kubenswrapper[5120]: I0316 17:19:55.722788 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="482a9a9b-501b-4009-a558-9c7a9e30a05d" containerName="ovn-edpm-compute-global-edpm-compute-global" Mar 16 17:19:55 crc kubenswrapper[5120]: I0316 17:19:55.722807 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="482a9a9b-501b-4009-a558-9c7a9e30a05d" containerName="ovn-edpm-compute-global-edpm-compute-global" Mar 16 17:19:55 crc kubenswrapper[5120]: I0316 17:19:55.722941 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="482a9a9b-501b-4009-a558-9c7a9e30a05d" containerName="ovn-edpm-compute-global-edpm-compute-global" Mar 16 17:19:55 crc kubenswrapper[5120]: I0316 17:19:55.733146 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-global-edpm-compute-global-ptgv2" Mar 16 17:19:55 crc kubenswrapper[5120]: I0316 17:19:55.738328 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-aee-default-env\"" Mar 16 17:19:55 crc kubenswrapper[5120]: I0316 17:19:55.738555 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"combined-ca-bundle\"" Mar 16 17:19:55 crc kubenswrapper[5120]: I0316 17:19:55.738805 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"edpm-compute-global-dockercfg-5hp85\"" Mar 16 17:19:55 crc kubenswrapper[5120]: I0316 17:19:55.738422 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-ovn-metadata-agent-neutron-config\"" Mar 16 17:19:55 crc kubenswrapper[5120]: I0316 17:19:55.738519 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplanenodeset-edpm-compute-global\"" Mar 16 17:19:55 crc kubenswrapper[5120]: I0316 17:19:55.738390 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-metadata-neutron-config\"" Mar 16 17:19:55 crc kubenswrapper[5120]: I0316 17:19:55.739315 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplane-ansible-ssh-private-key-secret\"" Mar 16 17:19:55 crc kubenswrapper[5120]: I0316 17:19:55.741109 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-metadata-edpm-compute-global-edpm-compute-global-ptgv2"] Mar 16 17:19:55 crc kubenswrapper[5120]: I0316 17:19:55.836639 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-neutron-config-1\" (UniqueName: \"kubernetes.io/secret/7c65ae5a-f219-400e-8b08-7ed5f3860761-nova-metadata-neutron-config-1\") pod \"neutron-metadata-edpm-compute-global-edpm-compute-global-ptgv2\" (UID: \"7c65ae5a-f219-400e-8b08-7ed5f3860761\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-global-edpm-compute-global-ptgv2" Mar 16 17:19:55 crc kubenswrapper[5120]: I0316 17:19:55.836848 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-neutron-config-2\" (UniqueName: \"kubernetes.io/secret/7c65ae5a-f219-400e-8b08-7ed5f3860761-nova-metadata-neutron-config-2\") pod \"neutron-metadata-edpm-compute-global-edpm-compute-global-ptgv2\" (UID: \"7c65ae5a-f219-400e-8b08-7ed5f3860761\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-global-edpm-compute-global-ptgv2" Mar 16 17:19:55 crc kubenswrapper[5120]: I0316 17:19:55.836936 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"neutron-ovn-metadata-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/7c65ae5a-f219-400e-8b08-7ed5f3860761-neutron-ovn-metadata-agent-neutron-config-0\") pod \"neutron-metadata-edpm-compute-global-edpm-compute-global-ptgv2\" (UID: \"7c65ae5a-f219-400e-8b08-7ed5f3860761\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-global-edpm-compute-global-ptgv2" Mar 16 17:19:55 crc kubenswrapper[5120]: I0316 17:19:55.837013 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"neutron-metadata-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7c65ae5a-f219-400e-8b08-7ed5f3860761-neutron-metadata-combined-ca-bundle\") pod \"neutron-metadata-edpm-compute-global-edpm-compute-global-ptgv2\" (UID: \"7c65ae5a-f219-400e-8b08-7ed5f3860761\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-global-edpm-compute-global-ptgv2" Mar 16 17:19:55 crc kubenswrapper[5120]: I0316 17:19:55.837098 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/7c65ae5a-f219-400e-8b08-7ed5f3860761-nova-metadata-neutron-config-0\") pod \"neutron-metadata-edpm-compute-global-edpm-compute-global-ptgv2\" (UID: \"7c65ae5a-f219-400e-8b08-7ed5f3860761\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-global-edpm-compute-global-ptgv2" Mar 16 17:19:55 crc kubenswrapper[5120]: I0316 17:19:55.837183 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hplzn\" (UniqueName: \"kubernetes.io/projected/7c65ae5a-f219-400e-8b08-7ed5f3860761-kube-api-access-hplzn\") pod \"neutron-metadata-edpm-compute-global-edpm-compute-global-ptgv2\" (UID: \"7c65ae5a-f219-400e-8b08-7ed5f3860761\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-global-edpm-compute-global-ptgv2" Mar 16 17:19:55 crc kubenswrapper[5120]: I0316 17:19:55.837206 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/7c65ae5a-f219-400e-8b08-7ed5f3860761-inventory\") pod \"neutron-metadata-edpm-compute-global-edpm-compute-global-ptgv2\" (UID: \"7c65ae5a-f219-400e-8b08-7ed5f3860761\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-global-edpm-compute-global-ptgv2" Mar 16 17:19:55 crc kubenswrapper[5120]: I0316 17:19:55.837309 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/7c65ae5a-f219-400e-8b08-7ed5f3860761-ssh-key-edpm-compute-global\") pod \"neutron-metadata-edpm-compute-global-edpm-compute-global-ptgv2\" (UID: \"7c65ae5a-f219-400e-8b08-7ed5f3860761\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-global-edpm-compute-global-ptgv2" Mar 16 17:19:55 crc kubenswrapper[5120]: I0316 17:19:55.939288 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"neutron-ovn-metadata-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/7c65ae5a-f219-400e-8b08-7ed5f3860761-neutron-ovn-metadata-agent-neutron-config-0\") pod \"neutron-metadata-edpm-compute-global-edpm-compute-global-ptgv2\" (UID: \"7c65ae5a-f219-400e-8b08-7ed5f3860761\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-global-edpm-compute-global-ptgv2" Mar 16 17:19:55 crc kubenswrapper[5120]: I0316 17:19:55.939394 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"neutron-metadata-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7c65ae5a-f219-400e-8b08-7ed5f3860761-neutron-metadata-combined-ca-bundle\") pod \"neutron-metadata-edpm-compute-global-edpm-compute-global-ptgv2\" (UID: \"7c65ae5a-f219-400e-8b08-7ed5f3860761\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-global-edpm-compute-global-ptgv2" Mar 16 17:19:55 crc kubenswrapper[5120]: I0316 17:19:55.939481 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-metadata-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/7c65ae5a-f219-400e-8b08-7ed5f3860761-nova-metadata-neutron-config-0\") pod \"neutron-metadata-edpm-compute-global-edpm-compute-global-ptgv2\" (UID: \"7c65ae5a-f219-400e-8b08-7ed5f3860761\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-global-edpm-compute-global-ptgv2" Mar 16 17:19:55 crc kubenswrapper[5120]: I0316 17:19:55.939574 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hplzn\" (UniqueName: \"kubernetes.io/projected/7c65ae5a-f219-400e-8b08-7ed5f3860761-kube-api-access-hplzn\") pod \"neutron-metadata-edpm-compute-global-edpm-compute-global-ptgv2\" (UID: \"7c65ae5a-f219-400e-8b08-7ed5f3860761\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-global-edpm-compute-global-ptgv2" Mar 16 17:19:55 crc kubenswrapper[5120]: I0316 17:19:55.939597 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/7c65ae5a-f219-400e-8b08-7ed5f3860761-inventory\") pod \"neutron-metadata-edpm-compute-global-edpm-compute-global-ptgv2\" (UID: \"7c65ae5a-f219-400e-8b08-7ed5f3860761\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-global-edpm-compute-global-ptgv2" Mar 16 17:19:55 crc kubenswrapper[5120]: I0316 17:19:55.939666 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/7c65ae5a-f219-400e-8b08-7ed5f3860761-ssh-key-edpm-compute-global\") pod \"neutron-metadata-edpm-compute-global-edpm-compute-global-ptgv2\" (UID: \"7c65ae5a-f219-400e-8b08-7ed5f3860761\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-global-edpm-compute-global-ptgv2" Mar 16 17:19:55 crc kubenswrapper[5120]: I0316 17:19:55.940484 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-metadata-neutron-config-1\" (UniqueName: \"kubernetes.io/secret/7c65ae5a-f219-400e-8b08-7ed5f3860761-nova-metadata-neutron-config-1\") pod \"neutron-metadata-edpm-compute-global-edpm-compute-global-ptgv2\" (UID: \"7c65ae5a-f219-400e-8b08-7ed5f3860761\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-global-edpm-compute-global-ptgv2" Mar 16 17:19:55 crc kubenswrapper[5120]: I0316 17:19:55.940654 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-metadata-neutron-config-2\" (UniqueName: \"kubernetes.io/secret/7c65ae5a-f219-400e-8b08-7ed5f3860761-nova-metadata-neutron-config-2\") pod \"neutron-metadata-edpm-compute-global-edpm-compute-global-ptgv2\" (UID: \"7c65ae5a-f219-400e-8b08-7ed5f3860761\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-global-edpm-compute-global-ptgv2" Mar 16 17:19:55 crc kubenswrapper[5120]: I0316 17:19:55.944313 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"neutron-ovn-metadata-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/7c65ae5a-f219-400e-8b08-7ed5f3860761-neutron-ovn-metadata-agent-neutron-config-0\") pod \"neutron-metadata-edpm-compute-global-edpm-compute-global-ptgv2\" (UID: \"7c65ae5a-f219-400e-8b08-7ed5f3860761\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-global-edpm-compute-global-ptgv2" Mar 16 17:19:55 crc kubenswrapper[5120]: I0316 17:19:55.944626 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-metadata-neutron-config-2\" (UniqueName: \"kubernetes.io/secret/7c65ae5a-f219-400e-8b08-7ed5f3860761-nova-metadata-neutron-config-2\") pod \"neutron-metadata-edpm-compute-global-edpm-compute-global-ptgv2\" (UID: \"7c65ae5a-f219-400e-8b08-7ed5f3860761\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-global-edpm-compute-global-ptgv2" Mar 16 17:19:55 crc kubenswrapper[5120]: I0316 17:19:55.944734 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/7c65ae5a-f219-400e-8b08-7ed5f3860761-inventory\") pod \"neutron-metadata-edpm-compute-global-edpm-compute-global-ptgv2\" (UID: \"7c65ae5a-f219-400e-8b08-7ed5f3860761\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-global-edpm-compute-global-ptgv2" Mar 16 17:19:55 crc kubenswrapper[5120]: I0316 17:19:55.948127 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"neutron-metadata-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7c65ae5a-f219-400e-8b08-7ed5f3860761-neutron-metadata-combined-ca-bundle\") pod \"neutron-metadata-edpm-compute-global-edpm-compute-global-ptgv2\" (UID: \"7c65ae5a-f219-400e-8b08-7ed5f3860761\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-global-edpm-compute-global-ptgv2" Mar 16 17:19:55 crc kubenswrapper[5120]: I0316 17:19:55.948301 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-metadata-neutron-config-1\" (UniqueName: \"kubernetes.io/secret/7c65ae5a-f219-400e-8b08-7ed5f3860761-nova-metadata-neutron-config-1\") pod \"neutron-metadata-edpm-compute-global-edpm-compute-global-ptgv2\" (UID: \"7c65ae5a-f219-400e-8b08-7ed5f3860761\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-global-edpm-compute-global-ptgv2" Mar 16 17:19:55 crc kubenswrapper[5120]: I0316 17:19:55.948573 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-metadata-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/7c65ae5a-f219-400e-8b08-7ed5f3860761-nova-metadata-neutron-config-0\") pod \"neutron-metadata-edpm-compute-global-edpm-compute-global-ptgv2\" (UID: \"7c65ae5a-f219-400e-8b08-7ed5f3860761\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-global-edpm-compute-global-ptgv2" Mar 16 17:19:55 crc kubenswrapper[5120]: I0316 17:19:55.949120 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/7c65ae5a-f219-400e-8b08-7ed5f3860761-ssh-key-edpm-compute-global\") pod \"neutron-metadata-edpm-compute-global-edpm-compute-global-ptgv2\" (UID: \"7c65ae5a-f219-400e-8b08-7ed5f3860761\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-global-edpm-compute-global-ptgv2" Mar 16 17:19:55 crc kubenswrapper[5120]: I0316 17:19:55.958254 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hplzn\" (UniqueName: \"kubernetes.io/projected/7c65ae5a-f219-400e-8b08-7ed5f3860761-kube-api-access-hplzn\") pod \"neutron-metadata-edpm-compute-global-edpm-compute-global-ptgv2\" (UID: \"7c65ae5a-f219-400e-8b08-7ed5f3860761\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-global-edpm-compute-global-ptgv2" Mar 16 17:19:56 crc kubenswrapper[5120]: I0316 17:19:56.049561 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-global-edpm-compute-global-ptgv2" Mar 16 17:19:56 crc kubenswrapper[5120]: I0316 17:19:56.469726 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-metadata-edpm-compute-global-edpm-compute-global-ptgv2"] Mar 16 17:19:56 crc kubenswrapper[5120]: W0316 17:19:56.488109 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7c65ae5a_f219_400e_8b08_7ed5f3860761.slice/crio-e3b7a990cb0b61beacccbe84e0a4fb60caaf53099aeeadfdbe56681f6a4624aa WatchSource:0}: Error finding container e3b7a990cb0b61beacccbe84e0a4fb60caaf53099aeeadfdbe56681f6a4624aa: Status 404 returned error can't find the container with id e3b7a990cb0b61beacccbe84e0a4fb60caaf53099aeeadfdbe56681f6a4624aa Mar 16 17:19:56 crc kubenswrapper[5120]: I0316 17:19:56.676573 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-global-edpm-compute-global-ptgv2" event={"ID":"7c65ae5a-f219-400e-8b08-7ed5f3860761","Type":"ContainerStarted","Data":"e3b7a990cb0b61beacccbe84e0a4fb60caaf53099aeeadfdbe56681f6a4624aa"} Mar 16 17:19:57 crc kubenswrapper[5120]: I0316 17:19:57.686212 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-global-edpm-compute-global-ptgv2" event={"ID":"7c65ae5a-f219-400e-8b08-7ed5f3860761","Type":"ContainerStarted","Data":"f5f52fb8379751eb34baf9768d46258cbf383a5789015ac8a5c3d5219444fc8b"} Mar 16 17:19:57 crc kubenswrapper[5120]: I0316 17:19:57.709287 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-global-edpm-compute-global-ptgv2" podStartSLOduration=2.168875087 podStartE2EDuration="2.709269194s" podCreationTimestamp="2026-03-16 17:19:55 +0000 UTC" firstStartedPulling="2026-03-16 17:19:56.490584903 +0000 UTC m=+6498.644516560" lastFinishedPulling="2026-03-16 17:19:57.03097901 +0000 UTC m=+6499.184910667" observedRunningTime="2026-03-16 17:19:57.703303131 +0000 UTC m=+6499.857234798" watchObservedRunningTime="2026-03-16 17:19:57.709269194 +0000 UTC m=+6499.863200851" Mar 16 17:19:58 crc kubenswrapper[5120]: I0316 17:19:58.698165 5120 generic.go:358] "Generic (PLEG): container finished" podID="7c65ae5a-f219-400e-8b08-7ed5f3860761" containerID="f5f52fb8379751eb34baf9768d46258cbf383a5789015ac8a5c3d5219444fc8b" exitCode=0 Mar 16 17:19:58 crc kubenswrapper[5120]: I0316 17:19:58.698232 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-global-edpm-compute-global-ptgv2" event={"ID":"7c65ae5a-f219-400e-8b08-7ed5f3860761","Type":"ContainerDied","Data":"f5f52fb8379751eb34baf9768d46258cbf383a5789015ac8a5c3d5219444fc8b"} Mar 16 17:20:00 crc kubenswrapper[5120]: I0316 17:20:00.011523 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-global-edpm-compute-global-ptgv2" Mar 16 17:20:00 crc kubenswrapper[5120]: I0316 17:20:00.122965 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-infra/auto-csr-approver-29561360-spmdl"] Mar 16 17:20:00 crc kubenswrapper[5120]: I0316 17:20:00.123878 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c65ae5a-f219-400e-8b08-7ed5f3860761" containerName="neutron-metadata-edpm-compute-global-edpm-compute-global" Mar 16 17:20:00 crc kubenswrapper[5120]: I0316 17:20:00.123897 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c65ae5a-f219-400e-8b08-7ed5f3860761" containerName="neutron-metadata-edpm-compute-global-edpm-compute-global" Mar 16 17:20:00 crc kubenswrapper[5120]: I0316 17:20:00.124063 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7c65ae5a-f219-400e-8b08-7ed5f3860761" containerName="neutron-metadata-edpm-compute-global-edpm-compute-global" Mar 16 17:20:00 crc kubenswrapper[5120]: I0316 17:20:00.128313 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"neutron-ovn-metadata-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/7c65ae5a-f219-400e-8b08-7ed5f3860761-neutron-ovn-metadata-agent-neutron-config-0\") pod \"7c65ae5a-f219-400e-8b08-7ed5f3860761\" (UID: \"7c65ae5a-f219-400e-8b08-7ed5f3860761\") " Mar 16 17:20:00 crc kubenswrapper[5120]: I0316 17:20:00.128544 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-metadata-neutron-config-1\" (UniqueName: \"kubernetes.io/secret/7c65ae5a-f219-400e-8b08-7ed5f3860761-nova-metadata-neutron-config-1\") pod \"7c65ae5a-f219-400e-8b08-7ed5f3860761\" (UID: \"7c65ae5a-f219-400e-8b08-7ed5f3860761\") " Mar 16 17:20:00 crc kubenswrapper[5120]: I0316 17:20:00.128606 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-metadata-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/7c65ae5a-f219-400e-8b08-7ed5f3860761-nova-metadata-neutron-config-0\") pod \"7c65ae5a-f219-400e-8b08-7ed5f3860761\" (UID: \"7c65ae5a-f219-400e-8b08-7ed5f3860761\") " Mar 16 17:20:00 crc kubenswrapper[5120]: I0316 17:20:00.128743 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hplzn\" (UniqueName: \"kubernetes.io/projected/7c65ae5a-f219-400e-8b08-7ed5f3860761-kube-api-access-hplzn\") pod \"7c65ae5a-f219-400e-8b08-7ed5f3860761\" (UID: \"7c65ae5a-f219-400e-8b08-7ed5f3860761\") " Mar 16 17:20:00 crc kubenswrapper[5120]: I0316 17:20:00.128797 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/7c65ae5a-f219-400e-8b08-7ed5f3860761-inventory\") pod \"7c65ae5a-f219-400e-8b08-7ed5f3860761\" (UID: \"7c65ae5a-f219-400e-8b08-7ed5f3860761\") " Mar 16 17:20:00 crc kubenswrapper[5120]: I0316 17:20:00.128866 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"neutron-metadata-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7c65ae5a-f219-400e-8b08-7ed5f3860761-neutron-metadata-combined-ca-bundle\") pod \"7c65ae5a-f219-400e-8b08-7ed5f3860761\" (UID: \"7c65ae5a-f219-400e-8b08-7ed5f3860761\") " Mar 16 17:20:00 crc kubenswrapper[5120]: I0316 17:20:00.128908 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-metadata-neutron-config-2\" (UniqueName: \"kubernetes.io/secret/7c65ae5a-f219-400e-8b08-7ed5f3860761-nova-metadata-neutron-config-2\") pod \"7c65ae5a-f219-400e-8b08-7ed5f3860761\" (UID: \"7c65ae5a-f219-400e-8b08-7ed5f3860761\") " Mar 16 17:20:00 crc kubenswrapper[5120]: I0316 17:20:00.128923 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/7c65ae5a-f219-400e-8b08-7ed5f3860761-ssh-key-edpm-compute-global\") pod \"7c65ae5a-f219-400e-8b08-7ed5f3860761\" (UID: \"7c65ae5a-f219-400e-8b08-7ed5f3860761\") " Mar 16 17:20:00 crc kubenswrapper[5120]: I0316 17:20:00.129497 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561360-spmdl" Mar 16 17:20:00 crc kubenswrapper[5120]: I0316 17:20:00.133305 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"kube-root-ca.crt\"" Mar 16 17:20:00 crc kubenswrapper[5120]: I0316 17:20:00.133316 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-infra\"/\"csr-approver-sa-dockercfg-x2nsz\"" Mar 16 17:20:00 crc kubenswrapper[5120]: I0316 17:20:00.133968 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561360-spmdl"] Mar 16 17:20:00 crc kubenswrapper[5120]: I0316 17:20:00.134522 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"openshift-service-ca.crt\"" Mar 16 17:20:00 crc kubenswrapper[5120]: I0316 17:20:00.135148 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c65ae5a-f219-400e-8b08-7ed5f3860761-neutron-metadata-combined-ca-bundle" (OuterVolumeSpecName: "neutron-metadata-combined-ca-bundle") pod "7c65ae5a-f219-400e-8b08-7ed5f3860761" (UID: "7c65ae5a-f219-400e-8b08-7ed5f3860761"). InnerVolumeSpecName "neutron-metadata-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:20:00 crc kubenswrapper[5120]: I0316 17:20:00.140385 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c65ae5a-f219-400e-8b08-7ed5f3860761-kube-api-access-hplzn" (OuterVolumeSpecName: "kube-api-access-hplzn") pod "7c65ae5a-f219-400e-8b08-7ed5f3860761" (UID: "7c65ae5a-f219-400e-8b08-7ed5f3860761"). InnerVolumeSpecName "kube-api-access-hplzn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:20:00 crc kubenswrapper[5120]: I0316 17:20:00.154823 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c65ae5a-f219-400e-8b08-7ed5f3860761-inventory" (OuterVolumeSpecName: "inventory") pod "7c65ae5a-f219-400e-8b08-7ed5f3860761" (UID: "7c65ae5a-f219-400e-8b08-7ed5f3860761"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:20:00 crc kubenswrapper[5120]: I0316 17:20:00.154994 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c65ae5a-f219-400e-8b08-7ed5f3860761-nova-metadata-neutron-config-0" (OuterVolumeSpecName: "nova-metadata-neutron-config-0") pod "7c65ae5a-f219-400e-8b08-7ed5f3860761" (UID: "7c65ae5a-f219-400e-8b08-7ed5f3860761"). InnerVolumeSpecName "nova-metadata-neutron-config-0". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:20:00 crc kubenswrapper[5120]: I0316 17:20:00.155473 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c65ae5a-f219-400e-8b08-7ed5f3860761-nova-metadata-neutron-config-2" (OuterVolumeSpecName: "nova-metadata-neutron-config-2") pod "7c65ae5a-f219-400e-8b08-7ed5f3860761" (UID: "7c65ae5a-f219-400e-8b08-7ed5f3860761"). InnerVolumeSpecName "nova-metadata-neutron-config-2". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:20:00 crc kubenswrapper[5120]: I0316 17:20:00.156440 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c65ae5a-f219-400e-8b08-7ed5f3860761-ssh-key-edpm-compute-global" (OuterVolumeSpecName: "ssh-key-edpm-compute-global") pod "7c65ae5a-f219-400e-8b08-7ed5f3860761" (UID: "7c65ae5a-f219-400e-8b08-7ed5f3860761"). InnerVolumeSpecName "ssh-key-edpm-compute-global". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:20:00 crc kubenswrapper[5120]: I0316 17:20:00.156581 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c65ae5a-f219-400e-8b08-7ed5f3860761-neutron-ovn-metadata-agent-neutron-config-0" (OuterVolumeSpecName: "neutron-ovn-metadata-agent-neutron-config-0") pod "7c65ae5a-f219-400e-8b08-7ed5f3860761" (UID: "7c65ae5a-f219-400e-8b08-7ed5f3860761"). InnerVolumeSpecName "neutron-ovn-metadata-agent-neutron-config-0". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:20:00 crc kubenswrapper[5120]: I0316 17:20:00.163227 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c65ae5a-f219-400e-8b08-7ed5f3860761-nova-metadata-neutron-config-1" (OuterVolumeSpecName: "nova-metadata-neutron-config-1") pod "7c65ae5a-f219-400e-8b08-7ed5f3860761" (UID: "7c65ae5a-f219-400e-8b08-7ed5f3860761"). InnerVolumeSpecName "nova-metadata-neutron-config-1". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:20:00 crc kubenswrapper[5120]: I0316 17:20:00.231013 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmp6m\" (UniqueName: \"kubernetes.io/projected/f5f45330-0cbc-42c0-9485-2495bc41b1d6-kube-api-access-pmp6m\") pod \"auto-csr-approver-29561360-spmdl\" (UID: \"f5f45330-0cbc-42c0-9485-2495bc41b1d6\") " pod="openshift-infra/auto-csr-approver-29561360-spmdl" Mar 16 17:20:00 crc kubenswrapper[5120]: I0316 17:20:00.231277 5120 reconciler_common.go:299] "Volume detached for volume \"nova-metadata-neutron-config-1\" (UniqueName: \"kubernetes.io/secret/7c65ae5a-f219-400e-8b08-7ed5f3860761-nova-metadata-neutron-config-1\") on node \"crc\" DevicePath \"\"" Mar 16 17:20:00 crc kubenswrapper[5120]: I0316 17:20:00.231290 5120 reconciler_common.go:299] "Volume detached for volume \"nova-metadata-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/7c65ae5a-f219-400e-8b08-7ed5f3860761-nova-metadata-neutron-config-0\") on node \"crc\" DevicePath \"\"" Mar 16 17:20:00 crc kubenswrapper[5120]: I0316 17:20:00.231300 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hplzn\" (UniqueName: \"kubernetes.io/projected/7c65ae5a-f219-400e-8b08-7ed5f3860761-kube-api-access-hplzn\") on node \"crc\" DevicePath \"\"" Mar 16 17:20:00 crc kubenswrapper[5120]: I0316 17:20:00.231311 5120 reconciler_common.go:299] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/7c65ae5a-f219-400e-8b08-7ed5f3860761-inventory\") on node \"crc\" DevicePath \"\"" Mar 16 17:20:00 crc kubenswrapper[5120]: I0316 17:20:00.231320 5120 reconciler_common.go:299] "Volume detached for volume \"neutron-metadata-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7c65ae5a-f219-400e-8b08-7ed5f3860761-neutron-metadata-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:20:00 crc kubenswrapper[5120]: I0316 17:20:00.231330 5120 reconciler_common.go:299] "Volume detached for volume \"nova-metadata-neutron-config-2\" (UniqueName: \"kubernetes.io/secret/7c65ae5a-f219-400e-8b08-7ed5f3860761-nova-metadata-neutron-config-2\") on node \"crc\" DevicePath \"\"" Mar 16 17:20:00 crc kubenswrapper[5120]: I0316 17:20:00.231340 5120 reconciler_common.go:299] "Volume detached for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/7c65ae5a-f219-400e-8b08-7ed5f3860761-ssh-key-edpm-compute-global\") on node \"crc\" DevicePath \"\"" Mar 16 17:20:00 crc kubenswrapper[5120]: I0316 17:20:00.231350 5120 reconciler_common.go:299] "Volume detached for volume \"neutron-ovn-metadata-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/7c65ae5a-f219-400e-8b08-7ed5f3860761-neutron-ovn-metadata-agent-neutron-config-0\") on node \"crc\" DevicePath \"\"" Mar 16 17:20:00 crc kubenswrapper[5120]: I0316 17:20:00.332939 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pmp6m\" (UniqueName: \"kubernetes.io/projected/f5f45330-0cbc-42c0-9485-2495bc41b1d6-kube-api-access-pmp6m\") pod \"auto-csr-approver-29561360-spmdl\" (UID: \"f5f45330-0cbc-42c0-9485-2495bc41b1d6\") " pod="openshift-infra/auto-csr-approver-29561360-spmdl" Mar 16 17:20:00 crc kubenswrapper[5120]: I0316 17:20:00.350300 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmp6m\" (UniqueName: \"kubernetes.io/projected/f5f45330-0cbc-42c0-9485-2495bc41b1d6-kube-api-access-pmp6m\") pod \"auto-csr-approver-29561360-spmdl\" (UID: \"f5f45330-0cbc-42c0-9485-2495bc41b1d6\") " pod="openshift-infra/auto-csr-approver-29561360-spmdl" Mar 16 17:20:00 crc kubenswrapper[5120]: I0316 17:20:00.511943 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561360-spmdl" Mar 16 17:20:00 crc kubenswrapper[5120]: I0316 17:20:00.755928 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-global-edpm-compute-global-ptgv2" Mar 16 17:20:00 crc kubenswrapper[5120]: I0316 17:20:00.756062 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-global-edpm-compute-global-ptgv2" event={"ID":"7c65ae5a-f219-400e-8b08-7ed5f3860761","Type":"ContainerDied","Data":"e3b7a990cb0b61beacccbe84e0a4fb60caaf53099aeeadfdbe56681f6a4624aa"} Mar 16 17:20:00 crc kubenswrapper[5120]: I0316 17:20:00.756145 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e3b7a990cb0b61beacccbe84e0a4fb60caaf53099aeeadfdbe56681f6a4624aa" Mar 16 17:20:00 crc kubenswrapper[5120]: I0316 17:20:00.788582 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-ovn-edpm-compute-global-edpm-compute-global-fqjh6"] Mar 16 17:20:00 crc kubenswrapper[5120]: I0316 17:20:00.804070 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-ovn-edpm-compute-global-edpm-compute-global-fqjh6"] Mar 16 17:20:00 crc kubenswrapper[5120]: I0316 17:20:00.804115 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-ovn-edpm-compute-global-edpm-compute-global-fqjh6" Mar 16 17:20:00 crc kubenswrapper[5120]: I0316 17:20:00.808525 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplanenodeset-edpm-compute-global\"" Mar 16 17:20:00 crc kubenswrapper[5120]: I0316 17:20:00.808566 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-metadata-neutron-config\"" Mar 16 17:20:00 crc kubenswrapper[5120]: I0316 17:20:00.808670 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplane-ansible-ssh-private-key-secret\"" Mar 16 17:20:00 crc kubenswrapper[5120]: I0316 17:20:00.810714 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"combined-ca-bundle\"" Mar 16 17:20:00 crc kubenswrapper[5120]: I0316 17:20:00.811144 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"edpm-compute-global-dockercfg-5hp85\"" Mar 16 17:20:00 crc kubenswrapper[5120]: I0316 17:20:00.811220 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-aee-default-env\"" Mar 16 17:20:00 crc kubenswrapper[5120]: I0316 17:20:00.811599 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-ovn-agent-neutron-config\"" Mar 16 17:20:00 crc kubenswrapper[5120]: I0316 17:20:00.928731 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561360-spmdl"] Mar 16 17:20:00 crc kubenswrapper[5120]: W0316 17:20:00.930000 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf5f45330_0cbc_42c0_9485_2495bc41b1d6.slice/crio-e919cab85bbc1eaca78f94c6da01fa7bf17ce92ceefab2ac6a5841aaf75c62bf WatchSource:0}: Error finding container e919cab85bbc1eaca78f94c6da01fa7bf17ce92ceefab2ac6a5841aaf75c62bf: Status 404 returned error can't find the container with id e919cab85bbc1eaca78f94c6da01fa7bf17ce92ceefab2ac6a5841aaf75c62bf Mar 16 17:20:00 crc kubenswrapper[5120]: I0316 17:20:00.947791 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-neutron-config-2\" (UniqueName: \"kubernetes.io/secret/81b58ad6-2d7d-48bc-b63e-3d6274ab1257-nova-metadata-neutron-config-2\") pod \"neutron-ovn-edpm-compute-global-edpm-compute-global-fqjh6\" (UID: \"81b58ad6-2d7d-48bc-b63e-3d6274ab1257\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-compute-global-edpm-compute-global-fqjh6" Mar 16 17:20:00 crc kubenswrapper[5120]: I0316 17:20:00.948489 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cb9h4\" (UniqueName: \"kubernetes.io/projected/81b58ad6-2d7d-48bc-b63e-3d6274ab1257-kube-api-access-cb9h4\") pod \"neutron-ovn-edpm-compute-global-edpm-compute-global-fqjh6\" (UID: \"81b58ad6-2d7d-48bc-b63e-3d6274ab1257\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-compute-global-edpm-compute-global-fqjh6" Mar 16 17:20:00 crc kubenswrapper[5120]: I0316 17:20:00.948551 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"neutron-ovn-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/81b58ad6-2d7d-48bc-b63e-3d6274ab1257-neutron-ovn-agent-neutron-config-0\") pod \"neutron-ovn-edpm-compute-global-edpm-compute-global-fqjh6\" (UID: \"81b58ad6-2d7d-48bc-b63e-3d6274ab1257\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-compute-global-edpm-compute-global-fqjh6" Mar 16 17:20:00 crc kubenswrapper[5120]: I0316 17:20:00.948584 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/81b58ad6-2d7d-48bc-b63e-3d6274ab1257-nova-metadata-neutron-config-0\") pod \"neutron-ovn-edpm-compute-global-edpm-compute-global-fqjh6\" (UID: \"81b58ad6-2d7d-48bc-b63e-3d6274ab1257\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-compute-global-edpm-compute-global-fqjh6" Mar 16 17:20:00 crc kubenswrapper[5120]: I0316 17:20:00.948653 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/81b58ad6-2d7d-48bc-b63e-3d6274ab1257-ssh-key-edpm-compute-global\") pod \"neutron-ovn-edpm-compute-global-edpm-compute-global-fqjh6\" (UID: \"81b58ad6-2d7d-48bc-b63e-3d6274ab1257\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-compute-global-edpm-compute-global-fqjh6" Mar 16 17:20:00 crc kubenswrapper[5120]: I0316 17:20:00.948784 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/81b58ad6-2d7d-48bc-b63e-3d6274ab1257-inventory\") pod \"neutron-ovn-edpm-compute-global-edpm-compute-global-fqjh6\" (UID: \"81b58ad6-2d7d-48bc-b63e-3d6274ab1257\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-compute-global-edpm-compute-global-fqjh6" Mar 16 17:20:00 crc kubenswrapper[5120]: I0316 17:20:00.948843 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-neutron-config-1\" (UniqueName: \"kubernetes.io/secret/81b58ad6-2d7d-48bc-b63e-3d6274ab1257-nova-metadata-neutron-config-1\") pod \"neutron-ovn-edpm-compute-global-edpm-compute-global-fqjh6\" (UID: \"81b58ad6-2d7d-48bc-b63e-3d6274ab1257\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-compute-global-edpm-compute-global-fqjh6" Mar 16 17:20:00 crc kubenswrapper[5120]: I0316 17:20:00.948897 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"neutron-ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/81b58ad6-2d7d-48bc-b63e-3d6274ab1257-neutron-ovn-combined-ca-bundle\") pod \"neutron-ovn-edpm-compute-global-edpm-compute-global-fqjh6\" (UID: \"81b58ad6-2d7d-48bc-b63e-3d6274ab1257\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-compute-global-edpm-compute-global-fqjh6" Mar 16 17:20:01 crc kubenswrapper[5120]: I0316 17:20:01.050851 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-metadata-neutron-config-2\" (UniqueName: \"kubernetes.io/secret/81b58ad6-2d7d-48bc-b63e-3d6274ab1257-nova-metadata-neutron-config-2\") pod \"neutron-ovn-edpm-compute-global-edpm-compute-global-fqjh6\" (UID: \"81b58ad6-2d7d-48bc-b63e-3d6274ab1257\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-compute-global-edpm-compute-global-fqjh6" Mar 16 17:20:01 crc kubenswrapper[5120]: I0316 17:20:01.050974 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cb9h4\" (UniqueName: \"kubernetes.io/projected/81b58ad6-2d7d-48bc-b63e-3d6274ab1257-kube-api-access-cb9h4\") pod \"neutron-ovn-edpm-compute-global-edpm-compute-global-fqjh6\" (UID: \"81b58ad6-2d7d-48bc-b63e-3d6274ab1257\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-compute-global-edpm-compute-global-fqjh6" Mar 16 17:20:01 crc kubenswrapper[5120]: I0316 17:20:01.051043 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"neutron-ovn-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/81b58ad6-2d7d-48bc-b63e-3d6274ab1257-neutron-ovn-agent-neutron-config-0\") pod \"neutron-ovn-edpm-compute-global-edpm-compute-global-fqjh6\" (UID: \"81b58ad6-2d7d-48bc-b63e-3d6274ab1257\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-compute-global-edpm-compute-global-fqjh6" Mar 16 17:20:01 crc kubenswrapper[5120]: I0316 17:20:01.051078 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-metadata-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/81b58ad6-2d7d-48bc-b63e-3d6274ab1257-nova-metadata-neutron-config-0\") pod \"neutron-ovn-edpm-compute-global-edpm-compute-global-fqjh6\" (UID: \"81b58ad6-2d7d-48bc-b63e-3d6274ab1257\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-compute-global-edpm-compute-global-fqjh6" Mar 16 17:20:01 crc kubenswrapper[5120]: I0316 17:20:01.051135 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/81b58ad6-2d7d-48bc-b63e-3d6274ab1257-ssh-key-edpm-compute-global\") pod \"neutron-ovn-edpm-compute-global-edpm-compute-global-fqjh6\" (UID: \"81b58ad6-2d7d-48bc-b63e-3d6274ab1257\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-compute-global-edpm-compute-global-fqjh6" Mar 16 17:20:01 crc kubenswrapper[5120]: I0316 17:20:01.051213 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/81b58ad6-2d7d-48bc-b63e-3d6274ab1257-inventory\") pod \"neutron-ovn-edpm-compute-global-edpm-compute-global-fqjh6\" (UID: \"81b58ad6-2d7d-48bc-b63e-3d6274ab1257\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-compute-global-edpm-compute-global-fqjh6" Mar 16 17:20:01 crc kubenswrapper[5120]: I0316 17:20:01.051248 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-metadata-neutron-config-1\" (UniqueName: \"kubernetes.io/secret/81b58ad6-2d7d-48bc-b63e-3d6274ab1257-nova-metadata-neutron-config-1\") pod \"neutron-ovn-edpm-compute-global-edpm-compute-global-fqjh6\" (UID: \"81b58ad6-2d7d-48bc-b63e-3d6274ab1257\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-compute-global-edpm-compute-global-fqjh6" Mar 16 17:20:01 crc kubenswrapper[5120]: I0316 17:20:01.051310 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"neutron-ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/81b58ad6-2d7d-48bc-b63e-3d6274ab1257-neutron-ovn-combined-ca-bundle\") pod \"neutron-ovn-edpm-compute-global-edpm-compute-global-fqjh6\" (UID: \"81b58ad6-2d7d-48bc-b63e-3d6274ab1257\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-compute-global-edpm-compute-global-fqjh6" Mar 16 17:20:01 crc kubenswrapper[5120]: I0316 17:20:01.060237 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/81b58ad6-2d7d-48bc-b63e-3d6274ab1257-inventory\") pod \"neutron-ovn-edpm-compute-global-edpm-compute-global-fqjh6\" (UID: \"81b58ad6-2d7d-48bc-b63e-3d6274ab1257\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-compute-global-edpm-compute-global-fqjh6" Mar 16 17:20:01 crc kubenswrapper[5120]: I0316 17:20:01.060270 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-metadata-neutron-config-1\" (UniqueName: \"kubernetes.io/secret/81b58ad6-2d7d-48bc-b63e-3d6274ab1257-nova-metadata-neutron-config-1\") pod \"neutron-ovn-edpm-compute-global-edpm-compute-global-fqjh6\" (UID: \"81b58ad6-2d7d-48bc-b63e-3d6274ab1257\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-compute-global-edpm-compute-global-fqjh6" Mar 16 17:20:01 crc kubenswrapper[5120]: I0316 17:20:01.060389 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"neutron-ovn-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/81b58ad6-2d7d-48bc-b63e-3d6274ab1257-neutron-ovn-agent-neutron-config-0\") pod \"neutron-ovn-edpm-compute-global-edpm-compute-global-fqjh6\" (UID: \"81b58ad6-2d7d-48bc-b63e-3d6274ab1257\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-compute-global-edpm-compute-global-fqjh6" Mar 16 17:20:01 crc kubenswrapper[5120]: I0316 17:20:01.060557 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/81b58ad6-2d7d-48bc-b63e-3d6274ab1257-ssh-key-edpm-compute-global\") pod \"neutron-ovn-edpm-compute-global-edpm-compute-global-fqjh6\" (UID: \"81b58ad6-2d7d-48bc-b63e-3d6274ab1257\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-compute-global-edpm-compute-global-fqjh6" Mar 16 17:20:01 crc kubenswrapper[5120]: I0316 17:20:01.061175 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-metadata-neutron-config-2\" (UniqueName: \"kubernetes.io/secret/81b58ad6-2d7d-48bc-b63e-3d6274ab1257-nova-metadata-neutron-config-2\") pod \"neutron-ovn-edpm-compute-global-edpm-compute-global-fqjh6\" (UID: \"81b58ad6-2d7d-48bc-b63e-3d6274ab1257\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-compute-global-edpm-compute-global-fqjh6" Mar 16 17:20:01 crc kubenswrapper[5120]: I0316 17:20:01.061694 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"neutron-ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/81b58ad6-2d7d-48bc-b63e-3d6274ab1257-neutron-ovn-combined-ca-bundle\") pod \"neutron-ovn-edpm-compute-global-edpm-compute-global-fqjh6\" (UID: \"81b58ad6-2d7d-48bc-b63e-3d6274ab1257\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-compute-global-edpm-compute-global-fqjh6" Mar 16 17:20:01 crc kubenswrapper[5120]: I0316 17:20:01.061697 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-metadata-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/81b58ad6-2d7d-48bc-b63e-3d6274ab1257-nova-metadata-neutron-config-0\") pod \"neutron-ovn-edpm-compute-global-edpm-compute-global-fqjh6\" (UID: \"81b58ad6-2d7d-48bc-b63e-3d6274ab1257\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-compute-global-edpm-compute-global-fqjh6" Mar 16 17:20:01 crc kubenswrapper[5120]: I0316 17:20:01.072662 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cb9h4\" (UniqueName: \"kubernetes.io/projected/81b58ad6-2d7d-48bc-b63e-3d6274ab1257-kube-api-access-cb9h4\") pod \"neutron-ovn-edpm-compute-global-edpm-compute-global-fqjh6\" (UID: \"81b58ad6-2d7d-48bc-b63e-3d6274ab1257\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-compute-global-edpm-compute-global-fqjh6" Mar 16 17:20:01 crc kubenswrapper[5120]: I0316 17:20:01.123257 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-ovn-edpm-compute-global-edpm-compute-global-fqjh6" Mar 16 17:20:01 crc kubenswrapper[5120]: I0316 17:20:01.567408 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-ovn-edpm-compute-global-edpm-compute-global-fqjh6"] Mar 16 17:20:01 crc kubenswrapper[5120]: I0316 17:20:01.766139 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-ovn-edpm-compute-global-edpm-compute-global-fqjh6" event={"ID":"81b58ad6-2d7d-48bc-b63e-3d6274ab1257","Type":"ContainerStarted","Data":"278c1b3498f6f1c7667eaa9fe3cc569c482e7b07de98c89a24ab33d13d5e9f1d"} Mar 16 17:20:01 crc kubenswrapper[5120]: I0316 17:20:01.767910 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561360-spmdl" event={"ID":"f5f45330-0cbc-42c0-9485-2495bc41b1d6","Type":"ContainerStarted","Data":"e919cab85bbc1eaca78f94c6da01fa7bf17ce92ceefab2ac6a5841aaf75c62bf"} Mar 16 17:20:02 crc kubenswrapper[5120]: I0316 17:20:02.781245 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-ovn-edpm-compute-global-edpm-compute-global-fqjh6" event={"ID":"81b58ad6-2d7d-48bc-b63e-3d6274ab1257","Type":"ContainerStarted","Data":"7e4613b63abd7a9ba8a958d75e431bbb4741e9a03a6efc019a4ad419bd12b76f"} Mar 16 17:20:02 crc kubenswrapper[5120]: I0316 17:20:02.811242 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-ovn-edpm-compute-global-edpm-compute-global-fqjh6" podStartSLOduration=2.172946084 podStartE2EDuration="2.811225155s" podCreationTimestamp="2026-03-16 17:20:00 +0000 UTC" firstStartedPulling="2026-03-16 17:20:01.565546117 +0000 UTC m=+6503.719477774" lastFinishedPulling="2026-03-16 17:20:02.203825188 +0000 UTC m=+6504.357756845" observedRunningTime="2026-03-16 17:20:02.807984207 +0000 UTC m=+6504.961915914" watchObservedRunningTime="2026-03-16 17:20:02.811225155 +0000 UTC m=+6504.965156812" Mar 16 17:20:03 crc kubenswrapper[5120]: I0316 17:20:03.791636 5120 generic.go:358] "Generic (PLEG): container finished" podID="81b58ad6-2d7d-48bc-b63e-3d6274ab1257" containerID="7e4613b63abd7a9ba8a958d75e431bbb4741e9a03a6efc019a4ad419bd12b76f" exitCode=0 Mar 16 17:20:03 crc kubenswrapper[5120]: I0316 17:20:03.791680 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-ovn-edpm-compute-global-edpm-compute-global-fqjh6" event={"ID":"81b58ad6-2d7d-48bc-b63e-3d6274ab1257","Type":"ContainerDied","Data":"7e4613b63abd7a9ba8a958d75e431bbb4741e9a03a6efc019a4ad419bd12b76f"} Mar 16 17:20:03 crc kubenswrapper[5120]: I0316 17:20:03.796017 5120 generic.go:358] "Generic (PLEG): container finished" podID="f5f45330-0cbc-42c0-9485-2495bc41b1d6" containerID="74071e54972f8b578c51149c44e1a701bf0ad1014b41797c40d6f94335cd1843" exitCode=0 Mar 16 17:20:03 crc kubenswrapper[5120]: I0316 17:20:03.796142 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561360-spmdl" event={"ID":"f5f45330-0cbc-42c0-9485-2495bc41b1d6","Type":"ContainerDied","Data":"74071e54972f8b578c51149c44e1a701bf0ad1014b41797c40d6f94335cd1843"} Mar 16 17:20:05 crc kubenswrapper[5120]: I0316 17:20:05.138390 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-ovn-edpm-compute-global-edpm-compute-global-fqjh6" Mar 16 17:20:05 crc kubenswrapper[5120]: I0316 17:20:05.144102 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561360-spmdl" Mar 16 17:20:05 crc kubenswrapper[5120]: I0316 17:20:05.239061 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/81b58ad6-2d7d-48bc-b63e-3d6274ab1257-inventory\") pod \"81b58ad6-2d7d-48bc-b63e-3d6274ab1257\" (UID: \"81b58ad6-2d7d-48bc-b63e-3d6274ab1257\") " Mar 16 17:20:05 crc kubenswrapper[5120]: I0316 17:20:05.239262 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"neutron-ovn-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/81b58ad6-2d7d-48bc-b63e-3d6274ab1257-neutron-ovn-agent-neutron-config-0\") pod \"81b58ad6-2d7d-48bc-b63e-3d6274ab1257\" (UID: \"81b58ad6-2d7d-48bc-b63e-3d6274ab1257\") " Mar 16 17:20:05 crc kubenswrapper[5120]: I0316 17:20:05.239320 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pmp6m\" (UniqueName: \"kubernetes.io/projected/f5f45330-0cbc-42c0-9485-2495bc41b1d6-kube-api-access-pmp6m\") pod \"f5f45330-0cbc-42c0-9485-2495bc41b1d6\" (UID: \"f5f45330-0cbc-42c0-9485-2495bc41b1d6\") " Mar 16 17:20:05 crc kubenswrapper[5120]: I0316 17:20:05.239338 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-metadata-neutron-config-2\" (UniqueName: \"kubernetes.io/secret/81b58ad6-2d7d-48bc-b63e-3d6274ab1257-nova-metadata-neutron-config-2\") pod \"81b58ad6-2d7d-48bc-b63e-3d6274ab1257\" (UID: \"81b58ad6-2d7d-48bc-b63e-3d6274ab1257\") " Mar 16 17:20:05 crc kubenswrapper[5120]: I0316 17:20:05.239366 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cb9h4\" (UniqueName: \"kubernetes.io/projected/81b58ad6-2d7d-48bc-b63e-3d6274ab1257-kube-api-access-cb9h4\") pod \"81b58ad6-2d7d-48bc-b63e-3d6274ab1257\" (UID: \"81b58ad6-2d7d-48bc-b63e-3d6274ab1257\") " Mar 16 17:20:05 crc kubenswrapper[5120]: I0316 17:20:05.239562 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/81b58ad6-2d7d-48bc-b63e-3d6274ab1257-ssh-key-edpm-compute-global\") pod \"81b58ad6-2d7d-48bc-b63e-3d6274ab1257\" (UID: \"81b58ad6-2d7d-48bc-b63e-3d6274ab1257\") " Mar 16 17:20:05 crc kubenswrapper[5120]: I0316 17:20:05.240093 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-metadata-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/81b58ad6-2d7d-48bc-b63e-3d6274ab1257-nova-metadata-neutron-config-0\") pod \"81b58ad6-2d7d-48bc-b63e-3d6274ab1257\" (UID: \"81b58ad6-2d7d-48bc-b63e-3d6274ab1257\") " Mar 16 17:20:05 crc kubenswrapper[5120]: I0316 17:20:05.240180 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-metadata-neutron-config-1\" (UniqueName: \"kubernetes.io/secret/81b58ad6-2d7d-48bc-b63e-3d6274ab1257-nova-metadata-neutron-config-1\") pod \"81b58ad6-2d7d-48bc-b63e-3d6274ab1257\" (UID: \"81b58ad6-2d7d-48bc-b63e-3d6274ab1257\") " Mar 16 17:20:05 crc kubenswrapper[5120]: I0316 17:20:05.240236 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"neutron-ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/81b58ad6-2d7d-48bc-b63e-3d6274ab1257-neutron-ovn-combined-ca-bundle\") pod \"81b58ad6-2d7d-48bc-b63e-3d6274ab1257\" (UID: \"81b58ad6-2d7d-48bc-b63e-3d6274ab1257\") " Mar 16 17:20:05 crc kubenswrapper[5120]: I0316 17:20:05.245123 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5f45330-0cbc-42c0-9485-2495bc41b1d6-kube-api-access-pmp6m" (OuterVolumeSpecName: "kube-api-access-pmp6m") pod "f5f45330-0cbc-42c0-9485-2495bc41b1d6" (UID: "f5f45330-0cbc-42c0-9485-2495bc41b1d6"). InnerVolumeSpecName "kube-api-access-pmp6m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:20:05 crc kubenswrapper[5120]: I0316 17:20:05.246317 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/81b58ad6-2d7d-48bc-b63e-3d6274ab1257-neutron-ovn-combined-ca-bundle" (OuterVolumeSpecName: "neutron-ovn-combined-ca-bundle") pod "81b58ad6-2d7d-48bc-b63e-3d6274ab1257" (UID: "81b58ad6-2d7d-48bc-b63e-3d6274ab1257"). InnerVolumeSpecName "neutron-ovn-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:20:05 crc kubenswrapper[5120]: I0316 17:20:05.246450 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81b58ad6-2d7d-48bc-b63e-3d6274ab1257-kube-api-access-cb9h4" (OuterVolumeSpecName: "kube-api-access-cb9h4") pod "81b58ad6-2d7d-48bc-b63e-3d6274ab1257" (UID: "81b58ad6-2d7d-48bc-b63e-3d6274ab1257"). InnerVolumeSpecName "kube-api-access-cb9h4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:20:05 crc kubenswrapper[5120]: I0316 17:20:05.260883 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/81b58ad6-2d7d-48bc-b63e-3d6274ab1257-ssh-key-edpm-compute-global" (OuterVolumeSpecName: "ssh-key-edpm-compute-global") pod "81b58ad6-2d7d-48bc-b63e-3d6274ab1257" (UID: "81b58ad6-2d7d-48bc-b63e-3d6274ab1257"). InnerVolumeSpecName "ssh-key-edpm-compute-global". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:20:05 crc kubenswrapper[5120]: I0316 17:20:05.261370 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/81b58ad6-2d7d-48bc-b63e-3d6274ab1257-nova-metadata-neutron-config-2" (OuterVolumeSpecName: "nova-metadata-neutron-config-2") pod "81b58ad6-2d7d-48bc-b63e-3d6274ab1257" (UID: "81b58ad6-2d7d-48bc-b63e-3d6274ab1257"). InnerVolumeSpecName "nova-metadata-neutron-config-2". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:20:05 crc kubenswrapper[5120]: I0316 17:20:05.263163 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/81b58ad6-2d7d-48bc-b63e-3d6274ab1257-neutron-ovn-agent-neutron-config-0" (OuterVolumeSpecName: "neutron-ovn-agent-neutron-config-0") pod "81b58ad6-2d7d-48bc-b63e-3d6274ab1257" (UID: "81b58ad6-2d7d-48bc-b63e-3d6274ab1257"). InnerVolumeSpecName "neutron-ovn-agent-neutron-config-0". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:20:05 crc kubenswrapper[5120]: I0316 17:20:05.265000 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/81b58ad6-2d7d-48bc-b63e-3d6274ab1257-inventory" (OuterVolumeSpecName: "inventory") pod "81b58ad6-2d7d-48bc-b63e-3d6274ab1257" (UID: "81b58ad6-2d7d-48bc-b63e-3d6274ab1257"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:20:05 crc kubenswrapper[5120]: I0316 17:20:05.265300 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/81b58ad6-2d7d-48bc-b63e-3d6274ab1257-nova-metadata-neutron-config-1" (OuterVolumeSpecName: "nova-metadata-neutron-config-1") pod "81b58ad6-2d7d-48bc-b63e-3d6274ab1257" (UID: "81b58ad6-2d7d-48bc-b63e-3d6274ab1257"). InnerVolumeSpecName "nova-metadata-neutron-config-1". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:20:05 crc kubenswrapper[5120]: I0316 17:20:05.269729 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/81b58ad6-2d7d-48bc-b63e-3d6274ab1257-nova-metadata-neutron-config-0" (OuterVolumeSpecName: "nova-metadata-neutron-config-0") pod "81b58ad6-2d7d-48bc-b63e-3d6274ab1257" (UID: "81b58ad6-2d7d-48bc-b63e-3d6274ab1257"). InnerVolumeSpecName "nova-metadata-neutron-config-0". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:20:05 crc kubenswrapper[5120]: I0316 17:20:05.343048 5120 reconciler_common.go:299] "Volume detached for volume \"neutron-ovn-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/81b58ad6-2d7d-48bc-b63e-3d6274ab1257-neutron-ovn-agent-neutron-config-0\") on node \"crc\" DevicePath \"\"" Mar 16 17:20:05 crc kubenswrapper[5120]: I0316 17:20:05.343199 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pmp6m\" (UniqueName: \"kubernetes.io/projected/f5f45330-0cbc-42c0-9485-2495bc41b1d6-kube-api-access-pmp6m\") on node \"crc\" DevicePath \"\"" Mar 16 17:20:05 crc kubenswrapper[5120]: I0316 17:20:05.343212 5120 reconciler_common.go:299] "Volume detached for volume \"nova-metadata-neutron-config-2\" (UniqueName: \"kubernetes.io/secret/81b58ad6-2d7d-48bc-b63e-3d6274ab1257-nova-metadata-neutron-config-2\") on node \"crc\" DevicePath \"\"" Mar 16 17:20:05 crc kubenswrapper[5120]: I0316 17:20:05.343221 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cb9h4\" (UniqueName: \"kubernetes.io/projected/81b58ad6-2d7d-48bc-b63e-3d6274ab1257-kube-api-access-cb9h4\") on node \"crc\" DevicePath \"\"" Mar 16 17:20:05 crc kubenswrapper[5120]: I0316 17:20:05.343252 5120 reconciler_common.go:299] "Volume detached for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/81b58ad6-2d7d-48bc-b63e-3d6274ab1257-ssh-key-edpm-compute-global\") on node \"crc\" DevicePath \"\"" Mar 16 17:20:05 crc kubenswrapper[5120]: I0316 17:20:05.343262 5120 reconciler_common.go:299] "Volume detached for volume \"nova-metadata-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/81b58ad6-2d7d-48bc-b63e-3d6274ab1257-nova-metadata-neutron-config-0\") on node \"crc\" DevicePath \"\"" Mar 16 17:20:05 crc kubenswrapper[5120]: I0316 17:20:05.343271 5120 reconciler_common.go:299] "Volume detached for volume \"nova-metadata-neutron-config-1\" (UniqueName: \"kubernetes.io/secret/81b58ad6-2d7d-48bc-b63e-3d6274ab1257-nova-metadata-neutron-config-1\") on node \"crc\" DevicePath \"\"" Mar 16 17:20:05 crc kubenswrapper[5120]: I0316 17:20:05.343282 5120 reconciler_common.go:299] "Volume detached for volume \"neutron-ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/81b58ad6-2d7d-48bc-b63e-3d6274ab1257-neutron-ovn-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:20:05 crc kubenswrapper[5120]: I0316 17:20:05.343295 5120 reconciler_common.go:299] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/81b58ad6-2d7d-48bc-b63e-3d6274ab1257-inventory\") on node \"crc\" DevicePath \"\"" Mar 16 17:20:05 crc kubenswrapper[5120]: I0316 17:20:05.822495 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-ovn-edpm-compute-global-edpm-compute-global-fqjh6" event={"ID":"81b58ad6-2d7d-48bc-b63e-3d6274ab1257","Type":"ContainerDied","Data":"278c1b3498f6f1c7667eaa9fe3cc569c482e7b07de98c89a24ab33d13d5e9f1d"} Mar 16 17:20:05 crc kubenswrapper[5120]: I0316 17:20:05.822858 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="278c1b3498f6f1c7667eaa9fe3cc569c482e7b07de98c89a24ab33d13d5e9f1d" Mar 16 17:20:05 crc kubenswrapper[5120]: I0316 17:20:05.822737 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-ovn-edpm-compute-global-edpm-compute-global-fqjh6" Mar 16 17:20:05 crc kubenswrapper[5120]: I0316 17:20:05.830641 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561360-spmdl" event={"ID":"f5f45330-0cbc-42c0-9485-2495bc41b1d6","Type":"ContainerDied","Data":"e919cab85bbc1eaca78f94c6da01fa7bf17ce92ceefab2ac6a5841aaf75c62bf"} Mar 16 17:20:05 crc kubenswrapper[5120]: I0316 17:20:05.831000 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e919cab85bbc1eaca78f94c6da01fa7bf17ce92ceefab2ac6a5841aaf75c62bf" Mar 16 17:20:05 crc kubenswrapper[5120]: I0316 17:20:05.831263 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561360-spmdl" Mar 16 17:20:05 crc kubenswrapper[5120]: I0316 17:20:05.880313 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-sriov-edpm-compute-global-edpm-compute-global-5zs7b"] Mar 16 17:20:05 crc kubenswrapper[5120]: I0316 17:20:05.881284 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81b58ad6-2d7d-48bc-b63e-3d6274ab1257" containerName="neutron-ovn-edpm-compute-global-edpm-compute-global" Mar 16 17:20:05 crc kubenswrapper[5120]: I0316 17:20:05.881303 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="81b58ad6-2d7d-48bc-b63e-3d6274ab1257" containerName="neutron-ovn-edpm-compute-global-edpm-compute-global" Mar 16 17:20:05 crc kubenswrapper[5120]: I0316 17:20:05.881331 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5f45330-0cbc-42c0-9485-2495bc41b1d6" containerName="oc" Mar 16 17:20:05 crc kubenswrapper[5120]: I0316 17:20:05.881337 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5f45330-0cbc-42c0-9485-2495bc41b1d6" containerName="oc" Mar 16 17:20:05 crc kubenswrapper[5120]: I0316 17:20:05.881463 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f5f45330-0cbc-42c0-9485-2495bc41b1d6" containerName="oc" Mar 16 17:20:05 crc kubenswrapper[5120]: I0316 17:20:05.881479 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="81b58ad6-2d7d-48bc-b63e-3d6274ab1257" containerName="neutron-ovn-edpm-compute-global-edpm-compute-global" Mar 16 17:20:05 crc kubenswrapper[5120]: I0316 17:20:05.899147 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-sriov-edpm-compute-global-edpm-compute-global-5zs7b"] Mar 16 17:20:05 crc kubenswrapper[5120]: I0316 17:20:05.899290 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-sriov-edpm-compute-global-edpm-compute-global-5zs7b" Mar 16 17:20:05 crc kubenswrapper[5120]: I0316 17:20:05.904492 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-sriov-agent-neutron-config\"" Mar 16 17:20:05 crc kubenswrapper[5120]: I0316 17:20:05.904610 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplane-ansible-ssh-private-key-secret\"" Mar 16 17:20:05 crc kubenswrapper[5120]: I0316 17:20:05.904966 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplanenodeset-edpm-compute-global\"" Mar 16 17:20:05 crc kubenswrapper[5120]: I0316 17:20:05.904991 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-aee-default-env\"" Mar 16 17:20:05 crc kubenswrapper[5120]: I0316 17:20:05.905284 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"combined-ca-bundle\"" Mar 16 17:20:05 crc kubenswrapper[5120]: I0316 17:20:05.905330 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"edpm-compute-global-dockercfg-5hp85\"" Mar 16 17:20:05 crc kubenswrapper[5120]: I0316 17:20:05.955088 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qmjb\" (UniqueName: \"kubernetes.io/projected/0b772688-e5ec-415c-98fd-222dcc3e3d05-kube-api-access-5qmjb\") pod \"neutron-sriov-edpm-compute-global-edpm-compute-global-5zs7b\" (UID: \"0b772688-e5ec-415c-98fd-222dcc3e3d05\") " pod="openstack-kuttl-tests/neutron-sriov-edpm-compute-global-edpm-compute-global-5zs7b" Mar 16 17:20:05 crc kubenswrapper[5120]: I0316 17:20:05.955276 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/0b772688-e5ec-415c-98fd-222dcc3e3d05-inventory\") pod \"neutron-sriov-edpm-compute-global-edpm-compute-global-5zs7b\" (UID: \"0b772688-e5ec-415c-98fd-222dcc3e3d05\") " pod="openstack-kuttl-tests/neutron-sriov-edpm-compute-global-edpm-compute-global-5zs7b" Mar 16 17:20:05 crc kubenswrapper[5120]: I0316 17:20:05.955307 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"neutron-sriov-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/0b772688-e5ec-415c-98fd-222dcc3e3d05-neutron-sriov-agent-neutron-config-0\") pod \"neutron-sriov-edpm-compute-global-edpm-compute-global-5zs7b\" (UID: \"0b772688-e5ec-415c-98fd-222dcc3e3d05\") " pod="openstack-kuttl-tests/neutron-sriov-edpm-compute-global-edpm-compute-global-5zs7b" Mar 16 17:20:05 crc kubenswrapper[5120]: I0316 17:20:05.955369 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/0b772688-e5ec-415c-98fd-222dcc3e3d05-ssh-key-edpm-compute-global\") pod \"neutron-sriov-edpm-compute-global-edpm-compute-global-5zs7b\" (UID: \"0b772688-e5ec-415c-98fd-222dcc3e3d05\") " pod="openstack-kuttl-tests/neutron-sriov-edpm-compute-global-edpm-compute-global-5zs7b" Mar 16 17:20:05 crc kubenswrapper[5120]: I0316 17:20:05.955522 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"neutron-sriov-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0b772688-e5ec-415c-98fd-222dcc3e3d05-neutron-sriov-combined-ca-bundle\") pod \"neutron-sriov-edpm-compute-global-edpm-compute-global-5zs7b\" (UID: \"0b772688-e5ec-415c-98fd-222dcc3e3d05\") " pod="openstack-kuttl-tests/neutron-sriov-edpm-compute-global-edpm-compute-global-5zs7b" Mar 16 17:20:06 crc kubenswrapper[5120]: I0316 17:20:06.056886 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/0b772688-e5ec-415c-98fd-222dcc3e3d05-ssh-key-edpm-compute-global\") pod \"neutron-sriov-edpm-compute-global-edpm-compute-global-5zs7b\" (UID: \"0b772688-e5ec-415c-98fd-222dcc3e3d05\") " pod="openstack-kuttl-tests/neutron-sriov-edpm-compute-global-edpm-compute-global-5zs7b" Mar 16 17:20:06 crc kubenswrapper[5120]: I0316 17:20:06.057372 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"neutron-sriov-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0b772688-e5ec-415c-98fd-222dcc3e3d05-neutron-sriov-combined-ca-bundle\") pod \"neutron-sriov-edpm-compute-global-edpm-compute-global-5zs7b\" (UID: \"0b772688-e5ec-415c-98fd-222dcc3e3d05\") " pod="openstack-kuttl-tests/neutron-sriov-edpm-compute-global-edpm-compute-global-5zs7b" Mar 16 17:20:06 crc kubenswrapper[5120]: I0316 17:20:06.057507 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5qmjb\" (UniqueName: \"kubernetes.io/projected/0b772688-e5ec-415c-98fd-222dcc3e3d05-kube-api-access-5qmjb\") pod \"neutron-sriov-edpm-compute-global-edpm-compute-global-5zs7b\" (UID: \"0b772688-e5ec-415c-98fd-222dcc3e3d05\") " pod="openstack-kuttl-tests/neutron-sriov-edpm-compute-global-edpm-compute-global-5zs7b" Mar 16 17:20:06 crc kubenswrapper[5120]: I0316 17:20:06.057827 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/0b772688-e5ec-415c-98fd-222dcc3e3d05-inventory\") pod \"neutron-sriov-edpm-compute-global-edpm-compute-global-5zs7b\" (UID: \"0b772688-e5ec-415c-98fd-222dcc3e3d05\") " pod="openstack-kuttl-tests/neutron-sriov-edpm-compute-global-edpm-compute-global-5zs7b" Mar 16 17:20:06 crc kubenswrapper[5120]: I0316 17:20:06.057976 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"neutron-sriov-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/0b772688-e5ec-415c-98fd-222dcc3e3d05-neutron-sriov-agent-neutron-config-0\") pod \"neutron-sriov-edpm-compute-global-edpm-compute-global-5zs7b\" (UID: \"0b772688-e5ec-415c-98fd-222dcc3e3d05\") " pod="openstack-kuttl-tests/neutron-sriov-edpm-compute-global-edpm-compute-global-5zs7b" Mar 16 17:20:06 crc kubenswrapper[5120]: I0316 17:20:06.061732 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"neutron-sriov-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0b772688-e5ec-415c-98fd-222dcc3e3d05-neutron-sriov-combined-ca-bundle\") pod \"neutron-sriov-edpm-compute-global-edpm-compute-global-5zs7b\" (UID: \"0b772688-e5ec-415c-98fd-222dcc3e3d05\") " pod="openstack-kuttl-tests/neutron-sriov-edpm-compute-global-edpm-compute-global-5zs7b" Mar 16 17:20:06 crc kubenswrapper[5120]: I0316 17:20:06.061800 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/0b772688-e5ec-415c-98fd-222dcc3e3d05-ssh-key-edpm-compute-global\") pod \"neutron-sriov-edpm-compute-global-edpm-compute-global-5zs7b\" (UID: \"0b772688-e5ec-415c-98fd-222dcc3e3d05\") " pod="openstack-kuttl-tests/neutron-sriov-edpm-compute-global-edpm-compute-global-5zs7b" Mar 16 17:20:06 crc kubenswrapper[5120]: I0316 17:20:06.061973 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/0b772688-e5ec-415c-98fd-222dcc3e3d05-inventory\") pod \"neutron-sriov-edpm-compute-global-edpm-compute-global-5zs7b\" (UID: \"0b772688-e5ec-415c-98fd-222dcc3e3d05\") " pod="openstack-kuttl-tests/neutron-sriov-edpm-compute-global-edpm-compute-global-5zs7b" Mar 16 17:20:06 crc kubenswrapper[5120]: I0316 17:20:06.063463 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"neutron-sriov-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/0b772688-e5ec-415c-98fd-222dcc3e3d05-neutron-sriov-agent-neutron-config-0\") pod \"neutron-sriov-edpm-compute-global-edpm-compute-global-5zs7b\" (UID: \"0b772688-e5ec-415c-98fd-222dcc3e3d05\") " pod="openstack-kuttl-tests/neutron-sriov-edpm-compute-global-edpm-compute-global-5zs7b" Mar 16 17:20:06 crc kubenswrapper[5120]: I0316 17:20:06.078629 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qmjb\" (UniqueName: \"kubernetes.io/projected/0b772688-e5ec-415c-98fd-222dcc3e3d05-kube-api-access-5qmjb\") pod \"neutron-sriov-edpm-compute-global-edpm-compute-global-5zs7b\" (UID: \"0b772688-e5ec-415c-98fd-222dcc3e3d05\") " pod="openstack-kuttl-tests/neutron-sriov-edpm-compute-global-edpm-compute-global-5zs7b" Mar 16 17:20:06 crc kubenswrapper[5120]: I0316 17:20:06.219212 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-sriov-edpm-compute-global-edpm-compute-global-5zs7b" Mar 16 17:20:06 crc kubenswrapper[5120]: I0316 17:20:06.222219 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-infra/auto-csr-approver-29561354-wp79g"] Mar 16 17:20:06 crc kubenswrapper[5120]: I0316 17:20:06.229524 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-infra/auto-csr-approver-29561354-wp79g"] Mar 16 17:20:06 crc kubenswrapper[5120]: I0316 17:20:06.641412 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-sriov-edpm-compute-global-edpm-compute-global-5zs7b"] Mar 16 17:20:06 crc kubenswrapper[5120]: W0316 17:20:06.649002 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0b772688_e5ec_415c_98fd_222dcc3e3d05.slice/crio-9e2e1fcfd2d93e761b7df78f64275e2ccf13aafb970a81d34b506cd2ad468703 WatchSource:0}: Error finding container 9e2e1fcfd2d93e761b7df78f64275e2ccf13aafb970a81d34b506cd2ad468703: Status 404 returned error can't find the container with id 9e2e1fcfd2d93e761b7df78f64275e2ccf13aafb970a81d34b506cd2ad468703 Mar 16 17:20:06 crc kubenswrapper[5120]: I0316 17:20:06.676284 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f398ab9a-6e18-44d4-8a49-22cb9d7e7f3f" path="/var/lib/kubelet/pods/f398ab9a-6e18-44d4-8a49-22cb9d7e7f3f/volumes" Mar 16 17:20:06 crc kubenswrapper[5120]: I0316 17:20:06.841250 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-sriov-edpm-compute-global-edpm-compute-global-5zs7b" event={"ID":"0b772688-e5ec-415c-98fd-222dcc3e3d05","Type":"ContainerStarted","Data":"9e2e1fcfd2d93e761b7df78f64275e2ccf13aafb970a81d34b506cd2ad468703"} Mar 16 17:20:07 crc kubenswrapper[5120]: E0316 17:20:07.552905 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1312115 actualBytes=10240 Mar 16 17:20:07 crc kubenswrapper[5120]: I0316 17:20:07.852387 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-sriov-edpm-compute-global-edpm-compute-global-5zs7b" event={"ID":"0b772688-e5ec-415c-98fd-222dcc3e3d05","Type":"ContainerStarted","Data":"d46b76d57a0182d62f31acab74f4f9b6368023dcdc3f4bcf2079d1a08cf478f7"} Mar 16 17:20:07 crc kubenswrapper[5120]: I0316 17:20:07.873867 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-sriov-edpm-compute-global-edpm-compute-global-5zs7b" podStartSLOduration=1.931772449 podStartE2EDuration="2.873849182s" podCreationTimestamp="2026-03-16 17:20:05 +0000 UTC" firstStartedPulling="2026-03-16 17:20:06.65037583 +0000 UTC m=+6508.804307487" lastFinishedPulling="2026-03-16 17:20:07.592452563 +0000 UTC m=+6509.746384220" observedRunningTime="2026-03-16 17:20:07.868782103 +0000 UTC m=+6510.022713780" watchObservedRunningTime="2026-03-16 17:20:07.873849182 +0000 UTC m=+6510.027780839" Mar 16 17:20:08 crc kubenswrapper[5120]: I0316 17:20:08.672630 5120 scope.go:117] "RemoveContainer" containerID="2ca61165dca6fdb30458423ef74c44c42b1b273e8fa504e89f5f9e186e516cc3" Mar 16 17:20:08 crc kubenswrapper[5120]: E0316 17:20:08.673107 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 17:20:09 crc kubenswrapper[5120]: I0316 17:20:09.914665 5120 generic.go:358] "Generic (PLEG): container finished" podID="0b772688-e5ec-415c-98fd-222dcc3e3d05" containerID="d46b76d57a0182d62f31acab74f4f9b6368023dcdc3f4bcf2079d1a08cf478f7" exitCode=0 Mar 16 17:20:09 crc kubenswrapper[5120]: I0316 17:20:09.914764 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-sriov-edpm-compute-global-edpm-compute-global-5zs7b" event={"ID":"0b772688-e5ec-415c-98fd-222dcc3e3d05","Type":"ContainerDied","Data":"d46b76d57a0182d62f31acab74f4f9b6368023dcdc3f4bcf2079d1a08cf478f7"} Mar 16 17:20:11 crc kubenswrapper[5120]: I0316 17:20:11.247900 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-sriov-edpm-compute-global-edpm-compute-global-5zs7b" Mar 16 17:20:11 crc kubenswrapper[5120]: I0316 17:20:11.373368 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/0b772688-e5ec-415c-98fd-222dcc3e3d05-inventory\") pod \"0b772688-e5ec-415c-98fd-222dcc3e3d05\" (UID: \"0b772688-e5ec-415c-98fd-222dcc3e3d05\") " Mar 16 17:20:11 crc kubenswrapper[5120]: I0316 17:20:11.373554 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5qmjb\" (UniqueName: \"kubernetes.io/projected/0b772688-e5ec-415c-98fd-222dcc3e3d05-kube-api-access-5qmjb\") pod \"0b772688-e5ec-415c-98fd-222dcc3e3d05\" (UID: \"0b772688-e5ec-415c-98fd-222dcc3e3d05\") " Mar 16 17:20:11 crc kubenswrapper[5120]: I0316 17:20:11.373623 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/0b772688-e5ec-415c-98fd-222dcc3e3d05-ssh-key-edpm-compute-global\") pod \"0b772688-e5ec-415c-98fd-222dcc3e3d05\" (UID: \"0b772688-e5ec-415c-98fd-222dcc3e3d05\") " Mar 16 17:20:11 crc kubenswrapper[5120]: I0316 17:20:11.373681 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"neutron-sriov-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/0b772688-e5ec-415c-98fd-222dcc3e3d05-neutron-sriov-agent-neutron-config-0\") pod \"0b772688-e5ec-415c-98fd-222dcc3e3d05\" (UID: \"0b772688-e5ec-415c-98fd-222dcc3e3d05\") " Mar 16 17:20:11 crc kubenswrapper[5120]: I0316 17:20:11.373949 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"neutron-sriov-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0b772688-e5ec-415c-98fd-222dcc3e3d05-neutron-sriov-combined-ca-bundle\") pod \"0b772688-e5ec-415c-98fd-222dcc3e3d05\" (UID: \"0b772688-e5ec-415c-98fd-222dcc3e3d05\") " Mar 16 17:20:11 crc kubenswrapper[5120]: I0316 17:20:11.379048 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b772688-e5ec-415c-98fd-222dcc3e3d05-neutron-sriov-combined-ca-bundle" (OuterVolumeSpecName: "neutron-sriov-combined-ca-bundle") pod "0b772688-e5ec-415c-98fd-222dcc3e3d05" (UID: "0b772688-e5ec-415c-98fd-222dcc3e3d05"). InnerVolumeSpecName "neutron-sriov-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:20:11 crc kubenswrapper[5120]: I0316 17:20:11.379205 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b772688-e5ec-415c-98fd-222dcc3e3d05-kube-api-access-5qmjb" (OuterVolumeSpecName: "kube-api-access-5qmjb") pod "0b772688-e5ec-415c-98fd-222dcc3e3d05" (UID: "0b772688-e5ec-415c-98fd-222dcc3e3d05"). InnerVolumeSpecName "kube-api-access-5qmjb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:20:11 crc kubenswrapper[5120]: I0316 17:20:11.393965 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b772688-e5ec-415c-98fd-222dcc3e3d05-neutron-sriov-agent-neutron-config-0" (OuterVolumeSpecName: "neutron-sriov-agent-neutron-config-0") pod "0b772688-e5ec-415c-98fd-222dcc3e3d05" (UID: "0b772688-e5ec-415c-98fd-222dcc3e3d05"). InnerVolumeSpecName "neutron-sriov-agent-neutron-config-0". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:20:11 crc kubenswrapper[5120]: I0316 17:20:11.395676 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b772688-e5ec-415c-98fd-222dcc3e3d05-ssh-key-edpm-compute-global" (OuterVolumeSpecName: "ssh-key-edpm-compute-global") pod "0b772688-e5ec-415c-98fd-222dcc3e3d05" (UID: "0b772688-e5ec-415c-98fd-222dcc3e3d05"). InnerVolumeSpecName "ssh-key-edpm-compute-global". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:20:11 crc kubenswrapper[5120]: I0316 17:20:11.401992 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b772688-e5ec-415c-98fd-222dcc3e3d05-inventory" (OuterVolumeSpecName: "inventory") pod "0b772688-e5ec-415c-98fd-222dcc3e3d05" (UID: "0b772688-e5ec-415c-98fd-222dcc3e3d05"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:20:11 crc kubenswrapper[5120]: I0316 17:20:11.477499 5120 reconciler_common.go:299] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/0b772688-e5ec-415c-98fd-222dcc3e3d05-inventory\") on node \"crc\" DevicePath \"\"" Mar 16 17:20:11 crc kubenswrapper[5120]: I0316 17:20:11.477536 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5qmjb\" (UniqueName: \"kubernetes.io/projected/0b772688-e5ec-415c-98fd-222dcc3e3d05-kube-api-access-5qmjb\") on node \"crc\" DevicePath \"\"" Mar 16 17:20:11 crc kubenswrapper[5120]: I0316 17:20:11.477550 5120 reconciler_common.go:299] "Volume detached for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/0b772688-e5ec-415c-98fd-222dcc3e3d05-ssh-key-edpm-compute-global\") on node \"crc\" DevicePath \"\"" Mar 16 17:20:11 crc kubenswrapper[5120]: I0316 17:20:11.477567 5120 reconciler_common.go:299] "Volume detached for volume \"neutron-sriov-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/0b772688-e5ec-415c-98fd-222dcc3e3d05-neutron-sriov-agent-neutron-config-0\") on node \"crc\" DevicePath \"\"" Mar 16 17:20:11 crc kubenswrapper[5120]: I0316 17:20:11.477587 5120 reconciler_common.go:299] "Volume detached for volume \"neutron-sriov-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0b772688-e5ec-415c-98fd-222dcc3e3d05-neutron-sriov-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:20:11 crc kubenswrapper[5120]: I0316 17:20:11.941320 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-sriov-edpm-compute-global-edpm-compute-global-5zs7b" Mar 16 17:20:11 crc kubenswrapper[5120]: I0316 17:20:11.941318 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-sriov-edpm-compute-global-edpm-compute-global-5zs7b" event={"ID":"0b772688-e5ec-415c-98fd-222dcc3e3d05","Type":"ContainerDied","Data":"9e2e1fcfd2d93e761b7df78f64275e2ccf13aafb970a81d34b506cd2ad468703"} Mar 16 17:20:11 crc kubenswrapper[5120]: I0316 17:20:11.941493 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9e2e1fcfd2d93e761b7df78f64275e2ccf13aafb970a81d34b506cd2ad468703" Mar 16 17:20:12 crc kubenswrapper[5120]: I0316 17:20:12.013579 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-dhcp-edpm-compute-global-edpm-compute-global-555pt"] Mar 16 17:20:12 crc kubenswrapper[5120]: I0316 17:20:12.014848 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b772688-e5ec-415c-98fd-222dcc3e3d05" containerName="neutron-sriov-edpm-compute-global-edpm-compute-global" Mar 16 17:20:12 crc kubenswrapper[5120]: I0316 17:20:12.014875 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b772688-e5ec-415c-98fd-222dcc3e3d05" containerName="neutron-sriov-edpm-compute-global-edpm-compute-global" Mar 16 17:20:12 crc kubenswrapper[5120]: I0316 17:20:12.015015 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="0b772688-e5ec-415c-98fd-222dcc3e3d05" containerName="neutron-sriov-edpm-compute-global-edpm-compute-global" Mar 16 17:20:12 crc kubenswrapper[5120]: I0316 17:20:12.026370 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-dhcp-edpm-compute-global-edpm-compute-global-555pt" Mar 16 17:20:12 crc kubenswrapper[5120]: I0316 17:20:12.029814 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"combined-ca-bundle\"" Mar 16 17:20:12 crc kubenswrapper[5120]: I0316 17:20:12.031118 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-aee-default-env\"" Mar 16 17:20:12 crc kubenswrapper[5120]: I0316 17:20:12.031243 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-dhcp-agent-neutron-config\"" Mar 16 17:20:12 crc kubenswrapper[5120]: I0316 17:20:12.031277 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplane-ansible-ssh-private-key-secret\"" Mar 16 17:20:12 crc kubenswrapper[5120]: I0316 17:20:12.031530 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplanenodeset-edpm-compute-global\"" Mar 16 17:20:12 crc kubenswrapper[5120]: I0316 17:20:12.031989 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"edpm-compute-global-dockercfg-5hp85\"" Mar 16 17:20:12 crc kubenswrapper[5120]: I0316 17:20:12.040013 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-dhcp-edpm-compute-global-edpm-compute-global-555pt"] Mar 16 17:20:12 crc kubenswrapper[5120]: I0316 17:20:12.194956 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"neutron-dhcp-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/5504360a-4f14-4c79-8bc1-67c631bfd594-neutron-dhcp-agent-neutron-config-0\") pod \"neutron-dhcp-edpm-compute-global-edpm-compute-global-555pt\" (UID: \"5504360a-4f14-4c79-8bc1-67c631bfd594\") " pod="openstack-kuttl-tests/neutron-dhcp-edpm-compute-global-edpm-compute-global-555pt" Mar 16 17:20:12 crc kubenswrapper[5120]: I0316 17:20:12.195107 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/5504360a-4f14-4c79-8bc1-67c631bfd594-ssh-key-edpm-compute-global\") pod \"neutron-dhcp-edpm-compute-global-edpm-compute-global-555pt\" (UID: \"5504360a-4f14-4c79-8bc1-67c631bfd594\") " pod="openstack-kuttl-tests/neutron-dhcp-edpm-compute-global-edpm-compute-global-555pt" Mar 16 17:20:12 crc kubenswrapper[5120]: I0316 17:20:12.195301 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"neutron-dhcp-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5504360a-4f14-4c79-8bc1-67c631bfd594-neutron-dhcp-combined-ca-bundle\") pod \"neutron-dhcp-edpm-compute-global-edpm-compute-global-555pt\" (UID: \"5504360a-4f14-4c79-8bc1-67c631bfd594\") " pod="openstack-kuttl-tests/neutron-dhcp-edpm-compute-global-edpm-compute-global-555pt" Mar 16 17:20:12 crc kubenswrapper[5120]: I0316 17:20:12.195589 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7b976\" (UniqueName: \"kubernetes.io/projected/5504360a-4f14-4c79-8bc1-67c631bfd594-kube-api-access-7b976\") pod \"neutron-dhcp-edpm-compute-global-edpm-compute-global-555pt\" (UID: \"5504360a-4f14-4c79-8bc1-67c631bfd594\") " pod="openstack-kuttl-tests/neutron-dhcp-edpm-compute-global-edpm-compute-global-555pt" Mar 16 17:20:12 crc kubenswrapper[5120]: I0316 17:20:12.195835 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/5504360a-4f14-4c79-8bc1-67c631bfd594-inventory\") pod \"neutron-dhcp-edpm-compute-global-edpm-compute-global-555pt\" (UID: \"5504360a-4f14-4c79-8bc1-67c631bfd594\") " pod="openstack-kuttl-tests/neutron-dhcp-edpm-compute-global-edpm-compute-global-555pt" Mar 16 17:20:12 crc kubenswrapper[5120]: I0316 17:20:12.297441 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7b976\" (UniqueName: \"kubernetes.io/projected/5504360a-4f14-4c79-8bc1-67c631bfd594-kube-api-access-7b976\") pod \"neutron-dhcp-edpm-compute-global-edpm-compute-global-555pt\" (UID: \"5504360a-4f14-4c79-8bc1-67c631bfd594\") " pod="openstack-kuttl-tests/neutron-dhcp-edpm-compute-global-edpm-compute-global-555pt" Mar 16 17:20:12 crc kubenswrapper[5120]: I0316 17:20:12.297560 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/5504360a-4f14-4c79-8bc1-67c631bfd594-inventory\") pod \"neutron-dhcp-edpm-compute-global-edpm-compute-global-555pt\" (UID: \"5504360a-4f14-4c79-8bc1-67c631bfd594\") " pod="openstack-kuttl-tests/neutron-dhcp-edpm-compute-global-edpm-compute-global-555pt" Mar 16 17:20:12 crc kubenswrapper[5120]: I0316 17:20:12.297698 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"neutron-dhcp-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/5504360a-4f14-4c79-8bc1-67c631bfd594-neutron-dhcp-agent-neutron-config-0\") pod \"neutron-dhcp-edpm-compute-global-edpm-compute-global-555pt\" (UID: \"5504360a-4f14-4c79-8bc1-67c631bfd594\") " pod="openstack-kuttl-tests/neutron-dhcp-edpm-compute-global-edpm-compute-global-555pt" Mar 16 17:20:12 crc kubenswrapper[5120]: I0316 17:20:12.297893 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/5504360a-4f14-4c79-8bc1-67c631bfd594-ssh-key-edpm-compute-global\") pod \"neutron-dhcp-edpm-compute-global-edpm-compute-global-555pt\" (UID: \"5504360a-4f14-4c79-8bc1-67c631bfd594\") " pod="openstack-kuttl-tests/neutron-dhcp-edpm-compute-global-edpm-compute-global-555pt" Mar 16 17:20:12 crc kubenswrapper[5120]: I0316 17:20:12.297968 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"neutron-dhcp-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5504360a-4f14-4c79-8bc1-67c631bfd594-neutron-dhcp-combined-ca-bundle\") pod \"neutron-dhcp-edpm-compute-global-edpm-compute-global-555pt\" (UID: \"5504360a-4f14-4c79-8bc1-67c631bfd594\") " pod="openstack-kuttl-tests/neutron-dhcp-edpm-compute-global-edpm-compute-global-555pt" Mar 16 17:20:12 crc kubenswrapper[5120]: I0316 17:20:12.302244 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/5504360a-4f14-4c79-8bc1-67c631bfd594-ssh-key-edpm-compute-global\") pod \"neutron-dhcp-edpm-compute-global-edpm-compute-global-555pt\" (UID: \"5504360a-4f14-4c79-8bc1-67c631bfd594\") " pod="openstack-kuttl-tests/neutron-dhcp-edpm-compute-global-edpm-compute-global-555pt" Mar 16 17:20:12 crc kubenswrapper[5120]: I0316 17:20:12.302707 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/5504360a-4f14-4c79-8bc1-67c631bfd594-inventory\") pod \"neutron-dhcp-edpm-compute-global-edpm-compute-global-555pt\" (UID: \"5504360a-4f14-4c79-8bc1-67c631bfd594\") " pod="openstack-kuttl-tests/neutron-dhcp-edpm-compute-global-edpm-compute-global-555pt" Mar 16 17:20:12 crc kubenswrapper[5120]: I0316 17:20:12.304751 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"neutron-dhcp-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/5504360a-4f14-4c79-8bc1-67c631bfd594-neutron-dhcp-agent-neutron-config-0\") pod \"neutron-dhcp-edpm-compute-global-edpm-compute-global-555pt\" (UID: \"5504360a-4f14-4c79-8bc1-67c631bfd594\") " pod="openstack-kuttl-tests/neutron-dhcp-edpm-compute-global-edpm-compute-global-555pt" Mar 16 17:20:12 crc kubenswrapper[5120]: I0316 17:20:12.309472 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"neutron-dhcp-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5504360a-4f14-4c79-8bc1-67c631bfd594-neutron-dhcp-combined-ca-bundle\") pod \"neutron-dhcp-edpm-compute-global-edpm-compute-global-555pt\" (UID: \"5504360a-4f14-4c79-8bc1-67c631bfd594\") " pod="openstack-kuttl-tests/neutron-dhcp-edpm-compute-global-edpm-compute-global-555pt" Mar 16 17:20:12 crc kubenswrapper[5120]: I0316 17:20:12.315044 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7b976\" (UniqueName: \"kubernetes.io/projected/5504360a-4f14-4c79-8bc1-67c631bfd594-kube-api-access-7b976\") pod \"neutron-dhcp-edpm-compute-global-edpm-compute-global-555pt\" (UID: \"5504360a-4f14-4c79-8bc1-67c631bfd594\") " pod="openstack-kuttl-tests/neutron-dhcp-edpm-compute-global-edpm-compute-global-555pt" Mar 16 17:20:12 crc kubenswrapper[5120]: I0316 17:20:12.349316 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-dhcp-edpm-compute-global-edpm-compute-global-555pt" Mar 16 17:20:12 crc kubenswrapper[5120]: I0316 17:20:12.751777 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-dhcp-edpm-compute-global-edpm-compute-global-555pt"] Mar 16 17:20:12 crc kubenswrapper[5120]: I0316 17:20:12.950594 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-dhcp-edpm-compute-global-edpm-compute-global-555pt" event={"ID":"5504360a-4f14-4c79-8bc1-67c631bfd594","Type":"ContainerStarted","Data":"4de223317f659168d5b273f3972d247fa69ead149ec11dab74cead2cd6bc0b20"} Mar 16 17:20:13 crc kubenswrapper[5120]: I0316 17:20:13.962522 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-dhcp-edpm-compute-global-edpm-compute-global-555pt" event={"ID":"5504360a-4f14-4c79-8bc1-67c631bfd594","Type":"ContainerStarted","Data":"bfa075f1f2cfaa5f473f62b680e98718a97895695933be4e9505f4b0d663459a"} Mar 16 17:20:13 crc kubenswrapper[5120]: I0316 17:20:13.988527 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-dhcp-edpm-compute-global-edpm-compute-global-555pt" podStartSLOduration=2.583486029 podStartE2EDuration="2.988510766s" podCreationTimestamp="2026-03-16 17:20:11 +0000 UTC" firstStartedPulling="2026-03-16 17:20:12.755751671 +0000 UTC m=+6514.909683328" lastFinishedPulling="2026-03-16 17:20:13.160776388 +0000 UTC m=+6515.314708065" observedRunningTime="2026-03-16 17:20:13.981630988 +0000 UTC m=+6516.135562655" watchObservedRunningTime="2026-03-16 17:20:13.988510766 +0000 UTC m=+6516.142442413" Mar 16 17:20:14 crc kubenswrapper[5120]: I0316 17:20:14.971746 5120 generic.go:358] "Generic (PLEG): container finished" podID="5504360a-4f14-4c79-8bc1-67c631bfd594" containerID="bfa075f1f2cfaa5f473f62b680e98718a97895695933be4e9505f4b0d663459a" exitCode=0 Mar 16 17:20:14 crc kubenswrapper[5120]: I0316 17:20:14.972057 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-dhcp-edpm-compute-global-edpm-compute-global-555pt" event={"ID":"5504360a-4f14-4c79-8bc1-67c631bfd594","Type":"ContainerDied","Data":"bfa075f1f2cfaa5f473f62b680e98718a97895695933be4e9505f4b0d663459a"} Mar 16 17:20:16 crc kubenswrapper[5120]: I0316 17:20:16.273639 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-dhcp-edpm-compute-global-edpm-compute-global-555pt" Mar 16 17:20:16 crc kubenswrapper[5120]: I0316 17:20:16.384341 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/5504360a-4f14-4c79-8bc1-67c631bfd594-ssh-key-edpm-compute-global\") pod \"5504360a-4f14-4c79-8bc1-67c631bfd594\" (UID: \"5504360a-4f14-4c79-8bc1-67c631bfd594\") " Mar 16 17:20:16 crc kubenswrapper[5120]: I0316 17:20:16.384488 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/5504360a-4f14-4c79-8bc1-67c631bfd594-inventory\") pod \"5504360a-4f14-4c79-8bc1-67c631bfd594\" (UID: \"5504360a-4f14-4c79-8bc1-67c631bfd594\") " Mar 16 17:20:16 crc kubenswrapper[5120]: I0316 17:20:16.384600 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"neutron-dhcp-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5504360a-4f14-4c79-8bc1-67c631bfd594-neutron-dhcp-combined-ca-bundle\") pod \"5504360a-4f14-4c79-8bc1-67c631bfd594\" (UID: \"5504360a-4f14-4c79-8bc1-67c631bfd594\") " Mar 16 17:20:16 crc kubenswrapper[5120]: I0316 17:20:16.384985 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"neutron-dhcp-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/5504360a-4f14-4c79-8bc1-67c631bfd594-neutron-dhcp-agent-neutron-config-0\") pod \"5504360a-4f14-4c79-8bc1-67c631bfd594\" (UID: \"5504360a-4f14-4c79-8bc1-67c631bfd594\") " Mar 16 17:20:16 crc kubenswrapper[5120]: I0316 17:20:16.385048 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7b976\" (UniqueName: \"kubernetes.io/projected/5504360a-4f14-4c79-8bc1-67c631bfd594-kube-api-access-7b976\") pod \"5504360a-4f14-4c79-8bc1-67c631bfd594\" (UID: \"5504360a-4f14-4c79-8bc1-67c631bfd594\") " Mar 16 17:20:16 crc kubenswrapper[5120]: I0316 17:20:16.390033 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5504360a-4f14-4c79-8bc1-67c631bfd594-kube-api-access-7b976" (OuterVolumeSpecName: "kube-api-access-7b976") pod "5504360a-4f14-4c79-8bc1-67c631bfd594" (UID: "5504360a-4f14-4c79-8bc1-67c631bfd594"). InnerVolumeSpecName "kube-api-access-7b976". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:20:16 crc kubenswrapper[5120]: I0316 17:20:16.395851 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5504360a-4f14-4c79-8bc1-67c631bfd594-neutron-dhcp-combined-ca-bundle" (OuterVolumeSpecName: "neutron-dhcp-combined-ca-bundle") pod "5504360a-4f14-4c79-8bc1-67c631bfd594" (UID: "5504360a-4f14-4c79-8bc1-67c631bfd594"). InnerVolumeSpecName "neutron-dhcp-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:20:16 crc kubenswrapper[5120]: I0316 17:20:16.405776 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5504360a-4f14-4c79-8bc1-67c631bfd594-inventory" (OuterVolumeSpecName: "inventory") pod "5504360a-4f14-4c79-8bc1-67c631bfd594" (UID: "5504360a-4f14-4c79-8bc1-67c631bfd594"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:20:16 crc kubenswrapper[5120]: I0316 17:20:16.405793 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5504360a-4f14-4c79-8bc1-67c631bfd594-neutron-dhcp-agent-neutron-config-0" (OuterVolumeSpecName: "neutron-dhcp-agent-neutron-config-0") pod "5504360a-4f14-4c79-8bc1-67c631bfd594" (UID: "5504360a-4f14-4c79-8bc1-67c631bfd594"). InnerVolumeSpecName "neutron-dhcp-agent-neutron-config-0". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:20:16 crc kubenswrapper[5120]: I0316 17:20:16.405904 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5504360a-4f14-4c79-8bc1-67c631bfd594-ssh-key-edpm-compute-global" (OuterVolumeSpecName: "ssh-key-edpm-compute-global") pod "5504360a-4f14-4c79-8bc1-67c631bfd594" (UID: "5504360a-4f14-4c79-8bc1-67c631bfd594"). InnerVolumeSpecName "ssh-key-edpm-compute-global". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:20:16 crc kubenswrapper[5120]: I0316 17:20:16.487529 5120 reconciler_common.go:299] "Volume detached for volume \"neutron-dhcp-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/5504360a-4f14-4c79-8bc1-67c631bfd594-neutron-dhcp-agent-neutron-config-0\") on node \"crc\" DevicePath \"\"" Mar 16 17:20:16 crc kubenswrapper[5120]: I0316 17:20:16.487571 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7b976\" (UniqueName: \"kubernetes.io/projected/5504360a-4f14-4c79-8bc1-67c631bfd594-kube-api-access-7b976\") on node \"crc\" DevicePath \"\"" Mar 16 17:20:16 crc kubenswrapper[5120]: I0316 17:20:16.487591 5120 reconciler_common.go:299] "Volume detached for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/5504360a-4f14-4c79-8bc1-67c631bfd594-ssh-key-edpm-compute-global\") on node \"crc\" DevicePath \"\"" Mar 16 17:20:16 crc kubenswrapper[5120]: I0316 17:20:16.487604 5120 reconciler_common.go:299] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/5504360a-4f14-4c79-8bc1-67c631bfd594-inventory\") on node \"crc\" DevicePath \"\"" Mar 16 17:20:16 crc kubenswrapper[5120]: I0316 17:20:16.487617 5120 reconciler_common.go:299] "Volume detached for volume \"neutron-dhcp-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5504360a-4f14-4c79-8bc1-67c631bfd594-neutron-dhcp-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:20:16 crc kubenswrapper[5120]: I0316 17:20:16.993033 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-dhcp-edpm-compute-global-edpm-compute-global-555pt" Mar 16 17:20:16 crc kubenswrapper[5120]: I0316 17:20:16.993070 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-dhcp-edpm-compute-global-edpm-compute-global-555pt" event={"ID":"5504360a-4f14-4c79-8bc1-67c631bfd594","Type":"ContainerDied","Data":"4de223317f659168d5b273f3972d247fa69ead149ec11dab74cead2cd6bc0b20"} Mar 16 17:20:16 crc kubenswrapper[5120]: I0316 17:20:16.993110 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4de223317f659168d5b273f3972d247fa69ead149ec11dab74cead2cd6bc0b20" Mar 16 17:20:17 crc kubenswrapper[5120]: I0316 17:20:17.056596 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/libvirt-edpm-compute-global-edpm-compute-global-t8t2l"] Mar 16 17:20:17 crc kubenswrapper[5120]: I0316 17:20:17.057808 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5504360a-4f14-4c79-8bc1-67c631bfd594" containerName="neutron-dhcp-edpm-compute-global-edpm-compute-global" Mar 16 17:20:17 crc kubenswrapper[5120]: I0316 17:20:17.057833 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="5504360a-4f14-4c79-8bc1-67c631bfd594" containerName="neutron-dhcp-edpm-compute-global-edpm-compute-global" Mar 16 17:20:17 crc kubenswrapper[5120]: I0316 17:20:17.059796 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="5504360a-4f14-4c79-8bc1-67c631bfd594" containerName="neutron-dhcp-edpm-compute-global-edpm-compute-global" Mar 16 17:20:17 crc kubenswrapper[5120]: I0316 17:20:17.079113 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/libvirt-edpm-compute-global-edpm-compute-global-t8t2l"] Mar 16 17:20:17 crc kubenswrapper[5120]: I0316 17:20:17.079294 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/libvirt-edpm-compute-global-edpm-compute-global-t8t2l" Mar 16 17:20:17 crc kubenswrapper[5120]: I0316 17:20:17.085011 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-aee-default-env\"" Mar 16 17:20:17 crc kubenswrapper[5120]: I0316 17:20:17.085096 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"edpm-compute-global-dockercfg-5hp85\"" Mar 16 17:20:17 crc kubenswrapper[5120]: I0316 17:20:17.085022 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"libvirt-secret\"" Mar 16 17:20:17 crc kubenswrapper[5120]: I0316 17:20:17.085253 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"combined-ca-bundle\"" Mar 16 17:20:17 crc kubenswrapper[5120]: I0316 17:20:17.085255 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplane-ansible-ssh-private-key-secret\"" Mar 16 17:20:17 crc kubenswrapper[5120]: I0316 17:20:17.085568 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplanenodeset-edpm-compute-global\"" Mar 16 17:20:17 crc kubenswrapper[5120]: I0316 17:20:17.205719 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqsb2\" (UniqueName: \"kubernetes.io/projected/387b0793-b863-48d4-832f-8eb85b4e4d37-kube-api-access-qqsb2\") pod \"libvirt-edpm-compute-global-edpm-compute-global-t8t2l\" (UID: \"387b0793-b863-48d4-832f-8eb85b4e4d37\") " pod="openstack-kuttl-tests/libvirt-edpm-compute-global-edpm-compute-global-t8t2l" Mar 16 17:20:17 crc kubenswrapper[5120]: I0316 17:20:17.205834 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"libvirt-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/387b0793-b863-48d4-832f-8eb85b4e4d37-libvirt-combined-ca-bundle\") pod \"libvirt-edpm-compute-global-edpm-compute-global-t8t2l\" (UID: \"387b0793-b863-48d4-832f-8eb85b4e4d37\") " pod="openstack-kuttl-tests/libvirt-edpm-compute-global-edpm-compute-global-t8t2l" Mar 16 17:20:17 crc kubenswrapper[5120]: I0316 17:20:17.206182 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"libvirt-secret-0\" (UniqueName: \"kubernetes.io/secret/387b0793-b863-48d4-832f-8eb85b4e4d37-libvirt-secret-0\") pod \"libvirt-edpm-compute-global-edpm-compute-global-t8t2l\" (UID: \"387b0793-b863-48d4-832f-8eb85b4e4d37\") " pod="openstack-kuttl-tests/libvirt-edpm-compute-global-edpm-compute-global-t8t2l" Mar 16 17:20:17 crc kubenswrapper[5120]: I0316 17:20:17.206330 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/387b0793-b863-48d4-832f-8eb85b4e4d37-ssh-key-edpm-compute-global\") pod \"libvirt-edpm-compute-global-edpm-compute-global-t8t2l\" (UID: \"387b0793-b863-48d4-832f-8eb85b4e4d37\") " pod="openstack-kuttl-tests/libvirt-edpm-compute-global-edpm-compute-global-t8t2l" Mar 16 17:20:17 crc kubenswrapper[5120]: I0316 17:20:17.206360 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/387b0793-b863-48d4-832f-8eb85b4e4d37-inventory\") pod \"libvirt-edpm-compute-global-edpm-compute-global-t8t2l\" (UID: \"387b0793-b863-48d4-832f-8eb85b4e4d37\") " pod="openstack-kuttl-tests/libvirt-edpm-compute-global-edpm-compute-global-t8t2l" Mar 16 17:20:17 crc kubenswrapper[5120]: I0316 17:20:17.309416 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/387b0793-b863-48d4-832f-8eb85b4e4d37-ssh-key-edpm-compute-global\") pod \"libvirt-edpm-compute-global-edpm-compute-global-t8t2l\" (UID: \"387b0793-b863-48d4-832f-8eb85b4e4d37\") " pod="openstack-kuttl-tests/libvirt-edpm-compute-global-edpm-compute-global-t8t2l" Mar 16 17:20:17 crc kubenswrapper[5120]: I0316 17:20:17.309467 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/387b0793-b863-48d4-832f-8eb85b4e4d37-inventory\") pod \"libvirt-edpm-compute-global-edpm-compute-global-t8t2l\" (UID: \"387b0793-b863-48d4-832f-8eb85b4e4d37\") " pod="openstack-kuttl-tests/libvirt-edpm-compute-global-edpm-compute-global-t8t2l" Mar 16 17:20:17 crc kubenswrapper[5120]: I0316 17:20:17.309666 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qqsb2\" (UniqueName: \"kubernetes.io/projected/387b0793-b863-48d4-832f-8eb85b4e4d37-kube-api-access-qqsb2\") pod \"libvirt-edpm-compute-global-edpm-compute-global-t8t2l\" (UID: \"387b0793-b863-48d4-832f-8eb85b4e4d37\") " pod="openstack-kuttl-tests/libvirt-edpm-compute-global-edpm-compute-global-t8t2l" Mar 16 17:20:17 crc kubenswrapper[5120]: I0316 17:20:17.309820 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"libvirt-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/387b0793-b863-48d4-832f-8eb85b4e4d37-libvirt-combined-ca-bundle\") pod \"libvirt-edpm-compute-global-edpm-compute-global-t8t2l\" (UID: \"387b0793-b863-48d4-832f-8eb85b4e4d37\") " pod="openstack-kuttl-tests/libvirt-edpm-compute-global-edpm-compute-global-t8t2l" Mar 16 17:20:17 crc kubenswrapper[5120]: I0316 17:20:17.310067 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"libvirt-secret-0\" (UniqueName: \"kubernetes.io/secret/387b0793-b863-48d4-832f-8eb85b4e4d37-libvirt-secret-0\") pod \"libvirt-edpm-compute-global-edpm-compute-global-t8t2l\" (UID: \"387b0793-b863-48d4-832f-8eb85b4e4d37\") " pod="openstack-kuttl-tests/libvirt-edpm-compute-global-edpm-compute-global-t8t2l" Mar 16 17:20:17 crc kubenswrapper[5120]: I0316 17:20:17.314048 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"libvirt-secret-0\" (UniqueName: \"kubernetes.io/secret/387b0793-b863-48d4-832f-8eb85b4e4d37-libvirt-secret-0\") pod \"libvirt-edpm-compute-global-edpm-compute-global-t8t2l\" (UID: \"387b0793-b863-48d4-832f-8eb85b4e4d37\") " pod="openstack-kuttl-tests/libvirt-edpm-compute-global-edpm-compute-global-t8t2l" Mar 16 17:20:17 crc kubenswrapper[5120]: I0316 17:20:17.314103 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"libvirt-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/387b0793-b863-48d4-832f-8eb85b4e4d37-libvirt-combined-ca-bundle\") pod \"libvirt-edpm-compute-global-edpm-compute-global-t8t2l\" (UID: \"387b0793-b863-48d4-832f-8eb85b4e4d37\") " pod="openstack-kuttl-tests/libvirt-edpm-compute-global-edpm-compute-global-t8t2l" Mar 16 17:20:17 crc kubenswrapper[5120]: I0316 17:20:17.314230 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/387b0793-b863-48d4-832f-8eb85b4e4d37-inventory\") pod \"libvirt-edpm-compute-global-edpm-compute-global-t8t2l\" (UID: \"387b0793-b863-48d4-832f-8eb85b4e4d37\") " pod="openstack-kuttl-tests/libvirt-edpm-compute-global-edpm-compute-global-t8t2l" Mar 16 17:20:17 crc kubenswrapper[5120]: I0316 17:20:17.315164 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/387b0793-b863-48d4-832f-8eb85b4e4d37-ssh-key-edpm-compute-global\") pod \"libvirt-edpm-compute-global-edpm-compute-global-t8t2l\" (UID: \"387b0793-b863-48d4-832f-8eb85b4e4d37\") " pod="openstack-kuttl-tests/libvirt-edpm-compute-global-edpm-compute-global-t8t2l" Mar 16 17:20:17 crc kubenswrapper[5120]: I0316 17:20:17.326874 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqsb2\" (UniqueName: \"kubernetes.io/projected/387b0793-b863-48d4-832f-8eb85b4e4d37-kube-api-access-qqsb2\") pod \"libvirt-edpm-compute-global-edpm-compute-global-t8t2l\" (UID: \"387b0793-b863-48d4-832f-8eb85b4e4d37\") " pod="openstack-kuttl-tests/libvirt-edpm-compute-global-edpm-compute-global-t8t2l" Mar 16 17:20:17 crc kubenswrapper[5120]: I0316 17:20:17.393998 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/libvirt-edpm-compute-global-edpm-compute-global-t8t2l" Mar 16 17:20:17 crc kubenswrapper[5120]: I0316 17:20:17.663432 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/libvirt-edpm-compute-global-edpm-compute-global-t8t2l"] Mar 16 17:20:17 crc kubenswrapper[5120]: W0316 17:20:17.664695 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod387b0793_b863_48d4_832f_8eb85b4e4d37.slice/crio-5c39807eb11b6818ff14d9d6ba1c1eecdab8d68137d2b040e46dd9e6eb11bd52 WatchSource:0}: Error finding container 5c39807eb11b6818ff14d9d6ba1c1eecdab8d68137d2b040e46dd9e6eb11bd52: Status 404 returned error can't find the container with id 5c39807eb11b6818ff14d9d6ba1c1eecdab8d68137d2b040e46dd9e6eb11bd52 Mar 16 17:20:18 crc kubenswrapper[5120]: I0316 17:20:18.005810 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/libvirt-edpm-compute-global-edpm-compute-global-t8t2l" event={"ID":"387b0793-b863-48d4-832f-8eb85b4e4d37","Type":"ContainerStarted","Data":"5c39807eb11b6818ff14d9d6ba1c1eecdab8d68137d2b040e46dd9e6eb11bd52"} Mar 16 17:20:19 crc kubenswrapper[5120]: I0316 17:20:19.017169 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/libvirt-edpm-compute-global-edpm-compute-global-t8t2l" event={"ID":"387b0793-b863-48d4-832f-8eb85b4e4d37","Type":"ContainerStarted","Data":"850a877ea8085adffb221a96fed82ef9e52de59548601ca02ba08156c1816b53"} Mar 16 17:20:19 crc kubenswrapper[5120]: I0316 17:20:19.036438 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/libvirt-edpm-compute-global-edpm-compute-global-t8t2l" podStartSLOduration=1.424413187 podStartE2EDuration="2.03641712s" podCreationTimestamp="2026-03-16 17:20:17 +0000 UTC" firstStartedPulling="2026-03-16 17:20:17.666618641 +0000 UTC m=+6519.820550298" lastFinishedPulling="2026-03-16 17:20:18.278622574 +0000 UTC m=+6520.432554231" observedRunningTime="2026-03-16 17:20:19.033007798 +0000 UTC m=+6521.186939455" watchObservedRunningTime="2026-03-16 17:20:19.03641712 +0000 UTC m=+6521.190348777" Mar 16 17:20:20 crc kubenswrapper[5120]: I0316 17:20:20.025910 5120 generic.go:358] "Generic (PLEG): container finished" podID="387b0793-b863-48d4-832f-8eb85b4e4d37" containerID="850a877ea8085adffb221a96fed82ef9e52de59548601ca02ba08156c1816b53" exitCode=0 Mar 16 17:20:20 crc kubenswrapper[5120]: I0316 17:20:20.026018 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/libvirt-edpm-compute-global-edpm-compute-global-t8t2l" event={"ID":"387b0793-b863-48d4-832f-8eb85b4e4d37","Type":"ContainerDied","Data":"850a877ea8085adffb221a96fed82ef9e52de59548601ca02ba08156c1816b53"} Mar 16 17:20:21 crc kubenswrapper[5120]: I0316 17:20:21.316475 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/libvirt-edpm-compute-global-edpm-compute-global-t8t2l" Mar 16 17:20:21 crc kubenswrapper[5120]: I0316 17:20:21.406599 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/387b0793-b863-48d4-832f-8eb85b4e4d37-ssh-key-edpm-compute-global\") pod \"387b0793-b863-48d4-832f-8eb85b4e4d37\" (UID: \"387b0793-b863-48d4-832f-8eb85b4e4d37\") " Mar 16 17:20:21 crc kubenswrapper[5120]: I0316 17:20:21.407000 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"libvirt-secret-0\" (UniqueName: \"kubernetes.io/secret/387b0793-b863-48d4-832f-8eb85b4e4d37-libvirt-secret-0\") pod \"387b0793-b863-48d4-832f-8eb85b4e4d37\" (UID: \"387b0793-b863-48d4-832f-8eb85b4e4d37\") " Mar 16 17:20:21 crc kubenswrapper[5120]: I0316 17:20:21.407075 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/387b0793-b863-48d4-832f-8eb85b4e4d37-inventory\") pod \"387b0793-b863-48d4-832f-8eb85b4e4d37\" (UID: \"387b0793-b863-48d4-832f-8eb85b4e4d37\") " Mar 16 17:20:21 crc kubenswrapper[5120]: I0316 17:20:21.407600 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qqsb2\" (UniqueName: \"kubernetes.io/projected/387b0793-b863-48d4-832f-8eb85b4e4d37-kube-api-access-qqsb2\") pod \"387b0793-b863-48d4-832f-8eb85b4e4d37\" (UID: \"387b0793-b863-48d4-832f-8eb85b4e4d37\") " Mar 16 17:20:21 crc kubenswrapper[5120]: I0316 17:20:21.407955 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"libvirt-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/387b0793-b863-48d4-832f-8eb85b4e4d37-libvirt-combined-ca-bundle\") pod \"387b0793-b863-48d4-832f-8eb85b4e4d37\" (UID: \"387b0793-b863-48d4-832f-8eb85b4e4d37\") " Mar 16 17:20:21 crc kubenswrapper[5120]: I0316 17:20:21.414337 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/387b0793-b863-48d4-832f-8eb85b4e4d37-kube-api-access-qqsb2" (OuterVolumeSpecName: "kube-api-access-qqsb2") pod "387b0793-b863-48d4-832f-8eb85b4e4d37" (UID: "387b0793-b863-48d4-832f-8eb85b4e4d37"). InnerVolumeSpecName "kube-api-access-qqsb2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:20:21 crc kubenswrapper[5120]: I0316 17:20:21.414811 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/387b0793-b863-48d4-832f-8eb85b4e4d37-libvirt-combined-ca-bundle" (OuterVolumeSpecName: "libvirt-combined-ca-bundle") pod "387b0793-b863-48d4-832f-8eb85b4e4d37" (UID: "387b0793-b863-48d4-832f-8eb85b4e4d37"). InnerVolumeSpecName "libvirt-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:20:21 crc kubenswrapper[5120]: I0316 17:20:21.431725 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/387b0793-b863-48d4-832f-8eb85b4e4d37-libvirt-secret-0" (OuterVolumeSpecName: "libvirt-secret-0") pod "387b0793-b863-48d4-832f-8eb85b4e4d37" (UID: "387b0793-b863-48d4-832f-8eb85b4e4d37"). InnerVolumeSpecName "libvirt-secret-0". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:20:21 crc kubenswrapper[5120]: I0316 17:20:21.434700 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/387b0793-b863-48d4-832f-8eb85b4e4d37-ssh-key-edpm-compute-global" (OuterVolumeSpecName: "ssh-key-edpm-compute-global") pod "387b0793-b863-48d4-832f-8eb85b4e4d37" (UID: "387b0793-b863-48d4-832f-8eb85b4e4d37"). InnerVolumeSpecName "ssh-key-edpm-compute-global". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:20:21 crc kubenswrapper[5120]: I0316 17:20:21.437175 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/387b0793-b863-48d4-832f-8eb85b4e4d37-inventory" (OuterVolumeSpecName: "inventory") pod "387b0793-b863-48d4-832f-8eb85b4e4d37" (UID: "387b0793-b863-48d4-832f-8eb85b4e4d37"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:20:21 crc kubenswrapper[5120]: I0316 17:20:21.510900 5120 reconciler_common.go:299] "Volume detached for volume \"libvirt-secret-0\" (UniqueName: \"kubernetes.io/secret/387b0793-b863-48d4-832f-8eb85b4e4d37-libvirt-secret-0\") on node \"crc\" DevicePath \"\"" Mar 16 17:20:21 crc kubenswrapper[5120]: I0316 17:20:21.510948 5120 reconciler_common.go:299] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/387b0793-b863-48d4-832f-8eb85b4e4d37-inventory\") on node \"crc\" DevicePath \"\"" Mar 16 17:20:21 crc kubenswrapper[5120]: I0316 17:20:21.510960 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qqsb2\" (UniqueName: \"kubernetes.io/projected/387b0793-b863-48d4-832f-8eb85b4e4d37-kube-api-access-qqsb2\") on node \"crc\" DevicePath \"\"" Mar 16 17:20:21 crc kubenswrapper[5120]: I0316 17:20:21.510975 5120 reconciler_common.go:299] "Volume detached for volume \"libvirt-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/387b0793-b863-48d4-832f-8eb85b4e4d37-libvirt-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:20:21 crc kubenswrapper[5120]: I0316 17:20:21.510984 5120 reconciler_common.go:299] "Volume detached for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/387b0793-b863-48d4-832f-8eb85b4e4d37-ssh-key-edpm-compute-global\") on node \"crc\" DevicePath \"\"" Mar 16 17:20:21 crc kubenswrapper[5120]: I0316 17:20:21.665086 5120 scope.go:117] "RemoveContainer" containerID="2ca61165dca6fdb30458423ef74c44c42b1b273e8fa504e89f5f9e186e516cc3" Mar 16 17:20:21 crc kubenswrapper[5120]: E0316 17:20:21.665652 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 17:20:21 crc kubenswrapper[5120]: I0316 17:20:21.770619 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-edpm-compute-global-edpm-compute-global-pfsz2"] Mar 16 17:20:21 crc kubenswrapper[5120]: I0316 17:20:21.771537 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="387b0793-b863-48d4-832f-8eb85b4e4d37" containerName="libvirt-edpm-compute-global-edpm-compute-global" Mar 16 17:20:21 crc kubenswrapper[5120]: I0316 17:20:21.771557 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="387b0793-b863-48d4-832f-8eb85b4e4d37" containerName="libvirt-edpm-compute-global-edpm-compute-global" Mar 16 17:20:21 crc kubenswrapper[5120]: I0316 17:20:21.771703 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="387b0793-b863-48d4-832f-8eb85b4e4d37" containerName="libvirt-edpm-compute-global-edpm-compute-global" Mar 16 17:20:21 crc kubenswrapper[5120]: I0316 17:20:21.778953 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-edpm-compute-global-edpm-compute-global-pfsz2"] Mar 16 17:20:21 crc kubenswrapper[5120]: I0316 17:20:21.779081 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-edpm-compute-global-edpm-compute-global-pfsz2" Mar 16 17:20:21 crc kubenswrapper[5120]: I0316 17:20:21.781160 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-migration-ssh-key\"" Mar 16 17:20:21 crc kubenswrapper[5120]: I0316 17:20:21.781452 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-compute-config\"" Mar 16 17:20:21 crc kubenswrapper[5120]: I0316 17:20:21.822133 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-cell1-compute-config-0\" (UniqueName: \"kubernetes.io/secret/971f334c-69fb-40d2-a173-87de07ee2d14-nova-cell1-compute-config-0\") pod \"nova-edpm-compute-global-edpm-compute-global-pfsz2\" (UID: \"971f334c-69fb-40d2-a173-87de07ee2d14\") " pod="openstack-kuttl-tests/nova-edpm-compute-global-edpm-compute-global-pfsz2" Mar 16 17:20:21 crc kubenswrapper[5120]: I0316 17:20:21.822422 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-migration-ssh-key-0\" (UniqueName: \"kubernetes.io/secret/971f334c-69fb-40d2-a173-87de07ee2d14-nova-migration-ssh-key-0\") pod \"nova-edpm-compute-global-edpm-compute-global-pfsz2\" (UID: \"971f334c-69fb-40d2-a173-87de07ee2d14\") " pod="openstack-kuttl-tests/nova-edpm-compute-global-edpm-compute-global-pfsz2" Mar 16 17:20:21 crc kubenswrapper[5120]: I0316 17:20:21.822551 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/971f334c-69fb-40d2-a173-87de07ee2d14-ssh-key-edpm-compute-global\") pod \"nova-edpm-compute-global-edpm-compute-global-pfsz2\" (UID: \"971f334c-69fb-40d2-a173-87de07ee2d14\") " pod="openstack-kuttl-tests/nova-edpm-compute-global-edpm-compute-global-pfsz2" Mar 16 17:20:21 crc kubenswrapper[5120]: I0316 17:20:21.822658 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/971f334c-69fb-40d2-a173-87de07ee2d14-inventory\") pod \"nova-edpm-compute-global-edpm-compute-global-pfsz2\" (UID: \"971f334c-69fb-40d2-a173-87de07ee2d14\") " pod="openstack-kuttl-tests/nova-edpm-compute-global-edpm-compute-global-pfsz2" Mar 16 17:20:21 crc kubenswrapper[5120]: I0316 17:20:21.822788 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-cell1-compute-config-1\" (UniqueName: \"kubernetes.io/secret/971f334c-69fb-40d2-a173-87de07ee2d14-nova-cell1-compute-config-1\") pod \"nova-edpm-compute-global-edpm-compute-global-pfsz2\" (UID: \"971f334c-69fb-40d2-a173-87de07ee2d14\") " pod="openstack-kuttl-tests/nova-edpm-compute-global-edpm-compute-global-pfsz2" Mar 16 17:20:21 crc kubenswrapper[5120]: I0316 17:20:21.822891 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rd7nr\" (UniqueName: \"kubernetes.io/projected/971f334c-69fb-40d2-a173-87de07ee2d14-kube-api-access-rd7nr\") pod \"nova-edpm-compute-global-edpm-compute-global-pfsz2\" (UID: \"971f334c-69fb-40d2-a173-87de07ee2d14\") " pod="openstack-kuttl-tests/nova-edpm-compute-global-edpm-compute-global-pfsz2" Mar 16 17:20:21 crc kubenswrapper[5120]: I0316 17:20:21.823009 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/971f334c-69fb-40d2-a173-87de07ee2d14-nova-combined-ca-bundle\") pod \"nova-edpm-compute-global-edpm-compute-global-pfsz2\" (UID: \"971f334c-69fb-40d2-a173-87de07ee2d14\") " pod="openstack-kuttl-tests/nova-edpm-compute-global-edpm-compute-global-pfsz2" Mar 16 17:20:21 crc kubenswrapper[5120]: I0316 17:20:21.823151 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-migration-ssh-key-1\" (UniqueName: \"kubernetes.io/secret/971f334c-69fb-40d2-a173-87de07ee2d14-nova-migration-ssh-key-1\") pod \"nova-edpm-compute-global-edpm-compute-global-pfsz2\" (UID: \"971f334c-69fb-40d2-a173-87de07ee2d14\") " pod="openstack-kuttl-tests/nova-edpm-compute-global-edpm-compute-global-pfsz2" Mar 16 17:20:21 crc kubenswrapper[5120]: I0316 17:20:21.925241 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-cell1-compute-config-0\" (UniqueName: \"kubernetes.io/secret/971f334c-69fb-40d2-a173-87de07ee2d14-nova-cell1-compute-config-0\") pod \"nova-edpm-compute-global-edpm-compute-global-pfsz2\" (UID: \"971f334c-69fb-40d2-a173-87de07ee2d14\") " pod="openstack-kuttl-tests/nova-edpm-compute-global-edpm-compute-global-pfsz2" Mar 16 17:20:21 crc kubenswrapper[5120]: I0316 17:20:21.925295 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-migration-ssh-key-0\" (UniqueName: \"kubernetes.io/secret/971f334c-69fb-40d2-a173-87de07ee2d14-nova-migration-ssh-key-0\") pod \"nova-edpm-compute-global-edpm-compute-global-pfsz2\" (UID: \"971f334c-69fb-40d2-a173-87de07ee2d14\") " pod="openstack-kuttl-tests/nova-edpm-compute-global-edpm-compute-global-pfsz2" Mar 16 17:20:21 crc kubenswrapper[5120]: I0316 17:20:21.925345 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/971f334c-69fb-40d2-a173-87de07ee2d14-ssh-key-edpm-compute-global\") pod \"nova-edpm-compute-global-edpm-compute-global-pfsz2\" (UID: \"971f334c-69fb-40d2-a173-87de07ee2d14\") " pod="openstack-kuttl-tests/nova-edpm-compute-global-edpm-compute-global-pfsz2" Mar 16 17:20:21 crc kubenswrapper[5120]: I0316 17:20:21.925368 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/971f334c-69fb-40d2-a173-87de07ee2d14-inventory\") pod \"nova-edpm-compute-global-edpm-compute-global-pfsz2\" (UID: \"971f334c-69fb-40d2-a173-87de07ee2d14\") " pod="openstack-kuttl-tests/nova-edpm-compute-global-edpm-compute-global-pfsz2" Mar 16 17:20:21 crc kubenswrapper[5120]: I0316 17:20:21.925397 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-cell1-compute-config-1\" (UniqueName: \"kubernetes.io/secret/971f334c-69fb-40d2-a173-87de07ee2d14-nova-cell1-compute-config-1\") pod \"nova-edpm-compute-global-edpm-compute-global-pfsz2\" (UID: \"971f334c-69fb-40d2-a173-87de07ee2d14\") " pod="openstack-kuttl-tests/nova-edpm-compute-global-edpm-compute-global-pfsz2" Mar 16 17:20:21 crc kubenswrapper[5120]: I0316 17:20:21.925422 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rd7nr\" (UniqueName: \"kubernetes.io/projected/971f334c-69fb-40d2-a173-87de07ee2d14-kube-api-access-rd7nr\") pod \"nova-edpm-compute-global-edpm-compute-global-pfsz2\" (UID: \"971f334c-69fb-40d2-a173-87de07ee2d14\") " pod="openstack-kuttl-tests/nova-edpm-compute-global-edpm-compute-global-pfsz2" Mar 16 17:20:21 crc kubenswrapper[5120]: I0316 17:20:21.925465 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/971f334c-69fb-40d2-a173-87de07ee2d14-nova-combined-ca-bundle\") pod \"nova-edpm-compute-global-edpm-compute-global-pfsz2\" (UID: \"971f334c-69fb-40d2-a173-87de07ee2d14\") " pod="openstack-kuttl-tests/nova-edpm-compute-global-edpm-compute-global-pfsz2" Mar 16 17:20:21 crc kubenswrapper[5120]: I0316 17:20:21.925554 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-migration-ssh-key-1\" (UniqueName: \"kubernetes.io/secret/971f334c-69fb-40d2-a173-87de07ee2d14-nova-migration-ssh-key-1\") pod \"nova-edpm-compute-global-edpm-compute-global-pfsz2\" (UID: \"971f334c-69fb-40d2-a173-87de07ee2d14\") " pod="openstack-kuttl-tests/nova-edpm-compute-global-edpm-compute-global-pfsz2" Mar 16 17:20:21 crc kubenswrapper[5120]: I0316 17:20:21.929322 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-migration-ssh-key-1\" (UniqueName: \"kubernetes.io/secret/971f334c-69fb-40d2-a173-87de07ee2d14-nova-migration-ssh-key-1\") pod \"nova-edpm-compute-global-edpm-compute-global-pfsz2\" (UID: \"971f334c-69fb-40d2-a173-87de07ee2d14\") " pod="openstack-kuttl-tests/nova-edpm-compute-global-edpm-compute-global-pfsz2" Mar 16 17:20:21 crc kubenswrapper[5120]: I0316 17:20:21.929953 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-migration-ssh-key-0\" (UniqueName: \"kubernetes.io/secret/971f334c-69fb-40d2-a173-87de07ee2d14-nova-migration-ssh-key-0\") pod \"nova-edpm-compute-global-edpm-compute-global-pfsz2\" (UID: \"971f334c-69fb-40d2-a173-87de07ee2d14\") " pod="openstack-kuttl-tests/nova-edpm-compute-global-edpm-compute-global-pfsz2" Mar 16 17:20:21 crc kubenswrapper[5120]: I0316 17:20:21.930020 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-cell1-compute-config-1\" (UniqueName: \"kubernetes.io/secret/971f334c-69fb-40d2-a173-87de07ee2d14-nova-cell1-compute-config-1\") pod \"nova-edpm-compute-global-edpm-compute-global-pfsz2\" (UID: \"971f334c-69fb-40d2-a173-87de07ee2d14\") " pod="openstack-kuttl-tests/nova-edpm-compute-global-edpm-compute-global-pfsz2" Mar 16 17:20:21 crc kubenswrapper[5120]: I0316 17:20:21.930184 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/971f334c-69fb-40d2-a173-87de07ee2d14-ssh-key-edpm-compute-global\") pod \"nova-edpm-compute-global-edpm-compute-global-pfsz2\" (UID: \"971f334c-69fb-40d2-a173-87de07ee2d14\") " pod="openstack-kuttl-tests/nova-edpm-compute-global-edpm-compute-global-pfsz2" Mar 16 17:20:21 crc kubenswrapper[5120]: I0316 17:20:21.930879 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-cell1-compute-config-0\" (UniqueName: \"kubernetes.io/secret/971f334c-69fb-40d2-a173-87de07ee2d14-nova-cell1-compute-config-0\") pod \"nova-edpm-compute-global-edpm-compute-global-pfsz2\" (UID: \"971f334c-69fb-40d2-a173-87de07ee2d14\") " pod="openstack-kuttl-tests/nova-edpm-compute-global-edpm-compute-global-pfsz2" Mar 16 17:20:21 crc kubenswrapper[5120]: I0316 17:20:21.931499 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/971f334c-69fb-40d2-a173-87de07ee2d14-nova-combined-ca-bundle\") pod \"nova-edpm-compute-global-edpm-compute-global-pfsz2\" (UID: \"971f334c-69fb-40d2-a173-87de07ee2d14\") " pod="openstack-kuttl-tests/nova-edpm-compute-global-edpm-compute-global-pfsz2" Mar 16 17:20:21 crc kubenswrapper[5120]: I0316 17:20:21.931593 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/971f334c-69fb-40d2-a173-87de07ee2d14-inventory\") pod \"nova-edpm-compute-global-edpm-compute-global-pfsz2\" (UID: \"971f334c-69fb-40d2-a173-87de07ee2d14\") " pod="openstack-kuttl-tests/nova-edpm-compute-global-edpm-compute-global-pfsz2" Mar 16 17:20:21 crc kubenswrapper[5120]: I0316 17:20:21.942152 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rd7nr\" (UniqueName: \"kubernetes.io/projected/971f334c-69fb-40d2-a173-87de07ee2d14-kube-api-access-rd7nr\") pod \"nova-edpm-compute-global-edpm-compute-global-pfsz2\" (UID: \"971f334c-69fb-40d2-a173-87de07ee2d14\") " pod="openstack-kuttl-tests/nova-edpm-compute-global-edpm-compute-global-pfsz2" Mar 16 17:20:22 crc kubenswrapper[5120]: I0316 17:20:22.049219 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/libvirt-edpm-compute-global-edpm-compute-global-t8t2l" Mar 16 17:20:22 crc kubenswrapper[5120]: I0316 17:20:22.049260 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/libvirt-edpm-compute-global-edpm-compute-global-t8t2l" event={"ID":"387b0793-b863-48d4-832f-8eb85b4e4d37","Type":"ContainerDied","Data":"5c39807eb11b6818ff14d9d6ba1c1eecdab8d68137d2b040e46dd9e6eb11bd52"} Mar 16 17:20:22 crc kubenswrapper[5120]: I0316 17:20:22.049621 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5c39807eb11b6818ff14d9d6ba1c1eecdab8d68137d2b040e46dd9e6eb11bd52" Mar 16 17:20:22 crc kubenswrapper[5120]: I0316 17:20:22.098685 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-edpm-compute-global-edpm-compute-global-pfsz2" Mar 16 17:20:22 crc kubenswrapper[5120]: I0316 17:20:22.341319 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-edpm-compute-global-edpm-compute-global-pfsz2"] Mar 16 17:20:22 crc kubenswrapper[5120]: W0316 17:20:22.343685 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod971f334c_69fb_40d2_a173_87de07ee2d14.slice/crio-091cd38bc8cf832c787db94c4da0f479661c1eb1c6323ec675b5ec4c06ce6d6f WatchSource:0}: Error finding container 091cd38bc8cf832c787db94c4da0f479661c1eb1c6323ec675b5ec4c06ce6d6f: Status 404 returned error can't find the container with id 091cd38bc8cf832c787db94c4da0f479661c1eb1c6323ec675b5ec4c06ce6d6f Mar 16 17:20:23 crc kubenswrapper[5120]: I0316 17:20:23.058312 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-edpm-compute-global-edpm-compute-global-pfsz2" event={"ID":"971f334c-69fb-40d2-a173-87de07ee2d14","Type":"ContainerStarted","Data":"812b63c9828980ac8131599a518bcb66f145a0e2e45deefcf876d29e4f4f2fec"} Mar 16 17:20:23 crc kubenswrapper[5120]: I0316 17:20:23.058637 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-edpm-compute-global-edpm-compute-global-pfsz2" event={"ID":"971f334c-69fb-40d2-a173-87de07ee2d14","Type":"ContainerStarted","Data":"091cd38bc8cf832c787db94c4da0f479661c1eb1c6323ec675b5ec4c06ce6d6f"} Mar 16 17:20:23 crc kubenswrapper[5120]: I0316 17:20:23.075579 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-edpm-compute-global-edpm-compute-global-pfsz2" podStartSLOduration=1.650519026 podStartE2EDuration="2.075559191s" podCreationTimestamp="2026-03-16 17:20:21 +0000 UTC" firstStartedPulling="2026-03-16 17:20:22.345043739 +0000 UTC m=+6524.498975396" lastFinishedPulling="2026-03-16 17:20:22.770083904 +0000 UTC m=+6524.924015561" observedRunningTime="2026-03-16 17:20:23.074974916 +0000 UTC m=+6525.228906573" watchObservedRunningTime="2026-03-16 17:20:23.075559191 +0000 UTC m=+6525.229490848" Mar 16 17:20:23 crc kubenswrapper[5120]: I0316 17:20:23.835400 5120 scope.go:117] "RemoveContainer" containerID="ec4062b394d56862e1ae3bad938c3fcf69b02aa1d4cf1b6ee7609e0c9ded8ba3" Mar 16 17:20:23 crc kubenswrapper[5120]: I0316 17:20:23.857690 5120 scope.go:117] "RemoveContainer" containerID="6ed9051ec8823bfbf22ce1272643a6e138dece8ee338be178cec39b284aafecb" Mar 16 17:20:23 crc kubenswrapper[5120]: I0316 17:20:23.888167 5120 scope.go:117] "RemoveContainer" containerID="94b5a95d3401ba6aca2c4eea6b8e4a63e4758571456a4be6ec2da46ee9dfd215" Mar 16 17:20:23 crc kubenswrapper[5120]: I0316 17:20:23.907190 5120 scope.go:117] "RemoveContainer" containerID="5a608768c816e759b1547b4e7085b9239ee5a3b88e54a9ac9ed87d76d8f06f24" Mar 16 17:20:23 crc kubenswrapper[5120]: I0316 17:20:23.925503 5120 scope.go:117] "RemoveContainer" containerID="c5fef62b06d8256f82c76b40b8a78f4431b6cbe5fe68d35ce041bf7aec63df7c" Mar 16 17:20:23 crc kubenswrapper[5120]: I0316 17:20:23.948499 5120 scope.go:117] "RemoveContainer" containerID="b8326165cdd8aa171a07bf7a235f392a4c768dec9ed42d972cea9cd5c29116f3" Mar 16 17:20:23 crc kubenswrapper[5120]: I0316 17:20:23.979313 5120 scope.go:117] "RemoveContainer" containerID="c488500facf2a43af1b9d21af7057a21ff3941510d5b87671ffafb7a3741ab33" Mar 16 17:20:24 crc kubenswrapper[5120]: I0316 17:20:23.996582 5120 scope.go:117] "RemoveContainer" containerID="2fc3e403e6330ac6fbe973cbd165e0c7e03d0b3ecbbc2615e12f28cf90e0be45" Mar 16 17:20:24 crc kubenswrapper[5120]: I0316 17:20:24.027120 5120 scope.go:117] "RemoveContainer" containerID="ad6f4cf61cb3feac4417796aa1dded828003e1cc426a18dfdeaada2e2db23204" Mar 16 17:20:24 crc kubenswrapper[5120]: I0316 17:20:24.052936 5120 scope.go:117] "RemoveContainer" containerID="fb67d148059bfc4eacc0403df2280ae59beca37b8486e74770730596695c5a9c" Mar 16 17:20:24 crc kubenswrapper[5120]: I0316 17:20:24.098199 5120 scope.go:117] "RemoveContainer" containerID="b238a32cf48132d7f92857ce9002d00388e302772145a1e6263f979c4738435f" Mar 16 17:20:24 crc kubenswrapper[5120]: I0316 17:20:24.122313 5120 scope.go:117] "RemoveContainer" containerID="4e6c0f66786b5e3b4a73599395a4b0251b018a5b233eaa26d6632468ef6db93c" Mar 16 17:20:24 crc kubenswrapper[5120]: I0316 17:20:24.214166 5120 scope.go:117] "RemoveContainer" containerID="372efc3906fa2e4af2cf094c15567db6c1e2954d2088443f236e805e56e280f1" Mar 16 17:20:24 crc kubenswrapper[5120]: I0316 17:20:24.255859 5120 scope.go:117] "RemoveContainer" containerID="332d8a8119619d4e075777df9bea346c6e4c6f1db10ae7a73e35a01395d94e8d" Mar 16 17:20:24 crc kubenswrapper[5120]: E0316 17:20:24.291605 5120 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod971f334c_69fb_40d2_a173_87de07ee2d14.slice/crio-conmon-812b63c9828980ac8131599a518bcb66f145a0e2e45deefcf876d29e4f4f2fec.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod971f334c_69fb_40d2_a173_87de07ee2d14.slice/crio-812b63c9828980ac8131599a518bcb66f145a0e2e45deefcf876d29e4f4f2fec.scope\": RecentStats: unable to find data in memory cache]" Mar 16 17:20:24 crc kubenswrapper[5120]: I0316 17:20:24.347716 5120 scope.go:117] "RemoveContainer" containerID="8989093cd2b31486c0447902c228c679bdf019f2265ec9159f2c17f23921c256" Mar 16 17:20:24 crc kubenswrapper[5120]: I0316 17:20:24.367991 5120 scope.go:117] "RemoveContainer" containerID="40629dd0d3c60a17d6216d22b679f572b39fc0af6c6ec56f7975429633a51360" Mar 16 17:20:24 crc kubenswrapper[5120]: I0316 17:20:24.387169 5120 scope.go:117] "RemoveContainer" containerID="d6fb5db0545d3a192d7d97f43821fe460f21562edeb502a39499c7c3d66a82b0" Mar 16 17:20:25 crc kubenswrapper[5120]: I0316 17:20:25.087547 5120 generic.go:358] "Generic (PLEG): container finished" podID="971f334c-69fb-40d2-a173-87de07ee2d14" containerID="812b63c9828980ac8131599a518bcb66f145a0e2e45deefcf876d29e4f4f2fec" exitCode=0 Mar 16 17:20:25 crc kubenswrapper[5120]: I0316 17:20:25.087648 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-edpm-compute-global-edpm-compute-global-pfsz2" event={"ID":"971f334c-69fb-40d2-a173-87de07ee2d14","Type":"ContainerDied","Data":"812b63c9828980ac8131599a518bcb66f145a0e2e45deefcf876d29e4f4f2fec"} Mar 16 17:20:26 crc kubenswrapper[5120]: I0316 17:20:26.374264 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-edpm-compute-global-edpm-compute-global-pfsz2" Mar 16 17:20:26 crc kubenswrapper[5120]: I0316 17:20:26.548263 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/971f334c-69fb-40d2-a173-87de07ee2d14-ssh-key-edpm-compute-global\") pod \"971f334c-69fb-40d2-a173-87de07ee2d14\" (UID: \"971f334c-69fb-40d2-a173-87de07ee2d14\") " Mar 16 17:20:26 crc kubenswrapper[5120]: I0316 17:20:26.548411 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/971f334c-69fb-40d2-a173-87de07ee2d14-nova-combined-ca-bundle\") pod \"971f334c-69fb-40d2-a173-87de07ee2d14\" (UID: \"971f334c-69fb-40d2-a173-87de07ee2d14\") " Mar 16 17:20:26 crc kubenswrapper[5120]: I0316 17:20:26.548464 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-cell1-compute-config-1\" (UniqueName: \"kubernetes.io/secret/971f334c-69fb-40d2-a173-87de07ee2d14-nova-cell1-compute-config-1\") pod \"971f334c-69fb-40d2-a173-87de07ee2d14\" (UID: \"971f334c-69fb-40d2-a173-87de07ee2d14\") " Mar 16 17:20:26 crc kubenswrapper[5120]: I0316 17:20:26.548529 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-migration-ssh-key-0\" (UniqueName: \"kubernetes.io/secret/971f334c-69fb-40d2-a173-87de07ee2d14-nova-migration-ssh-key-0\") pod \"971f334c-69fb-40d2-a173-87de07ee2d14\" (UID: \"971f334c-69fb-40d2-a173-87de07ee2d14\") " Mar 16 17:20:26 crc kubenswrapper[5120]: I0316 17:20:26.548616 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/971f334c-69fb-40d2-a173-87de07ee2d14-inventory\") pod \"971f334c-69fb-40d2-a173-87de07ee2d14\" (UID: \"971f334c-69fb-40d2-a173-87de07ee2d14\") " Mar 16 17:20:26 crc kubenswrapper[5120]: I0316 17:20:26.548662 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-migration-ssh-key-1\" (UniqueName: \"kubernetes.io/secret/971f334c-69fb-40d2-a173-87de07ee2d14-nova-migration-ssh-key-1\") pod \"971f334c-69fb-40d2-a173-87de07ee2d14\" (UID: \"971f334c-69fb-40d2-a173-87de07ee2d14\") " Mar 16 17:20:26 crc kubenswrapper[5120]: I0316 17:20:26.548884 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-cell1-compute-config-0\" (UniqueName: \"kubernetes.io/secret/971f334c-69fb-40d2-a173-87de07ee2d14-nova-cell1-compute-config-0\") pod \"971f334c-69fb-40d2-a173-87de07ee2d14\" (UID: \"971f334c-69fb-40d2-a173-87de07ee2d14\") " Mar 16 17:20:26 crc kubenswrapper[5120]: I0316 17:20:26.548947 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rd7nr\" (UniqueName: \"kubernetes.io/projected/971f334c-69fb-40d2-a173-87de07ee2d14-kube-api-access-rd7nr\") pod \"971f334c-69fb-40d2-a173-87de07ee2d14\" (UID: \"971f334c-69fb-40d2-a173-87de07ee2d14\") " Mar 16 17:20:26 crc kubenswrapper[5120]: I0316 17:20:26.577259 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/971f334c-69fb-40d2-a173-87de07ee2d14-nova-combined-ca-bundle" (OuterVolumeSpecName: "nova-combined-ca-bundle") pod "971f334c-69fb-40d2-a173-87de07ee2d14" (UID: "971f334c-69fb-40d2-a173-87de07ee2d14"). InnerVolumeSpecName "nova-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:20:26 crc kubenswrapper[5120]: I0316 17:20:26.578544 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/971f334c-69fb-40d2-a173-87de07ee2d14-kube-api-access-rd7nr" (OuterVolumeSpecName: "kube-api-access-rd7nr") pod "971f334c-69fb-40d2-a173-87de07ee2d14" (UID: "971f334c-69fb-40d2-a173-87de07ee2d14"). InnerVolumeSpecName "kube-api-access-rd7nr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:20:26 crc kubenswrapper[5120]: I0316 17:20:26.582169 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/971f334c-69fb-40d2-a173-87de07ee2d14-nova-cell1-compute-config-1" (OuterVolumeSpecName: "nova-cell1-compute-config-1") pod "971f334c-69fb-40d2-a173-87de07ee2d14" (UID: "971f334c-69fb-40d2-a173-87de07ee2d14"). InnerVolumeSpecName "nova-cell1-compute-config-1". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:20:26 crc kubenswrapper[5120]: I0316 17:20:26.584135 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/971f334c-69fb-40d2-a173-87de07ee2d14-ssh-key-edpm-compute-global" (OuterVolumeSpecName: "ssh-key-edpm-compute-global") pod "971f334c-69fb-40d2-a173-87de07ee2d14" (UID: "971f334c-69fb-40d2-a173-87de07ee2d14"). InnerVolumeSpecName "ssh-key-edpm-compute-global". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:20:26 crc kubenswrapper[5120]: I0316 17:20:26.584916 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/971f334c-69fb-40d2-a173-87de07ee2d14-inventory" (OuterVolumeSpecName: "inventory") pod "971f334c-69fb-40d2-a173-87de07ee2d14" (UID: "971f334c-69fb-40d2-a173-87de07ee2d14"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:20:26 crc kubenswrapper[5120]: I0316 17:20:26.585857 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/971f334c-69fb-40d2-a173-87de07ee2d14-nova-migration-ssh-key-0" (OuterVolumeSpecName: "nova-migration-ssh-key-0") pod "971f334c-69fb-40d2-a173-87de07ee2d14" (UID: "971f334c-69fb-40d2-a173-87de07ee2d14"). InnerVolumeSpecName "nova-migration-ssh-key-0". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:20:26 crc kubenswrapper[5120]: I0316 17:20:26.585934 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/971f334c-69fb-40d2-a173-87de07ee2d14-nova-migration-ssh-key-1" (OuterVolumeSpecName: "nova-migration-ssh-key-1") pod "971f334c-69fb-40d2-a173-87de07ee2d14" (UID: "971f334c-69fb-40d2-a173-87de07ee2d14"). InnerVolumeSpecName "nova-migration-ssh-key-1". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:20:26 crc kubenswrapper[5120]: I0316 17:20:26.587955 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/971f334c-69fb-40d2-a173-87de07ee2d14-nova-cell1-compute-config-0" (OuterVolumeSpecName: "nova-cell1-compute-config-0") pod "971f334c-69fb-40d2-a173-87de07ee2d14" (UID: "971f334c-69fb-40d2-a173-87de07ee2d14"). InnerVolumeSpecName "nova-cell1-compute-config-0". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:20:26 crc kubenswrapper[5120]: I0316 17:20:26.651976 5120 reconciler_common.go:299] "Volume detached for volume \"nova-cell1-compute-config-0\" (UniqueName: \"kubernetes.io/secret/971f334c-69fb-40d2-a173-87de07ee2d14-nova-cell1-compute-config-0\") on node \"crc\" DevicePath \"\"" Mar 16 17:20:26 crc kubenswrapper[5120]: I0316 17:20:26.652043 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rd7nr\" (UniqueName: \"kubernetes.io/projected/971f334c-69fb-40d2-a173-87de07ee2d14-kube-api-access-rd7nr\") on node \"crc\" DevicePath \"\"" Mar 16 17:20:26 crc kubenswrapper[5120]: I0316 17:20:26.652065 5120 reconciler_common.go:299] "Volume detached for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/971f334c-69fb-40d2-a173-87de07ee2d14-ssh-key-edpm-compute-global\") on node \"crc\" DevicePath \"\"" Mar 16 17:20:26 crc kubenswrapper[5120]: I0316 17:20:26.652078 5120 reconciler_common.go:299] "Volume detached for volume \"nova-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/971f334c-69fb-40d2-a173-87de07ee2d14-nova-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:20:26 crc kubenswrapper[5120]: I0316 17:20:26.652091 5120 reconciler_common.go:299] "Volume detached for volume \"nova-cell1-compute-config-1\" (UniqueName: \"kubernetes.io/secret/971f334c-69fb-40d2-a173-87de07ee2d14-nova-cell1-compute-config-1\") on node \"crc\" DevicePath \"\"" Mar 16 17:20:26 crc kubenswrapper[5120]: I0316 17:20:26.652104 5120 reconciler_common.go:299] "Volume detached for volume \"nova-migration-ssh-key-0\" (UniqueName: \"kubernetes.io/secret/971f334c-69fb-40d2-a173-87de07ee2d14-nova-migration-ssh-key-0\") on node \"crc\" DevicePath \"\"" Mar 16 17:20:26 crc kubenswrapper[5120]: I0316 17:20:26.652117 5120 reconciler_common.go:299] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/971f334c-69fb-40d2-a173-87de07ee2d14-inventory\") on node \"crc\" DevicePath \"\"" Mar 16 17:20:26 crc kubenswrapper[5120]: I0316 17:20:26.652130 5120 reconciler_common.go:299] "Volume detached for volume \"nova-migration-ssh-key-1\" (UniqueName: \"kubernetes.io/secret/971f334c-69fb-40d2-a173-87de07ee2d14-nova-migration-ssh-key-1\") on node \"crc\" DevicePath \"\"" Mar 16 17:20:27 crc kubenswrapper[5120]: I0316 17:20:27.104554 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-edpm-compute-global-edpm-compute-global-pfsz2" event={"ID":"971f334c-69fb-40d2-a173-87de07ee2d14","Type":"ContainerDied","Data":"091cd38bc8cf832c787db94c4da0f479661c1eb1c6323ec675b5ec4c06ce6d6f"} Mar 16 17:20:27 crc kubenswrapper[5120]: I0316 17:20:27.104607 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="091cd38bc8cf832c787db94c4da0f479661c1eb1c6323ec675b5ec4c06ce6d6f" Mar 16 17:20:27 crc kubenswrapper[5120]: I0316 17:20:27.104573 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-edpm-compute-global-edpm-compute-global-pfsz2" Mar 16 17:20:27 crc kubenswrapper[5120]: I0316 17:20:27.181483 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/custom-global-service-edpm-compute-global-fq4pn"] Mar 16 17:20:27 crc kubenswrapper[5120]: I0316 17:20:27.183050 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="971f334c-69fb-40d2-a173-87de07ee2d14" containerName="nova-edpm-compute-global-edpm-compute-global" Mar 16 17:20:27 crc kubenswrapper[5120]: I0316 17:20:27.183080 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="971f334c-69fb-40d2-a173-87de07ee2d14" containerName="nova-edpm-compute-global-edpm-compute-global" Mar 16 17:20:27 crc kubenswrapper[5120]: I0316 17:20:27.183250 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="971f334c-69fb-40d2-a173-87de07ee2d14" containerName="nova-edpm-compute-global-edpm-compute-global" Mar 16 17:20:27 crc kubenswrapper[5120]: I0316 17:20:27.203404 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/custom-global-service-edpm-compute-global-fq4pn" Mar 16 17:20:27 crc kubenswrapper[5120]: I0316 17:20:27.206308 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplanenodeset-edpm-compute-global\"" Mar 16 17:20:27 crc kubenswrapper[5120]: I0316 17:20:27.206365 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"edpm-compute-global-dockercfg-5hp85\"" Mar 16 17:20:27 crc kubenswrapper[5120]: I0316 17:20:27.206477 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-aee-default-env\"" Mar 16 17:20:27 crc kubenswrapper[5120]: I0316 17:20:27.206647 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"combined-ca-bundle\"" Mar 16 17:20:27 crc kubenswrapper[5120]: I0316 17:20:27.208802 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/custom-global-service-edpm-compute-global-fq4pn"] Mar 16 17:20:27 crc kubenswrapper[5120]: I0316 17:20:27.213144 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplane-ansible-ssh-private-key-secret\"" Mar 16 17:20:27 crc kubenswrapper[5120]: I0316 17:20:27.264367 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory-0\" (UniqueName: \"kubernetes.io/secret/2ec4d48f-6f71-4029-b5da-d428dd885ac4-inventory-0\") pod \"custom-global-service-edpm-compute-global-fq4pn\" (UID: \"2ec4d48f-6f71-4029-b5da-d428dd885ac4\") " pod="openstack-kuttl-tests/custom-global-service-edpm-compute-global-fq4pn" Mar 16 17:20:27 crc kubenswrapper[5120]: I0316 17:20:27.264592 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/2ec4d48f-6f71-4029-b5da-d428dd885ac4-ssh-key-edpm-compute-global\") pod \"custom-global-service-edpm-compute-global-fq4pn\" (UID: \"2ec4d48f-6f71-4029-b5da-d428dd885ac4\") " pod="openstack-kuttl-tests/custom-global-service-edpm-compute-global-fq4pn" Mar 16 17:20:27 crc kubenswrapper[5120]: I0316 17:20:27.264790 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"custom-global-service-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2ec4d48f-6f71-4029-b5da-d428dd885ac4-custom-global-service-combined-ca-bundle\") pod \"custom-global-service-edpm-compute-global-fq4pn\" (UID: \"2ec4d48f-6f71-4029-b5da-d428dd885ac4\") " pod="openstack-kuttl-tests/custom-global-service-edpm-compute-global-fq4pn" Mar 16 17:20:27 crc kubenswrapper[5120]: I0316 17:20:27.264932 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xc9w\" (UniqueName: \"kubernetes.io/projected/2ec4d48f-6f71-4029-b5da-d428dd885ac4-kube-api-access-7xc9w\") pod \"custom-global-service-edpm-compute-global-fq4pn\" (UID: \"2ec4d48f-6f71-4029-b5da-d428dd885ac4\") " pod="openstack-kuttl-tests/custom-global-service-edpm-compute-global-fq4pn" Mar 16 17:20:27 crc kubenswrapper[5120]: I0316 17:20:27.366714 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7xc9w\" (UniqueName: \"kubernetes.io/projected/2ec4d48f-6f71-4029-b5da-d428dd885ac4-kube-api-access-7xc9w\") pod \"custom-global-service-edpm-compute-global-fq4pn\" (UID: \"2ec4d48f-6f71-4029-b5da-d428dd885ac4\") " pod="openstack-kuttl-tests/custom-global-service-edpm-compute-global-fq4pn" Mar 16 17:20:27 crc kubenswrapper[5120]: I0316 17:20:27.366868 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"inventory-0\" (UniqueName: \"kubernetes.io/secret/2ec4d48f-6f71-4029-b5da-d428dd885ac4-inventory-0\") pod \"custom-global-service-edpm-compute-global-fq4pn\" (UID: \"2ec4d48f-6f71-4029-b5da-d428dd885ac4\") " pod="openstack-kuttl-tests/custom-global-service-edpm-compute-global-fq4pn" Mar 16 17:20:27 crc kubenswrapper[5120]: I0316 17:20:27.367000 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/2ec4d48f-6f71-4029-b5da-d428dd885ac4-ssh-key-edpm-compute-global\") pod \"custom-global-service-edpm-compute-global-fq4pn\" (UID: \"2ec4d48f-6f71-4029-b5da-d428dd885ac4\") " pod="openstack-kuttl-tests/custom-global-service-edpm-compute-global-fq4pn" Mar 16 17:20:27 crc kubenswrapper[5120]: I0316 17:20:27.367199 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"custom-global-service-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2ec4d48f-6f71-4029-b5da-d428dd885ac4-custom-global-service-combined-ca-bundle\") pod \"custom-global-service-edpm-compute-global-fq4pn\" (UID: \"2ec4d48f-6f71-4029-b5da-d428dd885ac4\") " pod="openstack-kuttl-tests/custom-global-service-edpm-compute-global-fq4pn" Mar 16 17:20:27 crc kubenswrapper[5120]: I0316 17:20:27.371852 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/2ec4d48f-6f71-4029-b5da-d428dd885ac4-ssh-key-edpm-compute-global\") pod \"custom-global-service-edpm-compute-global-fq4pn\" (UID: \"2ec4d48f-6f71-4029-b5da-d428dd885ac4\") " pod="openstack-kuttl-tests/custom-global-service-edpm-compute-global-fq4pn" Mar 16 17:20:27 crc kubenswrapper[5120]: I0316 17:20:27.372153 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"custom-global-service-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2ec4d48f-6f71-4029-b5da-d428dd885ac4-custom-global-service-combined-ca-bundle\") pod \"custom-global-service-edpm-compute-global-fq4pn\" (UID: \"2ec4d48f-6f71-4029-b5da-d428dd885ac4\") " pod="openstack-kuttl-tests/custom-global-service-edpm-compute-global-fq4pn" Mar 16 17:20:27 crc kubenswrapper[5120]: I0316 17:20:27.373987 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"inventory-0\" (UniqueName: \"kubernetes.io/secret/2ec4d48f-6f71-4029-b5da-d428dd885ac4-inventory-0\") pod \"custom-global-service-edpm-compute-global-fq4pn\" (UID: \"2ec4d48f-6f71-4029-b5da-d428dd885ac4\") " pod="openstack-kuttl-tests/custom-global-service-edpm-compute-global-fq4pn" Mar 16 17:20:27 crc kubenswrapper[5120]: I0316 17:20:27.386903 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xc9w\" (UniqueName: \"kubernetes.io/projected/2ec4d48f-6f71-4029-b5da-d428dd885ac4-kube-api-access-7xc9w\") pod \"custom-global-service-edpm-compute-global-fq4pn\" (UID: \"2ec4d48f-6f71-4029-b5da-d428dd885ac4\") " pod="openstack-kuttl-tests/custom-global-service-edpm-compute-global-fq4pn" Mar 16 17:20:27 crc kubenswrapper[5120]: I0316 17:20:27.528928 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/custom-global-service-edpm-compute-global-fq4pn" Mar 16 17:20:27 crc kubenswrapper[5120]: I0316 17:20:27.979709 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/custom-global-service-edpm-compute-global-fq4pn"] Mar 16 17:20:28 crc kubenswrapper[5120]: I0316 17:20:28.113049 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/custom-global-service-edpm-compute-global-fq4pn" event={"ID":"2ec4d48f-6f71-4029-b5da-d428dd885ac4","Type":"ContainerStarted","Data":"e3fe76267a1e63f57cad9a165302ab78d5066b1850be7feb722798197ce2290f"} Mar 16 17:20:29 crc kubenswrapper[5120]: I0316 17:20:29.122703 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/custom-global-service-edpm-compute-global-fq4pn" event={"ID":"2ec4d48f-6f71-4029-b5da-d428dd885ac4","Type":"ContainerStarted","Data":"654211a94a476c388666a35294705859ca787c25584b814d726d4de9744c6e45"} Mar 16 17:20:29 crc kubenswrapper[5120]: I0316 17:20:29.143507 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/custom-global-service-edpm-compute-global-fq4pn" podStartSLOduration=1.7256185309999998 podStartE2EDuration="2.143492359s" podCreationTimestamp="2026-03-16 17:20:27 +0000 UTC" firstStartedPulling="2026-03-16 17:20:27.98708514 +0000 UTC m=+6530.141016797" lastFinishedPulling="2026-03-16 17:20:28.404958968 +0000 UTC m=+6530.558890625" observedRunningTime="2026-03-16 17:20:29.137892516 +0000 UTC m=+6531.291824193" watchObservedRunningTime="2026-03-16 17:20:29.143492359 +0000 UTC m=+6531.297424016" Mar 16 17:20:32 crc kubenswrapper[5120]: I0316 17:20:32.156457 5120 generic.go:358] "Generic (PLEG): container finished" podID="2ec4d48f-6f71-4029-b5da-d428dd885ac4" containerID="654211a94a476c388666a35294705859ca787c25584b814d726d4de9744c6e45" exitCode=0 Mar 16 17:20:32 crc kubenswrapper[5120]: I0316 17:20:32.156561 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/custom-global-service-edpm-compute-global-fq4pn" event={"ID":"2ec4d48f-6f71-4029-b5da-d428dd885ac4","Type":"ContainerDied","Data":"654211a94a476c388666a35294705859ca787c25584b814d726d4de9744c6e45"} Mar 16 17:20:33 crc kubenswrapper[5120]: I0316 17:20:33.446958 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/custom-global-service-edpm-compute-global-fq4pn" Mar 16 17:20:33 crc kubenswrapper[5120]: I0316 17:20:33.605302 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"inventory-0\" (UniqueName: \"kubernetes.io/secret/2ec4d48f-6f71-4029-b5da-d428dd885ac4-inventory-0\") pod \"2ec4d48f-6f71-4029-b5da-d428dd885ac4\" (UID: \"2ec4d48f-6f71-4029-b5da-d428dd885ac4\") " Mar 16 17:20:33 crc kubenswrapper[5120]: I0316 17:20:33.605513 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/2ec4d48f-6f71-4029-b5da-d428dd885ac4-ssh-key-edpm-compute-global\") pod \"2ec4d48f-6f71-4029-b5da-d428dd885ac4\" (UID: \"2ec4d48f-6f71-4029-b5da-d428dd885ac4\") " Mar 16 17:20:33 crc kubenswrapper[5120]: I0316 17:20:33.605622 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"custom-global-service-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2ec4d48f-6f71-4029-b5da-d428dd885ac4-custom-global-service-combined-ca-bundle\") pod \"2ec4d48f-6f71-4029-b5da-d428dd885ac4\" (UID: \"2ec4d48f-6f71-4029-b5da-d428dd885ac4\") " Mar 16 17:20:33 crc kubenswrapper[5120]: I0316 17:20:33.605963 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7xc9w\" (UniqueName: \"kubernetes.io/projected/2ec4d48f-6f71-4029-b5da-d428dd885ac4-kube-api-access-7xc9w\") pod \"2ec4d48f-6f71-4029-b5da-d428dd885ac4\" (UID: \"2ec4d48f-6f71-4029-b5da-d428dd885ac4\") " Mar 16 17:20:33 crc kubenswrapper[5120]: I0316 17:20:33.610916 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2ec4d48f-6f71-4029-b5da-d428dd885ac4-custom-global-service-combined-ca-bundle" (OuterVolumeSpecName: "custom-global-service-combined-ca-bundle") pod "2ec4d48f-6f71-4029-b5da-d428dd885ac4" (UID: "2ec4d48f-6f71-4029-b5da-d428dd885ac4"). InnerVolumeSpecName "custom-global-service-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:20:33 crc kubenswrapper[5120]: I0316 17:20:33.611052 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ec4d48f-6f71-4029-b5da-d428dd885ac4-kube-api-access-7xc9w" (OuterVolumeSpecName: "kube-api-access-7xc9w") pod "2ec4d48f-6f71-4029-b5da-d428dd885ac4" (UID: "2ec4d48f-6f71-4029-b5da-d428dd885ac4"). InnerVolumeSpecName "kube-api-access-7xc9w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:20:33 crc kubenswrapper[5120]: I0316 17:20:33.626246 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2ec4d48f-6f71-4029-b5da-d428dd885ac4-ssh-key-edpm-compute-global" (OuterVolumeSpecName: "ssh-key-edpm-compute-global") pod "2ec4d48f-6f71-4029-b5da-d428dd885ac4" (UID: "2ec4d48f-6f71-4029-b5da-d428dd885ac4"). InnerVolumeSpecName "ssh-key-edpm-compute-global". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:20:33 crc kubenswrapper[5120]: I0316 17:20:33.626407 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2ec4d48f-6f71-4029-b5da-d428dd885ac4-inventory-0" (OuterVolumeSpecName: "inventory-0") pod "2ec4d48f-6f71-4029-b5da-d428dd885ac4" (UID: "2ec4d48f-6f71-4029-b5da-d428dd885ac4"). InnerVolumeSpecName "inventory-0". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:20:33 crc kubenswrapper[5120]: I0316 17:20:33.709287 5120 reconciler_common.go:299] "Volume detached for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/2ec4d48f-6f71-4029-b5da-d428dd885ac4-ssh-key-edpm-compute-global\") on node \"crc\" DevicePath \"\"" Mar 16 17:20:33 crc kubenswrapper[5120]: I0316 17:20:33.709332 5120 reconciler_common.go:299] "Volume detached for volume \"custom-global-service-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2ec4d48f-6f71-4029-b5da-d428dd885ac4-custom-global-service-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:20:33 crc kubenswrapper[5120]: I0316 17:20:33.709343 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7xc9w\" (UniqueName: \"kubernetes.io/projected/2ec4d48f-6f71-4029-b5da-d428dd885ac4-kube-api-access-7xc9w\") on node \"crc\" DevicePath \"\"" Mar 16 17:20:33 crc kubenswrapper[5120]: I0316 17:20:33.709359 5120 reconciler_common.go:299] "Volume detached for volume \"inventory-0\" (UniqueName: \"kubernetes.io/secret/2ec4d48f-6f71-4029-b5da-d428dd885ac4-inventory-0\") on node \"crc\" DevicePath \"\"" Mar 16 17:20:34 crc kubenswrapper[5120]: I0316 17:20:34.182990 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/custom-global-service-edpm-compute-global-fq4pn" Mar 16 17:20:34 crc kubenswrapper[5120]: I0316 17:20:34.183018 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/custom-global-service-edpm-compute-global-fq4pn" event={"ID":"2ec4d48f-6f71-4029-b5da-d428dd885ac4","Type":"ContainerDied","Data":"e3fe76267a1e63f57cad9a165302ab78d5066b1850be7feb722798197ce2290f"} Mar 16 17:20:34 crc kubenswrapper[5120]: I0316 17:20:34.183054 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e3fe76267a1e63f57cad9a165302ab78d5066b1850be7feb722798197ce2290f" Mar 16 17:20:35 crc kubenswrapper[5120]: I0316 17:20:35.116513 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-6bfd6db6c-rsfj9"] Mar 16 17:20:35 crc kubenswrapper[5120]: I0316 17:20:35.117786 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ec4d48f-6f71-4029-b5da-d428dd885ac4" containerName="custom-global-service-edpm-compute-global" Mar 16 17:20:35 crc kubenswrapper[5120]: I0316 17:20:35.117804 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ec4d48f-6f71-4029-b5da-d428dd885ac4" containerName="custom-global-service-edpm-compute-global" Mar 16 17:20:35 crc kubenswrapper[5120]: I0316 17:20:35.117951 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="2ec4d48f-6f71-4029-b5da-d428dd885ac4" containerName="custom-global-service-edpm-compute-global" Mar 16 17:20:35 crc kubenswrapper[5120]: I0316 17:20:35.124669 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6bfd6db6c-rsfj9" Mar 16 17:20:35 crc kubenswrapper[5120]: I0316 17:20:35.136468 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-6bfd6db6c-rsfj9"] Mar 16 17:20:35 crc kubenswrapper[5120]: I0316 17:20:35.140281 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"edpm-compute-beta-nodeset\"" Mar 16 17:20:35 crc kubenswrapper[5120]: I0316 17:20:35.145066 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"edpm-compute-beta-nodeset\" (UniqueName: \"kubernetes.io/configmap/1b766beb-1497-471b-a986-6ee60a441924-edpm-compute-beta-nodeset\") pod \"dnsmasq-dnsmasq-6bfd6db6c-rsfj9\" (UID: \"1b766beb-1497-471b-a986-6ee60a441924\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6bfd6db6c-rsfj9" Mar 16 17:20:35 crc kubenswrapper[5120]: I0316 17:20:35.145154 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/1b766beb-1497-471b-a986-6ee60a441924-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-6bfd6db6c-rsfj9\" (UID: \"1b766beb-1497-471b-a986-6ee60a441924\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6bfd6db6c-rsfj9" Mar 16 17:20:35 crc kubenswrapper[5120]: I0316 17:20:35.145311 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1b766beb-1497-471b-a986-6ee60a441924-config\") pod \"dnsmasq-dnsmasq-6bfd6db6c-rsfj9\" (UID: \"1b766beb-1497-471b-a986-6ee60a441924\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6bfd6db6c-rsfj9" Mar 16 17:20:35 crc kubenswrapper[5120]: I0316 17:20:35.145586 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"edpm-compute-global\" (UniqueName: \"kubernetes.io/configmap/1b766beb-1497-471b-a986-6ee60a441924-edpm-compute-global\") pod \"dnsmasq-dnsmasq-6bfd6db6c-rsfj9\" (UID: \"1b766beb-1497-471b-a986-6ee60a441924\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6bfd6db6c-rsfj9" Mar 16 17:20:35 crc kubenswrapper[5120]: I0316 17:20:35.145613 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qkcwd\" (UniqueName: \"kubernetes.io/projected/1b766beb-1497-471b-a986-6ee60a441924-kube-api-access-qkcwd\") pod \"dnsmasq-dnsmasq-6bfd6db6c-rsfj9\" (UID: \"1b766beb-1497-471b-a986-6ee60a441924\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6bfd6db6c-rsfj9" Mar 16 17:20:35 crc kubenswrapper[5120]: I0316 17:20:35.247593 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"edpm-compute-global\" (UniqueName: \"kubernetes.io/configmap/1b766beb-1497-471b-a986-6ee60a441924-edpm-compute-global\") pod \"dnsmasq-dnsmasq-6bfd6db6c-rsfj9\" (UID: \"1b766beb-1497-471b-a986-6ee60a441924\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6bfd6db6c-rsfj9" Mar 16 17:20:35 crc kubenswrapper[5120]: I0316 17:20:35.247647 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qkcwd\" (UniqueName: \"kubernetes.io/projected/1b766beb-1497-471b-a986-6ee60a441924-kube-api-access-qkcwd\") pod \"dnsmasq-dnsmasq-6bfd6db6c-rsfj9\" (UID: \"1b766beb-1497-471b-a986-6ee60a441924\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6bfd6db6c-rsfj9" Mar 16 17:20:35 crc kubenswrapper[5120]: I0316 17:20:35.247720 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"edpm-compute-beta-nodeset\" (UniqueName: \"kubernetes.io/configmap/1b766beb-1497-471b-a986-6ee60a441924-edpm-compute-beta-nodeset\") pod \"dnsmasq-dnsmasq-6bfd6db6c-rsfj9\" (UID: \"1b766beb-1497-471b-a986-6ee60a441924\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6bfd6db6c-rsfj9" Mar 16 17:20:35 crc kubenswrapper[5120]: I0316 17:20:35.247825 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/1b766beb-1497-471b-a986-6ee60a441924-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-6bfd6db6c-rsfj9\" (UID: \"1b766beb-1497-471b-a986-6ee60a441924\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6bfd6db6c-rsfj9" Mar 16 17:20:35 crc kubenswrapper[5120]: I0316 17:20:35.248223 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1b766beb-1497-471b-a986-6ee60a441924-config\") pod \"dnsmasq-dnsmasq-6bfd6db6c-rsfj9\" (UID: \"1b766beb-1497-471b-a986-6ee60a441924\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6bfd6db6c-rsfj9" Mar 16 17:20:35 crc kubenswrapper[5120]: I0316 17:20:35.248625 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"edpm-compute-global\" (UniqueName: \"kubernetes.io/configmap/1b766beb-1497-471b-a986-6ee60a441924-edpm-compute-global\") pod \"dnsmasq-dnsmasq-6bfd6db6c-rsfj9\" (UID: \"1b766beb-1497-471b-a986-6ee60a441924\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6bfd6db6c-rsfj9" Mar 16 17:20:35 crc kubenswrapper[5120]: I0316 17:20:35.248901 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"edpm-compute-beta-nodeset\" (UniqueName: \"kubernetes.io/configmap/1b766beb-1497-471b-a986-6ee60a441924-edpm-compute-beta-nodeset\") pod \"dnsmasq-dnsmasq-6bfd6db6c-rsfj9\" (UID: \"1b766beb-1497-471b-a986-6ee60a441924\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6bfd6db6c-rsfj9" Mar 16 17:20:35 crc kubenswrapper[5120]: I0316 17:20:35.248994 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1b766beb-1497-471b-a986-6ee60a441924-config\") pod \"dnsmasq-dnsmasq-6bfd6db6c-rsfj9\" (UID: \"1b766beb-1497-471b-a986-6ee60a441924\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6bfd6db6c-rsfj9" Mar 16 17:20:35 crc kubenswrapper[5120]: I0316 17:20:35.249033 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/1b766beb-1497-471b-a986-6ee60a441924-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-6bfd6db6c-rsfj9\" (UID: \"1b766beb-1497-471b-a986-6ee60a441924\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6bfd6db6c-rsfj9" Mar 16 17:20:35 crc kubenswrapper[5120]: I0316 17:20:35.267063 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qkcwd\" (UniqueName: \"kubernetes.io/projected/1b766beb-1497-471b-a986-6ee60a441924-kube-api-access-qkcwd\") pod \"dnsmasq-dnsmasq-6bfd6db6c-rsfj9\" (UID: \"1b766beb-1497-471b-a986-6ee60a441924\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6bfd6db6c-rsfj9" Mar 16 17:20:35 crc kubenswrapper[5120]: I0316 17:20:35.443088 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6bfd6db6c-rsfj9" Mar 16 17:20:35 crc kubenswrapper[5120]: I0316 17:20:35.842368 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-6bfd6db6c-rsfj9"] Mar 16 17:20:35 crc kubenswrapper[5120]: W0316 17:20:35.848018 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1b766beb_1497_471b_a986_6ee60a441924.slice/crio-9758217056e1d70d11998ca24a7cd0db055f471a082fd3945f1fa908d0cf97dd WatchSource:0}: Error finding container 9758217056e1d70d11998ca24a7cd0db055f471a082fd3945f1fa908d0cf97dd: Status 404 returned error can't find the container with id 9758217056e1d70d11998ca24a7cd0db055f471a082fd3945f1fa908d0cf97dd Mar 16 17:20:36 crc kubenswrapper[5120]: I0316 17:20:36.203678 5120 generic.go:358] "Generic (PLEG): container finished" podID="1b766beb-1497-471b-a986-6ee60a441924" containerID="065d4c2a8aa78f6f8e380943b4e490bebc2b4edb93bf161581ccbc23e1316974" exitCode=0 Mar 16 17:20:36 crc kubenswrapper[5120]: I0316 17:20:36.203927 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6bfd6db6c-rsfj9" event={"ID":"1b766beb-1497-471b-a986-6ee60a441924","Type":"ContainerDied","Data":"065d4c2a8aa78f6f8e380943b4e490bebc2b4edb93bf161581ccbc23e1316974"} Mar 16 17:20:36 crc kubenswrapper[5120]: I0316 17:20:36.204012 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6bfd6db6c-rsfj9" event={"ID":"1b766beb-1497-471b-a986-6ee60a441924","Type":"ContainerStarted","Data":"9758217056e1d70d11998ca24a7cd0db055f471a082fd3945f1fa908d0cf97dd"} Mar 16 17:20:36 crc kubenswrapper[5120]: I0316 17:20:36.664207 5120 scope.go:117] "RemoveContainer" containerID="2ca61165dca6fdb30458423ef74c44c42b1b273e8fa504e89f5f9e186e516cc3" Mar 16 17:20:36 crc kubenswrapper[5120]: E0316 17:20:36.664495 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 17:20:37 crc kubenswrapper[5120]: I0316 17:20:37.214820 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6bfd6db6c-rsfj9" event={"ID":"1b766beb-1497-471b-a986-6ee60a441924","Type":"ContainerStarted","Data":"3bd16362cd4f225ae75753af56053201fd913e06fd4a0ae95fdbb33f97174db5"} Mar 16 17:20:37 crc kubenswrapper[5120]: I0316 17:20:37.215211 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6bfd6db6c-rsfj9" Mar 16 17:20:37 crc kubenswrapper[5120]: I0316 17:20:37.237923 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6bfd6db6c-rsfj9" podStartSLOduration=2.23790796 podStartE2EDuration="2.23790796s" podCreationTimestamp="2026-03-16 17:20:35 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:20:37.233066058 +0000 UTC m=+6539.386997735" watchObservedRunningTime="2026-03-16 17:20:37.23790796 +0000 UTC m=+6539.391839617" Mar 16 17:20:43 crc kubenswrapper[5120]: I0316 17:20:43.224974 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6bfd6db6c-rsfj9" Mar 16 17:20:43 crc kubenswrapper[5120]: I0316 17:20:43.271056 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-67bb796bf-hrqrl"] Mar 16 17:20:43 crc kubenswrapper[5120]: I0316 17:20:43.271311 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-67bb796bf-hrqrl" podUID="fce8c087-0b1c-428f-bdff-734cba235234" containerName="dnsmasq-dns" containerID="cri-o://77fb7bd4d2cc43955f1e96bce491366263d9057ecdb373f532f67c9047e93ab8" gracePeriod=10 Mar 16 17:20:43 crc kubenswrapper[5120]: I0316 17:20:43.680433 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-67bb796bf-hrqrl" Mar 16 17:20:43 crc kubenswrapper[5120]: I0316 17:20:43.830233 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zlppd\" (UniqueName: \"kubernetes.io/projected/fce8c087-0b1c-428f-bdff-734cba235234-kube-api-access-zlppd\") pod \"fce8c087-0b1c-428f-bdff-734cba235234\" (UID: \"fce8c087-0b1c-428f-bdff-734cba235234\") " Mar 16 17:20:43 crc kubenswrapper[5120]: I0316 17:20:43.830288 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/fce8c087-0b1c-428f-bdff-734cba235234-dnsmasq-svc\") pod \"fce8c087-0b1c-428f-bdff-734cba235234\" (UID: \"fce8c087-0b1c-428f-bdff-734cba235234\") " Mar 16 17:20:43 crc kubenswrapper[5120]: I0316 17:20:43.830405 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fce8c087-0b1c-428f-bdff-734cba235234-config\") pod \"fce8c087-0b1c-428f-bdff-734cba235234\" (UID: \"fce8c087-0b1c-428f-bdff-734cba235234\") " Mar 16 17:20:43 crc kubenswrapper[5120]: I0316 17:20:43.830792 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"edpm-compute-global\" (UniqueName: \"kubernetes.io/configmap/fce8c087-0b1c-428f-bdff-734cba235234-edpm-compute-global\") pod \"fce8c087-0b1c-428f-bdff-734cba235234\" (UID: \"fce8c087-0b1c-428f-bdff-734cba235234\") " Mar 16 17:20:43 crc kubenswrapper[5120]: I0316 17:20:43.837333 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fce8c087-0b1c-428f-bdff-734cba235234-kube-api-access-zlppd" (OuterVolumeSpecName: "kube-api-access-zlppd") pod "fce8c087-0b1c-428f-bdff-734cba235234" (UID: "fce8c087-0b1c-428f-bdff-734cba235234"). InnerVolumeSpecName "kube-api-access-zlppd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:20:43 crc kubenswrapper[5120]: I0316 17:20:43.872332 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fce8c087-0b1c-428f-bdff-734cba235234-edpm-compute-global" (OuterVolumeSpecName: "edpm-compute-global") pod "fce8c087-0b1c-428f-bdff-734cba235234" (UID: "fce8c087-0b1c-428f-bdff-734cba235234"). InnerVolumeSpecName "edpm-compute-global". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:20:43 crc kubenswrapper[5120]: I0316 17:20:43.877414 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fce8c087-0b1c-428f-bdff-734cba235234-config" (OuterVolumeSpecName: "config") pod "fce8c087-0b1c-428f-bdff-734cba235234" (UID: "fce8c087-0b1c-428f-bdff-734cba235234"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:20:43 crc kubenswrapper[5120]: I0316 17:20:43.881924 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fce8c087-0b1c-428f-bdff-734cba235234-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "fce8c087-0b1c-428f-bdff-734cba235234" (UID: "fce8c087-0b1c-428f-bdff-734cba235234"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:20:43 crc kubenswrapper[5120]: I0316 17:20:43.934068 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zlppd\" (UniqueName: \"kubernetes.io/projected/fce8c087-0b1c-428f-bdff-734cba235234-kube-api-access-zlppd\") on node \"crc\" DevicePath \"\"" Mar 16 17:20:43 crc kubenswrapper[5120]: I0316 17:20:43.934097 5120 reconciler_common.go:299] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/fce8c087-0b1c-428f-bdff-734cba235234-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Mar 16 17:20:43 crc kubenswrapper[5120]: I0316 17:20:43.934107 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fce8c087-0b1c-428f-bdff-734cba235234-config\") on node \"crc\" DevicePath \"\"" Mar 16 17:20:43 crc kubenswrapper[5120]: I0316 17:20:43.934116 5120 reconciler_common.go:299] "Volume detached for volume \"edpm-compute-global\" (UniqueName: \"kubernetes.io/configmap/fce8c087-0b1c-428f-bdff-734cba235234-edpm-compute-global\") on node \"crc\" DevicePath \"\"" Mar 16 17:20:44 crc kubenswrapper[5120]: I0316 17:20:44.300473 5120 generic.go:358] "Generic (PLEG): container finished" podID="fce8c087-0b1c-428f-bdff-734cba235234" containerID="77fb7bd4d2cc43955f1e96bce491366263d9057ecdb373f532f67c9047e93ab8" exitCode=0 Mar 16 17:20:44 crc kubenswrapper[5120]: I0316 17:20:44.300573 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-67bb796bf-hrqrl" event={"ID":"fce8c087-0b1c-428f-bdff-734cba235234","Type":"ContainerDied","Data":"77fb7bd4d2cc43955f1e96bce491366263d9057ecdb373f532f67c9047e93ab8"} Mar 16 17:20:44 crc kubenswrapper[5120]: I0316 17:20:44.300597 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-67bb796bf-hrqrl" event={"ID":"fce8c087-0b1c-428f-bdff-734cba235234","Type":"ContainerDied","Data":"049bcac2edecaf55867fc688415323b334f95fc5267a2f54db6821cee44bc505"} Mar 16 17:20:44 crc kubenswrapper[5120]: I0316 17:20:44.300613 5120 scope.go:117] "RemoveContainer" containerID="77fb7bd4d2cc43955f1e96bce491366263d9057ecdb373f532f67c9047e93ab8" Mar 16 17:20:44 crc kubenswrapper[5120]: I0316 17:20:44.300729 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-67bb796bf-hrqrl" Mar 16 17:20:44 crc kubenswrapper[5120]: I0316 17:20:44.325225 5120 scope.go:117] "RemoveContainer" containerID="545bba89e45b5c1f8b8407921abfaf73289949049fba4d94a339e7aa18067b40" Mar 16 17:20:44 crc kubenswrapper[5120]: I0316 17:20:44.334229 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-67bb796bf-hrqrl"] Mar 16 17:20:44 crc kubenswrapper[5120]: I0316 17:20:44.340719 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-67bb796bf-hrqrl"] Mar 16 17:20:44 crc kubenswrapper[5120]: I0316 17:20:44.359028 5120 scope.go:117] "RemoveContainer" containerID="77fb7bd4d2cc43955f1e96bce491366263d9057ecdb373f532f67c9047e93ab8" Mar 16 17:20:44 crc kubenswrapper[5120]: E0316 17:20:44.359471 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"77fb7bd4d2cc43955f1e96bce491366263d9057ecdb373f532f67c9047e93ab8\": container with ID starting with 77fb7bd4d2cc43955f1e96bce491366263d9057ecdb373f532f67c9047e93ab8 not found: ID does not exist" containerID="77fb7bd4d2cc43955f1e96bce491366263d9057ecdb373f532f67c9047e93ab8" Mar 16 17:20:44 crc kubenswrapper[5120]: I0316 17:20:44.359512 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77fb7bd4d2cc43955f1e96bce491366263d9057ecdb373f532f67c9047e93ab8"} err="failed to get container status \"77fb7bd4d2cc43955f1e96bce491366263d9057ecdb373f532f67c9047e93ab8\": rpc error: code = NotFound desc = could not find container \"77fb7bd4d2cc43955f1e96bce491366263d9057ecdb373f532f67c9047e93ab8\": container with ID starting with 77fb7bd4d2cc43955f1e96bce491366263d9057ecdb373f532f67c9047e93ab8 not found: ID does not exist" Mar 16 17:20:44 crc kubenswrapper[5120]: I0316 17:20:44.359542 5120 scope.go:117] "RemoveContainer" containerID="545bba89e45b5c1f8b8407921abfaf73289949049fba4d94a339e7aa18067b40" Mar 16 17:20:44 crc kubenswrapper[5120]: E0316 17:20:44.359985 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"545bba89e45b5c1f8b8407921abfaf73289949049fba4d94a339e7aa18067b40\": container with ID starting with 545bba89e45b5c1f8b8407921abfaf73289949049fba4d94a339e7aa18067b40 not found: ID does not exist" containerID="545bba89e45b5c1f8b8407921abfaf73289949049fba4d94a339e7aa18067b40" Mar 16 17:20:44 crc kubenswrapper[5120]: I0316 17:20:44.360017 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"545bba89e45b5c1f8b8407921abfaf73289949049fba4d94a339e7aa18067b40"} err="failed to get container status \"545bba89e45b5c1f8b8407921abfaf73289949049fba4d94a339e7aa18067b40\": rpc error: code = NotFound desc = could not find container \"545bba89e45b5c1f8b8407921abfaf73289949049fba4d94a339e7aa18067b40\": container with ID starting with 545bba89e45b5c1f8b8407921abfaf73289949049fba4d94a339e7aa18067b40 not found: ID does not exist" Mar 16 17:20:44 crc kubenswrapper[5120]: I0316 17:20:44.674957 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fce8c087-0b1c-428f-bdff-734cba235234" path="/var/lib/kubelet/pods/fce8c087-0b1c-428f-bdff-734cba235234/volumes" Mar 16 17:20:49 crc kubenswrapper[5120]: I0316 17:20:49.664574 5120 scope.go:117] "RemoveContainer" containerID="2ca61165dca6fdb30458423ef74c44c42b1b273e8fa504e89f5f9e186e516cc3" Mar 16 17:20:49 crc kubenswrapper[5120]: E0316 17:20:49.665175 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 17:20:50 crc kubenswrapper[5120]: I0316 17:20:50.098797 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-global-mqm76"] Mar 16 17:20:50 crc kubenswrapper[5120]: I0316 17:20:50.099724 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fce8c087-0b1c-428f-bdff-734cba235234" containerName="init" Mar 16 17:20:50 crc kubenswrapper[5120]: I0316 17:20:50.099743 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="fce8c087-0b1c-428f-bdff-734cba235234" containerName="init" Mar 16 17:20:50 crc kubenswrapper[5120]: I0316 17:20:50.099753 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fce8c087-0b1c-428f-bdff-734cba235234" containerName="dnsmasq-dns" Mar 16 17:20:50 crc kubenswrapper[5120]: I0316 17:20:50.099774 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="fce8c087-0b1c-428f-bdff-734cba235234" containerName="dnsmasq-dns" Mar 16 17:20:50 crc kubenswrapper[5120]: I0316 17:20:50.099904 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="fce8c087-0b1c-428f-bdff-734cba235234" containerName="dnsmasq-dns" Mar 16 17:20:50 crc kubenswrapper[5120]: I0316 17:20:50.106477 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-global-mqm76" Mar 16 17:20:50 crc kubenswrapper[5120]: I0316 17:20:50.109939 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-beta-nodesetf9qr5"] Mar 16 17:20:50 crc kubenswrapper[5120]: I0316 17:20:50.116687 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-beta-nodesetf9qr5" Mar 16 17:20:50 crc kubenswrapper[5120]: I0316 17:20:50.117196 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-beta-nodesetf9qr5"] Mar 16 17:20:50 crc kubenswrapper[5120]: I0316 17:20:50.126440 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-global-mqm76"] Mar 16 17:20:50 crc kubenswrapper[5120]: I0316 17:20:50.141099 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplane-ansible-ssh-private-key-secret\"" Mar 16 17:20:50 crc kubenswrapper[5120]: I0316 17:20:50.141345 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"edpm-compute-global-dockercfg-5hp85\"" Mar 16 17:20:50 crc kubenswrapper[5120]: I0316 17:20:50.141403 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplanenodeset-edpm-compute-beta-nodeset\"" Mar 16 17:20:50 crc kubenswrapper[5120]: I0316 17:20:50.141652 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplanenodeset-edpm-compute-global\"" Mar 16 17:20:50 crc kubenswrapper[5120]: I0316 17:20:50.141801 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-aee-default-env\"" Mar 16 17:20:50 crc kubenswrapper[5120]: I0316 17:20:50.141989 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"edpm-compute-beta-nodeset-dockercfg-mnh5z\"" Mar 16 17:20:50 crc kubenswrapper[5120]: I0316 17:20:50.163988 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key-edpm-compute-beta-nodeset\" (UniqueName: \"kubernetes.io/secret/d8f49ea6-2f72-49ca-9e11-f1fe280d8bc8-ssh-key-edpm-compute-beta-nodeset\") pod \"download-cache-edpm-multinodeset-edpm-compute-beta-nodesetf9qr5\" (UID: \"d8f49ea6-2f72-49ca-9e11-f1fe280d8bc8\") " pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-beta-nodesetf9qr5" Mar 16 17:20:50 crc kubenswrapper[5120]: I0316 17:20:50.164321 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jlj4\" (UniqueName: \"kubernetes.io/projected/a1eb2c4c-523e-43d3-95cb-9edcc781645a-kube-api-access-9jlj4\") pod \"download-cache-edpm-multinodeset-edpm-compute-global-mqm76\" (UID: \"a1eb2c4c-523e-43d3-95cb-9edcc781645a\") " pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-global-mqm76" Mar 16 17:20:50 crc kubenswrapper[5120]: I0316 17:20:50.164635 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/a1eb2c4c-523e-43d3-95cb-9edcc781645a-inventory\") pod \"download-cache-edpm-multinodeset-edpm-compute-global-mqm76\" (UID: \"a1eb2c4c-523e-43d3-95cb-9edcc781645a\") " pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-global-mqm76" Mar 16 17:20:50 crc kubenswrapper[5120]: I0316 17:20:50.164713 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87bq2\" (UniqueName: \"kubernetes.io/projected/d8f49ea6-2f72-49ca-9e11-f1fe280d8bc8-kube-api-access-87bq2\") pod \"download-cache-edpm-multinodeset-edpm-compute-beta-nodesetf9qr5\" (UID: \"d8f49ea6-2f72-49ca-9e11-f1fe280d8bc8\") " pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-beta-nodesetf9qr5" Mar 16 17:20:50 crc kubenswrapper[5120]: I0316 17:20:50.164751 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/a1eb2c4c-523e-43d3-95cb-9edcc781645a-ssh-key-edpm-compute-global\") pod \"download-cache-edpm-multinodeset-edpm-compute-global-mqm76\" (UID: \"a1eb2c4c-523e-43d3-95cb-9edcc781645a\") " pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-global-mqm76" Mar 16 17:20:50 crc kubenswrapper[5120]: I0316 17:20:50.164795 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/d8f49ea6-2f72-49ca-9e11-f1fe280d8bc8-inventory\") pod \"download-cache-edpm-multinodeset-edpm-compute-beta-nodesetf9qr5\" (UID: \"d8f49ea6-2f72-49ca-9e11-f1fe280d8bc8\") " pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-beta-nodesetf9qr5" Mar 16 17:20:50 crc kubenswrapper[5120]: I0316 17:20:50.266169 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ssh-key-edpm-compute-beta-nodeset\" (UniqueName: \"kubernetes.io/secret/d8f49ea6-2f72-49ca-9e11-f1fe280d8bc8-ssh-key-edpm-compute-beta-nodeset\") pod \"download-cache-edpm-multinodeset-edpm-compute-beta-nodesetf9qr5\" (UID: \"d8f49ea6-2f72-49ca-9e11-f1fe280d8bc8\") " pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-beta-nodesetf9qr5" Mar 16 17:20:50 crc kubenswrapper[5120]: I0316 17:20:50.266230 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9jlj4\" (UniqueName: \"kubernetes.io/projected/a1eb2c4c-523e-43d3-95cb-9edcc781645a-kube-api-access-9jlj4\") pod \"download-cache-edpm-multinodeset-edpm-compute-global-mqm76\" (UID: \"a1eb2c4c-523e-43d3-95cb-9edcc781645a\") " pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-global-mqm76" Mar 16 17:20:50 crc kubenswrapper[5120]: I0316 17:20:50.266479 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/a1eb2c4c-523e-43d3-95cb-9edcc781645a-inventory\") pod \"download-cache-edpm-multinodeset-edpm-compute-global-mqm76\" (UID: \"a1eb2c4c-523e-43d3-95cb-9edcc781645a\") " pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-global-mqm76" Mar 16 17:20:50 crc kubenswrapper[5120]: I0316 17:20:50.266606 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-87bq2\" (UniqueName: \"kubernetes.io/projected/d8f49ea6-2f72-49ca-9e11-f1fe280d8bc8-kube-api-access-87bq2\") pod \"download-cache-edpm-multinodeset-edpm-compute-beta-nodesetf9qr5\" (UID: \"d8f49ea6-2f72-49ca-9e11-f1fe280d8bc8\") " pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-beta-nodesetf9qr5" Mar 16 17:20:50 crc kubenswrapper[5120]: I0316 17:20:50.267641 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/a1eb2c4c-523e-43d3-95cb-9edcc781645a-ssh-key-edpm-compute-global\") pod \"download-cache-edpm-multinodeset-edpm-compute-global-mqm76\" (UID: \"a1eb2c4c-523e-43d3-95cb-9edcc781645a\") " pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-global-mqm76" Mar 16 17:20:50 crc kubenswrapper[5120]: I0316 17:20:50.267702 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/d8f49ea6-2f72-49ca-9e11-f1fe280d8bc8-inventory\") pod \"download-cache-edpm-multinodeset-edpm-compute-beta-nodesetf9qr5\" (UID: \"d8f49ea6-2f72-49ca-9e11-f1fe280d8bc8\") " pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-beta-nodesetf9qr5" Mar 16 17:20:50 crc kubenswrapper[5120]: I0316 17:20:50.273518 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ssh-key-edpm-compute-beta-nodeset\" (UniqueName: \"kubernetes.io/secret/d8f49ea6-2f72-49ca-9e11-f1fe280d8bc8-ssh-key-edpm-compute-beta-nodeset\") pod \"download-cache-edpm-multinodeset-edpm-compute-beta-nodesetf9qr5\" (UID: \"d8f49ea6-2f72-49ca-9e11-f1fe280d8bc8\") " pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-beta-nodesetf9qr5" Mar 16 17:20:50 crc kubenswrapper[5120]: I0316 17:20:50.273944 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/d8f49ea6-2f72-49ca-9e11-f1fe280d8bc8-inventory\") pod \"download-cache-edpm-multinodeset-edpm-compute-beta-nodesetf9qr5\" (UID: \"d8f49ea6-2f72-49ca-9e11-f1fe280d8bc8\") " pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-beta-nodesetf9qr5" Mar 16 17:20:50 crc kubenswrapper[5120]: I0316 17:20:50.276143 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/a1eb2c4c-523e-43d3-95cb-9edcc781645a-ssh-key-edpm-compute-global\") pod \"download-cache-edpm-multinodeset-edpm-compute-global-mqm76\" (UID: \"a1eb2c4c-523e-43d3-95cb-9edcc781645a\") " pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-global-mqm76" Mar 16 17:20:50 crc kubenswrapper[5120]: I0316 17:20:50.276453 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/a1eb2c4c-523e-43d3-95cb-9edcc781645a-inventory\") pod \"download-cache-edpm-multinodeset-edpm-compute-global-mqm76\" (UID: \"a1eb2c4c-523e-43d3-95cb-9edcc781645a\") " pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-global-mqm76" Mar 16 17:20:50 crc kubenswrapper[5120]: I0316 17:20:50.294100 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jlj4\" (UniqueName: \"kubernetes.io/projected/a1eb2c4c-523e-43d3-95cb-9edcc781645a-kube-api-access-9jlj4\") pod \"download-cache-edpm-multinodeset-edpm-compute-global-mqm76\" (UID: \"a1eb2c4c-523e-43d3-95cb-9edcc781645a\") " pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-global-mqm76" Mar 16 17:20:50 crc kubenswrapper[5120]: I0316 17:20:50.294102 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-87bq2\" (UniqueName: \"kubernetes.io/projected/d8f49ea6-2f72-49ca-9e11-f1fe280d8bc8-kube-api-access-87bq2\") pod \"download-cache-edpm-multinodeset-edpm-compute-beta-nodesetf9qr5\" (UID: \"d8f49ea6-2f72-49ca-9e11-f1fe280d8bc8\") " pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-beta-nodesetf9qr5" Mar 16 17:20:50 crc kubenswrapper[5120]: I0316 17:20:50.467580 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-global-mqm76" Mar 16 17:20:50 crc kubenswrapper[5120]: I0316 17:20:50.475453 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-beta-nodesetf9qr5" Mar 16 17:20:50 crc kubenswrapper[5120]: I0316 17:20:50.912568 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-global-mqm76"] Mar 16 17:20:50 crc kubenswrapper[5120]: I0316 17:20:50.961851 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-beta-nodesetf9qr5"] Mar 16 17:20:50 crc kubenswrapper[5120]: W0316 17:20:50.962492 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd8f49ea6_2f72_49ca_9e11_f1fe280d8bc8.slice/crio-5701372c7b77ac8d4835bc0870e97011c9507f5b69e825e101ca81c5b408430f WatchSource:0}: Error finding container 5701372c7b77ac8d4835bc0870e97011c9507f5b69e825e101ca81c5b408430f: Status 404 returned error can't find the container with id 5701372c7b77ac8d4835bc0870e97011c9507f5b69e825e101ca81c5b408430f Mar 16 17:20:51 crc kubenswrapper[5120]: I0316 17:20:51.366940 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-beta-nodesetf9qr5" event={"ID":"d8f49ea6-2f72-49ca-9e11-f1fe280d8bc8","Type":"ContainerStarted","Data":"5701372c7b77ac8d4835bc0870e97011c9507f5b69e825e101ca81c5b408430f"} Mar 16 17:20:51 crc kubenswrapper[5120]: I0316 17:20:51.370970 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-global-mqm76" event={"ID":"a1eb2c4c-523e-43d3-95cb-9edcc781645a","Type":"ContainerStarted","Data":"2aff5d22dd50eadc47558bf7fb74673abffed2591c20f2d42c8f73e396d05815"} Mar 16 17:20:52 crc kubenswrapper[5120]: I0316 17:20:52.381560 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-global-mqm76" event={"ID":"a1eb2c4c-523e-43d3-95cb-9edcc781645a","Type":"ContainerStarted","Data":"cc769c8dffa253fe6b6943576d02bf26f88a63b0dded4eb5d12bd81a26e26cf1"} Mar 16 17:20:52 crc kubenswrapper[5120]: I0316 17:20:52.384281 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-beta-nodesetf9qr5" event={"ID":"d8f49ea6-2f72-49ca-9e11-f1fe280d8bc8","Type":"ContainerStarted","Data":"0d608f795a6adf89dbfa7fb0b75b222f76251b003c5a3540f63458a7e3428809"} Mar 16 17:20:52 crc kubenswrapper[5120]: I0316 17:20:52.435642 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-beta-nodesetf9qr5" podStartSLOduration=1.9452100369999998 podStartE2EDuration="2.435615638s" podCreationTimestamp="2026-03-16 17:20:50 +0000 UTC" firstStartedPulling="2026-03-16 17:20:50.963429771 +0000 UTC m=+6553.117361428" lastFinishedPulling="2026-03-16 17:20:51.453835372 +0000 UTC m=+6553.607767029" observedRunningTime="2026-03-16 17:20:52.432502104 +0000 UTC m=+6554.586433791" watchObservedRunningTime="2026-03-16 17:20:52.435615638 +0000 UTC m=+6554.589547335" Mar 16 17:20:52 crc kubenswrapper[5120]: I0316 17:20:52.446163 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-global-mqm76" podStartSLOduration=2.000984364 podStartE2EDuration="2.446138357s" podCreationTimestamp="2026-03-16 17:20:50 +0000 UTC" firstStartedPulling="2026-03-16 17:20:50.91432308 +0000 UTC m=+6553.068254737" lastFinishedPulling="2026-03-16 17:20:51.359477073 +0000 UTC m=+6553.513408730" observedRunningTime="2026-03-16 17:20:52.41624191 +0000 UTC m=+6554.570173567" watchObservedRunningTime="2026-03-16 17:20:52.446138357 +0000 UTC m=+6554.600070054" Mar 16 17:20:53 crc kubenswrapper[5120]: I0316 17:20:53.394837 5120 generic.go:358] "Generic (PLEG): container finished" podID="d8f49ea6-2f72-49ca-9e11-f1fe280d8bc8" containerID="0d608f795a6adf89dbfa7fb0b75b222f76251b003c5a3540f63458a7e3428809" exitCode=0 Mar 16 17:20:53 crc kubenswrapper[5120]: I0316 17:20:53.396080 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-beta-nodesetf9qr5" event={"ID":"d8f49ea6-2f72-49ca-9e11-f1fe280d8bc8","Type":"ContainerDied","Data":"0d608f795a6adf89dbfa7fb0b75b222f76251b003c5a3540f63458a7e3428809"} Mar 16 17:20:53 crc kubenswrapper[5120]: I0316 17:20:53.399428 5120 generic.go:358] "Generic (PLEG): container finished" podID="a1eb2c4c-523e-43d3-95cb-9edcc781645a" containerID="cc769c8dffa253fe6b6943576d02bf26f88a63b0dded4eb5d12bd81a26e26cf1" exitCode=0 Mar 16 17:20:53 crc kubenswrapper[5120]: I0316 17:20:53.399662 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-global-mqm76" event={"ID":"a1eb2c4c-523e-43d3-95cb-9edcc781645a","Type":"ContainerDied","Data":"cc769c8dffa253fe6b6943576d02bf26f88a63b0dded4eb5d12bd81a26e26cf1"} Mar 16 17:20:54 crc kubenswrapper[5120]: I0316 17:20:54.743220 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-global-mqm76" Mar 16 17:20:54 crc kubenswrapper[5120]: I0316 17:20:54.752406 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-beta-nodesetf9qr5" Mar 16 17:20:54 crc kubenswrapper[5120]: I0316 17:20:54.876399 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9jlj4\" (UniqueName: \"kubernetes.io/projected/a1eb2c4c-523e-43d3-95cb-9edcc781645a-kube-api-access-9jlj4\") pod \"a1eb2c4c-523e-43d3-95cb-9edcc781645a\" (UID: \"a1eb2c4c-523e-43d3-95cb-9edcc781645a\") " Mar 16 17:20:54 crc kubenswrapper[5120]: I0316 17:20:54.877030 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/a1eb2c4c-523e-43d3-95cb-9edcc781645a-inventory\") pod \"a1eb2c4c-523e-43d3-95cb-9edcc781645a\" (UID: \"a1eb2c4c-523e-43d3-95cb-9edcc781645a\") " Mar 16 17:20:54 crc kubenswrapper[5120]: I0316 17:20:54.877216 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ssh-key-edpm-compute-beta-nodeset\" (UniqueName: \"kubernetes.io/secret/d8f49ea6-2f72-49ca-9e11-f1fe280d8bc8-ssh-key-edpm-compute-beta-nodeset\") pod \"d8f49ea6-2f72-49ca-9e11-f1fe280d8bc8\" (UID: \"d8f49ea6-2f72-49ca-9e11-f1fe280d8bc8\") " Mar 16 17:20:54 crc kubenswrapper[5120]: I0316 17:20:54.877381 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/d8f49ea6-2f72-49ca-9e11-f1fe280d8bc8-inventory\") pod \"d8f49ea6-2f72-49ca-9e11-f1fe280d8bc8\" (UID: \"d8f49ea6-2f72-49ca-9e11-f1fe280d8bc8\") " Mar 16 17:20:54 crc kubenswrapper[5120]: I0316 17:20:54.877497 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/a1eb2c4c-523e-43d3-95cb-9edcc781645a-ssh-key-edpm-compute-global\") pod \"a1eb2c4c-523e-43d3-95cb-9edcc781645a\" (UID: \"a1eb2c4c-523e-43d3-95cb-9edcc781645a\") " Mar 16 17:20:54 crc kubenswrapper[5120]: I0316 17:20:54.877638 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-87bq2\" (UniqueName: \"kubernetes.io/projected/d8f49ea6-2f72-49ca-9e11-f1fe280d8bc8-kube-api-access-87bq2\") pod \"d8f49ea6-2f72-49ca-9e11-f1fe280d8bc8\" (UID: \"d8f49ea6-2f72-49ca-9e11-f1fe280d8bc8\") " Mar 16 17:20:54 crc kubenswrapper[5120]: I0316 17:20:54.882289 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1eb2c4c-523e-43d3-95cb-9edcc781645a-kube-api-access-9jlj4" (OuterVolumeSpecName: "kube-api-access-9jlj4") pod "a1eb2c4c-523e-43d3-95cb-9edcc781645a" (UID: "a1eb2c4c-523e-43d3-95cb-9edcc781645a"). InnerVolumeSpecName "kube-api-access-9jlj4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:20:54 crc kubenswrapper[5120]: I0316 17:20:54.886974 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8f49ea6-2f72-49ca-9e11-f1fe280d8bc8-kube-api-access-87bq2" (OuterVolumeSpecName: "kube-api-access-87bq2") pod "d8f49ea6-2f72-49ca-9e11-f1fe280d8bc8" (UID: "d8f49ea6-2f72-49ca-9e11-f1fe280d8bc8"). InnerVolumeSpecName "kube-api-access-87bq2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:20:54 crc kubenswrapper[5120]: I0316 17:20:54.897743 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a1eb2c4c-523e-43d3-95cb-9edcc781645a-ssh-key-edpm-compute-global" (OuterVolumeSpecName: "ssh-key-edpm-compute-global") pod "a1eb2c4c-523e-43d3-95cb-9edcc781645a" (UID: "a1eb2c4c-523e-43d3-95cb-9edcc781645a"). InnerVolumeSpecName "ssh-key-edpm-compute-global". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:20:54 crc kubenswrapper[5120]: I0316 17:20:54.898472 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d8f49ea6-2f72-49ca-9e11-f1fe280d8bc8-inventory" (OuterVolumeSpecName: "inventory") pod "d8f49ea6-2f72-49ca-9e11-f1fe280d8bc8" (UID: "d8f49ea6-2f72-49ca-9e11-f1fe280d8bc8"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:20:54 crc kubenswrapper[5120]: I0316 17:20:54.901216 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d8f49ea6-2f72-49ca-9e11-f1fe280d8bc8-ssh-key-edpm-compute-beta-nodeset" (OuterVolumeSpecName: "ssh-key-edpm-compute-beta-nodeset") pod "d8f49ea6-2f72-49ca-9e11-f1fe280d8bc8" (UID: "d8f49ea6-2f72-49ca-9e11-f1fe280d8bc8"). InnerVolumeSpecName "ssh-key-edpm-compute-beta-nodeset". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:20:54 crc kubenswrapper[5120]: I0316 17:20:54.905031 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a1eb2c4c-523e-43d3-95cb-9edcc781645a-inventory" (OuterVolumeSpecName: "inventory") pod "a1eb2c4c-523e-43d3-95cb-9edcc781645a" (UID: "a1eb2c4c-523e-43d3-95cb-9edcc781645a"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:20:54 crc kubenswrapper[5120]: I0316 17:20:54.980916 5120 reconciler_common.go:299] "Volume detached for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/a1eb2c4c-523e-43d3-95cb-9edcc781645a-ssh-key-edpm-compute-global\") on node \"crc\" DevicePath \"\"" Mar 16 17:20:54 crc kubenswrapper[5120]: I0316 17:20:54.980959 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-87bq2\" (UniqueName: \"kubernetes.io/projected/d8f49ea6-2f72-49ca-9e11-f1fe280d8bc8-kube-api-access-87bq2\") on node \"crc\" DevicePath \"\"" Mar 16 17:20:54 crc kubenswrapper[5120]: I0316 17:20:54.980970 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9jlj4\" (UniqueName: \"kubernetes.io/projected/a1eb2c4c-523e-43d3-95cb-9edcc781645a-kube-api-access-9jlj4\") on node \"crc\" DevicePath \"\"" Mar 16 17:20:54 crc kubenswrapper[5120]: I0316 17:20:54.980980 5120 reconciler_common.go:299] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/a1eb2c4c-523e-43d3-95cb-9edcc781645a-inventory\") on node \"crc\" DevicePath \"\"" Mar 16 17:20:54 crc kubenswrapper[5120]: I0316 17:20:54.980990 5120 reconciler_common.go:299] "Volume detached for volume \"ssh-key-edpm-compute-beta-nodeset\" (UniqueName: \"kubernetes.io/secret/d8f49ea6-2f72-49ca-9e11-f1fe280d8bc8-ssh-key-edpm-compute-beta-nodeset\") on node \"crc\" DevicePath \"\"" Mar 16 17:20:54 crc kubenswrapper[5120]: I0316 17:20:54.981002 5120 reconciler_common.go:299] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/d8f49ea6-2f72-49ca-9e11-f1fe280d8bc8-inventory\") on node \"crc\" DevicePath \"\"" Mar 16 17:20:55 crc kubenswrapper[5120]: I0316 17:20:55.416433 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-beta-nodesetf9qr5" Mar 16 17:20:55 crc kubenswrapper[5120]: I0316 17:20:55.416504 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-beta-nodesetf9qr5" event={"ID":"d8f49ea6-2f72-49ca-9e11-f1fe280d8bc8","Type":"ContainerDied","Data":"5701372c7b77ac8d4835bc0870e97011c9507f5b69e825e101ca81c5b408430f"} Mar 16 17:20:55 crc kubenswrapper[5120]: I0316 17:20:55.416550 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5701372c7b77ac8d4835bc0870e97011c9507f5b69e825e101ca81c5b408430f" Mar 16 17:20:55 crc kubenswrapper[5120]: I0316 17:20:55.419478 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-global-mqm76" event={"ID":"a1eb2c4c-523e-43d3-95cb-9edcc781645a","Type":"ContainerDied","Data":"2aff5d22dd50eadc47558bf7fb74673abffed2591c20f2d42c8f73e396d05815"} Mar 16 17:20:55 crc kubenswrapper[5120]: I0316 17:20:55.419512 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2aff5d22dd50eadc47558bf7fb74673abffed2591c20f2d42c8f73e396d05815" Mar 16 17:20:55 crc kubenswrapper[5120]: I0316 17:20:55.419727 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-global-mqm76" Mar 16 17:20:55 crc kubenswrapper[5120]: I0316 17:20:55.500930 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-global-qbgz7"] Mar 16 17:20:55 crc kubenswrapper[5120]: I0316 17:20:55.501841 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8f49ea6-2f72-49ca-9e11-f1fe280d8bc8" containerName="download-cache-edpm-multinodeset-edpm-compute-beta-nodeset" Mar 16 17:20:55 crc kubenswrapper[5120]: I0316 17:20:55.501900 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8f49ea6-2f72-49ca-9e11-f1fe280d8bc8" containerName="download-cache-edpm-multinodeset-edpm-compute-beta-nodeset" Mar 16 17:20:55 crc kubenswrapper[5120]: I0316 17:20:55.501951 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1eb2c4c-523e-43d3-95cb-9edcc781645a" containerName="download-cache-edpm-multinodeset-edpm-compute-global" Mar 16 17:20:55 crc kubenswrapper[5120]: I0316 17:20:55.501957 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1eb2c4c-523e-43d3-95cb-9edcc781645a" containerName="download-cache-edpm-multinodeset-edpm-compute-global" Mar 16 17:20:55 crc kubenswrapper[5120]: I0316 17:20:55.502107 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="d8f49ea6-2f72-49ca-9e11-f1fe280d8bc8" containerName="download-cache-edpm-multinodeset-edpm-compute-beta-nodeset" Mar 16 17:20:55 crc kubenswrapper[5120]: I0316 17:20:55.502132 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="a1eb2c4c-523e-43d3-95cb-9edcc781645a" containerName="download-cache-edpm-multinodeset-edpm-compute-global" Mar 16 17:20:55 crc kubenswrapper[5120]: I0316 17:20:55.509079 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-global-qbgz7" Mar 16 17:20:55 crc kubenswrapper[5120]: I0316 17:20:55.509219 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-global-qbgz7"] Mar 16 17:20:55 crc kubenswrapper[5120]: I0316 17:20:55.511579 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"combined-ca-bundle\"" Mar 16 17:20:55 crc kubenswrapper[5120]: I0316 17:20:55.511641 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"edpm-compute-global-dockercfg-5hp85\"" Mar 16 17:20:55 crc kubenswrapper[5120]: I0316 17:20:55.511592 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-aee-default-env\"" Mar 16 17:20:55 crc kubenswrapper[5120]: I0316 17:20:55.512121 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplanenodeset-edpm-compute-global\"" Mar 16 17:20:55 crc kubenswrapper[5120]: I0316 17:20:55.512261 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplane-ansible-ssh-private-key-secret\"" Mar 16 17:20:55 crc kubenswrapper[5120]: I0316 17:20:55.596256 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bootstrap-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fc38d17d-9798-43ab-a697-0148939455e1-bootstrap-combined-ca-bundle\") pod \"bootstrap-edpm-multinodeset-edpm-compute-global-qbgz7\" (UID: \"fc38d17d-9798-43ab-a697-0148939455e1\") " pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-global-qbgz7" Mar 16 17:20:55 crc kubenswrapper[5120]: I0316 17:20:55.596497 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/fc38d17d-9798-43ab-a697-0148939455e1-ssh-key-edpm-compute-global\") pod \"bootstrap-edpm-multinodeset-edpm-compute-global-qbgz7\" (UID: \"fc38d17d-9798-43ab-a697-0148939455e1\") " pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-global-qbgz7" Mar 16 17:20:55 crc kubenswrapper[5120]: I0316 17:20:55.596817 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/fc38d17d-9798-43ab-a697-0148939455e1-inventory\") pod \"bootstrap-edpm-multinodeset-edpm-compute-global-qbgz7\" (UID: \"fc38d17d-9798-43ab-a697-0148939455e1\") " pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-global-qbgz7" Mar 16 17:20:55 crc kubenswrapper[5120]: I0316 17:20:55.597060 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vmbrs\" (UniqueName: \"kubernetes.io/projected/fc38d17d-9798-43ab-a697-0148939455e1-kube-api-access-vmbrs\") pod \"bootstrap-edpm-multinodeset-edpm-compute-global-qbgz7\" (UID: \"fc38d17d-9798-43ab-a697-0148939455e1\") " pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-global-qbgz7" Mar 16 17:20:55 crc kubenswrapper[5120]: I0316 17:20:55.698668 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/fc38d17d-9798-43ab-a697-0148939455e1-inventory\") pod \"bootstrap-edpm-multinodeset-edpm-compute-global-qbgz7\" (UID: \"fc38d17d-9798-43ab-a697-0148939455e1\") " pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-global-qbgz7" Mar 16 17:20:55 crc kubenswrapper[5120]: I0316 17:20:55.698836 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vmbrs\" (UniqueName: \"kubernetes.io/projected/fc38d17d-9798-43ab-a697-0148939455e1-kube-api-access-vmbrs\") pod \"bootstrap-edpm-multinodeset-edpm-compute-global-qbgz7\" (UID: \"fc38d17d-9798-43ab-a697-0148939455e1\") " pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-global-qbgz7" Mar 16 17:20:55 crc kubenswrapper[5120]: I0316 17:20:55.698970 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bootstrap-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fc38d17d-9798-43ab-a697-0148939455e1-bootstrap-combined-ca-bundle\") pod \"bootstrap-edpm-multinodeset-edpm-compute-global-qbgz7\" (UID: \"fc38d17d-9798-43ab-a697-0148939455e1\") " pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-global-qbgz7" Mar 16 17:20:55 crc kubenswrapper[5120]: I0316 17:20:55.699004 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/fc38d17d-9798-43ab-a697-0148939455e1-ssh-key-edpm-compute-global\") pod \"bootstrap-edpm-multinodeset-edpm-compute-global-qbgz7\" (UID: \"fc38d17d-9798-43ab-a697-0148939455e1\") " pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-global-qbgz7" Mar 16 17:20:55 crc kubenswrapper[5120]: I0316 17:20:55.703749 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/fc38d17d-9798-43ab-a697-0148939455e1-ssh-key-edpm-compute-global\") pod \"bootstrap-edpm-multinodeset-edpm-compute-global-qbgz7\" (UID: \"fc38d17d-9798-43ab-a697-0148939455e1\") " pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-global-qbgz7" Mar 16 17:20:55 crc kubenswrapper[5120]: I0316 17:20:55.707130 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/fc38d17d-9798-43ab-a697-0148939455e1-inventory\") pod \"bootstrap-edpm-multinodeset-edpm-compute-global-qbgz7\" (UID: \"fc38d17d-9798-43ab-a697-0148939455e1\") " pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-global-qbgz7" Mar 16 17:20:55 crc kubenswrapper[5120]: I0316 17:20:55.709451 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bootstrap-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fc38d17d-9798-43ab-a697-0148939455e1-bootstrap-combined-ca-bundle\") pod \"bootstrap-edpm-multinodeset-edpm-compute-global-qbgz7\" (UID: \"fc38d17d-9798-43ab-a697-0148939455e1\") " pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-global-qbgz7" Mar 16 17:20:55 crc kubenswrapper[5120]: I0316 17:20:55.714506 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vmbrs\" (UniqueName: \"kubernetes.io/projected/fc38d17d-9798-43ab-a697-0148939455e1-kube-api-access-vmbrs\") pod \"bootstrap-edpm-multinodeset-edpm-compute-global-qbgz7\" (UID: \"fc38d17d-9798-43ab-a697-0148939455e1\") " pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-global-qbgz7" Mar 16 17:20:55 crc kubenswrapper[5120]: I0316 17:20:55.828646 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-global-qbgz7" Mar 16 17:20:55 crc kubenswrapper[5120]: I0316 17:20:55.855634 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-f5g5s"] Mar 16 17:20:55 crc kubenswrapper[5120]: I0316 17:20:55.862175 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-f5g5s" Mar 16 17:20:55 crc kubenswrapper[5120]: I0316 17:20:55.867245 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-f5g5s"] Mar 16 17:20:55 crc kubenswrapper[5120]: I0316 17:20:55.869182 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"edpm-compute-beta-nodeset-dockercfg-mnh5z\"" Mar 16 17:20:55 crc kubenswrapper[5120]: I0316 17:20:55.869542 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplanenodeset-edpm-compute-beta-nodeset\"" Mar 16 17:20:55 crc kubenswrapper[5120]: I0316 17:20:55.903854 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bootstrap-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f41c2228-c503-41ca-98da-5e5518e564a5-bootstrap-combined-ca-bundle\") pod \"bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-f5g5s\" (UID: \"f41c2228-c503-41ca-98da-5e5518e564a5\") " pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-f5g5s" Mar 16 17:20:55 crc kubenswrapper[5120]: I0316 17:20:55.904097 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key-edpm-compute-beta-nodeset\" (UniqueName: \"kubernetes.io/secret/f41c2228-c503-41ca-98da-5e5518e564a5-ssh-key-edpm-compute-beta-nodeset\") pod \"bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-f5g5s\" (UID: \"f41c2228-c503-41ca-98da-5e5518e564a5\") " pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-f5g5s" Mar 16 17:20:55 crc kubenswrapper[5120]: I0316 17:20:55.904175 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjtg9\" (UniqueName: \"kubernetes.io/projected/f41c2228-c503-41ca-98da-5e5518e564a5-kube-api-access-rjtg9\") pod \"bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-f5g5s\" (UID: \"f41c2228-c503-41ca-98da-5e5518e564a5\") " pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-f5g5s" Mar 16 17:20:55 crc kubenswrapper[5120]: I0316 17:20:55.904280 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/f41c2228-c503-41ca-98da-5e5518e564a5-inventory\") pod \"bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-f5g5s\" (UID: \"f41c2228-c503-41ca-98da-5e5518e564a5\") " pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-f5g5s" Mar 16 17:20:56 crc kubenswrapper[5120]: I0316 17:20:56.007357 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bootstrap-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f41c2228-c503-41ca-98da-5e5518e564a5-bootstrap-combined-ca-bundle\") pod \"bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-f5g5s\" (UID: \"f41c2228-c503-41ca-98da-5e5518e564a5\") " pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-f5g5s" Mar 16 17:20:56 crc kubenswrapper[5120]: I0316 17:20:56.007597 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ssh-key-edpm-compute-beta-nodeset\" (UniqueName: \"kubernetes.io/secret/f41c2228-c503-41ca-98da-5e5518e564a5-ssh-key-edpm-compute-beta-nodeset\") pod \"bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-f5g5s\" (UID: \"f41c2228-c503-41ca-98da-5e5518e564a5\") " pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-f5g5s" Mar 16 17:20:56 crc kubenswrapper[5120]: I0316 17:20:56.007688 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rjtg9\" (UniqueName: \"kubernetes.io/projected/f41c2228-c503-41ca-98da-5e5518e564a5-kube-api-access-rjtg9\") pod \"bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-f5g5s\" (UID: \"f41c2228-c503-41ca-98da-5e5518e564a5\") " pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-f5g5s" Mar 16 17:20:56 crc kubenswrapper[5120]: I0316 17:20:56.007808 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/f41c2228-c503-41ca-98da-5e5518e564a5-inventory\") pod \"bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-f5g5s\" (UID: \"f41c2228-c503-41ca-98da-5e5518e564a5\") " pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-f5g5s" Mar 16 17:20:56 crc kubenswrapper[5120]: I0316 17:20:56.013265 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ssh-key-edpm-compute-beta-nodeset\" (UniqueName: \"kubernetes.io/secret/f41c2228-c503-41ca-98da-5e5518e564a5-ssh-key-edpm-compute-beta-nodeset\") pod \"bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-f5g5s\" (UID: \"f41c2228-c503-41ca-98da-5e5518e564a5\") " pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-f5g5s" Mar 16 17:20:56 crc kubenswrapper[5120]: I0316 17:20:56.016214 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/f41c2228-c503-41ca-98da-5e5518e564a5-inventory\") pod \"bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-f5g5s\" (UID: \"f41c2228-c503-41ca-98da-5e5518e564a5\") " pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-f5g5s" Mar 16 17:20:56 crc kubenswrapper[5120]: I0316 17:20:56.022234 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bootstrap-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f41c2228-c503-41ca-98da-5e5518e564a5-bootstrap-combined-ca-bundle\") pod \"bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-f5g5s\" (UID: \"f41c2228-c503-41ca-98da-5e5518e564a5\") " pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-f5g5s" Mar 16 17:20:56 crc kubenswrapper[5120]: I0316 17:20:56.029004 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjtg9\" (UniqueName: \"kubernetes.io/projected/f41c2228-c503-41ca-98da-5e5518e564a5-kube-api-access-rjtg9\") pod \"bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-f5g5s\" (UID: \"f41c2228-c503-41ca-98da-5e5518e564a5\") " pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-f5g5s" Mar 16 17:20:56 crc kubenswrapper[5120]: I0316 17:20:56.226870 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-f5g5s" Mar 16 17:20:56 crc kubenswrapper[5120]: I0316 17:20:56.235218 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-global-qbgz7"] Mar 16 17:20:56 crc kubenswrapper[5120]: W0316 17:20:56.244954 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfc38d17d_9798_43ab_a697_0148939455e1.slice/crio-068e7ef4a9c181ba15bc79862688a74d70f6a00396bedbc4d86ce536def2b84f WatchSource:0}: Error finding container 068e7ef4a9c181ba15bc79862688a74d70f6a00396bedbc4d86ce536def2b84f: Status 404 returned error can't find the container with id 068e7ef4a9c181ba15bc79862688a74d70f6a00396bedbc4d86ce536def2b84f Mar 16 17:20:56 crc kubenswrapper[5120]: I0316 17:20:56.430358 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-global-qbgz7" event={"ID":"fc38d17d-9798-43ab-a697-0148939455e1","Type":"ContainerStarted","Data":"068e7ef4a9c181ba15bc79862688a74d70f6a00396bedbc4d86ce536def2b84f"} Mar 16 17:20:56 crc kubenswrapper[5120]: I0316 17:20:56.653252 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-f5g5s"] Mar 16 17:20:56 crc kubenswrapper[5120]: W0316 17:20:56.659976 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf41c2228_c503_41ca_98da_5e5518e564a5.slice/crio-8e07b565904d8d7638d40067c35444a7de5611c5e754066208b2dc0f43a3211b WatchSource:0}: Error finding container 8e07b565904d8d7638d40067c35444a7de5611c5e754066208b2dc0f43a3211b: Status 404 returned error can't find the container with id 8e07b565904d8d7638d40067c35444a7de5611c5e754066208b2dc0f43a3211b Mar 16 17:20:57 crc kubenswrapper[5120]: I0316 17:20:57.438928 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-global-qbgz7" event={"ID":"fc38d17d-9798-43ab-a697-0148939455e1","Type":"ContainerStarted","Data":"016eec3ea2dd14326073c498fbf8f9bdf42ab2cbb22e50251644f31d4868c757"} Mar 16 17:20:57 crc kubenswrapper[5120]: I0316 17:20:57.441120 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-f5g5s" event={"ID":"f41c2228-c503-41ca-98da-5e5518e564a5","Type":"ContainerStarted","Data":"07db26521289b3d93875f9081bdd3ffcf4064cf7283ad7537dd2edbe11a940ff"} Mar 16 17:20:57 crc kubenswrapper[5120]: I0316 17:20:57.441159 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-f5g5s" event={"ID":"f41c2228-c503-41ca-98da-5e5518e564a5","Type":"ContainerStarted","Data":"8e07b565904d8d7638d40067c35444a7de5611c5e754066208b2dc0f43a3211b"} Mar 16 17:20:57 crc kubenswrapper[5120]: I0316 17:20:57.455683 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-global-qbgz7" podStartSLOduration=2.007349303 podStartE2EDuration="2.455662183s" podCreationTimestamp="2026-03-16 17:20:55 +0000 UTC" firstStartedPulling="2026-03-16 17:20:56.247042077 +0000 UTC m=+6558.400973734" lastFinishedPulling="2026-03-16 17:20:56.695354957 +0000 UTC m=+6558.849286614" observedRunningTime="2026-03-16 17:20:57.453340979 +0000 UTC m=+6559.607272646" watchObservedRunningTime="2026-03-16 17:20:57.455662183 +0000 UTC m=+6559.609593840" Mar 16 17:20:57 crc kubenswrapper[5120]: I0316 17:20:57.483742 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-f5g5s" podStartSLOduration=2.041455905 podStartE2EDuration="2.48372556s" podCreationTimestamp="2026-03-16 17:20:55 +0000 UTC" firstStartedPulling="2026-03-16 17:20:56.663207359 +0000 UTC m=+6558.817139016" lastFinishedPulling="2026-03-16 17:20:57.105477024 +0000 UTC m=+6559.259408671" observedRunningTime="2026-03-16 17:20:57.475056043 +0000 UTC m=+6559.628987700" watchObservedRunningTime="2026-03-16 17:20:57.48372556 +0000 UTC m=+6559.637657217" Mar 16 17:20:58 crc kubenswrapper[5120]: I0316 17:20:58.460869 5120 generic.go:358] "Generic (PLEG): container finished" podID="fc38d17d-9798-43ab-a697-0148939455e1" containerID="016eec3ea2dd14326073c498fbf8f9bdf42ab2cbb22e50251644f31d4868c757" exitCode=0 Mar 16 17:20:58 crc kubenswrapper[5120]: I0316 17:20:58.460926 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-global-qbgz7" event={"ID":"fc38d17d-9798-43ab-a697-0148939455e1","Type":"ContainerDied","Data":"016eec3ea2dd14326073c498fbf8f9bdf42ab2cbb22e50251644f31d4868c757"} Mar 16 17:20:59 crc kubenswrapper[5120]: I0316 17:20:59.474026 5120 generic.go:358] "Generic (PLEG): container finished" podID="f41c2228-c503-41ca-98da-5e5518e564a5" containerID="07db26521289b3d93875f9081bdd3ffcf4064cf7283ad7537dd2edbe11a940ff" exitCode=0 Mar 16 17:20:59 crc kubenswrapper[5120]: I0316 17:20:59.474654 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-f5g5s" event={"ID":"f41c2228-c503-41ca-98da-5e5518e564a5","Type":"ContainerDied","Data":"07db26521289b3d93875f9081bdd3ffcf4064cf7283ad7537dd2edbe11a940ff"} Mar 16 17:20:59 crc kubenswrapper[5120]: I0316 17:20:59.746507 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-global-qbgz7" Mar 16 17:20:59 crc kubenswrapper[5120]: I0316 17:20:59.794854 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/fc38d17d-9798-43ab-a697-0148939455e1-inventory\") pod \"fc38d17d-9798-43ab-a697-0148939455e1\" (UID: \"fc38d17d-9798-43ab-a697-0148939455e1\") " Mar 16 17:20:59 crc kubenswrapper[5120]: I0316 17:20:59.795075 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vmbrs\" (UniqueName: \"kubernetes.io/projected/fc38d17d-9798-43ab-a697-0148939455e1-kube-api-access-vmbrs\") pod \"fc38d17d-9798-43ab-a697-0148939455e1\" (UID: \"fc38d17d-9798-43ab-a697-0148939455e1\") " Mar 16 17:20:59 crc kubenswrapper[5120]: I0316 17:20:59.795218 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/fc38d17d-9798-43ab-a697-0148939455e1-ssh-key-edpm-compute-global\") pod \"fc38d17d-9798-43ab-a697-0148939455e1\" (UID: \"fc38d17d-9798-43ab-a697-0148939455e1\") " Mar 16 17:20:59 crc kubenswrapper[5120]: I0316 17:20:59.795273 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bootstrap-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fc38d17d-9798-43ab-a697-0148939455e1-bootstrap-combined-ca-bundle\") pod \"fc38d17d-9798-43ab-a697-0148939455e1\" (UID: \"fc38d17d-9798-43ab-a697-0148939455e1\") " Mar 16 17:20:59 crc kubenswrapper[5120]: I0316 17:20:59.803313 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc38d17d-9798-43ab-a697-0148939455e1-kube-api-access-vmbrs" (OuterVolumeSpecName: "kube-api-access-vmbrs") pod "fc38d17d-9798-43ab-a697-0148939455e1" (UID: "fc38d17d-9798-43ab-a697-0148939455e1"). InnerVolumeSpecName "kube-api-access-vmbrs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:20:59 crc kubenswrapper[5120]: I0316 17:20:59.803328 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc38d17d-9798-43ab-a697-0148939455e1-bootstrap-combined-ca-bundle" (OuterVolumeSpecName: "bootstrap-combined-ca-bundle") pod "fc38d17d-9798-43ab-a697-0148939455e1" (UID: "fc38d17d-9798-43ab-a697-0148939455e1"). InnerVolumeSpecName "bootstrap-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:20:59 crc kubenswrapper[5120]: I0316 17:20:59.816645 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc38d17d-9798-43ab-a697-0148939455e1-inventory" (OuterVolumeSpecName: "inventory") pod "fc38d17d-9798-43ab-a697-0148939455e1" (UID: "fc38d17d-9798-43ab-a697-0148939455e1"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:20:59 crc kubenswrapper[5120]: I0316 17:20:59.817129 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc38d17d-9798-43ab-a697-0148939455e1-ssh-key-edpm-compute-global" (OuterVolumeSpecName: "ssh-key-edpm-compute-global") pod "fc38d17d-9798-43ab-a697-0148939455e1" (UID: "fc38d17d-9798-43ab-a697-0148939455e1"). InnerVolumeSpecName "ssh-key-edpm-compute-global". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:20:59 crc kubenswrapper[5120]: I0316 17:20:59.899454 5120 reconciler_common.go:299] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/fc38d17d-9798-43ab-a697-0148939455e1-inventory\") on node \"crc\" DevicePath \"\"" Mar 16 17:20:59 crc kubenswrapper[5120]: I0316 17:20:59.899485 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vmbrs\" (UniqueName: \"kubernetes.io/projected/fc38d17d-9798-43ab-a697-0148939455e1-kube-api-access-vmbrs\") on node \"crc\" DevicePath \"\"" Mar 16 17:20:59 crc kubenswrapper[5120]: I0316 17:20:59.899496 5120 reconciler_common.go:299] "Volume detached for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/fc38d17d-9798-43ab-a697-0148939455e1-ssh-key-edpm-compute-global\") on node \"crc\" DevicePath \"\"" Mar 16 17:20:59 crc kubenswrapper[5120]: I0316 17:20:59.899505 5120 reconciler_common.go:299] "Volume detached for volume \"bootstrap-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fc38d17d-9798-43ab-a697-0148939455e1-bootstrap-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:21:00 crc kubenswrapper[5120]: I0316 17:21:00.508816 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-global-qbgz7" Mar 16 17:21:00 crc kubenswrapper[5120]: I0316 17:21:00.509903 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-global-qbgz7" event={"ID":"fc38d17d-9798-43ab-a697-0148939455e1","Type":"ContainerDied","Data":"068e7ef4a9c181ba15bc79862688a74d70f6a00396bedbc4d86ce536def2b84f"} Mar 16 17:21:00 crc kubenswrapper[5120]: I0316 17:21:00.510009 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="068e7ef4a9c181ba15bc79862688a74d70f6a00396bedbc4d86ce536def2b84f" Mar 16 17:21:00 crc kubenswrapper[5120]: I0316 17:21:00.552797 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/configure-network-edpm-multinodeset-edpm-compute-global-57c2c"] Mar 16 17:21:00 crc kubenswrapper[5120]: I0316 17:21:00.554104 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc38d17d-9798-43ab-a697-0148939455e1" containerName="bootstrap-edpm-multinodeset-edpm-compute-global" Mar 16 17:21:00 crc kubenswrapper[5120]: I0316 17:21:00.554133 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc38d17d-9798-43ab-a697-0148939455e1" containerName="bootstrap-edpm-multinodeset-edpm-compute-global" Mar 16 17:21:00 crc kubenswrapper[5120]: I0316 17:21:00.554359 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="fc38d17d-9798-43ab-a697-0148939455e1" containerName="bootstrap-edpm-multinodeset-edpm-compute-global" Mar 16 17:21:00 crc kubenswrapper[5120]: I0316 17:21:00.560284 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/configure-network-edpm-multinodeset-edpm-compute-global-57c2c" Mar 16 17:21:00 crc kubenswrapper[5120]: I0316 17:21:00.564026 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplanenodeset-edpm-compute-global\"" Mar 16 17:21:00 crc kubenswrapper[5120]: I0316 17:21:00.564569 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"edpm-compute-global-dockercfg-5hp85\"" Mar 16 17:21:00 crc kubenswrapper[5120]: I0316 17:21:00.568675 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/configure-network-edpm-multinodeset-edpm-compute-global-57c2c"] Mar 16 17:21:00 crc kubenswrapper[5120]: I0316 17:21:00.716980 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/5b90541f-789c-4c4f-ad4e-eda4e32c5d83-ssh-key-edpm-compute-global\") pod \"configure-network-edpm-multinodeset-edpm-compute-global-57c2c\" (UID: \"5b90541f-789c-4c4f-ad4e-eda4e32c5d83\") " pod="openstack-kuttl-tests/configure-network-edpm-multinodeset-edpm-compute-global-57c2c" Mar 16 17:21:00 crc kubenswrapper[5120]: I0316 17:21:00.717047 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/5b90541f-789c-4c4f-ad4e-eda4e32c5d83-inventory\") pod \"configure-network-edpm-multinodeset-edpm-compute-global-57c2c\" (UID: \"5b90541f-789c-4c4f-ad4e-eda4e32c5d83\") " pod="openstack-kuttl-tests/configure-network-edpm-multinodeset-edpm-compute-global-57c2c" Mar 16 17:21:00 crc kubenswrapper[5120]: I0316 17:21:00.717227 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7gr9\" (UniqueName: \"kubernetes.io/projected/5b90541f-789c-4c4f-ad4e-eda4e32c5d83-kube-api-access-p7gr9\") pod \"configure-network-edpm-multinodeset-edpm-compute-global-57c2c\" (UID: \"5b90541f-789c-4c4f-ad4e-eda4e32c5d83\") " pod="openstack-kuttl-tests/configure-network-edpm-multinodeset-edpm-compute-global-57c2c" Mar 16 17:21:00 crc kubenswrapper[5120]: I0316 17:21:00.805902 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-f5g5s" Mar 16 17:21:00 crc kubenswrapper[5120]: I0316 17:21:00.819032 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/5b90541f-789c-4c4f-ad4e-eda4e32c5d83-ssh-key-edpm-compute-global\") pod \"configure-network-edpm-multinodeset-edpm-compute-global-57c2c\" (UID: \"5b90541f-789c-4c4f-ad4e-eda4e32c5d83\") " pod="openstack-kuttl-tests/configure-network-edpm-multinodeset-edpm-compute-global-57c2c" Mar 16 17:21:00 crc kubenswrapper[5120]: I0316 17:21:00.819094 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/5b90541f-789c-4c4f-ad4e-eda4e32c5d83-inventory\") pod \"configure-network-edpm-multinodeset-edpm-compute-global-57c2c\" (UID: \"5b90541f-789c-4c4f-ad4e-eda4e32c5d83\") " pod="openstack-kuttl-tests/configure-network-edpm-multinodeset-edpm-compute-global-57c2c" Mar 16 17:21:00 crc kubenswrapper[5120]: I0316 17:21:00.822797 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p7gr9\" (UniqueName: \"kubernetes.io/projected/5b90541f-789c-4c4f-ad4e-eda4e32c5d83-kube-api-access-p7gr9\") pod \"configure-network-edpm-multinodeset-edpm-compute-global-57c2c\" (UID: \"5b90541f-789c-4c4f-ad4e-eda4e32c5d83\") " pod="openstack-kuttl-tests/configure-network-edpm-multinodeset-edpm-compute-global-57c2c" Mar 16 17:21:00 crc kubenswrapper[5120]: I0316 17:21:00.827977 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/5b90541f-789c-4c4f-ad4e-eda4e32c5d83-ssh-key-edpm-compute-global\") pod \"configure-network-edpm-multinodeset-edpm-compute-global-57c2c\" (UID: \"5b90541f-789c-4c4f-ad4e-eda4e32c5d83\") " pod="openstack-kuttl-tests/configure-network-edpm-multinodeset-edpm-compute-global-57c2c" Mar 16 17:21:00 crc kubenswrapper[5120]: I0316 17:21:00.830323 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/5b90541f-789c-4c4f-ad4e-eda4e32c5d83-inventory\") pod \"configure-network-edpm-multinodeset-edpm-compute-global-57c2c\" (UID: \"5b90541f-789c-4c4f-ad4e-eda4e32c5d83\") " pod="openstack-kuttl-tests/configure-network-edpm-multinodeset-edpm-compute-global-57c2c" Mar 16 17:21:00 crc kubenswrapper[5120]: I0316 17:21:00.841604 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7gr9\" (UniqueName: \"kubernetes.io/projected/5b90541f-789c-4c4f-ad4e-eda4e32c5d83-kube-api-access-p7gr9\") pod \"configure-network-edpm-multinodeset-edpm-compute-global-57c2c\" (UID: \"5b90541f-789c-4c4f-ad4e-eda4e32c5d83\") " pod="openstack-kuttl-tests/configure-network-edpm-multinodeset-edpm-compute-global-57c2c" Mar 16 17:21:00 crc kubenswrapper[5120]: I0316 17:21:00.884029 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/configure-network-edpm-multinodeset-edpm-compute-global-57c2c" Mar 16 17:21:00 crc kubenswrapper[5120]: I0316 17:21:00.928457 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/f41c2228-c503-41ca-98da-5e5518e564a5-inventory\") pod \"f41c2228-c503-41ca-98da-5e5518e564a5\" (UID: \"f41c2228-c503-41ca-98da-5e5518e564a5\") " Mar 16 17:21:00 crc kubenswrapper[5120]: I0316 17:21:00.929342 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rjtg9\" (UniqueName: \"kubernetes.io/projected/f41c2228-c503-41ca-98da-5e5518e564a5-kube-api-access-rjtg9\") pod \"f41c2228-c503-41ca-98da-5e5518e564a5\" (UID: \"f41c2228-c503-41ca-98da-5e5518e564a5\") " Mar 16 17:21:00 crc kubenswrapper[5120]: I0316 17:21:00.929699 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bootstrap-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f41c2228-c503-41ca-98da-5e5518e564a5-bootstrap-combined-ca-bundle\") pod \"f41c2228-c503-41ca-98da-5e5518e564a5\" (UID: \"f41c2228-c503-41ca-98da-5e5518e564a5\") " Mar 16 17:21:00 crc kubenswrapper[5120]: I0316 17:21:00.929780 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ssh-key-edpm-compute-beta-nodeset\" (UniqueName: \"kubernetes.io/secret/f41c2228-c503-41ca-98da-5e5518e564a5-ssh-key-edpm-compute-beta-nodeset\") pod \"f41c2228-c503-41ca-98da-5e5518e564a5\" (UID: \"f41c2228-c503-41ca-98da-5e5518e564a5\") " Mar 16 17:21:00 crc kubenswrapper[5120]: I0316 17:21:00.935707 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f41c2228-c503-41ca-98da-5e5518e564a5-kube-api-access-rjtg9" (OuterVolumeSpecName: "kube-api-access-rjtg9") pod "f41c2228-c503-41ca-98da-5e5518e564a5" (UID: "f41c2228-c503-41ca-98da-5e5518e564a5"). InnerVolumeSpecName "kube-api-access-rjtg9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:21:00 crc kubenswrapper[5120]: I0316 17:21:00.935943 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f41c2228-c503-41ca-98da-5e5518e564a5-bootstrap-combined-ca-bundle" (OuterVolumeSpecName: "bootstrap-combined-ca-bundle") pod "f41c2228-c503-41ca-98da-5e5518e564a5" (UID: "f41c2228-c503-41ca-98da-5e5518e564a5"). InnerVolumeSpecName "bootstrap-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:21:00 crc kubenswrapper[5120]: I0316 17:21:00.948387 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f41c2228-c503-41ca-98da-5e5518e564a5-inventory" (OuterVolumeSpecName: "inventory") pod "f41c2228-c503-41ca-98da-5e5518e564a5" (UID: "f41c2228-c503-41ca-98da-5e5518e564a5"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:21:00 crc kubenswrapper[5120]: I0316 17:21:00.953907 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f41c2228-c503-41ca-98da-5e5518e564a5-ssh-key-edpm-compute-beta-nodeset" (OuterVolumeSpecName: "ssh-key-edpm-compute-beta-nodeset") pod "f41c2228-c503-41ca-98da-5e5518e564a5" (UID: "f41c2228-c503-41ca-98da-5e5518e564a5"). InnerVolumeSpecName "ssh-key-edpm-compute-beta-nodeset". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:21:01 crc kubenswrapper[5120]: I0316 17:21:01.033847 5120 reconciler_common.go:299] "Volume detached for volume \"bootstrap-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f41c2228-c503-41ca-98da-5e5518e564a5-bootstrap-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:21:01 crc kubenswrapper[5120]: I0316 17:21:01.033906 5120 reconciler_common.go:299] "Volume detached for volume \"ssh-key-edpm-compute-beta-nodeset\" (UniqueName: \"kubernetes.io/secret/f41c2228-c503-41ca-98da-5e5518e564a5-ssh-key-edpm-compute-beta-nodeset\") on node \"crc\" DevicePath \"\"" Mar 16 17:21:01 crc kubenswrapper[5120]: I0316 17:21:01.033923 5120 reconciler_common.go:299] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/f41c2228-c503-41ca-98da-5e5518e564a5-inventory\") on node \"crc\" DevicePath \"\"" Mar 16 17:21:01 crc kubenswrapper[5120]: I0316 17:21:01.033935 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rjtg9\" (UniqueName: \"kubernetes.io/projected/f41c2228-c503-41ca-98da-5e5518e564a5-kube-api-access-rjtg9\") on node \"crc\" DevicePath \"\"" Mar 16 17:21:01 crc kubenswrapper[5120]: I0316 17:21:01.298599 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/configure-network-edpm-multinodeset-edpm-compute-global-57c2c"] Mar 16 17:21:01 crc kubenswrapper[5120]: I0316 17:21:01.299272 5120 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Mar 16 17:21:01 crc kubenswrapper[5120]: I0316 17:21:01.522959 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-f5g5s" Mar 16 17:21:01 crc kubenswrapper[5120]: I0316 17:21:01.523036 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-f5g5s" event={"ID":"f41c2228-c503-41ca-98da-5e5518e564a5","Type":"ContainerDied","Data":"8e07b565904d8d7638d40067c35444a7de5611c5e754066208b2dc0f43a3211b"} Mar 16 17:21:01 crc kubenswrapper[5120]: I0316 17:21:01.523084 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8e07b565904d8d7638d40067c35444a7de5611c5e754066208b2dc0f43a3211b" Mar 16 17:21:01 crc kubenswrapper[5120]: I0316 17:21:01.525171 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/configure-network-edpm-multinodeset-edpm-compute-global-57c2c" event={"ID":"5b90541f-789c-4c4f-ad4e-eda4e32c5d83","Type":"ContainerStarted","Data":"15cf962f9e7442d04d5be2e4781e1f4de538cf0fa55a63bb3200772e711e464f"} Mar 16 17:21:02 crc kubenswrapper[5120]: I0316 17:21:02.536737 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/configure-network-edpm-multinodeset-edpm-compute-global-57c2c" event={"ID":"5b90541f-789c-4c4f-ad4e-eda4e32c5d83","Type":"ContainerStarted","Data":"41164c2cb0bd7012a94e2b17e005c1a1285a85dc1177e08ca1c6e95e09b7aa50"} Mar 16 17:21:02 crc kubenswrapper[5120]: I0316 17:21:02.555277 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/configure-network-edpm-multinodeset-edpm-compute-global-57c2c" podStartSLOduration=2.158634353 podStartE2EDuration="2.555257221s" podCreationTimestamp="2026-03-16 17:21:00 +0000 UTC" firstStartedPulling="2026-03-16 17:21:01.299445975 +0000 UTC m=+6563.453377632" lastFinishedPulling="2026-03-16 17:21:01.696068843 +0000 UTC m=+6563.850000500" observedRunningTime="2026-03-16 17:21:02.553838282 +0000 UTC m=+6564.707769959" watchObservedRunningTime="2026-03-16 17:21:02.555257221 +0000 UTC m=+6564.709188888" Mar 16 17:21:03 crc kubenswrapper[5120]: I0316 17:21:03.547934 5120 generic.go:358] "Generic (PLEG): container finished" podID="5b90541f-789c-4c4f-ad4e-eda4e32c5d83" containerID="41164c2cb0bd7012a94e2b17e005c1a1285a85dc1177e08ca1c6e95e09b7aa50" exitCode=0 Mar 16 17:21:03 crc kubenswrapper[5120]: I0316 17:21:03.547984 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/configure-network-edpm-multinodeset-edpm-compute-global-57c2c" event={"ID":"5b90541f-789c-4c4f-ad4e-eda4e32c5d83","Type":"ContainerDied","Data":"41164c2cb0bd7012a94e2b17e005c1a1285a85dc1177e08ca1c6e95e09b7aa50"} Mar 16 17:21:04 crc kubenswrapper[5120]: I0316 17:21:04.663982 5120 scope.go:117] "RemoveContainer" containerID="2ca61165dca6fdb30458423ef74c44c42b1b273e8fa504e89f5f9e186e516cc3" Mar 16 17:21:04 crc kubenswrapper[5120]: E0316 17:21:04.664373 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 17:21:04 crc kubenswrapper[5120]: I0316 17:21:04.841862 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/configure-network-edpm-multinodeset-edpm-compute-global-57c2c" Mar 16 17:21:04 crc kubenswrapper[5120]: I0316 17:21:04.920099 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p7gr9\" (UniqueName: \"kubernetes.io/projected/5b90541f-789c-4c4f-ad4e-eda4e32c5d83-kube-api-access-p7gr9\") pod \"5b90541f-789c-4c4f-ad4e-eda4e32c5d83\" (UID: \"5b90541f-789c-4c4f-ad4e-eda4e32c5d83\") " Mar 16 17:21:04 crc kubenswrapper[5120]: I0316 17:21:04.920353 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/5b90541f-789c-4c4f-ad4e-eda4e32c5d83-inventory\") pod \"5b90541f-789c-4c4f-ad4e-eda4e32c5d83\" (UID: \"5b90541f-789c-4c4f-ad4e-eda4e32c5d83\") " Mar 16 17:21:04 crc kubenswrapper[5120]: I0316 17:21:04.920548 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/5b90541f-789c-4c4f-ad4e-eda4e32c5d83-ssh-key-edpm-compute-global\") pod \"5b90541f-789c-4c4f-ad4e-eda4e32c5d83\" (UID: \"5b90541f-789c-4c4f-ad4e-eda4e32c5d83\") " Mar 16 17:21:04 crc kubenswrapper[5120]: I0316 17:21:04.928154 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b90541f-789c-4c4f-ad4e-eda4e32c5d83-kube-api-access-p7gr9" (OuterVolumeSpecName: "kube-api-access-p7gr9") pod "5b90541f-789c-4c4f-ad4e-eda4e32c5d83" (UID: "5b90541f-789c-4c4f-ad4e-eda4e32c5d83"). InnerVolumeSpecName "kube-api-access-p7gr9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:21:04 crc kubenswrapper[5120]: I0316 17:21:04.946954 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b90541f-789c-4c4f-ad4e-eda4e32c5d83-ssh-key-edpm-compute-global" (OuterVolumeSpecName: "ssh-key-edpm-compute-global") pod "5b90541f-789c-4c4f-ad4e-eda4e32c5d83" (UID: "5b90541f-789c-4c4f-ad4e-eda4e32c5d83"). InnerVolumeSpecName "ssh-key-edpm-compute-global". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:21:04 crc kubenswrapper[5120]: I0316 17:21:04.952005 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b90541f-789c-4c4f-ad4e-eda4e32c5d83-inventory" (OuterVolumeSpecName: "inventory") pod "5b90541f-789c-4c4f-ad4e-eda4e32c5d83" (UID: "5b90541f-789c-4c4f-ad4e-eda4e32c5d83"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:21:05 crc kubenswrapper[5120]: I0316 17:21:05.023072 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p7gr9\" (UniqueName: \"kubernetes.io/projected/5b90541f-789c-4c4f-ad4e-eda4e32c5d83-kube-api-access-p7gr9\") on node \"crc\" DevicePath \"\"" Mar 16 17:21:05 crc kubenswrapper[5120]: I0316 17:21:05.023101 5120 reconciler_common.go:299] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/5b90541f-789c-4c4f-ad4e-eda4e32c5d83-inventory\") on node \"crc\" DevicePath \"\"" Mar 16 17:21:05 crc kubenswrapper[5120]: I0316 17:21:05.023110 5120 reconciler_common.go:299] "Volume detached for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/5b90541f-789c-4c4f-ad4e-eda4e32c5d83-ssh-key-edpm-compute-global\") on node \"crc\" DevicePath \"\"" Mar 16 17:21:05 crc kubenswrapper[5120]: I0316 17:21:05.566177 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/configure-network-edpm-multinodeset-edpm-compute-global-57c2c" Mar 16 17:21:05 crc kubenswrapper[5120]: I0316 17:21:05.566166 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/configure-network-edpm-multinodeset-edpm-compute-global-57c2c" event={"ID":"5b90541f-789c-4c4f-ad4e-eda4e32c5d83","Type":"ContainerDied","Data":"15cf962f9e7442d04d5be2e4781e1f4de538cf0fa55a63bb3200772e711e464f"} Mar 16 17:21:05 crc kubenswrapper[5120]: I0316 17:21:05.566593 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="15cf962f9e7442d04d5be2e4781e1f4de538cf0fa55a63bb3200772e711e464f" Mar 16 17:21:05 crc kubenswrapper[5120]: I0316 17:21:05.632948 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/validate-network-edpm-multinodeset-edpm-compute-global-rbzll"] Mar 16 17:21:05 crc kubenswrapper[5120]: I0316 17:21:05.634470 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b90541f-789c-4c4f-ad4e-eda4e32c5d83" containerName="configure-network-edpm-multinodeset-edpm-compute-global" Mar 16 17:21:05 crc kubenswrapper[5120]: I0316 17:21:05.634494 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b90541f-789c-4c4f-ad4e-eda4e32c5d83" containerName="configure-network-edpm-multinodeset-edpm-compute-global" Mar 16 17:21:05 crc kubenswrapper[5120]: I0316 17:21:05.634578 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f41c2228-c503-41ca-98da-5e5518e564a5" containerName="bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset" Mar 16 17:21:05 crc kubenswrapper[5120]: I0316 17:21:05.634592 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f41c2228-c503-41ca-98da-5e5518e564a5" containerName="bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset" Mar 16 17:21:05 crc kubenswrapper[5120]: I0316 17:21:05.634740 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="5b90541f-789c-4c4f-ad4e-eda4e32c5d83" containerName="configure-network-edpm-multinodeset-edpm-compute-global" Mar 16 17:21:05 crc kubenswrapper[5120]: I0316 17:21:05.634778 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f41c2228-c503-41ca-98da-5e5518e564a5" containerName="bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset" Mar 16 17:21:05 crc kubenswrapper[5120]: I0316 17:21:05.640661 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/validate-network-edpm-multinodeset-edpm-compute-global-rbzll" Mar 16 17:21:05 crc kubenswrapper[5120]: I0316 17:21:05.642043 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/validate-network-edpm-multinodeset-edpm-compute-global-rbzll"] Mar 16 17:21:05 crc kubenswrapper[5120]: I0316 17:21:05.643165 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-aee-default-env\"" Mar 16 17:21:05 crc kubenswrapper[5120]: I0316 17:21:05.643343 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplane-ansible-ssh-private-key-secret\"" Mar 16 17:21:05 crc kubenswrapper[5120]: I0316 17:21:05.643458 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplanenodeset-edpm-compute-global\"" Mar 16 17:21:05 crc kubenswrapper[5120]: I0316 17:21:05.643534 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"edpm-compute-global-dockercfg-5hp85\"" Mar 16 17:21:05 crc kubenswrapper[5120]: I0316 17:21:05.739689 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/151c171e-6248-4807-adc6-0510de79c2a4-ssh-key-edpm-compute-global\") pod \"validate-network-edpm-multinodeset-edpm-compute-global-rbzll\" (UID: \"151c171e-6248-4807-adc6-0510de79c2a4\") " pod="openstack-kuttl-tests/validate-network-edpm-multinodeset-edpm-compute-global-rbzll" Mar 16 17:21:05 crc kubenswrapper[5120]: I0316 17:21:05.739970 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwbdw\" (UniqueName: \"kubernetes.io/projected/151c171e-6248-4807-adc6-0510de79c2a4-kube-api-access-pwbdw\") pod \"validate-network-edpm-multinodeset-edpm-compute-global-rbzll\" (UID: \"151c171e-6248-4807-adc6-0510de79c2a4\") " pod="openstack-kuttl-tests/validate-network-edpm-multinodeset-edpm-compute-global-rbzll" Mar 16 17:21:05 crc kubenswrapper[5120]: I0316 17:21:05.740031 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/151c171e-6248-4807-adc6-0510de79c2a4-inventory\") pod \"validate-network-edpm-multinodeset-edpm-compute-global-rbzll\" (UID: \"151c171e-6248-4807-adc6-0510de79c2a4\") " pod="openstack-kuttl-tests/validate-network-edpm-multinodeset-edpm-compute-global-rbzll" Mar 16 17:21:05 crc kubenswrapper[5120]: I0316 17:21:05.842462 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/151c171e-6248-4807-adc6-0510de79c2a4-ssh-key-edpm-compute-global\") pod \"validate-network-edpm-multinodeset-edpm-compute-global-rbzll\" (UID: \"151c171e-6248-4807-adc6-0510de79c2a4\") " pod="openstack-kuttl-tests/validate-network-edpm-multinodeset-edpm-compute-global-rbzll" Mar 16 17:21:05 crc kubenswrapper[5120]: I0316 17:21:05.842560 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pwbdw\" (UniqueName: \"kubernetes.io/projected/151c171e-6248-4807-adc6-0510de79c2a4-kube-api-access-pwbdw\") pod \"validate-network-edpm-multinodeset-edpm-compute-global-rbzll\" (UID: \"151c171e-6248-4807-adc6-0510de79c2a4\") " pod="openstack-kuttl-tests/validate-network-edpm-multinodeset-edpm-compute-global-rbzll" Mar 16 17:21:05 crc kubenswrapper[5120]: I0316 17:21:05.842603 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/151c171e-6248-4807-adc6-0510de79c2a4-inventory\") pod \"validate-network-edpm-multinodeset-edpm-compute-global-rbzll\" (UID: \"151c171e-6248-4807-adc6-0510de79c2a4\") " pod="openstack-kuttl-tests/validate-network-edpm-multinodeset-edpm-compute-global-rbzll" Mar 16 17:21:05 crc kubenswrapper[5120]: I0316 17:21:05.848828 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/151c171e-6248-4807-adc6-0510de79c2a4-ssh-key-edpm-compute-global\") pod \"validate-network-edpm-multinodeset-edpm-compute-global-rbzll\" (UID: \"151c171e-6248-4807-adc6-0510de79c2a4\") " pod="openstack-kuttl-tests/validate-network-edpm-multinodeset-edpm-compute-global-rbzll" Mar 16 17:21:05 crc kubenswrapper[5120]: I0316 17:21:05.848884 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/151c171e-6248-4807-adc6-0510de79c2a4-inventory\") pod \"validate-network-edpm-multinodeset-edpm-compute-global-rbzll\" (UID: \"151c171e-6248-4807-adc6-0510de79c2a4\") " pod="openstack-kuttl-tests/validate-network-edpm-multinodeset-edpm-compute-global-rbzll" Mar 16 17:21:05 crc kubenswrapper[5120]: I0316 17:21:05.860631 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwbdw\" (UniqueName: \"kubernetes.io/projected/151c171e-6248-4807-adc6-0510de79c2a4-kube-api-access-pwbdw\") pod \"validate-network-edpm-multinodeset-edpm-compute-global-rbzll\" (UID: \"151c171e-6248-4807-adc6-0510de79c2a4\") " pod="openstack-kuttl-tests/validate-network-edpm-multinodeset-edpm-compute-global-rbzll" Mar 16 17:21:05 crc kubenswrapper[5120]: I0316 17:21:05.978640 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/validate-network-edpm-multinodeset-edpm-compute-global-rbzll" Mar 16 17:21:06 crc kubenswrapper[5120]: I0316 17:21:06.388996 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/validate-network-edpm-multinodeset-edpm-compute-global-rbzll"] Mar 16 17:21:06 crc kubenswrapper[5120]: W0316 17:21:06.617447 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod151c171e_6248_4807_adc6_0510de79c2a4.slice/crio-3c2a9257572cc7d3bf285bc62f53a21ff95b734fb66c8902ac2ed1a78dfb1f63 WatchSource:0}: Error finding container 3c2a9257572cc7d3bf285bc62f53a21ff95b734fb66c8902ac2ed1a78dfb1f63: Status 404 returned error can't find the container with id 3c2a9257572cc7d3bf285bc62f53a21ff95b734fb66c8902ac2ed1a78dfb1f63 Mar 16 17:21:07 crc kubenswrapper[5120]: I0316 17:21:07.582681 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/validate-network-edpm-multinodeset-edpm-compute-global-rbzll" event={"ID":"151c171e-6248-4807-adc6-0510de79c2a4","Type":"ContainerStarted","Data":"9a54ba14b71c2fc488b749d44ac4d6ecd982f4238ee497bd391073897402179b"} Mar 16 17:21:07 crc kubenswrapper[5120]: I0316 17:21:07.583051 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/validate-network-edpm-multinodeset-edpm-compute-global-rbzll" event={"ID":"151c171e-6248-4807-adc6-0510de79c2a4","Type":"ContainerStarted","Data":"3c2a9257572cc7d3bf285bc62f53a21ff95b734fb66c8902ac2ed1a78dfb1f63"} Mar 16 17:21:07 crc kubenswrapper[5120]: I0316 17:21:07.606520 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/validate-network-edpm-multinodeset-edpm-compute-global-rbzll" podStartSLOduration=2.144149364 podStartE2EDuration="2.606502368s" podCreationTimestamp="2026-03-16 17:21:05 +0000 UTC" firstStartedPulling="2026-03-16 17:21:06.61997462 +0000 UTC m=+6568.773906277" lastFinishedPulling="2026-03-16 17:21:07.082327634 +0000 UTC m=+6569.236259281" observedRunningTime="2026-03-16 17:21:07.595110886 +0000 UTC m=+6569.749042563" watchObservedRunningTime="2026-03-16 17:21:07.606502368 +0000 UTC m=+6569.760434015" Mar 16 17:21:07 crc kubenswrapper[5120]: E0316 17:21:07.666392 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1313278 actualBytes=10240 Mar 16 17:21:08 crc kubenswrapper[5120]: I0316 17:21:08.591870 5120 generic.go:358] "Generic (PLEG): container finished" podID="151c171e-6248-4807-adc6-0510de79c2a4" containerID="9a54ba14b71c2fc488b749d44ac4d6ecd982f4238ee497bd391073897402179b" exitCode=0 Mar 16 17:21:08 crc kubenswrapper[5120]: I0316 17:21:08.591937 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/validate-network-edpm-multinodeset-edpm-compute-global-rbzll" event={"ID":"151c171e-6248-4807-adc6-0510de79c2a4","Type":"ContainerDied","Data":"9a54ba14b71c2fc488b749d44ac4d6ecd982f4238ee497bd391073897402179b"} Mar 16 17:21:09 crc kubenswrapper[5120]: I0316 17:21:09.870466 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/validate-network-edpm-multinodeset-edpm-compute-global-rbzll" Mar 16 17:21:10 crc kubenswrapper[5120]: I0316 17:21:10.039625 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/151c171e-6248-4807-adc6-0510de79c2a4-ssh-key-edpm-compute-global\") pod \"151c171e-6248-4807-adc6-0510de79c2a4\" (UID: \"151c171e-6248-4807-adc6-0510de79c2a4\") " Mar 16 17:21:10 crc kubenswrapper[5120]: I0316 17:21:10.039733 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pwbdw\" (UniqueName: \"kubernetes.io/projected/151c171e-6248-4807-adc6-0510de79c2a4-kube-api-access-pwbdw\") pod \"151c171e-6248-4807-adc6-0510de79c2a4\" (UID: \"151c171e-6248-4807-adc6-0510de79c2a4\") " Mar 16 17:21:10 crc kubenswrapper[5120]: I0316 17:21:10.039793 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/151c171e-6248-4807-adc6-0510de79c2a4-inventory\") pod \"151c171e-6248-4807-adc6-0510de79c2a4\" (UID: \"151c171e-6248-4807-adc6-0510de79c2a4\") " Mar 16 17:21:10 crc kubenswrapper[5120]: I0316 17:21:10.046819 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/151c171e-6248-4807-adc6-0510de79c2a4-kube-api-access-pwbdw" (OuterVolumeSpecName: "kube-api-access-pwbdw") pod "151c171e-6248-4807-adc6-0510de79c2a4" (UID: "151c171e-6248-4807-adc6-0510de79c2a4"). InnerVolumeSpecName "kube-api-access-pwbdw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:21:10 crc kubenswrapper[5120]: I0316 17:21:10.062241 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/151c171e-6248-4807-adc6-0510de79c2a4-inventory" (OuterVolumeSpecName: "inventory") pod "151c171e-6248-4807-adc6-0510de79c2a4" (UID: "151c171e-6248-4807-adc6-0510de79c2a4"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:21:10 crc kubenswrapper[5120]: I0316 17:21:10.065560 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/151c171e-6248-4807-adc6-0510de79c2a4-ssh-key-edpm-compute-global" (OuterVolumeSpecName: "ssh-key-edpm-compute-global") pod "151c171e-6248-4807-adc6-0510de79c2a4" (UID: "151c171e-6248-4807-adc6-0510de79c2a4"). InnerVolumeSpecName "ssh-key-edpm-compute-global". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:21:10 crc kubenswrapper[5120]: I0316 17:21:10.142786 5120 reconciler_common.go:299] "Volume detached for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/151c171e-6248-4807-adc6-0510de79c2a4-ssh-key-edpm-compute-global\") on node \"crc\" DevicePath \"\"" Mar 16 17:21:10 crc kubenswrapper[5120]: I0316 17:21:10.142829 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pwbdw\" (UniqueName: \"kubernetes.io/projected/151c171e-6248-4807-adc6-0510de79c2a4-kube-api-access-pwbdw\") on node \"crc\" DevicePath \"\"" Mar 16 17:21:10 crc kubenswrapper[5120]: I0316 17:21:10.142843 5120 reconciler_common.go:299] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/151c171e-6248-4807-adc6-0510de79c2a4-inventory\") on node \"crc\" DevicePath \"\"" Mar 16 17:21:10 crc kubenswrapper[5120]: I0316 17:21:10.617276 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/validate-network-edpm-multinodeset-edpm-compute-global-rbzll" Mar 16 17:21:10 crc kubenswrapper[5120]: I0316 17:21:10.617569 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/validate-network-edpm-multinodeset-edpm-compute-global-rbzll" event={"ID":"151c171e-6248-4807-adc6-0510de79c2a4","Type":"ContainerDied","Data":"3c2a9257572cc7d3bf285bc62f53a21ff95b734fb66c8902ac2ed1a78dfb1f63"} Mar 16 17:21:10 crc kubenswrapper[5120]: I0316 17:21:10.617639 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3c2a9257572cc7d3bf285bc62f53a21ff95b734fb66c8902ac2ed1a78dfb1f63" Mar 16 17:21:10 crc kubenswrapper[5120]: I0316 17:21:10.672793 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/install-os-edpm-multinodeset-edpm-compute-global-zd7r5"] Mar 16 17:21:10 crc kubenswrapper[5120]: I0316 17:21:10.674156 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="151c171e-6248-4807-adc6-0510de79c2a4" containerName="validate-network-edpm-multinodeset-edpm-compute-global" Mar 16 17:21:10 crc kubenswrapper[5120]: I0316 17:21:10.674180 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="151c171e-6248-4807-adc6-0510de79c2a4" containerName="validate-network-edpm-multinodeset-edpm-compute-global" Mar 16 17:21:10 crc kubenswrapper[5120]: I0316 17:21:10.674406 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="151c171e-6248-4807-adc6-0510de79c2a4" containerName="validate-network-edpm-multinodeset-edpm-compute-global" Mar 16 17:21:10 crc kubenswrapper[5120]: I0316 17:21:10.680355 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/install-os-edpm-multinodeset-edpm-compute-global-zd7r5" Mar 16 17:21:10 crc kubenswrapper[5120]: I0316 17:21:10.680689 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/install-os-edpm-multinodeset-edpm-compute-global-zd7r5"] Mar 16 17:21:10 crc kubenswrapper[5120]: I0316 17:21:10.695014 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-aee-default-env\"" Mar 16 17:21:10 crc kubenswrapper[5120]: I0316 17:21:10.696041 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplanenodeset-edpm-compute-global\"" Mar 16 17:21:10 crc kubenswrapper[5120]: I0316 17:21:10.696326 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplane-ansible-ssh-private-key-secret\"" Mar 16 17:21:10 crc kubenswrapper[5120]: I0316 17:21:10.697151 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"edpm-compute-global-dockercfg-5hp85\"" Mar 16 17:21:10 crc kubenswrapper[5120]: I0316 17:21:10.778934 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/c142b874-2f55-42f0-9b78-b463054819a6-ssh-key-edpm-compute-global\") pod \"install-os-edpm-multinodeset-edpm-compute-global-zd7r5\" (UID: \"c142b874-2f55-42f0-9b78-b463054819a6\") " pod="openstack-kuttl-tests/install-os-edpm-multinodeset-edpm-compute-global-zd7r5" Mar 16 17:21:10 crc kubenswrapper[5120]: I0316 17:21:10.779232 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/c142b874-2f55-42f0-9b78-b463054819a6-inventory\") pod \"install-os-edpm-multinodeset-edpm-compute-global-zd7r5\" (UID: \"c142b874-2f55-42f0-9b78-b463054819a6\") " pod="openstack-kuttl-tests/install-os-edpm-multinodeset-edpm-compute-global-zd7r5" Mar 16 17:21:10 crc kubenswrapper[5120]: I0316 17:21:10.779464 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjqvq\" (UniqueName: \"kubernetes.io/projected/c142b874-2f55-42f0-9b78-b463054819a6-kube-api-access-cjqvq\") pod \"install-os-edpm-multinodeset-edpm-compute-global-zd7r5\" (UID: \"c142b874-2f55-42f0-9b78-b463054819a6\") " pod="openstack-kuttl-tests/install-os-edpm-multinodeset-edpm-compute-global-zd7r5" Mar 16 17:21:10 crc kubenswrapper[5120]: I0316 17:21:10.881474 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/c142b874-2f55-42f0-9b78-b463054819a6-inventory\") pod \"install-os-edpm-multinodeset-edpm-compute-global-zd7r5\" (UID: \"c142b874-2f55-42f0-9b78-b463054819a6\") " pod="openstack-kuttl-tests/install-os-edpm-multinodeset-edpm-compute-global-zd7r5" Mar 16 17:21:10 crc kubenswrapper[5120]: I0316 17:21:10.881633 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cjqvq\" (UniqueName: \"kubernetes.io/projected/c142b874-2f55-42f0-9b78-b463054819a6-kube-api-access-cjqvq\") pod \"install-os-edpm-multinodeset-edpm-compute-global-zd7r5\" (UID: \"c142b874-2f55-42f0-9b78-b463054819a6\") " pod="openstack-kuttl-tests/install-os-edpm-multinodeset-edpm-compute-global-zd7r5" Mar 16 17:21:10 crc kubenswrapper[5120]: I0316 17:21:10.881916 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/c142b874-2f55-42f0-9b78-b463054819a6-ssh-key-edpm-compute-global\") pod \"install-os-edpm-multinodeset-edpm-compute-global-zd7r5\" (UID: \"c142b874-2f55-42f0-9b78-b463054819a6\") " pod="openstack-kuttl-tests/install-os-edpm-multinodeset-edpm-compute-global-zd7r5" Mar 16 17:21:10 crc kubenswrapper[5120]: I0316 17:21:10.888307 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/c142b874-2f55-42f0-9b78-b463054819a6-inventory\") pod \"install-os-edpm-multinodeset-edpm-compute-global-zd7r5\" (UID: \"c142b874-2f55-42f0-9b78-b463054819a6\") " pod="openstack-kuttl-tests/install-os-edpm-multinodeset-edpm-compute-global-zd7r5" Mar 16 17:21:10 crc kubenswrapper[5120]: I0316 17:21:10.888308 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/c142b874-2f55-42f0-9b78-b463054819a6-ssh-key-edpm-compute-global\") pod \"install-os-edpm-multinodeset-edpm-compute-global-zd7r5\" (UID: \"c142b874-2f55-42f0-9b78-b463054819a6\") " pod="openstack-kuttl-tests/install-os-edpm-multinodeset-edpm-compute-global-zd7r5" Mar 16 17:21:10 crc kubenswrapper[5120]: I0316 17:21:10.903836 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjqvq\" (UniqueName: \"kubernetes.io/projected/c142b874-2f55-42f0-9b78-b463054819a6-kube-api-access-cjqvq\") pod \"install-os-edpm-multinodeset-edpm-compute-global-zd7r5\" (UID: \"c142b874-2f55-42f0-9b78-b463054819a6\") " pod="openstack-kuttl-tests/install-os-edpm-multinodeset-edpm-compute-global-zd7r5" Mar 16 17:21:11 crc kubenswrapper[5120]: I0316 17:21:11.010856 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/install-os-edpm-multinodeset-edpm-compute-global-zd7r5" Mar 16 17:21:11 crc kubenswrapper[5120]: I0316 17:21:11.434868 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/install-os-edpm-multinodeset-edpm-compute-global-zd7r5"] Mar 16 17:21:11 crc kubenswrapper[5120]: I0316 17:21:11.626428 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/install-os-edpm-multinodeset-edpm-compute-global-zd7r5" event={"ID":"c142b874-2f55-42f0-9b78-b463054819a6","Type":"ContainerStarted","Data":"34974f89e264470125951304e66d04521a2c3d5810136498deb82e3f74234e40"} Mar 16 17:21:12 crc kubenswrapper[5120]: I0316 17:21:12.638062 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/install-os-edpm-multinodeset-edpm-compute-global-zd7r5" event={"ID":"c142b874-2f55-42f0-9b78-b463054819a6","Type":"ContainerStarted","Data":"a00234859febaca6fb5a5f488d176511a075ee9dd72dfb086601517dd0251b6b"} Mar 16 17:21:12 crc kubenswrapper[5120]: I0316 17:21:12.664474 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/install-os-edpm-multinodeset-edpm-compute-global-zd7r5" podStartSLOduration=2.22105736 podStartE2EDuration="2.664450596s" podCreationTimestamp="2026-03-16 17:21:10 +0000 UTC" firstStartedPulling="2026-03-16 17:21:11.434195179 +0000 UTC m=+6573.588126836" lastFinishedPulling="2026-03-16 17:21:11.877588405 +0000 UTC m=+6574.031520072" observedRunningTime="2026-03-16 17:21:12.655535463 +0000 UTC m=+6574.809467120" watchObservedRunningTime="2026-03-16 17:21:12.664450596 +0000 UTC m=+6574.818382253" Mar 16 17:21:13 crc kubenswrapper[5120]: I0316 17:21:13.653151 5120 generic.go:358] "Generic (PLEG): container finished" podID="c142b874-2f55-42f0-9b78-b463054819a6" containerID="a00234859febaca6fb5a5f488d176511a075ee9dd72dfb086601517dd0251b6b" exitCode=0 Mar 16 17:21:13 crc kubenswrapper[5120]: I0316 17:21:13.653554 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/install-os-edpm-multinodeset-edpm-compute-global-zd7r5" event={"ID":"c142b874-2f55-42f0-9b78-b463054819a6","Type":"ContainerDied","Data":"a00234859febaca6fb5a5f488d176511a075ee9dd72dfb086601517dd0251b6b"} Mar 16 17:21:14 crc kubenswrapper[5120]: I0316 17:21:14.943863 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/install-os-edpm-multinodeset-edpm-compute-global-zd7r5" Mar 16 17:21:15 crc kubenswrapper[5120]: I0316 17:21:15.069242 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cjqvq\" (UniqueName: \"kubernetes.io/projected/c142b874-2f55-42f0-9b78-b463054819a6-kube-api-access-cjqvq\") pod \"c142b874-2f55-42f0-9b78-b463054819a6\" (UID: \"c142b874-2f55-42f0-9b78-b463054819a6\") " Mar 16 17:21:15 crc kubenswrapper[5120]: I0316 17:21:15.069497 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/c142b874-2f55-42f0-9b78-b463054819a6-inventory\") pod \"c142b874-2f55-42f0-9b78-b463054819a6\" (UID: \"c142b874-2f55-42f0-9b78-b463054819a6\") " Mar 16 17:21:15 crc kubenswrapper[5120]: I0316 17:21:15.070427 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/c142b874-2f55-42f0-9b78-b463054819a6-ssh-key-edpm-compute-global\") pod \"c142b874-2f55-42f0-9b78-b463054819a6\" (UID: \"c142b874-2f55-42f0-9b78-b463054819a6\") " Mar 16 17:21:15 crc kubenswrapper[5120]: I0316 17:21:15.108372 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c142b874-2f55-42f0-9b78-b463054819a6-kube-api-access-cjqvq" (OuterVolumeSpecName: "kube-api-access-cjqvq") pod "c142b874-2f55-42f0-9b78-b463054819a6" (UID: "c142b874-2f55-42f0-9b78-b463054819a6"). InnerVolumeSpecName "kube-api-access-cjqvq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:21:15 crc kubenswrapper[5120]: I0316 17:21:15.115733 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c142b874-2f55-42f0-9b78-b463054819a6-inventory" (OuterVolumeSpecName: "inventory") pod "c142b874-2f55-42f0-9b78-b463054819a6" (UID: "c142b874-2f55-42f0-9b78-b463054819a6"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:21:15 crc kubenswrapper[5120]: I0316 17:21:15.123162 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c142b874-2f55-42f0-9b78-b463054819a6-ssh-key-edpm-compute-global" (OuterVolumeSpecName: "ssh-key-edpm-compute-global") pod "c142b874-2f55-42f0-9b78-b463054819a6" (UID: "c142b874-2f55-42f0-9b78-b463054819a6"). InnerVolumeSpecName "ssh-key-edpm-compute-global". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:21:15 crc kubenswrapper[5120]: I0316 17:21:15.174806 5120 reconciler_common.go:299] "Volume detached for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/c142b874-2f55-42f0-9b78-b463054819a6-ssh-key-edpm-compute-global\") on node \"crc\" DevicePath \"\"" Mar 16 17:21:15 crc kubenswrapper[5120]: I0316 17:21:15.174865 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cjqvq\" (UniqueName: \"kubernetes.io/projected/c142b874-2f55-42f0-9b78-b463054819a6-kube-api-access-cjqvq\") on node \"crc\" DevicePath \"\"" Mar 16 17:21:15 crc kubenswrapper[5120]: I0316 17:21:15.174881 5120 reconciler_common.go:299] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/c142b874-2f55-42f0-9b78-b463054819a6-inventory\") on node \"crc\" DevicePath \"\"" Mar 16 17:21:15 crc kubenswrapper[5120]: I0316 17:21:15.673861 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/install-os-edpm-multinodeset-edpm-compute-global-zd7r5" event={"ID":"c142b874-2f55-42f0-9b78-b463054819a6","Type":"ContainerDied","Data":"34974f89e264470125951304e66d04521a2c3d5810136498deb82e3f74234e40"} Mar 16 17:21:15 crc kubenswrapper[5120]: I0316 17:21:15.673916 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="34974f89e264470125951304e66d04521a2c3d5810136498deb82e3f74234e40" Mar 16 17:21:15 crc kubenswrapper[5120]: I0316 17:21:15.673931 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/install-os-edpm-multinodeset-edpm-compute-global-zd7r5" Mar 16 17:21:15 crc kubenswrapper[5120]: I0316 17:21:15.748533 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/configure-os-edpm-multinodeset-edpm-compute-global-6rsg7"] Mar 16 17:21:15 crc kubenswrapper[5120]: I0316 17:21:15.752178 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c142b874-2f55-42f0-9b78-b463054819a6" containerName="install-os-edpm-multinodeset-edpm-compute-global" Mar 16 17:21:15 crc kubenswrapper[5120]: I0316 17:21:15.752207 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c142b874-2f55-42f0-9b78-b463054819a6" containerName="install-os-edpm-multinodeset-edpm-compute-global" Mar 16 17:21:15 crc kubenswrapper[5120]: I0316 17:21:15.752405 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c142b874-2f55-42f0-9b78-b463054819a6" containerName="install-os-edpm-multinodeset-edpm-compute-global" Mar 16 17:21:15 crc kubenswrapper[5120]: I0316 17:21:15.759207 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/configure-os-edpm-multinodeset-edpm-compute-global-6rsg7" Mar 16 17:21:15 crc kubenswrapper[5120]: I0316 17:21:15.759511 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/configure-os-edpm-multinodeset-edpm-compute-global-6rsg7"] Mar 16 17:21:15 crc kubenswrapper[5120]: I0316 17:21:15.763085 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"edpm-compute-global-dockercfg-5hp85\"" Mar 16 17:21:15 crc kubenswrapper[5120]: I0316 17:21:15.763308 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-aee-default-env\"" Mar 16 17:21:15 crc kubenswrapper[5120]: I0316 17:21:15.763500 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplane-ansible-ssh-private-key-secret\"" Mar 16 17:21:15 crc kubenswrapper[5120]: I0316 17:21:15.763616 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplanenodeset-edpm-compute-global\"" Mar 16 17:21:15 crc kubenswrapper[5120]: I0316 17:21:15.891605 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/d5806840-8be0-4868-b0b7-f264425abb5e-inventory\") pod \"configure-os-edpm-multinodeset-edpm-compute-global-6rsg7\" (UID: \"d5806840-8be0-4868-b0b7-f264425abb5e\") " pod="openstack-kuttl-tests/configure-os-edpm-multinodeset-edpm-compute-global-6rsg7" Mar 16 17:21:15 crc kubenswrapper[5120]: I0316 17:21:15.891780 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/d5806840-8be0-4868-b0b7-f264425abb5e-ssh-key-edpm-compute-global\") pod \"configure-os-edpm-multinodeset-edpm-compute-global-6rsg7\" (UID: \"d5806840-8be0-4868-b0b7-f264425abb5e\") " pod="openstack-kuttl-tests/configure-os-edpm-multinodeset-edpm-compute-global-6rsg7" Mar 16 17:21:15 crc kubenswrapper[5120]: I0316 17:21:15.891988 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mdpv\" (UniqueName: \"kubernetes.io/projected/d5806840-8be0-4868-b0b7-f264425abb5e-kube-api-access-8mdpv\") pod \"configure-os-edpm-multinodeset-edpm-compute-global-6rsg7\" (UID: \"d5806840-8be0-4868-b0b7-f264425abb5e\") " pod="openstack-kuttl-tests/configure-os-edpm-multinodeset-edpm-compute-global-6rsg7" Mar 16 17:21:15 crc kubenswrapper[5120]: I0316 17:21:15.993676 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/d5806840-8be0-4868-b0b7-f264425abb5e-inventory\") pod \"configure-os-edpm-multinodeset-edpm-compute-global-6rsg7\" (UID: \"d5806840-8be0-4868-b0b7-f264425abb5e\") " pod="openstack-kuttl-tests/configure-os-edpm-multinodeset-edpm-compute-global-6rsg7" Mar 16 17:21:15 crc kubenswrapper[5120]: I0316 17:21:15.993798 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/d5806840-8be0-4868-b0b7-f264425abb5e-ssh-key-edpm-compute-global\") pod \"configure-os-edpm-multinodeset-edpm-compute-global-6rsg7\" (UID: \"d5806840-8be0-4868-b0b7-f264425abb5e\") " pod="openstack-kuttl-tests/configure-os-edpm-multinodeset-edpm-compute-global-6rsg7" Mar 16 17:21:15 crc kubenswrapper[5120]: I0316 17:21:15.993925 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8mdpv\" (UniqueName: \"kubernetes.io/projected/d5806840-8be0-4868-b0b7-f264425abb5e-kube-api-access-8mdpv\") pod \"configure-os-edpm-multinodeset-edpm-compute-global-6rsg7\" (UID: \"d5806840-8be0-4868-b0b7-f264425abb5e\") " pod="openstack-kuttl-tests/configure-os-edpm-multinodeset-edpm-compute-global-6rsg7" Mar 16 17:21:15 crc kubenswrapper[5120]: I0316 17:21:15.999884 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/d5806840-8be0-4868-b0b7-f264425abb5e-inventory\") pod \"configure-os-edpm-multinodeset-edpm-compute-global-6rsg7\" (UID: \"d5806840-8be0-4868-b0b7-f264425abb5e\") " pod="openstack-kuttl-tests/configure-os-edpm-multinodeset-edpm-compute-global-6rsg7" Mar 16 17:21:16 crc kubenswrapper[5120]: I0316 17:21:16.000380 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/d5806840-8be0-4868-b0b7-f264425abb5e-ssh-key-edpm-compute-global\") pod \"configure-os-edpm-multinodeset-edpm-compute-global-6rsg7\" (UID: \"d5806840-8be0-4868-b0b7-f264425abb5e\") " pod="openstack-kuttl-tests/configure-os-edpm-multinodeset-edpm-compute-global-6rsg7" Mar 16 17:21:16 crc kubenswrapper[5120]: I0316 17:21:16.015957 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mdpv\" (UniqueName: \"kubernetes.io/projected/d5806840-8be0-4868-b0b7-f264425abb5e-kube-api-access-8mdpv\") pod \"configure-os-edpm-multinodeset-edpm-compute-global-6rsg7\" (UID: \"d5806840-8be0-4868-b0b7-f264425abb5e\") " pod="openstack-kuttl-tests/configure-os-edpm-multinodeset-edpm-compute-global-6rsg7" Mar 16 17:21:16 crc kubenswrapper[5120]: I0316 17:21:16.081563 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/configure-os-edpm-multinodeset-edpm-compute-global-6rsg7" Mar 16 17:21:16 crc kubenswrapper[5120]: I0316 17:21:16.527773 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/configure-os-edpm-multinodeset-edpm-compute-global-6rsg7"] Mar 16 17:21:16 crc kubenswrapper[5120]: I0316 17:21:16.687903 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/configure-os-edpm-multinodeset-edpm-compute-global-6rsg7" event={"ID":"d5806840-8be0-4868-b0b7-f264425abb5e","Type":"ContainerStarted","Data":"b19ea033157fcd754a9c39ebd16cb55c4609d8ebbad0d9ad1a3e5424f6f4504f"} Mar 16 17:21:17 crc kubenswrapper[5120]: I0316 17:21:17.696521 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/configure-os-edpm-multinodeset-edpm-compute-global-6rsg7" event={"ID":"d5806840-8be0-4868-b0b7-f264425abb5e","Type":"ContainerStarted","Data":"c3ea549d6d5e5cdedccccba7cb20a2f30502b81c1c43be79640ae15ca5801b7f"} Mar 16 17:21:17 crc kubenswrapper[5120]: I0316 17:21:17.718472 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/configure-os-edpm-multinodeset-edpm-compute-global-6rsg7" podStartSLOduration=2.258164312 podStartE2EDuration="2.718449158s" podCreationTimestamp="2026-03-16 17:21:15 +0000 UTC" firstStartedPulling="2026-03-16 17:21:16.532242555 +0000 UTC m=+6578.686174212" lastFinishedPulling="2026-03-16 17:21:16.992527401 +0000 UTC m=+6579.146459058" observedRunningTime="2026-03-16 17:21:17.711852267 +0000 UTC m=+6579.865783924" watchObservedRunningTime="2026-03-16 17:21:17.718449158 +0000 UTC m=+6579.872380835" Mar 16 17:21:18 crc kubenswrapper[5120]: I0316 17:21:18.675749 5120 scope.go:117] "RemoveContainer" containerID="2ca61165dca6fdb30458423ef74c44c42b1b273e8fa504e89f5f9e186e516cc3" Mar 16 17:21:18 crc kubenswrapper[5120]: E0316 17:21:18.676274 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 17:21:18 crc kubenswrapper[5120]: I0316 17:21:18.706945 5120 generic.go:358] "Generic (PLEG): container finished" podID="d5806840-8be0-4868-b0b7-f264425abb5e" containerID="c3ea549d6d5e5cdedccccba7cb20a2f30502b81c1c43be79640ae15ca5801b7f" exitCode=0 Mar 16 17:21:18 crc kubenswrapper[5120]: I0316 17:21:18.707019 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/configure-os-edpm-multinodeset-edpm-compute-global-6rsg7" event={"ID":"d5806840-8be0-4868-b0b7-f264425abb5e","Type":"ContainerDied","Data":"c3ea549d6d5e5cdedccccba7cb20a2f30502b81c1c43be79640ae15ca5801b7f"} Mar 16 17:21:19 crc kubenswrapper[5120]: I0316 17:21:19.991122 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/configure-os-edpm-multinodeset-edpm-compute-global-6rsg7" Mar 16 17:21:20 crc kubenswrapper[5120]: I0316 17:21:20.025463 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/d5806840-8be0-4868-b0b7-f264425abb5e-ssh-key-edpm-compute-global\") pod \"d5806840-8be0-4868-b0b7-f264425abb5e\" (UID: \"d5806840-8be0-4868-b0b7-f264425abb5e\") " Mar 16 17:21:20 crc kubenswrapper[5120]: I0316 17:21:20.025604 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/d5806840-8be0-4868-b0b7-f264425abb5e-inventory\") pod \"d5806840-8be0-4868-b0b7-f264425abb5e\" (UID: \"d5806840-8be0-4868-b0b7-f264425abb5e\") " Mar 16 17:21:20 crc kubenswrapper[5120]: I0316 17:21:20.025635 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8mdpv\" (UniqueName: \"kubernetes.io/projected/d5806840-8be0-4868-b0b7-f264425abb5e-kube-api-access-8mdpv\") pod \"d5806840-8be0-4868-b0b7-f264425abb5e\" (UID: \"d5806840-8be0-4868-b0b7-f264425abb5e\") " Mar 16 17:21:20 crc kubenswrapper[5120]: I0316 17:21:20.030979 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5806840-8be0-4868-b0b7-f264425abb5e-kube-api-access-8mdpv" (OuterVolumeSpecName: "kube-api-access-8mdpv") pod "d5806840-8be0-4868-b0b7-f264425abb5e" (UID: "d5806840-8be0-4868-b0b7-f264425abb5e"). InnerVolumeSpecName "kube-api-access-8mdpv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:21:20 crc kubenswrapper[5120]: I0316 17:21:20.048919 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5806840-8be0-4868-b0b7-f264425abb5e-inventory" (OuterVolumeSpecName: "inventory") pod "d5806840-8be0-4868-b0b7-f264425abb5e" (UID: "d5806840-8be0-4868-b0b7-f264425abb5e"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:21:20 crc kubenswrapper[5120]: I0316 17:21:20.048949 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5806840-8be0-4868-b0b7-f264425abb5e-ssh-key-edpm-compute-global" (OuterVolumeSpecName: "ssh-key-edpm-compute-global") pod "d5806840-8be0-4868-b0b7-f264425abb5e" (UID: "d5806840-8be0-4868-b0b7-f264425abb5e"). InnerVolumeSpecName "ssh-key-edpm-compute-global". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:21:20 crc kubenswrapper[5120]: I0316 17:21:20.129012 5120 reconciler_common.go:299] "Volume detached for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/d5806840-8be0-4868-b0b7-f264425abb5e-ssh-key-edpm-compute-global\") on node \"crc\" DevicePath \"\"" Mar 16 17:21:20 crc kubenswrapper[5120]: I0316 17:21:20.129053 5120 reconciler_common.go:299] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/d5806840-8be0-4868-b0b7-f264425abb5e-inventory\") on node \"crc\" DevicePath \"\"" Mar 16 17:21:20 crc kubenswrapper[5120]: I0316 17:21:20.129067 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8mdpv\" (UniqueName: \"kubernetes.io/projected/d5806840-8be0-4868-b0b7-f264425abb5e-kube-api-access-8mdpv\") on node \"crc\" DevicePath \"\"" Mar 16 17:21:20 crc kubenswrapper[5120]: I0316 17:21:20.724376 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/configure-os-edpm-multinodeset-edpm-compute-global-6rsg7" event={"ID":"d5806840-8be0-4868-b0b7-f264425abb5e","Type":"ContainerDied","Data":"b19ea033157fcd754a9c39ebd16cb55c4609d8ebbad0d9ad1a3e5424f6f4504f"} Mar 16 17:21:20 crc kubenswrapper[5120]: I0316 17:21:20.724421 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b19ea033157fcd754a9c39ebd16cb55c4609d8ebbad0d9ad1a3e5424f6f4504f" Mar 16 17:21:20 crc kubenswrapper[5120]: I0316 17:21:20.724455 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/configure-os-edpm-multinodeset-edpm-compute-global-6rsg7" Mar 16 17:21:20 crc kubenswrapper[5120]: I0316 17:21:20.776742 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/run-os-edpm-multinodeset-edpm-compute-global-wpmb8"] Mar 16 17:21:20 crc kubenswrapper[5120]: I0316 17:21:20.778031 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5806840-8be0-4868-b0b7-f264425abb5e" containerName="configure-os-edpm-multinodeset-edpm-compute-global" Mar 16 17:21:20 crc kubenswrapper[5120]: I0316 17:21:20.778060 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5806840-8be0-4868-b0b7-f264425abb5e" containerName="configure-os-edpm-multinodeset-edpm-compute-global" Mar 16 17:21:20 crc kubenswrapper[5120]: I0316 17:21:20.778282 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="d5806840-8be0-4868-b0b7-f264425abb5e" containerName="configure-os-edpm-multinodeset-edpm-compute-global" Mar 16 17:21:20 crc kubenswrapper[5120]: I0316 17:21:20.783087 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/run-os-edpm-multinodeset-edpm-compute-global-wpmb8" Mar 16 17:21:20 crc kubenswrapper[5120]: I0316 17:21:20.785366 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/run-os-edpm-multinodeset-edpm-compute-global-wpmb8"] Mar 16 17:21:20 crc kubenswrapper[5120]: I0316 17:21:20.786050 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-aee-default-env\"" Mar 16 17:21:20 crc kubenswrapper[5120]: I0316 17:21:20.786089 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplanenodeset-edpm-compute-global\"" Mar 16 17:21:20 crc kubenswrapper[5120]: I0316 17:21:20.786166 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"edpm-compute-global-dockercfg-5hp85\"" Mar 16 17:21:20 crc kubenswrapper[5120]: I0316 17:21:20.786555 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplane-ansible-ssh-private-key-secret\"" Mar 16 17:21:20 crc kubenswrapper[5120]: I0316 17:21:20.849170 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/161af075-1663-4d77-87b2-62b32c81a62c-inventory\") pod \"run-os-edpm-multinodeset-edpm-compute-global-wpmb8\" (UID: \"161af075-1663-4d77-87b2-62b32c81a62c\") " pod="openstack-kuttl-tests/run-os-edpm-multinodeset-edpm-compute-global-wpmb8" Mar 16 17:21:20 crc kubenswrapper[5120]: I0316 17:21:20.849406 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dfpb\" (UniqueName: \"kubernetes.io/projected/161af075-1663-4d77-87b2-62b32c81a62c-kube-api-access-8dfpb\") pod \"run-os-edpm-multinodeset-edpm-compute-global-wpmb8\" (UID: \"161af075-1663-4d77-87b2-62b32c81a62c\") " pod="openstack-kuttl-tests/run-os-edpm-multinodeset-edpm-compute-global-wpmb8" Mar 16 17:21:20 crc kubenswrapper[5120]: I0316 17:21:20.849488 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/161af075-1663-4d77-87b2-62b32c81a62c-ssh-key-edpm-compute-global\") pod \"run-os-edpm-multinodeset-edpm-compute-global-wpmb8\" (UID: \"161af075-1663-4d77-87b2-62b32c81a62c\") " pod="openstack-kuttl-tests/run-os-edpm-multinodeset-edpm-compute-global-wpmb8" Mar 16 17:21:20 crc kubenswrapper[5120]: I0316 17:21:20.951747 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8dfpb\" (UniqueName: \"kubernetes.io/projected/161af075-1663-4d77-87b2-62b32c81a62c-kube-api-access-8dfpb\") pod \"run-os-edpm-multinodeset-edpm-compute-global-wpmb8\" (UID: \"161af075-1663-4d77-87b2-62b32c81a62c\") " pod="openstack-kuttl-tests/run-os-edpm-multinodeset-edpm-compute-global-wpmb8" Mar 16 17:21:20 crc kubenswrapper[5120]: I0316 17:21:20.951856 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/161af075-1663-4d77-87b2-62b32c81a62c-ssh-key-edpm-compute-global\") pod \"run-os-edpm-multinodeset-edpm-compute-global-wpmb8\" (UID: \"161af075-1663-4d77-87b2-62b32c81a62c\") " pod="openstack-kuttl-tests/run-os-edpm-multinodeset-edpm-compute-global-wpmb8" Mar 16 17:21:20 crc kubenswrapper[5120]: I0316 17:21:20.952085 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/161af075-1663-4d77-87b2-62b32c81a62c-inventory\") pod \"run-os-edpm-multinodeset-edpm-compute-global-wpmb8\" (UID: \"161af075-1663-4d77-87b2-62b32c81a62c\") " pod="openstack-kuttl-tests/run-os-edpm-multinodeset-edpm-compute-global-wpmb8" Mar 16 17:21:20 crc kubenswrapper[5120]: I0316 17:21:20.956832 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/161af075-1663-4d77-87b2-62b32c81a62c-inventory\") pod \"run-os-edpm-multinodeset-edpm-compute-global-wpmb8\" (UID: \"161af075-1663-4d77-87b2-62b32c81a62c\") " pod="openstack-kuttl-tests/run-os-edpm-multinodeset-edpm-compute-global-wpmb8" Mar 16 17:21:20 crc kubenswrapper[5120]: I0316 17:21:20.956894 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/161af075-1663-4d77-87b2-62b32c81a62c-ssh-key-edpm-compute-global\") pod \"run-os-edpm-multinodeset-edpm-compute-global-wpmb8\" (UID: \"161af075-1663-4d77-87b2-62b32c81a62c\") " pod="openstack-kuttl-tests/run-os-edpm-multinodeset-edpm-compute-global-wpmb8" Mar 16 17:21:20 crc kubenswrapper[5120]: I0316 17:21:20.970347 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dfpb\" (UniqueName: \"kubernetes.io/projected/161af075-1663-4d77-87b2-62b32c81a62c-kube-api-access-8dfpb\") pod \"run-os-edpm-multinodeset-edpm-compute-global-wpmb8\" (UID: \"161af075-1663-4d77-87b2-62b32c81a62c\") " pod="openstack-kuttl-tests/run-os-edpm-multinodeset-edpm-compute-global-wpmb8" Mar 16 17:21:21 crc kubenswrapper[5120]: I0316 17:21:21.103522 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/run-os-edpm-multinodeset-edpm-compute-global-wpmb8" Mar 16 17:21:21 crc kubenswrapper[5120]: I0316 17:21:21.519612 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/run-os-edpm-multinodeset-edpm-compute-global-wpmb8"] Mar 16 17:21:21 crc kubenswrapper[5120]: I0316 17:21:21.735380 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/run-os-edpm-multinodeset-edpm-compute-global-wpmb8" event={"ID":"161af075-1663-4d77-87b2-62b32c81a62c","Type":"ContainerStarted","Data":"038986a686293be61e6bb2fb0c7570539f1d48d8120f1cdc50d81b4f6e676448"} Mar 16 17:21:22 crc kubenswrapper[5120]: I0316 17:21:22.745100 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/run-os-edpm-multinodeset-edpm-compute-global-wpmb8" event={"ID":"161af075-1663-4d77-87b2-62b32c81a62c","Type":"ContainerStarted","Data":"fe8fe09bb3f95220a3c0e8f6f9eba99070627a0fb44bf07393d28608f7ad69d6"} Mar 16 17:21:22 crc kubenswrapper[5120]: I0316 17:21:22.767983 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/run-os-edpm-multinodeset-edpm-compute-global-wpmb8" podStartSLOduration=2.364134742 podStartE2EDuration="2.767962486s" podCreationTimestamp="2026-03-16 17:21:20 +0000 UTC" firstStartedPulling="2026-03-16 17:21:21.522399661 +0000 UTC m=+6583.676331318" lastFinishedPulling="2026-03-16 17:21:21.926227405 +0000 UTC m=+6584.080159062" observedRunningTime="2026-03-16 17:21:22.759165556 +0000 UTC m=+6584.913097203" watchObservedRunningTime="2026-03-16 17:21:22.767962486 +0000 UTC m=+6584.921894143" Mar 16 17:21:23 crc kubenswrapper[5120]: I0316 17:21:23.755694 5120 generic.go:358] "Generic (PLEG): container finished" podID="161af075-1663-4d77-87b2-62b32c81a62c" containerID="fe8fe09bb3f95220a3c0e8f6f9eba99070627a0fb44bf07393d28608f7ad69d6" exitCode=0 Mar 16 17:21:23 crc kubenswrapper[5120]: I0316 17:21:23.756072 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/run-os-edpm-multinodeset-edpm-compute-global-wpmb8" event={"ID":"161af075-1663-4d77-87b2-62b32c81a62c","Type":"ContainerDied","Data":"fe8fe09bb3f95220a3c0e8f6f9eba99070627a0fb44bf07393d28608f7ad69d6"} Mar 16 17:21:24 crc kubenswrapper[5120]: I0316 17:21:24.568193 5120 scope.go:117] "RemoveContainer" containerID="4d5201645c90c320c938b67420b0e5657c14656d543ebc83b0e5396f29bec71b" Mar 16 17:21:24 crc kubenswrapper[5120]: I0316 17:21:24.611715 5120 scope.go:117] "RemoveContainer" containerID="d2d1984e8f336bf15aaabdb3ab94e9958586677a69ccab41ee3bc77397c1d236" Mar 16 17:21:24 crc kubenswrapper[5120]: I0316 17:21:24.653239 5120 scope.go:117] "RemoveContainer" containerID="8f0a5cfda44fa0469d5667988c40b5fa21d4bc25c03c32374a9002107e112cf6" Mar 16 17:21:24 crc kubenswrapper[5120]: I0316 17:21:24.673407 5120 scope.go:117] "RemoveContainer" containerID="e3755f35f9a681410c6077b20fb86fa8d207825ea9e789bf539fe7e07f0d9847" Mar 16 17:21:24 crc kubenswrapper[5120]: I0316 17:21:24.690987 5120 scope.go:117] "RemoveContainer" containerID="35ba2e32f1219544208d3844bf0654ef2effacbd5d493e238c7a99b1c6f328e3" Mar 16 17:21:25 crc kubenswrapper[5120]: I0316 17:21:25.071052 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/run-os-edpm-multinodeset-edpm-compute-global-wpmb8" Mar 16 17:21:25 crc kubenswrapper[5120]: I0316 17:21:25.144543 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/161af075-1663-4d77-87b2-62b32c81a62c-ssh-key-edpm-compute-global\") pod \"161af075-1663-4d77-87b2-62b32c81a62c\" (UID: \"161af075-1663-4d77-87b2-62b32c81a62c\") " Mar 16 17:21:25 crc kubenswrapper[5120]: I0316 17:21:25.144612 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/161af075-1663-4d77-87b2-62b32c81a62c-inventory\") pod \"161af075-1663-4d77-87b2-62b32c81a62c\" (UID: \"161af075-1663-4d77-87b2-62b32c81a62c\") " Mar 16 17:21:25 crc kubenswrapper[5120]: I0316 17:21:25.144792 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8dfpb\" (UniqueName: \"kubernetes.io/projected/161af075-1663-4d77-87b2-62b32c81a62c-kube-api-access-8dfpb\") pod \"161af075-1663-4d77-87b2-62b32c81a62c\" (UID: \"161af075-1663-4d77-87b2-62b32c81a62c\") " Mar 16 17:21:25 crc kubenswrapper[5120]: I0316 17:21:25.150782 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/161af075-1663-4d77-87b2-62b32c81a62c-kube-api-access-8dfpb" (OuterVolumeSpecName: "kube-api-access-8dfpb") pod "161af075-1663-4d77-87b2-62b32c81a62c" (UID: "161af075-1663-4d77-87b2-62b32c81a62c"). InnerVolumeSpecName "kube-api-access-8dfpb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:21:25 crc kubenswrapper[5120]: I0316 17:21:25.165943 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/161af075-1663-4d77-87b2-62b32c81a62c-ssh-key-edpm-compute-global" (OuterVolumeSpecName: "ssh-key-edpm-compute-global") pod "161af075-1663-4d77-87b2-62b32c81a62c" (UID: "161af075-1663-4d77-87b2-62b32c81a62c"). InnerVolumeSpecName "ssh-key-edpm-compute-global". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:21:25 crc kubenswrapper[5120]: I0316 17:21:25.166061 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/161af075-1663-4d77-87b2-62b32c81a62c-inventory" (OuterVolumeSpecName: "inventory") pod "161af075-1663-4d77-87b2-62b32c81a62c" (UID: "161af075-1663-4d77-87b2-62b32c81a62c"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:21:25 crc kubenswrapper[5120]: I0316 17:21:25.246825 5120 reconciler_common.go:299] "Volume detached for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/161af075-1663-4d77-87b2-62b32c81a62c-ssh-key-edpm-compute-global\") on node \"crc\" DevicePath \"\"" Mar 16 17:21:25 crc kubenswrapper[5120]: I0316 17:21:25.246859 5120 reconciler_common.go:299] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/161af075-1663-4d77-87b2-62b32c81a62c-inventory\") on node \"crc\" DevicePath \"\"" Mar 16 17:21:25 crc kubenswrapper[5120]: I0316 17:21:25.246868 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8dfpb\" (UniqueName: \"kubernetes.io/projected/161af075-1663-4d77-87b2-62b32c81a62c-kube-api-access-8dfpb\") on node \"crc\" DevicePath \"\"" Mar 16 17:21:25 crc kubenswrapper[5120]: I0316 17:21:25.776528 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/run-os-edpm-multinodeset-edpm-compute-global-wpmb8" event={"ID":"161af075-1663-4d77-87b2-62b32c81a62c","Type":"ContainerDied","Data":"038986a686293be61e6bb2fb0c7570539f1d48d8120f1cdc50d81b4f6e676448"} Mar 16 17:21:25 crc kubenswrapper[5120]: I0316 17:21:25.778561 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="038986a686293be61e6bb2fb0c7570539f1d48d8120f1cdc50d81b4f6e676448" Mar 16 17:21:25 crc kubenswrapper[5120]: I0316 17:21:25.778706 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/run-os-edpm-multinodeset-edpm-compute-global-wpmb8" Mar 16 17:21:25 crc kubenswrapper[5120]: I0316 17:21:25.840129 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-global-4ljhm"] Mar 16 17:21:25 crc kubenswrapper[5120]: I0316 17:21:25.841291 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="161af075-1663-4d77-87b2-62b32c81a62c" containerName="run-os-edpm-multinodeset-edpm-compute-global" Mar 16 17:21:25 crc kubenswrapper[5120]: I0316 17:21:25.841320 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="161af075-1663-4d77-87b2-62b32c81a62c" containerName="run-os-edpm-multinodeset-edpm-compute-global" Mar 16 17:21:25 crc kubenswrapper[5120]: I0316 17:21:25.841513 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="161af075-1663-4d77-87b2-62b32c81a62c" containerName="run-os-edpm-multinodeset-edpm-compute-global" Mar 16 17:21:25 crc kubenswrapper[5120]: I0316 17:21:25.856550 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-global-4ljhm"] Mar 16 17:21:25 crc kubenswrapper[5120]: I0316 17:21:25.856680 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-global-4ljhm" Mar 16 17:21:25 crc kubenswrapper[5120]: I0316 17:21:25.860106 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"combined-ca-bundle\"" Mar 16 17:21:25 crc kubenswrapper[5120]: I0316 17:21:25.860679 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplanenodeset-edpm-compute-global\"" Mar 16 17:21:25 crc kubenswrapper[5120]: I0316 17:21:25.861433 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-aee-default-env\"" Mar 16 17:21:25 crc kubenswrapper[5120]: I0316 17:21:25.861661 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"edpm-compute-global-dockercfg-5hp85\"" Mar 16 17:21:25 crc kubenswrapper[5120]: I0316 17:21:25.861823 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplane-ansible-ssh-private-key-secret\"" Mar 16 17:21:25 crc kubenswrapper[5120]: I0316 17:21:25.959707 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"neutron-dhcp-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0ad6fc48-b614-4048-827f-290a2619a529-neutron-dhcp-combined-ca-bundle\") pod \"install-certs-edpm-multinodeset-edpm-compute-global-4ljhm\" (UID: \"0ad6fc48-b614-4048-827f-290a2619a529\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-global-4ljhm" Mar 16 17:21:25 crc kubenswrapper[5120]: I0316 17:21:25.959830 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/0ad6fc48-b614-4048-827f-290a2619a529-ssh-key-edpm-compute-global\") pod \"install-certs-edpm-multinodeset-edpm-compute-global-4ljhm\" (UID: \"0ad6fc48-b614-4048-827f-290a2619a529\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-global-4ljhm" Mar 16 17:21:25 crc kubenswrapper[5120]: I0316 17:21:25.959885 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"libvirt-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0ad6fc48-b614-4048-827f-290a2619a529-libvirt-combined-ca-bundle\") pod \"install-certs-edpm-multinodeset-edpm-compute-global-4ljhm\" (UID: \"0ad6fc48-b614-4048-827f-290a2619a529\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-global-4ljhm" Mar 16 17:21:25 crc kubenswrapper[5120]: I0316 17:21:25.959914 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0ad6fc48-b614-4048-827f-290a2619a529-ovn-combined-ca-bundle\") pod \"install-certs-edpm-multinodeset-edpm-compute-global-4ljhm\" (UID: \"0ad6fc48-b614-4048-827f-290a2619a529\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-global-4ljhm" Mar 16 17:21:25 crc kubenswrapper[5120]: I0316 17:21:25.960070 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bootstrap-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0ad6fc48-b614-4048-827f-290a2619a529-bootstrap-combined-ca-bundle\") pod \"install-certs-edpm-multinodeset-edpm-compute-global-4ljhm\" (UID: \"0ad6fc48-b614-4048-827f-290a2619a529\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-global-4ljhm" Mar 16 17:21:25 crc kubenswrapper[5120]: I0316 17:21:25.960151 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/0ad6fc48-b614-4048-827f-290a2619a529-inventory\") pod \"install-certs-edpm-multinodeset-edpm-compute-global-4ljhm\" (UID: \"0ad6fc48-b614-4048-827f-290a2619a529\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-global-4ljhm" Mar 16 17:21:25 crc kubenswrapper[5120]: I0316 17:21:25.960207 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"custom-global-service-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0ad6fc48-b614-4048-827f-290a2619a529-custom-global-service-combined-ca-bundle\") pod \"install-certs-edpm-multinodeset-edpm-compute-global-4ljhm\" (UID: \"0ad6fc48-b614-4048-827f-290a2619a529\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-global-4ljhm" Mar 16 17:21:25 crc kubenswrapper[5120]: I0316 17:21:25.960283 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0ad6fc48-b614-4048-827f-290a2619a529-nova-combined-ca-bundle\") pod \"install-certs-edpm-multinodeset-edpm-compute-global-4ljhm\" (UID: \"0ad6fc48-b614-4048-827f-290a2619a529\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-global-4ljhm" Mar 16 17:21:25 crc kubenswrapper[5120]: I0316 17:21:25.960426 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6zhr\" (UniqueName: \"kubernetes.io/projected/0ad6fc48-b614-4048-827f-290a2619a529-kube-api-access-z6zhr\") pod \"install-certs-edpm-multinodeset-edpm-compute-global-4ljhm\" (UID: \"0ad6fc48-b614-4048-827f-290a2619a529\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-global-4ljhm" Mar 16 17:21:25 crc kubenswrapper[5120]: I0316 17:21:25.960541 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"neutron-metadata-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0ad6fc48-b614-4048-827f-290a2619a529-neutron-metadata-combined-ca-bundle\") pod \"install-certs-edpm-multinodeset-edpm-compute-global-4ljhm\" (UID: \"0ad6fc48-b614-4048-827f-290a2619a529\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-global-4ljhm" Mar 16 17:21:25 crc kubenswrapper[5120]: I0316 17:21:25.960604 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"neutron-ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0ad6fc48-b614-4048-827f-290a2619a529-neutron-ovn-combined-ca-bundle\") pod \"install-certs-edpm-multinodeset-edpm-compute-global-4ljhm\" (UID: \"0ad6fc48-b614-4048-827f-290a2619a529\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-global-4ljhm" Mar 16 17:21:25 crc kubenswrapper[5120]: I0316 17:21:25.960680 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"neutron-sriov-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0ad6fc48-b614-4048-827f-290a2619a529-neutron-sriov-combined-ca-bundle\") pod \"install-certs-edpm-multinodeset-edpm-compute-global-4ljhm\" (UID: \"0ad6fc48-b614-4048-827f-290a2619a529\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-global-4ljhm" Mar 16 17:21:26 crc kubenswrapper[5120]: I0316 17:21:26.062825 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"neutron-sriov-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0ad6fc48-b614-4048-827f-290a2619a529-neutron-sriov-combined-ca-bundle\") pod \"install-certs-edpm-multinodeset-edpm-compute-global-4ljhm\" (UID: \"0ad6fc48-b614-4048-827f-290a2619a529\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-global-4ljhm" Mar 16 17:21:26 crc kubenswrapper[5120]: I0316 17:21:26.062995 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"neutron-dhcp-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0ad6fc48-b614-4048-827f-290a2619a529-neutron-dhcp-combined-ca-bundle\") pod \"install-certs-edpm-multinodeset-edpm-compute-global-4ljhm\" (UID: \"0ad6fc48-b614-4048-827f-290a2619a529\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-global-4ljhm" Mar 16 17:21:26 crc kubenswrapper[5120]: I0316 17:21:26.063083 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/0ad6fc48-b614-4048-827f-290a2619a529-ssh-key-edpm-compute-global\") pod \"install-certs-edpm-multinodeset-edpm-compute-global-4ljhm\" (UID: \"0ad6fc48-b614-4048-827f-290a2619a529\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-global-4ljhm" Mar 16 17:21:26 crc kubenswrapper[5120]: I0316 17:21:26.063129 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"libvirt-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0ad6fc48-b614-4048-827f-290a2619a529-libvirt-combined-ca-bundle\") pod \"install-certs-edpm-multinodeset-edpm-compute-global-4ljhm\" (UID: \"0ad6fc48-b614-4048-827f-290a2619a529\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-global-4ljhm" Mar 16 17:21:26 crc kubenswrapper[5120]: I0316 17:21:26.063173 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0ad6fc48-b614-4048-827f-290a2619a529-ovn-combined-ca-bundle\") pod \"install-certs-edpm-multinodeset-edpm-compute-global-4ljhm\" (UID: \"0ad6fc48-b614-4048-827f-290a2619a529\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-global-4ljhm" Mar 16 17:21:26 crc kubenswrapper[5120]: I0316 17:21:26.063258 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bootstrap-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0ad6fc48-b614-4048-827f-290a2619a529-bootstrap-combined-ca-bundle\") pod \"install-certs-edpm-multinodeset-edpm-compute-global-4ljhm\" (UID: \"0ad6fc48-b614-4048-827f-290a2619a529\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-global-4ljhm" Mar 16 17:21:26 crc kubenswrapper[5120]: I0316 17:21:26.063327 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/0ad6fc48-b614-4048-827f-290a2619a529-inventory\") pod \"install-certs-edpm-multinodeset-edpm-compute-global-4ljhm\" (UID: \"0ad6fc48-b614-4048-827f-290a2619a529\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-global-4ljhm" Mar 16 17:21:26 crc kubenswrapper[5120]: I0316 17:21:26.063379 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"custom-global-service-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0ad6fc48-b614-4048-827f-290a2619a529-custom-global-service-combined-ca-bundle\") pod \"install-certs-edpm-multinodeset-edpm-compute-global-4ljhm\" (UID: \"0ad6fc48-b614-4048-827f-290a2619a529\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-global-4ljhm" Mar 16 17:21:26 crc kubenswrapper[5120]: I0316 17:21:26.063532 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0ad6fc48-b614-4048-827f-290a2619a529-nova-combined-ca-bundle\") pod \"install-certs-edpm-multinodeset-edpm-compute-global-4ljhm\" (UID: \"0ad6fc48-b614-4048-827f-290a2619a529\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-global-4ljhm" Mar 16 17:21:26 crc kubenswrapper[5120]: I0316 17:21:26.064206 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z6zhr\" (UniqueName: \"kubernetes.io/projected/0ad6fc48-b614-4048-827f-290a2619a529-kube-api-access-z6zhr\") pod \"install-certs-edpm-multinodeset-edpm-compute-global-4ljhm\" (UID: \"0ad6fc48-b614-4048-827f-290a2619a529\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-global-4ljhm" Mar 16 17:21:26 crc kubenswrapper[5120]: I0316 17:21:26.064314 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"neutron-metadata-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0ad6fc48-b614-4048-827f-290a2619a529-neutron-metadata-combined-ca-bundle\") pod \"install-certs-edpm-multinodeset-edpm-compute-global-4ljhm\" (UID: \"0ad6fc48-b614-4048-827f-290a2619a529\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-global-4ljhm" Mar 16 17:21:26 crc kubenswrapper[5120]: I0316 17:21:26.064381 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"neutron-ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0ad6fc48-b614-4048-827f-290a2619a529-neutron-ovn-combined-ca-bundle\") pod \"install-certs-edpm-multinodeset-edpm-compute-global-4ljhm\" (UID: \"0ad6fc48-b614-4048-827f-290a2619a529\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-global-4ljhm" Mar 16 17:21:26 crc kubenswrapper[5120]: I0316 17:21:26.068610 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"neutron-sriov-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0ad6fc48-b614-4048-827f-290a2619a529-neutron-sriov-combined-ca-bundle\") pod \"install-certs-edpm-multinodeset-edpm-compute-global-4ljhm\" (UID: \"0ad6fc48-b614-4048-827f-290a2619a529\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-global-4ljhm" Mar 16 17:21:26 crc kubenswrapper[5120]: I0316 17:21:26.068631 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0ad6fc48-b614-4048-827f-290a2619a529-nova-combined-ca-bundle\") pod \"install-certs-edpm-multinodeset-edpm-compute-global-4ljhm\" (UID: \"0ad6fc48-b614-4048-827f-290a2619a529\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-global-4ljhm" Mar 16 17:21:26 crc kubenswrapper[5120]: I0316 17:21:26.068633 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0ad6fc48-b614-4048-827f-290a2619a529-ovn-combined-ca-bundle\") pod \"install-certs-edpm-multinodeset-edpm-compute-global-4ljhm\" (UID: \"0ad6fc48-b614-4048-827f-290a2619a529\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-global-4ljhm" Mar 16 17:21:26 crc kubenswrapper[5120]: I0316 17:21:26.068745 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"libvirt-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0ad6fc48-b614-4048-827f-290a2619a529-libvirt-combined-ca-bundle\") pod \"install-certs-edpm-multinodeset-edpm-compute-global-4ljhm\" (UID: \"0ad6fc48-b614-4048-827f-290a2619a529\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-global-4ljhm" Mar 16 17:21:26 crc kubenswrapper[5120]: I0316 17:21:26.068934 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"custom-global-service-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0ad6fc48-b614-4048-827f-290a2619a529-custom-global-service-combined-ca-bundle\") pod \"install-certs-edpm-multinodeset-edpm-compute-global-4ljhm\" (UID: \"0ad6fc48-b614-4048-827f-290a2619a529\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-global-4ljhm" Mar 16 17:21:26 crc kubenswrapper[5120]: I0316 17:21:26.069078 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/0ad6fc48-b614-4048-827f-290a2619a529-inventory\") pod \"install-certs-edpm-multinodeset-edpm-compute-global-4ljhm\" (UID: \"0ad6fc48-b614-4048-827f-290a2619a529\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-global-4ljhm" Mar 16 17:21:26 crc kubenswrapper[5120]: I0316 17:21:26.069651 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bootstrap-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0ad6fc48-b614-4048-827f-290a2619a529-bootstrap-combined-ca-bundle\") pod \"install-certs-edpm-multinodeset-edpm-compute-global-4ljhm\" (UID: \"0ad6fc48-b614-4048-827f-290a2619a529\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-global-4ljhm" Mar 16 17:21:26 crc kubenswrapper[5120]: I0316 17:21:26.070159 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"neutron-metadata-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0ad6fc48-b614-4048-827f-290a2619a529-neutron-metadata-combined-ca-bundle\") pod \"install-certs-edpm-multinodeset-edpm-compute-global-4ljhm\" (UID: \"0ad6fc48-b614-4048-827f-290a2619a529\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-global-4ljhm" Mar 16 17:21:26 crc kubenswrapper[5120]: I0316 17:21:26.070582 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"neutron-dhcp-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0ad6fc48-b614-4048-827f-290a2619a529-neutron-dhcp-combined-ca-bundle\") pod \"install-certs-edpm-multinodeset-edpm-compute-global-4ljhm\" (UID: \"0ad6fc48-b614-4048-827f-290a2619a529\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-global-4ljhm" Mar 16 17:21:26 crc kubenswrapper[5120]: I0316 17:21:26.071266 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/0ad6fc48-b614-4048-827f-290a2619a529-ssh-key-edpm-compute-global\") pod \"install-certs-edpm-multinodeset-edpm-compute-global-4ljhm\" (UID: \"0ad6fc48-b614-4048-827f-290a2619a529\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-global-4ljhm" Mar 16 17:21:26 crc kubenswrapper[5120]: I0316 17:21:26.081999 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"neutron-ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0ad6fc48-b614-4048-827f-290a2619a529-neutron-ovn-combined-ca-bundle\") pod \"install-certs-edpm-multinodeset-edpm-compute-global-4ljhm\" (UID: \"0ad6fc48-b614-4048-827f-290a2619a529\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-global-4ljhm" Mar 16 17:21:26 crc kubenswrapper[5120]: I0316 17:21:26.084907 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6zhr\" (UniqueName: \"kubernetes.io/projected/0ad6fc48-b614-4048-827f-290a2619a529-kube-api-access-z6zhr\") pod \"install-certs-edpm-multinodeset-edpm-compute-global-4ljhm\" (UID: \"0ad6fc48-b614-4048-827f-290a2619a529\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-global-4ljhm" Mar 16 17:21:26 crc kubenswrapper[5120]: I0316 17:21:26.174030 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-global-4ljhm" Mar 16 17:21:26 crc kubenswrapper[5120]: I0316 17:21:26.590494 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-global-4ljhm"] Mar 16 17:21:26 crc kubenswrapper[5120]: W0316 17:21:26.593838 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0ad6fc48_b614_4048_827f_290a2619a529.slice/crio-7f21ad7335ec0217c66ca58fc54483a9cf289dffc6b1a2ece4b31b1c4c681463 WatchSource:0}: Error finding container 7f21ad7335ec0217c66ca58fc54483a9cf289dffc6b1a2ece4b31b1c4c681463: Status 404 returned error can't find the container with id 7f21ad7335ec0217c66ca58fc54483a9cf289dffc6b1a2ece4b31b1c4c681463 Mar 16 17:21:26 crc kubenswrapper[5120]: I0316 17:21:26.785682 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-global-4ljhm" event={"ID":"0ad6fc48-b614-4048-827f-290a2619a529","Type":"ContainerStarted","Data":"7f21ad7335ec0217c66ca58fc54483a9cf289dffc6b1a2ece4b31b1c4c681463"} Mar 16 17:21:27 crc kubenswrapper[5120]: I0316 17:21:27.827822 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-global-4ljhm" event={"ID":"0ad6fc48-b614-4048-827f-290a2619a529","Type":"ContainerStarted","Data":"674d349a28c45bd02784bcd00686851848aac5d3acb8478415b002ed71f9c072"} Mar 16 17:21:27 crc kubenswrapper[5120]: I0316 17:21:27.855526 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-global-4ljhm" podStartSLOduration=2.4514477230000002 podStartE2EDuration="2.855498924s" podCreationTimestamp="2026-03-16 17:21:25 +0000 UTC" firstStartedPulling="2026-03-16 17:21:26.595399101 +0000 UTC m=+6588.749330758" lastFinishedPulling="2026-03-16 17:21:26.999450301 +0000 UTC m=+6589.153381959" observedRunningTime="2026-03-16 17:21:27.846454636 +0000 UTC m=+6590.000386303" watchObservedRunningTime="2026-03-16 17:21:27.855498924 +0000 UTC m=+6590.009430591" Mar 16 17:21:28 crc kubenswrapper[5120]: I0316 17:21:28.839578 5120 generic.go:358] "Generic (PLEG): container finished" podID="0ad6fc48-b614-4048-827f-290a2619a529" containerID="674d349a28c45bd02784bcd00686851848aac5d3acb8478415b002ed71f9c072" exitCode=0 Mar 16 17:21:28 crc kubenswrapper[5120]: I0316 17:21:28.839658 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-global-4ljhm" event={"ID":"0ad6fc48-b614-4048-827f-290a2619a529","Type":"ContainerDied","Data":"674d349a28c45bd02784bcd00686851848aac5d3acb8478415b002ed71f9c072"} Mar 16 17:21:30 crc kubenswrapper[5120]: I0316 17:21:30.140895 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-global-4ljhm" Mar 16 17:21:30 crc kubenswrapper[5120]: I0316 17:21:30.162885 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/0ad6fc48-b614-4048-827f-290a2619a529-inventory\") pod \"0ad6fc48-b614-4048-827f-290a2619a529\" (UID: \"0ad6fc48-b614-4048-827f-290a2619a529\") " Mar 16 17:21:30 crc kubenswrapper[5120]: I0316 17:21:30.162969 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/0ad6fc48-b614-4048-827f-290a2619a529-ssh-key-edpm-compute-global\") pod \"0ad6fc48-b614-4048-827f-290a2619a529\" (UID: \"0ad6fc48-b614-4048-827f-290a2619a529\") " Mar 16 17:21:30 crc kubenswrapper[5120]: I0316 17:21:30.163004 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0ad6fc48-b614-4048-827f-290a2619a529-ovn-combined-ca-bundle\") pod \"0ad6fc48-b614-4048-827f-290a2619a529\" (UID: \"0ad6fc48-b614-4048-827f-290a2619a529\") " Mar 16 17:21:30 crc kubenswrapper[5120]: I0316 17:21:30.163073 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"libvirt-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0ad6fc48-b614-4048-827f-290a2619a529-libvirt-combined-ca-bundle\") pod \"0ad6fc48-b614-4048-827f-290a2619a529\" (UID: \"0ad6fc48-b614-4048-827f-290a2619a529\") " Mar 16 17:21:30 crc kubenswrapper[5120]: I0316 17:21:30.163132 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bootstrap-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0ad6fc48-b614-4048-827f-290a2619a529-bootstrap-combined-ca-bundle\") pod \"0ad6fc48-b614-4048-827f-290a2619a529\" (UID: \"0ad6fc48-b614-4048-827f-290a2619a529\") " Mar 16 17:21:30 crc kubenswrapper[5120]: I0316 17:21:30.163156 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"neutron-dhcp-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0ad6fc48-b614-4048-827f-290a2619a529-neutron-dhcp-combined-ca-bundle\") pod \"0ad6fc48-b614-4048-827f-290a2619a529\" (UID: \"0ad6fc48-b614-4048-827f-290a2619a529\") " Mar 16 17:21:30 crc kubenswrapper[5120]: I0316 17:21:30.163515 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"neutron-ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0ad6fc48-b614-4048-827f-290a2619a529-neutron-ovn-combined-ca-bundle\") pod \"0ad6fc48-b614-4048-827f-290a2619a529\" (UID: \"0ad6fc48-b614-4048-827f-290a2619a529\") " Mar 16 17:21:30 crc kubenswrapper[5120]: I0316 17:21:30.163719 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"custom-global-service-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0ad6fc48-b614-4048-827f-290a2619a529-custom-global-service-combined-ca-bundle\") pod \"0ad6fc48-b614-4048-827f-290a2619a529\" (UID: \"0ad6fc48-b614-4048-827f-290a2619a529\") " Mar 16 17:21:30 crc kubenswrapper[5120]: I0316 17:21:30.164034 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z6zhr\" (UniqueName: \"kubernetes.io/projected/0ad6fc48-b614-4048-827f-290a2619a529-kube-api-access-z6zhr\") pod \"0ad6fc48-b614-4048-827f-290a2619a529\" (UID: \"0ad6fc48-b614-4048-827f-290a2619a529\") " Mar 16 17:21:30 crc kubenswrapper[5120]: I0316 17:21:30.164244 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"neutron-metadata-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0ad6fc48-b614-4048-827f-290a2619a529-neutron-metadata-combined-ca-bundle\") pod \"0ad6fc48-b614-4048-827f-290a2619a529\" (UID: \"0ad6fc48-b614-4048-827f-290a2619a529\") " Mar 16 17:21:30 crc kubenswrapper[5120]: I0316 17:21:30.164392 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"neutron-sriov-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0ad6fc48-b614-4048-827f-290a2619a529-neutron-sriov-combined-ca-bundle\") pod \"0ad6fc48-b614-4048-827f-290a2619a529\" (UID: \"0ad6fc48-b614-4048-827f-290a2619a529\") " Mar 16 17:21:30 crc kubenswrapper[5120]: I0316 17:21:30.164446 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0ad6fc48-b614-4048-827f-290a2619a529-nova-combined-ca-bundle\") pod \"0ad6fc48-b614-4048-827f-290a2619a529\" (UID: \"0ad6fc48-b614-4048-827f-290a2619a529\") " Mar 16 17:21:30 crc kubenswrapper[5120]: I0316 17:21:30.173708 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ad6fc48-b614-4048-827f-290a2619a529-neutron-sriov-combined-ca-bundle" (OuterVolumeSpecName: "neutron-sriov-combined-ca-bundle") pod "0ad6fc48-b614-4048-827f-290a2619a529" (UID: "0ad6fc48-b614-4048-827f-290a2619a529"). InnerVolumeSpecName "neutron-sriov-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:21:30 crc kubenswrapper[5120]: I0316 17:21:30.173775 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ad6fc48-b614-4048-827f-290a2619a529-kube-api-access-z6zhr" (OuterVolumeSpecName: "kube-api-access-z6zhr") pod "0ad6fc48-b614-4048-827f-290a2619a529" (UID: "0ad6fc48-b614-4048-827f-290a2619a529"). InnerVolumeSpecName "kube-api-access-z6zhr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:21:30 crc kubenswrapper[5120]: I0316 17:21:30.173904 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ad6fc48-b614-4048-827f-290a2619a529-ovn-combined-ca-bundle" (OuterVolumeSpecName: "ovn-combined-ca-bundle") pod "0ad6fc48-b614-4048-827f-290a2619a529" (UID: "0ad6fc48-b614-4048-827f-290a2619a529"). InnerVolumeSpecName "ovn-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:21:30 crc kubenswrapper[5120]: I0316 17:21:30.173896 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ad6fc48-b614-4048-827f-290a2619a529-nova-combined-ca-bundle" (OuterVolumeSpecName: "nova-combined-ca-bundle") pod "0ad6fc48-b614-4048-827f-290a2619a529" (UID: "0ad6fc48-b614-4048-827f-290a2619a529"). InnerVolumeSpecName "nova-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:21:30 crc kubenswrapper[5120]: I0316 17:21:30.173925 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ad6fc48-b614-4048-827f-290a2619a529-neutron-ovn-combined-ca-bundle" (OuterVolumeSpecName: "neutron-ovn-combined-ca-bundle") pod "0ad6fc48-b614-4048-827f-290a2619a529" (UID: "0ad6fc48-b614-4048-827f-290a2619a529"). InnerVolumeSpecName "neutron-ovn-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:21:30 crc kubenswrapper[5120]: I0316 17:21:30.173973 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ad6fc48-b614-4048-827f-290a2619a529-libvirt-combined-ca-bundle" (OuterVolumeSpecName: "libvirt-combined-ca-bundle") pod "0ad6fc48-b614-4048-827f-290a2619a529" (UID: "0ad6fc48-b614-4048-827f-290a2619a529"). InnerVolumeSpecName "libvirt-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:21:30 crc kubenswrapper[5120]: I0316 17:21:30.174038 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ad6fc48-b614-4048-827f-290a2619a529-neutron-metadata-combined-ca-bundle" (OuterVolumeSpecName: "neutron-metadata-combined-ca-bundle") pod "0ad6fc48-b614-4048-827f-290a2619a529" (UID: "0ad6fc48-b614-4048-827f-290a2619a529"). InnerVolumeSpecName "neutron-metadata-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:21:30 crc kubenswrapper[5120]: I0316 17:21:30.174090 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ad6fc48-b614-4048-827f-290a2619a529-neutron-dhcp-combined-ca-bundle" (OuterVolumeSpecName: "neutron-dhcp-combined-ca-bundle") pod "0ad6fc48-b614-4048-827f-290a2619a529" (UID: "0ad6fc48-b614-4048-827f-290a2619a529"). InnerVolumeSpecName "neutron-dhcp-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:21:30 crc kubenswrapper[5120]: I0316 17:21:30.176203 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ad6fc48-b614-4048-827f-290a2619a529-custom-global-service-combined-ca-bundle" (OuterVolumeSpecName: "custom-global-service-combined-ca-bundle") pod "0ad6fc48-b614-4048-827f-290a2619a529" (UID: "0ad6fc48-b614-4048-827f-290a2619a529"). InnerVolumeSpecName "custom-global-service-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:21:30 crc kubenswrapper[5120]: I0316 17:21:30.182502 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ad6fc48-b614-4048-827f-290a2619a529-bootstrap-combined-ca-bundle" (OuterVolumeSpecName: "bootstrap-combined-ca-bundle") pod "0ad6fc48-b614-4048-827f-290a2619a529" (UID: "0ad6fc48-b614-4048-827f-290a2619a529"). InnerVolumeSpecName "bootstrap-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:21:30 crc kubenswrapper[5120]: I0316 17:21:30.187929 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ad6fc48-b614-4048-827f-290a2619a529-ssh-key-edpm-compute-global" (OuterVolumeSpecName: "ssh-key-edpm-compute-global") pod "0ad6fc48-b614-4048-827f-290a2619a529" (UID: "0ad6fc48-b614-4048-827f-290a2619a529"). InnerVolumeSpecName "ssh-key-edpm-compute-global". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:21:30 crc kubenswrapper[5120]: I0316 17:21:30.202666 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ad6fc48-b614-4048-827f-290a2619a529-inventory" (OuterVolumeSpecName: "inventory") pod "0ad6fc48-b614-4048-827f-290a2619a529" (UID: "0ad6fc48-b614-4048-827f-290a2619a529"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:21:30 crc kubenswrapper[5120]: I0316 17:21:30.267891 5120 reconciler_common.go:299] "Volume detached for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/0ad6fc48-b614-4048-827f-290a2619a529-ssh-key-edpm-compute-global\") on node \"crc\" DevicePath \"\"" Mar 16 17:21:30 crc kubenswrapper[5120]: I0316 17:21:30.267942 5120 reconciler_common.go:299] "Volume detached for volume \"ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0ad6fc48-b614-4048-827f-290a2619a529-ovn-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:21:30 crc kubenswrapper[5120]: I0316 17:21:30.267954 5120 reconciler_common.go:299] "Volume detached for volume \"libvirt-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0ad6fc48-b614-4048-827f-290a2619a529-libvirt-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:21:30 crc kubenswrapper[5120]: I0316 17:21:30.267965 5120 reconciler_common.go:299] "Volume detached for volume \"bootstrap-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0ad6fc48-b614-4048-827f-290a2619a529-bootstrap-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:21:30 crc kubenswrapper[5120]: I0316 17:21:30.267975 5120 reconciler_common.go:299] "Volume detached for volume \"neutron-dhcp-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0ad6fc48-b614-4048-827f-290a2619a529-neutron-dhcp-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:21:30 crc kubenswrapper[5120]: I0316 17:21:30.267987 5120 reconciler_common.go:299] "Volume detached for volume \"neutron-ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0ad6fc48-b614-4048-827f-290a2619a529-neutron-ovn-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:21:30 crc kubenswrapper[5120]: I0316 17:21:30.267997 5120 reconciler_common.go:299] "Volume detached for volume \"custom-global-service-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0ad6fc48-b614-4048-827f-290a2619a529-custom-global-service-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:21:30 crc kubenswrapper[5120]: I0316 17:21:30.268008 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z6zhr\" (UniqueName: \"kubernetes.io/projected/0ad6fc48-b614-4048-827f-290a2619a529-kube-api-access-z6zhr\") on node \"crc\" DevicePath \"\"" Mar 16 17:21:30 crc kubenswrapper[5120]: I0316 17:21:30.268019 5120 reconciler_common.go:299] "Volume detached for volume \"neutron-metadata-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0ad6fc48-b614-4048-827f-290a2619a529-neutron-metadata-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:21:30 crc kubenswrapper[5120]: I0316 17:21:30.268029 5120 reconciler_common.go:299] "Volume detached for volume \"neutron-sriov-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0ad6fc48-b614-4048-827f-290a2619a529-neutron-sriov-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:21:30 crc kubenswrapper[5120]: I0316 17:21:30.268039 5120 reconciler_common.go:299] "Volume detached for volume \"nova-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0ad6fc48-b614-4048-827f-290a2619a529-nova-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:21:30 crc kubenswrapper[5120]: I0316 17:21:30.268052 5120 reconciler_common.go:299] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/0ad6fc48-b614-4048-827f-290a2619a529-inventory\") on node \"crc\" DevicePath \"\"" Mar 16 17:21:30 crc kubenswrapper[5120]: I0316 17:21:30.863874 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-global-4ljhm" Mar 16 17:21:30 crc kubenswrapper[5120]: I0316 17:21:30.863921 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-global-4ljhm" event={"ID":"0ad6fc48-b614-4048-827f-290a2619a529","Type":"ContainerDied","Data":"7f21ad7335ec0217c66ca58fc54483a9cf289dffc6b1a2ece4b31b1c4c681463"} Mar 16 17:21:30 crc kubenswrapper[5120]: I0316 17:21:30.864504 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7f21ad7335ec0217c66ca58fc54483a9cf289dffc6b1a2ece4b31b1c4c681463" Mar 16 17:21:30 crc kubenswrapper[5120]: I0316 17:21:30.950582 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovn-edpm-multinodeset-edpm-compute-global-xmb42"] Mar 16 17:21:30 crc kubenswrapper[5120]: I0316 17:21:30.951592 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ad6fc48-b614-4048-827f-290a2619a529" containerName="install-certs-edpm-multinodeset-edpm-compute-global" Mar 16 17:21:30 crc kubenswrapper[5120]: I0316 17:21:30.951614 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ad6fc48-b614-4048-827f-290a2619a529" containerName="install-certs-edpm-multinodeset-edpm-compute-global" Mar 16 17:21:30 crc kubenswrapper[5120]: I0316 17:21:30.951750 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="0ad6fc48-b614-4048-827f-290a2619a529" containerName="install-certs-edpm-multinodeset-edpm-compute-global" Mar 16 17:21:30 crc kubenswrapper[5120]: I0316 17:21:30.959736 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-edpm-multinodeset-edpm-compute-global-xmb42" Mar 16 17:21:30 crc kubenswrapper[5120]: I0316 17:21:30.967913 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"combined-ca-bundle\"" Mar 16 17:21:30 crc kubenswrapper[5120]: I0316 17:21:30.967913 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplanenodeset-edpm-compute-global\"" Mar 16 17:21:30 crc kubenswrapper[5120]: I0316 17:21:30.967961 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-aee-default-env\"" Mar 16 17:21:30 crc kubenswrapper[5120]: I0316 17:21:30.967995 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"edpm-compute-global-dockercfg-5hp85\"" Mar 16 17:21:30 crc kubenswrapper[5120]: I0316 17:21:30.968024 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovncontroller-config\"" Mar 16 17:21:30 crc kubenswrapper[5120]: I0316 17:21:30.968051 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplane-ansible-ssh-private-key-secret\"" Mar 16 17:21:30 crc kubenswrapper[5120]: I0316 17:21:30.969417 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-edpm-multinodeset-edpm-compute-global-xmb42"] Mar 16 17:21:30 crc kubenswrapper[5120]: I0316 17:21:30.986176 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8cdaa1ac-bac8-41a4-b2c0-4d90c52ac825-ovn-combined-ca-bundle\") pod \"ovn-edpm-multinodeset-edpm-compute-global-xmb42\" (UID: \"8cdaa1ac-bac8-41a4-b2c0-4d90c52ac825\") " pod="openstack-kuttl-tests/ovn-edpm-multinodeset-edpm-compute-global-xmb42" Mar 16 17:21:30 crc kubenswrapper[5120]: I0316 17:21:30.986604 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/8cdaa1ac-bac8-41a4-b2c0-4d90c52ac825-ssh-key-edpm-compute-global\") pod \"ovn-edpm-multinodeset-edpm-compute-global-xmb42\" (UID: \"8cdaa1ac-bac8-41a4-b2c0-4d90c52ac825\") " pod="openstack-kuttl-tests/ovn-edpm-multinodeset-edpm-compute-global-xmb42" Mar 16 17:21:30 crc kubenswrapper[5120]: I0316 17:21:30.986911 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxfft\" (UniqueName: \"kubernetes.io/projected/8cdaa1ac-bac8-41a4-b2c0-4d90c52ac825-kube-api-access-qxfft\") pod \"ovn-edpm-multinodeset-edpm-compute-global-xmb42\" (UID: \"8cdaa1ac-bac8-41a4-b2c0-4d90c52ac825\") " pod="openstack-kuttl-tests/ovn-edpm-multinodeset-edpm-compute-global-xmb42" Mar 16 17:21:30 crc kubenswrapper[5120]: I0316 17:21:30.987955 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovncontroller-config-0\" (UniqueName: \"kubernetes.io/configmap/8cdaa1ac-bac8-41a4-b2c0-4d90c52ac825-ovncontroller-config-0\") pod \"ovn-edpm-multinodeset-edpm-compute-global-xmb42\" (UID: \"8cdaa1ac-bac8-41a4-b2c0-4d90c52ac825\") " pod="openstack-kuttl-tests/ovn-edpm-multinodeset-edpm-compute-global-xmb42" Mar 16 17:21:30 crc kubenswrapper[5120]: I0316 17:21:30.988058 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/8cdaa1ac-bac8-41a4-b2c0-4d90c52ac825-inventory\") pod \"ovn-edpm-multinodeset-edpm-compute-global-xmb42\" (UID: \"8cdaa1ac-bac8-41a4-b2c0-4d90c52ac825\") " pod="openstack-kuttl-tests/ovn-edpm-multinodeset-edpm-compute-global-xmb42" Mar 16 17:21:31 crc kubenswrapper[5120]: I0316 17:21:31.090030 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/8cdaa1ac-bac8-41a4-b2c0-4d90c52ac825-ssh-key-edpm-compute-global\") pod \"ovn-edpm-multinodeset-edpm-compute-global-xmb42\" (UID: \"8cdaa1ac-bac8-41a4-b2c0-4d90c52ac825\") " pod="openstack-kuttl-tests/ovn-edpm-multinodeset-edpm-compute-global-xmb42" Mar 16 17:21:31 crc kubenswrapper[5120]: I0316 17:21:31.090515 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qxfft\" (UniqueName: \"kubernetes.io/projected/8cdaa1ac-bac8-41a4-b2c0-4d90c52ac825-kube-api-access-qxfft\") pod \"ovn-edpm-multinodeset-edpm-compute-global-xmb42\" (UID: \"8cdaa1ac-bac8-41a4-b2c0-4d90c52ac825\") " pod="openstack-kuttl-tests/ovn-edpm-multinodeset-edpm-compute-global-xmb42" Mar 16 17:21:31 crc kubenswrapper[5120]: I0316 17:21:31.090664 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovncontroller-config-0\" (UniqueName: \"kubernetes.io/configmap/8cdaa1ac-bac8-41a4-b2c0-4d90c52ac825-ovncontroller-config-0\") pod \"ovn-edpm-multinodeset-edpm-compute-global-xmb42\" (UID: \"8cdaa1ac-bac8-41a4-b2c0-4d90c52ac825\") " pod="openstack-kuttl-tests/ovn-edpm-multinodeset-edpm-compute-global-xmb42" Mar 16 17:21:31 crc kubenswrapper[5120]: I0316 17:21:31.091183 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/8cdaa1ac-bac8-41a4-b2c0-4d90c52ac825-inventory\") pod \"ovn-edpm-multinodeset-edpm-compute-global-xmb42\" (UID: \"8cdaa1ac-bac8-41a4-b2c0-4d90c52ac825\") " pod="openstack-kuttl-tests/ovn-edpm-multinodeset-edpm-compute-global-xmb42" Mar 16 17:21:31 crc kubenswrapper[5120]: I0316 17:21:31.091504 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8cdaa1ac-bac8-41a4-b2c0-4d90c52ac825-ovn-combined-ca-bundle\") pod \"ovn-edpm-multinodeset-edpm-compute-global-xmb42\" (UID: \"8cdaa1ac-bac8-41a4-b2c0-4d90c52ac825\") " pod="openstack-kuttl-tests/ovn-edpm-multinodeset-edpm-compute-global-xmb42" Mar 16 17:21:31 crc kubenswrapper[5120]: I0316 17:21:31.091528 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovncontroller-config-0\" (UniqueName: \"kubernetes.io/configmap/8cdaa1ac-bac8-41a4-b2c0-4d90c52ac825-ovncontroller-config-0\") pod \"ovn-edpm-multinodeset-edpm-compute-global-xmb42\" (UID: \"8cdaa1ac-bac8-41a4-b2c0-4d90c52ac825\") " pod="openstack-kuttl-tests/ovn-edpm-multinodeset-edpm-compute-global-xmb42" Mar 16 17:21:31 crc kubenswrapper[5120]: I0316 17:21:31.094957 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/8cdaa1ac-bac8-41a4-b2c0-4d90c52ac825-inventory\") pod \"ovn-edpm-multinodeset-edpm-compute-global-xmb42\" (UID: \"8cdaa1ac-bac8-41a4-b2c0-4d90c52ac825\") " pod="openstack-kuttl-tests/ovn-edpm-multinodeset-edpm-compute-global-xmb42" Mar 16 17:21:31 crc kubenswrapper[5120]: I0316 17:21:31.098407 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/8cdaa1ac-bac8-41a4-b2c0-4d90c52ac825-ssh-key-edpm-compute-global\") pod \"ovn-edpm-multinodeset-edpm-compute-global-xmb42\" (UID: \"8cdaa1ac-bac8-41a4-b2c0-4d90c52ac825\") " pod="openstack-kuttl-tests/ovn-edpm-multinodeset-edpm-compute-global-xmb42" Mar 16 17:21:31 crc kubenswrapper[5120]: I0316 17:21:31.098841 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8cdaa1ac-bac8-41a4-b2c0-4d90c52ac825-ovn-combined-ca-bundle\") pod \"ovn-edpm-multinodeset-edpm-compute-global-xmb42\" (UID: \"8cdaa1ac-bac8-41a4-b2c0-4d90c52ac825\") " pod="openstack-kuttl-tests/ovn-edpm-multinodeset-edpm-compute-global-xmb42" Mar 16 17:21:31 crc kubenswrapper[5120]: I0316 17:21:31.107752 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxfft\" (UniqueName: \"kubernetes.io/projected/8cdaa1ac-bac8-41a4-b2c0-4d90c52ac825-kube-api-access-qxfft\") pod \"ovn-edpm-multinodeset-edpm-compute-global-xmb42\" (UID: \"8cdaa1ac-bac8-41a4-b2c0-4d90c52ac825\") " pod="openstack-kuttl-tests/ovn-edpm-multinodeset-edpm-compute-global-xmb42" Mar 16 17:21:31 crc kubenswrapper[5120]: I0316 17:21:31.279176 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-edpm-multinodeset-edpm-compute-global-xmb42" Mar 16 17:21:31 crc kubenswrapper[5120]: I0316 17:21:31.733869 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-edpm-multinodeset-edpm-compute-global-xmb42"] Mar 16 17:21:31 crc kubenswrapper[5120]: I0316 17:21:31.874770 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-edpm-multinodeset-edpm-compute-global-xmb42" event={"ID":"8cdaa1ac-bac8-41a4-b2c0-4d90c52ac825","Type":"ContainerStarted","Data":"1450d495a024a4a14a732508cca038ef66f8913496d8a43ac6cadadd7a6d76d7"} Mar 16 17:21:32 crc kubenswrapper[5120]: I0316 17:21:32.884970 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-edpm-multinodeset-edpm-compute-global-xmb42" event={"ID":"8cdaa1ac-bac8-41a4-b2c0-4d90c52ac825","Type":"ContainerStarted","Data":"9cb4860743540aae5afaeff4177d035e2ec8c5ca38d5b7a3743c90e19ffb3ba0"} Mar 16 17:21:32 crc kubenswrapper[5120]: I0316 17:21:32.900712 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovn-edpm-multinodeset-edpm-compute-global-xmb42" podStartSLOduration=2.525851301 podStartE2EDuration="2.900683824s" podCreationTimestamp="2026-03-16 17:21:30 +0000 UTC" firstStartedPulling="2026-03-16 17:21:31.737678874 +0000 UTC m=+6593.891610531" lastFinishedPulling="2026-03-16 17:21:32.112511387 +0000 UTC m=+6594.266443054" observedRunningTime="2026-03-16 17:21:32.89838454 +0000 UTC m=+6595.052316217" watchObservedRunningTime="2026-03-16 17:21:32.900683824 +0000 UTC m=+6595.054615471" Mar 16 17:21:33 crc kubenswrapper[5120]: I0316 17:21:33.665105 5120 scope.go:117] "RemoveContainer" containerID="2ca61165dca6fdb30458423ef74c44c42b1b273e8fa504e89f5f9e186e516cc3" Mar 16 17:21:33 crc kubenswrapper[5120]: E0316 17:21:33.665301 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 17:21:33 crc kubenswrapper[5120]: I0316 17:21:33.894391 5120 generic.go:358] "Generic (PLEG): container finished" podID="8cdaa1ac-bac8-41a4-b2c0-4d90c52ac825" containerID="9cb4860743540aae5afaeff4177d035e2ec8c5ca38d5b7a3743c90e19ffb3ba0" exitCode=0 Mar 16 17:21:33 crc kubenswrapper[5120]: I0316 17:21:33.894476 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-edpm-multinodeset-edpm-compute-global-xmb42" event={"ID":"8cdaa1ac-bac8-41a4-b2c0-4d90c52ac825","Type":"ContainerDied","Data":"9cb4860743540aae5afaeff4177d035e2ec8c5ca38d5b7a3743c90e19ffb3ba0"} Mar 16 17:21:35 crc kubenswrapper[5120]: I0316 17:21:35.178732 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-edpm-multinodeset-edpm-compute-global-xmb42" Mar 16 17:21:35 crc kubenswrapper[5120]: I0316 17:21:35.284600 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qxfft\" (UniqueName: \"kubernetes.io/projected/8cdaa1ac-bac8-41a4-b2c0-4d90c52ac825-kube-api-access-qxfft\") pod \"8cdaa1ac-bac8-41a4-b2c0-4d90c52ac825\" (UID: \"8cdaa1ac-bac8-41a4-b2c0-4d90c52ac825\") " Mar 16 17:21:35 crc kubenswrapper[5120]: I0316 17:21:35.284725 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8cdaa1ac-bac8-41a4-b2c0-4d90c52ac825-ovn-combined-ca-bundle\") pod \"8cdaa1ac-bac8-41a4-b2c0-4d90c52ac825\" (UID: \"8cdaa1ac-bac8-41a4-b2c0-4d90c52ac825\") " Mar 16 17:21:35 crc kubenswrapper[5120]: I0316 17:21:35.285902 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/8cdaa1ac-bac8-41a4-b2c0-4d90c52ac825-ssh-key-edpm-compute-global\") pod \"8cdaa1ac-bac8-41a4-b2c0-4d90c52ac825\" (UID: \"8cdaa1ac-bac8-41a4-b2c0-4d90c52ac825\") " Mar 16 17:21:35 crc kubenswrapper[5120]: I0316 17:21:35.286006 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/8cdaa1ac-bac8-41a4-b2c0-4d90c52ac825-inventory\") pod \"8cdaa1ac-bac8-41a4-b2c0-4d90c52ac825\" (UID: \"8cdaa1ac-bac8-41a4-b2c0-4d90c52ac825\") " Mar 16 17:21:35 crc kubenswrapper[5120]: I0316 17:21:35.286262 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovncontroller-config-0\" (UniqueName: \"kubernetes.io/configmap/8cdaa1ac-bac8-41a4-b2c0-4d90c52ac825-ovncontroller-config-0\") pod \"8cdaa1ac-bac8-41a4-b2c0-4d90c52ac825\" (UID: \"8cdaa1ac-bac8-41a4-b2c0-4d90c52ac825\") " Mar 16 17:21:35 crc kubenswrapper[5120]: I0316 17:21:35.292197 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8cdaa1ac-bac8-41a4-b2c0-4d90c52ac825-kube-api-access-qxfft" (OuterVolumeSpecName: "kube-api-access-qxfft") pod "8cdaa1ac-bac8-41a4-b2c0-4d90c52ac825" (UID: "8cdaa1ac-bac8-41a4-b2c0-4d90c52ac825"). InnerVolumeSpecName "kube-api-access-qxfft". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:21:35 crc kubenswrapper[5120]: I0316 17:21:35.293622 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8cdaa1ac-bac8-41a4-b2c0-4d90c52ac825-ovn-combined-ca-bundle" (OuterVolumeSpecName: "ovn-combined-ca-bundle") pod "8cdaa1ac-bac8-41a4-b2c0-4d90c52ac825" (UID: "8cdaa1ac-bac8-41a4-b2c0-4d90c52ac825"). InnerVolumeSpecName "ovn-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:21:35 crc kubenswrapper[5120]: I0316 17:21:35.306436 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8cdaa1ac-bac8-41a4-b2c0-4d90c52ac825-ovncontroller-config-0" (OuterVolumeSpecName: "ovncontroller-config-0") pod "8cdaa1ac-bac8-41a4-b2c0-4d90c52ac825" (UID: "8cdaa1ac-bac8-41a4-b2c0-4d90c52ac825"). InnerVolumeSpecName "ovncontroller-config-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:21:35 crc kubenswrapper[5120]: I0316 17:21:35.311682 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8cdaa1ac-bac8-41a4-b2c0-4d90c52ac825-ssh-key-edpm-compute-global" (OuterVolumeSpecName: "ssh-key-edpm-compute-global") pod "8cdaa1ac-bac8-41a4-b2c0-4d90c52ac825" (UID: "8cdaa1ac-bac8-41a4-b2c0-4d90c52ac825"). InnerVolumeSpecName "ssh-key-edpm-compute-global". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:21:35 crc kubenswrapper[5120]: I0316 17:21:35.315453 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8cdaa1ac-bac8-41a4-b2c0-4d90c52ac825-inventory" (OuterVolumeSpecName: "inventory") pod "8cdaa1ac-bac8-41a4-b2c0-4d90c52ac825" (UID: "8cdaa1ac-bac8-41a4-b2c0-4d90c52ac825"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:21:35 crc kubenswrapper[5120]: I0316 17:21:35.390213 5120 reconciler_common.go:299] "Volume detached for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/8cdaa1ac-bac8-41a4-b2c0-4d90c52ac825-ssh-key-edpm-compute-global\") on node \"crc\" DevicePath \"\"" Mar 16 17:21:35 crc kubenswrapper[5120]: I0316 17:21:35.390252 5120 reconciler_common.go:299] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/8cdaa1ac-bac8-41a4-b2c0-4d90c52ac825-inventory\") on node \"crc\" DevicePath \"\"" Mar 16 17:21:35 crc kubenswrapper[5120]: I0316 17:21:35.390262 5120 reconciler_common.go:299] "Volume detached for volume \"ovncontroller-config-0\" (UniqueName: \"kubernetes.io/configmap/8cdaa1ac-bac8-41a4-b2c0-4d90c52ac825-ovncontroller-config-0\") on node \"crc\" DevicePath \"\"" Mar 16 17:21:35 crc kubenswrapper[5120]: I0316 17:21:35.390272 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qxfft\" (UniqueName: \"kubernetes.io/projected/8cdaa1ac-bac8-41a4-b2c0-4d90c52ac825-kube-api-access-qxfft\") on node \"crc\" DevicePath \"\"" Mar 16 17:21:35 crc kubenswrapper[5120]: I0316 17:21:35.390284 5120 reconciler_common.go:299] "Volume detached for volume \"ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8cdaa1ac-bac8-41a4-b2c0-4d90c52ac825-ovn-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:21:35 crc kubenswrapper[5120]: I0316 17:21:35.916380 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-edpm-multinodeset-edpm-compute-global-xmb42" Mar 16 17:21:35 crc kubenswrapper[5120]: I0316 17:21:35.916432 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-edpm-multinodeset-edpm-compute-global-xmb42" event={"ID":"8cdaa1ac-bac8-41a4-b2c0-4d90c52ac825","Type":"ContainerDied","Data":"1450d495a024a4a14a732508cca038ef66f8913496d8a43ac6cadadd7a6d76d7"} Mar 16 17:21:35 crc kubenswrapper[5120]: I0316 17:21:35.916803 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1450d495a024a4a14a732508cca038ef66f8913496d8a43ac6cadadd7a6d76d7" Mar 16 17:21:35 crc kubenswrapper[5120]: I0316 17:21:35.975517 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-global-89hrj"] Mar 16 17:21:35 crc kubenswrapper[5120]: I0316 17:21:35.976493 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8cdaa1ac-bac8-41a4-b2c0-4d90c52ac825" containerName="ovn-edpm-multinodeset-edpm-compute-global" Mar 16 17:21:35 crc kubenswrapper[5120]: I0316 17:21:35.976517 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8cdaa1ac-bac8-41a4-b2c0-4d90c52ac825" containerName="ovn-edpm-multinodeset-edpm-compute-global" Mar 16 17:21:35 crc kubenswrapper[5120]: I0316 17:21:35.976672 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="8cdaa1ac-bac8-41a4-b2c0-4d90c52ac825" containerName="ovn-edpm-multinodeset-edpm-compute-global" Mar 16 17:21:35 crc kubenswrapper[5120]: I0316 17:21:35.983462 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-global-89hrj" Mar 16 17:21:35 crc kubenswrapper[5120]: I0316 17:21:35.987182 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-aee-default-env\"" Mar 16 17:21:35 crc kubenswrapper[5120]: I0316 17:21:35.987246 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-ovn-metadata-agent-neutron-config\"" Mar 16 17:21:35 crc kubenswrapper[5120]: I0316 17:21:35.987281 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-metadata-neutron-config\"" Mar 16 17:21:35 crc kubenswrapper[5120]: I0316 17:21:35.987391 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"combined-ca-bundle\"" Mar 16 17:21:35 crc kubenswrapper[5120]: I0316 17:21:35.987600 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplane-ansible-ssh-private-key-secret\"" Mar 16 17:21:35 crc kubenswrapper[5120]: I0316 17:21:35.987780 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplanenodeset-edpm-compute-global\"" Mar 16 17:21:35 crc kubenswrapper[5120]: I0316 17:21:35.988297 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-global-89hrj"] Mar 16 17:21:35 crc kubenswrapper[5120]: I0316 17:21:35.990026 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"edpm-compute-global-dockercfg-5hp85\"" Mar 16 17:21:36 crc kubenswrapper[5120]: I0316 17:21:36.110778 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-neutron-config-1\" (UniqueName: \"kubernetes.io/secret/d86f967c-0478-485d-bd75-15e6a4e7588e-nova-metadata-neutron-config-1\") pod \"neutron-metadata-edpm-multinodeset-edpm-compute-global-89hrj\" (UID: \"d86f967c-0478-485d-bd75-15e6a4e7588e\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-global-89hrj" Mar 16 17:21:36 crc kubenswrapper[5120]: I0316 17:21:36.110882 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-neutron-config-2\" (UniqueName: \"kubernetes.io/secret/d86f967c-0478-485d-bd75-15e6a4e7588e-nova-metadata-neutron-config-2\") pod \"neutron-metadata-edpm-multinodeset-edpm-compute-global-89hrj\" (UID: \"d86f967c-0478-485d-bd75-15e6a4e7588e\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-global-89hrj" Mar 16 17:21:36 crc kubenswrapper[5120]: I0316 17:21:36.111143 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"neutron-metadata-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d86f967c-0478-485d-bd75-15e6a4e7588e-neutron-metadata-combined-ca-bundle\") pod \"neutron-metadata-edpm-multinodeset-edpm-compute-global-89hrj\" (UID: \"d86f967c-0478-485d-bd75-15e6a4e7588e\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-global-89hrj" Mar 16 17:21:36 crc kubenswrapper[5120]: I0316 17:21:36.111242 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qf7cv\" (UniqueName: \"kubernetes.io/projected/d86f967c-0478-485d-bd75-15e6a4e7588e-kube-api-access-qf7cv\") pod \"neutron-metadata-edpm-multinodeset-edpm-compute-global-89hrj\" (UID: \"d86f967c-0478-485d-bd75-15e6a4e7588e\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-global-89hrj" Mar 16 17:21:36 crc kubenswrapper[5120]: I0316 17:21:36.111329 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"neutron-ovn-metadata-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/d86f967c-0478-485d-bd75-15e6a4e7588e-neutron-ovn-metadata-agent-neutron-config-0\") pod \"neutron-metadata-edpm-multinodeset-edpm-compute-global-89hrj\" (UID: \"d86f967c-0478-485d-bd75-15e6a4e7588e\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-global-89hrj" Mar 16 17:21:36 crc kubenswrapper[5120]: I0316 17:21:36.111387 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/d86f967c-0478-485d-bd75-15e6a4e7588e-inventory\") pod \"neutron-metadata-edpm-multinodeset-edpm-compute-global-89hrj\" (UID: \"d86f967c-0478-485d-bd75-15e6a4e7588e\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-global-89hrj" Mar 16 17:21:36 crc kubenswrapper[5120]: I0316 17:21:36.111495 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/d86f967c-0478-485d-bd75-15e6a4e7588e-nova-metadata-neutron-config-0\") pod \"neutron-metadata-edpm-multinodeset-edpm-compute-global-89hrj\" (UID: \"d86f967c-0478-485d-bd75-15e6a4e7588e\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-global-89hrj" Mar 16 17:21:36 crc kubenswrapper[5120]: I0316 17:21:36.111672 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/d86f967c-0478-485d-bd75-15e6a4e7588e-ssh-key-edpm-compute-global\") pod \"neutron-metadata-edpm-multinodeset-edpm-compute-global-89hrj\" (UID: \"d86f967c-0478-485d-bd75-15e6a4e7588e\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-global-89hrj" Mar 16 17:21:36 crc kubenswrapper[5120]: I0316 17:21:36.213468 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-metadata-neutron-config-1\" (UniqueName: \"kubernetes.io/secret/d86f967c-0478-485d-bd75-15e6a4e7588e-nova-metadata-neutron-config-1\") pod \"neutron-metadata-edpm-multinodeset-edpm-compute-global-89hrj\" (UID: \"d86f967c-0478-485d-bd75-15e6a4e7588e\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-global-89hrj" Mar 16 17:21:36 crc kubenswrapper[5120]: I0316 17:21:36.214576 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-metadata-neutron-config-2\" (UniqueName: \"kubernetes.io/secret/d86f967c-0478-485d-bd75-15e6a4e7588e-nova-metadata-neutron-config-2\") pod \"neutron-metadata-edpm-multinodeset-edpm-compute-global-89hrj\" (UID: \"d86f967c-0478-485d-bd75-15e6a4e7588e\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-global-89hrj" Mar 16 17:21:36 crc kubenswrapper[5120]: I0316 17:21:36.214860 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"neutron-metadata-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d86f967c-0478-485d-bd75-15e6a4e7588e-neutron-metadata-combined-ca-bundle\") pod \"neutron-metadata-edpm-multinodeset-edpm-compute-global-89hrj\" (UID: \"d86f967c-0478-485d-bd75-15e6a4e7588e\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-global-89hrj" Mar 16 17:21:36 crc kubenswrapper[5120]: I0316 17:21:36.215015 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qf7cv\" (UniqueName: \"kubernetes.io/projected/d86f967c-0478-485d-bd75-15e6a4e7588e-kube-api-access-qf7cv\") pod \"neutron-metadata-edpm-multinodeset-edpm-compute-global-89hrj\" (UID: \"d86f967c-0478-485d-bd75-15e6a4e7588e\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-global-89hrj" Mar 16 17:21:36 crc kubenswrapper[5120]: I0316 17:21:36.215172 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"neutron-ovn-metadata-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/d86f967c-0478-485d-bd75-15e6a4e7588e-neutron-ovn-metadata-agent-neutron-config-0\") pod \"neutron-metadata-edpm-multinodeset-edpm-compute-global-89hrj\" (UID: \"d86f967c-0478-485d-bd75-15e6a4e7588e\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-global-89hrj" Mar 16 17:21:36 crc kubenswrapper[5120]: I0316 17:21:36.215317 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/d86f967c-0478-485d-bd75-15e6a4e7588e-inventory\") pod \"neutron-metadata-edpm-multinodeset-edpm-compute-global-89hrj\" (UID: \"d86f967c-0478-485d-bd75-15e6a4e7588e\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-global-89hrj" Mar 16 17:21:36 crc kubenswrapper[5120]: I0316 17:21:36.215482 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-metadata-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/d86f967c-0478-485d-bd75-15e6a4e7588e-nova-metadata-neutron-config-0\") pod \"neutron-metadata-edpm-multinodeset-edpm-compute-global-89hrj\" (UID: \"d86f967c-0478-485d-bd75-15e6a4e7588e\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-global-89hrj" Mar 16 17:21:36 crc kubenswrapper[5120]: I0316 17:21:36.215782 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/d86f967c-0478-485d-bd75-15e6a4e7588e-ssh-key-edpm-compute-global\") pod \"neutron-metadata-edpm-multinodeset-edpm-compute-global-89hrj\" (UID: \"d86f967c-0478-485d-bd75-15e6a4e7588e\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-global-89hrj" Mar 16 17:21:36 crc kubenswrapper[5120]: I0316 17:21:36.220114 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"neutron-ovn-metadata-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/d86f967c-0478-485d-bd75-15e6a4e7588e-neutron-ovn-metadata-agent-neutron-config-0\") pod \"neutron-metadata-edpm-multinodeset-edpm-compute-global-89hrj\" (UID: \"d86f967c-0478-485d-bd75-15e6a4e7588e\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-global-89hrj" Mar 16 17:21:36 crc kubenswrapper[5120]: I0316 17:21:36.220442 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-metadata-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/d86f967c-0478-485d-bd75-15e6a4e7588e-nova-metadata-neutron-config-0\") pod \"neutron-metadata-edpm-multinodeset-edpm-compute-global-89hrj\" (UID: \"d86f967c-0478-485d-bd75-15e6a4e7588e\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-global-89hrj" Mar 16 17:21:36 crc kubenswrapper[5120]: I0316 17:21:36.220575 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-metadata-neutron-config-1\" (UniqueName: \"kubernetes.io/secret/d86f967c-0478-485d-bd75-15e6a4e7588e-nova-metadata-neutron-config-1\") pod \"neutron-metadata-edpm-multinodeset-edpm-compute-global-89hrj\" (UID: \"d86f967c-0478-485d-bd75-15e6a4e7588e\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-global-89hrj" Mar 16 17:21:36 crc kubenswrapper[5120]: I0316 17:21:36.220631 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/d86f967c-0478-485d-bd75-15e6a4e7588e-ssh-key-edpm-compute-global\") pod \"neutron-metadata-edpm-multinodeset-edpm-compute-global-89hrj\" (UID: \"d86f967c-0478-485d-bd75-15e6a4e7588e\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-global-89hrj" Mar 16 17:21:36 crc kubenswrapper[5120]: I0316 17:21:36.220640 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/d86f967c-0478-485d-bd75-15e6a4e7588e-inventory\") pod \"neutron-metadata-edpm-multinodeset-edpm-compute-global-89hrj\" (UID: \"d86f967c-0478-485d-bd75-15e6a4e7588e\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-global-89hrj" Mar 16 17:21:36 crc kubenswrapper[5120]: I0316 17:21:36.221228 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"neutron-metadata-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d86f967c-0478-485d-bd75-15e6a4e7588e-neutron-metadata-combined-ca-bundle\") pod \"neutron-metadata-edpm-multinodeset-edpm-compute-global-89hrj\" (UID: \"d86f967c-0478-485d-bd75-15e6a4e7588e\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-global-89hrj" Mar 16 17:21:36 crc kubenswrapper[5120]: I0316 17:21:36.221868 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-metadata-neutron-config-2\" (UniqueName: \"kubernetes.io/secret/d86f967c-0478-485d-bd75-15e6a4e7588e-nova-metadata-neutron-config-2\") pod \"neutron-metadata-edpm-multinodeset-edpm-compute-global-89hrj\" (UID: \"d86f967c-0478-485d-bd75-15e6a4e7588e\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-global-89hrj" Mar 16 17:21:36 crc kubenswrapper[5120]: I0316 17:21:36.233424 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qf7cv\" (UniqueName: \"kubernetes.io/projected/d86f967c-0478-485d-bd75-15e6a4e7588e-kube-api-access-qf7cv\") pod \"neutron-metadata-edpm-multinodeset-edpm-compute-global-89hrj\" (UID: \"d86f967c-0478-485d-bd75-15e6a4e7588e\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-global-89hrj" Mar 16 17:21:36 crc kubenswrapper[5120]: I0316 17:21:36.316987 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-global-89hrj" Mar 16 17:21:36 crc kubenswrapper[5120]: W0316 17:21:36.727966 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd86f967c_0478_485d_bd75_15e6a4e7588e.slice/crio-1b62dff86775d3c0ac17491132b92ee42b210226a8129f512b6d5fa29396298e WatchSource:0}: Error finding container 1b62dff86775d3c0ac17491132b92ee42b210226a8129f512b6d5fa29396298e: Status 404 returned error can't find the container with id 1b62dff86775d3c0ac17491132b92ee42b210226a8129f512b6d5fa29396298e Mar 16 17:21:36 crc kubenswrapper[5120]: I0316 17:21:36.731784 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-global-89hrj"] Mar 16 17:21:36 crc kubenswrapper[5120]: I0316 17:21:36.928283 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-global-89hrj" event={"ID":"d86f967c-0478-485d-bd75-15e6a4e7588e","Type":"ContainerStarted","Data":"1b62dff86775d3c0ac17491132b92ee42b210226a8129f512b6d5fa29396298e"} Mar 16 17:21:37 crc kubenswrapper[5120]: I0316 17:21:37.938279 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-global-89hrj" event={"ID":"d86f967c-0478-485d-bd75-15e6a4e7588e","Type":"ContainerStarted","Data":"9f736e6e626bae203318086df29b36aea24a7f2c4c06f86e934985eaa796e101"} Mar 16 17:21:37 crc kubenswrapper[5120]: I0316 17:21:37.964600 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-global-89hrj" podStartSLOduration=2.516309139 podStartE2EDuration="2.964577688s" podCreationTimestamp="2026-03-16 17:21:35 +0000 UTC" firstStartedPulling="2026-03-16 17:21:36.729791147 +0000 UTC m=+6598.883722804" lastFinishedPulling="2026-03-16 17:21:37.178059696 +0000 UTC m=+6599.331991353" observedRunningTime="2026-03-16 17:21:37.955827738 +0000 UTC m=+6600.109759395" watchObservedRunningTime="2026-03-16 17:21:37.964577688 +0000 UTC m=+6600.118509345" Mar 16 17:21:38 crc kubenswrapper[5120]: I0316 17:21:38.966650 5120 generic.go:358] "Generic (PLEG): container finished" podID="d86f967c-0478-485d-bd75-15e6a4e7588e" containerID="9f736e6e626bae203318086df29b36aea24a7f2c4c06f86e934985eaa796e101" exitCode=0 Mar 16 17:21:38 crc kubenswrapper[5120]: I0316 17:21:38.966771 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-global-89hrj" event={"ID":"d86f967c-0478-485d-bd75-15e6a4e7588e","Type":"ContainerDied","Data":"9f736e6e626bae203318086df29b36aea24a7f2c4c06f86e934985eaa796e101"} Mar 16 17:21:40 crc kubenswrapper[5120]: I0316 17:21:40.251897 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-global-89hrj" Mar 16 17:21:40 crc kubenswrapper[5120]: I0316 17:21:40.298536 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-metadata-neutron-config-2\" (UniqueName: \"kubernetes.io/secret/d86f967c-0478-485d-bd75-15e6a4e7588e-nova-metadata-neutron-config-2\") pod \"d86f967c-0478-485d-bd75-15e6a4e7588e\" (UID: \"d86f967c-0478-485d-bd75-15e6a4e7588e\") " Mar 16 17:21:40 crc kubenswrapper[5120]: I0316 17:21:40.298649 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/d86f967c-0478-485d-bd75-15e6a4e7588e-ssh-key-edpm-compute-global\") pod \"d86f967c-0478-485d-bd75-15e6a4e7588e\" (UID: \"d86f967c-0478-485d-bd75-15e6a4e7588e\") " Mar 16 17:21:40 crc kubenswrapper[5120]: I0316 17:21:40.298754 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-metadata-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/d86f967c-0478-485d-bd75-15e6a4e7588e-nova-metadata-neutron-config-0\") pod \"d86f967c-0478-485d-bd75-15e6a4e7588e\" (UID: \"d86f967c-0478-485d-bd75-15e6a4e7588e\") " Mar 16 17:21:40 crc kubenswrapper[5120]: I0316 17:21:40.298880 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-metadata-neutron-config-1\" (UniqueName: \"kubernetes.io/secret/d86f967c-0478-485d-bd75-15e6a4e7588e-nova-metadata-neutron-config-1\") pod \"d86f967c-0478-485d-bd75-15e6a4e7588e\" (UID: \"d86f967c-0478-485d-bd75-15e6a4e7588e\") " Mar 16 17:21:40 crc kubenswrapper[5120]: I0316 17:21:40.298911 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/d86f967c-0478-485d-bd75-15e6a4e7588e-inventory\") pod \"d86f967c-0478-485d-bd75-15e6a4e7588e\" (UID: \"d86f967c-0478-485d-bd75-15e6a4e7588e\") " Mar 16 17:21:40 crc kubenswrapper[5120]: I0316 17:21:40.298965 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qf7cv\" (UniqueName: \"kubernetes.io/projected/d86f967c-0478-485d-bd75-15e6a4e7588e-kube-api-access-qf7cv\") pod \"d86f967c-0478-485d-bd75-15e6a4e7588e\" (UID: \"d86f967c-0478-485d-bd75-15e6a4e7588e\") " Mar 16 17:21:40 crc kubenswrapper[5120]: I0316 17:21:40.299058 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"neutron-ovn-metadata-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/d86f967c-0478-485d-bd75-15e6a4e7588e-neutron-ovn-metadata-agent-neutron-config-0\") pod \"d86f967c-0478-485d-bd75-15e6a4e7588e\" (UID: \"d86f967c-0478-485d-bd75-15e6a4e7588e\") " Mar 16 17:21:40 crc kubenswrapper[5120]: I0316 17:21:40.299144 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"neutron-metadata-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d86f967c-0478-485d-bd75-15e6a4e7588e-neutron-metadata-combined-ca-bundle\") pod \"d86f967c-0478-485d-bd75-15e6a4e7588e\" (UID: \"d86f967c-0478-485d-bd75-15e6a4e7588e\") " Mar 16 17:21:40 crc kubenswrapper[5120]: I0316 17:21:40.304720 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d86f967c-0478-485d-bd75-15e6a4e7588e-kube-api-access-qf7cv" (OuterVolumeSpecName: "kube-api-access-qf7cv") pod "d86f967c-0478-485d-bd75-15e6a4e7588e" (UID: "d86f967c-0478-485d-bd75-15e6a4e7588e"). InnerVolumeSpecName "kube-api-access-qf7cv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:21:40 crc kubenswrapper[5120]: I0316 17:21:40.304861 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d86f967c-0478-485d-bd75-15e6a4e7588e-neutron-metadata-combined-ca-bundle" (OuterVolumeSpecName: "neutron-metadata-combined-ca-bundle") pod "d86f967c-0478-485d-bd75-15e6a4e7588e" (UID: "d86f967c-0478-485d-bd75-15e6a4e7588e"). InnerVolumeSpecName "neutron-metadata-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:21:40 crc kubenswrapper[5120]: I0316 17:21:40.320226 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d86f967c-0478-485d-bd75-15e6a4e7588e-nova-metadata-neutron-config-2" (OuterVolumeSpecName: "nova-metadata-neutron-config-2") pod "d86f967c-0478-485d-bd75-15e6a4e7588e" (UID: "d86f967c-0478-485d-bd75-15e6a4e7588e"). InnerVolumeSpecName "nova-metadata-neutron-config-2". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:21:40 crc kubenswrapper[5120]: I0316 17:21:40.321508 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d86f967c-0478-485d-bd75-15e6a4e7588e-nova-metadata-neutron-config-1" (OuterVolumeSpecName: "nova-metadata-neutron-config-1") pod "d86f967c-0478-485d-bd75-15e6a4e7588e" (UID: "d86f967c-0478-485d-bd75-15e6a4e7588e"). InnerVolumeSpecName "nova-metadata-neutron-config-1". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:21:40 crc kubenswrapper[5120]: I0316 17:21:40.323075 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d86f967c-0478-485d-bd75-15e6a4e7588e-nova-metadata-neutron-config-0" (OuterVolumeSpecName: "nova-metadata-neutron-config-0") pod "d86f967c-0478-485d-bd75-15e6a4e7588e" (UID: "d86f967c-0478-485d-bd75-15e6a4e7588e"). InnerVolumeSpecName "nova-metadata-neutron-config-0". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:21:40 crc kubenswrapper[5120]: I0316 17:21:40.323199 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d86f967c-0478-485d-bd75-15e6a4e7588e-neutron-ovn-metadata-agent-neutron-config-0" (OuterVolumeSpecName: "neutron-ovn-metadata-agent-neutron-config-0") pod "d86f967c-0478-485d-bd75-15e6a4e7588e" (UID: "d86f967c-0478-485d-bd75-15e6a4e7588e"). InnerVolumeSpecName "neutron-ovn-metadata-agent-neutron-config-0". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:21:40 crc kubenswrapper[5120]: I0316 17:21:40.324385 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d86f967c-0478-485d-bd75-15e6a4e7588e-ssh-key-edpm-compute-global" (OuterVolumeSpecName: "ssh-key-edpm-compute-global") pod "d86f967c-0478-485d-bd75-15e6a4e7588e" (UID: "d86f967c-0478-485d-bd75-15e6a4e7588e"). InnerVolumeSpecName "ssh-key-edpm-compute-global". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:21:40 crc kubenswrapper[5120]: I0316 17:21:40.333195 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d86f967c-0478-485d-bd75-15e6a4e7588e-inventory" (OuterVolumeSpecName: "inventory") pod "d86f967c-0478-485d-bd75-15e6a4e7588e" (UID: "d86f967c-0478-485d-bd75-15e6a4e7588e"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:21:40 crc kubenswrapper[5120]: I0316 17:21:40.401554 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qf7cv\" (UniqueName: \"kubernetes.io/projected/d86f967c-0478-485d-bd75-15e6a4e7588e-kube-api-access-qf7cv\") on node \"crc\" DevicePath \"\"" Mar 16 17:21:40 crc kubenswrapper[5120]: I0316 17:21:40.401626 5120 reconciler_common.go:299] "Volume detached for volume \"neutron-ovn-metadata-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/d86f967c-0478-485d-bd75-15e6a4e7588e-neutron-ovn-metadata-agent-neutron-config-0\") on node \"crc\" DevicePath \"\"" Mar 16 17:21:40 crc kubenswrapper[5120]: I0316 17:21:40.401645 5120 reconciler_common.go:299] "Volume detached for volume \"neutron-metadata-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d86f967c-0478-485d-bd75-15e6a4e7588e-neutron-metadata-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:21:40 crc kubenswrapper[5120]: I0316 17:21:40.401658 5120 reconciler_common.go:299] "Volume detached for volume \"nova-metadata-neutron-config-2\" (UniqueName: \"kubernetes.io/secret/d86f967c-0478-485d-bd75-15e6a4e7588e-nova-metadata-neutron-config-2\") on node \"crc\" DevicePath \"\"" Mar 16 17:21:40 crc kubenswrapper[5120]: I0316 17:21:40.401671 5120 reconciler_common.go:299] "Volume detached for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/d86f967c-0478-485d-bd75-15e6a4e7588e-ssh-key-edpm-compute-global\") on node \"crc\" DevicePath \"\"" Mar 16 17:21:40 crc kubenswrapper[5120]: I0316 17:21:40.401685 5120 reconciler_common.go:299] "Volume detached for volume \"nova-metadata-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/d86f967c-0478-485d-bd75-15e6a4e7588e-nova-metadata-neutron-config-0\") on node \"crc\" DevicePath \"\"" Mar 16 17:21:40 crc kubenswrapper[5120]: I0316 17:21:40.401696 5120 reconciler_common.go:299] "Volume detached for volume \"nova-metadata-neutron-config-1\" (UniqueName: \"kubernetes.io/secret/d86f967c-0478-485d-bd75-15e6a4e7588e-nova-metadata-neutron-config-1\") on node \"crc\" DevicePath \"\"" Mar 16 17:21:40 crc kubenswrapper[5120]: I0316 17:21:40.401708 5120 reconciler_common.go:299] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/d86f967c-0478-485d-bd75-15e6a4e7588e-inventory\") on node \"crc\" DevicePath \"\"" Mar 16 17:21:41 crc kubenswrapper[5120]: I0316 17:21:41.006837 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-global-89hrj" Mar 16 17:21:41 crc kubenswrapper[5120]: I0316 17:21:41.006857 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-global-89hrj" event={"ID":"d86f967c-0478-485d-bd75-15e6a4e7588e","Type":"ContainerDied","Data":"1b62dff86775d3c0ac17491132b92ee42b210226a8129f512b6d5fa29396298e"} Mar 16 17:21:41 crc kubenswrapper[5120]: I0316 17:21:41.006918 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1b62dff86775d3c0ac17491132b92ee42b210226a8129f512b6d5fa29396298e" Mar 16 17:21:41 crc kubenswrapper[5120]: I0316 17:21:41.144363 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-global-b2wcf"] Mar 16 17:21:41 crc kubenswrapper[5120]: I0316 17:21:41.145575 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d86f967c-0478-485d-bd75-15e6a4e7588e" containerName="neutron-metadata-edpm-multinodeset-edpm-compute-global" Mar 16 17:21:41 crc kubenswrapper[5120]: I0316 17:21:41.145608 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="d86f967c-0478-485d-bd75-15e6a4e7588e" containerName="neutron-metadata-edpm-multinodeset-edpm-compute-global" Mar 16 17:21:41 crc kubenswrapper[5120]: I0316 17:21:41.145837 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="d86f967c-0478-485d-bd75-15e6a4e7588e" containerName="neutron-metadata-edpm-multinodeset-edpm-compute-global" Mar 16 17:21:41 crc kubenswrapper[5120]: I0316 17:21:41.158034 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-global-b2wcf"] Mar 16 17:21:41 crc kubenswrapper[5120]: I0316 17:21:41.158186 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-global-b2wcf" Mar 16 17:21:41 crc kubenswrapper[5120]: I0316 17:21:41.165476 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-metadata-neutron-config\"" Mar 16 17:21:41 crc kubenswrapper[5120]: I0316 17:21:41.165938 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"combined-ca-bundle\"" Mar 16 17:21:41 crc kubenswrapper[5120]: I0316 17:21:41.166109 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-ovn-agent-neutron-config\"" Mar 16 17:21:41 crc kubenswrapper[5120]: I0316 17:21:41.166233 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-aee-default-env\"" Mar 16 17:21:41 crc kubenswrapper[5120]: I0316 17:21:41.166492 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"edpm-compute-global-dockercfg-5hp85\"" Mar 16 17:21:41 crc kubenswrapper[5120]: I0316 17:21:41.166611 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplane-ansible-ssh-private-key-secret\"" Mar 16 17:21:41 crc kubenswrapper[5120]: I0316 17:21:41.166722 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplanenodeset-edpm-compute-global\"" Mar 16 17:21:41 crc kubenswrapper[5120]: I0316 17:21:41.222390 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-neutron-config-1\" (UniqueName: \"kubernetes.io/secret/5de90149-15ef-4716-be7d-90136958a64e-nova-metadata-neutron-config-1\") pod \"neutron-ovn-edpm-multinodeset-edpm-compute-global-b2wcf\" (UID: \"5de90149-15ef-4716-be7d-90136958a64e\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-global-b2wcf" Mar 16 17:21:41 crc kubenswrapper[5120]: I0316 17:21:41.222488 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/5de90149-15ef-4716-be7d-90136958a64e-ssh-key-edpm-compute-global\") pod \"neutron-ovn-edpm-multinodeset-edpm-compute-global-b2wcf\" (UID: \"5de90149-15ef-4716-be7d-90136958a64e\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-global-b2wcf" Mar 16 17:21:41 crc kubenswrapper[5120]: I0316 17:21:41.222528 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/5de90149-15ef-4716-be7d-90136958a64e-inventory\") pod \"neutron-ovn-edpm-multinodeset-edpm-compute-global-b2wcf\" (UID: \"5de90149-15ef-4716-be7d-90136958a64e\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-global-b2wcf" Mar 16 17:21:41 crc kubenswrapper[5120]: I0316 17:21:41.222589 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nsfn7\" (UniqueName: \"kubernetes.io/projected/5de90149-15ef-4716-be7d-90136958a64e-kube-api-access-nsfn7\") pod \"neutron-ovn-edpm-multinodeset-edpm-compute-global-b2wcf\" (UID: \"5de90149-15ef-4716-be7d-90136958a64e\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-global-b2wcf" Mar 16 17:21:41 crc kubenswrapper[5120]: I0316 17:21:41.222655 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/5de90149-15ef-4716-be7d-90136958a64e-nova-metadata-neutron-config-0\") pod \"neutron-ovn-edpm-multinodeset-edpm-compute-global-b2wcf\" (UID: \"5de90149-15ef-4716-be7d-90136958a64e\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-global-b2wcf" Mar 16 17:21:41 crc kubenswrapper[5120]: I0316 17:21:41.222682 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"neutron-ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5de90149-15ef-4716-be7d-90136958a64e-neutron-ovn-combined-ca-bundle\") pod \"neutron-ovn-edpm-multinodeset-edpm-compute-global-b2wcf\" (UID: \"5de90149-15ef-4716-be7d-90136958a64e\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-global-b2wcf" Mar 16 17:21:41 crc kubenswrapper[5120]: I0316 17:21:41.222784 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-neutron-config-2\" (UniqueName: \"kubernetes.io/secret/5de90149-15ef-4716-be7d-90136958a64e-nova-metadata-neutron-config-2\") pod \"neutron-ovn-edpm-multinodeset-edpm-compute-global-b2wcf\" (UID: \"5de90149-15ef-4716-be7d-90136958a64e\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-global-b2wcf" Mar 16 17:21:41 crc kubenswrapper[5120]: I0316 17:21:41.222820 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"neutron-ovn-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/5de90149-15ef-4716-be7d-90136958a64e-neutron-ovn-agent-neutron-config-0\") pod \"neutron-ovn-edpm-multinodeset-edpm-compute-global-b2wcf\" (UID: \"5de90149-15ef-4716-be7d-90136958a64e\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-global-b2wcf" Mar 16 17:21:41 crc kubenswrapper[5120]: I0316 17:21:41.324796 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/5de90149-15ef-4716-be7d-90136958a64e-ssh-key-edpm-compute-global\") pod \"neutron-ovn-edpm-multinodeset-edpm-compute-global-b2wcf\" (UID: \"5de90149-15ef-4716-be7d-90136958a64e\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-global-b2wcf" Mar 16 17:21:41 crc kubenswrapper[5120]: I0316 17:21:41.324858 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/5de90149-15ef-4716-be7d-90136958a64e-inventory\") pod \"neutron-ovn-edpm-multinodeset-edpm-compute-global-b2wcf\" (UID: \"5de90149-15ef-4716-be7d-90136958a64e\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-global-b2wcf" Mar 16 17:21:41 crc kubenswrapper[5120]: I0316 17:21:41.324907 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nsfn7\" (UniqueName: \"kubernetes.io/projected/5de90149-15ef-4716-be7d-90136958a64e-kube-api-access-nsfn7\") pod \"neutron-ovn-edpm-multinodeset-edpm-compute-global-b2wcf\" (UID: \"5de90149-15ef-4716-be7d-90136958a64e\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-global-b2wcf" Mar 16 17:21:41 crc kubenswrapper[5120]: I0316 17:21:41.324967 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-metadata-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/5de90149-15ef-4716-be7d-90136958a64e-nova-metadata-neutron-config-0\") pod \"neutron-ovn-edpm-multinodeset-edpm-compute-global-b2wcf\" (UID: \"5de90149-15ef-4716-be7d-90136958a64e\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-global-b2wcf" Mar 16 17:21:41 crc kubenswrapper[5120]: I0316 17:21:41.324996 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"neutron-ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5de90149-15ef-4716-be7d-90136958a64e-neutron-ovn-combined-ca-bundle\") pod \"neutron-ovn-edpm-multinodeset-edpm-compute-global-b2wcf\" (UID: \"5de90149-15ef-4716-be7d-90136958a64e\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-global-b2wcf" Mar 16 17:21:41 crc kubenswrapper[5120]: I0316 17:21:41.325086 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-metadata-neutron-config-2\" (UniqueName: \"kubernetes.io/secret/5de90149-15ef-4716-be7d-90136958a64e-nova-metadata-neutron-config-2\") pod \"neutron-ovn-edpm-multinodeset-edpm-compute-global-b2wcf\" (UID: \"5de90149-15ef-4716-be7d-90136958a64e\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-global-b2wcf" Mar 16 17:21:41 crc kubenswrapper[5120]: I0316 17:21:41.325120 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"neutron-ovn-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/5de90149-15ef-4716-be7d-90136958a64e-neutron-ovn-agent-neutron-config-0\") pod \"neutron-ovn-edpm-multinodeset-edpm-compute-global-b2wcf\" (UID: \"5de90149-15ef-4716-be7d-90136958a64e\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-global-b2wcf" Mar 16 17:21:41 crc kubenswrapper[5120]: I0316 17:21:41.325182 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-metadata-neutron-config-1\" (UniqueName: \"kubernetes.io/secret/5de90149-15ef-4716-be7d-90136958a64e-nova-metadata-neutron-config-1\") pod \"neutron-ovn-edpm-multinodeset-edpm-compute-global-b2wcf\" (UID: \"5de90149-15ef-4716-be7d-90136958a64e\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-global-b2wcf" Mar 16 17:21:41 crc kubenswrapper[5120]: I0316 17:21:41.329260 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/5de90149-15ef-4716-be7d-90136958a64e-inventory\") pod \"neutron-ovn-edpm-multinodeset-edpm-compute-global-b2wcf\" (UID: \"5de90149-15ef-4716-be7d-90136958a64e\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-global-b2wcf" Mar 16 17:21:41 crc kubenswrapper[5120]: I0316 17:21:41.329548 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-metadata-neutron-config-2\" (UniqueName: \"kubernetes.io/secret/5de90149-15ef-4716-be7d-90136958a64e-nova-metadata-neutron-config-2\") pod \"neutron-ovn-edpm-multinodeset-edpm-compute-global-b2wcf\" (UID: \"5de90149-15ef-4716-be7d-90136958a64e\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-global-b2wcf" Mar 16 17:21:41 crc kubenswrapper[5120]: I0316 17:21:41.329584 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"neutron-ovn-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/5de90149-15ef-4716-be7d-90136958a64e-neutron-ovn-agent-neutron-config-0\") pod \"neutron-ovn-edpm-multinodeset-edpm-compute-global-b2wcf\" (UID: \"5de90149-15ef-4716-be7d-90136958a64e\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-global-b2wcf" Mar 16 17:21:41 crc kubenswrapper[5120]: I0316 17:21:41.330179 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/5de90149-15ef-4716-be7d-90136958a64e-ssh-key-edpm-compute-global\") pod \"neutron-ovn-edpm-multinodeset-edpm-compute-global-b2wcf\" (UID: \"5de90149-15ef-4716-be7d-90136958a64e\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-global-b2wcf" Mar 16 17:21:41 crc kubenswrapper[5120]: I0316 17:21:41.331432 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"neutron-ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5de90149-15ef-4716-be7d-90136958a64e-neutron-ovn-combined-ca-bundle\") pod \"neutron-ovn-edpm-multinodeset-edpm-compute-global-b2wcf\" (UID: \"5de90149-15ef-4716-be7d-90136958a64e\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-global-b2wcf" Mar 16 17:21:41 crc kubenswrapper[5120]: I0316 17:21:41.333212 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-metadata-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/5de90149-15ef-4716-be7d-90136958a64e-nova-metadata-neutron-config-0\") pod \"neutron-ovn-edpm-multinodeset-edpm-compute-global-b2wcf\" (UID: \"5de90149-15ef-4716-be7d-90136958a64e\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-global-b2wcf" Mar 16 17:21:41 crc kubenswrapper[5120]: I0316 17:21:41.336480 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-metadata-neutron-config-1\" (UniqueName: \"kubernetes.io/secret/5de90149-15ef-4716-be7d-90136958a64e-nova-metadata-neutron-config-1\") pod \"neutron-ovn-edpm-multinodeset-edpm-compute-global-b2wcf\" (UID: \"5de90149-15ef-4716-be7d-90136958a64e\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-global-b2wcf" Mar 16 17:21:41 crc kubenswrapper[5120]: I0316 17:21:41.343430 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nsfn7\" (UniqueName: \"kubernetes.io/projected/5de90149-15ef-4716-be7d-90136958a64e-kube-api-access-nsfn7\") pod \"neutron-ovn-edpm-multinodeset-edpm-compute-global-b2wcf\" (UID: \"5de90149-15ef-4716-be7d-90136958a64e\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-global-b2wcf" Mar 16 17:21:41 crc kubenswrapper[5120]: I0316 17:21:41.482398 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-global-b2wcf" Mar 16 17:21:42 crc kubenswrapper[5120]: I0316 17:21:41.733498 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-global-b2wcf"] Mar 16 17:21:42 crc kubenswrapper[5120]: I0316 17:21:42.022628 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-global-b2wcf" event={"ID":"5de90149-15ef-4716-be7d-90136958a64e","Type":"ContainerStarted","Data":"1f180a886d47d5e18972632e5886d473475b585901007b6ea8ef8db72bb44773"} Mar 16 17:21:43 crc kubenswrapper[5120]: I0316 17:21:43.032102 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-global-b2wcf" event={"ID":"5de90149-15ef-4716-be7d-90136958a64e","Type":"ContainerStarted","Data":"e81508d86e1b0bb97c123cbf72ff9ea5ba5698d3046d0b99918c12e6765bf2d7"} Mar 16 17:21:43 crc kubenswrapper[5120]: I0316 17:21:43.062959 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-global-b2wcf" podStartSLOduration=1.681321143 podStartE2EDuration="2.062935641s" podCreationTimestamp="2026-03-16 17:21:41 +0000 UTC" firstStartedPulling="2026-03-16 17:21:41.740188537 +0000 UTC m=+6603.894120194" lastFinishedPulling="2026-03-16 17:21:42.121803035 +0000 UTC m=+6604.275734692" observedRunningTime="2026-03-16 17:21:43.057694018 +0000 UTC m=+6605.211625675" watchObservedRunningTime="2026-03-16 17:21:43.062935641 +0000 UTC m=+6605.216867298" Mar 16 17:21:44 crc kubenswrapper[5120]: I0316 17:21:44.043670 5120 generic.go:358] "Generic (PLEG): container finished" podID="5de90149-15ef-4716-be7d-90136958a64e" containerID="e81508d86e1b0bb97c123cbf72ff9ea5ba5698d3046d0b99918c12e6765bf2d7" exitCode=0 Mar 16 17:21:44 crc kubenswrapper[5120]: I0316 17:21:44.043737 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-global-b2wcf" event={"ID":"5de90149-15ef-4716-be7d-90136958a64e","Type":"ContainerDied","Data":"e81508d86e1b0bb97c123cbf72ff9ea5ba5698d3046d0b99918c12e6765bf2d7"} Mar 16 17:21:45 crc kubenswrapper[5120]: I0316 17:21:45.334399 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-global-b2wcf" Mar 16 17:21:45 crc kubenswrapper[5120]: I0316 17:21:45.440086 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nsfn7\" (UniqueName: \"kubernetes.io/projected/5de90149-15ef-4716-be7d-90136958a64e-kube-api-access-nsfn7\") pod \"5de90149-15ef-4716-be7d-90136958a64e\" (UID: \"5de90149-15ef-4716-be7d-90136958a64e\") " Mar 16 17:21:45 crc kubenswrapper[5120]: I0316 17:21:45.440308 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-metadata-neutron-config-2\" (UniqueName: \"kubernetes.io/secret/5de90149-15ef-4716-be7d-90136958a64e-nova-metadata-neutron-config-2\") pod \"5de90149-15ef-4716-be7d-90136958a64e\" (UID: \"5de90149-15ef-4716-be7d-90136958a64e\") " Mar 16 17:21:45 crc kubenswrapper[5120]: I0316 17:21:45.440939 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"neutron-ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5de90149-15ef-4716-be7d-90136958a64e-neutron-ovn-combined-ca-bundle\") pod \"5de90149-15ef-4716-be7d-90136958a64e\" (UID: \"5de90149-15ef-4716-be7d-90136958a64e\") " Mar 16 17:21:45 crc kubenswrapper[5120]: I0316 17:21:45.441046 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"neutron-ovn-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/5de90149-15ef-4716-be7d-90136958a64e-neutron-ovn-agent-neutron-config-0\") pod \"5de90149-15ef-4716-be7d-90136958a64e\" (UID: \"5de90149-15ef-4716-be7d-90136958a64e\") " Mar 16 17:21:45 crc kubenswrapper[5120]: I0316 17:21:45.441152 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/5de90149-15ef-4716-be7d-90136958a64e-inventory\") pod \"5de90149-15ef-4716-be7d-90136958a64e\" (UID: \"5de90149-15ef-4716-be7d-90136958a64e\") " Mar 16 17:21:45 crc kubenswrapper[5120]: I0316 17:21:45.441347 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/5de90149-15ef-4716-be7d-90136958a64e-ssh-key-edpm-compute-global\") pod \"5de90149-15ef-4716-be7d-90136958a64e\" (UID: \"5de90149-15ef-4716-be7d-90136958a64e\") " Mar 16 17:21:45 crc kubenswrapper[5120]: I0316 17:21:45.441500 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-metadata-neutron-config-1\" (UniqueName: \"kubernetes.io/secret/5de90149-15ef-4716-be7d-90136958a64e-nova-metadata-neutron-config-1\") pod \"5de90149-15ef-4716-be7d-90136958a64e\" (UID: \"5de90149-15ef-4716-be7d-90136958a64e\") " Mar 16 17:21:45 crc kubenswrapper[5120]: I0316 17:21:45.441680 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-metadata-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/5de90149-15ef-4716-be7d-90136958a64e-nova-metadata-neutron-config-0\") pod \"5de90149-15ef-4716-be7d-90136958a64e\" (UID: \"5de90149-15ef-4716-be7d-90136958a64e\") " Mar 16 17:21:45 crc kubenswrapper[5120]: I0316 17:21:45.446906 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5de90149-15ef-4716-be7d-90136958a64e-neutron-ovn-combined-ca-bundle" (OuterVolumeSpecName: "neutron-ovn-combined-ca-bundle") pod "5de90149-15ef-4716-be7d-90136958a64e" (UID: "5de90149-15ef-4716-be7d-90136958a64e"). InnerVolumeSpecName "neutron-ovn-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:21:45 crc kubenswrapper[5120]: I0316 17:21:45.447906 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5de90149-15ef-4716-be7d-90136958a64e-kube-api-access-nsfn7" (OuterVolumeSpecName: "kube-api-access-nsfn7") pod "5de90149-15ef-4716-be7d-90136958a64e" (UID: "5de90149-15ef-4716-be7d-90136958a64e"). InnerVolumeSpecName "kube-api-access-nsfn7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:21:45 crc kubenswrapper[5120]: I0316 17:21:45.461959 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5de90149-15ef-4716-be7d-90136958a64e-inventory" (OuterVolumeSpecName: "inventory") pod "5de90149-15ef-4716-be7d-90136958a64e" (UID: "5de90149-15ef-4716-be7d-90136958a64e"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:21:45 crc kubenswrapper[5120]: I0316 17:21:45.462624 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5de90149-15ef-4716-be7d-90136958a64e-neutron-ovn-agent-neutron-config-0" (OuterVolumeSpecName: "neutron-ovn-agent-neutron-config-0") pod "5de90149-15ef-4716-be7d-90136958a64e" (UID: "5de90149-15ef-4716-be7d-90136958a64e"). InnerVolumeSpecName "neutron-ovn-agent-neutron-config-0". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:21:45 crc kubenswrapper[5120]: I0316 17:21:45.462658 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5de90149-15ef-4716-be7d-90136958a64e-ssh-key-edpm-compute-global" (OuterVolumeSpecName: "ssh-key-edpm-compute-global") pod "5de90149-15ef-4716-be7d-90136958a64e" (UID: "5de90149-15ef-4716-be7d-90136958a64e"). InnerVolumeSpecName "ssh-key-edpm-compute-global". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:21:45 crc kubenswrapper[5120]: I0316 17:21:45.462996 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5de90149-15ef-4716-be7d-90136958a64e-nova-metadata-neutron-config-1" (OuterVolumeSpecName: "nova-metadata-neutron-config-1") pod "5de90149-15ef-4716-be7d-90136958a64e" (UID: "5de90149-15ef-4716-be7d-90136958a64e"). InnerVolumeSpecName "nova-metadata-neutron-config-1". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:21:45 crc kubenswrapper[5120]: I0316 17:21:45.464806 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5de90149-15ef-4716-be7d-90136958a64e-nova-metadata-neutron-config-0" (OuterVolumeSpecName: "nova-metadata-neutron-config-0") pod "5de90149-15ef-4716-be7d-90136958a64e" (UID: "5de90149-15ef-4716-be7d-90136958a64e"). InnerVolumeSpecName "nova-metadata-neutron-config-0". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:21:45 crc kubenswrapper[5120]: I0316 17:21:45.476077 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5de90149-15ef-4716-be7d-90136958a64e-nova-metadata-neutron-config-2" (OuterVolumeSpecName: "nova-metadata-neutron-config-2") pod "5de90149-15ef-4716-be7d-90136958a64e" (UID: "5de90149-15ef-4716-be7d-90136958a64e"). InnerVolumeSpecName "nova-metadata-neutron-config-2". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:21:45 crc kubenswrapper[5120]: I0316 17:21:45.544438 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nsfn7\" (UniqueName: \"kubernetes.io/projected/5de90149-15ef-4716-be7d-90136958a64e-kube-api-access-nsfn7\") on node \"crc\" DevicePath \"\"" Mar 16 17:21:45 crc kubenswrapper[5120]: I0316 17:21:45.544670 5120 reconciler_common.go:299] "Volume detached for volume \"nova-metadata-neutron-config-2\" (UniqueName: \"kubernetes.io/secret/5de90149-15ef-4716-be7d-90136958a64e-nova-metadata-neutron-config-2\") on node \"crc\" DevicePath \"\"" Mar 16 17:21:45 crc kubenswrapper[5120]: I0316 17:21:45.544742 5120 reconciler_common.go:299] "Volume detached for volume \"neutron-ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5de90149-15ef-4716-be7d-90136958a64e-neutron-ovn-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:21:45 crc kubenswrapper[5120]: I0316 17:21:45.544832 5120 reconciler_common.go:299] "Volume detached for volume \"neutron-ovn-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/5de90149-15ef-4716-be7d-90136958a64e-neutron-ovn-agent-neutron-config-0\") on node \"crc\" DevicePath \"\"" Mar 16 17:21:45 crc kubenswrapper[5120]: I0316 17:21:45.544890 5120 reconciler_common.go:299] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/5de90149-15ef-4716-be7d-90136958a64e-inventory\") on node \"crc\" DevicePath \"\"" Mar 16 17:21:45 crc kubenswrapper[5120]: I0316 17:21:45.544937 5120 reconciler_common.go:299] "Volume detached for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/5de90149-15ef-4716-be7d-90136958a64e-ssh-key-edpm-compute-global\") on node \"crc\" DevicePath \"\"" Mar 16 17:21:45 crc kubenswrapper[5120]: I0316 17:21:45.544989 5120 reconciler_common.go:299] "Volume detached for volume \"nova-metadata-neutron-config-1\" (UniqueName: \"kubernetes.io/secret/5de90149-15ef-4716-be7d-90136958a64e-nova-metadata-neutron-config-1\") on node \"crc\" DevicePath \"\"" Mar 16 17:21:45 crc kubenswrapper[5120]: I0316 17:21:45.545050 5120 reconciler_common.go:299] "Volume detached for volume \"nova-metadata-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/5de90149-15ef-4716-be7d-90136958a64e-nova-metadata-neutron-config-0\") on node \"crc\" DevicePath \"\"" Mar 16 17:21:46 crc kubenswrapper[5120]: I0316 17:21:46.064619 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-global-b2wcf" Mar 16 17:21:46 crc kubenswrapper[5120]: I0316 17:21:46.064652 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-global-b2wcf" event={"ID":"5de90149-15ef-4716-be7d-90136958a64e","Type":"ContainerDied","Data":"1f180a886d47d5e18972632e5886d473475b585901007b6ea8ef8db72bb44773"} Mar 16 17:21:46 crc kubenswrapper[5120]: I0316 17:21:46.065224 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1f180a886d47d5e18972632e5886d473475b585901007b6ea8ef8db72bb44773" Mar 16 17:21:46 crc kubenswrapper[5120]: I0316 17:21:46.145044 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-sriov-edpm-multinodeset-edpm-compute-global-gvnhj"] Mar 16 17:21:46 crc kubenswrapper[5120]: I0316 17:21:46.146280 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5de90149-15ef-4716-be7d-90136958a64e" containerName="neutron-ovn-edpm-multinodeset-edpm-compute-global" Mar 16 17:21:46 crc kubenswrapper[5120]: I0316 17:21:46.146312 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="5de90149-15ef-4716-be7d-90136958a64e" containerName="neutron-ovn-edpm-multinodeset-edpm-compute-global" Mar 16 17:21:46 crc kubenswrapper[5120]: I0316 17:21:46.146540 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="5de90149-15ef-4716-be7d-90136958a64e" containerName="neutron-ovn-edpm-multinodeset-edpm-compute-global" Mar 16 17:21:46 crc kubenswrapper[5120]: I0316 17:21:46.151830 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-sriov-edpm-multinodeset-edpm-compute-global-gvnhj" Mar 16 17:21:46 crc kubenswrapper[5120]: I0316 17:21:46.156473 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-sriov-agent-neutron-config\"" Mar 16 17:21:46 crc kubenswrapper[5120]: I0316 17:21:46.156901 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-sriov-edpm-multinodeset-edpm-compute-global-gvnhj"] Mar 16 17:21:46 crc kubenswrapper[5120]: I0316 17:21:46.156925 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"combined-ca-bundle\"" Mar 16 17:21:46 crc kubenswrapper[5120]: I0316 17:21:46.157025 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-aee-default-env\"" Mar 16 17:21:46 crc kubenswrapper[5120]: I0316 17:21:46.157201 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplane-ansible-ssh-private-key-secret\"" Mar 16 17:21:46 crc kubenswrapper[5120]: I0316 17:21:46.157658 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplanenodeset-edpm-compute-global\"" Mar 16 17:21:46 crc kubenswrapper[5120]: I0316 17:21:46.158127 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"edpm-compute-global-dockercfg-5hp85\"" Mar 16 17:21:46 crc kubenswrapper[5120]: I0316 17:21:46.290511 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkztj\" (UniqueName: \"kubernetes.io/projected/633b0a27-35c6-40d9-9d84-788905b450fb-kube-api-access-mkztj\") pod \"neutron-sriov-edpm-multinodeset-edpm-compute-global-gvnhj\" (UID: \"633b0a27-35c6-40d9-9d84-788905b450fb\") " pod="openstack-kuttl-tests/neutron-sriov-edpm-multinodeset-edpm-compute-global-gvnhj" Mar 16 17:21:46 crc kubenswrapper[5120]: I0316 17:21:46.290651 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"neutron-sriov-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/633b0a27-35c6-40d9-9d84-788905b450fb-neutron-sriov-combined-ca-bundle\") pod \"neutron-sriov-edpm-multinodeset-edpm-compute-global-gvnhj\" (UID: \"633b0a27-35c6-40d9-9d84-788905b450fb\") " pod="openstack-kuttl-tests/neutron-sriov-edpm-multinodeset-edpm-compute-global-gvnhj" Mar 16 17:21:46 crc kubenswrapper[5120]: I0316 17:21:46.290807 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/633b0a27-35c6-40d9-9d84-788905b450fb-inventory\") pod \"neutron-sriov-edpm-multinodeset-edpm-compute-global-gvnhj\" (UID: \"633b0a27-35c6-40d9-9d84-788905b450fb\") " pod="openstack-kuttl-tests/neutron-sriov-edpm-multinodeset-edpm-compute-global-gvnhj" Mar 16 17:21:46 crc kubenswrapper[5120]: I0316 17:21:46.291212 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"neutron-sriov-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/633b0a27-35c6-40d9-9d84-788905b450fb-neutron-sriov-agent-neutron-config-0\") pod \"neutron-sriov-edpm-multinodeset-edpm-compute-global-gvnhj\" (UID: \"633b0a27-35c6-40d9-9d84-788905b450fb\") " pod="openstack-kuttl-tests/neutron-sriov-edpm-multinodeset-edpm-compute-global-gvnhj" Mar 16 17:21:46 crc kubenswrapper[5120]: I0316 17:21:46.291542 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/633b0a27-35c6-40d9-9d84-788905b450fb-ssh-key-edpm-compute-global\") pod \"neutron-sriov-edpm-multinodeset-edpm-compute-global-gvnhj\" (UID: \"633b0a27-35c6-40d9-9d84-788905b450fb\") " pod="openstack-kuttl-tests/neutron-sriov-edpm-multinodeset-edpm-compute-global-gvnhj" Mar 16 17:21:46 crc kubenswrapper[5120]: I0316 17:21:46.393359 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/633b0a27-35c6-40d9-9d84-788905b450fb-ssh-key-edpm-compute-global\") pod \"neutron-sriov-edpm-multinodeset-edpm-compute-global-gvnhj\" (UID: \"633b0a27-35c6-40d9-9d84-788905b450fb\") " pod="openstack-kuttl-tests/neutron-sriov-edpm-multinodeset-edpm-compute-global-gvnhj" Mar 16 17:21:46 crc kubenswrapper[5120]: I0316 17:21:46.393531 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mkztj\" (UniqueName: \"kubernetes.io/projected/633b0a27-35c6-40d9-9d84-788905b450fb-kube-api-access-mkztj\") pod \"neutron-sriov-edpm-multinodeset-edpm-compute-global-gvnhj\" (UID: \"633b0a27-35c6-40d9-9d84-788905b450fb\") " pod="openstack-kuttl-tests/neutron-sriov-edpm-multinodeset-edpm-compute-global-gvnhj" Mar 16 17:21:46 crc kubenswrapper[5120]: I0316 17:21:46.393572 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"neutron-sriov-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/633b0a27-35c6-40d9-9d84-788905b450fb-neutron-sriov-combined-ca-bundle\") pod \"neutron-sriov-edpm-multinodeset-edpm-compute-global-gvnhj\" (UID: \"633b0a27-35c6-40d9-9d84-788905b450fb\") " pod="openstack-kuttl-tests/neutron-sriov-edpm-multinodeset-edpm-compute-global-gvnhj" Mar 16 17:21:46 crc kubenswrapper[5120]: I0316 17:21:46.393608 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/633b0a27-35c6-40d9-9d84-788905b450fb-inventory\") pod \"neutron-sriov-edpm-multinodeset-edpm-compute-global-gvnhj\" (UID: \"633b0a27-35c6-40d9-9d84-788905b450fb\") " pod="openstack-kuttl-tests/neutron-sriov-edpm-multinodeset-edpm-compute-global-gvnhj" Mar 16 17:21:46 crc kubenswrapper[5120]: I0316 17:21:46.393685 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"neutron-sriov-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/633b0a27-35c6-40d9-9d84-788905b450fb-neutron-sriov-agent-neutron-config-0\") pod \"neutron-sriov-edpm-multinodeset-edpm-compute-global-gvnhj\" (UID: \"633b0a27-35c6-40d9-9d84-788905b450fb\") " pod="openstack-kuttl-tests/neutron-sriov-edpm-multinodeset-edpm-compute-global-gvnhj" Mar 16 17:21:46 crc kubenswrapper[5120]: I0316 17:21:46.398604 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/633b0a27-35c6-40d9-9d84-788905b450fb-inventory\") pod \"neutron-sriov-edpm-multinodeset-edpm-compute-global-gvnhj\" (UID: \"633b0a27-35c6-40d9-9d84-788905b450fb\") " pod="openstack-kuttl-tests/neutron-sriov-edpm-multinodeset-edpm-compute-global-gvnhj" Mar 16 17:21:46 crc kubenswrapper[5120]: I0316 17:21:46.398602 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/633b0a27-35c6-40d9-9d84-788905b450fb-ssh-key-edpm-compute-global\") pod \"neutron-sriov-edpm-multinodeset-edpm-compute-global-gvnhj\" (UID: \"633b0a27-35c6-40d9-9d84-788905b450fb\") " pod="openstack-kuttl-tests/neutron-sriov-edpm-multinodeset-edpm-compute-global-gvnhj" Mar 16 17:21:46 crc kubenswrapper[5120]: I0316 17:21:46.399022 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"neutron-sriov-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/633b0a27-35c6-40d9-9d84-788905b450fb-neutron-sriov-agent-neutron-config-0\") pod \"neutron-sriov-edpm-multinodeset-edpm-compute-global-gvnhj\" (UID: \"633b0a27-35c6-40d9-9d84-788905b450fb\") " pod="openstack-kuttl-tests/neutron-sriov-edpm-multinodeset-edpm-compute-global-gvnhj" Mar 16 17:21:46 crc kubenswrapper[5120]: I0316 17:21:46.401366 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"neutron-sriov-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/633b0a27-35c6-40d9-9d84-788905b450fb-neutron-sriov-combined-ca-bundle\") pod \"neutron-sriov-edpm-multinodeset-edpm-compute-global-gvnhj\" (UID: \"633b0a27-35c6-40d9-9d84-788905b450fb\") " pod="openstack-kuttl-tests/neutron-sriov-edpm-multinodeset-edpm-compute-global-gvnhj" Mar 16 17:21:46 crc kubenswrapper[5120]: I0316 17:21:46.412850 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkztj\" (UniqueName: \"kubernetes.io/projected/633b0a27-35c6-40d9-9d84-788905b450fb-kube-api-access-mkztj\") pod \"neutron-sriov-edpm-multinodeset-edpm-compute-global-gvnhj\" (UID: \"633b0a27-35c6-40d9-9d84-788905b450fb\") " pod="openstack-kuttl-tests/neutron-sriov-edpm-multinodeset-edpm-compute-global-gvnhj" Mar 16 17:21:46 crc kubenswrapper[5120]: I0316 17:21:46.508063 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-sriov-edpm-multinodeset-edpm-compute-global-gvnhj" Mar 16 17:21:46 crc kubenswrapper[5120]: I0316 17:21:46.927507 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-sriov-edpm-multinodeset-edpm-compute-global-gvnhj"] Mar 16 17:21:47 crc kubenswrapper[5120]: I0316 17:21:47.075071 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-sriov-edpm-multinodeset-edpm-compute-global-gvnhj" event={"ID":"633b0a27-35c6-40d9-9d84-788905b450fb","Type":"ContainerStarted","Data":"b625537e6073680808b23b32bbb6b44a8b74aa4562efda5e5ee1e9b6ec4a366b"} Mar 16 17:21:47 crc kubenswrapper[5120]: I0316 17:21:47.360059 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-v822j_ac55471d-4e42-475f-a082-50f611571482/kube-multus/0.log" Mar 16 17:21:47 crc kubenswrapper[5120]: I0316 17:21:47.366714 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-crc_9f0bc7fcb0822a2c13eb2d22cd8c0641/kube-controller-manager/0.log" Mar 16 17:21:47 crc kubenswrapper[5120]: I0316 17:21:47.663697 5120 scope.go:117] "RemoveContainer" containerID="2ca61165dca6fdb30458423ef74c44c42b1b273e8fa504e89f5f9e186e516cc3" Mar 16 17:21:47 crc kubenswrapper[5120]: E0316 17:21:47.663909 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 17:21:47 crc kubenswrapper[5120]: I0316 17:21:47.668159 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-v822j_ac55471d-4e42-475f-a082-50f611571482/kube-multus/0.log" Mar 16 17:21:47 crc kubenswrapper[5120]: I0316 17:21:47.671695 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-crc_9f0bc7fcb0822a2c13eb2d22cd8c0641/kube-controller-manager/0.log" Mar 16 17:21:48 crc kubenswrapper[5120]: I0316 17:21:48.094491 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-sriov-edpm-multinodeset-edpm-compute-global-gvnhj" event={"ID":"633b0a27-35c6-40d9-9d84-788905b450fb","Type":"ContainerStarted","Data":"08645c1b8faa89f8d95a1d5de294466e57647d45e9f58fb2030b3e8eef934a5b"} Mar 16 17:21:48 crc kubenswrapper[5120]: I0316 17:21:48.123038 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-sriov-edpm-multinodeset-edpm-compute-global-gvnhj" podStartSLOduration=1.617002692 podStartE2EDuration="2.123013939s" podCreationTimestamp="2026-03-16 17:21:46 +0000 UTC" firstStartedPulling="2026-03-16 17:21:46.931857691 +0000 UTC m=+6609.085789348" lastFinishedPulling="2026-03-16 17:21:47.437868938 +0000 UTC m=+6609.591800595" observedRunningTime="2026-03-16 17:21:48.113195081 +0000 UTC m=+6610.267126738" watchObservedRunningTime="2026-03-16 17:21:48.123013939 +0000 UTC m=+6610.276945596" Mar 16 17:21:49 crc kubenswrapper[5120]: I0316 17:21:49.107471 5120 generic.go:358] "Generic (PLEG): container finished" podID="633b0a27-35c6-40d9-9d84-788905b450fb" containerID="08645c1b8faa89f8d95a1d5de294466e57647d45e9f58fb2030b3e8eef934a5b" exitCode=0 Mar 16 17:21:49 crc kubenswrapper[5120]: I0316 17:21:49.107589 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-sriov-edpm-multinodeset-edpm-compute-global-gvnhj" event={"ID":"633b0a27-35c6-40d9-9d84-788905b450fb","Type":"ContainerDied","Data":"08645c1b8faa89f8d95a1d5de294466e57647d45e9f58fb2030b3e8eef934a5b"} Mar 16 17:21:50 crc kubenswrapper[5120]: I0316 17:21:50.446045 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-sriov-edpm-multinodeset-edpm-compute-global-gvnhj" Mar 16 17:21:50 crc kubenswrapper[5120]: I0316 17:21:50.491307 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/633b0a27-35c6-40d9-9d84-788905b450fb-ssh-key-edpm-compute-global\") pod \"633b0a27-35c6-40d9-9d84-788905b450fb\" (UID: \"633b0a27-35c6-40d9-9d84-788905b450fb\") " Mar 16 17:21:50 crc kubenswrapper[5120]: I0316 17:21:50.491895 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"neutron-sriov-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/633b0a27-35c6-40d9-9d84-788905b450fb-neutron-sriov-agent-neutron-config-0\") pod \"633b0a27-35c6-40d9-9d84-788905b450fb\" (UID: \"633b0a27-35c6-40d9-9d84-788905b450fb\") " Mar 16 17:21:50 crc kubenswrapper[5120]: I0316 17:21:50.491958 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"neutron-sriov-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/633b0a27-35c6-40d9-9d84-788905b450fb-neutron-sriov-combined-ca-bundle\") pod \"633b0a27-35c6-40d9-9d84-788905b450fb\" (UID: \"633b0a27-35c6-40d9-9d84-788905b450fb\") " Mar 16 17:21:50 crc kubenswrapper[5120]: I0316 17:21:50.492173 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mkztj\" (UniqueName: \"kubernetes.io/projected/633b0a27-35c6-40d9-9d84-788905b450fb-kube-api-access-mkztj\") pod \"633b0a27-35c6-40d9-9d84-788905b450fb\" (UID: \"633b0a27-35c6-40d9-9d84-788905b450fb\") " Mar 16 17:21:50 crc kubenswrapper[5120]: I0316 17:21:50.492421 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/633b0a27-35c6-40d9-9d84-788905b450fb-inventory\") pod \"633b0a27-35c6-40d9-9d84-788905b450fb\" (UID: \"633b0a27-35c6-40d9-9d84-788905b450fb\") " Mar 16 17:21:50 crc kubenswrapper[5120]: I0316 17:21:50.499958 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/633b0a27-35c6-40d9-9d84-788905b450fb-kube-api-access-mkztj" (OuterVolumeSpecName: "kube-api-access-mkztj") pod "633b0a27-35c6-40d9-9d84-788905b450fb" (UID: "633b0a27-35c6-40d9-9d84-788905b450fb"). InnerVolumeSpecName "kube-api-access-mkztj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:21:50 crc kubenswrapper[5120]: I0316 17:21:50.501842 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/633b0a27-35c6-40d9-9d84-788905b450fb-neutron-sriov-combined-ca-bundle" (OuterVolumeSpecName: "neutron-sriov-combined-ca-bundle") pod "633b0a27-35c6-40d9-9d84-788905b450fb" (UID: "633b0a27-35c6-40d9-9d84-788905b450fb"). InnerVolumeSpecName "neutron-sriov-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:21:50 crc kubenswrapper[5120]: I0316 17:21:50.518079 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/633b0a27-35c6-40d9-9d84-788905b450fb-neutron-sriov-agent-neutron-config-0" (OuterVolumeSpecName: "neutron-sriov-agent-neutron-config-0") pod "633b0a27-35c6-40d9-9d84-788905b450fb" (UID: "633b0a27-35c6-40d9-9d84-788905b450fb"). InnerVolumeSpecName "neutron-sriov-agent-neutron-config-0". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:21:50 crc kubenswrapper[5120]: I0316 17:21:50.520071 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/633b0a27-35c6-40d9-9d84-788905b450fb-ssh-key-edpm-compute-global" (OuterVolumeSpecName: "ssh-key-edpm-compute-global") pod "633b0a27-35c6-40d9-9d84-788905b450fb" (UID: "633b0a27-35c6-40d9-9d84-788905b450fb"). InnerVolumeSpecName "ssh-key-edpm-compute-global". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:21:50 crc kubenswrapper[5120]: I0316 17:21:50.527127 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/633b0a27-35c6-40d9-9d84-788905b450fb-inventory" (OuterVolumeSpecName: "inventory") pod "633b0a27-35c6-40d9-9d84-788905b450fb" (UID: "633b0a27-35c6-40d9-9d84-788905b450fb"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:21:50 crc kubenswrapper[5120]: I0316 17:21:50.595497 5120 reconciler_common.go:299] "Volume detached for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/633b0a27-35c6-40d9-9d84-788905b450fb-ssh-key-edpm-compute-global\") on node \"crc\" DevicePath \"\"" Mar 16 17:21:50 crc kubenswrapper[5120]: I0316 17:21:50.595563 5120 reconciler_common.go:299] "Volume detached for volume \"neutron-sriov-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/633b0a27-35c6-40d9-9d84-788905b450fb-neutron-sriov-agent-neutron-config-0\") on node \"crc\" DevicePath \"\"" Mar 16 17:21:50 crc kubenswrapper[5120]: I0316 17:21:50.595576 5120 reconciler_common.go:299] "Volume detached for volume \"neutron-sriov-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/633b0a27-35c6-40d9-9d84-788905b450fb-neutron-sriov-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:21:50 crc kubenswrapper[5120]: I0316 17:21:50.595591 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mkztj\" (UniqueName: \"kubernetes.io/projected/633b0a27-35c6-40d9-9d84-788905b450fb-kube-api-access-mkztj\") on node \"crc\" DevicePath \"\"" Mar 16 17:21:50 crc kubenswrapper[5120]: I0316 17:21:50.595601 5120 reconciler_common.go:299] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/633b0a27-35c6-40d9-9d84-788905b450fb-inventory\") on node \"crc\" DevicePath \"\"" Mar 16 17:21:51 crc kubenswrapper[5120]: I0316 17:21:51.133261 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-sriov-edpm-multinodeset-edpm-compute-global-gvnhj" event={"ID":"633b0a27-35c6-40d9-9d84-788905b450fb","Type":"ContainerDied","Data":"b625537e6073680808b23b32bbb6b44a8b74aa4562efda5e5ee1e9b6ec4a366b"} Mar 16 17:21:51 crc kubenswrapper[5120]: I0316 17:21:51.133503 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b625537e6073680808b23b32bbb6b44a8b74aa4562efda5e5ee1e9b6ec4a366b" Mar 16 17:21:51 crc kubenswrapper[5120]: I0316 17:21:51.133588 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-sriov-edpm-multinodeset-edpm-compute-global-gvnhj" Mar 16 17:21:51 crc kubenswrapper[5120]: I0316 17:21:51.228690 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-dhcp-edpm-multinodeset-edpm-compute-global-4lrzt"] Mar 16 17:21:51 crc kubenswrapper[5120]: I0316 17:21:51.229833 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="633b0a27-35c6-40d9-9d84-788905b450fb" containerName="neutron-sriov-edpm-multinodeset-edpm-compute-global" Mar 16 17:21:51 crc kubenswrapper[5120]: I0316 17:21:51.229863 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="633b0a27-35c6-40d9-9d84-788905b450fb" containerName="neutron-sriov-edpm-multinodeset-edpm-compute-global" Mar 16 17:21:51 crc kubenswrapper[5120]: I0316 17:21:51.230073 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="633b0a27-35c6-40d9-9d84-788905b450fb" containerName="neutron-sriov-edpm-multinodeset-edpm-compute-global" Mar 16 17:21:51 crc kubenswrapper[5120]: I0316 17:21:51.250128 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-dhcp-edpm-multinodeset-edpm-compute-global-4lrzt"] Mar 16 17:21:51 crc kubenswrapper[5120]: I0316 17:21:51.250207 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-dhcp-edpm-multinodeset-edpm-compute-global-4lrzt" Mar 16 17:21:51 crc kubenswrapper[5120]: I0316 17:21:51.253677 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"edpm-compute-global-dockercfg-5hp85\"" Mar 16 17:21:51 crc kubenswrapper[5120]: I0316 17:21:51.254004 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-dhcp-agent-neutron-config\"" Mar 16 17:21:51 crc kubenswrapper[5120]: I0316 17:21:51.254245 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"combined-ca-bundle\"" Mar 16 17:21:51 crc kubenswrapper[5120]: I0316 17:21:51.254512 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplane-ansible-ssh-private-key-secret\"" Mar 16 17:21:51 crc kubenswrapper[5120]: I0316 17:21:51.268464 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-aee-default-env\"" Mar 16 17:21:51 crc kubenswrapper[5120]: I0316 17:21:51.268772 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplanenodeset-edpm-compute-global\"" Mar 16 17:21:51 crc kubenswrapper[5120]: I0316 17:21:51.314207 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"neutron-dhcp-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8f5ad2e0-6689-48e2-8366-690d63b73046-neutron-dhcp-combined-ca-bundle\") pod \"neutron-dhcp-edpm-multinodeset-edpm-compute-global-4lrzt\" (UID: \"8f5ad2e0-6689-48e2-8366-690d63b73046\") " pod="openstack-kuttl-tests/neutron-dhcp-edpm-multinodeset-edpm-compute-global-4lrzt" Mar 16 17:21:51 crc kubenswrapper[5120]: I0316 17:21:51.314473 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"neutron-dhcp-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/8f5ad2e0-6689-48e2-8366-690d63b73046-neutron-dhcp-agent-neutron-config-0\") pod \"neutron-dhcp-edpm-multinodeset-edpm-compute-global-4lrzt\" (UID: \"8f5ad2e0-6689-48e2-8366-690d63b73046\") " pod="openstack-kuttl-tests/neutron-dhcp-edpm-multinodeset-edpm-compute-global-4lrzt" Mar 16 17:21:51 crc kubenswrapper[5120]: I0316 17:21:51.314714 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/8f5ad2e0-6689-48e2-8366-690d63b73046-ssh-key-edpm-compute-global\") pod \"neutron-dhcp-edpm-multinodeset-edpm-compute-global-4lrzt\" (UID: \"8f5ad2e0-6689-48e2-8366-690d63b73046\") " pod="openstack-kuttl-tests/neutron-dhcp-edpm-multinodeset-edpm-compute-global-4lrzt" Mar 16 17:21:51 crc kubenswrapper[5120]: I0316 17:21:51.314778 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/8f5ad2e0-6689-48e2-8366-690d63b73046-inventory\") pod \"neutron-dhcp-edpm-multinodeset-edpm-compute-global-4lrzt\" (UID: \"8f5ad2e0-6689-48e2-8366-690d63b73046\") " pod="openstack-kuttl-tests/neutron-dhcp-edpm-multinodeset-edpm-compute-global-4lrzt" Mar 16 17:21:51 crc kubenswrapper[5120]: I0316 17:21:51.314908 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4prpc\" (UniqueName: \"kubernetes.io/projected/8f5ad2e0-6689-48e2-8366-690d63b73046-kube-api-access-4prpc\") pod \"neutron-dhcp-edpm-multinodeset-edpm-compute-global-4lrzt\" (UID: \"8f5ad2e0-6689-48e2-8366-690d63b73046\") " pod="openstack-kuttl-tests/neutron-dhcp-edpm-multinodeset-edpm-compute-global-4lrzt" Mar 16 17:21:51 crc kubenswrapper[5120]: I0316 17:21:51.416109 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"neutron-dhcp-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8f5ad2e0-6689-48e2-8366-690d63b73046-neutron-dhcp-combined-ca-bundle\") pod \"neutron-dhcp-edpm-multinodeset-edpm-compute-global-4lrzt\" (UID: \"8f5ad2e0-6689-48e2-8366-690d63b73046\") " pod="openstack-kuttl-tests/neutron-dhcp-edpm-multinodeset-edpm-compute-global-4lrzt" Mar 16 17:21:51 crc kubenswrapper[5120]: I0316 17:21:51.416223 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"neutron-dhcp-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/8f5ad2e0-6689-48e2-8366-690d63b73046-neutron-dhcp-agent-neutron-config-0\") pod \"neutron-dhcp-edpm-multinodeset-edpm-compute-global-4lrzt\" (UID: \"8f5ad2e0-6689-48e2-8366-690d63b73046\") " pod="openstack-kuttl-tests/neutron-dhcp-edpm-multinodeset-edpm-compute-global-4lrzt" Mar 16 17:21:51 crc kubenswrapper[5120]: I0316 17:21:51.416352 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/8f5ad2e0-6689-48e2-8366-690d63b73046-ssh-key-edpm-compute-global\") pod \"neutron-dhcp-edpm-multinodeset-edpm-compute-global-4lrzt\" (UID: \"8f5ad2e0-6689-48e2-8366-690d63b73046\") " pod="openstack-kuttl-tests/neutron-dhcp-edpm-multinodeset-edpm-compute-global-4lrzt" Mar 16 17:21:51 crc kubenswrapper[5120]: I0316 17:21:51.416377 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/8f5ad2e0-6689-48e2-8366-690d63b73046-inventory\") pod \"neutron-dhcp-edpm-multinodeset-edpm-compute-global-4lrzt\" (UID: \"8f5ad2e0-6689-48e2-8366-690d63b73046\") " pod="openstack-kuttl-tests/neutron-dhcp-edpm-multinodeset-edpm-compute-global-4lrzt" Mar 16 17:21:51 crc kubenswrapper[5120]: I0316 17:21:51.416452 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4prpc\" (UniqueName: \"kubernetes.io/projected/8f5ad2e0-6689-48e2-8366-690d63b73046-kube-api-access-4prpc\") pod \"neutron-dhcp-edpm-multinodeset-edpm-compute-global-4lrzt\" (UID: \"8f5ad2e0-6689-48e2-8366-690d63b73046\") " pod="openstack-kuttl-tests/neutron-dhcp-edpm-multinodeset-edpm-compute-global-4lrzt" Mar 16 17:21:51 crc kubenswrapper[5120]: I0316 17:21:51.421990 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/8f5ad2e0-6689-48e2-8366-690d63b73046-inventory\") pod \"neutron-dhcp-edpm-multinodeset-edpm-compute-global-4lrzt\" (UID: \"8f5ad2e0-6689-48e2-8366-690d63b73046\") " pod="openstack-kuttl-tests/neutron-dhcp-edpm-multinodeset-edpm-compute-global-4lrzt" Mar 16 17:21:51 crc kubenswrapper[5120]: I0316 17:21:51.422156 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"neutron-dhcp-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/8f5ad2e0-6689-48e2-8366-690d63b73046-neutron-dhcp-agent-neutron-config-0\") pod \"neutron-dhcp-edpm-multinodeset-edpm-compute-global-4lrzt\" (UID: \"8f5ad2e0-6689-48e2-8366-690d63b73046\") " pod="openstack-kuttl-tests/neutron-dhcp-edpm-multinodeset-edpm-compute-global-4lrzt" Mar 16 17:21:51 crc kubenswrapper[5120]: I0316 17:21:51.422498 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"neutron-dhcp-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8f5ad2e0-6689-48e2-8366-690d63b73046-neutron-dhcp-combined-ca-bundle\") pod \"neutron-dhcp-edpm-multinodeset-edpm-compute-global-4lrzt\" (UID: \"8f5ad2e0-6689-48e2-8366-690d63b73046\") " pod="openstack-kuttl-tests/neutron-dhcp-edpm-multinodeset-edpm-compute-global-4lrzt" Mar 16 17:21:51 crc kubenswrapper[5120]: I0316 17:21:51.421799 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/8f5ad2e0-6689-48e2-8366-690d63b73046-ssh-key-edpm-compute-global\") pod \"neutron-dhcp-edpm-multinodeset-edpm-compute-global-4lrzt\" (UID: \"8f5ad2e0-6689-48e2-8366-690d63b73046\") " pod="openstack-kuttl-tests/neutron-dhcp-edpm-multinodeset-edpm-compute-global-4lrzt" Mar 16 17:21:51 crc kubenswrapper[5120]: I0316 17:21:51.441657 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4prpc\" (UniqueName: \"kubernetes.io/projected/8f5ad2e0-6689-48e2-8366-690d63b73046-kube-api-access-4prpc\") pod \"neutron-dhcp-edpm-multinodeset-edpm-compute-global-4lrzt\" (UID: \"8f5ad2e0-6689-48e2-8366-690d63b73046\") " pod="openstack-kuttl-tests/neutron-dhcp-edpm-multinodeset-edpm-compute-global-4lrzt" Mar 16 17:21:51 crc kubenswrapper[5120]: I0316 17:21:51.566654 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-dhcp-edpm-multinodeset-edpm-compute-global-4lrzt" Mar 16 17:21:52 crc kubenswrapper[5120]: I0316 17:21:52.167159 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-dhcp-edpm-multinodeset-edpm-compute-global-4lrzt"] Mar 16 17:21:53 crc kubenswrapper[5120]: I0316 17:21:53.151902 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-dhcp-edpm-multinodeset-edpm-compute-global-4lrzt" event={"ID":"8f5ad2e0-6689-48e2-8366-690d63b73046","Type":"ContainerStarted","Data":"a723609c1f8e6450a49850d7c9310ea3ce008f5f4291bcef712fb830d41910da"} Mar 16 17:21:53 crc kubenswrapper[5120]: I0316 17:21:53.152423 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-dhcp-edpm-multinodeset-edpm-compute-global-4lrzt" event={"ID":"8f5ad2e0-6689-48e2-8366-690d63b73046","Type":"ContainerStarted","Data":"d0b9827c9dfccf130cf8a289cbf0ccf033b1f3b01b0a023d1a2955022fd810b7"} Mar 16 17:21:53 crc kubenswrapper[5120]: I0316 17:21:53.169741 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-dhcp-edpm-multinodeset-edpm-compute-global-4lrzt" podStartSLOduration=1.7617716030000001 podStartE2EDuration="2.169724321s" podCreationTimestamp="2026-03-16 17:21:51 +0000 UTC" firstStartedPulling="2026-03-16 17:21:52.166977421 +0000 UTC m=+6614.320909078" lastFinishedPulling="2026-03-16 17:21:52.574930139 +0000 UTC m=+6614.728861796" observedRunningTime="2026-03-16 17:21:53.166680878 +0000 UTC m=+6615.320612545" watchObservedRunningTime="2026-03-16 17:21:53.169724321 +0000 UTC m=+6615.323655968" Mar 16 17:21:54 crc kubenswrapper[5120]: I0316 17:21:54.162539 5120 generic.go:358] "Generic (PLEG): container finished" podID="8f5ad2e0-6689-48e2-8366-690d63b73046" containerID="a723609c1f8e6450a49850d7c9310ea3ce008f5f4291bcef712fb830d41910da" exitCode=0 Mar 16 17:21:54 crc kubenswrapper[5120]: I0316 17:21:54.162600 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-dhcp-edpm-multinodeset-edpm-compute-global-4lrzt" event={"ID":"8f5ad2e0-6689-48e2-8366-690d63b73046","Type":"ContainerDied","Data":"a723609c1f8e6450a49850d7c9310ea3ce008f5f4291bcef712fb830d41910da"} Mar 16 17:21:55 crc kubenswrapper[5120]: I0316 17:21:55.678306 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-dhcp-edpm-multinodeset-edpm-compute-global-4lrzt" Mar 16 17:21:55 crc kubenswrapper[5120]: I0316 17:21:55.835951 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"neutron-dhcp-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/8f5ad2e0-6689-48e2-8366-690d63b73046-neutron-dhcp-agent-neutron-config-0\") pod \"8f5ad2e0-6689-48e2-8366-690d63b73046\" (UID: \"8f5ad2e0-6689-48e2-8366-690d63b73046\") " Mar 16 17:21:55 crc kubenswrapper[5120]: I0316 17:21:55.836565 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4prpc\" (UniqueName: \"kubernetes.io/projected/8f5ad2e0-6689-48e2-8366-690d63b73046-kube-api-access-4prpc\") pod \"8f5ad2e0-6689-48e2-8366-690d63b73046\" (UID: \"8f5ad2e0-6689-48e2-8366-690d63b73046\") " Mar 16 17:21:55 crc kubenswrapper[5120]: I0316 17:21:55.836672 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/8f5ad2e0-6689-48e2-8366-690d63b73046-ssh-key-edpm-compute-global\") pod \"8f5ad2e0-6689-48e2-8366-690d63b73046\" (UID: \"8f5ad2e0-6689-48e2-8366-690d63b73046\") " Mar 16 17:21:55 crc kubenswrapper[5120]: I0316 17:21:55.837096 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/8f5ad2e0-6689-48e2-8366-690d63b73046-inventory\") pod \"8f5ad2e0-6689-48e2-8366-690d63b73046\" (UID: \"8f5ad2e0-6689-48e2-8366-690d63b73046\") " Mar 16 17:21:55 crc kubenswrapper[5120]: I0316 17:21:55.837200 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"neutron-dhcp-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8f5ad2e0-6689-48e2-8366-690d63b73046-neutron-dhcp-combined-ca-bundle\") pod \"8f5ad2e0-6689-48e2-8366-690d63b73046\" (UID: \"8f5ad2e0-6689-48e2-8366-690d63b73046\") " Mar 16 17:21:55 crc kubenswrapper[5120]: I0316 17:21:55.842445 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f5ad2e0-6689-48e2-8366-690d63b73046-neutron-dhcp-combined-ca-bundle" (OuterVolumeSpecName: "neutron-dhcp-combined-ca-bundle") pod "8f5ad2e0-6689-48e2-8366-690d63b73046" (UID: "8f5ad2e0-6689-48e2-8366-690d63b73046"). InnerVolumeSpecName "neutron-dhcp-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:21:55 crc kubenswrapper[5120]: I0316 17:21:55.845224 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f5ad2e0-6689-48e2-8366-690d63b73046-kube-api-access-4prpc" (OuterVolumeSpecName: "kube-api-access-4prpc") pod "8f5ad2e0-6689-48e2-8366-690d63b73046" (UID: "8f5ad2e0-6689-48e2-8366-690d63b73046"). InnerVolumeSpecName "kube-api-access-4prpc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:21:55 crc kubenswrapper[5120]: I0316 17:21:55.859014 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f5ad2e0-6689-48e2-8366-690d63b73046-ssh-key-edpm-compute-global" (OuterVolumeSpecName: "ssh-key-edpm-compute-global") pod "8f5ad2e0-6689-48e2-8366-690d63b73046" (UID: "8f5ad2e0-6689-48e2-8366-690d63b73046"). InnerVolumeSpecName "ssh-key-edpm-compute-global". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:21:55 crc kubenswrapper[5120]: I0316 17:21:55.860479 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f5ad2e0-6689-48e2-8366-690d63b73046-inventory" (OuterVolumeSpecName: "inventory") pod "8f5ad2e0-6689-48e2-8366-690d63b73046" (UID: "8f5ad2e0-6689-48e2-8366-690d63b73046"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:21:55 crc kubenswrapper[5120]: I0316 17:21:55.873829 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f5ad2e0-6689-48e2-8366-690d63b73046-neutron-dhcp-agent-neutron-config-0" (OuterVolumeSpecName: "neutron-dhcp-agent-neutron-config-0") pod "8f5ad2e0-6689-48e2-8366-690d63b73046" (UID: "8f5ad2e0-6689-48e2-8366-690d63b73046"). InnerVolumeSpecName "neutron-dhcp-agent-neutron-config-0". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:21:55 crc kubenswrapper[5120]: I0316 17:21:55.939578 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4prpc\" (UniqueName: \"kubernetes.io/projected/8f5ad2e0-6689-48e2-8366-690d63b73046-kube-api-access-4prpc\") on node \"crc\" DevicePath \"\"" Mar 16 17:21:55 crc kubenswrapper[5120]: I0316 17:21:55.939620 5120 reconciler_common.go:299] "Volume detached for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/8f5ad2e0-6689-48e2-8366-690d63b73046-ssh-key-edpm-compute-global\") on node \"crc\" DevicePath \"\"" Mar 16 17:21:55 crc kubenswrapper[5120]: I0316 17:21:55.939632 5120 reconciler_common.go:299] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/8f5ad2e0-6689-48e2-8366-690d63b73046-inventory\") on node \"crc\" DevicePath \"\"" Mar 16 17:21:55 crc kubenswrapper[5120]: I0316 17:21:55.939641 5120 reconciler_common.go:299] "Volume detached for volume \"neutron-dhcp-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8f5ad2e0-6689-48e2-8366-690d63b73046-neutron-dhcp-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:21:55 crc kubenswrapper[5120]: I0316 17:21:55.939651 5120 reconciler_common.go:299] "Volume detached for volume \"neutron-dhcp-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/8f5ad2e0-6689-48e2-8366-690d63b73046-neutron-dhcp-agent-neutron-config-0\") on node \"crc\" DevicePath \"\"" Mar 16 17:21:56 crc kubenswrapper[5120]: I0316 17:21:56.180236 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-dhcp-edpm-multinodeset-edpm-compute-global-4lrzt" Mar 16 17:21:56 crc kubenswrapper[5120]: I0316 17:21:56.180246 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-dhcp-edpm-multinodeset-edpm-compute-global-4lrzt" event={"ID":"8f5ad2e0-6689-48e2-8366-690d63b73046","Type":"ContainerDied","Data":"d0b9827c9dfccf130cf8a289cbf0ccf033b1f3b01b0a023d1a2955022fd810b7"} Mar 16 17:21:56 crc kubenswrapper[5120]: I0316 17:21:56.180531 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d0b9827c9dfccf130cf8a289cbf0ccf033b1f3b01b0a023d1a2955022fd810b7" Mar 16 17:21:56 crc kubenswrapper[5120]: I0316 17:21:56.342496 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/libvirt-edpm-multinodeset-edpm-compute-global-q7sgm"] Mar 16 17:21:56 crc kubenswrapper[5120]: I0316 17:21:56.343508 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f5ad2e0-6689-48e2-8366-690d63b73046" containerName="neutron-dhcp-edpm-multinodeset-edpm-compute-global" Mar 16 17:21:56 crc kubenswrapper[5120]: I0316 17:21:56.343704 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f5ad2e0-6689-48e2-8366-690d63b73046" containerName="neutron-dhcp-edpm-multinodeset-edpm-compute-global" Mar 16 17:21:56 crc kubenswrapper[5120]: I0316 17:21:56.343971 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="8f5ad2e0-6689-48e2-8366-690d63b73046" containerName="neutron-dhcp-edpm-multinodeset-edpm-compute-global" Mar 16 17:21:56 crc kubenswrapper[5120]: I0316 17:21:56.350184 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/libvirt-edpm-multinodeset-edpm-compute-global-q7sgm" Mar 16 17:21:56 crc kubenswrapper[5120]: I0316 17:21:56.352321 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"combined-ca-bundle\"" Mar 16 17:21:56 crc kubenswrapper[5120]: I0316 17:21:56.352585 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplane-ansible-ssh-private-key-secret\"" Mar 16 17:21:56 crc kubenswrapper[5120]: I0316 17:21:56.352809 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"edpm-compute-global-dockercfg-5hp85\"" Mar 16 17:21:56 crc kubenswrapper[5120]: I0316 17:21:56.353070 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"libvirt-secret\"" Mar 16 17:21:56 crc kubenswrapper[5120]: I0316 17:21:56.353185 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplanenodeset-edpm-compute-global\"" Mar 16 17:21:56 crc kubenswrapper[5120]: I0316 17:21:56.353891 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-aee-default-env\"" Mar 16 17:21:56 crc kubenswrapper[5120]: I0316 17:21:56.355642 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/libvirt-edpm-multinodeset-edpm-compute-global-q7sgm"] Mar 16 17:21:56 crc kubenswrapper[5120]: I0316 17:21:56.448833 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"libvirt-secret-0\" (UniqueName: \"kubernetes.io/secret/75049598-8303-41ea-ae94-c5f410b8815c-libvirt-secret-0\") pod \"libvirt-edpm-multinodeset-edpm-compute-global-q7sgm\" (UID: \"75049598-8303-41ea-ae94-c5f410b8815c\") " pod="openstack-kuttl-tests/libvirt-edpm-multinodeset-edpm-compute-global-q7sgm" Mar 16 17:21:56 crc kubenswrapper[5120]: I0316 17:21:56.448927 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/75049598-8303-41ea-ae94-c5f410b8815c-ssh-key-edpm-compute-global\") pod \"libvirt-edpm-multinodeset-edpm-compute-global-q7sgm\" (UID: \"75049598-8303-41ea-ae94-c5f410b8815c\") " pod="openstack-kuttl-tests/libvirt-edpm-multinodeset-edpm-compute-global-q7sgm" Mar 16 17:21:56 crc kubenswrapper[5120]: I0316 17:21:56.449119 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/75049598-8303-41ea-ae94-c5f410b8815c-inventory\") pod \"libvirt-edpm-multinodeset-edpm-compute-global-q7sgm\" (UID: \"75049598-8303-41ea-ae94-c5f410b8815c\") " pod="openstack-kuttl-tests/libvirt-edpm-multinodeset-edpm-compute-global-q7sgm" Mar 16 17:21:56 crc kubenswrapper[5120]: I0316 17:21:56.449212 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"libvirt-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/75049598-8303-41ea-ae94-c5f410b8815c-libvirt-combined-ca-bundle\") pod \"libvirt-edpm-multinodeset-edpm-compute-global-q7sgm\" (UID: \"75049598-8303-41ea-ae94-c5f410b8815c\") " pod="openstack-kuttl-tests/libvirt-edpm-multinodeset-edpm-compute-global-q7sgm" Mar 16 17:21:56 crc kubenswrapper[5120]: I0316 17:21:56.449358 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vs7v9\" (UniqueName: \"kubernetes.io/projected/75049598-8303-41ea-ae94-c5f410b8815c-kube-api-access-vs7v9\") pod \"libvirt-edpm-multinodeset-edpm-compute-global-q7sgm\" (UID: \"75049598-8303-41ea-ae94-c5f410b8815c\") " pod="openstack-kuttl-tests/libvirt-edpm-multinodeset-edpm-compute-global-q7sgm" Mar 16 17:21:56 crc kubenswrapper[5120]: I0316 17:21:56.551407 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"libvirt-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/75049598-8303-41ea-ae94-c5f410b8815c-libvirt-combined-ca-bundle\") pod \"libvirt-edpm-multinodeset-edpm-compute-global-q7sgm\" (UID: \"75049598-8303-41ea-ae94-c5f410b8815c\") " pod="openstack-kuttl-tests/libvirt-edpm-multinodeset-edpm-compute-global-q7sgm" Mar 16 17:21:56 crc kubenswrapper[5120]: I0316 17:21:56.551596 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vs7v9\" (UniqueName: \"kubernetes.io/projected/75049598-8303-41ea-ae94-c5f410b8815c-kube-api-access-vs7v9\") pod \"libvirt-edpm-multinodeset-edpm-compute-global-q7sgm\" (UID: \"75049598-8303-41ea-ae94-c5f410b8815c\") " pod="openstack-kuttl-tests/libvirt-edpm-multinodeset-edpm-compute-global-q7sgm" Mar 16 17:21:56 crc kubenswrapper[5120]: I0316 17:21:56.551773 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"libvirt-secret-0\" (UniqueName: \"kubernetes.io/secret/75049598-8303-41ea-ae94-c5f410b8815c-libvirt-secret-0\") pod \"libvirt-edpm-multinodeset-edpm-compute-global-q7sgm\" (UID: \"75049598-8303-41ea-ae94-c5f410b8815c\") " pod="openstack-kuttl-tests/libvirt-edpm-multinodeset-edpm-compute-global-q7sgm" Mar 16 17:21:56 crc kubenswrapper[5120]: I0316 17:21:56.551820 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/75049598-8303-41ea-ae94-c5f410b8815c-ssh-key-edpm-compute-global\") pod \"libvirt-edpm-multinodeset-edpm-compute-global-q7sgm\" (UID: \"75049598-8303-41ea-ae94-c5f410b8815c\") " pod="openstack-kuttl-tests/libvirt-edpm-multinodeset-edpm-compute-global-q7sgm" Mar 16 17:21:56 crc kubenswrapper[5120]: I0316 17:21:56.551920 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/75049598-8303-41ea-ae94-c5f410b8815c-inventory\") pod \"libvirt-edpm-multinodeset-edpm-compute-global-q7sgm\" (UID: \"75049598-8303-41ea-ae94-c5f410b8815c\") " pod="openstack-kuttl-tests/libvirt-edpm-multinodeset-edpm-compute-global-q7sgm" Mar 16 17:21:56 crc kubenswrapper[5120]: I0316 17:21:56.556143 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/75049598-8303-41ea-ae94-c5f410b8815c-ssh-key-edpm-compute-global\") pod \"libvirt-edpm-multinodeset-edpm-compute-global-q7sgm\" (UID: \"75049598-8303-41ea-ae94-c5f410b8815c\") " pod="openstack-kuttl-tests/libvirt-edpm-multinodeset-edpm-compute-global-q7sgm" Mar 16 17:21:56 crc kubenswrapper[5120]: I0316 17:21:56.557145 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"libvirt-secret-0\" (UniqueName: \"kubernetes.io/secret/75049598-8303-41ea-ae94-c5f410b8815c-libvirt-secret-0\") pod \"libvirt-edpm-multinodeset-edpm-compute-global-q7sgm\" (UID: \"75049598-8303-41ea-ae94-c5f410b8815c\") " pod="openstack-kuttl-tests/libvirt-edpm-multinodeset-edpm-compute-global-q7sgm" Mar 16 17:21:56 crc kubenswrapper[5120]: I0316 17:21:56.557382 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"libvirt-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/75049598-8303-41ea-ae94-c5f410b8815c-libvirt-combined-ca-bundle\") pod \"libvirt-edpm-multinodeset-edpm-compute-global-q7sgm\" (UID: \"75049598-8303-41ea-ae94-c5f410b8815c\") " pod="openstack-kuttl-tests/libvirt-edpm-multinodeset-edpm-compute-global-q7sgm" Mar 16 17:21:56 crc kubenswrapper[5120]: I0316 17:21:56.557819 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/75049598-8303-41ea-ae94-c5f410b8815c-inventory\") pod \"libvirt-edpm-multinodeset-edpm-compute-global-q7sgm\" (UID: \"75049598-8303-41ea-ae94-c5f410b8815c\") " pod="openstack-kuttl-tests/libvirt-edpm-multinodeset-edpm-compute-global-q7sgm" Mar 16 17:21:56 crc kubenswrapper[5120]: I0316 17:21:56.572620 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vs7v9\" (UniqueName: \"kubernetes.io/projected/75049598-8303-41ea-ae94-c5f410b8815c-kube-api-access-vs7v9\") pod \"libvirt-edpm-multinodeset-edpm-compute-global-q7sgm\" (UID: \"75049598-8303-41ea-ae94-c5f410b8815c\") " pod="openstack-kuttl-tests/libvirt-edpm-multinodeset-edpm-compute-global-q7sgm" Mar 16 17:21:56 crc kubenswrapper[5120]: I0316 17:21:56.676667 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/libvirt-edpm-multinodeset-edpm-compute-global-q7sgm" Mar 16 17:21:57 crc kubenswrapper[5120]: I0316 17:21:57.090468 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/libvirt-edpm-multinodeset-edpm-compute-global-q7sgm"] Mar 16 17:21:57 crc kubenswrapper[5120]: W0316 17:21:57.093559 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod75049598_8303_41ea_ae94_c5f410b8815c.slice/crio-8bc126e637b7aca81502fa0264efc2cef931ff07c77039f86be0fd5ca80e8a75 WatchSource:0}: Error finding container 8bc126e637b7aca81502fa0264efc2cef931ff07c77039f86be0fd5ca80e8a75: Status 404 returned error can't find the container with id 8bc126e637b7aca81502fa0264efc2cef931ff07c77039f86be0fd5ca80e8a75 Mar 16 17:21:57 crc kubenswrapper[5120]: I0316 17:21:57.190929 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/libvirt-edpm-multinodeset-edpm-compute-global-q7sgm" event={"ID":"75049598-8303-41ea-ae94-c5f410b8815c","Type":"ContainerStarted","Data":"8bc126e637b7aca81502fa0264efc2cef931ff07c77039f86be0fd5ca80e8a75"} Mar 16 17:21:58 crc kubenswrapper[5120]: I0316 17:21:58.201686 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/libvirt-edpm-multinodeset-edpm-compute-global-q7sgm" event={"ID":"75049598-8303-41ea-ae94-c5f410b8815c","Type":"ContainerStarted","Data":"d1f809ed8657df370b218ae3dcfc9edef2857bb56cc4419c1324d294fe903450"} Mar 16 17:21:58 crc kubenswrapper[5120]: I0316 17:21:58.226180 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/libvirt-edpm-multinodeset-edpm-compute-global-q7sgm" podStartSLOduration=1.744716415 podStartE2EDuration="2.2261589s" podCreationTimestamp="2026-03-16 17:21:56 +0000 UTC" firstStartedPulling="2026-03-16 17:21:57.095079563 +0000 UTC m=+6619.249011220" lastFinishedPulling="2026-03-16 17:21:57.576522038 +0000 UTC m=+6619.730453705" observedRunningTime="2026-03-16 17:21:58.218673335 +0000 UTC m=+6620.372604992" watchObservedRunningTime="2026-03-16 17:21:58.2261589 +0000 UTC m=+6620.380090557" Mar 16 17:21:59 crc kubenswrapper[5120]: I0316 17:21:59.213851 5120 generic.go:358] "Generic (PLEG): container finished" podID="75049598-8303-41ea-ae94-c5f410b8815c" containerID="d1f809ed8657df370b218ae3dcfc9edef2857bb56cc4419c1324d294fe903450" exitCode=0 Mar 16 17:21:59 crc kubenswrapper[5120]: I0316 17:21:59.213936 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/libvirt-edpm-multinodeset-edpm-compute-global-q7sgm" event={"ID":"75049598-8303-41ea-ae94-c5f410b8815c","Type":"ContainerDied","Data":"d1f809ed8657df370b218ae3dcfc9edef2857bb56cc4419c1324d294fe903450"} Mar 16 17:22:00 crc kubenswrapper[5120]: I0316 17:22:00.129655 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-infra/auto-csr-approver-29561362-wh99d"] Mar 16 17:22:00 crc kubenswrapper[5120]: I0316 17:22:00.135491 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561362-wh99d" Mar 16 17:22:00 crc kubenswrapper[5120]: I0316 17:22:00.138874 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561362-wh99d"] Mar 16 17:22:00 crc kubenswrapper[5120]: I0316 17:22:00.139110 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"openshift-service-ca.crt\"" Mar 16 17:22:00 crc kubenswrapper[5120]: I0316 17:22:00.139313 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"kube-root-ca.crt\"" Mar 16 17:22:00 crc kubenswrapper[5120]: I0316 17:22:00.140133 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-infra\"/\"csr-approver-sa-dockercfg-x2nsz\"" Mar 16 17:22:00 crc kubenswrapper[5120]: I0316 17:22:00.227456 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x495g\" (UniqueName: \"kubernetes.io/projected/90574d91-311c-41c6-b0aa-335110f0d600-kube-api-access-x495g\") pod \"auto-csr-approver-29561362-wh99d\" (UID: \"90574d91-311c-41c6-b0aa-335110f0d600\") " pod="openshift-infra/auto-csr-approver-29561362-wh99d" Mar 16 17:22:00 crc kubenswrapper[5120]: I0316 17:22:00.329999 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x495g\" (UniqueName: \"kubernetes.io/projected/90574d91-311c-41c6-b0aa-335110f0d600-kube-api-access-x495g\") pod \"auto-csr-approver-29561362-wh99d\" (UID: \"90574d91-311c-41c6-b0aa-335110f0d600\") " pod="openshift-infra/auto-csr-approver-29561362-wh99d" Mar 16 17:22:00 crc kubenswrapper[5120]: I0316 17:22:00.355861 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x495g\" (UniqueName: \"kubernetes.io/projected/90574d91-311c-41c6-b0aa-335110f0d600-kube-api-access-x495g\") pod \"auto-csr-approver-29561362-wh99d\" (UID: \"90574d91-311c-41c6-b0aa-335110f0d600\") " pod="openshift-infra/auto-csr-approver-29561362-wh99d" Mar 16 17:22:00 crc kubenswrapper[5120]: I0316 17:22:00.460533 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561362-wh99d" Mar 16 17:22:00 crc kubenswrapper[5120]: I0316 17:22:00.567893 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/libvirt-edpm-multinodeset-edpm-compute-global-q7sgm" Mar 16 17:22:00 crc kubenswrapper[5120]: I0316 17:22:00.636596 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"libvirt-secret-0\" (UniqueName: \"kubernetes.io/secret/75049598-8303-41ea-ae94-c5f410b8815c-libvirt-secret-0\") pod \"75049598-8303-41ea-ae94-c5f410b8815c\" (UID: \"75049598-8303-41ea-ae94-c5f410b8815c\") " Mar 16 17:22:00 crc kubenswrapper[5120]: I0316 17:22:00.636708 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/75049598-8303-41ea-ae94-c5f410b8815c-ssh-key-edpm-compute-global\") pod \"75049598-8303-41ea-ae94-c5f410b8815c\" (UID: \"75049598-8303-41ea-ae94-c5f410b8815c\") " Mar 16 17:22:00 crc kubenswrapper[5120]: I0316 17:22:00.637173 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"libvirt-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/75049598-8303-41ea-ae94-c5f410b8815c-libvirt-combined-ca-bundle\") pod \"75049598-8303-41ea-ae94-c5f410b8815c\" (UID: \"75049598-8303-41ea-ae94-c5f410b8815c\") " Mar 16 17:22:00 crc kubenswrapper[5120]: I0316 17:22:00.637254 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vs7v9\" (UniqueName: \"kubernetes.io/projected/75049598-8303-41ea-ae94-c5f410b8815c-kube-api-access-vs7v9\") pod \"75049598-8303-41ea-ae94-c5f410b8815c\" (UID: \"75049598-8303-41ea-ae94-c5f410b8815c\") " Mar 16 17:22:00 crc kubenswrapper[5120]: I0316 17:22:00.637476 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/75049598-8303-41ea-ae94-c5f410b8815c-inventory\") pod \"75049598-8303-41ea-ae94-c5f410b8815c\" (UID: \"75049598-8303-41ea-ae94-c5f410b8815c\") " Mar 16 17:22:00 crc kubenswrapper[5120]: I0316 17:22:00.642970 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75049598-8303-41ea-ae94-c5f410b8815c-kube-api-access-vs7v9" (OuterVolumeSpecName: "kube-api-access-vs7v9") pod "75049598-8303-41ea-ae94-c5f410b8815c" (UID: "75049598-8303-41ea-ae94-c5f410b8815c"). InnerVolumeSpecName "kube-api-access-vs7v9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:22:00 crc kubenswrapper[5120]: I0316 17:22:00.645500 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75049598-8303-41ea-ae94-c5f410b8815c-libvirt-combined-ca-bundle" (OuterVolumeSpecName: "libvirt-combined-ca-bundle") pod "75049598-8303-41ea-ae94-c5f410b8815c" (UID: "75049598-8303-41ea-ae94-c5f410b8815c"). InnerVolumeSpecName "libvirt-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:22:00 crc kubenswrapper[5120]: I0316 17:22:00.661569 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75049598-8303-41ea-ae94-c5f410b8815c-libvirt-secret-0" (OuterVolumeSpecName: "libvirt-secret-0") pod "75049598-8303-41ea-ae94-c5f410b8815c" (UID: "75049598-8303-41ea-ae94-c5f410b8815c"). InnerVolumeSpecName "libvirt-secret-0". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:22:00 crc kubenswrapper[5120]: I0316 17:22:00.662299 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75049598-8303-41ea-ae94-c5f410b8815c-inventory" (OuterVolumeSpecName: "inventory") pod "75049598-8303-41ea-ae94-c5f410b8815c" (UID: "75049598-8303-41ea-ae94-c5f410b8815c"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:22:00 crc kubenswrapper[5120]: I0316 17:22:00.665330 5120 scope.go:117] "RemoveContainer" containerID="2ca61165dca6fdb30458423ef74c44c42b1b273e8fa504e89f5f9e186e516cc3" Mar 16 17:22:00 crc kubenswrapper[5120]: E0316 17:22:00.665619 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 17:22:00 crc kubenswrapper[5120]: I0316 17:22:00.672693 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75049598-8303-41ea-ae94-c5f410b8815c-ssh-key-edpm-compute-global" (OuterVolumeSpecName: "ssh-key-edpm-compute-global") pod "75049598-8303-41ea-ae94-c5f410b8815c" (UID: "75049598-8303-41ea-ae94-c5f410b8815c"). InnerVolumeSpecName "ssh-key-edpm-compute-global". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:22:00 crc kubenswrapper[5120]: I0316 17:22:00.741464 5120 reconciler_common.go:299] "Volume detached for volume \"libvirt-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/75049598-8303-41ea-ae94-c5f410b8815c-libvirt-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:22:00 crc kubenswrapper[5120]: I0316 17:22:00.741523 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vs7v9\" (UniqueName: \"kubernetes.io/projected/75049598-8303-41ea-ae94-c5f410b8815c-kube-api-access-vs7v9\") on node \"crc\" DevicePath \"\"" Mar 16 17:22:00 crc kubenswrapper[5120]: I0316 17:22:00.741536 5120 reconciler_common.go:299] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/75049598-8303-41ea-ae94-c5f410b8815c-inventory\") on node \"crc\" DevicePath \"\"" Mar 16 17:22:00 crc kubenswrapper[5120]: I0316 17:22:00.741553 5120 reconciler_common.go:299] "Volume detached for volume \"libvirt-secret-0\" (UniqueName: \"kubernetes.io/secret/75049598-8303-41ea-ae94-c5f410b8815c-libvirt-secret-0\") on node \"crc\" DevicePath \"\"" Mar 16 17:22:00 crc kubenswrapper[5120]: I0316 17:22:00.741568 5120 reconciler_common.go:299] "Volume detached for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/75049598-8303-41ea-ae94-c5f410b8815c-ssh-key-edpm-compute-global\") on node \"crc\" DevicePath \"\"" Mar 16 17:22:00 crc kubenswrapper[5120]: I0316 17:22:00.897985 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561362-wh99d"] Mar 16 17:22:00 crc kubenswrapper[5120]: W0316 17:22:00.898846 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod90574d91_311c_41c6_b0aa_335110f0d600.slice/crio-e5194c998e63ccb3638eb920510f2e99f985c528756b9fb9c90a062990fe043a WatchSource:0}: Error finding container e5194c998e63ccb3638eb920510f2e99f985c528756b9fb9c90a062990fe043a: Status 404 returned error can't find the container with id e5194c998e63ccb3638eb920510f2e99f985c528756b9fb9c90a062990fe043a Mar 16 17:22:01 crc kubenswrapper[5120]: I0316 17:22:01.230256 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/libvirt-edpm-multinodeset-edpm-compute-global-q7sgm" Mar 16 17:22:01 crc kubenswrapper[5120]: I0316 17:22:01.230271 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/libvirt-edpm-multinodeset-edpm-compute-global-q7sgm" event={"ID":"75049598-8303-41ea-ae94-c5f410b8815c","Type":"ContainerDied","Data":"8bc126e637b7aca81502fa0264efc2cef931ff07c77039f86be0fd5ca80e8a75"} Mar 16 17:22:01 crc kubenswrapper[5120]: I0316 17:22:01.230643 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8bc126e637b7aca81502fa0264efc2cef931ff07c77039f86be0fd5ca80e8a75" Mar 16 17:22:01 crc kubenswrapper[5120]: I0316 17:22:01.231537 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561362-wh99d" event={"ID":"90574d91-311c-41c6-b0aa-335110f0d600","Type":"ContainerStarted","Data":"e5194c998e63ccb3638eb920510f2e99f985c528756b9fb9c90a062990fe043a"} Mar 16 17:22:01 crc kubenswrapper[5120]: I0316 17:22:01.301823 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-global-xjfrc"] Mar 16 17:22:01 crc kubenswrapper[5120]: I0316 17:22:01.303223 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75049598-8303-41ea-ae94-c5f410b8815c" containerName="libvirt-edpm-multinodeset-edpm-compute-global" Mar 16 17:22:01 crc kubenswrapper[5120]: I0316 17:22:01.303258 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="75049598-8303-41ea-ae94-c5f410b8815c" containerName="libvirt-edpm-multinodeset-edpm-compute-global" Mar 16 17:22:01 crc kubenswrapper[5120]: I0316 17:22:01.303557 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="75049598-8303-41ea-ae94-c5f410b8815c" containerName="libvirt-edpm-multinodeset-edpm-compute-global" Mar 16 17:22:01 crc kubenswrapper[5120]: I0316 17:22:01.312616 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-global-xjfrc" Mar 16 17:22:01 crc kubenswrapper[5120]: I0316 17:22:01.314711 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-global-xjfrc"] Mar 16 17:22:01 crc kubenswrapper[5120]: I0316 17:22:01.316030 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"edpm-compute-global-dockercfg-5hp85\"" Mar 16 17:22:01 crc kubenswrapper[5120]: I0316 17:22:01.317159 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplane-ansible-ssh-private-key-secret\"" Mar 16 17:22:01 crc kubenswrapper[5120]: I0316 17:22:01.317615 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplanenodeset-edpm-compute-global\"" Mar 16 17:22:01 crc kubenswrapper[5120]: I0316 17:22:01.318097 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"combined-ca-bundle\"" Mar 16 17:22:01 crc kubenswrapper[5120]: I0316 17:22:01.318354 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-aee-default-env\"" Mar 16 17:22:01 crc kubenswrapper[5120]: I0316 17:22:01.318673 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-compute-config\"" Mar 16 17:22:01 crc kubenswrapper[5120]: I0316 17:22:01.318832 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-migration-ssh-key\"" Mar 16 17:22:01 crc kubenswrapper[5120]: I0316 17:22:01.464334 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q79bm\" (UniqueName: \"kubernetes.io/projected/9d13d12e-26e7-4367-b3d0-b9df485bda68-kube-api-access-q79bm\") pod \"nova-edpm-multinodeset-edpm-compute-global-xjfrc\" (UID: \"9d13d12e-26e7-4367-b3d0-b9df485bda68\") " pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-global-xjfrc" Mar 16 17:22:01 crc kubenswrapper[5120]: I0316 17:22:01.464555 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/9d13d12e-26e7-4367-b3d0-b9df485bda68-inventory\") pod \"nova-edpm-multinodeset-edpm-compute-global-xjfrc\" (UID: \"9d13d12e-26e7-4367-b3d0-b9df485bda68\") " pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-global-xjfrc" Mar 16 17:22:01 crc kubenswrapper[5120]: I0316 17:22:01.464642 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-migration-ssh-key-1\" (UniqueName: \"kubernetes.io/secret/9d13d12e-26e7-4367-b3d0-b9df485bda68-nova-migration-ssh-key-1\") pod \"nova-edpm-multinodeset-edpm-compute-global-xjfrc\" (UID: \"9d13d12e-26e7-4367-b3d0-b9df485bda68\") " pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-global-xjfrc" Mar 16 17:22:01 crc kubenswrapper[5120]: I0316 17:22:01.464979 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-cell1-compute-config-0\" (UniqueName: \"kubernetes.io/secret/9d13d12e-26e7-4367-b3d0-b9df485bda68-nova-cell1-compute-config-0\") pod \"nova-edpm-multinodeset-edpm-compute-global-xjfrc\" (UID: \"9d13d12e-26e7-4367-b3d0-b9df485bda68\") " pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-global-xjfrc" Mar 16 17:22:01 crc kubenswrapper[5120]: I0316 17:22:01.465166 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-cell1-compute-config-1\" (UniqueName: \"kubernetes.io/secret/9d13d12e-26e7-4367-b3d0-b9df485bda68-nova-cell1-compute-config-1\") pod \"nova-edpm-multinodeset-edpm-compute-global-xjfrc\" (UID: \"9d13d12e-26e7-4367-b3d0-b9df485bda68\") " pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-global-xjfrc" Mar 16 17:22:01 crc kubenswrapper[5120]: I0316 17:22:01.465356 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9d13d12e-26e7-4367-b3d0-b9df485bda68-nova-combined-ca-bundle\") pod \"nova-edpm-multinodeset-edpm-compute-global-xjfrc\" (UID: \"9d13d12e-26e7-4367-b3d0-b9df485bda68\") " pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-global-xjfrc" Mar 16 17:22:01 crc kubenswrapper[5120]: I0316 17:22:01.465443 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/9d13d12e-26e7-4367-b3d0-b9df485bda68-ssh-key-edpm-compute-global\") pod \"nova-edpm-multinodeset-edpm-compute-global-xjfrc\" (UID: \"9d13d12e-26e7-4367-b3d0-b9df485bda68\") " pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-global-xjfrc" Mar 16 17:22:01 crc kubenswrapper[5120]: I0316 17:22:01.465489 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-migration-ssh-key-0\" (UniqueName: \"kubernetes.io/secret/9d13d12e-26e7-4367-b3d0-b9df485bda68-nova-migration-ssh-key-0\") pod \"nova-edpm-multinodeset-edpm-compute-global-xjfrc\" (UID: \"9d13d12e-26e7-4367-b3d0-b9df485bda68\") " pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-global-xjfrc" Mar 16 17:22:01 crc kubenswrapper[5120]: I0316 17:22:01.567536 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9d13d12e-26e7-4367-b3d0-b9df485bda68-nova-combined-ca-bundle\") pod \"nova-edpm-multinodeset-edpm-compute-global-xjfrc\" (UID: \"9d13d12e-26e7-4367-b3d0-b9df485bda68\") " pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-global-xjfrc" Mar 16 17:22:01 crc kubenswrapper[5120]: I0316 17:22:01.567667 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/9d13d12e-26e7-4367-b3d0-b9df485bda68-ssh-key-edpm-compute-global\") pod \"nova-edpm-multinodeset-edpm-compute-global-xjfrc\" (UID: \"9d13d12e-26e7-4367-b3d0-b9df485bda68\") " pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-global-xjfrc" Mar 16 17:22:01 crc kubenswrapper[5120]: I0316 17:22:01.567914 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-migration-ssh-key-0\" (UniqueName: \"kubernetes.io/secret/9d13d12e-26e7-4367-b3d0-b9df485bda68-nova-migration-ssh-key-0\") pod \"nova-edpm-multinodeset-edpm-compute-global-xjfrc\" (UID: \"9d13d12e-26e7-4367-b3d0-b9df485bda68\") " pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-global-xjfrc" Mar 16 17:22:01 crc kubenswrapper[5120]: I0316 17:22:01.568108 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q79bm\" (UniqueName: \"kubernetes.io/projected/9d13d12e-26e7-4367-b3d0-b9df485bda68-kube-api-access-q79bm\") pod \"nova-edpm-multinodeset-edpm-compute-global-xjfrc\" (UID: \"9d13d12e-26e7-4367-b3d0-b9df485bda68\") " pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-global-xjfrc" Mar 16 17:22:01 crc kubenswrapper[5120]: I0316 17:22:01.568226 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/9d13d12e-26e7-4367-b3d0-b9df485bda68-inventory\") pod \"nova-edpm-multinodeset-edpm-compute-global-xjfrc\" (UID: \"9d13d12e-26e7-4367-b3d0-b9df485bda68\") " pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-global-xjfrc" Mar 16 17:22:01 crc kubenswrapper[5120]: I0316 17:22:01.568272 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-migration-ssh-key-1\" (UniqueName: \"kubernetes.io/secret/9d13d12e-26e7-4367-b3d0-b9df485bda68-nova-migration-ssh-key-1\") pod \"nova-edpm-multinodeset-edpm-compute-global-xjfrc\" (UID: \"9d13d12e-26e7-4367-b3d0-b9df485bda68\") " pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-global-xjfrc" Mar 16 17:22:01 crc kubenswrapper[5120]: I0316 17:22:01.568481 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-cell1-compute-config-0\" (UniqueName: \"kubernetes.io/secret/9d13d12e-26e7-4367-b3d0-b9df485bda68-nova-cell1-compute-config-0\") pod \"nova-edpm-multinodeset-edpm-compute-global-xjfrc\" (UID: \"9d13d12e-26e7-4367-b3d0-b9df485bda68\") " pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-global-xjfrc" Mar 16 17:22:01 crc kubenswrapper[5120]: I0316 17:22:01.568581 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-cell1-compute-config-1\" (UniqueName: \"kubernetes.io/secret/9d13d12e-26e7-4367-b3d0-b9df485bda68-nova-cell1-compute-config-1\") pod \"nova-edpm-multinodeset-edpm-compute-global-xjfrc\" (UID: \"9d13d12e-26e7-4367-b3d0-b9df485bda68\") " pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-global-xjfrc" Mar 16 17:22:01 crc kubenswrapper[5120]: I0316 17:22:01.572934 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-cell1-compute-config-0\" (UniqueName: \"kubernetes.io/secret/9d13d12e-26e7-4367-b3d0-b9df485bda68-nova-cell1-compute-config-0\") pod \"nova-edpm-multinodeset-edpm-compute-global-xjfrc\" (UID: \"9d13d12e-26e7-4367-b3d0-b9df485bda68\") " pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-global-xjfrc" Mar 16 17:22:01 crc kubenswrapper[5120]: I0316 17:22:01.573025 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-migration-ssh-key-0\" (UniqueName: \"kubernetes.io/secret/9d13d12e-26e7-4367-b3d0-b9df485bda68-nova-migration-ssh-key-0\") pod \"nova-edpm-multinodeset-edpm-compute-global-xjfrc\" (UID: \"9d13d12e-26e7-4367-b3d0-b9df485bda68\") " pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-global-xjfrc" Mar 16 17:22:01 crc kubenswrapper[5120]: I0316 17:22:01.573065 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9d13d12e-26e7-4367-b3d0-b9df485bda68-nova-combined-ca-bundle\") pod \"nova-edpm-multinodeset-edpm-compute-global-xjfrc\" (UID: \"9d13d12e-26e7-4367-b3d0-b9df485bda68\") " pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-global-xjfrc" Mar 16 17:22:01 crc kubenswrapper[5120]: I0316 17:22:01.573813 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/9d13d12e-26e7-4367-b3d0-b9df485bda68-ssh-key-edpm-compute-global\") pod \"nova-edpm-multinodeset-edpm-compute-global-xjfrc\" (UID: \"9d13d12e-26e7-4367-b3d0-b9df485bda68\") " pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-global-xjfrc" Mar 16 17:22:01 crc kubenswrapper[5120]: I0316 17:22:01.574262 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/9d13d12e-26e7-4367-b3d0-b9df485bda68-inventory\") pod \"nova-edpm-multinodeset-edpm-compute-global-xjfrc\" (UID: \"9d13d12e-26e7-4367-b3d0-b9df485bda68\") " pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-global-xjfrc" Mar 16 17:22:01 crc kubenswrapper[5120]: I0316 17:22:01.574282 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-cell1-compute-config-1\" (UniqueName: \"kubernetes.io/secret/9d13d12e-26e7-4367-b3d0-b9df485bda68-nova-cell1-compute-config-1\") pod \"nova-edpm-multinodeset-edpm-compute-global-xjfrc\" (UID: \"9d13d12e-26e7-4367-b3d0-b9df485bda68\") " pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-global-xjfrc" Mar 16 17:22:01 crc kubenswrapper[5120]: I0316 17:22:01.574825 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-migration-ssh-key-1\" (UniqueName: \"kubernetes.io/secret/9d13d12e-26e7-4367-b3d0-b9df485bda68-nova-migration-ssh-key-1\") pod \"nova-edpm-multinodeset-edpm-compute-global-xjfrc\" (UID: \"9d13d12e-26e7-4367-b3d0-b9df485bda68\") " pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-global-xjfrc" Mar 16 17:22:01 crc kubenswrapper[5120]: I0316 17:22:01.586989 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q79bm\" (UniqueName: \"kubernetes.io/projected/9d13d12e-26e7-4367-b3d0-b9df485bda68-kube-api-access-q79bm\") pod \"nova-edpm-multinodeset-edpm-compute-global-xjfrc\" (UID: \"9d13d12e-26e7-4367-b3d0-b9df485bda68\") " pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-global-xjfrc" Mar 16 17:22:01 crc kubenswrapper[5120]: I0316 17:22:01.648271 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-global-xjfrc" Mar 16 17:22:02 crc kubenswrapper[5120]: I0316 17:22:02.055716 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-global-xjfrc"] Mar 16 17:22:02 crc kubenswrapper[5120]: W0316 17:22:02.057523 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9d13d12e_26e7_4367_b3d0_b9df485bda68.slice/crio-2d846bb5f1bdf7b5c8ad06020120317eac4aedd937092edb22c57ebce60a67d6 WatchSource:0}: Error finding container 2d846bb5f1bdf7b5c8ad06020120317eac4aedd937092edb22c57ebce60a67d6: Status 404 returned error can't find the container with id 2d846bb5f1bdf7b5c8ad06020120317eac4aedd937092edb22c57ebce60a67d6 Mar 16 17:22:02 crc kubenswrapper[5120]: I0316 17:22:02.249935 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-global-xjfrc" event={"ID":"9d13d12e-26e7-4367-b3d0-b9df485bda68","Type":"ContainerStarted","Data":"2d846bb5f1bdf7b5c8ad06020120317eac4aedd937092edb22c57ebce60a67d6"} Mar 16 17:22:03 crc kubenswrapper[5120]: I0316 17:22:03.259248 5120 generic.go:358] "Generic (PLEG): container finished" podID="90574d91-311c-41c6-b0aa-335110f0d600" containerID="4872ac50a742af8e990415e0942fa24b81c82ce727529d46983f5d4223e6e345" exitCode=0 Mar 16 17:22:03 crc kubenswrapper[5120]: I0316 17:22:03.259977 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561362-wh99d" event={"ID":"90574d91-311c-41c6-b0aa-335110f0d600","Type":"ContainerDied","Data":"4872ac50a742af8e990415e0942fa24b81c82ce727529d46983f5d4223e6e345"} Mar 16 17:22:03 crc kubenswrapper[5120]: I0316 17:22:03.262114 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-global-xjfrc" event={"ID":"9d13d12e-26e7-4367-b3d0-b9df485bda68","Type":"ContainerStarted","Data":"1b7ae89447979578b9ba1f1f6e01df8833f240df36f957865d3e9a970bd9c7a4"} Mar 16 17:22:04 crc kubenswrapper[5120]: I0316 17:22:04.271834 5120 generic.go:358] "Generic (PLEG): container finished" podID="9d13d12e-26e7-4367-b3d0-b9df485bda68" containerID="1b7ae89447979578b9ba1f1f6e01df8833f240df36f957865d3e9a970bd9c7a4" exitCode=0 Mar 16 17:22:04 crc kubenswrapper[5120]: I0316 17:22:04.271885 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-global-xjfrc" event={"ID":"9d13d12e-26e7-4367-b3d0-b9df485bda68","Type":"ContainerDied","Data":"1b7ae89447979578b9ba1f1f6e01df8833f240df36f957865d3e9a970bd9c7a4"} Mar 16 17:22:04 crc kubenswrapper[5120]: I0316 17:22:04.550517 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561362-wh99d" Mar 16 17:22:04 crc kubenswrapper[5120]: I0316 17:22:04.638172 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x495g\" (UniqueName: \"kubernetes.io/projected/90574d91-311c-41c6-b0aa-335110f0d600-kube-api-access-x495g\") pod \"90574d91-311c-41c6-b0aa-335110f0d600\" (UID: \"90574d91-311c-41c6-b0aa-335110f0d600\") " Mar 16 17:22:04 crc kubenswrapper[5120]: I0316 17:22:04.644201 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90574d91-311c-41c6-b0aa-335110f0d600-kube-api-access-x495g" (OuterVolumeSpecName: "kube-api-access-x495g") pod "90574d91-311c-41c6-b0aa-335110f0d600" (UID: "90574d91-311c-41c6-b0aa-335110f0d600"). InnerVolumeSpecName "kube-api-access-x495g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:22:04 crc kubenswrapper[5120]: I0316 17:22:04.741146 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x495g\" (UniqueName: \"kubernetes.io/projected/90574d91-311c-41c6-b0aa-335110f0d600-kube-api-access-x495g\") on node \"crc\" DevicePath \"\"" Mar 16 17:22:05 crc kubenswrapper[5120]: I0316 17:22:05.281479 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561362-wh99d" Mar 16 17:22:05 crc kubenswrapper[5120]: I0316 17:22:05.281631 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561362-wh99d" event={"ID":"90574d91-311c-41c6-b0aa-335110f0d600","Type":"ContainerDied","Data":"e5194c998e63ccb3638eb920510f2e99f985c528756b9fb9c90a062990fe043a"} Mar 16 17:22:05 crc kubenswrapper[5120]: I0316 17:22:05.282244 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e5194c998e63ccb3638eb920510f2e99f985c528756b9fb9c90a062990fe043a" Mar 16 17:22:05 crc kubenswrapper[5120]: I0316 17:22:05.536226 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-global-xjfrc" Mar 16 17:22:05 crc kubenswrapper[5120]: I0316 17:22:05.560358 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9d13d12e-26e7-4367-b3d0-b9df485bda68-nova-combined-ca-bundle\") pod \"9d13d12e-26e7-4367-b3d0-b9df485bda68\" (UID: \"9d13d12e-26e7-4367-b3d0-b9df485bda68\") " Mar 16 17:22:05 crc kubenswrapper[5120]: I0316 17:22:05.560488 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q79bm\" (UniqueName: \"kubernetes.io/projected/9d13d12e-26e7-4367-b3d0-b9df485bda68-kube-api-access-q79bm\") pod \"9d13d12e-26e7-4367-b3d0-b9df485bda68\" (UID: \"9d13d12e-26e7-4367-b3d0-b9df485bda68\") " Mar 16 17:22:05 crc kubenswrapper[5120]: I0316 17:22:05.560635 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/9d13d12e-26e7-4367-b3d0-b9df485bda68-inventory\") pod \"9d13d12e-26e7-4367-b3d0-b9df485bda68\" (UID: \"9d13d12e-26e7-4367-b3d0-b9df485bda68\") " Mar 16 17:22:05 crc kubenswrapper[5120]: I0316 17:22:05.560695 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-cell1-compute-config-1\" (UniqueName: \"kubernetes.io/secret/9d13d12e-26e7-4367-b3d0-b9df485bda68-nova-cell1-compute-config-1\") pod \"9d13d12e-26e7-4367-b3d0-b9df485bda68\" (UID: \"9d13d12e-26e7-4367-b3d0-b9df485bda68\") " Mar 16 17:22:05 crc kubenswrapper[5120]: I0316 17:22:05.560800 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-migration-ssh-key-1\" (UniqueName: \"kubernetes.io/secret/9d13d12e-26e7-4367-b3d0-b9df485bda68-nova-migration-ssh-key-1\") pod \"9d13d12e-26e7-4367-b3d0-b9df485bda68\" (UID: \"9d13d12e-26e7-4367-b3d0-b9df485bda68\") " Mar 16 17:22:05 crc kubenswrapper[5120]: I0316 17:22:05.560865 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-cell1-compute-config-0\" (UniqueName: \"kubernetes.io/secret/9d13d12e-26e7-4367-b3d0-b9df485bda68-nova-cell1-compute-config-0\") pod \"9d13d12e-26e7-4367-b3d0-b9df485bda68\" (UID: \"9d13d12e-26e7-4367-b3d0-b9df485bda68\") " Mar 16 17:22:05 crc kubenswrapper[5120]: I0316 17:22:05.561021 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-migration-ssh-key-0\" (UniqueName: \"kubernetes.io/secret/9d13d12e-26e7-4367-b3d0-b9df485bda68-nova-migration-ssh-key-0\") pod \"9d13d12e-26e7-4367-b3d0-b9df485bda68\" (UID: \"9d13d12e-26e7-4367-b3d0-b9df485bda68\") " Mar 16 17:22:05 crc kubenswrapper[5120]: I0316 17:22:05.561255 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/9d13d12e-26e7-4367-b3d0-b9df485bda68-ssh-key-edpm-compute-global\") pod \"9d13d12e-26e7-4367-b3d0-b9df485bda68\" (UID: \"9d13d12e-26e7-4367-b3d0-b9df485bda68\") " Mar 16 17:22:05 crc kubenswrapper[5120]: I0316 17:22:05.565933 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d13d12e-26e7-4367-b3d0-b9df485bda68-kube-api-access-q79bm" (OuterVolumeSpecName: "kube-api-access-q79bm") pod "9d13d12e-26e7-4367-b3d0-b9df485bda68" (UID: "9d13d12e-26e7-4367-b3d0-b9df485bda68"). InnerVolumeSpecName "kube-api-access-q79bm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:22:05 crc kubenswrapper[5120]: I0316 17:22:05.566060 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9d13d12e-26e7-4367-b3d0-b9df485bda68-nova-combined-ca-bundle" (OuterVolumeSpecName: "nova-combined-ca-bundle") pod "9d13d12e-26e7-4367-b3d0-b9df485bda68" (UID: "9d13d12e-26e7-4367-b3d0-b9df485bda68"). InnerVolumeSpecName "nova-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:22:05 crc kubenswrapper[5120]: I0316 17:22:05.590722 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9d13d12e-26e7-4367-b3d0-b9df485bda68-nova-migration-ssh-key-1" (OuterVolumeSpecName: "nova-migration-ssh-key-1") pod "9d13d12e-26e7-4367-b3d0-b9df485bda68" (UID: "9d13d12e-26e7-4367-b3d0-b9df485bda68"). InnerVolumeSpecName "nova-migration-ssh-key-1". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:22:05 crc kubenswrapper[5120]: I0316 17:22:05.594096 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9d13d12e-26e7-4367-b3d0-b9df485bda68-ssh-key-edpm-compute-global" (OuterVolumeSpecName: "ssh-key-edpm-compute-global") pod "9d13d12e-26e7-4367-b3d0-b9df485bda68" (UID: "9d13d12e-26e7-4367-b3d0-b9df485bda68"). InnerVolumeSpecName "ssh-key-edpm-compute-global". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:22:05 crc kubenswrapper[5120]: I0316 17:22:05.594208 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9d13d12e-26e7-4367-b3d0-b9df485bda68-nova-migration-ssh-key-0" (OuterVolumeSpecName: "nova-migration-ssh-key-0") pod "9d13d12e-26e7-4367-b3d0-b9df485bda68" (UID: "9d13d12e-26e7-4367-b3d0-b9df485bda68"). InnerVolumeSpecName "nova-migration-ssh-key-0". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:22:05 crc kubenswrapper[5120]: I0316 17:22:05.602984 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9d13d12e-26e7-4367-b3d0-b9df485bda68-inventory" (OuterVolumeSpecName: "inventory") pod "9d13d12e-26e7-4367-b3d0-b9df485bda68" (UID: "9d13d12e-26e7-4367-b3d0-b9df485bda68"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:22:05 crc kubenswrapper[5120]: I0316 17:22:05.606320 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9d13d12e-26e7-4367-b3d0-b9df485bda68-nova-cell1-compute-config-1" (OuterVolumeSpecName: "nova-cell1-compute-config-1") pod "9d13d12e-26e7-4367-b3d0-b9df485bda68" (UID: "9d13d12e-26e7-4367-b3d0-b9df485bda68"). InnerVolumeSpecName "nova-cell1-compute-config-1". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:22:05 crc kubenswrapper[5120]: I0316 17:22:05.607006 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9d13d12e-26e7-4367-b3d0-b9df485bda68-nova-cell1-compute-config-0" (OuterVolumeSpecName: "nova-cell1-compute-config-0") pod "9d13d12e-26e7-4367-b3d0-b9df485bda68" (UID: "9d13d12e-26e7-4367-b3d0-b9df485bda68"). InnerVolumeSpecName "nova-cell1-compute-config-0". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:22:05 crc kubenswrapper[5120]: I0316 17:22:05.621791 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-infra/auto-csr-approver-29561356-xzfvc"] Mar 16 17:22:05 crc kubenswrapper[5120]: I0316 17:22:05.629841 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-infra/auto-csr-approver-29561356-xzfvc"] Mar 16 17:22:05 crc kubenswrapper[5120]: I0316 17:22:05.665246 5120 reconciler_common.go:299] "Volume detached for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/9d13d12e-26e7-4367-b3d0-b9df485bda68-ssh-key-edpm-compute-global\") on node \"crc\" DevicePath \"\"" Mar 16 17:22:05 crc kubenswrapper[5120]: I0316 17:22:05.665276 5120 reconciler_common.go:299] "Volume detached for volume \"nova-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9d13d12e-26e7-4367-b3d0-b9df485bda68-nova-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:22:05 crc kubenswrapper[5120]: I0316 17:22:05.665286 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q79bm\" (UniqueName: \"kubernetes.io/projected/9d13d12e-26e7-4367-b3d0-b9df485bda68-kube-api-access-q79bm\") on node \"crc\" DevicePath \"\"" Mar 16 17:22:05 crc kubenswrapper[5120]: I0316 17:22:05.665294 5120 reconciler_common.go:299] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/9d13d12e-26e7-4367-b3d0-b9df485bda68-inventory\") on node \"crc\" DevicePath \"\"" Mar 16 17:22:05 crc kubenswrapper[5120]: I0316 17:22:05.665303 5120 reconciler_common.go:299] "Volume detached for volume \"nova-cell1-compute-config-1\" (UniqueName: \"kubernetes.io/secret/9d13d12e-26e7-4367-b3d0-b9df485bda68-nova-cell1-compute-config-1\") on node \"crc\" DevicePath \"\"" Mar 16 17:22:05 crc kubenswrapper[5120]: I0316 17:22:05.665312 5120 reconciler_common.go:299] "Volume detached for volume \"nova-migration-ssh-key-1\" (UniqueName: \"kubernetes.io/secret/9d13d12e-26e7-4367-b3d0-b9df485bda68-nova-migration-ssh-key-1\") on node \"crc\" DevicePath \"\"" Mar 16 17:22:05 crc kubenswrapper[5120]: I0316 17:22:05.665322 5120 reconciler_common.go:299] "Volume detached for volume \"nova-cell1-compute-config-0\" (UniqueName: \"kubernetes.io/secret/9d13d12e-26e7-4367-b3d0-b9df485bda68-nova-cell1-compute-config-0\") on node \"crc\" DevicePath \"\"" Mar 16 17:22:05 crc kubenswrapper[5120]: I0316 17:22:05.665331 5120 reconciler_common.go:299] "Volume detached for volume \"nova-migration-ssh-key-0\" (UniqueName: \"kubernetes.io/secret/9d13d12e-26e7-4367-b3d0-b9df485bda68-nova-migration-ssh-key-0\") on node \"crc\" DevicePath \"\"" Mar 16 17:22:06 crc kubenswrapper[5120]: I0316 17:22:06.291835 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-global-xjfrc" event={"ID":"9d13d12e-26e7-4367-b3d0-b9df485bda68","Type":"ContainerDied","Data":"2d846bb5f1bdf7b5c8ad06020120317eac4aedd937092edb22c57ebce60a67d6"} Mar 16 17:22:06 crc kubenswrapper[5120]: I0316 17:22:06.292167 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2d846bb5f1bdf7b5c8ad06020120317eac4aedd937092edb22c57ebce60a67d6" Mar 16 17:22:06 crc kubenswrapper[5120]: I0316 17:22:06.292229 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-global-xjfrc" Mar 16 17:22:06 crc kubenswrapper[5120]: I0316 17:22:06.356688 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/custom-global-service-edpm-multinodeset-smz7m"] Mar 16 17:22:06 crc kubenswrapper[5120]: I0316 17:22:06.357670 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90574d91-311c-41c6-b0aa-335110f0d600" containerName="oc" Mar 16 17:22:06 crc kubenswrapper[5120]: I0316 17:22:06.357691 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="90574d91-311c-41c6-b0aa-335110f0d600" containerName="oc" Mar 16 17:22:06 crc kubenswrapper[5120]: I0316 17:22:06.357701 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d13d12e-26e7-4367-b3d0-b9df485bda68" containerName="nova-edpm-multinodeset-edpm-compute-global" Mar 16 17:22:06 crc kubenswrapper[5120]: I0316 17:22:06.357708 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d13d12e-26e7-4367-b3d0-b9df485bda68" containerName="nova-edpm-multinodeset-edpm-compute-global" Mar 16 17:22:06 crc kubenswrapper[5120]: I0316 17:22:06.357912 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="9d13d12e-26e7-4367-b3d0-b9df485bda68" containerName="nova-edpm-multinodeset-edpm-compute-global" Mar 16 17:22:06 crc kubenswrapper[5120]: I0316 17:22:06.357937 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="90574d91-311c-41c6-b0aa-335110f0d600" containerName="oc" Mar 16 17:22:06 crc kubenswrapper[5120]: I0316 17:22:06.368516 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/custom-global-service-edpm-multinodeset-smz7m" Mar 16 17:22:06 crc kubenswrapper[5120]: I0316 17:22:06.377690 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/custom-global-service-edpm-multinodeset-smz7m"] Mar 16 17:22:06 crc kubenswrapper[5120]: I0316 17:22:06.379661 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"edpm-compute-global-dockercfg-5hp85\"" Mar 16 17:22:06 crc kubenswrapper[5120]: I0316 17:22:06.379861 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplanenodeset-edpm-compute-beta-nodeset\"" Mar 16 17:22:06 crc kubenswrapper[5120]: I0316 17:22:06.379955 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"combined-ca-bundle\"" Mar 16 17:22:06 crc kubenswrapper[5120]: I0316 17:22:06.379663 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplanenodeset-edpm-compute-global\"" Mar 16 17:22:06 crc kubenswrapper[5120]: I0316 17:22:06.380157 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplane-ansible-ssh-private-key-secret\"" Mar 16 17:22:06 crc kubenswrapper[5120]: I0316 17:22:06.380314 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-aee-default-env\"" Mar 16 17:22:06 crc kubenswrapper[5120]: I0316 17:22:06.481430 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/0a3c728f-b518-4879-bd48-9e96e30eb49e-ssh-key-edpm-compute-global\") pod \"custom-global-service-edpm-multinodeset-smz7m\" (UID: \"0a3c728f-b518-4879-bd48-9e96e30eb49e\") " pod="openstack-kuttl-tests/custom-global-service-edpm-multinodeset-smz7m" Mar 16 17:22:06 crc kubenswrapper[5120]: I0316 17:22:06.481948 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key-edpm-compute-beta-nodeset\" (UniqueName: \"kubernetes.io/secret/0a3c728f-b518-4879-bd48-9e96e30eb49e-ssh-key-edpm-compute-beta-nodeset\") pod \"custom-global-service-edpm-multinodeset-smz7m\" (UID: \"0a3c728f-b518-4879-bd48-9e96e30eb49e\") " pod="openstack-kuttl-tests/custom-global-service-edpm-multinodeset-smz7m" Mar 16 17:22:06 crc kubenswrapper[5120]: I0316 17:22:06.482087 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"custom-global-service-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0a3c728f-b518-4879-bd48-9e96e30eb49e-custom-global-service-combined-ca-bundle\") pod \"custom-global-service-edpm-multinodeset-smz7m\" (UID: \"0a3c728f-b518-4879-bd48-9e96e30eb49e\") " pod="openstack-kuttl-tests/custom-global-service-edpm-multinodeset-smz7m" Mar 16 17:22:06 crc kubenswrapper[5120]: I0316 17:22:06.482141 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnf5x\" (UniqueName: \"kubernetes.io/projected/0a3c728f-b518-4879-bd48-9e96e30eb49e-kube-api-access-rnf5x\") pod \"custom-global-service-edpm-multinodeset-smz7m\" (UID: \"0a3c728f-b518-4879-bd48-9e96e30eb49e\") " pod="openstack-kuttl-tests/custom-global-service-edpm-multinodeset-smz7m" Mar 16 17:22:06 crc kubenswrapper[5120]: I0316 17:22:06.482164 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory-1\" (UniqueName: \"kubernetes.io/secret/0a3c728f-b518-4879-bd48-9e96e30eb49e-inventory-1\") pod \"custom-global-service-edpm-multinodeset-smz7m\" (UID: \"0a3c728f-b518-4879-bd48-9e96e30eb49e\") " pod="openstack-kuttl-tests/custom-global-service-edpm-multinodeset-smz7m" Mar 16 17:22:06 crc kubenswrapper[5120]: I0316 17:22:06.482260 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory-0\" (UniqueName: \"kubernetes.io/secret/0a3c728f-b518-4879-bd48-9e96e30eb49e-inventory-0\") pod \"custom-global-service-edpm-multinodeset-smz7m\" (UID: \"0a3c728f-b518-4879-bd48-9e96e30eb49e\") " pod="openstack-kuttl-tests/custom-global-service-edpm-multinodeset-smz7m" Mar 16 17:22:06 crc kubenswrapper[5120]: I0316 17:22:06.584750 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ssh-key-edpm-compute-beta-nodeset\" (UniqueName: \"kubernetes.io/secret/0a3c728f-b518-4879-bd48-9e96e30eb49e-ssh-key-edpm-compute-beta-nodeset\") pod \"custom-global-service-edpm-multinodeset-smz7m\" (UID: \"0a3c728f-b518-4879-bd48-9e96e30eb49e\") " pod="openstack-kuttl-tests/custom-global-service-edpm-multinodeset-smz7m" Mar 16 17:22:06 crc kubenswrapper[5120]: I0316 17:22:06.585278 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"custom-global-service-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0a3c728f-b518-4879-bd48-9e96e30eb49e-custom-global-service-combined-ca-bundle\") pod \"custom-global-service-edpm-multinodeset-smz7m\" (UID: \"0a3c728f-b518-4879-bd48-9e96e30eb49e\") " pod="openstack-kuttl-tests/custom-global-service-edpm-multinodeset-smz7m" Mar 16 17:22:06 crc kubenswrapper[5120]: I0316 17:22:06.585594 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rnf5x\" (UniqueName: \"kubernetes.io/projected/0a3c728f-b518-4879-bd48-9e96e30eb49e-kube-api-access-rnf5x\") pod \"custom-global-service-edpm-multinodeset-smz7m\" (UID: \"0a3c728f-b518-4879-bd48-9e96e30eb49e\") " pod="openstack-kuttl-tests/custom-global-service-edpm-multinodeset-smz7m" Mar 16 17:22:06 crc kubenswrapper[5120]: I0316 17:22:06.585820 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"inventory-1\" (UniqueName: \"kubernetes.io/secret/0a3c728f-b518-4879-bd48-9e96e30eb49e-inventory-1\") pod \"custom-global-service-edpm-multinodeset-smz7m\" (UID: \"0a3c728f-b518-4879-bd48-9e96e30eb49e\") " pod="openstack-kuttl-tests/custom-global-service-edpm-multinodeset-smz7m" Mar 16 17:22:06 crc kubenswrapper[5120]: I0316 17:22:06.586067 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"inventory-0\" (UniqueName: \"kubernetes.io/secret/0a3c728f-b518-4879-bd48-9e96e30eb49e-inventory-0\") pod \"custom-global-service-edpm-multinodeset-smz7m\" (UID: \"0a3c728f-b518-4879-bd48-9e96e30eb49e\") " pod="openstack-kuttl-tests/custom-global-service-edpm-multinodeset-smz7m" Mar 16 17:22:06 crc kubenswrapper[5120]: I0316 17:22:06.586357 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/0a3c728f-b518-4879-bd48-9e96e30eb49e-ssh-key-edpm-compute-global\") pod \"custom-global-service-edpm-multinodeset-smz7m\" (UID: \"0a3c728f-b518-4879-bd48-9e96e30eb49e\") " pod="openstack-kuttl-tests/custom-global-service-edpm-multinodeset-smz7m" Mar 16 17:22:06 crc kubenswrapper[5120]: I0316 17:22:06.591826 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"inventory-1\" (UniqueName: \"kubernetes.io/secret/0a3c728f-b518-4879-bd48-9e96e30eb49e-inventory-1\") pod \"custom-global-service-edpm-multinodeset-smz7m\" (UID: \"0a3c728f-b518-4879-bd48-9e96e30eb49e\") " pod="openstack-kuttl-tests/custom-global-service-edpm-multinodeset-smz7m" Mar 16 17:22:06 crc kubenswrapper[5120]: I0316 17:22:06.596538 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ssh-key-edpm-compute-beta-nodeset\" (UniqueName: \"kubernetes.io/secret/0a3c728f-b518-4879-bd48-9e96e30eb49e-ssh-key-edpm-compute-beta-nodeset\") pod \"custom-global-service-edpm-multinodeset-smz7m\" (UID: \"0a3c728f-b518-4879-bd48-9e96e30eb49e\") " pod="openstack-kuttl-tests/custom-global-service-edpm-multinodeset-smz7m" Mar 16 17:22:06 crc kubenswrapper[5120]: I0316 17:22:06.597134 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"custom-global-service-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0a3c728f-b518-4879-bd48-9e96e30eb49e-custom-global-service-combined-ca-bundle\") pod \"custom-global-service-edpm-multinodeset-smz7m\" (UID: \"0a3c728f-b518-4879-bd48-9e96e30eb49e\") " pod="openstack-kuttl-tests/custom-global-service-edpm-multinodeset-smz7m" Mar 16 17:22:06 crc kubenswrapper[5120]: I0316 17:22:06.597378 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"inventory-0\" (UniqueName: \"kubernetes.io/secret/0a3c728f-b518-4879-bd48-9e96e30eb49e-inventory-0\") pod \"custom-global-service-edpm-multinodeset-smz7m\" (UID: \"0a3c728f-b518-4879-bd48-9e96e30eb49e\") " pod="openstack-kuttl-tests/custom-global-service-edpm-multinodeset-smz7m" Mar 16 17:22:06 crc kubenswrapper[5120]: I0316 17:22:06.597484 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/0a3c728f-b518-4879-bd48-9e96e30eb49e-ssh-key-edpm-compute-global\") pod \"custom-global-service-edpm-multinodeset-smz7m\" (UID: \"0a3c728f-b518-4879-bd48-9e96e30eb49e\") " pod="openstack-kuttl-tests/custom-global-service-edpm-multinodeset-smz7m" Mar 16 17:22:06 crc kubenswrapper[5120]: I0316 17:22:06.611811 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnf5x\" (UniqueName: \"kubernetes.io/projected/0a3c728f-b518-4879-bd48-9e96e30eb49e-kube-api-access-rnf5x\") pod \"custom-global-service-edpm-multinodeset-smz7m\" (UID: \"0a3c728f-b518-4879-bd48-9e96e30eb49e\") " pod="openstack-kuttl-tests/custom-global-service-edpm-multinodeset-smz7m" Mar 16 17:22:06 crc kubenswrapper[5120]: I0316 17:22:06.674899 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4a90b6ba-7b58-4ed4-bce7-a09a38c07811" path="/var/lib/kubelet/pods/4a90b6ba-7b58-4ed4-bce7-a09a38c07811/volumes" Mar 16 17:22:06 crc kubenswrapper[5120]: I0316 17:22:06.712288 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/custom-global-service-edpm-multinodeset-smz7m" Mar 16 17:22:07 crc kubenswrapper[5120]: I0316 17:22:07.138260 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/custom-global-service-edpm-multinodeset-smz7m"] Mar 16 17:22:07 crc kubenswrapper[5120]: W0316 17:22:07.147915 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0a3c728f_b518_4879_bd48_9e96e30eb49e.slice/crio-d212cccfaeb6a0c2755d29218c489fc2a0fcd117c529bcea8299d0a149e99e87 WatchSource:0}: Error finding container d212cccfaeb6a0c2755d29218c489fc2a0fcd117c529bcea8299d0a149e99e87: Status 404 returned error can't find the container with id d212cccfaeb6a0c2755d29218c489fc2a0fcd117c529bcea8299d0a149e99e87 Mar 16 17:22:07 crc kubenswrapper[5120]: I0316 17:22:07.302067 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/custom-global-service-edpm-multinodeset-smz7m" event={"ID":"0a3c728f-b518-4879-bd48-9e96e30eb49e","Type":"ContainerStarted","Data":"d212cccfaeb6a0c2755d29218c489fc2a0fcd117c529bcea8299d0a149e99e87"} Mar 16 17:22:07 crc kubenswrapper[5120]: E0316 17:22:07.584325 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1305028 actualBytes=10240 Mar 16 17:22:08 crc kubenswrapper[5120]: I0316 17:22:08.311691 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/custom-global-service-edpm-multinodeset-smz7m" event={"ID":"0a3c728f-b518-4879-bd48-9e96e30eb49e","Type":"ContainerStarted","Data":"7d9c351e7631b2c8a14609eb1956d006e2763bca3e784c48864041179e430ba1"} Mar 16 17:22:08 crc kubenswrapper[5120]: I0316 17:22:08.341748 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/custom-global-service-edpm-multinodeset-smz7m" podStartSLOduration=1.933018711 podStartE2EDuration="2.341726198s" podCreationTimestamp="2026-03-16 17:22:06 +0000 UTC" firstStartedPulling="2026-03-16 17:22:07.148931836 +0000 UTC m=+6629.302863493" lastFinishedPulling="2026-03-16 17:22:07.557639323 +0000 UTC m=+6629.711570980" observedRunningTime="2026-03-16 17:22:08.331475368 +0000 UTC m=+6630.485407025" watchObservedRunningTime="2026-03-16 17:22:08.341726198 +0000 UTC m=+6630.495657855" Mar 16 17:22:11 crc kubenswrapper[5120]: I0316 17:22:11.335338 5120 generic.go:358] "Generic (PLEG): container finished" podID="0a3c728f-b518-4879-bd48-9e96e30eb49e" containerID="7d9c351e7631b2c8a14609eb1956d006e2763bca3e784c48864041179e430ba1" exitCode=0 Mar 16 17:22:11 crc kubenswrapper[5120]: I0316 17:22:11.335429 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/custom-global-service-edpm-multinodeset-smz7m" event={"ID":"0a3c728f-b518-4879-bd48-9e96e30eb49e","Type":"ContainerDied","Data":"7d9c351e7631b2c8a14609eb1956d006e2763bca3e784c48864041179e430ba1"} Mar 16 17:22:12 crc kubenswrapper[5120]: I0316 17:22:12.596434 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/custom-global-service-edpm-multinodeset-smz7m" Mar 16 17:22:12 crc kubenswrapper[5120]: I0316 17:22:12.632653 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"custom-global-service-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0a3c728f-b518-4879-bd48-9e96e30eb49e-custom-global-service-combined-ca-bundle\") pod \"0a3c728f-b518-4879-bd48-9e96e30eb49e\" (UID: \"0a3c728f-b518-4879-bd48-9e96e30eb49e\") " Mar 16 17:22:12 crc kubenswrapper[5120]: I0316 17:22:12.632802 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/0a3c728f-b518-4879-bd48-9e96e30eb49e-ssh-key-edpm-compute-global\") pod \"0a3c728f-b518-4879-bd48-9e96e30eb49e\" (UID: \"0a3c728f-b518-4879-bd48-9e96e30eb49e\") " Mar 16 17:22:12 crc kubenswrapper[5120]: I0316 17:22:12.633021 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rnf5x\" (UniqueName: \"kubernetes.io/projected/0a3c728f-b518-4879-bd48-9e96e30eb49e-kube-api-access-rnf5x\") pod \"0a3c728f-b518-4879-bd48-9e96e30eb49e\" (UID: \"0a3c728f-b518-4879-bd48-9e96e30eb49e\") " Mar 16 17:22:12 crc kubenswrapper[5120]: I0316 17:22:12.633406 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"inventory-0\" (UniqueName: \"kubernetes.io/secret/0a3c728f-b518-4879-bd48-9e96e30eb49e-inventory-0\") pod \"0a3c728f-b518-4879-bd48-9e96e30eb49e\" (UID: \"0a3c728f-b518-4879-bd48-9e96e30eb49e\") " Mar 16 17:22:12 crc kubenswrapper[5120]: I0316 17:22:12.633456 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ssh-key-edpm-compute-beta-nodeset\" (UniqueName: \"kubernetes.io/secret/0a3c728f-b518-4879-bd48-9e96e30eb49e-ssh-key-edpm-compute-beta-nodeset\") pod \"0a3c728f-b518-4879-bd48-9e96e30eb49e\" (UID: \"0a3c728f-b518-4879-bd48-9e96e30eb49e\") " Mar 16 17:22:12 crc kubenswrapper[5120]: I0316 17:22:12.633981 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"inventory-1\" (UniqueName: \"kubernetes.io/secret/0a3c728f-b518-4879-bd48-9e96e30eb49e-inventory-1\") pod \"0a3c728f-b518-4879-bd48-9e96e30eb49e\" (UID: \"0a3c728f-b518-4879-bd48-9e96e30eb49e\") " Mar 16 17:22:12 crc kubenswrapper[5120]: I0316 17:22:12.640940 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a3c728f-b518-4879-bd48-9e96e30eb49e-kube-api-access-rnf5x" (OuterVolumeSpecName: "kube-api-access-rnf5x") pod "0a3c728f-b518-4879-bd48-9e96e30eb49e" (UID: "0a3c728f-b518-4879-bd48-9e96e30eb49e"). InnerVolumeSpecName "kube-api-access-rnf5x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:22:12 crc kubenswrapper[5120]: I0316 17:22:12.641927 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a3c728f-b518-4879-bd48-9e96e30eb49e-custom-global-service-combined-ca-bundle" (OuterVolumeSpecName: "custom-global-service-combined-ca-bundle") pod "0a3c728f-b518-4879-bd48-9e96e30eb49e" (UID: "0a3c728f-b518-4879-bd48-9e96e30eb49e"). InnerVolumeSpecName "custom-global-service-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:22:12 crc kubenswrapper[5120]: I0316 17:22:12.663955 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a3c728f-b518-4879-bd48-9e96e30eb49e-inventory-0" (OuterVolumeSpecName: "inventory-0") pod "0a3c728f-b518-4879-bd48-9e96e30eb49e" (UID: "0a3c728f-b518-4879-bd48-9e96e30eb49e"). InnerVolumeSpecName "inventory-0". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:22:12 crc kubenswrapper[5120]: I0316 17:22:12.666697 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a3c728f-b518-4879-bd48-9e96e30eb49e-ssh-key-edpm-compute-beta-nodeset" (OuterVolumeSpecName: "ssh-key-edpm-compute-beta-nodeset") pod "0a3c728f-b518-4879-bd48-9e96e30eb49e" (UID: "0a3c728f-b518-4879-bd48-9e96e30eb49e"). InnerVolumeSpecName "ssh-key-edpm-compute-beta-nodeset". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:22:12 crc kubenswrapper[5120]: I0316 17:22:12.666746 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a3c728f-b518-4879-bd48-9e96e30eb49e-ssh-key-edpm-compute-global" (OuterVolumeSpecName: "ssh-key-edpm-compute-global") pod "0a3c728f-b518-4879-bd48-9e96e30eb49e" (UID: "0a3c728f-b518-4879-bd48-9e96e30eb49e"). InnerVolumeSpecName "ssh-key-edpm-compute-global". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:22:12 crc kubenswrapper[5120]: I0316 17:22:12.674734 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a3c728f-b518-4879-bd48-9e96e30eb49e-inventory-1" (OuterVolumeSpecName: "inventory-1") pod "0a3c728f-b518-4879-bd48-9e96e30eb49e" (UID: "0a3c728f-b518-4879-bd48-9e96e30eb49e"). InnerVolumeSpecName "inventory-1". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:22:12 crc kubenswrapper[5120]: I0316 17:22:12.737645 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rnf5x\" (UniqueName: \"kubernetes.io/projected/0a3c728f-b518-4879-bd48-9e96e30eb49e-kube-api-access-rnf5x\") on node \"crc\" DevicePath \"\"" Mar 16 17:22:12 crc kubenswrapper[5120]: I0316 17:22:12.737689 5120 reconciler_common.go:299] "Volume detached for volume \"inventory-0\" (UniqueName: \"kubernetes.io/secret/0a3c728f-b518-4879-bd48-9e96e30eb49e-inventory-0\") on node \"crc\" DevicePath \"\"" Mar 16 17:22:12 crc kubenswrapper[5120]: I0316 17:22:12.737701 5120 reconciler_common.go:299] "Volume detached for volume \"ssh-key-edpm-compute-beta-nodeset\" (UniqueName: \"kubernetes.io/secret/0a3c728f-b518-4879-bd48-9e96e30eb49e-ssh-key-edpm-compute-beta-nodeset\") on node \"crc\" DevicePath \"\"" Mar 16 17:22:12 crc kubenswrapper[5120]: I0316 17:22:12.737713 5120 reconciler_common.go:299] "Volume detached for volume \"inventory-1\" (UniqueName: \"kubernetes.io/secret/0a3c728f-b518-4879-bd48-9e96e30eb49e-inventory-1\") on node \"crc\" DevicePath \"\"" Mar 16 17:22:12 crc kubenswrapper[5120]: I0316 17:22:12.737724 5120 reconciler_common.go:299] "Volume detached for volume \"custom-global-service-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0a3c728f-b518-4879-bd48-9e96e30eb49e-custom-global-service-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:22:12 crc kubenswrapper[5120]: I0316 17:22:12.737737 5120 reconciler_common.go:299] "Volume detached for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/0a3c728f-b518-4879-bd48-9e96e30eb49e-ssh-key-edpm-compute-global\") on node \"crc\" DevicePath \"\"" Mar 16 17:22:13 crc kubenswrapper[5120]: I0316 17:22:13.356739 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/custom-global-service-edpm-multinodeset-smz7m" event={"ID":"0a3c728f-b518-4879-bd48-9e96e30eb49e","Type":"ContainerDied","Data":"d212cccfaeb6a0c2755d29218c489fc2a0fcd117c529bcea8299d0a149e99e87"} Mar 16 17:22:13 crc kubenswrapper[5120]: I0316 17:22:13.357067 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d212cccfaeb6a0c2755d29218c489fc2a0fcd117c529bcea8299d0a149e99e87" Mar 16 17:22:13 crc kubenswrapper[5120]: I0316 17:22:13.357138 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/custom-global-service-edpm-multinodeset-smz7m" Mar 16 17:22:13 crc kubenswrapper[5120]: I0316 17:22:13.859003 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-f5g5s"] Mar 16 17:22:13 crc kubenswrapper[5120]: I0316 17:22:13.882718 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-f5g5s"] Mar 16 17:22:13 crc kubenswrapper[5120]: I0316 17:22:13.893073 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/run-os-edpm-multinodeset-edpm-compute-global-wpmb8"] Mar 16 17:22:13 crc kubenswrapper[5120]: I0316 17:22:13.911559 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/run-os-edpm-multinodeset-edpm-compute-global-wpmb8"] Mar 16 17:22:13 crc kubenswrapper[5120]: I0316 17:22:13.929321 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/validate-network-edpm-multinodeset-edpm-compute-global-rbzll"] Mar 16 17:22:13 crc kubenswrapper[5120]: I0316 17:22:13.941833 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/libvirt-edpm-multinodeset-edpm-compute-global-q7sgm"] Mar 16 17:22:13 crc kubenswrapper[5120]: I0316 17:22:13.953176 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-global-qbgz7"] Mar 16 17:22:13 crc kubenswrapper[5120]: I0316 17:22:13.961162 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-edpm-multinodeset-edpm-compute-global-xmb42"] Mar 16 17:22:13 crc kubenswrapper[5120]: I0316 17:22:13.970565 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-global-xjfrc"] Mar 16 17:22:13 crc kubenswrapper[5120]: I0316 17:22:13.977512 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-dhcp-edpm-multinodeset-edpm-compute-global-4lrzt"] Mar 16 17:22:13 crc kubenswrapper[5120]: I0316 17:22:13.985914 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-sriov-edpm-multinodeset-edpm-compute-global-gvnhj"] Mar 16 17:22:13 crc kubenswrapper[5120]: I0316 17:22:13.992935 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/validate-network-edpm-multinodeset-edpm-compute-global-rbzll"] Mar 16 17:22:14 crc kubenswrapper[5120]: I0316 17:22:14.001824 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/libvirt-edpm-multinodeset-edpm-compute-global-q7sgm"] Mar 16 17:22:14 crc kubenswrapper[5120]: I0316 17:22:14.008097 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-dhcp-edpm-multinodeset-edpm-compute-global-4lrzt"] Mar 16 17:22:14 crc kubenswrapper[5120]: I0316 17:22:14.015622 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-sriov-edpm-multinodeset-edpm-compute-global-gvnhj"] Mar 16 17:22:14 crc kubenswrapper[5120]: I0316 17:22:14.023665 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-beta-nodesetf9qr5"] Mar 16 17:22:14 crc kubenswrapper[5120]: I0316 17:22:14.031940 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovn-edpm-multinodeset-edpm-compute-global-xmb42"] Mar 16 17:22:14 crc kubenswrapper[5120]: I0316 17:22:14.038869 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-global-xjfrc"] Mar 16 17:22:14 crc kubenswrapper[5120]: I0316 17:22:14.048339 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-global-qbgz7"] Mar 16 17:22:14 crc kubenswrapper[5120]: I0316 17:22:14.056622 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-beta-nodesetf9qr5"] Mar 16 17:22:14 crc kubenswrapper[5120]: I0316 17:22:14.064950 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/configure-os-edpm-multinodeset-edpm-compute-global-6rsg7"] Mar 16 17:22:14 crc kubenswrapper[5120]: I0316 17:22:14.079949 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/custom-global-service-edpm-multinodeset-smz7m"] Mar 16 17:22:14 crc kubenswrapper[5120]: I0316 17:22:14.080005 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/configure-os-edpm-multinodeset-edpm-compute-global-6rsg7"] Mar 16 17:22:14 crc kubenswrapper[5120]: I0316 17:22:14.086512 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/custom-global-service-edpm-multinodeset-smz7m"] Mar 16 17:22:14 crc kubenswrapper[5120]: I0316 17:22:14.096850 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-global-89hrj"] Mar 16 17:22:14 crc kubenswrapper[5120]: I0316 17:22:14.101844 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-global-4ljhm"] Mar 16 17:22:14 crc kubenswrapper[5120]: I0316 17:22:14.112307 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-global-4ljhm"] Mar 16 17:22:14 crc kubenswrapper[5120]: I0316 17:22:14.122143 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-global-89hrj"] Mar 16 17:22:14 crc kubenswrapper[5120]: I0316 17:22:14.130612 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/install-os-edpm-multinodeset-edpm-compute-global-zd7r5"] Mar 16 17:22:14 crc kubenswrapper[5120]: I0316 17:22:14.143848 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/bootstrap-edpm-compute-global-edpm-compute-global-wzq2k"] Mar 16 17:22:14 crc kubenswrapper[5120]: I0316 17:22:14.152199 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-global-mqm76"] Mar 16 17:22:14 crc kubenswrapper[5120]: I0316 17:22:14.160216 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/configure-network-edpm-multinodeset-edpm-compute-global-57c2c"] Mar 16 17:22:14 crc kubenswrapper[5120]: I0316 17:22:14.167936 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-global-b2wcf"] Mar 16 17:22:14 crc kubenswrapper[5120]: I0316 17:22:14.177810 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-edpm-compute-global-edpm-compute-global-pfsz2"] Mar 16 17:22:14 crc kubenswrapper[5120]: I0316 17:22:14.185738 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/bootstrap-edpm-compute-global-edpm-compute-global-wzq2k"] Mar 16 17:22:14 crc kubenswrapper[5120]: I0316 17:22:14.193720 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-global-b2wcf"] Mar 16 17:22:14 crc kubenswrapper[5120]: I0316 17:22:14.201890 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/configure-network-edpm-multinodeset-edpm-compute-global-57c2c"] Mar 16 17:22:14 crc kubenswrapper[5120]: I0316 17:22:14.210039 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-global-mqm76"] Mar 16 17:22:14 crc kubenswrapper[5120]: I0316 17:22:14.218506 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-dhcp-edpm-compute-global-edpm-compute-global-555pt"] Mar 16 17:22:14 crc kubenswrapper[5120]: I0316 17:22:14.227544 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-ovn-edpm-compute-global-edpm-compute-global-fqjh6"] Mar 16 17:22:14 crc kubenswrapper[5120]: I0316 17:22:14.234999 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/download-cache-edpm-compute-global-edpm-compute-global-4z24m"] Mar 16 17:22:14 crc kubenswrapper[5120]: I0316 17:22:14.241657 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/install-os-edpm-multinodeset-edpm-compute-global-zd7r5"] Mar 16 17:22:14 crc kubenswrapper[5120]: I0316 17:22:14.249387 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/custom-global-service-edpm-compute-global-fq4pn"] Mar 16 17:22:14 crc kubenswrapper[5120]: I0316 17:22:14.260276 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/configure-network-edpm-compute-global-edpm-compute-global-9ss2s"] Mar 16 17:22:14 crc kubenswrapper[5120]: I0316 17:22:14.269750 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-edpm-compute-global-edpm-compute-global-55bs7"] Mar 16 17:22:14 crc kubenswrapper[5120]: I0316 17:22:14.276239 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/libvirt-edpm-compute-global-edpm-compute-global-t8t2l"] Mar 16 17:22:14 crc kubenswrapper[5120]: I0316 17:22:14.281738 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-sriov-edpm-compute-global-edpm-compute-global-5zs7b"] Mar 16 17:22:14 crc kubenswrapper[5120]: I0316 17:22:14.288792 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-metadata-edpm-compute-global-edpm-compute-global-ptgv2"] Mar 16 17:22:14 crc kubenswrapper[5120]: I0316 17:22:14.295934 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-edpm-compute-global-edpm-compute-global-pfsz2"] Mar 16 17:22:14 crc kubenswrapper[5120]: I0316 17:22:14.303213 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/install-certs-edpm-compute-global-edpm-compute-global-wld47"] Mar 16 17:22:14 crc kubenswrapper[5120]: I0316 17:22:14.309174 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/validate-network-edpm-compute-global-edpm-compute-global-nqmf9"] Mar 16 17:22:14 crc kubenswrapper[5120]: I0316 17:22:14.317396 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/download-cache-edpm-compute-global-edpm-compute-global-4z24m"] Mar 16 17:22:14 crc kubenswrapper[5120]: I0316 17:22:14.324730 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/configure-network-edpm-compute-global-edpm-compute-global-9ss2s"] Mar 16 17:22:14 crc kubenswrapper[5120]: I0316 17:22:14.332340 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/run-os-edpm-compute-global-edpm-compute-global-ph77t"] Mar 16 17:22:14 crc kubenswrapper[5120]: I0316 17:22:14.340129 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-ovn-edpm-compute-global-edpm-compute-global-fqjh6"] Mar 16 17:22:14 crc kubenswrapper[5120]: I0316 17:22:14.347392 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-dhcp-edpm-compute-global-edpm-compute-global-555pt"] Mar 16 17:22:14 crc kubenswrapper[5120]: I0316 17:22:14.372885 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/install-os-edpm-compute-global-edpm-compute-global-k8htx"] Mar 16 17:22:14 crc kubenswrapper[5120]: I0316 17:22:14.381228 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-sriov-edpm-compute-global-edpm-compute-global-5zs7b"] Mar 16 17:22:14 crc kubenswrapper[5120]: I0316 17:22:14.389912 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-metadata-edpm-compute-global-edpm-compute-global-ptgv2"] Mar 16 17:22:14 crc kubenswrapper[5120]: I0316 17:22:14.398146 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/custom-global-service-edpm-compute-global-fq4pn"] Mar 16 17:22:14 crc kubenswrapper[5120]: I0316 17:22:14.406785 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovn-edpm-compute-global-edpm-compute-global-55bs7"] Mar 16 17:22:14 crc kubenswrapper[5120]: I0316 17:22:14.414612 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/libvirt-edpm-compute-global-edpm-compute-global-t8t2l"] Mar 16 17:22:14 crc kubenswrapper[5120]: I0316 17:22:14.421437 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/install-certs-edpm-compute-global-edpm-compute-global-wld47"] Mar 16 17:22:14 crc kubenswrapper[5120]: I0316 17:22:14.427740 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/validate-network-edpm-compute-global-edpm-compute-global-nqmf9"] Mar 16 17:22:14 crc kubenswrapper[5120]: I0316 17:22:14.434689 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/run-os-edpm-compute-global-edpm-compute-global-ph77t"] Mar 16 17:22:14 crc kubenswrapper[5120]: I0316 17:22:14.441314 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/install-os-edpm-compute-global-edpm-compute-global-k8htx"] Mar 16 17:22:14 crc kubenswrapper[5120]: I0316 17:22:14.447893 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/configure-os-edpm-compute-global-edpm-compute-global-2q8w6"] Mar 16 17:22:14 crc kubenswrapper[5120]: I0316 17:22:14.453384 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/configure-os-edpm-compute-global-edpm-compute-global-2q8w6"] Mar 16 17:22:14 crc kubenswrapper[5120]: I0316 17:22:14.460046 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-67bb796bf-cjz24"] Mar 16 17:22:14 crc kubenswrapper[5120]: I0316 17:22:14.461350 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a3c728f-b518-4879-bd48-9e96e30eb49e" containerName="custom-global-service-edpm-multinodeset" Mar 16 17:22:14 crc kubenswrapper[5120]: I0316 17:22:14.461374 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a3c728f-b518-4879-bd48-9e96e30eb49e" containerName="custom-global-service-edpm-multinodeset" Mar 16 17:22:14 crc kubenswrapper[5120]: I0316 17:22:14.461607 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="0a3c728f-b518-4879-bd48-9e96e30eb49e" containerName="custom-global-service-edpm-multinodeset" Mar 16 17:22:14 crc kubenswrapper[5120]: I0316 17:22:14.468199 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-67bb796bf-cjz24"] Mar 16 17:22:14 crc kubenswrapper[5120]: I0316 17:22:14.468296 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-67bb796bf-cjz24" Mar 16 17:22:14 crc kubenswrapper[5120]: I0316 17:22:14.474915 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-67bb796bf-cjz24"] Mar 16 17:22:14 crc kubenswrapper[5120]: I0316 17:22:14.484809 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-sjkkk"] Mar 16 17:22:14 crc kubenswrapper[5120]: E0316 17:22:14.486260 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[config dnsmasq-svc edpm-compute-global kube-api-access-l6mk2], unattached volumes=[], failed to process volumes=[config dnsmasq-svc edpm-compute-global kube-api-access-l6mk2]: context canceled" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-67bb796bf-cjz24" podUID="5ebeaceb-5117-4200-abf4-b810b8b024d7" Mar 16 17:22:14 crc kubenswrapper[5120]: I0316 17:22:14.490336 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-sjkkk" Mar 16 17:22:14 crc kubenswrapper[5120]: I0316 17:22:14.492489 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-sjkkk"] Mar 16 17:22:14 crc kubenswrapper[5120]: I0316 17:22:14.598736 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/5ebeaceb-5117-4200-abf4-b810b8b024d7-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-67bb796bf-cjz24\" (UID: \"5ebeaceb-5117-4200-abf4-b810b8b024d7\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-67bb796bf-cjz24" Mar 16 17:22:14 crc kubenswrapper[5120]: I0316 17:22:14.598827 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/c3656132-3010-45c1-a0df-f1394d08c0e5-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-79dcd846c5-sjkkk\" (UID: \"c3656132-3010-45c1-a0df-f1394d08c0e5\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-sjkkk" Mar 16 17:22:14 crc kubenswrapper[5120]: I0316 17:22:14.598883 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"edpm-compute-global\" (UniqueName: \"kubernetes.io/configmap/5ebeaceb-5117-4200-abf4-b810b8b024d7-edpm-compute-global\") pod \"dnsmasq-dnsmasq-67bb796bf-cjz24\" (UID: \"5ebeaceb-5117-4200-abf4-b810b8b024d7\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-67bb796bf-cjz24" Mar 16 17:22:14 crc kubenswrapper[5120]: I0316 17:22:14.599000 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6mk2\" (UniqueName: \"kubernetes.io/projected/5ebeaceb-5117-4200-abf4-b810b8b024d7-kube-api-access-l6mk2\") pod \"dnsmasq-dnsmasq-67bb796bf-cjz24\" (UID: \"5ebeaceb-5117-4200-abf4-b810b8b024d7\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-67bb796bf-cjz24" Mar 16 17:22:14 crc kubenswrapper[5120]: I0316 17:22:14.599106 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5ebeaceb-5117-4200-abf4-b810b8b024d7-config\") pod \"dnsmasq-dnsmasq-67bb796bf-cjz24\" (UID: \"5ebeaceb-5117-4200-abf4-b810b8b024d7\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-67bb796bf-cjz24" Mar 16 17:22:14 crc kubenswrapper[5120]: I0316 17:22:14.599178 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxp7g\" (UniqueName: \"kubernetes.io/projected/c3656132-3010-45c1-a0df-f1394d08c0e5-kube-api-access-jxp7g\") pod \"dnsmasq-dnsmasq-79dcd846c5-sjkkk\" (UID: \"c3656132-3010-45c1-a0df-f1394d08c0e5\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-sjkkk" Mar 16 17:22:14 crc kubenswrapper[5120]: I0316 17:22:14.599239 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c3656132-3010-45c1-a0df-f1394d08c0e5-config\") pod \"dnsmasq-dnsmasq-79dcd846c5-sjkkk\" (UID: \"c3656132-3010-45c1-a0df-f1394d08c0e5\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-sjkkk" Mar 16 17:22:14 crc kubenswrapper[5120]: I0316 17:22:14.674172 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0a3c728f-b518-4879-bd48-9e96e30eb49e" path="/var/lib/kubelet/pods/0a3c728f-b518-4879-bd48-9e96e30eb49e/volumes" Mar 16 17:22:14 crc kubenswrapper[5120]: I0316 17:22:14.675018 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ad6fc48-b614-4048-827f-290a2619a529" path="/var/lib/kubelet/pods/0ad6fc48-b614-4048-827f-290a2619a529/volumes" Mar 16 17:22:14 crc kubenswrapper[5120]: I0316 17:22:14.675639 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b772688-e5ec-415c-98fd-222dcc3e3d05" path="/var/lib/kubelet/pods/0b772688-e5ec-415c-98fd-222dcc3e3d05/volumes" Mar 16 17:22:14 crc kubenswrapper[5120]: I0316 17:22:14.676273 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="151c171e-6248-4807-adc6-0510de79c2a4" path="/var/lib/kubelet/pods/151c171e-6248-4807-adc6-0510de79c2a4/volumes" Mar 16 17:22:14 crc kubenswrapper[5120]: I0316 17:22:14.678042 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="161af075-1663-4d77-87b2-62b32c81a62c" path="/var/lib/kubelet/pods/161af075-1663-4d77-87b2-62b32c81a62c/volumes" Mar 16 17:22:14 crc kubenswrapper[5120]: I0316 17:22:14.678593 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="16d1cbb9-7339-4170-827c-1ff72424a7e6" path="/var/lib/kubelet/pods/16d1cbb9-7339-4170-827c-1ff72424a7e6/volumes" Mar 16 17:22:14 crc kubenswrapper[5120]: I0316 17:22:14.679223 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="29090232-2003-44d6-bd82-596011902d6c" path="/var/lib/kubelet/pods/29090232-2003-44d6-bd82-596011902d6c/volumes" Mar 16 17:22:14 crc kubenswrapper[5120]: I0316 17:22:14.680514 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2ec4d48f-6f71-4029-b5da-d428dd885ac4" path="/var/lib/kubelet/pods/2ec4d48f-6f71-4029-b5da-d428dd885ac4/volumes" Mar 16 17:22:14 crc kubenswrapper[5120]: I0316 17:22:14.681132 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="300a1e4b-8fc3-42f8-9188-ff87d21d71bc" path="/var/lib/kubelet/pods/300a1e4b-8fc3-42f8-9188-ff87d21d71bc/volumes" Mar 16 17:22:14 crc kubenswrapper[5120]: I0316 17:22:14.681669 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="387b0793-b863-48d4-832f-8eb85b4e4d37" path="/var/lib/kubelet/pods/387b0793-b863-48d4-832f-8eb85b4e4d37/volumes" Mar 16 17:22:14 crc kubenswrapper[5120]: I0316 17:22:14.682675 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="482a9a9b-501b-4009-a558-9c7a9e30a05d" path="/var/lib/kubelet/pods/482a9a9b-501b-4009-a558-9c7a9e30a05d/volumes" Mar 16 17:22:14 crc kubenswrapper[5120]: I0316 17:22:14.683270 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="527acda8-28c9-412c-b3a8-ce5749238659" path="/var/lib/kubelet/pods/527acda8-28c9-412c-b3a8-ce5749238659/volumes" Mar 16 17:22:14 crc kubenswrapper[5120]: I0316 17:22:14.683809 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5504360a-4f14-4c79-8bc1-67c631bfd594" path="/var/lib/kubelet/pods/5504360a-4f14-4c79-8bc1-67c631bfd594/volumes" Mar 16 17:22:14 crc kubenswrapper[5120]: I0316 17:22:14.684406 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b90541f-789c-4c4f-ad4e-eda4e32c5d83" path="/var/lib/kubelet/pods/5b90541f-789c-4c4f-ad4e-eda4e32c5d83/volumes" Mar 16 17:22:14 crc kubenswrapper[5120]: I0316 17:22:14.685419 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5de90149-15ef-4716-be7d-90136958a64e" path="/var/lib/kubelet/pods/5de90149-15ef-4716-be7d-90136958a64e/volumes" Mar 16 17:22:14 crc kubenswrapper[5120]: I0316 17:22:14.686130 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="633b0a27-35c6-40d9-9d84-788905b450fb" path="/var/lib/kubelet/pods/633b0a27-35c6-40d9-9d84-788905b450fb/volumes" Mar 16 17:22:14 crc kubenswrapper[5120]: I0316 17:22:14.686782 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="75049598-8303-41ea-ae94-c5f410b8815c" path="/var/lib/kubelet/pods/75049598-8303-41ea-ae94-c5f410b8815c/volumes" Mar 16 17:22:14 crc kubenswrapper[5120]: I0316 17:22:14.687726 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c65ae5a-f219-400e-8b08-7ed5f3860761" path="/var/lib/kubelet/pods/7c65ae5a-f219-400e-8b08-7ed5f3860761/volumes" Mar 16 17:22:14 crc kubenswrapper[5120]: I0316 17:22:14.688499 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="81b58ad6-2d7d-48bc-b63e-3d6274ab1257" path="/var/lib/kubelet/pods/81b58ad6-2d7d-48bc-b63e-3d6274ab1257/volumes" Mar 16 17:22:14 crc kubenswrapper[5120]: I0316 17:22:14.689206 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8cdaa1ac-bac8-41a4-b2c0-4d90c52ac825" path="/var/lib/kubelet/pods/8cdaa1ac-bac8-41a4-b2c0-4d90c52ac825/volumes" Mar 16 17:22:14 crc kubenswrapper[5120]: I0316 17:22:14.690222 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8f5ad2e0-6689-48e2-8366-690d63b73046" path="/var/lib/kubelet/pods/8f5ad2e0-6689-48e2-8366-690d63b73046/volumes" Mar 16 17:22:14 crc kubenswrapper[5120]: I0316 17:22:14.690732 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="971f334c-69fb-40d2-a173-87de07ee2d14" path="/var/lib/kubelet/pods/971f334c-69fb-40d2-a173-87de07ee2d14/volumes" Mar 16 17:22:14 crc kubenswrapper[5120]: I0316 17:22:14.691240 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9751110f-a380-4ff1-b960-ec8ab627c38b" path="/var/lib/kubelet/pods/9751110f-a380-4ff1-b960-ec8ab627c38b/volumes" Mar 16 17:22:14 crc kubenswrapper[5120]: I0316 17:22:14.691751 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9d13d12e-26e7-4367-b3d0-b9df485bda68" path="/var/lib/kubelet/pods/9d13d12e-26e7-4367-b3d0-b9df485bda68/volumes" Mar 16 17:22:14 crc kubenswrapper[5120]: I0316 17:22:14.692690 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a1eb2c4c-523e-43d3-95cb-9edcc781645a" path="/var/lib/kubelet/pods/a1eb2c4c-523e-43d3-95cb-9edcc781645a/volumes" Mar 16 17:22:14 crc kubenswrapper[5120]: I0316 17:22:14.693244 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa71ee8f-8be3-47d7-ad6c-2d1dd72e0d45" path="/var/lib/kubelet/pods/aa71ee8f-8be3-47d7-ad6c-2d1dd72e0d45/volumes" Mar 16 17:22:14 crc kubenswrapper[5120]: I0316 17:22:14.693744 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b824f0e6-549f-464b-89a2-f90732d13799" path="/var/lib/kubelet/pods/b824f0e6-549f-464b-89a2-f90732d13799/volumes" Mar 16 17:22:14 crc kubenswrapper[5120]: I0316 17:22:14.694690 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="baa0fd9c-149b-4767-862c-ee0d588d8508" path="/var/lib/kubelet/pods/baa0fd9c-149b-4767-862c-ee0d588d8508/volumes" Mar 16 17:22:14 crc kubenswrapper[5120]: I0316 17:22:14.695213 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c142b874-2f55-42f0-9b78-b463054819a6" path="/var/lib/kubelet/pods/c142b874-2f55-42f0-9b78-b463054819a6/volumes" Mar 16 17:22:14 crc kubenswrapper[5120]: I0316 17:22:14.695706 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d5806840-8be0-4868-b0b7-f264425abb5e" path="/var/lib/kubelet/pods/d5806840-8be0-4868-b0b7-f264425abb5e/volumes" Mar 16 17:22:14 crc kubenswrapper[5120]: I0316 17:22:14.696407 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d86f967c-0478-485d-bd75-15e6a4e7588e" path="/var/lib/kubelet/pods/d86f967c-0478-485d-bd75-15e6a4e7588e/volumes" Mar 16 17:22:14 crc kubenswrapper[5120]: I0316 17:22:14.697471 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d8f49ea6-2f72-49ca-9e11-f1fe280d8bc8" path="/var/lib/kubelet/pods/d8f49ea6-2f72-49ca-9e11-f1fe280d8bc8/volumes" Mar 16 17:22:14 crc kubenswrapper[5120]: I0316 17:22:14.698093 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f41c2228-c503-41ca-98da-5e5518e564a5" path="/var/lib/kubelet/pods/f41c2228-c503-41ca-98da-5e5518e564a5/volumes" Mar 16 17:22:14 crc kubenswrapper[5120]: I0316 17:22:14.698584 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc38d17d-9798-43ab-a697-0148939455e1" path="/var/lib/kubelet/pods/fc38d17d-9798-43ab-a697-0148939455e1/volumes" Mar 16 17:22:14 crc kubenswrapper[5120]: I0316 17:22:14.700321 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/c3656132-3010-45c1-a0df-f1394d08c0e5-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-79dcd846c5-sjkkk\" (UID: \"c3656132-3010-45c1-a0df-f1394d08c0e5\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-sjkkk" Mar 16 17:22:14 crc kubenswrapper[5120]: I0316 17:22:14.700441 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"edpm-compute-global\" (UniqueName: \"kubernetes.io/configmap/5ebeaceb-5117-4200-abf4-b810b8b024d7-edpm-compute-global\") pod \"dnsmasq-dnsmasq-67bb796bf-cjz24\" (UID: \"5ebeaceb-5117-4200-abf4-b810b8b024d7\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-67bb796bf-cjz24" Mar 16 17:22:14 crc kubenswrapper[5120]: E0316 17:22:14.700577 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/edpm-compute-global: configmap "edpm-compute-global" not found Mar 16 17:22:14 crc kubenswrapper[5120]: E0316 17:22:14.700704 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5ebeaceb-5117-4200-abf4-b810b8b024d7-edpm-compute-global podName:5ebeaceb-5117-4200-abf4-b810b8b024d7 nodeName:}" failed. No retries permitted until 2026-03-16 17:22:15.200666467 +0000 UTC m=+6637.354598124 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "edpm-compute-global" (UniqueName: "kubernetes.io/configmap/5ebeaceb-5117-4200-abf4-b810b8b024d7-edpm-compute-global") pod "dnsmasq-dnsmasq-67bb796bf-cjz24" (UID: "5ebeaceb-5117-4200-abf4-b810b8b024d7") : configmap "edpm-compute-global" not found Mar 16 17:22:14 crc kubenswrapper[5120]: I0316 17:22:14.700578 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l6mk2\" (UniqueName: \"kubernetes.io/projected/5ebeaceb-5117-4200-abf4-b810b8b024d7-kube-api-access-l6mk2\") pod \"dnsmasq-dnsmasq-67bb796bf-cjz24\" (UID: \"5ebeaceb-5117-4200-abf4-b810b8b024d7\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-67bb796bf-cjz24" Mar 16 17:22:14 crc kubenswrapper[5120]: I0316 17:22:14.700939 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5ebeaceb-5117-4200-abf4-b810b8b024d7-config\") pod \"dnsmasq-dnsmasq-67bb796bf-cjz24\" (UID: \"5ebeaceb-5117-4200-abf4-b810b8b024d7\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-67bb796bf-cjz24" Mar 16 17:22:14 crc kubenswrapper[5120]: I0316 17:22:14.701051 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jxp7g\" (UniqueName: \"kubernetes.io/projected/c3656132-3010-45c1-a0df-f1394d08c0e5-kube-api-access-jxp7g\") pod \"dnsmasq-dnsmasq-79dcd846c5-sjkkk\" (UID: \"c3656132-3010-45c1-a0df-f1394d08c0e5\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-sjkkk" Mar 16 17:22:14 crc kubenswrapper[5120]: I0316 17:22:14.701088 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c3656132-3010-45c1-a0df-f1394d08c0e5-config\") pod \"dnsmasq-dnsmasq-79dcd846c5-sjkkk\" (UID: \"c3656132-3010-45c1-a0df-f1394d08c0e5\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-sjkkk" Mar 16 17:22:14 crc kubenswrapper[5120]: I0316 17:22:14.701527 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/c3656132-3010-45c1-a0df-f1394d08c0e5-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-79dcd846c5-sjkkk\" (UID: \"c3656132-3010-45c1-a0df-f1394d08c0e5\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-sjkkk" Mar 16 17:22:14 crc kubenswrapper[5120]: I0316 17:22:14.701936 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5ebeaceb-5117-4200-abf4-b810b8b024d7-config\") pod \"dnsmasq-dnsmasq-67bb796bf-cjz24\" (UID: \"5ebeaceb-5117-4200-abf4-b810b8b024d7\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-67bb796bf-cjz24" Mar 16 17:22:14 crc kubenswrapper[5120]: I0316 17:22:14.702018 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c3656132-3010-45c1-a0df-f1394d08c0e5-config\") pod \"dnsmasq-dnsmasq-79dcd846c5-sjkkk\" (UID: \"c3656132-3010-45c1-a0df-f1394d08c0e5\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-sjkkk" Mar 16 17:22:14 crc kubenswrapper[5120]: I0316 17:22:14.702174 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/5ebeaceb-5117-4200-abf4-b810b8b024d7-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-67bb796bf-cjz24\" (UID: \"5ebeaceb-5117-4200-abf4-b810b8b024d7\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-67bb796bf-cjz24" Mar 16 17:22:14 crc kubenswrapper[5120]: I0316 17:22:14.702897 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/5ebeaceb-5117-4200-abf4-b810b8b024d7-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-67bb796bf-cjz24\" (UID: \"5ebeaceb-5117-4200-abf4-b810b8b024d7\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-67bb796bf-cjz24" Mar 16 17:22:14 crc kubenswrapper[5120]: I0316 17:22:14.719598 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6mk2\" (UniqueName: \"kubernetes.io/projected/5ebeaceb-5117-4200-abf4-b810b8b024d7-kube-api-access-l6mk2\") pod \"dnsmasq-dnsmasq-67bb796bf-cjz24\" (UID: \"5ebeaceb-5117-4200-abf4-b810b8b024d7\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-67bb796bf-cjz24" Mar 16 17:22:14 crc kubenswrapper[5120]: I0316 17:22:14.720313 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxp7g\" (UniqueName: \"kubernetes.io/projected/c3656132-3010-45c1-a0df-f1394d08c0e5-kube-api-access-jxp7g\") pod \"dnsmasq-dnsmasq-79dcd846c5-sjkkk\" (UID: \"c3656132-3010-45c1-a0df-f1394d08c0e5\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-sjkkk" Mar 16 17:22:14 crc kubenswrapper[5120]: I0316 17:22:14.810401 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-sjkkk" Mar 16 17:22:15 crc kubenswrapper[5120]: I0316 17:22:15.216050 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"edpm-compute-global\" (UniqueName: \"kubernetes.io/configmap/5ebeaceb-5117-4200-abf4-b810b8b024d7-edpm-compute-global\") pod \"dnsmasq-dnsmasq-67bb796bf-cjz24\" (UID: \"5ebeaceb-5117-4200-abf4-b810b8b024d7\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-67bb796bf-cjz24" Mar 16 17:22:15 crc kubenswrapper[5120]: E0316 17:22:15.216222 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/edpm-compute-global: configmap "edpm-compute-global" not found Mar 16 17:22:15 crc kubenswrapper[5120]: E0316 17:22:15.216464 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5ebeaceb-5117-4200-abf4-b810b8b024d7-edpm-compute-global podName:5ebeaceb-5117-4200-abf4-b810b8b024d7 nodeName:}" failed. No retries permitted until 2026-03-16 17:22:16.216443021 +0000 UTC m=+6638.370374678 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "edpm-compute-global" (UniqueName: "kubernetes.io/configmap/5ebeaceb-5117-4200-abf4-b810b8b024d7-edpm-compute-global") pod "dnsmasq-dnsmasq-67bb796bf-cjz24" (UID: "5ebeaceb-5117-4200-abf4-b810b8b024d7") : configmap "edpm-compute-global" not found Mar 16 17:22:15 crc kubenswrapper[5120]: I0316 17:22:15.251978 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-sjkkk"] Mar 16 17:22:15 crc kubenswrapper[5120]: I0316 17:22:15.384877 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-67bb796bf-cjz24" Mar 16 17:22:15 crc kubenswrapper[5120]: I0316 17:22:15.384908 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-sjkkk" event={"ID":"c3656132-3010-45c1-a0df-f1394d08c0e5","Type":"ContainerStarted","Data":"dc5e09fdaafd46c66a11d2510fd44175f0194472c130fd4ac439b3530cffda0f"} Mar 16 17:22:15 crc kubenswrapper[5120]: I0316 17:22:15.396097 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-67bb796bf-cjz24" Mar 16 17:22:15 crc kubenswrapper[5120]: I0316 17:22:15.521910 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5ebeaceb-5117-4200-abf4-b810b8b024d7-config\") pod \"5ebeaceb-5117-4200-abf4-b810b8b024d7\" (UID: \"5ebeaceb-5117-4200-abf4-b810b8b024d7\") " Mar 16 17:22:15 crc kubenswrapper[5120]: I0316 17:22:15.522124 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/5ebeaceb-5117-4200-abf4-b810b8b024d7-dnsmasq-svc\") pod \"5ebeaceb-5117-4200-abf4-b810b8b024d7\" (UID: \"5ebeaceb-5117-4200-abf4-b810b8b024d7\") " Mar 16 17:22:15 crc kubenswrapper[5120]: I0316 17:22:15.522371 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l6mk2\" (UniqueName: \"kubernetes.io/projected/5ebeaceb-5117-4200-abf4-b810b8b024d7-kube-api-access-l6mk2\") pod \"5ebeaceb-5117-4200-abf4-b810b8b024d7\" (UID: \"5ebeaceb-5117-4200-abf4-b810b8b024d7\") " Mar 16 17:22:15 crc kubenswrapper[5120]: I0316 17:22:15.522623 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ebeaceb-5117-4200-abf4-b810b8b024d7-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "5ebeaceb-5117-4200-abf4-b810b8b024d7" (UID: "5ebeaceb-5117-4200-abf4-b810b8b024d7"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:22:15 crc kubenswrapper[5120]: I0316 17:22:15.522804 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ebeaceb-5117-4200-abf4-b810b8b024d7-config" (OuterVolumeSpecName: "config") pod "5ebeaceb-5117-4200-abf4-b810b8b024d7" (UID: "5ebeaceb-5117-4200-abf4-b810b8b024d7"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:22:15 crc kubenswrapper[5120]: I0316 17:22:15.524018 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5ebeaceb-5117-4200-abf4-b810b8b024d7-config\") on node \"crc\" DevicePath \"\"" Mar 16 17:22:15 crc kubenswrapper[5120]: I0316 17:22:15.524061 5120 reconciler_common.go:299] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/5ebeaceb-5117-4200-abf4-b810b8b024d7-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Mar 16 17:22:15 crc kubenswrapper[5120]: I0316 17:22:15.526488 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ebeaceb-5117-4200-abf4-b810b8b024d7-kube-api-access-l6mk2" (OuterVolumeSpecName: "kube-api-access-l6mk2") pod "5ebeaceb-5117-4200-abf4-b810b8b024d7" (UID: "5ebeaceb-5117-4200-abf4-b810b8b024d7"). InnerVolumeSpecName "kube-api-access-l6mk2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:22:15 crc kubenswrapper[5120]: I0316 17:22:15.626273 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l6mk2\" (UniqueName: \"kubernetes.io/projected/5ebeaceb-5117-4200-abf4-b810b8b024d7-kube-api-access-l6mk2\") on node \"crc\" DevicePath \"\"" Mar 16 17:22:15 crc kubenswrapper[5120]: I0316 17:22:15.665176 5120 scope.go:117] "RemoveContainer" containerID="2ca61165dca6fdb30458423ef74c44c42b1b273e8fa504e89f5f9e186e516cc3" Mar 16 17:22:15 crc kubenswrapper[5120]: E0316 17:22:15.665877 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 17:22:16 crc kubenswrapper[5120]: I0316 17:22:16.239953 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"edpm-compute-global\" (UniqueName: \"kubernetes.io/configmap/5ebeaceb-5117-4200-abf4-b810b8b024d7-edpm-compute-global\") pod \"dnsmasq-dnsmasq-67bb796bf-cjz24\" (UID: \"5ebeaceb-5117-4200-abf4-b810b8b024d7\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-67bb796bf-cjz24" Mar 16 17:22:16 crc kubenswrapper[5120]: E0316 17:22:16.240069 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/edpm-compute-global: configmap "edpm-compute-global" not found Mar 16 17:22:16 crc kubenswrapper[5120]: E0316 17:22:16.240385 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5ebeaceb-5117-4200-abf4-b810b8b024d7-edpm-compute-global podName:5ebeaceb-5117-4200-abf4-b810b8b024d7 nodeName:}" failed. No retries permitted until 2026-03-16 17:22:18.2403353 +0000 UTC m=+6640.394266967 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "edpm-compute-global" (UniqueName: "kubernetes.io/configmap/5ebeaceb-5117-4200-abf4-b810b8b024d7-edpm-compute-global") pod "dnsmasq-dnsmasq-67bb796bf-cjz24" (UID: "5ebeaceb-5117-4200-abf4-b810b8b024d7") : configmap "edpm-compute-global" not found Mar 16 17:22:16 crc kubenswrapper[5120]: I0316 17:22:16.396514 5120 generic.go:358] "Generic (PLEG): container finished" podID="c3656132-3010-45c1-a0df-f1394d08c0e5" containerID="159835db48d97ce80479ef27ef87b3740c51daef6ec7f1663e3a2e87bca46fd7" exitCode=0 Mar 16 17:22:16 crc kubenswrapper[5120]: I0316 17:22:16.396644 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-sjkkk" event={"ID":"c3656132-3010-45c1-a0df-f1394d08c0e5","Type":"ContainerDied","Data":"159835db48d97ce80479ef27ef87b3740c51daef6ec7f1663e3a2e87bca46fd7"} Mar 16 17:22:16 crc kubenswrapper[5120]: I0316 17:22:16.396789 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-67bb796bf-cjz24" Mar 16 17:22:16 crc kubenswrapper[5120]: I0316 17:22:16.547617 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-67bb796bf-cjz24"] Mar 16 17:22:16 crc kubenswrapper[5120]: I0316 17:22:16.552450 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-67bb796bf-cjz24"] Mar 16 17:22:16 crc kubenswrapper[5120]: I0316 17:22:16.650037 5120 reconciler_common.go:299] "Volume detached for volume \"edpm-compute-global\" (UniqueName: \"kubernetes.io/configmap/5ebeaceb-5117-4200-abf4-b810b8b024d7-edpm-compute-global\") on node \"crc\" DevicePath \"\"" Mar 16 17:22:16 crc kubenswrapper[5120]: I0316 17:22:16.673351 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ebeaceb-5117-4200-abf4-b810b8b024d7" path="/var/lib/kubelet/pods/5ebeaceb-5117-4200-abf4-b810b8b024d7/volumes" Mar 16 17:22:17 crc kubenswrapper[5120]: I0316 17:22:17.410729 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-sjkkk" event={"ID":"c3656132-3010-45c1-a0df-f1394d08c0e5","Type":"ContainerStarted","Data":"a7e9b546caaf7d4a8fc2befbce2191d822a948be0ab2d7fead7bb439111d47bd"} Mar 16 17:22:17 crc kubenswrapper[5120]: I0316 17:22:17.411133 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-sjkkk" Mar 16 17:22:17 crc kubenswrapper[5120]: I0316 17:22:17.433324 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-sjkkk" podStartSLOduration=3.433297707 podStartE2EDuration="3.433297707s" podCreationTimestamp="2026-03-16 17:22:14 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:22:17.429330919 +0000 UTC m=+6639.583262596" watchObservedRunningTime="2026-03-16 17:22:17.433297707 +0000 UTC m=+6639.587229364" Mar 16 17:22:21 crc kubenswrapper[5120]: I0316 17:22:21.619208 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["crc-storage/crc-storage-crc-7756s"] Mar 16 17:22:21 crc kubenswrapper[5120]: I0316 17:22:21.625485 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["crc-storage/crc-storage-crc-7756s"] Mar 16 17:22:21 crc kubenswrapper[5120]: I0316 17:22:21.736565 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["crc-storage/crc-storage-crc-2vkr2"] Mar 16 17:22:21 crc kubenswrapper[5120]: I0316 17:22:21.742716 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-2vkr2" Mar 16 17:22:21 crc kubenswrapper[5120]: I0316 17:22:21.744593 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-2vkr2"] Mar 16 17:22:21 crc kubenswrapper[5120]: I0316 17:22:21.745165 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"crc-storage\"/\"crc-storage-dockercfg-s2tht\"" Mar 16 17:22:21 crc kubenswrapper[5120]: I0316 17:22:21.745359 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"openshift-service-ca.crt\"" Mar 16 17:22:21 crc kubenswrapper[5120]: I0316 17:22:21.745407 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"kube-root-ca.crt\"" Mar 16 17:22:21 crc kubenswrapper[5120]: I0316 17:22:21.746855 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"crc-storage\"" Mar 16 17:22:21 crc kubenswrapper[5120]: I0316 17:22:21.861897 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/8a974730-1822-4122-b77e-bf0bcecc498c-crc-storage\") pod \"crc-storage-crc-2vkr2\" (UID: \"8a974730-1822-4122-b77e-bf0bcecc498c\") " pod="crc-storage/crc-storage-crc-2vkr2" Mar 16 17:22:21 crc kubenswrapper[5120]: I0316 17:22:21.862214 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/8a974730-1822-4122-b77e-bf0bcecc498c-node-mnt\") pod \"crc-storage-crc-2vkr2\" (UID: \"8a974730-1822-4122-b77e-bf0bcecc498c\") " pod="crc-storage/crc-storage-crc-2vkr2" Mar 16 17:22:21 crc kubenswrapper[5120]: I0316 17:22:21.862598 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mj7b9\" (UniqueName: \"kubernetes.io/projected/8a974730-1822-4122-b77e-bf0bcecc498c-kube-api-access-mj7b9\") pod \"crc-storage-crc-2vkr2\" (UID: \"8a974730-1822-4122-b77e-bf0bcecc498c\") " pod="crc-storage/crc-storage-crc-2vkr2" Mar 16 17:22:21 crc kubenswrapper[5120]: I0316 17:22:21.965405 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/8a974730-1822-4122-b77e-bf0bcecc498c-crc-storage\") pod \"crc-storage-crc-2vkr2\" (UID: \"8a974730-1822-4122-b77e-bf0bcecc498c\") " pod="crc-storage/crc-storage-crc-2vkr2" Mar 16 17:22:21 crc kubenswrapper[5120]: I0316 17:22:21.965471 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/8a974730-1822-4122-b77e-bf0bcecc498c-node-mnt\") pod \"crc-storage-crc-2vkr2\" (UID: \"8a974730-1822-4122-b77e-bf0bcecc498c\") " pod="crc-storage/crc-storage-crc-2vkr2" Mar 16 17:22:21 crc kubenswrapper[5120]: I0316 17:22:21.965826 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mj7b9\" (UniqueName: \"kubernetes.io/projected/8a974730-1822-4122-b77e-bf0bcecc498c-kube-api-access-mj7b9\") pod \"crc-storage-crc-2vkr2\" (UID: \"8a974730-1822-4122-b77e-bf0bcecc498c\") " pod="crc-storage/crc-storage-crc-2vkr2" Mar 16 17:22:21 crc kubenswrapper[5120]: I0316 17:22:21.966083 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/8a974730-1822-4122-b77e-bf0bcecc498c-node-mnt\") pod \"crc-storage-crc-2vkr2\" (UID: \"8a974730-1822-4122-b77e-bf0bcecc498c\") " pod="crc-storage/crc-storage-crc-2vkr2" Mar 16 17:22:21 crc kubenswrapper[5120]: I0316 17:22:21.966955 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/8a974730-1822-4122-b77e-bf0bcecc498c-crc-storage\") pod \"crc-storage-crc-2vkr2\" (UID: \"8a974730-1822-4122-b77e-bf0bcecc498c\") " pod="crc-storage/crc-storage-crc-2vkr2" Mar 16 17:22:21 crc kubenswrapper[5120]: I0316 17:22:21.985428 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mj7b9\" (UniqueName: \"kubernetes.io/projected/8a974730-1822-4122-b77e-bf0bcecc498c-kube-api-access-mj7b9\") pod \"crc-storage-crc-2vkr2\" (UID: \"8a974730-1822-4122-b77e-bf0bcecc498c\") " pod="crc-storage/crc-storage-crc-2vkr2" Mar 16 17:22:22 crc kubenswrapper[5120]: I0316 17:22:22.069451 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-2vkr2" Mar 16 17:22:22 crc kubenswrapper[5120]: I0316 17:22:22.485403 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-2vkr2"] Mar 16 17:22:22 crc kubenswrapper[5120]: I0316 17:22:22.673828 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7b4ef419-2944-418b-9d08-306c8f39f7a7" path="/var/lib/kubelet/pods/7b4ef419-2944-418b-9d08-306c8f39f7a7/volumes" Mar 16 17:22:23 crc kubenswrapper[5120]: I0316 17:22:23.419744 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-sjkkk" Mar 16 17:22:23 crc kubenswrapper[5120]: I0316 17:22:23.463105 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-2vkr2" event={"ID":"8a974730-1822-4122-b77e-bf0bcecc498c","Type":"ContainerStarted","Data":"918c155cb132742cfe46a640b9ffdcfce0f29564c8cb7ab9dc8bbb918430a93b"} Mar 16 17:22:23 crc kubenswrapper[5120]: I0316 17:22:23.481462 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-6bfd6db6c-rsfj9"] Mar 16 17:22:23 crc kubenswrapper[5120]: I0316 17:22:23.481756 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6bfd6db6c-rsfj9" podUID="1b766beb-1497-471b-a986-6ee60a441924" containerName="dnsmasq-dns" containerID="cri-o://3bd16362cd4f225ae75753af56053201fd913e06fd4a0ae95fdbb33f97174db5" gracePeriod=10 Mar 16 17:22:23 crc kubenswrapper[5120]: I0316 17:22:23.954967 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6bfd6db6c-rsfj9" Mar 16 17:22:24 crc kubenswrapper[5120]: I0316 17:22:24.031247 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"edpm-compute-beta-nodeset\" (UniqueName: \"kubernetes.io/configmap/1b766beb-1497-471b-a986-6ee60a441924-edpm-compute-beta-nodeset\") pod \"1b766beb-1497-471b-a986-6ee60a441924\" (UID: \"1b766beb-1497-471b-a986-6ee60a441924\") " Mar 16 17:22:24 crc kubenswrapper[5120]: I0316 17:22:24.031893 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"edpm-compute-global\" (UniqueName: \"kubernetes.io/configmap/1b766beb-1497-471b-a986-6ee60a441924-edpm-compute-global\") pod \"1b766beb-1497-471b-a986-6ee60a441924\" (UID: \"1b766beb-1497-471b-a986-6ee60a441924\") " Mar 16 17:22:24 crc kubenswrapper[5120]: I0316 17:22:24.032140 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1b766beb-1497-471b-a986-6ee60a441924-config\") pod \"1b766beb-1497-471b-a986-6ee60a441924\" (UID: \"1b766beb-1497-471b-a986-6ee60a441924\") " Mar 16 17:22:24 crc kubenswrapper[5120]: I0316 17:22:24.032273 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qkcwd\" (UniqueName: \"kubernetes.io/projected/1b766beb-1497-471b-a986-6ee60a441924-kube-api-access-qkcwd\") pod \"1b766beb-1497-471b-a986-6ee60a441924\" (UID: \"1b766beb-1497-471b-a986-6ee60a441924\") " Mar 16 17:22:24 crc kubenswrapper[5120]: I0316 17:22:24.032466 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/1b766beb-1497-471b-a986-6ee60a441924-dnsmasq-svc\") pod \"1b766beb-1497-471b-a986-6ee60a441924\" (UID: \"1b766beb-1497-471b-a986-6ee60a441924\") " Mar 16 17:22:24 crc kubenswrapper[5120]: I0316 17:22:24.038341 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b766beb-1497-471b-a986-6ee60a441924-kube-api-access-qkcwd" (OuterVolumeSpecName: "kube-api-access-qkcwd") pod "1b766beb-1497-471b-a986-6ee60a441924" (UID: "1b766beb-1497-471b-a986-6ee60a441924"). InnerVolumeSpecName "kube-api-access-qkcwd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:22:24 crc kubenswrapper[5120]: I0316 17:22:24.075352 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1b766beb-1497-471b-a986-6ee60a441924-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "1b766beb-1497-471b-a986-6ee60a441924" (UID: "1b766beb-1497-471b-a986-6ee60a441924"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:22:24 crc kubenswrapper[5120]: I0316 17:22:24.075548 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1b766beb-1497-471b-a986-6ee60a441924-edpm-compute-global" (OuterVolumeSpecName: "edpm-compute-global") pod "1b766beb-1497-471b-a986-6ee60a441924" (UID: "1b766beb-1497-471b-a986-6ee60a441924"). InnerVolumeSpecName "edpm-compute-global". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:22:24 crc kubenswrapper[5120]: I0316 17:22:24.076354 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1b766beb-1497-471b-a986-6ee60a441924-config" (OuterVolumeSpecName: "config") pod "1b766beb-1497-471b-a986-6ee60a441924" (UID: "1b766beb-1497-471b-a986-6ee60a441924"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:22:24 crc kubenswrapper[5120]: I0316 17:22:24.079153 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1b766beb-1497-471b-a986-6ee60a441924-edpm-compute-beta-nodeset" (OuterVolumeSpecName: "edpm-compute-beta-nodeset") pod "1b766beb-1497-471b-a986-6ee60a441924" (UID: "1b766beb-1497-471b-a986-6ee60a441924"). InnerVolumeSpecName "edpm-compute-beta-nodeset". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:22:24 crc kubenswrapper[5120]: I0316 17:22:24.135526 5120 reconciler_common.go:299] "Volume detached for volume \"edpm-compute-beta-nodeset\" (UniqueName: \"kubernetes.io/configmap/1b766beb-1497-471b-a986-6ee60a441924-edpm-compute-beta-nodeset\") on node \"crc\" DevicePath \"\"" Mar 16 17:22:24 crc kubenswrapper[5120]: I0316 17:22:24.135850 5120 reconciler_common.go:299] "Volume detached for volume \"edpm-compute-global\" (UniqueName: \"kubernetes.io/configmap/1b766beb-1497-471b-a986-6ee60a441924-edpm-compute-global\") on node \"crc\" DevicePath \"\"" Mar 16 17:22:24 crc kubenswrapper[5120]: I0316 17:22:24.135996 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1b766beb-1497-471b-a986-6ee60a441924-config\") on node \"crc\" DevicePath \"\"" Mar 16 17:22:24 crc kubenswrapper[5120]: I0316 17:22:24.136110 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qkcwd\" (UniqueName: \"kubernetes.io/projected/1b766beb-1497-471b-a986-6ee60a441924-kube-api-access-qkcwd\") on node \"crc\" DevicePath \"\"" Mar 16 17:22:24 crc kubenswrapper[5120]: I0316 17:22:24.136186 5120 reconciler_common.go:299] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/1b766beb-1497-471b-a986-6ee60a441924-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Mar 16 17:22:24 crc kubenswrapper[5120]: I0316 17:22:24.474155 5120 generic.go:358] "Generic (PLEG): container finished" podID="8a974730-1822-4122-b77e-bf0bcecc498c" containerID="4089538c541ca20870002ad5f9d5c5483dd30f36da1b6e81a3360d99c5a9bf3e" exitCode=0 Mar 16 17:22:24 crc kubenswrapper[5120]: I0316 17:22:24.474368 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-2vkr2" event={"ID":"8a974730-1822-4122-b77e-bf0bcecc498c","Type":"ContainerDied","Data":"4089538c541ca20870002ad5f9d5c5483dd30f36da1b6e81a3360d99c5a9bf3e"} Mar 16 17:22:24 crc kubenswrapper[5120]: I0316 17:22:24.476408 5120 generic.go:358] "Generic (PLEG): container finished" podID="1b766beb-1497-471b-a986-6ee60a441924" containerID="3bd16362cd4f225ae75753af56053201fd913e06fd4a0ae95fdbb33f97174db5" exitCode=0 Mar 16 17:22:24 crc kubenswrapper[5120]: I0316 17:22:24.476498 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6bfd6db6c-rsfj9" event={"ID":"1b766beb-1497-471b-a986-6ee60a441924","Type":"ContainerDied","Data":"3bd16362cd4f225ae75753af56053201fd913e06fd4a0ae95fdbb33f97174db5"} Mar 16 17:22:24 crc kubenswrapper[5120]: I0316 17:22:24.476550 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6bfd6db6c-rsfj9" event={"ID":"1b766beb-1497-471b-a986-6ee60a441924","Type":"ContainerDied","Data":"9758217056e1d70d11998ca24a7cd0db055f471a082fd3945f1fa908d0cf97dd"} Mar 16 17:22:24 crc kubenswrapper[5120]: I0316 17:22:24.476584 5120 scope.go:117] "RemoveContainer" containerID="3bd16362cd4f225ae75753af56053201fd913e06fd4a0ae95fdbb33f97174db5" Mar 16 17:22:24 crc kubenswrapper[5120]: I0316 17:22:24.476785 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6bfd6db6c-rsfj9" Mar 16 17:22:24 crc kubenswrapper[5120]: I0316 17:22:24.515995 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-6bfd6db6c-rsfj9"] Mar 16 17:22:24 crc kubenswrapper[5120]: I0316 17:22:24.520348 5120 scope.go:117] "RemoveContainer" containerID="065d4c2a8aa78f6f8e380943b4e490bebc2b4edb93bf161581ccbc23e1316974" Mar 16 17:22:24 crc kubenswrapper[5120]: I0316 17:22:24.522360 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-6bfd6db6c-rsfj9"] Mar 16 17:22:24 crc kubenswrapper[5120]: I0316 17:22:24.555160 5120 scope.go:117] "RemoveContainer" containerID="3bd16362cd4f225ae75753af56053201fd913e06fd4a0ae95fdbb33f97174db5" Mar 16 17:22:24 crc kubenswrapper[5120]: E0316 17:22:24.555559 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3bd16362cd4f225ae75753af56053201fd913e06fd4a0ae95fdbb33f97174db5\": container with ID starting with 3bd16362cd4f225ae75753af56053201fd913e06fd4a0ae95fdbb33f97174db5 not found: ID does not exist" containerID="3bd16362cd4f225ae75753af56053201fd913e06fd4a0ae95fdbb33f97174db5" Mar 16 17:22:24 crc kubenswrapper[5120]: I0316 17:22:24.555617 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3bd16362cd4f225ae75753af56053201fd913e06fd4a0ae95fdbb33f97174db5"} err="failed to get container status \"3bd16362cd4f225ae75753af56053201fd913e06fd4a0ae95fdbb33f97174db5\": rpc error: code = NotFound desc = could not find container \"3bd16362cd4f225ae75753af56053201fd913e06fd4a0ae95fdbb33f97174db5\": container with ID starting with 3bd16362cd4f225ae75753af56053201fd913e06fd4a0ae95fdbb33f97174db5 not found: ID does not exist" Mar 16 17:22:24 crc kubenswrapper[5120]: I0316 17:22:24.555648 5120 scope.go:117] "RemoveContainer" containerID="065d4c2a8aa78f6f8e380943b4e490bebc2b4edb93bf161581ccbc23e1316974" Mar 16 17:22:24 crc kubenswrapper[5120]: E0316 17:22:24.556027 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"065d4c2a8aa78f6f8e380943b4e490bebc2b4edb93bf161581ccbc23e1316974\": container with ID starting with 065d4c2a8aa78f6f8e380943b4e490bebc2b4edb93bf161581ccbc23e1316974 not found: ID does not exist" containerID="065d4c2a8aa78f6f8e380943b4e490bebc2b4edb93bf161581ccbc23e1316974" Mar 16 17:22:24 crc kubenswrapper[5120]: I0316 17:22:24.556062 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"065d4c2a8aa78f6f8e380943b4e490bebc2b4edb93bf161581ccbc23e1316974"} err="failed to get container status \"065d4c2a8aa78f6f8e380943b4e490bebc2b4edb93bf161581ccbc23e1316974\": rpc error: code = NotFound desc = could not find container \"065d4c2a8aa78f6f8e380943b4e490bebc2b4edb93bf161581ccbc23e1316974\": container with ID starting with 065d4c2a8aa78f6f8e380943b4e490bebc2b4edb93bf161581ccbc23e1316974 not found: ID does not exist" Mar 16 17:22:24 crc kubenswrapper[5120]: I0316 17:22:24.672832 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1b766beb-1497-471b-a986-6ee60a441924" path="/var/lib/kubelet/pods/1b766beb-1497-471b-a986-6ee60a441924/volumes" Mar 16 17:22:24 crc kubenswrapper[5120]: I0316 17:22:24.817686 5120 scope.go:117] "RemoveContainer" containerID="53dee9ec6f61b3c2fe3a98dba73419658c1a5e8068004e03d249fb113db99fb1" Mar 16 17:22:24 crc kubenswrapper[5120]: I0316 17:22:24.834817 5120 scope.go:117] "RemoveContainer" containerID="8e966e7a3db58c0ea0cbcd320352f7c37ff60c65ba460cbea2a206ae8bc85a03" Mar 16 17:22:24 crc kubenswrapper[5120]: I0316 17:22:24.854073 5120 scope.go:117] "RemoveContainer" containerID="b1bb1b4ab057a25df9b631fc57e4802bf0bba47050f57936fc34c73572f29c74" Mar 16 17:22:24 crc kubenswrapper[5120]: I0316 17:22:24.870544 5120 scope.go:117] "RemoveContainer" containerID="1f033c1078ab366c878ef0f91d47853f19b234f5aabc572bf79644c1cbe72955" Mar 16 17:22:24 crc kubenswrapper[5120]: I0316 17:22:24.945642 5120 scope.go:117] "RemoveContainer" containerID="7b3605121dfcb41904c93ec2bbb8ad37d6a6e38ef76cb5f399e9242f155e315c" Mar 16 17:22:25 crc kubenswrapper[5120]: I0316 17:22:25.856564 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-2vkr2" Mar 16 17:22:25 crc kubenswrapper[5120]: I0316 17:22:25.990785 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mj7b9\" (UniqueName: \"kubernetes.io/projected/8a974730-1822-4122-b77e-bf0bcecc498c-kube-api-access-mj7b9\") pod \"8a974730-1822-4122-b77e-bf0bcecc498c\" (UID: \"8a974730-1822-4122-b77e-bf0bcecc498c\") " Mar 16 17:22:25 crc kubenswrapper[5120]: I0316 17:22:25.990959 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/8a974730-1822-4122-b77e-bf0bcecc498c-crc-storage\") pod \"8a974730-1822-4122-b77e-bf0bcecc498c\" (UID: \"8a974730-1822-4122-b77e-bf0bcecc498c\") " Mar 16 17:22:25 crc kubenswrapper[5120]: I0316 17:22:25.990986 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/8a974730-1822-4122-b77e-bf0bcecc498c-node-mnt\") pod \"8a974730-1822-4122-b77e-bf0bcecc498c\" (UID: \"8a974730-1822-4122-b77e-bf0bcecc498c\") " Mar 16 17:22:25 crc kubenswrapper[5120]: I0316 17:22:25.991171 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/8a974730-1822-4122-b77e-bf0bcecc498c-node-mnt" (OuterVolumeSpecName: "node-mnt") pod "8a974730-1822-4122-b77e-bf0bcecc498c" (UID: "8a974730-1822-4122-b77e-bf0bcecc498c"). InnerVolumeSpecName "node-mnt". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 17:22:25 crc kubenswrapper[5120]: I0316 17:22:25.992096 5120 reconciler_common.go:299] "Volume detached for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/8a974730-1822-4122-b77e-bf0bcecc498c-node-mnt\") on node \"crc\" DevicePath \"\"" Mar 16 17:22:25 crc kubenswrapper[5120]: I0316 17:22:25.995801 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a974730-1822-4122-b77e-bf0bcecc498c-kube-api-access-mj7b9" (OuterVolumeSpecName: "kube-api-access-mj7b9") pod "8a974730-1822-4122-b77e-bf0bcecc498c" (UID: "8a974730-1822-4122-b77e-bf0bcecc498c"). InnerVolumeSpecName "kube-api-access-mj7b9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:22:26 crc kubenswrapper[5120]: I0316 17:22:26.011586 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a974730-1822-4122-b77e-bf0bcecc498c-crc-storage" (OuterVolumeSpecName: "crc-storage") pod "8a974730-1822-4122-b77e-bf0bcecc498c" (UID: "8a974730-1822-4122-b77e-bf0bcecc498c"). InnerVolumeSpecName "crc-storage". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:22:26 crc kubenswrapper[5120]: I0316 17:22:26.093705 5120 reconciler_common.go:299] "Volume detached for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/8a974730-1822-4122-b77e-bf0bcecc498c-crc-storage\") on node \"crc\" DevicePath \"\"" Mar 16 17:22:26 crc kubenswrapper[5120]: I0316 17:22:26.094045 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mj7b9\" (UniqueName: \"kubernetes.io/projected/8a974730-1822-4122-b77e-bf0bcecc498c-kube-api-access-mj7b9\") on node \"crc\" DevicePath \"\"" Mar 16 17:22:26 crc kubenswrapper[5120]: I0316 17:22:26.508124 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-2vkr2" event={"ID":"8a974730-1822-4122-b77e-bf0bcecc498c","Type":"ContainerDied","Data":"918c155cb132742cfe46a640b9ffdcfce0f29564c8cb7ab9dc8bbb918430a93b"} Mar 16 17:22:26 crc kubenswrapper[5120]: I0316 17:22:26.508159 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="918c155cb132742cfe46a640b9ffdcfce0f29564c8cb7ab9dc8bbb918430a93b" Mar 16 17:22:26 crc kubenswrapper[5120]: I0316 17:22:26.508220 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-2vkr2" Mar 16 17:22:27 crc kubenswrapper[5120]: I0316 17:22:27.663733 5120 scope.go:117] "RemoveContainer" containerID="2ca61165dca6fdb30458423ef74c44c42b1b273e8fa504e89f5f9e186e516cc3" Mar 16 17:22:28 crc kubenswrapper[5120]: I0316 17:22:28.532154 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" event={"ID":"e2275cb4-4905-4d66-a87e-8010120db2bd","Type":"ContainerStarted","Data":"705b2fc8d158c06189736fd1aaa4ad03cb7c69d2b4b29439feb0bec2c2b5228a"} Mar 16 17:22:29 crc kubenswrapper[5120]: I0316 17:22:29.150812 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["crc-storage/crc-storage-crc-2vkr2"] Mar 16 17:22:29 crc kubenswrapper[5120]: I0316 17:22:29.159565 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["crc-storage/crc-storage-crc-2vkr2"] Mar 16 17:22:29 crc kubenswrapper[5120]: I0316 17:22:29.262866 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["crc-storage/crc-storage-crc-9crxp"] Mar 16 17:22:29 crc kubenswrapper[5120]: I0316 17:22:29.263856 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b766beb-1497-471b-a986-6ee60a441924" containerName="dnsmasq-dns" Mar 16 17:22:29 crc kubenswrapper[5120]: I0316 17:22:29.263877 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b766beb-1497-471b-a986-6ee60a441924" containerName="dnsmasq-dns" Mar 16 17:22:29 crc kubenswrapper[5120]: I0316 17:22:29.263890 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a974730-1822-4122-b77e-bf0bcecc498c" containerName="storage" Mar 16 17:22:29 crc kubenswrapper[5120]: I0316 17:22:29.263896 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a974730-1822-4122-b77e-bf0bcecc498c" containerName="storage" Mar 16 17:22:29 crc kubenswrapper[5120]: I0316 17:22:29.263933 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b766beb-1497-471b-a986-6ee60a441924" containerName="init" Mar 16 17:22:29 crc kubenswrapper[5120]: I0316 17:22:29.263940 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b766beb-1497-471b-a986-6ee60a441924" containerName="init" Mar 16 17:22:29 crc kubenswrapper[5120]: I0316 17:22:29.264094 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="8a974730-1822-4122-b77e-bf0bcecc498c" containerName="storage" Mar 16 17:22:29 crc kubenswrapper[5120]: I0316 17:22:29.264109 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1b766beb-1497-471b-a986-6ee60a441924" containerName="dnsmasq-dns" Mar 16 17:22:29 crc kubenswrapper[5120]: I0316 17:22:29.268527 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-9crxp" Mar 16 17:22:29 crc kubenswrapper[5120]: I0316 17:22:29.270406 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"crc-storage\"/\"crc-storage-dockercfg-s2tht\"" Mar 16 17:22:29 crc kubenswrapper[5120]: I0316 17:22:29.271506 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"openshift-service-ca.crt\"" Mar 16 17:22:29 crc kubenswrapper[5120]: I0316 17:22:29.271720 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"crc-storage\"" Mar 16 17:22:29 crc kubenswrapper[5120]: I0316 17:22:29.272367 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"kube-root-ca.crt\"" Mar 16 17:22:29 crc kubenswrapper[5120]: I0316 17:22:29.274213 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-9crxp"] Mar 16 17:22:29 crc kubenswrapper[5120]: I0316 17:22:29.357722 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jkpj\" (UniqueName: \"kubernetes.io/projected/bdded3e7-1fd7-49c5-bc57-c835920c2658-kube-api-access-8jkpj\") pod \"crc-storage-crc-9crxp\" (UID: \"bdded3e7-1fd7-49c5-bc57-c835920c2658\") " pod="crc-storage/crc-storage-crc-9crxp" Mar 16 17:22:29 crc kubenswrapper[5120]: I0316 17:22:29.357943 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/bdded3e7-1fd7-49c5-bc57-c835920c2658-node-mnt\") pod \"crc-storage-crc-9crxp\" (UID: \"bdded3e7-1fd7-49c5-bc57-c835920c2658\") " pod="crc-storage/crc-storage-crc-9crxp" Mar 16 17:22:29 crc kubenswrapper[5120]: I0316 17:22:29.358143 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/bdded3e7-1fd7-49c5-bc57-c835920c2658-crc-storage\") pod \"crc-storage-crc-9crxp\" (UID: \"bdded3e7-1fd7-49c5-bc57-c835920c2658\") " pod="crc-storage/crc-storage-crc-9crxp" Mar 16 17:22:29 crc kubenswrapper[5120]: I0316 17:22:29.459922 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/bdded3e7-1fd7-49c5-bc57-c835920c2658-crc-storage\") pod \"crc-storage-crc-9crxp\" (UID: \"bdded3e7-1fd7-49c5-bc57-c835920c2658\") " pod="crc-storage/crc-storage-crc-9crxp" Mar 16 17:22:29 crc kubenswrapper[5120]: I0316 17:22:29.460034 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8jkpj\" (UniqueName: \"kubernetes.io/projected/bdded3e7-1fd7-49c5-bc57-c835920c2658-kube-api-access-8jkpj\") pod \"crc-storage-crc-9crxp\" (UID: \"bdded3e7-1fd7-49c5-bc57-c835920c2658\") " pod="crc-storage/crc-storage-crc-9crxp" Mar 16 17:22:29 crc kubenswrapper[5120]: I0316 17:22:29.460137 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/bdded3e7-1fd7-49c5-bc57-c835920c2658-node-mnt\") pod \"crc-storage-crc-9crxp\" (UID: \"bdded3e7-1fd7-49c5-bc57-c835920c2658\") " pod="crc-storage/crc-storage-crc-9crxp" Mar 16 17:22:29 crc kubenswrapper[5120]: I0316 17:22:29.460497 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/bdded3e7-1fd7-49c5-bc57-c835920c2658-node-mnt\") pod \"crc-storage-crc-9crxp\" (UID: \"bdded3e7-1fd7-49c5-bc57-c835920c2658\") " pod="crc-storage/crc-storage-crc-9crxp" Mar 16 17:22:29 crc kubenswrapper[5120]: I0316 17:22:29.465247 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/bdded3e7-1fd7-49c5-bc57-c835920c2658-crc-storage\") pod \"crc-storage-crc-9crxp\" (UID: \"bdded3e7-1fd7-49c5-bc57-c835920c2658\") " pod="crc-storage/crc-storage-crc-9crxp" Mar 16 17:22:29 crc kubenswrapper[5120]: I0316 17:22:29.480253 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jkpj\" (UniqueName: \"kubernetes.io/projected/bdded3e7-1fd7-49c5-bc57-c835920c2658-kube-api-access-8jkpj\") pod \"crc-storage-crc-9crxp\" (UID: \"bdded3e7-1fd7-49c5-bc57-c835920c2658\") " pod="crc-storage/crc-storage-crc-9crxp" Mar 16 17:22:29 crc kubenswrapper[5120]: I0316 17:22:29.589045 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-9crxp" Mar 16 17:22:30 crc kubenswrapper[5120]: I0316 17:22:30.000721 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-9crxp"] Mar 16 17:22:30 crc kubenswrapper[5120]: I0316 17:22:30.551964 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-9crxp" event={"ID":"bdded3e7-1fd7-49c5-bc57-c835920c2658","Type":"ContainerStarted","Data":"1b21f0d65e74ffefed58d99aab4d33d81835d9d543830de46ee3a5d2a18cda2f"} Mar 16 17:22:30 crc kubenswrapper[5120]: I0316 17:22:30.678439 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a974730-1822-4122-b77e-bf0bcecc498c" path="/var/lib/kubelet/pods/8a974730-1822-4122-b77e-bf0bcecc498c/volumes" Mar 16 17:22:31 crc kubenswrapper[5120]: I0316 17:22:31.563207 5120 generic.go:358] "Generic (PLEG): container finished" podID="bdded3e7-1fd7-49c5-bc57-c835920c2658" containerID="ac4c098443c886dcc0f855cfb983fb197e11545ea6cfaa24b64e21b0e720e7bb" exitCode=0 Mar 16 17:22:31 crc kubenswrapper[5120]: I0316 17:22:31.563291 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-9crxp" event={"ID":"bdded3e7-1fd7-49c5-bc57-c835920c2658","Type":"ContainerDied","Data":"ac4c098443c886dcc0f855cfb983fb197e11545ea6cfaa24b64e21b0e720e7bb"} Mar 16 17:22:32 crc kubenswrapper[5120]: I0316 17:22:32.837310 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-9crxp" Mar 16 17:22:32 crc kubenswrapper[5120]: I0316 17:22:32.932857 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8jkpj\" (UniqueName: \"kubernetes.io/projected/bdded3e7-1fd7-49c5-bc57-c835920c2658-kube-api-access-8jkpj\") pod \"bdded3e7-1fd7-49c5-bc57-c835920c2658\" (UID: \"bdded3e7-1fd7-49c5-bc57-c835920c2658\") " Mar 16 17:22:32 crc kubenswrapper[5120]: I0316 17:22:32.932974 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/bdded3e7-1fd7-49c5-bc57-c835920c2658-crc-storage\") pod \"bdded3e7-1fd7-49c5-bc57-c835920c2658\" (UID: \"bdded3e7-1fd7-49c5-bc57-c835920c2658\") " Mar 16 17:22:32 crc kubenswrapper[5120]: I0316 17:22:32.933455 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/bdded3e7-1fd7-49c5-bc57-c835920c2658-node-mnt\") pod \"bdded3e7-1fd7-49c5-bc57-c835920c2658\" (UID: \"bdded3e7-1fd7-49c5-bc57-c835920c2658\") " Mar 16 17:22:32 crc kubenswrapper[5120]: I0316 17:22:32.933569 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/bdded3e7-1fd7-49c5-bc57-c835920c2658-node-mnt" (OuterVolumeSpecName: "node-mnt") pod "bdded3e7-1fd7-49c5-bc57-c835920c2658" (UID: "bdded3e7-1fd7-49c5-bc57-c835920c2658"). InnerVolumeSpecName "node-mnt". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 17:22:32 crc kubenswrapper[5120]: I0316 17:22:32.934428 5120 reconciler_common.go:299] "Volume detached for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/bdded3e7-1fd7-49c5-bc57-c835920c2658-node-mnt\") on node \"crc\" DevicePath \"\"" Mar 16 17:22:32 crc kubenswrapper[5120]: I0316 17:22:32.940008 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bdded3e7-1fd7-49c5-bc57-c835920c2658-kube-api-access-8jkpj" (OuterVolumeSpecName: "kube-api-access-8jkpj") pod "bdded3e7-1fd7-49c5-bc57-c835920c2658" (UID: "bdded3e7-1fd7-49c5-bc57-c835920c2658"). InnerVolumeSpecName "kube-api-access-8jkpj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:22:32 crc kubenswrapper[5120]: I0316 17:22:32.952832 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bdded3e7-1fd7-49c5-bc57-c835920c2658-crc-storage" (OuterVolumeSpecName: "crc-storage") pod "bdded3e7-1fd7-49c5-bc57-c835920c2658" (UID: "bdded3e7-1fd7-49c5-bc57-c835920c2658"). InnerVolumeSpecName "crc-storage". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:22:33 crc kubenswrapper[5120]: I0316 17:22:33.036200 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8jkpj\" (UniqueName: \"kubernetes.io/projected/bdded3e7-1fd7-49c5-bc57-c835920c2658-kube-api-access-8jkpj\") on node \"crc\" DevicePath \"\"" Mar 16 17:22:33 crc kubenswrapper[5120]: I0316 17:22:33.036237 5120 reconciler_common.go:299] "Volume detached for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/bdded3e7-1fd7-49c5-bc57-c835920c2658-crc-storage\") on node \"crc\" DevicePath \"\"" Mar 16 17:22:33 crc kubenswrapper[5120]: I0316 17:22:33.587328 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-9crxp" event={"ID":"bdded3e7-1fd7-49c5-bc57-c835920c2658","Type":"ContainerDied","Data":"1b21f0d65e74ffefed58d99aab4d33d81835d9d543830de46ee3a5d2a18cda2f"} Mar 16 17:22:33 crc kubenswrapper[5120]: I0316 17:22:33.587371 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1b21f0d65e74ffefed58d99aab4d33d81835d9d543830de46ee3a5d2a18cda2f" Mar 16 17:22:33 crc kubenswrapper[5120]: I0316 17:22:33.587522 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-9crxp" Mar 16 17:22:36 crc kubenswrapper[5120]: I0316 17:22:36.056922 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-77f4d697b7-hlrz5"] Mar 16 17:22:36 crc kubenswrapper[5120]: I0316 17:22:36.059310 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bdded3e7-1fd7-49c5-bc57-c835920c2658" containerName="storage" Mar 16 17:22:36 crc kubenswrapper[5120]: I0316 17:22:36.059352 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="bdded3e7-1fd7-49c5-bc57-c835920c2658" containerName="storage" Mar 16 17:22:36 crc kubenswrapper[5120]: I0316 17:22:36.059796 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="bdded3e7-1fd7-49c5-bc57-c835920c2658" containerName="storage" Mar 16 17:22:36 crc kubenswrapper[5120]: I0316 17:22:36.083417 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-77f4d697b7-hlrz5" Mar 16 17:22:36 crc kubenswrapper[5120]: I0316 17:22:36.089627 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-edpm-tls\"" Mar 16 17:22:36 crc kubenswrapper[5120]: I0316 17:22:36.100668 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/053c7b18-896d-4cf6-9625-d9893747aa4c-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-77f4d697b7-hlrz5\" (UID: \"053c7b18-896d-4cf6-9625-d9893747aa4c\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-77f4d697b7-hlrz5" Mar 16 17:22:36 crc kubenswrapper[5120]: I0316 17:22:36.100720 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lpd4k\" (UniqueName: \"kubernetes.io/projected/053c7b18-896d-4cf6-9625-d9893747aa4c-kube-api-access-lpd4k\") pod \"dnsmasq-dnsmasq-77f4d697b7-hlrz5\" (UID: \"053c7b18-896d-4cf6-9625-d9893747aa4c\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-77f4d697b7-hlrz5" Mar 16 17:22:36 crc kubenswrapper[5120]: I0316 17:22:36.100793 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/053c7b18-896d-4cf6-9625-d9893747aa4c-config\") pod \"dnsmasq-dnsmasq-77f4d697b7-hlrz5\" (UID: \"053c7b18-896d-4cf6-9625-d9893747aa4c\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-77f4d697b7-hlrz5" Mar 16 17:22:36 crc kubenswrapper[5120]: I0316 17:22:36.100820 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-edpm-tls\" (UniqueName: \"kubernetes.io/configmap/053c7b18-896d-4cf6-9625-d9893747aa4c-openstack-edpm-tls\") pod \"dnsmasq-dnsmasq-77f4d697b7-hlrz5\" (UID: \"053c7b18-896d-4cf6-9625-d9893747aa4c\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-77f4d697b7-hlrz5" Mar 16 17:22:36 crc kubenswrapper[5120]: I0316 17:22:36.102619 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-77f4d697b7-hlrz5"] Mar 16 17:22:36 crc kubenswrapper[5120]: I0316 17:22:36.177373 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-77f4d697b7-hlrz5"] Mar 16 17:22:36 crc kubenswrapper[5120]: E0316 17:22:36.178229 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[config dnsmasq-svc kube-api-access-lpd4k openstack-edpm-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-77f4d697b7-hlrz5" podUID="053c7b18-896d-4cf6-9625-d9893747aa4c" Mar 16 17:22:36 crc kubenswrapper[5120]: I0316 17:22:36.192460 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-6f5787b9d7-q5fft"] Mar 16 17:22:36 crc kubenswrapper[5120]: I0316 17:22:36.198145 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6f5787b9d7-q5fft" Mar 16 17:22:36 crc kubenswrapper[5120]: I0316 17:22:36.202899 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/053c7b18-896d-4cf6-9625-d9893747aa4c-config\") pod \"dnsmasq-dnsmasq-77f4d697b7-hlrz5\" (UID: \"053c7b18-896d-4cf6-9625-d9893747aa4c\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-77f4d697b7-hlrz5" Mar 16 17:22:36 crc kubenswrapper[5120]: I0316 17:22:36.202967 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openstack-edpm-tls\" (UniqueName: \"kubernetes.io/configmap/053c7b18-896d-4cf6-9625-d9893747aa4c-openstack-edpm-tls\") pod \"dnsmasq-dnsmasq-77f4d697b7-hlrz5\" (UID: \"053c7b18-896d-4cf6-9625-d9893747aa4c\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-77f4d697b7-hlrz5" Mar 16 17:22:36 crc kubenswrapper[5120]: I0316 17:22:36.203014 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvzxm\" (UniqueName: \"kubernetes.io/projected/bd64ce41-f404-4fb4-80f9-636edf71b390-kube-api-access-tvzxm\") pod \"dnsmasq-dnsmasq-6f5787b9d7-q5fft\" (UID: \"bd64ce41-f404-4fb4-80f9-636edf71b390\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6f5787b9d7-q5fft" Mar 16 17:22:36 crc kubenswrapper[5120]: I0316 17:22:36.203104 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bd64ce41-f404-4fb4-80f9-636edf71b390-config\") pod \"dnsmasq-dnsmasq-6f5787b9d7-q5fft\" (UID: \"bd64ce41-f404-4fb4-80f9-636edf71b390\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6f5787b9d7-q5fft" Mar 16 17:22:36 crc kubenswrapper[5120]: I0316 17:22:36.203186 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/bd64ce41-f404-4fb4-80f9-636edf71b390-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-6f5787b9d7-q5fft\" (UID: \"bd64ce41-f404-4fb4-80f9-636edf71b390\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6f5787b9d7-q5fft" Mar 16 17:22:36 crc kubenswrapper[5120]: I0316 17:22:36.203591 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-edpm-tls\" (UniqueName: \"kubernetes.io/configmap/bd64ce41-f404-4fb4-80f9-636edf71b390-openstack-edpm-tls\") pod \"dnsmasq-dnsmasq-6f5787b9d7-q5fft\" (UID: \"bd64ce41-f404-4fb4-80f9-636edf71b390\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6f5787b9d7-q5fft" Mar 16 17:22:36 crc kubenswrapper[5120]: I0316 17:22:36.203738 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/053c7b18-896d-4cf6-9625-d9893747aa4c-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-77f4d697b7-hlrz5\" (UID: \"053c7b18-896d-4cf6-9625-d9893747aa4c\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-77f4d697b7-hlrz5" Mar 16 17:22:36 crc kubenswrapper[5120]: I0316 17:22:36.203810 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/053c7b18-896d-4cf6-9625-d9893747aa4c-config\") pod \"dnsmasq-dnsmasq-77f4d697b7-hlrz5\" (UID: \"053c7b18-896d-4cf6-9625-d9893747aa4c\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-77f4d697b7-hlrz5" Mar 16 17:22:36 crc kubenswrapper[5120]: I0316 17:22:36.203833 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lpd4k\" (UniqueName: \"kubernetes.io/projected/053c7b18-896d-4cf6-9625-d9893747aa4c-kube-api-access-lpd4k\") pod \"dnsmasq-dnsmasq-77f4d697b7-hlrz5\" (UID: \"053c7b18-896d-4cf6-9625-d9893747aa4c\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-77f4d697b7-hlrz5" Mar 16 17:22:36 crc kubenswrapper[5120]: I0316 17:22:36.203992 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openstack-edpm-tls\" (UniqueName: \"kubernetes.io/configmap/053c7b18-896d-4cf6-9625-d9893747aa4c-openstack-edpm-tls\") pod \"dnsmasq-dnsmasq-77f4d697b7-hlrz5\" (UID: \"053c7b18-896d-4cf6-9625-d9893747aa4c\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-77f4d697b7-hlrz5" Mar 16 17:22:36 crc kubenswrapper[5120]: I0316 17:22:36.204335 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/053c7b18-896d-4cf6-9625-d9893747aa4c-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-77f4d697b7-hlrz5\" (UID: \"053c7b18-896d-4cf6-9625-d9893747aa4c\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-77f4d697b7-hlrz5" Mar 16 17:22:36 crc kubenswrapper[5120]: I0316 17:22:36.218109 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-6f5787b9d7-q5fft"] Mar 16 17:22:36 crc kubenswrapper[5120]: I0316 17:22:36.231753 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lpd4k\" (UniqueName: \"kubernetes.io/projected/053c7b18-896d-4cf6-9625-d9893747aa4c-kube-api-access-lpd4k\") pod \"dnsmasq-dnsmasq-77f4d697b7-hlrz5\" (UID: \"053c7b18-896d-4cf6-9625-d9893747aa4c\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-77f4d697b7-hlrz5" Mar 16 17:22:36 crc kubenswrapper[5120]: I0316 17:22:36.306018 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bd64ce41-f404-4fb4-80f9-636edf71b390-config\") pod \"dnsmasq-dnsmasq-6f5787b9d7-q5fft\" (UID: \"bd64ce41-f404-4fb4-80f9-636edf71b390\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6f5787b9d7-q5fft" Mar 16 17:22:36 crc kubenswrapper[5120]: I0316 17:22:36.306116 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/bd64ce41-f404-4fb4-80f9-636edf71b390-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-6f5787b9d7-q5fft\" (UID: \"bd64ce41-f404-4fb4-80f9-636edf71b390\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6f5787b9d7-q5fft" Mar 16 17:22:36 crc kubenswrapper[5120]: I0316 17:22:36.306997 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/bd64ce41-f404-4fb4-80f9-636edf71b390-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-6f5787b9d7-q5fft\" (UID: \"bd64ce41-f404-4fb4-80f9-636edf71b390\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6f5787b9d7-q5fft" Mar 16 17:22:36 crc kubenswrapper[5120]: I0316 17:22:36.307692 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bd64ce41-f404-4fb4-80f9-636edf71b390-config\") pod \"dnsmasq-dnsmasq-6f5787b9d7-q5fft\" (UID: \"bd64ce41-f404-4fb4-80f9-636edf71b390\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6f5787b9d7-q5fft" Mar 16 17:22:36 crc kubenswrapper[5120]: I0316 17:22:36.307889 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openstack-edpm-tls\" (UniqueName: \"kubernetes.io/configmap/bd64ce41-f404-4fb4-80f9-636edf71b390-openstack-edpm-tls\") pod \"dnsmasq-dnsmasq-6f5787b9d7-q5fft\" (UID: \"bd64ce41-f404-4fb4-80f9-636edf71b390\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6f5787b9d7-q5fft" Mar 16 17:22:36 crc kubenswrapper[5120]: I0316 17:22:36.308068 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tvzxm\" (UniqueName: \"kubernetes.io/projected/bd64ce41-f404-4fb4-80f9-636edf71b390-kube-api-access-tvzxm\") pod \"dnsmasq-dnsmasq-6f5787b9d7-q5fft\" (UID: \"bd64ce41-f404-4fb4-80f9-636edf71b390\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6f5787b9d7-q5fft" Mar 16 17:22:36 crc kubenswrapper[5120]: I0316 17:22:36.308989 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openstack-edpm-tls\" (UniqueName: \"kubernetes.io/configmap/bd64ce41-f404-4fb4-80f9-636edf71b390-openstack-edpm-tls\") pod \"dnsmasq-dnsmasq-6f5787b9d7-q5fft\" (UID: \"bd64ce41-f404-4fb4-80f9-636edf71b390\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6f5787b9d7-q5fft" Mar 16 17:22:36 crc kubenswrapper[5120]: I0316 17:22:36.328248 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvzxm\" (UniqueName: \"kubernetes.io/projected/bd64ce41-f404-4fb4-80f9-636edf71b390-kube-api-access-tvzxm\") pod \"dnsmasq-dnsmasq-6f5787b9d7-q5fft\" (UID: \"bd64ce41-f404-4fb4-80f9-636edf71b390\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6f5787b9d7-q5fft" Mar 16 17:22:36 crc kubenswrapper[5120]: I0316 17:22:36.512440 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6f5787b9d7-q5fft" Mar 16 17:22:36 crc kubenswrapper[5120]: I0316 17:22:36.612977 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-77f4d697b7-hlrz5" Mar 16 17:22:36 crc kubenswrapper[5120]: I0316 17:22:36.628668 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-77f4d697b7-hlrz5" Mar 16 17:22:36 crc kubenswrapper[5120]: I0316 17:22:36.715907 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lpd4k\" (UniqueName: \"kubernetes.io/projected/053c7b18-896d-4cf6-9625-d9893747aa4c-kube-api-access-lpd4k\") pod \"053c7b18-896d-4cf6-9625-d9893747aa4c\" (UID: \"053c7b18-896d-4cf6-9625-d9893747aa4c\") " Mar 16 17:22:36 crc kubenswrapper[5120]: I0316 17:22:36.716470 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/053c7b18-896d-4cf6-9625-d9893747aa4c-config\") pod \"053c7b18-896d-4cf6-9625-d9893747aa4c\" (UID: \"053c7b18-896d-4cf6-9625-d9893747aa4c\") " Mar 16 17:22:36 crc kubenswrapper[5120]: I0316 17:22:36.716556 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"openstack-edpm-tls\" (UniqueName: \"kubernetes.io/configmap/053c7b18-896d-4cf6-9625-d9893747aa4c-openstack-edpm-tls\") pod \"053c7b18-896d-4cf6-9625-d9893747aa4c\" (UID: \"053c7b18-896d-4cf6-9625-d9893747aa4c\") " Mar 16 17:22:36 crc kubenswrapper[5120]: I0316 17:22:36.716983 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/053c7b18-896d-4cf6-9625-d9893747aa4c-config" (OuterVolumeSpecName: "config") pod "053c7b18-896d-4cf6-9625-d9893747aa4c" (UID: "053c7b18-896d-4cf6-9625-d9893747aa4c"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:22:36 crc kubenswrapper[5120]: I0316 17:22:36.717189 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/053c7b18-896d-4cf6-9625-d9893747aa4c-openstack-edpm-tls" (OuterVolumeSpecName: "openstack-edpm-tls") pod "053c7b18-896d-4cf6-9625-d9893747aa4c" (UID: "053c7b18-896d-4cf6-9625-d9893747aa4c"). InnerVolumeSpecName "openstack-edpm-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:22:36 crc kubenswrapper[5120]: I0316 17:22:36.717584 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/053c7b18-896d-4cf6-9625-d9893747aa4c-dnsmasq-svc\") pod \"053c7b18-896d-4cf6-9625-d9893747aa4c\" (UID: \"053c7b18-896d-4cf6-9625-d9893747aa4c\") " Mar 16 17:22:36 crc kubenswrapper[5120]: I0316 17:22:36.718107 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/053c7b18-896d-4cf6-9625-d9893747aa4c-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "053c7b18-896d-4cf6-9625-d9893747aa4c" (UID: "053c7b18-896d-4cf6-9625-d9893747aa4c"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:22:36 crc kubenswrapper[5120]: I0316 17:22:36.720474 5120 reconciler_common.go:299] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/053c7b18-896d-4cf6-9625-d9893747aa4c-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Mar 16 17:22:36 crc kubenswrapper[5120]: I0316 17:22:36.720495 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/053c7b18-896d-4cf6-9625-d9893747aa4c-config\") on node \"crc\" DevicePath \"\"" Mar 16 17:22:36 crc kubenswrapper[5120]: I0316 17:22:36.720506 5120 reconciler_common.go:299] "Volume detached for volume \"openstack-edpm-tls\" (UniqueName: \"kubernetes.io/configmap/053c7b18-896d-4cf6-9625-d9893747aa4c-openstack-edpm-tls\") on node \"crc\" DevicePath \"\"" Mar 16 17:22:36 crc kubenswrapper[5120]: I0316 17:22:36.722793 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/053c7b18-896d-4cf6-9625-d9893747aa4c-kube-api-access-lpd4k" (OuterVolumeSpecName: "kube-api-access-lpd4k") pod "053c7b18-896d-4cf6-9625-d9893747aa4c" (UID: "053c7b18-896d-4cf6-9625-d9893747aa4c"). InnerVolumeSpecName "kube-api-access-lpd4k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:22:36 crc kubenswrapper[5120]: I0316 17:22:36.822991 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lpd4k\" (UniqueName: \"kubernetes.io/projected/053c7b18-896d-4cf6-9625-d9893747aa4c-kube-api-access-lpd4k\") on node \"crc\" DevicePath \"\"" Mar 16 17:22:36 crc kubenswrapper[5120]: I0316 17:22:36.920565 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-6f5787b9d7-q5fft"] Mar 16 17:22:37 crc kubenswrapper[5120]: I0316 17:22:37.624999 5120 generic.go:358] "Generic (PLEG): container finished" podID="bd64ce41-f404-4fb4-80f9-636edf71b390" containerID="f33f49bc2125eb15aba7c235914ca9f7b6fbfb3d376c279e2c940a1fae747b58" exitCode=0 Mar 16 17:22:37 crc kubenswrapper[5120]: I0316 17:22:37.625331 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-77f4d697b7-hlrz5" Mar 16 17:22:37 crc kubenswrapper[5120]: I0316 17:22:37.625087 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6f5787b9d7-q5fft" event={"ID":"bd64ce41-f404-4fb4-80f9-636edf71b390","Type":"ContainerDied","Data":"f33f49bc2125eb15aba7c235914ca9f7b6fbfb3d376c279e2c940a1fae747b58"} Mar 16 17:22:37 crc kubenswrapper[5120]: I0316 17:22:37.625919 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6f5787b9d7-q5fft" event={"ID":"bd64ce41-f404-4fb4-80f9-636edf71b390","Type":"ContainerStarted","Data":"5768d6e875ebe64884b124d30c62661b96d1952cb972dddad1e4ced322e7d5ed"} Mar 16 17:22:37 crc kubenswrapper[5120]: I0316 17:22:37.800946 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-77f4d697b7-hlrz5"] Mar 16 17:22:37 crc kubenswrapper[5120]: I0316 17:22:37.810690 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-77f4d697b7-hlrz5"] Mar 16 17:22:38 crc kubenswrapper[5120]: I0316 17:22:38.636937 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6f5787b9d7-q5fft" event={"ID":"bd64ce41-f404-4fb4-80f9-636edf71b390","Type":"ContainerStarted","Data":"701921bba1fcfd2de000a2802ae426b0a7ac79b4ad09ae63c9edf1a63eb3172b"} Mar 16 17:22:38 crc kubenswrapper[5120]: I0316 17:22:38.637407 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6f5787b9d7-q5fft" Mar 16 17:22:38 crc kubenswrapper[5120]: I0316 17:22:38.661078 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6f5787b9d7-q5fft" podStartSLOduration=2.6610530199999998 podStartE2EDuration="2.66105302s" podCreationTimestamp="2026-03-16 17:22:36 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:22:38.653296427 +0000 UTC m=+6660.807228074" watchObservedRunningTime="2026-03-16 17:22:38.66105302 +0000 UTC m=+6660.814984677" Mar 16 17:22:38 crc kubenswrapper[5120]: I0316 17:22:38.673873 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="053c7b18-896d-4cf6-9625-d9893747aa4c" path="/var/lib/kubelet/pods/053c7b18-896d-4cf6-9625-d9893747aa4c/volumes" Mar 16 17:22:44 crc kubenswrapper[5120]: I0316 17:22:44.651037 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6f5787b9d7-q5fft" Mar 16 17:22:44 crc kubenswrapper[5120]: I0316 17:22:44.710590 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-sjkkk"] Mar 16 17:22:44 crc kubenswrapper[5120]: I0316 17:22:44.710917 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-sjkkk" podUID="c3656132-3010-45c1-a0df-f1394d08c0e5" containerName="dnsmasq-dns" containerID="cri-o://a7e9b546caaf7d4a8fc2befbce2191d822a948be0ab2d7fead7bb439111d47bd" gracePeriod=10 Mar 16 17:22:44 crc kubenswrapper[5120]: I0316 17:22:44.859524 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-694766f957-tr8z4"] Mar 16 17:22:44 crc kubenswrapper[5120]: I0316 17:22:44.867127 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-694766f957-tr8z4" Mar 16 17:22:44 crc kubenswrapper[5120]: I0316 17:22:44.885229 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-694766f957-tr8z4"] Mar 16 17:22:44 crc kubenswrapper[5120]: I0316 17:22:44.991478 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7kzg\" (UniqueName: \"kubernetes.io/projected/6a8f5d87-cc5b-4621-a464-942357c5296b-kube-api-access-p7kzg\") pod \"dnsmasq-dnsmasq-694766f957-tr8z4\" (UID: \"6a8f5d87-cc5b-4621-a464-942357c5296b\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-694766f957-tr8z4" Mar 16 17:22:44 crc kubenswrapper[5120]: I0316 17:22:44.991605 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-edpm-tls\" (UniqueName: \"kubernetes.io/configmap/6a8f5d87-cc5b-4621-a464-942357c5296b-openstack-edpm-tls\") pod \"dnsmasq-dnsmasq-694766f957-tr8z4\" (UID: \"6a8f5d87-cc5b-4621-a464-942357c5296b\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-694766f957-tr8z4" Mar 16 17:22:44 crc kubenswrapper[5120]: I0316 17:22:44.991721 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/6a8f5d87-cc5b-4621-a464-942357c5296b-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-694766f957-tr8z4\" (UID: \"6a8f5d87-cc5b-4621-a464-942357c5296b\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-694766f957-tr8z4" Mar 16 17:22:44 crc kubenswrapper[5120]: I0316 17:22:44.991841 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6a8f5d87-cc5b-4621-a464-942357c5296b-config\") pod \"dnsmasq-dnsmasq-694766f957-tr8z4\" (UID: \"6a8f5d87-cc5b-4621-a464-942357c5296b\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-694766f957-tr8z4" Mar 16 17:22:45 crc kubenswrapper[5120]: I0316 17:22:45.094117 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openstack-edpm-tls\" (UniqueName: \"kubernetes.io/configmap/6a8f5d87-cc5b-4621-a464-942357c5296b-openstack-edpm-tls\") pod \"dnsmasq-dnsmasq-694766f957-tr8z4\" (UID: \"6a8f5d87-cc5b-4621-a464-942357c5296b\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-694766f957-tr8z4" Mar 16 17:22:45 crc kubenswrapper[5120]: I0316 17:22:45.094268 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/6a8f5d87-cc5b-4621-a464-942357c5296b-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-694766f957-tr8z4\" (UID: \"6a8f5d87-cc5b-4621-a464-942357c5296b\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-694766f957-tr8z4" Mar 16 17:22:45 crc kubenswrapper[5120]: I0316 17:22:45.094361 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6a8f5d87-cc5b-4621-a464-942357c5296b-config\") pod \"dnsmasq-dnsmasq-694766f957-tr8z4\" (UID: \"6a8f5d87-cc5b-4621-a464-942357c5296b\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-694766f957-tr8z4" Mar 16 17:22:45 crc kubenswrapper[5120]: I0316 17:22:45.094479 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p7kzg\" (UniqueName: \"kubernetes.io/projected/6a8f5d87-cc5b-4621-a464-942357c5296b-kube-api-access-p7kzg\") pod \"dnsmasq-dnsmasq-694766f957-tr8z4\" (UID: \"6a8f5d87-cc5b-4621-a464-942357c5296b\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-694766f957-tr8z4" Mar 16 17:22:45 crc kubenswrapper[5120]: I0316 17:22:45.095559 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/6a8f5d87-cc5b-4621-a464-942357c5296b-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-694766f957-tr8z4\" (UID: \"6a8f5d87-cc5b-4621-a464-942357c5296b\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-694766f957-tr8z4" Mar 16 17:22:45 crc kubenswrapper[5120]: I0316 17:22:45.095568 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6a8f5d87-cc5b-4621-a464-942357c5296b-config\") pod \"dnsmasq-dnsmasq-694766f957-tr8z4\" (UID: \"6a8f5d87-cc5b-4621-a464-942357c5296b\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-694766f957-tr8z4" Mar 16 17:22:45 crc kubenswrapper[5120]: I0316 17:22:45.095959 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openstack-edpm-tls\" (UniqueName: \"kubernetes.io/configmap/6a8f5d87-cc5b-4621-a464-942357c5296b-openstack-edpm-tls\") pod \"dnsmasq-dnsmasq-694766f957-tr8z4\" (UID: \"6a8f5d87-cc5b-4621-a464-942357c5296b\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-694766f957-tr8z4" Mar 16 17:22:45 crc kubenswrapper[5120]: I0316 17:22:45.114659 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7kzg\" (UniqueName: \"kubernetes.io/projected/6a8f5d87-cc5b-4621-a464-942357c5296b-kube-api-access-p7kzg\") pod \"dnsmasq-dnsmasq-694766f957-tr8z4\" (UID: \"6a8f5d87-cc5b-4621-a464-942357c5296b\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-694766f957-tr8z4" Mar 16 17:22:45 crc kubenswrapper[5120]: I0316 17:22:45.168864 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-sjkkk" Mar 16 17:22:45 crc kubenswrapper[5120]: I0316 17:22:45.188787 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-694766f957-tr8z4" Mar 16 17:22:45 crc kubenswrapper[5120]: I0316 17:22:45.197112 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jxp7g\" (UniqueName: \"kubernetes.io/projected/c3656132-3010-45c1-a0df-f1394d08c0e5-kube-api-access-jxp7g\") pod \"c3656132-3010-45c1-a0df-f1394d08c0e5\" (UID: \"c3656132-3010-45c1-a0df-f1394d08c0e5\") " Mar 16 17:22:45 crc kubenswrapper[5120]: I0316 17:22:45.205570 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3656132-3010-45c1-a0df-f1394d08c0e5-kube-api-access-jxp7g" (OuterVolumeSpecName: "kube-api-access-jxp7g") pod "c3656132-3010-45c1-a0df-f1394d08c0e5" (UID: "c3656132-3010-45c1-a0df-f1394d08c0e5"). InnerVolumeSpecName "kube-api-access-jxp7g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:22:45 crc kubenswrapper[5120]: I0316 17:22:45.299754 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/c3656132-3010-45c1-a0df-f1394d08c0e5-dnsmasq-svc\") pod \"c3656132-3010-45c1-a0df-f1394d08c0e5\" (UID: \"c3656132-3010-45c1-a0df-f1394d08c0e5\") " Mar 16 17:22:45 crc kubenswrapper[5120]: I0316 17:22:45.299856 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c3656132-3010-45c1-a0df-f1394d08c0e5-config\") pod \"c3656132-3010-45c1-a0df-f1394d08c0e5\" (UID: \"c3656132-3010-45c1-a0df-f1394d08c0e5\") " Mar 16 17:22:45 crc kubenswrapper[5120]: I0316 17:22:45.300573 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jxp7g\" (UniqueName: \"kubernetes.io/projected/c3656132-3010-45c1-a0df-f1394d08c0e5-kube-api-access-jxp7g\") on node \"crc\" DevicePath \"\"" Mar 16 17:22:45 crc kubenswrapper[5120]: I0316 17:22:45.342881 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c3656132-3010-45c1-a0df-f1394d08c0e5-config" (OuterVolumeSpecName: "config") pod "c3656132-3010-45c1-a0df-f1394d08c0e5" (UID: "c3656132-3010-45c1-a0df-f1394d08c0e5"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:22:45 crc kubenswrapper[5120]: I0316 17:22:45.351570 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c3656132-3010-45c1-a0df-f1394d08c0e5-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "c3656132-3010-45c1-a0df-f1394d08c0e5" (UID: "c3656132-3010-45c1-a0df-f1394d08c0e5"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:22:45 crc kubenswrapper[5120]: I0316 17:22:45.403039 5120 reconciler_common.go:299] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/c3656132-3010-45c1-a0df-f1394d08c0e5-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Mar 16 17:22:45 crc kubenswrapper[5120]: I0316 17:22:45.403305 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c3656132-3010-45c1-a0df-f1394d08c0e5-config\") on node \"crc\" DevicePath \"\"" Mar 16 17:22:45 crc kubenswrapper[5120]: I0316 17:22:45.609099 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-694766f957-tr8z4"] Mar 16 17:22:45 crc kubenswrapper[5120]: I0316 17:22:45.711146 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-694766f957-tr8z4" event={"ID":"6a8f5d87-cc5b-4621-a464-942357c5296b","Type":"ContainerStarted","Data":"d11294c1100573f9fafc3e3e56cd57d8ceb85268d934279001449bfb5cc6bfc8"} Mar 16 17:22:45 crc kubenswrapper[5120]: I0316 17:22:45.714136 5120 generic.go:358] "Generic (PLEG): container finished" podID="c3656132-3010-45c1-a0df-f1394d08c0e5" containerID="a7e9b546caaf7d4a8fc2befbce2191d822a948be0ab2d7fead7bb439111d47bd" exitCode=0 Mar 16 17:22:45 crc kubenswrapper[5120]: I0316 17:22:45.714203 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-sjkkk" Mar 16 17:22:45 crc kubenswrapper[5120]: I0316 17:22:45.714280 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-sjkkk" event={"ID":"c3656132-3010-45c1-a0df-f1394d08c0e5","Type":"ContainerDied","Data":"a7e9b546caaf7d4a8fc2befbce2191d822a948be0ab2d7fead7bb439111d47bd"} Mar 16 17:22:45 crc kubenswrapper[5120]: I0316 17:22:45.714313 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-sjkkk" event={"ID":"c3656132-3010-45c1-a0df-f1394d08c0e5","Type":"ContainerDied","Data":"dc5e09fdaafd46c66a11d2510fd44175f0194472c130fd4ac439b3530cffda0f"} Mar 16 17:22:45 crc kubenswrapper[5120]: I0316 17:22:45.714334 5120 scope.go:117] "RemoveContainer" containerID="a7e9b546caaf7d4a8fc2befbce2191d822a948be0ab2d7fead7bb439111d47bd" Mar 16 17:22:45 crc kubenswrapper[5120]: I0316 17:22:45.734376 5120 scope.go:117] "RemoveContainer" containerID="159835db48d97ce80479ef27ef87b3740c51daef6ec7f1663e3a2e87bca46fd7" Mar 16 17:22:45 crc kubenswrapper[5120]: I0316 17:22:45.746425 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-sjkkk"] Mar 16 17:22:45 crc kubenswrapper[5120]: I0316 17:22:45.753671 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-sjkkk"] Mar 16 17:22:45 crc kubenswrapper[5120]: I0316 17:22:45.768110 5120 scope.go:117] "RemoveContainer" containerID="a7e9b546caaf7d4a8fc2befbce2191d822a948be0ab2d7fead7bb439111d47bd" Mar 16 17:22:45 crc kubenswrapper[5120]: E0316 17:22:45.769339 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a7e9b546caaf7d4a8fc2befbce2191d822a948be0ab2d7fead7bb439111d47bd\": container with ID starting with a7e9b546caaf7d4a8fc2befbce2191d822a948be0ab2d7fead7bb439111d47bd not found: ID does not exist" containerID="a7e9b546caaf7d4a8fc2befbce2191d822a948be0ab2d7fead7bb439111d47bd" Mar 16 17:22:45 crc kubenswrapper[5120]: I0316 17:22:45.769373 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7e9b546caaf7d4a8fc2befbce2191d822a948be0ab2d7fead7bb439111d47bd"} err="failed to get container status \"a7e9b546caaf7d4a8fc2befbce2191d822a948be0ab2d7fead7bb439111d47bd\": rpc error: code = NotFound desc = could not find container \"a7e9b546caaf7d4a8fc2befbce2191d822a948be0ab2d7fead7bb439111d47bd\": container with ID starting with a7e9b546caaf7d4a8fc2befbce2191d822a948be0ab2d7fead7bb439111d47bd not found: ID does not exist" Mar 16 17:22:45 crc kubenswrapper[5120]: I0316 17:22:45.769454 5120 scope.go:117] "RemoveContainer" containerID="159835db48d97ce80479ef27ef87b3740c51daef6ec7f1663e3a2e87bca46fd7" Mar 16 17:22:45 crc kubenswrapper[5120]: E0316 17:22:45.770022 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"159835db48d97ce80479ef27ef87b3740c51daef6ec7f1663e3a2e87bca46fd7\": container with ID starting with 159835db48d97ce80479ef27ef87b3740c51daef6ec7f1663e3a2e87bca46fd7 not found: ID does not exist" containerID="159835db48d97ce80479ef27ef87b3740c51daef6ec7f1663e3a2e87bca46fd7" Mar 16 17:22:45 crc kubenswrapper[5120]: I0316 17:22:45.770081 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"159835db48d97ce80479ef27ef87b3740c51daef6ec7f1663e3a2e87bca46fd7"} err="failed to get container status \"159835db48d97ce80479ef27ef87b3740c51daef6ec7f1663e3a2e87bca46fd7\": rpc error: code = NotFound desc = could not find container \"159835db48d97ce80479ef27ef87b3740c51daef6ec7f1663e3a2e87bca46fd7\": container with ID starting with 159835db48d97ce80479ef27ef87b3740c51daef6ec7f1663e3a2e87bca46fd7 not found: ID does not exist" Mar 16 17:22:46 crc kubenswrapper[5120]: I0316 17:22:46.673915 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c3656132-3010-45c1-a0df-f1394d08c0e5" path="/var/lib/kubelet/pods/c3656132-3010-45c1-a0df-f1394d08c0e5/volumes" Mar 16 17:22:46 crc kubenswrapper[5120]: I0316 17:22:46.725866 5120 generic.go:358] "Generic (PLEG): container finished" podID="6a8f5d87-cc5b-4621-a464-942357c5296b" containerID="78fd8eb2c2dfed97ed243fbc87a5c9b352c66f133f6d470846e6b211b6ab2f1c" exitCode=0 Mar 16 17:22:46 crc kubenswrapper[5120]: I0316 17:22:46.726012 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-694766f957-tr8z4" event={"ID":"6a8f5d87-cc5b-4621-a464-942357c5296b","Type":"ContainerDied","Data":"78fd8eb2c2dfed97ed243fbc87a5c9b352c66f133f6d470846e6b211b6ab2f1c"} Mar 16 17:22:47 crc kubenswrapper[5120]: I0316 17:22:47.738154 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-694766f957-tr8z4" event={"ID":"6a8f5d87-cc5b-4621-a464-942357c5296b","Type":"ContainerStarted","Data":"48e64a37e5bcdea8cf9be8ff7028bdf9c274e074a638690c80b39aa1f87c6557"} Mar 16 17:22:47 crc kubenswrapper[5120]: I0316 17:22:47.738475 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-694766f957-tr8z4" Mar 16 17:22:47 crc kubenswrapper[5120]: I0316 17:22:47.755732 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-694766f957-tr8z4" podStartSLOduration=3.755714702 podStartE2EDuration="3.755714702s" podCreationTimestamp="2026-03-16 17:22:44 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:22:47.755521087 +0000 UTC m=+6669.909452744" watchObservedRunningTime="2026-03-16 17:22:47.755714702 +0000 UTC m=+6669.909646359" Mar 16 17:22:53 crc kubenswrapper[5120]: I0316 17:22:53.747939 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-694766f957-tr8z4" Mar 16 17:22:53 crc kubenswrapper[5120]: I0316 17:22:53.826237 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-6f5787b9d7-q5fft"] Mar 16 17:22:53 crc kubenswrapper[5120]: I0316 17:22:53.828168 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6f5787b9d7-q5fft" podUID="bd64ce41-f404-4fb4-80f9-636edf71b390" containerName="dnsmasq-dns" containerID="cri-o://701921bba1fcfd2de000a2802ae426b0a7ac79b4ad09ae63c9edf1a63eb3172b" gracePeriod=10 Mar 16 17:22:54 crc kubenswrapper[5120]: I0316 17:22:54.209802 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6f5787b9d7-q5fft" Mar 16 17:22:54 crc kubenswrapper[5120]: I0316 17:22:54.305666 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tvzxm\" (UniqueName: \"kubernetes.io/projected/bd64ce41-f404-4fb4-80f9-636edf71b390-kube-api-access-tvzxm\") pod \"bd64ce41-f404-4fb4-80f9-636edf71b390\" (UID: \"bd64ce41-f404-4fb4-80f9-636edf71b390\") " Mar 16 17:22:54 crc kubenswrapper[5120]: I0316 17:22:54.305866 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"openstack-edpm-tls\" (UniqueName: \"kubernetes.io/configmap/bd64ce41-f404-4fb4-80f9-636edf71b390-openstack-edpm-tls\") pod \"bd64ce41-f404-4fb4-80f9-636edf71b390\" (UID: \"bd64ce41-f404-4fb4-80f9-636edf71b390\") " Mar 16 17:22:54 crc kubenswrapper[5120]: I0316 17:22:54.306044 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bd64ce41-f404-4fb4-80f9-636edf71b390-config\") pod \"bd64ce41-f404-4fb4-80f9-636edf71b390\" (UID: \"bd64ce41-f404-4fb4-80f9-636edf71b390\") " Mar 16 17:22:54 crc kubenswrapper[5120]: I0316 17:22:54.306113 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/bd64ce41-f404-4fb4-80f9-636edf71b390-dnsmasq-svc\") pod \"bd64ce41-f404-4fb4-80f9-636edf71b390\" (UID: \"bd64ce41-f404-4fb4-80f9-636edf71b390\") " Mar 16 17:22:54 crc kubenswrapper[5120]: I0316 17:22:54.316213 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd64ce41-f404-4fb4-80f9-636edf71b390-kube-api-access-tvzxm" (OuterVolumeSpecName: "kube-api-access-tvzxm") pod "bd64ce41-f404-4fb4-80f9-636edf71b390" (UID: "bd64ce41-f404-4fb4-80f9-636edf71b390"). InnerVolumeSpecName "kube-api-access-tvzxm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:22:54 crc kubenswrapper[5120]: I0316 17:22:54.343263 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd64ce41-f404-4fb4-80f9-636edf71b390-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "bd64ce41-f404-4fb4-80f9-636edf71b390" (UID: "bd64ce41-f404-4fb4-80f9-636edf71b390"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:22:54 crc kubenswrapper[5120]: I0316 17:22:54.343428 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd64ce41-f404-4fb4-80f9-636edf71b390-openstack-edpm-tls" (OuterVolumeSpecName: "openstack-edpm-tls") pod "bd64ce41-f404-4fb4-80f9-636edf71b390" (UID: "bd64ce41-f404-4fb4-80f9-636edf71b390"). InnerVolumeSpecName "openstack-edpm-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:22:54 crc kubenswrapper[5120]: I0316 17:22:54.343427 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd64ce41-f404-4fb4-80f9-636edf71b390-config" (OuterVolumeSpecName: "config") pod "bd64ce41-f404-4fb4-80f9-636edf71b390" (UID: "bd64ce41-f404-4fb4-80f9-636edf71b390"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:22:54 crc kubenswrapper[5120]: I0316 17:22:54.408709 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bd64ce41-f404-4fb4-80f9-636edf71b390-config\") on node \"crc\" DevicePath \"\"" Mar 16 17:22:54 crc kubenswrapper[5120]: I0316 17:22:54.408747 5120 reconciler_common.go:299] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/bd64ce41-f404-4fb4-80f9-636edf71b390-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Mar 16 17:22:54 crc kubenswrapper[5120]: I0316 17:22:54.408772 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tvzxm\" (UniqueName: \"kubernetes.io/projected/bd64ce41-f404-4fb4-80f9-636edf71b390-kube-api-access-tvzxm\") on node \"crc\" DevicePath \"\"" Mar 16 17:22:54 crc kubenswrapper[5120]: I0316 17:22:54.408784 5120 reconciler_common.go:299] "Volume detached for volume \"openstack-edpm-tls\" (UniqueName: \"kubernetes.io/configmap/bd64ce41-f404-4fb4-80f9-636edf71b390-openstack-edpm-tls\") on node \"crc\" DevicePath \"\"" Mar 16 17:22:54 crc kubenswrapper[5120]: I0316 17:22:54.811257 5120 generic.go:358] "Generic (PLEG): container finished" podID="bd64ce41-f404-4fb4-80f9-636edf71b390" containerID="701921bba1fcfd2de000a2802ae426b0a7ac79b4ad09ae63c9edf1a63eb3172b" exitCode=0 Mar 16 17:22:54 crc kubenswrapper[5120]: I0316 17:22:54.811810 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6f5787b9d7-q5fft" event={"ID":"bd64ce41-f404-4fb4-80f9-636edf71b390","Type":"ContainerDied","Data":"701921bba1fcfd2de000a2802ae426b0a7ac79b4ad09ae63c9edf1a63eb3172b"} Mar 16 17:22:54 crc kubenswrapper[5120]: I0316 17:22:54.811847 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6f5787b9d7-q5fft" event={"ID":"bd64ce41-f404-4fb4-80f9-636edf71b390","Type":"ContainerDied","Data":"5768d6e875ebe64884b124d30c62661b96d1952cb972dddad1e4ced322e7d5ed"} Mar 16 17:22:54 crc kubenswrapper[5120]: I0316 17:22:54.811868 5120 scope.go:117] "RemoveContainer" containerID="701921bba1fcfd2de000a2802ae426b0a7ac79b4ad09ae63c9edf1a63eb3172b" Mar 16 17:22:54 crc kubenswrapper[5120]: I0316 17:22:54.812059 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6f5787b9d7-q5fft" Mar 16 17:22:54 crc kubenswrapper[5120]: I0316 17:22:54.834276 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-6f5787b9d7-q5fft"] Mar 16 17:22:54 crc kubenswrapper[5120]: I0316 17:22:54.840352 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-6f5787b9d7-q5fft"] Mar 16 17:22:54 crc kubenswrapper[5120]: I0316 17:22:54.841135 5120 scope.go:117] "RemoveContainer" containerID="f33f49bc2125eb15aba7c235914ca9f7b6fbfb3d376c279e2c940a1fae747b58" Mar 16 17:22:54 crc kubenswrapper[5120]: I0316 17:22:54.869479 5120 scope.go:117] "RemoveContainer" containerID="701921bba1fcfd2de000a2802ae426b0a7ac79b4ad09ae63c9edf1a63eb3172b" Mar 16 17:22:54 crc kubenswrapper[5120]: E0316 17:22:54.870192 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"701921bba1fcfd2de000a2802ae426b0a7ac79b4ad09ae63c9edf1a63eb3172b\": container with ID starting with 701921bba1fcfd2de000a2802ae426b0a7ac79b4ad09ae63c9edf1a63eb3172b not found: ID does not exist" containerID="701921bba1fcfd2de000a2802ae426b0a7ac79b4ad09ae63c9edf1a63eb3172b" Mar 16 17:22:54 crc kubenswrapper[5120]: I0316 17:22:54.870221 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"701921bba1fcfd2de000a2802ae426b0a7ac79b4ad09ae63c9edf1a63eb3172b"} err="failed to get container status \"701921bba1fcfd2de000a2802ae426b0a7ac79b4ad09ae63c9edf1a63eb3172b\": rpc error: code = NotFound desc = could not find container \"701921bba1fcfd2de000a2802ae426b0a7ac79b4ad09ae63c9edf1a63eb3172b\": container with ID starting with 701921bba1fcfd2de000a2802ae426b0a7ac79b4ad09ae63c9edf1a63eb3172b not found: ID does not exist" Mar 16 17:22:54 crc kubenswrapper[5120]: I0316 17:22:54.870242 5120 scope.go:117] "RemoveContainer" containerID="f33f49bc2125eb15aba7c235914ca9f7b6fbfb3d376c279e2c940a1fae747b58" Mar 16 17:22:54 crc kubenswrapper[5120]: E0316 17:22:54.870680 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f33f49bc2125eb15aba7c235914ca9f7b6fbfb3d376c279e2c940a1fae747b58\": container with ID starting with f33f49bc2125eb15aba7c235914ca9f7b6fbfb3d376c279e2c940a1fae747b58 not found: ID does not exist" containerID="f33f49bc2125eb15aba7c235914ca9f7b6fbfb3d376c279e2c940a1fae747b58" Mar 16 17:22:54 crc kubenswrapper[5120]: I0316 17:22:54.870805 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f33f49bc2125eb15aba7c235914ca9f7b6fbfb3d376c279e2c940a1fae747b58"} err="failed to get container status \"f33f49bc2125eb15aba7c235914ca9f7b6fbfb3d376c279e2c940a1fae747b58\": rpc error: code = NotFound desc = could not find container \"f33f49bc2125eb15aba7c235914ca9f7b6fbfb3d376c279e2c940a1fae747b58\": container with ID starting with f33f49bc2125eb15aba7c235914ca9f7b6fbfb3d376c279e2c940a1fae747b58 not found: ID does not exist" Mar 16 17:22:56 crc kubenswrapper[5120]: I0316 17:22:56.673151 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bd64ce41-f404-4fb4-80f9-636edf71b390" path="/var/lib/kubelet/pods/bd64ce41-f404-4fb4-80f9-636edf71b390/volumes" Mar 16 17:22:58 crc kubenswrapper[5120]: I0316 17:22:58.163536 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/install-certs-ovr-openstack-edpm-tls-openstack-edpm-tls-w5lnq"] Mar 16 17:22:58 crc kubenswrapper[5120]: I0316 17:22:58.165099 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd64ce41-f404-4fb4-80f9-636edf71b390" containerName="dnsmasq-dns" Mar 16 17:22:58 crc kubenswrapper[5120]: I0316 17:22:58.165118 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd64ce41-f404-4fb4-80f9-636edf71b390" containerName="dnsmasq-dns" Mar 16 17:22:58 crc kubenswrapper[5120]: I0316 17:22:58.165139 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3656132-3010-45c1-a0df-f1394d08c0e5" containerName="dnsmasq-dns" Mar 16 17:22:58 crc kubenswrapper[5120]: I0316 17:22:58.165144 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3656132-3010-45c1-a0df-f1394d08c0e5" containerName="dnsmasq-dns" Mar 16 17:22:58 crc kubenswrapper[5120]: I0316 17:22:58.165173 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd64ce41-f404-4fb4-80f9-636edf71b390" containerName="init" Mar 16 17:22:58 crc kubenswrapper[5120]: I0316 17:22:58.165179 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd64ce41-f404-4fb4-80f9-636edf71b390" containerName="init" Mar 16 17:22:58 crc kubenswrapper[5120]: I0316 17:22:58.165192 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3656132-3010-45c1-a0df-f1394d08c0e5" containerName="init" Mar 16 17:22:58 crc kubenswrapper[5120]: I0316 17:22:58.165197 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3656132-3010-45c1-a0df-f1394d08c0e5" containerName="init" Mar 16 17:22:58 crc kubenswrapper[5120]: I0316 17:22:58.165347 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="bd64ce41-f404-4fb4-80f9-636edf71b390" containerName="dnsmasq-dns" Mar 16 17:22:58 crc kubenswrapper[5120]: I0316 17:22:58.165363 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c3656132-3010-45c1-a0df-f1394d08c0e5" containerName="dnsmasq-dns" Mar 16 17:22:58 crc kubenswrapper[5120]: I0316 17:22:58.172502 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/install-certs-ovr-openstack-edpm-tls-openstack-edpm-tls-w5lnq" Mar 16 17:22:58 crc kubenswrapper[5120]: I0316 17:22:58.175604 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"combined-ca-bundle\"" Mar 16 17:22:58 crc kubenswrapper[5120]: I0316 17:22:58.175604 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"openstack-edpm-tls-generic-service1-default-certs-0\"" Mar 16 17:22:58 crc kubenswrapper[5120]: I0316 17:22:58.176662 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"openstack-edpm-tls-generic-service1-default-certs-2\"" Mar 16 17:22:58 crc kubenswrapper[5120]: I0316 17:22:58.177024 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-aee-default-env\"" Mar 16 17:22:58 crc kubenswrapper[5120]: I0316 17:22:58.177103 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplanenodeset-openstack-edpm-tls\"" Mar 16 17:22:58 crc kubenswrapper[5120]: I0316 17:22:58.177035 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"openstack-edpm-tls-dockercfg-j6dnf\"" Mar 16 17:22:58 crc kubenswrapper[5120]: I0316 17:22:58.177378 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"openstack-edpm-tls-generic-service1-default-certs-1\"" Mar 16 17:22:58 crc kubenswrapper[5120]: I0316 17:22:58.181949 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/install-certs-ovr-openstack-edpm-tls-openstack-edpm-tls-w5lnq"] Mar 16 17:22:58 crc kubenswrapper[5120]: I0316 17:22:58.182398 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplane-ansible-ssh-private-key-secret\"" Mar 16 17:22:58 crc kubenswrapper[5120]: I0316 17:22:58.301528 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/dc623871-7557-4fec-9e23-992286e28761-inventory\") pod \"install-certs-ovr-openstack-edpm-tls-openstack-edpm-tls-w5lnq\" (UID: \"dc623871-7557-4fec-9e23-992286e28761\") " pod="openstack-kuttl-tests/install-certs-ovr-openstack-edpm-tls-openstack-edpm-tls-w5lnq" Mar 16 17:22:58 crc kubenswrapper[5120]: I0316 17:22:58.301743 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-edpm-tls-generic-service1-default-certs-0\" (UniqueName: \"kubernetes.io/projected/dc623871-7557-4fec-9e23-992286e28761-openstack-edpm-tls-generic-service1-default-certs-0\") pod \"install-certs-ovr-openstack-edpm-tls-openstack-edpm-tls-w5lnq\" (UID: \"dc623871-7557-4fec-9e23-992286e28761\") " pod="openstack-kuttl-tests/install-certs-ovr-openstack-edpm-tls-openstack-edpm-tls-w5lnq" Mar 16 17:22:58 crc kubenswrapper[5120]: I0316 17:22:58.301920 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfjf8\" (UniqueName: \"kubernetes.io/projected/dc623871-7557-4fec-9e23-992286e28761-kube-api-access-rfjf8\") pod \"install-certs-ovr-openstack-edpm-tls-openstack-edpm-tls-w5lnq\" (UID: \"dc623871-7557-4fec-9e23-992286e28761\") " pod="openstack-kuttl-tests/install-certs-ovr-openstack-edpm-tls-openstack-edpm-tls-w5lnq" Mar 16 17:22:58 crc kubenswrapper[5120]: I0316 17:22:58.301975 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key-openstack-edpm-tls\" (UniqueName: \"kubernetes.io/secret/dc623871-7557-4fec-9e23-992286e28761-ssh-key-openstack-edpm-tls\") pod \"install-certs-ovr-openstack-edpm-tls-openstack-edpm-tls-w5lnq\" (UID: \"dc623871-7557-4fec-9e23-992286e28761\") " pod="openstack-kuttl-tests/install-certs-ovr-openstack-edpm-tls-openstack-edpm-tls-w5lnq" Mar 16 17:22:58 crc kubenswrapper[5120]: I0316 17:22:58.302391 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"generic-service1-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dc623871-7557-4fec-9e23-992286e28761-generic-service1-combined-ca-bundle\") pod \"install-certs-ovr-openstack-edpm-tls-openstack-edpm-tls-w5lnq\" (UID: \"dc623871-7557-4fec-9e23-992286e28761\") " pod="openstack-kuttl-tests/install-certs-ovr-openstack-edpm-tls-openstack-edpm-tls-w5lnq" Mar 16 17:22:58 crc kubenswrapper[5120]: I0316 17:22:58.302489 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"install-certs-ovr-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dc623871-7557-4fec-9e23-992286e28761-install-certs-ovr-combined-ca-bundle\") pod \"install-certs-ovr-openstack-edpm-tls-openstack-edpm-tls-w5lnq\" (UID: \"dc623871-7557-4fec-9e23-992286e28761\") " pod="openstack-kuttl-tests/install-certs-ovr-openstack-edpm-tls-openstack-edpm-tls-w5lnq" Mar 16 17:22:58 crc kubenswrapper[5120]: I0316 17:22:58.403730 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openstack-edpm-tls-generic-service1-default-certs-0\" (UniqueName: \"kubernetes.io/projected/dc623871-7557-4fec-9e23-992286e28761-openstack-edpm-tls-generic-service1-default-certs-0\") pod \"install-certs-ovr-openstack-edpm-tls-openstack-edpm-tls-w5lnq\" (UID: \"dc623871-7557-4fec-9e23-992286e28761\") " pod="openstack-kuttl-tests/install-certs-ovr-openstack-edpm-tls-openstack-edpm-tls-w5lnq" Mar 16 17:22:58 crc kubenswrapper[5120]: I0316 17:22:58.404095 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rfjf8\" (UniqueName: \"kubernetes.io/projected/dc623871-7557-4fec-9e23-992286e28761-kube-api-access-rfjf8\") pod \"install-certs-ovr-openstack-edpm-tls-openstack-edpm-tls-w5lnq\" (UID: \"dc623871-7557-4fec-9e23-992286e28761\") " pod="openstack-kuttl-tests/install-certs-ovr-openstack-edpm-tls-openstack-edpm-tls-w5lnq" Mar 16 17:22:58 crc kubenswrapper[5120]: I0316 17:22:58.404203 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ssh-key-openstack-edpm-tls\" (UniqueName: \"kubernetes.io/secret/dc623871-7557-4fec-9e23-992286e28761-ssh-key-openstack-edpm-tls\") pod \"install-certs-ovr-openstack-edpm-tls-openstack-edpm-tls-w5lnq\" (UID: \"dc623871-7557-4fec-9e23-992286e28761\") " pod="openstack-kuttl-tests/install-certs-ovr-openstack-edpm-tls-openstack-edpm-tls-w5lnq" Mar 16 17:22:58 crc kubenswrapper[5120]: I0316 17:22:58.404380 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"generic-service1-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dc623871-7557-4fec-9e23-992286e28761-generic-service1-combined-ca-bundle\") pod \"install-certs-ovr-openstack-edpm-tls-openstack-edpm-tls-w5lnq\" (UID: \"dc623871-7557-4fec-9e23-992286e28761\") " pod="openstack-kuttl-tests/install-certs-ovr-openstack-edpm-tls-openstack-edpm-tls-w5lnq" Mar 16 17:22:58 crc kubenswrapper[5120]: I0316 17:22:58.404480 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"install-certs-ovr-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dc623871-7557-4fec-9e23-992286e28761-install-certs-ovr-combined-ca-bundle\") pod \"install-certs-ovr-openstack-edpm-tls-openstack-edpm-tls-w5lnq\" (UID: \"dc623871-7557-4fec-9e23-992286e28761\") " pod="openstack-kuttl-tests/install-certs-ovr-openstack-edpm-tls-openstack-edpm-tls-w5lnq" Mar 16 17:22:58 crc kubenswrapper[5120]: I0316 17:22:58.404575 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/dc623871-7557-4fec-9e23-992286e28761-inventory\") pod \"install-certs-ovr-openstack-edpm-tls-openstack-edpm-tls-w5lnq\" (UID: \"dc623871-7557-4fec-9e23-992286e28761\") " pod="openstack-kuttl-tests/install-certs-ovr-openstack-edpm-tls-openstack-edpm-tls-w5lnq" Mar 16 17:22:58 crc kubenswrapper[5120]: I0316 17:22:58.411086 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"generic-service1-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dc623871-7557-4fec-9e23-992286e28761-generic-service1-combined-ca-bundle\") pod \"install-certs-ovr-openstack-edpm-tls-openstack-edpm-tls-w5lnq\" (UID: \"dc623871-7557-4fec-9e23-992286e28761\") " pod="openstack-kuttl-tests/install-certs-ovr-openstack-edpm-tls-openstack-edpm-tls-w5lnq" Mar 16 17:22:58 crc kubenswrapper[5120]: I0316 17:22:58.411135 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/dc623871-7557-4fec-9e23-992286e28761-inventory\") pod \"install-certs-ovr-openstack-edpm-tls-openstack-edpm-tls-w5lnq\" (UID: \"dc623871-7557-4fec-9e23-992286e28761\") " pod="openstack-kuttl-tests/install-certs-ovr-openstack-edpm-tls-openstack-edpm-tls-w5lnq" Mar 16 17:22:58 crc kubenswrapper[5120]: I0316 17:22:58.413362 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"install-certs-ovr-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dc623871-7557-4fec-9e23-992286e28761-install-certs-ovr-combined-ca-bundle\") pod \"install-certs-ovr-openstack-edpm-tls-openstack-edpm-tls-w5lnq\" (UID: \"dc623871-7557-4fec-9e23-992286e28761\") " pod="openstack-kuttl-tests/install-certs-ovr-openstack-edpm-tls-openstack-edpm-tls-w5lnq" Mar 16 17:22:58 crc kubenswrapper[5120]: I0316 17:22:58.414242 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ssh-key-openstack-edpm-tls\" (UniqueName: \"kubernetes.io/secret/dc623871-7557-4fec-9e23-992286e28761-ssh-key-openstack-edpm-tls\") pod \"install-certs-ovr-openstack-edpm-tls-openstack-edpm-tls-w5lnq\" (UID: \"dc623871-7557-4fec-9e23-992286e28761\") " pod="openstack-kuttl-tests/install-certs-ovr-openstack-edpm-tls-openstack-edpm-tls-w5lnq" Mar 16 17:22:58 crc kubenswrapper[5120]: I0316 17:22:58.418240 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openstack-edpm-tls-generic-service1-default-certs-0\" (UniqueName: \"kubernetes.io/projected/dc623871-7557-4fec-9e23-992286e28761-openstack-edpm-tls-generic-service1-default-certs-0\") pod \"install-certs-ovr-openstack-edpm-tls-openstack-edpm-tls-w5lnq\" (UID: \"dc623871-7557-4fec-9e23-992286e28761\") " pod="openstack-kuttl-tests/install-certs-ovr-openstack-edpm-tls-openstack-edpm-tls-w5lnq" Mar 16 17:22:58 crc kubenswrapper[5120]: I0316 17:22:58.421694 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfjf8\" (UniqueName: \"kubernetes.io/projected/dc623871-7557-4fec-9e23-992286e28761-kube-api-access-rfjf8\") pod \"install-certs-ovr-openstack-edpm-tls-openstack-edpm-tls-w5lnq\" (UID: \"dc623871-7557-4fec-9e23-992286e28761\") " pod="openstack-kuttl-tests/install-certs-ovr-openstack-edpm-tls-openstack-edpm-tls-w5lnq" Mar 16 17:22:58 crc kubenswrapper[5120]: I0316 17:22:58.505071 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/install-certs-ovr-openstack-edpm-tls-openstack-edpm-tls-w5lnq" Mar 16 17:22:58 crc kubenswrapper[5120]: I0316 17:22:58.946204 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/install-certs-ovr-openstack-edpm-tls-openstack-edpm-tls-w5lnq"] Mar 16 17:22:59 crc kubenswrapper[5120]: I0316 17:22:59.860115 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/install-certs-ovr-openstack-edpm-tls-openstack-edpm-tls-w5lnq" event={"ID":"dc623871-7557-4fec-9e23-992286e28761","Type":"ContainerStarted","Data":"7ec068cbf27c04fbf21d2e6e76e4bd8aa96c095cc502c5e522fb91421eb09b6c"} Mar 16 17:22:59 crc kubenswrapper[5120]: I0316 17:22:59.860471 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/install-certs-ovr-openstack-edpm-tls-openstack-edpm-tls-w5lnq" event={"ID":"dc623871-7557-4fec-9e23-992286e28761","Type":"ContainerStarted","Data":"d53da8705609b57da02ac581e30036797981e7655c89e0d50c02058b1c69e6a3"} Mar 16 17:22:59 crc kubenswrapper[5120]: I0316 17:22:59.878780 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/install-certs-ovr-openstack-edpm-tls-openstack-edpm-tls-w5lnq" podStartSLOduration=1.394975947 podStartE2EDuration="1.878738396s" podCreationTimestamp="2026-03-16 17:22:58 +0000 UTC" firstStartedPulling="2026-03-16 17:22:58.943698285 +0000 UTC m=+6681.097629942" lastFinishedPulling="2026-03-16 17:22:59.427460734 +0000 UTC m=+6681.581392391" observedRunningTime="2026-03-16 17:22:59.876743931 +0000 UTC m=+6682.030675688" watchObservedRunningTime="2026-03-16 17:22:59.878738396 +0000 UTC m=+6682.032670043" Mar 16 17:23:02 crc kubenswrapper[5120]: I0316 17:23:02.890430 5120 generic.go:358] "Generic (PLEG): container finished" podID="dc623871-7557-4fec-9e23-992286e28761" containerID="7ec068cbf27c04fbf21d2e6e76e4bd8aa96c095cc502c5e522fb91421eb09b6c" exitCode=0 Mar 16 17:23:02 crc kubenswrapper[5120]: I0316 17:23:02.890560 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/install-certs-ovr-openstack-edpm-tls-openstack-edpm-tls-w5lnq" event={"ID":"dc623871-7557-4fec-9e23-992286e28761","Type":"ContainerDied","Data":"7ec068cbf27c04fbf21d2e6e76e4bd8aa96c095cc502c5e522fb91421eb09b6c"} Mar 16 17:23:04 crc kubenswrapper[5120]: I0316 17:23:04.234995 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/install-certs-ovr-openstack-edpm-tls-openstack-edpm-tls-w5lnq" Mar 16 17:23:04 crc kubenswrapper[5120]: I0316 17:23:04.336419 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"openstack-edpm-tls-generic-service1-default-certs-0\" (UniqueName: \"kubernetes.io/projected/dc623871-7557-4fec-9e23-992286e28761-openstack-edpm-tls-generic-service1-default-certs-0\") pod \"dc623871-7557-4fec-9e23-992286e28761\" (UID: \"dc623871-7557-4fec-9e23-992286e28761\") " Mar 16 17:23:04 crc kubenswrapper[5120]: I0316 17:23:04.336508 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"generic-service1-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dc623871-7557-4fec-9e23-992286e28761-generic-service1-combined-ca-bundle\") pod \"dc623871-7557-4fec-9e23-992286e28761\" (UID: \"dc623871-7557-4fec-9e23-992286e28761\") " Mar 16 17:23:04 crc kubenswrapper[5120]: I0316 17:23:04.336823 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rfjf8\" (UniqueName: \"kubernetes.io/projected/dc623871-7557-4fec-9e23-992286e28761-kube-api-access-rfjf8\") pod \"dc623871-7557-4fec-9e23-992286e28761\" (UID: \"dc623871-7557-4fec-9e23-992286e28761\") " Mar 16 17:23:04 crc kubenswrapper[5120]: I0316 17:23:04.337057 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ssh-key-openstack-edpm-tls\" (UniqueName: \"kubernetes.io/secret/dc623871-7557-4fec-9e23-992286e28761-ssh-key-openstack-edpm-tls\") pod \"dc623871-7557-4fec-9e23-992286e28761\" (UID: \"dc623871-7557-4fec-9e23-992286e28761\") " Mar 16 17:23:04 crc kubenswrapper[5120]: I0316 17:23:04.337192 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/dc623871-7557-4fec-9e23-992286e28761-inventory\") pod \"dc623871-7557-4fec-9e23-992286e28761\" (UID: \"dc623871-7557-4fec-9e23-992286e28761\") " Mar 16 17:23:04 crc kubenswrapper[5120]: I0316 17:23:04.337295 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"install-certs-ovr-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dc623871-7557-4fec-9e23-992286e28761-install-certs-ovr-combined-ca-bundle\") pod \"dc623871-7557-4fec-9e23-992286e28761\" (UID: \"dc623871-7557-4fec-9e23-992286e28761\") " Mar 16 17:23:04 crc kubenswrapper[5120]: I0316 17:23:04.342871 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc623871-7557-4fec-9e23-992286e28761-install-certs-ovr-combined-ca-bundle" (OuterVolumeSpecName: "install-certs-ovr-combined-ca-bundle") pod "dc623871-7557-4fec-9e23-992286e28761" (UID: "dc623871-7557-4fec-9e23-992286e28761"). InnerVolumeSpecName "install-certs-ovr-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:23:04 crc kubenswrapper[5120]: I0316 17:23:04.343172 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc623871-7557-4fec-9e23-992286e28761-kube-api-access-rfjf8" (OuterVolumeSpecName: "kube-api-access-rfjf8") pod "dc623871-7557-4fec-9e23-992286e28761" (UID: "dc623871-7557-4fec-9e23-992286e28761"). InnerVolumeSpecName "kube-api-access-rfjf8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:23:04 crc kubenswrapper[5120]: I0316 17:23:04.343274 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc623871-7557-4fec-9e23-992286e28761-openstack-edpm-tls-generic-service1-default-certs-0" (OuterVolumeSpecName: "openstack-edpm-tls-generic-service1-default-certs-0") pod "dc623871-7557-4fec-9e23-992286e28761" (UID: "dc623871-7557-4fec-9e23-992286e28761"). InnerVolumeSpecName "openstack-edpm-tls-generic-service1-default-certs-0". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:23:04 crc kubenswrapper[5120]: I0316 17:23:04.343905 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc623871-7557-4fec-9e23-992286e28761-generic-service1-combined-ca-bundle" (OuterVolumeSpecName: "generic-service1-combined-ca-bundle") pod "dc623871-7557-4fec-9e23-992286e28761" (UID: "dc623871-7557-4fec-9e23-992286e28761"). InnerVolumeSpecName "generic-service1-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:23:04 crc kubenswrapper[5120]: I0316 17:23:04.360738 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc623871-7557-4fec-9e23-992286e28761-ssh-key-openstack-edpm-tls" (OuterVolumeSpecName: "ssh-key-openstack-edpm-tls") pod "dc623871-7557-4fec-9e23-992286e28761" (UID: "dc623871-7557-4fec-9e23-992286e28761"). InnerVolumeSpecName "ssh-key-openstack-edpm-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:23:04 crc kubenswrapper[5120]: I0316 17:23:04.361030 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc623871-7557-4fec-9e23-992286e28761-inventory" (OuterVolumeSpecName: "inventory") pod "dc623871-7557-4fec-9e23-992286e28761" (UID: "dc623871-7557-4fec-9e23-992286e28761"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:23:04 crc kubenswrapper[5120]: I0316 17:23:04.439375 5120 reconciler_common.go:299] "Volume detached for volume \"ssh-key-openstack-edpm-tls\" (UniqueName: \"kubernetes.io/secret/dc623871-7557-4fec-9e23-992286e28761-ssh-key-openstack-edpm-tls\") on node \"crc\" DevicePath \"\"" Mar 16 17:23:04 crc kubenswrapper[5120]: I0316 17:23:04.439418 5120 reconciler_common.go:299] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/dc623871-7557-4fec-9e23-992286e28761-inventory\") on node \"crc\" DevicePath \"\"" Mar 16 17:23:04 crc kubenswrapper[5120]: I0316 17:23:04.439429 5120 reconciler_common.go:299] "Volume detached for volume \"install-certs-ovr-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dc623871-7557-4fec-9e23-992286e28761-install-certs-ovr-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:23:04 crc kubenswrapper[5120]: I0316 17:23:04.439442 5120 reconciler_common.go:299] "Volume detached for volume \"openstack-edpm-tls-generic-service1-default-certs-0\" (UniqueName: \"kubernetes.io/projected/dc623871-7557-4fec-9e23-992286e28761-openstack-edpm-tls-generic-service1-default-certs-0\") on node \"crc\" DevicePath \"\"" Mar 16 17:23:04 crc kubenswrapper[5120]: I0316 17:23:04.439452 5120 reconciler_common.go:299] "Volume detached for volume \"generic-service1-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dc623871-7557-4fec-9e23-992286e28761-generic-service1-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:23:04 crc kubenswrapper[5120]: I0316 17:23:04.439464 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rfjf8\" (UniqueName: \"kubernetes.io/projected/dc623871-7557-4fec-9e23-992286e28761-kube-api-access-rfjf8\") on node \"crc\" DevicePath \"\"" Mar 16 17:23:04 crc kubenswrapper[5120]: I0316 17:23:04.934749 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/install-certs-ovr-openstack-edpm-tls-openstack-edpm-tls-w5lnq" Mar 16 17:23:04 crc kubenswrapper[5120]: I0316 17:23:04.934834 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/install-certs-ovr-openstack-edpm-tls-openstack-edpm-tls-w5lnq" event={"ID":"dc623871-7557-4fec-9e23-992286e28761","Type":"ContainerDied","Data":"d53da8705609b57da02ac581e30036797981e7655c89e0d50c02058b1c69e6a3"} Mar 16 17:23:04 crc kubenswrapper[5120]: I0316 17:23:04.934878 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d53da8705609b57da02ac581e30036797981e7655c89e0d50c02058b1c69e6a3" Mar 16 17:23:05 crc kubenswrapper[5120]: I0316 17:23:05.034196 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/generic-service1-openstack-edpm-tls-openstack-edpm-tls-7rxmq"] Mar 16 17:23:05 crc kubenswrapper[5120]: I0316 17:23:05.035710 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc623871-7557-4fec-9e23-992286e28761" containerName="install-certs-ovr-openstack-edpm-tls-openstack-edpm-tls" Mar 16 17:23:05 crc kubenswrapper[5120]: I0316 17:23:05.035741 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc623871-7557-4fec-9e23-992286e28761" containerName="install-certs-ovr-openstack-edpm-tls-openstack-edpm-tls" Mar 16 17:23:05 crc kubenswrapper[5120]: I0316 17:23:05.035929 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="dc623871-7557-4fec-9e23-992286e28761" containerName="install-certs-ovr-openstack-edpm-tls-openstack-edpm-tls" Mar 16 17:23:05 crc kubenswrapper[5120]: I0316 17:23:05.042931 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/generic-service1-openstack-edpm-tls-openstack-edpm-tls-7rxmq" Mar 16 17:23:05 crc kubenswrapper[5120]: I0316 17:23:05.045695 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"combined-ca-bundle\"" Mar 16 17:23:05 crc kubenswrapper[5120]: I0316 17:23:05.046001 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"openstack-edpm-tls-dockercfg-j6dnf\"" Mar 16 17:23:05 crc kubenswrapper[5120]: I0316 17:23:05.046338 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplane-ansible-ssh-private-key-secret\"" Mar 16 17:23:05 crc kubenswrapper[5120]: I0316 17:23:05.046470 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplanenodeset-openstack-edpm-tls\"" Mar 16 17:23:05 crc kubenswrapper[5120]: I0316 17:23:05.050812 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/generic-service1-openstack-edpm-tls-openstack-edpm-tls-7rxmq"] Mar 16 17:23:05 crc kubenswrapper[5120]: I0316 17:23:05.052032 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-aee-default-env\"" Mar 16 17:23:05 crc kubenswrapper[5120]: I0316 17:23:05.157473 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"generic-service1-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fa4d9235-fc18-4574-84ab-f1ad7875f78a-generic-service1-combined-ca-bundle\") pod \"generic-service1-openstack-edpm-tls-openstack-edpm-tls-7rxmq\" (UID: \"fa4d9235-fc18-4574-84ab-f1ad7875f78a\") " pod="openstack-kuttl-tests/generic-service1-openstack-edpm-tls-openstack-edpm-tls-7rxmq" Mar 16 17:23:05 crc kubenswrapper[5120]: I0316 17:23:05.157731 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key-openstack-edpm-tls\" (UniqueName: \"kubernetes.io/secret/fa4d9235-fc18-4574-84ab-f1ad7875f78a-ssh-key-openstack-edpm-tls\") pod \"generic-service1-openstack-edpm-tls-openstack-edpm-tls-7rxmq\" (UID: \"fa4d9235-fc18-4574-84ab-f1ad7875f78a\") " pod="openstack-kuttl-tests/generic-service1-openstack-edpm-tls-openstack-edpm-tls-7rxmq" Mar 16 17:23:05 crc kubenswrapper[5120]: I0316 17:23:05.157877 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/fa4d9235-fc18-4574-84ab-f1ad7875f78a-inventory\") pod \"generic-service1-openstack-edpm-tls-openstack-edpm-tls-7rxmq\" (UID: \"fa4d9235-fc18-4574-84ab-f1ad7875f78a\") " pod="openstack-kuttl-tests/generic-service1-openstack-edpm-tls-openstack-edpm-tls-7rxmq" Mar 16 17:23:05 crc kubenswrapper[5120]: I0316 17:23:05.158158 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6w57f\" (UniqueName: \"kubernetes.io/projected/fa4d9235-fc18-4574-84ab-f1ad7875f78a-kube-api-access-6w57f\") pod \"generic-service1-openstack-edpm-tls-openstack-edpm-tls-7rxmq\" (UID: \"fa4d9235-fc18-4574-84ab-f1ad7875f78a\") " pod="openstack-kuttl-tests/generic-service1-openstack-edpm-tls-openstack-edpm-tls-7rxmq" Mar 16 17:23:05 crc kubenswrapper[5120]: I0316 17:23:05.260319 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ssh-key-openstack-edpm-tls\" (UniqueName: \"kubernetes.io/secret/fa4d9235-fc18-4574-84ab-f1ad7875f78a-ssh-key-openstack-edpm-tls\") pod \"generic-service1-openstack-edpm-tls-openstack-edpm-tls-7rxmq\" (UID: \"fa4d9235-fc18-4574-84ab-f1ad7875f78a\") " pod="openstack-kuttl-tests/generic-service1-openstack-edpm-tls-openstack-edpm-tls-7rxmq" Mar 16 17:23:05 crc kubenswrapper[5120]: I0316 17:23:05.260386 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/fa4d9235-fc18-4574-84ab-f1ad7875f78a-inventory\") pod \"generic-service1-openstack-edpm-tls-openstack-edpm-tls-7rxmq\" (UID: \"fa4d9235-fc18-4574-84ab-f1ad7875f78a\") " pod="openstack-kuttl-tests/generic-service1-openstack-edpm-tls-openstack-edpm-tls-7rxmq" Mar 16 17:23:05 crc kubenswrapper[5120]: I0316 17:23:05.260515 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6w57f\" (UniqueName: \"kubernetes.io/projected/fa4d9235-fc18-4574-84ab-f1ad7875f78a-kube-api-access-6w57f\") pod \"generic-service1-openstack-edpm-tls-openstack-edpm-tls-7rxmq\" (UID: \"fa4d9235-fc18-4574-84ab-f1ad7875f78a\") " pod="openstack-kuttl-tests/generic-service1-openstack-edpm-tls-openstack-edpm-tls-7rxmq" Mar 16 17:23:05 crc kubenswrapper[5120]: I0316 17:23:05.260636 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"generic-service1-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fa4d9235-fc18-4574-84ab-f1ad7875f78a-generic-service1-combined-ca-bundle\") pod \"generic-service1-openstack-edpm-tls-openstack-edpm-tls-7rxmq\" (UID: \"fa4d9235-fc18-4574-84ab-f1ad7875f78a\") " pod="openstack-kuttl-tests/generic-service1-openstack-edpm-tls-openstack-edpm-tls-7rxmq" Mar 16 17:23:05 crc kubenswrapper[5120]: I0316 17:23:05.264492 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ssh-key-openstack-edpm-tls\" (UniqueName: \"kubernetes.io/secret/fa4d9235-fc18-4574-84ab-f1ad7875f78a-ssh-key-openstack-edpm-tls\") pod \"generic-service1-openstack-edpm-tls-openstack-edpm-tls-7rxmq\" (UID: \"fa4d9235-fc18-4574-84ab-f1ad7875f78a\") " pod="openstack-kuttl-tests/generic-service1-openstack-edpm-tls-openstack-edpm-tls-7rxmq" Mar 16 17:23:05 crc kubenswrapper[5120]: I0316 17:23:05.264536 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/fa4d9235-fc18-4574-84ab-f1ad7875f78a-inventory\") pod \"generic-service1-openstack-edpm-tls-openstack-edpm-tls-7rxmq\" (UID: \"fa4d9235-fc18-4574-84ab-f1ad7875f78a\") " pod="openstack-kuttl-tests/generic-service1-openstack-edpm-tls-openstack-edpm-tls-7rxmq" Mar 16 17:23:05 crc kubenswrapper[5120]: I0316 17:23:05.277470 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"generic-service1-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fa4d9235-fc18-4574-84ab-f1ad7875f78a-generic-service1-combined-ca-bundle\") pod \"generic-service1-openstack-edpm-tls-openstack-edpm-tls-7rxmq\" (UID: \"fa4d9235-fc18-4574-84ab-f1ad7875f78a\") " pod="openstack-kuttl-tests/generic-service1-openstack-edpm-tls-openstack-edpm-tls-7rxmq" Mar 16 17:23:05 crc kubenswrapper[5120]: I0316 17:23:05.279496 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6w57f\" (UniqueName: \"kubernetes.io/projected/fa4d9235-fc18-4574-84ab-f1ad7875f78a-kube-api-access-6w57f\") pod \"generic-service1-openstack-edpm-tls-openstack-edpm-tls-7rxmq\" (UID: \"fa4d9235-fc18-4574-84ab-f1ad7875f78a\") " pod="openstack-kuttl-tests/generic-service1-openstack-edpm-tls-openstack-edpm-tls-7rxmq" Mar 16 17:23:05 crc kubenswrapper[5120]: I0316 17:23:05.366626 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/generic-service1-openstack-edpm-tls-openstack-edpm-tls-7rxmq" Mar 16 17:23:05 crc kubenswrapper[5120]: I0316 17:23:05.816543 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/generic-service1-openstack-edpm-tls-openstack-edpm-tls-7rxmq"] Mar 16 17:23:05 crc kubenswrapper[5120]: I0316 17:23:05.945011 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/generic-service1-openstack-edpm-tls-openstack-edpm-tls-7rxmq" event={"ID":"fa4d9235-fc18-4574-84ab-f1ad7875f78a","Type":"ContainerStarted","Data":"7eeea6397015241fe32ff4db1c6f7365f99d4918ffe7976e56f04b981bc7c95c"} Mar 16 17:23:06 crc kubenswrapper[5120]: I0316 17:23:06.954347 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/generic-service1-openstack-edpm-tls-openstack-edpm-tls-7rxmq" event={"ID":"fa4d9235-fc18-4574-84ab-f1ad7875f78a","Type":"ContainerStarted","Data":"c1fbb7e6a91060e85eb5a841afe516c5fad034248b484402c1a9bc0e83d243e6"} Mar 16 17:23:06 crc kubenswrapper[5120]: I0316 17:23:06.972269 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/generic-service1-openstack-edpm-tls-openstack-edpm-tls-7rxmq" podStartSLOduration=1.512641578 podStartE2EDuration="1.972252267s" podCreationTimestamp="2026-03-16 17:23:05 +0000 UTC" firstStartedPulling="2026-03-16 17:23:05.820230628 +0000 UTC m=+6687.974162285" lastFinishedPulling="2026-03-16 17:23:06.279841317 +0000 UTC m=+6688.433772974" observedRunningTime="2026-03-16 17:23:06.970443498 +0000 UTC m=+6689.124375155" watchObservedRunningTime="2026-03-16 17:23:06.972252267 +0000 UTC m=+6689.126183924" Mar 16 17:23:08 crc kubenswrapper[5120]: E0316 17:23:08.064928 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1314611 actualBytes=10240 Mar 16 17:23:09 crc kubenswrapper[5120]: I0316 17:23:09.982611 5120 generic.go:358] "Generic (PLEG): container finished" podID="fa4d9235-fc18-4574-84ab-f1ad7875f78a" containerID="c1fbb7e6a91060e85eb5a841afe516c5fad034248b484402c1a9bc0e83d243e6" exitCode=0 Mar 16 17:23:09 crc kubenswrapper[5120]: I0316 17:23:09.982689 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/generic-service1-openstack-edpm-tls-openstack-edpm-tls-7rxmq" event={"ID":"fa4d9235-fc18-4574-84ab-f1ad7875f78a","Type":"ContainerDied","Data":"c1fbb7e6a91060e85eb5a841afe516c5fad034248b484402c1a9bc0e83d243e6"} Mar 16 17:23:11 crc kubenswrapper[5120]: I0316 17:23:11.302502 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/generic-service1-openstack-edpm-tls-openstack-edpm-tls-7rxmq" Mar 16 17:23:11 crc kubenswrapper[5120]: I0316 17:23:11.394969 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/fa4d9235-fc18-4574-84ab-f1ad7875f78a-inventory\") pod \"fa4d9235-fc18-4574-84ab-f1ad7875f78a\" (UID: \"fa4d9235-fc18-4574-84ab-f1ad7875f78a\") " Mar 16 17:23:11 crc kubenswrapper[5120]: I0316 17:23:11.395104 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6w57f\" (UniqueName: \"kubernetes.io/projected/fa4d9235-fc18-4574-84ab-f1ad7875f78a-kube-api-access-6w57f\") pod \"fa4d9235-fc18-4574-84ab-f1ad7875f78a\" (UID: \"fa4d9235-fc18-4574-84ab-f1ad7875f78a\") " Mar 16 17:23:11 crc kubenswrapper[5120]: I0316 17:23:11.395198 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"generic-service1-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fa4d9235-fc18-4574-84ab-f1ad7875f78a-generic-service1-combined-ca-bundle\") pod \"fa4d9235-fc18-4574-84ab-f1ad7875f78a\" (UID: \"fa4d9235-fc18-4574-84ab-f1ad7875f78a\") " Mar 16 17:23:11 crc kubenswrapper[5120]: I0316 17:23:11.395278 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ssh-key-openstack-edpm-tls\" (UniqueName: \"kubernetes.io/secret/fa4d9235-fc18-4574-84ab-f1ad7875f78a-ssh-key-openstack-edpm-tls\") pod \"fa4d9235-fc18-4574-84ab-f1ad7875f78a\" (UID: \"fa4d9235-fc18-4574-84ab-f1ad7875f78a\") " Mar 16 17:23:11 crc kubenswrapper[5120]: I0316 17:23:11.400430 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa4d9235-fc18-4574-84ab-f1ad7875f78a-generic-service1-combined-ca-bundle" (OuterVolumeSpecName: "generic-service1-combined-ca-bundle") pod "fa4d9235-fc18-4574-84ab-f1ad7875f78a" (UID: "fa4d9235-fc18-4574-84ab-f1ad7875f78a"). InnerVolumeSpecName "generic-service1-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:23:11 crc kubenswrapper[5120]: I0316 17:23:11.400668 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa4d9235-fc18-4574-84ab-f1ad7875f78a-kube-api-access-6w57f" (OuterVolumeSpecName: "kube-api-access-6w57f") pod "fa4d9235-fc18-4574-84ab-f1ad7875f78a" (UID: "fa4d9235-fc18-4574-84ab-f1ad7875f78a"). InnerVolumeSpecName "kube-api-access-6w57f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:23:11 crc kubenswrapper[5120]: I0316 17:23:11.416370 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa4d9235-fc18-4574-84ab-f1ad7875f78a-ssh-key-openstack-edpm-tls" (OuterVolumeSpecName: "ssh-key-openstack-edpm-tls") pod "fa4d9235-fc18-4574-84ab-f1ad7875f78a" (UID: "fa4d9235-fc18-4574-84ab-f1ad7875f78a"). InnerVolumeSpecName "ssh-key-openstack-edpm-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:23:11 crc kubenswrapper[5120]: I0316 17:23:11.416525 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa4d9235-fc18-4574-84ab-f1ad7875f78a-inventory" (OuterVolumeSpecName: "inventory") pod "fa4d9235-fc18-4574-84ab-f1ad7875f78a" (UID: "fa4d9235-fc18-4574-84ab-f1ad7875f78a"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:23:11 crc kubenswrapper[5120]: I0316 17:23:11.498859 5120 reconciler_common.go:299] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/fa4d9235-fc18-4574-84ab-f1ad7875f78a-inventory\") on node \"crc\" DevicePath \"\"" Mar 16 17:23:11 crc kubenswrapper[5120]: I0316 17:23:11.498937 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6w57f\" (UniqueName: \"kubernetes.io/projected/fa4d9235-fc18-4574-84ab-f1ad7875f78a-kube-api-access-6w57f\") on node \"crc\" DevicePath \"\"" Mar 16 17:23:11 crc kubenswrapper[5120]: I0316 17:23:11.498949 5120 reconciler_common.go:299] "Volume detached for volume \"generic-service1-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fa4d9235-fc18-4574-84ab-f1ad7875f78a-generic-service1-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:23:11 crc kubenswrapper[5120]: I0316 17:23:11.498961 5120 reconciler_common.go:299] "Volume detached for volume \"ssh-key-openstack-edpm-tls\" (UniqueName: \"kubernetes.io/secret/fa4d9235-fc18-4574-84ab-f1ad7875f78a-ssh-key-openstack-edpm-tls\") on node \"crc\" DevicePath \"\"" Mar 16 17:23:12 crc kubenswrapper[5120]: I0316 17:23:12.004520 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/generic-service1-openstack-edpm-tls-openstack-edpm-tls-7rxmq" Mar 16 17:23:12 crc kubenswrapper[5120]: I0316 17:23:12.004524 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/generic-service1-openstack-edpm-tls-openstack-edpm-tls-7rxmq" event={"ID":"fa4d9235-fc18-4574-84ab-f1ad7875f78a","Type":"ContainerDied","Data":"7eeea6397015241fe32ff4db1c6f7365f99d4918ffe7976e56f04b981bc7c95c"} Mar 16 17:23:12 crc kubenswrapper[5120]: I0316 17:23:12.004657 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7eeea6397015241fe32ff4db1c6f7365f99d4918ffe7976e56f04b981bc7c95c" Mar 16 17:23:13 crc kubenswrapper[5120]: I0316 17:23:13.036911 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/install-certs-ovr-openstack-edpm-tls-openstack-edpm-tls-w5lnq"] Mar 16 17:23:13 crc kubenswrapper[5120]: I0316 17:23:13.045346 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/generic-service1-openstack-edpm-tls-openstack-edpm-tls-7rxmq"] Mar 16 17:23:13 crc kubenswrapper[5120]: I0316 17:23:13.051861 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/install-certs-ovr-openstack-edpm-tls-openstack-edpm-tls-w5lnq"] Mar 16 17:23:13 crc kubenswrapper[5120]: I0316 17:23:13.059348 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/generic-service1-openstack-edpm-tls-openstack-edpm-tls-7rxmq"] Mar 16 17:23:13 crc kubenswrapper[5120]: I0316 17:23:13.187756 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-nhfgn"] Mar 16 17:23:13 crc kubenswrapper[5120]: I0316 17:23:13.189328 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa4d9235-fc18-4574-84ab-f1ad7875f78a" containerName="generic-service1-openstack-edpm-tls-openstack-edpm-tls" Mar 16 17:23:13 crc kubenswrapper[5120]: I0316 17:23:13.189529 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa4d9235-fc18-4574-84ab-f1ad7875f78a" containerName="generic-service1-openstack-edpm-tls-openstack-edpm-tls" Mar 16 17:23:13 crc kubenswrapper[5120]: I0316 17:23:13.189805 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="fa4d9235-fc18-4574-84ab-f1ad7875f78a" containerName="generic-service1-openstack-edpm-tls-openstack-edpm-tls" Mar 16 17:23:13 crc kubenswrapper[5120]: I0316 17:23:13.198470 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-nhfgn" Mar 16 17:23:13 crc kubenswrapper[5120]: I0316 17:23:13.210347 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-nhfgn"] Mar 16 17:23:13 crc kubenswrapper[5120]: I0316 17:23:13.361340 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/fdefd288-2f86-4806-871e-df4e61d9b916-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-79dcd846c5-nhfgn\" (UID: \"fdefd288-2f86-4806-871e-df4e61d9b916\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-nhfgn" Mar 16 17:23:13 crc kubenswrapper[5120]: I0316 17:23:13.361634 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pcgv7\" (UniqueName: \"kubernetes.io/projected/fdefd288-2f86-4806-871e-df4e61d9b916-kube-api-access-pcgv7\") pod \"dnsmasq-dnsmasq-79dcd846c5-nhfgn\" (UID: \"fdefd288-2f86-4806-871e-df4e61d9b916\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-nhfgn" Mar 16 17:23:13 crc kubenswrapper[5120]: I0316 17:23:13.361996 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fdefd288-2f86-4806-871e-df4e61d9b916-config\") pod \"dnsmasq-dnsmasq-79dcd846c5-nhfgn\" (UID: \"fdefd288-2f86-4806-871e-df4e61d9b916\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-nhfgn" Mar 16 17:23:13 crc kubenswrapper[5120]: I0316 17:23:13.463511 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/fdefd288-2f86-4806-871e-df4e61d9b916-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-79dcd846c5-nhfgn\" (UID: \"fdefd288-2f86-4806-871e-df4e61d9b916\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-nhfgn" Mar 16 17:23:13 crc kubenswrapper[5120]: I0316 17:23:13.463850 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pcgv7\" (UniqueName: \"kubernetes.io/projected/fdefd288-2f86-4806-871e-df4e61d9b916-kube-api-access-pcgv7\") pod \"dnsmasq-dnsmasq-79dcd846c5-nhfgn\" (UID: \"fdefd288-2f86-4806-871e-df4e61d9b916\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-nhfgn" Mar 16 17:23:13 crc kubenswrapper[5120]: I0316 17:23:13.464005 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fdefd288-2f86-4806-871e-df4e61d9b916-config\") pod \"dnsmasq-dnsmasq-79dcd846c5-nhfgn\" (UID: \"fdefd288-2f86-4806-871e-df4e61d9b916\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-nhfgn" Mar 16 17:23:13 crc kubenswrapper[5120]: I0316 17:23:13.465233 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fdefd288-2f86-4806-871e-df4e61d9b916-config\") pod \"dnsmasq-dnsmasq-79dcd846c5-nhfgn\" (UID: \"fdefd288-2f86-4806-871e-df4e61d9b916\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-nhfgn" Mar 16 17:23:13 crc kubenswrapper[5120]: I0316 17:23:13.465506 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/fdefd288-2f86-4806-871e-df4e61d9b916-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-79dcd846c5-nhfgn\" (UID: \"fdefd288-2f86-4806-871e-df4e61d9b916\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-nhfgn" Mar 16 17:23:13 crc kubenswrapper[5120]: I0316 17:23:13.485295 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pcgv7\" (UniqueName: \"kubernetes.io/projected/fdefd288-2f86-4806-871e-df4e61d9b916-kube-api-access-pcgv7\") pod \"dnsmasq-dnsmasq-79dcd846c5-nhfgn\" (UID: \"fdefd288-2f86-4806-871e-df4e61d9b916\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-nhfgn" Mar 16 17:23:13 crc kubenswrapper[5120]: I0316 17:23:13.516173 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-nhfgn" Mar 16 17:23:13 crc kubenswrapper[5120]: I0316 17:23:13.939400 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-nhfgn"] Mar 16 17:23:14 crc kubenswrapper[5120]: I0316 17:23:14.023242 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-nhfgn" event={"ID":"fdefd288-2f86-4806-871e-df4e61d9b916","Type":"ContainerStarted","Data":"1c8f764110b02ae8416be9ba017c69a3706e36bfda845e50165d5665f1316fa9"} Mar 16 17:23:14 crc kubenswrapper[5120]: I0316 17:23:14.673008 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc623871-7557-4fec-9e23-992286e28761" path="/var/lib/kubelet/pods/dc623871-7557-4fec-9e23-992286e28761/volumes" Mar 16 17:23:14 crc kubenswrapper[5120]: I0316 17:23:14.673892 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fa4d9235-fc18-4574-84ab-f1ad7875f78a" path="/var/lib/kubelet/pods/fa4d9235-fc18-4574-84ab-f1ad7875f78a/volumes" Mar 16 17:23:15 crc kubenswrapper[5120]: I0316 17:23:15.033866 5120 generic.go:358] "Generic (PLEG): container finished" podID="fdefd288-2f86-4806-871e-df4e61d9b916" containerID="2d5b8b82ae926f14e0b99d2f0e7f69d423d13d6985341bdb4ae4655231877411" exitCode=0 Mar 16 17:23:15 crc kubenswrapper[5120]: I0316 17:23:15.033915 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-nhfgn" event={"ID":"fdefd288-2f86-4806-871e-df4e61d9b916","Type":"ContainerDied","Data":"2d5b8b82ae926f14e0b99d2f0e7f69d423d13d6985341bdb4ae4655231877411"} Mar 16 17:23:16 crc kubenswrapper[5120]: I0316 17:23:16.046242 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-nhfgn" event={"ID":"fdefd288-2f86-4806-871e-df4e61d9b916","Type":"ContainerStarted","Data":"082e897bacac4ef6fa4ec04f25e62c41a7d386a3fb34ae7f1b9c2e25da121784"} Mar 16 17:23:16 crc kubenswrapper[5120]: I0316 17:23:16.046619 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-nhfgn" Mar 16 17:23:16 crc kubenswrapper[5120]: I0316 17:23:16.066772 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-nhfgn" podStartSLOduration=3.066741045 podStartE2EDuration="3.066741045s" podCreationTimestamp="2026-03-16 17:23:13 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:23:16.061948204 +0000 UTC m=+6698.215879871" watchObservedRunningTime="2026-03-16 17:23:16.066741045 +0000 UTC m=+6698.220672702" Mar 16 17:23:20 crc kubenswrapper[5120]: I0316 17:23:20.748016 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["crc-storage/crc-storage-crc-9crxp"] Mar 16 17:23:20 crc kubenswrapper[5120]: I0316 17:23:20.753724 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["crc-storage/crc-storage-crc-9crxp"] Mar 16 17:23:20 crc kubenswrapper[5120]: I0316 17:23:20.850147 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["crc-storage/crc-storage-crc-t5fds"] Mar 16 17:23:20 crc kubenswrapper[5120]: I0316 17:23:20.865138 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-t5fds"] Mar 16 17:23:20 crc kubenswrapper[5120]: I0316 17:23:20.865260 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-t5fds" Mar 16 17:23:20 crc kubenswrapper[5120]: I0316 17:23:20.867579 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"crc-storage\"" Mar 16 17:23:20 crc kubenswrapper[5120]: I0316 17:23:20.867811 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"crc-storage\"/\"crc-storage-dockercfg-s2tht\"" Mar 16 17:23:20 crc kubenswrapper[5120]: I0316 17:23:20.868083 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"kube-root-ca.crt\"" Mar 16 17:23:20 crc kubenswrapper[5120]: I0316 17:23:20.869492 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"openshift-service-ca.crt\"" Mar 16 17:23:20 crc kubenswrapper[5120]: I0316 17:23:20.970961 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/a294c034-b8c4-4fe5-8a67-7d364884aa5b-crc-storage\") pod \"crc-storage-crc-t5fds\" (UID: \"a294c034-b8c4-4fe5-8a67-7d364884aa5b\") " pod="crc-storage/crc-storage-crc-t5fds" Mar 16 17:23:20 crc kubenswrapper[5120]: I0316 17:23:20.971022 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/a294c034-b8c4-4fe5-8a67-7d364884aa5b-node-mnt\") pod \"crc-storage-crc-t5fds\" (UID: \"a294c034-b8c4-4fe5-8a67-7d364884aa5b\") " pod="crc-storage/crc-storage-crc-t5fds" Mar 16 17:23:20 crc kubenswrapper[5120]: I0316 17:23:20.971321 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-776qf\" (UniqueName: \"kubernetes.io/projected/a294c034-b8c4-4fe5-8a67-7d364884aa5b-kube-api-access-776qf\") pod \"crc-storage-crc-t5fds\" (UID: \"a294c034-b8c4-4fe5-8a67-7d364884aa5b\") " pod="crc-storage/crc-storage-crc-t5fds" Mar 16 17:23:21 crc kubenswrapper[5120]: I0316 17:23:21.072661 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-776qf\" (UniqueName: \"kubernetes.io/projected/a294c034-b8c4-4fe5-8a67-7d364884aa5b-kube-api-access-776qf\") pod \"crc-storage-crc-t5fds\" (UID: \"a294c034-b8c4-4fe5-8a67-7d364884aa5b\") " pod="crc-storage/crc-storage-crc-t5fds" Mar 16 17:23:21 crc kubenswrapper[5120]: I0316 17:23:21.072905 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/a294c034-b8c4-4fe5-8a67-7d364884aa5b-crc-storage\") pod \"crc-storage-crc-t5fds\" (UID: \"a294c034-b8c4-4fe5-8a67-7d364884aa5b\") " pod="crc-storage/crc-storage-crc-t5fds" Mar 16 17:23:21 crc kubenswrapper[5120]: I0316 17:23:21.072944 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/a294c034-b8c4-4fe5-8a67-7d364884aa5b-node-mnt\") pod \"crc-storage-crc-t5fds\" (UID: \"a294c034-b8c4-4fe5-8a67-7d364884aa5b\") " pod="crc-storage/crc-storage-crc-t5fds" Mar 16 17:23:21 crc kubenswrapper[5120]: I0316 17:23:21.073269 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/a294c034-b8c4-4fe5-8a67-7d364884aa5b-node-mnt\") pod \"crc-storage-crc-t5fds\" (UID: \"a294c034-b8c4-4fe5-8a67-7d364884aa5b\") " pod="crc-storage/crc-storage-crc-t5fds" Mar 16 17:23:21 crc kubenswrapper[5120]: I0316 17:23:21.073840 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/a294c034-b8c4-4fe5-8a67-7d364884aa5b-crc-storage\") pod \"crc-storage-crc-t5fds\" (UID: \"a294c034-b8c4-4fe5-8a67-7d364884aa5b\") " pod="crc-storage/crc-storage-crc-t5fds" Mar 16 17:23:21 crc kubenswrapper[5120]: I0316 17:23:21.094690 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-776qf\" (UniqueName: \"kubernetes.io/projected/a294c034-b8c4-4fe5-8a67-7d364884aa5b-kube-api-access-776qf\") pod \"crc-storage-crc-t5fds\" (UID: \"a294c034-b8c4-4fe5-8a67-7d364884aa5b\") " pod="crc-storage/crc-storage-crc-t5fds" Mar 16 17:23:21 crc kubenswrapper[5120]: I0316 17:23:21.186068 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-t5fds" Mar 16 17:23:21 crc kubenswrapper[5120]: I0316 17:23:21.396468 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-t5fds"] Mar 16 17:23:22 crc kubenswrapper[5120]: I0316 17:23:22.057973 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-nhfgn" Mar 16 17:23:22 crc kubenswrapper[5120]: I0316 17:23:22.107905 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-694766f957-tr8z4"] Mar 16 17:23:22 crc kubenswrapper[5120]: I0316 17:23:22.108200 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-694766f957-tr8z4" podUID="6a8f5d87-cc5b-4621-a464-942357c5296b" containerName="dnsmasq-dns" containerID="cri-o://48e64a37e5bcdea8cf9be8ff7028bdf9c274e074a638690c80b39aa1f87c6557" gracePeriod=10 Mar 16 17:23:22 crc kubenswrapper[5120]: I0316 17:23:22.125301 5120 generic.go:358] "Generic (PLEG): container finished" podID="a294c034-b8c4-4fe5-8a67-7d364884aa5b" containerID="ec9e84f5c5ff83a164a2a7599780b27672729c0d2543e761e499d1db5efd4b06" exitCode=0 Mar 16 17:23:22 crc kubenswrapper[5120]: I0316 17:23:22.125360 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-t5fds" event={"ID":"a294c034-b8c4-4fe5-8a67-7d364884aa5b","Type":"ContainerDied","Data":"ec9e84f5c5ff83a164a2a7599780b27672729c0d2543e761e499d1db5efd4b06"} Mar 16 17:23:22 crc kubenswrapper[5120]: I0316 17:23:22.126017 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-t5fds" event={"ID":"a294c034-b8c4-4fe5-8a67-7d364884aa5b","Type":"ContainerStarted","Data":"51aba6e65fdc8e07e95664e1a762099f5820b31801176ddaef951b54b54537cb"} Mar 16 17:23:22 crc kubenswrapper[5120]: I0316 17:23:22.496354 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-694766f957-tr8z4" Mar 16 17:23:22 crc kubenswrapper[5120]: I0316 17:23:22.605902 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/6a8f5d87-cc5b-4621-a464-942357c5296b-dnsmasq-svc\") pod \"6a8f5d87-cc5b-4621-a464-942357c5296b\" (UID: \"6a8f5d87-cc5b-4621-a464-942357c5296b\") " Mar 16 17:23:22 crc kubenswrapper[5120]: I0316 17:23:22.606030 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6a8f5d87-cc5b-4621-a464-942357c5296b-config\") pod \"6a8f5d87-cc5b-4621-a464-942357c5296b\" (UID: \"6a8f5d87-cc5b-4621-a464-942357c5296b\") " Mar 16 17:23:22 crc kubenswrapper[5120]: I0316 17:23:22.606403 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p7kzg\" (UniqueName: \"kubernetes.io/projected/6a8f5d87-cc5b-4621-a464-942357c5296b-kube-api-access-p7kzg\") pod \"6a8f5d87-cc5b-4621-a464-942357c5296b\" (UID: \"6a8f5d87-cc5b-4621-a464-942357c5296b\") " Mar 16 17:23:22 crc kubenswrapper[5120]: I0316 17:23:22.606499 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"openstack-edpm-tls\" (UniqueName: \"kubernetes.io/configmap/6a8f5d87-cc5b-4621-a464-942357c5296b-openstack-edpm-tls\") pod \"6a8f5d87-cc5b-4621-a464-942357c5296b\" (UID: \"6a8f5d87-cc5b-4621-a464-942357c5296b\") " Mar 16 17:23:22 crc kubenswrapper[5120]: I0316 17:23:22.610941 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a8f5d87-cc5b-4621-a464-942357c5296b-kube-api-access-p7kzg" (OuterVolumeSpecName: "kube-api-access-p7kzg") pod "6a8f5d87-cc5b-4621-a464-942357c5296b" (UID: "6a8f5d87-cc5b-4621-a464-942357c5296b"). InnerVolumeSpecName "kube-api-access-p7kzg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:23:22 crc kubenswrapper[5120]: I0316 17:23:22.639620 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a8f5d87-cc5b-4621-a464-942357c5296b-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "6a8f5d87-cc5b-4621-a464-942357c5296b" (UID: "6a8f5d87-cc5b-4621-a464-942357c5296b"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:23:22 crc kubenswrapper[5120]: I0316 17:23:22.642613 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a8f5d87-cc5b-4621-a464-942357c5296b-config" (OuterVolumeSpecName: "config") pod "6a8f5d87-cc5b-4621-a464-942357c5296b" (UID: "6a8f5d87-cc5b-4621-a464-942357c5296b"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:23:22 crc kubenswrapper[5120]: I0316 17:23:22.649912 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a8f5d87-cc5b-4621-a464-942357c5296b-openstack-edpm-tls" (OuterVolumeSpecName: "openstack-edpm-tls") pod "6a8f5d87-cc5b-4621-a464-942357c5296b" (UID: "6a8f5d87-cc5b-4621-a464-942357c5296b"). InnerVolumeSpecName "openstack-edpm-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:23:22 crc kubenswrapper[5120]: I0316 17:23:22.672809 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bdded3e7-1fd7-49c5-bc57-c835920c2658" path="/var/lib/kubelet/pods/bdded3e7-1fd7-49c5-bc57-c835920c2658/volumes" Mar 16 17:23:22 crc kubenswrapper[5120]: I0316 17:23:22.709361 5120 reconciler_common.go:299] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/6a8f5d87-cc5b-4621-a464-942357c5296b-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Mar 16 17:23:22 crc kubenswrapper[5120]: I0316 17:23:22.709396 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6a8f5d87-cc5b-4621-a464-942357c5296b-config\") on node \"crc\" DevicePath \"\"" Mar 16 17:23:22 crc kubenswrapper[5120]: I0316 17:23:22.709411 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p7kzg\" (UniqueName: \"kubernetes.io/projected/6a8f5d87-cc5b-4621-a464-942357c5296b-kube-api-access-p7kzg\") on node \"crc\" DevicePath \"\"" Mar 16 17:23:22 crc kubenswrapper[5120]: I0316 17:23:22.709425 5120 reconciler_common.go:299] "Volume detached for volume \"openstack-edpm-tls\" (UniqueName: \"kubernetes.io/configmap/6a8f5d87-cc5b-4621-a464-942357c5296b-openstack-edpm-tls\") on node \"crc\" DevicePath \"\"" Mar 16 17:23:23 crc kubenswrapper[5120]: I0316 17:23:23.138431 5120 generic.go:358] "Generic (PLEG): container finished" podID="6a8f5d87-cc5b-4621-a464-942357c5296b" containerID="48e64a37e5bcdea8cf9be8ff7028bdf9c274e074a638690c80b39aa1f87c6557" exitCode=0 Mar 16 17:23:23 crc kubenswrapper[5120]: I0316 17:23:23.138562 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-694766f957-tr8z4" Mar 16 17:23:23 crc kubenswrapper[5120]: I0316 17:23:23.138569 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-694766f957-tr8z4" event={"ID":"6a8f5d87-cc5b-4621-a464-942357c5296b","Type":"ContainerDied","Data":"48e64a37e5bcdea8cf9be8ff7028bdf9c274e074a638690c80b39aa1f87c6557"} Mar 16 17:23:23 crc kubenswrapper[5120]: I0316 17:23:23.138637 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-694766f957-tr8z4" event={"ID":"6a8f5d87-cc5b-4621-a464-942357c5296b","Type":"ContainerDied","Data":"d11294c1100573f9fafc3e3e56cd57d8ceb85268d934279001449bfb5cc6bfc8"} Mar 16 17:23:23 crc kubenswrapper[5120]: I0316 17:23:23.138663 5120 scope.go:117] "RemoveContainer" containerID="48e64a37e5bcdea8cf9be8ff7028bdf9c274e074a638690c80b39aa1f87c6557" Mar 16 17:23:23 crc kubenswrapper[5120]: I0316 17:23:23.172051 5120 scope.go:117] "RemoveContainer" containerID="78fd8eb2c2dfed97ed243fbc87a5c9b352c66f133f6d470846e6b211b6ab2f1c" Mar 16 17:23:23 crc kubenswrapper[5120]: I0316 17:23:23.178097 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-694766f957-tr8z4"] Mar 16 17:23:23 crc kubenswrapper[5120]: I0316 17:23:23.184930 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-694766f957-tr8z4"] Mar 16 17:23:23 crc kubenswrapper[5120]: I0316 17:23:23.202448 5120 scope.go:117] "RemoveContainer" containerID="48e64a37e5bcdea8cf9be8ff7028bdf9c274e074a638690c80b39aa1f87c6557" Mar 16 17:23:23 crc kubenswrapper[5120]: E0316 17:23:23.203861 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"48e64a37e5bcdea8cf9be8ff7028bdf9c274e074a638690c80b39aa1f87c6557\": container with ID starting with 48e64a37e5bcdea8cf9be8ff7028bdf9c274e074a638690c80b39aa1f87c6557 not found: ID does not exist" containerID="48e64a37e5bcdea8cf9be8ff7028bdf9c274e074a638690c80b39aa1f87c6557" Mar 16 17:23:23 crc kubenswrapper[5120]: I0316 17:23:23.203893 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48e64a37e5bcdea8cf9be8ff7028bdf9c274e074a638690c80b39aa1f87c6557"} err="failed to get container status \"48e64a37e5bcdea8cf9be8ff7028bdf9c274e074a638690c80b39aa1f87c6557\": rpc error: code = NotFound desc = could not find container \"48e64a37e5bcdea8cf9be8ff7028bdf9c274e074a638690c80b39aa1f87c6557\": container with ID starting with 48e64a37e5bcdea8cf9be8ff7028bdf9c274e074a638690c80b39aa1f87c6557 not found: ID does not exist" Mar 16 17:23:23 crc kubenswrapper[5120]: I0316 17:23:23.203912 5120 scope.go:117] "RemoveContainer" containerID="78fd8eb2c2dfed97ed243fbc87a5c9b352c66f133f6d470846e6b211b6ab2f1c" Mar 16 17:23:23 crc kubenswrapper[5120]: E0316 17:23:23.205235 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"78fd8eb2c2dfed97ed243fbc87a5c9b352c66f133f6d470846e6b211b6ab2f1c\": container with ID starting with 78fd8eb2c2dfed97ed243fbc87a5c9b352c66f133f6d470846e6b211b6ab2f1c not found: ID does not exist" containerID="78fd8eb2c2dfed97ed243fbc87a5c9b352c66f133f6d470846e6b211b6ab2f1c" Mar 16 17:23:23 crc kubenswrapper[5120]: I0316 17:23:23.205253 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78fd8eb2c2dfed97ed243fbc87a5c9b352c66f133f6d470846e6b211b6ab2f1c"} err="failed to get container status \"78fd8eb2c2dfed97ed243fbc87a5c9b352c66f133f6d470846e6b211b6ab2f1c\": rpc error: code = NotFound desc = could not find container \"78fd8eb2c2dfed97ed243fbc87a5c9b352c66f133f6d470846e6b211b6ab2f1c\": container with ID starting with 78fd8eb2c2dfed97ed243fbc87a5c9b352c66f133f6d470846e6b211b6ab2f1c not found: ID does not exist" Mar 16 17:23:23 crc kubenswrapper[5120]: I0316 17:23:23.391500 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-t5fds" Mar 16 17:23:23 crc kubenswrapper[5120]: I0316 17:23:23.526122 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-776qf\" (UniqueName: \"kubernetes.io/projected/a294c034-b8c4-4fe5-8a67-7d364884aa5b-kube-api-access-776qf\") pod \"a294c034-b8c4-4fe5-8a67-7d364884aa5b\" (UID: \"a294c034-b8c4-4fe5-8a67-7d364884aa5b\") " Mar 16 17:23:23 crc kubenswrapper[5120]: I0316 17:23:23.526786 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/a294c034-b8c4-4fe5-8a67-7d364884aa5b-crc-storage\") pod \"a294c034-b8c4-4fe5-8a67-7d364884aa5b\" (UID: \"a294c034-b8c4-4fe5-8a67-7d364884aa5b\") " Mar 16 17:23:23 crc kubenswrapper[5120]: I0316 17:23:23.526963 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/a294c034-b8c4-4fe5-8a67-7d364884aa5b-node-mnt\") pod \"a294c034-b8c4-4fe5-8a67-7d364884aa5b\" (UID: \"a294c034-b8c4-4fe5-8a67-7d364884aa5b\") " Mar 16 17:23:23 crc kubenswrapper[5120]: I0316 17:23:23.527023 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/a294c034-b8c4-4fe5-8a67-7d364884aa5b-node-mnt" (OuterVolumeSpecName: "node-mnt") pod "a294c034-b8c4-4fe5-8a67-7d364884aa5b" (UID: "a294c034-b8c4-4fe5-8a67-7d364884aa5b"). InnerVolumeSpecName "node-mnt". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 17:23:23 crc kubenswrapper[5120]: I0316 17:23:23.528847 5120 reconciler_common.go:299] "Volume detached for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/a294c034-b8c4-4fe5-8a67-7d364884aa5b-node-mnt\") on node \"crc\" DevicePath \"\"" Mar 16 17:23:23 crc kubenswrapper[5120]: I0316 17:23:23.546993 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a294c034-b8c4-4fe5-8a67-7d364884aa5b-kube-api-access-776qf" (OuterVolumeSpecName: "kube-api-access-776qf") pod "a294c034-b8c4-4fe5-8a67-7d364884aa5b" (UID: "a294c034-b8c4-4fe5-8a67-7d364884aa5b"). InnerVolumeSpecName "kube-api-access-776qf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:23:23 crc kubenswrapper[5120]: I0316 17:23:23.560886 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a294c034-b8c4-4fe5-8a67-7d364884aa5b-crc-storage" (OuterVolumeSpecName: "crc-storage") pod "a294c034-b8c4-4fe5-8a67-7d364884aa5b" (UID: "a294c034-b8c4-4fe5-8a67-7d364884aa5b"). InnerVolumeSpecName "crc-storage". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:23:23 crc kubenswrapper[5120]: I0316 17:23:23.630909 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-776qf\" (UniqueName: \"kubernetes.io/projected/a294c034-b8c4-4fe5-8a67-7d364884aa5b-kube-api-access-776qf\") on node \"crc\" DevicePath \"\"" Mar 16 17:23:23 crc kubenswrapper[5120]: I0316 17:23:23.630967 5120 reconciler_common.go:299] "Volume detached for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/a294c034-b8c4-4fe5-8a67-7d364884aa5b-crc-storage\") on node \"crc\" DevicePath \"\"" Mar 16 17:23:24 crc kubenswrapper[5120]: I0316 17:23:24.147054 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-t5fds" Mar 16 17:23:24 crc kubenswrapper[5120]: I0316 17:23:24.147082 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-t5fds" event={"ID":"a294c034-b8c4-4fe5-8a67-7d364884aa5b","Type":"ContainerDied","Data":"51aba6e65fdc8e07e95664e1a762099f5820b31801176ddaef951b54b54537cb"} Mar 16 17:23:24 crc kubenswrapper[5120]: I0316 17:23:24.147122 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="51aba6e65fdc8e07e95664e1a762099f5820b31801176ddaef951b54b54537cb" Mar 16 17:23:24 crc kubenswrapper[5120]: I0316 17:23:24.673671 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a8f5d87-cc5b-4621-a464-942357c5296b" path="/var/lib/kubelet/pods/6a8f5d87-cc5b-4621-a464-942357c5296b/volumes" Mar 16 17:23:26 crc kubenswrapper[5120]: I0316 17:23:26.672322 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["crc-storage/crc-storage-crc-t5fds"] Mar 16 17:23:26 crc kubenswrapper[5120]: I0316 17:23:26.677596 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["crc-storage/crc-storage-crc-t5fds"] Mar 16 17:23:26 crc kubenswrapper[5120]: I0316 17:23:26.789127 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["crc-storage/crc-storage-crc-h7rgz"] Mar 16 17:23:26 crc kubenswrapper[5120]: I0316 17:23:26.790443 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a294c034-b8c4-4fe5-8a67-7d364884aa5b" containerName="storage" Mar 16 17:23:26 crc kubenswrapper[5120]: I0316 17:23:26.790586 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a294c034-b8c4-4fe5-8a67-7d364884aa5b" containerName="storage" Mar 16 17:23:26 crc kubenswrapper[5120]: I0316 17:23:26.790711 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a8f5d87-cc5b-4621-a464-942357c5296b" containerName="init" Mar 16 17:23:26 crc kubenswrapper[5120]: I0316 17:23:26.790795 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a8f5d87-cc5b-4621-a464-942357c5296b" containerName="init" Mar 16 17:23:26 crc kubenswrapper[5120]: I0316 17:23:26.790888 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a8f5d87-cc5b-4621-a464-942357c5296b" containerName="dnsmasq-dns" Mar 16 17:23:26 crc kubenswrapper[5120]: I0316 17:23:26.790957 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a8f5d87-cc5b-4621-a464-942357c5296b" containerName="dnsmasq-dns" Mar 16 17:23:26 crc kubenswrapper[5120]: I0316 17:23:26.791198 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="a294c034-b8c4-4fe5-8a67-7d364884aa5b" containerName="storage" Mar 16 17:23:26 crc kubenswrapper[5120]: I0316 17:23:26.791279 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="6a8f5d87-cc5b-4621-a464-942357c5296b" containerName="dnsmasq-dns" Mar 16 17:23:26 crc kubenswrapper[5120]: I0316 17:23:26.799850 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-h7rgz"] Mar 16 17:23:26 crc kubenswrapper[5120]: I0316 17:23:26.799985 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-h7rgz" Mar 16 17:23:26 crc kubenswrapper[5120]: I0316 17:23:26.802194 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"openshift-service-ca.crt\"" Mar 16 17:23:26 crc kubenswrapper[5120]: I0316 17:23:26.802224 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"crc-storage\"" Mar 16 17:23:26 crc kubenswrapper[5120]: I0316 17:23:26.802414 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"crc-storage\"/\"crc-storage-dockercfg-s2tht\"" Mar 16 17:23:26 crc kubenswrapper[5120]: I0316 17:23:26.803431 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"kube-root-ca.crt\"" Mar 16 17:23:26 crc kubenswrapper[5120]: I0316 17:23:26.904123 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/11090ef3-d160-43c6-8af6-ab2598c381ae-crc-storage\") pod \"crc-storage-crc-h7rgz\" (UID: \"11090ef3-d160-43c6-8af6-ab2598c381ae\") " pod="crc-storage/crc-storage-crc-h7rgz" Mar 16 17:23:26 crc kubenswrapper[5120]: I0316 17:23:26.904271 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2xkb\" (UniqueName: \"kubernetes.io/projected/11090ef3-d160-43c6-8af6-ab2598c381ae-kube-api-access-h2xkb\") pod \"crc-storage-crc-h7rgz\" (UID: \"11090ef3-d160-43c6-8af6-ab2598c381ae\") " pod="crc-storage/crc-storage-crc-h7rgz" Mar 16 17:23:26 crc kubenswrapper[5120]: I0316 17:23:26.904410 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/11090ef3-d160-43c6-8af6-ab2598c381ae-node-mnt\") pod \"crc-storage-crc-h7rgz\" (UID: \"11090ef3-d160-43c6-8af6-ab2598c381ae\") " pod="crc-storage/crc-storage-crc-h7rgz" Mar 16 17:23:27 crc kubenswrapper[5120]: I0316 17:23:27.006312 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/11090ef3-d160-43c6-8af6-ab2598c381ae-crc-storage\") pod \"crc-storage-crc-h7rgz\" (UID: \"11090ef3-d160-43c6-8af6-ab2598c381ae\") " pod="crc-storage/crc-storage-crc-h7rgz" Mar 16 17:23:27 crc kubenswrapper[5120]: I0316 17:23:27.006414 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h2xkb\" (UniqueName: \"kubernetes.io/projected/11090ef3-d160-43c6-8af6-ab2598c381ae-kube-api-access-h2xkb\") pod \"crc-storage-crc-h7rgz\" (UID: \"11090ef3-d160-43c6-8af6-ab2598c381ae\") " pod="crc-storage/crc-storage-crc-h7rgz" Mar 16 17:23:27 crc kubenswrapper[5120]: I0316 17:23:27.006462 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/11090ef3-d160-43c6-8af6-ab2598c381ae-node-mnt\") pod \"crc-storage-crc-h7rgz\" (UID: \"11090ef3-d160-43c6-8af6-ab2598c381ae\") " pod="crc-storage/crc-storage-crc-h7rgz" Mar 16 17:23:27 crc kubenswrapper[5120]: I0316 17:23:27.006747 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/11090ef3-d160-43c6-8af6-ab2598c381ae-node-mnt\") pod \"crc-storage-crc-h7rgz\" (UID: \"11090ef3-d160-43c6-8af6-ab2598c381ae\") " pod="crc-storage/crc-storage-crc-h7rgz" Mar 16 17:23:27 crc kubenswrapper[5120]: I0316 17:23:27.007308 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/11090ef3-d160-43c6-8af6-ab2598c381ae-crc-storage\") pod \"crc-storage-crc-h7rgz\" (UID: \"11090ef3-d160-43c6-8af6-ab2598c381ae\") " pod="crc-storage/crc-storage-crc-h7rgz" Mar 16 17:23:27 crc kubenswrapper[5120]: I0316 17:23:27.029327 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2xkb\" (UniqueName: \"kubernetes.io/projected/11090ef3-d160-43c6-8af6-ab2598c381ae-kube-api-access-h2xkb\") pod \"crc-storage-crc-h7rgz\" (UID: \"11090ef3-d160-43c6-8af6-ab2598c381ae\") " pod="crc-storage/crc-storage-crc-h7rgz" Mar 16 17:23:27 crc kubenswrapper[5120]: I0316 17:23:27.119866 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-h7rgz" Mar 16 17:23:27 crc kubenswrapper[5120]: I0316 17:23:27.520854 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-h7rgz"] Mar 16 17:23:28 crc kubenswrapper[5120]: I0316 17:23:28.197868 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-h7rgz" event={"ID":"11090ef3-d160-43c6-8af6-ab2598c381ae","Type":"ContainerStarted","Data":"a86a4842f9e57bb09bb0af16f0edcfb767704116d787bf6425263fbed071df1e"} Mar 16 17:23:28 crc kubenswrapper[5120]: I0316 17:23:28.672629 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a294c034-b8c4-4fe5-8a67-7d364884aa5b" path="/var/lib/kubelet/pods/a294c034-b8c4-4fe5-8a67-7d364884aa5b/volumes" Mar 16 17:23:29 crc kubenswrapper[5120]: I0316 17:23:29.229925 5120 generic.go:358] "Generic (PLEG): container finished" podID="11090ef3-d160-43c6-8af6-ab2598c381ae" containerID="14637ec8e5a89f3a6472432f41e4c041e15781e78a3b2b975caf2edc7f0d1205" exitCode=0 Mar 16 17:23:29 crc kubenswrapper[5120]: I0316 17:23:29.229991 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-h7rgz" event={"ID":"11090ef3-d160-43c6-8af6-ab2598c381ae","Type":"ContainerDied","Data":"14637ec8e5a89f3a6472432f41e4c041e15781e78a3b2b975caf2edc7f0d1205"} Mar 16 17:23:30 crc kubenswrapper[5120]: I0316 17:23:30.527538 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-h7rgz" Mar 16 17:23:30 crc kubenswrapper[5120]: I0316 17:23:30.688050 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/11090ef3-d160-43c6-8af6-ab2598c381ae-crc-storage\") pod \"11090ef3-d160-43c6-8af6-ab2598c381ae\" (UID: \"11090ef3-d160-43c6-8af6-ab2598c381ae\") " Mar 16 17:23:30 crc kubenswrapper[5120]: I0316 17:23:30.688163 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/11090ef3-d160-43c6-8af6-ab2598c381ae-node-mnt\") pod \"11090ef3-d160-43c6-8af6-ab2598c381ae\" (UID: \"11090ef3-d160-43c6-8af6-ab2598c381ae\") " Mar 16 17:23:30 crc kubenswrapper[5120]: I0316 17:23:30.688345 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h2xkb\" (UniqueName: \"kubernetes.io/projected/11090ef3-d160-43c6-8af6-ab2598c381ae-kube-api-access-h2xkb\") pod \"11090ef3-d160-43c6-8af6-ab2598c381ae\" (UID: \"11090ef3-d160-43c6-8af6-ab2598c381ae\") " Mar 16 17:23:30 crc kubenswrapper[5120]: I0316 17:23:30.688452 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/11090ef3-d160-43c6-8af6-ab2598c381ae-node-mnt" (OuterVolumeSpecName: "node-mnt") pod "11090ef3-d160-43c6-8af6-ab2598c381ae" (UID: "11090ef3-d160-43c6-8af6-ab2598c381ae"). InnerVolumeSpecName "node-mnt". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 17:23:30 crc kubenswrapper[5120]: I0316 17:23:30.689255 5120 reconciler_common.go:299] "Volume detached for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/11090ef3-d160-43c6-8af6-ab2598c381ae-node-mnt\") on node \"crc\" DevicePath \"\"" Mar 16 17:23:30 crc kubenswrapper[5120]: I0316 17:23:30.694987 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11090ef3-d160-43c6-8af6-ab2598c381ae-kube-api-access-h2xkb" (OuterVolumeSpecName: "kube-api-access-h2xkb") pod "11090ef3-d160-43c6-8af6-ab2598c381ae" (UID: "11090ef3-d160-43c6-8af6-ab2598c381ae"). InnerVolumeSpecName "kube-api-access-h2xkb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:23:30 crc kubenswrapper[5120]: I0316 17:23:30.707308 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11090ef3-d160-43c6-8af6-ab2598c381ae-crc-storage" (OuterVolumeSpecName: "crc-storage") pod "11090ef3-d160-43c6-8af6-ab2598c381ae" (UID: "11090ef3-d160-43c6-8af6-ab2598c381ae"). InnerVolumeSpecName "crc-storage". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:23:30 crc kubenswrapper[5120]: I0316 17:23:30.791434 5120 reconciler_common.go:299] "Volume detached for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/11090ef3-d160-43c6-8af6-ab2598c381ae-crc-storage\") on node \"crc\" DevicePath \"\"" Mar 16 17:23:30 crc kubenswrapper[5120]: I0316 17:23:30.791487 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h2xkb\" (UniqueName: \"kubernetes.io/projected/11090ef3-d160-43c6-8af6-ab2598c381ae-kube-api-access-h2xkb\") on node \"crc\" DevicePath \"\"" Mar 16 17:23:31 crc kubenswrapper[5120]: I0316 17:23:31.248492 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-h7rgz" Mar 16 17:23:31 crc kubenswrapper[5120]: I0316 17:23:31.248516 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-h7rgz" event={"ID":"11090ef3-d160-43c6-8af6-ab2598c381ae","Type":"ContainerDied","Data":"a86a4842f9e57bb09bb0af16f0edcfb767704116d787bf6425263fbed071df1e"} Mar 16 17:23:31 crc kubenswrapper[5120]: I0316 17:23:31.249049 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a86a4842f9e57bb09bb0af16f0edcfb767704116d787bf6425263fbed071df1e" Mar 16 17:23:33 crc kubenswrapper[5120]: I0316 17:23:33.888452 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-8c5974765-c6tkv"] Mar 16 17:23:33 crc kubenswrapper[5120]: I0316 17:23:33.889915 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11090ef3-d160-43c6-8af6-ab2598c381ae" containerName="storage" Mar 16 17:23:33 crc kubenswrapper[5120]: I0316 17:23:33.889937 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="11090ef3-d160-43c6-8af6-ab2598c381ae" containerName="storage" Mar 16 17:23:33 crc kubenswrapper[5120]: I0316 17:23:33.890116 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="11090ef3-d160-43c6-8af6-ab2598c381ae" containerName="storage" Mar 16 17:23:33 crc kubenswrapper[5120]: I0316 17:23:33.897174 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-8c5974765-c6tkv" Mar 16 17:23:33 crc kubenswrapper[5120]: I0316 17:23:33.898535 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-8c5974765-c6tkv"] Mar 16 17:23:33 crc kubenswrapper[5120]: I0316 17:23:33.899209 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"edpm-compute-no-nodes\"" Mar 16 17:23:33 crc kubenswrapper[5120]: I0316 17:23:33.964995 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3624a599-2ea0-41fa-931f-9258d899b82e-config\") pod \"dnsmasq-dnsmasq-8c5974765-c6tkv\" (UID: \"3624a599-2ea0-41fa-931f-9258d899b82e\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-8c5974765-c6tkv" Mar 16 17:23:33 crc kubenswrapper[5120]: I0316 17:23:33.965218 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/configmap/3624a599-2ea0-41fa-931f-9258d899b82e-edpm-compute-no-nodes\") pod \"dnsmasq-dnsmasq-8c5974765-c6tkv\" (UID: \"3624a599-2ea0-41fa-931f-9258d899b82e\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-8c5974765-c6tkv" Mar 16 17:23:33 crc kubenswrapper[5120]: I0316 17:23:33.965732 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/3624a599-2ea0-41fa-931f-9258d899b82e-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-8c5974765-c6tkv\" (UID: \"3624a599-2ea0-41fa-931f-9258d899b82e\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-8c5974765-c6tkv" Mar 16 17:23:33 crc kubenswrapper[5120]: I0316 17:23:33.965807 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5m4jb\" (UniqueName: \"kubernetes.io/projected/3624a599-2ea0-41fa-931f-9258d899b82e-kube-api-access-5m4jb\") pod \"dnsmasq-dnsmasq-8c5974765-c6tkv\" (UID: \"3624a599-2ea0-41fa-931f-9258d899b82e\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-8c5974765-c6tkv" Mar 16 17:23:34 crc kubenswrapper[5120]: I0316 17:23:34.068339 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/3624a599-2ea0-41fa-931f-9258d899b82e-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-8c5974765-c6tkv\" (UID: \"3624a599-2ea0-41fa-931f-9258d899b82e\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-8c5974765-c6tkv" Mar 16 17:23:34 crc kubenswrapper[5120]: I0316 17:23:34.068666 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5m4jb\" (UniqueName: \"kubernetes.io/projected/3624a599-2ea0-41fa-931f-9258d899b82e-kube-api-access-5m4jb\") pod \"dnsmasq-dnsmasq-8c5974765-c6tkv\" (UID: \"3624a599-2ea0-41fa-931f-9258d899b82e\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-8c5974765-c6tkv" Mar 16 17:23:34 crc kubenswrapper[5120]: I0316 17:23:34.068788 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3624a599-2ea0-41fa-931f-9258d899b82e-config\") pod \"dnsmasq-dnsmasq-8c5974765-c6tkv\" (UID: \"3624a599-2ea0-41fa-931f-9258d899b82e\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-8c5974765-c6tkv" Mar 16 17:23:34 crc kubenswrapper[5120]: I0316 17:23:34.068860 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/configmap/3624a599-2ea0-41fa-931f-9258d899b82e-edpm-compute-no-nodes\") pod \"dnsmasq-dnsmasq-8c5974765-c6tkv\" (UID: \"3624a599-2ea0-41fa-931f-9258d899b82e\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-8c5974765-c6tkv" Mar 16 17:23:34 crc kubenswrapper[5120]: I0316 17:23:34.069612 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/3624a599-2ea0-41fa-931f-9258d899b82e-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-8c5974765-c6tkv\" (UID: \"3624a599-2ea0-41fa-931f-9258d899b82e\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-8c5974765-c6tkv" Mar 16 17:23:34 crc kubenswrapper[5120]: I0316 17:23:34.069674 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3624a599-2ea0-41fa-931f-9258d899b82e-config\") pod \"dnsmasq-dnsmasq-8c5974765-c6tkv\" (UID: \"3624a599-2ea0-41fa-931f-9258d899b82e\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-8c5974765-c6tkv" Mar 16 17:23:34 crc kubenswrapper[5120]: I0316 17:23:34.069828 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/configmap/3624a599-2ea0-41fa-931f-9258d899b82e-edpm-compute-no-nodes\") pod \"dnsmasq-dnsmasq-8c5974765-c6tkv\" (UID: \"3624a599-2ea0-41fa-931f-9258d899b82e\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-8c5974765-c6tkv" Mar 16 17:23:34 crc kubenswrapper[5120]: I0316 17:23:34.089585 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5m4jb\" (UniqueName: \"kubernetes.io/projected/3624a599-2ea0-41fa-931f-9258d899b82e-kube-api-access-5m4jb\") pod \"dnsmasq-dnsmasq-8c5974765-c6tkv\" (UID: \"3624a599-2ea0-41fa-931f-9258d899b82e\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-8c5974765-c6tkv" Mar 16 17:23:34 crc kubenswrapper[5120]: I0316 17:23:34.217877 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-8c5974765-c6tkv" Mar 16 17:23:34 crc kubenswrapper[5120]: W0316 17:23:34.647064 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3624a599_2ea0_41fa_931f_9258d899b82e.slice/crio-9df9df4db16922e074d8574d20d1b61f4e3e3b16fe0b59e36ead50b635291d2b WatchSource:0}: Error finding container 9df9df4db16922e074d8574d20d1b61f4e3e3b16fe0b59e36ead50b635291d2b: Status 404 returned error can't find the container with id 9df9df4db16922e074d8574d20d1b61f4e3e3b16fe0b59e36ead50b635291d2b Mar 16 17:23:34 crc kubenswrapper[5120]: I0316 17:23:34.648154 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-8c5974765-c6tkv"] Mar 16 17:23:35 crc kubenswrapper[5120]: I0316 17:23:35.286623 5120 generic.go:358] "Generic (PLEG): container finished" podID="3624a599-2ea0-41fa-931f-9258d899b82e" containerID="d3c0746e6fca283d70987344f0d070ef1b5d89071b8fcbd1430806d49882fe21" exitCode=0 Mar 16 17:23:35 crc kubenswrapper[5120]: I0316 17:23:35.286679 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-8c5974765-c6tkv" event={"ID":"3624a599-2ea0-41fa-931f-9258d899b82e","Type":"ContainerDied","Data":"d3c0746e6fca283d70987344f0d070ef1b5d89071b8fcbd1430806d49882fe21"} Mar 16 17:23:35 crc kubenswrapper[5120]: I0316 17:23:35.287028 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-8c5974765-c6tkv" event={"ID":"3624a599-2ea0-41fa-931f-9258d899b82e","Type":"ContainerStarted","Data":"9df9df4db16922e074d8574d20d1b61f4e3e3b16fe0b59e36ead50b635291d2b"} Mar 16 17:23:36 crc kubenswrapper[5120]: I0316 17:23:36.304712 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-8c5974765-c6tkv" event={"ID":"3624a599-2ea0-41fa-931f-9258d899b82e","Type":"ContainerStarted","Data":"34f41b200d8b95f5496297ee71e6cd239e16f0c575c9610daaf762f0efe4648c"} Mar 16 17:23:36 crc kubenswrapper[5120]: I0316 17:23:36.305295 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-8c5974765-c6tkv" Mar 16 17:23:36 crc kubenswrapper[5120]: I0316 17:23:36.339617 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-8c5974765-c6tkv" podStartSLOduration=3.339588005 podStartE2EDuration="3.339588005s" podCreationTimestamp="2026-03-16 17:23:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:23:36.327864055 +0000 UTC m=+6718.481795762" watchObservedRunningTime="2026-03-16 17:23:36.339588005 +0000 UTC m=+6718.493519702" Mar 16 17:23:42 crc kubenswrapper[5120]: I0316 17:23:42.315896 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-8c5974765-c6tkv" Mar 16 17:23:42 crc kubenswrapper[5120]: I0316 17:23:42.371200 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-nhfgn"] Mar 16 17:23:42 crc kubenswrapper[5120]: I0316 17:23:42.371441 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-nhfgn" podUID="fdefd288-2f86-4806-871e-df4e61d9b916" containerName="dnsmasq-dns" containerID="cri-o://082e897bacac4ef6fa4ec04f25e62c41a7d386a3fb34ae7f1b9c2e25da121784" gracePeriod=10 Mar 16 17:23:42 crc kubenswrapper[5120]: I0316 17:23:42.743101 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-nhfgn" Mar 16 17:23:42 crc kubenswrapper[5120]: I0316 17:23:42.864459 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pcgv7\" (UniqueName: \"kubernetes.io/projected/fdefd288-2f86-4806-871e-df4e61d9b916-kube-api-access-pcgv7\") pod \"fdefd288-2f86-4806-871e-df4e61d9b916\" (UID: \"fdefd288-2f86-4806-871e-df4e61d9b916\") " Mar 16 17:23:42 crc kubenswrapper[5120]: I0316 17:23:42.864626 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/fdefd288-2f86-4806-871e-df4e61d9b916-dnsmasq-svc\") pod \"fdefd288-2f86-4806-871e-df4e61d9b916\" (UID: \"fdefd288-2f86-4806-871e-df4e61d9b916\") " Mar 16 17:23:42 crc kubenswrapper[5120]: I0316 17:23:42.864796 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fdefd288-2f86-4806-871e-df4e61d9b916-config\") pod \"fdefd288-2f86-4806-871e-df4e61d9b916\" (UID: \"fdefd288-2f86-4806-871e-df4e61d9b916\") " Mar 16 17:23:42 crc kubenswrapper[5120]: I0316 17:23:42.866528 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/download-cache-edpm-compute-no-nodes-edpm-compute-no-nodesbgvvh"] Mar 16 17:23:42 crc kubenswrapper[5120]: I0316 17:23:42.867947 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fdefd288-2f86-4806-871e-df4e61d9b916" containerName="init" Mar 16 17:23:42 crc kubenswrapper[5120]: I0316 17:23:42.867994 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="fdefd288-2f86-4806-871e-df4e61d9b916" containerName="init" Mar 16 17:23:42 crc kubenswrapper[5120]: I0316 17:23:42.868020 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fdefd288-2f86-4806-871e-df4e61d9b916" containerName="dnsmasq-dns" Mar 16 17:23:42 crc kubenswrapper[5120]: I0316 17:23:42.868028 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="fdefd288-2f86-4806-871e-df4e61d9b916" containerName="dnsmasq-dns" Mar 16 17:23:42 crc kubenswrapper[5120]: I0316 17:23:42.868199 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="fdefd288-2f86-4806-871e-df4e61d9b916" containerName="dnsmasq-dns" Mar 16 17:23:42 crc kubenswrapper[5120]: I0316 17:23:42.872117 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fdefd288-2f86-4806-871e-df4e61d9b916-kube-api-access-pcgv7" (OuterVolumeSpecName: "kube-api-access-pcgv7") pod "fdefd288-2f86-4806-871e-df4e61d9b916" (UID: "fdefd288-2f86-4806-871e-df4e61d9b916"). InnerVolumeSpecName "kube-api-access-pcgv7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:23:42 crc kubenswrapper[5120]: I0316 17:23:42.873308 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/download-cache-edpm-compute-no-nodes-edpm-compute-no-nodesbgvvh" Mar 16 17:23:42 crc kubenswrapper[5120]: I0316 17:23:42.875204 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-aee-default-env\"" Mar 16 17:23:42 crc kubenswrapper[5120]: I0316 17:23:42.875547 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplane-ansible-ssh-private-key-secret\"" Mar 16 17:23:42 crc kubenswrapper[5120]: I0316 17:23:42.875715 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplanenodeset-edpm-compute-no-nodes\"" Mar 16 17:23:42 crc kubenswrapper[5120]: I0316 17:23:42.875864 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"edpm-compute-no-nodes-dockercfg-znndh\"" Mar 16 17:23:42 crc kubenswrapper[5120]: I0316 17:23:42.876295 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/download-cache-edpm-compute-no-nodes-edpm-compute-no-nodesbgvvh"] Mar 16 17:23:42 crc kubenswrapper[5120]: I0316 17:23:42.906277 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fdefd288-2f86-4806-871e-df4e61d9b916-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "fdefd288-2f86-4806-871e-df4e61d9b916" (UID: "fdefd288-2f86-4806-871e-df4e61d9b916"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:23:42 crc kubenswrapper[5120]: I0316 17:23:42.914024 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fdefd288-2f86-4806-871e-df4e61d9b916-config" (OuterVolumeSpecName: "config") pod "fdefd288-2f86-4806-871e-df4e61d9b916" (UID: "fdefd288-2f86-4806-871e-df4e61d9b916"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:23:42 crc kubenswrapper[5120]: I0316 17:23:42.967058 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/a99fad38-e89e-490c-9443-4a0e67d529cf-ssh-key-edpm-compute-no-nodes\") pod \"download-cache-edpm-compute-no-nodes-edpm-compute-no-nodesbgvvh\" (UID: \"a99fad38-e89e-490c-9443-4a0e67d529cf\") " pod="openstack-kuttl-tests/download-cache-edpm-compute-no-nodes-edpm-compute-no-nodesbgvvh" Mar 16 17:23:42 crc kubenswrapper[5120]: I0316 17:23:42.967456 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gx6fk\" (UniqueName: \"kubernetes.io/projected/a99fad38-e89e-490c-9443-4a0e67d529cf-kube-api-access-gx6fk\") pod \"download-cache-edpm-compute-no-nodes-edpm-compute-no-nodesbgvvh\" (UID: \"a99fad38-e89e-490c-9443-4a0e67d529cf\") " pod="openstack-kuttl-tests/download-cache-edpm-compute-no-nodes-edpm-compute-no-nodesbgvvh" Mar 16 17:23:42 crc kubenswrapper[5120]: I0316 17:23:42.967703 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/a99fad38-e89e-490c-9443-4a0e67d529cf-inventory\") pod \"download-cache-edpm-compute-no-nodes-edpm-compute-no-nodesbgvvh\" (UID: \"a99fad38-e89e-490c-9443-4a0e67d529cf\") " pod="openstack-kuttl-tests/download-cache-edpm-compute-no-nodes-edpm-compute-no-nodesbgvvh" Mar 16 17:23:42 crc kubenswrapper[5120]: I0316 17:23:42.967943 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pcgv7\" (UniqueName: \"kubernetes.io/projected/fdefd288-2f86-4806-871e-df4e61d9b916-kube-api-access-pcgv7\") on node \"crc\" DevicePath \"\"" Mar 16 17:23:42 crc kubenswrapper[5120]: I0316 17:23:42.967969 5120 reconciler_common.go:299] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/fdefd288-2f86-4806-871e-df4e61d9b916-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Mar 16 17:23:42 crc kubenswrapper[5120]: I0316 17:23:42.967980 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fdefd288-2f86-4806-871e-df4e61d9b916-config\") on node \"crc\" DevicePath \"\"" Mar 16 17:23:43 crc kubenswrapper[5120]: I0316 17:23:43.069465 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/a99fad38-e89e-490c-9443-4a0e67d529cf-ssh-key-edpm-compute-no-nodes\") pod \"download-cache-edpm-compute-no-nodes-edpm-compute-no-nodesbgvvh\" (UID: \"a99fad38-e89e-490c-9443-4a0e67d529cf\") " pod="openstack-kuttl-tests/download-cache-edpm-compute-no-nodes-edpm-compute-no-nodesbgvvh" Mar 16 17:23:43 crc kubenswrapper[5120]: I0316 17:23:43.069781 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gx6fk\" (UniqueName: \"kubernetes.io/projected/a99fad38-e89e-490c-9443-4a0e67d529cf-kube-api-access-gx6fk\") pod \"download-cache-edpm-compute-no-nodes-edpm-compute-no-nodesbgvvh\" (UID: \"a99fad38-e89e-490c-9443-4a0e67d529cf\") " pod="openstack-kuttl-tests/download-cache-edpm-compute-no-nodes-edpm-compute-no-nodesbgvvh" Mar 16 17:23:43 crc kubenswrapper[5120]: I0316 17:23:43.069943 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/a99fad38-e89e-490c-9443-4a0e67d529cf-inventory\") pod \"download-cache-edpm-compute-no-nodes-edpm-compute-no-nodesbgvvh\" (UID: \"a99fad38-e89e-490c-9443-4a0e67d529cf\") " pod="openstack-kuttl-tests/download-cache-edpm-compute-no-nodes-edpm-compute-no-nodesbgvvh" Mar 16 17:23:43 crc kubenswrapper[5120]: I0316 17:23:43.075196 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/a99fad38-e89e-490c-9443-4a0e67d529cf-inventory\") pod \"download-cache-edpm-compute-no-nodes-edpm-compute-no-nodesbgvvh\" (UID: \"a99fad38-e89e-490c-9443-4a0e67d529cf\") " pod="openstack-kuttl-tests/download-cache-edpm-compute-no-nodes-edpm-compute-no-nodesbgvvh" Mar 16 17:23:43 crc kubenswrapper[5120]: I0316 17:23:43.075488 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/a99fad38-e89e-490c-9443-4a0e67d529cf-ssh-key-edpm-compute-no-nodes\") pod \"download-cache-edpm-compute-no-nodes-edpm-compute-no-nodesbgvvh\" (UID: \"a99fad38-e89e-490c-9443-4a0e67d529cf\") " pod="openstack-kuttl-tests/download-cache-edpm-compute-no-nodes-edpm-compute-no-nodesbgvvh" Mar 16 17:23:43 crc kubenswrapper[5120]: I0316 17:23:43.085561 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gx6fk\" (UniqueName: \"kubernetes.io/projected/a99fad38-e89e-490c-9443-4a0e67d529cf-kube-api-access-gx6fk\") pod \"download-cache-edpm-compute-no-nodes-edpm-compute-no-nodesbgvvh\" (UID: \"a99fad38-e89e-490c-9443-4a0e67d529cf\") " pod="openstack-kuttl-tests/download-cache-edpm-compute-no-nodes-edpm-compute-no-nodesbgvvh" Mar 16 17:23:43 crc kubenswrapper[5120]: I0316 17:23:43.246561 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/download-cache-edpm-compute-no-nodes-edpm-compute-no-nodesbgvvh" Mar 16 17:23:43 crc kubenswrapper[5120]: I0316 17:23:43.401124 5120 generic.go:358] "Generic (PLEG): container finished" podID="fdefd288-2f86-4806-871e-df4e61d9b916" containerID="082e897bacac4ef6fa4ec04f25e62c41a7d386a3fb34ae7f1b9c2e25da121784" exitCode=0 Mar 16 17:23:43 crc kubenswrapper[5120]: I0316 17:23:43.401225 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-nhfgn" Mar 16 17:23:43 crc kubenswrapper[5120]: I0316 17:23:43.401221 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-nhfgn" event={"ID":"fdefd288-2f86-4806-871e-df4e61d9b916","Type":"ContainerDied","Data":"082e897bacac4ef6fa4ec04f25e62c41a7d386a3fb34ae7f1b9c2e25da121784"} Mar 16 17:23:43 crc kubenswrapper[5120]: I0316 17:23:43.401483 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-nhfgn" event={"ID":"fdefd288-2f86-4806-871e-df4e61d9b916","Type":"ContainerDied","Data":"1c8f764110b02ae8416be9ba017c69a3706e36bfda845e50165d5665f1316fa9"} Mar 16 17:23:43 crc kubenswrapper[5120]: I0316 17:23:43.401556 5120 scope.go:117] "RemoveContainer" containerID="082e897bacac4ef6fa4ec04f25e62c41a7d386a3fb34ae7f1b9c2e25da121784" Mar 16 17:23:43 crc kubenswrapper[5120]: I0316 17:23:43.431031 5120 scope.go:117] "RemoveContainer" containerID="2d5b8b82ae926f14e0b99d2f0e7f69d423d13d6985341bdb4ae4655231877411" Mar 16 17:23:43 crc kubenswrapper[5120]: I0316 17:23:43.437522 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-nhfgn"] Mar 16 17:23:43 crc kubenswrapper[5120]: I0316 17:23:43.445973 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-nhfgn"] Mar 16 17:23:43 crc kubenswrapper[5120]: I0316 17:23:43.471290 5120 scope.go:117] "RemoveContainer" containerID="082e897bacac4ef6fa4ec04f25e62c41a7d386a3fb34ae7f1b9c2e25da121784" Mar 16 17:23:43 crc kubenswrapper[5120]: E0316 17:23:43.475856 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"082e897bacac4ef6fa4ec04f25e62c41a7d386a3fb34ae7f1b9c2e25da121784\": container with ID starting with 082e897bacac4ef6fa4ec04f25e62c41a7d386a3fb34ae7f1b9c2e25da121784 not found: ID does not exist" containerID="082e897bacac4ef6fa4ec04f25e62c41a7d386a3fb34ae7f1b9c2e25da121784" Mar 16 17:23:43 crc kubenswrapper[5120]: I0316 17:23:43.475892 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"082e897bacac4ef6fa4ec04f25e62c41a7d386a3fb34ae7f1b9c2e25da121784"} err="failed to get container status \"082e897bacac4ef6fa4ec04f25e62c41a7d386a3fb34ae7f1b9c2e25da121784\": rpc error: code = NotFound desc = could not find container \"082e897bacac4ef6fa4ec04f25e62c41a7d386a3fb34ae7f1b9c2e25da121784\": container with ID starting with 082e897bacac4ef6fa4ec04f25e62c41a7d386a3fb34ae7f1b9c2e25da121784 not found: ID does not exist" Mar 16 17:23:43 crc kubenswrapper[5120]: I0316 17:23:43.475914 5120 scope.go:117] "RemoveContainer" containerID="2d5b8b82ae926f14e0b99d2f0e7f69d423d13d6985341bdb4ae4655231877411" Mar 16 17:23:43 crc kubenswrapper[5120]: E0316 17:23:43.476242 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d5b8b82ae926f14e0b99d2f0e7f69d423d13d6985341bdb4ae4655231877411\": container with ID starting with 2d5b8b82ae926f14e0b99d2f0e7f69d423d13d6985341bdb4ae4655231877411 not found: ID does not exist" containerID="2d5b8b82ae926f14e0b99d2f0e7f69d423d13d6985341bdb4ae4655231877411" Mar 16 17:23:43 crc kubenswrapper[5120]: I0316 17:23:43.476287 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d5b8b82ae926f14e0b99d2f0e7f69d423d13d6985341bdb4ae4655231877411"} err="failed to get container status \"2d5b8b82ae926f14e0b99d2f0e7f69d423d13d6985341bdb4ae4655231877411\": rpc error: code = NotFound desc = could not find container \"2d5b8b82ae926f14e0b99d2f0e7f69d423d13d6985341bdb4ae4655231877411\": container with ID starting with 2d5b8b82ae926f14e0b99d2f0e7f69d423d13d6985341bdb4ae4655231877411 not found: ID does not exist" Mar 16 17:23:43 crc kubenswrapper[5120]: I0316 17:23:43.714909 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/download-cache-edpm-compute-no-nodes-edpm-compute-no-nodesbgvvh"] Mar 16 17:23:43 crc kubenswrapper[5120]: W0316 17:23:43.720795 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda99fad38_e89e_490c_9443_4a0e67d529cf.slice/crio-4b5fbdc5e754d989c958297963daa8baf30b9365d56ef71c94174ca07fd42b54 WatchSource:0}: Error finding container 4b5fbdc5e754d989c958297963daa8baf30b9365d56ef71c94174ca07fd42b54: Status 404 returned error can't find the container with id 4b5fbdc5e754d989c958297963daa8baf30b9365d56ef71c94174ca07fd42b54 Mar 16 17:23:44 crc kubenswrapper[5120]: I0316 17:23:44.414530 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/download-cache-edpm-compute-no-nodes-edpm-compute-no-nodesbgvvh" event={"ID":"a99fad38-e89e-490c-9443-4a0e67d529cf","Type":"ContainerStarted","Data":"4b5fbdc5e754d989c958297963daa8baf30b9365d56ef71c94174ca07fd42b54"} Mar 16 17:23:44 crc kubenswrapper[5120]: I0316 17:23:44.437102 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/download-cache-edpm-compute-no-nodes-edpm-compute-no-nodesbgvvh" podStartSLOduration=1.9433500590000001 podStartE2EDuration="2.437085931s" podCreationTimestamp="2026-03-16 17:23:42 +0000 UTC" firstStartedPulling="2026-03-16 17:23:43.722419672 +0000 UTC m=+6725.876351329" lastFinishedPulling="2026-03-16 17:23:44.216155544 +0000 UTC m=+6726.370087201" observedRunningTime="2026-03-16 17:23:44.430501101 +0000 UTC m=+6726.584432768" watchObservedRunningTime="2026-03-16 17:23:44.437085931 +0000 UTC m=+6726.591017588" Mar 16 17:23:44 crc kubenswrapper[5120]: I0316 17:23:44.679894 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fdefd288-2f86-4806-871e-df4e61d9b916" path="/var/lib/kubelet/pods/fdefd288-2f86-4806-871e-df4e61d9b916/volumes" Mar 16 17:23:45 crc kubenswrapper[5120]: I0316 17:23:45.424926 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/download-cache-edpm-compute-no-nodes-edpm-compute-no-nodesbgvvh" event={"ID":"a99fad38-e89e-490c-9443-4a0e67d529cf","Type":"ContainerStarted","Data":"3adccde65dcd749026902ec6beb68d640652a344128bdb472228faf8780cfd35"} Mar 16 17:23:46 crc kubenswrapper[5120]: I0316 17:23:46.441461 5120 generic.go:358] "Generic (PLEG): container finished" podID="a99fad38-e89e-490c-9443-4a0e67d529cf" containerID="3adccde65dcd749026902ec6beb68d640652a344128bdb472228faf8780cfd35" exitCode=0 Mar 16 17:23:46 crc kubenswrapper[5120]: I0316 17:23:46.441546 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/download-cache-edpm-compute-no-nodes-edpm-compute-no-nodesbgvvh" event={"ID":"a99fad38-e89e-490c-9443-4a0e67d529cf","Type":"ContainerDied","Data":"3adccde65dcd749026902ec6beb68d640652a344128bdb472228faf8780cfd35"} Mar 16 17:23:47 crc kubenswrapper[5120]: I0316 17:23:47.751550 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/download-cache-edpm-compute-no-nodes-edpm-compute-no-nodesbgvvh" Mar 16 17:23:47 crc kubenswrapper[5120]: I0316 17:23:47.789539 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gx6fk\" (UniqueName: \"kubernetes.io/projected/a99fad38-e89e-490c-9443-4a0e67d529cf-kube-api-access-gx6fk\") pod \"a99fad38-e89e-490c-9443-4a0e67d529cf\" (UID: \"a99fad38-e89e-490c-9443-4a0e67d529cf\") " Mar 16 17:23:47 crc kubenswrapper[5120]: I0316 17:23:47.789689 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/a99fad38-e89e-490c-9443-4a0e67d529cf-inventory\") pod \"a99fad38-e89e-490c-9443-4a0e67d529cf\" (UID: \"a99fad38-e89e-490c-9443-4a0e67d529cf\") " Mar 16 17:23:47 crc kubenswrapper[5120]: I0316 17:23:47.790092 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/a99fad38-e89e-490c-9443-4a0e67d529cf-ssh-key-edpm-compute-no-nodes\") pod \"a99fad38-e89e-490c-9443-4a0e67d529cf\" (UID: \"a99fad38-e89e-490c-9443-4a0e67d529cf\") " Mar 16 17:23:47 crc kubenswrapper[5120]: I0316 17:23:47.795828 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a99fad38-e89e-490c-9443-4a0e67d529cf-kube-api-access-gx6fk" (OuterVolumeSpecName: "kube-api-access-gx6fk") pod "a99fad38-e89e-490c-9443-4a0e67d529cf" (UID: "a99fad38-e89e-490c-9443-4a0e67d529cf"). InnerVolumeSpecName "kube-api-access-gx6fk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:23:47 crc kubenswrapper[5120]: I0316 17:23:47.811049 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a99fad38-e89e-490c-9443-4a0e67d529cf-ssh-key-edpm-compute-no-nodes" (OuterVolumeSpecName: "ssh-key-edpm-compute-no-nodes") pod "a99fad38-e89e-490c-9443-4a0e67d529cf" (UID: "a99fad38-e89e-490c-9443-4a0e67d529cf"). InnerVolumeSpecName "ssh-key-edpm-compute-no-nodes". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:23:47 crc kubenswrapper[5120]: I0316 17:23:47.817134 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a99fad38-e89e-490c-9443-4a0e67d529cf-inventory" (OuterVolumeSpecName: "inventory") pod "a99fad38-e89e-490c-9443-4a0e67d529cf" (UID: "a99fad38-e89e-490c-9443-4a0e67d529cf"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:23:47 crc kubenswrapper[5120]: I0316 17:23:47.892362 5120 reconciler_common.go:299] "Volume detached for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/a99fad38-e89e-490c-9443-4a0e67d529cf-ssh-key-edpm-compute-no-nodes\") on node \"crc\" DevicePath \"\"" Mar 16 17:23:47 crc kubenswrapper[5120]: I0316 17:23:47.892733 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gx6fk\" (UniqueName: \"kubernetes.io/projected/a99fad38-e89e-490c-9443-4a0e67d529cf-kube-api-access-gx6fk\") on node \"crc\" DevicePath \"\"" Mar 16 17:23:47 crc kubenswrapper[5120]: I0316 17:23:47.892754 5120 reconciler_common.go:299] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/a99fad38-e89e-490c-9443-4a0e67d529cf-inventory\") on node \"crc\" DevicePath \"\"" Mar 16 17:23:48 crc kubenswrapper[5120]: I0316 17:23:48.461228 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/download-cache-edpm-compute-no-nodes-edpm-compute-no-nodesbgvvh" Mar 16 17:23:48 crc kubenswrapper[5120]: I0316 17:23:48.461295 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/download-cache-edpm-compute-no-nodes-edpm-compute-no-nodesbgvvh" event={"ID":"a99fad38-e89e-490c-9443-4a0e67d529cf","Type":"ContainerDied","Data":"4b5fbdc5e754d989c958297963daa8baf30b9365d56ef71c94174ca07fd42b54"} Mar 16 17:23:48 crc kubenswrapper[5120]: I0316 17:23:48.461357 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4b5fbdc5e754d989c958297963daa8baf30b9365d56ef71c94174ca07fd42b54" Mar 16 17:23:48 crc kubenswrapper[5120]: I0316 17:23:48.523965 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/bootstrap-edpm-compute-no-nodes-edpm-compute-no-nodes-xmd29"] Mar 16 17:23:48 crc kubenswrapper[5120]: I0316 17:23:48.525407 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a99fad38-e89e-490c-9443-4a0e67d529cf" containerName="download-cache-edpm-compute-no-nodes-edpm-compute-no-nodes" Mar 16 17:23:48 crc kubenswrapper[5120]: I0316 17:23:48.525431 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a99fad38-e89e-490c-9443-4a0e67d529cf" containerName="download-cache-edpm-compute-no-nodes-edpm-compute-no-nodes" Mar 16 17:23:48 crc kubenswrapper[5120]: I0316 17:23:48.525624 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="a99fad38-e89e-490c-9443-4a0e67d529cf" containerName="download-cache-edpm-compute-no-nodes-edpm-compute-no-nodes" Mar 16 17:23:48 crc kubenswrapper[5120]: I0316 17:23:48.531497 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/bootstrap-edpm-compute-no-nodes-edpm-compute-no-nodes-xmd29" Mar 16 17:23:48 crc kubenswrapper[5120]: I0316 17:23:48.534512 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"combined-ca-bundle\"" Mar 16 17:23:48 crc kubenswrapper[5120]: I0316 17:23:48.534621 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-aee-default-env\"" Mar 16 17:23:48 crc kubenswrapper[5120]: I0316 17:23:48.534910 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplane-ansible-ssh-private-key-secret\"" Mar 16 17:23:48 crc kubenswrapper[5120]: I0316 17:23:48.535186 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"edpm-compute-no-nodes-dockercfg-znndh\"" Mar 16 17:23:48 crc kubenswrapper[5120]: I0316 17:23:48.535236 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplanenodeset-edpm-compute-no-nodes\"" Mar 16 17:23:48 crc kubenswrapper[5120]: I0316 17:23:48.536162 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/bootstrap-edpm-compute-no-nodes-edpm-compute-no-nodes-xmd29"] Mar 16 17:23:48 crc kubenswrapper[5120]: I0316 17:23:48.615855 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8cvpt\" (UniqueName: \"kubernetes.io/projected/2d22c7e3-5552-4214-b5f2-079d55230a97-kube-api-access-8cvpt\") pod \"bootstrap-edpm-compute-no-nodes-edpm-compute-no-nodes-xmd29\" (UID: \"2d22c7e3-5552-4214-b5f2-079d55230a97\") " pod="openstack-kuttl-tests/bootstrap-edpm-compute-no-nodes-edpm-compute-no-nodes-xmd29" Mar 16 17:23:48 crc kubenswrapper[5120]: I0316 17:23:48.616056 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/2d22c7e3-5552-4214-b5f2-079d55230a97-ssh-key-edpm-compute-no-nodes\") pod \"bootstrap-edpm-compute-no-nodes-edpm-compute-no-nodes-xmd29\" (UID: \"2d22c7e3-5552-4214-b5f2-079d55230a97\") " pod="openstack-kuttl-tests/bootstrap-edpm-compute-no-nodes-edpm-compute-no-nodes-xmd29" Mar 16 17:23:48 crc kubenswrapper[5120]: I0316 17:23:48.616155 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/2d22c7e3-5552-4214-b5f2-079d55230a97-inventory\") pod \"bootstrap-edpm-compute-no-nodes-edpm-compute-no-nodes-xmd29\" (UID: \"2d22c7e3-5552-4214-b5f2-079d55230a97\") " pod="openstack-kuttl-tests/bootstrap-edpm-compute-no-nodes-edpm-compute-no-nodes-xmd29" Mar 16 17:23:48 crc kubenswrapper[5120]: I0316 17:23:48.616227 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bootstrap-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2d22c7e3-5552-4214-b5f2-079d55230a97-bootstrap-combined-ca-bundle\") pod \"bootstrap-edpm-compute-no-nodes-edpm-compute-no-nodes-xmd29\" (UID: \"2d22c7e3-5552-4214-b5f2-079d55230a97\") " pod="openstack-kuttl-tests/bootstrap-edpm-compute-no-nodes-edpm-compute-no-nodes-xmd29" Mar 16 17:23:48 crc kubenswrapper[5120]: I0316 17:23:48.717711 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bootstrap-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2d22c7e3-5552-4214-b5f2-079d55230a97-bootstrap-combined-ca-bundle\") pod \"bootstrap-edpm-compute-no-nodes-edpm-compute-no-nodes-xmd29\" (UID: \"2d22c7e3-5552-4214-b5f2-079d55230a97\") " pod="openstack-kuttl-tests/bootstrap-edpm-compute-no-nodes-edpm-compute-no-nodes-xmd29" Mar 16 17:23:48 crc kubenswrapper[5120]: I0316 17:23:48.717971 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8cvpt\" (UniqueName: \"kubernetes.io/projected/2d22c7e3-5552-4214-b5f2-079d55230a97-kube-api-access-8cvpt\") pod \"bootstrap-edpm-compute-no-nodes-edpm-compute-no-nodes-xmd29\" (UID: \"2d22c7e3-5552-4214-b5f2-079d55230a97\") " pod="openstack-kuttl-tests/bootstrap-edpm-compute-no-nodes-edpm-compute-no-nodes-xmd29" Mar 16 17:23:48 crc kubenswrapper[5120]: I0316 17:23:48.718139 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/2d22c7e3-5552-4214-b5f2-079d55230a97-ssh-key-edpm-compute-no-nodes\") pod \"bootstrap-edpm-compute-no-nodes-edpm-compute-no-nodes-xmd29\" (UID: \"2d22c7e3-5552-4214-b5f2-079d55230a97\") " pod="openstack-kuttl-tests/bootstrap-edpm-compute-no-nodes-edpm-compute-no-nodes-xmd29" Mar 16 17:23:48 crc kubenswrapper[5120]: I0316 17:23:48.718274 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/2d22c7e3-5552-4214-b5f2-079d55230a97-inventory\") pod \"bootstrap-edpm-compute-no-nodes-edpm-compute-no-nodes-xmd29\" (UID: \"2d22c7e3-5552-4214-b5f2-079d55230a97\") " pod="openstack-kuttl-tests/bootstrap-edpm-compute-no-nodes-edpm-compute-no-nodes-xmd29" Mar 16 17:23:48 crc kubenswrapper[5120]: I0316 17:23:48.723566 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/2d22c7e3-5552-4214-b5f2-079d55230a97-ssh-key-edpm-compute-no-nodes\") pod \"bootstrap-edpm-compute-no-nodes-edpm-compute-no-nodes-xmd29\" (UID: \"2d22c7e3-5552-4214-b5f2-079d55230a97\") " pod="openstack-kuttl-tests/bootstrap-edpm-compute-no-nodes-edpm-compute-no-nodes-xmd29" Mar 16 17:23:48 crc kubenswrapper[5120]: I0316 17:23:48.724171 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/2d22c7e3-5552-4214-b5f2-079d55230a97-inventory\") pod \"bootstrap-edpm-compute-no-nodes-edpm-compute-no-nodes-xmd29\" (UID: \"2d22c7e3-5552-4214-b5f2-079d55230a97\") " pod="openstack-kuttl-tests/bootstrap-edpm-compute-no-nodes-edpm-compute-no-nodes-xmd29" Mar 16 17:23:48 crc kubenswrapper[5120]: I0316 17:23:48.726308 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bootstrap-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2d22c7e3-5552-4214-b5f2-079d55230a97-bootstrap-combined-ca-bundle\") pod \"bootstrap-edpm-compute-no-nodes-edpm-compute-no-nodes-xmd29\" (UID: \"2d22c7e3-5552-4214-b5f2-079d55230a97\") " pod="openstack-kuttl-tests/bootstrap-edpm-compute-no-nodes-edpm-compute-no-nodes-xmd29" Mar 16 17:23:48 crc kubenswrapper[5120]: I0316 17:23:48.735435 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8cvpt\" (UniqueName: \"kubernetes.io/projected/2d22c7e3-5552-4214-b5f2-079d55230a97-kube-api-access-8cvpt\") pod \"bootstrap-edpm-compute-no-nodes-edpm-compute-no-nodes-xmd29\" (UID: \"2d22c7e3-5552-4214-b5f2-079d55230a97\") " pod="openstack-kuttl-tests/bootstrap-edpm-compute-no-nodes-edpm-compute-no-nodes-xmd29" Mar 16 17:23:48 crc kubenswrapper[5120]: I0316 17:23:48.849569 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/bootstrap-edpm-compute-no-nodes-edpm-compute-no-nodes-xmd29" Mar 16 17:23:49 crc kubenswrapper[5120]: I0316 17:23:49.256792 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/bootstrap-edpm-compute-no-nodes-edpm-compute-no-nodes-xmd29"] Mar 16 17:23:49 crc kubenswrapper[5120]: I0316 17:23:49.472917 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/bootstrap-edpm-compute-no-nodes-edpm-compute-no-nodes-xmd29" event={"ID":"2d22c7e3-5552-4214-b5f2-079d55230a97","Type":"ContainerStarted","Data":"b6012837b6e5aaeaabbf67c6c751ce34e3ce51aedddf39e841abd8d9c2bbd857"} Mar 16 17:23:50 crc kubenswrapper[5120]: I0316 17:23:50.483254 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/bootstrap-edpm-compute-no-nodes-edpm-compute-no-nodes-xmd29" event={"ID":"2d22c7e3-5552-4214-b5f2-079d55230a97","Type":"ContainerStarted","Data":"5b96f7557231f5c82b606572833789080e72915189b0f4c12da7de54bb9c6cfc"} Mar 16 17:23:50 crc kubenswrapper[5120]: I0316 17:23:50.503242 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/bootstrap-edpm-compute-no-nodes-edpm-compute-no-nodes-xmd29" podStartSLOduration=2.074671838 podStartE2EDuration="2.503220038s" podCreationTimestamp="2026-03-16 17:23:48 +0000 UTC" firstStartedPulling="2026-03-16 17:23:49.265664683 +0000 UTC m=+6731.419596350" lastFinishedPulling="2026-03-16 17:23:49.694212893 +0000 UTC m=+6731.848144550" observedRunningTime="2026-03-16 17:23:50.494593362 +0000 UTC m=+6732.648525029" watchObservedRunningTime="2026-03-16 17:23:50.503220038 +0000 UTC m=+6732.657151695" Mar 16 17:23:51 crc kubenswrapper[5120]: I0316 17:23:51.500652 5120 generic.go:358] "Generic (PLEG): container finished" podID="2d22c7e3-5552-4214-b5f2-079d55230a97" containerID="5b96f7557231f5c82b606572833789080e72915189b0f4c12da7de54bb9c6cfc" exitCode=0 Mar 16 17:23:51 crc kubenswrapper[5120]: I0316 17:23:51.500731 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/bootstrap-edpm-compute-no-nodes-edpm-compute-no-nodes-xmd29" event={"ID":"2d22c7e3-5552-4214-b5f2-079d55230a97","Type":"ContainerDied","Data":"5b96f7557231f5c82b606572833789080e72915189b0f4c12da7de54bb9c6cfc"} Mar 16 17:23:52 crc kubenswrapper[5120]: I0316 17:23:52.784996 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/bootstrap-edpm-compute-no-nodes-edpm-compute-no-nodes-xmd29" Mar 16 17:23:52 crc kubenswrapper[5120]: I0316 17:23:52.913167 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bootstrap-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2d22c7e3-5552-4214-b5f2-079d55230a97-bootstrap-combined-ca-bundle\") pod \"2d22c7e3-5552-4214-b5f2-079d55230a97\" (UID: \"2d22c7e3-5552-4214-b5f2-079d55230a97\") " Mar 16 17:23:52 crc kubenswrapper[5120]: I0316 17:23:52.913789 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/2d22c7e3-5552-4214-b5f2-079d55230a97-inventory\") pod \"2d22c7e3-5552-4214-b5f2-079d55230a97\" (UID: \"2d22c7e3-5552-4214-b5f2-079d55230a97\") " Mar 16 17:23:52 crc kubenswrapper[5120]: I0316 17:23:52.914109 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8cvpt\" (UniqueName: \"kubernetes.io/projected/2d22c7e3-5552-4214-b5f2-079d55230a97-kube-api-access-8cvpt\") pod \"2d22c7e3-5552-4214-b5f2-079d55230a97\" (UID: \"2d22c7e3-5552-4214-b5f2-079d55230a97\") " Mar 16 17:23:52 crc kubenswrapper[5120]: I0316 17:23:52.914166 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/2d22c7e3-5552-4214-b5f2-079d55230a97-ssh-key-edpm-compute-no-nodes\") pod \"2d22c7e3-5552-4214-b5f2-079d55230a97\" (UID: \"2d22c7e3-5552-4214-b5f2-079d55230a97\") " Mar 16 17:23:52 crc kubenswrapper[5120]: I0316 17:23:52.918782 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d22c7e3-5552-4214-b5f2-079d55230a97-kube-api-access-8cvpt" (OuterVolumeSpecName: "kube-api-access-8cvpt") pod "2d22c7e3-5552-4214-b5f2-079d55230a97" (UID: "2d22c7e3-5552-4214-b5f2-079d55230a97"). InnerVolumeSpecName "kube-api-access-8cvpt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:23:52 crc kubenswrapper[5120]: I0316 17:23:52.918625 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2d22c7e3-5552-4214-b5f2-079d55230a97-bootstrap-combined-ca-bundle" (OuterVolumeSpecName: "bootstrap-combined-ca-bundle") pod "2d22c7e3-5552-4214-b5f2-079d55230a97" (UID: "2d22c7e3-5552-4214-b5f2-079d55230a97"). InnerVolumeSpecName "bootstrap-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:23:52 crc kubenswrapper[5120]: I0316 17:23:52.935227 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2d22c7e3-5552-4214-b5f2-079d55230a97-ssh-key-edpm-compute-no-nodes" (OuterVolumeSpecName: "ssh-key-edpm-compute-no-nodes") pod "2d22c7e3-5552-4214-b5f2-079d55230a97" (UID: "2d22c7e3-5552-4214-b5f2-079d55230a97"). InnerVolumeSpecName "ssh-key-edpm-compute-no-nodes". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:23:52 crc kubenswrapper[5120]: I0316 17:23:52.935505 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2d22c7e3-5552-4214-b5f2-079d55230a97-inventory" (OuterVolumeSpecName: "inventory") pod "2d22c7e3-5552-4214-b5f2-079d55230a97" (UID: "2d22c7e3-5552-4214-b5f2-079d55230a97"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:23:53 crc kubenswrapper[5120]: I0316 17:23:53.017234 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8cvpt\" (UniqueName: \"kubernetes.io/projected/2d22c7e3-5552-4214-b5f2-079d55230a97-kube-api-access-8cvpt\") on node \"crc\" DevicePath \"\"" Mar 16 17:23:53 crc kubenswrapper[5120]: I0316 17:23:53.017271 5120 reconciler_common.go:299] "Volume detached for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/2d22c7e3-5552-4214-b5f2-079d55230a97-ssh-key-edpm-compute-no-nodes\") on node \"crc\" DevicePath \"\"" Mar 16 17:23:53 crc kubenswrapper[5120]: I0316 17:23:53.017288 5120 reconciler_common.go:299] "Volume detached for volume \"bootstrap-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2d22c7e3-5552-4214-b5f2-079d55230a97-bootstrap-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:23:53 crc kubenswrapper[5120]: I0316 17:23:53.017344 5120 reconciler_common.go:299] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/2d22c7e3-5552-4214-b5f2-079d55230a97-inventory\") on node \"crc\" DevicePath \"\"" Mar 16 17:23:53 crc kubenswrapper[5120]: I0316 17:23:53.525980 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/bootstrap-edpm-compute-no-nodes-edpm-compute-no-nodes-xmd29" Mar 16 17:23:53 crc kubenswrapper[5120]: I0316 17:23:53.525979 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/bootstrap-edpm-compute-no-nodes-edpm-compute-no-nodes-xmd29" event={"ID":"2d22c7e3-5552-4214-b5f2-079d55230a97","Type":"ContainerDied","Data":"b6012837b6e5aaeaabbf67c6c751ce34e3ce51aedddf39e841abd8d9c2bbd857"} Mar 16 17:23:53 crc kubenswrapper[5120]: I0316 17:23:53.526107 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b6012837b6e5aaeaabbf67c6c751ce34e3ce51aedddf39e841abd8d9c2bbd857" Mar 16 17:23:53 crc kubenswrapper[5120]: I0316 17:23:53.577785 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/configure-network-edpm-compute-no-nodes-edpm-compute-no-noszw6z"] Mar 16 17:23:53 crc kubenswrapper[5120]: I0316 17:23:53.578947 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d22c7e3-5552-4214-b5f2-079d55230a97" containerName="bootstrap-edpm-compute-no-nodes-edpm-compute-no-nodes" Mar 16 17:23:53 crc kubenswrapper[5120]: I0316 17:23:53.579067 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d22c7e3-5552-4214-b5f2-079d55230a97" containerName="bootstrap-edpm-compute-no-nodes-edpm-compute-no-nodes" Mar 16 17:23:53 crc kubenswrapper[5120]: I0316 17:23:53.579295 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="2d22c7e3-5552-4214-b5f2-079d55230a97" containerName="bootstrap-edpm-compute-no-nodes-edpm-compute-no-nodes" Mar 16 17:23:53 crc kubenswrapper[5120]: I0316 17:23:53.585075 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/configure-network-edpm-compute-no-nodes-edpm-compute-no-noszw6z" Mar 16 17:23:53 crc kubenswrapper[5120]: I0316 17:23:53.585658 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/configure-network-edpm-compute-no-nodes-edpm-compute-no-noszw6z"] Mar 16 17:23:53 crc kubenswrapper[5120]: I0316 17:23:53.587350 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"edpm-compute-no-nodes-dockercfg-znndh\"" Mar 16 17:23:53 crc kubenswrapper[5120]: I0316 17:23:53.587358 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplanenodeset-edpm-compute-no-nodes\"" Mar 16 17:23:53 crc kubenswrapper[5120]: I0316 17:23:53.587560 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplane-ansible-ssh-private-key-secret\"" Mar 16 17:23:53 crc kubenswrapper[5120]: I0316 17:23:53.587709 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-aee-default-env\"" Mar 16 17:23:53 crc kubenswrapper[5120]: I0316 17:23:53.731968 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/0e81067f-3b6a-4704-bd56-f972dccc60f9-ssh-key-edpm-compute-no-nodes\") pod \"configure-network-edpm-compute-no-nodes-edpm-compute-no-noszw6z\" (UID: \"0e81067f-3b6a-4704-bd56-f972dccc60f9\") " pod="openstack-kuttl-tests/configure-network-edpm-compute-no-nodes-edpm-compute-no-noszw6z" Mar 16 17:23:53 crc kubenswrapper[5120]: I0316 17:23:53.732018 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hmcx\" (UniqueName: \"kubernetes.io/projected/0e81067f-3b6a-4704-bd56-f972dccc60f9-kube-api-access-7hmcx\") pod \"configure-network-edpm-compute-no-nodes-edpm-compute-no-noszw6z\" (UID: \"0e81067f-3b6a-4704-bd56-f972dccc60f9\") " pod="openstack-kuttl-tests/configure-network-edpm-compute-no-nodes-edpm-compute-no-noszw6z" Mar 16 17:23:53 crc kubenswrapper[5120]: I0316 17:23:53.732177 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/0e81067f-3b6a-4704-bd56-f972dccc60f9-inventory\") pod \"configure-network-edpm-compute-no-nodes-edpm-compute-no-noszw6z\" (UID: \"0e81067f-3b6a-4704-bd56-f972dccc60f9\") " pod="openstack-kuttl-tests/configure-network-edpm-compute-no-nodes-edpm-compute-no-noszw6z" Mar 16 17:23:53 crc kubenswrapper[5120]: I0316 17:23:53.834207 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/0e81067f-3b6a-4704-bd56-f972dccc60f9-inventory\") pod \"configure-network-edpm-compute-no-nodes-edpm-compute-no-noszw6z\" (UID: \"0e81067f-3b6a-4704-bd56-f972dccc60f9\") " pod="openstack-kuttl-tests/configure-network-edpm-compute-no-nodes-edpm-compute-no-noszw6z" Mar 16 17:23:53 crc kubenswrapper[5120]: I0316 17:23:53.835373 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/0e81067f-3b6a-4704-bd56-f972dccc60f9-ssh-key-edpm-compute-no-nodes\") pod \"configure-network-edpm-compute-no-nodes-edpm-compute-no-noszw6z\" (UID: \"0e81067f-3b6a-4704-bd56-f972dccc60f9\") " pod="openstack-kuttl-tests/configure-network-edpm-compute-no-nodes-edpm-compute-no-noszw6z" Mar 16 17:23:53 crc kubenswrapper[5120]: I0316 17:23:53.835443 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7hmcx\" (UniqueName: \"kubernetes.io/projected/0e81067f-3b6a-4704-bd56-f972dccc60f9-kube-api-access-7hmcx\") pod \"configure-network-edpm-compute-no-nodes-edpm-compute-no-noszw6z\" (UID: \"0e81067f-3b6a-4704-bd56-f972dccc60f9\") " pod="openstack-kuttl-tests/configure-network-edpm-compute-no-nodes-edpm-compute-no-noszw6z" Mar 16 17:23:53 crc kubenswrapper[5120]: I0316 17:23:53.849789 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/0e81067f-3b6a-4704-bd56-f972dccc60f9-inventory\") pod \"configure-network-edpm-compute-no-nodes-edpm-compute-no-noszw6z\" (UID: \"0e81067f-3b6a-4704-bd56-f972dccc60f9\") " pod="openstack-kuttl-tests/configure-network-edpm-compute-no-nodes-edpm-compute-no-noszw6z" Mar 16 17:23:53 crc kubenswrapper[5120]: I0316 17:23:53.849801 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/0e81067f-3b6a-4704-bd56-f972dccc60f9-ssh-key-edpm-compute-no-nodes\") pod \"configure-network-edpm-compute-no-nodes-edpm-compute-no-noszw6z\" (UID: \"0e81067f-3b6a-4704-bd56-f972dccc60f9\") " pod="openstack-kuttl-tests/configure-network-edpm-compute-no-nodes-edpm-compute-no-noszw6z" Mar 16 17:23:53 crc kubenswrapper[5120]: I0316 17:23:53.855529 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hmcx\" (UniqueName: \"kubernetes.io/projected/0e81067f-3b6a-4704-bd56-f972dccc60f9-kube-api-access-7hmcx\") pod \"configure-network-edpm-compute-no-nodes-edpm-compute-no-noszw6z\" (UID: \"0e81067f-3b6a-4704-bd56-f972dccc60f9\") " pod="openstack-kuttl-tests/configure-network-edpm-compute-no-nodes-edpm-compute-no-noszw6z" Mar 16 17:23:53 crc kubenswrapper[5120]: I0316 17:23:53.902302 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/configure-network-edpm-compute-no-nodes-edpm-compute-no-noszw6z" Mar 16 17:23:54 crc kubenswrapper[5120]: I0316 17:23:54.328618 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/configure-network-edpm-compute-no-nodes-edpm-compute-no-noszw6z"] Mar 16 17:23:54 crc kubenswrapper[5120]: W0316 17:23:54.331505 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0e81067f_3b6a_4704_bd56_f972dccc60f9.slice/crio-b05ab5df863b7fb2c11e6ae440353d8ddca1fccb902461ec47f3d86c42190754 WatchSource:0}: Error finding container b05ab5df863b7fb2c11e6ae440353d8ddca1fccb902461ec47f3d86c42190754: Status 404 returned error can't find the container with id b05ab5df863b7fb2c11e6ae440353d8ddca1fccb902461ec47f3d86c42190754 Mar 16 17:23:54 crc kubenswrapper[5120]: I0316 17:23:54.537608 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/configure-network-edpm-compute-no-nodes-edpm-compute-no-noszw6z" event={"ID":"0e81067f-3b6a-4704-bd56-f972dccc60f9","Type":"ContainerStarted","Data":"b05ab5df863b7fb2c11e6ae440353d8ddca1fccb902461ec47f3d86c42190754"} Mar 16 17:23:56 crc kubenswrapper[5120]: I0316 17:23:56.554613 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/configure-network-edpm-compute-no-nodes-edpm-compute-no-noszw6z" event={"ID":"0e81067f-3b6a-4704-bd56-f972dccc60f9","Type":"ContainerStarted","Data":"3fda4b581efcd28634715cf60dee717fc3337938c7742009210a9ee14778b476"} Mar 16 17:23:56 crc kubenswrapper[5120]: I0316 17:23:56.584902 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/configure-network-edpm-compute-no-nodes-edpm-compute-no-noszw6z" podStartSLOduration=2.179856217 podStartE2EDuration="3.58487893s" podCreationTimestamp="2026-03-16 17:23:53 +0000 UTC" firstStartedPulling="2026-03-16 17:23:54.333586253 +0000 UTC m=+6736.487517910" lastFinishedPulling="2026-03-16 17:23:55.738608966 +0000 UTC m=+6737.892540623" observedRunningTime="2026-03-16 17:23:56.578135595 +0000 UTC m=+6738.732067282" watchObservedRunningTime="2026-03-16 17:23:56.58487893 +0000 UTC m=+6738.738810607" Mar 16 17:23:57 crc kubenswrapper[5120]: I0316 17:23:57.565167 5120 generic.go:358] "Generic (PLEG): container finished" podID="0e81067f-3b6a-4704-bd56-f972dccc60f9" containerID="3fda4b581efcd28634715cf60dee717fc3337938c7742009210a9ee14778b476" exitCode=0 Mar 16 17:23:57 crc kubenswrapper[5120]: I0316 17:23:57.565230 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/configure-network-edpm-compute-no-nodes-edpm-compute-no-noszw6z" event={"ID":"0e81067f-3b6a-4704-bd56-f972dccc60f9","Type":"ContainerDied","Data":"3fda4b581efcd28634715cf60dee717fc3337938c7742009210a9ee14778b476"} Mar 16 17:23:58 crc kubenswrapper[5120]: I0316 17:23:58.867192 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/configure-network-edpm-compute-no-nodes-edpm-compute-no-noszw6z" Mar 16 17:23:58 crc kubenswrapper[5120]: I0316 17:23:58.946600 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/0e81067f-3b6a-4704-bd56-f972dccc60f9-inventory\") pod \"0e81067f-3b6a-4704-bd56-f972dccc60f9\" (UID: \"0e81067f-3b6a-4704-bd56-f972dccc60f9\") " Mar 16 17:23:58 crc kubenswrapper[5120]: I0316 17:23:58.947007 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/0e81067f-3b6a-4704-bd56-f972dccc60f9-ssh-key-edpm-compute-no-nodes\") pod \"0e81067f-3b6a-4704-bd56-f972dccc60f9\" (UID: \"0e81067f-3b6a-4704-bd56-f972dccc60f9\") " Mar 16 17:23:58 crc kubenswrapper[5120]: I0316 17:23:58.947049 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7hmcx\" (UniqueName: \"kubernetes.io/projected/0e81067f-3b6a-4704-bd56-f972dccc60f9-kube-api-access-7hmcx\") pod \"0e81067f-3b6a-4704-bd56-f972dccc60f9\" (UID: \"0e81067f-3b6a-4704-bd56-f972dccc60f9\") " Mar 16 17:23:58 crc kubenswrapper[5120]: I0316 17:23:58.953243 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e81067f-3b6a-4704-bd56-f972dccc60f9-kube-api-access-7hmcx" (OuterVolumeSpecName: "kube-api-access-7hmcx") pod "0e81067f-3b6a-4704-bd56-f972dccc60f9" (UID: "0e81067f-3b6a-4704-bd56-f972dccc60f9"). InnerVolumeSpecName "kube-api-access-7hmcx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:23:58 crc kubenswrapper[5120]: I0316 17:23:58.968303 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e81067f-3b6a-4704-bd56-f972dccc60f9-ssh-key-edpm-compute-no-nodes" (OuterVolumeSpecName: "ssh-key-edpm-compute-no-nodes") pod "0e81067f-3b6a-4704-bd56-f972dccc60f9" (UID: "0e81067f-3b6a-4704-bd56-f972dccc60f9"). InnerVolumeSpecName "ssh-key-edpm-compute-no-nodes". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:23:58 crc kubenswrapper[5120]: I0316 17:23:58.973086 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e81067f-3b6a-4704-bd56-f972dccc60f9-inventory" (OuterVolumeSpecName: "inventory") pod "0e81067f-3b6a-4704-bd56-f972dccc60f9" (UID: "0e81067f-3b6a-4704-bd56-f972dccc60f9"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:23:59 crc kubenswrapper[5120]: I0316 17:23:59.049922 5120 reconciler_common.go:299] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/0e81067f-3b6a-4704-bd56-f972dccc60f9-inventory\") on node \"crc\" DevicePath \"\"" Mar 16 17:23:59 crc kubenswrapper[5120]: I0316 17:23:59.050142 5120 reconciler_common.go:299] "Volume detached for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/0e81067f-3b6a-4704-bd56-f972dccc60f9-ssh-key-edpm-compute-no-nodes\") on node \"crc\" DevicePath \"\"" Mar 16 17:23:59 crc kubenswrapper[5120]: I0316 17:23:59.050208 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7hmcx\" (UniqueName: \"kubernetes.io/projected/0e81067f-3b6a-4704-bd56-f972dccc60f9-kube-api-access-7hmcx\") on node \"crc\" DevicePath \"\"" Mar 16 17:23:59 crc kubenswrapper[5120]: I0316 17:23:59.585246 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/configure-network-edpm-compute-no-nodes-edpm-compute-no-noszw6z" Mar 16 17:23:59 crc kubenswrapper[5120]: I0316 17:23:59.585298 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/configure-network-edpm-compute-no-nodes-edpm-compute-no-noszw6z" event={"ID":"0e81067f-3b6a-4704-bd56-f972dccc60f9","Type":"ContainerDied","Data":"b05ab5df863b7fb2c11e6ae440353d8ddca1fccb902461ec47f3d86c42190754"} Mar 16 17:23:59 crc kubenswrapper[5120]: I0316 17:23:59.586119 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b05ab5df863b7fb2c11e6ae440353d8ddca1fccb902461ec47f3d86c42190754" Mar 16 17:23:59 crc kubenswrapper[5120]: I0316 17:23:59.655328 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/validate-network-edpm-compute-no-nodes-edpm-compute-no-nodlc8q5"] Mar 16 17:23:59 crc kubenswrapper[5120]: I0316 17:23:59.656317 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e81067f-3b6a-4704-bd56-f972dccc60f9" containerName="configure-network-edpm-compute-no-nodes-edpm-compute-no-nodes" Mar 16 17:23:59 crc kubenswrapper[5120]: I0316 17:23:59.656336 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e81067f-3b6a-4704-bd56-f972dccc60f9" containerName="configure-network-edpm-compute-no-nodes-edpm-compute-no-nodes" Mar 16 17:23:59 crc kubenswrapper[5120]: I0316 17:23:59.656497 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="0e81067f-3b6a-4704-bd56-f972dccc60f9" containerName="configure-network-edpm-compute-no-nodes-edpm-compute-no-nodes" Mar 16 17:23:59 crc kubenswrapper[5120]: I0316 17:23:59.662002 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/validate-network-edpm-compute-no-nodes-edpm-compute-no-nodlc8q5" Mar 16 17:23:59 crc kubenswrapper[5120]: I0316 17:23:59.664267 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/validate-network-edpm-compute-no-nodes-edpm-compute-no-nodlc8q5"] Mar 16 17:23:59 crc kubenswrapper[5120]: I0316 17:23:59.664621 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplane-ansible-ssh-private-key-secret\"" Mar 16 17:23:59 crc kubenswrapper[5120]: I0316 17:23:59.664795 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplanenodeset-edpm-compute-no-nodes\"" Mar 16 17:23:59 crc kubenswrapper[5120]: I0316 17:23:59.664995 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-aee-default-env\"" Mar 16 17:23:59 crc kubenswrapper[5120]: I0316 17:23:59.665996 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"edpm-compute-no-nodes-dockercfg-znndh\"" Mar 16 17:23:59 crc kubenswrapper[5120]: I0316 17:23:59.764625 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/f2c615aa-8c70-4017-83ee-12c091491d64-inventory\") pod \"validate-network-edpm-compute-no-nodes-edpm-compute-no-nodlc8q5\" (UID: \"f2c615aa-8c70-4017-83ee-12c091491d64\") " pod="openstack-kuttl-tests/validate-network-edpm-compute-no-nodes-edpm-compute-no-nodlc8q5" Mar 16 17:23:59 crc kubenswrapper[5120]: I0316 17:23:59.764955 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/f2c615aa-8c70-4017-83ee-12c091491d64-ssh-key-edpm-compute-no-nodes\") pod \"validate-network-edpm-compute-no-nodes-edpm-compute-no-nodlc8q5\" (UID: \"f2c615aa-8c70-4017-83ee-12c091491d64\") " pod="openstack-kuttl-tests/validate-network-edpm-compute-no-nodes-edpm-compute-no-nodlc8q5" Mar 16 17:23:59 crc kubenswrapper[5120]: I0316 17:23:59.765626 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmdqc\" (UniqueName: \"kubernetes.io/projected/f2c615aa-8c70-4017-83ee-12c091491d64-kube-api-access-mmdqc\") pod \"validate-network-edpm-compute-no-nodes-edpm-compute-no-nodlc8q5\" (UID: \"f2c615aa-8c70-4017-83ee-12c091491d64\") " pod="openstack-kuttl-tests/validate-network-edpm-compute-no-nodes-edpm-compute-no-nodlc8q5" Mar 16 17:23:59 crc kubenswrapper[5120]: I0316 17:23:59.867484 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/f2c615aa-8c70-4017-83ee-12c091491d64-ssh-key-edpm-compute-no-nodes\") pod \"validate-network-edpm-compute-no-nodes-edpm-compute-no-nodlc8q5\" (UID: \"f2c615aa-8c70-4017-83ee-12c091491d64\") " pod="openstack-kuttl-tests/validate-network-edpm-compute-no-nodes-edpm-compute-no-nodlc8q5" Mar 16 17:23:59 crc kubenswrapper[5120]: I0316 17:23:59.867707 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mmdqc\" (UniqueName: \"kubernetes.io/projected/f2c615aa-8c70-4017-83ee-12c091491d64-kube-api-access-mmdqc\") pod \"validate-network-edpm-compute-no-nodes-edpm-compute-no-nodlc8q5\" (UID: \"f2c615aa-8c70-4017-83ee-12c091491d64\") " pod="openstack-kuttl-tests/validate-network-edpm-compute-no-nodes-edpm-compute-no-nodlc8q5" Mar 16 17:23:59 crc kubenswrapper[5120]: I0316 17:23:59.867789 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/f2c615aa-8c70-4017-83ee-12c091491d64-inventory\") pod \"validate-network-edpm-compute-no-nodes-edpm-compute-no-nodlc8q5\" (UID: \"f2c615aa-8c70-4017-83ee-12c091491d64\") " pod="openstack-kuttl-tests/validate-network-edpm-compute-no-nodes-edpm-compute-no-nodlc8q5" Mar 16 17:23:59 crc kubenswrapper[5120]: I0316 17:23:59.873442 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/f2c615aa-8c70-4017-83ee-12c091491d64-ssh-key-edpm-compute-no-nodes\") pod \"validate-network-edpm-compute-no-nodes-edpm-compute-no-nodlc8q5\" (UID: \"f2c615aa-8c70-4017-83ee-12c091491d64\") " pod="openstack-kuttl-tests/validate-network-edpm-compute-no-nodes-edpm-compute-no-nodlc8q5" Mar 16 17:23:59 crc kubenswrapper[5120]: I0316 17:23:59.875370 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/f2c615aa-8c70-4017-83ee-12c091491d64-inventory\") pod \"validate-network-edpm-compute-no-nodes-edpm-compute-no-nodlc8q5\" (UID: \"f2c615aa-8c70-4017-83ee-12c091491d64\") " pod="openstack-kuttl-tests/validate-network-edpm-compute-no-nodes-edpm-compute-no-nodlc8q5" Mar 16 17:23:59 crc kubenswrapper[5120]: I0316 17:23:59.885189 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmdqc\" (UniqueName: \"kubernetes.io/projected/f2c615aa-8c70-4017-83ee-12c091491d64-kube-api-access-mmdqc\") pod \"validate-network-edpm-compute-no-nodes-edpm-compute-no-nodlc8q5\" (UID: \"f2c615aa-8c70-4017-83ee-12c091491d64\") " pod="openstack-kuttl-tests/validate-network-edpm-compute-no-nodes-edpm-compute-no-nodlc8q5" Mar 16 17:23:59 crc kubenswrapper[5120]: I0316 17:23:59.980179 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/validate-network-edpm-compute-no-nodes-edpm-compute-no-nodlc8q5" Mar 16 17:24:00 crc kubenswrapper[5120]: I0316 17:24:00.131020 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-infra/auto-csr-approver-29561364-xzfp4"] Mar 16 17:24:00 crc kubenswrapper[5120]: I0316 17:24:00.138868 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561364-xzfp4"] Mar 16 17:24:00 crc kubenswrapper[5120]: I0316 17:24:00.138981 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561364-xzfp4" Mar 16 17:24:00 crc kubenswrapper[5120]: I0316 17:24:00.142045 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-infra\"/\"csr-approver-sa-dockercfg-x2nsz\"" Mar 16 17:24:00 crc kubenswrapper[5120]: I0316 17:24:00.142204 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"openshift-service-ca.crt\"" Mar 16 17:24:00 crc kubenswrapper[5120]: I0316 17:24:00.143177 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"kube-root-ca.crt\"" Mar 16 17:24:00 crc kubenswrapper[5120]: I0316 17:24:00.277002 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nggc6\" (UniqueName: \"kubernetes.io/projected/6d0b509f-dfc3-4425-9706-b0c336ffc410-kube-api-access-nggc6\") pod \"auto-csr-approver-29561364-xzfp4\" (UID: \"6d0b509f-dfc3-4425-9706-b0c336ffc410\") " pod="openshift-infra/auto-csr-approver-29561364-xzfp4" Mar 16 17:24:00 crc kubenswrapper[5120]: I0316 17:24:00.382394 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nggc6\" (UniqueName: \"kubernetes.io/projected/6d0b509f-dfc3-4425-9706-b0c336ffc410-kube-api-access-nggc6\") pod \"auto-csr-approver-29561364-xzfp4\" (UID: \"6d0b509f-dfc3-4425-9706-b0c336ffc410\") " pod="openshift-infra/auto-csr-approver-29561364-xzfp4" Mar 16 17:24:00 crc kubenswrapper[5120]: I0316 17:24:00.403559 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nggc6\" (UniqueName: \"kubernetes.io/projected/6d0b509f-dfc3-4425-9706-b0c336ffc410-kube-api-access-nggc6\") pod \"auto-csr-approver-29561364-xzfp4\" (UID: \"6d0b509f-dfc3-4425-9706-b0c336ffc410\") " pod="openshift-infra/auto-csr-approver-29561364-xzfp4" Mar 16 17:24:00 crc kubenswrapper[5120]: I0316 17:24:00.405290 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/validate-network-edpm-compute-no-nodes-edpm-compute-no-nodlc8q5"] Mar 16 17:24:00 crc kubenswrapper[5120]: W0316 17:24:00.408280 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf2c615aa_8c70_4017_83ee_12c091491d64.slice/crio-c0a6cf2274a373f592c9b61a7ad3e619debbb3102ef4bba68d5ab15794ab3683 WatchSource:0}: Error finding container c0a6cf2274a373f592c9b61a7ad3e619debbb3102ef4bba68d5ab15794ab3683: Status 404 returned error can't find the container with id c0a6cf2274a373f592c9b61a7ad3e619debbb3102ef4bba68d5ab15794ab3683 Mar 16 17:24:00 crc kubenswrapper[5120]: I0316 17:24:00.462459 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561364-xzfp4" Mar 16 17:24:00 crc kubenswrapper[5120]: I0316 17:24:00.599488 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/validate-network-edpm-compute-no-nodes-edpm-compute-no-nodlc8q5" event={"ID":"f2c615aa-8c70-4017-83ee-12c091491d64","Type":"ContainerStarted","Data":"c0a6cf2274a373f592c9b61a7ad3e619debbb3102ef4bba68d5ab15794ab3683"} Mar 16 17:24:00 crc kubenswrapper[5120]: W0316 17:24:00.874171 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6d0b509f_dfc3_4425_9706_b0c336ffc410.slice/crio-0cbf9dd6732c2518123aeea61bcb9d6dec7758d4b2c894e1a535b3581c286f82 WatchSource:0}: Error finding container 0cbf9dd6732c2518123aeea61bcb9d6dec7758d4b2c894e1a535b3581c286f82: Status 404 returned error can't find the container with id 0cbf9dd6732c2518123aeea61bcb9d6dec7758d4b2c894e1a535b3581c286f82 Mar 16 17:24:00 crc kubenswrapper[5120]: I0316 17:24:00.874473 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561364-xzfp4"] Mar 16 17:24:01 crc kubenswrapper[5120]: I0316 17:24:01.630920 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561364-xzfp4" event={"ID":"6d0b509f-dfc3-4425-9706-b0c336ffc410","Type":"ContainerStarted","Data":"0cbf9dd6732c2518123aeea61bcb9d6dec7758d4b2c894e1a535b3581c286f82"} Mar 16 17:24:01 crc kubenswrapper[5120]: I0316 17:24:01.633358 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/validate-network-edpm-compute-no-nodes-edpm-compute-no-nodlc8q5" event={"ID":"f2c615aa-8c70-4017-83ee-12c091491d64","Type":"ContainerStarted","Data":"dafbbfc7f4027f6364f977d2dcf792eabd886b0ee6f0d1928892410df28facba"} Mar 16 17:24:01 crc kubenswrapper[5120]: I0316 17:24:01.665573 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/validate-network-edpm-compute-no-nodes-edpm-compute-no-nodlc8q5" podStartSLOduration=2.220061788 podStartE2EDuration="2.66554516s" podCreationTimestamp="2026-03-16 17:23:59 +0000 UTC" firstStartedPulling="2026-03-16 17:24:00.410112765 +0000 UTC m=+6742.564044422" lastFinishedPulling="2026-03-16 17:24:00.855596137 +0000 UTC m=+6743.009527794" observedRunningTime="2026-03-16 17:24:01.653239453 +0000 UTC m=+6743.807171140" watchObservedRunningTime="2026-03-16 17:24:01.66554516 +0000 UTC m=+6743.819476857" Mar 16 17:24:02 crc kubenswrapper[5120]: I0316 17:24:02.645616 5120 generic.go:358] "Generic (PLEG): container finished" podID="6d0b509f-dfc3-4425-9706-b0c336ffc410" containerID="756d80abbf144b03e73508b2100c74eb5fa3671adca4346c7d5954023c86241e" exitCode=0 Mar 16 17:24:02 crc kubenswrapper[5120]: I0316 17:24:02.645734 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561364-xzfp4" event={"ID":"6d0b509f-dfc3-4425-9706-b0c336ffc410","Type":"ContainerDied","Data":"756d80abbf144b03e73508b2100c74eb5fa3671adca4346c7d5954023c86241e"} Mar 16 17:24:02 crc kubenswrapper[5120]: I0316 17:24:02.648534 5120 generic.go:358] "Generic (PLEG): container finished" podID="f2c615aa-8c70-4017-83ee-12c091491d64" containerID="dafbbfc7f4027f6364f977d2dcf792eabd886b0ee6f0d1928892410df28facba" exitCode=0 Mar 16 17:24:02 crc kubenswrapper[5120]: I0316 17:24:02.648693 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/validate-network-edpm-compute-no-nodes-edpm-compute-no-nodlc8q5" event={"ID":"f2c615aa-8c70-4017-83ee-12c091491d64","Type":"ContainerDied","Data":"dafbbfc7f4027f6364f977d2dcf792eabd886b0ee6f0d1928892410df28facba"} Mar 16 17:24:03 crc kubenswrapper[5120]: I0316 17:24:03.965968 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/validate-network-edpm-compute-no-nodes-edpm-compute-no-nodlc8q5" Mar 16 17:24:03 crc kubenswrapper[5120]: I0316 17:24:03.972949 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561364-xzfp4" Mar 16 17:24:04 crc kubenswrapper[5120]: I0316 17:24:04.080458 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nggc6\" (UniqueName: \"kubernetes.io/projected/6d0b509f-dfc3-4425-9706-b0c336ffc410-kube-api-access-nggc6\") pod \"6d0b509f-dfc3-4425-9706-b0c336ffc410\" (UID: \"6d0b509f-dfc3-4425-9706-b0c336ffc410\") " Mar 16 17:24:04 crc kubenswrapper[5120]: I0316 17:24:04.080590 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/f2c615aa-8c70-4017-83ee-12c091491d64-inventory\") pod \"f2c615aa-8c70-4017-83ee-12c091491d64\" (UID: \"f2c615aa-8c70-4017-83ee-12c091491d64\") " Mar 16 17:24:04 crc kubenswrapper[5120]: I0316 17:24:04.080613 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mmdqc\" (UniqueName: \"kubernetes.io/projected/f2c615aa-8c70-4017-83ee-12c091491d64-kube-api-access-mmdqc\") pod \"f2c615aa-8c70-4017-83ee-12c091491d64\" (UID: \"f2c615aa-8c70-4017-83ee-12c091491d64\") " Mar 16 17:24:04 crc kubenswrapper[5120]: I0316 17:24:04.080865 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/f2c615aa-8c70-4017-83ee-12c091491d64-ssh-key-edpm-compute-no-nodes\") pod \"f2c615aa-8c70-4017-83ee-12c091491d64\" (UID: \"f2c615aa-8c70-4017-83ee-12c091491d64\") " Mar 16 17:24:04 crc kubenswrapper[5120]: I0316 17:24:04.086890 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d0b509f-dfc3-4425-9706-b0c336ffc410-kube-api-access-nggc6" (OuterVolumeSpecName: "kube-api-access-nggc6") pod "6d0b509f-dfc3-4425-9706-b0c336ffc410" (UID: "6d0b509f-dfc3-4425-9706-b0c336ffc410"). InnerVolumeSpecName "kube-api-access-nggc6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:24:04 crc kubenswrapper[5120]: I0316 17:24:04.088019 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2c615aa-8c70-4017-83ee-12c091491d64-kube-api-access-mmdqc" (OuterVolumeSpecName: "kube-api-access-mmdqc") pod "f2c615aa-8c70-4017-83ee-12c091491d64" (UID: "f2c615aa-8c70-4017-83ee-12c091491d64"). InnerVolumeSpecName "kube-api-access-mmdqc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:24:04 crc kubenswrapper[5120]: I0316 17:24:04.104253 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f2c615aa-8c70-4017-83ee-12c091491d64-inventory" (OuterVolumeSpecName: "inventory") pod "f2c615aa-8c70-4017-83ee-12c091491d64" (UID: "f2c615aa-8c70-4017-83ee-12c091491d64"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:24:04 crc kubenswrapper[5120]: I0316 17:24:04.104522 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f2c615aa-8c70-4017-83ee-12c091491d64-ssh-key-edpm-compute-no-nodes" (OuterVolumeSpecName: "ssh-key-edpm-compute-no-nodes") pod "f2c615aa-8c70-4017-83ee-12c091491d64" (UID: "f2c615aa-8c70-4017-83ee-12c091491d64"). InnerVolumeSpecName "ssh-key-edpm-compute-no-nodes". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:24:04 crc kubenswrapper[5120]: I0316 17:24:04.185211 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nggc6\" (UniqueName: \"kubernetes.io/projected/6d0b509f-dfc3-4425-9706-b0c336ffc410-kube-api-access-nggc6\") on node \"crc\" DevicePath \"\"" Mar 16 17:24:04 crc kubenswrapper[5120]: I0316 17:24:04.185249 5120 reconciler_common.go:299] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/f2c615aa-8c70-4017-83ee-12c091491d64-inventory\") on node \"crc\" DevicePath \"\"" Mar 16 17:24:04 crc kubenswrapper[5120]: I0316 17:24:04.185258 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mmdqc\" (UniqueName: \"kubernetes.io/projected/f2c615aa-8c70-4017-83ee-12c091491d64-kube-api-access-mmdqc\") on node \"crc\" DevicePath \"\"" Mar 16 17:24:04 crc kubenswrapper[5120]: I0316 17:24:04.185271 5120 reconciler_common.go:299] "Volume detached for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/f2c615aa-8c70-4017-83ee-12c091491d64-ssh-key-edpm-compute-no-nodes\") on node \"crc\" DevicePath \"\"" Mar 16 17:24:04 crc kubenswrapper[5120]: I0316 17:24:04.666164 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561364-xzfp4" Mar 16 17:24:04 crc kubenswrapper[5120]: I0316 17:24:04.670082 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/validate-network-edpm-compute-no-nodes-edpm-compute-no-nodlc8q5" Mar 16 17:24:04 crc kubenswrapper[5120]: I0316 17:24:04.676524 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561364-xzfp4" event={"ID":"6d0b509f-dfc3-4425-9706-b0c336ffc410","Type":"ContainerDied","Data":"0cbf9dd6732c2518123aeea61bcb9d6dec7758d4b2c894e1a535b3581c286f82"} Mar 16 17:24:04 crc kubenswrapper[5120]: I0316 17:24:04.676581 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0cbf9dd6732c2518123aeea61bcb9d6dec7758d4b2c894e1a535b3581c286f82" Mar 16 17:24:04 crc kubenswrapper[5120]: I0316 17:24:04.676595 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/validate-network-edpm-compute-no-nodes-edpm-compute-no-nodlc8q5" event={"ID":"f2c615aa-8c70-4017-83ee-12c091491d64","Type":"ContainerDied","Data":"c0a6cf2274a373f592c9b61a7ad3e619debbb3102ef4bba68d5ab15794ab3683"} Mar 16 17:24:04 crc kubenswrapper[5120]: I0316 17:24:04.676607 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c0a6cf2274a373f592c9b61a7ad3e619debbb3102ef4bba68d5ab15794ab3683" Mar 16 17:24:04 crc kubenswrapper[5120]: I0316 17:24:04.724165 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/install-os-edpm-compute-no-nodes-edpm-compute-no-nodes-nt8ng"] Mar 16 17:24:04 crc kubenswrapper[5120]: I0316 17:24:04.725407 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2c615aa-8c70-4017-83ee-12c091491d64" containerName="validate-network-edpm-compute-no-nodes-edpm-compute-no-nodes" Mar 16 17:24:04 crc kubenswrapper[5120]: I0316 17:24:04.725446 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2c615aa-8c70-4017-83ee-12c091491d64" containerName="validate-network-edpm-compute-no-nodes-edpm-compute-no-nodes" Mar 16 17:24:04 crc kubenswrapper[5120]: I0316 17:24:04.725485 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d0b509f-dfc3-4425-9706-b0c336ffc410" containerName="oc" Mar 16 17:24:04 crc kubenswrapper[5120]: I0316 17:24:04.725492 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d0b509f-dfc3-4425-9706-b0c336ffc410" containerName="oc" Mar 16 17:24:04 crc kubenswrapper[5120]: I0316 17:24:04.725622 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f2c615aa-8c70-4017-83ee-12c091491d64" containerName="validate-network-edpm-compute-no-nodes-edpm-compute-no-nodes" Mar 16 17:24:04 crc kubenswrapper[5120]: I0316 17:24:04.725646 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="6d0b509f-dfc3-4425-9706-b0c336ffc410" containerName="oc" Mar 16 17:24:04 crc kubenswrapper[5120]: I0316 17:24:04.729750 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/install-os-edpm-compute-no-nodes-edpm-compute-no-nodes-nt8ng" Mar 16 17:24:04 crc kubenswrapper[5120]: I0316 17:24:04.732260 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplanenodeset-edpm-compute-no-nodes\"" Mar 16 17:24:04 crc kubenswrapper[5120]: I0316 17:24:04.733060 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"edpm-compute-no-nodes-dockercfg-znndh\"" Mar 16 17:24:04 crc kubenswrapper[5120]: I0316 17:24:04.733236 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplane-ansible-ssh-private-key-secret\"" Mar 16 17:24:04 crc kubenswrapper[5120]: I0316 17:24:04.734718 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/install-os-edpm-compute-no-nodes-edpm-compute-no-nodes-nt8ng"] Mar 16 17:24:04 crc kubenswrapper[5120]: I0316 17:24:04.736621 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-aee-default-env\"" Mar 16 17:24:04 crc kubenswrapper[5120]: I0316 17:24:04.801222 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/11279f5d-2620-4e41-a14a-be5d6418eb7a-inventory\") pod \"install-os-edpm-compute-no-nodes-edpm-compute-no-nodes-nt8ng\" (UID: \"11279f5d-2620-4e41-a14a-be5d6418eb7a\") " pod="openstack-kuttl-tests/install-os-edpm-compute-no-nodes-edpm-compute-no-nodes-nt8ng" Mar 16 17:24:04 crc kubenswrapper[5120]: I0316 17:24:04.801324 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sc6cn\" (UniqueName: \"kubernetes.io/projected/11279f5d-2620-4e41-a14a-be5d6418eb7a-kube-api-access-sc6cn\") pod \"install-os-edpm-compute-no-nodes-edpm-compute-no-nodes-nt8ng\" (UID: \"11279f5d-2620-4e41-a14a-be5d6418eb7a\") " pod="openstack-kuttl-tests/install-os-edpm-compute-no-nodes-edpm-compute-no-nodes-nt8ng" Mar 16 17:24:04 crc kubenswrapper[5120]: I0316 17:24:04.801598 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/11279f5d-2620-4e41-a14a-be5d6418eb7a-ssh-key-edpm-compute-no-nodes\") pod \"install-os-edpm-compute-no-nodes-edpm-compute-no-nodes-nt8ng\" (UID: \"11279f5d-2620-4e41-a14a-be5d6418eb7a\") " pod="openstack-kuttl-tests/install-os-edpm-compute-no-nodes-edpm-compute-no-nodes-nt8ng" Mar 16 17:24:04 crc kubenswrapper[5120]: I0316 17:24:04.903813 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/11279f5d-2620-4e41-a14a-be5d6418eb7a-inventory\") pod \"install-os-edpm-compute-no-nodes-edpm-compute-no-nodes-nt8ng\" (UID: \"11279f5d-2620-4e41-a14a-be5d6418eb7a\") " pod="openstack-kuttl-tests/install-os-edpm-compute-no-nodes-edpm-compute-no-nodes-nt8ng" Mar 16 17:24:04 crc kubenswrapper[5120]: I0316 17:24:04.903953 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sc6cn\" (UniqueName: \"kubernetes.io/projected/11279f5d-2620-4e41-a14a-be5d6418eb7a-kube-api-access-sc6cn\") pod \"install-os-edpm-compute-no-nodes-edpm-compute-no-nodes-nt8ng\" (UID: \"11279f5d-2620-4e41-a14a-be5d6418eb7a\") " pod="openstack-kuttl-tests/install-os-edpm-compute-no-nodes-edpm-compute-no-nodes-nt8ng" Mar 16 17:24:04 crc kubenswrapper[5120]: I0316 17:24:04.904156 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/11279f5d-2620-4e41-a14a-be5d6418eb7a-ssh-key-edpm-compute-no-nodes\") pod \"install-os-edpm-compute-no-nodes-edpm-compute-no-nodes-nt8ng\" (UID: \"11279f5d-2620-4e41-a14a-be5d6418eb7a\") " pod="openstack-kuttl-tests/install-os-edpm-compute-no-nodes-edpm-compute-no-nodes-nt8ng" Mar 16 17:24:04 crc kubenswrapper[5120]: I0316 17:24:04.909423 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/11279f5d-2620-4e41-a14a-be5d6418eb7a-inventory\") pod \"install-os-edpm-compute-no-nodes-edpm-compute-no-nodes-nt8ng\" (UID: \"11279f5d-2620-4e41-a14a-be5d6418eb7a\") " pod="openstack-kuttl-tests/install-os-edpm-compute-no-nodes-edpm-compute-no-nodes-nt8ng" Mar 16 17:24:04 crc kubenswrapper[5120]: I0316 17:24:04.909696 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/11279f5d-2620-4e41-a14a-be5d6418eb7a-ssh-key-edpm-compute-no-nodes\") pod \"install-os-edpm-compute-no-nodes-edpm-compute-no-nodes-nt8ng\" (UID: \"11279f5d-2620-4e41-a14a-be5d6418eb7a\") " pod="openstack-kuttl-tests/install-os-edpm-compute-no-nodes-edpm-compute-no-nodes-nt8ng" Mar 16 17:24:04 crc kubenswrapper[5120]: I0316 17:24:04.921858 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sc6cn\" (UniqueName: \"kubernetes.io/projected/11279f5d-2620-4e41-a14a-be5d6418eb7a-kube-api-access-sc6cn\") pod \"install-os-edpm-compute-no-nodes-edpm-compute-no-nodes-nt8ng\" (UID: \"11279f5d-2620-4e41-a14a-be5d6418eb7a\") " pod="openstack-kuttl-tests/install-os-edpm-compute-no-nodes-edpm-compute-no-nodes-nt8ng" Mar 16 17:24:05 crc kubenswrapper[5120]: I0316 17:24:05.042488 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-infra/auto-csr-approver-29561358-jmrct"] Mar 16 17:24:05 crc kubenswrapper[5120]: I0316 17:24:05.047908 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-infra/auto-csr-approver-29561358-jmrct"] Mar 16 17:24:05 crc kubenswrapper[5120]: I0316 17:24:05.052965 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/install-os-edpm-compute-no-nodes-edpm-compute-no-nodes-nt8ng" Mar 16 17:24:05 crc kubenswrapper[5120]: I0316 17:24:05.464276 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/install-os-edpm-compute-no-nodes-edpm-compute-no-nodes-nt8ng"] Mar 16 17:24:05 crc kubenswrapper[5120]: I0316 17:24:05.679962 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/install-os-edpm-compute-no-nodes-edpm-compute-no-nodes-nt8ng" event={"ID":"11279f5d-2620-4e41-a14a-be5d6418eb7a","Type":"ContainerStarted","Data":"2bab9650135aafa464dffc5a6b950d1b088725ec056d1430672b97baf8e94b14"} Mar 16 17:24:06 crc kubenswrapper[5120]: I0316 17:24:06.673039 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="46885d57-43f7-41f0-832e-3ee4c1f4a456" path="/var/lib/kubelet/pods/46885d57-43f7-41f0-832e-3ee4c1f4a456/volumes" Mar 16 17:24:06 crc kubenswrapper[5120]: I0316 17:24:06.690591 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/install-os-edpm-compute-no-nodes-edpm-compute-no-nodes-nt8ng" event={"ID":"11279f5d-2620-4e41-a14a-be5d6418eb7a","Type":"ContainerStarted","Data":"12ac70829d2369dbf3ffe907fba2c7d6bada6d051cfd71eb556afecd85739cb4"} Mar 16 17:24:06 crc kubenswrapper[5120]: I0316 17:24:06.709321 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/install-os-edpm-compute-no-nodes-edpm-compute-no-nodes-nt8ng" podStartSLOduration=2.247514501 podStartE2EDuration="2.70930131s" podCreationTimestamp="2026-03-16 17:24:04 +0000 UTC" firstStartedPulling="2026-03-16 17:24:05.471490037 +0000 UTC m=+6747.625421694" lastFinishedPulling="2026-03-16 17:24:05.933276846 +0000 UTC m=+6748.087208503" observedRunningTime="2026-03-16 17:24:06.705553787 +0000 UTC m=+6748.859485454" watchObservedRunningTime="2026-03-16 17:24:06.70930131 +0000 UTC m=+6748.863232967" Mar 16 17:24:07 crc kubenswrapper[5120]: E0316 17:24:07.553337 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1314618 actualBytes=10240 Mar 16 17:24:07 crc kubenswrapper[5120]: I0316 17:24:07.723145 5120 generic.go:358] "Generic (PLEG): container finished" podID="11279f5d-2620-4e41-a14a-be5d6418eb7a" containerID="12ac70829d2369dbf3ffe907fba2c7d6bada6d051cfd71eb556afecd85739cb4" exitCode=0 Mar 16 17:24:07 crc kubenswrapper[5120]: I0316 17:24:07.723877 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/install-os-edpm-compute-no-nodes-edpm-compute-no-nodes-nt8ng" event={"ID":"11279f5d-2620-4e41-a14a-be5d6418eb7a","Type":"ContainerDied","Data":"12ac70829d2369dbf3ffe907fba2c7d6bada6d051cfd71eb556afecd85739cb4"} Mar 16 17:24:09 crc kubenswrapper[5120]: I0316 17:24:09.024144 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/install-os-edpm-compute-no-nodes-edpm-compute-no-nodes-nt8ng" Mar 16 17:24:09 crc kubenswrapper[5120]: I0316 17:24:09.199689 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/11279f5d-2620-4e41-a14a-be5d6418eb7a-ssh-key-edpm-compute-no-nodes\") pod \"11279f5d-2620-4e41-a14a-be5d6418eb7a\" (UID: \"11279f5d-2620-4e41-a14a-be5d6418eb7a\") " Mar 16 17:24:09 crc kubenswrapper[5120]: I0316 17:24:09.199753 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/11279f5d-2620-4e41-a14a-be5d6418eb7a-inventory\") pod \"11279f5d-2620-4e41-a14a-be5d6418eb7a\" (UID: \"11279f5d-2620-4e41-a14a-be5d6418eb7a\") " Mar 16 17:24:09 crc kubenswrapper[5120]: I0316 17:24:09.199851 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sc6cn\" (UniqueName: \"kubernetes.io/projected/11279f5d-2620-4e41-a14a-be5d6418eb7a-kube-api-access-sc6cn\") pod \"11279f5d-2620-4e41-a14a-be5d6418eb7a\" (UID: \"11279f5d-2620-4e41-a14a-be5d6418eb7a\") " Mar 16 17:24:09 crc kubenswrapper[5120]: I0316 17:24:09.207482 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11279f5d-2620-4e41-a14a-be5d6418eb7a-kube-api-access-sc6cn" (OuterVolumeSpecName: "kube-api-access-sc6cn") pod "11279f5d-2620-4e41-a14a-be5d6418eb7a" (UID: "11279f5d-2620-4e41-a14a-be5d6418eb7a"). InnerVolumeSpecName "kube-api-access-sc6cn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:24:09 crc kubenswrapper[5120]: I0316 17:24:09.222033 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11279f5d-2620-4e41-a14a-be5d6418eb7a-ssh-key-edpm-compute-no-nodes" (OuterVolumeSpecName: "ssh-key-edpm-compute-no-nodes") pod "11279f5d-2620-4e41-a14a-be5d6418eb7a" (UID: "11279f5d-2620-4e41-a14a-be5d6418eb7a"). InnerVolumeSpecName "ssh-key-edpm-compute-no-nodes". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:24:09 crc kubenswrapper[5120]: I0316 17:24:09.222407 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11279f5d-2620-4e41-a14a-be5d6418eb7a-inventory" (OuterVolumeSpecName: "inventory") pod "11279f5d-2620-4e41-a14a-be5d6418eb7a" (UID: "11279f5d-2620-4e41-a14a-be5d6418eb7a"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:24:09 crc kubenswrapper[5120]: I0316 17:24:09.302354 5120 reconciler_common.go:299] "Volume detached for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/11279f5d-2620-4e41-a14a-be5d6418eb7a-ssh-key-edpm-compute-no-nodes\") on node \"crc\" DevicePath \"\"" Mar 16 17:24:09 crc kubenswrapper[5120]: I0316 17:24:09.302398 5120 reconciler_common.go:299] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/11279f5d-2620-4e41-a14a-be5d6418eb7a-inventory\") on node \"crc\" DevicePath \"\"" Mar 16 17:24:09 crc kubenswrapper[5120]: I0316 17:24:09.302410 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sc6cn\" (UniqueName: \"kubernetes.io/projected/11279f5d-2620-4e41-a14a-be5d6418eb7a-kube-api-access-sc6cn\") on node \"crc\" DevicePath \"\"" Mar 16 17:24:09 crc kubenswrapper[5120]: I0316 17:24:09.752085 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/install-os-edpm-compute-no-nodes-edpm-compute-no-nodes-nt8ng" Mar 16 17:24:09 crc kubenswrapper[5120]: I0316 17:24:09.752490 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/install-os-edpm-compute-no-nodes-edpm-compute-no-nodes-nt8ng" event={"ID":"11279f5d-2620-4e41-a14a-be5d6418eb7a","Type":"ContainerDied","Data":"2bab9650135aafa464dffc5a6b950d1b088725ec056d1430672b97baf8e94b14"} Mar 16 17:24:09 crc kubenswrapper[5120]: I0316 17:24:09.752540 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2bab9650135aafa464dffc5a6b950d1b088725ec056d1430672b97baf8e94b14" Mar 16 17:24:09 crc kubenswrapper[5120]: I0316 17:24:09.777965 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/configure-os-edpm-compute-no-nodes-edpm-compute-no-nodes-hbs5p"] Mar 16 17:24:09 crc kubenswrapper[5120]: I0316 17:24:09.780903 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11279f5d-2620-4e41-a14a-be5d6418eb7a" containerName="install-os-edpm-compute-no-nodes-edpm-compute-no-nodes" Mar 16 17:24:09 crc kubenswrapper[5120]: I0316 17:24:09.780928 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="11279f5d-2620-4e41-a14a-be5d6418eb7a" containerName="install-os-edpm-compute-no-nodes-edpm-compute-no-nodes" Mar 16 17:24:09 crc kubenswrapper[5120]: I0316 17:24:09.781088 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="11279f5d-2620-4e41-a14a-be5d6418eb7a" containerName="install-os-edpm-compute-no-nodes-edpm-compute-no-nodes" Mar 16 17:24:09 crc kubenswrapper[5120]: I0316 17:24:09.789387 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/configure-os-edpm-compute-no-nodes-edpm-compute-no-nodes-hbs5p"] Mar 16 17:24:09 crc kubenswrapper[5120]: I0316 17:24:09.789572 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/configure-os-edpm-compute-no-nodes-edpm-compute-no-nodes-hbs5p" Mar 16 17:24:09 crc kubenswrapper[5120]: I0316 17:24:09.794488 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"edpm-compute-no-nodes-dockercfg-znndh\"" Mar 16 17:24:09 crc kubenswrapper[5120]: I0316 17:24:09.794862 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-aee-default-env\"" Mar 16 17:24:09 crc kubenswrapper[5120]: I0316 17:24:09.795038 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplane-ansible-ssh-private-key-secret\"" Mar 16 17:24:09 crc kubenswrapper[5120]: I0316 17:24:09.795177 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplanenodeset-edpm-compute-no-nodes\"" Mar 16 17:24:09 crc kubenswrapper[5120]: I0316 17:24:09.811308 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/de27760f-f52b-4895-a6ca-4a5e1845679d-ssh-key-edpm-compute-no-nodes\") pod \"configure-os-edpm-compute-no-nodes-edpm-compute-no-nodes-hbs5p\" (UID: \"de27760f-f52b-4895-a6ca-4a5e1845679d\") " pod="openstack-kuttl-tests/configure-os-edpm-compute-no-nodes-edpm-compute-no-nodes-hbs5p" Mar 16 17:24:09 crc kubenswrapper[5120]: I0316 17:24:09.811426 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/de27760f-f52b-4895-a6ca-4a5e1845679d-inventory\") pod \"configure-os-edpm-compute-no-nodes-edpm-compute-no-nodes-hbs5p\" (UID: \"de27760f-f52b-4895-a6ca-4a5e1845679d\") " pod="openstack-kuttl-tests/configure-os-edpm-compute-no-nodes-edpm-compute-no-nodes-hbs5p" Mar 16 17:24:09 crc kubenswrapper[5120]: I0316 17:24:09.811450 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wsdnp\" (UniqueName: \"kubernetes.io/projected/de27760f-f52b-4895-a6ca-4a5e1845679d-kube-api-access-wsdnp\") pod \"configure-os-edpm-compute-no-nodes-edpm-compute-no-nodes-hbs5p\" (UID: \"de27760f-f52b-4895-a6ca-4a5e1845679d\") " pod="openstack-kuttl-tests/configure-os-edpm-compute-no-nodes-edpm-compute-no-nodes-hbs5p" Mar 16 17:24:09 crc kubenswrapper[5120]: I0316 17:24:09.912540 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/de27760f-f52b-4895-a6ca-4a5e1845679d-inventory\") pod \"configure-os-edpm-compute-no-nodes-edpm-compute-no-nodes-hbs5p\" (UID: \"de27760f-f52b-4895-a6ca-4a5e1845679d\") " pod="openstack-kuttl-tests/configure-os-edpm-compute-no-nodes-edpm-compute-no-nodes-hbs5p" Mar 16 17:24:09 crc kubenswrapper[5120]: I0316 17:24:09.912603 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wsdnp\" (UniqueName: \"kubernetes.io/projected/de27760f-f52b-4895-a6ca-4a5e1845679d-kube-api-access-wsdnp\") pod \"configure-os-edpm-compute-no-nodes-edpm-compute-no-nodes-hbs5p\" (UID: \"de27760f-f52b-4895-a6ca-4a5e1845679d\") " pod="openstack-kuttl-tests/configure-os-edpm-compute-no-nodes-edpm-compute-no-nodes-hbs5p" Mar 16 17:24:09 crc kubenswrapper[5120]: I0316 17:24:09.912847 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/de27760f-f52b-4895-a6ca-4a5e1845679d-ssh-key-edpm-compute-no-nodes\") pod \"configure-os-edpm-compute-no-nodes-edpm-compute-no-nodes-hbs5p\" (UID: \"de27760f-f52b-4895-a6ca-4a5e1845679d\") " pod="openstack-kuttl-tests/configure-os-edpm-compute-no-nodes-edpm-compute-no-nodes-hbs5p" Mar 16 17:24:09 crc kubenswrapper[5120]: I0316 17:24:09.917932 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/de27760f-f52b-4895-a6ca-4a5e1845679d-ssh-key-edpm-compute-no-nodes\") pod \"configure-os-edpm-compute-no-nodes-edpm-compute-no-nodes-hbs5p\" (UID: \"de27760f-f52b-4895-a6ca-4a5e1845679d\") " pod="openstack-kuttl-tests/configure-os-edpm-compute-no-nodes-edpm-compute-no-nodes-hbs5p" Mar 16 17:24:09 crc kubenswrapper[5120]: I0316 17:24:09.922488 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/de27760f-f52b-4895-a6ca-4a5e1845679d-inventory\") pod \"configure-os-edpm-compute-no-nodes-edpm-compute-no-nodes-hbs5p\" (UID: \"de27760f-f52b-4895-a6ca-4a5e1845679d\") " pod="openstack-kuttl-tests/configure-os-edpm-compute-no-nodes-edpm-compute-no-nodes-hbs5p" Mar 16 17:24:09 crc kubenswrapper[5120]: I0316 17:24:09.931340 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wsdnp\" (UniqueName: \"kubernetes.io/projected/de27760f-f52b-4895-a6ca-4a5e1845679d-kube-api-access-wsdnp\") pod \"configure-os-edpm-compute-no-nodes-edpm-compute-no-nodes-hbs5p\" (UID: \"de27760f-f52b-4895-a6ca-4a5e1845679d\") " pod="openstack-kuttl-tests/configure-os-edpm-compute-no-nodes-edpm-compute-no-nodes-hbs5p" Mar 16 17:24:10 crc kubenswrapper[5120]: I0316 17:24:10.116871 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/configure-os-edpm-compute-no-nodes-edpm-compute-no-nodes-hbs5p" Mar 16 17:24:10 crc kubenswrapper[5120]: I0316 17:24:10.516558 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/configure-os-edpm-compute-no-nodes-edpm-compute-no-nodes-hbs5p"] Mar 16 17:24:10 crc kubenswrapper[5120]: W0316 17:24:10.520358 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podde27760f_f52b_4895_a6ca_4a5e1845679d.slice/crio-d3449e83d803eafe28a02b6f2554f5036c1cf2b5bb4cce9d2fa05132b7bb4eca WatchSource:0}: Error finding container d3449e83d803eafe28a02b6f2554f5036c1cf2b5bb4cce9d2fa05132b7bb4eca: Status 404 returned error can't find the container with id d3449e83d803eafe28a02b6f2554f5036c1cf2b5bb4cce9d2fa05132b7bb4eca Mar 16 17:24:10 crc kubenswrapper[5120]: I0316 17:24:10.761668 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/configure-os-edpm-compute-no-nodes-edpm-compute-no-nodes-hbs5p" event={"ID":"de27760f-f52b-4895-a6ca-4a5e1845679d","Type":"ContainerStarted","Data":"d3449e83d803eafe28a02b6f2554f5036c1cf2b5bb4cce9d2fa05132b7bb4eca"} Mar 16 17:24:11 crc kubenswrapper[5120]: I0316 17:24:11.771015 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/configure-os-edpm-compute-no-nodes-edpm-compute-no-nodes-hbs5p" event={"ID":"de27760f-f52b-4895-a6ca-4a5e1845679d","Type":"ContainerStarted","Data":"1d381cc60145fbdb2c724a62542988d10f62906fe49795555657dfce2ec52bfc"} Mar 16 17:24:11 crc kubenswrapper[5120]: I0316 17:24:11.792642 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/configure-os-edpm-compute-no-nodes-edpm-compute-no-nodes-hbs5p" podStartSLOduration=2.41231706 podStartE2EDuration="2.792620563s" podCreationTimestamp="2026-03-16 17:24:09 +0000 UTC" firstStartedPulling="2026-03-16 17:24:10.522178967 +0000 UTC m=+6752.676110624" lastFinishedPulling="2026-03-16 17:24:10.90248247 +0000 UTC m=+6753.056414127" observedRunningTime="2026-03-16 17:24:11.78266325 +0000 UTC m=+6753.936594927" watchObservedRunningTime="2026-03-16 17:24:11.792620563 +0000 UTC m=+6753.946552230" Mar 16 17:24:12 crc kubenswrapper[5120]: I0316 17:24:12.785526 5120 generic.go:358] "Generic (PLEG): container finished" podID="de27760f-f52b-4895-a6ca-4a5e1845679d" containerID="1d381cc60145fbdb2c724a62542988d10f62906fe49795555657dfce2ec52bfc" exitCode=0 Mar 16 17:24:12 crc kubenswrapper[5120]: I0316 17:24:12.785596 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/configure-os-edpm-compute-no-nodes-edpm-compute-no-nodes-hbs5p" event={"ID":"de27760f-f52b-4895-a6ca-4a5e1845679d","Type":"ContainerDied","Data":"1d381cc60145fbdb2c724a62542988d10f62906fe49795555657dfce2ec52bfc"} Mar 16 17:24:14 crc kubenswrapper[5120]: I0316 17:24:14.078299 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/configure-os-edpm-compute-no-nodes-edpm-compute-no-nodes-hbs5p" Mar 16 17:24:14 crc kubenswrapper[5120]: I0316 17:24:14.212544 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/de27760f-f52b-4895-a6ca-4a5e1845679d-inventory\") pod \"de27760f-f52b-4895-a6ca-4a5e1845679d\" (UID: \"de27760f-f52b-4895-a6ca-4a5e1845679d\") " Mar 16 17:24:14 crc kubenswrapper[5120]: I0316 17:24:14.212682 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wsdnp\" (UniqueName: \"kubernetes.io/projected/de27760f-f52b-4895-a6ca-4a5e1845679d-kube-api-access-wsdnp\") pod \"de27760f-f52b-4895-a6ca-4a5e1845679d\" (UID: \"de27760f-f52b-4895-a6ca-4a5e1845679d\") " Mar 16 17:24:14 crc kubenswrapper[5120]: I0316 17:24:14.212751 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/de27760f-f52b-4895-a6ca-4a5e1845679d-ssh-key-edpm-compute-no-nodes\") pod \"de27760f-f52b-4895-a6ca-4a5e1845679d\" (UID: \"de27760f-f52b-4895-a6ca-4a5e1845679d\") " Mar 16 17:24:14 crc kubenswrapper[5120]: I0316 17:24:14.220965 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de27760f-f52b-4895-a6ca-4a5e1845679d-kube-api-access-wsdnp" (OuterVolumeSpecName: "kube-api-access-wsdnp") pod "de27760f-f52b-4895-a6ca-4a5e1845679d" (UID: "de27760f-f52b-4895-a6ca-4a5e1845679d"). InnerVolumeSpecName "kube-api-access-wsdnp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:24:14 crc kubenswrapper[5120]: I0316 17:24:14.236271 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de27760f-f52b-4895-a6ca-4a5e1845679d-inventory" (OuterVolumeSpecName: "inventory") pod "de27760f-f52b-4895-a6ca-4a5e1845679d" (UID: "de27760f-f52b-4895-a6ca-4a5e1845679d"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:24:14 crc kubenswrapper[5120]: I0316 17:24:14.239321 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de27760f-f52b-4895-a6ca-4a5e1845679d-ssh-key-edpm-compute-no-nodes" (OuterVolumeSpecName: "ssh-key-edpm-compute-no-nodes") pod "de27760f-f52b-4895-a6ca-4a5e1845679d" (UID: "de27760f-f52b-4895-a6ca-4a5e1845679d"). InnerVolumeSpecName "ssh-key-edpm-compute-no-nodes". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:24:14 crc kubenswrapper[5120]: I0316 17:24:14.315364 5120 reconciler_common.go:299] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/de27760f-f52b-4895-a6ca-4a5e1845679d-inventory\") on node \"crc\" DevicePath \"\"" Mar 16 17:24:14 crc kubenswrapper[5120]: I0316 17:24:14.315399 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wsdnp\" (UniqueName: \"kubernetes.io/projected/de27760f-f52b-4895-a6ca-4a5e1845679d-kube-api-access-wsdnp\") on node \"crc\" DevicePath \"\"" Mar 16 17:24:14 crc kubenswrapper[5120]: I0316 17:24:14.315411 5120 reconciler_common.go:299] "Volume detached for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/de27760f-f52b-4895-a6ca-4a5e1845679d-ssh-key-edpm-compute-no-nodes\") on node \"crc\" DevicePath \"\"" Mar 16 17:24:14 crc kubenswrapper[5120]: I0316 17:24:14.821205 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/configure-os-edpm-compute-no-nodes-edpm-compute-no-nodes-hbs5p" event={"ID":"de27760f-f52b-4895-a6ca-4a5e1845679d","Type":"ContainerDied","Data":"d3449e83d803eafe28a02b6f2554f5036c1cf2b5bb4cce9d2fa05132b7bb4eca"} Mar 16 17:24:14 crc kubenswrapper[5120]: I0316 17:24:14.821443 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d3449e83d803eafe28a02b6f2554f5036c1cf2b5bb4cce9d2fa05132b7bb4eca" Mar 16 17:24:14 crc kubenswrapper[5120]: I0316 17:24:14.823479 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/configure-os-edpm-compute-no-nodes-edpm-compute-no-nodes-hbs5p" Mar 16 17:24:14 crc kubenswrapper[5120]: I0316 17:24:14.862274 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/run-os-edpm-compute-no-nodes-edpm-compute-no-nodes-b728r"] Mar 16 17:24:14 crc kubenswrapper[5120]: I0316 17:24:14.863329 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de27760f-f52b-4895-a6ca-4a5e1845679d" containerName="configure-os-edpm-compute-no-nodes-edpm-compute-no-nodes" Mar 16 17:24:14 crc kubenswrapper[5120]: I0316 17:24:14.863357 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="de27760f-f52b-4895-a6ca-4a5e1845679d" containerName="configure-os-edpm-compute-no-nodes-edpm-compute-no-nodes" Mar 16 17:24:14 crc kubenswrapper[5120]: I0316 17:24:14.863519 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="de27760f-f52b-4895-a6ca-4a5e1845679d" containerName="configure-os-edpm-compute-no-nodes-edpm-compute-no-nodes" Mar 16 17:24:14 crc kubenswrapper[5120]: I0316 17:24:14.868836 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/run-os-edpm-compute-no-nodes-edpm-compute-no-nodes-b728r" Mar 16 17:24:14 crc kubenswrapper[5120]: I0316 17:24:14.868988 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/run-os-edpm-compute-no-nodes-edpm-compute-no-nodes-b728r"] Mar 16 17:24:14 crc kubenswrapper[5120]: I0316 17:24:14.871094 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplane-ansible-ssh-private-key-secret\"" Mar 16 17:24:14 crc kubenswrapper[5120]: I0316 17:24:14.871211 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-aee-default-env\"" Mar 16 17:24:14 crc kubenswrapper[5120]: I0316 17:24:14.871456 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"edpm-compute-no-nodes-dockercfg-znndh\"" Mar 16 17:24:14 crc kubenswrapper[5120]: I0316 17:24:14.872588 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplanenodeset-edpm-compute-no-nodes\"" Mar 16 17:24:15 crc kubenswrapper[5120]: I0316 17:24:15.034853 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/7d38318f-f378-43a0-a69b-44765bf3af17-ssh-key-edpm-compute-no-nodes\") pod \"run-os-edpm-compute-no-nodes-edpm-compute-no-nodes-b728r\" (UID: \"7d38318f-f378-43a0-a69b-44765bf3af17\") " pod="openstack-kuttl-tests/run-os-edpm-compute-no-nodes-edpm-compute-no-nodes-b728r" Mar 16 17:24:15 crc kubenswrapper[5120]: I0316 17:24:15.034898 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/7d38318f-f378-43a0-a69b-44765bf3af17-inventory\") pod \"run-os-edpm-compute-no-nodes-edpm-compute-no-nodes-b728r\" (UID: \"7d38318f-f378-43a0-a69b-44765bf3af17\") " pod="openstack-kuttl-tests/run-os-edpm-compute-no-nodes-edpm-compute-no-nodes-b728r" Mar 16 17:24:15 crc kubenswrapper[5120]: I0316 17:24:15.035442 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8g4wr\" (UniqueName: \"kubernetes.io/projected/7d38318f-f378-43a0-a69b-44765bf3af17-kube-api-access-8g4wr\") pod \"run-os-edpm-compute-no-nodes-edpm-compute-no-nodes-b728r\" (UID: \"7d38318f-f378-43a0-a69b-44765bf3af17\") " pod="openstack-kuttl-tests/run-os-edpm-compute-no-nodes-edpm-compute-no-nodes-b728r" Mar 16 17:24:15 crc kubenswrapper[5120]: I0316 17:24:15.138165 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8g4wr\" (UniqueName: \"kubernetes.io/projected/7d38318f-f378-43a0-a69b-44765bf3af17-kube-api-access-8g4wr\") pod \"run-os-edpm-compute-no-nodes-edpm-compute-no-nodes-b728r\" (UID: \"7d38318f-f378-43a0-a69b-44765bf3af17\") " pod="openstack-kuttl-tests/run-os-edpm-compute-no-nodes-edpm-compute-no-nodes-b728r" Mar 16 17:24:15 crc kubenswrapper[5120]: I0316 17:24:15.138469 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/7d38318f-f378-43a0-a69b-44765bf3af17-ssh-key-edpm-compute-no-nodes\") pod \"run-os-edpm-compute-no-nodes-edpm-compute-no-nodes-b728r\" (UID: \"7d38318f-f378-43a0-a69b-44765bf3af17\") " pod="openstack-kuttl-tests/run-os-edpm-compute-no-nodes-edpm-compute-no-nodes-b728r" Mar 16 17:24:15 crc kubenswrapper[5120]: I0316 17:24:15.138504 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/7d38318f-f378-43a0-a69b-44765bf3af17-inventory\") pod \"run-os-edpm-compute-no-nodes-edpm-compute-no-nodes-b728r\" (UID: \"7d38318f-f378-43a0-a69b-44765bf3af17\") " pod="openstack-kuttl-tests/run-os-edpm-compute-no-nodes-edpm-compute-no-nodes-b728r" Mar 16 17:24:15 crc kubenswrapper[5120]: I0316 17:24:15.147171 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/7d38318f-f378-43a0-a69b-44765bf3af17-ssh-key-edpm-compute-no-nodes\") pod \"run-os-edpm-compute-no-nodes-edpm-compute-no-nodes-b728r\" (UID: \"7d38318f-f378-43a0-a69b-44765bf3af17\") " pod="openstack-kuttl-tests/run-os-edpm-compute-no-nodes-edpm-compute-no-nodes-b728r" Mar 16 17:24:15 crc kubenswrapper[5120]: I0316 17:24:15.149586 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/7d38318f-f378-43a0-a69b-44765bf3af17-inventory\") pod \"run-os-edpm-compute-no-nodes-edpm-compute-no-nodes-b728r\" (UID: \"7d38318f-f378-43a0-a69b-44765bf3af17\") " pod="openstack-kuttl-tests/run-os-edpm-compute-no-nodes-edpm-compute-no-nodes-b728r" Mar 16 17:24:15 crc kubenswrapper[5120]: I0316 17:24:15.163125 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8g4wr\" (UniqueName: \"kubernetes.io/projected/7d38318f-f378-43a0-a69b-44765bf3af17-kube-api-access-8g4wr\") pod \"run-os-edpm-compute-no-nodes-edpm-compute-no-nodes-b728r\" (UID: \"7d38318f-f378-43a0-a69b-44765bf3af17\") " pod="openstack-kuttl-tests/run-os-edpm-compute-no-nodes-edpm-compute-no-nodes-b728r" Mar 16 17:24:15 crc kubenswrapper[5120]: I0316 17:24:15.189218 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/run-os-edpm-compute-no-nodes-edpm-compute-no-nodes-b728r" Mar 16 17:24:15 crc kubenswrapper[5120]: I0316 17:24:15.609599 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/run-os-edpm-compute-no-nodes-edpm-compute-no-nodes-b728r"] Mar 16 17:24:15 crc kubenswrapper[5120]: W0316 17:24:15.614407 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7d38318f_f378_43a0_a69b_44765bf3af17.slice/crio-79a70483c7d9a21499ea106e459b0ce2e42721ba2bb1cc1a091027daf8456245 WatchSource:0}: Error finding container 79a70483c7d9a21499ea106e459b0ce2e42721ba2bb1cc1a091027daf8456245: Status 404 returned error can't find the container with id 79a70483c7d9a21499ea106e459b0ce2e42721ba2bb1cc1a091027daf8456245 Mar 16 17:24:15 crc kubenswrapper[5120]: I0316 17:24:15.833192 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/run-os-edpm-compute-no-nodes-edpm-compute-no-nodes-b728r" event={"ID":"7d38318f-f378-43a0-a69b-44765bf3af17","Type":"ContainerStarted","Data":"79a70483c7d9a21499ea106e459b0ce2e42721ba2bb1cc1a091027daf8456245"} Mar 16 17:24:16 crc kubenswrapper[5120]: I0316 17:24:16.844719 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/run-os-edpm-compute-no-nodes-edpm-compute-no-nodes-b728r" event={"ID":"7d38318f-f378-43a0-a69b-44765bf3af17","Type":"ContainerStarted","Data":"d83667513e345e9469836704314b9afc88c38cb055463bed8312804a2e2f66f7"} Mar 16 17:24:16 crc kubenswrapper[5120]: I0316 17:24:16.861493 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/run-os-edpm-compute-no-nodes-edpm-compute-no-nodes-b728r" podStartSLOduration=2.369315712 podStartE2EDuration="2.861472121s" podCreationTimestamp="2026-03-16 17:24:14 +0000 UTC" firstStartedPulling="2026-03-16 17:24:15.615962446 +0000 UTC m=+6757.769894103" lastFinishedPulling="2026-03-16 17:24:16.108118855 +0000 UTC m=+6758.262050512" observedRunningTime="2026-03-16 17:24:16.85996989 +0000 UTC m=+6759.013901547" watchObservedRunningTime="2026-03-16 17:24:16.861472121 +0000 UTC m=+6759.015403778" Mar 16 17:24:17 crc kubenswrapper[5120]: I0316 17:24:17.857468 5120 generic.go:358] "Generic (PLEG): container finished" podID="7d38318f-f378-43a0-a69b-44765bf3af17" containerID="d83667513e345e9469836704314b9afc88c38cb055463bed8312804a2e2f66f7" exitCode=0 Mar 16 17:24:17 crc kubenswrapper[5120]: I0316 17:24:17.857565 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/run-os-edpm-compute-no-nodes-edpm-compute-no-nodes-b728r" event={"ID":"7d38318f-f378-43a0-a69b-44765bf3af17","Type":"ContainerDied","Data":"d83667513e345e9469836704314b9afc88c38cb055463bed8312804a2e2f66f7"} Mar 16 17:24:19 crc kubenswrapper[5120]: I0316 17:24:19.192653 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/run-os-edpm-compute-no-nodes-edpm-compute-no-nodes-b728r" Mar 16 17:24:19 crc kubenswrapper[5120]: I0316 17:24:19.227025 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/7d38318f-f378-43a0-a69b-44765bf3af17-inventory\") pod \"7d38318f-f378-43a0-a69b-44765bf3af17\" (UID: \"7d38318f-f378-43a0-a69b-44765bf3af17\") " Mar 16 17:24:19 crc kubenswrapper[5120]: I0316 17:24:19.227636 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8g4wr\" (UniqueName: \"kubernetes.io/projected/7d38318f-f378-43a0-a69b-44765bf3af17-kube-api-access-8g4wr\") pod \"7d38318f-f378-43a0-a69b-44765bf3af17\" (UID: \"7d38318f-f378-43a0-a69b-44765bf3af17\") " Mar 16 17:24:19 crc kubenswrapper[5120]: I0316 17:24:19.227843 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/7d38318f-f378-43a0-a69b-44765bf3af17-ssh-key-edpm-compute-no-nodes\") pod \"7d38318f-f378-43a0-a69b-44765bf3af17\" (UID: \"7d38318f-f378-43a0-a69b-44765bf3af17\") " Mar 16 17:24:19 crc kubenswrapper[5120]: I0316 17:24:19.237275 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d38318f-f378-43a0-a69b-44765bf3af17-kube-api-access-8g4wr" (OuterVolumeSpecName: "kube-api-access-8g4wr") pod "7d38318f-f378-43a0-a69b-44765bf3af17" (UID: "7d38318f-f378-43a0-a69b-44765bf3af17"). InnerVolumeSpecName "kube-api-access-8g4wr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:24:19 crc kubenswrapper[5120]: I0316 17:24:19.255430 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d38318f-f378-43a0-a69b-44765bf3af17-inventory" (OuterVolumeSpecName: "inventory") pod "7d38318f-f378-43a0-a69b-44765bf3af17" (UID: "7d38318f-f378-43a0-a69b-44765bf3af17"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:24:19 crc kubenswrapper[5120]: I0316 17:24:19.256437 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d38318f-f378-43a0-a69b-44765bf3af17-ssh-key-edpm-compute-no-nodes" (OuterVolumeSpecName: "ssh-key-edpm-compute-no-nodes") pod "7d38318f-f378-43a0-a69b-44765bf3af17" (UID: "7d38318f-f378-43a0-a69b-44765bf3af17"). InnerVolumeSpecName "ssh-key-edpm-compute-no-nodes". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:24:19 crc kubenswrapper[5120]: I0316 17:24:19.333103 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8g4wr\" (UniqueName: \"kubernetes.io/projected/7d38318f-f378-43a0-a69b-44765bf3af17-kube-api-access-8g4wr\") on node \"crc\" DevicePath \"\"" Mar 16 17:24:19 crc kubenswrapper[5120]: I0316 17:24:19.333152 5120 reconciler_common.go:299] "Volume detached for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/7d38318f-f378-43a0-a69b-44765bf3af17-ssh-key-edpm-compute-no-nodes\") on node \"crc\" DevicePath \"\"" Mar 16 17:24:19 crc kubenswrapper[5120]: I0316 17:24:19.333236 5120 reconciler_common.go:299] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/7d38318f-f378-43a0-a69b-44765bf3af17-inventory\") on node \"crc\" DevicePath \"\"" Mar 16 17:24:19 crc kubenswrapper[5120]: I0316 17:24:19.931666 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/run-os-edpm-compute-no-nodes-edpm-compute-no-nodes-b728r" event={"ID":"7d38318f-f378-43a0-a69b-44765bf3af17","Type":"ContainerDied","Data":"79a70483c7d9a21499ea106e459b0ce2e42721ba2bb1cc1a091027daf8456245"} Mar 16 17:24:19 crc kubenswrapper[5120]: I0316 17:24:19.931742 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="79a70483c7d9a21499ea106e459b0ce2e42721ba2bb1cc1a091027daf8456245" Mar 16 17:24:19 crc kubenswrapper[5120]: I0316 17:24:19.931982 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/run-os-edpm-compute-no-nodes-edpm-compute-no-nodes-b728r" Mar 16 17:24:19 crc kubenswrapper[5120]: I0316 17:24:19.949037 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-5q7fr"] Mar 16 17:24:19 crc kubenswrapper[5120]: I0316 17:24:19.950084 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d38318f-f378-43a0-a69b-44765bf3af17" containerName="run-os-edpm-compute-no-nodes-edpm-compute-no-nodes" Mar 16 17:24:19 crc kubenswrapper[5120]: I0316 17:24:19.950111 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d38318f-f378-43a0-a69b-44765bf3af17" containerName="run-os-edpm-compute-no-nodes-edpm-compute-no-nodes" Mar 16 17:24:19 crc kubenswrapper[5120]: I0316 17:24:19.950285 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7d38318f-f378-43a0-a69b-44765bf3af17" containerName="run-os-edpm-compute-no-nodes-edpm-compute-no-nodes" Mar 16 17:24:19 crc kubenswrapper[5120]: I0316 17:24:19.955156 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-5q7fr" Mar 16 17:24:19 crc kubenswrapper[5120]: I0316 17:24:19.958077 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"combined-ca-bundle\"" Mar 16 17:24:19 crc kubenswrapper[5120]: I0316 17:24:19.959297 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-aee-default-env\"" Mar 16 17:24:19 crc kubenswrapper[5120]: I0316 17:24:19.959404 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplanenodeset-edpm-compute-no-nodes\"" Mar 16 17:24:19 crc kubenswrapper[5120]: I0316 17:24:19.959740 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplane-ansible-ssh-private-key-secret\"" Mar 16 17:24:19 crc kubenswrapper[5120]: I0316 17:24:19.959980 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"edpm-compute-no-nodes-dockercfg-znndh\"" Mar 16 17:24:19 crc kubenswrapper[5120]: I0316 17:24:19.961425 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-5q7fr"] Mar 16 17:24:20 crc kubenswrapper[5120]: I0316 17:24:20.048287 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"libvirt-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8fded38e-5987-4d93-b8f5-ae718d6cb529-libvirt-combined-ca-bundle\") pod \"install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-5q7fr\" (UID: \"8fded38e-5987-4d93-b8f5-ae718d6cb529\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-5q7fr" Mar 16 17:24:20 crc kubenswrapper[5120]: I0316 17:24:20.048599 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"neutron-ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8fded38e-5987-4d93-b8f5-ae718d6cb529-neutron-ovn-combined-ca-bundle\") pod \"install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-5q7fr\" (UID: \"8fded38e-5987-4d93-b8f5-ae718d6cb529\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-5q7fr" Mar 16 17:24:20 crc kubenswrapper[5120]: I0316 17:24:20.048908 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8fded38e-5987-4d93-b8f5-ae718d6cb529-nova-combined-ca-bundle\") pod \"install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-5q7fr\" (UID: \"8fded38e-5987-4d93-b8f5-ae718d6cb529\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-5q7fr" Mar 16 17:24:20 crc kubenswrapper[5120]: I0316 17:24:20.048990 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"neutron-sriov-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8fded38e-5987-4d93-b8f5-ae718d6cb529-neutron-sriov-combined-ca-bundle\") pod \"install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-5q7fr\" (UID: \"8fded38e-5987-4d93-b8f5-ae718d6cb529\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-5q7fr" Mar 16 17:24:20 crc kubenswrapper[5120]: I0316 17:24:20.049058 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/8fded38e-5987-4d93-b8f5-ae718d6cb529-inventory\") pod \"install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-5q7fr\" (UID: \"8fded38e-5987-4d93-b8f5-ae718d6cb529\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-5q7fr" Mar 16 17:24:20 crc kubenswrapper[5120]: I0316 17:24:20.049120 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"neutron-metadata-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8fded38e-5987-4d93-b8f5-ae718d6cb529-neutron-metadata-combined-ca-bundle\") pod \"install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-5q7fr\" (UID: \"8fded38e-5987-4d93-b8f5-ae718d6cb529\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-5q7fr" Mar 16 17:24:20 crc kubenswrapper[5120]: I0316 17:24:20.049183 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptq6r\" (UniqueName: \"kubernetes.io/projected/8fded38e-5987-4d93-b8f5-ae718d6cb529-kube-api-access-ptq6r\") pod \"install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-5q7fr\" (UID: \"8fded38e-5987-4d93-b8f5-ae718d6cb529\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-5q7fr" Mar 16 17:24:20 crc kubenswrapper[5120]: I0316 17:24:20.049224 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"neutron-dhcp-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8fded38e-5987-4d93-b8f5-ae718d6cb529-neutron-dhcp-combined-ca-bundle\") pod \"install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-5q7fr\" (UID: \"8fded38e-5987-4d93-b8f5-ae718d6cb529\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-5q7fr" Mar 16 17:24:20 crc kubenswrapper[5120]: I0316 17:24:20.049319 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bootstrap-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8fded38e-5987-4d93-b8f5-ae718d6cb529-bootstrap-combined-ca-bundle\") pod \"install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-5q7fr\" (UID: \"8fded38e-5987-4d93-b8f5-ae718d6cb529\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-5q7fr" Mar 16 17:24:20 crc kubenswrapper[5120]: I0316 17:24:20.049606 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8fded38e-5987-4d93-b8f5-ae718d6cb529-ovn-combined-ca-bundle\") pod \"install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-5q7fr\" (UID: \"8fded38e-5987-4d93-b8f5-ae718d6cb529\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-5q7fr" Mar 16 17:24:20 crc kubenswrapper[5120]: I0316 17:24:20.049648 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/8fded38e-5987-4d93-b8f5-ae718d6cb529-ssh-key-edpm-compute-no-nodes\") pod \"install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-5q7fr\" (UID: \"8fded38e-5987-4d93-b8f5-ae718d6cb529\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-5q7fr" Mar 16 17:24:20 crc kubenswrapper[5120]: I0316 17:24:20.151182 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/8fded38e-5987-4d93-b8f5-ae718d6cb529-inventory\") pod \"install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-5q7fr\" (UID: \"8fded38e-5987-4d93-b8f5-ae718d6cb529\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-5q7fr" Mar 16 17:24:20 crc kubenswrapper[5120]: I0316 17:24:20.151234 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"neutron-metadata-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8fded38e-5987-4d93-b8f5-ae718d6cb529-neutron-metadata-combined-ca-bundle\") pod \"install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-5q7fr\" (UID: \"8fded38e-5987-4d93-b8f5-ae718d6cb529\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-5q7fr" Mar 16 17:24:20 crc kubenswrapper[5120]: I0316 17:24:20.151271 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ptq6r\" (UniqueName: \"kubernetes.io/projected/8fded38e-5987-4d93-b8f5-ae718d6cb529-kube-api-access-ptq6r\") pod \"install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-5q7fr\" (UID: \"8fded38e-5987-4d93-b8f5-ae718d6cb529\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-5q7fr" Mar 16 17:24:20 crc kubenswrapper[5120]: I0316 17:24:20.151302 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"neutron-dhcp-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8fded38e-5987-4d93-b8f5-ae718d6cb529-neutron-dhcp-combined-ca-bundle\") pod \"install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-5q7fr\" (UID: \"8fded38e-5987-4d93-b8f5-ae718d6cb529\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-5q7fr" Mar 16 17:24:20 crc kubenswrapper[5120]: I0316 17:24:20.151351 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bootstrap-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8fded38e-5987-4d93-b8f5-ae718d6cb529-bootstrap-combined-ca-bundle\") pod \"install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-5q7fr\" (UID: \"8fded38e-5987-4d93-b8f5-ae718d6cb529\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-5q7fr" Mar 16 17:24:20 crc kubenswrapper[5120]: I0316 17:24:20.151412 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8fded38e-5987-4d93-b8f5-ae718d6cb529-ovn-combined-ca-bundle\") pod \"install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-5q7fr\" (UID: \"8fded38e-5987-4d93-b8f5-ae718d6cb529\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-5q7fr" Mar 16 17:24:20 crc kubenswrapper[5120]: I0316 17:24:20.151433 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/8fded38e-5987-4d93-b8f5-ae718d6cb529-ssh-key-edpm-compute-no-nodes\") pod \"install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-5q7fr\" (UID: \"8fded38e-5987-4d93-b8f5-ae718d6cb529\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-5q7fr" Mar 16 17:24:20 crc kubenswrapper[5120]: I0316 17:24:20.151587 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"libvirt-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8fded38e-5987-4d93-b8f5-ae718d6cb529-libvirt-combined-ca-bundle\") pod \"install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-5q7fr\" (UID: \"8fded38e-5987-4d93-b8f5-ae718d6cb529\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-5q7fr" Mar 16 17:24:20 crc kubenswrapper[5120]: I0316 17:24:20.151625 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"neutron-ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8fded38e-5987-4d93-b8f5-ae718d6cb529-neutron-ovn-combined-ca-bundle\") pod \"install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-5q7fr\" (UID: \"8fded38e-5987-4d93-b8f5-ae718d6cb529\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-5q7fr" Mar 16 17:24:20 crc kubenswrapper[5120]: I0316 17:24:20.151649 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8fded38e-5987-4d93-b8f5-ae718d6cb529-nova-combined-ca-bundle\") pod \"install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-5q7fr\" (UID: \"8fded38e-5987-4d93-b8f5-ae718d6cb529\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-5q7fr" Mar 16 17:24:20 crc kubenswrapper[5120]: I0316 17:24:20.151683 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"neutron-sriov-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8fded38e-5987-4d93-b8f5-ae718d6cb529-neutron-sriov-combined-ca-bundle\") pod \"install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-5q7fr\" (UID: \"8fded38e-5987-4d93-b8f5-ae718d6cb529\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-5q7fr" Mar 16 17:24:20 crc kubenswrapper[5120]: I0316 17:24:20.156214 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"neutron-ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8fded38e-5987-4d93-b8f5-ae718d6cb529-neutron-ovn-combined-ca-bundle\") pod \"install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-5q7fr\" (UID: \"8fded38e-5987-4d93-b8f5-ae718d6cb529\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-5q7fr" Mar 16 17:24:20 crc kubenswrapper[5120]: I0316 17:24:20.156214 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"neutron-metadata-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8fded38e-5987-4d93-b8f5-ae718d6cb529-neutron-metadata-combined-ca-bundle\") pod \"install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-5q7fr\" (UID: \"8fded38e-5987-4d93-b8f5-ae718d6cb529\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-5q7fr" Mar 16 17:24:20 crc kubenswrapper[5120]: I0316 17:24:20.156251 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"neutron-dhcp-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8fded38e-5987-4d93-b8f5-ae718d6cb529-neutron-dhcp-combined-ca-bundle\") pod \"install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-5q7fr\" (UID: \"8fded38e-5987-4d93-b8f5-ae718d6cb529\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-5q7fr" Mar 16 17:24:20 crc kubenswrapper[5120]: I0316 17:24:20.156467 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"libvirt-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8fded38e-5987-4d93-b8f5-ae718d6cb529-libvirt-combined-ca-bundle\") pod \"install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-5q7fr\" (UID: \"8fded38e-5987-4d93-b8f5-ae718d6cb529\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-5q7fr" Mar 16 17:24:20 crc kubenswrapper[5120]: I0316 17:24:20.156647 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"neutron-sriov-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8fded38e-5987-4d93-b8f5-ae718d6cb529-neutron-sriov-combined-ca-bundle\") pod \"install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-5q7fr\" (UID: \"8fded38e-5987-4d93-b8f5-ae718d6cb529\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-5q7fr" Mar 16 17:24:20 crc kubenswrapper[5120]: I0316 17:24:20.156733 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8fded38e-5987-4d93-b8f5-ae718d6cb529-nova-combined-ca-bundle\") pod \"install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-5q7fr\" (UID: \"8fded38e-5987-4d93-b8f5-ae718d6cb529\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-5q7fr" Mar 16 17:24:20 crc kubenswrapper[5120]: I0316 17:24:20.157119 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/8fded38e-5987-4d93-b8f5-ae718d6cb529-inventory\") pod \"install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-5q7fr\" (UID: \"8fded38e-5987-4d93-b8f5-ae718d6cb529\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-5q7fr" Mar 16 17:24:20 crc kubenswrapper[5120]: I0316 17:24:20.157583 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/8fded38e-5987-4d93-b8f5-ae718d6cb529-ssh-key-edpm-compute-no-nodes\") pod \"install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-5q7fr\" (UID: \"8fded38e-5987-4d93-b8f5-ae718d6cb529\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-5q7fr" Mar 16 17:24:20 crc kubenswrapper[5120]: I0316 17:24:20.160286 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8fded38e-5987-4d93-b8f5-ae718d6cb529-ovn-combined-ca-bundle\") pod \"install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-5q7fr\" (UID: \"8fded38e-5987-4d93-b8f5-ae718d6cb529\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-5q7fr" Mar 16 17:24:20 crc kubenswrapper[5120]: I0316 17:24:20.166125 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bootstrap-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8fded38e-5987-4d93-b8f5-ae718d6cb529-bootstrap-combined-ca-bundle\") pod \"install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-5q7fr\" (UID: \"8fded38e-5987-4d93-b8f5-ae718d6cb529\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-5q7fr" Mar 16 17:24:20 crc kubenswrapper[5120]: I0316 17:24:20.168683 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptq6r\" (UniqueName: \"kubernetes.io/projected/8fded38e-5987-4d93-b8f5-ae718d6cb529-kube-api-access-ptq6r\") pod \"install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-5q7fr\" (UID: \"8fded38e-5987-4d93-b8f5-ae718d6cb529\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-5q7fr" Mar 16 17:24:20 crc kubenswrapper[5120]: I0316 17:24:20.283303 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-5q7fr" Mar 16 17:24:20 crc kubenswrapper[5120]: I0316 17:24:20.706563 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-5q7fr"] Mar 16 17:24:20 crc kubenswrapper[5120]: W0316 17:24:20.709000 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8fded38e_5987_4d93_b8f5_ae718d6cb529.slice/crio-dabd10a8f84bf440952377e1330ed15ebc98a7ea0333cf4edf8cb7b97c7a0f9c WatchSource:0}: Error finding container dabd10a8f84bf440952377e1330ed15ebc98a7ea0333cf4edf8cb7b97c7a0f9c: Status 404 returned error can't find the container with id dabd10a8f84bf440952377e1330ed15ebc98a7ea0333cf4edf8cb7b97c7a0f9c Mar 16 17:24:20 crc kubenswrapper[5120]: I0316 17:24:20.940267 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-5q7fr" event={"ID":"8fded38e-5987-4d93-b8f5-ae718d6cb529","Type":"ContainerStarted","Data":"dabd10a8f84bf440952377e1330ed15ebc98a7ea0333cf4edf8cb7b97c7a0f9c"} Mar 16 17:24:21 crc kubenswrapper[5120]: I0316 17:24:21.955013 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-5q7fr" event={"ID":"8fded38e-5987-4d93-b8f5-ae718d6cb529","Type":"ContainerStarted","Data":"fcecca7b41949210ed0391e5e10474c2b21d59845467faabdc5ca827a86ad8f3"} Mar 16 17:24:21 crc kubenswrapper[5120]: I0316 17:24:21.993111 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-5q7fr" podStartSLOduration=2.444924746 podStartE2EDuration="2.993073823s" podCreationTimestamp="2026-03-16 17:24:19 +0000 UTC" firstStartedPulling="2026-03-16 17:24:20.710598429 +0000 UTC m=+6762.864530086" lastFinishedPulling="2026-03-16 17:24:21.258747506 +0000 UTC m=+6763.412679163" observedRunningTime="2026-03-16 17:24:21.982601636 +0000 UTC m=+6764.136533293" watchObservedRunningTime="2026-03-16 17:24:21.993073823 +0000 UTC m=+6764.147005480" Mar 16 17:24:22 crc kubenswrapper[5120]: I0316 17:24:22.971725 5120 generic.go:358] "Generic (PLEG): container finished" podID="8fded38e-5987-4d93-b8f5-ae718d6cb529" containerID="fcecca7b41949210ed0391e5e10474c2b21d59845467faabdc5ca827a86ad8f3" exitCode=0 Mar 16 17:24:22 crc kubenswrapper[5120]: I0316 17:24:22.971824 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-5q7fr" event={"ID":"8fded38e-5987-4d93-b8f5-ae718d6cb529","Type":"ContainerDied","Data":"fcecca7b41949210ed0391e5e10474c2b21d59845467faabdc5ca827a86ad8f3"} Mar 16 17:24:24 crc kubenswrapper[5120]: I0316 17:24:24.258915 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-5q7fr" Mar 16 17:24:24 crc kubenswrapper[5120]: I0316 17:24:24.341534 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"neutron-sriov-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8fded38e-5987-4d93-b8f5-ae718d6cb529-neutron-sriov-combined-ca-bundle\") pod \"8fded38e-5987-4d93-b8f5-ae718d6cb529\" (UID: \"8fded38e-5987-4d93-b8f5-ae718d6cb529\") " Mar 16 17:24:24 crc kubenswrapper[5120]: I0316 17:24:24.341663 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/8fded38e-5987-4d93-b8f5-ae718d6cb529-inventory\") pod \"8fded38e-5987-4d93-b8f5-ae718d6cb529\" (UID: \"8fded38e-5987-4d93-b8f5-ae718d6cb529\") " Mar 16 17:24:24 crc kubenswrapper[5120]: I0316 17:24:24.341722 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8fded38e-5987-4d93-b8f5-ae718d6cb529-nova-combined-ca-bundle\") pod \"8fded38e-5987-4d93-b8f5-ae718d6cb529\" (UID: \"8fded38e-5987-4d93-b8f5-ae718d6cb529\") " Mar 16 17:24:24 crc kubenswrapper[5120]: I0316 17:24:24.341841 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ptq6r\" (UniqueName: \"kubernetes.io/projected/8fded38e-5987-4d93-b8f5-ae718d6cb529-kube-api-access-ptq6r\") pod \"8fded38e-5987-4d93-b8f5-ae718d6cb529\" (UID: \"8fded38e-5987-4d93-b8f5-ae718d6cb529\") " Mar 16 17:24:24 crc kubenswrapper[5120]: I0316 17:24:24.341958 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"neutron-metadata-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8fded38e-5987-4d93-b8f5-ae718d6cb529-neutron-metadata-combined-ca-bundle\") pod \"8fded38e-5987-4d93-b8f5-ae718d6cb529\" (UID: \"8fded38e-5987-4d93-b8f5-ae718d6cb529\") " Mar 16 17:24:24 crc kubenswrapper[5120]: I0316 17:24:24.342008 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/8fded38e-5987-4d93-b8f5-ae718d6cb529-ssh-key-edpm-compute-no-nodes\") pod \"8fded38e-5987-4d93-b8f5-ae718d6cb529\" (UID: \"8fded38e-5987-4d93-b8f5-ae718d6cb529\") " Mar 16 17:24:24 crc kubenswrapper[5120]: I0316 17:24:24.342050 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"neutron-ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8fded38e-5987-4d93-b8f5-ae718d6cb529-neutron-ovn-combined-ca-bundle\") pod \"8fded38e-5987-4d93-b8f5-ae718d6cb529\" (UID: \"8fded38e-5987-4d93-b8f5-ae718d6cb529\") " Mar 16 17:24:24 crc kubenswrapper[5120]: I0316 17:24:24.342193 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"neutron-dhcp-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8fded38e-5987-4d93-b8f5-ae718d6cb529-neutron-dhcp-combined-ca-bundle\") pod \"8fded38e-5987-4d93-b8f5-ae718d6cb529\" (UID: \"8fded38e-5987-4d93-b8f5-ae718d6cb529\") " Mar 16 17:24:24 crc kubenswrapper[5120]: I0316 17:24:24.342588 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8fded38e-5987-4d93-b8f5-ae718d6cb529-ovn-combined-ca-bundle\") pod \"8fded38e-5987-4d93-b8f5-ae718d6cb529\" (UID: \"8fded38e-5987-4d93-b8f5-ae718d6cb529\") " Mar 16 17:24:24 crc kubenswrapper[5120]: I0316 17:24:24.342703 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bootstrap-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8fded38e-5987-4d93-b8f5-ae718d6cb529-bootstrap-combined-ca-bundle\") pod \"8fded38e-5987-4d93-b8f5-ae718d6cb529\" (UID: \"8fded38e-5987-4d93-b8f5-ae718d6cb529\") " Mar 16 17:24:24 crc kubenswrapper[5120]: I0316 17:24:24.342851 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"libvirt-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8fded38e-5987-4d93-b8f5-ae718d6cb529-libvirt-combined-ca-bundle\") pod \"8fded38e-5987-4d93-b8f5-ae718d6cb529\" (UID: \"8fded38e-5987-4d93-b8f5-ae718d6cb529\") " Mar 16 17:24:24 crc kubenswrapper[5120]: I0316 17:24:24.348476 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8fded38e-5987-4d93-b8f5-ae718d6cb529-kube-api-access-ptq6r" (OuterVolumeSpecName: "kube-api-access-ptq6r") pod "8fded38e-5987-4d93-b8f5-ae718d6cb529" (UID: "8fded38e-5987-4d93-b8f5-ae718d6cb529"). InnerVolumeSpecName "kube-api-access-ptq6r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:24:24 crc kubenswrapper[5120]: I0316 17:24:24.348597 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8fded38e-5987-4d93-b8f5-ae718d6cb529-neutron-metadata-combined-ca-bundle" (OuterVolumeSpecName: "neutron-metadata-combined-ca-bundle") pod "8fded38e-5987-4d93-b8f5-ae718d6cb529" (UID: "8fded38e-5987-4d93-b8f5-ae718d6cb529"). InnerVolumeSpecName "neutron-metadata-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:24:24 crc kubenswrapper[5120]: I0316 17:24:24.348659 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8fded38e-5987-4d93-b8f5-ae718d6cb529-neutron-ovn-combined-ca-bundle" (OuterVolumeSpecName: "neutron-ovn-combined-ca-bundle") pod "8fded38e-5987-4d93-b8f5-ae718d6cb529" (UID: "8fded38e-5987-4d93-b8f5-ae718d6cb529"). InnerVolumeSpecName "neutron-ovn-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:24:24 crc kubenswrapper[5120]: I0316 17:24:24.348804 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8fded38e-5987-4d93-b8f5-ae718d6cb529-neutron-sriov-combined-ca-bundle" (OuterVolumeSpecName: "neutron-sriov-combined-ca-bundle") pod "8fded38e-5987-4d93-b8f5-ae718d6cb529" (UID: "8fded38e-5987-4d93-b8f5-ae718d6cb529"). InnerVolumeSpecName "neutron-sriov-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:24:24 crc kubenswrapper[5120]: I0316 17:24:24.350873 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8fded38e-5987-4d93-b8f5-ae718d6cb529-bootstrap-combined-ca-bundle" (OuterVolumeSpecName: "bootstrap-combined-ca-bundle") pod "8fded38e-5987-4d93-b8f5-ae718d6cb529" (UID: "8fded38e-5987-4d93-b8f5-ae718d6cb529"). InnerVolumeSpecName "bootstrap-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:24:24 crc kubenswrapper[5120]: I0316 17:24:24.351019 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8fded38e-5987-4d93-b8f5-ae718d6cb529-neutron-dhcp-combined-ca-bundle" (OuterVolumeSpecName: "neutron-dhcp-combined-ca-bundle") pod "8fded38e-5987-4d93-b8f5-ae718d6cb529" (UID: "8fded38e-5987-4d93-b8f5-ae718d6cb529"). InnerVolumeSpecName "neutron-dhcp-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:24:24 crc kubenswrapper[5120]: I0316 17:24:24.351032 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8fded38e-5987-4d93-b8f5-ae718d6cb529-nova-combined-ca-bundle" (OuterVolumeSpecName: "nova-combined-ca-bundle") pod "8fded38e-5987-4d93-b8f5-ae718d6cb529" (UID: "8fded38e-5987-4d93-b8f5-ae718d6cb529"). InnerVolumeSpecName "nova-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:24:24 crc kubenswrapper[5120]: I0316 17:24:24.351078 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8fded38e-5987-4d93-b8f5-ae718d6cb529-libvirt-combined-ca-bundle" (OuterVolumeSpecName: "libvirt-combined-ca-bundle") pod "8fded38e-5987-4d93-b8f5-ae718d6cb529" (UID: "8fded38e-5987-4d93-b8f5-ae718d6cb529"). InnerVolumeSpecName "libvirt-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:24:24 crc kubenswrapper[5120]: I0316 17:24:24.354899 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8fded38e-5987-4d93-b8f5-ae718d6cb529-ovn-combined-ca-bundle" (OuterVolumeSpecName: "ovn-combined-ca-bundle") pod "8fded38e-5987-4d93-b8f5-ae718d6cb529" (UID: "8fded38e-5987-4d93-b8f5-ae718d6cb529"). InnerVolumeSpecName "ovn-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:24:24 crc kubenswrapper[5120]: I0316 17:24:24.369053 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8fded38e-5987-4d93-b8f5-ae718d6cb529-inventory" (OuterVolumeSpecName: "inventory") pod "8fded38e-5987-4d93-b8f5-ae718d6cb529" (UID: "8fded38e-5987-4d93-b8f5-ae718d6cb529"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:24:24 crc kubenswrapper[5120]: I0316 17:24:24.371048 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8fded38e-5987-4d93-b8f5-ae718d6cb529-ssh-key-edpm-compute-no-nodes" (OuterVolumeSpecName: "ssh-key-edpm-compute-no-nodes") pod "8fded38e-5987-4d93-b8f5-ae718d6cb529" (UID: "8fded38e-5987-4d93-b8f5-ae718d6cb529"). InnerVolumeSpecName "ssh-key-edpm-compute-no-nodes". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:24:24 crc kubenswrapper[5120]: I0316 17:24:24.445927 5120 reconciler_common.go:299] "Volume detached for volume \"bootstrap-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8fded38e-5987-4d93-b8f5-ae718d6cb529-bootstrap-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:24:24 crc kubenswrapper[5120]: I0316 17:24:24.445966 5120 reconciler_common.go:299] "Volume detached for volume \"libvirt-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8fded38e-5987-4d93-b8f5-ae718d6cb529-libvirt-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:24:24 crc kubenswrapper[5120]: I0316 17:24:24.445975 5120 reconciler_common.go:299] "Volume detached for volume \"neutron-sriov-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8fded38e-5987-4d93-b8f5-ae718d6cb529-neutron-sriov-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:24:24 crc kubenswrapper[5120]: I0316 17:24:24.445989 5120 reconciler_common.go:299] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/8fded38e-5987-4d93-b8f5-ae718d6cb529-inventory\") on node \"crc\" DevicePath \"\"" Mar 16 17:24:24 crc kubenswrapper[5120]: I0316 17:24:24.446001 5120 reconciler_common.go:299] "Volume detached for volume \"nova-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8fded38e-5987-4d93-b8f5-ae718d6cb529-nova-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:24:24 crc kubenswrapper[5120]: I0316 17:24:24.446010 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ptq6r\" (UniqueName: \"kubernetes.io/projected/8fded38e-5987-4d93-b8f5-ae718d6cb529-kube-api-access-ptq6r\") on node \"crc\" DevicePath \"\"" Mar 16 17:24:24 crc kubenswrapper[5120]: I0316 17:24:24.446018 5120 reconciler_common.go:299] "Volume detached for volume \"neutron-metadata-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8fded38e-5987-4d93-b8f5-ae718d6cb529-neutron-metadata-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:24:24 crc kubenswrapper[5120]: I0316 17:24:24.446027 5120 reconciler_common.go:299] "Volume detached for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/8fded38e-5987-4d93-b8f5-ae718d6cb529-ssh-key-edpm-compute-no-nodes\") on node \"crc\" DevicePath \"\"" Mar 16 17:24:24 crc kubenswrapper[5120]: I0316 17:24:24.446036 5120 reconciler_common.go:299] "Volume detached for volume \"neutron-ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8fded38e-5987-4d93-b8f5-ae718d6cb529-neutron-ovn-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:24:24 crc kubenswrapper[5120]: I0316 17:24:24.446045 5120 reconciler_common.go:299] "Volume detached for volume \"neutron-dhcp-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8fded38e-5987-4d93-b8f5-ae718d6cb529-neutron-dhcp-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:24:24 crc kubenswrapper[5120]: I0316 17:24:24.446054 5120 reconciler_common.go:299] "Volume detached for volume \"ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8fded38e-5987-4d93-b8f5-ae718d6cb529-ovn-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:24:24 crc kubenswrapper[5120]: I0316 17:24:24.990020 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-5q7fr" Mar 16 17:24:24 crc kubenswrapper[5120]: I0316 17:24:24.990353 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-5q7fr" event={"ID":"8fded38e-5987-4d93-b8f5-ae718d6cb529","Type":"ContainerDied","Data":"dabd10a8f84bf440952377e1330ed15ebc98a7ea0333cf4edf8cb7b97c7a0f9c"} Mar 16 17:24:24 crc kubenswrapper[5120]: I0316 17:24:24.990514 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dabd10a8f84bf440952377e1330ed15ebc98a7ea0333cf4edf8cb7b97c7a0f9c" Mar 16 17:24:25 crc kubenswrapper[5120]: I0316 17:24:25.072684 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-xw5ct"] Mar 16 17:24:25 crc kubenswrapper[5120]: I0316 17:24:25.073628 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8fded38e-5987-4d93-b8f5-ae718d6cb529" containerName="install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes" Mar 16 17:24:25 crc kubenswrapper[5120]: I0316 17:24:25.073653 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8fded38e-5987-4d93-b8f5-ae718d6cb529" containerName="install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes" Mar 16 17:24:25 crc kubenswrapper[5120]: I0316 17:24:25.073814 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="8fded38e-5987-4d93-b8f5-ae718d6cb529" containerName="install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes" Mar 16 17:24:25 crc kubenswrapper[5120]: I0316 17:24:25.079280 5120 scope.go:117] "RemoveContainer" containerID="ed88c9646f6b81d6df10256d70c26a344c2af94efe1137d72d74b373da3c2a8e" Mar 16 17:24:25 crc kubenswrapper[5120]: I0316 17:24:25.081520 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-xw5ct" Mar 16 17:24:25 crc kubenswrapper[5120]: I0316 17:24:25.084703 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-aee-default-env\"" Mar 16 17:24:25 crc kubenswrapper[5120]: I0316 17:24:25.085127 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"combined-ca-bundle\"" Mar 16 17:24:25 crc kubenswrapper[5120]: I0316 17:24:25.085433 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"edpm-compute-no-nodes-dockercfg-znndh\"" Mar 16 17:24:25 crc kubenswrapper[5120]: I0316 17:24:25.088011 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-xw5ct"] Mar 16 17:24:25 crc kubenswrapper[5120]: I0316 17:24:25.089845 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplane-ansible-ssh-private-key-secret\"" Mar 16 17:24:25 crc kubenswrapper[5120]: I0316 17:24:25.092530 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovncontroller-config\"" Mar 16 17:24:25 crc kubenswrapper[5120]: I0316 17:24:25.096267 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplanenodeset-edpm-compute-no-nodes\"" Mar 16 17:24:25 crc kubenswrapper[5120]: I0316 17:24:25.117741 5120 scope.go:117] "RemoveContainer" containerID="81947b04127136171912ff1b77489d536432fb3741a5520af68d98d822b16299" Mar 16 17:24:25 crc kubenswrapper[5120]: I0316 17:24:25.177548 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d6c27e72-d717-46eb-90f1-7a5e8f15e996-ovn-combined-ca-bundle\") pod \"ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-xw5ct\" (UID: \"d6c27e72-d717-46eb-90f1-7a5e8f15e996\") " pod="openstack-kuttl-tests/ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-xw5ct" Mar 16 17:24:25 crc kubenswrapper[5120]: I0316 17:24:25.177600 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhn7v\" (UniqueName: \"kubernetes.io/projected/d6c27e72-d717-46eb-90f1-7a5e8f15e996-kube-api-access-qhn7v\") pod \"ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-xw5ct\" (UID: \"d6c27e72-d717-46eb-90f1-7a5e8f15e996\") " pod="openstack-kuttl-tests/ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-xw5ct" Mar 16 17:24:25 crc kubenswrapper[5120]: I0316 17:24:25.177679 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/d6c27e72-d717-46eb-90f1-7a5e8f15e996-inventory\") pod \"ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-xw5ct\" (UID: \"d6c27e72-d717-46eb-90f1-7a5e8f15e996\") " pod="openstack-kuttl-tests/ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-xw5ct" Mar 16 17:24:25 crc kubenswrapper[5120]: I0316 17:24:25.177719 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovncontroller-config-0\" (UniqueName: \"kubernetes.io/configmap/d6c27e72-d717-46eb-90f1-7a5e8f15e996-ovncontroller-config-0\") pod \"ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-xw5ct\" (UID: \"d6c27e72-d717-46eb-90f1-7a5e8f15e996\") " pod="openstack-kuttl-tests/ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-xw5ct" Mar 16 17:24:25 crc kubenswrapper[5120]: I0316 17:24:25.177986 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/d6c27e72-d717-46eb-90f1-7a5e8f15e996-ssh-key-edpm-compute-no-nodes\") pod \"ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-xw5ct\" (UID: \"d6c27e72-d717-46eb-90f1-7a5e8f15e996\") " pod="openstack-kuttl-tests/ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-xw5ct" Mar 16 17:24:25 crc kubenswrapper[5120]: I0316 17:24:25.222102 5120 scope.go:117] "RemoveContainer" containerID="882757027d6601b088c798dfefa154df85dd1d7bb847781376b5e4f34df92a9c" Mar 16 17:24:25 crc kubenswrapper[5120]: I0316 17:24:25.279891 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d6c27e72-d717-46eb-90f1-7a5e8f15e996-ovn-combined-ca-bundle\") pod \"ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-xw5ct\" (UID: \"d6c27e72-d717-46eb-90f1-7a5e8f15e996\") " pod="openstack-kuttl-tests/ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-xw5ct" Mar 16 17:24:25 crc kubenswrapper[5120]: I0316 17:24:25.279933 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qhn7v\" (UniqueName: \"kubernetes.io/projected/d6c27e72-d717-46eb-90f1-7a5e8f15e996-kube-api-access-qhn7v\") pod \"ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-xw5ct\" (UID: \"d6c27e72-d717-46eb-90f1-7a5e8f15e996\") " pod="openstack-kuttl-tests/ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-xw5ct" Mar 16 17:24:25 crc kubenswrapper[5120]: I0316 17:24:25.279979 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/d6c27e72-d717-46eb-90f1-7a5e8f15e996-inventory\") pod \"ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-xw5ct\" (UID: \"d6c27e72-d717-46eb-90f1-7a5e8f15e996\") " pod="openstack-kuttl-tests/ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-xw5ct" Mar 16 17:24:25 crc kubenswrapper[5120]: I0316 17:24:25.280008 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovncontroller-config-0\" (UniqueName: \"kubernetes.io/configmap/d6c27e72-d717-46eb-90f1-7a5e8f15e996-ovncontroller-config-0\") pod \"ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-xw5ct\" (UID: \"d6c27e72-d717-46eb-90f1-7a5e8f15e996\") " pod="openstack-kuttl-tests/ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-xw5ct" Mar 16 17:24:25 crc kubenswrapper[5120]: I0316 17:24:25.280154 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/d6c27e72-d717-46eb-90f1-7a5e8f15e996-ssh-key-edpm-compute-no-nodes\") pod \"ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-xw5ct\" (UID: \"d6c27e72-d717-46eb-90f1-7a5e8f15e996\") " pod="openstack-kuttl-tests/ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-xw5ct" Mar 16 17:24:25 crc kubenswrapper[5120]: I0316 17:24:25.281196 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovncontroller-config-0\" (UniqueName: \"kubernetes.io/configmap/d6c27e72-d717-46eb-90f1-7a5e8f15e996-ovncontroller-config-0\") pod \"ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-xw5ct\" (UID: \"d6c27e72-d717-46eb-90f1-7a5e8f15e996\") " pod="openstack-kuttl-tests/ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-xw5ct" Mar 16 17:24:25 crc kubenswrapper[5120]: I0316 17:24:25.287461 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/d6c27e72-d717-46eb-90f1-7a5e8f15e996-inventory\") pod \"ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-xw5ct\" (UID: \"d6c27e72-d717-46eb-90f1-7a5e8f15e996\") " pod="openstack-kuttl-tests/ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-xw5ct" Mar 16 17:24:25 crc kubenswrapper[5120]: I0316 17:24:25.287497 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d6c27e72-d717-46eb-90f1-7a5e8f15e996-ovn-combined-ca-bundle\") pod \"ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-xw5ct\" (UID: \"d6c27e72-d717-46eb-90f1-7a5e8f15e996\") " pod="openstack-kuttl-tests/ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-xw5ct" Mar 16 17:24:25 crc kubenswrapper[5120]: I0316 17:24:25.295334 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/d6c27e72-d717-46eb-90f1-7a5e8f15e996-ssh-key-edpm-compute-no-nodes\") pod \"ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-xw5ct\" (UID: \"d6c27e72-d717-46eb-90f1-7a5e8f15e996\") " pod="openstack-kuttl-tests/ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-xw5ct" Mar 16 17:24:25 crc kubenswrapper[5120]: I0316 17:24:25.300717 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhn7v\" (UniqueName: \"kubernetes.io/projected/d6c27e72-d717-46eb-90f1-7a5e8f15e996-kube-api-access-qhn7v\") pod \"ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-xw5ct\" (UID: \"d6c27e72-d717-46eb-90f1-7a5e8f15e996\") " pod="openstack-kuttl-tests/ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-xw5ct" Mar 16 17:24:25 crc kubenswrapper[5120]: I0316 17:24:25.428889 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-xw5ct" Mar 16 17:24:25 crc kubenswrapper[5120]: I0316 17:24:25.675116 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-xw5ct"] Mar 16 17:24:25 crc kubenswrapper[5120]: W0316 17:24:25.682584 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd6c27e72_d717_46eb_90f1_7a5e8f15e996.slice/crio-2ca252b32213e9314c7652f8cc34b4e1fc824eb2f6c50cdecab09fb0b5f9a42c WatchSource:0}: Error finding container 2ca252b32213e9314c7652f8cc34b4e1fc824eb2f6c50cdecab09fb0b5f9a42c: Status 404 returned error can't find the container with id 2ca252b32213e9314c7652f8cc34b4e1fc824eb2f6c50cdecab09fb0b5f9a42c Mar 16 17:24:26 crc kubenswrapper[5120]: I0316 17:24:26.016141 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-xw5ct" event={"ID":"d6c27e72-d717-46eb-90f1-7a5e8f15e996","Type":"ContainerStarted","Data":"2ca252b32213e9314c7652f8cc34b4e1fc824eb2f6c50cdecab09fb0b5f9a42c"} Mar 16 17:24:28 crc kubenswrapper[5120]: I0316 17:24:28.035118 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-xw5ct" event={"ID":"d6c27e72-d717-46eb-90f1-7a5e8f15e996","Type":"ContainerStarted","Data":"045bcc04e88463e39bca1be465f2415de09e49742b297f5cec5baf749eca7715"} Mar 16 17:24:28 crc kubenswrapper[5120]: I0316 17:24:28.053245 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-xw5ct" podStartSLOduration=1.5181228199999999 podStartE2EDuration="3.053222747s" podCreationTimestamp="2026-03-16 17:24:25 +0000 UTC" firstStartedPulling="2026-03-16 17:24:25.685076237 +0000 UTC m=+6767.839007894" lastFinishedPulling="2026-03-16 17:24:27.220176164 +0000 UTC m=+6769.374107821" observedRunningTime="2026-03-16 17:24:28.049543426 +0000 UTC m=+6770.203475083" watchObservedRunningTime="2026-03-16 17:24:28.053222747 +0000 UTC m=+6770.207154404" Mar 16 17:24:29 crc kubenswrapper[5120]: I0316 17:24:29.051150 5120 generic.go:358] "Generic (PLEG): container finished" podID="d6c27e72-d717-46eb-90f1-7a5e8f15e996" containerID="045bcc04e88463e39bca1be465f2415de09e49742b297f5cec5baf749eca7715" exitCode=0 Mar 16 17:24:29 crc kubenswrapper[5120]: I0316 17:24:29.051370 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-xw5ct" event={"ID":"d6c27e72-d717-46eb-90f1-7a5e8f15e996","Type":"ContainerDied","Data":"045bcc04e88463e39bca1be465f2415de09e49742b297f5cec5baf749eca7715"} Mar 16 17:24:30 crc kubenswrapper[5120]: I0316 17:24:30.358806 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-xw5ct" Mar 16 17:24:30 crc kubenswrapper[5120]: I0316 17:24:30.525715 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/d6c27e72-d717-46eb-90f1-7a5e8f15e996-inventory\") pod \"d6c27e72-d717-46eb-90f1-7a5e8f15e996\" (UID: \"d6c27e72-d717-46eb-90f1-7a5e8f15e996\") " Mar 16 17:24:30 crc kubenswrapper[5120]: I0316 17:24:30.525807 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d6c27e72-d717-46eb-90f1-7a5e8f15e996-ovn-combined-ca-bundle\") pod \"d6c27e72-d717-46eb-90f1-7a5e8f15e996\" (UID: \"d6c27e72-d717-46eb-90f1-7a5e8f15e996\") " Mar 16 17:24:30 crc kubenswrapper[5120]: I0316 17:24:30.525856 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/d6c27e72-d717-46eb-90f1-7a5e8f15e996-ssh-key-edpm-compute-no-nodes\") pod \"d6c27e72-d717-46eb-90f1-7a5e8f15e996\" (UID: \"d6c27e72-d717-46eb-90f1-7a5e8f15e996\") " Mar 16 17:24:30 crc kubenswrapper[5120]: I0316 17:24:30.525979 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovncontroller-config-0\" (UniqueName: \"kubernetes.io/configmap/d6c27e72-d717-46eb-90f1-7a5e8f15e996-ovncontroller-config-0\") pod \"d6c27e72-d717-46eb-90f1-7a5e8f15e996\" (UID: \"d6c27e72-d717-46eb-90f1-7a5e8f15e996\") " Mar 16 17:24:30 crc kubenswrapper[5120]: I0316 17:24:30.526034 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qhn7v\" (UniqueName: \"kubernetes.io/projected/d6c27e72-d717-46eb-90f1-7a5e8f15e996-kube-api-access-qhn7v\") pod \"d6c27e72-d717-46eb-90f1-7a5e8f15e996\" (UID: \"d6c27e72-d717-46eb-90f1-7a5e8f15e996\") " Mar 16 17:24:30 crc kubenswrapper[5120]: I0316 17:24:30.531516 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6c27e72-d717-46eb-90f1-7a5e8f15e996-ovn-combined-ca-bundle" (OuterVolumeSpecName: "ovn-combined-ca-bundle") pod "d6c27e72-d717-46eb-90f1-7a5e8f15e996" (UID: "d6c27e72-d717-46eb-90f1-7a5e8f15e996"). InnerVolumeSpecName "ovn-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:24:30 crc kubenswrapper[5120]: I0316 17:24:30.533705 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6c27e72-d717-46eb-90f1-7a5e8f15e996-kube-api-access-qhn7v" (OuterVolumeSpecName: "kube-api-access-qhn7v") pod "d6c27e72-d717-46eb-90f1-7a5e8f15e996" (UID: "d6c27e72-d717-46eb-90f1-7a5e8f15e996"). InnerVolumeSpecName "kube-api-access-qhn7v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:24:30 crc kubenswrapper[5120]: I0316 17:24:30.547968 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6c27e72-d717-46eb-90f1-7a5e8f15e996-ovncontroller-config-0" (OuterVolumeSpecName: "ovncontroller-config-0") pod "d6c27e72-d717-46eb-90f1-7a5e8f15e996" (UID: "d6c27e72-d717-46eb-90f1-7a5e8f15e996"). InnerVolumeSpecName "ovncontroller-config-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:24:30 crc kubenswrapper[5120]: I0316 17:24:30.551882 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6c27e72-d717-46eb-90f1-7a5e8f15e996-ssh-key-edpm-compute-no-nodes" (OuterVolumeSpecName: "ssh-key-edpm-compute-no-nodes") pod "d6c27e72-d717-46eb-90f1-7a5e8f15e996" (UID: "d6c27e72-d717-46eb-90f1-7a5e8f15e996"). InnerVolumeSpecName "ssh-key-edpm-compute-no-nodes". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:24:30 crc kubenswrapper[5120]: I0316 17:24:30.556336 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6c27e72-d717-46eb-90f1-7a5e8f15e996-inventory" (OuterVolumeSpecName: "inventory") pod "d6c27e72-d717-46eb-90f1-7a5e8f15e996" (UID: "d6c27e72-d717-46eb-90f1-7a5e8f15e996"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:24:30 crc kubenswrapper[5120]: I0316 17:24:30.629124 5120 reconciler_common.go:299] "Volume detached for volume \"ovncontroller-config-0\" (UniqueName: \"kubernetes.io/configmap/d6c27e72-d717-46eb-90f1-7a5e8f15e996-ovncontroller-config-0\") on node \"crc\" DevicePath \"\"" Mar 16 17:24:30 crc kubenswrapper[5120]: I0316 17:24:30.629169 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qhn7v\" (UniqueName: \"kubernetes.io/projected/d6c27e72-d717-46eb-90f1-7a5e8f15e996-kube-api-access-qhn7v\") on node \"crc\" DevicePath \"\"" Mar 16 17:24:30 crc kubenswrapper[5120]: I0316 17:24:30.629181 5120 reconciler_common.go:299] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/d6c27e72-d717-46eb-90f1-7a5e8f15e996-inventory\") on node \"crc\" DevicePath \"\"" Mar 16 17:24:30 crc kubenswrapper[5120]: I0316 17:24:30.629192 5120 reconciler_common.go:299] "Volume detached for volume \"ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d6c27e72-d717-46eb-90f1-7a5e8f15e996-ovn-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:24:30 crc kubenswrapper[5120]: I0316 17:24:30.629206 5120 reconciler_common.go:299] "Volume detached for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/d6c27e72-d717-46eb-90f1-7a5e8f15e996-ssh-key-edpm-compute-no-nodes\") on node \"crc\" DevicePath \"\"" Mar 16 17:24:31 crc kubenswrapper[5120]: I0316 17:24:31.075327 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-xw5ct" Mar 16 17:24:31 crc kubenswrapper[5120]: I0316 17:24:31.075408 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-xw5ct" event={"ID":"d6c27e72-d717-46eb-90f1-7a5e8f15e996","Type":"ContainerDied","Data":"2ca252b32213e9314c7652f8cc34b4e1fc824eb2f6c50cdecab09fb0b5f9a42c"} Mar 16 17:24:31 crc kubenswrapper[5120]: I0316 17:24:31.076276 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2ca252b32213e9314c7652f8cc34b4e1fc824eb2f6c50cdecab09fb0b5f9a42c" Mar 16 17:24:31 crc kubenswrapper[5120]: I0316 17:24:31.140833 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodh8x2b"] Mar 16 17:24:31 crc kubenswrapper[5120]: I0316 17:24:31.141996 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6c27e72-d717-46eb-90f1-7a5e8f15e996" containerName="ovn-edpm-compute-no-nodes-edpm-compute-no-nodes" Mar 16 17:24:31 crc kubenswrapper[5120]: I0316 17:24:31.142017 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6c27e72-d717-46eb-90f1-7a5e8f15e996" containerName="ovn-edpm-compute-no-nodes-edpm-compute-no-nodes" Mar 16 17:24:31 crc kubenswrapper[5120]: I0316 17:24:31.142207 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="d6c27e72-d717-46eb-90f1-7a5e8f15e996" containerName="ovn-edpm-compute-no-nodes-edpm-compute-no-nodes" Mar 16 17:24:31 crc kubenswrapper[5120]: I0316 17:24:31.148150 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodh8x2b" Mar 16 17:24:31 crc kubenswrapper[5120]: I0316 17:24:31.150672 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"edpm-compute-no-nodes-dockercfg-znndh\"" Mar 16 17:24:31 crc kubenswrapper[5120]: I0316 17:24:31.150708 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-aee-default-env\"" Mar 16 17:24:31 crc kubenswrapper[5120]: I0316 17:24:31.151100 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodh8x2b"] Mar 16 17:24:31 crc kubenswrapper[5120]: I0316 17:24:31.151277 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplanenodeset-edpm-compute-no-nodes\"" Mar 16 17:24:31 crc kubenswrapper[5120]: I0316 17:24:31.151330 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-metadata-neutron-config\"" Mar 16 17:24:31 crc kubenswrapper[5120]: I0316 17:24:31.151587 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-ovn-metadata-agent-neutron-config\"" Mar 16 17:24:31 crc kubenswrapper[5120]: I0316 17:24:31.151700 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplane-ansible-ssh-private-key-secret\"" Mar 16 17:24:31 crc kubenswrapper[5120]: I0316 17:24:31.151806 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"combined-ca-bundle\"" Mar 16 17:24:31 crc kubenswrapper[5120]: I0316 17:24:31.240944 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"neutron-metadata-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4a804b00-52e3-498e-a77d-f9b6848ca9db-neutron-metadata-combined-ca-bundle\") pod \"neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodh8x2b\" (UID: \"4a804b00-52e3-498e-a77d-f9b6848ca9db\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodh8x2b" Mar 16 17:24:31 crc kubenswrapper[5120]: I0316 17:24:31.241019 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-neutron-config-1\" (UniqueName: \"kubernetes.io/secret/4a804b00-52e3-498e-a77d-f9b6848ca9db-nova-metadata-neutron-config-1\") pod \"neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodh8x2b\" (UID: \"4a804b00-52e3-498e-a77d-f9b6848ca9db\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodh8x2b" Mar 16 17:24:31 crc kubenswrapper[5120]: I0316 17:24:31.241153 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/4a804b00-52e3-498e-a77d-f9b6848ca9db-inventory\") pod \"neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodh8x2b\" (UID: \"4a804b00-52e3-498e-a77d-f9b6848ca9db\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodh8x2b" Mar 16 17:24:31 crc kubenswrapper[5120]: I0316 17:24:31.241193 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"neutron-ovn-metadata-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/4a804b00-52e3-498e-a77d-f9b6848ca9db-neutron-ovn-metadata-agent-neutron-config-0\") pod \"neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodh8x2b\" (UID: \"4a804b00-52e3-498e-a77d-f9b6848ca9db\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodh8x2b" Mar 16 17:24:31 crc kubenswrapper[5120]: I0316 17:24:31.241369 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rd8v\" (UniqueName: \"kubernetes.io/projected/4a804b00-52e3-498e-a77d-f9b6848ca9db-kube-api-access-2rd8v\") pod \"neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodh8x2b\" (UID: \"4a804b00-52e3-498e-a77d-f9b6848ca9db\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodh8x2b" Mar 16 17:24:31 crc kubenswrapper[5120]: I0316 17:24:31.241486 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/4a804b00-52e3-498e-a77d-f9b6848ca9db-nova-metadata-neutron-config-0\") pod \"neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodh8x2b\" (UID: \"4a804b00-52e3-498e-a77d-f9b6848ca9db\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodh8x2b" Mar 16 17:24:31 crc kubenswrapper[5120]: I0316 17:24:31.241537 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/4a804b00-52e3-498e-a77d-f9b6848ca9db-ssh-key-edpm-compute-no-nodes\") pod \"neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodh8x2b\" (UID: \"4a804b00-52e3-498e-a77d-f9b6848ca9db\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodh8x2b" Mar 16 17:24:31 crc kubenswrapper[5120]: I0316 17:24:31.241680 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-neutron-config-2\" (UniqueName: \"kubernetes.io/secret/4a804b00-52e3-498e-a77d-f9b6848ca9db-nova-metadata-neutron-config-2\") pod \"neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodh8x2b\" (UID: \"4a804b00-52e3-498e-a77d-f9b6848ca9db\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodh8x2b" Mar 16 17:24:31 crc kubenswrapper[5120]: I0316 17:24:31.342698 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/4a804b00-52e3-498e-a77d-f9b6848ca9db-inventory\") pod \"neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodh8x2b\" (UID: \"4a804b00-52e3-498e-a77d-f9b6848ca9db\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodh8x2b" Mar 16 17:24:31 crc kubenswrapper[5120]: I0316 17:24:31.342788 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"neutron-ovn-metadata-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/4a804b00-52e3-498e-a77d-f9b6848ca9db-neutron-ovn-metadata-agent-neutron-config-0\") pod \"neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodh8x2b\" (UID: \"4a804b00-52e3-498e-a77d-f9b6848ca9db\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodh8x2b" Mar 16 17:24:31 crc kubenswrapper[5120]: I0316 17:24:31.342905 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2rd8v\" (UniqueName: \"kubernetes.io/projected/4a804b00-52e3-498e-a77d-f9b6848ca9db-kube-api-access-2rd8v\") pod \"neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodh8x2b\" (UID: \"4a804b00-52e3-498e-a77d-f9b6848ca9db\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodh8x2b" Mar 16 17:24:31 crc kubenswrapper[5120]: I0316 17:24:31.343018 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-metadata-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/4a804b00-52e3-498e-a77d-f9b6848ca9db-nova-metadata-neutron-config-0\") pod \"neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodh8x2b\" (UID: \"4a804b00-52e3-498e-a77d-f9b6848ca9db\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodh8x2b" Mar 16 17:24:31 crc kubenswrapper[5120]: I0316 17:24:31.343076 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/4a804b00-52e3-498e-a77d-f9b6848ca9db-ssh-key-edpm-compute-no-nodes\") pod \"neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodh8x2b\" (UID: \"4a804b00-52e3-498e-a77d-f9b6848ca9db\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodh8x2b" Mar 16 17:24:31 crc kubenswrapper[5120]: I0316 17:24:31.343231 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-metadata-neutron-config-2\" (UniqueName: \"kubernetes.io/secret/4a804b00-52e3-498e-a77d-f9b6848ca9db-nova-metadata-neutron-config-2\") pod \"neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodh8x2b\" (UID: \"4a804b00-52e3-498e-a77d-f9b6848ca9db\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodh8x2b" Mar 16 17:24:31 crc kubenswrapper[5120]: I0316 17:24:31.343402 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"neutron-metadata-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4a804b00-52e3-498e-a77d-f9b6848ca9db-neutron-metadata-combined-ca-bundle\") pod \"neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodh8x2b\" (UID: \"4a804b00-52e3-498e-a77d-f9b6848ca9db\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodh8x2b" Mar 16 17:24:31 crc kubenswrapper[5120]: I0316 17:24:31.344122 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-metadata-neutron-config-1\" (UniqueName: \"kubernetes.io/secret/4a804b00-52e3-498e-a77d-f9b6848ca9db-nova-metadata-neutron-config-1\") pod \"neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodh8x2b\" (UID: \"4a804b00-52e3-498e-a77d-f9b6848ca9db\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodh8x2b" Mar 16 17:24:31 crc kubenswrapper[5120]: I0316 17:24:31.348369 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-metadata-neutron-config-1\" (UniqueName: \"kubernetes.io/secret/4a804b00-52e3-498e-a77d-f9b6848ca9db-nova-metadata-neutron-config-1\") pod \"neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodh8x2b\" (UID: \"4a804b00-52e3-498e-a77d-f9b6848ca9db\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodh8x2b" Mar 16 17:24:31 crc kubenswrapper[5120]: I0316 17:24:31.348498 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/4a804b00-52e3-498e-a77d-f9b6848ca9db-ssh-key-edpm-compute-no-nodes\") pod \"neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodh8x2b\" (UID: \"4a804b00-52e3-498e-a77d-f9b6848ca9db\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodh8x2b" Mar 16 17:24:31 crc kubenswrapper[5120]: I0316 17:24:31.349179 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"neutron-ovn-metadata-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/4a804b00-52e3-498e-a77d-f9b6848ca9db-neutron-ovn-metadata-agent-neutron-config-0\") pod \"neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodh8x2b\" (UID: \"4a804b00-52e3-498e-a77d-f9b6848ca9db\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodh8x2b" Mar 16 17:24:31 crc kubenswrapper[5120]: I0316 17:24:31.349176 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"neutron-metadata-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4a804b00-52e3-498e-a77d-f9b6848ca9db-neutron-metadata-combined-ca-bundle\") pod \"neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodh8x2b\" (UID: \"4a804b00-52e3-498e-a77d-f9b6848ca9db\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodh8x2b" Mar 16 17:24:31 crc kubenswrapper[5120]: I0316 17:24:31.356842 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-metadata-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/4a804b00-52e3-498e-a77d-f9b6848ca9db-nova-metadata-neutron-config-0\") pod \"neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodh8x2b\" (UID: \"4a804b00-52e3-498e-a77d-f9b6848ca9db\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodh8x2b" Mar 16 17:24:31 crc kubenswrapper[5120]: I0316 17:24:31.358920 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-metadata-neutron-config-2\" (UniqueName: \"kubernetes.io/secret/4a804b00-52e3-498e-a77d-f9b6848ca9db-nova-metadata-neutron-config-2\") pod \"neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodh8x2b\" (UID: \"4a804b00-52e3-498e-a77d-f9b6848ca9db\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodh8x2b" Mar 16 17:24:31 crc kubenswrapper[5120]: I0316 17:24:31.361302 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/4a804b00-52e3-498e-a77d-f9b6848ca9db-inventory\") pod \"neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodh8x2b\" (UID: \"4a804b00-52e3-498e-a77d-f9b6848ca9db\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodh8x2b" Mar 16 17:24:31 crc kubenswrapper[5120]: I0316 17:24:31.361528 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rd8v\" (UniqueName: \"kubernetes.io/projected/4a804b00-52e3-498e-a77d-f9b6848ca9db-kube-api-access-2rd8v\") pod \"neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodh8x2b\" (UID: \"4a804b00-52e3-498e-a77d-f9b6848ca9db\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodh8x2b" Mar 16 17:24:31 crc kubenswrapper[5120]: I0316 17:24:31.470301 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodh8x2b" Mar 16 17:24:31 crc kubenswrapper[5120]: I0316 17:24:31.877299 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodh8x2b"] Mar 16 17:24:31 crc kubenswrapper[5120]: W0316 17:24:31.884914 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4a804b00_52e3_498e_a77d_f9b6848ca9db.slice/crio-5eae7521c431b9fe3f840072d9f7afd47d35b9bc620323d65b85598cd28fbf96 WatchSource:0}: Error finding container 5eae7521c431b9fe3f840072d9f7afd47d35b9bc620323d65b85598cd28fbf96: Status 404 returned error can't find the container with id 5eae7521c431b9fe3f840072d9f7afd47d35b9bc620323d65b85598cd28fbf96 Mar 16 17:24:32 crc kubenswrapper[5120]: I0316 17:24:32.092930 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodh8x2b" event={"ID":"4a804b00-52e3-498e-a77d-f9b6848ca9db","Type":"ContainerStarted","Data":"5eae7521c431b9fe3f840072d9f7afd47d35b9bc620323d65b85598cd28fbf96"} Mar 16 17:24:33 crc kubenswrapper[5120]: I0316 17:24:33.104052 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodh8x2b" event={"ID":"4a804b00-52e3-498e-a77d-f9b6848ca9db","Type":"ContainerStarted","Data":"e9aa39b0b4fa8bee2a5fa5359835265331414170d04a3a3a7ed7751ec7df78c9"} Mar 16 17:24:33 crc kubenswrapper[5120]: I0316 17:24:33.128723 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodh8x2b" podStartSLOduration=1.719233246 podStartE2EDuration="2.128703185s" podCreationTimestamp="2026-03-16 17:24:31 +0000 UTC" firstStartedPulling="2026-03-16 17:24:31.887244252 +0000 UTC m=+6774.041175909" lastFinishedPulling="2026-03-16 17:24:32.296714191 +0000 UTC m=+6774.450645848" observedRunningTime="2026-03-16 17:24:33.122089664 +0000 UTC m=+6775.276021321" watchObservedRunningTime="2026-03-16 17:24:33.128703185 +0000 UTC m=+6775.282634842" Mar 16 17:24:34 crc kubenswrapper[5120]: I0316 17:24:34.112559 5120 generic.go:358] "Generic (PLEG): container finished" podID="4a804b00-52e3-498e-a77d-f9b6848ca9db" containerID="e9aa39b0b4fa8bee2a5fa5359835265331414170d04a3a3a7ed7751ec7df78c9" exitCode=0 Mar 16 17:24:34 crc kubenswrapper[5120]: I0316 17:24:34.112696 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodh8x2b" event={"ID":"4a804b00-52e3-498e-a77d-f9b6848ca9db","Type":"ContainerDied","Data":"e9aa39b0b4fa8bee2a5fa5359835265331414170d04a3a3a7ed7751ec7df78c9"} Mar 16 17:24:35 crc kubenswrapper[5120]: I0316 17:24:35.396471 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodh8x2b" Mar 16 17:24:35 crc kubenswrapper[5120]: I0316 17:24:35.529097 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"neutron-metadata-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4a804b00-52e3-498e-a77d-f9b6848ca9db-neutron-metadata-combined-ca-bundle\") pod \"4a804b00-52e3-498e-a77d-f9b6848ca9db\" (UID: \"4a804b00-52e3-498e-a77d-f9b6848ca9db\") " Mar 16 17:24:35 crc kubenswrapper[5120]: I0316 17:24:35.529228 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-metadata-neutron-config-1\" (UniqueName: \"kubernetes.io/secret/4a804b00-52e3-498e-a77d-f9b6848ca9db-nova-metadata-neutron-config-1\") pod \"4a804b00-52e3-498e-a77d-f9b6848ca9db\" (UID: \"4a804b00-52e3-498e-a77d-f9b6848ca9db\") " Mar 16 17:24:35 crc kubenswrapper[5120]: I0316 17:24:35.529307 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"neutron-ovn-metadata-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/4a804b00-52e3-498e-a77d-f9b6848ca9db-neutron-ovn-metadata-agent-neutron-config-0\") pod \"4a804b00-52e3-498e-a77d-f9b6848ca9db\" (UID: \"4a804b00-52e3-498e-a77d-f9b6848ca9db\") " Mar 16 17:24:35 crc kubenswrapper[5120]: I0316 17:24:35.529380 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2rd8v\" (UniqueName: \"kubernetes.io/projected/4a804b00-52e3-498e-a77d-f9b6848ca9db-kube-api-access-2rd8v\") pod \"4a804b00-52e3-498e-a77d-f9b6848ca9db\" (UID: \"4a804b00-52e3-498e-a77d-f9b6848ca9db\") " Mar 16 17:24:35 crc kubenswrapper[5120]: I0316 17:24:35.529477 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/4a804b00-52e3-498e-a77d-f9b6848ca9db-inventory\") pod \"4a804b00-52e3-498e-a77d-f9b6848ca9db\" (UID: \"4a804b00-52e3-498e-a77d-f9b6848ca9db\") " Mar 16 17:24:35 crc kubenswrapper[5120]: I0316 17:24:35.529643 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-metadata-neutron-config-2\" (UniqueName: \"kubernetes.io/secret/4a804b00-52e3-498e-a77d-f9b6848ca9db-nova-metadata-neutron-config-2\") pod \"4a804b00-52e3-498e-a77d-f9b6848ca9db\" (UID: \"4a804b00-52e3-498e-a77d-f9b6848ca9db\") " Mar 16 17:24:35 crc kubenswrapper[5120]: I0316 17:24:35.529711 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/4a804b00-52e3-498e-a77d-f9b6848ca9db-ssh-key-edpm-compute-no-nodes\") pod \"4a804b00-52e3-498e-a77d-f9b6848ca9db\" (UID: \"4a804b00-52e3-498e-a77d-f9b6848ca9db\") " Mar 16 17:24:35 crc kubenswrapper[5120]: I0316 17:24:35.529967 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-metadata-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/4a804b00-52e3-498e-a77d-f9b6848ca9db-nova-metadata-neutron-config-0\") pod \"4a804b00-52e3-498e-a77d-f9b6848ca9db\" (UID: \"4a804b00-52e3-498e-a77d-f9b6848ca9db\") " Mar 16 17:24:35 crc kubenswrapper[5120]: I0316 17:24:35.535599 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a804b00-52e3-498e-a77d-f9b6848ca9db-kube-api-access-2rd8v" (OuterVolumeSpecName: "kube-api-access-2rd8v") pod "4a804b00-52e3-498e-a77d-f9b6848ca9db" (UID: "4a804b00-52e3-498e-a77d-f9b6848ca9db"). InnerVolumeSpecName "kube-api-access-2rd8v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:24:35 crc kubenswrapper[5120]: I0316 17:24:35.535935 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4a804b00-52e3-498e-a77d-f9b6848ca9db-neutron-metadata-combined-ca-bundle" (OuterVolumeSpecName: "neutron-metadata-combined-ca-bundle") pod "4a804b00-52e3-498e-a77d-f9b6848ca9db" (UID: "4a804b00-52e3-498e-a77d-f9b6848ca9db"). InnerVolumeSpecName "neutron-metadata-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:24:35 crc kubenswrapper[5120]: I0316 17:24:35.554055 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4a804b00-52e3-498e-a77d-f9b6848ca9db-neutron-ovn-metadata-agent-neutron-config-0" (OuterVolumeSpecName: "neutron-ovn-metadata-agent-neutron-config-0") pod "4a804b00-52e3-498e-a77d-f9b6848ca9db" (UID: "4a804b00-52e3-498e-a77d-f9b6848ca9db"). InnerVolumeSpecName "neutron-ovn-metadata-agent-neutron-config-0". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:24:35 crc kubenswrapper[5120]: I0316 17:24:35.554091 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4a804b00-52e3-498e-a77d-f9b6848ca9db-inventory" (OuterVolumeSpecName: "inventory") pod "4a804b00-52e3-498e-a77d-f9b6848ca9db" (UID: "4a804b00-52e3-498e-a77d-f9b6848ca9db"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:24:35 crc kubenswrapper[5120]: I0316 17:24:35.554166 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4a804b00-52e3-498e-a77d-f9b6848ca9db-nova-metadata-neutron-config-1" (OuterVolumeSpecName: "nova-metadata-neutron-config-1") pod "4a804b00-52e3-498e-a77d-f9b6848ca9db" (UID: "4a804b00-52e3-498e-a77d-f9b6848ca9db"). InnerVolumeSpecName "nova-metadata-neutron-config-1". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:24:35 crc kubenswrapper[5120]: I0316 17:24:35.555044 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4a804b00-52e3-498e-a77d-f9b6848ca9db-nova-metadata-neutron-config-0" (OuterVolumeSpecName: "nova-metadata-neutron-config-0") pod "4a804b00-52e3-498e-a77d-f9b6848ca9db" (UID: "4a804b00-52e3-498e-a77d-f9b6848ca9db"). InnerVolumeSpecName "nova-metadata-neutron-config-0". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:24:35 crc kubenswrapper[5120]: I0316 17:24:35.558686 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4a804b00-52e3-498e-a77d-f9b6848ca9db-nova-metadata-neutron-config-2" (OuterVolumeSpecName: "nova-metadata-neutron-config-2") pod "4a804b00-52e3-498e-a77d-f9b6848ca9db" (UID: "4a804b00-52e3-498e-a77d-f9b6848ca9db"). InnerVolumeSpecName "nova-metadata-neutron-config-2". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:24:35 crc kubenswrapper[5120]: I0316 17:24:35.565322 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4a804b00-52e3-498e-a77d-f9b6848ca9db-ssh-key-edpm-compute-no-nodes" (OuterVolumeSpecName: "ssh-key-edpm-compute-no-nodes") pod "4a804b00-52e3-498e-a77d-f9b6848ca9db" (UID: "4a804b00-52e3-498e-a77d-f9b6848ca9db"). InnerVolumeSpecName "ssh-key-edpm-compute-no-nodes". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:24:35 crc kubenswrapper[5120]: I0316 17:24:35.632719 5120 reconciler_common.go:299] "Volume detached for volume \"nova-metadata-neutron-config-2\" (UniqueName: \"kubernetes.io/secret/4a804b00-52e3-498e-a77d-f9b6848ca9db-nova-metadata-neutron-config-2\") on node \"crc\" DevicePath \"\"" Mar 16 17:24:35 crc kubenswrapper[5120]: I0316 17:24:35.633103 5120 reconciler_common.go:299] "Volume detached for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/4a804b00-52e3-498e-a77d-f9b6848ca9db-ssh-key-edpm-compute-no-nodes\") on node \"crc\" DevicePath \"\"" Mar 16 17:24:35 crc kubenswrapper[5120]: I0316 17:24:35.633120 5120 reconciler_common.go:299] "Volume detached for volume \"nova-metadata-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/4a804b00-52e3-498e-a77d-f9b6848ca9db-nova-metadata-neutron-config-0\") on node \"crc\" DevicePath \"\"" Mar 16 17:24:35 crc kubenswrapper[5120]: I0316 17:24:35.633136 5120 reconciler_common.go:299] "Volume detached for volume \"neutron-metadata-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4a804b00-52e3-498e-a77d-f9b6848ca9db-neutron-metadata-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:24:35 crc kubenswrapper[5120]: I0316 17:24:35.633150 5120 reconciler_common.go:299] "Volume detached for volume \"nova-metadata-neutron-config-1\" (UniqueName: \"kubernetes.io/secret/4a804b00-52e3-498e-a77d-f9b6848ca9db-nova-metadata-neutron-config-1\") on node \"crc\" DevicePath \"\"" Mar 16 17:24:35 crc kubenswrapper[5120]: I0316 17:24:35.633164 5120 reconciler_common.go:299] "Volume detached for volume \"neutron-ovn-metadata-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/4a804b00-52e3-498e-a77d-f9b6848ca9db-neutron-ovn-metadata-agent-neutron-config-0\") on node \"crc\" DevicePath \"\"" Mar 16 17:24:35 crc kubenswrapper[5120]: I0316 17:24:35.633182 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2rd8v\" (UniqueName: \"kubernetes.io/projected/4a804b00-52e3-498e-a77d-f9b6848ca9db-kube-api-access-2rd8v\") on node \"crc\" DevicePath \"\"" Mar 16 17:24:35 crc kubenswrapper[5120]: I0316 17:24:35.633195 5120 reconciler_common.go:299] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/4a804b00-52e3-498e-a77d-f9b6848ca9db-inventory\") on node \"crc\" DevicePath \"\"" Mar 16 17:24:36 crc kubenswrapper[5120]: I0316 17:24:36.136320 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodh8x2b" Mar 16 17:24:36 crc kubenswrapper[5120]: I0316 17:24:36.136331 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodh8x2b" event={"ID":"4a804b00-52e3-498e-a77d-f9b6848ca9db","Type":"ContainerDied","Data":"5eae7521c431b9fe3f840072d9f7afd47d35b9bc620323d65b85598cd28fbf96"} Mar 16 17:24:36 crc kubenswrapper[5120]: I0316 17:24:36.136493 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5eae7521c431b9fe3f840072d9f7afd47d35b9bc620323d65b85598cd28fbf96" Mar 16 17:24:36 crc kubenswrapper[5120]: I0316 17:24:36.200409 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-k7czl"] Mar 16 17:24:36 crc kubenswrapper[5120]: I0316 17:24:36.201693 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a804b00-52e3-498e-a77d-f9b6848ca9db" containerName="neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodes" Mar 16 17:24:36 crc kubenswrapper[5120]: I0316 17:24:36.201717 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a804b00-52e3-498e-a77d-f9b6848ca9db" containerName="neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodes" Mar 16 17:24:36 crc kubenswrapper[5120]: I0316 17:24:36.201931 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="4a804b00-52e3-498e-a77d-f9b6848ca9db" containerName="neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodes" Mar 16 17:24:36 crc kubenswrapper[5120]: I0316 17:24:36.207746 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-k7czl" Mar 16 17:24:36 crc kubenswrapper[5120]: I0316 17:24:36.209748 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-metadata-neutron-config\"" Mar 16 17:24:36 crc kubenswrapper[5120]: I0316 17:24:36.210212 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplane-ansible-ssh-private-key-secret\"" Mar 16 17:24:36 crc kubenswrapper[5120]: I0316 17:24:36.210436 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"edpm-compute-no-nodes-dockercfg-znndh\"" Mar 16 17:24:36 crc kubenswrapper[5120]: I0316 17:24:36.210570 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-aee-default-env\"" Mar 16 17:24:36 crc kubenswrapper[5120]: I0316 17:24:36.210750 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"combined-ca-bundle\"" Mar 16 17:24:36 crc kubenswrapper[5120]: I0316 17:24:36.211346 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-ovn-agent-neutron-config\"" Mar 16 17:24:36 crc kubenswrapper[5120]: I0316 17:24:36.212441 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-k7czl"] Mar 16 17:24:36 crc kubenswrapper[5120]: I0316 17:24:36.213811 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplanenodeset-edpm-compute-no-nodes\"" Mar 16 17:24:36 crc kubenswrapper[5120]: I0316 17:24:36.351113 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/fc24b408-f9c2-4896-b74a-1069fa20c8a2-ssh-key-edpm-compute-no-nodes\") pod \"neutron-ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-k7czl\" (UID: \"fc24b408-f9c2-4896-b74a-1069fa20c8a2\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-k7czl" Mar 16 17:24:36 crc kubenswrapper[5120]: I0316 17:24:36.351174 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"neutron-ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fc24b408-f9c2-4896-b74a-1069fa20c8a2-neutron-ovn-combined-ca-bundle\") pod \"neutron-ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-k7czl\" (UID: \"fc24b408-f9c2-4896-b74a-1069fa20c8a2\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-k7czl" Mar 16 17:24:36 crc kubenswrapper[5120]: I0316 17:24:36.351213 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/fc24b408-f9c2-4896-b74a-1069fa20c8a2-nova-metadata-neutron-config-0\") pod \"neutron-ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-k7czl\" (UID: \"fc24b408-f9c2-4896-b74a-1069fa20c8a2\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-k7czl" Mar 16 17:24:36 crc kubenswrapper[5120]: I0316 17:24:36.351353 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/fc24b408-f9c2-4896-b74a-1069fa20c8a2-inventory\") pod \"neutron-ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-k7czl\" (UID: \"fc24b408-f9c2-4896-b74a-1069fa20c8a2\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-k7czl" Mar 16 17:24:36 crc kubenswrapper[5120]: I0316 17:24:36.351377 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxtqg\" (UniqueName: \"kubernetes.io/projected/fc24b408-f9c2-4896-b74a-1069fa20c8a2-kube-api-access-hxtqg\") pod \"neutron-ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-k7czl\" (UID: \"fc24b408-f9c2-4896-b74a-1069fa20c8a2\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-k7czl" Mar 16 17:24:36 crc kubenswrapper[5120]: I0316 17:24:36.351479 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-neutron-config-1\" (UniqueName: \"kubernetes.io/secret/fc24b408-f9c2-4896-b74a-1069fa20c8a2-nova-metadata-neutron-config-1\") pod \"neutron-ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-k7czl\" (UID: \"fc24b408-f9c2-4896-b74a-1069fa20c8a2\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-k7czl" Mar 16 17:24:36 crc kubenswrapper[5120]: I0316 17:24:36.351589 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-neutron-config-2\" (UniqueName: \"kubernetes.io/secret/fc24b408-f9c2-4896-b74a-1069fa20c8a2-nova-metadata-neutron-config-2\") pod \"neutron-ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-k7czl\" (UID: \"fc24b408-f9c2-4896-b74a-1069fa20c8a2\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-k7czl" Mar 16 17:24:36 crc kubenswrapper[5120]: I0316 17:24:36.351679 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"neutron-ovn-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/fc24b408-f9c2-4896-b74a-1069fa20c8a2-neutron-ovn-agent-neutron-config-0\") pod \"neutron-ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-k7czl\" (UID: \"fc24b408-f9c2-4896-b74a-1069fa20c8a2\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-k7czl" Mar 16 17:24:36 crc kubenswrapper[5120]: I0316 17:24:36.453420 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-metadata-neutron-config-2\" (UniqueName: \"kubernetes.io/secret/fc24b408-f9c2-4896-b74a-1069fa20c8a2-nova-metadata-neutron-config-2\") pod \"neutron-ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-k7czl\" (UID: \"fc24b408-f9c2-4896-b74a-1069fa20c8a2\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-k7czl" Mar 16 17:24:36 crc kubenswrapper[5120]: I0316 17:24:36.453500 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"neutron-ovn-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/fc24b408-f9c2-4896-b74a-1069fa20c8a2-neutron-ovn-agent-neutron-config-0\") pod \"neutron-ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-k7czl\" (UID: \"fc24b408-f9c2-4896-b74a-1069fa20c8a2\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-k7czl" Mar 16 17:24:36 crc kubenswrapper[5120]: I0316 17:24:36.453550 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/fc24b408-f9c2-4896-b74a-1069fa20c8a2-ssh-key-edpm-compute-no-nodes\") pod \"neutron-ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-k7czl\" (UID: \"fc24b408-f9c2-4896-b74a-1069fa20c8a2\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-k7czl" Mar 16 17:24:36 crc kubenswrapper[5120]: I0316 17:24:36.453623 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"neutron-ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fc24b408-f9c2-4896-b74a-1069fa20c8a2-neutron-ovn-combined-ca-bundle\") pod \"neutron-ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-k7czl\" (UID: \"fc24b408-f9c2-4896-b74a-1069fa20c8a2\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-k7czl" Mar 16 17:24:36 crc kubenswrapper[5120]: I0316 17:24:36.453836 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-metadata-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/fc24b408-f9c2-4896-b74a-1069fa20c8a2-nova-metadata-neutron-config-0\") pod \"neutron-ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-k7czl\" (UID: \"fc24b408-f9c2-4896-b74a-1069fa20c8a2\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-k7czl" Mar 16 17:24:36 crc kubenswrapper[5120]: I0316 17:24:36.454156 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/fc24b408-f9c2-4896-b74a-1069fa20c8a2-inventory\") pod \"neutron-ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-k7czl\" (UID: \"fc24b408-f9c2-4896-b74a-1069fa20c8a2\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-k7czl" Mar 16 17:24:36 crc kubenswrapper[5120]: I0316 17:24:36.454191 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hxtqg\" (UniqueName: \"kubernetes.io/projected/fc24b408-f9c2-4896-b74a-1069fa20c8a2-kube-api-access-hxtqg\") pod \"neutron-ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-k7czl\" (UID: \"fc24b408-f9c2-4896-b74a-1069fa20c8a2\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-k7czl" Mar 16 17:24:36 crc kubenswrapper[5120]: I0316 17:24:36.454285 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-metadata-neutron-config-1\" (UniqueName: \"kubernetes.io/secret/fc24b408-f9c2-4896-b74a-1069fa20c8a2-nova-metadata-neutron-config-1\") pod \"neutron-ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-k7czl\" (UID: \"fc24b408-f9c2-4896-b74a-1069fa20c8a2\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-k7czl" Mar 16 17:24:36 crc kubenswrapper[5120]: I0316 17:24:36.458433 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-metadata-neutron-config-1\" (UniqueName: \"kubernetes.io/secret/fc24b408-f9c2-4896-b74a-1069fa20c8a2-nova-metadata-neutron-config-1\") pod \"neutron-ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-k7czl\" (UID: \"fc24b408-f9c2-4896-b74a-1069fa20c8a2\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-k7czl" Mar 16 17:24:36 crc kubenswrapper[5120]: I0316 17:24:36.458452 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-metadata-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/fc24b408-f9c2-4896-b74a-1069fa20c8a2-nova-metadata-neutron-config-0\") pod \"neutron-ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-k7czl\" (UID: \"fc24b408-f9c2-4896-b74a-1069fa20c8a2\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-k7czl" Mar 16 17:24:36 crc kubenswrapper[5120]: I0316 17:24:36.458555 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-metadata-neutron-config-2\" (UniqueName: \"kubernetes.io/secret/fc24b408-f9c2-4896-b74a-1069fa20c8a2-nova-metadata-neutron-config-2\") pod \"neutron-ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-k7czl\" (UID: \"fc24b408-f9c2-4896-b74a-1069fa20c8a2\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-k7czl" Mar 16 17:24:36 crc kubenswrapper[5120]: I0316 17:24:36.459067 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/fc24b408-f9c2-4896-b74a-1069fa20c8a2-ssh-key-edpm-compute-no-nodes\") pod \"neutron-ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-k7czl\" (UID: \"fc24b408-f9c2-4896-b74a-1069fa20c8a2\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-k7czl" Mar 16 17:24:36 crc kubenswrapper[5120]: I0316 17:24:36.459532 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"neutron-ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fc24b408-f9c2-4896-b74a-1069fa20c8a2-neutron-ovn-combined-ca-bundle\") pod \"neutron-ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-k7czl\" (UID: \"fc24b408-f9c2-4896-b74a-1069fa20c8a2\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-k7czl" Mar 16 17:24:36 crc kubenswrapper[5120]: I0316 17:24:36.460513 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/fc24b408-f9c2-4896-b74a-1069fa20c8a2-inventory\") pod \"neutron-ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-k7czl\" (UID: \"fc24b408-f9c2-4896-b74a-1069fa20c8a2\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-k7czl" Mar 16 17:24:36 crc kubenswrapper[5120]: I0316 17:24:36.470910 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"neutron-ovn-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/fc24b408-f9c2-4896-b74a-1069fa20c8a2-neutron-ovn-agent-neutron-config-0\") pod \"neutron-ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-k7czl\" (UID: \"fc24b408-f9c2-4896-b74a-1069fa20c8a2\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-k7czl" Mar 16 17:24:36 crc kubenswrapper[5120]: I0316 17:24:36.473081 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxtqg\" (UniqueName: \"kubernetes.io/projected/fc24b408-f9c2-4896-b74a-1069fa20c8a2-kube-api-access-hxtqg\") pod \"neutron-ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-k7czl\" (UID: \"fc24b408-f9c2-4896-b74a-1069fa20c8a2\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-k7czl" Mar 16 17:24:36 crc kubenswrapper[5120]: I0316 17:24:36.536532 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-k7czl" Mar 16 17:24:36 crc kubenswrapper[5120]: I0316 17:24:36.948569 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-k7czl"] Mar 16 17:24:37 crc kubenswrapper[5120]: I0316 17:24:37.145614 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-k7czl" event={"ID":"fc24b408-f9c2-4896-b74a-1069fa20c8a2","Type":"ContainerStarted","Data":"3e161ba7559ca456611cd91f6ac7bc665565404cb3b78c8b1d16815de293a2cf"} Mar 16 17:24:38 crc kubenswrapper[5120]: I0316 17:24:38.172814 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-k7czl" event={"ID":"fc24b408-f9c2-4896-b74a-1069fa20c8a2","Type":"ContainerStarted","Data":"7030b93327db94386b36e0fbe44123e0027372fbd6f85c3a87cf92746740491d"} Mar 16 17:24:38 crc kubenswrapper[5120]: I0316 17:24:38.194236 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-k7czl" podStartSLOduration=1.795429914 podStartE2EDuration="2.194212801s" podCreationTimestamp="2026-03-16 17:24:36 +0000 UTC" firstStartedPulling="2026-03-16 17:24:36.95795759 +0000 UTC m=+6779.111889237" lastFinishedPulling="2026-03-16 17:24:37.356740467 +0000 UTC m=+6779.510672124" observedRunningTime="2026-03-16 17:24:38.18721861 +0000 UTC m=+6780.341150287" watchObservedRunningTime="2026-03-16 17:24:38.194212801 +0000 UTC m=+6780.348144458" Mar 16 17:24:38 crc kubenswrapper[5120]: E0316 17:24:38.780837 5120 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfc24b408_f9c2_4896_b74a_1069fa20c8a2.slice/crio-conmon-7030b93327db94386b36e0fbe44123e0027372fbd6f85c3a87cf92746740491d.scope\": RecentStats: unable to find data in memory cache]" Mar 16 17:24:39 crc kubenswrapper[5120]: I0316 17:24:39.183145 5120 generic.go:358] "Generic (PLEG): container finished" podID="fc24b408-f9c2-4896-b74a-1069fa20c8a2" containerID="7030b93327db94386b36e0fbe44123e0027372fbd6f85c3a87cf92746740491d" exitCode=0 Mar 16 17:24:39 crc kubenswrapper[5120]: I0316 17:24:39.183859 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-k7czl" event={"ID":"fc24b408-f9c2-4896-b74a-1069fa20c8a2","Type":"ContainerDied","Data":"7030b93327db94386b36e0fbe44123e0027372fbd6f85c3a87cf92746740491d"} Mar 16 17:24:40 crc kubenswrapper[5120]: I0316 17:24:40.492739 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-k7czl" Mar 16 17:24:40 crc kubenswrapper[5120]: I0316 17:24:40.548100 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-metadata-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/fc24b408-f9c2-4896-b74a-1069fa20c8a2-nova-metadata-neutron-config-0\") pod \"fc24b408-f9c2-4896-b74a-1069fa20c8a2\" (UID: \"fc24b408-f9c2-4896-b74a-1069fa20c8a2\") " Mar 16 17:24:40 crc kubenswrapper[5120]: I0316 17:24:40.548241 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-metadata-neutron-config-1\" (UniqueName: \"kubernetes.io/secret/fc24b408-f9c2-4896-b74a-1069fa20c8a2-nova-metadata-neutron-config-1\") pod \"fc24b408-f9c2-4896-b74a-1069fa20c8a2\" (UID: \"fc24b408-f9c2-4896-b74a-1069fa20c8a2\") " Mar 16 17:24:40 crc kubenswrapper[5120]: I0316 17:24:40.548325 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/fc24b408-f9c2-4896-b74a-1069fa20c8a2-ssh-key-edpm-compute-no-nodes\") pod \"fc24b408-f9c2-4896-b74a-1069fa20c8a2\" (UID: \"fc24b408-f9c2-4896-b74a-1069fa20c8a2\") " Mar 16 17:24:40 crc kubenswrapper[5120]: I0316 17:24:40.548359 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/fc24b408-f9c2-4896-b74a-1069fa20c8a2-inventory\") pod \"fc24b408-f9c2-4896-b74a-1069fa20c8a2\" (UID: \"fc24b408-f9c2-4896-b74a-1069fa20c8a2\") " Mar 16 17:24:40 crc kubenswrapper[5120]: I0316 17:24:40.548464 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"neutron-ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fc24b408-f9c2-4896-b74a-1069fa20c8a2-neutron-ovn-combined-ca-bundle\") pod \"fc24b408-f9c2-4896-b74a-1069fa20c8a2\" (UID: \"fc24b408-f9c2-4896-b74a-1069fa20c8a2\") " Mar 16 17:24:40 crc kubenswrapper[5120]: I0316 17:24:40.548620 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"neutron-ovn-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/fc24b408-f9c2-4896-b74a-1069fa20c8a2-neutron-ovn-agent-neutron-config-0\") pod \"fc24b408-f9c2-4896-b74a-1069fa20c8a2\" (UID: \"fc24b408-f9c2-4896-b74a-1069fa20c8a2\") " Mar 16 17:24:40 crc kubenswrapper[5120]: I0316 17:24:40.548733 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-metadata-neutron-config-2\" (UniqueName: \"kubernetes.io/secret/fc24b408-f9c2-4896-b74a-1069fa20c8a2-nova-metadata-neutron-config-2\") pod \"fc24b408-f9c2-4896-b74a-1069fa20c8a2\" (UID: \"fc24b408-f9c2-4896-b74a-1069fa20c8a2\") " Mar 16 17:24:40 crc kubenswrapper[5120]: I0316 17:24:40.549141 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hxtqg\" (UniqueName: \"kubernetes.io/projected/fc24b408-f9c2-4896-b74a-1069fa20c8a2-kube-api-access-hxtqg\") pod \"fc24b408-f9c2-4896-b74a-1069fa20c8a2\" (UID: \"fc24b408-f9c2-4896-b74a-1069fa20c8a2\") " Mar 16 17:24:40 crc kubenswrapper[5120]: I0316 17:24:40.553672 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc24b408-f9c2-4896-b74a-1069fa20c8a2-kube-api-access-hxtqg" (OuterVolumeSpecName: "kube-api-access-hxtqg") pod "fc24b408-f9c2-4896-b74a-1069fa20c8a2" (UID: "fc24b408-f9c2-4896-b74a-1069fa20c8a2"). InnerVolumeSpecName "kube-api-access-hxtqg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:24:40 crc kubenswrapper[5120]: I0316 17:24:40.566271 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc24b408-f9c2-4896-b74a-1069fa20c8a2-neutron-ovn-combined-ca-bundle" (OuterVolumeSpecName: "neutron-ovn-combined-ca-bundle") pod "fc24b408-f9c2-4896-b74a-1069fa20c8a2" (UID: "fc24b408-f9c2-4896-b74a-1069fa20c8a2"). InnerVolumeSpecName "neutron-ovn-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:24:40 crc kubenswrapper[5120]: I0316 17:24:40.571619 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc24b408-f9c2-4896-b74a-1069fa20c8a2-ssh-key-edpm-compute-no-nodes" (OuterVolumeSpecName: "ssh-key-edpm-compute-no-nodes") pod "fc24b408-f9c2-4896-b74a-1069fa20c8a2" (UID: "fc24b408-f9c2-4896-b74a-1069fa20c8a2"). InnerVolumeSpecName "ssh-key-edpm-compute-no-nodes". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:24:40 crc kubenswrapper[5120]: I0316 17:24:40.572311 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc24b408-f9c2-4896-b74a-1069fa20c8a2-inventory" (OuterVolumeSpecName: "inventory") pod "fc24b408-f9c2-4896-b74a-1069fa20c8a2" (UID: "fc24b408-f9c2-4896-b74a-1069fa20c8a2"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:24:40 crc kubenswrapper[5120]: I0316 17:24:40.574803 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc24b408-f9c2-4896-b74a-1069fa20c8a2-nova-metadata-neutron-config-2" (OuterVolumeSpecName: "nova-metadata-neutron-config-2") pod "fc24b408-f9c2-4896-b74a-1069fa20c8a2" (UID: "fc24b408-f9c2-4896-b74a-1069fa20c8a2"). InnerVolumeSpecName "nova-metadata-neutron-config-2". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:24:40 crc kubenswrapper[5120]: I0316 17:24:40.575096 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc24b408-f9c2-4896-b74a-1069fa20c8a2-nova-metadata-neutron-config-0" (OuterVolumeSpecName: "nova-metadata-neutron-config-0") pod "fc24b408-f9c2-4896-b74a-1069fa20c8a2" (UID: "fc24b408-f9c2-4896-b74a-1069fa20c8a2"). InnerVolumeSpecName "nova-metadata-neutron-config-0". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:24:40 crc kubenswrapper[5120]: I0316 17:24:40.577069 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc24b408-f9c2-4896-b74a-1069fa20c8a2-neutron-ovn-agent-neutron-config-0" (OuterVolumeSpecName: "neutron-ovn-agent-neutron-config-0") pod "fc24b408-f9c2-4896-b74a-1069fa20c8a2" (UID: "fc24b408-f9c2-4896-b74a-1069fa20c8a2"). InnerVolumeSpecName "neutron-ovn-agent-neutron-config-0". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:24:40 crc kubenswrapper[5120]: I0316 17:24:40.580682 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc24b408-f9c2-4896-b74a-1069fa20c8a2-nova-metadata-neutron-config-1" (OuterVolumeSpecName: "nova-metadata-neutron-config-1") pod "fc24b408-f9c2-4896-b74a-1069fa20c8a2" (UID: "fc24b408-f9c2-4896-b74a-1069fa20c8a2"). InnerVolumeSpecName "nova-metadata-neutron-config-1". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:24:40 crc kubenswrapper[5120]: I0316 17:24:40.652346 5120 reconciler_common.go:299] "Volume detached for volume \"nova-metadata-neutron-config-1\" (UniqueName: \"kubernetes.io/secret/fc24b408-f9c2-4896-b74a-1069fa20c8a2-nova-metadata-neutron-config-1\") on node \"crc\" DevicePath \"\"" Mar 16 17:24:40 crc kubenswrapper[5120]: I0316 17:24:40.652374 5120 reconciler_common.go:299] "Volume detached for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/fc24b408-f9c2-4896-b74a-1069fa20c8a2-ssh-key-edpm-compute-no-nodes\") on node \"crc\" DevicePath \"\"" Mar 16 17:24:40 crc kubenswrapper[5120]: I0316 17:24:40.652386 5120 reconciler_common.go:299] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/fc24b408-f9c2-4896-b74a-1069fa20c8a2-inventory\") on node \"crc\" DevicePath \"\"" Mar 16 17:24:40 crc kubenswrapper[5120]: I0316 17:24:40.652397 5120 reconciler_common.go:299] "Volume detached for volume \"neutron-ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fc24b408-f9c2-4896-b74a-1069fa20c8a2-neutron-ovn-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:24:40 crc kubenswrapper[5120]: I0316 17:24:40.652409 5120 reconciler_common.go:299] "Volume detached for volume \"neutron-ovn-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/fc24b408-f9c2-4896-b74a-1069fa20c8a2-neutron-ovn-agent-neutron-config-0\") on node \"crc\" DevicePath \"\"" Mar 16 17:24:40 crc kubenswrapper[5120]: I0316 17:24:40.652419 5120 reconciler_common.go:299] "Volume detached for volume \"nova-metadata-neutron-config-2\" (UniqueName: \"kubernetes.io/secret/fc24b408-f9c2-4896-b74a-1069fa20c8a2-nova-metadata-neutron-config-2\") on node \"crc\" DevicePath \"\"" Mar 16 17:24:40 crc kubenswrapper[5120]: I0316 17:24:40.652428 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hxtqg\" (UniqueName: \"kubernetes.io/projected/fc24b408-f9c2-4896-b74a-1069fa20c8a2-kube-api-access-hxtqg\") on node \"crc\" DevicePath \"\"" Mar 16 17:24:40 crc kubenswrapper[5120]: I0316 17:24:40.652437 5120 reconciler_common.go:299] "Volume detached for volume \"nova-metadata-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/fc24b408-f9c2-4896-b74a-1069fa20c8a2-nova-metadata-neutron-config-0\") on node \"crc\" DevicePath \"\"" Mar 16 17:24:41 crc kubenswrapper[5120]: I0316 17:24:41.206445 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-k7czl" Mar 16 17:24:41 crc kubenswrapper[5120]: I0316 17:24:41.206476 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-k7czl" event={"ID":"fc24b408-f9c2-4896-b74a-1069fa20c8a2","Type":"ContainerDied","Data":"3e161ba7559ca456611cd91f6ac7bc665565404cb3b78c8b1d16815de293a2cf"} Mar 16 17:24:41 crc kubenswrapper[5120]: I0316 17:24:41.206715 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3e161ba7559ca456611cd91f6ac7bc665565404cb3b78c8b1d16815de293a2cf" Mar 16 17:24:41 crc kubenswrapper[5120]: I0316 17:24:41.263479 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-sriov-edpm-compute-no-nodes-edpm-compute-no-nodes-cn7fp"] Mar 16 17:24:41 crc kubenswrapper[5120]: I0316 17:24:41.264651 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc24b408-f9c2-4896-b74a-1069fa20c8a2" containerName="neutron-ovn-edpm-compute-no-nodes-edpm-compute-no-nodes" Mar 16 17:24:41 crc kubenswrapper[5120]: I0316 17:24:41.264680 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc24b408-f9c2-4896-b74a-1069fa20c8a2" containerName="neutron-ovn-edpm-compute-no-nodes-edpm-compute-no-nodes" Mar 16 17:24:41 crc kubenswrapper[5120]: I0316 17:24:41.264890 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="fc24b408-f9c2-4896-b74a-1069fa20c8a2" containerName="neutron-ovn-edpm-compute-no-nodes-edpm-compute-no-nodes" Mar 16 17:24:41 crc kubenswrapper[5120]: I0316 17:24:41.271932 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-sriov-edpm-compute-no-nodes-edpm-compute-no-nodes-cn7fp" Mar 16 17:24:41 crc kubenswrapper[5120]: I0316 17:24:41.274878 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-sriov-edpm-compute-no-nodes-edpm-compute-no-nodes-cn7fp"] Mar 16 17:24:41 crc kubenswrapper[5120]: I0316 17:24:41.276247 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"edpm-compute-no-nodes-dockercfg-znndh\"" Mar 16 17:24:41 crc kubenswrapper[5120]: I0316 17:24:41.276379 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-sriov-agent-neutron-config\"" Mar 16 17:24:41 crc kubenswrapper[5120]: I0316 17:24:41.276665 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-aee-default-env\"" Mar 16 17:24:41 crc kubenswrapper[5120]: I0316 17:24:41.276690 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplanenodeset-edpm-compute-no-nodes\"" Mar 16 17:24:41 crc kubenswrapper[5120]: I0316 17:24:41.276700 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"combined-ca-bundle\"" Mar 16 17:24:41 crc kubenswrapper[5120]: I0316 17:24:41.276876 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplane-ansible-ssh-private-key-secret\"" Mar 16 17:24:41 crc kubenswrapper[5120]: I0316 17:24:41.366028 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"neutron-sriov-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a150700f-69e3-456a-8c8c-00d5fa0c798a-neutron-sriov-combined-ca-bundle\") pod \"neutron-sriov-edpm-compute-no-nodes-edpm-compute-no-nodes-cn7fp\" (UID: \"a150700f-69e3-456a-8c8c-00d5fa0c798a\") " pod="openstack-kuttl-tests/neutron-sriov-edpm-compute-no-nodes-edpm-compute-no-nodes-cn7fp" Mar 16 17:24:41 crc kubenswrapper[5120]: I0316 17:24:41.366165 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/a150700f-69e3-456a-8c8c-00d5fa0c798a-inventory\") pod \"neutron-sriov-edpm-compute-no-nodes-edpm-compute-no-nodes-cn7fp\" (UID: \"a150700f-69e3-456a-8c8c-00d5fa0c798a\") " pod="openstack-kuttl-tests/neutron-sriov-edpm-compute-no-nodes-edpm-compute-no-nodes-cn7fp" Mar 16 17:24:41 crc kubenswrapper[5120]: I0316 17:24:41.366193 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"neutron-sriov-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/a150700f-69e3-456a-8c8c-00d5fa0c798a-neutron-sriov-agent-neutron-config-0\") pod \"neutron-sriov-edpm-compute-no-nodes-edpm-compute-no-nodes-cn7fp\" (UID: \"a150700f-69e3-456a-8c8c-00d5fa0c798a\") " pod="openstack-kuttl-tests/neutron-sriov-edpm-compute-no-nodes-edpm-compute-no-nodes-cn7fp" Mar 16 17:24:41 crc kubenswrapper[5120]: I0316 17:24:41.366431 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/a150700f-69e3-456a-8c8c-00d5fa0c798a-ssh-key-edpm-compute-no-nodes\") pod \"neutron-sriov-edpm-compute-no-nodes-edpm-compute-no-nodes-cn7fp\" (UID: \"a150700f-69e3-456a-8c8c-00d5fa0c798a\") " pod="openstack-kuttl-tests/neutron-sriov-edpm-compute-no-nodes-edpm-compute-no-nodes-cn7fp" Mar 16 17:24:41 crc kubenswrapper[5120]: I0316 17:24:41.366570 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84qrv\" (UniqueName: \"kubernetes.io/projected/a150700f-69e3-456a-8c8c-00d5fa0c798a-kube-api-access-84qrv\") pod \"neutron-sriov-edpm-compute-no-nodes-edpm-compute-no-nodes-cn7fp\" (UID: \"a150700f-69e3-456a-8c8c-00d5fa0c798a\") " pod="openstack-kuttl-tests/neutron-sriov-edpm-compute-no-nodes-edpm-compute-no-nodes-cn7fp" Mar 16 17:24:41 crc kubenswrapper[5120]: I0316 17:24:41.468731 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/a150700f-69e3-456a-8c8c-00d5fa0c798a-ssh-key-edpm-compute-no-nodes\") pod \"neutron-sriov-edpm-compute-no-nodes-edpm-compute-no-nodes-cn7fp\" (UID: \"a150700f-69e3-456a-8c8c-00d5fa0c798a\") " pod="openstack-kuttl-tests/neutron-sriov-edpm-compute-no-nodes-edpm-compute-no-nodes-cn7fp" Mar 16 17:24:41 crc kubenswrapper[5120]: I0316 17:24:41.468863 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-84qrv\" (UniqueName: \"kubernetes.io/projected/a150700f-69e3-456a-8c8c-00d5fa0c798a-kube-api-access-84qrv\") pod \"neutron-sriov-edpm-compute-no-nodes-edpm-compute-no-nodes-cn7fp\" (UID: \"a150700f-69e3-456a-8c8c-00d5fa0c798a\") " pod="openstack-kuttl-tests/neutron-sriov-edpm-compute-no-nodes-edpm-compute-no-nodes-cn7fp" Mar 16 17:24:41 crc kubenswrapper[5120]: I0316 17:24:41.468962 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"neutron-sriov-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a150700f-69e3-456a-8c8c-00d5fa0c798a-neutron-sriov-combined-ca-bundle\") pod \"neutron-sriov-edpm-compute-no-nodes-edpm-compute-no-nodes-cn7fp\" (UID: \"a150700f-69e3-456a-8c8c-00d5fa0c798a\") " pod="openstack-kuttl-tests/neutron-sriov-edpm-compute-no-nodes-edpm-compute-no-nodes-cn7fp" Mar 16 17:24:41 crc kubenswrapper[5120]: I0316 17:24:41.469087 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/a150700f-69e3-456a-8c8c-00d5fa0c798a-inventory\") pod \"neutron-sriov-edpm-compute-no-nodes-edpm-compute-no-nodes-cn7fp\" (UID: \"a150700f-69e3-456a-8c8c-00d5fa0c798a\") " pod="openstack-kuttl-tests/neutron-sriov-edpm-compute-no-nodes-edpm-compute-no-nodes-cn7fp" Mar 16 17:24:41 crc kubenswrapper[5120]: I0316 17:24:41.469122 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"neutron-sriov-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/a150700f-69e3-456a-8c8c-00d5fa0c798a-neutron-sriov-agent-neutron-config-0\") pod \"neutron-sriov-edpm-compute-no-nodes-edpm-compute-no-nodes-cn7fp\" (UID: \"a150700f-69e3-456a-8c8c-00d5fa0c798a\") " pod="openstack-kuttl-tests/neutron-sriov-edpm-compute-no-nodes-edpm-compute-no-nodes-cn7fp" Mar 16 17:24:41 crc kubenswrapper[5120]: I0316 17:24:41.473341 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"neutron-sriov-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/a150700f-69e3-456a-8c8c-00d5fa0c798a-neutron-sriov-agent-neutron-config-0\") pod \"neutron-sriov-edpm-compute-no-nodes-edpm-compute-no-nodes-cn7fp\" (UID: \"a150700f-69e3-456a-8c8c-00d5fa0c798a\") " pod="openstack-kuttl-tests/neutron-sriov-edpm-compute-no-nodes-edpm-compute-no-nodes-cn7fp" Mar 16 17:24:41 crc kubenswrapper[5120]: I0316 17:24:41.473565 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/a150700f-69e3-456a-8c8c-00d5fa0c798a-ssh-key-edpm-compute-no-nodes\") pod \"neutron-sriov-edpm-compute-no-nodes-edpm-compute-no-nodes-cn7fp\" (UID: \"a150700f-69e3-456a-8c8c-00d5fa0c798a\") " pod="openstack-kuttl-tests/neutron-sriov-edpm-compute-no-nodes-edpm-compute-no-nodes-cn7fp" Mar 16 17:24:41 crc kubenswrapper[5120]: I0316 17:24:41.473578 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"neutron-sriov-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a150700f-69e3-456a-8c8c-00d5fa0c798a-neutron-sriov-combined-ca-bundle\") pod \"neutron-sriov-edpm-compute-no-nodes-edpm-compute-no-nodes-cn7fp\" (UID: \"a150700f-69e3-456a-8c8c-00d5fa0c798a\") " pod="openstack-kuttl-tests/neutron-sriov-edpm-compute-no-nodes-edpm-compute-no-nodes-cn7fp" Mar 16 17:24:41 crc kubenswrapper[5120]: I0316 17:24:41.473943 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/a150700f-69e3-456a-8c8c-00d5fa0c798a-inventory\") pod \"neutron-sriov-edpm-compute-no-nodes-edpm-compute-no-nodes-cn7fp\" (UID: \"a150700f-69e3-456a-8c8c-00d5fa0c798a\") " pod="openstack-kuttl-tests/neutron-sriov-edpm-compute-no-nodes-edpm-compute-no-nodes-cn7fp" Mar 16 17:24:41 crc kubenswrapper[5120]: I0316 17:24:41.489436 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-84qrv\" (UniqueName: \"kubernetes.io/projected/a150700f-69e3-456a-8c8c-00d5fa0c798a-kube-api-access-84qrv\") pod \"neutron-sriov-edpm-compute-no-nodes-edpm-compute-no-nodes-cn7fp\" (UID: \"a150700f-69e3-456a-8c8c-00d5fa0c798a\") " pod="openstack-kuttl-tests/neutron-sriov-edpm-compute-no-nodes-edpm-compute-no-nodes-cn7fp" Mar 16 17:24:41 crc kubenswrapper[5120]: I0316 17:24:41.605213 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-sriov-edpm-compute-no-nodes-edpm-compute-no-nodes-cn7fp" Mar 16 17:24:42 crc kubenswrapper[5120]: I0316 17:24:42.055583 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-sriov-edpm-compute-no-nodes-edpm-compute-no-nodes-cn7fp"] Mar 16 17:24:42 crc kubenswrapper[5120]: I0316 17:24:42.217878 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-sriov-edpm-compute-no-nodes-edpm-compute-no-nodes-cn7fp" event={"ID":"a150700f-69e3-456a-8c8c-00d5fa0c798a","Type":"ContainerStarted","Data":"562696a97caedd00ba4ffa173b24da0b2dfbd6100656e04f8e29c0ac2fd6dc61"} Mar 16 17:24:43 crc kubenswrapper[5120]: I0316 17:24:43.227959 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-sriov-edpm-compute-no-nodes-edpm-compute-no-nodes-cn7fp" event={"ID":"a150700f-69e3-456a-8c8c-00d5fa0c798a","Type":"ContainerStarted","Data":"b4eda95ca813921c9f3e8b78648ab182f5dce86a684c9d715da2381ce959207c"} Mar 16 17:24:43 crc kubenswrapper[5120]: I0316 17:24:43.249252 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-sriov-edpm-compute-no-nodes-edpm-compute-no-nodes-cn7fp" podStartSLOduration=1.782044084 podStartE2EDuration="2.249232169s" podCreationTimestamp="2026-03-16 17:24:41 +0000 UTC" firstStartedPulling="2026-03-16 17:24:42.059926632 +0000 UTC m=+6784.213858289" lastFinishedPulling="2026-03-16 17:24:42.527114717 +0000 UTC m=+6784.681046374" observedRunningTime="2026-03-16 17:24:43.241515079 +0000 UTC m=+6785.395446736" watchObservedRunningTime="2026-03-16 17:24:43.249232169 +0000 UTC m=+6785.403163826" Mar 16 17:24:44 crc kubenswrapper[5120]: I0316 17:24:44.238269 5120 generic.go:358] "Generic (PLEG): container finished" podID="a150700f-69e3-456a-8c8c-00d5fa0c798a" containerID="b4eda95ca813921c9f3e8b78648ab182f5dce86a684c9d715da2381ce959207c" exitCode=0 Mar 16 17:24:44 crc kubenswrapper[5120]: I0316 17:24:44.238316 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-sriov-edpm-compute-no-nodes-edpm-compute-no-nodes-cn7fp" event={"ID":"a150700f-69e3-456a-8c8c-00d5fa0c798a","Type":"ContainerDied","Data":"b4eda95ca813921c9f3e8b78648ab182f5dce86a684c9d715da2381ce959207c"} Mar 16 17:24:45 crc kubenswrapper[5120]: I0316 17:24:45.544336 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-sriov-edpm-compute-no-nodes-edpm-compute-no-nodes-cn7fp" Mar 16 17:24:45 crc kubenswrapper[5120]: I0316 17:24:45.658450 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"neutron-sriov-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/a150700f-69e3-456a-8c8c-00d5fa0c798a-neutron-sriov-agent-neutron-config-0\") pod \"a150700f-69e3-456a-8c8c-00d5fa0c798a\" (UID: \"a150700f-69e3-456a-8c8c-00d5fa0c798a\") " Mar 16 17:24:45 crc kubenswrapper[5120]: I0316 17:24:45.658628 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-84qrv\" (UniqueName: \"kubernetes.io/projected/a150700f-69e3-456a-8c8c-00d5fa0c798a-kube-api-access-84qrv\") pod \"a150700f-69e3-456a-8c8c-00d5fa0c798a\" (UID: \"a150700f-69e3-456a-8c8c-00d5fa0c798a\") " Mar 16 17:24:45 crc kubenswrapper[5120]: I0316 17:24:45.658780 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/a150700f-69e3-456a-8c8c-00d5fa0c798a-inventory\") pod \"a150700f-69e3-456a-8c8c-00d5fa0c798a\" (UID: \"a150700f-69e3-456a-8c8c-00d5fa0c798a\") " Mar 16 17:24:45 crc kubenswrapper[5120]: I0316 17:24:45.658840 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/a150700f-69e3-456a-8c8c-00d5fa0c798a-ssh-key-edpm-compute-no-nodes\") pod \"a150700f-69e3-456a-8c8c-00d5fa0c798a\" (UID: \"a150700f-69e3-456a-8c8c-00d5fa0c798a\") " Mar 16 17:24:45 crc kubenswrapper[5120]: I0316 17:24:45.658860 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"neutron-sriov-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a150700f-69e3-456a-8c8c-00d5fa0c798a-neutron-sriov-combined-ca-bundle\") pod \"a150700f-69e3-456a-8c8c-00d5fa0c798a\" (UID: \"a150700f-69e3-456a-8c8c-00d5fa0c798a\") " Mar 16 17:24:45 crc kubenswrapper[5120]: I0316 17:24:45.666159 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a150700f-69e3-456a-8c8c-00d5fa0c798a-neutron-sriov-combined-ca-bundle" (OuterVolumeSpecName: "neutron-sriov-combined-ca-bundle") pod "a150700f-69e3-456a-8c8c-00d5fa0c798a" (UID: "a150700f-69e3-456a-8c8c-00d5fa0c798a"). InnerVolumeSpecName "neutron-sriov-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:24:45 crc kubenswrapper[5120]: I0316 17:24:45.667671 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a150700f-69e3-456a-8c8c-00d5fa0c798a-kube-api-access-84qrv" (OuterVolumeSpecName: "kube-api-access-84qrv") pod "a150700f-69e3-456a-8c8c-00d5fa0c798a" (UID: "a150700f-69e3-456a-8c8c-00d5fa0c798a"). InnerVolumeSpecName "kube-api-access-84qrv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:24:45 crc kubenswrapper[5120]: I0316 17:24:45.686671 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a150700f-69e3-456a-8c8c-00d5fa0c798a-inventory" (OuterVolumeSpecName: "inventory") pod "a150700f-69e3-456a-8c8c-00d5fa0c798a" (UID: "a150700f-69e3-456a-8c8c-00d5fa0c798a"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:24:45 crc kubenswrapper[5120]: I0316 17:24:45.687123 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a150700f-69e3-456a-8c8c-00d5fa0c798a-neutron-sriov-agent-neutron-config-0" (OuterVolumeSpecName: "neutron-sriov-agent-neutron-config-0") pod "a150700f-69e3-456a-8c8c-00d5fa0c798a" (UID: "a150700f-69e3-456a-8c8c-00d5fa0c798a"). InnerVolumeSpecName "neutron-sriov-agent-neutron-config-0". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:24:45 crc kubenswrapper[5120]: I0316 17:24:45.690225 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a150700f-69e3-456a-8c8c-00d5fa0c798a-ssh-key-edpm-compute-no-nodes" (OuterVolumeSpecName: "ssh-key-edpm-compute-no-nodes") pod "a150700f-69e3-456a-8c8c-00d5fa0c798a" (UID: "a150700f-69e3-456a-8c8c-00d5fa0c798a"). InnerVolumeSpecName "ssh-key-edpm-compute-no-nodes". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:24:45 crc kubenswrapper[5120]: I0316 17:24:45.761202 5120 reconciler_common.go:299] "Volume detached for volume \"neutron-sriov-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/a150700f-69e3-456a-8c8c-00d5fa0c798a-neutron-sriov-agent-neutron-config-0\") on node \"crc\" DevicePath \"\"" Mar 16 17:24:45 crc kubenswrapper[5120]: I0316 17:24:45.761278 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-84qrv\" (UniqueName: \"kubernetes.io/projected/a150700f-69e3-456a-8c8c-00d5fa0c798a-kube-api-access-84qrv\") on node \"crc\" DevicePath \"\"" Mar 16 17:24:45 crc kubenswrapper[5120]: I0316 17:24:45.761291 5120 reconciler_common.go:299] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/a150700f-69e3-456a-8c8c-00d5fa0c798a-inventory\") on node \"crc\" DevicePath \"\"" Mar 16 17:24:45 crc kubenswrapper[5120]: I0316 17:24:45.761302 5120 reconciler_common.go:299] "Volume detached for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/a150700f-69e3-456a-8c8c-00d5fa0c798a-ssh-key-edpm-compute-no-nodes\") on node \"crc\" DevicePath \"\"" Mar 16 17:24:45 crc kubenswrapper[5120]: I0316 17:24:45.761313 5120 reconciler_common.go:299] "Volume detached for volume \"neutron-sriov-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a150700f-69e3-456a-8c8c-00d5fa0c798a-neutron-sriov-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:24:46 crc kubenswrapper[5120]: I0316 17:24:46.257592 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-sriov-edpm-compute-no-nodes-edpm-compute-no-nodes-cn7fp" Mar 16 17:24:46 crc kubenswrapper[5120]: I0316 17:24:46.257614 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-sriov-edpm-compute-no-nodes-edpm-compute-no-nodes-cn7fp" event={"ID":"a150700f-69e3-456a-8c8c-00d5fa0c798a","Type":"ContainerDied","Data":"562696a97caedd00ba4ffa173b24da0b2dfbd6100656e04f8e29c0ac2fd6dc61"} Mar 16 17:24:46 crc kubenswrapper[5120]: I0316 17:24:46.258047 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="562696a97caedd00ba4ffa173b24da0b2dfbd6100656e04f8e29c0ac2fd6dc61" Mar 16 17:24:46 crc kubenswrapper[5120]: I0316 17:24:46.319004 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-dhcp-edpm-compute-no-nodes-edpm-compute-no-nodes-qttzd"] Mar 16 17:24:46 crc kubenswrapper[5120]: I0316 17:24:46.322490 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a150700f-69e3-456a-8c8c-00d5fa0c798a" containerName="neutron-sriov-edpm-compute-no-nodes-edpm-compute-no-nodes" Mar 16 17:24:46 crc kubenswrapper[5120]: I0316 17:24:46.322633 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a150700f-69e3-456a-8c8c-00d5fa0c798a" containerName="neutron-sriov-edpm-compute-no-nodes-edpm-compute-no-nodes" Mar 16 17:24:46 crc kubenswrapper[5120]: I0316 17:24:46.322883 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="a150700f-69e3-456a-8c8c-00d5fa0c798a" containerName="neutron-sriov-edpm-compute-no-nodes-edpm-compute-no-nodes" Mar 16 17:24:46 crc kubenswrapper[5120]: I0316 17:24:46.331069 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-dhcp-edpm-compute-no-nodes-edpm-compute-no-nodes-qttzd" Mar 16 17:24:46 crc kubenswrapper[5120]: I0316 17:24:46.333364 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"combined-ca-bundle\"" Mar 16 17:24:46 crc kubenswrapper[5120]: I0316 17:24:46.333405 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplane-ansible-ssh-private-key-secret\"" Mar 16 17:24:46 crc kubenswrapper[5120]: I0316 17:24:46.333950 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-dhcp-edpm-compute-no-nodes-edpm-compute-no-nodes-qttzd"] Mar 16 17:24:46 crc kubenswrapper[5120]: I0316 17:24:46.334684 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-dhcp-agent-neutron-config\"" Mar 16 17:24:46 crc kubenswrapper[5120]: I0316 17:24:46.334911 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplanenodeset-edpm-compute-no-nodes\"" Mar 16 17:24:46 crc kubenswrapper[5120]: I0316 17:24:46.335284 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-aee-default-env\"" Mar 16 17:24:46 crc kubenswrapper[5120]: I0316 17:24:46.338280 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"edpm-compute-no-nodes-dockercfg-znndh\"" Mar 16 17:24:46 crc kubenswrapper[5120]: I0316 17:24:46.481082 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zd8lh\" (UniqueName: \"kubernetes.io/projected/d28180ab-20c9-43ac-933a-892ab0774703-kube-api-access-zd8lh\") pod \"neutron-dhcp-edpm-compute-no-nodes-edpm-compute-no-nodes-qttzd\" (UID: \"d28180ab-20c9-43ac-933a-892ab0774703\") " pod="openstack-kuttl-tests/neutron-dhcp-edpm-compute-no-nodes-edpm-compute-no-nodes-qttzd" Mar 16 17:24:46 crc kubenswrapper[5120]: I0316 17:24:46.481170 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"neutron-dhcp-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d28180ab-20c9-43ac-933a-892ab0774703-neutron-dhcp-combined-ca-bundle\") pod \"neutron-dhcp-edpm-compute-no-nodes-edpm-compute-no-nodes-qttzd\" (UID: \"d28180ab-20c9-43ac-933a-892ab0774703\") " pod="openstack-kuttl-tests/neutron-dhcp-edpm-compute-no-nodes-edpm-compute-no-nodes-qttzd" Mar 16 17:24:46 crc kubenswrapper[5120]: I0316 17:24:46.481265 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/d28180ab-20c9-43ac-933a-892ab0774703-inventory\") pod \"neutron-dhcp-edpm-compute-no-nodes-edpm-compute-no-nodes-qttzd\" (UID: \"d28180ab-20c9-43ac-933a-892ab0774703\") " pod="openstack-kuttl-tests/neutron-dhcp-edpm-compute-no-nodes-edpm-compute-no-nodes-qttzd" Mar 16 17:24:46 crc kubenswrapper[5120]: I0316 17:24:46.481430 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/d28180ab-20c9-43ac-933a-892ab0774703-ssh-key-edpm-compute-no-nodes\") pod \"neutron-dhcp-edpm-compute-no-nodes-edpm-compute-no-nodes-qttzd\" (UID: \"d28180ab-20c9-43ac-933a-892ab0774703\") " pod="openstack-kuttl-tests/neutron-dhcp-edpm-compute-no-nodes-edpm-compute-no-nodes-qttzd" Mar 16 17:24:46 crc kubenswrapper[5120]: I0316 17:24:46.481492 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"neutron-dhcp-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/d28180ab-20c9-43ac-933a-892ab0774703-neutron-dhcp-agent-neutron-config-0\") pod \"neutron-dhcp-edpm-compute-no-nodes-edpm-compute-no-nodes-qttzd\" (UID: \"d28180ab-20c9-43ac-933a-892ab0774703\") " pod="openstack-kuttl-tests/neutron-dhcp-edpm-compute-no-nodes-edpm-compute-no-nodes-qttzd" Mar 16 17:24:46 crc kubenswrapper[5120]: I0316 17:24:46.583170 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/d28180ab-20c9-43ac-933a-892ab0774703-ssh-key-edpm-compute-no-nodes\") pod \"neutron-dhcp-edpm-compute-no-nodes-edpm-compute-no-nodes-qttzd\" (UID: \"d28180ab-20c9-43ac-933a-892ab0774703\") " pod="openstack-kuttl-tests/neutron-dhcp-edpm-compute-no-nodes-edpm-compute-no-nodes-qttzd" Mar 16 17:24:46 crc kubenswrapper[5120]: I0316 17:24:46.583237 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"neutron-dhcp-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/d28180ab-20c9-43ac-933a-892ab0774703-neutron-dhcp-agent-neutron-config-0\") pod \"neutron-dhcp-edpm-compute-no-nodes-edpm-compute-no-nodes-qttzd\" (UID: \"d28180ab-20c9-43ac-933a-892ab0774703\") " pod="openstack-kuttl-tests/neutron-dhcp-edpm-compute-no-nodes-edpm-compute-no-nodes-qttzd" Mar 16 17:24:46 crc kubenswrapper[5120]: I0316 17:24:46.583587 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zd8lh\" (UniqueName: \"kubernetes.io/projected/d28180ab-20c9-43ac-933a-892ab0774703-kube-api-access-zd8lh\") pod \"neutron-dhcp-edpm-compute-no-nodes-edpm-compute-no-nodes-qttzd\" (UID: \"d28180ab-20c9-43ac-933a-892ab0774703\") " pod="openstack-kuttl-tests/neutron-dhcp-edpm-compute-no-nodes-edpm-compute-no-nodes-qttzd" Mar 16 17:24:46 crc kubenswrapper[5120]: I0316 17:24:46.583641 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"neutron-dhcp-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d28180ab-20c9-43ac-933a-892ab0774703-neutron-dhcp-combined-ca-bundle\") pod \"neutron-dhcp-edpm-compute-no-nodes-edpm-compute-no-nodes-qttzd\" (UID: \"d28180ab-20c9-43ac-933a-892ab0774703\") " pod="openstack-kuttl-tests/neutron-dhcp-edpm-compute-no-nodes-edpm-compute-no-nodes-qttzd" Mar 16 17:24:46 crc kubenswrapper[5120]: I0316 17:24:46.583677 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/d28180ab-20c9-43ac-933a-892ab0774703-inventory\") pod \"neutron-dhcp-edpm-compute-no-nodes-edpm-compute-no-nodes-qttzd\" (UID: \"d28180ab-20c9-43ac-933a-892ab0774703\") " pod="openstack-kuttl-tests/neutron-dhcp-edpm-compute-no-nodes-edpm-compute-no-nodes-qttzd" Mar 16 17:24:46 crc kubenswrapper[5120]: I0316 17:24:46.589920 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/d28180ab-20c9-43ac-933a-892ab0774703-inventory\") pod \"neutron-dhcp-edpm-compute-no-nodes-edpm-compute-no-nodes-qttzd\" (UID: \"d28180ab-20c9-43ac-933a-892ab0774703\") " pod="openstack-kuttl-tests/neutron-dhcp-edpm-compute-no-nodes-edpm-compute-no-nodes-qttzd" Mar 16 17:24:46 crc kubenswrapper[5120]: I0316 17:24:46.590091 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"neutron-dhcp-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d28180ab-20c9-43ac-933a-892ab0774703-neutron-dhcp-combined-ca-bundle\") pod \"neutron-dhcp-edpm-compute-no-nodes-edpm-compute-no-nodes-qttzd\" (UID: \"d28180ab-20c9-43ac-933a-892ab0774703\") " pod="openstack-kuttl-tests/neutron-dhcp-edpm-compute-no-nodes-edpm-compute-no-nodes-qttzd" Mar 16 17:24:46 crc kubenswrapper[5120]: I0316 17:24:46.591116 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/d28180ab-20c9-43ac-933a-892ab0774703-ssh-key-edpm-compute-no-nodes\") pod \"neutron-dhcp-edpm-compute-no-nodes-edpm-compute-no-nodes-qttzd\" (UID: \"d28180ab-20c9-43ac-933a-892ab0774703\") " pod="openstack-kuttl-tests/neutron-dhcp-edpm-compute-no-nodes-edpm-compute-no-nodes-qttzd" Mar 16 17:24:46 crc kubenswrapper[5120]: I0316 17:24:46.595211 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"neutron-dhcp-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/d28180ab-20c9-43ac-933a-892ab0774703-neutron-dhcp-agent-neutron-config-0\") pod \"neutron-dhcp-edpm-compute-no-nodes-edpm-compute-no-nodes-qttzd\" (UID: \"d28180ab-20c9-43ac-933a-892ab0774703\") " pod="openstack-kuttl-tests/neutron-dhcp-edpm-compute-no-nodes-edpm-compute-no-nodes-qttzd" Mar 16 17:24:46 crc kubenswrapper[5120]: I0316 17:24:46.602740 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zd8lh\" (UniqueName: \"kubernetes.io/projected/d28180ab-20c9-43ac-933a-892ab0774703-kube-api-access-zd8lh\") pod \"neutron-dhcp-edpm-compute-no-nodes-edpm-compute-no-nodes-qttzd\" (UID: \"d28180ab-20c9-43ac-933a-892ab0774703\") " pod="openstack-kuttl-tests/neutron-dhcp-edpm-compute-no-nodes-edpm-compute-no-nodes-qttzd" Mar 16 17:24:46 crc kubenswrapper[5120]: I0316 17:24:46.648409 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-dhcp-edpm-compute-no-nodes-edpm-compute-no-nodes-qttzd" Mar 16 17:24:47 crc kubenswrapper[5120]: I0316 17:24:47.117897 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-dhcp-edpm-compute-no-nodes-edpm-compute-no-nodes-qttzd"] Mar 16 17:24:47 crc kubenswrapper[5120]: W0316 17:24:47.127065 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd28180ab_20c9_43ac_933a_892ab0774703.slice/crio-2931342d312de33386a9c52594d2f4a5949c6b7a421a60184d50663fbf5d09a4 WatchSource:0}: Error finding container 2931342d312de33386a9c52594d2f4a5949c6b7a421a60184d50663fbf5d09a4: Status 404 returned error can't find the container with id 2931342d312de33386a9c52594d2f4a5949c6b7a421a60184d50663fbf5d09a4 Mar 16 17:24:47 crc kubenswrapper[5120]: I0316 17:24:47.269522 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-dhcp-edpm-compute-no-nodes-edpm-compute-no-nodes-qttzd" event={"ID":"d28180ab-20c9-43ac-933a-892ab0774703","Type":"ContainerStarted","Data":"2931342d312de33386a9c52594d2f4a5949c6b7a421a60184d50663fbf5d09a4"} Mar 16 17:24:48 crc kubenswrapper[5120]: I0316 17:24:48.280284 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-dhcp-edpm-compute-no-nodes-edpm-compute-no-nodes-qttzd" event={"ID":"d28180ab-20c9-43ac-933a-892ab0774703","Type":"ContainerStarted","Data":"fd4225c0e24d106b55cc7f9e1a02c63e43004a8f15a1c1ebb1762b82f65e65d2"} Mar 16 17:24:49 crc kubenswrapper[5120]: I0316 17:24:49.294215 5120 generic.go:358] "Generic (PLEG): container finished" podID="d28180ab-20c9-43ac-933a-892ab0774703" containerID="fd4225c0e24d106b55cc7f9e1a02c63e43004a8f15a1c1ebb1762b82f65e65d2" exitCode=0 Mar 16 17:24:49 crc kubenswrapper[5120]: I0316 17:24:49.294303 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-dhcp-edpm-compute-no-nodes-edpm-compute-no-nodes-qttzd" event={"ID":"d28180ab-20c9-43ac-933a-892ab0774703","Type":"ContainerDied","Data":"fd4225c0e24d106b55cc7f9e1a02c63e43004a8f15a1c1ebb1762b82f65e65d2"} Mar 16 17:24:50 crc kubenswrapper[5120]: I0316 17:24:50.611208 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-dhcp-edpm-compute-no-nodes-edpm-compute-no-nodes-qttzd" Mar 16 17:24:50 crc kubenswrapper[5120]: I0316 17:24:50.679345 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zd8lh\" (UniqueName: \"kubernetes.io/projected/d28180ab-20c9-43ac-933a-892ab0774703-kube-api-access-zd8lh\") pod \"d28180ab-20c9-43ac-933a-892ab0774703\" (UID: \"d28180ab-20c9-43ac-933a-892ab0774703\") " Mar 16 17:24:50 crc kubenswrapper[5120]: I0316 17:24:50.679430 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/d28180ab-20c9-43ac-933a-892ab0774703-ssh-key-edpm-compute-no-nodes\") pod \"d28180ab-20c9-43ac-933a-892ab0774703\" (UID: \"d28180ab-20c9-43ac-933a-892ab0774703\") " Mar 16 17:24:50 crc kubenswrapper[5120]: I0316 17:24:50.679713 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"neutron-dhcp-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d28180ab-20c9-43ac-933a-892ab0774703-neutron-dhcp-combined-ca-bundle\") pod \"d28180ab-20c9-43ac-933a-892ab0774703\" (UID: \"d28180ab-20c9-43ac-933a-892ab0774703\") " Mar 16 17:24:50 crc kubenswrapper[5120]: I0316 17:24:50.679753 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"neutron-dhcp-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/d28180ab-20c9-43ac-933a-892ab0774703-neutron-dhcp-agent-neutron-config-0\") pod \"d28180ab-20c9-43ac-933a-892ab0774703\" (UID: \"d28180ab-20c9-43ac-933a-892ab0774703\") " Mar 16 17:24:50 crc kubenswrapper[5120]: I0316 17:24:50.680241 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/d28180ab-20c9-43ac-933a-892ab0774703-inventory\") pod \"d28180ab-20c9-43ac-933a-892ab0774703\" (UID: \"d28180ab-20c9-43ac-933a-892ab0774703\") " Mar 16 17:24:50 crc kubenswrapper[5120]: I0316 17:24:50.686439 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d28180ab-20c9-43ac-933a-892ab0774703-neutron-dhcp-combined-ca-bundle" (OuterVolumeSpecName: "neutron-dhcp-combined-ca-bundle") pod "d28180ab-20c9-43ac-933a-892ab0774703" (UID: "d28180ab-20c9-43ac-933a-892ab0774703"). InnerVolumeSpecName "neutron-dhcp-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:24:50 crc kubenswrapper[5120]: I0316 17:24:50.689963 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d28180ab-20c9-43ac-933a-892ab0774703-kube-api-access-zd8lh" (OuterVolumeSpecName: "kube-api-access-zd8lh") pod "d28180ab-20c9-43ac-933a-892ab0774703" (UID: "d28180ab-20c9-43ac-933a-892ab0774703"). InnerVolumeSpecName "kube-api-access-zd8lh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:24:50 crc kubenswrapper[5120]: I0316 17:24:50.705454 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d28180ab-20c9-43ac-933a-892ab0774703-ssh-key-edpm-compute-no-nodes" (OuterVolumeSpecName: "ssh-key-edpm-compute-no-nodes") pod "d28180ab-20c9-43ac-933a-892ab0774703" (UID: "d28180ab-20c9-43ac-933a-892ab0774703"). InnerVolumeSpecName "ssh-key-edpm-compute-no-nodes". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:24:50 crc kubenswrapper[5120]: I0316 17:24:50.708024 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d28180ab-20c9-43ac-933a-892ab0774703-inventory" (OuterVolumeSpecName: "inventory") pod "d28180ab-20c9-43ac-933a-892ab0774703" (UID: "d28180ab-20c9-43ac-933a-892ab0774703"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:24:50 crc kubenswrapper[5120]: I0316 17:24:50.721065 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d28180ab-20c9-43ac-933a-892ab0774703-neutron-dhcp-agent-neutron-config-0" (OuterVolumeSpecName: "neutron-dhcp-agent-neutron-config-0") pod "d28180ab-20c9-43ac-933a-892ab0774703" (UID: "d28180ab-20c9-43ac-933a-892ab0774703"). InnerVolumeSpecName "neutron-dhcp-agent-neutron-config-0". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:24:50 crc kubenswrapper[5120]: I0316 17:24:50.782826 5120 reconciler_common.go:299] "Volume detached for volume \"neutron-dhcp-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/d28180ab-20c9-43ac-933a-892ab0774703-neutron-dhcp-agent-neutron-config-0\") on node \"crc\" DevicePath \"\"" Mar 16 17:24:50 crc kubenswrapper[5120]: I0316 17:24:50.782875 5120 reconciler_common.go:299] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/d28180ab-20c9-43ac-933a-892ab0774703-inventory\") on node \"crc\" DevicePath \"\"" Mar 16 17:24:50 crc kubenswrapper[5120]: I0316 17:24:50.782885 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zd8lh\" (UniqueName: \"kubernetes.io/projected/d28180ab-20c9-43ac-933a-892ab0774703-kube-api-access-zd8lh\") on node \"crc\" DevicePath \"\"" Mar 16 17:24:50 crc kubenswrapper[5120]: I0316 17:24:50.782895 5120 reconciler_common.go:299] "Volume detached for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/d28180ab-20c9-43ac-933a-892ab0774703-ssh-key-edpm-compute-no-nodes\") on node \"crc\" DevicePath \"\"" Mar 16 17:24:50 crc kubenswrapper[5120]: I0316 17:24:50.782904 5120 reconciler_common.go:299] "Volume detached for volume \"neutron-dhcp-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d28180ab-20c9-43ac-933a-892ab0774703-neutron-dhcp-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:24:51 crc kubenswrapper[5120]: I0316 17:24:51.316720 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-dhcp-edpm-compute-no-nodes-edpm-compute-no-nodes-qttzd" Mar 16 17:24:51 crc kubenswrapper[5120]: I0316 17:24:51.317002 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-dhcp-edpm-compute-no-nodes-edpm-compute-no-nodes-qttzd" event={"ID":"d28180ab-20c9-43ac-933a-892ab0774703","Type":"ContainerDied","Data":"2931342d312de33386a9c52594d2f4a5949c6b7a421a60184d50663fbf5d09a4"} Mar 16 17:24:51 crc kubenswrapper[5120]: I0316 17:24:51.319836 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2931342d312de33386a9c52594d2f4a5949c6b7a421a60184d50663fbf5d09a4" Mar 16 17:24:51 crc kubenswrapper[5120]: I0316 17:24:51.372934 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/libvirt-edpm-compute-no-nodes-edpm-compute-no-nodes-vmmf2"] Mar 16 17:24:51 crc kubenswrapper[5120]: I0316 17:24:51.373932 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d28180ab-20c9-43ac-933a-892ab0774703" containerName="neutron-dhcp-edpm-compute-no-nodes-edpm-compute-no-nodes" Mar 16 17:24:51 crc kubenswrapper[5120]: I0316 17:24:51.373955 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="d28180ab-20c9-43ac-933a-892ab0774703" containerName="neutron-dhcp-edpm-compute-no-nodes-edpm-compute-no-nodes" Mar 16 17:24:51 crc kubenswrapper[5120]: I0316 17:24:51.374089 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="d28180ab-20c9-43ac-933a-892ab0774703" containerName="neutron-dhcp-edpm-compute-no-nodes-edpm-compute-no-nodes" Mar 16 17:24:51 crc kubenswrapper[5120]: I0316 17:24:51.379880 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/libvirt-edpm-compute-no-nodes-edpm-compute-no-nodes-vmmf2" Mar 16 17:24:51 crc kubenswrapper[5120]: I0316 17:24:51.383103 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-aee-default-env\"" Mar 16 17:24:51 crc kubenswrapper[5120]: I0316 17:24:51.383143 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"libvirt-secret\"" Mar 16 17:24:51 crc kubenswrapper[5120]: I0316 17:24:51.383103 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplanenodeset-edpm-compute-no-nodes\"" Mar 16 17:24:51 crc kubenswrapper[5120]: I0316 17:24:51.383447 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplane-ansible-ssh-private-key-secret\"" Mar 16 17:24:51 crc kubenswrapper[5120]: I0316 17:24:51.383619 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"combined-ca-bundle\"" Mar 16 17:24:51 crc kubenswrapper[5120]: I0316 17:24:51.383878 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"edpm-compute-no-nodes-dockercfg-znndh\"" Mar 16 17:24:51 crc kubenswrapper[5120]: I0316 17:24:51.385118 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/libvirt-edpm-compute-no-nodes-edpm-compute-no-nodes-vmmf2"] Mar 16 17:24:51 crc kubenswrapper[5120]: I0316 17:24:51.498505 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"libvirt-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f9ab2ddd-74df-4e40-a811-1eecfa066a6f-libvirt-combined-ca-bundle\") pod \"libvirt-edpm-compute-no-nodes-edpm-compute-no-nodes-vmmf2\" (UID: \"f9ab2ddd-74df-4e40-a811-1eecfa066a6f\") " pod="openstack-kuttl-tests/libvirt-edpm-compute-no-nodes-edpm-compute-no-nodes-vmmf2" Mar 16 17:24:51 crc kubenswrapper[5120]: I0316 17:24:51.498606 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/f9ab2ddd-74df-4e40-a811-1eecfa066a6f-inventory\") pod \"libvirt-edpm-compute-no-nodes-edpm-compute-no-nodes-vmmf2\" (UID: \"f9ab2ddd-74df-4e40-a811-1eecfa066a6f\") " pod="openstack-kuttl-tests/libvirt-edpm-compute-no-nodes-edpm-compute-no-nodes-vmmf2" Mar 16 17:24:51 crc kubenswrapper[5120]: I0316 17:24:51.498741 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5fwt\" (UniqueName: \"kubernetes.io/projected/f9ab2ddd-74df-4e40-a811-1eecfa066a6f-kube-api-access-j5fwt\") pod \"libvirt-edpm-compute-no-nodes-edpm-compute-no-nodes-vmmf2\" (UID: \"f9ab2ddd-74df-4e40-a811-1eecfa066a6f\") " pod="openstack-kuttl-tests/libvirt-edpm-compute-no-nodes-edpm-compute-no-nodes-vmmf2" Mar 16 17:24:51 crc kubenswrapper[5120]: I0316 17:24:51.498864 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/f9ab2ddd-74df-4e40-a811-1eecfa066a6f-ssh-key-edpm-compute-no-nodes\") pod \"libvirt-edpm-compute-no-nodes-edpm-compute-no-nodes-vmmf2\" (UID: \"f9ab2ddd-74df-4e40-a811-1eecfa066a6f\") " pod="openstack-kuttl-tests/libvirt-edpm-compute-no-nodes-edpm-compute-no-nodes-vmmf2" Mar 16 17:24:51 crc kubenswrapper[5120]: I0316 17:24:51.498899 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"libvirt-secret-0\" (UniqueName: \"kubernetes.io/secret/f9ab2ddd-74df-4e40-a811-1eecfa066a6f-libvirt-secret-0\") pod \"libvirt-edpm-compute-no-nodes-edpm-compute-no-nodes-vmmf2\" (UID: \"f9ab2ddd-74df-4e40-a811-1eecfa066a6f\") " pod="openstack-kuttl-tests/libvirt-edpm-compute-no-nodes-edpm-compute-no-nodes-vmmf2" Mar 16 17:24:51 crc kubenswrapper[5120]: I0316 17:24:51.600855 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"libvirt-secret-0\" (UniqueName: \"kubernetes.io/secret/f9ab2ddd-74df-4e40-a811-1eecfa066a6f-libvirt-secret-0\") pod \"libvirt-edpm-compute-no-nodes-edpm-compute-no-nodes-vmmf2\" (UID: \"f9ab2ddd-74df-4e40-a811-1eecfa066a6f\") " pod="openstack-kuttl-tests/libvirt-edpm-compute-no-nodes-edpm-compute-no-nodes-vmmf2" Mar 16 17:24:51 crc kubenswrapper[5120]: I0316 17:24:51.601350 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"libvirt-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f9ab2ddd-74df-4e40-a811-1eecfa066a6f-libvirt-combined-ca-bundle\") pod \"libvirt-edpm-compute-no-nodes-edpm-compute-no-nodes-vmmf2\" (UID: \"f9ab2ddd-74df-4e40-a811-1eecfa066a6f\") " pod="openstack-kuttl-tests/libvirt-edpm-compute-no-nodes-edpm-compute-no-nodes-vmmf2" Mar 16 17:24:51 crc kubenswrapper[5120]: I0316 17:24:51.601644 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/f9ab2ddd-74df-4e40-a811-1eecfa066a6f-inventory\") pod \"libvirt-edpm-compute-no-nodes-edpm-compute-no-nodes-vmmf2\" (UID: \"f9ab2ddd-74df-4e40-a811-1eecfa066a6f\") " pod="openstack-kuttl-tests/libvirt-edpm-compute-no-nodes-edpm-compute-no-nodes-vmmf2" Mar 16 17:24:51 crc kubenswrapper[5120]: I0316 17:24:51.602201 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j5fwt\" (UniqueName: \"kubernetes.io/projected/f9ab2ddd-74df-4e40-a811-1eecfa066a6f-kube-api-access-j5fwt\") pod \"libvirt-edpm-compute-no-nodes-edpm-compute-no-nodes-vmmf2\" (UID: \"f9ab2ddd-74df-4e40-a811-1eecfa066a6f\") " pod="openstack-kuttl-tests/libvirt-edpm-compute-no-nodes-edpm-compute-no-nodes-vmmf2" Mar 16 17:24:51 crc kubenswrapper[5120]: I0316 17:24:51.602599 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/f9ab2ddd-74df-4e40-a811-1eecfa066a6f-ssh-key-edpm-compute-no-nodes\") pod \"libvirt-edpm-compute-no-nodes-edpm-compute-no-nodes-vmmf2\" (UID: \"f9ab2ddd-74df-4e40-a811-1eecfa066a6f\") " pod="openstack-kuttl-tests/libvirt-edpm-compute-no-nodes-edpm-compute-no-nodes-vmmf2" Mar 16 17:24:51 crc kubenswrapper[5120]: I0316 17:24:51.606650 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/f9ab2ddd-74df-4e40-a811-1eecfa066a6f-inventory\") pod \"libvirt-edpm-compute-no-nodes-edpm-compute-no-nodes-vmmf2\" (UID: \"f9ab2ddd-74df-4e40-a811-1eecfa066a6f\") " pod="openstack-kuttl-tests/libvirt-edpm-compute-no-nodes-edpm-compute-no-nodes-vmmf2" Mar 16 17:24:51 crc kubenswrapper[5120]: I0316 17:24:51.607537 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"libvirt-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f9ab2ddd-74df-4e40-a811-1eecfa066a6f-libvirt-combined-ca-bundle\") pod \"libvirt-edpm-compute-no-nodes-edpm-compute-no-nodes-vmmf2\" (UID: \"f9ab2ddd-74df-4e40-a811-1eecfa066a6f\") " pod="openstack-kuttl-tests/libvirt-edpm-compute-no-nodes-edpm-compute-no-nodes-vmmf2" Mar 16 17:24:51 crc kubenswrapper[5120]: I0316 17:24:51.611544 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"libvirt-secret-0\" (UniqueName: \"kubernetes.io/secret/f9ab2ddd-74df-4e40-a811-1eecfa066a6f-libvirt-secret-0\") pod \"libvirt-edpm-compute-no-nodes-edpm-compute-no-nodes-vmmf2\" (UID: \"f9ab2ddd-74df-4e40-a811-1eecfa066a6f\") " pod="openstack-kuttl-tests/libvirt-edpm-compute-no-nodes-edpm-compute-no-nodes-vmmf2" Mar 16 17:24:51 crc kubenswrapper[5120]: I0316 17:24:51.614340 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/f9ab2ddd-74df-4e40-a811-1eecfa066a6f-ssh-key-edpm-compute-no-nodes\") pod \"libvirt-edpm-compute-no-nodes-edpm-compute-no-nodes-vmmf2\" (UID: \"f9ab2ddd-74df-4e40-a811-1eecfa066a6f\") " pod="openstack-kuttl-tests/libvirt-edpm-compute-no-nodes-edpm-compute-no-nodes-vmmf2" Mar 16 17:24:51 crc kubenswrapper[5120]: I0316 17:24:51.620300 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5fwt\" (UniqueName: \"kubernetes.io/projected/f9ab2ddd-74df-4e40-a811-1eecfa066a6f-kube-api-access-j5fwt\") pod \"libvirt-edpm-compute-no-nodes-edpm-compute-no-nodes-vmmf2\" (UID: \"f9ab2ddd-74df-4e40-a811-1eecfa066a6f\") " pod="openstack-kuttl-tests/libvirt-edpm-compute-no-nodes-edpm-compute-no-nodes-vmmf2" Mar 16 17:24:51 crc kubenswrapper[5120]: I0316 17:24:51.703090 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/libvirt-edpm-compute-no-nodes-edpm-compute-no-nodes-vmmf2" Mar 16 17:24:52 crc kubenswrapper[5120]: I0316 17:24:52.008139 5120 patch_prober.go:28] interesting pod/machine-config-daemon-7bf76 container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 17:24:52 crc kubenswrapper[5120]: I0316 17:24:52.008466 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 17:24:52 crc kubenswrapper[5120]: I0316 17:24:52.112941 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/libvirt-edpm-compute-no-nodes-edpm-compute-no-nodes-vmmf2"] Mar 16 17:24:52 crc kubenswrapper[5120]: W0316 17:24:52.120488 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf9ab2ddd_74df_4e40_a811_1eecfa066a6f.slice/crio-a70969f69475e6cb9b7f81e0020140583b887676577faf06f8acc7ee09cee064 WatchSource:0}: Error finding container a70969f69475e6cb9b7f81e0020140583b887676577faf06f8acc7ee09cee064: Status 404 returned error can't find the container with id a70969f69475e6cb9b7f81e0020140583b887676577faf06f8acc7ee09cee064 Mar 16 17:24:52 crc kubenswrapper[5120]: I0316 17:24:52.336215 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/libvirt-edpm-compute-no-nodes-edpm-compute-no-nodes-vmmf2" event={"ID":"f9ab2ddd-74df-4e40-a811-1eecfa066a6f","Type":"ContainerStarted","Data":"a70969f69475e6cb9b7f81e0020140583b887676577faf06f8acc7ee09cee064"} Mar 16 17:24:53 crc kubenswrapper[5120]: I0316 17:24:53.346968 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/libvirt-edpm-compute-no-nodes-edpm-compute-no-nodes-vmmf2" event={"ID":"f9ab2ddd-74df-4e40-a811-1eecfa066a6f","Type":"ContainerStarted","Data":"baab5981bae1d55395fe57cbdefcda23a160b798f1acf5543946ee5e76f035eb"} Mar 16 17:24:53 crc kubenswrapper[5120]: I0316 17:24:53.369321 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/libvirt-edpm-compute-no-nodes-edpm-compute-no-nodes-vmmf2" podStartSLOduration=1.969939721 podStartE2EDuration="2.369299623s" podCreationTimestamp="2026-03-16 17:24:51 +0000 UTC" firstStartedPulling="2026-03-16 17:24:52.122443023 +0000 UTC m=+6794.276374680" lastFinishedPulling="2026-03-16 17:24:52.521802925 +0000 UTC m=+6794.675734582" observedRunningTime="2026-03-16 17:24:53.367935536 +0000 UTC m=+6795.521867213" watchObservedRunningTime="2026-03-16 17:24:53.369299623 +0000 UTC m=+6795.523231280" Mar 16 17:24:54 crc kubenswrapper[5120]: I0316 17:24:54.358780 5120 generic.go:358] "Generic (PLEG): container finished" podID="f9ab2ddd-74df-4e40-a811-1eecfa066a6f" containerID="baab5981bae1d55395fe57cbdefcda23a160b798f1acf5543946ee5e76f035eb" exitCode=0 Mar 16 17:24:54 crc kubenswrapper[5120]: I0316 17:24:54.358899 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/libvirt-edpm-compute-no-nodes-edpm-compute-no-nodes-vmmf2" event={"ID":"f9ab2ddd-74df-4e40-a811-1eecfa066a6f","Type":"ContainerDied","Data":"baab5981bae1d55395fe57cbdefcda23a160b798f1acf5543946ee5e76f035eb"} Mar 16 17:24:55 crc kubenswrapper[5120]: I0316 17:24:55.657159 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/libvirt-edpm-compute-no-nodes-edpm-compute-no-nodes-vmmf2" Mar 16 17:24:55 crc kubenswrapper[5120]: I0316 17:24:55.800546 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/f9ab2ddd-74df-4e40-a811-1eecfa066a6f-ssh-key-edpm-compute-no-nodes\") pod \"f9ab2ddd-74df-4e40-a811-1eecfa066a6f\" (UID: \"f9ab2ddd-74df-4e40-a811-1eecfa066a6f\") " Mar 16 17:24:55 crc kubenswrapper[5120]: I0316 17:24:55.800629 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/f9ab2ddd-74df-4e40-a811-1eecfa066a6f-inventory\") pod \"f9ab2ddd-74df-4e40-a811-1eecfa066a6f\" (UID: \"f9ab2ddd-74df-4e40-a811-1eecfa066a6f\") " Mar 16 17:24:55 crc kubenswrapper[5120]: I0316 17:24:55.801031 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"libvirt-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f9ab2ddd-74df-4e40-a811-1eecfa066a6f-libvirt-combined-ca-bundle\") pod \"f9ab2ddd-74df-4e40-a811-1eecfa066a6f\" (UID: \"f9ab2ddd-74df-4e40-a811-1eecfa066a6f\") " Mar 16 17:24:55 crc kubenswrapper[5120]: I0316 17:24:55.801059 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"libvirt-secret-0\" (UniqueName: \"kubernetes.io/secret/f9ab2ddd-74df-4e40-a811-1eecfa066a6f-libvirt-secret-0\") pod \"f9ab2ddd-74df-4e40-a811-1eecfa066a6f\" (UID: \"f9ab2ddd-74df-4e40-a811-1eecfa066a6f\") " Mar 16 17:24:55 crc kubenswrapper[5120]: I0316 17:24:55.801170 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j5fwt\" (UniqueName: \"kubernetes.io/projected/f9ab2ddd-74df-4e40-a811-1eecfa066a6f-kube-api-access-j5fwt\") pod \"f9ab2ddd-74df-4e40-a811-1eecfa066a6f\" (UID: \"f9ab2ddd-74df-4e40-a811-1eecfa066a6f\") " Mar 16 17:24:55 crc kubenswrapper[5120]: I0316 17:24:55.808925 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f9ab2ddd-74df-4e40-a811-1eecfa066a6f-libvirt-combined-ca-bundle" (OuterVolumeSpecName: "libvirt-combined-ca-bundle") pod "f9ab2ddd-74df-4e40-a811-1eecfa066a6f" (UID: "f9ab2ddd-74df-4e40-a811-1eecfa066a6f"). InnerVolumeSpecName "libvirt-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:24:55 crc kubenswrapper[5120]: I0316 17:24:55.815018 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f9ab2ddd-74df-4e40-a811-1eecfa066a6f-kube-api-access-j5fwt" (OuterVolumeSpecName: "kube-api-access-j5fwt") pod "f9ab2ddd-74df-4e40-a811-1eecfa066a6f" (UID: "f9ab2ddd-74df-4e40-a811-1eecfa066a6f"). InnerVolumeSpecName "kube-api-access-j5fwt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:24:55 crc kubenswrapper[5120]: I0316 17:24:55.823167 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f9ab2ddd-74df-4e40-a811-1eecfa066a6f-inventory" (OuterVolumeSpecName: "inventory") pod "f9ab2ddd-74df-4e40-a811-1eecfa066a6f" (UID: "f9ab2ddd-74df-4e40-a811-1eecfa066a6f"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:24:55 crc kubenswrapper[5120]: I0316 17:24:55.823337 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f9ab2ddd-74df-4e40-a811-1eecfa066a6f-ssh-key-edpm-compute-no-nodes" (OuterVolumeSpecName: "ssh-key-edpm-compute-no-nodes") pod "f9ab2ddd-74df-4e40-a811-1eecfa066a6f" (UID: "f9ab2ddd-74df-4e40-a811-1eecfa066a6f"). InnerVolumeSpecName "ssh-key-edpm-compute-no-nodes". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:24:55 crc kubenswrapper[5120]: I0316 17:24:55.824471 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f9ab2ddd-74df-4e40-a811-1eecfa066a6f-libvirt-secret-0" (OuterVolumeSpecName: "libvirt-secret-0") pod "f9ab2ddd-74df-4e40-a811-1eecfa066a6f" (UID: "f9ab2ddd-74df-4e40-a811-1eecfa066a6f"). InnerVolumeSpecName "libvirt-secret-0". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:24:55 crc kubenswrapper[5120]: I0316 17:24:55.903581 5120 reconciler_common.go:299] "Volume detached for volume \"libvirt-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f9ab2ddd-74df-4e40-a811-1eecfa066a6f-libvirt-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:24:55 crc kubenswrapper[5120]: I0316 17:24:55.903618 5120 reconciler_common.go:299] "Volume detached for volume \"libvirt-secret-0\" (UniqueName: \"kubernetes.io/secret/f9ab2ddd-74df-4e40-a811-1eecfa066a6f-libvirt-secret-0\") on node \"crc\" DevicePath \"\"" Mar 16 17:24:55 crc kubenswrapper[5120]: I0316 17:24:55.903628 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j5fwt\" (UniqueName: \"kubernetes.io/projected/f9ab2ddd-74df-4e40-a811-1eecfa066a6f-kube-api-access-j5fwt\") on node \"crc\" DevicePath \"\"" Mar 16 17:24:55 crc kubenswrapper[5120]: I0316 17:24:55.903642 5120 reconciler_common.go:299] "Volume detached for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/f9ab2ddd-74df-4e40-a811-1eecfa066a6f-ssh-key-edpm-compute-no-nodes\") on node \"crc\" DevicePath \"\"" Mar 16 17:24:55 crc kubenswrapper[5120]: I0316 17:24:55.903654 5120 reconciler_common.go:299] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/f9ab2ddd-74df-4e40-a811-1eecfa066a6f-inventory\") on node \"crc\" DevicePath \"\"" Mar 16 17:24:56 crc kubenswrapper[5120]: I0316 17:24:56.384562 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/libvirt-edpm-compute-no-nodes-edpm-compute-no-nodes-vmmf2" Mar 16 17:24:56 crc kubenswrapper[5120]: I0316 17:24:56.385060 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/libvirt-edpm-compute-no-nodes-edpm-compute-no-nodes-vmmf2" event={"ID":"f9ab2ddd-74df-4e40-a811-1eecfa066a6f","Type":"ContainerDied","Data":"a70969f69475e6cb9b7f81e0020140583b887676577faf06f8acc7ee09cee064"} Mar 16 17:24:56 crc kubenswrapper[5120]: I0316 17:24:56.385145 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a70969f69475e6cb9b7f81e0020140583b887676577faf06f8acc7ee09cee064" Mar 16 17:24:56 crc kubenswrapper[5120]: I0316 17:24:56.474500 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-edpm-compute-no-nodes-edpm-compute-no-nodes-c5xmq"] Mar 16 17:24:56 crc kubenswrapper[5120]: I0316 17:24:56.475799 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9ab2ddd-74df-4e40-a811-1eecfa066a6f" containerName="libvirt-edpm-compute-no-nodes-edpm-compute-no-nodes" Mar 16 17:24:56 crc kubenswrapper[5120]: I0316 17:24:56.475822 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9ab2ddd-74df-4e40-a811-1eecfa066a6f" containerName="libvirt-edpm-compute-no-nodes-edpm-compute-no-nodes" Mar 16 17:24:56 crc kubenswrapper[5120]: I0316 17:24:56.476070 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f9ab2ddd-74df-4e40-a811-1eecfa066a6f" containerName="libvirt-edpm-compute-no-nodes-edpm-compute-no-nodes" Mar 16 17:24:56 crc kubenswrapper[5120]: I0316 17:24:56.483122 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-edpm-compute-no-nodes-edpm-compute-no-nodes-c5xmq" Mar 16 17:24:56 crc kubenswrapper[5120]: I0316 17:24:56.495145 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-aee-default-env\"" Mar 16 17:24:56 crc kubenswrapper[5120]: I0316 17:24:56.495239 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-migration-ssh-key\"" Mar 16 17:24:56 crc kubenswrapper[5120]: I0316 17:24:56.495543 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"combined-ca-bundle\"" Mar 16 17:24:56 crc kubenswrapper[5120]: I0316 17:24:56.495646 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplanenodeset-edpm-compute-no-nodes\"" Mar 16 17:24:56 crc kubenswrapper[5120]: I0316 17:24:56.495157 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"edpm-compute-no-nodes-dockercfg-znndh\"" Mar 16 17:24:56 crc kubenswrapper[5120]: I0316 17:24:56.495999 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-compute-config\"" Mar 16 17:24:56 crc kubenswrapper[5120]: I0316 17:24:56.496211 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplane-ansible-ssh-private-key-secret\"" Mar 16 17:24:56 crc kubenswrapper[5120]: I0316 17:24:56.503366 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-edpm-compute-no-nodes-edpm-compute-no-nodes-c5xmq"] Mar 16 17:24:56 crc kubenswrapper[5120]: I0316 17:24:56.622287 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-migration-ssh-key-0\" (UniqueName: \"kubernetes.io/secret/ff74d56b-c496-41b7-8dbf-8a1ef33c2115-nova-migration-ssh-key-0\") pod \"nova-edpm-compute-no-nodes-edpm-compute-no-nodes-c5xmq\" (UID: \"ff74d56b-c496-41b7-8dbf-8a1ef33c2115\") " pod="openstack-kuttl-tests/nova-edpm-compute-no-nodes-edpm-compute-no-nodes-c5xmq" Mar 16 17:24:56 crc kubenswrapper[5120]: I0316 17:24:56.622475 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/ff74d56b-c496-41b7-8dbf-8a1ef33c2115-inventory\") pod \"nova-edpm-compute-no-nodes-edpm-compute-no-nodes-c5xmq\" (UID: \"ff74d56b-c496-41b7-8dbf-8a1ef33c2115\") " pod="openstack-kuttl-tests/nova-edpm-compute-no-nodes-edpm-compute-no-nodes-c5xmq" Mar 16 17:24:56 crc kubenswrapper[5120]: I0316 17:24:56.622681 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ff74d56b-c496-41b7-8dbf-8a1ef33c2115-nova-combined-ca-bundle\") pod \"nova-edpm-compute-no-nodes-edpm-compute-no-nodes-c5xmq\" (UID: \"ff74d56b-c496-41b7-8dbf-8a1ef33c2115\") " pod="openstack-kuttl-tests/nova-edpm-compute-no-nodes-edpm-compute-no-nodes-c5xmq" Mar 16 17:24:56 crc kubenswrapper[5120]: I0316 17:24:56.622739 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-cell1-compute-config-1\" (UniqueName: \"kubernetes.io/secret/ff74d56b-c496-41b7-8dbf-8a1ef33c2115-nova-cell1-compute-config-1\") pod \"nova-edpm-compute-no-nodes-edpm-compute-no-nodes-c5xmq\" (UID: \"ff74d56b-c496-41b7-8dbf-8a1ef33c2115\") " pod="openstack-kuttl-tests/nova-edpm-compute-no-nodes-edpm-compute-no-nodes-c5xmq" Mar 16 17:24:56 crc kubenswrapper[5120]: I0316 17:24:56.622936 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-migration-ssh-key-1\" (UniqueName: \"kubernetes.io/secret/ff74d56b-c496-41b7-8dbf-8a1ef33c2115-nova-migration-ssh-key-1\") pod \"nova-edpm-compute-no-nodes-edpm-compute-no-nodes-c5xmq\" (UID: \"ff74d56b-c496-41b7-8dbf-8a1ef33c2115\") " pod="openstack-kuttl-tests/nova-edpm-compute-no-nodes-edpm-compute-no-nodes-c5xmq" Mar 16 17:24:56 crc kubenswrapper[5120]: I0316 17:24:56.623002 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/ff74d56b-c496-41b7-8dbf-8a1ef33c2115-ssh-key-edpm-compute-no-nodes\") pod \"nova-edpm-compute-no-nodes-edpm-compute-no-nodes-c5xmq\" (UID: \"ff74d56b-c496-41b7-8dbf-8a1ef33c2115\") " pod="openstack-kuttl-tests/nova-edpm-compute-no-nodes-edpm-compute-no-nodes-c5xmq" Mar 16 17:24:56 crc kubenswrapper[5120]: I0316 17:24:56.623029 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-cell1-compute-config-0\" (UniqueName: \"kubernetes.io/secret/ff74d56b-c496-41b7-8dbf-8a1ef33c2115-nova-cell1-compute-config-0\") pod \"nova-edpm-compute-no-nodes-edpm-compute-no-nodes-c5xmq\" (UID: \"ff74d56b-c496-41b7-8dbf-8a1ef33c2115\") " pod="openstack-kuttl-tests/nova-edpm-compute-no-nodes-edpm-compute-no-nodes-c5xmq" Mar 16 17:24:56 crc kubenswrapper[5120]: I0316 17:24:56.623153 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwf8k\" (UniqueName: \"kubernetes.io/projected/ff74d56b-c496-41b7-8dbf-8a1ef33c2115-kube-api-access-gwf8k\") pod \"nova-edpm-compute-no-nodes-edpm-compute-no-nodes-c5xmq\" (UID: \"ff74d56b-c496-41b7-8dbf-8a1ef33c2115\") " pod="openstack-kuttl-tests/nova-edpm-compute-no-nodes-edpm-compute-no-nodes-c5xmq" Mar 16 17:24:56 crc kubenswrapper[5120]: I0316 17:24:56.726022 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gwf8k\" (UniqueName: \"kubernetes.io/projected/ff74d56b-c496-41b7-8dbf-8a1ef33c2115-kube-api-access-gwf8k\") pod \"nova-edpm-compute-no-nodes-edpm-compute-no-nodes-c5xmq\" (UID: \"ff74d56b-c496-41b7-8dbf-8a1ef33c2115\") " pod="openstack-kuttl-tests/nova-edpm-compute-no-nodes-edpm-compute-no-nodes-c5xmq" Mar 16 17:24:56 crc kubenswrapper[5120]: I0316 17:24:56.726528 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-migration-ssh-key-0\" (UniqueName: \"kubernetes.io/secret/ff74d56b-c496-41b7-8dbf-8a1ef33c2115-nova-migration-ssh-key-0\") pod \"nova-edpm-compute-no-nodes-edpm-compute-no-nodes-c5xmq\" (UID: \"ff74d56b-c496-41b7-8dbf-8a1ef33c2115\") " pod="openstack-kuttl-tests/nova-edpm-compute-no-nodes-edpm-compute-no-nodes-c5xmq" Mar 16 17:24:56 crc kubenswrapper[5120]: I0316 17:24:56.726621 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/ff74d56b-c496-41b7-8dbf-8a1ef33c2115-inventory\") pod \"nova-edpm-compute-no-nodes-edpm-compute-no-nodes-c5xmq\" (UID: \"ff74d56b-c496-41b7-8dbf-8a1ef33c2115\") " pod="openstack-kuttl-tests/nova-edpm-compute-no-nodes-edpm-compute-no-nodes-c5xmq" Mar 16 17:24:56 crc kubenswrapper[5120]: I0316 17:24:56.726728 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ff74d56b-c496-41b7-8dbf-8a1ef33c2115-nova-combined-ca-bundle\") pod \"nova-edpm-compute-no-nodes-edpm-compute-no-nodes-c5xmq\" (UID: \"ff74d56b-c496-41b7-8dbf-8a1ef33c2115\") " pod="openstack-kuttl-tests/nova-edpm-compute-no-nodes-edpm-compute-no-nodes-c5xmq" Mar 16 17:24:56 crc kubenswrapper[5120]: I0316 17:24:56.726836 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-cell1-compute-config-1\" (UniqueName: \"kubernetes.io/secret/ff74d56b-c496-41b7-8dbf-8a1ef33c2115-nova-cell1-compute-config-1\") pod \"nova-edpm-compute-no-nodes-edpm-compute-no-nodes-c5xmq\" (UID: \"ff74d56b-c496-41b7-8dbf-8a1ef33c2115\") " pod="openstack-kuttl-tests/nova-edpm-compute-no-nodes-edpm-compute-no-nodes-c5xmq" Mar 16 17:24:56 crc kubenswrapper[5120]: I0316 17:24:56.727018 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-migration-ssh-key-1\" (UniqueName: \"kubernetes.io/secret/ff74d56b-c496-41b7-8dbf-8a1ef33c2115-nova-migration-ssh-key-1\") pod \"nova-edpm-compute-no-nodes-edpm-compute-no-nodes-c5xmq\" (UID: \"ff74d56b-c496-41b7-8dbf-8a1ef33c2115\") " pod="openstack-kuttl-tests/nova-edpm-compute-no-nodes-edpm-compute-no-nodes-c5xmq" Mar 16 17:24:56 crc kubenswrapper[5120]: I0316 17:24:56.727082 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/ff74d56b-c496-41b7-8dbf-8a1ef33c2115-ssh-key-edpm-compute-no-nodes\") pod \"nova-edpm-compute-no-nodes-edpm-compute-no-nodes-c5xmq\" (UID: \"ff74d56b-c496-41b7-8dbf-8a1ef33c2115\") " pod="openstack-kuttl-tests/nova-edpm-compute-no-nodes-edpm-compute-no-nodes-c5xmq" Mar 16 17:24:56 crc kubenswrapper[5120]: I0316 17:24:56.727132 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-cell1-compute-config-0\" (UniqueName: \"kubernetes.io/secret/ff74d56b-c496-41b7-8dbf-8a1ef33c2115-nova-cell1-compute-config-0\") pod \"nova-edpm-compute-no-nodes-edpm-compute-no-nodes-c5xmq\" (UID: \"ff74d56b-c496-41b7-8dbf-8a1ef33c2115\") " pod="openstack-kuttl-tests/nova-edpm-compute-no-nodes-edpm-compute-no-nodes-c5xmq" Mar 16 17:24:56 crc kubenswrapper[5120]: I0316 17:24:56.731751 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-migration-ssh-key-1\" (UniqueName: \"kubernetes.io/secret/ff74d56b-c496-41b7-8dbf-8a1ef33c2115-nova-migration-ssh-key-1\") pod \"nova-edpm-compute-no-nodes-edpm-compute-no-nodes-c5xmq\" (UID: \"ff74d56b-c496-41b7-8dbf-8a1ef33c2115\") " pod="openstack-kuttl-tests/nova-edpm-compute-no-nodes-edpm-compute-no-nodes-c5xmq" Mar 16 17:24:56 crc kubenswrapper[5120]: I0316 17:24:56.732251 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ff74d56b-c496-41b7-8dbf-8a1ef33c2115-nova-combined-ca-bundle\") pod \"nova-edpm-compute-no-nodes-edpm-compute-no-nodes-c5xmq\" (UID: \"ff74d56b-c496-41b7-8dbf-8a1ef33c2115\") " pod="openstack-kuttl-tests/nova-edpm-compute-no-nodes-edpm-compute-no-nodes-c5xmq" Mar 16 17:24:56 crc kubenswrapper[5120]: I0316 17:24:56.732513 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/ff74d56b-c496-41b7-8dbf-8a1ef33c2115-ssh-key-edpm-compute-no-nodes\") pod \"nova-edpm-compute-no-nodes-edpm-compute-no-nodes-c5xmq\" (UID: \"ff74d56b-c496-41b7-8dbf-8a1ef33c2115\") " pod="openstack-kuttl-tests/nova-edpm-compute-no-nodes-edpm-compute-no-nodes-c5xmq" Mar 16 17:24:56 crc kubenswrapper[5120]: I0316 17:24:56.732899 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/ff74d56b-c496-41b7-8dbf-8a1ef33c2115-inventory\") pod \"nova-edpm-compute-no-nodes-edpm-compute-no-nodes-c5xmq\" (UID: \"ff74d56b-c496-41b7-8dbf-8a1ef33c2115\") " pod="openstack-kuttl-tests/nova-edpm-compute-no-nodes-edpm-compute-no-nodes-c5xmq" Mar 16 17:24:56 crc kubenswrapper[5120]: I0316 17:24:56.733268 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-migration-ssh-key-0\" (UniqueName: \"kubernetes.io/secret/ff74d56b-c496-41b7-8dbf-8a1ef33c2115-nova-migration-ssh-key-0\") pod \"nova-edpm-compute-no-nodes-edpm-compute-no-nodes-c5xmq\" (UID: \"ff74d56b-c496-41b7-8dbf-8a1ef33c2115\") " pod="openstack-kuttl-tests/nova-edpm-compute-no-nodes-edpm-compute-no-nodes-c5xmq" Mar 16 17:24:56 crc kubenswrapper[5120]: I0316 17:24:56.735222 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-cell1-compute-config-1\" (UniqueName: \"kubernetes.io/secret/ff74d56b-c496-41b7-8dbf-8a1ef33c2115-nova-cell1-compute-config-1\") pod \"nova-edpm-compute-no-nodes-edpm-compute-no-nodes-c5xmq\" (UID: \"ff74d56b-c496-41b7-8dbf-8a1ef33c2115\") " pod="openstack-kuttl-tests/nova-edpm-compute-no-nodes-edpm-compute-no-nodes-c5xmq" Mar 16 17:24:56 crc kubenswrapper[5120]: I0316 17:24:56.739729 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-cell1-compute-config-0\" (UniqueName: \"kubernetes.io/secret/ff74d56b-c496-41b7-8dbf-8a1ef33c2115-nova-cell1-compute-config-0\") pod \"nova-edpm-compute-no-nodes-edpm-compute-no-nodes-c5xmq\" (UID: \"ff74d56b-c496-41b7-8dbf-8a1ef33c2115\") " pod="openstack-kuttl-tests/nova-edpm-compute-no-nodes-edpm-compute-no-nodes-c5xmq" Mar 16 17:24:56 crc kubenswrapper[5120]: I0316 17:24:56.757858 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwf8k\" (UniqueName: \"kubernetes.io/projected/ff74d56b-c496-41b7-8dbf-8a1ef33c2115-kube-api-access-gwf8k\") pod \"nova-edpm-compute-no-nodes-edpm-compute-no-nodes-c5xmq\" (UID: \"ff74d56b-c496-41b7-8dbf-8a1ef33c2115\") " pod="openstack-kuttl-tests/nova-edpm-compute-no-nodes-edpm-compute-no-nodes-c5xmq" Mar 16 17:24:56 crc kubenswrapper[5120]: I0316 17:24:56.810945 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-edpm-compute-no-nodes-edpm-compute-no-nodes-c5xmq" Mar 16 17:24:57 crc kubenswrapper[5120]: I0316 17:24:57.059160 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-edpm-compute-no-nodes-edpm-compute-no-nodes-c5xmq"] Mar 16 17:24:57 crc kubenswrapper[5120]: I0316 17:24:57.397065 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-edpm-compute-no-nodes-edpm-compute-no-nodes-c5xmq" event={"ID":"ff74d56b-c496-41b7-8dbf-8a1ef33c2115","Type":"ContainerStarted","Data":"2be115b04cda193f78137b9c0d2b57c70bc5c05fe186893eaaa4389d43d03a0b"} Mar 16 17:24:58 crc kubenswrapper[5120]: I0316 17:24:58.407168 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-edpm-compute-no-nodes-edpm-compute-no-nodes-c5xmq" event={"ID":"ff74d56b-c496-41b7-8dbf-8a1ef33c2115","Type":"ContainerStarted","Data":"873068b6bbc29240846337736a47389c76af632240fb1df5b2925dd5e4819d93"} Mar 16 17:24:58 crc kubenswrapper[5120]: I0316 17:24:58.430428 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-edpm-compute-no-nodes-edpm-compute-no-nodes-c5xmq" podStartSLOduration=2.04215509 podStartE2EDuration="2.430408649s" podCreationTimestamp="2026-03-16 17:24:56 +0000 UTC" firstStartedPulling="2026-03-16 17:24:57.070937241 +0000 UTC m=+6799.224868898" lastFinishedPulling="2026-03-16 17:24:57.4591908 +0000 UTC m=+6799.613122457" observedRunningTime="2026-03-16 17:24:58.424614491 +0000 UTC m=+6800.578546158" watchObservedRunningTime="2026-03-16 17:24:58.430408649 +0000 UTC m=+6800.584340306" Mar 16 17:24:59 crc kubenswrapper[5120]: I0316 17:24:59.417528 5120 generic.go:358] "Generic (PLEG): container finished" podID="ff74d56b-c496-41b7-8dbf-8a1ef33c2115" containerID="873068b6bbc29240846337736a47389c76af632240fb1df5b2925dd5e4819d93" exitCode=0 Mar 16 17:24:59 crc kubenswrapper[5120]: I0316 17:24:59.417884 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-edpm-compute-no-nodes-edpm-compute-no-nodes-c5xmq" event={"ID":"ff74d56b-c496-41b7-8dbf-8a1ef33c2115","Type":"ContainerDied","Data":"873068b6bbc29240846337736a47389c76af632240fb1df5b2925dd5e4819d93"} Mar 16 17:25:00 crc kubenswrapper[5120]: I0316 17:25:00.727888 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-edpm-compute-no-nodes-edpm-compute-no-nodes-c5xmq" Mar 16 17:25:00 crc kubenswrapper[5120]: I0316 17:25:00.821882 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-migration-ssh-key-0\" (UniqueName: \"kubernetes.io/secret/ff74d56b-c496-41b7-8dbf-8a1ef33c2115-nova-migration-ssh-key-0\") pod \"ff74d56b-c496-41b7-8dbf-8a1ef33c2115\" (UID: \"ff74d56b-c496-41b7-8dbf-8a1ef33c2115\") " Mar 16 17:25:00 crc kubenswrapper[5120]: I0316 17:25:00.821918 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-cell1-compute-config-1\" (UniqueName: \"kubernetes.io/secret/ff74d56b-c496-41b7-8dbf-8a1ef33c2115-nova-cell1-compute-config-1\") pod \"ff74d56b-c496-41b7-8dbf-8a1ef33c2115\" (UID: \"ff74d56b-c496-41b7-8dbf-8a1ef33c2115\") " Mar 16 17:25:00 crc kubenswrapper[5120]: I0316 17:25:00.821991 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-cell1-compute-config-0\" (UniqueName: \"kubernetes.io/secret/ff74d56b-c496-41b7-8dbf-8a1ef33c2115-nova-cell1-compute-config-0\") pod \"ff74d56b-c496-41b7-8dbf-8a1ef33c2115\" (UID: \"ff74d56b-c496-41b7-8dbf-8a1ef33c2115\") " Mar 16 17:25:00 crc kubenswrapper[5120]: I0316 17:25:00.822076 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/ff74d56b-c496-41b7-8dbf-8a1ef33c2115-ssh-key-edpm-compute-no-nodes\") pod \"ff74d56b-c496-41b7-8dbf-8a1ef33c2115\" (UID: \"ff74d56b-c496-41b7-8dbf-8a1ef33c2115\") " Mar 16 17:25:00 crc kubenswrapper[5120]: I0316 17:25:00.822215 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ff74d56b-c496-41b7-8dbf-8a1ef33c2115-nova-combined-ca-bundle\") pod \"ff74d56b-c496-41b7-8dbf-8a1ef33c2115\" (UID: \"ff74d56b-c496-41b7-8dbf-8a1ef33c2115\") " Mar 16 17:25:00 crc kubenswrapper[5120]: I0316 17:25:00.822944 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gwf8k\" (UniqueName: \"kubernetes.io/projected/ff74d56b-c496-41b7-8dbf-8a1ef33c2115-kube-api-access-gwf8k\") pod \"ff74d56b-c496-41b7-8dbf-8a1ef33c2115\" (UID: \"ff74d56b-c496-41b7-8dbf-8a1ef33c2115\") " Mar 16 17:25:00 crc kubenswrapper[5120]: I0316 17:25:00.823134 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-migration-ssh-key-1\" (UniqueName: \"kubernetes.io/secret/ff74d56b-c496-41b7-8dbf-8a1ef33c2115-nova-migration-ssh-key-1\") pod \"ff74d56b-c496-41b7-8dbf-8a1ef33c2115\" (UID: \"ff74d56b-c496-41b7-8dbf-8a1ef33c2115\") " Mar 16 17:25:00 crc kubenswrapper[5120]: I0316 17:25:00.823200 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/ff74d56b-c496-41b7-8dbf-8a1ef33c2115-inventory\") pod \"ff74d56b-c496-41b7-8dbf-8a1ef33c2115\" (UID: \"ff74d56b-c496-41b7-8dbf-8a1ef33c2115\") " Mar 16 17:25:00 crc kubenswrapper[5120]: I0316 17:25:00.828719 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff74d56b-c496-41b7-8dbf-8a1ef33c2115-nova-combined-ca-bundle" (OuterVolumeSpecName: "nova-combined-ca-bundle") pod "ff74d56b-c496-41b7-8dbf-8a1ef33c2115" (UID: "ff74d56b-c496-41b7-8dbf-8a1ef33c2115"). InnerVolumeSpecName "nova-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:25:00 crc kubenswrapper[5120]: I0316 17:25:00.840139 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff74d56b-c496-41b7-8dbf-8a1ef33c2115-kube-api-access-gwf8k" (OuterVolumeSpecName: "kube-api-access-gwf8k") pod "ff74d56b-c496-41b7-8dbf-8a1ef33c2115" (UID: "ff74d56b-c496-41b7-8dbf-8a1ef33c2115"). InnerVolumeSpecName "kube-api-access-gwf8k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:25:00 crc kubenswrapper[5120]: I0316 17:25:00.848970 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff74d56b-c496-41b7-8dbf-8a1ef33c2115-nova-migration-ssh-key-0" (OuterVolumeSpecName: "nova-migration-ssh-key-0") pod "ff74d56b-c496-41b7-8dbf-8a1ef33c2115" (UID: "ff74d56b-c496-41b7-8dbf-8a1ef33c2115"). InnerVolumeSpecName "nova-migration-ssh-key-0". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:25:00 crc kubenswrapper[5120]: I0316 17:25:00.849006 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff74d56b-c496-41b7-8dbf-8a1ef33c2115-ssh-key-edpm-compute-no-nodes" (OuterVolumeSpecName: "ssh-key-edpm-compute-no-nodes") pod "ff74d56b-c496-41b7-8dbf-8a1ef33c2115" (UID: "ff74d56b-c496-41b7-8dbf-8a1ef33c2115"). InnerVolumeSpecName "ssh-key-edpm-compute-no-nodes". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:25:00 crc kubenswrapper[5120]: I0316 17:25:00.849739 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff74d56b-c496-41b7-8dbf-8a1ef33c2115-nova-cell1-compute-config-0" (OuterVolumeSpecName: "nova-cell1-compute-config-0") pod "ff74d56b-c496-41b7-8dbf-8a1ef33c2115" (UID: "ff74d56b-c496-41b7-8dbf-8a1ef33c2115"). InnerVolumeSpecName "nova-cell1-compute-config-0". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:25:00 crc kubenswrapper[5120]: I0316 17:25:00.858494 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff74d56b-c496-41b7-8dbf-8a1ef33c2115-inventory" (OuterVolumeSpecName: "inventory") pod "ff74d56b-c496-41b7-8dbf-8a1ef33c2115" (UID: "ff74d56b-c496-41b7-8dbf-8a1ef33c2115"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:25:00 crc kubenswrapper[5120]: I0316 17:25:00.859235 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff74d56b-c496-41b7-8dbf-8a1ef33c2115-nova-cell1-compute-config-1" (OuterVolumeSpecName: "nova-cell1-compute-config-1") pod "ff74d56b-c496-41b7-8dbf-8a1ef33c2115" (UID: "ff74d56b-c496-41b7-8dbf-8a1ef33c2115"). InnerVolumeSpecName "nova-cell1-compute-config-1". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:25:00 crc kubenswrapper[5120]: I0316 17:25:00.864427 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff74d56b-c496-41b7-8dbf-8a1ef33c2115-nova-migration-ssh-key-1" (OuterVolumeSpecName: "nova-migration-ssh-key-1") pod "ff74d56b-c496-41b7-8dbf-8a1ef33c2115" (UID: "ff74d56b-c496-41b7-8dbf-8a1ef33c2115"). InnerVolumeSpecName "nova-migration-ssh-key-1". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:25:00 crc kubenswrapper[5120]: I0316 17:25:00.925822 5120 reconciler_common.go:299] "Volume detached for volume \"nova-cell1-compute-config-0\" (UniqueName: \"kubernetes.io/secret/ff74d56b-c496-41b7-8dbf-8a1ef33c2115-nova-cell1-compute-config-0\") on node \"crc\" DevicePath \"\"" Mar 16 17:25:00 crc kubenswrapper[5120]: I0316 17:25:00.925862 5120 reconciler_common.go:299] "Volume detached for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/ff74d56b-c496-41b7-8dbf-8a1ef33c2115-ssh-key-edpm-compute-no-nodes\") on node \"crc\" DevicePath \"\"" Mar 16 17:25:00 crc kubenswrapper[5120]: I0316 17:25:00.925878 5120 reconciler_common.go:299] "Volume detached for volume \"nova-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ff74d56b-c496-41b7-8dbf-8a1ef33c2115-nova-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:25:00 crc kubenswrapper[5120]: I0316 17:25:00.925891 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gwf8k\" (UniqueName: \"kubernetes.io/projected/ff74d56b-c496-41b7-8dbf-8a1ef33c2115-kube-api-access-gwf8k\") on node \"crc\" DevicePath \"\"" Mar 16 17:25:00 crc kubenswrapper[5120]: I0316 17:25:00.925903 5120 reconciler_common.go:299] "Volume detached for volume \"nova-migration-ssh-key-1\" (UniqueName: \"kubernetes.io/secret/ff74d56b-c496-41b7-8dbf-8a1ef33c2115-nova-migration-ssh-key-1\") on node \"crc\" DevicePath \"\"" Mar 16 17:25:00 crc kubenswrapper[5120]: I0316 17:25:00.925917 5120 reconciler_common.go:299] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/ff74d56b-c496-41b7-8dbf-8a1ef33c2115-inventory\") on node \"crc\" DevicePath \"\"" Mar 16 17:25:00 crc kubenswrapper[5120]: I0316 17:25:00.925928 5120 reconciler_common.go:299] "Volume detached for volume \"nova-migration-ssh-key-0\" (UniqueName: \"kubernetes.io/secret/ff74d56b-c496-41b7-8dbf-8a1ef33c2115-nova-migration-ssh-key-0\") on node \"crc\" DevicePath \"\"" Mar 16 17:25:00 crc kubenswrapper[5120]: I0316 17:25:00.925939 5120 reconciler_common.go:299] "Volume detached for volume \"nova-cell1-compute-config-1\" (UniqueName: \"kubernetes.io/secret/ff74d56b-c496-41b7-8dbf-8a1ef33c2115-nova-cell1-compute-config-1\") on node \"crc\" DevicePath \"\"" Mar 16 17:25:01 crc kubenswrapper[5120]: I0316 17:25:01.439221 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-edpm-compute-no-nodes-edpm-compute-no-nodes-c5xmq" event={"ID":"ff74d56b-c496-41b7-8dbf-8a1ef33c2115","Type":"ContainerDied","Data":"2be115b04cda193f78137b9c0d2b57c70bc5c05fe186893eaaa4389d43d03a0b"} Mar 16 17:25:01 crc kubenswrapper[5120]: I0316 17:25:01.439267 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2be115b04cda193f78137b9c0d2b57c70bc5c05fe186893eaaa4389d43d03a0b" Mar 16 17:25:01 crc kubenswrapper[5120]: I0316 17:25:01.439314 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-edpm-compute-no-nodes-edpm-compute-no-nodes-c5xmq" Mar 16 17:25:02 crc kubenswrapper[5120]: I0316 17:25:02.246333 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/custom-svc-edpm-compute-no-nodes-ovrd-edpm-compute-no-nodecphpx"] Mar 16 17:25:02 crc kubenswrapper[5120]: I0316 17:25:02.248313 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff74d56b-c496-41b7-8dbf-8a1ef33c2115" containerName="nova-edpm-compute-no-nodes-edpm-compute-no-nodes" Mar 16 17:25:02 crc kubenswrapper[5120]: I0316 17:25:02.248336 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff74d56b-c496-41b7-8dbf-8a1ef33c2115" containerName="nova-edpm-compute-no-nodes-edpm-compute-no-nodes" Mar 16 17:25:02 crc kubenswrapper[5120]: I0316 17:25:02.248563 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ff74d56b-c496-41b7-8dbf-8a1ef33c2115" containerName="nova-edpm-compute-no-nodes-edpm-compute-no-nodes" Mar 16 17:25:02 crc kubenswrapper[5120]: I0316 17:25:02.256749 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/custom-svc-edpm-compute-no-nodes-ovrd-edpm-compute-no-nodecphpx" Mar 16 17:25:02 crc kubenswrapper[5120]: I0316 17:25:02.261219 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-aee-default-env\"" Mar 16 17:25:02 crc kubenswrapper[5120]: I0316 17:25:02.262029 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"combined-ca-bundle\"" Mar 16 17:25:02 crc kubenswrapper[5120]: I0316 17:25:02.262264 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"edpm-compute-no-nodes-dockercfg-znndh\"" Mar 16 17:25:02 crc kubenswrapper[5120]: I0316 17:25:02.262485 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplanenodeset-edpm-compute-no-nodes\"" Mar 16 17:25:02 crc kubenswrapper[5120]: I0316 17:25:02.262657 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplane-ansible-ssh-private-key-secret\"" Mar 16 17:25:02 crc kubenswrapper[5120]: I0316 17:25:02.262840 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/custom-svc-edpm-compute-no-nodes-ovrd-edpm-compute-no-nodecphpx"] Mar 16 17:25:02 crc kubenswrapper[5120]: I0316 17:25:02.359377 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"custom-svc-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/09db059a-bb7c-4f11-807d-9d38a9c712c5-custom-svc-combined-ca-bundle\") pod \"custom-svc-edpm-compute-no-nodes-ovrd-edpm-compute-no-nodecphpx\" (UID: \"09db059a-bb7c-4f11-807d-9d38a9c712c5\") " pod="openstack-kuttl-tests/custom-svc-edpm-compute-no-nodes-ovrd-edpm-compute-no-nodecphpx" Mar 16 17:25:02 crc kubenswrapper[5120]: I0316 17:25:02.359458 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxkrt\" (UniqueName: \"kubernetes.io/projected/09db059a-bb7c-4f11-807d-9d38a9c712c5-kube-api-access-dxkrt\") pod \"custom-svc-edpm-compute-no-nodes-ovrd-edpm-compute-no-nodecphpx\" (UID: \"09db059a-bb7c-4f11-807d-9d38a9c712c5\") " pod="openstack-kuttl-tests/custom-svc-edpm-compute-no-nodes-ovrd-edpm-compute-no-nodecphpx" Mar 16 17:25:02 crc kubenswrapper[5120]: I0316 17:25:02.359484 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/09db059a-bb7c-4f11-807d-9d38a9c712c5-inventory\") pod \"custom-svc-edpm-compute-no-nodes-ovrd-edpm-compute-no-nodecphpx\" (UID: \"09db059a-bb7c-4f11-807d-9d38a9c712c5\") " pod="openstack-kuttl-tests/custom-svc-edpm-compute-no-nodes-ovrd-edpm-compute-no-nodecphpx" Mar 16 17:25:02 crc kubenswrapper[5120]: I0316 17:25:02.359615 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/09db059a-bb7c-4f11-807d-9d38a9c712c5-ssh-key-edpm-compute-no-nodes\") pod \"custom-svc-edpm-compute-no-nodes-ovrd-edpm-compute-no-nodecphpx\" (UID: \"09db059a-bb7c-4f11-807d-9d38a9c712c5\") " pod="openstack-kuttl-tests/custom-svc-edpm-compute-no-nodes-ovrd-edpm-compute-no-nodecphpx" Mar 16 17:25:02 crc kubenswrapper[5120]: I0316 17:25:02.461457 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"custom-svc-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/09db059a-bb7c-4f11-807d-9d38a9c712c5-custom-svc-combined-ca-bundle\") pod \"custom-svc-edpm-compute-no-nodes-ovrd-edpm-compute-no-nodecphpx\" (UID: \"09db059a-bb7c-4f11-807d-9d38a9c712c5\") " pod="openstack-kuttl-tests/custom-svc-edpm-compute-no-nodes-ovrd-edpm-compute-no-nodecphpx" Mar 16 17:25:02 crc kubenswrapper[5120]: I0316 17:25:02.461536 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dxkrt\" (UniqueName: \"kubernetes.io/projected/09db059a-bb7c-4f11-807d-9d38a9c712c5-kube-api-access-dxkrt\") pod \"custom-svc-edpm-compute-no-nodes-ovrd-edpm-compute-no-nodecphpx\" (UID: \"09db059a-bb7c-4f11-807d-9d38a9c712c5\") " pod="openstack-kuttl-tests/custom-svc-edpm-compute-no-nodes-ovrd-edpm-compute-no-nodecphpx" Mar 16 17:25:02 crc kubenswrapper[5120]: I0316 17:25:02.461748 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/09db059a-bb7c-4f11-807d-9d38a9c712c5-inventory\") pod \"custom-svc-edpm-compute-no-nodes-ovrd-edpm-compute-no-nodecphpx\" (UID: \"09db059a-bb7c-4f11-807d-9d38a9c712c5\") " pod="openstack-kuttl-tests/custom-svc-edpm-compute-no-nodes-ovrd-edpm-compute-no-nodecphpx" Mar 16 17:25:02 crc kubenswrapper[5120]: I0316 17:25:02.461867 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/09db059a-bb7c-4f11-807d-9d38a9c712c5-ssh-key-edpm-compute-no-nodes\") pod \"custom-svc-edpm-compute-no-nodes-ovrd-edpm-compute-no-nodecphpx\" (UID: \"09db059a-bb7c-4f11-807d-9d38a9c712c5\") " pod="openstack-kuttl-tests/custom-svc-edpm-compute-no-nodes-ovrd-edpm-compute-no-nodecphpx" Mar 16 17:25:02 crc kubenswrapper[5120]: I0316 17:25:02.467750 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/09db059a-bb7c-4f11-807d-9d38a9c712c5-ssh-key-edpm-compute-no-nodes\") pod \"custom-svc-edpm-compute-no-nodes-ovrd-edpm-compute-no-nodecphpx\" (UID: \"09db059a-bb7c-4f11-807d-9d38a9c712c5\") " pod="openstack-kuttl-tests/custom-svc-edpm-compute-no-nodes-ovrd-edpm-compute-no-nodecphpx" Mar 16 17:25:02 crc kubenswrapper[5120]: I0316 17:25:02.468770 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/09db059a-bb7c-4f11-807d-9d38a9c712c5-inventory\") pod \"custom-svc-edpm-compute-no-nodes-ovrd-edpm-compute-no-nodecphpx\" (UID: \"09db059a-bb7c-4f11-807d-9d38a9c712c5\") " pod="openstack-kuttl-tests/custom-svc-edpm-compute-no-nodes-ovrd-edpm-compute-no-nodecphpx" Mar 16 17:25:02 crc kubenswrapper[5120]: I0316 17:25:02.471334 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"custom-svc-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/09db059a-bb7c-4f11-807d-9d38a9c712c5-custom-svc-combined-ca-bundle\") pod \"custom-svc-edpm-compute-no-nodes-ovrd-edpm-compute-no-nodecphpx\" (UID: \"09db059a-bb7c-4f11-807d-9d38a9c712c5\") " pod="openstack-kuttl-tests/custom-svc-edpm-compute-no-nodes-ovrd-edpm-compute-no-nodecphpx" Mar 16 17:25:02 crc kubenswrapper[5120]: I0316 17:25:02.478664 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxkrt\" (UniqueName: \"kubernetes.io/projected/09db059a-bb7c-4f11-807d-9d38a9c712c5-kube-api-access-dxkrt\") pod \"custom-svc-edpm-compute-no-nodes-ovrd-edpm-compute-no-nodecphpx\" (UID: \"09db059a-bb7c-4f11-807d-9d38a9c712c5\") " pod="openstack-kuttl-tests/custom-svc-edpm-compute-no-nodes-ovrd-edpm-compute-no-nodecphpx" Mar 16 17:25:02 crc kubenswrapper[5120]: I0316 17:25:02.571952 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/custom-svc-edpm-compute-no-nodes-ovrd-edpm-compute-no-nodecphpx" Mar 16 17:25:02 crc kubenswrapper[5120]: I0316 17:25:02.978441 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/custom-svc-edpm-compute-no-nodes-ovrd-edpm-compute-no-nodecphpx"] Mar 16 17:25:03 crc kubenswrapper[5120]: I0316 17:25:03.455644 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/custom-svc-edpm-compute-no-nodes-ovrd-edpm-compute-no-nodecphpx" event={"ID":"09db059a-bb7c-4f11-807d-9d38a9c712c5","Type":"ContainerStarted","Data":"93d5a4078884b163cd3270d12b44152138e3241f4686ba482d9f4a43dcec6a3d"} Mar 16 17:25:04 crc kubenswrapper[5120]: I0316 17:25:04.469675 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/custom-svc-edpm-compute-no-nodes-ovrd-edpm-compute-no-nodecphpx" event={"ID":"09db059a-bb7c-4f11-807d-9d38a9c712c5","Type":"ContainerStarted","Data":"297d8efae1036524c61bddf6cab1c086d9c6c55c724340bcef4ff3a1432ea3d5"} Mar 16 17:25:04 crc kubenswrapper[5120]: I0316 17:25:04.492035 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/custom-svc-edpm-compute-no-nodes-ovrd-edpm-compute-no-nodecphpx" podStartSLOduration=1.851062519 podStartE2EDuration="2.492012203s" podCreationTimestamp="2026-03-16 17:25:02 +0000 UTC" firstStartedPulling="2026-03-16 17:25:02.991442179 +0000 UTC m=+6805.145373836" lastFinishedPulling="2026-03-16 17:25:03.632391863 +0000 UTC m=+6805.786323520" observedRunningTime="2026-03-16 17:25:04.491626902 +0000 UTC m=+6806.645558649" watchObservedRunningTime="2026-03-16 17:25:04.492012203 +0000 UTC m=+6806.645943860" Mar 16 17:25:06 crc kubenswrapper[5120]: I0316 17:25:06.487621 5120 generic.go:358] "Generic (PLEG): container finished" podID="09db059a-bb7c-4f11-807d-9d38a9c712c5" containerID="297d8efae1036524c61bddf6cab1c086d9c6c55c724340bcef4ff3a1432ea3d5" exitCode=0 Mar 16 17:25:06 crc kubenswrapper[5120]: I0316 17:25:06.487722 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/custom-svc-edpm-compute-no-nodes-ovrd-edpm-compute-no-nodecphpx" event={"ID":"09db059a-bb7c-4f11-807d-9d38a9c712c5","Type":"ContainerDied","Data":"297d8efae1036524c61bddf6cab1c086d9c6c55c724340bcef4ff3a1432ea3d5"} Mar 16 17:25:07 crc kubenswrapper[5120]: E0316 17:25:07.513711 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1314539 actualBytes=10240 Mar 16 17:25:07 crc kubenswrapper[5120]: I0316 17:25:07.787266 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/custom-svc-edpm-compute-no-nodes-ovrd-edpm-compute-no-nodecphpx" Mar 16 17:25:07 crc kubenswrapper[5120]: I0316 17:25:07.884921 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/09db059a-bb7c-4f11-807d-9d38a9c712c5-ssh-key-edpm-compute-no-nodes\") pod \"09db059a-bb7c-4f11-807d-9d38a9c712c5\" (UID: \"09db059a-bb7c-4f11-807d-9d38a9c712c5\") " Mar 16 17:25:07 crc kubenswrapper[5120]: I0316 17:25:07.885047 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dxkrt\" (UniqueName: \"kubernetes.io/projected/09db059a-bb7c-4f11-807d-9d38a9c712c5-kube-api-access-dxkrt\") pod \"09db059a-bb7c-4f11-807d-9d38a9c712c5\" (UID: \"09db059a-bb7c-4f11-807d-9d38a9c712c5\") " Mar 16 17:25:07 crc kubenswrapper[5120]: I0316 17:25:07.885148 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"custom-svc-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/09db059a-bb7c-4f11-807d-9d38a9c712c5-custom-svc-combined-ca-bundle\") pod \"09db059a-bb7c-4f11-807d-9d38a9c712c5\" (UID: \"09db059a-bb7c-4f11-807d-9d38a9c712c5\") " Mar 16 17:25:07 crc kubenswrapper[5120]: I0316 17:25:07.885305 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/09db059a-bb7c-4f11-807d-9d38a9c712c5-inventory\") pod \"09db059a-bb7c-4f11-807d-9d38a9c712c5\" (UID: \"09db059a-bb7c-4f11-807d-9d38a9c712c5\") " Mar 16 17:25:07 crc kubenswrapper[5120]: I0316 17:25:07.890344 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09db059a-bb7c-4f11-807d-9d38a9c712c5-kube-api-access-dxkrt" (OuterVolumeSpecName: "kube-api-access-dxkrt") pod "09db059a-bb7c-4f11-807d-9d38a9c712c5" (UID: "09db059a-bb7c-4f11-807d-9d38a9c712c5"). InnerVolumeSpecName "kube-api-access-dxkrt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:25:07 crc kubenswrapper[5120]: I0316 17:25:07.890687 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/09db059a-bb7c-4f11-807d-9d38a9c712c5-custom-svc-combined-ca-bundle" (OuterVolumeSpecName: "custom-svc-combined-ca-bundle") pod "09db059a-bb7c-4f11-807d-9d38a9c712c5" (UID: "09db059a-bb7c-4f11-807d-9d38a9c712c5"). InnerVolumeSpecName "custom-svc-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:25:07 crc kubenswrapper[5120]: I0316 17:25:07.906072 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/09db059a-bb7c-4f11-807d-9d38a9c712c5-ssh-key-edpm-compute-no-nodes" (OuterVolumeSpecName: "ssh-key-edpm-compute-no-nodes") pod "09db059a-bb7c-4f11-807d-9d38a9c712c5" (UID: "09db059a-bb7c-4f11-807d-9d38a9c712c5"). InnerVolumeSpecName "ssh-key-edpm-compute-no-nodes". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:25:07 crc kubenswrapper[5120]: I0316 17:25:07.907905 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/09db059a-bb7c-4f11-807d-9d38a9c712c5-inventory" (OuterVolumeSpecName: "inventory") pod "09db059a-bb7c-4f11-807d-9d38a9c712c5" (UID: "09db059a-bb7c-4f11-807d-9d38a9c712c5"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:25:07 crc kubenswrapper[5120]: I0316 17:25:07.987303 5120 reconciler_common.go:299] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/09db059a-bb7c-4f11-807d-9d38a9c712c5-inventory\") on node \"crc\" DevicePath \"\"" Mar 16 17:25:07 crc kubenswrapper[5120]: I0316 17:25:07.987360 5120 reconciler_common.go:299] "Volume detached for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/09db059a-bb7c-4f11-807d-9d38a9c712c5-ssh-key-edpm-compute-no-nodes\") on node \"crc\" DevicePath \"\"" Mar 16 17:25:07 crc kubenswrapper[5120]: I0316 17:25:07.987374 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dxkrt\" (UniqueName: \"kubernetes.io/projected/09db059a-bb7c-4f11-807d-9d38a9c712c5-kube-api-access-dxkrt\") on node \"crc\" DevicePath \"\"" Mar 16 17:25:07 crc kubenswrapper[5120]: I0316 17:25:07.987388 5120 reconciler_common.go:299] "Volume detached for volume \"custom-svc-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/09db059a-bb7c-4f11-807d-9d38a9c712c5-custom-svc-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:25:08 crc kubenswrapper[5120]: I0316 17:25:08.813898 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/custom-svc-edpm-compute-no-nodes-ovrd-edpm-compute-no-nodecphpx" Mar 16 17:25:08 crc kubenswrapper[5120]: I0316 17:25:08.819605 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/custom-svc-edpm-compute-no-nodes-ovrd-edpm-compute-no-nodecphpx" event={"ID":"09db059a-bb7c-4f11-807d-9d38a9c712c5","Type":"ContainerDied","Data":"93d5a4078884b163cd3270d12b44152138e3241f4686ba482d9f4a43dcec6a3d"} Mar 16 17:25:08 crc kubenswrapper[5120]: I0316 17:25:08.819863 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="93d5a4078884b163cd3270d12b44152138e3241f4686ba482d9f4a43dcec6a3d" Mar 16 17:25:22 crc kubenswrapper[5120]: I0316 17:25:22.008195 5120 patch_prober.go:28] interesting pod/machine-config-daemon-7bf76 container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 17:25:22 crc kubenswrapper[5120]: I0316 17:25:22.008733 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 17:25:25 crc kubenswrapper[5120]: I0316 17:25:25.326730 5120 scope.go:117] "RemoveContainer" containerID="383b854ebc03a050f158311a471e9a7596df61897a7bb8232d9921d4fbb3ce53" Mar 16 17:25:25 crc kubenswrapper[5120]: I0316 17:25:25.370221 5120 scope.go:117] "RemoveContainer" containerID="a3219456479c58d1c73310670060bcbbb12f96868ce6dc571cf91e49d5038d2b" Mar 16 17:25:25 crc kubenswrapper[5120]: I0316 17:25:25.394680 5120 scope.go:117] "RemoveContainer" containerID="56c208ca7047dd7530b048f2e52514c22d2f99fb699ca5ce4124f7baeed7d274" Mar 16 17:25:25 crc kubenswrapper[5120]: I0316 17:25:25.421406 5120 scope.go:117] "RemoveContainer" containerID="8c8bfd3d4b500e1a51c417dde958249bc67da6c7b4636c44742b3a2b0394818b" Mar 16 17:25:25 crc kubenswrapper[5120]: I0316 17:25:25.447898 5120 scope.go:117] "RemoveContainer" containerID="573b2ed01d63aeb033c6967418e782b072d2d3d4f5bd773a11c79d86a5808c25" Mar 16 17:25:32 crc kubenswrapper[5120]: I0316 17:25:32.287307 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovn-edpm-compute-no-nodes-updated-ovn-cm-edpm-compute-no-nmvpqw"] Mar 16 17:25:32 crc kubenswrapper[5120]: I0316 17:25:32.289045 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09db059a-bb7c-4f11-807d-9d38a9c712c5" containerName="custom-svc-edpm-compute-no-nodes-ovrd-edpm-compute-no-nodes" Mar 16 17:25:32 crc kubenswrapper[5120]: I0316 17:25:32.289068 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="09db059a-bb7c-4f11-807d-9d38a9c712c5" containerName="custom-svc-edpm-compute-no-nodes-ovrd-edpm-compute-no-nodes" Mar 16 17:25:32 crc kubenswrapper[5120]: I0316 17:25:32.289263 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="09db059a-bb7c-4f11-807d-9d38a9c712c5" containerName="custom-svc-edpm-compute-no-nodes-ovrd-edpm-compute-no-nodes" Mar 16 17:25:32 crc kubenswrapper[5120]: I0316 17:25:32.304398 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-edpm-compute-no-nodes-updated-ovn-cm-edpm-compute-no-nmvpqw"] Mar 16 17:25:32 crc kubenswrapper[5120]: I0316 17:25:32.304734 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-edpm-compute-no-nodes-updated-ovn-cm-edpm-compute-no-nmvpqw" Mar 16 17:25:32 crc kubenswrapper[5120]: I0316 17:25:32.307313 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"edpm-compute-no-nodes-dockercfg-znndh\"" Mar 16 17:25:32 crc kubenswrapper[5120]: I0316 17:25:32.308291 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-aee-default-env\"" Mar 16 17:25:32 crc kubenswrapper[5120]: I0316 17:25:32.308622 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplane-ansible-ssh-private-key-secret\"" Mar 16 17:25:32 crc kubenswrapper[5120]: I0316 17:25:32.308660 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovncontroller-config\"" Mar 16 17:25:32 crc kubenswrapper[5120]: I0316 17:25:32.309248 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplanenodeset-edpm-compute-no-nodes\"" Mar 16 17:25:32 crc kubenswrapper[5120]: I0316 17:25:32.309283 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"combined-ca-bundle\"" Mar 16 17:25:32 crc kubenswrapper[5120]: I0316 17:25:32.420743 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxdv7\" (UniqueName: \"kubernetes.io/projected/52a14b00-2ed7-41cd-9ea0-8a6e39445c09-kube-api-access-kxdv7\") pod \"ovn-edpm-compute-no-nodes-updated-ovn-cm-edpm-compute-no-nmvpqw\" (UID: \"52a14b00-2ed7-41cd-9ea0-8a6e39445c09\") " pod="openstack-kuttl-tests/ovn-edpm-compute-no-nodes-updated-ovn-cm-edpm-compute-no-nmvpqw" Mar 16 17:25:32 crc kubenswrapper[5120]: I0316 17:25:32.420835 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovncontroller-config-0\" (UniqueName: \"kubernetes.io/configmap/52a14b00-2ed7-41cd-9ea0-8a6e39445c09-ovncontroller-config-0\") pod \"ovn-edpm-compute-no-nodes-updated-ovn-cm-edpm-compute-no-nmvpqw\" (UID: \"52a14b00-2ed7-41cd-9ea0-8a6e39445c09\") " pod="openstack-kuttl-tests/ovn-edpm-compute-no-nodes-updated-ovn-cm-edpm-compute-no-nmvpqw" Mar 16 17:25:32 crc kubenswrapper[5120]: I0316 17:25:32.420988 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/52a14b00-2ed7-41cd-9ea0-8a6e39445c09-ovn-combined-ca-bundle\") pod \"ovn-edpm-compute-no-nodes-updated-ovn-cm-edpm-compute-no-nmvpqw\" (UID: \"52a14b00-2ed7-41cd-9ea0-8a6e39445c09\") " pod="openstack-kuttl-tests/ovn-edpm-compute-no-nodes-updated-ovn-cm-edpm-compute-no-nmvpqw" Mar 16 17:25:32 crc kubenswrapper[5120]: I0316 17:25:32.421046 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/52a14b00-2ed7-41cd-9ea0-8a6e39445c09-ssh-key-edpm-compute-no-nodes\") pod \"ovn-edpm-compute-no-nodes-updated-ovn-cm-edpm-compute-no-nmvpqw\" (UID: \"52a14b00-2ed7-41cd-9ea0-8a6e39445c09\") " pod="openstack-kuttl-tests/ovn-edpm-compute-no-nodes-updated-ovn-cm-edpm-compute-no-nmvpqw" Mar 16 17:25:32 crc kubenswrapper[5120]: I0316 17:25:32.421196 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/52a14b00-2ed7-41cd-9ea0-8a6e39445c09-inventory\") pod \"ovn-edpm-compute-no-nodes-updated-ovn-cm-edpm-compute-no-nmvpqw\" (UID: \"52a14b00-2ed7-41cd-9ea0-8a6e39445c09\") " pod="openstack-kuttl-tests/ovn-edpm-compute-no-nodes-updated-ovn-cm-edpm-compute-no-nmvpqw" Mar 16 17:25:32 crc kubenswrapper[5120]: I0316 17:25:32.523495 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/52a14b00-2ed7-41cd-9ea0-8a6e39445c09-ssh-key-edpm-compute-no-nodes\") pod \"ovn-edpm-compute-no-nodes-updated-ovn-cm-edpm-compute-no-nmvpqw\" (UID: \"52a14b00-2ed7-41cd-9ea0-8a6e39445c09\") " pod="openstack-kuttl-tests/ovn-edpm-compute-no-nodes-updated-ovn-cm-edpm-compute-no-nmvpqw" Mar 16 17:25:32 crc kubenswrapper[5120]: I0316 17:25:32.523706 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/52a14b00-2ed7-41cd-9ea0-8a6e39445c09-inventory\") pod \"ovn-edpm-compute-no-nodes-updated-ovn-cm-edpm-compute-no-nmvpqw\" (UID: \"52a14b00-2ed7-41cd-9ea0-8a6e39445c09\") " pod="openstack-kuttl-tests/ovn-edpm-compute-no-nodes-updated-ovn-cm-edpm-compute-no-nmvpqw" Mar 16 17:25:32 crc kubenswrapper[5120]: I0316 17:25:32.523925 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kxdv7\" (UniqueName: \"kubernetes.io/projected/52a14b00-2ed7-41cd-9ea0-8a6e39445c09-kube-api-access-kxdv7\") pod \"ovn-edpm-compute-no-nodes-updated-ovn-cm-edpm-compute-no-nmvpqw\" (UID: \"52a14b00-2ed7-41cd-9ea0-8a6e39445c09\") " pod="openstack-kuttl-tests/ovn-edpm-compute-no-nodes-updated-ovn-cm-edpm-compute-no-nmvpqw" Mar 16 17:25:32 crc kubenswrapper[5120]: I0316 17:25:32.524033 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovncontroller-config-0\" (UniqueName: \"kubernetes.io/configmap/52a14b00-2ed7-41cd-9ea0-8a6e39445c09-ovncontroller-config-0\") pod \"ovn-edpm-compute-no-nodes-updated-ovn-cm-edpm-compute-no-nmvpqw\" (UID: \"52a14b00-2ed7-41cd-9ea0-8a6e39445c09\") " pod="openstack-kuttl-tests/ovn-edpm-compute-no-nodes-updated-ovn-cm-edpm-compute-no-nmvpqw" Mar 16 17:25:32 crc kubenswrapper[5120]: I0316 17:25:32.524192 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/52a14b00-2ed7-41cd-9ea0-8a6e39445c09-ovn-combined-ca-bundle\") pod \"ovn-edpm-compute-no-nodes-updated-ovn-cm-edpm-compute-no-nmvpqw\" (UID: \"52a14b00-2ed7-41cd-9ea0-8a6e39445c09\") " pod="openstack-kuttl-tests/ovn-edpm-compute-no-nodes-updated-ovn-cm-edpm-compute-no-nmvpqw" Mar 16 17:25:32 crc kubenswrapper[5120]: I0316 17:25:32.524932 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovncontroller-config-0\" (UniqueName: \"kubernetes.io/configmap/52a14b00-2ed7-41cd-9ea0-8a6e39445c09-ovncontroller-config-0\") pod \"ovn-edpm-compute-no-nodes-updated-ovn-cm-edpm-compute-no-nmvpqw\" (UID: \"52a14b00-2ed7-41cd-9ea0-8a6e39445c09\") " pod="openstack-kuttl-tests/ovn-edpm-compute-no-nodes-updated-ovn-cm-edpm-compute-no-nmvpqw" Mar 16 17:25:32 crc kubenswrapper[5120]: I0316 17:25:32.529986 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/52a14b00-2ed7-41cd-9ea0-8a6e39445c09-ovn-combined-ca-bundle\") pod \"ovn-edpm-compute-no-nodes-updated-ovn-cm-edpm-compute-no-nmvpqw\" (UID: \"52a14b00-2ed7-41cd-9ea0-8a6e39445c09\") " pod="openstack-kuttl-tests/ovn-edpm-compute-no-nodes-updated-ovn-cm-edpm-compute-no-nmvpqw" Mar 16 17:25:32 crc kubenswrapper[5120]: I0316 17:25:32.537591 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/52a14b00-2ed7-41cd-9ea0-8a6e39445c09-inventory\") pod \"ovn-edpm-compute-no-nodes-updated-ovn-cm-edpm-compute-no-nmvpqw\" (UID: \"52a14b00-2ed7-41cd-9ea0-8a6e39445c09\") " pod="openstack-kuttl-tests/ovn-edpm-compute-no-nodes-updated-ovn-cm-edpm-compute-no-nmvpqw" Mar 16 17:25:32 crc kubenswrapper[5120]: I0316 17:25:32.539743 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/52a14b00-2ed7-41cd-9ea0-8a6e39445c09-ssh-key-edpm-compute-no-nodes\") pod \"ovn-edpm-compute-no-nodes-updated-ovn-cm-edpm-compute-no-nmvpqw\" (UID: \"52a14b00-2ed7-41cd-9ea0-8a6e39445c09\") " pod="openstack-kuttl-tests/ovn-edpm-compute-no-nodes-updated-ovn-cm-edpm-compute-no-nmvpqw" Mar 16 17:25:32 crc kubenswrapper[5120]: I0316 17:25:32.544984 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxdv7\" (UniqueName: \"kubernetes.io/projected/52a14b00-2ed7-41cd-9ea0-8a6e39445c09-kube-api-access-kxdv7\") pod \"ovn-edpm-compute-no-nodes-updated-ovn-cm-edpm-compute-no-nmvpqw\" (UID: \"52a14b00-2ed7-41cd-9ea0-8a6e39445c09\") " pod="openstack-kuttl-tests/ovn-edpm-compute-no-nodes-updated-ovn-cm-edpm-compute-no-nmvpqw" Mar 16 17:25:32 crc kubenswrapper[5120]: I0316 17:25:32.634118 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-edpm-compute-no-nodes-updated-ovn-cm-edpm-compute-no-nmvpqw" Mar 16 17:25:33 crc kubenswrapper[5120]: I0316 17:25:33.064380 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-edpm-compute-no-nodes-updated-ovn-cm-edpm-compute-no-nmvpqw"] Mar 16 17:25:34 crc kubenswrapper[5120]: I0316 17:25:34.046495 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-edpm-compute-no-nodes-updated-ovn-cm-edpm-compute-no-nmvpqw" event={"ID":"52a14b00-2ed7-41cd-9ea0-8a6e39445c09","Type":"ContainerStarted","Data":"49c356ce77aa518c9388549e733bca58a944421f63c8eafeb93628bfcc335bd0"} Mar 16 17:25:34 crc kubenswrapper[5120]: I0316 17:25:34.046831 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-edpm-compute-no-nodes-updated-ovn-cm-edpm-compute-no-nmvpqw" event={"ID":"52a14b00-2ed7-41cd-9ea0-8a6e39445c09","Type":"ContainerStarted","Data":"a8ecd7ed722c8835116a2e29d27482ef9ee90fee602a8097eec01f5857dbcd2b"} Mar 16 17:25:34 crc kubenswrapper[5120]: I0316 17:25:34.081022 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovn-edpm-compute-no-nodes-updated-ovn-cm-edpm-compute-no-nmvpqw" podStartSLOduration=1.5929175340000001 podStartE2EDuration="2.080984209s" podCreationTimestamp="2026-03-16 17:25:32 +0000 UTC" firstStartedPulling="2026-03-16 17:25:33.075451433 +0000 UTC m=+6835.229383130" lastFinishedPulling="2026-03-16 17:25:33.563518148 +0000 UTC m=+6835.717449805" observedRunningTime="2026-03-16 17:25:34.069422223 +0000 UTC m=+6836.223353880" watchObservedRunningTime="2026-03-16 17:25:34.080984209 +0000 UTC m=+6836.234915886" Mar 16 17:25:35 crc kubenswrapper[5120]: I0316 17:25:35.059189 5120 generic.go:358] "Generic (PLEG): container finished" podID="52a14b00-2ed7-41cd-9ea0-8a6e39445c09" containerID="49c356ce77aa518c9388549e733bca58a944421f63c8eafeb93628bfcc335bd0" exitCode=0 Mar 16 17:25:35 crc kubenswrapper[5120]: I0316 17:25:35.059295 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-edpm-compute-no-nodes-updated-ovn-cm-edpm-compute-no-nmvpqw" event={"ID":"52a14b00-2ed7-41cd-9ea0-8a6e39445c09","Type":"ContainerDied","Data":"49c356ce77aa518c9388549e733bca58a944421f63c8eafeb93628bfcc335bd0"} Mar 16 17:25:35 crc kubenswrapper[5120]: I0316 17:25:35.185345 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/certified-operators-mwlb4"] Mar 16 17:25:35 crc kubenswrapper[5120]: I0316 17:25:35.193148 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-mwlb4" Mar 16 17:25:35 crc kubenswrapper[5120]: I0316 17:25:35.196921 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/certified-operators-mwlb4"] Mar 16 17:25:35 crc kubenswrapper[5120]: I0316 17:25:35.298786 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/23e9e1fa-7ea0-48b9-b4d7-7db1735fa8a5-utilities\") pod \"certified-operators-mwlb4\" (UID: \"23e9e1fa-7ea0-48b9-b4d7-7db1735fa8a5\") " pod="openshift-marketplace/certified-operators-mwlb4" Mar 16 17:25:35 crc kubenswrapper[5120]: I0316 17:25:35.298957 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b99d5\" (UniqueName: \"kubernetes.io/projected/23e9e1fa-7ea0-48b9-b4d7-7db1735fa8a5-kube-api-access-b99d5\") pod \"certified-operators-mwlb4\" (UID: \"23e9e1fa-7ea0-48b9-b4d7-7db1735fa8a5\") " pod="openshift-marketplace/certified-operators-mwlb4" Mar 16 17:25:35 crc kubenswrapper[5120]: I0316 17:25:35.299122 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/23e9e1fa-7ea0-48b9-b4d7-7db1735fa8a5-catalog-content\") pod \"certified-operators-mwlb4\" (UID: \"23e9e1fa-7ea0-48b9-b4d7-7db1735fa8a5\") " pod="openshift-marketplace/certified-operators-mwlb4" Mar 16 17:25:35 crc kubenswrapper[5120]: I0316 17:25:35.400532 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/23e9e1fa-7ea0-48b9-b4d7-7db1735fa8a5-catalog-content\") pod \"certified-operators-mwlb4\" (UID: \"23e9e1fa-7ea0-48b9-b4d7-7db1735fa8a5\") " pod="openshift-marketplace/certified-operators-mwlb4" Mar 16 17:25:35 crc kubenswrapper[5120]: I0316 17:25:35.400612 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/23e9e1fa-7ea0-48b9-b4d7-7db1735fa8a5-utilities\") pod \"certified-operators-mwlb4\" (UID: \"23e9e1fa-7ea0-48b9-b4d7-7db1735fa8a5\") " pod="openshift-marketplace/certified-operators-mwlb4" Mar 16 17:25:35 crc kubenswrapper[5120]: I0316 17:25:35.400772 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b99d5\" (UniqueName: \"kubernetes.io/projected/23e9e1fa-7ea0-48b9-b4d7-7db1735fa8a5-kube-api-access-b99d5\") pod \"certified-operators-mwlb4\" (UID: \"23e9e1fa-7ea0-48b9-b4d7-7db1735fa8a5\") " pod="openshift-marketplace/certified-operators-mwlb4" Mar 16 17:25:35 crc kubenswrapper[5120]: I0316 17:25:35.401239 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/23e9e1fa-7ea0-48b9-b4d7-7db1735fa8a5-catalog-content\") pod \"certified-operators-mwlb4\" (UID: \"23e9e1fa-7ea0-48b9-b4d7-7db1735fa8a5\") " pod="openshift-marketplace/certified-operators-mwlb4" Mar 16 17:25:35 crc kubenswrapper[5120]: I0316 17:25:35.401345 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/23e9e1fa-7ea0-48b9-b4d7-7db1735fa8a5-utilities\") pod \"certified-operators-mwlb4\" (UID: \"23e9e1fa-7ea0-48b9-b4d7-7db1735fa8a5\") " pod="openshift-marketplace/certified-operators-mwlb4" Mar 16 17:25:35 crc kubenswrapper[5120]: I0316 17:25:35.440350 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b99d5\" (UniqueName: \"kubernetes.io/projected/23e9e1fa-7ea0-48b9-b4d7-7db1735fa8a5-kube-api-access-b99d5\") pod \"certified-operators-mwlb4\" (UID: \"23e9e1fa-7ea0-48b9-b4d7-7db1735fa8a5\") " pod="openshift-marketplace/certified-operators-mwlb4" Mar 16 17:25:35 crc kubenswrapper[5120]: I0316 17:25:35.532425 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-mwlb4" Mar 16 17:25:35 crc kubenswrapper[5120]: I0316 17:25:35.989909 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/certified-operators-mwlb4"] Mar 16 17:25:35 crc kubenswrapper[5120]: W0316 17:25:35.992345 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23e9e1fa_7ea0_48b9_b4d7_7db1735fa8a5.slice/crio-a3bf5a7bbe13e98bea1a8f8df601dcca0496dc785a3b182bfeb25f3532829fab WatchSource:0}: Error finding container a3bf5a7bbe13e98bea1a8f8df601dcca0496dc785a3b182bfeb25f3532829fab: Status 404 returned error can't find the container with id a3bf5a7bbe13e98bea1a8f8df601dcca0496dc785a3b182bfeb25f3532829fab Mar 16 17:25:36 crc kubenswrapper[5120]: I0316 17:25:36.072935 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-mwlb4" event={"ID":"23e9e1fa-7ea0-48b9-b4d7-7db1735fa8a5","Type":"ContainerStarted","Data":"a3bf5a7bbe13e98bea1a8f8df601dcca0496dc785a3b182bfeb25f3532829fab"} Mar 16 17:25:36 crc kubenswrapper[5120]: I0316 17:25:36.340468 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-edpm-compute-no-nodes-updated-ovn-cm-edpm-compute-no-nmvpqw" Mar 16 17:25:36 crc kubenswrapper[5120]: I0316 17:25:36.423069 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/52a14b00-2ed7-41cd-9ea0-8a6e39445c09-inventory\") pod \"52a14b00-2ed7-41cd-9ea0-8a6e39445c09\" (UID: \"52a14b00-2ed7-41cd-9ea0-8a6e39445c09\") " Mar 16 17:25:36 crc kubenswrapper[5120]: I0316 17:25:36.423350 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kxdv7\" (UniqueName: \"kubernetes.io/projected/52a14b00-2ed7-41cd-9ea0-8a6e39445c09-kube-api-access-kxdv7\") pod \"52a14b00-2ed7-41cd-9ea0-8a6e39445c09\" (UID: \"52a14b00-2ed7-41cd-9ea0-8a6e39445c09\") " Mar 16 17:25:36 crc kubenswrapper[5120]: I0316 17:25:36.423589 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovncontroller-config-0\" (UniqueName: \"kubernetes.io/configmap/52a14b00-2ed7-41cd-9ea0-8a6e39445c09-ovncontroller-config-0\") pod \"52a14b00-2ed7-41cd-9ea0-8a6e39445c09\" (UID: \"52a14b00-2ed7-41cd-9ea0-8a6e39445c09\") " Mar 16 17:25:36 crc kubenswrapper[5120]: I0316 17:25:36.423619 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/52a14b00-2ed7-41cd-9ea0-8a6e39445c09-ssh-key-edpm-compute-no-nodes\") pod \"52a14b00-2ed7-41cd-9ea0-8a6e39445c09\" (UID: \"52a14b00-2ed7-41cd-9ea0-8a6e39445c09\") " Mar 16 17:25:36 crc kubenswrapper[5120]: I0316 17:25:36.423681 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/52a14b00-2ed7-41cd-9ea0-8a6e39445c09-ovn-combined-ca-bundle\") pod \"52a14b00-2ed7-41cd-9ea0-8a6e39445c09\" (UID: \"52a14b00-2ed7-41cd-9ea0-8a6e39445c09\") " Mar 16 17:25:36 crc kubenswrapper[5120]: I0316 17:25:36.430173 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/52a14b00-2ed7-41cd-9ea0-8a6e39445c09-kube-api-access-kxdv7" (OuterVolumeSpecName: "kube-api-access-kxdv7") pod "52a14b00-2ed7-41cd-9ea0-8a6e39445c09" (UID: "52a14b00-2ed7-41cd-9ea0-8a6e39445c09"). InnerVolumeSpecName "kube-api-access-kxdv7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:25:36 crc kubenswrapper[5120]: I0316 17:25:36.430220 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/52a14b00-2ed7-41cd-9ea0-8a6e39445c09-ovn-combined-ca-bundle" (OuterVolumeSpecName: "ovn-combined-ca-bundle") pod "52a14b00-2ed7-41cd-9ea0-8a6e39445c09" (UID: "52a14b00-2ed7-41cd-9ea0-8a6e39445c09"). InnerVolumeSpecName "ovn-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:25:36 crc kubenswrapper[5120]: I0316 17:25:36.443493 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/52a14b00-2ed7-41cd-9ea0-8a6e39445c09-ovncontroller-config-0" (OuterVolumeSpecName: "ovncontroller-config-0") pod "52a14b00-2ed7-41cd-9ea0-8a6e39445c09" (UID: "52a14b00-2ed7-41cd-9ea0-8a6e39445c09"). InnerVolumeSpecName "ovncontroller-config-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:25:36 crc kubenswrapper[5120]: I0316 17:25:36.445804 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/52a14b00-2ed7-41cd-9ea0-8a6e39445c09-inventory" (OuterVolumeSpecName: "inventory") pod "52a14b00-2ed7-41cd-9ea0-8a6e39445c09" (UID: "52a14b00-2ed7-41cd-9ea0-8a6e39445c09"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:25:36 crc kubenswrapper[5120]: I0316 17:25:36.446000 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/52a14b00-2ed7-41cd-9ea0-8a6e39445c09-ssh-key-edpm-compute-no-nodes" (OuterVolumeSpecName: "ssh-key-edpm-compute-no-nodes") pod "52a14b00-2ed7-41cd-9ea0-8a6e39445c09" (UID: "52a14b00-2ed7-41cd-9ea0-8a6e39445c09"). InnerVolumeSpecName "ssh-key-edpm-compute-no-nodes". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:25:36 crc kubenswrapper[5120]: I0316 17:25:36.530645 5120 reconciler_common.go:299] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/52a14b00-2ed7-41cd-9ea0-8a6e39445c09-inventory\") on node \"crc\" DevicePath \"\"" Mar 16 17:25:36 crc kubenswrapper[5120]: I0316 17:25:36.530688 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kxdv7\" (UniqueName: \"kubernetes.io/projected/52a14b00-2ed7-41cd-9ea0-8a6e39445c09-kube-api-access-kxdv7\") on node \"crc\" DevicePath \"\"" Mar 16 17:25:36 crc kubenswrapper[5120]: I0316 17:25:36.530704 5120 reconciler_common.go:299] "Volume detached for volume \"ovncontroller-config-0\" (UniqueName: \"kubernetes.io/configmap/52a14b00-2ed7-41cd-9ea0-8a6e39445c09-ovncontroller-config-0\") on node \"crc\" DevicePath \"\"" Mar 16 17:25:36 crc kubenswrapper[5120]: I0316 17:25:36.530713 5120 reconciler_common.go:299] "Volume detached for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/52a14b00-2ed7-41cd-9ea0-8a6e39445c09-ssh-key-edpm-compute-no-nodes\") on node \"crc\" DevicePath \"\"" Mar 16 17:25:36 crc kubenswrapper[5120]: I0316 17:25:36.530725 5120 reconciler_common.go:299] "Volume detached for volume \"ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/52a14b00-2ed7-41cd-9ea0-8a6e39445c09-ovn-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:25:37 crc kubenswrapper[5120]: I0316 17:25:37.084258 5120 generic.go:358] "Generic (PLEG): container finished" podID="23e9e1fa-7ea0-48b9-b4d7-7db1735fa8a5" containerID="70247b1d1fbf751c44c0839720d37663a5fd8ca6d913569b945fc9ee4e5ebda6" exitCode=0 Mar 16 17:25:37 crc kubenswrapper[5120]: I0316 17:25:37.084314 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-mwlb4" event={"ID":"23e9e1fa-7ea0-48b9-b4d7-7db1735fa8a5","Type":"ContainerDied","Data":"70247b1d1fbf751c44c0839720d37663a5fd8ca6d913569b945fc9ee4e5ebda6"} Mar 16 17:25:37 crc kubenswrapper[5120]: I0316 17:25:37.087630 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-edpm-compute-no-nodes-updated-ovn-cm-edpm-compute-no-nmvpqw" Mar 16 17:25:37 crc kubenswrapper[5120]: I0316 17:25:37.088540 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-edpm-compute-no-nodes-updated-ovn-cm-edpm-compute-no-nmvpqw" event={"ID":"52a14b00-2ed7-41cd-9ea0-8a6e39445c09","Type":"ContainerDied","Data":"a8ecd7ed722c8835116a2e29d27482ef9ee90fee602a8097eec01f5857dbcd2b"} Mar 16 17:25:37 crc kubenswrapper[5120]: I0316 17:25:37.088577 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a8ecd7ed722c8835116a2e29d27482ef9ee90fee602a8097eec01f5857dbcd2b" Mar 16 17:25:38 crc kubenswrapper[5120]: I0316 17:25:38.485791 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-795f46b747-6fgjf"] Mar 16 17:25:38 crc kubenswrapper[5120]: I0316 17:25:38.487225 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52a14b00-2ed7-41cd-9ea0-8a6e39445c09" containerName="ovn-edpm-compute-no-nodes-updated-ovn-cm-edpm-compute-no-nodes" Mar 16 17:25:38 crc kubenswrapper[5120]: I0316 17:25:38.487248 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="52a14b00-2ed7-41cd-9ea0-8a6e39445c09" containerName="ovn-edpm-compute-no-nodes-updated-ovn-cm-edpm-compute-no-nodes" Mar 16 17:25:38 crc kubenswrapper[5120]: I0316 17:25:38.487476 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="52a14b00-2ed7-41cd-9ea0-8a6e39445c09" containerName="ovn-edpm-compute-no-nodes-updated-ovn-cm-edpm-compute-no-nodes" Mar 16 17:25:38 crc kubenswrapper[5120]: I0316 17:25:38.501195 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-795f46b747-6fgjf" Mar 16 17:25:38 crc kubenswrapper[5120]: I0316 17:25:38.503517 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"edpm-compute-beta-nodeset\"" Mar 16 17:25:38 crc kubenswrapper[5120]: I0316 17:25:38.509014 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-795f46b747-6fgjf"] Mar 16 17:25:38 crc kubenswrapper[5120]: I0316 17:25:38.577559 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gnmh\" (UniqueName: \"kubernetes.io/projected/4f0674e4-b3ab-4aa4-bf48-271225fb7a23-kube-api-access-8gnmh\") pod \"dnsmasq-dnsmasq-795f46b747-6fgjf\" (UID: \"4f0674e4-b3ab-4aa4-bf48-271225fb7a23\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-795f46b747-6fgjf" Mar 16 17:25:38 crc kubenswrapper[5120]: I0316 17:25:38.577662 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/configmap/4f0674e4-b3ab-4aa4-bf48-271225fb7a23-edpm-compute-no-nodes\") pod \"dnsmasq-dnsmasq-795f46b747-6fgjf\" (UID: \"4f0674e4-b3ab-4aa4-bf48-271225fb7a23\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-795f46b747-6fgjf" Mar 16 17:25:38 crc kubenswrapper[5120]: I0316 17:25:38.577817 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/4f0674e4-b3ab-4aa4-bf48-271225fb7a23-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-795f46b747-6fgjf\" (UID: \"4f0674e4-b3ab-4aa4-bf48-271225fb7a23\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-795f46b747-6fgjf" Mar 16 17:25:38 crc kubenswrapper[5120]: I0316 17:25:38.577888 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"edpm-compute-beta-nodeset\" (UniqueName: \"kubernetes.io/configmap/4f0674e4-b3ab-4aa4-bf48-271225fb7a23-edpm-compute-beta-nodeset\") pod \"dnsmasq-dnsmasq-795f46b747-6fgjf\" (UID: \"4f0674e4-b3ab-4aa4-bf48-271225fb7a23\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-795f46b747-6fgjf" Mar 16 17:25:38 crc kubenswrapper[5120]: I0316 17:25:38.577926 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4f0674e4-b3ab-4aa4-bf48-271225fb7a23-config\") pod \"dnsmasq-dnsmasq-795f46b747-6fgjf\" (UID: \"4f0674e4-b3ab-4aa4-bf48-271225fb7a23\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-795f46b747-6fgjf" Mar 16 17:25:38 crc kubenswrapper[5120]: I0316 17:25:38.686193 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"edpm-compute-beta-nodeset\" (UniqueName: \"kubernetes.io/configmap/4f0674e4-b3ab-4aa4-bf48-271225fb7a23-edpm-compute-beta-nodeset\") pod \"dnsmasq-dnsmasq-795f46b747-6fgjf\" (UID: \"4f0674e4-b3ab-4aa4-bf48-271225fb7a23\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-795f46b747-6fgjf" Mar 16 17:25:38 crc kubenswrapper[5120]: I0316 17:25:38.686307 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4f0674e4-b3ab-4aa4-bf48-271225fb7a23-config\") pod \"dnsmasq-dnsmasq-795f46b747-6fgjf\" (UID: \"4f0674e4-b3ab-4aa4-bf48-271225fb7a23\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-795f46b747-6fgjf" Mar 16 17:25:38 crc kubenswrapper[5120]: I0316 17:25:38.686444 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8gnmh\" (UniqueName: \"kubernetes.io/projected/4f0674e4-b3ab-4aa4-bf48-271225fb7a23-kube-api-access-8gnmh\") pod \"dnsmasq-dnsmasq-795f46b747-6fgjf\" (UID: \"4f0674e4-b3ab-4aa4-bf48-271225fb7a23\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-795f46b747-6fgjf" Mar 16 17:25:38 crc kubenswrapper[5120]: I0316 17:25:38.686551 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/configmap/4f0674e4-b3ab-4aa4-bf48-271225fb7a23-edpm-compute-no-nodes\") pod \"dnsmasq-dnsmasq-795f46b747-6fgjf\" (UID: \"4f0674e4-b3ab-4aa4-bf48-271225fb7a23\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-795f46b747-6fgjf" Mar 16 17:25:38 crc kubenswrapper[5120]: I0316 17:25:38.686756 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/4f0674e4-b3ab-4aa4-bf48-271225fb7a23-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-795f46b747-6fgjf\" (UID: \"4f0674e4-b3ab-4aa4-bf48-271225fb7a23\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-795f46b747-6fgjf" Mar 16 17:25:38 crc kubenswrapper[5120]: I0316 17:25:38.688404 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/4f0674e4-b3ab-4aa4-bf48-271225fb7a23-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-795f46b747-6fgjf\" (UID: \"4f0674e4-b3ab-4aa4-bf48-271225fb7a23\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-795f46b747-6fgjf" Mar 16 17:25:38 crc kubenswrapper[5120]: I0316 17:25:38.688596 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4f0674e4-b3ab-4aa4-bf48-271225fb7a23-config\") pod \"dnsmasq-dnsmasq-795f46b747-6fgjf\" (UID: \"4f0674e4-b3ab-4aa4-bf48-271225fb7a23\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-795f46b747-6fgjf" Mar 16 17:25:38 crc kubenswrapper[5120]: I0316 17:25:38.689549 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/configmap/4f0674e4-b3ab-4aa4-bf48-271225fb7a23-edpm-compute-no-nodes\") pod \"dnsmasq-dnsmasq-795f46b747-6fgjf\" (UID: \"4f0674e4-b3ab-4aa4-bf48-271225fb7a23\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-795f46b747-6fgjf" Mar 16 17:25:38 crc kubenswrapper[5120]: I0316 17:25:38.690676 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"edpm-compute-beta-nodeset\"" Mar 16 17:25:38 crc kubenswrapper[5120]: I0316 17:25:38.701546 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"edpm-compute-beta-nodeset\" (UniqueName: \"kubernetes.io/configmap/4f0674e4-b3ab-4aa4-bf48-271225fb7a23-edpm-compute-beta-nodeset\") pod \"dnsmasq-dnsmasq-795f46b747-6fgjf\" (UID: \"4f0674e4-b3ab-4aa4-bf48-271225fb7a23\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-795f46b747-6fgjf" Mar 16 17:25:38 crc kubenswrapper[5120]: I0316 17:25:38.717437 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gnmh\" (UniqueName: \"kubernetes.io/projected/4f0674e4-b3ab-4aa4-bf48-271225fb7a23-kube-api-access-8gnmh\") pod \"dnsmasq-dnsmasq-795f46b747-6fgjf\" (UID: \"4f0674e4-b3ab-4aa4-bf48-271225fb7a23\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-795f46b747-6fgjf" Mar 16 17:25:38 crc kubenswrapper[5120]: I0316 17:25:38.818286 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-795f46b747-6fgjf" Mar 16 17:25:39 crc kubenswrapper[5120]: I0316 17:25:39.112014 5120 generic.go:358] "Generic (PLEG): container finished" podID="23e9e1fa-7ea0-48b9-b4d7-7db1735fa8a5" containerID="3de267825d321e8afa3d923cf1d5a8a476807600274693ee2b260d10fd3dbc3d" exitCode=0 Mar 16 17:25:39 crc kubenswrapper[5120]: I0316 17:25:39.112414 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-mwlb4" event={"ID":"23e9e1fa-7ea0-48b9-b4d7-7db1735fa8a5","Type":"ContainerDied","Data":"3de267825d321e8afa3d923cf1d5a8a476807600274693ee2b260d10fd3dbc3d"} Mar 16 17:25:39 crc kubenswrapper[5120]: I0316 17:25:39.294413 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-795f46b747-6fgjf"] Mar 16 17:25:40 crc kubenswrapper[5120]: I0316 17:25:40.125844 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-mwlb4" event={"ID":"23e9e1fa-7ea0-48b9-b4d7-7db1735fa8a5","Type":"ContainerStarted","Data":"3706452f8274db95ff98678d8b13605290b0aa6031d1d48b402b3773efb584c6"} Mar 16 17:25:40 crc kubenswrapper[5120]: I0316 17:25:40.131175 5120 generic.go:358] "Generic (PLEG): container finished" podID="4f0674e4-b3ab-4aa4-bf48-271225fb7a23" containerID="9864d97c234fcfcf4e3c40afa06271ed444c9fcd5a5d809e249cafb5a7c98362" exitCode=0 Mar 16 17:25:40 crc kubenswrapper[5120]: I0316 17:25:40.131289 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-795f46b747-6fgjf" event={"ID":"4f0674e4-b3ab-4aa4-bf48-271225fb7a23","Type":"ContainerDied","Data":"9864d97c234fcfcf4e3c40afa06271ed444c9fcd5a5d809e249cafb5a7c98362"} Mar 16 17:25:40 crc kubenswrapper[5120]: I0316 17:25:40.131321 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-795f46b747-6fgjf" event={"ID":"4f0674e4-b3ab-4aa4-bf48-271225fb7a23","Type":"ContainerStarted","Data":"0ebee029bc425cd1b9cf10f37a86a21db62012eda6f41685431c5213261022d4"} Mar 16 17:25:40 crc kubenswrapper[5120]: I0316 17:25:40.183848 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/certified-operators-mwlb4" podStartSLOduration=4.242479026 podStartE2EDuration="5.183810039s" podCreationTimestamp="2026-03-16 17:25:35 +0000 UTC" firstStartedPulling="2026-03-16 17:25:37.086381511 +0000 UTC m=+6839.240313168" lastFinishedPulling="2026-03-16 17:25:38.027712524 +0000 UTC m=+6840.181644181" observedRunningTime="2026-03-16 17:25:40.151403413 +0000 UTC m=+6842.305335070" watchObservedRunningTime="2026-03-16 17:25:40.183810039 +0000 UTC m=+6842.337741686" Mar 16 17:25:41 crc kubenswrapper[5120]: I0316 17:25:41.143038 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-795f46b747-6fgjf" event={"ID":"4f0674e4-b3ab-4aa4-bf48-271225fb7a23","Type":"ContainerStarted","Data":"b431b49b7bf133c94875a49acd84a554f1ce5bd8676605e81b26c796815de4fe"} Mar 16 17:25:41 crc kubenswrapper[5120]: I0316 17:25:41.143946 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-795f46b747-6fgjf" Mar 16 17:25:41 crc kubenswrapper[5120]: I0316 17:25:41.163836 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-795f46b747-6fgjf" podStartSLOduration=3.163819787 podStartE2EDuration="3.163819787s" podCreationTimestamp="2026-03-16 17:25:38 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:25:41.161601217 +0000 UTC m=+6843.315532874" watchObservedRunningTime="2026-03-16 17:25:41.163819787 +0000 UTC m=+6843.317751444" Mar 16 17:25:45 crc kubenswrapper[5120]: I0316 17:25:45.533581 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-marketplace/certified-operators-mwlb4" Mar 16 17:25:45 crc kubenswrapper[5120]: I0316 17:25:45.534189 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/certified-operators-mwlb4" Mar 16 17:25:45 crc kubenswrapper[5120]: I0316 17:25:45.570435 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/certified-operators-mwlb4" Mar 16 17:25:46 crc kubenswrapper[5120]: I0316 17:25:46.227418 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/certified-operators-mwlb4" Mar 16 17:25:46 crc kubenswrapper[5120]: I0316 17:25:46.267657 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/certified-operators-mwlb4"] Mar 16 17:25:47 crc kubenswrapper[5120]: I0316 17:25:47.152954 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-795f46b747-6fgjf" Mar 16 17:25:47 crc kubenswrapper[5120]: I0316 17:25:47.200107 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-8c5974765-c6tkv"] Mar 16 17:25:47 crc kubenswrapper[5120]: I0316 17:25:47.200339 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-8c5974765-c6tkv" podUID="3624a599-2ea0-41fa-931f-9258d899b82e" containerName="dnsmasq-dns" containerID="cri-o://34f41b200d8b95f5496297ee71e6cd239e16f0c575c9610daaf762f0efe4648c" gracePeriod=10 Mar 16 17:25:47 crc kubenswrapper[5120]: I0316 17:25:47.315948 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-8c5974765-c6tkv" podUID="3624a599-2ea0-41fa-931f-9258d899b82e" containerName="dnsmasq-dns" probeResult="failure" output="dial tcp 10.217.1.31:5353: connect: connection refused" Mar 16 17:25:47 crc kubenswrapper[5120]: I0316 17:25:47.598023 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-8c5974765-c6tkv" Mar 16 17:25:47 crc kubenswrapper[5120]: I0316 17:25:47.684778 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3624a599-2ea0-41fa-931f-9258d899b82e-config\") pod \"3624a599-2ea0-41fa-931f-9258d899b82e\" (UID: \"3624a599-2ea0-41fa-931f-9258d899b82e\") " Mar 16 17:25:47 crc kubenswrapper[5120]: I0316 17:25:47.685020 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5m4jb\" (UniqueName: \"kubernetes.io/projected/3624a599-2ea0-41fa-931f-9258d899b82e-kube-api-access-5m4jb\") pod \"3624a599-2ea0-41fa-931f-9258d899b82e\" (UID: \"3624a599-2ea0-41fa-931f-9258d899b82e\") " Mar 16 17:25:47 crc kubenswrapper[5120]: I0316 17:25:47.685349 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/configmap/3624a599-2ea0-41fa-931f-9258d899b82e-edpm-compute-no-nodes\") pod \"3624a599-2ea0-41fa-931f-9258d899b82e\" (UID: \"3624a599-2ea0-41fa-931f-9258d899b82e\") " Mar 16 17:25:47 crc kubenswrapper[5120]: I0316 17:25:47.685700 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/3624a599-2ea0-41fa-931f-9258d899b82e-dnsmasq-svc\") pod \"3624a599-2ea0-41fa-931f-9258d899b82e\" (UID: \"3624a599-2ea0-41fa-931f-9258d899b82e\") " Mar 16 17:25:47 crc kubenswrapper[5120]: I0316 17:25:47.691086 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3624a599-2ea0-41fa-931f-9258d899b82e-kube-api-access-5m4jb" (OuterVolumeSpecName: "kube-api-access-5m4jb") pod "3624a599-2ea0-41fa-931f-9258d899b82e" (UID: "3624a599-2ea0-41fa-931f-9258d899b82e"). InnerVolumeSpecName "kube-api-access-5m4jb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:25:47 crc kubenswrapper[5120]: I0316 17:25:47.728064 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3624a599-2ea0-41fa-931f-9258d899b82e-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "3624a599-2ea0-41fa-931f-9258d899b82e" (UID: "3624a599-2ea0-41fa-931f-9258d899b82e"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:25:47 crc kubenswrapper[5120]: I0316 17:25:47.728076 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3624a599-2ea0-41fa-931f-9258d899b82e-config" (OuterVolumeSpecName: "config") pod "3624a599-2ea0-41fa-931f-9258d899b82e" (UID: "3624a599-2ea0-41fa-931f-9258d899b82e"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:25:47 crc kubenswrapper[5120]: I0316 17:25:47.732327 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3624a599-2ea0-41fa-931f-9258d899b82e-edpm-compute-no-nodes" (OuterVolumeSpecName: "edpm-compute-no-nodes") pod "3624a599-2ea0-41fa-931f-9258d899b82e" (UID: "3624a599-2ea0-41fa-931f-9258d899b82e"). InnerVolumeSpecName "edpm-compute-no-nodes". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:25:47 crc kubenswrapper[5120]: I0316 17:25:47.788675 5120 reconciler_common.go:299] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/3624a599-2ea0-41fa-931f-9258d899b82e-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Mar 16 17:25:47 crc kubenswrapper[5120]: I0316 17:25:47.788720 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3624a599-2ea0-41fa-931f-9258d899b82e-config\") on node \"crc\" DevicePath \"\"" Mar 16 17:25:47 crc kubenswrapper[5120]: I0316 17:25:47.788737 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5m4jb\" (UniqueName: \"kubernetes.io/projected/3624a599-2ea0-41fa-931f-9258d899b82e-kube-api-access-5m4jb\") on node \"crc\" DevicePath \"\"" Mar 16 17:25:47 crc kubenswrapper[5120]: I0316 17:25:47.788755 5120 reconciler_common.go:299] "Volume detached for volume \"edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/configmap/3624a599-2ea0-41fa-931f-9258d899b82e-edpm-compute-no-nodes\") on node \"crc\" DevicePath \"\"" Mar 16 17:25:48 crc kubenswrapper[5120]: I0316 17:25:48.222954 5120 generic.go:358] "Generic (PLEG): container finished" podID="3624a599-2ea0-41fa-931f-9258d899b82e" containerID="34f41b200d8b95f5496297ee71e6cd239e16f0c575c9610daaf762f0efe4648c" exitCode=0 Mar 16 17:25:48 crc kubenswrapper[5120]: I0316 17:25:48.223011 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-8c5974765-c6tkv" event={"ID":"3624a599-2ea0-41fa-931f-9258d899b82e","Type":"ContainerDied","Data":"34f41b200d8b95f5496297ee71e6cd239e16f0c575c9610daaf762f0efe4648c"} Mar 16 17:25:48 crc kubenswrapper[5120]: I0316 17:25:48.223069 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-8c5974765-c6tkv" Mar 16 17:25:48 crc kubenswrapper[5120]: I0316 17:25:48.223419 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-8c5974765-c6tkv" event={"ID":"3624a599-2ea0-41fa-931f-9258d899b82e","Type":"ContainerDied","Data":"9df9df4db16922e074d8574d20d1b61f4e3e3b16fe0b59e36ead50b635291d2b"} Mar 16 17:25:48 crc kubenswrapper[5120]: I0316 17:25:48.223454 5120 scope.go:117] "RemoveContainer" containerID="34f41b200d8b95f5496297ee71e6cd239e16f0c575c9610daaf762f0efe4648c" Mar 16 17:25:48 crc kubenswrapper[5120]: I0316 17:25:48.224103 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-marketplace/certified-operators-mwlb4" podUID="23e9e1fa-7ea0-48b9-b4d7-7db1735fa8a5" containerName="registry-server" containerID="cri-o://3706452f8274db95ff98678d8b13605290b0aa6031d1d48b402b3773efb584c6" gracePeriod=2 Mar 16 17:25:48 crc kubenswrapper[5120]: I0316 17:25:48.259862 5120 scope.go:117] "RemoveContainer" containerID="d3c0746e6fca283d70987344f0d070ef1b5d89071b8fcbd1430806d49882fe21" Mar 16 17:25:48 crc kubenswrapper[5120]: I0316 17:25:48.273928 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-8c5974765-c6tkv"] Mar 16 17:25:48 crc kubenswrapper[5120]: I0316 17:25:48.282924 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-8c5974765-c6tkv"] Mar 16 17:25:48 crc kubenswrapper[5120]: I0316 17:25:48.352653 5120 scope.go:117] "RemoveContainer" containerID="34f41b200d8b95f5496297ee71e6cd239e16f0c575c9610daaf762f0efe4648c" Mar 16 17:25:48 crc kubenswrapper[5120]: E0316 17:25:48.353356 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"34f41b200d8b95f5496297ee71e6cd239e16f0c575c9610daaf762f0efe4648c\": container with ID starting with 34f41b200d8b95f5496297ee71e6cd239e16f0c575c9610daaf762f0efe4648c not found: ID does not exist" containerID="34f41b200d8b95f5496297ee71e6cd239e16f0c575c9610daaf762f0efe4648c" Mar 16 17:25:48 crc kubenswrapper[5120]: I0316 17:25:48.353406 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34f41b200d8b95f5496297ee71e6cd239e16f0c575c9610daaf762f0efe4648c"} err="failed to get container status \"34f41b200d8b95f5496297ee71e6cd239e16f0c575c9610daaf762f0efe4648c\": rpc error: code = NotFound desc = could not find container \"34f41b200d8b95f5496297ee71e6cd239e16f0c575c9610daaf762f0efe4648c\": container with ID starting with 34f41b200d8b95f5496297ee71e6cd239e16f0c575c9610daaf762f0efe4648c not found: ID does not exist" Mar 16 17:25:48 crc kubenswrapper[5120]: I0316 17:25:48.353439 5120 scope.go:117] "RemoveContainer" containerID="d3c0746e6fca283d70987344f0d070ef1b5d89071b8fcbd1430806d49882fe21" Mar 16 17:25:48 crc kubenswrapper[5120]: E0316 17:25:48.353829 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d3c0746e6fca283d70987344f0d070ef1b5d89071b8fcbd1430806d49882fe21\": container with ID starting with d3c0746e6fca283d70987344f0d070ef1b5d89071b8fcbd1430806d49882fe21 not found: ID does not exist" containerID="d3c0746e6fca283d70987344f0d070ef1b5d89071b8fcbd1430806d49882fe21" Mar 16 17:25:48 crc kubenswrapper[5120]: I0316 17:25:48.353909 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3c0746e6fca283d70987344f0d070ef1b5d89071b8fcbd1430806d49882fe21"} err="failed to get container status \"d3c0746e6fca283d70987344f0d070ef1b5d89071b8fcbd1430806d49882fe21\": rpc error: code = NotFound desc = could not find container \"d3c0746e6fca283d70987344f0d070ef1b5d89071b8fcbd1430806d49882fe21\": container with ID starting with d3c0746e6fca283d70987344f0d070ef1b5d89071b8fcbd1430806d49882fe21 not found: ID does not exist" Mar 16 17:25:48 crc kubenswrapper[5120]: I0316 17:25:48.679935 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3624a599-2ea0-41fa-931f-9258d899b82e" path="/var/lib/kubelet/pods/3624a599-2ea0-41fa-931f-9258d899b82e/volumes" Mar 16 17:25:48 crc kubenswrapper[5120]: I0316 17:25:48.705357 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-mwlb4" Mar 16 17:25:48 crc kubenswrapper[5120]: I0316 17:25:48.809593 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/23e9e1fa-7ea0-48b9-b4d7-7db1735fa8a5-utilities\") pod \"23e9e1fa-7ea0-48b9-b4d7-7db1735fa8a5\" (UID: \"23e9e1fa-7ea0-48b9-b4d7-7db1735fa8a5\") " Mar 16 17:25:48 crc kubenswrapper[5120]: I0316 17:25:48.809832 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b99d5\" (UniqueName: \"kubernetes.io/projected/23e9e1fa-7ea0-48b9-b4d7-7db1735fa8a5-kube-api-access-b99d5\") pod \"23e9e1fa-7ea0-48b9-b4d7-7db1735fa8a5\" (UID: \"23e9e1fa-7ea0-48b9-b4d7-7db1735fa8a5\") " Mar 16 17:25:48 crc kubenswrapper[5120]: I0316 17:25:48.809888 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/23e9e1fa-7ea0-48b9-b4d7-7db1735fa8a5-catalog-content\") pod \"23e9e1fa-7ea0-48b9-b4d7-7db1735fa8a5\" (UID: \"23e9e1fa-7ea0-48b9-b4d7-7db1735fa8a5\") " Mar 16 17:25:48 crc kubenswrapper[5120]: I0316 17:25:48.810723 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23e9e1fa-7ea0-48b9-b4d7-7db1735fa8a5-utilities" (OuterVolumeSpecName: "utilities") pod "23e9e1fa-7ea0-48b9-b4d7-7db1735fa8a5" (UID: "23e9e1fa-7ea0-48b9-b4d7-7db1735fa8a5"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:25:48 crc kubenswrapper[5120]: I0316 17:25:48.814562 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23e9e1fa-7ea0-48b9-b4d7-7db1735fa8a5-kube-api-access-b99d5" (OuterVolumeSpecName: "kube-api-access-b99d5") pod "23e9e1fa-7ea0-48b9-b4d7-7db1735fa8a5" (UID: "23e9e1fa-7ea0-48b9-b4d7-7db1735fa8a5"). InnerVolumeSpecName "kube-api-access-b99d5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:25:48 crc kubenswrapper[5120]: I0316 17:25:48.912723 5120 reconciler_common.go:299] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/23e9e1fa-7ea0-48b9-b4d7-7db1735fa8a5-utilities\") on node \"crc\" DevicePath \"\"" Mar 16 17:25:48 crc kubenswrapper[5120]: I0316 17:25:48.912781 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b99d5\" (UniqueName: \"kubernetes.io/projected/23e9e1fa-7ea0-48b9-b4d7-7db1735fa8a5-kube-api-access-b99d5\") on node \"crc\" DevicePath \"\"" Mar 16 17:25:48 crc kubenswrapper[5120]: I0316 17:25:48.963401 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23e9e1fa-7ea0-48b9-b4d7-7db1735fa8a5-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "23e9e1fa-7ea0-48b9-b4d7-7db1735fa8a5" (UID: "23e9e1fa-7ea0-48b9-b4d7-7db1735fa8a5"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:25:49 crc kubenswrapper[5120]: I0316 17:25:49.014566 5120 reconciler_common.go:299] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/23e9e1fa-7ea0-48b9-b4d7-7db1735fa8a5-catalog-content\") on node \"crc\" DevicePath \"\"" Mar 16 17:25:49 crc kubenswrapper[5120]: I0316 17:25:49.246403 5120 generic.go:358] "Generic (PLEG): container finished" podID="23e9e1fa-7ea0-48b9-b4d7-7db1735fa8a5" containerID="3706452f8274db95ff98678d8b13605290b0aa6031d1d48b402b3773efb584c6" exitCode=0 Mar 16 17:25:49 crc kubenswrapper[5120]: I0316 17:25:49.246482 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-mwlb4" event={"ID":"23e9e1fa-7ea0-48b9-b4d7-7db1735fa8a5","Type":"ContainerDied","Data":"3706452f8274db95ff98678d8b13605290b0aa6031d1d48b402b3773efb584c6"} Mar 16 17:25:49 crc kubenswrapper[5120]: I0316 17:25:49.246511 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-mwlb4" Mar 16 17:25:49 crc kubenswrapper[5120]: I0316 17:25:49.246577 5120 scope.go:117] "RemoveContainer" containerID="3706452f8274db95ff98678d8b13605290b0aa6031d1d48b402b3773efb584c6" Mar 16 17:25:49 crc kubenswrapper[5120]: I0316 17:25:49.246560 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-mwlb4" event={"ID":"23e9e1fa-7ea0-48b9-b4d7-7db1735fa8a5","Type":"ContainerDied","Data":"a3bf5a7bbe13e98bea1a8f8df601dcca0496dc785a3b182bfeb25f3532829fab"} Mar 16 17:25:49 crc kubenswrapper[5120]: I0316 17:25:49.291966 5120 scope.go:117] "RemoveContainer" containerID="3de267825d321e8afa3d923cf1d5a8a476807600274693ee2b260d10fd3dbc3d" Mar 16 17:25:49 crc kubenswrapper[5120]: I0316 17:25:49.301416 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/certified-operators-mwlb4"] Mar 16 17:25:49 crc kubenswrapper[5120]: I0316 17:25:49.307421 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/certified-operators-mwlb4"] Mar 16 17:25:49 crc kubenswrapper[5120]: I0316 17:25:49.310901 5120 scope.go:117] "RemoveContainer" containerID="70247b1d1fbf751c44c0839720d37663a5fd8ca6d913569b945fc9ee4e5ebda6" Mar 16 17:25:49 crc kubenswrapper[5120]: I0316 17:25:49.331368 5120 scope.go:117] "RemoveContainer" containerID="3706452f8274db95ff98678d8b13605290b0aa6031d1d48b402b3773efb584c6" Mar 16 17:25:49 crc kubenswrapper[5120]: E0316 17:25:49.332739 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3706452f8274db95ff98678d8b13605290b0aa6031d1d48b402b3773efb584c6\": container with ID starting with 3706452f8274db95ff98678d8b13605290b0aa6031d1d48b402b3773efb584c6 not found: ID does not exist" containerID="3706452f8274db95ff98678d8b13605290b0aa6031d1d48b402b3773efb584c6" Mar 16 17:25:49 crc kubenswrapper[5120]: I0316 17:25:49.332796 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3706452f8274db95ff98678d8b13605290b0aa6031d1d48b402b3773efb584c6"} err="failed to get container status \"3706452f8274db95ff98678d8b13605290b0aa6031d1d48b402b3773efb584c6\": rpc error: code = NotFound desc = could not find container \"3706452f8274db95ff98678d8b13605290b0aa6031d1d48b402b3773efb584c6\": container with ID starting with 3706452f8274db95ff98678d8b13605290b0aa6031d1d48b402b3773efb584c6 not found: ID does not exist" Mar 16 17:25:49 crc kubenswrapper[5120]: I0316 17:25:49.332821 5120 scope.go:117] "RemoveContainer" containerID="3de267825d321e8afa3d923cf1d5a8a476807600274693ee2b260d10fd3dbc3d" Mar 16 17:25:49 crc kubenswrapper[5120]: E0316 17:25:49.333452 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3de267825d321e8afa3d923cf1d5a8a476807600274693ee2b260d10fd3dbc3d\": container with ID starting with 3de267825d321e8afa3d923cf1d5a8a476807600274693ee2b260d10fd3dbc3d not found: ID does not exist" containerID="3de267825d321e8afa3d923cf1d5a8a476807600274693ee2b260d10fd3dbc3d" Mar 16 17:25:49 crc kubenswrapper[5120]: I0316 17:25:49.333491 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3de267825d321e8afa3d923cf1d5a8a476807600274693ee2b260d10fd3dbc3d"} err="failed to get container status \"3de267825d321e8afa3d923cf1d5a8a476807600274693ee2b260d10fd3dbc3d\": rpc error: code = NotFound desc = could not find container \"3de267825d321e8afa3d923cf1d5a8a476807600274693ee2b260d10fd3dbc3d\": container with ID starting with 3de267825d321e8afa3d923cf1d5a8a476807600274693ee2b260d10fd3dbc3d not found: ID does not exist" Mar 16 17:25:49 crc kubenswrapper[5120]: I0316 17:25:49.333516 5120 scope.go:117] "RemoveContainer" containerID="70247b1d1fbf751c44c0839720d37663a5fd8ca6d913569b945fc9ee4e5ebda6" Mar 16 17:25:49 crc kubenswrapper[5120]: E0316 17:25:49.333923 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"70247b1d1fbf751c44c0839720d37663a5fd8ca6d913569b945fc9ee4e5ebda6\": container with ID starting with 70247b1d1fbf751c44c0839720d37663a5fd8ca6d913569b945fc9ee4e5ebda6 not found: ID does not exist" containerID="70247b1d1fbf751c44c0839720d37663a5fd8ca6d913569b945fc9ee4e5ebda6" Mar 16 17:25:49 crc kubenswrapper[5120]: I0316 17:25:49.333966 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70247b1d1fbf751c44c0839720d37663a5fd8ca6d913569b945fc9ee4e5ebda6"} err="failed to get container status \"70247b1d1fbf751c44c0839720d37663a5fd8ca6d913569b945fc9ee4e5ebda6\": rpc error: code = NotFound desc = could not find container \"70247b1d1fbf751c44c0839720d37663a5fd8ca6d913569b945fc9ee4e5ebda6\": container with ID starting with 70247b1d1fbf751c44c0839720d37663a5fd8ca6d913569b945fc9ee4e5ebda6 not found: ID does not exist" Mar 16 17:25:50 crc kubenswrapper[5120]: I0316 17:25:50.674483 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="23e9e1fa-7ea0-48b9-b4d7-7db1735fa8a5" path="/var/lib/kubelet/pods/23e9e1fa-7ea0-48b9-b4d7-7db1735fa8a5/volumes" Mar 16 17:25:52 crc kubenswrapper[5120]: I0316 17:25:52.007548 5120 patch_prober.go:28] interesting pod/machine-config-daemon-7bf76 container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 17:25:52 crc kubenswrapper[5120]: I0316 17:25:52.007615 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 17:25:52 crc kubenswrapper[5120]: I0316 17:25:52.007662 5120 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" Mar 16 17:25:52 crc kubenswrapper[5120]: I0316 17:25:52.008214 5120 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="machine-config-daemon" containerStatusID={"Type":"cri-o","ID":"705b2fc8d158c06189736fd1aaa4ad03cb7c69d2b4b29439feb0bec2c2b5228a"} pod="openshift-machine-config-operator/machine-config-daemon-7bf76" containerMessage="Container machine-config-daemon failed liveness probe, will be restarted" Mar 16 17:25:52 crc kubenswrapper[5120]: I0316 17:25:52.008275 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" containerID="cri-o://705b2fc8d158c06189736fd1aaa4ad03cb7c69d2b4b29439feb0bec2c2b5228a" gracePeriod=600 Mar 16 17:25:52 crc kubenswrapper[5120]: I0316 17:25:52.282988 5120 generic.go:358] "Generic (PLEG): container finished" podID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerID="705b2fc8d158c06189736fd1aaa4ad03cb7c69d2b4b29439feb0bec2c2b5228a" exitCode=0 Mar 16 17:25:52 crc kubenswrapper[5120]: I0316 17:25:52.283209 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" event={"ID":"e2275cb4-4905-4d66-a87e-8010120db2bd","Type":"ContainerDied","Data":"705b2fc8d158c06189736fd1aaa4ad03cb7c69d2b4b29439feb0bec2c2b5228a"} Mar 16 17:25:52 crc kubenswrapper[5120]: I0316 17:25:52.283256 5120 scope.go:117] "RemoveContainer" containerID="2ca61165dca6fdb30458423ef74c44c42b1b273e8fa504e89f5f9e186e516cc3" Mar 16 17:25:53 crc kubenswrapper[5120]: I0316 17:25:53.311682 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" event={"ID":"e2275cb4-4905-4d66-a87e-8010120db2bd","Type":"ContainerStarted","Data":"df0a87b047c8208d5fc21057efed33321f6cab49c4cf053702d222dc12979450"} Mar 16 17:25:53 crc kubenswrapper[5120]: I0316 17:25:53.444592 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-no-nodes-qpqzs"] Mar 16 17:25:53 crc kubenswrapper[5120]: I0316 17:25:53.446008 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3624a599-2ea0-41fa-931f-9258d899b82e" containerName="dnsmasq-dns" Mar 16 17:25:53 crc kubenswrapper[5120]: I0316 17:25:53.446034 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="3624a599-2ea0-41fa-931f-9258d899b82e" containerName="dnsmasq-dns" Mar 16 17:25:53 crc kubenswrapper[5120]: I0316 17:25:53.446067 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23e9e1fa-7ea0-48b9-b4d7-7db1735fa8a5" containerName="registry-server" Mar 16 17:25:53 crc kubenswrapper[5120]: I0316 17:25:53.446075 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="23e9e1fa-7ea0-48b9-b4d7-7db1735fa8a5" containerName="registry-server" Mar 16 17:25:53 crc kubenswrapper[5120]: I0316 17:25:53.446111 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23e9e1fa-7ea0-48b9-b4d7-7db1735fa8a5" containerName="extract-utilities" Mar 16 17:25:53 crc kubenswrapper[5120]: I0316 17:25:53.446118 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="23e9e1fa-7ea0-48b9-b4d7-7db1735fa8a5" containerName="extract-utilities" Mar 16 17:25:53 crc kubenswrapper[5120]: I0316 17:25:53.446138 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23e9e1fa-7ea0-48b9-b4d7-7db1735fa8a5" containerName="extract-content" Mar 16 17:25:53 crc kubenswrapper[5120]: I0316 17:25:53.446146 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="23e9e1fa-7ea0-48b9-b4d7-7db1735fa8a5" containerName="extract-content" Mar 16 17:25:53 crc kubenswrapper[5120]: I0316 17:25:53.446165 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3624a599-2ea0-41fa-931f-9258d899b82e" containerName="init" Mar 16 17:25:53 crc kubenswrapper[5120]: I0316 17:25:53.446172 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="3624a599-2ea0-41fa-931f-9258d899b82e" containerName="init" Mar 16 17:25:53 crc kubenswrapper[5120]: I0316 17:25:53.446328 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="23e9e1fa-7ea0-48b9-b4d7-7db1735fa8a5" containerName="registry-server" Mar 16 17:25:53 crc kubenswrapper[5120]: I0316 17:25:53.446355 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="3624a599-2ea0-41fa-931f-9258d899b82e" containerName="dnsmasq-dns" Mar 16 17:25:53 crc kubenswrapper[5120]: I0316 17:25:53.452514 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-beta-nodeset8hsbf"] Mar 16 17:25:53 crc kubenswrapper[5120]: I0316 17:25:53.452656 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-no-nodes-qpqzs" Mar 16 17:25:53 crc kubenswrapper[5120]: I0316 17:25:53.457290 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-beta-nodeset8hsbf" Mar 16 17:25:53 crc kubenswrapper[5120]: I0316 17:25:53.458668 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-no-nodes-qpqzs"] Mar 16 17:25:53 crc kubenswrapper[5120]: I0316 17:25:53.465233 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-beta-nodeset8hsbf"] Mar 16 17:25:53 crc kubenswrapper[5120]: I0316 17:25:53.471430 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplanenodeset-edpm-compute-no-nodes\"" Mar 16 17:25:53 crc kubenswrapper[5120]: I0316 17:25:53.471526 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"edpm-compute-beta-nodeset-dockercfg-dcm6g\"" Mar 16 17:25:53 crc kubenswrapper[5120]: I0316 17:25:53.471564 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-aee-default-env\"" Mar 16 17:25:53 crc kubenswrapper[5120]: I0316 17:25:53.471729 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplanenodeset-edpm-compute-beta-nodeset\"" Mar 16 17:25:53 crc kubenswrapper[5120]: I0316 17:25:53.471743 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplane-ansible-ssh-private-key-secret\"" Mar 16 17:25:53 crc kubenswrapper[5120]: I0316 17:25:53.471893 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"edpm-compute-no-nodes-dockercfg-znndh\"" Mar 16 17:25:53 crc kubenswrapper[5120]: I0316 17:25:53.511924 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/fd217e20-4685-4030-9826-ada1bc0b7650-inventory\") pod \"download-cache-edpm-multinodeset-edpm-compute-no-nodes-qpqzs\" (UID: \"fd217e20-4685-4030-9826-ada1bc0b7650\") " pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-no-nodes-qpqzs" Mar 16 17:25:53 crc kubenswrapper[5120]: I0316 17:25:53.511988 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key-edpm-compute-beta-nodeset\" (UniqueName: \"kubernetes.io/secret/7245ce74-f002-41c9-898b-ae0c6c86a954-ssh-key-edpm-compute-beta-nodeset\") pod \"download-cache-edpm-multinodeset-edpm-compute-beta-nodeset8hsbf\" (UID: \"7245ce74-f002-41c9-898b-ae0c6c86a954\") " pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-beta-nodeset8hsbf" Mar 16 17:25:53 crc kubenswrapper[5120]: I0316 17:25:53.512088 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkxnd\" (UniqueName: \"kubernetes.io/projected/fd217e20-4685-4030-9826-ada1bc0b7650-kube-api-access-kkxnd\") pod \"download-cache-edpm-multinodeset-edpm-compute-no-nodes-qpqzs\" (UID: \"fd217e20-4685-4030-9826-ada1bc0b7650\") " pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-no-nodes-qpqzs" Mar 16 17:25:53 crc kubenswrapper[5120]: I0316 17:25:53.512270 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btl5p\" (UniqueName: \"kubernetes.io/projected/7245ce74-f002-41c9-898b-ae0c6c86a954-kube-api-access-btl5p\") pod \"download-cache-edpm-multinodeset-edpm-compute-beta-nodeset8hsbf\" (UID: \"7245ce74-f002-41c9-898b-ae0c6c86a954\") " pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-beta-nodeset8hsbf" Mar 16 17:25:53 crc kubenswrapper[5120]: I0316 17:25:53.512306 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/fd217e20-4685-4030-9826-ada1bc0b7650-ssh-key-edpm-compute-no-nodes\") pod \"download-cache-edpm-multinodeset-edpm-compute-no-nodes-qpqzs\" (UID: \"fd217e20-4685-4030-9826-ada1bc0b7650\") " pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-no-nodes-qpqzs" Mar 16 17:25:53 crc kubenswrapper[5120]: I0316 17:25:53.512395 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/7245ce74-f002-41c9-898b-ae0c6c86a954-inventory\") pod \"download-cache-edpm-multinodeset-edpm-compute-beta-nodeset8hsbf\" (UID: \"7245ce74-f002-41c9-898b-ae0c6c86a954\") " pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-beta-nodeset8hsbf" Mar 16 17:25:53 crc kubenswrapper[5120]: I0316 17:25:53.614745 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-btl5p\" (UniqueName: \"kubernetes.io/projected/7245ce74-f002-41c9-898b-ae0c6c86a954-kube-api-access-btl5p\") pod \"download-cache-edpm-multinodeset-edpm-compute-beta-nodeset8hsbf\" (UID: \"7245ce74-f002-41c9-898b-ae0c6c86a954\") " pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-beta-nodeset8hsbf" Mar 16 17:25:53 crc kubenswrapper[5120]: I0316 17:25:53.614870 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/fd217e20-4685-4030-9826-ada1bc0b7650-ssh-key-edpm-compute-no-nodes\") pod \"download-cache-edpm-multinodeset-edpm-compute-no-nodes-qpqzs\" (UID: \"fd217e20-4685-4030-9826-ada1bc0b7650\") " pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-no-nodes-qpqzs" Mar 16 17:25:53 crc kubenswrapper[5120]: I0316 17:25:53.614907 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/7245ce74-f002-41c9-898b-ae0c6c86a954-inventory\") pod \"download-cache-edpm-multinodeset-edpm-compute-beta-nodeset8hsbf\" (UID: \"7245ce74-f002-41c9-898b-ae0c6c86a954\") " pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-beta-nodeset8hsbf" Mar 16 17:25:53 crc kubenswrapper[5120]: I0316 17:25:53.615015 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/fd217e20-4685-4030-9826-ada1bc0b7650-inventory\") pod \"download-cache-edpm-multinodeset-edpm-compute-no-nodes-qpqzs\" (UID: \"fd217e20-4685-4030-9826-ada1bc0b7650\") " pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-no-nodes-qpqzs" Mar 16 17:25:53 crc kubenswrapper[5120]: I0316 17:25:53.615077 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ssh-key-edpm-compute-beta-nodeset\" (UniqueName: \"kubernetes.io/secret/7245ce74-f002-41c9-898b-ae0c6c86a954-ssh-key-edpm-compute-beta-nodeset\") pod \"download-cache-edpm-multinodeset-edpm-compute-beta-nodeset8hsbf\" (UID: \"7245ce74-f002-41c9-898b-ae0c6c86a954\") " pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-beta-nodeset8hsbf" Mar 16 17:25:53 crc kubenswrapper[5120]: I0316 17:25:53.615175 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kkxnd\" (UniqueName: \"kubernetes.io/projected/fd217e20-4685-4030-9826-ada1bc0b7650-kube-api-access-kkxnd\") pod \"download-cache-edpm-multinodeset-edpm-compute-no-nodes-qpqzs\" (UID: \"fd217e20-4685-4030-9826-ada1bc0b7650\") " pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-no-nodes-qpqzs" Mar 16 17:25:53 crc kubenswrapper[5120]: I0316 17:25:53.621158 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ssh-key-edpm-compute-beta-nodeset\" (UniqueName: \"kubernetes.io/secret/7245ce74-f002-41c9-898b-ae0c6c86a954-ssh-key-edpm-compute-beta-nodeset\") pod \"download-cache-edpm-multinodeset-edpm-compute-beta-nodeset8hsbf\" (UID: \"7245ce74-f002-41c9-898b-ae0c6c86a954\") " pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-beta-nodeset8hsbf" Mar 16 17:25:53 crc kubenswrapper[5120]: I0316 17:25:53.621186 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/fd217e20-4685-4030-9826-ada1bc0b7650-inventory\") pod \"download-cache-edpm-multinodeset-edpm-compute-no-nodes-qpqzs\" (UID: \"fd217e20-4685-4030-9826-ada1bc0b7650\") " pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-no-nodes-qpqzs" Mar 16 17:25:53 crc kubenswrapper[5120]: I0316 17:25:53.623386 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/fd217e20-4685-4030-9826-ada1bc0b7650-ssh-key-edpm-compute-no-nodes\") pod \"download-cache-edpm-multinodeset-edpm-compute-no-nodes-qpqzs\" (UID: \"fd217e20-4685-4030-9826-ada1bc0b7650\") " pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-no-nodes-qpqzs" Mar 16 17:25:53 crc kubenswrapper[5120]: I0316 17:25:53.623439 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/7245ce74-f002-41c9-898b-ae0c6c86a954-inventory\") pod \"download-cache-edpm-multinodeset-edpm-compute-beta-nodeset8hsbf\" (UID: \"7245ce74-f002-41c9-898b-ae0c6c86a954\") " pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-beta-nodeset8hsbf" Mar 16 17:25:53 crc kubenswrapper[5120]: I0316 17:25:53.632863 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkxnd\" (UniqueName: \"kubernetes.io/projected/fd217e20-4685-4030-9826-ada1bc0b7650-kube-api-access-kkxnd\") pod \"download-cache-edpm-multinodeset-edpm-compute-no-nodes-qpqzs\" (UID: \"fd217e20-4685-4030-9826-ada1bc0b7650\") " pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-no-nodes-qpqzs" Mar 16 17:25:53 crc kubenswrapper[5120]: I0316 17:25:53.633716 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-btl5p\" (UniqueName: \"kubernetes.io/projected/7245ce74-f002-41c9-898b-ae0c6c86a954-kube-api-access-btl5p\") pod \"download-cache-edpm-multinodeset-edpm-compute-beta-nodeset8hsbf\" (UID: \"7245ce74-f002-41c9-898b-ae0c6c86a954\") " pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-beta-nodeset8hsbf" Mar 16 17:25:53 crc kubenswrapper[5120]: I0316 17:25:53.786401 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-no-nodes-qpqzs" Mar 16 17:25:53 crc kubenswrapper[5120]: I0316 17:25:53.791902 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-beta-nodeset8hsbf" Mar 16 17:25:54 crc kubenswrapper[5120]: I0316 17:25:54.074708 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-beta-nodeset8hsbf"] Mar 16 17:25:54 crc kubenswrapper[5120]: I0316 17:25:54.324993 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-beta-nodeset8hsbf" event={"ID":"7245ce74-f002-41c9-898b-ae0c6c86a954","Type":"ContainerStarted","Data":"ef9168fd05441362ba447656f80da58f77ee1c4506794d4ed2661fafadd0456c"} Mar 16 17:25:54 crc kubenswrapper[5120]: W0316 17:25:54.379338 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfd217e20_4685_4030_9826_ada1bc0b7650.slice/crio-f29d0456ddc93cc3a04a4f3e92161c488c893df92d79816ff9c83d9789299fea WatchSource:0}: Error finding container f29d0456ddc93cc3a04a4f3e92161c488c893df92d79816ff9c83d9789299fea: Status 404 returned error can't find the container with id f29d0456ddc93cc3a04a4f3e92161c488c893df92d79816ff9c83d9789299fea Mar 16 17:25:54 crc kubenswrapper[5120]: I0316 17:25:54.385697 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-no-nodes-qpqzs"] Mar 16 17:25:55 crc kubenswrapper[5120]: I0316 17:25:55.339546 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-no-nodes-qpqzs" event={"ID":"fd217e20-4685-4030-9826-ada1bc0b7650","Type":"ContainerStarted","Data":"7710156ac8fe96e119e2d8f3bef47b44fe2594248dd67e18d61bb54b9ff58103"} Mar 16 17:25:55 crc kubenswrapper[5120]: I0316 17:25:55.339614 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-no-nodes-qpqzs" event={"ID":"fd217e20-4685-4030-9826-ada1bc0b7650","Type":"ContainerStarted","Data":"f29d0456ddc93cc3a04a4f3e92161c488c893df92d79816ff9c83d9789299fea"} Mar 16 17:25:55 crc kubenswrapper[5120]: I0316 17:25:55.342117 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-beta-nodeset8hsbf" event={"ID":"7245ce74-f002-41c9-898b-ae0c6c86a954","Type":"ContainerStarted","Data":"3703139c869bdad87cbe3ab996720f42bc161c53750ebba2f16bd6faaab6499d"} Mar 16 17:25:55 crc kubenswrapper[5120]: I0316 17:25:55.355493 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-no-nodes-qpqzs" podStartSLOduration=1.6911703340000002 podStartE2EDuration="2.355472176s" podCreationTimestamp="2026-03-16 17:25:53 +0000 UTC" firstStartedPulling="2026-03-16 17:25:54.380396502 +0000 UTC m=+6856.534328159" lastFinishedPulling="2026-03-16 17:25:55.044698344 +0000 UTC m=+6857.198630001" observedRunningTime="2026-03-16 17:25:55.353962235 +0000 UTC m=+6857.507893892" watchObservedRunningTime="2026-03-16 17:25:55.355472176 +0000 UTC m=+6857.509403833" Mar 16 17:25:55 crc kubenswrapper[5120]: I0316 17:25:55.373449 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-beta-nodeset8hsbf" podStartSLOduration=1.9117731519999999 podStartE2EDuration="2.373430997s" podCreationTimestamp="2026-03-16 17:25:53 +0000 UTC" firstStartedPulling="2026-03-16 17:25:54.082634486 +0000 UTC m=+6856.236566143" lastFinishedPulling="2026-03-16 17:25:54.544292331 +0000 UTC m=+6856.698223988" observedRunningTime="2026-03-16 17:25:55.369087388 +0000 UTC m=+6857.523019045" watchObservedRunningTime="2026-03-16 17:25:55.373430997 +0000 UTC m=+6857.527362654" Mar 16 17:25:56 crc kubenswrapper[5120]: I0316 17:25:56.353852 5120 generic.go:358] "Generic (PLEG): container finished" podID="fd217e20-4685-4030-9826-ada1bc0b7650" containerID="7710156ac8fe96e119e2d8f3bef47b44fe2594248dd67e18d61bb54b9ff58103" exitCode=0 Mar 16 17:25:56 crc kubenswrapper[5120]: I0316 17:25:56.353898 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-no-nodes-qpqzs" event={"ID":"fd217e20-4685-4030-9826-ada1bc0b7650","Type":"ContainerDied","Data":"7710156ac8fe96e119e2d8f3bef47b44fe2594248dd67e18d61bb54b9ff58103"} Mar 16 17:25:56 crc kubenswrapper[5120]: I0316 17:25:56.355691 5120 generic.go:358] "Generic (PLEG): container finished" podID="7245ce74-f002-41c9-898b-ae0c6c86a954" containerID="3703139c869bdad87cbe3ab996720f42bc161c53750ebba2f16bd6faaab6499d" exitCode=0 Mar 16 17:25:56 crc kubenswrapper[5120]: I0316 17:25:56.355844 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-beta-nodeset8hsbf" event={"ID":"7245ce74-f002-41c9-898b-ae0c6c86a954","Type":"ContainerDied","Data":"3703139c869bdad87cbe3ab996720f42bc161c53750ebba2f16bd6faaab6499d"} Mar 16 17:25:57 crc kubenswrapper[5120]: I0316 17:25:57.684169 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-beta-nodeset8hsbf" Mar 16 17:25:57 crc kubenswrapper[5120]: I0316 17:25:57.694626 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-no-nodes-qpqzs" Mar 16 17:25:57 crc kubenswrapper[5120]: I0316 17:25:57.814713 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/fd217e20-4685-4030-9826-ada1bc0b7650-inventory\") pod \"fd217e20-4685-4030-9826-ada1bc0b7650\" (UID: \"fd217e20-4685-4030-9826-ada1bc0b7650\") " Mar 16 17:25:57 crc kubenswrapper[5120]: I0316 17:25:57.814971 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kkxnd\" (UniqueName: \"kubernetes.io/projected/fd217e20-4685-4030-9826-ada1bc0b7650-kube-api-access-kkxnd\") pod \"fd217e20-4685-4030-9826-ada1bc0b7650\" (UID: \"fd217e20-4685-4030-9826-ada1bc0b7650\") " Mar 16 17:25:57 crc kubenswrapper[5120]: I0316 17:25:57.815054 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ssh-key-edpm-compute-beta-nodeset\" (UniqueName: \"kubernetes.io/secret/7245ce74-f002-41c9-898b-ae0c6c86a954-ssh-key-edpm-compute-beta-nodeset\") pod \"7245ce74-f002-41c9-898b-ae0c6c86a954\" (UID: \"7245ce74-f002-41c9-898b-ae0c6c86a954\") " Mar 16 17:25:57 crc kubenswrapper[5120]: I0316 17:25:57.815181 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/fd217e20-4685-4030-9826-ada1bc0b7650-ssh-key-edpm-compute-no-nodes\") pod \"fd217e20-4685-4030-9826-ada1bc0b7650\" (UID: \"fd217e20-4685-4030-9826-ada1bc0b7650\") " Mar 16 17:25:57 crc kubenswrapper[5120]: I0316 17:25:57.815279 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-btl5p\" (UniqueName: \"kubernetes.io/projected/7245ce74-f002-41c9-898b-ae0c6c86a954-kube-api-access-btl5p\") pod \"7245ce74-f002-41c9-898b-ae0c6c86a954\" (UID: \"7245ce74-f002-41c9-898b-ae0c6c86a954\") " Mar 16 17:25:57 crc kubenswrapper[5120]: I0316 17:25:57.815341 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/7245ce74-f002-41c9-898b-ae0c6c86a954-inventory\") pod \"7245ce74-f002-41c9-898b-ae0c6c86a954\" (UID: \"7245ce74-f002-41c9-898b-ae0c6c86a954\") " Mar 16 17:25:57 crc kubenswrapper[5120]: I0316 17:25:57.823295 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7245ce74-f002-41c9-898b-ae0c6c86a954-kube-api-access-btl5p" (OuterVolumeSpecName: "kube-api-access-btl5p") pod "7245ce74-f002-41c9-898b-ae0c6c86a954" (UID: "7245ce74-f002-41c9-898b-ae0c6c86a954"). InnerVolumeSpecName "kube-api-access-btl5p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:25:57 crc kubenswrapper[5120]: I0316 17:25:57.823252 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd217e20-4685-4030-9826-ada1bc0b7650-kube-api-access-kkxnd" (OuterVolumeSpecName: "kube-api-access-kkxnd") pod "fd217e20-4685-4030-9826-ada1bc0b7650" (UID: "fd217e20-4685-4030-9826-ada1bc0b7650"). InnerVolumeSpecName "kube-api-access-kkxnd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:25:57 crc kubenswrapper[5120]: I0316 17:25:57.838419 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fd217e20-4685-4030-9826-ada1bc0b7650-ssh-key-edpm-compute-no-nodes" (OuterVolumeSpecName: "ssh-key-edpm-compute-no-nodes") pod "fd217e20-4685-4030-9826-ada1bc0b7650" (UID: "fd217e20-4685-4030-9826-ada1bc0b7650"). InnerVolumeSpecName "ssh-key-edpm-compute-no-nodes". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:25:57 crc kubenswrapper[5120]: I0316 17:25:57.838745 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7245ce74-f002-41c9-898b-ae0c6c86a954-ssh-key-edpm-compute-beta-nodeset" (OuterVolumeSpecName: "ssh-key-edpm-compute-beta-nodeset") pod "7245ce74-f002-41c9-898b-ae0c6c86a954" (UID: "7245ce74-f002-41c9-898b-ae0c6c86a954"). InnerVolumeSpecName "ssh-key-edpm-compute-beta-nodeset". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:25:57 crc kubenswrapper[5120]: I0316 17:25:57.839322 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fd217e20-4685-4030-9826-ada1bc0b7650-inventory" (OuterVolumeSpecName: "inventory") pod "fd217e20-4685-4030-9826-ada1bc0b7650" (UID: "fd217e20-4685-4030-9826-ada1bc0b7650"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:25:57 crc kubenswrapper[5120]: I0316 17:25:57.842610 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7245ce74-f002-41c9-898b-ae0c6c86a954-inventory" (OuterVolumeSpecName: "inventory") pod "7245ce74-f002-41c9-898b-ae0c6c86a954" (UID: "7245ce74-f002-41c9-898b-ae0c6c86a954"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:25:57 crc kubenswrapper[5120]: I0316 17:25:57.917956 5120 reconciler_common.go:299] "Volume detached for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/fd217e20-4685-4030-9826-ada1bc0b7650-ssh-key-edpm-compute-no-nodes\") on node \"crc\" DevicePath \"\"" Mar 16 17:25:57 crc kubenswrapper[5120]: I0316 17:25:57.917986 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-btl5p\" (UniqueName: \"kubernetes.io/projected/7245ce74-f002-41c9-898b-ae0c6c86a954-kube-api-access-btl5p\") on node \"crc\" DevicePath \"\"" Mar 16 17:25:57 crc kubenswrapper[5120]: I0316 17:25:57.918000 5120 reconciler_common.go:299] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/7245ce74-f002-41c9-898b-ae0c6c86a954-inventory\") on node \"crc\" DevicePath \"\"" Mar 16 17:25:57 crc kubenswrapper[5120]: I0316 17:25:57.918009 5120 reconciler_common.go:299] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/fd217e20-4685-4030-9826-ada1bc0b7650-inventory\") on node \"crc\" DevicePath \"\"" Mar 16 17:25:57 crc kubenswrapper[5120]: I0316 17:25:57.918020 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kkxnd\" (UniqueName: \"kubernetes.io/projected/fd217e20-4685-4030-9826-ada1bc0b7650-kube-api-access-kkxnd\") on node \"crc\" DevicePath \"\"" Mar 16 17:25:57 crc kubenswrapper[5120]: I0316 17:25:57.918031 5120 reconciler_common.go:299] "Volume detached for volume \"ssh-key-edpm-compute-beta-nodeset\" (UniqueName: \"kubernetes.io/secret/7245ce74-f002-41c9-898b-ae0c6c86a954-ssh-key-edpm-compute-beta-nodeset\") on node \"crc\" DevicePath \"\"" Mar 16 17:25:58 crc kubenswrapper[5120]: I0316 17:25:58.376379 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-beta-nodeset8hsbf" event={"ID":"7245ce74-f002-41c9-898b-ae0c6c86a954","Type":"ContainerDied","Data":"ef9168fd05441362ba447656f80da58f77ee1c4506794d4ed2661fafadd0456c"} Mar 16 17:25:58 crc kubenswrapper[5120]: I0316 17:25:58.376447 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ef9168fd05441362ba447656f80da58f77ee1c4506794d4ed2661fafadd0456c" Mar 16 17:25:58 crc kubenswrapper[5120]: I0316 17:25:58.376558 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-beta-nodeset8hsbf" Mar 16 17:25:58 crc kubenswrapper[5120]: I0316 17:25:58.381930 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-no-nodes-qpqzs" event={"ID":"fd217e20-4685-4030-9826-ada1bc0b7650","Type":"ContainerDied","Data":"f29d0456ddc93cc3a04a4f3e92161c488c893df92d79816ff9c83d9789299fea"} Mar 16 17:25:58 crc kubenswrapper[5120]: I0316 17:25:58.381999 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f29d0456ddc93cc3a04a4f3e92161c488c893df92d79816ff9c83d9789299fea" Mar 16 17:25:58 crc kubenswrapper[5120]: I0316 17:25:58.382099 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-no-nodes-qpqzs" Mar 16 17:25:58 crc kubenswrapper[5120]: I0316 17:25:58.454836 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-no-nodes-88vsp"] Mar 16 17:25:58 crc kubenswrapper[5120]: I0316 17:25:58.455701 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7245ce74-f002-41c9-898b-ae0c6c86a954" containerName="download-cache-edpm-multinodeset-edpm-compute-beta-nodeset" Mar 16 17:25:58 crc kubenswrapper[5120]: I0316 17:25:58.455724 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7245ce74-f002-41c9-898b-ae0c6c86a954" containerName="download-cache-edpm-multinodeset-edpm-compute-beta-nodeset" Mar 16 17:25:58 crc kubenswrapper[5120]: I0316 17:25:58.455746 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd217e20-4685-4030-9826-ada1bc0b7650" containerName="download-cache-edpm-multinodeset-edpm-compute-no-nodes" Mar 16 17:25:58 crc kubenswrapper[5120]: I0316 17:25:58.455770 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd217e20-4685-4030-9826-ada1bc0b7650" containerName="download-cache-edpm-multinodeset-edpm-compute-no-nodes" Mar 16 17:25:58 crc kubenswrapper[5120]: I0316 17:25:58.455923 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="fd217e20-4685-4030-9826-ada1bc0b7650" containerName="download-cache-edpm-multinodeset-edpm-compute-no-nodes" Mar 16 17:25:58 crc kubenswrapper[5120]: I0316 17:25:58.455945 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7245ce74-f002-41c9-898b-ae0c6c86a954" containerName="download-cache-edpm-multinodeset-edpm-compute-beta-nodeset" Mar 16 17:25:58 crc kubenswrapper[5120]: I0316 17:25:58.462875 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-no-nodes-88vsp" Mar 16 17:25:58 crc kubenswrapper[5120]: I0316 17:25:58.463111 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-gxxnc"] Mar 16 17:25:58 crc kubenswrapper[5120]: I0316 17:25:58.467598 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"combined-ca-bundle\"" Mar 16 17:25:58 crc kubenswrapper[5120]: I0316 17:25:58.467603 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-aee-default-env\"" Mar 16 17:25:58 crc kubenswrapper[5120]: I0316 17:25:58.467629 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplanenodeset-edpm-compute-no-nodes\"" Mar 16 17:25:58 crc kubenswrapper[5120]: I0316 17:25:58.467719 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplane-ansible-ssh-private-key-secret\"" Mar 16 17:25:58 crc kubenswrapper[5120]: I0316 17:25:58.467936 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"edpm-compute-no-nodes-dockercfg-znndh\"" Mar 16 17:25:58 crc kubenswrapper[5120]: I0316 17:25:58.471235 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-gxxnc" Mar 16 17:25:58 crc kubenswrapper[5120]: I0316 17:25:58.473065 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"edpm-compute-beta-nodeset-dockercfg-dcm6g\"" Mar 16 17:25:58 crc kubenswrapper[5120]: I0316 17:25:58.474340 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplanenodeset-edpm-compute-beta-nodeset\"" Mar 16 17:25:58 crc kubenswrapper[5120]: I0316 17:25:58.479452 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-no-nodes-88vsp"] Mar 16 17:25:58 crc kubenswrapper[5120]: I0316 17:25:58.489922 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-gxxnc"] Mar 16 17:25:58 crc kubenswrapper[5120]: I0316 17:25:58.632260 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bootstrap-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/accda91b-7614-4daf-a050-40cba5ced680-bootstrap-combined-ca-bundle\") pod \"bootstrap-edpm-multinodeset-edpm-compute-no-nodes-88vsp\" (UID: \"accda91b-7614-4daf-a050-40cba5ced680\") " pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-no-nodes-88vsp" Mar 16 17:25:58 crc kubenswrapper[5120]: I0316 17:25:58.632320 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46qqg\" (UniqueName: \"kubernetes.io/projected/accda91b-7614-4daf-a050-40cba5ced680-kube-api-access-46qqg\") pod \"bootstrap-edpm-multinodeset-edpm-compute-no-nodes-88vsp\" (UID: \"accda91b-7614-4daf-a050-40cba5ced680\") " pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-no-nodes-88vsp" Mar 16 17:25:58 crc kubenswrapper[5120]: I0316 17:25:58.632385 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bootstrap-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d1492ea4-a300-4dfa-b156-cca634cca18d-bootstrap-combined-ca-bundle\") pod \"bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-gxxnc\" (UID: \"d1492ea4-a300-4dfa-b156-cca634cca18d\") " pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-gxxnc" Mar 16 17:25:58 crc kubenswrapper[5120]: I0316 17:25:58.632446 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key-edpm-compute-beta-nodeset\" (UniqueName: \"kubernetes.io/secret/d1492ea4-a300-4dfa-b156-cca634cca18d-ssh-key-edpm-compute-beta-nodeset\") pod \"bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-gxxnc\" (UID: \"d1492ea4-a300-4dfa-b156-cca634cca18d\") " pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-gxxnc" Mar 16 17:25:58 crc kubenswrapper[5120]: I0316 17:25:58.632541 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/accda91b-7614-4daf-a050-40cba5ced680-ssh-key-edpm-compute-no-nodes\") pod \"bootstrap-edpm-multinodeset-edpm-compute-no-nodes-88vsp\" (UID: \"accda91b-7614-4daf-a050-40cba5ced680\") " pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-no-nodes-88vsp" Mar 16 17:25:58 crc kubenswrapper[5120]: I0316 17:25:58.632564 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/accda91b-7614-4daf-a050-40cba5ced680-inventory\") pod \"bootstrap-edpm-multinodeset-edpm-compute-no-nodes-88vsp\" (UID: \"accda91b-7614-4daf-a050-40cba5ced680\") " pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-no-nodes-88vsp" Mar 16 17:25:58 crc kubenswrapper[5120]: I0316 17:25:58.632583 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g274z\" (UniqueName: \"kubernetes.io/projected/d1492ea4-a300-4dfa-b156-cca634cca18d-kube-api-access-g274z\") pod \"bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-gxxnc\" (UID: \"d1492ea4-a300-4dfa-b156-cca634cca18d\") " pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-gxxnc" Mar 16 17:25:58 crc kubenswrapper[5120]: I0316 17:25:58.632726 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/d1492ea4-a300-4dfa-b156-cca634cca18d-inventory\") pod \"bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-gxxnc\" (UID: \"d1492ea4-a300-4dfa-b156-cca634cca18d\") " pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-gxxnc" Mar 16 17:25:58 crc kubenswrapper[5120]: I0316 17:25:58.735784 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/d1492ea4-a300-4dfa-b156-cca634cca18d-inventory\") pod \"bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-gxxnc\" (UID: \"d1492ea4-a300-4dfa-b156-cca634cca18d\") " pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-gxxnc" Mar 16 17:25:58 crc kubenswrapper[5120]: I0316 17:25:58.736079 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bootstrap-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/accda91b-7614-4daf-a050-40cba5ced680-bootstrap-combined-ca-bundle\") pod \"bootstrap-edpm-multinodeset-edpm-compute-no-nodes-88vsp\" (UID: \"accda91b-7614-4daf-a050-40cba5ced680\") " pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-no-nodes-88vsp" Mar 16 17:25:58 crc kubenswrapper[5120]: I0316 17:25:58.736136 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-46qqg\" (UniqueName: \"kubernetes.io/projected/accda91b-7614-4daf-a050-40cba5ced680-kube-api-access-46qqg\") pod \"bootstrap-edpm-multinodeset-edpm-compute-no-nodes-88vsp\" (UID: \"accda91b-7614-4daf-a050-40cba5ced680\") " pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-no-nodes-88vsp" Mar 16 17:25:58 crc kubenswrapper[5120]: I0316 17:25:58.736239 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bootstrap-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d1492ea4-a300-4dfa-b156-cca634cca18d-bootstrap-combined-ca-bundle\") pod \"bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-gxxnc\" (UID: \"d1492ea4-a300-4dfa-b156-cca634cca18d\") " pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-gxxnc" Mar 16 17:25:58 crc kubenswrapper[5120]: I0316 17:25:58.736340 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ssh-key-edpm-compute-beta-nodeset\" (UniqueName: \"kubernetes.io/secret/d1492ea4-a300-4dfa-b156-cca634cca18d-ssh-key-edpm-compute-beta-nodeset\") pod \"bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-gxxnc\" (UID: \"d1492ea4-a300-4dfa-b156-cca634cca18d\") " pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-gxxnc" Mar 16 17:25:58 crc kubenswrapper[5120]: I0316 17:25:58.736808 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/accda91b-7614-4daf-a050-40cba5ced680-ssh-key-edpm-compute-no-nodes\") pod \"bootstrap-edpm-multinodeset-edpm-compute-no-nodes-88vsp\" (UID: \"accda91b-7614-4daf-a050-40cba5ced680\") " pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-no-nodes-88vsp" Mar 16 17:25:58 crc kubenswrapper[5120]: I0316 17:25:58.736950 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/accda91b-7614-4daf-a050-40cba5ced680-inventory\") pod \"bootstrap-edpm-multinodeset-edpm-compute-no-nodes-88vsp\" (UID: \"accda91b-7614-4daf-a050-40cba5ced680\") " pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-no-nodes-88vsp" Mar 16 17:25:58 crc kubenswrapper[5120]: I0316 17:25:58.736997 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g274z\" (UniqueName: \"kubernetes.io/projected/d1492ea4-a300-4dfa-b156-cca634cca18d-kube-api-access-g274z\") pod \"bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-gxxnc\" (UID: \"d1492ea4-a300-4dfa-b156-cca634cca18d\") " pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-gxxnc" Mar 16 17:25:58 crc kubenswrapper[5120]: I0316 17:25:58.742050 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bootstrap-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d1492ea4-a300-4dfa-b156-cca634cca18d-bootstrap-combined-ca-bundle\") pod \"bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-gxxnc\" (UID: \"d1492ea4-a300-4dfa-b156-cca634cca18d\") " pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-gxxnc" Mar 16 17:25:58 crc kubenswrapper[5120]: I0316 17:25:58.751019 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/d1492ea4-a300-4dfa-b156-cca634cca18d-inventory\") pod \"bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-gxxnc\" (UID: \"d1492ea4-a300-4dfa-b156-cca634cca18d\") " pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-gxxnc" Mar 16 17:25:58 crc kubenswrapper[5120]: I0316 17:25:58.751129 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/accda91b-7614-4daf-a050-40cba5ced680-inventory\") pod \"bootstrap-edpm-multinodeset-edpm-compute-no-nodes-88vsp\" (UID: \"accda91b-7614-4daf-a050-40cba5ced680\") " pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-no-nodes-88vsp" Mar 16 17:25:58 crc kubenswrapper[5120]: I0316 17:25:58.752879 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/accda91b-7614-4daf-a050-40cba5ced680-ssh-key-edpm-compute-no-nodes\") pod \"bootstrap-edpm-multinodeset-edpm-compute-no-nodes-88vsp\" (UID: \"accda91b-7614-4daf-a050-40cba5ced680\") " pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-no-nodes-88vsp" Mar 16 17:25:58 crc kubenswrapper[5120]: I0316 17:25:58.752923 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ssh-key-edpm-compute-beta-nodeset\" (UniqueName: \"kubernetes.io/secret/d1492ea4-a300-4dfa-b156-cca634cca18d-ssh-key-edpm-compute-beta-nodeset\") pod \"bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-gxxnc\" (UID: \"d1492ea4-a300-4dfa-b156-cca634cca18d\") " pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-gxxnc" Mar 16 17:25:58 crc kubenswrapper[5120]: I0316 17:25:58.754860 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bootstrap-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/accda91b-7614-4daf-a050-40cba5ced680-bootstrap-combined-ca-bundle\") pod \"bootstrap-edpm-multinodeset-edpm-compute-no-nodes-88vsp\" (UID: \"accda91b-7614-4daf-a050-40cba5ced680\") " pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-no-nodes-88vsp" Mar 16 17:25:58 crc kubenswrapper[5120]: I0316 17:25:58.755081 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-46qqg\" (UniqueName: \"kubernetes.io/projected/accda91b-7614-4daf-a050-40cba5ced680-kube-api-access-46qqg\") pod \"bootstrap-edpm-multinodeset-edpm-compute-no-nodes-88vsp\" (UID: \"accda91b-7614-4daf-a050-40cba5ced680\") " pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-no-nodes-88vsp" Mar 16 17:25:58 crc kubenswrapper[5120]: I0316 17:25:58.760124 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g274z\" (UniqueName: \"kubernetes.io/projected/d1492ea4-a300-4dfa-b156-cca634cca18d-kube-api-access-g274z\") pod \"bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-gxxnc\" (UID: \"d1492ea4-a300-4dfa-b156-cca634cca18d\") " pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-gxxnc" Mar 16 17:25:58 crc kubenswrapper[5120]: I0316 17:25:58.782892 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-no-nodes-88vsp" Mar 16 17:25:58 crc kubenswrapper[5120]: I0316 17:25:58.796273 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-gxxnc" Mar 16 17:25:59 crc kubenswrapper[5120]: I0316 17:25:59.276969 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-no-nodes-88vsp"] Mar 16 17:25:59 crc kubenswrapper[5120]: I0316 17:25:59.313840 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-gxxnc"] Mar 16 17:25:59 crc kubenswrapper[5120]: W0316 17:25:59.315737 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd1492ea4_a300_4dfa_b156_cca634cca18d.slice/crio-d7d8769ffaa618ee1e241b2829e369a264a0fe25771c5ebcfcdedffe8aecaa39 WatchSource:0}: Error finding container d7d8769ffaa618ee1e241b2829e369a264a0fe25771c5ebcfcdedffe8aecaa39: Status 404 returned error can't find the container with id d7d8769ffaa618ee1e241b2829e369a264a0fe25771c5ebcfcdedffe8aecaa39 Mar 16 17:25:59 crc kubenswrapper[5120]: I0316 17:25:59.391996 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-no-nodes-88vsp" event={"ID":"accda91b-7614-4daf-a050-40cba5ced680","Type":"ContainerStarted","Data":"01e0b91707f8ae9473ad99298b4ebc1d510e226fb962f3354d232bdd2cf3ce70"} Mar 16 17:25:59 crc kubenswrapper[5120]: I0316 17:25:59.393165 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-gxxnc" event={"ID":"d1492ea4-a300-4dfa-b156-cca634cca18d","Type":"ContainerStarted","Data":"d7d8769ffaa618ee1e241b2829e369a264a0fe25771c5ebcfcdedffe8aecaa39"} Mar 16 17:26:00 crc kubenswrapper[5120]: I0316 17:26:00.132864 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-infra/auto-csr-approver-29561366-vtccj"] Mar 16 17:26:00 crc kubenswrapper[5120]: I0316 17:26:00.142458 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561366-vtccj" Mar 16 17:26:00 crc kubenswrapper[5120]: I0316 17:26:00.143582 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561366-vtccj"] Mar 16 17:26:00 crc kubenswrapper[5120]: I0316 17:26:00.145411 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"openshift-service-ca.crt\"" Mar 16 17:26:00 crc kubenswrapper[5120]: I0316 17:26:00.145902 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-infra\"/\"csr-approver-sa-dockercfg-x2nsz\"" Mar 16 17:26:00 crc kubenswrapper[5120]: I0316 17:26:00.147866 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"kube-root-ca.crt\"" Mar 16 17:26:00 crc kubenswrapper[5120]: I0316 17:26:00.169444 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vnvg\" (UniqueName: \"kubernetes.io/projected/60bb955b-b31e-4fa4-9225-1ac98eccc95d-kube-api-access-5vnvg\") pod \"auto-csr-approver-29561366-vtccj\" (UID: \"60bb955b-b31e-4fa4-9225-1ac98eccc95d\") " pod="openshift-infra/auto-csr-approver-29561366-vtccj" Mar 16 17:26:00 crc kubenswrapper[5120]: I0316 17:26:00.271283 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5vnvg\" (UniqueName: \"kubernetes.io/projected/60bb955b-b31e-4fa4-9225-1ac98eccc95d-kube-api-access-5vnvg\") pod \"auto-csr-approver-29561366-vtccj\" (UID: \"60bb955b-b31e-4fa4-9225-1ac98eccc95d\") " pod="openshift-infra/auto-csr-approver-29561366-vtccj" Mar 16 17:26:00 crc kubenswrapper[5120]: I0316 17:26:00.297385 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vnvg\" (UniqueName: \"kubernetes.io/projected/60bb955b-b31e-4fa4-9225-1ac98eccc95d-kube-api-access-5vnvg\") pod \"auto-csr-approver-29561366-vtccj\" (UID: \"60bb955b-b31e-4fa4-9225-1ac98eccc95d\") " pod="openshift-infra/auto-csr-approver-29561366-vtccj" Mar 16 17:26:00 crc kubenswrapper[5120]: I0316 17:26:00.407969 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-no-nodes-88vsp" event={"ID":"accda91b-7614-4daf-a050-40cba5ced680","Type":"ContainerStarted","Data":"cf5b83adf0c762bf8f1e3f90d82700ec16061af75798e6fcc07e661b321ebf6f"} Mar 16 17:26:00 crc kubenswrapper[5120]: I0316 17:26:00.410054 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-gxxnc" event={"ID":"d1492ea4-a300-4dfa-b156-cca634cca18d","Type":"ContainerStarted","Data":"98796da7547f1aa72ce0429e40199d72c428470ad0c26f929540115a7fef0fec"} Mar 16 17:26:00 crc kubenswrapper[5120]: I0316 17:26:00.424167 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-no-nodes-88vsp" podStartSLOduration=2.018749912 podStartE2EDuration="2.424152349s" podCreationTimestamp="2026-03-16 17:25:58 +0000 UTC" firstStartedPulling="2026-03-16 17:25:59.272218553 +0000 UTC m=+6861.426150200" lastFinishedPulling="2026-03-16 17:25:59.67762097 +0000 UTC m=+6861.831552637" observedRunningTime="2026-03-16 17:26:00.422770641 +0000 UTC m=+6862.576702298" watchObservedRunningTime="2026-03-16 17:26:00.424152349 +0000 UTC m=+6862.578084006" Mar 16 17:26:00 crc kubenswrapper[5120]: I0316 17:26:00.444721 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-gxxnc" podStartSLOduration=2.023970844 podStartE2EDuration="2.444699211s" podCreationTimestamp="2026-03-16 17:25:58 +0000 UTC" firstStartedPulling="2026-03-16 17:25:59.317461559 +0000 UTC m=+6861.471393216" lastFinishedPulling="2026-03-16 17:25:59.738189916 +0000 UTC m=+6861.892121583" observedRunningTime="2026-03-16 17:26:00.435625313 +0000 UTC m=+6862.589556970" watchObservedRunningTime="2026-03-16 17:26:00.444699211 +0000 UTC m=+6862.598630868" Mar 16 17:26:00 crc kubenswrapper[5120]: I0316 17:26:00.460394 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561366-vtccj" Mar 16 17:26:00 crc kubenswrapper[5120]: I0316 17:26:00.922202 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561366-vtccj"] Mar 16 17:26:01 crc kubenswrapper[5120]: I0316 17:26:01.423189 5120 generic.go:358] "Generic (PLEG): container finished" podID="accda91b-7614-4daf-a050-40cba5ced680" containerID="cf5b83adf0c762bf8f1e3f90d82700ec16061af75798e6fcc07e661b321ebf6f" exitCode=0 Mar 16 17:26:01 crc kubenswrapper[5120]: I0316 17:26:01.423531 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-no-nodes-88vsp" event={"ID":"accda91b-7614-4daf-a050-40cba5ced680","Type":"ContainerDied","Data":"cf5b83adf0c762bf8f1e3f90d82700ec16061af75798e6fcc07e661b321ebf6f"} Mar 16 17:26:01 crc kubenswrapper[5120]: I0316 17:26:01.427141 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561366-vtccj" event={"ID":"60bb955b-b31e-4fa4-9225-1ac98eccc95d","Type":"ContainerStarted","Data":"7c30c32e0a704bf641186caae6bac1c3bbfa46d5e3948e48170272aab4600f9b"} Mar 16 17:26:02 crc kubenswrapper[5120]: I0316 17:26:02.440434 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561366-vtccj" event={"ID":"60bb955b-b31e-4fa4-9225-1ac98eccc95d","Type":"ContainerStarted","Data":"9805ca42b1d798b28a491a3992b792bf52553df5493d5e5c5dcbb631827092b4"} Mar 16 17:26:02 crc kubenswrapper[5120]: I0316 17:26:02.443982 5120 generic.go:358] "Generic (PLEG): container finished" podID="d1492ea4-a300-4dfa-b156-cca634cca18d" containerID="98796da7547f1aa72ce0429e40199d72c428470ad0c26f929540115a7fef0fec" exitCode=0 Mar 16 17:26:02 crc kubenswrapper[5120]: I0316 17:26:02.444084 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-gxxnc" event={"ID":"d1492ea4-a300-4dfa-b156-cca634cca18d","Type":"ContainerDied","Data":"98796da7547f1aa72ce0429e40199d72c428470ad0c26f929540115a7fef0fec"} Mar 16 17:26:02 crc kubenswrapper[5120]: I0316 17:26:02.462239 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-infra/auto-csr-approver-29561366-vtccj" podStartSLOduration=1.299139448 podStartE2EDuration="2.4622204s" podCreationTimestamp="2026-03-16 17:26:00 +0000 UTC" firstStartedPulling="2026-03-16 17:26:00.92334487 +0000 UTC m=+6863.077276527" lastFinishedPulling="2026-03-16 17:26:02.086425822 +0000 UTC m=+6864.240357479" observedRunningTime="2026-03-16 17:26:02.457025028 +0000 UTC m=+6864.610956705" watchObservedRunningTime="2026-03-16 17:26:02.4622204 +0000 UTC m=+6864.616152057" Mar 16 17:26:02 crc kubenswrapper[5120]: I0316 17:26:02.783373 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-no-nodes-88vsp" Mar 16 17:26:02 crc kubenswrapper[5120]: I0316 17:26:02.827605 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-46qqg\" (UniqueName: \"kubernetes.io/projected/accda91b-7614-4daf-a050-40cba5ced680-kube-api-access-46qqg\") pod \"accda91b-7614-4daf-a050-40cba5ced680\" (UID: \"accda91b-7614-4daf-a050-40cba5ced680\") " Mar 16 17:26:02 crc kubenswrapper[5120]: I0316 17:26:02.827662 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bootstrap-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/accda91b-7614-4daf-a050-40cba5ced680-bootstrap-combined-ca-bundle\") pod \"accda91b-7614-4daf-a050-40cba5ced680\" (UID: \"accda91b-7614-4daf-a050-40cba5ced680\") " Mar 16 17:26:02 crc kubenswrapper[5120]: I0316 17:26:02.827796 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/accda91b-7614-4daf-a050-40cba5ced680-inventory\") pod \"accda91b-7614-4daf-a050-40cba5ced680\" (UID: \"accda91b-7614-4daf-a050-40cba5ced680\") " Mar 16 17:26:02 crc kubenswrapper[5120]: I0316 17:26:02.828073 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/accda91b-7614-4daf-a050-40cba5ced680-ssh-key-edpm-compute-no-nodes\") pod \"accda91b-7614-4daf-a050-40cba5ced680\" (UID: \"accda91b-7614-4daf-a050-40cba5ced680\") " Mar 16 17:26:02 crc kubenswrapper[5120]: I0316 17:26:02.836053 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/accda91b-7614-4daf-a050-40cba5ced680-kube-api-access-46qqg" (OuterVolumeSpecName: "kube-api-access-46qqg") pod "accda91b-7614-4daf-a050-40cba5ced680" (UID: "accda91b-7614-4daf-a050-40cba5ced680"). InnerVolumeSpecName "kube-api-access-46qqg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:26:02 crc kubenswrapper[5120]: I0316 17:26:02.838426 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/accda91b-7614-4daf-a050-40cba5ced680-bootstrap-combined-ca-bundle" (OuterVolumeSpecName: "bootstrap-combined-ca-bundle") pod "accda91b-7614-4daf-a050-40cba5ced680" (UID: "accda91b-7614-4daf-a050-40cba5ced680"). InnerVolumeSpecName "bootstrap-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:26:02 crc kubenswrapper[5120]: I0316 17:26:02.852451 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/accda91b-7614-4daf-a050-40cba5ced680-ssh-key-edpm-compute-no-nodes" (OuterVolumeSpecName: "ssh-key-edpm-compute-no-nodes") pod "accda91b-7614-4daf-a050-40cba5ced680" (UID: "accda91b-7614-4daf-a050-40cba5ced680"). InnerVolumeSpecName "ssh-key-edpm-compute-no-nodes". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:26:02 crc kubenswrapper[5120]: I0316 17:26:02.862780 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/accda91b-7614-4daf-a050-40cba5ced680-inventory" (OuterVolumeSpecName: "inventory") pod "accda91b-7614-4daf-a050-40cba5ced680" (UID: "accda91b-7614-4daf-a050-40cba5ced680"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:26:02 crc kubenswrapper[5120]: I0316 17:26:02.931085 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-46qqg\" (UniqueName: \"kubernetes.io/projected/accda91b-7614-4daf-a050-40cba5ced680-kube-api-access-46qqg\") on node \"crc\" DevicePath \"\"" Mar 16 17:26:02 crc kubenswrapper[5120]: I0316 17:26:02.931153 5120 reconciler_common.go:299] "Volume detached for volume \"bootstrap-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/accda91b-7614-4daf-a050-40cba5ced680-bootstrap-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:26:02 crc kubenswrapper[5120]: I0316 17:26:02.931175 5120 reconciler_common.go:299] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/accda91b-7614-4daf-a050-40cba5ced680-inventory\") on node \"crc\" DevicePath \"\"" Mar 16 17:26:02 crc kubenswrapper[5120]: I0316 17:26:02.931194 5120 reconciler_common.go:299] "Volume detached for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/accda91b-7614-4daf-a050-40cba5ced680-ssh-key-edpm-compute-no-nodes\") on node \"crc\" DevicePath \"\"" Mar 16 17:26:03 crc kubenswrapper[5120]: I0316 17:26:03.459889 5120 generic.go:358] "Generic (PLEG): container finished" podID="60bb955b-b31e-4fa4-9225-1ac98eccc95d" containerID="9805ca42b1d798b28a491a3992b792bf52553df5493d5e5c5dcbb631827092b4" exitCode=0 Mar 16 17:26:03 crc kubenswrapper[5120]: I0316 17:26:03.459952 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561366-vtccj" event={"ID":"60bb955b-b31e-4fa4-9225-1ac98eccc95d","Type":"ContainerDied","Data":"9805ca42b1d798b28a491a3992b792bf52553df5493d5e5c5dcbb631827092b4"} Mar 16 17:26:03 crc kubenswrapper[5120]: I0316 17:26:03.466267 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-no-nodes-88vsp" Mar 16 17:26:03 crc kubenswrapper[5120]: I0316 17:26:03.466285 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-no-nodes-88vsp" event={"ID":"accda91b-7614-4daf-a050-40cba5ced680","Type":"ContainerDied","Data":"01e0b91707f8ae9473ad99298b4ebc1d510e226fb962f3354d232bdd2cf3ce70"} Mar 16 17:26:03 crc kubenswrapper[5120]: I0316 17:26:03.466339 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="01e0b91707f8ae9473ad99298b4ebc1d510e226fb962f3354d232bdd2cf3ce70" Mar 16 17:26:03 crc kubenswrapper[5120]: I0316 17:26:03.514514 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/configure-network-edpm-multinodeset-edpm-compute-no-nodes-frdcs"] Mar 16 17:26:03 crc kubenswrapper[5120]: I0316 17:26:03.516243 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="accda91b-7614-4daf-a050-40cba5ced680" containerName="bootstrap-edpm-multinodeset-edpm-compute-no-nodes" Mar 16 17:26:03 crc kubenswrapper[5120]: I0316 17:26:03.516265 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="accda91b-7614-4daf-a050-40cba5ced680" containerName="bootstrap-edpm-multinodeset-edpm-compute-no-nodes" Mar 16 17:26:03 crc kubenswrapper[5120]: I0316 17:26:03.516434 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="accda91b-7614-4daf-a050-40cba5ced680" containerName="bootstrap-edpm-multinodeset-edpm-compute-no-nodes" Mar 16 17:26:03 crc kubenswrapper[5120]: I0316 17:26:03.521434 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/configure-network-edpm-multinodeset-edpm-compute-no-nodes-frdcs" Mar 16 17:26:03 crc kubenswrapper[5120]: I0316 17:26:03.523588 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/configure-network-edpm-multinodeset-edpm-compute-no-nodes-frdcs"] Mar 16 17:26:03 crc kubenswrapper[5120]: I0316 17:26:03.524911 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"edpm-compute-no-nodes-dockercfg-znndh\"" Mar 16 17:26:03 crc kubenswrapper[5120]: I0316 17:26:03.524943 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplanenodeset-edpm-compute-no-nodes\"" Mar 16 17:26:03 crc kubenswrapper[5120]: I0316 17:26:03.648706 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/4e45ceb5-cbda-4146-a521-d764eb69bc05-ssh-key-edpm-compute-no-nodes\") pod \"configure-network-edpm-multinodeset-edpm-compute-no-nodes-frdcs\" (UID: \"4e45ceb5-cbda-4146-a521-d764eb69bc05\") " pod="openstack-kuttl-tests/configure-network-edpm-multinodeset-edpm-compute-no-nodes-frdcs" Mar 16 17:26:03 crc kubenswrapper[5120]: I0316 17:26:03.649003 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/4e45ceb5-cbda-4146-a521-d764eb69bc05-inventory\") pod \"configure-network-edpm-multinodeset-edpm-compute-no-nodes-frdcs\" (UID: \"4e45ceb5-cbda-4146-a521-d764eb69bc05\") " pod="openstack-kuttl-tests/configure-network-edpm-multinodeset-edpm-compute-no-nodes-frdcs" Mar 16 17:26:03 crc kubenswrapper[5120]: I0316 17:26:03.649519 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whmnp\" (UniqueName: \"kubernetes.io/projected/4e45ceb5-cbda-4146-a521-d764eb69bc05-kube-api-access-whmnp\") pod \"configure-network-edpm-multinodeset-edpm-compute-no-nodes-frdcs\" (UID: \"4e45ceb5-cbda-4146-a521-d764eb69bc05\") " pod="openstack-kuttl-tests/configure-network-edpm-multinodeset-edpm-compute-no-nodes-frdcs" Mar 16 17:26:03 crc kubenswrapper[5120]: I0316 17:26:03.751289 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/4e45ceb5-cbda-4146-a521-d764eb69bc05-ssh-key-edpm-compute-no-nodes\") pod \"configure-network-edpm-multinodeset-edpm-compute-no-nodes-frdcs\" (UID: \"4e45ceb5-cbda-4146-a521-d764eb69bc05\") " pod="openstack-kuttl-tests/configure-network-edpm-multinodeset-edpm-compute-no-nodes-frdcs" Mar 16 17:26:03 crc kubenswrapper[5120]: I0316 17:26:03.751455 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/4e45ceb5-cbda-4146-a521-d764eb69bc05-inventory\") pod \"configure-network-edpm-multinodeset-edpm-compute-no-nodes-frdcs\" (UID: \"4e45ceb5-cbda-4146-a521-d764eb69bc05\") " pod="openstack-kuttl-tests/configure-network-edpm-multinodeset-edpm-compute-no-nodes-frdcs" Mar 16 17:26:03 crc kubenswrapper[5120]: I0316 17:26:03.751614 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-whmnp\" (UniqueName: \"kubernetes.io/projected/4e45ceb5-cbda-4146-a521-d764eb69bc05-kube-api-access-whmnp\") pod \"configure-network-edpm-multinodeset-edpm-compute-no-nodes-frdcs\" (UID: \"4e45ceb5-cbda-4146-a521-d764eb69bc05\") " pod="openstack-kuttl-tests/configure-network-edpm-multinodeset-edpm-compute-no-nodes-frdcs" Mar 16 17:26:03 crc kubenswrapper[5120]: I0316 17:26:03.758298 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/4e45ceb5-cbda-4146-a521-d764eb69bc05-ssh-key-edpm-compute-no-nodes\") pod \"configure-network-edpm-multinodeset-edpm-compute-no-nodes-frdcs\" (UID: \"4e45ceb5-cbda-4146-a521-d764eb69bc05\") " pod="openstack-kuttl-tests/configure-network-edpm-multinodeset-edpm-compute-no-nodes-frdcs" Mar 16 17:26:03 crc kubenswrapper[5120]: I0316 17:26:03.761699 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/4e45ceb5-cbda-4146-a521-d764eb69bc05-inventory\") pod \"configure-network-edpm-multinodeset-edpm-compute-no-nodes-frdcs\" (UID: \"4e45ceb5-cbda-4146-a521-d764eb69bc05\") " pod="openstack-kuttl-tests/configure-network-edpm-multinodeset-edpm-compute-no-nodes-frdcs" Mar 16 17:26:03 crc kubenswrapper[5120]: I0316 17:26:03.768575 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-whmnp\" (UniqueName: \"kubernetes.io/projected/4e45ceb5-cbda-4146-a521-d764eb69bc05-kube-api-access-whmnp\") pod \"configure-network-edpm-multinodeset-edpm-compute-no-nodes-frdcs\" (UID: \"4e45ceb5-cbda-4146-a521-d764eb69bc05\") " pod="openstack-kuttl-tests/configure-network-edpm-multinodeset-edpm-compute-no-nodes-frdcs" Mar 16 17:26:03 crc kubenswrapper[5120]: I0316 17:26:03.823709 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-gxxnc" Mar 16 17:26:03 crc kubenswrapper[5120]: I0316 17:26:03.877109 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/configure-network-edpm-multinodeset-edpm-compute-no-nodes-frdcs" Mar 16 17:26:03 crc kubenswrapper[5120]: I0316 17:26:03.954874 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ssh-key-edpm-compute-beta-nodeset\" (UniqueName: \"kubernetes.io/secret/d1492ea4-a300-4dfa-b156-cca634cca18d-ssh-key-edpm-compute-beta-nodeset\") pod \"d1492ea4-a300-4dfa-b156-cca634cca18d\" (UID: \"d1492ea4-a300-4dfa-b156-cca634cca18d\") " Mar 16 17:26:03 crc kubenswrapper[5120]: I0316 17:26:03.955318 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bootstrap-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d1492ea4-a300-4dfa-b156-cca634cca18d-bootstrap-combined-ca-bundle\") pod \"d1492ea4-a300-4dfa-b156-cca634cca18d\" (UID: \"d1492ea4-a300-4dfa-b156-cca634cca18d\") " Mar 16 17:26:03 crc kubenswrapper[5120]: I0316 17:26:03.955368 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g274z\" (UniqueName: \"kubernetes.io/projected/d1492ea4-a300-4dfa-b156-cca634cca18d-kube-api-access-g274z\") pod \"d1492ea4-a300-4dfa-b156-cca634cca18d\" (UID: \"d1492ea4-a300-4dfa-b156-cca634cca18d\") " Mar 16 17:26:03 crc kubenswrapper[5120]: I0316 17:26:03.955699 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/d1492ea4-a300-4dfa-b156-cca634cca18d-inventory\") pod \"d1492ea4-a300-4dfa-b156-cca634cca18d\" (UID: \"d1492ea4-a300-4dfa-b156-cca634cca18d\") " Mar 16 17:26:03 crc kubenswrapper[5120]: I0316 17:26:03.960578 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d1492ea4-a300-4dfa-b156-cca634cca18d-bootstrap-combined-ca-bundle" (OuterVolumeSpecName: "bootstrap-combined-ca-bundle") pod "d1492ea4-a300-4dfa-b156-cca634cca18d" (UID: "d1492ea4-a300-4dfa-b156-cca634cca18d"). InnerVolumeSpecName "bootstrap-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:26:03 crc kubenswrapper[5120]: I0316 17:26:03.961467 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1492ea4-a300-4dfa-b156-cca634cca18d-kube-api-access-g274z" (OuterVolumeSpecName: "kube-api-access-g274z") pod "d1492ea4-a300-4dfa-b156-cca634cca18d" (UID: "d1492ea4-a300-4dfa-b156-cca634cca18d"). InnerVolumeSpecName "kube-api-access-g274z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:26:03 crc kubenswrapper[5120]: I0316 17:26:03.993473 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d1492ea4-a300-4dfa-b156-cca634cca18d-inventory" (OuterVolumeSpecName: "inventory") pod "d1492ea4-a300-4dfa-b156-cca634cca18d" (UID: "d1492ea4-a300-4dfa-b156-cca634cca18d"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:26:04 crc kubenswrapper[5120]: I0316 17:26:04.012027 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d1492ea4-a300-4dfa-b156-cca634cca18d-ssh-key-edpm-compute-beta-nodeset" (OuterVolumeSpecName: "ssh-key-edpm-compute-beta-nodeset") pod "d1492ea4-a300-4dfa-b156-cca634cca18d" (UID: "d1492ea4-a300-4dfa-b156-cca634cca18d"). InnerVolumeSpecName "ssh-key-edpm-compute-beta-nodeset". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:26:04 crc kubenswrapper[5120]: I0316 17:26:04.059973 5120 reconciler_common.go:299] "Volume detached for volume \"ssh-key-edpm-compute-beta-nodeset\" (UniqueName: \"kubernetes.io/secret/d1492ea4-a300-4dfa-b156-cca634cca18d-ssh-key-edpm-compute-beta-nodeset\") on node \"crc\" DevicePath \"\"" Mar 16 17:26:04 crc kubenswrapper[5120]: I0316 17:26:04.060008 5120 reconciler_common.go:299] "Volume detached for volume \"bootstrap-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d1492ea4-a300-4dfa-b156-cca634cca18d-bootstrap-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:26:04 crc kubenswrapper[5120]: I0316 17:26:04.060022 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g274z\" (UniqueName: \"kubernetes.io/projected/d1492ea4-a300-4dfa-b156-cca634cca18d-kube-api-access-g274z\") on node \"crc\" DevicePath \"\"" Mar 16 17:26:04 crc kubenswrapper[5120]: I0316 17:26:04.060034 5120 reconciler_common.go:299] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/d1492ea4-a300-4dfa-b156-cca634cca18d-inventory\") on node \"crc\" DevicePath \"\"" Mar 16 17:26:04 crc kubenswrapper[5120]: I0316 17:26:04.320681 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/configure-network-edpm-multinodeset-edpm-compute-no-nodes-frdcs"] Mar 16 17:26:04 crc kubenswrapper[5120]: I0316 17:26:04.324235 5120 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Mar 16 17:26:04 crc kubenswrapper[5120]: I0316 17:26:04.477957 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/configure-network-edpm-multinodeset-edpm-compute-no-nodes-frdcs" event={"ID":"4e45ceb5-cbda-4146-a521-d764eb69bc05","Type":"ContainerStarted","Data":"842166931a52ec57ae6027b23d5f85ea46a3155c2ff9fb2defc7e9cbbf9fc144"} Mar 16 17:26:04 crc kubenswrapper[5120]: I0316 17:26:04.480016 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-gxxnc" Mar 16 17:26:04 crc kubenswrapper[5120]: I0316 17:26:04.480049 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-gxxnc" event={"ID":"d1492ea4-a300-4dfa-b156-cca634cca18d","Type":"ContainerDied","Data":"d7d8769ffaa618ee1e241b2829e369a264a0fe25771c5ebcfcdedffe8aecaa39"} Mar 16 17:26:04 crc kubenswrapper[5120]: I0316 17:26:04.480074 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d7d8769ffaa618ee1e241b2829e369a264a0fe25771c5ebcfcdedffe8aecaa39" Mar 16 17:26:04 crc kubenswrapper[5120]: I0316 17:26:04.704888 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561366-vtccj" Mar 16 17:26:04 crc kubenswrapper[5120]: I0316 17:26:04.773485 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5vnvg\" (UniqueName: \"kubernetes.io/projected/60bb955b-b31e-4fa4-9225-1ac98eccc95d-kube-api-access-5vnvg\") pod \"60bb955b-b31e-4fa4-9225-1ac98eccc95d\" (UID: \"60bb955b-b31e-4fa4-9225-1ac98eccc95d\") " Mar 16 17:26:04 crc kubenswrapper[5120]: I0316 17:26:04.781289 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60bb955b-b31e-4fa4-9225-1ac98eccc95d-kube-api-access-5vnvg" (OuterVolumeSpecName: "kube-api-access-5vnvg") pod "60bb955b-b31e-4fa4-9225-1ac98eccc95d" (UID: "60bb955b-b31e-4fa4-9225-1ac98eccc95d"). InnerVolumeSpecName "kube-api-access-5vnvg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:26:04 crc kubenswrapper[5120]: I0316 17:26:04.878177 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5vnvg\" (UniqueName: \"kubernetes.io/projected/60bb955b-b31e-4fa4-9225-1ac98eccc95d-kube-api-access-5vnvg\") on node \"crc\" DevicePath \"\"" Mar 16 17:26:05 crc kubenswrapper[5120]: I0316 17:26:05.503642 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/configure-network-edpm-multinodeset-edpm-compute-no-nodes-frdcs" event={"ID":"4e45ceb5-cbda-4146-a521-d764eb69bc05","Type":"ContainerStarted","Data":"3ab5069672d613f3caefbaba100facc5ff9809b176365fd5391665f33396ef24"} Mar 16 17:26:05 crc kubenswrapper[5120]: I0316 17:26:05.509132 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561366-vtccj" event={"ID":"60bb955b-b31e-4fa4-9225-1ac98eccc95d","Type":"ContainerDied","Data":"7c30c32e0a704bf641186caae6bac1c3bbfa46d5e3948e48170272aab4600f9b"} Mar 16 17:26:05 crc kubenswrapper[5120]: I0316 17:26:05.509172 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7c30c32e0a704bf641186caae6bac1c3bbfa46d5e3948e48170272aab4600f9b" Mar 16 17:26:05 crc kubenswrapper[5120]: I0316 17:26:05.509256 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561366-vtccj" Mar 16 17:26:05 crc kubenswrapper[5120]: I0316 17:26:05.524470 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-infra/auto-csr-approver-29561360-spmdl"] Mar 16 17:26:05 crc kubenswrapper[5120]: I0316 17:26:05.534260 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-infra/auto-csr-approver-29561360-spmdl"] Mar 16 17:26:05 crc kubenswrapper[5120]: I0316 17:26:05.537371 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/configure-network-edpm-multinodeset-edpm-compute-no-nodes-frdcs" podStartSLOduration=1.8765262310000002 podStartE2EDuration="2.537354188s" podCreationTimestamp="2026-03-16 17:26:03 +0000 UTC" firstStartedPulling="2026-03-16 17:26:04.324376654 +0000 UTC m=+6866.478308311" lastFinishedPulling="2026-03-16 17:26:04.985204611 +0000 UTC m=+6867.139136268" observedRunningTime="2026-03-16 17:26:05.520547749 +0000 UTC m=+6867.674479416" watchObservedRunningTime="2026-03-16 17:26:05.537354188 +0000 UTC m=+6867.691285845" Mar 16 17:26:06 crc kubenswrapper[5120]: I0316 17:26:06.518618 5120 generic.go:358] "Generic (PLEG): container finished" podID="4e45ceb5-cbda-4146-a521-d764eb69bc05" containerID="3ab5069672d613f3caefbaba100facc5ff9809b176365fd5391665f33396ef24" exitCode=0 Mar 16 17:26:06 crc kubenswrapper[5120]: I0316 17:26:06.518658 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/configure-network-edpm-multinodeset-edpm-compute-no-nodes-frdcs" event={"ID":"4e45ceb5-cbda-4146-a521-d764eb69bc05","Type":"ContainerDied","Data":"3ab5069672d613f3caefbaba100facc5ff9809b176365fd5391665f33396ef24"} Mar 16 17:26:06 crc kubenswrapper[5120]: I0316 17:26:06.672929 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f5f45330-0cbc-42c0-9485-2495bc41b1d6" path="/var/lib/kubelet/pods/f5f45330-0cbc-42c0-9485-2495bc41b1d6/volumes" Mar 16 17:26:07 crc kubenswrapper[5120]: I0316 17:26:07.796226 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/configure-network-edpm-multinodeset-edpm-compute-no-nodes-frdcs" Mar 16 17:26:07 crc kubenswrapper[5120]: I0316 17:26:07.851375 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/4e45ceb5-cbda-4146-a521-d764eb69bc05-inventory\") pod \"4e45ceb5-cbda-4146-a521-d764eb69bc05\" (UID: \"4e45ceb5-cbda-4146-a521-d764eb69bc05\") " Mar 16 17:26:07 crc kubenswrapper[5120]: I0316 17:26:07.851442 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-whmnp\" (UniqueName: \"kubernetes.io/projected/4e45ceb5-cbda-4146-a521-d764eb69bc05-kube-api-access-whmnp\") pod \"4e45ceb5-cbda-4146-a521-d764eb69bc05\" (UID: \"4e45ceb5-cbda-4146-a521-d764eb69bc05\") " Mar 16 17:26:07 crc kubenswrapper[5120]: I0316 17:26:07.852035 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/4e45ceb5-cbda-4146-a521-d764eb69bc05-ssh-key-edpm-compute-no-nodes\") pod \"4e45ceb5-cbda-4146-a521-d764eb69bc05\" (UID: \"4e45ceb5-cbda-4146-a521-d764eb69bc05\") " Mar 16 17:26:07 crc kubenswrapper[5120]: I0316 17:26:07.866064 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e45ceb5-cbda-4146-a521-d764eb69bc05-kube-api-access-whmnp" (OuterVolumeSpecName: "kube-api-access-whmnp") pod "4e45ceb5-cbda-4146-a521-d764eb69bc05" (UID: "4e45ceb5-cbda-4146-a521-d764eb69bc05"). InnerVolumeSpecName "kube-api-access-whmnp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:26:07 crc kubenswrapper[5120]: E0316 17:26:07.874240 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e45ceb5-cbda-4146-a521-d764eb69bc05-ssh-key-edpm-compute-no-nodes podName:4e45ceb5-cbda-4146-a521-d764eb69bc05 nodeName:}" failed. No retries permitted until 2026-03-16 17:26:08.374198673 +0000 UTC m=+6870.528130330 (durationBeforeRetry 500ms). Error: error cleaning subPath mounts for volume "ssh-key-edpm-compute-no-nodes" (UniqueName: "kubernetes.io/secret/4e45ceb5-cbda-4146-a521-d764eb69bc05-ssh-key-edpm-compute-no-nodes") pod "4e45ceb5-cbda-4146-a521-d764eb69bc05" (UID: "4e45ceb5-cbda-4146-a521-d764eb69bc05") : error deleting /var/lib/kubelet/pods/4e45ceb5-cbda-4146-a521-d764eb69bc05/volume-subpaths: remove /var/lib/kubelet/pods/4e45ceb5-cbda-4146-a521-d764eb69bc05/volume-subpaths: no such file or directory Mar 16 17:26:07 crc kubenswrapper[5120]: I0316 17:26:07.879195 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4e45ceb5-cbda-4146-a521-d764eb69bc05-inventory" (OuterVolumeSpecName: "inventory") pod "4e45ceb5-cbda-4146-a521-d764eb69bc05" (UID: "4e45ceb5-cbda-4146-a521-d764eb69bc05"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:26:07 crc kubenswrapper[5120]: I0316 17:26:07.955950 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-whmnp\" (UniqueName: \"kubernetes.io/projected/4e45ceb5-cbda-4146-a521-d764eb69bc05-kube-api-access-whmnp\") on node \"crc\" DevicePath \"\"" Mar 16 17:26:07 crc kubenswrapper[5120]: I0316 17:26:07.955988 5120 reconciler_common.go:299] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/4e45ceb5-cbda-4146-a521-d764eb69bc05-inventory\") on node \"crc\" DevicePath \"\"" Mar 16 17:26:07 crc kubenswrapper[5120]: E0316 17:26:07.977269 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1313226 actualBytes=10240 Mar 16 17:26:08 crc kubenswrapper[5120]: I0316 17:26:08.466084 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/4e45ceb5-cbda-4146-a521-d764eb69bc05-ssh-key-edpm-compute-no-nodes\") pod \"4e45ceb5-cbda-4146-a521-d764eb69bc05\" (UID: \"4e45ceb5-cbda-4146-a521-d764eb69bc05\") " Mar 16 17:26:08 crc kubenswrapper[5120]: I0316 17:26:08.470372 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4e45ceb5-cbda-4146-a521-d764eb69bc05-ssh-key-edpm-compute-no-nodes" (OuterVolumeSpecName: "ssh-key-edpm-compute-no-nodes") pod "4e45ceb5-cbda-4146-a521-d764eb69bc05" (UID: "4e45ceb5-cbda-4146-a521-d764eb69bc05"). InnerVolumeSpecName "ssh-key-edpm-compute-no-nodes". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:26:08 crc kubenswrapper[5120]: I0316 17:26:08.547650 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/configure-network-edpm-multinodeset-edpm-compute-no-nodes-frdcs" Mar 16 17:26:08 crc kubenswrapper[5120]: I0316 17:26:08.547650 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/configure-network-edpm-multinodeset-edpm-compute-no-nodes-frdcs" event={"ID":"4e45ceb5-cbda-4146-a521-d764eb69bc05","Type":"ContainerDied","Data":"842166931a52ec57ae6027b23d5f85ea46a3155c2ff9fb2defc7e9cbbf9fc144"} Mar 16 17:26:08 crc kubenswrapper[5120]: I0316 17:26:08.548106 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="842166931a52ec57ae6027b23d5f85ea46a3155c2ff9fb2defc7e9cbbf9fc144" Mar 16 17:26:08 crc kubenswrapper[5120]: I0316 17:26:08.568415 5120 reconciler_common.go:299] "Volume detached for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/4e45ceb5-cbda-4146-a521-d764eb69bc05-ssh-key-edpm-compute-no-nodes\") on node \"crc\" DevicePath \"\"" Mar 16 17:26:08 crc kubenswrapper[5120]: I0316 17:26:08.587566 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/validate-network-edpm-multinodeset-edpm-compute-no-nodes-5hmfc"] Mar 16 17:26:08 crc kubenswrapper[5120]: I0316 17:26:08.588892 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1492ea4-a300-4dfa-b156-cca634cca18d" containerName="bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset" Mar 16 17:26:08 crc kubenswrapper[5120]: I0316 17:26:08.588923 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1492ea4-a300-4dfa-b156-cca634cca18d" containerName="bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset" Mar 16 17:26:08 crc kubenswrapper[5120]: I0316 17:26:08.588969 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60bb955b-b31e-4fa4-9225-1ac98eccc95d" containerName="oc" Mar 16 17:26:08 crc kubenswrapper[5120]: I0316 17:26:08.588979 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="60bb955b-b31e-4fa4-9225-1ac98eccc95d" containerName="oc" Mar 16 17:26:08 crc kubenswrapper[5120]: I0316 17:26:08.588998 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e45ceb5-cbda-4146-a521-d764eb69bc05" containerName="configure-network-edpm-multinodeset-edpm-compute-no-nodes" Mar 16 17:26:08 crc kubenswrapper[5120]: I0316 17:26:08.589006 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e45ceb5-cbda-4146-a521-d764eb69bc05" containerName="configure-network-edpm-multinodeset-edpm-compute-no-nodes" Mar 16 17:26:08 crc kubenswrapper[5120]: I0316 17:26:08.589168 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="4e45ceb5-cbda-4146-a521-d764eb69bc05" containerName="configure-network-edpm-multinodeset-edpm-compute-no-nodes" Mar 16 17:26:08 crc kubenswrapper[5120]: I0316 17:26:08.589186 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="60bb955b-b31e-4fa4-9225-1ac98eccc95d" containerName="oc" Mar 16 17:26:08 crc kubenswrapper[5120]: I0316 17:26:08.589206 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="d1492ea4-a300-4dfa-b156-cca634cca18d" containerName="bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset" Mar 16 17:26:08 crc kubenswrapper[5120]: I0316 17:26:08.594074 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/validate-network-edpm-multinodeset-edpm-compute-no-nodes-5hmfc" Mar 16 17:26:08 crc kubenswrapper[5120]: I0316 17:26:08.597139 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"edpm-compute-no-nodes-dockercfg-znndh\"" Mar 16 17:26:08 crc kubenswrapper[5120]: I0316 17:26:08.597394 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplanenodeset-edpm-compute-no-nodes\"" Mar 16 17:26:08 crc kubenswrapper[5120]: I0316 17:26:08.599284 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-aee-default-env\"" Mar 16 17:26:08 crc kubenswrapper[5120]: I0316 17:26:08.599610 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplane-ansible-ssh-private-key-secret\"" Mar 16 17:26:08 crc kubenswrapper[5120]: I0316 17:26:08.600246 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/validate-network-edpm-multinodeset-edpm-compute-no-nodes-5hmfc"] Mar 16 17:26:08 crc kubenswrapper[5120]: I0316 17:26:08.669885 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/932c47c4-942d-4749-a784-88e26d8b91a4-inventory\") pod \"validate-network-edpm-multinodeset-edpm-compute-no-nodes-5hmfc\" (UID: \"932c47c4-942d-4749-a784-88e26d8b91a4\") " pod="openstack-kuttl-tests/validate-network-edpm-multinodeset-edpm-compute-no-nodes-5hmfc" Mar 16 17:26:08 crc kubenswrapper[5120]: I0316 17:26:08.670153 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhnj8\" (UniqueName: \"kubernetes.io/projected/932c47c4-942d-4749-a784-88e26d8b91a4-kube-api-access-hhnj8\") pod \"validate-network-edpm-multinodeset-edpm-compute-no-nodes-5hmfc\" (UID: \"932c47c4-942d-4749-a784-88e26d8b91a4\") " pod="openstack-kuttl-tests/validate-network-edpm-multinodeset-edpm-compute-no-nodes-5hmfc" Mar 16 17:26:08 crc kubenswrapper[5120]: I0316 17:26:08.670332 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/932c47c4-942d-4749-a784-88e26d8b91a4-ssh-key-edpm-compute-no-nodes\") pod \"validate-network-edpm-multinodeset-edpm-compute-no-nodes-5hmfc\" (UID: \"932c47c4-942d-4749-a784-88e26d8b91a4\") " pod="openstack-kuttl-tests/validate-network-edpm-multinodeset-edpm-compute-no-nodes-5hmfc" Mar 16 17:26:08 crc kubenswrapper[5120]: I0316 17:26:08.772709 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/932c47c4-942d-4749-a784-88e26d8b91a4-ssh-key-edpm-compute-no-nodes\") pod \"validate-network-edpm-multinodeset-edpm-compute-no-nodes-5hmfc\" (UID: \"932c47c4-942d-4749-a784-88e26d8b91a4\") " pod="openstack-kuttl-tests/validate-network-edpm-multinodeset-edpm-compute-no-nodes-5hmfc" Mar 16 17:26:08 crc kubenswrapper[5120]: I0316 17:26:08.773046 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/932c47c4-942d-4749-a784-88e26d8b91a4-inventory\") pod \"validate-network-edpm-multinodeset-edpm-compute-no-nodes-5hmfc\" (UID: \"932c47c4-942d-4749-a784-88e26d8b91a4\") " pod="openstack-kuttl-tests/validate-network-edpm-multinodeset-edpm-compute-no-nodes-5hmfc" Mar 16 17:26:08 crc kubenswrapper[5120]: I0316 17:26:08.773149 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hhnj8\" (UniqueName: \"kubernetes.io/projected/932c47c4-942d-4749-a784-88e26d8b91a4-kube-api-access-hhnj8\") pod \"validate-network-edpm-multinodeset-edpm-compute-no-nodes-5hmfc\" (UID: \"932c47c4-942d-4749-a784-88e26d8b91a4\") " pod="openstack-kuttl-tests/validate-network-edpm-multinodeset-edpm-compute-no-nodes-5hmfc" Mar 16 17:26:08 crc kubenswrapper[5120]: I0316 17:26:08.777220 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/932c47c4-942d-4749-a784-88e26d8b91a4-ssh-key-edpm-compute-no-nodes\") pod \"validate-network-edpm-multinodeset-edpm-compute-no-nodes-5hmfc\" (UID: \"932c47c4-942d-4749-a784-88e26d8b91a4\") " pod="openstack-kuttl-tests/validate-network-edpm-multinodeset-edpm-compute-no-nodes-5hmfc" Mar 16 17:26:08 crc kubenswrapper[5120]: I0316 17:26:08.777377 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/932c47c4-942d-4749-a784-88e26d8b91a4-inventory\") pod \"validate-network-edpm-multinodeset-edpm-compute-no-nodes-5hmfc\" (UID: \"932c47c4-942d-4749-a784-88e26d8b91a4\") " pod="openstack-kuttl-tests/validate-network-edpm-multinodeset-edpm-compute-no-nodes-5hmfc" Mar 16 17:26:08 crc kubenswrapper[5120]: I0316 17:26:08.796312 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhnj8\" (UniqueName: \"kubernetes.io/projected/932c47c4-942d-4749-a784-88e26d8b91a4-kube-api-access-hhnj8\") pod \"validate-network-edpm-multinodeset-edpm-compute-no-nodes-5hmfc\" (UID: \"932c47c4-942d-4749-a784-88e26d8b91a4\") " pod="openstack-kuttl-tests/validate-network-edpm-multinodeset-edpm-compute-no-nodes-5hmfc" Mar 16 17:26:08 crc kubenswrapper[5120]: I0316 17:26:08.928113 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/validate-network-edpm-multinodeset-edpm-compute-no-nodes-5hmfc" Mar 16 17:26:09 crc kubenswrapper[5120]: I0316 17:26:09.371962 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/validate-network-edpm-multinodeset-edpm-compute-no-nodes-5hmfc"] Mar 16 17:26:09 crc kubenswrapper[5120]: W0316 17:26:09.373534 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod932c47c4_942d_4749_a784_88e26d8b91a4.slice/crio-af2ffd6fb68653646b6beeb92c1ad8ffece79ec7cc60be62ace934eb8e296762 WatchSource:0}: Error finding container af2ffd6fb68653646b6beeb92c1ad8ffece79ec7cc60be62ace934eb8e296762: Status 404 returned error can't find the container with id af2ffd6fb68653646b6beeb92c1ad8ffece79ec7cc60be62ace934eb8e296762 Mar 16 17:26:09 crc kubenswrapper[5120]: I0316 17:26:09.558425 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/validate-network-edpm-multinodeset-edpm-compute-no-nodes-5hmfc" event={"ID":"932c47c4-942d-4749-a784-88e26d8b91a4","Type":"ContainerStarted","Data":"af2ffd6fb68653646b6beeb92c1ad8ffece79ec7cc60be62ace934eb8e296762"} Mar 16 17:26:10 crc kubenswrapper[5120]: I0316 17:26:10.587665 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/validate-network-edpm-multinodeset-edpm-compute-no-nodes-5hmfc" event={"ID":"932c47c4-942d-4749-a784-88e26d8b91a4","Type":"ContainerStarted","Data":"5b8202bef1ad5b5b779a707ee83b132129cbdd4e0f0e2d4ef32ff6f215dd2774"} Mar 16 17:26:10 crc kubenswrapper[5120]: I0316 17:26:10.608964 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/validate-network-edpm-multinodeset-edpm-compute-no-nodes-5hmfc" podStartSLOduration=2.168629349 podStartE2EDuration="2.608945331s" podCreationTimestamp="2026-03-16 17:26:08 +0000 UTC" firstStartedPulling="2026-03-16 17:26:09.375582399 +0000 UTC m=+6871.529514056" lastFinishedPulling="2026-03-16 17:26:09.815898371 +0000 UTC m=+6871.969830038" observedRunningTime="2026-03-16 17:26:10.602948617 +0000 UTC m=+6872.756880694" watchObservedRunningTime="2026-03-16 17:26:10.608945331 +0000 UTC m=+6872.762876978" Mar 16 17:26:11 crc kubenswrapper[5120]: I0316 17:26:11.599513 5120 generic.go:358] "Generic (PLEG): container finished" podID="932c47c4-942d-4749-a784-88e26d8b91a4" containerID="5b8202bef1ad5b5b779a707ee83b132129cbdd4e0f0e2d4ef32ff6f215dd2774" exitCode=0 Mar 16 17:26:11 crc kubenswrapper[5120]: I0316 17:26:11.599585 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/validate-network-edpm-multinodeset-edpm-compute-no-nodes-5hmfc" event={"ID":"932c47c4-942d-4749-a784-88e26d8b91a4","Type":"ContainerDied","Data":"5b8202bef1ad5b5b779a707ee83b132129cbdd4e0f0e2d4ef32ff6f215dd2774"} Mar 16 17:26:12 crc kubenswrapper[5120]: I0316 17:26:12.922757 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/validate-network-edpm-multinodeset-edpm-compute-no-nodes-5hmfc" Mar 16 17:26:13 crc kubenswrapper[5120]: I0316 17:26:13.068721 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hhnj8\" (UniqueName: \"kubernetes.io/projected/932c47c4-942d-4749-a784-88e26d8b91a4-kube-api-access-hhnj8\") pod \"932c47c4-942d-4749-a784-88e26d8b91a4\" (UID: \"932c47c4-942d-4749-a784-88e26d8b91a4\") " Mar 16 17:26:13 crc kubenswrapper[5120]: I0316 17:26:13.068948 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/932c47c4-942d-4749-a784-88e26d8b91a4-ssh-key-edpm-compute-no-nodes\") pod \"932c47c4-942d-4749-a784-88e26d8b91a4\" (UID: \"932c47c4-942d-4749-a784-88e26d8b91a4\") " Mar 16 17:26:13 crc kubenswrapper[5120]: I0316 17:26:13.069196 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/932c47c4-942d-4749-a784-88e26d8b91a4-inventory\") pod \"932c47c4-942d-4749-a784-88e26d8b91a4\" (UID: \"932c47c4-942d-4749-a784-88e26d8b91a4\") " Mar 16 17:26:13 crc kubenswrapper[5120]: I0316 17:26:13.074455 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/932c47c4-942d-4749-a784-88e26d8b91a4-kube-api-access-hhnj8" (OuterVolumeSpecName: "kube-api-access-hhnj8") pod "932c47c4-942d-4749-a784-88e26d8b91a4" (UID: "932c47c4-942d-4749-a784-88e26d8b91a4"). InnerVolumeSpecName "kube-api-access-hhnj8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:26:13 crc kubenswrapper[5120]: I0316 17:26:13.090267 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/932c47c4-942d-4749-a784-88e26d8b91a4-inventory" (OuterVolumeSpecName: "inventory") pod "932c47c4-942d-4749-a784-88e26d8b91a4" (UID: "932c47c4-942d-4749-a784-88e26d8b91a4"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:26:13 crc kubenswrapper[5120]: I0316 17:26:13.090548 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/932c47c4-942d-4749-a784-88e26d8b91a4-ssh-key-edpm-compute-no-nodes" (OuterVolumeSpecName: "ssh-key-edpm-compute-no-nodes") pod "932c47c4-942d-4749-a784-88e26d8b91a4" (UID: "932c47c4-942d-4749-a784-88e26d8b91a4"). InnerVolumeSpecName "ssh-key-edpm-compute-no-nodes". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:26:13 crc kubenswrapper[5120]: I0316 17:26:13.172246 5120 reconciler_common.go:299] "Volume detached for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/932c47c4-942d-4749-a784-88e26d8b91a4-ssh-key-edpm-compute-no-nodes\") on node \"crc\" DevicePath \"\"" Mar 16 17:26:13 crc kubenswrapper[5120]: I0316 17:26:13.172279 5120 reconciler_common.go:299] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/932c47c4-942d-4749-a784-88e26d8b91a4-inventory\") on node \"crc\" DevicePath \"\"" Mar 16 17:26:13 crc kubenswrapper[5120]: I0316 17:26:13.172292 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hhnj8\" (UniqueName: \"kubernetes.io/projected/932c47c4-942d-4749-a784-88e26d8b91a4-kube-api-access-hhnj8\") on node \"crc\" DevicePath \"\"" Mar 16 17:26:13 crc kubenswrapper[5120]: I0316 17:26:13.638874 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/validate-network-edpm-multinodeset-edpm-compute-no-nodes-5hmfc" event={"ID":"932c47c4-942d-4749-a784-88e26d8b91a4","Type":"ContainerDied","Data":"af2ffd6fb68653646b6beeb92c1ad8ffece79ec7cc60be62ace934eb8e296762"} Mar 16 17:26:13 crc kubenswrapper[5120]: I0316 17:26:13.638926 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="af2ffd6fb68653646b6beeb92c1ad8ffece79ec7cc60be62ace934eb8e296762" Mar 16 17:26:13 crc kubenswrapper[5120]: I0316 17:26:13.639420 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/validate-network-edpm-multinodeset-edpm-compute-no-nodes-5hmfc" Mar 16 17:26:13 crc kubenswrapper[5120]: I0316 17:26:13.686752 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/install-os-edpm-multinodeset-edpm-compute-no-nodes-d6rc9"] Mar 16 17:26:13 crc kubenswrapper[5120]: I0316 17:26:13.687922 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="932c47c4-942d-4749-a784-88e26d8b91a4" containerName="validate-network-edpm-multinodeset-edpm-compute-no-nodes" Mar 16 17:26:13 crc kubenswrapper[5120]: I0316 17:26:13.687946 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="932c47c4-942d-4749-a784-88e26d8b91a4" containerName="validate-network-edpm-multinodeset-edpm-compute-no-nodes" Mar 16 17:26:13 crc kubenswrapper[5120]: I0316 17:26:13.688157 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="932c47c4-942d-4749-a784-88e26d8b91a4" containerName="validate-network-edpm-multinodeset-edpm-compute-no-nodes" Mar 16 17:26:13 crc kubenswrapper[5120]: I0316 17:26:13.694541 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/install-os-edpm-multinodeset-edpm-compute-no-nodes-d6rc9" Mar 16 17:26:13 crc kubenswrapper[5120]: I0316 17:26:13.696243 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/install-os-edpm-multinodeset-edpm-compute-no-nodes-d6rc9"] Mar 16 17:26:13 crc kubenswrapper[5120]: I0316 17:26:13.698894 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplane-ansible-ssh-private-key-secret\"" Mar 16 17:26:13 crc kubenswrapper[5120]: I0316 17:26:13.699584 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplanenodeset-edpm-compute-no-nodes\"" Mar 16 17:26:13 crc kubenswrapper[5120]: I0316 17:26:13.700661 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-aee-default-env\"" Mar 16 17:26:13 crc kubenswrapper[5120]: I0316 17:26:13.700893 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"edpm-compute-no-nodes-dockercfg-znndh\"" Mar 16 17:26:13 crc kubenswrapper[5120]: I0316 17:26:13.783274 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ttlc\" (UniqueName: \"kubernetes.io/projected/647bf253-ef47-40c8-a7ad-d0a014574d07-kube-api-access-8ttlc\") pod \"install-os-edpm-multinodeset-edpm-compute-no-nodes-d6rc9\" (UID: \"647bf253-ef47-40c8-a7ad-d0a014574d07\") " pod="openstack-kuttl-tests/install-os-edpm-multinodeset-edpm-compute-no-nodes-d6rc9" Mar 16 17:26:13 crc kubenswrapper[5120]: I0316 17:26:13.783502 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/647bf253-ef47-40c8-a7ad-d0a014574d07-ssh-key-edpm-compute-no-nodes\") pod \"install-os-edpm-multinodeset-edpm-compute-no-nodes-d6rc9\" (UID: \"647bf253-ef47-40c8-a7ad-d0a014574d07\") " pod="openstack-kuttl-tests/install-os-edpm-multinodeset-edpm-compute-no-nodes-d6rc9" Mar 16 17:26:13 crc kubenswrapper[5120]: I0316 17:26:13.783728 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/647bf253-ef47-40c8-a7ad-d0a014574d07-inventory\") pod \"install-os-edpm-multinodeset-edpm-compute-no-nodes-d6rc9\" (UID: \"647bf253-ef47-40c8-a7ad-d0a014574d07\") " pod="openstack-kuttl-tests/install-os-edpm-multinodeset-edpm-compute-no-nodes-d6rc9" Mar 16 17:26:13 crc kubenswrapper[5120]: I0316 17:26:13.885873 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8ttlc\" (UniqueName: \"kubernetes.io/projected/647bf253-ef47-40c8-a7ad-d0a014574d07-kube-api-access-8ttlc\") pod \"install-os-edpm-multinodeset-edpm-compute-no-nodes-d6rc9\" (UID: \"647bf253-ef47-40c8-a7ad-d0a014574d07\") " pod="openstack-kuttl-tests/install-os-edpm-multinodeset-edpm-compute-no-nodes-d6rc9" Mar 16 17:26:13 crc kubenswrapper[5120]: I0316 17:26:13.885934 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/647bf253-ef47-40c8-a7ad-d0a014574d07-ssh-key-edpm-compute-no-nodes\") pod \"install-os-edpm-multinodeset-edpm-compute-no-nodes-d6rc9\" (UID: \"647bf253-ef47-40c8-a7ad-d0a014574d07\") " pod="openstack-kuttl-tests/install-os-edpm-multinodeset-edpm-compute-no-nodes-d6rc9" Mar 16 17:26:13 crc kubenswrapper[5120]: I0316 17:26:13.886163 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/647bf253-ef47-40c8-a7ad-d0a014574d07-inventory\") pod \"install-os-edpm-multinodeset-edpm-compute-no-nodes-d6rc9\" (UID: \"647bf253-ef47-40c8-a7ad-d0a014574d07\") " pod="openstack-kuttl-tests/install-os-edpm-multinodeset-edpm-compute-no-nodes-d6rc9" Mar 16 17:26:13 crc kubenswrapper[5120]: I0316 17:26:13.891607 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/647bf253-ef47-40c8-a7ad-d0a014574d07-inventory\") pod \"install-os-edpm-multinodeset-edpm-compute-no-nodes-d6rc9\" (UID: \"647bf253-ef47-40c8-a7ad-d0a014574d07\") " pod="openstack-kuttl-tests/install-os-edpm-multinodeset-edpm-compute-no-nodes-d6rc9" Mar 16 17:26:13 crc kubenswrapper[5120]: I0316 17:26:13.891796 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/647bf253-ef47-40c8-a7ad-d0a014574d07-ssh-key-edpm-compute-no-nodes\") pod \"install-os-edpm-multinodeset-edpm-compute-no-nodes-d6rc9\" (UID: \"647bf253-ef47-40c8-a7ad-d0a014574d07\") " pod="openstack-kuttl-tests/install-os-edpm-multinodeset-edpm-compute-no-nodes-d6rc9" Mar 16 17:26:13 crc kubenswrapper[5120]: I0316 17:26:13.910933 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ttlc\" (UniqueName: \"kubernetes.io/projected/647bf253-ef47-40c8-a7ad-d0a014574d07-kube-api-access-8ttlc\") pod \"install-os-edpm-multinodeset-edpm-compute-no-nodes-d6rc9\" (UID: \"647bf253-ef47-40c8-a7ad-d0a014574d07\") " pod="openstack-kuttl-tests/install-os-edpm-multinodeset-edpm-compute-no-nodes-d6rc9" Mar 16 17:26:14 crc kubenswrapper[5120]: I0316 17:26:14.017830 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/install-os-edpm-multinodeset-edpm-compute-no-nodes-d6rc9" Mar 16 17:26:14 crc kubenswrapper[5120]: I0316 17:26:14.430467 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/install-os-edpm-multinodeset-edpm-compute-no-nodes-d6rc9"] Mar 16 17:26:14 crc kubenswrapper[5120]: I0316 17:26:14.651012 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/install-os-edpm-multinodeset-edpm-compute-no-nodes-d6rc9" event={"ID":"647bf253-ef47-40c8-a7ad-d0a014574d07","Type":"ContainerStarted","Data":"fe138d865bc6e1ca49d452ed09b745e8d12e0f576c9b050127cc667d8a9453b4"} Mar 16 17:26:15 crc kubenswrapper[5120]: I0316 17:26:15.604516 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/community-operators-spb8z"] Mar 16 17:26:15 crc kubenswrapper[5120]: I0316 17:26:15.611494 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-spb8z" Mar 16 17:26:15 crc kubenswrapper[5120]: I0316 17:26:15.612892 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/community-operators-spb8z"] Mar 16 17:26:15 crc kubenswrapper[5120]: I0316 17:26:15.663602 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/install-os-edpm-multinodeset-edpm-compute-no-nodes-d6rc9" event={"ID":"647bf253-ef47-40c8-a7ad-d0a014574d07","Type":"ContainerStarted","Data":"2c1ba6d336b5012e01fbfce39f43e7f88bc27534b58b37da4dd9780159f265a6"} Mar 16 17:26:15 crc kubenswrapper[5120]: I0316 17:26:15.685543 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/install-os-edpm-multinodeset-edpm-compute-no-nodes-d6rc9" podStartSLOduration=2.009650742 podStartE2EDuration="2.685527549s" podCreationTimestamp="2026-03-16 17:26:13 +0000 UTC" firstStartedPulling="2026-03-16 17:26:14.43575402 +0000 UTC m=+6876.589685677" lastFinishedPulling="2026-03-16 17:26:15.111630827 +0000 UTC m=+6877.265562484" observedRunningTime="2026-03-16 17:26:15.683427802 +0000 UTC m=+6877.837359469" watchObservedRunningTime="2026-03-16 17:26:15.685527549 +0000 UTC m=+6877.839459206" Mar 16 17:26:15 crc kubenswrapper[5120]: I0316 17:26:15.726493 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/125118bd-be94-405c-b33a-54d886d78781-catalog-content\") pod \"community-operators-spb8z\" (UID: \"125118bd-be94-405c-b33a-54d886d78781\") " pod="openshift-marketplace/community-operators-spb8z" Mar 16 17:26:15 crc kubenswrapper[5120]: I0316 17:26:15.726655 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/125118bd-be94-405c-b33a-54d886d78781-utilities\") pod \"community-operators-spb8z\" (UID: \"125118bd-be94-405c-b33a-54d886d78781\") " pod="openshift-marketplace/community-operators-spb8z" Mar 16 17:26:15 crc kubenswrapper[5120]: I0316 17:26:15.727092 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6tpx5\" (UniqueName: \"kubernetes.io/projected/125118bd-be94-405c-b33a-54d886d78781-kube-api-access-6tpx5\") pod \"community-operators-spb8z\" (UID: \"125118bd-be94-405c-b33a-54d886d78781\") " pod="openshift-marketplace/community-operators-spb8z" Mar 16 17:26:15 crc kubenswrapper[5120]: I0316 17:26:15.829427 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/125118bd-be94-405c-b33a-54d886d78781-utilities\") pod \"community-operators-spb8z\" (UID: \"125118bd-be94-405c-b33a-54d886d78781\") " pod="openshift-marketplace/community-operators-spb8z" Mar 16 17:26:15 crc kubenswrapper[5120]: I0316 17:26:15.829621 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6tpx5\" (UniqueName: \"kubernetes.io/projected/125118bd-be94-405c-b33a-54d886d78781-kube-api-access-6tpx5\") pod \"community-operators-spb8z\" (UID: \"125118bd-be94-405c-b33a-54d886d78781\") " pod="openshift-marketplace/community-operators-spb8z" Mar 16 17:26:15 crc kubenswrapper[5120]: I0316 17:26:15.829718 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/125118bd-be94-405c-b33a-54d886d78781-catalog-content\") pod \"community-operators-spb8z\" (UID: \"125118bd-be94-405c-b33a-54d886d78781\") " pod="openshift-marketplace/community-operators-spb8z" Mar 16 17:26:15 crc kubenswrapper[5120]: I0316 17:26:15.830191 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/125118bd-be94-405c-b33a-54d886d78781-catalog-content\") pod \"community-operators-spb8z\" (UID: \"125118bd-be94-405c-b33a-54d886d78781\") " pod="openshift-marketplace/community-operators-spb8z" Mar 16 17:26:15 crc kubenswrapper[5120]: I0316 17:26:15.830411 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/125118bd-be94-405c-b33a-54d886d78781-utilities\") pod \"community-operators-spb8z\" (UID: \"125118bd-be94-405c-b33a-54d886d78781\") " pod="openshift-marketplace/community-operators-spb8z" Mar 16 17:26:15 crc kubenswrapper[5120]: I0316 17:26:15.860939 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6tpx5\" (UniqueName: \"kubernetes.io/projected/125118bd-be94-405c-b33a-54d886d78781-kube-api-access-6tpx5\") pod \"community-operators-spb8z\" (UID: \"125118bd-be94-405c-b33a-54d886d78781\") " pod="openshift-marketplace/community-operators-spb8z" Mar 16 17:26:15 crc kubenswrapper[5120]: I0316 17:26:15.930874 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-spb8z" Mar 16 17:26:16 crc kubenswrapper[5120]: I0316 17:26:16.399879 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/community-operators-spb8z"] Mar 16 17:26:16 crc kubenswrapper[5120]: I0316 17:26:16.674260 5120 generic.go:358] "Generic (PLEG): container finished" podID="647bf253-ef47-40c8-a7ad-d0a014574d07" containerID="2c1ba6d336b5012e01fbfce39f43e7f88bc27534b58b37da4dd9780159f265a6" exitCode=0 Mar 16 17:26:16 crc kubenswrapper[5120]: I0316 17:26:16.674298 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/install-os-edpm-multinodeset-edpm-compute-no-nodes-d6rc9" event={"ID":"647bf253-ef47-40c8-a7ad-d0a014574d07","Type":"ContainerDied","Data":"2c1ba6d336b5012e01fbfce39f43e7f88bc27534b58b37da4dd9780159f265a6"} Mar 16 17:26:16 crc kubenswrapper[5120]: I0316 17:26:16.677888 5120 generic.go:358] "Generic (PLEG): container finished" podID="125118bd-be94-405c-b33a-54d886d78781" containerID="fcb92cf9161ed65cbdecaea3e259cfb20bb7ca6c27cb6f62f419411aa4d4d943" exitCode=0 Mar 16 17:26:16 crc kubenswrapper[5120]: I0316 17:26:16.678405 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-spb8z" event={"ID":"125118bd-be94-405c-b33a-54d886d78781","Type":"ContainerDied","Data":"fcb92cf9161ed65cbdecaea3e259cfb20bb7ca6c27cb6f62f419411aa4d4d943"} Mar 16 17:26:16 crc kubenswrapper[5120]: I0316 17:26:16.678439 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-spb8z" event={"ID":"125118bd-be94-405c-b33a-54d886d78781","Type":"ContainerStarted","Data":"bf69b61b82aef92015647332ce2c23790508a79b8007012113157794d50a254b"} Mar 16 17:26:17 crc kubenswrapper[5120]: I0316 17:26:17.950874 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/install-os-edpm-multinodeset-edpm-compute-no-nodes-d6rc9" Mar 16 17:26:18 crc kubenswrapper[5120]: I0316 17:26:18.080520 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8ttlc\" (UniqueName: \"kubernetes.io/projected/647bf253-ef47-40c8-a7ad-d0a014574d07-kube-api-access-8ttlc\") pod \"647bf253-ef47-40c8-a7ad-d0a014574d07\" (UID: \"647bf253-ef47-40c8-a7ad-d0a014574d07\") " Mar 16 17:26:18 crc kubenswrapper[5120]: I0316 17:26:18.081501 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/647bf253-ef47-40c8-a7ad-d0a014574d07-inventory\") pod \"647bf253-ef47-40c8-a7ad-d0a014574d07\" (UID: \"647bf253-ef47-40c8-a7ad-d0a014574d07\") " Mar 16 17:26:18 crc kubenswrapper[5120]: I0316 17:26:18.081725 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/647bf253-ef47-40c8-a7ad-d0a014574d07-ssh-key-edpm-compute-no-nodes\") pod \"647bf253-ef47-40c8-a7ad-d0a014574d07\" (UID: \"647bf253-ef47-40c8-a7ad-d0a014574d07\") " Mar 16 17:26:18 crc kubenswrapper[5120]: I0316 17:26:18.087563 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/647bf253-ef47-40c8-a7ad-d0a014574d07-kube-api-access-8ttlc" (OuterVolumeSpecName: "kube-api-access-8ttlc") pod "647bf253-ef47-40c8-a7ad-d0a014574d07" (UID: "647bf253-ef47-40c8-a7ad-d0a014574d07"). InnerVolumeSpecName "kube-api-access-8ttlc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:26:18 crc kubenswrapper[5120]: I0316 17:26:18.106633 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/647bf253-ef47-40c8-a7ad-d0a014574d07-inventory" (OuterVolumeSpecName: "inventory") pod "647bf253-ef47-40c8-a7ad-d0a014574d07" (UID: "647bf253-ef47-40c8-a7ad-d0a014574d07"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:26:18 crc kubenswrapper[5120]: I0316 17:26:18.112438 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/647bf253-ef47-40c8-a7ad-d0a014574d07-ssh-key-edpm-compute-no-nodes" (OuterVolumeSpecName: "ssh-key-edpm-compute-no-nodes") pod "647bf253-ef47-40c8-a7ad-d0a014574d07" (UID: "647bf253-ef47-40c8-a7ad-d0a014574d07"). InnerVolumeSpecName "ssh-key-edpm-compute-no-nodes". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:26:18 crc kubenswrapper[5120]: I0316 17:26:18.185326 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8ttlc\" (UniqueName: \"kubernetes.io/projected/647bf253-ef47-40c8-a7ad-d0a014574d07-kube-api-access-8ttlc\") on node \"crc\" DevicePath \"\"" Mar 16 17:26:18 crc kubenswrapper[5120]: I0316 17:26:18.185370 5120 reconciler_common.go:299] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/647bf253-ef47-40c8-a7ad-d0a014574d07-inventory\") on node \"crc\" DevicePath \"\"" Mar 16 17:26:18 crc kubenswrapper[5120]: I0316 17:26:18.185381 5120 reconciler_common.go:299] "Volume detached for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/647bf253-ef47-40c8-a7ad-d0a014574d07-ssh-key-edpm-compute-no-nodes\") on node \"crc\" DevicePath \"\"" Mar 16 17:26:18 crc kubenswrapper[5120]: I0316 17:26:18.698588 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/install-os-edpm-multinodeset-edpm-compute-no-nodes-d6rc9" event={"ID":"647bf253-ef47-40c8-a7ad-d0a014574d07","Type":"ContainerDied","Data":"fe138d865bc6e1ca49d452ed09b745e8d12e0f576c9b050127cc667d8a9453b4"} Mar 16 17:26:18 crc kubenswrapper[5120]: I0316 17:26:18.698635 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fe138d865bc6e1ca49d452ed09b745e8d12e0f576c9b050127cc667d8a9453b4" Mar 16 17:26:18 crc kubenswrapper[5120]: I0316 17:26:18.698706 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/install-os-edpm-multinodeset-edpm-compute-no-nodes-d6rc9" Mar 16 17:26:18 crc kubenswrapper[5120]: I0316 17:26:18.705155 5120 generic.go:358] "Generic (PLEG): container finished" podID="125118bd-be94-405c-b33a-54d886d78781" containerID="47024c5c0b725df265bfdd96523145ab26ae1f65d3d9d988324fdcce27dc3626" exitCode=0 Mar 16 17:26:18 crc kubenswrapper[5120]: I0316 17:26:18.705219 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-spb8z" event={"ID":"125118bd-be94-405c-b33a-54d886d78781","Type":"ContainerDied","Data":"47024c5c0b725df265bfdd96523145ab26ae1f65d3d9d988324fdcce27dc3626"} Mar 16 17:26:18 crc kubenswrapper[5120]: I0316 17:26:18.774708 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/configure-os-edpm-multinodeset-edpm-compute-no-nodes-xgs8r"] Mar 16 17:26:18 crc kubenswrapper[5120]: I0316 17:26:18.776060 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="647bf253-ef47-40c8-a7ad-d0a014574d07" containerName="install-os-edpm-multinodeset-edpm-compute-no-nodes" Mar 16 17:26:18 crc kubenswrapper[5120]: I0316 17:26:18.776085 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="647bf253-ef47-40c8-a7ad-d0a014574d07" containerName="install-os-edpm-multinodeset-edpm-compute-no-nodes" Mar 16 17:26:18 crc kubenswrapper[5120]: I0316 17:26:18.776276 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="647bf253-ef47-40c8-a7ad-d0a014574d07" containerName="install-os-edpm-multinodeset-edpm-compute-no-nodes" Mar 16 17:26:18 crc kubenswrapper[5120]: I0316 17:26:18.792275 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/configure-os-edpm-multinodeset-edpm-compute-no-nodes-xgs8r" Mar 16 17:26:18 crc kubenswrapper[5120]: I0316 17:26:18.794231 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/configure-os-edpm-multinodeset-edpm-compute-no-nodes-xgs8r"] Mar 16 17:26:18 crc kubenswrapper[5120]: I0316 17:26:18.795545 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"edpm-compute-no-nodes-dockercfg-znndh\"" Mar 16 17:26:18 crc kubenswrapper[5120]: I0316 17:26:18.795573 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplane-ansible-ssh-private-key-secret\"" Mar 16 17:26:18 crc kubenswrapper[5120]: I0316 17:26:18.796782 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-aee-default-env\"" Mar 16 17:26:18 crc kubenswrapper[5120]: I0316 17:26:18.796857 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplanenodeset-edpm-compute-no-nodes\"" Mar 16 17:26:18 crc kubenswrapper[5120]: I0316 17:26:18.906108 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/60592e04-37e3-4147-8382-fdd1d841ec27-ssh-key-edpm-compute-no-nodes\") pod \"configure-os-edpm-multinodeset-edpm-compute-no-nodes-xgs8r\" (UID: \"60592e04-37e3-4147-8382-fdd1d841ec27\") " pod="openstack-kuttl-tests/configure-os-edpm-multinodeset-edpm-compute-no-nodes-xgs8r" Mar 16 17:26:18 crc kubenswrapper[5120]: I0316 17:26:18.906151 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/60592e04-37e3-4147-8382-fdd1d841ec27-inventory\") pod \"configure-os-edpm-multinodeset-edpm-compute-no-nodes-xgs8r\" (UID: \"60592e04-37e3-4147-8382-fdd1d841ec27\") " pod="openstack-kuttl-tests/configure-os-edpm-multinodeset-edpm-compute-no-nodes-xgs8r" Mar 16 17:26:18 crc kubenswrapper[5120]: I0316 17:26:18.906367 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gr26z\" (UniqueName: \"kubernetes.io/projected/60592e04-37e3-4147-8382-fdd1d841ec27-kube-api-access-gr26z\") pod \"configure-os-edpm-multinodeset-edpm-compute-no-nodes-xgs8r\" (UID: \"60592e04-37e3-4147-8382-fdd1d841ec27\") " pod="openstack-kuttl-tests/configure-os-edpm-multinodeset-edpm-compute-no-nodes-xgs8r" Mar 16 17:26:19 crc kubenswrapper[5120]: I0316 17:26:19.007885 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gr26z\" (UniqueName: \"kubernetes.io/projected/60592e04-37e3-4147-8382-fdd1d841ec27-kube-api-access-gr26z\") pod \"configure-os-edpm-multinodeset-edpm-compute-no-nodes-xgs8r\" (UID: \"60592e04-37e3-4147-8382-fdd1d841ec27\") " pod="openstack-kuttl-tests/configure-os-edpm-multinodeset-edpm-compute-no-nodes-xgs8r" Mar 16 17:26:19 crc kubenswrapper[5120]: I0316 17:26:19.008043 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/60592e04-37e3-4147-8382-fdd1d841ec27-ssh-key-edpm-compute-no-nodes\") pod \"configure-os-edpm-multinodeset-edpm-compute-no-nodes-xgs8r\" (UID: \"60592e04-37e3-4147-8382-fdd1d841ec27\") " pod="openstack-kuttl-tests/configure-os-edpm-multinodeset-edpm-compute-no-nodes-xgs8r" Mar 16 17:26:19 crc kubenswrapper[5120]: I0316 17:26:19.008068 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/60592e04-37e3-4147-8382-fdd1d841ec27-inventory\") pod \"configure-os-edpm-multinodeset-edpm-compute-no-nodes-xgs8r\" (UID: \"60592e04-37e3-4147-8382-fdd1d841ec27\") " pod="openstack-kuttl-tests/configure-os-edpm-multinodeset-edpm-compute-no-nodes-xgs8r" Mar 16 17:26:19 crc kubenswrapper[5120]: I0316 17:26:19.013177 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/60592e04-37e3-4147-8382-fdd1d841ec27-inventory\") pod \"configure-os-edpm-multinodeset-edpm-compute-no-nodes-xgs8r\" (UID: \"60592e04-37e3-4147-8382-fdd1d841ec27\") " pod="openstack-kuttl-tests/configure-os-edpm-multinodeset-edpm-compute-no-nodes-xgs8r" Mar 16 17:26:19 crc kubenswrapper[5120]: I0316 17:26:19.019654 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/60592e04-37e3-4147-8382-fdd1d841ec27-ssh-key-edpm-compute-no-nodes\") pod \"configure-os-edpm-multinodeset-edpm-compute-no-nodes-xgs8r\" (UID: \"60592e04-37e3-4147-8382-fdd1d841ec27\") " pod="openstack-kuttl-tests/configure-os-edpm-multinodeset-edpm-compute-no-nodes-xgs8r" Mar 16 17:26:19 crc kubenswrapper[5120]: I0316 17:26:19.029230 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gr26z\" (UniqueName: \"kubernetes.io/projected/60592e04-37e3-4147-8382-fdd1d841ec27-kube-api-access-gr26z\") pod \"configure-os-edpm-multinodeset-edpm-compute-no-nodes-xgs8r\" (UID: \"60592e04-37e3-4147-8382-fdd1d841ec27\") " pod="openstack-kuttl-tests/configure-os-edpm-multinodeset-edpm-compute-no-nodes-xgs8r" Mar 16 17:26:19 crc kubenswrapper[5120]: I0316 17:26:19.163247 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/configure-os-edpm-multinodeset-edpm-compute-no-nodes-xgs8r" Mar 16 17:26:19 crc kubenswrapper[5120]: I0316 17:26:19.570379 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/configure-os-edpm-multinodeset-edpm-compute-no-nodes-xgs8r"] Mar 16 17:26:19 crc kubenswrapper[5120]: W0316 17:26:19.574620 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod60592e04_37e3_4147_8382_fdd1d841ec27.slice/crio-e57a6673b2d6bc256c22c2ee81cb036a5e079e23ab40131df809c8fe92c24577 WatchSource:0}: Error finding container e57a6673b2d6bc256c22c2ee81cb036a5e079e23ab40131df809c8fe92c24577: Status 404 returned error can't find the container with id e57a6673b2d6bc256c22c2ee81cb036a5e079e23ab40131df809c8fe92c24577 Mar 16 17:26:19 crc kubenswrapper[5120]: I0316 17:26:19.716216 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/configure-os-edpm-multinodeset-edpm-compute-no-nodes-xgs8r" event={"ID":"60592e04-37e3-4147-8382-fdd1d841ec27","Type":"ContainerStarted","Data":"e57a6673b2d6bc256c22c2ee81cb036a5e079e23ab40131df809c8fe92c24577"} Mar 16 17:26:19 crc kubenswrapper[5120]: I0316 17:26:19.720029 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-spb8z" event={"ID":"125118bd-be94-405c-b33a-54d886d78781","Type":"ContainerStarted","Data":"7dfd379babec8cc52bc2336fa47af5bc996afe1f8eacee6b4498438bba1a8813"} Mar 16 17:26:19 crc kubenswrapper[5120]: I0316 17:26:19.742091 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/community-operators-spb8z" podStartSLOduration=3.840433858 podStartE2EDuration="4.742070346s" podCreationTimestamp="2026-03-16 17:26:15 +0000 UTC" firstStartedPulling="2026-03-16 17:26:16.679336695 +0000 UTC m=+6878.833268372" lastFinishedPulling="2026-03-16 17:26:17.580973203 +0000 UTC m=+6879.734904860" observedRunningTime="2026-03-16 17:26:19.738449386 +0000 UTC m=+6881.892381053" watchObservedRunningTime="2026-03-16 17:26:19.742070346 +0000 UTC m=+6881.896002003" Mar 16 17:26:20 crc kubenswrapper[5120]: I0316 17:26:20.731636 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/configure-os-edpm-multinodeset-edpm-compute-no-nodes-xgs8r" event={"ID":"60592e04-37e3-4147-8382-fdd1d841ec27","Type":"ContainerStarted","Data":"5d4095eace31f5292b15e66e8d027e3834f205d05b9409c08cab41b28926d936"} Mar 16 17:26:20 crc kubenswrapper[5120]: I0316 17:26:20.760734 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/configure-os-edpm-multinodeset-edpm-compute-no-nodes-xgs8r" podStartSLOduration=2.345025561 podStartE2EDuration="2.76071547s" podCreationTimestamp="2026-03-16 17:26:18 +0000 UTC" firstStartedPulling="2026-03-16 17:26:19.576171662 +0000 UTC m=+6881.730103319" lastFinishedPulling="2026-03-16 17:26:19.991861561 +0000 UTC m=+6882.145793228" observedRunningTime="2026-03-16 17:26:20.752561537 +0000 UTC m=+6882.906493204" watchObservedRunningTime="2026-03-16 17:26:20.76071547 +0000 UTC m=+6882.914647127" Mar 16 17:26:21 crc kubenswrapper[5120]: I0316 17:26:21.746447 5120 generic.go:358] "Generic (PLEG): container finished" podID="60592e04-37e3-4147-8382-fdd1d841ec27" containerID="5d4095eace31f5292b15e66e8d027e3834f205d05b9409c08cab41b28926d936" exitCode=0 Mar 16 17:26:21 crc kubenswrapper[5120]: I0316 17:26:21.746567 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/configure-os-edpm-multinodeset-edpm-compute-no-nodes-xgs8r" event={"ID":"60592e04-37e3-4147-8382-fdd1d841ec27","Type":"ContainerDied","Data":"5d4095eace31f5292b15e66e8d027e3834f205d05b9409c08cab41b28926d936"} Mar 16 17:26:23 crc kubenswrapper[5120]: I0316 17:26:23.036820 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/configure-os-edpm-multinodeset-edpm-compute-no-nodes-xgs8r" Mar 16 17:26:23 crc kubenswrapper[5120]: I0316 17:26:23.093333 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/60592e04-37e3-4147-8382-fdd1d841ec27-ssh-key-edpm-compute-no-nodes\") pod \"60592e04-37e3-4147-8382-fdd1d841ec27\" (UID: \"60592e04-37e3-4147-8382-fdd1d841ec27\") " Mar 16 17:26:23 crc kubenswrapper[5120]: I0316 17:26:23.093414 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gr26z\" (UniqueName: \"kubernetes.io/projected/60592e04-37e3-4147-8382-fdd1d841ec27-kube-api-access-gr26z\") pod \"60592e04-37e3-4147-8382-fdd1d841ec27\" (UID: \"60592e04-37e3-4147-8382-fdd1d841ec27\") " Mar 16 17:26:23 crc kubenswrapper[5120]: I0316 17:26:23.093911 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/60592e04-37e3-4147-8382-fdd1d841ec27-inventory\") pod \"60592e04-37e3-4147-8382-fdd1d841ec27\" (UID: \"60592e04-37e3-4147-8382-fdd1d841ec27\") " Mar 16 17:26:23 crc kubenswrapper[5120]: I0316 17:26:23.100050 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60592e04-37e3-4147-8382-fdd1d841ec27-kube-api-access-gr26z" (OuterVolumeSpecName: "kube-api-access-gr26z") pod "60592e04-37e3-4147-8382-fdd1d841ec27" (UID: "60592e04-37e3-4147-8382-fdd1d841ec27"). InnerVolumeSpecName "kube-api-access-gr26z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:26:23 crc kubenswrapper[5120]: I0316 17:26:23.115930 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/60592e04-37e3-4147-8382-fdd1d841ec27-ssh-key-edpm-compute-no-nodes" (OuterVolumeSpecName: "ssh-key-edpm-compute-no-nodes") pod "60592e04-37e3-4147-8382-fdd1d841ec27" (UID: "60592e04-37e3-4147-8382-fdd1d841ec27"). InnerVolumeSpecName "ssh-key-edpm-compute-no-nodes". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:26:23 crc kubenswrapper[5120]: I0316 17:26:23.116600 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/60592e04-37e3-4147-8382-fdd1d841ec27-inventory" (OuterVolumeSpecName: "inventory") pod "60592e04-37e3-4147-8382-fdd1d841ec27" (UID: "60592e04-37e3-4147-8382-fdd1d841ec27"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:26:23 crc kubenswrapper[5120]: I0316 17:26:23.196360 5120 reconciler_common.go:299] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/60592e04-37e3-4147-8382-fdd1d841ec27-inventory\") on node \"crc\" DevicePath \"\"" Mar 16 17:26:23 crc kubenswrapper[5120]: I0316 17:26:23.196393 5120 reconciler_common.go:299] "Volume detached for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/60592e04-37e3-4147-8382-fdd1d841ec27-ssh-key-edpm-compute-no-nodes\") on node \"crc\" DevicePath \"\"" Mar 16 17:26:23 crc kubenswrapper[5120]: I0316 17:26:23.196409 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gr26z\" (UniqueName: \"kubernetes.io/projected/60592e04-37e3-4147-8382-fdd1d841ec27-kube-api-access-gr26z\") on node \"crc\" DevicePath \"\"" Mar 16 17:26:23 crc kubenswrapper[5120]: I0316 17:26:23.772313 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/configure-os-edpm-multinodeset-edpm-compute-no-nodes-xgs8r" event={"ID":"60592e04-37e3-4147-8382-fdd1d841ec27","Type":"ContainerDied","Data":"e57a6673b2d6bc256c22c2ee81cb036a5e079e23ab40131df809c8fe92c24577"} Mar 16 17:26:23 crc kubenswrapper[5120]: I0316 17:26:23.772584 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e57a6673b2d6bc256c22c2ee81cb036a5e079e23ab40131df809c8fe92c24577" Mar 16 17:26:23 crc kubenswrapper[5120]: I0316 17:26:23.772431 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/configure-os-edpm-multinodeset-edpm-compute-no-nodes-xgs8r" Mar 16 17:26:23 crc kubenswrapper[5120]: I0316 17:26:23.823906 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/run-os-edpm-multinodeset-edpm-compute-no-nodes-m59w4"] Mar 16 17:26:23 crc kubenswrapper[5120]: I0316 17:26:23.826235 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60592e04-37e3-4147-8382-fdd1d841ec27" containerName="configure-os-edpm-multinodeset-edpm-compute-no-nodes" Mar 16 17:26:23 crc kubenswrapper[5120]: I0316 17:26:23.826266 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="60592e04-37e3-4147-8382-fdd1d841ec27" containerName="configure-os-edpm-multinodeset-edpm-compute-no-nodes" Mar 16 17:26:23 crc kubenswrapper[5120]: I0316 17:26:23.826430 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="60592e04-37e3-4147-8382-fdd1d841ec27" containerName="configure-os-edpm-multinodeset-edpm-compute-no-nodes" Mar 16 17:26:23 crc kubenswrapper[5120]: I0316 17:26:23.840028 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/run-os-edpm-multinodeset-edpm-compute-no-nodes-m59w4"] Mar 16 17:26:23 crc kubenswrapper[5120]: I0316 17:26:23.840217 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/run-os-edpm-multinodeset-edpm-compute-no-nodes-m59w4" Mar 16 17:26:23 crc kubenswrapper[5120]: I0316 17:26:23.844791 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-aee-default-env\"" Mar 16 17:26:23 crc kubenswrapper[5120]: I0316 17:26:23.845048 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"edpm-compute-no-nodes-dockercfg-znndh\"" Mar 16 17:26:23 crc kubenswrapper[5120]: I0316 17:26:23.845486 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplane-ansible-ssh-private-key-secret\"" Mar 16 17:26:23 crc kubenswrapper[5120]: I0316 17:26:23.845702 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplanenodeset-edpm-compute-no-nodes\"" Mar 16 17:26:23 crc kubenswrapper[5120]: I0316 17:26:23.911930 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/6a0c1a5e-04da-4494-a427-392ffed37244-ssh-key-edpm-compute-no-nodes\") pod \"run-os-edpm-multinodeset-edpm-compute-no-nodes-m59w4\" (UID: \"6a0c1a5e-04da-4494-a427-392ffed37244\") " pod="openstack-kuttl-tests/run-os-edpm-multinodeset-edpm-compute-no-nodes-m59w4" Mar 16 17:26:23 crc kubenswrapper[5120]: I0316 17:26:23.912028 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgbkm\" (UniqueName: \"kubernetes.io/projected/6a0c1a5e-04da-4494-a427-392ffed37244-kube-api-access-zgbkm\") pod \"run-os-edpm-multinodeset-edpm-compute-no-nodes-m59w4\" (UID: \"6a0c1a5e-04da-4494-a427-392ffed37244\") " pod="openstack-kuttl-tests/run-os-edpm-multinodeset-edpm-compute-no-nodes-m59w4" Mar 16 17:26:23 crc kubenswrapper[5120]: I0316 17:26:23.912180 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/6a0c1a5e-04da-4494-a427-392ffed37244-inventory\") pod \"run-os-edpm-multinodeset-edpm-compute-no-nodes-m59w4\" (UID: \"6a0c1a5e-04da-4494-a427-392ffed37244\") " pod="openstack-kuttl-tests/run-os-edpm-multinodeset-edpm-compute-no-nodes-m59w4" Mar 16 17:26:24 crc kubenswrapper[5120]: I0316 17:26:24.014234 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/6a0c1a5e-04da-4494-a427-392ffed37244-inventory\") pod \"run-os-edpm-multinodeset-edpm-compute-no-nodes-m59w4\" (UID: \"6a0c1a5e-04da-4494-a427-392ffed37244\") " pod="openstack-kuttl-tests/run-os-edpm-multinodeset-edpm-compute-no-nodes-m59w4" Mar 16 17:26:24 crc kubenswrapper[5120]: I0316 17:26:24.014527 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/6a0c1a5e-04da-4494-a427-392ffed37244-ssh-key-edpm-compute-no-nodes\") pod \"run-os-edpm-multinodeset-edpm-compute-no-nodes-m59w4\" (UID: \"6a0c1a5e-04da-4494-a427-392ffed37244\") " pod="openstack-kuttl-tests/run-os-edpm-multinodeset-edpm-compute-no-nodes-m59w4" Mar 16 17:26:24 crc kubenswrapper[5120]: I0316 17:26:24.014656 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zgbkm\" (UniqueName: \"kubernetes.io/projected/6a0c1a5e-04da-4494-a427-392ffed37244-kube-api-access-zgbkm\") pod \"run-os-edpm-multinodeset-edpm-compute-no-nodes-m59w4\" (UID: \"6a0c1a5e-04da-4494-a427-392ffed37244\") " pod="openstack-kuttl-tests/run-os-edpm-multinodeset-edpm-compute-no-nodes-m59w4" Mar 16 17:26:24 crc kubenswrapper[5120]: I0316 17:26:24.019154 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/6a0c1a5e-04da-4494-a427-392ffed37244-inventory\") pod \"run-os-edpm-multinodeset-edpm-compute-no-nodes-m59w4\" (UID: \"6a0c1a5e-04da-4494-a427-392ffed37244\") " pod="openstack-kuttl-tests/run-os-edpm-multinodeset-edpm-compute-no-nodes-m59w4" Mar 16 17:26:24 crc kubenswrapper[5120]: I0316 17:26:24.019218 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/6a0c1a5e-04da-4494-a427-392ffed37244-ssh-key-edpm-compute-no-nodes\") pod \"run-os-edpm-multinodeset-edpm-compute-no-nodes-m59w4\" (UID: \"6a0c1a5e-04da-4494-a427-392ffed37244\") " pod="openstack-kuttl-tests/run-os-edpm-multinodeset-edpm-compute-no-nodes-m59w4" Mar 16 17:26:24 crc kubenswrapper[5120]: I0316 17:26:24.029549 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgbkm\" (UniqueName: \"kubernetes.io/projected/6a0c1a5e-04da-4494-a427-392ffed37244-kube-api-access-zgbkm\") pod \"run-os-edpm-multinodeset-edpm-compute-no-nodes-m59w4\" (UID: \"6a0c1a5e-04da-4494-a427-392ffed37244\") " pod="openstack-kuttl-tests/run-os-edpm-multinodeset-edpm-compute-no-nodes-m59w4" Mar 16 17:26:24 crc kubenswrapper[5120]: I0316 17:26:24.162272 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/run-os-edpm-multinodeset-edpm-compute-no-nodes-m59w4" Mar 16 17:26:24 crc kubenswrapper[5120]: I0316 17:26:24.559168 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/run-os-edpm-multinodeset-edpm-compute-no-nodes-m59w4"] Mar 16 17:26:24 crc kubenswrapper[5120]: W0316 17:26:24.563291 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6a0c1a5e_04da_4494_a427_392ffed37244.slice/crio-38ff902a4cc993e06fe361e0454f178090fee65d5d990677cca11f6b001add3a WatchSource:0}: Error finding container 38ff902a4cc993e06fe361e0454f178090fee65d5d990677cca11f6b001add3a: Status 404 returned error can't find the container with id 38ff902a4cc993e06fe361e0454f178090fee65d5d990677cca11f6b001add3a Mar 16 17:26:24 crc kubenswrapper[5120]: I0316 17:26:24.782787 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/run-os-edpm-multinodeset-edpm-compute-no-nodes-m59w4" event={"ID":"6a0c1a5e-04da-4494-a427-392ffed37244","Type":"ContainerStarted","Data":"38ff902a4cc993e06fe361e0454f178090fee65d5d990677cca11f6b001add3a"} Mar 16 17:26:25 crc kubenswrapper[5120]: I0316 17:26:25.554048 5120 scope.go:117] "RemoveContainer" containerID="74071e54972f8b578c51149c44e1a701bf0ad1014b41797c40d6f94335cd1843" Mar 16 17:26:25 crc kubenswrapper[5120]: I0316 17:26:25.637945 5120 scope.go:117] "RemoveContainer" containerID="f5f52fb8379751eb34baf9768d46258cbf383a5789015ac8a5c3d5219444fc8b" Mar 16 17:26:25 crc kubenswrapper[5120]: I0316 17:26:25.692816 5120 scope.go:117] "RemoveContainer" containerID="bfa075f1f2cfaa5f473f62b680e98718a97895695933be4e9505f4b0d663459a" Mar 16 17:26:25 crc kubenswrapper[5120]: I0316 17:26:25.727243 5120 scope.go:117] "RemoveContainer" containerID="812b63c9828980ac8131599a518bcb66f145a0e2e45deefcf876d29e4f4f2fec" Mar 16 17:26:25 crc kubenswrapper[5120]: I0316 17:26:25.758042 5120 scope.go:117] "RemoveContainer" containerID="322747eda9006ff7d4e59e8a9356f5618021dd3ac30ec9a64b848d4659e0faa8" Mar 16 17:26:25 crc kubenswrapper[5120]: I0316 17:26:25.815343 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/run-os-edpm-multinodeset-edpm-compute-no-nodes-m59w4" event={"ID":"6a0c1a5e-04da-4494-a427-392ffed37244","Type":"ContainerStarted","Data":"6b89bf0aca6a82d2d9c95dfdb0653dd85b15a7a4eba4acd26c3613c487600621"} Mar 16 17:26:25 crc kubenswrapper[5120]: I0316 17:26:25.834057 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/run-os-edpm-multinodeset-edpm-compute-no-nodes-m59w4" podStartSLOduration=2.23573877 podStartE2EDuration="2.834037798s" podCreationTimestamp="2026-03-16 17:26:23 +0000 UTC" firstStartedPulling="2026-03-16 17:26:24.564867079 +0000 UTC m=+6886.718798736" lastFinishedPulling="2026-03-16 17:26:25.163166107 +0000 UTC m=+6887.317097764" observedRunningTime="2026-03-16 17:26:25.831146749 +0000 UTC m=+6887.985078426" watchObservedRunningTime="2026-03-16 17:26:25.834037798 +0000 UTC m=+6887.987969455" Mar 16 17:26:25 crc kubenswrapper[5120]: I0316 17:26:25.842261 5120 scope.go:117] "RemoveContainer" containerID="edf0142e43bf0653aede30db255bd4e35294389f21bf03ada5c25f3e8881fa96" Mar 16 17:26:25 crc kubenswrapper[5120]: I0316 17:26:25.863360 5120 scope.go:117] "RemoveContainer" containerID="5de07ced2092009f24435a75e942a466fe117b36b986a84740cbae9ef7397abb" Mar 16 17:26:25 crc kubenswrapper[5120]: I0316 17:26:25.885165 5120 scope.go:117] "RemoveContainer" containerID="d46b76d57a0182d62f31acab74f4f9b6368023dcdc3f4bcf2079d1a08cf478f7" Mar 16 17:26:25 crc kubenswrapper[5120]: I0316 17:26:25.907920 5120 scope.go:117] "RemoveContainer" containerID="041aa7f84ae7bfe944b6f83c5472e2c8858b115a6774424595ed0bb7b87d32d0" Mar 16 17:26:25 crc kubenswrapper[5120]: I0316 17:26:25.929378 5120 scope.go:117] "RemoveContainer" containerID="7e4613b63abd7a9ba8a958d75e431bbb4741e9a03a6efc019a4ad419bd12b76f" Mar 16 17:26:25 crc kubenswrapper[5120]: I0316 17:26:25.932010 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-marketplace/community-operators-spb8z" Mar 16 17:26:25 crc kubenswrapper[5120]: I0316 17:26:25.932044 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/community-operators-spb8z" Mar 16 17:26:25 crc kubenswrapper[5120]: I0316 17:26:25.953978 5120 scope.go:117] "RemoveContainer" containerID="4389fa3288353f00799a73ddeb8671c7e21f898ea7d60403340362f56599f173" Mar 16 17:26:25 crc kubenswrapper[5120]: I0316 17:26:25.969642 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/community-operators-spb8z" Mar 16 17:26:25 crc kubenswrapper[5120]: I0316 17:26:25.980420 5120 scope.go:117] "RemoveContainer" containerID="3efe3ba1329558a789748eeced2fb833e2fcb37c31820d947b4864ad64467d5f" Mar 16 17:26:26 crc kubenswrapper[5120]: I0316 17:26:26.007602 5120 scope.go:117] "RemoveContainer" containerID="850a877ea8085adffb221a96fed82ef9e52de59548601ca02ba08156c1816b53" Mar 16 17:26:26 crc kubenswrapper[5120]: I0316 17:26:26.834373 5120 generic.go:358] "Generic (PLEG): container finished" podID="6a0c1a5e-04da-4494-a427-392ffed37244" containerID="6b89bf0aca6a82d2d9c95dfdb0653dd85b15a7a4eba4acd26c3613c487600621" exitCode=0 Mar 16 17:26:26 crc kubenswrapper[5120]: I0316 17:26:26.834434 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/run-os-edpm-multinodeset-edpm-compute-no-nodes-m59w4" event={"ID":"6a0c1a5e-04da-4494-a427-392ffed37244","Type":"ContainerDied","Data":"6b89bf0aca6a82d2d9c95dfdb0653dd85b15a7a4eba4acd26c3613c487600621"} Mar 16 17:26:26 crc kubenswrapper[5120]: I0316 17:26:26.899678 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/community-operators-spb8z" Mar 16 17:26:26 crc kubenswrapper[5120]: I0316 17:26:26.939706 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/community-operators-spb8z"] Mar 16 17:26:28 crc kubenswrapper[5120]: I0316 17:26:28.140065 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/run-os-edpm-multinodeset-edpm-compute-no-nodes-m59w4" Mar 16 17:26:28 crc kubenswrapper[5120]: I0316 17:26:28.302381 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/6a0c1a5e-04da-4494-a427-392ffed37244-inventory\") pod \"6a0c1a5e-04da-4494-a427-392ffed37244\" (UID: \"6a0c1a5e-04da-4494-a427-392ffed37244\") " Mar 16 17:26:28 crc kubenswrapper[5120]: I0316 17:26:28.303224 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zgbkm\" (UniqueName: \"kubernetes.io/projected/6a0c1a5e-04da-4494-a427-392ffed37244-kube-api-access-zgbkm\") pod \"6a0c1a5e-04da-4494-a427-392ffed37244\" (UID: \"6a0c1a5e-04da-4494-a427-392ffed37244\") " Mar 16 17:26:28 crc kubenswrapper[5120]: I0316 17:26:28.303361 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/6a0c1a5e-04da-4494-a427-392ffed37244-ssh-key-edpm-compute-no-nodes\") pod \"6a0c1a5e-04da-4494-a427-392ffed37244\" (UID: \"6a0c1a5e-04da-4494-a427-392ffed37244\") " Mar 16 17:26:28 crc kubenswrapper[5120]: I0316 17:26:28.311459 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a0c1a5e-04da-4494-a427-392ffed37244-kube-api-access-zgbkm" (OuterVolumeSpecName: "kube-api-access-zgbkm") pod "6a0c1a5e-04da-4494-a427-392ffed37244" (UID: "6a0c1a5e-04da-4494-a427-392ffed37244"). InnerVolumeSpecName "kube-api-access-zgbkm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:26:28 crc kubenswrapper[5120]: I0316 17:26:28.329440 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a0c1a5e-04da-4494-a427-392ffed37244-inventory" (OuterVolumeSpecName: "inventory") pod "6a0c1a5e-04da-4494-a427-392ffed37244" (UID: "6a0c1a5e-04da-4494-a427-392ffed37244"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:26:28 crc kubenswrapper[5120]: I0316 17:26:28.329549 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a0c1a5e-04da-4494-a427-392ffed37244-ssh-key-edpm-compute-no-nodes" (OuterVolumeSpecName: "ssh-key-edpm-compute-no-nodes") pod "6a0c1a5e-04da-4494-a427-392ffed37244" (UID: "6a0c1a5e-04da-4494-a427-392ffed37244"). InnerVolumeSpecName "ssh-key-edpm-compute-no-nodes". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:26:28 crc kubenswrapper[5120]: I0316 17:26:28.406126 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zgbkm\" (UniqueName: \"kubernetes.io/projected/6a0c1a5e-04da-4494-a427-392ffed37244-kube-api-access-zgbkm\") on node \"crc\" DevicePath \"\"" Mar 16 17:26:28 crc kubenswrapper[5120]: I0316 17:26:28.406170 5120 reconciler_common.go:299] "Volume detached for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/6a0c1a5e-04da-4494-a427-392ffed37244-ssh-key-edpm-compute-no-nodes\") on node \"crc\" DevicePath \"\"" Mar 16 17:26:28 crc kubenswrapper[5120]: I0316 17:26:28.406188 5120 reconciler_common.go:299] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/6a0c1a5e-04da-4494-a427-392ffed37244-inventory\") on node \"crc\" DevicePath \"\"" Mar 16 17:26:28 crc kubenswrapper[5120]: I0316 17:26:28.854462 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/run-os-edpm-multinodeset-edpm-compute-no-nodes-m59w4" Mar 16 17:26:28 crc kubenswrapper[5120]: I0316 17:26:28.854832 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-marketplace/community-operators-spb8z" podUID="125118bd-be94-405c-b33a-54d886d78781" containerName="registry-server" containerID="cri-o://7dfd379babec8cc52bc2336fa47af5bc996afe1f8eacee6b4498438bba1a8813" gracePeriod=2 Mar 16 17:26:28 crc kubenswrapper[5120]: I0316 17:26:28.854460 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/run-os-edpm-multinodeset-edpm-compute-no-nodes-m59w4" event={"ID":"6a0c1a5e-04da-4494-a427-392ffed37244","Type":"ContainerDied","Data":"38ff902a4cc993e06fe361e0454f178090fee65d5d990677cca11f6b001add3a"} Mar 16 17:26:28 crc kubenswrapper[5120]: I0316 17:26:28.854934 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="38ff902a4cc993e06fe361e0454f178090fee65d5d990677cca11f6b001add3a" Mar 16 17:26:28 crc kubenswrapper[5120]: I0316 17:26:28.924383 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-no-nodes-qmh89"] Mar 16 17:26:28 crc kubenswrapper[5120]: I0316 17:26:28.925523 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a0c1a5e-04da-4494-a427-392ffed37244" containerName="run-os-edpm-multinodeset-edpm-compute-no-nodes" Mar 16 17:26:28 crc kubenswrapper[5120]: I0316 17:26:28.925542 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a0c1a5e-04da-4494-a427-392ffed37244" containerName="run-os-edpm-multinodeset-edpm-compute-no-nodes" Mar 16 17:26:28 crc kubenswrapper[5120]: I0316 17:26:28.925726 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="6a0c1a5e-04da-4494-a427-392ffed37244" containerName="run-os-edpm-multinodeset-edpm-compute-no-nodes" Mar 16 17:26:28 crc kubenswrapper[5120]: I0316 17:26:28.930973 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-no-nodes-qmh89" Mar 16 17:26:28 crc kubenswrapper[5120]: I0316 17:26:28.934181 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"combined-ca-bundle\"" Mar 16 17:26:28 crc kubenswrapper[5120]: I0316 17:26:28.934296 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"edpm-compute-no-nodes-dockercfg-znndh\"" Mar 16 17:26:28 crc kubenswrapper[5120]: I0316 17:26:28.934294 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplane-ansible-ssh-private-key-secret\"" Mar 16 17:26:28 crc kubenswrapper[5120]: I0316 17:26:28.934449 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-aee-default-env\"" Mar 16 17:26:28 crc kubenswrapper[5120]: I0316 17:26:28.935842 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplanenodeset-edpm-compute-no-nodes\"" Mar 16 17:26:28 crc kubenswrapper[5120]: I0316 17:26:28.942854 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-no-nodes-qmh89"] Mar 16 17:26:29 crc kubenswrapper[5120]: I0316 17:26:29.017588 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"neutron-metadata-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b-neutron-metadata-combined-ca-bundle\") pod \"install-certs-edpm-multinodeset-edpm-compute-no-nodes-qmh89\" (UID: \"eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-no-nodes-qmh89" Mar 16 17:26:29 crc kubenswrapper[5120]: I0316 17:26:29.017652 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b-inventory\") pod \"install-certs-edpm-multinodeset-edpm-compute-no-nodes-qmh89\" (UID: \"eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-no-nodes-qmh89" Mar 16 17:26:29 crc kubenswrapper[5120]: I0316 17:26:29.017790 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"libvirt-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b-libvirt-combined-ca-bundle\") pod \"install-certs-edpm-multinodeset-edpm-compute-no-nodes-qmh89\" (UID: \"eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-no-nodes-qmh89" Mar 16 17:26:29 crc kubenswrapper[5120]: I0316 17:26:29.017889 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"neutron-ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b-neutron-ovn-combined-ca-bundle\") pod \"install-certs-edpm-multinodeset-edpm-compute-no-nodes-qmh89\" (UID: \"eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-no-nodes-qmh89" Mar 16 17:26:29 crc kubenswrapper[5120]: I0316 17:26:29.018006 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"neutron-dhcp-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b-neutron-dhcp-combined-ca-bundle\") pod \"install-certs-edpm-multinodeset-edpm-compute-no-nodes-qmh89\" (UID: \"eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-no-nodes-qmh89" Mar 16 17:26:29 crc kubenswrapper[5120]: I0316 17:26:29.018221 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxc92\" (UniqueName: \"kubernetes.io/projected/eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b-kube-api-access-zxc92\") pod \"install-certs-edpm-multinodeset-edpm-compute-no-nodes-qmh89\" (UID: \"eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-no-nodes-qmh89" Mar 16 17:26:29 crc kubenswrapper[5120]: I0316 17:26:29.018323 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b-ovn-combined-ca-bundle\") pod \"install-certs-edpm-multinodeset-edpm-compute-no-nodes-qmh89\" (UID: \"eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-no-nodes-qmh89" Mar 16 17:26:29 crc kubenswrapper[5120]: I0316 17:26:29.018415 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bootstrap-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b-bootstrap-combined-ca-bundle\") pod \"install-certs-edpm-multinodeset-edpm-compute-no-nodes-qmh89\" (UID: \"eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-no-nodes-qmh89" Mar 16 17:26:29 crc kubenswrapper[5120]: I0316 17:26:29.018458 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b-ssh-key-edpm-compute-no-nodes\") pod \"install-certs-edpm-multinodeset-edpm-compute-no-nodes-qmh89\" (UID: \"eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-no-nodes-qmh89" Mar 16 17:26:29 crc kubenswrapper[5120]: I0316 17:26:29.018642 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b-nova-combined-ca-bundle\") pod \"install-certs-edpm-multinodeset-edpm-compute-no-nodes-qmh89\" (UID: \"eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-no-nodes-qmh89" Mar 16 17:26:29 crc kubenswrapper[5120]: I0316 17:26:29.018738 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"neutron-sriov-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b-neutron-sriov-combined-ca-bundle\") pod \"install-certs-edpm-multinodeset-edpm-compute-no-nodes-qmh89\" (UID: \"eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-no-nodes-qmh89" Mar 16 17:26:29 crc kubenswrapper[5120]: I0316 17:26:29.120523 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b-nova-combined-ca-bundle\") pod \"install-certs-edpm-multinodeset-edpm-compute-no-nodes-qmh89\" (UID: \"eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-no-nodes-qmh89" Mar 16 17:26:29 crc kubenswrapper[5120]: I0316 17:26:29.121159 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"neutron-sriov-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b-neutron-sriov-combined-ca-bundle\") pod \"install-certs-edpm-multinodeset-edpm-compute-no-nodes-qmh89\" (UID: \"eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-no-nodes-qmh89" Mar 16 17:26:29 crc kubenswrapper[5120]: I0316 17:26:29.121343 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"neutron-metadata-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b-neutron-metadata-combined-ca-bundle\") pod \"install-certs-edpm-multinodeset-edpm-compute-no-nodes-qmh89\" (UID: \"eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-no-nodes-qmh89" Mar 16 17:26:29 crc kubenswrapper[5120]: I0316 17:26:29.121782 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b-inventory\") pod \"install-certs-edpm-multinodeset-edpm-compute-no-nodes-qmh89\" (UID: \"eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-no-nodes-qmh89" Mar 16 17:26:29 crc kubenswrapper[5120]: I0316 17:26:29.121881 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"libvirt-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b-libvirt-combined-ca-bundle\") pod \"install-certs-edpm-multinodeset-edpm-compute-no-nodes-qmh89\" (UID: \"eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-no-nodes-qmh89" Mar 16 17:26:29 crc kubenswrapper[5120]: I0316 17:26:29.121909 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"neutron-ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b-neutron-ovn-combined-ca-bundle\") pod \"install-certs-edpm-multinodeset-edpm-compute-no-nodes-qmh89\" (UID: \"eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-no-nodes-qmh89" Mar 16 17:26:29 crc kubenswrapper[5120]: I0316 17:26:29.121989 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"neutron-dhcp-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b-neutron-dhcp-combined-ca-bundle\") pod \"install-certs-edpm-multinodeset-edpm-compute-no-nodes-qmh89\" (UID: \"eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-no-nodes-qmh89" Mar 16 17:26:29 crc kubenswrapper[5120]: I0316 17:26:29.122051 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zxc92\" (UniqueName: \"kubernetes.io/projected/eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b-kube-api-access-zxc92\") pod \"install-certs-edpm-multinodeset-edpm-compute-no-nodes-qmh89\" (UID: \"eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-no-nodes-qmh89" Mar 16 17:26:29 crc kubenswrapper[5120]: I0316 17:26:29.122101 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b-ovn-combined-ca-bundle\") pod \"install-certs-edpm-multinodeset-edpm-compute-no-nodes-qmh89\" (UID: \"eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-no-nodes-qmh89" Mar 16 17:26:29 crc kubenswrapper[5120]: I0316 17:26:29.122144 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bootstrap-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b-bootstrap-combined-ca-bundle\") pod \"install-certs-edpm-multinodeset-edpm-compute-no-nodes-qmh89\" (UID: \"eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-no-nodes-qmh89" Mar 16 17:26:29 crc kubenswrapper[5120]: I0316 17:26:29.122208 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b-ssh-key-edpm-compute-no-nodes\") pod \"install-certs-edpm-multinodeset-edpm-compute-no-nodes-qmh89\" (UID: \"eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-no-nodes-qmh89" Mar 16 17:26:29 crc kubenswrapper[5120]: I0316 17:26:29.126415 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b-nova-combined-ca-bundle\") pod \"install-certs-edpm-multinodeset-edpm-compute-no-nodes-qmh89\" (UID: \"eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-no-nodes-qmh89" Mar 16 17:26:29 crc kubenswrapper[5120]: I0316 17:26:29.126679 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"libvirt-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b-libvirt-combined-ca-bundle\") pod \"install-certs-edpm-multinodeset-edpm-compute-no-nodes-qmh89\" (UID: \"eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-no-nodes-qmh89" Mar 16 17:26:29 crc kubenswrapper[5120]: I0316 17:26:29.141575 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"neutron-metadata-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b-neutron-metadata-combined-ca-bundle\") pod \"install-certs-edpm-multinodeset-edpm-compute-no-nodes-qmh89\" (UID: \"eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-no-nodes-qmh89" Mar 16 17:26:29 crc kubenswrapper[5120]: I0316 17:26:29.143002 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b-inventory\") pod \"install-certs-edpm-multinodeset-edpm-compute-no-nodes-qmh89\" (UID: \"eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-no-nodes-qmh89" Mar 16 17:26:29 crc kubenswrapper[5120]: I0316 17:26:29.144207 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b-ovn-combined-ca-bundle\") pod \"install-certs-edpm-multinodeset-edpm-compute-no-nodes-qmh89\" (UID: \"eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-no-nodes-qmh89" Mar 16 17:26:29 crc kubenswrapper[5120]: I0316 17:26:29.144877 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"neutron-ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b-neutron-ovn-combined-ca-bundle\") pod \"install-certs-edpm-multinodeset-edpm-compute-no-nodes-qmh89\" (UID: \"eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-no-nodes-qmh89" Mar 16 17:26:29 crc kubenswrapper[5120]: I0316 17:26:29.145043 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"neutron-sriov-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b-neutron-sriov-combined-ca-bundle\") pod \"install-certs-edpm-multinodeset-edpm-compute-no-nodes-qmh89\" (UID: \"eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-no-nodes-qmh89" Mar 16 17:26:29 crc kubenswrapper[5120]: I0316 17:26:29.145263 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"neutron-dhcp-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b-neutron-dhcp-combined-ca-bundle\") pod \"install-certs-edpm-multinodeset-edpm-compute-no-nodes-qmh89\" (UID: \"eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-no-nodes-qmh89" Mar 16 17:26:29 crc kubenswrapper[5120]: I0316 17:26:29.147494 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b-ssh-key-edpm-compute-no-nodes\") pod \"install-certs-edpm-multinodeset-edpm-compute-no-nodes-qmh89\" (UID: \"eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-no-nodes-qmh89" Mar 16 17:26:29 crc kubenswrapper[5120]: I0316 17:26:29.147595 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bootstrap-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b-bootstrap-combined-ca-bundle\") pod \"install-certs-edpm-multinodeset-edpm-compute-no-nodes-qmh89\" (UID: \"eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-no-nodes-qmh89" Mar 16 17:26:29 crc kubenswrapper[5120]: I0316 17:26:29.148101 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxc92\" (UniqueName: \"kubernetes.io/projected/eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b-kube-api-access-zxc92\") pod \"install-certs-edpm-multinodeset-edpm-compute-no-nodes-qmh89\" (UID: \"eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-no-nodes-qmh89" Mar 16 17:26:29 crc kubenswrapper[5120]: I0316 17:26:29.295333 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-spb8z" Mar 16 17:26:29 crc kubenswrapper[5120]: I0316 17:26:29.326259 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/125118bd-be94-405c-b33a-54d886d78781-catalog-content\") pod \"125118bd-be94-405c-b33a-54d886d78781\" (UID: \"125118bd-be94-405c-b33a-54d886d78781\") " Mar 16 17:26:29 crc kubenswrapper[5120]: I0316 17:26:29.326615 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/125118bd-be94-405c-b33a-54d886d78781-utilities\") pod \"125118bd-be94-405c-b33a-54d886d78781\" (UID: \"125118bd-be94-405c-b33a-54d886d78781\") " Mar 16 17:26:29 crc kubenswrapper[5120]: I0316 17:26:29.326684 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6tpx5\" (UniqueName: \"kubernetes.io/projected/125118bd-be94-405c-b33a-54d886d78781-kube-api-access-6tpx5\") pod \"125118bd-be94-405c-b33a-54d886d78781\" (UID: \"125118bd-be94-405c-b33a-54d886d78781\") " Mar 16 17:26:29 crc kubenswrapper[5120]: I0316 17:26:29.327872 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/125118bd-be94-405c-b33a-54d886d78781-utilities" (OuterVolumeSpecName: "utilities") pod "125118bd-be94-405c-b33a-54d886d78781" (UID: "125118bd-be94-405c-b33a-54d886d78781"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:26:29 crc kubenswrapper[5120]: I0316 17:26:29.335528 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/125118bd-be94-405c-b33a-54d886d78781-kube-api-access-6tpx5" (OuterVolumeSpecName: "kube-api-access-6tpx5") pod "125118bd-be94-405c-b33a-54d886d78781" (UID: "125118bd-be94-405c-b33a-54d886d78781"). InnerVolumeSpecName "kube-api-access-6tpx5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:26:29 crc kubenswrapper[5120]: I0316 17:26:29.341050 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-no-nodes-qmh89" Mar 16 17:26:29 crc kubenswrapper[5120]: I0316 17:26:29.400551 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/125118bd-be94-405c-b33a-54d886d78781-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "125118bd-be94-405c-b33a-54d886d78781" (UID: "125118bd-be94-405c-b33a-54d886d78781"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:26:29 crc kubenswrapper[5120]: I0316 17:26:29.429693 5120 reconciler_common.go:299] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/125118bd-be94-405c-b33a-54d886d78781-utilities\") on node \"crc\" DevicePath \"\"" Mar 16 17:26:29 crc kubenswrapper[5120]: I0316 17:26:29.429737 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6tpx5\" (UniqueName: \"kubernetes.io/projected/125118bd-be94-405c-b33a-54d886d78781-kube-api-access-6tpx5\") on node \"crc\" DevicePath \"\"" Mar 16 17:26:29 crc kubenswrapper[5120]: I0316 17:26:29.429752 5120 reconciler_common.go:299] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/125118bd-be94-405c-b33a-54d886d78781-catalog-content\") on node \"crc\" DevicePath \"\"" Mar 16 17:26:29 crc kubenswrapper[5120]: I0316 17:26:29.775628 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-no-nodes-qmh89"] Mar 16 17:26:29 crc kubenswrapper[5120]: W0316 17:26:29.779001 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podeeca88f7_db95_4cb5_a6b9_f8d4cb7a427b.slice/crio-ac7242857a56512a564d6e607d606409640c52b1160ca2b2d9e642e5cfa58d95 WatchSource:0}: Error finding container ac7242857a56512a564d6e607d606409640c52b1160ca2b2d9e642e5cfa58d95: Status 404 returned error can't find the container with id ac7242857a56512a564d6e607d606409640c52b1160ca2b2d9e642e5cfa58d95 Mar 16 17:26:29 crc kubenswrapper[5120]: I0316 17:26:29.866815 5120 generic.go:358] "Generic (PLEG): container finished" podID="125118bd-be94-405c-b33a-54d886d78781" containerID="7dfd379babec8cc52bc2336fa47af5bc996afe1f8eacee6b4498438bba1a8813" exitCode=0 Mar 16 17:26:29 crc kubenswrapper[5120]: I0316 17:26:29.866862 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-spb8z" event={"ID":"125118bd-be94-405c-b33a-54d886d78781","Type":"ContainerDied","Data":"7dfd379babec8cc52bc2336fa47af5bc996afe1f8eacee6b4498438bba1a8813"} Mar 16 17:26:29 crc kubenswrapper[5120]: I0316 17:26:29.867185 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-spb8z" event={"ID":"125118bd-be94-405c-b33a-54d886d78781","Type":"ContainerDied","Data":"bf69b61b82aef92015647332ce2c23790508a79b8007012113157794d50a254b"} Mar 16 17:26:29 crc kubenswrapper[5120]: I0316 17:26:29.866926 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-spb8z" Mar 16 17:26:29 crc kubenswrapper[5120]: I0316 17:26:29.867215 5120 scope.go:117] "RemoveContainer" containerID="7dfd379babec8cc52bc2336fa47af5bc996afe1f8eacee6b4498438bba1a8813" Mar 16 17:26:29 crc kubenswrapper[5120]: I0316 17:26:29.869255 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-no-nodes-qmh89" event={"ID":"eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b","Type":"ContainerStarted","Data":"ac7242857a56512a564d6e607d606409640c52b1160ca2b2d9e642e5cfa58d95"} Mar 16 17:26:29 crc kubenswrapper[5120]: I0316 17:26:29.889853 5120 scope.go:117] "RemoveContainer" containerID="47024c5c0b725df265bfdd96523145ab26ae1f65d3d9d988324fdcce27dc3626" Mar 16 17:26:29 crc kubenswrapper[5120]: I0316 17:26:29.900707 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/community-operators-spb8z"] Mar 16 17:26:29 crc kubenswrapper[5120]: I0316 17:26:29.908649 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/community-operators-spb8z"] Mar 16 17:26:29 crc kubenswrapper[5120]: I0316 17:26:29.937823 5120 scope.go:117] "RemoveContainer" containerID="fcb92cf9161ed65cbdecaea3e259cfb20bb7ca6c27cb6f62f419411aa4d4d943" Mar 16 17:26:29 crc kubenswrapper[5120]: I0316 17:26:29.964901 5120 scope.go:117] "RemoveContainer" containerID="7dfd379babec8cc52bc2336fa47af5bc996afe1f8eacee6b4498438bba1a8813" Mar 16 17:26:29 crc kubenswrapper[5120]: E0316 17:26:29.965400 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7dfd379babec8cc52bc2336fa47af5bc996afe1f8eacee6b4498438bba1a8813\": container with ID starting with 7dfd379babec8cc52bc2336fa47af5bc996afe1f8eacee6b4498438bba1a8813 not found: ID does not exist" containerID="7dfd379babec8cc52bc2336fa47af5bc996afe1f8eacee6b4498438bba1a8813" Mar 16 17:26:29 crc kubenswrapper[5120]: I0316 17:26:29.965449 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7dfd379babec8cc52bc2336fa47af5bc996afe1f8eacee6b4498438bba1a8813"} err="failed to get container status \"7dfd379babec8cc52bc2336fa47af5bc996afe1f8eacee6b4498438bba1a8813\": rpc error: code = NotFound desc = could not find container \"7dfd379babec8cc52bc2336fa47af5bc996afe1f8eacee6b4498438bba1a8813\": container with ID starting with 7dfd379babec8cc52bc2336fa47af5bc996afe1f8eacee6b4498438bba1a8813 not found: ID does not exist" Mar 16 17:26:29 crc kubenswrapper[5120]: I0316 17:26:29.965473 5120 scope.go:117] "RemoveContainer" containerID="47024c5c0b725df265bfdd96523145ab26ae1f65d3d9d988324fdcce27dc3626" Mar 16 17:26:29 crc kubenswrapper[5120]: E0316 17:26:29.966004 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"47024c5c0b725df265bfdd96523145ab26ae1f65d3d9d988324fdcce27dc3626\": container with ID starting with 47024c5c0b725df265bfdd96523145ab26ae1f65d3d9d988324fdcce27dc3626 not found: ID does not exist" containerID="47024c5c0b725df265bfdd96523145ab26ae1f65d3d9d988324fdcce27dc3626" Mar 16 17:26:29 crc kubenswrapper[5120]: I0316 17:26:29.966070 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47024c5c0b725df265bfdd96523145ab26ae1f65d3d9d988324fdcce27dc3626"} err="failed to get container status \"47024c5c0b725df265bfdd96523145ab26ae1f65d3d9d988324fdcce27dc3626\": rpc error: code = NotFound desc = could not find container \"47024c5c0b725df265bfdd96523145ab26ae1f65d3d9d988324fdcce27dc3626\": container with ID starting with 47024c5c0b725df265bfdd96523145ab26ae1f65d3d9d988324fdcce27dc3626 not found: ID does not exist" Mar 16 17:26:29 crc kubenswrapper[5120]: I0316 17:26:29.966092 5120 scope.go:117] "RemoveContainer" containerID="fcb92cf9161ed65cbdecaea3e259cfb20bb7ca6c27cb6f62f419411aa4d4d943" Mar 16 17:26:29 crc kubenswrapper[5120]: E0316 17:26:29.966498 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fcb92cf9161ed65cbdecaea3e259cfb20bb7ca6c27cb6f62f419411aa4d4d943\": container with ID starting with fcb92cf9161ed65cbdecaea3e259cfb20bb7ca6c27cb6f62f419411aa4d4d943 not found: ID does not exist" containerID="fcb92cf9161ed65cbdecaea3e259cfb20bb7ca6c27cb6f62f419411aa4d4d943" Mar 16 17:26:29 crc kubenswrapper[5120]: I0316 17:26:29.966538 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fcb92cf9161ed65cbdecaea3e259cfb20bb7ca6c27cb6f62f419411aa4d4d943"} err="failed to get container status \"fcb92cf9161ed65cbdecaea3e259cfb20bb7ca6c27cb6f62f419411aa4d4d943\": rpc error: code = NotFound desc = could not find container \"fcb92cf9161ed65cbdecaea3e259cfb20bb7ca6c27cb6f62f419411aa4d4d943\": container with ID starting with fcb92cf9161ed65cbdecaea3e259cfb20bb7ca6c27cb6f62f419411aa4d4d943 not found: ID does not exist" Mar 16 17:26:30 crc kubenswrapper[5120]: I0316 17:26:30.680089 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="125118bd-be94-405c-b33a-54d886d78781" path="/var/lib/kubelet/pods/125118bd-be94-405c-b33a-54d886d78781/volumes" Mar 16 17:26:30 crc kubenswrapper[5120]: I0316 17:26:30.886088 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-no-nodes-qmh89" event={"ID":"eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b","Type":"ContainerStarted","Data":"2e09128ad370e2f003150c7f73759e46b02933b5202888ca938417844c45409b"} Mar 16 17:26:30 crc kubenswrapper[5120]: I0316 17:26:30.910900 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-no-nodes-qmh89" podStartSLOduration=2.471679432 podStartE2EDuration="2.910882824s" podCreationTimestamp="2026-03-16 17:26:28 +0000 UTC" firstStartedPulling="2026-03-16 17:26:29.780381343 +0000 UTC m=+6891.934313000" lastFinishedPulling="2026-03-16 17:26:30.219584735 +0000 UTC m=+6892.373516392" observedRunningTime="2026-03-16 17:26:30.902287109 +0000 UTC m=+6893.056218786" watchObservedRunningTime="2026-03-16 17:26:30.910882824 +0000 UTC m=+6893.064814481" Mar 16 17:26:31 crc kubenswrapper[5120]: I0316 17:26:31.612972 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-operators-hbphh"] Mar 16 17:26:31 crc kubenswrapper[5120]: I0316 17:26:31.614589 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="125118bd-be94-405c-b33a-54d886d78781" containerName="registry-server" Mar 16 17:26:31 crc kubenswrapper[5120]: I0316 17:26:31.614684 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="125118bd-be94-405c-b33a-54d886d78781" containerName="registry-server" Mar 16 17:26:31 crc kubenswrapper[5120]: I0316 17:26:31.614749 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="125118bd-be94-405c-b33a-54d886d78781" containerName="extract-content" Mar 16 17:26:31 crc kubenswrapper[5120]: I0316 17:26:31.614879 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="125118bd-be94-405c-b33a-54d886d78781" containerName="extract-content" Mar 16 17:26:31 crc kubenswrapper[5120]: I0316 17:26:31.614954 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="125118bd-be94-405c-b33a-54d886d78781" containerName="extract-utilities" Mar 16 17:26:31 crc kubenswrapper[5120]: I0316 17:26:31.615002 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="125118bd-be94-405c-b33a-54d886d78781" containerName="extract-utilities" Mar 16 17:26:31 crc kubenswrapper[5120]: I0316 17:26:31.615200 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="125118bd-be94-405c-b33a-54d886d78781" containerName="registry-server" Mar 16 17:26:31 crc kubenswrapper[5120]: I0316 17:26:31.619731 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-hbphh" Mar 16 17:26:31 crc kubenswrapper[5120]: I0316 17:26:31.634419 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-hbphh"] Mar 16 17:26:31 crc kubenswrapper[5120]: I0316 17:26:31.677185 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/dfe750b5-405d-4458-9209-6be15f12e3a7-catalog-content\") pod \"redhat-operators-hbphh\" (UID: \"dfe750b5-405d-4458-9209-6be15f12e3a7\") " pod="openshift-marketplace/redhat-operators-hbphh" Mar 16 17:26:31 crc kubenswrapper[5120]: I0316 17:26:31.677515 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zk92b\" (UniqueName: \"kubernetes.io/projected/dfe750b5-405d-4458-9209-6be15f12e3a7-kube-api-access-zk92b\") pod \"redhat-operators-hbphh\" (UID: \"dfe750b5-405d-4458-9209-6be15f12e3a7\") " pod="openshift-marketplace/redhat-operators-hbphh" Mar 16 17:26:31 crc kubenswrapper[5120]: I0316 17:26:31.677704 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/dfe750b5-405d-4458-9209-6be15f12e3a7-utilities\") pod \"redhat-operators-hbphh\" (UID: \"dfe750b5-405d-4458-9209-6be15f12e3a7\") " pod="openshift-marketplace/redhat-operators-hbphh" Mar 16 17:26:31 crc kubenswrapper[5120]: I0316 17:26:31.780062 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/dfe750b5-405d-4458-9209-6be15f12e3a7-catalog-content\") pod \"redhat-operators-hbphh\" (UID: \"dfe750b5-405d-4458-9209-6be15f12e3a7\") " pod="openshift-marketplace/redhat-operators-hbphh" Mar 16 17:26:31 crc kubenswrapper[5120]: I0316 17:26:31.780577 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/dfe750b5-405d-4458-9209-6be15f12e3a7-catalog-content\") pod \"redhat-operators-hbphh\" (UID: \"dfe750b5-405d-4458-9209-6be15f12e3a7\") " pod="openshift-marketplace/redhat-operators-hbphh" Mar 16 17:26:31 crc kubenswrapper[5120]: I0316 17:26:31.781101 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zk92b\" (UniqueName: \"kubernetes.io/projected/dfe750b5-405d-4458-9209-6be15f12e3a7-kube-api-access-zk92b\") pod \"redhat-operators-hbphh\" (UID: \"dfe750b5-405d-4458-9209-6be15f12e3a7\") " pod="openshift-marketplace/redhat-operators-hbphh" Mar 16 17:26:31 crc kubenswrapper[5120]: I0316 17:26:31.781169 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/dfe750b5-405d-4458-9209-6be15f12e3a7-utilities\") pod \"redhat-operators-hbphh\" (UID: \"dfe750b5-405d-4458-9209-6be15f12e3a7\") " pod="openshift-marketplace/redhat-operators-hbphh" Mar 16 17:26:31 crc kubenswrapper[5120]: I0316 17:26:31.781527 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/dfe750b5-405d-4458-9209-6be15f12e3a7-utilities\") pod \"redhat-operators-hbphh\" (UID: \"dfe750b5-405d-4458-9209-6be15f12e3a7\") " pod="openshift-marketplace/redhat-operators-hbphh" Mar 16 17:26:31 crc kubenswrapper[5120]: I0316 17:26:31.801711 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zk92b\" (UniqueName: \"kubernetes.io/projected/dfe750b5-405d-4458-9209-6be15f12e3a7-kube-api-access-zk92b\") pod \"redhat-operators-hbphh\" (UID: \"dfe750b5-405d-4458-9209-6be15f12e3a7\") " pod="openshift-marketplace/redhat-operators-hbphh" Mar 16 17:26:31 crc kubenswrapper[5120]: I0316 17:26:31.896503 5120 generic.go:358] "Generic (PLEG): container finished" podID="eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b" containerID="2e09128ad370e2f003150c7f73759e46b02933b5202888ca938417844c45409b" exitCode=0 Mar 16 17:26:31 crc kubenswrapper[5120]: I0316 17:26:31.896805 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-no-nodes-qmh89" event={"ID":"eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b","Type":"ContainerDied","Data":"2e09128ad370e2f003150c7f73759e46b02933b5202888ca938417844c45409b"} Mar 16 17:26:31 crc kubenswrapper[5120]: I0316 17:26:31.948565 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-hbphh" Mar 16 17:26:32 crc kubenswrapper[5120]: I0316 17:26:32.370419 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-hbphh"] Mar 16 17:26:32 crc kubenswrapper[5120]: W0316 17:26:32.371794 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfe750b5_405d_4458_9209_6be15f12e3a7.slice/crio-6f6f38dc9beba56e608eab3055f389059036d2afa082f1c339c5966d4aeb183c WatchSource:0}: Error finding container 6f6f38dc9beba56e608eab3055f389059036d2afa082f1c339c5966d4aeb183c: Status 404 returned error can't find the container with id 6f6f38dc9beba56e608eab3055f389059036d2afa082f1c339c5966d4aeb183c Mar 16 17:26:32 crc kubenswrapper[5120]: I0316 17:26:32.915852 5120 generic.go:358] "Generic (PLEG): container finished" podID="dfe750b5-405d-4458-9209-6be15f12e3a7" containerID="db17c434cc94a79c7935aa450b9c24e36aa4ad97a01d0b139d6d1823c38e2a5f" exitCode=0 Mar 16 17:26:32 crc kubenswrapper[5120]: I0316 17:26:32.916978 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-hbphh" event={"ID":"dfe750b5-405d-4458-9209-6be15f12e3a7","Type":"ContainerDied","Data":"db17c434cc94a79c7935aa450b9c24e36aa4ad97a01d0b139d6d1823c38e2a5f"} Mar 16 17:26:32 crc kubenswrapper[5120]: I0316 17:26:32.917018 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-hbphh" event={"ID":"dfe750b5-405d-4458-9209-6be15f12e3a7","Type":"ContainerStarted","Data":"6f6f38dc9beba56e608eab3055f389059036d2afa082f1c339c5966d4aeb183c"} Mar 16 17:26:33 crc kubenswrapper[5120]: I0316 17:26:33.168824 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-no-nodes-qmh89" Mar 16 17:26:33 crc kubenswrapper[5120]: I0316 17:26:33.317436 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b-ssh-key-edpm-compute-no-nodes\") pod \"eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b\" (UID: \"eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b\") " Mar 16 17:26:33 crc kubenswrapper[5120]: I0316 17:26:33.317557 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"neutron-metadata-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b-neutron-metadata-combined-ca-bundle\") pod \"eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b\" (UID: \"eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b\") " Mar 16 17:26:33 crc kubenswrapper[5120]: I0316 17:26:33.317619 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zxc92\" (UniqueName: \"kubernetes.io/projected/eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b-kube-api-access-zxc92\") pod \"eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b\" (UID: \"eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b\") " Mar 16 17:26:33 crc kubenswrapper[5120]: I0316 17:26:33.317661 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b-nova-combined-ca-bundle\") pod \"eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b\" (UID: \"eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b\") " Mar 16 17:26:33 crc kubenswrapper[5120]: I0316 17:26:33.317857 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"neutron-dhcp-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b-neutron-dhcp-combined-ca-bundle\") pod \"eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b\" (UID: \"eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b\") " Mar 16 17:26:33 crc kubenswrapper[5120]: I0316 17:26:33.317932 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b-inventory\") pod \"eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b\" (UID: \"eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b\") " Mar 16 17:26:33 crc kubenswrapper[5120]: I0316 17:26:33.317976 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b-ovn-combined-ca-bundle\") pod \"eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b\" (UID: \"eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b\") " Mar 16 17:26:33 crc kubenswrapper[5120]: I0316 17:26:33.318022 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"libvirt-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b-libvirt-combined-ca-bundle\") pod \"eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b\" (UID: \"eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b\") " Mar 16 17:26:33 crc kubenswrapper[5120]: I0316 17:26:33.318061 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bootstrap-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b-bootstrap-combined-ca-bundle\") pod \"eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b\" (UID: \"eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b\") " Mar 16 17:26:33 crc kubenswrapper[5120]: I0316 17:26:33.318099 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"neutron-sriov-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b-neutron-sriov-combined-ca-bundle\") pod \"eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b\" (UID: \"eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b\") " Mar 16 17:26:33 crc kubenswrapper[5120]: I0316 17:26:33.318156 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"neutron-ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b-neutron-ovn-combined-ca-bundle\") pod \"eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b\" (UID: \"eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b\") " Mar 16 17:26:33 crc kubenswrapper[5120]: I0316 17:26:33.323649 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b-libvirt-combined-ca-bundle" (OuterVolumeSpecName: "libvirt-combined-ca-bundle") pod "eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b" (UID: "eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b"). InnerVolumeSpecName "libvirt-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:26:33 crc kubenswrapper[5120]: I0316 17:26:33.323681 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b-neutron-ovn-combined-ca-bundle" (OuterVolumeSpecName: "neutron-ovn-combined-ca-bundle") pod "eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b" (UID: "eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b"). InnerVolumeSpecName "neutron-ovn-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:26:33 crc kubenswrapper[5120]: I0316 17:26:33.323869 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b-bootstrap-combined-ca-bundle" (OuterVolumeSpecName: "bootstrap-combined-ca-bundle") pod "eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b" (UID: "eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b"). InnerVolumeSpecName "bootstrap-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:26:33 crc kubenswrapper[5120]: I0316 17:26:33.326164 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b-neutron-sriov-combined-ca-bundle" (OuterVolumeSpecName: "neutron-sriov-combined-ca-bundle") pod "eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b" (UID: "eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b"). InnerVolumeSpecName "neutron-sriov-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:26:33 crc kubenswrapper[5120]: I0316 17:26:33.328576 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b-neutron-dhcp-combined-ca-bundle" (OuterVolumeSpecName: "neutron-dhcp-combined-ca-bundle") pod "eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b" (UID: "eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b"). InnerVolumeSpecName "neutron-dhcp-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:26:33 crc kubenswrapper[5120]: I0316 17:26:33.328596 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b-neutron-metadata-combined-ca-bundle" (OuterVolumeSpecName: "neutron-metadata-combined-ca-bundle") pod "eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b" (UID: "eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b"). InnerVolumeSpecName "neutron-metadata-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:26:33 crc kubenswrapper[5120]: I0316 17:26:33.328923 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b-ovn-combined-ca-bundle" (OuterVolumeSpecName: "ovn-combined-ca-bundle") pod "eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b" (UID: "eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b"). InnerVolumeSpecName "ovn-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:26:33 crc kubenswrapper[5120]: I0316 17:26:33.329132 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b-nova-combined-ca-bundle" (OuterVolumeSpecName: "nova-combined-ca-bundle") pod "eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b" (UID: "eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b"). InnerVolumeSpecName "nova-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:26:33 crc kubenswrapper[5120]: I0316 17:26:33.329190 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b-kube-api-access-zxc92" (OuterVolumeSpecName: "kube-api-access-zxc92") pod "eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b" (UID: "eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b"). InnerVolumeSpecName "kube-api-access-zxc92". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:26:33 crc kubenswrapper[5120]: I0316 17:26:33.342323 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b-ssh-key-edpm-compute-no-nodes" (OuterVolumeSpecName: "ssh-key-edpm-compute-no-nodes") pod "eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b" (UID: "eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b"). InnerVolumeSpecName "ssh-key-edpm-compute-no-nodes". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:26:33 crc kubenswrapper[5120]: I0316 17:26:33.344690 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b-inventory" (OuterVolumeSpecName: "inventory") pod "eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b" (UID: "eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:26:33 crc kubenswrapper[5120]: I0316 17:26:33.420456 5120 reconciler_common.go:299] "Volume detached for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b-ssh-key-edpm-compute-no-nodes\") on node \"crc\" DevicePath \"\"" Mar 16 17:26:33 crc kubenswrapper[5120]: I0316 17:26:33.420774 5120 reconciler_common.go:299] "Volume detached for volume \"neutron-metadata-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b-neutron-metadata-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:26:33 crc kubenswrapper[5120]: I0316 17:26:33.420788 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zxc92\" (UniqueName: \"kubernetes.io/projected/eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b-kube-api-access-zxc92\") on node \"crc\" DevicePath \"\"" Mar 16 17:26:33 crc kubenswrapper[5120]: I0316 17:26:33.420797 5120 reconciler_common.go:299] "Volume detached for volume \"nova-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b-nova-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:26:33 crc kubenswrapper[5120]: I0316 17:26:33.420806 5120 reconciler_common.go:299] "Volume detached for volume \"neutron-dhcp-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b-neutron-dhcp-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:26:33 crc kubenswrapper[5120]: I0316 17:26:33.420819 5120 reconciler_common.go:299] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b-inventory\") on node \"crc\" DevicePath \"\"" Mar 16 17:26:33 crc kubenswrapper[5120]: I0316 17:26:33.420831 5120 reconciler_common.go:299] "Volume detached for volume \"ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b-ovn-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:26:33 crc kubenswrapper[5120]: I0316 17:26:33.420840 5120 reconciler_common.go:299] "Volume detached for volume \"libvirt-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b-libvirt-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:26:33 crc kubenswrapper[5120]: I0316 17:26:33.420848 5120 reconciler_common.go:299] "Volume detached for volume \"bootstrap-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b-bootstrap-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:26:33 crc kubenswrapper[5120]: I0316 17:26:33.420857 5120 reconciler_common.go:299] "Volume detached for volume \"neutron-sriov-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b-neutron-sriov-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:26:33 crc kubenswrapper[5120]: I0316 17:26:33.420867 5120 reconciler_common.go:299] "Volume detached for volume \"neutron-ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b-neutron-ovn-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:26:33 crc kubenswrapper[5120]: I0316 17:26:33.924700 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-no-nodes-qmh89" event={"ID":"eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b","Type":"ContainerDied","Data":"ac7242857a56512a564d6e607d606409640c52b1160ca2b2d9e642e5cfa58d95"} Mar 16 17:26:33 crc kubenswrapper[5120]: I0316 17:26:33.924738 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ac7242857a56512a564d6e607d606409640c52b1160ca2b2d9e642e5cfa58d95" Mar 16 17:26:33 crc kubenswrapper[5120]: I0316 17:26:33.924812 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-no-nodes-qmh89" Mar 16 17:26:33 crc kubenswrapper[5120]: I0316 17:26:33.988606 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovn-edpm-multinodeset-edpm-compute-no-nodes-zzpvm"] Mar 16 17:26:33 crc kubenswrapper[5120]: I0316 17:26:33.991532 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b" containerName="install-certs-edpm-multinodeset-edpm-compute-no-nodes" Mar 16 17:26:33 crc kubenswrapper[5120]: I0316 17:26:33.991654 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b" containerName="install-certs-edpm-multinodeset-edpm-compute-no-nodes" Mar 16 17:26:33 crc kubenswrapper[5120]: I0316 17:26:33.991917 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b" containerName="install-certs-edpm-multinodeset-edpm-compute-no-nodes" Mar 16 17:26:33 crc kubenswrapper[5120]: I0316 17:26:33.997328 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-edpm-multinodeset-edpm-compute-no-nodes-zzpvm" Mar 16 17:26:34 crc kubenswrapper[5120]: I0316 17:26:34.000604 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplane-ansible-ssh-private-key-secret\"" Mar 16 17:26:34 crc kubenswrapper[5120]: I0316 17:26:34.000887 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplanenodeset-edpm-compute-no-nodes\"" Mar 16 17:26:34 crc kubenswrapper[5120]: I0316 17:26:34.001235 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-aee-default-env\"" Mar 16 17:26:34 crc kubenswrapper[5120]: I0316 17:26:34.001545 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovncontroller-config\"" Mar 16 17:26:34 crc kubenswrapper[5120]: I0316 17:26:34.001646 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"combined-ca-bundle\"" Mar 16 17:26:34 crc kubenswrapper[5120]: I0316 17:26:34.012318 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"edpm-compute-no-nodes-dockercfg-znndh\"" Mar 16 17:26:34 crc kubenswrapper[5120]: I0316 17:26:34.019186 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-edpm-multinodeset-edpm-compute-no-nodes-zzpvm"] Mar 16 17:26:34 crc kubenswrapper[5120]: I0316 17:26:34.136808 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-446mk\" (UniqueName: \"kubernetes.io/projected/389a1bb6-2b6f-4ec6-a945-40b4901f4e18-kube-api-access-446mk\") pod \"ovn-edpm-multinodeset-edpm-compute-no-nodes-zzpvm\" (UID: \"389a1bb6-2b6f-4ec6-a945-40b4901f4e18\") " pod="openstack-kuttl-tests/ovn-edpm-multinodeset-edpm-compute-no-nodes-zzpvm" Mar 16 17:26:34 crc kubenswrapper[5120]: I0316 17:26:34.136912 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovncontroller-config-0\" (UniqueName: \"kubernetes.io/configmap/389a1bb6-2b6f-4ec6-a945-40b4901f4e18-ovncontroller-config-0\") pod \"ovn-edpm-multinodeset-edpm-compute-no-nodes-zzpvm\" (UID: \"389a1bb6-2b6f-4ec6-a945-40b4901f4e18\") " pod="openstack-kuttl-tests/ovn-edpm-multinodeset-edpm-compute-no-nodes-zzpvm" Mar 16 17:26:34 crc kubenswrapper[5120]: I0316 17:26:34.137231 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/389a1bb6-2b6f-4ec6-a945-40b4901f4e18-inventory\") pod \"ovn-edpm-multinodeset-edpm-compute-no-nodes-zzpvm\" (UID: \"389a1bb6-2b6f-4ec6-a945-40b4901f4e18\") " pod="openstack-kuttl-tests/ovn-edpm-multinodeset-edpm-compute-no-nodes-zzpvm" Mar 16 17:26:34 crc kubenswrapper[5120]: I0316 17:26:34.137334 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/389a1bb6-2b6f-4ec6-a945-40b4901f4e18-ovn-combined-ca-bundle\") pod \"ovn-edpm-multinodeset-edpm-compute-no-nodes-zzpvm\" (UID: \"389a1bb6-2b6f-4ec6-a945-40b4901f4e18\") " pod="openstack-kuttl-tests/ovn-edpm-multinodeset-edpm-compute-no-nodes-zzpvm" Mar 16 17:26:34 crc kubenswrapper[5120]: I0316 17:26:34.137517 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/389a1bb6-2b6f-4ec6-a945-40b4901f4e18-ssh-key-edpm-compute-no-nodes\") pod \"ovn-edpm-multinodeset-edpm-compute-no-nodes-zzpvm\" (UID: \"389a1bb6-2b6f-4ec6-a945-40b4901f4e18\") " pod="openstack-kuttl-tests/ovn-edpm-multinodeset-edpm-compute-no-nodes-zzpvm" Mar 16 17:26:34 crc kubenswrapper[5120]: I0316 17:26:34.239632 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-446mk\" (UniqueName: \"kubernetes.io/projected/389a1bb6-2b6f-4ec6-a945-40b4901f4e18-kube-api-access-446mk\") pod \"ovn-edpm-multinodeset-edpm-compute-no-nodes-zzpvm\" (UID: \"389a1bb6-2b6f-4ec6-a945-40b4901f4e18\") " pod="openstack-kuttl-tests/ovn-edpm-multinodeset-edpm-compute-no-nodes-zzpvm" Mar 16 17:26:34 crc kubenswrapper[5120]: I0316 17:26:34.239722 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovncontroller-config-0\" (UniqueName: \"kubernetes.io/configmap/389a1bb6-2b6f-4ec6-a945-40b4901f4e18-ovncontroller-config-0\") pod \"ovn-edpm-multinodeset-edpm-compute-no-nodes-zzpvm\" (UID: \"389a1bb6-2b6f-4ec6-a945-40b4901f4e18\") " pod="openstack-kuttl-tests/ovn-edpm-multinodeset-edpm-compute-no-nodes-zzpvm" Mar 16 17:26:34 crc kubenswrapper[5120]: I0316 17:26:34.239915 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/389a1bb6-2b6f-4ec6-a945-40b4901f4e18-inventory\") pod \"ovn-edpm-multinodeset-edpm-compute-no-nodes-zzpvm\" (UID: \"389a1bb6-2b6f-4ec6-a945-40b4901f4e18\") " pod="openstack-kuttl-tests/ovn-edpm-multinodeset-edpm-compute-no-nodes-zzpvm" Mar 16 17:26:34 crc kubenswrapper[5120]: I0316 17:26:34.239978 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/389a1bb6-2b6f-4ec6-a945-40b4901f4e18-ovn-combined-ca-bundle\") pod \"ovn-edpm-multinodeset-edpm-compute-no-nodes-zzpvm\" (UID: \"389a1bb6-2b6f-4ec6-a945-40b4901f4e18\") " pod="openstack-kuttl-tests/ovn-edpm-multinodeset-edpm-compute-no-nodes-zzpvm" Mar 16 17:26:34 crc kubenswrapper[5120]: I0316 17:26:34.240146 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/389a1bb6-2b6f-4ec6-a945-40b4901f4e18-ssh-key-edpm-compute-no-nodes\") pod \"ovn-edpm-multinodeset-edpm-compute-no-nodes-zzpvm\" (UID: \"389a1bb6-2b6f-4ec6-a945-40b4901f4e18\") " pod="openstack-kuttl-tests/ovn-edpm-multinodeset-edpm-compute-no-nodes-zzpvm" Mar 16 17:26:34 crc kubenswrapper[5120]: I0316 17:26:34.240682 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovncontroller-config-0\" (UniqueName: \"kubernetes.io/configmap/389a1bb6-2b6f-4ec6-a945-40b4901f4e18-ovncontroller-config-0\") pod \"ovn-edpm-multinodeset-edpm-compute-no-nodes-zzpvm\" (UID: \"389a1bb6-2b6f-4ec6-a945-40b4901f4e18\") " pod="openstack-kuttl-tests/ovn-edpm-multinodeset-edpm-compute-no-nodes-zzpvm" Mar 16 17:26:34 crc kubenswrapper[5120]: I0316 17:26:34.245039 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/389a1bb6-2b6f-4ec6-a945-40b4901f4e18-ssh-key-edpm-compute-no-nodes\") pod \"ovn-edpm-multinodeset-edpm-compute-no-nodes-zzpvm\" (UID: \"389a1bb6-2b6f-4ec6-a945-40b4901f4e18\") " pod="openstack-kuttl-tests/ovn-edpm-multinodeset-edpm-compute-no-nodes-zzpvm" Mar 16 17:26:34 crc kubenswrapper[5120]: I0316 17:26:34.245315 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/389a1bb6-2b6f-4ec6-a945-40b4901f4e18-inventory\") pod \"ovn-edpm-multinodeset-edpm-compute-no-nodes-zzpvm\" (UID: \"389a1bb6-2b6f-4ec6-a945-40b4901f4e18\") " pod="openstack-kuttl-tests/ovn-edpm-multinodeset-edpm-compute-no-nodes-zzpvm" Mar 16 17:26:34 crc kubenswrapper[5120]: I0316 17:26:34.245457 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/389a1bb6-2b6f-4ec6-a945-40b4901f4e18-ovn-combined-ca-bundle\") pod \"ovn-edpm-multinodeset-edpm-compute-no-nodes-zzpvm\" (UID: \"389a1bb6-2b6f-4ec6-a945-40b4901f4e18\") " pod="openstack-kuttl-tests/ovn-edpm-multinodeset-edpm-compute-no-nodes-zzpvm" Mar 16 17:26:34 crc kubenswrapper[5120]: I0316 17:26:34.266273 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-446mk\" (UniqueName: \"kubernetes.io/projected/389a1bb6-2b6f-4ec6-a945-40b4901f4e18-kube-api-access-446mk\") pod \"ovn-edpm-multinodeset-edpm-compute-no-nodes-zzpvm\" (UID: \"389a1bb6-2b6f-4ec6-a945-40b4901f4e18\") " pod="openstack-kuttl-tests/ovn-edpm-multinodeset-edpm-compute-no-nodes-zzpvm" Mar 16 17:26:34 crc kubenswrapper[5120]: I0316 17:26:34.313611 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-edpm-multinodeset-edpm-compute-no-nodes-zzpvm" Mar 16 17:26:34 crc kubenswrapper[5120]: I0316 17:26:34.791659 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-edpm-multinodeset-edpm-compute-no-nodes-zzpvm"] Mar 16 17:26:34 crc kubenswrapper[5120]: I0316 17:26:34.945806 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-hbphh" event={"ID":"dfe750b5-405d-4458-9209-6be15f12e3a7","Type":"ContainerStarted","Data":"5cff4d32fe632972e0563176b342b1877f0a8112a45df2b316a23f360d29069a"} Mar 16 17:26:34 crc kubenswrapper[5120]: I0316 17:26:34.947214 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-edpm-multinodeset-edpm-compute-no-nodes-zzpvm" event={"ID":"389a1bb6-2b6f-4ec6-a945-40b4901f4e18","Type":"ContainerStarted","Data":"e2f1c9bc8eb086442f37eb97c5d331e43bd906281352b56eed5bf6047eb4656f"} Mar 16 17:26:35 crc kubenswrapper[5120]: I0316 17:26:35.957896 5120 generic.go:358] "Generic (PLEG): container finished" podID="dfe750b5-405d-4458-9209-6be15f12e3a7" containerID="5cff4d32fe632972e0563176b342b1877f0a8112a45df2b316a23f360d29069a" exitCode=0 Mar 16 17:26:35 crc kubenswrapper[5120]: I0316 17:26:35.957998 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-hbphh" event={"ID":"dfe750b5-405d-4458-9209-6be15f12e3a7","Type":"ContainerDied","Data":"5cff4d32fe632972e0563176b342b1877f0a8112a45df2b316a23f360d29069a"} Mar 16 17:26:35 crc kubenswrapper[5120]: I0316 17:26:35.960818 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-edpm-multinodeset-edpm-compute-no-nodes-zzpvm" event={"ID":"389a1bb6-2b6f-4ec6-a945-40b4901f4e18","Type":"ContainerStarted","Data":"6050d2cdc43f055f93cccbbf3a6752db021431ce92a9f036397c1a5e6770cb93"} Mar 16 17:26:36 crc kubenswrapper[5120]: I0316 17:26:36.008867 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovn-edpm-multinodeset-edpm-compute-no-nodes-zzpvm" podStartSLOduration=2.5742307909999997 podStartE2EDuration="3.008846786s" podCreationTimestamp="2026-03-16 17:26:33 +0000 UTC" firstStartedPulling="2026-03-16 17:26:34.783959287 +0000 UTC m=+6896.937890944" lastFinishedPulling="2026-03-16 17:26:35.218575282 +0000 UTC m=+6897.372506939" observedRunningTime="2026-03-16 17:26:36.001920268 +0000 UTC m=+6898.155851925" watchObservedRunningTime="2026-03-16 17:26:36.008846786 +0000 UTC m=+6898.162778443" Mar 16 17:26:36 crc kubenswrapper[5120]: I0316 17:26:36.971737 5120 generic.go:358] "Generic (PLEG): container finished" podID="389a1bb6-2b6f-4ec6-a945-40b4901f4e18" containerID="6050d2cdc43f055f93cccbbf3a6752db021431ce92a9f036397c1a5e6770cb93" exitCode=0 Mar 16 17:26:36 crc kubenswrapper[5120]: I0316 17:26:36.971810 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-edpm-multinodeset-edpm-compute-no-nodes-zzpvm" event={"ID":"389a1bb6-2b6f-4ec6-a945-40b4901f4e18","Type":"ContainerDied","Data":"6050d2cdc43f055f93cccbbf3a6752db021431ce92a9f036397c1a5e6770cb93"} Mar 16 17:26:36 crc kubenswrapper[5120]: I0316 17:26:36.974985 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-hbphh" event={"ID":"dfe750b5-405d-4458-9209-6be15f12e3a7","Type":"ContainerStarted","Data":"65d7c68391304caf39f30994f07bcc21f474e377bbfe87e84591d3e0c4b331bf"} Mar 16 17:26:37 crc kubenswrapper[5120]: I0316 17:26:37.026114 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/redhat-operators-hbphh" podStartSLOduration=5.180028674 podStartE2EDuration="6.026087292s" podCreationTimestamp="2026-03-16 17:26:31 +0000 UTC" firstStartedPulling="2026-03-16 17:26:32.917631519 +0000 UTC m=+6895.071563176" lastFinishedPulling="2026-03-16 17:26:33.763690117 +0000 UTC m=+6895.917621794" observedRunningTime="2026-03-16 17:26:37.012689796 +0000 UTC m=+6899.166621453" watchObservedRunningTime="2026-03-16 17:26:37.026087292 +0000 UTC m=+6899.180018949" Mar 16 17:26:38 crc kubenswrapper[5120]: I0316 17:26:38.264730 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-edpm-multinodeset-edpm-compute-no-nodes-zzpvm" Mar 16 17:26:38 crc kubenswrapper[5120]: I0316 17:26:38.331291 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/389a1bb6-2b6f-4ec6-a945-40b4901f4e18-inventory\") pod \"389a1bb6-2b6f-4ec6-a945-40b4901f4e18\" (UID: \"389a1bb6-2b6f-4ec6-a945-40b4901f4e18\") " Mar 16 17:26:38 crc kubenswrapper[5120]: I0316 17:26:38.331489 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovncontroller-config-0\" (UniqueName: \"kubernetes.io/configmap/389a1bb6-2b6f-4ec6-a945-40b4901f4e18-ovncontroller-config-0\") pod \"389a1bb6-2b6f-4ec6-a945-40b4901f4e18\" (UID: \"389a1bb6-2b6f-4ec6-a945-40b4901f4e18\") " Mar 16 17:26:38 crc kubenswrapper[5120]: I0316 17:26:38.331531 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/389a1bb6-2b6f-4ec6-a945-40b4901f4e18-ssh-key-edpm-compute-no-nodes\") pod \"389a1bb6-2b6f-4ec6-a945-40b4901f4e18\" (UID: \"389a1bb6-2b6f-4ec6-a945-40b4901f4e18\") " Mar 16 17:26:38 crc kubenswrapper[5120]: I0316 17:26:38.331658 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/389a1bb6-2b6f-4ec6-a945-40b4901f4e18-ovn-combined-ca-bundle\") pod \"389a1bb6-2b6f-4ec6-a945-40b4901f4e18\" (UID: \"389a1bb6-2b6f-4ec6-a945-40b4901f4e18\") " Mar 16 17:26:38 crc kubenswrapper[5120]: I0316 17:26:38.331716 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-446mk\" (UniqueName: \"kubernetes.io/projected/389a1bb6-2b6f-4ec6-a945-40b4901f4e18-kube-api-access-446mk\") pod \"389a1bb6-2b6f-4ec6-a945-40b4901f4e18\" (UID: \"389a1bb6-2b6f-4ec6-a945-40b4901f4e18\") " Mar 16 17:26:38 crc kubenswrapper[5120]: I0316 17:26:38.343680 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/389a1bb6-2b6f-4ec6-a945-40b4901f4e18-ovn-combined-ca-bundle" (OuterVolumeSpecName: "ovn-combined-ca-bundle") pod "389a1bb6-2b6f-4ec6-a945-40b4901f4e18" (UID: "389a1bb6-2b6f-4ec6-a945-40b4901f4e18"). InnerVolumeSpecName "ovn-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:26:38 crc kubenswrapper[5120]: I0316 17:26:38.344443 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/389a1bb6-2b6f-4ec6-a945-40b4901f4e18-kube-api-access-446mk" (OuterVolumeSpecName: "kube-api-access-446mk") pod "389a1bb6-2b6f-4ec6-a945-40b4901f4e18" (UID: "389a1bb6-2b6f-4ec6-a945-40b4901f4e18"). InnerVolumeSpecName "kube-api-access-446mk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:26:38 crc kubenswrapper[5120]: I0316 17:26:38.357884 5120 reconciler_common.go:299] "Volume detached for volume \"ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/389a1bb6-2b6f-4ec6-a945-40b4901f4e18-ovn-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:26:38 crc kubenswrapper[5120]: I0316 17:26:38.357921 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-446mk\" (UniqueName: \"kubernetes.io/projected/389a1bb6-2b6f-4ec6-a945-40b4901f4e18-kube-api-access-446mk\") on node \"crc\" DevicePath \"\"" Mar 16 17:26:38 crc kubenswrapper[5120]: I0316 17:26:38.374439 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/389a1bb6-2b6f-4ec6-a945-40b4901f4e18-ovncontroller-config-0" (OuterVolumeSpecName: "ovncontroller-config-0") pod "389a1bb6-2b6f-4ec6-a945-40b4901f4e18" (UID: "389a1bb6-2b6f-4ec6-a945-40b4901f4e18"). InnerVolumeSpecName "ovncontroller-config-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:26:38 crc kubenswrapper[5120]: I0316 17:26:38.380568 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/389a1bb6-2b6f-4ec6-a945-40b4901f4e18-ssh-key-edpm-compute-no-nodes" (OuterVolumeSpecName: "ssh-key-edpm-compute-no-nodes") pod "389a1bb6-2b6f-4ec6-a945-40b4901f4e18" (UID: "389a1bb6-2b6f-4ec6-a945-40b4901f4e18"). InnerVolumeSpecName "ssh-key-edpm-compute-no-nodes". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:26:38 crc kubenswrapper[5120]: I0316 17:26:38.382248 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/389a1bb6-2b6f-4ec6-a945-40b4901f4e18-inventory" (OuterVolumeSpecName: "inventory") pod "389a1bb6-2b6f-4ec6-a945-40b4901f4e18" (UID: "389a1bb6-2b6f-4ec6-a945-40b4901f4e18"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:26:38 crc kubenswrapper[5120]: I0316 17:26:38.459597 5120 reconciler_common.go:299] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/389a1bb6-2b6f-4ec6-a945-40b4901f4e18-inventory\") on node \"crc\" DevicePath \"\"" Mar 16 17:26:38 crc kubenswrapper[5120]: I0316 17:26:38.459644 5120 reconciler_common.go:299] "Volume detached for volume \"ovncontroller-config-0\" (UniqueName: \"kubernetes.io/configmap/389a1bb6-2b6f-4ec6-a945-40b4901f4e18-ovncontroller-config-0\") on node \"crc\" DevicePath \"\"" Mar 16 17:26:38 crc kubenswrapper[5120]: I0316 17:26:38.459656 5120 reconciler_common.go:299] "Volume detached for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/389a1bb6-2b6f-4ec6-a945-40b4901f4e18-ssh-key-edpm-compute-no-nodes\") on node \"crc\" DevicePath \"\"" Mar 16 17:26:38 crc kubenswrapper[5120]: I0316 17:26:38.990938 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-edpm-multinodeset-edpm-compute-no-nodes-zzpvm" Mar 16 17:26:38 crc kubenswrapper[5120]: I0316 17:26:38.990958 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-edpm-multinodeset-edpm-compute-no-nodes-zzpvm" event={"ID":"389a1bb6-2b6f-4ec6-a945-40b4901f4e18","Type":"ContainerDied","Data":"e2f1c9bc8eb086442f37eb97c5d331e43bd906281352b56eed5bf6047eb4656f"} Mar 16 17:26:38 crc kubenswrapper[5120]: I0316 17:26:38.991095 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e2f1c9bc8eb086442f37eb97c5d331e43bd906281352b56eed5bf6047eb4656f" Mar 16 17:26:39 crc kubenswrapper[5120]: I0316 17:26:39.347871 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes-d6shz"] Mar 16 17:26:39 crc kubenswrapper[5120]: I0316 17:26:39.349083 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="389a1bb6-2b6f-4ec6-a945-40b4901f4e18" containerName="ovn-edpm-multinodeset-edpm-compute-no-nodes" Mar 16 17:26:39 crc kubenswrapper[5120]: I0316 17:26:39.349113 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="389a1bb6-2b6f-4ec6-a945-40b4901f4e18" containerName="ovn-edpm-multinodeset-edpm-compute-no-nodes" Mar 16 17:26:39 crc kubenswrapper[5120]: I0316 17:26:39.349313 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="389a1bb6-2b6f-4ec6-a945-40b4901f4e18" containerName="ovn-edpm-multinodeset-edpm-compute-no-nodes" Mar 16 17:26:39 crc kubenswrapper[5120]: I0316 17:26:39.378327 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes-d6shz"] Mar 16 17:26:39 crc kubenswrapper[5120]: I0316 17:26:39.378466 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes-d6shz" Mar 16 17:26:39 crc kubenswrapper[5120]: I0316 17:26:39.406264 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-aee-default-env\"" Mar 16 17:26:39 crc kubenswrapper[5120]: I0316 17:26:39.406399 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-metadata-neutron-config\"" Mar 16 17:26:39 crc kubenswrapper[5120]: I0316 17:26:39.406456 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-ovn-metadata-agent-neutron-config\"" Mar 16 17:26:39 crc kubenswrapper[5120]: I0316 17:26:39.406840 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplane-ansible-ssh-private-key-secret\"" Mar 16 17:26:39 crc kubenswrapper[5120]: I0316 17:26:39.406889 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"combined-ca-bundle\"" Mar 16 17:26:39 crc kubenswrapper[5120]: I0316 17:26:39.407091 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplanenodeset-edpm-compute-no-nodes\"" Mar 16 17:26:39 crc kubenswrapper[5120]: I0316 17:26:39.407158 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"edpm-compute-no-nodes-dockercfg-znndh\"" Mar 16 17:26:39 crc kubenswrapper[5120]: I0316 17:26:39.478272 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/7798e8ae-c2d9-4748-8971-730d5a5d4d82-nova-metadata-neutron-config-0\") pod \"neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes-d6shz\" (UID: \"7798e8ae-c2d9-4748-8971-730d5a5d4d82\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes-d6shz" Mar 16 17:26:39 crc kubenswrapper[5120]: I0316 17:26:39.478439 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4tz7\" (UniqueName: \"kubernetes.io/projected/7798e8ae-c2d9-4748-8971-730d5a5d4d82-kube-api-access-h4tz7\") pod \"neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes-d6shz\" (UID: \"7798e8ae-c2d9-4748-8971-730d5a5d4d82\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes-d6shz" Mar 16 17:26:39 crc kubenswrapper[5120]: I0316 17:26:39.478524 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-neutron-config-2\" (UniqueName: \"kubernetes.io/secret/7798e8ae-c2d9-4748-8971-730d5a5d4d82-nova-metadata-neutron-config-2\") pod \"neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes-d6shz\" (UID: \"7798e8ae-c2d9-4748-8971-730d5a5d4d82\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes-d6shz" Mar 16 17:26:39 crc kubenswrapper[5120]: I0316 17:26:39.478608 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"neutron-metadata-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7798e8ae-c2d9-4748-8971-730d5a5d4d82-neutron-metadata-combined-ca-bundle\") pod \"neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes-d6shz\" (UID: \"7798e8ae-c2d9-4748-8971-730d5a5d4d82\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes-d6shz" Mar 16 17:26:39 crc kubenswrapper[5120]: I0316 17:26:39.478729 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/7798e8ae-c2d9-4748-8971-730d5a5d4d82-inventory\") pod \"neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes-d6shz\" (UID: \"7798e8ae-c2d9-4748-8971-730d5a5d4d82\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes-d6shz" Mar 16 17:26:39 crc kubenswrapper[5120]: I0316 17:26:39.478824 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-neutron-config-1\" (UniqueName: \"kubernetes.io/secret/7798e8ae-c2d9-4748-8971-730d5a5d4d82-nova-metadata-neutron-config-1\") pod \"neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes-d6shz\" (UID: \"7798e8ae-c2d9-4748-8971-730d5a5d4d82\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes-d6shz" Mar 16 17:26:39 crc kubenswrapper[5120]: I0316 17:26:39.478894 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/7798e8ae-c2d9-4748-8971-730d5a5d4d82-ssh-key-edpm-compute-no-nodes\") pod \"neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes-d6shz\" (UID: \"7798e8ae-c2d9-4748-8971-730d5a5d4d82\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes-d6shz" Mar 16 17:26:39 crc kubenswrapper[5120]: I0316 17:26:39.479012 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"neutron-ovn-metadata-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/7798e8ae-c2d9-4748-8971-730d5a5d4d82-neutron-ovn-metadata-agent-neutron-config-0\") pod \"neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes-d6shz\" (UID: \"7798e8ae-c2d9-4748-8971-730d5a5d4d82\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes-d6shz" Mar 16 17:26:39 crc kubenswrapper[5120]: I0316 17:26:39.580335 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-metadata-neutron-config-2\" (UniqueName: \"kubernetes.io/secret/7798e8ae-c2d9-4748-8971-730d5a5d4d82-nova-metadata-neutron-config-2\") pod \"neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes-d6shz\" (UID: \"7798e8ae-c2d9-4748-8971-730d5a5d4d82\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes-d6shz" Mar 16 17:26:39 crc kubenswrapper[5120]: I0316 17:26:39.580388 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"neutron-metadata-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7798e8ae-c2d9-4748-8971-730d5a5d4d82-neutron-metadata-combined-ca-bundle\") pod \"neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes-d6shz\" (UID: \"7798e8ae-c2d9-4748-8971-730d5a5d4d82\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes-d6shz" Mar 16 17:26:39 crc kubenswrapper[5120]: I0316 17:26:39.580446 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/7798e8ae-c2d9-4748-8971-730d5a5d4d82-inventory\") pod \"neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes-d6shz\" (UID: \"7798e8ae-c2d9-4748-8971-730d5a5d4d82\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes-d6shz" Mar 16 17:26:39 crc kubenswrapper[5120]: I0316 17:26:39.580507 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-metadata-neutron-config-1\" (UniqueName: \"kubernetes.io/secret/7798e8ae-c2d9-4748-8971-730d5a5d4d82-nova-metadata-neutron-config-1\") pod \"neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes-d6shz\" (UID: \"7798e8ae-c2d9-4748-8971-730d5a5d4d82\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes-d6shz" Mar 16 17:26:39 crc kubenswrapper[5120]: I0316 17:26:39.580538 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/7798e8ae-c2d9-4748-8971-730d5a5d4d82-ssh-key-edpm-compute-no-nodes\") pod \"neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes-d6shz\" (UID: \"7798e8ae-c2d9-4748-8971-730d5a5d4d82\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes-d6shz" Mar 16 17:26:39 crc kubenswrapper[5120]: I0316 17:26:39.580607 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"neutron-ovn-metadata-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/7798e8ae-c2d9-4748-8971-730d5a5d4d82-neutron-ovn-metadata-agent-neutron-config-0\") pod \"neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes-d6shz\" (UID: \"7798e8ae-c2d9-4748-8971-730d5a5d4d82\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes-d6shz" Mar 16 17:26:39 crc kubenswrapper[5120]: I0316 17:26:39.580690 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-metadata-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/7798e8ae-c2d9-4748-8971-730d5a5d4d82-nova-metadata-neutron-config-0\") pod \"neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes-d6shz\" (UID: \"7798e8ae-c2d9-4748-8971-730d5a5d4d82\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes-d6shz" Mar 16 17:26:39 crc kubenswrapper[5120]: I0316 17:26:39.580782 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h4tz7\" (UniqueName: \"kubernetes.io/projected/7798e8ae-c2d9-4748-8971-730d5a5d4d82-kube-api-access-h4tz7\") pod \"neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes-d6shz\" (UID: \"7798e8ae-c2d9-4748-8971-730d5a5d4d82\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes-d6shz" Mar 16 17:26:39 crc kubenswrapper[5120]: I0316 17:26:39.589927 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-metadata-neutron-config-2\" (UniqueName: \"kubernetes.io/secret/7798e8ae-c2d9-4748-8971-730d5a5d4d82-nova-metadata-neutron-config-2\") pod \"neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes-d6shz\" (UID: \"7798e8ae-c2d9-4748-8971-730d5a5d4d82\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes-d6shz" Mar 16 17:26:39 crc kubenswrapper[5120]: I0316 17:26:39.589974 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"neutron-ovn-metadata-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/7798e8ae-c2d9-4748-8971-730d5a5d4d82-neutron-ovn-metadata-agent-neutron-config-0\") pod \"neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes-d6shz\" (UID: \"7798e8ae-c2d9-4748-8971-730d5a5d4d82\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes-d6shz" Mar 16 17:26:39 crc kubenswrapper[5120]: I0316 17:26:39.590021 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"neutron-metadata-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7798e8ae-c2d9-4748-8971-730d5a5d4d82-neutron-metadata-combined-ca-bundle\") pod \"neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes-d6shz\" (UID: \"7798e8ae-c2d9-4748-8971-730d5a5d4d82\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes-d6shz" Mar 16 17:26:39 crc kubenswrapper[5120]: I0316 17:26:39.590100 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-metadata-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/7798e8ae-c2d9-4748-8971-730d5a5d4d82-nova-metadata-neutron-config-0\") pod \"neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes-d6shz\" (UID: \"7798e8ae-c2d9-4748-8971-730d5a5d4d82\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes-d6shz" Mar 16 17:26:39 crc kubenswrapper[5120]: I0316 17:26:39.590327 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/7798e8ae-c2d9-4748-8971-730d5a5d4d82-ssh-key-edpm-compute-no-nodes\") pod \"neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes-d6shz\" (UID: \"7798e8ae-c2d9-4748-8971-730d5a5d4d82\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes-d6shz" Mar 16 17:26:39 crc kubenswrapper[5120]: I0316 17:26:39.590447 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-metadata-neutron-config-1\" (UniqueName: \"kubernetes.io/secret/7798e8ae-c2d9-4748-8971-730d5a5d4d82-nova-metadata-neutron-config-1\") pod \"neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes-d6shz\" (UID: \"7798e8ae-c2d9-4748-8971-730d5a5d4d82\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes-d6shz" Mar 16 17:26:39 crc kubenswrapper[5120]: I0316 17:26:39.591394 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/7798e8ae-c2d9-4748-8971-730d5a5d4d82-inventory\") pod \"neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes-d6shz\" (UID: \"7798e8ae-c2d9-4748-8971-730d5a5d4d82\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes-d6shz" Mar 16 17:26:39 crc kubenswrapper[5120]: I0316 17:26:39.604916 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4tz7\" (UniqueName: \"kubernetes.io/projected/7798e8ae-c2d9-4748-8971-730d5a5d4d82-kube-api-access-h4tz7\") pod \"neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes-d6shz\" (UID: \"7798e8ae-c2d9-4748-8971-730d5a5d4d82\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes-d6shz" Mar 16 17:26:39 crc kubenswrapper[5120]: I0316 17:26:39.720925 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes-d6shz" Mar 16 17:26:39 crc kubenswrapper[5120]: I0316 17:26:39.956945 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes-d6shz"] Mar 16 17:26:39 crc kubenswrapper[5120]: W0316 17:26:39.959029 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7798e8ae_c2d9_4748_8971_730d5a5d4d82.slice/crio-a7542178566b4497a18bdf07708379ba560fe1f774e7807f0350ea01df4a15ff WatchSource:0}: Error finding container a7542178566b4497a18bdf07708379ba560fe1f774e7807f0350ea01df4a15ff: Status 404 returned error can't find the container with id a7542178566b4497a18bdf07708379ba560fe1f774e7807f0350ea01df4a15ff Mar 16 17:26:40 crc kubenswrapper[5120]: I0316 17:26:40.000353 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes-d6shz" event={"ID":"7798e8ae-c2d9-4748-8971-730d5a5d4d82","Type":"ContainerStarted","Data":"a7542178566b4497a18bdf07708379ba560fe1f774e7807f0350ea01df4a15ff"} Mar 16 17:26:41 crc kubenswrapper[5120]: I0316 17:26:41.013685 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes-d6shz" event={"ID":"7798e8ae-c2d9-4748-8971-730d5a5d4d82","Type":"ContainerStarted","Data":"3e39347b9c3f965977cda4844ea80037e601e81f43cdc2ae1a2b0c201ba89548"} Mar 16 17:26:41 crc kubenswrapper[5120]: I0316 17:26:41.038497 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes-d6shz" podStartSLOduration=1.5248509270000001 podStartE2EDuration="2.038476202s" podCreationTimestamp="2026-03-16 17:26:39 +0000 UTC" firstStartedPulling="2026-03-16 17:26:39.960382563 +0000 UTC m=+6902.114314220" lastFinishedPulling="2026-03-16 17:26:40.474007838 +0000 UTC m=+6902.627939495" observedRunningTime="2026-03-16 17:26:41.029563718 +0000 UTC m=+6903.183495375" watchObservedRunningTime="2026-03-16 17:26:41.038476202 +0000 UTC m=+6903.192407859" Mar 16 17:26:41 crc kubenswrapper[5120]: I0316 17:26:41.949041 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-operators-hbphh" Mar 16 17:26:41 crc kubenswrapper[5120]: I0316 17:26:41.949434 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-marketplace/redhat-operators-hbphh" Mar 16 17:26:41 crc kubenswrapper[5120]: I0316 17:26:41.994891 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-operators-hbphh" Mar 16 17:26:42 crc kubenswrapper[5120]: I0316 17:26:42.031899 5120 generic.go:358] "Generic (PLEG): container finished" podID="7798e8ae-c2d9-4748-8971-730d5a5d4d82" containerID="3e39347b9c3f965977cda4844ea80037e601e81f43cdc2ae1a2b0c201ba89548" exitCode=0 Mar 16 17:26:42 crc kubenswrapper[5120]: I0316 17:26:42.032296 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes-d6shz" event={"ID":"7798e8ae-c2d9-4748-8971-730d5a5d4d82","Type":"ContainerDied","Data":"3e39347b9c3f965977cda4844ea80037e601e81f43cdc2ae1a2b0c201ba89548"} Mar 16 17:26:42 crc kubenswrapper[5120]: I0316 17:26:42.077503 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-operators-hbphh" Mar 16 17:26:42 crc kubenswrapper[5120]: I0316 17:26:42.227419 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-operators-hbphh"] Mar 16 17:26:43 crc kubenswrapper[5120]: I0316 17:26:43.358798 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes-d6shz" Mar 16 17:26:43 crc kubenswrapper[5120]: I0316 17:26:43.470148 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-metadata-neutron-config-1\" (UniqueName: \"kubernetes.io/secret/7798e8ae-c2d9-4748-8971-730d5a5d4d82-nova-metadata-neutron-config-1\") pod \"7798e8ae-c2d9-4748-8971-730d5a5d4d82\" (UID: \"7798e8ae-c2d9-4748-8971-730d5a5d4d82\") " Mar 16 17:26:43 crc kubenswrapper[5120]: I0316 17:26:43.470218 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/7798e8ae-c2d9-4748-8971-730d5a5d4d82-inventory\") pod \"7798e8ae-c2d9-4748-8971-730d5a5d4d82\" (UID: \"7798e8ae-c2d9-4748-8971-730d5a5d4d82\") " Mar 16 17:26:43 crc kubenswrapper[5120]: I0316 17:26:43.470309 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-metadata-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/7798e8ae-c2d9-4748-8971-730d5a5d4d82-nova-metadata-neutron-config-0\") pod \"7798e8ae-c2d9-4748-8971-730d5a5d4d82\" (UID: \"7798e8ae-c2d9-4748-8971-730d5a5d4d82\") " Mar 16 17:26:43 crc kubenswrapper[5120]: I0316 17:26:43.470391 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h4tz7\" (UniqueName: \"kubernetes.io/projected/7798e8ae-c2d9-4748-8971-730d5a5d4d82-kube-api-access-h4tz7\") pod \"7798e8ae-c2d9-4748-8971-730d5a5d4d82\" (UID: \"7798e8ae-c2d9-4748-8971-730d5a5d4d82\") " Mar 16 17:26:43 crc kubenswrapper[5120]: I0316 17:26:43.470455 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/7798e8ae-c2d9-4748-8971-730d5a5d4d82-ssh-key-edpm-compute-no-nodes\") pod \"7798e8ae-c2d9-4748-8971-730d5a5d4d82\" (UID: \"7798e8ae-c2d9-4748-8971-730d5a5d4d82\") " Mar 16 17:26:43 crc kubenswrapper[5120]: I0316 17:26:43.470479 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"neutron-ovn-metadata-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/7798e8ae-c2d9-4748-8971-730d5a5d4d82-neutron-ovn-metadata-agent-neutron-config-0\") pod \"7798e8ae-c2d9-4748-8971-730d5a5d4d82\" (UID: \"7798e8ae-c2d9-4748-8971-730d5a5d4d82\") " Mar 16 17:26:43 crc kubenswrapper[5120]: I0316 17:26:43.470545 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-metadata-neutron-config-2\" (UniqueName: \"kubernetes.io/secret/7798e8ae-c2d9-4748-8971-730d5a5d4d82-nova-metadata-neutron-config-2\") pod \"7798e8ae-c2d9-4748-8971-730d5a5d4d82\" (UID: \"7798e8ae-c2d9-4748-8971-730d5a5d4d82\") " Mar 16 17:26:43 crc kubenswrapper[5120]: I0316 17:26:43.471068 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"neutron-metadata-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7798e8ae-c2d9-4748-8971-730d5a5d4d82-neutron-metadata-combined-ca-bundle\") pod \"7798e8ae-c2d9-4748-8971-730d5a5d4d82\" (UID: \"7798e8ae-c2d9-4748-8971-730d5a5d4d82\") " Mar 16 17:26:43 crc kubenswrapper[5120]: I0316 17:26:43.475929 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7798e8ae-c2d9-4748-8971-730d5a5d4d82-kube-api-access-h4tz7" (OuterVolumeSpecName: "kube-api-access-h4tz7") pod "7798e8ae-c2d9-4748-8971-730d5a5d4d82" (UID: "7798e8ae-c2d9-4748-8971-730d5a5d4d82"). InnerVolumeSpecName "kube-api-access-h4tz7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:26:43 crc kubenswrapper[5120]: I0316 17:26:43.476142 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7798e8ae-c2d9-4748-8971-730d5a5d4d82-neutron-metadata-combined-ca-bundle" (OuterVolumeSpecName: "neutron-metadata-combined-ca-bundle") pod "7798e8ae-c2d9-4748-8971-730d5a5d4d82" (UID: "7798e8ae-c2d9-4748-8971-730d5a5d4d82"). InnerVolumeSpecName "neutron-metadata-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:26:43 crc kubenswrapper[5120]: I0316 17:26:43.494603 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7798e8ae-c2d9-4748-8971-730d5a5d4d82-nova-metadata-neutron-config-2" (OuterVolumeSpecName: "nova-metadata-neutron-config-2") pod "7798e8ae-c2d9-4748-8971-730d5a5d4d82" (UID: "7798e8ae-c2d9-4748-8971-730d5a5d4d82"). InnerVolumeSpecName "nova-metadata-neutron-config-2". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:26:43 crc kubenswrapper[5120]: I0316 17:26:43.494638 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7798e8ae-c2d9-4748-8971-730d5a5d4d82-nova-metadata-neutron-config-0" (OuterVolumeSpecName: "nova-metadata-neutron-config-0") pod "7798e8ae-c2d9-4748-8971-730d5a5d4d82" (UID: "7798e8ae-c2d9-4748-8971-730d5a5d4d82"). InnerVolumeSpecName "nova-metadata-neutron-config-0". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:26:43 crc kubenswrapper[5120]: I0316 17:26:43.497581 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7798e8ae-c2d9-4748-8971-730d5a5d4d82-ssh-key-edpm-compute-no-nodes" (OuterVolumeSpecName: "ssh-key-edpm-compute-no-nodes") pod "7798e8ae-c2d9-4748-8971-730d5a5d4d82" (UID: "7798e8ae-c2d9-4748-8971-730d5a5d4d82"). InnerVolumeSpecName "ssh-key-edpm-compute-no-nodes". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:26:43 crc kubenswrapper[5120]: I0316 17:26:43.498747 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7798e8ae-c2d9-4748-8971-730d5a5d4d82-neutron-ovn-metadata-agent-neutron-config-0" (OuterVolumeSpecName: "neutron-ovn-metadata-agent-neutron-config-0") pod "7798e8ae-c2d9-4748-8971-730d5a5d4d82" (UID: "7798e8ae-c2d9-4748-8971-730d5a5d4d82"). InnerVolumeSpecName "neutron-ovn-metadata-agent-neutron-config-0". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:26:43 crc kubenswrapper[5120]: I0316 17:26:43.502968 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7798e8ae-c2d9-4748-8971-730d5a5d4d82-inventory" (OuterVolumeSpecName: "inventory") pod "7798e8ae-c2d9-4748-8971-730d5a5d4d82" (UID: "7798e8ae-c2d9-4748-8971-730d5a5d4d82"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:26:43 crc kubenswrapper[5120]: I0316 17:26:43.502843 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7798e8ae-c2d9-4748-8971-730d5a5d4d82-nova-metadata-neutron-config-1" (OuterVolumeSpecName: "nova-metadata-neutron-config-1") pod "7798e8ae-c2d9-4748-8971-730d5a5d4d82" (UID: "7798e8ae-c2d9-4748-8971-730d5a5d4d82"). InnerVolumeSpecName "nova-metadata-neutron-config-1". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:26:43 crc kubenswrapper[5120]: I0316 17:26:43.574441 5120 reconciler_common.go:299] "Volume detached for volume \"nova-metadata-neutron-config-1\" (UniqueName: \"kubernetes.io/secret/7798e8ae-c2d9-4748-8971-730d5a5d4d82-nova-metadata-neutron-config-1\") on node \"crc\" DevicePath \"\"" Mar 16 17:26:43 crc kubenswrapper[5120]: I0316 17:26:43.574720 5120 reconciler_common.go:299] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/7798e8ae-c2d9-4748-8971-730d5a5d4d82-inventory\") on node \"crc\" DevicePath \"\"" Mar 16 17:26:43 crc kubenswrapper[5120]: I0316 17:26:43.574908 5120 reconciler_common.go:299] "Volume detached for volume \"nova-metadata-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/7798e8ae-c2d9-4748-8971-730d5a5d4d82-nova-metadata-neutron-config-0\") on node \"crc\" DevicePath \"\"" Mar 16 17:26:43 crc kubenswrapper[5120]: I0316 17:26:43.574975 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h4tz7\" (UniqueName: \"kubernetes.io/projected/7798e8ae-c2d9-4748-8971-730d5a5d4d82-kube-api-access-h4tz7\") on node \"crc\" DevicePath \"\"" Mar 16 17:26:43 crc kubenswrapper[5120]: I0316 17:26:43.575031 5120 reconciler_common.go:299] "Volume detached for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/7798e8ae-c2d9-4748-8971-730d5a5d4d82-ssh-key-edpm-compute-no-nodes\") on node \"crc\" DevicePath \"\"" Mar 16 17:26:43 crc kubenswrapper[5120]: I0316 17:26:43.575090 5120 reconciler_common.go:299] "Volume detached for volume \"neutron-ovn-metadata-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/7798e8ae-c2d9-4748-8971-730d5a5d4d82-neutron-ovn-metadata-agent-neutron-config-0\") on node \"crc\" DevicePath \"\"" Mar 16 17:26:43 crc kubenswrapper[5120]: I0316 17:26:43.575145 5120 reconciler_common.go:299] "Volume detached for volume \"nova-metadata-neutron-config-2\" (UniqueName: \"kubernetes.io/secret/7798e8ae-c2d9-4748-8971-730d5a5d4d82-nova-metadata-neutron-config-2\") on node \"crc\" DevicePath \"\"" Mar 16 17:26:43 crc kubenswrapper[5120]: I0316 17:26:43.575202 5120 reconciler_common.go:299] "Volume detached for volume \"neutron-metadata-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7798e8ae-c2d9-4748-8971-730d5a5d4d82-neutron-metadata-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:26:44 crc kubenswrapper[5120]: I0316 17:26:44.051685 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes-d6shz" event={"ID":"7798e8ae-c2d9-4748-8971-730d5a5d4d82","Type":"ContainerDied","Data":"a7542178566b4497a18bdf07708379ba560fe1f774e7807f0350ea01df4a15ff"} Mar 16 17:26:44 crc kubenswrapper[5120]: I0316 17:26:44.051741 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a7542178566b4497a18bdf07708379ba560fe1f774e7807f0350ea01df4a15ff" Mar 16 17:26:44 crc kubenswrapper[5120]: I0316 17:26:44.051704 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes-d6shz" Mar 16 17:26:44 crc kubenswrapper[5120]: I0316 17:26:44.052215 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-marketplace/redhat-operators-hbphh" podUID="dfe750b5-405d-4458-9209-6be15f12e3a7" containerName="registry-server" containerID="cri-o://65d7c68391304caf39f30994f07bcc21f474e377bbfe87e84591d3e0c4b331bf" gracePeriod=2 Mar 16 17:26:44 crc kubenswrapper[5120]: I0316 17:26:44.137819 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-no-nodes-cpc4h"] Mar 16 17:26:44 crc kubenswrapper[5120]: I0316 17:26:44.139025 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7798e8ae-c2d9-4748-8971-730d5a5d4d82" containerName="neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes" Mar 16 17:26:44 crc kubenswrapper[5120]: I0316 17:26:44.139050 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7798e8ae-c2d9-4748-8971-730d5a5d4d82" containerName="neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes" Mar 16 17:26:44 crc kubenswrapper[5120]: I0316 17:26:44.139286 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7798e8ae-c2d9-4748-8971-730d5a5d4d82" containerName="neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes" Mar 16 17:26:44 crc kubenswrapper[5120]: I0316 17:26:44.220288 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-no-nodes-cpc4h"] Mar 16 17:26:44 crc kubenswrapper[5120]: I0316 17:26:44.220467 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-no-nodes-cpc4h" Mar 16 17:26:44 crc kubenswrapper[5120]: I0316 17:26:44.226709 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplanenodeset-edpm-compute-no-nodes\"" Mar 16 17:26:44 crc kubenswrapper[5120]: I0316 17:26:44.226878 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-aee-default-env\"" Mar 16 17:26:44 crc kubenswrapper[5120]: I0316 17:26:44.227080 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplane-ansible-ssh-private-key-secret\"" Mar 16 17:26:44 crc kubenswrapper[5120]: I0316 17:26:44.228106 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-ovn-agent-neutron-config\"" Mar 16 17:26:44 crc kubenswrapper[5120]: I0316 17:26:44.228275 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-metadata-neutron-config\"" Mar 16 17:26:44 crc kubenswrapper[5120]: I0316 17:26:44.228483 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"combined-ca-bundle\"" Mar 16 17:26:44 crc kubenswrapper[5120]: I0316 17:26:44.228619 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"edpm-compute-no-nodes-dockercfg-znndh\"" Mar 16 17:26:44 crc kubenswrapper[5120]: I0316 17:26:44.289627 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/cd812a73-e066-4163-824a-d1e33f7396f1-nova-metadata-neutron-config-0\") pod \"neutron-ovn-edpm-multinodeset-edpm-compute-no-nodes-cpc4h\" (UID: \"cd812a73-e066-4163-824a-d1e33f7396f1\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-no-nodes-cpc4h" Mar 16 17:26:44 crc kubenswrapper[5120]: I0316 17:26:44.289663 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stpmv\" (UniqueName: \"kubernetes.io/projected/cd812a73-e066-4163-824a-d1e33f7396f1-kube-api-access-stpmv\") pod \"neutron-ovn-edpm-multinodeset-edpm-compute-no-nodes-cpc4h\" (UID: \"cd812a73-e066-4163-824a-d1e33f7396f1\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-no-nodes-cpc4h" Mar 16 17:26:44 crc kubenswrapper[5120]: I0316 17:26:44.289725 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/cd812a73-e066-4163-824a-d1e33f7396f1-ssh-key-edpm-compute-no-nodes\") pod \"neutron-ovn-edpm-multinodeset-edpm-compute-no-nodes-cpc4h\" (UID: \"cd812a73-e066-4163-824a-d1e33f7396f1\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-no-nodes-cpc4h" Mar 16 17:26:44 crc kubenswrapper[5120]: I0316 17:26:44.289789 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"neutron-ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cd812a73-e066-4163-824a-d1e33f7396f1-neutron-ovn-combined-ca-bundle\") pod \"neutron-ovn-edpm-multinodeset-edpm-compute-no-nodes-cpc4h\" (UID: \"cd812a73-e066-4163-824a-d1e33f7396f1\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-no-nodes-cpc4h" Mar 16 17:26:44 crc kubenswrapper[5120]: I0316 17:26:44.289828 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-neutron-config-2\" (UniqueName: \"kubernetes.io/secret/cd812a73-e066-4163-824a-d1e33f7396f1-nova-metadata-neutron-config-2\") pod \"neutron-ovn-edpm-multinodeset-edpm-compute-no-nodes-cpc4h\" (UID: \"cd812a73-e066-4163-824a-d1e33f7396f1\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-no-nodes-cpc4h" Mar 16 17:26:44 crc kubenswrapper[5120]: I0316 17:26:44.289901 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-neutron-config-1\" (UniqueName: \"kubernetes.io/secret/cd812a73-e066-4163-824a-d1e33f7396f1-nova-metadata-neutron-config-1\") pod \"neutron-ovn-edpm-multinodeset-edpm-compute-no-nodes-cpc4h\" (UID: \"cd812a73-e066-4163-824a-d1e33f7396f1\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-no-nodes-cpc4h" Mar 16 17:26:44 crc kubenswrapper[5120]: I0316 17:26:44.289972 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"neutron-ovn-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/cd812a73-e066-4163-824a-d1e33f7396f1-neutron-ovn-agent-neutron-config-0\") pod \"neutron-ovn-edpm-multinodeset-edpm-compute-no-nodes-cpc4h\" (UID: \"cd812a73-e066-4163-824a-d1e33f7396f1\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-no-nodes-cpc4h" Mar 16 17:26:44 crc kubenswrapper[5120]: I0316 17:26:44.290030 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/cd812a73-e066-4163-824a-d1e33f7396f1-inventory\") pod \"neutron-ovn-edpm-multinodeset-edpm-compute-no-nodes-cpc4h\" (UID: \"cd812a73-e066-4163-824a-d1e33f7396f1\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-no-nodes-cpc4h" Mar 16 17:26:44 crc kubenswrapper[5120]: I0316 17:26:44.391622 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-metadata-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/cd812a73-e066-4163-824a-d1e33f7396f1-nova-metadata-neutron-config-0\") pod \"neutron-ovn-edpm-multinodeset-edpm-compute-no-nodes-cpc4h\" (UID: \"cd812a73-e066-4163-824a-d1e33f7396f1\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-no-nodes-cpc4h" Mar 16 17:26:44 crc kubenswrapper[5120]: I0316 17:26:44.391678 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-stpmv\" (UniqueName: \"kubernetes.io/projected/cd812a73-e066-4163-824a-d1e33f7396f1-kube-api-access-stpmv\") pod \"neutron-ovn-edpm-multinodeset-edpm-compute-no-nodes-cpc4h\" (UID: \"cd812a73-e066-4163-824a-d1e33f7396f1\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-no-nodes-cpc4h" Mar 16 17:26:44 crc kubenswrapper[5120]: I0316 17:26:44.391785 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/cd812a73-e066-4163-824a-d1e33f7396f1-ssh-key-edpm-compute-no-nodes\") pod \"neutron-ovn-edpm-multinodeset-edpm-compute-no-nodes-cpc4h\" (UID: \"cd812a73-e066-4163-824a-d1e33f7396f1\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-no-nodes-cpc4h" Mar 16 17:26:44 crc kubenswrapper[5120]: I0316 17:26:44.391857 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"neutron-ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cd812a73-e066-4163-824a-d1e33f7396f1-neutron-ovn-combined-ca-bundle\") pod \"neutron-ovn-edpm-multinodeset-edpm-compute-no-nodes-cpc4h\" (UID: \"cd812a73-e066-4163-824a-d1e33f7396f1\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-no-nodes-cpc4h" Mar 16 17:26:44 crc kubenswrapper[5120]: I0316 17:26:44.391966 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-metadata-neutron-config-2\" (UniqueName: \"kubernetes.io/secret/cd812a73-e066-4163-824a-d1e33f7396f1-nova-metadata-neutron-config-2\") pod \"neutron-ovn-edpm-multinodeset-edpm-compute-no-nodes-cpc4h\" (UID: \"cd812a73-e066-4163-824a-d1e33f7396f1\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-no-nodes-cpc4h" Mar 16 17:26:44 crc kubenswrapper[5120]: I0316 17:26:44.392479 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-metadata-neutron-config-1\" (UniqueName: \"kubernetes.io/secret/cd812a73-e066-4163-824a-d1e33f7396f1-nova-metadata-neutron-config-1\") pod \"neutron-ovn-edpm-multinodeset-edpm-compute-no-nodes-cpc4h\" (UID: \"cd812a73-e066-4163-824a-d1e33f7396f1\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-no-nodes-cpc4h" Mar 16 17:26:44 crc kubenswrapper[5120]: I0316 17:26:44.392602 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"neutron-ovn-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/cd812a73-e066-4163-824a-d1e33f7396f1-neutron-ovn-agent-neutron-config-0\") pod \"neutron-ovn-edpm-multinodeset-edpm-compute-no-nodes-cpc4h\" (UID: \"cd812a73-e066-4163-824a-d1e33f7396f1\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-no-nodes-cpc4h" Mar 16 17:26:44 crc kubenswrapper[5120]: I0316 17:26:44.392698 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/cd812a73-e066-4163-824a-d1e33f7396f1-inventory\") pod \"neutron-ovn-edpm-multinodeset-edpm-compute-no-nodes-cpc4h\" (UID: \"cd812a73-e066-4163-824a-d1e33f7396f1\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-no-nodes-cpc4h" Mar 16 17:26:44 crc kubenswrapper[5120]: I0316 17:26:44.402049 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"neutron-ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cd812a73-e066-4163-824a-d1e33f7396f1-neutron-ovn-combined-ca-bundle\") pod \"neutron-ovn-edpm-multinodeset-edpm-compute-no-nodes-cpc4h\" (UID: \"cd812a73-e066-4163-824a-d1e33f7396f1\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-no-nodes-cpc4h" Mar 16 17:26:44 crc kubenswrapper[5120]: I0316 17:26:44.403556 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-metadata-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/cd812a73-e066-4163-824a-d1e33f7396f1-nova-metadata-neutron-config-0\") pod \"neutron-ovn-edpm-multinodeset-edpm-compute-no-nodes-cpc4h\" (UID: \"cd812a73-e066-4163-824a-d1e33f7396f1\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-no-nodes-cpc4h" Mar 16 17:26:44 crc kubenswrapper[5120]: I0316 17:26:44.407337 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/cd812a73-e066-4163-824a-d1e33f7396f1-ssh-key-edpm-compute-no-nodes\") pod \"neutron-ovn-edpm-multinodeset-edpm-compute-no-nodes-cpc4h\" (UID: \"cd812a73-e066-4163-824a-d1e33f7396f1\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-no-nodes-cpc4h" Mar 16 17:26:44 crc kubenswrapper[5120]: I0316 17:26:44.408387 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-metadata-neutron-config-2\" (UniqueName: \"kubernetes.io/secret/cd812a73-e066-4163-824a-d1e33f7396f1-nova-metadata-neutron-config-2\") pod \"neutron-ovn-edpm-multinodeset-edpm-compute-no-nodes-cpc4h\" (UID: \"cd812a73-e066-4163-824a-d1e33f7396f1\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-no-nodes-cpc4h" Mar 16 17:26:44 crc kubenswrapper[5120]: I0316 17:26:44.409271 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-metadata-neutron-config-1\" (UniqueName: \"kubernetes.io/secret/cd812a73-e066-4163-824a-d1e33f7396f1-nova-metadata-neutron-config-1\") pod \"neutron-ovn-edpm-multinodeset-edpm-compute-no-nodes-cpc4h\" (UID: \"cd812a73-e066-4163-824a-d1e33f7396f1\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-no-nodes-cpc4h" Mar 16 17:26:44 crc kubenswrapper[5120]: I0316 17:26:44.410088 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"neutron-ovn-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/cd812a73-e066-4163-824a-d1e33f7396f1-neutron-ovn-agent-neutron-config-0\") pod \"neutron-ovn-edpm-multinodeset-edpm-compute-no-nodes-cpc4h\" (UID: \"cd812a73-e066-4163-824a-d1e33f7396f1\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-no-nodes-cpc4h" Mar 16 17:26:44 crc kubenswrapper[5120]: I0316 17:26:44.412657 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/cd812a73-e066-4163-824a-d1e33f7396f1-inventory\") pod \"neutron-ovn-edpm-multinodeset-edpm-compute-no-nodes-cpc4h\" (UID: \"cd812a73-e066-4163-824a-d1e33f7396f1\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-no-nodes-cpc4h" Mar 16 17:26:44 crc kubenswrapper[5120]: I0316 17:26:44.435707 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-stpmv\" (UniqueName: \"kubernetes.io/projected/cd812a73-e066-4163-824a-d1e33f7396f1-kube-api-access-stpmv\") pod \"neutron-ovn-edpm-multinodeset-edpm-compute-no-nodes-cpc4h\" (UID: \"cd812a73-e066-4163-824a-d1e33f7396f1\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-no-nodes-cpc4h" Mar 16 17:26:44 crc kubenswrapper[5120]: I0316 17:26:44.596187 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-no-nodes-cpc4h" Mar 16 17:26:44 crc kubenswrapper[5120]: I0316 17:26:44.977467 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-hbphh" Mar 16 17:26:45 crc kubenswrapper[5120]: I0316 17:26:45.005269 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/dfe750b5-405d-4458-9209-6be15f12e3a7-utilities\") pod \"dfe750b5-405d-4458-9209-6be15f12e3a7\" (UID: \"dfe750b5-405d-4458-9209-6be15f12e3a7\") " Mar 16 17:26:45 crc kubenswrapper[5120]: I0316 17:26:45.005587 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/dfe750b5-405d-4458-9209-6be15f12e3a7-catalog-content\") pod \"dfe750b5-405d-4458-9209-6be15f12e3a7\" (UID: \"dfe750b5-405d-4458-9209-6be15f12e3a7\") " Mar 16 17:26:45 crc kubenswrapper[5120]: I0316 17:26:45.005804 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zk92b\" (UniqueName: \"kubernetes.io/projected/dfe750b5-405d-4458-9209-6be15f12e3a7-kube-api-access-zk92b\") pod \"dfe750b5-405d-4458-9209-6be15f12e3a7\" (UID: \"dfe750b5-405d-4458-9209-6be15f12e3a7\") " Mar 16 17:26:45 crc kubenswrapper[5120]: I0316 17:26:45.006922 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dfe750b5-405d-4458-9209-6be15f12e3a7-utilities" (OuterVolumeSpecName: "utilities") pod "dfe750b5-405d-4458-9209-6be15f12e3a7" (UID: "dfe750b5-405d-4458-9209-6be15f12e3a7"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:26:45 crc kubenswrapper[5120]: I0316 17:26:45.013607 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dfe750b5-405d-4458-9209-6be15f12e3a7-kube-api-access-zk92b" (OuterVolumeSpecName: "kube-api-access-zk92b") pod "dfe750b5-405d-4458-9209-6be15f12e3a7" (UID: "dfe750b5-405d-4458-9209-6be15f12e3a7"). InnerVolumeSpecName "kube-api-access-zk92b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:26:45 crc kubenswrapper[5120]: W0316 17:26:45.030589 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcd812a73_e066_4163_824a_d1e33f7396f1.slice/crio-05f5c838bdad59dfbdbba04a2e47879a0c35c1d1be77398a63a64ba79e7ac90a WatchSource:0}: Error finding container 05f5c838bdad59dfbdbba04a2e47879a0c35c1d1be77398a63a64ba79e7ac90a: Status 404 returned error can't find the container with id 05f5c838bdad59dfbdbba04a2e47879a0c35c1d1be77398a63a64ba79e7ac90a Mar 16 17:26:45 crc kubenswrapper[5120]: I0316 17:26:45.031904 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-no-nodes-cpc4h"] Mar 16 17:26:45 crc kubenswrapper[5120]: I0316 17:26:45.062094 5120 generic.go:358] "Generic (PLEG): container finished" podID="dfe750b5-405d-4458-9209-6be15f12e3a7" containerID="65d7c68391304caf39f30994f07bcc21f474e377bbfe87e84591d3e0c4b331bf" exitCode=0 Mar 16 17:26:45 crc kubenswrapper[5120]: I0316 17:26:45.062167 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-hbphh" Mar 16 17:26:45 crc kubenswrapper[5120]: I0316 17:26:45.062180 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-hbphh" event={"ID":"dfe750b5-405d-4458-9209-6be15f12e3a7","Type":"ContainerDied","Data":"65d7c68391304caf39f30994f07bcc21f474e377bbfe87e84591d3e0c4b331bf"} Mar 16 17:26:45 crc kubenswrapper[5120]: I0316 17:26:45.062218 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-hbphh" event={"ID":"dfe750b5-405d-4458-9209-6be15f12e3a7","Type":"ContainerDied","Data":"6f6f38dc9beba56e608eab3055f389059036d2afa082f1c339c5966d4aeb183c"} Mar 16 17:26:45 crc kubenswrapper[5120]: I0316 17:26:45.062272 5120 scope.go:117] "RemoveContainer" containerID="65d7c68391304caf39f30994f07bcc21f474e377bbfe87e84591d3e0c4b331bf" Mar 16 17:26:45 crc kubenswrapper[5120]: I0316 17:26:45.066036 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-no-nodes-cpc4h" event={"ID":"cd812a73-e066-4163-824a-d1e33f7396f1","Type":"ContainerStarted","Data":"05f5c838bdad59dfbdbba04a2e47879a0c35c1d1be77398a63a64ba79e7ac90a"} Mar 16 17:26:45 crc kubenswrapper[5120]: I0316 17:26:45.085269 5120 scope.go:117] "RemoveContainer" containerID="5cff4d32fe632972e0563176b342b1877f0a8112a45df2b316a23f360d29069a" Mar 16 17:26:45 crc kubenswrapper[5120]: I0316 17:26:45.108789 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zk92b\" (UniqueName: \"kubernetes.io/projected/dfe750b5-405d-4458-9209-6be15f12e3a7-kube-api-access-zk92b\") on node \"crc\" DevicePath \"\"" Mar 16 17:26:45 crc kubenswrapper[5120]: I0316 17:26:45.108832 5120 reconciler_common.go:299] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/dfe750b5-405d-4458-9209-6be15f12e3a7-utilities\") on node \"crc\" DevicePath \"\"" Mar 16 17:26:45 crc kubenswrapper[5120]: I0316 17:26:45.115786 5120 scope.go:117] "RemoveContainer" containerID="db17c434cc94a79c7935aa450b9c24e36aa4ad97a01d0b139d6d1823c38e2a5f" Mar 16 17:26:45 crc kubenswrapper[5120]: I0316 17:26:45.135470 5120 scope.go:117] "RemoveContainer" containerID="65d7c68391304caf39f30994f07bcc21f474e377bbfe87e84591d3e0c4b331bf" Mar 16 17:26:45 crc kubenswrapper[5120]: E0316 17:26:45.135803 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"65d7c68391304caf39f30994f07bcc21f474e377bbfe87e84591d3e0c4b331bf\": container with ID starting with 65d7c68391304caf39f30994f07bcc21f474e377bbfe87e84591d3e0c4b331bf not found: ID does not exist" containerID="65d7c68391304caf39f30994f07bcc21f474e377bbfe87e84591d3e0c4b331bf" Mar 16 17:26:45 crc kubenswrapper[5120]: I0316 17:26:45.135839 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65d7c68391304caf39f30994f07bcc21f474e377bbfe87e84591d3e0c4b331bf"} err="failed to get container status \"65d7c68391304caf39f30994f07bcc21f474e377bbfe87e84591d3e0c4b331bf\": rpc error: code = NotFound desc = could not find container \"65d7c68391304caf39f30994f07bcc21f474e377bbfe87e84591d3e0c4b331bf\": container with ID starting with 65d7c68391304caf39f30994f07bcc21f474e377bbfe87e84591d3e0c4b331bf not found: ID does not exist" Mar 16 17:26:45 crc kubenswrapper[5120]: I0316 17:26:45.135865 5120 scope.go:117] "RemoveContainer" containerID="5cff4d32fe632972e0563176b342b1877f0a8112a45df2b316a23f360d29069a" Mar 16 17:26:45 crc kubenswrapper[5120]: E0316 17:26:45.136210 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5cff4d32fe632972e0563176b342b1877f0a8112a45df2b316a23f360d29069a\": container with ID starting with 5cff4d32fe632972e0563176b342b1877f0a8112a45df2b316a23f360d29069a not found: ID does not exist" containerID="5cff4d32fe632972e0563176b342b1877f0a8112a45df2b316a23f360d29069a" Mar 16 17:26:45 crc kubenswrapper[5120]: I0316 17:26:45.136254 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5cff4d32fe632972e0563176b342b1877f0a8112a45df2b316a23f360d29069a"} err="failed to get container status \"5cff4d32fe632972e0563176b342b1877f0a8112a45df2b316a23f360d29069a\": rpc error: code = NotFound desc = could not find container \"5cff4d32fe632972e0563176b342b1877f0a8112a45df2b316a23f360d29069a\": container with ID starting with 5cff4d32fe632972e0563176b342b1877f0a8112a45df2b316a23f360d29069a not found: ID does not exist" Mar 16 17:26:45 crc kubenswrapper[5120]: I0316 17:26:45.136286 5120 scope.go:117] "RemoveContainer" containerID="db17c434cc94a79c7935aa450b9c24e36aa4ad97a01d0b139d6d1823c38e2a5f" Mar 16 17:26:45 crc kubenswrapper[5120]: E0316 17:26:45.136544 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db17c434cc94a79c7935aa450b9c24e36aa4ad97a01d0b139d6d1823c38e2a5f\": container with ID starting with db17c434cc94a79c7935aa450b9c24e36aa4ad97a01d0b139d6d1823c38e2a5f not found: ID does not exist" containerID="db17c434cc94a79c7935aa450b9c24e36aa4ad97a01d0b139d6d1823c38e2a5f" Mar 16 17:26:45 crc kubenswrapper[5120]: I0316 17:26:45.136584 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db17c434cc94a79c7935aa450b9c24e36aa4ad97a01d0b139d6d1823c38e2a5f"} err="failed to get container status \"db17c434cc94a79c7935aa450b9c24e36aa4ad97a01d0b139d6d1823c38e2a5f\": rpc error: code = NotFound desc = could not find container \"db17c434cc94a79c7935aa450b9c24e36aa4ad97a01d0b139d6d1823c38e2a5f\": container with ID starting with db17c434cc94a79c7935aa450b9c24e36aa4ad97a01d0b139d6d1823c38e2a5f not found: ID does not exist" Mar 16 17:26:45 crc kubenswrapper[5120]: I0316 17:26:45.170602 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dfe750b5-405d-4458-9209-6be15f12e3a7-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "dfe750b5-405d-4458-9209-6be15f12e3a7" (UID: "dfe750b5-405d-4458-9209-6be15f12e3a7"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:26:45 crc kubenswrapper[5120]: I0316 17:26:45.210820 5120 reconciler_common.go:299] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/dfe750b5-405d-4458-9209-6be15f12e3a7-catalog-content\") on node \"crc\" DevicePath \"\"" Mar 16 17:26:45 crc kubenswrapper[5120]: I0316 17:26:45.398841 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-operators-hbphh"] Mar 16 17:26:45 crc kubenswrapper[5120]: I0316 17:26:45.405771 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/redhat-operators-hbphh"] Mar 16 17:26:46 crc kubenswrapper[5120]: I0316 17:26:46.078654 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-no-nodes-cpc4h" event={"ID":"cd812a73-e066-4163-824a-d1e33f7396f1","Type":"ContainerStarted","Data":"9606e6c1a920a405983e1b56e2ededfe1c2e6f5221ce180c91f90bc5f8e53168"} Mar 16 17:26:46 crc kubenswrapper[5120]: I0316 17:26:46.097372 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-no-nodes-cpc4h" podStartSLOduration=1.618011917 podStartE2EDuration="2.097353566s" podCreationTimestamp="2026-03-16 17:26:44 +0000 UTC" firstStartedPulling="2026-03-16 17:26:45.032715424 +0000 UTC m=+6907.186647081" lastFinishedPulling="2026-03-16 17:26:45.512057073 +0000 UTC m=+6907.665988730" observedRunningTime="2026-03-16 17:26:46.092866534 +0000 UTC m=+6908.246798211" watchObservedRunningTime="2026-03-16 17:26:46.097353566 +0000 UTC m=+6908.251285213" Mar 16 17:26:46 crc kubenswrapper[5120]: I0316 17:26:46.674803 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dfe750b5-405d-4458-9209-6be15f12e3a7" path="/var/lib/kubelet/pods/dfe750b5-405d-4458-9209-6be15f12e3a7/volumes" Mar 16 17:26:47 crc kubenswrapper[5120]: I0316 17:26:47.096232 5120 generic.go:358] "Generic (PLEG): container finished" podID="cd812a73-e066-4163-824a-d1e33f7396f1" containerID="9606e6c1a920a405983e1b56e2ededfe1c2e6f5221ce180c91f90bc5f8e53168" exitCode=0 Mar 16 17:26:47 crc kubenswrapper[5120]: I0316 17:26:47.096304 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-no-nodes-cpc4h" event={"ID":"cd812a73-e066-4163-824a-d1e33f7396f1","Type":"ContainerDied","Data":"9606e6c1a920a405983e1b56e2ededfe1c2e6f5221ce180c91f90bc5f8e53168"} Mar 16 17:26:47 crc kubenswrapper[5120]: I0316 17:26:47.465559 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-v822j_ac55471d-4e42-475f-a082-50f611571482/kube-multus/0.log" Mar 16 17:26:47 crc kubenswrapper[5120]: I0316 17:26:47.469869 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-crc_9f0bc7fcb0822a2c13eb2d22cd8c0641/kube-controller-manager/0.log" Mar 16 17:26:47 crc kubenswrapper[5120]: I0316 17:26:47.781721 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-v822j_ac55471d-4e42-475f-a082-50f611571482/kube-multus/0.log" Mar 16 17:26:47 crc kubenswrapper[5120]: I0316 17:26:47.787153 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-crc_9f0bc7fcb0822a2c13eb2d22cd8c0641/kube-controller-manager/0.log" Mar 16 17:26:48 crc kubenswrapper[5120]: I0316 17:26:48.452797 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-no-nodes-cpc4h" Mar 16 17:26:48 crc kubenswrapper[5120]: I0316 17:26:48.583464 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/cd812a73-e066-4163-824a-d1e33f7396f1-inventory\") pod \"cd812a73-e066-4163-824a-d1e33f7396f1\" (UID: \"cd812a73-e066-4163-824a-d1e33f7396f1\") " Mar 16 17:26:48 crc kubenswrapper[5120]: I0316 17:26:48.583599 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-metadata-neutron-config-1\" (UniqueName: \"kubernetes.io/secret/cd812a73-e066-4163-824a-d1e33f7396f1-nova-metadata-neutron-config-1\") pod \"cd812a73-e066-4163-824a-d1e33f7396f1\" (UID: \"cd812a73-e066-4163-824a-d1e33f7396f1\") " Mar 16 17:26:48 crc kubenswrapper[5120]: I0316 17:26:48.583630 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-stpmv\" (UniqueName: \"kubernetes.io/projected/cd812a73-e066-4163-824a-d1e33f7396f1-kube-api-access-stpmv\") pod \"cd812a73-e066-4163-824a-d1e33f7396f1\" (UID: \"cd812a73-e066-4163-824a-d1e33f7396f1\") " Mar 16 17:26:48 crc kubenswrapper[5120]: I0316 17:26:48.583699 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-metadata-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/cd812a73-e066-4163-824a-d1e33f7396f1-nova-metadata-neutron-config-0\") pod \"cd812a73-e066-4163-824a-d1e33f7396f1\" (UID: \"cd812a73-e066-4163-824a-d1e33f7396f1\") " Mar 16 17:26:48 crc kubenswrapper[5120]: I0316 17:26:48.583775 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"neutron-ovn-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/cd812a73-e066-4163-824a-d1e33f7396f1-neutron-ovn-agent-neutron-config-0\") pod \"cd812a73-e066-4163-824a-d1e33f7396f1\" (UID: \"cd812a73-e066-4163-824a-d1e33f7396f1\") " Mar 16 17:26:48 crc kubenswrapper[5120]: I0316 17:26:48.584112 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/cd812a73-e066-4163-824a-d1e33f7396f1-ssh-key-edpm-compute-no-nodes\") pod \"cd812a73-e066-4163-824a-d1e33f7396f1\" (UID: \"cd812a73-e066-4163-824a-d1e33f7396f1\") " Mar 16 17:26:48 crc kubenswrapper[5120]: I0316 17:26:48.584172 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-metadata-neutron-config-2\" (UniqueName: \"kubernetes.io/secret/cd812a73-e066-4163-824a-d1e33f7396f1-nova-metadata-neutron-config-2\") pod \"cd812a73-e066-4163-824a-d1e33f7396f1\" (UID: \"cd812a73-e066-4163-824a-d1e33f7396f1\") " Mar 16 17:26:48 crc kubenswrapper[5120]: I0316 17:26:48.584226 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"neutron-ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cd812a73-e066-4163-824a-d1e33f7396f1-neutron-ovn-combined-ca-bundle\") pod \"cd812a73-e066-4163-824a-d1e33f7396f1\" (UID: \"cd812a73-e066-4163-824a-d1e33f7396f1\") " Mar 16 17:26:48 crc kubenswrapper[5120]: I0316 17:26:48.589542 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd812a73-e066-4163-824a-d1e33f7396f1-neutron-ovn-combined-ca-bundle" (OuterVolumeSpecName: "neutron-ovn-combined-ca-bundle") pod "cd812a73-e066-4163-824a-d1e33f7396f1" (UID: "cd812a73-e066-4163-824a-d1e33f7396f1"). InnerVolumeSpecName "neutron-ovn-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:26:48 crc kubenswrapper[5120]: I0316 17:26:48.589993 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd812a73-e066-4163-824a-d1e33f7396f1-kube-api-access-stpmv" (OuterVolumeSpecName: "kube-api-access-stpmv") pod "cd812a73-e066-4163-824a-d1e33f7396f1" (UID: "cd812a73-e066-4163-824a-d1e33f7396f1"). InnerVolumeSpecName "kube-api-access-stpmv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:26:48 crc kubenswrapper[5120]: I0316 17:26:48.607184 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd812a73-e066-4163-824a-d1e33f7396f1-nova-metadata-neutron-config-1" (OuterVolumeSpecName: "nova-metadata-neutron-config-1") pod "cd812a73-e066-4163-824a-d1e33f7396f1" (UID: "cd812a73-e066-4163-824a-d1e33f7396f1"). InnerVolumeSpecName "nova-metadata-neutron-config-1". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:26:48 crc kubenswrapper[5120]: I0316 17:26:48.607214 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd812a73-e066-4163-824a-d1e33f7396f1-neutron-ovn-agent-neutron-config-0" (OuterVolumeSpecName: "neutron-ovn-agent-neutron-config-0") pod "cd812a73-e066-4163-824a-d1e33f7396f1" (UID: "cd812a73-e066-4163-824a-d1e33f7396f1"). InnerVolumeSpecName "neutron-ovn-agent-neutron-config-0". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:26:48 crc kubenswrapper[5120]: I0316 17:26:48.607510 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd812a73-e066-4163-824a-d1e33f7396f1-nova-metadata-neutron-config-0" (OuterVolumeSpecName: "nova-metadata-neutron-config-0") pod "cd812a73-e066-4163-824a-d1e33f7396f1" (UID: "cd812a73-e066-4163-824a-d1e33f7396f1"). InnerVolumeSpecName "nova-metadata-neutron-config-0". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:26:48 crc kubenswrapper[5120]: I0316 17:26:48.608538 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd812a73-e066-4163-824a-d1e33f7396f1-inventory" (OuterVolumeSpecName: "inventory") pod "cd812a73-e066-4163-824a-d1e33f7396f1" (UID: "cd812a73-e066-4163-824a-d1e33f7396f1"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:26:48 crc kubenswrapper[5120]: I0316 17:26:48.610426 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd812a73-e066-4163-824a-d1e33f7396f1-ssh-key-edpm-compute-no-nodes" (OuterVolumeSpecName: "ssh-key-edpm-compute-no-nodes") pod "cd812a73-e066-4163-824a-d1e33f7396f1" (UID: "cd812a73-e066-4163-824a-d1e33f7396f1"). InnerVolumeSpecName "ssh-key-edpm-compute-no-nodes". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:26:48 crc kubenswrapper[5120]: I0316 17:26:48.612082 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd812a73-e066-4163-824a-d1e33f7396f1-nova-metadata-neutron-config-2" (OuterVolumeSpecName: "nova-metadata-neutron-config-2") pod "cd812a73-e066-4163-824a-d1e33f7396f1" (UID: "cd812a73-e066-4163-824a-d1e33f7396f1"). InnerVolumeSpecName "nova-metadata-neutron-config-2". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:26:48 crc kubenswrapper[5120]: I0316 17:26:48.688611 5120 reconciler_common.go:299] "Volume detached for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/cd812a73-e066-4163-824a-d1e33f7396f1-ssh-key-edpm-compute-no-nodes\") on node \"crc\" DevicePath \"\"" Mar 16 17:26:48 crc kubenswrapper[5120]: I0316 17:26:48.688684 5120 reconciler_common.go:299] "Volume detached for volume \"nova-metadata-neutron-config-2\" (UniqueName: \"kubernetes.io/secret/cd812a73-e066-4163-824a-d1e33f7396f1-nova-metadata-neutron-config-2\") on node \"crc\" DevicePath \"\"" Mar 16 17:26:48 crc kubenswrapper[5120]: I0316 17:26:48.688696 5120 reconciler_common.go:299] "Volume detached for volume \"neutron-ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cd812a73-e066-4163-824a-d1e33f7396f1-neutron-ovn-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:26:48 crc kubenswrapper[5120]: I0316 17:26:48.688732 5120 reconciler_common.go:299] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/cd812a73-e066-4163-824a-d1e33f7396f1-inventory\") on node \"crc\" DevicePath \"\"" Mar 16 17:26:48 crc kubenswrapper[5120]: I0316 17:26:48.688788 5120 reconciler_common.go:299] "Volume detached for volume \"nova-metadata-neutron-config-1\" (UniqueName: \"kubernetes.io/secret/cd812a73-e066-4163-824a-d1e33f7396f1-nova-metadata-neutron-config-1\") on node \"crc\" DevicePath \"\"" Mar 16 17:26:48 crc kubenswrapper[5120]: I0316 17:26:48.688807 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-stpmv\" (UniqueName: \"kubernetes.io/projected/cd812a73-e066-4163-824a-d1e33f7396f1-kube-api-access-stpmv\") on node \"crc\" DevicePath \"\"" Mar 16 17:26:48 crc kubenswrapper[5120]: I0316 17:26:48.688820 5120 reconciler_common.go:299] "Volume detached for volume \"nova-metadata-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/cd812a73-e066-4163-824a-d1e33f7396f1-nova-metadata-neutron-config-0\") on node \"crc\" DevicePath \"\"" Mar 16 17:26:48 crc kubenswrapper[5120]: I0316 17:26:48.688833 5120 reconciler_common.go:299] "Volume detached for volume \"neutron-ovn-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/cd812a73-e066-4163-824a-d1e33f7396f1-neutron-ovn-agent-neutron-config-0\") on node \"crc\" DevicePath \"\"" Mar 16 17:26:49 crc kubenswrapper[5120]: I0316 17:26:49.117099 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-no-nodes-cpc4h" Mar 16 17:26:49 crc kubenswrapper[5120]: I0316 17:26:49.117125 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-no-nodes-cpc4h" event={"ID":"cd812a73-e066-4163-824a-d1e33f7396f1","Type":"ContainerDied","Data":"05f5c838bdad59dfbdbba04a2e47879a0c35c1d1be77398a63a64ba79e7ac90a"} Mar 16 17:26:49 crc kubenswrapper[5120]: I0316 17:26:49.117552 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="05f5c838bdad59dfbdbba04a2e47879a0c35c1d1be77398a63a64ba79e7ac90a" Mar 16 17:26:49 crc kubenswrapper[5120]: I0316 17:26:49.177522 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-sriov-edpm-multinodeset-edpm-compute-no-nodes-wvsb9"] Mar 16 17:26:49 crc kubenswrapper[5120]: I0316 17:26:49.178986 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dfe750b5-405d-4458-9209-6be15f12e3a7" containerName="registry-server" Mar 16 17:26:49 crc kubenswrapper[5120]: I0316 17:26:49.179016 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="dfe750b5-405d-4458-9209-6be15f12e3a7" containerName="registry-server" Mar 16 17:26:49 crc kubenswrapper[5120]: I0316 17:26:49.179053 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dfe750b5-405d-4458-9209-6be15f12e3a7" containerName="extract-content" Mar 16 17:26:49 crc kubenswrapper[5120]: I0316 17:26:49.179059 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="dfe750b5-405d-4458-9209-6be15f12e3a7" containerName="extract-content" Mar 16 17:26:49 crc kubenswrapper[5120]: I0316 17:26:49.179073 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dfe750b5-405d-4458-9209-6be15f12e3a7" containerName="extract-utilities" Mar 16 17:26:49 crc kubenswrapper[5120]: I0316 17:26:49.179080 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="dfe750b5-405d-4458-9209-6be15f12e3a7" containerName="extract-utilities" Mar 16 17:26:49 crc kubenswrapper[5120]: I0316 17:26:49.179096 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd812a73-e066-4163-824a-d1e33f7396f1" containerName="neutron-ovn-edpm-multinodeset-edpm-compute-no-nodes" Mar 16 17:26:49 crc kubenswrapper[5120]: I0316 17:26:49.179106 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd812a73-e066-4163-824a-d1e33f7396f1" containerName="neutron-ovn-edpm-multinodeset-edpm-compute-no-nodes" Mar 16 17:26:49 crc kubenswrapper[5120]: I0316 17:26:49.179227 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="dfe750b5-405d-4458-9209-6be15f12e3a7" containerName="registry-server" Mar 16 17:26:49 crc kubenswrapper[5120]: I0316 17:26:49.179238 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="cd812a73-e066-4163-824a-d1e33f7396f1" containerName="neutron-ovn-edpm-multinodeset-edpm-compute-no-nodes" Mar 16 17:26:49 crc kubenswrapper[5120]: I0316 17:26:49.186030 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-sriov-edpm-multinodeset-edpm-compute-no-nodes-wvsb9" Mar 16 17:26:49 crc kubenswrapper[5120]: I0316 17:26:49.188089 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplanenodeset-edpm-compute-no-nodes\"" Mar 16 17:26:49 crc kubenswrapper[5120]: I0316 17:26:49.188621 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-sriov-agent-neutron-config\"" Mar 16 17:26:49 crc kubenswrapper[5120]: I0316 17:26:49.189162 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"edpm-compute-no-nodes-dockercfg-znndh\"" Mar 16 17:26:49 crc kubenswrapper[5120]: I0316 17:26:49.189862 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-aee-default-env\"" Mar 16 17:26:49 crc kubenswrapper[5120]: I0316 17:26:49.190088 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplane-ansible-ssh-private-key-secret\"" Mar 16 17:26:49 crc kubenswrapper[5120]: I0316 17:26:49.191097 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-sriov-edpm-multinodeset-edpm-compute-no-nodes-wvsb9"] Mar 16 17:26:49 crc kubenswrapper[5120]: I0316 17:26:49.191589 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"combined-ca-bundle\"" Mar 16 17:26:49 crc kubenswrapper[5120]: I0316 17:26:49.300298 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9thcr\" (UniqueName: \"kubernetes.io/projected/24347f47-4e7b-40ab-a307-6f7226d3ee17-kube-api-access-9thcr\") pod \"neutron-sriov-edpm-multinodeset-edpm-compute-no-nodes-wvsb9\" (UID: \"24347f47-4e7b-40ab-a307-6f7226d3ee17\") " pod="openstack-kuttl-tests/neutron-sriov-edpm-multinodeset-edpm-compute-no-nodes-wvsb9" Mar 16 17:26:49 crc kubenswrapper[5120]: I0316 17:26:49.300434 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"neutron-sriov-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/24347f47-4e7b-40ab-a307-6f7226d3ee17-neutron-sriov-agent-neutron-config-0\") pod \"neutron-sriov-edpm-multinodeset-edpm-compute-no-nodes-wvsb9\" (UID: \"24347f47-4e7b-40ab-a307-6f7226d3ee17\") " pod="openstack-kuttl-tests/neutron-sriov-edpm-multinodeset-edpm-compute-no-nodes-wvsb9" Mar 16 17:26:49 crc kubenswrapper[5120]: I0316 17:26:49.300621 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/24347f47-4e7b-40ab-a307-6f7226d3ee17-inventory\") pod \"neutron-sriov-edpm-multinodeset-edpm-compute-no-nodes-wvsb9\" (UID: \"24347f47-4e7b-40ab-a307-6f7226d3ee17\") " pod="openstack-kuttl-tests/neutron-sriov-edpm-multinodeset-edpm-compute-no-nodes-wvsb9" Mar 16 17:26:49 crc kubenswrapper[5120]: I0316 17:26:49.300928 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"neutron-sriov-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/24347f47-4e7b-40ab-a307-6f7226d3ee17-neutron-sriov-combined-ca-bundle\") pod \"neutron-sriov-edpm-multinodeset-edpm-compute-no-nodes-wvsb9\" (UID: \"24347f47-4e7b-40ab-a307-6f7226d3ee17\") " pod="openstack-kuttl-tests/neutron-sriov-edpm-multinodeset-edpm-compute-no-nodes-wvsb9" Mar 16 17:26:49 crc kubenswrapper[5120]: I0316 17:26:49.301007 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/24347f47-4e7b-40ab-a307-6f7226d3ee17-ssh-key-edpm-compute-no-nodes\") pod \"neutron-sriov-edpm-multinodeset-edpm-compute-no-nodes-wvsb9\" (UID: \"24347f47-4e7b-40ab-a307-6f7226d3ee17\") " pod="openstack-kuttl-tests/neutron-sriov-edpm-multinodeset-edpm-compute-no-nodes-wvsb9" Mar 16 17:26:49 crc kubenswrapper[5120]: I0316 17:26:49.403015 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/24347f47-4e7b-40ab-a307-6f7226d3ee17-ssh-key-edpm-compute-no-nodes\") pod \"neutron-sriov-edpm-multinodeset-edpm-compute-no-nodes-wvsb9\" (UID: \"24347f47-4e7b-40ab-a307-6f7226d3ee17\") " pod="openstack-kuttl-tests/neutron-sriov-edpm-multinodeset-edpm-compute-no-nodes-wvsb9" Mar 16 17:26:49 crc kubenswrapper[5120]: I0316 17:26:49.403222 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9thcr\" (UniqueName: \"kubernetes.io/projected/24347f47-4e7b-40ab-a307-6f7226d3ee17-kube-api-access-9thcr\") pod \"neutron-sriov-edpm-multinodeset-edpm-compute-no-nodes-wvsb9\" (UID: \"24347f47-4e7b-40ab-a307-6f7226d3ee17\") " pod="openstack-kuttl-tests/neutron-sriov-edpm-multinodeset-edpm-compute-no-nodes-wvsb9" Mar 16 17:26:49 crc kubenswrapper[5120]: I0316 17:26:49.403306 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"neutron-sriov-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/24347f47-4e7b-40ab-a307-6f7226d3ee17-neutron-sriov-agent-neutron-config-0\") pod \"neutron-sriov-edpm-multinodeset-edpm-compute-no-nodes-wvsb9\" (UID: \"24347f47-4e7b-40ab-a307-6f7226d3ee17\") " pod="openstack-kuttl-tests/neutron-sriov-edpm-multinodeset-edpm-compute-no-nodes-wvsb9" Mar 16 17:26:49 crc kubenswrapper[5120]: I0316 17:26:49.403358 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/24347f47-4e7b-40ab-a307-6f7226d3ee17-inventory\") pod \"neutron-sriov-edpm-multinodeset-edpm-compute-no-nodes-wvsb9\" (UID: \"24347f47-4e7b-40ab-a307-6f7226d3ee17\") " pod="openstack-kuttl-tests/neutron-sriov-edpm-multinodeset-edpm-compute-no-nodes-wvsb9" Mar 16 17:26:49 crc kubenswrapper[5120]: I0316 17:26:49.403517 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"neutron-sriov-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/24347f47-4e7b-40ab-a307-6f7226d3ee17-neutron-sriov-combined-ca-bundle\") pod \"neutron-sriov-edpm-multinodeset-edpm-compute-no-nodes-wvsb9\" (UID: \"24347f47-4e7b-40ab-a307-6f7226d3ee17\") " pod="openstack-kuttl-tests/neutron-sriov-edpm-multinodeset-edpm-compute-no-nodes-wvsb9" Mar 16 17:26:49 crc kubenswrapper[5120]: I0316 17:26:49.409637 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"neutron-sriov-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/24347f47-4e7b-40ab-a307-6f7226d3ee17-neutron-sriov-agent-neutron-config-0\") pod \"neutron-sriov-edpm-multinodeset-edpm-compute-no-nodes-wvsb9\" (UID: \"24347f47-4e7b-40ab-a307-6f7226d3ee17\") " pod="openstack-kuttl-tests/neutron-sriov-edpm-multinodeset-edpm-compute-no-nodes-wvsb9" Mar 16 17:26:49 crc kubenswrapper[5120]: I0316 17:26:49.415136 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/24347f47-4e7b-40ab-a307-6f7226d3ee17-inventory\") pod \"neutron-sriov-edpm-multinodeset-edpm-compute-no-nodes-wvsb9\" (UID: \"24347f47-4e7b-40ab-a307-6f7226d3ee17\") " pod="openstack-kuttl-tests/neutron-sriov-edpm-multinodeset-edpm-compute-no-nodes-wvsb9" Mar 16 17:26:49 crc kubenswrapper[5120]: I0316 17:26:49.415403 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"neutron-sriov-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/24347f47-4e7b-40ab-a307-6f7226d3ee17-neutron-sriov-combined-ca-bundle\") pod \"neutron-sriov-edpm-multinodeset-edpm-compute-no-nodes-wvsb9\" (UID: \"24347f47-4e7b-40ab-a307-6f7226d3ee17\") " pod="openstack-kuttl-tests/neutron-sriov-edpm-multinodeset-edpm-compute-no-nodes-wvsb9" Mar 16 17:26:49 crc kubenswrapper[5120]: I0316 17:26:49.415639 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/24347f47-4e7b-40ab-a307-6f7226d3ee17-ssh-key-edpm-compute-no-nodes\") pod \"neutron-sriov-edpm-multinodeset-edpm-compute-no-nodes-wvsb9\" (UID: \"24347f47-4e7b-40ab-a307-6f7226d3ee17\") " pod="openstack-kuttl-tests/neutron-sriov-edpm-multinodeset-edpm-compute-no-nodes-wvsb9" Mar 16 17:26:49 crc kubenswrapper[5120]: I0316 17:26:49.419649 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9thcr\" (UniqueName: \"kubernetes.io/projected/24347f47-4e7b-40ab-a307-6f7226d3ee17-kube-api-access-9thcr\") pod \"neutron-sriov-edpm-multinodeset-edpm-compute-no-nodes-wvsb9\" (UID: \"24347f47-4e7b-40ab-a307-6f7226d3ee17\") " pod="openstack-kuttl-tests/neutron-sriov-edpm-multinodeset-edpm-compute-no-nodes-wvsb9" Mar 16 17:26:49 crc kubenswrapper[5120]: I0316 17:26:49.510873 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-sriov-edpm-multinodeset-edpm-compute-no-nodes-wvsb9" Mar 16 17:26:49 crc kubenswrapper[5120]: I0316 17:26:49.942955 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-sriov-edpm-multinodeset-edpm-compute-no-nodes-wvsb9"] Mar 16 17:26:49 crc kubenswrapper[5120]: W0316 17:26:49.944052 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod24347f47_4e7b_40ab_a307_6f7226d3ee17.slice/crio-df66c614af93d218638544232c55832ccd1fdf9af6d86d063f0191586bf2192e WatchSource:0}: Error finding container df66c614af93d218638544232c55832ccd1fdf9af6d86d063f0191586bf2192e: Status 404 returned error can't find the container with id df66c614af93d218638544232c55832ccd1fdf9af6d86d063f0191586bf2192e Mar 16 17:26:50 crc kubenswrapper[5120]: I0316 17:26:50.129572 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-sriov-edpm-multinodeset-edpm-compute-no-nodes-wvsb9" event={"ID":"24347f47-4e7b-40ab-a307-6f7226d3ee17","Type":"ContainerStarted","Data":"df66c614af93d218638544232c55832ccd1fdf9af6d86d063f0191586bf2192e"} Mar 16 17:26:51 crc kubenswrapper[5120]: I0316 17:26:51.154746 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-sriov-edpm-multinodeset-edpm-compute-no-nodes-wvsb9" event={"ID":"24347f47-4e7b-40ab-a307-6f7226d3ee17","Type":"ContainerStarted","Data":"b86ea823c85103cde50cbedb18a2cd871e13bde21ea5a64d0b57c89f40dcfd0b"} Mar 16 17:26:51 crc kubenswrapper[5120]: I0316 17:26:51.175996 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-sriov-edpm-multinodeset-edpm-compute-no-nodes-wvsb9" podStartSLOduration=1.5259214380000001 podStartE2EDuration="2.17597445s" podCreationTimestamp="2026-03-16 17:26:49 +0000 UTC" firstStartedPulling="2026-03-16 17:26:49.946297809 +0000 UTC m=+6912.100229466" lastFinishedPulling="2026-03-16 17:26:50.596350801 +0000 UTC m=+6912.750282478" observedRunningTime="2026-03-16 17:26:51.169848783 +0000 UTC m=+6913.323780500" watchObservedRunningTime="2026-03-16 17:26:51.17597445 +0000 UTC m=+6913.329906107" Mar 16 17:26:52 crc kubenswrapper[5120]: I0316 17:26:52.170696 5120 generic.go:358] "Generic (PLEG): container finished" podID="24347f47-4e7b-40ab-a307-6f7226d3ee17" containerID="b86ea823c85103cde50cbedb18a2cd871e13bde21ea5a64d0b57c89f40dcfd0b" exitCode=0 Mar 16 17:26:52 crc kubenswrapper[5120]: I0316 17:26:52.170864 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-sriov-edpm-multinodeset-edpm-compute-no-nodes-wvsb9" event={"ID":"24347f47-4e7b-40ab-a307-6f7226d3ee17","Type":"ContainerDied","Data":"b86ea823c85103cde50cbedb18a2cd871e13bde21ea5a64d0b57c89f40dcfd0b"} Mar 16 17:26:52 crc kubenswrapper[5120]: I0316 17:26:52.245637 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-marketplace-kx46q"] Mar 16 17:26:52 crc kubenswrapper[5120]: I0316 17:26:52.252675 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-kx46q" Mar 16 17:26:52 crc kubenswrapper[5120]: I0316 17:26:52.263258 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-kx46q"] Mar 16 17:26:52 crc kubenswrapper[5120]: I0316 17:26:52.371125 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/4b8ef736-b72d-43c0-9c46-9fea0f814438-utilities\") pod \"redhat-marketplace-kx46q\" (UID: \"4b8ef736-b72d-43c0-9c46-9fea0f814438\") " pod="openshift-marketplace/redhat-marketplace-kx46q" Mar 16 17:26:52 crc kubenswrapper[5120]: I0316 17:26:52.371560 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/4b8ef736-b72d-43c0-9c46-9fea0f814438-catalog-content\") pod \"redhat-marketplace-kx46q\" (UID: \"4b8ef736-b72d-43c0-9c46-9fea0f814438\") " pod="openshift-marketplace/redhat-marketplace-kx46q" Mar 16 17:26:52 crc kubenswrapper[5120]: I0316 17:26:52.371815 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xlcg\" (UniqueName: \"kubernetes.io/projected/4b8ef736-b72d-43c0-9c46-9fea0f814438-kube-api-access-4xlcg\") pod \"redhat-marketplace-kx46q\" (UID: \"4b8ef736-b72d-43c0-9c46-9fea0f814438\") " pod="openshift-marketplace/redhat-marketplace-kx46q" Mar 16 17:26:52 crc kubenswrapper[5120]: I0316 17:26:52.473245 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/4b8ef736-b72d-43c0-9c46-9fea0f814438-catalog-content\") pod \"redhat-marketplace-kx46q\" (UID: \"4b8ef736-b72d-43c0-9c46-9fea0f814438\") " pod="openshift-marketplace/redhat-marketplace-kx46q" Mar 16 17:26:52 crc kubenswrapper[5120]: I0316 17:26:52.473319 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4xlcg\" (UniqueName: \"kubernetes.io/projected/4b8ef736-b72d-43c0-9c46-9fea0f814438-kube-api-access-4xlcg\") pod \"redhat-marketplace-kx46q\" (UID: \"4b8ef736-b72d-43c0-9c46-9fea0f814438\") " pod="openshift-marketplace/redhat-marketplace-kx46q" Mar 16 17:26:52 crc kubenswrapper[5120]: I0316 17:26:52.473461 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/4b8ef736-b72d-43c0-9c46-9fea0f814438-utilities\") pod \"redhat-marketplace-kx46q\" (UID: \"4b8ef736-b72d-43c0-9c46-9fea0f814438\") " pod="openshift-marketplace/redhat-marketplace-kx46q" Mar 16 17:26:52 crc kubenswrapper[5120]: I0316 17:26:52.473775 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/4b8ef736-b72d-43c0-9c46-9fea0f814438-catalog-content\") pod \"redhat-marketplace-kx46q\" (UID: \"4b8ef736-b72d-43c0-9c46-9fea0f814438\") " pod="openshift-marketplace/redhat-marketplace-kx46q" Mar 16 17:26:52 crc kubenswrapper[5120]: I0316 17:26:52.474031 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/4b8ef736-b72d-43c0-9c46-9fea0f814438-utilities\") pod \"redhat-marketplace-kx46q\" (UID: \"4b8ef736-b72d-43c0-9c46-9fea0f814438\") " pod="openshift-marketplace/redhat-marketplace-kx46q" Mar 16 17:26:52 crc kubenswrapper[5120]: I0316 17:26:52.496784 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xlcg\" (UniqueName: \"kubernetes.io/projected/4b8ef736-b72d-43c0-9c46-9fea0f814438-kube-api-access-4xlcg\") pod \"redhat-marketplace-kx46q\" (UID: \"4b8ef736-b72d-43c0-9c46-9fea0f814438\") " pod="openshift-marketplace/redhat-marketplace-kx46q" Mar 16 17:26:52 crc kubenswrapper[5120]: I0316 17:26:52.571334 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-kx46q" Mar 16 17:26:52 crc kubenswrapper[5120]: I0316 17:26:52.980589 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-kx46q"] Mar 16 17:26:52 crc kubenswrapper[5120]: W0316 17:26:52.984197 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b8ef736_b72d_43c0_9c46_9fea0f814438.slice/crio-048e9a6c3f8a15e4cc79b057c4f87f18d1c69848acd957a6af7b152f4c35794f WatchSource:0}: Error finding container 048e9a6c3f8a15e4cc79b057c4f87f18d1c69848acd957a6af7b152f4c35794f: Status 404 returned error can't find the container with id 048e9a6c3f8a15e4cc79b057c4f87f18d1c69848acd957a6af7b152f4c35794f Mar 16 17:26:53 crc kubenswrapper[5120]: I0316 17:26:53.183096 5120 generic.go:358] "Generic (PLEG): container finished" podID="4b8ef736-b72d-43c0-9c46-9fea0f814438" containerID="5020693d927f6cae20c39e98c605d33f77f9990d1cb5e92842bcc9046de07596" exitCode=0 Mar 16 17:26:53 crc kubenswrapper[5120]: I0316 17:26:53.183171 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-kx46q" event={"ID":"4b8ef736-b72d-43c0-9c46-9fea0f814438","Type":"ContainerDied","Data":"5020693d927f6cae20c39e98c605d33f77f9990d1cb5e92842bcc9046de07596"} Mar 16 17:26:53 crc kubenswrapper[5120]: I0316 17:26:53.184808 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-kx46q" event={"ID":"4b8ef736-b72d-43c0-9c46-9fea0f814438","Type":"ContainerStarted","Data":"048e9a6c3f8a15e4cc79b057c4f87f18d1c69848acd957a6af7b152f4c35794f"} Mar 16 17:26:53 crc kubenswrapper[5120]: I0316 17:26:53.437682 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-sriov-edpm-multinodeset-edpm-compute-no-nodes-wvsb9" Mar 16 17:26:53 crc kubenswrapper[5120]: I0316 17:26:53.499347 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"neutron-sriov-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/24347f47-4e7b-40ab-a307-6f7226d3ee17-neutron-sriov-agent-neutron-config-0\") pod \"24347f47-4e7b-40ab-a307-6f7226d3ee17\" (UID: \"24347f47-4e7b-40ab-a307-6f7226d3ee17\") " Mar 16 17:26:53 crc kubenswrapper[5120]: I0316 17:26:53.499789 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/24347f47-4e7b-40ab-a307-6f7226d3ee17-inventory\") pod \"24347f47-4e7b-40ab-a307-6f7226d3ee17\" (UID: \"24347f47-4e7b-40ab-a307-6f7226d3ee17\") " Mar 16 17:26:53 crc kubenswrapper[5120]: I0316 17:26:53.499919 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/24347f47-4e7b-40ab-a307-6f7226d3ee17-ssh-key-edpm-compute-no-nodes\") pod \"24347f47-4e7b-40ab-a307-6f7226d3ee17\" (UID: \"24347f47-4e7b-40ab-a307-6f7226d3ee17\") " Mar 16 17:26:53 crc kubenswrapper[5120]: I0316 17:26:53.499961 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9thcr\" (UniqueName: \"kubernetes.io/projected/24347f47-4e7b-40ab-a307-6f7226d3ee17-kube-api-access-9thcr\") pod \"24347f47-4e7b-40ab-a307-6f7226d3ee17\" (UID: \"24347f47-4e7b-40ab-a307-6f7226d3ee17\") " Mar 16 17:26:53 crc kubenswrapper[5120]: I0316 17:26:53.500088 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"neutron-sriov-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/24347f47-4e7b-40ab-a307-6f7226d3ee17-neutron-sriov-combined-ca-bundle\") pod \"24347f47-4e7b-40ab-a307-6f7226d3ee17\" (UID: \"24347f47-4e7b-40ab-a307-6f7226d3ee17\") " Mar 16 17:26:53 crc kubenswrapper[5120]: I0316 17:26:53.506354 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24347f47-4e7b-40ab-a307-6f7226d3ee17-neutron-sriov-combined-ca-bundle" (OuterVolumeSpecName: "neutron-sriov-combined-ca-bundle") pod "24347f47-4e7b-40ab-a307-6f7226d3ee17" (UID: "24347f47-4e7b-40ab-a307-6f7226d3ee17"). InnerVolumeSpecName "neutron-sriov-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:26:53 crc kubenswrapper[5120]: I0316 17:26:53.509547 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24347f47-4e7b-40ab-a307-6f7226d3ee17-kube-api-access-9thcr" (OuterVolumeSpecName: "kube-api-access-9thcr") pod "24347f47-4e7b-40ab-a307-6f7226d3ee17" (UID: "24347f47-4e7b-40ab-a307-6f7226d3ee17"). InnerVolumeSpecName "kube-api-access-9thcr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:26:53 crc kubenswrapper[5120]: I0316 17:26:53.523330 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24347f47-4e7b-40ab-a307-6f7226d3ee17-inventory" (OuterVolumeSpecName: "inventory") pod "24347f47-4e7b-40ab-a307-6f7226d3ee17" (UID: "24347f47-4e7b-40ab-a307-6f7226d3ee17"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:26:53 crc kubenswrapper[5120]: I0316 17:26:53.523824 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24347f47-4e7b-40ab-a307-6f7226d3ee17-ssh-key-edpm-compute-no-nodes" (OuterVolumeSpecName: "ssh-key-edpm-compute-no-nodes") pod "24347f47-4e7b-40ab-a307-6f7226d3ee17" (UID: "24347f47-4e7b-40ab-a307-6f7226d3ee17"). InnerVolumeSpecName "ssh-key-edpm-compute-no-nodes". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:26:53 crc kubenswrapper[5120]: I0316 17:26:53.529933 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24347f47-4e7b-40ab-a307-6f7226d3ee17-neutron-sriov-agent-neutron-config-0" (OuterVolumeSpecName: "neutron-sriov-agent-neutron-config-0") pod "24347f47-4e7b-40ab-a307-6f7226d3ee17" (UID: "24347f47-4e7b-40ab-a307-6f7226d3ee17"). InnerVolumeSpecName "neutron-sriov-agent-neutron-config-0". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:26:53 crc kubenswrapper[5120]: I0316 17:26:53.602516 5120 reconciler_common.go:299] "Volume detached for volume \"neutron-sriov-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/24347f47-4e7b-40ab-a307-6f7226d3ee17-neutron-sriov-agent-neutron-config-0\") on node \"crc\" DevicePath \"\"" Mar 16 17:26:53 crc kubenswrapper[5120]: I0316 17:26:53.602554 5120 reconciler_common.go:299] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/24347f47-4e7b-40ab-a307-6f7226d3ee17-inventory\") on node \"crc\" DevicePath \"\"" Mar 16 17:26:53 crc kubenswrapper[5120]: I0316 17:26:53.602568 5120 reconciler_common.go:299] "Volume detached for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/24347f47-4e7b-40ab-a307-6f7226d3ee17-ssh-key-edpm-compute-no-nodes\") on node \"crc\" DevicePath \"\"" Mar 16 17:26:53 crc kubenswrapper[5120]: I0316 17:26:53.602578 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9thcr\" (UniqueName: \"kubernetes.io/projected/24347f47-4e7b-40ab-a307-6f7226d3ee17-kube-api-access-9thcr\") on node \"crc\" DevicePath \"\"" Mar 16 17:26:53 crc kubenswrapper[5120]: I0316 17:26:53.602590 5120 reconciler_common.go:299] "Volume detached for volume \"neutron-sriov-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/24347f47-4e7b-40ab-a307-6f7226d3ee17-neutron-sriov-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:26:54 crc kubenswrapper[5120]: I0316 17:26:54.204304 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-kx46q" event={"ID":"4b8ef736-b72d-43c0-9c46-9fea0f814438","Type":"ContainerStarted","Data":"6b9fe98dd4ca3a1e1003acee09001dcaa5e232b082be11f78ed85bedae8069ee"} Mar 16 17:26:54 crc kubenswrapper[5120]: I0316 17:26:54.215366 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-sriov-edpm-multinodeset-edpm-compute-no-nodes-wvsb9" event={"ID":"24347f47-4e7b-40ab-a307-6f7226d3ee17","Type":"ContainerDied","Data":"df66c614af93d218638544232c55832ccd1fdf9af6d86d063f0191586bf2192e"} Mar 16 17:26:54 crc kubenswrapper[5120]: I0316 17:26:54.215441 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-sriov-edpm-multinodeset-edpm-compute-no-nodes-wvsb9" Mar 16 17:26:54 crc kubenswrapper[5120]: I0316 17:26:54.215464 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="df66c614af93d218638544232c55832ccd1fdf9af6d86d063f0191586bf2192e" Mar 16 17:26:54 crc kubenswrapper[5120]: I0316 17:26:54.273234 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-dhcp-edpm-multinodeset-edpm-compute-no-nodes-sshzg"] Mar 16 17:26:54 crc kubenswrapper[5120]: I0316 17:26:54.274149 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24347f47-4e7b-40ab-a307-6f7226d3ee17" containerName="neutron-sriov-edpm-multinodeset-edpm-compute-no-nodes" Mar 16 17:26:54 crc kubenswrapper[5120]: I0316 17:26:54.274171 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="24347f47-4e7b-40ab-a307-6f7226d3ee17" containerName="neutron-sriov-edpm-multinodeset-edpm-compute-no-nodes" Mar 16 17:26:54 crc kubenswrapper[5120]: I0316 17:26:54.274352 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="24347f47-4e7b-40ab-a307-6f7226d3ee17" containerName="neutron-sriov-edpm-multinodeset-edpm-compute-no-nodes" Mar 16 17:26:54 crc kubenswrapper[5120]: I0316 17:26:54.280776 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-dhcp-edpm-multinodeset-edpm-compute-no-nodes-sshzg" Mar 16 17:26:54 crc kubenswrapper[5120]: I0316 17:26:54.282804 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-dhcp-edpm-multinodeset-edpm-compute-no-nodes-sshzg"] Mar 16 17:26:54 crc kubenswrapper[5120]: I0316 17:26:54.283246 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"combined-ca-bundle\"" Mar 16 17:26:54 crc kubenswrapper[5120]: I0316 17:26:54.284473 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplanenodeset-edpm-compute-no-nodes\"" Mar 16 17:26:54 crc kubenswrapper[5120]: I0316 17:26:54.284716 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"edpm-compute-no-nodes-dockercfg-znndh\"" Mar 16 17:26:54 crc kubenswrapper[5120]: I0316 17:26:54.284851 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-dhcp-agent-neutron-config\"" Mar 16 17:26:54 crc kubenswrapper[5120]: I0316 17:26:54.285033 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-aee-default-env\"" Mar 16 17:26:54 crc kubenswrapper[5120]: I0316 17:26:54.285514 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplane-ansible-ssh-private-key-secret\"" Mar 16 17:26:54 crc kubenswrapper[5120]: I0316 17:26:54.318674 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"neutron-dhcp-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/645dafe1-7f68-47aa-8e82-a3867fffc7c8-neutron-dhcp-combined-ca-bundle\") pod \"neutron-dhcp-edpm-multinodeset-edpm-compute-no-nodes-sshzg\" (UID: \"645dafe1-7f68-47aa-8e82-a3867fffc7c8\") " pod="openstack-kuttl-tests/neutron-dhcp-edpm-multinodeset-edpm-compute-no-nodes-sshzg" Mar 16 17:26:54 crc kubenswrapper[5120]: I0316 17:26:54.318775 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"neutron-dhcp-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/645dafe1-7f68-47aa-8e82-a3867fffc7c8-neutron-dhcp-agent-neutron-config-0\") pod \"neutron-dhcp-edpm-multinodeset-edpm-compute-no-nodes-sshzg\" (UID: \"645dafe1-7f68-47aa-8e82-a3867fffc7c8\") " pod="openstack-kuttl-tests/neutron-dhcp-edpm-multinodeset-edpm-compute-no-nodes-sshzg" Mar 16 17:26:54 crc kubenswrapper[5120]: I0316 17:26:54.318866 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/645dafe1-7f68-47aa-8e82-a3867fffc7c8-inventory\") pod \"neutron-dhcp-edpm-multinodeset-edpm-compute-no-nodes-sshzg\" (UID: \"645dafe1-7f68-47aa-8e82-a3867fffc7c8\") " pod="openstack-kuttl-tests/neutron-dhcp-edpm-multinodeset-edpm-compute-no-nodes-sshzg" Mar 16 17:26:54 crc kubenswrapper[5120]: I0316 17:26:54.319154 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-st9dv\" (UniqueName: \"kubernetes.io/projected/645dafe1-7f68-47aa-8e82-a3867fffc7c8-kube-api-access-st9dv\") pod \"neutron-dhcp-edpm-multinodeset-edpm-compute-no-nodes-sshzg\" (UID: \"645dafe1-7f68-47aa-8e82-a3867fffc7c8\") " pod="openstack-kuttl-tests/neutron-dhcp-edpm-multinodeset-edpm-compute-no-nodes-sshzg" Mar 16 17:26:54 crc kubenswrapper[5120]: I0316 17:26:54.319552 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/645dafe1-7f68-47aa-8e82-a3867fffc7c8-ssh-key-edpm-compute-no-nodes\") pod \"neutron-dhcp-edpm-multinodeset-edpm-compute-no-nodes-sshzg\" (UID: \"645dafe1-7f68-47aa-8e82-a3867fffc7c8\") " pod="openstack-kuttl-tests/neutron-dhcp-edpm-multinodeset-edpm-compute-no-nodes-sshzg" Mar 16 17:26:54 crc kubenswrapper[5120]: I0316 17:26:54.422007 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"neutron-dhcp-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/645dafe1-7f68-47aa-8e82-a3867fffc7c8-neutron-dhcp-combined-ca-bundle\") pod \"neutron-dhcp-edpm-multinodeset-edpm-compute-no-nodes-sshzg\" (UID: \"645dafe1-7f68-47aa-8e82-a3867fffc7c8\") " pod="openstack-kuttl-tests/neutron-dhcp-edpm-multinodeset-edpm-compute-no-nodes-sshzg" Mar 16 17:26:54 crc kubenswrapper[5120]: I0316 17:26:54.422145 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"neutron-dhcp-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/645dafe1-7f68-47aa-8e82-a3867fffc7c8-neutron-dhcp-agent-neutron-config-0\") pod \"neutron-dhcp-edpm-multinodeset-edpm-compute-no-nodes-sshzg\" (UID: \"645dafe1-7f68-47aa-8e82-a3867fffc7c8\") " pod="openstack-kuttl-tests/neutron-dhcp-edpm-multinodeset-edpm-compute-no-nodes-sshzg" Mar 16 17:26:54 crc kubenswrapper[5120]: I0316 17:26:54.422343 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/645dafe1-7f68-47aa-8e82-a3867fffc7c8-inventory\") pod \"neutron-dhcp-edpm-multinodeset-edpm-compute-no-nodes-sshzg\" (UID: \"645dafe1-7f68-47aa-8e82-a3867fffc7c8\") " pod="openstack-kuttl-tests/neutron-dhcp-edpm-multinodeset-edpm-compute-no-nodes-sshzg" Mar 16 17:26:54 crc kubenswrapper[5120]: I0316 17:26:54.422422 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-st9dv\" (UniqueName: \"kubernetes.io/projected/645dafe1-7f68-47aa-8e82-a3867fffc7c8-kube-api-access-st9dv\") pod \"neutron-dhcp-edpm-multinodeset-edpm-compute-no-nodes-sshzg\" (UID: \"645dafe1-7f68-47aa-8e82-a3867fffc7c8\") " pod="openstack-kuttl-tests/neutron-dhcp-edpm-multinodeset-edpm-compute-no-nodes-sshzg" Mar 16 17:26:54 crc kubenswrapper[5120]: I0316 17:26:54.422795 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/645dafe1-7f68-47aa-8e82-a3867fffc7c8-ssh-key-edpm-compute-no-nodes\") pod \"neutron-dhcp-edpm-multinodeset-edpm-compute-no-nodes-sshzg\" (UID: \"645dafe1-7f68-47aa-8e82-a3867fffc7c8\") " pod="openstack-kuttl-tests/neutron-dhcp-edpm-multinodeset-edpm-compute-no-nodes-sshzg" Mar 16 17:26:54 crc kubenswrapper[5120]: I0316 17:26:54.427722 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"neutron-dhcp-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/645dafe1-7f68-47aa-8e82-a3867fffc7c8-neutron-dhcp-agent-neutron-config-0\") pod \"neutron-dhcp-edpm-multinodeset-edpm-compute-no-nodes-sshzg\" (UID: \"645dafe1-7f68-47aa-8e82-a3867fffc7c8\") " pod="openstack-kuttl-tests/neutron-dhcp-edpm-multinodeset-edpm-compute-no-nodes-sshzg" Mar 16 17:26:54 crc kubenswrapper[5120]: I0316 17:26:54.428087 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/645dafe1-7f68-47aa-8e82-a3867fffc7c8-ssh-key-edpm-compute-no-nodes\") pod \"neutron-dhcp-edpm-multinodeset-edpm-compute-no-nodes-sshzg\" (UID: \"645dafe1-7f68-47aa-8e82-a3867fffc7c8\") " pod="openstack-kuttl-tests/neutron-dhcp-edpm-multinodeset-edpm-compute-no-nodes-sshzg" Mar 16 17:26:54 crc kubenswrapper[5120]: I0316 17:26:54.440801 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"neutron-dhcp-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/645dafe1-7f68-47aa-8e82-a3867fffc7c8-neutron-dhcp-combined-ca-bundle\") pod \"neutron-dhcp-edpm-multinodeset-edpm-compute-no-nodes-sshzg\" (UID: \"645dafe1-7f68-47aa-8e82-a3867fffc7c8\") " pod="openstack-kuttl-tests/neutron-dhcp-edpm-multinodeset-edpm-compute-no-nodes-sshzg" Mar 16 17:26:54 crc kubenswrapper[5120]: I0316 17:26:54.441285 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/645dafe1-7f68-47aa-8e82-a3867fffc7c8-inventory\") pod \"neutron-dhcp-edpm-multinodeset-edpm-compute-no-nodes-sshzg\" (UID: \"645dafe1-7f68-47aa-8e82-a3867fffc7c8\") " pod="openstack-kuttl-tests/neutron-dhcp-edpm-multinodeset-edpm-compute-no-nodes-sshzg" Mar 16 17:26:54 crc kubenswrapper[5120]: I0316 17:26:54.451193 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-st9dv\" (UniqueName: \"kubernetes.io/projected/645dafe1-7f68-47aa-8e82-a3867fffc7c8-kube-api-access-st9dv\") pod \"neutron-dhcp-edpm-multinodeset-edpm-compute-no-nodes-sshzg\" (UID: \"645dafe1-7f68-47aa-8e82-a3867fffc7c8\") " pod="openstack-kuttl-tests/neutron-dhcp-edpm-multinodeset-edpm-compute-no-nodes-sshzg" Mar 16 17:26:54 crc kubenswrapper[5120]: I0316 17:26:54.606513 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-dhcp-edpm-multinodeset-edpm-compute-no-nodes-sshzg" Mar 16 17:26:55 crc kubenswrapper[5120]: I0316 17:26:55.018201 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-dhcp-edpm-multinodeset-edpm-compute-no-nodes-sshzg"] Mar 16 17:26:55 crc kubenswrapper[5120]: I0316 17:26:55.229412 5120 generic.go:358] "Generic (PLEG): container finished" podID="4b8ef736-b72d-43c0-9c46-9fea0f814438" containerID="6b9fe98dd4ca3a1e1003acee09001dcaa5e232b082be11f78ed85bedae8069ee" exitCode=0 Mar 16 17:26:55 crc kubenswrapper[5120]: I0316 17:26:55.229457 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-kx46q" event={"ID":"4b8ef736-b72d-43c0-9c46-9fea0f814438","Type":"ContainerDied","Data":"6b9fe98dd4ca3a1e1003acee09001dcaa5e232b082be11f78ed85bedae8069ee"} Mar 16 17:26:55 crc kubenswrapper[5120]: I0316 17:26:55.231450 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-dhcp-edpm-multinodeset-edpm-compute-no-nodes-sshzg" event={"ID":"645dafe1-7f68-47aa-8e82-a3867fffc7c8","Type":"ContainerStarted","Data":"c9f9ad53cfdb94280b036a77e8064e6fac12722eeb49962969e8c6eba692da1e"} Mar 16 17:26:56 crc kubenswrapper[5120]: I0316 17:26:56.242614 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-kx46q" event={"ID":"4b8ef736-b72d-43c0-9c46-9fea0f814438","Type":"ContainerStarted","Data":"00367b6b6f510d4dc78cfa122808afa77e1155a783d5193b9810684e860c4836"} Mar 16 17:26:56 crc kubenswrapper[5120]: I0316 17:26:56.245703 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-dhcp-edpm-multinodeset-edpm-compute-no-nodes-sshzg" event={"ID":"645dafe1-7f68-47aa-8e82-a3867fffc7c8","Type":"ContainerStarted","Data":"f51107a823957d47a684b5478f24d691cb44d5ec8e16de22695e9ca15b5c4fba"} Mar 16 17:26:56 crc kubenswrapper[5120]: I0316 17:26:56.263058 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/redhat-marketplace-kx46q" podStartSLOduration=3.632845786 podStartE2EDuration="4.263040183s" podCreationTimestamp="2026-03-16 17:26:52 +0000 UTC" firstStartedPulling="2026-03-16 17:26:53.183947828 +0000 UTC m=+6915.337879485" lastFinishedPulling="2026-03-16 17:26:53.814142225 +0000 UTC m=+6915.968073882" observedRunningTime="2026-03-16 17:26:56.258443958 +0000 UTC m=+6918.412375615" watchObservedRunningTime="2026-03-16 17:26:56.263040183 +0000 UTC m=+6918.416971840" Mar 16 17:26:56 crc kubenswrapper[5120]: I0316 17:26:56.280974 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-dhcp-edpm-multinodeset-edpm-compute-no-nodes-sshzg" podStartSLOduration=1.859132182 podStartE2EDuration="2.280958092s" podCreationTimestamp="2026-03-16 17:26:54 +0000 UTC" firstStartedPulling="2026-03-16 17:26:55.023318753 +0000 UTC m=+6917.177250430" lastFinishedPulling="2026-03-16 17:26:55.445144683 +0000 UTC m=+6917.599076340" observedRunningTime="2026-03-16 17:26:56.274600458 +0000 UTC m=+6918.428532115" watchObservedRunningTime="2026-03-16 17:26:56.280958092 +0000 UTC m=+6918.434889749" Mar 16 17:26:57 crc kubenswrapper[5120]: I0316 17:26:57.255349 5120 generic.go:358] "Generic (PLEG): container finished" podID="645dafe1-7f68-47aa-8e82-a3867fffc7c8" containerID="f51107a823957d47a684b5478f24d691cb44d5ec8e16de22695e9ca15b5c4fba" exitCode=0 Mar 16 17:26:57 crc kubenswrapper[5120]: I0316 17:26:57.255512 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-dhcp-edpm-multinodeset-edpm-compute-no-nodes-sshzg" event={"ID":"645dafe1-7f68-47aa-8e82-a3867fffc7c8","Type":"ContainerDied","Data":"f51107a823957d47a684b5478f24d691cb44d5ec8e16de22695e9ca15b5c4fba"} Mar 16 17:26:58 crc kubenswrapper[5120]: I0316 17:26:58.579643 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-dhcp-edpm-multinodeset-edpm-compute-no-nodes-sshzg" Mar 16 17:26:58 crc kubenswrapper[5120]: I0316 17:26:58.724322 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"neutron-dhcp-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/645dafe1-7f68-47aa-8e82-a3867fffc7c8-neutron-dhcp-combined-ca-bundle\") pod \"645dafe1-7f68-47aa-8e82-a3867fffc7c8\" (UID: \"645dafe1-7f68-47aa-8e82-a3867fffc7c8\") " Mar 16 17:26:58 crc kubenswrapper[5120]: I0316 17:26:58.724379 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/645dafe1-7f68-47aa-8e82-a3867fffc7c8-ssh-key-edpm-compute-no-nodes\") pod \"645dafe1-7f68-47aa-8e82-a3867fffc7c8\" (UID: \"645dafe1-7f68-47aa-8e82-a3867fffc7c8\") " Mar 16 17:26:58 crc kubenswrapper[5120]: I0316 17:26:58.724437 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/645dafe1-7f68-47aa-8e82-a3867fffc7c8-inventory\") pod \"645dafe1-7f68-47aa-8e82-a3867fffc7c8\" (UID: \"645dafe1-7f68-47aa-8e82-a3867fffc7c8\") " Mar 16 17:26:58 crc kubenswrapper[5120]: I0316 17:26:58.725361 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"neutron-dhcp-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/645dafe1-7f68-47aa-8e82-a3867fffc7c8-neutron-dhcp-agent-neutron-config-0\") pod \"645dafe1-7f68-47aa-8e82-a3867fffc7c8\" (UID: \"645dafe1-7f68-47aa-8e82-a3867fffc7c8\") " Mar 16 17:26:58 crc kubenswrapper[5120]: I0316 17:26:58.725416 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-st9dv\" (UniqueName: \"kubernetes.io/projected/645dafe1-7f68-47aa-8e82-a3867fffc7c8-kube-api-access-st9dv\") pod \"645dafe1-7f68-47aa-8e82-a3867fffc7c8\" (UID: \"645dafe1-7f68-47aa-8e82-a3867fffc7c8\") " Mar 16 17:26:58 crc kubenswrapper[5120]: I0316 17:26:58.730156 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/645dafe1-7f68-47aa-8e82-a3867fffc7c8-neutron-dhcp-combined-ca-bundle" (OuterVolumeSpecName: "neutron-dhcp-combined-ca-bundle") pod "645dafe1-7f68-47aa-8e82-a3867fffc7c8" (UID: "645dafe1-7f68-47aa-8e82-a3867fffc7c8"). InnerVolumeSpecName "neutron-dhcp-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:26:58 crc kubenswrapper[5120]: I0316 17:26:58.730278 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/645dafe1-7f68-47aa-8e82-a3867fffc7c8-kube-api-access-st9dv" (OuterVolumeSpecName: "kube-api-access-st9dv") pod "645dafe1-7f68-47aa-8e82-a3867fffc7c8" (UID: "645dafe1-7f68-47aa-8e82-a3867fffc7c8"). InnerVolumeSpecName "kube-api-access-st9dv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:26:58 crc kubenswrapper[5120]: I0316 17:26:58.745942 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/645dafe1-7f68-47aa-8e82-a3867fffc7c8-neutron-dhcp-agent-neutron-config-0" (OuterVolumeSpecName: "neutron-dhcp-agent-neutron-config-0") pod "645dafe1-7f68-47aa-8e82-a3867fffc7c8" (UID: "645dafe1-7f68-47aa-8e82-a3867fffc7c8"). InnerVolumeSpecName "neutron-dhcp-agent-neutron-config-0". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:26:58 crc kubenswrapper[5120]: I0316 17:26:58.747133 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/645dafe1-7f68-47aa-8e82-a3867fffc7c8-ssh-key-edpm-compute-no-nodes" (OuterVolumeSpecName: "ssh-key-edpm-compute-no-nodes") pod "645dafe1-7f68-47aa-8e82-a3867fffc7c8" (UID: "645dafe1-7f68-47aa-8e82-a3867fffc7c8"). InnerVolumeSpecName "ssh-key-edpm-compute-no-nodes". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:26:58 crc kubenswrapper[5120]: I0316 17:26:58.749273 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/645dafe1-7f68-47aa-8e82-a3867fffc7c8-inventory" (OuterVolumeSpecName: "inventory") pod "645dafe1-7f68-47aa-8e82-a3867fffc7c8" (UID: "645dafe1-7f68-47aa-8e82-a3867fffc7c8"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:26:58 crc kubenswrapper[5120]: I0316 17:26:58.828244 5120 reconciler_common.go:299] "Volume detached for volume \"neutron-dhcp-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/645dafe1-7f68-47aa-8e82-a3867fffc7c8-neutron-dhcp-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:26:58 crc kubenswrapper[5120]: I0316 17:26:58.828290 5120 reconciler_common.go:299] "Volume detached for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/645dafe1-7f68-47aa-8e82-a3867fffc7c8-ssh-key-edpm-compute-no-nodes\") on node \"crc\" DevicePath \"\"" Mar 16 17:26:58 crc kubenswrapper[5120]: I0316 17:26:58.828308 5120 reconciler_common.go:299] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/645dafe1-7f68-47aa-8e82-a3867fffc7c8-inventory\") on node \"crc\" DevicePath \"\"" Mar 16 17:26:58 crc kubenswrapper[5120]: I0316 17:26:58.828322 5120 reconciler_common.go:299] "Volume detached for volume \"neutron-dhcp-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/645dafe1-7f68-47aa-8e82-a3867fffc7c8-neutron-dhcp-agent-neutron-config-0\") on node \"crc\" DevicePath \"\"" Mar 16 17:26:58 crc kubenswrapper[5120]: I0316 17:26:58.828333 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-st9dv\" (UniqueName: \"kubernetes.io/projected/645dafe1-7f68-47aa-8e82-a3867fffc7c8-kube-api-access-st9dv\") on node \"crc\" DevicePath \"\"" Mar 16 17:26:59 crc kubenswrapper[5120]: I0316 17:26:59.283247 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-dhcp-edpm-multinodeset-edpm-compute-no-nodes-sshzg" event={"ID":"645dafe1-7f68-47aa-8e82-a3867fffc7c8","Type":"ContainerDied","Data":"c9f9ad53cfdb94280b036a77e8064e6fac12722eeb49962969e8c6eba692da1e"} Mar 16 17:26:59 crc kubenswrapper[5120]: I0316 17:26:59.283967 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c9f9ad53cfdb94280b036a77e8064e6fac12722eeb49962969e8c6eba692da1e" Mar 16 17:26:59 crc kubenswrapper[5120]: I0316 17:26:59.283898 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-dhcp-edpm-multinodeset-edpm-compute-no-nodes-sshzg" Mar 16 17:26:59 crc kubenswrapper[5120]: I0316 17:26:59.744356 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/libvirt-edpm-multinodeset-edpm-compute-no-nodes-q65l5"] Mar 16 17:26:59 crc kubenswrapper[5120]: I0316 17:26:59.745617 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="645dafe1-7f68-47aa-8e82-a3867fffc7c8" containerName="neutron-dhcp-edpm-multinodeset-edpm-compute-no-nodes" Mar 16 17:26:59 crc kubenswrapper[5120]: I0316 17:26:59.745643 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="645dafe1-7f68-47aa-8e82-a3867fffc7c8" containerName="neutron-dhcp-edpm-multinodeset-edpm-compute-no-nodes" Mar 16 17:26:59 crc kubenswrapper[5120]: I0316 17:26:59.745880 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="645dafe1-7f68-47aa-8e82-a3867fffc7c8" containerName="neutron-dhcp-edpm-multinodeset-edpm-compute-no-nodes" Mar 16 17:26:59 crc kubenswrapper[5120]: I0316 17:26:59.755808 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/libvirt-edpm-multinodeset-edpm-compute-no-nodes-q65l5"] Mar 16 17:26:59 crc kubenswrapper[5120]: I0316 17:26:59.755897 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/libvirt-edpm-multinodeset-edpm-compute-no-nodes-q65l5" Mar 16 17:26:59 crc kubenswrapper[5120]: I0316 17:26:59.759561 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-aee-default-env\"" Mar 16 17:26:59 crc kubenswrapper[5120]: I0316 17:26:59.759848 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"libvirt-secret\"" Mar 16 17:26:59 crc kubenswrapper[5120]: I0316 17:26:59.759631 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"combined-ca-bundle\"" Mar 16 17:26:59 crc kubenswrapper[5120]: I0316 17:26:59.759666 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplanenodeset-edpm-compute-no-nodes\"" Mar 16 17:26:59 crc kubenswrapper[5120]: I0316 17:26:59.759595 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"edpm-compute-no-nodes-dockercfg-znndh\"" Mar 16 17:26:59 crc kubenswrapper[5120]: I0316 17:26:59.760184 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplane-ansible-ssh-private-key-secret\"" Mar 16 17:26:59 crc kubenswrapper[5120]: I0316 17:26:59.953186 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"libvirt-secret-0\" (UniqueName: \"kubernetes.io/secret/0203b737-1e17-4e99-b05a-429ddeaf9200-libvirt-secret-0\") pod \"libvirt-edpm-multinodeset-edpm-compute-no-nodes-q65l5\" (UID: \"0203b737-1e17-4e99-b05a-429ddeaf9200\") " pod="openstack-kuttl-tests/libvirt-edpm-multinodeset-edpm-compute-no-nodes-q65l5" Mar 16 17:26:59 crc kubenswrapper[5120]: I0316 17:26:59.953328 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4xc9\" (UniqueName: \"kubernetes.io/projected/0203b737-1e17-4e99-b05a-429ddeaf9200-kube-api-access-h4xc9\") pod \"libvirt-edpm-multinodeset-edpm-compute-no-nodes-q65l5\" (UID: \"0203b737-1e17-4e99-b05a-429ddeaf9200\") " pod="openstack-kuttl-tests/libvirt-edpm-multinodeset-edpm-compute-no-nodes-q65l5" Mar 16 17:26:59 crc kubenswrapper[5120]: I0316 17:26:59.953403 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"libvirt-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0203b737-1e17-4e99-b05a-429ddeaf9200-libvirt-combined-ca-bundle\") pod \"libvirt-edpm-multinodeset-edpm-compute-no-nodes-q65l5\" (UID: \"0203b737-1e17-4e99-b05a-429ddeaf9200\") " pod="openstack-kuttl-tests/libvirt-edpm-multinodeset-edpm-compute-no-nodes-q65l5" Mar 16 17:26:59 crc kubenswrapper[5120]: I0316 17:26:59.953627 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/0203b737-1e17-4e99-b05a-429ddeaf9200-inventory\") pod \"libvirt-edpm-multinodeset-edpm-compute-no-nodes-q65l5\" (UID: \"0203b737-1e17-4e99-b05a-429ddeaf9200\") " pod="openstack-kuttl-tests/libvirt-edpm-multinodeset-edpm-compute-no-nodes-q65l5" Mar 16 17:26:59 crc kubenswrapper[5120]: I0316 17:26:59.953706 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/0203b737-1e17-4e99-b05a-429ddeaf9200-ssh-key-edpm-compute-no-nodes\") pod \"libvirt-edpm-multinodeset-edpm-compute-no-nodes-q65l5\" (UID: \"0203b737-1e17-4e99-b05a-429ddeaf9200\") " pod="openstack-kuttl-tests/libvirt-edpm-multinodeset-edpm-compute-no-nodes-q65l5" Mar 16 17:27:00 crc kubenswrapper[5120]: I0316 17:27:00.055054 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"libvirt-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0203b737-1e17-4e99-b05a-429ddeaf9200-libvirt-combined-ca-bundle\") pod \"libvirt-edpm-multinodeset-edpm-compute-no-nodes-q65l5\" (UID: \"0203b737-1e17-4e99-b05a-429ddeaf9200\") " pod="openstack-kuttl-tests/libvirt-edpm-multinodeset-edpm-compute-no-nodes-q65l5" Mar 16 17:27:00 crc kubenswrapper[5120]: I0316 17:27:00.055279 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/0203b737-1e17-4e99-b05a-429ddeaf9200-inventory\") pod \"libvirt-edpm-multinodeset-edpm-compute-no-nodes-q65l5\" (UID: \"0203b737-1e17-4e99-b05a-429ddeaf9200\") " pod="openstack-kuttl-tests/libvirt-edpm-multinodeset-edpm-compute-no-nodes-q65l5" Mar 16 17:27:00 crc kubenswrapper[5120]: I0316 17:27:00.055350 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/0203b737-1e17-4e99-b05a-429ddeaf9200-ssh-key-edpm-compute-no-nodes\") pod \"libvirt-edpm-multinodeset-edpm-compute-no-nodes-q65l5\" (UID: \"0203b737-1e17-4e99-b05a-429ddeaf9200\") " pod="openstack-kuttl-tests/libvirt-edpm-multinodeset-edpm-compute-no-nodes-q65l5" Mar 16 17:27:00 crc kubenswrapper[5120]: I0316 17:27:00.056135 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"libvirt-secret-0\" (UniqueName: \"kubernetes.io/secret/0203b737-1e17-4e99-b05a-429ddeaf9200-libvirt-secret-0\") pod \"libvirt-edpm-multinodeset-edpm-compute-no-nodes-q65l5\" (UID: \"0203b737-1e17-4e99-b05a-429ddeaf9200\") " pod="openstack-kuttl-tests/libvirt-edpm-multinodeset-edpm-compute-no-nodes-q65l5" Mar 16 17:27:00 crc kubenswrapper[5120]: I0316 17:27:00.056214 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h4xc9\" (UniqueName: \"kubernetes.io/projected/0203b737-1e17-4e99-b05a-429ddeaf9200-kube-api-access-h4xc9\") pod \"libvirt-edpm-multinodeset-edpm-compute-no-nodes-q65l5\" (UID: \"0203b737-1e17-4e99-b05a-429ddeaf9200\") " pod="openstack-kuttl-tests/libvirt-edpm-multinodeset-edpm-compute-no-nodes-q65l5" Mar 16 17:27:00 crc kubenswrapper[5120]: I0316 17:27:00.061627 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/0203b737-1e17-4e99-b05a-429ddeaf9200-ssh-key-edpm-compute-no-nodes\") pod \"libvirt-edpm-multinodeset-edpm-compute-no-nodes-q65l5\" (UID: \"0203b737-1e17-4e99-b05a-429ddeaf9200\") " pod="openstack-kuttl-tests/libvirt-edpm-multinodeset-edpm-compute-no-nodes-q65l5" Mar 16 17:27:00 crc kubenswrapper[5120]: I0316 17:27:00.061660 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"libvirt-secret-0\" (UniqueName: \"kubernetes.io/secret/0203b737-1e17-4e99-b05a-429ddeaf9200-libvirt-secret-0\") pod \"libvirt-edpm-multinodeset-edpm-compute-no-nodes-q65l5\" (UID: \"0203b737-1e17-4e99-b05a-429ddeaf9200\") " pod="openstack-kuttl-tests/libvirt-edpm-multinodeset-edpm-compute-no-nodes-q65l5" Mar 16 17:27:00 crc kubenswrapper[5120]: I0316 17:27:00.061646 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"libvirt-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0203b737-1e17-4e99-b05a-429ddeaf9200-libvirt-combined-ca-bundle\") pod \"libvirt-edpm-multinodeset-edpm-compute-no-nodes-q65l5\" (UID: \"0203b737-1e17-4e99-b05a-429ddeaf9200\") " pod="openstack-kuttl-tests/libvirt-edpm-multinodeset-edpm-compute-no-nodes-q65l5" Mar 16 17:27:00 crc kubenswrapper[5120]: I0316 17:27:00.062092 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/0203b737-1e17-4e99-b05a-429ddeaf9200-inventory\") pod \"libvirt-edpm-multinodeset-edpm-compute-no-nodes-q65l5\" (UID: \"0203b737-1e17-4e99-b05a-429ddeaf9200\") " pod="openstack-kuttl-tests/libvirt-edpm-multinodeset-edpm-compute-no-nodes-q65l5" Mar 16 17:27:00 crc kubenswrapper[5120]: I0316 17:27:00.079451 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4xc9\" (UniqueName: \"kubernetes.io/projected/0203b737-1e17-4e99-b05a-429ddeaf9200-kube-api-access-h4xc9\") pod \"libvirt-edpm-multinodeset-edpm-compute-no-nodes-q65l5\" (UID: \"0203b737-1e17-4e99-b05a-429ddeaf9200\") " pod="openstack-kuttl-tests/libvirt-edpm-multinodeset-edpm-compute-no-nodes-q65l5" Mar 16 17:27:00 crc kubenswrapper[5120]: I0316 17:27:00.374245 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/libvirt-edpm-multinodeset-edpm-compute-no-nodes-q65l5" Mar 16 17:27:00 crc kubenswrapper[5120]: I0316 17:27:00.804969 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/libvirt-edpm-multinodeset-edpm-compute-no-nodes-q65l5"] Mar 16 17:27:01 crc kubenswrapper[5120]: I0316 17:27:01.311340 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/libvirt-edpm-multinodeset-edpm-compute-no-nodes-q65l5" event={"ID":"0203b737-1e17-4e99-b05a-429ddeaf9200","Type":"ContainerStarted","Data":"f5b981270f4171a185db07b66c03882527a67a8d24a32cfe1827ff0463c0811c"} Mar 16 17:27:02 crc kubenswrapper[5120]: I0316 17:27:02.321199 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/libvirt-edpm-multinodeset-edpm-compute-no-nodes-q65l5" event={"ID":"0203b737-1e17-4e99-b05a-429ddeaf9200","Type":"ContainerStarted","Data":"c24dcc16429c15b545e262c8ec7c242fff23f9efabb72c1e0b69c8c6be695e32"} Mar 16 17:27:02 crc kubenswrapper[5120]: I0316 17:27:02.348032 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/libvirt-edpm-multinodeset-edpm-compute-no-nodes-q65l5" podStartSLOduration=2.900489803 podStartE2EDuration="3.348014785s" podCreationTimestamp="2026-03-16 17:26:59 +0000 UTC" firstStartedPulling="2026-03-16 17:27:00.814133497 +0000 UTC m=+6922.968065164" lastFinishedPulling="2026-03-16 17:27:01.261658489 +0000 UTC m=+6923.415590146" observedRunningTime="2026-03-16 17:27:02.340467339 +0000 UTC m=+6924.494398996" watchObservedRunningTime="2026-03-16 17:27:02.348014785 +0000 UTC m=+6924.501946442" Mar 16 17:27:02 crc kubenswrapper[5120]: I0316 17:27:02.571893 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-marketplace-kx46q" Mar 16 17:27:02 crc kubenswrapper[5120]: I0316 17:27:02.572204 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-marketplace/redhat-marketplace-kx46q" Mar 16 17:27:02 crc kubenswrapper[5120]: I0316 17:27:02.615535 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-marketplace-kx46q" Mar 16 17:27:03 crc kubenswrapper[5120]: I0316 17:27:03.330031 5120 generic.go:358] "Generic (PLEG): container finished" podID="0203b737-1e17-4e99-b05a-429ddeaf9200" containerID="c24dcc16429c15b545e262c8ec7c242fff23f9efabb72c1e0b69c8c6be695e32" exitCode=0 Mar 16 17:27:03 crc kubenswrapper[5120]: I0316 17:27:03.330103 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/libvirt-edpm-multinodeset-edpm-compute-no-nodes-q65l5" event={"ID":"0203b737-1e17-4e99-b05a-429ddeaf9200","Type":"ContainerDied","Data":"c24dcc16429c15b545e262c8ec7c242fff23f9efabb72c1e0b69c8c6be695e32"} Mar 16 17:27:03 crc kubenswrapper[5120]: I0316 17:27:03.377857 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-marketplace-kx46q" Mar 16 17:27:03 crc kubenswrapper[5120]: I0316 17:27:03.421020 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-marketplace-kx46q"] Mar 16 17:27:04 crc kubenswrapper[5120]: I0316 17:27:04.651680 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/libvirt-edpm-multinodeset-edpm-compute-no-nodes-q65l5" Mar 16 17:27:04 crc kubenswrapper[5120]: I0316 17:27:04.763115 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h4xc9\" (UniqueName: \"kubernetes.io/projected/0203b737-1e17-4e99-b05a-429ddeaf9200-kube-api-access-h4xc9\") pod \"0203b737-1e17-4e99-b05a-429ddeaf9200\" (UID: \"0203b737-1e17-4e99-b05a-429ddeaf9200\") " Mar 16 17:27:04 crc kubenswrapper[5120]: I0316 17:27:04.763219 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"libvirt-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0203b737-1e17-4e99-b05a-429ddeaf9200-libvirt-combined-ca-bundle\") pod \"0203b737-1e17-4e99-b05a-429ddeaf9200\" (UID: \"0203b737-1e17-4e99-b05a-429ddeaf9200\") " Mar 16 17:27:04 crc kubenswrapper[5120]: I0316 17:27:04.763326 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/0203b737-1e17-4e99-b05a-429ddeaf9200-inventory\") pod \"0203b737-1e17-4e99-b05a-429ddeaf9200\" (UID: \"0203b737-1e17-4e99-b05a-429ddeaf9200\") " Mar 16 17:27:04 crc kubenswrapper[5120]: I0316 17:27:04.763366 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"libvirt-secret-0\" (UniqueName: \"kubernetes.io/secret/0203b737-1e17-4e99-b05a-429ddeaf9200-libvirt-secret-0\") pod \"0203b737-1e17-4e99-b05a-429ddeaf9200\" (UID: \"0203b737-1e17-4e99-b05a-429ddeaf9200\") " Mar 16 17:27:04 crc kubenswrapper[5120]: I0316 17:27:04.763557 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/0203b737-1e17-4e99-b05a-429ddeaf9200-ssh-key-edpm-compute-no-nodes\") pod \"0203b737-1e17-4e99-b05a-429ddeaf9200\" (UID: \"0203b737-1e17-4e99-b05a-429ddeaf9200\") " Mar 16 17:27:04 crc kubenswrapper[5120]: I0316 17:27:04.768984 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0203b737-1e17-4e99-b05a-429ddeaf9200-libvirt-combined-ca-bundle" (OuterVolumeSpecName: "libvirt-combined-ca-bundle") pod "0203b737-1e17-4e99-b05a-429ddeaf9200" (UID: "0203b737-1e17-4e99-b05a-429ddeaf9200"). InnerVolumeSpecName "libvirt-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:27:04 crc kubenswrapper[5120]: I0316 17:27:04.769310 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0203b737-1e17-4e99-b05a-429ddeaf9200-kube-api-access-h4xc9" (OuterVolumeSpecName: "kube-api-access-h4xc9") pod "0203b737-1e17-4e99-b05a-429ddeaf9200" (UID: "0203b737-1e17-4e99-b05a-429ddeaf9200"). InnerVolumeSpecName "kube-api-access-h4xc9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:27:04 crc kubenswrapper[5120]: I0316 17:27:04.786150 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0203b737-1e17-4e99-b05a-429ddeaf9200-inventory" (OuterVolumeSpecName: "inventory") pod "0203b737-1e17-4e99-b05a-429ddeaf9200" (UID: "0203b737-1e17-4e99-b05a-429ddeaf9200"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:27:04 crc kubenswrapper[5120]: I0316 17:27:04.788498 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0203b737-1e17-4e99-b05a-429ddeaf9200-ssh-key-edpm-compute-no-nodes" (OuterVolumeSpecName: "ssh-key-edpm-compute-no-nodes") pod "0203b737-1e17-4e99-b05a-429ddeaf9200" (UID: "0203b737-1e17-4e99-b05a-429ddeaf9200"). InnerVolumeSpecName "ssh-key-edpm-compute-no-nodes". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:27:04 crc kubenswrapper[5120]: I0316 17:27:04.789151 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0203b737-1e17-4e99-b05a-429ddeaf9200-libvirt-secret-0" (OuterVolumeSpecName: "libvirt-secret-0") pod "0203b737-1e17-4e99-b05a-429ddeaf9200" (UID: "0203b737-1e17-4e99-b05a-429ddeaf9200"). InnerVolumeSpecName "libvirt-secret-0". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:27:04 crc kubenswrapper[5120]: I0316 17:27:04.865874 5120 reconciler_common.go:299] "Volume detached for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/0203b737-1e17-4e99-b05a-429ddeaf9200-ssh-key-edpm-compute-no-nodes\") on node \"crc\" DevicePath \"\"" Mar 16 17:27:04 crc kubenswrapper[5120]: I0316 17:27:04.865907 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h4xc9\" (UniqueName: \"kubernetes.io/projected/0203b737-1e17-4e99-b05a-429ddeaf9200-kube-api-access-h4xc9\") on node \"crc\" DevicePath \"\"" Mar 16 17:27:04 crc kubenswrapper[5120]: I0316 17:27:04.865917 5120 reconciler_common.go:299] "Volume detached for volume \"libvirt-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0203b737-1e17-4e99-b05a-429ddeaf9200-libvirt-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:27:04 crc kubenswrapper[5120]: I0316 17:27:04.865928 5120 reconciler_common.go:299] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/0203b737-1e17-4e99-b05a-429ddeaf9200-inventory\") on node \"crc\" DevicePath \"\"" Mar 16 17:27:04 crc kubenswrapper[5120]: I0316 17:27:04.865939 5120 reconciler_common.go:299] "Volume detached for volume \"libvirt-secret-0\" (UniqueName: \"kubernetes.io/secret/0203b737-1e17-4e99-b05a-429ddeaf9200-libvirt-secret-0\") on node \"crc\" DevicePath \"\"" Mar 16 17:27:05 crc kubenswrapper[5120]: I0316 17:27:05.365131 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/libvirt-edpm-multinodeset-edpm-compute-no-nodes-q65l5" event={"ID":"0203b737-1e17-4e99-b05a-429ddeaf9200","Type":"ContainerDied","Data":"f5b981270f4171a185db07b66c03882527a67a8d24a32cfe1827ff0463c0811c"} Mar 16 17:27:05 crc kubenswrapper[5120]: I0316 17:27:05.365483 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f5b981270f4171a185db07b66c03882527a67a8d24a32cfe1827ff0463c0811c" Mar 16 17:27:05 crc kubenswrapper[5120]: I0316 17:27:05.365254 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/libvirt-edpm-multinodeset-edpm-compute-no-nodes-q65l5" Mar 16 17:27:05 crc kubenswrapper[5120]: I0316 17:27:05.365492 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-marketplace/redhat-marketplace-kx46q" podUID="4b8ef736-b72d-43c0-9c46-9fea0f814438" containerName="registry-server" containerID="cri-o://00367b6b6f510d4dc78cfa122808afa77e1155a783d5193b9810684e860c4836" gracePeriod=2 Mar 16 17:27:05 crc kubenswrapper[5120]: I0316 17:27:05.425659 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-no-nodes-t9xl6"] Mar 16 17:27:05 crc kubenswrapper[5120]: I0316 17:27:05.426896 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0203b737-1e17-4e99-b05a-429ddeaf9200" containerName="libvirt-edpm-multinodeset-edpm-compute-no-nodes" Mar 16 17:27:05 crc kubenswrapper[5120]: I0316 17:27:05.426912 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="0203b737-1e17-4e99-b05a-429ddeaf9200" containerName="libvirt-edpm-multinodeset-edpm-compute-no-nodes" Mar 16 17:27:05 crc kubenswrapper[5120]: I0316 17:27:05.427074 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="0203b737-1e17-4e99-b05a-429ddeaf9200" containerName="libvirt-edpm-multinodeset-edpm-compute-no-nodes" Mar 16 17:27:05 crc kubenswrapper[5120]: I0316 17:27:05.430802 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-no-nodes-t9xl6" Mar 16 17:27:05 crc kubenswrapper[5120]: I0316 17:27:05.433828 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-aee-default-env\"" Mar 16 17:27:05 crc kubenswrapper[5120]: I0316 17:27:05.433895 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplanenodeset-edpm-compute-no-nodes\"" Mar 16 17:27:05 crc kubenswrapper[5120]: I0316 17:27:05.433963 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"combined-ca-bundle\"" Mar 16 17:27:05 crc kubenswrapper[5120]: I0316 17:27:05.433827 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplane-ansible-ssh-private-key-secret\"" Mar 16 17:27:05 crc kubenswrapper[5120]: I0316 17:27:05.434289 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-compute-config\"" Mar 16 17:27:05 crc kubenswrapper[5120]: I0316 17:27:05.434692 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"edpm-compute-no-nodes-dockercfg-znndh\"" Mar 16 17:27:05 crc kubenswrapper[5120]: I0316 17:27:05.436068 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-no-nodes-t9xl6"] Mar 16 17:27:05 crc kubenswrapper[5120]: I0316 17:27:05.437682 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-migration-ssh-key\"" Mar 16 17:27:05 crc kubenswrapper[5120]: I0316 17:27:05.580692 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/1196e231-b422-4bef-90a7-7695e895e8f2-inventory\") pod \"nova-edpm-multinodeset-edpm-compute-no-nodes-t9xl6\" (UID: \"1196e231-b422-4bef-90a7-7695e895e8f2\") " pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-no-nodes-t9xl6" Mar 16 17:27:05 crc kubenswrapper[5120]: I0316 17:27:05.580980 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/1196e231-b422-4bef-90a7-7695e895e8f2-ssh-key-edpm-compute-no-nodes\") pod \"nova-edpm-multinodeset-edpm-compute-no-nodes-t9xl6\" (UID: \"1196e231-b422-4bef-90a7-7695e895e8f2\") " pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-no-nodes-t9xl6" Mar 16 17:27:05 crc kubenswrapper[5120]: I0316 17:27:05.581129 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4k22\" (UniqueName: \"kubernetes.io/projected/1196e231-b422-4bef-90a7-7695e895e8f2-kube-api-access-n4k22\") pod \"nova-edpm-multinodeset-edpm-compute-no-nodes-t9xl6\" (UID: \"1196e231-b422-4bef-90a7-7695e895e8f2\") " pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-no-nodes-t9xl6" Mar 16 17:27:05 crc kubenswrapper[5120]: I0316 17:27:05.581322 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-migration-ssh-key-0\" (UniqueName: \"kubernetes.io/secret/1196e231-b422-4bef-90a7-7695e895e8f2-nova-migration-ssh-key-0\") pod \"nova-edpm-multinodeset-edpm-compute-no-nodes-t9xl6\" (UID: \"1196e231-b422-4bef-90a7-7695e895e8f2\") " pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-no-nodes-t9xl6" Mar 16 17:27:05 crc kubenswrapper[5120]: I0316 17:27:05.581374 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-migration-ssh-key-1\" (UniqueName: \"kubernetes.io/secret/1196e231-b422-4bef-90a7-7695e895e8f2-nova-migration-ssh-key-1\") pod \"nova-edpm-multinodeset-edpm-compute-no-nodes-t9xl6\" (UID: \"1196e231-b422-4bef-90a7-7695e895e8f2\") " pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-no-nodes-t9xl6" Mar 16 17:27:05 crc kubenswrapper[5120]: I0316 17:27:05.581427 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-cell1-compute-config-0\" (UniqueName: \"kubernetes.io/secret/1196e231-b422-4bef-90a7-7695e895e8f2-nova-cell1-compute-config-0\") pod \"nova-edpm-multinodeset-edpm-compute-no-nodes-t9xl6\" (UID: \"1196e231-b422-4bef-90a7-7695e895e8f2\") " pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-no-nodes-t9xl6" Mar 16 17:27:05 crc kubenswrapper[5120]: I0316 17:27:05.581479 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1196e231-b422-4bef-90a7-7695e895e8f2-nova-combined-ca-bundle\") pod \"nova-edpm-multinodeset-edpm-compute-no-nodes-t9xl6\" (UID: \"1196e231-b422-4bef-90a7-7695e895e8f2\") " pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-no-nodes-t9xl6" Mar 16 17:27:05 crc kubenswrapper[5120]: I0316 17:27:05.581507 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-cell1-compute-config-1\" (UniqueName: \"kubernetes.io/secret/1196e231-b422-4bef-90a7-7695e895e8f2-nova-cell1-compute-config-1\") pod \"nova-edpm-multinodeset-edpm-compute-no-nodes-t9xl6\" (UID: \"1196e231-b422-4bef-90a7-7695e895e8f2\") " pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-no-nodes-t9xl6" Mar 16 17:27:05 crc kubenswrapper[5120]: I0316 17:27:05.683513 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-migration-ssh-key-1\" (UniqueName: \"kubernetes.io/secret/1196e231-b422-4bef-90a7-7695e895e8f2-nova-migration-ssh-key-1\") pod \"nova-edpm-multinodeset-edpm-compute-no-nodes-t9xl6\" (UID: \"1196e231-b422-4bef-90a7-7695e895e8f2\") " pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-no-nodes-t9xl6" Mar 16 17:27:05 crc kubenswrapper[5120]: I0316 17:27:05.683572 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-cell1-compute-config-0\" (UniqueName: \"kubernetes.io/secret/1196e231-b422-4bef-90a7-7695e895e8f2-nova-cell1-compute-config-0\") pod \"nova-edpm-multinodeset-edpm-compute-no-nodes-t9xl6\" (UID: \"1196e231-b422-4bef-90a7-7695e895e8f2\") " pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-no-nodes-t9xl6" Mar 16 17:27:05 crc kubenswrapper[5120]: I0316 17:27:05.683614 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1196e231-b422-4bef-90a7-7695e895e8f2-nova-combined-ca-bundle\") pod \"nova-edpm-multinodeset-edpm-compute-no-nodes-t9xl6\" (UID: \"1196e231-b422-4bef-90a7-7695e895e8f2\") " pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-no-nodes-t9xl6" Mar 16 17:27:05 crc kubenswrapper[5120]: I0316 17:27:05.683640 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-cell1-compute-config-1\" (UniqueName: \"kubernetes.io/secret/1196e231-b422-4bef-90a7-7695e895e8f2-nova-cell1-compute-config-1\") pod \"nova-edpm-multinodeset-edpm-compute-no-nodes-t9xl6\" (UID: \"1196e231-b422-4bef-90a7-7695e895e8f2\") " pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-no-nodes-t9xl6" Mar 16 17:27:05 crc kubenswrapper[5120]: I0316 17:27:05.683730 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/1196e231-b422-4bef-90a7-7695e895e8f2-inventory\") pod \"nova-edpm-multinodeset-edpm-compute-no-nodes-t9xl6\" (UID: \"1196e231-b422-4bef-90a7-7695e895e8f2\") " pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-no-nodes-t9xl6" Mar 16 17:27:05 crc kubenswrapper[5120]: I0316 17:27:05.684008 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/1196e231-b422-4bef-90a7-7695e895e8f2-ssh-key-edpm-compute-no-nodes\") pod \"nova-edpm-multinodeset-edpm-compute-no-nodes-t9xl6\" (UID: \"1196e231-b422-4bef-90a7-7695e895e8f2\") " pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-no-nodes-t9xl6" Mar 16 17:27:05 crc kubenswrapper[5120]: I0316 17:27:05.684090 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n4k22\" (UniqueName: \"kubernetes.io/projected/1196e231-b422-4bef-90a7-7695e895e8f2-kube-api-access-n4k22\") pod \"nova-edpm-multinodeset-edpm-compute-no-nodes-t9xl6\" (UID: \"1196e231-b422-4bef-90a7-7695e895e8f2\") " pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-no-nodes-t9xl6" Mar 16 17:27:05 crc kubenswrapper[5120]: I0316 17:27:05.684154 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-migration-ssh-key-0\" (UniqueName: \"kubernetes.io/secret/1196e231-b422-4bef-90a7-7695e895e8f2-nova-migration-ssh-key-0\") pod \"nova-edpm-multinodeset-edpm-compute-no-nodes-t9xl6\" (UID: \"1196e231-b422-4bef-90a7-7695e895e8f2\") " pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-no-nodes-t9xl6" Mar 16 17:27:05 crc kubenswrapper[5120]: I0316 17:27:05.689683 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-cell1-compute-config-1\" (UniqueName: \"kubernetes.io/secret/1196e231-b422-4bef-90a7-7695e895e8f2-nova-cell1-compute-config-1\") pod \"nova-edpm-multinodeset-edpm-compute-no-nodes-t9xl6\" (UID: \"1196e231-b422-4bef-90a7-7695e895e8f2\") " pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-no-nodes-t9xl6" Mar 16 17:27:05 crc kubenswrapper[5120]: I0316 17:27:05.689924 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1196e231-b422-4bef-90a7-7695e895e8f2-nova-combined-ca-bundle\") pod \"nova-edpm-multinodeset-edpm-compute-no-nodes-t9xl6\" (UID: \"1196e231-b422-4bef-90a7-7695e895e8f2\") " pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-no-nodes-t9xl6" Mar 16 17:27:05 crc kubenswrapper[5120]: I0316 17:27:05.690211 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-migration-ssh-key-1\" (UniqueName: \"kubernetes.io/secret/1196e231-b422-4bef-90a7-7695e895e8f2-nova-migration-ssh-key-1\") pod \"nova-edpm-multinodeset-edpm-compute-no-nodes-t9xl6\" (UID: \"1196e231-b422-4bef-90a7-7695e895e8f2\") " pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-no-nodes-t9xl6" Mar 16 17:27:05 crc kubenswrapper[5120]: I0316 17:27:05.690293 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-migration-ssh-key-0\" (UniqueName: \"kubernetes.io/secret/1196e231-b422-4bef-90a7-7695e895e8f2-nova-migration-ssh-key-0\") pod \"nova-edpm-multinodeset-edpm-compute-no-nodes-t9xl6\" (UID: \"1196e231-b422-4bef-90a7-7695e895e8f2\") " pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-no-nodes-t9xl6" Mar 16 17:27:05 crc kubenswrapper[5120]: I0316 17:27:05.690817 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/1196e231-b422-4bef-90a7-7695e895e8f2-inventory\") pod \"nova-edpm-multinodeset-edpm-compute-no-nodes-t9xl6\" (UID: \"1196e231-b422-4bef-90a7-7695e895e8f2\") " pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-no-nodes-t9xl6" Mar 16 17:27:05 crc kubenswrapper[5120]: I0316 17:27:05.693028 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/1196e231-b422-4bef-90a7-7695e895e8f2-ssh-key-edpm-compute-no-nodes\") pod \"nova-edpm-multinodeset-edpm-compute-no-nodes-t9xl6\" (UID: \"1196e231-b422-4bef-90a7-7695e895e8f2\") " pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-no-nodes-t9xl6" Mar 16 17:27:05 crc kubenswrapper[5120]: I0316 17:27:05.693436 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-cell1-compute-config-0\" (UniqueName: \"kubernetes.io/secret/1196e231-b422-4bef-90a7-7695e895e8f2-nova-cell1-compute-config-0\") pod \"nova-edpm-multinodeset-edpm-compute-no-nodes-t9xl6\" (UID: \"1196e231-b422-4bef-90a7-7695e895e8f2\") " pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-no-nodes-t9xl6" Mar 16 17:27:05 crc kubenswrapper[5120]: I0316 17:27:05.701183 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4k22\" (UniqueName: \"kubernetes.io/projected/1196e231-b422-4bef-90a7-7695e895e8f2-kube-api-access-n4k22\") pod \"nova-edpm-multinodeset-edpm-compute-no-nodes-t9xl6\" (UID: \"1196e231-b422-4bef-90a7-7695e895e8f2\") " pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-no-nodes-t9xl6" Mar 16 17:27:05 crc kubenswrapper[5120]: I0316 17:27:05.813010 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-kx46q" Mar 16 17:27:05 crc kubenswrapper[5120]: I0316 17:27:05.825499 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-no-nodes-t9xl6" Mar 16 17:27:05 crc kubenswrapper[5120]: I0316 17:27:05.886333 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4xlcg\" (UniqueName: \"kubernetes.io/projected/4b8ef736-b72d-43c0-9c46-9fea0f814438-kube-api-access-4xlcg\") pod \"4b8ef736-b72d-43c0-9c46-9fea0f814438\" (UID: \"4b8ef736-b72d-43c0-9c46-9fea0f814438\") " Mar 16 17:27:05 crc kubenswrapper[5120]: I0316 17:27:05.886738 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/4b8ef736-b72d-43c0-9c46-9fea0f814438-catalog-content\") pod \"4b8ef736-b72d-43c0-9c46-9fea0f814438\" (UID: \"4b8ef736-b72d-43c0-9c46-9fea0f814438\") " Mar 16 17:27:05 crc kubenswrapper[5120]: I0316 17:27:05.886813 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/4b8ef736-b72d-43c0-9c46-9fea0f814438-utilities\") pod \"4b8ef736-b72d-43c0-9c46-9fea0f814438\" (UID: \"4b8ef736-b72d-43c0-9c46-9fea0f814438\") " Mar 16 17:27:05 crc kubenswrapper[5120]: I0316 17:27:05.888332 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b8ef736-b72d-43c0-9c46-9fea0f814438-utilities" (OuterVolumeSpecName: "utilities") pod "4b8ef736-b72d-43c0-9c46-9fea0f814438" (UID: "4b8ef736-b72d-43c0-9c46-9fea0f814438"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:27:05 crc kubenswrapper[5120]: I0316 17:27:05.891934 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b8ef736-b72d-43c0-9c46-9fea0f814438-kube-api-access-4xlcg" (OuterVolumeSpecName: "kube-api-access-4xlcg") pod "4b8ef736-b72d-43c0-9c46-9fea0f814438" (UID: "4b8ef736-b72d-43c0-9c46-9fea0f814438"). InnerVolumeSpecName "kube-api-access-4xlcg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:27:05 crc kubenswrapper[5120]: I0316 17:27:05.908331 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b8ef736-b72d-43c0-9c46-9fea0f814438-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "4b8ef736-b72d-43c0-9c46-9fea0f814438" (UID: "4b8ef736-b72d-43c0-9c46-9fea0f814438"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:27:05 crc kubenswrapper[5120]: I0316 17:27:05.990029 5120 reconciler_common.go:299] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/4b8ef736-b72d-43c0-9c46-9fea0f814438-catalog-content\") on node \"crc\" DevicePath \"\"" Mar 16 17:27:05 crc kubenswrapper[5120]: I0316 17:27:05.990073 5120 reconciler_common.go:299] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/4b8ef736-b72d-43c0-9c46-9fea0f814438-utilities\") on node \"crc\" DevicePath \"\"" Mar 16 17:27:05 crc kubenswrapper[5120]: I0316 17:27:05.990085 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4xlcg\" (UniqueName: \"kubernetes.io/projected/4b8ef736-b72d-43c0-9c46-9fea0f814438-kube-api-access-4xlcg\") on node \"crc\" DevicePath \"\"" Mar 16 17:27:06 crc kubenswrapper[5120]: I0316 17:27:06.251360 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-no-nodes-t9xl6"] Mar 16 17:27:06 crc kubenswrapper[5120]: W0316 17:27:06.256264 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1196e231_b422_4bef_90a7_7695e895e8f2.slice/crio-7f93c0715bdf32f6144758577f41894b9ed44a47687e1a3f096458fe810f2c57 WatchSource:0}: Error finding container 7f93c0715bdf32f6144758577f41894b9ed44a47687e1a3f096458fe810f2c57: Status 404 returned error can't find the container with id 7f93c0715bdf32f6144758577f41894b9ed44a47687e1a3f096458fe810f2c57 Mar 16 17:27:06 crc kubenswrapper[5120]: I0316 17:27:06.375635 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-no-nodes-t9xl6" event={"ID":"1196e231-b422-4bef-90a7-7695e895e8f2","Type":"ContainerStarted","Data":"7f93c0715bdf32f6144758577f41894b9ed44a47687e1a3f096458fe810f2c57"} Mar 16 17:27:06 crc kubenswrapper[5120]: I0316 17:27:06.377994 5120 generic.go:358] "Generic (PLEG): container finished" podID="4b8ef736-b72d-43c0-9c46-9fea0f814438" containerID="00367b6b6f510d4dc78cfa122808afa77e1155a783d5193b9810684e860c4836" exitCode=0 Mar 16 17:27:06 crc kubenswrapper[5120]: I0316 17:27:06.378050 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-kx46q" event={"ID":"4b8ef736-b72d-43c0-9c46-9fea0f814438","Type":"ContainerDied","Data":"00367b6b6f510d4dc78cfa122808afa77e1155a783d5193b9810684e860c4836"} Mar 16 17:27:06 crc kubenswrapper[5120]: I0316 17:27:06.378092 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-kx46q" event={"ID":"4b8ef736-b72d-43c0-9c46-9fea0f814438","Type":"ContainerDied","Data":"048e9a6c3f8a15e4cc79b057c4f87f18d1c69848acd957a6af7b152f4c35794f"} Mar 16 17:27:06 crc kubenswrapper[5120]: I0316 17:27:06.378112 5120 scope.go:117] "RemoveContainer" containerID="00367b6b6f510d4dc78cfa122808afa77e1155a783d5193b9810684e860c4836" Mar 16 17:27:06 crc kubenswrapper[5120]: I0316 17:27:06.378255 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-kx46q" Mar 16 17:27:06 crc kubenswrapper[5120]: I0316 17:27:06.403652 5120 scope.go:117] "RemoveContainer" containerID="6b9fe98dd4ca3a1e1003acee09001dcaa5e232b082be11f78ed85bedae8069ee" Mar 16 17:27:06 crc kubenswrapper[5120]: I0316 17:27:06.424824 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-marketplace-kx46q"] Mar 16 17:27:06 crc kubenswrapper[5120]: I0316 17:27:06.432867 5120 scope.go:117] "RemoveContainer" containerID="5020693d927f6cae20c39e98c605d33f77f9990d1cb5e92842bcc9046de07596" Mar 16 17:27:06 crc kubenswrapper[5120]: I0316 17:27:06.433456 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/redhat-marketplace-kx46q"] Mar 16 17:27:06 crc kubenswrapper[5120]: I0316 17:27:06.453052 5120 scope.go:117] "RemoveContainer" containerID="00367b6b6f510d4dc78cfa122808afa77e1155a783d5193b9810684e860c4836" Mar 16 17:27:06 crc kubenswrapper[5120]: E0316 17:27:06.453429 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"00367b6b6f510d4dc78cfa122808afa77e1155a783d5193b9810684e860c4836\": container with ID starting with 00367b6b6f510d4dc78cfa122808afa77e1155a783d5193b9810684e860c4836 not found: ID does not exist" containerID="00367b6b6f510d4dc78cfa122808afa77e1155a783d5193b9810684e860c4836" Mar 16 17:27:06 crc kubenswrapper[5120]: I0316 17:27:06.453522 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00367b6b6f510d4dc78cfa122808afa77e1155a783d5193b9810684e860c4836"} err="failed to get container status \"00367b6b6f510d4dc78cfa122808afa77e1155a783d5193b9810684e860c4836\": rpc error: code = NotFound desc = could not find container \"00367b6b6f510d4dc78cfa122808afa77e1155a783d5193b9810684e860c4836\": container with ID starting with 00367b6b6f510d4dc78cfa122808afa77e1155a783d5193b9810684e860c4836 not found: ID does not exist" Mar 16 17:27:06 crc kubenswrapper[5120]: I0316 17:27:06.453596 5120 scope.go:117] "RemoveContainer" containerID="6b9fe98dd4ca3a1e1003acee09001dcaa5e232b082be11f78ed85bedae8069ee" Mar 16 17:27:06 crc kubenswrapper[5120]: E0316 17:27:06.453845 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b9fe98dd4ca3a1e1003acee09001dcaa5e232b082be11f78ed85bedae8069ee\": container with ID starting with 6b9fe98dd4ca3a1e1003acee09001dcaa5e232b082be11f78ed85bedae8069ee not found: ID does not exist" containerID="6b9fe98dd4ca3a1e1003acee09001dcaa5e232b082be11f78ed85bedae8069ee" Mar 16 17:27:06 crc kubenswrapper[5120]: I0316 17:27:06.453872 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b9fe98dd4ca3a1e1003acee09001dcaa5e232b082be11f78ed85bedae8069ee"} err="failed to get container status \"6b9fe98dd4ca3a1e1003acee09001dcaa5e232b082be11f78ed85bedae8069ee\": rpc error: code = NotFound desc = could not find container \"6b9fe98dd4ca3a1e1003acee09001dcaa5e232b082be11f78ed85bedae8069ee\": container with ID starting with 6b9fe98dd4ca3a1e1003acee09001dcaa5e232b082be11f78ed85bedae8069ee not found: ID does not exist" Mar 16 17:27:06 crc kubenswrapper[5120]: I0316 17:27:06.453886 5120 scope.go:117] "RemoveContainer" containerID="5020693d927f6cae20c39e98c605d33f77f9990d1cb5e92842bcc9046de07596" Mar 16 17:27:06 crc kubenswrapper[5120]: E0316 17:27:06.454138 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5020693d927f6cae20c39e98c605d33f77f9990d1cb5e92842bcc9046de07596\": container with ID starting with 5020693d927f6cae20c39e98c605d33f77f9990d1cb5e92842bcc9046de07596 not found: ID does not exist" containerID="5020693d927f6cae20c39e98c605d33f77f9990d1cb5e92842bcc9046de07596" Mar 16 17:27:06 crc kubenswrapper[5120]: I0316 17:27:06.454158 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5020693d927f6cae20c39e98c605d33f77f9990d1cb5e92842bcc9046de07596"} err="failed to get container status \"5020693d927f6cae20c39e98c605d33f77f9990d1cb5e92842bcc9046de07596\": rpc error: code = NotFound desc = could not find container \"5020693d927f6cae20c39e98c605d33f77f9990d1cb5e92842bcc9046de07596\": container with ID starting with 5020693d927f6cae20c39e98c605d33f77f9990d1cb5e92842bcc9046de07596 not found: ID does not exist" Mar 16 17:27:06 crc kubenswrapper[5120]: I0316 17:27:06.673405 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b8ef736-b72d-43c0-9c46-9fea0f814438" path="/var/lib/kubelet/pods/4b8ef736-b72d-43c0-9c46-9fea0f814438/volumes" Mar 16 17:27:07 crc kubenswrapper[5120]: I0316 17:27:07.388095 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-no-nodes-t9xl6" event={"ID":"1196e231-b422-4bef-90a7-7695e895e8f2","Type":"ContainerStarted","Data":"19648ac0d1db8832c39c3c67e2d3855dec89f6eddc9a1d408e909fe3b057e7d5"} Mar 16 17:27:07 crc kubenswrapper[5120]: I0316 17:27:07.404931 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-no-nodes-t9xl6" podStartSLOduration=1.6557420280000001 podStartE2EDuration="2.404911892s" podCreationTimestamp="2026-03-16 17:27:05 +0000 UTC" firstStartedPulling="2026-03-16 17:27:06.259048443 +0000 UTC m=+6928.412980100" lastFinishedPulling="2026-03-16 17:27:07.008218307 +0000 UTC m=+6929.162149964" observedRunningTime="2026-03-16 17:27:07.40298313 +0000 UTC m=+6929.556914797" watchObservedRunningTime="2026-03-16 17:27:07.404911892 +0000 UTC m=+6929.558843549" Mar 16 17:27:07 crc kubenswrapper[5120]: E0316 17:27:07.511061 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1313187 actualBytes=10240 Mar 16 17:27:08 crc kubenswrapper[5120]: I0316 17:27:08.400139 5120 generic.go:358] "Generic (PLEG): container finished" podID="1196e231-b422-4bef-90a7-7695e895e8f2" containerID="19648ac0d1db8832c39c3c67e2d3855dec89f6eddc9a1d408e909fe3b057e7d5" exitCode=0 Mar 16 17:27:08 crc kubenswrapper[5120]: I0316 17:27:08.400264 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-no-nodes-t9xl6" event={"ID":"1196e231-b422-4bef-90a7-7695e895e8f2","Type":"ContainerDied","Data":"19648ac0d1db8832c39c3c67e2d3855dec89f6eddc9a1d408e909fe3b057e7d5"} Mar 16 17:27:09 crc kubenswrapper[5120]: I0316 17:27:09.784189 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-no-nodes-t9xl6" Mar 16 17:27:09 crc kubenswrapper[5120]: I0316 17:27:09.875425 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n4k22\" (UniqueName: \"kubernetes.io/projected/1196e231-b422-4bef-90a7-7695e895e8f2-kube-api-access-n4k22\") pod \"1196e231-b422-4bef-90a7-7695e895e8f2\" (UID: \"1196e231-b422-4bef-90a7-7695e895e8f2\") " Mar 16 17:27:09 crc kubenswrapper[5120]: I0316 17:27:09.875483 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1196e231-b422-4bef-90a7-7695e895e8f2-nova-combined-ca-bundle\") pod \"1196e231-b422-4bef-90a7-7695e895e8f2\" (UID: \"1196e231-b422-4bef-90a7-7695e895e8f2\") " Mar 16 17:27:09 crc kubenswrapper[5120]: I0316 17:27:09.875520 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-migration-ssh-key-0\" (UniqueName: \"kubernetes.io/secret/1196e231-b422-4bef-90a7-7695e895e8f2-nova-migration-ssh-key-0\") pod \"1196e231-b422-4bef-90a7-7695e895e8f2\" (UID: \"1196e231-b422-4bef-90a7-7695e895e8f2\") " Mar 16 17:27:09 crc kubenswrapper[5120]: I0316 17:27:09.875845 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/1196e231-b422-4bef-90a7-7695e895e8f2-inventory\") pod \"1196e231-b422-4bef-90a7-7695e895e8f2\" (UID: \"1196e231-b422-4bef-90a7-7695e895e8f2\") " Mar 16 17:27:09 crc kubenswrapper[5120]: I0316 17:27:09.875935 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/1196e231-b422-4bef-90a7-7695e895e8f2-ssh-key-edpm-compute-no-nodes\") pod \"1196e231-b422-4bef-90a7-7695e895e8f2\" (UID: \"1196e231-b422-4bef-90a7-7695e895e8f2\") " Mar 16 17:27:09 crc kubenswrapper[5120]: I0316 17:27:09.875998 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-cell1-compute-config-0\" (UniqueName: \"kubernetes.io/secret/1196e231-b422-4bef-90a7-7695e895e8f2-nova-cell1-compute-config-0\") pod \"1196e231-b422-4bef-90a7-7695e895e8f2\" (UID: \"1196e231-b422-4bef-90a7-7695e895e8f2\") " Mar 16 17:27:09 crc kubenswrapper[5120]: I0316 17:27:09.876726 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-migration-ssh-key-1\" (UniqueName: \"kubernetes.io/secret/1196e231-b422-4bef-90a7-7695e895e8f2-nova-migration-ssh-key-1\") pod \"1196e231-b422-4bef-90a7-7695e895e8f2\" (UID: \"1196e231-b422-4bef-90a7-7695e895e8f2\") " Mar 16 17:27:09 crc kubenswrapper[5120]: I0316 17:27:09.876778 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-cell1-compute-config-1\" (UniqueName: \"kubernetes.io/secret/1196e231-b422-4bef-90a7-7695e895e8f2-nova-cell1-compute-config-1\") pod \"1196e231-b422-4bef-90a7-7695e895e8f2\" (UID: \"1196e231-b422-4bef-90a7-7695e895e8f2\") " Mar 16 17:27:09 crc kubenswrapper[5120]: I0316 17:27:09.881869 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1196e231-b422-4bef-90a7-7695e895e8f2-kube-api-access-n4k22" (OuterVolumeSpecName: "kube-api-access-n4k22") pod "1196e231-b422-4bef-90a7-7695e895e8f2" (UID: "1196e231-b422-4bef-90a7-7695e895e8f2"). InnerVolumeSpecName "kube-api-access-n4k22". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:27:09 crc kubenswrapper[5120]: I0316 17:27:09.881867 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1196e231-b422-4bef-90a7-7695e895e8f2-nova-combined-ca-bundle" (OuterVolumeSpecName: "nova-combined-ca-bundle") pod "1196e231-b422-4bef-90a7-7695e895e8f2" (UID: "1196e231-b422-4bef-90a7-7695e895e8f2"). InnerVolumeSpecName "nova-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:27:09 crc kubenswrapper[5120]: I0316 17:27:09.900961 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1196e231-b422-4bef-90a7-7695e895e8f2-inventory" (OuterVolumeSpecName: "inventory") pod "1196e231-b422-4bef-90a7-7695e895e8f2" (UID: "1196e231-b422-4bef-90a7-7695e895e8f2"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:27:09 crc kubenswrapper[5120]: I0316 17:27:09.904151 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1196e231-b422-4bef-90a7-7695e895e8f2-nova-migration-ssh-key-0" (OuterVolumeSpecName: "nova-migration-ssh-key-0") pod "1196e231-b422-4bef-90a7-7695e895e8f2" (UID: "1196e231-b422-4bef-90a7-7695e895e8f2"). InnerVolumeSpecName "nova-migration-ssh-key-0". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:27:09 crc kubenswrapper[5120]: I0316 17:27:09.904253 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1196e231-b422-4bef-90a7-7695e895e8f2-nova-migration-ssh-key-1" (OuterVolumeSpecName: "nova-migration-ssh-key-1") pod "1196e231-b422-4bef-90a7-7695e895e8f2" (UID: "1196e231-b422-4bef-90a7-7695e895e8f2"). InnerVolumeSpecName "nova-migration-ssh-key-1". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:27:09 crc kubenswrapper[5120]: I0316 17:27:09.904502 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1196e231-b422-4bef-90a7-7695e895e8f2-ssh-key-edpm-compute-no-nodes" (OuterVolumeSpecName: "ssh-key-edpm-compute-no-nodes") pod "1196e231-b422-4bef-90a7-7695e895e8f2" (UID: "1196e231-b422-4bef-90a7-7695e895e8f2"). InnerVolumeSpecName "ssh-key-edpm-compute-no-nodes". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:27:09 crc kubenswrapper[5120]: I0316 17:27:09.904771 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1196e231-b422-4bef-90a7-7695e895e8f2-nova-cell1-compute-config-1" (OuterVolumeSpecName: "nova-cell1-compute-config-1") pod "1196e231-b422-4bef-90a7-7695e895e8f2" (UID: "1196e231-b422-4bef-90a7-7695e895e8f2"). InnerVolumeSpecName "nova-cell1-compute-config-1". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:27:09 crc kubenswrapper[5120]: I0316 17:27:09.907359 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1196e231-b422-4bef-90a7-7695e895e8f2-nova-cell1-compute-config-0" (OuterVolumeSpecName: "nova-cell1-compute-config-0") pod "1196e231-b422-4bef-90a7-7695e895e8f2" (UID: "1196e231-b422-4bef-90a7-7695e895e8f2"). InnerVolumeSpecName "nova-cell1-compute-config-0". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:27:09 crc kubenswrapper[5120]: I0316 17:27:09.978831 5120 reconciler_common.go:299] "Volume detached for volume \"nova-migration-ssh-key-1\" (UniqueName: \"kubernetes.io/secret/1196e231-b422-4bef-90a7-7695e895e8f2-nova-migration-ssh-key-1\") on node \"crc\" DevicePath \"\"" Mar 16 17:27:09 crc kubenswrapper[5120]: I0316 17:27:09.978875 5120 reconciler_common.go:299] "Volume detached for volume \"nova-cell1-compute-config-1\" (UniqueName: \"kubernetes.io/secret/1196e231-b422-4bef-90a7-7695e895e8f2-nova-cell1-compute-config-1\") on node \"crc\" DevicePath \"\"" Mar 16 17:27:09 crc kubenswrapper[5120]: I0316 17:27:09.978886 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n4k22\" (UniqueName: \"kubernetes.io/projected/1196e231-b422-4bef-90a7-7695e895e8f2-kube-api-access-n4k22\") on node \"crc\" DevicePath \"\"" Mar 16 17:27:09 crc kubenswrapper[5120]: I0316 17:27:09.978895 5120 reconciler_common.go:299] "Volume detached for volume \"nova-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1196e231-b422-4bef-90a7-7695e895e8f2-nova-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:27:09 crc kubenswrapper[5120]: I0316 17:27:09.978904 5120 reconciler_common.go:299] "Volume detached for volume \"nova-migration-ssh-key-0\" (UniqueName: \"kubernetes.io/secret/1196e231-b422-4bef-90a7-7695e895e8f2-nova-migration-ssh-key-0\") on node \"crc\" DevicePath \"\"" Mar 16 17:27:09 crc kubenswrapper[5120]: I0316 17:27:09.978914 5120 reconciler_common.go:299] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/1196e231-b422-4bef-90a7-7695e895e8f2-inventory\") on node \"crc\" DevicePath \"\"" Mar 16 17:27:09 crc kubenswrapper[5120]: I0316 17:27:09.978923 5120 reconciler_common.go:299] "Volume detached for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/1196e231-b422-4bef-90a7-7695e895e8f2-ssh-key-edpm-compute-no-nodes\") on node \"crc\" DevicePath \"\"" Mar 16 17:27:09 crc kubenswrapper[5120]: I0316 17:27:09.978932 5120 reconciler_common.go:299] "Volume detached for volume \"nova-cell1-compute-config-0\" (UniqueName: \"kubernetes.io/secret/1196e231-b422-4bef-90a7-7695e895e8f2-nova-cell1-compute-config-0\") on node \"crc\" DevicePath \"\"" Mar 16 17:27:10 crc kubenswrapper[5120]: I0316 17:27:10.420919 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-no-nodes-t9xl6" Mar 16 17:27:10 crc kubenswrapper[5120]: I0316 17:27:10.420962 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-no-nodes-t9xl6" event={"ID":"1196e231-b422-4bef-90a7-7695e895e8f2","Type":"ContainerDied","Data":"7f93c0715bdf32f6144758577f41894b9ed44a47687e1a3f096458fe810f2c57"} Mar 16 17:27:10 crc kubenswrapper[5120]: I0316 17:27:10.421002 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7f93c0715bdf32f6144758577f41894b9ed44a47687e1a3f096458fe810f2c57" Mar 16 17:27:12 crc kubenswrapper[5120]: I0316 17:27:12.779077 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/configure-os-edpm-ansiblevars-deploy-edpm-compute-no-nodesgprqv"] Mar 16 17:27:12 crc kubenswrapper[5120]: I0316 17:27:12.781101 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b8ef736-b72d-43c0-9c46-9fea0f814438" containerName="registry-server" Mar 16 17:27:12 crc kubenswrapper[5120]: I0316 17:27:12.781214 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b8ef736-b72d-43c0-9c46-9fea0f814438" containerName="registry-server" Mar 16 17:27:12 crc kubenswrapper[5120]: I0316 17:27:12.781289 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b8ef736-b72d-43c0-9c46-9fea0f814438" containerName="extract-content" Mar 16 17:27:12 crc kubenswrapper[5120]: I0316 17:27:12.781366 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b8ef736-b72d-43c0-9c46-9fea0f814438" containerName="extract-content" Mar 16 17:27:12 crc kubenswrapper[5120]: I0316 17:27:12.781444 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1196e231-b422-4bef-90a7-7695e895e8f2" containerName="nova-edpm-multinodeset-edpm-compute-no-nodes" Mar 16 17:27:12 crc kubenswrapper[5120]: I0316 17:27:12.781533 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1196e231-b422-4bef-90a7-7695e895e8f2" containerName="nova-edpm-multinodeset-edpm-compute-no-nodes" Mar 16 17:27:12 crc kubenswrapper[5120]: I0316 17:27:12.781608 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b8ef736-b72d-43c0-9c46-9fea0f814438" containerName="extract-utilities" Mar 16 17:27:12 crc kubenswrapper[5120]: I0316 17:27:12.781662 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b8ef736-b72d-43c0-9c46-9fea0f814438" containerName="extract-utilities" Mar 16 17:27:12 crc kubenswrapper[5120]: I0316 17:27:12.781917 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="4b8ef736-b72d-43c0-9c46-9fea0f814438" containerName="registry-server" Mar 16 17:27:12 crc kubenswrapper[5120]: I0316 17:27:12.782584 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1196e231-b422-4bef-90a7-7695e895e8f2" containerName="nova-edpm-multinodeset-edpm-compute-no-nodes" Mar 16 17:27:12 crc kubenswrapper[5120]: I0316 17:27:12.796077 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/configure-os-edpm-ansiblevars-deploy-edpm-compute-no-nodesgprqv"] Mar 16 17:27:12 crc kubenswrapper[5120]: I0316 17:27:12.796250 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/configure-os-edpm-ansiblevars-deploy-edpm-compute-no-nodesgprqv" Mar 16 17:27:12 crc kubenswrapper[5120]: I0316 17:27:12.798783 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-aee-default-env\"" Mar 16 17:27:12 crc kubenswrapper[5120]: I0316 17:27:12.799519 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplane-ansible-ssh-private-key-secret\"" Mar 16 17:27:12 crc kubenswrapper[5120]: I0316 17:27:12.799687 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"edpm-compute-no-nodes-dockercfg-znndh\"" Mar 16 17:27:12 crc kubenswrapper[5120]: I0316 17:27:12.802124 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplanenodeset-edpm-compute-no-nodes\"" Mar 16 17:27:12 crc kubenswrapper[5120]: I0316 17:27:12.943996 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rpqgb\" (UniqueName: \"kubernetes.io/projected/c3e99380-03e2-498b-b872-6f5af9ff0e63-kube-api-access-rpqgb\") pod \"configure-os-edpm-ansiblevars-deploy-edpm-compute-no-nodesgprqv\" (UID: \"c3e99380-03e2-498b-b872-6f5af9ff0e63\") " pod="openstack-kuttl-tests/configure-os-edpm-ansiblevars-deploy-edpm-compute-no-nodesgprqv" Mar 16 17:27:12 crc kubenswrapper[5120]: I0316 17:27:12.944525 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/c3e99380-03e2-498b-b872-6f5af9ff0e63-ssh-key-edpm-compute-no-nodes\") pod \"configure-os-edpm-ansiblevars-deploy-edpm-compute-no-nodesgprqv\" (UID: \"c3e99380-03e2-498b-b872-6f5af9ff0e63\") " pod="openstack-kuttl-tests/configure-os-edpm-ansiblevars-deploy-edpm-compute-no-nodesgprqv" Mar 16 17:27:12 crc kubenswrapper[5120]: I0316 17:27:12.944847 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/c3e99380-03e2-498b-b872-6f5af9ff0e63-inventory\") pod \"configure-os-edpm-ansiblevars-deploy-edpm-compute-no-nodesgprqv\" (UID: \"c3e99380-03e2-498b-b872-6f5af9ff0e63\") " pod="openstack-kuttl-tests/configure-os-edpm-ansiblevars-deploy-edpm-compute-no-nodesgprqv" Mar 16 17:27:13 crc kubenswrapper[5120]: I0316 17:27:13.047900 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rpqgb\" (UniqueName: \"kubernetes.io/projected/c3e99380-03e2-498b-b872-6f5af9ff0e63-kube-api-access-rpqgb\") pod \"configure-os-edpm-ansiblevars-deploy-edpm-compute-no-nodesgprqv\" (UID: \"c3e99380-03e2-498b-b872-6f5af9ff0e63\") " pod="openstack-kuttl-tests/configure-os-edpm-ansiblevars-deploy-edpm-compute-no-nodesgprqv" Mar 16 17:27:13 crc kubenswrapper[5120]: I0316 17:27:13.048050 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/c3e99380-03e2-498b-b872-6f5af9ff0e63-ssh-key-edpm-compute-no-nodes\") pod \"configure-os-edpm-ansiblevars-deploy-edpm-compute-no-nodesgprqv\" (UID: \"c3e99380-03e2-498b-b872-6f5af9ff0e63\") " pod="openstack-kuttl-tests/configure-os-edpm-ansiblevars-deploy-edpm-compute-no-nodesgprqv" Mar 16 17:27:13 crc kubenswrapper[5120]: I0316 17:27:13.048197 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/c3e99380-03e2-498b-b872-6f5af9ff0e63-inventory\") pod \"configure-os-edpm-ansiblevars-deploy-edpm-compute-no-nodesgprqv\" (UID: \"c3e99380-03e2-498b-b872-6f5af9ff0e63\") " pod="openstack-kuttl-tests/configure-os-edpm-ansiblevars-deploy-edpm-compute-no-nodesgprqv" Mar 16 17:27:13 crc kubenswrapper[5120]: I0316 17:27:13.055594 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/c3e99380-03e2-498b-b872-6f5af9ff0e63-ssh-key-edpm-compute-no-nodes\") pod \"configure-os-edpm-ansiblevars-deploy-edpm-compute-no-nodesgprqv\" (UID: \"c3e99380-03e2-498b-b872-6f5af9ff0e63\") " pod="openstack-kuttl-tests/configure-os-edpm-ansiblevars-deploy-edpm-compute-no-nodesgprqv" Mar 16 17:27:13 crc kubenswrapper[5120]: I0316 17:27:13.056222 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/c3e99380-03e2-498b-b872-6f5af9ff0e63-inventory\") pod \"configure-os-edpm-ansiblevars-deploy-edpm-compute-no-nodesgprqv\" (UID: \"c3e99380-03e2-498b-b872-6f5af9ff0e63\") " pod="openstack-kuttl-tests/configure-os-edpm-ansiblevars-deploy-edpm-compute-no-nodesgprqv" Mar 16 17:27:13 crc kubenswrapper[5120]: I0316 17:27:13.065459 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rpqgb\" (UniqueName: \"kubernetes.io/projected/c3e99380-03e2-498b-b872-6f5af9ff0e63-kube-api-access-rpqgb\") pod \"configure-os-edpm-ansiblevars-deploy-edpm-compute-no-nodesgprqv\" (UID: \"c3e99380-03e2-498b-b872-6f5af9ff0e63\") " pod="openstack-kuttl-tests/configure-os-edpm-ansiblevars-deploy-edpm-compute-no-nodesgprqv" Mar 16 17:27:13 crc kubenswrapper[5120]: I0316 17:27:13.118778 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/configure-os-edpm-ansiblevars-deploy-edpm-compute-no-nodesgprqv" Mar 16 17:27:13 crc kubenswrapper[5120]: I0316 17:27:13.583090 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/configure-os-edpm-ansiblevars-deploy-edpm-compute-no-nodesgprqv"] Mar 16 17:27:14 crc kubenswrapper[5120]: I0316 17:27:14.469008 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/configure-os-edpm-ansiblevars-deploy-edpm-compute-no-nodesgprqv" event={"ID":"c3e99380-03e2-498b-b872-6f5af9ff0e63","Type":"ContainerStarted","Data":"70692e6edf5b29528d4d5c7307821d7188338279e888f87965793032a701dceb"} Mar 16 17:27:14 crc kubenswrapper[5120]: I0316 17:27:14.470375 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/configure-os-edpm-ansiblevars-deploy-edpm-compute-no-nodesgprqv" event={"ID":"c3e99380-03e2-498b-b872-6f5af9ff0e63","Type":"ContainerStarted","Data":"3c3397734bf6dda9a4f08bd93d442cd892f990cc0e156ffbaff36e18764f08bf"} Mar 16 17:27:14 crc kubenswrapper[5120]: I0316 17:27:14.504562 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/configure-os-edpm-ansiblevars-deploy-edpm-compute-no-nodesgprqv" podStartSLOduration=1.975808856 podStartE2EDuration="2.504540433s" podCreationTimestamp="2026-03-16 17:27:12 +0000 UTC" firstStartedPulling="2026-03-16 17:27:13.587885909 +0000 UTC m=+6935.741817566" lastFinishedPulling="2026-03-16 17:27:14.116617486 +0000 UTC m=+6936.270549143" observedRunningTime="2026-03-16 17:27:14.497879901 +0000 UTC m=+6936.651811628" watchObservedRunningTime="2026-03-16 17:27:14.504540433 +0000 UTC m=+6936.658472080" Mar 16 17:27:16 crc kubenswrapper[5120]: I0316 17:27:16.488002 5120 generic.go:358] "Generic (PLEG): container finished" podID="c3e99380-03e2-498b-b872-6f5af9ff0e63" containerID="70692e6edf5b29528d4d5c7307821d7188338279e888f87965793032a701dceb" exitCode=0 Mar 16 17:27:16 crc kubenswrapper[5120]: I0316 17:27:16.488047 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/configure-os-edpm-ansiblevars-deploy-edpm-compute-no-nodesgprqv" event={"ID":"c3e99380-03e2-498b-b872-6f5af9ff0e63","Type":"ContainerDied","Data":"70692e6edf5b29528d4d5c7307821d7188338279e888f87965793032a701dceb"} Mar 16 17:27:17 crc kubenswrapper[5120]: I0316 17:27:17.811123 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/configure-os-edpm-ansiblevars-deploy-edpm-compute-no-nodesgprqv" Mar 16 17:27:17 crc kubenswrapper[5120]: I0316 17:27:17.878572 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rpqgb\" (UniqueName: \"kubernetes.io/projected/c3e99380-03e2-498b-b872-6f5af9ff0e63-kube-api-access-rpqgb\") pod \"c3e99380-03e2-498b-b872-6f5af9ff0e63\" (UID: \"c3e99380-03e2-498b-b872-6f5af9ff0e63\") " Mar 16 17:27:17 crc kubenswrapper[5120]: I0316 17:27:17.878651 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/c3e99380-03e2-498b-b872-6f5af9ff0e63-inventory\") pod \"c3e99380-03e2-498b-b872-6f5af9ff0e63\" (UID: \"c3e99380-03e2-498b-b872-6f5af9ff0e63\") " Mar 16 17:27:17 crc kubenswrapper[5120]: I0316 17:27:17.878981 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/c3e99380-03e2-498b-b872-6f5af9ff0e63-ssh-key-edpm-compute-no-nodes\") pod \"c3e99380-03e2-498b-b872-6f5af9ff0e63\" (UID: \"c3e99380-03e2-498b-b872-6f5af9ff0e63\") " Mar 16 17:27:17 crc kubenswrapper[5120]: I0316 17:27:17.883916 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3e99380-03e2-498b-b872-6f5af9ff0e63-kube-api-access-rpqgb" (OuterVolumeSpecName: "kube-api-access-rpqgb") pod "c3e99380-03e2-498b-b872-6f5af9ff0e63" (UID: "c3e99380-03e2-498b-b872-6f5af9ff0e63"). InnerVolumeSpecName "kube-api-access-rpqgb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:27:17 crc kubenswrapper[5120]: I0316 17:27:17.901801 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c3e99380-03e2-498b-b872-6f5af9ff0e63-ssh-key-edpm-compute-no-nodes" (OuterVolumeSpecName: "ssh-key-edpm-compute-no-nodes") pod "c3e99380-03e2-498b-b872-6f5af9ff0e63" (UID: "c3e99380-03e2-498b-b872-6f5af9ff0e63"). InnerVolumeSpecName "ssh-key-edpm-compute-no-nodes". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:27:17 crc kubenswrapper[5120]: I0316 17:27:17.903682 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c3e99380-03e2-498b-b872-6f5af9ff0e63-inventory" (OuterVolumeSpecName: "inventory") pod "c3e99380-03e2-498b-b872-6f5af9ff0e63" (UID: "c3e99380-03e2-498b-b872-6f5af9ff0e63"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:27:17 crc kubenswrapper[5120]: I0316 17:27:17.982077 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rpqgb\" (UniqueName: \"kubernetes.io/projected/c3e99380-03e2-498b-b872-6f5af9ff0e63-kube-api-access-rpqgb\") on node \"crc\" DevicePath \"\"" Mar 16 17:27:17 crc kubenswrapper[5120]: I0316 17:27:17.982116 5120 reconciler_common.go:299] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/c3e99380-03e2-498b-b872-6f5af9ff0e63-inventory\") on node \"crc\" DevicePath \"\"" Mar 16 17:27:17 crc kubenswrapper[5120]: I0316 17:27:17.982126 5120 reconciler_common.go:299] "Volume detached for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/c3e99380-03e2-498b-b872-6f5af9ff0e63-ssh-key-edpm-compute-no-nodes\") on node \"crc\" DevicePath \"\"" Mar 16 17:27:18 crc kubenswrapper[5120]: I0316 17:27:18.509383 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/configure-os-edpm-ansiblevars-deploy-edpm-compute-no-nodesgprqv" Mar 16 17:27:18 crc kubenswrapper[5120]: I0316 17:27:18.509437 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/configure-os-edpm-ansiblevars-deploy-edpm-compute-no-nodesgprqv" event={"ID":"c3e99380-03e2-498b-b872-6f5af9ff0e63","Type":"ContainerDied","Data":"3c3397734bf6dda9a4f08bd93d442cd892f990cc0e156ffbaff36e18764f08bf"} Mar 16 17:27:18 crc kubenswrapper[5120]: I0316 17:27:18.509480 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3c3397734bf6dda9a4f08bd93d442cd892f990cc0e156ffbaff36e18764f08bf" Mar 16 17:27:19 crc kubenswrapper[5120]: I0316 17:27:19.905266 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/configure-os-edpm-ansiblevars-deploy-update-edpm-compu-1e8nvnsw"] Mar 16 17:27:19 crc kubenswrapper[5120]: I0316 17:27:19.906440 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3e99380-03e2-498b-b872-6f5af9ff0e63" containerName="configure-os-edpm-ansiblevars-deploy-edpm-compute-no-nodes" Mar 16 17:27:19 crc kubenswrapper[5120]: I0316 17:27:19.906458 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3e99380-03e2-498b-b872-6f5af9ff0e63" containerName="configure-os-edpm-ansiblevars-deploy-edpm-compute-no-nodes" Mar 16 17:27:19 crc kubenswrapper[5120]: I0316 17:27:19.906639 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c3e99380-03e2-498b-b872-6f5af9ff0e63" containerName="configure-os-edpm-ansiblevars-deploy-edpm-compute-no-nodes" Mar 16 17:27:19 crc kubenswrapper[5120]: I0316 17:27:19.912274 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/configure-os-edpm-ansiblevars-deploy-update-edpm-compu-1e8nvnsw" Mar 16 17:27:19 crc kubenswrapper[5120]: I0316 17:27:19.915009 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-aee-default-env\"" Mar 16 17:27:19 crc kubenswrapper[5120]: I0316 17:27:19.915231 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"edpm-compute-no-nodes-dockercfg-znndh\"" Mar 16 17:27:19 crc kubenswrapper[5120]: I0316 17:27:19.915265 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplanenodeset-edpm-compute-no-nodes\"" Mar 16 17:27:19 crc kubenswrapper[5120]: I0316 17:27:19.915420 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplane-ansible-ssh-private-key-secret\"" Mar 16 17:27:19 crc kubenswrapper[5120]: I0316 17:27:19.927008 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/configure-os-edpm-ansiblevars-deploy-update-edpm-compu-1e8nvnsw"] Mar 16 17:27:20 crc kubenswrapper[5120]: I0316 17:27:20.026059 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/a7bcdb72-eeb9-4ccc-b2fb-327353144256-ssh-key-edpm-compute-no-nodes\") pod \"configure-os-edpm-ansiblevars-deploy-update-edpm-compu-1e8nvnsw\" (UID: \"a7bcdb72-eeb9-4ccc-b2fb-327353144256\") " pod="openstack-kuttl-tests/configure-os-edpm-ansiblevars-deploy-update-edpm-compu-1e8nvnsw" Mar 16 17:27:20 crc kubenswrapper[5120]: I0316 17:27:20.026159 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crm4l\" (UniqueName: \"kubernetes.io/projected/a7bcdb72-eeb9-4ccc-b2fb-327353144256-kube-api-access-crm4l\") pod \"configure-os-edpm-ansiblevars-deploy-update-edpm-compu-1e8nvnsw\" (UID: \"a7bcdb72-eeb9-4ccc-b2fb-327353144256\") " pod="openstack-kuttl-tests/configure-os-edpm-ansiblevars-deploy-update-edpm-compu-1e8nvnsw" Mar 16 17:27:20 crc kubenswrapper[5120]: I0316 17:27:20.026278 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/a7bcdb72-eeb9-4ccc-b2fb-327353144256-inventory\") pod \"configure-os-edpm-ansiblevars-deploy-update-edpm-compu-1e8nvnsw\" (UID: \"a7bcdb72-eeb9-4ccc-b2fb-327353144256\") " pod="openstack-kuttl-tests/configure-os-edpm-ansiblevars-deploy-update-edpm-compu-1e8nvnsw" Mar 16 17:27:20 crc kubenswrapper[5120]: I0316 17:27:20.128371 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/a7bcdb72-eeb9-4ccc-b2fb-327353144256-inventory\") pod \"configure-os-edpm-ansiblevars-deploy-update-edpm-compu-1e8nvnsw\" (UID: \"a7bcdb72-eeb9-4ccc-b2fb-327353144256\") " pod="openstack-kuttl-tests/configure-os-edpm-ansiblevars-deploy-update-edpm-compu-1e8nvnsw" Mar 16 17:27:20 crc kubenswrapper[5120]: I0316 17:27:20.129001 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/a7bcdb72-eeb9-4ccc-b2fb-327353144256-ssh-key-edpm-compute-no-nodes\") pod \"configure-os-edpm-ansiblevars-deploy-update-edpm-compu-1e8nvnsw\" (UID: \"a7bcdb72-eeb9-4ccc-b2fb-327353144256\") " pod="openstack-kuttl-tests/configure-os-edpm-ansiblevars-deploy-update-edpm-compu-1e8nvnsw" Mar 16 17:27:20 crc kubenswrapper[5120]: I0316 17:27:20.129030 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-crm4l\" (UniqueName: \"kubernetes.io/projected/a7bcdb72-eeb9-4ccc-b2fb-327353144256-kube-api-access-crm4l\") pod \"configure-os-edpm-ansiblevars-deploy-update-edpm-compu-1e8nvnsw\" (UID: \"a7bcdb72-eeb9-4ccc-b2fb-327353144256\") " pod="openstack-kuttl-tests/configure-os-edpm-ansiblevars-deploy-update-edpm-compu-1e8nvnsw" Mar 16 17:27:20 crc kubenswrapper[5120]: I0316 17:27:20.133671 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/a7bcdb72-eeb9-4ccc-b2fb-327353144256-inventory\") pod \"configure-os-edpm-ansiblevars-deploy-update-edpm-compu-1e8nvnsw\" (UID: \"a7bcdb72-eeb9-4ccc-b2fb-327353144256\") " pod="openstack-kuttl-tests/configure-os-edpm-ansiblevars-deploy-update-edpm-compu-1e8nvnsw" Mar 16 17:27:20 crc kubenswrapper[5120]: I0316 17:27:20.135479 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/a7bcdb72-eeb9-4ccc-b2fb-327353144256-ssh-key-edpm-compute-no-nodes\") pod \"configure-os-edpm-ansiblevars-deploy-update-edpm-compu-1e8nvnsw\" (UID: \"a7bcdb72-eeb9-4ccc-b2fb-327353144256\") " pod="openstack-kuttl-tests/configure-os-edpm-ansiblevars-deploy-update-edpm-compu-1e8nvnsw" Mar 16 17:27:20 crc kubenswrapper[5120]: I0316 17:27:20.151037 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-crm4l\" (UniqueName: \"kubernetes.io/projected/a7bcdb72-eeb9-4ccc-b2fb-327353144256-kube-api-access-crm4l\") pod \"configure-os-edpm-ansiblevars-deploy-update-edpm-compu-1e8nvnsw\" (UID: \"a7bcdb72-eeb9-4ccc-b2fb-327353144256\") " pod="openstack-kuttl-tests/configure-os-edpm-ansiblevars-deploy-update-edpm-compu-1e8nvnsw" Mar 16 17:27:20 crc kubenswrapper[5120]: I0316 17:27:20.229510 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/configure-os-edpm-ansiblevars-deploy-update-edpm-compu-1e8nvnsw" Mar 16 17:27:20 crc kubenswrapper[5120]: I0316 17:27:20.672598 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/configure-os-edpm-ansiblevars-deploy-update-edpm-compu-1e8nvnsw"] Mar 16 17:27:21 crc kubenswrapper[5120]: I0316 17:27:21.539464 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/configure-os-edpm-ansiblevars-deploy-update-edpm-compu-1e8nvnsw" event={"ID":"a7bcdb72-eeb9-4ccc-b2fb-327353144256","Type":"ContainerStarted","Data":"124699f72915f7db5d4b67db8ee70c528de4d860c54d51f11d17edcf3173932d"} Mar 16 17:27:21 crc kubenswrapper[5120]: I0316 17:27:21.539833 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/configure-os-edpm-ansiblevars-deploy-update-edpm-compu-1e8nvnsw" event={"ID":"a7bcdb72-eeb9-4ccc-b2fb-327353144256","Type":"ContainerStarted","Data":"02186a4e8189148a2f2aa435436b2851eab3558d39d256950eafd8eeb86e0d32"} Mar 16 17:27:21 crc kubenswrapper[5120]: I0316 17:27:21.556906 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/configure-os-edpm-ansiblevars-deploy-update-edpm-compu-1e8nvnsw" podStartSLOduration=2.1672335289999998 podStartE2EDuration="2.556888182s" podCreationTimestamp="2026-03-16 17:27:19 +0000 UTC" firstStartedPulling="2026-03-16 17:27:20.672367325 +0000 UTC m=+6942.826298982" lastFinishedPulling="2026-03-16 17:27:21.062021978 +0000 UTC m=+6943.215953635" observedRunningTime="2026-03-16 17:27:21.553260324 +0000 UTC m=+6943.707191991" watchObservedRunningTime="2026-03-16 17:27:21.556888182 +0000 UTC m=+6943.710819839" Mar 16 17:27:23 crc kubenswrapper[5120]: I0316 17:27:23.560041 5120 generic.go:358] "Generic (PLEG): container finished" podID="a7bcdb72-eeb9-4ccc-b2fb-327353144256" containerID="124699f72915f7db5d4b67db8ee70c528de4d860c54d51f11d17edcf3173932d" exitCode=0 Mar 16 17:27:23 crc kubenswrapper[5120]: I0316 17:27:23.560147 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/configure-os-edpm-ansiblevars-deploy-update-edpm-compu-1e8nvnsw" event={"ID":"a7bcdb72-eeb9-4ccc-b2fb-327353144256","Type":"ContainerDied","Data":"124699f72915f7db5d4b67db8ee70c528de4d860c54d51f11d17edcf3173932d"} Mar 16 17:27:24 crc kubenswrapper[5120]: I0316 17:27:24.955591 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/configure-os-edpm-ansiblevars-deploy-update-edpm-compu-1e8nvnsw" Mar 16 17:27:25 crc kubenswrapper[5120]: I0316 17:27:25.049298 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/a7bcdb72-eeb9-4ccc-b2fb-327353144256-inventory\") pod \"a7bcdb72-eeb9-4ccc-b2fb-327353144256\" (UID: \"a7bcdb72-eeb9-4ccc-b2fb-327353144256\") " Mar 16 17:27:25 crc kubenswrapper[5120]: I0316 17:27:25.049706 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/a7bcdb72-eeb9-4ccc-b2fb-327353144256-ssh-key-edpm-compute-no-nodes\") pod \"a7bcdb72-eeb9-4ccc-b2fb-327353144256\" (UID: \"a7bcdb72-eeb9-4ccc-b2fb-327353144256\") " Mar 16 17:27:25 crc kubenswrapper[5120]: I0316 17:27:25.049917 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-crm4l\" (UniqueName: \"kubernetes.io/projected/a7bcdb72-eeb9-4ccc-b2fb-327353144256-kube-api-access-crm4l\") pod \"a7bcdb72-eeb9-4ccc-b2fb-327353144256\" (UID: \"a7bcdb72-eeb9-4ccc-b2fb-327353144256\") " Mar 16 17:27:25 crc kubenswrapper[5120]: I0316 17:27:25.057962 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7bcdb72-eeb9-4ccc-b2fb-327353144256-kube-api-access-crm4l" (OuterVolumeSpecName: "kube-api-access-crm4l") pod "a7bcdb72-eeb9-4ccc-b2fb-327353144256" (UID: "a7bcdb72-eeb9-4ccc-b2fb-327353144256"). InnerVolumeSpecName "kube-api-access-crm4l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:27:25 crc kubenswrapper[5120]: I0316 17:27:25.072281 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7bcdb72-eeb9-4ccc-b2fb-327353144256-ssh-key-edpm-compute-no-nodes" (OuterVolumeSpecName: "ssh-key-edpm-compute-no-nodes") pod "a7bcdb72-eeb9-4ccc-b2fb-327353144256" (UID: "a7bcdb72-eeb9-4ccc-b2fb-327353144256"). InnerVolumeSpecName "ssh-key-edpm-compute-no-nodes". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:27:25 crc kubenswrapper[5120]: I0316 17:27:25.074196 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7bcdb72-eeb9-4ccc-b2fb-327353144256-inventory" (OuterVolumeSpecName: "inventory") pod "a7bcdb72-eeb9-4ccc-b2fb-327353144256" (UID: "a7bcdb72-eeb9-4ccc-b2fb-327353144256"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:27:25 crc kubenswrapper[5120]: I0316 17:27:25.152325 5120 reconciler_common.go:299] "Volume detached for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/a7bcdb72-eeb9-4ccc-b2fb-327353144256-ssh-key-edpm-compute-no-nodes\") on node \"crc\" DevicePath \"\"" Mar 16 17:27:25 crc kubenswrapper[5120]: I0316 17:27:25.152387 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-crm4l\" (UniqueName: \"kubernetes.io/projected/a7bcdb72-eeb9-4ccc-b2fb-327353144256-kube-api-access-crm4l\") on node \"crc\" DevicePath \"\"" Mar 16 17:27:25 crc kubenswrapper[5120]: I0316 17:27:25.152400 5120 reconciler_common.go:299] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/a7bcdb72-eeb9-4ccc-b2fb-327353144256-inventory\") on node \"crc\" DevicePath \"\"" Mar 16 17:27:25 crc kubenswrapper[5120]: I0316 17:27:25.581618 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/configure-os-edpm-ansiblevars-deploy-update-edpm-compu-1e8nvnsw" Mar 16 17:27:25 crc kubenswrapper[5120]: I0316 17:27:25.582017 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/configure-os-edpm-ansiblevars-deploy-update-edpm-compu-1e8nvnsw" event={"ID":"a7bcdb72-eeb9-4ccc-b2fb-327353144256","Type":"ContainerDied","Data":"02186a4e8189148a2f2aa435436b2851eab3558d39d256950eafd8eeb86e0d32"} Mar 16 17:27:25 crc kubenswrapper[5120]: I0316 17:27:25.582199 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="02186a4e8189148a2f2aa435436b2851eab3558d39d256950eafd8eeb86e0d32" Mar 16 17:27:25 crc kubenswrapper[5120]: I0316 17:27:25.999622 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/configure-os-edpm-ansiblevars-deploy-edpm-compute-no-nodesgprqv"] Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.013041 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/configure-os-edpm-ansiblevars-deploy-edpm-compute-no-nodesgprqv"] Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.031068 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/configure-os-edpm-ansiblevars-deploy-update-edpm-compu-1e8nvnsw"] Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.040987 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/configure-os-edpm-multinodeset-edpm-compute-no-nodes-xgs8r"] Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.049711 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-no-nodes-qmh89"] Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.062413 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/install-os-edpm-multinodeset-edpm-compute-no-nodes-d6rc9"] Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.069957 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/configure-os-edpm-multinodeset-edpm-compute-no-nodes-xgs8r"] Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.078455 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-beta-nodeset8hsbf"] Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.089132 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/configure-network-edpm-multinodeset-edpm-compute-no-nodes-frdcs"] Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.100054 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-edpm-multinodeset-edpm-compute-no-nodes-zzpvm"] Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.111208 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-no-nodes-qmh89"] Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.124624 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/configure-os-edpm-ansiblevars-deploy-update-edpm-compu-1e8nvnsw"] Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.133634 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes-d6shz"] Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.140282 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-sriov-edpm-multinodeset-edpm-compute-no-nodes-wvsb9"] Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.159332 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-no-nodes-88vsp"] Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.192338 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/run-os-edpm-multinodeset-edpm-compute-no-nodes-m59w4"] Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.209690 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-dhcp-edpm-multinodeset-edpm-compute-no-nodes-sshzg"] Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.220624 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-no-nodes-t9xl6"] Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.228601 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/install-os-edpm-multinodeset-edpm-compute-no-nodes-d6rc9"] Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.239816 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes-d6shz"] Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.248002 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovn-edpm-multinodeset-edpm-compute-no-nodes-zzpvm"] Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.255563 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-beta-nodeset8hsbf"] Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.261473 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/configure-network-edpm-multinodeset-edpm-compute-no-nodes-frdcs"] Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.262487 5120 scope.go:117] "RemoveContainer" containerID="c3ea549d6d5e5cdedccccba7cb20a2f30502b81c1c43be79640ae15ca5801b7f" Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.268696 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-no-nodes-88vsp"] Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.287018 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-no-nodes-t9xl6"] Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.288695 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-dhcp-edpm-multinodeset-edpm-compute-no-nodes-sshzg"] Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.299966 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/run-os-edpm-multinodeset-edpm-compute-no-nodes-m59w4"] Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.307235 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-gxxnc"] Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.307836 5120 scope.go:117] "RemoveContainer" containerID="9a54ba14b71c2fc488b749d44ac4d6ecd982f4238ee497bd391073897402179b" Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.315112 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-sriov-edpm-multinodeset-edpm-compute-no-nodes-wvsb9"] Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.322937 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/libvirt-edpm-multinodeset-edpm-compute-no-nodes-q65l5"] Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.337362 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-gxxnc"] Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.354937 5120 scope.go:117] "RemoveContainer" containerID="cc769c8dffa253fe6b6943576d02bf26f88a63b0dded4eb5d12bd81a26e26cf1" Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.357012 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/libvirt-edpm-multinodeset-edpm-compute-no-nodes-q65l5"] Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.375235 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/validate-network-edpm-multinodeset-edpm-compute-no-nodes-5hmfc"] Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.390294 5120 scope.go:117] "RemoveContainer" containerID="0d608f795a6adf89dbfa7fb0b75b222f76251b003c5a3540f63458a7e3428809" Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.390570 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-no-nodes-qpqzs"] Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.393346 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-edpm-compute-no-nodes-updated-ovn-cm-edpm-compute-no-nmvpqw"] Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.403630 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-no-nodes-cpc4h"] Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.412092 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/validate-network-edpm-multinodeset-edpm-compute-no-nodes-5hmfc"] Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.421802 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-no-nodes-qpqzs"] Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.422467 5120 scope.go:117] "RemoveContainer" containerID="41164c2cb0bd7012a94e2b17e005c1a1285a85dc1177e08ca1c6e95e09b7aa50" Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.430361 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-no-nodes-cpc4h"] Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.441933 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/custom-svc-edpm-compute-no-nodes-ovrd-edpm-compute-no-nodecphpx"] Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.451133 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/custom-svc-edpm-compute-no-nodes-ovrd-edpm-compute-no-nodecphpx"] Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.456433 5120 scope.go:117] "RemoveContainer" containerID="016eec3ea2dd14326073c498fbf8f9bdf42ab2cbb22e50251644f31d4868c757" Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.463870 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovn-edpm-compute-no-nodes-updated-ovn-cm-edpm-compute-no-nmvpqw"] Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.472156 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/bootstrap-edpm-compute-no-nodes-edpm-compute-no-nodes-xmd29"] Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.480117 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-5q7fr"] Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.487445 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/bootstrap-edpm-compute-no-nodes-edpm-compute-no-nodes-xmd29"] Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.490096 5120 scope.go:117] "RemoveContainer" containerID="654211a94a476c388666a35294705859ca787c25584b814d726d4de9744c6e45" Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.493480 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodh8x2b"] Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.498975 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-5q7fr"] Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.503871 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/install-os-edpm-compute-no-nodes-edpm-compute-no-nodes-nt8ng"] Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.509138 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-xw5ct"] Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.514236 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodh8x2b"] Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.517147 5120 scope.go:117] "RemoveContainer" containerID="fe8fe09bb3f95220a3c0e8f6f9eba99070627a0fb44bf07393d28608f7ad69d6" Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.519546 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/configure-os-edpm-compute-no-nodes-edpm-compute-no-nodes-hbs5p"] Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.525531 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/download-cache-edpm-compute-no-nodes-edpm-compute-no-nodesbgvvh"] Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.531896 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/validate-network-edpm-compute-no-nodes-edpm-compute-no-nodlc8q5"] Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.537792 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-edpm-compute-no-nodes-edpm-compute-no-nodes-c5xmq"] Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.543151 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/configure-network-edpm-compute-no-nodes-edpm-compute-no-noszw6z"] Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.546667 5120 scope.go:117] "RemoveContainer" containerID="07db26521289b3d93875f9081bdd3ffcf4064cf7283ad7537dd2edbe11a940ff" Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.552577 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/libvirt-edpm-compute-no-nodes-edpm-compute-no-nodes-vmmf2"] Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.565350 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-k7czl"] Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.576057 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/run-os-edpm-compute-no-nodes-edpm-compute-no-nodes-b728r"] Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.590650 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-xw5ct"] Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.597037 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/configure-network-edpm-compute-no-nodes-edpm-compute-no-noszw6z"] Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.604718 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/libvirt-edpm-compute-no-nodes-edpm-compute-no-nodes-vmmf2"] Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.608340 5120 scope.go:117] "RemoveContainer" containerID="a00234859febaca6fb5a5f488d176511a075ee9dd72dfb086601517dd0251b6b" Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.613632 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/install-os-edpm-compute-no-nodes-edpm-compute-no-nodes-nt8ng"] Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.624063 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/download-cache-edpm-compute-no-nodes-edpm-compute-no-nodesbgvvh"] Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.630651 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-edpm-compute-no-nodes-edpm-compute-no-nodes-c5xmq"] Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.638559 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/configure-os-edpm-compute-no-nodes-edpm-compute-no-nodes-hbs5p"] Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.648444 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-sriov-edpm-compute-no-nodes-edpm-compute-no-nodes-cn7fp"] Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.658569 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-dhcp-edpm-compute-no-nodes-edpm-compute-no-nodes-qttzd"] Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.681069 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0203b737-1e17-4e99-b05a-429ddeaf9200" path="/var/lib/kubelet/pods/0203b737-1e17-4e99-b05a-429ddeaf9200/volumes" Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.681590 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="09db059a-bb7c-4f11-807d-9d38a9c712c5" path="/var/lib/kubelet/pods/09db059a-bb7c-4f11-807d-9d38a9c712c5/volumes" Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.682156 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0e81067f-3b6a-4704-bd56-f972dccc60f9" path="/var/lib/kubelet/pods/0e81067f-3b6a-4704-bd56-f972dccc60f9/volumes" Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.682614 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="11279f5d-2620-4e41-a14a-be5d6418eb7a" path="/var/lib/kubelet/pods/11279f5d-2620-4e41-a14a-be5d6418eb7a/volumes" Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.683674 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1196e231-b422-4bef-90a7-7695e895e8f2" path="/var/lib/kubelet/pods/1196e231-b422-4bef-90a7-7695e895e8f2/volumes" Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.684164 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="24347f47-4e7b-40ab-a307-6f7226d3ee17" path="/var/lib/kubelet/pods/24347f47-4e7b-40ab-a307-6f7226d3ee17/volumes" Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.684643 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2d22c7e3-5552-4214-b5f2-079d55230a97" path="/var/lib/kubelet/pods/2d22c7e3-5552-4214-b5f2-079d55230a97/volumes" Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.685719 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="389a1bb6-2b6f-4ec6-a945-40b4901f4e18" path="/var/lib/kubelet/pods/389a1bb6-2b6f-4ec6-a945-40b4901f4e18/volumes" Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.686380 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4a804b00-52e3-498e-a77d-f9b6848ca9db" path="/var/lib/kubelet/pods/4a804b00-52e3-498e-a77d-f9b6848ca9db/volumes" Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.686888 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4e45ceb5-cbda-4146-a521-d764eb69bc05" path="/var/lib/kubelet/pods/4e45ceb5-cbda-4146-a521-d764eb69bc05/volumes" Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.687461 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="52a14b00-2ed7-41cd-9ea0-8a6e39445c09" path="/var/lib/kubelet/pods/52a14b00-2ed7-41cd-9ea0-8a6e39445c09/volumes" Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.688451 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="60592e04-37e3-4147-8382-fdd1d841ec27" path="/var/lib/kubelet/pods/60592e04-37e3-4147-8382-fdd1d841ec27/volumes" Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.688966 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="645dafe1-7f68-47aa-8e82-a3867fffc7c8" path="/var/lib/kubelet/pods/645dafe1-7f68-47aa-8e82-a3867fffc7c8/volumes" Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.689434 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="647bf253-ef47-40c8-a7ad-d0a014574d07" path="/var/lib/kubelet/pods/647bf253-ef47-40c8-a7ad-d0a014574d07/volumes" Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.690016 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a0c1a5e-04da-4494-a427-392ffed37244" path="/var/lib/kubelet/pods/6a0c1a5e-04da-4494-a427-392ffed37244/volumes" Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.691040 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7245ce74-f002-41c9-898b-ae0c6c86a954" path="/var/lib/kubelet/pods/7245ce74-f002-41c9-898b-ae0c6c86a954/volumes" Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.691549 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7798e8ae-c2d9-4748-8971-730d5a5d4d82" path="/var/lib/kubelet/pods/7798e8ae-c2d9-4748-8971-730d5a5d4d82/volumes" Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.692106 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8fded38e-5987-4d93-b8f5-ae718d6cb529" path="/var/lib/kubelet/pods/8fded38e-5987-4d93-b8f5-ae718d6cb529/volumes" Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.693068 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="932c47c4-942d-4749-a784-88e26d8b91a4" path="/var/lib/kubelet/pods/932c47c4-942d-4749-a784-88e26d8b91a4/volumes" Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.693548 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a7bcdb72-eeb9-4ccc-b2fb-327353144256" path="/var/lib/kubelet/pods/a7bcdb72-eeb9-4ccc-b2fb-327353144256/volumes" Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.694066 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a99fad38-e89e-490c-9443-4a0e67d529cf" path="/var/lib/kubelet/pods/a99fad38-e89e-490c-9443-4a0e67d529cf/volumes" Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.695089 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="accda91b-7614-4daf-a050-40cba5ced680" path="/var/lib/kubelet/pods/accda91b-7614-4daf-a050-40cba5ced680/volumes" Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.695667 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c3e99380-03e2-498b-b872-6f5af9ff0e63" path="/var/lib/kubelet/pods/c3e99380-03e2-498b-b872-6f5af9ff0e63/volumes" Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.696211 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cd812a73-e066-4163-824a-d1e33f7396f1" path="/var/lib/kubelet/pods/cd812a73-e066-4163-824a-d1e33f7396f1/volumes" Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.696683 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d1492ea4-a300-4dfa-b156-cca634cca18d" path="/var/lib/kubelet/pods/d1492ea4-a300-4dfa-b156-cca634cca18d/volumes" Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.697914 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d6c27e72-d717-46eb-90f1-7a5e8f15e996" path="/var/lib/kubelet/pods/d6c27e72-d717-46eb-90f1-7a5e8f15e996/volumes" Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.698453 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="de27760f-f52b-4895-a6ca-4a5e1845679d" path="/var/lib/kubelet/pods/de27760f-f52b-4895-a6ca-4a5e1845679d/volumes" Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.699069 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b" path="/var/lib/kubelet/pods/eeca88f7-db95-4cb5-a6b9-f8d4cb7a427b/volumes" Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.700053 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f9ab2ddd-74df-4e40-a811-1eecfa066a6f" path="/var/lib/kubelet/pods/f9ab2ddd-74df-4e40-a811-1eecfa066a6f/volumes" Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.700751 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd217e20-4685-4030-9826-ada1bc0b7650" path="/var/lib/kubelet/pods/fd217e20-4685-4030-9826-ada1bc0b7650/volumes" Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.701449 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ff74d56b-c496-41b7-8dbf-8a1ef33c2115" path="/var/lib/kubelet/pods/ff74d56b-c496-41b7-8dbf-8a1ef33c2115/volumes" Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.702828 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/validate-network-edpm-compute-no-nodes-edpm-compute-no-nodlc8q5"] Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.702871 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-k7czl"] Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.702896 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/run-os-edpm-compute-no-nodes-edpm-compute-no-nodes-b728r"] Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.702909 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-sriov-edpm-compute-no-nodes-edpm-compute-no-nodes-cn7fp"] Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.714696 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-dhcp-edpm-compute-no-nodes-edpm-compute-no-nodes-qttzd"] Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.726364 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-8c5974765-4rskz"] Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.727435 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7bcdb72-eeb9-4ccc-b2fb-327353144256" containerName="configure-os-edpm-ansiblevars-deploy-update-edpm-compu-1e8b4446" Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.727458 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7bcdb72-eeb9-4ccc-b2fb-327353144256" containerName="configure-os-edpm-ansiblevars-deploy-update-edpm-compu-1e8b4446" Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.727619 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="a7bcdb72-eeb9-4ccc-b2fb-327353144256" containerName="configure-os-edpm-ansiblevars-deploy-update-edpm-compu-1e8b4446" Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.781326 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-8c5974765-4rskz"] Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.781395 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-8c5974765-4rskz"] Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.781412 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-bd8mf"] Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.781482 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-8c5974765-4rskz" Mar 16 17:27:26 crc kubenswrapper[5120]: E0316 17:27:26.782407 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[config dnsmasq-svc edpm-compute-no-nodes kube-api-access-xv75g], unattached volumes=[], failed to process volumes=[config dnsmasq-svc edpm-compute-no-nodes kube-api-access-xv75g]: context canceled" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-8c5974765-4rskz" podUID="3ae1aa6c-8134-472e-8200-8fd726d3834c" Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.792273 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-bd8mf"] Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.792414 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-bd8mf" Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.905196 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xv75g\" (UniqueName: \"kubernetes.io/projected/3ae1aa6c-8134-472e-8200-8fd726d3834c-kube-api-access-xv75g\") pod \"dnsmasq-dnsmasq-8c5974765-4rskz\" (UID: \"3ae1aa6c-8134-472e-8200-8fd726d3834c\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-8c5974765-4rskz" Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.905263 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/3ae1aa6c-8134-472e-8200-8fd726d3834c-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-8c5974765-4rskz\" (UID: \"3ae1aa6c-8134-472e-8200-8fd726d3834c\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-8c5974765-4rskz" Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.905329 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/configmap/3ae1aa6c-8134-472e-8200-8fd726d3834c-edpm-compute-no-nodes\") pod \"dnsmasq-dnsmasq-8c5974765-4rskz\" (UID: \"3ae1aa6c-8134-472e-8200-8fd726d3834c\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-8c5974765-4rskz" Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.905445 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/2ed306f9-a5ea-4132-bc7b-8ed55abb3f95-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-79dcd846c5-bd8mf\" (UID: \"2ed306f9-a5ea-4132-bc7b-8ed55abb3f95\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-bd8mf" Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.905503 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2ed306f9-a5ea-4132-bc7b-8ed55abb3f95-config\") pod \"dnsmasq-dnsmasq-79dcd846c5-bd8mf\" (UID: \"2ed306f9-a5ea-4132-bc7b-8ed55abb3f95\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-bd8mf" Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.905619 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3ae1aa6c-8134-472e-8200-8fd726d3834c-config\") pod \"dnsmasq-dnsmasq-8c5974765-4rskz\" (UID: \"3ae1aa6c-8134-472e-8200-8fd726d3834c\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-8c5974765-4rskz" Mar 16 17:27:26 crc kubenswrapper[5120]: I0316 17:27:26.905813 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5sn2\" (UniqueName: \"kubernetes.io/projected/2ed306f9-a5ea-4132-bc7b-8ed55abb3f95-kube-api-access-s5sn2\") pod \"dnsmasq-dnsmasq-79dcd846c5-bd8mf\" (UID: \"2ed306f9-a5ea-4132-bc7b-8ed55abb3f95\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-bd8mf" Mar 16 17:27:27 crc kubenswrapper[5120]: I0316 17:27:27.008748 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xv75g\" (UniqueName: \"kubernetes.io/projected/3ae1aa6c-8134-472e-8200-8fd726d3834c-kube-api-access-xv75g\") pod \"dnsmasq-dnsmasq-8c5974765-4rskz\" (UID: \"3ae1aa6c-8134-472e-8200-8fd726d3834c\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-8c5974765-4rskz" Mar 16 17:27:27 crc kubenswrapper[5120]: I0316 17:27:27.008825 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/3ae1aa6c-8134-472e-8200-8fd726d3834c-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-8c5974765-4rskz\" (UID: \"3ae1aa6c-8134-472e-8200-8fd726d3834c\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-8c5974765-4rskz" Mar 16 17:27:27 crc kubenswrapper[5120]: I0316 17:27:27.008892 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/configmap/3ae1aa6c-8134-472e-8200-8fd726d3834c-edpm-compute-no-nodes\") pod \"dnsmasq-dnsmasq-8c5974765-4rskz\" (UID: \"3ae1aa6c-8134-472e-8200-8fd726d3834c\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-8c5974765-4rskz" Mar 16 17:27:27 crc kubenswrapper[5120]: I0316 17:27:27.009149 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/2ed306f9-a5ea-4132-bc7b-8ed55abb3f95-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-79dcd846c5-bd8mf\" (UID: \"2ed306f9-a5ea-4132-bc7b-8ed55abb3f95\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-bd8mf" Mar 16 17:27:27 crc kubenswrapper[5120]: E0316 17:27:27.009201 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/edpm-compute-no-nodes: configmap "edpm-compute-no-nodes" not found Mar 16 17:27:27 crc kubenswrapper[5120]: E0316 17:27:27.009254 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3ae1aa6c-8134-472e-8200-8fd726d3834c-edpm-compute-no-nodes podName:3ae1aa6c-8134-472e-8200-8fd726d3834c nodeName:}" failed. No retries permitted until 2026-03-16 17:27:27.509236332 +0000 UTC m=+6949.663167989 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "edpm-compute-no-nodes" (UniqueName: "kubernetes.io/configmap/3ae1aa6c-8134-472e-8200-8fd726d3834c-edpm-compute-no-nodes") pod "dnsmasq-dnsmasq-8c5974765-4rskz" (UID: "3ae1aa6c-8134-472e-8200-8fd726d3834c") : configmap "edpm-compute-no-nodes" not found Mar 16 17:27:27 crc kubenswrapper[5120]: I0316 17:27:27.009288 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2ed306f9-a5ea-4132-bc7b-8ed55abb3f95-config\") pod \"dnsmasq-dnsmasq-79dcd846c5-bd8mf\" (UID: \"2ed306f9-a5ea-4132-bc7b-8ed55abb3f95\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-bd8mf" Mar 16 17:27:27 crc kubenswrapper[5120]: I0316 17:27:27.009364 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3ae1aa6c-8134-472e-8200-8fd726d3834c-config\") pod \"dnsmasq-dnsmasq-8c5974765-4rskz\" (UID: \"3ae1aa6c-8134-472e-8200-8fd726d3834c\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-8c5974765-4rskz" Mar 16 17:27:27 crc kubenswrapper[5120]: I0316 17:27:27.009444 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s5sn2\" (UniqueName: \"kubernetes.io/projected/2ed306f9-a5ea-4132-bc7b-8ed55abb3f95-kube-api-access-s5sn2\") pod \"dnsmasq-dnsmasq-79dcd846c5-bd8mf\" (UID: \"2ed306f9-a5ea-4132-bc7b-8ed55abb3f95\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-bd8mf" Mar 16 17:27:27 crc kubenswrapper[5120]: I0316 17:27:27.010052 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/3ae1aa6c-8134-472e-8200-8fd726d3834c-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-8c5974765-4rskz\" (UID: \"3ae1aa6c-8134-472e-8200-8fd726d3834c\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-8c5974765-4rskz" Mar 16 17:27:27 crc kubenswrapper[5120]: I0316 17:27:27.010280 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3ae1aa6c-8134-472e-8200-8fd726d3834c-config\") pod \"dnsmasq-dnsmasq-8c5974765-4rskz\" (UID: \"3ae1aa6c-8134-472e-8200-8fd726d3834c\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-8c5974765-4rskz" Mar 16 17:27:27 crc kubenswrapper[5120]: I0316 17:27:27.010376 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2ed306f9-a5ea-4132-bc7b-8ed55abb3f95-config\") pod \"dnsmasq-dnsmasq-79dcd846c5-bd8mf\" (UID: \"2ed306f9-a5ea-4132-bc7b-8ed55abb3f95\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-bd8mf" Mar 16 17:27:27 crc kubenswrapper[5120]: I0316 17:27:27.010805 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/2ed306f9-a5ea-4132-bc7b-8ed55abb3f95-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-79dcd846c5-bd8mf\" (UID: \"2ed306f9-a5ea-4132-bc7b-8ed55abb3f95\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-bd8mf" Mar 16 17:27:27 crc kubenswrapper[5120]: I0316 17:27:27.027504 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xv75g\" (UniqueName: \"kubernetes.io/projected/3ae1aa6c-8134-472e-8200-8fd726d3834c-kube-api-access-xv75g\") pod \"dnsmasq-dnsmasq-8c5974765-4rskz\" (UID: \"3ae1aa6c-8134-472e-8200-8fd726d3834c\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-8c5974765-4rskz" Mar 16 17:27:27 crc kubenswrapper[5120]: I0316 17:27:27.027595 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5sn2\" (UniqueName: \"kubernetes.io/projected/2ed306f9-a5ea-4132-bc7b-8ed55abb3f95-kube-api-access-s5sn2\") pod \"dnsmasq-dnsmasq-79dcd846c5-bd8mf\" (UID: \"2ed306f9-a5ea-4132-bc7b-8ed55abb3f95\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-bd8mf" Mar 16 17:27:27 crc kubenswrapper[5120]: I0316 17:27:27.118091 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-bd8mf" Mar 16 17:27:27 crc kubenswrapper[5120]: I0316 17:27:27.520696 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/configmap/3ae1aa6c-8134-472e-8200-8fd726d3834c-edpm-compute-no-nodes\") pod \"dnsmasq-dnsmasq-8c5974765-4rskz\" (UID: \"3ae1aa6c-8134-472e-8200-8fd726d3834c\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-8c5974765-4rskz" Mar 16 17:27:27 crc kubenswrapper[5120]: E0316 17:27:27.520879 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/edpm-compute-no-nodes: configmap "edpm-compute-no-nodes" not found Mar 16 17:27:27 crc kubenswrapper[5120]: E0316 17:27:27.521223 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3ae1aa6c-8134-472e-8200-8fd726d3834c-edpm-compute-no-nodes podName:3ae1aa6c-8134-472e-8200-8fd726d3834c nodeName:}" failed. No retries permitted until 2026-03-16 17:27:28.521199792 +0000 UTC m=+6950.675131449 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "edpm-compute-no-nodes" (UniqueName: "kubernetes.io/configmap/3ae1aa6c-8134-472e-8200-8fd726d3834c-edpm-compute-no-nodes") pod "dnsmasq-dnsmasq-8c5974765-4rskz" (UID: "3ae1aa6c-8134-472e-8200-8fd726d3834c") : configmap "edpm-compute-no-nodes" not found Mar 16 17:27:27 crc kubenswrapper[5120]: I0316 17:27:27.591730 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-bd8mf"] Mar 16 17:27:27 crc kubenswrapper[5120]: I0316 17:27:27.645127 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-bd8mf" event={"ID":"2ed306f9-a5ea-4132-bc7b-8ed55abb3f95","Type":"ContainerStarted","Data":"13e8d0a743c61f8430f2fd2bc58c5250b431bf980c045dbc1c21a3f83307019f"} Mar 16 17:27:27 crc kubenswrapper[5120]: I0316 17:27:27.645255 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-8c5974765-4rskz" Mar 16 17:27:27 crc kubenswrapper[5120]: I0316 17:27:27.656038 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-8c5974765-4rskz" Mar 16 17:27:27 crc kubenswrapper[5120]: I0316 17:27:27.732278 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/3ae1aa6c-8134-472e-8200-8fd726d3834c-dnsmasq-svc\") pod \"3ae1aa6c-8134-472e-8200-8fd726d3834c\" (UID: \"3ae1aa6c-8134-472e-8200-8fd726d3834c\") " Mar 16 17:27:27 crc kubenswrapper[5120]: I0316 17:27:27.732334 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3ae1aa6c-8134-472e-8200-8fd726d3834c-config\") pod \"3ae1aa6c-8134-472e-8200-8fd726d3834c\" (UID: \"3ae1aa6c-8134-472e-8200-8fd726d3834c\") " Mar 16 17:27:27 crc kubenswrapper[5120]: I0316 17:27:27.732477 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xv75g\" (UniqueName: \"kubernetes.io/projected/3ae1aa6c-8134-472e-8200-8fd726d3834c-kube-api-access-xv75g\") pod \"3ae1aa6c-8134-472e-8200-8fd726d3834c\" (UID: \"3ae1aa6c-8134-472e-8200-8fd726d3834c\") " Mar 16 17:27:27 crc kubenswrapper[5120]: I0316 17:27:27.732835 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3ae1aa6c-8134-472e-8200-8fd726d3834c-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "3ae1aa6c-8134-472e-8200-8fd726d3834c" (UID: "3ae1aa6c-8134-472e-8200-8fd726d3834c"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:27:27 crc kubenswrapper[5120]: I0316 17:27:27.732852 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3ae1aa6c-8134-472e-8200-8fd726d3834c-config" (OuterVolumeSpecName: "config") pod "3ae1aa6c-8134-472e-8200-8fd726d3834c" (UID: "3ae1aa6c-8134-472e-8200-8fd726d3834c"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:27:27 crc kubenswrapper[5120]: I0316 17:27:27.733233 5120 reconciler_common.go:299] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/3ae1aa6c-8134-472e-8200-8fd726d3834c-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Mar 16 17:27:27 crc kubenswrapper[5120]: I0316 17:27:27.733249 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3ae1aa6c-8134-472e-8200-8fd726d3834c-config\") on node \"crc\" DevicePath \"\"" Mar 16 17:27:27 crc kubenswrapper[5120]: I0316 17:27:27.741441 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ae1aa6c-8134-472e-8200-8fd726d3834c-kube-api-access-xv75g" (OuterVolumeSpecName: "kube-api-access-xv75g") pod "3ae1aa6c-8134-472e-8200-8fd726d3834c" (UID: "3ae1aa6c-8134-472e-8200-8fd726d3834c"). InnerVolumeSpecName "kube-api-access-xv75g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:27:27 crc kubenswrapper[5120]: I0316 17:27:27.835529 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xv75g\" (UniqueName: \"kubernetes.io/projected/3ae1aa6c-8134-472e-8200-8fd726d3834c-kube-api-access-xv75g\") on node \"crc\" DevicePath \"\"" Mar 16 17:27:28 crc kubenswrapper[5120]: I0316 17:27:28.548340 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/configmap/3ae1aa6c-8134-472e-8200-8fd726d3834c-edpm-compute-no-nodes\") pod \"dnsmasq-dnsmasq-8c5974765-4rskz\" (UID: \"3ae1aa6c-8134-472e-8200-8fd726d3834c\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-8c5974765-4rskz" Mar 16 17:27:28 crc kubenswrapper[5120]: E0316 17:27:28.548668 5120 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/edpm-compute-no-nodes: configmap "edpm-compute-no-nodes" not found Mar 16 17:27:28 crc kubenswrapper[5120]: E0316 17:27:28.548988 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3ae1aa6c-8134-472e-8200-8fd726d3834c-edpm-compute-no-nodes podName:3ae1aa6c-8134-472e-8200-8fd726d3834c nodeName:}" failed. No retries permitted until 2026-03-16 17:27:30.548971939 +0000 UTC m=+6952.702903596 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "edpm-compute-no-nodes" (UniqueName: "kubernetes.io/configmap/3ae1aa6c-8134-472e-8200-8fd726d3834c-edpm-compute-no-nodes") pod "dnsmasq-dnsmasq-8c5974765-4rskz" (UID: "3ae1aa6c-8134-472e-8200-8fd726d3834c") : configmap "edpm-compute-no-nodes" not found Mar 16 17:27:28 crc kubenswrapper[5120]: I0316 17:27:28.657936 5120 generic.go:358] "Generic (PLEG): container finished" podID="2ed306f9-a5ea-4132-bc7b-8ed55abb3f95" containerID="75ef2b6d05bab37018cde4ef6e26495a1f86fdd177369d63a6bd1686a8c707df" exitCode=0 Mar 16 17:27:28 crc kubenswrapper[5120]: I0316 17:27:28.658070 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-bd8mf" event={"ID":"2ed306f9-a5ea-4132-bc7b-8ed55abb3f95","Type":"ContainerDied","Data":"75ef2b6d05bab37018cde4ef6e26495a1f86fdd177369d63a6bd1686a8c707df"} Mar 16 17:27:28 crc kubenswrapper[5120]: I0316 17:27:28.658196 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-8c5974765-4rskz" Mar 16 17:27:28 crc kubenswrapper[5120]: I0316 17:27:28.695415 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7d38318f-f378-43a0-a69b-44765bf3af17" path="/var/lib/kubelet/pods/7d38318f-f378-43a0-a69b-44765bf3af17/volumes" Mar 16 17:27:28 crc kubenswrapper[5120]: I0316 17:27:28.696213 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a150700f-69e3-456a-8c8c-00d5fa0c798a" path="/var/lib/kubelet/pods/a150700f-69e3-456a-8c8c-00d5fa0c798a/volumes" Mar 16 17:27:28 crc kubenswrapper[5120]: I0316 17:27:28.696909 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d28180ab-20c9-43ac-933a-892ab0774703" path="/var/lib/kubelet/pods/d28180ab-20c9-43ac-933a-892ab0774703/volumes" Mar 16 17:27:28 crc kubenswrapper[5120]: I0316 17:27:28.698438 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f2c615aa-8c70-4017-83ee-12c091491d64" path="/var/lib/kubelet/pods/f2c615aa-8c70-4017-83ee-12c091491d64/volumes" Mar 16 17:27:28 crc kubenswrapper[5120]: I0316 17:27:28.699656 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc24b408-f9c2-4896-b74a-1069fa20c8a2" path="/var/lib/kubelet/pods/fc24b408-f9c2-4896-b74a-1069fa20c8a2/volumes" Mar 16 17:27:28 crc kubenswrapper[5120]: I0316 17:27:28.745034 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-8c5974765-4rskz"] Mar 16 17:27:28 crc kubenswrapper[5120]: I0316 17:27:28.750950 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-8c5974765-4rskz"] Mar 16 17:27:28 crc kubenswrapper[5120]: I0316 17:27:28.855452 5120 reconciler_common.go:299] "Volume detached for volume \"edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/configmap/3ae1aa6c-8134-472e-8200-8fd726d3834c-edpm-compute-no-nodes\") on node \"crc\" DevicePath \"\"" Mar 16 17:27:29 crc kubenswrapper[5120]: I0316 17:27:29.669511 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-bd8mf" event={"ID":"2ed306f9-a5ea-4132-bc7b-8ed55abb3f95","Type":"ContainerStarted","Data":"608183e23452d3d3017d828071ec566890c1454081fb0d761f6f91fcd660ea57"} Mar 16 17:27:29 crc kubenswrapper[5120]: I0316 17:27:29.669918 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-bd8mf" Mar 16 17:27:29 crc kubenswrapper[5120]: I0316 17:27:29.685867 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-bd8mf" podStartSLOduration=3.685844133 podStartE2EDuration="3.685844133s" podCreationTimestamp="2026-03-16 17:27:26 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:27:29.682266705 +0000 UTC m=+6951.836198402" watchObservedRunningTime="2026-03-16 17:27:29.685844133 +0000 UTC m=+6951.839775790" Mar 16 17:27:30 crc kubenswrapper[5120]: I0316 17:27:30.673734 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3ae1aa6c-8134-472e-8200-8fd726d3834c" path="/var/lib/kubelet/pods/3ae1aa6c-8134-472e-8200-8fd726d3834c/volumes" Mar 16 17:27:33 crc kubenswrapper[5120]: I0316 17:27:33.645116 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["crc-storage/crc-storage-crc-h7rgz"] Mar 16 17:27:33 crc kubenswrapper[5120]: I0316 17:27:33.650082 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["crc-storage/crc-storage-crc-h7rgz"] Mar 16 17:27:33 crc kubenswrapper[5120]: I0316 17:27:33.785453 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["crc-storage/crc-storage-crc-bwdn7"] Mar 16 17:27:33 crc kubenswrapper[5120]: I0316 17:27:33.795747 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-bwdn7"] Mar 16 17:27:33 crc kubenswrapper[5120]: I0316 17:27:33.795945 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-bwdn7" Mar 16 17:27:33 crc kubenswrapper[5120]: I0316 17:27:33.798737 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"openshift-service-ca.crt\"" Mar 16 17:27:33 crc kubenswrapper[5120]: I0316 17:27:33.799899 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"kube-root-ca.crt\"" Mar 16 17:27:33 crc kubenswrapper[5120]: I0316 17:27:33.800122 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"crc-storage\"/\"crc-storage-dockercfg-s2tht\"" Mar 16 17:27:33 crc kubenswrapper[5120]: I0316 17:27:33.800219 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"crc-storage\"" Mar 16 17:27:33 crc kubenswrapper[5120]: I0316 17:27:33.859611 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/6f35d54a-7f49-4a89-8906-95f67f952fb9-crc-storage\") pod \"crc-storage-crc-bwdn7\" (UID: \"6f35d54a-7f49-4a89-8906-95f67f952fb9\") " pod="crc-storage/crc-storage-crc-bwdn7" Mar 16 17:27:33 crc kubenswrapper[5120]: I0316 17:27:33.859749 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/6f35d54a-7f49-4a89-8906-95f67f952fb9-node-mnt\") pod \"crc-storage-crc-bwdn7\" (UID: \"6f35d54a-7f49-4a89-8906-95f67f952fb9\") " pod="crc-storage/crc-storage-crc-bwdn7" Mar 16 17:27:33 crc kubenswrapper[5120]: I0316 17:27:33.859975 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldnw8\" (UniqueName: \"kubernetes.io/projected/6f35d54a-7f49-4a89-8906-95f67f952fb9-kube-api-access-ldnw8\") pod \"crc-storage-crc-bwdn7\" (UID: \"6f35d54a-7f49-4a89-8906-95f67f952fb9\") " pod="crc-storage/crc-storage-crc-bwdn7" Mar 16 17:27:33 crc kubenswrapper[5120]: I0316 17:27:33.963092 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/6f35d54a-7f49-4a89-8906-95f67f952fb9-crc-storage\") pod \"crc-storage-crc-bwdn7\" (UID: \"6f35d54a-7f49-4a89-8906-95f67f952fb9\") " pod="crc-storage/crc-storage-crc-bwdn7" Mar 16 17:27:33 crc kubenswrapper[5120]: I0316 17:27:33.963160 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/6f35d54a-7f49-4a89-8906-95f67f952fb9-node-mnt\") pod \"crc-storage-crc-bwdn7\" (UID: \"6f35d54a-7f49-4a89-8906-95f67f952fb9\") " pod="crc-storage/crc-storage-crc-bwdn7" Mar 16 17:27:33 crc kubenswrapper[5120]: I0316 17:27:33.963309 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ldnw8\" (UniqueName: \"kubernetes.io/projected/6f35d54a-7f49-4a89-8906-95f67f952fb9-kube-api-access-ldnw8\") pod \"crc-storage-crc-bwdn7\" (UID: \"6f35d54a-7f49-4a89-8906-95f67f952fb9\") " pod="crc-storage/crc-storage-crc-bwdn7" Mar 16 17:27:33 crc kubenswrapper[5120]: I0316 17:27:33.963614 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/6f35d54a-7f49-4a89-8906-95f67f952fb9-node-mnt\") pod \"crc-storage-crc-bwdn7\" (UID: \"6f35d54a-7f49-4a89-8906-95f67f952fb9\") " pod="crc-storage/crc-storage-crc-bwdn7" Mar 16 17:27:33 crc kubenswrapper[5120]: I0316 17:27:33.964100 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/6f35d54a-7f49-4a89-8906-95f67f952fb9-crc-storage\") pod \"crc-storage-crc-bwdn7\" (UID: \"6f35d54a-7f49-4a89-8906-95f67f952fb9\") " pod="crc-storage/crc-storage-crc-bwdn7" Mar 16 17:27:33 crc kubenswrapper[5120]: I0316 17:27:33.985076 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldnw8\" (UniqueName: \"kubernetes.io/projected/6f35d54a-7f49-4a89-8906-95f67f952fb9-kube-api-access-ldnw8\") pod \"crc-storage-crc-bwdn7\" (UID: \"6f35d54a-7f49-4a89-8906-95f67f952fb9\") " pod="crc-storage/crc-storage-crc-bwdn7" Mar 16 17:27:34 crc kubenswrapper[5120]: I0316 17:27:34.125741 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-bwdn7" Mar 16 17:27:34 crc kubenswrapper[5120]: I0316 17:27:34.532129 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-bwdn7"] Mar 16 17:27:34 crc kubenswrapper[5120]: I0316 17:27:34.674563 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="11090ef3-d160-43c6-8af6-ab2598c381ae" path="/var/lib/kubelet/pods/11090ef3-d160-43c6-8af6-ab2598c381ae/volumes" Mar 16 17:27:34 crc kubenswrapper[5120]: I0316 17:27:34.717531 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-bwdn7" event={"ID":"6f35d54a-7f49-4a89-8906-95f67f952fb9","Type":"ContainerStarted","Data":"165a44f460a60f0635383f16a735ca408c1f021c2fa88b2adf0e7d8e84cf879c"} Mar 16 17:27:35 crc kubenswrapper[5120]: I0316 17:27:35.679353 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-bd8mf" Mar 16 17:27:35 crc kubenswrapper[5120]: I0316 17:27:35.743878 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-795f46b747-6fgjf"] Mar 16 17:27:35 crc kubenswrapper[5120]: I0316 17:27:35.744195 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-795f46b747-6fgjf" podUID="4f0674e4-b3ab-4aa4-bf48-271225fb7a23" containerName="dnsmasq-dns" containerID="cri-o://b431b49b7bf133c94875a49acd84a554f1ce5bd8676605e81b26c796815de4fe" gracePeriod=10 Mar 16 17:27:35 crc kubenswrapper[5120]: I0316 17:27:35.766600 5120 generic.go:358] "Generic (PLEG): container finished" podID="6f35d54a-7f49-4a89-8906-95f67f952fb9" containerID="c754a4af15dc7586abc6c7ed6caefdbd2f11739749f4404fba75832cfca01d4f" exitCode=0 Mar 16 17:27:35 crc kubenswrapper[5120]: I0316 17:27:35.766730 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-bwdn7" event={"ID":"6f35d54a-7f49-4a89-8906-95f67f952fb9","Type":"ContainerDied","Data":"c754a4af15dc7586abc6c7ed6caefdbd2f11739749f4404fba75832cfca01d4f"} Mar 16 17:27:36 crc kubenswrapper[5120]: I0316 17:27:36.169994 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-795f46b747-6fgjf" Mar 16 17:27:36 crc kubenswrapper[5120]: I0316 17:27:36.310019 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8gnmh\" (UniqueName: \"kubernetes.io/projected/4f0674e4-b3ab-4aa4-bf48-271225fb7a23-kube-api-access-8gnmh\") pod \"4f0674e4-b3ab-4aa4-bf48-271225fb7a23\" (UID: \"4f0674e4-b3ab-4aa4-bf48-271225fb7a23\") " Mar 16 17:27:36 crc kubenswrapper[5120]: I0316 17:27:36.310104 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/4f0674e4-b3ab-4aa4-bf48-271225fb7a23-dnsmasq-svc\") pod \"4f0674e4-b3ab-4aa4-bf48-271225fb7a23\" (UID: \"4f0674e4-b3ab-4aa4-bf48-271225fb7a23\") " Mar 16 17:27:36 crc kubenswrapper[5120]: I0316 17:27:36.310165 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"edpm-compute-beta-nodeset\" (UniqueName: \"kubernetes.io/configmap/4f0674e4-b3ab-4aa4-bf48-271225fb7a23-edpm-compute-beta-nodeset\") pod \"4f0674e4-b3ab-4aa4-bf48-271225fb7a23\" (UID: \"4f0674e4-b3ab-4aa4-bf48-271225fb7a23\") " Mar 16 17:27:36 crc kubenswrapper[5120]: I0316 17:27:36.310341 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4f0674e4-b3ab-4aa4-bf48-271225fb7a23-config\") pod \"4f0674e4-b3ab-4aa4-bf48-271225fb7a23\" (UID: \"4f0674e4-b3ab-4aa4-bf48-271225fb7a23\") " Mar 16 17:27:36 crc kubenswrapper[5120]: I0316 17:27:36.310529 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/configmap/4f0674e4-b3ab-4aa4-bf48-271225fb7a23-edpm-compute-no-nodes\") pod \"4f0674e4-b3ab-4aa4-bf48-271225fb7a23\" (UID: \"4f0674e4-b3ab-4aa4-bf48-271225fb7a23\") " Mar 16 17:27:36 crc kubenswrapper[5120]: I0316 17:27:36.315482 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f0674e4-b3ab-4aa4-bf48-271225fb7a23-kube-api-access-8gnmh" (OuterVolumeSpecName: "kube-api-access-8gnmh") pod "4f0674e4-b3ab-4aa4-bf48-271225fb7a23" (UID: "4f0674e4-b3ab-4aa4-bf48-271225fb7a23"). InnerVolumeSpecName "kube-api-access-8gnmh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:27:36 crc kubenswrapper[5120]: I0316 17:27:36.344606 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f0674e4-b3ab-4aa4-bf48-271225fb7a23-edpm-compute-beta-nodeset" (OuterVolumeSpecName: "edpm-compute-beta-nodeset") pod "4f0674e4-b3ab-4aa4-bf48-271225fb7a23" (UID: "4f0674e4-b3ab-4aa4-bf48-271225fb7a23"). InnerVolumeSpecName "edpm-compute-beta-nodeset". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:27:36 crc kubenswrapper[5120]: I0316 17:27:36.346494 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f0674e4-b3ab-4aa4-bf48-271225fb7a23-config" (OuterVolumeSpecName: "config") pod "4f0674e4-b3ab-4aa4-bf48-271225fb7a23" (UID: "4f0674e4-b3ab-4aa4-bf48-271225fb7a23"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:27:36 crc kubenswrapper[5120]: I0316 17:27:36.348052 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f0674e4-b3ab-4aa4-bf48-271225fb7a23-edpm-compute-no-nodes" (OuterVolumeSpecName: "edpm-compute-no-nodes") pod "4f0674e4-b3ab-4aa4-bf48-271225fb7a23" (UID: "4f0674e4-b3ab-4aa4-bf48-271225fb7a23"). InnerVolumeSpecName "edpm-compute-no-nodes". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:27:36 crc kubenswrapper[5120]: I0316 17:27:36.348358 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f0674e4-b3ab-4aa4-bf48-271225fb7a23-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "4f0674e4-b3ab-4aa4-bf48-271225fb7a23" (UID: "4f0674e4-b3ab-4aa4-bf48-271225fb7a23"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:27:36 crc kubenswrapper[5120]: I0316 17:27:36.413399 5120 reconciler_common.go:299] "Volume detached for volume \"edpm-compute-beta-nodeset\" (UniqueName: \"kubernetes.io/configmap/4f0674e4-b3ab-4aa4-bf48-271225fb7a23-edpm-compute-beta-nodeset\") on node \"crc\" DevicePath \"\"" Mar 16 17:27:36 crc kubenswrapper[5120]: I0316 17:27:36.413449 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4f0674e4-b3ab-4aa4-bf48-271225fb7a23-config\") on node \"crc\" DevicePath \"\"" Mar 16 17:27:36 crc kubenswrapper[5120]: I0316 17:27:36.413459 5120 reconciler_common.go:299] "Volume detached for volume \"edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/configmap/4f0674e4-b3ab-4aa4-bf48-271225fb7a23-edpm-compute-no-nodes\") on node \"crc\" DevicePath \"\"" Mar 16 17:27:36 crc kubenswrapper[5120]: I0316 17:27:36.413468 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8gnmh\" (UniqueName: \"kubernetes.io/projected/4f0674e4-b3ab-4aa4-bf48-271225fb7a23-kube-api-access-8gnmh\") on node \"crc\" DevicePath \"\"" Mar 16 17:27:36 crc kubenswrapper[5120]: I0316 17:27:36.413479 5120 reconciler_common.go:299] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/4f0674e4-b3ab-4aa4-bf48-271225fb7a23-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Mar 16 17:27:36 crc kubenswrapper[5120]: I0316 17:27:36.778138 5120 generic.go:358] "Generic (PLEG): container finished" podID="4f0674e4-b3ab-4aa4-bf48-271225fb7a23" containerID="b431b49b7bf133c94875a49acd84a554f1ce5bd8676605e81b26c796815de4fe" exitCode=0 Mar 16 17:27:36 crc kubenswrapper[5120]: I0316 17:27:36.778189 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-795f46b747-6fgjf" event={"ID":"4f0674e4-b3ab-4aa4-bf48-271225fb7a23","Type":"ContainerDied","Data":"b431b49b7bf133c94875a49acd84a554f1ce5bd8676605e81b26c796815de4fe"} Mar 16 17:27:36 crc kubenswrapper[5120]: I0316 17:27:36.778267 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-795f46b747-6fgjf" Mar 16 17:27:36 crc kubenswrapper[5120]: I0316 17:27:36.778270 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-795f46b747-6fgjf" event={"ID":"4f0674e4-b3ab-4aa4-bf48-271225fb7a23","Type":"ContainerDied","Data":"0ebee029bc425cd1b9cf10f37a86a21db62012eda6f41685431c5213261022d4"} Mar 16 17:27:36 crc kubenswrapper[5120]: I0316 17:27:36.778317 5120 scope.go:117] "RemoveContainer" containerID="b431b49b7bf133c94875a49acd84a554f1ce5bd8676605e81b26c796815de4fe" Mar 16 17:27:36 crc kubenswrapper[5120]: I0316 17:27:36.807095 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-795f46b747-6fgjf"] Mar 16 17:27:36 crc kubenswrapper[5120]: I0316 17:27:36.809939 5120 scope.go:117] "RemoveContainer" containerID="9864d97c234fcfcf4e3c40afa06271ed444c9fcd5a5d809e249cafb5a7c98362" Mar 16 17:27:36 crc kubenswrapper[5120]: I0316 17:27:36.814396 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-795f46b747-6fgjf"] Mar 16 17:27:36 crc kubenswrapper[5120]: I0316 17:27:36.831677 5120 scope.go:117] "RemoveContainer" containerID="b431b49b7bf133c94875a49acd84a554f1ce5bd8676605e81b26c796815de4fe" Mar 16 17:27:36 crc kubenswrapper[5120]: E0316 17:27:36.832246 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b431b49b7bf133c94875a49acd84a554f1ce5bd8676605e81b26c796815de4fe\": container with ID starting with b431b49b7bf133c94875a49acd84a554f1ce5bd8676605e81b26c796815de4fe not found: ID does not exist" containerID="b431b49b7bf133c94875a49acd84a554f1ce5bd8676605e81b26c796815de4fe" Mar 16 17:27:36 crc kubenswrapper[5120]: I0316 17:27:36.832283 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b431b49b7bf133c94875a49acd84a554f1ce5bd8676605e81b26c796815de4fe"} err="failed to get container status \"b431b49b7bf133c94875a49acd84a554f1ce5bd8676605e81b26c796815de4fe\": rpc error: code = NotFound desc = could not find container \"b431b49b7bf133c94875a49acd84a554f1ce5bd8676605e81b26c796815de4fe\": container with ID starting with b431b49b7bf133c94875a49acd84a554f1ce5bd8676605e81b26c796815de4fe not found: ID does not exist" Mar 16 17:27:36 crc kubenswrapper[5120]: I0316 17:27:36.832310 5120 scope.go:117] "RemoveContainer" containerID="9864d97c234fcfcf4e3c40afa06271ed444c9fcd5a5d809e249cafb5a7c98362" Mar 16 17:27:36 crc kubenswrapper[5120]: E0316 17:27:36.832572 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9864d97c234fcfcf4e3c40afa06271ed444c9fcd5a5d809e249cafb5a7c98362\": container with ID starting with 9864d97c234fcfcf4e3c40afa06271ed444c9fcd5a5d809e249cafb5a7c98362 not found: ID does not exist" containerID="9864d97c234fcfcf4e3c40afa06271ed444c9fcd5a5d809e249cafb5a7c98362" Mar 16 17:27:36 crc kubenswrapper[5120]: I0316 17:27:36.832647 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9864d97c234fcfcf4e3c40afa06271ed444c9fcd5a5d809e249cafb5a7c98362"} err="failed to get container status \"9864d97c234fcfcf4e3c40afa06271ed444c9fcd5a5d809e249cafb5a7c98362\": rpc error: code = NotFound desc = could not find container \"9864d97c234fcfcf4e3c40afa06271ed444c9fcd5a5d809e249cafb5a7c98362\": container with ID starting with 9864d97c234fcfcf4e3c40afa06271ed444c9fcd5a5d809e249cafb5a7c98362 not found: ID does not exist" Mar 16 17:27:37 crc kubenswrapper[5120]: I0316 17:27:37.056675 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-bwdn7" Mar 16 17:27:37 crc kubenswrapper[5120]: I0316 17:27:37.130405 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/6f35d54a-7f49-4a89-8906-95f67f952fb9-node-mnt\") pod \"6f35d54a-7f49-4a89-8906-95f67f952fb9\" (UID: \"6f35d54a-7f49-4a89-8906-95f67f952fb9\") " Mar 16 17:27:37 crc kubenswrapper[5120]: I0316 17:27:37.130503 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/6f35d54a-7f49-4a89-8906-95f67f952fb9-crc-storage\") pod \"6f35d54a-7f49-4a89-8906-95f67f952fb9\" (UID: \"6f35d54a-7f49-4a89-8906-95f67f952fb9\") " Mar 16 17:27:37 crc kubenswrapper[5120]: I0316 17:27:37.130564 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/6f35d54a-7f49-4a89-8906-95f67f952fb9-node-mnt" (OuterVolumeSpecName: "node-mnt") pod "6f35d54a-7f49-4a89-8906-95f67f952fb9" (UID: "6f35d54a-7f49-4a89-8906-95f67f952fb9"). InnerVolumeSpecName "node-mnt". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 17:27:37 crc kubenswrapper[5120]: I0316 17:27:37.130961 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ldnw8\" (UniqueName: \"kubernetes.io/projected/6f35d54a-7f49-4a89-8906-95f67f952fb9-kube-api-access-ldnw8\") pod \"6f35d54a-7f49-4a89-8906-95f67f952fb9\" (UID: \"6f35d54a-7f49-4a89-8906-95f67f952fb9\") " Mar 16 17:27:37 crc kubenswrapper[5120]: I0316 17:27:37.131460 5120 reconciler_common.go:299] "Volume detached for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/6f35d54a-7f49-4a89-8906-95f67f952fb9-node-mnt\") on node \"crc\" DevicePath \"\"" Mar 16 17:27:37 crc kubenswrapper[5120]: I0316 17:27:37.134877 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f35d54a-7f49-4a89-8906-95f67f952fb9-kube-api-access-ldnw8" (OuterVolumeSpecName: "kube-api-access-ldnw8") pod "6f35d54a-7f49-4a89-8906-95f67f952fb9" (UID: "6f35d54a-7f49-4a89-8906-95f67f952fb9"). InnerVolumeSpecName "kube-api-access-ldnw8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:27:37 crc kubenswrapper[5120]: I0316 17:27:37.149550 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f35d54a-7f49-4a89-8906-95f67f952fb9-crc-storage" (OuterVolumeSpecName: "crc-storage") pod "6f35d54a-7f49-4a89-8906-95f67f952fb9" (UID: "6f35d54a-7f49-4a89-8906-95f67f952fb9"). InnerVolumeSpecName "crc-storage". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:27:37 crc kubenswrapper[5120]: I0316 17:27:37.233522 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ldnw8\" (UniqueName: \"kubernetes.io/projected/6f35d54a-7f49-4a89-8906-95f67f952fb9-kube-api-access-ldnw8\") on node \"crc\" DevicePath \"\"" Mar 16 17:27:37 crc kubenswrapper[5120]: I0316 17:27:37.233562 5120 reconciler_common.go:299] "Volume detached for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/6f35d54a-7f49-4a89-8906-95f67f952fb9-crc-storage\") on node \"crc\" DevicePath \"\"" Mar 16 17:27:37 crc kubenswrapper[5120]: I0316 17:27:37.796559 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-bwdn7" event={"ID":"6f35d54a-7f49-4a89-8906-95f67f952fb9","Type":"ContainerDied","Data":"165a44f460a60f0635383f16a735ca408c1f021c2fa88b2adf0e7d8e84cf879c"} Mar 16 17:27:37 crc kubenswrapper[5120]: I0316 17:27:37.796601 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="165a44f460a60f0635383f16a735ca408c1f021c2fa88b2adf0e7d8e84cf879c" Mar 16 17:27:37 crc kubenswrapper[5120]: I0316 17:27:37.796633 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-bwdn7" Mar 16 17:27:38 crc kubenswrapper[5120]: I0316 17:27:38.689755 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4f0674e4-b3ab-4aa4-bf48-271225fb7a23" path="/var/lib/kubelet/pods/4f0674e4-b3ab-4aa4-bf48-271225fb7a23/volumes" Mar 16 17:27:40 crc kubenswrapper[5120]: I0316 17:27:40.184873 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["crc-storage/crc-storage-crc-bwdn7"] Mar 16 17:27:40 crc kubenswrapper[5120]: I0316 17:27:40.190246 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["crc-storage/crc-storage-crc-bwdn7"] Mar 16 17:27:40 crc kubenswrapper[5120]: I0316 17:27:40.321748 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["crc-storage/crc-storage-crc-qgskf"] Mar 16 17:27:40 crc kubenswrapper[5120]: I0316 17:27:40.322911 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f0674e4-b3ab-4aa4-bf48-271225fb7a23" containerName="init" Mar 16 17:27:40 crc kubenswrapper[5120]: I0316 17:27:40.322934 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f0674e4-b3ab-4aa4-bf48-271225fb7a23" containerName="init" Mar 16 17:27:40 crc kubenswrapper[5120]: I0316 17:27:40.322961 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f0674e4-b3ab-4aa4-bf48-271225fb7a23" containerName="dnsmasq-dns" Mar 16 17:27:40 crc kubenswrapper[5120]: I0316 17:27:40.322968 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f0674e4-b3ab-4aa4-bf48-271225fb7a23" containerName="dnsmasq-dns" Mar 16 17:27:40 crc kubenswrapper[5120]: I0316 17:27:40.322977 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f35d54a-7f49-4a89-8906-95f67f952fb9" containerName="storage" Mar 16 17:27:40 crc kubenswrapper[5120]: I0316 17:27:40.322985 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f35d54a-7f49-4a89-8906-95f67f952fb9" containerName="storage" Mar 16 17:27:40 crc kubenswrapper[5120]: I0316 17:27:40.323163 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="6f35d54a-7f49-4a89-8906-95f67f952fb9" containerName="storage" Mar 16 17:27:40 crc kubenswrapper[5120]: I0316 17:27:40.323180 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="4f0674e4-b3ab-4aa4-bf48-271225fb7a23" containerName="dnsmasq-dns" Mar 16 17:27:40 crc kubenswrapper[5120]: I0316 17:27:40.334519 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-qgskf"] Mar 16 17:27:40 crc kubenswrapper[5120]: I0316 17:27:40.334672 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-qgskf" Mar 16 17:27:40 crc kubenswrapper[5120]: I0316 17:27:40.337929 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"crc-storage\"/\"crc-storage-dockercfg-s2tht\"" Mar 16 17:27:40 crc kubenswrapper[5120]: I0316 17:27:40.338324 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"kube-root-ca.crt\"" Mar 16 17:27:40 crc kubenswrapper[5120]: I0316 17:27:40.338501 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"crc-storage\"" Mar 16 17:27:40 crc kubenswrapper[5120]: I0316 17:27:40.339258 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"openshift-service-ca.crt\"" Mar 16 17:27:40 crc kubenswrapper[5120]: I0316 17:27:40.505421 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4z5c\" (UniqueName: \"kubernetes.io/projected/7b9857ea-679f-43c5-aa03-340f6cb135f5-kube-api-access-f4z5c\") pod \"crc-storage-crc-qgskf\" (UID: \"7b9857ea-679f-43c5-aa03-340f6cb135f5\") " pod="crc-storage/crc-storage-crc-qgskf" Mar 16 17:27:40 crc kubenswrapper[5120]: I0316 17:27:40.505906 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/7b9857ea-679f-43c5-aa03-340f6cb135f5-crc-storage\") pod \"crc-storage-crc-qgskf\" (UID: \"7b9857ea-679f-43c5-aa03-340f6cb135f5\") " pod="crc-storage/crc-storage-crc-qgskf" Mar 16 17:27:40 crc kubenswrapper[5120]: I0316 17:27:40.506004 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/7b9857ea-679f-43c5-aa03-340f6cb135f5-node-mnt\") pod \"crc-storage-crc-qgskf\" (UID: \"7b9857ea-679f-43c5-aa03-340f6cb135f5\") " pod="crc-storage/crc-storage-crc-qgskf" Mar 16 17:27:40 crc kubenswrapper[5120]: I0316 17:27:40.608176 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f4z5c\" (UniqueName: \"kubernetes.io/projected/7b9857ea-679f-43c5-aa03-340f6cb135f5-kube-api-access-f4z5c\") pod \"crc-storage-crc-qgskf\" (UID: \"7b9857ea-679f-43c5-aa03-340f6cb135f5\") " pod="crc-storage/crc-storage-crc-qgskf" Mar 16 17:27:40 crc kubenswrapper[5120]: I0316 17:27:40.608336 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/7b9857ea-679f-43c5-aa03-340f6cb135f5-crc-storage\") pod \"crc-storage-crc-qgskf\" (UID: \"7b9857ea-679f-43c5-aa03-340f6cb135f5\") " pod="crc-storage/crc-storage-crc-qgskf" Mar 16 17:27:40 crc kubenswrapper[5120]: I0316 17:27:40.608374 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/7b9857ea-679f-43c5-aa03-340f6cb135f5-node-mnt\") pod \"crc-storage-crc-qgskf\" (UID: \"7b9857ea-679f-43c5-aa03-340f6cb135f5\") " pod="crc-storage/crc-storage-crc-qgskf" Mar 16 17:27:40 crc kubenswrapper[5120]: I0316 17:27:40.608670 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/7b9857ea-679f-43c5-aa03-340f6cb135f5-node-mnt\") pod \"crc-storage-crc-qgskf\" (UID: \"7b9857ea-679f-43c5-aa03-340f6cb135f5\") " pod="crc-storage/crc-storage-crc-qgskf" Mar 16 17:27:40 crc kubenswrapper[5120]: I0316 17:27:40.610719 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/7b9857ea-679f-43c5-aa03-340f6cb135f5-crc-storage\") pod \"crc-storage-crc-qgskf\" (UID: \"7b9857ea-679f-43c5-aa03-340f6cb135f5\") " pod="crc-storage/crc-storage-crc-qgskf" Mar 16 17:27:40 crc kubenswrapper[5120]: I0316 17:27:40.639272 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4z5c\" (UniqueName: \"kubernetes.io/projected/7b9857ea-679f-43c5-aa03-340f6cb135f5-kube-api-access-f4z5c\") pod \"crc-storage-crc-qgskf\" (UID: \"7b9857ea-679f-43c5-aa03-340f6cb135f5\") " pod="crc-storage/crc-storage-crc-qgskf" Mar 16 17:27:40 crc kubenswrapper[5120]: I0316 17:27:40.653441 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-qgskf" Mar 16 17:27:40 crc kubenswrapper[5120]: I0316 17:27:40.674605 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f35d54a-7f49-4a89-8906-95f67f952fb9" path="/var/lib/kubelet/pods/6f35d54a-7f49-4a89-8906-95f67f952fb9/volumes" Mar 16 17:27:41 crc kubenswrapper[5120]: I0316 17:27:41.094257 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-qgskf"] Mar 16 17:27:41 crc kubenswrapper[5120]: I0316 17:27:41.836209 5120 generic.go:358] "Generic (PLEG): container finished" podID="7b9857ea-679f-43c5-aa03-340f6cb135f5" containerID="08d811cb878e0e1223af22a6f3068e2745debf6cc51d35a5c988385cc1938379" exitCode=0 Mar 16 17:27:41 crc kubenswrapper[5120]: I0316 17:27:41.836441 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-qgskf" event={"ID":"7b9857ea-679f-43c5-aa03-340f6cb135f5","Type":"ContainerDied","Data":"08d811cb878e0e1223af22a6f3068e2745debf6cc51d35a5c988385cc1938379"} Mar 16 17:27:41 crc kubenswrapper[5120]: I0316 17:27:41.836673 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-qgskf" event={"ID":"7b9857ea-679f-43c5-aa03-340f6cb135f5","Type":"ContainerStarted","Data":"dcb00d7f26ec3cdf8f4dca5ea92f7d4f13c0200ae8e1d2d8d51b41b760c0424c"} Mar 16 17:27:43 crc kubenswrapper[5120]: I0316 17:27:43.144228 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-qgskf" Mar 16 17:27:43 crc kubenswrapper[5120]: I0316 17:27:43.265291 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/7b9857ea-679f-43c5-aa03-340f6cb135f5-crc-storage\") pod \"7b9857ea-679f-43c5-aa03-340f6cb135f5\" (UID: \"7b9857ea-679f-43c5-aa03-340f6cb135f5\") " Mar 16 17:27:43 crc kubenswrapper[5120]: I0316 17:27:43.265654 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/7b9857ea-679f-43c5-aa03-340f6cb135f5-node-mnt\") pod \"7b9857ea-679f-43c5-aa03-340f6cb135f5\" (UID: \"7b9857ea-679f-43c5-aa03-340f6cb135f5\") " Mar 16 17:27:43 crc kubenswrapper[5120]: I0316 17:27:43.265830 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f4z5c\" (UniqueName: \"kubernetes.io/projected/7b9857ea-679f-43c5-aa03-340f6cb135f5-kube-api-access-f4z5c\") pod \"7b9857ea-679f-43c5-aa03-340f6cb135f5\" (UID: \"7b9857ea-679f-43c5-aa03-340f6cb135f5\") " Mar 16 17:27:43 crc kubenswrapper[5120]: I0316 17:27:43.265928 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/7b9857ea-679f-43c5-aa03-340f6cb135f5-node-mnt" (OuterVolumeSpecName: "node-mnt") pod "7b9857ea-679f-43c5-aa03-340f6cb135f5" (UID: "7b9857ea-679f-43c5-aa03-340f6cb135f5"). InnerVolumeSpecName "node-mnt". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 17:27:43 crc kubenswrapper[5120]: I0316 17:27:43.267487 5120 reconciler_common.go:299] "Volume detached for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/7b9857ea-679f-43c5-aa03-340f6cb135f5-node-mnt\") on node \"crc\" DevicePath \"\"" Mar 16 17:27:43 crc kubenswrapper[5120]: I0316 17:27:43.272668 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b9857ea-679f-43c5-aa03-340f6cb135f5-kube-api-access-f4z5c" (OuterVolumeSpecName: "kube-api-access-f4z5c") pod "7b9857ea-679f-43c5-aa03-340f6cb135f5" (UID: "7b9857ea-679f-43c5-aa03-340f6cb135f5"). InnerVolumeSpecName "kube-api-access-f4z5c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:27:43 crc kubenswrapper[5120]: I0316 17:27:43.286864 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7b9857ea-679f-43c5-aa03-340f6cb135f5-crc-storage" (OuterVolumeSpecName: "crc-storage") pod "7b9857ea-679f-43c5-aa03-340f6cb135f5" (UID: "7b9857ea-679f-43c5-aa03-340f6cb135f5"). InnerVolumeSpecName "crc-storage". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:27:43 crc kubenswrapper[5120]: I0316 17:27:43.369644 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f4z5c\" (UniqueName: \"kubernetes.io/projected/7b9857ea-679f-43c5-aa03-340f6cb135f5-kube-api-access-f4z5c\") on node \"crc\" DevicePath \"\"" Mar 16 17:27:43 crc kubenswrapper[5120]: I0316 17:27:43.369694 5120 reconciler_common.go:299] "Volume detached for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/7b9857ea-679f-43c5-aa03-340f6cb135f5-crc-storage\") on node \"crc\" DevicePath \"\"" Mar 16 17:27:43 crc kubenswrapper[5120]: I0316 17:27:43.857579 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-qgskf" Mar 16 17:27:43 crc kubenswrapper[5120]: I0316 17:27:43.857628 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-qgskf" event={"ID":"7b9857ea-679f-43c5-aa03-340f6cb135f5","Type":"ContainerDied","Data":"dcb00d7f26ec3cdf8f4dca5ea92f7d4f13c0200ae8e1d2d8d51b41b760c0424c"} Mar 16 17:27:43 crc kubenswrapper[5120]: I0316 17:27:43.858155 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dcb00d7f26ec3cdf8f4dca5ea92f7d4f13c0200ae8e1d2d8d51b41b760c0424c" Mar 16 17:27:46 crc kubenswrapper[5120]: I0316 17:27:46.410799 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-77f4d697b7-gkzvd"] Mar 16 17:27:46 crc kubenswrapper[5120]: I0316 17:27:46.411922 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b9857ea-679f-43c5-aa03-340f6cb135f5" containerName="storage" Mar 16 17:27:46 crc kubenswrapper[5120]: I0316 17:27:46.411935 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b9857ea-679f-43c5-aa03-340f6cb135f5" containerName="storage" Mar 16 17:27:46 crc kubenswrapper[5120]: I0316 17:27:46.412081 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7b9857ea-679f-43c5-aa03-340f6cb135f5" containerName="storage" Mar 16 17:27:46 crc kubenswrapper[5120]: I0316 17:27:46.418384 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-77f4d697b7-gkzvd" Mar 16 17:27:46 crc kubenswrapper[5120]: I0316 17:27:46.421487 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-edpm-tls\"" Mar 16 17:27:46 crc kubenswrapper[5120]: I0316 17:27:46.426019 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-77f4d697b7-gkzvd"] Mar 16 17:27:46 crc kubenswrapper[5120]: I0316 17:27:46.538276 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-edpm-tls\" (UniqueName: \"kubernetes.io/configmap/6a403755-b706-4572-8118-bf6263ddf75e-openstack-edpm-tls\") pod \"dnsmasq-dnsmasq-77f4d697b7-gkzvd\" (UID: \"6a403755-b706-4572-8118-bf6263ddf75e\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-77f4d697b7-gkzvd" Mar 16 17:27:46 crc kubenswrapper[5120]: I0316 17:27:46.538355 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjnwg\" (UniqueName: \"kubernetes.io/projected/6a403755-b706-4572-8118-bf6263ddf75e-kube-api-access-rjnwg\") pod \"dnsmasq-dnsmasq-77f4d697b7-gkzvd\" (UID: \"6a403755-b706-4572-8118-bf6263ddf75e\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-77f4d697b7-gkzvd" Mar 16 17:27:46 crc kubenswrapper[5120]: I0316 17:27:46.538530 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/6a403755-b706-4572-8118-bf6263ddf75e-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-77f4d697b7-gkzvd\" (UID: \"6a403755-b706-4572-8118-bf6263ddf75e\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-77f4d697b7-gkzvd" Mar 16 17:27:46 crc kubenswrapper[5120]: I0316 17:27:46.538791 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6a403755-b706-4572-8118-bf6263ddf75e-config\") pod \"dnsmasq-dnsmasq-77f4d697b7-gkzvd\" (UID: \"6a403755-b706-4572-8118-bf6263ddf75e\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-77f4d697b7-gkzvd" Mar 16 17:27:46 crc kubenswrapper[5120]: I0316 17:27:46.641071 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6a403755-b706-4572-8118-bf6263ddf75e-config\") pod \"dnsmasq-dnsmasq-77f4d697b7-gkzvd\" (UID: \"6a403755-b706-4572-8118-bf6263ddf75e\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-77f4d697b7-gkzvd" Mar 16 17:27:46 crc kubenswrapper[5120]: I0316 17:27:46.641383 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openstack-edpm-tls\" (UniqueName: \"kubernetes.io/configmap/6a403755-b706-4572-8118-bf6263ddf75e-openstack-edpm-tls\") pod \"dnsmasq-dnsmasq-77f4d697b7-gkzvd\" (UID: \"6a403755-b706-4572-8118-bf6263ddf75e\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-77f4d697b7-gkzvd" Mar 16 17:27:46 crc kubenswrapper[5120]: I0316 17:27:46.641443 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rjnwg\" (UniqueName: \"kubernetes.io/projected/6a403755-b706-4572-8118-bf6263ddf75e-kube-api-access-rjnwg\") pod \"dnsmasq-dnsmasq-77f4d697b7-gkzvd\" (UID: \"6a403755-b706-4572-8118-bf6263ddf75e\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-77f4d697b7-gkzvd" Mar 16 17:27:46 crc kubenswrapper[5120]: I0316 17:27:46.641535 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/6a403755-b706-4572-8118-bf6263ddf75e-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-77f4d697b7-gkzvd\" (UID: \"6a403755-b706-4572-8118-bf6263ddf75e\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-77f4d697b7-gkzvd" Mar 16 17:27:46 crc kubenswrapper[5120]: I0316 17:27:46.642172 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6a403755-b706-4572-8118-bf6263ddf75e-config\") pod \"dnsmasq-dnsmasq-77f4d697b7-gkzvd\" (UID: \"6a403755-b706-4572-8118-bf6263ddf75e\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-77f4d697b7-gkzvd" Mar 16 17:27:46 crc kubenswrapper[5120]: I0316 17:27:46.642501 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/6a403755-b706-4572-8118-bf6263ddf75e-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-77f4d697b7-gkzvd\" (UID: \"6a403755-b706-4572-8118-bf6263ddf75e\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-77f4d697b7-gkzvd" Mar 16 17:27:46 crc kubenswrapper[5120]: I0316 17:27:46.642510 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openstack-edpm-tls\" (UniqueName: \"kubernetes.io/configmap/6a403755-b706-4572-8118-bf6263ddf75e-openstack-edpm-tls\") pod \"dnsmasq-dnsmasq-77f4d697b7-gkzvd\" (UID: \"6a403755-b706-4572-8118-bf6263ddf75e\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-77f4d697b7-gkzvd" Mar 16 17:27:46 crc kubenswrapper[5120]: I0316 17:27:46.686267 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjnwg\" (UniqueName: \"kubernetes.io/projected/6a403755-b706-4572-8118-bf6263ddf75e-kube-api-access-rjnwg\") pod \"dnsmasq-dnsmasq-77f4d697b7-gkzvd\" (UID: \"6a403755-b706-4572-8118-bf6263ddf75e\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-77f4d697b7-gkzvd" Mar 16 17:27:46 crc kubenswrapper[5120]: I0316 17:27:46.743821 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-77f4d697b7-gkzvd" Mar 16 17:27:47 crc kubenswrapper[5120]: W0316 17:27:47.173252 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6a403755_b706_4572_8118_bf6263ddf75e.slice/crio-67c0cc38b8a16157dcf5f29992fbe24c63840963668102a5fd3ea587a0738026 WatchSource:0}: Error finding container 67c0cc38b8a16157dcf5f29992fbe24c63840963668102a5fd3ea587a0738026: Status 404 returned error can't find the container with id 67c0cc38b8a16157dcf5f29992fbe24c63840963668102a5fd3ea587a0738026 Mar 16 17:27:47 crc kubenswrapper[5120]: I0316 17:27:47.176814 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-77f4d697b7-gkzvd"] Mar 16 17:27:47 crc kubenswrapper[5120]: I0316 17:27:47.898658 5120 generic.go:358] "Generic (PLEG): container finished" podID="6a403755-b706-4572-8118-bf6263ddf75e" containerID="be06367ea06aff1bb28b81c58f95d500ec0b6f790eeee1cbc7499da6e93bcbfe" exitCode=0 Mar 16 17:27:47 crc kubenswrapper[5120]: I0316 17:27:47.898756 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-77f4d697b7-gkzvd" event={"ID":"6a403755-b706-4572-8118-bf6263ddf75e","Type":"ContainerDied","Data":"be06367ea06aff1bb28b81c58f95d500ec0b6f790eeee1cbc7499da6e93bcbfe"} Mar 16 17:27:47 crc kubenswrapper[5120]: I0316 17:27:47.900787 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-77f4d697b7-gkzvd" event={"ID":"6a403755-b706-4572-8118-bf6263ddf75e","Type":"ContainerStarted","Data":"67c0cc38b8a16157dcf5f29992fbe24c63840963668102a5fd3ea587a0738026"} Mar 16 17:27:48 crc kubenswrapper[5120]: I0316 17:27:48.912486 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-77f4d697b7-gkzvd" event={"ID":"6a403755-b706-4572-8118-bf6263ddf75e","Type":"ContainerStarted","Data":"5718e0b9e8e64d206689ddba22adf887132c9543078f40af9e83abce9cbe6a67"} Mar 16 17:27:48 crc kubenswrapper[5120]: I0316 17:27:48.912824 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-77f4d697b7-gkzvd" Mar 16 17:27:48 crc kubenswrapper[5120]: I0316 17:27:48.932742 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-77f4d697b7-gkzvd" podStartSLOduration=2.932723459 podStartE2EDuration="2.932723459s" podCreationTimestamp="2026-03-16 17:27:46 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:27:48.929689395 +0000 UTC m=+6971.083621052" watchObservedRunningTime="2026-03-16 17:27:48.932723459 +0000 UTC m=+6971.086655116" Mar 16 17:27:52 crc kubenswrapper[5120]: I0316 17:27:52.008062 5120 patch_prober.go:28] interesting pod/machine-config-daemon-7bf76 container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 17:27:52 crc kubenswrapper[5120]: I0316 17:27:52.008446 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 17:27:54 crc kubenswrapper[5120]: I0316 17:27:54.923834 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-77f4d697b7-gkzvd" Mar 16 17:27:54 crc kubenswrapper[5120]: I0316 17:27:54.975249 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-bd8mf"] Mar 16 17:27:54 crc kubenswrapper[5120]: I0316 17:27:54.975584 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-bd8mf" podUID="2ed306f9-a5ea-4132-bc7b-8ed55abb3f95" containerName="dnsmasq-dns" containerID="cri-o://608183e23452d3d3017d828071ec566890c1454081fb0d761f6f91fcd660ea57" gracePeriod=10 Mar 16 17:27:55 crc kubenswrapper[5120]: I0316 17:27:55.144626 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-6f5787b9d7-pc75p"] Mar 16 17:27:55 crc kubenswrapper[5120]: I0316 17:27:55.151204 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6f5787b9d7-pc75p" Mar 16 17:27:55 crc kubenswrapper[5120]: I0316 17:27:55.161846 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-6f5787b9d7-pc75p"] Mar 16 17:27:55 crc kubenswrapper[5120]: I0316 17:27:55.242356 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/329d73ef-e3a7-47f4-bcc7-1f9c5ea3d8a1-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-6f5787b9d7-pc75p\" (UID: \"329d73ef-e3a7-47f4-bcc7-1f9c5ea3d8a1\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6f5787b9d7-pc75p" Mar 16 17:27:55 crc kubenswrapper[5120]: I0316 17:27:55.242465 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mw8rc\" (UniqueName: \"kubernetes.io/projected/329d73ef-e3a7-47f4-bcc7-1f9c5ea3d8a1-kube-api-access-mw8rc\") pod \"dnsmasq-dnsmasq-6f5787b9d7-pc75p\" (UID: \"329d73ef-e3a7-47f4-bcc7-1f9c5ea3d8a1\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6f5787b9d7-pc75p" Mar 16 17:27:55 crc kubenswrapper[5120]: I0316 17:27:55.242491 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/329d73ef-e3a7-47f4-bcc7-1f9c5ea3d8a1-config\") pod \"dnsmasq-dnsmasq-6f5787b9d7-pc75p\" (UID: \"329d73ef-e3a7-47f4-bcc7-1f9c5ea3d8a1\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6f5787b9d7-pc75p" Mar 16 17:27:55 crc kubenswrapper[5120]: I0316 17:27:55.242630 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-edpm-tls\" (UniqueName: \"kubernetes.io/configmap/329d73ef-e3a7-47f4-bcc7-1f9c5ea3d8a1-openstack-edpm-tls\") pod \"dnsmasq-dnsmasq-6f5787b9d7-pc75p\" (UID: \"329d73ef-e3a7-47f4-bcc7-1f9c5ea3d8a1\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6f5787b9d7-pc75p" Mar 16 17:27:55 crc kubenswrapper[5120]: I0316 17:27:55.345293 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openstack-edpm-tls\" (UniqueName: \"kubernetes.io/configmap/329d73ef-e3a7-47f4-bcc7-1f9c5ea3d8a1-openstack-edpm-tls\") pod \"dnsmasq-dnsmasq-6f5787b9d7-pc75p\" (UID: \"329d73ef-e3a7-47f4-bcc7-1f9c5ea3d8a1\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6f5787b9d7-pc75p" Mar 16 17:27:55 crc kubenswrapper[5120]: I0316 17:27:55.345856 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/329d73ef-e3a7-47f4-bcc7-1f9c5ea3d8a1-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-6f5787b9d7-pc75p\" (UID: \"329d73ef-e3a7-47f4-bcc7-1f9c5ea3d8a1\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6f5787b9d7-pc75p" Mar 16 17:27:55 crc kubenswrapper[5120]: I0316 17:27:55.346108 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mw8rc\" (UniqueName: \"kubernetes.io/projected/329d73ef-e3a7-47f4-bcc7-1f9c5ea3d8a1-kube-api-access-mw8rc\") pod \"dnsmasq-dnsmasq-6f5787b9d7-pc75p\" (UID: \"329d73ef-e3a7-47f4-bcc7-1f9c5ea3d8a1\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6f5787b9d7-pc75p" Mar 16 17:27:55 crc kubenswrapper[5120]: I0316 17:27:55.346161 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/329d73ef-e3a7-47f4-bcc7-1f9c5ea3d8a1-config\") pod \"dnsmasq-dnsmasq-6f5787b9d7-pc75p\" (UID: \"329d73ef-e3a7-47f4-bcc7-1f9c5ea3d8a1\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6f5787b9d7-pc75p" Mar 16 17:27:55 crc kubenswrapper[5120]: I0316 17:27:55.346263 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openstack-edpm-tls\" (UniqueName: \"kubernetes.io/configmap/329d73ef-e3a7-47f4-bcc7-1f9c5ea3d8a1-openstack-edpm-tls\") pod \"dnsmasq-dnsmasq-6f5787b9d7-pc75p\" (UID: \"329d73ef-e3a7-47f4-bcc7-1f9c5ea3d8a1\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6f5787b9d7-pc75p" Mar 16 17:27:55 crc kubenswrapper[5120]: I0316 17:27:55.346878 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/329d73ef-e3a7-47f4-bcc7-1f9c5ea3d8a1-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-6f5787b9d7-pc75p\" (UID: \"329d73ef-e3a7-47f4-bcc7-1f9c5ea3d8a1\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6f5787b9d7-pc75p" Mar 16 17:27:55 crc kubenswrapper[5120]: I0316 17:27:55.346899 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/329d73ef-e3a7-47f4-bcc7-1f9c5ea3d8a1-config\") pod \"dnsmasq-dnsmasq-6f5787b9d7-pc75p\" (UID: \"329d73ef-e3a7-47f4-bcc7-1f9c5ea3d8a1\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6f5787b9d7-pc75p" Mar 16 17:27:55 crc kubenswrapper[5120]: I0316 17:27:55.380445 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mw8rc\" (UniqueName: \"kubernetes.io/projected/329d73ef-e3a7-47f4-bcc7-1f9c5ea3d8a1-kube-api-access-mw8rc\") pod \"dnsmasq-dnsmasq-6f5787b9d7-pc75p\" (UID: \"329d73ef-e3a7-47f4-bcc7-1f9c5ea3d8a1\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6f5787b9d7-pc75p" Mar 16 17:27:55 crc kubenswrapper[5120]: I0316 17:27:55.421471 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-bd8mf" Mar 16 17:27:55 crc kubenswrapper[5120]: I0316 17:27:55.467983 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6f5787b9d7-pc75p" Mar 16 17:27:55 crc kubenswrapper[5120]: I0316 17:27:55.549681 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s5sn2\" (UniqueName: \"kubernetes.io/projected/2ed306f9-a5ea-4132-bc7b-8ed55abb3f95-kube-api-access-s5sn2\") pod \"2ed306f9-a5ea-4132-bc7b-8ed55abb3f95\" (UID: \"2ed306f9-a5ea-4132-bc7b-8ed55abb3f95\") " Mar 16 17:27:55 crc kubenswrapper[5120]: I0316 17:27:55.550073 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/2ed306f9-a5ea-4132-bc7b-8ed55abb3f95-dnsmasq-svc\") pod \"2ed306f9-a5ea-4132-bc7b-8ed55abb3f95\" (UID: \"2ed306f9-a5ea-4132-bc7b-8ed55abb3f95\") " Mar 16 17:27:55 crc kubenswrapper[5120]: I0316 17:27:55.550156 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2ed306f9-a5ea-4132-bc7b-8ed55abb3f95-config\") pod \"2ed306f9-a5ea-4132-bc7b-8ed55abb3f95\" (UID: \"2ed306f9-a5ea-4132-bc7b-8ed55abb3f95\") " Mar 16 17:27:55 crc kubenswrapper[5120]: I0316 17:27:55.557665 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ed306f9-a5ea-4132-bc7b-8ed55abb3f95-kube-api-access-s5sn2" (OuterVolumeSpecName: "kube-api-access-s5sn2") pod "2ed306f9-a5ea-4132-bc7b-8ed55abb3f95" (UID: "2ed306f9-a5ea-4132-bc7b-8ed55abb3f95"). InnerVolumeSpecName "kube-api-access-s5sn2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:27:55 crc kubenswrapper[5120]: I0316 17:27:55.592006 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ed306f9-a5ea-4132-bc7b-8ed55abb3f95-config" (OuterVolumeSpecName: "config") pod "2ed306f9-a5ea-4132-bc7b-8ed55abb3f95" (UID: "2ed306f9-a5ea-4132-bc7b-8ed55abb3f95"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:27:55 crc kubenswrapper[5120]: I0316 17:27:55.599596 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ed306f9-a5ea-4132-bc7b-8ed55abb3f95-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "2ed306f9-a5ea-4132-bc7b-8ed55abb3f95" (UID: "2ed306f9-a5ea-4132-bc7b-8ed55abb3f95"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:27:55 crc kubenswrapper[5120]: I0316 17:27:55.653178 5120 reconciler_common.go:299] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/2ed306f9-a5ea-4132-bc7b-8ed55abb3f95-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Mar 16 17:27:55 crc kubenswrapper[5120]: I0316 17:27:55.653224 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2ed306f9-a5ea-4132-bc7b-8ed55abb3f95-config\") on node \"crc\" DevicePath \"\"" Mar 16 17:27:55 crc kubenswrapper[5120]: I0316 17:27:55.653241 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s5sn2\" (UniqueName: \"kubernetes.io/projected/2ed306f9-a5ea-4132-bc7b-8ed55abb3f95-kube-api-access-s5sn2\") on node \"crc\" DevicePath \"\"" Mar 16 17:27:55 crc kubenswrapper[5120]: I0316 17:27:55.867388 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-6f5787b9d7-pc75p"] Mar 16 17:27:55 crc kubenswrapper[5120]: I0316 17:27:55.987942 5120 generic.go:358] "Generic (PLEG): container finished" podID="2ed306f9-a5ea-4132-bc7b-8ed55abb3f95" containerID="608183e23452d3d3017d828071ec566890c1454081fb0d761f6f91fcd660ea57" exitCode=0 Mar 16 17:27:55 crc kubenswrapper[5120]: I0316 17:27:55.988152 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-bd8mf" Mar 16 17:27:55 crc kubenswrapper[5120]: I0316 17:27:55.993874 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-bd8mf" event={"ID":"2ed306f9-a5ea-4132-bc7b-8ed55abb3f95","Type":"ContainerDied","Data":"608183e23452d3d3017d828071ec566890c1454081fb0d761f6f91fcd660ea57"} Mar 16 17:27:55 crc kubenswrapper[5120]: I0316 17:27:55.993932 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-bd8mf" event={"ID":"2ed306f9-a5ea-4132-bc7b-8ed55abb3f95","Type":"ContainerDied","Data":"13e8d0a743c61f8430f2fd2bc58c5250b431bf980c045dbc1c21a3f83307019f"} Mar 16 17:27:55 crc kubenswrapper[5120]: I0316 17:27:55.993953 5120 scope.go:117] "RemoveContainer" containerID="608183e23452d3d3017d828071ec566890c1454081fb0d761f6f91fcd660ea57" Mar 16 17:27:55 crc kubenswrapper[5120]: I0316 17:27:55.996241 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6f5787b9d7-pc75p" event={"ID":"329d73ef-e3a7-47f4-bcc7-1f9c5ea3d8a1","Type":"ContainerStarted","Data":"feee60cc2d5893e6d8ad853bb0f7b48d5f1e567291743ce9978c1b9baa1757e6"} Mar 16 17:27:56 crc kubenswrapper[5120]: I0316 17:27:56.014655 5120 scope.go:117] "RemoveContainer" containerID="75ef2b6d05bab37018cde4ef6e26495a1f86fdd177369d63a6bd1686a8c707df" Mar 16 17:27:56 crc kubenswrapper[5120]: I0316 17:27:56.017981 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-bd8mf"] Mar 16 17:27:56 crc kubenswrapper[5120]: I0316 17:27:56.023967 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-bd8mf"] Mar 16 17:27:56 crc kubenswrapper[5120]: I0316 17:27:56.050895 5120 scope.go:117] "RemoveContainer" containerID="608183e23452d3d3017d828071ec566890c1454081fb0d761f6f91fcd660ea57" Mar 16 17:27:56 crc kubenswrapper[5120]: E0316 17:27:56.051356 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"608183e23452d3d3017d828071ec566890c1454081fb0d761f6f91fcd660ea57\": container with ID starting with 608183e23452d3d3017d828071ec566890c1454081fb0d761f6f91fcd660ea57 not found: ID does not exist" containerID="608183e23452d3d3017d828071ec566890c1454081fb0d761f6f91fcd660ea57" Mar 16 17:27:56 crc kubenswrapper[5120]: I0316 17:27:56.051402 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"608183e23452d3d3017d828071ec566890c1454081fb0d761f6f91fcd660ea57"} err="failed to get container status \"608183e23452d3d3017d828071ec566890c1454081fb0d761f6f91fcd660ea57\": rpc error: code = NotFound desc = could not find container \"608183e23452d3d3017d828071ec566890c1454081fb0d761f6f91fcd660ea57\": container with ID starting with 608183e23452d3d3017d828071ec566890c1454081fb0d761f6f91fcd660ea57 not found: ID does not exist" Mar 16 17:27:56 crc kubenswrapper[5120]: I0316 17:27:56.051429 5120 scope.go:117] "RemoveContainer" containerID="75ef2b6d05bab37018cde4ef6e26495a1f86fdd177369d63a6bd1686a8c707df" Mar 16 17:27:56 crc kubenswrapper[5120]: E0316 17:27:56.051688 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"75ef2b6d05bab37018cde4ef6e26495a1f86fdd177369d63a6bd1686a8c707df\": container with ID starting with 75ef2b6d05bab37018cde4ef6e26495a1f86fdd177369d63a6bd1686a8c707df not found: ID does not exist" containerID="75ef2b6d05bab37018cde4ef6e26495a1f86fdd177369d63a6bd1686a8c707df" Mar 16 17:27:56 crc kubenswrapper[5120]: I0316 17:27:56.051710 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75ef2b6d05bab37018cde4ef6e26495a1f86fdd177369d63a6bd1686a8c707df"} err="failed to get container status \"75ef2b6d05bab37018cde4ef6e26495a1f86fdd177369d63a6bd1686a8c707df\": rpc error: code = NotFound desc = could not find container \"75ef2b6d05bab37018cde4ef6e26495a1f86fdd177369d63a6bd1686a8c707df\": container with ID starting with 75ef2b6d05bab37018cde4ef6e26495a1f86fdd177369d63a6bd1686a8c707df not found: ID does not exist" Mar 16 17:27:56 crc kubenswrapper[5120]: I0316 17:27:56.676585 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2ed306f9-a5ea-4132-bc7b-8ed55abb3f95" path="/var/lib/kubelet/pods/2ed306f9-a5ea-4132-bc7b-8ed55abb3f95/volumes" Mar 16 17:27:57 crc kubenswrapper[5120]: I0316 17:27:57.007269 5120 generic.go:358] "Generic (PLEG): container finished" podID="329d73ef-e3a7-47f4-bcc7-1f9c5ea3d8a1" containerID="4d5e75a7fdf3eb5656a76ccd50c4e5df1208a705e5a3a6f0ae6961b31ad214ce" exitCode=0 Mar 16 17:27:57 crc kubenswrapper[5120]: I0316 17:27:57.007341 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6f5787b9d7-pc75p" event={"ID":"329d73ef-e3a7-47f4-bcc7-1f9c5ea3d8a1","Type":"ContainerDied","Data":"4d5e75a7fdf3eb5656a76ccd50c4e5df1208a705e5a3a6f0ae6961b31ad214ce"} Mar 16 17:27:58 crc kubenswrapper[5120]: I0316 17:27:58.019505 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6f5787b9d7-pc75p" event={"ID":"329d73ef-e3a7-47f4-bcc7-1f9c5ea3d8a1","Type":"ContainerStarted","Data":"77cb63ac5348cb2afb6f20ea495cbd078fa27d80640b6a05b1b393f39d28f1ac"} Mar 16 17:27:58 crc kubenswrapper[5120]: I0316 17:27:58.020693 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6f5787b9d7-pc75p" Mar 16 17:27:58 crc kubenswrapper[5120]: I0316 17:27:58.044822 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6f5787b9d7-pc75p" podStartSLOduration=3.044800216 podStartE2EDuration="3.044800216s" podCreationTimestamp="2026-03-16 17:27:55 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:27:58.03872635 +0000 UTC m=+6980.192658007" watchObservedRunningTime="2026-03-16 17:27:58.044800216 +0000 UTC m=+6980.198731883" Mar 16 17:28:00 crc kubenswrapper[5120]: I0316 17:28:00.145504 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-infra/auto-csr-approver-29561368-k94zr"] Mar 16 17:28:00 crc kubenswrapper[5120]: I0316 17:28:00.147813 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ed306f9-a5ea-4132-bc7b-8ed55abb3f95" containerName="dnsmasq-dns" Mar 16 17:28:00 crc kubenswrapper[5120]: I0316 17:28:00.147919 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ed306f9-a5ea-4132-bc7b-8ed55abb3f95" containerName="dnsmasq-dns" Mar 16 17:28:00 crc kubenswrapper[5120]: I0316 17:28:00.147977 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ed306f9-a5ea-4132-bc7b-8ed55abb3f95" containerName="init" Mar 16 17:28:00 crc kubenswrapper[5120]: I0316 17:28:00.148047 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ed306f9-a5ea-4132-bc7b-8ed55abb3f95" containerName="init" Mar 16 17:28:00 crc kubenswrapper[5120]: I0316 17:28:00.148492 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="2ed306f9-a5ea-4132-bc7b-8ed55abb3f95" containerName="dnsmasq-dns" Mar 16 17:28:00 crc kubenswrapper[5120]: I0316 17:28:00.154029 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561368-k94zr"] Mar 16 17:28:00 crc kubenswrapper[5120]: I0316 17:28:00.154337 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561368-k94zr" Mar 16 17:28:00 crc kubenswrapper[5120]: I0316 17:28:00.157666 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"kube-root-ca.crt\"" Mar 16 17:28:00 crc kubenswrapper[5120]: I0316 17:28:00.157956 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-infra\"/\"csr-approver-sa-dockercfg-x2nsz\"" Mar 16 17:28:00 crc kubenswrapper[5120]: I0316 17:28:00.161056 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"openshift-service-ca.crt\"" Mar 16 17:28:00 crc kubenswrapper[5120]: I0316 17:28:00.253811 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqvzv\" (UniqueName: \"kubernetes.io/projected/a6309f04-ff19-4337-911a-3b6125f1bc18-kube-api-access-wqvzv\") pod \"auto-csr-approver-29561368-k94zr\" (UID: \"a6309f04-ff19-4337-911a-3b6125f1bc18\") " pod="openshift-infra/auto-csr-approver-29561368-k94zr" Mar 16 17:28:00 crc kubenswrapper[5120]: I0316 17:28:00.355823 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wqvzv\" (UniqueName: \"kubernetes.io/projected/a6309f04-ff19-4337-911a-3b6125f1bc18-kube-api-access-wqvzv\") pod \"auto-csr-approver-29561368-k94zr\" (UID: \"a6309f04-ff19-4337-911a-3b6125f1bc18\") " pod="openshift-infra/auto-csr-approver-29561368-k94zr" Mar 16 17:28:00 crc kubenswrapper[5120]: I0316 17:28:00.381087 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqvzv\" (UniqueName: \"kubernetes.io/projected/a6309f04-ff19-4337-911a-3b6125f1bc18-kube-api-access-wqvzv\") pod \"auto-csr-approver-29561368-k94zr\" (UID: \"a6309f04-ff19-4337-911a-3b6125f1bc18\") " pod="openshift-infra/auto-csr-approver-29561368-k94zr" Mar 16 17:28:00 crc kubenswrapper[5120]: I0316 17:28:00.475583 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561368-k94zr" Mar 16 17:28:00 crc kubenswrapper[5120]: I0316 17:28:00.891770 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561368-k94zr"] Mar 16 17:28:01 crc kubenswrapper[5120]: I0316 17:28:01.046592 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561368-k94zr" event={"ID":"a6309f04-ff19-4337-911a-3b6125f1bc18","Type":"ContainerStarted","Data":"39f6faa2d3b6f7a34069c564a7472e7a8ac84a27fccb8d7a25d9ad1447294f28"} Mar 16 17:28:03 crc kubenswrapper[5120]: I0316 17:28:03.067904 5120 generic.go:358] "Generic (PLEG): container finished" podID="a6309f04-ff19-4337-911a-3b6125f1bc18" containerID="5d5b640e46450ed8ce04cf6f90f619d4921f4277cd35008ef6120182974b799f" exitCode=0 Mar 16 17:28:03 crc kubenswrapper[5120]: I0316 17:28:03.068118 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561368-k94zr" event={"ID":"a6309f04-ff19-4337-911a-3b6125f1bc18","Type":"ContainerDied","Data":"5d5b640e46450ed8ce04cf6f90f619d4921f4277cd35008ef6120182974b799f"} Mar 16 17:28:04 crc kubenswrapper[5120]: I0316 17:28:04.387037 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561368-k94zr" Mar 16 17:28:04 crc kubenswrapper[5120]: I0316 17:28:04.542001 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wqvzv\" (UniqueName: \"kubernetes.io/projected/a6309f04-ff19-4337-911a-3b6125f1bc18-kube-api-access-wqvzv\") pod \"a6309f04-ff19-4337-911a-3b6125f1bc18\" (UID: \"a6309f04-ff19-4337-911a-3b6125f1bc18\") " Mar 16 17:28:04 crc kubenswrapper[5120]: I0316 17:28:04.548872 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6309f04-ff19-4337-911a-3b6125f1bc18-kube-api-access-wqvzv" (OuterVolumeSpecName: "kube-api-access-wqvzv") pod "a6309f04-ff19-4337-911a-3b6125f1bc18" (UID: "a6309f04-ff19-4337-911a-3b6125f1bc18"). InnerVolumeSpecName "kube-api-access-wqvzv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:28:04 crc kubenswrapper[5120]: I0316 17:28:04.644400 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wqvzv\" (UniqueName: \"kubernetes.io/projected/a6309f04-ff19-4337-911a-3b6125f1bc18-kube-api-access-wqvzv\") on node \"crc\" DevicePath \"\"" Mar 16 17:28:05 crc kubenswrapper[5120]: I0316 17:28:05.037923 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6f5787b9d7-pc75p" Mar 16 17:28:05 crc kubenswrapper[5120]: I0316 17:28:05.095347 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-77f4d697b7-gkzvd"] Mar 16 17:28:05 crc kubenswrapper[5120]: I0316 17:28:05.095579 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-77f4d697b7-gkzvd" podUID="6a403755-b706-4572-8118-bf6263ddf75e" containerName="dnsmasq-dns" containerID="cri-o://5718e0b9e8e64d206689ddba22adf887132c9543078f40af9e83abce9cbe6a67" gracePeriod=10 Mar 16 17:28:05 crc kubenswrapper[5120]: I0316 17:28:05.103799 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561368-k94zr" event={"ID":"a6309f04-ff19-4337-911a-3b6125f1bc18","Type":"ContainerDied","Data":"39f6faa2d3b6f7a34069c564a7472e7a8ac84a27fccb8d7a25d9ad1447294f28"} Mar 16 17:28:05 crc kubenswrapper[5120]: I0316 17:28:05.103844 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="39f6faa2d3b6f7a34069c564a7472e7a8ac84a27fccb8d7a25d9ad1447294f28" Mar 16 17:28:05 crc kubenswrapper[5120]: I0316 17:28:05.103916 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561368-k94zr" Mar 16 17:28:05 crc kubenswrapper[5120]: I0316 17:28:05.459795 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-infra/auto-csr-approver-29561362-wh99d"] Mar 16 17:28:05 crc kubenswrapper[5120]: I0316 17:28:05.467260 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-infra/auto-csr-approver-29561362-wh99d"] Mar 16 17:28:05 crc kubenswrapper[5120]: I0316 17:28:05.522345 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-77f4d697b7-gkzvd" Mar 16 17:28:05 crc kubenswrapper[5120]: I0316 17:28:05.570691 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rjnwg\" (UniqueName: \"kubernetes.io/projected/6a403755-b706-4572-8118-bf6263ddf75e-kube-api-access-rjnwg\") pod \"6a403755-b706-4572-8118-bf6263ddf75e\" (UID: \"6a403755-b706-4572-8118-bf6263ddf75e\") " Mar 16 17:28:05 crc kubenswrapper[5120]: I0316 17:28:05.570837 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6a403755-b706-4572-8118-bf6263ddf75e-config\") pod \"6a403755-b706-4572-8118-bf6263ddf75e\" (UID: \"6a403755-b706-4572-8118-bf6263ddf75e\") " Mar 16 17:28:05 crc kubenswrapper[5120]: I0316 17:28:05.570898 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/6a403755-b706-4572-8118-bf6263ddf75e-dnsmasq-svc\") pod \"6a403755-b706-4572-8118-bf6263ddf75e\" (UID: \"6a403755-b706-4572-8118-bf6263ddf75e\") " Mar 16 17:28:05 crc kubenswrapper[5120]: I0316 17:28:05.571450 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"openstack-edpm-tls\" (UniqueName: \"kubernetes.io/configmap/6a403755-b706-4572-8118-bf6263ddf75e-openstack-edpm-tls\") pod \"6a403755-b706-4572-8118-bf6263ddf75e\" (UID: \"6a403755-b706-4572-8118-bf6263ddf75e\") " Mar 16 17:28:05 crc kubenswrapper[5120]: I0316 17:28:05.577600 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a403755-b706-4572-8118-bf6263ddf75e-kube-api-access-rjnwg" (OuterVolumeSpecName: "kube-api-access-rjnwg") pod "6a403755-b706-4572-8118-bf6263ddf75e" (UID: "6a403755-b706-4572-8118-bf6263ddf75e"). InnerVolumeSpecName "kube-api-access-rjnwg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:28:05 crc kubenswrapper[5120]: I0316 17:28:05.610329 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a403755-b706-4572-8118-bf6263ddf75e-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "6a403755-b706-4572-8118-bf6263ddf75e" (UID: "6a403755-b706-4572-8118-bf6263ddf75e"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:28:05 crc kubenswrapper[5120]: I0316 17:28:05.614376 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a403755-b706-4572-8118-bf6263ddf75e-openstack-edpm-tls" (OuterVolumeSpecName: "openstack-edpm-tls") pod "6a403755-b706-4572-8118-bf6263ddf75e" (UID: "6a403755-b706-4572-8118-bf6263ddf75e"). InnerVolumeSpecName "openstack-edpm-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:28:05 crc kubenswrapper[5120]: I0316 17:28:05.614960 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a403755-b706-4572-8118-bf6263ddf75e-config" (OuterVolumeSpecName: "config") pod "6a403755-b706-4572-8118-bf6263ddf75e" (UID: "6a403755-b706-4572-8118-bf6263ddf75e"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:28:05 crc kubenswrapper[5120]: I0316 17:28:05.674891 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rjnwg\" (UniqueName: \"kubernetes.io/projected/6a403755-b706-4572-8118-bf6263ddf75e-kube-api-access-rjnwg\") on node \"crc\" DevicePath \"\"" Mar 16 17:28:05 crc kubenswrapper[5120]: I0316 17:28:05.674940 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6a403755-b706-4572-8118-bf6263ddf75e-config\") on node \"crc\" DevicePath \"\"" Mar 16 17:28:05 crc kubenswrapper[5120]: I0316 17:28:05.674954 5120 reconciler_common.go:299] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/6a403755-b706-4572-8118-bf6263ddf75e-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Mar 16 17:28:05 crc kubenswrapper[5120]: I0316 17:28:05.674965 5120 reconciler_common.go:299] "Volume detached for volume \"openstack-edpm-tls\" (UniqueName: \"kubernetes.io/configmap/6a403755-b706-4572-8118-bf6263ddf75e-openstack-edpm-tls\") on node \"crc\" DevicePath \"\"" Mar 16 17:28:06 crc kubenswrapper[5120]: I0316 17:28:06.117406 5120 generic.go:358] "Generic (PLEG): container finished" podID="6a403755-b706-4572-8118-bf6263ddf75e" containerID="5718e0b9e8e64d206689ddba22adf887132c9543078f40af9e83abce9cbe6a67" exitCode=0 Mar 16 17:28:06 crc kubenswrapper[5120]: I0316 17:28:06.117504 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-77f4d697b7-gkzvd" event={"ID":"6a403755-b706-4572-8118-bf6263ddf75e","Type":"ContainerDied","Data":"5718e0b9e8e64d206689ddba22adf887132c9543078f40af9e83abce9cbe6a67"} Mar 16 17:28:06 crc kubenswrapper[5120]: I0316 17:28:06.117527 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-77f4d697b7-gkzvd" Mar 16 17:28:06 crc kubenswrapper[5120]: I0316 17:28:06.117736 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-77f4d697b7-gkzvd" event={"ID":"6a403755-b706-4572-8118-bf6263ddf75e","Type":"ContainerDied","Data":"67c0cc38b8a16157dcf5f29992fbe24c63840963668102a5fd3ea587a0738026"} Mar 16 17:28:06 crc kubenswrapper[5120]: I0316 17:28:06.117798 5120 scope.go:117] "RemoveContainer" containerID="5718e0b9e8e64d206689ddba22adf887132c9543078f40af9e83abce9cbe6a67" Mar 16 17:28:06 crc kubenswrapper[5120]: I0316 17:28:06.153279 5120 scope.go:117] "RemoveContainer" containerID="be06367ea06aff1bb28b81c58f95d500ec0b6f790eeee1cbc7499da6e93bcbfe" Mar 16 17:28:06 crc kubenswrapper[5120]: I0316 17:28:06.153482 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-77f4d697b7-gkzvd"] Mar 16 17:28:06 crc kubenswrapper[5120]: I0316 17:28:06.161479 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-77f4d697b7-gkzvd"] Mar 16 17:28:06 crc kubenswrapper[5120]: I0316 17:28:06.180277 5120 scope.go:117] "RemoveContainer" containerID="5718e0b9e8e64d206689ddba22adf887132c9543078f40af9e83abce9cbe6a67" Mar 16 17:28:06 crc kubenswrapper[5120]: E0316 17:28:06.180936 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5718e0b9e8e64d206689ddba22adf887132c9543078f40af9e83abce9cbe6a67\": container with ID starting with 5718e0b9e8e64d206689ddba22adf887132c9543078f40af9e83abce9cbe6a67 not found: ID does not exist" containerID="5718e0b9e8e64d206689ddba22adf887132c9543078f40af9e83abce9cbe6a67" Mar 16 17:28:06 crc kubenswrapper[5120]: I0316 17:28:06.180986 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5718e0b9e8e64d206689ddba22adf887132c9543078f40af9e83abce9cbe6a67"} err="failed to get container status \"5718e0b9e8e64d206689ddba22adf887132c9543078f40af9e83abce9cbe6a67\": rpc error: code = NotFound desc = could not find container \"5718e0b9e8e64d206689ddba22adf887132c9543078f40af9e83abce9cbe6a67\": container with ID starting with 5718e0b9e8e64d206689ddba22adf887132c9543078f40af9e83abce9cbe6a67 not found: ID does not exist" Mar 16 17:28:06 crc kubenswrapper[5120]: I0316 17:28:06.181016 5120 scope.go:117] "RemoveContainer" containerID="be06367ea06aff1bb28b81c58f95d500ec0b6f790eeee1cbc7499da6e93bcbfe" Mar 16 17:28:06 crc kubenswrapper[5120]: E0316 17:28:06.181377 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"be06367ea06aff1bb28b81c58f95d500ec0b6f790eeee1cbc7499da6e93bcbfe\": container with ID starting with be06367ea06aff1bb28b81c58f95d500ec0b6f790eeee1cbc7499da6e93bcbfe not found: ID does not exist" containerID="be06367ea06aff1bb28b81c58f95d500ec0b6f790eeee1cbc7499da6e93bcbfe" Mar 16 17:28:06 crc kubenswrapper[5120]: I0316 17:28:06.181410 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be06367ea06aff1bb28b81c58f95d500ec0b6f790eeee1cbc7499da6e93bcbfe"} err="failed to get container status \"be06367ea06aff1bb28b81c58f95d500ec0b6f790eeee1cbc7499da6e93bcbfe\": rpc error: code = NotFound desc = could not find container \"be06367ea06aff1bb28b81c58f95d500ec0b6f790eeee1cbc7499da6e93bcbfe\": container with ID starting with be06367ea06aff1bb28b81c58f95d500ec0b6f790eeee1cbc7499da6e93bcbfe not found: ID does not exist" Mar 16 17:28:06 crc kubenswrapper[5120]: I0316 17:28:06.673398 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a403755-b706-4572-8118-bf6263ddf75e" path="/var/lib/kubelet/pods/6a403755-b706-4572-8118-bf6263ddf75e/volumes" Mar 16 17:28:06 crc kubenswrapper[5120]: I0316 17:28:06.674066 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="90574d91-311c-41c6-b0aa-335110f0d600" path="/var/lib/kubelet/pods/90574d91-311c-41c6-b0aa-335110f0d600/volumes" Mar 16 17:28:08 crc kubenswrapper[5120]: I0316 17:28:08.034467 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-openstack-edpm-tls-jbszj"] Mar 16 17:28:08 crc kubenswrapper[5120]: I0316 17:28:08.037293 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6309f04-ff19-4337-911a-3b6125f1bc18" containerName="oc" Mar 16 17:28:08 crc kubenswrapper[5120]: I0316 17:28:08.037330 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6309f04-ff19-4337-911a-3b6125f1bc18" containerName="oc" Mar 16 17:28:08 crc kubenswrapper[5120]: I0316 17:28:08.037394 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a403755-b706-4572-8118-bf6263ddf75e" containerName="init" Mar 16 17:28:08 crc kubenswrapper[5120]: I0316 17:28:08.037421 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a403755-b706-4572-8118-bf6263ddf75e" containerName="init" Mar 16 17:28:08 crc kubenswrapper[5120]: I0316 17:28:08.037521 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a403755-b706-4572-8118-bf6263ddf75e" containerName="dnsmasq-dns" Mar 16 17:28:08 crc kubenswrapper[5120]: I0316 17:28:08.037531 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a403755-b706-4572-8118-bf6263ddf75e" containerName="dnsmasq-dns" Mar 16 17:28:08 crc kubenswrapper[5120]: I0316 17:28:08.037867 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="6a403755-b706-4572-8118-bf6263ddf75e" containerName="dnsmasq-dns" Mar 16 17:28:08 crc kubenswrapper[5120]: I0316 17:28:08.037893 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="a6309f04-ff19-4337-911a-3b6125f1bc18" containerName="oc" Mar 16 17:28:08 crc kubenswrapper[5120]: I0316 17:28:08.068060 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-openstack-edpm-tls-jbszj" Mar 16 17:28:08 crc kubenswrapper[5120]: I0316 17:28:08.071982 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"openstack-edpm-tls-tls-dnsnames-second-certs-0\"" Mar 16 17:28:08 crc kubenswrapper[5120]: I0316 17:28:08.072565 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplanenodeset-openstack-edpm-tls\"" Mar 16 17:28:08 crc kubenswrapper[5120]: I0316 17:28:08.072734 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-aee-default-env\"" Mar 16 17:28:08 crc kubenswrapper[5120]: I0316 17:28:08.073339 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"combined-ca-bundle\"" Mar 16 17:28:08 crc kubenswrapper[5120]: I0316 17:28:08.073678 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplane-ansible-ssh-private-key-secret\"" Mar 16 17:28:08 crc kubenswrapper[5120]: I0316 17:28:08.075399 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"openstack-edpm-tls-tls-dnsnames-default-certs-0\"" Mar 16 17:28:08 crc kubenswrapper[5120]: I0316 17:28:08.075626 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"openstack-edpm-tls-dockercfg-kbq9x\"" Mar 16 17:28:08 crc kubenswrapper[5120]: I0316 17:28:08.078299 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-openstack-edpm-tls-jbszj"] Mar 16 17:28:08 crc kubenswrapper[5120]: I0316 17:28:08.134688 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/5ef31d0f-8688-4e28-afd0-407f1217fce0-inventory\") pod \"install-certs-ovrd-openstack-edpm-tls-openstack-edpm-tls-jbszj\" (UID: \"5ef31d0f-8688-4e28-afd0-407f1217fce0\") " pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-openstack-edpm-tls-jbszj" Mar 16 17:28:08 crc kubenswrapper[5120]: I0316 17:28:08.134792 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"install-certs-ovrd-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5ef31d0f-8688-4e28-afd0-407f1217fce0-install-certs-ovrd-combined-ca-bundle\") pod \"install-certs-ovrd-openstack-edpm-tls-openstack-edpm-tls-jbszj\" (UID: \"5ef31d0f-8688-4e28-afd0-407f1217fce0\") " pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-openstack-edpm-tls-jbszj" Mar 16 17:28:08 crc kubenswrapper[5120]: I0316 17:28:08.134925 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key-openstack-edpm-tls\" (UniqueName: \"kubernetes.io/secret/5ef31d0f-8688-4e28-afd0-407f1217fce0-ssh-key-openstack-edpm-tls\") pod \"install-certs-ovrd-openstack-edpm-tls-openstack-edpm-tls-jbszj\" (UID: \"5ef31d0f-8688-4e28-afd0-407f1217fce0\") " pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-openstack-edpm-tls-jbszj" Mar 16 17:28:08 crc kubenswrapper[5120]: I0316 17:28:08.134961 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mdnc\" (UniqueName: \"kubernetes.io/projected/5ef31d0f-8688-4e28-afd0-407f1217fce0-kube-api-access-7mdnc\") pod \"install-certs-ovrd-openstack-edpm-tls-openstack-edpm-tls-jbszj\" (UID: \"5ef31d0f-8688-4e28-afd0-407f1217fce0\") " pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-openstack-edpm-tls-jbszj" Mar 16 17:28:08 crc kubenswrapper[5120]: I0316 17:28:08.135094 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-edpm-tls-tls-dnsnames-default-certs-0\" (UniqueName: \"kubernetes.io/projected/5ef31d0f-8688-4e28-afd0-407f1217fce0-openstack-edpm-tls-tls-dnsnames-default-certs-0\") pod \"install-certs-ovrd-openstack-edpm-tls-openstack-edpm-tls-jbszj\" (UID: \"5ef31d0f-8688-4e28-afd0-407f1217fce0\") " pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-openstack-edpm-tls-jbszj" Mar 16 17:28:08 crc kubenswrapper[5120]: I0316 17:28:08.135125 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-edpm-tls-tls-dnsnames-second-certs-0\" (UniqueName: \"kubernetes.io/projected/5ef31d0f-8688-4e28-afd0-407f1217fce0-openstack-edpm-tls-tls-dnsnames-second-certs-0\") pod \"install-certs-ovrd-openstack-edpm-tls-openstack-edpm-tls-jbszj\" (UID: \"5ef31d0f-8688-4e28-afd0-407f1217fce0\") " pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-openstack-edpm-tls-jbszj" Mar 16 17:28:08 crc kubenswrapper[5120]: I0316 17:28:08.135206 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-dnsnames-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5ef31d0f-8688-4e28-afd0-407f1217fce0-tls-dnsnames-combined-ca-bundle\") pod \"install-certs-ovrd-openstack-edpm-tls-openstack-edpm-tls-jbszj\" (UID: \"5ef31d0f-8688-4e28-afd0-407f1217fce0\") " pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-openstack-edpm-tls-jbszj" Mar 16 17:28:08 crc kubenswrapper[5120]: I0316 17:28:08.238678 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ssh-key-openstack-edpm-tls\" (UniqueName: \"kubernetes.io/secret/5ef31d0f-8688-4e28-afd0-407f1217fce0-ssh-key-openstack-edpm-tls\") pod \"install-certs-ovrd-openstack-edpm-tls-openstack-edpm-tls-jbszj\" (UID: \"5ef31d0f-8688-4e28-afd0-407f1217fce0\") " pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-openstack-edpm-tls-jbszj" Mar 16 17:28:08 crc kubenswrapper[5120]: I0316 17:28:08.238823 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7mdnc\" (UniqueName: \"kubernetes.io/projected/5ef31d0f-8688-4e28-afd0-407f1217fce0-kube-api-access-7mdnc\") pod \"install-certs-ovrd-openstack-edpm-tls-openstack-edpm-tls-jbszj\" (UID: \"5ef31d0f-8688-4e28-afd0-407f1217fce0\") " pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-openstack-edpm-tls-jbszj" Mar 16 17:28:08 crc kubenswrapper[5120]: I0316 17:28:08.238921 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openstack-edpm-tls-tls-dnsnames-default-certs-0\" (UniqueName: \"kubernetes.io/projected/5ef31d0f-8688-4e28-afd0-407f1217fce0-openstack-edpm-tls-tls-dnsnames-default-certs-0\") pod \"install-certs-ovrd-openstack-edpm-tls-openstack-edpm-tls-jbszj\" (UID: \"5ef31d0f-8688-4e28-afd0-407f1217fce0\") " pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-openstack-edpm-tls-jbszj" Mar 16 17:28:08 crc kubenswrapper[5120]: I0316 17:28:08.238955 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openstack-edpm-tls-tls-dnsnames-second-certs-0\" (UniqueName: \"kubernetes.io/projected/5ef31d0f-8688-4e28-afd0-407f1217fce0-openstack-edpm-tls-tls-dnsnames-second-certs-0\") pod \"install-certs-ovrd-openstack-edpm-tls-openstack-edpm-tls-jbszj\" (UID: \"5ef31d0f-8688-4e28-afd0-407f1217fce0\") " pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-openstack-edpm-tls-jbszj" Mar 16 17:28:08 crc kubenswrapper[5120]: I0316 17:28:08.239043 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-dnsnames-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5ef31d0f-8688-4e28-afd0-407f1217fce0-tls-dnsnames-combined-ca-bundle\") pod \"install-certs-ovrd-openstack-edpm-tls-openstack-edpm-tls-jbszj\" (UID: \"5ef31d0f-8688-4e28-afd0-407f1217fce0\") " pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-openstack-edpm-tls-jbszj" Mar 16 17:28:08 crc kubenswrapper[5120]: I0316 17:28:08.239168 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/5ef31d0f-8688-4e28-afd0-407f1217fce0-inventory\") pod \"install-certs-ovrd-openstack-edpm-tls-openstack-edpm-tls-jbszj\" (UID: \"5ef31d0f-8688-4e28-afd0-407f1217fce0\") " pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-openstack-edpm-tls-jbszj" Mar 16 17:28:08 crc kubenswrapper[5120]: I0316 17:28:08.239242 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"install-certs-ovrd-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5ef31d0f-8688-4e28-afd0-407f1217fce0-install-certs-ovrd-combined-ca-bundle\") pod \"install-certs-ovrd-openstack-edpm-tls-openstack-edpm-tls-jbszj\" (UID: \"5ef31d0f-8688-4e28-afd0-407f1217fce0\") " pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-openstack-edpm-tls-jbszj" Mar 16 17:28:08 crc kubenswrapper[5120]: I0316 17:28:08.246738 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/5ef31d0f-8688-4e28-afd0-407f1217fce0-inventory\") pod \"install-certs-ovrd-openstack-edpm-tls-openstack-edpm-tls-jbszj\" (UID: \"5ef31d0f-8688-4e28-afd0-407f1217fce0\") " pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-openstack-edpm-tls-jbszj" Mar 16 17:28:08 crc kubenswrapper[5120]: I0316 17:28:08.246813 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"install-certs-ovrd-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5ef31d0f-8688-4e28-afd0-407f1217fce0-install-certs-ovrd-combined-ca-bundle\") pod \"install-certs-ovrd-openstack-edpm-tls-openstack-edpm-tls-jbszj\" (UID: \"5ef31d0f-8688-4e28-afd0-407f1217fce0\") " pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-openstack-edpm-tls-jbszj" Mar 16 17:28:08 crc kubenswrapper[5120]: I0316 17:28:08.247170 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ssh-key-openstack-edpm-tls\" (UniqueName: \"kubernetes.io/secret/5ef31d0f-8688-4e28-afd0-407f1217fce0-ssh-key-openstack-edpm-tls\") pod \"install-certs-ovrd-openstack-edpm-tls-openstack-edpm-tls-jbszj\" (UID: \"5ef31d0f-8688-4e28-afd0-407f1217fce0\") " pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-openstack-edpm-tls-jbszj" Mar 16 17:28:08 crc kubenswrapper[5120]: I0316 17:28:08.248387 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openstack-edpm-tls-tls-dnsnames-second-certs-0\" (UniqueName: \"kubernetes.io/projected/5ef31d0f-8688-4e28-afd0-407f1217fce0-openstack-edpm-tls-tls-dnsnames-second-certs-0\") pod \"install-certs-ovrd-openstack-edpm-tls-openstack-edpm-tls-jbszj\" (UID: \"5ef31d0f-8688-4e28-afd0-407f1217fce0\") " pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-openstack-edpm-tls-jbszj" Mar 16 17:28:08 crc kubenswrapper[5120]: I0316 17:28:08.249516 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-dnsnames-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5ef31d0f-8688-4e28-afd0-407f1217fce0-tls-dnsnames-combined-ca-bundle\") pod \"install-certs-ovrd-openstack-edpm-tls-openstack-edpm-tls-jbszj\" (UID: \"5ef31d0f-8688-4e28-afd0-407f1217fce0\") " pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-openstack-edpm-tls-jbszj" Mar 16 17:28:08 crc kubenswrapper[5120]: I0316 17:28:08.250540 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openstack-edpm-tls-tls-dnsnames-default-certs-0\" (UniqueName: \"kubernetes.io/projected/5ef31d0f-8688-4e28-afd0-407f1217fce0-openstack-edpm-tls-tls-dnsnames-default-certs-0\") pod \"install-certs-ovrd-openstack-edpm-tls-openstack-edpm-tls-jbszj\" (UID: \"5ef31d0f-8688-4e28-afd0-407f1217fce0\") " pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-openstack-edpm-tls-jbszj" Mar 16 17:28:08 crc kubenswrapper[5120]: I0316 17:28:08.265915 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mdnc\" (UniqueName: \"kubernetes.io/projected/5ef31d0f-8688-4e28-afd0-407f1217fce0-kube-api-access-7mdnc\") pod \"install-certs-ovrd-openstack-edpm-tls-openstack-edpm-tls-jbszj\" (UID: \"5ef31d0f-8688-4e28-afd0-407f1217fce0\") " pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-openstack-edpm-tls-jbszj" Mar 16 17:28:08 crc kubenswrapper[5120]: I0316 17:28:08.395749 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-openstack-edpm-tls-jbszj" Mar 16 17:28:08 crc kubenswrapper[5120]: E0316 17:28:08.496921 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1304889 actualBytes=10240 Mar 16 17:28:08 crc kubenswrapper[5120]: I0316 17:28:08.829979 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-openstack-edpm-tls-jbszj"] Mar 16 17:28:08 crc kubenswrapper[5120]: W0316 17:28:08.834324 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5ef31d0f_8688_4e28_afd0_407f1217fce0.slice/crio-7fc7cfd2c2a12aeb85615b073814838c73e6c2b592790ed3358501e08972b852 WatchSource:0}: Error finding container 7fc7cfd2c2a12aeb85615b073814838c73e6c2b592790ed3358501e08972b852: Status 404 returned error can't find the container with id 7fc7cfd2c2a12aeb85615b073814838c73e6c2b592790ed3358501e08972b852 Mar 16 17:28:09 crc kubenswrapper[5120]: I0316 17:28:09.154797 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-openstack-edpm-tls-jbszj" event={"ID":"5ef31d0f-8688-4e28-afd0-407f1217fce0","Type":"ContainerStarted","Data":"7fc7cfd2c2a12aeb85615b073814838c73e6c2b592790ed3358501e08972b852"} Mar 16 17:28:10 crc kubenswrapper[5120]: I0316 17:28:10.164926 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-openstack-edpm-tls-jbszj" event={"ID":"5ef31d0f-8688-4e28-afd0-407f1217fce0","Type":"ContainerStarted","Data":"7147fb70d7eff7d193b24eeaf61cecb82183c9f95fb6068bd666cb6bd4a3c594"} Mar 16 17:28:10 crc kubenswrapper[5120]: I0316 17:28:10.192356 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-openstack-edpm-tls-jbszj" podStartSLOduration=1.721669034 podStartE2EDuration="2.192335838s" podCreationTimestamp="2026-03-16 17:28:08 +0000 UTC" firstStartedPulling="2026-03-16 17:28:08.836734746 +0000 UTC m=+6990.990666403" lastFinishedPulling="2026-03-16 17:28:09.30740155 +0000 UTC m=+6991.461333207" observedRunningTime="2026-03-16 17:28:10.183636931 +0000 UTC m=+6992.337568578" watchObservedRunningTime="2026-03-16 17:28:10.192335838 +0000 UTC m=+6992.346267505" Mar 16 17:28:12 crc kubenswrapper[5120]: I0316 17:28:12.191024 5120 generic.go:358] "Generic (PLEG): container finished" podID="5ef31d0f-8688-4e28-afd0-407f1217fce0" containerID="7147fb70d7eff7d193b24eeaf61cecb82183c9f95fb6068bd666cb6bd4a3c594" exitCode=0 Mar 16 17:28:12 crc kubenswrapper[5120]: I0316 17:28:12.191092 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-openstack-edpm-tls-jbszj" event={"ID":"5ef31d0f-8688-4e28-afd0-407f1217fce0","Type":"ContainerDied","Data":"7147fb70d7eff7d193b24eeaf61cecb82183c9f95fb6068bd666cb6bd4a3c594"} Mar 16 17:28:13 crc kubenswrapper[5120]: I0316 17:28:13.538548 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-openstack-edpm-tls-jbszj" Mar 16 17:28:13 crc kubenswrapper[5120]: I0316 17:28:13.557103 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/5ef31d0f-8688-4e28-afd0-407f1217fce0-inventory\") pod \"5ef31d0f-8688-4e28-afd0-407f1217fce0\" (UID: \"5ef31d0f-8688-4e28-afd0-407f1217fce0\") " Mar 16 17:28:13 crc kubenswrapper[5120]: I0316 17:28:13.557172 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"openstack-edpm-tls-tls-dnsnames-second-certs-0\" (UniqueName: \"kubernetes.io/projected/5ef31d0f-8688-4e28-afd0-407f1217fce0-openstack-edpm-tls-tls-dnsnames-second-certs-0\") pod \"5ef31d0f-8688-4e28-afd0-407f1217fce0\" (UID: \"5ef31d0f-8688-4e28-afd0-407f1217fce0\") " Mar 16 17:28:13 crc kubenswrapper[5120]: I0316 17:28:13.557298 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"install-certs-ovrd-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5ef31d0f-8688-4e28-afd0-407f1217fce0-install-certs-ovrd-combined-ca-bundle\") pod \"5ef31d0f-8688-4e28-afd0-407f1217fce0\" (UID: \"5ef31d0f-8688-4e28-afd0-407f1217fce0\") " Mar 16 17:28:13 crc kubenswrapper[5120]: I0316 17:28:13.557430 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7mdnc\" (UniqueName: \"kubernetes.io/projected/5ef31d0f-8688-4e28-afd0-407f1217fce0-kube-api-access-7mdnc\") pod \"5ef31d0f-8688-4e28-afd0-407f1217fce0\" (UID: \"5ef31d0f-8688-4e28-afd0-407f1217fce0\") " Mar 16 17:28:13 crc kubenswrapper[5120]: I0316 17:28:13.557481 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-dnsnames-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5ef31d0f-8688-4e28-afd0-407f1217fce0-tls-dnsnames-combined-ca-bundle\") pod \"5ef31d0f-8688-4e28-afd0-407f1217fce0\" (UID: \"5ef31d0f-8688-4e28-afd0-407f1217fce0\") " Mar 16 17:28:13 crc kubenswrapper[5120]: I0316 17:28:13.557589 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"openstack-edpm-tls-tls-dnsnames-default-certs-0\" (UniqueName: \"kubernetes.io/projected/5ef31d0f-8688-4e28-afd0-407f1217fce0-openstack-edpm-tls-tls-dnsnames-default-certs-0\") pod \"5ef31d0f-8688-4e28-afd0-407f1217fce0\" (UID: \"5ef31d0f-8688-4e28-afd0-407f1217fce0\") " Mar 16 17:28:13 crc kubenswrapper[5120]: I0316 17:28:13.557816 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ssh-key-openstack-edpm-tls\" (UniqueName: \"kubernetes.io/secret/5ef31d0f-8688-4e28-afd0-407f1217fce0-ssh-key-openstack-edpm-tls\") pod \"5ef31d0f-8688-4e28-afd0-407f1217fce0\" (UID: \"5ef31d0f-8688-4e28-afd0-407f1217fce0\") " Mar 16 17:28:13 crc kubenswrapper[5120]: I0316 17:28:13.564145 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ef31d0f-8688-4e28-afd0-407f1217fce0-install-certs-ovrd-combined-ca-bundle" (OuterVolumeSpecName: "install-certs-ovrd-combined-ca-bundle") pod "5ef31d0f-8688-4e28-afd0-407f1217fce0" (UID: "5ef31d0f-8688-4e28-afd0-407f1217fce0"). InnerVolumeSpecName "install-certs-ovrd-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:28:13 crc kubenswrapper[5120]: I0316 17:28:13.564270 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ef31d0f-8688-4e28-afd0-407f1217fce0-tls-dnsnames-combined-ca-bundle" (OuterVolumeSpecName: "tls-dnsnames-combined-ca-bundle") pod "5ef31d0f-8688-4e28-afd0-407f1217fce0" (UID: "5ef31d0f-8688-4e28-afd0-407f1217fce0"). InnerVolumeSpecName "tls-dnsnames-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:28:13 crc kubenswrapper[5120]: I0316 17:28:13.566435 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ef31d0f-8688-4e28-afd0-407f1217fce0-openstack-edpm-tls-tls-dnsnames-second-certs-0" (OuterVolumeSpecName: "openstack-edpm-tls-tls-dnsnames-second-certs-0") pod "5ef31d0f-8688-4e28-afd0-407f1217fce0" (UID: "5ef31d0f-8688-4e28-afd0-407f1217fce0"). InnerVolumeSpecName "openstack-edpm-tls-tls-dnsnames-second-certs-0". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:28:13 crc kubenswrapper[5120]: I0316 17:28:13.567973 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ef31d0f-8688-4e28-afd0-407f1217fce0-openstack-edpm-tls-tls-dnsnames-default-certs-0" (OuterVolumeSpecName: "openstack-edpm-tls-tls-dnsnames-default-certs-0") pod "5ef31d0f-8688-4e28-afd0-407f1217fce0" (UID: "5ef31d0f-8688-4e28-afd0-407f1217fce0"). InnerVolumeSpecName "openstack-edpm-tls-tls-dnsnames-default-certs-0". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:28:13 crc kubenswrapper[5120]: I0316 17:28:13.569046 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ef31d0f-8688-4e28-afd0-407f1217fce0-kube-api-access-7mdnc" (OuterVolumeSpecName: "kube-api-access-7mdnc") pod "5ef31d0f-8688-4e28-afd0-407f1217fce0" (UID: "5ef31d0f-8688-4e28-afd0-407f1217fce0"). InnerVolumeSpecName "kube-api-access-7mdnc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:28:13 crc kubenswrapper[5120]: I0316 17:28:13.581497 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ef31d0f-8688-4e28-afd0-407f1217fce0-inventory" (OuterVolumeSpecName: "inventory") pod "5ef31d0f-8688-4e28-afd0-407f1217fce0" (UID: "5ef31d0f-8688-4e28-afd0-407f1217fce0"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:28:13 crc kubenswrapper[5120]: I0316 17:28:13.585451 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ef31d0f-8688-4e28-afd0-407f1217fce0-ssh-key-openstack-edpm-tls" (OuterVolumeSpecName: "ssh-key-openstack-edpm-tls") pod "5ef31d0f-8688-4e28-afd0-407f1217fce0" (UID: "5ef31d0f-8688-4e28-afd0-407f1217fce0"). InnerVolumeSpecName "ssh-key-openstack-edpm-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:28:13 crc kubenswrapper[5120]: I0316 17:28:13.659746 5120 reconciler_common.go:299] "Volume detached for volume \"openstack-edpm-tls-tls-dnsnames-default-certs-0\" (UniqueName: \"kubernetes.io/projected/5ef31d0f-8688-4e28-afd0-407f1217fce0-openstack-edpm-tls-tls-dnsnames-default-certs-0\") on node \"crc\" DevicePath \"\"" Mar 16 17:28:13 crc kubenswrapper[5120]: I0316 17:28:13.659803 5120 reconciler_common.go:299] "Volume detached for volume \"ssh-key-openstack-edpm-tls\" (UniqueName: \"kubernetes.io/secret/5ef31d0f-8688-4e28-afd0-407f1217fce0-ssh-key-openstack-edpm-tls\") on node \"crc\" DevicePath \"\"" Mar 16 17:28:13 crc kubenswrapper[5120]: I0316 17:28:13.659814 5120 reconciler_common.go:299] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/5ef31d0f-8688-4e28-afd0-407f1217fce0-inventory\") on node \"crc\" DevicePath \"\"" Mar 16 17:28:13 crc kubenswrapper[5120]: I0316 17:28:13.659829 5120 reconciler_common.go:299] "Volume detached for volume \"openstack-edpm-tls-tls-dnsnames-second-certs-0\" (UniqueName: \"kubernetes.io/projected/5ef31d0f-8688-4e28-afd0-407f1217fce0-openstack-edpm-tls-tls-dnsnames-second-certs-0\") on node \"crc\" DevicePath \"\"" Mar 16 17:28:13 crc kubenswrapper[5120]: I0316 17:28:13.659842 5120 reconciler_common.go:299] "Volume detached for volume \"install-certs-ovrd-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5ef31d0f-8688-4e28-afd0-407f1217fce0-install-certs-ovrd-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:28:13 crc kubenswrapper[5120]: I0316 17:28:13.659855 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7mdnc\" (UniqueName: \"kubernetes.io/projected/5ef31d0f-8688-4e28-afd0-407f1217fce0-kube-api-access-7mdnc\") on node \"crc\" DevicePath \"\"" Mar 16 17:28:13 crc kubenswrapper[5120]: I0316 17:28:13.659865 5120 reconciler_common.go:299] "Volume detached for volume \"tls-dnsnames-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5ef31d0f-8688-4e28-afd0-407f1217fce0-tls-dnsnames-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:28:14 crc kubenswrapper[5120]: I0316 17:28:14.210162 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-openstack-edpm-tls-jbszj" Mar 16 17:28:14 crc kubenswrapper[5120]: I0316 17:28:14.210189 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-openstack-edpm-tls-jbszj" event={"ID":"5ef31d0f-8688-4e28-afd0-407f1217fce0","Type":"ContainerDied","Data":"7fc7cfd2c2a12aeb85615b073814838c73e6c2b592790ed3358501e08972b852"} Mar 16 17:28:14 crc kubenswrapper[5120]: I0316 17:28:14.210226 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7fc7cfd2c2a12aeb85615b073814838c73e6c2b592790ed3358501e08972b852" Mar 16 17:28:14 crc kubenswrapper[5120]: I0316 17:28:14.283673 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/tls-dnsnames-openstack-edpm-tls-openstack-edpm-tls-xbvdp"] Mar 16 17:28:14 crc kubenswrapper[5120]: I0316 17:28:14.284821 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ef31d0f-8688-4e28-afd0-407f1217fce0" containerName="install-certs-ovrd-openstack-edpm-tls-openstack-edpm-tls" Mar 16 17:28:14 crc kubenswrapper[5120]: I0316 17:28:14.284876 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ef31d0f-8688-4e28-afd0-407f1217fce0" containerName="install-certs-ovrd-openstack-edpm-tls-openstack-edpm-tls" Mar 16 17:28:14 crc kubenswrapper[5120]: I0316 17:28:14.285083 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="5ef31d0f-8688-4e28-afd0-407f1217fce0" containerName="install-certs-ovrd-openstack-edpm-tls-openstack-edpm-tls" Mar 16 17:28:14 crc kubenswrapper[5120]: I0316 17:28:14.292872 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/tls-dnsnames-openstack-edpm-tls-openstack-edpm-tls-xbvdp"] Mar 16 17:28:14 crc kubenswrapper[5120]: I0316 17:28:14.292951 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/tls-dnsnames-openstack-edpm-tls-openstack-edpm-tls-xbvdp" Mar 16 17:28:14 crc kubenswrapper[5120]: I0316 17:28:14.296063 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"combined-ca-bundle\"" Mar 16 17:28:14 crc kubenswrapper[5120]: I0316 17:28:14.296326 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"openstack-edpm-tls-dockercfg-kbq9x\"" Mar 16 17:28:14 crc kubenswrapper[5120]: I0316 17:28:14.296818 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-aee-default-env\"" Mar 16 17:28:14 crc kubenswrapper[5120]: I0316 17:28:14.297156 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplane-ansible-ssh-private-key-secret\"" Mar 16 17:28:14 crc kubenswrapper[5120]: I0316 17:28:14.297808 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplanenodeset-openstack-edpm-tls\"" Mar 16 17:28:14 crc kubenswrapper[5120]: I0316 17:28:14.375658 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/5f858691-27a3-4858-adf8-80eaa6b1056f-inventory\") pod \"tls-dnsnames-openstack-edpm-tls-openstack-edpm-tls-xbvdp\" (UID: \"5f858691-27a3-4858-adf8-80eaa6b1056f\") " pod="openstack-kuttl-tests/tls-dnsnames-openstack-edpm-tls-openstack-edpm-tls-xbvdp" Mar 16 17:28:14 crc kubenswrapper[5120]: I0316 17:28:14.376000 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key-openstack-edpm-tls\" (UniqueName: \"kubernetes.io/secret/5f858691-27a3-4858-adf8-80eaa6b1056f-ssh-key-openstack-edpm-tls\") pod \"tls-dnsnames-openstack-edpm-tls-openstack-edpm-tls-xbvdp\" (UID: \"5f858691-27a3-4858-adf8-80eaa6b1056f\") " pod="openstack-kuttl-tests/tls-dnsnames-openstack-edpm-tls-openstack-edpm-tls-xbvdp" Mar 16 17:28:14 crc kubenswrapper[5120]: I0316 17:28:14.376051 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-dnsnames-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5f858691-27a3-4858-adf8-80eaa6b1056f-tls-dnsnames-combined-ca-bundle\") pod \"tls-dnsnames-openstack-edpm-tls-openstack-edpm-tls-xbvdp\" (UID: \"5f858691-27a3-4858-adf8-80eaa6b1056f\") " pod="openstack-kuttl-tests/tls-dnsnames-openstack-edpm-tls-openstack-edpm-tls-xbvdp" Mar 16 17:28:14 crc kubenswrapper[5120]: I0316 17:28:14.376185 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bd9t8\" (UniqueName: \"kubernetes.io/projected/5f858691-27a3-4858-adf8-80eaa6b1056f-kube-api-access-bd9t8\") pod \"tls-dnsnames-openstack-edpm-tls-openstack-edpm-tls-xbvdp\" (UID: \"5f858691-27a3-4858-adf8-80eaa6b1056f\") " pod="openstack-kuttl-tests/tls-dnsnames-openstack-edpm-tls-openstack-edpm-tls-xbvdp" Mar 16 17:28:14 crc kubenswrapper[5120]: I0316 17:28:14.477931 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ssh-key-openstack-edpm-tls\" (UniqueName: \"kubernetes.io/secret/5f858691-27a3-4858-adf8-80eaa6b1056f-ssh-key-openstack-edpm-tls\") pod \"tls-dnsnames-openstack-edpm-tls-openstack-edpm-tls-xbvdp\" (UID: \"5f858691-27a3-4858-adf8-80eaa6b1056f\") " pod="openstack-kuttl-tests/tls-dnsnames-openstack-edpm-tls-openstack-edpm-tls-xbvdp" Mar 16 17:28:14 crc kubenswrapper[5120]: I0316 17:28:14.477978 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-dnsnames-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5f858691-27a3-4858-adf8-80eaa6b1056f-tls-dnsnames-combined-ca-bundle\") pod \"tls-dnsnames-openstack-edpm-tls-openstack-edpm-tls-xbvdp\" (UID: \"5f858691-27a3-4858-adf8-80eaa6b1056f\") " pod="openstack-kuttl-tests/tls-dnsnames-openstack-edpm-tls-openstack-edpm-tls-xbvdp" Mar 16 17:28:14 crc kubenswrapper[5120]: I0316 17:28:14.478067 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bd9t8\" (UniqueName: \"kubernetes.io/projected/5f858691-27a3-4858-adf8-80eaa6b1056f-kube-api-access-bd9t8\") pod \"tls-dnsnames-openstack-edpm-tls-openstack-edpm-tls-xbvdp\" (UID: \"5f858691-27a3-4858-adf8-80eaa6b1056f\") " pod="openstack-kuttl-tests/tls-dnsnames-openstack-edpm-tls-openstack-edpm-tls-xbvdp" Mar 16 17:28:14 crc kubenswrapper[5120]: I0316 17:28:14.478112 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/5f858691-27a3-4858-adf8-80eaa6b1056f-inventory\") pod \"tls-dnsnames-openstack-edpm-tls-openstack-edpm-tls-xbvdp\" (UID: \"5f858691-27a3-4858-adf8-80eaa6b1056f\") " pod="openstack-kuttl-tests/tls-dnsnames-openstack-edpm-tls-openstack-edpm-tls-xbvdp" Mar 16 17:28:14 crc kubenswrapper[5120]: I0316 17:28:14.483463 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ssh-key-openstack-edpm-tls\" (UniqueName: \"kubernetes.io/secret/5f858691-27a3-4858-adf8-80eaa6b1056f-ssh-key-openstack-edpm-tls\") pod \"tls-dnsnames-openstack-edpm-tls-openstack-edpm-tls-xbvdp\" (UID: \"5f858691-27a3-4858-adf8-80eaa6b1056f\") " pod="openstack-kuttl-tests/tls-dnsnames-openstack-edpm-tls-openstack-edpm-tls-xbvdp" Mar 16 17:28:14 crc kubenswrapper[5120]: I0316 17:28:14.485188 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/5f858691-27a3-4858-adf8-80eaa6b1056f-inventory\") pod \"tls-dnsnames-openstack-edpm-tls-openstack-edpm-tls-xbvdp\" (UID: \"5f858691-27a3-4858-adf8-80eaa6b1056f\") " pod="openstack-kuttl-tests/tls-dnsnames-openstack-edpm-tls-openstack-edpm-tls-xbvdp" Mar 16 17:28:14 crc kubenswrapper[5120]: I0316 17:28:14.485740 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-dnsnames-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5f858691-27a3-4858-adf8-80eaa6b1056f-tls-dnsnames-combined-ca-bundle\") pod \"tls-dnsnames-openstack-edpm-tls-openstack-edpm-tls-xbvdp\" (UID: \"5f858691-27a3-4858-adf8-80eaa6b1056f\") " pod="openstack-kuttl-tests/tls-dnsnames-openstack-edpm-tls-openstack-edpm-tls-xbvdp" Mar 16 17:28:14 crc kubenswrapper[5120]: I0316 17:28:14.498137 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bd9t8\" (UniqueName: \"kubernetes.io/projected/5f858691-27a3-4858-adf8-80eaa6b1056f-kube-api-access-bd9t8\") pod \"tls-dnsnames-openstack-edpm-tls-openstack-edpm-tls-xbvdp\" (UID: \"5f858691-27a3-4858-adf8-80eaa6b1056f\") " pod="openstack-kuttl-tests/tls-dnsnames-openstack-edpm-tls-openstack-edpm-tls-xbvdp" Mar 16 17:28:14 crc kubenswrapper[5120]: I0316 17:28:14.623456 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/tls-dnsnames-openstack-edpm-tls-openstack-edpm-tls-xbvdp" Mar 16 17:28:15 crc kubenswrapper[5120]: I0316 17:28:15.054639 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/tls-dnsnames-openstack-edpm-tls-openstack-edpm-tls-xbvdp"] Mar 16 17:28:15 crc kubenswrapper[5120]: W0316 17:28:15.063384 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5f858691_27a3_4858_adf8_80eaa6b1056f.slice/crio-570831a1c8ecfde988e4059a3e88450fdc2849bfa5eeab9aad5e8413c3f5709f WatchSource:0}: Error finding container 570831a1c8ecfde988e4059a3e88450fdc2849bfa5eeab9aad5e8413c3f5709f: Status 404 returned error can't find the container with id 570831a1c8ecfde988e4059a3e88450fdc2849bfa5eeab9aad5e8413c3f5709f Mar 16 17:28:15 crc kubenswrapper[5120]: I0316 17:28:15.221699 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/tls-dnsnames-openstack-edpm-tls-openstack-edpm-tls-xbvdp" event={"ID":"5f858691-27a3-4858-adf8-80eaa6b1056f","Type":"ContainerStarted","Data":"570831a1c8ecfde988e4059a3e88450fdc2849bfa5eeab9aad5e8413c3f5709f"} Mar 16 17:28:16 crc kubenswrapper[5120]: I0316 17:28:16.232828 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/tls-dnsnames-openstack-edpm-tls-openstack-edpm-tls-xbvdp" event={"ID":"5f858691-27a3-4858-adf8-80eaa6b1056f","Type":"ContainerStarted","Data":"455cd5587849bda55db253e5cdc2fe50dcbd0d8347cd795abb08d3a957dce0d3"} Mar 16 17:28:16 crc kubenswrapper[5120]: I0316 17:28:16.254117 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/tls-dnsnames-openstack-edpm-tls-openstack-edpm-tls-xbvdp" podStartSLOduration=1.823118547 podStartE2EDuration="2.253996375s" podCreationTimestamp="2026-03-16 17:28:14 +0000 UTC" firstStartedPulling="2026-03-16 17:28:15.072638267 +0000 UTC m=+6997.226569924" lastFinishedPulling="2026-03-16 17:28:15.503516095 +0000 UTC m=+6997.657447752" observedRunningTime="2026-03-16 17:28:16.249886293 +0000 UTC m=+6998.403817950" watchObservedRunningTime="2026-03-16 17:28:16.253996375 +0000 UTC m=+6998.407928032" Mar 16 17:28:19 crc kubenswrapper[5120]: I0316 17:28:19.278417 5120 generic.go:358] "Generic (PLEG): container finished" podID="5f858691-27a3-4858-adf8-80eaa6b1056f" containerID="455cd5587849bda55db253e5cdc2fe50dcbd0d8347cd795abb08d3a957dce0d3" exitCode=0 Mar 16 17:28:19 crc kubenswrapper[5120]: I0316 17:28:19.278545 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/tls-dnsnames-openstack-edpm-tls-openstack-edpm-tls-xbvdp" event={"ID":"5f858691-27a3-4858-adf8-80eaa6b1056f","Type":"ContainerDied","Data":"455cd5587849bda55db253e5cdc2fe50dcbd0d8347cd795abb08d3a957dce0d3"} Mar 16 17:28:20 crc kubenswrapper[5120]: I0316 17:28:20.597527 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/tls-dnsnames-openstack-edpm-tls-openstack-edpm-tls-xbvdp" Mar 16 17:28:20 crc kubenswrapper[5120]: I0316 17:28:20.716109 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bd9t8\" (UniqueName: \"kubernetes.io/projected/5f858691-27a3-4858-adf8-80eaa6b1056f-kube-api-access-bd9t8\") pod \"5f858691-27a3-4858-adf8-80eaa6b1056f\" (UID: \"5f858691-27a3-4858-adf8-80eaa6b1056f\") " Mar 16 17:28:20 crc kubenswrapper[5120]: I0316 17:28:20.716418 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-dnsnames-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5f858691-27a3-4858-adf8-80eaa6b1056f-tls-dnsnames-combined-ca-bundle\") pod \"5f858691-27a3-4858-adf8-80eaa6b1056f\" (UID: \"5f858691-27a3-4858-adf8-80eaa6b1056f\") " Mar 16 17:28:20 crc kubenswrapper[5120]: I0316 17:28:20.716807 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/5f858691-27a3-4858-adf8-80eaa6b1056f-inventory\") pod \"5f858691-27a3-4858-adf8-80eaa6b1056f\" (UID: \"5f858691-27a3-4858-adf8-80eaa6b1056f\") " Mar 16 17:28:20 crc kubenswrapper[5120]: I0316 17:28:20.717325 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ssh-key-openstack-edpm-tls\" (UniqueName: \"kubernetes.io/secret/5f858691-27a3-4858-adf8-80eaa6b1056f-ssh-key-openstack-edpm-tls\") pod \"5f858691-27a3-4858-adf8-80eaa6b1056f\" (UID: \"5f858691-27a3-4858-adf8-80eaa6b1056f\") " Mar 16 17:28:20 crc kubenswrapper[5120]: I0316 17:28:20.724733 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f858691-27a3-4858-adf8-80eaa6b1056f-tls-dnsnames-combined-ca-bundle" (OuterVolumeSpecName: "tls-dnsnames-combined-ca-bundle") pod "5f858691-27a3-4858-adf8-80eaa6b1056f" (UID: "5f858691-27a3-4858-adf8-80eaa6b1056f"). InnerVolumeSpecName "tls-dnsnames-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:28:20 crc kubenswrapper[5120]: I0316 17:28:20.725285 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f858691-27a3-4858-adf8-80eaa6b1056f-kube-api-access-bd9t8" (OuterVolumeSpecName: "kube-api-access-bd9t8") pod "5f858691-27a3-4858-adf8-80eaa6b1056f" (UID: "5f858691-27a3-4858-adf8-80eaa6b1056f"). InnerVolumeSpecName "kube-api-access-bd9t8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:28:20 crc kubenswrapper[5120]: I0316 17:28:20.738979 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f858691-27a3-4858-adf8-80eaa6b1056f-inventory" (OuterVolumeSpecName: "inventory") pod "5f858691-27a3-4858-adf8-80eaa6b1056f" (UID: "5f858691-27a3-4858-adf8-80eaa6b1056f"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:28:20 crc kubenswrapper[5120]: I0316 17:28:20.743590 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f858691-27a3-4858-adf8-80eaa6b1056f-ssh-key-openstack-edpm-tls" (OuterVolumeSpecName: "ssh-key-openstack-edpm-tls") pod "5f858691-27a3-4858-adf8-80eaa6b1056f" (UID: "5f858691-27a3-4858-adf8-80eaa6b1056f"). InnerVolumeSpecName "ssh-key-openstack-edpm-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:28:20 crc kubenswrapper[5120]: I0316 17:28:20.821457 5120 reconciler_common.go:299] "Volume detached for volume \"tls-dnsnames-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5f858691-27a3-4858-adf8-80eaa6b1056f-tls-dnsnames-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:28:20 crc kubenswrapper[5120]: I0316 17:28:20.821555 5120 reconciler_common.go:299] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/5f858691-27a3-4858-adf8-80eaa6b1056f-inventory\") on node \"crc\" DevicePath \"\"" Mar 16 17:28:20 crc kubenswrapper[5120]: I0316 17:28:20.821687 5120 reconciler_common.go:299] "Volume detached for volume \"ssh-key-openstack-edpm-tls\" (UniqueName: \"kubernetes.io/secret/5f858691-27a3-4858-adf8-80eaa6b1056f-ssh-key-openstack-edpm-tls\") on node \"crc\" DevicePath \"\"" Mar 16 17:28:20 crc kubenswrapper[5120]: I0316 17:28:20.821728 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bd9t8\" (UniqueName: \"kubernetes.io/projected/5f858691-27a3-4858-adf8-80eaa6b1056f-kube-api-access-bd9t8\") on node \"crc\" DevicePath \"\"" Mar 16 17:28:21 crc kubenswrapper[5120]: I0316 17:28:21.300613 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/tls-dnsnames-openstack-edpm-tls-openstack-edpm-tls-xbvdp" Mar 16 17:28:21 crc kubenswrapper[5120]: I0316 17:28:21.300623 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/tls-dnsnames-openstack-edpm-tls-openstack-edpm-tls-xbvdp" event={"ID":"5f858691-27a3-4858-adf8-80eaa6b1056f","Type":"ContainerDied","Data":"570831a1c8ecfde988e4059a3e88450fdc2849bfa5eeab9aad5e8413c3f5709f"} Mar 16 17:28:21 crc kubenswrapper[5120]: I0316 17:28:21.301041 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="570831a1c8ecfde988e4059a3e88450fdc2849bfa5eeab9aad5e8413c3f5709f" Mar 16 17:28:22 crc kubenswrapper[5120]: I0316 17:28:22.008210 5120 patch_prober.go:28] interesting pod/machine-config-daemon-7bf76 container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 17:28:22 crc kubenswrapper[5120]: I0316 17:28:22.008299 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 17:28:22 crc kubenswrapper[5120]: I0316 17:28:22.727115 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-z5j64"] Mar 16 17:28:22 crc kubenswrapper[5120]: I0316 17:28:22.728184 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f858691-27a3-4858-adf8-80eaa6b1056f" containerName="tls-dnsnames-openstack-edpm-tls-openstack-edpm-tls" Mar 16 17:28:22 crc kubenswrapper[5120]: I0316 17:28:22.728206 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f858691-27a3-4858-adf8-80eaa6b1056f" containerName="tls-dnsnames-openstack-edpm-tls-openstack-edpm-tls" Mar 16 17:28:22 crc kubenswrapper[5120]: I0316 17:28:22.728352 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="5f858691-27a3-4858-adf8-80eaa6b1056f" containerName="tls-dnsnames-openstack-edpm-tls-openstack-edpm-tls" Mar 16 17:28:22 crc kubenswrapper[5120]: I0316 17:28:22.733104 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-z5j64" Mar 16 17:28:22 crc kubenswrapper[5120]: I0316 17:28:22.735710 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplanenodeset-openstack-edpm-tls\"" Mar 16 17:28:22 crc kubenswrapper[5120]: I0316 17:28:22.735734 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-aee-default-env\"" Mar 16 17:28:22 crc kubenswrapper[5120]: I0316 17:28:22.736164 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"openstack-edpm-tls-custom-tls-dns-default-certs-0\"" Mar 16 17:28:22 crc kubenswrapper[5120]: I0316 17:28:22.736214 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"combined-ca-bundle\"" Mar 16 17:28:22 crc kubenswrapper[5120]: I0316 17:28:22.736294 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"openstack-edpm-tls-tls-dns-ips-default-certs-0\"" Mar 16 17:28:22 crc kubenswrapper[5120]: I0316 17:28:22.736354 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplane-ansible-ssh-private-key-secret\"" Mar 16 17:28:22 crc kubenswrapper[5120]: I0316 17:28:22.736424 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"openstack-edpm-tls-dockercfg-kbq9x\"" Mar 16 17:28:22 crc kubenswrapper[5120]: I0316 17:28:22.737122 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-z5j64"] Mar 16 17:28:22 crc kubenswrapper[5120]: I0316 17:28:22.768002 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-edpm-tls-tls-dns-ips-default-certs-0\" (UniqueName: \"kubernetes.io/projected/53c22ec9-233d-4147-bbf2-f15e6aca6e45-openstack-edpm-tls-tls-dns-ips-default-certs-0\") pod \"install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-z5j64\" (UID: \"53c22ec9-233d-4147-bbf2-f15e6aca6e45\") " pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-z5j64" Mar 16 17:28:22 crc kubenswrapper[5120]: I0316 17:28:22.768068 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"custom-tls-dns-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/53c22ec9-233d-4147-bbf2-f15e6aca6e45-custom-tls-dns-combined-ca-bundle\") pod \"install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-z5j64\" (UID: \"53c22ec9-233d-4147-bbf2-f15e6aca6e45\") " pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-z5j64" Mar 16 17:28:22 crc kubenswrapper[5120]: I0316 17:28:22.768125 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-dns-ips-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/53c22ec9-233d-4147-bbf2-f15e6aca6e45-tls-dns-ips-combined-ca-bundle\") pod \"install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-z5j64\" (UID: \"53c22ec9-233d-4147-bbf2-f15e6aca6e45\") " pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-z5j64" Mar 16 17:28:22 crc kubenswrapper[5120]: I0316 17:28:22.768182 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/53c22ec9-233d-4147-bbf2-f15e6aca6e45-inventory\") pod \"install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-z5j64\" (UID: \"53c22ec9-233d-4147-bbf2-f15e6aca6e45\") " pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-z5j64" Mar 16 17:28:22 crc kubenswrapper[5120]: I0316 17:28:22.768281 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"install-certs-ovrd-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/53c22ec9-233d-4147-bbf2-f15e6aca6e45-install-certs-ovrd-combined-ca-bundle\") pod \"install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-z5j64\" (UID: \"53c22ec9-233d-4147-bbf2-f15e6aca6e45\") " pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-z5j64" Mar 16 17:28:22 crc kubenswrapper[5120]: I0316 17:28:22.768606 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-edpm-tls-custom-tls-dns-default-certs-0\" (UniqueName: \"kubernetes.io/projected/53c22ec9-233d-4147-bbf2-f15e6aca6e45-openstack-edpm-tls-custom-tls-dns-default-certs-0\") pod \"install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-z5j64\" (UID: \"53c22ec9-233d-4147-bbf2-f15e6aca6e45\") " pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-z5j64" Mar 16 17:28:22 crc kubenswrapper[5120]: I0316 17:28:22.768752 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gcl8\" (UniqueName: \"kubernetes.io/projected/53c22ec9-233d-4147-bbf2-f15e6aca6e45-kube-api-access-8gcl8\") pod \"install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-z5j64\" (UID: \"53c22ec9-233d-4147-bbf2-f15e6aca6e45\") " pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-z5j64" Mar 16 17:28:22 crc kubenswrapper[5120]: I0316 17:28:22.768977 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key-openstack-edpm-tls\" (UniqueName: \"kubernetes.io/secret/53c22ec9-233d-4147-bbf2-f15e6aca6e45-ssh-key-openstack-edpm-tls\") pod \"install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-z5j64\" (UID: \"53c22ec9-233d-4147-bbf2-f15e6aca6e45\") " pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-z5j64" Mar 16 17:28:22 crc kubenswrapper[5120]: I0316 17:28:22.870215 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/53c22ec9-233d-4147-bbf2-f15e6aca6e45-inventory\") pod \"install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-z5j64\" (UID: \"53c22ec9-233d-4147-bbf2-f15e6aca6e45\") " pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-z5j64" Mar 16 17:28:22 crc kubenswrapper[5120]: I0316 17:28:22.870317 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"install-certs-ovrd-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/53c22ec9-233d-4147-bbf2-f15e6aca6e45-install-certs-ovrd-combined-ca-bundle\") pod \"install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-z5j64\" (UID: \"53c22ec9-233d-4147-bbf2-f15e6aca6e45\") " pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-z5j64" Mar 16 17:28:22 crc kubenswrapper[5120]: I0316 17:28:22.870509 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openstack-edpm-tls-custom-tls-dns-default-certs-0\" (UniqueName: \"kubernetes.io/projected/53c22ec9-233d-4147-bbf2-f15e6aca6e45-openstack-edpm-tls-custom-tls-dns-default-certs-0\") pod \"install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-z5j64\" (UID: \"53c22ec9-233d-4147-bbf2-f15e6aca6e45\") " pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-z5j64" Mar 16 17:28:22 crc kubenswrapper[5120]: I0316 17:28:22.870621 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8gcl8\" (UniqueName: \"kubernetes.io/projected/53c22ec9-233d-4147-bbf2-f15e6aca6e45-kube-api-access-8gcl8\") pod \"install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-z5j64\" (UID: \"53c22ec9-233d-4147-bbf2-f15e6aca6e45\") " pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-z5j64" Mar 16 17:28:22 crc kubenswrapper[5120]: I0316 17:28:22.870701 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ssh-key-openstack-edpm-tls\" (UniqueName: \"kubernetes.io/secret/53c22ec9-233d-4147-bbf2-f15e6aca6e45-ssh-key-openstack-edpm-tls\") pod \"install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-z5j64\" (UID: \"53c22ec9-233d-4147-bbf2-f15e6aca6e45\") " pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-z5j64" Mar 16 17:28:22 crc kubenswrapper[5120]: I0316 17:28:22.870776 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openstack-edpm-tls-tls-dns-ips-default-certs-0\" (UniqueName: \"kubernetes.io/projected/53c22ec9-233d-4147-bbf2-f15e6aca6e45-openstack-edpm-tls-tls-dns-ips-default-certs-0\") pod \"install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-z5j64\" (UID: \"53c22ec9-233d-4147-bbf2-f15e6aca6e45\") " pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-z5j64" Mar 16 17:28:22 crc kubenswrapper[5120]: I0316 17:28:22.870810 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"custom-tls-dns-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/53c22ec9-233d-4147-bbf2-f15e6aca6e45-custom-tls-dns-combined-ca-bundle\") pod \"install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-z5j64\" (UID: \"53c22ec9-233d-4147-bbf2-f15e6aca6e45\") " pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-z5j64" Mar 16 17:28:22 crc kubenswrapper[5120]: I0316 17:28:22.870833 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-dns-ips-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/53c22ec9-233d-4147-bbf2-f15e6aca6e45-tls-dns-ips-combined-ca-bundle\") pod \"install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-z5j64\" (UID: \"53c22ec9-233d-4147-bbf2-f15e6aca6e45\") " pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-z5j64" Mar 16 17:28:22 crc kubenswrapper[5120]: I0316 17:28:22.875307 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/53c22ec9-233d-4147-bbf2-f15e6aca6e45-inventory\") pod \"install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-z5j64\" (UID: \"53c22ec9-233d-4147-bbf2-f15e6aca6e45\") " pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-z5j64" Mar 16 17:28:22 crc kubenswrapper[5120]: I0316 17:28:22.875392 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openstack-edpm-tls-custom-tls-dns-default-certs-0\" (UniqueName: \"kubernetes.io/projected/53c22ec9-233d-4147-bbf2-f15e6aca6e45-openstack-edpm-tls-custom-tls-dns-default-certs-0\") pod \"install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-z5j64\" (UID: \"53c22ec9-233d-4147-bbf2-f15e6aca6e45\") " pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-z5j64" Mar 16 17:28:22 crc kubenswrapper[5120]: I0316 17:28:22.875396 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-dns-ips-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/53c22ec9-233d-4147-bbf2-f15e6aca6e45-tls-dns-ips-combined-ca-bundle\") pod \"install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-z5j64\" (UID: \"53c22ec9-233d-4147-bbf2-f15e6aca6e45\") " pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-z5j64" Mar 16 17:28:22 crc kubenswrapper[5120]: I0316 17:28:22.876198 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openstack-edpm-tls-tls-dns-ips-default-certs-0\" (UniqueName: \"kubernetes.io/projected/53c22ec9-233d-4147-bbf2-f15e6aca6e45-openstack-edpm-tls-tls-dns-ips-default-certs-0\") pod \"install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-z5j64\" (UID: \"53c22ec9-233d-4147-bbf2-f15e6aca6e45\") " pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-z5j64" Mar 16 17:28:22 crc kubenswrapper[5120]: I0316 17:28:22.876426 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ssh-key-openstack-edpm-tls\" (UniqueName: \"kubernetes.io/secret/53c22ec9-233d-4147-bbf2-f15e6aca6e45-ssh-key-openstack-edpm-tls\") pod \"install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-z5j64\" (UID: \"53c22ec9-233d-4147-bbf2-f15e6aca6e45\") " pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-z5j64" Mar 16 17:28:22 crc kubenswrapper[5120]: I0316 17:28:22.876797 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"custom-tls-dns-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/53c22ec9-233d-4147-bbf2-f15e6aca6e45-custom-tls-dns-combined-ca-bundle\") pod \"install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-z5j64\" (UID: \"53c22ec9-233d-4147-bbf2-f15e6aca6e45\") " pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-z5j64" Mar 16 17:28:22 crc kubenswrapper[5120]: I0316 17:28:22.883980 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"install-certs-ovrd-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/53c22ec9-233d-4147-bbf2-f15e6aca6e45-install-certs-ovrd-combined-ca-bundle\") pod \"install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-z5j64\" (UID: \"53c22ec9-233d-4147-bbf2-f15e6aca6e45\") " pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-z5j64" Mar 16 17:28:22 crc kubenswrapper[5120]: I0316 17:28:22.888263 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gcl8\" (UniqueName: \"kubernetes.io/projected/53c22ec9-233d-4147-bbf2-f15e6aca6e45-kube-api-access-8gcl8\") pod \"install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-z5j64\" (UID: \"53c22ec9-233d-4147-bbf2-f15e6aca6e45\") " pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-z5j64" Mar 16 17:28:23 crc kubenswrapper[5120]: I0316 17:28:23.050477 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-z5j64" Mar 16 17:28:23 crc kubenswrapper[5120]: I0316 17:28:23.499676 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-z5j64"] Mar 16 17:28:24 crc kubenswrapper[5120]: I0316 17:28:24.330215 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-z5j64" event={"ID":"53c22ec9-233d-4147-bbf2-f15e6aca6e45","Type":"ContainerStarted","Data":"0537f61a62371d26f4334104a5c72f96b6a12dfae432d4aef41caa27dac85d17"} Mar 16 17:28:24 crc kubenswrapper[5120]: I0316 17:28:24.330599 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-z5j64" event={"ID":"53c22ec9-233d-4147-bbf2-f15e6aca6e45","Type":"ContainerStarted","Data":"8d4cb49ef39babf83f5c8d539e68267ae7131bff1148031cb22c83aa32deb5be"} Mar 16 17:28:24 crc kubenswrapper[5120]: I0316 17:28:24.347682 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-z5j64" podStartSLOduration=1.967670541 podStartE2EDuration="2.347643211s" podCreationTimestamp="2026-03-16 17:28:22 +0000 UTC" firstStartedPulling="2026-03-16 17:28:23.507455893 +0000 UTC m=+7005.661387560" lastFinishedPulling="2026-03-16 17:28:23.887428573 +0000 UTC m=+7006.041360230" observedRunningTime="2026-03-16 17:28:24.34685237 +0000 UTC m=+7006.500784037" watchObservedRunningTime="2026-03-16 17:28:24.347643211 +0000 UTC m=+7006.501574868" Mar 16 17:28:26 crc kubenswrapper[5120]: I0316 17:28:26.878287 5120 scope.go:117] "RemoveContainer" containerID="e81508d86e1b0bb97c123cbf72ff9ea5ba5698d3046d0b99918c12e6765bf2d7" Mar 16 17:28:26 crc kubenswrapper[5120]: I0316 17:28:26.912010 5120 scope.go:117] "RemoveContainer" containerID="9cb4860743540aae5afaeff4177d035e2ec8c5ca38d5b7a3743c90e19ffb3ba0" Mar 16 17:28:26 crc kubenswrapper[5120]: I0316 17:28:26.948924 5120 scope.go:117] "RemoveContainer" containerID="4089538c541ca20870002ad5f9d5c5483dd30f36da1b6e81a3360d99c5a9bf3e" Mar 16 17:28:26 crc kubenswrapper[5120]: I0316 17:28:26.973997 5120 scope.go:117] "RemoveContainer" containerID="1b7ae89447979578b9ba1f1f6e01df8833f240df36f957865d3e9a970bd9c7a4" Mar 16 17:28:27 crc kubenswrapper[5120]: I0316 17:28:27.008214 5120 scope.go:117] "RemoveContainer" containerID="4872ac50a742af8e990415e0942fa24b81c82ce727529d46983f5d4223e6e345" Mar 16 17:28:27 crc kubenswrapper[5120]: I0316 17:28:27.086394 5120 scope.go:117] "RemoveContainer" containerID="08645c1b8faa89f8d95a1d5de294466e57647d45e9f58fb2030b3e8eef934a5b" Mar 16 17:28:27 crc kubenswrapper[5120]: I0316 17:28:27.112806 5120 scope.go:117] "RemoveContainer" containerID="674d349a28c45bd02784bcd00686851848aac5d3acb8478415b002ed71f9c072" Mar 16 17:28:27 crc kubenswrapper[5120]: I0316 17:28:27.139863 5120 scope.go:117] "RemoveContainer" containerID="d1f809ed8657df370b218ae3dcfc9edef2857bb56cc4419c1324d294fe903450" Mar 16 17:28:27 crc kubenswrapper[5120]: I0316 17:28:27.162340 5120 scope.go:117] "RemoveContainer" containerID="a723609c1f8e6450a49850d7c9310ea3ce008f5f4291bcef712fb830d41910da" Mar 16 17:28:27 crc kubenswrapper[5120]: I0316 17:28:27.183796 5120 scope.go:117] "RemoveContainer" containerID="7d9c351e7631b2c8a14609eb1956d006e2763bca3e784c48864041179e430ba1" Mar 16 17:28:27 crc kubenswrapper[5120]: I0316 17:28:27.212051 5120 scope.go:117] "RemoveContainer" containerID="9f736e6e626bae203318086df29b36aea24a7f2c4c06f86e934985eaa796e101" Mar 16 17:28:27 crc kubenswrapper[5120]: I0316 17:28:27.361971 5120 generic.go:358] "Generic (PLEG): container finished" podID="53c22ec9-233d-4147-bbf2-f15e6aca6e45" containerID="0537f61a62371d26f4334104a5c72f96b6a12dfae432d4aef41caa27dac85d17" exitCode=0 Mar 16 17:28:27 crc kubenswrapper[5120]: I0316 17:28:27.362158 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-z5j64" event={"ID":"53c22ec9-233d-4147-bbf2-f15e6aca6e45","Type":"ContainerDied","Data":"0537f61a62371d26f4334104a5c72f96b6a12dfae432d4aef41caa27dac85d17"} Mar 16 17:28:28 crc kubenswrapper[5120]: I0316 17:28:28.716711 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-z5j64" Mar 16 17:28:28 crc kubenswrapper[5120]: I0316 17:28:28.810850 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8gcl8\" (UniqueName: \"kubernetes.io/projected/53c22ec9-233d-4147-bbf2-f15e6aca6e45-kube-api-access-8gcl8\") pod \"53c22ec9-233d-4147-bbf2-f15e6aca6e45\" (UID: \"53c22ec9-233d-4147-bbf2-f15e6aca6e45\") " Mar 16 17:28:28 crc kubenswrapper[5120]: I0316 17:28:28.810902 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"openstack-edpm-tls-tls-dns-ips-default-certs-0\" (UniqueName: \"kubernetes.io/projected/53c22ec9-233d-4147-bbf2-f15e6aca6e45-openstack-edpm-tls-tls-dns-ips-default-certs-0\") pod \"53c22ec9-233d-4147-bbf2-f15e6aca6e45\" (UID: \"53c22ec9-233d-4147-bbf2-f15e6aca6e45\") " Mar 16 17:28:28 crc kubenswrapper[5120]: I0316 17:28:28.810995 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"install-certs-ovrd-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/53c22ec9-233d-4147-bbf2-f15e6aca6e45-install-certs-ovrd-combined-ca-bundle\") pod \"53c22ec9-233d-4147-bbf2-f15e6aca6e45\" (UID: \"53c22ec9-233d-4147-bbf2-f15e6aca6e45\") " Mar 16 17:28:28 crc kubenswrapper[5120]: I0316 17:28:28.811067 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"openstack-edpm-tls-custom-tls-dns-default-certs-0\" (UniqueName: \"kubernetes.io/projected/53c22ec9-233d-4147-bbf2-f15e6aca6e45-openstack-edpm-tls-custom-tls-dns-default-certs-0\") pod \"53c22ec9-233d-4147-bbf2-f15e6aca6e45\" (UID: \"53c22ec9-233d-4147-bbf2-f15e6aca6e45\") " Mar 16 17:28:28 crc kubenswrapper[5120]: I0316 17:28:28.811149 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-dns-ips-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/53c22ec9-233d-4147-bbf2-f15e6aca6e45-tls-dns-ips-combined-ca-bundle\") pod \"53c22ec9-233d-4147-bbf2-f15e6aca6e45\" (UID: \"53c22ec9-233d-4147-bbf2-f15e6aca6e45\") " Mar 16 17:28:28 crc kubenswrapper[5120]: I0316 17:28:28.811171 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"custom-tls-dns-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/53c22ec9-233d-4147-bbf2-f15e6aca6e45-custom-tls-dns-combined-ca-bundle\") pod \"53c22ec9-233d-4147-bbf2-f15e6aca6e45\" (UID: \"53c22ec9-233d-4147-bbf2-f15e6aca6e45\") " Mar 16 17:28:28 crc kubenswrapper[5120]: I0316 17:28:28.811187 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/53c22ec9-233d-4147-bbf2-f15e6aca6e45-inventory\") pod \"53c22ec9-233d-4147-bbf2-f15e6aca6e45\" (UID: \"53c22ec9-233d-4147-bbf2-f15e6aca6e45\") " Mar 16 17:28:28 crc kubenswrapper[5120]: I0316 17:28:28.811230 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ssh-key-openstack-edpm-tls\" (UniqueName: \"kubernetes.io/secret/53c22ec9-233d-4147-bbf2-f15e6aca6e45-ssh-key-openstack-edpm-tls\") pod \"53c22ec9-233d-4147-bbf2-f15e6aca6e45\" (UID: \"53c22ec9-233d-4147-bbf2-f15e6aca6e45\") " Mar 16 17:28:28 crc kubenswrapper[5120]: I0316 17:28:28.817260 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/53c22ec9-233d-4147-bbf2-f15e6aca6e45-install-certs-ovrd-combined-ca-bundle" (OuterVolumeSpecName: "install-certs-ovrd-combined-ca-bundle") pod "53c22ec9-233d-4147-bbf2-f15e6aca6e45" (UID: "53c22ec9-233d-4147-bbf2-f15e6aca6e45"). InnerVolumeSpecName "install-certs-ovrd-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:28:28 crc kubenswrapper[5120]: I0316 17:28:28.817343 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53c22ec9-233d-4147-bbf2-f15e6aca6e45-openstack-edpm-tls-tls-dns-ips-default-certs-0" (OuterVolumeSpecName: "openstack-edpm-tls-tls-dns-ips-default-certs-0") pod "53c22ec9-233d-4147-bbf2-f15e6aca6e45" (UID: "53c22ec9-233d-4147-bbf2-f15e6aca6e45"). InnerVolumeSpecName "openstack-edpm-tls-tls-dns-ips-default-certs-0". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:28:28 crc kubenswrapper[5120]: I0316 17:28:28.817364 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53c22ec9-233d-4147-bbf2-f15e6aca6e45-kube-api-access-8gcl8" (OuterVolumeSpecName: "kube-api-access-8gcl8") pod "53c22ec9-233d-4147-bbf2-f15e6aca6e45" (UID: "53c22ec9-233d-4147-bbf2-f15e6aca6e45"). InnerVolumeSpecName "kube-api-access-8gcl8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:28:28 crc kubenswrapper[5120]: I0316 17:28:28.817567 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/53c22ec9-233d-4147-bbf2-f15e6aca6e45-custom-tls-dns-combined-ca-bundle" (OuterVolumeSpecName: "custom-tls-dns-combined-ca-bundle") pod "53c22ec9-233d-4147-bbf2-f15e6aca6e45" (UID: "53c22ec9-233d-4147-bbf2-f15e6aca6e45"). InnerVolumeSpecName "custom-tls-dns-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:28:28 crc kubenswrapper[5120]: I0316 17:28:28.819254 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/53c22ec9-233d-4147-bbf2-f15e6aca6e45-tls-dns-ips-combined-ca-bundle" (OuterVolumeSpecName: "tls-dns-ips-combined-ca-bundle") pod "53c22ec9-233d-4147-bbf2-f15e6aca6e45" (UID: "53c22ec9-233d-4147-bbf2-f15e6aca6e45"). InnerVolumeSpecName "tls-dns-ips-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:28:28 crc kubenswrapper[5120]: I0316 17:28:28.819559 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53c22ec9-233d-4147-bbf2-f15e6aca6e45-openstack-edpm-tls-custom-tls-dns-default-certs-0" (OuterVolumeSpecName: "openstack-edpm-tls-custom-tls-dns-default-certs-0") pod "53c22ec9-233d-4147-bbf2-f15e6aca6e45" (UID: "53c22ec9-233d-4147-bbf2-f15e6aca6e45"). InnerVolumeSpecName "openstack-edpm-tls-custom-tls-dns-default-certs-0". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:28:28 crc kubenswrapper[5120]: I0316 17:28:28.835197 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/53c22ec9-233d-4147-bbf2-f15e6aca6e45-inventory" (OuterVolumeSpecName: "inventory") pod "53c22ec9-233d-4147-bbf2-f15e6aca6e45" (UID: "53c22ec9-233d-4147-bbf2-f15e6aca6e45"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:28:28 crc kubenswrapper[5120]: I0316 17:28:28.835599 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/53c22ec9-233d-4147-bbf2-f15e6aca6e45-ssh-key-openstack-edpm-tls" (OuterVolumeSpecName: "ssh-key-openstack-edpm-tls") pod "53c22ec9-233d-4147-bbf2-f15e6aca6e45" (UID: "53c22ec9-233d-4147-bbf2-f15e6aca6e45"). InnerVolumeSpecName "ssh-key-openstack-edpm-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:28:28 crc kubenswrapper[5120]: I0316 17:28:28.913513 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8gcl8\" (UniqueName: \"kubernetes.io/projected/53c22ec9-233d-4147-bbf2-f15e6aca6e45-kube-api-access-8gcl8\") on node \"crc\" DevicePath \"\"" Mar 16 17:28:28 crc kubenswrapper[5120]: I0316 17:28:28.913563 5120 reconciler_common.go:299] "Volume detached for volume \"openstack-edpm-tls-tls-dns-ips-default-certs-0\" (UniqueName: \"kubernetes.io/projected/53c22ec9-233d-4147-bbf2-f15e6aca6e45-openstack-edpm-tls-tls-dns-ips-default-certs-0\") on node \"crc\" DevicePath \"\"" Mar 16 17:28:28 crc kubenswrapper[5120]: I0316 17:28:28.913576 5120 reconciler_common.go:299] "Volume detached for volume \"install-certs-ovrd-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/53c22ec9-233d-4147-bbf2-f15e6aca6e45-install-certs-ovrd-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:28:28 crc kubenswrapper[5120]: I0316 17:28:28.913589 5120 reconciler_common.go:299] "Volume detached for volume \"openstack-edpm-tls-custom-tls-dns-default-certs-0\" (UniqueName: \"kubernetes.io/projected/53c22ec9-233d-4147-bbf2-f15e6aca6e45-openstack-edpm-tls-custom-tls-dns-default-certs-0\") on node \"crc\" DevicePath \"\"" Mar 16 17:28:28 crc kubenswrapper[5120]: I0316 17:28:28.913599 5120 reconciler_common.go:299] "Volume detached for volume \"tls-dns-ips-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/53c22ec9-233d-4147-bbf2-f15e6aca6e45-tls-dns-ips-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:28:28 crc kubenswrapper[5120]: I0316 17:28:28.913608 5120 reconciler_common.go:299] "Volume detached for volume \"custom-tls-dns-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/53c22ec9-233d-4147-bbf2-f15e6aca6e45-custom-tls-dns-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:28:28 crc kubenswrapper[5120]: I0316 17:28:28.913619 5120 reconciler_common.go:299] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/53c22ec9-233d-4147-bbf2-f15e6aca6e45-inventory\") on node \"crc\" DevicePath \"\"" Mar 16 17:28:28 crc kubenswrapper[5120]: I0316 17:28:28.913630 5120 reconciler_common.go:299] "Volume detached for volume \"ssh-key-openstack-edpm-tls\" (UniqueName: \"kubernetes.io/secret/53c22ec9-233d-4147-bbf2-f15e6aca6e45-ssh-key-openstack-edpm-tls\") on node \"crc\" DevicePath \"\"" Mar 16 17:28:29 crc kubenswrapper[5120]: I0316 17:28:29.408594 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-z5j64" event={"ID":"53c22ec9-233d-4147-bbf2-f15e6aca6e45","Type":"ContainerDied","Data":"8d4cb49ef39babf83f5c8d539e68267ae7131bff1148031cb22c83aa32deb5be"} Mar 16 17:28:29 crc kubenswrapper[5120]: I0316 17:28:29.408671 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8d4cb49ef39babf83f5c8d539e68267ae7131bff1148031cb22c83aa32deb5be" Mar 16 17:28:29 crc kubenswrapper[5120]: I0316 17:28:29.409189 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-z5j64" Mar 16 17:28:29 crc kubenswrapper[5120]: I0316 17:28:29.462272 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/tls-dns-ips-openstack-edpm-tls-ovrd-openstack-edpm-tls-xjldb"] Mar 16 17:28:29 crc kubenswrapper[5120]: I0316 17:28:29.463319 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53c22ec9-233d-4147-bbf2-f15e6aca6e45" containerName="install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-tls" Mar 16 17:28:29 crc kubenswrapper[5120]: I0316 17:28:29.463344 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="53c22ec9-233d-4147-bbf2-f15e6aca6e45" containerName="install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-tls" Mar 16 17:28:29 crc kubenswrapper[5120]: I0316 17:28:29.463554 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="53c22ec9-233d-4147-bbf2-f15e6aca6e45" containerName="install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-tls" Mar 16 17:28:29 crc kubenswrapper[5120]: I0316 17:28:29.493825 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/tls-dns-ips-openstack-edpm-tls-ovrd-openstack-edpm-tls-xjldb"] Mar 16 17:28:29 crc kubenswrapper[5120]: I0316 17:28:29.493966 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/tls-dns-ips-openstack-edpm-tls-ovrd-openstack-edpm-tls-xjldb" Mar 16 17:28:29 crc kubenswrapper[5120]: I0316 17:28:29.496373 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplanenodeset-openstack-edpm-tls\"" Mar 16 17:28:29 crc kubenswrapper[5120]: I0316 17:28:29.496483 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"combined-ca-bundle\"" Mar 16 17:28:29 crc kubenswrapper[5120]: I0316 17:28:29.496801 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-aee-default-env\"" Mar 16 17:28:29 crc kubenswrapper[5120]: I0316 17:28:29.498581 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplane-ansible-ssh-private-key-secret\"" Mar 16 17:28:29 crc kubenswrapper[5120]: I0316 17:28:29.498641 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"openstack-edpm-tls-dockercfg-kbq9x\"" Mar 16 17:28:29 crc kubenswrapper[5120]: I0316 17:28:29.529648 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpm2r\" (UniqueName: \"kubernetes.io/projected/48a394bc-c78b-463d-92f1-2eb351b93385-kube-api-access-zpm2r\") pod \"tls-dns-ips-openstack-edpm-tls-ovrd-openstack-edpm-tls-xjldb\" (UID: \"48a394bc-c78b-463d-92f1-2eb351b93385\") " pod="openstack-kuttl-tests/tls-dns-ips-openstack-edpm-tls-ovrd-openstack-edpm-tls-xjldb" Mar 16 17:28:29 crc kubenswrapper[5120]: I0316 17:28:29.529730 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/48a394bc-c78b-463d-92f1-2eb351b93385-inventory\") pod \"tls-dns-ips-openstack-edpm-tls-ovrd-openstack-edpm-tls-xjldb\" (UID: \"48a394bc-c78b-463d-92f1-2eb351b93385\") " pod="openstack-kuttl-tests/tls-dns-ips-openstack-edpm-tls-ovrd-openstack-edpm-tls-xjldb" Mar 16 17:28:29 crc kubenswrapper[5120]: I0316 17:28:29.529838 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key-openstack-edpm-tls\" (UniqueName: \"kubernetes.io/secret/48a394bc-c78b-463d-92f1-2eb351b93385-ssh-key-openstack-edpm-tls\") pod \"tls-dns-ips-openstack-edpm-tls-ovrd-openstack-edpm-tls-xjldb\" (UID: \"48a394bc-c78b-463d-92f1-2eb351b93385\") " pod="openstack-kuttl-tests/tls-dns-ips-openstack-edpm-tls-ovrd-openstack-edpm-tls-xjldb" Mar 16 17:28:29 crc kubenswrapper[5120]: I0316 17:28:29.530057 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-dns-ips-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/48a394bc-c78b-463d-92f1-2eb351b93385-tls-dns-ips-combined-ca-bundle\") pod \"tls-dns-ips-openstack-edpm-tls-ovrd-openstack-edpm-tls-xjldb\" (UID: \"48a394bc-c78b-463d-92f1-2eb351b93385\") " pod="openstack-kuttl-tests/tls-dns-ips-openstack-edpm-tls-ovrd-openstack-edpm-tls-xjldb" Mar 16 17:28:29 crc kubenswrapper[5120]: I0316 17:28:29.632578 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/48a394bc-c78b-463d-92f1-2eb351b93385-inventory\") pod \"tls-dns-ips-openstack-edpm-tls-ovrd-openstack-edpm-tls-xjldb\" (UID: \"48a394bc-c78b-463d-92f1-2eb351b93385\") " pod="openstack-kuttl-tests/tls-dns-ips-openstack-edpm-tls-ovrd-openstack-edpm-tls-xjldb" Mar 16 17:28:29 crc kubenswrapper[5120]: I0316 17:28:29.632846 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ssh-key-openstack-edpm-tls\" (UniqueName: \"kubernetes.io/secret/48a394bc-c78b-463d-92f1-2eb351b93385-ssh-key-openstack-edpm-tls\") pod \"tls-dns-ips-openstack-edpm-tls-ovrd-openstack-edpm-tls-xjldb\" (UID: \"48a394bc-c78b-463d-92f1-2eb351b93385\") " pod="openstack-kuttl-tests/tls-dns-ips-openstack-edpm-tls-ovrd-openstack-edpm-tls-xjldb" Mar 16 17:28:29 crc kubenswrapper[5120]: I0316 17:28:29.632999 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-dns-ips-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/48a394bc-c78b-463d-92f1-2eb351b93385-tls-dns-ips-combined-ca-bundle\") pod \"tls-dns-ips-openstack-edpm-tls-ovrd-openstack-edpm-tls-xjldb\" (UID: \"48a394bc-c78b-463d-92f1-2eb351b93385\") " pod="openstack-kuttl-tests/tls-dns-ips-openstack-edpm-tls-ovrd-openstack-edpm-tls-xjldb" Mar 16 17:28:29 crc kubenswrapper[5120]: I0316 17:28:29.633158 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zpm2r\" (UniqueName: \"kubernetes.io/projected/48a394bc-c78b-463d-92f1-2eb351b93385-kube-api-access-zpm2r\") pod \"tls-dns-ips-openstack-edpm-tls-ovrd-openstack-edpm-tls-xjldb\" (UID: \"48a394bc-c78b-463d-92f1-2eb351b93385\") " pod="openstack-kuttl-tests/tls-dns-ips-openstack-edpm-tls-ovrd-openstack-edpm-tls-xjldb" Mar 16 17:28:29 crc kubenswrapper[5120]: I0316 17:28:29.637006 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ssh-key-openstack-edpm-tls\" (UniqueName: \"kubernetes.io/secret/48a394bc-c78b-463d-92f1-2eb351b93385-ssh-key-openstack-edpm-tls\") pod \"tls-dns-ips-openstack-edpm-tls-ovrd-openstack-edpm-tls-xjldb\" (UID: \"48a394bc-c78b-463d-92f1-2eb351b93385\") " pod="openstack-kuttl-tests/tls-dns-ips-openstack-edpm-tls-ovrd-openstack-edpm-tls-xjldb" Mar 16 17:28:29 crc kubenswrapper[5120]: I0316 17:28:29.637009 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/48a394bc-c78b-463d-92f1-2eb351b93385-inventory\") pod \"tls-dns-ips-openstack-edpm-tls-ovrd-openstack-edpm-tls-xjldb\" (UID: \"48a394bc-c78b-463d-92f1-2eb351b93385\") " pod="openstack-kuttl-tests/tls-dns-ips-openstack-edpm-tls-ovrd-openstack-edpm-tls-xjldb" Mar 16 17:28:29 crc kubenswrapper[5120]: I0316 17:28:29.638828 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-dns-ips-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/48a394bc-c78b-463d-92f1-2eb351b93385-tls-dns-ips-combined-ca-bundle\") pod \"tls-dns-ips-openstack-edpm-tls-ovrd-openstack-edpm-tls-xjldb\" (UID: \"48a394bc-c78b-463d-92f1-2eb351b93385\") " pod="openstack-kuttl-tests/tls-dns-ips-openstack-edpm-tls-ovrd-openstack-edpm-tls-xjldb" Mar 16 17:28:29 crc kubenswrapper[5120]: I0316 17:28:29.655256 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpm2r\" (UniqueName: \"kubernetes.io/projected/48a394bc-c78b-463d-92f1-2eb351b93385-kube-api-access-zpm2r\") pod \"tls-dns-ips-openstack-edpm-tls-ovrd-openstack-edpm-tls-xjldb\" (UID: \"48a394bc-c78b-463d-92f1-2eb351b93385\") " pod="openstack-kuttl-tests/tls-dns-ips-openstack-edpm-tls-ovrd-openstack-edpm-tls-xjldb" Mar 16 17:28:29 crc kubenswrapper[5120]: I0316 17:28:29.813369 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/tls-dns-ips-openstack-edpm-tls-ovrd-openstack-edpm-tls-xjldb" Mar 16 17:28:30 crc kubenswrapper[5120]: I0316 17:28:30.247810 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/tls-dns-ips-openstack-edpm-tls-ovrd-openstack-edpm-tls-xjldb"] Mar 16 17:28:30 crc kubenswrapper[5120]: I0316 17:28:30.417412 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/tls-dns-ips-openstack-edpm-tls-ovrd-openstack-edpm-tls-xjldb" event={"ID":"48a394bc-c78b-463d-92f1-2eb351b93385","Type":"ContainerStarted","Data":"f3c3e3ea930746ce801073920f8e3e26e1610a8560609584b6286d50a1f950f1"} Mar 16 17:28:31 crc kubenswrapper[5120]: I0316 17:28:31.427229 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/tls-dns-ips-openstack-edpm-tls-ovrd-openstack-edpm-tls-xjldb" event={"ID":"48a394bc-c78b-463d-92f1-2eb351b93385","Type":"ContainerStarted","Data":"7f530fc93769bf7ae833e7d5ee3ef2203c363452cabaca5eb55dacd06cc7865a"} Mar 16 17:28:31 crc kubenswrapper[5120]: I0316 17:28:31.444059 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/tls-dns-ips-openstack-edpm-tls-ovrd-openstack-edpm-tls-xjldb" podStartSLOduration=1.95317893 podStartE2EDuration="2.444036635s" podCreationTimestamp="2026-03-16 17:28:29 +0000 UTC" firstStartedPulling="2026-03-16 17:28:30.23422815 +0000 UTC m=+7012.388159807" lastFinishedPulling="2026-03-16 17:28:30.725085855 +0000 UTC m=+7012.879017512" observedRunningTime="2026-03-16 17:28:31.443057178 +0000 UTC m=+7013.596988845" watchObservedRunningTime="2026-03-16 17:28:31.444036635 +0000 UTC m=+7013.597968312" Mar 16 17:28:34 crc kubenswrapper[5120]: I0316 17:28:34.454275 5120 generic.go:358] "Generic (PLEG): container finished" podID="48a394bc-c78b-463d-92f1-2eb351b93385" containerID="7f530fc93769bf7ae833e7d5ee3ef2203c363452cabaca5eb55dacd06cc7865a" exitCode=0 Mar 16 17:28:34 crc kubenswrapper[5120]: I0316 17:28:34.454420 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/tls-dns-ips-openstack-edpm-tls-ovrd-openstack-edpm-tls-xjldb" event={"ID":"48a394bc-c78b-463d-92f1-2eb351b93385","Type":"ContainerDied","Data":"7f530fc93769bf7ae833e7d5ee3ef2203c363452cabaca5eb55dacd06cc7865a"} Mar 16 17:28:35 crc kubenswrapper[5120]: I0316 17:28:35.728971 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/tls-dns-ips-openstack-edpm-tls-ovrd-openstack-edpm-tls-xjldb" Mar 16 17:28:35 crc kubenswrapper[5120]: I0316 17:28:35.857967 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/48a394bc-c78b-463d-92f1-2eb351b93385-inventory\") pod \"48a394bc-c78b-463d-92f1-2eb351b93385\" (UID: \"48a394bc-c78b-463d-92f1-2eb351b93385\") " Mar 16 17:28:35 crc kubenswrapper[5120]: I0316 17:28:35.858011 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-dns-ips-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/48a394bc-c78b-463d-92f1-2eb351b93385-tls-dns-ips-combined-ca-bundle\") pod \"48a394bc-c78b-463d-92f1-2eb351b93385\" (UID: \"48a394bc-c78b-463d-92f1-2eb351b93385\") " Mar 16 17:28:35 crc kubenswrapper[5120]: I0316 17:28:35.858348 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ssh-key-openstack-edpm-tls\" (UniqueName: \"kubernetes.io/secret/48a394bc-c78b-463d-92f1-2eb351b93385-ssh-key-openstack-edpm-tls\") pod \"48a394bc-c78b-463d-92f1-2eb351b93385\" (UID: \"48a394bc-c78b-463d-92f1-2eb351b93385\") " Mar 16 17:28:35 crc kubenswrapper[5120]: I0316 17:28:35.858406 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zpm2r\" (UniqueName: \"kubernetes.io/projected/48a394bc-c78b-463d-92f1-2eb351b93385-kube-api-access-zpm2r\") pod \"48a394bc-c78b-463d-92f1-2eb351b93385\" (UID: \"48a394bc-c78b-463d-92f1-2eb351b93385\") " Mar 16 17:28:35 crc kubenswrapper[5120]: I0316 17:28:35.864705 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48a394bc-c78b-463d-92f1-2eb351b93385-tls-dns-ips-combined-ca-bundle" (OuterVolumeSpecName: "tls-dns-ips-combined-ca-bundle") pod "48a394bc-c78b-463d-92f1-2eb351b93385" (UID: "48a394bc-c78b-463d-92f1-2eb351b93385"). InnerVolumeSpecName "tls-dns-ips-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:28:35 crc kubenswrapper[5120]: I0316 17:28:35.865230 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48a394bc-c78b-463d-92f1-2eb351b93385-kube-api-access-zpm2r" (OuterVolumeSpecName: "kube-api-access-zpm2r") pod "48a394bc-c78b-463d-92f1-2eb351b93385" (UID: "48a394bc-c78b-463d-92f1-2eb351b93385"). InnerVolumeSpecName "kube-api-access-zpm2r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:28:35 crc kubenswrapper[5120]: I0316 17:28:35.881413 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48a394bc-c78b-463d-92f1-2eb351b93385-inventory" (OuterVolumeSpecName: "inventory") pod "48a394bc-c78b-463d-92f1-2eb351b93385" (UID: "48a394bc-c78b-463d-92f1-2eb351b93385"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:28:35 crc kubenswrapper[5120]: I0316 17:28:35.881939 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48a394bc-c78b-463d-92f1-2eb351b93385-ssh-key-openstack-edpm-tls" (OuterVolumeSpecName: "ssh-key-openstack-edpm-tls") pod "48a394bc-c78b-463d-92f1-2eb351b93385" (UID: "48a394bc-c78b-463d-92f1-2eb351b93385"). InnerVolumeSpecName "ssh-key-openstack-edpm-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:28:35 crc kubenswrapper[5120]: I0316 17:28:35.961046 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zpm2r\" (UniqueName: \"kubernetes.io/projected/48a394bc-c78b-463d-92f1-2eb351b93385-kube-api-access-zpm2r\") on node \"crc\" DevicePath \"\"" Mar 16 17:28:35 crc kubenswrapper[5120]: I0316 17:28:35.961081 5120 reconciler_common.go:299] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/48a394bc-c78b-463d-92f1-2eb351b93385-inventory\") on node \"crc\" DevicePath \"\"" Mar 16 17:28:35 crc kubenswrapper[5120]: I0316 17:28:35.961096 5120 reconciler_common.go:299] "Volume detached for volume \"tls-dns-ips-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/48a394bc-c78b-463d-92f1-2eb351b93385-tls-dns-ips-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:28:35 crc kubenswrapper[5120]: I0316 17:28:35.961110 5120 reconciler_common.go:299] "Volume detached for volume \"ssh-key-openstack-edpm-tls\" (UniqueName: \"kubernetes.io/secret/48a394bc-c78b-463d-92f1-2eb351b93385-ssh-key-openstack-edpm-tls\") on node \"crc\" DevicePath \"\"" Mar 16 17:28:36 crc kubenswrapper[5120]: I0316 17:28:36.474853 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/tls-dns-ips-openstack-edpm-tls-ovrd-openstack-edpm-tls-xjldb" Mar 16 17:28:36 crc kubenswrapper[5120]: I0316 17:28:36.474847 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/tls-dns-ips-openstack-edpm-tls-ovrd-openstack-edpm-tls-xjldb" event={"ID":"48a394bc-c78b-463d-92f1-2eb351b93385","Type":"ContainerDied","Data":"f3c3e3ea930746ce801073920f8e3e26e1610a8560609584b6286d50a1f950f1"} Mar 16 17:28:36 crc kubenswrapper[5120]: I0316 17:28:36.475005 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f3c3e3ea930746ce801073920f8e3e26e1610a8560609584b6286d50a1f950f1" Mar 16 17:28:36 crc kubenswrapper[5120]: I0316 17:28:36.545991 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/custom-tls-dns-openstack-edpm-tls-ovrd-openstack-edpm-tls-s5fqg"] Mar 16 17:28:36 crc kubenswrapper[5120]: I0316 17:28:36.547241 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48a394bc-c78b-463d-92f1-2eb351b93385" containerName="tls-dns-ips-openstack-edpm-tls-ovrd-openstack-edpm-tls" Mar 16 17:28:36 crc kubenswrapper[5120]: I0316 17:28:36.547269 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="48a394bc-c78b-463d-92f1-2eb351b93385" containerName="tls-dns-ips-openstack-edpm-tls-ovrd-openstack-edpm-tls" Mar 16 17:28:36 crc kubenswrapper[5120]: I0316 17:28:36.547434 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="48a394bc-c78b-463d-92f1-2eb351b93385" containerName="tls-dns-ips-openstack-edpm-tls-ovrd-openstack-edpm-tls" Mar 16 17:28:36 crc kubenswrapper[5120]: I0316 17:28:36.555783 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/custom-tls-dns-openstack-edpm-tls-ovrd-openstack-edpm-tls-s5fqg"] Mar 16 17:28:36 crc kubenswrapper[5120]: I0316 17:28:36.555893 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/custom-tls-dns-openstack-edpm-tls-ovrd-openstack-edpm-tls-s5fqg" Mar 16 17:28:36 crc kubenswrapper[5120]: I0316 17:28:36.558378 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"openstack-edpm-tls-dockercfg-kbq9x\"" Mar 16 17:28:36 crc kubenswrapper[5120]: I0316 17:28:36.558448 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplane-ansible-ssh-private-key-secret\"" Mar 16 17:28:36 crc kubenswrapper[5120]: I0316 17:28:36.558547 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"combined-ca-bundle\"" Mar 16 17:28:36 crc kubenswrapper[5120]: I0316 17:28:36.558664 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplanenodeset-openstack-edpm-tls\"" Mar 16 17:28:36 crc kubenswrapper[5120]: I0316 17:28:36.558694 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-aee-default-env\"" Mar 16 17:28:36 crc kubenswrapper[5120]: I0316 17:28:36.677222 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key-openstack-edpm-tls\" (UniqueName: \"kubernetes.io/secret/9b528c29-3e26-4c9d-b120-e84f0008850b-ssh-key-openstack-edpm-tls\") pod \"custom-tls-dns-openstack-edpm-tls-ovrd-openstack-edpm-tls-s5fqg\" (UID: \"9b528c29-3e26-4c9d-b120-e84f0008850b\") " pod="openstack-kuttl-tests/custom-tls-dns-openstack-edpm-tls-ovrd-openstack-edpm-tls-s5fqg" Mar 16 17:28:36 crc kubenswrapper[5120]: I0316 17:28:36.677752 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/9b528c29-3e26-4c9d-b120-e84f0008850b-inventory\") pod \"custom-tls-dns-openstack-edpm-tls-ovrd-openstack-edpm-tls-s5fqg\" (UID: \"9b528c29-3e26-4c9d-b120-e84f0008850b\") " pod="openstack-kuttl-tests/custom-tls-dns-openstack-edpm-tls-ovrd-openstack-edpm-tls-s5fqg" Mar 16 17:28:36 crc kubenswrapper[5120]: I0316 17:28:36.677954 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwngh\" (UniqueName: \"kubernetes.io/projected/9b528c29-3e26-4c9d-b120-e84f0008850b-kube-api-access-gwngh\") pod \"custom-tls-dns-openstack-edpm-tls-ovrd-openstack-edpm-tls-s5fqg\" (UID: \"9b528c29-3e26-4c9d-b120-e84f0008850b\") " pod="openstack-kuttl-tests/custom-tls-dns-openstack-edpm-tls-ovrd-openstack-edpm-tls-s5fqg" Mar 16 17:28:36 crc kubenswrapper[5120]: I0316 17:28:36.678050 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"custom-tls-dns-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9b528c29-3e26-4c9d-b120-e84f0008850b-custom-tls-dns-combined-ca-bundle\") pod \"custom-tls-dns-openstack-edpm-tls-ovrd-openstack-edpm-tls-s5fqg\" (UID: \"9b528c29-3e26-4c9d-b120-e84f0008850b\") " pod="openstack-kuttl-tests/custom-tls-dns-openstack-edpm-tls-ovrd-openstack-edpm-tls-s5fqg" Mar 16 17:28:36 crc kubenswrapper[5120]: I0316 17:28:36.779563 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/9b528c29-3e26-4c9d-b120-e84f0008850b-inventory\") pod \"custom-tls-dns-openstack-edpm-tls-ovrd-openstack-edpm-tls-s5fqg\" (UID: \"9b528c29-3e26-4c9d-b120-e84f0008850b\") " pod="openstack-kuttl-tests/custom-tls-dns-openstack-edpm-tls-ovrd-openstack-edpm-tls-s5fqg" Mar 16 17:28:36 crc kubenswrapper[5120]: I0316 17:28:36.779717 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gwngh\" (UniqueName: \"kubernetes.io/projected/9b528c29-3e26-4c9d-b120-e84f0008850b-kube-api-access-gwngh\") pod \"custom-tls-dns-openstack-edpm-tls-ovrd-openstack-edpm-tls-s5fqg\" (UID: \"9b528c29-3e26-4c9d-b120-e84f0008850b\") " pod="openstack-kuttl-tests/custom-tls-dns-openstack-edpm-tls-ovrd-openstack-edpm-tls-s5fqg" Mar 16 17:28:36 crc kubenswrapper[5120]: I0316 17:28:36.779802 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"custom-tls-dns-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9b528c29-3e26-4c9d-b120-e84f0008850b-custom-tls-dns-combined-ca-bundle\") pod \"custom-tls-dns-openstack-edpm-tls-ovrd-openstack-edpm-tls-s5fqg\" (UID: \"9b528c29-3e26-4c9d-b120-e84f0008850b\") " pod="openstack-kuttl-tests/custom-tls-dns-openstack-edpm-tls-ovrd-openstack-edpm-tls-s5fqg" Mar 16 17:28:36 crc kubenswrapper[5120]: I0316 17:28:36.779845 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ssh-key-openstack-edpm-tls\" (UniqueName: \"kubernetes.io/secret/9b528c29-3e26-4c9d-b120-e84f0008850b-ssh-key-openstack-edpm-tls\") pod \"custom-tls-dns-openstack-edpm-tls-ovrd-openstack-edpm-tls-s5fqg\" (UID: \"9b528c29-3e26-4c9d-b120-e84f0008850b\") " pod="openstack-kuttl-tests/custom-tls-dns-openstack-edpm-tls-ovrd-openstack-edpm-tls-s5fqg" Mar 16 17:28:36 crc kubenswrapper[5120]: I0316 17:28:36.785058 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"custom-tls-dns-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9b528c29-3e26-4c9d-b120-e84f0008850b-custom-tls-dns-combined-ca-bundle\") pod \"custom-tls-dns-openstack-edpm-tls-ovrd-openstack-edpm-tls-s5fqg\" (UID: \"9b528c29-3e26-4c9d-b120-e84f0008850b\") " pod="openstack-kuttl-tests/custom-tls-dns-openstack-edpm-tls-ovrd-openstack-edpm-tls-s5fqg" Mar 16 17:28:36 crc kubenswrapper[5120]: I0316 17:28:36.785077 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/9b528c29-3e26-4c9d-b120-e84f0008850b-inventory\") pod \"custom-tls-dns-openstack-edpm-tls-ovrd-openstack-edpm-tls-s5fqg\" (UID: \"9b528c29-3e26-4c9d-b120-e84f0008850b\") " pod="openstack-kuttl-tests/custom-tls-dns-openstack-edpm-tls-ovrd-openstack-edpm-tls-s5fqg" Mar 16 17:28:36 crc kubenswrapper[5120]: I0316 17:28:36.785959 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ssh-key-openstack-edpm-tls\" (UniqueName: \"kubernetes.io/secret/9b528c29-3e26-4c9d-b120-e84f0008850b-ssh-key-openstack-edpm-tls\") pod \"custom-tls-dns-openstack-edpm-tls-ovrd-openstack-edpm-tls-s5fqg\" (UID: \"9b528c29-3e26-4c9d-b120-e84f0008850b\") " pod="openstack-kuttl-tests/custom-tls-dns-openstack-edpm-tls-ovrd-openstack-edpm-tls-s5fqg" Mar 16 17:28:36 crc kubenswrapper[5120]: I0316 17:28:36.797311 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwngh\" (UniqueName: \"kubernetes.io/projected/9b528c29-3e26-4c9d-b120-e84f0008850b-kube-api-access-gwngh\") pod \"custom-tls-dns-openstack-edpm-tls-ovrd-openstack-edpm-tls-s5fqg\" (UID: \"9b528c29-3e26-4c9d-b120-e84f0008850b\") " pod="openstack-kuttl-tests/custom-tls-dns-openstack-edpm-tls-ovrd-openstack-edpm-tls-s5fqg" Mar 16 17:28:36 crc kubenswrapper[5120]: I0316 17:28:36.886867 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/custom-tls-dns-openstack-edpm-tls-ovrd-openstack-edpm-tls-s5fqg" Mar 16 17:28:37 crc kubenswrapper[5120]: I0316 17:28:37.330871 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/custom-tls-dns-openstack-edpm-tls-ovrd-openstack-edpm-tls-s5fqg"] Mar 16 17:28:37 crc kubenswrapper[5120]: I0316 17:28:37.484332 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/custom-tls-dns-openstack-edpm-tls-ovrd-openstack-edpm-tls-s5fqg" event={"ID":"9b528c29-3e26-4c9d-b120-e84f0008850b","Type":"ContainerStarted","Data":"012b2d14ce9409dba77cbcae4705c97a43597081e754a60e99d5996367eb220f"} Mar 16 17:28:38 crc kubenswrapper[5120]: I0316 17:28:38.495101 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/custom-tls-dns-openstack-edpm-tls-ovrd-openstack-edpm-tls-s5fqg" event={"ID":"9b528c29-3e26-4c9d-b120-e84f0008850b","Type":"ContainerStarted","Data":"f3fcfaaff1af24518d0661eae5bb8f082fc7c79d24590bfcd88dcb1217387b7e"} Mar 16 17:28:40 crc kubenswrapper[5120]: I0316 17:28:40.515806 5120 generic.go:358] "Generic (PLEG): container finished" podID="9b528c29-3e26-4c9d-b120-e84f0008850b" containerID="f3fcfaaff1af24518d0661eae5bb8f082fc7c79d24590bfcd88dcb1217387b7e" exitCode=0 Mar 16 17:28:40 crc kubenswrapper[5120]: I0316 17:28:40.515884 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/custom-tls-dns-openstack-edpm-tls-ovrd-openstack-edpm-tls-s5fqg" event={"ID":"9b528c29-3e26-4c9d-b120-e84f0008850b","Type":"ContainerDied","Data":"f3fcfaaff1af24518d0661eae5bb8f082fc7c79d24590bfcd88dcb1217387b7e"} Mar 16 17:28:41 crc kubenswrapper[5120]: I0316 17:28:41.811611 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/custom-tls-dns-openstack-edpm-tls-ovrd-openstack-edpm-tls-s5fqg" Mar 16 17:28:41 crc kubenswrapper[5120]: I0316 17:28:41.886022 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ssh-key-openstack-edpm-tls\" (UniqueName: \"kubernetes.io/secret/9b528c29-3e26-4c9d-b120-e84f0008850b-ssh-key-openstack-edpm-tls\") pod \"9b528c29-3e26-4c9d-b120-e84f0008850b\" (UID: \"9b528c29-3e26-4c9d-b120-e84f0008850b\") " Mar 16 17:28:41 crc kubenswrapper[5120]: I0316 17:28:41.886153 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/9b528c29-3e26-4c9d-b120-e84f0008850b-inventory\") pod \"9b528c29-3e26-4c9d-b120-e84f0008850b\" (UID: \"9b528c29-3e26-4c9d-b120-e84f0008850b\") " Mar 16 17:28:41 crc kubenswrapper[5120]: I0316 17:28:41.886184 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gwngh\" (UniqueName: \"kubernetes.io/projected/9b528c29-3e26-4c9d-b120-e84f0008850b-kube-api-access-gwngh\") pod \"9b528c29-3e26-4c9d-b120-e84f0008850b\" (UID: \"9b528c29-3e26-4c9d-b120-e84f0008850b\") " Mar 16 17:28:41 crc kubenswrapper[5120]: I0316 17:28:41.886431 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"custom-tls-dns-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9b528c29-3e26-4c9d-b120-e84f0008850b-custom-tls-dns-combined-ca-bundle\") pod \"9b528c29-3e26-4c9d-b120-e84f0008850b\" (UID: \"9b528c29-3e26-4c9d-b120-e84f0008850b\") " Mar 16 17:28:41 crc kubenswrapper[5120]: I0316 17:28:41.892033 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b528c29-3e26-4c9d-b120-e84f0008850b-kube-api-access-gwngh" (OuterVolumeSpecName: "kube-api-access-gwngh") pod "9b528c29-3e26-4c9d-b120-e84f0008850b" (UID: "9b528c29-3e26-4c9d-b120-e84f0008850b"). InnerVolumeSpecName "kube-api-access-gwngh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:28:41 crc kubenswrapper[5120]: I0316 17:28:41.893238 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9b528c29-3e26-4c9d-b120-e84f0008850b-custom-tls-dns-combined-ca-bundle" (OuterVolumeSpecName: "custom-tls-dns-combined-ca-bundle") pod "9b528c29-3e26-4c9d-b120-e84f0008850b" (UID: "9b528c29-3e26-4c9d-b120-e84f0008850b"). InnerVolumeSpecName "custom-tls-dns-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:28:41 crc kubenswrapper[5120]: I0316 17:28:41.906944 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9b528c29-3e26-4c9d-b120-e84f0008850b-ssh-key-openstack-edpm-tls" (OuterVolumeSpecName: "ssh-key-openstack-edpm-tls") pod "9b528c29-3e26-4c9d-b120-e84f0008850b" (UID: "9b528c29-3e26-4c9d-b120-e84f0008850b"). InnerVolumeSpecName "ssh-key-openstack-edpm-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:28:41 crc kubenswrapper[5120]: I0316 17:28:41.907935 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9b528c29-3e26-4c9d-b120-e84f0008850b-inventory" (OuterVolumeSpecName: "inventory") pod "9b528c29-3e26-4c9d-b120-e84f0008850b" (UID: "9b528c29-3e26-4c9d-b120-e84f0008850b"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:28:41 crc kubenswrapper[5120]: I0316 17:28:41.989220 5120 reconciler_common.go:299] "Volume detached for volume \"ssh-key-openstack-edpm-tls\" (UniqueName: \"kubernetes.io/secret/9b528c29-3e26-4c9d-b120-e84f0008850b-ssh-key-openstack-edpm-tls\") on node \"crc\" DevicePath \"\"" Mar 16 17:28:41 crc kubenswrapper[5120]: I0316 17:28:41.989263 5120 reconciler_common.go:299] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/9b528c29-3e26-4c9d-b120-e84f0008850b-inventory\") on node \"crc\" DevicePath \"\"" Mar 16 17:28:41 crc kubenswrapper[5120]: I0316 17:28:41.989275 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gwngh\" (UniqueName: \"kubernetes.io/projected/9b528c29-3e26-4c9d-b120-e84f0008850b-kube-api-access-gwngh\") on node \"crc\" DevicePath \"\"" Mar 16 17:28:41 crc kubenswrapper[5120]: I0316 17:28:41.989289 5120 reconciler_common.go:299] "Volume detached for volume \"custom-tls-dns-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9b528c29-3e26-4c9d-b120-e84f0008850b-custom-tls-dns-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:28:42 crc kubenswrapper[5120]: I0316 17:28:42.539792 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/custom-tls-dns-openstack-edpm-tls-ovrd-openstack-edpm-tls-s5fqg" event={"ID":"9b528c29-3e26-4c9d-b120-e84f0008850b","Type":"ContainerDied","Data":"012b2d14ce9409dba77cbcae4705c97a43597081e754a60e99d5996367eb220f"} Mar 16 17:28:42 crc kubenswrapper[5120]: I0316 17:28:42.539833 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="012b2d14ce9409dba77cbcae4705c97a43597081e754a60e99d5996367eb220f" Mar 16 17:28:42 crc kubenswrapper[5120]: I0316 17:28:42.539868 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/custom-tls-dns-openstack-edpm-tls-ovrd-openstack-edpm-tls-s5fqg" Mar 16 17:28:44 crc kubenswrapper[5120]: I0316 17:28:44.461627 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb"] Mar 16 17:28:44 crc kubenswrapper[5120]: I0316 17:28:44.462984 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b528c29-3e26-4c9d-b120-e84f0008850b" containerName="custom-tls-dns-openstack-edpm-tls-ovrd-openstack-edpm-tls" Mar 16 17:28:44 crc kubenswrapper[5120]: I0316 17:28:44.463011 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b528c29-3e26-4c9d-b120-e84f0008850b" containerName="custom-tls-dns-openstack-edpm-tls-ovrd-openstack-edpm-tls" Mar 16 17:28:44 crc kubenswrapper[5120]: I0316 17:28:44.463209 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="9b528c29-3e26-4c9d-b120-e84f0008850b" containerName="custom-tls-dns-openstack-edpm-tls-ovrd-openstack-edpm-tls" Mar 16 17:28:44 crc kubenswrapper[5120]: I0316 17:28:44.468262 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb" Mar 16 17:28:44 crc kubenswrapper[5120]: I0316 17:28:44.471257 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"combined-ca-bundle\"" Mar 16 17:28:44 crc kubenswrapper[5120]: I0316 17:28:44.471520 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplane-ansible-ssh-private-key-secret\"" Mar 16 17:28:44 crc kubenswrapper[5120]: I0316 17:28:44.472096 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"openstack-edpm-tls-dockercfg-kbq9x\"" Mar 16 17:28:44 crc kubenswrapper[5120]: I0316 17:28:44.472211 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplanenodeset-openstack-edpm-tls\"" Mar 16 17:28:44 crc kubenswrapper[5120]: I0316 17:28:44.472264 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"openstack-edpm-tls-tls-dns-ips-default-certs-0\"" Mar 16 17:28:44 crc kubenswrapper[5120]: I0316 17:28:44.473490 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-aee-default-env\"" Mar 16 17:28:44 crc kubenswrapper[5120]: I0316 17:28:44.473834 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"openstack-edpm-tls-custom-tls-dns-default-certs-0\"" Mar 16 17:28:44 crc kubenswrapper[5120]: I0316 17:28:44.474904 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb"] Mar 16 17:28:44 crc kubenswrapper[5120]: I0316 17:28:44.544604 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"install-certs-ovrd-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/30d4e12d-badf-4c88-b298-65f806643a02-install-certs-ovrd-combined-ca-bundle\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb\" (UID: \"30d4e12d-badf-4c88-b298-65f806643a02\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb" Mar 16 17:28:44 crc kubenswrapper[5120]: I0316 17:28:44.544825 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-edpm-tls-custom-tls-dns-default-certs-0\" (UniqueName: \"kubernetes.io/projected/30d4e12d-badf-4c88-b298-65f806643a02-openstack-edpm-tls-custom-tls-dns-default-certs-0\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb\" (UID: \"30d4e12d-badf-4c88-b298-65f806643a02\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb" Mar 16 17:28:44 crc kubenswrapper[5120]: I0316 17:28:44.544944 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"custom-tls-dns-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/30d4e12d-badf-4c88-b298-65f806643a02-custom-tls-dns-combined-ca-bundle\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb\" (UID: \"30d4e12d-badf-4c88-b298-65f806643a02\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb" Mar 16 17:28:44 crc kubenswrapper[5120]: I0316 17:28:44.545056 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-dns-ips-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/30d4e12d-badf-4c88-b298-65f806643a02-tls-dns-ips-combined-ca-bundle\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb\" (UID: \"30d4e12d-badf-4c88-b298-65f806643a02\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb" Mar 16 17:28:44 crc kubenswrapper[5120]: I0316 17:28:44.545195 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key-openstack-edpm-tls\" (UniqueName: \"kubernetes.io/secret/30d4e12d-badf-4c88-b298-65f806643a02-ssh-key-openstack-edpm-tls\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb\" (UID: \"30d4e12d-badf-4c88-b298-65f806643a02\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb" Mar 16 17:28:44 crc kubenswrapper[5120]: I0316 17:28:44.545250 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qsjg\" (UniqueName: \"kubernetes.io/projected/30d4e12d-badf-4c88-b298-65f806643a02-kube-api-access-2qsjg\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb\" (UID: \"30d4e12d-badf-4c88-b298-65f806643a02\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb" Mar 16 17:28:44 crc kubenswrapper[5120]: I0316 17:28:44.545306 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-edpm-tls-tls-dns-ips-default-certs-0\" (UniqueName: \"kubernetes.io/projected/30d4e12d-badf-4c88-b298-65f806643a02-openstack-edpm-tls-tls-dns-ips-default-certs-0\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb\" (UID: \"30d4e12d-badf-4c88-b298-65f806643a02\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb" Mar 16 17:28:44 crc kubenswrapper[5120]: I0316 17:28:44.545682 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/30d4e12d-badf-4c88-b298-65f806643a02-inventory\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb\" (UID: \"30d4e12d-badf-4c88-b298-65f806643a02\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb" Mar 16 17:28:44 crc kubenswrapper[5120]: I0316 17:28:44.647729 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/30d4e12d-badf-4c88-b298-65f806643a02-inventory\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb\" (UID: \"30d4e12d-badf-4c88-b298-65f806643a02\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb" Mar 16 17:28:44 crc kubenswrapper[5120]: I0316 17:28:44.647822 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"install-certs-ovrd-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/30d4e12d-badf-4c88-b298-65f806643a02-install-certs-ovrd-combined-ca-bundle\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb\" (UID: \"30d4e12d-badf-4c88-b298-65f806643a02\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb" Mar 16 17:28:44 crc kubenswrapper[5120]: I0316 17:28:44.647930 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openstack-edpm-tls-custom-tls-dns-default-certs-0\" (UniqueName: \"kubernetes.io/projected/30d4e12d-badf-4c88-b298-65f806643a02-openstack-edpm-tls-custom-tls-dns-default-certs-0\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb\" (UID: \"30d4e12d-badf-4c88-b298-65f806643a02\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb" Mar 16 17:28:44 crc kubenswrapper[5120]: I0316 17:28:44.647977 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"custom-tls-dns-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/30d4e12d-badf-4c88-b298-65f806643a02-custom-tls-dns-combined-ca-bundle\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb\" (UID: \"30d4e12d-badf-4c88-b298-65f806643a02\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb" Mar 16 17:28:44 crc kubenswrapper[5120]: I0316 17:28:44.648325 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-dns-ips-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/30d4e12d-badf-4c88-b298-65f806643a02-tls-dns-ips-combined-ca-bundle\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb\" (UID: \"30d4e12d-badf-4c88-b298-65f806643a02\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb" Mar 16 17:28:44 crc kubenswrapper[5120]: I0316 17:28:44.648497 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ssh-key-openstack-edpm-tls\" (UniqueName: \"kubernetes.io/secret/30d4e12d-badf-4c88-b298-65f806643a02-ssh-key-openstack-edpm-tls\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb\" (UID: \"30d4e12d-badf-4c88-b298-65f806643a02\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb" Mar 16 17:28:44 crc kubenswrapper[5120]: I0316 17:28:44.648551 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2qsjg\" (UniqueName: \"kubernetes.io/projected/30d4e12d-badf-4c88-b298-65f806643a02-kube-api-access-2qsjg\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb\" (UID: \"30d4e12d-badf-4c88-b298-65f806643a02\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb" Mar 16 17:28:44 crc kubenswrapper[5120]: I0316 17:28:44.648625 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openstack-edpm-tls-tls-dns-ips-default-certs-0\" (UniqueName: \"kubernetes.io/projected/30d4e12d-badf-4c88-b298-65f806643a02-openstack-edpm-tls-tls-dns-ips-default-certs-0\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb\" (UID: \"30d4e12d-badf-4c88-b298-65f806643a02\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb" Mar 16 17:28:44 crc kubenswrapper[5120]: I0316 17:28:44.655260 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ssh-key-openstack-edpm-tls\" (UniqueName: \"kubernetes.io/secret/30d4e12d-badf-4c88-b298-65f806643a02-ssh-key-openstack-edpm-tls\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb\" (UID: \"30d4e12d-badf-4c88-b298-65f806643a02\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb" Mar 16 17:28:44 crc kubenswrapper[5120]: I0316 17:28:44.655465 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/30d4e12d-badf-4c88-b298-65f806643a02-inventory\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb\" (UID: \"30d4e12d-badf-4c88-b298-65f806643a02\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb" Mar 16 17:28:44 crc kubenswrapper[5120]: I0316 17:28:44.655506 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openstack-edpm-tls-tls-dns-ips-default-certs-0\" (UniqueName: \"kubernetes.io/projected/30d4e12d-badf-4c88-b298-65f806643a02-openstack-edpm-tls-tls-dns-ips-default-certs-0\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb\" (UID: \"30d4e12d-badf-4c88-b298-65f806643a02\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb" Mar 16 17:28:44 crc kubenswrapper[5120]: I0316 17:28:44.665458 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"custom-tls-dns-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/30d4e12d-badf-4c88-b298-65f806643a02-custom-tls-dns-combined-ca-bundle\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb\" (UID: \"30d4e12d-badf-4c88-b298-65f806643a02\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb" Mar 16 17:28:44 crc kubenswrapper[5120]: I0316 17:28:44.670874 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"install-certs-ovrd-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/30d4e12d-badf-4c88-b298-65f806643a02-install-certs-ovrd-combined-ca-bundle\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb\" (UID: \"30d4e12d-badf-4c88-b298-65f806643a02\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb" Mar 16 17:28:44 crc kubenswrapper[5120]: I0316 17:28:44.671189 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openstack-edpm-tls-custom-tls-dns-default-certs-0\" (UniqueName: \"kubernetes.io/projected/30d4e12d-badf-4c88-b298-65f806643a02-openstack-edpm-tls-custom-tls-dns-default-certs-0\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb\" (UID: \"30d4e12d-badf-4c88-b298-65f806643a02\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb" Mar 16 17:28:44 crc kubenswrapper[5120]: I0316 17:28:44.679145 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-dns-ips-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/30d4e12d-badf-4c88-b298-65f806643a02-tls-dns-ips-combined-ca-bundle\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb\" (UID: \"30d4e12d-badf-4c88-b298-65f806643a02\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb" Mar 16 17:28:44 crc kubenswrapper[5120]: I0316 17:28:44.688130 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qsjg\" (UniqueName: \"kubernetes.io/projected/30d4e12d-badf-4c88-b298-65f806643a02-kube-api-access-2qsjg\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb\" (UID: \"30d4e12d-badf-4c88-b298-65f806643a02\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb" Mar 16 17:28:44 crc kubenswrapper[5120]: I0316 17:28:44.787486 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb" Mar 16 17:28:45 crc kubenswrapper[5120]: I0316 17:28:45.262590 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb"] Mar 16 17:28:45 crc kubenswrapper[5120]: I0316 17:28:45.569955 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb" event={"ID":"30d4e12d-badf-4c88-b298-65f806643a02","Type":"ContainerStarted","Data":"0ab7d563cdf0ff5c86aada9744708b40000471c0d43b36c0cbaf1e472ac8b250"} Mar 16 17:28:46 crc kubenswrapper[5120]: I0316 17:28:46.579611 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb" event={"ID":"30d4e12d-badf-4c88-b298-65f806643a02","Type":"ContainerStarted","Data":"9813d5e7521c43889a53c38a0b4ae488f75dba1765580aee59d404de0150a7fe"} Mar 16 17:28:46 crc kubenswrapper[5120]: I0316 17:28:46.597653 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb" podStartSLOduration=2.174351436 podStartE2EDuration="2.597629647s" podCreationTimestamp="2026-03-16 17:28:44 +0000 UTC" firstStartedPulling="2026-03-16 17:28:45.266313158 +0000 UTC m=+7027.420244805" lastFinishedPulling="2026-03-16 17:28:45.689591359 +0000 UTC m=+7027.843523016" observedRunningTime="2026-03-16 17:28:46.59258179 +0000 UTC m=+7028.746513447" watchObservedRunningTime="2026-03-16 17:28:46.597629647 +0000 UTC m=+7028.751561304" Mar 16 17:28:48 crc kubenswrapper[5120]: I0316 17:28:48.599676 5120 generic.go:358] "Generic (PLEG): container finished" podID="30d4e12d-badf-4c88-b298-65f806643a02" containerID="9813d5e7521c43889a53c38a0b4ae488f75dba1765580aee59d404de0150a7fe" exitCode=0 Mar 16 17:28:48 crc kubenswrapper[5120]: I0316 17:28:48.599739 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb" event={"ID":"30d4e12d-badf-4c88-b298-65f806643a02","Type":"ContainerDied","Data":"9813d5e7521c43889a53c38a0b4ae488f75dba1765580aee59d404de0150a7fe"} Mar 16 17:28:49 crc kubenswrapper[5120]: I0316 17:28:49.904943 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb" Mar 16 17:28:49 crc kubenswrapper[5120]: I0316 17:28:49.966889 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"install-certs-ovrd-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/30d4e12d-badf-4c88-b298-65f806643a02-install-certs-ovrd-combined-ca-bundle\") pod \"30d4e12d-badf-4c88-b298-65f806643a02\" (UID: \"30d4e12d-badf-4c88-b298-65f806643a02\") " Mar 16 17:28:49 crc kubenswrapper[5120]: I0316 17:28:49.967095 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-dns-ips-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/30d4e12d-badf-4c88-b298-65f806643a02-tls-dns-ips-combined-ca-bundle\") pod \"30d4e12d-badf-4c88-b298-65f806643a02\" (UID: \"30d4e12d-badf-4c88-b298-65f806643a02\") " Mar 16 17:28:49 crc kubenswrapper[5120]: I0316 17:28:49.967277 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ssh-key-openstack-edpm-tls\" (UniqueName: \"kubernetes.io/secret/30d4e12d-badf-4c88-b298-65f806643a02-ssh-key-openstack-edpm-tls\") pod \"30d4e12d-badf-4c88-b298-65f806643a02\" (UID: \"30d4e12d-badf-4c88-b298-65f806643a02\") " Mar 16 17:28:49 crc kubenswrapper[5120]: I0316 17:28:49.967495 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/30d4e12d-badf-4c88-b298-65f806643a02-inventory\") pod \"30d4e12d-badf-4c88-b298-65f806643a02\" (UID: \"30d4e12d-badf-4c88-b298-65f806643a02\") " Mar 16 17:28:49 crc kubenswrapper[5120]: I0316 17:28:49.967589 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"openstack-edpm-tls-tls-dns-ips-default-certs-0\" (UniqueName: \"kubernetes.io/projected/30d4e12d-badf-4c88-b298-65f806643a02-openstack-edpm-tls-tls-dns-ips-default-certs-0\") pod \"30d4e12d-badf-4c88-b298-65f806643a02\" (UID: \"30d4e12d-badf-4c88-b298-65f806643a02\") " Mar 16 17:28:49 crc kubenswrapper[5120]: I0316 17:28:49.967979 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"openstack-edpm-tls-custom-tls-dns-default-certs-0\" (UniqueName: \"kubernetes.io/projected/30d4e12d-badf-4c88-b298-65f806643a02-openstack-edpm-tls-custom-tls-dns-default-certs-0\") pod \"30d4e12d-badf-4c88-b298-65f806643a02\" (UID: \"30d4e12d-badf-4c88-b298-65f806643a02\") " Mar 16 17:28:49 crc kubenswrapper[5120]: I0316 17:28:49.968071 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2qsjg\" (UniqueName: \"kubernetes.io/projected/30d4e12d-badf-4c88-b298-65f806643a02-kube-api-access-2qsjg\") pod \"30d4e12d-badf-4c88-b298-65f806643a02\" (UID: \"30d4e12d-badf-4c88-b298-65f806643a02\") " Mar 16 17:28:49 crc kubenswrapper[5120]: I0316 17:28:49.968126 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"custom-tls-dns-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/30d4e12d-badf-4c88-b298-65f806643a02-custom-tls-dns-combined-ca-bundle\") pod \"30d4e12d-badf-4c88-b298-65f806643a02\" (UID: \"30d4e12d-badf-4c88-b298-65f806643a02\") " Mar 16 17:28:49 crc kubenswrapper[5120]: I0316 17:28:49.972664 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30d4e12d-badf-4c88-b298-65f806643a02-openstack-edpm-tls-tls-dns-ips-default-certs-0" (OuterVolumeSpecName: "openstack-edpm-tls-tls-dns-ips-default-certs-0") pod "30d4e12d-badf-4c88-b298-65f806643a02" (UID: "30d4e12d-badf-4c88-b298-65f806643a02"). InnerVolumeSpecName "openstack-edpm-tls-tls-dns-ips-default-certs-0". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:28:49 crc kubenswrapper[5120]: I0316 17:28:49.977139 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/30d4e12d-badf-4c88-b298-65f806643a02-tls-dns-ips-combined-ca-bundle" (OuterVolumeSpecName: "tls-dns-ips-combined-ca-bundle") pod "30d4e12d-badf-4c88-b298-65f806643a02" (UID: "30d4e12d-badf-4c88-b298-65f806643a02"). InnerVolumeSpecName "tls-dns-ips-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:28:49 crc kubenswrapper[5120]: I0316 17:28:49.977165 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/30d4e12d-badf-4c88-b298-65f806643a02-custom-tls-dns-combined-ca-bundle" (OuterVolumeSpecName: "custom-tls-dns-combined-ca-bundle") pod "30d4e12d-badf-4c88-b298-65f806643a02" (UID: "30d4e12d-badf-4c88-b298-65f806643a02"). InnerVolumeSpecName "custom-tls-dns-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:28:49 crc kubenswrapper[5120]: I0316 17:28:49.977202 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/30d4e12d-badf-4c88-b298-65f806643a02-install-certs-ovrd-combined-ca-bundle" (OuterVolumeSpecName: "install-certs-ovrd-combined-ca-bundle") pod "30d4e12d-badf-4c88-b298-65f806643a02" (UID: "30d4e12d-badf-4c88-b298-65f806643a02"). InnerVolumeSpecName "install-certs-ovrd-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:28:49 crc kubenswrapper[5120]: I0316 17:28:49.977243 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30d4e12d-badf-4c88-b298-65f806643a02-openstack-edpm-tls-custom-tls-dns-default-certs-0" (OuterVolumeSpecName: "openstack-edpm-tls-custom-tls-dns-default-certs-0") pod "30d4e12d-badf-4c88-b298-65f806643a02" (UID: "30d4e12d-badf-4c88-b298-65f806643a02"). InnerVolumeSpecName "openstack-edpm-tls-custom-tls-dns-default-certs-0". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:28:49 crc kubenswrapper[5120]: I0316 17:28:49.977281 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30d4e12d-badf-4c88-b298-65f806643a02-kube-api-access-2qsjg" (OuterVolumeSpecName: "kube-api-access-2qsjg") pod "30d4e12d-badf-4c88-b298-65f806643a02" (UID: "30d4e12d-badf-4c88-b298-65f806643a02"). InnerVolumeSpecName "kube-api-access-2qsjg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:28:49 crc kubenswrapper[5120]: I0316 17:28:49.989286 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/30d4e12d-badf-4c88-b298-65f806643a02-inventory" (OuterVolumeSpecName: "inventory") pod "30d4e12d-badf-4c88-b298-65f806643a02" (UID: "30d4e12d-badf-4c88-b298-65f806643a02"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:28:49 crc kubenswrapper[5120]: I0316 17:28:49.989405 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/30d4e12d-badf-4c88-b298-65f806643a02-ssh-key-openstack-edpm-tls" (OuterVolumeSpecName: "ssh-key-openstack-edpm-tls") pod "30d4e12d-badf-4c88-b298-65f806643a02" (UID: "30d4e12d-badf-4c88-b298-65f806643a02"). InnerVolumeSpecName "ssh-key-openstack-edpm-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:28:50 crc kubenswrapper[5120]: I0316 17:28:50.071825 5120 reconciler_common.go:299] "Volume detached for volume \"openstack-edpm-tls-custom-tls-dns-default-certs-0\" (UniqueName: \"kubernetes.io/projected/30d4e12d-badf-4c88-b298-65f806643a02-openstack-edpm-tls-custom-tls-dns-default-certs-0\") on node \"crc\" DevicePath \"\"" Mar 16 17:28:50 crc kubenswrapper[5120]: I0316 17:28:50.071868 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2qsjg\" (UniqueName: \"kubernetes.io/projected/30d4e12d-badf-4c88-b298-65f806643a02-kube-api-access-2qsjg\") on node \"crc\" DevicePath \"\"" Mar 16 17:28:50 crc kubenswrapper[5120]: I0316 17:28:50.071884 5120 reconciler_common.go:299] "Volume detached for volume \"custom-tls-dns-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/30d4e12d-badf-4c88-b298-65f806643a02-custom-tls-dns-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:28:50 crc kubenswrapper[5120]: I0316 17:28:50.071901 5120 reconciler_common.go:299] "Volume detached for volume \"install-certs-ovrd-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/30d4e12d-badf-4c88-b298-65f806643a02-install-certs-ovrd-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:28:50 crc kubenswrapper[5120]: I0316 17:28:50.071914 5120 reconciler_common.go:299] "Volume detached for volume \"tls-dns-ips-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/30d4e12d-badf-4c88-b298-65f806643a02-tls-dns-ips-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:28:50 crc kubenswrapper[5120]: I0316 17:28:50.071931 5120 reconciler_common.go:299] "Volume detached for volume \"ssh-key-openstack-edpm-tls\" (UniqueName: \"kubernetes.io/secret/30d4e12d-badf-4c88-b298-65f806643a02-ssh-key-openstack-edpm-tls\") on node \"crc\" DevicePath \"\"" Mar 16 17:28:50 crc kubenswrapper[5120]: I0316 17:28:50.071944 5120 reconciler_common.go:299] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/30d4e12d-badf-4c88-b298-65f806643a02-inventory\") on node \"crc\" DevicePath \"\"" Mar 16 17:28:50 crc kubenswrapper[5120]: I0316 17:28:50.071956 5120 reconciler_common.go:299] "Volume detached for volume \"openstack-edpm-tls-tls-dns-ips-default-certs-0\" (UniqueName: \"kubernetes.io/projected/30d4e12d-badf-4c88-b298-65f806643a02-openstack-edpm-tls-tls-dns-ips-default-certs-0\") on node \"crc\" DevicePath \"\"" Mar 16 17:28:50 crc kubenswrapper[5120]: I0316 17:28:50.626003 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb" Mar 16 17:28:50 crc kubenswrapper[5120]: I0316 17:28:50.626027 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb" event={"ID":"30d4e12d-badf-4c88-b298-65f806643a02","Type":"ContainerDied","Data":"0ab7d563cdf0ff5c86aada9744708b40000471c0d43b36c0cbaf1e472ac8b250"} Mar 16 17:28:50 crc kubenswrapper[5120]: I0316 17:28:50.626085 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0ab7d563cdf0ff5c86aada9744708b40000471c0d43b36c0cbaf1e472ac8b250" Mar 16 17:28:50 crc kubenswrapper[5120]: I0316 17:28:50.698524 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/tls-dns-ips-certs-refresh-openstack-edpm-tls-2tm4f"] Mar 16 17:28:50 crc kubenswrapper[5120]: I0316 17:28:50.699663 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30d4e12d-badf-4c88-b298-65f806643a02" containerName="install-certs-ovrd-certs-refresh-openstack-edpm-tls" Mar 16 17:28:50 crc kubenswrapper[5120]: I0316 17:28:50.699694 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="30d4e12d-badf-4c88-b298-65f806643a02" containerName="install-certs-ovrd-certs-refresh-openstack-edpm-tls" Mar 16 17:28:50 crc kubenswrapper[5120]: I0316 17:28:50.699944 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="30d4e12d-badf-4c88-b298-65f806643a02" containerName="install-certs-ovrd-certs-refresh-openstack-edpm-tls" Mar 16 17:28:50 crc kubenswrapper[5120]: I0316 17:28:50.706776 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/tls-dns-ips-certs-refresh-openstack-edpm-tls-2tm4f" Mar 16 17:28:50 crc kubenswrapper[5120]: I0316 17:28:50.707928 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/tls-dns-ips-certs-refresh-openstack-edpm-tls-2tm4f"] Mar 16 17:28:50 crc kubenswrapper[5120]: I0316 17:28:50.710900 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"combined-ca-bundle\"" Mar 16 17:28:50 crc kubenswrapper[5120]: I0316 17:28:50.711246 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"openstack-edpm-tls-dockercfg-kbq9x\"" Mar 16 17:28:50 crc kubenswrapper[5120]: I0316 17:28:50.711270 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-aee-default-env\"" Mar 16 17:28:50 crc kubenswrapper[5120]: I0316 17:28:50.711391 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplane-ansible-ssh-private-key-secret\"" Mar 16 17:28:50 crc kubenswrapper[5120]: I0316 17:28:50.711590 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplanenodeset-openstack-edpm-tls\"" Mar 16 17:28:50 crc kubenswrapper[5120]: I0316 17:28:50.786332 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/c2acbe7c-2082-4860-9c1f-9220d71880b3-inventory\") pod \"tls-dns-ips-certs-refresh-openstack-edpm-tls-2tm4f\" (UID: \"c2acbe7c-2082-4860-9c1f-9220d71880b3\") " pod="openstack-kuttl-tests/tls-dns-ips-certs-refresh-openstack-edpm-tls-2tm4f" Mar 16 17:28:50 crc kubenswrapper[5120]: I0316 17:28:50.786585 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key-openstack-edpm-tls\" (UniqueName: \"kubernetes.io/secret/c2acbe7c-2082-4860-9c1f-9220d71880b3-ssh-key-openstack-edpm-tls\") pod \"tls-dns-ips-certs-refresh-openstack-edpm-tls-2tm4f\" (UID: \"c2acbe7c-2082-4860-9c1f-9220d71880b3\") " pod="openstack-kuttl-tests/tls-dns-ips-certs-refresh-openstack-edpm-tls-2tm4f" Mar 16 17:28:50 crc kubenswrapper[5120]: I0316 17:28:50.786864 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtkj9\" (UniqueName: \"kubernetes.io/projected/c2acbe7c-2082-4860-9c1f-9220d71880b3-kube-api-access-jtkj9\") pod \"tls-dns-ips-certs-refresh-openstack-edpm-tls-2tm4f\" (UID: \"c2acbe7c-2082-4860-9c1f-9220d71880b3\") " pod="openstack-kuttl-tests/tls-dns-ips-certs-refresh-openstack-edpm-tls-2tm4f" Mar 16 17:28:50 crc kubenswrapper[5120]: I0316 17:28:50.787418 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-dns-ips-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c2acbe7c-2082-4860-9c1f-9220d71880b3-tls-dns-ips-combined-ca-bundle\") pod \"tls-dns-ips-certs-refresh-openstack-edpm-tls-2tm4f\" (UID: \"c2acbe7c-2082-4860-9c1f-9220d71880b3\") " pod="openstack-kuttl-tests/tls-dns-ips-certs-refresh-openstack-edpm-tls-2tm4f" Mar 16 17:28:50 crc kubenswrapper[5120]: I0316 17:28:50.889047 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-dns-ips-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c2acbe7c-2082-4860-9c1f-9220d71880b3-tls-dns-ips-combined-ca-bundle\") pod \"tls-dns-ips-certs-refresh-openstack-edpm-tls-2tm4f\" (UID: \"c2acbe7c-2082-4860-9c1f-9220d71880b3\") " pod="openstack-kuttl-tests/tls-dns-ips-certs-refresh-openstack-edpm-tls-2tm4f" Mar 16 17:28:50 crc kubenswrapper[5120]: I0316 17:28:50.889223 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/c2acbe7c-2082-4860-9c1f-9220d71880b3-inventory\") pod \"tls-dns-ips-certs-refresh-openstack-edpm-tls-2tm4f\" (UID: \"c2acbe7c-2082-4860-9c1f-9220d71880b3\") " pod="openstack-kuttl-tests/tls-dns-ips-certs-refresh-openstack-edpm-tls-2tm4f" Mar 16 17:28:50 crc kubenswrapper[5120]: I0316 17:28:50.889959 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ssh-key-openstack-edpm-tls\" (UniqueName: \"kubernetes.io/secret/c2acbe7c-2082-4860-9c1f-9220d71880b3-ssh-key-openstack-edpm-tls\") pod \"tls-dns-ips-certs-refresh-openstack-edpm-tls-2tm4f\" (UID: \"c2acbe7c-2082-4860-9c1f-9220d71880b3\") " pod="openstack-kuttl-tests/tls-dns-ips-certs-refresh-openstack-edpm-tls-2tm4f" Mar 16 17:28:50 crc kubenswrapper[5120]: I0316 17:28:50.890088 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jtkj9\" (UniqueName: \"kubernetes.io/projected/c2acbe7c-2082-4860-9c1f-9220d71880b3-kube-api-access-jtkj9\") pod \"tls-dns-ips-certs-refresh-openstack-edpm-tls-2tm4f\" (UID: \"c2acbe7c-2082-4860-9c1f-9220d71880b3\") " pod="openstack-kuttl-tests/tls-dns-ips-certs-refresh-openstack-edpm-tls-2tm4f" Mar 16 17:28:50 crc kubenswrapper[5120]: I0316 17:28:50.894096 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ssh-key-openstack-edpm-tls\" (UniqueName: \"kubernetes.io/secret/c2acbe7c-2082-4860-9c1f-9220d71880b3-ssh-key-openstack-edpm-tls\") pod \"tls-dns-ips-certs-refresh-openstack-edpm-tls-2tm4f\" (UID: \"c2acbe7c-2082-4860-9c1f-9220d71880b3\") " pod="openstack-kuttl-tests/tls-dns-ips-certs-refresh-openstack-edpm-tls-2tm4f" Mar 16 17:28:50 crc kubenswrapper[5120]: I0316 17:28:50.894115 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-dns-ips-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c2acbe7c-2082-4860-9c1f-9220d71880b3-tls-dns-ips-combined-ca-bundle\") pod \"tls-dns-ips-certs-refresh-openstack-edpm-tls-2tm4f\" (UID: \"c2acbe7c-2082-4860-9c1f-9220d71880b3\") " pod="openstack-kuttl-tests/tls-dns-ips-certs-refresh-openstack-edpm-tls-2tm4f" Mar 16 17:28:50 crc kubenswrapper[5120]: I0316 17:28:50.895650 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/c2acbe7c-2082-4860-9c1f-9220d71880b3-inventory\") pod \"tls-dns-ips-certs-refresh-openstack-edpm-tls-2tm4f\" (UID: \"c2acbe7c-2082-4860-9c1f-9220d71880b3\") " pod="openstack-kuttl-tests/tls-dns-ips-certs-refresh-openstack-edpm-tls-2tm4f" Mar 16 17:28:50 crc kubenswrapper[5120]: I0316 17:28:50.908536 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtkj9\" (UniqueName: \"kubernetes.io/projected/c2acbe7c-2082-4860-9c1f-9220d71880b3-kube-api-access-jtkj9\") pod \"tls-dns-ips-certs-refresh-openstack-edpm-tls-2tm4f\" (UID: \"c2acbe7c-2082-4860-9c1f-9220d71880b3\") " pod="openstack-kuttl-tests/tls-dns-ips-certs-refresh-openstack-edpm-tls-2tm4f" Mar 16 17:28:51 crc kubenswrapper[5120]: I0316 17:28:51.051941 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/tls-dns-ips-certs-refresh-openstack-edpm-tls-2tm4f" Mar 16 17:28:51 crc kubenswrapper[5120]: I0316 17:28:51.317990 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-sg8jg"] Mar 16 17:28:51 crc kubenswrapper[5120]: I0316 17:28:51.325976 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-sg8jg" Mar 16 17:28:51 crc kubenswrapper[5120]: I0316 17:28:51.330041 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"openstack-edpm-tls-tls-dns-ips-default-certs-0\"" Mar 16 17:28:51 crc kubenswrapper[5120]: I0316 17:28:51.330179 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"openstack-edpm-tls-custom-tls-dns-default-certs-0\"" Mar 16 17:28:51 crc kubenswrapper[5120]: I0316 17:28:51.335130 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-sg8jg"] Mar 16 17:28:51 crc kubenswrapper[5120]: I0316 17:28:51.398805 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/6787943d-625b-47cb-80c5-9cc72262c3c8-inventory\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-sg8jg\" (UID: \"6787943d-625b-47cb-80c5-9cc72262c3c8\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-sg8jg" Mar 16 17:28:51 crc kubenswrapper[5120]: I0316 17:28:51.398870 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"custom-tls-dns-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6787943d-625b-47cb-80c5-9cc72262c3c8-custom-tls-dns-combined-ca-bundle\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-sg8jg\" (UID: \"6787943d-625b-47cb-80c5-9cc72262c3c8\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-sg8jg" Mar 16 17:28:51 crc kubenswrapper[5120]: I0316 17:28:51.399469 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-edpm-tls-custom-tls-dns-default-certs-0\" (UniqueName: \"kubernetes.io/projected/6787943d-625b-47cb-80c5-9cc72262c3c8-openstack-edpm-tls-custom-tls-dns-default-certs-0\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-sg8jg\" (UID: \"6787943d-625b-47cb-80c5-9cc72262c3c8\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-sg8jg" Mar 16 17:28:51 crc kubenswrapper[5120]: I0316 17:28:51.399740 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key-openstack-edpm-tls\" (UniqueName: \"kubernetes.io/secret/6787943d-625b-47cb-80c5-9cc72262c3c8-ssh-key-openstack-edpm-tls\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-sg8jg\" (UID: \"6787943d-625b-47cb-80c5-9cc72262c3c8\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-sg8jg" Mar 16 17:28:51 crc kubenswrapper[5120]: I0316 17:28:51.399862 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-edpm-tls-tls-dns-ips-default-certs-0\" (UniqueName: \"kubernetes.io/projected/6787943d-625b-47cb-80c5-9cc72262c3c8-openstack-edpm-tls-tls-dns-ips-default-certs-0\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-sg8jg\" (UID: \"6787943d-625b-47cb-80c5-9cc72262c3c8\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-sg8jg" Mar 16 17:28:51 crc kubenswrapper[5120]: I0316 17:28:51.400023 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-dns-ips-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6787943d-625b-47cb-80c5-9cc72262c3c8-tls-dns-ips-combined-ca-bundle\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-sg8jg\" (UID: \"6787943d-625b-47cb-80c5-9cc72262c3c8\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-sg8jg" Mar 16 17:28:51 crc kubenswrapper[5120]: I0316 17:28:51.400105 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qsjg\" (UniqueName: \"kubernetes.io/projected/6787943d-625b-47cb-80c5-9cc72262c3c8-kube-api-access-2qsjg\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-sg8jg\" (UID: \"6787943d-625b-47cb-80c5-9cc72262c3c8\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-sg8jg" Mar 16 17:28:51 crc kubenswrapper[5120]: I0316 17:28:51.400144 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"install-certs-ovrd-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6787943d-625b-47cb-80c5-9cc72262c3c8-install-certs-ovrd-combined-ca-bundle\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-sg8jg\" (UID: \"6787943d-625b-47cb-80c5-9cc72262c3c8\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-sg8jg" Mar 16 17:28:51 crc kubenswrapper[5120]: I0316 17:28:51.464798 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/tls-dns-ips-certs-refresh-openstack-edpm-tls-2tm4f"] Mar 16 17:28:51 crc kubenswrapper[5120]: I0316 17:28:51.503022 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-dns-ips-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6787943d-625b-47cb-80c5-9cc72262c3c8-tls-dns-ips-combined-ca-bundle\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-sg8jg\" (UID: \"6787943d-625b-47cb-80c5-9cc72262c3c8\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-sg8jg" Mar 16 17:28:51 crc kubenswrapper[5120]: I0316 17:28:51.503457 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2qsjg\" (UniqueName: \"kubernetes.io/projected/6787943d-625b-47cb-80c5-9cc72262c3c8-kube-api-access-2qsjg\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-sg8jg\" (UID: \"6787943d-625b-47cb-80c5-9cc72262c3c8\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-sg8jg" Mar 16 17:28:51 crc kubenswrapper[5120]: I0316 17:28:51.503528 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"install-certs-ovrd-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6787943d-625b-47cb-80c5-9cc72262c3c8-install-certs-ovrd-combined-ca-bundle\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-sg8jg\" (UID: \"6787943d-625b-47cb-80c5-9cc72262c3c8\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-sg8jg" Mar 16 17:28:51 crc kubenswrapper[5120]: I0316 17:28:51.503680 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/6787943d-625b-47cb-80c5-9cc72262c3c8-inventory\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-sg8jg\" (UID: \"6787943d-625b-47cb-80c5-9cc72262c3c8\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-sg8jg" Mar 16 17:28:51 crc kubenswrapper[5120]: I0316 17:28:51.503738 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"custom-tls-dns-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6787943d-625b-47cb-80c5-9cc72262c3c8-custom-tls-dns-combined-ca-bundle\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-sg8jg\" (UID: \"6787943d-625b-47cb-80c5-9cc72262c3c8\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-sg8jg" Mar 16 17:28:51 crc kubenswrapper[5120]: I0316 17:28:51.503898 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openstack-edpm-tls-custom-tls-dns-default-certs-0\" (UniqueName: \"kubernetes.io/projected/6787943d-625b-47cb-80c5-9cc72262c3c8-openstack-edpm-tls-custom-tls-dns-default-certs-0\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-sg8jg\" (UID: \"6787943d-625b-47cb-80c5-9cc72262c3c8\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-sg8jg" Mar 16 17:28:51 crc kubenswrapper[5120]: I0316 17:28:51.503945 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ssh-key-openstack-edpm-tls\" (UniqueName: \"kubernetes.io/secret/6787943d-625b-47cb-80c5-9cc72262c3c8-ssh-key-openstack-edpm-tls\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-sg8jg\" (UID: \"6787943d-625b-47cb-80c5-9cc72262c3c8\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-sg8jg" Mar 16 17:28:51 crc kubenswrapper[5120]: I0316 17:28:51.503989 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openstack-edpm-tls-tls-dns-ips-default-certs-0\" (UniqueName: \"kubernetes.io/projected/6787943d-625b-47cb-80c5-9cc72262c3c8-openstack-edpm-tls-tls-dns-ips-default-certs-0\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-sg8jg\" (UID: \"6787943d-625b-47cb-80c5-9cc72262c3c8\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-sg8jg" Mar 16 17:28:51 crc kubenswrapper[5120]: I0316 17:28:51.511337 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-dns-ips-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6787943d-625b-47cb-80c5-9cc72262c3c8-tls-dns-ips-combined-ca-bundle\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-sg8jg\" (UID: \"6787943d-625b-47cb-80c5-9cc72262c3c8\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-sg8jg" Mar 16 17:28:51 crc kubenswrapper[5120]: I0316 17:28:51.511897 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openstack-edpm-tls-tls-dns-ips-default-certs-0\" (UniqueName: \"kubernetes.io/projected/6787943d-625b-47cb-80c5-9cc72262c3c8-openstack-edpm-tls-tls-dns-ips-default-certs-0\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-sg8jg\" (UID: \"6787943d-625b-47cb-80c5-9cc72262c3c8\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-sg8jg" Mar 16 17:28:51 crc kubenswrapper[5120]: I0316 17:28:51.511977 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"install-certs-ovrd-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6787943d-625b-47cb-80c5-9cc72262c3c8-install-certs-ovrd-combined-ca-bundle\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-sg8jg\" (UID: \"6787943d-625b-47cb-80c5-9cc72262c3c8\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-sg8jg" Mar 16 17:28:51 crc kubenswrapper[5120]: I0316 17:28:51.512095 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"custom-tls-dns-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6787943d-625b-47cb-80c5-9cc72262c3c8-custom-tls-dns-combined-ca-bundle\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-sg8jg\" (UID: \"6787943d-625b-47cb-80c5-9cc72262c3c8\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-sg8jg" Mar 16 17:28:51 crc kubenswrapper[5120]: I0316 17:28:51.512170 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ssh-key-openstack-edpm-tls\" (UniqueName: \"kubernetes.io/secret/6787943d-625b-47cb-80c5-9cc72262c3c8-ssh-key-openstack-edpm-tls\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-sg8jg\" (UID: \"6787943d-625b-47cb-80c5-9cc72262c3c8\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-sg8jg" Mar 16 17:28:51 crc kubenswrapper[5120]: I0316 17:28:51.512634 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openstack-edpm-tls-custom-tls-dns-default-certs-0\" (UniqueName: \"kubernetes.io/projected/6787943d-625b-47cb-80c5-9cc72262c3c8-openstack-edpm-tls-custom-tls-dns-default-certs-0\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-sg8jg\" (UID: \"6787943d-625b-47cb-80c5-9cc72262c3c8\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-sg8jg" Mar 16 17:28:51 crc kubenswrapper[5120]: I0316 17:28:51.512713 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/6787943d-625b-47cb-80c5-9cc72262c3c8-inventory\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-sg8jg\" (UID: \"6787943d-625b-47cb-80c5-9cc72262c3c8\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-sg8jg" Mar 16 17:28:51 crc kubenswrapper[5120]: I0316 17:28:51.522355 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qsjg\" (UniqueName: \"kubernetes.io/projected/6787943d-625b-47cb-80c5-9cc72262c3c8-kube-api-access-2qsjg\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-sg8jg\" (UID: \"6787943d-625b-47cb-80c5-9cc72262c3c8\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-sg8jg" Mar 16 17:28:51 crc kubenswrapper[5120]: I0316 17:28:51.636804 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/tls-dns-ips-certs-refresh-openstack-edpm-tls-2tm4f" event={"ID":"c2acbe7c-2082-4860-9c1f-9220d71880b3","Type":"ContainerStarted","Data":"4b36ef933edbb275dac8a7df0487d494957244797941dc3e99789515910bd4f8"} Mar 16 17:28:51 crc kubenswrapper[5120]: I0316 17:28:51.654583 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-sg8jg" Mar 16 17:28:51 crc kubenswrapper[5120]: E0316 17:28:51.655054 5120 kubelet_pods.go:553] "Hostname for pod was too long, truncated it" podName="install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-sg8jg" hostnameMaxLen=63 truncatedHostname="install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug" Mar 16 17:28:52 crc kubenswrapper[5120]: I0316 17:28:52.008602 5120 patch_prober.go:28] interesting pod/machine-config-daemon-7bf76 container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 17:28:52 crc kubenswrapper[5120]: I0316 17:28:52.008688 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 17:28:52 crc kubenswrapper[5120]: I0316 17:28:52.008742 5120 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" Mar 16 17:28:52 crc kubenswrapper[5120]: I0316 17:28:52.009521 5120 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="machine-config-daemon" containerStatusID={"Type":"cri-o","ID":"df0a87b047c8208d5fc21057efed33321f6cab49c4cf053702d222dc12979450"} pod="openshift-machine-config-operator/machine-config-daemon-7bf76" containerMessage="Container machine-config-daemon failed liveness probe, will be restarted" Mar 16 17:28:52 crc kubenswrapper[5120]: I0316 17:28:52.009585 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" containerID="cri-o://df0a87b047c8208d5fc21057efed33321f6cab49c4cf053702d222dc12979450" gracePeriod=600 Mar 16 17:28:52 crc kubenswrapper[5120]: I0316 17:28:52.068960 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-sg8jg"] Mar 16 17:28:52 crc kubenswrapper[5120]: W0316 17:28:52.069186 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6787943d_625b_47cb_80c5_9cc72262c3c8.slice/crio-31ab031509941c6d1f3b3839d5284738fc8a412e534740eeb3fc123787f432d2 WatchSource:0}: Error finding container 31ab031509941c6d1f3b3839d5284738fc8a412e534740eeb3fc123787f432d2: Status 404 returned error can't find the container with id 31ab031509941c6d1f3b3839d5284738fc8a412e534740eeb3fc123787f432d2 Mar 16 17:28:52 crc kubenswrapper[5120]: E0316 17:28:52.070622 5120 kubelet_pods.go:553] "Hostname for pod was too long, truncated it" podName="install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-sg8jg" hostnameMaxLen=63 truncatedHostname="install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug" Mar 16 17:28:52 crc kubenswrapper[5120]: E0316 17:28:52.134687 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 17:28:52 crc kubenswrapper[5120]: I0316 17:28:52.651814 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/tls-dns-ips-certs-refresh-openstack-edpm-tls-2tm4f" event={"ID":"c2acbe7c-2082-4860-9c1f-9220d71880b3","Type":"ContainerStarted","Data":"c9cc5ae6ca611d80618a11a70f537f31705651222046ae6bbbd6d05dd6762c70"} Mar 16 17:28:52 crc kubenswrapper[5120]: I0316 17:28:52.654412 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-sg8jg" event={"ID":"6787943d-625b-47cb-80c5-9cc72262c3c8","Type":"ContainerStarted","Data":"31ab031509941c6d1f3b3839d5284738fc8a412e534740eeb3fc123787f432d2"} Mar 16 17:28:52 crc kubenswrapper[5120]: I0316 17:28:52.662253 5120 generic.go:358] "Generic (PLEG): container finished" podID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerID="df0a87b047c8208d5fc21057efed33321f6cab49c4cf053702d222dc12979450" exitCode=0 Mar 16 17:28:52 crc kubenswrapper[5120]: I0316 17:28:52.662529 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" event={"ID":"e2275cb4-4905-4d66-a87e-8010120db2bd","Type":"ContainerDied","Data":"df0a87b047c8208d5fc21057efed33321f6cab49c4cf053702d222dc12979450"} Mar 16 17:28:52 crc kubenswrapper[5120]: I0316 17:28:52.662801 5120 scope.go:117] "RemoveContainer" containerID="705b2fc8d158c06189736fd1aaa4ad03cb7c69d2b4b29439feb0bec2c2b5228a" Mar 16 17:28:52 crc kubenswrapper[5120]: I0316 17:28:52.664649 5120 scope.go:117] "RemoveContainer" containerID="df0a87b047c8208d5fc21057efed33321f6cab49c4cf053702d222dc12979450" Mar 16 17:28:52 crc kubenswrapper[5120]: E0316 17:28:52.665172 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 17:28:52 crc kubenswrapper[5120]: I0316 17:28:52.676726 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/tls-dns-ips-certs-refresh-openstack-edpm-tls-2tm4f" podStartSLOduration=1.989917908 podStartE2EDuration="2.676706839s" podCreationTimestamp="2026-03-16 17:28:50 +0000 UTC" firstStartedPulling="2026-03-16 17:28:51.471916732 +0000 UTC m=+7033.625848389" lastFinishedPulling="2026-03-16 17:28:52.158705663 +0000 UTC m=+7034.312637320" observedRunningTime="2026-03-16 17:28:52.670416648 +0000 UTC m=+7034.824348305" watchObservedRunningTime="2026-03-16 17:28:52.676706839 +0000 UTC m=+7034.830638496" Mar 16 17:28:52 crc kubenswrapper[5120]: E0316 17:28:52.746317 5120 kubelet_pods.go:553] "Hostname for pod was too long, truncated it" podName="install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-sg8jg" hostnameMaxLen=63 truncatedHostname="install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug" Mar 16 17:28:53 crc kubenswrapper[5120]: I0316 17:28:53.674223 5120 generic.go:358] "Generic (PLEG): container finished" podID="6787943d-625b-47cb-80c5-9cc72262c3c8" containerID="273093c5fd18216c994bf5b0a6086ca9a4b63b9a341d4dd3897dc277cb160594" exitCode=0 Mar 16 17:28:53 crc kubenswrapper[5120]: I0316 17:28:53.674851 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-sg8jg" event={"ID":"6787943d-625b-47cb-80c5-9cc72262c3c8","Type":"ContainerDied","Data":"273093c5fd18216c994bf5b0a6086ca9a4b63b9a341d4dd3897dc277cb160594"} Mar 16 17:28:53 crc kubenswrapper[5120]: I0316 17:28:53.729281 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-sg8jg"] Mar 16 17:28:53 crc kubenswrapper[5120]: I0316 17:28:53.737103 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-sg8jg"] Mar 16 17:28:54 crc kubenswrapper[5120]: I0316 17:28:54.004983 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-gnx9r"] Mar 16 17:28:54 crc kubenswrapper[5120]: I0316 17:28:54.005952 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6787943d-625b-47cb-80c5-9cc72262c3c8" containerName="install-certs-ovrd-certs-refresh-openstack-edpm-tls" Mar 16 17:28:54 crc kubenswrapper[5120]: I0316 17:28:54.005979 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="6787943d-625b-47cb-80c5-9cc72262c3c8" containerName="install-certs-ovrd-certs-refresh-openstack-edpm-tls" Mar 16 17:28:54 crc kubenswrapper[5120]: I0316 17:28:54.006109 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="6787943d-625b-47cb-80c5-9cc72262c3c8" containerName="install-certs-ovrd-certs-refresh-openstack-edpm-tls" Mar 16 17:28:54 crc kubenswrapper[5120]: I0316 17:28:54.013245 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-gnx9r" Mar 16 17:28:54 crc kubenswrapper[5120]: I0316 17:28:54.020326 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-gnx9r"] Mar 16 17:28:54 crc kubenswrapper[5120]: I0316 17:28:54.159959 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key-openstack-edpm-tls\" (UniqueName: \"kubernetes.io/secret/59fd0685-d834-4605-b606-e45eb6e88b83-ssh-key-openstack-edpm-tls\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-gnx9r\" (UID: \"59fd0685-d834-4605-b606-e45eb6e88b83\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-gnx9r" Mar 16 17:28:54 crc kubenswrapper[5120]: I0316 17:28:54.160034 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/59fd0685-d834-4605-b606-e45eb6e88b83-inventory\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-gnx9r\" (UID: \"59fd0685-d834-4605-b606-e45eb6e88b83\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-gnx9r" Mar 16 17:28:54 crc kubenswrapper[5120]: I0316 17:28:54.160237 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qsjg\" (UniqueName: \"kubernetes.io/projected/59fd0685-d834-4605-b606-e45eb6e88b83-kube-api-access-2qsjg\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-gnx9r\" (UID: \"59fd0685-d834-4605-b606-e45eb6e88b83\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-gnx9r" Mar 16 17:28:54 crc kubenswrapper[5120]: I0316 17:28:54.160513 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"custom-tls-dns-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/59fd0685-d834-4605-b606-e45eb6e88b83-custom-tls-dns-combined-ca-bundle\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-gnx9r\" (UID: \"59fd0685-d834-4605-b606-e45eb6e88b83\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-gnx9r" Mar 16 17:28:54 crc kubenswrapper[5120]: I0316 17:28:54.160705 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-edpm-tls-tls-dns-ips-default-certs-0\" (UniqueName: \"kubernetes.io/projected/59fd0685-d834-4605-b606-e45eb6e88b83-openstack-edpm-tls-tls-dns-ips-default-certs-0\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-gnx9r\" (UID: \"59fd0685-d834-4605-b606-e45eb6e88b83\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-gnx9r" Mar 16 17:28:54 crc kubenswrapper[5120]: I0316 17:28:54.160964 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-dns-ips-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/59fd0685-d834-4605-b606-e45eb6e88b83-tls-dns-ips-combined-ca-bundle\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-gnx9r\" (UID: \"59fd0685-d834-4605-b606-e45eb6e88b83\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-gnx9r" Mar 16 17:28:54 crc kubenswrapper[5120]: I0316 17:28:54.161031 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-edpm-tls-custom-tls-dns-default-certs-0\" (UniqueName: \"kubernetes.io/projected/59fd0685-d834-4605-b606-e45eb6e88b83-openstack-edpm-tls-custom-tls-dns-default-certs-0\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-gnx9r\" (UID: \"59fd0685-d834-4605-b606-e45eb6e88b83\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-gnx9r" Mar 16 17:28:54 crc kubenswrapper[5120]: I0316 17:28:54.161113 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"install-certs-ovrd-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/59fd0685-d834-4605-b606-e45eb6e88b83-install-certs-ovrd-combined-ca-bundle\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-gnx9r\" (UID: \"59fd0685-d834-4605-b606-e45eb6e88b83\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-gnx9r" Mar 16 17:28:54 crc kubenswrapper[5120]: I0316 17:28:54.263318 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openstack-edpm-tls-tls-dns-ips-default-certs-0\" (UniqueName: \"kubernetes.io/projected/59fd0685-d834-4605-b606-e45eb6e88b83-openstack-edpm-tls-tls-dns-ips-default-certs-0\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-gnx9r\" (UID: \"59fd0685-d834-4605-b606-e45eb6e88b83\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-gnx9r" Mar 16 17:28:54 crc kubenswrapper[5120]: I0316 17:28:54.263513 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-dns-ips-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/59fd0685-d834-4605-b606-e45eb6e88b83-tls-dns-ips-combined-ca-bundle\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-gnx9r\" (UID: \"59fd0685-d834-4605-b606-e45eb6e88b83\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-gnx9r" Mar 16 17:28:54 crc kubenswrapper[5120]: I0316 17:28:54.263580 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openstack-edpm-tls-custom-tls-dns-default-certs-0\" (UniqueName: \"kubernetes.io/projected/59fd0685-d834-4605-b606-e45eb6e88b83-openstack-edpm-tls-custom-tls-dns-default-certs-0\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-gnx9r\" (UID: \"59fd0685-d834-4605-b606-e45eb6e88b83\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-gnx9r" Mar 16 17:28:54 crc kubenswrapper[5120]: I0316 17:28:54.263640 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"install-certs-ovrd-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/59fd0685-d834-4605-b606-e45eb6e88b83-install-certs-ovrd-combined-ca-bundle\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-gnx9r\" (UID: \"59fd0685-d834-4605-b606-e45eb6e88b83\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-gnx9r" Mar 16 17:28:54 crc kubenswrapper[5120]: I0316 17:28:54.263703 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ssh-key-openstack-edpm-tls\" (UniqueName: \"kubernetes.io/secret/59fd0685-d834-4605-b606-e45eb6e88b83-ssh-key-openstack-edpm-tls\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-gnx9r\" (UID: \"59fd0685-d834-4605-b606-e45eb6e88b83\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-gnx9r" Mar 16 17:28:54 crc kubenswrapper[5120]: I0316 17:28:54.263808 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/59fd0685-d834-4605-b606-e45eb6e88b83-inventory\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-gnx9r\" (UID: \"59fd0685-d834-4605-b606-e45eb6e88b83\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-gnx9r" Mar 16 17:28:54 crc kubenswrapper[5120]: I0316 17:28:54.263985 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2qsjg\" (UniqueName: \"kubernetes.io/projected/59fd0685-d834-4605-b606-e45eb6e88b83-kube-api-access-2qsjg\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-gnx9r\" (UID: \"59fd0685-d834-4605-b606-e45eb6e88b83\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-gnx9r" Mar 16 17:28:54 crc kubenswrapper[5120]: I0316 17:28:54.264146 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"custom-tls-dns-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/59fd0685-d834-4605-b606-e45eb6e88b83-custom-tls-dns-combined-ca-bundle\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-gnx9r\" (UID: \"59fd0685-d834-4605-b606-e45eb6e88b83\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-gnx9r" Mar 16 17:28:54 crc kubenswrapper[5120]: I0316 17:28:54.269301 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/59fd0685-d834-4605-b606-e45eb6e88b83-inventory\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-gnx9r\" (UID: \"59fd0685-d834-4605-b606-e45eb6e88b83\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-gnx9r" Mar 16 17:28:54 crc kubenswrapper[5120]: I0316 17:28:54.269301 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"install-certs-ovrd-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/59fd0685-d834-4605-b606-e45eb6e88b83-install-certs-ovrd-combined-ca-bundle\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-gnx9r\" (UID: \"59fd0685-d834-4605-b606-e45eb6e88b83\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-gnx9r" Mar 16 17:28:54 crc kubenswrapper[5120]: I0316 17:28:54.269703 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-dns-ips-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/59fd0685-d834-4605-b606-e45eb6e88b83-tls-dns-ips-combined-ca-bundle\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-gnx9r\" (UID: \"59fd0685-d834-4605-b606-e45eb6e88b83\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-gnx9r" Mar 16 17:28:54 crc kubenswrapper[5120]: I0316 17:28:54.269996 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openstack-edpm-tls-custom-tls-dns-default-certs-0\" (UniqueName: \"kubernetes.io/projected/59fd0685-d834-4605-b606-e45eb6e88b83-openstack-edpm-tls-custom-tls-dns-default-certs-0\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-gnx9r\" (UID: \"59fd0685-d834-4605-b606-e45eb6e88b83\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-gnx9r" Mar 16 17:28:54 crc kubenswrapper[5120]: I0316 17:28:54.270014 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"custom-tls-dns-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/59fd0685-d834-4605-b606-e45eb6e88b83-custom-tls-dns-combined-ca-bundle\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-gnx9r\" (UID: \"59fd0685-d834-4605-b606-e45eb6e88b83\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-gnx9r" Mar 16 17:28:54 crc kubenswrapper[5120]: I0316 17:28:54.270164 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ssh-key-openstack-edpm-tls\" (UniqueName: \"kubernetes.io/secret/59fd0685-d834-4605-b606-e45eb6e88b83-ssh-key-openstack-edpm-tls\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-gnx9r\" (UID: \"59fd0685-d834-4605-b606-e45eb6e88b83\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-gnx9r" Mar 16 17:28:54 crc kubenswrapper[5120]: I0316 17:28:54.271166 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openstack-edpm-tls-tls-dns-ips-default-certs-0\" (UniqueName: \"kubernetes.io/projected/59fd0685-d834-4605-b606-e45eb6e88b83-openstack-edpm-tls-tls-dns-ips-default-certs-0\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-gnx9r\" (UID: \"59fd0685-d834-4605-b606-e45eb6e88b83\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-gnx9r" Mar 16 17:28:54 crc kubenswrapper[5120]: I0316 17:28:54.282735 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qsjg\" (UniqueName: \"kubernetes.io/projected/59fd0685-d834-4605-b606-e45eb6e88b83-kube-api-access-2qsjg\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-gnx9r\" (UID: \"59fd0685-d834-4605-b606-e45eb6e88b83\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-gnx9r" Mar 16 17:28:54 crc kubenswrapper[5120]: I0316 17:28:54.338992 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-gnx9r" Mar 16 17:28:54 crc kubenswrapper[5120]: E0316 17:28:54.339404 5120 kubelet_pods.go:553] "Hostname for pod was too long, truncated it" podName="install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-gnx9r" hostnameMaxLen=63 truncatedHostname="install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug" Mar 16 17:28:54 crc kubenswrapper[5120]: I0316 17:28:54.737313 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-gnx9r"] Mar 16 17:28:54 crc kubenswrapper[5120]: W0316 17:28:54.742064 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod59fd0685_d834_4605_b606_e45eb6e88b83.slice/crio-e779d97b4e37d1563c48ba82914d0d7190ff2263113ffacd61f1d2f143542f90 WatchSource:0}: Error finding container e779d97b4e37d1563c48ba82914d0d7190ff2263113ffacd61f1d2f143542f90: Status 404 returned error can't find the container with id e779d97b4e37d1563c48ba82914d0d7190ff2263113ffacd61f1d2f143542f90 Mar 16 17:28:54 crc kubenswrapper[5120]: E0316 17:28:54.743332 5120 kubelet_pods.go:553] "Hostname for pod was too long, truncated it" podName="install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-gnx9r" hostnameMaxLen=63 truncatedHostname="install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug" Mar 16 17:28:54 crc kubenswrapper[5120]: I0316 17:28:54.932601 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-sg8jg" Mar 16 17:28:55 crc kubenswrapper[5120]: I0316 17:28:55.079342 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-dns-ips-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6787943d-625b-47cb-80c5-9cc72262c3c8-tls-dns-ips-combined-ca-bundle\") pod \"6787943d-625b-47cb-80c5-9cc72262c3c8\" (UID: \"6787943d-625b-47cb-80c5-9cc72262c3c8\") " Mar 16 17:28:55 crc kubenswrapper[5120]: I0316 17:28:55.079521 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"install-certs-ovrd-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6787943d-625b-47cb-80c5-9cc72262c3c8-install-certs-ovrd-combined-ca-bundle\") pod \"6787943d-625b-47cb-80c5-9cc72262c3c8\" (UID: \"6787943d-625b-47cb-80c5-9cc72262c3c8\") " Mar 16 17:28:55 crc kubenswrapper[5120]: I0316 17:28:55.079801 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ssh-key-openstack-edpm-tls\" (UniqueName: \"kubernetes.io/secret/6787943d-625b-47cb-80c5-9cc72262c3c8-ssh-key-openstack-edpm-tls\") pod \"6787943d-625b-47cb-80c5-9cc72262c3c8\" (UID: \"6787943d-625b-47cb-80c5-9cc72262c3c8\") " Mar 16 17:28:55 crc kubenswrapper[5120]: I0316 17:28:55.080048 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"openstack-edpm-tls-custom-tls-dns-default-certs-0\" (UniqueName: \"kubernetes.io/projected/6787943d-625b-47cb-80c5-9cc72262c3c8-openstack-edpm-tls-custom-tls-dns-default-certs-0\") pod \"6787943d-625b-47cb-80c5-9cc72262c3c8\" (UID: \"6787943d-625b-47cb-80c5-9cc72262c3c8\") " Mar 16 17:28:55 crc kubenswrapper[5120]: I0316 17:28:55.080506 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"custom-tls-dns-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6787943d-625b-47cb-80c5-9cc72262c3c8-custom-tls-dns-combined-ca-bundle\") pod \"6787943d-625b-47cb-80c5-9cc72262c3c8\" (UID: \"6787943d-625b-47cb-80c5-9cc72262c3c8\") " Mar 16 17:28:55 crc kubenswrapper[5120]: I0316 17:28:55.080584 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/6787943d-625b-47cb-80c5-9cc72262c3c8-inventory\") pod \"6787943d-625b-47cb-80c5-9cc72262c3c8\" (UID: \"6787943d-625b-47cb-80c5-9cc72262c3c8\") " Mar 16 17:28:55 crc kubenswrapper[5120]: I0316 17:28:55.080655 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"openstack-edpm-tls-tls-dns-ips-default-certs-0\" (UniqueName: \"kubernetes.io/projected/6787943d-625b-47cb-80c5-9cc72262c3c8-openstack-edpm-tls-tls-dns-ips-default-certs-0\") pod \"6787943d-625b-47cb-80c5-9cc72262c3c8\" (UID: \"6787943d-625b-47cb-80c5-9cc72262c3c8\") " Mar 16 17:28:55 crc kubenswrapper[5120]: I0316 17:28:55.080750 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2qsjg\" (UniqueName: \"kubernetes.io/projected/6787943d-625b-47cb-80c5-9cc72262c3c8-kube-api-access-2qsjg\") pod \"6787943d-625b-47cb-80c5-9cc72262c3c8\" (UID: \"6787943d-625b-47cb-80c5-9cc72262c3c8\") " Mar 16 17:28:55 crc kubenswrapper[5120]: I0316 17:28:55.085178 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6787943d-625b-47cb-80c5-9cc72262c3c8-tls-dns-ips-combined-ca-bundle" (OuterVolumeSpecName: "tls-dns-ips-combined-ca-bundle") pod "6787943d-625b-47cb-80c5-9cc72262c3c8" (UID: "6787943d-625b-47cb-80c5-9cc72262c3c8"). InnerVolumeSpecName "tls-dns-ips-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:28:55 crc kubenswrapper[5120]: I0316 17:28:55.085411 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6787943d-625b-47cb-80c5-9cc72262c3c8-install-certs-ovrd-combined-ca-bundle" (OuterVolumeSpecName: "install-certs-ovrd-combined-ca-bundle") pod "6787943d-625b-47cb-80c5-9cc72262c3c8" (UID: "6787943d-625b-47cb-80c5-9cc72262c3c8"). InnerVolumeSpecName "install-certs-ovrd-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:28:55 crc kubenswrapper[5120]: I0316 17:28:55.085512 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6787943d-625b-47cb-80c5-9cc72262c3c8-openstack-edpm-tls-custom-tls-dns-default-certs-0" (OuterVolumeSpecName: "openstack-edpm-tls-custom-tls-dns-default-certs-0") pod "6787943d-625b-47cb-80c5-9cc72262c3c8" (UID: "6787943d-625b-47cb-80c5-9cc72262c3c8"). InnerVolumeSpecName "openstack-edpm-tls-custom-tls-dns-default-certs-0". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:28:55 crc kubenswrapper[5120]: I0316 17:28:55.085551 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6787943d-625b-47cb-80c5-9cc72262c3c8-kube-api-access-2qsjg" (OuterVolumeSpecName: "kube-api-access-2qsjg") pod "6787943d-625b-47cb-80c5-9cc72262c3c8" (UID: "6787943d-625b-47cb-80c5-9cc72262c3c8"). InnerVolumeSpecName "kube-api-access-2qsjg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:28:55 crc kubenswrapper[5120]: I0316 17:28:55.085691 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6787943d-625b-47cb-80c5-9cc72262c3c8-custom-tls-dns-combined-ca-bundle" (OuterVolumeSpecName: "custom-tls-dns-combined-ca-bundle") pod "6787943d-625b-47cb-80c5-9cc72262c3c8" (UID: "6787943d-625b-47cb-80c5-9cc72262c3c8"). InnerVolumeSpecName "custom-tls-dns-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:28:55 crc kubenswrapper[5120]: I0316 17:28:55.086695 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6787943d-625b-47cb-80c5-9cc72262c3c8-openstack-edpm-tls-tls-dns-ips-default-certs-0" (OuterVolumeSpecName: "openstack-edpm-tls-tls-dns-ips-default-certs-0") pod "6787943d-625b-47cb-80c5-9cc72262c3c8" (UID: "6787943d-625b-47cb-80c5-9cc72262c3c8"). InnerVolumeSpecName "openstack-edpm-tls-tls-dns-ips-default-certs-0". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:28:55 crc kubenswrapper[5120]: I0316 17:28:55.101368 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6787943d-625b-47cb-80c5-9cc72262c3c8-ssh-key-openstack-edpm-tls" (OuterVolumeSpecName: "ssh-key-openstack-edpm-tls") pod "6787943d-625b-47cb-80c5-9cc72262c3c8" (UID: "6787943d-625b-47cb-80c5-9cc72262c3c8"). InnerVolumeSpecName "ssh-key-openstack-edpm-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:28:55 crc kubenswrapper[5120]: I0316 17:28:55.102111 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6787943d-625b-47cb-80c5-9cc72262c3c8-inventory" (OuterVolumeSpecName: "inventory") pod "6787943d-625b-47cb-80c5-9cc72262c3c8" (UID: "6787943d-625b-47cb-80c5-9cc72262c3c8"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:28:55 crc kubenswrapper[5120]: I0316 17:28:55.185119 5120 reconciler_common.go:299] "Volume detached for volume \"ssh-key-openstack-edpm-tls\" (UniqueName: \"kubernetes.io/secret/6787943d-625b-47cb-80c5-9cc72262c3c8-ssh-key-openstack-edpm-tls\") on node \"crc\" DevicePath \"\"" Mar 16 17:28:55 crc kubenswrapper[5120]: I0316 17:28:55.185173 5120 reconciler_common.go:299] "Volume detached for volume \"openstack-edpm-tls-custom-tls-dns-default-certs-0\" (UniqueName: \"kubernetes.io/projected/6787943d-625b-47cb-80c5-9cc72262c3c8-openstack-edpm-tls-custom-tls-dns-default-certs-0\") on node \"crc\" DevicePath \"\"" Mar 16 17:28:55 crc kubenswrapper[5120]: I0316 17:28:55.185198 5120 reconciler_common.go:299] "Volume detached for volume \"custom-tls-dns-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6787943d-625b-47cb-80c5-9cc72262c3c8-custom-tls-dns-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:28:55 crc kubenswrapper[5120]: I0316 17:28:55.185218 5120 reconciler_common.go:299] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/6787943d-625b-47cb-80c5-9cc72262c3c8-inventory\") on node \"crc\" DevicePath \"\"" Mar 16 17:28:55 crc kubenswrapper[5120]: I0316 17:28:55.185240 5120 reconciler_common.go:299] "Volume detached for volume \"openstack-edpm-tls-tls-dns-ips-default-certs-0\" (UniqueName: \"kubernetes.io/projected/6787943d-625b-47cb-80c5-9cc72262c3c8-openstack-edpm-tls-tls-dns-ips-default-certs-0\") on node \"crc\" DevicePath \"\"" Mar 16 17:28:55 crc kubenswrapper[5120]: I0316 17:28:55.185262 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2qsjg\" (UniqueName: \"kubernetes.io/projected/6787943d-625b-47cb-80c5-9cc72262c3c8-kube-api-access-2qsjg\") on node \"crc\" DevicePath \"\"" Mar 16 17:28:55 crc kubenswrapper[5120]: I0316 17:28:55.185281 5120 reconciler_common.go:299] "Volume detached for volume \"tls-dns-ips-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6787943d-625b-47cb-80c5-9cc72262c3c8-tls-dns-ips-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:28:55 crc kubenswrapper[5120]: I0316 17:28:55.185301 5120 reconciler_common.go:299] "Volume detached for volume \"install-certs-ovrd-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6787943d-625b-47cb-80c5-9cc72262c3c8-install-certs-ovrd-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:28:55 crc kubenswrapper[5120]: E0316 17:28:55.251720 5120 kubelet_pods.go:553] "Hostname for pod was too long, truncated it" podName="install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-gnx9r" hostnameMaxLen=63 truncatedHostname="install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug" Mar 16 17:28:55 crc kubenswrapper[5120]: I0316 17:28:55.690515 5120 generic.go:358] "Generic (PLEG): container finished" podID="c2acbe7c-2082-4860-9c1f-9220d71880b3" containerID="c9cc5ae6ca611d80618a11a70f537f31705651222046ae6bbbd6d05dd6762c70" exitCode=0 Mar 16 17:28:55 crc kubenswrapper[5120]: I0316 17:28:55.690623 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/tls-dns-ips-certs-refresh-openstack-edpm-tls-2tm4f" event={"ID":"c2acbe7c-2082-4860-9c1f-9220d71880b3","Type":"ContainerDied","Data":"c9cc5ae6ca611d80618a11a70f537f31705651222046ae6bbbd6d05dd6762c70"} Mar 16 17:28:55 crc kubenswrapper[5120]: I0316 17:28:55.693147 5120 scope.go:117] "RemoveContainer" containerID="273093c5fd18216c994bf5b0a6086ca9a4b63b9a341d4dd3897dc277cb160594" Mar 16 17:28:55 crc kubenswrapper[5120]: I0316 17:28:55.693242 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-sg8jg" Mar 16 17:28:55 crc kubenswrapper[5120]: I0316 17:28:55.697364 5120 generic.go:358] "Generic (PLEG): container finished" podID="59fd0685-d834-4605-b606-e45eb6e88b83" containerID="1049cfe3c249cd959d7e31d13541eb535c56d8831b1cee508a25e769bc2fb46e" exitCode=0 Mar 16 17:28:55 crc kubenswrapper[5120]: I0316 17:28:55.697480 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-gnx9r" event={"ID":"59fd0685-d834-4605-b606-e45eb6e88b83","Type":"ContainerDied","Data":"1049cfe3c249cd959d7e31d13541eb535c56d8831b1cee508a25e769bc2fb46e"} Mar 16 17:28:55 crc kubenswrapper[5120]: I0316 17:28:55.697507 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-gnx9r" event={"ID":"59fd0685-d834-4605-b606-e45eb6e88b83","Type":"ContainerStarted","Data":"e779d97b4e37d1563c48ba82914d0d7190ff2263113ffacd61f1d2f143542f90"} Mar 16 17:28:55 crc kubenswrapper[5120]: I0316 17:28:55.714025 5120 status_manager.go:895] "Failed to get status for pod" podUID="6787943d-625b-47cb-80c5-9cc72262c3c8" pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-sg8jg" err="pods \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-sg8jg\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 17:28:55 crc kubenswrapper[5120]: I0316 17:28:55.741276 5120 status_manager.go:895] "Failed to get status for pod" podUID="6787943d-625b-47cb-80c5-9cc72262c3c8" pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-sg8jg" err="pods \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-sg8jg\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 17:28:55 crc kubenswrapper[5120]: I0316 17:28:55.769154 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-gnx9r"] Mar 16 17:28:55 crc kubenswrapper[5120]: I0316 17:28:55.784390 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-gnx9r"] Mar 16 17:28:55 crc kubenswrapper[5120]: I0316 17:28:55.816293 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/custom-tls-dns-openstack-edpm-tls-ovrd-openstack-edpm-tls-s5fqg"] Mar 16 17:28:55 crc kubenswrapper[5120]: I0316 17:28:55.856228 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/tls-dns-ips-openstack-edpm-tls-ovrd-openstack-edpm-tls-xjldb"] Mar 16 17:28:55 crc kubenswrapper[5120]: I0316 17:28:55.879805 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/custom-tls-dns-openstack-edpm-tls-ovrd-openstack-edpm-tls-s5fqg"] Mar 16 17:28:55 crc kubenswrapper[5120]: I0316 17:28:55.888532 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/tls-dns-ips-certs-refresh-openstack-edpm-tls-2tm4f"] Mar 16 17:28:55 crc kubenswrapper[5120]: I0316 17:28:55.897502 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/tls-dns-ips-openstack-edpm-tls-ovrd-openstack-edpm-tls-xjldb"] Mar 16 17:28:55 crc kubenswrapper[5120]: I0316 17:28:55.904520 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-z5j64"] Mar 16 17:28:55 crc kubenswrapper[5120]: I0316 17:28:55.913183 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb"] Mar 16 17:28:55 crc kubenswrapper[5120]: I0316 17:28:55.918751 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/tls-dnsnames-openstack-edpm-tls-openstack-edpm-tls-xbvdp"] Mar 16 17:28:55 crc kubenswrapper[5120]: I0316 17:28:55.924655 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb"] Mar 16 17:28:55 crc kubenswrapper[5120]: I0316 17:28:55.934376 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-z5j64"] Mar 16 17:28:55 crc kubenswrapper[5120]: I0316 17:28:55.944200 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-openstack-edpm-tls-jbszj"] Mar 16 17:28:55 crc kubenswrapper[5120]: I0316 17:28:55.954670 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/tls-dnsnames-openstack-edpm-tls-openstack-edpm-tls-xbvdp"] Mar 16 17:28:55 crc kubenswrapper[5120]: I0316 17:28:55.959846 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-openstack-edpm-tls-jbszj"] Mar 16 17:28:55 crc kubenswrapper[5120]: I0316 17:28:55.964501 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-gpp5n"] Mar 16 17:28:55 crc kubenswrapper[5120]: I0316 17:28:55.965506 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59fd0685-d834-4605-b606-e45eb6e88b83" containerName="install-certs-ovrd-certs-refresh-openstack-edpm-tls" Mar 16 17:28:55 crc kubenswrapper[5120]: I0316 17:28:55.965527 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="59fd0685-d834-4605-b606-e45eb6e88b83" containerName="install-certs-ovrd-certs-refresh-openstack-edpm-tls" Mar 16 17:28:55 crc kubenswrapper[5120]: I0316 17:28:55.965713 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="59fd0685-d834-4605-b606-e45eb6e88b83" containerName="install-certs-ovrd-certs-refresh-openstack-edpm-tls" Mar 16 17:28:55 crc kubenswrapper[5120]: I0316 17:28:55.971937 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-gpp5n"] Mar 16 17:28:55 crc kubenswrapper[5120]: I0316 17:28:55.972037 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-gpp5n" Mar 16 17:28:55 crc kubenswrapper[5120]: I0316 17:28:55.973723 5120 status_manager.go:895] "Failed to get status for pod" podUID="6787943d-625b-47cb-80c5-9cc72262c3c8" pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-sg8jg" err="pods \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-sg8jg\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 17:28:56 crc kubenswrapper[5120]: I0316 17:28:56.101862 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkr7t\" (UniqueName: \"kubernetes.io/projected/7f72bbb7-4bba-42d3-bbf1-de4311db5e28-kube-api-access-hkr7t\") pod \"dnsmasq-dnsmasq-79dcd846c5-gpp5n\" (UID: \"7f72bbb7-4bba-42d3-bbf1-de4311db5e28\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-gpp5n" Mar 16 17:28:56 crc kubenswrapper[5120]: I0316 17:28:56.102178 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7f72bbb7-4bba-42d3-bbf1-de4311db5e28-config\") pod \"dnsmasq-dnsmasq-79dcd846c5-gpp5n\" (UID: \"7f72bbb7-4bba-42d3-bbf1-de4311db5e28\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-gpp5n" Mar 16 17:28:56 crc kubenswrapper[5120]: I0316 17:28:56.102342 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/7f72bbb7-4bba-42d3-bbf1-de4311db5e28-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-79dcd846c5-gpp5n\" (UID: \"7f72bbb7-4bba-42d3-bbf1-de4311db5e28\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-gpp5n" Mar 16 17:28:56 crc kubenswrapper[5120]: I0316 17:28:56.205049 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hkr7t\" (UniqueName: \"kubernetes.io/projected/7f72bbb7-4bba-42d3-bbf1-de4311db5e28-kube-api-access-hkr7t\") pod \"dnsmasq-dnsmasq-79dcd846c5-gpp5n\" (UID: \"7f72bbb7-4bba-42d3-bbf1-de4311db5e28\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-gpp5n" Mar 16 17:28:56 crc kubenswrapper[5120]: I0316 17:28:56.205244 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7f72bbb7-4bba-42d3-bbf1-de4311db5e28-config\") pod \"dnsmasq-dnsmasq-79dcd846c5-gpp5n\" (UID: \"7f72bbb7-4bba-42d3-bbf1-de4311db5e28\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-gpp5n" Mar 16 17:28:56 crc kubenswrapper[5120]: I0316 17:28:56.205286 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/7f72bbb7-4bba-42d3-bbf1-de4311db5e28-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-79dcd846c5-gpp5n\" (UID: \"7f72bbb7-4bba-42d3-bbf1-de4311db5e28\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-gpp5n" Mar 16 17:28:56 crc kubenswrapper[5120]: I0316 17:28:56.206170 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7f72bbb7-4bba-42d3-bbf1-de4311db5e28-config\") pod \"dnsmasq-dnsmasq-79dcd846c5-gpp5n\" (UID: \"7f72bbb7-4bba-42d3-bbf1-de4311db5e28\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-gpp5n" Mar 16 17:28:56 crc kubenswrapper[5120]: I0316 17:28:56.206376 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/7f72bbb7-4bba-42d3-bbf1-de4311db5e28-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-79dcd846c5-gpp5n\" (UID: \"7f72bbb7-4bba-42d3-bbf1-de4311db5e28\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-gpp5n" Mar 16 17:28:56 crc kubenswrapper[5120]: I0316 17:28:56.223649 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkr7t\" (UniqueName: \"kubernetes.io/projected/7f72bbb7-4bba-42d3-bbf1-de4311db5e28-kube-api-access-hkr7t\") pod \"dnsmasq-dnsmasq-79dcd846c5-gpp5n\" (UID: \"7f72bbb7-4bba-42d3-bbf1-de4311db5e28\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-gpp5n" Mar 16 17:28:56 crc kubenswrapper[5120]: I0316 17:28:56.297843 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-gpp5n" Mar 16 17:28:56 crc kubenswrapper[5120]: I0316 17:28:56.679935 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="30d4e12d-badf-4c88-b298-65f806643a02" path="/var/lib/kubelet/pods/30d4e12d-badf-4c88-b298-65f806643a02/volumes" Mar 16 17:28:56 crc kubenswrapper[5120]: I0316 17:28:56.681186 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="48a394bc-c78b-463d-92f1-2eb351b93385" path="/var/lib/kubelet/pods/48a394bc-c78b-463d-92f1-2eb351b93385/volumes" Mar 16 17:28:56 crc kubenswrapper[5120]: I0316 17:28:56.682411 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="53c22ec9-233d-4147-bbf2-f15e6aca6e45" path="/var/lib/kubelet/pods/53c22ec9-233d-4147-bbf2-f15e6aca6e45/volumes" Mar 16 17:28:56 crc kubenswrapper[5120]: I0316 17:28:56.683483 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ef31d0f-8688-4e28-afd0-407f1217fce0" path="/var/lib/kubelet/pods/5ef31d0f-8688-4e28-afd0-407f1217fce0/volumes" Mar 16 17:28:56 crc kubenswrapper[5120]: I0316 17:28:56.685649 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5f858691-27a3-4858-adf8-80eaa6b1056f" path="/var/lib/kubelet/pods/5f858691-27a3-4858-adf8-80eaa6b1056f/volumes" Mar 16 17:28:56 crc kubenswrapper[5120]: I0316 17:28:56.686918 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6787943d-625b-47cb-80c5-9cc72262c3c8" path="/var/lib/kubelet/pods/6787943d-625b-47cb-80c5-9cc72262c3c8/volumes" Mar 16 17:28:56 crc kubenswrapper[5120]: I0316 17:28:56.688339 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b528c29-3e26-4c9d-b120-e84f0008850b" path="/var/lib/kubelet/pods/9b528c29-3e26-4c9d-b120-e84f0008850b/volumes" Mar 16 17:28:56 crc kubenswrapper[5120]: I0316 17:28:56.703363 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-gpp5n"] Mar 16 17:28:56 crc kubenswrapper[5120]: W0316 17:28:56.712965 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7f72bbb7_4bba_42d3_bbf1_de4311db5e28.slice/crio-67f2d0fb907e2703717f23011b87393152fdb7c2f5b39e984a9f4166a50e2408 WatchSource:0}: Error finding container 67f2d0fb907e2703717f23011b87393152fdb7c2f5b39e984a9f4166a50e2408: Status 404 returned error can't find the container with id 67f2d0fb907e2703717f23011b87393152fdb7c2f5b39e984a9f4166a50e2408 Mar 16 17:28:56 crc kubenswrapper[5120]: I0316 17:28:56.943557 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-gnx9r" Mar 16 17:28:57 crc kubenswrapper[5120]: I0316 17:28:57.047181 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/tls-dns-ips-certs-refresh-openstack-edpm-tls-2tm4f" Mar 16 17:28:57 crc kubenswrapper[5120]: I0316 17:28:57.122854 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2qsjg\" (UniqueName: \"kubernetes.io/projected/59fd0685-d834-4605-b606-e45eb6e88b83-kube-api-access-2qsjg\") pod \"59fd0685-d834-4605-b606-e45eb6e88b83\" (UID: \"59fd0685-d834-4605-b606-e45eb6e88b83\") " Mar 16 17:28:57 crc kubenswrapper[5120]: I0316 17:28:57.123066 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-dns-ips-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/59fd0685-d834-4605-b606-e45eb6e88b83-tls-dns-ips-combined-ca-bundle\") pod \"59fd0685-d834-4605-b606-e45eb6e88b83\" (UID: \"59fd0685-d834-4605-b606-e45eb6e88b83\") " Mar 16 17:28:57 crc kubenswrapper[5120]: I0316 17:28:57.123211 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/59fd0685-d834-4605-b606-e45eb6e88b83-inventory\") pod \"59fd0685-d834-4605-b606-e45eb6e88b83\" (UID: \"59fd0685-d834-4605-b606-e45eb6e88b83\") " Mar 16 17:28:57 crc kubenswrapper[5120]: I0316 17:28:57.123622 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ssh-key-openstack-edpm-tls\" (UniqueName: \"kubernetes.io/secret/59fd0685-d834-4605-b606-e45eb6e88b83-ssh-key-openstack-edpm-tls\") pod \"59fd0685-d834-4605-b606-e45eb6e88b83\" (UID: \"59fd0685-d834-4605-b606-e45eb6e88b83\") " Mar 16 17:28:57 crc kubenswrapper[5120]: I0316 17:28:57.123683 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"custom-tls-dns-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/59fd0685-d834-4605-b606-e45eb6e88b83-custom-tls-dns-combined-ca-bundle\") pod \"59fd0685-d834-4605-b606-e45eb6e88b83\" (UID: \"59fd0685-d834-4605-b606-e45eb6e88b83\") " Mar 16 17:28:57 crc kubenswrapper[5120]: I0316 17:28:57.124634 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"openstack-edpm-tls-tls-dns-ips-default-certs-0\" (UniqueName: \"kubernetes.io/projected/59fd0685-d834-4605-b606-e45eb6e88b83-openstack-edpm-tls-tls-dns-ips-default-certs-0\") pod \"59fd0685-d834-4605-b606-e45eb6e88b83\" (UID: \"59fd0685-d834-4605-b606-e45eb6e88b83\") " Mar 16 17:28:57 crc kubenswrapper[5120]: I0316 17:28:57.124880 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"openstack-edpm-tls-custom-tls-dns-default-certs-0\" (UniqueName: \"kubernetes.io/projected/59fd0685-d834-4605-b606-e45eb6e88b83-openstack-edpm-tls-custom-tls-dns-default-certs-0\") pod \"59fd0685-d834-4605-b606-e45eb6e88b83\" (UID: \"59fd0685-d834-4605-b606-e45eb6e88b83\") " Mar 16 17:28:57 crc kubenswrapper[5120]: I0316 17:28:57.125335 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/c2acbe7c-2082-4860-9c1f-9220d71880b3-inventory\") pod \"c2acbe7c-2082-4860-9c1f-9220d71880b3\" (UID: \"c2acbe7c-2082-4860-9c1f-9220d71880b3\") " Mar 16 17:28:57 crc kubenswrapper[5120]: I0316 17:28:57.125403 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"install-certs-ovrd-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/59fd0685-d834-4605-b606-e45eb6e88b83-install-certs-ovrd-combined-ca-bundle\") pod \"59fd0685-d834-4605-b606-e45eb6e88b83\" (UID: \"59fd0685-d834-4605-b606-e45eb6e88b83\") " Mar 16 17:28:57 crc kubenswrapper[5120]: I0316 17:28:57.129249 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59fd0685-d834-4605-b606-e45eb6e88b83-kube-api-access-2qsjg" (OuterVolumeSpecName: "kube-api-access-2qsjg") pod "59fd0685-d834-4605-b606-e45eb6e88b83" (UID: "59fd0685-d834-4605-b606-e45eb6e88b83"). InnerVolumeSpecName "kube-api-access-2qsjg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:28:57 crc kubenswrapper[5120]: I0316 17:28:57.129358 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59fd0685-d834-4605-b606-e45eb6e88b83-openstack-edpm-tls-custom-tls-dns-default-certs-0" (OuterVolumeSpecName: "openstack-edpm-tls-custom-tls-dns-default-certs-0") pod "59fd0685-d834-4605-b606-e45eb6e88b83" (UID: "59fd0685-d834-4605-b606-e45eb6e88b83"). InnerVolumeSpecName "openstack-edpm-tls-custom-tls-dns-default-certs-0". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:28:57 crc kubenswrapper[5120]: I0316 17:28:57.129606 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/59fd0685-d834-4605-b606-e45eb6e88b83-custom-tls-dns-combined-ca-bundle" (OuterVolumeSpecName: "custom-tls-dns-combined-ca-bundle") pod "59fd0685-d834-4605-b606-e45eb6e88b83" (UID: "59fd0685-d834-4605-b606-e45eb6e88b83"). InnerVolumeSpecName "custom-tls-dns-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:28:57 crc kubenswrapper[5120]: I0316 17:28:57.130386 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59fd0685-d834-4605-b606-e45eb6e88b83-openstack-edpm-tls-tls-dns-ips-default-certs-0" (OuterVolumeSpecName: "openstack-edpm-tls-tls-dns-ips-default-certs-0") pod "59fd0685-d834-4605-b606-e45eb6e88b83" (UID: "59fd0685-d834-4605-b606-e45eb6e88b83"). InnerVolumeSpecName "openstack-edpm-tls-tls-dns-ips-default-certs-0". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:28:57 crc kubenswrapper[5120]: I0316 17:28:57.130577 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/59fd0685-d834-4605-b606-e45eb6e88b83-tls-dns-ips-combined-ca-bundle" (OuterVolumeSpecName: "tls-dns-ips-combined-ca-bundle") pod "59fd0685-d834-4605-b606-e45eb6e88b83" (UID: "59fd0685-d834-4605-b606-e45eb6e88b83"). InnerVolumeSpecName "tls-dns-ips-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:28:57 crc kubenswrapper[5120]: I0316 17:28:57.130683 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/59fd0685-d834-4605-b606-e45eb6e88b83-install-certs-ovrd-combined-ca-bundle" (OuterVolumeSpecName: "install-certs-ovrd-combined-ca-bundle") pod "59fd0685-d834-4605-b606-e45eb6e88b83" (UID: "59fd0685-d834-4605-b606-e45eb6e88b83"). InnerVolumeSpecName "install-certs-ovrd-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:28:57 crc kubenswrapper[5120]: I0316 17:28:57.146541 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/59fd0685-d834-4605-b606-e45eb6e88b83-inventory" (OuterVolumeSpecName: "inventory") pod "59fd0685-d834-4605-b606-e45eb6e88b83" (UID: "59fd0685-d834-4605-b606-e45eb6e88b83"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:28:57 crc kubenswrapper[5120]: I0316 17:28:57.148906 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/59fd0685-d834-4605-b606-e45eb6e88b83-ssh-key-openstack-edpm-tls" (OuterVolumeSpecName: "ssh-key-openstack-edpm-tls") pod "59fd0685-d834-4605-b606-e45eb6e88b83" (UID: "59fd0685-d834-4605-b606-e45eb6e88b83"). InnerVolumeSpecName "ssh-key-openstack-edpm-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:28:57 crc kubenswrapper[5120]: I0316 17:28:57.149007 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c2acbe7c-2082-4860-9c1f-9220d71880b3-inventory" (OuterVolumeSpecName: "inventory") pod "c2acbe7c-2082-4860-9c1f-9220d71880b3" (UID: "c2acbe7c-2082-4860-9c1f-9220d71880b3"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:28:57 crc kubenswrapper[5120]: I0316 17:28:57.227712 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ssh-key-openstack-edpm-tls\" (UniqueName: \"kubernetes.io/secret/c2acbe7c-2082-4860-9c1f-9220d71880b3-ssh-key-openstack-edpm-tls\") pod \"c2acbe7c-2082-4860-9c1f-9220d71880b3\" (UID: \"c2acbe7c-2082-4860-9c1f-9220d71880b3\") " Mar 16 17:28:57 crc kubenswrapper[5120]: I0316 17:28:57.227892 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jtkj9\" (UniqueName: \"kubernetes.io/projected/c2acbe7c-2082-4860-9c1f-9220d71880b3-kube-api-access-jtkj9\") pod \"c2acbe7c-2082-4860-9c1f-9220d71880b3\" (UID: \"c2acbe7c-2082-4860-9c1f-9220d71880b3\") " Mar 16 17:28:57 crc kubenswrapper[5120]: I0316 17:28:57.228948 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-dns-ips-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c2acbe7c-2082-4860-9c1f-9220d71880b3-tls-dns-ips-combined-ca-bundle\") pod \"c2acbe7c-2082-4860-9c1f-9220d71880b3\" (UID: \"c2acbe7c-2082-4860-9c1f-9220d71880b3\") " Mar 16 17:28:57 crc kubenswrapper[5120]: I0316 17:28:57.230155 5120 reconciler_common.go:299] "Volume detached for volume \"openstack-edpm-tls-tls-dns-ips-default-certs-0\" (UniqueName: \"kubernetes.io/projected/59fd0685-d834-4605-b606-e45eb6e88b83-openstack-edpm-tls-tls-dns-ips-default-certs-0\") on node \"crc\" DevicePath \"\"" Mar 16 17:28:57 crc kubenswrapper[5120]: I0316 17:28:57.230185 5120 reconciler_common.go:299] "Volume detached for volume \"openstack-edpm-tls-custom-tls-dns-default-certs-0\" (UniqueName: \"kubernetes.io/projected/59fd0685-d834-4605-b606-e45eb6e88b83-openstack-edpm-tls-custom-tls-dns-default-certs-0\") on node \"crc\" DevicePath \"\"" Mar 16 17:28:57 crc kubenswrapper[5120]: I0316 17:28:57.230203 5120 reconciler_common.go:299] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/c2acbe7c-2082-4860-9c1f-9220d71880b3-inventory\") on node \"crc\" DevicePath \"\"" Mar 16 17:28:57 crc kubenswrapper[5120]: I0316 17:28:57.230218 5120 reconciler_common.go:299] "Volume detached for volume \"install-certs-ovrd-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/59fd0685-d834-4605-b606-e45eb6e88b83-install-certs-ovrd-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:28:57 crc kubenswrapper[5120]: I0316 17:28:57.230231 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2qsjg\" (UniqueName: \"kubernetes.io/projected/59fd0685-d834-4605-b606-e45eb6e88b83-kube-api-access-2qsjg\") on node \"crc\" DevicePath \"\"" Mar 16 17:28:57 crc kubenswrapper[5120]: I0316 17:28:57.230245 5120 reconciler_common.go:299] "Volume detached for volume \"tls-dns-ips-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/59fd0685-d834-4605-b606-e45eb6e88b83-tls-dns-ips-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:28:57 crc kubenswrapper[5120]: I0316 17:28:57.230259 5120 reconciler_common.go:299] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/59fd0685-d834-4605-b606-e45eb6e88b83-inventory\") on node \"crc\" DevicePath \"\"" Mar 16 17:28:57 crc kubenswrapper[5120]: I0316 17:28:57.230271 5120 reconciler_common.go:299] "Volume detached for volume \"ssh-key-openstack-edpm-tls\" (UniqueName: \"kubernetes.io/secret/59fd0685-d834-4605-b606-e45eb6e88b83-ssh-key-openstack-edpm-tls\") on node \"crc\" DevicePath \"\"" Mar 16 17:28:57 crc kubenswrapper[5120]: I0316 17:28:57.230282 5120 reconciler_common.go:299] "Volume detached for volume \"custom-tls-dns-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/59fd0685-d834-4605-b606-e45eb6e88b83-custom-tls-dns-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:28:57 crc kubenswrapper[5120]: I0316 17:28:57.232271 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2acbe7c-2082-4860-9c1f-9220d71880b3-kube-api-access-jtkj9" (OuterVolumeSpecName: "kube-api-access-jtkj9") pod "c2acbe7c-2082-4860-9c1f-9220d71880b3" (UID: "c2acbe7c-2082-4860-9c1f-9220d71880b3"). InnerVolumeSpecName "kube-api-access-jtkj9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:28:57 crc kubenswrapper[5120]: I0316 17:28:57.232354 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c2acbe7c-2082-4860-9c1f-9220d71880b3-tls-dns-ips-combined-ca-bundle" (OuterVolumeSpecName: "tls-dns-ips-combined-ca-bundle") pod "c2acbe7c-2082-4860-9c1f-9220d71880b3" (UID: "c2acbe7c-2082-4860-9c1f-9220d71880b3"). InnerVolumeSpecName "tls-dns-ips-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:28:57 crc kubenswrapper[5120]: I0316 17:28:57.250841 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c2acbe7c-2082-4860-9c1f-9220d71880b3-ssh-key-openstack-edpm-tls" (OuterVolumeSpecName: "ssh-key-openstack-edpm-tls") pod "c2acbe7c-2082-4860-9c1f-9220d71880b3" (UID: "c2acbe7c-2082-4860-9c1f-9220d71880b3"). InnerVolumeSpecName "ssh-key-openstack-edpm-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:28:57 crc kubenswrapper[5120]: I0316 17:28:57.332494 5120 reconciler_common.go:299] "Volume detached for volume \"ssh-key-openstack-edpm-tls\" (UniqueName: \"kubernetes.io/secret/c2acbe7c-2082-4860-9c1f-9220d71880b3-ssh-key-openstack-edpm-tls\") on node \"crc\" DevicePath \"\"" Mar 16 17:28:57 crc kubenswrapper[5120]: I0316 17:28:57.332541 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jtkj9\" (UniqueName: \"kubernetes.io/projected/c2acbe7c-2082-4860-9c1f-9220d71880b3-kube-api-access-jtkj9\") on node \"crc\" DevicePath \"\"" Mar 16 17:28:57 crc kubenswrapper[5120]: I0316 17:28:57.332558 5120 reconciler_common.go:299] "Volume detached for volume \"tls-dns-ips-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c2acbe7c-2082-4860-9c1f-9220d71880b3-tls-dns-ips-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:28:57 crc kubenswrapper[5120]: I0316 17:28:57.718900 5120 generic.go:358] "Generic (PLEG): container finished" podID="7f72bbb7-4bba-42d3-bbf1-de4311db5e28" containerID="fea6887013450276879eed375e063261045d258858ad903c3afd53c361902833" exitCode=0 Mar 16 17:28:57 crc kubenswrapper[5120]: I0316 17:28:57.718974 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-gpp5n" event={"ID":"7f72bbb7-4bba-42d3-bbf1-de4311db5e28","Type":"ContainerDied","Data":"fea6887013450276879eed375e063261045d258858ad903c3afd53c361902833"} Mar 16 17:28:57 crc kubenswrapper[5120]: I0316 17:28:57.719030 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-gpp5n" event={"ID":"7f72bbb7-4bba-42d3-bbf1-de4311db5e28","Type":"ContainerStarted","Data":"67f2d0fb907e2703717f23011b87393152fdb7c2f5b39e984a9f4166a50e2408"} Mar 16 17:28:57 crc kubenswrapper[5120]: I0316 17:28:57.724138 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-gnx9r" Mar 16 17:28:57 crc kubenswrapper[5120]: I0316 17:28:57.725987 5120 scope.go:117] "RemoveContainer" containerID="1049cfe3c249cd959d7e31d13541eb535c56d8831b1cee508a25e769bc2fb46e" Mar 16 17:28:57 crc kubenswrapper[5120]: I0316 17:28:57.732146 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/tls-dns-ips-certs-refresh-openstack-edpm-tls-2tm4f" event={"ID":"c2acbe7c-2082-4860-9c1f-9220d71880b3","Type":"ContainerDied","Data":"4b36ef933edbb275dac8a7df0487d494957244797941dc3e99789515910bd4f8"} Mar 16 17:28:57 crc kubenswrapper[5120]: I0316 17:28:57.732189 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4b36ef933edbb275dac8a7df0487d494957244797941dc3e99789515910bd4f8" Mar 16 17:28:57 crc kubenswrapper[5120]: I0316 17:28:57.732235 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/tls-dns-ips-certs-refresh-openstack-edpm-tls-2tm4f" Mar 16 17:28:57 crc kubenswrapper[5120]: I0316 17:28:57.740291 5120 status_manager.go:895] "Failed to get status for pod" podUID="59fd0685-d834-4605-b606-e45eb6e88b83" pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-gnx9r" err="pods \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-gnx9r\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 17:28:57 crc kubenswrapper[5120]: I0316 17:28:57.861411 5120 status_manager.go:895] "Failed to get status for pod" podUID="59fd0685-d834-4605-b606-e45eb6e88b83" pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-gnx9r" err="pods \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-gnx9r\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 17:28:57 crc kubenswrapper[5120]: I0316 17:28:57.862563 5120 status_manager.go:895] "Failed to get status for pod" podUID="59fd0685-d834-4605-b606-e45eb6e88b83" pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-gnx9r" err="pods \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-gnx9r\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 17:28:57 crc kubenswrapper[5120]: I0316 17:28:57.880989 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/tls-dns-ips-certs-refresh-openstack-edpm-tls-2tm4f"] Mar 16 17:28:57 crc kubenswrapper[5120]: I0316 17:28:57.886710 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/tls-dns-ips-certs-refresh-openstack-edpm-tls-2tm4f"] Mar 16 17:28:58 crc kubenswrapper[5120]: I0316 17:28:58.671930 5120 status_manager.go:895] "Failed to get status for pod" podUID="59fd0685-d834-4605-b606-e45eb6e88b83" pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-gnx9r" err="pods \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-m6tzb-debug-gnx9r\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 17:28:58 crc kubenswrapper[5120]: I0316 17:28:58.675630 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="59fd0685-d834-4605-b606-e45eb6e88b83" path="/var/lib/kubelet/pods/59fd0685-d834-4605-b606-e45eb6e88b83/volumes" Mar 16 17:28:58 crc kubenswrapper[5120]: I0316 17:28:58.676342 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c2acbe7c-2082-4860-9c1f-9220d71880b3" path="/var/lib/kubelet/pods/c2acbe7c-2082-4860-9c1f-9220d71880b3/volumes" Mar 16 17:28:58 crc kubenswrapper[5120]: I0316 17:28:58.745417 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-gpp5n" event={"ID":"7f72bbb7-4bba-42d3-bbf1-de4311db5e28","Type":"ContainerStarted","Data":"d15295117e7a214679c1c7de7e41859c5284248f1f2995ac296ce2ec909ce5ab"} Mar 16 17:28:58 crc kubenswrapper[5120]: I0316 17:28:58.745500 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-gpp5n" Mar 16 17:28:58 crc kubenswrapper[5120]: I0316 17:28:58.768753 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-gpp5n" podStartSLOduration=3.768733584 podStartE2EDuration="3.768733584s" podCreationTimestamp="2026-03-16 17:28:55 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:28:58.762281248 +0000 UTC m=+7040.916212925" watchObservedRunningTime="2026-03-16 17:28:58.768733584 +0000 UTC m=+7040.922665241" Mar 16 17:29:03 crc kubenswrapper[5120]: I0316 17:29:03.272735 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["crc-storage/crc-storage-crc-qgskf"] Mar 16 17:29:03 crc kubenswrapper[5120]: I0316 17:29:03.280007 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["crc-storage/crc-storage-crc-qgskf"] Mar 16 17:29:03 crc kubenswrapper[5120]: I0316 17:29:03.439692 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["crc-storage/crc-storage-crc-vfpwt"] Mar 16 17:29:03 crc kubenswrapper[5120]: I0316 17:29:03.440822 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2acbe7c-2082-4860-9c1f-9220d71880b3" containerName="tls-dns-ips-certs-refresh-openstack-edpm-tls" Mar 16 17:29:03 crc kubenswrapper[5120]: I0316 17:29:03.440941 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2acbe7c-2082-4860-9c1f-9220d71880b3" containerName="tls-dns-ips-certs-refresh-openstack-edpm-tls" Mar 16 17:29:03 crc kubenswrapper[5120]: I0316 17:29:03.441140 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c2acbe7c-2082-4860-9c1f-9220d71880b3" containerName="tls-dns-ips-certs-refresh-openstack-edpm-tls" Mar 16 17:29:03 crc kubenswrapper[5120]: I0316 17:29:03.447419 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-vfpwt" Mar 16 17:29:03 crc kubenswrapper[5120]: I0316 17:29:03.449731 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"kube-root-ca.crt\"" Mar 16 17:29:03 crc kubenswrapper[5120]: I0316 17:29:03.449736 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"crc-storage\"" Mar 16 17:29:03 crc kubenswrapper[5120]: I0316 17:29:03.451306 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-vfpwt"] Mar 16 17:29:03 crc kubenswrapper[5120]: I0316 17:29:03.452658 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"crc-storage\"/\"crc-storage-dockercfg-s2tht\"" Mar 16 17:29:03 crc kubenswrapper[5120]: I0316 17:29:03.452857 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"openshift-service-ca.crt\"" Mar 16 17:29:03 crc kubenswrapper[5120]: I0316 17:29:03.574451 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/de6a5f6a-32b1-46b5-b810-f74779238239-node-mnt\") pod \"crc-storage-crc-vfpwt\" (UID: \"de6a5f6a-32b1-46b5-b810-f74779238239\") " pod="crc-storage/crc-storage-crc-vfpwt" Mar 16 17:29:03 crc kubenswrapper[5120]: I0316 17:29:03.575027 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4cvl\" (UniqueName: \"kubernetes.io/projected/de6a5f6a-32b1-46b5-b810-f74779238239-kube-api-access-r4cvl\") pod \"crc-storage-crc-vfpwt\" (UID: \"de6a5f6a-32b1-46b5-b810-f74779238239\") " pod="crc-storage/crc-storage-crc-vfpwt" Mar 16 17:29:03 crc kubenswrapper[5120]: I0316 17:29:03.575330 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/de6a5f6a-32b1-46b5-b810-f74779238239-crc-storage\") pod \"crc-storage-crc-vfpwt\" (UID: \"de6a5f6a-32b1-46b5-b810-f74779238239\") " pod="crc-storage/crc-storage-crc-vfpwt" Mar 16 17:29:03 crc kubenswrapper[5120]: I0316 17:29:03.677629 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r4cvl\" (UniqueName: \"kubernetes.io/projected/de6a5f6a-32b1-46b5-b810-f74779238239-kube-api-access-r4cvl\") pod \"crc-storage-crc-vfpwt\" (UID: \"de6a5f6a-32b1-46b5-b810-f74779238239\") " pod="crc-storage/crc-storage-crc-vfpwt" Mar 16 17:29:03 crc kubenswrapper[5120]: I0316 17:29:03.677846 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/de6a5f6a-32b1-46b5-b810-f74779238239-crc-storage\") pod \"crc-storage-crc-vfpwt\" (UID: \"de6a5f6a-32b1-46b5-b810-f74779238239\") " pod="crc-storage/crc-storage-crc-vfpwt" Mar 16 17:29:03 crc kubenswrapper[5120]: I0316 17:29:03.678083 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/de6a5f6a-32b1-46b5-b810-f74779238239-node-mnt\") pod \"crc-storage-crc-vfpwt\" (UID: \"de6a5f6a-32b1-46b5-b810-f74779238239\") " pod="crc-storage/crc-storage-crc-vfpwt" Mar 16 17:29:03 crc kubenswrapper[5120]: I0316 17:29:03.678434 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/de6a5f6a-32b1-46b5-b810-f74779238239-node-mnt\") pod \"crc-storage-crc-vfpwt\" (UID: \"de6a5f6a-32b1-46b5-b810-f74779238239\") " pod="crc-storage/crc-storage-crc-vfpwt" Mar 16 17:29:03 crc kubenswrapper[5120]: I0316 17:29:03.678540 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/de6a5f6a-32b1-46b5-b810-f74779238239-crc-storage\") pod \"crc-storage-crc-vfpwt\" (UID: \"de6a5f6a-32b1-46b5-b810-f74779238239\") " pod="crc-storage/crc-storage-crc-vfpwt" Mar 16 17:29:03 crc kubenswrapper[5120]: I0316 17:29:03.695504 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4cvl\" (UniqueName: \"kubernetes.io/projected/de6a5f6a-32b1-46b5-b810-f74779238239-kube-api-access-r4cvl\") pod \"crc-storage-crc-vfpwt\" (UID: \"de6a5f6a-32b1-46b5-b810-f74779238239\") " pod="crc-storage/crc-storage-crc-vfpwt" Mar 16 17:29:03 crc kubenswrapper[5120]: I0316 17:29:03.774156 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-vfpwt" Mar 16 17:29:04 crc kubenswrapper[5120]: I0316 17:29:04.177280 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-vfpwt"] Mar 16 17:29:04 crc kubenswrapper[5120]: I0316 17:29:04.672517 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7b9857ea-679f-43c5-aa03-340f6cb135f5" path="/var/lib/kubelet/pods/7b9857ea-679f-43c5-aa03-340f6cb135f5/volumes" Mar 16 17:29:04 crc kubenswrapper[5120]: I0316 17:29:04.761790 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-gpp5n" Mar 16 17:29:04 crc kubenswrapper[5120]: I0316 17:29:04.815635 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-vfpwt" event={"ID":"de6a5f6a-32b1-46b5-b810-f74779238239","Type":"ContainerStarted","Data":"1cfb1c82f41a01c4ba029ce3e4d9ca1130d63219399fc43b3894e50b15b2318f"} Mar 16 17:29:04 crc kubenswrapper[5120]: I0316 17:29:04.819935 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-6f5787b9d7-pc75p"] Mar 16 17:29:04 crc kubenswrapper[5120]: I0316 17:29:04.820303 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6f5787b9d7-pc75p" podUID="329d73ef-e3a7-47f4-bcc7-1f9c5ea3d8a1" containerName="dnsmasq-dns" containerID="cri-o://77cb63ac5348cb2afb6f20ea495cbd078fa27d80640b6a05b1b393f39d28f1ac" gracePeriod=10 Mar 16 17:29:05 crc kubenswrapper[5120]: I0316 17:29:05.245137 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6f5787b9d7-pc75p" Mar 16 17:29:05 crc kubenswrapper[5120]: I0316 17:29:05.322219 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mw8rc\" (UniqueName: \"kubernetes.io/projected/329d73ef-e3a7-47f4-bcc7-1f9c5ea3d8a1-kube-api-access-mw8rc\") pod \"329d73ef-e3a7-47f4-bcc7-1f9c5ea3d8a1\" (UID: \"329d73ef-e3a7-47f4-bcc7-1f9c5ea3d8a1\") " Mar 16 17:29:05 crc kubenswrapper[5120]: I0316 17:29:05.322531 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/329d73ef-e3a7-47f4-bcc7-1f9c5ea3d8a1-dnsmasq-svc\") pod \"329d73ef-e3a7-47f4-bcc7-1f9c5ea3d8a1\" (UID: \"329d73ef-e3a7-47f4-bcc7-1f9c5ea3d8a1\") " Mar 16 17:29:05 crc kubenswrapper[5120]: I0316 17:29:05.322696 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/329d73ef-e3a7-47f4-bcc7-1f9c5ea3d8a1-config\") pod \"329d73ef-e3a7-47f4-bcc7-1f9c5ea3d8a1\" (UID: \"329d73ef-e3a7-47f4-bcc7-1f9c5ea3d8a1\") " Mar 16 17:29:05 crc kubenswrapper[5120]: I0316 17:29:05.323663 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"openstack-edpm-tls\" (UniqueName: \"kubernetes.io/configmap/329d73ef-e3a7-47f4-bcc7-1f9c5ea3d8a1-openstack-edpm-tls\") pod \"329d73ef-e3a7-47f4-bcc7-1f9c5ea3d8a1\" (UID: \"329d73ef-e3a7-47f4-bcc7-1f9c5ea3d8a1\") " Mar 16 17:29:05 crc kubenswrapper[5120]: I0316 17:29:05.328086 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/329d73ef-e3a7-47f4-bcc7-1f9c5ea3d8a1-kube-api-access-mw8rc" (OuterVolumeSpecName: "kube-api-access-mw8rc") pod "329d73ef-e3a7-47f4-bcc7-1f9c5ea3d8a1" (UID: "329d73ef-e3a7-47f4-bcc7-1f9c5ea3d8a1"). InnerVolumeSpecName "kube-api-access-mw8rc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:29:05 crc kubenswrapper[5120]: I0316 17:29:05.364837 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/329d73ef-e3a7-47f4-bcc7-1f9c5ea3d8a1-config" (OuterVolumeSpecName: "config") pod "329d73ef-e3a7-47f4-bcc7-1f9c5ea3d8a1" (UID: "329d73ef-e3a7-47f4-bcc7-1f9c5ea3d8a1"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:29:05 crc kubenswrapper[5120]: I0316 17:29:05.364868 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/329d73ef-e3a7-47f4-bcc7-1f9c5ea3d8a1-openstack-edpm-tls" (OuterVolumeSpecName: "openstack-edpm-tls") pod "329d73ef-e3a7-47f4-bcc7-1f9c5ea3d8a1" (UID: "329d73ef-e3a7-47f4-bcc7-1f9c5ea3d8a1"). InnerVolumeSpecName "openstack-edpm-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:29:05 crc kubenswrapper[5120]: I0316 17:29:05.367499 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/329d73ef-e3a7-47f4-bcc7-1f9c5ea3d8a1-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "329d73ef-e3a7-47f4-bcc7-1f9c5ea3d8a1" (UID: "329d73ef-e3a7-47f4-bcc7-1f9c5ea3d8a1"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:29:05 crc kubenswrapper[5120]: I0316 17:29:05.427054 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mw8rc\" (UniqueName: \"kubernetes.io/projected/329d73ef-e3a7-47f4-bcc7-1f9c5ea3d8a1-kube-api-access-mw8rc\") on node \"crc\" DevicePath \"\"" Mar 16 17:29:05 crc kubenswrapper[5120]: I0316 17:29:05.427100 5120 reconciler_common.go:299] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/329d73ef-e3a7-47f4-bcc7-1f9c5ea3d8a1-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Mar 16 17:29:05 crc kubenswrapper[5120]: I0316 17:29:05.427116 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/329d73ef-e3a7-47f4-bcc7-1f9c5ea3d8a1-config\") on node \"crc\" DevicePath \"\"" Mar 16 17:29:05 crc kubenswrapper[5120]: I0316 17:29:05.427129 5120 reconciler_common.go:299] "Volume detached for volume \"openstack-edpm-tls\" (UniqueName: \"kubernetes.io/configmap/329d73ef-e3a7-47f4-bcc7-1f9c5ea3d8a1-openstack-edpm-tls\") on node \"crc\" DevicePath \"\"" Mar 16 17:29:05 crc kubenswrapper[5120]: I0316 17:29:05.828956 5120 generic.go:358] "Generic (PLEG): container finished" podID="329d73ef-e3a7-47f4-bcc7-1f9c5ea3d8a1" containerID="77cb63ac5348cb2afb6f20ea495cbd078fa27d80640b6a05b1b393f39d28f1ac" exitCode=0 Mar 16 17:29:05 crc kubenswrapper[5120]: I0316 17:29:05.829061 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6f5787b9d7-pc75p" event={"ID":"329d73ef-e3a7-47f4-bcc7-1f9c5ea3d8a1","Type":"ContainerDied","Data":"77cb63ac5348cb2afb6f20ea495cbd078fa27d80640b6a05b1b393f39d28f1ac"} Mar 16 17:29:05 crc kubenswrapper[5120]: I0316 17:29:05.829092 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6f5787b9d7-pc75p" event={"ID":"329d73ef-e3a7-47f4-bcc7-1f9c5ea3d8a1","Type":"ContainerDied","Data":"feee60cc2d5893e6d8ad853bb0f7b48d5f1e567291743ce9978c1b9baa1757e6"} Mar 16 17:29:05 crc kubenswrapper[5120]: I0316 17:29:05.829111 5120 scope.go:117] "RemoveContainer" containerID="77cb63ac5348cb2afb6f20ea495cbd078fa27d80640b6a05b1b393f39d28f1ac" Mar 16 17:29:05 crc kubenswrapper[5120]: I0316 17:29:05.829124 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6f5787b9d7-pc75p" Mar 16 17:29:05 crc kubenswrapper[5120]: I0316 17:29:05.832299 5120 generic.go:358] "Generic (PLEG): container finished" podID="de6a5f6a-32b1-46b5-b810-f74779238239" containerID="868b71a5d1b7ebf24b207db975a0cc847eaf43adc2f774fd90db826f4737a82f" exitCode=0 Mar 16 17:29:05 crc kubenswrapper[5120]: I0316 17:29:05.832344 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-vfpwt" event={"ID":"de6a5f6a-32b1-46b5-b810-f74779238239","Type":"ContainerDied","Data":"868b71a5d1b7ebf24b207db975a0cc847eaf43adc2f774fd90db826f4737a82f"} Mar 16 17:29:05 crc kubenswrapper[5120]: I0316 17:29:05.853212 5120 scope.go:117] "RemoveContainer" containerID="4d5e75a7fdf3eb5656a76ccd50c4e5df1208a705e5a3a6f0ae6961b31ad214ce" Mar 16 17:29:05 crc kubenswrapper[5120]: I0316 17:29:05.866506 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-6f5787b9d7-pc75p"] Mar 16 17:29:05 crc kubenswrapper[5120]: I0316 17:29:05.872745 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-6f5787b9d7-pc75p"] Mar 16 17:29:05 crc kubenswrapper[5120]: I0316 17:29:05.889420 5120 scope.go:117] "RemoveContainer" containerID="77cb63ac5348cb2afb6f20ea495cbd078fa27d80640b6a05b1b393f39d28f1ac" Mar 16 17:29:05 crc kubenswrapper[5120]: E0316 17:29:05.889965 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"77cb63ac5348cb2afb6f20ea495cbd078fa27d80640b6a05b1b393f39d28f1ac\": container with ID starting with 77cb63ac5348cb2afb6f20ea495cbd078fa27d80640b6a05b1b393f39d28f1ac not found: ID does not exist" containerID="77cb63ac5348cb2afb6f20ea495cbd078fa27d80640b6a05b1b393f39d28f1ac" Mar 16 17:29:05 crc kubenswrapper[5120]: I0316 17:29:05.890010 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77cb63ac5348cb2afb6f20ea495cbd078fa27d80640b6a05b1b393f39d28f1ac"} err="failed to get container status \"77cb63ac5348cb2afb6f20ea495cbd078fa27d80640b6a05b1b393f39d28f1ac\": rpc error: code = NotFound desc = could not find container \"77cb63ac5348cb2afb6f20ea495cbd078fa27d80640b6a05b1b393f39d28f1ac\": container with ID starting with 77cb63ac5348cb2afb6f20ea495cbd078fa27d80640b6a05b1b393f39d28f1ac not found: ID does not exist" Mar 16 17:29:05 crc kubenswrapper[5120]: I0316 17:29:05.890037 5120 scope.go:117] "RemoveContainer" containerID="4d5e75a7fdf3eb5656a76ccd50c4e5df1208a705e5a3a6f0ae6961b31ad214ce" Mar 16 17:29:05 crc kubenswrapper[5120]: E0316 17:29:05.890575 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d5e75a7fdf3eb5656a76ccd50c4e5df1208a705e5a3a6f0ae6961b31ad214ce\": container with ID starting with 4d5e75a7fdf3eb5656a76ccd50c4e5df1208a705e5a3a6f0ae6961b31ad214ce not found: ID does not exist" containerID="4d5e75a7fdf3eb5656a76ccd50c4e5df1208a705e5a3a6f0ae6961b31ad214ce" Mar 16 17:29:05 crc kubenswrapper[5120]: I0316 17:29:05.890617 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d5e75a7fdf3eb5656a76ccd50c4e5df1208a705e5a3a6f0ae6961b31ad214ce"} err="failed to get container status \"4d5e75a7fdf3eb5656a76ccd50c4e5df1208a705e5a3a6f0ae6961b31ad214ce\": rpc error: code = NotFound desc = could not find container \"4d5e75a7fdf3eb5656a76ccd50c4e5df1208a705e5a3a6f0ae6961b31ad214ce\": container with ID starting with 4d5e75a7fdf3eb5656a76ccd50c4e5df1208a705e5a3a6f0ae6961b31ad214ce not found: ID does not exist" Mar 16 17:29:06 crc kubenswrapper[5120]: I0316 17:29:06.671971 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="329d73ef-e3a7-47f4-bcc7-1f9c5ea3d8a1" path="/var/lib/kubelet/pods/329d73ef-e3a7-47f4-bcc7-1f9c5ea3d8a1/volumes" Mar 16 17:29:06 crc kubenswrapper[5120]: I0316 17:29:06.673168 5120 scope.go:117] "RemoveContainer" containerID="df0a87b047c8208d5fc21057efed33321f6cab49c4cf053702d222dc12979450" Mar 16 17:29:06 crc kubenswrapper[5120]: E0316 17:29:06.673471 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 17:29:07 crc kubenswrapper[5120]: I0316 17:29:07.247649 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-vfpwt" Mar 16 17:29:07 crc kubenswrapper[5120]: I0316 17:29:07.384423 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r4cvl\" (UniqueName: \"kubernetes.io/projected/de6a5f6a-32b1-46b5-b810-f74779238239-kube-api-access-r4cvl\") pod \"de6a5f6a-32b1-46b5-b810-f74779238239\" (UID: \"de6a5f6a-32b1-46b5-b810-f74779238239\") " Mar 16 17:29:07 crc kubenswrapper[5120]: I0316 17:29:07.384460 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/de6a5f6a-32b1-46b5-b810-f74779238239-crc-storage\") pod \"de6a5f6a-32b1-46b5-b810-f74779238239\" (UID: \"de6a5f6a-32b1-46b5-b810-f74779238239\") " Mar 16 17:29:07 crc kubenswrapper[5120]: I0316 17:29:07.385053 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/de6a5f6a-32b1-46b5-b810-f74779238239-node-mnt\") pod \"de6a5f6a-32b1-46b5-b810-f74779238239\" (UID: \"de6a5f6a-32b1-46b5-b810-f74779238239\") " Mar 16 17:29:07 crc kubenswrapper[5120]: I0316 17:29:07.385153 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/de6a5f6a-32b1-46b5-b810-f74779238239-node-mnt" (OuterVolumeSpecName: "node-mnt") pod "de6a5f6a-32b1-46b5-b810-f74779238239" (UID: "de6a5f6a-32b1-46b5-b810-f74779238239"). InnerVolumeSpecName "node-mnt". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 17:29:07 crc kubenswrapper[5120]: I0316 17:29:07.385680 5120 reconciler_common.go:299] "Volume detached for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/de6a5f6a-32b1-46b5-b810-f74779238239-node-mnt\") on node \"crc\" DevicePath \"\"" Mar 16 17:29:07 crc kubenswrapper[5120]: I0316 17:29:07.392610 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de6a5f6a-32b1-46b5-b810-f74779238239-kube-api-access-r4cvl" (OuterVolumeSpecName: "kube-api-access-r4cvl") pod "de6a5f6a-32b1-46b5-b810-f74779238239" (UID: "de6a5f6a-32b1-46b5-b810-f74779238239"). InnerVolumeSpecName "kube-api-access-r4cvl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:29:07 crc kubenswrapper[5120]: I0316 17:29:07.410017 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/de6a5f6a-32b1-46b5-b810-f74779238239-crc-storage" (OuterVolumeSpecName: "crc-storage") pod "de6a5f6a-32b1-46b5-b810-f74779238239" (UID: "de6a5f6a-32b1-46b5-b810-f74779238239"). InnerVolumeSpecName "crc-storage". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:29:07 crc kubenswrapper[5120]: I0316 17:29:07.488527 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r4cvl\" (UniqueName: \"kubernetes.io/projected/de6a5f6a-32b1-46b5-b810-f74779238239-kube-api-access-r4cvl\") on node \"crc\" DevicePath \"\"" Mar 16 17:29:07 crc kubenswrapper[5120]: I0316 17:29:07.488603 5120 reconciler_common.go:299] "Volume detached for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/de6a5f6a-32b1-46b5-b810-f74779238239-crc-storage\") on node \"crc\" DevicePath \"\"" Mar 16 17:29:07 crc kubenswrapper[5120]: E0316 17:29:07.627303 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1312670 actualBytes=10240 Mar 16 17:29:07 crc kubenswrapper[5120]: I0316 17:29:07.856890 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-vfpwt" Mar 16 17:29:07 crc kubenswrapper[5120]: I0316 17:29:07.856969 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-vfpwt" event={"ID":"de6a5f6a-32b1-46b5-b810-f74779238239","Type":"ContainerDied","Data":"1cfb1c82f41a01c4ba029ce3e4d9ca1130d63219399fc43b3894e50b15b2318f"} Mar 16 17:29:07 crc kubenswrapper[5120]: I0316 17:29:07.857014 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1cfb1c82f41a01c4ba029ce3e4d9ca1130d63219399fc43b3894e50b15b2318f" Mar 16 17:29:10 crc kubenswrapper[5120]: I0316 17:29:10.037591 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6f5787b9d7-pc75p" podUID="329d73ef-e3a7-47f4-bcc7-1f9c5ea3d8a1" containerName="dnsmasq-dns" probeResult="failure" output="dial tcp 10.217.1.86:5353: i/o timeout" Mar 16 17:29:10 crc kubenswrapper[5120]: I0316 17:29:10.580194 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["crc-storage/crc-storage-crc-vfpwt"] Mar 16 17:29:10 crc kubenswrapper[5120]: I0316 17:29:10.585141 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["crc-storage/crc-storage-crc-vfpwt"] Mar 16 17:29:10 crc kubenswrapper[5120]: I0316 17:29:10.672821 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="de6a5f6a-32b1-46b5-b810-f74779238239" path="/var/lib/kubelet/pods/de6a5f6a-32b1-46b5-b810-f74779238239/volumes" Mar 16 17:29:10 crc kubenswrapper[5120]: I0316 17:29:10.704315 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["crc-storage/crc-storage-crc-4kqzw"] Mar 16 17:29:10 crc kubenswrapper[5120]: I0316 17:29:10.705269 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="329d73ef-e3a7-47f4-bcc7-1f9c5ea3d8a1" containerName="dnsmasq-dns" Mar 16 17:29:10 crc kubenswrapper[5120]: I0316 17:29:10.705285 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="329d73ef-e3a7-47f4-bcc7-1f9c5ea3d8a1" containerName="dnsmasq-dns" Mar 16 17:29:10 crc kubenswrapper[5120]: I0316 17:29:10.705312 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de6a5f6a-32b1-46b5-b810-f74779238239" containerName="storage" Mar 16 17:29:10 crc kubenswrapper[5120]: I0316 17:29:10.705318 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="de6a5f6a-32b1-46b5-b810-f74779238239" containerName="storage" Mar 16 17:29:10 crc kubenswrapper[5120]: I0316 17:29:10.705341 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="329d73ef-e3a7-47f4-bcc7-1f9c5ea3d8a1" containerName="init" Mar 16 17:29:10 crc kubenswrapper[5120]: I0316 17:29:10.705346 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="329d73ef-e3a7-47f4-bcc7-1f9c5ea3d8a1" containerName="init" Mar 16 17:29:10 crc kubenswrapper[5120]: I0316 17:29:10.705458 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="329d73ef-e3a7-47f4-bcc7-1f9c5ea3d8a1" containerName="dnsmasq-dns" Mar 16 17:29:10 crc kubenswrapper[5120]: I0316 17:29:10.705479 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="de6a5f6a-32b1-46b5-b810-f74779238239" containerName="storage" Mar 16 17:29:10 crc kubenswrapper[5120]: I0316 17:29:10.719532 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-4kqzw"] Mar 16 17:29:10 crc kubenswrapper[5120]: I0316 17:29:10.719593 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-4kqzw" Mar 16 17:29:10 crc kubenswrapper[5120]: I0316 17:29:10.722003 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"crc-storage\"" Mar 16 17:29:10 crc kubenswrapper[5120]: I0316 17:29:10.722171 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"crc-storage\"/\"crc-storage-dockercfg-s2tht\"" Mar 16 17:29:10 crc kubenswrapper[5120]: I0316 17:29:10.726010 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"openshift-service-ca.crt\"" Mar 16 17:29:10 crc kubenswrapper[5120]: I0316 17:29:10.726076 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"kube-root-ca.crt\"" Mar 16 17:29:10 crc kubenswrapper[5120]: I0316 17:29:10.857446 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6nxl\" (UniqueName: \"kubernetes.io/projected/7be187e0-49e6-4c70-8593-f045ce464ac4-kube-api-access-w6nxl\") pod \"crc-storage-crc-4kqzw\" (UID: \"7be187e0-49e6-4c70-8593-f045ce464ac4\") " pod="crc-storage/crc-storage-crc-4kqzw" Mar 16 17:29:10 crc kubenswrapper[5120]: I0316 17:29:10.858540 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/7be187e0-49e6-4c70-8593-f045ce464ac4-crc-storage\") pod \"crc-storage-crc-4kqzw\" (UID: \"7be187e0-49e6-4c70-8593-f045ce464ac4\") " pod="crc-storage/crc-storage-crc-4kqzw" Mar 16 17:29:10 crc kubenswrapper[5120]: I0316 17:29:10.858627 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/7be187e0-49e6-4c70-8593-f045ce464ac4-node-mnt\") pod \"crc-storage-crc-4kqzw\" (UID: \"7be187e0-49e6-4c70-8593-f045ce464ac4\") " pod="crc-storage/crc-storage-crc-4kqzw" Mar 16 17:29:10 crc kubenswrapper[5120]: I0316 17:29:10.961225 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/7be187e0-49e6-4c70-8593-f045ce464ac4-crc-storage\") pod \"crc-storage-crc-4kqzw\" (UID: \"7be187e0-49e6-4c70-8593-f045ce464ac4\") " pod="crc-storage/crc-storage-crc-4kqzw" Mar 16 17:29:10 crc kubenswrapper[5120]: I0316 17:29:10.961334 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/7be187e0-49e6-4c70-8593-f045ce464ac4-node-mnt\") pod \"crc-storage-crc-4kqzw\" (UID: \"7be187e0-49e6-4c70-8593-f045ce464ac4\") " pod="crc-storage/crc-storage-crc-4kqzw" Mar 16 17:29:10 crc kubenswrapper[5120]: I0316 17:29:10.961555 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w6nxl\" (UniqueName: \"kubernetes.io/projected/7be187e0-49e6-4c70-8593-f045ce464ac4-kube-api-access-w6nxl\") pod \"crc-storage-crc-4kqzw\" (UID: \"7be187e0-49e6-4c70-8593-f045ce464ac4\") " pod="crc-storage/crc-storage-crc-4kqzw" Mar 16 17:29:10 crc kubenswrapper[5120]: I0316 17:29:10.961980 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/7be187e0-49e6-4c70-8593-f045ce464ac4-node-mnt\") pod \"crc-storage-crc-4kqzw\" (UID: \"7be187e0-49e6-4c70-8593-f045ce464ac4\") " pod="crc-storage/crc-storage-crc-4kqzw" Mar 16 17:29:10 crc kubenswrapper[5120]: I0316 17:29:10.962284 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/7be187e0-49e6-4c70-8593-f045ce464ac4-crc-storage\") pod \"crc-storage-crc-4kqzw\" (UID: \"7be187e0-49e6-4c70-8593-f045ce464ac4\") " pod="crc-storage/crc-storage-crc-4kqzw" Mar 16 17:29:10 crc kubenswrapper[5120]: I0316 17:29:10.981394 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6nxl\" (UniqueName: \"kubernetes.io/projected/7be187e0-49e6-4c70-8593-f045ce464ac4-kube-api-access-w6nxl\") pod \"crc-storage-crc-4kqzw\" (UID: \"7be187e0-49e6-4c70-8593-f045ce464ac4\") " pod="crc-storage/crc-storage-crc-4kqzw" Mar 16 17:29:11 crc kubenswrapper[5120]: I0316 17:29:11.037932 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-4kqzw" Mar 16 17:29:11 crc kubenswrapper[5120]: I0316 17:29:11.459284 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-4kqzw"] Mar 16 17:29:11 crc kubenswrapper[5120]: I0316 17:29:11.894458 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-4kqzw" event={"ID":"7be187e0-49e6-4c70-8593-f045ce464ac4","Type":"ContainerStarted","Data":"494131fbfc64735225c979843ed6e41246a8be142e1c6bf4cbe29f93f7a443c1"} Mar 16 17:29:12 crc kubenswrapper[5120]: I0316 17:29:12.907116 5120 generic.go:358] "Generic (PLEG): container finished" podID="7be187e0-49e6-4c70-8593-f045ce464ac4" containerID="b703f853c2173f1ee674f9e41b1b6514e6dac0db4a20c9728feabe6fce355e9e" exitCode=0 Mar 16 17:29:12 crc kubenswrapper[5120]: I0316 17:29:12.907163 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-4kqzw" event={"ID":"7be187e0-49e6-4c70-8593-f045ce464ac4","Type":"ContainerDied","Data":"b703f853c2173f1ee674f9e41b1b6514e6dac0db4a20c9728feabe6fce355e9e"} Mar 16 17:29:14 crc kubenswrapper[5120]: I0316 17:29:14.200443 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-4kqzw" Mar 16 17:29:14 crc kubenswrapper[5120]: I0316 17:29:14.331513 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w6nxl\" (UniqueName: \"kubernetes.io/projected/7be187e0-49e6-4c70-8593-f045ce464ac4-kube-api-access-w6nxl\") pod \"7be187e0-49e6-4c70-8593-f045ce464ac4\" (UID: \"7be187e0-49e6-4c70-8593-f045ce464ac4\") " Mar 16 17:29:14 crc kubenswrapper[5120]: I0316 17:29:14.331724 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/7be187e0-49e6-4c70-8593-f045ce464ac4-node-mnt\") pod \"7be187e0-49e6-4c70-8593-f045ce464ac4\" (UID: \"7be187e0-49e6-4c70-8593-f045ce464ac4\") " Mar 16 17:29:14 crc kubenswrapper[5120]: I0316 17:29:14.331827 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/7be187e0-49e6-4c70-8593-f045ce464ac4-crc-storage\") pod \"7be187e0-49e6-4c70-8593-f045ce464ac4\" (UID: \"7be187e0-49e6-4c70-8593-f045ce464ac4\") " Mar 16 17:29:14 crc kubenswrapper[5120]: I0316 17:29:14.332159 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/7be187e0-49e6-4c70-8593-f045ce464ac4-node-mnt" (OuterVolumeSpecName: "node-mnt") pod "7be187e0-49e6-4c70-8593-f045ce464ac4" (UID: "7be187e0-49e6-4c70-8593-f045ce464ac4"). InnerVolumeSpecName "node-mnt". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 17:29:14 crc kubenswrapper[5120]: I0316 17:29:14.332502 5120 reconciler_common.go:299] "Volume detached for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/7be187e0-49e6-4c70-8593-f045ce464ac4-node-mnt\") on node \"crc\" DevicePath \"\"" Mar 16 17:29:14 crc kubenswrapper[5120]: I0316 17:29:14.338224 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7be187e0-49e6-4c70-8593-f045ce464ac4-kube-api-access-w6nxl" (OuterVolumeSpecName: "kube-api-access-w6nxl") pod "7be187e0-49e6-4c70-8593-f045ce464ac4" (UID: "7be187e0-49e6-4c70-8593-f045ce464ac4"). InnerVolumeSpecName "kube-api-access-w6nxl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:29:14 crc kubenswrapper[5120]: I0316 17:29:14.351635 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7be187e0-49e6-4c70-8593-f045ce464ac4-crc-storage" (OuterVolumeSpecName: "crc-storage") pod "7be187e0-49e6-4c70-8593-f045ce464ac4" (UID: "7be187e0-49e6-4c70-8593-f045ce464ac4"). InnerVolumeSpecName "crc-storage". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:29:14 crc kubenswrapper[5120]: I0316 17:29:14.434971 5120 reconciler_common.go:299] "Volume detached for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/7be187e0-49e6-4c70-8593-f045ce464ac4-crc-storage\") on node \"crc\" DevicePath \"\"" Mar 16 17:29:14 crc kubenswrapper[5120]: I0316 17:29:14.435014 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w6nxl\" (UniqueName: \"kubernetes.io/projected/7be187e0-49e6-4c70-8593-f045ce464ac4-kube-api-access-w6nxl\") on node \"crc\" DevicePath \"\"" Mar 16 17:29:14 crc kubenswrapper[5120]: I0316 17:29:14.929423 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-4kqzw" event={"ID":"7be187e0-49e6-4c70-8593-f045ce464ac4","Type":"ContainerDied","Data":"494131fbfc64735225c979843ed6e41246a8be142e1c6bf4cbe29f93f7a443c1"} Mar 16 17:29:14 crc kubenswrapper[5120]: I0316 17:29:14.929471 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="494131fbfc64735225c979843ed6e41246a8be142e1c6bf4cbe29f93f7a443c1" Mar 16 17:29:14 crc kubenswrapper[5120]: I0316 17:29:14.929444 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-4kqzw" Mar 16 17:29:17 crc kubenswrapper[5120]: I0316 17:29:17.500401 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-6f7d8cfdff-b2gk2"] Mar 16 17:29:17 crc kubenswrapper[5120]: I0316 17:29:17.503752 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7be187e0-49e6-4c70-8593-f045ce464ac4" containerName="storage" Mar 16 17:29:17 crc kubenswrapper[5120]: I0316 17:29:17.503894 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7be187e0-49e6-4c70-8593-f045ce464ac4" containerName="storage" Mar 16 17:29:17 crc kubenswrapper[5120]: I0316 17:29:17.504203 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7be187e0-49e6-4c70-8593-f045ce464ac4" containerName="storage" Mar 16 17:29:17 crc kubenswrapper[5120]: I0316 17:29:17.512816 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6f7d8cfdff-b2gk2" Mar 16 17:29:17 crc kubenswrapper[5120]: I0316 17:29:17.515717 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"edpm-extramounts\"" Mar 16 17:29:17 crc kubenswrapper[5120]: I0316 17:29:17.528167 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-6f7d8cfdff-b2gk2"] Mar 16 17:29:17 crc kubenswrapper[5120]: I0316 17:29:17.607890 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"edpm-extramounts\" (UniqueName: \"kubernetes.io/configmap/e8b617f0-70d3-4173-9474-8d2683da7eef-edpm-extramounts\") pod \"dnsmasq-dnsmasq-6f7d8cfdff-b2gk2\" (UID: \"e8b617f0-70d3-4173-9474-8d2683da7eef\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6f7d8cfdff-b2gk2" Mar 16 17:29:17 crc kubenswrapper[5120]: I0316 17:29:17.608088 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e8b617f0-70d3-4173-9474-8d2683da7eef-config\") pod \"dnsmasq-dnsmasq-6f7d8cfdff-b2gk2\" (UID: \"e8b617f0-70d3-4173-9474-8d2683da7eef\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6f7d8cfdff-b2gk2" Mar 16 17:29:17 crc kubenswrapper[5120]: I0316 17:29:17.608121 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/e8b617f0-70d3-4173-9474-8d2683da7eef-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-6f7d8cfdff-b2gk2\" (UID: \"e8b617f0-70d3-4173-9474-8d2683da7eef\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6f7d8cfdff-b2gk2" Mar 16 17:29:17 crc kubenswrapper[5120]: I0316 17:29:17.608204 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdj4b\" (UniqueName: \"kubernetes.io/projected/e8b617f0-70d3-4173-9474-8d2683da7eef-kube-api-access-wdj4b\") pod \"dnsmasq-dnsmasq-6f7d8cfdff-b2gk2\" (UID: \"e8b617f0-70d3-4173-9474-8d2683da7eef\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6f7d8cfdff-b2gk2" Mar 16 17:29:17 crc kubenswrapper[5120]: I0316 17:29:17.710103 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"edpm-extramounts\" (UniqueName: \"kubernetes.io/configmap/e8b617f0-70d3-4173-9474-8d2683da7eef-edpm-extramounts\") pod \"dnsmasq-dnsmasq-6f7d8cfdff-b2gk2\" (UID: \"e8b617f0-70d3-4173-9474-8d2683da7eef\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6f7d8cfdff-b2gk2" Mar 16 17:29:17 crc kubenswrapper[5120]: I0316 17:29:17.710250 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e8b617f0-70d3-4173-9474-8d2683da7eef-config\") pod \"dnsmasq-dnsmasq-6f7d8cfdff-b2gk2\" (UID: \"e8b617f0-70d3-4173-9474-8d2683da7eef\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6f7d8cfdff-b2gk2" Mar 16 17:29:17 crc kubenswrapper[5120]: I0316 17:29:17.710278 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/e8b617f0-70d3-4173-9474-8d2683da7eef-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-6f7d8cfdff-b2gk2\" (UID: \"e8b617f0-70d3-4173-9474-8d2683da7eef\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6f7d8cfdff-b2gk2" Mar 16 17:29:17 crc kubenswrapper[5120]: I0316 17:29:17.710358 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wdj4b\" (UniqueName: \"kubernetes.io/projected/e8b617f0-70d3-4173-9474-8d2683da7eef-kube-api-access-wdj4b\") pod \"dnsmasq-dnsmasq-6f7d8cfdff-b2gk2\" (UID: \"e8b617f0-70d3-4173-9474-8d2683da7eef\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6f7d8cfdff-b2gk2" Mar 16 17:29:17 crc kubenswrapper[5120]: I0316 17:29:17.711333 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"edpm-extramounts\" (UniqueName: \"kubernetes.io/configmap/e8b617f0-70d3-4173-9474-8d2683da7eef-edpm-extramounts\") pod \"dnsmasq-dnsmasq-6f7d8cfdff-b2gk2\" (UID: \"e8b617f0-70d3-4173-9474-8d2683da7eef\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6f7d8cfdff-b2gk2" Mar 16 17:29:17 crc kubenswrapper[5120]: I0316 17:29:17.711338 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/e8b617f0-70d3-4173-9474-8d2683da7eef-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-6f7d8cfdff-b2gk2\" (UID: \"e8b617f0-70d3-4173-9474-8d2683da7eef\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6f7d8cfdff-b2gk2" Mar 16 17:29:17 crc kubenswrapper[5120]: I0316 17:29:17.712088 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e8b617f0-70d3-4173-9474-8d2683da7eef-config\") pod \"dnsmasq-dnsmasq-6f7d8cfdff-b2gk2\" (UID: \"e8b617f0-70d3-4173-9474-8d2683da7eef\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6f7d8cfdff-b2gk2" Mar 16 17:29:17 crc kubenswrapper[5120]: I0316 17:29:17.729295 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdj4b\" (UniqueName: \"kubernetes.io/projected/e8b617f0-70d3-4173-9474-8d2683da7eef-kube-api-access-wdj4b\") pod \"dnsmasq-dnsmasq-6f7d8cfdff-b2gk2\" (UID: \"e8b617f0-70d3-4173-9474-8d2683da7eef\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6f7d8cfdff-b2gk2" Mar 16 17:29:17 crc kubenswrapper[5120]: I0316 17:29:17.837820 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6f7d8cfdff-b2gk2" Mar 16 17:29:18 crc kubenswrapper[5120]: I0316 17:29:18.250756 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-6f7d8cfdff-b2gk2"] Mar 16 17:29:18 crc kubenswrapper[5120]: I0316 17:29:18.986890 5120 generic.go:358] "Generic (PLEG): container finished" podID="e8b617f0-70d3-4173-9474-8d2683da7eef" containerID="54b8703be34a5d59c13687294963356a6f755f53b6ae6ff95bd03e431bbc0df2" exitCode=0 Mar 16 17:29:18 crc kubenswrapper[5120]: I0316 17:29:18.987037 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6f7d8cfdff-b2gk2" event={"ID":"e8b617f0-70d3-4173-9474-8d2683da7eef","Type":"ContainerDied","Data":"54b8703be34a5d59c13687294963356a6f755f53b6ae6ff95bd03e431bbc0df2"} Mar 16 17:29:18 crc kubenswrapper[5120]: I0316 17:29:18.987106 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6f7d8cfdff-b2gk2" event={"ID":"e8b617f0-70d3-4173-9474-8d2683da7eef","Type":"ContainerStarted","Data":"6fa8eb6c8996602dd5604d4080f23ea094d2716ba26ca9b1305b1f3688d42951"} Mar 16 17:29:20 crc kubenswrapper[5120]: I0316 17:29:20.000228 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6f7d8cfdff-b2gk2" event={"ID":"e8b617f0-70d3-4173-9474-8d2683da7eef","Type":"ContainerStarted","Data":"1289897ac050a0f20f9d7144dc09811cfa21eea16520f6134b637018563a0bf3"} Mar 16 17:29:20 crc kubenswrapper[5120]: I0316 17:29:20.000313 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6f7d8cfdff-b2gk2" Mar 16 17:29:20 crc kubenswrapper[5120]: I0316 17:29:20.019710 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6f7d8cfdff-b2gk2" podStartSLOduration=3.01969103 podStartE2EDuration="3.01969103s" podCreationTimestamp="2026-03-16 17:29:17 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:29:20.014897289 +0000 UTC m=+7062.168828956" watchObservedRunningTime="2026-03-16 17:29:20.01969103 +0000 UTC m=+7062.173622687" Mar 16 17:29:21 crc kubenswrapper[5120]: I0316 17:29:21.663670 5120 scope.go:117] "RemoveContainer" containerID="df0a87b047c8208d5fc21057efed33321f6cab49c4cf053702d222dc12979450" Mar 16 17:29:21 crc kubenswrapper[5120]: E0316 17:29:21.664267 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 17:29:26 crc kubenswrapper[5120]: I0316 17:29:26.010575 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6f7d8cfdff-b2gk2" Mar 16 17:29:26 crc kubenswrapper[5120]: I0316 17:29:26.068180 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-gpp5n"] Mar 16 17:29:26 crc kubenswrapper[5120]: I0316 17:29:26.068682 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-gpp5n" podUID="7f72bbb7-4bba-42d3-bbf1-de4311db5e28" containerName="dnsmasq-dns" containerID="cri-o://d15295117e7a214679c1c7de7e41859c5284248f1f2995ac296ce2ec909ce5ab" gracePeriod=10 Mar 16 17:29:26 crc kubenswrapper[5120]: I0316 17:29:26.478927 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-gpp5n" Mar 16 17:29:26 crc kubenswrapper[5120]: I0316 17:29:26.604916 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/7f72bbb7-4bba-42d3-bbf1-de4311db5e28-dnsmasq-svc\") pod \"7f72bbb7-4bba-42d3-bbf1-de4311db5e28\" (UID: \"7f72bbb7-4bba-42d3-bbf1-de4311db5e28\") " Mar 16 17:29:26 crc kubenswrapper[5120]: I0316 17:29:26.605319 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7f72bbb7-4bba-42d3-bbf1-de4311db5e28-config\") pod \"7f72bbb7-4bba-42d3-bbf1-de4311db5e28\" (UID: \"7f72bbb7-4bba-42d3-bbf1-de4311db5e28\") " Mar 16 17:29:26 crc kubenswrapper[5120]: I0316 17:29:26.605472 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hkr7t\" (UniqueName: \"kubernetes.io/projected/7f72bbb7-4bba-42d3-bbf1-de4311db5e28-kube-api-access-hkr7t\") pod \"7f72bbb7-4bba-42d3-bbf1-de4311db5e28\" (UID: \"7f72bbb7-4bba-42d3-bbf1-de4311db5e28\") " Mar 16 17:29:26 crc kubenswrapper[5120]: I0316 17:29:26.617701 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f72bbb7-4bba-42d3-bbf1-de4311db5e28-kube-api-access-hkr7t" (OuterVolumeSpecName: "kube-api-access-hkr7t") pod "7f72bbb7-4bba-42d3-bbf1-de4311db5e28" (UID: "7f72bbb7-4bba-42d3-bbf1-de4311db5e28"). InnerVolumeSpecName "kube-api-access-hkr7t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:29:26 crc kubenswrapper[5120]: I0316 17:29:26.643702 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f72bbb7-4bba-42d3-bbf1-de4311db5e28-config" (OuterVolumeSpecName: "config") pod "7f72bbb7-4bba-42d3-bbf1-de4311db5e28" (UID: "7f72bbb7-4bba-42d3-bbf1-de4311db5e28"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:29:26 crc kubenswrapper[5120]: I0316 17:29:26.644820 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f72bbb7-4bba-42d3-bbf1-de4311db5e28-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "7f72bbb7-4bba-42d3-bbf1-de4311db5e28" (UID: "7f72bbb7-4bba-42d3-bbf1-de4311db5e28"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:29:26 crc kubenswrapper[5120]: I0316 17:29:26.708460 5120 reconciler_common.go:299] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/7f72bbb7-4bba-42d3-bbf1-de4311db5e28-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Mar 16 17:29:26 crc kubenswrapper[5120]: I0316 17:29:26.708506 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7f72bbb7-4bba-42d3-bbf1-de4311db5e28-config\") on node \"crc\" DevicePath \"\"" Mar 16 17:29:26 crc kubenswrapper[5120]: I0316 17:29:26.708521 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hkr7t\" (UniqueName: \"kubernetes.io/projected/7f72bbb7-4bba-42d3-bbf1-de4311db5e28-kube-api-access-hkr7t\") on node \"crc\" DevicePath \"\"" Mar 16 17:29:27 crc kubenswrapper[5120]: I0316 17:29:27.084042 5120 generic.go:358] "Generic (PLEG): container finished" podID="7f72bbb7-4bba-42d3-bbf1-de4311db5e28" containerID="d15295117e7a214679c1c7de7e41859c5284248f1f2995ac296ce2ec909ce5ab" exitCode=0 Mar 16 17:29:27 crc kubenswrapper[5120]: I0316 17:29:27.084173 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-gpp5n" Mar 16 17:29:27 crc kubenswrapper[5120]: I0316 17:29:27.084210 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-gpp5n" event={"ID":"7f72bbb7-4bba-42d3-bbf1-de4311db5e28","Type":"ContainerDied","Data":"d15295117e7a214679c1c7de7e41859c5284248f1f2995ac296ce2ec909ce5ab"} Mar 16 17:29:27 crc kubenswrapper[5120]: I0316 17:29:27.084283 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-gpp5n" event={"ID":"7f72bbb7-4bba-42d3-bbf1-de4311db5e28","Type":"ContainerDied","Data":"67f2d0fb907e2703717f23011b87393152fdb7c2f5b39e984a9f4166a50e2408"} Mar 16 17:29:27 crc kubenswrapper[5120]: I0316 17:29:27.084303 5120 scope.go:117] "RemoveContainer" containerID="d15295117e7a214679c1c7de7e41859c5284248f1f2995ac296ce2ec909ce5ab" Mar 16 17:29:27 crc kubenswrapper[5120]: I0316 17:29:27.116074 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-gpp5n"] Mar 16 17:29:27 crc kubenswrapper[5120]: I0316 17:29:27.121645 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-gpp5n"] Mar 16 17:29:27 crc kubenswrapper[5120]: I0316 17:29:27.127446 5120 scope.go:117] "RemoveContainer" containerID="fea6887013450276879eed375e063261045d258858ad903c3afd53c361902833" Mar 16 17:29:27 crc kubenswrapper[5120]: I0316 17:29:27.143990 5120 scope.go:117] "RemoveContainer" containerID="d15295117e7a214679c1c7de7e41859c5284248f1f2995ac296ce2ec909ce5ab" Mar 16 17:29:27 crc kubenswrapper[5120]: E0316 17:29:27.144465 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d15295117e7a214679c1c7de7e41859c5284248f1f2995ac296ce2ec909ce5ab\": container with ID starting with d15295117e7a214679c1c7de7e41859c5284248f1f2995ac296ce2ec909ce5ab not found: ID does not exist" containerID="d15295117e7a214679c1c7de7e41859c5284248f1f2995ac296ce2ec909ce5ab" Mar 16 17:29:27 crc kubenswrapper[5120]: I0316 17:29:27.144515 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d15295117e7a214679c1c7de7e41859c5284248f1f2995ac296ce2ec909ce5ab"} err="failed to get container status \"d15295117e7a214679c1c7de7e41859c5284248f1f2995ac296ce2ec909ce5ab\": rpc error: code = NotFound desc = could not find container \"d15295117e7a214679c1c7de7e41859c5284248f1f2995ac296ce2ec909ce5ab\": container with ID starting with d15295117e7a214679c1c7de7e41859c5284248f1f2995ac296ce2ec909ce5ab not found: ID does not exist" Mar 16 17:29:27 crc kubenswrapper[5120]: I0316 17:29:27.144540 5120 scope.go:117] "RemoveContainer" containerID="fea6887013450276879eed375e063261045d258858ad903c3afd53c361902833" Mar 16 17:29:27 crc kubenswrapper[5120]: E0316 17:29:27.144804 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fea6887013450276879eed375e063261045d258858ad903c3afd53c361902833\": container with ID starting with fea6887013450276879eed375e063261045d258858ad903c3afd53c361902833 not found: ID does not exist" containerID="fea6887013450276879eed375e063261045d258858ad903c3afd53c361902833" Mar 16 17:29:27 crc kubenswrapper[5120]: I0316 17:29:27.144829 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fea6887013450276879eed375e063261045d258858ad903c3afd53c361902833"} err="failed to get container status \"fea6887013450276879eed375e063261045d258858ad903c3afd53c361902833\": rpc error: code = NotFound desc = could not find container \"fea6887013450276879eed375e063261045d258858ad903c3afd53c361902833\": container with ID starting with fea6887013450276879eed375e063261045d258858ad903c3afd53c361902833 not found: ID does not exist" Mar 16 17:29:27 crc kubenswrapper[5120]: I0316 17:29:27.430905 5120 scope.go:117] "RemoveContainer" containerID="c1fbb7e6a91060e85eb5a841afe516c5fad034248b484402c1a9bc0e83d243e6" Mar 16 17:29:27 crc kubenswrapper[5120]: I0316 17:29:27.454968 5120 scope.go:117] "RemoveContainer" containerID="ec9e84f5c5ff83a164a2a7599780b27672729c0d2543e761e499d1db5efd4b06" Mar 16 17:29:27 crc kubenswrapper[5120]: I0316 17:29:27.476408 5120 scope.go:117] "RemoveContainer" containerID="7ec068cbf27c04fbf21d2e6e76e4bd8aa96c095cc502c5e522fb91421eb09b6c" Mar 16 17:29:27 crc kubenswrapper[5120]: I0316 17:29:27.509859 5120 scope.go:117] "RemoveContainer" containerID="ac4c098443c886dcc0f855cfb983fb197e11545ea6cfaa24b64e21b0e720e7bb" Mar 16 17:29:28 crc kubenswrapper[5120]: I0316 17:29:28.675513 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7f72bbb7-4bba-42d3-bbf1-de4311db5e28" path="/var/lib/kubelet/pods/7f72bbb7-4bba-42d3-bbf1-de4311db5e28/volumes" Mar 16 17:29:32 crc kubenswrapper[5120]: I0316 17:29:32.614694 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-jbbpm"] Mar 16 17:29:32 crc kubenswrapper[5120]: I0316 17:29:32.616125 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f72bbb7-4bba-42d3-bbf1-de4311db5e28" containerName="init" Mar 16 17:29:32 crc kubenswrapper[5120]: I0316 17:29:32.616153 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f72bbb7-4bba-42d3-bbf1-de4311db5e28" containerName="init" Mar 16 17:29:32 crc kubenswrapper[5120]: I0316 17:29:32.616220 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f72bbb7-4bba-42d3-bbf1-de4311db5e28" containerName="dnsmasq-dns" Mar 16 17:29:32 crc kubenswrapper[5120]: I0316 17:29:32.616229 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f72bbb7-4bba-42d3-bbf1-de4311db5e28" containerName="dnsmasq-dns" Mar 16 17:29:32 crc kubenswrapper[5120]: I0316 17:29:32.616381 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7f72bbb7-4bba-42d3-bbf1-de4311db5e28" containerName="dnsmasq-dns" Mar 16 17:29:32 crc kubenswrapper[5120]: I0316 17:29:32.629786 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-jbbpm"] Mar 16 17:29:32 crc kubenswrapper[5120]: I0316 17:29:32.629949 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-jbbpm" Mar 16 17:29:32 crc kubenswrapper[5120]: I0316 17:29:32.738174 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cs64f\" (UniqueName: \"kubernetes.io/projected/efc4931c-21e8-49a4-957a-8436dfcd49b0-kube-api-access-cs64f\") pod \"dnsmasq-dnsmasq-79dcd846c5-jbbpm\" (UID: \"efc4931c-21e8-49a4-957a-8436dfcd49b0\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-jbbpm" Mar 16 17:29:32 crc kubenswrapper[5120]: I0316 17:29:32.738518 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/efc4931c-21e8-49a4-957a-8436dfcd49b0-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-79dcd846c5-jbbpm\" (UID: \"efc4931c-21e8-49a4-957a-8436dfcd49b0\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-jbbpm" Mar 16 17:29:32 crc kubenswrapper[5120]: I0316 17:29:32.738684 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/efc4931c-21e8-49a4-957a-8436dfcd49b0-config\") pod \"dnsmasq-dnsmasq-79dcd846c5-jbbpm\" (UID: \"efc4931c-21e8-49a4-957a-8436dfcd49b0\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-jbbpm" Mar 16 17:29:32 crc kubenswrapper[5120]: I0316 17:29:32.840683 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cs64f\" (UniqueName: \"kubernetes.io/projected/efc4931c-21e8-49a4-957a-8436dfcd49b0-kube-api-access-cs64f\") pod \"dnsmasq-dnsmasq-79dcd846c5-jbbpm\" (UID: \"efc4931c-21e8-49a4-957a-8436dfcd49b0\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-jbbpm" Mar 16 17:29:32 crc kubenswrapper[5120]: I0316 17:29:32.841177 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/efc4931c-21e8-49a4-957a-8436dfcd49b0-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-79dcd846c5-jbbpm\" (UID: \"efc4931c-21e8-49a4-957a-8436dfcd49b0\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-jbbpm" Mar 16 17:29:32 crc kubenswrapper[5120]: I0316 17:29:32.842105 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/efc4931c-21e8-49a4-957a-8436dfcd49b0-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-79dcd846c5-jbbpm\" (UID: \"efc4931c-21e8-49a4-957a-8436dfcd49b0\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-jbbpm" Mar 16 17:29:32 crc kubenswrapper[5120]: I0316 17:29:32.842107 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/efc4931c-21e8-49a4-957a-8436dfcd49b0-config\") pod \"dnsmasq-dnsmasq-79dcd846c5-jbbpm\" (UID: \"efc4931c-21e8-49a4-957a-8436dfcd49b0\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-jbbpm" Mar 16 17:29:32 crc kubenswrapper[5120]: I0316 17:29:32.842831 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/efc4931c-21e8-49a4-957a-8436dfcd49b0-config\") pod \"dnsmasq-dnsmasq-79dcd846c5-jbbpm\" (UID: \"efc4931c-21e8-49a4-957a-8436dfcd49b0\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-jbbpm" Mar 16 17:29:32 crc kubenswrapper[5120]: I0316 17:29:32.859477 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cs64f\" (UniqueName: \"kubernetes.io/projected/efc4931c-21e8-49a4-957a-8436dfcd49b0-kube-api-access-cs64f\") pod \"dnsmasq-dnsmasq-79dcd846c5-jbbpm\" (UID: \"efc4931c-21e8-49a4-957a-8436dfcd49b0\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-jbbpm" Mar 16 17:29:32 crc kubenswrapper[5120]: I0316 17:29:32.950532 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-jbbpm" Mar 16 17:29:33 crc kubenswrapper[5120]: I0316 17:29:33.384089 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-jbbpm"] Mar 16 17:29:33 crc kubenswrapper[5120]: W0316 17:29:33.390586 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podefc4931c_21e8_49a4_957a_8436dfcd49b0.slice/crio-a561aea9dfdfcc2ec8b9e893891272616008f27ec2b295aa1efbf249bc9bd298 WatchSource:0}: Error finding container a561aea9dfdfcc2ec8b9e893891272616008f27ec2b295aa1efbf249bc9bd298: Status 404 returned error can't find the container with id a561aea9dfdfcc2ec8b9e893891272616008f27ec2b295aa1efbf249bc9bd298 Mar 16 17:29:34 crc kubenswrapper[5120]: I0316 17:29:34.149471 5120 generic.go:358] "Generic (PLEG): container finished" podID="efc4931c-21e8-49a4-957a-8436dfcd49b0" containerID="ccb2c3405e558f483d532a5117458dd244cab1afacb48f81f3817273c675dad8" exitCode=0 Mar 16 17:29:34 crc kubenswrapper[5120]: I0316 17:29:34.149566 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-jbbpm" event={"ID":"efc4931c-21e8-49a4-957a-8436dfcd49b0","Type":"ContainerDied","Data":"ccb2c3405e558f483d532a5117458dd244cab1afacb48f81f3817273c675dad8"} Mar 16 17:29:34 crc kubenswrapper[5120]: I0316 17:29:34.149966 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-jbbpm" event={"ID":"efc4931c-21e8-49a4-957a-8436dfcd49b0","Type":"ContainerStarted","Data":"a561aea9dfdfcc2ec8b9e893891272616008f27ec2b295aa1efbf249bc9bd298"} Mar 16 17:29:34 crc kubenswrapper[5120]: I0316 17:29:34.664059 5120 scope.go:117] "RemoveContainer" containerID="df0a87b047c8208d5fc21057efed33321f6cab49c4cf053702d222dc12979450" Mar 16 17:29:34 crc kubenswrapper[5120]: E0316 17:29:34.664384 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 17:29:35 crc kubenswrapper[5120]: I0316 17:29:35.160854 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-jbbpm" event={"ID":"efc4931c-21e8-49a4-957a-8436dfcd49b0","Type":"ContainerStarted","Data":"2bf51a5ea5c74f87ab5a29652860d87cd8965b05fc48e226057c888c7b702dc4"} Mar 16 17:29:35 crc kubenswrapper[5120]: I0316 17:29:35.161966 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-jbbpm" Mar 16 17:29:35 crc kubenswrapper[5120]: I0316 17:29:35.182332 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-jbbpm" podStartSLOduration=3.18231274 podStartE2EDuration="3.18231274s" podCreationTimestamp="2026-03-16 17:29:32 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:29:35.181172439 +0000 UTC m=+7077.335104106" watchObservedRunningTime="2026-03-16 17:29:35.18231274 +0000 UTC m=+7077.336244397" Mar 16 17:29:39 crc kubenswrapper[5120]: I0316 17:29:39.630827 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["crc-storage/crc-storage-crc-4kqzw"] Mar 16 17:29:39 crc kubenswrapper[5120]: I0316 17:29:39.637275 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["crc-storage/crc-storage-crc-4kqzw"] Mar 16 17:29:39 crc kubenswrapper[5120]: I0316 17:29:39.762908 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["crc-storage/crc-storage-crc-9fq94"] Mar 16 17:29:39 crc kubenswrapper[5120]: I0316 17:29:39.821540 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-9fq94"] Mar 16 17:29:39 crc kubenswrapper[5120]: I0316 17:29:39.821683 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-9fq94" Mar 16 17:29:39 crc kubenswrapper[5120]: I0316 17:29:39.824702 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"crc-storage\"" Mar 16 17:29:39 crc kubenswrapper[5120]: I0316 17:29:39.824903 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"crc-storage\"/\"crc-storage-dockercfg-s2tht\"" Mar 16 17:29:39 crc kubenswrapper[5120]: I0316 17:29:39.825841 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"openshift-service-ca.crt\"" Mar 16 17:29:39 crc kubenswrapper[5120]: I0316 17:29:39.826114 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"kube-root-ca.crt\"" Mar 16 17:29:39 crc kubenswrapper[5120]: I0316 17:29:39.895066 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ckgn\" (UniqueName: \"kubernetes.io/projected/ef647388-3771-42f3-b7ad-f924d6bb3c3d-kube-api-access-5ckgn\") pod \"crc-storage-crc-9fq94\" (UID: \"ef647388-3771-42f3-b7ad-f924d6bb3c3d\") " pod="crc-storage/crc-storage-crc-9fq94" Mar 16 17:29:39 crc kubenswrapper[5120]: I0316 17:29:39.895357 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/ef647388-3771-42f3-b7ad-f924d6bb3c3d-crc-storage\") pod \"crc-storage-crc-9fq94\" (UID: \"ef647388-3771-42f3-b7ad-f924d6bb3c3d\") " pod="crc-storage/crc-storage-crc-9fq94" Mar 16 17:29:39 crc kubenswrapper[5120]: I0316 17:29:39.895699 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/ef647388-3771-42f3-b7ad-f924d6bb3c3d-node-mnt\") pod \"crc-storage-crc-9fq94\" (UID: \"ef647388-3771-42f3-b7ad-f924d6bb3c3d\") " pod="crc-storage/crc-storage-crc-9fq94" Mar 16 17:29:39 crc kubenswrapper[5120]: I0316 17:29:39.997619 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5ckgn\" (UniqueName: \"kubernetes.io/projected/ef647388-3771-42f3-b7ad-f924d6bb3c3d-kube-api-access-5ckgn\") pod \"crc-storage-crc-9fq94\" (UID: \"ef647388-3771-42f3-b7ad-f924d6bb3c3d\") " pod="crc-storage/crc-storage-crc-9fq94" Mar 16 17:29:39 crc kubenswrapper[5120]: I0316 17:29:39.998175 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/ef647388-3771-42f3-b7ad-f924d6bb3c3d-crc-storage\") pod \"crc-storage-crc-9fq94\" (UID: \"ef647388-3771-42f3-b7ad-f924d6bb3c3d\") " pod="crc-storage/crc-storage-crc-9fq94" Mar 16 17:29:39 crc kubenswrapper[5120]: I0316 17:29:39.998350 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/ef647388-3771-42f3-b7ad-f924d6bb3c3d-node-mnt\") pod \"crc-storage-crc-9fq94\" (UID: \"ef647388-3771-42f3-b7ad-f924d6bb3c3d\") " pod="crc-storage/crc-storage-crc-9fq94" Mar 16 17:29:39 crc kubenswrapper[5120]: I0316 17:29:39.998693 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/ef647388-3771-42f3-b7ad-f924d6bb3c3d-node-mnt\") pod \"crc-storage-crc-9fq94\" (UID: \"ef647388-3771-42f3-b7ad-f924d6bb3c3d\") " pod="crc-storage/crc-storage-crc-9fq94" Mar 16 17:29:39 crc kubenswrapper[5120]: I0316 17:29:39.999108 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/ef647388-3771-42f3-b7ad-f924d6bb3c3d-crc-storage\") pod \"crc-storage-crc-9fq94\" (UID: \"ef647388-3771-42f3-b7ad-f924d6bb3c3d\") " pod="crc-storage/crc-storage-crc-9fq94" Mar 16 17:29:40 crc kubenswrapper[5120]: I0316 17:29:40.017518 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ckgn\" (UniqueName: \"kubernetes.io/projected/ef647388-3771-42f3-b7ad-f924d6bb3c3d-kube-api-access-5ckgn\") pod \"crc-storage-crc-9fq94\" (UID: \"ef647388-3771-42f3-b7ad-f924d6bb3c3d\") " pod="crc-storage/crc-storage-crc-9fq94" Mar 16 17:29:40 crc kubenswrapper[5120]: I0316 17:29:40.144035 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-9fq94" Mar 16 17:29:40 crc kubenswrapper[5120]: I0316 17:29:40.554894 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-9fq94"] Mar 16 17:29:40 crc kubenswrapper[5120]: W0316 17:29:40.558340 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podef647388_3771_42f3_b7ad_f924d6bb3c3d.slice/crio-b4e61187d626a199b3d737481ab86b18327f0bdc9fa83b87e9e8806b2c63caff WatchSource:0}: Error finding container b4e61187d626a199b3d737481ab86b18327f0bdc9fa83b87e9e8806b2c63caff: Status 404 returned error can't find the container with id b4e61187d626a199b3d737481ab86b18327f0bdc9fa83b87e9e8806b2c63caff Mar 16 17:29:40 crc kubenswrapper[5120]: I0316 17:29:40.675010 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7be187e0-49e6-4c70-8593-f045ce464ac4" path="/var/lib/kubelet/pods/7be187e0-49e6-4c70-8593-f045ce464ac4/volumes" Mar 16 17:29:41 crc kubenswrapper[5120]: I0316 17:29:41.214638 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-9fq94" event={"ID":"ef647388-3771-42f3-b7ad-f924d6bb3c3d","Type":"ContainerStarted","Data":"95673ae5a357aa45e270b30e99847c6edd87976528ade2c747aa44f53563913d"} Mar 16 17:29:41 crc kubenswrapper[5120]: I0316 17:29:41.215084 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-9fq94" event={"ID":"ef647388-3771-42f3-b7ad-f924d6bb3c3d","Type":"ContainerStarted","Data":"b4e61187d626a199b3d737481ab86b18327f0bdc9fa83b87e9e8806b2c63caff"} Mar 16 17:29:41 crc kubenswrapper[5120]: I0316 17:29:41.232318 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="crc-storage/crc-storage-crc-9fq94" podStartSLOduration=1.768623185 podStartE2EDuration="2.232298198s" podCreationTimestamp="2026-03-16 17:29:39 +0000 UTC" firstStartedPulling="2026-03-16 17:29:40.559972351 +0000 UTC m=+7082.713904008" lastFinishedPulling="2026-03-16 17:29:41.023647364 +0000 UTC m=+7083.177579021" observedRunningTime="2026-03-16 17:29:41.232115913 +0000 UTC m=+7083.386047570" watchObservedRunningTime="2026-03-16 17:29:41.232298198 +0000 UTC m=+7083.386229855" Mar 16 17:29:42 crc kubenswrapper[5120]: I0316 17:29:42.179216 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-jbbpm" Mar 16 17:29:42 crc kubenswrapper[5120]: I0316 17:29:42.237731 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-6f7d8cfdff-b2gk2"] Mar 16 17:29:42 crc kubenswrapper[5120]: I0316 17:29:42.238012 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6f7d8cfdff-b2gk2" podUID="e8b617f0-70d3-4173-9474-8d2683da7eef" containerName="dnsmasq-dns" containerID="cri-o://1289897ac050a0f20f9d7144dc09811cfa21eea16520f6134b637018563a0bf3" gracePeriod=10 Mar 16 17:29:42 crc kubenswrapper[5120]: I0316 17:29:42.238127 5120 generic.go:358] "Generic (PLEG): container finished" podID="ef647388-3771-42f3-b7ad-f924d6bb3c3d" containerID="95673ae5a357aa45e270b30e99847c6edd87976528ade2c747aa44f53563913d" exitCode=0 Mar 16 17:29:42 crc kubenswrapper[5120]: I0316 17:29:42.238460 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-9fq94" event={"ID":"ef647388-3771-42f3-b7ad-f924d6bb3c3d","Type":"ContainerDied","Data":"95673ae5a357aa45e270b30e99847c6edd87976528ade2c747aa44f53563913d"} Mar 16 17:29:42 crc kubenswrapper[5120]: I0316 17:29:42.685106 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6f7d8cfdff-b2gk2" Mar 16 17:29:42 crc kubenswrapper[5120]: I0316 17:29:42.763013 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/e8b617f0-70d3-4173-9474-8d2683da7eef-dnsmasq-svc\") pod \"e8b617f0-70d3-4173-9474-8d2683da7eef\" (UID: \"e8b617f0-70d3-4173-9474-8d2683da7eef\") " Mar 16 17:29:42 crc kubenswrapper[5120]: I0316 17:29:42.763058 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wdj4b\" (UniqueName: \"kubernetes.io/projected/e8b617f0-70d3-4173-9474-8d2683da7eef-kube-api-access-wdj4b\") pod \"e8b617f0-70d3-4173-9474-8d2683da7eef\" (UID: \"e8b617f0-70d3-4173-9474-8d2683da7eef\") " Mar 16 17:29:42 crc kubenswrapper[5120]: I0316 17:29:42.763266 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"edpm-extramounts\" (UniqueName: \"kubernetes.io/configmap/e8b617f0-70d3-4173-9474-8d2683da7eef-edpm-extramounts\") pod \"e8b617f0-70d3-4173-9474-8d2683da7eef\" (UID: \"e8b617f0-70d3-4173-9474-8d2683da7eef\") " Mar 16 17:29:42 crc kubenswrapper[5120]: I0316 17:29:42.763885 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e8b617f0-70d3-4173-9474-8d2683da7eef-config\") pod \"e8b617f0-70d3-4173-9474-8d2683da7eef\" (UID: \"e8b617f0-70d3-4173-9474-8d2683da7eef\") " Mar 16 17:29:42 crc kubenswrapper[5120]: I0316 17:29:42.775014 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8b617f0-70d3-4173-9474-8d2683da7eef-kube-api-access-wdj4b" (OuterVolumeSpecName: "kube-api-access-wdj4b") pod "e8b617f0-70d3-4173-9474-8d2683da7eef" (UID: "e8b617f0-70d3-4173-9474-8d2683da7eef"). InnerVolumeSpecName "kube-api-access-wdj4b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:29:42 crc kubenswrapper[5120]: I0316 17:29:42.796878 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8b617f0-70d3-4173-9474-8d2683da7eef-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "e8b617f0-70d3-4173-9474-8d2683da7eef" (UID: "e8b617f0-70d3-4173-9474-8d2683da7eef"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:29:42 crc kubenswrapper[5120]: I0316 17:29:42.800323 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8b617f0-70d3-4173-9474-8d2683da7eef-edpm-extramounts" (OuterVolumeSpecName: "edpm-extramounts") pod "e8b617f0-70d3-4173-9474-8d2683da7eef" (UID: "e8b617f0-70d3-4173-9474-8d2683da7eef"). InnerVolumeSpecName "edpm-extramounts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:29:42 crc kubenswrapper[5120]: I0316 17:29:42.800428 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8b617f0-70d3-4173-9474-8d2683da7eef-config" (OuterVolumeSpecName: "config") pod "e8b617f0-70d3-4173-9474-8d2683da7eef" (UID: "e8b617f0-70d3-4173-9474-8d2683da7eef"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:29:42 crc kubenswrapper[5120]: I0316 17:29:42.867149 5120 reconciler_common.go:299] "Volume detached for volume \"edpm-extramounts\" (UniqueName: \"kubernetes.io/configmap/e8b617f0-70d3-4173-9474-8d2683da7eef-edpm-extramounts\") on node \"crc\" DevicePath \"\"" Mar 16 17:29:42 crc kubenswrapper[5120]: I0316 17:29:42.867448 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e8b617f0-70d3-4173-9474-8d2683da7eef-config\") on node \"crc\" DevicePath \"\"" Mar 16 17:29:42 crc kubenswrapper[5120]: I0316 17:29:42.867460 5120 reconciler_common.go:299] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/e8b617f0-70d3-4173-9474-8d2683da7eef-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Mar 16 17:29:42 crc kubenswrapper[5120]: I0316 17:29:42.867475 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wdj4b\" (UniqueName: \"kubernetes.io/projected/e8b617f0-70d3-4173-9474-8d2683da7eef-kube-api-access-wdj4b\") on node \"crc\" DevicePath \"\"" Mar 16 17:29:43 crc kubenswrapper[5120]: I0316 17:29:43.253941 5120 generic.go:358] "Generic (PLEG): container finished" podID="e8b617f0-70d3-4173-9474-8d2683da7eef" containerID="1289897ac050a0f20f9d7144dc09811cfa21eea16520f6134b637018563a0bf3" exitCode=0 Mar 16 17:29:43 crc kubenswrapper[5120]: I0316 17:29:43.254046 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6f7d8cfdff-b2gk2" Mar 16 17:29:43 crc kubenswrapper[5120]: I0316 17:29:43.254076 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6f7d8cfdff-b2gk2" event={"ID":"e8b617f0-70d3-4173-9474-8d2683da7eef","Type":"ContainerDied","Data":"1289897ac050a0f20f9d7144dc09811cfa21eea16520f6134b637018563a0bf3"} Mar 16 17:29:43 crc kubenswrapper[5120]: I0316 17:29:43.254196 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6f7d8cfdff-b2gk2" event={"ID":"e8b617f0-70d3-4173-9474-8d2683da7eef","Type":"ContainerDied","Data":"6fa8eb6c8996602dd5604d4080f23ea094d2716ba26ca9b1305b1f3688d42951"} Mar 16 17:29:43 crc kubenswrapper[5120]: I0316 17:29:43.254226 5120 scope.go:117] "RemoveContainer" containerID="1289897ac050a0f20f9d7144dc09811cfa21eea16520f6134b637018563a0bf3" Mar 16 17:29:43 crc kubenswrapper[5120]: I0316 17:29:43.275413 5120 scope.go:117] "RemoveContainer" containerID="54b8703be34a5d59c13687294963356a6f755f53b6ae6ff95bd03e431bbc0df2" Mar 16 17:29:43 crc kubenswrapper[5120]: I0316 17:29:43.290725 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-6f7d8cfdff-b2gk2"] Mar 16 17:29:43 crc kubenswrapper[5120]: I0316 17:29:43.297342 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-6f7d8cfdff-b2gk2"] Mar 16 17:29:43 crc kubenswrapper[5120]: I0316 17:29:43.316355 5120 scope.go:117] "RemoveContainer" containerID="1289897ac050a0f20f9d7144dc09811cfa21eea16520f6134b637018563a0bf3" Mar 16 17:29:43 crc kubenswrapper[5120]: E0316 17:29:43.318954 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1289897ac050a0f20f9d7144dc09811cfa21eea16520f6134b637018563a0bf3\": container with ID starting with 1289897ac050a0f20f9d7144dc09811cfa21eea16520f6134b637018563a0bf3 not found: ID does not exist" containerID="1289897ac050a0f20f9d7144dc09811cfa21eea16520f6134b637018563a0bf3" Mar 16 17:29:43 crc kubenswrapper[5120]: I0316 17:29:43.319003 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1289897ac050a0f20f9d7144dc09811cfa21eea16520f6134b637018563a0bf3"} err="failed to get container status \"1289897ac050a0f20f9d7144dc09811cfa21eea16520f6134b637018563a0bf3\": rpc error: code = NotFound desc = could not find container \"1289897ac050a0f20f9d7144dc09811cfa21eea16520f6134b637018563a0bf3\": container with ID starting with 1289897ac050a0f20f9d7144dc09811cfa21eea16520f6134b637018563a0bf3 not found: ID does not exist" Mar 16 17:29:43 crc kubenswrapper[5120]: I0316 17:29:43.319062 5120 scope.go:117] "RemoveContainer" containerID="54b8703be34a5d59c13687294963356a6f755f53b6ae6ff95bd03e431bbc0df2" Mar 16 17:29:43 crc kubenswrapper[5120]: E0316 17:29:43.319449 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"54b8703be34a5d59c13687294963356a6f755f53b6ae6ff95bd03e431bbc0df2\": container with ID starting with 54b8703be34a5d59c13687294963356a6f755f53b6ae6ff95bd03e431bbc0df2 not found: ID does not exist" containerID="54b8703be34a5d59c13687294963356a6f755f53b6ae6ff95bd03e431bbc0df2" Mar 16 17:29:43 crc kubenswrapper[5120]: I0316 17:29:43.319473 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54b8703be34a5d59c13687294963356a6f755f53b6ae6ff95bd03e431bbc0df2"} err="failed to get container status \"54b8703be34a5d59c13687294963356a6f755f53b6ae6ff95bd03e431bbc0df2\": rpc error: code = NotFound desc = could not find container \"54b8703be34a5d59c13687294963356a6f755f53b6ae6ff95bd03e431bbc0df2\": container with ID starting with 54b8703be34a5d59c13687294963356a6f755f53b6ae6ff95bd03e431bbc0df2 not found: ID does not exist" Mar 16 17:29:43 crc kubenswrapper[5120]: I0316 17:29:43.515468 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-9fq94" Mar 16 17:29:43 crc kubenswrapper[5120]: I0316 17:29:43.581531 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5ckgn\" (UniqueName: \"kubernetes.io/projected/ef647388-3771-42f3-b7ad-f924d6bb3c3d-kube-api-access-5ckgn\") pod \"ef647388-3771-42f3-b7ad-f924d6bb3c3d\" (UID: \"ef647388-3771-42f3-b7ad-f924d6bb3c3d\") " Mar 16 17:29:43 crc kubenswrapper[5120]: I0316 17:29:43.582064 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/ef647388-3771-42f3-b7ad-f924d6bb3c3d-node-mnt\") pod \"ef647388-3771-42f3-b7ad-f924d6bb3c3d\" (UID: \"ef647388-3771-42f3-b7ad-f924d6bb3c3d\") " Mar 16 17:29:43 crc kubenswrapper[5120]: I0316 17:29:43.582238 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/ef647388-3771-42f3-b7ad-f924d6bb3c3d-node-mnt" (OuterVolumeSpecName: "node-mnt") pod "ef647388-3771-42f3-b7ad-f924d6bb3c3d" (UID: "ef647388-3771-42f3-b7ad-f924d6bb3c3d"). InnerVolumeSpecName "node-mnt". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 17:29:43 crc kubenswrapper[5120]: I0316 17:29:43.582266 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/ef647388-3771-42f3-b7ad-f924d6bb3c3d-crc-storage\") pod \"ef647388-3771-42f3-b7ad-f924d6bb3c3d\" (UID: \"ef647388-3771-42f3-b7ad-f924d6bb3c3d\") " Mar 16 17:29:43 crc kubenswrapper[5120]: I0316 17:29:43.582955 5120 reconciler_common.go:299] "Volume detached for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/ef647388-3771-42f3-b7ad-f924d6bb3c3d-node-mnt\") on node \"crc\" DevicePath \"\"" Mar 16 17:29:43 crc kubenswrapper[5120]: I0316 17:29:43.587941 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef647388-3771-42f3-b7ad-f924d6bb3c3d-kube-api-access-5ckgn" (OuterVolumeSpecName: "kube-api-access-5ckgn") pod "ef647388-3771-42f3-b7ad-f924d6bb3c3d" (UID: "ef647388-3771-42f3-b7ad-f924d6bb3c3d"). InnerVolumeSpecName "kube-api-access-5ckgn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:29:43 crc kubenswrapper[5120]: I0316 17:29:43.611342 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ef647388-3771-42f3-b7ad-f924d6bb3c3d-crc-storage" (OuterVolumeSpecName: "crc-storage") pod "ef647388-3771-42f3-b7ad-f924d6bb3c3d" (UID: "ef647388-3771-42f3-b7ad-f924d6bb3c3d"). InnerVolumeSpecName "crc-storage". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:29:43 crc kubenswrapper[5120]: I0316 17:29:43.684575 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5ckgn\" (UniqueName: \"kubernetes.io/projected/ef647388-3771-42f3-b7ad-f924d6bb3c3d-kube-api-access-5ckgn\") on node \"crc\" DevicePath \"\"" Mar 16 17:29:43 crc kubenswrapper[5120]: I0316 17:29:43.684611 5120 reconciler_common.go:299] "Volume detached for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/ef647388-3771-42f3-b7ad-f924d6bb3c3d-crc-storage\") on node \"crc\" DevicePath \"\"" Mar 16 17:29:44 crc kubenswrapper[5120]: I0316 17:29:44.278602 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-9fq94" event={"ID":"ef647388-3771-42f3-b7ad-f924d6bb3c3d","Type":"ContainerDied","Data":"b4e61187d626a199b3d737481ab86b18327f0bdc9fa83b87e9e8806b2c63caff"} Mar 16 17:29:44 crc kubenswrapper[5120]: I0316 17:29:44.278640 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b4e61187d626a199b3d737481ab86b18327f0bdc9fa83b87e9e8806b2c63caff" Mar 16 17:29:44 crc kubenswrapper[5120]: I0316 17:29:44.278703 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-9fq94" Mar 16 17:29:44 crc kubenswrapper[5120]: E0316 17:29:44.428477 5120 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podef647388_3771_42f3_b7ad_f924d6bb3c3d.slice\": RecentStats: unable to find data in memory cache]" Mar 16 17:29:44 crc kubenswrapper[5120]: I0316 17:29:44.684349 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e8b617f0-70d3-4173-9474-8d2683da7eef" path="/var/lib/kubelet/pods/e8b617f0-70d3-4173-9474-8d2683da7eef/volumes" Mar 16 17:29:45 crc kubenswrapper[5120]: I0316 17:29:45.663297 5120 scope.go:117] "RemoveContainer" containerID="df0a87b047c8208d5fc21057efed33321f6cab49c4cf053702d222dc12979450" Mar 16 17:29:45 crc kubenswrapper[5120]: E0316 17:29:45.663630 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 17:29:46 crc kubenswrapper[5120]: I0316 17:29:46.352798 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["crc-storage/crc-storage-crc-9fq94"] Mar 16 17:29:46 crc kubenswrapper[5120]: I0316 17:29:46.359291 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["crc-storage/crc-storage-crc-9fq94"] Mar 16 17:29:46 crc kubenswrapper[5120]: I0316 17:29:46.476235 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["crc-storage/crc-storage-crc-89w9t"] Mar 16 17:29:46 crc kubenswrapper[5120]: I0316 17:29:46.477466 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8b617f0-70d3-4173-9474-8d2683da7eef" containerName="dnsmasq-dns" Mar 16 17:29:46 crc kubenswrapper[5120]: I0316 17:29:46.477489 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8b617f0-70d3-4173-9474-8d2683da7eef" containerName="dnsmasq-dns" Mar 16 17:29:46 crc kubenswrapper[5120]: I0316 17:29:46.477532 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef647388-3771-42f3-b7ad-f924d6bb3c3d" containerName="storage" Mar 16 17:29:46 crc kubenswrapper[5120]: I0316 17:29:46.477539 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef647388-3771-42f3-b7ad-f924d6bb3c3d" containerName="storage" Mar 16 17:29:46 crc kubenswrapper[5120]: I0316 17:29:46.477554 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8b617f0-70d3-4173-9474-8d2683da7eef" containerName="init" Mar 16 17:29:46 crc kubenswrapper[5120]: I0316 17:29:46.477559 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8b617f0-70d3-4173-9474-8d2683da7eef" containerName="init" Mar 16 17:29:46 crc kubenswrapper[5120]: I0316 17:29:46.477675 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ef647388-3771-42f3-b7ad-f924d6bb3c3d" containerName="storage" Mar 16 17:29:46 crc kubenswrapper[5120]: I0316 17:29:46.477686 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e8b617f0-70d3-4173-9474-8d2683da7eef" containerName="dnsmasq-dns" Mar 16 17:29:46 crc kubenswrapper[5120]: I0316 17:29:46.483028 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-89w9t" Mar 16 17:29:46 crc kubenswrapper[5120]: I0316 17:29:46.483236 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-89w9t"] Mar 16 17:29:46 crc kubenswrapper[5120]: I0316 17:29:46.485460 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"crc-storage\"" Mar 16 17:29:46 crc kubenswrapper[5120]: I0316 17:29:46.485970 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"crc-storage\"/\"crc-storage-dockercfg-s2tht\"" Mar 16 17:29:46 crc kubenswrapper[5120]: I0316 17:29:46.486233 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"kube-root-ca.crt\"" Mar 16 17:29:46 crc kubenswrapper[5120]: I0316 17:29:46.486392 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"openshift-service-ca.crt\"" Mar 16 17:29:46 crc kubenswrapper[5120]: I0316 17:29:46.649171 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6znz\" (UniqueName: \"kubernetes.io/projected/80041c1e-539e-4acf-8d86-209be273da56-kube-api-access-j6znz\") pod \"crc-storage-crc-89w9t\" (UID: \"80041c1e-539e-4acf-8d86-209be273da56\") " pod="crc-storage/crc-storage-crc-89w9t" Mar 16 17:29:46 crc kubenswrapper[5120]: I0316 17:29:46.649520 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/80041c1e-539e-4acf-8d86-209be273da56-crc-storage\") pod \"crc-storage-crc-89w9t\" (UID: \"80041c1e-539e-4acf-8d86-209be273da56\") " pod="crc-storage/crc-storage-crc-89w9t" Mar 16 17:29:46 crc kubenswrapper[5120]: I0316 17:29:46.649620 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/80041c1e-539e-4acf-8d86-209be273da56-node-mnt\") pod \"crc-storage-crc-89w9t\" (UID: \"80041c1e-539e-4acf-8d86-209be273da56\") " pod="crc-storage/crc-storage-crc-89w9t" Mar 16 17:29:46 crc kubenswrapper[5120]: I0316 17:29:46.672410 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef647388-3771-42f3-b7ad-f924d6bb3c3d" path="/var/lib/kubelet/pods/ef647388-3771-42f3-b7ad-f924d6bb3c3d/volumes" Mar 16 17:29:46 crc kubenswrapper[5120]: I0316 17:29:46.751657 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j6znz\" (UniqueName: \"kubernetes.io/projected/80041c1e-539e-4acf-8d86-209be273da56-kube-api-access-j6znz\") pod \"crc-storage-crc-89w9t\" (UID: \"80041c1e-539e-4acf-8d86-209be273da56\") " pod="crc-storage/crc-storage-crc-89w9t" Mar 16 17:29:46 crc kubenswrapper[5120]: I0316 17:29:46.751898 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/80041c1e-539e-4acf-8d86-209be273da56-crc-storage\") pod \"crc-storage-crc-89w9t\" (UID: \"80041c1e-539e-4acf-8d86-209be273da56\") " pod="crc-storage/crc-storage-crc-89w9t" Mar 16 17:29:46 crc kubenswrapper[5120]: I0316 17:29:46.751966 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/80041c1e-539e-4acf-8d86-209be273da56-node-mnt\") pod \"crc-storage-crc-89w9t\" (UID: \"80041c1e-539e-4acf-8d86-209be273da56\") " pod="crc-storage/crc-storage-crc-89w9t" Mar 16 17:29:46 crc kubenswrapper[5120]: I0316 17:29:46.752323 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/80041c1e-539e-4acf-8d86-209be273da56-node-mnt\") pod \"crc-storage-crc-89w9t\" (UID: \"80041c1e-539e-4acf-8d86-209be273da56\") " pod="crc-storage/crc-storage-crc-89w9t" Mar 16 17:29:46 crc kubenswrapper[5120]: I0316 17:29:46.752593 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/80041c1e-539e-4acf-8d86-209be273da56-crc-storage\") pod \"crc-storage-crc-89w9t\" (UID: \"80041c1e-539e-4acf-8d86-209be273da56\") " pod="crc-storage/crc-storage-crc-89w9t" Mar 16 17:29:46 crc kubenswrapper[5120]: I0316 17:29:46.768998 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6znz\" (UniqueName: \"kubernetes.io/projected/80041c1e-539e-4acf-8d86-209be273da56-kube-api-access-j6znz\") pod \"crc-storage-crc-89w9t\" (UID: \"80041c1e-539e-4acf-8d86-209be273da56\") " pod="crc-storage/crc-storage-crc-89w9t" Mar 16 17:29:46 crc kubenswrapper[5120]: I0316 17:29:46.803858 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-89w9t" Mar 16 17:29:47 crc kubenswrapper[5120]: I0316 17:29:47.284467 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-89w9t"] Mar 16 17:29:47 crc kubenswrapper[5120]: I0316 17:29:47.326502 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-89w9t" event={"ID":"80041c1e-539e-4acf-8d86-209be273da56","Type":"ContainerStarted","Data":"564f8636a5ce40e25084950c270568391bce9cd2ed026977ac49687bd06bc727"} Mar 16 17:29:48 crc kubenswrapper[5120]: I0316 17:29:48.338188 5120 generic.go:358] "Generic (PLEG): container finished" podID="80041c1e-539e-4acf-8d86-209be273da56" containerID="f317cbc1a8a839cda1140c0d70ddda60919b4fdd6a15c967b9ce836aadb0f34a" exitCode=0 Mar 16 17:29:48 crc kubenswrapper[5120]: I0316 17:29:48.338244 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-89w9t" event={"ID":"80041c1e-539e-4acf-8d86-209be273da56","Type":"ContainerDied","Data":"f317cbc1a8a839cda1140c0d70ddda60919b4fdd6a15c967b9ce836aadb0f34a"} Mar 16 17:29:49 crc kubenswrapper[5120]: I0316 17:29:49.660381 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-89w9t" Mar 16 17:29:49 crc kubenswrapper[5120]: I0316 17:29:49.709437 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j6znz\" (UniqueName: \"kubernetes.io/projected/80041c1e-539e-4acf-8d86-209be273da56-kube-api-access-j6znz\") pod \"80041c1e-539e-4acf-8d86-209be273da56\" (UID: \"80041c1e-539e-4acf-8d86-209be273da56\") " Mar 16 17:29:49 crc kubenswrapper[5120]: I0316 17:29:49.709601 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/80041c1e-539e-4acf-8d86-209be273da56-crc-storage\") pod \"80041c1e-539e-4acf-8d86-209be273da56\" (UID: \"80041c1e-539e-4acf-8d86-209be273da56\") " Mar 16 17:29:49 crc kubenswrapper[5120]: I0316 17:29:49.709778 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/80041c1e-539e-4acf-8d86-209be273da56-node-mnt\") pod \"80041c1e-539e-4acf-8d86-209be273da56\" (UID: \"80041c1e-539e-4acf-8d86-209be273da56\") " Mar 16 17:29:49 crc kubenswrapper[5120]: I0316 17:29:49.710153 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/80041c1e-539e-4acf-8d86-209be273da56-node-mnt" (OuterVolumeSpecName: "node-mnt") pod "80041c1e-539e-4acf-8d86-209be273da56" (UID: "80041c1e-539e-4acf-8d86-209be273da56"). InnerVolumeSpecName "node-mnt". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 17:29:49 crc kubenswrapper[5120]: I0316 17:29:49.712362 5120 reconciler_common.go:299] "Volume detached for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/80041c1e-539e-4acf-8d86-209be273da56-node-mnt\") on node \"crc\" DevicePath \"\"" Mar 16 17:29:49 crc kubenswrapper[5120]: I0316 17:29:49.719057 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80041c1e-539e-4acf-8d86-209be273da56-kube-api-access-j6znz" (OuterVolumeSpecName: "kube-api-access-j6znz") pod "80041c1e-539e-4acf-8d86-209be273da56" (UID: "80041c1e-539e-4acf-8d86-209be273da56"). InnerVolumeSpecName "kube-api-access-j6znz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:29:49 crc kubenswrapper[5120]: I0316 17:29:49.738923 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80041c1e-539e-4acf-8d86-209be273da56-crc-storage" (OuterVolumeSpecName: "crc-storage") pod "80041c1e-539e-4acf-8d86-209be273da56" (UID: "80041c1e-539e-4acf-8d86-209be273da56"). InnerVolumeSpecName "crc-storage". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:29:49 crc kubenswrapper[5120]: I0316 17:29:49.814632 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j6znz\" (UniqueName: \"kubernetes.io/projected/80041c1e-539e-4acf-8d86-209be273da56-kube-api-access-j6znz\") on node \"crc\" DevicePath \"\"" Mar 16 17:29:49 crc kubenswrapper[5120]: I0316 17:29:49.814673 5120 reconciler_common.go:299] "Volume detached for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/80041c1e-539e-4acf-8d86-209be273da56-crc-storage\") on node \"crc\" DevicePath \"\"" Mar 16 17:29:50 crc kubenswrapper[5120]: I0316 17:29:50.354477 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-89w9t" Mar 16 17:29:50 crc kubenswrapper[5120]: I0316 17:29:50.354477 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-89w9t" event={"ID":"80041c1e-539e-4acf-8d86-209be273da56","Type":"ContainerDied","Data":"564f8636a5ce40e25084950c270568391bce9cd2ed026977ac49687bd06bc727"} Mar 16 17:29:50 crc kubenswrapper[5120]: I0316 17:29:50.354693 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="564f8636a5ce40e25084950c270568391bce9cd2ed026977ac49687bd06bc727" Mar 16 17:29:52 crc kubenswrapper[5120]: I0316 17:29:52.738619 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-7ff48f6fd9-mj5nh"] Mar 16 17:29:52 crc kubenswrapper[5120]: I0316 17:29:52.740571 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80041c1e-539e-4acf-8d86-209be273da56" containerName="storage" Mar 16 17:29:52 crc kubenswrapper[5120]: I0316 17:29:52.740608 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="80041c1e-539e-4acf-8d86-209be273da56" containerName="storage" Mar 16 17:29:52 crc kubenswrapper[5120]: I0316 17:29:52.741454 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="80041c1e-539e-4acf-8d86-209be273da56" containerName="storage" Mar 16 17:29:52 crc kubenswrapper[5120]: I0316 17:29:52.748370 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7ff48f6fd9-mj5nh" Mar 16 17:29:52 crc kubenswrapper[5120]: I0316 17:29:52.748628 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-7ff48f6fd9-mj5nh"] Mar 16 17:29:52 crc kubenswrapper[5120]: I0316 17:29:52.751407 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-edpm-multinode\"" Mar 16 17:29:52 crc kubenswrapper[5120]: I0316 17:29:52.880828 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-edpm-multinode\" (UniqueName: \"kubernetes.io/configmap/79080511-9e73-44c8-afd5-8fccad9a224d-openstack-edpm-multinode\") pod \"dnsmasq-dnsmasq-7ff48f6fd9-mj5nh\" (UID: \"79080511-9e73-44c8-afd5-8fccad9a224d\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7ff48f6fd9-mj5nh" Mar 16 17:29:52 crc kubenswrapper[5120]: I0316 17:29:52.881043 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/79080511-9e73-44c8-afd5-8fccad9a224d-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-7ff48f6fd9-mj5nh\" (UID: \"79080511-9e73-44c8-afd5-8fccad9a224d\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7ff48f6fd9-mj5nh" Mar 16 17:29:52 crc kubenswrapper[5120]: I0316 17:29:52.881202 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwhvn\" (UniqueName: \"kubernetes.io/projected/79080511-9e73-44c8-afd5-8fccad9a224d-kube-api-access-mwhvn\") pod \"dnsmasq-dnsmasq-7ff48f6fd9-mj5nh\" (UID: \"79080511-9e73-44c8-afd5-8fccad9a224d\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7ff48f6fd9-mj5nh" Mar 16 17:29:52 crc kubenswrapper[5120]: I0316 17:29:52.881655 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/79080511-9e73-44c8-afd5-8fccad9a224d-config\") pod \"dnsmasq-dnsmasq-7ff48f6fd9-mj5nh\" (UID: \"79080511-9e73-44c8-afd5-8fccad9a224d\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7ff48f6fd9-mj5nh" Mar 16 17:29:52 crc kubenswrapper[5120]: I0316 17:29:52.887298 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-7ff48f6fd9-mj5nh"] Mar 16 17:29:52 crc kubenswrapper[5120]: E0316 17:29:52.887876 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[config dnsmasq-svc kube-api-access-mwhvn openstack-edpm-multinode], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7ff48f6fd9-mj5nh" podUID="79080511-9e73-44c8-afd5-8fccad9a224d" Mar 16 17:29:52 crc kubenswrapper[5120]: I0316 17:29:52.917301 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-7d69f65899-mq89f"] Mar 16 17:29:52 crc kubenswrapper[5120]: I0316 17:29:52.930651 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7d69f65899-mq89f" Mar 16 17:29:52 crc kubenswrapper[5120]: I0316 17:29:52.949972 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-7d69f65899-mq89f"] Mar 16 17:29:52 crc kubenswrapper[5120]: I0316 17:29:52.984582 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mwhvn\" (UniqueName: \"kubernetes.io/projected/79080511-9e73-44c8-afd5-8fccad9a224d-kube-api-access-mwhvn\") pod \"dnsmasq-dnsmasq-7ff48f6fd9-mj5nh\" (UID: \"79080511-9e73-44c8-afd5-8fccad9a224d\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7ff48f6fd9-mj5nh" Mar 16 17:29:52 crc kubenswrapper[5120]: I0316 17:29:52.984833 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/79080511-9e73-44c8-afd5-8fccad9a224d-config\") pod \"dnsmasq-dnsmasq-7ff48f6fd9-mj5nh\" (UID: \"79080511-9e73-44c8-afd5-8fccad9a224d\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7ff48f6fd9-mj5nh" Mar 16 17:29:52 crc kubenswrapper[5120]: I0316 17:29:52.984988 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openstack-edpm-multinode\" (UniqueName: \"kubernetes.io/configmap/79080511-9e73-44c8-afd5-8fccad9a224d-openstack-edpm-multinode\") pod \"dnsmasq-dnsmasq-7ff48f6fd9-mj5nh\" (UID: \"79080511-9e73-44c8-afd5-8fccad9a224d\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7ff48f6fd9-mj5nh" Mar 16 17:29:52 crc kubenswrapper[5120]: I0316 17:29:52.985046 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/79080511-9e73-44c8-afd5-8fccad9a224d-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-7ff48f6fd9-mj5nh\" (UID: \"79080511-9e73-44c8-afd5-8fccad9a224d\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7ff48f6fd9-mj5nh" Mar 16 17:29:52 crc kubenswrapper[5120]: I0316 17:29:52.986620 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/79080511-9e73-44c8-afd5-8fccad9a224d-config\") pod \"dnsmasq-dnsmasq-7ff48f6fd9-mj5nh\" (UID: \"79080511-9e73-44c8-afd5-8fccad9a224d\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7ff48f6fd9-mj5nh" Mar 16 17:29:52 crc kubenswrapper[5120]: I0316 17:29:52.986811 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openstack-edpm-multinode\" (UniqueName: \"kubernetes.io/configmap/79080511-9e73-44c8-afd5-8fccad9a224d-openstack-edpm-multinode\") pod \"dnsmasq-dnsmasq-7ff48f6fd9-mj5nh\" (UID: \"79080511-9e73-44c8-afd5-8fccad9a224d\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7ff48f6fd9-mj5nh" Mar 16 17:29:52 crc kubenswrapper[5120]: I0316 17:29:52.986991 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/79080511-9e73-44c8-afd5-8fccad9a224d-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-7ff48f6fd9-mj5nh\" (UID: \"79080511-9e73-44c8-afd5-8fccad9a224d\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7ff48f6fd9-mj5nh" Mar 16 17:29:53 crc kubenswrapper[5120]: I0316 17:29:53.005974 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwhvn\" (UniqueName: \"kubernetes.io/projected/79080511-9e73-44c8-afd5-8fccad9a224d-kube-api-access-mwhvn\") pod \"dnsmasq-dnsmasq-7ff48f6fd9-mj5nh\" (UID: \"79080511-9e73-44c8-afd5-8fccad9a224d\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7ff48f6fd9-mj5nh" Mar 16 17:29:53 crc kubenswrapper[5120]: I0316 17:29:53.086895 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9cd6d9f8-2abb-46ad-816c-a7aa2079e932-config\") pod \"dnsmasq-dnsmasq-7d69f65899-mq89f\" (UID: \"9cd6d9f8-2abb-46ad-816c-a7aa2079e932\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7d69f65899-mq89f" Mar 16 17:29:53 crc kubenswrapper[5120]: I0316 17:29:53.087078 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-edpm-multinode\" (UniqueName: \"kubernetes.io/configmap/9cd6d9f8-2abb-46ad-816c-a7aa2079e932-openstack-edpm-multinode\") pod \"dnsmasq-dnsmasq-7d69f65899-mq89f\" (UID: \"9cd6d9f8-2abb-46ad-816c-a7aa2079e932\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7d69f65899-mq89f" Mar 16 17:29:53 crc kubenswrapper[5120]: I0316 17:29:53.087122 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-946zk\" (UniqueName: \"kubernetes.io/projected/9cd6d9f8-2abb-46ad-816c-a7aa2079e932-kube-api-access-946zk\") pod \"dnsmasq-dnsmasq-7d69f65899-mq89f\" (UID: \"9cd6d9f8-2abb-46ad-816c-a7aa2079e932\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7d69f65899-mq89f" Mar 16 17:29:53 crc kubenswrapper[5120]: I0316 17:29:53.087312 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/9cd6d9f8-2abb-46ad-816c-a7aa2079e932-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-7d69f65899-mq89f\" (UID: \"9cd6d9f8-2abb-46ad-816c-a7aa2079e932\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7d69f65899-mq89f" Mar 16 17:29:53 crc kubenswrapper[5120]: I0316 17:29:53.189870 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9cd6d9f8-2abb-46ad-816c-a7aa2079e932-config\") pod \"dnsmasq-dnsmasq-7d69f65899-mq89f\" (UID: \"9cd6d9f8-2abb-46ad-816c-a7aa2079e932\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7d69f65899-mq89f" Mar 16 17:29:53 crc kubenswrapper[5120]: I0316 17:29:53.190048 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openstack-edpm-multinode\" (UniqueName: \"kubernetes.io/configmap/9cd6d9f8-2abb-46ad-816c-a7aa2079e932-openstack-edpm-multinode\") pod \"dnsmasq-dnsmasq-7d69f65899-mq89f\" (UID: \"9cd6d9f8-2abb-46ad-816c-a7aa2079e932\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7d69f65899-mq89f" Mar 16 17:29:53 crc kubenswrapper[5120]: I0316 17:29:53.190110 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-946zk\" (UniqueName: \"kubernetes.io/projected/9cd6d9f8-2abb-46ad-816c-a7aa2079e932-kube-api-access-946zk\") pod \"dnsmasq-dnsmasq-7d69f65899-mq89f\" (UID: \"9cd6d9f8-2abb-46ad-816c-a7aa2079e932\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7d69f65899-mq89f" Mar 16 17:29:53 crc kubenswrapper[5120]: I0316 17:29:53.190187 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/9cd6d9f8-2abb-46ad-816c-a7aa2079e932-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-7d69f65899-mq89f\" (UID: \"9cd6d9f8-2abb-46ad-816c-a7aa2079e932\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7d69f65899-mq89f" Mar 16 17:29:53 crc kubenswrapper[5120]: I0316 17:29:53.190954 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9cd6d9f8-2abb-46ad-816c-a7aa2079e932-config\") pod \"dnsmasq-dnsmasq-7d69f65899-mq89f\" (UID: \"9cd6d9f8-2abb-46ad-816c-a7aa2079e932\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7d69f65899-mq89f" Mar 16 17:29:53 crc kubenswrapper[5120]: I0316 17:29:53.191076 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/9cd6d9f8-2abb-46ad-816c-a7aa2079e932-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-7d69f65899-mq89f\" (UID: \"9cd6d9f8-2abb-46ad-816c-a7aa2079e932\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7d69f65899-mq89f" Mar 16 17:29:53 crc kubenswrapper[5120]: I0316 17:29:53.191075 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openstack-edpm-multinode\" (UniqueName: \"kubernetes.io/configmap/9cd6d9f8-2abb-46ad-816c-a7aa2079e932-openstack-edpm-multinode\") pod \"dnsmasq-dnsmasq-7d69f65899-mq89f\" (UID: \"9cd6d9f8-2abb-46ad-816c-a7aa2079e932\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7d69f65899-mq89f" Mar 16 17:29:53 crc kubenswrapper[5120]: I0316 17:29:53.207042 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-946zk\" (UniqueName: \"kubernetes.io/projected/9cd6d9f8-2abb-46ad-816c-a7aa2079e932-kube-api-access-946zk\") pod \"dnsmasq-dnsmasq-7d69f65899-mq89f\" (UID: \"9cd6d9f8-2abb-46ad-816c-a7aa2079e932\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7d69f65899-mq89f" Mar 16 17:29:53 crc kubenswrapper[5120]: I0316 17:29:53.268417 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7d69f65899-mq89f" Mar 16 17:29:53 crc kubenswrapper[5120]: I0316 17:29:53.380373 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7ff48f6fd9-mj5nh" Mar 16 17:29:53 crc kubenswrapper[5120]: I0316 17:29:53.393479 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7ff48f6fd9-mj5nh" Mar 16 17:29:53 crc kubenswrapper[5120]: I0316 17:29:53.495689 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/79080511-9e73-44c8-afd5-8fccad9a224d-config\") pod \"79080511-9e73-44c8-afd5-8fccad9a224d\" (UID: \"79080511-9e73-44c8-afd5-8fccad9a224d\") " Mar 16 17:29:53 crc kubenswrapper[5120]: I0316 17:29:53.495837 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"openstack-edpm-multinode\" (UniqueName: \"kubernetes.io/configmap/79080511-9e73-44c8-afd5-8fccad9a224d-openstack-edpm-multinode\") pod \"79080511-9e73-44c8-afd5-8fccad9a224d\" (UID: \"79080511-9e73-44c8-afd5-8fccad9a224d\") " Mar 16 17:29:53 crc kubenswrapper[5120]: I0316 17:29:53.495868 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/79080511-9e73-44c8-afd5-8fccad9a224d-dnsmasq-svc\") pod \"79080511-9e73-44c8-afd5-8fccad9a224d\" (UID: \"79080511-9e73-44c8-afd5-8fccad9a224d\") " Mar 16 17:29:53 crc kubenswrapper[5120]: I0316 17:29:53.495918 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mwhvn\" (UniqueName: \"kubernetes.io/projected/79080511-9e73-44c8-afd5-8fccad9a224d-kube-api-access-mwhvn\") pod \"79080511-9e73-44c8-afd5-8fccad9a224d\" (UID: \"79080511-9e73-44c8-afd5-8fccad9a224d\") " Mar 16 17:29:53 crc kubenswrapper[5120]: I0316 17:29:53.496371 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/79080511-9e73-44c8-afd5-8fccad9a224d-config" (OuterVolumeSpecName: "config") pod "79080511-9e73-44c8-afd5-8fccad9a224d" (UID: "79080511-9e73-44c8-afd5-8fccad9a224d"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:29:53 crc kubenswrapper[5120]: I0316 17:29:53.496669 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/79080511-9e73-44c8-afd5-8fccad9a224d-openstack-edpm-multinode" (OuterVolumeSpecName: "openstack-edpm-multinode") pod "79080511-9e73-44c8-afd5-8fccad9a224d" (UID: "79080511-9e73-44c8-afd5-8fccad9a224d"). InnerVolumeSpecName "openstack-edpm-multinode". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:29:53 crc kubenswrapper[5120]: I0316 17:29:53.496725 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/79080511-9e73-44c8-afd5-8fccad9a224d-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "79080511-9e73-44c8-afd5-8fccad9a224d" (UID: "79080511-9e73-44c8-afd5-8fccad9a224d"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:29:53 crc kubenswrapper[5120]: I0316 17:29:53.496895 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/79080511-9e73-44c8-afd5-8fccad9a224d-config\") on node \"crc\" DevicePath \"\"" Mar 16 17:29:53 crc kubenswrapper[5120]: I0316 17:29:53.496917 5120 reconciler_common.go:299] "Volume detached for volume \"openstack-edpm-multinode\" (UniqueName: \"kubernetes.io/configmap/79080511-9e73-44c8-afd5-8fccad9a224d-openstack-edpm-multinode\") on node \"crc\" DevicePath \"\"" Mar 16 17:29:53 crc kubenswrapper[5120]: I0316 17:29:53.496927 5120 reconciler_common.go:299] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/79080511-9e73-44c8-afd5-8fccad9a224d-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Mar 16 17:29:53 crc kubenswrapper[5120]: I0316 17:29:53.500530 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79080511-9e73-44c8-afd5-8fccad9a224d-kube-api-access-mwhvn" (OuterVolumeSpecName: "kube-api-access-mwhvn") pod "79080511-9e73-44c8-afd5-8fccad9a224d" (UID: "79080511-9e73-44c8-afd5-8fccad9a224d"). InnerVolumeSpecName "kube-api-access-mwhvn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:29:53 crc kubenswrapper[5120]: I0316 17:29:53.599210 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mwhvn\" (UniqueName: \"kubernetes.io/projected/79080511-9e73-44c8-afd5-8fccad9a224d-kube-api-access-mwhvn\") on node \"crc\" DevicePath \"\"" Mar 16 17:29:53 crc kubenswrapper[5120]: I0316 17:29:53.694357 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-7d69f65899-mq89f"] Mar 16 17:29:54 crc kubenswrapper[5120]: I0316 17:29:54.391622 5120 generic.go:358] "Generic (PLEG): container finished" podID="9cd6d9f8-2abb-46ad-816c-a7aa2079e932" containerID="97f4cdd7e2a9ffecd61f56ae71bf2aa6307a47513ecda8f5d7c6fcc3b97a55d2" exitCode=0 Mar 16 17:29:54 crc kubenswrapper[5120]: I0316 17:29:54.391708 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7d69f65899-mq89f" event={"ID":"9cd6d9f8-2abb-46ad-816c-a7aa2079e932","Type":"ContainerDied","Data":"97f4cdd7e2a9ffecd61f56ae71bf2aa6307a47513ecda8f5d7c6fcc3b97a55d2"} Mar 16 17:29:54 crc kubenswrapper[5120]: I0316 17:29:54.393027 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7d69f65899-mq89f" event={"ID":"9cd6d9f8-2abb-46ad-816c-a7aa2079e932","Type":"ContainerStarted","Data":"3d0c0faace67b87ecbc1ce4be32b0826a6fa71a06d4d6feacc64db4e79687252"} Mar 16 17:29:54 crc kubenswrapper[5120]: I0316 17:29:54.393928 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7ff48f6fd9-mj5nh" Mar 16 17:29:54 crc kubenswrapper[5120]: I0316 17:29:54.562232 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-7ff48f6fd9-mj5nh"] Mar 16 17:29:54 crc kubenswrapper[5120]: I0316 17:29:54.567869 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-7ff48f6fd9-mj5nh"] Mar 16 17:29:54 crc kubenswrapper[5120]: E0316 17:29:54.592921 5120 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod79080511_9e73_44c8_afd5_8fccad9a224d.slice\": RecentStats: unable to find data in memory cache]" Mar 16 17:29:54 crc kubenswrapper[5120]: I0316 17:29:54.671822 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="79080511-9e73-44c8-afd5-8fccad9a224d" path="/var/lib/kubelet/pods/79080511-9e73-44c8-afd5-8fccad9a224d/volumes" Mar 16 17:29:55 crc kubenswrapper[5120]: I0316 17:29:55.405820 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7d69f65899-mq89f" event={"ID":"9cd6d9f8-2abb-46ad-816c-a7aa2079e932","Type":"ContainerStarted","Data":"ffccea56550d1c8feb8974cae3a8f6e42f846f3ab5ab1f3c8324d7fa63a2dca9"} Mar 16 17:29:55 crc kubenswrapper[5120]: I0316 17:29:55.406815 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7d69f65899-mq89f" Mar 16 17:29:55 crc kubenswrapper[5120]: I0316 17:29:55.425465 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7d69f65899-mq89f" podStartSLOduration=3.425446013 podStartE2EDuration="3.425446013s" podCreationTimestamp="2026-03-16 17:29:52 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:29:55.42315046 +0000 UTC m=+7097.577082117" watchObservedRunningTime="2026-03-16 17:29:55.425446013 +0000 UTC m=+7097.579377670" Mar 16 17:29:58 crc kubenswrapper[5120]: I0316 17:29:58.672411 5120 scope.go:117] "RemoveContainer" containerID="df0a87b047c8208d5fc21057efed33321f6cab49c4cf053702d222dc12979450" Mar 16 17:29:58 crc kubenswrapper[5120]: E0316 17:29:58.673262 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 17:30:00 crc kubenswrapper[5120]: I0316 17:30:00.138540 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-infra/auto-csr-approver-29561370-nx5tw"] Mar 16 17:30:00 crc kubenswrapper[5120]: I0316 17:30:00.208457 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29561370-bs8d6"] Mar 16 17:30:00 crc kubenswrapper[5120]: I0316 17:30:00.208635 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561370-nx5tw" Mar 16 17:30:00 crc kubenswrapper[5120]: I0316 17:30:00.211095 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"openshift-service-ca.crt\"" Mar 16 17:30:00 crc kubenswrapper[5120]: I0316 17:30:00.211308 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-infra\"/\"csr-approver-sa-dockercfg-x2nsz\"" Mar 16 17:30:00 crc kubenswrapper[5120]: I0316 17:30:00.211458 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"kube-root-ca.crt\"" Mar 16 17:30:00 crc kubenswrapper[5120]: I0316 17:30:00.213869 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29561370-bs8d6"] Mar 16 17:30:00 crc kubenswrapper[5120]: I0316 17:30:00.213913 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561370-nx5tw"] Mar 16 17:30:00 crc kubenswrapper[5120]: I0316 17:30:00.214009 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29561370-bs8d6" Mar 16 17:30:00 crc kubenswrapper[5120]: I0316 17:30:00.215676 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operator-lifecycle-manager\"/\"collect-profiles-dockercfg-vfqp6\"" Mar 16 17:30:00 crc kubenswrapper[5120]: I0316 17:30:00.216968 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operator-lifecycle-manager\"/\"collect-profiles-config\"" Mar 16 17:30:00 crc kubenswrapper[5120]: I0316 17:30:00.356187 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drsb2\" (UniqueName: \"kubernetes.io/projected/5c86e884-f840-490e-a1bc-d348dbbcbf55-kube-api-access-drsb2\") pod \"collect-profiles-29561370-bs8d6\" (UID: \"5c86e884-f840-490e-a1bc-d348dbbcbf55\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561370-bs8d6" Mar 16 17:30:00 crc kubenswrapper[5120]: I0316 17:30:00.356305 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5c86e884-f840-490e-a1bc-d348dbbcbf55-config-volume\") pod \"collect-profiles-29561370-bs8d6\" (UID: \"5c86e884-f840-490e-a1bc-d348dbbcbf55\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561370-bs8d6" Mar 16 17:30:00 crc kubenswrapper[5120]: I0316 17:30:00.356373 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/5c86e884-f840-490e-a1bc-d348dbbcbf55-secret-volume\") pod \"collect-profiles-29561370-bs8d6\" (UID: \"5c86e884-f840-490e-a1bc-d348dbbcbf55\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561370-bs8d6" Mar 16 17:30:00 crc kubenswrapper[5120]: I0316 17:30:00.356572 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9m6v\" (UniqueName: \"kubernetes.io/projected/ec8b3ad4-d6ad-4340-bd11-a2f30caec2cc-kube-api-access-t9m6v\") pod \"auto-csr-approver-29561370-nx5tw\" (UID: \"ec8b3ad4-d6ad-4340-bd11-a2f30caec2cc\") " pod="openshift-infra/auto-csr-approver-29561370-nx5tw" Mar 16 17:30:00 crc kubenswrapper[5120]: I0316 17:30:00.458025 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-drsb2\" (UniqueName: \"kubernetes.io/projected/5c86e884-f840-490e-a1bc-d348dbbcbf55-kube-api-access-drsb2\") pod \"collect-profiles-29561370-bs8d6\" (UID: \"5c86e884-f840-490e-a1bc-d348dbbcbf55\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561370-bs8d6" Mar 16 17:30:00 crc kubenswrapper[5120]: I0316 17:30:00.458167 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5c86e884-f840-490e-a1bc-d348dbbcbf55-config-volume\") pod \"collect-profiles-29561370-bs8d6\" (UID: \"5c86e884-f840-490e-a1bc-d348dbbcbf55\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561370-bs8d6" Mar 16 17:30:00 crc kubenswrapper[5120]: I0316 17:30:00.458219 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/5c86e884-f840-490e-a1bc-d348dbbcbf55-secret-volume\") pod \"collect-profiles-29561370-bs8d6\" (UID: \"5c86e884-f840-490e-a1bc-d348dbbcbf55\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561370-bs8d6" Mar 16 17:30:00 crc kubenswrapper[5120]: I0316 17:30:00.458338 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t9m6v\" (UniqueName: \"kubernetes.io/projected/ec8b3ad4-d6ad-4340-bd11-a2f30caec2cc-kube-api-access-t9m6v\") pod \"auto-csr-approver-29561370-nx5tw\" (UID: \"ec8b3ad4-d6ad-4340-bd11-a2f30caec2cc\") " pod="openshift-infra/auto-csr-approver-29561370-nx5tw" Mar 16 17:30:00 crc kubenswrapper[5120]: I0316 17:30:00.459217 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5c86e884-f840-490e-a1bc-d348dbbcbf55-config-volume\") pod \"collect-profiles-29561370-bs8d6\" (UID: \"5c86e884-f840-490e-a1bc-d348dbbcbf55\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561370-bs8d6" Mar 16 17:30:00 crc kubenswrapper[5120]: I0316 17:30:00.470703 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/5c86e884-f840-490e-a1bc-d348dbbcbf55-secret-volume\") pod \"collect-profiles-29561370-bs8d6\" (UID: \"5c86e884-f840-490e-a1bc-d348dbbcbf55\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561370-bs8d6" Mar 16 17:30:00 crc kubenswrapper[5120]: I0316 17:30:00.474353 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9m6v\" (UniqueName: \"kubernetes.io/projected/ec8b3ad4-d6ad-4340-bd11-a2f30caec2cc-kube-api-access-t9m6v\") pod \"auto-csr-approver-29561370-nx5tw\" (UID: \"ec8b3ad4-d6ad-4340-bd11-a2f30caec2cc\") " pod="openshift-infra/auto-csr-approver-29561370-nx5tw" Mar 16 17:30:00 crc kubenswrapper[5120]: I0316 17:30:00.476572 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-drsb2\" (UniqueName: \"kubernetes.io/projected/5c86e884-f840-490e-a1bc-d348dbbcbf55-kube-api-access-drsb2\") pod \"collect-profiles-29561370-bs8d6\" (UID: \"5c86e884-f840-490e-a1bc-d348dbbcbf55\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561370-bs8d6" Mar 16 17:30:00 crc kubenswrapper[5120]: I0316 17:30:00.531883 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561370-nx5tw" Mar 16 17:30:00 crc kubenswrapper[5120]: I0316 17:30:00.550083 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29561370-bs8d6" Mar 16 17:30:00 crc kubenswrapper[5120]: I0316 17:30:00.950005 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561370-nx5tw"] Mar 16 17:30:01 crc kubenswrapper[5120]: I0316 17:30:01.032357 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29561370-bs8d6"] Mar 16 17:30:01 crc kubenswrapper[5120]: W0316 17:30:01.034738 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c86e884_f840_490e_a1bc_d348dbbcbf55.slice/crio-c43cff17c516b69de973f2d91a9d885227a1433d1c6505b6794675f1906e97c9 WatchSource:0}: Error finding container c43cff17c516b69de973f2d91a9d885227a1433d1c6505b6794675f1906e97c9: Status 404 returned error can't find the container with id c43cff17c516b69de973f2d91a9d885227a1433d1c6505b6794675f1906e97c9 Mar 16 17:30:01 crc kubenswrapper[5120]: I0316 17:30:01.414963 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7d69f65899-mq89f" Mar 16 17:30:01 crc kubenswrapper[5120]: I0316 17:30:01.477430 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561370-nx5tw" event={"ID":"ec8b3ad4-d6ad-4340-bd11-a2f30caec2cc","Type":"ContainerStarted","Data":"0bd8383f7e11faea0794ed836a73516dcc0d9d4ebda3f7de2da348e6a3c7aeef"} Mar 16 17:30:01 crc kubenswrapper[5120]: I0316 17:30:01.481047 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-jbbpm"] Mar 16 17:30:01 crc kubenswrapper[5120]: I0316 17:30:01.481328 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-jbbpm" podUID="efc4931c-21e8-49a4-957a-8436dfcd49b0" containerName="dnsmasq-dns" containerID="cri-o://2bf51a5ea5c74f87ab5a29652860d87cd8965b05fc48e226057c888c7b702dc4" gracePeriod=10 Mar 16 17:30:01 crc kubenswrapper[5120]: I0316 17:30:01.481331 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/collect-profiles-29561370-bs8d6" event={"ID":"5c86e884-f840-490e-a1bc-d348dbbcbf55","Type":"ContainerStarted","Data":"1f9fe8dc0a2128a2648e1c5d77f328409f7f02cfd9417a6f0afced687561a086"} Mar 16 17:30:01 crc kubenswrapper[5120]: I0316 17:30:01.481443 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/collect-profiles-29561370-bs8d6" event={"ID":"5c86e884-f840-490e-a1bc-d348dbbcbf55","Type":"ContainerStarted","Data":"c43cff17c516b69de973f2d91a9d885227a1433d1c6505b6794675f1906e97c9"} Mar 16 17:30:01 crc kubenswrapper[5120]: I0316 17:30:01.513157 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operator-lifecycle-manager/collect-profiles-29561370-bs8d6" podStartSLOduration=1.513138858 podStartE2EDuration="1.513138858s" podCreationTimestamp="2026-03-16 17:30:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:30:01.502943091 +0000 UTC m=+7103.656874758" watchObservedRunningTime="2026-03-16 17:30:01.513138858 +0000 UTC m=+7103.667070515" Mar 16 17:30:01 crc kubenswrapper[5120]: I0316 17:30:01.889463 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-jbbpm" Mar 16 17:30:01 crc kubenswrapper[5120]: I0316 17:30:01.992219 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/efc4931c-21e8-49a4-957a-8436dfcd49b0-config\") pod \"efc4931c-21e8-49a4-957a-8436dfcd49b0\" (UID: \"efc4931c-21e8-49a4-957a-8436dfcd49b0\") " Mar 16 17:30:01 crc kubenswrapper[5120]: I0316 17:30:01.992336 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/efc4931c-21e8-49a4-957a-8436dfcd49b0-dnsmasq-svc\") pod \"efc4931c-21e8-49a4-957a-8436dfcd49b0\" (UID: \"efc4931c-21e8-49a4-957a-8436dfcd49b0\") " Mar 16 17:30:01 crc kubenswrapper[5120]: I0316 17:30:01.992494 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cs64f\" (UniqueName: \"kubernetes.io/projected/efc4931c-21e8-49a4-957a-8436dfcd49b0-kube-api-access-cs64f\") pod \"efc4931c-21e8-49a4-957a-8436dfcd49b0\" (UID: \"efc4931c-21e8-49a4-957a-8436dfcd49b0\") " Mar 16 17:30:02 crc kubenswrapper[5120]: I0316 17:30:02.004673 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/efc4931c-21e8-49a4-957a-8436dfcd49b0-kube-api-access-cs64f" (OuterVolumeSpecName: "kube-api-access-cs64f") pod "efc4931c-21e8-49a4-957a-8436dfcd49b0" (UID: "efc4931c-21e8-49a4-957a-8436dfcd49b0"). InnerVolumeSpecName "kube-api-access-cs64f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:30:02 crc kubenswrapper[5120]: I0316 17:30:02.033669 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/efc4931c-21e8-49a4-957a-8436dfcd49b0-config" (OuterVolumeSpecName: "config") pod "efc4931c-21e8-49a4-957a-8436dfcd49b0" (UID: "efc4931c-21e8-49a4-957a-8436dfcd49b0"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:30:02 crc kubenswrapper[5120]: I0316 17:30:02.046962 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/efc4931c-21e8-49a4-957a-8436dfcd49b0-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "efc4931c-21e8-49a4-957a-8436dfcd49b0" (UID: "efc4931c-21e8-49a4-957a-8436dfcd49b0"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:30:02 crc kubenswrapper[5120]: I0316 17:30:02.053887 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-6b55f4579f-pqqj7"] Mar 16 17:30:02 crc kubenswrapper[5120]: I0316 17:30:02.055511 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efc4931c-21e8-49a4-957a-8436dfcd49b0" containerName="dnsmasq-dns" Mar 16 17:30:02 crc kubenswrapper[5120]: I0316 17:30:02.055591 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="efc4931c-21e8-49a4-957a-8436dfcd49b0" containerName="dnsmasq-dns" Mar 16 17:30:02 crc kubenswrapper[5120]: I0316 17:30:02.055896 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efc4931c-21e8-49a4-957a-8436dfcd49b0" containerName="init" Mar 16 17:30:02 crc kubenswrapper[5120]: I0316 17:30:02.055915 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="efc4931c-21e8-49a4-957a-8436dfcd49b0" containerName="init" Mar 16 17:30:02 crc kubenswrapper[5120]: I0316 17:30:02.056176 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="efc4931c-21e8-49a4-957a-8436dfcd49b0" containerName="dnsmasq-dns" Mar 16 17:30:02 crc kubenswrapper[5120]: I0316 17:30:02.065778 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-6b55f4579f-pqqj7"] Mar 16 17:30:02 crc kubenswrapper[5120]: I0316 17:30:02.065966 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6b55f4579f-pqqj7" Mar 16 17:30:02 crc kubenswrapper[5120]: I0316 17:30:02.095498 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/efc4931c-21e8-49a4-957a-8436dfcd49b0-config\") on node \"crc\" DevicePath \"\"" Mar 16 17:30:02 crc kubenswrapper[5120]: I0316 17:30:02.095529 5120 reconciler_common.go:299] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/efc4931c-21e8-49a4-957a-8436dfcd49b0-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Mar 16 17:30:02 crc kubenswrapper[5120]: I0316 17:30:02.095543 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cs64f\" (UniqueName: \"kubernetes.io/projected/efc4931c-21e8-49a4-957a-8436dfcd49b0-kube-api-access-cs64f\") on node \"crc\" DevicePath \"\"" Mar 16 17:30:02 crc kubenswrapper[5120]: I0316 17:30:02.197633 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3fc87b23-1582-4367-9863-06f63de043aa-config\") pod \"dnsmasq-dnsmasq-6b55f4579f-pqqj7\" (UID: \"3fc87b23-1582-4367-9863-06f63de043aa\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6b55f4579f-pqqj7" Mar 16 17:30:02 crc kubenswrapper[5120]: I0316 17:30:02.197693 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/3fc87b23-1582-4367-9863-06f63de043aa-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-6b55f4579f-pqqj7\" (UID: \"3fc87b23-1582-4367-9863-06f63de043aa\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6b55f4579f-pqqj7" Mar 16 17:30:02 crc kubenswrapper[5120]: I0316 17:30:02.198539 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-edpm-multinode\" (UniqueName: \"kubernetes.io/configmap/3fc87b23-1582-4367-9863-06f63de043aa-openstack-edpm-multinode\") pod \"dnsmasq-dnsmasq-6b55f4579f-pqqj7\" (UID: \"3fc87b23-1582-4367-9863-06f63de043aa\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6b55f4579f-pqqj7" Mar 16 17:30:02 crc kubenswrapper[5120]: I0316 17:30:02.198649 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vlq9r\" (UniqueName: \"kubernetes.io/projected/3fc87b23-1582-4367-9863-06f63de043aa-kube-api-access-vlq9r\") pod \"dnsmasq-dnsmasq-6b55f4579f-pqqj7\" (UID: \"3fc87b23-1582-4367-9863-06f63de043aa\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6b55f4579f-pqqj7" Mar 16 17:30:02 crc kubenswrapper[5120]: I0316 17:30:02.300023 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openstack-edpm-multinode\" (UniqueName: \"kubernetes.io/configmap/3fc87b23-1582-4367-9863-06f63de043aa-openstack-edpm-multinode\") pod \"dnsmasq-dnsmasq-6b55f4579f-pqqj7\" (UID: \"3fc87b23-1582-4367-9863-06f63de043aa\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6b55f4579f-pqqj7" Mar 16 17:30:02 crc kubenswrapper[5120]: I0316 17:30:02.300086 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vlq9r\" (UniqueName: \"kubernetes.io/projected/3fc87b23-1582-4367-9863-06f63de043aa-kube-api-access-vlq9r\") pod \"dnsmasq-dnsmasq-6b55f4579f-pqqj7\" (UID: \"3fc87b23-1582-4367-9863-06f63de043aa\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6b55f4579f-pqqj7" Mar 16 17:30:02 crc kubenswrapper[5120]: I0316 17:30:02.300214 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3fc87b23-1582-4367-9863-06f63de043aa-config\") pod \"dnsmasq-dnsmasq-6b55f4579f-pqqj7\" (UID: \"3fc87b23-1582-4367-9863-06f63de043aa\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6b55f4579f-pqqj7" Mar 16 17:30:02 crc kubenswrapper[5120]: I0316 17:30:02.300262 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/3fc87b23-1582-4367-9863-06f63de043aa-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-6b55f4579f-pqqj7\" (UID: \"3fc87b23-1582-4367-9863-06f63de043aa\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6b55f4579f-pqqj7" Mar 16 17:30:02 crc kubenswrapper[5120]: I0316 17:30:02.301041 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openstack-edpm-multinode\" (UniqueName: \"kubernetes.io/configmap/3fc87b23-1582-4367-9863-06f63de043aa-openstack-edpm-multinode\") pod \"dnsmasq-dnsmasq-6b55f4579f-pqqj7\" (UID: \"3fc87b23-1582-4367-9863-06f63de043aa\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6b55f4579f-pqqj7" Mar 16 17:30:02 crc kubenswrapper[5120]: I0316 17:30:02.301163 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3fc87b23-1582-4367-9863-06f63de043aa-config\") pod \"dnsmasq-dnsmasq-6b55f4579f-pqqj7\" (UID: \"3fc87b23-1582-4367-9863-06f63de043aa\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6b55f4579f-pqqj7" Mar 16 17:30:02 crc kubenswrapper[5120]: I0316 17:30:02.301410 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/3fc87b23-1582-4367-9863-06f63de043aa-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-6b55f4579f-pqqj7\" (UID: \"3fc87b23-1582-4367-9863-06f63de043aa\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6b55f4579f-pqqj7" Mar 16 17:30:02 crc kubenswrapper[5120]: I0316 17:30:02.319900 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vlq9r\" (UniqueName: \"kubernetes.io/projected/3fc87b23-1582-4367-9863-06f63de043aa-kube-api-access-vlq9r\") pod \"dnsmasq-dnsmasq-6b55f4579f-pqqj7\" (UID: \"3fc87b23-1582-4367-9863-06f63de043aa\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6b55f4579f-pqqj7" Mar 16 17:30:02 crc kubenswrapper[5120]: I0316 17:30:02.387849 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6b55f4579f-pqqj7" Mar 16 17:30:02 crc kubenswrapper[5120]: I0316 17:30:02.500998 5120 generic.go:358] "Generic (PLEG): container finished" podID="efc4931c-21e8-49a4-957a-8436dfcd49b0" containerID="2bf51a5ea5c74f87ab5a29652860d87cd8965b05fc48e226057c888c7b702dc4" exitCode=0 Mar 16 17:30:02 crc kubenswrapper[5120]: I0316 17:30:02.501074 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-jbbpm" Mar 16 17:30:02 crc kubenswrapper[5120]: I0316 17:30:02.501085 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-jbbpm" event={"ID":"efc4931c-21e8-49a4-957a-8436dfcd49b0","Type":"ContainerDied","Data":"2bf51a5ea5c74f87ab5a29652860d87cd8965b05fc48e226057c888c7b702dc4"} Mar 16 17:30:02 crc kubenswrapper[5120]: I0316 17:30:02.501160 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-jbbpm" event={"ID":"efc4931c-21e8-49a4-957a-8436dfcd49b0","Type":"ContainerDied","Data":"a561aea9dfdfcc2ec8b9e893891272616008f27ec2b295aa1efbf249bc9bd298"} Mar 16 17:30:02 crc kubenswrapper[5120]: I0316 17:30:02.501185 5120 scope.go:117] "RemoveContainer" containerID="2bf51a5ea5c74f87ab5a29652860d87cd8965b05fc48e226057c888c7b702dc4" Mar 16 17:30:02 crc kubenswrapper[5120]: I0316 17:30:02.506945 5120 generic.go:358] "Generic (PLEG): container finished" podID="5c86e884-f840-490e-a1bc-d348dbbcbf55" containerID="1f9fe8dc0a2128a2648e1c5d77f328409f7f02cfd9417a6f0afced687561a086" exitCode=0 Mar 16 17:30:02 crc kubenswrapper[5120]: I0316 17:30:02.507039 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/collect-profiles-29561370-bs8d6" event={"ID":"5c86e884-f840-490e-a1bc-d348dbbcbf55","Type":"ContainerDied","Data":"1f9fe8dc0a2128a2648e1c5d77f328409f7f02cfd9417a6f0afced687561a086"} Mar 16 17:30:02 crc kubenswrapper[5120]: I0316 17:30:02.541513 5120 scope.go:117] "RemoveContainer" containerID="ccb2c3405e558f483d532a5117458dd244cab1afacb48f81f3817273c675dad8" Mar 16 17:30:02 crc kubenswrapper[5120]: I0316 17:30:02.549338 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-jbbpm"] Mar 16 17:30:02 crc kubenswrapper[5120]: I0316 17:30:02.555026 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-jbbpm"] Mar 16 17:30:02 crc kubenswrapper[5120]: I0316 17:30:02.576020 5120 scope.go:117] "RemoveContainer" containerID="2bf51a5ea5c74f87ab5a29652860d87cd8965b05fc48e226057c888c7b702dc4" Mar 16 17:30:02 crc kubenswrapper[5120]: E0316 17:30:02.576877 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2bf51a5ea5c74f87ab5a29652860d87cd8965b05fc48e226057c888c7b702dc4\": container with ID starting with 2bf51a5ea5c74f87ab5a29652860d87cd8965b05fc48e226057c888c7b702dc4 not found: ID does not exist" containerID="2bf51a5ea5c74f87ab5a29652860d87cd8965b05fc48e226057c888c7b702dc4" Mar 16 17:30:02 crc kubenswrapper[5120]: I0316 17:30:02.576920 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2bf51a5ea5c74f87ab5a29652860d87cd8965b05fc48e226057c888c7b702dc4"} err="failed to get container status \"2bf51a5ea5c74f87ab5a29652860d87cd8965b05fc48e226057c888c7b702dc4\": rpc error: code = NotFound desc = could not find container \"2bf51a5ea5c74f87ab5a29652860d87cd8965b05fc48e226057c888c7b702dc4\": container with ID starting with 2bf51a5ea5c74f87ab5a29652860d87cd8965b05fc48e226057c888c7b702dc4 not found: ID does not exist" Mar 16 17:30:02 crc kubenswrapper[5120]: I0316 17:30:02.576967 5120 scope.go:117] "RemoveContainer" containerID="ccb2c3405e558f483d532a5117458dd244cab1afacb48f81f3817273c675dad8" Mar 16 17:30:02 crc kubenswrapper[5120]: E0316 17:30:02.577438 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ccb2c3405e558f483d532a5117458dd244cab1afacb48f81f3817273c675dad8\": container with ID starting with ccb2c3405e558f483d532a5117458dd244cab1afacb48f81f3817273c675dad8 not found: ID does not exist" containerID="ccb2c3405e558f483d532a5117458dd244cab1afacb48f81f3817273c675dad8" Mar 16 17:30:02 crc kubenswrapper[5120]: I0316 17:30:02.577487 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ccb2c3405e558f483d532a5117458dd244cab1afacb48f81f3817273c675dad8"} err="failed to get container status \"ccb2c3405e558f483d532a5117458dd244cab1afacb48f81f3817273c675dad8\": rpc error: code = NotFound desc = could not find container \"ccb2c3405e558f483d532a5117458dd244cab1afacb48f81f3817273c675dad8\": container with ID starting with ccb2c3405e558f483d532a5117458dd244cab1afacb48f81f3817273c675dad8 not found: ID does not exist" Mar 16 17:30:02 crc kubenswrapper[5120]: I0316 17:30:02.673031 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="efc4931c-21e8-49a4-957a-8436dfcd49b0" path="/var/lib/kubelet/pods/efc4931c-21e8-49a4-957a-8436dfcd49b0/volumes" Mar 16 17:30:02 crc kubenswrapper[5120]: I0316 17:30:02.808294 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-6b55f4579f-pqqj7"] Mar 16 17:30:02 crc kubenswrapper[5120]: W0316 17:30:02.812329 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3fc87b23_1582_4367_9863_06f63de043aa.slice/crio-8f5c0235f822cf5adf4e7808aec35e6d5f4fb90273114529cc2ce99a54713ae0 WatchSource:0}: Error finding container 8f5c0235f822cf5adf4e7808aec35e6d5f4fb90273114529cc2ce99a54713ae0: Status 404 returned error can't find the container with id 8f5c0235f822cf5adf4e7808aec35e6d5f4fb90273114529cc2ce99a54713ae0 Mar 16 17:30:03 crc kubenswrapper[5120]: I0316 17:30:03.524529 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561370-nx5tw" event={"ID":"ec8b3ad4-d6ad-4340-bd11-a2f30caec2cc","Type":"ContainerStarted","Data":"41c286ed2b2869abda5476705bd3651cc1782d041015733291119ad6b3d8c216"} Mar 16 17:30:03 crc kubenswrapper[5120]: I0316 17:30:03.528324 5120 generic.go:358] "Generic (PLEG): container finished" podID="3fc87b23-1582-4367-9863-06f63de043aa" containerID="3539b53375fc5fd00c6c4114b11326d2a8bffc6f508c95eddd2d5af5e514085f" exitCode=0 Mar 16 17:30:03 crc kubenswrapper[5120]: I0316 17:30:03.528402 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6b55f4579f-pqqj7" event={"ID":"3fc87b23-1582-4367-9863-06f63de043aa","Type":"ContainerDied","Data":"3539b53375fc5fd00c6c4114b11326d2a8bffc6f508c95eddd2d5af5e514085f"} Mar 16 17:30:03 crc kubenswrapper[5120]: I0316 17:30:03.528431 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6b55f4579f-pqqj7" event={"ID":"3fc87b23-1582-4367-9863-06f63de043aa","Type":"ContainerStarted","Data":"8f5c0235f822cf5adf4e7808aec35e6d5f4fb90273114529cc2ce99a54713ae0"} Mar 16 17:30:03 crc kubenswrapper[5120]: I0316 17:30:03.544856 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-infra/auto-csr-approver-29561370-nx5tw" podStartSLOduration=1.273510119 podStartE2EDuration="3.544831871s" podCreationTimestamp="2026-03-16 17:30:00 +0000 UTC" firstStartedPulling="2026-03-16 17:30:00.958810441 +0000 UTC m=+7103.112742098" lastFinishedPulling="2026-03-16 17:30:03.230132193 +0000 UTC m=+7105.384063850" observedRunningTime="2026-03-16 17:30:03.537177693 +0000 UTC m=+7105.691109350" watchObservedRunningTime="2026-03-16 17:30:03.544831871 +0000 UTC m=+7105.698763528" Mar 16 17:30:03 crc kubenswrapper[5120]: I0316 17:30:03.855656 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29561370-bs8d6" Mar 16 17:30:04 crc kubenswrapper[5120]: I0316 17:30:04.043558 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/5c86e884-f840-490e-a1bc-d348dbbcbf55-secret-volume\") pod \"5c86e884-f840-490e-a1bc-d348dbbcbf55\" (UID: \"5c86e884-f840-490e-a1bc-d348dbbcbf55\") " Mar 16 17:30:04 crc kubenswrapper[5120]: I0316 17:30:04.043712 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-drsb2\" (UniqueName: \"kubernetes.io/projected/5c86e884-f840-490e-a1bc-d348dbbcbf55-kube-api-access-drsb2\") pod \"5c86e884-f840-490e-a1bc-d348dbbcbf55\" (UID: \"5c86e884-f840-490e-a1bc-d348dbbcbf55\") " Mar 16 17:30:04 crc kubenswrapper[5120]: I0316 17:30:04.043953 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5c86e884-f840-490e-a1bc-d348dbbcbf55-config-volume\") pod \"5c86e884-f840-490e-a1bc-d348dbbcbf55\" (UID: \"5c86e884-f840-490e-a1bc-d348dbbcbf55\") " Mar 16 17:30:04 crc kubenswrapper[5120]: I0316 17:30:04.044421 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c86e884-f840-490e-a1bc-d348dbbcbf55-config-volume" (OuterVolumeSpecName: "config-volume") pod "5c86e884-f840-490e-a1bc-d348dbbcbf55" (UID: "5c86e884-f840-490e-a1bc-d348dbbcbf55"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:30:04 crc kubenswrapper[5120]: I0316 17:30:04.048448 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c86e884-f840-490e-a1bc-d348dbbcbf55-secret-volume" (OuterVolumeSpecName: "secret-volume") pod "5c86e884-f840-490e-a1bc-d348dbbcbf55" (UID: "5c86e884-f840-490e-a1bc-d348dbbcbf55"). InnerVolumeSpecName "secret-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:30:04 crc kubenswrapper[5120]: I0316 17:30:04.048816 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c86e884-f840-490e-a1bc-d348dbbcbf55-kube-api-access-drsb2" (OuterVolumeSpecName: "kube-api-access-drsb2") pod "5c86e884-f840-490e-a1bc-d348dbbcbf55" (UID: "5c86e884-f840-490e-a1bc-d348dbbcbf55"). InnerVolumeSpecName "kube-api-access-drsb2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:30:04 crc kubenswrapper[5120]: I0316 17:30:04.146028 5120 reconciler_common.go:299] "Volume detached for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/5c86e884-f840-490e-a1bc-d348dbbcbf55-secret-volume\") on node \"crc\" DevicePath \"\"" Mar 16 17:30:04 crc kubenswrapper[5120]: I0316 17:30:04.146071 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-drsb2\" (UniqueName: \"kubernetes.io/projected/5c86e884-f840-490e-a1bc-d348dbbcbf55-kube-api-access-drsb2\") on node \"crc\" DevicePath \"\"" Mar 16 17:30:04 crc kubenswrapper[5120]: I0316 17:30:04.146109 5120 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5c86e884-f840-490e-a1bc-d348dbbcbf55-config-volume\") on node \"crc\" DevicePath \"\"" Mar 16 17:30:04 crc kubenswrapper[5120]: I0316 17:30:04.546647 5120 generic.go:358] "Generic (PLEG): container finished" podID="ec8b3ad4-d6ad-4340-bd11-a2f30caec2cc" containerID="41c286ed2b2869abda5476705bd3651cc1782d041015733291119ad6b3d8c216" exitCode=0 Mar 16 17:30:04 crc kubenswrapper[5120]: I0316 17:30:04.546778 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561370-nx5tw" event={"ID":"ec8b3ad4-d6ad-4340-bd11-a2f30caec2cc","Type":"ContainerDied","Data":"41c286ed2b2869abda5476705bd3651cc1782d041015733291119ad6b3d8c216"} Mar 16 17:30:04 crc kubenswrapper[5120]: I0316 17:30:04.549791 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6b55f4579f-pqqj7" event={"ID":"3fc87b23-1582-4367-9863-06f63de043aa","Type":"ContainerStarted","Data":"f3a07edc66a03aceb2859c332464c6c9c00f86f0ac94487c825256b0e46892ea"} Mar 16 17:30:04 crc kubenswrapper[5120]: I0316 17:30:04.549870 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6b55f4579f-pqqj7" Mar 16 17:30:04 crc kubenswrapper[5120]: I0316 17:30:04.552242 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/collect-profiles-29561370-bs8d6" event={"ID":"5c86e884-f840-490e-a1bc-d348dbbcbf55","Type":"ContainerDied","Data":"c43cff17c516b69de973f2d91a9d885227a1433d1c6505b6794675f1906e97c9"} Mar 16 17:30:04 crc kubenswrapper[5120]: I0316 17:30:04.552311 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c43cff17c516b69de973f2d91a9d885227a1433d1c6505b6794675f1906e97c9" Mar 16 17:30:04 crc kubenswrapper[5120]: I0316 17:30:04.552325 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29561370-bs8d6" Mar 16 17:30:04 crc kubenswrapper[5120]: I0316 17:30:04.565491 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29561325-6tc9k"] Mar 16 17:30:04 crc kubenswrapper[5120]: I0316 17:30:04.574609 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29561325-6tc9k"] Mar 16 17:30:04 crc kubenswrapper[5120]: I0316 17:30:04.585812 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6b55f4579f-pqqj7" podStartSLOduration=2.585790168 podStartE2EDuration="2.585790168s" podCreationTimestamp="2026-03-16 17:30:02 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:30:04.576955376 +0000 UTC m=+7106.730887033" watchObservedRunningTime="2026-03-16 17:30:04.585790168 +0000 UTC m=+7106.739721825" Mar 16 17:30:04 crc kubenswrapper[5120]: I0316 17:30:04.672555 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe7dbce5-1133-445b-8a9c-05ced8fb138e" path="/var/lib/kubelet/pods/fe7dbce5-1133-445b-8a9c-05ced8fb138e/volumes" Mar 16 17:30:05 crc kubenswrapper[5120]: I0316 17:30:05.862471 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561370-nx5tw" Mar 16 17:30:05 crc kubenswrapper[5120]: I0316 17:30:05.882992 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t9m6v\" (UniqueName: \"kubernetes.io/projected/ec8b3ad4-d6ad-4340-bd11-a2f30caec2cc-kube-api-access-t9m6v\") pod \"ec8b3ad4-d6ad-4340-bd11-a2f30caec2cc\" (UID: \"ec8b3ad4-d6ad-4340-bd11-a2f30caec2cc\") " Mar 16 17:30:05 crc kubenswrapper[5120]: I0316 17:30:05.890585 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec8b3ad4-d6ad-4340-bd11-a2f30caec2cc-kube-api-access-t9m6v" (OuterVolumeSpecName: "kube-api-access-t9m6v") pod "ec8b3ad4-d6ad-4340-bd11-a2f30caec2cc" (UID: "ec8b3ad4-d6ad-4340-bd11-a2f30caec2cc"). InnerVolumeSpecName "kube-api-access-t9m6v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:30:05 crc kubenswrapper[5120]: I0316 17:30:05.986218 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t9m6v\" (UniqueName: \"kubernetes.io/projected/ec8b3ad4-d6ad-4340-bd11-a2f30caec2cc-kube-api-access-t9m6v\") on node \"crc\" DevicePath \"\"" Mar 16 17:30:06 crc kubenswrapper[5120]: I0316 17:30:06.575224 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561370-nx5tw" event={"ID":"ec8b3ad4-d6ad-4340-bd11-a2f30caec2cc","Type":"ContainerDied","Data":"0bd8383f7e11faea0794ed836a73516dcc0d9d4ebda3f7de2da348e6a3c7aeef"} Mar 16 17:30:06 crc kubenswrapper[5120]: I0316 17:30:06.575526 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0bd8383f7e11faea0794ed836a73516dcc0d9d4ebda3f7de2da348e6a3c7aeef" Mar 16 17:30:06 crc kubenswrapper[5120]: I0316 17:30:06.575591 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561370-nx5tw" Mar 16 17:30:06 crc kubenswrapper[5120]: I0316 17:30:06.588986 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-infra/auto-csr-approver-29561364-xzfp4"] Mar 16 17:30:06 crc kubenswrapper[5120]: I0316 17:30:06.596999 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-infra/auto-csr-approver-29561364-xzfp4"] Mar 16 17:30:06 crc kubenswrapper[5120]: I0316 17:30:06.701031 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6d0b509f-dfc3-4425-9706-b0c336ffc410" path="/var/lib/kubelet/pods/6d0b509f-dfc3-4425-9706-b0c336ffc410/volumes" Mar 16 17:30:07 crc kubenswrapper[5120]: E0316 17:30:07.660646 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1313420 actualBytes=10240 Mar 16 17:30:10 crc kubenswrapper[5120]: I0316 17:30:10.562016 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6b55f4579f-pqqj7" Mar 16 17:30:10 crc kubenswrapper[5120]: I0316 17:30:10.623949 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-7d69f65899-mq89f"] Mar 16 17:30:10 crc kubenswrapper[5120]: I0316 17:30:10.624211 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7d69f65899-mq89f" podUID="9cd6d9f8-2abb-46ad-816c-a7aa2079e932" containerName="dnsmasq-dns" containerID="cri-o://ffccea56550d1c8feb8974cae3a8f6e42f846f3ab5ab1f3c8324d7fa63a2dca9" gracePeriod=10 Mar 16 17:30:10 crc kubenswrapper[5120]: I0316 17:30:10.777596 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-5cc978ff9f-stcpz"] Mar 16 17:30:10 crc kubenswrapper[5120]: I0316 17:30:10.780139 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c86e884-f840-490e-a1bc-d348dbbcbf55" containerName="collect-profiles" Mar 16 17:30:10 crc kubenswrapper[5120]: I0316 17:30:10.780172 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c86e884-f840-490e-a1bc-d348dbbcbf55" containerName="collect-profiles" Mar 16 17:30:10 crc kubenswrapper[5120]: I0316 17:30:10.780227 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec8b3ad4-d6ad-4340-bd11-a2f30caec2cc" containerName="oc" Mar 16 17:30:10 crc kubenswrapper[5120]: I0316 17:30:10.780236 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec8b3ad4-d6ad-4340-bd11-a2f30caec2cc" containerName="oc" Mar 16 17:30:10 crc kubenswrapper[5120]: I0316 17:30:10.780989 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="5c86e884-f840-490e-a1bc-d348dbbcbf55" containerName="collect-profiles" Mar 16 17:30:10 crc kubenswrapper[5120]: I0316 17:30:10.781048 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ec8b3ad4-d6ad-4340-bd11-a2f30caec2cc" containerName="oc" Mar 16 17:30:10 crc kubenswrapper[5120]: I0316 17:30:10.791748 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-5cc978ff9f-stcpz"] Mar 16 17:30:10 crc kubenswrapper[5120]: I0316 17:30:10.791896 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5cc978ff9f-stcpz" Mar 16 17:30:10 crc kubenswrapper[5120]: I0316 17:30:10.893292 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9738c494-7cc4-4663-b2ec-e2f34062c059-config\") pod \"dnsmasq-dnsmasq-5cc978ff9f-stcpz\" (UID: \"9738c494-7cc4-4663-b2ec-e2f34062c059\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5cc978ff9f-stcpz" Mar 16 17:30:10 crc kubenswrapper[5120]: I0316 17:30:10.893427 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-edpm-multinode\" (UniqueName: \"kubernetes.io/configmap/9738c494-7cc4-4663-b2ec-e2f34062c059-openstack-edpm-multinode\") pod \"dnsmasq-dnsmasq-5cc978ff9f-stcpz\" (UID: \"9738c494-7cc4-4663-b2ec-e2f34062c059\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5cc978ff9f-stcpz" Mar 16 17:30:10 crc kubenswrapper[5120]: I0316 17:30:10.893591 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/9738c494-7cc4-4663-b2ec-e2f34062c059-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-5cc978ff9f-stcpz\" (UID: \"9738c494-7cc4-4663-b2ec-e2f34062c059\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5cc978ff9f-stcpz" Mar 16 17:30:10 crc kubenswrapper[5120]: I0316 17:30:10.893667 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2mwn\" (UniqueName: \"kubernetes.io/projected/9738c494-7cc4-4663-b2ec-e2f34062c059-kube-api-access-c2mwn\") pod \"dnsmasq-dnsmasq-5cc978ff9f-stcpz\" (UID: \"9738c494-7cc4-4663-b2ec-e2f34062c059\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5cc978ff9f-stcpz" Mar 16 17:30:10 crc kubenswrapper[5120]: I0316 17:30:10.995469 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9738c494-7cc4-4663-b2ec-e2f34062c059-config\") pod \"dnsmasq-dnsmasq-5cc978ff9f-stcpz\" (UID: \"9738c494-7cc4-4663-b2ec-e2f34062c059\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5cc978ff9f-stcpz" Mar 16 17:30:10 crc kubenswrapper[5120]: I0316 17:30:10.995948 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openstack-edpm-multinode\" (UniqueName: \"kubernetes.io/configmap/9738c494-7cc4-4663-b2ec-e2f34062c059-openstack-edpm-multinode\") pod \"dnsmasq-dnsmasq-5cc978ff9f-stcpz\" (UID: \"9738c494-7cc4-4663-b2ec-e2f34062c059\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5cc978ff9f-stcpz" Mar 16 17:30:10 crc kubenswrapper[5120]: I0316 17:30:10.996081 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/9738c494-7cc4-4663-b2ec-e2f34062c059-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-5cc978ff9f-stcpz\" (UID: \"9738c494-7cc4-4663-b2ec-e2f34062c059\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5cc978ff9f-stcpz" Mar 16 17:30:10 crc kubenswrapper[5120]: I0316 17:30:10.996178 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c2mwn\" (UniqueName: \"kubernetes.io/projected/9738c494-7cc4-4663-b2ec-e2f34062c059-kube-api-access-c2mwn\") pod \"dnsmasq-dnsmasq-5cc978ff9f-stcpz\" (UID: \"9738c494-7cc4-4663-b2ec-e2f34062c059\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5cc978ff9f-stcpz" Mar 16 17:30:10 crc kubenswrapper[5120]: I0316 17:30:10.996535 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9738c494-7cc4-4663-b2ec-e2f34062c059-config\") pod \"dnsmasq-dnsmasq-5cc978ff9f-stcpz\" (UID: \"9738c494-7cc4-4663-b2ec-e2f34062c059\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5cc978ff9f-stcpz" Mar 16 17:30:10 crc kubenswrapper[5120]: I0316 17:30:10.997218 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openstack-edpm-multinode\" (UniqueName: \"kubernetes.io/configmap/9738c494-7cc4-4663-b2ec-e2f34062c059-openstack-edpm-multinode\") pod \"dnsmasq-dnsmasq-5cc978ff9f-stcpz\" (UID: \"9738c494-7cc4-4663-b2ec-e2f34062c059\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5cc978ff9f-stcpz" Mar 16 17:30:11 crc kubenswrapper[5120]: I0316 17:30:11.000593 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/9738c494-7cc4-4663-b2ec-e2f34062c059-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-5cc978ff9f-stcpz\" (UID: \"9738c494-7cc4-4663-b2ec-e2f34062c059\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5cc978ff9f-stcpz" Mar 16 17:30:11 crc kubenswrapper[5120]: I0316 17:30:11.026577 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2mwn\" (UniqueName: \"kubernetes.io/projected/9738c494-7cc4-4663-b2ec-e2f34062c059-kube-api-access-c2mwn\") pod \"dnsmasq-dnsmasq-5cc978ff9f-stcpz\" (UID: \"9738c494-7cc4-4663-b2ec-e2f34062c059\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5cc978ff9f-stcpz" Mar 16 17:30:11 crc kubenswrapper[5120]: I0316 17:30:11.068869 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7d69f65899-mq89f" Mar 16 17:30:11 crc kubenswrapper[5120]: I0316 17:30:11.119511 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5cc978ff9f-stcpz" Mar 16 17:30:11 crc kubenswrapper[5120]: I0316 17:30:11.199686 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-946zk\" (UniqueName: \"kubernetes.io/projected/9cd6d9f8-2abb-46ad-816c-a7aa2079e932-kube-api-access-946zk\") pod \"9cd6d9f8-2abb-46ad-816c-a7aa2079e932\" (UID: \"9cd6d9f8-2abb-46ad-816c-a7aa2079e932\") " Mar 16 17:30:11 crc kubenswrapper[5120]: I0316 17:30:11.199782 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/9cd6d9f8-2abb-46ad-816c-a7aa2079e932-dnsmasq-svc\") pod \"9cd6d9f8-2abb-46ad-816c-a7aa2079e932\" (UID: \"9cd6d9f8-2abb-46ad-816c-a7aa2079e932\") " Mar 16 17:30:11 crc kubenswrapper[5120]: I0316 17:30:11.200088 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9cd6d9f8-2abb-46ad-816c-a7aa2079e932-config\") pod \"9cd6d9f8-2abb-46ad-816c-a7aa2079e932\" (UID: \"9cd6d9f8-2abb-46ad-816c-a7aa2079e932\") " Mar 16 17:30:11 crc kubenswrapper[5120]: I0316 17:30:11.200229 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"openstack-edpm-multinode\" (UniqueName: \"kubernetes.io/configmap/9cd6d9f8-2abb-46ad-816c-a7aa2079e932-openstack-edpm-multinode\") pod \"9cd6d9f8-2abb-46ad-816c-a7aa2079e932\" (UID: \"9cd6d9f8-2abb-46ad-816c-a7aa2079e932\") " Mar 16 17:30:11 crc kubenswrapper[5120]: I0316 17:30:11.204337 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9cd6d9f8-2abb-46ad-816c-a7aa2079e932-kube-api-access-946zk" (OuterVolumeSpecName: "kube-api-access-946zk") pod "9cd6d9f8-2abb-46ad-816c-a7aa2079e932" (UID: "9cd6d9f8-2abb-46ad-816c-a7aa2079e932"). InnerVolumeSpecName "kube-api-access-946zk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:30:11 crc kubenswrapper[5120]: I0316 17:30:11.244208 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9cd6d9f8-2abb-46ad-816c-a7aa2079e932-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "9cd6d9f8-2abb-46ad-816c-a7aa2079e932" (UID: "9cd6d9f8-2abb-46ad-816c-a7aa2079e932"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:30:11 crc kubenswrapper[5120]: I0316 17:30:11.249495 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9cd6d9f8-2abb-46ad-816c-a7aa2079e932-config" (OuterVolumeSpecName: "config") pod "9cd6d9f8-2abb-46ad-816c-a7aa2079e932" (UID: "9cd6d9f8-2abb-46ad-816c-a7aa2079e932"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:30:11 crc kubenswrapper[5120]: I0316 17:30:11.249563 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9cd6d9f8-2abb-46ad-816c-a7aa2079e932-openstack-edpm-multinode" (OuterVolumeSpecName: "openstack-edpm-multinode") pod "9cd6d9f8-2abb-46ad-816c-a7aa2079e932" (UID: "9cd6d9f8-2abb-46ad-816c-a7aa2079e932"). InnerVolumeSpecName "openstack-edpm-multinode". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:30:11 crc kubenswrapper[5120]: I0316 17:30:11.303524 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-946zk\" (UniqueName: \"kubernetes.io/projected/9cd6d9f8-2abb-46ad-816c-a7aa2079e932-kube-api-access-946zk\") on node \"crc\" DevicePath \"\"" Mar 16 17:30:11 crc kubenswrapper[5120]: I0316 17:30:11.303838 5120 reconciler_common.go:299] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/9cd6d9f8-2abb-46ad-816c-a7aa2079e932-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Mar 16 17:30:11 crc kubenswrapper[5120]: I0316 17:30:11.303849 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9cd6d9f8-2abb-46ad-816c-a7aa2079e932-config\") on node \"crc\" DevicePath \"\"" Mar 16 17:30:11 crc kubenswrapper[5120]: I0316 17:30:11.303862 5120 reconciler_common.go:299] "Volume detached for volume \"openstack-edpm-multinode\" (UniqueName: \"kubernetes.io/configmap/9cd6d9f8-2abb-46ad-816c-a7aa2079e932-openstack-edpm-multinode\") on node \"crc\" DevicePath \"\"" Mar 16 17:30:11 crc kubenswrapper[5120]: I0316 17:30:11.360366 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-5cc978ff9f-stcpz"] Mar 16 17:30:11 crc kubenswrapper[5120]: I0316 17:30:11.632360 5120 generic.go:358] "Generic (PLEG): container finished" podID="9738c494-7cc4-4663-b2ec-e2f34062c059" containerID="22012db4060a0aa1fd423469612b182f8e3e4690a6ee0e3f23545bf721ec57e9" exitCode=0 Mar 16 17:30:11 crc kubenswrapper[5120]: I0316 17:30:11.632460 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5cc978ff9f-stcpz" event={"ID":"9738c494-7cc4-4663-b2ec-e2f34062c059","Type":"ContainerDied","Data":"22012db4060a0aa1fd423469612b182f8e3e4690a6ee0e3f23545bf721ec57e9"} Mar 16 17:30:11 crc kubenswrapper[5120]: I0316 17:30:11.632488 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5cc978ff9f-stcpz" event={"ID":"9738c494-7cc4-4663-b2ec-e2f34062c059","Type":"ContainerStarted","Data":"777fa70132a3cbd17aa7ed45ed0706aa7417429b679aee156099195a0e5ecffc"} Mar 16 17:30:11 crc kubenswrapper[5120]: I0316 17:30:11.634383 5120 generic.go:358] "Generic (PLEG): container finished" podID="9cd6d9f8-2abb-46ad-816c-a7aa2079e932" containerID="ffccea56550d1c8feb8974cae3a8f6e42f846f3ab5ab1f3c8324d7fa63a2dca9" exitCode=0 Mar 16 17:30:11 crc kubenswrapper[5120]: I0316 17:30:11.634695 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7d69f65899-mq89f" Mar 16 17:30:11 crc kubenswrapper[5120]: I0316 17:30:11.634694 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7d69f65899-mq89f" event={"ID":"9cd6d9f8-2abb-46ad-816c-a7aa2079e932","Type":"ContainerDied","Data":"ffccea56550d1c8feb8974cae3a8f6e42f846f3ab5ab1f3c8324d7fa63a2dca9"} Mar 16 17:30:11 crc kubenswrapper[5120]: I0316 17:30:11.635062 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7d69f65899-mq89f" event={"ID":"9cd6d9f8-2abb-46ad-816c-a7aa2079e932","Type":"ContainerDied","Data":"3d0c0faace67b87ecbc1ce4be32b0826a6fa71a06d4d6feacc64db4e79687252"} Mar 16 17:30:11 crc kubenswrapper[5120]: I0316 17:30:11.635110 5120 scope.go:117] "RemoveContainer" containerID="ffccea56550d1c8feb8974cae3a8f6e42f846f3ab5ab1f3c8324d7fa63a2dca9" Mar 16 17:30:11 crc kubenswrapper[5120]: I0316 17:30:11.671898 5120 scope.go:117] "RemoveContainer" containerID="97f4cdd7e2a9ffecd61f56ae71bf2aa6307a47513ecda8f5d7c6fcc3b97a55d2" Mar 16 17:30:11 crc kubenswrapper[5120]: I0316 17:30:11.680459 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-7d69f65899-mq89f"] Mar 16 17:30:11 crc kubenswrapper[5120]: I0316 17:30:11.686229 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-7d69f65899-mq89f"] Mar 16 17:30:11 crc kubenswrapper[5120]: I0316 17:30:11.710506 5120 scope.go:117] "RemoveContainer" containerID="ffccea56550d1c8feb8974cae3a8f6e42f846f3ab5ab1f3c8324d7fa63a2dca9" Mar 16 17:30:11 crc kubenswrapper[5120]: E0316 17:30:11.711055 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ffccea56550d1c8feb8974cae3a8f6e42f846f3ab5ab1f3c8324d7fa63a2dca9\": container with ID starting with ffccea56550d1c8feb8974cae3a8f6e42f846f3ab5ab1f3c8324d7fa63a2dca9 not found: ID does not exist" containerID="ffccea56550d1c8feb8974cae3a8f6e42f846f3ab5ab1f3c8324d7fa63a2dca9" Mar 16 17:30:11 crc kubenswrapper[5120]: I0316 17:30:11.711108 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ffccea56550d1c8feb8974cae3a8f6e42f846f3ab5ab1f3c8324d7fa63a2dca9"} err="failed to get container status \"ffccea56550d1c8feb8974cae3a8f6e42f846f3ab5ab1f3c8324d7fa63a2dca9\": rpc error: code = NotFound desc = could not find container \"ffccea56550d1c8feb8974cae3a8f6e42f846f3ab5ab1f3c8324d7fa63a2dca9\": container with ID starting with ffccea56550d1c8feb8974cae3a8f6e42f846f3ab5ab1f3c8324d7fa63a2dca9 not found: ID does not exist" Mar 16 17:30:11 crc kubenswrapper[5120]: I0316 17:30:11.711137 5120 scope.go:117] "RemoveContainer" containerID="97f4cdd7e2a9ffecd61f56ae71bf2aa6307a47513ecda8f5d7c6fcc3b97a55d2" Mar 16 17:30:11 crc kubenswrapper[5120]: E0316 17:30:11.711579 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"97f4cdd7e2a9ffecd61f56ae71bf2aa6307a47513ecda8f5d7c6fcc3b97a55d2\": container with ID starting with 97f4cdd7e2a9ffecd61f56ae71bf2aa6307a47513ecda8f5d7c6fcc3b97a55d2 not found: ID does not exist" containerID="97f4cdd7e2a9ffecd61f56ae71bf2aa6307a47513ecda8f5d7c6fcc3b97a55d2" Mar 16 17:30:11 crc kubenswrapper[5120]: I0316 17:30:11.711606 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97f4cdd7e2a9ffecd61f56ae71bf2aa6307a47513ecda8f5d7c6fcc3b97a55d2"} err="failed to get container status \"97f4cdd7e2a9ffecd61f56ae71bf2aa6307a47513ecda8f5d7c6fcc3b97a55d2\": rpc error: code = NotFound desc = could not find container \"97f4cdd7e2a9ffecd61f56ae71bf2aa6307a47513ecda8f5d7c6fcc3b97a55d2\": container with ID starting with 97f4cdd7e2a9ffecd61f56ae71bf2aa6307a47513ecda8f5d7c6fcc3b97a55d2 not found: ID does not exist" Mar 16 17:30:12 crc kubenswrapper[5120]: I0316 17:30:12.647528 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5cc978ff9f-stcpz" event={"ID":"9738c494-7cc4-4663-b2ec-e2f34062c059","Type":"ContainerStarted","Data":"5d6c198b36bd9834da61ecea023043fedc36d31b7be73dccfa1bea2432929714"} Mar 16 17:30:12 crc kubenswrapper[5120]: I0316 17:30:12.648373 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5cc978ff9f-stcpz" Mar 16 17:30:12 crc kubenswrapper[5120]: I0316 17:30:12.673464 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5cc978ff9f-stcpz" podStartSLOduration=2.673448611 podStartE2EDuration="2.673448611s" podCreationTimestamp="2026-03-16 17:30:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:30:12.670805319 +0000 UTC m=+7114.824736986" watchObservedRunningTime="2026-03-16 17:30:12.673448611 +0000 UTC m=+7114.827380268" Mar 16 17:30:12 crc kubenswrapper[5120]: I0316 17:30:12.677676 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9cd6d9f8-2abb-46ad-816c-a7aa2079e932" path="/var/lib/kubelet/pods/9cd6d9f8-2abb-46ad-816c-a7aa2079e932/volumes" Mar 16 17:30:13 crc kubenswrapper[5120]: I0316 17:30:13.663378 5120 scope.go:117] "RemoveContainer" containerID="df0a87b047c8208d5fc21057efed33321f6cab49c4cf053702d222dc12979450" Mar 16 17:30:13 crc kubenswrapper[5120]: E0316 17:30:13.663670 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 17:30:18 crc kubenswrapper[5120]: I0316 17:30:18.660814 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5cc978ff9f-stcpz" Mar 16 17:30:18 crc kubenswrapper[5120]: I0316 17:30:18.717478 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-6b55f4579f-pqqj7"] Mar 16 17:30:18 crc kubenswrapper[5120]: I0316 17:30:18.717709 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6b55f4579f-pqqj7" podUID="3fc87b23-1582-4367-9863-06f63de043aa" containerName="dnsmasq-dns" containerID="cri-o://f3a07edc66a03aceb2859c332464c6c9c00f86f0ac94487c825256b0e46892ea" gracePeriod=10 Mar 16 17:30:19 crc kubenswrapper[5120]: I0316 17:30:19.131026 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6b55f4579f-pqqj7" Mar 16 17:30:19 crc kubenswrapper[5120]: I0316 17:30:19.283328 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/3fc87b23-1582-4367-9863-06f63de043aa-dnsmasq-svc\") pod \"3fc87b23-1582-4367-9863-06f63de043aa\" (UID: \"3fc87b23-1582-4367-9863-06f63de043aa\") " Mar 16 17:30:19 crc kubenswrapper[5120]: I0316 17:30:19.283713 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"openstack-edpm-multinode\" (UniqueName: \"kubernetes.io/configmap/3fc87b23-1582-4367-9863-06f63de043aa-openstack-edpm-multinode\") pod \"3fc87b23-1582-4367-9863-06f63de043aa\" (UID: \"3fc87b23-1582-4367-9863-06f63de043aa\") " Mar 16 17:30:19 crc kubenswrapper[5120]: I0316 17:30:19.284273 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3fc87b23-1582-4367-9863-06f63de043aa-config\") pod \"3fc87b23-1582-4367-9863-06f63de043aa\" (UID: \"3fc87b23-1582-4367-9863-06f63de043aa\") " Mar 16 17:30:19 crc kubenswrapper[5120]: I0316 17:30:19.284344 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vlq9r\" (UniqueName: \"kubernetes.io/projected/3fc87b23-1582-4367-9863-06f63de043aa-kube-api-access-vlq9r\") pod \"3fc87b23-1582-4367-9863-06f63de043aa\" (UID: \"3fc87b23-1582-4367-9863-06f63de043aa\") " Mar 16 17:30:19 crc kubenswrapper[5120]: I0316 17:30:19.290569 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3fc87b23-1582-4367-9863-06f63de043aa-kube-api-access-vlq9r" (OuterVolumeSpecName: "kube-api-access-vlq9r") pod "3fc87b23-1582-4367-9863-06f63de043aa" (UID: "3fc87b23-1582-4367-9863-06f63de043aa"). InnerVolumeSpecName "kube-api-access-vlq9r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:30:19 crc kubenswrapper[5120]: I0316 17:30:19.334848 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3fc87b23-1582-4367-9863-06f63de043aa-config" (OuterVolumeSpecName: "config") pod "3fc87b23-1582-4367-9863-06f63de043aa" (UID: "3fc87b23-1582-4367-9863-06f63de043aa"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:30:19 crc kubenswrapper[5120]: I0316 17:30:19.345552 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3fc87b23-1582-4367-9863-06f63de043aa-openstack-edpm-multinode" (OuterVolumeSpecName: "openstack-edpm-multinode") pod "3fc87b23-1582-4367-9863-06f63de043aa" (UID: "3fc87b23-1582-4367-9863-06f63de043aa"). InnerVolumeSpecName "openstack-edpm-multinode". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:30:19 crc kubenswrapper[5120]: I0316 17:30:19.350430 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3fc87b23-1582-4367-9863-06f63de043aa-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "3fc87b23-1582-4367-9863-06f63de043aa" (UID: "3fc87b23-1582-4367-9863-06f63de043aa"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:30:19 crc kubenswrapper[5120]: I0316 17:30:19.387836 5120 reconciler_common.go:299] "Volume detached for volume \"openstack-edpm-multinode\" (UniqueName: \"kubernetes.io/configmap/3fc87b23-1582-4367-9863-06f63de043aa-openstack-edpm-multinode\") on node \"crc\" DevicePath \"\"" Mar 16 17:30:19 crc kubenswrapper[5120]: I0316 17:30:19.387883 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3fc87b23-1582-4367-9863-06f63de043aa-config\") on node \"crc\" DevicePath \"\"" Mar 16 17:30:19 crc kubenswrapper[5120]: I0316 17:30:19.387896 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vlq9r\" (UniqueName: \"kubernetes.io/projected/3fc87b23-1582-4367-9863-06f63de043aa-kube-api-access-vlq9r\") on node \"crc\" DevicePath \"\"" Mar 16 17:30:19 crc kubenswrapper[5120]: I0316 17:30:19.387910 5120 reconciler_common.go:299] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/3fc87b23-1582-4367-9863-06f63de043aa-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Mar 16 17:30:19 crc kubenswrapper[5120]: I0316 17:30:19.410388 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-mvthj"] Mar 16 17:30:19 crc kubenswrapper[5120]: I0316 17:30:19.411373 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fc87b23-1582-4367-9863-06f63de043aa" containerName="dnsmasq-dns" Mar 16 17:30:19 crc kubenswrapper[5120]: I0316 17:30:19.411397 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fc87b23-1582-4367-9863-06f63de043aa" containerName="dnsmasq-dns" Mar 16 17:30:19 crc kubenswrapper[5120]: I0316 17:30:19.411426 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fc87b23-1582-4367-9863-06f63de043aa" containerName="init" Mar 16 17:30:19 crc kubenswrapper[5120]: I0316 17:30:19.411434 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fc87b23-1582-4367-9863-06f63de043aa" containerName="init" Mar 16 17:30:19 crc kubenswrapper[5120]: I0316 17:30:19.411454 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9cd6d9f8-2abb-46ad-816c-a7aa2079e932" containerName="init" Mar 16 17:30:19 crc kubenswrapper[5120]: I0316 17:30:19.411460 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9cd6d9f8-2abb-46ad-816c-a7aa2079e932" containerName="init" Mar 16 17:30:19 crc kubenswrapper[5120]: I0316 17:30:19.411484 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9cd6d9f8-2abb-46ad-816c-a7aa2079e932" containerName="dnsmasq-dns" Mar 16 17:30:19 crc kubenswrapper[5120]: I0316 17:30:19.411491 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9cd6d9f8-2abb-46ad-816c-a7aa2079e932" containerName="dnsmasq-dns" Mar 16 17:30:19 crc kubenswrapper[5120]: I0316 17:30:19.411658 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="9cd6d9f8-2abb-46ad-816c-a7aa2079e932" containerName="dnsmasq-dns" Mar 16 17:30:19 crc kubenswrapper[5120]: I0316 17:30:19.411681 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="3fc87b23-1582-4367-9863-06f63de043aa" containerName="dnsmasq-dns" Mar 16 17:30:19 crc kubenswrapper[5120]: I0316 17:30:19.420174 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-mvthj" Mar 16 17:30:19 crc kubenswrapper[5120]: I0316 17:30:19.424259 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-mvthj"] Mar 16 17:30:19 crc kubenswrapper[5120]: I0316 17:30:19.604807 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/4b8eed83-ada0-4695-b200-bfbaeb51ffc7-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-79dcd846c5-mvthj\" (UID: \"4b8eed83-ada0-4695-b200-bfbaeb51ffc7\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-mvthj" Mar 16 17:30:19 crc kubenswrapper[5120]: I0316 17:30:19.604989 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4b8eed83-ada0-4695-b200-bfbaeb51ffc7-config\") pod \"dnsmasq-dnsmasq-79dcd846c5-mvthj\" (UID: \"4b8eed83-ada0-4695-b200-bfbaeb51ffc7\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-mvthj" Mar 16 17:30:19 crc kubenswrapper[5120]: I0316 17:30:19.605397 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzk5n\" (UniqueName: \"kubernetes.io/projected/4b8eed83-ada0-4695-b200-bfbaeb51ffc7-kube-api-access-bzk5n\") pod \"dnsmasq-dnsmasq-79dcd846c5-mvthj\" (UID: \"4b8eed83-ada0-4695-b200-bfbaeb51ffc7\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-mvthj" Mar 16 17:30:19 crc kubenswrapper[5120]: I0316 17:30:19.707470 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bzk5n\" (UniqueName: \"kubernetes.io/projected/4b8eed83-ada0-4695-b200-bfbaeb51ffc7-kube-api-access-bzk5n\") pod \"dnsmasq-dnsmasq-79dcd846c5-mvthj\" (UID: \"4b8eed83-ada0-4695-b200-bfbaeb51ffc7\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-mvthj" Mar 16 17:30:19 crc kubenswrapper[5120]: I0316 17:30:19.707822 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/4b8eed83-ada0-4695-b200-bfbaeb51ffc7-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-79dcd846c5-mvthj\" (UID: \"4b8eed83-ada0-4695-b200-bfbaeb51ffc7\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-mvthj" Mar 16 17:30:19 crc kubenswrapper[5120]: I0316 17:30:19.708380 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4b8eed83-ada0-4695-b200-bfbaeb51ffc7-config\") pod \"dnsmasq-dnsmasq-79dcd846c5-mvthj\" (UID: \"4b8eed83-ada0-4695-b200-bfbaeb51ffc7\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-mvthj" Mar 16 17:30:19 crc kubenswrapper[5120]: I0316 17:30:19.709204 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/4b8eed83-ada0-4695-b200-bfbaeb51ffc7-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-79dcd846c5-mvthj\" (UID: \"4b8eed83-ada0-4695-b200-bfbaeb51ffc7\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-mvthj" Mar 16 17:30:19 crc kubenswrapper[5120]: I0316 17:30:19.709235 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4b8eed83-ada0-4695-b200-bfbaeb51ffc7-config\") pod \"dnsmasq-dnsmasq-79dcd846c5-mvthj\" (UID: \"4b8eed83-ada0-4695-b200-bfbaeb51ffc7\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-mvthj" Mar 16 17:30:19 crc kubenswrapper[5120]: I0316 17:30:19.725117 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzk5n\" (UniqueName: \"kubernetes.io/projected/4b8eed83-ada0-4695-b200-bfbaeb51ffc7-kube-api-access-bzk5n\") pod \"dnsmasq-dnsmasq-79dcd846c5-mvthj\" (UID: \"4b8eed83-ada0-4695-b200-bfbaeb51ffc7\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-mvthj" Mar 16 17:30:19 crc kubenswrapper[5120]: I0316 17:30:19.742159 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-mvthj" Mar 16 17:30:19 crc kubenswrapper[5120]: I0316 17:30:19.745804 5120 generic.go:358] "Generic (PLEG): container finished" podID="3fc87b23-1582-4367-9863-06f63de043aa" containerID="f3a07edc66a03aceb2859c332464c6c9c00f86f0ac94487c825256b0e46892ea" exitCode=0 Mar 16 17:30:19 crc kubenswrapper[5120]: I0316 17:30:19.745872 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6b55f4579f-pqqj7" event={"ID":"3fc87b23-1582-4367-9863-06f63de043aa","Type":"ContainerDied","Data":"f3a07edc66a03aceb2859c332464c6c9c00f86f0ac94487c825256b0e46892ea"} Mar 16 17:30:19 crc kubenswrapper[5120]: I0316 17:30:19.745897 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6b55f4579f-pqqj7" event={"ID":"3fc87b23-1582-4367-9863-06f63de043aa","Type":"ContainerDied","Data":"8f5c0235f822cf5adf4e7808aec35e6d5f4fb90273114529cc2ce99a54713ae0"} Mar 16 17:30:19 crc kubenswrapper[5120]: I0316 17:30:19.745914 5120 scope.go:117] "RemoveContainer" containerID="f3a07edc66a03aceb2859c332464c6c9c00f86f0ac94487c825256b0e46892ea" Mar 16 17:30:19 crc kubenswrapper[5120]: I0316 17:30:19.746048 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6b55f4579f-pqqj7" Mar 16 17:30:19 crc kubenswrapper[5120]: I0316 17:30:19.773064 5120 scope.go:117] "RemoveContainer" containerID="3539b53375fc5fd00c6c4114b11326d2a8bffc6f508c95eddd2d5af5e514085f" Mar 16 17:30:19 crc kubenswrapper[5120]: I0316 17:30:19.783323 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-6b55f4579f-pqqj7"] Mar 16 17:30:19 crc kubenswrapper[5120]: I0316 17:30:19.790677 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-6b55f4579f-pqqj7"] Mar 16 17:30:19 crc kubenswrapper[5120]: I0316 17:30:19.810175 5120 scope.go:117] "RemoveContainer" containerID="f3a07edc66a03aceb2859c332464c6c9c00f86f0ac94487c825256b0e46892ea" Mar 16 17:30:19 crc kubenswrapper[5120]: E0316 17:30:19.810623 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f3a07edc66a03aceb2859c332464c6c9c00f86f0ac94487c825256b0e46892ea\": container with ID starting with f3a07edc66a03aceb2859c332464c6c9c00f86f0ac94487c825256b0e46892ea not found: ID does not exist" containerID="f3a07edc66a03aceb2859c332464c6c9c00f86f0ac94487c825256b0e46892ea" Mar 16 17:30:19 crc kubenswrapper[5120]: I0316 17:30:19.810692 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3a07edc66a03aceb2859c332464c6c9c00f86f0ac94487c825256b0e46892ea"} err="failed to get container status \"f3a07edc66a03aceb2859c332464c6c9c00f86f0ac94487c825256b0e46892ea\": rpc error: code = NotFound desc = could not find container \"f3a07edc66a03aceb2859c332464c6c9c00f86f0ac94487c825256b0e46892ea\": container with ID starting with f3a07edc66a03aceb2859c332464c6c9c00f86f0ac94487c825256b0e46892ea not found: ID does not exist" Mar 16 17:30:19 crc kubenswrapper[5120]: I0316 17:30:19.810731 5120 scope.go:117] "RemoveContainer" containerID="3539b53375fc5fd00c6c4114b11326d2a8bffc6f508c95eddd2d5af5e514085f" Mar 16 17:30:19 crc kubenswrapper[5120]: E0316 17:30:19.811462 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3539b53375fc5fd00c6c4114b11326d2a8bffc6f508c95eddd2d5af5e514085f\": container with ID starting with 3539b53375fc5fd00c6c4114b11326d2a8bffc6f508c95eddd2d5af5e514085f not found: ID does not exist" containerID="3539b53375fc5fd00c6c4114b11326d2a8bffc6f508c95eddd2d5af5e514085f" Mar 16 17:30:19 crc kubenswrapper[5120]: I0316 17:30:19.811569 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3539b53375fc5fd00c6c4114b11326d2a8bffc6f508c95eddd2d5af5e514085f"} err="failed to get container status \"3539b53375fc5fd00c6c4114b11326d2a8bffc6f508c95eddd2d5af5e514085f\": rpc error: code = NotFound desc = could not find container \"3539b53375fc5fd00c6c4114b11326d2a8bffc6f508c95eddd2d5af5e514085f\": container with ID starting with 3539b53375fc5fd00c6c4114b11326d2a8bffc6f508c95eddd2d5af5e514085f not found: ID does not exist" Mar 16 17:30:19 crc kubenswrapper[5120]: I0316 17:30:19.968342 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-mvthj"] Mar 16 17:30:20 crc kubenswrapper[5120]: I0316 17:30:20.676977 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3fc87b23-1582-4367-9863-06f63de043aa" path="/var/lib/kubelet/pods/3fc87b23-1582-4367-9863-06f63de043aa/volumes" Mar 16 17:30:20 crc kubenswrapper[5120]: I0316 17:30:20.756847 5120 generic.go:358] "Generic (PLEG): container finished" podID="4b8eed83-ada0-4695-b200-bfbaeb51ffc7" containerID="06c19f4c3ba386790e9067715fb60362301906808b0ebb074cd986101a8431f9" exitCode=0 Mar 16 17:30:20 crc kubenswrapper[5120]: I0316 17:30:20.758408 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-mvthj" event={"ID":"4b8eed83-ada0-4695-b200-bfbaeb51ffc7","Type":"ContainerDied","Data":"06c19f4c3ba386790e9067715fb60362301906808b0ebb074cd986101a8431f9"} Mar 16 17:30:20 crc kubenswrapper[5120]: I0316 17:30:20.758509 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-mvthj" event={"ID":"4b8eed83-ada0-4695-b200-bfbaeb51ffc7","Type":"ContainerStarted","Data":"f1e275716e8375f8e19a8347bdf21dbd9f39f2c064510b96d7fb55726684734d"} Mar 16 17:30:21 crc kubenswrapper[5120]: I0316 17:30:21.770450 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-mvthj" event={"ID":"4b8eed83-ada0-4695-b200-bfbaeb51ffc7","Type":"ContainerStarted","Data":"a612fcb56546dba762d48d3906bd1a3b88734aaad0f1b4ba29adc3121b24dbb0"} Mar 16 17:30:21 crc kubenswrapper[5120]: I0316 17:30:21.770581 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-mvthj" Mar 16 17:30:21 crc kubenswrapper[5120]: I0316 17:30:21.806358 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-mvthj" podStartSLOduration=2.806339918 podStartE2EDuration="2.806339918s" podCreationTimestamp="2026-03-16 17:30:19 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:30:21.786956209 +0000 UTC m=+7123.940887876" watchObservedRunningTime="2026-03-16 17:30:21.806339918 +0000 UTC m=+7123.960271585" Mar 16 17:30:26 crc kubenswrapper[5120]: I0316 17:30:26.577916 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["crc-storage/crc-storage-crc-89w9t"] Mar 16 17:30:26 crc kubenswrapper[5120]: I0316 17:30:26.584084 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["crc-storage/crc-storage-crc-89w9t"] Mar 16 17:30:26 crc kubenswrapper[5120]: I0316 17:30:26.672122 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="80041c1e-539e-4acf-8d86-209be273da56" path="/var/lib/kubelet/pods/80041c1e-539e-4acf-8d86-209be273da56/volumes" Mar 16 17:30:26 crc kubenswrapper[5120]: I0316 17:30:26.721405 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["crc-storage/crc-storage-crc-zpr2d"] Mar 16 17:30:26 crc kubenswrapper[5120]: I0316 17:30:26.728098 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-zpr2d" Mar 16 17:30:26 crc kubenswrapper[5120]: I0316 17:30:26.730109 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"crc-storage\"" Mar 16 17:30:26 crc kubenswrapper[5120]: I0316 17:30:26.730280 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"kube-root-ca.crt\"" Mar 16 17:30:26 crc kubenswrapper[5120]: I0316 17:30:26.730746 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"crc-storage\"/\"crc-storage-dockercfg-s2tht\"" Mar 16 17:30:26 crc kubenswrapper[5120]: I0316 17:30:26.732852 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-zpr2d"] Mar 16 17:30:26 crc kubenswrapper[5120]: I0316 17:30:26.734513 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"openshift-service-ca.crt\"" Mar 16 17:30:26 crc kubenswrapper[5120]: I0316 17:30:26.873863 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/26460cd4-d1b8-49fa-a806-d866debafda4-crc-storage\") pod \"crc-storage-crc-zpr2d\" (UID: \"26460cd4-d1b8-49fa-a806-d866debafda4\") " pod="crc-storage/crc-storage-crc-zpr2d" Mar 16 17:30:26 crc kubenswrapper[5120]: I0316 17:30:26.873914 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6c2t\" (UniqueName: \"kubernetes.io/projected/26460cd4-d1b8-49fa-a806-d866debafda4-kube-api-access-d6c2t\") pod \"crc-storage-crc-zpr2d\" (UID: \"26460cd4-d1b8-49fa-a806-d866debafda4\") " pod="crc-storage/crc-storage-crc-zpr2d" Mar 16 17:30:26 crc kubenswrapper[5120]: I0316 17:30:26.874131 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/26460cd4-d1b8-49fa-a806-d866debafda4-node-mnt\") pod \"crc-storage-crc-zpr2d\" (UID: \"26460cd4-d1b8-49fa-a806-d866debafda4\") " pod="crc-storage/crc-storage-crc-zpr2d" Mar 16 17:30:26 crc kubenswrapper[5120]: I0316 17:30:26.976280 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/26460cd4-d1b8-49fa-a806-d866debafda4-crc-storage\") pod \"crc-storage-crc-zpr2d\" (UID: \"26460cd4-d1b8-49fa-a806-d866debafda4\") " pod="crc-storage/crc-storage-crc-zpr2d" Mar 16 17:30:26 crc kubenswrapper[5120]: I0316 17:30:26.976328 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d6c2t\" (UniqueName: \"kubernetes.io/projected/26460cd4-d1b8-49fa-a806-d866debafda4-kube-api-access-d6c2t\") pod \"crc-storage-crc-zpr2d\" (UID: \"26460cd4-d1b8-49fa-a806-d866debafda4\") " pod="crc-storage/crc-storage-crc-zpr2d" Mar 16 17:30:26 crc kubenswrapper[5120]: I0316 17:30:26.976500 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/26460cd4-d1b8-49fa-a806-d866debafda4-node-mnt\") pod \"crc-storage-crc-zpr2d\" (UID: \"26460cd4-d1b8-49fa-a806-d866debafda4\") " pod="crc-storage/crc-storage-crc-zpr2d" Mar 16 17:30:26 crc kubenswrapper[5120]: I0316 17:30:26.976887 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/26460cd4-d1b8-49fa-a806-d866debafda4-node-mnt\") pod \"crc-storage-crc-zpr2d\" (UID: \"26460cd4-d1b8-49fa-a806-d866debafda4\") " pod="crc-storage/crc-storage-crc-zpr2d" Mar 16 17:30:26 crc kubenswrapper[5120]: I0316 17:30:26.977126 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/26460cd4-d1b8-49fa-a806-d866debafda4-crc-storage\") pod \"crc-storage-crc-zpr2d\" (UID: \"26460cd4-d1b8-49fa-a806-d866debafda4\") " pod="crc-storage/crc-storage-crc-zpr2d" Mar 16 17:30:26 crc kubenswrapper[5120]: I0316 17:30:26.995803 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6c2t\" (UniqueName: \"kubernetes.io/projected/26460cd4-d1b8-49fa-a806-d866debafda4-kube-api-access-d6c2t\") pod \"crc-storage-crc-zpr2d\" (UID: \"26460cd4-d1b8-49fa-a806-d866debafda4\") " pod="crc-storage/crc-storage-crc-zpr2d" Mar 16 17:30:27 crc kubenswrapper[5120]: I0316 17:30:27.045926 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-zpr2d" Mar 16 17:30:27 crc kubenswrapper[5120]: I0316 17:30:27.289986 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-zpr2d"] Mar 16 17:30:27 crc kubenswrapper[5120]: I0316 17:30:27.659273 5120 scope.go:117] "RemoveContainer" containerID="045bcc04e88463e39bca1be465f2415de09e49742b297f5cec5baf749eca7715" Mar 16 17:30:27 crc kubenswrapper[5120]: I0316 17:30:27.664578 5120 scope.go:117] "RemoveContainer" containerID="df0a87b047c8208d5fc21057efed33321f6cab49c4cf053702d222dc12979450" Mar 16 17:30:27 crc kubenswrapper[5120]: E0316 17:30:27.664863 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 17:30:27 crc kubenswrapper[5120]: I0316 17:30:27.694389 5120 scope.go:117] "RemoveContainer" containerID="fcecca7b41949210ed0391e5e10474c2b21d59845467faabdc5ca827a86ad8f3" Mar 16 17:30:27 crc kubenswrapper[5120]: I0316 17:30:27.720230 5120 scope.go:117] "RemoveContainer" containerID="5b96f7557231f5c82b606572833789080e72915189b0f4c12da7de54bb9c6cfc" Mar 16 17:30:27 crc kubenswrapper[5120]: I0316 17:30:27.750007 5120 scope.go:117] "RemoveContainer" containerID="d83667513e345e9469836704314b9afc88c38cb055463bed8312804a2e2f66f7" Mar 16 17:30:27 crc kubenswrapper[5120]: I0316 17:30:27.776387 5120 scope.go:117] "RemoveContainer" containerID="756d80abbf144b03e73508b2100c74eb5fa3671adca4346c7d5954023c86241e" Mar 16 17:30:27 crc kubenswrapper[5120]: I0316 17:30:27.780169 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-mvthj" Mar 16 17:30:27 crc kubenswrapper[5120]: I0316 17:30:27.829809 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-5cc978ff9f-stcpz"] Mar 16 17:30:27 crc kubenswrapper[5120]: I0316 17:30:27.830435 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5cc978ff9f-stcpz" podUID="9738c494-7cc4-4663-b2ec-e2f34062c059" containerName="dnsmasq-dns" containerID="cri-o://5d6c198b36bd9834da61ecea023043fedc36d31b7be73dccfa1bea2432929714" gracePeriod=10 Mar 16 17:30:27 crc kubenswrapper[5120]: I0316 17:30:27.865301 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-zpr2d" event={"ID":"26460cd4-d1b8-49fa-a806-d866debafda4","Type":"ContainerStarted","Data":"c7f51c9adc541e34c993430d6de37d40478f78344b4996b71129b9033af8c16f"} Mar 16 17:30:27 crc kubenswrapper[5120]: I0316 17:30:27.890400 5120 scope.go:117] "RemoveContainer" containerID="dafbbfc7f4027f6364f977d2dcf792eabd886b0ee6f0d1928892410df28facba" Mar 16 17:30:27 crc kubenswrapper[5120]: I0316 17:30:27.920668 5120 scope.go:117] "RemoveContainer" containerID="7a1ff61c9342026e5b18084603bf6ce8710f944e3384b7971d5e89baecc59904" Mar 16 17:30:27 crc kubenswrapper[5120]: I0316 17:30:27.949825 5120 scope.go:117] "RemoveContainer" containerID="3fda4b581efcd28634715cf60dee717fc3337938c7742009210a9ee14778b476" Mar 16 17:30:27 crc kubenswrapper[5120]: I0316 17:30:27.982205 5120 scope.go:117] "RemoveContainer" containerID="1d381cc60145fbdb2c724a62542988d10f62906fe49795555657dfce2ec52bfc" Mar 16 17:30:28 crc kubenswrapper[5120]: I0316 17:30:28.011054 5120 scope.go:117] "RemoveContainer" containerID="3adccde65dcd749026902ec6beb68d640652a344128bdb472228faf8780cfd35" Mar 16 17:30:28 crc kubenswrapper[5120]: I0316 17:30:28.080276 5120 scope.go:117] "RemoveContainer" containerID="14637ec8e5a89f3a6472432f41e4c041e15781e78a3b2b975caf2edc7f0d1205" Mar 16 17:30:28 crc kubenswrapper[5120]: I0316 17:30:28.162501 5120 scope.go:117] "RemoveContainer" containerID="12ac70829d2369dbf3ffe907fba2c7d6bada6d051cfd71eb556afecd85739cb4" Mar 16 17:30:28 crc kubenswrapper[5120]: I0316 17:30:28.243374 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5cc978ff9f-stcpz" Mar 16 17:30:28 crc kubenswrapper[5120]: I0316 17:30:28.314633 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"openstack-edpm-multinode\" (UniqueName: \"kubernetes.io/configmap/9738c494-7cc4-4663-b2ec-e2f34062c059-openstack-edpm-multinode\") pod \"9738c494-7cc4-4663-b2ec-e2f34062c059\" (UID: \"9738c494-7cc4-4663-b2ec-e2f34062c059\") " Mar 16 17:30:28 crc kubenswrapper[5120]: I0316 17:30:28.314845 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c2mwn\" (UniqueName: \"kubernetes.io/projected/9738c494-7cc4-4663-b2ec-e2f34062c059-kube-api-access-c2mwn\") pod \"9738c494-7cc4-4663-b2ec-e2f34062c059\" (UID: \"9738c494-7cc4-4663-b2ec-e2f34062c059\") " Mar 16 17:30:28 crc kubenswrapper[5120]: I0316 17:30:28.314898 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/9738c494-7cc4-4663-b2ec-e2f34062c059-dnsmasq-svc\") pod \"9738c494-7cc4-4663-b2ec-e2f34062c059\" (UID: \"9738c494-7cc4-4663-b2ec-e2f34062c059\") " Mar 16 17:30:28 crc kubenswrapper[5120]: I0316 17:30:28.316694 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9738c494-7cc4-4663-b2ec-e2f34062c059-config\") pod \"9738c494-7cc4-4663-b2ec-e2f34062c059\" (UID: \"9738c494-7cc4-4663-b2ec-e2f34062c059\") " Mar 16 17:30:28 crc kubenswrapper[5120]: I0316 17:30:28.326976 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9738c494-7cc4-4663-b2ec-e2f34062c059-kube-api-access-c2mwn" (OuterVolumeSpecName: "kube-api-access-c2mwn") pod "9738c494-7cc4-4663-b2ec-e2f34062c059" (UID: "9738c494-7cc4-4663-b2ec-e2f34062c059"). InnerVolumeSpecName "kube-api-access-c2mwn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:30:28 crc kubenswrapper[5120]: I0316 17:30:28.366982 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9738c494-7cc4-4663-b2ec-e2f34062c059-config" (OuterVolumeSpecName: "config") pod "9738c494-7cc4-4663-b2ec-e2f34062c059" (UID: "9738c494-7cc4-4663-b2ec-e2f34062c059"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:30:28 crc kubenswrapper[5120]: I0316 17:30:28.372718 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9738c494-7cc4-4663-b2ec-e2f34062c059-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "9738c494-7cc4-4663-b2ec-e2f34062c059" (UID: "9738c494-7cc4-4663-b2ec-e2f34062c059"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:30:28 crc kubenswrapper[5120]: I0316 17:30:28.377276 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9738c494-7cc4-4663-b2ec-e2f34062c059-openstack-edpm-multinode" (OuterVolumeSpecName: "openstack-edpm-multinode") pod "9738c494-7cc4-4663-b2ec-e2f34062c059" (UID: "9738c494-7cc4-4663-b2ec-e2f34062c059"). InnerVolumeSpecName "openstack-edpm-multinode". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:30:28 crc kubenswrapper[5120]: I0316 17:30:28.420082 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c2mwn\" (UniqueName: \"kubernetes.io/projected/9738c494-7cc4-4663-b2ec-e2f34062c059-kube-api-access-c2mwn\") on node \"crc\" DevicePath \"\"" Mar 16 17:30:28 crc kubenswrapper[5120]: I0316 17:30:28.420119 5120 reconciler_common.go:299] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/9738c494-7cc4-4663-b2ec-e2f34062c059-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Mar 16 17:30:28 crc kubenswrapper[5120]: I0316 17:30:28.420129 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9738c494-7cc4-4663-b2ec-e2f34062c059-config\") on node \"crc\" DevicePath \"\"" Mar 16 17:30:28 crc kubenswrapper[5120]: I0316 17:30:28.420143 5120 reconciler_common.go:299] "Volume detached for volume \"openstack-edpm-multinode\" (UniqueName: \"kubernetes.io/configmap/9738c494-7cc4-4663-b2ec-e2f34062c059-openstack-edpm-multinode\") on node \"crc\" DevicePath \"\"" Mar 16 17:30:28 crc kubenswrapper[5120]: I0316 17:30:28.880268 5120 generic.go:358] "Generic (PLEG): container finished" podID="26460cd4-d1b8-49fa-a806-d866debafda4" containerID="193b25f0a0e0338a0901f7a6ebd642bd72580cc135fd3b3d6cf0fbfd8b50ac31" exitCode=0 Mar 16 17:30:28 crc kubenswrapper[5120]: I0316 17:30:28.880422 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-zpr2d" event={"ID":"26460cd4-d1b8-49fa-a806-d866debafda4","Type":"ContainerDied","Data":"193b25f0a0e0338a0901f7a6ebd642bd72580cc135fd3b3d6cf0fbfd8b50ac31"} Mar 16 17:30:28 crc kubenswrapper[5120]: I0316 17:30:28.886307 5120 generic.go:358] "Generic (PLEG): container finished" podID="9738c494-7cc4-4663-b2ec-e2f34062c059" containerID="5d6c198b36bd9834da61ecea023043fedc36d31b7be73dccfa1bea2432929714" exitCode=0 Mar 16 17:30:28 crc kubenswrapper[5120]: I0316 17:30:28.886423 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5cc978ff9f-stcpz" Mar 16 17:30:28 crc kubenswrapper[5120]: I0316 17:30:28.886471 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5cc978ff9f-stcpz" event={"ID":"9738c494-7cc4-4663-b2ec-e2f34062c059","Type":"ContainerDied","Data":"5d6c198b36bd9834da61ecea023043fedc36d31b7be73dccfa1bea2432929714"} Mar 16 17:30:28 crc kubenswrapper[5120]: I0316 17:30:28.886509 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5cc978ff9f-stcpz" event={"ID":"9738c494-7cc4-4663-b2ec-e2f34062c059","Type":"ContainerDied","Data":"777fa70132a3cbd17aa7ed45ed0706aa7417429b679aee156099195a0e5ecffc"} Mar 16 17:30:28 crc kubenswrapper[5120]: I0316 17:30:28.886533 5120 scope.go:117] "RemoveContainer" containerID="5d6c198b36bd9834da61ecea023043fedc36d31b7be73dccfa1bea2432929714" Mar 16 17:30:28 crc kubenswrapper[5120]: I0316 17:30:28.915813 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-5cc978ff9f-stcpz"] Mar 16 17:30:28 crc kubenswrapper[5120]: I0316 17:30:28.921616 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-5cc978ff9f-stcpz"] Mar 16 17:30:28 crc kubenswrapper[5120]: I0316 17:30:28.926589 5120 scope.go:117] "RemoveContainer" containerID="22012db4060a0aa1fd423469612b182f8e3e4690a6ee0e3f23545bf721ec57e9" Mar 16 17:30:28 crc kubenswrapper[5120]: I0316 17:30:28.944709 5120 scope.go:117] "RemoveContainer" containerID="5d6c198b36bd9834da61ecea023043fedc36d31b7be73dccfa1bea2432929714" Mar 16 17:30:28 crc kubenswrapper[5120]: E0316 17:30:28.945148 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d6c198b36bd9834da61ecea023043fedc36d31b7be73dccfa1bea2432929714\": container with ID starting with 5d6c198b36bd9834da61ecea023043fedc36d31b7be73dccfa1bea2432929714 not found: ID does not exist" containerID="5d6c198b36bd9834da61ecea023043fedc36d31b7be73dccfa1bea2432929714" Mar 16 17:30:28 crc kubenswrapper[5120]: I0316 17:30:28.945189 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d6c198b36bd9834da61ecea023043fedc36d31b7be73dccfa1bea2432929714"} err="failed to get container status \"5d6c198b36bd9834da61ecea023043fedc36d31b7be73dccfa1bea2432929714\": rpc error: code = NotFound desc = could not find container \"5d6c198b36bd9834da61ecea023043fedc36d31b7be73dccfa1bea2432929714\": container with ID starting with 5d6c198b36bd9834da61ecea023043fedc36d31b7be73dccfa1bea2432929714 not found: ID does not exist" Mar 16 17:30:28 crc kubenswrapper[5120]: I0316 17:30:28.945213 5120 scope.go:117] "RemoveContainer" containerID="22012db4060a0aa1fd423469612b182f8e3e4690a6ee0e3f23545bf721ec57e9" Mar 16 17:30:28 crc kubenswrapper[5120]: E0316 17:30:28.945590 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"22012db4060a0aa1fd423469612b182f8e3e4690a6ee0e3f23545bf721ec57e9\": container with ID starting with 22012db4060a0aa1fd423469612b182f8e3e4690a6ee0e3f23545bf721ec57e9 not found: ID does not exist" containerID="22012db4060a0aa1fd423469612b182f8e3e4690a6ee0e3f23545bf721ec57e9" Mar 16 17:30:28 crc kubenswrapper[5120]: I0316 17:30:28.945629 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22012db4060a0aa1fd423469612b182f8e3e4690a6ee0e3f23545bf721ec57e9"} err="failed to get container status \"22012db4060a0aa1fd423469612b182f8e3e4690a6ee0e3f23545bf721ec57e9\": rpc error: code = NotFound desc = could not find container \"22012db4060a0aa1fd423469612b182f8e3e4690a6ee0e3f23545bf721ec57e9\": container with ID starting with 22012db4060a0aa1fd423469612b182f8e3e4690a6ee0e3f23545bf721ec57e9 not found: ID does not exist" Mar 16 17:30:30 crc kubenswrapper[5120]: I0316 17:30:30.186368 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-zpr2d" Mar 16 17:30:30 crc kubenswrapper[5120]: I0316 17:30:30.263399 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/26460cd4-d1b8-49fa-a806-d866debafda4-node-mnt\") pod \"26460cd4-d1b8-49fa-a806-d866debafda4\" (UID: \"26460cd4-d1b8-49fa-a806-d866debafda4\") " Mar 16 17:30:30 crc kubenswrapper[5120]: I0316 17:30:30.263470 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d6c2t\" (UniqueName: \"kubernetes.io/projected/26460cd4-d1b8-49fa-a806-d866debafda4-kube-api-access-d6c2t\") pod \"26460cd4-d1b8-49fa-a806-d866debafda4\" (UID: \"26460cd4-d1b8-49fa-a806-d866debafda4\") " Mar 16 17:30:30 crc kubenswrapper[5120]: I0316 17:30:30.263511 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/26460cd4-d1b8-49fa-a806-d866debafda4-crc-storage\") pod \"26460cd4-d1b8-49fa-a806-d866debafda4\" (UID: \"26460cd4-d1b8-49fa-a806-d866debafda4\") " Mar 16 17:30:30 crc kubenswrapper[5120]: I0316 17:30:30.263519 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/26460cd4-d1b8-49fa-a806-d866debafda4-node-mnt" (OuterVolumeSpecName: "node-mnt") pod "26460cd4-d1b8-49fa-a806-d866debafda4" (UID: "26460cd4-d1b8-49fa-a806-d866debafda4"). InnerVolumeSpecName "node-mnt". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 17:30:30 crc kubenswrapper[5120]: I0316 17:30:30.264443 5120 reconciler_common.go:299] "Volume detached for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/26460cd4-d1b8-49fa-a806-d866debafda4-node-mnt\") on node \"crc\" DevicePath \"\"" Mar 16 17:30:30 crc kubenswrapper[5120]: I0316 17:30:30.270413 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26460cd4-d1b8-49fa-a806-d866debafda4-kube-api-access-d6c2t" (OuterVolumeSpecName: "kube-api-access-d6c2t") pod "26460cd4-d1b8-49fa-a806-d866debafda4" (UID: "26460cd4-d1b8-49fa-a806-d866debafda4"). InnerVolumeSpecName "kube-api-access-d6c2t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:30:30 crc kubenswrapper[5120]: I0316 17:30:30.295835 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/26460cd4-d1b8-49fa-a806-d866debafda4-crc-storage" (OuterVolumeSpecName: "crc-storage") pod "26460cd4-d1b8-49fa-a806-d866debafda4" (UID: "26460cd4-d1b8-49fa-a806-d866debafda4"). InnerVolumeSpecName "crc-storage". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:30:30 crc kubenswrapper[5120]: I0316 17:30:30.366559 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d6c2t\" (UniqueName: \"kubernetes.io/projected/26460cd4-d1b8-49fa-a806-d866debafda4-kube-api-access-d6c2t\") on node \"crc\" DevicePath \"\"" Mar 16 17:30:30 crc kubenswrapper[5120]: I0316 17:30:30.366593 5120 reconciler_common.go:299] "Volume detached for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/26460cd4-d1b8-49fa-a806-d866debafda4-crc-storage\") on node \"crc\" DevicePath \"\"" Mar 16 17:30:30 crc kubenswrapper[5120]: I0316 17:30:30.677425 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9738c494-7cc4-4663-b2ec-e2f34062c059" path="/var/lib/kubelet/pods/9738c494-7cc4-4663-b2ec-e2f34062c059/volumes" Mar 16 17:30:30 crc kubenswrapper[5120]: I0316 17:30:30.906393 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-zpr2d" event={"ID":"26460cd4-d1b8-49fa-a806-d866debafda4","Type":"ContainerDied","Data":"c7f51c9adc541e34c993430d6de37d40478f78344b4996b71129b9033af8c16f"} Mar 16 17:30:30 crc kubenswrapper[5120]: I0316 17:30:30.906440 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c7f51c9adc541e34c993430d6de37d40478f78344b4996b71129b9033af8c16f" Mar 16 17:30:30 crc kubenswrapper[5120]: I0316 17:30:30.906524 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-zpr2d" Mar 16 17:30:33 crc kubenswrapper[5120]: I0316 17:30:33.438491 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["crc-storage/crc-storage-crc-zpr2d"] Mar 16 17:30:33 crc kubenswrapper[5120]: I0316 17:30:33.444241 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["crc-storage/crc-storage-crc-zpr2d"] Mar 16 17:30:33 crc kubenswrapper[5120]: I0316 17:30:33.573921 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["crc-storage/crc-storage-crc-lqqmq"] Mar 16 17:30:33 crc kubenswrapper[5120]: I0316 17:30:33.574843 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9738c494-7cc4-4663-b2ec-e2f34062c059" containerName="init" Mar 16 17:30:33 crc kubenswrapper[5120]: I0316 17:30:33.574864 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9738c494-7cc4-4663-b2ec-e2f34062c059" containerName="init" Mar 16 17:30:33 crc kubenswrapper[5120]: I0316 17:30:33.574874 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26460cd4-d1b8-49fa-a806-d866debafda4" containerName="storage" Mar 16 17:30:33 crc kubenswrapper[5120]: I0316 17:30:33.574881 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="26460cd4-d1b8-49fa-a806-d866debafda4" containerName="storage" Mar 16 17:30:33 crc kubenswrapper[5120]: I0316 17:30:33.574896 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9738c494-7cc4-4663-b2ec-e2f34062c059" containerName="dnsmasq-dns" Mar 16 17:30:33 crc kubenswrapper[5120]: I0316 17:30:33.574907 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9738c494-7cc4-4663-b2ec-e2f34062c059" containerName="dnsmasq-dns" Mar 16 17:30:33 crc kubenswrapper[5120]: I0316 17:30:33.575085 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="26460cd4-d1b8-49fa-a806-d866debafda4" containerName="storage" Mar 16 17:30:33 crc kubenswrapper[5120]: I0316 17:30:33.575134 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="9738c494-7cc4-4663-b2ec-e2f34062c059" containerName="dnsmasq-dns" Mar 16 17:30:33 crc kubenswrapper[5120]: I0316 17:30:33.588295 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-lqqmq"] Mar 16 17:30:33 crc kubenswrapper[5120]: I0316 17:30:33.590910 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-lqqmq" Mar 16 17:30:33 crc kubenswrapper[5120]: I0316 17:30:33.593932 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"crc-storage\"/\"crc-storage-dockercfg-s2tht\"" Mar 16 17:30:33 crc kubenswrapper[5120]: I0316 17:30:33.594122 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"crc-storage\"" Mar 16 17:30:33 crc kubenswrapper[5120]: I0316 17:30:33.594407 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"openshift-service-ca.crt\"" Mar 16 17:30:33 crc kubenswrapper[5120]: I0316 17:30:33.594420 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"kube-root-ca.crt\"" Mar 16 17:30:33 crc kubenswrapper[5120]: I0316 17:30:33.736909 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/0457d730-d29e-420a-863f-c13998d5915e-node-mnt\") pod \"crc-storage-crc-lqqmq\" (UID: \"0457d730-d29e-420a-863f-c13998d5915e\") " pod="crc-storage/crc-storage-crc-lqqmq" Mar 16 17:30:33 crc kubenswrapper[5120]: I0316 17:30:33.737058 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jsd8b\" (UniqueName: \"kubernetes.io/projected/0457d730-d29e-420a-863f-c13998d5915e-kube-api-access-jsd8b\") pod \"crc-storage-crc-lqqmq\" (UID: \"0457d730-d29e-420a-863f-c13998d5915e\") " pod="crc-storage/crc-storage-crc-lqqmq" Mar 16 17:30:33 crc kubenswrapper[5120]: I0316 17:30:33.737127 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/0457d730-d29e-420a-863f-c13998d5915e-crc-storage\") pod \"crc-storage-crc-lqqmq\" (UID: \"0457d730-d29e-420a-863f-c13998d5915e\") " pod="crc-storage/crc-storage-crc-lqqmq" Mar 16 17:30:33 crc kubenswrapper[5120]: I0316 17:30:33.839064 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/0457d730-d29e-420a-863f-c13998d5915e-node-mnt\") pod \"crc-storage-crc-lqqmq\" (UID: \"0457d730-d29e-420a-863f-c13998d5915e\") " pod="crc-storage/crc-storage-crc-lqqmq" Mar 16 17:30:33 crc kubenswrapper[5120]: I0316 17:30:33.839409 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/0457d730-d29e-420a-863f-c13998d5915e-node-mnt\") pod \"crc-storage-crc-lqqmq\" (UID: \"0457d730-d29e-420a-863f-c13998d5915e\") " pod="crc-storage/crc-storage-crc-lqqmq" Mar 16 17:30:33 crc kubenswrapper[5120]: I0316 17:30:33.839568 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jsd8b\" (UniqueName: \"kubernetes.io/projected/0457d730-d29e-420a-863f-c13998d5915e-kube-api-access-jsd8b\") pod \"crc-storage-crc-lqqmq\" (UID: \"0457d730-d29e-420a-863f-c13998d5915e\") " pod="crc-storage/crc-storage-crc-lqqmq" Mar 16 17:30:33 crc kubenswrapper[5120]: I0316 17:30:33.839727 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/0457d730-d29e-420a-863f-c13998d5915e-crc-storage\") pod \"crc-storage-crc-lqqmq\" (UID: \"0457d730-d29e-420a-863f-c13998d5915e\") " pod="crc-storage/crc-storage-crc-lqqmq" Mar 16 17:30:33 crc kubenswrapper[5120]: I0316 17:30:33.840447 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/0457d730-d29e-420a-863f-c13998d5915e-crc-storage\") pod \"crc-storage-crc-lqqmq\" (UID: \"0457d730-d29e-420a-863f-c13998d5915e\") " pod="crc-storage/crc-storage-crc-lqqmq" Mar 16 17:30:33 crc kubenswrapper[5120]: I0316 17:30:33.857617 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jsd8b\" (UniqueName: \"kubernetes.io/projected/0457d730-d29e-420a-863f-c13998d5915e-kube-api-access-jsd8b\") pod \"crc-storage-crc-lqqmq\" (UID: \"0457d730-d29e-420a-863f-c13998d5915e\") " pod="crc-storage/crc-storage-crc-lqqmq" Mar 16 17:30:33 crc kubenswrapper[5120]: I0316 17:30:33.919060 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-lqqmq" Mar 16 17:30:34 crc kubenswrapper[5120]: I0316 17:30:34.166990 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-lqqmq"] Mar 16 17:30:34 crc kubenswrapper[5120]: I0316 17:30:34.674088 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="26460cd4-d1b8-49fa-a806-d866debafda4" path="/var/lib/kubelet/pods/26460cd4-d1b8-49fa-a806-d866debafda4/volumes" Mar 16 17:30:34 crc kubenswrapper[5120]: I0316 17:30:34.943576 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-lqqmq" event={"ID":"0457d730-d29e-420a-863f-c13998d5915e","Type":"ContainerStarted","Data":"289b54a2184ee566f5da7e2df65d6d53a89a2a9eec8573b42fb0fe16510f1d42"} Mar 16 17:30:35 crc kubenswrapper[5120]: I0316 17:30:35.952662 5120 generic.go:358] "Generic (PLEG): container finished" podID="0457d730-d29e-420a-863f-c13998d5915e" containerID="3b883636fd87d746fac383fa53809c8b2cacb7d041e1212f5b84b65bf4b31721" exitCode=0 Mar 16 17:30:35 crc kubenswrapper[5120]: I0316 17:30:35.952793 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-lqqmq" event={"ID":"0457d730-d29e-420a-863f-c13998d5915e","Type":"ContainerDied","Data":"3b883636fd87d746fac383fa53809c8b2cacb7d041e1212f5b84b65bf4b31721"} Mar 16 17:30:37 crc kubenswrapper[5120]: I0316 17:30:37.212593 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-lqqmq" Mar 16 17:30:37 crc kubenswrapper[5120]: I0316 17:30:37.314458 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/0457d730-d29e-420a-863f-c13998d5915e-crc-storage\") pod \"0457d730-d29e-420a-863f-c13998d5915e\" (UID: \"0457d730-d29e-420a-863f-c13998d5915e\") " Mar 16 17:30:37 crc kubenswrapper[5120]: I0316 17:30:37.314505 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/0457d730-d29e-420a-863f-c13998d5915e-node-mnt\") pod \"0457d730-d29e-420a-863f-c13998d5915e\" (UID: \"0457d730-d29e-420a-863f-c13998d5915e\") " Mar 16 17:30:37 crc kubenswrapper[5120]: I0316 17:30:37.314626 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jsd8b\" (UniqueName: \"kubernetes.io/projected/0457d730-d29e-420a-863f-c13998d5915e-kube-api-access-jsd8b\") pod \"0457d730-d29e-420a-863f-c13998d5915e\" (UID: \"0457d730-d29e-420a-863f-c13998d5915e\") " Mar 16 17:30:37 crc kubenswrapper[5120]: I0316 17:30:37.314685 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/0457d730-d29e-420a-863f-c13998d5915e-node-mnt" (OuterVolumeSpecName: "node-mnt") pod "0457d730-d29e-420a-863f-c13998d5915e" (UID: "0457d730-d29e-420a-863f-c13998d5915e"). InnerVolumeSpecName "node-mnt". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 17:30:37 crc kubenswrapper[5120]: I0316 17:30:37.315441 5120 reconciler_common.go:299] "Volume detached for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/0457d730-d29e-420a-863f-c13998d5915e-node-mnt\") on node \"crc\" DevicePath \"\"" Mar 16 17:30:37 crc kubenswrapper[5120]: I0316 17:30:37.319859 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0457d730-d29e-420a-863f-c13998d5915e-kube-api-access-jsd8b" (OuterVolumeSpecName: "kube-api-access-jsd8b") pod "0457d730-d29e-420a-863f-c13998d5915e" (UID: "0457d730-d29e-420a-863f-c13998d5915e"). InnerVolumeSpecName "kube-api-access-jsd8b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:30:37 crc kubenswrapper[5120]: I0316 17:30:37.337137 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0457d730-d29e-420a-863f-c13998d5915e-crc-storage" (OuterVolumeSpecName: "crc-storage") pod "0457d730-d29e-420a-863f-c13998d5915e" (UID: "0457d730-d29e-420a-863f-c13998d5915e"). InnerVolumeSpecName "crc-storage". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:30:37 crc kubenswrapper[5120]: I0316 17:30:37.417503 5120 reconciler_common.go:299] "Volume detached for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/0457d730-d29e-420a-863f-c13998d5915e-crc-storage\") on node \"crc\" DevicePath \"\"" Mar 16 17:30:37 crc kubenswrapper[5120]: I0316 17:30:37.417535 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jsd8b\" (UniqueName: \"kubernetes.io/projected/0457d730-d29e-420a-863f-c13998d5915e-kube-api-access-jsd8b\") on node \"crc\" DevicePath \"\"" Mar 16 17:30:37 crc kubenswrapper[5120]: I0316 17:30:37.980249 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-lqqmq" Mar 16 17:30:37 crc kubenswrapper[5120]: I0316 17:30:37.980264 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-lqqmq" event={"ID":"0457d730-d29e-420a-863f-c13998d5915e","Type":"ContainerDied","Data":"289b54a2184ee566f5da7e2df65d6d53a89a2a9eec8573b42fb0fe16510f1d42"} Mar 16 17:30:37 crc kubenswrapper[5120]: I0316 17:30:37.980377 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="289b54a2184ee566f5da7e2df65d6d53a89a2a9eec8573b42fb0fe16510f1d42" Mar 16 17:30:38 crc kubenswrapper[5120]: I0316 17:30:38.672671 5120 scope.go:117] "RemoveContainer" containerID="df0a87b047c8208d5fc21057efed33321f6cab49c4cf053702d222dc12979450" Mar 16 17:30:38 crc kubenswrapper[5120]: E0316 17:30:38.673175 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 17:30:40 crc kubenswrapper[5120]: I0316 17:30:40.348531 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-8c5974765-b2qkc"] Mar 16 17:30:40 crc kubenswrapper[5120]: I0316 17:30:40.349726 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0457d730-d29e-420a-863f-c13998d5915e" containerName="storage" Mar 16 17:30:40 crc kubenswrapper[5120]: I0316 17:30:40.349752 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="0457d730-d29e-420a-863f-c13998d5915e" containerName="storage" Mar 16 17:30:40 crc kubenswrapper[5120]: I0316 17:30:40.349947 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="0457d730-d29e-420a-863f-c13998d5915e" containerName="storage" Mar 16 17:30:40 crc kubenswrapper[5120]: I0316 17:30:40.357870 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-8c5974765-b2qkc" Mar 16 17:30:40 crc kubenswrapper[5120]: I0316 17:30:40.360195 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-8c5974765-b2qkc"] Mar 16 17:30:40 crc kubenswrapper[5120]: I0316 17:30:40.360226 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"edpm-compute-no-nodes\"" Mar 16 17:30:40 crc kubenswrapper[5120]: I0316 17:30:40.481184 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/bdd1309f-ffde-462f-aa1d-5e5f6cef3a22-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-8c5974765-b2qkc\" (UID: \"bdd1309f-ffde-462f-aa1d-5e5f6cef3a22\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-8c5974765-b2qkc" Mar 16 17:30:40 crc kubenswrapper[5120]: I0316 17:30:40.481661 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/configmap/bdd1309f-ffde-462f-aa1d-5e5f6cef3a22-edpm-compute-no-nodes\") pod \"dnsmasq-dnsmasq-8c5974765-b2qkc\" (UID: \"bdd1309f-ffde-462f-aa1d-5e5f6cef3a22\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-8c5974765-b2qkc" Mar 16 17:30:40 crc kubenswrapper[5120]: I0316 17:30:40.481714 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gl84m\" (UniqueName: \"kubernetes.io/projected/bdd1309f-ffde-462f-aa1d-5e5f6cef3a22-kube-api-access-gl84m\") pod \"dnsmasq-dnsmasq-8c5974765-b2qkc\" (UID: \"bdd1309f-ffde-462f-aa1d-5e5f6cef3a22\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-8c5974765-b2qkc" Mar 16 17:30:40 crc kubenswrapper[5120]: I0316 17:30:40.481922 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bdd1309f-ffde-462f-aa1d-5e5f6cef3a22-config\") pod \"dnsmasq-dnsmasq-8c5974765-b2qkc\" (UID: \"bdd1309f-ffde-462f-aa1d-5e5f6cef3a22\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-8c5974765-b2qkc" Mar 16 17:30:40 crc kubenswrapper[5120]: I0316 17:30:40.584429 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bdd1309f-ffde-462f-aa1d-5e5f6cef3a22-config\") pod \"dnsmasq-dnsmasq-8c5974765-b2qkc\" (UID: \"bdd1309f-ffde-462f-aa1d-5e5f6cef3a22\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-8c5974765-b2qkc" Mar 16 17:30:40 crc kubenswrapper[5120]: I0316 17:30:40.584583 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/bdd1309f-ffde-462f-aa1d-5e5f6cef3a22-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-8c5974765-b2qkc\" (UID: \"bdd1309f-ffde-462f-aa1d-5e5f6cef3a22\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-8c5974765-b2qkc" Mar 16 17:30:40 crc kubenswrapper[5120]: I0316 17:30:40.584703 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/configmap/bdd1309f-ffde-462f-aa1d-5e5f6cef3a22-edpm-compute-no-nodes\") pod \"dnsmasq-dnsmasq-8c5974765-b2qkc\" (UID: \"bdd1309f-ffde-462f-aa1d-5e5f6cef3a22\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-8c5974765-b2qkc" Mar 16 17:30:40 crc kubenswrapper[5120]: I0316 17:30:40.584786 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gl84m\" (UniqueName: \"kubernetes.io/projected/bdd1309f-ffde-462f-aa1d-5e5f6cef3a22-kube-api-access-gl84m\") pod \"dnsmasq-dnsmasq-8c5974765-b2qkc\" (UID: \"bdd1309f-ffde-462f-aa1d-5e5f6cef3a22\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-8c5974765-b2qkc" Mar 16 17:30:40 crc kubenswrapper[5120]: I0316 17:30:40.585397 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bdd1309f-ffde-462f-aa1d-5e5f6cef3a22-config\") pod \"dnsmasq-dnsmasq-8c5974765-b2qkc\" (UID: \"bdd1309f-ffde-462f-aa1d-5e5f6cef3a22\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-8c5974765-b2qkc" Mar 16 17:30:40 crc kubenswrapper[5120]: I0316 17:30:40.585503 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/configmap/bdd1309f-ffde-462f-aa1d-5e5f6cef3a22-edpm-compute-no-nodes\") pod \"dnsmasq-dnsmasq-8c5974765-b2qkc\" (UID: \"bdd1309f-ffde-462f-aa1d-5e5f6cef3a22\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-8c5974765-b2qkc" Mar 16 17:30:40 crc kubenswrapper[5120]: I0316 17:30:40.585521 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/bdd1309f-ffde-462f-aa1d-5e5f6cef3a22-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-8c5974765-b2qkc\" (UID: \"bdd1309f-ffde-462f-aa1d-5e5f6cef3a22\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-8c5974765-b2qkc" Mar 16 17:30:40 crc kubenswrapper[5120]: I0316 17:30:40.617467 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gl84m\" (UniqueName: \"kubernetes.io/projected/bdd1309f-ffde-462f-aa1d-5e5f6cef3a22-kube-api-access-gl84m\") pod \"dnsmasq-dnsmasq-8c5974765-b2qkc\" (UID: \"bdd1309f-ffde-462f-aa1d-5e5f6cef3a22\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-8c5974765-b2qkc" Mar 16 17:30:40 crc kubenswrapper[5120]: I0316 17:30:40.673286 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-8c5974765-b2qkc" Mar 16 17:30:40 crc kubenswrapper[5120]: I0316 17:30:40.908756 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-8c5974765-b2qkc"] Mar 16 17:30:41 crc kubenswrapper[5120]: I0316 17:30:41.009964 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-8c5974765-b2qkc" event={"ID":"bdd1309f-ffde-462f-aa1d-5e5f6cef3a22","Type":"ContainerStarted","Data":"ce7e942a71b77e8d1e196b82c3546b1dd879ccfe359791971a7df723c0993608"} Mar 16 17:30:42 crc kubenswrapper[5120]: I0316 17:30:42.022668 5120 generic.go:358] "Generic (PLEG): container finished" podID="bdd1309f-ffde-462f-aa1d-5e5f6cef3a22" containerID="31840da0efe96357d2a6cb54201480cd3fd5fbec622be09460c0bd90e5aeb0ad" exitCode=0 Mar 16 17:30:42 crc kubenswrapper[5120]: I0316 17:30:42.022733 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-8c5974765-b2qkc" event={"ID":"bdd1309f-ffde-462f-aa1d-5e5f6cef3a22","Type":"ContainerDied","Data":"31840da0efe96357d2a6cb54201480cd3fd5fbec622be09460c0bd90e5aeb0ad"} Mar 16 17:30:43 crc kubenswrapper[5120]: I0316 17:30:43.033029 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-8c5974765-b2qkc" event={"ID":"bdd1309f-ffde-462f-aa1d-5e5f6cef3a22","Type":"ContainerStarted","Data":"394b9a19e76fad3c78459703be696a43be16efa957f12358ef3a1a1f9177d7dd"} Mar 16 17:30:43 crc kubenswrapper[5120]: I0316 17:30:43.033537 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-8c5974765-b2qkc" Mar 16 17:30:43 crc kubenswrapper[5120]: I0316 17:30:43.052612 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-8c5974765-b2qkc" podStartSLOduration=3.052592964 podStartE2EDuration="3.052592964s" podCreationTimestamp="2026-03-16 17:30:40 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:30:43.046371514 +0000 UTC m=+7145.200303171" watchObservedRunningTime="2026-03-16 17:30:43.052592964 +0000 UTC m=+7145.206524621" Mar 16 17:30:49 crc kubenswrapper[5120]: I0316 17:30:49.042990 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-8c5974765-b2qkc" Mar 16 17:30:49 crc kubenswrapper[5120]: I0316 17:30:49.093188 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-mvthj"] Mar 16 17:30:49 crc kubenswrapper[5120]: I0316 17:30:49.093467 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-mvthj" podUID="4b8eed83-ada0-4695-b200-bfbaeb51ffc7" containerName="dnsmasq-dns" containerID="cri-o://a612fcb56546dba762d48d3906bd1a3b88734aaad0f1b4ba29adc3121b24dbb0" gracePeriod=10 Mar 16 17:30:49 crc kubenswrapper[5120]: I0316 17:30:49.530178 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-mvthj" Mar 16 17:30:49 crc kubenswrapper[5120]: I0316 17:30:49.615079 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/4b8eed83-ada0-4695-b200-bfbaeb51ffc7-dnsmasq-svc\") pod \"4b8eed83-ada0-4695-b200-bfbaeb51ffc7\" (UID: \"4b8eed83-ada0-4695-b200-bfbaeb51ffc7\") " Mar 16 17:30:49 crc kubenswrapper[5120]: I0316 17:30:49.615122 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4b8eed83-ada0-4695-b200-bfbaeb51ffc7-config\") pod \"4b8eed83-ada0-4695-b200-bfbaeb51ffc7\" (UID: \"4b8eed83-ada0-4695-b200-bfbaeb51ffc7\") " Mar 16 17:30:49 crc kubenswrapper[5120]: I0316 17:30:49.615342 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bzk5n\" (UniqueName: \"kubernetes.io/projected/4b8eed83-ada0-4695-b200-bfbaeb51ffc7-kube-api-access-bzk5n\") pod \"4b8eed83-ada0-4695-b200-bfbaeb51ffc7\" (UID: \"4b8eed83-ada0-4695-b200-bfbaeb51ffc7\") " Mar 16 17:30:49 crc kubenswrapper[5120]: I0316 17:30:49.621203 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b8eed83-ada0-4695-b200-bfbaeb51ffc7-kube-api-access-bzk5n" (OuterVolumeSpecName: "kube-api-access-bzk5n") pod "4b8eed83-ada0-4695-b200-bfbaeb51ffc7" (UID: "4b8eed83-ada0-4695-b200-bfbaeb51ffc7"). InnerVolumeSpecName "kube-api-access-bzk5n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:30:49 crc kubenswrapper[5120]: I0316 17:30:49.652213 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b8eed83-ada0-4695-b200-bfbaeb51ffc7-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "4b8eed83-ada0-4695-b200-bfbaeb51ffc7" (UID: "4b8eed83-ada0-4695-b200-bfbaeb51ffc7"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:30:49 crc kubenswrapper[5120]: I0316 17:30:49.654818 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b8eed83-ada0-4695-b200-bfbaeb51ffc7-config" (OuterVolumeSpecName: "config") pod "4b8eed83-ada0-4695-b200-bfbaeb51ffc7" (UID: "4b8eed83-ada0-4695-b200-bfbaeb51ffc7"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:30:49 crc kubenswrapper[5120]: I0316 17:30:49.717888 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bzk5n\" (UniqueName: \"kubernetes.io/projected/4b8eed83-ada0-4695-b200-bfbaeb51ffc7-kube-api-access-bzk5n\") on node \"crc\" DevicePath \"\"" Mar 16 17:30:49 crc kubenswrapper[5120]: I0316 17:30:49.717927 5120 reconciler_common.go:299] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/4b8eed83-ada0-4695-b200-bfbaeb51ffc7-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Mar 16 17:30:49 crc kubenswrapper[5120]: I0316 17:30:49.717938 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4b8eed83-ada0-4695-b200-bfbaeb51ffc7-config\") on node \"crc\" DevicePath \"\"" Mar 16 17:30:50 crc kubenswrapper[5120]: I0316 17:30:50.106405 5120 generic.go:358] "Generic (PLEG): container finished" podID="4b8eed83-ada0-4695-b200-bfbaeb51ffc7" containerID="a612fcb56546dba762d48d3906bd1a3b88734aaad0f1b4ba29adc3121b24dbb0" exitCode=0 Mar 16 17:30:50 crc kubenswrapper[5120]: I0316 17:30:50.106465 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-mvthj" event={"ID":"4b8eed83-ada0-4695-b200-bfbaeb51ffc7","Type":"ContainerDied","Data":"a612fcb56546dba762d48d3906bd1a3b88734aaad0f1b4ba29adc3121b24dbb0"} Mar 16 17:30:50 crc kubenswrapper[5120]: I0316 17:30:50.106864 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-mvthj" event={"ID":"4b8eed83-ada0-4695-b200-bfbaeb51ffc7","Type":"ContainerDied","Data":"f1e275716e8375f8e19a8347bdf21dbd9f39f2c064510b96d7fb55726684734d"} Mar 16 17:30:50 crc kubenswrapper[5120]: I0316 17:30:50.106511 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-mvthj" Mar 16 17:30:50 crc kubenswrapper[5120]: I0316 17:30:50.106905 5120 scope.go:117] "RemoveContainer" containerID="a612fcb56546dba762d48d3906bd1a3b88734aaad0f1b4ba29adc3121b24dbb0" Mar 16 17:30:50 crc kubenswrapper[5120]: I0316 17:30:50.130905 5120 scope.go:117] "RemoveContainer" containerID="06c19f4c3ba386790e9067715fb60362301906808b0ebb074cd986101a8431f9" Mar 16 17:30:50 crc kubenswrapper[5120]: I0316 17:30:50.143557 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-mvthj"] Mar 16 17:30:50 crc kubenswrapper[5120]: I0316 17:30:50.150089 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-mvthj"] Mar 16 17:30:50 crc kubenswrapper[5120]: I0316 17:30:50.161666 5120 scope.go:117] "RemoveContainer" containerID="a612fcb56546dba762d48d3906bd1a3b88734aaad0f1b4ba29adc3121b24dbb0" Mar 16 17:30:50 crc kubenswrapper[5120]: E0316 17:30:50.162205 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a612fcb56546dba762d48d3906bd1a3b88734aaad0f1b4ba29adc3121b24dbb0\": container with ID starting with a612fcb56546dba762d48d3906bd1a3b88734aaad0f1b4ba29adc3121b24dbb0 not found: ID does not exist" containerID="a612fcb56546dba762d48d3906bd1a3b88734aaad0f1b4ba29adc3121b24dbb0" Mar 16 17:30:50 crc kubenswrapper[5120]: I0316 17:30:50.162254 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a612fcb56546dba762d48d3906bd1a3b88734aaad0f1b4ba29adc3121b24dbb0"} err="failed to get container status \"a612fcb56546dba762d48d3906bd1a3b88734aaad0f1b4ba29adc3121b24dbb0\": rpc error: code = NotFound desc = could not find container \"a612fcb56546dba762d48d3906bd1a3b88734aaad0f1b4ba29adc3121b24dbb0\": container with ID starting with a612fcb56546dba762d48d3906bd1a3b88734aaad0f1b4ba29adc3121b24dbb0 not found: ID does not exist" Mar 16 17:30:50 crc kubenswrapper[5120]: I0316 17:30:50.162281 5120 scope.go:117] "RemoveContainer" containerID="06c19f4c3ba386790e9067715fb60362301906808b0ebb074cd986101a8431f9" Mar 16 17:30:50 crc kubenswrapper[5120]: E0316 17:30:50.162631 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"06c19f4c3ba386790e9067715fb60362301906808b0ebb074cd986101a8431f9\": container with ID starting with 06c19f4c3ba386790e9067715fb60362301906808b0ebb074cd986101a8431f9 not found: ID does not exist" containerID="06c19f4c3ba386790e9067715fb60362301906808b0ebb074cd986101a8431f9" Mar 16 17:30:50 crc kubenswrapper[5120]: I0316 17:30:50.162677 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"06c19f4c3ba386790e9067715fb60362301906808b0ebb074cd986101a8431f9"} err="failed to get container status \"06c19f4c3ba386790e9067715fb60362301906808b0ebb074cd986101a8431f9\": rpc error: code = NotFound desc = could not find container \"06c19f4c3ba386790e9067715fb60362301906808b0ebb074cd986101a8431f9\": container with ID starting with 06c19f4c3ba386790e9067715fb60362301906808b0ebb074cd986101a8431f9 not found: ID does not exist" Mar 16 17:30:50 crc kubenswrapper[5120]: I0316 17:30:50.675575 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b8eed83-ada0-4695-b200-bfbaeb51ffc7" path="/var/lib/kubelet/pods/4b8eed83-ada0-4695-b200-bfbaeb51ffc7/volumes" Mar 16 17:30:53 crc kubenswrapper[5120]: I0316 17:30:53.663427 5120 scope.go:117] "RemoveContainer" containerID="df0a87b047c8208d5fc21057efed33321f6cab49c4cf053702d222dc12979450" Mar 16 17:30:53 crc kubenswrapper[5120]: E0316 17:30:53.664182 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 17:30:55 crc kubenswrapper[5120]: I0316 17:30:55.299889 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-wd9wf"] Mar 16 17:30:55 crc kubenswrapper[5120]: I0316 17:30:55.301136 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b8eed83-ada0-4695-b200-bfbaeb51ffc7" containerName="init" Mar 16 17:30:55 crc kubenswrapper[5120]: I0316 17:30:55.301158 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b8eed83-ada0-4695-b200-bfbaeb51ffc7" containerName="init" Mar 16 17:30:55 crc kubenswrapper[5120]: I0316 17:30:55.301193 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b8eed83-ada0-4695-b200-bfbaeb51ffc7" containerName="dnsmasq-dns" Mar 16 17:30:55 crc kubenswrapper[5120]: I0316 17:30:55.301202 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b8eed83-ada0-4695-b200-bfbaeb51ffc7" containerName="dnsmasq-dns" Mar 16 17:30:55 crc kubenswrapper[5120]: I0316 17:30:55.301451 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="4b8eed83-ada0-4695-b200-bfbaeb51ffc7" containerName="dnsmasq-dns" Mar 16 17:30:55 crc kubenswrapper[5120]: I0316 17:30:55.307172 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-wd9wf" Mar 16 17:30:55 crc kubenswrapper[5120]: I0316 17:30:55.309166 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"edpm-compute-no-nodes-dockercfg-zqzw2\"" Mar 16 17:30:55 crc kubenswrapper[5120]: I0316 17:30:55.309371 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"kuttl-service-cm-0\"" Mar 16 17:30:55 crc kubenswrapper[5120]: I0316 17:30:55.309558 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplane-ansible-ssh-private-key-secret\"" Mar 16 17:30:55 crc kubenswrapper[5120]: I0316 17:30:55.310099 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-aee-default-env\"" Mar 16 17:30:55 crc kubenswrapper[5120]: I0316 17:30:55.310142 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplanenodeset-edpm-compute-no-nodes\"" Mar 16 17:30:55 crc kubenswrapper[5120]: I0316 17:30:55.310468 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"kuttl-service-cm-1\"" Mar 16 17:30:55 crc kubenswrapper[5120]: I0316 17:30:55.310484 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"combined-ca-bundle\"" Mar 16 17:30:55 crc kubenswrapper[5120]: I0316 17:30:55.310577 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"kuttl-service-cm-2\"" Mar 16 17:30:55 crc kubenswrapper[5120]: I0316 17:30:55.315870 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-wd9wf"] Mar 16 17:30:55 crc kubenswrapper[5120]: I0316 17:30:55.448847 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kuttl-service-cm-2-0\" (UniqueName: \"kubernetes.io/configmap/6f0ac35c-eae8-4ead-9bce-441f102640c0-kuttl-service-cm-2-0\") pod \"kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-wd9wf\" (UID: \"6f0ac35c-eae8-4ead-9bce-441f102640c0\") " pod="openstack-kuttl-tests/kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-wd9wf" Mar 16 17:30:55 crc kubenswrapper[5120]: I0316 17:30:55.448884 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/6f0ac35c-eae8-4ead-9bce-441f102640c0-ssh-key-edpm-compute-no-nodes\") pod \"kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-wd9wf\" (UID: \"6f0ac35c-eae8-4ead-9bce-441f102640c0\") " pod="openstack-kuttl-tests/kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-wd9wf" Mar 16 17:30:55 crc kubenswrapper[5120]: I0316 17:30:55.448971 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kuttl-service-cm-0-2\" (UniqueName: \"kubernetes.io/configmap/6f0ac35c-eae8-4ead-9bce-441f102640c0-kuttl-service-cm-0-2\") pod \"kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-wd9wf\" (UID: \"6f0ac35c-eae8-4ead-9bce-441f102640c0\") " pod="openstack-kuttl-tests/kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-wd9wf" Mar 16 17:30:55 crc kubenswrapper[5120]: I0316 17:30:55.449054 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kuttl-service-cm-1-0\" (UniqueName: \"kubernetes.io/configmap/6f0ac35c-eae8-4ead-9bce-441f102640c0-kuttl-service-cm-1-0\") pod \"kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-wd9wf\" (UID: \"6f0ac35c-eae8-4ead-9bce-441f102640c0\") " pod="openstack-kuttl-tests/kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-wd9wf" Mar 16 17:30:55 crc kubenswrapper[5120]: I0316 17:30:55.449127 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kuttl-service-cm-1-1\" (UniqueName: \"kubernetes.io/configmap/6f0ac35c-eae8-4ead-9bce-441f102640c0-kuttl-service-cm-1-1\") pod \"kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-wd9wf\" (UID: \"6f0ac35c-eae8-4ead-9bce-441f102640c0\") " pod="openstack-kuttl-tests/kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-wd9wf" Mar 16 17:30:55 crc kubenswrapper[5120]: I0316 17:30:55.449189 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kuttl-service-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6f0ac35c-eae8-4ead-9bce-441f102640c0-kuttl-service-combined-ca-bundle\") pod \"kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-wd9wf\" (UID: \"6f0ac35c-eae8-4ead-9bce-441f102640c0\") " pod="openstack-kuttl-tests/kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-wd9wf" Mar 16 17:30:55 crc kubenswrapper[5120]: I0316 17:30:55.449217 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kuttl-service-cm-0-1\" (UniqueName: \"kubernetes.io/configmap/6f0ac35c-eae8-4ead-9bce-441f102640c0-kuttl-service-cm-0-1\") pod \"kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-wd9wf\" (UID: \"6f0ac35c-eae8-4ead-9bce-441f102640c0\") " pod="openstack-kuttl-tests/kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-wd9wf" Mar 16 17:30:55 crc kubenswrapper[5120]: I0316 17:30:55.449242 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kuttl-service-cm-0-0\" (UniqueName: \"kubernetes.io/configmap/6f0ac35c-eae8-4ead-9bce-441f102640c0-kuttl-service-cm-0-0\") pod \"kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-wd9wf\" (UID: \"6f0ac35c-eae8-4ead-9bce-441f102640c0\") " pod="openstack-kuttl-tests/kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-wd9wf" Mar 16 17:30:55 crc kubenswrapper[5120]: I0316 17:30:55.449294 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/6f0ac35c-eae8-4ead-9bce-441f102640c0-inventory\") pod \"kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-wd9wf\" (UID: \"6f0ac35c-eae8-4ead-9bce-441f102640c0\") " pod="openstack-kuttl-tests/kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-wd9wf" Mar 16 17:30:55 crc kubenswrapper[5120]: I0316 17:30:55.449343 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4nf8j\" (UniqueName: \"kubernetes.io/projected/6f0ac35c-eae8-4ead-9bce-441f102640c0-kube-api-access-4nf8j\") pod \"kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-wd9wf\" (UID: \"6f0ac35c-eae8-4ead-9bce-441f102640c0\") " pod="openstack-kuttl-tests/kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-wd9wf" Mar 16 17:30:55 crc kubenswrapper[5120]: I0316 17:30:55.449402 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kuttl-service-cm-1-2\" (UniqueName: \"kubernetes.io/configmap/6f0ac35c-eae8-4ead-9bce-441f102640c0-kuttl-service-cm-1-2\") pod \"kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-wd9wf\" (UID: \"6f0ac35c-eae8-4ead-9bce-441f102640c0\") " pod="openstack-kuttl-tests/kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-wd9wf" Mar 16 17:30:55 crc kubenswrapper[5120]: I0316 17:30:55.550724 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kuttl-service-cm-2-0\" (UniqueName: \"kubernetes.io/configmap/6f0ac35c-eae8-4ead-9bce-441f102640c0-kuttl-service-cm-2-0\") pod \"kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-wd9wf\" (UID: \"6f0ac35c-eae8-4ead-9bce-441f102640c0\") " pod="openstack-kuttl-tests/kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-wd9wf" Mar 16 17:30:55 crc kubenswrapper[5120]: I0316 17:30:55.550796 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/6f0ac35c-eae8-4ead-9bce-441f102640c0-ssh-key-edpm-compute-no-nodes\") pod \"kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-wd9wf\" (UID: \"6f0ac35c-eae8-4ead-9bce-441f102640c0\") " pod="openstack-kuttl-tests/kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-wd9wf" Mar 16 17:30:55 crc kubenswrapper[5120]: I0316 17:30:55.550858 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kuttl-service-cm-0-2\" (UniqueName: \"kubernetes.io/configmap/6f0ac35c-eae8-4ead-9bce-441f102640c0-kuttl-service-cm-0-2\") pod \"kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-wd9wf\" (UID: \"6f0ac35c-eae8-4ead-9bce-441f102640c0\") " pod="openstack-kuttl-tests/kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-wd9wf" Mar 16 17:30:55 crc kubenswrapper[5120]: I0316 17:30:55.550941 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kuttl-service-cm-1-0\" (UniqueName: \"kubernetes.io/configmap/6f0ac35c-eae8-4ead-9bce-441f102640c0-kuttl-service-cm-1-0\") pod \"kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-wd9wf\" (UID: \"6f0ac35c-eae8-4ead-9bce-441f102640c0\") " pod="openstack-kuttl-tests/kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-wd9wf" Mar 16 17:30:55 crc kubenswrapper[5120]: I0316 17:30:55.550997 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kuttl-service-cm-1-1\" (UniqueName: \"kubernetes.io/configmap/6f0ac35c-eae8-4ead-9bce-441f102640c0-kuttl-service-cm-1-1\") pod \"kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-wd9wf\" (UID: \"6f0ac35c-eae8-4ead-9bce-441f102640c0\") " pod="openstack-kuttl-tests/kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-wd9wf" Mar 16 17:30:55 crc kubenswrapper[5120]: I0316 17:30:55.551061 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kuttl-service-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6f0ac35c-eae8-4ead-9bce-441f102640c0-kuttl-service-combined-ca-bundle\") pod \"kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-wd9wf\" (UID: \"6f0ac35c-eae8-4ead-9bce-441f102640c0\") " pod="openstack-kuttl-tests/kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-wd9wf" Mar 16 17:30:55 crc kubenswrapper[5120]: I0316 17:30:55.551118 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kuttl-service-cm-0-1\" (UniqueName: \"kubernetes.io/configmap/6f0ac35c-eae8-4ead-9bce-441f102640c0-kuttl-service-cm-0-1\") pod \"kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-wd9wf\" (UID: \"6f0ac35c-eae8-4ead-9bce-441f102640c0\") " pod="openstack-kuttl-tests/kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-wd9wf" Mar 16 17:30:55 crc kubenswrapper[5120]: I0316 17:30:55.551139 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kuttl-service-cm-0-0\" (UniqueName: \"kubernetes.io/configmap/6f0ac35c-eae8-4ead-9bce-441f102640c0-kuttl-service-cm-0-0\") pod \"kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-wd9wf\" (UID: \"6f0ac35c-eae8-4ead-9bce-441f102640c0\") " pod="openstack-kuttl-tests/kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-wd9wf" Mar 16 17:30:55 crc kubenswrapper[5120]: I0316 17:30:55.551207 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/6f0ac35c-eae8-4ead-9bce-441f102640c0-inventory\") pod \"kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-wd9wf\" (UID: \"6f0ac35c-eae8-4ead-9bce-441f102640c0\") " pod="openstack-kuttl-tests/kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-wd9wf" Mar 16 17:30:55 crc kubenswrapper[5120]: I0316 17:30:55.551231 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4nf8j\" (UniqueName: \"kubernetes.io/projected/6f0ac35c-eae8-4ead-9bce-441f102640c0-kube-api-access-4nf8j\") pod \"kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-wd9wf\" (UID: \"6f0ac35c-eae8-4ead-9bce-441f102640c0\") " pod="openstack-kuttl-tests/kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-wd9wf" Mar 16 17:30:55 crc kubenswrapper[5120]: I0316 17:30:55.551256 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kuttl-service-cm-1-2\" (UniqueName: \"kubernetes.io/configmap/6f0ac35c-eae8-4ead-9bce-441f102640c0-kuttl-service-cm-1-2\") pod \"kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-wd9wf\" (UID: \"6f0ac35c-eae8-4ead-9bce-441f102640c0\") " pod="openstack-kuttl-tests/kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-wd9wf" Mar 16 17:30:55 crc kubenswrapper[5120]: I0316 17:30:55.551972 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kuttl-service-cm-1-0\" (UniqueName: \"kubernetes.io/configmap/6f0ac35c-eae8-4ead-9bce-441f102640c0-kuttl-service-cm-1-0\") pod \"kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-wd9wf\" (UID: \"6f0ac35c-eae8-4ead-9bce-441f102640c0\") " pod="openstack-kuttl-tests/kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-wd9wf" Mar 16 17:30:55 crc kubenswrapper[5120]: I0316 17:30:55.552348 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kuttl-service-cm-1-2\" (UniqueName: \"kubernetes.io/configmap/6f0ac35c-eae8-4ead-9bce-441f102640c0-kuttl-service-cm-1-2\") pod \"kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-wd9wf\" (UID: \"6f0ac35c-eae8-4ead-9bce-441f102640c0\") " pod="openstack-kuttl-tests/kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-wd9wf" Mar 16 17:30:55 crc kubenswrapper[5120]: I0316 17:30:55.552430 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kuttl-service-cm-0-0\" (UniqueName: \"kubernetes.io/configmap/6f0ac35c-eae8-4ead-9bce-441f102640c0-kuttl-service-cm-0-0\") pod \"kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-wd9wf\" (UID: \"6f0ac35c-eae8-4ead-9bce-441f102640c0\") " pod="openstack-kuttl-tests/kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-wd9wf" Mar 16 17:30:55 crc kubenswrapper[5120]: I0316 17:30:55.552911 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kuttl-service-cm-2-0\" (UniqueName: \"kubernetes.io/configmap/6f0ac35c-eae8-4ead-9bce-441f102640c0-kuttl-service-cm-2-0\") pod \"kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-wd9wf\" (UID: \"6f0ac35c-eae8-4ead-9bce-441f102640c0\") " pod="openstack-kuttl-tests/kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-wd9wf" Mar 16 17:30:55 crc kubenswrapper[5120]: I0316 17:30:55.553195 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kuttl-service-cm-0-1\" (UniqueName: \"kubernetes.io/configmap/6f0ac35c-eae8-4ead-9bce-441f102640c0-kuttl-service-cm-0-1\") pod \"kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-wd9wf\" (UID: \"6f0ac35c-eae8-4ead-9bce-441f102640c0\") " pod="openstack-kuttl-tests/kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-wd9wf" Mar 16 17:30:55 crc kubenswrapper[5120]: I0316 17:30:55.553367 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kuttl-service-cm-0-2\" (UniqueName: \"kubernetes.io/configmap/6f0ac35c-eae8-4ead-9bce-441f102640c0-kuttl-service-cm-0-2\") pod \"kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-wd9wf\" (UID: \"6f0ac35c-eae8-4ead-9bce-441f102640c0\") " pod="openstack-kuttl-tests/kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-wd9wf" Mar 16 17:30:55 crc kubenswrapper[5120]: I0316 17:30:55.553653 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kuttl-service-cm-1-1\" (UniqueName: \"kubernetes.io/configmap/6f0ac35c-eae8-4ead-9bce-441f102640c0-kuttl-service-cm-1-1\") pod \"kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-wd9wf\" (UID: \"6f0ac35c-eae8-4ead-9bce-441f102640c0\") " pod="openstack-kuttl-tests/kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-wd9wf" Mar 16 17:30:55 crc kubenswrapper[5120]: I0316 17:30:55.556990 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/6f0ac35c-eae8-4ead-9bce-441f102640c0-inventory\") pod \"kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-wd9wf\" (UID: \"6f0ac35c-eae8-4ead-9bce-441f102640c0\") " pod="openstack-kuttl-tests/kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-wd9wf" Mar 16 17:30:55 crc kubenswrapper[5120]: I0316 17:30:55.557239 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kuttl-service-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6f0ac35c-eae8-4ead-9bce-441f102640c0-kuttl-service-combined-ca-bundle\") pod \"kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-wd9wf\" (UID: \"6f0ac35c-eae8-4ead-9bce-441f102640c0\") " pod="openstack-kuttl-tests/kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-wd9wf" Mar 16 17:30:55 crc kubenswrapper[5120]: I0316 17:30:55.557915 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/6f0ac35c-eae8-4ead-9bce-441f102640c0-ssh-key-edpm-compute-no-nodes\") pod \"kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-wd9wf\" (UID: \"6f0ac35c-eae8-4ead-9bce-441f102640c0\") " pod="openstack-kuttl-tests/kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-wd9wf" Mar 16 17:30:55 crc kubenswrapper[5120]: I0316 17:30:55.568509 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4nf8j\" (UniqueName: \"kubernetes.io/projected/6f0ac35c-eae8-4ead-9bce-441f102640c0-kube-api-access-4nf8j\") pod \"kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-wd9wf\" (UID: \"6f0ac35c-eae8-4ead-9bce-441f102640c0\") " pod="openstack-kuttl-tests/kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-wd9wf" Mar 16 17:30:55 crc kubenswrapper[5120]: I0316 17:30:55.641609 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-wd9wf" Mar 16 17:30:56 crc kubenswrapper[5120]: I0316 17:30:56.078238 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-wd9wf"] Mar 16 17:30:56 crc kubenswrapper[5120]: I0316 17:30:56.163095 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-wd9wf" event={"ID":"6f0ac35c-eae8-4ead-9bce-441f102640c0","Type":"ContainerStarted","Data":"e2963c8610dc2c1e7192a91514c2ba0afdc5c7b518e4defc78db969c480261d1"} Mar 16 17:30:57 crc kubenswrapper[5120]: I0316 17:30:57.183818 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-wd9wf" event={"ID":"6f0ac35c-eae8-4ead-9bce-441f102640c0","Type":"ContainerStarted","Data":"4b9c5baa416342d96c0e0a29ed1a971aff85a46f150da0a691d4d88b828a43f7"} Mar 16 17:30:57 crc kubenswrapper[5120]: I0316 17:30:57.209664 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-wd9wf" podStartSLOduration=1.351724033 podStartE2EDuration="2.209644474s" podCreationTimestamp="2026-03-16 17:30:55 +0000 UTC" firstStartedPulling="2026-03-16 17:30:56.086128405 +0000 UTC m=+7158.240060062" lastFinishedPulling="2026-03-16 17:30:56.944048846 +0000 UTC m=+7159.097980503" observedRunningTime="2026-03-16 17:30:57.203483276 +0000 UTC m=+7159.357414943" watchObservedRunningTime="2026-03-16 17:30:57.209644474 +0000 UTC m=+7159.363576131" Mar 16 17:30:58 crc kubenswrapper[5120]: I0316 17:30:58.384713 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-wd9wf"] Mar 16 17:30:58 crc kubenswrapper[5120]: I0316 17:30:58.457117 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-vhnqf"] Mar 16 17:30:58 crc kubenswrapper[5120]: I0316 17:30:58.469123 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-vhnqf" Mar 16 17:30:58 crc kubenswrapper[5120]: I0316 17:30:58.469641 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-vhnqf"] Mar 16 17:30:58 crc kubenswrapper[5120]: I0316 17:30:58.613396 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/8cd65401-2ccd-48bf-8103-caf1c7b81ea7-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-79dcd846c5-vhnqf\" (UID: \"8cd65401-2ccd-48bf-8103-caf1c7b81ea7\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-vhnqf" Mar 16 17:30:58 crc kubenswrapper[5120]: I0316 17:30:58.613752 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbt9p\" (UniqueName: \"kubernetes.io/projected/8cd65401-2ccd-48bf-8103-caf1c7b81ea7-kube-api-access-zbt9p\") pod \"dnsmasq-dnsmasq-79dcd846c5-vhnqf\" (UID: \"8cd65401-2ccd-48bf-8103-caf1c7b81ea7\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-vhnqf" Mar 16 17:30:58 crc kubenswrapper[5120]: I0316 17:30:58.613825 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8cd65401-2ccd-48bf-8103-caf1c7b81ea7-config\") pod \"dnsmasq-dnsmasq-79dcd846c5-vhnqf\" (UID: \"8cd65401-2ccd-48bf-8103-caf1c7b81ea7\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-vhnqf" Mar 16 17:30:58 crc kubenswrapper[5120]: I0316 17:30:58.715356 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zbt9p\" (UniqueName: \"kubernetes.io/projected/8cd65401-2ccd-48bf-8103-caf1c7b81ea7-kube-api-access-zbt9p\") pod \"dnsmasq-dnsmasq-79dcd846c5-vhnqf\" (UID: \"8cd65401-2ccd-48bf-8103-caf1c7b81ea7\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-vhnqf" Mar 16 17:30:58 crc kubenswrapper[5120]: I0316 17:30:58.715444 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8cd65401-2ccd-48bf-8103-caf1c7b81ea7-config\") pod \"dnsmasq-dnsmasq-79dcd846c5-vhnqf\" (UID: \"8cd65401-2ccd-48bf-8103-caf1c7b81ea7\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-vhnqf" Mar 16 17:30:58 crc kubenswrapper[5120]: I0316 17:30:58.715547 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/8cd65401-2ccd-48bf-8103-caf1c7b81ea7-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-79dcd846c5-vhnqf\" (UID: \"8cd65401-2ccd-48bf-8103-caf1c7b81ea7\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-vhnqf" Mar 16 17:30:58 crc kubenswrapper[5120]: I0316 17:30:58.716619 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/8cd65401-2ccd-48bf-8103-caf1c7b81ea7-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-79dcd846c5-vhnqf\" (UID: \"8cd65401-2ccd-48bf-8103-caf1c7b81ea7\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-vhnqf" Mar 16 17:30:58 crc kubenswrapper[5120]: I0316 17:30:58.716840 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8cd65401-2ccd-48bf-8103-caf1c7b81ea7-config\") pod \"dnsmasq-dnsmasq-79dcd846c5-vhnqf\" (UID: \"8cd65401-2ccd-48bf-8103-caf1c7b81ea7\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-vhnqf" Mar 16 17:30:58 crc kubenswrapper[5120]: I0316 17:30:58.739829 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbt9p\" (UniqueName: \"kubernetes.io/projected/8cd65401-2ccd-48bf-8103-caf1c7b81ea7-kube-api-access-zbt9p\") pod \"dnsmasq-dnsmasq-79dcd846c5-vhnqf\" (UID: \"8cd65401-2ccd-48bf-8103-caf1c7b81ea7\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-vhnqf" Mar 16 17:30:58 crc kubenswrapper[5120]: I0316 17:30:58.791374 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-vhnqf" Mar 16 17:30:59 crc kubenswrapper[5120]: I0316 17:30:59.199118 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-wd9wf" podUID="6f0ac35c-eae8-4ead-9bce-441f102640c0" containerName="kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes" containerID="cri-o://4b9c5baa416342d96c0e0a29ed1a971aff85a46f150da0a691d4d88b828a43f7" gracePeriod=30 Mar 16 17:30:59 crc kubenswrapper[5120]: I0316 17:30:59.232664 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-vhnqf"] Mar 16 17:30:59 crc kubenswrapper[5120]: W0316 17:30:59.236534 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8cd65401_2ccd_48bf_8103_caf1c7b81ea7.slice/crio-5def8cd68b199be3f0e4b8dcedacc7c3af4a1008d752e930fd08ab1d4be55bc7 WatchSource:0}: Error finding container 5def8cd68b199be3f0e4b8dcedacc7c3af4a1008d752e930fd08ab1d4be55bc7: Status 404 returned error can't find the container with id 5def8cd68b199be3f0e4b8dcedacc7c3af4a1008d752e930fd08ab1d4be55bc7 Mar 16 17:31:00 crc kubenswrapper[5120]: I0316 17:31:00.210892 5120 generic.go:358] "Generic (PLEG): container finished" podID="8cd65401-2ccd-48bf-8103-caf1c7b81ea7" containerID="f77e66934df22a8b9cfc852b5e3b40cf48ccb6c5f96ca1300f68d7d959b1095a" exitCode=0 Mar 16 17:31:00 crc kubenswrapper[5120]: I0316 17:31:00.210957 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-vhnqf" event={"ID":"8cd65401-2ccd-48bf-8103-caf1c7b81ea7","Type":"ContainerDied","Data":"f77e66934df22a8b9cfc852b5e3b40cf48ccb6c5f96ca1300f68d7d959b1095a"} Mar 16 17:31:00 crc kubenswrapper[5120]: I0316 17:31:00.211251 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-vhnqf" event={"ID":"8cd65401-2ccd-48bf-8103-caf1c7b81ea7","Type":"ContainerStarted","Data":"5def8cd68b199be3f0e4b8dcedacc7c3af4a1008d752e930fd08ab1d4be55bc7"} Mar 16 17:31:01 crc kubenswrapper[5120]: I0316 17:31:01.223573 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-vhnqf" event={"ID":"8cd65401-2ccd-48bf-8103-caf1c7b81ea7","Type":"ContainerStarted","Data":"b750bca2295eb68789f2a737488715a80393c4f2e89325ea802363297dec96e7"} Mar 16 17:31:01 crc kubenswrapper[5120]: I0316 17:31:01.223908 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-vhnqf" Mar 16 17:31:01 crc kubenswrapper[5120]: I0316 17:31:01.239208 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-vhnqf" podStartSLOduration=3.239190995 podStartE2EDuration="3.239190995s" podCreationTimestamp="2026-03-16 17:30:58 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:31:01.238464686 +0000 UTC m=+7163.392396343" watchObservedRunningTime="2026-03-16 17:31:01.239190995 +0000 UTC m=+7163.393122642" Mar 16 17:31:05 crc kubenswrapper[5120]: I0316 17:31:05.625940 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["crc-storage/crc-storage-crc-lqqmq"] Mar 16 17:31:05 crc kubenswrapper[5120]: I0316 17:31:05.633393 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["crc-storage/crc-storage-crc-lqqmq"] Mar 16 17:31:05 crc kubenswrapper[5120]: I0316 17:31:05.755591 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["crc-storage/crc-storage-crc-t9w2w"] Mar 16 17:31:05 crc kubenswrapper[5120]: I0316 17:31:05.764886 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-t9w2w"] Mar 16 17:31:05 crc kubenswrapper[5120]: I0316 17:31:05.765016 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-t9w2w" Mar 16 17:31:05 crc kubenswrapper[5120]: I0316 17:31:05.769469 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"kube-root-ca.crt\"" Mar 16 17:31:05 crc kubenswrapper[5120]: I0316 17:31:05.769753 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"openshift-service-ca.crt\"" Mar 16 17:31:05 crc kubenswrapper[5120]: I0316 17:31:05.769951 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"crc-storage\"" Mar 16 17:31:05 crc kubenswrapper[5120]: I0316 17:31:05.770139 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"crc-storage\"/\"crc-storage-dockercfg-s2tht\"" Mar 16 17:31:05 crc kubenswrapper[5120]: I0316 17:31:05.867972 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/dc360746-240c-4eb9-9cb8-705d7ea3607f-node-mnt\") pod \"crc-storage-crc-t9w2w\" (UID: \"dc360746-240c-4eb9-9cb8-705d7ea3607f\") " pod="crc-storage/crc-storage-crc-t9w2w" Mar 16 17:31:05 crc kubenswrapper[5120]: I0316 17:31:05.868323 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npdlv\" (UniqueName: \"kubernetes.io/projected/dc360746-240c-4eb9-9cb8-705d7ea3607f-kube-api-access-npdlv\") pod \"crc-storage-crc-t9w2w\" (UID: \"dc360746-240c-4eb9-9cb8-705d7ea3607f\") " pod="crc-storage/crc-storage-crc-t9w2w" Mar 16 17:31:05 crc kubenswrapper[5120]: I0316 17:31:05.868798 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/dc360746-240c-4eb9-9cb8-705d7ea3607f-crc-storage\") pod \"crc-storage-crc-t9w2w\" (UID: \"dc360746-240c-4eb9-9cb8-705d7ea3607f\") " pod="crc-storage/crc-storage-crc-t9w2w" Mar 16 17:31:05 crc kubenswrapper[5120]: I0316 17:31:05.971361 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-npdlv\" (UniqueName: \"kubernetes.io/projected/dc360746-240c-4eb9-9cb8-705d7ea3607f-kube-api-access-npdlv\") pod \"crc-storage-crc-t9w2w\" (UID: \"dc360746-240c-4eb9-9cb8-705d7ea3607f\") " pod="crc-storage/crc-storage-crc-t9w2w" Mar 16 17:31:05 crc kubenswrapper[5120]: I0316 17:31:05.971613 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/dc360746-240c-4eb9-9cb8-705d7ea3607f-crc-storage\") pod \"crc-storage-crc-t9w2w\" (UID: \"dc360746-240c-4eb9-9cb8-705d7ea3607f\") " pod="crc-storage/crc-storage-crc-t9w2w" Mar 16 17:31:05 crc kubenswrapper[5120]: I0316 17:31:05.971780 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/dc360746-240c-4eb9-9cb8-705d7ea3607f-node-mnt\") pod \"crc-storage-crc-t9w2w\" (UID: \"dc360746-240c-4eb9-9cb8-705d7ea3607f\") " pod="crc-storage/crc-storage-crc-t9w2w" Mar 16 17:31:05 crc kubenswrapper[5120]: I0316 17:31:05.972252 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/dc360746-240c-4eb9-9cb8-705d7ea3607f-node-mnt\") pod \"crc-storage-crc-t9w2w\" (UID: \"dc360746-240c-4eb9-9cb8-705d7ea3607f\") " pod="crc-storage/crc-storage-crc-t9w2w" Mar 16 17:31:05 crc kubenswrapper[5120]: I0316 17:31:05.972790 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/dc360746-240c-4eb9-9cb8-705d7ea3607f-crc-storage\") pod \"crc-storage-crc-t9w2w\" (UID: \"dc360746-240c-4eb9-9cb8-705d7ea3607f\") " pod="crc-storage/crc-storage-crc-t9w2w" Mar 16 17:31:05 crc kubenswrapper[5120]: I0316 17:31:05.991553 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-npdlv\" (UniqueName: \"kubernetes.io/projected/dc360746-240c-4eb9-9cb8-705d7ea3607f-kube-api-access-npdlv\") pod \"crc-storage-crc-t9w2w\" (UID: \"dc360746-240c-4eb9-9cb8-705d7ea3607f\") " pod="crc-storage/crc-storage-crc-t9w2w" Mar 16 17:31:06 crc kubenswrapper[5120]: I0316 17:31:06.089007 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-t9w2w" Mar 16 17:31:06 crc kubenswrapper[5120]: I0316 17:31:06.512208 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-t9w2w"] Mar 16 17:31:06 crc kubenswrapper[5120]: I0316 17:31:06.517304 5120 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Mar 16 17:31:06 crc kubenswrapper[5120]: I0316 17:31:06.675713 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0457d730-d29e-420a-863f-c13998d5915e" path="/var/lib/kubelet/pods/0457d730-d29e-420a-863f-c13998d5915e/volumes" Mar 16 17:31:07 crc kubenswrapper[5120]: I0316 17:31:07.636675 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-vhnqf" Mar 16 17:31:07 crc kubenswrapper[5120]: I0316 17:31:07.649726 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-t9w2w" event={"ID":"dc360746-240c-4eb9-9cb8-705d7ea3607f","Type":"ContainerStarted","Data":"ff4b23fd17152490cad105d28c681f82a3758fb4100fb2fe14d5f09c3ec915be"} Mar 16 17:31:07 crc kubenswrapper[5120]: E0316 17:31:07.678827 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1330653 actualBytes=10240 Mar 16 17:31:07 crc kubenswrapper[5120]: I0316 17:31:07.705330 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-8c5974765-b2qkc"] Mar 16 17:31:07 crc kubenswrapper[5120]: I0316 17:31:07.705655 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-8c5974765-b2qkc" podUID="bdd1309f-ffde-462f-aa1d-5e5f6cef3a22" containerName="dnsmasq-dns" containerID="cri-o://394b9a19e76fad3c78459703be696a43be16efa957f12358ef3a1a1f9177d7dd" gracePeriod=10 Mar 16 17:31:08 crc kubenswrapper[5120]: I0316 17:31:08.096122 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-8c5974765-b2qkc" Mar 16 17:31:08 crc kubenswrapper[5120]: I0316 17:31:08.143877 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gl84m\" (UniqueName: \"kubernetes.io/projected/bdd1309f-ffde-462f-aa1d-5e5f6cef3a22-kube-api-access-gl84m\") pod \"bdd1309f-ffde-462f-aa1d-5e5f6cef3a22\" (UID: \"bdd1309f-ffde-462f-aa1d-5e5f6cef3a22\") " Mar 16 17:31:08 crc kubenswrapper[5120]: I0316 17:31:08.144051 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/configmap/bdd1309f-ffde-462f-aa1d-5e5f6cef3a22-edpm-compute-no-nodes\") pod \"bdd1309f-ffde-462f-aa1d-5e5f6cef3a22\" (UID: \"bdd1309f-ffde-462f-aa1d-5e5f6cef3a22\") " Mar 16 17:31:08 crc kubenswrapper[5120]: I0316 17:31:08.144130 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bdd1309f-ffde-462f-aa1d-5e5f6cef3a22-config\") pod \"bdd1309f-ffde-462f-aa1d-5e5f6cef3a22\" (UID: \"bdd1309f-ffde-462f-aa1d-5e5f6cef3a22\") " Mar 16 17:31:08 crc kubenswrapper[5120]: I0316 17:31:08.144454 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/bdd1309f-ffde-462f-aa1d-5e5f6cef3a22-dnsmasq-svc\") pod \"bdd1309f-ffde-462f-aa1d-5e5f6cef3a22\" (UID: \"bdd1309f-ffde-462f-aa1d-5e5f6cef3a22\") " Mar 16 17:31:08 crc kubenswrapper[5120]: I0316 17:31:08.146726 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-wd9wf" Mar 16 17:31:08 crc kubenswrapper[5120]: I0316 17:31:08.150977 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bdd1309f-ffde-462f-aa1d-5e5f6cef3a22-kube-api-access-gl84m" (OuterVolumeSpecName: "kube-api-access-gl84m") pod "bdd1309f-ffde-462f-aa1d-5e5f6cef3a22" (UID: "bdd1309f-ffde-462f-aa1d-5e5f6cef3a22"). InnerVolumeSpecName "kube-api-access-gl84m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:31:08 crc kubenswrapper[5120]: I0316 17:31:08.190822 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bdd1309f-ffde-462f-aa1d-5e5f6cef3a22-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "bdd1309f-ffde-462f-aa1d-5e5f6cef3a22" (UID: "bdd1309f-ffde-462f-aa1d-5e5f6cef3a22"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:31:08 crc kubenswrapper[5120]: E0316 17:31:08.195999 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bdd1309f-ffde-462f-aa1d-5e5f6cef3a22-edpm-compute-no-nodes podName:bdd1309f-ffde-462f-aa1d-5e5f6cef3a22 nodeName:}" failed. No retries permitted until 2026-03-16 17:31:08.695950817 +0000 UTC m=+7170.849882474 (durationBeforeRetry 500ms). Error: error cleaning subPath mounts for volume "edpm-compute-no-nodes" (UniqueName: "kubernetes.io/configmap/bdd1309f-ffde-462f-aa1d-5e5f6cef3a22-edpm-compute-no-nodes") pod "bdd1309f-ffde-462f-aa1d-5e5f6cef3a22" (UID: "bdd1309f-ffde-462f-aa1d-5e5f6cef3a22") : error deleting /var/lib/kubelet/pods/bdd1309f-ffde-462f-aa1d-5e5f6cef3a22/volume-subpaths: remove /var/lib/kubelet/pods/bdd1309f-ffde-462f-aa1d-5e5f6cef3a22/volume-subpaths: no such file or directory Mar 16 17:31:08 crc kubenswrapper[5120]: I0316 17:31:08.196229 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bdd1309f-ffde-462f-aa1d-5e5f6cef3a22-config" (OuterVolumeSpecName: "config") pod "bdd1309f-ffde-462f-aa1d-5e5f6cef3a22" (UID: "bdd1309f-ffde-462f-aa1d-5e5f6cef3a22"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:31:08 crc kubenswrapper[5120]: I0316 17:31:08.245947 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kuttl-service-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6f0ac35c-eae8-4ead-9bce-441f102640c0-kuttl-service-combined-ca-bundle\") pod \"6f0ac35c-eae8-4ead-9bce-441f102640c0\" (UID: \"6f0ac35c-eae8-4ead-9bce-441f102640c0\") " Mar 16 17:31:08 crc kubenswrapper[5120]: I0316 17:31:08.246065 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kuttl-service-cm-2-0\" (UniqueName: \"kubernetes.io/configmap/6f0ac35c-eae8-4ead-9bce-441f102640c0-kuttl-service-cm-2-0\") pod \"6f0ac35c-eae8-4ead-9bce-441f102640c0\" (UID: \"6f0ac35c-eae8-4ead-9bce-441f102640c0\") " Mar 16 17:31:08 crc kubenswrapper[5120]: I0316 17:31:08.246274 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kuttl-service-cm-1-2\" (UniqueName: \"kubernetes.io/configmap/6f0ac35c-eae8-4ead-9bce-441f102640c0-kuttl-service-cm-1-2\") pod \"6f0ac35c-eae8-4ead-9bce-441f102640c0\" (UID: \"6f0ac35c-eae8-4ead-9bce-441f102640c0\") " Mar 16 17:31:08 crc kubenswrapper[5120]: I0316 17:31:08.246367 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kuttl-service-cm-1-0\" (UniqueName: \"kubernetes.io/configmap/6f0ac35c-eae8-4ead-9bce-441f102640c0-kuttl-service-cm-1-0\") pod \"6f0ac35c-eae8-4ead-9bce-441f102640c0\" (UID: \"6f0ac35c-eae8-4ead-9bce-441f102640c0\") " Mar 16 17:31:08 crc kubenswrapper[5120]: I0316 17:31:08.246421 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kuttl-service-cm-0-1\" (UniqueName: \"kubernetes.io/configmap/6f0ac35c-eae8-4ead-9bce-441f102640c0-kuttl-service-cm-0-1\") pod \"6f0ac35c-eae8-4ead-9bce-441f102640c0\" (UID: \"6f0ac35c-eae8-4ead-9bce-441f102640c0\") " Mar 16 17:31:08 crc kubenswrapper[5120]: I0316 17:31:08.246531 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kuttl-service-cm-0-2\" (UniqueName: \"kubernetes.io/configmap/6f0ac35c-eae8-4ead-9bce-441f102640c0-kuttl-service-cm-0-2\") pod \"6f0ac35c-eae8-4ead-9bce-441f102640c0\" (UID: \"6f0ac35c-eae8-4ead-9bce-441f102640c0\") " Mar 16 17:31:08 crc kubenswrapper[5120]: I0316 17:31:08.246619 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kuttl-service-cm-0-0\" (UniqueName: \"kubernetes.io/configmap/6f0ac35c-eae8-4ead-9bce-441f102640c0-kuttl-service-cm-0-0\") pod \"6f0ac35c-eae8-4ead-9bce-441f102640c0\" (UID: \"6f0ac35c-eae8-4ead-9bce-441f102640c0\") " Mar 16 17:31:08 crc kubenswrapper[5120]: I0316 17:31:08.246649 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4nf8j\" (UniqueName: \"kubernetes.io/projected/6f0ac35c-eae8-4ead-9bce-441f102640c0-kube-api-access-4nf8j\") pod \"6f0ac35c-eae8-4ead-9bce-441f102640c0\" (UID: \"6f0ac35c-eae8-4ead-9bce-441f102640c0\") " Mar 16 17:31:08 crc kubenswrapper[5120]: I0316 17:31:08.246684 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kuttl-service-cm-1-1\" (UniqueName: \"kubernetes.io/configmap/6f0ac35c-eae8-4ead-9bce-441f102640c0-kuttl-service-cm-1-1\") pod \"6f0ac35c-eae8-4ead-9bce-441f102640c0\" (UID: \"6f0ac35c-eae8-4ead-9bce-441f102640c0\") " Mar 16 17:31:08 crc kubenswrapper[5120]: I0316 17:31:08.246844 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/6f0ac35c-eae8-4ead-9bce-441f102640c0-ssh-key-edpm-compute-no-nodes\") pod \"6f0ac35c-eae8-4ead-9bce-441f102640c0\" (UID: \"6f0ac35c-eae8-4ead-9bce-441f102640c0\") " Mar 16 17:31:08 crc kubenswrapper[5120]: I0316 17:31:08.247336 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/6f0ac35c-eae8-4ead-9bce-441f102640c0-inventory\") pod \"6f0ac35c-eae8-4ead-9bce-441f102640c0\" (UID: \"6f0ac35c-eae8-4ead-9bce-441f102640c0\") " Mar 16 17:31:08 crc kubenswrapper[5120]: I0316 17:31:08.248408 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gl84m\" (UniqueName: \"kubernetes.io/projected/bdd1309f-ffde-462f-aa1d-5e5f6cef3a22-kube-api-access-gl84m\") on node \"crc\" DevicePath \"\"" Mar 16 17:31:08 crc kubenswrapper[5120]: I0316 17:31:08.248455 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bdd1309f-ffde-462f-aa1d-5e5f6cef3a22-config\") on node \"crc\" DevicePath \"\"" Mar 16 17:31:08 crc kubenswrapper[5120]: I0316 17:31:08.248471 5120 reconciler_common.go:299] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/bdd1309f-ffde-462f-aa1d-5e5f6cef3a22-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Mar 16 17:31:08 crc kubenswrapper[5120]: I0316 17:31:08.250356 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f0ac35c-eae8-4ead-9bce-441f102640c0-kuttl-service-combined-ca-bundle" (OuterVolumeSpecName: "kuttl-service-combined-ca-bundle") pod "6f0ac35c-eae8-4ead-9bce-441f102640c0" (UID: "6f0ac35c-eae8-4ead-9bce-441f102640c0"). InnerVolumeSpecName "kuttl-service-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:31:08 crc kubenswrapper[5120]: I0316 17:31:08.250555 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f0ac35c-eae8-4ead-9bce-441f102640c0-kube-api-access-4nf8j" (OuterVolumeSpecName: "kube-api-access-4nf8j") pod "6f0ac35c-eae8-4ead-9bce-441f102640c0" (UID: "6f0ac35c-eae8-4ead-9bce-441f102640c0"). InnerVolumeSpecName "kube-api-access-4nf8j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:31:08 crc kubenswrapper[5120]: I0316 17:31:08.265457 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f0ac35c-eae8-4ead-9bce-441f102640c0-kuttl-service-cm-1-1" (OuterVolumeSpecName: "kuttl-service-cm-1-1") pod "6f0ac35c-eae8-4ead-9bce-441f102640c0" (UID: "6f0ac35c-eae8-4ead-9bce-441f102640c0"). InnerVolumeSpecName "kuttl-service-cm-1-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:31:08 crc kubenswrapper[5120]: I0316 17:31:08.266310 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f0ac35c-eae8-4ead-9bce-441f102640c0-kuttl-service-cm-1-0" (OuterVolumeSpecName: "kuttl-service-cm-1-0") pod "6f0ac35c-eae8-4ead-9bce-441f102640c0" (UID: "6f0ac35c-eae8-4ead-9bce-441f102640c0"). InnerVolumeSpecName "kuttl-service-cm-1-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:31:08 crc kubenswrapper[5120]: I0316 17:31:08.268110 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f0ac35c-eae8-4ead-9bce-441f102640c0-kuttl-service-cm-1-2" (OuterVolumeSpecName: "kuttl-service-cm-1-2") pod "6f0ac35c-eae8-4ead-9bce-441f102640c0" (UID: "6f0ac35c-eae8-4ead-9bce-441f102640c0"). InnerVolumeSpecName "kuttl-service-cm-1-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:31:08 crc kubenswrapper[5120]: I0316 17:31:08.268809 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f0ac35c-eae8-4ead-9bce-441f102640c0-kuttl-service-cm-2-0" (OuterVolumeSpecName: "kuttl-service-cm-2-0") pod "6f0ac35c-eae8-4ead-9bce-441f102640c0" (UID: "6f0ac35c-eae8-4ead-9bce-441f102640c0"). InnerVolumeSpecName "kuttl-service-cm-2-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:31:08 crc kubenswrapper[5120]: I0316 17:31:08.268973 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f0ac35c-eae8-4ead-9bce-441f102640c0-kuttl-service-cm-0-1" (OuterVolumeSpecName: "kuttl-service-cm-0-1") pod "6f0ac35c-eae8-4ead-9bce-441f102640c0" (UID: "6f0ac35c-eae8-4ead-9bce-441f102640c0"). InnerVolumeSpecName "kuttl-service-cm-0-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:31:08 crc kubenswrapper[5120]: I0316 17:31:08.270037 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f0ac35c-eae8-4ead-9bce-441f102640c0-inventory" (OuterVolumeSpecName: "inventory") pod "6f0ac35c-eae8-4ead-9bce-441f102640c0" (UID: "6f0ac35c-eae8-4ead-9bce-441f102640c0"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:31:08 crc kubenswrapper[5120]: I0316 17:31:08.270860 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f0ac35c-eae8-4ead-9bce-441f102640c0-kuttl-service-cm-0-2" (OuterVolumeSpecName: "kuttl-service-cm-0-2") pod "6f0ac35c-eae8-4ead-9bce-441f102640c0" (UID: "6f0ac35c-eae8-4ead-9bce-441f102640c0"). InnerVolumeSpecName "kuttl-service-cm-0-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:31:08 crc kubenswrapper[5120]: I0316 17:31:08.270998 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f0ac35c-eae8-4ead-9bce-441f102640c0-kuttl-service-cm-0-0" (OuterVolumeSpecName: "kuttl-service-cm-0-0") pod "6f0ac35c-eae8-4ead-9bce-441f102640c0" (UID: "6f0ac35c-eae8-4ead-9bce-441f102640c0"). InnerVolumeSpecName "kuttl-service-cm-0-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:31:08 crc kubenswrapper[5120]: I0316 17:31:08.271302 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f0ac35c-eae8-4ead-9bce-441f102640c0-ssh-key-edpm-compute-no-nodes" (OuterVolumeSpecName: "ssh-key-edpm-compute-no-nodes") pod "6f0ac35c-eae8-4ead-9bce-441f102640c0" (UID: "6f0ac35c-eae8-4ead-9bce-441f102640c0"). InnerVolumeSpecName "ssh-key-edpm-compute-no-nodes". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:31:08 crc kubenswrapper[5120]: I0316 17:31:08.350900 5120 reconciler_common.go:299] "Volume detached for volume \"kuttl-service-cm-0-1\" (UniqueName: \"kubernetes.io/configmap/6f0ac35c-eae8-4ead-9bce-441f102640c0-kuttl-service-cm-0-1\") on node \"crc\" DevicePath \"\"" Mar 16 17:31:08 crc kubenswrapper[5120]: I0316 17:31:08.350949 5120 reconciler_common.go:299] "Volume detached for volume \"kuttl-service-cm-0-2\" (UniqueName: \"kubernetes.io/configmap/6f0ac35c-eae8-4ead-9bce-441f102640c0-kuttl-service-cm-0-2\") on node \"crc\" DevicePath \"\"" Mar 16 17:31:08 crc kubenswrapper[5120]: I0316 17:31:08.350998 5120 reconciler_common.go:299] "Volume detached for volume \"kuttl-service-cm-0-0\" (UniqueName: \"kubernetes.io/configmap/6f0ac35c-eae8-4ead-9bce-441f102640c0-kuttl-service-cm-0-0\") on node \"crc\" DevicePath \"\"" Mar 16 17:31:08 crc kubenswrapper[5120]: I0316 17:31:08.351018 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4nf8j\" (UniqueName: \"kubernetes.io/projected/6f0ac35c-eae8-4ead-9bce-441f102640c0-kube-api-access-4nf8j\") on node \"crc\" DevicePath \"\"" Mar 16 17:31:08 crc kubenswrapper[5120]: I0316 17:31:08.351032 5120 reconciler_common.go:299] "Volume detached for volume \"kuttl-service-cm-1-1\" (UniqueName: \"kubernetes.io/configmap/6f0ac35c-eae8-4ead-9bce-441f102640c0-kuttl-service-cm-1-1\") on node \"crc\" DevicePath \"\"" Mar 16 17:31:08 crc kubenswrapper[5120]: I0316 17:31:08.351045 5120 reconciler_common.go:299] "Volume detached for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/6f0ac35c-eae8-4ead-9bce-441f102640c0-ssh-key-edpm-compute-no-nodes\") on node \"crc\" DevicePath \"\"" Mar 16 17:31:08 crc kubenswrapper[5120]: I0316 17:31:08.351058 5120 reconciler_common.go:299] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/6f0ac35c-eae8-4ead-9bce-441f102640c0-inventory\") on node \"crc\" DevicePath \"\"" Mar 16 17:31:08 crc kubenswrapper[5120]: I0316 17:31:08.351071 5120 reconciler_common.go:299] "Volume detached for volume \"kuttl-service-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6f0ac35c-eae8-4ead-9bce-441f102640c0-kuttl-service-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:31:08 crc kubenswrapper[5120]: I0316 17:31:08.351084 5120 reconciler_common.go:299] "Volume detached for volume \"kuttl-service-cm-2-0\" (UniqueName: \"kubernetes.io/configmap/6f0ac35c-eae8-4ead-9bce-441f102640c0-kuttl-service-cm-2-0\") on node \"crc\" DevicePath \"\"" Mar 16 17:31:08 crc kubenswrapper[5120]: I0316 17:31:08.351095 5120 reconciler_common.go:299] "Volume detached for volume \"kuttl-service-cm-1-2\" (UniqueName: \"kubernetes.io/configmap/6f0ac35c-eae8-4ead-9bce-441f102640c0-kuttl-service-cm-1-2\") on node \"crc\" DevicePath \"\"" Mar 16 17:31:08 crc kubenswrapper[5120]: I0316 17:31:08.351106 5120 reconciler_common.go:299] "Volume detached for volume \"kuttl-service-cm-1-0\" (UniqueName: \"kubernetes.io/configmap/6f0ac35c-eae8-4ead-9bce-441f102640c0-kuttl-service-cm-1-0\") on node \"crc\" DevicePath \"\"" Mar 16 17:31:08 crc kubenswrapper[5120]: I0316 17:31:08.666734 5120 generic.go:358] "Generic (PLEG): container finished" podID="6f0ac35c-eae8-4ead-9bce-441f102640c0" containerID="4b9c5baa416342d96c0e0a29ed1a971aff85a46f150da0a691d4d88b828a43f7" exitCode=254 Mar 16 17:31:08 crc kubenswrapper[5120]: I0316 17:31:08.669031 5120 generic.go:358] "Generic (PLEG): container finished" podID="dc360746-240c-4eb9-9cb8-705d7ea3607f" containerID="55e45f8d9509a50b7235282a22c9feb074290b3b8f6ab5ffdadb02b413f444c1" exitCode=0 Mar 16 17:31:08 crc kubenswrapper[5120]: I0316 17:31:08.670953 5120 generic.go:358] "Generic (PLEG): container finished" podID="bdd1309f-ffde-462f-aa1d-5e5f6cef3a22" containerID="394b9a19e76fad3c78459703be696a43be16efa957f12358ef3a1a1f9177d7dd" exitCode=0 Mar 16 17:31:08 crc kubenswrapper[5120]: I0316 17:31:08.674459 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-wd9wf" Mar 16 17:31:08 crc kubenswrapper[5120]: I0316 17:31:08.675044 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-8c5974765-b2qkc" Mar 16 17:31:08 crc kubenswrapper[5120]: I0316 17:31:08.675499 5120 scope.go:117] "RemoveContainer" containerID="df0a87b047c8208d5fc21057efed33321f6cab49c4cf053702d222dc12979450" Mar 16 17:31:08 crc kubenswrapper[5120]: E0316 17:31:08.675804 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 17:31:08 crc kubenswrapper[5120]: I0316 17:31:08.687422 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-wd9wf" event={"ID":"6f0ac35c-eae8-4ead-9bce-441f102640c0","Type":"ContainerDied","Data":"4b9c5baa416342d96c0e0a29ed1a971aff85a46f150da0a691d4d88b828a43f7"} Mar 16 17:31:08 crc kubenswrapper[5120]: I0316 17:31:08.687483 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-wd9wf" event={"ID":"6f0ac35c-eae8-4ead-9bce-441f102640c0","Type":"ContainerDied","Data":"e2963c8610dc2c1e7192a91514c2ba0afdc5c7b518e4defc78db969c480261d1"} Mar 16 17:31:08 crc kubenswrapper[5120]: I0316 17:31:08.687496 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-t9w2w" event={"ID":"dc360746-240c-4eb9-9cb8-705d7ea3607f","Type":"ContainerDied","Data":"55e45f8d9509a50b7235282a22c9feb074290b3b8f6ab5ffdadb02b413f444c1"} Mar 16 17:31:08 crc kubenswrapper[5120]: I0316 17:31:08.687509 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-8c5974765-b2qkc" event={"ID":"bdd1309f-ffde-462f-aa1d-5e5f6cef3a22","Type":"ContainerDied","Data":"394b9a19e76fad3c78459703be696a43be16efa957f12358ef3a1a1f9177d7dd"} Mar 16 17:31:08 crc kubenswrapper[5120]: I0316 17:31:08.687521 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-8c5974765-b2qkc" event={"ID":"bdd1309f-ffde-462f-aa1d-5e5f6cef3a22","Type":"ContainerDied","Data":"ce7e942a71b77e8d1e196b82c3546b1dd879ccfe359791971a7df723c0993608"} Mar 16 17:31:08 crc kubenswrapper[5120]: I0316 17:31:08.687539 5120 scope.go:117] "RemoveContainer" containerID="4b9c5baa416342d96c0e0a29ed1a971aff85a46f150da0a691d4d88b828a43f7" Mar 16 17:31:08 crc kubenswrapper[5120]: I0316 17:31:08.758575 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/configmap/bdd1309f-ffde-462f-aa1d-5e5f6cef3a22-edpm-compute-no-nodes\") pod \"bdd1309f-ffde-462f-aa1d-5e5f6cef3a22\" (UID: \"bdd1309f-ffde-462f-aa1d-5e5f6cef3a22\") " Mar 16 17:31:08 crc kubenswrapper[5120]: I0316 17:31:08.759279 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bdd1309f-ffde-462f-aa1d-5e5f6cef3a22-edpm-compute-no-nodes" (OuterVolumeSpecName: "edpm-compute-no-nodes") pod "bdd1309f-ffde-462f-aa1d-5e5f6cef3a22" (UID: "bdd1309f-ffde-462f-aa1d-5e5f6cef3a22"). InnerVolumeSpecName "edpm-compute-no-nodes". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:31:08 crc kubenswrapper[5120]: I0316 17:31:08.760034 5120 reconciler_common.go:299] "Volume detached for volume \"edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/configmap/bdd1309f-ffde-462f-aa1d-5e5f6cef3a22-edpm-compute-no-nodes\") on node \"crc\" DevicePath \"\"" Mar 16 17:31:08 crc kubenswrapper[5120]: I0316 17:31:08.761881 5120 scope.go:117] "RemoveContainer" containerID="4b9c5baa416342d96c0e0a29ed1a971aff85a46f150da0a691d4d88b828a43f7" Mar 16 17:31:08 crc kubenswrapper[5120]: E0316 17:31:08.762304 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b9c5baa416342d96c0e0a29ed1a971aff85a46f150da0a691d4d88b828a43f7\": container with ID starting with 4b9c5baa416342d96c0e0a29ed1a971aff85a46f150da0a691d4d88b828a43f7 not found: ID does not exist" containerID="4b9c5baa416342d96c0e0a29ed1a971aff85a46f150da0a691d4d88b828a43f7" Mar 16 17:31:08 crc kubenswrapper[5120]: I0316 17:31:08.762347 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b9c5baa416342d96c0e0a29ed1a971aff85a46f150da0a691d4d88b828a43f7"} err="failed to get container status \"4b9c5baa416342d96c0e0a29ed1a971aff85a46f150da0a691d4d88b828a43f7\": rpc error: code = NotFound desc = could not find container \"4b9c5baa416342d96c0e0a29ed1a971aff85a46f150da0a691d4d88b828a43f7\": container with ID starting with 4b9c5baa416342d96c0e0a29ed1a971aff85a46f150da0a691d4d88b828a43f7 not found: ID does not exist" Mar 16 17:31:08 crc kubenswrapper[5120]: I0316 17:31:08.762375 5120 scope.go:117] "RemoveContainer" containerID="394b9a19e76fad3c78459703be696a43be16efa957f12358ef3a1a1f9177d7dd" Mar 16 17:31:08 crc kubenswrapper[5120]: I0316 17:31:08.788322 5120 scope.go:117] "RemoveContainer" containerID="31840da0efe96357d2a6cb54201480cd3fd5fbec622be09460c0bd90e5aeb0ad" Mar 16 17:31:08 crc kubenswrapper[5120]: I0316 17:31:08.809621 5120 scope.go:117] "RemoveContainer" containerID="394b9a19e76fad3c78459703be696a43be16efa957f12358ef3a1a1f9177d7dd" Mar 16 17:31:08 crc kubenswrapper[5120]: E0316 17:31:08.810135 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"394b9a19e76fad3c78459703be696a43be16efa957f12358ef3a1a1f9177d7dd\": container with ID starting with 394b9a19e76fad3c78459703be696a43be16efa957f12358ef3a1a1f9177d7dd not found: ID does not exist" containerID="394b9a19e76fad3c78459703be696a43be16efa957f12358ef3a1a1f9177d7dd" Mar 16 17:31:08 crc kubenswrapper[5120]: I0316 17:31:08.810174 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"394b9a19e76fad3c78459703be696a43be16efa957f12358ef3a1a1f9177d7dd"} err="failed to get container status \"394b9a19e76fad3c78459703be696a43be16efa957f12358ef3a1a1f9177d7dd\": rpc error: code = NotFound desc = could not find container \"394b9a19e76fad3c78459703be696a43be16efa957f12358ef3a1a1f9177d7dd\": container with ID starting with 394b9a19e76fad3c78459703be696a43be16efa957f12358ef3a1a1f9177d7dd not found: ID does not exist" Mar 16 17:31:08 crc kubenswrapper[5120]: I0316 17:31:08.810200 5120 scope.go:117] "RemoveContainer" containerID="31840da0efe96357d2a6cb54201480cd3fd5fbec622be09460c0bd90e5aeb0ad" Mar 16 17:31:08 crc kubenswrapper[5120]: E0316 17:31:08.810440 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"31840da0efe96357d2a6cb54201480cd3fd5fbec622be09460c0bd90e5aeb0ad\": container with ID starting with 31840da0efe96357d2a6cb54201480cd3fd5fbec622be09460c0bd90e5aeb0ad not found: ID does not exist" containerID="31840da0efe96357d2a6cb54201480cd3fd5fbec622be09460c0bd90e5aeb0ad" Mar 16 17:31:08 crc kubenswrapper[5120]: I0316 17:31:08.810462 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31840da0efe96357d2a6cb54201480cd3fd5fbec622be09460c0bd90e5aeb0ad"} err="failed to get container status \"31840da0efe96357d2a6cb54201480cd3fd5fbec622be09460c0bd90e5aeb0ad\": rpc error: code = NotFound desc = could not find container \"31840da0efe96357d2a6cb54201480cd3fd5fbec622be09460c0bd90e5aeb0ad\": container with ID starting with 31840da0efe96357d2a6cb54201480cd3fd5fbec622be09460c0bd90e5aeb0ad not found: ID does not exist" Mar 16 17:31:09 crc kubenswrapper[5120]: I0316 17:31:09.008641 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-8c5974765-b2qkc"] Mar 16 17:31:09 crc kubenswrapper[5120]: I0316 17:31:09.014139 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-8c5974765-b2qkc"] Mar 16 17:31:09 crc kubenswrapper[5120]: I0316 17:31:09.945753 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-t9w2w" Mar 16 17:31:09 crc kubenswrapper[5120]: I0316 17:31:09.984714 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-npdlv\" (UniqueName: \"kubernetes.io/projected/dc360746-240c-4eb9-9cb8-705d7ea3607f-kube-api-access-npdlv\") pod \"dc360746-240c-4eb9-9cb8-705d7ea3607f\" (UID: \"dc360746-240c-4eb9-9cb8-705d7ea3607f\") " Mar 16 17:31:09 crc kubenswrapper[5120]: I0316 17:31:09.984782 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/dc360746-240c-4eb9-9cb8-705d7ea3607f-crc-storage\") pod \"dc360746-240c-4eb9-9cb8-705d7ea3607f\" (UID: \"dc360746-240c-4eb9-9cb8-705d7ea3607f\") " Mar 16 17:31:09 crc kubenswrapper[5120]: I0316 17:31:09.984964 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/dc360746-240c-4eb9-9cb8-705d7ea3607f-node-mnt\") pod \"dc360746-240c-4eb9-9cb8-705d7ea3607f\" (UID: \"dc360746-240c-4eb9-9cb8-705d7ea3607f\") " Mar 16 17:31:09 crc kubenswrapper[5120]: I0316 17:31:09.985421 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/dc360746-240c-4eb9-9cb8-705d7ea3607f-node-mnt" (OuterVolumeSpecName: "node-mnt") pod "dc360746-240c-4eb9-9cb8-705d7ea3607f" (UID: "dc360746-240c-4eb9-9cb8-705d7ea3607f"). InnerVolumeSpecName "node-mnt". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 17:31:09 crc kubenswrapper[5120]: I0316 17:31:09.992809 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc360746-240c-4eb9-9cb8-705d7ea3607f-kube-api-access-npdlv" (OuterVolumeSpecName: "kube-api-access-npdlv") pod "dc360746-240c-4eb9-9cb8-705d7ea3607f" (UID: "dc360746-240c-4eb9-9cb8-705d7ea3607f"). InnerVolumeSpecName "kube-api-access-npdlv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:31:10 crc kubenswrapper[5120]: I0316 17:31:10.015780 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc360746-240c-4eb9-9cb8-705d7ea3607f-crc-storage" (OuterVolumeSpecName: "crc-storage") pod "dc360746-240c-4eb9-9cb8-705d7ea3607f" (UID: "dc360746-240c-4eb9-9cb8-705d7ea3607f"). InnerVolumeSpecName "crc-storage". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:31:10 crc kubenswrapper[5120]: I0316 17:31:10.087015 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-npdlv\" (UniqueName: \"kubernetes.io/projected/dc360746-240c-4eb9-9cb8-705d7ea3607f-kube-api-access-npdlv\") on node \"crc\" DevicePath \"\"" Mar 16 17:31:10 crc kubenswrapper[5120]: I0316 17:31:10.087050 5120 reconciler_common.go:299] "Volume detached for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/dc360746-240c-4eb9-9cb8-705d7ea3607f-crc-storage\") on node \"crc\" DevicePath \"\"" Mar 16 17:31:10 crc kubenswrapper[5120]: I0316 17:31:10.087064 5120 reconciler_common.go:299] "Volume detached for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/dc360746-240c-4eb9-9cb8-705d7ea3607f-node-mnt\") on node \"crc\" DevicePath \"\"" Mar 16 17:31:10 crc kubenswrapper[5120]: I0316 17:31:10.674599 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bdd1309f-ffde-462f-aa1d-5e5f6cef3a22" path="/var/lib/kubelet/pods/bdd1309f-ffde-462f-aa1d-5e5f6cef3a22/volumes" Mar 16 17:31:10 crc kubenswrapper[5120]: I0316 17:31:10.690490 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-t9w2w" event={"ID":"dc360746-240c-4eb9-9cb8-705d7ea3607f","Type":"ContainerDied","Data":"ff4b23fd17152490cad105d28c681f82a3758fb4100fb2fe14d5f09c3ec915be"} Mar 16 17:31:10 crc kubenswrapper[5120]: I0316 17:31:10.690521 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-t9w2w" Mar 16 17:31:10 crc kubenswrapper[5120]: I0316 17:31:10.690534 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ff4b23fd17152490cad105d28c681f82a3758fb4100fb2fe14d5f09c3ec915be" Mar 16 17:31:13 crc kubenswrapper[5120]: I0316 17:31:13.245818 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["crc-storage/crc-storage-crc-t9w2w"] Mar 16 17:31:13 crc kubenswrapper[5120]: I0316 17:31:13.254645 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["crc-storage/crc-storage-crc-t9w2w"] Mar 16 17:31:13 crc kubenswrapper[5120]: I0316 17:31:13.385076 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["crc-storage/crc-storage-crc-xzcm2"] Mar 16 17:31:13 crc kubenswrapper[5120]: I0316 17:31:13.386481 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc360746-240c-4eb9-9cb8-705d7ea3607f" containerName="storage" Mar 16 17:31:13 crc kubenswrapper[5120]: I0316 17:31:13.386510 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc360746-240c-4eb9-9cb8-705d7ea3607f" containerName="storage" Mar 16 17:31:13 crc kubenswrapper[5120]: I0316 17:31:13.386530 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bdd1309f-ffde-462f-aa1d-5e5f6cef3a22" containerName="dnsmasq-dns" Mar 16 17:31:13 crc kubenswrapper[5120]: I0316 17:31:13.386539 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="bdd1309f-ffde-462f-aa1d-5e5f6cef3a22" containerName="dnsmasq-dns" Mar 16 17:31:13 crc kubenswrapper[5120]: I0316 17:31:13.386560 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bdd1309f-ffde-462f-aa1d-5e5f6cef3a22" containerName="init" Mar 16 17:31:13 crc kubenswrapper[5120]: I0316 17:31:13.386569 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="bdd1309f-ffde-462f-aa1d-5e5f6cef3a22" containerName="init" Mar 16 17:31:13 crc kubenswrapper[5120]: I0316 17:31:13.386589 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f0ac35c-eae8-4ead-9bce-441f102640c0" containerName="kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes" Mar 16 17:31:13 crc kubenswrapper[5120]: I0316 17:31:13.386601 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f0ac35c-eae8-4ead-9bce-441f102640c0" containerName="kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes" Mar 16 17:31:13 crc kubenswrapper[5120]: I0316 17:31:13.386780 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="dc360746-240c-4eb9-9cb8-705d7ea3607f" containerName="storage" Mar 16 17:31:13 crc kubenswrapper[5120]: I0316 17:31:13.386801 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="bdd1309f-ffde-462f-aa1d-5e5f6cef3a22" containerName="dnsmasq-dns" Mar 16 17:31:13 crc kubenswrapper[5120]: I0316 17:31:13.386815 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="6f0ac35c-eae8-4ead-9bce-441f102640c0" containerName="kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes" Mar 16 17:31:13 crc kubenswrapper[5120]: I0316 17:31:13.399659 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-xzcm2" Mar 16 17:31:13 crc kubenswrapper[5120]: I0316 17:31:13.399695 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-xzcm2"] Mar 16 17:31:13 crc kubenswrapper[5120]: I0316 17:31:13.402724 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"openshift-service-ca.crt\"" Mar 16 17:31:13 crc kubenswrapper[5120]: I0316 17:31:13.402755 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"crc-storage\"" Mar 16 17:31:13 crc kubenswrapper[5120]: I0316 17:31:13.403019 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"crc-storage\"/\"crc-storage-dockercfg-s2tht\"" Mar 16 17:31:13 crc kubenswrapper[5120]: I0316 17:31:13.403157 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"kube-root-ca.crt\"" Mar 16 17:31:13 crc kubenswrapper[5120]: I0316 17:31:13.558510 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/95a59a04-a396-4181-9871-d78362dcde03-crc-storage\") pod \"crc-storage-crc-xzcm2\" (UID: \"95a59a04-a396-4181-9871-d78362dcde03\") " pod="crc-storage/crc-storage-crc-xzcm2" Mar 16 17:31:13 crc kubenswrapper[5120]: I0316 17:31:13.558626 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/95a59a04-a396-4181-9871-d78362dcde03-node-mnt\") pod \"crc-storage-crc-xzcm2\" (UID: \"95a59a04-a396-4181-9871-d78362dcde03\") " pod="crc-storage/crc-storage-crc-xzcm2" Mar 16 17:31:13 crc kubenswrapper[5120]: I0316 17:31:13.558884 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jx2f\" (UniqueName: \"kubernetes.io/projected/95a59a04-a396-4181-9871-d78362dcde03-kube-api-access-4jx2f\") pod \"crc-storage-crc-xzcm2\" (UID: \"95a59a04-a396-4181-9871-d78362dcde03\") " pod="crc-storage/crc-storage-crc-xzcm2" Mar 16 17:31:13 crc kubenswrapper[5120]: I0316 17:31:13.660361 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/95a59a04-a396-4181-9871-d78362dcde03-node-mnt\") pod \"crc-storage-crc-xzcm2\" (UID: \"95a59a04-a396-4181-9871-d78362dcde03\") " pod="crc-storage/crc-storage-crc-xzcm2" Mar 16 17:31:13 crc kubenswrapper[5120]: I0316 17:31:13.660568 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4jx2f\" (UniqueName: \"kubernetes.io/projected/95a59a04-a396-4181-9871-d78362dcde03-kube-api-access-4jx2f\") pod \"crc-storage-crc-xzcm2\" (UID: \"95a59a04-a396-4181-9871-d78362dcde03\") " pod="crc-storage/crc-storage-crc-xzcm2" Mar 16 17:31:13 crc kubenswrapper[5120]: I0316 17:31:13.660857 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/95a59a04-a396-4181-9871-d78362dcde03-crc-storage\") pod \"crc-storage-crc-xzcm2\" (UID: \"95a59a04-a396-4181-9871-d78362dcde03\") " pod="crc-storage/crc-storage-crc-xzcm2" Mar 16 17:31:13 crc kubenswrapper[5120]: I0316 17:31:13.662121 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/95a59a04-a396-4181-9871-d78362dcde03-crc-storage\") pod \"crc-storage-crc-xzcm2\" (UID: \"95a59a04-a396-4181-9871-d78362dcde03\") " pod="crc-storage/crc-storage-crc-xzcm2" Mar 16 17:31:13 crc kubenswrapper[5120]: I0316 17:31:13.662254 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/95a59a04-a396-4181-9871-d78362dcde03-node-mnt\") pod \"crc-storage-crc-xzcm2\" (UID: \"95a59a04-a396-4181-9871-d78362dcde03\") " pod="crc-storage/crc-storage-crc-xzcm2" Mar 16 17:31:13 crc kubenswrapper[5120]: I0316 17:31:13.682978 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jx2f\" (UniqueName: \"kubernetes.io/projected/95a59a04-a396-4181-9871-d78362dcde03-kube-api-access-4jx2f\") pod \"crc-storage-crc-xzcm2\" (UID: \"95a59a04-a396-4181-9871-d78362dcde03\") " pod="crc-storage/crc-storage-crc-xzcm2" Mar 16 17:31:13 crc kubenswrapper[5120]: I0316 17:31:13.719863 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-xzcm2" Mar 16 17:31:14 crc kubenswrapper[5120]: I0316 17:31:14.171577 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-xzcm2"] Mar 16 17:31:14 crc kubenswrapper[5120]: I0316 17:31:14.672454 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc360746-240c-4eb9-9cb8-705d7ea3607f" path="/var/lib/kubelet/pods/dc360746-240c-4eb9-9cb8-705d7ea3607f/volumes" Mar 16 17:31:14 crc kubenswrapper[5120]: I0316 17:31:14.728631 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-xzcm2" event={"ID":"95a59a04-a396-4181-9871-d78362dcde03","Type":"ContainerStarted","Data":"77c7aa9c40aa1aa884783087804ab079279d761fe679adabff811b66a105d291"} Mar 16 17:31:15 crc kubenswrapper[5120]: I0316 17:31:15.739683 5120 generic.go:358] "Generic (PLEG): container finished" podID="95a59a04-a396-4181-9871-d78362dcde03" containerID="9158470d4fea6a7e16fe50cb0dcaa52841e8e0954801d120f2c14d6f6b0efa7a" exitCode=0 Mar 16 17:31:15 crc kubenswrapper[5120]: I0316 17:31:15.739830 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-xzcm2" event={"ID":"95a59a04-a396-4181-9871-d78362dcde03","Type":"ContainerDied","Data":"9158470d4fea6a7e16fe50cb0dcaa52841e8e0954801d120f2c14d6f6b0efa7a"} Mar 16 17:31:17 crc kubenswrapper[5120]: I0316 17:31:17.030749 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-xzcm2" Mar 16 17:31:17 crc kubenswrapper[5120]: I0316 17:31:17.136836 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/95a59a04-a396-4181-9871-d78362dcde03-crc-storage\") pod \"95a59a04-a396-4181-9871-d78362dcde03\" (UID: \"95a59a04-a396-4181-9871-d78362dcde03\") " Mar 16 17:31:17 crc kubenswrapper[5120]: I0316 17:31:17.137306 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4jx2f\" (UniqueName: \"kubernetes.io/projected/95a59a04-a396-4181-9871-d78362dcde03-kube-api-access-4jx2f\") pod \"95a59a04-a396-4181-9871-d78362dcde03\" (UID: \"95a59a04-a396-4181-9871-d78362dcde03\") " Mar 16 17:31:17 crc kubenswrapper[5120]: I0316 17:31:17.137505 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/95a59a04-a396-4181-9871-d78362dcde03-node-mnt\") pod \"95a59a04-a396-4181-9871-d78362dcde03\" (UID: \"95a59a04-a396-4181-9871-d78362dcde03\") " Mar 16 17:31:17 crc kubenswrapper[5120]: I0316 17:31:17.137563 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/95a59a04-a396-4181-9871-d78362dcde03-node-mnt" (OuterVolumeSpecName: "node-mnt") pod "95a59a04-a396-4181-9871-d78362dcde03" (UID: "95a59a04-a396-4181-9871-d78362dcde03"). InnerVolumeSpecName "node-mnt". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 17:31:17 crc kubenswrapper[5120]: I0316 17:31:17.138222 5120 reconciler_common.go:299] "Volume detached for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/95a59a04-a396-4181-9871-d78362dcde03-node-mnt\") on node \"crc\" DevicePath \"\"" Mar 16 17:31:17 crc kubenswrapper[5120]: I0316 17:31:17.142106 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95a59a04-a396-4181-9871-d78362dcde03-kube-api-access-4jx2f" (OuterVolumeSpecName: "kube-api-access-4jx2f") pod "95a59a04-a396-4181-9871-d78362dcde03" (UID: "95a59a04-a396-4181-9871-d78362dcde03"). InnerVolumeSpecName "kube-api-access-4jx2f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:31:17 crc kubenswrapper[5120]: I0316 17:31:17.159342 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/95a59a04-a396-4181-9871-d78362dcde03-crc-storage" (OuterVolumeSpecName: "crc-storage") pod "95a59a04-a396-4181-9871-d78362dcde03" (UID: "95a59a04-a396-4181-9871-d78362dcde03"). InnerVolumeSpecName "crc-storage". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:31:17 crc kubenswrapper[5120]: I0316 17:31:17.240141 5120 reconciler_common.go:299] "Volume detached for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/95a59a04-a396-4181-9871-d78362dcde03-crc-storage\") on node \"crc\" DevicePath \"\"" Mar 16 17:31:17 crc kubenswrapper[5120]: I0316 17:31:17.240168 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4jx2f\" (UniqueName: \"kubernetes.io/projected/95a59a04-a396-4181-9871-d78362dcde03-kube-api-access-4jx2f\") on node \"crc\" DevicePath \"\"" Mar 16 17:31:17 crc kubenswrapper[5120]: I0316 17:31:17.766282 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-xzcm2" Mar 16 17:31:17 crc kubenswrapper[5120]: I0316 17:31:17.766312 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-xzcm2" event={"ID":"95a59a04-a396-4181-9871-d78362dcde03","Type":"ContainerDied","Data":"77c7aa9c40aa1aa884783087804ab079279d761fe679adabff811b66a105d291"} Mar 16 17:31:17 crc kubenswrapper[5120]: I0316 17:31:17.766359 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="77c7aa9c40aa1aa884783087804ab079279d761fe679adabff811b66a105d291" Mar 16 17:31:20 crc kubenswrapper[5120]: I0316 17:31:20.304310 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-8c7594c8f-pkzzl"] Mar 16 17:31:20 crc kubenswrapper[5120]: I0316 17:31:20.305858 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95a59a04-a396-4181-9871-d78362dcde03" containerName="storage" Mar 16 17:31:20 crc kubenswrapper[5120]: I0316 17:31:20.305889 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="95a59a04-a396-4181-9871-d78362dcde03" containerName="storage" Mar 16 17:31:20 crc kubenswrapper[5120]: I0316 17:31:20.307905 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="95a59a04-a396-4181-9871-d78362dcde03" containerName="storage" Mar 16 17:31:20 crc kubenswrapper[5120]: I0316 17:31:20.319027 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-8c7594c8f-pkzzl"] Mar 16 17:31:20 crc kubenswrapper[5120]: I0316 17:31:20.319197 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-8c7594c8f-pkzzl" Mar 16 17:31:20 crc kubenswrapper[5120]: I0316 17:31:20.321389 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"edpm-no-nodes-custom-svc\"" Mar 16 17:31:20 crc kubenswrapper[5120]: I0316 17:31:20.409428 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/6d6f8d10-cbb7-415a-b1ff-1e5cfd1c85bb-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-8c7594c8f-pkzzl\" (UID: \"6d6f8d10-cbb7-415a-b1ff-1e5cfd1c85bb\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-8c7594c8f-pkzzl" Mar 16 17:31:20 crc kubenswrapper[5120]: I0316 17:31:20.409545 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6d6f8d10-cbb7-415a-b1ff-1e5cfd1c85bb-config\") pod \"dnsmasq-dnsmasq-8c7594c8f-pkzzl\" (UID: \"6d6f8d10-cbb7-415a-b1ff-1e5cfd1c85bb\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-8c7594c8f-pkzzl" Mar 16 17:31:20 crc kubenswrapper[5120]: I0316 17:31:20.409614 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"edpm-no-nodes-custom-svc\" (UniqueName: \"kubernetes.io/configmap/6d6f8d10-cbb7-415a-b1ff-1e5cfd1c85bb-edpm-no-nodes-custom-svc\") pod \"dnsmasq-dnsmasq-8c7594c8f-pkzzl\" (UID: \"6d6f8d10-cbb7-415a-b1ff-1e5cfd1c85bb\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-8c7594c8f-pkzzl" Mar 16 17:31:20 crc kubenswrapper[5120]: I0316 17:31:20.409653 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8nl27\" (UniqueName: \"kubernetes.io/projected/6d6f8d10-cbb7-415a-b1ff-1e5cfd1c85bb-kube-api-access-8nl27\") pod \"dnsmasq-dnsmasq-8c7594c8f-pkzzl\" (UID: \"6d6f8d10-cbb7-415a-b1ff-1e5cfd1c85bb\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-8c7594c8f-pkzzl" Mar 16 17:31:20 crc kubenswrapper[5120]: I0316 17:31:20.511967 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/6d6f8d10-cbb7-415a-b1ff-1e5cfd1c85bb-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-8c7594c8f-pkzzl\" (UID: \"6d6f8d10-cbb7-415a-b1ff-1e5cfd1c85bb\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-8c7594c8f-pkzzl" Mar 16 17:31:20 crc kubenswrapper[5120]: I0316 17:31:20.512133 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6d6f8d10-cbb7-415a-b1ff-1e5cfd1c85bb-config\") pod \"dnsmasq-dnsmasq-8c7594c8f-pkzzl\" (UID: \"6d6f8d10-cbb7-415a-b1ff-1e5cfd1c85bb\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-8c7594c8f-pkzzl" Mar 16 17:31:20 crc kubenswrapper[5120]: I0316 17:31:20.512265 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"edpm-no-nodes-custom-svc\" (UniqueName: \"kubernetes.io/configmap/6d6f8d10-cbb7-415a-b1ff-1e5cfd1c85bb-edpm-no-nodes-custom-svc\") pod \"dnsmasq-dnsmasq-8c7594c8f-pkzzl\" (UID: \"6d6f8d10-cbb7-415a-b1ff-1e5cfd1c85bb\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-8c7594c8f-pkzzl" Mar 16 17:31:20 crc kubenswrapper[5120]: I0316 17:31:20.512319 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8nl27\" (UniqueName: \"kubernetes.io/projected/6d6f8d10-cbb7-415a-b1ff-1e5cfd1c85bb-kube-api-access-8nl27\") pod \"dnsmasq-dnsmasq-8c7594c8f-pkzzl\" (UID: \"6d6f8d10-cbb7-415a-b1ff-1e5cfd1c85bb\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-8c7594c8f-pkzzl" Mar 16 17:31:20 crc kubenswrapper[5120]: I0316 17:31:20.513016 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6d6f8d10-cbb7-415a-b1ff-1e5cfd1c85bb-config\") pod \"dnsmasq-dnsmasq-8c7594c8f-pkzzl\" (UID: \"6d6f8d10-cbb7-415a-b1ff-1e5cfd1c85bb\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-8c7594c8f-pkzzl" Mar 16 17:31:20 crc kubenswrapper[5120]: I0316 17:31:20.514020 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"edpm-no-nodes-custom-svc\" (UniqueName: \"kubernetes.io/configmap/6d6f8d10-cbb7-415a-b1ff-1e5cfd1c85bb-edpm-no-nodes-custom-svc\") pod \"dnsmasq-dnsmasq-8c7594c8f-pkzzl\" (UID: \"6d6f8d10-cbb7-415a-b1ff-1e5cfd1c85bb\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-8c7594c8f-pkzzl" Mar 16 17:31:20 crc kubenswrapper[5120]: I0316 17:31:20.514111 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/6d6f8d10-cbb7-415a-b1ff-1e5cfd1c85bb-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-8c7594c8f-pkzzl\" (UID: \"6d6f8d10-cbb7-415a-b1ff-1e5cfd1c85bb\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-8c7594c8f-pkzzl" Mar 16 17:31:20 crc kubenswrapper[5120]: I0316 17:31:20.531191 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8nl27\" (UniqueName: \"kubernetes.io/projected/6d6f8d10-cbb7-415a-b1ff-1e5cfd1c85bb-kube-api-access-8nl27\") pod \"dnsmasq-dnsmasq-8c7594c8f-pkzzl\" (UID: \"6d6f8d10-cbb7-415a-b1ff-1e5cfd1c85bb\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-8c7594c8f-pkzzl" Mar 16 17:31:20 crc kubenswrapper[5120]: I0316 17:31:20.638220 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-8c7594c8f-pkzzl" Mar 16 17:31:20 crc kubenswrapper[5120]: I0316 17:31:20.918721 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-8c7594c8f-pkzzl"] Mar 16 17:31:20 crc kubenswrapper[5120]: W0316 17:31:20.928065 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6d6f8d10_cbb7_415a_b1ff_1e5cfd1c85bb.slice/crio-9d04e785924d1b344a6ceebc4eb4bc251328589521053149c71b215e6c000b79 WatchSource:0}: Error finding container 9d04e785924d1b344a6ceebc4eb4bc251328589521053149c71b215e6c000b79: Status 404 returned error can't find the container with id 9d04e785924d1b344a6ceebc4eb4bc251328589521053149c71b215e6c000b79 Mar 16 17:31:21 crc kubenswrapper[5120]: I0316 17:31:21.663935 5120 scope.go:117] "RemoveContainer" containerID="df0a87b047c8208d5fc21057efed33321f6cab49c4cf053702d222dc12979450" Mar 16 17:31:21 crc kubenswrapper[5120]: E0316 17:31:21.664399 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 17:31:21 crc kubenswrapper[5120]: I0316 17:31:21.802567 5120 generic.go:358] "Generic (PLEG): container finished" podID="6d6f8d10-cbb7-415a-b1ff-1e5cfd1c85bb" containerID="c0786cd0da330932546b708310595f1dfbd1bc2b744e4f9cee654deaf280ee3e" exitCode=0 Mar 16 17:31:21 crc kubenswrapper[5120]: I0316 17:31:21.802669 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-8c7594c8f-pkzzl" event={"ID":"6d6f8d10-cbb7-415a-b1ff-1e5cfd1c85bb","Type":"ContainerDied","Data":"c0786cd0da330932546b708310595f1dfbd1bc2b744e4f9cee654deaf280ee3e"} Mar 16 17:31:21 crc kubenswrapper[5120]: I0316 17:31:21.802699 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-8c7594c8f-pkzzl" event={"ID":"6d6f8d10-cbb7-415a-b1ff-1e5cfd1c85bb","Type":"ContainerStarted","Data":"9d04e785924d1b344a6ceebc4eb4bc251328589521053149c71b215e6c000b79"} Mar 16 17:31:22 crc kubenswrapper[5120]: I0316 17:31:22.814449 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-8c7594c8f-pkzzl" event={"ID":"6d6f8d10-cbb7-415a-b1ff-1e5cfd1c85bb","Type":"ContainerStarted","Data":"7e2daefeaac48e45072b988b9bfe0f3af3a7a1b75d694e62437e344278af3381"} Mar 16 17:31:22 crc kubenswrapper[5120]: I0316 17:31:22.816084 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-8c7594c8f-pkzzl" Mar 16 17:31:22 crc kubenswrapper[5120]: I0316 17:31:22.839135 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-8c7594c8f-pkzzl" podStartSLOduration=2.8391164829999997 podStartE2EDuration="2.839116483s" podCreationTimestamp="2026-03-16 17:31:20 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:31:22.834439666 +0000 UTC m=+7184.988371343" watchObservedRunningTime="2026-03-16 17:31:22.839116483 +0000 UTC m=+7184.993048140" Mar 16 17:31:28 crc kubenswrapper[5120]: I0316 17:31:28.544555 5120 scope.go:117] "RemoveContainer" containerID="297d8efae1036524c61bddf6cab1c086d9c6c55c724340bcef4ff3a1432ea3d5" Mar 16 17:31:28 crc kubenswrapper[5120]: I0316 17:31:28.573355 5120 scope.go:117] "RemoveContainer" containerID="e9aa39b0b4fa8bee2a5fa5359835265331414170d04a3a3a7ed7751ec7df78c9" Mar 16 17:31:28 crc kubenswrapper[5120]: I0316 17:31:28.607237 5120 scope.go:117] "RemoveContainer" containerID="b4eda95ca813921c9f3e8b78648ab182f5dce86a684c9d715da2381ce959207c" Mar 16 17:31:28 crc kubenswrapper[5120]: I0316 17:31:28.630592 5120 scope.go:117] "RemoveContainer" containerID="873068b6bbc29240846337736a47389c76af632240fb1df5b2925dd5e4819d93" Mar 16 17:31:28 crc kubenswrapper[5120]: I0316 17:31:28.668506 5120 scope.go:117] "RemoveContainer" containerID="baab5981bae1d55395fe57cbdefcda23a160b798f1acf5543946ee5e76f035eb" Mar 16 17:31:28 crc kubenswrapper[5120]: I0316 17:31:28.700272 5120 scope.go:117] "RemoveContainer" containerID="7030b93327db94386b36e0fbe44123e0027372fbd6f85c3a87cf92746740491d" Mar 16 17:31:28 crc kubenswrapper[5120]: I0316 17:31:28.730912 5120 scope.go:117] "RemoveContainer" containerID="fd4225c0e24d106b55cc7f9e1a02c63e43004a8f15a1c1ebb1762b82f65e65d2" Mar 16 17:31:28 crc kubenswrapper[5120]: I0316 17:31:28.822994 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-8c7594c8f-pkzzl" Mar 16 17:31:28 crc kubenswrapper[5120]: I0316 17:31:28.893788 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-vhnqf"] Mar 16 17:31:28 crc kubenswrapper[5120]: I0316 17:31:28.894026 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-vhnqf" podUID="8cd65401-2ccd-48bf-8103-caf1c7b81ea7" containerName="dnsmasq-dns" containerID="cri-o://b750bca2295eb68789f2a737488715a80393c4f2e89325ea802363297dec96e7" gracePeriod=10 Mar 16 17:31:29 crc kubenswrapper[5120]: I0316 17:31:29.310135 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-vhnqf" Mar 16 17:31:29 crc kubenswrapper[5120]: I0316 17:31:29.411112 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8cd65401-2ccd-48bf-8103-caf1c7b81ea7-config\") pod \"8cd65401-2ccd-48bf-8103-caf1c7b81ea7\" (UID: \"8cd65401-2ccd-48bf-8103-caf1c7b81ea7\") " Mar 16 17:31:29 crc kubenswrapper[5120]: I0316 17:31:29.411422 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/8cd65401-2ccd-48bf-8103-caf1c7b81ea7-dnsmasq-svc\") pod \"8cd65401-2ccd-48bf-8103-caf1c7b81ea7\" (UID: \"8cd65401-2ccd-48bf-8103-caf1c7b81ea7\") " Mar 16 17:31:29 crc kubenswrapper[5120]: I0316 17:31:29.411738 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zbt9p\" (UniqueName: \"kubernetes.io/projected/8cd65401-2ccd-48bf-8103-caf1c7b81ea7-kube-api-access-zbt9p\") pod \"8cd65401-2ccd-48bf-8103-caf1c7b81ea7\" (UID: \"8cd65401-2ccd-48bf-8103-caf1c7b81ea7\") " Mar 16 17:31:29 crc kubenswrapper[5120]: I0316 17:31:29.416172 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8cd65401-2ccd-48bf-8103-caf1c7b81ea7-kube-api-access-zbt9p" (OuterVolumeSpecName: "kube-api-access-zbt9p") pod "8cd65401-2ccd-48bf-8103-caf1c7b81ea7" (UID: "8cd65401-2ccd-48bf-8103-caf1c7b81ea7"). InnerVolumeSpecName "kube-api-access-zbt9p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:31:29 crc kubenswrapper[5120]: I0316 17:31:29.445189 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8cd65401-2ccd-48bf-8103-caf1c7b81ea7-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "8cd65401-2ccd-48bf-8103-caf1c7b81ea7" (UID: "8cd65401-2ccd-48bf-8103-caf1c7b81ea7"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:31:29 crc kubenswrapper[5120]: I0316 17:31:29.447022 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8cd65401-2ccd-48bf-8103-caf1c7b81ea7-config" (OuterVolumeSpecName: "config") pod "8cd65401-2ccd-48bf-8103-caf1c7b81ea7" (UID: "8cd65401-2ccd-48bf-8103-caf1c7b81ea7"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:31:29 crc kubenswrapper[5120]: I0316 17:31:29.514303 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8cd65401-2ccd-48bf-8103-caf1c7b81ea7-config\") on node \"crc\" DevicePath \"\"" Mar 16 17:31:29 crc kubenswrapper[5120]: I0316 17:31:29.514339 5120 reconciler_common.go:299] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/8cd65401-2ccd-48bf-8103-caf1c7b81ea7-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Mar 16 17:31:29 crc kubenswrapper[5120]: I0316 17:31:29.514353 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zbt9p\" (UniqueName: \"kubernetes.io/projected/8cd65401-2ccd-48bf-8103-caf1c7b81ea7-kube-api-access-zbt9p\") on node \"crc\" DevicePath \"\"" Mar 16 17:31:29 crc kubenswrapper[5120]: I0316 17:31:29.917444 5120 generic.go:358] "Generic (PLEG): container finished" podID="8cd65401-2ccd-48bf-8103-caf1c7b81ea7" containerID="b750bca2295eb68789f2a737488715a80393c4f2e89325ea802363297dec96e7" exitCode=0 Mar 16 17:31:29 crc kubenswrapper[5120]: I0316 17:31:29.917527 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-vhnqf" event={"ID":"8cd65401-2ccd-48bf-8103-caf1c7b81ea7","Type":"ContainerDied","Data":"b750bca2295eb68789f2a737488715a80393c4f2e89325ea802363297dec96e7"} Mar 16 17:31:29 crc kubenswrapper[5120]: I0316 17:31:29.917555 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-vhnqf" event={"ID":"8cd65401-2ccd-48bf-8103-caf1c7b81ea7","Type":"ContainerDied","Data":"5def8cd68b199be3f0e4b8dcedacc7c3af4a1008d752e930fd08ab1d4be55bc7"} Mar 16 17:31:29 crc kubenswrapper[5120]: I0316 17:31:29.917553 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-vhnqf" Mar 16 17:31:29 crc kubenswrapper[5120]: I0316 17:31:29.917575 5120 scope.go:117] "RemoveContainer" containerID="b750bca2295eb68789f2a737488715a80393c4f2e89325ea802363297dec96e7" Mar 16 17:31:29 crc kubenswrapper[5120]: I0316 17:31:29.948235 5120 scope.go:117] "RemoveContainer" containerID="f77e66934df22a8b9cfc852b5e3b40cf48ccb6c5f96ca1300f68d7d959b1095a" Mar 16 17:31:29 crc kubenswrapper[5120]: I0316 17:31:29.951909 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-vhnqf"] Mar 16 17:31:29 crc kubenswrapper[5120]: I0316 17:31:29.961263 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-vhnqf"] Mar 16 17:31:29 crc kubenswrapper[5120]: I0316 17:31:29.983213 5120 scope.go:117] "RemoveContainer" containerID="b750bca2295eb68789f2a737488715a80393c4f2e89325ea802363297dec96e7" Mar 16 17:31:29 crc kubenswrapper[5120]: E0316 17:31:29.983674 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b750bca2295eb68789f2a737488715a80393c4f2e89325ea802363297dec96e7\": container with ID starting with b750bca2295eb68789f2a737488715a80393c4f2e89325ea802363297dec96e7 not found: ID does not exist" containerID="b750bca2295eb68789f2a737488715a80393c4f2e89325ea802363297dec96e7" Mar 16 17:31:29 crc kubenswrapper[5120]: I0316 17:31:29.983715 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b750bca2295eb68789f2a737488715a80393c4f2e89325ea802363297dec96e7"} err="failed to get container status \"b750bca2295eb68789f2a737488715a80393c4f2e89325ea802363297dec96e7\": rpc error: code = NotFound desc = could not find container \"b750bca2295eb68789f2a737488715a80393c4f2e89325ea802363297dec96e7\": container with ID starting with b750bca2295eb68789f2a737488715a80393c4f2e89325ea802363297dec96e7 not found: ID does not exist" Mar 16 17:31:29 crc kubenswrapper[5120]: I0316 17:31:29.983739 5120 scope.go:117] "RemoveContainer" containerID="f77e66934df22a8b9cfc852b5e3b40cf48ccb6c5f96ca1300f68d7d959b1095a" Mar 16 17:31:29 crc kubenswrapper[5120]: E0316 17:31:29.984050 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f77e66934df22a8b9cfc852b5e3b40cf48ccb6c5f96ca1300f68d7d959b1095a\": container with ID starting with f77e66934df22a8b9cfc852b5e3b40cf48ccb6c5f96ca1300f68d7d959b1095a not found: ID does not exist" containerID="f77e66934df22a8b9cfc852b5e3b40cf48ccb6c5f96ca1300f68d7d959b1095a" Mar 16 17:31:29 crc kubenswrapper[5120]: I0316 17:31:29.984085 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f77e66934df22a8b9cfc852b5e3b40cf48ccb6c5f96ca1300f68d7d959b1095a"} err="failed to get container status \"f77e66934df22a8b9cfc852b5e3b40cf48ccb6c5f96ca1300f68d7d959b1095a\": rpc error: code = NotFound desc = could not find container \"f77e66934df22a8b9cfc852b5e3b40cf48ccb6c5f96ca1300f68d7d959b1095a\": container with ID starting with f77e66934df22a8b9cfc852b5e3b40cf48ccb6c5f96ca1300f68d7d959b1095a not found: ID does not exist" Mar 16 17:31:30 crc kubenswrapper[5120]: I0316 17:31:30.671414 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8cd65401-2ccd-48bf-8103-caf1c7b81ea7" path="/var/lib/kubelet/pods/8cd65401-2ccd-48bf-8103-caf1c7b81ea7/volumes" Mar 16 17:31:35 crc kubenswrapper[5120]: I0316 17:31:35.280802 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/custom-img-svc-edpm-compute-no-nodes-edpm-no-nodes-custom-mhwqk"] Mar 16 17:31:35 crc kubenswrapper[5120]: I0316 17:31:35.282020 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8cd65401-2ccd-48bf-8103-caf1c7b81ea7" containerName="init" Mar 16 17:31:35 crc kubenswrapper[5120]: I0316 17:31:35.282036 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8cd65401-2ccd-48bf-8103-caf1c7b81ea7" containerName="init" Mar 16 17:31:35 crc kubenswrapper[5120]: I0316 17:31:35.282048 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8cd65401-2ccd-48bf-8103-caf1c7b81ea7" containerName="dnsmasq-dns" Mar 16 17:31:35 crc kubenswrapper[5120]: I0316 17:31:35.282054 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8cd65401-2ccd-48bf-8103-caf1c7b81ea7" containerName="dnsmasq-dns" Mar 16 17:31:35 crc kubenswrapper[5120]: I0316 17:31:35.282286 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="8cd65401-2ccd-48bf-8103-caf1c7b81ea7" containerName="dnsmasq-dns" Mar 16 17:31:35 crc kubenswrapper[5120]: I0316 17:31:35.299211 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/custom-img-svc-edpm-compute-no-nodes-edpm-no-nodes-custom-mhwqk"] Mar 16 17:31:35 crc kubenswrapper[5120]: I0316 17:31:35.299464 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/custom-img-svc-edpm-compute-no-nodes-edpm-no-nodes-custom-mhwqk" Mar 16 17:31:35 crc kubenswrapper[5120]: I0316 17:31:35.304466 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"edpm-no-nodes-custom-svc-dockercfg-jk9zl\"" Mar 16 17:31:35 crc kubenswrapper[5120]: I0316 17:31:35.304765 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplanenodeset-edpm-no-nodes-custom-svc\"" Mar 16 17:31:35 crc kubenswrapper[5120]: I0316 17:31:35.304910 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-aee-default-env\"" Mar 16 17:31:35 crc kubenswrapper[5120]: I0316 17:31:35.305027 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"combined-ca-bundle\"" Mar 16 17:31:35 crc kubenswrapper[5120]: I0316 17:31:35.305723 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplane-ansible-ssh-private-key-secret\"" Mar 16 17:31:35 crc kubenswrapper[5120]: I0316 17:31:35.333064 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/d6450789-0a55-41c8-bfcd-0b5526152010-inventory\") pod \"custom-img-svc-edpm-compute-no-nodes-edpm-no-nodes-custom-mhwqk\" (UID: \"d6450789-0a55-41c8-bfcd-0b5526152010\") " pod="openstack-kuttl-tests/custom-img-svc-edpm-compute-no-nodes-edpm-no-nodes-custom-mhwqk" Mar 16 17:31:35 crc kubenswrapper[5120]: I0316 17:31:35.333137 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdfvq\" (UniqueName: \"kubernetes.io/projected/d6450789-0a55-41c8-bfcd-0b5526152010-kube-api-access-gdfvq\") pod \"custom-img-svc-edpm-compute-no-nodes-edpm-no-nodes-custom-mhwqk\" (UID: \"d6450789-0a55-41c8-bfcd-0b5526152010\") " pod="openstack-kuttl-tests/custom-img-svc-edpm-compute-no-nodes-edpm-no-nodes-custom-mhwqk" Mar 16 17:31:35 crc kubenswrapper[5120]: I0316 17:31:35.333160 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"custom-img-svc-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d6450789-0a55-41c8-bfcd-0b5526152010-custom-img-svc-combined-ca-bundle\") pod \"custom-img-svc-edpm-compute-no-nodes-edpm-no-nodes-custom-mhwqk\" (UID: \"d6450789-0a55-41c8-bfcd-0b5526152010\") " pod="openstack-kuttl-tests/custom-img-svc-edpm-compute-no-nodes-edpm-no-nodes-custom-mhwqk" Mar 16 17:31:35 crc kubenswrapper[5120]: I0316 17:31:35.333874 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key-edpm-no-nodes-custom-svc\" (UniqueName: \"kubernetes.io/secret/d6450789-0a55-41c8-bfcd-0b5526152010-ssh-key-edpm-no-nodes-custom-svc\") pod \"custom-img-svc-edpm-compute-no-nodes-edpm-no-nodes-custom-mhwqk\" (UID: \"d6450789-0a55-41c8-bfcd-0b5526152010\") " pod="openstack-kuttl-tests/custom-img-svc-edpm-compute-no-nodes-edpm-no-nodes-custom-mhwqk" Mar 16 17:31:35 crc kubenswrapper[5120]: I0316 17:31:35.406657 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/custom-img-svc-edpm-compute-no-nodes-edpm-no-nodes-custom-mhwqk"] Mar 16 17:31:35 crc kubenswrapper[5120]: E0316 17:31:35.407174 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[custom-img-svc-combined-ca-bundle inventory kube-api-access-gdfvq ssh-key-edpm-no-nodes-custom-svc], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openstack-kuttl-tests/custom-img-svc-edpm-compute-no-nodes-edpm-no-nodes-custom-mhwqk" podUID="d6450789-0a55-41c8-bfcd-0b5526152010" Mar 16 17:31:35 crc kubenswrapper[5120]: I0316 17:31:35.436913 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/d6450789-0a55-41c8-bfcd-0b5526152010-inventory\") pod \"custom-img-svc-edpm-compute-no-nodes-edpm-no-nodes-custom-mhwqk\" (UID: \"d6450789-0a55-41c8-bfcd-0b5526152010\") " pod="openstack-kuttl-tests/custom-img-svc-edpm-compute-no-nodes-edpm-no-nodes-custom-mhwqk" Mar 16 17:31:35 crc kubenswrapper[5120]: I0316 17:31:35.436959 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gdfvq\" (UniqueName: \"kubernetes.io/projected/d6450789-0a55-41c8-bfcd-0b5526152010-kube-api-access-gdfvq\") pod \"custom-img-svc-edpm-compute-no-nodes-edpm-no-nodes-custom-mhwqk\" (UID: \"d6450789-0a55-41c8-bfcd-0b5526152010\") " pod="openstack-kuttl-tests/custom-img-svc-edpm-compute-no-nodes-edpm-no-nodes-custom-mhwqk" Mar 16 17:31:35 crc kubenswrapper[5120]: I0316 17:31:35.436983 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"custom-img-svc-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d6450789-0a55-41c8-bfcd-0b5526152010-custom-img-svc-combined-ca-bundle\") pod \"custom-img-svc-edpm-compute-no-nodes-edpm-no-nodes-custom-mhwqk\" (UID: \"d6450789-0a55-41c8-bfcd-0b5526152010\") " pod="openstack-kuttl-tests/custom-img-svc-edpm-compute-no-nodes-edpm-no-nodes-custom-mhwqk" Mar 16 17:31:35 crc kubenswrapper[5120]: E0316 17:31:35.437078 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/dataplanenodeset-edpm-no-nodes-custom-svc: secret "dataplanenodeset-edpm-no-nodes-custom-svc" not found Mar 16 17:31:35 crc kubenswrapper[5120]: E0316 17:31:35.439523 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6450789-0a55-41c8-bfcd-0b5526152010-inventory podName:d6450789-0a55-41c8-bfcd-0b5526152010 nodeName:}" failed. No retries permitted until 2026-03-16 17:31:35.939480443 +0000 UTC m=+7198.093412100 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "inventory" (UniqueName: "kubernetes.io/secret/d6450789-0a55-41c8-bfcd-0b5526152010-inventory") pod "custom-img-svc-edpm-compute-no-nodes-edpm-no-nodes-custom-mhwqk" (UID: "d6450789-0a55-41c8-bfcd-0b5526152010") : secret "dataplanenodeset-edpm-no-nodes-custom-svc" not found Mar 16 17:31:35 crc kubenswrapper[5120]: I0316 17:31:35.439850 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ssh-key-edpm-no-nodes-custom-svc\" (UniqueName: \"kubernetes.io/secret/d6450789-0a55-41c8-bfcd-0b5526152010-ssh-key-edpm-no-nodes-custom-svc\") pod \"custom-img-svc-edpm-compute-no-nodes-edpm-no-nodes-custom-mhwqk\" (UID: \"d6450789-0a55-41c8-bfcd-0b5526152010\") " pod="openstack-kuttl-tests/custom-img-svc-edpm-compute-no-nodes-edpm-no-nodes-custom-mhwqk" Mar 16 17:31:35 crc kubenswrapper[5120]: E0316 17:31:35.442124 5120 projected.go:194] Error preparing data for projected volume kube-api-access-gdfvq for pod openstack-kuttl-tests/custom-img-svc-edpm-compute-no-nodes-edpm-no-nodes-custom-mhwqk: failed to fetch token: serviceaccounts "edpm-no-nodes-custom-svc" not found Mar 16 17:31:35 crc kubenswrapper[5120]: E0316 17:31:35.442295 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d6450789-0a55-41c8-bfcd-0b5526152010-kube-api-access-gdfvq podName:d6450789-0a55-41c8-bfcd-0b5526152010 nodeName:}" failed. No retries permitted until 2026-03-16 17:31:35.942267159 +0000 UTC m=+7198.096198816 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-gdfvq" (UniqueName: "kubernetes.io/projected/d6450789-0a55-41c8-bfcd-0b5526152010-kube-api-access-gdfvq") pod "custom-img-svc-edpm-compute-no-nodes-edpm-no-nodes-custom-mhwqk" (UID: "d6450789-0a55-41c8-bfcd-0b5526152010") : failed to fetch token: serviceaccounts "edpm-no-nodes-custom-svc" not found Mar 16 17:31:35 crc kubenswrapper[5120]: I0316 17:31:35.446422 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ssh-key-edpm-no-nodes-custom-svc\" (UniqueName: \"kubernetes.io/secret/d6450789-0a55-41c8-bfcd-0b5526152010-ssh-key-edpm-no-nodes-custom-svc\") pod \"custom-img-svc-edpm-compute-no-nodes-edpm-no-nodes-custom-mhwqk\" (UID: \"d6450789-0a55-41c8-bfcd-0b5526152010\") " pod="openstack-kuttl-tests/custom-img-svc-edpm-compute-no-nodes-edpm-no-nodes-custom-mhwqk" Mar 16 17:31:35 crc kubenswrapper[5120]: I0316 17:31:35.447500 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"custom-img-svc-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d6450789-0a55-41c8-bfcd-0b5526152010-custom-img-svc-combined-ca-bundle\") pod \"custom-img-svc-edpm-compute-no-nodes-edpm-no-nodes-custom-mhwqk\" (UID: \"d6450789-0a55-41c8-bfcd-0b5526152010\") " pod="openstack-kuttl-tests/custom-img-svc-edpm-compute-no-nodes-edpm-no-nodes-custom-mhwqk" Mar 16 17:31:35 crc kubenswrapper[5120]: I0316 17:31:35.473505 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-555qn"] Mar 16 17:31:35 crc kubenswrapper[5120]: I0316 17:31:35.478889 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-555qn" Mar 16 17:31:35 crc kubenswrapper[5120]: I0316 17:31:35.490354 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-555qn"] Mar 16 17:31:35 crc kubenswrapper[5120]: I0316 17:31:35.541370 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vs2d\" (UniqueName: \"kubernetes.io/projected/1c4d5375-dde1-49f9-b29e-6445c3f7957c-kube-api-access-7vs2d\") pod \"dnsmasq-dnsmasq-79dcd846c5-555qn\" (UID: \"1c4d5375-dde1-49f9-b29e-6445c3f7957c\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-555qn" Mar 16 17:31:35 crc kubenswrapper[5120]: I0316 17:31:35.541691 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/1c4d5375-dde1-49f9-b29e-6445c3f7957c-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-79dcd846c5-555qn\" (UID: \"1c4d5375-dde1-49f9-b29e-6445c3f7957c\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-555qn" Mar 16 17:31:35 crc kubenswrapper[5120]: I0316 17:31:35.541819 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1c4d5375-dde1-49f9-b29e-6445c3f7957c-config\") pod \"dnsmasq-dnsmasq-79dcd846c5-555qn\" (UID: \"1c4d5375-dde1-49f9-b29e-6445c3f7957c\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-555qn" Mar 16 17:31:35 crc kubenswrapper[5120]: I0316 17:31:35.643952 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1c4d5375-dde1-49f9-b29e-6445c3f7957c-config\") pod \"dnsmasq-dnsmasq-79dcd846c5-555qn\" (UID: \"1c4d5375-dde1-49f9-b29e-6445c3f7957c\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-555qn" Mar 16 17:31:35 crc kubenswrapper[5120]: I0316 17:31:35.644397 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7vs2d\" (UniqueName: \"kubernetes.io/projected/1c4d5375-dde1-49f9-b29e-6445c3f7957c-kube-api-access-7vs2d\") pod \"dnsmasq-dnsmasq-79dcd846c5-555qn\" (UID: \"1c4d5375-dde1-49f9-b29e-6445c3f7957c\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-555qn" Mar 16 17:31:35 crc kubenswrapper[5120]: I0316 17:31:35.644482 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/1c4d5375-dde1-49f9-b29e-6445c3f7957c-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-79dcd846c5-555qn\" (UID: \"1c4d5375-dde1-49f9-b29e-6445c3f7957c\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-555qn" Mar 16 17:31:35 crc kubenswrapper[5120]: I0316 17:31:35.645150 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1c4d5375-dde1-49f9-b29e-6445c3f7957c-config\") pod \"dnsmasq-dnsmasq-79dcd846c5-555qn\" (UID: \"1c4d5375-dde1-49f9-b29e-6445c3f7957c\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-555qn" Mar 16 17:31:35 crc kubenswrapper[5120]: I0316 17:31:35.645472 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/1c4d5375-dde1-49f9-b29e-6445c3f7957c-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-79dcd846c5-555qn\" (UID: \"1c4d5375-dde1-49f9-b29e-6445c3f7957c\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-555qn" Mar 16 17:31:35 crc kubenswrapper[5120]: I0316 17:31:35.662543 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vs2d\" (UniqueName: \"kubernetes.io/projected/1c4d5375-dde1-49f9-b29e-6445c3f7957c-kube-api-access-7vs2d\") pod \"dnsmasq-dnsmasq-79dcd846c5-555qn\" (UID: \"1c4d5375-dde1-49f9-b29e-6445c3f7957c\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-555qn" Mar 16 17:31:35 crc kubenswrapper[5120]: I0316 17:31:35.663471 5120 scope.go:117] "RemoveContainer" containerID="df0a87b047c8208d5fc21057efed33321f6cab49c4cf053702d222dc12979450" Mar 16 17:31:35 crc kubenswrapper[5120]: E0316 17:31:35.664374 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 17:31:35 crc kubenswrapper[5120]: I0316 17:31:35.830509 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-555qn" Mar 16 17:31:35 crc kubenswrapper[5120]: I0316 17:31:35.951534 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/d6450789-0a55-41c8-bfcd-0b5526152010-inventory\") pod \"custom-img-svc-edpm-compute-no-nodes-edpm-no-nodes-custom-mhwqk\" (UID: \"d6450789-0a55-41c8-bfcd-0b5526152010\") " pod="openstack-kuttl-tests/custom-img-svc-edpm-compute-no-nodes-edpm-no-nodes-custom-mhwqk" Mar 16 17:31:35 crc kubenswrapper[5120]: I0316 17:31:35.951595 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gdfvq\" (UniqueName: \"kubernetes.io/projected/d6450789-0a55-41c8-bfcd-0b5526152010-kube-api-access-gdfvq\") pod \"custom-img-svc-edpm-compute-no-nodes-edpm-no-nodes-custom-mhwqk\" (UID: \"d6450789-0a55-41c8-bfcd-0b5526152010\") " pod="openstack-kuttl-tests/custom-img-svc-edpm-compute-no-nodes-edpm-no-nodes-custom-mhwqk" Mar 16 17:31:35 crc kubenswrapper[5120]: E0316 17:31:35.951745 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/dataplanenodeset-edpm-no-nodes-custom-svc: secret "dataplanenodeset-edpm-no-nodes-custom-svc" not found Mar 16 17:31:35 crc kubenswrapper[5120]: E0316 17:31:35.952258 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6450789-0a55-41c8-bfcd-0b5526152010-inventory podName:d6450789-0a55-41c8-bfcd-0b5526152010 nodeName:}" failed. No retries permitted until 2026-03-16 17:31:36.952230896 +0000 UTC m=+7199.106162553 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "inventory" (UniqueName: "kubernetes.io/secret/d6450789-0a55-41c8-bfcd-0b5526152010-inventory") pod "custom-img-svc-edpm-compute-no-nodes-edpm-no-nodes-custom-mhwqk" (UID: "d6450789-0a55-41c8-bfcd-0b5526152010") : secret "dataplanenodeset-edpm-no-nodes-custom-svc" not found Mar 16 17:31:35 crc kubenswrapper[5120]: E0316 17:31:35.955567 5120 projected.go:194] Error preparing data for projected volume kube-api-access-gdfvq for pod openstack-kuttl-tests/custom-img-svc-edpm-compute-no-nodes-edpm-no-nodes-custom-mhwqk: failed to fetch token: serviceaccounts "edpm-no-nodes-custom-svc" not found Mar 16 17:31:35 crc kubenswrapper[5120]: E0316 17:31:35.955707 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d6450789-0a55-41c8-bfcd-0b5526152010-kube-api-access-gdfvq podName:d6450789-0a55-41c8-bfcd-0b5526152010 nodeName:}" failed. No retries permitted until 2026-03-16 17:31:36.955679879 +0000 UTC m=+7199.109611536 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-gdfvq" (UniqueName: "kubernetes.io/projected/d6450789-0a55-41c8-bfcd-0b5526152010-kube-api-access-gdfvq") pod "custom-img-svc-edpm-compute-no-nodes-edpm-no-nodes-custom-mhwqk" (UID: "d6450789-0a55-41c8-bfcd-0b5526152010") : failed to fetch token: serviceaccounts "edpm-no-nodes-custom-svc" not found Mar 16 17:31:35 crc kubenswrapper[5120]: I0316 17:31:35.972082 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/custom-img-svc-edpm-compute-no-nodes-edpm-no-nodes-custom-mhwqk" Mar 16 17:31:35 crc kubenswrapper[5120]: I0316 17:31:35.983685 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/custom-img-svc-edpm-compute-no-nodes-edpm-no-nodes-custom-mhwqk" Mar 16 17:31:36 crc kubenswrapper[5120]: I0316 17:31:36.053482 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ssh-key-edpm-no-nodes-custom-svc\" (UniqueName: \"kubernetes.io/secret/d6450789-0a55-41c8-bfcd-0b5526152010-ssh-key-edpm-no-nodes-custom-svc\") pod \"d6450789-0a55-41c8-bfcd-0b5526152010\" (UID: \"d6450789-0a55-41c8-bfcd-0b5526152010\") " Mar 16 17:31:36 crc kubenswrapper[5120]: I0316 17:31:36.053623 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"custom-img-svc-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d6450789-0a55-41c8-bfcd-0b5526152010-custom-img-svc-combined-ca-bundle\") pod \"d6450789-0a55-41c8-bfcd-0b5526152010\" (UID: \"d6450789-0a55-41c8-bfcd-0b5526152010\") " Mar 16 17:31:36 crc kubenswrapper[5120]: I0316 17:31:36.057848 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6450789-0a55-41c8-bfcd-0b5526152010-custom-img-svc-combined-ca-bundle" (OuterVolumeSpecName: "custom-img-svc-combined-ca-bundle") pod "d6450789-0a55-41c8-bfcd-0b5526152010" (UID: "d6450789-0a55-41c8-bfcd-0b5526152010"). InnerVolumeSpecName "custom-img-svc-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:31:36 crc kubenswrapper[5120]: I0316 17:31:36.060732 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6450789-0a55-41c8-bfcd-0b5526152010-ssh-key-edpm-no-nodes-custom-svc" (OuterVolumeSpecName: "ssh-key-edpm-no-nodes-custom-svc") pod "d6450789-0a55-41c8-bfcd-0b5526152010" (UID: "d6450789-0a55-41c8-bfcd-0b5526152010"). InnerVolumeSpecName "ssh-key-edpm-no-nodes-custom-svc". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:31:36 crc kubenswrapper[5120]: I0316 17:31:36.156622 5120 reconciler_common.go:299] "Volume detached for volume \"custom-img-svc-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d6450789-0a55-41c8-bfcd-0b5526152010-custom-img-svc-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:31:36 crc kubenswrapper[5120]: I0316 17:31:36.156664 5120 reconciler_common.go:299] "Volume detached for volume \"ssh-key-edpm-no-nodes-custom-svc\" (UniqueName: \"kubernetes.io/secret/d6450789-0a55-41c8-bfcd-0b5526152010-ssh-key-edpm-no-nodes-custom-svc\") on node \"crc\" DevicePath \"\"" Mar 16 17:31:36 crc kubenswrapper[5120]: I0316 17:31:36.235291 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-555qn"] Mar 16 17:31:36 crc kubenswrapper[5120]: I0316 17:31:36.973028 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/d6450789-0a55-41c8-bfcd-0b5526152010-inventory\") pod \"custom-img-svc-edpm-compute-no-nodes-edpm-no-nodes-custom-mhwqk\" (UID: \"d6450789-0a55-41c8-bfcd-0b5526152010\") " pod="openstack-kuttl-tests/custom-img-svc-edpm-compute-no-nodes-edpm-no-nodes-custom-mhwqk" Mar 16 17:31:36 crc kubenswrapper[5120]: I0316 17:31:36.973376 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gdfvq\" (UniqueName: \"kubernetes.io/projected/d6450789-0a55-41c8-bfcd-0b5526152010-kube-api-access-gdfvq\") pod \"custom-img-svc-edpm-compute-no-nodes-edpm-no-nodes-custom-mhwqk\" (UID: \"d6450789-0a55-41c8-bfcd-0b5526152010\") " pod="openstack-kuttl-tests/custom-img-svc-edpm-compute-no-nodes-edpm-no-nodes-custom-mhwqk" Mar 16 17:31:36 crc kubenswrapper[5120]: E0316 17:31:36.973216 5120 secret.go:189] Couldn't get secret openstack-kuttl-tests/dataplanenodeset-edpm-no-nodes-custom-svc: secret "dataplanenodeset-edpm-no-nodes-custom-svc" not found Mar 16 17:31:36 crc kubenswrapper[5120]: E0316 17:31:36.973505 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6450789-0a55-41c8-bfcd-0b5526152010-inventory podName:d6450789-0a55-41c8-bfcd-0b5526152010 nodeName:}" failed. No retries permitted until 2026-03-16 17:31:38.973486614 +0000 UTC m=+7201.127418271 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "inventory" (UniqueName: "kubernetes.io/secret/d6450789-0a55-41c8-bfcd-0b5526152010-inventory") pod "custom-img-svc-edpm-compute-no-nodes-edpm-no-nodes-custom-mhwqk" (UID: "d6450789-0a55-41c8-bfcd-0b5526152010") : secret "dataplanenodeset-edpm-no-nodes-custom-svc" not found Mar 16 17:31:36 crc kubenswrapper[5120]: E0316 17:31:36.978371 5120 projected.go:194] Error preparing data for projected volume kube-api-access-gdfvq for pod openstack-kuttl-tests/custom-img-svc-edpm-compute-no-nodes-edpm-no-nodes-custom-mhwqk: failed to fetch token: serviceaccounts "edpm-no-nodes-custom-svc" not found Mar 16 17:31:36 crc kubenswrapper[5120]: E0316 17:31:36.978527 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d6450789-0a55-41c8-bfcd-0b5526152010-kube-api-access-gdfvq podName:d6450789-0a55-41c8-bfcd-0b5526152010 nodeName:}" failed. No retries permitted until 2026-03-16 17:31:38.978470011 +0000 UTC m=+7201.132401668 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-gdfvq" (UniqueName: "kubernetes.io/projected/d6450789-0a55-41c8-bfcd-0b5526152010-kube-api-access-gdfvq") pod "custom-img-svc-edpm-compute-no-nodes-edpm-no-nodes-custom-mhwqk" (UID: "d6450789-0a55-41c8-bfcd-0b5526152010") : failed to fetch token: serviceaccounts "edpm-no-nodes-custom-svc" not found Mar 16 17:31:36 crc kubenswrapper[5120]: I0316 17:31:36.986325 5120 generic.go:358] "Generic (PLEG): container finished" podID="1c4d5375-dde1-49f9-b29e-6445c3f7957c" containerID="493f986f9c0c14ce154f84f7fbf7ff0dc07bd71e745ce8574c0b4a03ec5bee8b" exitCode=0 Mar 16 17:31:36 crc kubenswrapper[5120]: I0316 17:31:36.986393 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-555qn" event={"ID":"1c4d5375-dde1-49f9-b29e-6445c3f7957c","Type":"ContainerDied","Data":"493f986f9c0c14ce154f84f7fbf7ff0dc07bd71e745ce8574c0b4a03ec5bee8b"} Mar 16 17:31:36 crc kubenswrapper[5120]: I0316 17:31:36.986449 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-555qn" event={"ID":"1c4d5375-dde1-49f9-b29e-6445c3f7957c","Type":"ContainerStarted","Data":"3ef71fe4bfed1f82471548e0ad1ab67761893f553f6eb3277ea7480bb86e7fee"} Mar 16 17:31:36 crc kubenswrapper[5120]: I0316 17:31:36.986806 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/custom-img-svc-edpm-compute-no-nodes-edpm-no-nodes-custom-mhwqk" Mar 16 17:31:37 crc kubenswrapper[5120]: I0316 17:31:37.048794 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/custom-img-svc-edpm-compute-no-nodes-edpm-no-nodes-custom-mhwqk"] Mar 16 17:31:37 crc kubenswrapper[5120]: I0316 17:31:37.057813 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/custom-img-svc-edpm-compute-no-nodes-edpm-no-nodes-custom-mhwqk"] Mar 16 17:31:37 crc kubenswrapper[5120]: I0316 17:31:37.178368 5120 reconciler_common.go:299] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/d6450789-0a55-41c8-bfcd-0b5526152010-inventory\") on node \"crc\" DevicePath \"\"" Mar 16 17:31:37 crc kubenswrapper[5120]: I0316 17:31:37.178394 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gdfvq\" (UniqueName: \"kubernetes.io/projected/d6450789-0a55-41c8-bfcd-0b5526152010-kube-api-access-gdfvq\") on node \"crc\" DevicePath \"\"" Mar 16 17:31:37 crc kubenswrapper[5120]: I0316 17:31:37.997539 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-555qn" event={"ID":"1c4d5375-dde1-49f9-b29e-6445c3f7957c","Type":"ContainerStarted","Data":"fd78b069ad4a7e78117da248c4b31e385283370e87f4e92d9b2beb60e772753c"} Mar 16 17:31:37 crc kubenswrapper[5120]: I0316 17:31:37.997632 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-555qn" Mar 16 17:31:38 crc kubenswrapper[5120]: I0316 17:31:38.019006 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-555qn" podStartSLOduration=3.018985935 podStartE2EDuration="3.018985935s" podCreationTimestamp="2026-03-16 17:31:35 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:31:38.012889588 +0000 UTC m=+7200.166821255" watchObservedRunningTime="2026-03-16 17:31:38.018985935 +0000 UTC m=+7200.172917592" Mar 16 17:31:38 crc kubenswrapper[5120]: I0316 17:31:38.673871 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d6450789-0a55-41c8-bfcd-0b5526152010" path="/var/lib/kubelet/pods/d6450789-0a55-41c8-bfcd-0b5526152010/volumes" Mar 16 17:31:38 crc kubenswrapper[5120]: I0316 17:31:38.746398 5120 pod_container_manager_linux.go:217] "Failed to delete cgroup paths" cgroupName=["kubepods","besteffort","pod6f0ac35c-eae8-4ead-9bce-441f102640c0"] err="unable to destroy cgroup paths for cgroup [kubepods besteffort pod6f0ac35c-eae8-4ead-9bce-441f102640c0] : Timed out while waiting for systemd to remove kubepods-besteffort-pod6f0ac35c_eae8_4ead_9bce_441f102640c0.slice" Mar 16 17:31:38 crc kubenswrapper[5120]: E0316 17:31:38.746522 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to delete cgroup paths for [kubepods besteffort pod6f0ac35c-eae8-4ead-9bce-441f102640c0] : unable to destroy cgroup paths for cgroup [kubepods besteffort pod6f0ac35c-eae8-4ead-9bce-441f102640c0] : Timed out while waiting for systemd to remove kubepods-besteffort-pod6f0ac35c_eae8_4ead_9bce_441f102640c0.slice" pod="openstack-kuttl-tests/kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-wd9wf" podUID="6f0ac35c-eae8-4ead-9bce-441f102640c0" Mar 16 17:31:39 crc kubenswrapper[5120]: I0316 17:31:39.005397 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-wd9wf" Mar 16 17:31:39 crc kubenswrapper[5120]: I0316 17:31:39.054697 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-wd9wf"] Mar 16 17:31:39 crc kubenswrapper[5120]: I0316 17:31:39.063305 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-wd9wf"] Mar 16 17:31:40 crc kubenswrapper[5120]: I0316 17:31:40.679799 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f0ac35c-eae8-4ead-9bce-441f102640c0" path="/var/lib/kubelet/pods/6f0ac35c-eae8-4ead-9bce-441f102640c0/volumes" Mar 16 17:31:42 crc kubenswrapper[5120]: I0316 17:31:42.661693 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["crc-storage/crc-storage-crc-xzcm2"] Mar 16 17:31:42 crc kubenswrapper[5120]: I0316 17:31:42.672674 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["crc-storage/crc-storage-crc-xzcm2"] Mar 16 17:31:42 crc kubenswrapper[5120]: I0316 17:31:42.781775 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["crc-storage/crc-storage-crc-gqxx5"] Mar 16 17:31:42 crc kubenswrapper[5120]: I0316 17:31:42.793184 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-gqxx5"] Mar 16 17:31:42 crc kubenswrapper[5120]: I0316 17:31:42.793295 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-gqxx5" Mar 16 17:31:42 crc kubenswrapper[5120]: I0316 17:31:42.797036 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"crc-storage\"" Mar 16 17:31:42 crc kubenswrapper[5120]: I0316 17:31:42.797317 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"openshift-service-ca.crt\"" Mar 16 17:31:42 crc kubenswrapper[5120]: I0316 17:31:42.799167 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"crc-storage\"/\"crc-storage-dockercfg-s2tht\"" Mar 16 17:31:42 crc kubenswrapper[5120]: I0316 17:31:42.799440 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"kube-root-ca.crt\"" Mar 16 17:31:42 crc kubenswrapper[5120]: I0316 17:31:42.799849 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtqfw\" (UniqueName: \"kubernetes.io/projected/4e3ed8b8-84a4-46f7-92d9-c17afb7a9d62-kube-api-access-mtqfw\") pod \"crc-storage-crc-gqxx5\" (UID: \"4e3ed8b8-84a4-46f7-92d9-c17afb7a9d62\") " pod="crc-storage/crc-storage-crc-gqxx5" Mar 16 17:31:42 crc kubenswrapper[5120]: I0316 17:31:42.799911 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/4e3ed8b8-84a4-46f7-92d9-c17afb7a9d62-crc-storage\") pod \"crc-storage-crc-gqxx5\" (UID: \"4e3ed8b8-84a4-46f7-92d9-c17afb7a9d62\") " pod="crc-storage/crc-storage-crc-gqxx5" Mar 16 17:31:42 crc kubenswrapper[5120]: I0316 17:31:42.800059 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/4e3ed8b8-84a4-46f7-92d9-c17afb7a9d62-node-mnt\") pod \"crc-storage-crc-gqxx5\" (UID: \"4e3ed8b8-84a4-46f7-92d9-c17afb7a9d62\") " pod="crc-storage/crc-storage-crc-gqxx5" Mar 16 17:31:42 crc kubenswrapper[5120]: I0316 17:31:42.901391 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/4e3ed8b8-84a4-46f7-92d9-c17afb7a9d62-crc-storage\") pod \"crc-storage-crc-gqxx5\" (UID: \"4e3ed8b8-84a4-46f7-92d9-c17afb7a9d62\") " pod="crc-storage/crc-storage-crc-gqxx5" Mar 16 17:31:42 crc kubenswrapper[5120]: I0316 17:31:42.901566 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/4e3ed8b8-84a4-46f7-92d9-c17afb7a9d62-node-mnt\") pod \"crc-storage-crc-gqxx5\" (UID: \"4e3ed8b8-84a4-46f7-92d9-c17afb7a9d62\") " pod="crc-storage/crc-storage-crc-gqxx5" Mar 16 17:31:42 crc kubenswrapper[5120]: I0316 17:31:42.901788 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mtqfw\" (UniqueName: \"kubernetes.io/projected/4e3ed8b8-84a4-46f7-92d9-c17afb7a9d62-kube-api-access-mtqfw\") pod \"crc-storage-crc-gqxx5\" (UID: \"4e3ed8b8-84a4-46f7-92d9-c17afb7a9d62\") " pod="crc-storage/crc-storage-crc-gqxx5" Mar 16 17:31:42 crc kubenswrapper[5120]: I0316 17:31:42.901963 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/4e3ed8b8-84a4-46f7-92d9-c17afb7a9d62-node-mnt\") pod \"crc-storage-crc-gqxx5\" (UID: \"4e3ed8b8-84a4-46f7-92d9-c17afb7a9d62\") " pod="crc-storage/crc-storage-crc-gqxx5" Mar 16 17:31:42 crc kubenswrapper[5120]: I0316 17:31:42.902264 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/4e3ed8b8-84a4-46f7-92d9-c17afb7a9d62-crc-storage\") pod \"crc-storage-crc-gqxx5\" (UID: \"4e3ed8b8-84a4-46f7-92d9-c17afb7a9d62\") " pod="crc-storage/crc-storage-crc-gqxx5" Mar 16 17:31:42 crc kubenswrapper[5120]: I0316 17:31:42.920940 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtqfw\" (UniqueName: \"kubernetes.io/projected/4e3ed8b8-84a4-46f7-92d9-c17afb7a9d62-kube-api-access-mtqfw\") pod \"crc-storage-crc-gqxx5\" (UID: \"4e3ed8b8-84a4-46f7-92d9-c17afb7a9d62\") " pod="crc-storage/crc-storage-crc-gqxx5" Mar 16 17:31:43 crc kubenswrapper[5120]: I0316 17:31:43.112742 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-gqxx5" Mar 16 17:31:43 crc kubenswrapper[5120]: I0316 17:31:43.563625 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-gqxx5"] Mar 16 17:31:43 crc kubenswrapper[5120]: W0316 17:31:43.565226 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4e3ed8b8_84a4_46f7_92d9_c17afb7a9d62.slice/crio-0afae4561f4eecb7dcf7659696182206290ffccb467b56c79c4e46053b6c9ca1 WatchSource:0}: Error finding container 0afae4561f4eecb7dcf7659696182206290ffccb467b56c79c4e46053b6c9ca1: Status 404 returned error can't find the container with id 0afae4561f4eecb7dcf7659696182206290ffccb467b56c79c4e46053b6c9ca1 Mar 16 17:31:44 crc kubenswrapper[5120]: I0316 17:31:44.006956 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-555qn" Mar 16 17:31:44 crc kubenswrapper[5120]: I0316 17:31:44.050030 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-gqxx5" event={"ID":"4e3ed8b8-84a4-46f7-92d9-c17afb7a9d62","Type":"ContainerStarted","Data":"0afae4561f4eecb7dcf7659696182206290ffccb467b56c79c4e46053b6c9ca1"} Mar 16 17:31:44 crc kubenswrapper[5120]: I0316 17:31:44.060168 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-8c7594c8f-pkzzl"] Mar 16 17:31:44 crc kubenswrapper[5120]: I0316 17:31:44.060449 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-8c7594c8f-pkzzl" podUID="6d6f8d10-cbb7-415a-b1ff-1e5cfd1c85bb" containerName="dnsmasq-dns" containerID="cri-o://7e2daefeaac48e45072b988b9bfe0f3af3a7a1b75d694e62437e344278af3381" gracePeriod=10 Mar 16 17:31:44 crc kubenswrapper[5120]: I0316 17:31:44.465198 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-8c7594c8f-pkzzl" Mar 16 17:31:44 crc kubenswrapper[5120]: I0316 17:31:44.540237 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/6d6f8d10-cbb7-415a-b1ff-1e5cfd1c85bb-dnsmasq-svc\") pod \"6d6f8d10-cbb7-415a-b1ff-1e5cfd1c85bb\" (UID: \"6d6f8d10-cbb7-415a-b1ff-1e5cfd1c85bb\") " Mar 16 17:31:44 crc kubenswrapper[5120]: I0316 17:31:44.540952 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6d6f8d10-cbb7-415a-b1ff-1e5cfd1c85bb-config\") pod \"6d6f8d10-cbb7-415a-b1ff-1e5cfd1c85bb\" (UID: \"6d6f8d10-cbb7-415a-b1ff-1e5cfd1c85bb\") " Mar 16 17:31:44 crc kubenswrapper[5120]: I0316 17:31:44.541306 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"edpm-no-nodes-custom-svc\" (UniqueName: \"kubernetes.io/configmap/6d6f8d10-cbb7-415a-b1ff-1e5cfd1c85bb-edpm-no-nodes-custom-svc\") pod \"6d6f8d10-cbb7-415a-b1ff-1e5cfd1c85bb\" (UID: \"6d6f8d10-cbb7-415a-b1ff-1e5cfd1c85bb\") " Mar 16 17:31:44 crc kubenswrapper[5120]: I0316 17:31:44.541448 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8nl27\" (UniqueName: \"kubernetes.io/projected/6d6f8d10-cbb7-415a-b1ff-1e5cfd1c85bb-kube-api-access-8nl27\") pod \"6d6f8d10-cbb7-415a-b1ff-1e5cfd1c85bb\" (UID: \"6d6f8d10-cbb7-415a-b1ff-1e5cfd1c85bb\") " Mar 16 17:31:44 crc kubenswrapper[5120]: I0316 17:31:44.546345 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d6f8d10-cbb7-415a-b1ff-1e5cfd1c85bb-kube-api-access-8nl27" (OuterVolumeSpecName: "kube-api-access-8nl27") pod "6d6f8d10-cbb7-415a-b1ff-1e5cfd1c85bb" (UID: "6d6f8d10-cbb7-415a-b1ff-1e5cfd1c85bb"). InnerVolumeSpecName "kube-api-access-8nl27". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:31:44 crc kubenswrapper[5120]: I0316 17:31:44.575871 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6d6f8d10-cbb7-415a-b1ff-1e5cfd1c85bb-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "6d6f8d10-cbb7-415a-b1ff-1e5cfd1c85bb" (UID: "6d6f8d10-cbb7-415a-b1ff-1e5cfd1c85bb"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:31:44 crc kubenswrapper[5120]: I0316 17:31:44.577202 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6d6f8d10-cbb7-415a-b1ff-1e5cfd1c85bb-edpm-no-nodes-custom-svc" (OuterVolumeSpecName: "edpm-no-nodes-custom-svc") pod "6d6f8d10-cbb7-415a-b1ff-1e5cfd1c85bb" (UID: "6d6f8d10-cbb7-415a-b1ff-1e5cfd1c85bb"). InnerVolumeSpecName "edpm-no-nodes-custom-svc". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:31:44 crc kubenswrapper[5120]: I0316 17:31:44.580000 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6d6f8d10-cbb7-415a-b1ff-1e5cfd1c85bb-config" (OuterVolumeSpecName: "config") pod "6d6f8d10-cbb7-415a-b1ff-1e5cfd1c85bb" (UID: "6d6f8d10-cbb7-415a-b1ff-1e5cfd1c85bb"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:31:44 crc kubenswrapper[5120]: I0316 17:31:44.643757 5120 reconciler_common.go:299] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/6d6f8d10-cbb7-415a-b1ff-1e5cfd1c85bb-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Mar 16 17:31:44 crc kubenswrapper[5120]: I0316 17:31:44.643806 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6d6f8d10-cbb7-415a-b1ff-1e5cfd1c85bb-config\") on node \"crc\" DevicePath \"\"" Mar 16 17:31:44 crc kubenswrapper[5120]: I0316 17:31:44.643821 5120 reconciler_common.go:299] "Volume detached for volume \"edpm-no-nodes-custom-svc\" (UniqueName: \"kubernetes.io/configmap/6d6f8d10-cbb7-415a-b1ff-1e5cfd1c85bb-edpm-no-nodes-custom-svc\") on node \"crc\" DevicePath \"\"" Mar 16 17:31:44 crc kubenswrapper[5120]: I0316 17:31:44.643833 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8nl27\" (UniqueName: \"kubernetes.io/projected/6d6f8d10-cbb7-415a-b1ff-1e5cfd1c85bb-kube-api-access-8nl27\") on node \"crc\" DevicePath \"\"" Mar 16 17:31:44 crc kubenswrapper[5120]: I0316 17:31:44.677130 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="95a59a04-a396-4181-9871-d78362dcde03" path="/var/lib/kubelet/pods/95a59a04-a396-4181-9871-d78362dcde03/volumes" Mar 16 17:31:45 crc kubenswrapper[5120]: I0316 17:31:45.059354 5120 generic.go:358] "Generic (PLEG): container finished" podID="6d6f8d10-cbb7-415a-b1ff-1e5cfd1c85bb" containerID="7e2daefeaac48e45072b988b9bfe0f3af3a7a1b75d694e62437e344278af3381" exitCode=0 Mar 16 17:31:45 crc kubenswrapper[5120]: I0316 17:31:45.059446 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-8c7594c8f-pkzzl" event={"ID":"6d6f8d10-cbb7-415a-b1ff-1e5cfd1c85bb","Type":"ContainerDied","Data":"7e2daefeaac48e45072b988b9bfe0f3af3a7a1b75d694e62437e344278af3381"} Mar 16 17:31:45 crc kubenswrapper[5120]: I0316 17:31:45.059486 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-8c7594c8f-pkzzl" event={"ID":"6d6f8d10-cbb7-415a-b1ff-1e5cfd1c85bb","Type":"ContainerDied","Data":"9d04e785924d1b344a6ceebc4eb4bc251328589521053149c71b215e6c000b79"} Mar 16 17:31:45 crc kubenswrapper[5120]: I0316 17:31:45.059492 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-8c7594c8f-pkzzl" Mar 16 17:31:45 crc kubenswrapper[5120]: I0316 17:31:45.059503 5120 scope.go:117] "RemoveContainer" containerID="7e2daefeaac48e45072b988b9bfe0f3af3a7a1b75d694e62437e344278af3381" Mar 16 17:31:45 crc kubenswrapper[5120]: I0316 17:31:45.062248 5120 generic.go:358] "Generic (PLEG): container finished" podID="4e3ed8b8-84a4-46f7-92d9-c17afb7a9d62" containerID="c913888b7937bca198789dacdac738c331d79cb985f6b5caf0f69fd33c203e7a" exitCode=0 Mar 16 17:31:45 crc kubenswrapper[5120]: I0316 17:31:45.062447 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-gqxx5" event={"ID":"4e3ed8b8-84a4-46f7-92d9-c17afb7a9d62","Type":"ContainerDied","Data":"c913888b7937bca198789dacdac738c331d79cb985f6b5caf0f69fd33c203e7a"} Mar 16 17:31:45 crc kubenswrapper[5120]: I0316 17:31:45.084574 5120 scope.go:117] "RemoveContainer" containerID="c0786cd0da330932546b708310595f1dfbd1bc2b744e4f9cee654deaf280ee3e" Mar 16 17:31:45 crc kubenswrapper[5120]: I0316 17:31:45.106971 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-8c7594c8f-pkzzl"] Mar 16 17:31:45 crc kubenswrapper[5120]: I0316 17:31:45.107472 5120 scope.go:117] "RemoveContainer" containerID="7e2daefeaac48e45072b988b9bfe0f3af3a7a1b75d694e62437e344278af3381" Mar 16 17:31:45 crc kubenswrapper[5120]: E0316 17:31:45.107872 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e2daefeaac48e45072b988b9bfe0f3af3a7a1b75d694e62437e344278af3381\": container with ID starting with 7e2daefeaac48e45072b988b9bfe0f3af3a7a1b75d694e62437e344278af3381 not found: ID does not exist" containerID="7e2daefeaac48e45072b988b9bfe0f3af3a7a1b75d694e62437e344278af3381" Mar 16 17:31:45 crc kubenswrapper[5120]: I0316 17:31:45.107900 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e2daefeaac48e45072b988b9bfe0f3af3a7a1b75d694e62437e344278af3381"} err="failed to get container status \"7e2daefeaac48e45072b988b9bfe0f3af3a7a1b75d694e62437e344278af3381\": rpc error: code = NotFound desc = could not find container \"7e2daefeaac48e45072b988b9bfe0f3af3a7a1b75d694e62437e344278af3381\": container with ID starting with 7e2daefeaac48e45072b988b9bfe0f3af3a7a1b75d694e62437e344278af3381 not found: ID does not exist" Mar 16 17:31:45 crc kubenswrapper[5120]: I0316 17:31:45.107928 5120 scope.go:117] "RemoveContainer" containerID="c0786cd0da330932546b708310595f1dfbd1bc2b744e4f9cee654deaf280ee3e" Mar 16 17:31:45 crc kubenswrapper[5120]: E0316 17:31:45.108192 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c0786cd0da330932546b708310595f1dfbd1bc2b744e4f9cee654deaf280ee3e\": container with ID starting with c0786cd0da330932546b708310595f1dfbd1bc2b744e4f9cee654deaf280ee3e not found: ID does not exist" containerID="c0786cd0da330932546b708310595f1dfbd1bc2b744e4f9cee654deaf280ee3e" Mar 16 17:31:45 crc kubenswrapper[5120]: I0316 17:31:45.108211 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0786cd0da330932546b708310595f1dfbd1bc2b744e4f9cee654deaf280ee3e"} err="failed to get container status \"c0786cd0da330932546b708310595f1dfbd1bc2b744e4f9cee654deaf280ee3e\": rpc error: code = NotFound desc = could not find container \"c0786cd0da330932546b708310595f1dfbd1bc2b744e4f9cee654deaf280ee3e\": container with ID starting with c0786cd0da330932546b708310595f1dfbd1bc2b744e4f9cee654deaf280ee3e not found: ID does not exist" Mar 16 17:31:45 crc kubenswrapper[5120]: I0316 17:31:45.112233 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-8c7594c8f-pkzzl"] Mar 16 17:31:46 crc kubenswrapper[5120]: I0316 17:31:46.387281 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-gqxx5" Mar 16 17:31:46 crc kubenswrapper[5120]: I0316 17:31:46.481486 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/4e3ed8b8-84a4-46f7-92d9-c17afb7a9d62-crc-storage\") pod \"4e3ed8b8-84a4-46f7-92d9-c17afb7a9d62\" (UID: \"4e3ed8b8-84a4-46f7-92d9-c17afb7a9d62\") " Mar 16 17:31:46 crc kubenswrapper[5120]: I0316 17:31:46.482688 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mtqfw\" (UniqueName: \"kubernetes.io/projected/4e3ed8b8-84a4-46f7-92d9-c17afb7a9d62-kube-api-access-mtqfw\") pod \"4e3ed8b8-84a4-46f7-92d9-c17afb7a9d62\" (UID: \"4e3ed8b8-84a4-46f7-92d9-c17afb7a9d62\") " Mar 16 17:31:46 crc kubenswrapper[5120]: I0316 17:31:46.483822 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/4e3ed8b8-84a4-46f7-92d9-c17afb7a9d62-node-mnt\") pod \"4e3ed8b8-84a4-46f7-92d9-c17afb7a9d62\" (UID: \"4e3ed8b8-84a4-46f7-92d9-c17afb7a9d62\") " Mar 16 17:31:46 crc kubenswrapper[5120]: I0316 17:31:46.484176 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/4e3ed8b8-84a4-46f7-92d9-c17afb7a9d62-node-mnt" (OuterVolumeSpecName: "node-mnt") pod "4e3ed8b8-84a4-46f7-92d9-c17afb7a9d62" (UID: "4e3ed8b8-84a4-46f7-92d9-c17afb7a9d62"). InnerVolumeSpecName "node-mnt". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 17:31:46 crc kubenswrapper[5120]: I0316 17:31:46.484966 5120 reconciler_common.go:299] "Volume detached for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/4e3ed8b8-84a4-46f7-92d9-c17afb7a9d62-node-mnt\") on node \"crc\" DevicePath \"\"" Mar 16 17:31:46 crc kubenswrapper[5120]: I0316 17:31:46.487859 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e3ed8b8-84a4-46f7-92d9-c17afb7a9d62-kube-api-access-mtqfw" (OuterVolumeSpecName: "kube-api-access-mtqfw") pod "4e3ed8b8-84a4-46f7-92d9-c17afb7a9d62" (UID: "4e3ed8b8-84a4-46f7-92d9-c17afb7a9d62"). InnerVolumeSpecName "kube-api-access-mtqfw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:31:46 crc kubenswrapper[5120]: I0316 17:31:46.505326 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4e3ed8b8-84a4-46f7-92d9-c17afb7a9d62-crc-storage" (OuterVolumeSpecName: "crc-storage") pod "4e3ed8b8-84a4-46f7-92d9-c17afb7a9d62" (UID: "4e3ed8b8-84a4-46f7-92d9-c17afb7a9d62"). InnerVolumeSpecName "crc-storage". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:31:46 crc kubenswrapper[5120]: I0316 17:31:46.587204 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mtqfw\" (UniqueName: \"kubernetes.io/projected/4e3ed8b8-84a4-46f7-92d9-c17afb7a9d62-kube-api-access-mtqfw\") on node \"crc\" DevicePath \"\"" Mar 16 17:31:46 crc kubenswrapper[5120]: I0316 17:31:46.587241 5120 reconciler_common.go:299] "Volume detached for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/4e3ed8b8-84a4-46f7-92d9-c17afb7a9d62-crc-storage\") on node \"crc\" DevicePath \"\"" Mar 16 17:31:46 crc kubenswrapper[5120]: I0316 17:31:46.675493 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6d6f8d10-cbb7-415a-b1ff-1e5cfd1c85bb" path="/var/lib/kubelet/pods/6d6f8d10-cbb7-415a-b1ff-1e5cfd1c85bb/volumes" Mar 16 17:31:47 crc kubenswrapper[5120]: I0316 17:31:47.085137 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-gqxx5" Mar 16 17:31:47 crc kubenswrapper[5120]: I0316 17:31:47.085199 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-gqxx5" event={"ID":"4e3ed8b8-84a4-46f7-92d9-c17afb7a9d62","Type":"ContainerDied","Data":"0afae4561f4eecb7dcf7659696182206290ffccb467b56c79c4e46053b6c9ca1"} Mar 16 17:31:47 crc kubenswrapper[5120]: I0316 17:31:47.085542 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0afae4561f4eecb7dcf7659696182206290ffccb467b56c79c4e46053b6c9ca1" Mar 16 17:31:47 crc kubenswrapper[5120]: I0316 17:31:47.571441 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-v822j_ac55471d-4e42-475f-a082-50f611571482/kube-multus/0.log" Mar 16 17:31:47 crc kubenswrapper[5120]: I0316 17:31:47.576300 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-crc_9f0bc7fcb0822a2c13eb2d22cd8c0641/kube-controller-manager/0.log" Mar 16 17:31:47 crc kubenswrapper[5120]: I0316 17:31:47.890174 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-v822j_ac55471d-4e42-475f-a082-50f611571482/kube-multus/0.log" Mar 16 17:31:47 crc kubenswrapper[5120]: I0316 17:31:47.900056 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-crc_9f0bc7fcb0822a2c13eb2d22cd8c0641/kube-controller-manager/0.log" Mar 16 17:31:49 crc kubenswrapper[5120]: I0316 17:31:49.682125 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["crc-storage/crc-storage-crc-gqxx5"] Mar 16 17:31:49 crc kubenswrapper[5120]: I0316 17:31:49.688715 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["crc-storage/crc-storage-crc-gqxx5"] Mar 16 17:31:49 crc kubenswrapper[5120]: I0316 17:31:49.811456 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["crc-storage/crc-storage-crc-4hjk4"] Mar 16 17:31:49 crc kubenswrapper[5120]: I0316 17:31:49.812302 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d6f8d10-cbb7-415a-b1ff-1e5cfd1c85bb" containerName="init" Mar 16 17:31:49 crc kubenswrapper[5120]: I0316 17:31:49.812321 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d6f8d10-cbb7-415a-b1ff-1e5cfd1c85bb" containerName="init" Mar 16 17:31:49 crc kubenswrapper[5120]: I0316 17:31:49.812340 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e3ed8b8-84a4-46f7-92d9-c17afb7a9d62" containerName="storage" Mar 16 17:31:49 crc kubenswrapper[5120]: I0316 17:31:49.812348 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e3ed8b8-84a4-46f7-92d9-c17afb7a9d62" containerName="storage" Mar 16 17:31:49 crc kubenswrapper[5120]: I0316 17:31:49.812380 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d6f8d10-cbb7-415a-b1ff-1e5cfd1c85bb" containerName="dnsmasq-dns" Mar 16 17:31:49 crc kubenswrapper[5120]: I0316 17:31:49.812386 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d6f8d10-cbb7-415a-b1ff-1e5cfd1c85bb" containerName="dnsmasq-dns" Mar 16 17:31:49 crc kubenswrapper[5120]: I0316 17:31:49.812534 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="6d6f8d10-cbb7-415a-b1ff-1e5cfd1c85bb" containerName="dnsmasq-dns" Mar 16 17:31:49 crc kubenswrapper[5120]: I0316 17:31:49.812556 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="4e3ed8b8-84a4-46f7-92d9-c17afb7a9d62" containerName="storage" Mar 16 17:31:49 crc kubenswrapper[5120]: I0316 17:31:49.823470 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-4hjk4" Mar 16 17:31:49 crc kubenswrapper[5120]: I0316 17:31:49.826853 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"kube-root-ca.crt\"" Mar 16 17:31:49 crc kubenswrapper[5120]: I0316 17:31:49.827215 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"crc-storage\"" Mar 16 17:31:49 crc kubenswrapper[5120]: I0316 17:31:49.827413 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"openshift-service-ca.crt\"" Mar 16 17:31:49 crc kubenswrapper[5120]: I0316 17:31:49.828128 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"crc-storage\"/\"crc-storage-dockercfg-s2tht\"" Mar 16 17:31:49 crc kubenswrapper[5120]: I0316 17:31:49.829965 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-4hjk4"] Mar 16 17:31:49 crc kubenswrapper[5120]: I0316 17:31:49.957389 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/11f8fc5c-c945-4b16-b4cf-623414f636c9-crc-storage\") pod \"crc-storage-crc-4hjk4\" (UID: \"11f8fc5c-c945-4b16-b4cf-623414f636c9\") " pod="crc-storage/crc-storage-crc-4hjk4" Mar 16 17:31:49 crc kubenswrapper[5120]: I0316 17:31:49.957836 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r22hp\" (UniqueName: \"kubernetes.io/projected/11f8fc5c-c945-4b16-b4cf-623414f636c9-kube-api-access-r22hp\") pod \"crc-storage-crc-4hjk4\" (UID: \"11f8fc5c-c945-4b16-b4cf-623414f636c9\") " pod="crc-storage/crc-storage-crc-4hjk4" Mar 16 17:31:49 crc kubenswrapper[5120]: I0316 17:31:49.957947 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/11f8fc5c-c945-4b16-b4cf-623414f636c9-node-mnt\") pod \"crc-storage-crc-4hjk4\" (UID: \"11f8fc5c-c945-4b16-b4cf-623414f636c9\") " pod="crc-storage/crc-storage-crc-4hjk4" Mar 16 17:31:50 crc kubenswrapper[5120]: I0316 17:31:50.061728 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/11f8fc5c-c945-4b16-b4cf-623414f636c9-crc-storage\") pod \"crc-storage-crc-4hjk4\" (UID: \"11f8fc5c-c945-4b16-b4cf-623414f636c9\") " pod="crc-storage/crc-storage-crc-4hjk4" Mar 16 17:31:50 crc kubenswrapper[5120]: I0316 17:31:50.062196 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r22hp\" (UniqueName: \"kubernetes.io/projected/11f8fc5c-c945-4b16-b4cf-623414f636c9-kube-api-access-r22hp\") pod \"crc-storage-crc-4hjk4\" (UID: \"11f8fc5c-c945-4b16-b4cf-623414f636c9\") " pod="crc-storage/crc-storage-crc-4hjk4" Mar 16 17:31:50 crc kubenswrapper[5120]: I0316 17:31:50.062313 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/11f8fc5c-c945-4b16-b4cf-623414f636c9-node-mnt\") pod \"crc-storage-crc-4hjk4\" (UID: \"11f8fc5c-c945-4b16-b4cf-623414f636c9\") " pod="crc-storage/crc-storage-crc-4hjk4" Mar 16 17:31:50 crc kubenswrapper[5120]: I0316 17:31:50.062652 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/11f8fc5c-c945-4b16-b4cf-623414f636c9-crc-storage\") pod \"crc-storage-crc-4hjk4\" (UID: \"11f8fc5c-c945-4b16-b4cf-623414f636c9\") " pod="crc-storage/crc-storage-crc-4hjk4" Mar 16 17:31:50 crc kubenswrapper[5120]: I0316 17:31:50.062729 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/11f8fc5c-c945-4b16-b4cf-623414f636c9-node-mnt\") pod \"crc-storage-crc-4hjk4\" (UID: \"11f8fc5c-c945-4b16-b4cf-623414f636c9\") " pod="crc-storage/crc-storage-crc-4hjk4" Mar 16 17:31:50 crc kubenswrapper[5120]: I0316 17:31:50.092602 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r22hp\" (UniqueName: \"kubernetes.io/projected/11f8fc5c-c945-4b16-b4cf-623414f636c9-kube-api-access-r22hp\") pod \"crc-storage-crc-4hjk4\" (UID: \"11f8fc5c-c945-4b16-b4cf-623414f636c9\") " pod="crc-storage/crc-storage-crc-4hjk4" Mar 16 17:31:50 crc kubenswrapper[5120]: I0316 17:31:50.142339 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-4hjk4" Mar 16 17:31:50 crc kubenswrapper[5120]: I0316 17:31:50.569859 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-4hjk4"] Mar 16 17:31:50 crc kubenswrapper[5120]: I0316 17:31:50.663905 5120 scope.go:117] "RemoveContainer" containerID="df0a87b047c8208d5fc21057efed33321f6cab49c4cf053702d222dc12979450" Mar 16 17:31:50 crc kubenswrapper[5120]: E0316 17:31:50.664477 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 17:31:50 crc kubenswrapper[5120]: I0316 17:31:50.674107 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4e3ed8b8-84a4-46f7-92d9-c17afb7a9d62" path="/var/lib/kubelet/pods/4e3ed8b8-84a4-46f7-92d9-c17afb7a9d62/volumes" Mar 16 17:31:51 crc kubenswrapper[5120]: I0316 17:31:51.123410 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-4hjk4" event={"ID":"11f8fc5c-c945-4b16-b4cf-623414f636c9","Type":"ContainerStarted","Data":"d6225a83786fbb383f2505707c5100a5c3cdf4009e6e29c81eb516101889ae5b"} Mar 16 17:31:52 crc kubenswrapper[5120]: I0316 17:31:52.133088 5120 generic.go:358] "Generic (PLEG): container finished" podID="11f8fc5c-c945-4b16-b4cf-623414f636c9" containerID="a86db9777ef8ab95e5606a3fd9cbee7d93a28f86592156208c21f0675fe293c2" exitCode=0 Mar 16 17:31:52 crc kubenswrapper[5120]: I0316 17:31:52.133152 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-4hjk4" event={"ID":"11f8fc5c-c945-4b16-b4cf-623414f636c9","Type":"ContainerDied","Data":"a86db9777ef8ab95e5606a3fd9cbee7d93a28f86592156208c21f0675fe293c2"} Mar 16 17:31:53 crc kubenswrapper[5120]: I0316 17:31:53.396725 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-4hjk4" Mar 16 17:31:53 crc kubenswrapper[5120]: I0316 17:31:53.438918 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/11f8fc5c-c945-4b16-b4cf-623414f636c9-node-mnt\") pod \"11f8fc5c-c945-4b16-b4cf-623414f636c9\" (UID: \"11f8fc5c-c945-4b16-b4cf-623414f636c9\") " Mar 16 17:31:53 crc kubenswrapper[5120]: I0316 17:31:53.439020 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/11f8fc5c-c945-4b16-b4cf-623414f636c9-crc-storage\") pod \"11f8fc5c-c945-4b16-b4cf-623414f636c9\" (UID: \"11f8fc5c-c945-4b16-b4cf-623414f636c9\") " Mar 16 17:31:53 crc kubenswrapper[5120]: I0316 17:31:53.439051 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/11f8fc5c-c945-4b16-b4cf-623414f636c9-node-mnt" (OuterVolumeSpecName: "node-mnt") pod "11f8fc5c-c945-4b16-b4cf-623414f636c9" (UID: "11f8fc5c-c945-4b16-b4cf-623414f636c9"). InnerVolumeSpecName "node-mnt". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 17:31:53 crc kubenswrapper[5120]: I0316 17:31:53.439444 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r22hp\" (UniqueName: \"kubernetes.io/projected/11f8fc5c-c945-4b16-b4cf-623414f636c9-kube-api-access-r22hp\") pod \"11f8fc5c-c945-4b16-b4cf-623414f636c9\" (UID: \"11f8fc5c-c945-4b16-b4cf-623414f636c9\") " Mar 16 17:31:53 crc kubenswrapper[5120]: I0316 17:31:53.440158 5120 reconciler_common.go:299] "Volume detached for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/11f8fc5c-c945-4b16-b4cf-623414f636c9-node-mnt\") on node \"crc\" DevicePath \"\"" Mar 16 17:31:53 crc kubenswrapper[5120]: I0316 17:31:53.444459 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11f8fc5c-c945-4b16-b4cf-623414f636c9-kube-api-access-r22hp" (OuterVolumeSpecName: "kube-api-access-r22hp") pod "11f8fc5c-c945-4b16-b4cf-623414f636c9" (UID: "11f8fc5c-c945-4b16-b4cf-623414f636c9"). InnerVolumeSpecName "kube-api-access-r22hp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:31:53 crc kubenswrapper[5120]: I0316 17:31:53.460114 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11f8fc5c-c945-4b16-b4cf-623414f636c9-crc-storage" (OuterVolumeSpecName: "crc-storage") pod "11f8fc5c-c945-4b16-b4cf-623414f636c9" (UID: "11f8fc5c-c945-4b16-b4cf-623414f636c9"). InnerVolumeSpecName "crc-storage". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:31:53 crc kubenswrapper[5120]: I0316 17:31:53.542057 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r22hp\" (UniqueName: \"kubernetes.io/projected/11f8fc5c-c945-4b16-b4cf-623414f636c9-kube-api-access-r22hp\") on node \"crc\" DevicePath \"\"" Mar 16 17:31:53 crc kubenswrapper[5120]: I0316 17:31:53.542096 5120 reconciler_common.go:299] "Volume detached for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/11f8fc5c-c945-4b16-b4cf-623414f636c9-crc-storage\") on node \"crc\" DevicePath \"\"" Mar 16 17:31:54 crc kubenswrapper[5120]: I0316 17:31:54.151194 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-4hjk4" event={"ID":"11f8fc5c-c945-4b16-b4cf-623414f636c9","Type":"ContainerDied","Data":"d6225a83786fbb383f2505707c5100a5c3cdf4009e6e29c81eb516101889ae5b"} Mar 16 17:31:54 crc kubenswrapper[5120]: I0316 17:31:54.151534 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d6225a83786fbb383f2505707c5100a5c3cdf4009e6e29c81eb516101889ae5b" Mar 16 17:31:54 crc kubenswrapper[5120]: I0316 17:31:54.151233 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-4hjk4" Mar 16 17:31:56 crc kubenswrapper[5120]: I0316 17:31:56.391910 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-8c5974765-rmj8x"] Mar 16 17:31:56 crc kubenswrapper[5120]: I0316 17:31:56.393125 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11f8fc5c-c945-4b16-b4cf-623414f636c9" containerName="storage" Mar 16 17:31:56 crc kubenswrapper[5120]: I0316 17:31:56.393150 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="11f8fc5c-c945-4b16-b4cf-623414f636c9" containerName="storage" Mar 16 17:31:56 crc kubenswrapper[5120]: I0316 17:31:56.393429 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="11f8fc5c-c945-4b16-b4cf-623414f636c9" containerName="storage" Mar 16 17:31:56 crc kubenswrapper[5120]: I0316 17:31:56.400060 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-8c5974765-rmj8x" Mar 16 17:31:56 crc kubenswrapper[5120]: I0316 17:31:56.402410 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"edpm-compute-no-nodes\"" Mar 16 17:31:56 crc kubenswrapper[5120]: I0316 17:31:56.403490 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-8c5974765-rmj8x"] Mar 16 17:31:56 crc kubenswrapper[5120]: I0316 17:31:56.503015 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xn54\" (UniqueName: \"kubernetes.io/projected/61bf94c7-387e-4d45-8b1a-e29a14b476f0-kube-api-access-4xn54\") pod \"dnsmasq-dnsmasq-8c5974765-rmj8x\" (UID: \"61bf94c7-387e-4d45-8b1a-e29a14b476f0\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-8c5974765-rmj8x" Mar 16 17:31:56 crc kubenswrapper[5120]: I0316 17:31:56.503152 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/61bf94c7-387e-4d45-8b1a-e29a14b476f0-config\") pod \"dnsmasq-dnsmasq-8c5974765-rmj8x\" (UID: \"61bf94c7-387e-4d45-8b1a-e29a14b476f0\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-8c5974765-rmj8x" Mar 16 17:31:56 crc kubenswrapper[5120]: I0316 17:31:56.503281 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/configmap/61bf94c7-387e-4d45-8b1a-e29a14b476f0-edpm-compute-no-nodes\") pod \"dnsmasq-dnsmasq-8c5974765-rmj8x\" (UID: \"61bf94c7-387e-4d45-8b1a-e29a14b476f0\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-8c5974765-rmj8x" Mar 16 17:31:56 crc kubenswrapper[5120]: I0316 17:31:56.503528 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/61bf94c7-387e-4d45-8b1a-e29a14b476f0-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-8c5974765-rmj8x\" (UID: \"61bf94c7-387e-4d45-8b1a-e29a14b476f0\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-8c5974765-rmj8x" Mar 16 17:31:56 crc kubenswrapper[5120]: I0316 17:31:56.605311 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/configmap/61bf94c7-387e-4d45-8b1a-e29a14b476f0-edpm-compute-no-nodes\") pod \"dnsmasq-dnsmasq-8c5974765-rmj8x\" (UID: \"61bf94c7-387e-4d45-8b1a-e29a14b476f0\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-8c5974765-rmj8x" Mar 16 17:31:56 crc kubenswrapper[5120]: I0316 17:31:56.605449 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/61bf94c7-387e-4d45-8b1a-e29a14b476f0-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-8c5974765-rmj8x\" (UID: \"61bf94c7-387e-4d45-8b1a-e29a14b476f0\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-8c5974765-rmj8x" Mar 16 17:31:56 crc kubenswrapper[5120]: I0316 17:31:56.605848 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4xn54\" (UniqueName: \"kubernetes.io/projected/61bf94c7-387e-4d45-8b1a-e29a14b476f0-kube-api-access-4xn54\") pod \"dnsmasq-dnsmasq-8c5974765-rmj8x\" (UID: \"61bf94c7-387e-4d45-8b1a-e29a14b476f0\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-8c5974765-rmj8x" Mar 16 17:31:56 crc kubenswrapper[5120]: I0316 17:31:56.605890 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/61bf94c7-387e-4d45-8b1a-e29a14b476f0-config\") pod \"dnsmasq-dnsmasq-8c5974765-rmj8x\" (UID: \"61bf94c7-387e-4d45-8b1a-e29a14b476f0\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-8c5974765-rmj8x" Mar 16 17:31:56 crc kubenswrapper[5120]: I0316 17:31:56.606406 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/configmap/61bf94c7-387e-4d45-8b1a-e29a14b476f0-edpm-compute-no-nodes\") pod \"dnsmasq-dnsmasq-8c5974765-rmj8x\" (UID: \"61bf94c7-387e-4d45-8b1a-e29a14b476f0\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-8c5974765-rmj8x" Mar 16 17:31:56 crc kubenswrapper[5120]: I0316 17:31:56.606463 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/61bf94c7-387e-4d45-8b1a-e29a14b476f0-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-8c5974765-rmj8x\" (UID: \"61bf94c7-387e-4d45-8b1a-e29a14b476f0\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-8c5974765-rmj8x" Mar 16 17:31:56 crc kubenswrapper[5120]: I0316 17:31:56.606504 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/61bf94c7-387e-4d45-8b1a-e29a14b476f0-config\") pod \"dnsmasq-dnsmasq-8c5974765-rmj8x\" (UID: \"61bf94c7-387e-4d45-8b1a-e29a14b476f0\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-8c5974765-rmj8x" Mar 16 17:31:56 crc kubenswrapper[5120]: I0316 17:31:56.624810 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xn54\" (UniqueName: \"kubernetes.io/projected/61bf94c7-387e-4d45-8b1a-e29a14b476f0-kube-api-access-4xn54\") pod \"dnsmasq-dnsmasq-8c5974765-rmj8x\" (UID: \"61bf94c7-387e-4d45-8b1a-e29a14b476f0\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-8c5974765-rmj8x" Mar 16 17:31:56 crc kubenswrapper[5120]: I0316 17:31:56.718795 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-8c5974765-rmj8x" Mar 16 17:31:57 crc kubenswrapper[5120]: I0316 17:31:57.167290 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-8c5974765-rmj8x"] Mar 16 17:31:57 crc kubenswrapper[5120]: I0316 17:31:57.186618 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-8c5974765-rmj8x" event={"ID":"61bf94c7-387e-4d45-8b1a-e29a14b476f0","Type":"ContainerStarted","Data":"9d2c974a07960db34cff8446ad34381e56f9656638a4c574b92e3130de2a5f36"} Mar 16 17:31:58 crc kubenswrapper[5120]: I0316 17:31:58.197211 5120 generic.go:358] "Generic (PLEG): container finished" podID="61bf94c7-387e-4d45-8b1a-e29a14b476f0" containerID="a5f029bd928cc490ae2ada03dec6c76ce7ae082a398404ef6a5f46817a21499f" exitCode=0 Mar 16 17:31:58 crc kubenswrapper[5120]: I0316 17:31:58.197678 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-8c5974765-rmj8x" event={"ID":"61bf94c7-387e-4d45-8b1a-e29a14b476f0","Type":"ContainerDied","Data":"a5f029bd928cc490ae2ada03dec6c76ce7ae082a398404ef6a5f46817a21499f"} Mar 16 17:31:59 crc kubenswrapper[5120]: I0316 17:31:59.206695 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-8c5974765-rmj8x" event={"ID":"61bf94c7-387e-4d45-8b1a-e29a14b476f0","Type":"ContainerStarted","Data":"f98c97c898650b78de8ec0b27d977220887db87a28847113b799c001f32e3ddb"} Mar 16 17:31:59 crc kubenswrapper[5120]: I0316 17:31:59.207180 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-8c5974765-rmj8x" Mar 16 17:31:59 crc kubenswrapper[5120]: I0316 17:31:59.222645 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-8c5974765-rmj8x" podStartSLOduration=3.222621908 podStartE2EDuration="3.222621908s" podCreationTimestamp="2026-03-16 17:31:56 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:31:59.221919699 +0000 UTC m=+7221.375851356" watchObservedRunningTime="2026-03-16 17:31:59.222621908 +0000 UTC m=+7221.376553565" Mar 16 17:32:00 crc kubenswrapper[5120]: I0316 17:32:00.135922 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-infra/auto-csr-approver-29561372-wbnxc"] Mar 16 17:32:00 crc kubenswrapper[5120]: I0316 17:32:00.140505 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561372-wbnxc" Mar 16 17:32:00 crc kubenswrapper[5120]: I0316 17:32:00.142753 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-infra\"/\"csr-approver-sa-dockercfg-x2nsz\"" Mar 16 17:32:00 crc kubenswrapper[5120]: I0316 17:32:00.142818 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"openshift-service-ca.crt\"" Mar 16 17:32:00 crc kubenswrapper[5120]: I0316 17:32:00.142907 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"kube-root-ca.crt\"" Mar 16 17:32:00 crc kubenswrapper[5120]: I0316 17:32:00.145683 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561372-wbnxc"] Mar 16 17:32:00 crc kubenswrapper[5120]: I0316 17:32:00.286616 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6drm5\" (UniqueName: \"kubernetes.io/projected/9352fe13-a49c-48be-b8f1-80824864dfb0-kube-api-access-6drm5\") pod \"auto-csr-approver-29561372-wbnxc\" (UID: \"9352fe13-a49c-48be-b8f1-80824864dfb0\") " pod="openshift-infra/auto-csr-approver-29561372-wbnxc" Mar 16 17:32:00 crc kubenswrapper[5120]: I0316 17:32:00.388465 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6drm5\" (UniqueName: \"kubernetes.io/projected/9352fe13-a49c-48be-b8f1-80824864dfb0-kube-api-access-6drm5\") pod \"auto-csr-approver-29561372-wbnxc\" (UID: \"9352fe13-a49c-48be-b8f1-80824864dfb0\") " pod="openshift-infra/auto-csr-approver-29561372-wbnxc" Mar 16 17:32:00 crc kubenswrapper[5120]: I0316 17:32:00.411067 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6drm5\" (UniqueName: \"kubernetes.io/projected/9352fe13-a49c-48be-b8f1-80824864dfb0-kube-api-access-6drm5\") pod \"auto-csr-approver-29561372-wbnxc\" (UID: \"9352fe13-a49c-48be-b8f1-80824864dfb0\") " pod="openshift-infra/auto-csr-approver-29561372-wbnxc" Mar 16 17:32:00 crc kubenswrapper[5120]: I0316 17:32:00.473632 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561372-wbnxc" Mar 16 17:32:00 crc kubenswrapper[5120]: I0316 17:32:00.909938 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561372-wbnxc"] Mar 16 17:32:01 crc kubenswrapper[5120]: I0316 17:32:01.225676 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561372-wbnxc" event={"ID":"9352fe13-a49c-48be-b8f1-80824864dfb0","Type":"ContainerStarted","Data":"67ef00ecf3c25923762d0f03e478da3b19675535c485509e400acea472270dca"} Mar 16 17:32:01 crc kubenswrapper[5120]: I0316 17:32:01.664402 5120 scope.go:117] "RemoveContainer" containerID="df0a87b047c8208d5fc21057efed33321f6cab49c4cf053702d222dc12979450" Mar 16 17:32:01 crc kubenswrapper[5120]: E0316 17:32:01.665071 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 17:32:03 crc kubenswrapper[5120]: I0316 17:32:03.245285 5120 generic.go:358] "Generic (PLEG): container finished" podID="9352fe13-a49c-48be-b8f1-80824864dfb0" containerID="3a2ba2e1046b323e2953d9442e3bfa15b30bb9787a4381df836219666d7b31ba" exitCode=0 Mar 16 17:32:03 crc kubenswrapper[5120]: I0316 17:32:03.245373 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561372-wbnxc" event={"ID":"9352fe13-a49c-48be-b8f1-80824864dfb0","Type":"ContainerDied","Data":"3a2ba2e1046b323e2953d9442e3bfa15b30bb9787a4381df836219666d7b31ba"} Mar 16 17:32:04 crc kubenswrapper[5120]: I0316 17:32:04.556466 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561372-wbnxc" Mar 16 17:32:04 crc kubenswrapper[5120]: I0316 17:32:04.675406 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6drm5\" (UniqueName: \"kubernetes.io/projected/9352fe13-a49c-48be-b8f1-80824864dfb0-kube-api-access-6drm5\") pod \"9352fe13-a49c-48be-b8f1-80824864dfb0\" (UID: \"9352fe13-a49c-48be-b8f1-80824864dfb0\") " Mar 16 17:32:04 crc kubenswrapper[5120]: I0316 17:32:04.681028 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9352fe13-a49c-48be-b8f1-80824864dfb0-kube-api-access-6drm5" (OuterVolumeSpecName: "kube-api-access-6drm5") pod "9352fe13-a49c-48be-b8f1-80824864dfb0" (UID: "9352fe13-a49c-48be-b8f1-80824864dfb0"). InnerVolumeSpecName "kube-api-access-6drm5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:32:04 crc kubenswrapper[5120]: I0316 17:32:04.778957 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6drm5\" (UniqueName: \"kubernetes.io/projected/9352fe13-a49c-48be-b8f1-80824864dfb0-kube-api-access-6drm5\") on node \"crc\" DevicePath \"\"" Mar 16 17:32:05 crc kubenswrapper[5120]: I0316 17:32:05.215980 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-8c5974765-rmj8x" Mar 16 17:32:05 crc kubenswrapper[5120]: I0316 17:32:05.271870 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561372-wbnxc" event={"ID":"9352fe13-a49c-48be-b8f1-80824864dfb0","Type":"ContainerDied","Data":"67ef00ecf3c25923762d0f03e478da3b19675535c485509e400acea472270dca"} Mar 16 17:32:05 crc kubenswrapper[5120]: I0316 17:32:05.271914 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="67ef00ecf3c25923762d0f03e478da3b19675535c485509e400acea472270dca" Mar 16 17:32:05 crc kubenswrapper[5120]: I0316 17:32:05.271991 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561372-wbnxc" Mar 16 17:32:05 crc kubenswrapper[5120]: I0316 17:32:05.280485 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-555qn"] Mar 16 17:32:05 crc kubenswrapper[5120]: I0316 17:32:05.280797 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-555qn" podUID="1c4d5375-dde1-49f9-b29e-6445c3f7957c" containerName="dnsmasq-dns" containerID="cri-o://fd78b069ad4a7e78117da248c4b31e385283370e87f4e92d9b2beb60e772753c" gracePeriod=10 Mar 16 17:32:05 crc kubenswrapper[5120]: I0316 17:32:05.614951 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-infra/auto-csr-approver-29561366-vtccj"] Mar 16 17:32:05 crc kubenswrapper[5120]: I0316 17:32:05.624937 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-infra/auto-csr-approver-29561366-vtccj"] Mar 16 17:32:05 crc kubenswrapper[5120]: I0316 17:32:05.715092 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-555qn" Mar 16 17:32:05 crc kubenswrapper[5120]: I0316 17:32:05.808609 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7vs2d\" (UniqueName: \"kubernetes.io/projected/1c4d5375-dde1-49f9-b29e-6445c3f7957c-kube-api-access-7vs2d\") pod \"1c4d5375-dde1-49f9-b29e-6445c3f7957c\" (UID: \"1c4d5375-dde1-49f9-b29e-6445c3f7957c\") " Mar 16 17:32:05 crc kubenswrapper[5120]: I0316 17:32:05.809723 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/1c4d5375-dde1-49f9-b29e-6445c3f7957c-dnsmasq-svc\") pod \"1c4d5375-dde1-49f9-b29e-6445c3f7957c\" (UID: \"1c4d5375-dde1-49f9-b29e-6445c3f7957c\") " Mar 16 17:32:05 crc kubenswrapper[5120]: I0316 17:32:05.809866 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1c4d5375-dde1-49f9-b29e-6445c3f7957c-config\") pod \"1c4d5375-dde1-49f9-b29e-6445c3f7957c\" (UID: \"1c4d5375-dde1-49f9-b29e-6445c3f7957c\") " Mar 16 17:32:05 crc kubenswrapper[5120]: I0316 17:32:05.813461 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c4d5375-dde1-49f9-b29e-6445c3f7957c-kube-api-access-7vs2d" (OuterVolumeSpecName: "kube-api-access-7vs2d") pod "1c4d5375-dde1-49f9-b29e-6445c3f7957c" (UID: "1c4d5375-dde1-49f9-b29e-6445c3f7957c"). InnerVolumeSpecName "kube-api-access-7vs2d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:32:05 crc kubenswrapper[5120]: I0316 17:32:05.844353 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c4d5375-dde1-49f9-b29e-6445c3f7957c-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "1c4d5375-dde1-49f9-b29e-6445c3f7957c" (UID: "1c4d5375-dde1-49f9-b29e-6445c3f7957c"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:32:05 crc kubenswrapper[5120]: I0316 17:32:05.855968 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c4d5375-dde1-49f9-b29e-6445c3f7957c-config" (OuterVolumeSpecName: "config") pod "1c4d5375-dde1-49f9-b29e-6445c3f7957c" (UID: "1c4d5375-dde1-49f9-b29e-6445c3f7957c"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:32:05 crc kubenswrapper[5120]: I0316 17:32:05.913105 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7vs2d\" (UniqueName: \"kubernetes.io/projected/1c4d5375-dde1-49f9-b29e-6445c3f7957c-kube-api-access-7vs2d\") on node \"crc\" DevicePath \"\"" Mar 16 17:32:05 crc kubenswrapper[5120]: I0316 17:32:05.913136 5120 reconciler_common.go:299] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/1c4d5375-dde1-49f9-b29e-6445c3f7957c-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Mar 16 17:32:05 crc kubenswrapper[5120]: I0316 17:32:05.913146 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1c4d5375-dde1-49f9-b29e-6445c3f7957c-config\") on node \"crc\" DevicePath \"\"" Mar 16 17:32:06 crc kubenswrapper[5120]: I0316 17:32:06.283443 5120 generic.go:358] "Generic (PLEG): container finished" podID="1c4d5375-dde1-49f9-b29e-6445c3f7957c" containerID="fd78b069ad4a7e78117da248c4b31e385283370e87f4e92d9b2beb60e772753c" exitCode=0 Mar 16 17:32:06 crc kubenswrapper[5120]: I0316 17:32:06.283495 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-555qn" event={"ID":"1c4d5375-dde1-49f9-b29e-6445c3f7957c","Type":"ContainerDied","Data":"fd78b069ad4a7e78117da248c4b31e385283370e87f4e92d9b2beb60e772753c"} Mar 16 17:32:06 crc kubenswrapper[5120]: I0316 17:32:06.283535 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-555qn" Mar 16 17:32:06 crc kubenswrapper[5120]: I0316 17:32:06.283573 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-555qn" event={"ID":"1c4d5375-dde1-49f9-b29e-6445c3f7957c","Type":"ContainerDied","Data":"3ef71fe4bfed1f82471548e0ad1ab67761893f553f6eb3277ea7480bb86e7fee"} Mar 16 17:32:06 crc kubenswrapper[5120]: I0316 17:32:06.283622 5120 scope.go:117] "RemoveContainer" containerID="fd78b069ad4a7e78117da248c4b31e385283370e87f4e92d9b2beb60e772753c" Mar 16 17:32:06 crc kubenswrapper[5120]: I0316 17:32:06.307507 5120 scope.go:117] "RemoveContainer" containerID="493f986f9c0c14ce154f84f7fbf7ff0dc07bd71e745ce8574c0b4a03ec5bee8b" Mar 16 17:32:06 crc kubenswrapper[5120]: I0316 17:32:06.322195 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-555qn"] Mar 16 17:32:06 crc kubenswrapper[5120]: I0316 17:32:06.329958 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-555qn"] Mar 16 17:32:06 crc kubenswrapper[5120]: I0316 17:32:06.338523 5120 scope.go:117] "RemoveContainer" containerID="fd78b069ad4a7e78117da248c4b31e385283370e87f4e92d9b2beb60e772753c" Mar 16 17:32:06 crc kubenswrapper[5120]: E0316 17:32:06.339006 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fd78b069ad4a7e78117da248c4b31e385283370e87f4e92d9b2beb60e772753c\": container with ID starting with fd78b069ad4a7e78117da248c4b31e385283370e87f4e92d9b2beb60e772753c not found: ID does not exist" containerID="fd78b069ad4a7e78117da248c4b31e385283370e87f4e92d9b2beb60e772753c" Mar 16 17:32:06 crc kubenswrapper[5120]: I0316 17:32:06.339041 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd78b069ad4a7e78117da248c4b31e385283370e87f4e92d9b2beb60e772753c"} err="failed to get container status \"fd78b069ad4a7e78117da248c4b31e385283370e87f4e92d9b2beb60e772753c\": rpc error: code = NotFound desc = could not find container \"fd78b069ad4a7e78117da248c4b31e385283370e87f4e92d9b2beb60e772753c\": container with ID starting with fd78b069ad4a7e78117da248c4b31e385283370e87f4e92d9b2beb60e772753c not found: ID does not exist" Mar 16 17:32:06 crc kubenswrapper[5120]: I0316 17:32:06.339064 5120 scope.go:117] "RemoveContainer" containerID="493f986f9c0c14ce154f84f7fbf7ff0dc07bd71e745ce8574c0b4a03ec5bee8b" Mar 16 17:32:06 crc kubenswrapper[5120]: E0316 17:32:06.339403 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"493f986f9c0c14ce154f84f7fbf7ff0dc07bd71e745ce8574c0b4a03ec5bee8b\": container with ID starting with 493f986f9c0c14ce154f84f7fbf7ff0dc07bd71e745ce8574c0b4a03ec5bee8b not found: ID does not exist" containerID="493f986f9c0c14ce154f84f7fbf7ff0dc07bd71e745ce8574c0b4a03ec5bee8b" Mar 16 17:32:06 crc kubenswrapper[5120]: I0316 17:32:06.339426 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"493f986f9c0c14ce154f84f7fbf7ff0dc07bd71e745ce8574c0b4a03ec5bee8b"} err="failed to get container status \"493f986f9c0c14ce154f84f7fbf7ff0dc07bd71e745ce8574c0b4a03ec5bee8b\": rpc error: code = NotFound desc = could not find container \"493f986f9c0c14ce154f84f7fbf7ff0dc07bd71e745ce8574c0b4a03ec5bee8b\": container with ID starting with 493f986f9c0c14ce154f84f7fbf7ff0dc07bd71e745ce8574c0b4a03ec5bee8b not found: ID does not exist" Mar 16 17:32:06 crc kubenswrapper[5120]: I0316 17:32:06.671873 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1c4d5375-dde1-49f9-b29e-6445c3f7957c" path="/var/lib/kubelet/pods/1c4d5375-dde1-49f9-b29e-6445c3f7957c/volumes" Mar 16 17:32:06 crc kubenswrapper[5120]: I0316 17:32:06.672405 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="60bb955b-b31e-4fa4-9225-1ac98eccc95d" path="/var/lib/kubelet/pods/60bb955b-b31e-4fa4-9225-1ac98eccc95d/volumes" Mar 16 17:32:07 crc kubenswrapper[5120]: E0316 17:32:07.734422 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1306194 actualBytes=10240 Mar 16 17:32:11 crc kubenswrapper[5120]: I0316 17:32:11.328739 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodeskvwjf"] Mar 16 17:32:11 crc kubenswrapper[5120]: I0316 17:32:11.330198 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9352fe13-a49c-48be-b8f1-80824864dfb0" containerName="oc" Mar 16 17:32:11 crc kubenswrapper[5120]: I0316 17:32:11.330216 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9352fe13-a49c-48be-b8f1-80824864dfb0" containerName="oc" Mar 16 17:32:11 crc kubenswrapper[5120]: I0316 17:32:11.330253 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c4d5375-dde1-49f9-b29e-6445c3f7957c" containerName="dnsmasq-dns" Mar 16 17:32:11 crc kubenswrapper[5120]: I0316 17:32:11.330260 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c4d5375-dde1-49f9-b29e-6445c3f7957c" containerName="dnsmasq-dns" Mar 16 17:32:11 crc kubenswrapper[5120]: I0316 17:32:11.330304 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c4d5375-dde1-49f9-b29e-6445c3f7957c" containerName="init" Mar 16 17:32:11 crc kubenswrapper[5120]: I0316 17:32:11.330310 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c4d5375-dde1-49f9-b29e-6445c3f7957c" containerName="init" Mar 16 17:32:11 crc kubenswrapper[5120]: I0316 17:32:11.330481 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1c4d5375-dde1-49f9-b29e-6445c3f7957c" containerName="dnsmasq-dns" Mar 16 17:32:11 crc kubenswrapper[5120]: I0316 17:32:11.330501 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="9352fe13-a49c-48be-b8f1-80824864dfb0" containerName="oc" Mar 16 17:32:11 crc kubenswrapper[5120]: I0316 17:32:11.345091 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodeskvwjf"] Mar 16 17:32:11 crc kubenswrapper[5120]: I0316 17:32:11.345431 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodeskvwjf" Mar 16 17:32:11 crc kubenswrapper[5120]: I0316 17:32:11.347696 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplane-ansible-ssh-private-key-secret\"" Mar 16 17:32:11 crc kubenswrapper[5120]: I0316 17:32:11.348103 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplanenodeset-edpm-compute-no-nodes\"" Mar 16 17:32:11 crc kubenswrapper[5120]: I0316 17:32:11.348492 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"combined-ca-bundle\"" Mar 16 17:32:11 crc kubenswrapper[5120]: I0316 17:32:11.348501 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"edpm-compute-no-nodes-dockercfg-p688g\"" Mar 16 17:32:11 crc kubenswrapper[5120]: I0316 17:32:11.349193 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-aee-default-env\"" Mar 16 17:32:11 crc kubenswrapper[5120]: I0316 17:32:11.431362 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/4b80edf6-6392-4ceb-8e2d-677189beaf3a-inventory\") pod \"failed-service-edpm-compute-no-nodes-edpm-compute-no-nodeskvwjf\" (UID: \"4b80edf6-6392-4ceb-8e2d-677189beaf3a\") " pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodeskvwjf" Mar 16 17:32:11 crc kubenswrapper[5120]: I0316 17:32:11.431457 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"failed-service-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4b80edf6-6392-4ceb-8e2d-677189beaf3a-failed-service-combined-ca-bundle\") pod \"failed-service-edpm-compute-no-nodes-edpm-compute-no-nodeskvwjf\" (UID: \"4b80edf6-6392-4ceb-8e2d-677189beaf3a\") " pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodeskvwjf" Mar 16 17:32:11 crc kubenswrapper[5120]: I0316 17:32:11.431517 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qt5j5\" (UniqueName: \"kubernetes.io/projected/4b80edf6-6392-4ceb-8e2d-677189beaf3a-kube-api-access-qt5j5\") pod \"failed-service-edpm-compute-no-nodes-edpm-compute-no-nodeskvwjf\" (UID: \"4b80edf6-6392-4ceb-8e2d-677189beaf3a\") " pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodeskvwjf" Mar 16 17:32:11 crc kubenswrapper[5120]: I0316 17:32:11.431587 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/4b80edf6-6392-4ceb-8e2d-677189beaf3a-ssh-key-edpm-compute-no-nodes\") pod \"failed-service-edpm-compute-no-nodes-edpm-compute-no-nodeskvwjf\" (UID: \"4b80edf6-6392-4ceb-8e2d-677189beaf3a\") " pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodeskvwjf" Mar 16 17:32:11 crc kubenswrapper[5120]: I0316 17:32:11.533982 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/4b80edf6-6392-4ceb-8e2d-677189beaf3a-inventory\") pod \"failed-service-edpm-compute-no-nodes-edpm-compute-no-nodeskvwjf\" (UID: \"4b80edf6-6392-4ceb-8e2d-677189beaf3a\") " pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodeskvwjf" Mar 16 17:32:11 crc kubenswrapper[5120]: I0316 17:32:11.534390 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"failed-service-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4b80edf6-6392-4ceb-8e2d-677189beaf3a-failed-service-combined-ca-bundle\") pod \"failed-service-edpm-compute-no-nodes-edpm-compute-no-nodeskvwjf\" (UID: \"4b80edf6-6392-4ceb-8e2d-677189beaf3a\") " pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodeskvwjf" Mar 16 17:32:11 crc kubenswrapper[5120]: I0316 17:32:11.534519 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qt5j5\" (UniqueName: \"kubernetes.io/projected/4b80edf6-6392-4ceb-8e2d-677189beaf3a-kube-api-access-qt5j5\") pod \"failed-service-edpm-compute-no-nodes-edpm-compute-no-nodeskvwjf\" (UID: \"4b80edf6-6392-4ceb-8e2d-677189beaf3a\") " pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodeskvwjf" Mar 16 17:32:11 crc kubenswrapper[5120]: I0316 17:32:11.534710 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/4b80edf6-6392-4ceb-8e2d-677189beaf3a-ssh-key-edpm-compute-no-nodes\") pod \"failed-service-edpm-compute-no-nodes-edpm-compute-no-nodeskvwjf\" (UID: \"4b80edf6-6392-4ceb-8e2d-677189beaf3a\") " pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodeskvwjf" Mar 16 17:32:11 crc kubenswrapper[5120]: I0316 17:32:11.542610 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/4b80edf6-6392-4ceb-8e2d-677189beaf3a-inventory\") pod \"failed-service-edpm-compute-no-nodes-edpm-compute-no-nodeskvwjf\" (UID: \"4b80edf6-6392-4ceb-8e2d-677189beaf3a\") " pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodeskvwjf" Mar 16 17:32:11 crc kubenswrapper[5120]: I0316 17:32:11.543183 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/4b80edf6-6392-4ceb-8e2d-677189beaf3a-ssh-key-edpm-compute-no-nodes\") pod \"failed-service-edpm-compute-no-nodes-edpm-compute-no-nodeskvwjf\" (UID: \"4b80edf6-6392-4ceb-8e2d-677189beaf3a\") " pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodeskvwjf" Mar 16 17:32:11 crc kubenswrapper[5120]: I0316 17:32:11.543245 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"failed-service-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4b80edf6-6392-4ceb-8e2d-677189beaf3a-failed-service-combined-ca-bundle\") pod \"failed-service-edpm-compute-no-nodes-edpm-compute-no-nodeskvwjf\" (UID: \"4b80edf6-6392-4ceb-8e2d-677189beaf3a\") " pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodeskvwjf" Mar 16 17:32:11 crc kubenswrapper[5120]: I0316 17:32:11.553009 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qt5j5\" (UniqueName: \"kubernetes.io/projected/4b80edf6-6392-4ceb-8e2d-677189beaf3a-kube-api-access-qt5j5\") pod \"failed-service-edpm-compute-no-nodes-edpm-compute-no-nodeskvwjf\" (UID: \"4b80edf6-6392-4ceb-8e2d-677189beaf3a\") " pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodeskvwjf" Mar 16 17:32:11 crc kubenswrapper[5120]: I0316 17:32:11.668998 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodeskvwjf" Mar 16 17:32:12 crc kubenswrapper[5120]: I0316 17:32:12.165671 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodeskvwjf"] Mar 16 17:32:12 crc kubenswrapper[5120]: I0316 17:32:12.348295 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodeskvwjf" event={"ID":"4b80edf6-6392-4ceb-8e2d-677189beaf3a","Type":"ContainerStarted","Data":"34c73a76bebe2d3d57414a83dfc6a5508ebb5650a7081c3deec48c18a04e8ea1"} Mar 16 17:32:12 crc kubenswrapper[5120]: I0316 17:32:12.663402 5120 scope.go:117] "RemoveContainer" containerID="df0a87b047c8208d5fc21057efed33321f6cab49c4cf053702d222dc12979450" Mar 16 17:32:12 crc kubenswrapper[5120]: E0316 17:32:12.663974 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 17:32:13 crc kubenswrapper[5120]: I0316 17:32:13.358705 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodeskvwjf" event={"ID":"4b80edf6-6392-4ceb-8e2d-677189beaf3a","Type":"ContainerStarted","Data":"4e26de85df0481ded1fef8cdbe39cbf810717b1b8a39ed615c9904b8547a19e3"} Mar 16 17:32:13 crc kubenswrapper[5120]: I0316 17:32:13.376544 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodeskvwjf" podStartSLOduration=1.450391137 podStartE2EDuration="2.376526171s" podCreationTimestamp="2026-03-16 17:32:11 +0000 UTC" firstStartedPulling="2026-03-16 17:32:12.169154944 +0000 UTC m=+7234.323086601" lastFinishedPulling="2026-03-16 17:32:13.095289978 +0000 UTC m=+7235.249221635" observedRunningTime="2026-03-16 17:32:13.373138109 +0000 UTC m=+7235.527069776" watchObservedRunningTime="2026-03-16 17:32:13.376526171 +0000 UTC m=+7235.530457828" Mar 16 17:32:15 crc kubenswrapper[5120]: I0316 17:32:15.377617 5120 generic.go:358] "Generic (PLEG): container finished" podID="4b80edf6-6392-4ceb-8e2d-677189beaf3a" containerID="4e26de85df0481ded1fef8cdbe39cbf810717b1b8a39ed615c9904b8547a19e3" exitCode=2 Mar 16 17:32:15 crc kubenswrapper[5120]: I0316 17:32:15.377687 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodeskvwjf" event={"ID":"4b80edf6-6392-4ceb-8e2d-677189beaf3a","Type":"ContainerDied","Data":"4e26de85df0481ded1fef8cdbe39cbf810717b1b8a39ed615c9904b8547a19e3"} Mar 16 17:32:16 crc kubenswrapper[5120]: I0316 17:32:16.640253 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodeskvwjf" Mar 16 17:32:16 crc kubenswrapper[5120]: I0316 17:32:16.747961 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/4b80edf6-6392-4ceb-8e2d-677189beaf3a-ssh-key-edpm-compute-no-nodes\") pod \"4b80edf6-6392-4ceb-8e2d-677189beaf3a\" (UID: \"4b80edf6-6392-4ceb-8e2d-677189beaf3a\") " Mar 16 17:32:16 crc kubenswrapper[5120]: I0316 17:32:16.748492 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/4b80edf6-6392-4ceb-8e2d-677189beaf3a-inventory\") pod \"4b80edf6-6392-4ceb-8e2d-677189beaf3a\" (UID: \"4b80edf6-6392-4ceb-8e2d-677189beaf3a\") " Mar 16 17:32:16 crc kubenswrapper[5120]: I0316 17:32:16.748584 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qt5j5\" (UniqueName: \"kubernetes.io/projected/4b80edf6-6392-4ceb-8e2d-677189beaf3a-kube-api-access-qt5j5\") pod \"4b80edf6-6392-4ceb-8e2d-677189beaf3a\" (UID: \"4b80edf6-6392-4ceb-8e2d-677189beaf3a\") " Mar 16 17:32:16 crc kubenswrapper[5120]: I0316 17:32:16.748619 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"failed-service-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4b80edf6-6392-4ceb-8e2d-677189beaf3a-failed-service-combined-ca-bundle\") pod \"4b80edf6-6392-4ceb-8e2d-677189beaf3a\" (UID: \"4b80edf6-6392-4ceb-8e2d-677189beaf3a\") " Mar 16 17:32:16 crc kubenswrapper[5120]: I0316 17:32:16.753609 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b80edf6-6392-4ceb-8e2d-677189beaf3a-failed-service-combined-ca-bundle" (OuterVolumeSpecName: "failed-service-combined-ca-bundle") pod "4b80edf6-6392-4ceb-8e2d-677189beaf3a" (UID: "4b80edf6-6392-4ceb-8e2d-677189beaf3a"). InnerVolumeSpecName "failed-service-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:32:16 crc kubenswrapper[5120]: I0316 17:32:16.753910 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b80edf6-6392-4ceb-8e2d-677189beaf3a-kube-api-access-qt5j5" (OuterVolumeSpecName: "kube-api-access-qt5j5") pod "4b80edf6-6392-4ceb-8e2d-677189beaf3a" (UID: "4b80edf6-6392-4ceb-8e2d-677189beaf3a"). InnerVolumeSpecName "kube-api-access-qt5j5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:32:16 crc kubenswrapper[5120]: I0316 17:32:16.781857 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b80edf6-6392-4ceb-8e2d-677189beaf3a-ssh-key-edpm-compute-no-nodes" (OuterVolumeSpecName: "ssh-key-edpm-compute-no-nodes") pod "4b80edf6-6392-4ceb-8e2d-677189beaf3a" (UID: "4b80edf6-6392-4ceb-8e2d-677189beaf3a"). InnerVolumeSpecName "ssh-key-edpm-compute-no-nodes". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:32:16 crc kubenswrapper[5120]: I0316 17:32:16.785160 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b80edf6-6392-4ceb-8e2d-677189beaf3a-inventory" (OuterVolumeSpecName: "inventory") pod "4b80edf6-6392-4ceb-8e2d-677189beaf3a" (UID: "4b80edf6-6392-4ceb-8e2d-677189beaf3a"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:32:16 crc kubenswrapper[5120]: I0316 17:32:16.852235 5120 reconciler_common.go:299] "Volume detached for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/4b80edf6-6392-4ceb-8e2d-677189beaf3a-ssh-key-edpm-compute-no-nodes\") on node \"crc\" DevicePath \"\"" Mar 16 17:32:16 crc kubenswrapper[5120]: I0316 17:32:16.852268 5120 reconciler_common.go:299] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/4b80edf6-6392-4ceb-8e2d-677189beaf3a-inventory\") on node \"crc\" DevicePath \"\"" Mar 16 17:32:16 crc kubenswrapper[5120]: I0316 17:32:16.852282 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qt5j5\" (UniqueName: \"kubernetes.io/projected/4b80edf6-6392-4ceb-8e2d-677189beaf3a-kube-api-access-qt5j5\") on node \"crc\" DevicePath \"\"" Mar 16 17:32:16 crc kubenswrapper[5120]: I0316 17:32:16.852292 5120 reconciler_common.go:299] "Volume detached for volume \"failed-service-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4b80edf6-6392-4ceb-8e2d-677189beaf3a-failed-service-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:32:17 crc kubenswrapper[5120]: I0316 17:32:17.398616 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodeskvwjf" Mar 16 17:32:17 crc kubenswrapper[5120]: I0316 17:32:17.398650 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodeskvwjf" event={"ID":"4b80edf6-6392-4ceb-8e2d-677189beaf3a","Type":"ContainerDied","Data":"34c73a76bebe2d3d57414a83dfc6a5508ebb5650a7081c3deec48c18a04e8ea1"} Mar 16 17:32:17 crc kubenswrapper[5120]: I0316 17:32:17.398710 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="34c73a76bebe2d3d57414a83dfc6a5508ebb5650a7081c3deec48c18a04e8ea1" Mar 16 17:32:23 crc kubenswrapper[5120]: I0316 17:32:23.663855 5120 scope.go:117] "RemoveContainer" containerID="df0a87b047c8208d5fc21057efed33321f6cab49c4cf053702d222dc12979450" Mar 16 17:32:23 crc kubenswrapper[5120]: E0316 17:32:23.664423 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 17:32:24 crc kubenswrapper[5120]: I0316 17:32:24.026722 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodestbsfz"] Mar 16 17:32:24 crc kubenswrapper[5120]: I0316 17:32:24.028017 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b80edf6-6392-4ceb-8e2d-677189beaf3a" containerName="failed-service-edpm-compute-no-nodes-edpm-compute-no-nodes" Mar 16 17:32:24 crc kubenswrapper[5120]: I0316 17:32:24.028039 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b80edf6-6392-4ceb-8e2d-677189beaf3a" containerName="failed-service-edpm-compute-no-nodes-edpm-compute-no-nodes" Mar 16 17:32:24 crc kubenswrapper[5120]: I0316 17:32:24.028285 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="4b80edf6-6392-4ceb-8e2d-677189beaf3a" containerName="failed-service-edpm-compute-no-nodes-edpm-compute-no-nodes" Mar 16 17:32:24 crc kubenswrapper[5120]: I0316 17:32:24.035933 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodestbsfz" Mar 16 17:32:24 crc kubenswrapper[5120]: I0316 17:32:24.036587 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodestbsfz"] Mar 16 17:32:24 crc kubenswrapper[5120]: I0316 17:32:24.040440 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-aee-default-env\"" Mar 16 17:32:24 crc kubenswrapper[5120]: I0316 17:32:24.040608 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"edpm-compute-no-nodes-dockercfg-p688g\"" Mar 16 17:32:24 crc kubenswrapper[5120]: I0316 17:32:24.041713 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplanenodeset-edpm-compute-no-nodes\"" Mar 16 17:32:24 crc kubenswrapper[5120]: I0316 17:32:24.041890 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"combined-ca-bundle\"" Mar 16 17:32:24 crc kubenswrapper[5120]: I0316 17:32:24.042076 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplane-ansible-ssh-private-key-secret\"" Mar 16 17:32:24 crc kubenswrapper[5120]: I0316 17:32:24.117525 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/77076381-e2e1-420f-b1ab-683c5503f4d9-ssh-key-edpm-compute-no-nodes\") pod \"failed-service-edpm-compute-no-nodes-edpm-compute-no-nodestbsfz\" (UID: \"77076381-e2e1-420f-b1ab-683c5503f4d9\") " pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodestbsfz" Mar 16 17:32:24 crc kubenswrapper[5120]: I0316 17:32:24.117693 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"failed-service-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/77076381-e2e1-420f-b1ab-683c5503f4d9-failed-service-combined-ca-bundle\") pod \"failed-service-edpm-compute-no-nodes-edpm-compute-no-nodestbsfz\" (UID: \"77076381-e2e1-420f-b1ab-683c5503f4d9\") " pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodestbsfz" Mar 16 17:32:24 crc kubenswrapper[5120]: I0316 17:32:24.117926 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjl9m\" (UniqueName: \"kubernetes.io/projected/77076381-e2e1-420f-b1ab-683c5503f4d9-kube-api-access-cjl9m\") pod \"failed-service-edpm-compute-no-nodes-edpm-compute-no-nodestbsfz\" (UID: \"77076381-e2e1-420f-b1ab-683c5503f4d9\") " pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodestbsfz" Mar 16 17:32:24 crc kubenswrapper[5120]: I0316 17:32:24.118039 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/77076381-e2e1-420f-b1ab-683c5503f4d9-inventory\") pod \"failed-service-edpm-compute-no-nodes-edpm-compute-no-nodestbsfz\" (UID: \"77076381-e2e1-420f-b1ab-683c5503f4d9\") " pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodestbsfz" Mar 16 17:32:24 crc kubenswrapper[5120]: I0316 17:32:24.219942 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/77076381-e2e1-420f-b1ab-683c5503f4d9-ssh-key-edpm-compute-no-nodes\") pod \"failed-service-edpm-compute-no-nodes-edpm-compute-no-nodestbsfz\" (UID: \"77076381-e2e1-420f-b1ab-683c5503f4d9\") " pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodestbsfz" Mar 16 17:32:24 crc kubenswrapper[5120]: I0316 17:32:24.220105 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"failed-service-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/77076381-e2e1-420f-b1ab-683c5503f4d9-failed-service-combined-ca-bundle\") pod \"failed-service-edpm-compute-no-nodes-edpm-compute-no-nodestbsfz\" (UID: \"77076381-e2e1-420f-b1ab-683c5503f4d9\") " pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodestbsfz" Mar 16 17:32:24 crc kubenswrapper[5120]: I0316 17:32:24.220340 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cjl9m\" (UniqueName: \"kubernetes.io/projected/77076381-e2e1-420f-b1ab-683c5503f4d9-kube-api-access-cjl9m\") pod \"failed-service-edpm-compute-no-nodes-edpm-compute-no-nodestbsfz\" (UID: \"77076381-e2e1-420f-b1ab-683c5503f4d9\") " pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodestbsfz" Mar 16 17:32:24 crc kubenswrapper[5120]: I0316 17:32:24.220470 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/77076381-e2e1-420f-b1ab-683c5503f4d9-inventory\") pod \"failed-service-edpm-compute-no-nodes-edpm-compute-no-nodestbsfz\" (UID: \"77076381-e2e1-420f-b1ab-683c5503f4d9\") " pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodestbsfz" Mar 16 17:32:24 crc kubenswrapper[5120]: I0316 17:32:24.226842 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"failed-service-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/77076381-e2e1-420f-b1ab-683c5503f4d9-failed-service-combined-ca-bundle\") pod \"failed-service-edpm-compute-no-nodes-edpm-compute-no-nodestbsfz\" (UID: \"77076381-e2e1-420f-b1ab-683c5503f4d9\") " pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodestbsfz" Mar 16 17:32:24 crc kubenswrapper[5120]: I0316 17:32:24.226999 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/77076381-e2e1-420f-b1ab-683c5503f4d9-inventory\") pod \"failed-service-edpm-compute-no-nodes-edpm-compute-no-nodestbsfz\" (UID: \"77076381-e2e1-420f-b1ab-683c5503f4d9\") " pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodestbsfz" Mar 16 17:32:24 crc kubenswrapper[5120]: I0316 17:32:24.227107 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/77076381-e2e1-420f-b1ab-683c5503f4d9-ssh-key-edpm-compute-no-nodes\") pod \"failed-service-edpm-compute-no-nodes-edpm-compute-no-nodestbsfz\" (UID: \"77076381-e2e1-420f-b1ab-683c5503f4d9\") " pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodestbsfz" Mar 16 17:32:24 crc kubenswrapper[5120]: I0316 17:32:24.239406 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjl9m\" (UniqueName: \"kubernetes.io/projected/77076381-e2e1-420f-b1ab-683c5503f4d9-kube-api-access-cjl9m\") pod \"failed-service-edpm-compute-no-nodes-edpm-compute-no-nodestbsfz\" (UID: \"77076381-e2e1-420f-b1ab-683c5503f4d9\") " pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodestbsfz" Mar 16 17:32:24 crc kubenswrapper[5120]: I0316 17:32:24.366365 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodestbsfz" Mar 16 17:32:24 crc kubenswrapper[5120]: I0316 17:32:24.797235 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodestbsfz"] Mar 16 17:32:25 crc kubenswrapper[5120]: I0316 17:32:25.465298 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodestbsfz" event={"ID":"77076381-e2e1-420f-b1ab-683c5503f4d9","Type":"ContainerStarted","Data":"2804f6a26836a720df329b94b7149248f550f65481b84ce9f03ce39c1edb38b2"} Mar 16 17:32:25 crc kubenswrapper[5120]: I0316 17:32:25.465344 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodestbsfz" event={"ID":"77076381-e2e1-420f-b1ab-683c5503f4d9","Type":"ContainerStarted","Data":"0c7a5d3c44e4e5eb71c245e23594b3c7f9ef48a32667b4b8b21cf4413418726e"} Mar 16 17:32:25 crc kubenswrapper[5120]: I0316 17:32:25.484540 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodestbsfz" podStartSLOduration=1.040379003 podStartE2EDuration="1.484525754s" podCreationTimestamp="2026-03-16 17:32:24 +0000 UTC" firstStartedPulling="2026-03-16 17:32:24.805802743 +0000 UTC m=+7246.959734400" lastFinishedPulling="2026-03-16 17:32:25.249949494 +0000 UTC m=+7247.403881151" observedRunningTime="2026-03-16 17:32:25.481301687 +0000 UTC m=+7247.635233354" watchObservedRunningTime="2026-03-16 17:32:25.484525754 +0000 UTC m=+7247.638457411" Mar 16 17:32:27 crc kubenswrapper[5120]: I0316 17:32:27.484400 5120 generic.go:358] "Generic (PLEG): container finished" podID="77076381-e2e1-420f-b1ab-683c5503f4d9" containerID="2804f6a26836a720df329b94b7149248f550f65481b84ce9f03ce39c1edb38b2" exitCode=2 Mar 16 17:32:27 crc kubenswrapper[5120]: I0316 17:32:27.484490 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodestbsfz" event={"ID":"77076381-e2e1-420f-b1ab-683c5503f4d9","Type":"ContainerDied","Data":"2804f6a26836a720df329b94b7149248f550f65481b84ce9f03ce39c1edb38b2"} Mar 16 17:32:28 crc kubenswrapper[5120]: I0316 17:32:28.803414 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodestbsfz" Mar 16 17:32:28 crc kubenswrapper[5120]: I0316 17:32:28.820934 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cjl9m\" (UniqueName: \"kubernetes.io/projected/77076381-e2e1-420f-b1ab-683c5503f4d9-kube-api-access-cjl9m\") pod \"77076381-e2e1-420f-b1ab-683c5503f4d9\" (UID: \"77076381-e2e1-420f-b1ab-683c5503f4d9\") " Mar 16 17:32:28 crc kubenswrapper[5120]: I0316 17:32:28.821095 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"failed-service-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/77076381-e2e1-420f-b1ab-683c5503f4d9-failed-service-combined-ca-bundle\") pod \"77076381-e2e1-420f-b1ab-683c5503f4d9\" (UID: \"77076381-e2e1-420f-b1ab-683c5503f4d9\") " Mar 16 17:32:28 crc kubenswrapper[5120]: I0316 17:32:28.821388 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/77076381-e2e1-420f-b1ab-683c5503f4d9-ssh-key-edpm-compute-no-nodes\") pod \"77076381-e2e1-420f-b1ab-683c5503f4d9\" (UID: \"77076381-e2e1-420f-b1ab-683c5503f4d9\") " Mar 16 17:32:28 crc kubenswrapper[5120]: I0316 17:32:28.821485 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/77076381-e2e1-420f-b1ab-683c5503f4d9-inventory\") pod \"77076381-e2e1-420f-b1ab-683c5503f4d9\" (UID: \"77076381-e2e1-420f-b1ab-683c5503f4d9\") " Mar 16 17:32:28 crc kubenswrapper[5120]: I0316 17:32:28.827436 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/77076381-e2e1-420f-b1ab-683c5503f4d9-failed-service-combined-ca-bundle" (OuterVolumeSpecName: "failed-service-combined-ca-bundle") pod "77076381-e2e1-420f-b1ab-683c5503f4d9" (UID: "77076381-e2e1-420f-b1ab-683c5503f4d9"). InnerVolumeSpecName "failed-service-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:32:28 crc kubenswrapper[5120]: I0316 17:32:28.828039 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77076381-e2e1-420f-b1ab-683c5503f4d9-kube-api-access-cjl9m" (OuterVolumeSpecName: "kube-api-access-cjl9m") pod "77076381-e2e1-420f-b1ab-683c5503f4d9" (UID: "77076381-e2e1-420f-b1ab-683c5503f4d9"). InnerVolumeSpecName "kube-api-access-cjl9m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:32:28 crc kubenswrapper[5120]: I0316 17:32:28.847387 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/77076381-e2e1-420f-b1ab-683c5503f4d9-inventory" (OuterVolumeSpecName: "inventory") pod "77076381-e2e1-420f-b1ab-683c5503f4d9" (UID: "77076381-e2e1-420f-b1ab-683c5503f4d9"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:32:28 crc kubenswrapper[5120]: I0316 17:32:28.857330 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/77076381-e2e1-420f-b1ab-683c5503f4d9-ssh-key-edpm-compute-no-nodes" (OuterVolumeSpecName: "ssh-key-edpm-compute-no-nodes") pod "77076381-e2e1-420f-b1ab-683c5503f4d9" (UID: "77076381-e2e1-420f-b1ab-683c5503f4d9"). InnerVolumeSpecName "ssh-key-edpm-compute-no-nodes". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:32:28 crc kubenswrapper[5120]: I0316 17:32:28.924689 5120 reconciler_common.go:299] "Volume detached for volume \"failed-service-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/77076381-e2e1-420f-b1ab-683c5503f4d9-failed-service-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:32:28 crc kubenswrapper[5120]: I0316 17:32:28.924729 5120 reconciler_common.go:299] "Volume detached for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/77076381-e2e1-420f-b1ab-683c5503f4d9-ssh-key-edpm-compute-no-nodes\") on node \"crc\" DevicePath \"\"" Mar 16 17:32:28 crc kubenswrapper[5120]: I0316 17:32:28.924742 5120 reconciler_common.go:299] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/77076381-e2e1-420f-b1ab-683c5503f4d9-inventory\") on node \"crc\" DevicePath \"\"" Mar 16 17:32:28 crc kubenswrapper[5120]: I0316 17:32:28.924752 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cjl9m\" (UniqueName: \"kubernetes.io/projected/77076381-e2e1-420f-b1ab-683c5503f4d9-kube-api-access-cjl9m\") on node \"crc\" DevicePath \"\"" Mar 16 17:32:28 crc kubenswrapper[5120]: I0316 17:32:28.969342 5120 scope.go:117] "RemoveContainer" containerID="6b89bf0aca6a82d2d9c95dfdb0653dd85b15a7a4eba4acd26c3613c487600621" Mar 16 17:32:29 crc kubenswrapper[5120]: I0316 17:32:29.001102 5120 scope.go:117] "RemoveContainer" containerID="5b8202bef1ad5b5b779a707ee83b132129cbdd4e0f0e2d4ef32ff6f215dd2774" Mar 16 17:32:29 crc kubenswrapper[5120]: I0316 17:32:29.035348 5120 scope.go:117] "RemoveContainer" containerID="9805ca42b1d798b28a491a3992b792bf52553df5493d5e5c5dcbb631827092b4" Mar 16 17:32:29 crc kubenswrapper[5120]: I0316 17:32:29.109964 5120 scope.go:117] "RemoveContainer" containerID="2c1ba6d336b5012e01fbfce39f43e7f88bc27534b58b37da4dd9780159f265a6" Mar 16 17:32:29 crc kubenswrapper[5120]: I0316 17:32:29.131147 5120 scope.go:117] "RemoveContainer" containerID="3ab5069672d613f3caefbaba100facc5ff9809b176365fd5391665f33396ef24" Mar 16 17:32:29 crc kubenswrapper[5120]: I0316 17:32:29.154648 5120 scope.go:117] "RemoveContainer" containerID="49c356ce77aa518c9388549e733bca58a944421f63c8eafeb93628bfcc335bd0" Mar 16 17:32:29 crc kubenswrapper[5120]: I0316 17:32:29.184402 5120 scope.go:117] "RemoveContainer" containerID="cf5b83adf0c762bf8f1e3f90d82700ec16061af75798e6fcc07e661b321ebf6f" Mar 16 17:32:29 crc kubenswrapper[5120]: I0316 17:32:29.210432 5120 scope.go:117] "RemoveContainer" containerID="7710156ac8fe96e119e2d8f3bef47b44fe2594248dd67e18d61bb54b9ff58103" Mar 16 17:32:29 crc kubenswrapper[5120]: I0316 17:32:29.237271 5120 scope.go:117] "RemoveContainer" containerID="3703139c869bdad87cbe3ab996720f42bc161c53750ebba2f16bd6faaab6499d" Mar 16 17:32:29 crc kubenswrapper[5120]: I0316 17:32:29.264149 5120 scope.go:117] "RemoveContainer" containerID="98796da7547f1aa72ce0429e40199d72c428470ad0c26f929540115a7fef0fec" Mar 16 17:32:29 crc kubenswrapper[5120]: I0316 17:32:29.301562 5120 scope.go:117] "RemoveContainer" containerID="5d4095eace31f5292b15e66e8d027e3834f205d05b9409c08cab41b28926d936" Mar 16 17:32:29 crc kubenswrapper[5120]: I0316 17:32:29.503040 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodestbsfz" Mar 16 17:32:29 crc kubenswrapper[5120]: I0316 17:32:29.503057 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodestbsfz" event={"ID":"77076381-e2e1-420f-b1ab-683c5503f4d9","Type":"ContainerDied","Data":"0c7a5d3c44e4e5eb71c245e23594b3c7f9ef48a32667b4b8b21cf4413418726e"} Mar 16 17:32:29 crc kubenswrapper[5120]: I0316 17:32:29.503094 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0c7a5d3c44e4e5eb71c245e23594b3c7f9ef48a32667b4b8b21cf4413418726e" Mar 16 17:32:36 crc kubenswrapper[5120]: I0316 17:32:36.663796 5120 scope.go:117] "RemoveContainer" containerID="df0a87b047c8208d5fc21057efed33321f6cab49c4cf053702d222dc12979450" Mar 16 17:32:36 crc kubenswrapper[5120]: E0316 17:32:36.664573 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 17:32:46 crc kubenswrapper[5120]: I0316 17:32:46.031506 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodes7qr8c"] Mar 16 17:32:46 crc kubenswrapper[5120]: I0316 17:32:46.033383 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77076381-e2e1-420f-b1ab-683c5503f4d9" containerName="failed-service-edpm-compute-no-nodes-edpm-compute-no-nodes" Mar 16 17:32:46 crc kubenswrapper[5120]: I0316 17:32:46.033405 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="77076381-e2e1-420f-b1ab-683c5503f4d9" containerName="failed-service-edpm-compute-no-nodes-edpm-compute-no-nodes" Mar 16 17:32:46 crc kubenswrapper[5120]: I0316 17:32:46.033587 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="77076381-e2e1-420f-b1ab-683c5503f4d9" containerName="failed-service-edpm-compute-no-nodes-edpm-compute-no-nodes" Mar 16 17:32:46 crc kubenswrapper[5120]: I0316 17:32:46.085663 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodes7qr8c" Mar 16 17:32:46 crc kubenswrapper[5120]: I0316 17:32:46.087998 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodes7qr8c"] Mar 16 17:32:46 crc kubenswrapper[5120]: I0316 17:32:46.088247 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-aee-default-env\"" Mar 16 17:32:46 crc kubenswrapper[5120]: I0316 17:32:46.088492 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"edpm-compute-no-nodes-dockercfg-p688g\"" Mar 16 17:32:46 crc kubenswrapper[5120]: I0316 17:32:46.088610 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"combined-ca-bundle\"" Mar 16 17:32:46 crc kubenswrapper[5120]: I0316 17:32:46.088513 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplanenodeset-edpm-compute-no-nodes\"" Mar 16 17:32:46 crc kubenswrapper[5120]: I0316 17:32:46.091343 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplane-ansible-ssh-private-key-secret\"" Mar 16 17:32:46 crc kubenswrapper[5120]: I0316 17:32:46.103102 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/27ee861b-010c-439f-bdff-0552adb90683-ssh-key-edpm-compute-no-nodes\") pod \"failed-service-edpm-compute-no-nodes-edpm-compute-no-nodes7qr8c\" (UID: \"27ee861b-010c-439f-bdff-0552adb90683\") " pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodes7qr8c" Mar 16 17:32:46 crc kubenswrapper[5120]: I0316 17:32:46.103834 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qn5dz\" (UniqueName: \"kubernetes.io/projected/27ee861b-010c-439f-bdff-0552adb90683-kube-api-access-qn5dz\") pod \"failed-service-edpm-compute-no-nodes-edpm-compute-no-nodes7qr8c\" (UID: \"27ee861b-010c-439f-bdff-0552adb90683\") " pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodes7qr8c" Mar 16 17:32:46 crc kubenswrapper[5120]: I0316 17:32:46.103929 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/27ee861b-010c-439f-bdff-0552adb90683-inventory\") pod \"failed-service-edpm-compute-no-nodes-edpm-compute-no-nodes7qr8c\" (UID: \"27ee861b-010c-439f-bdff-0552adb90683\") " pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodes7qr8c" Mar 16 17:32:46 crc kubenswrapper[5120]: I0316 17:32:46.104195 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"failed-service-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/27ee861b-010c-439f-bdff-0552adb90683-failed-service-combined-ca-bundle\") pod \"failed-service-edpm-compute-no-nodes-edpm-compute-no-nodes7qr8c\" (UID: \"27ee861b-010c-439f-bdff-0552adb90683\") " pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodes7qr8c" Mar 16 17:32:46 crc kubenswrapper[5120]: I0316 17:32:46.206163 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/27ee861b-010c-439f-bdff-0552adb90683-ssh-key-edpm-compute-no-nodes\") pod \"failed-service-edpm-compute-no-nodes-edpm-compute-no-nodes7qr8c\" (UID: \"27ee861b-010c-439f-bdff-0552adb90683\") " pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodes7qr8c" Mar 16 17:32:46 crc kubenswrapper[5120]: I0316 17:32:46.206288 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qn5dz\" (UniqueName: \"kubernetes.io/projected/27ee861b-010c-439f-bdff-0552adb90683-kube-api-access-qn5dz\") pod \"failed-service-edpm-compute-no-nodes-edpm-compute-no-nodes7qr8c\" (UID: \"27ee861b-010c-439f-bdff-0552adb90683\") " pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodes7qr8c" Mar 16 17:32:46 crc kubenswrapper[5120]: I0316 17:32:46.206348 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/27ee861b-010c-439f-bdff-0552adb90683-inventory\") pod \"failed-service-edpm-compute-no-nodes-edpm-compute-no-nodes7qr8c\" (UID: \"27ee861b-010c-439f-bdff-0552adb90683\") " pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodes7qr8c" Mar 16 17:32:46 crc kubenswrapper[5120]: I0316 17:32:46.206541 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"failed-service-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/27ee861b-010c-439f-bdff-0552adb90683-failed-service-combined-ca-bundle\") pod \"failed-service-edpm-compute-no-nodes-edpm-compute-no-nodes7qr8c\" (UID: \"27ee861b-010c-439f-bdff-0552adb90683\") " pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodes7qr8c" Mar 16 17:32:46 crc kubenswrapper[5120]: I0316 17:32:46.212254 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/27ee861b-010c-439f-bdff-0552adb90683-ssh-key-edpm-compute-no-nodes\") pod \"failed-service-edpm-compute-no-nodes-edpm-compute-no-nodes7qr8c\" (UID: \"27ee861b-010c-439f-bdff-0552adb90683\") " pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodes7qr8c" Mar 16 17:32:46 crc kubenswrapper[5120]: I0316 17:32:46.212348 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"failed-service-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/27ee861b-010c-439f-bdff-0552adb90683-failed-service-combined-ca-bundle\") pod \"failed-service-edpm-compute-no-nodes-edpm-compute-no-nodes7qr8c\" (UID: \"27ee861b-010c-439f-bdff-0552adb90683\") " pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodes7qr8c" Mar 16 17:32:46 crc kubenswrapper[5120]: I0316 17:32:46.217145 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/27ee861b-010c-439f-bdff-0552adb90683-inventory\") pod \"failed-service-edpm-compute-no-nodes-edpm-compute-no-nodes7qr8c\" (UID: \"27ee861b-010c-439f-bdff-0552adb90683\") " pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodes7qr8c" Mar 16 17:32:46 crc kubenswrapper[5120]: I0316 17:32:46.222546 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qn5dz\" (UniqueName: \"kubernetes.io/projected/27ee861b-010c-439f-bdff-0552adb90683-kube-api-access-qn5dz\") pod \"failed-service-edpm-compute-no-nodes-edpm-compute-no-nodes7qr8c\" (UID: \"27ee861b-010c-439f-bdff-0552adb90683\") " pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodes7qr8c" Mar 16 17:32:46 crc kubenswrapper[5120]: I0316 17:32:46.409548 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodes7qr8c" Mar 16 17:32:46 crc kubenswrapper[5120]: I0316 17:32:46.827285 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodes7qr8c"] Mar 16 17:32:46 crc kubenswrapper[5120]: W0316 17:32:46.832668 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod27ee861b_010c_439f_bdff_0552adb90683.slice/crio-a14ebea529565f961072fc1b0e576a641d1efa810f7c26427eff19125db4b7c8 WatchSource:0}: Error finding container a14ebea529565f961072fc1b0e576a641d1efa810f7c26427eff19125db4b7c8: Status 404 returned error can't find the container with id a14ebea529565f961072fc1b0e576a641d1efa810f7c26427eff19125db4b7c8 Mar 16 17:32:47 crc kubenswrapper[5120]: I0316 17:32:47.659624 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodes7qr8c" event={"ID":"27ee861b-010c-439f-bdff-0552adb90683","Type":"ContainerStarted","Data":"a14ebea529565f961072fc1b0e576a641d1efa810f7c26427eff19125db4b7c8"} Mar 16 17:32:48 crc kubenswrapper[5120]: I0316 17:32:48.673222 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodes7qr8c" event={"ID":"27ee861b-010c-439f-bdff-0552adb90683","Type":"ContainerStarted","Data":"60de5df1e90cbdfe08141933bb121d01da9df592501b6c79e77f8e9251c7c405"} Mar 16 17:32:48 crc kubenswrapper[5120]: I0316 17:32:48.709358 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodes7qr8c" podStartSLOduration=1.989081189 podStartE2EDuration="2.709337374s" podCreationTimestamp="2026-03-16 17:32:46 +0000 UTC" firstStartedPulling="2026-03-16 17:32:46.834445179 +0000 UTC m=+7268.988376836" lastFinishedPulling="2026-03-16 17:32:47.554701364 +0000 UTC m=+7269.708633021" observedRunningTime="2026-03-16 17:32:48.705342284 +0000 UTC m=+7270.859273951" watchObservedRunningTime="2026-03-16 17:32:48.709337374 +0000 UTC m=+7270.863269051" Mar 16 17:32:49 crc kubenswrapper[5120]: I0316 17:32:49.682112 5120 generic.go:358] "Generic (PLEG): container finished" podID="27ee861b-010c-439f-bdff-0552adb90683" containerID="60de5df1e90cbdfe08141933bb121d01da9df592501b6c79e77f8e9251c7c405" exitCode=2 Mar 16 17:32:49 crc kubenswrapper[5120]: I0316 17:32:49.682182 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodes7qr8c" event={"ID":"27ee861b-010c-439f-bdff-0552adb90683","Type":"ContainerDied","Data":"60de5df1e90cbdfe08141933bb121d01da9df592501b6c79e77f8e9251c7c405"} Mar 16 17:32:50 crc kubenswrapper[5120]: I0316 17:32:50.979426 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodes7qr8c" Mar 16 17:32:51 crc kubenswrapper[5120]: I0316 17:32:51.106191 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/27ee861b-010c-439f-bdff-0552adb90683-ssh-key-edpm-compute-no-nodes\") pod \"27ee861b-010c-439f-bdff-0552adb90683\" (UID: \"27ee861b-010c-439f-bdff-0552adb90683\") " Mar 16 17:32:51 crc kubenswrapper[5120]: I0316 17:32:51.106280 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/27ee861b-010c-439f-bdff-0552adb90683-inventory\") pod \"27ee861b-010c-439f-bdff-0552adb90683\" (UID: \"27ee861b-010c-439f-bdff-0552adb90683\") " Mar 16 17:32:51 crc kubenswrapper[5120]: I0316 17:32:51.106384 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qn5dz\" (UniqueName: \"kubernetes.io/projected/27ee861b-010c-439f-bdff-0552adb90683-kube-api-access-qn5dz\") pod \"27ee861b-010c-439f-bdff-0552adb90683\" (UID: \"27ee861b-010c-439f-bdff-0552adb90683\") " Mar 16 17:32:51 crc kubenswrapper[5120]: I0316 17:32:51.106437 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"failed-service-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/27ee861b-010c-439f-bdff-0552adb90683-failed-service-combined-ca-bundle\") pod \"27ee861b-010c-439f-bdff-0552adb90683\" (UID: \"27ee861b-010c-439f-bdff-0552adb90683\") " Mar 16 17:32:51 crc kubenswrapper[5120]: I0316 17:32:51.112826 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27ee861b-010c-439f-bdff-0552adb90683-kube-api-access-qn5dz" (OuterVolumeSpecName: "kube-api-access-qn5dz") pod "27ee861b-010c-439f-bdff-0552adb90683" (UID: "27ee861b-010c-439f-bdff-0552adb90683"). InnerVolumeSpecName "kube-api-access-qn5dz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:32:51 crc kubenswrapper[5120]: I0316 17:32:51.113030 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27ee861b-010c-439f-bdff-0552adb90683-failed-service-combined-ca-bundle" (OuterVolumeSpecName: "failed-service-combined-ca-bundle") pod "27ee861b-010c-439f-bdff-0552adb90683" (UID: "27ee861b-010c-439f-bdff-0552adb90683"). InnerVolumeSpecName "failed-service-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:32:51 crc kubenswrapper[5120]: I0316 17:32:51.128807 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27ee861b-010c-439f-bdff-0552adb90683-inventory" (OuterVolumeSpecName: "inventory") pod "27ee861b-010c-439f-bdff-0552adb90683" (UID: "27ee861b-010c-439f-bdff-0552adb90683"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:32:51 crc kubenswrapper[5120]: I0316 17:32:51.135292 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27ee861b-010c-439f-bdff-0552adb90683-ssh-key-edpm-compute-no-nodes" (OuterVolumeSpecName: "ssh-key-edpm-compute-no-nodes") pod "27ee861b-010c-439f-bdff-0552adb90683" (UID: "27ee861b-010c-439f-bdff-0552adb90683"). InnerVolumeSpecName "ssh-key-edpm-compute-no-nodes". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:32:51 crc kubenswrapper[5120]: I0316 17:32:51.209803 5120 reconciler_common.go:299] "Volume detached for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/27ee861b-010c-439f-bdff-0552adb90683-ssh-key-edpm-compute-no-nodes\") on node \"crc\" DevicePath \"\"" Mar 16 17:32:51 crc kubenswrapper[5120]: I0316 17:32:51.209836 5120 reconciler_common.go:299] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/27ee861b-010c-439f-bdff-0552adb90683-inventory\") on node \"crc\" DevicePath \"\"" Mar 16 17:32:51 crc kubenswrapper[5120]: I0316 17:32:51.209850 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qn5dz\" (UniqueName: \"kubernetes.io/projected/27ee861b-010c-439f-bdff-0552adb90683-kube-api-access-qn5dz\") on node \"crc\" DevicePath \"\"" Mar 16 17:32:51 crc kubenswrapper[5120]: I0316 17:32:51.209862 5120 reconciler_common.go:299] "Volume detached for volume \"failed-service-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/27ee861b-010c-439f-bdff-0552adb90683-failed-service-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:32:51 crc kubenswrapper[5120]: I0316 17:32:51.664406 5120 scope.go:117] "RemoveContainer" containerID="df0a87b047c8208d5fc21057efed33321f6cab49c4cf053702d222dc12979450" Mar 16 17:32:51 crc kubenswrapper[5120]: E0316 17:32:51.664815 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 17:32:51 crc kubenswrapper[5120]: I0316 17:32:51.705222 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodes7qr8c" Mar 16 17:32:51 crc kubenswrapper[5120]: I0316 17:32:51.705256 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodes7qr8c" event={"ID":"27ee861b-010c-439f-bdff-0552adb90683","Type":"ContainerDied","Data":"a14ebea529565f961072fc1b0e576a641d1efa810f7c26427eff19125db4b7c8"} Mar 16 17:32:51 crc kubenswrapper[5120]: I0316 17:32:51.705312 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a14ebea529565f961072fc1b0e576a641d1efa810f7c26427eff19125db4b7c8" Mar 16 17:33:03 crc kubenswrapper[5120]: I0316 17:33:03.665020 5120 scope.go:117] "RemoveContainer" containerID="df0a87b047c8208d5fc21057efed33321f6cab49c4cf053702d222dc12979450" Mar 16 17:33:03 crc kubenswrapper[5120]: E0316 17:33:03.666305 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 17:33:07 crc kubenswrapper[5120]: E0316 17:33:07.521827 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1306086 actualBytes=10240 Mar 16 17:33:17 crc kubenswrapper[5120]: I0316 17:33:17.663326 5120 scope.go:117] "RemoveContainer" containerID="df0a87b047c8208d5fc21057efed33321f6cab49c4cf053702d222dc12979450" Mar 16 17:33:17 crc kubenswrapper[5120]: E0316 17:33:17.664030 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 17:33:29 crc kubenswrapper[5120]: I0316 17:33:29.027801 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodes2t6t7"] Mar 16 17:33:29 crc kubenswrapper[5120]: I0316 17:33:29.029620 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27ee861b-010c-439f-bdff-0552adb90683" containerName="failed-service-edpm-compute-no-nodes-edpm-compute-no-nodes" Mar 16 17:33:29 crc kubenswrapper[5120]: I0316 17:33:29.029641 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="27ee861b-010c-439f-bdff-0552adb90683" containerName="failed-service-edpm-compute-no-nodes-edpm-compute-no-nodes" Mar 16 17:33:29 crc kubenswrapper[5120]: I0316 17:33:29.029818 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="27ee861b-010c-439f-bdff-0552adb90683" containerName="failed-service-edpm-compute-no-nodes-edpm-compute-no-nodes" Mar 16 17:33:29 crc kubenswrapper[5120]: I0316 17:33:29.037141 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodes2t6t7" Mar 16 17:33:29 crc kubenswrapper[5120]: I0316 17:33:29.039800 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"edpm-compute-no-nodes-dockercfg-p688g\"" Mar 16 17:33:29 crc kubenswrapper[5120]: I0316 17:33:29.040241 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplanenodeset-edpm-compute-no-nodes\"" Mar 16 17:33:29 crc kubenswrapper[5120]: I0316 17:33:29.040553 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"combined-ca-bundle\"" Mar 16 17:33:29 crc kubenswrapper[5120]: I0316 17:33:29.041219 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dataplane-ansible-ssh-private-key-secret\"" Mar 16 17:33:29 crc kubenswrapper[5120]: I0316 17:33:29.041491 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-aee-default-env\"" Mar 16 17:33:29 crc kubenswrapper[5120]: I0316 17:33:29.043002 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodes2t6t7"] Mar 16 17:33:29 crc kubenswrapper[5120]: I0316 17:33:29.157844 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/ae880261-e3a5-41cd-bfe6-2b1860beea6b-ssh-key-edpm-compute-no-nodes\") pod \"failed-service-edpm-compute-no-nodes-edpm-compute-no-nodes2t6t7\" (UID: \"ae880261-e3a5-41cd-bfe6-2b1860beea6b\") " pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodes2t6t7" Mar 16 17:33:29 crc kubenswrapper[5120]: I0316 17:33:29.157928 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbd68\" (UniqueName: \"kubernetes.io/projected/ae880261-e3a5-41cd-bfe6-2b1860beea6b-kube-api-access-dbd68\") pod \"failed-service-edpm-compute-no-nodes-edpm-compute-no-nodes2t6t7\" (UID: \"ae880261-e3a5-41cd-bfe6-2b1860beea6b\") " pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodes2t6t7" Mar 16 17:33:29 crc kubenswrapper[5120]: I0316 17:33:29.158554 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"failed-service-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ae880261-e3a5-41cd-bfe6-2b1860beea6b-failed-service-combined-ca-bundle\") pod \"failed-service-edpm-compute-no-nodes-edpm-compute-no-nodes2t6t7\" (UID: \"ae880261-e3a5-41cd-bfe6-2b1860beea6b\") " pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodes2t6t7" Mar 16 17:33:29 crc kubenswrapper[5120]: I0316 17:33:29.158668 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/ae880261-e3a5-41cd-bfe6-2b1860beea6b-inventory\") pod \"failed-service-edpm-compute-no-nodes-edpm-compute-no-nodes2t6t7\" (UID: \"ae880261-e3a5-41cd-bfe6-2b1860beea6b\") " pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodes2t6t7" Mar 16 17:33:29 crc kubenswrapper[5120]: I0316 17:33:29.260214 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"failed-service-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ae880261-e3a5-41cd-bfe6-2b1860beea6b-failed-service-combined-ca-bundle\") pod \"failed-service-edpm-compute-no-nodes-edpm-compute-no-nodes2t6t7\" (UID: \"ae880261-e3a5-41cd-bfe6-2b1860beea6b\") " pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodes2t6t7" Mar 16 17:33:29 crc kubenswrapper[5120]: I0316 17:33:29.260651 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/ae880261-e3a5-41cd-bfe6-2b1860beea6b-inventory\") pod \"failed-service-edpm-compute-no-nodes-edpm-compute-no-nodes2t6t7\" (UID: \"ae880261-e3a5-41cd-bfe6-2b1860beea6b\") " pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodes2t6t7" Mar 16 17:33:29 crc kubenswrapper[5120]: I0316 17:33:29.260810 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/ae880261-e3a5-41cd-bfe6-2b1860beea6b-ssh-key-edpm-compute-no-nodes\") pod \"failed-service-edpm-compute-no-nodes-edpm-compute-no-nodes2t6t7\" (UID: \"ae880261-e3a5-41cd-bfe6-2b1860beea6b\") " pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodes2t6t7" Mar 16 17:33:29 crc kubenswrapper[5120]: I0316 17:33:29.260884 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dbd68\" (UniqueName: \"kubernetes.io/projected/ae880261-e3a5-41cd-bfe6-2b1860beea6b-kube-api-access-dbd68\") pod \"failed-service-edpm-compute-no-nodes-edpm-compute-no-nodes2t6t7\" (UID: \"ae880261-e3a5-41cd-bfe6-2b1860beea6b\") " pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodes2t6t7" Mar 16 17:33:29 crc kubenswrapper[5120]: I0316 17:33:29.278090 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"failed-service-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ae880261-e3a5-41cd-bfe6-2b1860beea6b-failed-service-combined-ca-bundle\") pod \"failed-service-edpm-compute-no-nodes-edpm-compute-no-nodes2t6t7\" (UID: \"ae880261-e3a5-41cd-bfe6-2b1860beea6b\") " pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodes2t6t7" Mar 16 17:33:29 crc kubenswrapper[5120]: I0316 17:33:29.278104 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/ae880261-e3a5-41cd-bfe6-2b1860beea6b-inventory\") pod \"failed-service-edpm-compute-no-nodes-edpm-compute-no-nodes2t6t7\" (UID: \"ae880261-e3a5-41cd-bfe6-2b1860beea6b\") " pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodes2t6t7" Mar 16 17:33:29 crc kubenswrapper[5120]: I0316 17:33:29.278994 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/ae880261-e3a5-41cd-bfe6-2b1860beea6b-ssh-key-edpm-compute-no-nodes\") pod \"failed-service-edpm-compute-no-nodes-edpm-compute-no-nodes2t6t7\" (UID: \"ae880261-e3a5-41cd-bfe6-2b1860beea6b\") " pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodes2t6t7" Mar 16 17:33:29 crc kubenswrapper[5120]: I0316 17:33:29.281165 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbd68\" (UniqueName: \"kubernetes.io/projected/ae880261-e3a5-41cd-bfe6-2b1860beea6b-kube-api-access-dbd68\") pod \"failed-service-edpm-compute-no-nodes-edpm-compute-no-nodes2t6t7\" (UID: \"ae880261-e3a5-41cd-bfe6-2b1860beea6b\") " pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodes2t6t7" Mar 16 17:33:29 crc kubenswrapper[5120]: I0316 17:33:29.365126 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodes2t6t7" Mar 16 17:33:29 crc kubenswrapper[5120]: I0316 17:33:29.520887 5120 scope.go:117] "RemoveContainer" containerID="19648ac0d1db8832c39c3c67e2d3855dec89f6eddc9a1d408e909fe3b057e7d5" Mar 16 17:33:29 crc kubenswrapper[5120]: I0316 17:33:29.566332 5120 scope.go:117] "RemoveContainer" containerID="6050d2cdc43f055f93cccbbf3a6752db021431ce92a9f036397c1a5e6770cb93" Mar 16 17:33:29 crc kubenswrapper[5120]: I0316 17:33:29.608603 5120 scope.go:117] "RemoveContainer" containerID="9606e6c1a920a405983e1b56e2ededfe1c2e6f5221ce180c91f90bc5f8e53168" Mar 16 17:33:29 crc kubenswrapper[5120]: I0316 17:33:29.639560 5120 scope.go:117] "RemoveContainer" containerID="3e39347b9c3f965977cda4844ea80037e601e81f43cdc2ae1a2b0c201ba89548" Mar 16 17:33:29 crc kubenswrapper[5120]: I0316 17:33:29.661228 5120 scope.go:117] "RemoveContainer" containerID="f51107a823957d47a684b5478f24d691cb44d5ec8e16de22695e9ca15b5c4fba" Mar 16 17:33:29 crc kubenswrapper[5120]: I0316 17:33:29.692040 5120 scope.go:117] "RemoveContainer" containerID="c24dcc16429c15b545e262c8ec7c242fff23f9efabb72c1e0b69c8c6be695e32" Mar 16 17:33:29 crc kubenswrapper[5120]: I0316 17:33:29.714134 5120 scope.go:117] "RemoveContainer" containerID="b86ea823c85103cde50cbedb18a2cd871e13bde21ea5a64d0b57c89f40dcfd0b" Mar 16 17:33:29 crc kubenswrapper[5120]: I0316 17:33:29.737676 5120 scope.go:117] "RemoveContainer" containerID="124699f72915f7db5d4b67db8ee70c528de4d860c54d51f11d17edcf3173932d" Mar 16 17:33:29 crc kubenswrapper[5120]: I0316 17:33:29.759233 5120 scope.go:117] "RemoveContainer" containerID="70692e6edf5b29528d4d5c7307821d7188338279e888f87965793032a701dceb" Mar 16 17:33:29 crc kubenswrapper[5120]: I0316 17:33:29.790505 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodes2t6t7"] Mar 16 17:33:29 crc kubenswrapper[5120]: I0316 17:33:29.794396 5120 scope.go:117] "RemoveContainer" containerID="2e09128ad370e2f003150c7f73759e46b02933b5202888ca938417844c45409b" Mar 16 17:33:30 crc kubenswrapper[5120]: I0316 17:33:30.037365 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodes2t6t7" event={"ID":"ae880261-e3a5-41cd-bfe6-2b1860beea6b","Type":"ContainerStarted","Data":"c2f2756326b4c98a4b29b630cacf715514e1516c452dabd5f566e9ab649628c6"} Mar 16 17:33:31 crc kubenswrapper[5120]: I0316 17:33:31.050424 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodes2t6t7" event={"ID":"ae880261-e3a5-41cd-bfe6-2b1860beea6b","Type":"ContainerStarted","Data":"c57eb7dddc67195d418162e2d16fa141010626fa7711768b3b7df6e1bbb05adc"} Mar 16 17:33:31 crc kubenswrapper[5120]: I0316 17:33:31.067011 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodes2t6t7" podStartSLOduration=1.555412605 podStartE2EDuration="2.066994985s" podCreationTimestamp="2026-03-16 17:33:29 +0000 UTC" firstStartedPulling="2026-03-16 17:33:29.801531442 +0000 UTC m=+7311.955463099" lastFinishedPulling="2026-03-16 17:33:30.313113832 +0000 UTC m=+7312.467045479" observedRunningTime="2026-03-16 17:33:31.06569472 +0000 UTC m=+7313.219626387" watchObservedRunningTime="2026-03-16 17:33:31.066994985 +0000 UTC m=+7313.220926642" Mar 16 17:33:31 crc kubenswrapper[5120]: I0316 17:33:31.663618 5120 scope.go:117] "RemoveContainer" containerID="df0a87b047c8208d5fc21057efed33321f6cab49c4cf053702d222dc12979450" Mar 16 17:33:31 crc kubenswrapper[5120]: E0316 17:33:31.663939 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 17:33:32 crc kubenswrapper[5120]: I0316 17:33:32.061389 5120 generic.go:358] "Generic (PLEG): container finished" podID="ae880261-e3a5-41cd-bfe6-2b1860beea6b" containerID="c57eb7dddc67195d418162e2d16fa141010626fa7711768b3b7df6e1bbb05adc" exitCode=2 Mar 16 17:33:32 crc kubenswrapper[5120]: I0316 17:33:32.061927 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodes2t6t7" event={"ID":"ae880261-e3a5-41cd-bfe6-2b1860beea6b","Type":"ContainerDied","Data":"c57eb7dddc67195d418162e2d16fa141010626fa7711768b3b7df6e1bbb05adc"} Mar 16 17:33:33 crc kubenswrapper[5120]: I0316 17:33:33.336819 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodes2t6t7" Mar 16 17:33:33 crc kubenswrapper[5120]: I0316 17:33:33.453445 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dbd68\" (UniqueName: \"kubernetes.io/projected/ae880261-e3a5-41cd-bfe6-2b1860beea6b-kube-api-access-dbd68\") pod \"ae880261-e3a5-41cd-bfe6-2b1860beea6b\" (UID: \"ae880261-e3a5-41cd-bfe6-2b1860beea6b\") " Mar 16 17:33:33 crc kubenswrapper[5120]: I0316 17:33:33.453739 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/ae880261-e3a5-41cd-bfe6-2b1860beea6b-ssh-key-edpm-compute-no-nodes\") pod \"ae880261-e3a5-41cd-bfe6-2b1860beea6b\" (UID: \"ae880261-e3a5-41cd-bfe6-2b1860beea6b\") " Mar 16 17:33:33 crc kubenswrapper[5120]: I0316 17:33:33.454008 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"failed-service-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ae880261-e3a5-41cd-bfe6-2b1860beea6b-failed-service-combined-ca-bundle\") pod \"ae880261-e3a5-41cd-bfe6-2b1860beea6b\" (UID: \"ae880261-e3a5-41cd-bfe6-2b1860beea6b\") " Mar 16 17:33:33 crc kubenswrapper[5120]: I0316 17:33:33.454100 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/ae880261-e3a5-41cd-bfe6-2b1860beea6b-inventory\") pod \"ae880261-e3a5-41cd-bfe6-2b1860beea6b\" (UID: \"ae880261-e3a5-41cd-bfe6-2b1860beea6b\") " Mar 16 17:33:33 crc kubenswrapper[5120]: I0316 17:33:33.459373 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae880261-e3a5-41cd-bfe6-2b1860beea6b-failed-service-combined-ca-bundle" (OuterVolumeSpecName: "failed-service-combined-ca-bundle") pod "ae880261-e3a5-41cd-bfe6-2b1860beea6b" (UID: "ae880261-e3a5-41cd-bfe6-2b1860beea6b"). InnerVolumeSpecName "failed-service-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:33:33 crc kubenswrapper[5120]: I0316 17:33:33.459400 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae880261-e3a5-41cd-bfe6-2b1860beea6b-kube-api-access-dbd68" (OuterVolumeSpecName: "kube-api-access-dbd68") pod "ae880261-e3a5-41cd-bfe6-2b1860beea6b" (UID: "ae880261-e3a5-41cd-bfe6-2b1860beea6b"). InnerVolumeSpecName "kube-api-access-dbd68". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:33:33 crc kubenswrapper[5120]: I0316 17:33:33.474503 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae880261-e3a5-41cd-bfe6-2b1860beea6b-ssh-key-edpm-compute-no-nodes" (OuterVolumeSpecName: "ssh-key-edpm-compute-no-nodes") pod "ae880261-e3a5-41cd-bfe6-2b1860beea6b" (UID: "ae880261-e3a5-41cd-bfe6-2b1860beea6b"). InnerVolumeSpecName "ssh-key-edpm-compute-no-nodes". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:33:33 crc kubenswrapper[5120]: I0316 17:33:33.475754 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae880261-e3a5-41cd-bfe6-2b1860beea6b-inventory" (OuterVolumeSpecName: "inventory") pod "ae880261-e3a5-41cd-bfe6-2b1860beea6b" (UID: "ae880261-e3a5-41cd-bfe6-2b1860beea6b"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:33:33 crc kubenswrapper[5120]: I0316 17:33:33.556062 5120 reconciler_common.go:299] "Volume detached for volume \"ssh-key-edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/secret/ae880261-e3a5-41cd-bfe6-2b1860beea6b-ssh-key-edpm-compute-no-nodes\") on node \"crc\" DevicePath \"\"" Mar 16 17:33:33 crc kubenswrapper[5120]: I0316 17:33:33.556096 5120 reconciler_common.go:299] "Volume detached for volume \"failed-service-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ae880261-e3a5-41cd-bfe6-2b1860beea6b-failed-service-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:33:33 crc kubenswrapper[5120]: I0316 17:33:33.556108 5120 reconciler_common.go:299] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/ae880261-e3a5-41cd-bfe6-2b1860beea6b-inventory\") on node \"crc\" DevicePath \"\"" Mar 16 17:33:33 crc kubenswrapper[5120]: I0316 17:33:33.556121 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dbd68\" (UniqueName: \"kubernetes.io/projected/ae880261-e3a5-41cd-bfe6-2b1860beea6b-kube-api-access-dbd68\") on node \"crc\" DevicePath \"\"" Mar 16 17:33:34 crc kubenswrapper[5120]: I0316 17:33:34.098712 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodes2t6t7" Mar 16 17:33:34 crc kubenswrapper[5120]: I0316 17:33:34.100004 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodes2t6t7" event={"ID":"ae880261-e3a5-41cd-bfe6-2b1860beea6b","Type":"ContainerDied","Data":"c2f2756326b4c98a4b29b630cacf715514e1516c452dabd5f566e9ab649628c6"} Mar 16 17:33:34 crc kubenswrapper[5120]: I0316 17:33:34.100051 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c2f2756326b4c98a4b29b630cacf715514e1516c452dabd5f566e9ab649628c6" Mar 16 17:33:34 crc kubenswrapper[5120]: I0316 17:33:34.258043 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodes2t6t7"] Mar 16 17:33:34 crc kubenswrapper[5120]: I0316 17:33:34.264902 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodestbsfz"] Mar 16 17:33:34 crc kubenswrapper[5120]: I0316 17:33:34.271887 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodeskvwjf"] Mar 16 17:33:34 crc kubenswrapper[5120]: I0316 17:33:34.279825 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodes7qr8c"] Mar 16 17:33:34 crc kubenswrapper[5120]: I0316 17:33:34.289059 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodes7qr8c"] Mar 16 17:33:34 crc kubenswrapper[5120]: I0316 17:33:34.295331 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodeskvwjf"] Mar 16 17:33:34 crc kubenswrapper[5120]: I0316 17:33:34.302021 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodes2t6t7"] Mar 16 17:33:34 crc kubenswrapper[5120]: I0316 17:33:34.309498 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodestbsfz"] Mar 16 17:33:34 crc kubenswrapper[5120]: I0316 17:33:34.317334 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-5dr8d"] Mar 16 17:33:34 crc kubenswrapper[5120]: I0316 17:33:34.318375 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae880261-e3a5-41cd-bfe6-2b1860beea6b" containerName="failed-service-edpm-compute-no-nodes-edpm-compute-no-nodes" Mar 16 17:33:34 crc kubenswrapper[5120]: I0316 17:33:34.318455 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae880261-e3a5-41cd-bfe6-2b1860beea6b" containerName="failed-service-edpm-compute-no-nodes-edpm-compute-no-nodes" Mar 16 17:33:34 crc kubenswrapper[5120]: I0316 17:33:34.318663 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ae880261-e3a5-41cd-bfe6-2b1860beea6b" containerName="failed-service-edpm-compute-no-nodes-edpm-compute-no-nodes" Mar 16 17:33:34 crc kubenswrapper[5120]: I0316 17:33:34.324978 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-5dr8d" Mar 16 17:33:34 crc kubenswrapper[5120]: I0316 17:33:34.328013 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-5dr8d"] Mar 16 17:33:34 crc kubenswrapper[5120]: I0316 17:33:34.478054 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/798363c6-1234-40e2-a0a7-85e1180310c4-config\") pod \"dnsmasq-dnsmasq-79dcd846c5-5dr8d\" (UID: \"798363c6-1234-40e2-a0a7-85e1180310c4\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-5dr8d" Mar 16 17:33:34 crc kubenswrapper[5120]: I0316 17:33:34.478568 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drm22\" (UniqueName: \"kubernetes.io/projected/798363c6-1234-40e2-a0a7-85e1180310c4-kube-api-access-drm22\") pod \"dnsmasq-dnsmasq-79dcd846c5-5dr8d\" (UID: \"798363c6-1234-40e2-a0a7-85e1180310c4\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-5dr8d" Mar 16 17:33:34 crc kubenswrapper[5120]: I0316 17:33:34.478595 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/798363c6-1234-40e2-a0a7-85e1180310c4-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-79dcd846c5-5dr8d\" (UID: \"798363c6-1234-40e2-a0a7-85e1180310c4\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-5dr8d" Mar 16 17:33:34 crc kubenswrapper[5120]: I0316 17:33:34.580204 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-drm22\" (UniqueName: \"kubernetes.io/projected/798363c6-1234-40e2-a0a7-85e1180310c4-kube-api-access-drm22\") pod \"dnsmasq-dnsmasq-79dcd846c5-5dr8d\" (UID: \"798363c6-1234-40e2-a0a7-85e1180310c4\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-5dr8d" Mar 16 17:33:34 crc kubenswrapper[5120]: I0316 17:33:34.580260 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/798363c6-1234-40e2-a0a7-85e1180310c4-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-79dcd846c5-5dr8d\" (UID: \"798363c6-1234-40e2-a0a7-85e1180310c4\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-5dr8d" Mar 16 17:33:34 crc kubenswrapper[5120]: I0316 17:33:34.580433 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/798363c6-1234-40e2-a0a7-85e1180310c4-config\") pod \"dnsmasq-dnsmasq-79dcd846c5-5dr8d\" (UID: \"798363c6-1234-40e2-a0a7-85e1180310c4\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-5dr8d" Mar 16 17:33:34 crc kubenswrapper[5120]: I0316 17:33:34.581411 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/798363c6-1234-40e2-a0a7-85e1180310c4-config\") pod \"dnsmasq-dnsmasq-79dcd846c5-5dr8d\" (UID: \"798363c6-1234-40e2-a0a7-85e1180310c4\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-5dr8d" Mar 16 17:33:34 crc kubenswrapper[5120]: I0316 17:33:34.582254 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/798363c6-1234-40e2-a0a7-85e1180310c4-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-79dcd846c5-5dr8d\" (UID: \"798363c6-1234-40e2-a0a7-85e1180310c4\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-5dr8d" Mar 16 17:33:34 crc kubenswrapper[5120]: I0316 17:33:34.603998 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-drm22\" (UniqueName: \"kubernetes.io/projected/798363c6-1234-40e2-a0a7-85e1180310c4-kube-api-access-drm22\") pod \"dnsmasq-dnsmasq-79dcd846c5-5dr8d\" (UID: \"798363c6-1234-40e2-a0a7-85e1180310c4\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-5dr8d" Mar 16 17:33:34 crc kubenswrapper[5120]: I0316 17:33:34.654492 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-5dr8d" Mar 16 17:33:34 crc kubenswrapper[5120]: I0316 17:33:34.680615 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="27ee861b-010c-439f-bdff-0552adb90683" path="/var/lib/kubelet/pods/27ee861b-010c-439f-bdff-0552adb90683/volumes" Mar 16 17:33:34 crc kubenswrapper[5120]: I0316 17:33:34.682123 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b80edf6-6392-4ceb-8e2d-677189beaf3a" path="/var/lib/kubelet/pods/4b80edf6-6392-4ceb-8e2d-677189beaf3a/volumes" Mar 16 17:33:34 crc kubenswrapper[5120]: I0316 17:33:34.682692 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="77076381-e2e1-420f-b1ab-683c5503f4d9" path="/var/lib/kubelet/pods/77076381-e2e1-420f-b1ab-683c5503f4d9/volumes" Mar 16 17:33:34 crc kubenswrapper[5120]: I0316 17:33:34.683536 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ae880261-e3a5-41cd-bfe6-2b1860beea6b" path="/var/lib/kubelet/pods/ae880261-e3a5-41cd-bfe6-2b1860beea6b/volumes" Mar 16 17:33:35 crc kubenswrapper[5120]: I0316 17:33:35.077361 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-5dr8d"] Mar 16 17:33:35 crc kubenswrapper[5120]: I0316 17:33:35.109700 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-5dr8d" event={"ID":"798363c6-1234-40e2-a0a7-85e1180310c4","Type":"ContainerStarted","Data":"4c35927fa411cd2b24a11846136d9af4f477d0219d2c9455e92d528304eb8321"} Mar 16 17:33:36 crc kubenswrapper[5120]: I0316 17:33:36.119651 5120 generic.go:358] "Generic (PLEG): container finished" podID="798363c6-1234-40e2-a0a7-85e1180310c4" containerID="ac5c3ed52caa31a247ddc9126882f0293bba251ca672fc40959c61ac27e1d5f3" exitCode=0 Mar 16 17:33:36 crc kubenswrapper[5120]: I0316 17:33:36.119701 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-5dr8d" event={"ID":"798363c6-1234-40e2-a0a7-85e1180310c4","Type":"ContainerDied","Data":"ac5c3ed52caa31a247ddc9126882f0293bba251ca672fc40959c61ac27e1d5f3"} Mar 16 17:33:37 crc kubenswrapper[5120]: I0316 17:33:37.129937 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-5dr8d" event={"ID":"798363c6-1234-40e2-a0a7-85e1180310c4","Type":"ContainerStarted","Data":"7ec86ec8eab554ca1bec1a0eff28311ffcee883bd84be1afb7c217a8826106fd"} Mar 16 17:33:37 crc kubenswrapper[5120]: I0316 17:33:37.130919 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-5dr8d" Mar 16 17:33:37 crc kubenswrapper[5120]: I0316 17:33:37.151510 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-5dr8d" podStartSLOduration=3.151491594 podStartE2EDuration="3.151491594s" podCreationTimestamp="2026-03-16 17:33:34 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:33:37.146231851 +0000 UTC m=+7319.300163508" watchObservedRunningTime="2026-03-16 17:33:37.151491594 +0000 UTC m=+7319.305423251" Mar 16 17:33:37 crc kubenswrapper[5120]: I0316 17:33:37.999108 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/openstack-baremetal-operator-controller-manager-6b6ddbc599g848w"] Mar 16 17:33:37 crc kubenswrapper[5120]: I0316 17:33:37.999890 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-operators/openstack-baremetal-operator-controller-manager-6b6ddbc599g848w" podUID="8643ed10-e4fd-4b97-ae36-c4b581cdef1b" containerName="manager" containerID="cri-o://d36ab310f9eb32a43a7c5c1b874115c89e446170f7a4f5b94c195832631225ab" gracePeriod=10 Mar 16 17:33:38 crc kubenswrapper[5120]: I0316 17:33:38.092904 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/nova-operator-controller-manager-785d77464d-j7x9r"] Mar 16 17:33:38 crc kubenswrapper[5120]: I0316 17:33:38.093270 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-operators/nova-operator-controller-manager-785d77464d-j7x9r" podUID="66faede0-c074-49ca-8bf9-9b5777b02edf" containerName="manager" containerID="cri-o://3d5c918342f57ab22227d88adb1cfa9c0d01d92b66766ac6cdb7212a18358892" gracePeriod=10 Mar 16 17:33:38 crc kubenswrapper[5120]: I0316 17:33:38.109834 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/test-operator-controller-manager-74d567479f-cbkr4"] Mar 16 17:33:38 crc kubenswrapper[5120]: I0316 17:33:38.110169 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-operators/test-operator-controller-manager-74d567479f-cbkr4" podUID="ef52f45c-ba73-4607-8b03-f13fce9806bd" containerName="manager" containerID="cri-o://8a7d9c15b46652c24e31619db72ffcdd6edc32a99198a149ff7e231290a729b8" gracePeriod=10 Mar 16 17:33:38 crc kubenswrapper[5120]: I0316 17:33:38.115173 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/horizon-operator-controller-manager-5bf9fb4564-qzsbr"] Mar 16 17:33:38 crc kubenswrapper[5120]: I0316 17:33:38.115519 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-operators/horizon-operator-controller-manager-5bf9fb4564-qzsbr" podUID="e6b6caa5-b1c3-4ad6-8b0e-0358400bb03b" containerName="manager" containerID="cri-o://163918bdf98d1c1c3ca79246758fb544bcb919c9ecb8c47189928bbe3245b4d6" gracePeriod=10 Mar 16 17:33:38 crc kubenswrapper[5120]: I0316 17:33:38.130812 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/glance-operator-controller-manager-58d9bbd8cc-vhvn5"] Mar 16 17:33:38 crc kubenswrapper[5120]: I0316 17:33:38.131129 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-operators/glance-operator-controller-manager-58d9bbd8cc-vhvn5" podUID="e918c50c-96eb-4da3-9b1d-fc31e3582816" containerName="manager" containerID="cri-o://2bea00861ef023a301ed304c08762de77012ab04460a060088be7e7f197b34d7" gracePeriod=10 Mar 16 17:33:38 crc kubenswrapper[5120]: I0316 17:33:38.145433 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/keystone-operator-controller-manager-6f5b9fd59-rhjb2"] Mar 16 17:33:38 crc kubenswrapper[5120]: I0316 17:33:38.145751 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-operators/keystone-operator-controller-manager-6f5b9fd59-rhjb2" podUID="f5403564-ecbf-4103-89b6-530a8381c664" containerName="manager" containerID="cri-o://74b759d17c7d6bc10253b03d120e87e3c039046a6d9f3afc93394d3573e3b4bb" gracePeriod=10 Mar 16 17:33:38 crc kubenswrapper[5120]: I0316 17:33:38.163560 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/openstack-operator-controller-manager-5fbcdbcf94-6sdhq"] Mar 16 17:33:38 crc kubenswrapper[5120]: I0316 17:33:38.163898 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-operators/openstack-operator-controller-manager-5fbcdbcf94-6sdhq" podUID="91595c8f-09e8-4cdd-8054-1f46eafa27ad" containerName="manager" containerID="cri-o://c39c9fd812f20b679694300a29617b4f4b1a9a67c1c9ef8f9aff5b2909489a26" gracePeriod=10 Mar 16 17:33:38 crc kubenswrapper[5120]: I0316 17:33:38.175626 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/telemetry-operator-controller-manager-f5cf7fcb7-cmrwq"] Mar 16 17:33:38 crc kubenswrapper[5120]: I0316 17:33:38.175882 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-operators/telemetry-operator-controller-manager-f5cf7fcb7-cmrwq" podUID="201aeec6-1404-4b8d-8cf7-4d2550cc9898" containerName="manager" containerID="cri-o://9400626ed96f9196ac2177fe5b97b2f99a23d54b8aba032cd07a65b4fa62261b" gracePeriod=10 Mar 16 17:33:38 crc kubenswrapper[5120]: I0316 17:33:38.186412 5120 generic.go:358] "Generic (PLEG): container finished" podID="8643ed10-e4fd-4b97-ae36-c4b581cdef1b" containerID="d36ab310f9eb32a43a7c5c1b874115c89e446170f7a4f5b94c195832631225ab" exitCode=0 Mar 16 17:33:38 crc kubenswrapper[5120]: I0316 17:33:38.186896 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/openstack-baremetal-operator-controller-manager-6b6ddbc599g848w" event={"ID":"8643ed10-e4fd-4b97-ae36-c4b581cdef1b","Type":"ContainerDied","Data":"d36ab310f9eb32a43a7c5c1b874115c89e446170f7a4f5b94c195832631225ab"} Mar 16 17:33:38 crc kubenswrapper[5120]: I0316 17:33:38.194830 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/rabbitmq-cluster-operator-manager-85d9b55b6-tfl54"] Mar 16 17:33:38 crc kubenswrapper[5120]: I0316 17:33:38.195145 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-operators/rabbitmq-cluster-operator-manager-85d9b55b6-tfl54" podUID="d2d3e713-eefd-44fd-8784-1f4f54155d8f" containerName="operator" containerID="cri-o://ba2d7e8fb80dd5f1cea3845025bb460e85d914e39fff650768c91d758e0cb42f" gracePeriod=10 Mar 16 17:33:38 crc kubenswrapper[5120]: I0316 17:33:38.216859 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/designate-operator-controller-manager-7cf89c67bb-cjd7x"] Mar 16 17:33:38 crc kubenswrapper[5120]: I0316 17:33:38.217369 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-operators/designate-operator-controller-manager-7cf89c67bb-cjd7x" podUID="2fc99f04-8366-4f00-9ce1-d0e4faf1d0a3" containerName="manager" containerID="cri-o://1c41db9773336db87d587462f8cb97f5de96f1b4f579e3d8052b9a13bad57ded" gracePeriod=10 Mar 16 17:33:38 crc kubenswrapper[5120]: I0316 17:33:38.237828 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/heat-operator-controller-manager-79975d4c95-n2zm7"] Mar 16 17:33:38 crc kubenswrapper[5120]: I0316 17:33:38.238101 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-operators/heat-operator-controller-manager-79975d4c95-n2zm7" podUID="4752ce4e-0b7c-43d7-99dc-b8633f7a2cd7" containerName="manager" containerID="cri-o://cd5dbf07e769c93af8e2f9b7a8af06cf9287e9e82f2b76fb7904536eefed6823" gracePeriod=10 Mar 16 17:33:38 crc kubenswrapper[5120]: I0316 17:33:38.304518 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/placement-operator-controller-manager-57fdd4b4cf-v5f9b"] Mar 16 17:33:38 crc kubenswrapper[5120]: I0316 17:33:38.304943 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-operators/placement-operator-controller-manager-57fdd4b4cf-v5f9b" podUID="3b105271-39d9-4339-a315-3aa161a54b31" containerName="manager" containerID="cri-o://3da52e15c02df0a82c598ff490b54b787b7fe711f2a17e60e6ee0f883e895fa1" gracePeriod=10 Mar 16 17:33:38 crc kubenswrapper[5120]: I0316 17:33:38.320662 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/manila-operator-controller-manager-7d6d87b867-xkrnl"] Mar 16 17:33:38 crc kubenswrapper[5120]: I0316 17:33:38.321328 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-operators/manila-operator-controller-manager-7d6d87b867-xkrnl" podUID="eed7b084-3ca6-41c0-847f-19929fb52c41" containerName="manager" containerID="cri-o://76b28721686f76aade4349039a79bd66bf48c80868031b23a4b84de5420eca6a" gracePeriod=10 Mar 16 17:33:38 crc kubenswrapper[5120]: I0316 17:33:38.353603 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/mariadb-operator-controller-manager-5748db694b-nk2nc"] Mar 16 17:33:38 crc kubenswrapper[5120]: I0316 17:33:38.354204 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-operators/mariadb-operator-controller-manager-5748db694b-nk2nc" podUID="8a11dd5a-29d6-4791-849c-97b08acb5b4e" containerName="manager" containerID="cri-o://1de87f8609842e9f047525b572c69ce524ffb562d47c0be7de1674db25e09051" gracePeriod=10 Mar 16 17:33:38 crc kubenswrapper[5120]: I0316 17:33:38.387733 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/octavia-operator-controller-manager-7b89675745-5vg74"] Mar 16 17:33:38 crc kubenswrapper[5120]: I0316 17:33:38.388143 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-operators/octavia-operator-controller-manager-7b89675745-5vg74" podUID="bbc9f690-e60b-4c8a-b84a-2d8a3ca2001f" containerName="manager" containerID="cri-o://4dcde05605706042f7e10545568428ec80e8abcb93a4246f1298c6443f160ec6" gracePeriod=10 Mar 16 17:33:38 crc kubenswrapper[5120]: I0316 17:33:38.422160 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/swift-operator-controller-manager-5d89b4d5d5-9zvm4"] Mar 16 17:33:38 crc kubenswrapper[5120]: I0316 17:33:38.422473 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-operators/swift-operator-controller-manager-5d89b4d5d5-9zvm4" podUID="e46d1032-1fff-4f99-baa0-487aee0eb1bd" containerName="manager" containerID="cri-o://4bb0ceb90fb71a7a432b2d87618203e4ea86bcff6d9cef86f4573b133139af02" gracePeriod=10 Mar 16 17:33:38 crc kubenswrapper[5120]: I0316 17:33:38.451500 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/watcher-operator-controller-manager-65d578856c-7khnv"] Mar 16 17:33:38 crc kubenswrapper[5120]: I0316 17:33:38.452904 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-operators/watcher-operator-controller-manager-65d578856c-7khnv" podUID="4af61d68-498f-4c1a-812d-91089029f784" containerName="manager" containerID="cri-o://4919118b0391f6ba7ac4b1d16b3d5a87d7e6ebefe0bbe46b8922f1b0014f0282" gracePeriod=10 Mar 16 17:33:38 crc kubenswrapper[5120]: I0316 17:33:38.470237 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/infra-operator-controller-manager-76f8b7ddbd-nvwr5"] Mar 16 17:33:38 crc kubenswrapper[5120]: I0316 17:33:38.470541 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-operators/infra-operator-controller-manager-76f8b7ddbd-nvwr5" podUID="797f2c96-18c7-400b-a46d-795da852b08e" containerName="manager" containerID="cri-o://2dd1536f1978caea4100bb4567e6b33537548bb68086b77cbfee09af8ba09f6b" gracePeriod=10 Mar 16 17:33:38 crc kubenswrapper[5120]: I0316 17:33:38.500483 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/barbican-operator-controller-manager-848cfb5779-68smv"] Mar 16 17:33:38 crc kubenswrapper[5120]: I0316 17:33:38.500806 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-operators/barbican-operator-controller-manager-848cfb5779-68smv" podUID="f62d5d6a-d638-4968-902f-8eb726c039c1" containerName="manager" containerID="cri-o://cb53f78efe333f796357e348cca82be325147af2149d1fc52ec920cb98e13edc" gracePeriod=10 Mar 16 17:33:38 crc kubenswrapper[5120]: I0316 17:33:38.544421 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/ovn-operator-controller-manager-6fb6cd45c4-ln28h"] Mar 16 17:33:38 crc kubenswrapper[5120]: I0316 17:33:38.544742 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-operators/ovn-operator-controller-manager-6fb6cd45c4-ln28h" podUID="8e6d8ae5-f5be-4b12-8401-54dcc86da579" containerName="manager" containerID="cri-o://c9f555dc35319e5a738060a949804e12a57019848919f048fb0a5dd0a7b73fc6" gracePeriod=10 Mar 16 17:33:38 crc kubenswrapper[5120]: I0316 17:33:38.588717 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/cinder-operator-controller-manager-55bc8cdcc4-sbtk9"] Mar 16 17:33:38 crc kubenswrapper[5120]: I0316 17:33:38.589022 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-operators/cinder-operator-controller-manager-55bc8cdcc4-sbtk9" podUID="ed2165fd-95f2-40f7-a860-70b81d6ab977" containerName="manager" containerID="cri-o://5e696788c3a844d4ec752d5af523e578b1132a27c237c44a42ed0f439f974a09" gracePeriod=10 Mar 16 17:33:38 crc kubenswrapper[5120]: I0316 17:33:38.615657 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/ironic-operator-controller-manager-997698bf9-6zvjn"] Mar 16 17:33:38 crc kubenswrapper[5120]: I0316 17:33:38.617904 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-operators/ironic-operator-controller-manager-997698bf9-6zvjn" podUID="42478fad-5a61-4cc1-94cc-ac00bdf30f24" containerName="manager" containerID="cri-o://636f4788fa12f348f3f6e38ef9f3f32d17f195054394d6d4eac0b62afd8629f5" gracePeriod=10 Mar 16 17:33:38 crc kubenswrapper[5120]: I0316 17:33:38.634463 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/neutron-operator-controller-manager-75c6f4bc76-mbnvj"] Mar 16 17:33:38 crc kubenswrapper[5120]: I0316 17:33:38.635645 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-operators/neutron-operator-controller-manager-75c6f4bc76-mbnvj" podUID="32fa740c-28b3-42a7-8ab5-6d159c237bf8" containerName="manager" containerID="cri-o://8187984f8e77140a5f3d80b9a1039d239792a6246d38550200214f8daab0f7ca" gracePeriod=10 Mar 16 17:33:38 crc kubenswrapper[5120]: I0316 17:33:38.800280 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/openstack-operator-controller-init-7b76cc8c59-hmnw9"] Mar 16 17:33:38 crc kubenswrapper[5120]: I0316 17:33:38.800345 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/openstack-operator-index-2h9ct"] Mar 16 17:33:38 crc kubenswrapper[5120]: I0316 17:33:38.800363 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/607560efed3261fb385ad992f9f23627ac0d364289331c8dba808cbffbv5qh8"] Mar 16 17:33:38 crc kubenswrapper[5120]: I0316 17:33:38.800379 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-operators/607560efed3261fb385ad992f9f23627ac0d364289331c8dba808cbffbv5qh8"] Mar 16 17:33:38 crc kubenswrapper[5120]: I0316 17:33:38.800400 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-operator-lifecycle-manager/catalog-operator-75ff9f647d-x5d5w"] Mar 16 17:33:38 crc kubenswrapper[5120]: I0316 17:33:38.800669 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-operator-lifecycle-manager/catalog-operator-75ff9f647d-x5d5w" podUID="7f53cb77-0d21-4cd7-81c0-d003500184f1" containerName="catalog-operator" containerID="cri-o://af160f46b56e7465ca7930c0926d2c81d89bc4d73fe0c22293a02940de9f414f" gracePeriod=30 Mar 16 17:33:38 crc kubenswrapper[5120]: I0316 17:33:38.801067 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-operators/openstack-operator-index-2h9ct" podUID="127fb533-a6f7-4dc2-85d9-69ec57116fe9" containerName="registry-server" containerID="cri-o://354866e7009f17f044d6646ccb1748c884509fad24b122da4aef3b09d4134ba1" gracePeriod=30 Mar 16 17:33:38 crc kubenswrapper[5120]: I0316 17:33:38.801348 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-operators/openstack-operator-controller-init-7b76cc8c59-hmnw9" podUID="78743df2-449e-44ab-91f1-ac48af33b657" containerName="operator" containerID="cri-o://e2579a5f5422a476f71f7cbdd4956f87e25a1665768e12a05d68434c8a974b9f" gracePeriod=10 Mar 16 17:33:38 crc kubenswrapper[5120]: I0316 17:33:38.810675 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-operator-lifecycle-manager/catalog-operator-75ff9f647d-wtb28"] Mar 16 17:33:38 crc kubenswrapper[5120]: I0316 17:33:38.826141 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/catalog-operator-75ff9f647d-wtb28" Mar 16 17:33:38 crc kubenswrapper[5120]: I0316 17:33:38.837346 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operator-lifecycle-manager/catalog-operator-75ff9f647d-wtb28"] Mar 16 17:33:38 crc kubenswrapper[5120]: I0316 17:33:38.923506 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sc8f2\" (UniqueName: \"kubernetes.io/projected/5de233e4-28ee-437b-a4f1-28a1caf84fd5-kube-api-access-sc8f2\") pod \"catalog-operator-75ff9f647d-wtb28\" (UID: \"5de233e4-28ee-437b-a4f1-28a1caf84fd5\") " pod="openshift-operator-lifecycle-manager/catalog-operator-75ff9f647d-wtb28" Mar 16 17:33:38 crc kubenswrapper[5120]: I0316 17:33:38.923701 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmpfs\" (UniqueName: \"kubernetes.io/empty-dir/5de233e4-28ee-437b-a4f1-28a1caf84fd5-tmpfs\") pod \"catalog-operator-75ff9f647d-wtb28\" (UID: \"5de233e4-28ee-437b-a4f1-28a1caf84fd5\") " pod="openshift-operator-lifecycle-manager/catalog-operator-75ff9f647d-wtb28" Mar 16 17:33:38 crc kubenswrapper[5120]: I0316 17:33:38.923851 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"profile-collector-cert\" (UniqueName: \"kubernetes.io/secret/5de233e4-28ee-437b-a4f1-28a1caf84fd5-profile-collector-cert\") pod \"catalog-operator-75ff9f647d-wtb28\" (UID: \"5de233e4-28ee-437b-a4f1-28a1caf84fd5\") " pod="openshift-operator-lifecycle-manager/catalog-operator-75ff9f647d-wtb28" Mar 16 17:33:38 crc kubenswrapper[5120]: I0316 17:33:38.924050 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"srv-cert\" (UniqueName: \"kubernetes.io/secret/5de233e4-28ee-437b-a4f1-28a1caf84fd5-srv-cert\") pod \"catalog-operator-75ff9f647d-wtb28\" (UID: \"5de233e4-28ee-437b-a4f1-28a1caf84fd5\") " pod="openshift-operator-lifecycle-manager/catalog-operator-75ff9f647d-wtb28" Mar 16 17:33:39 crc kubenswrapper[5120]: I0316 17:33:39.027361 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"profile-collector-cert\" (UniqueName: \"kubernetes.io/secret/5de233e4-28ee-437b-a4f1-28a1caf84fd5-profile-collector-cert\") pod \"catalog-operator-75ff9f647d-wtb28\" (UID: \"5de233e4-28ee-437b-a4f1-28a1caf84fd5\") " pod="openshift-operator-lifecycle-manager/catalog-operator-75ff9f647d-wtb28" Mar 16 17:33:39 crc kubenswrapper[5120]: I0316 17:33:39.027528 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"srv-cert\" (UniqueName: \"kubernetes.io/secret/5de233e4-28ee-437b-a4f1-28a1caf84fd5-srv-cert\") pod \"catalog-operator-75ff9f647d-wtb28\" (UID: \"5de233e4-28ee-437b-a4f1-28a1caf84fd5\") " pod="openshift-operator-lifecycle-manager/catalog-operator-75ff9f647d-wtb28" Mar 16 17:33:39 crc kubenswrapper[5120]: I0316 17:33:39.027642 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sc8f2\" (UniqueName: \"kubernetes.io/projected/5de233e4-28ee-437b-a4f1-28a1caf84fd5-kube-api-access-sc8f2\") pod \"catalog-operator-75ff9f647d-wtb28\" (UID: \"5de233e4-28ee-437b-a4f1-28a1caf84fd5\") " pod="openshift-operator-lifecycle-manager/catalog-operator-75ff9f647d-wtb28" Mar 16 17:33:39 crc kubenswrapper[5120]: I0316 17:33:39.027740 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmpfs\" (UniqueName: \"kubernetes.io/empty-dir/5de233e4-28ee-437b-a4f1-28a1caf84fd5-tmpfs\") pod \"catalog-operator-75ff9f647d-wtb28\" (UID: \"5de233e4-28ee-437b-a4f1-28a1caf84fd5\") " pod="openshift-operator-lifecycle-manager/catalog-operator-75ff9f647d-wtb28" Mar 16 17:33:39 crc kubenswrapper[5120]: I0316 17:33:39.028409 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmpfs\" (UniqueName: \"kubernetes.io/empty-dir/5de233e4-28ee-437b-a4f1-28a1caf84fd5-tmpfs\") pod \"catalog-operator-75ff9f647d-wtb28\" (UID: \"5de233e4-28ee-437b-a4f1-28a1caf84fd5\") " pod="openshift-operator-lifecycle-manager/catalog-operator-75ff9f647d-wtb28" Mar 16 17:33:39 crc kubenswrapper[5120]: I0316 17:33:39.038732 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"profile-collector-cert\" (UniqueName: \"kubernetes.io/secret/5de233e4-28ee-437b-a4f1-28a1caf84fd5-profile-collector-cert\") pod \"catalog-operator-75ff9f647d-wtb28\" (UID: \"5de233e4-28ee-437b-a4f1-28a1caf84fd5\") " pod="openshift-operator-lifecycle-manager/catalog-operator-75ff9f647d-wtb28" Mar 16 17:33:39 crc kubenswrapper[5120]: I0316 17:33:39.047309 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"srv-cert\" (UniqueName: \"kubernetes.io/secret/5de233e4-28ee-437b-a4f1-28a1caf84fd5-srv-cert\") pod \"catalog-operator-75ff9f647d-wtb28\" (UID: \"5de233e4-28ee-437b-a4f1-28a1caf84fd5\") " pod="openshift-operator-lifecycle-manager/catalog-operator-75ff9f647d-wtb28" Mar 16 17:33:39 crc kubenswrapper[5120]: I0316 17:33:39.055165 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sc8f2\" (UniqueName: \"kubernetes.io/projected/5de233e4-28ee-437b-a4f1-28a1caf84fd5-kube-api-access-sc8f2\") pod \"catalog-operator-75ff9f647d-wtb28\" (UID: \"5de233e4-28ee-437b-a4f1-28a1caf84fd5\") " pod="openshift-operator-lifecycle-manager/catalog-operator-75ff9f647d-wtb28" Mar 16 17:33:39 crc kubenswrapper[5120]: E0316 17:33:39.143118 5120 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod201aeec6_1404_4b8d_8cf7_4d2550cc9898.slice/crio-9400626ed96f9196ac2177fe5b97b2f99a23d54b8aba032cd07a65b4fa62261b.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4af61d68_498f_4c1a_812d_91089029f784.slice/crio-conmon-4919118b0391f6ba7ac4b1d16b3d5a87d7e6ebefe0bbe46b8922f1b0014f0282.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf62d5d6a_d638_4968_902f_8eb726c039c1.slice/crio-conmon-cb53f78efe333f796357e348cca82be325147af2149d1fc52ec920cb98e13edc.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf62d5d6a_d638_4968_902f_8eb726c039c1.slice/crio-cb53f78efe333f796357e348cca82be325147af2149d1fc52ec920cb98e13edc.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4af61d68_498f_4c1a_812d_91089029f784.slice/crio-4919118b0391f6ba7ac4b1d16b3d5a87d7e6ebefe0bbe46b8922f1b0014f0282.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeed7b084_3ca6_41c0_847f_19929fb52c41.slice/crio-76b28721686f76aade4349039a79bd66bf48c80868031b23a4b84de5420eca6a.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f53cb77_0d21_4cd7_81c0_d003500184f1.slice/crio-conmon-af160f46b56e7465ca7930c0926d2c81d89bc4d73fe0c22293a02940de9f414f.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e6d8ae5_f5be_4b12_8401_54dcc86da579.slice/crio-c9f555dc35319e5a738060a949804e12a57019848919f048fb0a5dd0a7b73fc6.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42478fad_5a61_4cc1_94cc_ac00bdf30f24.slice/crio-conmon-636f4788fa12f348f3f6e38ef9f3f32d17f195054394d6d4eac0b62afd8629f5.scope\": RecentStats: unable to find data in memory cache]" Mar 16 17:33:39 crc kubenswrapper[5120]: I0316 17:33:39.203149 5120 generic.go:358] "Generic (PLEG): container finished" podID="91595c8f-09e8-4cdd-8054-1f46eafa27ad" containerID="c39c9fd812f20b679694300a29617b4f4b1a9a67c1c9ef8f9aff5b2909489a26" exitCode=0 Mar 16 17:33:39 crc kubenswrapper[5120]: I0316 17:33:39.203235 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/openstack-operator-controller-manager-5fbcdbcf94-6sdhq" event={"ID":"91595c8f-09e8-4cdd-8054-1f46eafa27ad","Type":"ContainerDied","Data":"c39c9fd812f20b679694300a29617b4f4b1a9a67c1c9ef8f9aff5b2909489a26"} Mar 16 17:33:39 crc kubenswrapper[5120]: I0316 17:33:39.209401 5120 generic.go:358] "Generic (PLEG): container finished" podID="2fc99f04-8366-4f00-9ce1-d0e4faf1d0a3" containerID="1c41db9773336db87d587462f8cb97f5de96f1b4f579e3d8052b9a13bad57ded" exitCode=0 Mar 16 17:33:39 crc kubenswrapper[5120]: I0316 17:33:39.209742 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/designate-operator-controller-manager-7cf89c67bb-cjd7x" event={"ID":"2fc99f04-8366-4f00-9ce1-d0e4faf1d0a3","Type":"ContainerDied","Data":"1c41db9773336db87d587462f8cb97f5de96f1b4f579e3d8052b9a13bad57ded"} Mar 16 17:33:39 crc kubenswrapper[5120]: I0316 17:33:39.212407 5120 generic.go:358] "Generic (PLEG): container finished" podID="e6b6caa5-b1c3-4ad6-8b0e-0358400bb03b" containerID="163918bdf98d1c1c3ca79246758fb544bcb919c9ecb8c47189928bbe3245b4d6" exitCode=0 Mar 16 17:33:39 crc kubenswrapper[5120]: I0316 17:33:39.212486 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/horizon-operator-controller-manager-5bf9fb4564-qzsbr" event={"ID":"e6b6caa5-b1c3-4ad6-8b0e-0358400bb03b","Type":"ContainerDied","Data":"163918bdf98d1c1c3ca79246758fb544bcb919c9ecb8c47189928bbe3245b4d6"} Mar 16 17:33:39 crc kubenswrapper[5120]: I0316 17:33:39.214359 5120 generic.go:358] "Generic (PLEG): container finished" podID="d2d3e713-eefd-44fd-8784-1f4f54155d8f" containerID="ba2d7e8fb80dd5f1cea3845025bb460e85d914e39fff650768c91d758e0cb42f" exitCode=0 Mar 16 17:33:39 crc kubenswrapper[5120]: I0316 17:33:39.214432 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/rabbitmq-cluster-operator-manager-85d9b55b6-tfl54" event={"ID":"d2d3e713-eefd-44fd-8784-1f4f54155d8f","Type":"ContainerDied","Data":"ba2d7e8fb80dd5f1cea3845025bb460e85d914e39fff650768c91d758e0cb42f"} Mar 16 17:33:39 crc kubenswrapper[5120]: I0316 17:33:39.233257 5120 generic.go:358] "Generic (PLEG): container finished" podID="797f2c96-18c7-400b-a46d-795da852b08e" containerID="2dd1536f1978caea4100bb4567e6b33537548bb68086b77cbfee09af8ba09f6b" exitCode=0 Mar 16 17:33:39 crc kubenswrapper[5120]: I0316 17:33:39.233393 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/infra-operator-controller-manager-76f8b7ddbd-nvwr5" event={"ID":"797f2c96-18c7-400b-a46d-795da852b08e","Type":"ContainerDied","Data":"2dd1536f1978caea4100bb4567e6b33537548bb68086b77cbfee09af8ba09f6b"} Mar 16 17:33:39 crc kubenswrapper[5120]: I0316 17:33:39.261100 5120 generic.go:358] "Generic (PLEG): container finished" podID="127fb533-a6f7-4dc2-85d9-69ec57116fe9" containerID="354866e7009f17f044d6646ccb1748c884509fad24b122da4aef3b09d4134ba1" exitCode=0 Mar 16 17:33:39 crc kubenswrapper[5120]: I0316 17:33:39.261254 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/openstack-operator-index-2h9ct" event={"ID":"127fb533-a6f7-4dc2-85d9-69ec57116fe9","Type":"ContainerDied","Data":"354866e7009f17f044d6646ccb1748c884509fad24b122da4aef3b09d4134ba1"} Mar 16 17:33:39 crc kubenswrapper[5120]: I0316 17:33:39.267375 5120 generic.go:358] "Generic (PLEG): container finished" podID="42478fad-5a61-4cc1-94cc-ac00bdf30f24" containerID="636f4788fa12f348f3f6e38ef9f3f32d17f195054394d6d4eac0b62afd8629f5" exitCode=0 Mar 16 17:33:39 crc kubenswrapper[5120]: I0316 17:33:39.267448 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/ironic-operator-controller-manager-997698bf9-6zvjn" event={"ID":"42478fad-5a61-4cc1-94cc-ac00bdf30f24","Type":"ContainerDied","Data":"636f4788fa12f348f3f6e38ef9f3f32d17f195054394d6d4eac0b62afd8629f5"} Mar 16 17:33:39 crc kubenswrapper[5120]: I0316 17:33:39.276176 5120 generic.go:358] "Generic (PLEG): container finished" podID="e918c50c-96eb-4da3-9b1d-fc31e3582816" containerID="2bea00861ef023a301ed304c08762de77012ab04460a060088be7e7f197b34d7" exitCode=0 Mar 16 17:33:39 crc kubenswrapper[5120]: I0316 17:33:39.276258 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/glance-operator-controller-manager-58d9bbd8cc-vhvn5" event={"ID":"e918c50c-96eb-4da3-9b1d-fc31e3582816","Type":"ContainerDied","Data":"2bea00861ef023a301ed304c08762de77012ab04460a060088be7e7f197b34d7"} Mar 16 17:33:39 crc kubenswrapper[5120]: I0316 17:33:39.287445 5120 generic.go:358] "Generic (PLEG): container finished" podID="78743df2-449e-44ab-91f1-ac48af33b657" containerID="e2579a5f5422a476f71f7cbdd4956f87e25a1665768e12a05d68434c8a974b9f" exitCode=0 Mar 16 17:33:39 crc kubenswrapper[5120]: I0316 17:33:39.287543 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/openstack-operator-controller-init-7b76cc8c59-hmnw9" event={"ID":"78743df2-449e-44ab-91f1-ac48af33b657","Type":"ContainerDied","Data":"e2579a5f5422a476f71f7cbdd4956f87e25a1665768e12a05d68434c8a974b9f"} Mar 16 17:33:39 crc kubenswrapper[5120]: I0316 17:33:39.289260 5120 generic.go:358] "Generic (PLEG): container finished" podID="66faede0-c074-49ca-8bf9-9b5777b02edf" containerID="3d5c918342f57ab22227d88adb1cfa9c0d01d92b66766ac6cdb7212a18358892" exitCode=0 Mar 16 17:33:39 crc kubenswrapper[5120]: I0316 17:33:39.289340 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/nova-operator-controller-manager-785d77464d-j7x9r" event={"ID":"66faede0-c074-49ca-8bf9-9b5777b02edf","Type":"ContainerDied","Data":"3d5c918342f57ab22227d88adb1cfa9c0d01d92b66766ac6cdb7212a18358892"} Mar 16 17:33:39 crc kubenswrapper[5120]: I0316 17:33:39.290717 5120 generic.go:358] "Generic (PLEG): container finished" podID="7f53cb77-0d21-4cd7-81c0-d003500184f1" containerID="af160f46b56e7465ca7930c0926d2c81d89bc4d73fe0c22293a02940de9f414f" exitCode=0 Mar 16 17:33:39 crc kubenswrapper[5120]: I0316 17:33:39.290911 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/catalog-operator-75ff9f647d-x5d5w" event={"ID":"7f53cb77-0d21-4cd7-81c0-d003500184f1","Type":"ContainerDied","Data":"af160f46b56e7465ca7930c0926d2c81d89bc4d73fe0c22293a02940de9f414f"} Mar 16 17:33:39 crc kubenswrapper[5120]: I0316 17:33:39.293379 5120 generic.go:358] "Generic (PLEG): container finished" podID="3b105271-39d9-4339-a315-3aa161a54b31" containerID="3da52e15c02df0a82c598ff490b54b787b7fe711f2a17e60e6ee0f883e895fa1" exitCode=0 Mar 16 17:33:39 crc kubenswrapper[5120]: I0316 17:33:39.293547 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/placement-operator-controller-manager-57fdd4b4cf-v5f9b" event={"ID":"3b105271-39d9-4339-a315-3aa161a54b31","Type":"ContainerDied","Data":"3da52e15c02df0a82c598ff490b54b787b7fe711f2a17e60e6ee0f883e895fa1"} Mar 16 17:33:39 crc kubenswrapper[5120]: I0316 17:33:39.298624 5120 generic.go:358] "Generic (PLEG): container finished" podID="ed2165fd-95f2-40f7-a860-70b81d6ab977" containerID="5e696788c3a844d4ec752d5af523e578b1132a27c237c44a42ed0f439f974a09" exitCode=0 Mar 16 17:33:39 crc kubenswrapper[5120]: I0316 17:33:39.298688 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/cinder-operator-controller-manager-55bc8cdcc4-sbtk9" event={"ID":"ed2165fd-95f2-40f7-a860-70b81d6ab977","Type":"ContainerDied","Data":"5e696788c3a844d4ec752d5af523e578b1132a27c237c44a42ed0f439f974a09"} Mar 16 17:33:39 crc kubenswrapper[5120]: I0316 17:33:39.300282 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/openstack-baremetal-operator-controller-manager-6b6ddbc599g848w" event={"ID":"8643ed10-e4fd-4b97-ae36-c4b581cdef1b","Type":"ContainerDied","Data":"2815432f0b822e87afdfa332f825a21eff527b5290ed2f089d9cf540302312bc"} Mar 16 17:33:39 crc kubenswrapper[5120]: I0316 17:33:39.300308 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2815432f0b822e87afdfa332f825a21eff527b5290ed2f089d9cf540302312bc" Mar 16 17:33:39 crc kubenswrapper[5120]: I0316 17:33:39.301839 5120 generic.go:358] "Generic (PLEG): container finished" podID="4af61d68-498f-4c1a-812d-91089029f784" containerID="4919118b0391f6ba7ac4b1d16b3d5a87d7e6ebefe0bbe46b8922f1b0014f0282" exitCode=0 Mar 16 17:33:39 crc kubenswrapper[5120]: I0316 17:33:39.301884 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/watcher-operator-controller-manager-65d578856c-7khnv" event={"ID":"4af61d68-498f-4c1a-812d-91089029f784","Type":"ContainerDied","Data":"4919118b0391f6ba7ac4b1d16b3d5a87d7e6ebefe0bbe46b8922f1b0014f0282"} Mar 16 17:33:39 crc kubenswrapper[5120]: I0316 17:33:39.303054 5120 generic.go:358] "Generic (PLEG): container finished" podID="8e6d8ae5-f5be-4b12-8401-54dcc86da579" containerID="c9f555dc35319e5a738060a949804e12a57019848919f048fb0a5dd0a7b73fc6" exitCode=0 Mar 16 17:33:39 crc kubenswrapper[5120]: I0316 17:33:39.303098 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/ovn-operator-controller-manager-6fb6cd45c4-ln28h" event={"ID":"8e6d8ae5-f5be-4b12-8401-54dcc86da579","Type":"ContainerDied","Data":"c9f555dc35319e5a738060a949804e12a57019848919f048fb0a5dd0a7b73fc6"} Mar 16 17:33:39 crc kubenswrapper[5120]: I0316 17:33:39.304273 5120 generic.go:358] "Generic (PLEG): container finished" podID="4752ce4e-0b7c-43d7-99dc-b8633f7a2cd7" containerID="cd5dbf07e769c93af8e2f9b7a8af06cf9287e9e82f2b76fb7904536eefed6823" exitCode=0 Mar 16 17:33:39 crc kubenswrapper[5120]: I0316 17:33:39.304314 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/heat-operator-controller-manager-79975d4c95-n2zm7" event={"ID":"4752ce4e-0b7c-43d7-99dc-b8633f7a2cd7","Type":"ContainerDied","Data":"cd5dbf07e769c93af8e2f9b7a8af06cf9287e9e82f2b76fb7904536eefed6823"} Mar 16 17:33:39 crc kubenswrapper[5120]: I0316 17:33:39.305667 5120 generic.go:358] "Generic (PLEG): container finished" podID="f5403564-ecbf-4103-89b6-530a8381c664" containerID="74b759d17c7d6bc10253b03d120e87e3c039046a6d9f3afc93394d3573e3b4bb" exitCode=0 Mar 16 17:33:39 crc kubenswrapper[5120]: I0316 17:33:39.305819 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/keystone-operator-controller-manager-6f5b9fd59-rhjb2" event={"ID":"f5403564-ecbf-4103-89b6-530a8381c664","Type":"ContainerDied","Data":"74b759d17c7d6bc10253b03d120e87e3c039046a6d9f3afc93394d3573e3b4bb"} Mar 16 17:33:39 crc kubenswrapper[5120]: I0316 17:33:39.307379 5120 generic.go:358] "Generic (PLEG): container finished" podID="e46d1032-1fff-4f99-baa0-487aee0eb1bd" containerID="4bb0ceb90fb71a7a432b2d87618203e4ea86bcff6d9cef86f4573b133139af02" exitCode=0 Mar 16 17:33:39 crc kubenswrapper[5120]: I0316 17:33:39.307515 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/swift-operator-controller-manager-5d89b4d5d5-9zvm4" event={"ID":"e46d1032-1fff-4f99-baa0-487aee0eb1bd","Type":"ContainerDied","Data":"4bb0ceb90fb71a7a432b2d87618203e4ea86bcff6d9cef86f4573b133139af02"} Mar 16 17:33:39 crc kubenswrapper[5120]: I0316 17:33:39.308874 5120 generic.go:358] "Generic (PLEG): container finished" podID="ef52f45c-ba73-4607-8b03-f13fce9806bd" containerID="8a7d9c15b46652c24e31619db72ffcdd6edc32a99198a149ff7e231290a729b8" exitCode=0 Mar 16 17:33:39 crc kubenswrapper[5120]: I0316 17:33:39.308947 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/test-operator-controller-manager-74d567479f-cbkr4" event={"ID":"ef52f45c-ba73-4607-8b03-f13fce9806bd","Type":"ContainerDied","Data":"8a7d9c15b46652c24e31619db72ffcdd6edc32a99198a149ff7e231290a729b8"} Mar 16 17:33:39 crc kubenswrapper[5120]: I0316 17:33:39.312972 5120 generic.go:358] "Generic (PLEG): container finished" podID="32fa740c-28b3-42a7-8ab5-6d159c237bf8" containerID="8187984f8e77140a5f3d80b9a1039d239792a6246d38550200214f8daab0f7ca" exitCode=0 Mar 16 17:33:39 crc kubenswrapper[5120]: I0316 17:33:39.313049 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/neutron-operator-controller-manager-75c6f4bc76-mbnvj" event={"ID":"32fa740c-28b3-42a7-8ab5-6d159c237bf8","Type":"ContainerDied","Data":"8187984f8e77140a5f3d80b9a1039d239792a6246d38550200214f8daab0f7ca"} Mar 16 17:33:39 crc kubenswrapper[5120]: I0316 17:33:39.314422 5120 generic.go:358] "Generic (PLEG): container finished" podID="eed7b084-3ca6-41c0-847f-19929fb52c41" containerID="76b28721686f76aade4349039a79bd66bf48c80868031b23a4b84de5420eca6a" exitCode=0 Mar 16 17:33:39 crc kubenswrapper[5120]: I0316 17:33:39.314496 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/manila-operator-controller-manager-7d6d87b867-xkrnl" event={"ID":"eed7b084-3ca6-41c0-847f-19929fb52c41","Type":"ContainerDied","Data":"76b28721686f76aade4349039a79bd66bf48c80868031b23a4b84de5420eca6a"} Mar 16 17:33:39 crc kubenswrapper[5120]: I0316 17:33:39.315712 5120 generic.go:358] "Generic (PLEG): container finished" podID="8a11dd5a-29d6-4791-849c-97b08acb5b4e" containerID="1de87f8609842e9f047525b572c69ce524ffb562d47c0be7de1674db25e09051" exitCode=0 Mar 16 17:33:39 crc kubenswrapper[5120]: I0316 17:33:39.315828 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/mariadb-operator-controller-manager-5748db694b-nk2nc" event={"ID":"8a11dd5a-29d6-4791-849c-97b08acb5b4e","Type":"ContainerDied","Data":"1de87f8609842e9f047525b572c69ce524ffb562d47c0be7de1674db25e09051"} Mar 16 17:33:39 crc kubenswrapper[5120]: I0316 17:33:39.318333 5120 generic.go:358] "Generic (PLEG): container finished" podID="201aeec6-1404-4b8d-8cf7-4d2550cc9898" containerID="9400626ed96f9196ac2177fe5b97b2f99a23d54b8aba032cd07a65b4fa62261b" exitCode=0 Mar 16 17:33:39 crc kubenswrapper[5120]: I0316 17:33:39.318392 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/telemetry-operator-controller-manager-f5cf7fcb7-cmrwq" event={"ID":"201aeec6-1404-4b8d-8cf7-4d2550cc9898","Type":"ContainerDied","Data":"9400626ed96f9196ac2177fe5b97b2f99a23d54b8aba032cd07a65b4fa62261b"} Mar 16 17:33:39 crc kubenswrapper[5120]: I0316 17:33:39.322462 5120 generic.go:358] "Generic (PLEG): container finished" podID="bbc9f690-e60b-4c8a-b84a-2d8a3ca2001f" containerID="4dcde05605706042f7e10545568428ec80e8abcb93a4246f1298c6443f160ec6" exitCode=0 Mar 16 17:33:39 crc kubenswrapper[5120]: I0316 17:33:39.322665 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/octavia-operator-controller-manager-7b89675745-5vg74" event={"ID":"bbc9f690-e60b-4c8a-b84a-2d8a3ca2001f","Type":"ContainerDied","Data":"4dcde05605706042f7e10545568428ec80e8abcb93a4246f1298c6443f160ec6"} Mar 16 17:33:39 crc kubenswrapper[5120]: I0316 17:33:39.325856 5120 generic.go:358] "Generic (PLEG): container finished" podID="f62d5d6a-d638-4968-902f-8eb726c039c1" containerID="cb53f78efe333f796357e348cca82be325147af2149d1fc52ec920cb98e13edc" exitCode=0 Mar 16 17:33:39 crc kubenswrapper[5120]: I0316 17:33:39.326068 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/barbican-operator-controller-manager-848cfb5779-68smv" event={"ID":"f62d5d6a-d638-4968-902f-8eb726c039c1","Type":"ContainerDied","Data":"cb53f78efe333f796357e348cca82be325147af2149d1fc52ec920cb98e13edc"} Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.335392 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/swift-operator-controller-manager-5d89b4d5d5-9zvm4" event={"ID":"e46d1032-1fff-4f99-baa0-487aee0eb1bd","Type":"ContainerDied","Data":"0d760b2b65c23df04b67266bafde4c6fe1cedb49a76ccedf6fed08ae1beddee5"} Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.335433 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0d760b2b65c23df04b67266bafde4c6fe1cedb49a76ccedf6fed08ae1beddee5" Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.338429 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/test-operator-controller-manager-74d567479f-cbkr4" event={"ID":"ef52f45c-ba73-4607-8b03-f13fce9806bd","Type":"ContainerDied","Data":"7eb9ccba69cf3dc32a377e309ea490bb46cad62e4d3a52460f3bd5b47d5c9eb2"} Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.338467 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7eb9ccba69cf3dc32a377e309ea490bb46cad62e4d3a52460f3bd5b47d5c9eb2" Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.340161 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/neutron-operator-controller-manager-75c6f4bc76-mbnvj" event={"ID":"32fa740c-28b3-42a7-8ab5-6d159c237bf8","Type":"ContainerDied","Data":"d5a3de0ce2103896651c778fde51206149a1bb9af78ce2c45706df5784e980e5"} Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.340212 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d5a3de0ce2103896651c778fde51206149a1bb9af78ce2c45706df5784e980e5" Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.341553 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/manila-operator-controller-manager-7d6d87b867-xkrnl" event={"ID":"eed7b084-3ca6-41c0-847f-19929fb52c41","Type":"ContainerDied","Data":"9fd4e81cb0f9c38cb33b3f2e4b7678f945fae53b7bc009c56ac74dc4b4e8f52c"} Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.341577 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9fd4e81cb0f9c38cb33b3f2e4b7678f945fae53b7bc009c56ac74dc4b4e8f52c" Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.343962 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/mariadb-operator-controller-manager-5748db694b-nk2nc" event={"ID":"8a11dd5a-29d6-4791-849c-97b08acb5b4e","Type":"ContainerDied","Data":"2454e6b8acfc7b9ad975c65192640929a5bc95fc0db435db64262f23e2fa54a5"} Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.343995 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2454e6b8acfc7b9ad975c65192640929a5bc95fc0db435db64262f23e2fa54a5" Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.345468 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/telemetry-operator-controller-manager-f5cf7fcb7-cmrwq" event={"ID":"201aeec6-1404-4b8d-8cf7-4d2550cc9898","Type":"ContainerDied","Data":"ce80cbc9343ba751c736405a94a36293106ae3b35b4508daa447d140f9a64302"} Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.345492 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ce80cbc9343ba751c736405a94a36293106ae3b35b4508daa447d140f9a64302" Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.346785 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/octavia-operator-controller-manager-7b89675745-5vg74" event={"ID":"bbc9f690-e60b-4c8a-b84a-2d8a3ca2001f","Type":"ContainerDied","Data":"02484f610112a0728af17724d02530d79267237bccb0649395aabae0858e39c3"} Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.346812 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="02484f610112a0728af17724d02530d79267237bccb0649395aabae0858e39c3" Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.348221 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/barbican-operator-controller-manager-848cfb5779-68smv" event={"ID":"f62d5d6a-d638-4968-902f-8eb726c039c1","Type":"ContainerDied","Data":"522c446690fd42ec82c1ca2942d82d990c4b0391447951f5c911037075bdbd03"} Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.348246 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="522c446690fd42ec82c1ca2942d82d990c4b0391447951f5c911037075bdbd03" Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.349562 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/openstack-operator-controller-manager-5fbcdbcf94-6sdhq" event={"ID":"91595c8f-09e8-4cdd-8054-1f46eafa27ad","Type":"ContainerDied","Data":"2beeb9b3dcf6824db4b6a6f45dbeae34b2a92712bfcb8b97843444e8f6b02c65"} Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.349581 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2beeb9b3dcf6824db4b6a6f45dbeae34b2a92712bfcb8b97843444e8f6b02c65" Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.350998 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/designate-operator-controller-manager-7cf89c67bb-cjd7x" event={"ID":"2fc99f04-8366-4f00-9ce1-d0e4faf1d0a3","Type":"ContainerDied","Data":"dcb50bfe2d0388f0111daeb30e2e78bfd90f9a2eec21d8e408012ff507eb2aa5"} Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.351019 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dcb50bfe2d0388f0111daeb30e2e78bfd90f9a2eec21d8e408012ff507eb2aa5" Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.352402 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/horizon-operator-controller-manager-5bf9fb4564-qzsbr" event={"ID":"e6b6caa5-b1c3-4ad6-8b0e-0358400bb03b","Type":"ContainerDied","Data":"681045361cf2bd7776417547f46c5f5295f10747e02d69d32618c7cea73269e9"} Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.352424 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="681045361cf2bd7776417547f46c5f5295f10747e02d69d32618c7cea73269e9" Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.353958 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/rabbitmq-cluster-operator-manager-85d9b55b6-tfl54" event={"ID":"d2d3e713-eefd-44fd-8784-1f4f54155d8f","Type":"ContainerDied","Data":"73deefd200ddec3b0dc5bfcb298d2fd1754d8338fd22adb946b46760d44eb2bf"} Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.353981 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="73deefd200ddec3b0dc5bfcb298d2fd1754d8338fd22adb946b46760d44eb2bf" Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.355580 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/infra-operator-controller-manager-76f8b7ddbd-nvwr5" event={"ID":"797f2c96-18c7-400b-a46d-795da852b08e","Type":"ContainerDied","Data":"eaee89cd90f5cc97e0e0d9cd0209e20337d8b08c1fbfb8cba737180bd1e95f71"} Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.355613 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="eaee89cd90f5cc97e0e0d9cd0209e20337d8b08c1fbfb8cba737180bd1e95f71" Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.357473 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/openstack-operator-index-2h9ct" event={"ID":"127fb533-a6f7-4dc2-85d9-69ec57116fe9","Type":"ContainerDied","Data":"dcba91ad39b6dfd662ae03a856088f8f5420d024f50f3640b70fc37496f3d1cd"} Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.357501 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dcba91ad39b6dfd662ae03a856088f8f5420d024f50f3640b70fc37496f3d1cd" Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.359367 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/ironic-operator-controller-manager-997698bf9-6zvjn" event={"ID":"42478fad-5a61-4cc1-94cc-ac00bdf30f24","Type":"ContainerDied","Data":"545c25b4bd71069314f7c505f3b97b07e5fb19339460a2edd1f8c97143cc0e39"} Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.359391 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="545c25b4bd71069314f7c505f3b97b07e5fb19339460a2edd1f8c97143cc0e39" Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.360798 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/glance-operator-controller-manager-58d9bbd8cc-vhvn5" event={"ID":"e918c50c-96eb-4da3-9b1d-fc31e3582816","Type":"ContainerDied","Data":"44a430d5312f4f57dd649d4462be3d3fee00a98efe90aa7767592c017e596086"} Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.360838 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="44a430d5312f4f57dd649d4462be3d3fee00a98efe90aa7767592c017e596086" Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.361984 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/openstack-operator-controller-init-7b76cc8c59-hmnw9" event={"ID":"78743df2-449e-44ab-91f1-ac48af33b657","Type":"ContainerDied","Data":"9edbd09f095ddf07c1f52982d24af7fc6c53f533aa861533061cb4e92ad5ee14"} Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.362004 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9edbd09f095ddf07c1f52982d24af7fc6c53f533aa861533061cb4e92ad5ee14" Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.363193 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/nova-operator-controller-manager-785d77464d-j7x9r" event={"ID":"66faede0-c074-49ca-8bf9-9b5777b02edf","Type":"ContainerDied","Data":"fdd83c623323d47d6c12084e96b5399673c400dd89d5e5f9462d315d12e68de5"} Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.363210 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fdd83c623323d47d6c12084e96b5399673c400dd89d5e5f9462d315d12e68de5" Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.364298 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/catalog-operator-75ff9f647d-x5d5w" event={"ID":"7f53cb77-0d21-4cd7-81c0-d003500184f1","Type":"ContainerDied","Data":"da11350f6070a39444a8c122a21b4dbc810e4f7706575e065d133c1eb9083bde"} Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.364318 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="da11350f6070a39444a8c122a21b4dbc810e4f7706575e065d133c1eb9083bde" Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.365567 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/placement-operator-controller-manager-57fdd4b4cf-v5f9b" event={"ID":"3b105271-39d9-4339-a315-3aa161a54b31","Type":"ContainerDied","Data":"8edf5b4a743a276bed8bf2749cc12c9ab11438630047bceca05dc5c4bd78adb2"} Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.365588 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8edf5b4a743a276bed8bf2749cc12c9ab11438630047bceca05dc5c4bd78adb2" Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.369402 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/cinder-operator-controller-manager-55bc8cdcc4-sbtk9" event={"ID":"ed2165fd-95f2-40f7-a860-70b81d6ab977","Type":"ContainerDied","Data":"cbd4bf9f0cccc3aecc250d1354d4c968f4f001fd9909303867737ec83c096096"} Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.369450 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cbd4bf9f0cccc3aecc250d1354d4c968f4f001fd9909303867737ec83c096096" Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.370901 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/watcher-operator-controller-manager-65d578856c-7khnv" event={"ID":"4af61d68-498f-4c1a-812d-91089029f784","Type":"ContainerDied","Data":"817c663018600ca8c6faf5d2c26fcef8a76bf369884318e57f65aee17ee9504c"} Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.370953 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="817c663018600ca8c6faf5d2c26fcef8a76bf369884318e57f65aee17ee9504c" Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.372589 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/ovn-operator-controller-manager-6fb6cd45c4-ln28h" event={"ID":"8e6d8ae5-f5be-4b12-8401-54dcc86da579","Type":"ContainerDied","Data":"56599aa87b3a9bc6916c774c8b5f27046fdc5e9f4783776b7ad3c54a151544d7"} Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.372623 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="56599aa87b3a9bc6916c774c8b5f27046fdc5e9f4783776b7ad3c54a151544d7" Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.374038 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/heat-operator-controller-manager-79975d4c95-n2zm7" event={"ID":"4752ce4e-0b7c-43d7-99dc-b8633f7a2cd7","Type":"ContainerDied","Data":"bf2ee9740d6b929f56124ffc33b886b74d45f262be402b3a97e3f8b00857b5d3"} Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.374077 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bf2ee9740d6b929f56124ffc33b886b74d45f262be402b3a97e3f8b00857b5d3" Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.374187 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/openstack-baremetal-operator-controller-manager-6b6ddbc599g848w" Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.375430 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/keystone-operator-controller-manager-6f5b9fd59-rhjb2" event={"ID":"f5403564-ecbf-4103-89b6-530a8381c664","Type":"ContainerDied","Data":"52dde25e8f39d2053edceb14a9f064c45f15efded30e00f99cc0fc07aad7bd95"} Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.375451 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="52dde25e8f39d2053edceb14a9f064c45f15efded30e00f99cc0fc07aad7bd95" Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.375859 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/catalog-operator-75ff9f647d-wtb28" Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.384743 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/designate-operator-controller-manager-7cf89c67bb-cjd7x" Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.392880 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/horizon-operator-controller-manager-5bf9fb4564-qzsbr" Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.471615 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r5n68\" (UniqueName: \"kubernetes.io/projected/2fc99f04-8366-4f00-9ce1-d0e4faf1d0a3-kube-api-access-r5n68\") pod \"2fc99f04-8366-4f00-9ce1-d0e4faf1d0a3\" (UID: \"2fc99f04-8366-4f00-9ce1-d0e4faf1d0a3\") " Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.471793 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-99snw\" (UniqueName: \"kubernetes.io/projected/8643ed10-e4fd-4b97-ae36-c4b581cdef1b-kube-api-access-99snw\") pod \"8643ed10-e4fd-4b97-ae36-c4b581cdef1b\" (UID: \"8643ed10-e4fd-4b97-ae36-c4b581cdef1b\") " Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.471841 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8643ed10-e4fd-4b97-ae36-c4b581cdef1b-cert\") pod \"8643ed10-e4fd-4b97-ae36-c4b581cdef1b\" (UID: \"8643ed10-e4fd-4b97-ae36-c4b581cdef1b\") " Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.473420 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/rabbitmq-cluster-operator-manager-85d9b55b6-tfl54" Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.478794 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2fc99f04-8366-4f00-9ce1-d0e4faf1d0a3-kube-api-access-r5n68" (OuterVolumeSpecName: "kube-api-access-r5n68") pod "2fc99f04-8366-4f00-9ce1-d0e4faf1d0a3" (UID: "2fc99f04-8366-4f00-9ce1-d0e4faf1d0a3"). InnerVolumeSpecName "kube-api-access-r5n68". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.486416 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8643ed10-e4fd-4b97-ae36-c4b581cdef1b-kube-api-access-99snw" (OuterVolumeSpecName: "kube-api-access-99snw") pod "8643ed10-e4fd-4b97-ae36-c4b581cdef1b" (UID: "8643ed10-e4fd-4b97-ae36-c4b581cdef1b"). InnerVolumeSpecName "kube-api-access-99snw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.488093 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/placement-operator-controller-manager-57fdd4b4cf-v5f9b" Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.488421 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8643ed10-e4fd-4b97-ae36-c4b581cdef1b-cert" (OuterVolumeSpecName: "cert") pod "8643ed10-e4fd-4b97-ae36-c4b581cdef1b" (UID: "8643ed10-e4fd-4b97-ae36-c4b581cdef1b"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.549260 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/swift-operator-controller-manager-5d89b4d5d5-9zvm4" Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.567392 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/nova-operator-controller-manager-785d77464d-j7x9r" Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.568427 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/heat-operator-controller-manager-79975d4c95-n2zm7" Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.573591 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lt64k\" (UniqueName: \"kubernetes.io/projected/3b105271-39d9-4339-a315-3aa161a54b31-kube-api-access-lt64k\") pod \"3b105271-39d9-4339-a315-3aa161a54b31\" (UID: \"3b105271-39d9-4339-a315-3aa161a54b31\") " Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.573750 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n7w8n\" (UniqueName: \"kubernetes.io/projected/d2d3e713-eefd-44fd-8784-1f4f54155d8f-kube-api-access-n7w8n\") pod \"d2d3e713-eefd-44fd-8784-1f4f54155d8f\" (UID: \"d2d3e713-eefd-44fd-8784-1f4f54155d8f\") " Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.573870 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8km49\" (UniqueName: \"kubernetes.io/projected/e6b6caa5-b1c3-4ad6-8b0e-0358400bb03b-kube-api-access-8km49\") pod \"e6b6caa5-b1c3-4ad6-8b0e-0358400bb03b\" (UID: \"e6b6caa5-b1c3-4ad6-8b0e-0358400bb03b\") " Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.575148 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r5n68\" (UniqueName: \"kubernetes.io/projected/2fc99f04-8366-4f00-9ce1-d0e4faf1d0a3-kube-api-access-r5n68\") on node \"crc\" DevicePath \"\"" Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.575166 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-99snw\" (UniqueName: \"kubernetes.io/projected/8643ed10-e4fd-4b97-ae36-c4b581cdef1b-kube-api-access-99snw\") on node \"crc\" DevicePath \"\"" Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.575202 5120 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8643ed10-e4fd-4b97-ae36-c4b581cdef1b-cert\") on node \"crc\" DevicePath \"\"" Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.576134 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/keystone-operator-controller-manager-6f5b9fd59-rhjb2" Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.578488 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2d3e713-eefd-44fd-8784-1f4f54155d8f-kube-api-access-n7w8n" (OuterVolumeSpecName: "kube-api-access-n7w8n") pod "d2d3e713-eefd-44fd-8784-1f4f54155d8f" (UID: "d2d3e713-eefd-44fd-8784-1f4f54155d8f"). InnerVolumeSpecName "kube-api-access-n7w8n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.578577 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6b6caa5-b1c3-4ad6-8b0e-0358400bb03b-kube-api-access-8km49" (OuterVolumeSpecName: "kube-api-access-8km49") pod "e6b6caa5-b1c3-4ad6-8b0e-0358400bb03b" (UID: "e6b6caa5-b1c3-4ad6-8b0e-0358400bb03b"). InnerVolumeSpecName "kube-api-access-8km49". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.583383 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b105271-39d9-4339-a315-3aa161a54b31-kube-api-access-lt64k" (OuterVolumeSpecName: "kube-api-access-lt64k") pod "3b105271-39d9-4339-a315-3aa161a54b31" (UID: "3b105271-39d9-4339-a315-3aa161a54b31"). InnerVolumeSpecName "kube-api-access-lt64k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.587199 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/glance-operator-controller-manager-58d9bbd8cc-vhvn5" Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.591706 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/octavia-operator-controller-manager-7b89675745-5vg74" Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.603328 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/watcher-operator-controller-manager-65d578856c-7khnv" Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.603748 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/test-operator-controller-manager-74d567479f-cbkr4" Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.610100 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/ovn-operator-controller-manager-6fb6cd45c4-ln28h" Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.619418 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/ironic-operator-controller-manager-997698bf9-6zvjn" Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.627350 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/telemetry-operator-controller-manager-f5cf7fcb7-cmrwq" Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.637859 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/openstack-operator-controller-manager-5fbcdbcf94-6sdhq" Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.650145 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/barbican-operator-controller-manager-848cfb5779-68smv" Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.656661 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/infra-operator-controller-manager-76f8b7ddbd-nvwr5" Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.666525 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/neutron-operator-controller-manager-75c6f4bc76-mbnvj" Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.679551 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cdhx5\" (UniqueName: \"kubernetes.io/projected/4752ce4e-0b7c-43d7-99dc-b8633f7a2cd7-kube-api-access-cdhx5\") pod \"4752ce4e-0b7c-43d7-99dc-b8633f7a2cd7\" (UID: \"4752ce4e-0b7c-43d7-99dc-b8633f7a2cd7\") " Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.679693 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-56pwc\" (UniqueName: \"kubernetes.io/projected/e918c50c-96eb-4da3-9b1d-fc31e3582816-kube-api-access-56pwc\") pod \"e918c50c-96eb-4da3-9b1d-fc31e3582816\" (UID: \"e918c50c-96eb-4da3-9b1d-fc31e3582816\") " Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.679884 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4rn2d\" (UniqueName: \"kubernetes.io/projected/66faede0-c074-49ca-8bf9-9b5777b02edf-kube-api-access-4rn2d\") pod \"66faede0-c074-49ca-8bf9-9b5777b02edf\" (UID: \"66faede0-c074-49ca-8bf9-9b5777b02edf\") " Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.680162 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cs5gv\" (UniqueName: \"kubernetes.io/projected/f5403564-ecbf-4103-89b6-530a8381c664-kube-api-access-cs5gv\") pod \"f5403564-ecbf-4103-89b6-530a8381c664\" (UID: \"f5403564-ecbf-4103-89b6-530a8381c664\") " Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.680411 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-smqps\" (UniqueName: \"kubernetes.io/projected/bbc9f690-e60b-4c8a-b84a-2d8a3ca2001f-kube-api-access-smqps\") pod \"bbc9f690-e60b-4c8a-b84a-2d8a3ca2001f\" (UID: \"bbc9f690-e60b-4c8a-b84a-2d8a3ca2001f\") " Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.680470 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8jck5\" (UniqueName: \"kubernetes.io/projected/e46d1032-1fff-4f99-baa0-487aee0eb1bd-kube-api-access-8jck5\") pod \"e46d1032-1fff-4f99-baa0-487aee0eb1bd\" (UID: \"e46d1032-1fff-4f99-baa0-487aee0eb1bd\") " Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.685097 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4752ce4e-0b7c-43d7-99dc-b8633f7a2cd7-kube-api-access-cdhx5" (OuterVolumeSpecName: "kube-api-access-cdhx5") pod "4752ce4e-0b7c-43d7-99dc-b8633f7a2cd7" (UID: "4752ce4e-0b7c-43d7-99dc-b8633f7a2cd7"). InnerVolumeSpecName "kube-api-access-cdhx5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.685889 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e918c50c-96eb-4da3-9b1d-fc31e3582816-kube-api-access-56pwc" (OuterVolumeSpecName: "kube-api-access-56pwc") pod "e918c50c-96eb-4da3-9b1d-fc31e3582816" (UID: "e918c50c-96eb-4da3-9b1d-fc31e3582816"). InnerVolumeSpecName "kube-api-access-56pwc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.687542 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/catalog-operator-75ff9f647d-x5d5w" Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.687798 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cdhx5\" (UniqueName: \"kubernetes.io/projected/4752ce4e-0b7c-43d7-99dc-b8633f7a2cd7-kube-api-access-cdhx5\") on node \"crc\" DevicePath \"\"" Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.687829 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-56pwc\" (UniqueName: \"kubernetes.io/projected/e918c50c-96eb-4da3-9b1d-fc31e3582816-kube-api-access-56pwc\") on node \"crc\" DevicePath \"\"" Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.687840 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lt64k\" (UniqueName: \"kubernetes.io/projected/3b105271-39d9-4339-a315-3aa161a54b31-kube-api-access-lt64k\") on node \"crc\" DevicePath \"\"" Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.687874 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n7w8n\" (UniqueName: \"kubernetes.io/projected/d2d3e713-eefd-44fd-8784-1f4f54155d8f-kube-api-access-n7w8n\") on node \"crc\" DevicePath \"\"" Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.687888 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8km49\" (UniqueName: \"kubernetes.io/projected/e6b6caa5-b1c3-4ad6-8b0e-0358400bb03b-kube-api-access-8km49\") on node \"crc\" DevicePath \"\"" Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.688704 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66faede0-c074-49ca-8bf9-9b5777b02edf-kube-api-access-4rn2d" (OuterVolumeSpecName: "kube-api-access-4rn2d") pod "66faede0-c074-49ca-8bf9-9b5777b02edf" (UID: "66faede0-c074-49ca-8bf9-9b5777b02edf"). InnerVolumeSpecName "kube-api-access-4rn2d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.689086 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bbc9f690-e60b-4c8a-b84a-2d8a3ca2001f-kube-api-access-smqps" (OuterVolumeSpecName: "kube-api-access-smqps") pod "bbc9f690-e60b-4c8a-b84a-2d8a3ca2001f" (UID: "bbc9f690-e60b-4c8a-b84a-2d8a3ca2001f"). InnerVolumeSpecName "kube-api-access-smqps". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.690465 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e46d1032-1fff-4f99-baa0-487aee0eb1bd-kube-api-access-8jck5" (OuterVolumeSpecName: "kube-api-access-8jck5") pod "e46d1032-1fff-4f99-baa0-487aee0eb1bd" (UID: "e46d1032-1fff-4f99-baa0-487aee0eb1bd"). InnerVolumeSpecName "kube-api-access-8jck5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.693538 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/openstack-operator-controller-init-7b76cc8c59-hmnw9" Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.704949 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/cinder-operator-controller-manager-55bc8cdcc4-sbtk9" Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.715850 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f2af4f6b-db98-46dc-9c06-b98d428f8634" path="/var/lib/kubelet/pods/f2af4f6b-db98-46dc-9c06-b98d428f8634/volumes" Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.716222 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5403564-ecbf-4103-89b6-530a8381c664-kube-api-access-cs5gv" (OuterVolumeSpecName: "kube-api-access-cs5gv") pod "f5403564-ecbf-4103-89b6-530a8381c664" (UID: "f5403564-ecbf-4103-89b6-530a8381c664"). InnerVolumeSpecName "kube-api-access-cs5gv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.750914 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/mariadb-operator-controller-manager-5748db694b-nk2nc" Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.758158 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/openstack-operator-index-2h9ct" Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.788547 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ns6ts\" (UniqueName: \"kubernetes.io/projected/78743df2-449e-44ab-91f1-ac48af33b657-kube-api-access-ns6ts\") pod \"78743df2-449e-44ab-91f1-ac48af33b657\" (UID: \"78743df2-449e-44ab-91f1-ac48af33b657\") " Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.788778 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s4b4v\" (UniqueName: \"kubernetes.io/projected/91595c8f-09e8-4cdd-8054-1f46eafa27ad-kube-api-access-s4b4v\") pod \"91595c8f-09e8-4cdd-8054-1f46eafa27ad\" (UID: \"91595c8f-09e8-4cdd-8054-1f46eafa27ad\") " Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.788872 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kjp8x\" (UniqueName: \"kubernetes.io/projected/4af61d68-498f-4c1a-812d-91089029f784-kube-api-access-kjp8x\") pod \"4af61d68-498f-4c1a-812d-91089029f784\" (UID: \"4af61d68-498f-4c1a-812d-91089029f784\") " Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.788945 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-89688\" (UniqueName: \"kubernetes.io/projected/7f53cb77-0d21-4cd7-81c0-d003500184f1-kube-api-access-89688\") pod \"7f53cb77-0d21-4cd7-81c0-d003500184f1\" (UID: \"7f53cb77-0d21-4cd7-81c0-d003500184f1\") " Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.788996 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/797f2c96-18c7-400b-a46d-795da852b08e-cert\") pod \"797f2c96-18c7-400b-a46d-795da852b08e\" (UID: \"797f2c96-18c7-400b-a46d-795da852b08e\") " Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.789120 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lfbdn\" (UniqueName: \"kubernetes.io/projected/f62d5d6a-d638-4968-902f-8eb726c039c1-kube-api-access-lfbdn\") pod \"f62d5d6a-d638-4968-902f-8eb726c039c1\" (UID: \"f62d5d6a-d638-4968-902f-8eb726c039c1\") " Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.789168 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/91595c8f-09e8-4cdd-8054-1f46eafa27ad-metrics-certs\") pod \"91595c8f-09e8-4cdd-8054-1f46eafa27ad\" (UID: \"91595c8f-09e8-4cdd-8054-1f46eafa27ad\") " Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.789202 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"webhook-certs\" (UniqueName: \"kubernetes.io/secret/91595c8f-09e8-4cdd-8054-1f46eafa27ad-webhook-certs\") pod \"91595c8f-09e8-4cdd-8054-1f46eafa27ad\" (UID: \"91595c8f-09e8-4cdd-8054-1f46eafa27ad\") " Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.789963 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mg8fr\" (UniqueName: \"kubernetes.io/projected/32fa740c-28b3-42a7-8ab5-6d159c237bf8-kube-api-access-mg8fr\") pod \"32fa740c-28b3-42a7-8ab5-6d159c237bf8\" (UID: \"32fa740c-28b3-42a7-8ab5-6d159c237bf8\") " Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.790023 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fgwqr\" (UniqueName: \"kubernetes.io/projected/42478fad-5a61-4cc1-94cc-ac00bdf30f24-kube-api-access-fgwqr\") pod \"42478fad-5a61-4cc1-94cc-ac00bdf30f24\" (UID: \"42478fad-5a61-4cc1-94cc-ac00bdf30f24\") " Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.790063 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"profile-collector-cert\" (UniqueName: \"kubernetes.io/secret/7f53cb77-0d21-4cd7-81c0-d003500184f1-profile-collector-cert\") pod \"7f53cb77-0d21-4cd7-81c0-d003500184f1\" (UID: \"7f53cb77-0d21-4cd7-81c0-d003500184f1\") " Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.790097 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4pfq8\" (UniqueName: \"kubernetes.io/projected/797f2c96-18c7-400b-a46d-795da852b08e-kube-api-access-4pfq8\") pod \"797f2c96-18c7-400b-a46d-795da852b08e\" (UID: \"797f2c96-18c7-400b-a46d-795da852b08e\") " Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.790146 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tmpfs\" (UniqueName: \"kubernetes.io/empty-dir/7f53cb77-0d21-4cd7-81c0-d003500184f1-tmpfs\") pod \"7f53cb77-0d21-4cd7-81c0-d003500184f1\" (UID: \"7f53cb77-0d21-4cd7-81c0-d003500184f1\") " Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.790269 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-66hqt\" (UniqueName: \"kubernetes.io/projected/8e6d8ae5-f5be-4b12-8401-54dcc86da579-kube-api-access-66hqt\") pod \"8e6d8ae5-f5be-4b12-8401-54dcc86da579\" (UID: \"8e6d8ae5-f5be-4b12-8401-54dcc86da579\") " Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.790306 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"srv-cert\" (UniqueName: \"kubernetes.io/secret/7f53cb77-0d21-4cd7-81c0-d003500184f1-srv-cert\") pod \"7f53cb77-0d21-4cd7-81c0-d003500184f1\" (UID: \"7f53cb77-0d21-4cd7-81c0-d003500184f1\") " Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.790525 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8zscs\" (UniqueName: \"kubernetes.io/projected/201aeec6-1404-4b8d-8cf7-4d2550cc9898-kube-api-access-8zscs\") pod \"201aeec6-1404-4b8d-8cf7-4d2550cc9898\" (UID: \"201aeec6-1404-4b8d-8cf7-4d2550cc9898\") " Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.790553 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m8688\" (UniqueName: \"kubernetes.io/projected/ef52f45c-ba73-4607-8b03-f13fce9806bd-kube-api-access-m8688\") pod \"ef52f45c-ba73-4607-8b03-f13fce9806bd\" (UID: \"ef52f45c-ba73-4607-8b03-f13fce9806bd\") " Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.794514 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4rn2d\" (UniqueName: \"kubernetes.io/projected/66faede0-c074-49ca-8bf9-9b5777b02edf-kube-api-access-4rn2d\") on node \"crc\" DevicePath \"\"" Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.794562 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cs5gv\" (UniqueName: \"kubernetes.io/projected/f5403564-ecbf-4103-89b6-530a8381c664-kube-api-access-cs5gv\") on node \"crc\" DevicePath \"\"" Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.794573 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-smqps\" (UniqueName: \"kubernetes.io/projected/bbc9f690-e60b-4c8a-b84a-2d8a3ca2001f-kube-api-access-smqps\") on node \"crc\" DevicePath \"\"" Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.794587 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8jck5\" (UniqueName: \"kubernetes.io/projected/e46d1032-1fff-4f99-baa0-487aee0eb1bd-kube-api-access-8jck5\") on node \"crc\" DevicePath \"\"" Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.797534 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f53cb77-0d21-4cd7-81c0-d003500184f1-tmpfs" (OuterVolumeSpecName: "tmpfs") pod "7f53cb77-0d21-4cd7-81c0-d003500184f1" (UID: "7f53cb77-0d21-4cd7-81c0-d003500184f1"). InnerVolumeSpecName "tmpfs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.802021 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91595c8f-09e8-4cdd-8054-1f46eafa27ad-kube-api-access-s4b4v" (OuterVolumeSpecName: "kube-api-access-s4b4v") pod "91595c8f-09e8-4cdd-8054-1f46eafa27ad" (UID: "91595c8f-09e8-4cdd-8054-1f46eafa27ad"). InnerVolumeSpecName "kube-api-access-s4b4v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.805084 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42478fad-5a61-4cc1-94cc-ac00bdf30f24-kube-api-access-fgwqr" (OuterVolumeSpecName: "kube-api-access-fgwqr") pod "42478fad-5a61-4cc1-94cc-ac00bdf30f24" (UID: "42478fad-5a61-4cc1-94cc-ac00bdf30f24"). InnerVolumeSpecName "kube-api-access-fgwqr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.805490 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32fa740c-28b3-42a7-8ab5-6d159c237bf8-kube-api-access-mg8fr" (OuterVolumeSpecName: "kube-api-access-mg8fr") pod "32fa740c-28b3-42a7-8ab5-6d159c237bf8" (UID: "32fa740c-28b3-42a7-8ab5-6d159c237bf8"). InnerVolumeSpecName "kube-api-access-mg8fr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.807020 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7f53cb77-0d21-4cd7-81c0-d003500184f1-profile-collector-cert" (OuterVolumeSpecName: "profile-collector-cert") pod "7f53cb77-0d21-4cd7-81c0-d003500184f1" (UID: "7f53cb77-0d21-4cd7-81c0-d003500184f1"). InnerVolumeSpecName "profile-collector-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.807897 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91595c8f-09e8-4cdd-8054-1f46eafa27ad-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "91595c8f-09e8-4cdd-8054-1f46eafa27ad" (UID: "91595c8f-09e8-4cdd-8054-1f46eafa27ad"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.808315 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/797f2c96-18c7-400b-a46d-795da852b08e-kube-api-access-4pfq8" (OuterVolumeSpecName: "kube-api-access-4pfq8") pod "797f2c96-18c7-400b-a46d-795da852b08e" (UID: "797f2c96-18c7-400b-a46d-795da852b08e"). InnerVolumeSpecName "kube-api-access-4pfq8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.808386 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4af61d68-498f-4c1a-812d-91089029f784-kube-api-access-kjp8x" (OuterVolumeSpecName: "kube-api-access-kjp8x") pod "4af61d68-498f-4c1a-812d-91089029f784" (UID: "4af61d68-498f-4c1a-812d-91089029f784"). InnerVolumeSpecName "kube-api-access-kjp8x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.808409 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/201aeec6-1404-4b8d-8cf7-4d2550cc9898-kube-api-access-8zscs" (OuterVolumeSpecName: "kube-api-access-8zscs") pod "201aeec6-1404-4b8d-8cf7-4d2550cc9898" (UID: "201aeec6-1404-4b8d-8cf7-4d2550cc9898"). InnerVolumeSpecName "kube-api-access-8zscs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.808556 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/manila-operator-controller-manager-7d6d87b867-xkrnl" Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.812980 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91595c8f-09e8-4cdd-8054-1f46eafa27ad-webhook-certs" (OuterVolumeSpecName: "webhook-certs") pod "91595c8f-09e8-4cdd-8054-1f46eafa27ad" (UID: "91595c8f-09e8-4cdd-8054-1f46eafa27ad"). InnerVolumeSpecName "webhook-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.817918 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef52f45c-ba73-4607-8b03-f13fce9806bd-kube-api-access-m8688" (OuterVolumeSpecName: "kube-api-access-m8688") pod "ef52f45c-ba73-4607-8b03-f13fce9806bd" (UID: "ef52f45c-ba73-4607-8b03-f13fce9806bd"). InnerVolumeSpecName "kube-api-access-m8688". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.819721 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e6d8ae5-f5be-4b12-8401-54dcc86da579-kube-api-access-66hqt" (OuterVolumeSpecName: "kube-api-access-66hqt") pod "8e6d8ae5-f5be-4b12-8401-54dcc86da579" (UID: "8e6d8ae5-f5be-4b12-8401-54dcc86da579"). InnerVolumeSpecName "kube-api-access-66hqt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.819895 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f62d5d6a-d638-4968-902f-8eb726c039c1-kube-api-access-lfbdn" (OuterVolumeSpecName: "kube-api-access-lfbdn") pod "f62d5d6a-d638-4968-902f-8eb726c039c1" (UID: "f62d5d6a-d638-4968-902f-8eb726c039c1"). InnerVolumeSpecName "kube-api-access-lfbdn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.821186 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7f53cb77-0d21-4cd7-81c0-d003500184f1-srv-cert" (OuterVolumeSpecName: "srv-cert") pod "7f53cb77-0d21-4cd7-81c0-d003500184f1" (UID: "7f53cb77-0d21-4cd7-81c0-d003500184f1"). InnerVolumeSpecName "srv-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.821351 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f53cb77-0d21-4cd7-81c0-d003500184f1-kube-api-access-89688" (OuterVolumeSpecName: "kube-api-access-89688") pod "7f53cb77-0d21-4cd7-81c0-d003500184f1" (UID: "7f53cb77-0d21-4cd7-81c0-d003500184f1"). InnerVolumeSpecName "kube-api-access-89688". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.861447 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/78743df2-449e-44ab-91f1-ac48af33b657-kube-api-access-ns6ts" (OuterVolumeSpecName: "kube-api-access-ns6ts") pod "78743df2-449e-44ab-91f1-ac48af33b657" (UID: "78743df2-449e-44ab-91f1-ac48af33b657"). InnerVolumeSpecName "kube-api-access-ns6ts". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.862190 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/797f2c96-18c7-400b-a46d-795da852b08e-cert" (OuterVolumeSpecName: "cert") pod "797f2c96-18c7-400b-a46d-795da852b08e" (UID: "797f2c96-18c7-400b-a46d-795da852b08e"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.883586 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operator-lifecycle-manager/catalog-operator-75ff9f647d-wtb28"] Mar 16 17:33:40 crc kubenswrapper[5120]: W0316 17:33:40.895570 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5de233e4_28ee_437b_a4f1_28a1caf84fd5.slice/crio-03ae1d9158ddd41325ff89b116cbc86f2eb141040439ba0cff96379c510b7a01 WatchSource:0}: Error finding container 03ae1d9158ddd41325ff89b116cbc86f2eb141040439ba0cff96379c510b7a01: Status 404 returned error can't find the container with id 03ae1d9158ddd41325ff89b116cbc86f2eb141040439ba0cff96379c510b7a01 Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.895649 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xv4m6\" (UniqueName: \"kubernetes.io/projected/eed7b084-3ca6-41c0-847f-19929fb52c41-kube-api-access-xv4m6\") pod \"eed7b084-3ca6-41c0-847f-19929fb52c41\" (UID: \"eed7b084-3ca6-41c0-847f-19929fb52c41\") " Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.895781 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dtdv8\" (UniqueName: \"kubernetes.io/projected/8a11dd5a-29d6-4791-849c-97b08acb5b4e-kube-api-access-dtdv8\") pod \"8a11dd5a-29d6-4791-849c-97b08acb5b4e\" (UID: \"8a11dd5a-29d6-4791-849c-97b08acb5b4e\") " Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.896282 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wbgsh\" (UniqueName: \"kubernetes.io/projected/127fb533-a6f7-4dc2-85d9-69ec57116fe9-kube-api-access-wbgsh\") pod \"127fb533-a6f7-4dc2-85d9-69ec57116fe9\" (UID: \"127fb533-a6f7-4dc2-85d9-69ec57116fe9\") " Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.896321 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7vhrs\" (UniqueName: \"kubernetes.io/projected/ed2165fd-95f2-40f7-a860-70b81d6ab977-kube-api-access-7vhrs\") pod \"ed2165fd-95f2-40f7-a860-70b81d6ab977\" (UID: \"ed2165fd-95f2-40f7-a860-70b81d6ab977\") " Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.897088 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fgwqr\" (UniqueName: \"kubernetes.io/projected/42478fad-5a61-4cc1-94cc-ac00bdf30f24-kube-api-access-fgwqr\") on node \"crc\" DevicePath \"\"" Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.897112 5120 reconciler_common.go:299] "Volume detached for volume \"profile-collector-cert\" (UniqueName: \"kubernetes.io/secret/7f53cb77-0d21-4cd7-81c0-d003500184f1-profile-collector-cert\") on node \"crc\" DevicePath \"\"" Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.897127 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4pfq8\" (UniqueName: \"kubernetes.io/projected/797f2c96-18c7-400b-a46d-795da852b08e-kube-api-access-4pfq8\") on node \"crc\" DevicePath \"\"" Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.897139 5120 reconciler_common.go:299] "Volume detached for volume \"tmpfs\" (UniqueName: \"kubernetes.io/empty-dir/7f53cb77-0d21-4cd7-81c0-d003500184f1-tmpfs\") on node \"crc\" DevicePath \"\"" Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.897182 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-66hqt\" (UniqueName: \"kubernetes.io/projected/8e6d8ae5-f5be-4b12-8401-54dcc86da579-kube-api-access-66hqt\") on node \"crc\" DevicePath \"\"" Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.897200 5120 reconciler_common.go:299] "Volume detached for volume \"srv-cert\" (UniqueName: \"kubernetes.io/secret/7f53cb77-0d21-4cd7-81c0-d003500184f1-srv-cert\") on node \"crc\" DevicePath \"\"" Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.897212 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8zscs\" (UniqueName: \"kubernetes.io/projected/201aeec6-1404-4b8d-8cf7-4d2550cc9898-kube-api-access-8zscs\") on node \"crc\" DevicePath \"\"" Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.897225 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m8688\" (UniqueName: \"kubernetes.io/projected/ef52f45c-ba73-4607-8b03-f13fce9806bd-kube-api-access-m8688\") on node \"crc\" DevicePath \"\"" Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.897269 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ns6ts\" (UniqueName: \"kubernetes.io/projected/78743df2-449e-44ab-91f1-ac48af33b657-kube-api-access-ns6ts\") on node \"crc\" DevicePath \"\"" Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.897284 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s4b4v\" (UniqueName: \"kubernetes.io/projected/91595c8f-09e8-4cdd-8054-1f46eafa27ad-kube-api-access-s4b4v\") on node \"crc\" DevicePath \"\"" Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.897297 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kjp8x\" (UniqueName: \"kubernetes.io/projected/4af61d68-498f-4c1a-812d-91089029f784-kube-api-access-kjp8x\") on node \"crc\" DevicePath \"\"" Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.897311 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-89688\" (UniqueName: \"kubernetes.io/projected/7f53cb77-0d21-4cd7-81c0-d003500184f1-kube-api-access-89688\") on node \"crc\" DevicePath \"\"" Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.897352 5120 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/797f2c96-18c7-400b-a46d-795da852b08e-cert\") on node \"crc\" DevicePath \"\"" Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.897367 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lfbdn\" (UniqueName: \"kubernetes.io/projected/f62d5d6a-d638-4968-902f-8eb726c039c1-kube-api-access-lfbdn\") on node \"crc\" DevicePath \"\"" Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.897380 5120 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/91595c8f-09e8-4cdd-8054-1f46eafa27ad-metrics-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.897394 5120 reconciler_common.go:299] "Volume detached for volume \"webhook-certs\" (UniqueName: \"kubernetes.io/secret/91595c8f-09e8-4cdd-8054-1f46eafa27ad-webhook-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.897429 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mg8fr\" (UniqueName: \"kubernetes.io/projected/32fa740c-28b3-42a7-8ab5-6d159c237bf8-kube-api-access-mg8fr\") on node \"crc\" DevicePath \"\"" Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.901175 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/127fb533-a6f7-4dc2-85d9-69ec57116fe9-kube-api-access-wbgsh" (OuterVolumeSpecName: "kube-api-access-wbgsh") pod "127fb533-a6f7-4dc2-85d9-69ec57116fe9" (UID: "127fb533-a6f7-4dc2-85d9-69ec57116fe9"). InnerVolumeSpecName "kube-api-access-wbgsh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.903067 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a11dd5a-29d6-4791-849c-97b08acb5b4e-kube-api-access-dtdv8" (OuterVolumeSpecName: "kube-api-access-dtdv8") pod "8a11dd5a-29d6-4791-849c-97b08acb5b4e" (UID: "8a11dd5a-29d6-4791-849c-97b08acb5b4e"). InnerVolumeSpecName "kube-api-access-dtdv8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.906062 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eed7b084-3ca6-41c0-847f-19929fb52c41-kube-api-access-xv4m6" (OuterVolumeSpecName: "kube-api-access-xv4m6") pod "eed7b084-3ca6-41c0-847f-19929fb52c41" (UID: "eed7b084-3ca6-41c0-847f-19929fb52c41"). InnerVolumeSpecName "kube-api-access-xv4m6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.911977 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed2165fd-95f2-40f7-a860-70b81d6ab977-kube-api-access-7vhrs" (OuterVolumeSpecName: "kube-api-access-7vhrs") pod "ed2165fd-95f2-40f7-a860-70b81d6ab977" (UID: "ed2165fd-95f2-40f7-a860-70b81d6ab977"). InnerVolumeSpecName "kube-api-access-7vhrs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.999019 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wbgsh\" (UniqueName: \"kubernetes.io/projected/127fb533-a6f7-4dc2-85d9-69ec57116fe9-kube-api-access-wbgsh\") on node \"crc\" DevicePath \"\"" Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.999220 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7vhrs\" (UniqueName: \"kubernetes.io/projected/ed2165fd-95f2-40f7-a860-70b81d6ab977-kube-api-access-7vhrs\") on node \"crc\" DevicePath \"\"" Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.999281 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xv4m6\" (UniqueName: \"kubernetes.io/projected/eed7b084-3ca6-41c0-847f-19929fb52c41-kube-api-access-xv4m6\") on node \"crc\" DevicePath \"\"" Mar 16 17:33:40 crc kubenswrapper[5120]: I0316 17:33:40.999339 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dtdv8\" (UniqueName: \"kubernetes.io/projected/8a11dd5a-29d6-4791-849c-97b08acb5b4e-kube-api-access-dtdv8\") on node \"crc\" DevicePath \"\"" Mar 16 17:33:41 crc kubenswrapper[5120]: I0316 17:33:41.385188 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/catalog-operator-75ff9f647d-wtb28" event={"ID":"5de233e4-28ee-437b-a4f1-28a1caf84fd5","Type":"ContainerStarted","Data":"c40712fbf7abdbeda906c6354519a3db4aab75d522e03761db18035a87af730d"} Mar 16 17:33:41 crc kubenswrapper[5120]: I0316 17:33:41.385462 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/barbican-operator-controller-manager-848cfb5779-68smv" Mar 16 17:33:41 crc kubenswrapper[5120]: I0316 17:33:41.385494 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operator-lifecycle-manager/catalog-operator-75ff9f647d-wtb28" Mar 16 17:33:41 crc kubenswrapper[5120]: I0316 17:33:41.385509 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/catalog-operator-75ff9f647d-wtb28" event={"ID":"5de233e4-28ee-437b-a4f1-28a1caf84fd5","Type":"ContainerStarted","Data":"03ae1d9158ddd41325ff89b116cbc86f2eb141040439ba0cff96379c510b7a01"} Mar 16 17:33:41 crc kubenswrapper[5120]: I0316 17:33:41.385678 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/glance-operator-controller-manager-58d9bbd8cc-vhvn5" Mar 16 17:33:41 crc kubenswrapper[5120]: I0316 17:33:41.385831 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/test-operator-controller-manager-74d567479f-cbkr4" Mar 16 17:33:41 crc kubenswrapper[5120]: I0316 17:33:41.385910 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/mariadb-operator-controller-manager-5748db694b-nk2nc" Mar 16 17:33:41 crc kubenswrapper[5120]: I0316 17:33:41.385931 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/openstack-baremetal-operator-controller-manager-6b6ddbc599g848w" Mar 16 17:33:41 crc kubenswrapper[5120]: I0316 17:33:41.386063 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/openstack-operator-controller-manager-5fbcdbcf94-6sdhq" Mar 16 17:33:41 crc kubenswrapper[5120]: I0316 17:33:41.386661 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/horizon-operator-controller-manager-5bf9fb4564-qzsbr" Mar 16 17:33:41 crc kubenswrapper[5120]: I0316 17:33:41.386864 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/rabbitmq-cluster-operator-manager-85d9b55b6-tfl54" Mar 16 17:33:41 crc kubenswrapper[5120]: I0316 17:33:41.386891 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/openstack-operator-controller-init-7b76cc8c59-hmnw9" Mar 16 17:33:41 crc kubenswrapper[5120]: I0316 17:33:41.387303 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/catalog-operator-75ff9f647d-x5d5w" Mar 16 17:33:41 crc kubenswrapper[5120]: I0316 17:33:41.387345 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/telemetry-operator-controller-manager-f5cf7fcb7-cmrwq" Mar 16 17:33:41 crc kubenswrapper[5120]: I0316 17:33:41.387358 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/openstack-operator-index-2h9ct" Mar 16 17:33:41 crc kubenswrapper[5120]: I0316 17:33:41.387365 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/ovn-operator-controller-manager-6fb6cd45c4-ln28h" Mar 16 17:33:41 crc kubenswrapper[5120]: I0316 17:33:41.387373 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/placement-operator-controller-manager-57fdd4b4cf-v5f9b" Mar 16 17:33:41 crc kubenswrapper[5120]: I0316 17:33:41.387380 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/designate-operator-controller-manager-7cf89c67bb-cjd7x" Mar 16 17:33:41 crc kubenswrapper[5120]: I0316 17:33:41.387387 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/ironic-operator-controller-manager-997698bf9-6zvjn" Mar 16 17:33:41 crc kubenswrapper[5120]: I0316 17:33:41.387407 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/swift-operator-controller-manager-5d89b4d5d5-9zvm4" Mar 16 17:33:41 crc kubenswrapper[5120]: I0316 17:33:41.387415 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/cinder-operator-controller-manager-55bc8cdcc4-sbtk9" Mar 16 17:33:41 crc kubenswrapper[5120]: I0316 17:33:41.387422 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/manila-operator-controller-manager-7d6d87b867-xkrnl" Mar 16 17:33:41 crc kubenswrapper[5120]: I0316 17:33:41.387429 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/heat-operator-controller-manager-79975d4c95-n2zm7" Mar 16 17:33:41 crc kubenswrapper[5120]: I0316 17:33:41.387435 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/infra-operator-controller-manager-76f8b7ddbd-nvwr5" Mar 16 17:33:41 crc kubenswrapper[5120]: I0316 17:33:41.387442 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/octavia-operator-controller-manager-7b89675745-5vg74" Mar 16 17:33:41 crc kubenswrapper[5120]: I0316 17:33:41.387450 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/watcher-operator-controller-manager-65d578856c-7khnv" Mar 16 17:33:41 crc kubenswrapper[5120]: I0316 17:33:41.387458 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/neutron-operator-controller-manager-75c6f4bc76-mbnvj" Mar 16 17:33:41 crc kubenswrapper[5120]: I0316 17:33:41.387465 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/nova-operator-controller-manager-785d77464d-j7x9r" Mar 16 17:33:41 crc kubenswrapper[5120]: I0316 17:33:41.387474 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/keystone-operator-controller-manager-6f5b9fd59-rhjb2" Mar 16 17:33:41 crc kubenswrapper[5120]: I0316 17:33:41.397573 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operator-lifecycle-manager/catalog-operator-75ff9f647d-wtb28" Mar 16 17:33:41 crc kubenswrapper[5120]: I0316 17:33:41.420940 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operator-lifecycle-manager/catalog-operator-75ff9f647d-wtb28" podStartSLOduration=3.420922602 podStartE2EDuration="3.420922602s" podCreationTimestamp="2026-03-16 17:33:38 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:33:41.410866118 +0000 UTC m=+7323.564797795" watchObservedRunningTime="2026-03-16 17:33:41.420922602 +0000 UTC m=+7323.574854259" Mar 16 17:33:41 crc kubenswrapper[5120]: I0316 17:33:41.533175 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/ironic-operator-controller-manager-997698bf9-6zvjn"] Mar 16 17:33:41 crc kubenswrapper[5120]: I0316 17:33:41.540497 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-operators/ironic-operator-controller-manager-997698bf9-6zvjn"] Mar 16 17:33:41 crc kubenswrapper[5120]: I0316 17:33:41.546827 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/heat-operator-controller-manager-79975d4c95-n2zm7"] Mar 16 17:33:41 crc kubenswrapper[5120]: I0316 17:33:41.563891 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-operators/heat-operator-controller-manager-79975d4c95-n2zm7"] Mar 16 17:33:41 crc kubenswrapper[5120]: I0316 17:33:41.573260 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/watcher-operator-controller-manager-65d578856c-7khnv"] Mar 16 17:33:41 crc kubenswrapper[5120]: I0316 17:33:41.581732 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-operators/watcher-operator-controller-manager-65d578856c-7khnv"] Mar 16 17:33:41 crc kubenswrapper[5120]: I0316 17:33:41.588336 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/openstack-operator-index-2h9ct"] Mar 16 17:33:41 crc kubenswrapper[5120]: I0316 17:33:41.597395 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-operators/openstack-operator-index-2h9ct"] Mar 16 17:33:41 crc kubenswrapper[5120]: I0316 17:33:41.605489 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/neutron-operator-controller-manager-75c6f4bc76-mbnvj"] Mar 16 17:33:41 crc kubenswrapper[5120]: I0316 17:33:41.609737 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-operators/openstack-operator-controller-init-7b76cc8c59-hmnw9" podUID="78743df2-449e-44ab-91f1-ac48af33b657" containerName="operator" probeResult="failure" output="Get \"http://10.217.0.75:8081/readyz\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 17:33:41 crc kubenswrapper[5120]: I0316 17:33:41.612893 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-operators/neutron-operator-controller-manager-75c6f4bc76-mbnvj"] Mar 16 17:33:41 crc kubenswrapper[5120]: I0316 17:33:41.619605 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/octavia-operator-controller-manager-7b89675745-5vg74"] Mar 16 17:33:41 crc kubenswrapper[5120]: I0316 17:33:41.627556 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-operators/octavia-operator-controller-manager-7b89675745-5vg74"] Mar 16 17:33:41 crc kubenswrapper[5120]: I0316 17:33:41.641501 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/openstack-operator-controller-init-7b76cc8c59-hmnw9"] Mar 16 17:33:41 crc kubenswrapper[5120]: I0316 17:33:41.653938 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-operators/openstack-operator-controller-init-7b76cc8c59-hmnw9"] Mar 16 17:33:41 crc kubenswrapper[5120]: I0316 17:33:41.667838 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/cinder-operator-controller-manager-55bc8cdcc4-sbtk9"] Mar 16 17:33:41 crc kubenswrapper[5120]: I0316 17:33:41.676141 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-operators/cinder-operator-controller-manager-55bc8cdcc4-sbtk9"] Mar 16 17:33:41 crc kubenswrapper[5120]: I0316 17:33:41.682394 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/manila-operator-controller-manager-7d6d87b867-xkrnl"] Mar 16 17:33:41 crc kubenswrapper[5120]: I0316 17:33:41.689194 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-operators/manila-operator-controller-manager-7d6d87b867-xkrnl"] Mar 16 17:33:41 crc kubenswrapper[5120]: I0316 17:33:41.697881 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/ovn-operator-controller-manager-6fb6cd45c4-ln28h"] Mar 16 17:33:41 crc kubenswrapper[5120]: I0316 17:33:41.706583 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-operators/ovn-operator-controller-manager-6fb6cd45c4-ln28h"] Mar 16 17:33:41 crc kubenswrapper[5120]: I0316 17:33:41.714204 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/horizon-operator-controller-manager-5bf9fb4564-qzsbr"] Mar 16 17:33:41 crc kubenswrapper[5120]: I0316 17:33:41.723247 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-operators/horizon-operator-controller-manager-5bf9fb4564-qzsbr"] Mar 16 17:33:41 crc kubenswrapper[5120]: I0316 17:33:41.730549 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/swift-operator-controller-manager-5d89b4d5d5-9zvm4"] Mar 16 17:33:41 crc kubenswrapper[5120]: I0316 17:33:41.736850 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-operators/swift-operator-controller-manager-5d89b4d5d5-9zvm4"] Mar 16 17:33:41 crc kubenswrapper[5120]: I0316 17:33:41.743216 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/telemetry-operator-controller-manager-f5cf7fcb7-cmrwq"] Mar 16 17:33:41 crc kubenswrapper[5120]: I0316 17:33:41.750706 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-operators/telemetry-operator-controller-manager-f5cf7fcb7-cmrwq"] Mar 16 17:33:41 crc kubenswrapper[5120]: I0316 17:33:41.757812 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/openstack-baremetal-operator-controller-manager-6b6ddbc599g848w"] Mar 16 17:33:41 crc kubenswrapper[5120]: I0316 17:33:41.763568 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-operators/openstack-baremetal-operator-controller-manager-6b6ddbc599g848w"] Mar 16 17:33:41 crc kubenswrapper[5120]: I0316 17:33:41.769074 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/infra-operator-controller-manager-76f8b7ddbd-nvwr5"] Mar 16 17:33:41 crc kubenswrapper[5120]: I0316 17:33:41.775213 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-operators/infra-operator-controller-manager-76f8b7ddbd-nvwr5"] Mar 16 17:33:41 crc kubenswrapper[5120]: I0316 17:33:41.780506 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-operator-lifecycle-manager/catalog-operator-75ff9f647d-x5d5w"] Mar 16 17:33:41 crc kubenswrapper[5120]: I0316 17:33:41.785724 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-operator-lifecycle-manager/catalog-operator-75ff9f647d-x5d5w"] Mar 16 17:33:41 crc kubenswrapper[5120]: I0316 17:33:41.792647 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/rabbitmq-cluster-operator-manager-85d9b55b6-tfl54"] Mar 16 17:33:41 crc kubenswrapper[5120]: I0316 17:33:41.799052 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-operators/rabbitmq-cluster-operator-manager-85d9b55b6-tfl54"] Mar 16 17:33:41 crc kubenswrapper[5120]: I0316 17:33:41.804198 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/designate-operator-controller-manager-7cf89c67bb-cjd7x"] Mar 16 17:33:41 crc kubenswrapper[5120]: I0316 17:33:41.808596 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-operators/designate-operator-controller-manager-7cf89c67bb-cjd7x"] Mar 16 17:33:41 crc kubenswrapper[5120]: I0316 17:33:41.813564 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/openstack-operator-controller-manager-5fbcdbcf94-6sdhq"] Mar 16 17:33:41 crc kubenswrapper[5120]: I0316 17:33:41.818595 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-operators/openstack-operator-controller-manager-5fbcdbcf94-6sdhq"] Mar 16 17:33:41 crc kubenswrapper[5120]: I0316 17:33:41.823208 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/test-operator-controller-manager-74d567479f-cbkr4"] Mar 16 17:33:41 crc kubenswrapper[5120]: I0316 17:33:41.827665 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-operators/test-operator-controller-manager-74d567479f-cbkr4"] Mar 16 17:33:41 crc kubenswrapper[5120]: I0316 17:33:41.831894 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/nova-operator-controller-manager-785d77464d-j7x9r"] Mar 16 17:33:41 crc kubenswrapper[5120]: I0316 17:33:41.836114 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-operators/nova-operator-controller-manager-785d77464d-j7x9r"] Mar 16 17:33:41 crc kubenswrapper[5120]: I0316 17:33:41.840153 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/mariadb-operator-controller-manager-5748db694b-nk2nc"] Mar 16 17:33:41 crc kubenswrapper[5120]: I0316 17:33:41.844328 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-operators/mariadb-operator-controller-manager-5748db694b-nk2nc"] Mar 16 17:33:41 crc kubenswrapper[5120]: I0316 17:33:41.848460 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/glance-operator-controller-manager-58d9bbd8cc-vhvn5"] Mar 16 17:33:41 crc kubenswrapper[5120]: I0316 17:33:41.852544 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-operators/glance-operator-controller-manager-58d9bbd8cc-vhvn5"] Mar 16 17:33:41 crc kubenswrapper[5120]: I0316 17:33:41.856414 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/barbican-operator-controller-manager-848cfb5779-68smv"] Mar 16 17:33:41 crc kubenswrapper[5120]: I0316 17:33:41.860394 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-operators/barbican-operator-controller-manager-848cfb5779-68smv"] Mar 16 17:33:41 crc kubenswrapper[5120]: I0316 17:33:41.864302 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/placement-operator-controller-manager-57fdd4b4cf-v5f9b"] Mar 16 17:33:41 crc kubenswrapper[5120]: I0316 17:33:41.868637 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-operators/placement-operator-controller-manager-57fdd4b4cf-v5f9b"] Mar 16 17:33:41 crc kubenswrapper[5120]: I0316 17:33:41.872455 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/keystone-operator-controller-manager-6f5b9fd59-rhjb2"] Mar 16 17:33:41 crc kubenswrapper[5120]: I0316 17:33:41.876436 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-operators/keystone-operator-controller-manager-6f5b9fd59-rhjb2"] Mar 16 17:33:42 crc kubenswrapper[5120]: I0316 17:33:42.672065 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="127fb533-a6f7-4dc2-85d9-69ec57116fe9" path="/var/lib/kubelet/pods/127fb533-a6f7-4dc2-85d9-69ec57116fe9/volumes" Mar 16 17:33:42 crc kubenswrapper[5120]: I0316 17:33:42.673121 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="201aeec6-1404-4b8d-8cf7-4d2550cc9898" path="/var/lib/kubelet/pods/201aeec6-1404-4b8d-8cf7-4d2550cc9898/volumes" Mar 16 17:33:42 crc kubenswrapper[5120]: I0316 17:33:42.673822 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2fc99f04-8366-4f00-9ce1-d0e4faf1d0a3" path="/var/lib/kubelet/pods/2fc99f04-8366-4f00-9ce1-d0e4faf1d0a3/volumes" Mar 16 17:33:42 crc kubenswrapper[5120]: I0316 17:33:42.674450 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="32fa740c-28b3-42a7-8ab5-6d159c237bf8" path="/var/lib/kubelet/pods/32fa740c-28b3-42a7-8ab5-6d159c237bf8/volumes" Mar 16 17:33:42 crc kubenswrapper[5120]: I0316 17:33:42.676041 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3b105271-39d9-4339-a315-3aa161a54b31" path="/var/lib/kubelet/pods/3b105271-39d9-4339-a315-3aa161a54b31/volumes" Mar 16 17:33:42 crc kubenswrapper[5120]: I0316 17:33:42.676681 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="42478fad-5a61-4cc1-94cc-ac00bdf30f24" path="/var/lib/kubelet/pods/42478fad-5a61-4cc1-94cc-ac00bdf30f24/volumes" Mar 16 17:33:42 crc kubenswrapper[5120]: I0316 17:33:42.677426 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4752ce4e-0b7c-43d7-99dc-b8633f7a2cd7" path="/var/lib/kubelet/pods/4752ce4e-0b7c-43d7-99dc-b8633f7a2cd7/volumes" Mar 16 17:33:42 crc kubenswrapper[5120]: I0316 17:33:42.678189 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4af61d68-498f-4c1a-812d-91089029f784" path="/var/lib/kubelet/pods/4af61d68-498f-4c1a-812d-91089029f784/volumes" Mar 16 17:33:42 crc kubenswrapper[5120]: I0316 17:33:42.679916 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="66faede0-c074-49ca-8bf9-9b5777b02edf" path="/var/lib/kubelet/pods/66faede0-c074-49ca-8bf9-9b5777b02edf/volumes" Mar 16 17:33:42 crc kubenswrapper[5120]: I0316 17:33:42.680743 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="78743df2-449e-44ab-91f1-ac48af33b657" path="/var/lib/kubelet/pods/78743df2-449e-44ab-91f1-ac48af33b657/volumes" Mar 16 17:33:42 crc kubenswrapper[5120]: I0316 17:33:42.681682 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="797f2c96-18c7-400b-a46d-795da852b08e" path="/var/lib/kubelet/pods/797f2c96-18c7-400b-a46d-795da852b08e/volumes" Mar 16 17:33:42 crc kubenswrapper[5120]: I0316 17:33:42.683241 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7f53cb77-0d21-4cd7-81c0-d003500184f1" path="/var/lib/kubelet/pods/7f53cb77-0d21-4cd7-81c0-d003500184f1/volumes" Mar 16 17:33:42 crc kubenswrapper[5120]: I0316 17:33:42.683908 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8643ed10-e4fd-4b97-ae36-c4b581cdef1b" path="/var/lib/kubelet/pods/8643ed10-e4fd-4b97-ae36-c4b581cdef1b/volumes" Mar 16 17:33:42 crc kubenswrapper[5120]: I0316 17:33:42.684346 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a11dd5a-29d6-4791-849c-97b08acb5b4e" path="/var/lib/kubelet/pods/8a11dd5a-29d6-4791-849c-97b08acb5b4e/volumes" Mar 16 17:33:42 crc kubenswrapper[5120]: I0316 17:33:42.684853 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8e6d8ae5-f5be-4b12-8401-54dcc86da579" path="/var/lib/kubelet/pods/8e6d8ae5-f5be-4b12-8401-54dcc86da579/volumes" Mar 16 17:33:42 crc kubenswrapper[5120]: I0316 17:33:42.685362 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="91595c8f-09e8-4cdd-8054-1f46eafa27ad" path="/var/lib/kubelet/pods/91595c8f-09e8-4cdd-8054-1f46eafa27ad/volumes" Mar 16 17:33:42 crc kubenswrapper[5120]: I0316 17:33:42.685861 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bbc9f690-e60b-4c8a-b84a-2d8a3ca2001f" path="/var/lib/kubelet/pods/bbc9f690-e60b-4c8a-b84a-2d8a3ca2001f/volumes" Mar 16 17:33:42 crc kubenswrapper[5120]: I0316 17:33:42.686261 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d2d3e713-eefd-44fd-8784-1f4f54155d8f" path="/var/lib/kubelet/pods/d2d3e713-eefd-44fd-8784-1f4f54155d8f/volumes" Mar 16 17:33:42 crc kubenswrapper[5120]: I0316 17:33:42.686786 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e46d1032-1fff-4f99-baa0-487aee0eb1bd" path="/var/lib/kubelet/pods/e46d1032-1fff-4f99-baa0-487aee0eb1bd/volumes" Mar 16 17:33:42 crc kubenswrapper[5120]: I0316 17:33:42.687207 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e6b6caa5-b1c3-4ad6-8b0e-0358400bb03b" path="/var/lib/kubelet/pods/e6b6caa5-b1c3-4ad6-8b0e-0358400bb03b/volumes" Mar 16 17:33:42 crc kubenswrapper[5120]: I0316 17:33:42.687649 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e918c50c-96eb-4da3-9b1d-fc31e3582816" path="/var/lib/kubelet/pods/e918c50c-96eb-4da3-9b1d-fc31e3582816/volumes" Mar 16 17:33:42 crc kubenswrapper[5120]: I0316 17:33:42.688084 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed2165fd-95f2-40f7-a860-70b81d6ab977" path="/var/lib/kubelet/pods/ed2165fd-95f2-40f7-a860-70b81d6ab977/volumes" Mar 16 17:33:42 crc kubenswrapper[5120]: I0316 17:33:42.688487 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eed7b084-3ca6-41c0-847f-19929fb52c41" path="/var/lib/kubelet/pods/eed7b084-3ca6-41c0-847f-19929fb52c41/volumes" Mar 16 17:33:42 crc kubenswrapper[5120]: I0316 17:33:42.690165 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef52f45c-ba73-4607-8b03-f13fce9806bd" path="/var/lib/kubelet/pods/ef52f45c-ba73-4607-8b03-f13fce9806bd/volumes" Mar 16 17:33:42 crc kubenswrapper[5120]: I0316 17:33:42.690678 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f5403564-ecbf-4103-89b6-530a8381c664" path="/var/lib/kubelet/pods/f5403564-ecbf-4103-89b6-530a8381c664/volumes" Mar 16 17:33:42 crc kubenswrapper[5120]: I0316 17:33:42.691133 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f62d5d6a-d638-4968-902f-8eb726c039c1" path="/var/lib/kubelet/pods/f62d5d6a-d638-4968-902f-8eb726c039c1/volumes" Mar 16 17:33:43 crc kubenswrapper[5120]: I0316 17:33:43.189047 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-5dr8d" Mar 16 17:33:43 crc kubenswrapper[5120]: I0316 17:33:43.252788 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-8c5974765-rmj8x"] Mar 16 17:33:43 crc kubenswrapper[5120]: I0316 17:33:43.253120 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-8c5974765-rmj8x" podUID="61bf94c7-387e-4d45-8b1a-e29a14b476f0" containerName="dnsmasq-dns" containerID="cri-o://f98c97c898650b78de8ec0b27d977220887db87a28847113b799c001f32e3ddb" gracePeriod=10 Mar 16 17:33:43 crc kubenswrapper[5120]: I0316 17:33:43.409828 5120 generic.go:358] "Generic (PLEG): container finished" podID="61bf94c7-387e-4d45-8b1a-e29a14b476f0" containerID="f98c97c898650b78de8ec0b27d977220887db87a28847113b799c001f32e3ddb" exitCode=0 Mar 16 17:33:43 crc kubenswrapper[5120]: I0316 17:33:43.409985 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-8c5974765-rmj8x" event={"ID":"61bf94c7-387e-4d45-8b1a-e29a14b476f0","Type":"ContainerDied","Data":"f98c97c898650b78de8ec0b27d977220887db87a28847113b799c001f32e3ddb"} Mar 16 17:33:43 crc kubenswrapper[5120]: I0316 17:33:43.627631 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-8c5974765-rmj8x" Mar 16 17:33:43 crc kubenswrapper[5120]: I0316 17:33:43.655789 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/61bf94c7-387e-4d45-8b1a-e29a14b476f0-dnsmasq-svc\") pod \"61bf94c7-387e-4d45-8b1a-e29a14b476f0\" (UID: \"61bf94c7-387e-4d45-8b1a-e29a14b476f0\") " Mar 16 17:33:43 crc kubenswrapper[5120]: I0316 17:33:43.656119 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4xn54\" (UniqueName: \"kubernetes.io/projected/61bf94c7-387e-4d45-8b1a-e29a14b476f0-kube-api-access-4xn54\") pod \"61bf94c7-387e-4d45-8b1a-e29a14b476f0\" (UID: \"61bf94c7-387e-4d45-8b1a-e29a14b476f0\") " Mar 16 17:33:43 crc kubenswrapper[5120]: I0316 17:33:43.656481 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/61bf94c7-387e-4d45-8b1a-e29a14b476f0-config\") pod \"61bf94c7-387e-4d45-8b1a-e29a14b476f0\" (UID: \"61bf94c7-387e-4d45-8b1a-e29a14b476f0\") " Mar 16 17:33:43 crc kubenswrapper[5120]: I0316 17:33:43.656658 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/configmap/61bf94c7-387e-4d45-8b1a-e29a14b476f0-edpm-compute-no-nodes\") pod \"61bf94c7-387e-4d45-8b1a-e29a14b476f0\" (UID: \"61bf94c7-387e-4d45-8b1a-e29a14b476f0\") " Mar 16 17:33:43 crc kubenswrapper[5120]: I0316 17:33:43.665193 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61bf94c7-387e-4d45-8b1a-e29a14b476f0-kube-api-access-4xn54" (OuterVolumeSpecName: "kube-api-access-4xn54") pod "61bf94c7-387e-4d45-8b1a-e29a14b476f0" (UID: "61bf94c7-387e-4d45-8b1a-e29a14b476f0"). InnerVolumeSpecName "kube-api-access-4xn54". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:33:43 crc kubenswrapper[5120]: I0316 17:33:43.665397 5120 scope.go:117] "RemoveContainer" containerID="df0a87b047c8208d5fc21057efed33321f6cab49c4cf053702d222dc12979450" Mar 16 17:33:43 crc kubenswrapper[5120]: E0316 17:33:43.665662 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 17:33:43 crc kubenswrapper[5120]: I0316 17:33:43.695287 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/61bf94c7-387e-4d45-8b1a-e29a14b476f0-edpm-compute-no-nodes" (OuterVolumeSpecName: "edpm-compute-no-nodes") pod "61bf94c7-387e-4d45-8b1a-e29a14b476f0" (UID: "61bf94c7-387e-4d45-8b1a-e29a14b476f0"). InnerVolumeSpecName "edpm-compute-no-nodes". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:33:43 crc kubenswrapper[5120]: I0316 17:33:43.696319 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/61bf94c7-387e-4d45-8b1a-e29a14b476f0-config" (OuterVolumeSpecName: "config") pod "61bf94c7-387e-4d45-8b1a-e29a14b476f0" (UID: "61bf94c7-387e-4d45-8b1a-e29a14b476f0"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:33:43 crc kubenswrapper[5120]: I0316 17:33:43.696962 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/61bf94c7-387e-4d45-8b1a-e29a14b476f0-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "61bf94c7-387e-4d45-8b1a-e29a14b476f0" (UID: "61bf94c7-387e-4d45-8b1a-e29a14b476f0"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:33:43 crc kubenswrapper[5120]: I0316 17:33:43.762509 5120 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/61bf94c7-387e-4d45-8b1a-e29a14b476f0-config\") on node \"crc\" DevicePath \"\"" Mar 16 17:33:43 crc kubenswrapper[5120]: I0316 17:33:43.762548 5120 reconciler_common.go:299] "Volume detached for volume \"edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/configmap/61bf94c7-387e-4d45-8b1a-e29a14b476f0-edpm-compute-no-nodes\") on node \"crc\" DevicePath \"\"" Mar 16 17:33:43 crc kubenswrapper[5120]: I0316 17:33:43.762562 5120 reconciler_common.go:299] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/61bf94c7-387e-4d45-8b1a-e29a14b476f0-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Mar 16 17:33:43 crc kubenswrapper[5120]: I0316 17:33:43.762577 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4xn54\" (UniqueName: \"kubernetes.io/projected/61bf94c7-387e-4d45-8b1a-e29a14b476f0-kube-api-access-4xn54\") on node \"crc\" DevicePath \"\"" Mar 16 17:33:44 crc kubenswrapper[5120]: I0316 17:33:44.430237 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-8c5974765-rmj8x" Mar 16 17:33:44 crc kubenswrapper[5120]: I0316 17:33:44.430264 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-8c5974765-rmj8x" event={"ID":"61bf94c7-387e-4d45-8b1a-e29a14b476f0","Type":"ContainerDied","Data":"9d2c974a07960db34cff8446ad34381e56f9656638a4c574b92e3130de2a5f36"} Mar 16 17:33:44 crc kubenswrapper[5120]: I0316 17:33:44.431048 5120 scope.go:117] "RemoveContainer" containerID="f98c97c898650b78de8ec0b27d977220887db87a28847113b799c001f32e3ddb" Mar 16 17:33:44 crc kubenswrapper[5120]: I0316 17:33:44.454092 5120 scope.go:117] "RemoveContainer" containerID="a5f029bd928cc490ae2ada03dec6c76ce7ae082a398404ef6a5f46817a21499f" Mar 16 17:33:44 crc kubenswrapper[5120]: I0316 17:33:44.469899 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-8c5974765-rmj8x"] Mar 16 17:33:44 crc kubenswrapper[5120]: I0316 17:33:44.477714 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-8c5974765-rmj8x"] Mar 16 17:33:44 crc kubenswrapper[5120]: I0316 17:33:44.681809 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="61bf94c7-387e-4d45-8b1a-e29a14b476f0" path="/var/lib/kubelet/pods/61bf94c7-387e-4d45-8b1a-e29a14b476f0/volumes" Mar 16 17:33:49 crc kubenswrapper[5120]: E0316 17:33:49.345598 5120 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded2165fd_95f2_40f7_a860_70b81d6ab977.slice/crio-5e696788c3a844d4ec752d5af523e578b1132a27c237c44a42ed0f439f974a09.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f53cb77_0d21_4cd7_81c0_d003500184f1.slice/crio-conmon-af160f46b56e7465ca7930c0926d2c81d89bc4d73fe0c22293a02940de9f414f.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78743df2_449e_44ab_91f1_ac48af33b657.slice/crio-conmon-e2579a5f5422a476f71f7cbdd4956f87e25a1665768e12a05d68434c8a974b9f.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f53cb77_0d21_4cd7_81c0_d003500184f1.slice/crio-af160f46b56e7465ca7930c0926d2c81d89bc4d73fe0c22293a02940de9f414f.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod127fb533_a6f7_4dc2_85d9_69ec57116fe9.slice/crio-354866e7009f17f044d6646ccb1748c884509fad24b122da4aef3b09d4134ba1.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod127fb533_a6f7_4dc2_85d9_69ec57116fe9.slice/crio-conmon-354866e7009f17f044d6646ccb1748c884509fad24b122da4aef3b09d4134ba1.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded2165fd_95f2_40f7_a860_70b81d6ab977.slice/crio-conmon-5e696788c3a844d4ec752d5af523e578b1132a27c237c44a42ed0f439f974a09.scope\": RecentStats: unable to find data in memory cache]" Mar 16 17:33:58 crc kubenswrapper[5120]: I0316 17:33:58.669493 5120 scope.go:117] "RemoveContainer" containerID="df0a87b047c8208d5fc21057efed33321f6cab49c4cf053702d222dc12979450" Mar 16 17:33:59 crc kubenswrapper[5120]: E0316 17:33:59.491122 5120 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod127fb533_a6f7_4dc2_85d9_69ec57116fe9.slice/crio-conmon-354866e7009f17f044d6646ccb1748c884509fad24b122da4aef3b09d4134ba1.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78743df2_449e_44ab_91f1_ac48af33b657.slice/crio-conmon-e2579a5f5422a476f71f7cbdd4956f87e25a1665768e12a05d68434c8a974b9f.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod127fb533_a6f7_4dc2_85d9_69ec57116fe9.slice/crio-354866e7009f17f044d6646ccb1748c884509fad24b122da4aef3b09d4134ba1.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded2165fd_95f2_40f7_a860_70b81d6ab977.slice/crio-conmon-5e696788c3a844d4ec752d5af523e578b1132a27c237c44a42ed0f439f974a09.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded2165fd_95f2_40f7_a860_70b81d6ab977.slice/crio-5e696788c3a844d4ec752d5af523e578b1132a27c237c44a42ed0f439f974a09.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f53cb77_0d21_4cd7_81c0_d003500184f1.slice/crio-conmon-af160f46b56e7465ca7930c0926d2c81d89bc4d73fe0c22293a02940de9f414f.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f53cb77_0d21_4cd7_81c0_d003500184f1.slice/crio-af160f46b56e7465ca7930c0926d2c81d89bc4d73fe0c22293a02940de9f414f.scope\": RecentStats: unable to find data in memory cache]" Mar 16 17:33:59 crc kubenswrapper[5120]: I0316 17:33:59.558149 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" event={"ID":"e2275cb4-4905-4d66-a87e-8010120db2bd","Type":"ContainerStarted","Data":"7675132b6a0a3435abd421d258a035263883c4eae7ede1a7f47b92d2e04f90b7"} Mar 16 17:34:00 crc kubenswrapper[5120]: I0316 17:34:00.139521 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-infra/auto-csr-approver-29561374-ddsht"] Mar 16 17:34:00 crc kubenswrapper[5120]: I0316 17:34:00.140685 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e918c50c-96eb-4da3-9b1d-fc31e3582816" containerName="manager" Mar 16 17:34:00 crc kubenswrapper[5120]: I0316 17:34:00.140702 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e918c50c-96eb-4da3-9b1d-fc31e3582816" containerName="manager" Mar 16 17:34:00 crc kubenswrapper[5120]: I0316 17:34:00.140718 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4af61d68-498f-4c1a-812d-91089029f784" containerName="manager" Mar 16 17:34:00 crc kubenswrapper[5120]: I0316 17:34:00.140725 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="4af61d68-498f-4c1a-812d-91089029f784" containerName="manager" Mar 16 17:34:00 crc kubenswrapper[5120]: I0316 17:34:00.140737 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4752ce4e-0b7c-43d7-99dc-b8633f7a2cd7" containerName="manager" Mar 16 17:34:00 crc kubenswrapper[5120]: I0316 17:34:00.140744 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="4752ce4e-0b7c-43d7-99dc-b8633f7a2cd7" containerName="manager" Mar 16 17:34:00 crc kubenswrapper[5120]: I0316 17:34:00.140777 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6b6caa5-b1c3-4ad6-8b0e-0358400bb03b" containerName="manager" Mar 16 17:34:00 crc kubenswrapper[5120]: I0316 17:34:00.140784 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6b6caa5-b1c3-4ad6-8b0e-0358400bb03b" containerName="manager" Mar 16 17:34:00 crc kubenswrapper[5120]: I0316 17:34:00.140797 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42478fad-5a61-4cc1-94cc-ac00bdf30f24" containerName="manager" Mar 16 17:34:00 crc kubenswrapper[5120]: I0316 17:34:00.140807 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="42478fad-5a61-4cc1-94cc-ac00bdf30f24" containerName="manager" Mar 16 17:34:00 crc kubenswrapper[5120]: I0316 17:34:00.140817 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eed7b084-3ca6-41c0-847f-19929fb52c41" containerName="manager" Mar 16 17:34:00 crc kubenswrapper[5120]: I0316 17:34:00.140823 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="eed7b084-3ca6-41c0-847f-19929fb52c41" containerName="manager" Mar 16 17:34:00 crc kubenswrapper[5120]: I0316 17:34:00.140837 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed2165fd-95f2-40f7-a860-70b81d6ab977" containerName="manager" Mar 16 17:34:00 crc kubenswrapper[5120]: I0316 17:34:00.140844 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed2165fd-95f2-40f7-a860-70b81d6ab977" containerName="manager" Mar 16 17:34:00 crc kubenswrapper[5120]: I0316 17:34:00.140854 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2d3e713-eefd-44fd-8784-1f4f54155d8f" containerName="operator" Mar 16 17:34:00 crc kubenswrapper[5120]: I0316 17:34:00.140860 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2d3e713-eefd-44fd-8784-1f4f54155d8f" containerName="operator" Mar 16 17:34:00 crc kubenswrapper[5120]: I0316 17:34:00.140871 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78743df2-449e-44ab-91f1-ac48af33b657" containerName="operator" Mar 16 17:34:00 crc kubenswrapper[5120]: I0316 17:34:00.140877 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="78743df2-449e-44ab-91f1-ac48af33b657" containerName="operator" Mar 16 17:34:00 crc kubenswrapper[5120]: I0316 17:34:00.140884 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e6d8ae5-f5be-4b12-8401-54dcc86da579" containerName="manager" Mar 16 17:34:00 crc kubenswrapper[5120]: I0316 17:34:00.140890 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e6d8ae5-f5be-4b12-8401-54dcc86da579" containerName="manager" Mar 16 17:34:00 crc kubenswrapper[5120]: I0316 17:34:00.140901 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61bf94c7-387e-4d45-8b1a-e29a14b476f0" containerName="dnsmasq-dns" Mar 16 17:34:00 crc kubenswrapper[5120]: I0316 17:34:00.140907 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="61bf94c7-387e-4d45-8b1a-e29a14b476f0" containerName="dnsmasq-dns" Mar 16 17:34:00 crc kubenswrapper[5120]: I0316 17:34:00.140917 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32fa740c-28b3-42a7-8ab5-6d159c237bf8" containerName="manager" Mar 16 17:34:00 crc kubenswrapper[5120]: I0316 17:34:00.140923 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="32fa740c-28b3-42a7-8ab5-6d159c237bf8" containerName="manager" Mar 16 17:34:00 crc kubenswrapper[5120]: I0316 17:34:00.140932 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e46d1032-1fff-4f99-baa0-487aee0eb1bd" containerName="manager" Mar 16 17:34:00 crc kubenswrapper[5120]: I0316 17:34:00.140938 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e46d1032-1fff-4f99-baa0-487aee0eb1bd" containerName="manager" Mar 16 17:34:00 crc kubenswrapper[5120]: I0316 17:34:00.140947 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f62d5d6a-d638-4968-902f-8eb726c039c1" containerName="manager" Mar 16 17:34:00 crc kubenswrapper[5120]: I0316 17:34:00.140954 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f62d5d6a-d638-4968-902f-8eb726c039c1" containerName="manager" Mar 16 17:34:00 crc kubenswrapper[5120]: I0316 17:34:00.140961 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61bf94c7-387e-4d45-8b1a-e29a14b476f0" containerName="init" Mar 16 17:34:00 crc kubenswrapper[5120]: I0316 17:34:00.140966 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="61bf94c7-387e-4d45-8b1a-e29a14b476f0" containerName="init" Mar 16 17:34:00 crc kubenswrapper[5120]: I0316 17:34:00.140974 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="797f2c96-18c7-400b-a46d-795da852b08e" containerName="manager" Mar 16 17:34:00 crc kubenswrapper[5120]: I0316 17:34:00.140983 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="797f2c96-18c7-400b-a46d-795da852b08e" containerName="manager" Mar 16 17:34:00 crc kubenswrapper[5120]: I0316 17:34:00.140995 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="127fb533-a6f7-4dc2-85d9-69ec57116fe9" containerName="registry-server" Mar 16 17:34:00 crc kubenswrapper[5120]: I0316 17:34:00.141001 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="127fb533-a6f7-4dc2-85d9-69ec57116fe9" containerName="registry-server" Mar 16 17:34:00 crc kubenswrapper[5120]: I0316 17:34:00.141011 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef52f45c-ba73-4607-8b03-f13fce9806bd" containerName="manager" Mar 16 17:34:00 crc kubenswrapper[5120]: I0316 17:34:00.141017 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef52f45c-ba73-4607-8b03-f13fce9806bd" containerName="manager" Mar 16 17:34:00 crc kubenswrapper[5120]: I0316 17:34:00.141025 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b105271-39d9-4339-a315-3aa161a54b31" containerName="manager" Mar 16 17:34:00 crc kubenswrapper[5120]: I0316 17:34:00.141031 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b105271-39d9-4339-a315-3aa161a54b31" containerName="manager" Mar 16 17:34:00 crc kubenswrapper[5120]: I0316 17:34:00.141041 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bbc9f690-e60b-4c8a-b84a-2d8a3ca2001f" containerName="manager" Mar 16 17:34:00 crc kubenswrapper[5120]: I0316 17:34:00.141047 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="bbc9f690-e60b-4c8a-b84a-2d8a3ca2001f" containerName="manager" Mar 16 17:34:00 crc kubenswrapper[5120]: I0316 17:34:00.141061 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="201aeec6-1404-4b8d-8cf7-4d2550cc9898" containerName="manager" Mar 16 17:34:00 crc kubenswrapper[5120]: I0316 17:34:00.141067 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="201aeec6-1404-4b8d-8cf7-4d2550cc9898" containerName="manager" Mar 16 17:34:00 crc kubenswrapper[5120]: I0316 17:34:00.141077 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a11dd5a-29d6-4791-849c-97b08acb5b4e" containerName="manager" Mar 16 17:34:00 crc kubenswrapper[5120]: I0316 17:34:00.141084 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a11dd5a-29d6-4791-849c-97b08acb5b4e" containerName="manager" Mar 16 17:34:00 crc kubenswrapper[5120]: I0316 17:34:00.141091 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f53cb77-0d21-4cd7-81c0-d003500184f1" containerName="catalog-operator" Mar 16 17:34:00 crc kubenswrapper[5120]: I0316 17:34:00.141097 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f53cb77-0d21-4cd7-81c0-d003500184f1" containerName="catalog-operator" Mar 16 17:34:00 crc kubenswrapper[5120]: I0316 17:34:00.141119 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66faede0-c074-49ca-8bf9-9b5777b02edf" containerName="manager" Mar 16 17:34:00 crc kubenswrapper[5120]: I0316 17:34:00.141125 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="66faede0-c074-49ca-8bf9-9b5777b02edf" containerName="manager" Mar 16 17:34:00 crc kubenswrapper[5120]: I0316 17:34:00.141133 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fc99f04-8366-4f00-9ce1-d0e4faf1d0a3" containerName="manager" Mar 16 17:34:00 crc kubenswrapper[5120]: I0316 17:34:00.141140 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fc99f04-8366-4f00-9ce1-d0e4faf1d0a3" containerName="manager" Mar 16 17:34:00 crc kubenswrapper[5120]: I0316 17:34:00.141150 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91595c8f-09e8-4cdd-8054-1f46eafa27ad" containerName="manager" Mar 16 17:34:00 crc kubenswrapper[5120]: I0316 17:34:00.141156 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="91595c8f-09e8-4cdd-8054-1f46eafa27ad" containerName="manager" Mar 16 17:34:00 crc kubenswrapper[5120]: I0316 17:34:00.141163 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8643ed10-e4fd-4b97-ae36-c4b581cdef1b" containerName="manager" Mar 16 17:34:00 crc kubenswrapper[5120]: I0316 17:34:00.141169 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8643ed10-e4fd-4b97-ae36-c4b581cdef1b" containerName="manager" Mar 16 17:34:00 crc kubenswrapper[5120]: I0316 17:34:00.141182 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5403564-ecbf-4103-89b6-530a8381c664" containerName="manager" Mar 16 17:34:00 crc kubenswrapper[5120]: I0316 17:34:00.141190 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5403564-ecbf-4103-89b6-530a8381c664" containerName="manager" Mar 16 17:34:00 crc kubenswrapper[5120]: I0316 17:34:00.141316 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ef52f45c-ba73-4607-8b03-f13fce9806bd" containerName="manager" Mar 16 17:34:00 crc kubenswrapper[5120]: I0316 17:34:00.141332 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="66faede0-c074-49ca-8bf9-9b5777b02edf" containerName="manager" Mar 16 17:34:00 crc kubenswrapper[5120]: I0316 17:34:00.141339 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e46d1032-1fff-4f99-baa0-487aee0eb1bd" containerName="manager" Mar 16 17:34:00 crc kubenswrapper[5120]: I0316 17:34:00.141347 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="d2d3e713-eefd-44fd-8784-1f4f54155d8f" containerName="operator" Mar 16 17:34:00 crc kubenswrapper[5120]: I0316 17:34:00.141356 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="8643ed10-e4fd-4b97-ae36-c4b581cdef1b" containerName="manager" Mar 16 17:34:00 crc kubenswrapper[5120]: I0316 17:34:00.141366 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="797f2c96-18c7-400b-a46d-795da852b08e" containerName="manager" Mar 16 17:34:00 crc kubenswrapper[5120]: I0316 17:34:00.141375 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="78743df2-449e-44ab-91f1-ac48af33b657" containerName="operator" Mar 16 17:34:00 crc kubenswrapper[5120]: I0316 17:34:00.141389 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ed2165fd-95f2-40f7-a860-70b81d6ab977" containerName="manager" Mar 16 17:34:00 crc kubenswrapper[5120]: I0316 17:34:00.141398 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="4752ce4e-0b7c-43d7-99dc-b8633f7a2cd7" containerName="manager" Mar 16 17:34:00 crc kubenswrapper[5120]: I0316 17:34:00.141406 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="4af61d68-498f-4c1a-812d-91089029f784" containerName="manager" Mar 16 17:34:00 crc kubenswrapper[5120]: I0316 17:34:00.141415 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e6b6caa5-b1c3-4ad6-8b0e-0358400bb03b" containerName="manager" Mar 16 17:34:00 crc kubenswrapper[5120]: I0316 17:34:00.141423 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="eed7b084-3ca6-41c0-847f-19929fb52c41" containerName="manager" Mar 16 17:34:00 crc kubenswrapper[5120]: I0316 17:34:00.141431 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="3b105271-39d9-4339-a315-3aa161a54b31" containerName="manager" Mar 16 17:34:00 crc kubenswrapper[5120]: I0316 17:34:00.141439 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="32fa740c-28b3-42a7-8ab5-6d159c237bf8" containerName="manager" Mar 16 17:34:00 crc kubenswrapper[5120]: I0316 17:34:00.141448 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="2fc99f04-8366-4f00-9ce1-d0e4faf1d0a3" containerName="manager" Mar 16 17:34:00 crc kubenswrapper[5120]: I0316 17:34:00.141455 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f62d5d6a-d638-4968-902f-8eb726c039c1" containerName="manager" Mar 16 17:34:00 crc kubenswrapper[5120]: I0316 17:34:00.141463 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="8a11dd5a-29d6-4791-849c-97b08acb5b4e" containerName="manager" Mar 16 17:34:00 crc kubenswrapper[5120]: I0316 17:34:00.141471 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="91595c8f-09e8-4cdd-8054-1f46eafa27ad" containerName="manager" Mar 16 17:34:00 crc kubenswrapper[5120]: I0316 17:34:00.141479 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="42478fad-5a61-4cc1-94cc-ac00bdf30f24" containerName="manager" Mar 16 17:34:00 crc kubenswrapper[5120]: I0316 17:34:00.141490 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="8e6d8ae5-f5be-4b12-8401-54dcc86da579" containerName="manager" Mar 16 17:34:00 crc kubenswrapper[5120]: I0316 17:34:00.141499 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="bbc9f690-e60b-4c8a-b84a-2d8a3ca2001f" containerName="manager" Mar 16 17:34:00 crc kubenswrapper[5120]: I0316 17:34:00.141510 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e918c50c-96eb-4da3-9b1d-fc31e3582816" containerName="manager" Mar 16 17:34:00 crc kubenswrapper[5120]: I0316 17:34:00.141520 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7f53cb77-0d21-4cd7-81c0-d003500184f1" containerName="catalog-operator" Mar 16 17:34:00 crc kubenswrapper[5120]: I0316 17:34:00.141534 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="201aeec6-1404-4b8d-8cf7-4d2550cc9898" containerName="manager" Mar 16 17:34:00 crc kubenswrapper[5120]: I0316 17:34:00.141544 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f5403564-ecbf-4103-89b6-530a8381c664" containerName="manager" Mar 16 17:34:00 crc kubenswrapper[5120]: I0316 17:34:00.141555 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="127fb533-a6f7-4dc2-85d9-69ec57116fe9" containerName="registry-server" Mar 16 17:34:00 crc kubenswrapper[5120]: I0316 17:34:00.141564 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="61bf94c7-387e-4d45-8b1a-e29a14b476f0" containerName="dnsmasq-dns" Mar 16 17:34:00 crc kubenswrapper[5120]: I0316 17:34:00.146961 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561374-ddsht"] Mar 16 17:34:00 crc kubenswrapper[5120]: I0316 17:34:00.147093 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561374-ddsht" Mar 16 17:34:00 crc kubenswrapper[5120]: I0316 17:34:00.148658 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"kube-root-ca.crt\"" Mar 16 17:34:00 crc kubenswrapper[5120]: I0316 17:34:00.149070 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"openshift-service-ca.crt\"" Mar 16 17:34:00 crc kubenswrapper[5120]: I0316 17:34:00.149206 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-infra\"/\"csr-approver-sa-dockercfg-x2nsz\"" Mar 16 17:34:00 crc kubenswrapper[5120]: I0316 17:34:00.299996 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8bgp\" (UniqueName: \"kubernetes.io/projected/5e2dabcd-8d5f-437e-8873-f212db862eb1-kube-api-access-m8bgp\") pod \"auto-csr-approver-29561374-ddsht\" (UID: \"5e2dabcd-8d5f-437e-8873-f212db862eb1\") " pod="openshift-infra/auto-csr-approver-29561374-ddsht" Mar 16 17:34:00 crc kubenswrapper[5120]: I0316 17:34:00.401459 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m8bgp\" (UniqueName: \"kubernetes.io/projected/5e2dabcd-8d5f-437e-8873-f212db862eb1-kube-api-access-m8bgp\") pod \"auto-csr-approver-29561374-ddsht\" (UID: \"5e2dabcd-8d5f-437e-8873-f212db862eb1\") " pod="openshift-infra/auto-csr-approver-29561374-ddsht" Mar 16 17:34:00 crc kubenswrapper[5120]: I0316 17:34:00.419180 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8bgp\" (UniqueName: \"kubernetes.io/projected/5e2dabcd-8d5f-437e-8873-f212db862eb1-kube-api-access-m8bgp\") pod \"auto-csr-approver-29561374-ddsht\" (UID: \"5e2dabcd-8d5f-437e-8873-f212db862eb1\") " pod="openshift-infra/auto-csr-approver-29561374-ddsht" Mar 16 17:34:00 crc kubenswrapper[5120]: I0316 17:34:00.469093 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561374-ddsht" Mar 16 17:34:00 crc kubenswrapper[5120]: I0316 17:34:00.671306 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561374-ddsht"] Mar 16 17:34:00 crc kubenswrapper[5120]: W0316 17:34:00.672352 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5e2dabcd_8d5f_437e_8873_f212db862eb1.slice/crio-69e1aca7656a4e2bfd938e4f6469fcd4de7164c75d6ffdae52227725567228ca WatchSource:0}: Error finding container 69e1aca7656a4e2bfd938e4f6469fcd4de7164c75d6ffdae52227725567228ca: Status 404 returned error can't find the container with id 69e1aca7656a4e2bfd938e4f6469fcd4de7164c75d6ffdae52227725567228ca Mar 16 17:34:01 crc kubenswrapper[5120]: I0316 17:34:01.579485 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561374-ddsht" event={"ID":"5e2dabcd-8d5f-437e-8873-f212db862eb1","Type":"ContainerStarted","Data":"69e1aca7656a4e2bfd938e4f6469fcd4de7164c75d6ffdae52227725567228ca"} Mar 16 17:34:02 crc kubenswrapper[5120]: I0316 17:34:02.590225 5120 generic.go:358] "Generic (PLEG): container finished" podID="5e2dabcd-8d5f-437e-8873-f212db862eb1" containerID="bbbc61f4cfac21dffa0e396eca660e866247eccac63f4b6bac12d7e504c58eef" exitCode=0 Mar 16 17:34:02 crc kubenswrapper[5120]: I0316 17:34:02.590279 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561374-ddsht" event={"ID":"5e2dabcd-8d5f-437e-8873-f212db862eb1","Type":"ContainerDied","Data":"bbbc61f4cfac21dffa0e396eca660e866247eccac63f4b6bac12d7e504c58eef"} Mar 16 17:34:03 crc kubenswrapper[5120]: I0316 17:34:03.824272 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561374-ddsht" Mar 16 17:34:03 crc kubenswrapper[5120]: I0316 17:34:03.872891 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m8bgp\" (UniqueName: \"kubernetes.io/projected/5e2dabcd-8d5f-437e-8873-f212db862eb1-kube-api-access-m8bgp\") pod \"5e2dabcd-8d5f-437e-8873-f212db862eb1\" (UID: \"5e2dabcd-8d5f-437e-8873-f212db862eb1\") " Mar 16 17:34:03 crc kubenswrapper[5120]: I0316 17:34:03.879211 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e2dabcd-8d5f-437e-8873-f212db862eb1-kube-api-access-m8bgp" (OuterVolumeSpecName: "kube-api-access-m8bgp") pod "5e2dabcd-8d5f-437e-8873-f212db862eb1" (UID: "5e2dabcd-8d5f-437e-8873-f212db862eb1"). InnerVolumeSpecName "kube-api-access-m8bgp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:34:03 crc kubenswrapper[5120]: I0316 17:34:03.975186 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m8bgp\" (UniqueName: \"kubernetes.io/projected/5e2dabcd-8d5f-437e-8873-f212db862eb1-kube-api-access-m8bgp\") on node \"crc\" DevicePath \"\"" Mar 16 17:34:04 crc kubenswrapper[5120]: I0316 17:34:04.606920 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561374-ddsht" event={"ID":"5e2dabcd-8d5f-437e-8873-f212db862eb1","Type":"ContainerDied","Data":"69e1aca7656a4e2bfd938e4f6469fcd4de7164c75d6ffdae52227725567228ca"} Mar 16 17:34:04 crc kubenswrapper[5120]: I0316 17:34:04.606969 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="69e1aca7656a4e2bfd938e4f6469fcd4de7164c75d6ffdae52227725567228ca" Mar 16 17:34:04 crc kubenswrapper[5120]: I0316 17:34:04.606890 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561374-ddsht" Mar 16 17:34:04 crc kubenswrapper[5120]: I0316 17:34:04.874205 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-infra/auto-csr-approver-29561368-k94zr"] Mar 16 17:34:04 crc kubenswrapper[5120]: I0316 17:34:04.879111 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-infra/auto-csr-approver-29561368-k94zr"] Mar 16 17:34:06 crc kubenswrapper[5120]: I0316 17:34:06.672551 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a6309f04-ff19-4337-911a-3b6125f1bc18" path="/var/lib/kubelet/pods/a6309f04-ff19-4337-911a-3b6125f1bc18/volumes" Mar 16 17:34:07 crc kubenswrapper[5120]: E0316 17:34:07.136156 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=848766 actualBytes=10240 Mar 16 17:34:09 crc kubenswrapper[5120]: E0316 17:34:09.633139 5120 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f53cb77_0d21_4cd7_81c0_d003500184f1.slice/crio-af160f46b56e7465ca7930c0926d2c81d89bc4d73fe0c22293a02940de9f414f.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod127fb533_a6f7_4dc2_85d9_69ec57116fe9.slice/crio-conmon-354866e7009f17f044d6646ccb1748c884509fad24b122da4aef3b09d4134ba1.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded2165fd_95f2_40f7_a860_70b81d6ab977.slice/crio-5e696788c3a844d4ec752d5af523e578b1132a27c237c44a42ed0f439f974a09.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78743df2_449e_44ab_91f1_ac48af33b657.slice/crio-conmon-e2579a5f5422a476f71f7cbdd4956f87e25a1665768e12a05d68434c8a974b9f.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded2165fd_95f2_40f7_a860_70b81d6ab977.slice/crio-conmon-5e696788c3a844d4ec752d5af523e578b1132a27c237c44a42ed0f439f974a09.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f53cb77_0d21_4cd7_81c0_d003500184f1.slice/crio-conmon-af160f46b56e7465ca7930c0926d2c81d89bc4d73fe0c22293a02940de9f414f.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod127fb533_a6f7_4dc2_85d9_69ec57116fe9.slice/crio-354866e7009f17f044d6646ccb1748c884509fad24b122da4aef3b09d4134ba1.scope\": RecentStats: unable to find data in memory cache]" Mar 16 17:34:19 crc kubenswrapper[5120]: E0316 17:34:19.799142 5120 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod127fb533_a6f7_4dc2_85d9_69ec57116fe9.slice/crio-conmon-354866e7009f17f044d6646ccb1748c884509fad24b122da4aef3b09d4134ba1.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f53cb77_0d21_4cd7_81c0_d003500184f1.slice/crio-af160f46b56e7465ca7930c0926d2c81d89bc4d73fe0c22293a02940de9f414f.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod127fb533_a6f7_4dc2_85d9_69ec57116fe9.slice/crio-354866e7009f17f044d6646ccb1748c884509fad24b122da4aef3b09d4134ba1.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded2165fd_95f2_40f7_a860_70b81d6ab977.slice/crio-5e696788c3a844d4ec752d5af523e578b1132a27c237c44a42ed0f439f974a09.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded2165fd_95f2_40f7_a860_70b81d6ab977.slice/crio-conmon-5e696788c3a844d4ec752d5af523e578b1132a27c237c44a42ed0f439f974a09.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f53cb77_0d21_4cd7_81c0_d003500184f1.slice/crio-conmon-af160f46b56e7465ca7930c0926d2c81d89bc4d73fe0c22293a02940de9f414f.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78743df2_449e_44ab_91f1_ac48af33b657.slice/crio-conmon-e2579a5f5422a476f71f7cbdd4956f87e25a1665768e12a05d68434c8a974b9f.scope\": RecentStats: unable to find data in memory cache]" Mar 16 17:34:26 crc kubenswrapper[5120]: I0316 17:34:26.402498 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-operators/mariadb-operator-index-5zmkh"] Mar 16 17:34:26 crc kubenswrapper[5120]: I0316 17:34:26.404279 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e2dabcd-8d5f-437e-8873-f212db862eb1" containerName="oc" Mar 16 17:34:26 crc kubenswrapper[5120]: I0316 17:34:26.404298 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e2dabcd-8d5f-437e-8873-f212db862eb1" containerName="oc" Mar 16 17:34:26 crc kubenswrapper[5120]: I0316 17:34:26.404467 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="5e2dabcd-8d5f-437e-8873-f212db862eb1" containerName="oc" Mar 16 17:34:26 crc kubenswrapper[5120]: I0316 17:34:26.409682 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/mariadb-operator-index-5zmkh" Mar 16 17:34:26 crc kubenswrapper[5120]: I0316 17:34:26.415097 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-operators\"/\"openshift-service-ca.crt\"" Mar 16 17:34:26 crc kubenswrapper[5120]: I0316 17:34:26.415105 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-operators\"/\"mariadb-operator-index-dockercfg-mbh4k\"" Mar 16 17:34:26 crc kubenswrapper[5120]: I0316 17:34:26.415391 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-operators\"/\"kube-root-ca.crt\"" Mar 16 17:34:26 crc kubenswrapper[5120]: I0316 17:34:26.422357 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/mariadb-operator-index-5zmkh"] Mar 16 17:34:26 crc kubenswrapper[5120]: I0316 17:34:26.546812 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wcc4l\" (UniqueName: \"kubernetes.io/projected/257aa232-1508-41da-8c07-b2aae95a506e-kube-api-access-wcc4l\") pod \"mariadb-operator-index-5zmkh\" (UID: \"257aa232-1508-41da-8c07-b2aae95a506e\") " pod="openstack-operators/mariadb-operator-index-5zmkh" Mar 16 17:34:26 crc kubenswrapper[5120]: I0316 17:34:26.648701 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wcc4l\" (UniqueName: \"kubernetes.io/projected/257aa232-1508-41da-8c07-b2aae95a506e-kube-api-access-wcc4l\") pod \"mariadb-operator-index-5zmkh\" (UID: \"257aa232-1508-41da-8c07-b2aae95a506e\") " pod="openstack-operators/mariadb-operator-index-5zmkh" Mar 16 17:34:26 crc kubenswrapper[5120]: I0316 17:34:26.667739 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wcc4l\" (UniqueName: \"kubernetes.io/projected/257aa232-1508-41da-8c07-b2aae95a506e-kube-api-access-wcc4l\") pod \"mariadb-operator-index-5zmkh\" (UID: \"257aa232-1508-41da-8c07-b2aae95a506e\") " pod="openstack-operators/mariadb-operator-index-5zmkh" Mar 16 17:34:26 crc kubenswrapper[5120]: I0316 17:34:26.734906 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/mariadb-operator-index-5zmkh" Mar 16 17:34:26 crc kubenswrapper[5120]: I0316 17:34:26.778126 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/mariadb-operator-index-5zmkh"] Mar 16 17:34:26 crc kubenswrapper[5120]: I0316 17:34:26.983662 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-operators/mariadb-operator-index-tj5ss"] Mar 16 17:34:26 crc kubenswrapper[5120]: I0316 17:34:26.990566 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/mariadb-operator-index-tj5ss"] Mar 16 17:34:26 crc kubenswrapper[5120]: I0316 17:34:26.990750 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/mariadb-operator-index-tj5ss" Mar 16 17:34:27 crc kubenswrapper[5120]: I0316 17:34:27.138695 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/mariadb-operator-index-5zmkh"] Mar 16 17:34:27 crc kubenswrapper[5120]: I0316 17:34:27.158601 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ksbms\" (UniqueName: \"kubernetes.io/projected/f0ee03d7-2cda-48de-94bd-b0ab8c1794a4-kube-api-access-ksbms\") pod \"mariadb-operator-index-tj5ss\" (UID: \"f0ee03d7-2cda-48de-94bd-b0ab8c1794a4\") " pod="openstack-operators/mariadb-operator-index-tj5ss" Mar 16 17:34:27 crc kubenswrapper[5120]: I0316 17:34:27.260477 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ksbms\" (UniqueName: \"kubernetes.io/projected/f0ee03d7-2cda-48de-94bd-b0ab8c1794a4-kube-api-access-ksbms\") pod \"mariadb-operator-index-tj5ss\" (UID: \"f0ee03d7-2cda-48de-94bd-b0ab8c1794a4\") " pod="openstack-operators/mariadb-operator-index-tj5ss" Mar 16 17:34:27 crc kubenswrapper[5120]: I0316 17:34:27.283947 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ksbms\" (UniqueName: \"kubernetes.io/projected/f0ee03d7-2cda-48de-94bd-b0ab8c1794a4-kube-api-access-ksbms\") pod \"mariadb-operator-index-tj5ss\" (UID: \"f0ee03d7-2cda-48de-94bd-b0ab8c1794a4\") " pod="openstack-operators/mariadb-operator-index-tj5ss" Mar 16 17:34:27 crc kubenswrapper[5120]: I0316 17:34:27.312172 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/mariadb-operator-index-tj5ss" Mar 16 17:34:27 crc kubenswrapper[5120]: I0316 17:34:27.553279 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/mariadb-operator-index-tj5ss"] Mar 16 17:34:27 crc kubenswrapper[5120]: W0316 17:34:27.558872 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0ee03d7_2cda_48de_94bd_b0ab8c1794a4.slice/crio-10c70aeb0c5a1aeab0e8b1eef65a8afb88d89e47ddc70e2d8464992d1468fef3 WatchSource:0}: Error finding container 10c70aeb0c5a1aeab0e8b1eef65a8afb88d89e47ddc70e2d8464992d1468fef3: Status 404 returned error can't find the container with id 10c70aeb0c5a1aeab0e8b1eef65a8afb88d89e47ddc70e2d8464992d1468fef3 Mar 16 17:34:27 crc kubenswrapper[5120]: I0316 17:34:27.811118 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/mariadb-operator-index-5zmkh" event={"ID":"257aa232-1508-41da-8c07-b2aae95a506e","Type":"ContainerStarted","Data":"ccbf88611825956f6bb28e8f25c5c7346fb2ac8fd68a7697628dddca5a4144be"} Mar 16 17:34:27 crc kubenswrapper[5120]: I0316 17:34:27.812289 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/mariadb-operator-index-tj5ss" event={"ID":"f0ee03d7-2cda-48de-94bd-b0ab8c1794a4","Type":"ContainerStarted","Data":"10c70aeb0c5a1aeab0e8b1eef65a8afb88d89e47ddc70e2d8464992d1468fef3"} Mar 16 17:34:29 crc kubenswrapper[5120]: I0316 17:34:29.834290 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/mariadb-operator-index-tj5ss" event={"ID":"f0ee03d7-2cda-48de-94bd-b0ab8c1794a4","Type":"ContainerStarted","Data":"e9b1a5a9c9de1fc800e7c8858e87fb37e271611ceeaae27ffeb96a83dac79fe5"} Mar 16 17:34:29 crc kubenswrapper[5120]: I0316 17:34:29.835944 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/mariadb-operator-index-5zmkh" event={"ID":"257aa232-1508-41da-8c07-b2aae95a506e","Type":"ContainerStarted","Data":"db403e2d7ce646849e6fdb33f191c52701cea75ac87400987b7dbeb019769744"} Mar 16 17:34:29 crc kubenswrapper[5120]: I0316 17:34:29.836029 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-operators/mariadb-operator-index-5zmkh" podUID="257aa232-1508-41da-8c07-b2aae95a506e" containerName="registry-server" containerID="cri-o://db403e2d7ce646849e6fdb33f191c52701cea75ac87400987b7dbeb019769744" gracePeriod=2 Mar 16 17:34:29 crc kubenswrapper[5120]: I0316 17:34:29.859844 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/mariadb-operator-index-tj5ss" podStartSLOduration=2.488856241 podStartE2EDuration="3.859822833s" podCreationTimestamp="2026-03-16 17:34:26 +0000 UTC" firstStartedPulling="2026-03-16 17:34:27.560384724 +0000 UTC m=+7369.714316381" lastFinishedPulling="2026-03-16 17:34:28.931351316 +0000 UTC m=+7371.085282973" observedRunningTime="2026-03-16 17:34:29.856323768 +0000 UTC m=+7372.010255435" watchObservedRunningTime="2026-03-16 17:34:29.859822833 +0000 UTC m=+7372.013754490" Mar 16 17:34:29 crc kubenswrapper[5120]: I0316 17:34:29.872327 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/mariadb-operator-index-5zmkh" podStartSLOduration=2.08535868 podStartE2EDuration="3.872306143s" podCreationTimestamp="2026-03-16 17:34:26 +0000 UTC" firstStartedPulling="2026-03-16 17:34:27.146065358 +0000 UTC m=+7369.299997045" lastFinishedPulling="2026-03-16 17:34:28.933012851 +0000 UTC m=+7371.086944508" observedRunningTime="2026-03-16 17:34:29.868799888 +0000 UTC m=+7372.022731575" watchObservedRunningTime="2026-03-16 17:34:29.872306143 +0000 UTC m=+7372.026237800" Mar 16 17:34:29 crc kubenswrapper[5120]: I0316 17:34:29.940451 5120 scope.go:117] "RemoveContainer" containerID="455cd5587849bda55db253e5cdc2fe50dcbd0d8347cd795abb08d3a957dce0d3" Mar 16 17:34:29 crc kubenswrapper[5120]: E0316 17:34:29.980859 5120 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod127fb533_a6f7_4dc2_85d9_69ec57116fe9.slice/crio-354866e7009f17f044d6646ccb1748c884509fad24b122da4aef3b09d4134ba1.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded2165fd_95f2_40f7_a860_70b81d6ab977.slice/crio-5e696788c3a844d4ec752d5af523e578b1132a27c237c44a42ed0f439f974a09.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded2165fd_95f2_40f7_a860_70b81d6ab977.slice/crio-conmon-5e696788c3a844d4ec752d5af523e578b1132a27c237c44a42ed0f439f974a09.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod257aa232_1508_41da_8c07_b2aae95a506e.slice/crio-conmon-db403e2d7ce646849e6fdb33f191c52701cea75ac87400987b7dbeb019769744.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f53cb77_0d21_4cd7_81c0_d003500184f1.slice/crio-af160f46b56e7465ca7930c0926d2c81d89bc4d73fe0c22293a02940de9f414f.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod257aa232_1508_41da_8c07_b2aae95a506e.slice/crio-db403e2d7ce646849e6fdb33f191c52701cea75ac87400987b7dbeb019769744.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod127fb533_a6f7_4dc2_85d9_69ec57116fe9.slice/crio-conmon-354866e7009f17f044d6646ccb1748c884509fad24b122da4aef3b09d4134ba1.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f53cb77_0d21_4cd7_81c0_d003500184f1.slice/crio-conmon-af160f46b56e7465ca7930c0926d2c81d89bc4d73fe0c22293a02940de9f414f.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78743df2_449e_44ab_91f1_ac48af33b657.slice/crio-conmon-e2579a5f5422a476f71f7cbdd4956f87e25a1665768e12a05d68434c8a974b9f.scope\": RecentStats: unable to find data in memory cache]" Mar 16 17:34:30 crc kubenswrapper[5120]: I0316 17:34:30.003846 5120 scope.go:117] "RemoveContainer" containerID="08d811cb878e0e1223af22a6f3068e2745debf6cc51d35a5c988385cc1938379" Mar 16 17:34:30 crc kubenswrapper[5120]: I0316 17:34:30.026168 5120 scope.go:117] "RemoveContainer" containerID="9400626ed96f9196ac2177fe5b97b2f99a23d54b8aba032cd07a65b4fa62261b" Mar 16 17:34:30 crc kubenswrapper[5120]: I0316 17:34:30.047109 5120 scope.go:117] "RemoveContainer" containerID="ba2d7e8fb80dd5f1cea3845025bb460e85d914e39fff650768c91d758e0cb42f" Mar 16 17:34:30 crc kubenswrapper[5120]: I0316 17:34:30.067053 5120 scope.go:117] "RemoveContainer" containerID="4dcde05605706042f7e10545568428ec80e8abcb93a4246f1298c6443f160ec6" Mar 16 17:34:30 crc kubenswrapper[5120]: I0316 17:34:30.088048 5120 scope.go:117] "RemoveContainer" containerID="7147fb70d7eff7d193b24eeaf61cecb82183c9f95fb6068bd666cb6bd4a3c594" Mar 16 17:34:30 crc kubenswrapper[5120]: I0316 17:34:30.123972 5120 scope.go:117] "RemoveContainer" containerID="d36ab310f9eb32a43a7c5c1b874115c89e446170f7a4f5b94c195832631225ab" Mar 16 17:34:30 crc kubenswrapper[5120]: I0316 17:34:30.145020 5120 scope.go:117] "RemoveContainer" containerID="3da52e15c02df0a82c598ff490b54b787b7fe711f2a17e60e6ee0f883e895fa1" Mar 16 17:34:30 crc kubenswrapper[5120]: I0316 17:34:30.179196 5120 scope.go:117] "RemoveContainer" containerID="74b759d17c7d6bc10253b03d120e87e3c039046a6d9f3afc93394d3573e3b4bb" Mar 16 17:34:30 crc kubenswrapper[5120]: I0316 17:34:30.235177 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/mariadb-operator-index-5zmkh" Mar 16 17:34:30 crc kubenswrapper[5120]: I0316 17:34:30.240540 5120 scope.go:117] "RemoveContainer" containerID="c9f555dc35319e5a738060a949804e12a57019848919f048fb0a5dd0a7b73fc6" Mar 16 17:34:30 crc kubenswrapper[5120]: I0316 17:34:30.274961 5120 scope.go:117] "RemoveContainer" containerID="8a7d9c15b46652c24e31619db72ffcdd6edc32a99198a149ff7e231290a729b8" Mar 16 17:34:30 crc kubenswrapper[5120]: I0316 17:34:30.291326 5120 scope.go:117] "RemoveContainer" containerID="5d5b640e46450ed8ce04cf6f90f619d4921f4277cd35008ef6120182974b799f" Mar 16 17:34:30 crc kubenswrapper[5120]: I0316 17:34:30.320901 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wcc4l\" (UniqueName: \"kubernetes.io/projected/257aa232-1508-41da-8c07-b2aae95a506e-kube-api-access-wcc4l\") pod \"257aa232-1508-41da-8c07-b2aae95a506e\" (UID: \"257aa232-1508-41da-8c07-b2aae95a506e\") " Mar 16 17:34:30 crc kubenswrapper[5120]: I0316 17:34:30.330238 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/257aa232-1508-41da-8c07-b2aae95a506e-kube-api-access-wcc4l" (OuterVolumeSpecName: "kube-api-access-wcc4l") pod "257aa232-1508-41da-8c07-b2aae95a506e" (UID: "257aa232-1508-41da-8c07-b2aae95a506e"). InnerVolumeSpecName "kube-api-access-wcc4l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:34:30 crc kubenswrapper[5120]: I0316 17:34:30.371359 5120 scope.go:117] "RemoveContainer" containerID="c754a4af15dc7586abc6c7ed6caefdbd2f11739749f4404fba75832cfca01d4f" Mar 16 17:34:30 crc kubenswrapper[5120]: I0316 17:34:30.393326 5120 scope.go:117] "RemoveContainer" containerID="c39c9fd812f20b679694300a29617b4f4b1a9a67c1c9ef8f9aff5b2909489a26" Mar 16 17:34:30 crc kubenswrapper[5120]: I0316 17:34:30.423331 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wcc4l\" (UniqueName: \"kubernetes.io/projected/257aa232-1508-41da-8c07-b2aae95a506e-kube-api-access-wcc4l\") on node \"crc\" DevicePath \"\"" Mar 16 17:34:30 crc kubenswrapper[5120]: I0316 17:34:30.423647 5120 scope.go:117] "RemoveContainer" containerID="8187984f8e77140a5f3d80b9a1039d239792a6246d38550200214f8daab0f7ca" Mar 16 17:34:30 crc kubenswrapper[5120]: I0316 17:34:30.439527 5120 scope.go:117] "RemoveContainer" containerID="e2579a5f5422a476f71f7cbdd4956f87e25a1665768e12a05d68434c8a974b9f" Mar 16 17:34:30 crc kubenswrapper[5120]: I0316 17:34:30.458951 5120 scope.go:117] "RemoveContainer" containerID="1de87f8609842e9f047525b572c69ce524ffb562d47c0be7de1674db25e09051" Mar 16 17:34:30 crc kubenswrapper[5120]: I0316 17:34:30.477795 5120 scope.go:117] "RemoveContainer" containerID="2bea00861ef023a301ed304c08762de77012ab04460a060088be7e7f197b34d7" Mar 16 17:34:30 crc kubenswrapper[5120]: I0316 17:34:30.495811 5120 scope.go:117] "RemoveContainer" containerID="3d5c918342f57ab22227d88adb1cfa9c0d01d92b66766ac6cdb7212a18358892" Mar 16 17:34:30 crc kubenswrapper[5120]: I0316 17:34:30.520215 5120 scope.go:117] "RemoveContainer" containerID="cb53f78efe333f796357e348cca82be325147af2149d1fc52ec920cb98e13edc" Mar 16 17:34:30 crc kubenswrapper[5120]: I0316 17:34:30.544502 5120 scope.go:117] "RemoveContainer" containerID="e4b54519a942b0acd62bf145b92412e8a4c692cf34fe45afb09efb514f012f3e" Mar 16 17:34:30 crc kubenswrapper[5120]: I0316 17:34:30.562154 5120 scope.go:117] "RemoveContainer" containerID="0537f61a62371d26f4334104a5c72f96b6a12dfae432d4aef41caa27dac85d17" Mar 16 17:34:30 crc kubenswrapper[5120]: I0316 17:34:30.588176 5120 scope.go:117] "RemoveContainer" containerID="636f4788fa12f348f3f6e38ef9f3f32d17f195054394d6d4eac0b62afd8629f5" Mar 16 17:34:30 crc kubenswrapper[5120]: I0316 17:34:30.607026 5120 scope.go:117] "RemoveContainer" containerID="76b28721686f76aade4349039a79bd66bf48c80868031b23a4b84de5420eca6a" Mar 16 17:34:30 crc kubenswrapper[5120]: I0316 17:34:30.626505 5120 scope.go:117] "RemoveContainer" containerID="4f9d40eab8b3939295ef3c4ed0e738b3259920fdbf943eaefe6566dbe5b8bbc6" Mar 16 17:34:30 crc kubenswrapper[5120]: I0316 17:34:30.645183 5120 scope.go:117] "RemoveContainer" containerID="aad637e4276cefe545d7e8f3c34770be29be04929f56649a5820a9eb16f8d0ce" Mar 16 17:34:30 crc kubenswrapper[5120]: I0316 17:34:30.681323 5120 scope.go:117] "RemoveContainer" containerID="af160f46b56e7465ca7930c0926d2c81d89bc4d73fe0c22293a02940de9f414f" Mar 16 17:34:30 crc kubenswrapper[5120]: I0316 17:34:30.697803 5120 scope.go:117] "RemoveContainer" containerID="2dd1536f1978caea4100bb4567e6b33537548bb68086b77cbfee09af8ba09f6b" Mar 16 17:34:30 crc kubenswrapper[5120]: I0316 17:34:30.716438 5120 scope.go:117] "RemoveContainer" containerID="4919118b0391f6ba7ac4b1d16b3d5a87d7e6ebefe0bbe46b8922f1b0014f0282" Mar 16 17:34:30 crc kubenswrapper[5120]: I0316 17:34:30.733752 5120 scope.go:117] "RemoveContainer" containerID="1c41db9773336db87d587462f8cb97f5de96f1b4f579e3d8052b9a13bad57ded" Mar 16 17:34:30 crc kubenswrapper[5120]: I0316 17:34:30.752915 5120 scope.go:117] "RemoveContainer" containerID="5e696788c3a844d4ec752d5af523e578b1132a27c237c44a42ed0f439f974a09" Mar 16 17:34:30 crc kubenswrapper[5120]: I0316 17:34:30.783832 5120 scope.go:117] "RemoveContainer" containerID="cd5dbf07e769c93af8e2f9b7a8af06cf9287e9e82f2b76fb7904536eefed6823" Mar 16 17:34:30 crc kubenswrapper[5120]: I0316 17:34:30.803474 5120 scope.go:117] "RemoveContainer" containerID="354866e7009f17f044d6646ccb1748c884509fad24b122da4aef3b09d4134ba1" Mar 16 17:34:30 crc kubenswrapper[5120]: I0316 17:34:30.820559 5120 scope.go:117] "RemoveContainer" containerID="4bb0ceb90fb71a7a432b2d87618203e4ea86bcff6d9cef86f4573b133139af02" Mar 16 17:34:30 crc kubenswrapper[5120]: I0316 17:34:30.836790 5120 scope.go:117] "RemoveContainer" containerID="163918bdf98d1c1c3ca79246758fb544bcb919c9ecb8c47189928bbe3245b4d6" Mar 16 17:34:30 crc kubenswrapper[5120]: I0316 17:34:30.846478 5120 generic.go:358] "Generic (PLEG): container finished" podID="257aa232-1508-41da-8c07-b2aae95a506e" containerID="db403e2d7ce646849e6fdb33f191c52701cea75ac87400987b7dbeb019769744" exitCode=0 Mar 16 17:34:30 crc kubenswrapper[5120]: I0316 17:34:30.846554 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/mariadb-operator-index-5zmkh" event={"ID":"257aa232-1508-41da-8c07-b2aae95a506e","Type":"ContainerDied","Data":"db403e2d7ce646849e6fdb33f191c52701cea75ac87400987b7dbeb019769744"} Mar 16 17:34:30 crc kubenswrapper[5120]: I0316 17:34:30.846583 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/mariadb-operator-index-5zmkh" event={"ID":"257aa232-1508-41da-8c07-b2aae95a506e","Type":"ContainerDied","Data":"ccbf88611825956f6bb28e8f25c5c7346fb2ac8fd68a7697628dddca5a4144be"} Mar 16 17:34:30 crc kubenswrapper[5120]: I0316 17:34:30.846599 5120 scope.go:117] "RemoveContainer" containerID="db403e2d7ce646849e6fdb33f191c52701cea75ac87400987b7dbeb019769744" Mar 16 17:34:30 crc kubenswrapper[5120]: I0316 17:34:30.846723 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/mariadb-operator-index-5zmkh" Mar 16 17:34:30 crc kubenswrapper[5120]: I0316 17:34:30.870974 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/mariadb-operator-index-5zmkh"] Mar 16 17:34:30 crc kubenswrapper[5120]: I0316 17:34:30.874402 5120 scope.go:117] "RemoveContainer" containerID="db403e2d7ce646849e6fdb33f191c52701cea75ac87400987b7dbeb019769744" Mar 16 17:34:30 crc kubenswrapper[5120]: E0316 17:34:30.874961 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db403e2d7ce646849e6fdb33f191c52701cea75ac87400987b7dbeb019769744\": container with ID starting with db403e2d7ce646849e6fdb33f191c52701cea75ac87400987b7dbeb019769744 not found: ID does not exist" containerID="db403e2d7ce646849e6fdb33f191c52701cea75ac87400987b7dbeb019769744" Mar 16 17:34:30 crc kubenswrapper[5120]: I0316 17:34:30.875006 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db403e2d7ce646849e6fdb33f191c52701cea75ac87400987b7dbeb019769744"} err="failed to get container status \"db403e2d7ce646849e6fdb33f191c52701cea75ac87400987b7dbeb019769744\": rpc error: code = NotFound desc = could not find container \"db403e2d7ce646849e6fdb33f191c52701cea75ac87400987b7dbeb019769744\": container with ID starting with db403e2d7ce646849e6fdb33f191c52701cea75ac87400987b7dbeb019769744 not found: ID does not exist" Mar 16 17:34:30 crc kubenswrapper[5120]: I0316 17:34:30.877201 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-operators/mariadb-operator-index-5zmkh"] Mar 16 17:34:32 crc kubenswrapper[5120]: I0316 17:34:32.676015 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="257aa232-1508-41da-8c07-b2aae95a506e" path="/var/lib/kubelet/pods/257aa232-1508-41da-8c07-b2aae95a506e/volumes" Mar 16 17:34:37 crc kubenswrapper[5120]: I0316 17:34:37.313245 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-operators/mariadb-operator-index-tj5ss" Mar 16 17:34:37 crc kubenswrapper[5120]: I0316 17:34:37.313599 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-operators/mariadb-operator-index-tj5ss" Mar 16 17:34:37 crc kubenswrapper[5120]: I0316 17:34:37.341435 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-operators/mariadb-operator-index-tj5ss" Mar 16 17:34:37 crc kubenswrapper[5120]: I0316 17:34:37.997781 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/mariadb-operator-index-tj5ss" Mar 16 17:34:50 crc kubenswrapper[5120]: I0316 17:34:50.617661 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-operators/1b4ccfde3488142cc254fb313062ed88e2d18a60b7907f7b7c6ca340282x65z"] Mar 16 17:34:50 crc kubenswrapper[5120]: I0316 17:34:50.619229 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="257aa232-1508-41da-8c07-b2aae95a506e" containerName="registry-server" Mar 16 17:34:50 crc kubenswrapper[5120]: I0316 17:34:50.619245 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="257aa232-1508-41da-8c07-b2aae95a506e" containerName="registry-server" Mar 16 17:34:50 crc kubenswrapper[5120]: I0316 17:34:50.619366 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="257aa232-1508-41da-8c07-b2aae95a506e" containerName="registry-server" Mar 16 17:34:50 crc kubenswrapper[5120]: I0316 17:34:50.634945 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/1b4ccfde3488142cc254fb313062ed88e2d18a60b7907f7b7c6ca340282x65z"] Mar 16 17:34:50 crc kubenswrapper[5120]: I0316 17:34:50.635129 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/1b4ccfde3488142cc254fb313062ed88e2d18a60b7907f7b7c6ca340282x65z" Mar 16 17:34:50 crc kubenswrapper[5120]: I0316 17:34:50.638422 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-operators\"/\"default-dockercfg-rmzsx\"" Mar 16 17:34:50 crc kubenswrapper[5120]: I0316 17:34:50.755024 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/25d5385c-eea4-4f6f-91e5-edd0dcbf337e-bundle\") pod \"1b4ccfde3488142cc254fb313062ed88e2d18a60b7907f7b7c6ca340282x65z\" (UID: \"25d5385c-eea4-4f6f-91e5-edd0dcbf337e\") " pod="openstack-operators/1b4ccfde3488142cc254fb313062ed88e2d18a60b7907f7b7c6ca340282x65z" Mar 16 17:34:50 crc kubenswrapper[5120]: I0316 17:34:50.755121 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lrxr\" (UniqueName: \"kubernetes.io/projected/25d5385c-eea4-4f6f-91e5-edd0dcbf337e-kube-api-access-2lrxr\") pod \"1b4ccfde3488142cc254fb313062ed88e2d18a60b7907f7b7c6ca340282x65z\" (UID: \"25d5385c-eea4-4f6f-91e5-edd0dcbf337e\") " pod="openstack-operators/1b4ccfde3488142cc254fb313062ed88e2d18a60b7907f7b7c6ca340282x65z" Mar 16 17:34:50 crc kubenswrapper[5120]: I0316 17:34:50.755246 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/25d5385c-eea4-4f6f-91e5-edd0dcbf337e-util\") pod \"1b4ccfde3488142cc254fb313062ed88e2d18a60b7907f7b7c6ca340282x65z\" (UID: \"25d5385c-eea4-4f6f-91e5-edd0dcbf337e\") " pod="openstack-operators/1b4ccfde3488142cc254fb313062ed88e2d18a60b7907f7b7c6ca340282x65z" Mar 16 17:34:50 crc kubenswrapper[5120]: I0316 17:34:50.857337 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/25d5385c-eea4-4f6f-91e5-edd0dcbf337e-bundle\") pod \"1b4ccfde3488142cc254fb313062ed88e2d18a60b7907f7b7c6ca340282x65z\" (UID: \"25d5385c-eea4-4f6f-91e5-edd0dcbf337e\") " pod="openstack-operators/1b4ccfde3488142cc254fb313062ed88e2d18a60b7907f7b7c6ca340282x65z" Mar 16 17:34:50 crc kubenswrapper[5120]: I0316 17:34:50.857403 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2lrxr\" (UniqueName: \"kubernetes.io/projected/25d5385c-eea4-4f6f-91e5-edd0dcbf337e-kube-api-access-2lrxr\") pod \"1b4ccfde3488142cc254fb313062ed88e2d18a60b7907f7b7c6ca340282x65z\" (UID: \"25d5385c-eea4-4f6f-91e5-edd0dcbf337e\") " pod="openstack-operators/1b4ccfde3488142cc254fb313062ed88e2d18a60b7907f7b7c6ca340282x65z" Mar 16 17:34:50 crc kubenswrapper[5120]: I0316 17:34:50.857491 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/25d5385c-eea4-4f6f-91e5-edd0dcbf337e-util\") pod \"1b4ccfde3488142cc254fb313062ed88e2d18a60b7907f7b7c6ca340282x65z\" (UID: \"25d5385c-eea4-4f6f-91e5-edd0dcbf337e\") " pod="openstack-operators/1b4ccfde3488142cc254fb313062ed88e2d18a60b7907f7b7c6ca340282x65z" Mar 16 17:34:50 crc kubenswrapper[5120]: I0316 17:34:50.857886 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/25d5385c-eea4-4f6f-91e5-edd0dcbf337e-bundle\") pod \"1b4ccfde3488142cc254fb313062ed88e2d18a60b7907f7b7c6ca340282x65z\" (UID: \"25d5385c-eea4-4f6f-91e5-edd0dcbf337e\") " pod="openstack-operators/1b4ccfde3488142cc254fb313062ed88e2d18a60b7907f7b7c6ca340282x65z" Mar 16 17:34:50 crc kubenswrapper[5120]: I0316 17:34:50.858418 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/25d5385c-eea4-4f6f-91e5-edd0dcbf337e-util\") pod \"1b4ccfde3488142cc254fb313062ed88e2d18a60b7907f7b7c6ca340282x65z\" (UID: \"25d5385c-eea4-4f6f-91e5-edd0dcbf337e\") " pod="openstack-operators/1b4ccfde3488142cc254fb313062ed88e2d18a60b7907f7b7c6ca340282x65z" Mar 16 17:34:50 crc kubenswrapper[5120]: I0316 17:34:50.877518 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lrxr\" (UniqueName: \"kubernetes.io/projected/25d5385c-eea4-4f6f-91e5-edd0dcbf337e-kube-api-access-2lrxr\") pod \"1b4ccfde3488142cc254fb313062ed88e2d18a60b7907f7b7c6ca340282x65z\" (UID: \"25d5385c-eea4-4f6f-91e5-edd0dcbf337e\") " pod="openstack-operators/1b4ccfde3488142cc254fb313062ed88e2d18a60b7907f7b7c6ca340282x65z" Mar 16 17:34:50 crc kubenswrapper[5120]: I0316 17:34:50.958405 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/1b4ccfde3488142cc254fb313062ed88e2d18a60b7907f7b7c6ca340282x65z" Mar 16 17:34:51 crc kubenswrapper[5120]: I0316 17:34:51.366411 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/1b4ccfde3488142cc254fb313062ed88e2d18a60b7907f7b7c6ca340282x65z"] Mar 16 17:34:51 crc kubenswrapper[5120]: W0316 17:34:51.373601 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25d5385c_eea4_4f6f_91e5_edd0dcbf337e.slice/crio-949ebf7529d5ac1d90d8812734cf9e0b25e981ff14e5ce72fd704a2356f77b9c WatchSource:0}: Error finding container 949ebf7529d5ac1d90d8812734cf9e0b25e981ff14e5ce72fd704a2356f77b9c: Status 404 returned error can't find the container with id 949ebf7529d5ac1d90d8812734cf9e0b25e981ff14e5ce72fd704a2356f77b9c Mar 16 17:34:52 crc kubenswrapper[5120]: I0316 17:34:52.072679 5120 generic.go:358] "Generic (PLEG): container finished" podID="25d5385c-eea4-4f6f-91e5-edd0dcbf337e" containerID="ebf9cb0783ef13b02118e2895eec10fe0e918f2b11671020a6bb10edfc76ac0d" exitCode=0 Mar 16 17:34:52 crc kubenswrapper[5120]: I0316 17:34:52.072776 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/1b4ccfde3488142cc254fb313062ed88e2d18a60b7907f7b7c6ca340282x65z" event={"ID":"25d5385c-eea4-4f6f-91e5-edd0dcbf337e","Type":"ContainerDied","Data":"ebf9cb0783ef13b02118e2895eec10fe0e918f2b11671020a6bb10edfc76ac0d"} Mar 16 17:34:52 crc kubenswrapper[5120]: I0316 17:34:52.073080 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/1b4ccfde3488142cc254fb313062ed88e2d18a60b7907f7b7c6ca340282x65z" event={"ID":"25d5385c-eea4-4f6f-91e5-edd0dcbf337e","Type":"ContainerStarted","Data":"949ebf7529d5ac1d90d8812734cf9e0b25e981ff14e5ce72fd704a2356f77b9c"} Mar 16 17:34:54 crc kubenswrapper[5120]: I0316 17:34:54.090979 5120 generic.go:358] "Generic (PLEG): container finished" podID="25d5385c-eea4-4f6f-91e5-edd0dcbf337e" containerID="5aa0254ff32acc87fe8611cb2617571fc3497143a7170e777f3cd9a477f2d80f" exitCode=0 Mar 16 17:34:54 crc kubenswrapper[5120]: I0316 17:34:54.091051 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/1b4ccfde3488142cc254fb313062ed88e2d18a60b7907f7b7c6ca340282x65z" event={"ID":"25d5385c-eea4-4f6f-91e5-edd0dcbf337e","Type":"ContainerDied","Data":"5aa0254ff32acc87fe8611cb2617571fc3497143a7170e777f3cd9a477f2d80f"} Mar 16 17:34:55 crc kubenswrapper[5120]: I0316 17:34:55.110530 5120 generic.go:358] "Generic (PLEG): container finished" podID="25d5385c-eea4-4f6f-91e5-edd0dcbf337e" containerID="c706bf29c3e565b685f84f96ebe42906c655160b36904429dd884e37ce364397" exitCode=0 Mar 16 17:34:55 crc kubenswrapper[5120]: I0316 17:34:55.110674 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/1b4ccfde3488142cc254fb313062ed88e2d18a60b7907f7b7c6ca340282x65z" event={"ID":"25d5385c-eea4-4f6f-91e5-edd0dcbf337e","Type":"ContainerDied","Data":"c706bf29c3e565b685f84f96ebe42906c655160b36904429dd884e37ce364397"} Mar 16 17:34:56 crc kubenswrapper[5120]: I0316 17:34:56.357415 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/1b4ccfde3488142cc254fb313062ed88e2d18a60b7907f7b7c6ca340282x65z" Mar 16 17:34:56 crc kubenswrapper[5120]: I0316 17:34:56.372569 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2lrxr\" (UniqueName: \"kubernetes.io/projected/25d5385c-eea4-4f6f-91e5-edd0dcbf337e-kube-api-access-2lrxr\") pod \"25d5385c-eea4-4f6f-91e5-edd0dcbf337e\" (UID: \"25d5385c-eea4-4f6f-91e5-edd0dcbf337e\") " Mar 16 17:34:56 crc kubenswrapper[5120]: I0316 17:34:56.372616 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/25d5385c-eea4-4f6f-91e5-edd0dcbf337e-bundle\") pod \"25d5385c-eea4-4f6f-91e5-edd0dcbf337e\" (UID: \"25d5385c-eea4-4f6f-91e5-edd0dcbf337e\") " Mar 16 17:34:56 crc kubenswrapper[5120]: I0316 17:34:56.372840 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/25d5385c-eea4-4f6f-91e5-edd0dcbf337e-util\") pod \"25d5385c-eea4-4f6f-91e5-edd0dcbf337e\" (UID: \"25d5385c-eea4-4f6f-91e5-edd0dcbf337e\") " Mar 16 17:34:56 crc kubenswrapper[5120]: I0316 17:34:56.374076 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25d5385c-eea4-4f6f-91e5-edd0dcbf337e-bundle" (OuterVolumeSpecName: "bundle") pod "25d5385c-eea4-4f6f-91e5-edd0dcbf337e" (UID: "25d5385c-eea4-4f6f-91e5-edd0dcbf337e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:34:56 crc kubenswrapper[5120]: I0316 17:34:56.379067 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25d5385c-eea4-4f6f-91e5-edd0dcbf337e-kube-api-access-2lrxr" (OuterVolumeSpecName: "kube-api-access-2lrxr") pod "25d5385c-eea4-4f6f-91e5-edd0dcbf337e" (UID: "25d5385c-eea4-4f6f-91e5-edd0dcbf337e"). InnerVolumeSpecName "kube-api-access-2lrxr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:34:56 crc kubenswrapper[5120]: I0316 17:34:56.384836 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25d5385c-eea4-4f6f-91e5-edd0dcbf337e-util" (OuterVolumeSpecName: "util") pod "25d5385c-eea4-4f6f-91e5-edd0dcbf337e" (UID: "25d5385c-eea4-4f6f-91e5-edd0dcbf337e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:34:56 crc kubenswrapper[5120]: I0316 17:34:56.475683 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2lrxr\" (UniqueName: \"kubernetes.io/projected/25d5385c-eea4-4f6f-91e5-edd0dcbf337e-kube-api-access-2lrxr\") on node \"crc\" DevicePath \"\"" Mar 16 17:34:56 crc kubenswrapper[5120]: I0316 17:34:56.475739 5120 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/25d5385c-eea4-4f6f-91e5-edd0dcbf337e-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:34:56 crc kubenswrapper[5120]: I0316 17:34:56.475752 5120 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/25d5385c-eea4-4f6f-91e5-edd0dcbf337e-util\") on node \"crc\" DevicePath \"\"" Mar 16 17:34:57 crc kubenswrapper[5120]: I0316 17:34:57.125381 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/1b4ccfde3488142cc254fb313062ed88e2d18a60b7907f7b7c6ca340282x65z" event={"ID":"25d5385c-eea4-4f6f-91e5-edd0dcbf337e","Type":"ContainerDied","Data":"949ebf7529d5ac1d90d8812734cf9e0b25e981ff14e5ce72fd704a2356f77b9c"} Mar 16 17:34:57 crc kubenswrapper[5120]: I0316 17:34:57.125421 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="949ebf7529d5ac1d90d8812734cf9e0b25e981ff14e5ce72fd704a2356f77b9c" Mar 16 17:34:57 crc kubenswrapper[5120]: I0316 17:34:57.125446 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/1b4ccfde3488142cc254fb313062ed88e2d18a60b7907f7b7c6ca340282x65z" Mar 16 17:35:04 crc kubenswrapper[5120]: I0316 17:35:04.096038 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-operators/mariadb-operator-controller-manager-8c6b767f7-fp79q"] Mar 16 17:35:04 crc kubenswrapper[5120]: I0316 17:35:04.097271 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25d5385c-eea4-4f6f-91e5-edd0dcbf337e" containerName="extract" Mar 16 17:35:04 crc kubenswrapper[5120]: I0316 17:35:04.097287 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="25d5385c-eea4-4f6f-91e5-edd0dcbf337e" containerName="extract" Mar 16 17:35:04 crc kubenswrapper[5120]: I0316 17:35:04.097322 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25d5385c-eea4-4f6f-91e5-edd0dcbf337e" containerName="pull" Mar 16 17:35:04 crc kubenswrapper[5120]: I0316 17:35:04.097330 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="25d5385c-eea4-4f6f-91e5-edd0dcbf337e" containerName="pull" Mar 16 17:35:04 crc kubenswrapper[5120]: I0316 17:35:04.097366 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25d5385c-eea4-4f6f-91e5-edd0dcbf337e" containerName="util" Mar 16 17:35:04 crc kubenswrapper[5120]: I0316 17:35:04.097373 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="25d5385c-eea4-4f6f-91e5-edd0dcbf337e" containerName="util" Mar 16 17:35:04 crc kubenswrapper[5120]: I0316 17:35:04.097512 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="25d5385c-eea4-4f6f-91e5-edd0dcbf337e" containerName="extract" Mar 16 17:35:04 crc kubenswrapper[5120]: I0316 17:35:04.108908 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/mariadb-operator-controller-manager-8c6b767f7-fp79q" Mar 16 17:35:04 crc kubenswrapper[5120]: I0316 17:35:04.111743 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-operators\"/\"webhook-server-cert\"" Mar 16 17:35:04 crc kubenswrapper[5120]: I0316 17:35:04.113272 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-operators\"/\"mariadb-operator-controller-manager-service-cert\"" Mar 16 17:35:04 crc kubenswrapper[5120]: I0316 17:35:04.113351 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-operators\"/\"mariadb-operator-controller-manager-dockercfg-qcr62\"" Mar 16 17:35:04 crc kubenswrapper[5120]: I0316 17:35:04.116805 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/mariadb-operator-controller-manager-8c6b767f7-fp79q"] Mar 16 17:35:04 crc kubenswrapper[5120]: I0316 17:35:04.224322 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e1a87a80-0dc7-4b13-938a-9b63c43df433-webhook-cert\") pod \"mariadb-operator-controller-manager-8c6b767f7-fp79q\" (UID: \"e1a87a80-0dc7-4b13-938a-9b63c43df433\") " pod="openstack-operators/mariadb-operator-controller-manager-8c6b767f7-fp79q" Mar 16 17:35:04 crc kubenswrapper[5120]: I0316 17:35:04.224480 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d5wln\" (UniqueName: \"kubernetes.io/projected/e1a87a80-0dc7-4b13-938a-9b63c43df433-kube-api-access-d5wln\") pod \"mariadb-operator-controller-manager-8c6b767f7-fp79q\" (UID: \"e1a87a80-0dc7-4b13-938a-9b63c43df433\") " pod="openstack-operators/mariadb-operator-controller-manager-8c6b767f7-fp79q" Mar 16 17:35:04 crc kubenswrapper[5120]: I0316 17:35:04.224588 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e1a87a80-0dc7-4b13-938a-9b63c43df433-apiservice-cert\") pod \"mariadb-operator-controller-manager-8c6b767f7-fp79q\" (UID: \"e1a87a80-0dc7-4b13-938a-9b63c43df433\") " pod="openstack-operators/mariadb-operator-controller-manager-8c6b767f7-fp79q" Mar 16 17:35:04 crc kubenswrapper[5120]: I0316 17:35:04.326184 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e1a87a80-0dc7-4b13-938a-9b63c43df433-webhook-cert\") pod \"mariadb-operator-controller-manager-8c6b767f7-fp79q\" (UID: \"e1a87a80-0dc7-4b13-938a-9b63c43df433\") " pod="openstack-operators/mariadb-operator-controller-manager-8c6b767f7-fp79q" Mar 16 17:35:04 crc kubenswrapper[5120]: I0316 17:35:04.326545 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d5wln\" (UniqueName: \"kubernetes.io/projected/e1a87a80-0dc7-4b13-938a-9b63c43df433-kube-api-access-d5wln\") pod \"mariadb-operator-controller-manager-8c6b767f7-fp79q\" (UID: \"e1a87a80-0dc7-4b13-938a-9b63c43df433\") " pod="openstack-operators/mariadb-operator-controller-manager-8c6b767f7-fp79q" Mar 16 17:35:04 crc kubenswrapper[5120]: I0316 17:35:04.326687 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e1a87a80-0dc7-4b13-938a-9b63c43df433-apiservice-cert\") pod \"mariadb-operator-controller-manager-8c6b767f7-fp79q\" (UID: \"e1a87a80-0dc7-4b13-938a-9b63c43df433\") " pod="openstack-operators/mariadb-operator-controller-manager-8c6b767f7-fp79q" Mar 16 17:35:04 crc kubenswrapper[5120]: I0316 17:35:04.333463 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e1a87a80-0dc7-4b13-938a-9b63c43df433-webhook-cert\") pod \"mariadb-operator-controller-manager-8c6b767f7-fp79q\" (UID: \"e1a87a80-0dc7-4b13-938a-9b63c43df433\") " pod="openstack-operators/mariadb-operator-controller-manager-8c6b767f7-fp79q" Mar 16 17:35:04 crc kubenswrapper[5120]: I0316 17:35:04.335526 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e1a87a80-0dc7-4b13-938a-9b63c43df433-apiservice-cert\") pod \"mariadb-operator-controller-manager-8c6b767f7-fp79q\" (UID: \"e1a87a80-0dc7-4b13-938a-9b63c43df433\") " pod="openstack-operators/mariadb-operator-controller-manager-8c6b767f7-fp79q" Mar 16 17:35:04 crc kubenswrapper[5120]: I0316 17:35:04.352882 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5wln\" (UniqueName: \"kubernetes.io/projected/e1a87a80-0dc7-4b13-938a-9b63c43df433-kube-api-access-d5wln\") pod \"mariadb-operator-controller-manager-8c6b767f7-fp79q\" (UID: \"e1a87a80-0dc7-4b13-938a-9b63c43df433\") " pod="openstack-operators/mariadb-operator-controller-manager-8c6b767f7-fp79q" Mar 16 17:35:04 crc kubenswrapper[5120]: I0316 17:35:04.432887 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/mariadb-operator-controller-manager-8c6b767f7-fp79q" Mar 16 17:35:04 crc kubenswrapper[5120]: I0316 17:35:04.852783 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/mariadb-operator-controller-manager-8c6b767f7-fp79q"] Mar 16 17:35:05 crc kubenswrapper[5120]: I0316 17:35:05.184229 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/mariadb-operator-controller-manager-8c6b767f7-fp79q" event={"ID":"e1a87a80-0dc7-4b13-938a-9b63c43df433","Type":"ContainerStarted","Data":"c2279a1ac87de5badd54b84d68c5debc2a280f154acbc555c810daa9d034e033"} Mar 16 17:35:05 crc kubenswrapper[5120]: I0316 17:35:05.184599 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/mariadb-operator-controller-manager-8c6b767f7-fp79q" event={"ID":"e1a87a80-0dc7-4b13-938a-9b63c43df433","Type":"ContainerStarted","Data":"9cc2b471263e8a66d467756cfc309b1cf46a1da0644df290a4dc4744bf233ca1"} Mar 16 17:35:05 crc kubenswrapper[5120]: I0316 17:35:05.184625 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-operators/mariadb-operator-controller-manager-8c6b767f7-fp79q" Mar 16 17:35:07 crc kubenswrapper[5120]: E0316 17:35:07.523102 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=893442 actualBytes=10240 Mar 16 17:35:16 crc kubenswrapper[5120]: I0316 17:35:16.197049 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/mariadb-operator-controller-manager-8c6b767f7-fp79q" Mar 16 17:35:16 crc kubenswrapper[5120]: I0316 17:35:16.223769 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/mariadb-operator-controller-manager-8c6b767f7-fp79q" podStartSLOduration=12.223731681 podStartE2EDuration="12.223731681s" podCreationTimestamp="2026-03-16 17:35:04 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:35:05.20750972 +0000 UTC m=+7407.361441377" watchObservedRunningTime="2026-03-16 17:35:16.223731681 +0000 UTC m=+7418.377663338" Mar 16 17:35:24 crc kubenswrapper[5120]: I0316 17:35:24.036678 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-operators/infra-operator-index-gs4dw"] Mar 16 17:35:24 crc kubenswrapper[5120]: I0316 17:35:24.041773 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/infra-operator-index-gs4dw" Mar 16 17:35:24 crc kubenswrapper[5120]: I0316 17:35:24.043463 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-operators\"/\"infra-operator-index-dockercfg-bd64r\"" Mar 16 17:35:24 crc kubenswrapper[5120]: I0316 17:35:24.047137 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/infra-operator-index-gs4dw"] Mar 16 17:35:24 crc kubenswrapper[5120]: I0316 17:35:24.125388 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2clg\" (UniqueName: \"kubernetes.io/projected/dc18cff5-655d-4b7d-b8e9-473dcf200489-kube-api-access-t2clg\") pod \"infra-operator-index-gs4dw\" (UID: \"dc18cff5-655d-4b7d-b8e9-473dcf200489\") " pod="openstack-operators/infra-operator-index-gs4dw" Mar 16 17:35:24 crc kubenswrapper[5120]: I0316 17:35:24.227200 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t2clg\" (UniqueName: \"kubernetes.io/projected/dc18cff5-655d-4b7d-b8e9-473dcf200489-kube-api-access-t2clg\") pod \"infra-operator-index-gs4dw\" (UID: \"dc18cff5-655d-4b7d-b8e9-473dcf200489\") " pod="openstack-operators/infra-operator-index-gs4dw" Mar 16 17:35:24 crc kubenswrapper[5120]: I0316 17:35:24.250990 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2clg\" (UniqueName: \"kubernetes.io/projected/dc18cff5-655d-4b7d-b8e9-473dcf200489-kube-api-access-t2clg\") pod \"infra-operator-index-gs4dw\" (UID: \"dc18cff5-655d-4b7d-b8e9-473dcf200489\") " pod="openstack-operators/infra-operator-index-gs4dw" Mar 16 17:35:24 crc kubenswrapper[5120]: I0316 17:35:24.394972 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/infra-operator-index-gs4dw" Mar 16 17:35:24 crc kubenswrapper[5120]: I0316 17:35:24.803964 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/infra-operator-index-gs4dw"] Mar 16 17:35:24 crc kubenswrapper[5120]: W0316 17:35:24.810951 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc18cff5_655d_4b7d_b8e9_473dcf200489.slice/crio-7eb2551f71b57bc01951ec9923f166a02d09453c6cd0f1c9740eb62513194d6b WatchSource:0}: Error finding container 7eb2551f71b57bc01951ec9923f166a02d09453c6cd0f1c9740eb62513194d6b: Status 404 returned error can't find the container with id 7eb2551f71b57bc01951ec9923f166a02d09453c6cd0f1c9740eb62513194d6b Mar 16 17:35:25 crc kubenswrapper[5120]: I0316 17:35:25.326208 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/infra-operator-index-gs4dw" event={"ID":"dc18cff5-655d-4b7d-b8e9-473dcf200489","Type":"ContainerStarted","Data":"7eb2551f71b57bc01951ec9923f166a02d09453c6cd0f1c9740eb62513194d6b"} Mar 16 17:35:27 crc kubenswrapper[5120]: I0316 17:35:27.357652 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/infra-operator-index-gs4dw" event={"ID":"dc18cff5-655d-4b7d-b8e9-473dcf200489","Type":"ContainerStarted","Data":"9df493f79ee66a4b81bf9859d01b5a1b08f72c0fc9dcd2ef080e5d83c5a97398"} Mar 16 17:35:27 crc kubenswrapper[5120]: I0316 17:35:27.373876 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/infra-operator-index-gs4dw" podStartSLOduration=1.8727692820000001 podStartE2EDuration="3.373829995s" podCreationTimestamp="2026-03-16 17:35:24 +0000 UTC" firstStartedPulling="2026-03-16 17:35:24.8122062 +0000 UTC m=+7426.966137857" lastFinishedPulling="2026-03-16 17:35:26.313266903 +0000 UTC m=+7428.467198570" observedRunningTime="2026-03-16 17:35:27.369315721 +0000 UTC m=+7429.523247378" watchObservedRunningTime="2026-03-16 17:35:27.373829995 +0000 UTC m=+7429.527761662" Mar 16 17:35:31 crc kubenswrapper[5120]: I0316 17:35:31.268568 5120 scope.go:117] "RemoveContainer" containerID="868b71a5d1b7ebf24b207db975a0cc847eaf43adc2f774fd90db826f4737a82f" Mar 16 17:35:31 crc kubenswrapper[5120]: I0316 17:35:31.292200 5120 scope.go:117] "RemoveContainer" containerID="7f530fc93769bf7ae833e7d5ee3ef2203c363452cabaca5eb55dacd06cc7865a" Mar 16 17:35:31 crc kubenswrapper[5120]: I0316 17:35:31.330419 5120 scope.go:117] "RemoveContainer" containerID="c9cc5ae6ca611d80618a11a70f537f31705651222046ae6bbbd6d05dd6762c70" Mar 16 17:35:31 crc kubenswrapper[5120]: I0316 17:35:31.353213 5120 scope.go:117] "RemoveContainer" containerID="9813d5e7521c43889a53c38a0b4ae488f75dba1765580aee59d404de0150a7fe" Mar 16 17:35:31 crc kubenswrapper[5120]: I0316 17:35:31.377035 5120 scope.go:117] "RemoveContainer" containerID="f3fcfaaff1af24518d0661eae5bb8f082fc7c79d24590bfcd88dcb1217387b7e" Mar 16 17:35:31 crc kubenswrapper[5120]: I0316 17:35:31.400969 5120 scope.go:117] "RemoveContainer" containerID="b703f853c2173f1ee674f9e41b1b6514e6dac0db4a20c9728feabe6fce355e9e" Mar 16 17:35:34 crc kubenswrapper[5120]: I0316 17:35:34.395886 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-operators/infra-operator-index-gs4dw" Mar 16 17:35:34 crc kubenswrapper[5120]: I0316 17:35:34.396573 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-operators/infra-operator-index-gs4dw" Mar 16 17:35:34 crc kubenswrapper[5120]: I0316 17:35:34.432399 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-operators/infra-operator-index-gs4dw" Mar 16 17:35:34 crc kubenswrapper[5120]: I0316 17:35:34.461551 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/infra-operator-index-gs4dw" Mar 16 17:35:38 crc kubenswrapper[5120]: I0316 17:35:38.102843 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-operators/0b4c51a436ce56c4393293420dad5bb37f4e2c4f062c7176860d28159525g5w"] Mar 16 17:35:38 crc kubenswrapper[5120]: I0316 17:35:38.112268 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/0b4c51a436ce56c4393293420dad5bb37f4e2c4f062c7176860d28159525g5w" Mar 16 17:35:38 crc kubenswrapper[5120]: I0316 17:35:38.113453 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/0b4c51a436ce56c4393293420dad5bb37f4e2c4f062c7176860d28159525g5w"] Mar 16 17:35:38 crc kubenswrapper[5120]: I0316 17:35:38.115380 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-operators\"/\"default-dockercfg-rmzsx\"" Mar 16 17:35:38 crc kubenswrapper[5120]: I0316 17:35:38.209632 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0b997602-48d7-44cd-b3f0-6e0425c6221c-util\") pod \"0b4c51a436ce56c4393293420dad5bb37f4e2c4f062c7176860d28159525g5w\" (UID: \"0b997602-48d7-44cd-b3f0-6e0425c6221c\") " pod="openstack-operators/0b4c51a436ce56c4393293420dad5bb37f4e2c4f062c7176860d28159525g5w" Mar 16 17:35:38 crc kubenswrapper[5120]: I0316 17:35:38.209737 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0b997602-48d7-44cd-b3f0-6e0425c6221c-bundle\") pod \"0b4c51a436ce56c4393293420dad5bb37f4e2c4f062c7176860d28159525g5w\" (UID: \"0b997602-48d7-44cd-b3f0-6e0425c6221c\") " pod="openstack-operators/0b4c51a436ce56c4393293420dad5bb37f4e2c4f062c7176860d28159525g5w" Mar 16 17:35:38 crc kubenswrapper[5120]: I0316 17:35:38.209976 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qlwdm\" (UniqueName: \"kubernetes.io/projected/0b997602-48d7-44cd-b3f0-6e0425c6221c-kube-api-access-qlwdm\") pod \"0b4c51a436ce56c4393293420dad5bb37f4e2c4f062c7176860d28159525g5w\" (UID: \"0b997602-48d7-44cd-b3f0-6e0425c6221c\") " pod="openstack-operators/0b4c51a436ce56c4393293420dad5bb37f4e2c4f062c7176860d28159525g5w" Mar 16 17:35:38 crc kubenswrapper[5120]: I0316 17:35:38.311194 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0b997602-48d7-44cd-b3f0-6e0425c6221c-util\") pod \"0b4c51a436ce56c4393293420dad5bb37f4e2c4f062c7176860d28159525g5w\" (UID: \"0b997602-48d7-44cd-b3f0-6e0425c6221c\") " pod="openstack-operators/0b4c51a436ce56c4393293420dad5bb37f4e2c4f062c7176860d28159525g5w" Mar 16 17:35:38 crc kubenswrapper[5120]: I0316 17:35:38.311300 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0b997602-48d7-44cd-b3f0-6e0425c6221c-bundle\") pod \"0b4c51a436ce56c4393293420dad5bb37f4e2c4f062c7176860d28159525g5w\" (UID: \"0b997602-48d7-44cd-b3f0-6e0425c6221c\") " pod="openstack-operators/0b4c51a436ce56c4393293420dad5bb37f4e2c4f062c7176860d28159525g5w" Mar 16 17:35:38 crc kubenswrapper[5120]: I0316 17:35:38.311379 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qlwdm\" (UniqueName: \"kubernetes.io/projected/0b997602-48d7-44cd-b3f0-6e0425c6221c-kube-api-access-qlwdm\") pod \"0b4c51a436ce56c4393293420dad5bb37f4e2c4f062c7176860d28159525g5w\" (UID: \"0b997602-48d7-44cd-b3f0-6e0425c6221c\") " pod="openstack-operators/0b4c51a436ce56c4393293420dad5bb37f4e2c4f062c7176860d28159525g5w" Mar 16 17:35:38 crc kubenswrapper[5120]: I0316 17:35:38.311917 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0b997602-48d7-44cd-b3f0-6e0425c6221c-bundle\") pod \"0b4c51a436ce56c4393293420dad5bb37f4e2c4f062c7176860d28159525g5w\" (UID: \"0b997602-48d7-44cd-b3f0-6e0425c6221c\") " pod="openstack-operators/0b4c51a436ce56c4393293420dad5bb37f4e2c4f062c7176860d28159525g5w" Mar 16 17:35:38 crc kubenswrapper[5120]: I0316 17:35:38.312142 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0b997602-48d7-44cd-b3f0-6e0425c6221c-util\") pod \"0b4c51a436ce56c4393293420dad5bb37f4e2c4f062c7176860d28159525g5w\" (UID: \"0b997602-48d7-44cd-b3f0-6e0425c6221c\") " pod="openstack-operators/0b4c51a436ce56c4393293420dad5bb37f4e2c4f062c7176860d28159525g5w" Mar 16 17:35:38 crc kubenswrapper[5120]: I0316 17:35:38.332741 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qlwdm\" (UniqueName: \"kubernetes.io/projected/0b997602-48d7-44cd-b3f0-6e0425c6221c-kube-api-access-qlwdm\") pod \"0b4c51a436ce56c4393293420dad5bb37f4e2c4f062c7176860d28159525g5w\" (UID: \"0b997602-48d7-44cd-b3f0-6e0425c6221c\") " pod="openstack-operators/0b4c51a436ce56c4393293420dad5bb37f4e2c4f062c7176860d28159525g5w" Mar 16 17:35:38 crc kubenswrapper[5120]: I0316 17:35:38.429930 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/0b4c51a436ce56c4393293420dad5bb37f4e2c4f062c7176860d28159525g5w" Mar 16 17:35:38 crc kubenswrapper[5120]: I0316 17:35:38.830030 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/0b4c51a436ce56c4393293420dad5bb37f4e2c4f062c7176860d28159525g5w"] Mar 16 17:35:38 crc kubenswrapper[5120]: W0316 17:35:38.835674 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b997602_48d7_44cd_b3f0_6e0425c6221c.slice/crio-b8ef7435e764da0f6c95619c569069c62fa53a5ef951347025bf4779a8518fd4 WatchSource:0}: Error finding container b8ef7435e764da0f6c95619c569069c62fa53a5ef951347025bf4779a8518fd4: Status 404 returned error can't find the container with id b8ef7435e764da0f6c95619c569069c62fa53a5ef951347025bf4779a8518fd4 Mar 16 17:35:39 crc kubenswrapper[5120]: I0316 17:35:39.018446 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["barbican-kuttl-tests/openstack-galera-0"] Mar 16 17:35:39 crc kubenswrapper[5120]: I0316 17:35:39.023127 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/openstack-galera-0" Mar 16 17:35:39 crc kubenswrapper[5120]: I0316 17:35:39.025634 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"barbican-kuttl-tests\"/\"openstack-config-data\"" Mar 16 17:35:39 crc kubenswrapper[5120]: I0316 17:35:39.026456 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"barbican-kuttl-tests\"/\"openstack-scripts\"" Mar 16 17:35:39 crc kubenswrapper[5120]: I0316 17:35:39.026625 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"barbican-kuttl-tests\"/\"openshift-service-ca.crt\"" Mar 16 17:35:39 crc kubenswrapper[5120]: I0316 17:35:39.028538 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"barbican-kuttl-tests\"/\"galera-openstack-dockercfg-fkfpr\"" Mar 16 17:35:39 crc kubenswrapper[5120]: I0316 17:35:39.032748 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["barbican-kuttl-tests/openstack-galera-0"] Mar 16 17:35:39 crc kubenswrapper[5120]: I0316 17:35:39.036996 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"barbican-kuttl-tests\"/\"kube-root-ca.crt\"" Mar 16 17:35:39 crc kubenswrapper[5120]: I0316 17:35:39.060840 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["barbican-kuttl-tests/openstack-galera-1"] Mar 16 17:35:39 crc kubenswrapper[5120]: I0316 17:35:39.066126 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/openstack-galera-1" Mar 16 17:35:39 crc kubenswrapper[5120]: I0316 17:35:39.067356 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["barbican-kuttl-tests/openstack-galera-2"] Mar 16 17:35:39 crc kubenswrapper[5120]: I0316 17:35:39.084964 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/openstack-galera-2" Mar 16 17:35:39 crc kubenswrapper[5120]: I0316 17:35:39.091002 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["barbican-kuttl-tests/openstack-galera-1"] Mar 16 17:35:39 crc kubenswrapper[5120]: I0316 17:35:39.098778 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["barbican-kuttl-tests/openstack-galera-2"] Mar 16 17:35:39 crc kubenswrapper[5120]: I0316 17:35:39.131601 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2dfcb27a-8b24-493a-b27f-74436a9105e0-operator-scripts\") pod \"openstack-galera-0\" (UID: \"2dfcb27a-8b24-493a-b27f-74436a9105e0\") " pod="barbican-kuttl-tests/openstack-galera-0" Mar 16 17:35:39 crc kubenswrapper[5120]: I0316 17:35:39.131669 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"openstack-galera-2\" (UID: \"c2432965-72a9-4f38-a930-85969dfa64d6\") " pod="barbican-kuttl-tests/openstack-galera-2" Mar 16 17:35:39 crc kubenswrapper[5120]: I0316 17:35:39.131691 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/05269e3d-2dcd-4828-8142-7399752715b3-kolla-config\") pod \"openstack-galera-1\" (UID: \"05269e3d-2dcd-4828-8142-7399752715b3\") " pod="barbican-kuttl-tests/openstack-galera-1" Mar 16 17:35:39 crc kubenswrapper[5120]: I0316 17:35:39.131720 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/05269e3d-2dcd-4828-8142-7399752715b3-config-data-generated\") pod \"openstack-galera-1\" (UID: \"05269e3d-2dcd-4828-8142-7399752715b3\") " pod="barbican-kuttl-tests/openstack-galera-1" Mar 16 17:35:39 crc kubenswrapper[5120]: I0316 17:35:39.131777 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/05269e3d-2dcd-4828-8142-7399752715b3-config-data-default\") pod \"openstack-galera-1\" (UID: \"05269e3d-2dcd-4828-8142-7399752715b3\") " pod="barbican-kuttl-tests/openstack-galera-1" Mar 16 17:35:39 crc kubenswrapper[5120]: I0316 17:35:39.131810 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/c2432965-72a9-4f38-a930-85969dfa64d6-config-data-default\") pod \"openstack-galera-2\" (UID: \"c2432965-72a9-4f38-a930-85969dfa64d6\") " pod="barbican-kuttl-tests/openstack-galera-2" Mar 16 17:35:39 crc kubenswrapper[5120]: I0316 17:35:39.131850 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2g98\" (UniqueName: \"kubernetes.io/projected/c2432965-72a9-4f38-a930-85969dfa64d6-kube-api-access-v2g98\") pod \"openstack-galera-2\" (UID: \"c2432965-72a9-4f38-a930-85969dfa64d6\") " pod="barbican-kuttl-tests/openstack-galera-2" Mar 16 17:35:39 crc kubenswrapper[5120]: I0316 17:35:39.131969 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sc2r5\" (UniqueName: \"kubernetes.io/projected/2dfcb27a-8b24-493a-b27f-74436a9105e0-kube-api-access-sc2r5\") pod \"openstack-galera-0\" (UID: \"2dfcb27a-8b24-493a-b27f-74436a9105e0\") " pod="barbican-kuttl-tests/openstack-galera-0" Mar 16 17:35:39 crc kubenswrapper[5120]: I0316 17:35:39.132006 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/2dfcb27a-8b24-493a-b27f-74436a9105e0-config-data-generated\") pod \"openstack-galera-0\" (UID: \"2dfcb27a-8b24-493a-b27f-74436a9105e0\") " pod="barbican-kuttl-tests/openstack-galera-0" Mar 16 17:35:39 crc kubenswrapper[5120]: I0316 17:35:39.132029 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/c2432965-72a9-4f38-a930-85969dfa64d6-config-data-generated\") pod \"openstack-galera-2\" (UID: \"c2432965-72a9-4f38-a930-85969dfa64d6\") " pod="barbican-kuttl-tests/openstack-galera-2" Mar 16 17:35:39 crc kubenswrapper[5120]: I0316 17:35:39.132052 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjbzf\" (UniqueName: \"kubernetes.io/projected/05269e3d-2dcd-4828-8142-7399752715b3-kube-api-access-wjbzf\") pod \"openstack-galera-1\" (UID: \"05269e3d-2dcd-4828-8142-7399752715b3\") " pod="barbican-kuttl-tests/openstack-galera-1" Mar 16 17:35:39 crc kubenswrapper[5120]: I0316 17:35:39.132095 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/c2432965-72a9-4f38-a930-85969dfa64d6-kolla-config\") pod \"openstack-galera-2\" (UID: \"c2432965-72a9-4f38-a930-85969dfa64d6\") " pod="barbican-kuttl-tests/openstack-galera-2" Mar 16 17:35:39 crc kubenswrapper[5120]: I0316 17:35:39.132146 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"openstack-galera-1\" (UID: \"05269e3d-2dcd-4828-8142-7399752715b3\") " pod="barbican-kuttl-tests/openstack-galera-1" Mar 16 17:35:39 crc kubenswrapper[5120]: I0316 17:35:39.132176 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"openstack-galera-0\" (UID: \"2dfcb27a-8b24-493a-b27f-74436a9105e0\") " pod="barbican-kuttl-tests/openstack-galera-0" Mar 16 17:35:39 crc kubenswrapper[5120]: I0316 17:35:39.132199 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/05269e3d-2dcd-4828-8142-7399752715b3-operator-scripts\") pod \"openstack-galera-1\" (UID: \"05269e3d-2dcd-4828-8142-7399752715b3\") " pod="barbican-kuttl-tests/openstack-galera-1" Mar 16 17:35:39 crc kubenswrapper[5120]: I0316 17:35:39.132244 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c2432965-72a9-4f38-a930-85969dfa64d6-operator-scripts\") pod \"openstack-galera-2\" (UID: \"c2432965-72a9-4f38-a930-85969dfa64d6\") " pod="barbican-kuttl-tests/openstack-galera-2" Mar 16 17:35:39 crc kubenswrapper[5120]: I0316 17:35:39.132264 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/2dfcb27a-8b24-493a-b27f-74436a9105e0-kolla-config\") pod \"openstack-galera-0\" (UID: \"2dfcb27a-8b24-493a-b27f-74436a9105e0\") " pod="barbican-kuttl-tests/openstack-galera-0" Mar 16 17:35:39 crc kubenswrapper[5120]: I0316 17:35:39.132277 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/2dfcb27a-8b24-493a-b27f-74436a9105e0-config-data-default\") pod \"openstack-galera-0\" (UID: \"2dfcb27a-8b24-493a-b27f-74436a9105e0\") " pod="barbican-kuttl-tests/openstack-galera-0" Mar 16 17:35:39 crc kubenswrapper[5120]: I0316 17:35:39.234569 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/2dfcb27a-8b24-493a-b27f-74436a9105e0-kolla-config\") pod \"openstack-galera-0\" (UID: \"2dfcb27a-8b24-493a-b27f-74436a9105e0\") " pod="barbican-kuttl-tests/openstack-galera-0" Mar 16 17:35:39 crc kubenswrapper[5120]: I0316 17:35:39.235069 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/2dfcb27a-8b24-493a-b27f-74436a9105e0-config-data-default\") pod \"openstack-galera-0\" (UID: \"2dfcb27a-8b24-493a-b27f-74436a9105e0\") " pod="barbican-kuttl-tests/openstack-galera-0" Mar 16 17:35:39 crc kubenswrapper[5120]: I0316 17:35:39.235330 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2dfcb27a-8b24-493a-b27f-74436a9105e0-operator-scripts\") pod \"openstack-galera-0\" (UID: \"2dfcb27a-8b24-493a-b27f-74436a9105e0\") " pod="barbican-kuttl-tests/openstack-galera-0" Mar 16 17:35:39 crc kubenswrapper[5120]: I0316 17:35:39.235482 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"openstack-galera-2\" (UID: \"c2432965-72a9-4f38-a930-85969dfa64d6\") " pod="barbican-kuttl-tests/openstack-galera-2" Mar 16 17:35:39 crc kubenswrapper[5120]: I0316 17:35:39.235618 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/05269e3d-2dcd-4828-8142-7399752715b3-kolla-config\") pod \"openstack-galera-1\" (UID: \"05269e3d-2dcd-4828-8142-7399752715b3\") " pod="barbican-kuttl-tests/openstack-galera-1" Mar 16 17:35:39 crc kubenswrapper[5120]: I0316 17:35:39.235742 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/05269e3d-2dcd-4828-8142-7399752715b3-config-data-generated\") pod \"openstack-galera-1\" (UID: \"05269e3d-2dcd-4828-8142-7399752715b3\") " pod="barbican-kuttl-tests/openstack-galera-1" Mar 16 17:35:39 crc kubenswrapper[5120]: I0316 17:35:39.235495 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/2dfcb27a-8b24-493a-b27f-74436a9105e0-kolla-config\") pod \"openstack-galera-0\" (UID: \"2dfcb27a-8b24-493a-b27f-74436a9105e0\") " pod="barbican-kuttl-tests/openstack-galera-0" Mar 16 17:35:39 crc kubenswrapper[5120]: I0316 17:35:39.235831 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"openstack-galera-2\" (UID: \"c2432965-72a9-4f38-a930-85969dfa64d6\") device mount path \"/mnt/openstack/pv02\"" pod="barbican-kuttl-tests/openstack-galera-2" Mar 16 17:35:39 crc kubenswrapper[5120]: I0316 17:35:39.235977 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/05269e3d-2dcd-4828-8142-7399752715b3-config-data-default\") pod \"openstack-galera-1\" (UID: \"05269e3d-2dcd-4828-8142-7399752715b3\") " pod="barbican-kuttl-tests/openstack-galera-1" Mar 16 17:35:39 crc kubenswrapper[5120]: I0316 17:35:39.236184 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/2dfcb27a-8b24-493a-b27f-74436a9105e0-config-data-default\") pod \"openstack-galera-0\" (UID: \"2dfcb27a-8b24-493a-b27f-74436a9105e0\") " pod="barbican-kuttl-tests/openstack-galera-0" Mar 16 17:35:39 crc kubenswrapper[5120]: I0316 17:35:39.236197 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/c2432965-72a9-4f38-a930-85969dfa64d6-config-data-default\") pod \"openstack-galera-2\" (UID: \"c2432965-72a9-4f38-a930-85969dfa64d6\") " pod="barbican-kuttl-tests/openstack-galera-2" Mar 16 17:35:39 crc kubenswrapper[5120]: I0316 17:35:39.236284 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/05269e3d-2dcd-4828-8142-7399752715b3-config-data-generated\") pod \"openstack-galera-1\" (UID: \"05269e3d-2dcd-4828-8142-7399752715b3\") " pod="barbican-kuttl-tests/openstack-galera-1" Mar 16 17:35:39 crc kubenswrapper[5120]: I0316 17:35:39.236351 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v2g98\" (UniqueName: \"kubernetes.io/projected/c2432965-72a9-4f38-a930-85969dfa64d6-kube-api-access-v2g98\") pod \"openstack-galera-2\" (UID: \"c2432965-72a9-4f38-a930-85969dfa64d6\") " pod="barbican-kuttl-tests/openstack-galera-2" Mar 16 17:35:39 crc kubenswrapper[5120]: I0316 17:35:39.236731 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sc2r5\" (UniqueName: \"kubernetes.io/projected/2dfcb27a-8b24-493a-b27f-74436a9105e0-kube-api-access-sc2r5\") pod \"openstack-galera-0\" (UID: \"2dfcb27a-8b24-493a-b27f-74436a9105e0\") " pod="barbican-kuttl-tests/openstack-galera-0" Mar 16 17:35:39 crc kubenswrapper[5120]: I0316 17:35:39.236865 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/2dfcb27a-8b24-493a-b27f-74436a9105e0-config-data-generated\") pod \"openstack-galera-0\" (UID: \"2dfcb27a-8b24-493a-b27f-74436a9105e0\") " pod="barbican-kuttl-tests/openstack-galera-0" Mar 16 17:35:39 crc kubenswrapper[5120]: I0316 17:35:39.236931 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/c2432965-72a9-4f38-a930-85969dfa64d6-config-data-generated\") pod \"openstack-galera-2\" (UID: \"c2432965-72a9-4f38-a930-85969dfa64d6\") " pod="barbican-kuttl-tests/openstack-galera-2" Mar 16 17:35:39 crc kubenswrapper[5120]: I0316 17:35:39.236986 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/c2432965-72a9-4f38-a930-85969dfa64d6-config-data-default\") pod \"openstack-galera-2\" (UID: \"c2432965-72a9-4f38-a930-85969dfa64d6\") " pod="barbican-kuttl-tests/openstack-galera-2" Mar 16 17:35:39 crc kubenswrapper[5120]: I0316 17:35:39.237225 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wjbzf\" (UniqueName: \"kubernetes.io/projected/05269e3d-2dcd-4828-8142-7399752715b3-kube-api-access-wjbzf\") pod \"openstack-galera-1\" (UID: \"05269e3d-2dcd-4828-8142-7399752715b3\") " pod="barbican-kuttl-tests/openstack-galera-1" Mar 16 17:35:39 crc kubenswrapper[5120]: I0316 17:35:39.237330 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/c2432965-72a9-4f38-a930-85969dfa64d6-kolla-config\") pod \"openstack-galera-2\" (UID: \"c2432965-72a9-4f38-a930-85969dfa64d6\") " pod="barbican-kuttl-tests/openstack-galera-2" Mar 16 17:35:39 crc kubenswrapper[5120]: I0316 17:35:39.237348 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/c2432965-72a9-4f38-a930-85969dfa64d6-config-data-generated\") pod \"openstack-galera-2\" (UID: \"c2432965-72a9-4f38-a930-85969dfa64d6\") " pod="barbican-kuttl-tests/openstack-galera-2" Mar 16 17:35:39 crc kubenswrapper[5120]: I0316 17:35:39.237412 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/05269e3d-2dcd-4828-8142-7399752715b3-kolla-config\") pod \"openstack-galera-1\" (UID: \"05269e3d-2dcd-4828-8142-7399752715b3\") " pod="barbican-kuttl-tests/openstack-galera-1" Mar 16 17:35:39 crc kubenswrapper[5120]: I0316 17:35:39.237428 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"openstack-galera-1\" (UID: \"05269e3d-2dcd-4828-8142-7399752715b3\") " pod="barbican-kuttl-tests/openstack-galera-1" Mar 16 17:35:39 crc kubenswrapper[5120]: I0316 17:35:39.237343 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/2dfcb27a-8b24-493a-b27f-74436a9105e0-config-data-generated\") pod \"openstack-galera-0\" (UID: \"2dfcb27a-8b24-493a-b27f-74436a9105e0\") " pod="barbican-kuttl-tests/openstack-galera-0" Mar 16 17:35:39 crc kubenswrapper[5120]: I0316 17:35:39.237491 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"openstack-galera-0\" (UID: \"2dfcb27a-8b24-493a-b27f-74436a9105e0\") " pod="barbican-kuttl-tests/openstack-galera-0" Mar 16 17:35:39 crc kubenswrapper[5120]: I0316 17:35:39.237535 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/05269e3d-2dcd-4828-8142-7399752715b3-operator-scripts\") pod \"openstack-galera-1\" (UID: \"05269e3d-2dcd-4828-8142-7399752715b3\") " pod="barbican-kuttl-tests/openstack-galera-1" Mar 16 17:35:39 crc kubenswrapper[5120]: I0316 17:35:39.237632 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"openstack-galera-1\" (UID: \"05269e3d-2dcd-4828-8142-7399752715b3\") device mount path \"/mnt/openstack/pv01\"" pod="barbican-kuttl-tests/openstack-galera-1" Mar 16 17:35:39 crc kubenswrapper[5120]: I0316 17:35:39.237632 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c2432965-72a9-4f38-a930-85969dfa64d6-operator-scripts\") pod \"openstack-galera-2\" (UID: \"c2432965-72a9-4f38-a930-85969dfa64d6\") " pod="barbican-kuttl-tests/openstack-galera-2" Mar 16 17:35:39 crc kubenswrapper[5120]: I0316 17:35:39.237635 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"openstack-galera-0\" (UID: \"2dfcb27a-8b24-493a-b27f-74436a9105e0\") device mount path \"/mnt/openstack/pv20\"" pod="barbican-kuttl-tests/openstack-galera-0" Mar 16 17:35:39 crc kubenswrapper[5120]: I0316 17:35:39.239078 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c2432965-72a9-4f38-a930-85969dfa64d6-operator-scripts\") pod \"openstack-galera-2\" (UID: \"c2432965-72a9-4f38-a930-85969dfa64d6\") " pod="barbican-kuttl-tests/openstack-galera-2" Mar 16 17:35:39 crc kubenswrapper[5120]: I0316 17:35:39.239100 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/05269e3d-2dcd-4828-8142-7399752715b3-operator-scripts\") pod \"openstack-galera-1\" (UID: \"05269e3d-2dcd-4828-8142-7399752715b3\") " pod="barbican-kuttl-tests/openstack-galera-1" Mar 16 17:35:39 crc kubenswrapper[5120]: I0316 17:35:39.239797 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/c2432965-72a9-4f38-a930-85969dfa64d6-kolla-config\") pod \"openstack-galera-2\" (UID: \"c2432965-72a9-4f38-a930-85969dfa64d6\") " pod="barbican-kuttl-tests/openstack-galera-2" Mar 16 17:35:39 crc kubenswrapper[5120]: I0316 17:35:39.240320 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/05269e3d-2dcd-4828-8142-7399752715b3-config-data-default\") pod \"openstack-galera-1\" (UID: \"05269e3d-2dcd-4828-8142-7399752715b3\") " pod="barbican-kuttl-tests/openstack-galera-1" Mar 16 17:35:39 crc kubenswrapper[5120]: I0316 17:35:39.242278 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2dfcb27a-8b24-493a-b27f-74436a9105e0-operator-scripts\") pod \"openstack-galera-0\" (UID: \"2dfcb27a-8b24-493a-b27f-74436a9105e0\") " pod="barbican-kuttl-tests/openstack-galera-0" Mar 16 17:35:39 crc kubenswrapper[5120]: I0316 17:35:39.257123 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2g98\" (UniqueName: \"kubernetes.io/projected/c2432965-72a9-4f38-a930-85969dfa64d6-kube-api-access-v2g98\") pod \"openstack-galera-2\" (UID: \"c2432965-72a9-4f38-a930-85969dfa64d6\") " pod="barbican-kuttl-tests/openstack-galera-2" Mar 16 17:35:39 crc kubenswrapper[5120]: I0316 17:35:39.257630 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sc2r5\" (UniqueName: \"kubernetes.io/projected/2dfcb27a-8b24-493a-b27f-74436a9105e0-kube-api-access-sc2r5\") pod \"openstack-galera-0\" (UID: \"2dfcb27a-8b24-493a-b27f-74436a9105e0\") " pod="barbican-kuttl-tests/openstack-galera-0" Mar 16 17:35:39 crc kubenswrapper[5120]: I0316 17:35:39.257782 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjbzf\" (UniqueName: \"kubernetes.io/projected/05269e3d-2dcd-4828-8142-7399752715b3-kube-api-access-wjbzf\") pod \"openstack-galera-1\" (UID: \"05269e3d-2dcd-4828-8142-7399752715b3\") " pod="barbican-kuttl-tests/openstack-galera-1" Mar 16 17:35:39 crc kubenswrapper[5120]: I0316 17:35:39.258267 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"openstack-galera-0\" (UID: \"2dfcb27a-8b24-493a-b27f-74436a9105e0\") " pod="barbican-kuttl-tests/openstack-galera-0" Mar 16 17:35:39 crc kubenswrapper[5120]: I0316 17:35:39.260691 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"openstack-galera-2\" (UID: \"c2432965-72a9-4f38-a930-85969dfa64d6\") " pod="barbican-kuttl-tests/openstack-galera-2" Mar 16 17:35:39 crc kubenswrapper[5120]: I0316 17:35:39.260858 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"openstack-galera-1\" (UID: \"05269e3d-2dcd-4828-8142-7399752715b3\") " pod="barbican-kuttl-tests/openstack-galera-1" Mar 16 17:35:39 crc kubenswrapper[5120]: I0316 17:35:39.450423 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/openstack-galera-0" Mar 16 17:35:39 crc kubenswrapper[5120]: I0316 17:35:39.455403 5120 generic.go:358] "Generic (PLEG): container finished" podID="0b997602-48d7-44cd-b3f0-6e0425c6221c" containerID="18b95fd11bd1fe9aba9152f730a9db1c4093aaf9d424fd5a4974869b71b5b07d" exitCode=0 Mar 16 17:35:39 crc kubenswrapper[5120]: I0316 17:35:39.455495 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/0b4c51a436ce56c4393293420dad5bb37f4e2c4f062c7176860d28159525g5w" event={"ID":"0b997602-48d7-44cd-b3f0-6e0425c6221c","Type":"ContainerDied","Data":"18b95fd11bd1fe9aba9152f730a9db1c4093aaf9d424fd5a4974869b71b5b07d"} Mar 16 17:35:39 crc kubenswrapper[5120]: I0316 17:35:39.455717 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/0b4c51a436ce56c4393293420dad5bb37f4e2c4f062c7176860d28159525g5w" event={"ID":"0b997602-48d7-44cd-b3f0-6e0425c6221c","Type":"ContainerStarted","Data":"b8ef7435e764da0f6c95619c569069c62fa53a5ef951347025bf4779a8518fd4"} Mar 16 17:35:39 crc kubenswrapper[5120]: I0316 17:35:39.482189 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/openstack-galera-1" Mar 16 17:35:39 crc kubenswrapper[5120]: I0316 17:35:39.498655 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/openstack-galera-2" Mar 16 17:35:39 crc kubenswrapper[5120]: I0316 17:35:39.929869 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["barbican-kuttl-tests/openstack-galera-0"] Mar 16 17:35:39 crc kubenswrapper[5120]: I0316 17:35:39.991390 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["barbican-kuttl-tests/openstack-galera-2"] Mar 16 17:35:39 crc kubenswrapper[5120]: I0316 17:35:39.998370 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["barbican-kuttl-tests/openstack-galera-1"] Mar 16 17:35:40 crc kubenswrapper[5120]: I0316 17:35:40.469331 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/openstack-galera-1" event={"ID":"05269e3d-2dcd-4828-8142-7399752715b3","Type":"ContainerStarted","Data":"538ce3c4956105a437564df6dcc125669c2d5a7191e8b6a1dd8efe13d1b8c74c"} Mar 16 17:35:40 crc kubenswrapper[5120]: I0316 17:35:40.469669 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/openstack-galera-1" event={"ID":"05269e3d-2dcd-4828-8142-7399752715b3","Type":"ContainerStarted","Data":"95fdb8c3d67e4f45182aa398eb0780e1b7736fce487e28e324cd64cacc729312"} Mar 16 17:35:40 crc kubenswrapper[5120]: I0316 17:35:40.471175 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/openstack-galera-2" event={"ID":"c2432965-72a9-4f38-a930-85969dfa64d6","Type":"ContainerStarted","Data":"92ace8bba3c5af5aa6d82a9d1f8721131c908a88141430070c28206a65352c46"} Mar 16 17:35:40 crc kubenswrapper[5120]: I0316 17:35:40.471202 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/openstack-galera-2" event={"ID":"c2432965-72a9-4f38-a930-85969dfa64d6","Type":"ContainerStarted","Data":"6c8907aefefe446ebb8725abdce8a0b9739fd3b4fcc101ea185c7962945abde5"} Mar 16 17:35:40 crc kubenswrapper[5120]: I0316 17:35:40.474195 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/openstack-galera-0" event={"ID":"2dfcb27a-8b24-493a-b27f-74436a9105e0","Type":"ContainerStarted","Data":"cbc275544c769916eae261440ae4e65beb6bb6dbb3351f1ae47027611bd82335"} Mar 16 17:35:40 crc kubenswrapper[5120]: I0316 17:35:40.474265 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/openstack-galera-0" event={"ID":"2dfcb27a-8b24-493a-b27f-74436a9105e0","Type":"ContainerStarted","Data":"a2a25e7350ecc0944499bd23779db5f0964ee9675c624e6d67f629eca92cf198"} Mar 16 17:35:41 crc kubenswrapper[5120]: I0316 17:35:41.483028 5120 generic.go:358] "Generic (PLEG): container finished" podID="0b997602-48d7-44cd-b3f0-6e0425c6221c" containerID="8d3fa0260c6f70d1422459cb8cf88c35d320c37e181b97c77dca4c41f6cd83b4" exitCode=0 Mar 16 17:35:41 crc kubenswrapper[5120]: I0316 17:35:41.483084 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/0b4c51a436ce56c4393293420dad5bb37f4e2c4f062c7176860d28159525g5w" event={"ID":"0b997602-48d7-44cd-b3f0-6e0425c6221c","Type":"ContainerDied","Data":"8d3fa0260c6f70d1422459cb8cf88c35d320c37e181b97c77dca4c41f6cd83b4"} Mar 16 17:35:42 crc kubenswrapper[5120]: I0316 17:35:42.493062 5120 generic.go:358] "Generic (PLEG): container finished" podID="0b997602-48d7-44cd-b3f0-6e0425c6221c" containerID="46f6b95e140ee661fae8132503f4dd8eb835f017d7225c285963a10ca90a4f47" exitCode=0 Mar 16 17:35:42 crc kubenswrapper[5120]: I0316 17:35:42.493362 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/0b4c51a436ce56c4393293420dad5bb37f4e2c4f062c7176860d28159525g5w" event={"ID":"0b997602-48d7-44cd-b3f0-6e0425c6221c","Type":"ContainerDied","Data":"46f6b95e140ee661fae8132503f4dd8eb835f017d7225c285963a10ca90a4f47"} Mar 16 17:35:43 crc kubenswrapper[5120]: I0316 17:35:43.505840 5120 generic.go:358] "Generic (PLEG): container finished" podID="05269e3d-2dcd-4828-8142-7399752715b3" containerID="538ce3c4956105a437564df6dcc125669c2d5a7191e8b6a1dd8efe13d1b8c74c" exitCode=0 Mar 16 17:35:43 crc kubenswrapper[5120]: I0316 17:35:43.505961 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/openstack-galera-1" event={"ID":"05269e3d-2dcd-4828-8142-7399752715b3","Type":"ContainerDied","Data":"538ce3c4956105a437564df6dcc125669c2d5a7191e8b6a1dd8efe13d1b8c74c"} Mar 16 17:35:43 crc kubenswrapper[5120]: I0316 17:35:43.509352 5120 generic.go:358] "Generic (PLEG): container finished" podID="c2432965-72a9-4f38-a930-85969dfa64d6" containerID="92ace8bba3c5af5aa6d82a9d1f8721131c908a88141430070c28206a65352c46" exitCode=0 Mar 16 17:35:43 crc kubenswrapper[5120]: I0316 17:35:43.509397 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/openstack-galera-2" event={"ID":"c2432965-72a9-4f38-a930-85969dfa64d6","Type":"ContainerDied","Data":"92ace8bba3c5af5aa6d82a9d1f8721131c908a88141430070c28206a65352c46"} Mar 16 17:35:43 crc kubenswrapper[5120]: I0316 17:35:43.513346 5120 generic.go:358] "Generic (PLEG): container finished" podID="2dfcb27a-8b24-493a-b27f-74436a9105e0" containerID="cbc275544c769916eae261440ae4e65beb6bb6dbb3351f1ae47027611bd82335" exitCode=0 Mar 16 17:35:43 crc kubenswrapper[5120]: I0316 17:35:43.513432 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/openstack-galera-0" event={"ID":"2dfcb27a-8b24-493a-b27f-74436a9105e0","Type":"ContainerDied","Data":"cbc275544c769916eae261440ae4e65beb6bb6dbb3351f1ae47027611bd82335"} Mar 16 17:35:43 crc kubenswrapper[5120]: I0316 17:35:43.857891 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/0b4c51a436ce56c4393293420dad5bb37f4e2c4f062c7176860d28159525g5w" Mar 16 17:35:43 crc kubenswrapper[5120]: I0316 17:35:43.941548 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0b997602-48d7-44cd-b3f0-6e0425c6221c-bundle\") pod \"0b997602-48d7-44cd-b3f0-6e0425c6221c\" (UID: \"0b997602-48d7-44cd-b3f0-6e0425c6221c\") " Mar 16 17:35:43 crc kubenswrapper[5120]: I0316 17:35:43.942013 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qlwdm\" (UniqueName: \"kubernetes.io/projected/0b997602-48d7-44cd-b3f0-6e0425c6221c-kube-api-access-qlwdm\") pod \"0b997602-48d7-44cd-b3f0-6e0425c6221c\" (UID: \"0b997602-48d7-44cd-b3f0-6e0425c6221c\") " Mar 16 17:35:43 crc kubenswrapper[5120]: I0316 17:35:43.942107 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0b997602-48d7-44cd-b3f0-6e0425c6221c-util\") pod \"0b997602-48d7-44cd-b3f0-6e0425c6221c\" (UID: \"0b997602-48d7-44cd-b3f0-6e0425c6221c\") " Mar 16 17:35:43 crc kubenswrapper[5120]: I0316 17:35:43.943305 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b997602-48d7-44cd-b3f0-6e0425c6221c-bundle" (OuterVolumeSpecName: "bundle") pod "0b997602-48d7-44cd-b3f0-6e0425c6221c" (UID: "0b997602-48d7-44cd-b3f0-6e0425c6221c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:35:43 crc kubenswrapper[5120]: I0316 17:35:43.946953 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b997602-48d7-44cd-b3f0-6e0425c6221c-kube-api-access-qlwdm" (OuterVolumeSpecName: "kube-api-access-qlwdm") pod "0b997602-48d7-44cd-b3f0-6e0425c6221c" (UID: "0b997602-48d7-44cd-b3f0-6e0425c6221c"). InnerVolumeSpecName "kube-api-access-qlwdm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:35:43 crc kubenswrapper[5120]: I0316 17:35:43.956041 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b997602-48d7-44cd-b3f0-6e0425c6221c-util" (OuterVolumeSpecName: "util") pod "0b997602-48d7-44cd-b3f0-6e0425c6221c" (UID: "0b997602-48d7-44cd-b3f0-6e0425c6221c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:35:44 crc kubenswrapper[5120]: I0316 17:35:44.045138 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qlwdm\" (UniqueName: \"kubernetes.io/projected/0b997602-48d7-44cd-b3f0-6e0425c6221c-kube-api-access-qlwdm\") on node \"crc\" DevicePath \"\"" Mar 16 17:35:44 crc kubenswrapper[5120]: I0316 17:35:44.045174 5120 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0b997602-48d7-44cd-b3f0-6e0425c6221c-util\") on node \"crc\" DevicePath \"\"" Mar 16 17:35:44 crc kubenswrapper[5120]: I0316 17:35:44.045186 5120 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0b997602-48d7-44cd-b3f0-6e0425c6221c-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:35:44 crc kubenswrapper[5120]: I0316 17:35:44.523421 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/openstack-galera-0" event={"ID":"2dfcb27a-8b24-493a-b27f-74436a9105e0","Type":"ContainerStarted","Data":"bd886c662bfb32fade18831a0234c64c44dffce578f9763a885f87560d3a39d3"} Mar 16 17:35:44 crc kubenswrapper[5120]: I0316 17:35:44.528230 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/0b4c51a436ce56c4393293420dad5bb37f4e2c4f062c7176860d28159525g5w" Mar 16 17:35:44 crc kubenswrapper[5120]: I0316 17:35:44.528270 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/0b4c51a436ce56c4393293420dad5bb37f4e2c4f062c7176860d28159525g5w" event={"ID":"0b997602-48d7-44cd-b3f0-6e0425c6221c","Type":"ContainerDied","Data":"b8ef7435e764da0f6c95619c569069c62fa53a5ef951347025bf4779a8518fd4"} Mar 16 17:35:44 crc kubenswrapper[5120]: I0316 17:35:44.528665 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b8ef7435e764da0f6c95619c569069c62fa53a5ef951347025bf4779a8518fd4" Mar 16 17:35:44 crc kubenswrapper[5120]: I0316 17:35:44.536250 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/openstack-galera-1" event={"ID":"05269e3d-2dcd-4828-8142-7399752715b3","Type":"ContainerStarted","Data":"a479804a3d0df2071c52b491d2c146037b2340dde34949b3e23c461b0785e14e"} Mar 16 17:35:44 crc kubenswrapper[5120]: I0316 17:35:44.538436 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/openstack-galera-2" event={"ID":"c2432965-72a9-4f38-a930-85969dfa64d6","Type":"ContainerStarted","Data":"1deaa04f0ba47668cb024c27266a0f617291e4ea399fd904803d2a470feb57ab"} Mar 16 17:35:44 crc kubenswrapper[5120]: I0316 17:35:44.546508 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="barbican-kuttl-tests/openstack-galera-0" podStartSLOduration=7.546485591 podStartE2EDuration="7.546485591s" podCreationTimestamp="2026-03-16 17:35:37 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:35:44.542408719 +0000 UTC m=+7446.696340396" watchObservedRunningTime="2026-03-16 17:35:44.546485591 +0000 UTC m=+7446.700417248" Mar 16 17:35:44 crc kubenswrapper[5120]: I0316 17:35:44.566537 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="barbican-kuttl-tests/openstack-galera-1" podStartSLOduration=6.566522638 podStartE2EDuration="6.566522638s" podCreationTimestamp="2026-03-16 17:35:38 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:35:44.562516678 +0000 UTC m=+7446.716448355" watchObservedRunningTime="2026-03-16 17:35:44.566522638 +0000 UTC m=+7446.720454295" Mar 16 17:35:44 crc kubenswrapper[5120]: I0316 17:35:44.585049 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="barbican-kuttl-tests/openstack-galera-2" podStartSLOduration=6.585028233 podStartE2EDuration="6.585028233s" podCreationTimestamp="2026-03-16 17:35:38 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:35:44.580280414 +0000 UTC m=+7446.734212091" watchObservedRunningTime="2026-03-16 17:35:44.585028233 +0000 UTC m=+7446.738959890" Mar 16 17:35:49 crc kubenswrapper[5120]: I0316 17:35:49.452055 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="barbican-kuttl-tests/openstack-galera-0" Mar 16 17:35:49 crc kubenswrapper[5120]: I0316 17:35:49.452415 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="barbican-kuttl-tests/openstack-galera-0" Mar 16 17:35:49 crc kubenswrapper[5120]: I0316 17:35:49.483332 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="barbican-kuttl-tests/openstack-galera-1" Mar 16 17:35:49 crc kubenswrapper[5120]: I0316 17:35:49.483387 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="barbican-kuttl-tests/openstack-galera-1" Mar 16 17:35:49 crc kubenswrapper[5120]: I0316 17:35:49.500284 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="barbican-kuttl-tests/openstack-galera-2" Mar 16 17:35:49 crc kubenswrapper[5120]: I0316 17:35:49.500337 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="barbican-kuttl-tests/openstack-galera-2" Mar 16 17:35:52 crc kubenswrapper[5120]: I0316 17:35:52.908787 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="barbican-kuttl-tests/openstack-galera-2" Mar 16 17:35:52 crc kubenswrapper[5120]: I0316 17:35:52.979414 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="barbican-kuttl-tests/openstack-galera-2" Mar 16 17:35:58 crc kubenswrapper[5120]: I0316 17:35:58.085141 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["barbican-kuttl-tests/root-account-create-update-9lfqj"] Mar 16 17:35:58 crc kubenswrapper[5120]: I0316 17:35:58.089154 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b997602-48d7-44cd-b3f0-6e0425c6221c" containerName="pull" Mar 16 17:35:58 crc kubenswrapper[5120]: I0316 17:35:58.089312 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b997602-48d7-44cd-b3f0-6e0425c6221c" containerName="pull" Mar 16 17:35:58 crc kubenswrapper[5120]: I0316 17:35:58.089406 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b997602-48d7-44cd-b3f0-6e0425c6221c" containerName="extract" Mar 16 17:35:58 crc kubenswrapper[5120]: I0316 17:35:58.089479 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b997602-48d7-44cd-b3f0-6e0425c6221c" containerName="extract" Mar 16 17:35:58 crc kubenswrapper[5120]: I0316 17:35:58.089554 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b997602-48d7-44cd-b3f0-6e0425c6221c" containerName="util" Mar 16 17:35:58 crc kubenswrapper[5120]: I0316 17:35:58.089618 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b997602-48d7-44cd-b3f0-6e0425c6221c" containerName="util" Mar 16 17:35:58 crc kubenswrapper[5120]: I0316 17:35:58.089849 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="0b997602-48d7-44cd-b3f0-6e0425c6221c" containerName="extract" Mar 16 17:35:58 crc kubenswrapper[5120]: I0316 17:35:58.094800 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/root-account-create-update-9lfqj" Mar 16 17:35:58 crc kubenswrapper[5120]: I0316 17:35:58.096951 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"barbican-kuttl-tests\"/\"openstack-mariadb-root-db-secret\"" Mar 16 17:35:58 crc kubenswrapper[5120]: I0316 17:35:58.103262 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["barbican-kuttl-tests/root-account-create-update-9lfqj"] Mar 16 17:35:58 crc kubenswrapper[5120]: I0316 17:35:58.147612 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6wlr\" (UniqueName: \"kubernetes.io/projected/6f852726-0929-487f-98f9-de1ec1032632-kube-api-access-g6wlr\") pod \"root-account-create-update-9lfqj\" (UID: \"6f852726-0929-487f-98f9-de1ec1032632\") " pod="barbican-kuttl-tests/root-account-create-update-9lfqj" Mar 16 17:35:58 crc kubenswrapper[5120]: I0316 17:35:58.147696 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/6f852726-0929-487f-98f9-de1ec1032632-operator-scripts\") pod \"root-account-create-update-9lfqj\" (UID: \"6f852726-0929-487f-98f9-de1ec1032632\") " pod="barbican-kuttl-tests/root-account-create-update-9lfqj" Mar 16 17:35:58 crc kubenswrapper[5120]: I0316 17:35:58.251660 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g6wlr\" (UniqueName: \"kubernetes.io/projected/6f852726-0929-487f-98f9-de1ec1032632-kube-api-access-g6wlr\") pod \"root-account-create-update-9lfqj\" (UID: \"6f852726-0929-487f-98f9-de1ec1032632\") " pod="barbican-kuttl-tests/root-account-create-update-9lfqj" Mar 16 17:35:58 crc kubenswrapper[5120]: I0316 17:35:58.252052 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/6f852726-0929-487f-98f9-de1ec1032632-operator-scripts\") pod \"root-account-create-update-9lfqj\" (UID: \"6f852726-0929-487f-98f9-de1ec1032632\") " pod="barbican-kuttl-tests/root-account-create-update-9lfqj" Mar 16 17:35:58 crc kubenswrapper[5120]: I0316 17:35:58.253473 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/6f852726-0929-487f-98f9-de1ec1032632-operator-scripts\") pod \"root-account-create-update-9lfqj\" (UID: \"6f852726-0929-487f-98f9-de1ec1032632\") " pod="barbican-kuttl-tests/root-account-create-update-9lfqj" Mar 16 17:35:58 crc kubenswrapper[5120]: I0316 17:35:58.274838 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6wlr\" (UniqueName: \"kubernetes.io/projected/6f852726-0929-487f-98f9-de1ec1032632-kube-api-access-g6wlr\") pod \"root-account-create-update-9lfqj\" (UID: \"6f852726-0929-487f-98f9-de1ec1032632\") " pod="barbican-kuttl-tests/root-account-create-update-9lfqj" Mar 16 17:35:58 crc kubenswrapper[5120]: I0316 17:35:58.420602 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/root-account-create-update-9lfqj" Mar 16 17:35:58 crc kubenswrapper[5120]: I0316 17:35:58.906753 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["barbican-kuttl-tests/root-account-create-update-9lfqj"] Mar 16 17:35:58 crc kubenswrapper[5120]: W0316 17:35:58.914206 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6f852726_0929_487f_98f9_de1ec1032632.slice/crio-3914474a8efad66504dd9cdc11fd278ca22bea4642cbe0c1d83badd81b5238fe WatchSource:0}: Error finding container 3914474a8efad66504dd9cdc11fd278ca22bea4642cbe0c1d83badd81b5238fe: Status 404 returned error can't find the container with id 3914474a8efad66504dd9cdc11fd278ca22bea4642cbe0c1d83badd81b5238fe Mar 16 17:35:59 crc kubenswrapper[5120]: I0316 17:35:59.656081 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/root-account-create-update-9lfqj" event={"ID":"6f852726-0929-487f-98f9-de1ec1032632","Type":"ContainerStarted","Data":"da849f57a022768b88910fd6487d2766891ee2f507ac2a628bef5cd0450464f8"} Mar 16 17:35:59 crc kubenswrapper[5120]: I0316 17:35:59.656128 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/root-account-create-update-9lfqj" event={"ID":"6f852726-0929-487f-98f9-de1ec1032632","Type":"ContainerStarted","Data":"3914474a8efad66504dd9cdc11fd278ca22bea4642cbe0c1d83badd81b5238fe"} Mar 16 17:35:59 crc kubenswrapper[5120]: I0316 17:35:59.676391 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="barbican-kuttl-tests/root-account-create-update-9lfqj" podStartSLOduration=1.676371107 podStartE2EDuration="1.676371107s" podCreationTimestamp="2026-03-16 17:35:58 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:35:59.670942639 +0000 UTC m=+7461.824874296" watchObservedRunningTime="2026-03-16 17:35:59.676371107 +0000 UTC m=+7461.830302764" Mar 16 17:36:00 crc kubenswrapper[5120]: I0316 17:36:00.121535 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-infra/auto-csr-approver-29561376-n8jht"] Mar 16 17:36:00 crc kubenswrapper[5120]: I0316 17:36:00.137991 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561376-n8jht"] Mar 16 17:36:00 crc kubenswrapper[5120]: I0316 17:36:00.138117 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561376-n8jht" Mar 16 17:36:00 crc kubenswrapper[5120]: I0316 17:36:00.144296 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"kube-root-ca.crt\"" Mar 16 17:36:00 crc kubenswrapper[5120]: I0316 17:36:00.144479 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-infra\"/\"csr-approver-sa-dockercfg-x2nsz\"" Mar 16 17:36:00 crc kubenswrapper[5120]: I0316 17:36:00.144536 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"openshift-service-ca.crt\"" Mar 16 17:36:00 crc kubenswrapper[5120]: I0316 17:36:00.194554 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkp6t\" (UniqueName: \"kubernetes.io/projected/735c0765-482f-45df-a6eb-bcb2dcc38e4f-kube-api-access-hkp6t\") pod \"auto-csr-approver-29561376-n8jht\" (UID: \"735c0765-482f-45df-a6eb-bcb2dcc38e4f\") " pod="openshift-infra/auto-csr-approver-29561376-n8jht" Mar 16 17:36:00 crc kubenswrapper[5120]: I0316 17:36:00.296850 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hkp6t\" (UniqueName: \"kubernetes.io/projected/735c0765-482f-45df-a6eb-bcb2dcc38e4f-kube-api-access-hkp6t\") pod \"auto-csr-approver-29561376-n8jht\" (UID: \"735c0765-482f-45df-a6eb-bcb2dcc38e4f\") " pod="openshift-infra/auto-csr-approver-29561376-n8jht" Mar 16 17:36:00 crc kubenswrapper[5120]: I0316 17:36:00.321845 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkp6t\" (UniqueName: \"kubernetes.io/projected/735c0765-482f-45df-a6eb-bcb2dcc38e4f-kube-api-access-hkp6t\") pod \"auto-csr-approver-29561376-n8jht\" (UID: \"735c0765-482f-45df-a6eb-bcb2dcc38e4f\") " pod="openshift-infra/auto-csr-approver-29561376-n8jht" Mar 16 17:36:00 crc kubenswrapper[5120]: I0316 17:36:00.456706 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561376-n8jht" Mar 16 17:36:00 crc kubenswrapper[5120]: I0316 17:36:00.663907 5120 generic.go:358] "Generic (PLEG): container finished" podID="6f852726-0929-487f-98f9-de1ec1032632" containerID="da849f57a022768b88910fd6487d2766891ee2f507ac2a628bef5cd0450464f8" exitCode=0 Mar 16 17:36:00 crc kubenswrapper[5120]: I0316 17:36:00.671825 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/root-account-create-update-9lfqj" event={"ID":"6f852726-0929-487f-98f9-de1ec1032632","Type":"ContainerDied","Data":"da849f57a022768b88910fd6487d2766891ee2f507ac2a628bef5cd0450464f8"} Mar 16 17:36:00 crc kubenswrapper[5120]: I0316 17:36:00.882478 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561376-n8jht"] Mar 16 17:36:00 crc kubenswrapper[5120]: W0316 17:36:00.887172 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod735c0765_482f_45df_a6eb_bcb2dcc38e4f.slice/crio-dafd5a160fc008fad388cfb2e4bbe5294c750121baba0438aa8a0864e5dde3ef WatchSource:0}: Error finding container dafd5a160fc008fad388cfb2e4bbe5294c750121baba0438aa8a0864e5dde3ef: Status 404 returned error can't find the container with id dafd5a160fc008fad388cfb2e4bbe5294c750121baba0438aa8a0864e5dde3ef Mar 16 17:36:01 crc kubenswrapper[5120]: I0316 17:36:01.126545 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="barbican-kuttl-tests/openstack-galera-0" Mar 16 17:36:01 crc kubenswrapper[5120]: I0316 17:36:01.157940 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-operators/infra-operator-controller-manager-747c77fd77-qt2c6"] Mar 16 17:36:01 crc kubenswrapper[5120]: I0316 17:36:01.163406 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/infra-operator-controller-manager-747c77fd77-qt2c6" Mar 16 17:36:01 crc kubenswrapper[5120]: I0316 17:36:01.165920 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-operators\"/\"infra-operator-controller-manager-dockercfg-fcm6c\"" Mar 16 17:36:01 crc kubenswrapper[5120]: I0316 17:36:01.166111 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-operators\"/\"infra-operator-controller-manager-service-cert\"" Mar 16 17:36:01 crc kubenswrapper[5120]: I0316 17:36:01.186472 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/infra-operator-controller-manager-747c77fd77-qt2c6"] Mar 16 17:36:01 crc kubenswrapper[5120]: I0316 17:36:01.217660 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a2746e35-f4b1-4c30-9288-8e4e9dc669bd-webhook-cert\") pod \"infra-operator-controller-manager-747c77fd77-qt2c6\" (UID: \"a2746e35-f4b1-4c30-9288-8e4e9dc669bd\") " pod="openstack-operators/infra-operator-controller-manager-747c77fd77-qt2c6" Mar 16 17:36:01 crc kubenswrapper[5120]: I0316 17:36:01.217893 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vk52k\" (UniqueName: \"kubernetes.io/projected/a2746e35-f4b1-4c30-9288-8e4e9dc669bd-kube-api-access-vk52k\") pod \"infra-operator-controller-manager-747c77fd77-qt2c6\" (UID: \"a2746e35-f4b1-4c30-9288-8e4e9dc669bd\") " pod="openstack-operators/infra-operator-controller-manager-747c77fd77-qt2c6" Mar 16 17:36:01 crc kubenswrapper[5120]: I0316 17:36:01.217954 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a2746e35-f4b1-4c30-9288-8e4e9dc669bd-apiservice-cert\") pod \"infra-operator-controller-manager-747c77fd77-qt2c6\" (UID: \"a2746e35-f4b1-4c30-9288-8e4e9dc669bd\") " pod="openstack-operators/infra-operator-controller-manager-747c77fd77-qt2c6" Mar 16 17:36:01 crc kubenswrapper[5120]: I0316 17:36:01.318039 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="barbican-kuttl-tests/openstack-galera-0" Mar 16 17:36:01 crc kubenswrapper[5120]: I0316 17:36:01.319530 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a2746e35-f4b1-4c30-9288-8e4e9dc669bd-webhook-cert\") pod \"infra-operator-controller-manager-747c77fd77-qt2c6\" (UID: \"a2746e35-f4b1-4c30-9288-8e4e9dc669bd\") " pod="openstack-operators/infra-operator-controller-manager-747c77fd77-qt2c6" Mar 16 17:36:01 crc kubenswrapper[5120]: I0316 17:36:01.319659 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vk52k\" (UniqueName: \"kubernetes.io/projected/a2746e35-f4b1-4c30-9288-8e4e9dc669bd-kube-api-access-vk52k\") pod \"infra-operator-controller-manager-747c77fd77-qt2c6\" (UID: \"a2746e35-f4b1-4c30-9288-8e4e9dc669bd\") " pod="openstack-operators/infra-operator-controller-manager-747c77fd77-qt2c6" Mar 16 17:36:01 crc kubenswrapper[5120]: I0316 17:36:01.319699 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a2746e35-f4b1-4c30-9288-8e4e9dc669bd-apiservice-cert\") pod \"infra-operator-controller-manager-747c77fd77-qt2c6\" (UID: \"a2746e35-f4b1-4c30-9288-8e4e9dc669bd\") " pod="openstack-operators/infra-operator-controller-manager-747c77fd77-qt2c6" Mar 16 17:36:01 crc kubenswrapper[5120]: I0316 17:36:01.327435 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a2746e35-f4b1-4c30-9288-8e4e9dc669bd-apiservice-cert\") pod \"infra-operator-controller-manager-747c77fd77-qt2c6\" (UID: \"a2746e35-f4b1-4c30-9288-8e4e9dc669bd\") " pod="openstack-operators/infra-operator-controller-manager-747c77fd77-qt2c6" Mar 16 17:36:01 crc kubenswrapper[5120]: I0316 17:36:01.343410 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vk52k\" (UniqueName: \"kubernetes.io/projected/a2746e35-f4b1-4c30-9288-8e4e9dc669bd-kube-api-access-vk52k\") pod \"infra-operator-controller-manager-747c77fd77-qt2c6\" (UID: \"a2746e35-f4b1-4c30-9288-8e4e9dc669bd\") " pod="openstack-operators/infra-operator-controller-manager-747c77fd77-qt2c6" Mar 16 17:36:01 crc kubenswrapper[5120]: I0316 17:36:01.350541 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a2746e35-f4b1-4c30-9288-8e4e9dc669bd-webhook-cert\") pod \"infra-operator-controller-manager-747c77fd77-qt2c6\" (UID: \"a2746e35-f4b1-4c30-9288-8e4e9dc669bd\") " pod="openstack-operators/infra-operator-controller-manager-747c77fd77-qt2c6" Mar 16 17:36:01 crc kubenswrapper[5120]: I0316 17:36:01.496595 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/infra-operator-controller-manager-747c77fd77-qt2c6" Mar 16 17:36:01 crc kubenswrapper[5120]: I0316 17:36:01.681145 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561376-n8jht" event={"ID":"735c0765-482f-45df-a6eb-bcb2dcc38e4f","Type":"ContainerStarted","Data":"dafd5a160fc008fad388cfb2e4bbe5294c750121baba0438aa8a0864e5dde3ef"} Mar 16 17:36:01 crc kubenswrapper[5120]: I0316 17:36:01.945826 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/infra-operator-controller-manager-747c77fd77-qt2c6"] Mar 16 17:36:02 crc kubenswrapper[5120]: I0316 17:36:02.066738 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/root-account-create-update-9lfqj" Mar 16 17:36:02 crc kubenswrapper[5120]: I0316 17:36:02.137047 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/6f852726-0929-487f-98f9-de1ec1032632-operator-scripts\") pod \"6f852726-0929-487f-98f9-de1ec1032632\" (UID: \"6f852726-0929-487f-98f9-de1ec1032632\") " Mar 16 17:36:02 crc kubenswrapper[5120]: I0316 17:36:02.137197 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g6wlr\" (UniqueName: \"kubernetes.io/projected/6f852726-0929-487f-98f9-de1ec1032632-kube-api-access-g6wlr\") pod \"6f852726-0929-487f-98f9-de1ec1032632\" (UID: \"6f852726-0929-487f-98f9-de1ec1032632\") " Mar 16 17:36:02 crc kubenswrapper[5120]: I0316 17:36:02.138030 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f852726-0929-487f-98f9-de1ec1032632-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "6f852726-0929-487f-98f9-de1ec1032632" (UID: "6f852726-0929-487f-98f9-de1ec1032632"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:36:02 crc kubenswrapper[5120]: I0316 17:36:02.139078 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/6f852726-0929-487f-98f9-de1ec1032632-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:36:02 crc kubenswrapper[5120]: I0316 17:36:02.145914 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f852726-0929-487f-98f9-de1ec1032632-kube-api-access-g6wlr" (OuterVolumeSpecName: "kube-api-access-g6wlr") pod "6f852726-0929-487f-98f9-de1ec1032632" (UID: "6f852726-0929-487f-98f9-de1ec1032632"). InnerVolumeSpecName "kube-api-access-g6wlr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:36:02 crc kubenswrapper[5120]: I0316 17:36:02.240637 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g6wlr\" (UniqueName: \"kubernetes.io/projected/6f852726-0929-487f-98f9-de1ec1032632-kube-api-access-g6wlr\") on node \"crc\" DevicePath \"\"" Mar 16 17:36:02 crc kubenswrapper[5120]: I0316 17:36:02.698966 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561376-n8jht" event={"ID":"735c0765-482f-45df-a6eb-bcb2dcc38e4f","Type":"ContainerStarted","Data":"853a1f4da9c5c60ce2bb4726bbf0f66e26ce2f780eed1db3d1e9ba33f84fc918"} Mar 16 17:36:02 crc kubenswrapper[5120]: I0316 17:36:02.702029 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/root-account-create-update-9lfqj" event={"ID":"6f852726-0929-487f-98f9-de1ec1032632","Type":"ContainerDied","Data":"3914474a8efad66504dd9cdc11fd278ca22bea4642cbe0c1d83badd81b5238fe"} Mar 16 17:36:02 crc kubenswrapper[5120]: I0316 17:36:02.702078 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3914474a8efad66504dd9cdc11fd278ca22bea4642cbe0c1d83badd81b5238fe" Mar 16 17:36:02 crc kubenswrapper[5120]: I0316 17:36:02.702100 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/root-account-create-update-9lfqj" Mar 16 17:36:02 crc kubenswrapper[5120]: I0316 17:36:02.706793 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/infra-operator-controller-manager-747c77fd77-qt2c6" event={"ID":"a2746e35-f4b1-4c30-9288-8e4e9dc669bd","Type":"ContainerStarted","Data":"44db3d7248647d8ddf58a3219f150f3f604c62996f4f469db7b38bca1a8bb9b2"} Mar 16 17:36:02 crc kubenswrapper[5120]: I0316 17:36:02.735283 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-infra/auto-csr-approver-29561376-n8jht" podStartSLOduration=1.212482367 podStartE2EDuration="2.735260876s" podCreationTimestamp="2026-03-16 17:36:00 +0000 UTC" firstStartedPulling="2026-03-16 17:36:00.889555489 +0000 UTC m=+7463.043487146" lastFinishedPulling="2026-03-16 17:36:02.412333988 +0000 UTC m=+7464.566265655" observedRunningTime="2026-03-16 17:36:02.718505538 +0000 UTC m=+7464.872437195" watchObservedRunningTime="2026-03-16 17:36:02.735260876 +0000 UTC m=+7464.889192523" Mar 16 17:36:03 crc kubenswrapper[5120]: I0316 17:36:03.716243 5120 generic.go:358] "Generic (PLEG): container finished" podID="735c0765-482f-45df-a6eb-bcb2dcc38e4f" containerID="853a1f4da9c5c60ce2bb4726bbf0f66e26ce2f780eed1db3d1e9ba33f84fc918" exitCode=0 Mar 16 17:36:03 crc kubenswrapper[5120]: I0316 17:36:03.716341 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561376-n8jht" event={"ID":"735c0765-482f-45df-a6eb-bcb2dcc38e4f","Type":"ContainerDied","Data":"853a1f4da9c5c60ce2bb4726bbf0f66e26ce2f780eed1db3d1e9ba33f84fc918"} Mar 16 17:36:05 crc kubenswrapper[5120]: I0316 17:36:05.011212 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561376-n8jht" Mar 16 17:36:05 crc kubenswrapper[5120]: I0316 17:36:05.103733 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hkp6t\" (UniqueName: \"kubernetes.io/projected/735c0765-482f-45df-a6eb-bcb2dcc38e4f-kube-api-access-hkp6t\") pod \"735c0765-482f-45df-a6eb-bcb2dcc38e4f\" (UID: \"735c0765-482f-45df-a6eb-bcb2dcc38e4f\") " Mar 16 17:36:05 crc kubenswrapper[5120]: I0316 17:36:05.111189 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/735c0765-482f-45df-a6eb-bcb2dcc38e4f-kube-api-access-hkp6t" (OuterVolumeSpecName: "kube-api-access-hkp6t") pod "735c0765-482f-45df-a6eb-bcb2dcc38e4f" (UID: "735c0765-482f-45df-a6eb-bcb2dcc38e4f"). InnerVolumeSpecName "kube-api-access-hkp6t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:36:05 crc kubenswrapper[5120]: I0316 17:36:05.206612 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hkp6t\" (UniqueName: \"kubernetes.io/projected/735c0765-482f-45df-a6eb-bcb2dcc38e4f-kube-api-access-hkp6t\") on node \"crc\" DevicePath \"\"" Mar 16 17:36:05 crc kubenswrapper[5120]: I0316 17:36:05.735495 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561376-n8jht" Mar 16 17:36:05 crc kubenswrapper[5120]: I0316 17:36:05.735544 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561376-n8jht" event={"ID":"735c0765-482f-45df-a6eb-bcb2dcc38e4f","Type":"ContainerDied","Data":"dafd5a160fc008fad388cfb2e4bbe5294c750121baba0438aa8a0864e5dde3ef"} Mar 16 17:36:05 crc kubenswrapper[5120]: I0316 17:36:05.735587 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dafd5a160fc008fad388cfb2e4bbe5294c750121baba0438aa8a0864e5dde3ef" Mar 16 17:36:06 crc kubenswrapper[5120]: I0316 17:36:06.076689 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-infra/auto-csr-approver-29561370-nx5tw"] Mar 16 17:36:06 crc kubenswrapper[5120]: I0316 17:36:06.081989 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-infra/auto-csr-approver-29561370-nx5tw"] Mar 16 17:36:06 crc kubenswrapper[5120]: I0316 17:36:06.525368 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="barbican-kuttl-tests/openstack-galera-1" Mar 16 17:36:06 crc kubenswrapper[5120]: I0316 17:36:06.602986 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="barbican-kuttl-tests/openstack-galera-1" Mar 16 17:36:06 crc kubenswrapper[5120]: I0316 17:36:06.675805 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec8b3ad4-d6ad-4340-bd11-a2f30caec2cc" path="/var/lib/kubelet/pods/ec8b3ad4-d6ad-4340-bd11-a2f30caec2cc/volumes" Mar 16 17:36:07 crc kubenswrapper[5120]: E0316 17:36:07.628520 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=974608 actualBytes=10240 Mar 16 17:36:08 crc kubenswrapper[5120]: I0316 17:36:08.757700 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/infra-operator-controller-manager-747c77fd77-qt2c6" event={"ID":"a2746e35-f4b1-4c30-9288-8e4e9dc669bd","Type":"ContainerStarted","Data":"003da9c3210226d0b187f0d095b7feb9a49c6aa245e6629599fbb138002efec8"} Mar 16 17:36:08 crc kubenswrapper[5120]: I0316 17:36:08.758073 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-operators/infra-operator-controller-manager-747c77fd77-qt2c6" Mar 16 17:36:08 crc kubenswrapper[5120]: I0316 17:36:08.776290 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/infra-operator-controller-manager-747c77fd77-qt2c6" podStartSLOduration=1.9978750079999998 podStartE2EDuration="7.776274786s" podCreationTimestamp="2026-03-16 17:36:01 +0000 UTC" firstStartedPulling="2026-03-16 17:36:01.977170143 +0000 UTC m=+7464.131101800" lastFinishedPulling="2026-03-16 17:36:07.755569921 +0000 UTC m=+7469.909501578" observedRunningTime="2026-03-16 17:36:08.775198477 +0000 UTC m=+7470.929130134" watchObservedRunningTime="2026-03-16 17:36:08.776274786 +0000 UTC m=+7470.930206443" Mar 16 17:36:19 crc kubenswrapper[5120]: I0316 17:36:19.770157 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/infra-operator-controller-manager-747c77fd77-qt2c6" Mar 16 17:36:22 crc kubenswrapper[5120]: I0316 17:36:22.008091 5120 patch_prober.go:28] interesting pod/machine-config-daemon-7bf76 container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 17:36:22 crc kubenswrapper[5120]: I0316 17:36:22.008449 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 17:36:22 crc kubenswrapper[5120]: I0316 17:36:22.360636 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-operators/rabbitmq-cluster-operator-index-wzb4n"] Mar 16 17:36:22 crc kubenswrapper[5120]: I0316 17:36:22.362069 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f852726-0929-487f-98f9-de1ec1032632" containerName="mariadb-account-create-update" Mar 16 17:36:22 crc kubenswrapper[5120]: I0316 17:36:22.362119 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f852726-0929-487f-98f9-de1ec1032632" containerName="mariadb-account-create-update" Mar 16 17:36:22 crc kubenswrapper[5120]: I0316 17:36:22.362137 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="735c0765-482f-45df-a6eb-bcb2dcc38e4f" containerName="oc" Mar 16 17:36:22 crc kubenswrapper[5120]: I0316 17:36:22.362149 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="735c0765-482f-45df-a6eb-bcb2dcc38e4f" containerName="oc" Mar 16 17:36:22 crc kubenswrapper[5120]: I0316 17:36:22.369297 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="6f852726-0929-487f-98f9-de1ec1032632" containerName="mariadb-account-create-update" Mar 16 17:36:22 crc kubenswrapper[5120]: I0316 17:36:22.369393 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="735c0765-482f-45df-a6eb-bcb2dcc38e4f" containerName="oc" Mar 16 17:36:22 crc kubenswrapper[5120]: I0316 17:36:22.406373 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/rabbitmq-cluster-operator-index-wzb4n"] Mar 16 17:36:22 crc kubenswrapper[5120]: I0316 17:36:22.406569 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/rabbitmq-cluster-operator-index-wzb4n" Mar 16 17:36:22 crc kubenswrapper[5120]: I0316 17:36:22.409338 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-operators\"/\"rabbitmq-cluster-operator-index-dockercfg-djldv\"" Mar 16 17:36:22 crc kubenswrapper[5120]: I0316 17:36:22.501959 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dd6th\" (UniqueName: \"kubernetes.io/projected/ca94e72f-2aee-4d4b-a757-0fe2e4b00aa6-kube-api-access-dd6th\") pod \"rabbitmq-cluster-operator-index-wzb4n\" (UID: \"ca94e72f-2aee-4d4b-a757-0fe2e4b00aa6\") " pod="openstack-operators/rabbitmq-cluster-operator-index-wzb4n" Mar 16 17:36:22 crc kubenswrapper[5120]: I0316 17:36:22.603617 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dd6th\" (UniqueName: \"kubernetes.io/projected/ca94e72f-2aee-4d4b-a757-0fe2e4b00aa6-kube-api-access-dd6th\") pod \"rabbitmq-cluster-operator-index-wzb4n\" (UID: \"ca94e72f-2aee-4d4b-a757-0fe2e4b00aa6\") " pod="openstack-operators/rabbitmq-cluster-operator-index-wzb4n" Mar 16 17:36:22 crc kubenswrapper[5120]: I0316 17:36:22.622717 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dd6th\" (UniqueName: \"kubernetes.io/projected/ca94e72f-2aee-4d4b-a757-0fe2e4b00aa6-kube-api-access-dd6th\") pod \"rabbitmq-cluster-operator-index-wzb4n\" (UID: \"ca94e72f-2aee-4d4b-a757-0fe2e4b00aa6\") " pod="openstack-operators/rabbitmq-cluster-operator-index-wzb4n" Mar 16 17:36:22 crc kubenswrapper[5120]: I0316 17:36:22.740076 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/rabbitmq-cluster-operator-index-wzb4n" Mar 16 17:36:23 crc kubenswrapper[5120]: I0316 17:36:23.165783 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/rabbitmq-cluster-operator-index-wzb4n"] Mar 16 17:36:23 crc kubenswrapper[5120]: W0316 17:36:23.175677 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca94e72f_2aee_4d4b_a757_0fe2e4b00aa6.slice/crio-f0c7dddca24d902544a07c811c948fede9e676380330313aa6b056de71b6a386 WatchSource:0}: Error finding container f0c7dddca24d902544a07c811c948fede9e676380330313aa6b056de71b6a386: Status 404 returned error can't find the container with id f0c7dddca24d902544a07c811c948fede9e676380330313aa6b056de71b6a386 Mar 16 17:36:23 crc kubenswrapper[5120]: I0316 17:36:23.177526 5120 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Mar 16 17:36:23 crc kubenswrapper[5120]: I0316 17:36:23.874048 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/rabbitmq-cluster-operator-index-wzb4n" event={"ID":"ca94e72f-2aee-4d4b-a757-0fe2e4b00aa6","Type":"ContainerStarted","Data":"f0c7dddca24d902544a07c811c948fede9e676380330313aa6b056de71b6a386"} Mar 16 17:36:26 crc kubenswrapper[5120]: I0316 17:36:26.564724 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/rabbitmq-cluster-operator-index-wzb4n"] Mar 16 17:36:26 crc kubenswrapper[5120]: I0316 17:36:26.895732 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/rabbitmq-cluster-operator-index-wzb4n" event={"ID":"ca94e72f-2aee-4d4b-a757-0fe2e4b00aa6","Type":"ContainerStarted","Data":"01f05211c18ec00444260d986caa46907566594e8a7e8017c57530100b1f9867"} Mar 16 17:36:26 crc kubenswrapper[5120]: I0316 17:36:26.895806 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-operators/rabbitmq-cluster-operator-index-wzb4n" podUID="ca94e72f-2aee-4d4b-a757-0fe2e4b00aa6" containerName="registry-server" containerID="cri-o://01f05211c18ec00444260d986caa46907566594e8a7e8017c57530100b1f9867" gracePeriod=2 Mar 16 17:36:26 crc kubenswrapper[5120]: I0316 17:36:26.919725 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/rabbitmq-cluster-operator-index-wzb4n" podStartSLOduration=1.6407262839999999 podStartE2EDuration="4.919702132s" podCreationTimestamp="2026-03-16 17:36:22 +0000 UTC" firstStartedPulling="2026-03-16 17:36:23.177710938 +0000 UTC m=+7485.331642595" lastFinishedPulling="2026-03-16 17:36:26.456686786 +0000 UTC m=+7488.610618443" observedRunningTime="2026-03-16 17:36:26.91269633 +0000 UTC m=+7489.066627987" watchObservedRunningTime="2026-03-16 17:36:26.919702132 +0000 UTC m=+7489.073633789" Mar 16 17:36:26 crc kubenswrapper[5120]: I0316 17:36:26.952690 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-operators/rabbitmq-cluster-operator-index-7c6bb"] Mar 16 17:36:26 crc kubenswrapper[5120]: I0316 17:36:26.957203 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/rabbitmq-cluster-operator-index-7c6bb" Mar 16 17:36:26 crc kubenswrapper[5120]: I0316 17:36:26.960937 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/rabbitmq-cluster-operator-index-7c6bb"] Mar 16 17:36:27 crc kubenswrapper[5120]: I0316 17:36:27.002220 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nq5nq\" (UniqueName: \"kubernetes.io/projected/28162b7c-56dd-481a-a0f8-dd4068ec5a59-kube-api-access-nq5nq\") pod \"rabbitmq-cluster-operator-index-7c6bb\" (UID: \"28162b7c-56dd-481a-a0f8-dd4068ec5a59\") " pod="openstack-operators/rabbitmq-cluster-operator-index-7c6bb" Mar 16 17:36:27 crc kubenswrapper[5120]: I0316 17:36:27.104677 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nq5nq\" (UniqueName: \"kubernetes.io/projected/28162b7c-56dd-481a-a0f8-dd4068ec5a59-kube-api-access-nq5nq\") pod \"rabbitmq-cluster-operator-index-7c6bb\" (UID: \"28162b7c-56dd-481a-a0f8-dd4068ec5a59\") " pod="openstack-operators/rabbitmq-cluster-operator-index-7c6bb" Mar 16 17:36:27 crc kubenswrapper[5120]: I0316 17:36:27.129593 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nq5nq\" (UniqueName: \"kubernetes.io/projected/28162b7c-56dd-481a-a0f8-dd4068ec5a59-kube-api-access-nq5nq\") pod \"rabbitmq-cluster-operator-index-7c6bb\" (UID: \"28162b7c-56dd-481a-a0f8-dd4068ec5a59\") " pod="openstack-operators/rabbitmq-cluster-operator-index-7c6bb" Mar 16 17:36:27 crc kubenswrapper[5120]: I0316 17:36:27.338051 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/rabbitmq-cluster-operator-index-wzb4n" Mar 16 17:36:27 crc kubenswrapper[5120]: I0316 17:36:27.350912 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/rabbitmq-cluster-operator-index-7c6bb" Mar 16 17:36:27 crc kubenswrapper[5120]: I0316 17:36:27.415642 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dd6th\" (UniqueName: \"kubernetes.io/projected/ca94e72f-2aee-4d4b-a757-0fe2e4b00aa6-kube-api-access-dd6th\") pod \"ca94e72f-2aee-4d4b-a757-0fe2e4b00aa6\" (UID: \"ca94e72f-2aee-4d4b-a757-0fe2e4b00aa6\") " Mar 16 17:36:27 crc kubenswrapper[5120]: I0316 17:36:27.423471 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca94e72f-2aee-4d4b-a757-0fe2e4b00aa6-kube-api-access-dd6th" (OuterVolumeSpecName: "kube-api-access-dd6th") pod "ca94e72f-2aee-4d4b-a757-0fe2e4b00aa6" (UID: "ca94e72f-2aee-4d4b-a757-0fe2e4b00aa6"). InnerVolumeSpecName "kube-api-access-dd6th". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:36:27 crc kubenswrapper[5120]: I0316 17:36:27.521620 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dd6th\" (UniqueName: \"kubernetes.io/projected/ca94e72f-2aee-4d4b-a757-0fe2e4b00aa6-kube-api-access-dd6th\") on node \"crc\" DevicePath \"\"" Mar 16 17:36:27 crc kubenswrapper[5120]: I0316 17:36:27.801675 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/rabbitmq-cluster-operator-index-7c6bb"] Mar 16 17:36:27 crc kubenswrapper[5120]: W0316 17:36:27.805956 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28162b7c_56dd_481a_a0f8_dd4068ec5a59.slice/crio-b8a1b93e9a55fe0ac680f0b467608115a26cd03b918c6893ec9d4736d340d210 WatchSource:0}: Error finding container b8a1b93e9a55fe0ac680f0b467608115a26cd03b918c6893ec9d4736d340d210: Status 404 returned error can't find the container with id b8a1b93e9a55fe0ac680f0b467608115a26cd03b918c6893ec9d4736d340d210 Mar 16 17:36:27 crc kubenswrapper[5120]: I0316 17:36:27.907260 5120 generic.go:358] "Generic (PLEG): container finished" podID="ca94e72f-2aee-4d4b-a757-0fe2e4b00aa6" containerID="01f05211c18ec00444260d986caa46907566594e8a7e8017c57530100b1f9867" exitCode=0 Mar 16 17:36:27 crc kubenswrapper[5120]: I0316 17:36:27.907363 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/rabbitmq-cluster-operator-index-wzb4n" Mar 16 17:36:27 crc kubenswrapper[5120]: I0316 17:36:27.907370 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/rabbitmq-cluster-operator-index-wzb4n" event={"ID":"ca94e72f-2aee-4d4b-a757-0fe2e4b00aa6","Type":"ContainerDied","Data":"01f05211c18ec00444260d986caa46907566594e8a7e8017c57530100b1f9867"} Mar 16 17:36:27 crc kubenswrapper[5120]: I0316 17:36:27.907535 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/rabbitmq-cluster-operator-index-wzb4n" event={"ID":"ca94e72f-2aee-4d4b-a757-0fe2e4b00aa6","Type":"ContainerDied","Data":"f0c7dddca24d902544a07c811c948fede9e676380330313aa6b056de71b6a386"} Mar 16 17:36:27 crc kubenswrapper[5120]: I0316 17:36:27.907590 5120 scope.go:117] "RemoveContainer" containerID="01f05211c18ec00444260d986caa46907566594e8a7e8017c57530100b1f9867" Mar 16 17:36:27 crc kubenswrapper[5120]: I0316 17:36:27.909002 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/rabbitmq-cluster-operator-index-7c6bb" event={"ID":"28162b7c-56dd-481a-a0f8-dd4068ec5a59","Type":"ContainerStarted","Data":"b8a1b93e9a55fe0ac680f0b467608115a26cd03b918c6893ec9d4736d340d210"} Mar 16 17:36:27 crc kubenswrapper[5120]: I0316 17:36:27.927729 5120 scope.go:117] "RemoveContainer" containerID="01f05211c18ec00444260d986caa46907566594e8a7e8017c57530100b1f9867" Mar 16 17:36:27 crc kubenswrapper[5120]: E0316 17:36:27.928228 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"01f05211c18ec00444260d986caa46907566594e8a7e8017c57530100b1f9867\": container with ID starting with 01f05211c18ec00444260d986caa46907566594e8a7e8017c57530100b1f9867 not found: ID does not exist" containerID="01f05211c18ec00444260d986caa46907566594e8a7e8017c57530100b1f9867" Mar 16 17:36:27 crc kubenswrapper[5120]: I0316 17:36:27.928275 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01f05211c18ec00444260d986caa46907566594e8a7e8017c57530100b1f9867"} err="failed to get container status \"01f05211c18ec00444260d986caa46907566594e8a7e8017c57530100b1f9867\": rpc error: code = NotFound desc = could not find container \"01f05211c18ec00444260d986caa46907566594e8a7e8017c57530100b1f9867\": container with ID starting with 01f05211c18ec00444260d986caa46907566594e8a7e8017c57530100b1f9867 not found: ID does not exist" Mar 16 17:36:27 crc kubenswrapper[5120]: I0316 17:36:27.938817 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/rabbitmq-cluster-operator-index-wzb4n"] Mar 16 17:36:27 crc kubenswrapper[5120]: I0316 17:36:27.944741 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-operators/rabbitmq-cluster-operator-index-wzb4n"] Mar 16 17:36:28 crc kubenswrapper[5120]: I0316 17:36:28.684916 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca94e72f-2aee-4d4b-a757-0fe2e4b00aa6" path="/var/lib/kubelet/pods/ca94e72f-2aee-4d4b-a757-0fe2e4b00aa6/volumes" Mar 16 17:36:28 crc kubenswrapper[5120]: I0316 17:36:28.920238 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/rabbitmq-cluster-operator-index-7c6bb" event={"ID":"28162b7c-56dd-481a-a0f8-dd4068ec5a59","Type":"ContainerStarted","Data":"e81da091a65c4035c53e284e50a1b5614f6138e186cfc49ed156bca3299242da"} Mar 16 17:36:28 crc kubenswrapper[5120]: I0316 17:36:28.935998 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/rabbitmq-cluster-operator-index-7c6bb" podStartSLOduration=2.240267806 podStartE2EDuration="2.935979886s" podCreationTimestamp="2026-03-16 17:36:26 +0000 UTC" firstStartedPulling="2026-03-16 17:36:27.807667412 +0000 UTC m=+7489.961599069" lastFinishedPulling="2026-03-16 17:36:28.503379492 +0000 UTC m=+7490.657311149" observedRunningTime="2026-03-16 17:36:28.933945561 +0000 UTC m=+7491.087877218" watchObservedRunningTime="2026-03-16 17:36:28.935979886 +0000 UTC m=+7491.089911543" Mar 16 17:36:31 crc kubenswrapper[5120]: I0316 17:36:31.504447 5120 scope.go:117] "RemoveContainer" containerID="f317cbc1a8a839cda1140c0d70ddda60919b4fdd6a15c967b9ce836aadb0f34a" Mar 16 17:36:31 crc kubenswrapper[5120]: I0316 17:36:31.527578 5120 scope.go:117] "RemoveContainer" containerID="95673ae5a357aa45e270b30e99847c6edd87976528ade2c747aa44f53563913d" Mar 16 17:36:31 crc kubenswrapper[5120]: I0316 17:36:31.563910 5120 scope.go:117] "RemoveContainer" containerID="41c286ed2b2869abda5476705bd3651cc1782d041015733291119ad6b3d8c216" Mar 16 17:36:31 crc kubenswrapper[5120]: I0316 17:36:31.647094 5120 scope.go:117] "RemoveContainer" containerID="193b25f0a0e0338a0901f7a6ebd642bd72580cc135fd3b3d6cf0fbfd8b50ac31" Mar 16 17:36:37 crc kubenswrapper[5120]: I0316 17:36:37.351529 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-operators/rabbitmq-cluster-operator-index-7c6bb" Mar 16 17:36:37 crc kubenswrapper[5120]: I0316 17:36:37.352112 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-operators/rabbitmq-cluster-operator-index-7c6bb" Mar 16 17:36:37 crc kubenswrapper[5120]: I0316 17:36:37.378388 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-operators/rabbitmq-cluster-operator-index-7c6bb" Mar 16 17:36:38 crc kubenswrapper[5120]: I0316 17:36:38.014195 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/rabbitmq-cluster-operator-index-7c6bb" Mar 16 17:36:39 crc kubenswrapper[5120]: I0316 17:36:39.793556 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590msptg"] Mar 16 17:36:39 crc kubenswrapper[5120]: I0316 17:36:39.794975 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca94e72f-2aee-4d4b-a757-0fe2e4b00aa6" containerName="registry-server" Mar 16 17:36:39 crc kubenswrapper[5120]: I0316 17:36:39.795002 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca94e72f-2aee-4d4b-a757-0fe2e4b00aa6" containerName="registry-server" Mar 16 17:36:39 crc kubenswrapper[5120]: I0316 17:36:39.795170 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ca94e72f-2aee-4d4b-a757-0fe2e4b00aa6" containerName="registry-server" Mar 16 17:36:39 crc kubenswrapper[5120]: I0316 17:36:39.802258 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590msptg" Mar 16 17:36:39 crc kubenswrapper[5120]: I0316 17:36:39.806725 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-operators\"/\"default-dockercfg-rmzsx\"" Mar 16 17:36:39 crc kubenswrapper[5120]: I0316 17:36:39.810409 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590msptg"] Mar 16 17:36:39 crc kubenswrapper[5120]: I0316 17:36:39.888558 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/993eeb7c-89cd-41ce-8b61-efcff7710f0f-util\") pod \"9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590msptg\" (UID: \"993eeb7c-89cd-41ce-8b61-efcff7710f0f\") " pod="openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590msptg" Mar 16 17:36:39 crc kubenswrapper[5120]: I0316 17:36:39.888901 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/993eeb7c-89cd-41ce-8b61-efcff7710f0f-bundle\") pod \"9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590msptg\" (UID: \"993eeb7c-89cd-41ce-8b61-efcff7710f0f\") " pod="openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590msptg" Mar 16 17:36:39 crc kubenswrapper[5120]: I0316 17:36:39.889018 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bstqq\" (UniqueName: \"kubernetes.io/projected/993eeb7c-89cd-41ce-8b61-efcff7710f0f-kube-api-access-bstqq\") pod \"9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590msptg\" (UID: \"993eeb7c-89cd-41ce-8b61-efcff7710f0f\") " pod="openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590msptg" Mar 16 17:36:39 crc kubenswrapper[5120]: I0316 17:36:39.991026 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/993eeb7c-89cd-41ce-8b61-efcff7710f0f-bundle\") pod \"9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590msptg\" (UID: \"993eeb7c-89cd-41ce-8b61-efcff7710f0f\") " pod="openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590msptg" Mar 16 17:36:39 crc kubenswrapper[5120]: I0316 17:36:39.991129 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bstqq\" (UniqueName: \"kubernetes.io/projected/993eeb7c-89cd-41ce-8b61-efcff7710f0f-kube-api-access-bstqq\") pod \"9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590msptg\" (UID: \"993eeb7c-89cd-41ce-8b61-efcff7710f0f\") " pod="openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590msptg" Mar 16 17:36:39 crc kubenswrapper[5120]: I0316 17:36:39.991502 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/993eeb7c-89cd-41ce-8b61-efcff7710f0f-util\") pod \"9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590msptg\" (UID: \"993eeb7c-89cd-41ce-8b61-efcff7710f0f\") " pod="openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590msptg" Mar 16 17:36:39 crc kubenswrapper[5120]: I0316 17:36:39.991630 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/993eeb7c-89cd-41ce-8b61-efcff7710f0f-bundle\") pod \"9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590msptg\" (UID: \"993eeb7c-89cd-41ce-8b61-efcff7710f0f\") " pod="openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590msptg" Mar 16 17:36:39 crc kubenswrapper[5120]: I0316 17:36:39.991860 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/993eeb7c-89cd-41ce-8b61-efcff7710f0f-util\") pod \"9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590msptg\" (UID: \"993eeb7c-89cd-41ce-8b61-efcff7710f0f\") " pod="openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590msptg" Mar 16 17:36:40 crc kubenswrapper[5120]: I0316 17:36:40.013441 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bstqq\" (UniqueName: \"kubernetes.io/projected/993eeb7c-89cd-41ce-8b61-efcff7710f0f-kube-api-access-bstqq\") pod \"9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590msptg\" (UID: \"993eeb7c-89cd-41ce-8b61-efcff7710f0f\") " pod="openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590msptg" Mar 16 17:36:40 crc kubenswrapper[5120]: I0316 17:36:40.121175 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590msptg" Mar 16 17:36:40 crc kubenswrapper[5120]: I0316 17:36:40.589443 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590msptg"] Mar 16 17:36:40 crc kubenswrapper[5120]: I0316 17:36:40.600168 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["barbican-kuttl-tests/memcached-0"] Mar 16 17:36:40 crc kubenswrapper[5120]: I0316 17:36:40.604222 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/memcached-0" Mar 16 17:36:40 crc kubenswrapper[5120]: I0316 17:36:40.605869 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"barbican-kuttl-tests\"/\"memcached-config-data\"" Mar 16 17:36:40 crc kubenswrapper[5120]: I0316 17:36:40.606088 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"barbican-kuttl-tests\"/\"memcached-memcached-dockercfg-d5hn5\"" Mar 16 17:36:40 crc kubenswrapper[5120]: I0316 17:36:40.633529 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["barbican-kuttl-tests/memcached-0"] Mar 16 17:36:40 crc kubenswrapper[5120]: I0316 17:36:40.705371 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/9b2e5d7a-5b39-424d-9eaa-dcace83ebf72-config-data\") pod \"memcached-0\" (UID: \"9b2e5d7a-5b39-424d-9eaa-dcace83ebf72\") " pod="barbican-kuttl-tests/memcached-0" Mar 16 17:36:40 crc kubenswrapper[5120]: I0316 17:36:40.706078 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7ffm\" (UniqueName: \"kubernetes.io/projected/9b2e5d7a-5b39-424d-9eaa-dcace83ebf72-kube-api-access-s7ffm\") pod \"memcached-0\" (UID: \"9b2e5d7a-5b39-424d-9eaa-dcace83ebf72\") " pod="barbican-kuttl-tests/memcached-0" Mar 16 17:36:40 crc kubenswrapper[5120]: I0316 17:36:40.706435 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/9b2e5d7a-5b39-424d-9eaa-dcace83ebf72-kolla-config\") pod \"memcached-0\" (UID: \"9b2e5d7a-5b39-424d-9eaa-dcace83ebf72\") " pod="barbican-kuttl-tests/memcached-0" Mar 16 17:36:40 crc kubenswrapper[5120]: I0316 17:36:40.808741 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/9b2e5d7a-5b39-424d-9eaa-dcace83ebf72-kolla-config\") pod \"memcached-0\" (UID: \"9b2e5d7a-5b39-424d-9eaa-dcace83ebf72\") " pod="barbican-kuttl-tests/memcached-0" Mar 16 17:36:40 crc kubenswrapper[5120]: I0316 17:36:40.809793 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/9b2e5d7a-5b39-424d-9eaa-dcace83ebf72-kolla-config\") pod \"memcached-0\" (UID: \"9b2e5d7a-5b39-424d-9eaa-dcace83ebf72\") " pod="barbican-kuttl-tests/memcached-0" Mar 16 17:36:40 crc kubenswrapper[5120]: I0316 17:36:40.810101 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/9b2e5d7a-5b39-424d-9eaa-dcace83ebf72-config-data\") pod \"memcached-0\" (UID: \"9b2e5d7a-5b39-424d-9eaa-dcace83ebf72\") " pod="barbican-kuttl-tests/memcached-0" Mar 16 17:36:40 crc kubenswrapper[5120]: I0316 17:36:40.811100 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/9b2e5d7a-5b39-424d-9eaa-dcace83ebf72-config-data\") pod \"memcached-0\" (UID: \"9b2e5d7a-5b39-424d-9eaa-dcace83ebf72\") " pod="barbican-kuttl-tests/memcached-0" Mar 16 17:36:40 crc kubenswrapper[5120]: I0316 17:36:40.811236 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s7ffm\" (UniqueName: \"kubernetes.io/projected/9b2e5d7a-5b39-424d-9eaa-dcace83ebf72-kube-api-access-s7ffm\") pod \"memcached-0\" (UID: \"9b2e5d7a-5b39-424d-9eaa-dcace83ebf72\") " pod="barbican-kuttl-tests/memcached-0" Mar 16 17:36:40 crc kubenswrapper[5120]: I0316 17:36:40.830207 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7ffm\" (UniqueName: \"kubernetes.io/projected/9b2e5d7a-5b39-424d-9eaa-dcace83ebf72-kube-api-access-s7ffm\") pod \"memcached-0\" (UID: \"9b2e5d7a-5b39-424d-9eaa-dcace83ebf72\") " pod="barbican-kuttl-tests/memcached-0" Mar 16 17:36:40 crc kubenswrapper[5120]: I0316 17:36:40.986192 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/memcached-0" Mar 16 17:36:41 crc kubenswrapper[5120]: I0316 17:36:41.019955 5120 generic.go:358] "Generic (PLEG): container finished" podID="993eeb7c-89cd-41ce-8b61-efcff7710f0f" containerID="7f2ea184df671d64fac49ba841d6820f0c6ba8154a4b551f4efe24edea4cedea" exitCode=0 Mar 16 17:36:41 crc kubenswrapper[5120]: I0316 17:36:41.020135 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590msptg" event={"ID":"993eeb7c-89cd-41ce-8b61-efcff7710f0f","Type":"ContainerDied","Data":"7f2ea184df671d64fac49ba841d6820f0c6ba8154a4b551f4efe24edea4cedea"} Mar 16 17:36:41 crc kubenswrapper[5120]: I0316 17:36:41.020174 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590msptg" event={"ID":"993eeb7c-89cd-41ce-8b61-efcff7710f0f","Type":"ContainerStarted","Data":"3e02ba0546b5917dcaf7c2e069b0baeee3cbc979dc1490f818c153173af8a12d"} Mar 16 17:36:41 crc kubenswrapper[5120]: I0316 17:36:41.415236 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["barbican-kuttl-tests/memcached-0"] Mar 16 17:36:42 crc kubenswrapper[5120]: I0316 17:36:42.030845 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/memcached-0" event={"ID":"9b2e5d7a-5b39-424d-9eaa-dcace83ebf72","Type":"ContainerStarted","Data":"fe506b38b0a486a1a40d17b9ef257ac599887749a33908cd6653bd7e99071613"} Mar 16 17:36:42 crc kubenswrapper[5120]: I0316 17:36:42.031737 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="barbican-kuttl-tests/memcached-0" Mar 16 17:36:42 crc kubenswrapper[5120]: I0316 17:36:42.031756 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/memcached-0" event={"ID":"9b2e5d7a-5b39-424d-9eaa-dcace83ebf72","Type":"ContainerStarted","Data":"46fa5c7731dfe25a5ce88a914e54c1fcebe3d46bfb5a6e3e8e0429e9097b9d17"} Mar 16 17:36:42 crc kubenswrapper[5120]: I0316 17:36:42.034298 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590msptg" event={"ID":"993eeb7c-89cd-41ce-8b61-efcff7710f0f","Type":"ContainerStarted","Data":"b2a08abb89feaeb0c7364e50e447764e4b946b218627e5388c06cce8e69ad5e5"} Mar 16 17:36:42 crc kubenswrapper[5120]: I0316 17:36:42.047106 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="barbican-kuttl-tests/memcached-0" podStartSLOduration=2.04708428 podStartE2EDuration="2.04708428s" podCreationTimestamp="2026-03-16 17:36:40 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:36:42.044592262 +0000 UTC m=+7504.198523919" watchObservedRunningTime="2026-03-16 17:36:42.04708428 +0000 UTC m=+7504.201015937" Mar 16 17:36:43 crc kubenswrapper[5120]: I0316 17:36:43.042951 5120 generic.go:358] "Generic (PLEG): container finished" podID="993eeb7c-89cd-41ce-8b61-efcff7710f0f" containerID="b2a08abb89feaeb0c7364e50e447764e4b946b218627e5388c06cce8e69ad5e5" exitCode=0 Mar 16 17:36:43 crc kubenswrapper[5120]: I0316 17:36:43.043026 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590msptg" event={"ID":"993eeb7c-89cd-41ce-8b61-efcff7710f0f","Type":"ContainerDied","Data":"b2a08abb89feaeb0c7364e50e447764e4b946b218627e5388c06cce8e69ad5e5"} Mar 16 17:36:44 crc kubenswrapper[5120]: I0316 17:36:44.054958 5120 generic.go:358] "Generic (PLEG): container finished" podID="993eeb7c-89cd-41ce-8b61-efcff7710f0f" containerID="a2d457f5d3598afe4c85fa6dde8e3c3df8142437007520fccb23270d6c80cec8" exitCode=0 Mar 16 17:36:44 crc kubenswrapper[5120]: I0316 17:36:44.056267 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590msptg" event={"ID":"993eeb7c-89cd-41ce-8b61-efcff7710f0f","Type":"ContainerDied","Data":"a2d457f5d3598afe4c85fa6dde8e3c3df8142437007520fccb23270d6c80cec8"} Mar 16 17:36:45 crc kubenswrapper[5120]: I0316 17:36:45.403491 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590msptg" Mar 16 17:36:45 crc kubenswrapper[5120]: I0316 17:36:45.510836 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/993eeb7c-89cd-41ce-8b61-efcff7710f0f-bundle\") pod \"993eeb7c-89cd-41ce-8b61-efcff7710f0f\" (UID: \"993eeb7c-89cd-41ce-8b61-efcff7710f0f\") " Mar 16 17:36:45 crc kubenswrapper[5120]: I0316 17:36:45.510936 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/993eeb7c-89cd-41ce-8b61-efcff7710f0f-util\") pod \"993eeb7c-89cd-41ce-8b61-efcff7710f0f\" (UID: \"993eeb7c-89cd-41ce-8b61-efcff7710f0f\") " Mar 16 17:36:45 crc kubenswrapper[5120]: I0316 17:36:45.511112 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bstqq\" (UniqueName: \"kubernetes.io/projected/993eeb7c-89cd-41ce-8b61-efcff7710f0f-kube-api-access-bstqq\") pod \"993eeb7c-89cd-41ce-8b61-efcff7710f0f\" (UID: \"993eeb7c-89cd-41ce-8b61-efcff7710f0f\") " Mar 16 17:36:45 crc kubenswrapper[5120]: I0316 17:36:45.512380 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/993eeb7c-89cd-41ce-8b61-efcff7710f0f-bundle" (OuterVolumeSpecName: "bundle") pod "993eeb7c-89cd-41ce-8b61-efcff7710f0f" (UID: "993eeb7c-89cd-41ce-8b61-efcff7710f0f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:36:45 crc kubenswrapper[5120]: I0316 17:36:45.522065 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/993eeb7c-89cd-41ce-8b61-efcff7710f0f-kube-api-access-bstqq" (OuterVolumeSpecName: "kube-api-access-bstqq") pod "993eeb7c-89cd-41ce-8b61-efcff7710f0f" (UID: "993eeb7c-89cd-41ce-8b61-efcff7710f0f"). InnerVolumeSpecName "kube-api-access-bstqq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:36:45 crc kubenswrapper[5120]: I0316 17:36:45.524826 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/993eeb7c-89cd-41ce-8b61-efcff7710f0f-util" (OuterVolumeSpecName: "util") pod "993eeb7c-89cd-41ce-8b61-efcff7710f0f" (UID: "993eeb7c-89cd-41ce-8b61-efcff7710f0f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:36:45 crc kubenswrapper[5120]: I0316 17:36:45.613846 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bstqq\" (UniqueName: \"kubernetes.io/projected/993eeb7c-89cd-41ce-8b61-efcff7710f0f-kube-api-access-bstqq\") on node \"crc\" DevicePath \"\"" Mar 16 17:36:45 crc kubenswrapper[5120]: I0316 17:36:45.613897 5120 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/993eeb7c-89cd-41ce-8b61-efcff7710f0f-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:36:45 crc kubenswrapper[5120]: I0316 17:36:45.613910 5120 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/993eeb7c-89cd-41ce-8b61-efcff7710f0f-util\") on node \"crc\" DevicePath \"\"" Mar 16 17:36:46 crc kubenswrapper[5120]: I0316 17:36:46.088554 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590msptg" event={"ID":"993eeb7c-89cd-41ce-8b61-efcff7710f0f","Type":"ContainerDied","Data":"3e02ba0546b5917dcaf7c2e069b0baeee3cbc979dc1490f818c153173af8a12d"} Mar 16 17:36:46 crc kubenswrapper[5120]: I0316 17:36:46.088612 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3e02ba0546b5917dcaf7c2e069b0baeee3cbc979dc1490f818c153173af8a12d" Mar 16 17:36:46 crc kubenswrapper[5120]: I0316 17:36:46.088560 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590msptg" Mar 16 17:36:47 crc kubenswrapper[5120]: I0316 17:36:47.699967 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-v822j_ac55471d-4e42-475f-a082-50f611571482/kube-multus/0.log" Mar 16 17:36:47 crc kubenswrapper[5120]: I0316 17:36:47.704841 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-crc_9f0bc7fcb0822a2c13eb2d22cd8c0641/kube-controller-manager/0.log" Mar 16 17:36:47 crc kubenswrapper[5120]: I0316 17:36:47.994400 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-v822j_ac55471d-4e42-475f-a082-50f611571482/kube-multus/0.log" Mar 16 17:36:47 crc kubenswrapper[5120]: I0316 17:36:47.999295 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-crc_9f0bc7fcb0822a2c13eb2d22cd8c0641/kube-controller-manager/0.log" Mar 16 17:36:49 crc kubenswrapper[5120]: I0316 17:36:49.056961 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="barbican-kuttl-tests/memcached-0" Mar 16 17:36:49 crc kubenswrapper[5120]: I0316 17:36:49.863185 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-operators/rabbitmq-cluster-operator-6bc46f9cd-wtpcn"] Mar 16 17:36:49 crc kubenswrapper[5120]: I0316 17:36:49.864335 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="993eeb7c-89cd-41ce-8b61-efcff7710f0f" containerName="pull" Mar 16 17:36:49 crc kubenswrapper[5120]: I0316 17:36:49.864425 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="993eeb7c-89cd-41ce-8b61-efcff7710f0f" containerName="pull" Mar 16 17:36:49 crc kubenswrapper[5120]: I0316 17:36:49.864497 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="993eeb7c-89cd-41ce-8b61-efcff7710f0f" containerName="util" Mar 16 17:36:49 crc kubenswrapper[5120]: I0316 17:36:49.864556 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="993eeb7c-89cd-41ce-8b61-efcff7710f0f" containerName="util" Mar 16 17:36:49 crc kubenswrapper[5120]: I0316 17:36:49.864647 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="993eeb7c-89cd-41ce-8b61-efcff7710f0f" containerName="extract" Mar 16 17:36:49 crc kubenswrapper[5120]: I0316 17:36:49.864707 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="993eeb7c-89cd-41ce-8b61-efcff7710f0f" containerName="extract" Mar 16 17:36:49 crc kubenswrapper[5120]: I0316 17:36:49.864920 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="993eeb7c-89cd-41ce-8b61-efcff7710f0f" containerName="extract" Mar 16 17:36:49 crc kubenswrapper[5120]: I0316 17:36:49.871749 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/rabbitmq-cluster-operator-6bc46f9cd-wtpcn" Mar 16 17:36:49 crc kubenswrapper[5120]: I0316 17:36:49.872037 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/rabbitmq-cluster-operator-6bc46f9cd-wtpcn"] Mar 16 17:36:49 crc kubenswrapper[5120]: I0316 17:36:49.874310 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-operators\"/\"rabbitmq-cluster-operator-dockercfg-sz7vq\"" Mar 16 17:36:50 crc kubenswrapper[5120]: I0316 17:36:50.010485 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5nv6w\" (UniqueName: \"kubernetes.io/projected/4a70a89a-dbe2-4a18-9c72-10a183001eb4-kube-api-access-5nv6w\") pod \"rabbitmq-cluster-operator-6bc46f9cd-wtpcn\" (UID: \"4a70a89a-dbe2-4a18-9c72-10a183001eb4\") " pod="openstack-operators/rabbitmq-cluster-operator-6bc46f9cd-wtpcn" Mar 16 17:36:50 crc kubenswrapper[5120]: I0316 17:36:50.113274 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5nv6w\" (UniqueName: \"kubernetes.io/projected/4a70a89a-dbe2-4a18-9c72-10a183001eb4-kube-api-access-5nv6w\") pod \"rabbitmq-cluster-operator-6bc46f9cd-wtpcn\" (UID: \"4a70a89a-dbe2-4a18-9c72-10a183001eb4\") " pod="openstack-operators/rabbitmq-cluster-operator-6bc46f9cd-wtpcn" Mar 16 17:36:50 crc kubenswrapper[5120]: I0316 17:36:50.136433 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5nv6w\" (UniqueName: \"kubernetes.io/projected/4a70a89a-dbe2-4a18-9c72-10a183001eb4-kube-api-access-5nv6w\") pod \"rabbitmq-cluster-operator-6bc46f9cd-wtpcn\" (UID: \"4a70a89a-dbe2-4a18-9c72-10a183001eb4\") " pod="openstack-operators/rabbitmq-cluster-operator-6bc46f9cd-wtpcn" Mar 16 17:36:50 crc kubenswrapper[5120]: I0316 17:36:50.190983 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/rabbitmq-cluster-operator-6bc46f9cd-wtpcn" Mar 16 17:36:50 crc kubenswrapper[5120]: I0316 17:36:50.633381 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/rabbitmq-cluster-operator-6bc46f9cd-wtpcn"] Mar 16 17:36:50 crc kubenswrapper[5120]: W0316 17:36:50.638025 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod4a70a89a_dbe2_4a18_9c72_10a183001eb4.slice/crio-6409f751afe9dce41bd9de9f0a65484138d7be6fcc3628e1a7604a1e69dda639 WatchSource:0}: Error finding container 6409f751afe9dce41bd9de9f0a65484138d7be6fcc3628e1a7604a1e69dda639: Status 404 returned error can't find the container with id 6409f751afe9dce41bd9de9f0a65484138d7be6fcc3628e1a7604a1e69dda639 Mar 16 17:36:51 crc kubenswrapper[5120]: I0316 17:36:51.127643 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/rabbitmq-cluster-operator-6bc46f9cd-wtpcn" event={"ID":"4a70a89a-dbe2-4a18-9c72-10a183001eb4","Type":"ContainerStarted","Data":"b036b1fecf6fb17a767a090dd0f159bb51fa3960bcb0db24a9e6cd31b0cb2c04"} Mar 16 17:36:51 crc kubenswrapper[5120]: I0316 17:36:51.129128 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/rabbitmq-cluster-operator-6bc46f9cd-wtpcn" event={"ID":"4a70a89a-dbe2-4a18-9c72-10a183001eb4","Type":"ContainerStarted","Data":"6409f751afe9dce41bd9de9f0a65484138d7be6fcc3628e1a7604a1e69dda639"} Mar 16 17:36:51 crc kubenswrapper[5120]: I0316 17:36:51.149413 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/rabbitmq-cluster-operator-6bc46f9cd-wtpcn" podStartSLOduration=2.149389824 podStartE2EDuration="2.149389824s" podCreationTimestamp="2026-03-16 17:36:49 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:36:51.144382868 +0000 UTC m=+7513.298314535" watchObservedRunningTime="2026-03-16 17:36:51.149389824 +0000 UTC m=+7513.303321481" Mar 16 17:36:52 crc kubenswrapper[5120]: I0316 17:36:52.008628 5120 patch_prober.go:28] interesting pod/machine-config-daemon-7bf76 container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 17:36:52 crc kubenswrapper[5120]: I0316 17:36:52.008717 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 17:36:57 crc kubenswrapper[5120]: I0316 17:36:57.758942 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-operators/keystone-operator-index-f85dc"] Mar 16 17:36:57 crc kubenswrapper[5120]: I0316 17:36:57.773117 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/keystone-operator-index-f85dc"] Mar 16 17:36:57 crc kubenswrapper[5120]: I0316 17:36:57.773266 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/keystone-operator-index-f85dc" Mar 16 17:36:57 crc kubenswrapper[5120]: I0316 17:36:57.775510 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-operators\"/\"keystone-operator-index-dockercfg-f4vn7\"" Mar 16 17:36:57 crc kubenswrapper[5120]: I0316 17:36:57.809708 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49tww\" (UniqueName: \"kubernetes.io/projected/017f781f-d93d-4b6b-9d7e-966c513348bc-kube-api-access-49tww\") pod \"keystone-operator-index-f85dc\" (UID: \"017f781f-d93d-4b6b-9d7e-966c513348bc\") " pod="openstack-operators/keystone-operator-index-f85dc" Mar 16 17:36:57 crc kubenswrapper[5120]: I0316 17:36:57.911257 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-49tww\" (UniqueName: \"kubernetes.io/projected/017f781f-d93d-4b6b-9d7e-966c513348bc-kube-api-access-49tww\") pod \"keystone-operator-index-f85dc\" (UID: \"017f781f-d93d-4b6b-9d7e-966c513348bc\") " pod="openstack-operators/keystone-operator-index-f85dc" Mar 16 17:36:57 crc kubenswrapper[5120]: I0316 17:36:57.928799 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-49tww\" (UniqueName: \"kubernetes.io/projected/017f781f-d93d-4b6b-9d7e-966c513348bc-kube-api-access-49tww\") pod \"keystone-operator-index-f85dc\" (UID: \"017f781f-d93d-4b6b-9d7e-966c513348bc\") " pod="openstack-operators/keystone-operator-index-f85dc" Mar 16 17:36:58 crc kubenswrapper[5120]: I0316 17:36:58.092559 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/keystone-operator-index-f85dc" Mar 16 17:36:58 crc kubenswrapper[5120]: I0316 17:36:58.499807 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/keystone-operator-index-f85dc"] Mar 16 17:36:59 crc kubenswrapper[5120]: I0316 17:36:59.206668 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/keystone-operator-index-f85dc" event={"ID":"017f781f-d93d-4b6b-9d7e-966c513348bc","Type":"ContainerStarted","Data":"e768f011b0ca64b2b088c6a9a6f17ea059d8e644667650aa2c051472eb3f7fb2"} Mar 16 17:37:00 crc kubenswrapper[5120]: I0316 17:37:00.232958 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/keystone-operator-index-f85dc" event={"ID":"017f781f-d93d-4b6b-9d7e-966c513348bc","Type":"ContainerStarted","Data":"8c9697eb83443bf35e9cf1f3170a19f53200a8665f727c4c1c8af15c8db02cfe"} Mar 16 17:37:00 crc kubenswrapper[5120]: I0316 17:37:00.271159 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/keystone-operator-index-f85dc" podStartSLOduration=2.2010329730000002 podStartE2EDuration="3.271136598s" podCreationTimestamp="2026-03-16 17:36:57 +0000 UTC" firstStartedPulling="2026-03-16 17:36:58.503507774 +0000 UTC m=+7520.657439431" lastFinishedPulling="2026-03-16 17:36:59.573611379 +0000 UTC m=+7521.727543056" observedRunningTime="2026-03-16 17:37:00.248446449 +0000 UTC m=+7522.402378106" watchObservedRunningTime="2026-03-16 17:37:00.271136598 +0000 UTC m=+7522.425068245" Mar 16 17:37:07 crc kubenswrapper[5120]: E0316 17:37:07.358321 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1006880 actualBytes=10240 Mar 16 17:37:08 crc kubenswrapper[5120]: I0316 17:37:08.093357 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-operators/keystone-operator-index-f85dc" Mar 16 17:37:08 crc kubenswrapper[5120]: I0316 17:37:08.093728 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-operators/keystone-operator-index-f85dc" Mar 16 17:37:08 crc kubenswrapper[5120]: I0316 17:37:08.121549 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-operators/keystone-operator-index-f85dc" Mar 16 17:37:08 crc kubenswrapper[5120]: I0316 17:37:08.332515 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/keystone-operator-index-f85dc" Mar 16 17:37:10 crc kubenswrapper[5120]: I0316 17:37:10.387978 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-operators/057d2ef2813dbca67df99f545f5daea57175a3b6e27320c69396d55997vx8x6"] Mar 16 17:37:10 crc kubenswrapper[5120]: I0316 17:37:10.397196 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/057d2ef2813dbca67df99f545f5daea57175a3b6e27320c69396d55997vx8x6" Mar 16 17:37:10 crc kubenswrapper[5120]: I0316 17:37:10.399885 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-operators\"/\"default-dockercfg-rmzsx\"" Mar 16 17:37:10 crc kubenswrapper[5120]: I0316 17:37:10.407043 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/057d2ef2813dbca67df99f545f5daea57175a3b6e27320c69396d55997vx8x6"] Mar 16 17:37:10 crc kubenswrapper[5120]: I0316 17:37:10.495017 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/58e44673-0526-46cc-b8c8-aab0861572ed-util\") pod \"057d2ef2813dbca67df99f545f5daea57175a3b6e27320c69396d55997vx8x6\" (UID: \"58e44673-0526-46cc-b8c8-aab0861572ed\") " pod="openstack-operators/057d2ef2813dbca67df99f545f5daea57175a3b6e27320c69396d55997vx8x6" Mar 16 17:37:10 crc kubenswrapper[5120]: I0316 17:37:10.495271 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5qzq\" (UniqueName: \"kubernetes.io/projected/58e44673-0526-46cc-b8c8-aab0861572ed-kube-api-access-q5qzq\") pod \"057d2ef2813dbca67df99f545f5daea57175a3b6e27320c69396d55997vx8x6\" (UID: \"58e44673-0526-46cc-b8c8-aab0861572ed\") " pod="openstack-operators/057d2ef2813dbca67df99f545f5daea57175a3b6e27320c69396d55997vx8x6" Mar 16 17:37:10 crc kubenswrapper[5120]: I0316 17:37:10.495352 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/58e44673-0526-46cc-b8c8-aab0861572ed-bundle\") pod \"057d2ef2813dbca67df99f545f5daea57175a3b6e27320c69396d55997vx8x6\" (UID: \"58e44673-0526-46cc-b8c8-aab0861572ed\") " pod="openstack-operators/057d2ef2813dbca67df99f545f5daea57175a3b6e27320c69396d55997vx8x6" Mar 16 17:37:10 crc kubenswrapper[5120]: I0316 17:37:10.597795 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/58e44673-0526-46cc-b8c8-aab0861572ed-util\") pod \"057d2ef2813dbca67df99f545f5daea57175a3b6e27320c69396d55997vx8x6\" (UID: \"58e44673-0526-46cc-b8c8-aab0861572ed\") " pod="openstack-operators/057d2ef2813dbca67df99f545f5daea57175a3b6e27320c69396d55997vx8x6" Mar 16 17:37:10 crc kubenswrapper[5120]: I0316 17:37:10.598000 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q5qzq\" (UniqueName: \"kubernetes.io/projected/58e44673-0526-46cc-b8c8-aab0861572ed-kube-api-access-q5qzq\") pod \"057d2ef2813dbca67df99f545f5daea57175a3b6e27320c69396d55997vx8x6\" (UID: \"58e44673-0526-46cc-b8c8-aab0861572ed\") " pod="openstack-operators/057d2ef2813dbca67df99f545f5daea57175a3b6e27320c69396d55997vx8x6" Mar 16 17:37:10 crc kubenswrapper[5120]: I0316 17:37:10.598067 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/58e44673-0526-46cc-b8c8-aab0861572ed-bundle\") pod \"057d2ef2813dbca67df99f545f5daea57175a3b6e27320c69396d55997vx8x6\" (UID: \"58e44673-0526-46cc-b8c8-aab0861572ed\") " pod="openstack-operators/057d2ef2813dbca67df99f545f5daea57175a3b6e27320c69396d55997vx8x6" Mar 16 17:37:10 crc kubenswrapper[5120]: I0316 17:37:10.598665 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/58e44673-0526-46cc-b8c8-aab0861572ed-util\") pod \"057d2ef2813dbca67df99f545f5daea57175a3b6e27320c69396d55997vx8x6\" (UID: \"58e44673-0526-46cc-b8c8-aab0861572ed\") " pod="openstack-operators/057d2ef2813dbca67df99f545f5daea57175a3b6e27320c69396d55997vx8x6" Mar 16 17:37:10 crc kubenswrapper[5120]: I0316 17:37:10.598686 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/58e44673-0526-46cc-b8c8-aab0861572ed-bundle\") pod \"057d2ef2813dbca67df99f545f5daea57175a3b6e27320c69396d55997vx8x6\" (UID: \"58e44673-0526-46cc-b8c8-aab0861572ed\") " pod="openstack-operators/057d2ef2813dbca67df99f545f5daea57175a3b6e27320c69396d55997vx8x6" Mar 16 17:37:10 crc kubenswrapper[5120]: I0316 17:37:10.617613 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5qzq\" (UniqueName: \"kubernetes.io/projected/58e44673-0526-46cc-b8c8-aab0861572ed-kube-api-access-q5qzq\") pod \"057d2ef2813dbca67df99f545f5daea57175a3b6e27320c69396d55997vx8x6\" (UID: \"58e44673-0526-46cc-b8c8-aab0861572ed\") " pod="openstack-operators/057d2ef2813dbca67df99f545f5daea57175a3b6e27320c69396d55997vx8x6" Mar 16 17:37:10 crc kubenswrapper[5120]: I0316 17:37:10.737868 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/057d2ef2813dbca67df99f545f5daea57175a3b6e27320c69396d55997vx8x6" Mar 16 17:37:11 crc kubenswrapper[5120]: I0316 17:37:11.169253 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/057d2ef2813dbca67df99f545f5daea57175a3b6e27320c69396d55997vx8x6"] Mar 16 17:37:11 crc kubenswrapper[5120]: W0316 17:37:11.173833 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58e44673_0526_46cc_b8c8_aab0861572ed.slice/crio-7161aa02798d7e49e26282b67968e0b1642147fe2088fa1aab4bbcc594850edc WatchSource:0}: Error finding container 7161aa02798d7e49e26282b67968e0b1642147fe2088fa1aab4bbcc594850edc: Status 404 returned error can't find the container with id 7161aa02798d7e49e26282b67968e0b1642147fe2088fa1aab4bbcc594850edc Mar 16 17:37:11 crc kubenswrapper[5120]: I0316 17:37:11.324491 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/057d2ef2813dbca67df99f545f5daea57175a3b6e27320c69396d55997vx8x6" event={"ID":"58e44673-0526-46cc-b8c8-aab0861572ed","Type":"ContainerStarted","Data":"7161aa02798d7e49e26282b67968e0b1642147fe2088fa1aab4bbcc594850edc"} Mar 16 17:37:12 crc kubenswrapper[5120]: I0316 17:37:12.334021 5120 generic.go:358] "Generic (PLEG): container finished" podID="58e44673-0526-46cc-b8c8-aab0861572ed" containerID="a3a4c7349f320b7f0eefe940a94be11135cfd9d279d13c560db7da28c7e7200d" exitCode=0 Mar 16 17:37:12 crc kubenswrapper[5120]: I0316 17:37:12.334106 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/057d2ef2813dbca67df99f545f5daea57175a3b6e27320c69396d55997vx8x6" event={"ID":"58e44673-0526-46cc-b8c8-aab0861572ed","Type":"ContainerDied","Data":"a3a4c7349f320b7f0eefe940a94be11135cfd9d279d13c560db7da28c7e7200d"} Mar 16 17:37:14 crc kubenswrapper[5120]: I0316 17:37:14.350038 5120 generic.go:358] "Generic (PLEG): container finished" podID="58e44673-0526-46cc-b8c8-aab0861572ed" containerID="a68f9ffb26ad36494ada5eac138a3ac1bb9c6829fc4838a238ef73f774e0b440" exitCode=0 Mar 16 17:37:14 crc kubenswrapper[5120]: I0316 17:37:14.350119 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/057d2ef2813dbca67df99f545f5daea57175a3b6e27320c69396d55997vx8x6" event={"ID":"58e44673-0526-46cc-b8c8-aab0861572ed","Type":"ContainerDied","Data":"a68f9ffb26ad36494ada5eac138a3ac1bb9c6829fc4838a238ef73f774e0b440"} Mar 16 17:37:15 crc kubenswrapper[5120]: I0316 17:37:15.364422 5120 generic.go:358] "Generic (PLEG): container finished" podID="58e44673-0526-46cc-b8c8-aab0861572ed" containerID="41d36b241d581c6b60fad004f55767dd1e3ff794a98234972bf4a2d7912cfe06" exitCode=0 Mar 16 17:37:15 crc kubenswrapper[5120]: I0316 17:37:15.364458 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/057d2ef2813dbca67df99f545f5daea57175a3b6e27320c69396d55997vx8x6" event={"ID":"58e44673-0526-46cc-b8c8-aab0861572ed","Type":"ContainerDied","Data":"41d36b241d581c6b60fad004f55767dd1e3ff794a98234972bf4a2d7912cfe06"} Mar 16 17:37:16 crc kubenswrapper[5120]: I0316 17:37:16.688948 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/057d2ef2813dbca67df99f545f5daea57175a3b6e27320c69396d55997vx8x6" Mar 16 17:37:16 crc kubenswrapper[5120]: I0316 17:37:16.849393 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/58e44673-0526-46cc-b8c8-aab0861572ed-util\") pod \"58e44673-0526-46cc-b8c8-aab0861572ed\" (UID: \"58e44673-0526-46cc-b8c8-aab0861572ed\") " Mar 16 17:37:16 crc kubenswrapper[5120]: I0316 17:37:16.849736 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/58e44673-0526-46cc-b8c8-aab0861572ed-bundle\") pod \"58e44673-0526-46cc-b8c8-aab0861572ed\" (UID: \"58e44673-0526-46cc-b8c8-aab0861572ed\") " Mar 16 17:37:16 crc kubenswrapper[5120]: I0316 17:37:16.850131 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q5qzq\" (UniqueName: \"kubernetes.io/projected/58e44673-0526-46cc-b8c8-aab0861572ed-kube-api-access-q5qzq\") pod \"58e44673-0526-46cc-b8c8-aab0861572ed\" (UID: \"58e44673-0526-46cc-b8c8-aab0861572ed\") " Mar 16 17:37:16 crc kubenswrapper[5120]: I0316 17:37:16.851881 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58e44673-0526-46cc-b8c8-aab0861572ed-bundle" (OuterVolumeSpecName: "bundle") pod "58e44673-0526-46cc-b8c8-aab0861572ed" (UID: "58e44673-0526-46cc-b8c8-aab0861572ed"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:37:16 crc kubenswrapper[5120]: I0316 17:37:16.856160 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58e44673-0526-46cc-b8c8-aab0861572ed-kube-api-access-q5qzq" (OuterVolumeSpecName: "kube-api-access-q5qzq") pod "58e44673-0526-46cc-b8c8-aab0861572ed" (UID: "58e44673-0526-46cc-b8c8-aab0861572ed"). InnerVolumeSpecName "kube-api-access-q5qzq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:37:16 crc kubenswrapper[5120]: I0316 17:37:16.860324 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58e44673-0526-46cc-b8c8-aab0861572ed-util" (OuterVolumeSpecName: "util") pod "58e44673-0526-46cc-b8c8-aab0861572ed" (UID: "58e44673-0526-46cc-b8c8-aab0861572ed"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:37:16 crc kubenswrapper[5120]: I0316 17:37:16.952818 5120 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/58e44673-0526-46cc-b8c8-aab0861572ed-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:37:16 crc kubenswrapper[5120]: I0316 17:37:16.952853 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q5qzq\" (UniqueName: \"kubernetes.io/projected/58e44673-0526-46cc-b8c8-aab0861572ed-kube-api-access-q5qzq\") on node \"crc\" DevicePath \"\"" Mar 16 17:37:16 crc kubenswrapper[5120]: I0316 17:37:16.952863 5120 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/58e44673-0526-46cc-b8c8-aab0861572ed-util\") on node \"crc\" DevicePath \"\"" Mar 16 17:37:17 crc kubenswrapper[5120]: I0316 17:37:17.384942 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/057d2ef2813dbca67df99f545f5daea57175a3b6e27320c69396d55997vx8x6" event={"ID":"58e44673-0526-46cc-b8c8-aab0861572ed","Type":"ContainerDied","Data":"7161aa02798d7e49e26282b67968e0b1642147fe2088fa1aab4bbcc594850edc"} Mar 16 17:37:17 crc kubenswrapper[5120]: I0316 17:37:17.384979 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/057d2ef2813dbca67df99f545f5daea57175a3b6e27320c69396d55997vx8x6" Mar 16 17:37:17 crc kubenswrapper[5120]: I0316 17:37:17.385001 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7161aa02798d7e49e26282b67968e0b1642147fe2088fa1aab4bbcc594850edc" Mar 16 17:37:22 crc kubenswrapper[5120]: I0316 17:37:22.008263 5120 patch_prober.go:28] interesting pod/machine-config-daemon-7bf76 container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 17:37:22 crc kubenswrapper[5120]: I0316 17:37:22.008957 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 17:37:22 crc kubenswrapper[5120]: I0316 17:37:22.009016 5120 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" Mar 16 17:37:22 crc kubenswrapper[5120]: I0316 17:37:22.009782 5120 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="machine-config-daemon" containerStatusID={"Type":"cri-o","ID":"7675132b6a0a3435abd421d258a035263883c4eae7ede1a7f47b92d2e04f90b7"} pod="openshift-machine-config-operator/machine-config-daemon-7bf76" containerMessage="Container machine-config-daemon failed liveness probe, will be restarted" Mar 16 17:37:22 crc kubenswrapper[5120]: I0316 17:37:22.009871 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" containerID="cri-o://7675132b6a0a3435abd421d258a035263883c4eae7ede1a7f47b92d2e04f90b7" gracePeriod=600 Mar 16 17:37:22 crc kubenswrapper[5120]: I0316 17:37:22.424319 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" event={"ID":"e2275cb4-4905-4d66-a87e-8010120db2bd","Type":"ContainerDied","Data":"7675132b6a0a3435abd421d258a035263883c4eae7ede1a7f47b92d2e04f90b7"} Mar 16 17:37:22 crc kubenswrapper[5120]: I0316 17:37:22.424326 5120 generic.go:358] "Generic (PLEG): container finished" podID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerID="7675132b6a0a3435abd421d258a035263883c4eae7ede1a7f47b92d2e04f90b7" exitCode=0 Mar 16 17:37:22 crc kubenswrapper[5120]: I0316 17:37:22.424387 5120 scope.go:117] "RemoveContainer" containerID="df0a87b047c8208d5fc21057efed33321f6cab49c4cf053702d222dc12979450" Mar 16 17:37:22 crc kubenswrapper[5120]: I0316 17:37:22.424484 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" event={"ID":"e2275cb4-4905-4d66-a87e-8010120db2bd","Type":"ContainerStarted","Data":"7fd764dd19065c7ce437c63b05fda51970409dfa8dfd1c77e2158bb3e05b7723"} Mar 16 17:37:23 crc kubenswrapper[5120]: I0316 17:37:23.605200 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["barbican-kuttl-tests/rabbitmq-server-0"] Mar 16 17:37:23 crc kubenswrapper[5120]: I0316 17:37:23.606607 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58e44673-0526-46cc-b8c8-aab0861572ed" containerName="pull" Mar 16 17:37:23 crc kubenswrapper[5120]: I0316 17:37:23.606632 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="58e44673-0526-46cc-b8c8-aab0861572ed" containerName="pull" Mar 16 17:37:23 crc kubenswrapper[5120]: I0316 17:37:23.606682 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58e44673-0526-46cc-b8c8-aab0861572ed" containerName="extract" Mar 16 17:37:23 crc kubenswrapper[5120]: I0316 17:37:23.606692 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="58e44673-0526-46cc-b8c8-aab0861572ed" containerName="extract" Mar 16 17:37:23 crc kubenswrapper[5120]: I0316 17:37:23.606753 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58e44673-0526-46cc-b8c8-aab0861572ed" containerName="util" Mar 16 17:37:23 crc kubenswrapper[5120]: I0316 17:37:23.606779 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="58e44673-0526-46cc-b8c8-aab0861572ed" containerName="util" Mar 16 17:37:23 crc kubenswrapper[5120]: I0316 17:37:23.606946 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="58e44673-0526-46cc-b8c8-aab0861572ed" containerName="extract" Mar 16 17:37:23 crc kubenswrapper[5120]: I0316 17:37:23.612572 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/rabbitmq-server-0" Mar 16 17:37:23 crc kubenswrapper[5120]: I0316 17:37:23.617626 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"barbican-kuttl-tests\"/\"rabbitmq-erlang-cookie\"" Mar 16 17:37:23 crc kubenswrapper[5120]: I0316 17:37:23.617626 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"barbican-kuttl-tests\"/\"rabbitmq-server-dockercfg-gctc8\"" Mar 16 17:37:23 crc kubenswrapper[5120]: I0316 17:37:23.617625 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"barbican-kuttl-tests\"/\"rabbitmq-server-conf\"" Mar 16 17:37:23 crc kubenswrapper[5120]: I0316 17:37:23.618893 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"barbican-kuttl-tests\"/\"rabbitmq-default-user\"" Mar 16 17:37:23 crc kubenswrapper[5120]: I0316 17:37:23.619839 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["barbican-kuttl-tests/rabbitmq-server-0"] Mar 16 17:37:23 crc kubenswrapper[5120]: I0316 17:37:23.619871 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"barbican-kuttl-tests\"/\"rabbitmq-plugins-conf\"" Mar 16 17:37:23 crc kubenswrapper[5120]: I0316 17:37:23.704480 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/459c983d-9938-4660-a965-31585832f250-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"459c983d-9938-4660-a965-31585832f250\") " pod="barbican-kuttl-tests/rabbitmq-server-0" Mar 16 17:37:23 crc kubenswrapper[5120]: I0316 17:37:23.704596 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/459c983d-9938-4660-a965-31585832f250-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"459c983d-9938-4660-a965-31585832f250\") " pod="barbican-kuttl-tests/rabbitmq-server-0" Mar 16 17:37:23 crc kubenswrapper[5120]: I0316 17:37:23.704655 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2smg\" (UniqueName: \"kubernetes.io/projected/459c983d-9938-4660-a965-31585832f250-kube-api-access-p2smg\") pod \"rabbitmq-server-0\" (UID: \"459c983d-9938-4660-a965-31585832f250\") " pod="barbican-kuttl-tests/rabbitmq-server-0" Mar 16 17:37:23 crc kubenswrapper[5120]: I0316 17:37:23.704745 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/459c983d-9938-4660-a965-31585832f250-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"459c983d-9938-4660-a965-31585832f250\") " pod="barbican-kuttl-tests/rabbitmq-server-0" Mar 16 17:37:23 crc kubenswrapper[5120]: I0316 17:37:23.704792 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/459c983d-9938-4660-a965-31585832f250-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"459c983d-9938-4660-a965-31585832f250\") " pod="barbican-kuttl-tests/rabbitmq-server-0" Mar 16 17:37:23 crc kubenswrapper[5120]: I0316 17:37:23.704824 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-add3ef42-eb87-4c34-8765-258ad4d436b4\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-add3ef42-eb87-4c34-8765-258ad4d436b4\") pod \"rabbitmq-server-0\" (UID: \"459c983d-9938-4660-a965-31585832f250\") " pod="barbican-kuttl-tests/rabbitmq-server-0" Mar 16 17:37:23 crc kubenswrapper[5120]: I0316 17:37:23.704900 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/459c983d-9938-4660-a965-31585832f250-pod-info\") pod \"rabbitmq-server-0\" (UID: \"459c983d-9938-4660-a965-31585832f250\") " pod="barbican-kuttl-tests/rabbitmq-server-0" Mar 16 17:37:23 crc kubenswrapper[5120]: I0316 17:37:23.705065 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/459c983d-9938-4660-a965-31585832f250-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"459c983d-9938-4660-a965-31585832f250\") " pod="barbican-kuttl-tests/rabbitmq-server-0" Mar 16 17:37:23 crc kubenswrapper[5120]: I0316 17:37:23.807026 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/459c983d-9938-4660-a965-31585832f250-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"459c983d-9938-4660-a965-31585832f250\") " pod="barbican-kuttl-tests/rabbitmq-server-0" Mar 16 17:37:23 crc kubenswrapper[5120]: I0316 17:37:23.807117 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p2smg\" (UniqueName: \"kubernetes.io/projected/459c983d-9938-4660-a965-31585832f250-kube-api-access-p2smg\") pod \"rabbitmq-server-0\" (UID: \"459c983d-9938-4660-a965-31585832f250\") " pod="barbican-kuttl-tests/rabbitmq-server-0" Mar 16 17:37:23 crc kubenswrapper[5120]: I0316 17:37:23.807202 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/459c983d-9938-4660-a965-31585832f250-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"459c983d-9938-4660-a965-31585832f250\") " pod="barbican-kuttl-tests/rabbitmq-server-0" Mar 16 17:37:23 crc kubenswrapper[5120]: I0316 17:37:23.808198 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/459c983d-9938-4660-a965-31585832f250-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"459c983d-9938-4660-a965-31585832f250\") " pod="barbican-kuttl-tests/rabbitmq-server-0" Mar 16 17:37:23 crc kubenswrapper[5120]: I0316 17:37:23.808627 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/459c983d-9938-4660-a965-31585832f250-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"459c983d-9938-4660-a965-31585832f250\") " pod="barbican-kuttl-tests/rabbitmq-server-0" Mar 16 17:37:23 crc kubenswrapper[5120]: I0316 17:37:23.808674 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pvc-add3ef42-eb87-4c34-8765-258ad4d436b4\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-add3ef42-eb87-4c34-8765-258ad4d436b4\") pod \"rabbitmq-server-0\" (UID: \"459c983d-9938-4660-a965-31585832f250\") " pod="barbican-kuttl-tests/rabbitmq-server-0" Mar 16 17:37:23 crc kubenswrapper[5120]: I0316 17:37:23.808750 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/459c983d-9938-4660-a965-31585832f250-pod-info\") pod \"rabbitmq-server-0\" (UID: \"459c983d-9938-4660-a965-31585832f250\") " pod="barbican-kuttl-tests/rabbitmq-server-0" Mar 16 17:37:23 crc kubenswrapper[5120]: I0316 17:37:23.808930 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/459c983d-9938-4660-a965-31585832f250-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"459c983d-9938-4660-a965-31585832f250\") " pod="barbican-kuttl-tests/rabbitmq-server-0" Mar 16 17:37:23 crc kubenswrapper[5120]: I0316 17:37:23.809150 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/459c983d-9938-4660-a965-31585832f250-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"459c983d-9938-4660-a965-31585832f250\") " pod="barbican-kuttl-tests/rabbitmq-server-0" Mar 16 17:37:23 crc kubenswrapper[5120]: I0316 17:37:23.809604 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/459c983d-9938-4660-a965-31585832f250-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"459c983d-9938-4660-a965-31585832f250\") " pod="barbican-kuttl-tests/rabbitmq-server-0" Mar 16 17:37:23 crc kubenswrapper[5120]: I0316 17:37:23.810279 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/459c983d-9938-4660-a965-31585832f250-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"459c983d-9938-4660-a965-31585832f250\") " pod="barbican-kuttl-tests/rabbitmq-server-0" Mar 16 17:37:23 crc kubenswrapper[5120]: I0316 17:37:23.817373 5120 csi_attacher.go:373] kubernetes.io/csi: attacher.MountDevice STAGE_UNSTAGE_VOLUME capability not set. Skipping MountDevice... Mar 16 17:37:23 crc kubenswrapper[5120]: I0316 17:37:23.817618 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"pvc-add3ef42-eb87-4c34-8765-258ad4d436b4\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-add3ef42-eb87-4c34-8765-258ad4d436b4\") pod \"rabbitmq-server-0\" (UID: \"459c983d-9938-4660-a965-31585832f250\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/kubevirt.io.hostpath-provisioner/eb31e100d294549dff970b6a673ec94f5bfc49c6a0dcc29384d0cc30fa9454cb/globalmount\"" pod="barbican-kuttl-tests/rabbitmq-server-0" Mar 16 17:37:23 crc kubenswrapper[5120]: I0316 17:37:23.820974 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/459c983d-9938-4660-a965-31585832f250-pod-info\") pod \"rabbitmq-server-0\" (UID: \"459c983d-9938-4660-a965-31585832f250\") " pod="barbican-kuttl-tests/rabbitmq-server-0" Mar 16 17:37:23 crc kubenswrapper[5120]: I0316 17:37:23.826270 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/459c983d-9938-4660-a965-31585832f250-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"459c983d-9938-4660-a965-31585832f250\") " pod="barbican-kuttl-tests/rabbitmq-server-0" Mar 16 17:37:23 crc kubenswrapper[5120]: I0316 17:37:23.827334 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2smg\" (UniqueName: \"kubernetes.io/projected/459c983d-9938-4660-a965-31585832f250-kube-api-access-p2smg\") pod \"rabbitmq-server-0\" (UID: \"459c983d-9938-4660-a965-31585832f250\") " pod="barbican-kuttl-tests/rabbitmq-server-0" Mar 16 17:37:23 crc kubenswrapper[5120]: I0316 17:37:23.831489 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/459c983d-9938-4660-a965-31585832f250-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"459c983d-9938-4660-a965-31585832f250\") " pod="barbican-kuttl-tests/rabbitmq-server-0" Mar 16 17:37:23 crc kubenswrapper[5120]: I0316 17:37:23.865289 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-add3ef42-eb87-4c34-8765-258ad4d436b4\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-add3ef42-eb87-4c34-8765-258ad4d436b4\") pod \"rabbitmq-server-0\" (UID: \"459c983d-9938-4660-a965-31585832f250\") " pod="barbican-kuttl-tests/rabbitmq-server-0" Mar 16 17:37:23 crc kubenswrapper[5120]: I0316 17:37:23.932635 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/rabbitmq-server-0" Mar 16 17:37:24 crc kubenswrapper[5120]: I0316 17:37:24.390888 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["barbican-kuttl-tests/rabbitmq-server-0"] Mar 16 17:37:24 crc kubenswrapper[5120]: I0316 17:37:24.471834 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/rabbitmq-server-0" event={"ID":"459c983d-9938-4660-a965-31585832f250","Type":"ContainerStarted","Data":"a351f0e22947cacead58e5f23181e10bb36ef00a7fe6bfa00afab1f91b623e5d"} Mar 16 17:37:25 crc kubenswrapper[5120]: I0316 17:37:25.707961 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-operators/keystone-operator-controller-manager-64d54cb9b4-dksf5"] Mar 16 17:37:25 crc kubenswrapper[5120]: I0316 17:37:25.714218 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/keystone-operator-controller-manager-64d54cb9b4-dksf5" Mar 16 17:37:25 crc kubenswrapper[5120]: I0316 17:37:25.716902 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-operators\"/\"keystone-operator-controller-manager-service-cert\"" Mar 16 17:37:25 crc kubenswrapper[5120]: I0316 17:37:25.717132 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-operators\"/\"keystone-operator-controller-manager-dockercfg-sz4r9\"" Mar 16 17:37:25 crc kubenswrapper[5120]: I0316 17:37:25.729050 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/keystone-operator-controller-manager-64d54cb9b4-dksf5"] Mar 16 17:37:25 crc kubenswrapper[5120]: I0316 17:37:25.853987 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ecba5863-ab91-4517-bc9b-553b7900ffc2-apiservice-cert\") pod \"keystone-operator-controller-manager-64d54cb9b4-dksf5\" (UID: \"ecba5863-ab91-4517-bc9b-553b7900ffc2\") " pod="openstack-operators/keystone-operator-controller-manager-64d54cb9b4-dksf5" Mar 16 17:37:25 crc kubenswrapper[5120]: I0316 17:37:25.854067 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8fmtj\" (UniqueName: \"kubernetes.io/projected/ecba5863-ab91-4517-bc9b-553b7900ffc2-kube-api-access-8fmtj\") pod \"keystone-operator-controller-manager-64d54cb9b4-dksf5\" (UID: \"ecba5863-ab91-4517-bc9b-553b7900ffc2\") " pod="openstack-operators/keystone-operator-controller-manager-64d54cb9b4-dksf5" Mar 16 17:37:25 crc kubenswrapper[5120]: I0316 17:37:25.854202 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ecba5863-ab91-4517-bc9b-553b7900ffc2-webhook-cert\") pod \"keystone-operator-controller-manager-64d54cb9b4-dksf5\" (UID: \"ecba5863-ab91-4517-bc9b-553b7900ffc2\") " pod="openstack-operators/keystone-operator-controller-manager-64d54cb9b4-dksf5" Mar 16 17:37:25 crc kubenswrapper[5120]: I0316 17:37:25.955842 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ecba5863-ab91-4517-bc9b-553b7900ffc2-webhook-cert\") pod \"keystone-operator-controller-manager-64d54cb9b4-dksf5\" (UID: \"ecba5863-ab91-4517-bc9b-553b7900ffc2\") " pod="openstack-operators/keystone-operator-controller-manager-64d54cb9b4-dksf5" Mar 16 17:37:25 crc kubenswrapper[5120]: I0316 17:37:25.957154 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ecba5863-ab91-4517-bc9b-553b7900ffc2-apiservice-cert\") pod \"keystone-operator-controller-manager-64d54cb9b4-dksf5\" (UID: \"ecba5863-ab91-4517-bc9b-553b7900ffc2\") " pod="openstack-operators/keystone-operator-controller-manager-64d54cb9b4-dksf5" Mar 16 17:37:25 crc kubenswrapper[5120]: I0316 17:37:25.957244 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8fmtj\" (UniqueName: \"kubernetes.io/projected/ecba5863-ab91-4517-bc9b-553b7900ffc2-kube-api-access-8fmtj\") pod \"keystone-operator-controller-manager-64d54cb9b4-dksf5\" (UID: \"ecba5863-ab91-4517-bc9b-553b7900ffc2\") " pod="openstack-operators/keystone-operator-controller-manager-64d54cb9b4-dksf5" Mar 16 17:37:25 crc kubenswrapper[5120]: I0316 17:37:25.968723 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ecba5863-ab91-4517-bc9b-553b7900ffc2-webhook-cert\") pod \"keystone-operator-controller-manager-64d54cb9b4-dksf5\" (UID: \"ecba5863-ab91-4517-bc9b-553b7900ffc2\") " pod="openstack-operators/keystone-operator-controller-manager-64d54cb9b4-dksf5" Mar 16 17:37:25 crc kubenswrapper[5120]: I0316 17:37:25.973042 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ecba5863-ab91-4517-bc9b-553b7900ffc2-apiservice-cert\") pod \"keystone-operator-controller-manager-64d54cb9b4-dksf5\" (UID: \"ecba5863-ab91-4517-bc9b-553b7900ffc2\") " pod="openstack-operators/keystone-operator-controller-manager-64d54cb9b4-dksf5" Mar 16 17:37:25 crc kubenswrapper[5120]: I0316 17:37:25.976661 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fmtj\" (UniqueName: \"kubernetes.io/projected/ecba5863-ab91-4517-bc9b-553b7900ffc2-kube-api-access-8fmtj\") pod \"keystone-operator-controller-manager-64d54cb9b4-dksf5\" (UID: \"ecba5863-ab91-4517-bc9b-553b7900ffc2\") " pod="openstack-operators/keystone-operator-controller-manager-64d54cb9b4-dksf5" Mar 16 17:37:26 crc kubenswrapper[5120]: I0316 17:37:26.034515 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/keystone-operator-controller-manager-64d54cb9b4-dksf5" Mar 16 17:37:26 crc kubenswrapper[5120]: I0316 17:37:26.636788 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/keystone-operator-controller-manager-64d54cb9b4-dksf5"] Mar 16 17:37:26 crc kubenswrapper[5120]: W0316 17:37:26.645717 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecba5863_ab91_4517_bc9b_553b7900ffc2.slice/crio-f4938567b35e715f88f519314c2827367462c1b647fc3a1c581d98d77707ef62 WatchSource:0}: Error finding container f4938567b35e715f88f519314c2827367462c1b647fc3a1c581d98d77707ef62: Status 404 returned error can't find the container with id f4938567b35e715f88f519314c2827367462c1b647fc3a1c581d98d77707ef62 Mar 16 17:37:27 crc kubenswrapper[5120]: I0316 17:37:27.540659 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/keystone-operator-controller-manager-64d54cb9b4-dksf5" event={"ID":"ecba5863-ab91-4517-bc9b-553b7900ffc2","Type":"ContainerStarted","Data":"ac8af4331affd0aaf54eea45b82781a8a53a6a8ec4c5e22e608f6a0bcf6230c7"} Mar 16 17:37:27 crc kubenswrapper[5120]: I0316 17:37:27.540703 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/keystone-operator-controller-manager-64d54cb9b4-dksf5" event={"ID":"ecba5863-ab91-4517-bc9b-553b7900ffc2","Type":"ContainerStarted","Data":"f4938567b35e715f88f519314c2827367462c1b647fc3a1c581d98d77707ef62"} Mar 16 17:37:27 crc kubenswrapper[5120]: I0316 17:37:27.541565 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-operators/keystone-operator-controller-manager-64d54cb9b4-dksf5" Mar 16 17:37:28 crc kubenswrapper[5120]: I0316 17:37:28.692707 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/keystone-operator-controller-manager-64d54cb9b4-dksf5" podStartSLOduration=3.69269076 podStartE2EDuration="3.69269076s" podCreationTimestamp="2026-03-16 17:37:25 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:37:27.567419539 +0000 UTC m=+7549.721351206" watchObservedRunningTime="2026-03-16 17:37:28.69269076 +0000 UTC m=+7550.846622417" Mar 16 17:37:31 crc kubenswrapper[5120]: I0316 17:37:31.731751 5120 scope.go:117] "RemoveContainer" containerID="3b883636fd87d746fac383fa53809c8b2cacb7d041e1212f5b84b65bf4b31721" Mar 16 17:37:31 crc kubenswrapper[5120]: I0316 17:37:31.944047 5120 scope.go:117] "RemoveContainer" containerID="55e45f8d9509a50b7235282a22c9feb074290b3b8f6ab5ffdadb02b413f444c1" Mar 16 17:37:32 crc kubenswrapper[5120]: I0316 17:37:32.640545 5120 scope.go:117] "RemoveContainer" containerID="9158470d4fea6a7e16fe50cb0dcaa52841e8e0954801d120f2c14d6f6b0efa7a" Mar 16 17:37:34 crc kubenswrapper[5120]: I0316 17:37:34.615229 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/rabbitmq-server-0" event={"ID":"459c983d-9938-4660-a965-31585832f250","Type":"ContainerStarted","Data":"8d64debaf4240a984c03535b7a49bb9866a5602d38dee2af65ebdaa1e93e5bfe"} Mar 16 17:37:39 crc kubenswrapper[5120]: I0316 17:37:39.561151 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/keystone-operator-controller-manager-64d54cb9b4-dksf5" Mar 16 17:37:46 crc kubenswrapper[5120]: I0316 17:37:46.956778 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-operators/barbican-operator-index-fcpv4"] Mar 16 17:37:46 crc kubenswrapper[5120]: I0316 17:37:46.990513 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/barbican-operator-index-fcpv4"] Mar 16 17:37:46 crc kubenswrapper[5120]: I0316 17:37:46.990650 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/barbican-operator-index-fcpv4" Mar 16 17:37:46 crc kubenswrapper[5120]: I0316 17:37:46.993371 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-operators\"/\"barbican-operator-index-dockercfg-nx2m7\"" Mar 16 17:37:47 crc kubenswrapper[5120]: I0316 17:37:47.126528 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czp4f\" (UniqueName: \"kubernetes.io/projected/b83d772d-de35-42db-a9e2-1abc0cd9d890-kube-api-access-czp4f\") pod \"barbican-operator-index-fcpv4\" (UID: \"b83d772d-de35-42db-a9e2-1abc0cd9d890\") " pod="openstack-operators/barbican-operator-index-fcpv4" Mar 16 17:37:47 crc kubenswrapper[5120]: I0316 17:37:47.229072 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-czp4f\" (UniqueName: \"kubernetes.io/projected/b83d772d-de35-42db-a9e2-1abc0cd9d890-kube-api-access-czp4f\") pod \"barbican-operator-index-fcpv4\" (UID: \"b83d772d-de35-42db-a9e2-1abc0cd9d890\") " pod="openstack-operators/barbican-operator-index-fcpv4" Mar 16 17:37:47 crc kubenswrapper[5120]: I0316 17:37:47.252793 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-czp4f\" (UniqueName: \"kubernetes.io/projected/b83d772d-de35-42db-a9e2-1abc0cd9d890-kube-api-access-czp4f\") pod \"barbican-operator-index-fcpv4\" (UID: \"b83d772d-de35-42db-a9e2-1abc0cd9d890\") " pod="openstack-operators/barbican-operator-index-fcpv4" Mar 16 17:37:47 crc kubenswrapper[5120]: I0316 17:37:47.318836 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/barbican-operator-index-fcpv4" Mar 16 17:37:47 crc kubenswrapper[5120]: I0316 17:37:47.748306 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/barbican-operator-index-fcpv4"] Mar 16 17:37:47 crc kubenswrapper[5120]: W0316 17:37:47.755397 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb83d772d_de35_42db_a9e2_1abc0cd9d890.slice/crio-1abdef487b7ad6a9b5d8f43f8ba822ccd6db169cb07902fec5444d842c8996b1 WatchSource:0}: Error finding container 1abdef487b7ad6a9b5d8f43f8ba822ccd6db169cb07902fec5444d842c8996b1: Status 404 returned error can't find the container with id 1abdef487b7ad6a9b5d8f43f8ba822ccd6db169cb07902fec5444d842c8996b1 Mar 16 17:37:48 crc kubenswrapper[5120]: I0316 17:37:48.727891 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/barbican-operator-index-fcpv4" event={"ID":"b83d772d-de35-42db-a9e2-1abc0cd9d890","Type":"ContainerStarted","Data":"1abdef487b7ad6a9b5d8f43f8ba822ccd6db169cb07902fec5444d842c8996b1"} Mar 16 17:37:50 crc kubenswrapper[5120]: I0316 17:37:50.750864 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/barbican-operator-index-fcpv4" event={"ID":"b83d772d-de35-42db-a9e2-1abc0cd9d890","Type":"ContainerStarted","Data":"6eceaa60b956e1c6bf39e49dc1497dc565d94d81dd115f042d66bc5c1c07f896"} Mar 16 17:37:50 crc kubenswrapper[5120]: I0316 17:37:50.780231 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/barbican-operator-index-fcpv4" podStartSLOduration=2.9421428020000002 podStartE2EDuration="4.780200939s" podCreationTimestamp="2026-03-16 17:37:46 +0000 UTC" firstStartedPulling="2026-03-16 17:37:47.758483266 +0000 UTC m=+7569.912414923" lastFinishedPulling="2026-03-16 17:37:49.596541403 +0000 UTC m=+7571.750473060" observedRunningTime="2026-03-16 17:37:50.771419169 +0000 UTC m=+7572.925350896" watchObservedRunningTime="2026-03-16 17:37:50.780200939 +0000 UTC m=+7572.934132636" Mar 16 17:37:51 crc kubenswrapper[5120]: I0316 17:37:51.947806 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/barbican-operator-index-fcpv4"] Mar 16 17:37:52 crc kubenswrapper[5120]: I0316 17:37:52.557942 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-operators/barbican-operator-index-ck2pw"] Mar 16 17:37:52 crc kubenswrapper[5120]: I0316 17:37:52.633656 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/barbican-operator-index-ck2pw"] Mar 16 17:37:52 crc kubenswrapper[5120]: I0316 17:37:52.633819 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/barbican-operator-index-ck2pw" Mar 16 17:37:52 crc kubenswrapper[5120]: I0316 17:37:52.759612 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7kdc\" (UniqueName: \"kubernetes.io/projected/a5ccdf19-64ed-4e83-b87f-d8623f7cd27e-kube-api-access-l7kdc\") pod \"barbican-operator-index-ck2pw\" (UID: \"a5ccdf19-64ed-4e83-b87f-d8623f7cd27e\") " pod="openstack-operators/barbican-operator-index-ck2pw" Mar 16 17:37:52 crc kubenswrapper[5120]: I0316 17:37:52.765906 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-operators/barbican-operator-index-fcpv4" podUID="b83d772d-de35-42db-a9e2-1abc0cd9d890" containerName="registry-server" containerID="cri-o://6eceaa60b956e1c6bf39e49dc1497dc565d94d81dd115f042d66bc5c1c07f896" gracePeriod=2 Mar 16 17:37:52 crc kubenswrapper[5120]: I0316 17:37:52.861540 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l7kdc\" (UniqueName: \"kubernetes.io/projected/a5ccdf19-64ed-4e83-b87f-d8623f7cd27e-kube-api-access-l7kdc\") pod \"barbican-operator-index-ck2pw\" (UID: \"a5ccdf19-64ed-4e83-b87f-d8623f7cd27e\") " pod="openstack-operators/barbican-operator-index-ck2pw" Mar 16 17:37:52 crc kubenswrapper[5120]: I0316 17:37:52.880408 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7kdc\" (UniqueName: \"kubernetes.io/projected/a5ccdf19-64ed-4e83-b87f-d8623f7cd27e-kube-api-access-l7kdc\") pod \"barbican-operator-index-ck2pw\" (UID: \"a5ccdf19-64ed-4e83-b87f-d8623f7cd27e\") " pod="openstack-operators/barbican-operator-index-ck2pw" Mar 16 17:37:53 crc kubenswrapper[5120]: I0316 17:37:52.953259 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/barbican-operator-index-ck2pw" Mar 16 17:37:53 crc kubenswrapper[5120]: I0316 17:37:53.397327 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/barbican-operator-index-fcpv4" Mar 16 17:37:53 crc kubenswrapper[5120]: I0316 17:37:53.463542 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/barbican-operator-index-ck2pw"] Mar 16 17:37:53 crc kubenswrapper[5120]: W0316 17:37:53.466996 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5ccdf19_64ed_4e83_b87f_d8623f7cd27e.slice/crio-e0fe1aa6466cde958217aa29f887444fb8d39994ce4b547480c498a593b4043f WatchSource:0}: Error finding container e0fe1aa6466cde958217aa29f887444fb8d39994ce4b547480c498a593b4043f: Status 404 returned error can't find the container with id e0fe1aa6466cde958217aa29f887444fb8d39994ce4b547480c498a593b4043f Mar 16 17:37:53 crc kubenswrapper[5120]: I0316 17:37:53.478427 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-czp4f\" (UniqueName: \"kubernetes.io/projected/b83d772d-de35-42db-a9e2-1abc0cd9d890-kube-api-access-czp4f\") pod \"b83d772d-de35-42db-a9e2-1abc0cd9d890\" (UID: \"b83d772d-de35-42db-a9e2-1abc0cd9d890\") " Mar 16 17:37:53 crc kubenswrapper[5120]: I0316 17:37:53.484546 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b83d772d-de35-42db-a9e2-1abc0cd9d890-kube-api-access-czp4f" (OuterVolumeSpecName: "kube-api-access-czp4f") pod "b83d772d-de35-42db-a9e2-1abc0cd9d890" (UID: "b83d772d-de35-42db-a9e2-1abc0cd9d890"). InnerVolumeSpecName "kube-api-access-czp4f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:37:53 crc kubenswrapper[5120]: I0316 17:37:53.581407 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-czp4f\" (UniqueName: \"kubernetes.io/projected/b83d772d-de35-42db-a9e2-1abc0cd9d890-kube-api-access-czp4f\") on node \"crc\" DevicePath \"\"" Mar 16 17:37:53 crc kubenswrapper[5120]: I0316 17:37:53.774702 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/barbican-operator-index-ck2pw" event={"ID":"a5ccdf19-64ed-4e83-b87f-d8623f7cd27e","Type":"ContainerStarted","Data":"e0fe1aa6466cde958217aa29f887444fb8d39994ce4b547480c498a593b4043f"} Mar 16 17:37:53 crc kubenswrapper[5120]: I0316 17:37:53.779236 5120 generic.go:358] "Generic (PLEG): container finished" podID="b83d772d-de35-42db-a9e2-1abc0cd9d890" containerID="6eceaa60b956e1c6bf39e49dc1497dc565d94d81dd115f042d66bc5c1c07f896" exitCode=0 Mar 16 17:37:53 crc kubenswrapper[5120]: I0316 17:37:53.779520 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/barbican-operator-index-fcpv4" event={"ID":"b83d772d-de35-42db-a9e2-1abc0cd9d890","Type":"ContainerDied","Data":"6eceaa60b956e1c6bf39e49dc1497dc565d94d81dd115f042d66bc5c1c07f896"} Mar 16 17:37:53 crc kubenswrapper[5120]: I0316 17:37:53.779541 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/barbican-operator-index-fcpv4" event={"ID":"b83d772d-de35-42db-a9e2-1abc0cd9d890","Type":"ContainerDied","Data":"1abdef487b7ad6a9b5d8f43f8ba822ccd6db169cb07902fec5444d842c8996b1"} Mar 16 17:37:53 crc kubenswrapper[5120]: I0316 17:37:53.779557 5120 scope.go:117] "RemoveContainer" containerID="6eceaa60b956e1c6bf39e49dc1497dc565d94d81dd115f042d66bc5c1c07f896" Mar 16 17:37:53 crc kubenswrapper[5120]: I0316 17:37:53.779783 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/barbican-operator-index-fcpv4" Mar 16 17:37:53 crc kubenswrapper[5120]: I0316 17:37:53.821692 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/barbican-operator-index-fcpv4"] Mar 16 17:37:53 crc kubenswrapper[5120]: I0316 17:37:53.822662 5120 scope.go:117] "RemoveContainer" containerID="6eceaa60b956e1c6bf39e49dc1497dc565d94d81dd115f042d66bc5c1c07f896" Mar 16 17:37:53 crc kubenswrapper[5120]: E0316 17:37:53.823051 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6eceaa60b956e1c6bf39e49dc1497dc565d94d81dd115f042d66bc5c1c07f896\": container with ID starting with 6eceaa60b956e1c6bf39e49dc1497dc565d94d81dd115f042d66bc5c1c07f896 not found: ID does not exist" containerID="6eceaa60b956e1c6bf39e49dc1497dc565d94d81dd115f042d66bc5c1c07f896" Mar 16 17:37:53 crc kubenswrapper[5120]: I0316 17:37:53.823091 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6eceaa60b956e1c6bf39e49dc1497dc565d94d81dd115f042d66bc5c1c07f896"} err="failed to get container status \"6eceaa60b956e1c6bf39e49dc1497dc565d94d81dd115f042d66bc5c1c07f896\": rpc error: code = NotFound desc = could not find container \"6eceaa60b956e1c6bf39e49dc1497dc565d94d81dd115f042d66bc5c1c07f896\": container with ID starting with 6eceaa60b956e1c6bf39e49dc1497dc565d94d81dd115f042d66bc5c1c07f896 not found: ID does not exist" Mar 16 17:37:53 crc kubenswrapper[5120]: I0316 17:37:53.830327 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-operators/barbican-operator-index-fcpv4"] Mar 16 17:37:54 crc kubenswrapper[5120]: I0316 17:37:54.674684 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b83d772d-de35-42db-a9e2-1abc0cd9d890" path="/var/lib/kubelet/pods/b83d772d-de35-42db-a9e2-1abc0cd9d890/volumes" Mar 16 17:37:54 crc kubenswrapper[5120]: I0316 17:37:54.788496 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/barbican-operator-index-ck2pw" event={"ID":"a5ccdf19-64ed-4e83-b87f-d8623f7cd27e","Type":"ContainerStarted","Data":"245a20fdc8132bd71d3234132847da0827395481054b4a9791fbb7ea50baf3f6"} Mar 16 17:37:54 crc kubenswrapper[5120]: I0316 17:37:54.806200 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/barbican-operator-index-ck2pw" podStartSLOduration=2.380764322 podStartE2EDuration="2.80617916s" podCreationTimestamp="2026-03-16 17:37:52 +0000 UTC" firstStartedPulling="2026-03-16 17:37:53.468879397 +0000 UTC m=+7575.622811054" lastFinishedPulling="2026-03-16 17:37:53.894294235 +0000 UTC m=+7576.048225892" observedRunningTime="2026-03-16 17:37:54.802038307 +0000 UTC m=+7576.955969984" watchObservedRunningTime="2026-03-16 17:37:54.80617916 +0000 UTC m=+7576.960110817" Mar 16 17:37:58 crc kubenswrapper[5120]: I0316 17:37:58.423770 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["barbican-kuttl-tests/keystone-db-create-q7sqs"] Mar 16 17:37:58 crc kubenswrapper[5120]: I0316 17:37:58.425130 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b83d772d-de35-42db-a9e2-1abc0cd9d890" containerName="registry-server" Mar 16 17:37:58 crc kubenswrapper[5120]: I0316 17:37:58.425152 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="b83d772d-de35-42db-a9e2-1abc0cd9d890" containerName="registry-server" Mar 16 17:37:58 crc kubenswrapper[5120]: I0316 17:37:58.425355 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="b83d772d-de35-42db-a9e2-1abc0cd9d890" containerName="registry-server" Mar 16 17:37:58 crc kubenswrapper[5120]: I0316 17:37:58.430777 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/keystone-db-create-q7sqs" Mar 16 17:37:58 crc kubenswrapper[5120]: I0316 17:37:58.431276 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["barbican-kuttl-tests/keystone-bc2c-account-create-update-z77gc"] Mar 16 17:37:58 crc kubenswrapper[5120]: I0316 17:37:58.435616 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/keystone-bc2c-account-create-update-z77gc" Mar 16 17:37:58 crc kubenswrapper[5120]: I0316 17:37:58.437282 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"barbican-kuttl-tests\"/\"keystone-db-secret\"" Mar 16 17:37:58 crc kubenswrapper[5120]: I0316 17:37:58.438675 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["barbican-kuttl-tests/keystone-bc2c-account-create-update-z77gc"] Mar 16 17:37:58 crc kubenswrapper[5120]: I0316 17:37:58.445710 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["barbican-kuttl-tests/keystone-db-create-q7sqs"] Mar 16 17:37:58 crc kubenswrapper[5120]: I0316 17:37:58.489960 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/cd2640c0-ff12-49d6-82df-d7bbd8bdf08c-operator-scripts\") pod \"keystone-db-create-q7sqs\" (UID: \"cd2640c0-ff12-49d6-82df-d7bbd8bdf08c\") " pod="barbican-kuttl-tests/keystone-db-create-q7sqs" Mar 16 17:37:58 crc kubenswrapper[5120]: I0316 17:37:58.490031 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zcbm5\" (UniqueName: \"kubernetes.io/projected/b60b9e90-4bd4-4678-b8d2-214b5b3ee528-kube-api-access-zcbm5\") pod \"keystone-bc2c-account-create-update-z77gc\" (UID: \"b60b9e90-4bd4-4678-b8d2-214b5b3ee528\") " pod="barbican-kuttl-tests/keystone-bc2c-account-create-update-z77gc" Mar 16 17:37:58 crc kubenswrapper[5120]: I0316 17:37:58.490274 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gpxg\" (UniqueName: \"kubernetes.io/projected/cd2640c0-ff12-49d6-82df-d7bbd8bdf08c-kube-api-access-5gpxg\") pod \"keystone-db-create-q7sqs\" (UID: \"cd2640c0-ff12-49d6-82df-d7bbd8bdf08c\") " pod="barbican-kuttl-tests/keystone-db-create-q7sqs" Mar 16 17:37:58 crc kubenswrapper[5120]: I0316 17:37:58.490647 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b60b9e90-4bd4-4678-b8d2-214b5b3ee528-operator-scripts\") pod \"keystone-bc2c-account-create-update-z77gc\" (UID: \"b60b9e90-4bd4-4678-b8d2-214b5b3ee528\") " pod="barbican-kuttl-tests/keystone-bc2c-account-create-update-z77gc" Mar 16 17:37:58 crc kubenswrapper[5120]: I0316 17:37:58.592122 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/cd2640c0-ff12-49d6-82df-d7bbd8bdf08c-operator-scripts\") pod \"keystone-db-create-q7sqs\" (UID: \"cd2640c0-ff12-49d6-82df-d7bbd8bdf08c\") " pod="barbican-kuttl-tests/keystone-db-create-q7sqs" Mar 16 17:37:58 crc kubenswrapper[5120]: I0316 17:37:58.592219 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zcbm5\" (UniqueName: \"kubernetes.io/projected/b60b9e90-4bd4-4678-b8d2-214b5b3ee528-kube-api-access-zcbm5\") pod \"keystone-bc2c-account-create-update-z77gc\" (UID: \"b60b9e90-4bd4-4678-b8d2-214b5b3ee528\") " pod="barbican-kuttl-tests/keystone-bc2c-account-create-update-z77gc" Mar 16 17:37:58 crc kubenswrapper[5120]: I0316 17:37:58.592654 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5gpxg\" (UniqueName: \"kubernetes.io/projected/cd2640c0-ff12-49d6-82df-d7bbd8bdf08c-kube-api-access-5gpxg\") pod \"keystone-db-create-q7sqs\" (UID: \"cd2640c0-ff12-49d6-82df-d7bbd8bdf08c\") " pod="barbican-kuttl-tests/keystone-db-create-q7sqs" Mar 16 17:37:58 crc kubenswrapper[5120]: I0316 17:37:58.593491 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b60b9e90-4bd4-4678-b8d2-214b5b3ee528-operator-scripts\") pod \"keystone-bc2c-account-create-update-z77gc\" (UID: \"b60b9e90-4bd4-4678-b8d2-214b5b3ee528\") " pod="barbican-kuttl-tests/keystone-bc2c-account-create-update-z77gc" Mar 16 17:37:58 crc kubenswrapper[5120]: I0316 17:37:58.593666 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/cd2640c0-ff12-49d6-82df-d7bbd8bdf08c-operator-scripts\") pod \"keystone-db-create-q7sqs\" (UID: \"cd2640c0-ff12-49d6-82df-d7bbd8bdf08c\") " pod="barbican-kuttl-tests/keystone-db-create-q7sqs" Mar 16 17:37:58 crc kubenswrapper[5120]: I0316 17:37:58.594283 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b60b9e90-4bd4-4678-b8d2-214b5b3ee528-operator-scripts\") pod \"keystone-bc2c-account-create-update-z77gc\" (UID: \"b60b9e90-4bd4-4678-b8d2-214b5b3ee528\") " pod="barbican-kuttl-tests/keystone-bc2c-account-create-update-z77gc" Mar 16 17:37:58 crc kubenswrapper[5120]: I0316 17:37:58.611575 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zcbm5\" (UniqueName: \"kubernetes.io/projected/b60b9e90-4bd4-4678-b8d2-214b5b3ee528-kube-api-access-zcbm5\") pod \"keystone-bc2c-account-create-update-z77gc\" (UID: \"b60b9e90-4bd4-4678-b8d2-214b5b3ee528\") " pod="barbican-kuttl-tests/keystone-bc2c-account-create-update-z77gc" Mar 16 17:37:58 crc kubenswrapper[5120]: I0316 17:37:58.612004 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gpxg\" (UniqueName: \"kubernetes.io/projected/cd2640c0-ff12-49d6-82df-d7bbd8bdf08c-kube-api-access-5gpxg\") pod \"keystone-db-create-q7sqs\" (UID: \"cd2640c0-ff12-49d6-82df-d7bbd8bdf08c\") " pod="barbican-kuttl-tests/keystone-db-create-q7sqs" Mar 16 17:37:58 crc kubenswrapper[5120]: I0316 17:37:58.755865 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/keystone-db-create-q7sqs" Mar 16 17:37:58 crc kubenswrapper[5120]: I0316 17:37:58.766401 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/keystone-bc2c-account-create-update-z77gc" Mar 16 17:37:59 crc kubenswrapper[5120]: I0316 17:37:59.161689 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["barbican-kuttl-tests/keystone-db-create-q7sqs"] Mar 16 17:37:59 crc kubenswrapper[5120]: I0316 17:37:59.241510 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["barbican-kuttl-tests/keystone-bc2c-account-create-update-z77gc"] Mar 16 17:37:59 crc kubenswrapper[5120]: I0316 17:37:59.832712 5120 generic.go:358] "Generic (PLEG): container finished" podID="cd2640c0-ff12-49d6-82df-d7bbd8bdf08c" containerID="9148ca1baa15e660bae995267713eaf07ccc2c4e1fa6119d54edee935208c202" exitCode=0 Mar 16 17:37:59 crc kubenswrapper[5120]: I0316 17:37:59.832784 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/keystone-db-create-q7sqs" event={"ID":"cd2640c0-ff12-49d6-82df-d7bbd8bdf08c","Type":"ContainerDied","Data":"9148ca1baa15e660bae995267713eaf07ccc2c4e1fa6119d54edee935208c202"} Mar 16 17:37:59 crc kubenswrapper[5120]: I0316 17:37:59.832854 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/keystone-db-create-q7sqs" event={"ID":"cd2640c0-ff12-49d6-82df-d7bbd8bdf08c","Type":"ContainerStarted","Data":"0f6df3ecdd20fd94b61eae727ce9059853435581bbc5232be5b80ffa7b675a3c"} Mar 16 17:37:59 crc kubenswrapper[5120]: I0316 17:37:59.834377 5120 generic.go:358] "Generic (PLEG): container finished" podID="b60b9e90-4bd4-4678-b8d2-214b5b3ee528" containerID="fc497a17ac10e39421c2bc03f7c8ca85fd61b566de9cff4b4d751ddd6e548ea1" exitCode=0 Mar 16 17:37:59 crc kubenswrapper[5120]: I0316 17:37:59.834423 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/keystone-bc2c-account-create-update-z77gc" event={"ID":"b60b9e90-4bd4-4678-b8d2-214b5b3ee528","Type":"ContainerDied","Data":"fc497a17ac10e39421c2bc03f7c8ca85fd61b566de9cff4b4d751ddd6e548ea1"} Mar 16 17:37:59 crc kubenswrapper[5120]: I0316 17:37:59.834450 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/keystone-bc2c-account-create-update-z77gc" event={"ID":"b60b9e90-4bd4-4678-b8d2-214b5b3ee528","Type":"ContainerStarted","Data":"65410b3a194f434801d7bde16740aef4b79e29398d36df6bc25c925e8cd97760"} Mar 16 17:38:00 crc kubenswrapper[5120]: I0316 17:38:00.134147 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-infra/auto-csr-approver-29561378-5ghjn"] Mar 16 17:38:00 crc kubenswrapper[5120]: I0316 17:38:00.142061 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561378-5ghjn" Mar 16 17:38:00 crc kubenswrapper[5120]: I0316 17:38:00.157372 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"kube-root-ca.crt\"" Mar 16 17:38:00 crc kubenswrapper[5120]: I0316 17:38:00.157953 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"openshift-service-ca.crt\"" Mar 16 17:38:00 crc kubenswrapper[5120]: I0316 17:38:00.160087 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561378-5ghjn"] Mar 16 17:38:00 crc kubenswrapper[5120]: I0316 17:38:00.164039 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-infra\"/\"csr-approver-sa-dockercfg-x2nsz\"" Mar 16 17:38:00 crc kubenswrapper[5120]: I0316 17:38:00.230834 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzm8d\" (UniqueName: \"kubernetes.io/projected/496a6dae-c160-45fc-8d5e-6fa4e6bf3e04-kube-api-access-gzm8d\") pod \"auto-csr-approver-29561378-5ghjn\" (UID: \"496a6dae-c160-45fc-8d5e-6fa4e6bf3e04\") " pod="openshift-infra/auto-csr-approver-29561378-5ghjn" Mar 16 17:38:00 crc kubenswrapper[5120]: I0316 17:38:00.333332 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gzm8d\" (UniqueName: \"kubernetes.io/projected/496a6dae-c160-45fc-8d5e-6fa4e6bf3e04-kube-api-access-gzm8d\") pod \"auto-csr-approver-29561378-5ghjn\" (UID: \"496a6dae-c160-45fc-8d5e-6fa4e6bf3e04\") " pod="openshift-infra/auto-csr-approver-29561378-5ghjn" Mar 16 17:38:00 crc kubenswrapper[5120]: I0316 17:38:00.354159 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzm8d\" (UniqueName: \"kubernetes.io/projected/496a6dae-c160-45fc-8d5e-6fa4e6bf3e04-kube-api-access-gzm8d\") pod \"auto-csr-approver-29561378-5ghjn\" (UID: \"496a6dae-c160-45fc-8d5e-6fa4e6bf3e04\") " pod="openshift-infra/auto-csr-approver-29561378-5ghjn" Mar 16 17:38:00 crc kubenswrapper[5120]: I0316 17:38:00.486179 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561378-5ghjn" Mar 16 17:38:00 crc kubenswrapper[5120]: I0316 17:38:00.896254 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561378-5ghjn"] Mar 16 17:38:00 crc kubenswrapper[5120]: W0316 17:38:00.904386 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod496a6dae_c160_45fc_8d5e_6fa4e6bf3e04.slice/crio-d463f42d8d333042569b59727efea2aeaff0d51e27335b8c2786c08a4b42a8c1 WatchSource:0}: Error finding container d463f42d8d333042569b59727efea2aeaff0d51e27335b8c2786c08a4b42a8c1: Status 404 returned error can't find the container with id d463f42d8d333042569b59727efea2aeaff0d51e27335b8c2786c08a4b42a8c1 Mar 16 17:38:01 crc kubenswrapper[5120]: I0316 17:38:01.180330 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/keystone-db-create-q7sqs" Mar 16 17:38:01 crc kubenswrapper[5120]: I0316 17:38:01.261740 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/cd2640c0-ff12-49d6-82df-d7bbd8bdf08c-operator-scripts\") pod \"cd2640c0-ff12-49d6-82df-d7bbd8bdf08c\" (UID: \"cd2640c0-ff12-49d6-82df-d7bbd8bdf08c\") " Mar 16 17:38:01 crc kubenswrapper[5120]: I0316 17:38:01.261886 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5gpxg\" (UniqueName: \"kubernetes.io/projected/cd2640c0-ff12-49d6-82df-d7bbd8bdf08c-kube-api-access-5gpxg\") pod \"cd2640c0-ff12-49d6-82df-d7bbd8bdf08c\" (UID: \"cd2640c0-ff12-49d6-82df-d7bbd8bdf08c\") " Mar 16 17:38:01 crc kubenswrapper[5120]: I0316 17:38:01.264409 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd2640c0-ff12-49d6-82df-d7bbd8bdf08c-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "cd2640c0-ff12-49d6-82df-d7bbd8bdf08c" (UID: "cd2640c0-ff12-49d6-82df-d7bbd8bdf08c"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:38:01 crc kubenswrapper[5120]: I0316 17:38:01.274076 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd2640c0-ff12-49d6-82df-d7bbd8bdf08c-kube-api-access-5gpxg" (OuterVolumeSpecName: "kube-api-access-5gpxg") pod "cd2640c0-ff12-49d6-82df-d7bbd8bdf08c" (UID: "cd2640c0-ff12-49d6-82df-d7bbd8bdf08c"). InnerVolumeSpecName "kube-api-access-5gpxg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:38:01 crc kubenswrapper[5120]: I0316 17:38:01.364379 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/cd2640c0-ff12-49d6-82df-d7bbd8bdf08c-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:38:01 crc kubenswrapper[5120]: I0316 17:38:01.364419 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5gpxg\" (UniqueName: \"kubernetes.io/projected/cd2640c0-ff12-49d6-82df-d7bbd8bdf08c-kube-api-access-5gpxg\") on node \"crc\" DevicePath \"\"" Mar 16 17:38:01 crc kubenswrapper[5120]: I0316 17:38:01.373725 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/keystone-bc2c-account-create-update-z77gc" Mar 16 17:38:01 crc kubenswrapper[5120]: I0316 17:38:01.465914 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zcbm5\" (UniqueName: \"kubernetes.io/projected/b60b9e90-4bd4-4678-b8d2-214b5b3ee528-kube-api-access-zcbm5\") pod \"b60b9e90-4bd4-4678-b8d2-214b5b3ee528\" (UID: \"b60b9e90-4bd4-4678-b8d2-214b5b3ee528\") " Mar 16 17:38:01 crc kubenswrapper[5120]: I0316 17:38:01.466286 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b60b9e90-4bd4-4678-b8d2-214b5b3ee528-operator-scripts\") pod \"b60b9e90-4bd4-4678-b8d2-214b5b3ee528\" (UID: \"b60b9e90-4bd4-4678-b8d2-214b5b3ee528\") " Mar 16 17:38:01 crc kubenswrapper[5120]: I0316 17:38:01.466850 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b60b9e90-4bd4-4678-b8d2-214b5b3ee528-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "b60b9e90-4bd4-4678-b8d2-214b5b3ee528" (UID: "b60b9e90-4bd4-4678-b8d2-214b5b3ee528"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:38:01 crc kubenswrapper[5120]: I0316 17:38:01.467492 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b60b9e90-4bd4-4678-b8d2-214b5b3ee528-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:38:01 crc kubenswrapper[5120]: I0316 17:38:01.469727 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b60b9e90-4bd4-4678-b8d2-214b5b3ee528-kube-api-access-zcbm5" (OuterVolumeSpecName: "kube-api-access-zcbm5") pod "b60b9e90-4bd4-4678-b8d2-214b5b3ee528" (UID: "b60b9e90-4bd4-4678-b8d2-214b5b3ee528"). InnerVolumeSpecName "kube-api-access-zcbm5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:38:01 crc kubenswrapper[5120]: I0316 17:38:01.569553 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zcbm5\" (UniqueName: \"kubernetes.io/projected/b60b9e90-4bd4-4678-b8d2-214b5b3ee528-kube-api-access-zcbm5\") on node \"crc\" DevicePath \"\"" Mar 16 17:38:01 crc kubenswrapper[5120]: I0316 17:38:01.848944 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561378-5ghjn" event={"ID":"496a6dae-c160-45fc-8d5e-6fa4e6bf3e04","Type":"ContainerStarted","Data":"d463f42d8d333042569b59727efea2aeaff0d51e27335b8c2786c08a4b42a8c1"} Mar 16 17:38:01 crc kubenswrapper[5120]: I0316 17:38:01.850990 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/keystone-db-create-q7sqs" Mar 16 17:38:01 crc kubenswrapper[5120]: I0316 17:38:01.851045 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/keystone-db-create-q7sqs" event={"ID":"cd2640c0-ff12-49d6-82df-d7bbd8bdf08c","Type":"ContainerDied","Data":"0f6df3ecdd20fd94b61eae727ce9059853435581bbc5232be5b80ffa7b675a3c"} Mar 16 17:38:01 crc kubenswrapper[5120]: I0316 17:38:01.851098 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0f6df3ecdd20fd94b61eae727ce9059853435581bbc5232be5b80ffa7b675a3c" Mar 16 17:38:01 crc kubenswrapper[5120]: I0316 17:38:01.852312 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/keystone-bc2c-account-create-update-z77gc" event={"ID":"b60b9e90-4bd4-4678-b8d2-214b5b3ee528","Type":"ContainerDied","Data":"65410b3a194f434801d7bde16740aef4b79e29398d36df6bc25c925e8cd97760"} Mar 16 17:38:01 crc kubenswrapper[5120]: I0316 17:38:01.852343 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="65410b3a194f434801d7bde16740aef4b79e29398d36df6bc25c925e8cd97760" Mar 16 17:38:01 crc kubenswrapper[5120]: I0316 17:38:01.852382 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/keystone-bc2c-account-create-update-z77gc" Mar 16 17:38:02 crc kubenswrapper[5120]: I0316 17:38:02.861801 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561378-5ghjn" event={"ID":"496a6dae-c160-45fc-8d5e-6fa4e6bf3e04","Type":"ContainerStarted","Data":"1e88114544c951283e018f47b4cd3488e56d7b8c09c08bdf747ad680dec09503"} Mar 16 17:38:02 crc kubenswrapper[5120]: I0316 17:38:02.879953 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-infra/auto-csr-approver-29561378-5ghjn" podStartSLOduration=1.390870286 podStartE2EDuration="2.879934333s" podCreationTimestamp="2026-03-16 17:38:00 +0000 UTC" firstStartedPulling="2026-03-16 17:38:00.906132208 +0000 UTC m=+7583.060063855" lastFinishedPulling="2026-03-16 17:38:02.395196245 +0000 UTC m=+7584.549127902" observedRunningTime="2026-03-16 17:38:02.876423567 +0000 UTC m=+7585.030355224" watchObservedRunningTime="2026-03-16 17:38:02.879934333 +0000 UTC m=+7585.033865990" Mar 16 17:38:02 crc kubenswrapper[5120]: I0316 17:38:02.953669 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-operators/barbican-operator-index-ck2pw" Mar 16 17:38:02 crc kubenswrapper[5120]: I0316 17:38:02.953746 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-operators/barbican-operator-index-ck2pw" Mar 16 17:38:02 crc kubenswrapper[5120]: I0316 17:38:02.984342 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-operators/barbican-operator-index-ck2pw" Mar 16 17:38:03 crc kubenswrapper[5120]: I0316 17:38:03.869325 5120 generic.go:358] "Generic (PLEG): container finished" podID="496a6dae-c160-45fc-8d5e-6fa4e6bf3e04" containerID="1e88114544c951283e018f47b4cd3488e56d7b8c09c08bdf747ad680dec09503" exitCode=0 Mar 16 17:38:03 crc kubenswrapper[5120]: I0316 17:38:03.869383 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561378-5ghjn" event={"ID":"496a6dae-c160-45fc-8d5e-6fa4e6bf3e04","Type":"ContainerDied","Data":"1e88114544c951283e018f47b4cd3488e56d7b8c09c08bdf747ad680dec09503"} Mar 16 17:38:03 crc kubenswrapper[5120]: I0316 17:38:03.899871 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/barbican-operator-index-ck2pw" Mar 16 17:38:05 crc kubenswrapper[5120]: I0316 17:38:05.310139 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561378-5ghjn" Mar 16 17:38:05 crc kubenswrapper[5120]: I0316 17:38:05.355017 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gzm8d\" (UniqueName: \"kubernetes.io/projected/496a6dae-c160-45fc-8d5e-6fa4e6bf3e04-kube-api-access-gzm8d\") pod \"496a6dae-c160-45fc-8d5e-6fa4e6bf3e04\" (UID: \"496a6dae-c160-45fc-8d5e-6fa4e6bf3e04\") " Mar 16 17:38:05 crc kubenswrapper[5120]: I0316 17:38:05.363293 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/496a6dae-c160-45fc-8d5e-6fa4e6bf3e04-kube-api-access-gzm8d" (OuterVolumeSpecName: "kube-api-access-gzm8d") pod "496a6dae-c160-45fc-8d5e-6fa4e6bf3e04" (UID: "496a6dae-c160-45fc-8d5e-6fa4e6bf3e04"). InnerVolumeSpecName "kube-api-access-gzm8d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:38:05 crc kubenswrapper[5120]: I0316 17:38:05.459297 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gzm8d\" (UniqueName: \"kubernetes.io/projected/496a6dae-c160-45fc-8d5e-6fa4e6bf3e04-kube-api-access-gzm8d\") on node \"crc\" DevicePath \"\"" Mar 16 17:38:05 crc kubenswrapper[5120]: I0316 17:38:05.885878 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561378-5ghjn" event={"ID":"496a6dae-c160-45fc-8d5e-6fa4e6bf3e04","Type":"ContainerDied","Data":"d463f42d8d333042569b59727efea2aeaff0d51e27335b8c2786c08a4b42a8c1"} Mar 16 17:38:05 crc kubenswrapper[5120]: I0316 17:38:05.885935 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d463f42d8d333042569b59727efea2aeaff0d51e27335b8c2786c08a4b42a8c1" Mar 16 17:38:05 crc kubenswrapper[5120]: I0316 17:38:05.885893 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561378-5ghjn" Mar 16 17:38:05 crc kubenswrapper[5120]: I0316 17:38:05.888457 5120 generic.go:358] "Generic (PLEG): container finished" podID="459c983d-9938-4660-a965-31585832f250" containerID="8d64debaf4240a984c03535b7a49bb9866a5602d38dee2af65ebdaa1e93e5bfe" exitCode=0 Mar 16 17:38:05 crc kubenswrapper[5120]: I0316 17:38:05.888518 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/rabbitmq-server-0" event={"ID":"459c983d-9938-4660-a965-31585832f250","Type":"ContainerDied","Data":"8d64debaf4240a984c03535b7a49bb9866a5602d38dee2af65ebdaa1e93e5bfe"} Mar 16 17:38:05 crc kubenswrapper[5120]: I0316 17:38:05.970641 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-infra/auto-csr-approver-29561372-wbnxc"] Mar 16 17:38:05 crc kubenswrapper[5120]: I0316 17:38:05.976593 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-infra/auto-csr-approver-29561372-wbnxc"] Mar 16 17:38:06 crc kubenswrapper[5120]: I0316 17:38:06.683013 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9352fe13-a49c-48be-b8f1-80824864dfb0" path="/var/lib/kubelet/pods/9352fe13-a49c-48be-b8f1-80824864dfb0/volumes" Mar 16 17:38:06 crc kubenswrapper[5120]: I0316 17:38:06.899930 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/rabbitmq-server-0" event={"ID":"459c983d-9938-4660-a965-31585832f250","Type":"ContainerStarted","Data":"1b67907377eee71752ebe9934ed076a8ff8f72f6f441c792b8fe77eb0b9cccaa"} Mar 16 17:38:06 crc kubenswrapper[5120]: I0316 17:38:06.900277 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="barbican-kuttl-tests/rabbitmq-server-0" Mar 16 17:38:06 crc kubenswrapper[5120]: I0316 17:38:06.920809 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="barbican-kuttl-tests/rabbitmq-server-0" podStartSLOduration=36.579802197 podStartE2EDuration="44.920792199s" podCreationTimestamp="2026-03-16 17:37:22 +0000 UTC" firstStartedPulling="2026-03-16 17:37:24.40120591 +0000 UTC m=+7546.555137567" lastFinishedPulling="2026-03-16 17:37:32.742195912 +0000 UTC m=+7554.896127569" observedRunningTime="2026-03-16 17:38:06.916535262 +0000 UTC m=+7589.070466919" watchObservedRunningTime="2026-03-16 17:38:06.920792199 +0000 UTC m=+7589.074723866" Mar 16 17:38:07 crc kubenswrapper[5120]: E0316 17:38:07.385089 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1109798 actualBytes=10240 Mar 16 17:38:12 crc kubenswrapper[5120]: I0316 17:38:12.383733 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-operators/43a0c6ba899107f448cc8c26f41e0ea8a8e90cd460116391929dfaf690nlf9w"] Mar 16 17:38:12 crc kubenswrapper[5120]: I0316 17:38:12.384920 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd2640c0-ff12-49d6-82df-d7bbd8bdf08c" containerName="mariadb-database-create" Mar 16 17:38:12 crc kubenswrapper[5120]: I0316 17:38:12.384933 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd2640c0-ff12-49d6-82df-d7bbd8bdf08c" containerName="mariadb-database-create" Mar 16 17:38:12 crc kubenswrapper[5120]: I0316 17:38:12.384951 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b60b9e90-4bd4-4678-b8d2-214b5b3ee528" containerName="mariadb-account-create-update" Mar 16 17:38:12 crc kubenswrapper[5120]: I0316 17:38:12.384957 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="b60b9e90-4bd4-4678-b8d2-214b5b3ee528" containerName="mariadb-account-create-update" Mar 16 17:38:12 crc kubenswrapper[5120]: I0316 17:38:12.384981 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="496a6dae-c160-45fc-8d5e-6fa4e6bf3e04" containerName="oc" Mar 16 17:38:12 crc kubenswrapper[5120]: I0316 17:38:12.384987 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="496a6dae-c160-45fc-8d5e-6fa4e6bf3e04" containerName="oc" Mar 16 17:38:12 crc kubenswrapper[5120]: I0316 17:38:12.385118 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="b60b9e90-4bd4-4678-b8d2-214b5b3ee528" containerName="mariadb-account-create-update" Mar 16 17:38:12 crc kubenswrapper[5120]: I0316 17:38:12.385133 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="cd2640c0-ff12-49d6-82df-d7bbd8bdf08c" containerName="mariadb-database-create" Mar 16 17:38:12 crc kubenswrapper[5120]: I0316 17:38:12.385145 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="496a6dae-c160-45fc-8d5e-6fa4e6bf3e04" containerName="oc" Mar 16 17:38:12 crc kubenswrapper[5120]: I0316 17:38:12.389248 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/43a0c6ba899107f448cc8c26f41e0ea8a8e90cd460116391929dfaf690nlf9w" Mar 16 17:38:12 crc kubenswrapper[5120]: I0316 17:38:12.392380 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-operators\"/\"default-dockercfg-rmzsx\"" Mar 16 17:38:12 crc kubenswrapper[5120]: I0316 17:38:12.395329 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/43a0c6ba899107f448cc8c26f41e0ea8a8e90cd460116391929dfaf690nlf9w"] Mar 16 17:38:12 crc kubenswrapper[5120]: I0316 17:38:12.473769 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c5662d29-b9ae-46f4-8a19-f0ce811d9661-bundle\") pod \"43a0c6ba899107f448cc8c26f41e0ea8a8e90cd460116391929dfaf690nlf9w\" (UID: \"c5662d29-b9ae-46f4-8a19-f0ce811d9661\") " pod="openstack-operators/43a0c6ba899107f448cc8c26f41e0ea8a8e90cd460116391929dfaf690nlf9w" Mar 16 17:38:12 crc kubenswrapper[5120]: I0316 17:38:12.473917 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c5662d29-b9ae-46f4-8a19-f0ce811d9661-util\") pod \"43a0c6ba899107f448cc8c26f41e0ea8a8e90cd460116391929dfaf690nlf9w\" (UID: \"c5662d29-b9ae-46f4-8a19-f0ce811d9661\") " pod="openstack-operators/43a0c6ba899107f448cc8c26f41e0ea8a8e90cd460116391929dfaf690nlf9w" Mar 16 17:38:12 crc kubenswrapper[5120]: I0316 17:38:12.474158 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gv8r\" (UniqueName: \"kubernetes.io/projected/c5662d29-b9ae-46f4-8a19-f0ce811d9661-kube-api-access-9gv8r\") pod \"43a0c6ba899107f448cc8c26f41e0ea8a8e90cd460116391929dfaf690nlf9w\" (UID: \"c5662d29-b9ae-46f4-8a19-f0ce811d9661\") " pod="openstack-operators/43a0c6ba899107f448cc8c26f41e0ea8a8e90cd460116391929dfaf690nlf9w" Mar 16 17:38:12 crc kubenswrapper[5120]: I0316 17:38:12.576119 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c5662d29-b9ae-46f4-8a19-f0ce811d9661-bundle\") pod \"43a0c6ba899107f448cc8c26f41e0ea8a8e90cd460116391929dfaf690nlf9w\" (UID: \"c5662d29-b9ae-46f4-8a19-f0ce811d9661\") " pod="openstack-operators/43a0c6ba899107f448cc8c26f41e0ea8a8e90cd460116391929dfaf690nlf9w" Mar 16 17:38:12 crc kubenswrapper[5120]: I0316 17:38:12.576291 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c5662d29-b9ae-46f4-8a19-f0ce811d9661-util\") pod \"43a0c6ba899107f448cc8c26f41e0ea8a8e90cd460116391929dfaf690nlf9w\" (UID: \"c5662d29-b9ae-46f4-8a19-f0ce811d9661\") " pod="openstack-operators/43a0c6ba899107f448cc8c26f41e0ea8a8e90cd460116391929dfaf690nlf9w" Mar 16 17:38:12 crc kubenswrapper[5120]: I0316 17:38:12.576544 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9gv8r\" (UniqueName: \"kubernetes.io/projected/c5662d29-b9ae-46f4-8a19-f0ce811d9661-kube-api-access-9gv8r\") pod \"43a0c6ba899107f448cc8c26f41e0ea8a8e90cd460116391929dfaf690nlf9w\" (UID: \"c5662d29-b9ae-46f4-8a19-f0ce811d9661\") " pod="openstack-operators/43a0c6ba899107f448cc8c26f41e0ea8a8e90cd460116391929dfaf690nlf9w" Mar 16 17:38:12 crc kubenswrapper[5120]: I0316 17:38:12.576700 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c5662d29-b9ae-46f4-8a19-f0ce811d9661-bundle\") pod \"43a0c6ba899107f448cc8c26f41e0ea8a8e90cd460116391929dfaf690nlf9w\" (UID: \"c5662d29-b9ae-46f4-8a19-f0ce811d9661\") " pod="openstack-operators/43a0c6ba899107f448cc8c26f41e0ea8a8e90cd460116391929dfaf690nlf9w" Mar 16 17:38:12 crc kubenswrapper[5120]: I0316 17:38:12.576877 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c5662d29-b9ae-46f4-8a19-f0ce811d9661-util\") pod \"43a0c6ba899107f448cc8c26f41e0ea8a8e90cd460116391929dfaf690nlf9w\" (UID: \"c5662d29-b9ae-46f4-8a19-f0ce811d9661\") " pod="openstack-operators/43a0c6ba899107f448cc8c26f41e0ea8a8e90cd460116391929dfaf690nlf9w" Mar 16 17:38:12 crc kubenswrapper[5120]: I0316 17:38:12.600447 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gv8r\" (UniqueName: \"kubernetes.io/projected/c5662d29-b9ae-46f4-8a19-f0ce811d9661-kube-api-access-9gv8r\") pod \"43a0c6ba899107f448cc8c26f41e0ea8a8e90cd460116391929dfaf690nlf9w\" (UID: \"c5662d29-b9ae-46f4-8a19-f0ce811d9661\") " pod="openstack-operators/43a0c6ba899107f448cc8c26f41e0ea8a8e90cd460116391929dfaf690nlf9w" Mar 16 17:38:12 crc kubenswrapper[5120]: I0316 17:38:12.717508 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/43a0c6ba899107f448cc8c26f41e0ea8a8e90cd460116391929dfaf690nlf9w" Mar 16 17:38:13 crc kubenswrapper[5120]: I0316 17:38:13.155223 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/43a0c6ba899107f448cc8c26f41e0ea8a8e90cd460116391929dfaf690nlf9w"] Mar 16 17:38:13 crc kubenswrapper[5120]: I0316 17:38:13.953317 5120 generic.go:358] "Generic (PLEG): container finished" podID="c5662d29-b9ae-46f4-8a19-f0ce811d9661" containerID="57a80fb2a05275b8a881ec7419bb5969095d7ba5e66572e22e40f6857d3a9f1d" exitCode=0 Mar 16 17:38:13 crc kubenswrapper[5120]: I0316 17:38:13.953450 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/43a0c6ba899107f448cc8c26f41e0ea8a8e90cd460116391929dfaf690nlf9w" event={"ID":"c5662d29-b9ae-46f4-8a19-f0ce811d9661","Type":"ContainerDied","Data":"57a80fb2a05275b8a881ec7419bb5969095d7ba5e66572e22e40f6857d3a9f1d"} Mar 16 17:38:13 crc kubenswrapper[5120]: I0316 17:38:13.953856 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/43a0c6ba899107f448cc8c26f41e0ea8a8e90cd460116391929dfaf690nlf9w" event={"ID":"c5662d29-b9ae-46f4-8a19-f0ce811d9661","Type":"ContainerStarted","Data":"97bbbc6a4ce2018b5d33858401a71c319f89993bc759fe506bde462b883656eb"} Mar 16 17:38:15 crc kubenswrapper[5120]: I0316 17:38:15.971505 5120 generic.go:358] "Generic (PLEG): container finished" podID="c5662d29-b9ae-46f4-8a19-f0ce811d9661" containerID="8933f4c1a2a183f2b54d26c651bc7e2667921bf070ffe8d20bcaaf3e01d81aeb" exitCode=0 Mar 16 17:38:15 crc kubenswrapper[5120]: I0316 17:38:15.971547 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/43a0c6ba899107f448cc8c26f41e0ea8a8e90cd460116391929dfaf690nlf9w" event={"ID":"c5662d29-b9ae-46f4-8a19-f0ce811d9661","Type":"ContainerDied","Data":"8933f4c1a2a183f2b54d26c651bc7e2667921bf070ffe8d20bcaaf3e01d81aeb"} Mar 16 17:38:16 crc kubenswrapper[5120]: I0316 17:38:16.982303 5120 generic.go:358] "Generic (PLEG): container finished" podID="c5662d29-b9ae-46f4-8a19-f0ce811d9661" containerID="f7d1760a10fd60339cbedbe3b1bf71ec24232b13dbf1d4c8109dd0508c23d506" exitCode=0 Mar 16 17:38:16 crc kubenswrapper[5120]: I0316 17:38:16.982433 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/43a0c6ba899107f448cc8c26f41e0ea8a8e90cd460116391929dfaf690nlf9w" event={"ID":"c5662d29-b9ae-46f4-8a19-f0ce811d9661","Type":"ContainerDied","Data":"f7d1760a10fd60339cbedbe3b1bf71ec24232b13dbf1d4c8109dd0508c23d506"} Mar 16 17:38:17 crc kubenswrapper[5120]: I0316 17:38:17.909959 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="barbican-kuttl-tests/rabbitmq-server-0" Mar 16 17:38:18 crc kubenswrapper[5120]: I0316 17:38:18.308671 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/43a0c6ba899107f448cc8c26f41e0ea8a8e90cd460116391929dfaf690nlf9w" Mar 16 17:38:18 crc kubenswrapper[5120]: I0316 17:38:18.405905 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9gv8r\" (UniqueName: \"kubernetes.io/projected/c5662d29-b9ae-46f4-8a19-f0ce811d9661-kube-api-access-9gv8r\") pod \"c5662d29-b9ae-46f4-8a19-f0ce811d9661\" (UID: \"c5662d29-b9ae-46f4-8a19-f0ce811d9661\") " Mar 16 17:38:18 crc kubenswrapper[5120]: I0316 17:38:18.406086 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c5662d29-b9ae-46f4-8a19-f0ce811d9661-bundle\") pod \"c5662d29-b9ae-46f4-8a19-f0ce811d9661\" (UID: \"c5662d29-b9ae-46f4-8a19-f0ce811d9661\") " Mar 16 17:38:18 crc kubenswrapper[5120]: I0316 17:38:18.406206 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c5662d29-b9ae-46f4-8a19-f0ce811d9661-util\") pod \"c5662d29-b9ae-46f4-8a19-f0ce811d9661\" (UID: \"c5662d29-b9ae-46f4-8a19-f0ce811d9661\") " Mar 16 17:38:18 crc kubenswrapper[5120]: I0316 17:38:18.408189 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5662d29-b9ae-46f4-8a19-f0ce811d9661-bundle" (OuterVolumeSpecName: "bundle") pod "c5662d29-b9ae-46f4-8a19-f0ce811d9661" (UID: "c5662d29-b9ae-46f4-8a19-f0ce811d9661"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:38:18 crc kubenswrapper[5120]: I0316 17:38:18.415170 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5662d29-b9ae-46f4-8a19-f0ce811d9661-kube-api-access-9gv8r" (OuterVolumeSpecName: "kube-api-access-9gv8r") pod "c5662d29-b9ae-46f4-8a19-f0ce811d9661" (UID: "c5662d29-b9ae-46f4-8a19-f0ce811d9661"). InnerVolumeSpecName "kube-api-access-9gv8r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:38:18 crc kubenswrapper[5120]: I0316 17:38:18.449426 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["barbican-kuttl-tests/keystone-db-sync-7pzns"] Mar 16 17:38:18 crc kubenswrapper[5120]: I0316 17:38:18.450295 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5662d29-b9ae-46f4-8a19-f0ce811d9661" containerName="pull" Mar 16 17:38:18 crc kubenswrapper[5120]: I0316 17:38:18.450314 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5662d29-b9ae-46f4-8a19-f0ce811d9661" containerName="pull" Mar 16 17:38:18 crc kubenswrapper[5120]: I0316 17:38:18.450333 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5662d29-b9ae-46f4-8a19-f0ce811d9661" containerName="extract" Mar 16 17:38:18 crc kubenswrapper[5120]: I0316 17:38:18.450339 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5662d29-b9ae-46f4-8a19-f0ce811d9661" containerName="extract" Mar 16 17:38:18 crc kubenswrapper[5120]: I0316 17:38:18.450360 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5662d29-b9ae-46f4-8a19-f0ce811d9661" containerName="util" Mar 16 17:38:18 crc kubenswrapper[5120]: I0316 17:38:18.450366 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5662d29-b9ae-46f4-8a19-f0ce811d9661" containerName="util" Mar 16 17:38:18 crc kubenswrapper[5120]: I0316 17:38:18.450486 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c5662d29-b9ae-46f4-8a19-f0ce811d9661" containerName="extract" Mar 16 17:38:18 crc kubenswrapper[5120]: I0316 17:38:18.476959 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["barbican-kuttl-tests/keystone-db-sync-7pzns"] Mar 16 17:38:18 crc kubenswrapper[5120]: I0316 17:38:18.477108 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/keystone-db-sync-7pzns" Mar 16 17:38:18 crc kubenswrapper[5120]: I0316 17:38:18.480244 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"barbican-kuttl-tests\"/\"keystone-scripts\"" Mar 16 17:38:18 crc kubenswrapper[5120]: I0316 17:38:18.480312 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"barbican-kuttl-tests\"/\"keystone-keystone-dockercfg-ww28q\"" Mar 16 17:38:18 crc kubenswrapper[5120]: I0316 17:38:18.480386 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"barbican-kuttl-tests\"/\"keystone\"" Mar 16 17:38:18 crc kubenswrapper[5120]: I0316 17:38:18.481075 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"barbican-kuttl-tests\"/\"keystone-config-data\"" Mar 16 17:38:18 crc kubenswrapper[5120]: I0316 17:38:18.509540 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/48098691-6364-4c1b-a898-645bce424cb1-config-data\") pod \"keystone-db-sync-7pzns\" (UID: \"48098691-6364-4c1b-a898-645bce424cb1\") " pod="barbican-kuttl-tests/keystone-db-sync-7pzns" Mar 16 17:38:18 crc kubenswrapper[5120]: I0316 17:38:18.509653 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54rgx\" (UniqueName: \"kubernetes.io/projected/48098691-6364-4c1b-a898-645bce424cb1-kube-api-access-54rgx\") pod \"keystone-db-sync-7pzns\" (UID: \"48098691-6364-4c1b-a898-645bce424cb1\") " pod="barbican-kuttl-tests/keystone-db-sync-7pzns" Mar 16 17:38:18 crc kubenswrapper[5120]: I0316 17:38:18.509875 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9gv8r\" (UniqueName: \"kubernetes.io/projected/c5662d29-b9ae-46f4-8a19-f0ce811d9661-kube-api-access-9gv8r\") on node \"crc\" DevicePath \"\"" Mar 16 17:38:18 crc kubenswrapper[5120]: I0316 17:38:18.509929 5120 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c5662d29-b9ae-46f4-8a19-f0ce811d9661-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:38:18 crc kubenswrapper[5120]: I0316 17:38:18.611656 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/48098691-6364-4c1b-a898-645bce424cb1-config-data\") pod \"keystone-db-sync-7pzns\" (UID: \"48098691-6364-4c1b-a898-645bce424cb1\") " pod="barbican-kuttl-tests/keystone-db-sync-7pzns" Mar 16 17:38:18 crc kubenswrapper[5120]: I0316 17:38:18.612020 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-54rgx\" (UniqueName: \"kubernetes.io/projected/48098691-6364-4c1b-a898-645bce424cb1-kube-api-access-54rgx\") pod \"keystone-db-sync-7pzns\" (UID: \"48098691-6364-4c1b-a898-645bce424cb1\") " pod="barbican-kuttl-tests/keystone-db-sync-7pzns" Mar 16 17:38:18 crc kubenswrapper[5120]: I0316 17:38:18.627710 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/48098691-6364-4c1b-a898-645bce424cb1-config-data\") pod \"keystone-db-sync-7pzns\" (UID: \"48098691-6364-4c1b-a898-645bce424cb1\") " pod="barbican-kuttl-tests/keystone-db-sync-7pzns" Mar 16 17:38:18 crc kubenswrapper[5120]: I0316 17:38:18.627728 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-54rgx\" (UniqueName: \"kubernetes.io/projected/48098691-6364-4c1b-a898-645bce424cb1-kube-api-access-54rgx\") pod \"keystone-db-sync-7pzns\" (UID: \"48098691-6364-4c1b-a898-645bce424cb1\") " pod="barbican-kuttl-tests/keystone-db-sync-7pzns" Mar 16 17:38:18 crc kubenswrapper[5120]: I0316 17:38:18.628539 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5662d29-b9ae-46f4-8a19-f0ce811d9661-util" (OuterVolumeSpecName: "util") pod "c5662d29-b9ae-46f4-8a19-f0ce811d9661" (UID: "c5662d29-b9ae-46f4-8a19-f0ce811d9661"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:38:18 crc kubenswrapper[5120]: I0316 17:38:18.714222 5120 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c5662d29-b9ae-46f4-8a19-f0ce811d9661-util\") on node \"crc\" DevicePath \"\"" Mar 16 17:38:18 crc kubenswrapper[5120]: I0316 17:38:18.793093 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/keystone-db-sync-7pzns" Mar 16 17:38:19 crc kubenswrapper[5120]: I0316 17:38:19.001735 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/43a0c6ba899107f448cc8c26f41e0ea8a8e90cd460116391929dfaf690nlf9w" Mar 16 17:38:19 crc kubenswrapper[5120]: I0316 17:38:19.001781 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/43a0c6ba899107f448cc8c26f41e0ea8a8e90cd460116391929dfaf690nlf9w" event={"ID":"c5662d29-b9ae-46f4-8a19-f0ce811d9661","Type":"ContainerDied","Data":"97bbbc6a4ce2018b5d33858401a71c319f89993bc759fe506bde462b883656eb"} Mar 16 17:38:19 crc kubenswrapper[5120]: I0316 17:38:19.002139 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="97bbbc6a4ce2018b5d33858401a71c319f89993bc759fe506bde462b883656eb" Mar 16 17:38:19 crc kubenswrapper[5120]: I0316 17:38:19.198834 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["barbican-kuttl-tests/keystone-db-sync-7pzns"] Mar 16 17:38:19 crc kubenswrapper[5120]: W0316 17:38:19.202379 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod48098691_6364_4c1b_a898_645bce424cb1.slice/crio-0a2153ebc5eb19a85634793fbab156751df8fb30654b6b503a6510f4162848c0 WatchSource:0}: Error finding container 0a2153ebc5eb19a85634793fbab156751df8fb30654b6b503a6510f4162848c0: Status 404 returned error can't find the container with id 0a2153ebc5eb19a85634793fbab156751df8fb30654b6b503a6510f4162848c0 Mar 16 17:38:20 crc kubenswrapper[5120]: I0316 17:38:20.009261 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/keystone-db-sync-7pzns" event={"ID":"48098691-6364-4c1b-a898-645bce424cb1","Type":"ContainerStarted","Data":"63d2058748252d3d85e082a70ce854971014cc990bacbc54d10686d0eff6c49b"} Mar 16 17:38:20 crc kubenswrapper[5120]: I0316 17:38:20.009639 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/keystone-db-sync-7pzns" event={"ID":"48098691-6364-4c1b-a898-645bce424cb1","Type":"ContainerStarted","Data":"0a2153ebc5eb19a85634793fbab156751df8fb30654b6b503a6510f4162848c0"} Mar 16 17:38:20 crc kubenswrapper[5120]: I0316 17:38:20.024597 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="barbican-kuttl-tests/keystone-db-sync-7pzns" podStartSLOduration=1.612033557 podStartE2EDuration="2.024578503s" podCreationTimestamp="2026-03-16 17:38:18 +0000 UTC" firstStartedPulling="2026-03-16 17:38:19.205393541 +0000 UTC m=+7601.359325198" lastFinishedPulling="2026-03-16 17:38:19.617938487 +0000 UTC m=+7601.771870144" observedRunningTime="2026-03-16 17:38:20.021391286 +0000 UTC m=+7602.175322943" watchObservedRunningTime="2026-03-16 17:38:20.024578503 +0000 UTC m=+7602.178510160" Mar 16 17:38:23 crc kubenswrapper[5120]: I0316 17:38:23.033246 5120 generic.go:358] "Generic (PLEG): container finished" podID="48098691-6364-4c1b-a898-645bce424cb1" containerID="63d2058748252d3d85e082a70ce854971014cc990bacbc54d10686d0eff6c49b" exitCode=0 Mar 16 17:38:23 crc kubenswrapper[5120]: I0316 17:38:23.033354 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/keystone-db-sync-7pzns" event={"ID":"48098691-6364-4c1b-a898-645bce424cb1","Type":"ContainerDied","Data":"63d2058748252d3d85e082a70ce854971014cc990bacbc54d10686d0eff6c49b"} Mar 16 17:38:24 crc kubenswrapper[5120]: I0316 17:38:24.386888 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/keystone-db-sync-7pzns" Mar 16 17:38:24 crc kubenswrapper[5120]: I0316 17:38:24.460533 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/48098691-6364-4c1b-a898-645bce424cb1-config-data\") pod \"48098691-6364-4c1b-a898-645bce424cb1\" (UID: \"48098691-6364-4c1b-a898-645bce424cb1\") " Mar 16 17:38:24 crc kubenswrapper[5120]: I0316 17:38:24.460668 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-54rgx\" (UniqueName: \"kubernetes.io/projected/48098691-6364-4c1b-a898-645bce424cb1-kube-api-access-54rgx\") pod \"48098691-6364-4c1b-a898-645bce424cb1\" (UID: \"48098691-6364-4c1b-a898-645bce424cb1\") " Mar 16 17:38:24 crc kubenswrapper[5120]: I0316 17:38:24.474444 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48098691-6364-4c1b-a898-645bce424cb1-kube-api-access-54rgx" (OuterVolumeSpecName: "kube-api-access-54rgx") pod "48098691-6364-4c1b-a898-645bce424cb1" (UID: "48098691-6364-4c1b-a898-645bce424cb1"). InnerVolumeSpecName "kube-api-access-54rgx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:38:24 crc kubenswrapper[5120]: I0316 17:38:24.501793 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48098691-6364-4c1b-a898-645bce424cb1-config-data" (OuterVolumeSpecName: "config-data") pod "48098691-6364-4c1b-a898-645bce424cb1" (UID: "48098691-6364-4c1b-a898-645bce424cb1"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:38:24 crc kubenswrapper[5120]: I0316 17:38:24.564346 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/48098691-6364-4c1b-a898-645bce424cb1-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:38:24 crc kubenswrapper[5120]: I0316 17:38:24.564829 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-54rgx\" (UniqueName: \"kubernetes.io/projected/48098691-6364-4c1b-a898-645bce424cb1-kube-api-access-54rgx\") on node \"crc\" DevicePath \"\"" Mar 16 17:38:25 crc kubenswrapper[5120]: I0316 17:38:25.049344 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/keystone-db-sync-7pzns" Mar 16 17:38:25 crc kubenswrapper[5120]: I0316 17:38:25.049372 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/keystone-db-sync-7pzns" event={"ID":"48098691-6364-4c1b-a898-645bce424cb1","Type":"ContainerDied","Data":"0a2153ebc5eb19a85634793fbab156751df8fb30654b6b503a6510f4162848c0"} Mar 16 17:38:25 crc kubenswrapper[5120]: I0316 17:38:25.049803 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0a2153ebc5eb19a85634793fbab156751df8fb30654b6b503a6510f4162848c0" Mar 16 17:38:25 crc kubenswrapper[5120]: I0316 17:38:25.338536 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["barbican-kuttl-tests/keystone-bootstrap-d2c9n"] Mar 16 17:38:25 crc kubenswrapper[5120]: I0316 17:38:25.339334 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48098691-6364-4c1b-a898-645bce424cb1" containerName="keystone-db-sync" Mar 16 17:38:25 crc kubenswrapper[5120]: I0316 17:38:25.339352 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="48098691-6364-4c1b-a898-645bce424cb1" containerName="keystone-db-sync" Mar 16 17:38:25 crc kubenswrapper[5120]: I0316 17:38:25.339468 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="48098691-6364-4c1b-a898-645bce424cb1" containerName="keystone-db-sync" Mar 16 17:38:25 crc kubenswrapper[5120]: I0316 17:38:25.355705 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["barbican-kuttl-tests/keystone-bootstrap-d2c9n"] Mar 16 17:38:25 crc kubenswrapper[5120]: I0316 17:38:25.355897 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/keystone-bootstrap-d2c9n" Mar 16 17:38:25 crc kubenswrapper[5120]: I0316 17:38:25.369279 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"barbican-kuttl-tests\"/\"keystone-keystone-dockercfg-ww28q\"" Mar 16 17:38:25 crc kubenswrapper[5120]: I0316 17:38:25.369436 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"barbican-kuttl-tests\"/\"osp-secret\"" Mar 16 17:38:25 crc kubenswrapper[5120]: I0316 17:38:25.369498 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"barbican-kuttl-tests\"/\"keystone-config-data\"" Mar 16 17:38:25 crc kubenswrapper[5120]: I0316 17:38:25.369538 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"barbican-kuttl-tests\"/\"keystone\"" Mar 16 17:38:25 crc kubenswrapper[5120]: I0316 17:38:25.369663 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"barbican-kuttl-tests\"/\"keystone-scripts\"" Mar 16 17:38:25 crc kubenswrapper[5120]: I0316 17:38:25.410616 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/fea2a8bc-e02b-417c-b271-459320e26809-scripts\") pod \"keystone-bootstrap-d2c9n\" (UID: \"fea2a8bc-e02b-417c-b271-459320e26809\") " pod="barbican-kuttl-tests/keystone-bootstrap-d2c9n" Mar 16 17:38:25 crc kubenswrapper[5120]: I0316 17:38:25.410804 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwkbc\" (UniqueName: \"kubernetes.io/projected/fea2a8bc-e02b-417c-b271-459320e26809-kube-api-access-fwkbc\") pod \"keystone-bootstrap-d2c9n\" (UID: \"fea2a8bc-e02b-417c-b271-459320e26809\") " pod="barbican-kuttl-tests/keystone-bootstrap-d2c9n" Mar 16 17:38:25 crc kubenswrapper[5120]: I0316 17:38:25.422188 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/fea2a8bc-e02b-417c-b271-459320e26809-fernet-keys\") pod \"keystone-bootstrap-d2c9n\" (UID: \"fea2a8bc-e02b-417c-b271-459320e26809\") " pod="barbican-kuttl-tests/keystone-bootstrap-d2c9n" Mar 16 17:38:25 crc kubenswrapper[5120]: I0316 17:38:25.422299 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fea2a8bc-e02b-417c-b271-459320e26809-config-data\") pod \"keystone-bootstrap-d2c9n\" (UID: \"fea2a8bc-e02b-417c-b271-459320e26809\") " pod="barbican-kuttl-tests/keystone-bootstrap-d2c9n" Mar 16 17:38:25 crc kubenswrapper[5120]: I0316 17:38:25.422575 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/fea2a8bc-e02b-417c-b271-459320e26809-credential-keys\") pod \"keystone-bootstrap-d2c9n\" (UID: \"fea2a8bc-e02b-417c-b271-459320e26809\") " pod="barbican-kuttl-tests/keystone-bootstrap-d2c9n" Mar 16 17:38:25 crc kubenswrapper[5120]: I0316 17:38:25.524104 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fwkbc\" (UniqueName: \"kubernetes.io/projected/fea2a8bc-e02b-417c-b271-459320e26809-kube-api-access-fwkbc\") pod \"keystone-bootstrap-d2c9n\" (UID: \"fea2a8bc-e02b-417c-b271-459320e26809\") " pod="barbican-kuttl-tests/keystone-bootstrap-d2c9n" Mar 16 17:38:25 crc kubenswrapper[5120]: I0316 17:38:25.524227 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/fea2a8bc-e02b-417c-b271-459320e26809-fernet-keys\") pod \"keystone-bootstrap-d2c9n\" (UID: \"fea2a8bc-e02b-417c-b271-459320e26809\") " pod="barbican-kuttl-tests/keystone-bootstrap-d2c9n" Mar 16 17:38:25 crc kubenswrapper[5120]: I0316 17:38:25.524265 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fea2a8bc-e02b-417c-b271-459320e26809-config-data\") pod \"keystone-bootstrap-d2c9n\" (UID: \"fea2a8bc-e02b-417c-b271-459320e26809\") " pod="barbican-kuttl-tests/keystone-bootstrap-d2c9n" Mar 16 17:38:25 crc kubenswrapper[5120]: I0316 17:38:25.524308 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/fea2a8bc-e02b-417c-b271-459320e26809-credential-keys\") pod \"keystone-bootstrap-d2c9n\" (UID: \"fea2a8bc-e02b-417c-b271-459320e26809\") " pod="barbican-kuttl-tests/keystone-bootstrap-d2c9n" Mar 16 17:38:25 crc kubenswrapper[5120]: I0316 17:38:25.524460 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/fea2a8bc-e02b-417c-b271-459320e26809-scripts\") pod \"keystone-bootstrap-d2c9n\" (UID: \"fea2a8bc-e02b-417c-b271-459320e26809\") " pod="barbican-kuttl-tests/keystone-bootstrap-d2c9n" Mar 16 17:38:25 crc kubenswrapper[5120]: I0316 17:38:25.530122 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/fea2a8bc-e02b-417c-b271-459320e26809-fernet-keys\") pod \"keystone-bootstrap-d2c9n\" (UID: \"fea2a8bc-e02b-417c-b271-459320e26809\") " pod="barbican-kuttl-tests/keystone-bootstrap-d2c9n" Mar 16 17:38:25 crc kubenswrapper[5120]: I0316 17:38:25.530461 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/fea2a8bc-e02b-417c-b271-459320e26809-scripts\") pod \"keystone-bootstrap-d2c9n\" (UID: \"fea2a8bc-e02b-417c-b271-459320e26809\") " pod="barbican-kuttl-tests/keystone-bootstrap-d2c9n" Mar 16 17:38:25 crc kubenswrapper[5120]: I0316 17:38:25.530827 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/fea2a8bc-e02b-417c-b271-459320e26809-credential-keys\") pod \"keystone-bootstrap-d2c9n\" (UID: \"fea2a8bc-e02b-417c-b271-459320e26809\") " pod="barbican-kuttl-tests/keystone-bootstrap-d2c9n" Mar 16 17:38:25 crc kubenswrapper[5120]: I0316 17:38:25.536504 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fea2a8bc-e02b-417c-b271-459320e26809-config-data\") pod \"keystone-bootstrap-d2c9n\" (UID: \"fea2a8bc-e02b-417c-b271-459320e26809\") " pod="barbican-kuttl-tests/keystone-bootstrap-d2c9n" Mar 16 17:38:25 crc kubenswrapper[5120]: I0316 17:38:25.560368 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwkbc\" (UniqueName: \"kubernetes.io/projected/fea2a8bc-e02b-417c-b271-459320e26809-kube-api-access-fwkbc\") pod \"keystone-bootstrap-d2c9n\" (UID: \"fea2a8bc-e02b-417c-b271-459320e26809\") " pod="barbican-kuttl-tests/keystone-bootstrap-d2c9n" Mar 16 17:38:25 crc kubenswrapper[5120]: I0316 17:38:25.680945 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/keystone-bootstrap-d2c9n" Mar 16 17:38:26 crc kubenswrapper[5120]: I0316 17:38:26.129687 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["barbican-kuttl-tests/keystone-bootstrap-d2c9n"] Mar 16 17:38:27 crc kubenswrapper[5120]: I0316 17:38:27.066776 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/keystone-bootstrap-d2c9n" event={"ID":"fea2a8bc-e02b-417c-b271-459320e26809","Type":"ContainerStarted","Data":"6b559a8164b92dd062250a013dfaf60deb04ddf8ef92bd45375231da79a4c85d"} Mar 16 17:38:27 crc kubenswrapper[5120]: I0316 17:38:27.067117 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/keystone-bootstrap-d2c9n" event={"ID":"fea2a8bc-e02b-417c-b271-459320e26809","Type":"ContainerStarted","Data":"f93b9a3cc2e906980f94700c09cc936d7e7cc1ba5ef5d2e2103deefa5d45d1e4"} Mar 16 17:38:27 crc kubenswrapper[5120]: I0316 17:38:27.089373 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="barbican-kuttl-tests/keystone-bootstrap-d2c9n" podStartSLOduration=2.089352071 podStartE2EDuration="2.089352071s" podCreationTimestamp="2026-03-16 17:38:25 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:38:27.086902914 +0000 UTC m=+7609.240834591" watchObservedRunningTime="2026-03-16 17:38:27.089352071 +0000 UTC m=+7609.243283728" Mar 16 17:38:27 crc kubenswrapper[5120]: I0316 17:38:27.101099 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-operators/barbican-operator-controller-manager-58bf5697d6-vhnpj"] Mar 16 17:38:27 crc kubenswrapper[5120]: I0316 17:38:27.114326 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/barbican-operator-controller-manager-58bf5697d6-vhnpj"] Mar 16 17:38:27 crc kubenswrapper[5120]: I0316 17:38:27.114542 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/barbican-operator-controller-manager-58bf5697d6-vhnpj" Mar 16 17:38:27 crc kubenswrapper[5120]: I0316 17:38:27.116710 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-operators\"/\"barbican-operator-controller-manager-service-cert\"" Mar 16 17:38:27 crc kubenswrapper[5120]: I0316 17:38:27.116944 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-operators\"/\"barbican-operator-controller-manager-dockercfg-r2tf2\"" Mar 16 17:38:27 crc kubenswrapper[5120]: I0316 17:38:27.265094 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5068ab90-b1e6-427e-9a8b-e77bbc0ffe1f-apiservice-cert\") pod \"barbican-operator-controller-manager-58bf5697d6-vhnpj\" (UID: \"5068ab90-b1e6-427e-9a8b-e77bbc0ffe1f\") " pod="openstack-operators/barbican-operator-controller-manager-58bf5697d6-vhnpj" Mar 16 17:38:27 crc kubenswrapper[5120]: I0316 17:38:27.265143 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dr69f\" (UniqueName: \"kubernetes.io/projected/5068ab90-b1e6-427e-9a8b-e77bbc0ffe1f-kube-api-access-dr69f\") pod \"barbican-operator-controller-manager-58bf5697d6-vhnpj\" (UID: \"5068ab90-b1e6-427e-9a8b-e77bbc0ffe1f\") " pod="openstack-operators/barbican-operator-controller-manager-58bf5697d6-vhnpj" Mar 16 17:38:27 crc kubenswrapper[5120]: I0316 17:38:27.265327 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5068ab90-b1e6-427e-9a8b-e77bbc0ffe1f-webhook-cert\") pod \"barbican-operator-controller-manager-58bf5697d6-vhnpj\" (UID: \"5068ab90-b1e6-427e-9a8b-e77bbc0ffe1f\") " pod="openstack-operators/barbican-operator-controller-manager-58bf5697d6-vhnpj" Mar 16 17:38:27 crc kubenswrapper[5120]: I0316 17:38:27.366676 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5068ab90-b1e6-427e-9a8b-e77bbc0ffe1f-apiservice-cert\") pod \"barbican-operator-controller-manager-58bf5697d6-vhnpj\" (UID: \"5068ab90-b1e6-427e-9a8b-e77bbc0ffe1f\") " pod="openstack-operators/barbican-operator-controller-manager-58bf5697d6-vhnpj" Mar 16 17:38:27 crc kubenswrapper[5120]: I0316 17:38:27.367075 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dr69f\" (UniqueName: \"kubernetes.io/projected/5068ab90-b1e6-427e-9a8b-e77bbc0ffe1f-kube-api-access-dr69f\") pod \"barbican-operator-controller-manager-58bf5697d6-vhnpj\" (UID: \"5068ab90-b1e6-427e-9a8b-e77bbc0ffe1f\") " pod="openstack-operators/barbican-operator-controller-manager-58bf5697d6-vhnpj" Mar 16 17:38:27 crc kubenswrapper[5120]: I0316 17:38:27.367239 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5068ab90-b1e6-427e-9a8b-e77bbc0ffe1f-webhook-cert\") pod \"barbican-operator-controller-manager-58bf5697d6-vhnpj\" (UID: \"5068ab90-b1e6-427e-9a8b-e77bbc0ffe1f\") " pod="openstack-operators/barbican-operator-controller-manager-58bf5697d6-vhnpj" Mar 16 17:38:27 crc kubenswrapper[5120]: I0316 17:38:27.372412 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5068ab90-b1e6-427e-9a8b-e77bbc0ffe1f-apiservice-cert\") pod \"barbican-operator-controller-manager-58bf5697d6-vhnpj\" (UID: \"5068ab90-b1e6-427e-9a8b-e77bbc0ffe1f\") " pod="openstack-operators/barbican-operator-controller-manager-58bf5697d6-vhnpj" Mar 16 17:38:27 crc kubenswrapper[5120]: I0316 17:38:27.385294 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5068ab90-b1e6-427e-9a8b-e77bbc0ffe1f-webhook-cert\") pod \"barbican-operator-controller-manager-58bf5697d6-vhnpj\" (UID: \"5068ab90-b1e6-427e-9a8b-e77bbc0ffe1f\") " pod="openstack-operators/barbican-operator-controller-manager-58bf5697d6-vhnpj" Mar 16 17:38:27 crc kubenswrapper[5120]: I0316 17:38:27.388201 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dr69f\" (UniqueName: \"kubernetes.io/projected/5068ab90-b1e6-427e-9a8b-e77bbc0ffe1f-kube-api-access-dr69f\") pod \"barbican-operator-controller-manager-58bf5697d6-vhnpj\" (UID: \"5068ab90-b1e6-427e-9a8b-e77bbc0ffe1f\") " pod="openstack-operators/barbican-operator-controller-manager-58bf5697d6-vhnpj" Mar 16 17:38:27 crc kubenswrapper[5120]: I0316 17:38:27.433801 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/barbican-operator-controller-manager-58bf5697d6-vhnpj" Mar 16 17:38:27 crc kubenswrapper[5120]: I0316 17:38:27.984405 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/barbican-operator-controller-manager-58bf5697d6-vhnpj"] Mar 16 17:38:28 crc kubenswrapper[5120]: I0316 17:38:28.077144 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/barbican-operator-controller-manager-58bf5697d6-vhnpj" event={"ID":"5068ab90-b1e6-427e-9a8b-e77bbc0ffe1f","Type":"ContainerStarted","Data":"1dd63000f7d785931afd44d56cbcb6ef1b3e5af0955dab838a7b093a9897bb51"} Mar 16 17:38:29 crc kubenswrapper[5120]: I0316 17:38:29.087678 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/barbican-operator-controller-manager-58bf5697d6-vhnpj" event={"ID":"5068ab90-b1e6-427e-9a8b-e77bbc0ffe1f","Type":"ContainerStarted","Data":"933d0eab8fda7bf80fa1bb171e7d2aed8c7939ac0f47a72f7df801eb4b529108"} Mar 16 17:38:29 crc kubenswrapper[5120]: I0316 17:38:29.088063 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-operators/barbican-operator-controller-manager-58bf5697d6-vhnpj" Mar 16 17:38:29 crc kubenswrapper[5120]: I0316 17:38:29.115571 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/barbican-operator-controller-manager-58bf5697d6-vhnpj" podStartSLOduration=2.115550517 podStartE2EDuration="2.115550517s" podCreationTimestamp="2026-03-16 17:38:27 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:38:29.1120331 +0000 UTC m=+7611.265964757" watchObservedRunningTime="2026-03-16 17:38:29.115550517 +0000 UTC m=+7611.269482164" Mar 16 17:38:30 crc kubenswrapper[5120]: I0316 17:38:30.100699 5120 generic.go:358] "Generic (PLEG): container finished" podID="fea2a8bc-e02b-417c-b271-459320e26809" containerID="6b559a8164b92dd062250a013dfaf60deb04ddf8ef92bd45375231da79a4c85d" exitCode=0 Mar 16 17:38:30 crc kubenswrapper[5120]: I0316 17:38:30.100804 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/keystone-bootstrap-d2c9n" event={"ID":"fea2a8bc-e02b-417c-b271-459320e26809","Type":"ContainerDied","Data":"6b559a8164b92dd062250a013dfaf60deb04ddf8ef92bd45375231da79a4c85d"} Mar 16 17:38:31 crc kubenswrapper[5120]: I0316 17:38:31.454039 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/keystone-bootstrap-d2c9n" Mar 16 17:38:31 crc kubenswrapper[5120]: I0316 17:38:31.555320 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/fea2a8bc-e02b-417c-b271-459320e26809-scripts\") pod \"fea2a8bc-e02b-417c-b271-459320e26809\" (UID: \"fea2a8bc-e02b-417c-b271-459320e26809\") " Mar 16 17:38:31 crc kubenswrapper[5120]: I0316 17:38:31.556399 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/fea2a8bc-e02b-417c-b271-459320e26809-fernet-keys\") pod \"fea2a8bc-e02b-417c-b271-459320e26809\" (UID: \"fea2a8bc-e02b-417c-b271-459320e26809\") " Mar 16 17:38:31 crc kubenswrapper[5120]: I0316 17:38:31.556683 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/fea2a8bc-e02b-417c-b271-459320e26809-credential-keys\") pod \"fea2a8bc-e02b-417c-b271-459320e26809\" (UID: \"fea2a8bc-e02b-417c-b271-459320e26809\") " Mar 16 17:38:31 crc kubenswrapper[5120]: I0316 17:38:31.556987 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fea2a8bc-e02b-417c-b271-459320e26809-config-data\") pod \"fea2a8bc-e02b-417c-b271-459320e26809\" (UID: \"fea2a8bc-e02b-417c-b271-459320e26809\") " Mar 16 17:38:31 crc kubenswrapper[5120]: I0316 17:38:31.557346 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fwkbc\" (UniqueName: \"kubernetes.io/projected/fea2a8bc-e02b-417c-b271-459320e26809-kube-api-access-fwkbc\") pod \"fea2a8bc-e02b-417c-b271-459320e26809\" (UID: \"fea2a8bc-e02b-417c-b271-459320e26809\") " Mar 16 17:38:31 crc kubenswrapper[5120]: I0316 17:38:31.562708 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fea2a8bc-e02b-417c-b271-459320e26809-kube-api-access-fwkbc" (OuterVolumeSpecName: "kube-api-access-fwkbc") pod "fea2a8bc-e02b-417c-b271-459320e26809" (UID: "fea2a8bc-e02b-417c-b271-459320e26809"). InnerVolumeSpecName "kube-api-access-fwkbc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:38:31 crc kubenswrapper[5120]: I0316 17:38:31.563296 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fea2a8bc-e02b-417c-b271-459320e26809-scripts" (OuterVolumeSpecName: "scripts") pod "fea2a8bc-e02b-417c-b271-459320e26809" (UID: "fea2a8bc-e02b-417c-b271-459320e26809"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:38:31 crc kubenswrapper[5120]: I0316 17:38:31.563449 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fea2a8bc-e02b-417c-b271-459320e26809-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "fea2a8bc-e02b-417c-b271-459320e26809" (UID: "fea2a8bc-e02b-417c-b271-459320e26809"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:38:31 crc kubenswrapper[5120]: I0316 17:38:31.569122 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fea2a8bc-e02b-417c-b271-459320e26809-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "fea2a8bc-e02b-417c-b271-459320e26809" (UID: "fea2a8bc-e02b-417c-b271-459320e26809"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:38:31 crc kubenswrapper[5120]: I0316 17:38:31.577576 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fea2a8bc-e02b-417c-b271-459320e26809-config-data" (OuterVolumeSpecName: "config-data") pod "fea2a8bc-e02b-417c-b271-459320e26809" (UID: "fea2a8bc-e02b-417c-b271-459320e26809"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:38:31 crc kubenswrapper[5120]: I0316 17:38:31.660998 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fea2a8bc-e02b-417c-b271-459320e26809-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:38:31 crc kubenswrapper[5120]: I0316 17:38:31.661038 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fwkbc\" (UniqueName: \"kubernetes.io/projected/fea2a8bc-e02b-417c-b271-459320e26809-kube-api-access-fwkbc\") on node \"crc\" DevicePath \"\"" Mar 16 17:38:31 crc kubenswrapper[5120]: I0316 17:38:31.661054 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/fea2a8bc-e02b-417c-b271-459320e26809-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:38:31 crc kubenswrapper[5120]: I0316 17:38:31.661065 5120 reconciler_common.go:299] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/fea2a8bc-e02b-417c-b271-459320e26809-fernet-keys\") on node \"crc\" DevicePath \"\"" Mar 16 17:38:31 crc kubenswrapper[5120]: I0316 17:38:31.661077 5120 reconciler_common.go:299] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/fea2a8bc-e02b-417c-b271-459320e26809-credential-keys\") on node \"crc\" DevicePath \"\"" Mar 16 17:38:32 crc kubenswrapper[5120]: I0316 17:38:32.117632 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/keystone-bootstrap-d2c9n" Mar 16 17:38:32 crc kubenswrapper[5120]: I0316 17:38:32.117634 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/keystone-bootstrap-d2c9n" event={"ID":"fea2a8bc-e02b-417c-b271-459320e26809","Type":"ContainerDied","Data":"f93b9a3cc2e906980f94700c09cc936d7e7cc1ba5ef5d2e2103deefa5d45d1e4"} Mar 16 17:38:32 crc kubenswrapper[5120]: I0316 17:38:32.117790 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f93b9a3cc2e906980f94700c09cc936d7e7cc1ba5ef5d2e2103deefa5d45d1e4" Mar 16 17:38:32 crc kubenswrapper[5120]: I0316 17:38:32.192995 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["barbican-kuttl-tests/keystone-667f6cf997-rrpr2"] Mar 16 17:38:32 crc kubenswrapper[5120]: I0316 17:38:32.196654 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fea2a8bc-e02b-417c-b271-459320e26809" containerName="keystone-bootstrap" Mar 16 17:38:32 crc kubenswrapper[5120]: I0316 17:38:32.196688 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="fea2a8bc-e02b-417c-b271-459320e26809" containerName="keystone-bootstrap" Mar 16 17:38:32 crc kubenswrapper[5120]: I0316 17:38:32.196860 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="fea2a8bc-e02b-417c-b271-459320e26809" containerName="keystone-bootstrap" Mar 16 17:38:32 crc kubenswrapper[5120]: I0316 17:38:32.205129 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["barbican-kuttl-tests/keystone-667f6cf997-rrpr2"] Mar 16 17:38:32 crc kubenswrapper[5120]: I0316 17:38:32.205212 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/keystone-667f6cf997-rrpr2" Mar 16 17:38:32 crc kubenswrapper[5120]: I0316 17:38:32.207586 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"barbican-kuttl-tests\"/\"keystone\"" Mar 16 17:38:32 crc kubenswrapper[5120]: I0316 17:38:32.208137 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"barbican-kuttl-tests\"/\"keystone-keystone-dockercfg-ww28q\"" Mar 16 17:38:32 crc kubenswrapper[5120]: I0316 17:38:32.208268 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"barbican-kuttl-tests\"/\"keystone-config-data\"" Mar 16 17:38:32 crc kubenswrapper[5120]: I0316 17:38:32.211444 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"barbican-kuttl-tests\"/\"keystone-scripts\"" Mar 16 17:38:32 crc kubenswrapper[5120]: I0316 17:38:32.275660 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bbe1e943-d345-4e78-a91c-de129e2b82ea-config-data\") pod \"keystone-667f6cf997-rrpr2\" (UID: \"bbe1e943-d345-4e78-a91c-de129e2b82ea\") " pod="barbican-kuttl-tests/keystone-667f6cf997-rrpr2" Mar 16 17:38:32 crc kubenswrapper[5120]: I0316 17:38:32.275712 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/bbe1e943-d345-4e78-a91c-de129e2b82ea-credential-keys\") pod \"keystone-667f6cf997-rrpr2\" (UID: \"bbe1e943-d345-4e78-a91c-de129e2b82ea\") " pod="barbican-kuttl-tests/keystone-667f6cf997-rrpr2" Mar 16 17:38:32 crc kubenswrapper[5120]: I0316 17:38:32.275925 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/bbe1e943-d345-4e78-a91c-de129e2b82ea-fernet-keys\") pod \"keystone-667f6cf997-rrpr2\" (UID: \"bbe1e943-d345-4e78-a91c-de129e2b82ea\") " pod="barbican-kuttl-tests/keystone-667f6cf997-rrpr2" Mar 16 17:38:32 crc kubenswrapper[5120]: I0316 17:38:32.276002 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klh5p\" (UniqueName: \"kubernetes.io/projected/bbe1e943-d345-4e78-a91c-de129e2b82ea-kube-api-access-klh5p\") pod \"keystone-667f6cf997-rrpr2\" (UID: \"bbe1e943-d345-4e78-a91c-de129e2b82ea\") " pod="barbican-kuttl-tests/keystone-667f6cf997-rrpr2" Mar 16 17:38:32 crc kubenswrapper[5120]: I0316 17:38:32.276221 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/bbe1e943-d345-4e78-a91c-de129e2b82ea-scripts\") pod \"keystone-667f6cf997-rrpr2\" (UID: \"bbe1e943-d345-4e78-a91c-de129e2b82ea\") " pod="barbican-kuttl-tests/keystone-667f6cf997-rrpr2" Mar 16 17:38:32 crc kubenswrapper[5120]: I0316 17:38:32.378431 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-klh5p\" (UniqueName: \"kubernetes.io/projected/bbe1e943-d345-4e78-a91c-de129e2b82ea-kube-api-access-klh5p\") pod \"keystone-667f6cf997-rrpr2\" (UID: \"bbe1e943-d345-4e78-a91c-de129e2b82ea\") " pod="barbican-kuttl-tests/keystone-667f6cf997-rrpr2" Mar 16 17:38:32 crc kubenswrapper[5120]: I0316 17:38:32.378851 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/bbe1e943-d345-4e78-a91c-de129e2b82ea-scripts\") pod \"keystone-667f6cf997-rrpr2\" (UID: \"bbe1e943-d345-4e78-a91c-de129e2b82ea\") " pod="barbican-kuttl-tests/keystone-667f6cf997-rrpr2" Mar 16 17:38:32 crc kubenswrapper[5120]: I0316 17:38:32.379134 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bbe1e943-d345-4e78-a91c-de129e2b82ea-config-data\") pod \"keystone-667f6cf997-rrpr2\" (UID: \"bbe1e943-d345-4e78-a91c-de129e2b82ea\") " pod="barbican-kuttl-tests/keystone-667f6cf997-rrpr2" Mar 16 17:38:32 crc kubenswrapper[5120]: I0316 17:38:32.379274 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/bbe1e943-d345-4e78-a91c-de129e2b82ea-credential-keys\") pod \"keystone-667f6cf997-rrpr2\" (UID: \"bbe1e943-d345-4e78-a91c-de129e2b82ea\") " pod="barbican-kuttl-tests/keystone-667f6cf997-rrpr2" Mar 16 17:38:32 crc kubenswrapper[5120]: I0316 17:38:32.379515 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/bbe1e943-d345-4e78-a91c-de129e2b82ea-fernet-keys\") pod \"keystone-667f6cf997-rrpr2\" (UID: \"bbe1e943-d345-4e78-a91c-de129e2b82ea\") " pod="barbican-kuttl-tests/keystone-667f6cf997-rrpr2" Mar 16 17:38:32 crc kubenswrapper[5120]: I0316 17:38:32.382972 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/bbe1e943-d345-4e78-a91c-de129e2b82ea-scripts\") pod \"keystone-667f6cf997-rrpr2\" (UID: \"bbe1e943-d345-4e78-a91c-de129e2b82ea\") " pod="barbican-kuttl-tests/keystone-667f6cf997-rrpr2" Mar 16 17:38:32 crc kubenswrapper[5120]: I0316 17:38:32.384158 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/bbe1e943-d345-4e78-a91c-de129e2b82ea-credential-keys\") pod \"keystone-667f6cf997-rrpr2\" (UID: \"bbe1e943-d345-4e78-a91c-de129e2b82ea\") " pod="barbican-kuttl-tests/keystone-667f6cf997-rrpr2" Mar 16 17:38:32 crc kubenswrapper[5120]: I0316 17:38:32.384372 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bbe1e943-d345-4e78-a91c-de129e2b82ea-config-data\") pod \"keystone-667f6cf997-rrpr2\" (UID: \"bbe1e943-d345-4e78-a91c-de129e2b82ea\") " pod="barbican-kuttl-tests/keystone-667f6cf997-rrpr2" Mar 16 17:38:32 crc kubenswrapper[5120]: I0316 17:38:32.387216 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/bbe1e943-d345-4e78-a91c-de129e2b82ea-fernet-keys\") pod \"keystone-667f6cf997-rrpr2\" (UID: \"bbe1e943-d345-4e78-a91c-de129e2b82ea\") " pod="barbican-kuttl-tests/keystone-667f6cf997-rrpr2" Mar 16 17:38:32 crc kubenswrapper[5120]: I0316 17:38:32.401320 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-klh5p\" (UniqueName: \"kubernetes.io/projected/bbe1e943-d345-4e78-a91c-de129e2b82ea-kube-api-access-klh5p\") pod \"keystone-667f6cf997-rrpr2\" (UID: \"bbe1e943-d345-4e78-a91c-de129e2b82ea\") " pod="barbican-kuttl-tests/keystone-667f6cf997-rrpr2" Mar 16 17:38:32 crc kubenswrapper[5120]: I0316 17:38:32.527087 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/keystone-667f6cf997-rrpr2" Mar 16 17:38:32 crc kubenswrapper[5120]: I0316 17:38:32.745024 5120 scope.go:117] "RemoveContainer" containerID="2804f6a26836a720df329b94b7149248f550f65481b84ce9f03ce39c1edb38b2" Mar 16 17:38:32 crc kubenswrapper[5120]: I0316 17:38:32.778082 5120 scope.go:117] "RemoveContainer" containerID="4e26de85df0481ded1fef8cdbe39cbf810717b1b8a39ed615c9904b8547a19e3" Mar 16 17:38:32 crc kubenswrapper[5120]: I0316 17:38:32.805617 5120 scope.go:117] "RemoveContainer" containerID="3a2ba2e1046b323e2953d9442e3bfa15b30bb9787a4381df836219666d7b31ba" Mar 16 17:38:32 crc kubenswrapper[5120]: I0316 17:38:32.899303 5120 scope.go:117] "RemoveContainer" containerID="c913888b7937bca198789dacdac738c331d79cb985f6b5caf0f69fd33c203e7a" Mar 16 17:38:32 crc kubenswrapper[5120]: I0316 17:38:32.993881 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["barbican-kuttl-tests/keystone-667f6cf997-rrpr2"] Mar 16 17:38:33 crc kubenswrapper[5120]: I0316 17:38:33.126360 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/keystone-667f6cf997-rrpr2" event={"ID":"bbe1e943-d345-4e78-a91c-de129e2b82ea","Type":"ContainerStarted","Data":"b7bbc246ad24573dd340fd92a8b99bc9649b6f51a012890141b2cb311e9770d1"} Mar 16 17:38:34 crc kubenswrapper[5120]: I0316 17:38:34.135785 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/keystone-667f6cf997-rrpr2" event={"ID":"bbe1e943-d345-4e78-a91c-de129e2b82ea","Type":"ContainerStarted","Data":"7e17100ea78d21a7a68ede041a39fabe0906dba91e4e2ff5e7638615575510b9"} Mar 16 17:38:34 crc kubenswrapper[5120]: I0316 17:38:34.136239 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="barbican-kuttl-tests/keystone-667f6cf997-rrpr2" Mar 16 17:38:34 crc kubenswrapper[5120]: I0316 17:38:34.155395 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="barbican-kuttl-tests/keystone-667f6cf997-rrpr2" podStartSLOduration=2.155378714 podStartE2EDuration="2.155378714s" podCreationTimestamp="2026-03-16 17:38:32 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:38:34.15376186 +0000 UTC m=+7616.307693507" watchObservedRunningTime="2026-03-16 17:38:34.155378714 +0000 UTC m=+7616.309310371" Mar 16 17:38:40 crc kubenswrapper[5120]: I0316 17:38:40.106326 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/barbican-operator-controller-manager-58bf5697d6-vhnpj" Mar 16 17:38:59 crc kubenswrapper[5120]: I0316 17:38:59.328878 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["barbican-kuttl-tests/barbican-db-create-5ttz8"] Mar 16 17:38:59 crc kubenswrapper[5120]: I0316 17:38:59.335280 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican-db-create-5ttz8" Mar 16 17:38:59 crc kubenswrapper[5120]: I0316 17:38:59.336393 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["barbican-kuttl-tests/barbican-db-create-5ttz8"] Mar 16 17:38:59 crc kubenswrapper[5120]: I0316 17:38:59.428998 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["barbican-kuttl-tests/barbican-09c0-account-create-update-gw84h"] Mar 16 17:38:59 crc kubenswrapper[5120]: I0316 17:38:59.433884 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican-09c0-account-create-update-gw84h" Mar 16 17:38:59 crc kubenswrapper[5120]: I0316 17:38:59.436353 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"barbican-kuttl-tests\"/\"barbican-db-secret\"" Mar 16 17:38:59 crc kubenswrapper[5120]: I0316 17:38:59.436960 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["barbican-kuttl-tests/barbican-09c0-account-create-update-gw84h"] Mar 16 17:38:59 crc kubenswrapper[5120]: I0316 17:38:59.441333 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a536f6ad-6aba-444e-be60-e780d44dba89-operator-scripts\") pod \"barbican-db-create-5ttz8\" (UID: \"a536f6ad-6aba-444e-be60-e780d44dba89\") " pod="barbican-kuttl-tests/barbican-db-create-5ttz8" Mar 16 17:38:59 crc kubenswrapper[5120]: I0316 17:38:59.442213 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddq6l\" (UniqueName: \"kubernetes.io/projected/a536f6ad-6aba-444e-be60-e780d44dba89-kube-api-access-ddq6l\") pod \"barbican-db-create-5ttz8\" (UID: \"a536f6ad-6aba-444e-be60-e780d44dba89\") " pod="barbican-kuttl-tests/barbican-db-create-5ttz8" Mar 16 17:38:59 crc kubenswrapper[5120]: I0316 17:38:59.544116 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a536f6ad-6aba-444e-be60-e780d44dba89-operator-scripts\") pod \"barbican-db-create-5ttz8\" (UID: \"a536f6ad-6aba-444e-be60-e780d44dba89\") " pod="barbican-kuttl-tests/barbican-db-create-5ttz8" Mar 16 17:38:59 crc kubenswrapper[5120]: I0316 17:38:59.544432 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ddq6l\" (UniqueName: \"kubernetes.io/projected/a536f6ad-6aba-444e-be60-e780d44dba89-kube-api-access-ddq6l\") pod \"barbican-db-create-5ttz8\" (UID: \"a536f6ad-6aba-444e-be60-e780d44dba89\") " pod="barbican-kuttl-tests/barbican-db-create-5ttz8" Mar 16 17:38:59 crc kubenswrapper[5120]: I0316 17:38:59.544488 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjkjx\" (UniqueName: \"kubernetes.io/projected/15bad79d-098b-4f11-afe6-1b22757d734d-kube-api-access-hjkjx\") pod \"barbican-09c0-account-create-update-gw84h\" (UID: \"15bad79d-098b-4f11-afe6-1b22757d734d\") " pod="barbican-kuttl-tests/barbican-09c0-account-create-update-gw84h" Mar 16 17:38:59 crc kubenswrapper[5120]: I0316 17:38:59.544739 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/15bad79d-098b-4f11-afe6-1b22757d734d-operator-scripts\") pod \"barbican-09c0-account-create-update-gw84h\" (UID: \"15bad79d-098b-4f11-afe6-1b22757d734d\") " pod="barbican-kuttl-tests/barbican-09c0-account-create-update-gw84h" Mar 16 17:38:59 crc kubenswrapper[5120]: I0316 17:38:59.545681 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a536f6ad-6aba-444e-be60-e780d44dba89-operator-scripts\") pod \"barbican-db-create-5ttz8\" (UID: \"a536f6ad-6aba-444e-be60-e780d44dba89\") " pod="barbican-kuttl-tests/barbican-db-create-5ttz8" Mar 16 17:38:59 crc kubenswrapper[5120]: I0316 17:38:59.569645 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddq6l\" (UniqueName: \"kubernetes.io/projected/a536f6ad-6aba-444e-be60-e780d44dba89-kube-api-access-ddq6l\") pod \"barbican-db-create-5ttz8\" (UID: \"a536f6ad-6aba-444e-be60-e780d44dba89\") " pod="barbican-kuttl-tests/barbican-db-create-5ttz8" Mar 16 17:38:59 crc kubenswrapper[5120]: I0316 17:38:59.646615 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hjkjx\" (UniqueName: \"kubernetes.io/projected/15bad79d-098b-4f11-afe6-1b22757d734d-kube-api-access-hjkjx\") pod \"barbican-09c0-account-create-update-gw84h\" (UID: \"15bad79d-098b-4f11-afe6-1b22757d734d\") " pod="barbican-kuttl-tests/barbican-09c0-account-create-update-gw84h" Mar 16 17:38:59 crc kubenswrapper[5120]: I0316 17:38:59.646754 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/15bad79d-098b-4f11-afe6-1b22757d734d-operator-scripts\") pod \"barbican-09c0-account-create-update-gw84h\" (UID: \"15bad79d-098b-4f11-afe6-1b22757d734d\") " pod="barbican-kuttl-tests/barbican-09c0-account-create-update-gw84h" Mar 16 17:38:59 crc kubenswrapper[5120]: I0316 17:38:59.647729 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/15bad79d-098b-4f11-afe6-1b22757d734d-operator-scripts\") pod \"barbican-09c0-account-create-update-gw84h\" (UID: \"15bad79d-098b-4f11-afe6-1b22757d734d\") " pod="barbican-kuttl-tests/barbican-09c0-account-create-update-gw84h" Mar 16 17:38:59 crc kubenswrapper[5120]: I0316 17:38:59.653914 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican-db-create-5ttz8" Mar 16 17:38:59 crc kubenswrapper[5120]: I0316 17:38:59.668953 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjkjx\" (UniqueName: \"kubernetes.io/projected/15bad79d-098b-4f11-afe6-1b22757d734d-kube-api-access-hjkjx\") pod \"barbican-09c0-account-create-update-gw84h\" (UID: \"15bad79d-098b-4f11-afe6-1b22757d734d\") " pod="barbican-kuttl-tests/barbican-09c0-account-create-update-gw84h" Mar 16 17:38:59 crc kubenswrapper[5120]: I0316 17:38:59.749136 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican-09c0-account-create-update-gw84h" Mar 16 17:39:00 crc kubenswrapper[5120]: I0316 17:39:00.068459 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["barbican-kuttl-tests/barbican-db-create-5ttz8"] Mar 16 17:39:00 crc kubenswrapper[5120]: I0316 17:39:00.173791 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["barbican-kuttl-tests/barbican-09c0-account-create-update-gw84h"] Mar 16 17:39:00 crc kubenswrapper[5120]: W0316 17:39:00.179989 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod15bad79d_098b_4f11_afe6_1b22757d734d.slice/crio-cb7c1c871f8b3fb1719711590993c1f39a62da125563be0dd00e2f8aa96f366a WatchSource:0}: Error finding container cb7c1c871f8b3fb1719711590993c1f39a62da125563be0dd00e2f8aa96f366a: Status 404 returned error can't find the container with id cb7c1c871f8b3fb1719711590993c1f39a62da125563be0dd00e2f8aa96f366a Mar 16 17:39:00 crc kubenswrapper[5120]: I0316 17:39:00.342486 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-09c0-account-create-update-gw84h" event={"ID":"15bad79d-098b-4f11-afe6-1b22757d734d","Type":"ContainerStarted","Data":"89c043e6be0b62df91ea671488f2df5f47269361918e8970bf2e56ba47345a72"} Mar 16 17:39:00 crc kubenswrapper[5120]: I0316 17:39:00.344941 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-09c0-account-create-update-gw84h" event={"ID":"15bad79d-098b-4f11-afe6-1b22757d734d","Type":"ContainerStarted","Data":"cb7c1c871f8b3fb1719711590993c1f39a62da125563be0dd00e2f8aa96f366a"} Mar 16 17:39:00 crc kubenswrapper[5120]: I0316 17:39:00.344979 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-db-create-5ttz8" event={"ID":"a536f6ad-6aba-444e-be60-e780d44dba89","Type":"ContainerStarted","Data":"c65c9047218036b7dce5dc7676f8777b6685820e33f291a341b7e7d61e520376"} Mar 16 17:39:00 crc kubenswrapper[5120]: I0316 17:39:00.344990 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-db-create-5ttz8" event={"ID":"a536f6ad-6aba-444e-be60-e780d44dba89","Type":"ContainerStarted","Data":"2197b0aecefbb6c957b9e56bc13a753da39555c40f30730bd8f430e89696e8fc"} Mar 16 17:39:00 crc kubenswrapper[5120]: I0316 17:39:00.358919 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="barbican-kuttl-tests/barbican-09c0-account-create-update-gw84h" podStartSLOduration=1.358900711 podStartE2EDuration="1.358900711s" podCreationTimestamp="2026-03-16 17:38:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:39:00.357284577 +0000 UTC m=+7642.511216234" watchObservedRunningTime="2026-03-16 17:39:00.358900711 +0000 UTC m=+7642.512832368" Mar 16 17:39:00 crc kubenswrapper[5120]: I0316 17:39:00.378419 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="barbican-kuttl-tests/barbican-db-create-5ttz8" podStartSLOduration=1.378397433 podStartE2EDuration="1.378397433s" podCreationTimestamp="2026-03-16 17:38:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:39:00.371059873 +0000 UTC m=+7642.524991550" watchObservedRunningTime="2026-03-16 17:39:00.378397433 +0000 UTC m=+7642.532329100" Mar 16 17:39:01 crc kubenswrapper[5120]: I0316 17:39:01.352486 5120 generic.go:358] "Generic (PLEG): container finished" podID="a536f6ad-6aba-444e-be60-e780d44dba89" containerID="c65c9047218036b7dce5dc7676f8777b6685820e33f291a341b7e7d61e520376" exitCode=0 Mar 16 17:39:01 crc kubenswrapper[5120]: I0316 17:39:01.352556 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-db-create-5ttz8" event={"ID":"a536f6ad-6aba-444e-be60-e780d44dba89","Type":"ContainerDied","Data":"c65c9047218036b7dce5dc7676f8777b6685820e33f291a341b7e7d61e520376"} Mar 16 17:39:01 crc kubenswrapper[5120]: I0316 17:39:01.354370 5120 generic.go:358] "Generic (PLEG): container finished" podID="15bad79d-098b-4f11-afe6-1b22757d734d" containerID="89c043e6be0b62df91ea671488f2df5f47269361918e8970bf2e56ba47345a72" exitCode=0 Mar 16 17:39:01 crc kubenswrapper[5120]: I0316 17:39:01.354485 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-09c0-account-create-update-gw84h" event={"ID":"15bad79d-098b-4f11-afe6-1b22757d734d","Type":"ContainerDied","Data":"89c043e6be0b62df91ea671488f2df5f47269361918e8970bf2e56ba47345a72"} Mar 16 17:39:02 crc kubenswrapper[5120]: I0316 17:39:02.775262 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican-db-create-5ttz8" Mar 16 17:39:02 crc kubenswrapper[5120]: I0316 17:39:02.779908 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican-09c0-account-create-update-gw84h" Mar 16 17:39:02 crc kubenswrapper[5120]: I0316 17:39:02.827626 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hjkjx\" (UniqueName: \"kubernetes.io/projected/15bad79d-098b-4f11-afe6-1b22757d734d-kube-api-access-hjkjx\") pod \"15bad79d-098b-4f11-afe6-1b22757d734d\" (UID: \"15bad79d-098b-4f11-afe6-1b22757d734d\") " Mar 16 17:39:02 crc kubenswrapper[5120]: I0316 17:39:02.827724 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a536f6ad-6aba-444e-be60-e780d44dba89-operator-scripts\") pod \"a536f6ad-6aba-444e-be60-e780d44dba89\" (UID: \"a536f6ad-6aba-444e-be60-e780d44dba89\") " Mar 16 17:39:02 crc kubenswrapper[5120]: I0316 17:39:02.827754 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/15bad79d-098b-4f11-afe6-1b22757d734d-operator-scripts\") pod \"15bad79d-098b-4f11-afe6-1b22757d734d\" (UID: \"15bad79d-098b-4f11-afe6-1b22757d734d\") " Mar 16 17:39:02 crc kubenswrapper[5120]: I0316 17:39:02.827991 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ddq6l\" (UniqueName: \"kubernetes.io/projected/a536f6ad-6aba-444e-be60-e780d44dba89-kube-api-access-ddq6l\") pod \"a536f6ad-6aba-444e-be60-e780d44dba89\" (UID: \"a536f6ad-6aba-444e-be60-e780d44dba89\") " Mar 16 17:39:02 crc kubenswrapper[5120]: I0316 17:39:02.828947 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a536f6ad-6aba-444e-be60-e780d44dba89-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "a536f6ad-6aba-444e-be60-e780d44dba89" (UID: "a536f6ad-6aba-444e-be60-e780d44dba89"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:39:02 crc kubenswrapper[5120]: I0316 17:39:02.829355 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/15bad79d-098b-4f11-afe6-1b22757d734d-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "15bad79d-098b-4f11-afe6-1b22757d734d" (UID: "15bad79d-098b-4f11-afe6-1b22757d734d"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:39:02 crc kubenswrapper[5120]: I0316 17:39:02.836603 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15bad79d-098b-4f11-afe6-1b22757d734d-kube-api-access-hjkjx" (OuterVolumeSpecName: "kube-api-access-hjkjx") pod "15bad79d-098b-4f11-afe6-1b22757d734d" (UID: "15bad79d-098b-4f11-afe6-1b22757d734d"). InnerVolumeSpecName "kube-api-access-hjkjx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:39:02 crc kubenswrapper[5120]: I0316 17:39:02.836736 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a536f6ad-6aba-444e-be60-e780d44dba89-kube-api-access-ddq6l" (OuterVolumeSpecName: "kube-api-access-ddq6l") pod "a536f6ad-6aba-444e-be60-e780d44dba89" (UID: "a536f6ad-6aba-444e-be60-e780d44dba89"). InnerVolumeSpecName "kube-api-access-ddq6l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:39:02 crc kubenswrapper[5120]: I0316 17:39:02.930416 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hjkjx\" (UniqueName: \"kubernetes.io/projected/15bad79d-098b-4f11-afe6-1b22757d734d-kube-api-access-hjkjx\") on node \"crc\" DevicePath \"\"" Mar 16 17:39:02 crc kubenswrapper[5120]: I0316 17:39:02.930455 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a536f6ad-6aba-444e-be60-e780d44dba89-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:39:02 crc kubenswrapper[5120]: I0316 17:39:02.930465 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/15bad79d-098b-4f11-afe6-1b22757d734d-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:39:02 crc kubenswrapper[5120]: I0316 17:39:02.930475 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ddq6l\" (UniqueName: \"kubernetes.io/projected/a536f6ad-6aba-444e-be60-e780d44dba89-kube-api-access-ddq6l\") on node \"crc\" DevicePath \"\"" Mar 16 17:39:03 crc kubenswrapper[5120]: I0316 17:39:03.371584 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-db-create-5ttz8" event={"ID":"a536f6ad-6aba-444e-be60-e780d44dba89","Type":"ContainerDied","Data":"2197b0aecefbb6c957b9e56bc13a753da39555c40f30730bd8f430e89696e8fc"} Mar 16 17:39:03 crc kubenswrapper[5120]: I0316 17:39:03.371622 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2197b0aecefbb6c957b9e56bc13a753da39555c40f30730bd8f430e89696e8fc" Mar 16 17:39:03 crc kubenswrapper[5120]: I0316 17:39:03.371677 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican-db-create-5ttz8" Mar 16 17:39:03 crc kubenswrapper[5120]: I0316 17:39:03.386072 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-09c0-account-create-update-gw84h" event={"ID":"15bad79d-098b-4f11-afe6-1b22757d734d","Type":"ContainerDied","Data":"cb7c1c871f8b3fb1719711590993c1f39a62da125563be0dd00e2f8aa96f366a"} Mar 16 17:39:03 crc kubenswrapper[5120]: I0316 17:39:03.386105 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cb7c1c871f8b3fb1719711590993c1f39a62da125563be0dd00e2f8aa96f366a" Mar 16 17:39:03 crc kubenswrapper[5120]: I0316 17:39:03.386192 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican-09c0-account-create-update-gw84h" Mar 16 17:39:04 crc kubenswrapper[5120]: I0316 17:39:04.676355 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["barbican-kuttl-tests/barbican-db-sync-5sw4t"] Mar 16 17:39:04 crc kubenswrapper[5120]: I0316 17:39:04.679262 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15bad79d-098b-4f11-afe6-1b22757d734d" containerName="mariadb-account-create-update" Mar 16 17:39:04 crc kubenswrapper[5120]: I0316 17:39:04.679424 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="15bad79d-098b-4f11-afe6-1b22757d734d" containerName="mariadb-account-create-update" Mar 16 17:39:04 crc kubenswrapper[5120]: I0316 17:39:04.679534 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a536f6ad-6aba-444e-be60-e780d44dba89" containerName="mariadb-database-create" Mar 16 17:39:04 crc kubenswrapper[5120]: I0316 17:39:04.679595 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a536f6ad-6aba-444e-be60-e780d44dba89" containerName="mariadb-database-create" Mar 16 17:39:04 crc kubenswrapper[5120]: I0316 17:39:04.679814 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="a536f6ad-6aba-444e-be60-e780d44dba89" containerName="mariadb-database-create" Mar 16 17:39:04 crc kubenswrapper[5120]: I0316 17:39:04.679898 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="15bad79d-098b-4f11-afe6-1b22757d734d" containerName="mariadb-account-create-update" Mar 16 17:39:04 crc kubenswrapper[5120]: I0316 17:39:04.687389 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["barbican-kuttl-tests/barbican-db-sync-5sw4t"] Mar 16 17:39:04 crc kubenswrapper[5120]: I0316 17:39:04.687457 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican-db-sync-5sw4t" Mar 16 17:39:04 crc kubenswrapper[5120]: I0316 17:39:04.689459 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"barbican-kuttl-tests\"/\"barbican-barbican-dockercfg-6h8tb\"" Mar 16 17:39:04 crc kubenswrapper[5120]: I0316 17:39:04.690011 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"barbican-kuttl-tests\"/\"barbican-config-data\"" Mar 16 17:39:04 crc kubenswrapper[5120]: I0316 17:39:04.766938 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/abf5f304-1df1-4dfe-9fcf-6b87d098d48c-db-sync-config-data\") pod \"barbican-db-sync-5sw4t\" (UID: \"abf5f304-1df1-4dfe-9fcf-6b87d098d48c\") " pod="barbican-kuttl-tests/barbican-db-sync-5sw4t" Mar 16 17:39:04 crc kubenswrapper[5120]: I0316 17:39:04.767259 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ps5g8\" (UniqueName: \"kubernetes.io/projected/abf5f304-1df1-4dfe-9fcf-6b87d098d48c-kube-api-access-ps5g8\") pod \"barbican-db-sync-5sw4t\" (UID: \"abf5f304-1df1-4dfe-9fcf-6b87d098d48c\") " pod="barbican-kuttl-tests/barbican-db-sync-5sw4t" Mar 16 17:39:04 crc kubenswrapper[5120]: I0316 17:39:04.869653 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/abf5f304-1df1-4dfe-9fcf-6b87d098d48c-db-sync-config-data\") pod \"barbican-db-sync-5sw4t\" (UID: \"abf5f304-1df1-4dfe-9fcf-6b87d098d48c\") " pod="barbican-kuttl-tests/barbican-db-sync-5sw4t" Mar 16 17:39:04 crc kubenswrapper[5120]: I0316 17:39:04.870286 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ps5g8\" (UniqueName: \"kubernetes.io/projected/abf5f304-1df1-4dfe-9fcf-6b87d098d48c-kube-api-access-ps5g8\") pod \"barbican-db-sync-5sw4t\" (UID: \"abf5f304-1df1-4dfe-9fcf-6b87d098d48c\") " pod="barbican-kuttl-tests/barbican-db-sync-5sw4t" Mar 16 17:39:04 crc kubenswrapper[5120]: I0316 17:39:04.880188 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/abf5f304-1df1-4dfe-9fcf-6b87d098d48c-db-sync-config-data\") pod \"barbican-db-sync-5sw4t\" (UID: \"abf5f304-1df1-4dfe-9fcf-6b87d098d48c\") " pod="barbican-kuttl-tests/barbican-db-sync-5sw4t" Mar 16 17:39:04 crc kubenswrapper[5120]: I0316 17:39:04.889138 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ps5g8\" (UniqueName: \"kubernetes.io/projected/abf5f304-1df1-4dfe-9fcf-6b87d098d48c-kube-api-access-ps5g8\") pod \"barbican-db-sync-5sw4t\" (UID: \"abf5f304-1df1-4dfe-9fcf-6b87d098d48c\") " pod="barbican-kuttl-tests/barbican-db-sync-5sw4t" Mar 16 17:39:05 crc kubenswrapper[5120]: I0316 17:39:05.006845 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican-db-sync-5sw4t" Mar 16 17:39:05 crc kubenswrapper[5120]: I0316 17:39:05.426970 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["barbican-kuttl-tests/barbican-db-sync-5sw4t"] Mar 16 17:39:06 crc kubenswrapper[5120]: I0316 17:39:06.415040 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-db-sync-5sw4t" event={"ID":"abf5f304-1df1-4dfe-9fcf-6b87d098d48c","Type":"ContainerStarted","Data":"1b0bdfdaaa4a9462794155faf62f78f265a50c86922b7d1bd2bea57eb49f0c73"} Mar 16 17:39:06 crc kubenswrapper[5120]: I0316 17:39:06.416422 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-db-sync-5sw4t" event={"ID":"abf5f304-1df1-4dfe-9fcf-6b87d098d48c","Type":"ContainerStarted","Data":"992319e27f69c108694aa0d7c4a4753915a5cd29d70ade27ceb2bf7fa117e76e"} Mar 16 17:39:06 crc kubenswrapper[5120]: I0316 17:39:06.444204 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="barbican-kuttl-tests/barbican-db-sync-5sw4t" podStartSLOduration=2.005126719 podStartE2EDuration="2.444175399s" podCreationTimestamp="2026-03-16 17:39:04 +0000 UTC" firstStartedPulling="2026-03-16 17:39:05.434041382 +0000 UTC m=+7647.587973039" lastFinishedPulling="2026-03-16 17:39:05.873090042 +0000 UTC m=+7648.027021719" observedRunningTime="2026-03-16 17:39:06.429645042 +0000 UTC m=+7648.583576729" watchObservedRunningTime="2026-03-16 17:39:06.444175399 +0000 UTC m=+7648.598107096" Mar 16 17:39:06 crc kubenswrapper[5120]: I0316 17:39:06.582992 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="barbican-kuttl-tests/keystone-667f6cf997-rrpr2" Mar 16 17:39:07 crc kubenswrapper[5120]: E0316 17:39:07.618635 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1135427 actualBytes=10240 Mar 16 17:39:08 crc kubenswrapper[5120]: I0316 17:39:08.432269 5120 generic.go:358] "Generic (PLEG): container finished" podID="abf5f304-1df1-4dfe-9fcf-6b87d098d48c" containerID="1b0bdfdaaa4a9462794155faf62f78f265a50c86922b7d1bd2bea57eb49f0c73" exitCode=0 Mar 16 17:39:08 crc kubenswrapper[5120]: I0316 17:39:08.432338 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-db-sync-5sw4t" event={"ID":"abf5f304-1df1-4dfe-9fcf-6b87d098d48c","Type":"ContainerDied","Data":"1b0bdfdaaa4a9462794155faf62f78f265a50c86922b7d1bd2bea57eb49f0c73"} Mar 16 17:39:10 crc kubenswrapper[5120]: I0316 17:39:10.809448 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-operators/infra-operator-controller-manager-747c77fd77-qt2c6" podUID="a2746e35-f4b1-4c30-9288-8e4e9dc669bd" containerName="manager" probeResult="failure" output="Get \"http://10.217.1.143:8081/readyz\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 17:39:11 crc kubenswrapper[5120]: I0316 17:39:11.093520 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican-db-sync-5sw4t" Mar 16 17:39:11 crc kubenswrapper[5120]: I0316 17:39:11.239054 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ps5g8\" (UniqueName: \"kubernetes.io/projected/abf5f304-1df1-4dfe-9fcf-6b87d098d48c-kube-api-access-ps5g8\") pod \"abf5f304-1df1-4dfe-9fcf-6b87d098d48c\" (UID: \"abf5f304-1df1-4dfe-9fcf-6b87d098d48c\") " Mar 16 17:39:11 crc kubenswrapper[5120]: I0316 17:39:11.239339 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/abf5f304-1df1-4dfe-9fcf-6b87d098d48c-db-sync-config-data\") pod \"abf5f304-1df1-4dfe-9fcf-6b87d098d48c\" (UID: \"abf5f304-1df1-4dfe-9fcf-6b87d098d48c\") " Mar 16 17:39:11 crc kubenswrapper[5120]: I0316 17:39:11.244367 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/abf5f304-1df1-4dfe-9fcf-6b87d098d48c-db-sync-config-data" (OuterVolumeSpecName: "db-sync-config-data") pod "abf5f304-1df1-4dfe-9fcf-6b87d098d48c" (UID: "abf5f304-1df1-4dfe-9fcf-6b87d098d48c"). InnerVolumeSpecName "db-sync-config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:39:11 crc kubenswrapper[5120]: I0316 17:39:11.244545 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/abf5f304-1df1-4dfe-9fcf-6b87d098d48c-kube-api-access-ps5g8" (OuterVolumeSpecName: "kube-api-access-ps5g8") pod "abf5f304-1df1-4dfe-9fcf-6b87d098d48c" (UID: "abf5f304-1df1-4dfe-9fcf-6b87d098d48c"). InnerVolumeSpecName "kube-api-access-ps5g8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:39:11 crc kubenswrapper[5120]: I0316 17:39:11.342265 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ps5g8\" (UniqueName: \"kubernetes.io/projected/abf5f304-1df1-4dfe-9fcf-6b87d098d48c-kube-api-access-ps5g8\") on node \"crc\" DevicePath \"\"" Mar 16 17:39:11 crc kubenswrapper[5120]: I0316 17:39:11.342301 5120 reconciler_common.go:299] "Volume detached for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/abf5f304-1df1-4dfe-9fcf-6b87d098d48c-db-sync-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:39:11 crc kubenswrapper[5120]: I0316 17:39:11.456627 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-db-sync-5sw4t" event={"ID":"abf5f304-1df1-4dfe-9fcf-6b87d098d48c","Type":"ContainerDied","Data":"992319e27f69c108694aa0d7c4a4753915a5cd29d70ade27ceb2bf7fa117e76e"} Mar 16 17:39:11 crc kubenswrapper[5120]: I0316 17:39:11.456672 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="992319e27f69c108694aa0d7c4a4753915a5cd29d70ade27ceb2bf7fa117e76e" Mar 16 17:39:11 crc kubenswrapper[5120]: I0316 17:39:11.456749 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican-db-sync-5sw4t" Mar 16 17:39:12 crc kubenswrapper[5120]: I0316 17:39:12.348153 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["barbican-kuttl-tests/barbican-worker-cb847bf9c-87m9r"] Mar 16 17:39:12 crc kubenswrapper[5120]: I0316 17:39:12.349163 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="abf5f304-1df1-4dfe-9fcf-6b87d098d48c" containerName="barbican-db-sync" Mar 16 17:39:12 crc kubenswrapper[5120]: I0316 17:39:12.349175 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="abf5f304-1df1-4dfe-9fcf-6b87d098d48c" containerName="barbican-db-sync" Mar 16 17:39:12 crc kubenswrapper[5120]: I0316 17:39:12.349316 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="abf5f304-1df1-4dfe-9fcf-6b87d098d48c" containerName="barbican-db-sync" Mar 16 17:39:12 crc kubenswrapper[5120]: I0316 17:39:12.356214 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican-worker-cb847bf9c-87m9r" Mar 16 17:39:12 crc kubenswrapper[5120]: I0316 17:39:12.359675 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"barbican-kuttl-tests\"/\"barbican-config-data\"" Mar 16 17:39:12 crc kubenswrapper[5120]: I0316 17:39:12.359992 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"barbican-kuttl-tests\"/\"barbican-barbican-dockercfg-6h8tb\"" Mar 16 17:39:12 crc kubenswrapper[5120]: I0316 17:39:12.360253 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"barbican-kuttl-tests\"/\"barbican-worker-config-data\"" Mar 16 17:39:12 crc kubenswrapper[5120]: I0316 17:39:12.371547 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["barbican-kuttl-tests/barbican-worker-cb847bf9c-87m9r"] Mar 16 17:39:12 crc kubenswrapper[5120]: I0316 17:39:12.403178 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["barbican-kuttl-tests/barbican-keystone-listener-9c667c454-mwz98"] Mar 16 17:39:12 crc kubenswrapper[5120]: I0316 17:39:12.430149 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican-keystone-listener-9c667c454-mwz98" Mar 16 17:39:12 crc kubenswrapper[5120]: I0316 17:39:12.453010 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"barbican-kuttl-tests\"/\"barbican-keystone-listener-config-data\"" Mar 16 17:39:12 crc kubenswrapper[5120]: I0316 17:39:12.453226 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["barbican-kuttl-tests/barbican-keystone-listener-9c667c454-mwz98"] Mar 16 17:39:12 crc kubenswrapper[5120]: I0316 17:39:12.467650 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7f66fc8b-a4b9-42f4-923a-f0f2562b14b5-config-data\") pod \"barbican-worker-cb847bf9c-87m9r\" (UID: \"7f66fc8b-a4b9-42f4-923a-f0f2562b14b5\") " pod="barbican-kuttl-tests/barbican-worker-cb847bf9c-87m9r" Mar 16 17:39:12 crc kubenswrapper[5120]: I0316 17:39:12.467734 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7f66fc8b-a4b9-42f4-923a-f0f2562b14b5-logs\") pod \"barbican-worker-cb847bf9c-87m9r\" (UID: \"7f66fc8b-a4b9-42f4-923a-f0f2562b14b5\") " pod="barbican-kuttl-tests/barbican-worker-cb847bf9c-87m9r" Mar 16 17:39:12 crc kubenswrapper[5120]: I0316 17:39:12.467984 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c45mx\" (UniqueName: \"kubernetes.io/projected/7f66fc8b-a4b9-42f4-923a-f0f2562b14b5-kube-api-access-c45mx\") pod \"barbican-worker-cb847bf9c-87m9r\" (UID: \"7f66fc8b-a4b9-42f4-923a-f0f2562b14b5\") " pod="barbican-kuttl-tests/barbican-worker-cb847bf9c-87m9r" Mar 16 17:39:12 crc kubenswrapper[5120]: I0316 17:39:12.468058 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/7f66fc8b-a4b9-42f4-923a-f0f2562b14b5-config-data-custom\") pod \"barbican-worker-cb847bf9c-87m9r\" (UID: \"7f66fc8b-a4b9-42f4-923a-f0f2562b14b5\") " pod="barbican-kuttl-tests/barbican-worker-cb847bf9c-87m9r" Mar 16 17:39:12 crc kubenswrapper[5120]: I0316 17:39:12.540113 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["barbican-kuttl-tests/barbican-api-6fc6fbdfcd-6zspr"] Mar 16 17:39:12 crc kubenswrapper[5120]: I0316 17:39:12.546818 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican-api-6fc6fbdfcd-6zspr" Mar 16 17:39:12 crc kubenswrapper[5120]: I0316 17:39:12.549409 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"barbican-kuttl-tests\"/\"barbican-api-config-data\"" Mar 16 17:39:12 crc kubenswrapper[5120]: I0316 17:39:12.560702 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["barbican-kuttl-tests/barbican-api-6fc6fbdfcd-6zspr"] Mar 16 17:39:12 crc kubenswrapper[5120]: I0316 17:39:12.571422 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2zwv\" (UniqueName: \"kubernetes.io/projected/d612c818-7a65-4f59-8908-fce1d295996b-kube-api-access-l2zwv\") pod \"barbican-keystone-listener-9c667c454-mwz98\" (UID: \"d612c818-7a65-4f59-8908-fce1d295996b\") " pod="barbican-kuttl-tests/barbican-keystone-listener-9c667c454-mwz98" Mar 16 17:39:12 crc kubenswrapper[5120]: I0316 17:39:12.571513 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7f66fc8b-a4b9-42f4-923a-f0f2562b14b5-logs\") pod \"barbican-worker-cb847bf9c-87m9r\" (UID: \"7f66fc8b-a4b9-42f4-923a-f0f2562b14b5\") " pod="barbican-kuttl-tests/barbican-worker-cb847bf9c-87m9r" Mar 16 17:39:12 crc kubenswrapper[5120]: I0316 17:39:12.571575 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c45mx\" (UniqueName: \"kubernetes.io/projected/7f66fc8b-a4b9-42f4-923a-f0f2562b14b5-kube-api-access-c45mx\") pod \"barbican-worker-cb847bf9c-87m9r\" (UID: \"7f66fc8b-a4b9-42f4-923a-f0f2562b14b5\") " pod="barbican-kuttl-tests/barbican-worker-cb847bf9c-87m9r" Mar 16 17:39:12 crc kubenswrapper[5120]: I0316 17:39:12.571649 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d612c818-7a65-4f59-8908-fce1d295996b-config-data\") pod \"barbican-keystone-listener-9c667c454-mwz98\" (UID: \"d612c818-7a65-4f59-8908-fce1d295996b\") " pod="barbican-kuttl-tests/barbican-keystone-listener-9c667c454-mwz98" Mar 16 17:39:12 crc kubenswrapper[5120]: I0316 17:39:12.571720 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/7f66fc8b-a4b9-42f4-923a-f0f2562b14b5-config-data-custom\") pod \"barbican-worker-cb847bf9c-87m9r\" (UID: \"7f66fc8b-a4b9-42f4-923a-f0f2562b14b5\") " pod="barbican-kuttl-tests/barbican-worker-cb847bf9c-87m9r" Mar 16 17:39:12 crc kubenswrapper[5120]: I0316 17:39:12.571856 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/d612c818-7a65-4f59-8908-fce1d295996b-config-data-custom\") pod \"barbican-keystone-listener-9c667c454-mwz98\" (UID: \"d612c818-7a65-4f59-8908-fce1d295996b\") " pod="barbican-kuttl-tests/barbican-keystone-listener-9c667c454-mwz98" Mar 16 17:39:12 crc kubenswrapper[5120]: I0316 17:39:12.571878 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7f66fc8b-a4b9-42f4-923a-f0f2562b14b5-logs\") pod \"barbican-worker-cb847bf9c-87m9r\" (UID: \"7f66fc8b-a4b9-42f4-923a-f0f2562b14b5\") " pod="barbican-kuttl-tests/barbican-worker-cb847bf9c-87m9r" Mar 16 17:39:12 crc kubenswrapper[5120]: I0316 17:39:12.572014 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d612c818-7a65-4f59-8908-fce1d295996b-logs\") pod \"barbican-keystone-listener-9c667c454-mwz98\" (UID: \"d612c818-7a65-4f59-8908-fce1d295996b\") " pod="barbican-kuttl-tests/barbican-keystone-listener-9c667c454-mwz98" Mar 16 17:39:12 crc kubenswrapper[5120]: I0316 17:39:12.572196 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7f66fc8b-a4b9-42f4-923a-f0f2562b14b5-config-data\") pod \"barbican-worker-cb847bf9c-87m9r\" (UID: \"7f66fc8b-a4b9-42f4-923a-f0f2562b14b5\") " pod="barbican-kuttl-tests/barbican-worker-cb847bf9c-87m9r" Mar 16 17:39:12 crc kubenswrapper[5120]: I0316 17:39:12.585918 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/7f66fc8b-a4b9-42f4-923a-f0f2562b14b5-config-data-custom\") pod \"barbican-worker-cb847bf9c-87m9r\" (UID: \"7f66fc8b-a4b9-42f4-923a-f0f2562b14b5\") " pod="barbican-kuttl-tests/barbican-worker-cb847bf9c-87m9r" Mar 16 17:39:12 crc kubenswrapper[5120]: I0316 17:39:12.592397 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c45mx\" (UniqueName: \"kubernetes.io/projected/7f66fc8b-a4b9-42f4-923a-f0f2562b14b5-kube-api-access-c45mx\") pod \"barbican-worker-cb847bf9c-87m9r\" (UID: \"7f66fc8b-a4b9-42f4-923a-f0f2562b14b5\") " pod="barbican-kuttl-tests/barbican-worker-cb847bf9c-87m9r" Mar 16 17:39:12 crc kubenswrapper[5120]: I0316 17:39:12.602077 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7f66fc8b-a4b9-42f4-923a-f0f2562b14b5-config-data\") pod \"barbican-worker-cb847bf9c-87m9r\" (UID: \"7f66fc8b-a4b9-42f4-923a-f0f2562b14b5\") " pod="barbican-kuttl-tests/barbican-worker-cb847bf9c-87m9r" Mar 16 17:39:12 crc kubenswrapper[5120]: I0316 17:39:12.673788 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/d612c818-7a65-4f59-8908-fce1d295996b-config-data-custom\") pod \"barbican-keystone-listener-9c667c454-mwz98\" (UID: \"d612c818-7a65-4f59-8908-fce1d295996b\") " pod="barbican-kuttl-tests/barbican-keystone-listener-9c667c454-mwz98" Mar 16 17:39:12 crc kubenswrapper[5120]: I0316 17:39:12.673884 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d612c818-7a65-4f59-8908-fce1d295996b-logs\") pod \"barbican-keystone-listener-9c667c454-mwz98\" (UID: \"d612c818-7a65-4f59-8908-fce1d295996b\") " pod="barbican-kuttl-tests/barbican-keystone-listener-9c667c454-mwz98" Mar 16 17:39:12 crc kubenswrapper[5120]: I0316 17:39:12.673975 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/443927da-114a-4656-9e75-0c2899a881c9-config-data-custom\") pod \"barbican-api-6fc6fbdfcd-6zspr\" (UID: \"443927da-114a-4656-9e75-0c2899a881c9\") " pod="barbican-kuttl-tests/barbican-api-6fc6fbdfcd-6zspr" Mar 16 17:39:12 crc kubenswrapper[5120]: I0316 17:39:12.674020 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/443927da-114a-4656-9e75-0c2899a881c9-config-data\") pod \"barbican-api-6fc6fbdfcd-6zspr\" (UID: \"443927da-114a-4656-9e75-0c2899a881c9\") " pod="barbican-kuttl-tests/barbican-api-6fc6fbdfcd-6zspr" Mar 16 17:39:12 crc kubenswrapper[5120]: I0316 17:39:12.674046 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htqhb\" (UniqueName: \"kubernetes.io/projected/443927da-114a-4656-9e75-0c2899a881c9-kube-api-access-htqhb\") pod \"barbican-api-6fc6fbdfcd-6zspr\" (UID: \"443927da-114a-4656-9e75-0c2899a881c9\") " pod="barbican-kuttl-tests/barbican-api-6fc6fbdfcd-6zspr" Mar 16 17:39:12 crc kubenswrapper[5120]: I0316 17:39:12.674091 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l2zwv\" (UniqueName: \"kubernetes.io/projected/d612c818-7a65-4f59-8908-fce1d295996b-kube-api-access-l2zwv\") pod \"barbican-keystone-listener-9c667c454-mwz98\" (UID: \"d612c818-7a65-4f59-8908-fce1d295996b\") " pod="barbican-kuttl-tests/barbican-keystone-listener-9c667c454-mwz98" Mar 16 17:39:12 crc kubenswrapper[5120]: I0316 17:39:12.674157 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/443927da-114a-4656-9e75-0c2899a881c9-logs\") pod \"barbican-api-6fc6fbdfcd-6zspr\" (UID: \"443927da-114a-4656-9e75-0c2899a881c9\") " pod="barbican-kuttl-tests/barbican-api-6fc6fbdfcd-6zspr" Mar 16 17:39:12 crc kubenswrapper[5120]: I0316 17:39:12.674412 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d612c818-7a65-4f59-8908-fce1d295996b-logs\") pod \"barbican-keystone-listener-9c667c454-mwz98\" (UID: \"d612c818-7a65-4f59-8908-fce1d295996b\") " pod="barbican-kuttl-tests/barbican-keystone-listener-9c667c454-mwz98" Mar 16 17:39:12 crc kubenswrapper[5120]: I0316 17:39:12.674424 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d612c818-7a65-4f59-8908-fce1d295996b-config-data\") pod \"barbican-keystone-listener-9c667c454-mwz98\" (UID: \"d612c818-7a65-4f59-8908-fce1d295996b\") " pod="barbican-kuttl-tests/barbican-keystone-listener-9c667c454-mwz98" Mar 16 17:39:12 crc kubenswrapper[5120]: I0316 17:39:12.678468 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/d612c818-7a65-4f59-8908-fce1d295996b-config-data-custom\") pod \"barbican-keystone-listener-9c667c454-mwz98\" (UID: \"d612c818-7a65-4f59-8908-fce1d295996b\") " pod="barbican-kuttl-tests/barbican-keystone-listener-9c667c454-mwz98" Mar 16 17:39:12 crc kubenswrapper[5120]: I0316 17:39:12.679099 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d612c818-7a65-4f59-8908-fce1d295996b-config-data\") pod \"barbican-keystone-listener-9c667c454-mwz98\" (UID: \"d612c818-7a65-4f59-8908-fce1d295996b\") " pod="barbican-kuttl-tests/barbican-keystone-listener-9c667c454-mwz98" Mar 16 17:39:12 crc kubenswrapper[5120]: I0316 17:39:12.681196 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican-worker-cb847bf9c-87m9r" Mar 16 17:39:12 crc kubenswrapper[5120]: I0316 17:39:12.692642 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2zwv\" (UniqueName: \"kubernetes.io/projected/d612c818-7a65-4f59-8908-fce1d295996b-kube-api-access-l2zwv\") pod \"barbican-keystone-listener-9c667c454-mwz98\" (UID: \"d612c818-7a65-4f59-8908-fce1d295996b\") " pod="barbican-kuttl-tests/barbican-keystone-listener-9c667c454-mwz98" Mar 16 17:39:12 crc kubenswrapper[5120]: I0316 17:39:12.772002 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican-keystone-listener-9c667c454-mwz98" Mar 16 17:39:12 crc kubenswrapper[5120]: I0316 17:39:12.775968 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/443927da-114a-4656-9e75-0c2899a881c9-logs\") pod \"barbican-api-6fc6fbdfcd-6zspr\" (UID: \"443927da-114a-4656-9e75-0c2899a881c9\") " pod="barbican-kuttl-tests/barbican-api-6fc6fbdfcd-6zspr" Mar 16 17:39:12 crc kubenswrapper[5120]: I0316 17:39:12.776209 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/443927da-114a-4656-9e75-0c2899a881c9-config-data-custom\") pod \"barbican-api-6fc6fbdfcd-6zspr\" (UID: \"443927da-114a-4656-9e75-0c2899a881c9\") " pod="barbican-kuttl-tests/barbican-api-6fc6fbdfcd-6zspr" Mar 16 17:39:12 crc kubenswrapper[5120]: I0316 17:39:12.776260 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/443927da-114a-4656-9e75-0c2899a881c9-config-data\") pod \"barbican-api-6fc6fbdfcd-6zspr\" (UID: \"443927da-114a-4656-9e75-0c2899a881c9\") " pod="barbican-kuttl-tests/barbican-api-6fc6fbdfcd-6zspr" Mar 16 17:39:12 crc kubenswrapper[5120]: I0316 17:39:12.776288 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-htqhb\" (UniqueName: \"kubernetes.io/projected/443927da-114a-4656-9e75-0c2899a881c9-kube-api-access-htqhb\") pod \"barbican-api-6fc6fbdfcd-6zspr\" (UID: \"443927da-114a-4656-9e75-0c2899a881c9\") " pod="barbican-kuttl-tests/barbican-api-6fc6fbdfcd-6zspr" Mar 16 17:39:12 crc kubenswrapper[5120]: I0316 17:39:12.777412 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/443927da-114a-4656-9e75-0c2899a881c9-logs\") pod \"barbican-api-6fc6fbdfcd-6zspr\" (UID: \"443927da-114a-4656-9e75-0c2899a881c9\") " pod="barbican-kuttl-tests/barbican-api-6fc6fbdfcd-6zspr" Mar 16 17:39:12 crc kubenswrapper[5120]: I0316 17:39:12.782517 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/443927da-114a-4656-9e75-0c2899a881c9-config-data-custom\") pod \"barbican-api-6fc6fbdfcd-6zspr\" (UID: \"443927da-114a-4656-9e75-0c2899a881c9\") " pod="barbican-kuttl-tests/barbican-api-6fc6fbdfcd-6zspr" Mar 16 17:39:12 crc kubenswrapper[5120]: I0316 17:39:12.786121 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/443927da-114a-4656-9e75-0c2899a881c9-config-data\") pod \"barbican-api-6fc6fbdfcd-6zspr\" (UID: \"443927da-114a-4656-9e75-0c2899a881c9\") " pod="barbican-kuttl-tests/barbican-api-6fc6fbdfcd-6zspr" Mar 16 17:39:12 crc kubenswrapper[5120]: I0316 17:39:12.835690 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-htqhb\" (UniqueName: \"kubernetes.io/projected/443927da-114a-4656-9e75-0c2899a881c9-kube-api-access-htqhb\") pod \"barbican-api-6fc6fbdfcd-6zspr\" (UID: \"443927da-114a-4656-9e75-0c2899a881c9\") " pod="barbican-kuttl-tests/barbican-api-6fc6fbdfcd-6zspr" Mar 16 17:39:12 crc kubenswrapper[5120]: I0316 17:39:12.870648 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican-api-6fc6fbdfcd-6zspr" Mar 16 17:39:13 crc kubenswrapper[5120]: I0316 17:39:13.117397 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["barbican-kuttl-tests/barbican-api-6fc6fbdfcd-8c2q8"] Mar 16 17:39:13 crc kubenswrapper[5120]: I0316 17:39:13.126539 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican-api-6fc6fbdfcd-8c2q8" Mar 16 17:39:13 crc kubenswrapper[5120]: I0316 17:39:13.134818 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["barbican-kuttl-tests/barbican-api-6fc6fbdfcd-8c2q8"] Mar 16 17:39:13 crc kubenswrapper[5120]: I0316 17:39:13.196579 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["barbican-kuttl-tests/barbican-worker-cb847bf9c-87m9r"] Mar 16 17:39:13 crc kubenswrapper[5120]: I0316 17:39:13.288765 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdggx\" (UniqueName: \"kubernetes.io/projected/f0f0e277-d818-4974-b331-03487ca8c544-kube-api-access-hdggx\") pod \"barbican-api-6fc6fbdfcd-8c2q8\" (UID: \"f0f0e277-d818-4974-b331-03487ca8c544\") " pod="barbican-kuttl-tests/barbican-api-6fc6fbdfcd-8c2q8" Mar 16 17:39:13 crc kubenswrapper[5120]: I0316 17:39:13.288923 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/f0f0e277-d818-4974-b331-03487ca8c544-config-data-custom\") pod \"barbican-api-6fc6fbdfcd-8c2q8\" (UID: \"f0f0e277-d818-4974-b331-03487ca8c544\") " pod="barbican-kuttl-tests/barbican-api-6fc6fbdfcd-8c2q8" Mar 16 17:39:13 crc kubenswrapper[5120]: I0316 17:39:13.289431 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f0f0e277-d818-4974-b331-03487ca8c544-logs\") pod \"barbican-api-6fc6fbdfcd-8c2q8\" (UID: \"f0f0e277-d818-4974-b331-03487ca8c544\") " pod="barbican-kuttl-tests/barbican-api-6fc6fbdfcd-8c2q8" Mar 16 17:39:13 crc kubenswrapper[5120]: I0316 17:39:13.289554 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f0f0e277-d818-4974-b331-03487ca8c544-config-data\") pod \"barbican-api-6fc6fbdfcd-8c2q8\" (UID: \"f0f0e277-d818-4974-b331-03487ca8c544\") " pod="barbican-kuttl-tests/barbican-api-6fc6fbdfcd-8c2q8" Mar 16 17:39:13 crc kubenswrapper[5120]: I0316 17:39:13.302335 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["barbican-kuttl-tests/barbican-keystone-listener-9c667c454-mwz98"] Mar 16 17:39:13 crc kubenswrapper[5120]: I0316 17:39:13.319804 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["barbican-kuttl-tests/barbican-keystone-listener-9c667c454-4k45s"] Mar 16 17:39:13 crc kubenswrapper[5120]: I0316 17:39:13.327644 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican-keystone-listener-9c667c454-4k45s" Mar 16 17:39:13 crc kubenswrapper[5120]: I0316 17:39:13.328738 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["barbican-kuttl-tests/barbican-keystone-listener-9c667c454-4k45s"] Mar 16 17:39:13 crc kubenswrapper[5120]: I0316 17:39:13.389491 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["barbican-kuttl-tests/barbican-api-6fc6fbdfcd-6zspr"] Mar 16 17:39:13 crc kubenswrapper[5120]: I0316 17:39:13.391696 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f0f0e277-d818-4974-b331-03487ca8c544-logs\") pod \"barbican-api-6fc6fbdfcd-8c2q8\" (UID: \"f0f0e277-d818-4974-b331-03487ca8c544\") " pod="barbican-kuttl-tests/barbican-api-6fc6fbdfcd-8c2q8" Mar 16 17:39:13 crc kubenswrapper[5120]: I0316 17:39:13.391857 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f0f0e277-d818-4974-b331-03487ca8c544-config-data\") pod \"barbican-api-6fc6fbdfcd-8c2q8\" (UID: \"f0f0e277-d818-4974-b331-03487ca8c544\") " pod="barbican-kuttl-tests/barbican-api-6fc6fbdfcd-8c2q8" Mar 16 17:39:13 crc kubenswrapper[5120]: I0316 17:39:13.391979 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hdggx\" (UniqueName: \"kubernetes.io/projected/f0f0e277-d818-4974-b331-03487ca8c544-kube-api-access-hdggx\") pod \"barbican-api-6fc6fbdfcd-8c2q8\" (UID: \"f0f0e277-d818-4974-b331-03487ca8c544\") " pod="barbican-kuttl-tests/barbican-api-6fc6fbdfcd-8c2q8" Mar 16 17:39:13 crc kubenswrapper[5120]: I0316 17:39:13.392019 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/f0f0e277-d818-4974-b331-03487ca8c544-config-data-custom\") pod \"barbican-api-6fc6fbdfcd-8c2q8\" (UID: \"f0f0e277-d818-4974-b331-03487ca8c544\") " pod="barbican-kuttl-tests/barbican-api-6fc6fbdfcd-8c2q8" Mar 16 17:39:13 crc kubenswrapper[5120]: I0316 17:39:13.392181 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f0f0e277-d818-4974-b331-03487ca8c544-logs\") pod \"barbican-api-6fc6fbdfcd-8c2q8\" (UID: \"f0f0e277-d818-4974-b331-03487ca8c544\") " pod="barbican-kuttl-tests/barbican-api-6fc6fbdfcd-8c2q8" Mar 16 17:39:13 crc kubenswrapper[5120]: I0316 17:39:13.397927 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/f0f0e277-d818-4974-b331-03487ca8c544-config-data-custom\") pod \"barbican-api-6fc6fbdfcd-8c2q8\" (UID: \"f0f0e277-d818-4974-b331-03487ca8c544\") " pod="barbican-kuttl-tests/barbican-api-6fc6fbdfcd-8c2q8" Mar 16 17:39:13 crc kubenswrapper[5120]: I0316 17:39:13.400716 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f0f0e277-d818-4974-b331-03487ca8c544-config-data\") pod \"barbican-api-6fc6fbdfcd-8c2q8\" (UID: \"f0f0e277-d818-4974-b331-03487ca8c544\") " pod="barbican-kuttl-tests/barbican-api-6fc6fbdfcd-8c2q8" Mar 16 17:39:13 crc kubenswrapper[5120]: I0316 17:39:13.413829 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdggx\" (UniqueName: \"kubernetes.io/projected/f0f0e277-d818-4974-b331-03487ca8c544-kube-api-access-hdggx\") pod \"barbican-api-6fc6fbdfcd-8c2q8\" (UID: \"f0f0e277-d818-4974-b331-03487ca8c544\") " pod="barbican-kuttl-tests/barbican-api-6fc6fbdfcd-8c2q8" Mar 16 17:39:13 crc kubenswrapper[5120]: I0316 17:39:13.427748 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["barbican-kuttl-tests/barbican-worker-cb847bf9c-fzjrt"] Mar 16 17:39:13 crc kubenswrapper[5120]: I0316 17:39:13.436844 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican-worker-cb847bf9c-fzjrt" Mar 16 17:39:13 crc kubenswrapper[5120]: I0316 17:39:13.451256 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican-api-6fc6fbdfcd-8c2q8" Mar 16 17:39:13 crc kubenswrapper[5120]: I0316 17:39:13.457850 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["barbican-kuttl-tests/barbican-worker-cb847bf9c-fzjrt"] Mar 16 17:39:13 crc kubenswrapper[5120]: I0316 17:39:13.474439 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-worker-cb847bf9c-87m9r" event={"ID":"7f66fc8b-a4b9-42f4-923a-f0f2562b14b5","Type":"ContainerStarted","Data":"467ef5d1612537dd770728aaef544d634dab92b7951bade2a12a7ab13cb6022c"} Mar 16 17:39:13 crc kubenswrapper[5120]: I0316 17:39:13.475877 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-api-6fc6fbdfcd-6zspr" event={"ID":"443927da-114a-4656-9e75-0c2899a881c9","Type":"ContainerStarted","Data":"c8159530502c62cdf49cde2f941979b0dfda8adf3331e9f5820b522d42fbbe18"} Mar 16 17:39:13 crc kubenswrapper[5120]: I0316 17:39:13.477473 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-keystone-listener-9c667c454-mwz98" event={"ID":"d612c818-7a65-4f59-8908-fce1d295996b","Type":"ContainerStarted","Data":"49dd8fca136cc3c879f3ddf409965b130bc55f2812ae7b099bc27883525445a7"} Mar 16 17:39:13 crc kubenswrapper[5120]: I0316 17:39:13.493935 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7bad27ae-2338-4a16-aba5-f813bbcd01b5-config-data\") pod \"barbican-keystone-listener-9c667c454-4k45s\" (UID: \"7bad27ae-2338-4a16-aba5-f813bbcd01b5\") " pod="barbican-kuttl-tests/barbican-keystone-listener-9c667c454-4k45s" Mar 16 17:39:13 crc kubenswrapper[5120]: I0316 17:39:13.494051 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/7bad27ae-2338-4a16-aba5-f813bbcd01b5-config-data-custom\") pod \"barbican-keystone-listener-9c667c454-4k45s\" (UID: \"7bad27ae-2338-4a16-aba5-f813bbcd01b5\") " pod="barbican-kuttl-tests/barbican-keystone-listener-9c667c454-4k45s" Mar 16 17:39:13 crc kubenswrapper[5120]: I0316 17:39:13.494331 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7bad27ae-2338-4a16-aba5-f813bbcd01b5-logs\") pod \"barbican-keystone-listener-9c667c454-4k45s\" (UID: \"7bad27ae-2338-4a16-aba5-f813bbcd01b5\") " pod="barbican-kuttl-tests/barbican-keystone-listener-9c667c454-4k45s" Mar 16 17:39:13 crc kubenswrapper[5120]: I0316 17:39:13.494404 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c75x6\" (UniqueName: \"kubernetes.io/projected/7bad27ae-2338-4a16-aba5-f813bbcd01b5-kube-api-access-c75x6\") pod \"barbican-keystone-listener-9c667c454-4k45s\" (UID: \"7bad27ae-2338-4a16-aba5-f813bbcd01b5\") " pod="barbican-kuttl-tests/barbican-keystone-listener-9c667c454-4k45s" Mar 16 17:39:13 crc kubenswrapper[5120]: I0316 17:39:13.596138 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4a00c03b-f82b-4b11-abfc-0ef8fb34dc9c-logs\") pod \"barbican-worker-cb847bf9c-fzjrt\" (UID: \"4a00c03b-f82b-4b11-abfc-0ef8fb34dc9c\") " pod="barbican-kuttl-tests/barbican-worker-cb847bf9c-fzjrt" Mar 16 17:39:13 crc kubenswrapper[5120]: I0316 17:39:13.596490 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7bad27ae-2338-4a16-aba5-f813bbcd01b5-logs\") pod \"barbican-keystone-listener-9c667c454-4k45s\" (UID: \"7bad27ae-2338-4a16-aba5-f813bbcd01b5\") " pod="barbican-kuttl-tests/barbican-keystone-listener-9c667c454-4k45s" Mar 16 17:39:13 crc kubenswrapper[5120]: I0316 17:39:13.596529 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c75x6\" (UniqueName: \"kubernetes.io/projected/7bad27ae-2338-4a16-aba5-f813bbcd01b5-kube-api-access-c75x6\") pod \"barbican-keystone-listener-9c667c454-4k45s\" (UID: \"7bad27ae-2338-4a16-aba5-f813bbcd01b5\") " pod="barbican-kuttl-tests/barbican-keystone-listener-9c667c454-4k45s" Mar 16 17:39:13 crc kubenswrapper[5120]: I0316 17:39:13.596591 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xchnk\" (UniqueName: \"kubernetes.io/projected/4a00c03b-f82b-4b11-abfc-0ef8fb34dc9c-kube-api-access-xchnk\") pod \"barbican-worker-cb847bf9c-fzjrt\" (UID: \"4a00c03b-f82b-4b11-abfc-0ef8fb34dc9c\") " pod="barbican-kuttl-tests/barbican-worker-cb847bf9c-fzjrt" Mar 16 17:39:13 crc kubenswrapper[5120]: I0316 17:39:13.596665 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7bad27ae-2338-4a16-aba5-f813bbcd01b5-config-data\") pod \"barbican-keystone-listener-9c667c454-4k45s\" (UID: \"7bad27ae-2338-4a16-aba5-f813bbcd01b5\") " pod="barbican-kuttl-tests/barbican-keystone-listener-9c667c454-4k45s" Mar 16 17:39:13 crc kubenswrapper[5120]: I0316 17:39:13.596706 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4a00c03b-f82b-4b11-abfc-0ef8fb34dc9c-config-data\") pod \"barbican-worker-cb847bf9c-fzjrt\" (UID: \"4a00c03b-f82b-4b11-abfc-0ef8fb34dc9c\") " pod="barbican-kuttl-tests/barbican-worker-cb847bf9c-fzjrt" Mar 16 17:39:13 crc kubenswrapper[5120]: I0316 17:39:13.596735 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/7bad27ae-2338-4a16-aba5-f813bbcd01b5-config-data-custom\") pod \"barbican-keystone-listener-9c667c454-4k45s\" (UID: \"7bad27ae-2338-4a16-aba5-f813bbcd01b5\") " pod="barbican-kuttl-tests/barbican-keystone-listener-9c667c454-4k45s" Mar 16 17:39:13 crc kubenswrapper[5120]: I0316 17:39:13.596820 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/4a00c03b-f82b-4b11-abfc-0ef8fb34dc9c-config-data-custom\") pod \"barbican-worker-cb847bf9c-fzjrt\" (UID: \"4a00c03b-f82b-4b11-abfc-0ef8fb34dc9c\") " pod="barbican-kuttl-tests/barbican-worker-cb847bf9c-fzjrt" Mar 16 17:39:13 crc kubenswrapper[5120]: I0316 17:39:13.597366 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7bad27ae-2338-4a16-aba5-f813bbcd01b5-logs\") pod \"barbican-keystone-listener-9c667c454-4k45s\" (UID: \"7bad27ae-2338-4a16-aba5-f813bbcd01b5\") " pod="barbican-kuttl-tests/barbican-keystone-listener-9c667c454-4k45s" Mar 16 17:39:13 crc kubenswrapper[5120]: I0316 17:39:13.602208 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/7bad27ae-2338-4a16-aba5-f813bbcd01b5-config-data-custom\") pod \"barbican-keystone-listener-9c667c454-4k45s\" (UID: \"7bad27ae-2338-4a16-aba5-f813bbcd01b5\") " pod="barbican-kuttl-tests/barbican-keystone-listener-9c667c454-4k45s" Mar 16 17:39:13 crc kubenswrapper[5120]: I0316 17:39:13.607630 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7bad27ae-2338-4a16-aba5-f813bbcd01b5-config-data\") pod \"barbican-keystone-listener-9c667c454-4k45s\" (UID: \"7bad27ae-2338-4a16-aba5-f813bbcd01b5\") " pod="barbican-kuttl-tests/barbican-keystone-listener-9c667c454-4k45s" Mar 16 17:39:13 crc kubenswrapper[5120]: I0316 17:39:13.629346 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c75x6\" (UniqueName: \"kubernetes.io/projected/7bad27ae-2338-4a16-aba5-f813bbcd01b5-kube-api-access-c75x6\") pod \"barbican-keystone-listener-9c667c454-4k45s\" (UID: \"7bad27ae-2338-4a16-aba5-f813bbcd01b5\") " pod="barbican-kuttl-tests/barbican-keystone-listener-9c667c454-4k45s" Mar 16 17:39:13 crc kubenswrapper[5120]: I0316 17:39:13.649629 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican-keystone-listener-9c667c454-4k45s" Mar 16 17:39:13 crc kubenswrapper[5120]: I0316 17:39:13.699216 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/4a00c03b-f82b-4b11-abfc-0ef8fb34dc9c-config-data-custom\") pod \"barbican-worker-cb847bf9c-fzjrt\" (UID: \"4a00c03b-f82b-4b11-abfc-0ef8fb34dc9c\") " pod="barbican-kuttl-tests/barbican-worker-cb847bf9c-fzjrt" Mar 16 17:39:13 crc kubenswrapper[5120]: I0316 17:39:13.699389 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4a00c03b-f82b-4b11-abfc-0ef8fb34dc9c-logs\") pod \"barbican-worker-cb847bf9c-fzjrt\" (UID: \"4a00c03b-f82b-4b11-abfc-0ef8fb34dc9c\") " pod="barbican-kuttl-tests/barbican-worker-cb847bf9c-fzjrt" Mar 16 17:39:13 crc kubenswrapper[5120]: I0316 17:39:13.700049 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4a00c03b-f82b-4b11-abfc-0ef8fb34dc9c-logs\") pod \"barbican-worker-cb847bf9c-fzjrt\" (UID: \"4a00c03b-f82b-4b11-abfc-0ef8fb34dc9c\") " pod="barbican-kuttl-tests/barbican-worker-cb847bf9c-fzjrt" Mar 16 17:39:13 crc kubenswrapper[5120]: I0316 17:39:13.700311 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xchnk\" (UniqueName: \"kubernetes.io/projected/4a00c03b-f82b-4b11-abfc-0ef8fb34dc9c-kube-api-access-xchnk\") pod \"barbican-worker-cb847bf9c-fzjrt\" (UID: \"4a00c03b-f82b-4b11-abfc-0ef8fb34dc9c\") " pod="barbican-kuttl-tests/barbican-worker-cb847bf9c-fzjrt" Mar 16 17:39:13 crc kubenswrapper[5120]: I0316 17:39:13.704076 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4a00c03b-f82b-4b11-abfc-0ef8fb34dc9c-config-data\") pod \"barbican-worker-cb847bf9c-fzjrt\" (UID: \"4a00c03b-f82b-4b11-abfc-0ef8fb34dc9c\") " pod="barbican-kuttl-tests/barbican-worker-cb847bf9c-fzjrt" Mar 16 17:39:13 crc kubenswrapper[5120]: I0316 17:39:13.710729 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/4a00c03b-f82b-4b11-abfc-0ef8fb34dc9c-config-data-custom\") pod \"barbican-worker-cb847bf9c-fzjrt\" (UID: \"4a00c03b-f82b-4b11-abfc-0ef8fb34dc9c\") " pod="barbican-kuttl-tests/barbican-worker-cb847bf9c-fzjrt" Mar 16 17:39:13 crc kubenswrapper[5120]: I0316 17:39:13.718900 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xchnk\" (UniqueName: \"kubernetes.io/projected/4a00c03b-f82b-4b11-abfc-0ef8fb34dc9c-kube-api-access-xchnk\") pod \"barbican-worker-cb847bf9c-fzjrt\" (UID: \"4a00c03b-f82b-4b11-abfc-0ef8fb34dc9c\") " pod="barbican-kuttl-tests/barbican-worker-cb847bf9c-fzjrt" Mar 16 17:39:13 crc kubenswrapper[5120]: I0316 17:39:13.720402 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4a00c03b-f82b-4b11-abfc-0ef8fb34dc9c-config-data\") pod \"barbican-worker-cb847bf9c-fzjrt\" (UID: \"4a00c03b-f82b-4b11-abfc-0ef8fb34dc9c\") " pod="barbican-kuttl-tests/barbican-worker-cb847bf9c-fzjrt" Mar 16 17:39:13 crc kubenswrapper[5120]: I0316 17:39:13.761081 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican-worker-cb847bf9c-fzjrt" Mar 16 17:39:13 crc kubenswrapper[5120]: I0316 17:39:13.942790 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["barbican-kuttl-tests/barbican-api-6fc6fbdfcd-8c2q8"] Mar 16 17:39:13 crc kubenswrapper[5120]: W0316 17:39:13.962290 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf0f0e277_d818_4974_b331_03487ca8c544.slice/crio-b9042dc459e03a66eed5c1020d15a2ee6692ebde8fa36eac8ca3a9443e8e261f WatchSource:0}: Error finding container b9042dc459e03a66eed5c1020d15a2ee6692ebde8fa36eac8ca3a9443e8e261f: Status 404 returned error can't find the container with id b9042dc459e03a66eed5c1020d15a2ee6692ebde8fa36eac8ca3a9443e8e261f Mar 16 17:39:14 crc kubenswrapper[5120]: I0316 17:39:14.118055 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["barbican-kuttl-tests/barbican-keystone-listener-9c667c454-4k45s"] Mar 16 17:39:14 crc kubenswrapper[5120]: W0316 17:39:14.128677 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7bad27ae_2338_4a16_aba5_f813bbcd01b5.slice/crio-257042cb32eb32131ce8a503d33f571a7766cce3b5fed2165e66583d7234d9e1 WatchSource:0}: Error finding container 257042cb32eb32131ce8a503d33f571a7766cce3b5fed2165e66583d7234d9e1: Status 404 returned error can't find the container with id 257042cb32eb32131ce8a503d33f571a7766cce3b5fed2165e66583d7234d9e1 Mar 16 17:39:14 crc kubenswrapper[5120]: I0316 17:39:14.267010 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["barbican-kuttl-tests/barbican-worker-cb847bf9c-fzjrt"] Mar 16 17:39:14 crc kubenswrapper[5120]: I0316 17:39:14.492933 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-api-6fc6fbdfcd-8c2q8" event={"ID":"f0f0e277-d818-4974-b331-03487ca8c544","Type":"ContainerStarted","Data":"01e5848acf0b4d61112ff33e2e4daf0fe5ba16878ad25e7fe4f6e684995a7bc9"} Mar 16 17:39:14 crc kubenswrapper[5120]: I0316 17:39:14.493859 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-api-6fc6fbdfcd-8c2q8" event={"ID":"f0f0e277-d818-4974-b331-03487ca8c544","Type":"ContainerStarted","Data":"ff8f2b86ab311d1e2a20fe7fdcaa273d1f63970cacd2c4c9cfff0f8665e303d0"} Mar 16 17:39:14 crc kubenswrapper[5120]: I0316 17:39:14.493882 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-api-6fc6fbdfcd-8c2q8" event={"ID":"f0f0e277-d818-4974-b331-03487ca8c544","Type":"ContainerStarted","Data":"b9042dc459e03a66eed5c1020d15a2ee6692ebde8fa36eac8ca3a9443e8e261f"} Mar 16 17:39:14 crc kubenswrapper[5120]: I0316 17:39:14.494386 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="barbican-kuttl-tests/barbican-api-6fc6fbdfcd-8c2q8" Mar 16 17:39:14 crc kubenswrapper[5120]: I0316 17:39:14.494402 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="barbican-kuttl-tests/barbican-api-6fc6fbdfcd-8c2q8" Mar 16 17:39:14 crc kubenswrapper[5120]: I0316 17:39:14.495632 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-keystone-listener-9c667c454-mwz98" event={"ID":"d612c818-7a65-4f59-8908-fce1d295996b","Type":"ContainerStarted","Data":"9b4899d3bb35e17dfb9a6276a51ce9805c142351651eb510b7cedf2166850431"} Mar 16 17:39:14 crc kubenswrapper[5120]: I0316 17:39:14.495663 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-keystone-listener-9c667c454-mwz98" event={"ID":"d612c818-7a65-4f59-8908-fce1d295996b","Type":"ContainerStarted","Data":"c2a5283c97192761d79f744fc1dfc5d471d1e8c5b6aa1953bfac4aefd3bf9aa3"} Mar 16 17:39:14 crc kubenswrapper[5120]: I0316 17:39:14.500665 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-worker-cb847bf9c-87m9r" event={"ID":"7f66fc8b-a4b9-42f4-923a-f0f2562b14b5","Type":"ContainerStarted","Data":"be55f846b6a66d6d6fd9407055b9b9d626cd98ac2d8b08d222f1d2085606121e"} Mar 16 17:39:14 crc kubenswrapper[5120]: I0316 17:39:14.500712 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-worker-cb847bf9c-87m9r" event={"ID":"7f66fc8b-a4b9-42f4-923a-f0f2562b14b5","Type":"ContainerStarted","Data":"6eb480efd56e68b47e99f6f6fea823e13043dddf2074c51c5e971292af19680e"} Mar 16 17:39:14 crc kubenswrapper[5120]: I0316 17:39:14.506929 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-keystone-listener-9c667c454-4k45s" event={"ID":"7bad27ae-2338-4a16-aba5-f813bbcd01b5","Type":"ContainerStarted","Data":"cecf8a5e736484634164124bf13492f5d8b5b58c5456b3667bc491ff5b3d02c2"} Mar 16 17:39:14 crc kubenswrapper[5120]: I0316 17:39:14.506982 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-keystone-listener-9c667c454-4k45s" event={"ID":"7bad27ae-2338-4a16-aba5-f813bbcd01b5","Type":"ContainerStarted","Data":"4ddd7d4cd3d34eaf22b010b199283fe291c89fe489eabedc4494125e00aba5df"} Mar 16 17:39:14 crc kubenswrapper[5120]: I0316 17:39:14.506996 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-keystone-listener-9c667c454-4k45s" event={"ID":"7bad27ae-2338-4a16-aba5-f813bbcd01b5","Type":"ContainerStarted","Data":"257042cb32eb32131ce8a503d33f571a7766cce3b5fed2165e66583d7234d9e1"} Mar 16 17:39:14 crc kubenswrapper[5120]: I0316 17:39:14.516792 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="barbican-kuttl-tests/barbican-api-6fc6fbdfcd-8c2q8" podStartSLOduration=1.51673437 podStartE2EDuration="1.51673437s" podCreationTimestamp="2026-03-16 17:39:13 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:39:14.514856018 +0000 UTC m=+7656.668787685" watchObservedRunningTime="2026-03-16 17:39:14.51673437 +0000 UTC m=+7656.670666027" Mar 16 17:39:14 crc kubenswrapper[5120]: I0316 17:39:14.520707 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-api-6fc6fbdfcd-6zspr" event={"ID":"443927da-114a-4656-9e75-0c2899a881c9","Type":"ContainerStarted","Data":"58e23239575e7911b272670edaf01701e2d2833c76edb4d2ca29e52b015428c0"} Mar 16 17:39:14 crc kubenswrapper[5120]: I0316 17:39:14.522301 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-api-6fc6fbdfcd-6zspr" event={"ID":"443927da-114a-4656-9e75-0c2899a881c9","Type":"ContainerStarted","Data":"8bd7151fc6d83565be6b5800d6af29ee46b835e1cf009e799846fc0dfbf53463"} Mar 16 17:39:14 crc kubenswrapper[5120]: I0316 17:39:14.529657 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-worker-cb847bf9c-fzjrt" event={"ID":"4a00c03b-f82b-4b11-abfc-0ef8fb34dc9c","Type":"ContainerStarted","Data":"f40de55e79bdd953805a60983f7f853e2e368eb79fd9463194551a1f1ef156ad"} Mar 16 17:39:14 crc kubenswrapper[5120]: I0316 17:39:14.563337 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="barbican-kuttl-tests/barbican-keystone-listener-9c667c454-mwz98" podStartSLOduration=1.8759792910000002 podStartE2EDuration="2.563309902s" podCreationTimestamp="2026-03-16 17:39:12 +0000 UTC" firstStartedPulling="2026-03-16 17:39:13.307894656 +0000 UTC m=+7655.461826313" lastFinishedPulling="2026-03-16 17:39:13.995225257 +0000 UTC m=+7656.149156924" observedRunningTime="2026-03-16 17:39:14.535201094 +0000 UTC m=+7656.689132761" watchObservedRunningTime="2026-03-16 17:39:14.563309902 +0000 UTC m=+7656.717241559" Mar 16 17:39:14 crc kubenswrapper[5120]: I0316 17:39:14.564789 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="barbican-kuttl-tests/barbican-keystone-listener-9c667c454-4k45s" podStartSLOduration=1.564776942 podStartE2EDuration="1.564776942s" podCreationTimestamp="2026-03-16 17:39:13 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:39:14.556444774 +0000 UTC m=+7656.710376431" watchObservedRunningTime="2026-03-16 17:39:14.564776942 +0000 UTC m=+7656.718708609" Mar 16 17:39:14 crc kubenswrapper[5120]: I0316 17:39:14.602431 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="barbican-kuttl-tests/barbican-worker-cb847bf9c-87m9r" podStartSLOduration=2.056825109 podStartE2EDuration="2.60241049s" podCreationTimestamp="2026-03-16 17:39:12 +0000 UTC" firstStartedPulling="2026-03-16 17:39:13.194470218 +0000 UTC m=+7655.348401875" lastFinishedPulling="2026-03-16 17:39:13.740055599 +0000 UTC m=+7655.893987256" observedRunningTime="2026-03-16 17:39:14.57460948 +0000 UTC m=+7656.728541147" watchObservedRunningTime="2026-03-16 17:39:14.60241049 +0000 UTC m=+7656.756342147" Mar 16 17:39:14 crc kubenswrapper[5120]: I0316 17:39:14.612346 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="barbican-kuttl-tests/barbican-api-6fc6fbdfcd-6zspr" podStartSLOduration=2.612330171 podStartE2EDuration="2.612330171s" podCreationTimestamp="2026-03-16 17:39:12 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:39:14.592446648 +0000 UTC m=+7656.746378305" watchObservedRunningTime="2026-03-16 17:39:14.612330171 +0000 UTC m=+7656.766261828" Mar 16 17:39:14 crc kubenswrapper[5120]: I0316 17:39:14.642521 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["barbican-kuttl-tests/barbican-api-6fc6fbdfcd-8c2q8"] Mar 16 17:39:14 crc kubenswrapper[5120]: I0316 17:39:14.797706 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["barbican-kuttl-tests/barbican-keystone-listener-9c667c454-4k45s"] Mar 16 17:39:15 crc kubenswrapper[5120]: I0316 17:39:15.013102 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["barbican-kuttl-tests/barbican-worker-cb847bf9c-fzjrt"] Mar 16 17:39:15 crc kubenswrapper[5120]: I0316 17:39:15.540468 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-worker-cb847bf9c-fzjrt" event={"ID":"4a00c03b-f82b-4b11-abfc-0ef8fb34dc9c","Type":"ContainerStarted","Data":"0641caf1b1077f937e7c248dc342cbb36559cb23c18ca20651dee6a9288084ca"} Mar 16 17:39:15 crc kubenswrapper[5120]: I0316 17:39:15.540518 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-worker-cb847bf9c-fzjrt" event={"ID":"4a00c03b-f82b-4b11-abfc-0ef8fb34dc9c","Type":"ContainerStarted","Data":"9a425f430419ee229962058115836e299260c47f6c783b3e50d240d878062e66"} Mar 16 17:39:15 crc kubenswrapper[5120]: I0316 17:39:15.540952 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="barbican-kuttl-tests/barbican-api-6fc6fbdfcd-6zspr" Mar 16 17:39:15 crc kubenswrapper[5120]: I0316 17:39:15.540989 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="barbican-kuttl-tests/barbican-api-6fc6fbdfcd-6zspr" Mar 16 17:39:16 crc kubenswrapper[5120]: I0316 17:39:16.136691 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="barbican-kuttl-tests/barbican-worker-cb847bf9c-fzjrt" podStartSLOduration=3.13666868 podStartE2EDuration="3.13666868s" podCreationTimestamp="2026-03-16 17:39:13 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:39:15.563150137 +0000 UTC m=+7657.717081794" watchObservedRunningTime="2026-03-16 17:39:16.13666868 +0000 UTC m=+7658.290600337" Mar 16 17:39:16 crc kubenswrapper[5120]: I0316 17:39:16.141497 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["barbican-kuttl-tests/barbican-api-6fc6fbdfcd-6zspr"] Mar 16 17:39:16 crc kubenswrapper[5120]: I0316 17:39:16.339558 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["barbican-kuttl-tests/barbican-keystone-listener-9c667c454-mwz98"] Mar 16 17:39:16 crc kubenswrapper[5120]: I0316 17:39:16.531034 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["barbican-kuttl-tests/barbican-worker-cb847bf9c-87m9r"] Mar 16 17:39:16 crc kubenswrapper[5120]: I0316 17:39:16.547458 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="barbican-kuttl-tests/barbican-worker-cb847bf9c-87m9r" podUID="7f66fc8b-a4b9-42f4-923a-f0f2562b14b5" containerName="barbican-worker-log" containerID="cri-o://6eb480efd56e68b47e99f6f6fea823e13043dddf2074c51c5e971292af19680e" gracePeriod=30 Mar 16 17:39:16 crc kubenswrapper[5120]: I0316 17:39:16.547729 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="barbican-kuttl-tests/barbican-keystone-listener-9c667c454-mwz98" podUID="d612c818-7a65-4f59-8908-fce1d295996b" containerName="barbican-keystone-listener-log" containerID="cri-o://c2a5283c97192761d79f744fc1dfc5d471d1e8c5b6aa1953bfac4aefd3bf9aa3" gracePeriod=30 Mar 16 17:39:16 crc kubenswrapper[5120]: I0316 17:39:16.547840 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="barbican-kuttl-tests/barbican-worker-cb847bf9c-87m9r" podUID="7f66fc8b-a4b9-42f4-923a-f0f2562b14b5" containerName="barbican-worker" containerID="cri-o://be55f846b6a66d6d6fd9407055b9b9d626cd98ac2d8b08d222f1d2085606121e" gracePeriod=30 Mar 16 17:39:16 crc kubenswrapper[5120]: I0316 17:39:16.548176 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="barbican-kuttl-tests/barbican-keystone-listener-9c667c454-mwz98" podUID="d612c818-7a65-4f59-8908-fce1d295996b" containerName="barbican-keystone-listener" containerID="cri-o://9b4899d3bb35e17dfb9a6276a51ce9805c142351651eb510b7cedf2166850431" gracePeriod=30 Mar 16 17:39:16 crc kubenswrapper[5120]: I0316 17:39:16.548191 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="barbican-kuttl-tests/barbican-worker-cb847bf9c-fzjrt" podUID="4a00c03b-f82b-4b11-abfc-0ef8fb34dc9c" containerName="barbican-worker-log" containerID="cri-o://0641caf1b1077f937e7c248dc342cbb36559cb23c18ca20651dee6a9288084ca" gracePeriod=30 Mar 16 17:39:16 crc kubenswrapper[5120]: I0316 17:39:16.548280 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="barbican-kuttl-tests/barbican-worker-cb847bf9c-fzjrt" podUID="4a00c03b-f82b-4b11-abfc-0ef8fb34dc9c" containerName="barbican-worker" containerID="cri-o://9a425f430419ee229962058115836e299260c47f6c783b3e50d240d878062e66" gracePeriod=30 Mar 16 17:39:16 crc kubenswrapper[5120]: I0316 17:39:16.548867 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="barbican-kuttl-tests/barbican-api-6fc6fbdfcd-8c2q8" podUID="f0f0e277-d818-4974-b331-03487ca8c544" containerName="barbican-api-log" containerID="cri-o://ff8f2b86ab311d1e2a20fe7fdcaa273d1f63970cacd2c4c9cfff0f8665e303d0" gracePeriod=30 Mar 16 17:39:16 crc kubenswrapper[5120]: I0316 17:39:16.549018 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="barbican-kuttl-tests/barbican-keystone-listener-9c667c454-4k45s" podUID="7bad27ae-2338-4a16-aba5-f813bbcd01b5" containerName="barbican-keystone-listener-log" containerID="cri-o://4ddd7d4cd3d34eaf22b010b199283fe291c89fe489eabedc4494125e00aba5df" gracePeriod=30 Mar 16 17:39:16 crc kubenswrapper[5120]: I0316 17:39:16.549123 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="barbican-kuttl-tests/barbican-keystone-listener-9c667c454-4k45s" podUID="7bad27ae-2338-4a16-aba5-f813bbcd01b5" containerName="barbican-keystone-listener" containerID="cri-o://cecf8a5e736484634164124bf13492f5d8b5b58c5456b3667bc491ff5b3d02c2" gracePeriod=30 Mar 16 17:39:16 crc kubenswrapper[5120]: I0316 17:39:16.549122 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="barbican-kuttl-tests/barbican-api-6fc6fbdfcd-8c2q8" podUID="f0f0e277-d818-4974-b331-03487ca8c544" containerName="barbican-api" containerID="cri-o://01e5848acf0b4d61112ff33e2e4daf0fe5ba16878ad25e7fe4f6e684995a7bc9" gracePeriod=30 Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.156023 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican-api-6fc6fbdfcd-8c2q8" Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.204054 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican-worker-cb847bf9c-87m9r" Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.255902 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f0f0e277-d818-4974-b331-03487ca8c544-logs\") pod \"f0f0e277-d818-4974-b331-03487ca8c544\" (UID: \"f0f0e277-d818-4974-b331-03487ca8c544\") " Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.256237 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c45mx\" (UniqueName: \"kubernetes.io/projected/7f66fc8b-a4b9-42f4-923a-f0f2562b14b5-kube-api-access-c45mx\") pod \"7f66fc8b-a4b9-42f4-923a-f0f2562b14b5\" (UID: \"7f66fc8b-a4b9-42f4-923a-f0f2562b14b5\") " Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.256296 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/7f66fc8b-a4b9-42f4-923a-f0f2562b14b5-config-data-custom\") pod \"7f66fc8b-a4b9-42f4-923a-f0f2562b14b5\" (UID: \"7f66fc8b-a4b9-42f4-923a-f0f2562b14b5\") " Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.256501 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/f0f0e277-d818-4974-b331-03487ca8c544-config-data-custom\") pod \"f0f0e277-d818-4974-b331-03487ca8c544\" (UID: \"f0f0e277-d818-4974-b331-03487ca8c544\") " Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.256593 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f0f0e277-d818-4974-b331-03487ca8c544-config-data\") pod \"f0f0e277-d818-4974-b331-03487ca8c544\" (UID: \"f0f0e277-d818-4974-b331-03487ca8c544\") " Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.256637 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7f66fc8b-a4b9-42f4-923a-f0f2562b14b5-config-data\") pod \"7f66fc8b-a4b9-42f4-923a-f0f2562b14b5\" (UID: \"7f66fc8b-a4b9-42f4-923a-f0f2562b14b5\") " Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.256680 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7f66fc8b-a4b9-42f4-923a-f0f2562b14b5-logs\") pod \"7f66fc8b-a4b9-42f4-923a-f0f2562b14b5\" (UID: \"7f66fc8b-a4b9-42f4-923a-f0f2562b14b5\") " Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.256702 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hdggx\" (UniqueName: \"kubernetes.io/projected/f0f0e277-d818-4974-b331-03487ca8c544-kube-api-access-hdggx\") pod \"f0f0e277-d818-4974-b331-03487ca8c544\" (UID: \"f0f0e277-d818-4974-b331-03487ca8c544\") " Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.257382 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f66fc8b-a4b9-42f4-923a-f0f2562b14b5-logs" (OuterVolumeSpecName: "logs") pod "7f66fc8b-a4b9-42f4-923a-f0f2562b14b5" (UID: "7f66fc8b-a4b9-42f4-923a-f0f2562b14b5"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.258149 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0f0e277-d818-4974-b331-03487ca8c544-logs" (OuterVolumeSpecName: "logs") pod "f0f0e277-d818-4974-b331-03487ca8c544" (UID: "f0f0e277-d818-4974-b331-03487ca8c544"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.258641 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7f66fc8b-a4b9-42f4-923a-f0f2562b14b5-logs\") on node \"crc\" DevicePath \"\"" Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.258660 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f0f0e277-d818-4974-b331-03487ca8c544-logs\") on node \"crc\" DevicePath \"\"" Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.262879 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0f0e277-d818-4974-b331-03487ca8c544-kube-api-access-hdggx" (OuterVolumeSpecName: "kube-api-access-hdggx") pod "f0f0e277-d818-4974-b331-03487ca8c544" (UID: "f0f0e277-d818-4974-b331-03487ca8c544"). InnerVolumeSpecName "kube-api-access-hdggx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.263130 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7f66fc8b-a4b9-42f4-923a-f0f2562b14b5-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "7f66fc8b-a4b9-42f4-923a-f0f2562b14b5" (UID: "7f66fc8b-a4b9-42f4-923a-f0f2562b14b5"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.263235 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f66fc8b-a4b9-42f4-923a-f0f2562b14b5-kube-api-access-c45mx" (OuterVolumeSpecName: "kube-api-access-c45mx") pod "7f66fc8b-a4b9-42f4-923a-f0f2562b14b5" (UID: "7f66fc8b-a4b9-42f4-923a-f0f2562b14b5"). InnerVolumeSpecName "kube-api-access-c45mx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.264143 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0f0e277-d818-4974-b331-03487ca8c544-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "f0f0e277-d818-4974-b331-03487ca8c544" (UID: "f0f0e277-d818-4974-b331-03487ca8c544"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.306863 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0f0e277-d818-4974-b331-03487ca8c544-config-data" (OuterVolumeSpecName: "config-data") pod "f0f0e277-d818-4974-b331-03487ca8c544" (UID: "f0f0e277-d818-4974-b331-03487ca8c544"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.316958 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7f66fc8b-a4b9-42f4-923a-f0f2562b14b5-config-data" (OuterVolumeSpecName: "config-data") pod "7f66fc8b-a4b9-42f4-923a-f0f2562b14b5" (UID: "7f66fc8b-a4b9-42f4-923a-f0f2562b14b5"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.360586 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/7f66fc8b-a4b9-42f4-923a-f0f2562b14b5-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.360908 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/f0f0e277-d818-4974-b331-03487ca8c544-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.360922 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f0f0e277-d818-4974-b331-03487ca8c544-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.360933 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7f66fc8b-a4b9-42f4-923a-f0f2562b14b5-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.360946 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hdggx\" (UniqueName: \"kubernetes.io/projected/f0f0e277-d818-4974-b331-03487ca8c544-kube-api-access-hdggx\") on node \"crc\" DevicePath \"\"" Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.360957 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c45mx\" (UniqueName: \"kubernetes.io/projected/7f66fc8b-a4b9-42f4-923a-f0f2562b14b5-kube-api-access-c45mx\") on node \"crc\" DevicePath \"\"" Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.526011 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican-keystone-listener-9c667c454-mwz98" Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.558202 5120 generic.go:358] "Generic (PLEG): container finished" podID="7bad27ae-2338-4a16-aba5-f813bbcd01b5" containerID="cecf8a5e736484634164124bf13492f5d8b5b58c5456b3667bc491ff5b3d02c2" exitCode=0 Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.558235 5120 generic.go:358] "Generic (PLEG): container finished" podID="7bad27ae-2338-4a16-aba5-f813bbcd01b5" containerID="4ddd7d4cd3d34eaf22b010b199283fe291c89fe489eabedc4494125e00aba5df" exitCode=143 Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.558360 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-keystone-listener-9c667c454-4k45s" event={"ID":"7bad27ae-2338-4a16-aba5-f813bbcd01b5","Type":"ContainerDied","Data":"cecf8a5e736484634164124bf13492f5d8b5b58c5456b3667bc491ff5b3d02c2"} Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.558388 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-keystone-listener-9c667c454-4k45s" event={"ID":"7bad27ae-2338-4a16-aba5-f813bbcd01b5","Type":"ContainerDied","Data":"4ddd7d4cd3d34eaf22b010b199283fe291c89fe489eabedc4494125e00aba5df"} Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.560222 5120 generic.go:358] "Generic (PLEG): container finished" podID="4a00c03b-f82b-4b11-abfc-0ef8fb34dc9c" containerID="9a425f430419ee229962058115836e299260c47f6c783b3e50d240d878062e66" exitCode=0 Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.560240 5120 generic.go:358] "Generic (PLEG): container finished" podID="4a00c03b-f82b-4b11-abfc-0ef8fb34dc9c" containerID="0641caf1b1077f937e7c248dc342cbb36559cb23c18ca20651dee6a9288084ca" exitCode=143 Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.560348 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-worker-cb847bf9c-fzjrt" event={"ID":"4a00c03b-f82b-4b11-abfc-0ef8fb34dc9c","Type":"ContainerDied","Data":"9a425f430419ee229962058115836e299260c47f6c783b3e50d240d878062e66"} Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.560370 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-worker-cb847bf9c-fzjrt" event={"ID":"4a00c03b-f82b-4b11-abfc-0ef8fb34dc9c","Type":"ContainerDied","Data":"0641caf1b1077f937e7c248dc342cbb36559cb23c18ca20651dee6a9288084ca"} Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.562383 5120 generic.go:358] "Generic (PLEG): container finished" podID="f0f0e277-d818-4974-b331-03487ca8c544" containerID="01e5848acf0b4d61112ff33e2e4daf0fe5ba16878ad25e7fe4f6e684995a7bc9" exitCode=0 Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.562411 5120 generic.go:358] "Generic (PLEG): container finished" podID="f0f0e277-d818-4974-b331-03487ca8c544" containerID="ff8f2b86ab311d1e2a20fe7fdcaa273d1f63970cacd2c4c9cfff0f8665e303d0" exitCode=143 Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.562628 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-api-6fc6fbdfcd-8c2q8" event={"ID":"f0f0e277-d818-4974-b331-03487ca8c544","Type":"ContainerDied","Data":"01e5848acf0b4d61112ff33e2e4daf0fe5ba16878ad25e7fe4f6e684995a7bc9"} Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.562657 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-api-6fc6fbdfcd-8c2q8" event={"ID":"f0f0e277-d818-4974-b331-03487ca8c544","Type":"ContainerDied","Data":"ff8f2b86ab311d1e2a20fe7fdcaa273d1f63970cacd2c4c9cfff0f8665e303d0"} Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.562667 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-api-6fc6fbdfcd-8c2q8" event={"ID":"f0f0e277-d818-4974-b331-03487ca8c544","Type":"ContainerDied","Data":"b9042dc459e03a66eed5c1020d15a2ee6692ebde8fa36eac8ca3a9443e8e261f"} Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.562683 5120 scope.go:117] "RemoveContainer" containerID="01e5848acf0b4d61112ff33e2e4daf0fe5ba16878ad25e7fe4f6e684995a7bc9" Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.562847 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican-api-6fc6fbdfcd-8c2q8" Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.568563 5120 generic.go:358] "Generic (PLEG): container finished" podID="d612c818-7a65-4f59-8908-fce1d295996b" containerID="9b4899d3bb35e17dfb9a6276a51ce9805c142351651eb510b7cedf2166850431" exitCode=0 Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.568592 5120 generic.go:358] "Generic (PLEG): container finished" podID="d612c818-7a65-4f59-8908-fce1d295996b" containerID="c2a5283c97192761d79f744fc1dfc5d471d1e8c5b6aa1953bfac4aefd3bf9aa3" exitCode=143 Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.568646 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-keystone-listener-9c667c454-mwz98" event={"ID":"d612c818-7a65-4f59-8908-fce1d295996b","Type":"ContainerDied","Data":"9b4899d3bb35e17dfb9a6276a51ce9805c142351651eb510b7cedf2166850431"} Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.568685 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-keystone-listener-9c667c454-mwz98" event={"ID":"d612c818-7a65-4f59-8908-fce1d295996b","Type":"ContainerDied","Data":"c2a5283c97192761d79f744fc1dfc5d471d1e8c5b6aa1953bfac4aefd3bf9aa3"} Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.568695 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-keystone-listener-9c667c454-mwz98" event={"ID":"d612c818-7a65-4f59-8908-fce1d295996b","Type":"ContainerDied","Data":"49dd8fca136cc3c879f3ddf409965b130bc55f2812ae7b099bc27883525445a7"} Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.568724 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican-keystone-listener-9c667c454-mwz98" Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.568827 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/d612c818-7a65-4f59-8908-fce1d295996b-config-data-custom\") pod \"d612c818-7a65-4f59-8908-fce1d295996b\" (UID: \"d612c818-7a65-4f59-8908-fce1d295996b\") " Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.569025 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l2zwv\" (UniqueName: \"kubernetes.io/projected/d612c818-7a65-4f59-8908-fce1d295996b-kube-api-access-l2zwv\") pod \"d612c818-7a65-4f59-8908-fce1d295996b\" (UID: \"d612c818-7a65-4f59-8908-fce1d295996b\") " Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.569202 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d612c818-7a65-4f59-8908-fce1d295996b-config-data\") pod \"d612c818-7a65-4f59-8908-fce1d295996b\" (UID: \"d612c818-7a65-4f59-8908-fce1d295996b\") " Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.569294 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d612c818-7a65-4f59-8908-fce1d295996b-logs\") pod \"d612c818-7a65-4f59-8908-fce1d295996b\" (UID: \"d612c818-7a65-4f59-8908-fce1d295996b\") " Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.569792 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d612c818-7a65-4f59-8908-fce1d295996b-logs" (OuterVolumeSpecName: "logs") pod "d612c818-7a65-4f59-8908-fce1d295996b" (UID: "d612c818-7a65-4f59-8908-fce1d295996b"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.569952 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d612c818-7a65-4f59-8908-fce1d295996b-logs\") on node \"crc\" DevicePath \"\"" Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.574578 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d612c818-7a65-4f59-8908-fce1d295996b-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "d612c818-7a65-4f59-8908-fce1d295996b" (UID: "d612c818-7a65-4f59-8908-fce1d295996b"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.574648 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d612c818-7a65-4f59-8908-fce1d295996b-kube-api-access-l2zwv" (OuterVolumeSpecName: "kube-api-access-l2zwv") pod "d612c818-7a65-4f59-8908-fce1d295996b" (UID: "d612c818-7a65-4f59-8908-fce1d295996b"). InnerVolumeSpecName "kube-api-access-l2zwv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.577418 5120 generic.go:358] "Generic (PLEG): container finished" podID="7f66fc8b-a4b9-42f4-923a-f0f2562b14b5" containerID="be55f846b6a66d6d6fd9407055b9b9d626cd98ac2d8b08d222f1d2085606121e" exitCode=0 Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.577448 5120 generic.go:358] "Generic (PLEG): container finished" podID="7f66fc8b-a4b9-42f4-923a-f0f2562b14b5" containerID="6eb480efd56e68b47e99f6f6fea823e13043dddf2074c51c5e971292af19680e" exitCode=143 Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.577661 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="barbican-kuttl-tests/barbican-api-6fc6fbdfcd-6zspr" podUID="443927da-114a-4656-9e75-0c2899a881c9" containerName="barbican-api-log" containerID="cri-o://8bd7151fc6d83565be6b5800d6af29ee46b835e1cf009e799846fc0dfbf53463" gracePeriod=30 Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.577964 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican-worker-cb847bf9c-87m9r" Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.579089 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-worker-cb847bf9c-87m9r" event={"ID":"7f66fc8b-a4b9-42f4-923a-f0f2562b14b5","Type":"ContainerDied","Data":"be55f846b6a66d6d6fd9407055b9b9d626cd98ac2d8b08d222f1d2085606121e"} Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.579132 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-worker-cb847bf9c-87m9r" event={"ID":"7f66fc8b-a4b9-42f4-923a-f0f2562b14b5","Type":"ContainerDied","Data":"6eb480efd56e68b47e99f6f6fea823e13043dddf2074c51c5e971292af19680e"} Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.579145 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-worker-cb847bf9c-87m9r" event={"ID":"7f66fc8b-a4b9-42f4-923a-f0f2562b14b5","Type":"ContainerDied","Data":"467ef5d1612537dd770728aaef544d634dab92b7951bade2a12a7ab13cb6022c"} Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.579234 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="barbican-kuttl-tests/barbican-api-6fc6fbdfcd-6zspr" podUID="443927da-114a-4656-9e75-0c2899a881c9" containerName="barbican-api" containerID="cri-o://58e23239575e7911b272670edaf01701e2d2833c76edb4d2ca29e52b015428c0" gracePeriod=30 Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.595913 5120 scope.go:117] "RemoveContainer" containerID="ff8f2b86ab311d1e2a20fe7fdcaa273d1f63970cacd2c4c9cfff0f8665e303d0" Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.608301 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["barbican-kuttl-tests/barbican-api-6fc6fbdfcd-8c2q8"] Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.616220 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["barbican-kuttl-tests/barbican-api-6fc6fbdfcd-8c2q8"] Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.634008 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican-keystone-listener-9c667c454-4k45s" Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.634328 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d612c818-7a65-4f59-8908-fce1d295996b-config-data" (OuterVolumeSpecName: "config-data") pod "d612c818-7a65-4f59-8908-fce1d295996b" (UID: "d612c818-7a65-4f59-8908-fce1d295996b"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.637330 5120 scope.go:117] "RemoveContainer" containerID="01e5848acf0b4d61112ff33e2e4daf0fe5ba16878ad25e7fe4f6e684995a7bc9" Mar 16 17:39:17 crc kubenswrapper[5120]: E0316 17:39:17.637696 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"01e5848acf0b4d61112ff33e2e4daf0fe5ba16878ad25e7fe4f6e684995a7bc9\": container with ID starting with 01e5848acf0b4d61112ff33e2e4daf0fe5ba16878ad25e7fe4f6e684995a7bc9 not found: ID does not exist" containerID="01e5848acf0b4d61112ff33e2e4daf0fe5ba16878ad25e7fe4f6e684995a7bc9" Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.637740 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01e5848acf0b4d61112ff33e2e4daf0fe5ba16878ad25e7fe4f6e684995a7bc9"} err="failed to get container status \"01e5848acf0b4d61112ff33e2e4daf0fe5ba16878ad25e7fe4f6e684995a7bc9\": rpc error: code = NotFound desc = could not find container \"01e5848acf0b4d61112ff33e2e4daf0fe5ba16878ad25e7fe4f6e684995a7bc9\": container with ID starting with 01e5848acf0b4d61112ff33e2e4daf0fe5ba16878ad25e7fe4f6e684995a7bc9 not found: ID does not exist" Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.637784 5120 scope.go:117] "RemoveContainer" containerID="ff8f2b86ab311d1e2a20fe7fdcaa273d1f63970cacd2c4c9cfff0f8665e303d0" Mar 16 17:39:17 crc kubenswrapper[5120]: E0316 17:39:17.638020 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ff8f2b86ab311d1e2a20fe7fdcaa273d1f63970cacd2c4c9cfff0f8665e303d0\": container with ID starting with ff8f2b86ab311d1e2a20fe7fdcaa273d1f63970cacd2c4c9cfff0f8665e303d0 not found: ID does not exist" containerID="ff8f2b86ab311d1e2a20fe7fdcaa273d1f63970cacd2c4c9cfff0f8665e303d0" Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.638056 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff8f2b86ab311d1e2a20fe7fdcaa273d1f63970cacd2c4c9cfff0f8665e303d0"} err="failed to get container status \"ff8f2b86ab311d1e2a20fe7fdcaa273d1f63970cacd2c4c9cfff0f8665e303d0\": rpc error: code = NotFound desc = could not find container \"ff8f2b86ab311d1e2a20fe7fdcaa273d1f63970cacd2c4c9cfff0f8665e303d0\": container with ID starting with ff8f2b86ab311d1e2a20fe7fdcaa273d1f63970cacd2c4c9cfff0f8665e303d0 not found: ID does not exist" Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.638077 5120 scope.go:117] "RemoveContainer" containerID="01e5848acf0b4d61112ff33e2e4daf0fe5ba16878ad25e7fe4f6e684995a7bc9" Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.638304 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01e5848acf0b4d61112ff33e2e4daf0fe5ba16878ad25e7fe4f6e684995a7bc9"} err="failed to get container status \"01e5848acf0b4d61112ff33e2e4daf0fe5ba16878ad25e7fe4f6e684995a7bc9\": rpc error: code = NotFound desc = could not find container \"01e5848acf0b4d61112ff33e2e4daf0fe5ba16878ad25e7fe4f6e684995a7bc9\": container with ID starting with 01e5848acf0b4d61112ff33e2e4daf0fe5ba16878ad25e7fe4f6e684995a7bc9 not found: ID does not exist" Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.638324 5120 scope.go:117] "RemoveContainer" containerID="ff8f2b86ab311d1e2a20fe7fdcaa273d1f63970cacd2c4c9cfff0f8665e303d0" Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.638552 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff8f2b86ab311d1e2a20fe7fdcaa273d1f63970cacd2c4c9cfff0f8665e303d0"} err="failed to get container status \"ff8f2b86ab311d1e2a20fe7fdcaa273d1f63970cacd2c4c9cfff0f8665e303d0\": rpc error: code = NotFound desc = could not find container \"ff8f2b86ab311d1e2a20fe7fdcaa273d1f63970cacd2c4c9cfff0f8665e303d0\": container with ID starting with ff8f2b86ab311d1e2a20fe7fdcaa273d1f63970cacd2c4c9cfff0f8665e303d0 not found: ID does not exist" Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.638578 5120 scope.go:117] "RemoveContainer" containerID="9b4899d3bb35e17dfb9a6276a51ce9805c142351651eb510b7cedf2166850431" Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.639113 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["barbican-kuttl-tests/barbican-worker-cb847bf9c-87m9r"] Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.647079 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["barbican-kuttl-tests/barbican-worker-cb847bf9c-87m9r"] Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.664523 5120 scope.go:117] "RemoveContainer" containerID="c2a5283c97192761d79f744fc1dfc5d471d1e8c5b6aa1953bfac4aefd3bf9aa3" Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.671244 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/7bad27ae-2338-4a16-aba5-f813bbcd01b5-config-data-custom\") pod \"7bad27ae-2338-4a16-aba5-f813bbcd01b5\" (UID: \"7bad27ae-2338-4a16-aba5-f813bbcd01b5\") " Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.671364 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7bad27ae-2338-4a16-aba5-f813bbcd01b5-config-data\") pod \"7bad27ae-2338-4a16-aba5-f813bbcd01b5\" (UID: \"7bad27ae-2338-4a16-aba5-f813bbcd01b5\") " Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.671695 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7bad27ae-2338-4a16-aba5-f813bbcd01b5-logs\") pod \"7bad27ae-2338-4a16-aba5-f813bbcd01b5\" (UID: \"7bad27ae-2338-4a16-aba5-f813bbcd01b5\") " Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.672505 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7bad27ae-2338-4a16-aba5-f813bbcd01b5-logs" (OuterVolumeSpecName: "logs") pod "7bad27ae-2338-4a16-aba5-f813bbcd01b5" (UID: "7bad27ae-2338-4a16-aba5-f813bbcd01b5"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.672579 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c75x6\" (UniqueName: \"kubernetes.io/projected/7bad27ae-2338-4a16-aba5-f813bbcd01b5-kube-api-access-c75x6\") pod \"7bad27ae-2338-4a16-aba5-f813bbcd01b5\" (UID: \"7bad27ae-2338-4a16-aba5-f813bbcd01b5\") " Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.673445 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l2zwv\" (UniqueName: \"kubernetes.io/projected/d612c818-7a65-4f59-8908-fce1d295996b-kube-api-access-l2zwv\") on node \"crc\" DevicePath \"\"" Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.673471 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d612c818-7a65-4f59-8908-fce1d295996b-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.673484 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/d612c818-7a65-4f59-8908-fce1d295996b-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.673495 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7bad27ae-2338-4a16-aba5-f813bbcd01b5-logs\") on node \"crc\" DevicePath \"\"" Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.676980 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7bad27ae-2338-4a16-aba5-f813bbcd01b5-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "7bad27ae-2338-4a16-aba5-f813bbcd01b5" (UID: "7bad27ae-2338-4a16-aba5-f813bbcd01b5"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.679362 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7bad27ae-2338-4a16-aba5-f813bbcd01b5-kube-api-access-c75x6" (OuterVolumeSpecName: "kube-api-access-c75x6") pod "7bad27ae-2338-4a16-aba5-f813bbcd01b5" (UID: "7bad27ae-2338-4a16-aba5-f813bbcd01b5"). InnerVolumeSpecName "kube-api-access-c75x6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.751919 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7bad27ae-2338-4a16-aba5-f813bbcd01b5-config-data" (OuterVolumeSpecName: "config-data") pod "7bad27ae-2338-4a16-aba5-f813bbcd01b5" (UID: "7bad27ae-2338-4a16-aba5-f813bbcd01b5"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.775508 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/7bad27ae-2338-4a16-aba5-f813bbcd01b5-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.775541 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7bad27ae-2338-4a16-aba5-f813bbcd01b5-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.775556 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c75x6\" (UniqueName: \"kubernetes.io/projected/7bad27ae-2338-4a16-aba5-f813bbcd01b5-kube-api-access-c75x6\") on node \"crc\" DevicePath \"\"" Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.786946 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["barbican-kuttl-tests/barbican-db-sync-5sw4t"] Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.793964 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["barbican-kuttl-tests/barbican-db-sync-5sw4t"] Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.804878 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican-worker-cb847bf9c-fzjrt" Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.810164 5120 scope.go:117] "RemoveContainer" containerID="9b4899d3bb35e17dfb9a6276a51ce9805c142351651eb510b7cedf2166850431" Mar 16 17:39:17 crc kubenswrapper[5120]: E0316 17:39:17.811368 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b4899d3bb35e17dfb9a6276a51ce9805c142351651eb510b7cedf2166850431\": container with ID starting with 9b4899d3bb35e17dfb9a6276a51ce9805c142351651eb510b7cedf2166850431 not found: ID does not exist" containerID="9b4899d3bb35e17dfb9a6276a51ce9805c142351651eb510b7cedf2166850431" Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.811433 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b4899d3bb35e17dfb9a6276a51ce9805c142351651eb510b7cedf2166850431"} err="failed to get container status \"9b4899d3bb35e17dfb9a6276a51ce9805c142351651eb510b7cedf2166850431\": rpc error: code = NotFound desc = could not find container \"9b4899d3bb35e17dfb9a6276a51ce9805c142351651eb510b7cedf2166850431\": container with ID starting with 9b4899d3bb35e17dfb9a6276a51ce9805c142351651eb510b7cedf2166850431 not found: ID does not exist" Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.811469 5120 scope.go:117] "RemoveContainer" containerID="c2a5283c97192761d79f744fc1dfc5d471d1e8c5b6aa1953bfac4aefd3bf9aa3" Mar 16 17:39:17 crc kubenswrapper[5120]: E0316 17:39:17.812214 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c2a5283c97192761d79f744fc1dfc5d471d1e8c5b6aa1953bfac4aefd3bf9aa3\": container with ID starting with c2a5283c97192761d79f744fc1dfc5d471d1e8c5b6aa1953bfac4aefd3bf9aa3 not found: ID does not exist" containerID="c2a5283c97192761d79f744fc1dfc5d471d1e8c5b6aa1953bfac4aefd3bf9aa3" Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.812265 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2a5283c97192761d79f744fc1dfc5d471d1e8c5b6aa1953bfac4aefd3bf9aa3"} err="failed to get container status \"c2a5283c97192761d79f744fc1dfc5d471d1e8c5b6aa1953bfac4aefd3bf9aa3\": rpc error: code = NotFound desc = could not find container \"c2a5283c97192761d79f744fc1dfc5d471d1e8c5b6aa1953bfac4aefd3bf9aa3\": container with ID starting with c2a5283c97192761d79f744fc1dfc5d471d1e8c5b6aa1953bfac4aefd3bf9aa3 not found: ID does not exist" Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.812290 5120 scope.go:117] "RemoveContainer" containerID="9b4899d3bb35e17dfb9a6276a51ce9805c142351651eb510b7cedf2166850431" Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.813953 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b4899d3bb35e17dfb9a6276a51ce9805c142351651eb510b7cedf2166850431"} err="failed to get container status \"9b4899d3bb35e17dfb9a6276a51ce9805c142351651eb510b7cedf2166850431\": rpc error: code = NotFound desc = could not find container \"9b4899d3bb35e17dfb9a6276a51ce9805c142351651eb510b7cedf2166850431\": container with ID starting with 9b4899d3bb35e17dfb9a6276a51ce9805c142351651eb510b7cedf2166850431 not found: ID does not exist" Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.814003 5120 scope.go:117] "RemoveContainer" containerID="c2a5283c97192761d79f744fc1dfc5d471d1e8c5b6aa1953bfac4aefd3bf9aa3" Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.814317 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2a5283c97192761d79f744fc1dfc5d471d1e8c5b6aa1953bfac4aefd3bf9aa3"} err="failed to get container status \"c2a5283c97192761d79f744fc1dfc5d471d1e8c5b6aa1953bfac4aefd3bf9aa3\": rpc error: code = NotFound desc = could not find container \"c2a5283c97192761d79f744fc1dfc5d471d1e8c5b6aa1953bfac4aefd3bf9aa3\": container with ID starting with c2a5283c97192761d79f744fc1dfc5d471d1e8c5b6aa1953bfac4aefd3bf9aa3 not found: ID does not exist" Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.814345 5120 scope.go:117] "RemoveContainer" containerID="be55f846b6a66d6d6fd9407055b9b9d626cd98ac2d8b08d222f1d2085606121e" Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.821722 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["barbican-kuttl-tests/barbican09c0-account-delete-bxs5n"] Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.822904 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0f0e277-d818-4974-b331-03487ca8c544" containerName="barbican-api-log" Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.827507 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0f0e277-d818-4974-b331-03487ca8c544" containerName="barbican-api-log" Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.827887 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a00c03b-f82b-4b11-abfc-0ef8fb34dc9c" containerName="barbican-worker" Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.828155 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a00c03b-f82b-4b11-abfc-0ef8fb34dc9c" containerName="barbican-worker" Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.828375 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f66fc8b-a4b9-42f4-923a-f0f2562b14b5" containerName="barbican-worker" Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.828505 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f66fc8b-a4b9-42f4-923a-f0f2562b14b5" containerName="barbican-worker" Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.828796 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d612c818-7a65-4f59-8908-fce1d295996b" containerName="barbican-keystone-listener" Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.832128 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="d612c818-7a65-4f59-8908-fce1d295996b" containerName="barbican-keystone-listener" Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.832311 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7bad27ae-2338-4a16-aba5-f813bbcd01b5" containerName="barbican-keystone-listener-log" Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.832394 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bad27ae-2338-4a16-aba5-f813bbcd01b5" containerName="barbican-keystone-listener-log" Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.832492 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a00c03b-f82b-4b11-abfc-0ef8fb34dc9c" containerName="barbican-worker-log" Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.832544 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a00c03b-f82b-4b11-abfc-0ef8fb34dc9c" containerName="barbican-worker-log" Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.832604 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0f0e277-d818-4974-b331-03487ca8c544" containerName="barbican-api" Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.832653 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0f0e277-d818-4974-b331-03487ca8c544" containerName="barbican-api" Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.832717 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d612c818-7a65-4f59-8908-fce1d295996b" containerName="barbican-keystone-listener-log" Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.832797 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="d612c818-7a65-4f59-8908-fce1d295996b" containerName="barbican-keystone-listener-log" Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.832866 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7bad27ae-2338-4a16-aba5-f813bbcd01b5" containerName="barbican-keystone-listener" Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.832916 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bad27ae-2338-4a16-aba5-f813bbcd01b5" containerName="barbican-keystone-listener" Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.832992 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f66fc8b-a4b9-42f4-923a-f0f2562b14b5" containerName="barbican-worker-log" Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.833043 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f66fc8b-a4b9-42f4-923a-f0f2562b14b5" containerName="barbican-worker-log" Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.833427 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="d612c818-7a65-4f59-8908-fce1d295996b" containerName="barbican-keystone-listener" Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.833505 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="4a00c03b-f82b-4b11-abfc-0ef8fb34dc9c" containerName="barbican-worker" Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.833569 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f0f0e277-d818-4974-b331-03487ca8c544" containerName="barbican-api-log" Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.833630 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f0f0e277-d818-4974-b331-03487ca8c544" containerName="barbican-api" Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.833688 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="4a00c03b-f82b-4b11-abfc-0ef8fb34dc9c" containerName="barbican-worker-log" Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.833785 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7f66fc8b-a4b9-42f4-923a-f0f2562b14b5" containerName="barbican-worker" Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.833850 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7bad27ae-2338-4a16-aba5-f813bbcd01b5" containerName="barbican-keystone-listener-log" Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.833903 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7bad27ae-2338-4a16-aba5-f813bbcd01b5" containerName="barbican-keystone-listener" Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.833967 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="d612c818-7a65-4f59-8908-fce1d295996b" containerName="barbican-keystone-listener-log" Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.834030 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7f66fc8b-a4b9-42f4-923a-f0f2562b14b5" containerName="barbican-worker-log" Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.854497 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican09c0-account-delete-bxs5n" Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.856364 5120 scope.go:117] "RemoveContainer" containerID="6eb480efd56e68b47e99f6f6fea823e13043dddf2074c51c5e971292af19680e" Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.861403 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["barbican-kuttl-tests/barbican09c0-account-delete-bxs5n"] Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.876731 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4a00c03b-f82b-4b11-abfc-0ef8fb34dc9c-logs\") pod \"4a00c03b-f82b-4b11-abfc-0ef8fb34dc9c\" (UID: \"4a00c03b-f82b-4b11-abfc-0ef8fb34dc9c\") " Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.884159 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/4a00c03b-f82b-4b11-abfc-0ef8fb34dc9c-config-data-custom\") pod \"4a00c03b-f82b-4b11-abfc-0ef8fb34dc9c\" (UID: \"4a00c03b-f82b-4b11-abfc-0ef8fb34dc9c\") " Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.884334 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4a00c03b-f82b-4b11-abfc-0ef8fb34dc9c-config-data\") pod \"4a00c03b-f82b-4b11-abfc-0ef8fb34dc9c\" (UID: \"4a00c03b-f82b-4b11-abfc-0ef8fb34dc9c\") " Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.884389 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xchnk\" (UniqueName: \"kubernetes.io/projected/4a00c03b-f82b-4b11-abfc-0ef8fb34dc9c-kube-api-access-xchnk\") pod \"4a00c03b-f82b-4b11-abfc-0ef8fb34dc9c\" (UID: \"4a00c03b-f82b-4b11-abfc-0ef8fb34dc9c\") " Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.884821 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwqxl\" (UniqueName: \"kubernetes.io/projected/a39cb762-65ab-4605-9a52-7a5c68da0509-kube-api-access-zwqxl\") pod \"barbican09c0-account-delete-bxs5n\" (UID: \"a39cb762-65ab-4605-9a52-7a5c68da0509\") " pod="barbican-kuttl-tests/barbican09c0-account-delete-bxs5n" Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.885055 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a39cb762-65ab-4605-9a52-7a5c68da0509-operator-scripts\") pod \"barbican09c0-account-delete-bxs5n\" (UID: \"a39cb762-65ab-4605-9a52-7a5c68da0509\") " pod="barbican-kuttl-tests/barbican09c0-account-delete-bxs5n" Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.878710 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a00c03b-f82b-4b11-abfc-0ef8fb34dc9c-logs" (OuterVolumeSpecName: "logs") pod "4a00c03b-f82b-4b11-abfc-0ef8fb34dc9c" (UID: "4a00c03b-f82b-4b11-abfc-0ef8fb34dc9c"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.886180 5120 scope.go:117] "RemoveContainer" containerID="be55f846b6a66d6d6fd9407055b9b9d626cd98ac2d8b08d222f1d2085606121e" Mar 16 17:39:17 crc kubenswrapper[5120]: E0316 17:39:17.889889 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"be55f846b6a66d6d6fd9407055b9b9d626cd98ac2d8b08d222f1d2085606121e\": container with ID starting with be55f846b6a66d6d6fd9407055b9b9d626cd98ac2d8b08d222f1d2085606121e not found: ID does not exist" containerID="be55f846b6a66d6d6fd9407055b9b9d626cd98ac2d8b08d222f1d2085606121e" Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.889979 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be55f846b6a66d6d6fd9407055b9b9d626cd98ac2d8b08d222f1d2085606121e"} err="failed to get container status \"be55f846b6a66d6d6fd9407055b9b9d626cd98ac2d8b08d222f1d2085606121e\": rpc error: code = NotFound desc = could not find container \"be55f846b6a66d6d6fd9407055b9b9d626cd98ac2d8b08d222f1d2085606121e\": container with ID starting with be55f846b6a66d6d6fd9407055b9b9d626cd98ac2d8b08d222f1d2085606121e not found: ID does not exist" Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.890003 5120 scope.go:117] "RemoveContainer" containerID="6eb480efd56e68b47e99f6f6fea823e13043dddf2074c51c5e971292af19680e" Mar 16 17:39:17 crc kubenswrapper[5120]: E0316 17:39:17.890795 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6eb480efd56e68b47e99f6f6fea823e13043dddf2074c51c5e971292af19680e\": container with ID starting with 6eb480efd56e68b47e99f6f6fea823e13043dddf2074c51c5e971292af19680e not found: ID does not exist" containerID="6eb480efd56e68b47e99f6f6fea823e13043dddf2074c51c5e971292af19680e" Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.890839 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6eb480efd56e68b47e99f6f6fea823e13043dddf2074c51c5e971292af19680e"} err="failed to get container status \"6eb480efd56e68b47e99f6f6fea823e13043dddf2074c51c5e971292af19680e\": rpc error: code = NotFound desc = could not find container \"6eb480efd56e68b47e99f6f6fea823e13043dddf2074c51c5e971292af19680e\": container with ID starting with 6eb480efd56e68b47e99f6f6fea823e13043dddf2074c51c5e971292af19680e not found: ID does not exist" Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.890868 5120 scope.go:117] "RemoveContainer" containerID="be55f846b6a66d6d6fd9407055b9b9d626cd98ac2d8b08d222f1d2085606121e" Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.891079 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be55f846b6a66d6d6fd9407055b9b9d626cd98ac2d8b08d222f1d2085606121e"} err="failed to get container status \"be55f846b6a66d6d6fd9407055b9b9d626cd98ac2d8b08d222f1d2085606121e\": rpc error: code = NotFound desc = could not find container \"be55f846b6a66d6d6fd9407055b9b9d626cd98ac2d8b08d222f1d2085606121e\": container with ID starting with be55f846b6a66d6d6fd9407055b9b9d626cd98ac2d8b08d222f1d2085606121e not found: ID does not exist" Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.891093 5120 scope.go:117] "RemoveContainer" containerID="6eb480efd56e68b47e99f6f6fea823e13043dddf2074c51c5e971292af19680e" Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.891248 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6eb480efd56e68b47e99f6f6fea823e13043dddf2074c51c5e971292af19680e"} err="failed to get container status \"6eb480efd56e68b47e99f6f6fea823e13043dddf2074c51c5e971292af19680e\": rpc error: code = NotFound desc = could not find container \"6eb480efd56e68b47e99f6f6fea823e13043dddf2074c51c5e971292af19680e\": container with ID starting with 6eb480efd56e68b47e99f6f6fea823e13043dddf2074c51c5e971292af19680e not found: ID does not exist" Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.899724 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4a00c03b-f82b-4b11-abfc-0ef8fb34dc9c-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "4a00c03b-f82b-4b11-abfc-0ef8fb34dc9c" (UID: "4a00c03b-f82b-4b11-abfc-0ef8fb34dc9c"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.900497 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a00c03b-f82b-4b11-abfc-0ef8fb34dc9c-kube-api-access-xchnk" (OuterVolumeSpecName: "kube-api-access-xchnk") pod "4a00c03b-f82b-4b11-abfc-0ef8fb34dc9c" (UID: "4a00c03b-f82b-4b11-abfc-0ef8fb34dc9c"). InnerVolumeSpecName "kube-api-access-xchnk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.926825 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4a00c03b-f82b-4b11-abfc-0ef8fb34dc9c-config-data" (OuterVolumeSpecName: "config-data") pod "4a00c03b-f82b-4b11-abfc-0ef8fb34dc9c" (UID: "4a00c03b-f82b-4b11-abfc-0ef8fb34dc9c"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.988146 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zwqxl\" (UniqueName: \"kubernetes.io/projected/a39cb762-65ab-4605-9a52-7a5c68da0509-kube-api-access-zwqxl\") pod \"barbican09c0-account-delete-bxs5n\" (UID: \"a39cb762-65ab-4605-9a52-7a5c68da0509\") " pod="barbican-kuttl-tests/barbican09c0-account-delete-bxs5n" Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.988504 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a39cb762-65ab-4605-9a52-7a5c68da0509-operator-scripts\") pod \"barbican09c0-account-delete-bxs5n\" (UID: \"a39cb762-65ab-4605-9a52-7a5c68da0509\") " pod="barbican-kuttl-tests/barbican09c0-account-delete-bxs5n" Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.989328 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4a00c03b-f82b-4b11-abfc-0ef8fb34dc9c-logs\") on node \"crc\" DevicePath \"\"" Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.989435 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a39cb762-65ab-4605-9a52-7a5c68da0509-operator-scripts\") pod \"barbican09c0-account-delete-bxs5n\" (UID: \"a39cb762-65ab-4605-9a52-7a5c68da0509\") " pod="barbican-kuttl-tests/barbican09c0-account-delete-bxs5n" Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.992071 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/4a00c03b-f82b-4b11-abfc-0ef8fb34dc9c-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.992812 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4a00c03b-f82b-4b11-abfc-0ef8fb34dc9c-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:39:17 crc kubenswrapper[5120]: I0316 17:39:17.992831 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xchnk\" (UniqueName: \"kubernetes.io/projected/4a00c03b-f82b-4b11-abfc-0ef8fb34dc9c-kube-api-access-xchnk\") on node \"crc\" DevicePath \"\"" Mar 16 17:39:18 crc kubenswrapper[5120]: I0316 17:39:18.015823 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwqxl\" (UniqueName: \"kubernetes.io/projected/a39cb762-65ab-4605-9a52-7a5c68da0509-kube-api-access-zwqxl\") pod \"barbican09c0-account-delete-bxs5n\" (UID: \"a39cb762-65ab-4605-9a52-7a5c68da0509\") " pod="barbican-kuttl-tests/barbican09c0-account-delete-bxs5n" Mar 16 17:39:18 crc kubenswrapper[5120]: I0316 17:39:18.039837 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["barbican-kuttl-tests/barbican-keystone-listener-9c667c454-mwz98"] Mar 16 17:39:18 crc kubenswrapper[5120]: I0316 17:39:18.046997 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["barbican-kuttl-tests/barbican-keystone-listener-9c667c454-mwz98"] Mar 16 17:39:18 crc kubenswrapper[5120]: I0316 17:39:18.172643 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican09c0-account-delete-bxs5n" Mar 16 17:39:18 crc kubenswrapper[5120]: I0316 17:39:18.461067 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican-api-6fc6fbdfcd-6zspr" Mar 16 17:39:18 crc kubenswrapper[5120]: I0316 17:39:18.504498 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/443927da-114a-4656-9e75-0c2899a881c9-config-data-custom\") pod \"443927da-114a-4656-9e75-0c2899a881c9\" (UID: \"443927da-114a-4656-9e75-0c2899a881c9\") " Mar 16 17:39:18 crc kubenswrapper[5120]: I0316 17:39:18.504979 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/443927da-114a-4656-9e75-0c2899a881c9-logs\") pod \"443927da-114a-4656-9e75-0c2899a881c9\" (UID: \"443927da-114a-4656-9e75-0c2899a881c9\") " Mar 16 17:39:18 crc kubenswrapper[5120]: I0316 17:39:18.505140 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/443927da-114a-4656-9e75-0c2899a881c9-config-data\") pod \"443927da-114a-4656-9e75-0c2899a881c9\" (UID: \"443927da-114a-4656-9e75-0c2899a881c9\") " Mar 16 17:39:18 crc kubenswrapper[5120]: I0316 17:39:18.505385 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-htqhb\" (UniqueName: \"kubernetes.io/projected/443927da-114a-4656-9e75-0c2899a881c9-kube-api-access-htqhb\") pod \"443927da-114a-4656-9e75-0c2899a881c9\" (UID: \"443927da-114a-4656-9e75-0c2899a881c9\") " Mar 16 17:39:18 crc kubenswrapper[5120]: I0316 17:39:18.505752 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/443927da-114a-4656-9e75-0c2899a881c9-logs" (OuterVolumeSpecName: "logs") pod "443927da-114a-4656-9e75-0c2899a881c9" (UID: "443927da-114a-4656-9e75-0c2899a881c9"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:39:18 crc kubenswrapper[5120]: I0316 17:39:18.506231 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/443927da-114a-4656-9e75-0c2899a881c9-logs\") on node \"crc\" DevicePath \"\"" Mar 16 17:39:18 crc kubenswrapper[5120]: I0316 17:39:18.513995 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/443927da-114a-4656-9e75-0c2899a881c9-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "443927da-114a-4656-9e75-0c2899a881c9" (UID: "443927da-114a-4656-9e75-0c2899a881c9"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:39:18 crc kubenswrapper[5120]: I0316 17:39:18.514024 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/443927da-114a-4656-9e75-0c2899a881c9-kube-api-access-htqhb" (OuterVolumeSpecName: "kube-api-access-htqhb") pod "443927da-114a-4656-9e75-0c2899a881c9" (UID: "443927da-114a-4656-9e75-0c2899a881c9"). InnerVolumeSpecName "kube-api-access-htqhb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:39:18 crc kubenswrapper[5120]: I0316 17:39:18.544345 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/443927da-114a-4656-9e75-0c2899a881c9-config-data" (OuterVolumeSpecName: "config-data") pod "443927da-114a-4656-9e75-0c2899a881c9" (UID: "443927da-114a-4656-9e75-0c2899a881c9"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:39:18 crc kubenswrapper[5120]: I0316 17:39:18.594333 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican-keystone-listener-9c667c454-4k45s" Mar 16 17:39:18 crc kubenswrapper[5120]: I0316 17:39:18.594331 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-keystone-listener-9c667c454-4k45s" event={"ID":"7bad27ae-2338-4a16-aba5-f813bbcd01b5","Type":"ContainerDied","Data":"257042cb32eb32131ce8a503d33f571a7766cce3b5fed2165e66583d7234d9e1"} Mar 16 17:39:18 crc kubenswrapper[5120]: I0316 17:39:18.594523 5120 scope.go:117] "RemoveContainer" containerID="cecf8a5e736484634164124bf13492f5d8b5b58c5456b3667bc491ff5b3d02c2" Mar 16 17:39:18 crc kubenswrapper[5120]: I0316 17:39:18.599047 5120 generic.go:358] "Generic (PLEG): container finished" podID="443927da-114a-4656-9e75-0c2899a881c9" containerID="58e23239575e7911b272670edaf01701e2d2833c76edb4d2ca29e52b015428c0" exitCode=0 Mar 16 17:39:18 crc kubenswrapper[5120]: I0316 17:39:18.599070 5120 generic.go:358] "Generic (PLEG): container finished" podID="443927da-114a-4656-9e75-0c2899a881c9" containerID="8bd7151fc6d83565be6b5800d6af29ee46b835e1cf009e799846fc0dfbf53463" exitCode=143 Mar 16 17:39:18 crc kubenswrapper[5120]: I0316 17:39:18.599135 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-api-6fc6fbdfcd-6zspr" event={"ID":"443927da-114a-4656-9e75-0c2899a881c9","Type":"ContainerDied","Data":"58e23239575e7911b272670edaf01701e2d2833c76edb4d2ca29e52b015428c0"} Mar 16 17:39:18 crc kubenswrapper[5120]: I0316 17:39:18.599156 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-api-6fc6fbdfcd-6zspr" event={"ID":"443927da-114a-4656-9e75-0c2899a881c9","Type":"ContainerDied","Data":"8bd7151fc6d83565be6b5800d6af29ee46b835e1cf009e799846fc0dfbf53463"} Mar 16 17:39:18 crc kubenswrapper[5120]: I0316 17:39:18.599169 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-api-6fc6fbdfcd-6zspr" event={"ID":"443927da-114a-4656-9e75-0c2899a881c9","Type":"ContainerDied","Data":"c8159530502c62cdf49cde2f941979b0dfda8adf3331e9f5820b522d42fbbe18"} Mar 16 17:39:18 crc kubenswrapper[5120]: I0316 17:39:18.599209 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican-api-6fc6fbdfcd-6zspr" Mar 16 17:39:18 crc kubenswrapper[5120]: I0316 17:39:18.601146 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-worker-cb847bf9c-fzjrt" event={"ID":"4a00c03b-f82b-4b11-abfc-0ef8fb34dc9c","Type":"ContainerDied","Data":"f40de55e79bdd953805a60983f7f853e2e368eb79fd9463194551a1f1ef156ad"} Mar 16 17:39:18 crc kubenswrapper[5120]: I0316 17:39:18.601247 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican-worker-cb847bf9c-fzjrt" Mar 16 17:39:18 crc kubenswrapper[5120]: I0316 17:39:18.608067 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/443927da-114a-4656-9e75-0c2899a881c9-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:39:18 crc kubenswrapper[5120]: I0316 17:39:18.608109 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-htqhb\" (UniqueName: \"kubernetes.io/projected/443927da-114a-4656-9e75-0c2899a881c9-kube-api-access-htqhb\") on node \"crc\" DevicePath \"\"" Mar 16 17:39:18 crc kubenswrapper[5120]: I0316 17:39:18.608124 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/443927da-114a-4656-9e75-0c2899a881c9-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 17:39:18 crc kubenswrapper[5120]: I0316 17:39:18.626325 5120 scope.go:117] "RemoveContainer" containerID="4ddd7d4cd3d34eaf22b010b199283fe291c89fe489eabedc4494125e00aba5df" Mar 16 17:39:18 crc kubenswrapper[5120]: I0316 17:39:18.630846 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["barbican-kuttl-tests/barbican-keystone-listener-9c667c454-4k45s"] Mar 16 17:39:18 crc kubenswrapper[5120]: I0316 17:39:18.637369 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["barbican-kuttl-tests/barbican-keystone-listener-9c667c454-4k45s"] Mar 16 17:39:18 crc kubenswrapper[5120]: I0316 17:39:18.650119 5120 scope.go:117] "RemoveContainer" containerID="58e23239575e7911b272670edaf01701e2d2833c76edb4d2ca29e52b015428c0" Mar 16 17:39:18 crc kubenswrapper[5120]: I0316 17:39:18.651593 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["barbican-kuttl-tests/barbican-worker-cb847bf9c-fzjrt"] Mar 16 17:39:18 crc kubenswrapper[5120]: I0316 17:39:18.659621 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["barbican-kuttl-tests/barbican-worker-cb847bf9c-fzjrt"] Mar 16 17:39:18 crc kubenswrapper[5120]: I0316 17:39:18.670571 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["barbican-kuttl-tests/barbican-api-6fc6fbdfcd-6zspr"] Mar 16 17:39:18 crc kubenswrapper[5120]: I0316 17:39:18.675032 5120 scope.go:117] "RemoveContainer" containerID="8bd7151fc6d83565be6b5800d6af29ee46b835e1cf009e799846fc0dfbf53463" Mar 16 17:39:18 crc kubenswrapper[5120]: I0316 17:39:18.691025 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4a00c03b-f82b-4b11-abfc-0ef8fb34dc9c" path="/var/lib/kubelet/pods/4a00c03b-f82b-4b11-abfc-0ef8fb34dc9c/volumes" Mar 16 17:39:18 crc kubenswrapper[5120]: I0316 17:39:18.692248 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7bad27ae-2338-4a16-aba5-f813bbcd01b5" path="/var/lib/kubelet/pods/7bad27ae-2338-4a16-aba5-f813bbcd01b5/volumes" Mar 16 17:39:18 crc kubenswrapper[5120]: I0316 17:39:18.693028 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7f66fc8b-a4b9-42f4-923a-f0f2562b14b5" path="/var/lib/kubelet/pods/7f66fc8b-a4b9-42f4-923a-f0f2562b14b5/volumes" Mar 16 17:39:18 crc kubenswrapper[5120]: I0316 17:39:18.694097 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="abf5f304-1df1-4dfe-9fcf-6b87d098d48c" path="/var/lib/kubelet/pods/abf5f304-1df1-4dfe-9fcf-6b87d098d48c/volumes" Mar 16 17:39:18 crc kubenswrapper[5120]: I0316 17:39:18.694662 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d612c818-7a65-4f59-8908-fce1d295996b" path="/var/lib/kubelet/pods/d612c818-7a65-4f59-8908-fce1d295996b/volumes" Mar 16 17:39:18 crc kubenswrapper[5120]: I0316 17:39:18.695280 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f0f0e277-d818-4974-b331-03487ca8c544" path="/var/lib/kubelet/pods/f0f0e277-d818-4974-b331-03487ca8c544/volumes" Mar 16 17:39:18 crc kubenswrapper[5120]: I0316 17:39:18.696268 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["barbican-kuttl-tests/barbican-api-6fc6fbdfcd-6zspr"] Mar 16 17:39:18 crc kubenswrapper[5120]: I0316 17:39:18.708336 5120 scope.go:117] "RemoveContainer" containerID="58e23239575e7911b272670edaf01701e2d2833c76edb4d2ca29e52b015428c0" Mar 16 17:39:18 crc kubenswrapper[5120]: E0316 17:39:18.708839 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"58e23239575e7911b272670edaf01701e2d2833c76edb4d2ca29e52b015428c0\": container with ID starting with 58e23239575e7911b272670edaf01701e2d2833c76edb4d2ca29e52b015428c0 not found: ID does not exist" containerID="58e23239575e7911b272670edaf01701e2d2833c76edb4d2ca29e52b015428c0" Mar 16 17:39:18 crc kubenswrapper[5120]: I0316 17:39:18.708897 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58e23239575e7911b272670edaf01701e2d2833c76edb4d2ca29e52b015428c0"} err="failed to get container status \"58e23239575e7911b272670edaf01701e2d2833c76edb4d2ca29e52b015428c0\": rpc error: code = NotFound desc = could not find container \"58e23239575e7911b272670edaf01701e2d2833c76edb4d2ca29e52b015428c0\": container with ID starting with 58e23239575e7911b272670edaf01701e2d2833c76edb4d2ca29e52b015428c0 not found: ID does not exist" Mar 16 17:39:18 crc kubenswrapper[5120]: I0316 17:39:18.708921 5120 scope.go:117] "RemoveContainer" containerID="8bd7151fc6d83565be6b5800d6af29ee46b835e1cf009e799846fc0dfbf53463" Mar 16 17:39:18 crc kubenswrapper[5120]: E0316 17:39:18.709479 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8bd7151fc6d83565be6b5800d6af29ee46b835e1cf009e799846fc0dfbf53463\": container with ID starting with 8bd7151fc6d83565be6b5800d6af29ee46b835e1cf009e799846fc0dfbf53463 not found: ID does not exist" containerID="8bd7151fc6d83565be6b5800d6af29ee46b835e1cf009e799846fc0dfbf53463" Mar 16 17:39:18 crc kubenswrapper[5120]: I0316 17:39:18.709541 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8bd7151fc6d83565be6b5800d6af29ee46b835e1cf009e799846fc0dfbf53463"} err="failed to get container status \"8bd7151fc6d83565be6b5800d6af29ee46b835e1cf009e799846fc0dfbf53463\": rpc error: code = NotFound desc = could not find container \"8bd7151fc6d83565be6b5800d6af29ee46b835e1cf009e799846fc0dfbf53463\": container with ID starting with 8bd7151fc6d83565be6b5800d6af29ee46b835e1cf009e799846fc0dfbf53463 not found: ID does not exist" Mar 16 17:39:18 crc kubenswrapper[5120]: I0316 17:39:18.709560 5120 scope.go:117] "RemoveContainer" containerID="58e23239575e7911b272670edaf01701e2d2833c76edb4d2ca29e52b015428c0" Mar 16 17:39:18 crc kubenswrapper[5120]: I0316 17:39:18.709951 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58e23239575e7911b272670edaf01701e2d2833c76edb4d2ca29e52b015428c0"} err="failed to get container status \"58e23239575e7911b272670edaf01701e2d2833c76edb4d2ca29e52b015428c0\": rpc error: code = NotFound desc = could not find container \"58e23239575e7911b272670edaf01701e2d2833c76edb4d2ca29e52b015428c0\": container with ID starting with 58e23239575e7911b272670edaf01701e2d2833c76edb4d2ca29e52b015428c0 not found: ID does not exist" Mar 16 17:39:18 crc kubenswrapper[5120]: I0316 17:39:18.709974 5120 scope.go:117] "RemoveContainer" containerID="8bd7151fc6d83565be6b5800d6af29ee46b835e1cf009e799846fc0dfbf53463" Mar 16 17:39:18 crc kubenswrapper[5120]: I0316 17:39:18.711321 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8bd7151fc6d83565be6b5800d6af29ee46b835e1cf009e799846fc0dfbf53463"} err="failed to get container status \"8bd7151fc6d83565be6b5800d6af29ee46b835e1cf009e799846fc0dfbf53463\": rpc error: code = NotFound desc = could not find container \"8bd7151fc6d83565be6b5800d6af29ee46b835e1cf009e799846fc0dfbf53463\": container with ID starting with 8bd7151fc6d83565be6b5800d6af29ee46b835e1cf009e799846fc0dfbf53463 not found: ID does not exist" Mar 16 17:39:18 crc kubenswrapper[5120]: I0316 17:39:18.711338 5120 scope.go:117] "RemoveContainer" containerID="9a425f430419ee229962058115836e299260c47f6c783b3e50d240d878062e66" Mar 16 17:39:18 crc kubenswrapper[5120]: I0316 17:39:18.730293 5120 scope.go:117] "RemoveContainer" containerID="0641caf1b1077f937e7c248dc342cbb36559cb23c18ca20651dee6a9288084ca" Mar 16 17:39:18 crc kubenswrapper[5120]: I0316 17:39:18.781465 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["barbican-kuttl-tests/barbican09c0-account-delete-bxs5n"] Mar 16 17:39:18 crc kubenswrapper[5120]: W0316 17:39:18.788325 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda39cb762_65ab_4605_9a52_7a5c68da0509.slice/crio-8d43dab7d699d8e1a4ef8ea34115fc06866fe7da104697d62e7dc7c634a9b0da WatchSource:0}: Error finding container 8d43dab7d699d8e1a4ef8ea34115fc06866fe7da104697d62e7dc7c634a9b0da: Status 404 returned error can't find the container with id 8d43dab7d699d8e1a4ef8ea34115fc06866fe7da104697d62e7dc7c634a9b0da Mar 16 17:39:19 crc kubenswrapper[5120]: I0316 17:39:19.622660 5120 generic.go:358] "Generic (PLEG): container finished" podID="a39cb762-65ab-4605-9a52-7a5c68da0509" containerID="586b99213b91f16f0c9d1d82594ef6da975b029942a4f213b63c3e462bab1207" exitCode=0 Mar 16 17:39:19 crc kubenswrapper[5120]: I0316 17:39:19.622913 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican09c0-account-delete-bxs5n" event={"ID":"a39cb762-65ab-4605-9a52-7a5c68da0509","Type":"ContainerDied","Data":"586b99213b91f16f0c9d1d82594ef6da975b029942a4f213b63c3e462bab1207"} Mar 16 17:39:19 crc kubenswrapper[5120]: I0316 17:39:19.623197 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican09c0-account-delete-bxs5n" event={"ID":"a39cb762-65ab-4605-9a52-7a5c68da0509","Type":"ContainerStarted","Data":"8d43dab7d699d8e1a4ef8ea34115fc06866fe7da104697d62e7dc7c634a9b0da"} Mar 16 17:39:20 crc kubenswrapper[5120]: I0316 17:39:20.674886 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="443927da-114a-4656-9e75-0c2899a881c9" path="/var/lib/kubelet/pods/443927da-114a-4656-9e75-0c2899a881c9/volumes" Mar 16 17:39:21 crc kubenswrapper[5120]: I0316 17:39:21.004239 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican09c0-account-delete-bxs5n" Mar 16 17:39:21 crc kubenswrapper[5120]: I0316 17:39:21.066453 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zwqxl\" (UniqueName: \"kubernetes.io/projected/a39cb762-65ab-4605-9a52-7a5c68da0509-kube-api-access-zwqxl\") pod \"a39cb762-65ab-4605-9a52-7a5c68da0509\" (UID: \"a39cb762-65ab-4605-9a52-7a5c68da0509\") " Mar 16 17:39:21 crc kubenswrapper[5120]: I0316 17:39:21.066570 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a39cb762-65ab-4605-9a52-7a5c68da0509-operator-scripts\") pod \"a39cb762-65ab-4605-9a52-7a5c68da0509\" (UID: \"a39cb762-65ab-4605-9a52-7a5c68da0509\") " Mar 16 17:39:21 crc kubenswrapper[5120]: I0316 17:39:21.067498 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a39cb762-65ab-4605-9a52-7a5c68da0509-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "a39cb762-65ab-4605-9a52-7a5c68da0509" (UID: "a39cb762-65ab-4605-9a52-7a5c68da0509"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:39:21 crc kubenswrapper[5120]: I0316 17:39:21.067629 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a39cb762-65ab-4605-9a52-7a5c68da0509-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:39:21 crc kubenswrapper[5120]: I0316 17:39:21.073023 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a39cb762-65ab-4605-9a52-7a5c68da0509-kube-api-access-zwqxl" (OuterVolumeSpecName: "kube-api-access-zwqxl") pod "a39cb762-65ab-4605-9a52-7a5c68da0509" (UID: "a39cb762-65ab-4605-9a52-7a5c68da0509"). InnerVolumeSpecName "kube-api-access-zwqxl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:39:21 crc kubenswrapper[5120]: I0316 17:39:21.169397 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zwqxl\" (UniqueName: \"kubernetes.io/projected/a39cb762-65ab-4605-9a52-7a5c68da0509-kube-api-access-zwqxl\") on node \"crc\" DevicePath \"\"" Mar 16 17:39:21 crc kubenswrapper[5120]: I0316 17:39:21.648406 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican09c0-account-delete-bxs5n" Mar 16 17:39:21 crc kubenswrapper[5120]: I0316 17:39:21.648413 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican09c0-account-delete-bxs5n" event={"ID":"a39cb762-65ab-4605-9a52-7a5c68da0509","Type":"ContainerDied","Data":"8d43dab7d699d8e1a4ef8ea34115fc06866fe7da104697d62e7dc7c634a9b0da"} Mar 16 17:39:21 crc kubenswrapper[5120]: I0316 17:39:21.648540 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8d43dab7d699d8e1a4ef8ea34115fc06866fe7da104697d62e7dc7c634a9b0da" Mar 16 17:39:22 crc kubenswrapper[5120]: I0316 17:39:22.008444 5120 patch_prober.go:28] interesting pod/machine-config-daemon-7bf76 container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 17:39:22 crc kubenswrapper[5120]: I0316 17:39:22.008512 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 17:39:22 crc kubenswrapper[5120]: I0316 17:39:22.867902 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["barbican-kuttl-tests/barbican-db-create-5ttz8"] Mar 16 17:39:22 crc kubenswrapper[5120]: I0316 17:39:22.876234 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["barbican-kuttl-tests/barbican-db-create-5ttz8"] Mar 16 17:39:22 crc kubenswrapper[5120]: I0316 17:39:22.884257 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["barbican-kuttl-tests/barbican09c0-account-delete-bxs5n"] Mar 16 17:39:22 crc kubenswrapper[5120]: I0316 17:39:22.891405 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["barbican-kuttl-tests/barbican09c0-account-delete-bxs5n"] Mar 16 17:39:22 crc kubenswrapper[5120]: I0316 17:39:22.899076 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["barbican-kuttl-tests/barbican-09c0-account-create-update-gw84h"] Mar 16 17:39:22 crc kubenswrapper[5120]: I0316 17:39:22.906824 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["barbican-kuttl-tests/barbican-09c0-account-create-update-gw84h"] Mar 16 17:39:22 crc kubenswrapper[5120]: I0316 17:39:22.935568 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["barbican-kuttl-tests/barbican-db-create-bm9kt"] Mar 16 17:39:22 crc kubenswrapper[5120]: I0316 17:39:22.936734 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="443927da-114a-4656-9e75-0c2899a881c9" containerName="barbican-api-log" Mar 16 17:39:22 crc kubenswrapper[5120]: I0316 17:39:22.936753 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="443927da-114a-4656-9e75-0c2899a881c9" containerName="barbican-api-log" Mar 16 17:39:22 crc kubenswrapper[5120]: I0316 17:39:22.936790 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="443927da-114a-4656-9e75-0c2899a881c9" containerName="barbican-api" Mar 16 17:39:22 crc kubenswrapper[5120]: I0316 17:39:22.936798 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="443927da-114a-4656-9e75-0c2899a881c9" containerName="barbican-api" Mar 16 17:39:22 crc kubenswrapper[5120]: I0316 17:39:22.936818 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a39cb762-65ab-4605-9a52-7a5c68da0509" containerName="mariadb-account-delete" Mar 16 17:39:22 crc kubenswrapper[5120]: I0316 17:39:22.936826 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a39cb762-65ab-4605-9a52-7a5c68da0509" containerName="mariadb-account-delete" Mar 16 17:39:22 crc kubenswrapper[5120]: I0316 17:39:22.937003 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="a39cb762-65ab-4605-9a52-7a5c68da0509" containerName="mariadb-account-delete" Mar 16 17:39:22 crc kubenswrapper[5120]: I0316 17:39:22.937019 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="443927da-114a-4656-9e75-0c2899a881c9" containerName="barbican-api" Mar 16 17:39:22 crc kubenswrapper[5120]: I0316 17:39:22.937048 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="443927da-114a-4656-9e75-0c2899a881c9" containerName="barbican-api-log" Mar 16 17:39:22 crc kubenswrapper[5120]: I0316 17:39:22.944103 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican-db-create-bm9kt" Mar 16 17:39:22 crc kubenswrapper[5120]: I0316 17:39:22.944187 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["barbican-kuttl-tests/barbican-db-create-bm9kt"] Mar 16 17:39:23 crc kubenswrapper[5120]: I0316 17:39:23.035851 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["barbican-kuttl-tests/barbican-c827-account-create-update-5km6b"] Mar 16 17:39:23 crc kubenswrapper[5120]: I0316 17:39:23.040316 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican-c827-account-create-update-5km6b" Mar 16 17:39:23 crc kubenswrapper[5120]: I0316 17:39:23.044087 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"barbican-kuttl-tests\"/\"barbican-db-secret\"" Mar 16 17:39:23 crc kubenswrapper[5120]: I0316 17:39:23.045729 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["barbican-kuttl-tests/barbican-c827-account-create-update-5km6b"] Mar 16 17:39:23 crc kubenswrapper[5120]: I0316 17:39:23.124612 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjlvd\" (UniqueName: \"kubernetes.io/projected/3d936a6d-ab99-42ab-bf8f-0c11edd3208e-kube-api-access-kjlvd\") pod \"barbican-c827-account-create-update-5km6b\" (UID: \"3d936a6d-ab99-42ab-bf8f-0c11edd3208e\") " pod="barbican-kuttl-tests/barbican-c827-account-create-update-5km6b" Mar 16 17:39:23 crc kubenswrapper[5120]: I0316 17:39:23.125266 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c6dc1383-ac95-474b-9250-5ebb015b3988-operator-scripts\") pod \"barbican-db-create-bm9kt\" (UID: \"c6dc1383-ac95-474b-9250-5ebb015b3988\") " pod="barbican-kuttl-tests/barbican-db-create-bm9kt" Mar 16 17:39:23 crc kubenswrapper[5120]: I0316 17:39:23.125344 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3d936a6d-ab99-42ab-bf8f-0c11edd3208e-operator-scripts\") pod \"barbican-c827-account-create-update-5km6b\" (UID: \"3d936a6d-ab99-42ab-bf8f-0c11edd3208e\") " pod="barbican-kuttl-tests/barbican-c827-account-create-update-5km6b" Mar 16 17:39:23 crc kubenswrapper[5120]: I0316 17:39:23.126022 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjswh\" (UniqueName: \"kubernetes.io/projected/c6dc1383-ac95-474b-9250-5ebb015b3988-kube-api-access-rjswh\") pod \"barbican-db-create-bm9kt\" (UID: \"c6dc1383-ac95-474b-9250-5ebb015b3988\") " pod="barbican-kuttl-tests/barbican-db-create-bm9kt" Mar 16 17:39:23 crc kubenswrapper[5120]: I0316 17:39:23.229677 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3d936a6d-ab99-42ab-bf8f-0c11edd3208e-operator-scripts\") pod \"barbican-c827-account-create-update-5km6b\" (UID: \"3d936a6d-ab99-42ab-bf8f-0c11edd3208e\") " pod="barbican-kuttl-tests/barbican-c827-account-create-update-5km6b" Mar 16 17:39:23 crc kubenswrapper[5120]: I0316 17:39:23.230045 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rjswh\" (UniqueName: \"kubernetes.io/projected/c6dc1383-ac95-474b-9250-5ebb015b3988-kube-api-access-rjswh\") pod \"barbican-db-create-bm9kt\" (UID: \"c6dc1383-ac95-474b-9250-5ebb015b3988\") " pod="barbican-kuttl-tests/barbican-db-create-bm9kt" Mar 16 17:39:23 crc kubenswrapper[5120]: I0316 17:39:23.230270 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kjlvd\" (UniqueName: \"kubernetes.io/projected/3d936a6d-ab99-42ab-bf8f-0c11edd3208e-kube-api-access-kjlvd\") pod \"barbican-c827-account-create-update-5km6b\" (UID: \"3d936a6d-ab99-42ab-bf8f-0c11edd3208e\") " pod="barbican-kuttl-tests/barbican-c827-account-create-update-5km6b" Mar 16 17:39:23 crc kubenswrapper[5120]: I0316 17:39:23.230355 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c6dc1383-ac95-474b-9250-5ebb015b3988-operator-scripts\") pod \"barbican-db-create-bm9kt\" (UID: \"c6dc1383-ac95-474b-9250-5ebb015b3988\") " pod="barbican-kuttl-tests/barbican-db-create-bm9kt" Mar 16 17:39:23 crc kubenswrapper[5120]: I0316 17:39:23.230954 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3d936a6d-ab99-42ab-bf8f-0c11edd3208e-operator-scripts\") pod \"barbican-c827-account-create-update-5km6b\" (UID: \"3d936a6d-ab99-42ab-bf8f-0c11edd3208e\") " pod="barbican-kuttl-tests/barbican-c827-account-create-update-5km6b" Mar 16 17:39:23 crc kubenswrapper[5120]: I0316 17:39:23.231343 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c6dc1383-ac95-474b-9250-5ebb015b3988-operator-scripts\") pod \"barbican-db-create-bm9kt\" (UID: \"c6dc1383-ac95-474b-9250-5ebb015b3988\") " pod="barbican-kuttl-tests/barbican-db-create-bm9kt" Mar 16 17:39:23 crc kubenswrapper[5120]: I0316 17:39:23.250733 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjlvd\" (UniqueName: \"kubernetes.io/projected/3d936a6d-ab99-42ab-bf8f-0c11edd3208e-kube-api-access-kjlvd\") pod \"barbican-c827-account-create-update-5km6b\" (UID: \"3d936a6d-ab99-42ab-bf8f-0c11edd3208e\") " pod="barbican-kuttl-tests/barbican-c827-account-create-update-5km6b" Mar 16 17:39:23 crc kubenswrapper[5120]: I0316 17:39:23.259793 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjswh\" (UniqueName: \"kubernetes.io/projected/c6dc1383-ac95-474b-9250-5ebb015b3988-kube-api-access-rjswh\") pod \"barbican-db-create-bm9kt\" (UID: \"c6dc1383-ac95-474b-9250-5ebb015b3988\") " pod="barbican-kuttl-tests/barbican-db-create-bm9kt" Mar 16 17:39:23 crc kubenswrapper[5120]: I0316 17:39:23.265426 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican-db-create-bm9kt" Mar 16 17:39:23 crc kubenswrapper[5120]: I0316 17:39:23.363396 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican-c827-account-create-update-5km6b" Mar 16 17:39:23 crc kubenswrapper[5120]: I0316 17:39:23.678329 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["barbican-kuttl-tests/barbican-db-create-bm9kt"] Mar 16 17:39:23 crc kubenswrapper[5120]: W0316 17:39:23.682789 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc6dc1383_ac95_474b_9250_5ebb015b3988.slice/crio-7d9958af16334bdc1de08eedb1491712cbe5ed48fe5ed5b49772e0e252a1f7d1 WatchSource:0}: Error finding container 7d9958af16334bdc1de08eedb1491712cbe5ed48fe5ed5b49772e0e252a1f7d1: Status 404 returned error can't find the container with id 7d9958af16334bdc1de08eedb1491712cbe5ed48fe5ed5b49772e0e252a1f7d1 Mar 16 17:39:23 crc kubenswrapper[5120]: I0316 17:39:23.791827 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["barbican-kuttl-tests/barbican-c827-account-create-update-5km6b"] Mar 16 17:39:23 crc kubenswrapper[5120]: W0316 17:39:23.795348 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3d936a6d_ab99_42ab_bf8f_0c11edd3208e.slice/crio-1c8269f5aeaba2d7fb74316fc7be6e48186dd8ba0d621c4f88ae39d8c0f00ea9 WatchSource:0}: Error finding container 1c8269f5aeaba2d7fb74316fc7be6e48186dd8ba0d621c4f88ae39d8c0f00ea9: Status 404 returned error can't find the container with id 1c8269f5aeaba2d7fb74316fc7be6e48186dd8ba0d621c4f88ae39d8c0f00ea9 Mar 16 17:39:24 crc kubenswrapper[5120]: I0316 17:39:24.672442 5120 generic.go:358] "Generic (PLEG): container finished" podID="c6dc1383-ac95-474b-9250-5ebb015b3988" containerID="fb5529b06ccd386956a29b2fa0c0e4ec6e9daa531575fc26907da055afd1d0d8" exitCode=0 Mar 16 17:39:24 crc kubenswrapper[5120]: I0316 17:39:24.675297 5120 generic.go:358] "Generic (PLEG): container finished" podID="3d936a6d-ab99-42ab-bf8f-0c11edd3208e" containerID="1181810fdd099b1dbb67fa2eb917411cd0acb25ec73f9c84025527aa8e97f907" exitCode=0 Mar 16 17:39:24 crc kubenswrapper[5120]: I0316 17:39:24.676197 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="15bad79d-098b-4f11-afe6-1b22757d734d" path="/var/lib/kubelet/pods/15bad79d-098b-4f11-afe6-1b22757d734d/volumes" Mar 16 17:39:24 crc kubenswrapper[5120]: I0316 17:39:24.677101 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a39cb762-65ab-4605-9a52-7a5c68da0509" path="/var/lib/kubelet/pods/a39cb762-65ab-4605-9a52-7a5c68da0509/volumes" Mar 16 17:39:24 crc kubenswrapper[5120]: I0316 17:39:24.677712 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a536f6ad-6aba-444e-be60-e780d44dba89" path="/var/lib/kubelet/pods/a536f6ad-6aba-444e-be60-e780d44dba89/volumes" Mar 16 17:39:24 crc kubenswrapper[5120]: I0316 17:39:24.678168 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-db-create-bm9kt" event={"ID":"c6dc1383-ac95-474b-9250-5ebb015b3988","Type":"ContainerDied","Data":"fb5529b06ccd386956a29b2fa0c0e4ec6e9daa531575fc26907da055afd1d0d8"} Mar 16 17:39:24 crc kubenswrapper[5120]: I0316 17:39:24.678193 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-db-create-bm9kt" event={"ID":"c6dc1383-ac95-474b-9250-5ebb015b3988","Type":"ContainerStarted","Data":"7d9958af16334bdc1de08eedb1491712cbe5ed48fe5ed5b49772e0e252a1f7d1"} Mar 16 17:39:24 crc kubenswrapper[5120]: I0316 17:39:24.678203 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-c827-account-create-update-5km6b" event={"ID":"3d936a6d-ab99-42ab-bf8f-0c11edd3208e","Type":"ContainerDied","Data":"1181810fdd099b1dbb67fa2eb917411cd0acb25ec73f9c84025527aa8e97f907"} Mar 16 17:39:24 crc kubenswrapper[5120]: I0316 17:39:24.678212 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-c827-account-create-update-5km6b" event={"ID":"3d936a6d-ab99-42ab-bf8f-0c11edd3208e","Type":"ContainerStarted","Data":"1c8269f5aeaba2d7fb74316fc7be6e48186dd8ba0d621c4f88ae39d8c0f00ea9"} Mar 16 17:39:26 crc kubenswrapper[5120]: I0316 17:39:26.148836 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican-db-create-bm9kt" Mar 16 17:39:26 crc kubenswrapper[5120]: I0316 17:39:26.155430 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican-c827-account-create-update-5km6b" Mar 16 17:39:26 crc kubenswrapper[5120]: I0316 17:39:26.202569 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3d936a6d-ab99-42ab-bf8f-0c11edd3208e-operator-scripts\") pod \"3d936a6d-ab99-42ab-bf8f-0c11edd3208e\" (UID: \"3d936a6d-ab99-42ab-bf8f-0c11edd3208e\") " Mar 16 17:39:26 crc kubenswrapper[5120]: I0316 17:39:26.202883 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rjswh\" (UniqueName: \"kubernetes.io/projected/c6dc1383-ac95-474b-9250-5ebb015b3988-kube-api-access-rjswh\") pod \"c6dc1383-ac95-474b-9250-5ebb015b3988\" (UID: \"c6dc1383-ac95-474b-9250-5ebb015b3988\") " Mar 16 17:39:26 crc kubenswrapper[5120]: I0316 17:39:26.203242 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c6dc1383-ac95-474b-9250-5ebb015b3988-operator-scripts\") pod \"c6dc1383-ac95-474b-9250-5ebb015b3988\" (UID: \"c6dc1383-ac95-474b-9250-5ebb015b3988\") " Mar 16 17:39:26 crc kubenswrapper[5120]: I0316 17:39:26.203326 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kjlvd\" (UniqueName: \"kubernetes.io/projected/3d936a6d-ab99-42ab-bf8f-0c11edd3208e-kube-api-access-kjlvd\") pod \"3d936a6d-ab99-42ab-bf8f-0c11edd3208e\" (UID: \"3d936a6d-ab99-42ab-bf8f-0c11edd3208e\") " Mar 16 17:39:26 crc kubenswrapper[5120]: I0316 17:39:26.203893 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c6dc1383-ac95-474b-9250-5ebb015b3988-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "c6dc1383-ac95-474b-9250-5ebb015b3988" (UID: "c6dc1383-ac95-474b-9250-5ebb015b3988"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:39:26 crc kubenswrapper[5120]: I0316 17:39:26.204132 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c6dc1383-ac95-474b-9250-5ebb015b3988-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:39:26 crc kubenswrapper[5120]: I0316 17:39:26.204814 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d936a6d-ab99-42ab-bf8f-0c11edd3208e-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "3d936a6d-ab99-42ab-bf8f-0c11edd3208e" (UID: "3d936a6d-ab99-42ab-bf8f-0c11edd3208e"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:39:26 crc kubenswrapper[5120]: I0316 17:39:26.209274 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d936a6d-ab99-42ab-bf8f-0c11edd3208e-kube-api-access-kjlvd" (OuterVolumeSpecName: "kube-api-access-kjlvd") pod "3d936a6d-ab99-42ab-bf8f-0c11edd3208e" (UID: "3d936a6d-ab99-42ab-bf8f-0c11edd3208e"). InnerVolumeSpecName "kube-api-access-kjlvd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:39:26 crc kubenswrapper[5120]: I0316 17:39:26.209332 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6dc1383-ac95-474b-9250-5ebb015b3988-kube-api-access-rjswh" (OuterVolumeSpecName: "kube-api-access-rjswh") pod "c6dc1383-ac95-474b-9250-5ebb015b3988" (UID: "c6dc1383-ac95-474b-9250-5ebb015b3988"). InnerVolumeSpecName "kube-api-access-rjswh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:39:26 crc kubenswrapper[5120]: I0316 17:39:26.306349 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3d936a6d-ab99-42ab-bf8f-0c11edd3208e-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:39:26 crc kubenswrapper[5120]: I0316 17:39:26.306389 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rjswh\" (UniqueName: \"kubernetes.io/projected/c6dc1383-ac95-474b-9250-5ebb015b3988-kube-api-access-rjswh\") on node \"crc\" DevicePath \"\"" Mar 16 17:39:26 crc kubenswrapper[5120]: I0316 17:39:26.306400 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kjlvd\" (UniqueName: \"kubernetes.io/projected/3d936a6d-ab99-42ab-bf8f-0c11edd3208e-kube-api-access-kjlvd\") on node \"crc\" DevicePath \"\"" Mar 16 17:39:26 crc kubenswrapper[5120]: I0316 17:39:26.702160 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican-c827-account-create-update-5km6b" Mar 16 17:39:26 crc kubenswrapper[5120]: I0316 17:39:26.702163 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-c827-account-create-update-5km6b" event={"ID":"3d936a6d-ab99-42ab-bf8f-0c11edd3208e","Type":"ContainerDied","Data":"1c8269f5aeaba2d7fb74316fc7be6e48186dd8ba0d621c4f88ae39d8c0f00ea9"} Mar 16 17:39:26 crc kubenswrapper[5120]: I0316 17:39:26.702282 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1c8269f5aeaba2d7fb74316fc7be6e48186dd8ba0d621c4f88ae39d8c0f00ea9" Mar 16 17:39:26 crc kubenswrapper[5120]: I0316 17:39:26.709405 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-db-create-bm9kt" event={"ID":"c6dc1383-ac95-474b-9250-5ebb015b3988","Type":"ContainerDied","Data":"7d9958af16334bdc1de08eedb1491712cbe5ed48fe5ed5b49772e0e252a1f7d1"} Mar 16 17:39:26 crc kubenswrapper[5120]: I0316 17:39:26.709457 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7d9958af16334bdc1de08eedb1491712cbe5ed48fe5ed5b49772e0e252a1f7d1" Mar 16 17:39:26 crc kubenswrapper[5120]: I0316 17:39:26.709557 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican-db-create-bm9kt" Mar 16 17:39:28 crc kubenswrapper[5120]: I0316 17:39:28.315861 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["barbican-kuttl-tests/barbican-db-sync-vkrtl"] Mar 16 17:39:28 crc kubenswrapper[5120]: I0316 17:39:28.317425 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6dc1383-ac95-474b-9250-5ebb015b3988" containerName="mariadb-database-create" Mar 16 17:39:28 crc kubenswrapper[5120]: I0316 17:39:28.317451 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6dc1383-ac95-474b-9250-5ebb015b3988" containerName="mariadb-database-create" Mar 16 17:39:28 crc kubenswrapper[5120]: I0316 17:39:28.317486 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d936a6d-ab99-42ab-bf8f-0c11edd3208e" containerName="mariadb-account-create-update" Mar 16 17:39:28 crc kubenswrapper[5120]: I0316 17:39:28.317495 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d936a6d-ab99-42ab-bf8f-0c11edd3208e" containerName="mariadb-account-create-update" Mar 16 17:39:28 crc kubenswrapper[5120]: I0316 17:39:28.317703 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="3d936a6d-ab99-42ab-bf8f-0c11edd3208e" containerName="mariadb-account-create-update" Mar 16 17:39:28 crc kubenswrapper[5120]: I0316 17:39:28.317731 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c6dc1383-ac95-474b-9250-5ebb015b3988" containerName="mariadb-database-create" Mar 16 17:39:28 crc kubenswrapper[5120]: I0316 17:39:28.329230 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["barbican-kuttl-tests/barbican-db-sync-vkrtl"] Mar 16 17:39:28 crc kubenswrapper[5120]: I0316 17:39:28.329376 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican-db-sync-vkrtl" Mar 16 17:39:28 crc kubenswrapper[5120]: I0316 17:39:28.333119 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"barbican-kuttl-tests\"/\"combined-ca-bundle\"" Mar 16 17:39:28 crc kubenswrapper[5120]: I0316 17:39:28.333267 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"barbican-kuttl-tests\"/\"barbican-config-data\"" Mar 16 17:39:28 crc kubenswrapper[5120]: I0316 17:39:28.333469 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"barbican-kuttl-tests\"/\"barbican-barbican-dockercfg-xsccz\"" Mar 16 17:39:28 crc kubenswrapper[5120]: I0316 17:39:28.461690 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffjqp\" (UniqueName: \"kubernetes.io/projected/ad6f3e31-b54d-4420-82c4-a9fed8215abc-kube-api-access-ffjqp\") pod \"barbican-db-sync-vkrtl\" (UID: \"ad6f3e31-b54d-4420-82c4-a9fed8215abc\") " pod="barbican-kuttl-tests/barbican-db-sync-vkrtl" Mar 16 17:39:28 crc kubenswrapper[5120]: I0316 17:39:28.462053 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ad6f3e31-b54d-4420-82c4-a9fed8215abc-combined-ca-bundle\") pod \"barbican-db-sync-vkrtl\" (UID: \"ad6f3e31-b54d-4420-82c4-a9fed8215abc\") " pod="barbican-kuttl-tests/barbican-db-sync-vkrtl" Mar 16 17:39:28 crc kubenswrapper[5120]: I0316 17:39:28.462249 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/ad6f3e31-b54d-4420-82c4-a9fed8215abc-db-sync-config-data\") pod \"barbican-db-sync-vkrtl\" (UID: \"ad6f3e31-b54d-4420-82c4-a9fed8215abc\") " pod="barbican-kuttl-tests/barbican-db-sync-vkrtl" Mar 16 17:39:28 crc kubenswrapper[5120]: I0316 17:39:28.563947 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/ad6f3e31-b54d-4420-82c4-a9fed8215abc-db-sync-config-data\") pod \"barbican-db-sync-vkrtl\" (UID: \"ad6f3e31-b54d-4420-82c4-a9fed8215abc\") " pod="barbican-kuttl-tests/barbican-db-sync-vkrtl" Mar 16 17:39:28 crc kubenswrapper[5120]: I0316 17:39:28.564270 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ffjqp\" (UniqueName: \"kubernetes.io/projected/ad6f3e31-b54d-4420-82c4-a9fed8215abc-kube-api-access-ffjqp\") pod \"barbican-db-sync-vkrtl\" (UID: \"ad6f3e31-b54d-4420-82c4-a9fed8215abc\") " pod="barbican-kuttl-tests/barbican-db-sync-vkrtl" Mar 16 17:39:28 crc kubenswrapper[5120]: I0316 17:39:28.564406 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ad6f3e31-b54d-4420-82c4-a9fed8215abc-combined-ca-bundle\") pod \"barbican-db-sync-vkrtl\" (UID: \"ad6f3e31-b54d-4420-82c4-a9fed8215abc\") " pod="barbican-kuttl-tests/barbican-db-sync-vkrtl" Mar 16 17:39:28 crc kubenswrapper[5120]: I0316 17:39:28.572227 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ad6f3e31-b54d-4420-82c4-a9fed8215abc-combined-ca-bundle\") pod \"barbican-db-sync-vkrtl\" (UID: \"ad6f3e31-b54d-4420-82c4-a9fed8215abc\") " pod="barbican-kuttl-tests/barbican-db-sync-vkrtl" Mar 16 17:39:28 crc kubenswrapper[5120]: I0316 17:39:28.576385 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/ad6f3e31-b54d-4420-82c4-a9fed8215abc-db-sync-config-data\") pod \"barbican-db-sync-vkrtl\" (UID: \"ad6f3e31-b54d-4420-82c4-a9fed8215abc\") " pod="barbican-kuttl-tests/barbican-db-sync-vkrtl" Mar 16 17:39:28 crc kubenswrapper[5120]: I0316 17:39:28.583219 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffjqp\" (UniqueName: \"kubernetes.io/projected/ad6f3e31-b54d-4420-82c4-a9fed8215abc-kube-api-access-ffjqp\") pod \"barbican-db-sync-vkrtl\" (UID: \"ad6f3e31-b54d-4420-82c4-a9fed8215abc\") " pod="barbican-kuttl-tests/barbican-db-sync-vkrtl" Mar 16 17:39:28 crc kubenswrapper[5120]: I0316 17:39:28.655516 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican-db-sync-vkrtl" Mar 16 17:39:29 crc kubenswrapper[5120]: I0316 17:39:29.110096 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["barbican-kuttl-tests/barbican-db-sync-vkrtl"] Mar 16 17:39:29 crc kubenswrapper[5120]: I0316 17:39:29.735974 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-db-sync-vkrtl" event={"ID":"ad6f3e31-b54d-4420-82c4-a9fed8215abc","Type":"ContainerStarted","Data":"e3664e35bdc3cc3f089bfe8b1a975c0c3c22a7c309397d40090b08c9c037b2eb"} Mar 16 17:39:29 crc kubenswrapper[5120]: I0316 17:39:29.737545 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-db-sync-vkrtl" event={"ID":"ad6f3e31-b54d-4420-82c4-a9fed8215abc","Type":"ContainerStarted","Data":"e12e0b4710a2dc40c52eeba008ef6174fef030b4d7d33b0826b254ffc5c5a469"} Mar 16 17:39:29 crc kubenswrapper[5120]: I0316 17:39:29.753480 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="barbican-kuttl-tests/barbican-db-sync-vkrtl" podStartSLOduration=1.7534617639999999 podStartE2EDuration="1.753461764s" podCreationTimestamp="2026-03-16 17:39:28 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:39:29.7493101 +0000 UTC m=+7671.903241757" watchObservedRunningTime="2026-03-16 17:39:29.753461764 +0000 UTC m=+7671.907393421" Mar 16 17:39:30 crc kubenswrapper[5120]: I0316 17:39:30.746514 5120 generic.go:358] "Generic (PLEG): container finished" podID="ad6f3e31-b54d-4420-82c4-a9fed8215abc" containerID="e3664e35bdc3cc3f089bfe8b1a975c0c3c22a7c309397d40090b08c9c037b2eb" exitCode=0 Mar 16 17:39:30 crc kubenswrapper[5120]: I0316 17:39:30.746609 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-db-sync-vkrtl" event={"ID":"ad6f3e31-b54d-4420-82c4-a9fed8215abc","Type":"ContainerDied","Data":"e3664e35bdc3cc3f089bfe8b1a975c0c3c22a7c309397d40090b08c9c037b2eb"} Mar 16 17:39:32 crc kubenswrapper[5120]: I0316 17:39:32.085742 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican-db-sync-vkrtl" Mar 16 17:39:32 crc kubenswrapper[5120]: I0316 17:39:32.144309 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ad6f3e31-b54d-4420-82c4-a9fed8215abc-combined-ca-bundle\") pod \"ad6f3e31-b54d-4420-82c4-a9fed8215abc\" (UID: \"ad6f3e31-b54d-4420-82c4-a9fed8215abc\") " Mar 16 17:39:32 crc kubenswrapper[5120]: I0316 17:39:32.144381 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ffjqp\" (UniqueName: \"kubernetes.io/projected/ad6f3e31-b54d-4420-82c4-a9fed8215abc-kube-api-access-ffjqp\") pod \"ad6f3e31-b54d-4420-82c4-a9fed8215abc\" (UID: \"ad6f3e31-b54d-4420-82c4-a9fed8215abc\") " Mar 16 17:39:32 crc kubenswrapper[5120]: I0316 17:39:32.144859 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/ad6f3e31-b54d-4420-82c4-a9fed8215abc-db-sync-config-data\") pod \"ad6f3e31-b54d-4420-82c4-a9fed8215abc\" (UID: \"ad6f3e31-b54d-4420-82c4-a9fed8215abc\") " Mar 16 17:39:32 crc kubenswrapper[5120]: I0316 17:39:32.149786 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad6f3e31-b54d-4420-82c4-a9fed8215abc-db-sync-config-data" (OuterVolumeSpecName: "db-sync-config-data") pod "ad6f3e31-b54d-4420-82c4-a9fed8215abc" (UID: "ad6f3e31-b54d-4420-82c4-a9fed8215abc"). InnerVolumeSpecName "db-sync-config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:39:32 crc kubenswrapper[5120]: I0316 17:39:32.149952 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad6f3e31-b54d-4420-82c4-a9fed8215abc-kube-api-access-ffjqp" (OuterVolumeSpecName: "kube-api-access-ffjqp") pod "ad6f3e31-b54d-4420-82c4-a9fed8215abc" (UID: "ad6f3e31-b54d-4420-82c4-a9fed8215abc"). InnerVolumeSpecName "kube-api-access-ffjqp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:39:32 crc kubenswrapper[5120]: I0316 17:39:32.173890 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad6f3e31-b54d-4420-82c4-a9fed8215abc-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ad6f3e31-b54d-4420-82c4-a9fed8215abc" (UID: "ad6f3e31-b54d-4420-82c4-a9fed8215abc"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:39:32 crc kubenswrapper[5120]: I0316 17:39:32.247895 5120 reconciler_common.go:299] "Volume detached for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/ad6f3e31-b54d-4420-82c4-a9fed8215abc-db-sync-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:39:32 crc kubenswrapper[5120]: I0316 17:39:32.247936 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ad6f3e31-b54d-4420-82c4-a9fed8215abc-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:39:32 crc kubenswrapper[5120]: I0316 17:39:32.247950 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ffjqp\" (UniqueName: \"kubernetes.io/projected/ad6f3e31-b54d-4420-82c4-a9fed8215abc-kube-api-access-ffjqp\") on node \"crc\" DevicePath \"\"" Mar 16 17:39:32 crc kubenswrapper[5120]: I0316 17:39:32.765797 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-db-sync-vkrtl" event={"ID":"ad6f3e31-b54d-4420-82c4-a9fed8215abc","Type":"ContainerDied","Data":"e12e0b4710a2dc40c52eeba008ef6174fef030b4d7d33b0826b254ffc5c5a469"} Mar 16 17:39:32 crc kubenswrapper[5120]: I0316 17:39:32.766171 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e12e0b4710a2dc40c52eeba008ef6174fef030b4d7d33b0826b254ffc5c5a469" Mar 16 17:39:32 crc kubenswrapper[5120]: I0316 17:39:32.765928 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican-db-sync-vkrtl" Mar 16 17:39:33 crc kubenswrapper[5120]: I0316 17:39:33.010580 5120 scope.go:117] "RemoveContainer" containerID="c57eb7dddc67195d418162e2d16fa141010626fa7711768b3b7df6e1bbb05adc" Mar 16 17:39:33 crc kubenswrapper[5120]: I0316 17:39:33.080955 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["barbican-kuttl-tests/barbican-worker-5866d466f9-r2z6v"] Mar 16 17:39:33 crc kubenswrapper[5120]: I0316 17:39:33.084326 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad6f3e31-b54d-4420-82c4-a9fed8215abc" containerName="barbican-db-sync" Mar 16 17:39:33 crc kubenswrapper[5120]: I0316 17:39:33.084344 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad6f3e31-b54d-4420-82c4-a9fed8215abc" containerName="barbican-db-sync" Mar 16 17:39:33 crc kubenswrapper[5120]: I0316 17:39:33.087100 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ad6f3e31-b54d-4420-82c4-a9fed8215abc" containerName="barbican-db-sync" Mar 16 17:39:33 crc kubenswrapper[5120]: I0316 17:39:33.104934 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican-worker-5866d466f9-r2z6v" Mar 16 17:39:33 crc kubenswrapper[5120]: I0316 17:39:33.108021 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"barbican-kuttl-tests\"/\"combined-ca-bundle\"" Mar 16 17:39:33 crc kubenswrapper[5120]: I0316 17:39:33.108085 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"barbican-kuttl-tests\"/\"barbican-barbican-dockercfg-xsccz\"" Mar 16 17:39:33 crc kubenswrapper[5120]: I0316 17:39:33.108156 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"barbican-kuttl-tests\"/\"barbican-config-data\"" Mar 16 17:39:33 crc kubenswrapper[5120]: I0316 17:39:33.108016 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"barbican-kuttl-tests\"/\"barbican-worker-config-data\"" Mar 16 17:39:33 crc kubenswrapper[5120]: I0316 17:39:33.106099 5120 scope.go:117] "RemoveContainer" containerID="60de5df1e90cbdfe08141933bb121d01da9df592501b6c79e77f8e9251c7c405" Mar 16 17:39:33 crc kubenswrapper[5120]: I0316 17:39:33.119537 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["barbican-kuttl-tests/barbican-keystone-listener-7d5f6d9466-48jv5"] Mar 16 17:39:33 crc kubenswrapper[5120]: I0316 17:39:33.140741 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican-keystone-listener-7d5f6d9466-48jv5" Mar 16 17:39:33 crc kubenswrapper[5120]: I0316 17:39:33.144028 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"barbican-kuttl-tests\"/\"barbican-keystone-listener-config-data\"" Mar 16 17:39:33 crc kubenswrapper[5120]: I0316 17:39:33.146154 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["barbican-kuttl-tests/barbican-worker-5866d466f9-r2z6v"] Mar 16 17:39:33 crc kubenswrapper[5120]: I0316 17:39:33.154184 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["barbican-kuttl-tests/barbican-keystone-listener-7d5f6d9466-48jv5"] Mar 16 17:39:33 crc kubenswrapper[5120]: I0316 17:39:33.174518 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["barbican-kuttl-tests/barbican-api-549469d458-jkj4p"] Mar 16 17:39:33 crc kubenswrapper[5120]: I0316 17:39:33.181602 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican-api-549469d458-jkj4p" Mar 16 17:39:33 crc kubenswrapper[5120]: I0316 17:39:33.183047 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hknn4\" (UniqueName: \"kubernetes.io/projected/3e09c52a-e250-43b2-a04e-b05b6e59cd7f-kube-api-access-hknn4\") pod \"barbican-worker-5866d466f9-r2z6v\" (UID: \"3e09c52a-e250-43b2-a04e-b05b6e59cd7f\") " pod="barbican-kuttl-tests/barbican-worker-5866d466f9-r2z6v" Mar 16 17:39:33 crc kubenswrapper[5120]: I0316 17:39:33.183302 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/09958586-c0f4-4fff-b268-389577fd2a91-config-data-custom\") pod \"barbican-keystone-listener-7d5f6d9466-48jv5\" (UID: \"09958586-c0f4-4fff-b268-389577fd2a91\") " pod="barbican-kuttl-tests/barbican-keystone-listener-7d5f6d9466-48jv5" Mar 16 17:39:33 crc kubenswrapper[5120]: I0316 17:39:33.184594 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"barbican-kuttl-tests\"/\"barbican-api-config-data\"" Mar 16 17:39:33 crc kubenswrapper[5120]: I0316 17:39:33.185304 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3e09c52a-e250-43b2-a04e-b05b6e59cd7f-logs\") pod \"barbican-worker-5866d466f9-r2z6v\" (UID: \"3e09c52a-e250-43b2-a04e-b05b6e59cd7f\") " pod="barbican-kuttl-tests/barbican-worker-5866d466f9-r2z6v" Mar 16 17:39:33 crc kubenswrapper[5120]: I0316 17:39:33.185438 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjfcc\" (UniqueName: \"kubernetes.io/projected/09958586-c0f4-4fff-b268-389577fd2a91-kube-api-access-rjfcc\") pod \"barbican-keystone-listener-7d5f6d9466-48jv5\" (UID: \"09958586-c0f4-4fff-b268-389577fd2a91\") " pod="barbican-kuttl-tests/barbican-keystone-listener-7d5f6d9466-48jv5" Mar 16 17:39:33 crc kubenswrapper[5120]: I0316 17:39:33.185472 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"barbican-kuttl-tests\"/\"cert-barbican-public-svc\"" Mar 16 17:39:33 crc kubenswrapper[5120]: I0316 17:39:33.185536 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/09958586-c0f4-4fff-b268-389577fd2a91-combined-ca-bundle\") pod \"barbican-keystone-listener-7d5f6d9466-48jv5\" (UID: \"09958586-c0f4-4fff-b268-389577fd2a91\") " pod="barbican-kuttl-tests/barbican-keystone-listener-7d5f6d9466-48jv5" Mar 16 17:39:33 crc kubenswrapper[5120]: I0316 17:39:33.185852 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3e09c52a-e250-43b2-a04e-b05b6e59cd7f-config-data\") pod \"barbican-worker-5866d466f9-r2z6v\" (UID: \"3e09c52a-e250-43b2-a04e-b05b6e59cd7f\") " pod="barbican-kuttl-tests/barbican-worker-5866d466f9-r2z6v" Mar 16 17:39:33 crc kubenswrapper[5120]: I0316 17:39:33.185973 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3e09c52a-e250-43b2-a04e-b05b6e59cd7f-combined-ca-bundle\") pod \"barbican-worker-5866d466f9-r2z6v\" (UID: \"3e09c52a-e250-43b2-a04e-b05b6e59cd7f\") " pod="barbican-kuttl-tests/barbican-worker-5866d466f9-r2z6v" Mar 16 17:39:33 crc kubenswrapper[5120]: I0316 17:39:33.186483 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/3e09c52a-e250-43b2-a04e-b05b6e59cd7f-config-data-custom\") pod \"barbican-worker-5866d466f9-r2z6v\" (UID: \"3e09c52a-e250-43b2-a04e-b05b6e59cd7f\") " pod="barbican-kuttl-tests/barbican-worker-5866d466f9-r2z6v" Mar 16 17:39:33 crc kubenswrapper[5120]: I0316 17:39:33.186533 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/09958586-c0f4-4fff-b268-389577fd2a91-logs\") pod \"barbican-keystone-listener-7d5f6d9466-48jv5\" (UID: \"09958586-c0f4-4fff-b268-389577fd2a91\") " pod="barbican-kuttl-tests/barbican-keystone-listener-7d5f6d9466-48jv5" Mar 16 17:39:33 crc kubenswrapper[5120]: I0316 17:39:33.186580 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/09958586-c0f4-4fff-b268-389577fd2a91-config-data\") pod \"barbican-keystone-listener-7d5f6d9466-48jv5\" (UID: \"09958586-c0f4-4fff-b268-389577fd2a91\") " pod="barbican-kuttl-tests/barbican-keystone-listener-7d5f6d9466-48jv5" Mar 16 17:39:33 crc kubenswrapper[5120]: I0316 17:39:33.186974 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"barbican-kuttl-tests\"/\"cert-barbican-internal-svc\"" Mar 16 17:39:33 crc kubenswrapper[5120]: I0316 17:39:33.196111 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["barbican-kuttl-tests/barbican-api-549469d458-jkj4p"] Mar 16 17:39:33 crc kubenswrapper[5120]: I0316 17:39:33.289242 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/db8dee65-16da-4f71-9052-f116f524f253-internal-tls-certs\") pod \"barbican-api-549469d458-jkj4p\" (UID: \"db8dee65-16da-4f71-9052-f116f524f253\") " pod="barbican-kuttl-tests/barbican-api-549469d458-jkj4p" Mar 16 17:39:33 crc kubenswrapper[5120]: I0316 17:39:33.289686 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hknn4\" (UniqueName: \"kubernetes.io/projected/3e09c52a-e250-43b2-a04e-b05b6e59cd7f-kube-api-access-hknn4\") pod \"barbican-worker-5866d466f9-r2z6v\" (UID: \"3e09c52a-e250-43b2-a04e-b05b6e59cd7f\") " pod="barbican-kuttl-tests/barbican-worker-5866d466f9-r2z6v" Mar 16 17:39:33 crc kubenswrapper[5120]: I0316 17:39:33.289801 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/09958586-c0f4-4fff-b268-389577fd2a91-config-data-custom\") pod \"barbican-keystone-listener-7d5f6d9466-48jv5\" (UID: \"09958586-c0f4-4fff-b268-389577fd2a91\") " pod="barbican-kuttl-tests/barbican-keystone-listener-7d5f6d9466-48jv5" Mar 16 17:39:33 crc kubenswrapper[5120]: I0316 17:39:33.289823 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/db8dee65-16da-4f71-9052-f116f524f253-public-tls-certs\") pod \"barbican-api-549469d458-jkj4p\" (UID: \"db8dee65-16da-4f71-9052-f116f524f253\") " pod="barbican-kuttl-tests/barbican-api-549469d458-jkj4p" Mar 16 17:39:33 crc kubenswrapper[5120]: I0316 17:39:33.289876 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/db8dee65-16da-4f71-9052-f116f524f253-combined-ca-bundle\") pod \"barbican-api-549469d458-jkj4p\" (UID: \"db8dee65-16da-4f71-9052-f116f524f253\") " pod="barbican-kuttl-tests/barbican-api-549469d458-jkj4p" Mar 16 17:39:33 crc kubenswrapper[5120]: I0316 17:39:33.289939 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2h544\" (UniqueName: \"kubernetes.io/projected/db8dee65-16da-4f71-9052-f116f524f253-kube-api-access-2h544\") pod \"barbican-api-549469d458-jkj4p\" (UID: \"db8dee65-16da-4f71-9052-f116f524f253\") " pod="barbican-kuttl-tests/barbican-api-549469d458-jkj4p" Mar 16 17:39:33 crc kubenswrapper[5120]: I0316 17:39:33.289989 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3e09c52a-e250-43b2-a04e-b05b6e59cd7f-logs\") pod \"barbican-worker-5866d466f9-r2z6v\" (UID: \"3e09c52a-e250-43b2-a04e-b05b6e59cd7f\") " pod="barbican-kuttl-tests/barbican-worker-5866d466f9-r2z6v" Mar 16 17:39:33 crc kubenswrapper[5120]: I0316 17:39:33.290132 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/db8dee65-16da-4f71-9052-f116f524f253-config-data\") pod \"barbican-api-549469d458-jkj4p\" (UID: \"db8dee65-16da-4f71-9052-f116f524f253\") " pod="barbican-kuttl-tests/barbican-api-549469d458-jkj4p" Mar 16 17:39:33 crc kubenswrapper[5120]: I0316 17:39:33.290208 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rjfcc\" (UniqueName: \"kubernetes.io/projected/09958586-c0f4-4fff-b268-389577fd2a91-kube-api-access-rjfcc\") pod \"barbican-keystone-listener-7d5f6d9466-48jv5\" (UID: \"09958586-c0f4-4fff-b268-389577fd2a91\") " pod="barbican-kuttl-tests/barbican-keystone-listener-7d5f6d9466-48jv5" Mar 16 17:39:33 crc kubenswrapper[5120]: I0316 17:39:33.290271 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/db8dee65-16da-4f71-9052-f116f524f253-config-data-custom\") pod \"barbican-api-549469d458-jkj4p\" (UID: \"db8dee65-16da-4f71-9052-f116f524f253\") " pod="barbican-kuttl-tests/barbican-api-549469d458-jkj4p" Mar 16 17:39:33 crc kubenswrapper[5120]: I0316 17:39:33.290370 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/09958586-c0f4-4fff-b268-389577fd2a91-combined-ca-bundle\") pod \"barbican-keystone-listener-7d5f6d9466-48jv5\" (UID: \"09958586-c0f4-4fff-b268-389577fd2a91\") " pod="barbican-kuttl-tests/barbican-keystone-listener-7d5f6d9466-48jv5" Mar 16 17:39:33 crc kubenswrapper[5120]: I0316 17:39:33.290458 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3e09c52a-e250-43b2-a04e-b05b6e59cd7f-config-data\") pod \"barbican-worker-5866d466f9-r2z6v\" (UID: \"3e09c52a-e250-43b2-a04e-b05b6e59cd7f\") " pod="barbican-kuttl-tests/barbican-worker-5866d466f9-r2z6v" Mar 16 17:39:33 crc kubenswrapper[5120]: I0316 17:39:33.290520 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3e09c52a-e250-43b2-a04e-b05b6e59cd7f-combined-ca-bundle\") pod \"barbican-worker-5866d466f9-r2z6v\" (UID: \"3e09c52a-e250-43b2-a04e-b05b6e59cd7f\") " pod="barbican-kuttl-tests/barbican-worker-5866d466f9-r2z6v" Mar 16 17:39:33 crc kubenswrapper[5120]: I0316 17:39:33.290682 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3e09c52a-e250-43b2-a04e-b05b6e59cd7f-logs\") pod \"barbican-worker-5866d466f9-r2z6v\" (UID: \"3e09c52a-e250-43b2-a04e-b05b6e59cd7f\") " pod="barbican-kuttl-tests/barbican-worker-5866d466f9-r2z6v" Mar 16 17:39:33 crc kubenswrapper[5120]: I0316 17:39:33.290828 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/3e09c52a-e250-43b2-a04e-b05b6e59cd7f-config-data-custom\") pod \"barbican-worker-5866d466f9-r2z6v\" (UID: \"3e09c52a-e250-43b2-a04e-b05b6e59cd7f\") " pod="barbican-kuttl-tests/barbican-worker-5866d466f9-r2z6v" Mar 16 17:39:33 crc kubenswrapper[5120]: I0316 17:39:33.290884 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/db8dee65-16da-4f71-9052-f116f524f253-logs\") pod \"barbican-api-549469d458-jkj4p\" (UID: \"db8dee65-16da-4f71-9052-f116f524f253\") " pod="barbican-kuttl-tests/barbican-api-549469d458-jkj4p" Mar 16 17:39:33 crc kubenswrapper[5120]: I0316 17:39:33.290918 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/09958586-c0f4-4fff-b268-389577fd2a91-logs\") pod \"barbican-keystone-listener-7d5f6d9466-48jv5\" (UID: \"09958586-c0f4-4fff-b268-389577fd2a91\") " pod="barbican-kuttl-tests/barbican-keystone-listener-7d5f6d9466-48jv5" Mar 16 17:39:33 crc kubenswrapper[5120]: I0316 17:39:33.290987 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/09958586-c0f4-4fff-b268-389577fd2a91-config-data\") pod \"barbican-keystone-listener-7d5f6d9466-48jv5\" (UID: \"09958586-c0f4-4fff-b268-389577fd2a91\") " pod="barbican-kuttl-tests/barbican-keystone-listener-7d5f6d9466-48jv5" Mar 16 17:39:33 crc kubenswrapper[5120]: I0316 17:39:33.292954 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/09958586-c0f4-4fff-b268-389577fd2a91-logs\") pod \"barbican-keystone-listener-7d5f6d9466-48jv5\" (UID: \"09958586-c0f4-4fff-b268-389577fd2a91\") " pod="barbican-kuttl-tests/barbican-keystone-listener-7d5f6d9466-48jv5" Mar 16 17:39:33 crc kubenswrapper[5120]: I0316 17:39:33.297475 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3e09c52a-e250-43b2-a04e-b05b6e59cd7f-combined-ca-bundle\") pod \"barbican-worker-5866d466f9-r2z6v\" (UID: \"3e09c52a-e250-43b2-a04e-b05b6e59cd7f\") " pod="barbican-kuttl-tests/barbican-worker-5866d466f9-r2z6v" Mar 16 17:39:33 crc kubenswrapper[5120]: I0316 17:39:33.303482 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/09958586-c0f4-4fff-b268-389577fd2a91-combined-ca-bundle\") pod \"barbican-keystone-listener-7d5f6d9466-48jv5\" (UID: \"09958586-c0f4-4fff-b268-389577fd2a91\") " pod="barbican-kuttl-tests/barbican-keystone-listener-7d5f6d9466-48jv5" Mar 16 17:39:33 crc kubenswrapper[5120]: I0316 17:39:33.303506 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/09958586-c0f4-4fff-b268-389577fd2a91-config-data-custom\") pod \"barbican-keystone-listener-7d5f6d9466-48jv5\" (UID: \"09958586-c0f4-4fff-b268-389577fd2a91\") " pod="barbican-kuttl-tests/barbican-keystone-listener-7d5f6d9466-48jv5" Mar 16 17:39:33 crc kubenswrapper[5120]: I0316 17:39:33.304261 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/3e09c52a-e250-43b2-a04e-b05b6e59cd7f-config-data-custom\") pod \"barbican-worker-5866d466f9-r2z6v\" (UID: \"3e09c52a-e250-43b2-a04e-b05b6e59cd7f\") " pod="barbican-kuttl-tests/barbican-worker-5866d466f9-r2z6v" Mar 16 17:39:33 crc kubenswrapper[5120]: I0316 17:39:33.304472 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3e09c52a-e250-43b2-a04e-b05b6e59cd7f-config-data\") pod \"barbican-worker-5866d466f9-r2z6v\" (UID: \"3e09c52a-e250-43b2-a04e-b05b6e59cd7f\") " pod="barbican-kuttl-tests/barbican-worker-5866d466f9-r2z6v" Mar 16 17:39:33 crc kubenswrapper[5120]: I0316 17:39:33.304544 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/09958586-c0f4-4fff-b268-389577fd2a91-config-data\") pod \"barbican-keystone-listener-7d5f6d9466-48jv5\" (UID: \"09958586-c0f4-4fff-b268-389577fd2a91\") " pod="barbican-kuttl-tests/barbican-keystone-listener-7d5f6d9466-48jv5" Mar 16 17:39:33 crc kubenswrapper[5120]: I0316 17:39:33.310355 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjfcc\" (UniqueName: \"kubernetes.io/projected/09958586-c0f4-4fff-b268-389577fd2a91-kube-api-access-rjfcc\") pod \"barbican-keystone-listener-7d5f6d9466-48jv5\" (UID: \"09958586-c0f4-4fff-b268-389577fd2a91\") " pod="barbican-kuttl-tests/barbican-keystone-listener-7d5f6d9466-48jv5" Mar 16 17:39:33 crc kubenswrapper[5120]: I0316 17:39:33.312354 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hknn4\" (UniqueName: \"kubernetes.io/projected/3e09c52a-e250-43b2-a04e-b05b6e59cd7f-kube-api-access-hknn4\") pod \"barbican-worker-5866d466f9-r2z6v\" (UID: \"3e09c52a-e250-43b2-a04e-b05b6e59cd7f\") " pod="barbican-kuttl-tests/barbican-worker-5866d466f9-r2z6v" Mar 16 17:39:33 crc kubenswrapper[5120]: I0316 17:39:33.393834 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/db8dee65-16da-4f71-9052-f116f524f253-public-tls-certs\") pod \"barbican-api-549469d458-jkj4p\" (UID: \"db8dee65-16da-4f71-9052-f116f524f253\") " pod="barbican-kuttl-tests/barbican-api-549469d458-jkj4p" Mar 16 17:39:33 crc kubenswrapper[5120]: I0316 17:39:33.393939 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/db8dee65-16da-4f71-9052-f116f524f253-combined-ca-bundle\") pod \"barbican-api-549469d458-jkj4p\" (UID: \"db8dee65-16da-4f71-9052-f116f524f253\") " pod="barbican-kuttl-tests/barbican-api-549469d458-jkj4p" Mar 16 17:39:33 crc kubenswrapper[5120]: I0316 17:39:33.394020 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2h544\" (UniqueName: \"kubernetes.io/projected/db8dee65-16da-4f71-9052-f116f524f253-kube-api-access-2h544\") pod \"barbican-api-549469d458-jkj4p\" (UID: \"db8dee65-16da-4f71-9052-f116f524f253\") " pod="barbican-kuttl-tests/barbican-api-549469d458-jkj4p" Mar 16 17:39:33 crc kubenswrapper[5120]: I0316 17:39:33.394093 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/db8dee65-16da-4f71-9052-f116f524f253-config-data\") pod \"barbican-api-549469d458-jkj4p\" (UID: \"db8dee65-16da-4f71-9052-f116f524f253\") " pod="barbican-kuttl-tests/barbican-api-549469d458-jkj4p" Mar 16 17:39:33 crc kubenswrapper[5120]: I0316 17:39:33.394189 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/db8dee65-16da-4f71-9052-f116f524f253-config-data-custom\") pod \"barbican-api-549469d458-jkj4p\" (UID: \"db8dee65-16da-4f71-9052-f116f524f253\") " pod="barbican-kuttl-tests/barbican-api-549469d458-jkj4p" Mar 16 17:39:33 crc kubenswrapper[5120]: I0316 17:39:33.394496 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/db8dee65-16da-4f71-9052-f116f524f253-logs\") pod \"barbican-api-549469d458-jkj4p\" (UID: \"db8dee65-16da-4f71-9052-f116f524f253\") " pod="barbican-kuttl-tests/barbican-api-549469d458-jkj4p" Mar 16 17:39:33 crc kubenswrapper[5120]: I0316 17:39:33.394597 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/db8dee65-16da-4f71-9052-f116f524f253-internal-tls-certs\") pod \"barbican-api-549469d458-jkj4p\" (UID: \"db8dee65-16da-4f71-9052-f116f524f253\") " pod="barbican-kuttl-tests/barbican-api-549469d458-jkj4p" Mar 16 17:39:33 crc kubenswrapper[5120]: I0316 17:39:33.394958 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/db8dee65-16da-4f71-9052-f116f524f253-logs\") pod \"barbican-api-549469d458-jkj4p\" (UID: \"db8dee65-16da-4f71-9052-f116f524f253\") " pod="barbican-kuttl-tests/barbican-api-549469d458-jkj4p" Mar 16 17:39:33 crc kubenswrapper[5120]: I0316 17:39:33.398339 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/db8dee65-16da-4f71-9052-f116f524f253-public-tls-certs\") pod \"barbican-api-549469d458-jkj4p\" (UID: \"db8dee65-16da-4f71-9052-f116f524f253\") " pod="barbican-kuttl-tests/barbican-api-549469d458-jkj4p" Mar 16 17:39:33 crc kubenswrapper[5120]: I0316 17:39:33.398684 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/db8dee65-16da-4f71-9052-f116f524f253-combined-ca-bundle\") pod \"barbican-api-549469d458-jkj4p\" (UID: \"db8dee65-16da-4f71-9052-f116f524f253\") " pod="barbican-kuttl-tests/barbican-api-549469d458-jkj4p" Mar 16 17:39:33 crc kubenswrapper[5120]: I0316 17:39:33.398891 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/db8dee65-16da-4f71-9052-f116f524f253-config-data\") pod \"barbican-api-549469d458-jkj4p\" (UID: \"db8dee65-16da-4f71-9052-f116f524f253\") " pod="barbican-kuttl-tests/barbican-api-549469d458-jkj4p" Mar 16 17:39:33 crc kubenswrapper[5120]: I0316 17:39:33.398915 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/db8dee65-16da-4f71-9052-f116f524f253-config-data-custom\") pod \"barbican-api-549469d458-jkj4p\" (UID: \"db8dee65-16da-4f71-9052-f116f524f253\") " pod="barbican-kuttl-tests/barbican-api-549469d458-jkj4p" Mar 16 17:39:33 crc kubenswrapper[5120]: I0316 17:39:33.400724 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/db8dee65-16da-4f71-9052-f116f524f253-internal-tls-certs\") pod \"barbican-api-549469d458-jkj4p\" (UID: \"db8dee65-16da-4f71-9052-f116f524f253\") " pod="barbican-kuttl-tests/barbican-api-549469d458-jkj4p" Mar 16 17:39:33 crc kubenswrapper[5120]: I0316 17:39:33.415279 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2h544\" (UniqueName: \"kubernetes.io/projected/db8dee65-16da-4f71-9052-f116f524f253-kube-api-access-2h544\") pod \"barbican-api-549469d458-jkj4p\" (UID: \"db8dee65-16da-4f71-9052-f116f524f253\") " pod="barbican-kuttl-tests/barbican-api-549469d458-jkj4p" Mar 16 17:39:33 crc kubenswrapper[5120]: I0316 17:39:33.435679 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican-worker-5866d466f9-r2z6v" Mar 16 17:39:33 crc kubenswrapper[5120]: I0316 17:39:33.493379 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican-keystone-listener-7d5f6d9466-48jv5" Mar 16 17:39:33 crc kubenswrapper[5120]: I0316 17:39:33.507790 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican-api-549469d458-jkj4p" Mar 16 17:39:33 crc kubenswrapper[5120]: I0316 17:39:33.695480 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["barbican-kuttl-tests/barbican-db-sync-vkrtl"] Mar 16 17:39:33 crc kubenswrapper[5120]: I0316 17:39:33.704722 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["barbican-kuttl-tests/barbican-db-sync-vkrtl"] Mar 16 17:39:33 crc kubenswrapper[5120]: I0316 17:39:33.734786 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["barbican-kuttl-tests/barbicanc827-account-delete-qsph2"] Mar 16 17:39:33 crc kubenswrapper[5120]: I0316 17:39:33.747130 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbicanc827-account-delete-qsph2" Mar 16 17:39:33 crc kubenswrapper[5120]: I0316 17:39:33.766781 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["barbican-kuttl-tests/barbicanc827-account-delete-qsph2"] Mar 16 17:39:33 crc kubenswrapper[5120]: I0316 17:39:33.799091 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["barbican-kuttl-tests/barbican-api-549469d458-jkj4p"] Mar 16 17:39:33 crc kubenswrapper[5120]: I0316 17:39:33.802877 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["barbican-kuttl-tests/barbican-worker-5866d466f9-r2z6v"] Mar 16 17:39:33 crc kubenswrapper[5120]: I0316 17:39:33.809335 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpw7s\" (UniqueName: \"kubernetes.io/projected/143cd239-bf99-447d-b5c2-b42fc98cfc37-kube-api-access-xpw7s\") pod \"barbicanc827-account-delete-qsph2\" (UID: \"143cd239-bf99-447d-b5c2-b42fc98cfc37\") " pod="barbican-kuttl-tests/barbicanc827-account-delete-qsph2" Mar 16 17:39:33 crc kubenswrapper[5120]: I0316 17:39:33.809410 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/143cd239-bf99-447d-b5c2-b42fc98cfc37-operator-scripts\") pod \"barbicanc827-account-delete-qsph2\" (UID: \"143cd239-bf99-447d-b5c2-b42fc98cfc37\") " pod="barbican-kuttl-tests/barbicanc827-account-delete-qsph2" Mar 16 17:39:33 crc kubenswrapper[5120]: I0316 17:39:33.810742 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["barbican-kuttl-tests/barbican-keystone-listener-7d5f6d9466-48jv5"] Mar 16 17:39:33 crc kubenswrapper[5120]: I0316 17:39:33.900225 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["barbican-kuttl-tests/barbican-worker-5866d466f9-r2z6v"] Mar 16 17:39:33 crc kubenswrapper[5120]: I0316 17:39:33.912816 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xpw7s\" (UniqueName: \"kubernetes.io/projected/143cd239-bf99-447d-b5c2-b42fc98cfc37-kube-api-access-xpw7s\") pod \"barbicanc827-account-delete-qsph2\" (UID: \"143cd239-bf99-447d-b5c2-b42fc98cfc37\") " pod="barbican-kuttl-tests/barbicanc827-account-delete-qsph2" Mar 16 17:39:33 crc kubenswrapper[5120]: I0316 17:39:33.912892 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/143cd239-bf99-447d-b5c2-b42fc98cfc37-operator-scripts\") pod \"barbicanc827-account-delete-qsph2\" (UID: \"143cd239-bf99-447d-b5c2-b42fc98cfc37\") " pod="barbican-kuttl-tests/barbicanc827-account-delete-qsph2" Mar 16 17:39:33 crc kubenswrapper[5120]: I0316 17:39:33.915964 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/143cd239-bf99-447d-b5c2-b42fc98cfc37-operator-scripts\") pod \"barbicanc827-account-delete-qsph2\" (UID: \"143cd239-bf99-447d-b5c2-b42fc98cfc37\") " pod="barbican-kuttl-tests/barbicanc827-account-delete-qsph2" Mar 16 17:39:33 crc kubenswrapper[5120]: I0316 17:39:33.939376 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpw7s\" (UniqueName: \"kubernetes.io/projected/143cd239-bf99-447d-b5c2-b42fc98cfc37-kube-api-access-xpw7s\") pod \"barbicanc827-account-delete-qsph2\" (UID: \"143cd239-bf99-447d-b5c2-b42fc98cfc37\") " pod="barbican-kuttl-tests/barbicanc827-account-delete-qsph2" Mar 16 17:39:34 crc kubenswrapper[5120]: I0316 17:39:34.080525 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbicanc827-account-delete-qsph2" Mar 16 17:39:34 crc kubenswrapper[5120]: I0316 17:39:34.100099 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["barbican-kuttl-tests/barbican-keystone-listener-7d5f6d9466-48jv5"] Mar 16 17:39:34 crc kubenswrapper[5120]: I0316 17:39:34.247173 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["barbican-kuttl-tests/barbican-api-549469d458-jkj4p"] Mar 16 17:39:34 crc kubenswrapper[5120]: I0316 17:39:34.526617 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["barbican-kuttl-tests/barbicanc827-account-delete-qsph2"] Mar 16 17:39:34 crc kubenswrapper[5120]: W0316 17:39:34.528994 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod143cd239_bf99_447d_b5c2_b42fc98cfc37.slice/crio-ce87f9c58743e8a7732d1159dcc39e21438704e5d8b11fd77dc797949a3630eb WatchSource:0}: Error finding container ce87f9c58743e8a7732d1159dcc39e21438704e5d8b11fd77dc797949a3630eb: Status 404 returned error can't find the container with id ce87f9c58743e8a7732d1159dcc39e21438704e5d8b11fd77dc797949a3630eb Mar 16 17:39:34 crc kubenswrapper[5120]: I0316 17:39:34.675228 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ad6f3e31-b54d-4420-82c4-a9fed8215abc" path="/var/lib/kubelet/pods/ad6f3e31-b54d-4420-82c4-a9fed8215abc/volumes" Mar 16 17:39:34 crc kubenswrapper[5120]: I0316 17:39:34.786058 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-keystone-listener-7d5f6d9466-48jv5" event={"ID":"09958586-c0f4-4fff-b268-389577fd2a91","Type":"ContainerStarted","Data":"f4e2e1b6150cbc31927dd5089571c0c7255f51042e2c0b5a955b4a4f6c5c5b93"} Mar 16 17:39:34 crc kubenswrapper[5120]: I0316 17:39:34.786103 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="barbican-kuttl-tests/barbican-keystone-listener-7d5f6d9466-48jv5" podUID="09958586-c0f4-4fff-b268-389577fd2a91" containerName="barbican-keystone-listener-log" containerID="cri-o://a9c894f4e0c13374fce1e284fdc2a01ab64b6f48de7fbc4f7a01b17f65d80fc0" gracePeriod=30 Mar 16 17:39:34 crc kubenswrapper[5120]: I0316 17:39:34.786124 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-keystone-listener-7d5f6d9466-48jv5" event={"ID":"09958586-c0f4-4fff-b268-389577fd2a91","Type":"ContainerStarted","Data":"a9c894f4e0c13374fce1e284fdc2a01ab64b6f48de7fbc4f7a01b17f65d80fc0"} Mar 16 17:39:34 crc kubenswrapper[5120]: I0316 17:39:34.786147 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-keystone-listener-7d5f6d9466-48jv5" event={"ID":"09958586-c0f4-4fff-b268-389577fd2a91","Type":"ContainerStarted","Data":"98eb3dacf68fe8f25e26cbb6d3571af6d1f1781a4709ec20b8b8923132b05b13"} Mar 16 17:39:34 crc kubenswrapper[5120]: I0316 17:39:34.786189 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="barbican-kuttl-tests/barbican-keystone-listener-7d5f6d9466-48jv5" podUID="09958586-c0f4-4fff-b268-389577fd2a91" containerName="barbican-keystone-listener" containerID="cri-o://f4e2e1b6150cbc31927dd5089571c0c7255f51042e2c0b5a955b4a4f6c5c5b93" gracePeriod=30 Mar 16 17:39:34 crc kubenswrapper[5120]: I0316 17:39:34.793826 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-api-549469d458-jkj4p" event={"ID":"db8dee65-16da-4f71-9052-f116f524f253","Type":"ContainerStarted","Data":"c7bc957d61fb55a4fe88520d907f9e230a35b56db6b1d43b650dc89440ca0058"} Mar 16 17:39:34 crc kubenswrapper[5120]: I0316 17:39:34.793879 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-api-549469d458-jkj4p" event={"ID":"db8dee65-16da-4f71-9052-f116f524f253","Type":"ContainerStarted","Data":"5298628aab1992774b14733faab8077e5852074c5f2e9ab7ea4922eed7afa17d"} Mar 16 17:39:34 crc kubenswrapper[5120]: I0316 17:39:34.793892 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-api-549469d458-jkj4p" event={"ID":"db8dee65-16da-4f71-9052-f116f524f253","Type":"ContainerStarted","Data":"aa5aef6a109d5165d8ac2615d086183057d26b84a6ecbcc0e53bcaf5fc02f64a"} Mar 16 17:39:34 crc kubenswrapper[5120]: I0316 17:39:34.794066 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="barbican-kuttl-tests/barbican-api-549469d458-jkj4p" podUID="db8dee65-16da-4f71-9052-f116f524f253" containerName="barbican-api-log" containerID="cri-o://5298628aab1992774b14733faab8077e5852074c5f2e9ab7ea4922eed7afa17d" gracePeriod=30 Mar 16 17:39:34 crc kubenswrapper[5120]: I0316 17:39:34.794154 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="barbican-kuttl-tests/barbican-api-549469d458-jkj4p" Mar 16 17:39:34 crc kubenswrapper[5120]: I0316 17:39:34.794175 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="barbican-kuttl-tests/barbican-api-549469d458-jkj4p" Mar 16 17:39:34 crc kubenswrapper[5120]: I0316 17:39:34.794215 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="barbican-kuttl-tests/barbican-api-549469d458-jkj4p" podUID="db8dee65-16da-4f71-9052-f116f524f253" containerName="barbican-api" containerID="cri-o://c7bc957d61fb55a4fe88520d907f9e230a35b56db6b1d43b650dc89440ca0058" gracePeriod=30 Mar 16 17:39:34 crc kubenswrapper[5120]: I0316 17:39:34.808886 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-worker-5866d466f9-r2z6v" event={"ID":"3e09c52a-e250-43b2-a04e-b05b6e59cd7f","Type":"ContainerStarted","Data":"a9d769d20efdaed37cb4cf4f248a79c6abe427926d988d980ae0304d7462e149"} Mar 16 17:39:34 crc kubenswrapper[5120]: I0316 17:39:34.808931 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-worker-5866d466f9-r2z6v" event={"ID":"3e09c52a-e250-43b2-a04e-b05b6e59cd7f","Type":"ContainerStarted","Data":"80b0d9679716950c18f988791bd25967593d029a0e2e93491cbd3f97fe91028b"} Mar 16 17:39:34 crc kubenswrapper[5120]: I0316 17:39:34.808940 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-worker-5866d466f9-r2z6v" event={"ID":"3e09c52a-e250-43b2-a04e-b05b6e59cd7f","Type":"ContainerStarted","Data":"03f40d55585df4a404e3864ac01d463980f51df1eda1799d339448114bb1ab68"} Mar 16 17:39:34 crc kubenswrapper[5120]: I0316 17:39:34.809147 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="barbican-kuttl-tests/barbican-worker-5866d466f9-r2z6v" podUID="3e09c52a-e250-43b2-a04e-b05b6e59cd7f" containerName="barbican-worker-log" containerID="cri-o://80b0d9679716950c18f988791bd25967593d029a0e2e93491cbd3f97fe91028b" gracePeriod=30 Mar 16 17:39:34 crc kubenswrapper[5120]: I0316 17:39:34.809175 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="barbican-kuttl-tests/barbican-worker-5866d466f9-r2z6v" podUID="3e09c52a-e250-43b2-a04e-b05b6e59cd7f" containerName="barbican-worker" containerID="cri-o://a9d769d20efdaed37cb4cf4f248a79c6abe427926d988d980ae0304d7462e149" gracePeriod=30 Mar 16 17:39:34 crc kubenswrapper[5120]: I0316 17:39:34.818888 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbicanc827-account-delete-qsph2" event={"ID":"143cd239-bf99-447d-b5c2-b42fc98cfc37","Type":"ContainerStarted","Data":"070e279de08417c73d03724005b14805ad69bee00fe5b12f75f7847aa14e717a"} Mar 16 17:39:34 crc kubenswrapper[5120]: I0316 17:39:34.818933 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbicanc827-account-delete-qsph2" event={"ID":"143cd239-bf99-447d-b5c2-b42fc98cfc37","Type":"ContainerStarted","Data":"ce87f9c58743e8a7732d1159dcc39e21438704e5d8b11fd77dc797949a3630eb"} Mar 16 17:39:34 crc kubenswrapper[5120]: I0316 17:39:34.827107 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="barbican-kuttl-tests/barbican-keystone-listener-7d5f6d9466-48jv5" podStartSLOduration=1.8270847350000001 podStartE2EDuration="1.827084735s" podCreationTimestamp="2026-03-16 17:39:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:39:34.820048892 +0000 UTC m=+7676.973980549" watchObservedRunningTime="2026-03-16 17:39:34.827084735 +0000 UTC m=+7676.981016392" Mar 16 17:39:34 crc kubenswrapper[5120]: I0316 17:39:34.855168 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="barbican-kuttl-tests/barbican-api-549469d458-jkj4p" podStartSLOduration=1.8551471510000002 podStartE2EDuration="1.855147151s" podCreationTimestamp="2026-03-16 17:39:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:39:34.844760167 +0000 UTC m=+7676.998691824" watchObservedRunningTime="2026-03-16 17:39:34.855147151 +0000 UTC m=+7677.009078828" Mar 16 17:39:34 crc kubenswrapper[5120]: I0316 17:39:34.869938 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="barbican-kuttl-tests/barbicanc827-account-delete-qsph2" podStartSLOduration=1.8699154839999999 podStartE2EDuration="1.869915484s" podCreationTimestamp="2026-03-16 17:39:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:39:34.860952349 +0000 UTC m=+7677.014884006" watchObservedRunningTime="2026-03-16 17:39:34.869915484 +0000 UTC m=+7677.023847141" Mar 16 17:39:34 crc kubenswrapper[5120]: I0316 17:39:34.888012 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="barbican-kuttl-tests/barbican-worker-5866d466f9-r2z6v" podStartSLOduration=1.8879863669999999 podStartE2EDuration="1.887986367s" podCreationTimestamp="2026-03-16 17:39:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:39:34.883377442 +0000 UTC m=+7677.037309099" watchObservedRunningTime="2026-03-16 17:39:34.887986367 +0000 UTC m=+7677.041918024" Mar 16 17:39:35 crc kubenswrapper[5120]: I0316 17:39:35.827440 5120 generic.go:358] "Generic (PLEG): container finished" podID="143cd239-bf99-447d-b5c2-b42fc98cfc37" containerID="070e279de08417c73d03724005b14805ad69bee00fe5b12f75f7847aa14e717a" exitCode=0 Mar 16 17:39:35 crc kubenswrapper[5120]: I0316 17:39:35.827590 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbicanc827-account-delete-qsph2" event={"ID":"143cd239-bf99-447d-b5c2-b42fc98cfc37","Type":"ContainerDied","Data":"070e279de08417c73d03724005b14805ad69bee00fe5b12f75f7847aa14e717a"} Mar 16 17:39:35 crc kubenswrapper[5120]: I0316 17:39:35.830597 5120 generic.go:358] "Generic (PLEG): container finished" podID="09958586-c0f4-4fff-b268-389577fd2a91" containerID="a9c894f4e0c13374fce1e284fdc2a01ab64b6f48de7fbc4f7a01b17f65d80fc0" exitCode=143 Mar 16 17:39:35 crc kubenswrapper[5120]: I0316 17:39:35.830683 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-keystone-listener-7d5f6d9466-48jv5" event={"ID":"09958586-c0f4-4fff-b268-389577fd2a91","Type":"ContainerDied","Data":"a9c894f4e0c13374fce1e284fdc2a01ab64b6f48de7fbc4f7a01b17f65d80fc0"} Mar 16 17:39:35 crc kubenswrapper[5120]: I0316 17:39:35.833143 5120 generic.go:358] "Generic (PLEG): container finished" podID="db8dee65-16da-4f71-9052-f116f524f253" containerID="5298628aab1992774b14733faab8077e5852074c5f2e9ab7ea4922eed7afa17d" exitCode=143 Mar 16 17:39:35 crc kubenswrapper[5120]: I0316 17:39:35.833184 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-api-549469d458-jkj4p" event={"ID":"db8dee65-16da-4f71-9052-f116f524f253","Type":"ContainerDied","Data":"5298628aab1992774b14733faab8077e5852074c5f2e9ab7ea4922eed7afa17d"} Mar 16 17:39:35 crc kubenswrapper[5120]: I0316 17:39:35.834951 5120 generic.go:358] "Generic (PLEG): container finished" podID="3e09c52a-e250-43b2-a04e-b05b6e59cd7f" containerID="80b0d9679716950c18f988791bd25967593d029a0e2e93491cbd3f97fe91028b" exitCode=143 Mar 16 17:39:35 crc kubenswrapper[5120]: I0316 17:39:35.835139 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-worker-5866d466f9-r2z6v" event={"ID":"3e09c52a-e250-43b2-a04e-b05b6e59cd7f","Type":"ContainerDied","Data":"80b0d9679716950c18f988791bd25967593d029a0e2e93491cbd3f97fe91028b"} Mar 16 17:39:36 crc kubenswrapper[5120]: I0316 17:39:36.401295 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican-worker-5866d466f9-r2z6v" Mar 16 17:39:36 crc kubenswrapper[5120]: I0316 17:39:36.409053 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican-keystone-listener-7d5f6d9466-48jv5" Mar 16 17:39:36 crc kubenswrapper[5120]: I0316 17:39:36.579441 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/09958586-c0f4-4fff-b268-389577fd2a91-config-data\") pod \"09958586-c0f4-4fff-b268-389577fd2a91\" (UID: \"09958586-c0f4-4fff-b268-389577fd2a91\") " Mar 16 17:39:36 crc kubenswrapper[5120]: I0316 17:39:36.579796 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/09958586-c0f4-4fff-b268-389577fd2a91-combined-ca-bundle\") pod \"09958586-c0f4-4fff-b268-389577fd2a91\" (UID: \"09958586-c0f4-4fff-b268-389577fd2a91\") " Mar 16 17:39:36 crc kubenswrapper[5120]: I0316 17:39:36.579894 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3e09c52a-e250-43b2-a04e-b05b6e59cd7f-logs\") pod \"3e09c52a-e250-43b2-a04e-b05b6e59cd7f\" (UID: \"3e09c52a-e250-43b2-a04e-b05b6e59cd7f\") " Mar 16 17:39:36 crc kubenswrapper[5120]: I0316 17:39:36.579973 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3e09c52a-e250-43b2-a04e-b05b6e59cd7f-combined-ca-bundle\") pod \"3e09c52a-e250-43b2-a04e-b05b6e59cd7f\" (UID: \"3e09c52a-e250-43b2-a04e-b05b6e59cd7f\") " Mar 16 17:39:36 crc kubenswrapper[5120]: I0316 17:39:36.580005 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3e09c52a-e250-43b2-a04e-b05b6e59cd7f-config-data\") pod \"3e09c52a-e250-43b2-a04e-b05b6e59cd7f\" (UID: \"3e09c52a-e250-43b2-a04e-b05b6e59cd7f\") " Mar 16 17:39:36 crc kubenswrapper[5120]: I0316 17:39:36.580035 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rjfcc\" (UniqueName: \"kubernetes.io/projected/09958586-c0f4-4fff-b268-389577fd2a91-kube-api-access-rjfcc\") pod \"09958586-c0f4-4fff-b268-389577fd2a91\" (UID: \"09958586-c0f4-4fff-b268-389577fd2a91\") " Mar 16 17:39:36 crc kubenswrapper[5120]: I0316 17:39:36.580058 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hknn4\" (UniqueName: \"kubernetes.io/projected/3e09c52a-e250-43b2-a04e-b05b6e59cd7f-kube-api-access-hknn4\") pod \"3e09c52a-e250-43b2-a04e-b05b6e59cd7f\" (UID: \"3e09c52a-e250-43b2-a04e-b05b6e59cd7f\") " Mar 16 17:39:36 crc kubenswrapper[5120]: I0316 17:39:36.580182 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/3e09c52a-e250-43b2-a04e-b05b6e59cd7f-config-data-custom\") pod \"3e09c52a-e250-43b2-a04e-b05b6e59cd7f\" (UID: \"3e09c52a-e250-43b2-a04e-b05b6e59cd7f\") " Mar 16 17:39:36 crc kubenswrapper[5120]: I0316 17:39:36.580247 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/09958586-c0f4-4fff-b268-389577fd2a91-logs\") pod \"09958586-c0f4-4fff-b268-389577fd2a91\" (UID: \"09958586-c0f4-4fff-b268-389577fd2a91\") " Mar 16 17:39:36 crc kubenswrapper[5120]: I0316 17:39:36.580300 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/09958586-c0f4-4fff-b268-389577fd2a91-config-data-custom\") pod \"09958586-c0f4-4fff-b268-389577fd2a91\" (UID: \"09958586-c0f4-4fff-b268-389577fd2a91\") " Mar 16 17:39:36 crc kubenswrapper[5120]: I0316 17:39:36.581017 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09958586-c0f4-4fff-b268-389577fd2a91-logs" (OuterVolumeSpecName: "logs") pod "09958586-c0f4-4fff-b268-389577fd2a91" (UID: "09958586-c0f4-4fff-b268-389577fd2a91"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:39:36 crc kubenswrapper[5120]: I0316 17:39:36.581281 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e09c52a-e250-43b2-a04e-b05b6e59cd7f-logs" (OuterVolumeSpecName: "logs") pod "3e09c52a-e250-43b2-a04e-b05b6e59cd7f" (UID: "3e09c52a-e250-43b2-a04e-b05b6e59cd7f"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:39:36 crc kubenswrapper[5120]: I0316 17:39:36.587569 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e09c52a-e250-43b2-a04e-b05b6e59cd7f-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "3e09c52a-e250-43b2-a04e-b05b6e59cd7f" (UID: "3e09c52a-e250-43b2-a04e-b05b6e59cd7f"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:39:36 crc kubenswrapper[5120]: I0316 17:39:36.587761 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09958586-c0f4-4fff-b268-389577fd2a91-kube-api-access-rjfcc" (OuterVolumeSpecName: "kube-api-access-rjfcc") pod "09958586-c0f4-4fff-b268-389577fd2a91" (UID: "09958586-c0f4-4fff-b268-389577fd2a91"). InnerVolumeSpecName "kube-api-access-rjfcc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:39:36 crc kubenswrapper[5120]: I0316 17:39:36.588051 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e09c52a-e250-43b2-a04e-b05b6e59cd7f-kube-api-access-hknn4" (OuterVolumeSpecName: "kube-api-access-hknn4") pod "3e09c52a-e250-43b2-a04e-b05b6e59cd7f" (UID: "3e09c52a-e250-43b2-a04e-b05b6e59cd7f"). InnerVolumeSpecName "kube-api-access-hknn4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:39:36 crc kubenswrapper[5120]: I0316 17:39:36.596959 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/09958586-c0f4-4fff-b268-389577fd2a91-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "09958586-c0f4-4fff-b268-389577fd2a91" (UID: "09958586-c0f4-4fff-b268-389577fd2a91"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:39:36 crc kubenswrapper[5120]: I0316 17:39:36.610375 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e09c52a-e250-43b2-a04e-b05b6e59cd7f-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "3e09c52a-e250-43b2-a04e-b05b6e59cd7f" (UID: "3e09c52a-e250-43b2-a04e-b05b6e59cd7f"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:39:36 crc kubenswrapper[5120]: I0316 17:39:36.619685 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/09958586-c0f4-4fff-b268-389577fd2a91-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "09958586-c0f4-4fff-b268-389577fd2a91" (UID: "09958586-c0f4-4fff-b268-389577fd2a91"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:39:36 crc kubenswrapper[5120]: I0316 17:39:36.629578 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e09c52a-e250-43b2-a04e-b05b6e59cd7f-config-data" (OuterVolumeSpecName: "config-data") pod "3e09c52a-e250-43b2-a04e-b05b6e59cd7f" (UID: "3e09c52a-e250-43b2-a04e-b05b6e59cd7f"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:39:36 crc kubenswrapper[5120]: I0316 17:39:36.630118 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/09958586-c0f4-4fff-b268-389577fd2a91-config-data" (OuterVolumeSpecName: "config-data") pod "09958586-c0f4-4fff-b268-389577fd2a91" (UID: "09958586-c0f4-4fff-b268-389577fd2a91"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:39:36 crc kubenswrapper[5120]: I0316 17:39:36.683159 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/09958586-c0f4-4fff-b268-389577fd2a91-logs\") on node \"crc\" DevicePath \"\"" Mar 16 17:39:36 crc kubenswrapper[5120]: I0316 17:39:36.683211 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/09958586-c0f4-4fff-b268-389577fd2a91-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 17:39:36 crc kubenswrapper[5120]: I0316 17:39:36.683223 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/09958586-c0f4-4fff-b268-389577fd2a91-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:39:36 crc kubenswrapper[5120]: I0316 17:39:36.683234 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/09958586-c0f4-4fff-b268-389577fd2a91-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:39:36 crc kubenswrapper[5120]: I0316 17:39:36.683243 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3e09c52a-e250-43b2-a04e-b05b6e59cd7f-logs\") on node \"crc\" DevicePath \"\"" Mar 16 17:39:36 crc kubenswrapper[5120]: I0316 17:39:36.683251 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3e09c52a-e250-43b2-a04e-b05b6e59cd7f-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:39:36 crc kubenswrapper[5120]: I0316 17:39:36.683260 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3e09c52a-e250-43b2-a04e-b05b6e59cd7f-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:39:36 crc kubenswrapper[5120]: I0316 17:39:36.683271 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rjfcc\" (UniqueName: \"kubernetes.io/projected/09958586-c0f4-4fff-b268-389577fd2a91-kube-api-access-rjfcc\") on node \"crc\" DevicePath \"\"" Mar 16 17:39:36 crc kubenswrapper[5120]: I0316 17:39:36.683308 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hknn4\" (UniqueName: \"kubernetes.io/projected/3e09c52a-e250-43b2-a04e-b05b6e59cd7f-kube-api-access-hknn4\") on node \"crc\" DevicePath \"\"" Mar 16 17:39:36 crc kubenswrapper[5120]: I0316 17:39:36.683319 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/3e09c52a-e250-43b2-a04e-b05b6e59cd7f-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 17:39:36 crc kubenswrapper[5120]: I0316 17:39:36.845882 5120 generic.go:358] "Generic (PLEG): container finished" podID="09958586-c0f4-4fff-b268-389577fd2a91" containerID="f4e2e1b6150cbc31927dd5089571c0c7255f51042e2c0b5a955b4a4f6c5c5b93" exitCode=1 Mar 16 17:39:36 crc kubenswrapper[5120]: I0316 17:39:36.845974 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican-keystone-listener-7d5f6d9466-48jv5" Mar 16 17:39:36 crc kubenswrapper[5120]: I0316 17:39:36.846033 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-keystone-listener-7d5f6d9466-48jv5" event={"ID":"09958586-c0f4-4fff-b268-389577fd2a91","Type":"ContainerDied","Data":"f4e2e1b6150cbc31927dd5089571c0c7255f51042e2c0b5a955b4a4f6c5c5b93"} Mar 16 17:39:36 crc kubenswrapper[5120]: I0316 17:39:36.846082 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-keystone-listener-7d5f6d9466-48jv5" event={"ID":"09958586-c0f4-4fff-b268-389577fd2a91","Type":"ContainerDied","Data":"98eb3dacf68fe8f25e26cbb6d3571af6d1f1781a4709ec20b8b8923132b05b13"} Mar 16 17:39:36 crc kubenswrapper[5120]: I0316 17:39:36.846104 5120 scope.go:117] "RemoveContainer" containerID="f4e2e1b6150cbc31927dd5089571c0c7255f51042e2c0b5a955b4a4f6c5c5b93" Mar 16 17:39:36 crc kubenswrapper[5120]: I0316 17:39:36.847399 5120 generic.go:358] "Generic (PLEG): container finished" podID="3e09c52a-e250-43b2-a04e-b05b6e59cd7f" containerID="a9d769d20efdaed37cb4cf4f248a79c6abe427926d988d980ae0304d7462e149" exitCode=1 Mar 16 17:39:36 crc kubenswrapper[5120]: I0316 17:39:36.847464 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican-worker-5866d466f9-r2z6v" Mar 16 17:39:36 crc kubenswrapper[5120]: I0316 17:39:36.847512 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-worker-5866d466f9-r2z6v" event={"ID":"3e09c52a-e250-43b2-a04e-b05b6e59cd7f","Type":"ContainerDied","Data":"a9d769d20efdaed37cb4cf4f248a79c6abe427926d988d980ae0304d7462e149"} Mar 16 17:39:36 crc kubenswrapper[5120]: I0316 17:39:36.847537 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-worker-5866d466f9-r2z6v" event={"ID":"3e09c52a-e250-43b2-a04e-b05b6e59cd7f","Type":"ContainerDied","Data":"03f40d55585df4a404e3864ac01d463980f51df1eda1799d339448114bb1ab68"} Mar 16 17:39:36 crc kubenswrapper[5120]: I0316 17:39:36.876614 5120 scope.go:117] "RemoveContainer" containerID="a9c894f4e0c13374fce1e284fdc2a01ab64b6f48de7fbc4f7a01b17f65d80fc0" Mar 16 17:39:36 crc kubenswrapper[5120]: I0316 17:39:36.878366 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["barbican-kuttl-tests/barbican-worker-5866d466f9-r2z6v"] Mar 16 17:39:36 crc kubenswrapper[5120]: I0316 17:39:36.885554 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["barbican-kuttl-tests/barbican-worker-5866d466f9-r2z6v"] Mar 16 17:39:36 crc kubenswrapper[5120]: I0316 17:39:36.894488 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["barbican-kuttl-tests/barbican-keystone-listener-7d5f6d9466-48jv5"] Mar 16 17:39:36 crc kubenswrapper[5120]: I0316 17:39:36.901427 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["barbican-kuttl-tests/barbican-keystone-listener-7d5f6d9466-48jv5"] Mar 16 17:39:36 crc kubenswrapper[5120]: I0316 17:39:36.902852 5120 scope.go:117] "RemoveContainer" containerID="f4e2e1b6150cbc31927dd5089571c0c7255f51042e2c0b5a955b4a4f6c5c5b93" Mar 16 17:39:36 crc kubenswrapper[5120]: E0316 17:39:36.903380 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f4e2e1b6150cbc31927dd5089571c0c7255f51042e2c0b5a955b4a4f6c5c5b93\": container with ID starting with f4e2e1b6150cbc31927dd5089571c0c7255f51042e2c0b5a955b4a4f6c5c5b93 not found: ID does not exist" containerID="f4e2e1b6150cbc31927dd5089571c0c7255f51042e2c0b5a955b4a4f6c5c5b93" Mar 16 17:39:36 crc kubenswrapper[5120]: I0316 17:39:36.903430 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4e2e1b6150cbc31927dd5089571c0c7255f51042e2c0b5a955b4a4f6c5c5b93"} err="failed to get container status \"f4e2e1b6150cbc31927dd5089571c0c7255f51042e2c0b5a955b4a4f6c5c5b93\": rpc error: code = NotFound desc = could not find container \"f4e2e1b6150cbc31927dd5089571c0c7255f51042e2c0b5a955b4a4f6c5c5b93\": container with ID starting with f4e2e1b6150cbc31927dd5089571c0c7255f51042e2c0b5a955b4a4f6c5c5b93 not found: ID does not exist" Mar 16 17:39:36 crc kubenswrapper[5120]: I0316 17:39:36.903455 5120 scope.go:117] "RemoveContainer" containerID="a9c894f4e0c13374fce1e284fdc2a01ab64b6f48de7fbc4f7a01b17f65d80fc0" Mar 16 17:39:36 crc kubenswrapper[5120]: E0316 17:39:36.903886 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a9c894f4e0c13374fce1e284fdc2a01ab64b6f48de7fbc4f7a01b17f65d80fc0\": container with ID starting with a9c894f4e0c13374fce1e284fdc2a01ab64b6f48de7fbc4f7a01b17f65d80fc0 not found: ID does not exist" containerID="a9c894f4e0c13374fce1e284fdc2a01ab64b6f48de7fbc4f7a01b17f65d80fc0" Mar 16 17:39:36 crc kubenswrapper[5120]: I0316 17:39:36.903908 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9c894f4e0c13374fce1e284fdc2a01ab64b6f48de7fbc4f7a01b17f65d80fc0"} err="failed to get container status \"a9c894f4e0c13374fce1e284fdc2a01ab64b6f48de7fbc4f7a01b17f65d80fc0\": rpc error: code = NotFound desc = could not find container \"a9c894f4e0c13374fce1e284fdc2a01ab64b6f48de7fbc4f7a01b17f65d80fc0\": container with ID starting with a9c894f4e0c13374fce1e284fdc2a01ab64b6f48de7fbc4f7a01b17f65d80fc0 not found: ID does not exist" Mar 16 17:39:36 crc kubenswrapper[5120]: I0316 17:39:36.903920 5120 scope.go:117] "RemoveContainer" containerID="a9d769d20efdaed37cb4cf4f248a79c6abe427926d988d980ae0304d7462e149" Mar 16 17:39:36 crc kubenswrapper[5120]: I0316 17:39:36.921481 5120 scope.go:117] "RemoveContainer" containerID="80b0d9679716950c18f988791bd25967593d029a0e2e93491cbd3f97fe91028b" Mar 16 17:39:36 crc kubenswrapper[5120]: I0316 17:39:36.946890 5120 scope.go:117] "RemoveContainer" containerID="a9d769d20efdaed37cb4cf4f248a79c6abe427926d988d980ae0304d7462e149" Mar 16 17:39:36 crc kubenswrapper[5120]: E0316 17:39:36.947397 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a9d769d20efdaed37cb4cf4f248a79c6abe427926d988d980ae0304d7462e149\": container with ID starting with a9d769d20efdaed37cb4cf4f248a79c6abe427926d988d980ae0304d7462e149 not found: ID does not exist" containerID="a9d769d20efdaed37cb4cf4f248a79c6abe427926d988d980ae0304d7462e149" Mar 16 17:39:36 crc kubenswrapper[5120]: I0316 17:39:36.947428 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9d769d20efdaed37cb4cf4f248a79c6abe427926d988d980ae0304d7462e149"} err="failed to get container status \"a9d769d20efdaed37cb4cf4f248a79c6abe427926d988d980ae0304d7462e149\": rpc error: code = NotFound desc = could not find container \"a9d769d20efdaed37cb4cf4f248a79c6abe427926d988d980ae0304d7462e149\": container with ID starting with a9d769d20efdaed37cb4cf4f248a79c6abe427926d988d980ae0304d7462e149 not found: ID does not exist" Mar 16 17:39:36 crc kubenswrapper[5120]: I0316 17:39:36.947451 5120 scope.go:117] "RemoveContainer" containerID="80b0d9679716950c18f988791bd25967593d029a0e2e93491cbd3f97fe91028b" Mar 16 17:39:36 crc kubenswrapper[5120]: E0316 17:39:36.947758 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"80b0d9679716950c18f988791bd25967593d029a0e2e93491cbd3f97fe91028b\": container with ID starting with 80b0d9679716950c18f988791bd25967593d029a0e2e93491cbd3f97fe91028b not found: ID does not exist" containerID="80b0d9679716950c18f988791bd25967593d029a0e2e93491cbd3f97fe91028b" Mar 16 17:39:36 crc kubenswrapper[5120]: I0316 17:39:36.947798 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80b0d9679716950c18f988791bd25967593d029a0e2e93491cbd3f97fe91028b"} err="failed to get container status \"80b0d9679716950c18f988791bd25967593d029a0e2e93491cbd3f97fe91028b\": rpc error: code = NotFound desc = could not find container \"80b0d9679716950c18f988791bd25967593d029a0e2e93491cbd3f97fe91028b\": container with ID starting with 80b0d9679716950c18f988791bd25967593d029a0e2e93491cbd3f97fe91028b not found: ID does not exist" Mar 16 17:39:37 crc kubenswrapper[5120]: I0316 17:39:37.116562 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbicanc827-account-delete-qsph2" Mar 16 17:39:37 crc kubenswrapper[5120]: I0316 17:39:37.303913 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/143cd239-bf99-447d-b5c2-b42fc98cfc37-operator-scripts\") pod \"143cd239-bf99-447d-b5c2-b42fc98cfc37\" (UID: \"143cd239-bf99-447d-b5c2-b42fc98cfc37\") " Mar 16 17:39:37 crc kubenswrapper[5120]: I0316 17:39:37.304082 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xpw7s\" (UniqueName: \"kubernetes.io/projected/143cd239-bf99-447d-b5c2-b42fc98cfc37-kube-api-access-xpw7s\") pod \"143cd239-bf99-447d-b5c2-b42fc98cfc37\" (UID: \"143cd239-bf99-447d-b5c2-b42fc98cfc37\") " Mar 16 17:39:37 crc kubenswrapper[5120]: I0316 17:39:37.306188 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/143cd239-bf99-447d-b5c2-b42fc98cfc37-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "143cd239-bf99-447d-b5c2-b42fc98cfc37" (UID: "143cd239-bf99-447d-b5c2-b42fc98cfc37"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:39:37 crc kubenswrapper[5120]: I0316 17:39:37.309166 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/143cd239-bf99-447d-b5c2-b42fc98cfc37-kube-api-access-xpw7s" (OuterVolumeSpecName: "kube-api-access-xpw7s") pod "143cd239-bf99-447d-b5c2-b42fc98cfc37" (UID: "143cd239-bf99-447d-b5c2-b42fc98cfc37"). InnerVolumeSpecName "kube-api-access-xpw7s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:39:37 crc kubenswrapper[5120]: I0316 17:39:37.406707 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/143cd239-bf99-447d-b5c2-b42fc98cfc37-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:39:37 crc kubenswrapper[5120]: I0316 17:39:37.406745 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xpw7s\" (UniqueName: \"kubernetes.io/projected/143cd239-bf99-447d-b5c2-b42fc98cfc37-kube-api-access-xpw7s\") on node \"crc\" DevicePath \"\"" Mar 16 17:39:37 crc kubenswrapper[5120]: I0316 17:39:37.859649 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbicanc827-account-delete-qsph2" Mar 16 17:39:37 crc kubenswrapper[5120]: I0316 17:39:37.859717 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbicanc827-account-delete-qsph2" event={"ID":"143cd239-bf99-447d-b5c2-b42fc98cfc37","Type":"ContainerDied","Data":"ce87f9c58743e8a7732d1159dcc39e21438704e5d8b11fd77dc797949a3630eb"} Mar 16 17:39:37 crc kubenswrapper[5120]: I0316 17:39:37.860072 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ce87f9c58743e8a7732d1159dcc39e21438704e5d8b11fd77dc797949a3630eb" Mar 16 17:39:38 crc kubenswrapper[5120]: I0316 17:39:38.677789 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="09958586-c0f4-4fff-b268-389577fd2a91" path="/var/lib/kubelet/pods/09958586-c0f4-4fff-b268-389577fd2a91/volumes" Mar 16 17:39:38 crc kubenswrapper[5120]: I0316 17:39:38.678472 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3e09c52a-e250-43b2-a04e-b05b6e59cd7f" path="/var/lib/kubelet/pods/3e09c52a-e250-43b2-a04e-b05b6e59cd7f/volumes" Mar 16 17:39:38 crc kubenswrapper[5120]: I0316 17:39:38.801146 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["barbican-kuttl-tests/barbican-db-create-bm9kt"] Mar 16 17:39:38 crc kubenswrapper[5120]: I0316 17:39:38.812282 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["barbican-kuttl-tests/barbican-db-create-bm9kt"] Mar 16 17:39:38 crc kubenswrapper[5120]: I0316 17:39:38.833227 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["barbican-kuttl-tests/barbican-c827-account-create-update-5km6b"] Mar 16 17:39:38 crc kubenswrapper[5120]: I0316 17:39:38.844857 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["barbican-kuttl-tests/barbicanc827-account-delete-qsph2"] Mar 16 17:39:38 crc kubenswrapper[5120]: I0316 17:39:38.852704 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["barbican-kuttl-tests/barbican-c827-account-create-update-5km6b"] Mar 16 17:39:38 crc kubenswrapper[5120]: I0316 17:39:38.858434 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["barbican-kuttl-tests/barbicanc827-account-delete-qsph2"] Mar 16 17:39:40 crc kubenswrapper[5120]: I0316 17:39:40.673478 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="143cd239-bf99-447d-b5c2-b42fc98cfc37" path="/var/lib/kubelet/pods/143cd239-bf99-447d-b5c2-b42fc98cfc37/volumes" Mar 16 17:39:40 crc kubenswrapper[5120]: I0316 17:39:40.674432 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d936a6d-ab99-42ab-bf8f-0c11edd3208e" path="/var/lib/kubelet/pods/3d936a6d-ab99-42ab-bf8f-0c11edd3208e/volumes" Mar 16 17:39:40 crc kubenswrapper[5120]: I0316 17:39:40.674897 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c6dc1383-ac95-474b-9250-5ebb015b3988" path="/var/lib/kubelet/pods/c6dc1383-ac95-474b-9250-5ebb015b3988/volumes" Mar 16 17:39:41 crc kubenswrapper[5120]: I0316 17:39:41.284205 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="barbican-kuttl-tests/barbican-api-549469d458-jkj4p" podUID="db8dee65-16da-4f71-9052-f116f524f253" containerName="barbican-api-log" probeResult="failure" output="HTTP probe failed with statuscode: 500" Mar 16 17:39:41 crc kubenswrapper[5120]: I0316 17:39:41.292065 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="barbican-kuttl-tests/barbican-api-549469d458-jkj4p" podUID="db8dee65-16da-4f71-9052-f116f524f253" containerName="barbican-api" probeResult="failure" output="HTTP probe failed with statuscode: 500" Mar 16 17:39:46 crc kubenswrapper[5120]: I0316 17:39:46.051460 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="barbican-kuttl-tests/barbican-api-549469d458-jkj4p" podUID="db8dee65-16da-4f71-9052-f116f524f253" containerName="barbican-api" probeResult="failure" output="HTTP probe failed with statuscode: 500" Mar 16 17:39:46 crc kubenswrapper[5120]: I0316 17:39:46.085408 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="barbican-kuttl-tests/barbican-api-549469d458-jkj4p" podUID="db8dee65-16da-4f71-9052-f116f524f253" containerName="barbican-api-log" probeResult="failure" output="HTTP probe failed with statuscode: 500" Mar 16 17:39:51 crc kubenswrapper[5120]: I0316 17:39:51.051071 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="barbican-kuttl-tests/barbican-api-549469d458-jkj4p" podUID="db8dee65-16da-4f71-9052-f116f524f253" containerName="barbican-api" probeResult="failure" output="HTTP probe failed with statuscode: 500" Mar 16 17:39:51 crc kubenswrapper[5120]: I0316 17:39:51.052902 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="barbican-kuttl-tests/barbican-api-549469d458-jkj4p" podUID="db8dee65-16da-4f71-9052-f116f524f253" containerName="barbican-api-log" probeResult="failure" output="HTTP probe failed with statuscode: 500" Mar 16 17:39:52 crc kubenswrapper[5120]: I0316 17:39:52.008374 5120 patch_prober.go:28] interesting pod/machine-config-daemon-7bf76 container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 17:39:52 crc kubenswrapper[5120]: I0316 17:39:52.008464 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 17:39:56 crc kubenswrapper[5120]: I0316 17:39:56.056095 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="barbican-kuttl-tests/barbican-api-549469d458-jkj4p" podUID="db8dee65-16da-4f71-9052-f116f524f253" containerName="barbican-api-log" probeResult="failure" output="HTTP probe failed with statuscode: 500" Mar 16 17:39:56 crc kubenswrapper[5120]: I0316 17:39:56.162189 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="barbican-kuttl-tests/barbican-api-549469d458-jkj4p" podUID="db8dee65-16da-4f71-9052-f116f524f253" containerName="barbican-api" probeResult="failure" output="HTTP probe failed with statuscode: 500" Mar 16 17:39:59 crc kubenswrapper[5120]: I0316 17:39:59.823674 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="barbican-kuttl-tests/barbican-api-549469d458-jkj4p" podUID="db8dee65-16da-4f71-9052-f116f524f253" containerName="barbican-api-log" probeResult="failure" output="HTTP probe failed with statuscode: 500" Mar 16 17:39:59 crc kubenswrapper[5120]: I0316 17:39:59.892048 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="barbican-kuttl-tests/barbican-api-549469d458-jkj4p" podUID="db8dee65-16da-4f71-9052-f116f524f253" containerName="barbican-api" probeResult="failure" output="HTTP probe failed with statuscode: 500" Mar 16 17:40:00 crc kubenswrapper[5120]: I0316 17:40:00.143161 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-infra/auto-csr-approver-29561380-d5x9f"] Mar 16 17:40:00 crc kubenswrapper[5120]: I0316 17:40:00.144335 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e09c52a-e250-43b2-a04e-b05b6e59cd7f" containerName="barbican-worker-log" Mar 16 17:40:00 crc kubenswrapper[5120]: I0316 17:40:00.144362 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e09c52a-e250-43b2-a04e-b05b6e59cd7f" containerName="barbican-worker-log" Mar 16 17:40:00 crc kubenswrapper[5120]: I0316 17:40:00.144381 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09958586-c0f4-4fff-b268-389577fd2a91" containerName="barbican-keystone-listener" Mar 16 17:40:00 crc kubenswrapper[5120]: I0316 17:40:00.144391 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="09958586-c0f4-4fff-b268-389577fd2a91" containerName="barbican-keystone-listener" Mar 16 17:40:00 crc kubenswrapper[5120]: I0316 17:40:00.144401 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="143cd239-bf99-447d-b5c2-b42fc98cfc37" containerName="mariadb-account-delete" Mar 16 17:40:00 crc kubenswrapper[5120]: I0316 17:40:00.144409 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="143cd239-bf99-447d-b5c2-b42fc98cfc37" containerName="mariadb-account-delete" Mar 16 17:40:00 crc kubenswrapper[5120]: I0316 17:40:00.144474 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09958586-c0f4-4fff-b268-389577fd2a91" containerName="barbican-keystone-listener-log" Mar 16 17:40:00 crc kubenswrapper[5120]: I0316 17:40:00.144484 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="09958586-c0f4-4fff-b268-389577fd2a91" containerName="barbican-keystone-listener-log" Mar 16 17:40:00 crc kubenswrapper[5120]: I0316 17:40:00.144500 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e09c52a-e250-43b2-a04e-b05b6e59cd7f" containerName="barbican-worker" Mar 16 17:40:00 crc kubenswrapper[5120]: I0316 17:40:00.144507 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e09c52a-e250-43b2-a04e-b05b6e59cd7f" containerName="barbican-worker" Mar 16 17:40:00 crc kubenswrapper[5120]: I0316 17:40:00.159590 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="3e09c52a-e250-43b2-a04e-b05b6e59cd7f" containerName="barbican-worker-log" Mar 16 17:40:00 crc kubenswrapper[5120]: I0316 17:40:00.159638 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="3e09c52a-e250-43b2-a04e-b05b6e59cd7f" containerName="barbican-worker" Mar 16 17:40:00 crc kubenswrapper[5120]: I0316 17:40:00.159656 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="09958586-c0f4-4fff-b268-389577fd2a91" containerName="barbican-keystone-listener" Mar 16 17:40:00 crc kubenswrapper[5120]: I0316 17:40:00.159696 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="09958586-c0f4-4fff-b268-389577fd2a91" containerName="barbican-keystone-listener-log" Mar 16 17:40:00 crc kubenswrapper[5120]: I0316 17:40:00.159713 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="143cd239-bf99-447d-b5c2-b42fc98cfc37" containerName="mariadb-account-delete" Mar 16 17:40:00 crc kubenswrapper[5120]: I0316 17:40:00.168391 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561380-d5x9f"] Mar 16 17:40:00 crc kubenswrapper[5120]: I0316 17:40:00.171369 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561380-d5x9f" Mar 16 17:40:00 crc kubenswrapper[5120]: I0316 17:40:00.175407 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-infra\"/\"csr-approver-sa-dockercfg-x2nsz\"" Mar 16 17:40:00 crc kubenswrapper[5120]: I0316 17:40:00.176050 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"openshift-service-ca.crt\"" Mar 16 17:40:00 crc kubenswrapper[5120]: I0316 17:40:00.176869 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"kube-root-ca.crt\"" Mar 16 17:40:00 crc kubenswrapper[5120]: I0316 17:40:00.178131 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hspwr\" (UniqueName: \"kubernetes.io/projected/c3bf94ae-a70e-49a9-8bfd-70c338d7bd87-kube-api-access-hspwr\") pod \"auto-csr-approver-29561380-d5x9f\" (UID: \"c3bf94ae-a70e-49a9-8bfd-70c338d7bd87\") " pod="openshift-infra/auto-csr-approver-29561380-d5x9f" Mar 16 17:40:00 crc kubenswrapper[5120]: I0316 17:40:00.284048 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hspwr\" (UniqueName: \"kubernetes.io/projected/c3bf94ae-a70e-49a9-8bfd-70c338d7bd87-kube-api-access-hspwr\") pod \"auto-csr-approver-29561380-d5x9f\" (UID: \"c3bf94ae-a70e-49a9-8bfd-70c338d7bd87\") " pod="openshift-infra/auto-csr-approver-29561380-d5x9f" Mar 16 17:40:00 crc kubenswrapper[5120]: I0316 17:40:00.304869 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hspwr\" (UniqueName: \"kubernetes.io/projected/c3bf94ae-a70e-49a9-8bfd-70c338d7bd87-kube-api-access-hspwr\") pod \"auto-csr-approver-29561380-d5x9f\" (UID: \"c3bf94ae-a70e-49a9-8bfd-70c338d7bd87\") " pod="openshift-infra/auto-csr-approver-29561380-d5x9f" Mar 16 17:40:00 crc kubenswrapper[5120]: I0316 17:40:00.495956 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561380-d5x9f" Mar 16 17:40:00 crc kubenswrapper[5120]: I0316 17:40:00.922279 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561380-d5x9f"] Mar 16 17:40:01 crc kubenswrapper[5120]: I0316 17:40:01.091673 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561380-d5x9f" event={"ID":"c3bf94ae-a70e-49a9-8bfd-70c338d7bd87","Type":"ContainerStarted","Data":"91e5e1d845a6af808c2687568478c8d446d914b2d31b48c5587a23ed0eb9103b"} Mar 16 17:40:03 crc kubenswrapper[5120]: I0316 17:40:03.108040 5120 generic.go:358] "Generic (PLEG): container finished" podID="c3bf94ae-a70e-49a9-8bfd-70c338d7bd87" containerID="73bcce191a179175c4e25a958b01f387549f8aaa1c1e014273e87c25d702b95e" exitCode=0 Mar 16 17:40:03 crc kubenswrapper[5120]: I0316 17:40:03.108188 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561380-d5x9f" event={"ID":"c3bf94ae-a70e-49a9-8bfd-70c338d7bd87","Type":"ContainerDied","Data":"73bcce191a179175c4e25a958b01f387549f8aaa1c1e014273e87c25d702b95e"} Mar 16 17:40:04 crc kubenswrapper[5120]: I0316 17:40:04.388880 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561380-d5x9f" Mar 16 17:40:04 crc kubenswrapper[5120]: I0316 17:40:04.481078 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hspwr\" (UniqueName: \"kubernetes.io/projected/c3bf94ae-a70e-49a9-8bfd-70c338d7bd87-kube-api-access-hspwr\") pod \"c3bf94ae-a70e-49a9-8bfd-70c338d7bd87\" (UID: \"c3bf94ae-a70e-49a9-8bfd-70c338d7bd87\") " Mar 16 17:40:04 crc kubenswrapper[5120]: I0316 17:40:04.488702 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3bf94ae-a70e-49a9-8bfd-70c338d7bd87-kube-api-access-hspwr" (OuterVolumeSpecName: "kube-api-access-hspwr") pod "c3bf94ae-a70e-49a9-8bfd-70c338d7bd87" (UID: "c3bf94ae-a70e-49a9-8bfd-70c338d7bd87"). InnerVolumeSpecName "kube-api-access-hspwr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:40:04 crc kubenswrapper[5120]: I0316 17:40:04.584801 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hspwr\" (UniqueName: \"kubernetes.io/projected/c3bf94ae-a70e-49a9-8bfd-70c338d7bd87-kube-api-access-hspwr\") on node \"crc\" DevicePath \"\"" Mar 16 17:40:04 crc kubenswrapper[5120]: I0316 17:40:04.821314 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="barbican-kuttl-tests/barbican-api-549469d458-jkj4p" podUID="db8dee65-16da-4f71-9052-f116f524f253" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.1.178:9311/healthcheck\": EOF" Mar 16 17:40:04 crc kubenswrapper[5120]: I0316 17:40:04.821344 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="barbican-kuttl-tests/barbican-api-549469d458-jkj4p" podUID="db8dee65-16da-4f71-9052-f116f524f253" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.1.178:9311/healthcheck\": EOF" Mar 16 17:40:05 crc kubenswrapper[5120]: I0316 17:40:05.136268 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561380-d5x9f" event={"ID":"c3bf94ae-a70e-49a9-8bfd-70c338d7bd87","Type":"ContainerDied","Data":"91e5e1d845a6af808c2687568478c8d446d914b2d31b48c5587a23ed0eb9103b"} Mar 16 17:40:05 crc kubenswrapper[5120]: I0316 17:40:05.136312 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="91e5e1d845a6af808c2687568478c8d446d914b2d31b48c5587a23ed0eb9103b" Mar 16 17:40:05 crc kubenswrapper[5120]: I0316 17:40:05.136372 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561380-d5x9f" Mar 16 17:40:05 crc kubenswrapper[5120]: I0316 17:40:05.139234 5120 generic.go:358] "Generic (PLEG): container finished" podID="db8dee65-16da-4f71-9052-f116f524f253" containerID="c7bc957d61fb55a4fe88520d907f9e230a35b56db6b1d43b650dc89440ca0058" exitCode=137 Mar 16 17:40:05 crc kubenswrapper[5120]: I0316 17:40:05.139315 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-api-549469d458-jkj4p" event={"ID":"db8dee65-16da-4f71-9052-f116f524f253","Type":"ContainerDied","Data":"c7bc957d61fb55a4fe88520d907f9e230a35b56db6b1d43b650dc89440ca0058"} Mar 16 17:40:05 crc kubenswrapper[5120]: I0316 17:40:05.169666 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican-api-549469d458-jkj4p" Mar 16 17:40:05 crc kubenswrapper[5120]: I0316 17:40:05.312460 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/db8dee65-16da-4f71-9052-f116f524f253-public-tls-certs\") pod \"db8dee65-16da-4f71-9052-f116f524f253\" (UID: \"db8dee65-16da-4f71-9052-f116f524f253\") " Mar 16 17:40:05 crc kubenswrapper[5120]: I0316 17:40:05.312869 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/db8dee65-16da-4f71-9052-f116f524f253-internal-tls-certs\") pod \"db8dee65-16da-4f71-9052-f116f524f253\" (UID: \"db8dee65-16da-4f71-9052-f116f524f253\") " Mar 16 17:40:05 crc kubenswrapper[5120]: I0316 17:40:05.312954 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2h544\" (UniqueName: \"kubernetes.io/projected/db8dee65-16da-4f71-9052-f116f524f253-kube-api-access-2h544\") pod \"db8dee65-16da-4f71-9052-f116f524f253\" (UID: \"db8dee65-16da-4f71-9052-f116f524f253\") " Mar 16 17:40:05 crc kubenswrapper[5120]: I0316 17:40:05.313022 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/db8dee65-16da-4f71-9052-f116f524f253-combined-ca-bundle\") pod \"db8dee65-16da-4f71-9052-f116f524f253\" (UID: \"db8dee65-16da-4f71-9052-f116f524f253\") " Mar 16 17:40:05 crc kubenswrapper[5120]: I0316 17:40:05.313076 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/db8dee65-16da-4f71-9052-f116f524f253-config-data-custom\") pod \"db8dee65-16da-4f71-9052-f116f524f253\" (UID: \"db8dee65-16da-4f71-9052-f116f524f253\") " Mar 16 17:40:05 crc kubenswrapper[5120]: I0316 17:40:05.313120 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/db8dee65-16da-4f71-9052-f116f524f253-config-data\") pod \"db8dee65-16da-4f71-9052-f116f524f253\" (UID: \"db8dee65-16da-4f71-9052-f116f524f253\") " Mar 16 17:40:05 crc kubenswrapper[5120]: I0316 17:40:05.313259 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/db8dee65-16da-4f71-9052-f116f524f253-logs\") pod \"db8dee65-16da-4f71-9052-f116f524f253\" (UID: \"db8dee65-16da-4f71-9052-f116f524f253\") " Mar 16 17:40:05 crc kubenswrapper[5120]: I0316 17:40:05.314356 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db8dee65-16da-4f71-9052-f116f524f253-logs" (OuterVolumeSpecName: "logs") pod "db8dee65-16da-4f71-9052-f116f524f253" (UID: "db8dee65-16da-4f71-9052-f116f524f253"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:40:05 crc kubenswrapper[5120]: I0316 17:40:05.317842 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db8dee65-16da-4f71-9052-f116f524f253-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "db8dee65-16da-4f71-9052-f116f524f253" (UID: "db8dee65-16da-4f71-9052-f116f524f253"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:40:05 crc kubenswrapper[5120]: I0316 17:40:05.317910 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db8dee65-16da-4f71-9052-f116f524f253-kube-api-access-2h544" (OuterVolumeSpecName: "kube-api-access-2h544") pod "db8dee65-16da-4f71-9052-f116f524f253" (UID: "db8dee65-16da-4f71-9052-f116f524f253"). InnerVolumeSpecName "kube-api-access-2h544". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:40:05 crc kubenswrapper[5120]: I0316 17:40:05.335049 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db8dee65-16da-4f71-9052-f116f524f253-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "db8dee65-16da-4f71-9052-f116f524f253" (UID: "db8dee65-16da-4f71-9052-f116f524f253"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:40:05 crc kubenswrapper[5120]: I0316 17:40:05.351845 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db8dee65-16da-4f71-9052-f116f524f253-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "db8dee65-16da-4f71-9052-f116f524f253" (UID: "db8dee65-16da-4f71-9052-f116f524f253"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:40:05 crc kubenswrapper[5120]: I0316 17:40:05.353696 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db8dee65-16da-4f71-9052-f116f524f253-config-data" (OuterVolumeSpecName: "config-data") pod "db8dee65-16da-4f71-9052-f116f524f253" (UID: "db8dee65-16da-4f71-9052-f116f524f253"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:40:05 crc kubenswrapper[5120]: I0316 17:40:05.354703 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db8dee65-16da-4f71-9052-f116f524f253-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "db8dee65-16da-4f71-9052-f116f524f253" (UID: "db8dee65-16da-4f71-9052-f116f524f253"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:40:05 crc kubenswrapper[5120]: I0316 17:40:05.418503 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/db8dee65-16da-4f71-9052-f116f524f253-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:40:05 crc kubenswrapper[5120]: I0316 17:40:05.418541 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2h544\" (UniqueName: \"kubernetes.io/projected/db8dee65-16da-4f71-9052-f116f524f253-kube-api-access-2h544\") on node \"crc\" DevicePath \"\"" Mar 16 17:40:05 crc kubenswrapper[5120]: I0316 17:40:05.418556 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/db8dee65-16da-4f71-9052-f116f524f253-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:40:05 crc kubenswrapper[5120]: I0316 17:40:05.418568 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/db8dee65-16da-4f71-9052-f116f524f253-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 17:40:05 crc kubenswrapper[5120]: I0316 17:40:05.418580 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/db8dee65-16da-4f71-9052-f116f524f253-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:40:05 crc kubenswrapper[5120]: I0316 17:40:05.418591 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/db8dee65-16da-4f71-9052-f116f524f253-logs\") on node \"crc\" DevicePath \"\"" Mar 16 17:40:05 crc kubenswrapper[5120]: I0316 17:40:05.418603 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/db8dee65-16da-4f71-9052-f116f524f253-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:40:05 crc kubenswrapper[5120]: I0316 17:40:05.452989 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-infra/auto-csr-approver-29561374-ddsht"] Mar 16 17:40:05 crc kubenswrapper[5120]: I0316 17:40:05.462535 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-infra/auto-csr-approver-29561374-ddsht"] Mar 16 17:40:06 crc kubenswrapper[5120]: I0316 17:40:06.147155 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-api-549469d458-jkj4p" event={"ID":"db8dee65-16da-4f71-9052-f116f524f253","Type":"ContainerDied","Data":"aa5aef6a109d5165d8ac2615d086183057d26b84a6ecbcc0e53bcaf5fc02f64a"} Mar 16 17:40:06 crc kubenswrapper[5120]: I0316 17:40:06.147207 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican-api-549469d458-jkj4p" Mar 16 17:40:06 crc kubenswrapper[5120]: I0316 17:40:06.147215 5120 scope.go:117] "RemoveContainer" containerID="c7bc957d61fb55a4fe88520d907f9e230a35b56db6b1d43b650dc89440ca0058" Mar 16 17:40:06 crc kubenswrapper[5120]: I0316 17:40:06.183789 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["barbican-kuttl-tests/barbican-api-549469d458-jkj4p"] Mar 16 17:40:06 crc kubenswrapper[5120]: I0316 17:40:06.185868 5120 scope.go:117] "RemoveContainer" containerID="5298628aab1992774b14733faab8077e5852074c5f2e9ab7ea4922eed7afa17d" Mar 16 17:40:06 crc kubenswrapper[5120]: I0316 17:40:06.202141 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["barbican-kuttl-tests/barbican-api-549469d458-jkj4p"] Mar 16 17:40:06 crc kubenswrapper[5120]: I0316 17:40:06.672126 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5e2dabcd-8d5f-437e-8873-f212db862eb1" path="/var/lib/kubelet/pods/5e2dabcd-8d5f-437e-8873-f212db862eb1/volumes" Mar 16 17:40:06 crc kubenswrapper[5120]: I0316 17:40:06.672866 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="db8dee65-16da-4f71-9052-f116f524f253" path="/var/lib/kubelet/pods/db8dee65-16da-4f71-9052-f116f524f253/volumes" Mar 16 17:40:07 crc kubenswrapper[5120]: E0316 17:40:07.397450 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1127431 actualBytes=10240 Mar 16 17:40:12 crc kubenswrapper[5120]: I0316 17:40:12.009745 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["barbican-kuttl-tests/keystone-bootstrap-d2c9n"] Mar 16 17:40:12 crc kubenswrapper[5120]: I0316 17:40:12.018459 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["barbican-kuttl-tests/keystone-db-sync-7pzns"] Mar 16 17:40:12 crc kubenswrapper[5120]: I0316 17:40:12.026817 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["barbican-kuttl-tests/keystone-db-sync-7pzns"] Mar 16 17:40:12 crc kubenswrapper[5120]: I0316 17:40:12.039094 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["barbican-kuttl-tests/keystone-bootstrap-d2c9n"] Mar 16 17:40:12 crc kubenswrapper[5120]: I0316 17:40:12.055343 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["barbican-kuttl-tests/keystone-667f6cf997-rrpr2"] Mar 16 17:40:12 crc kubenswrapper[5120]: I0316 17:40:12.055642 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="barbican-kuttl-tests/keystone-667f6cf997-rrpr2" podUID="bbe1e943-d345-4e78-a91c-de129e2b82ea" containerName="keystone-api" containerID="cri-o://7e17100ea78d21a7a68ede041a39fabe0906dba91e4e2ff5e7638615575510b9" gracePeriod=30 Mar 16 17:40:12 crc kubenswrapper[5120]: I0316 17:40:12.064825 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["barbican-kuttl-tests/keystonebc2c-account-delete-qrxr4"] Mar 16 17:40:12 crc kubenswrapper[5120]: I0316 17:40:12.065875 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3bf94ae-a70e-49a9-8bfd-70c338d7bd87" containerName="oc" Mar 16 17:40:12 crc kubenswrapper[5120]: I0316 17:40:12.065893 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3bf94ae-a70e-49a9-8bfd-70c338d7bd87" containerName="oc" Mar 16 17:40:12 crc kubenswrapper[5120]: I0316 17:40:12.065906 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db8dee65-16da-4f71-9052-f116f524f253" containerName="barbican-api" Mar 16 17:40:12 crc kubenswrapper[5120]: I0316 17:40:12.065913 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="db8dee65-16da-4f71-9052-f116f524f253" containerName="barbican-api" Mar 16 17:40:12 crc kubenswrapper[5120]: I0316 17:40:12.065935 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db8dee65-16da-4f71-9052-f116f524f253" containerName="barbican-api-log" Mar 16 17:40:12 crc kubenswrapper[5120]: I0316 17:40:12.065943 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="db8dee65-16da-4f71-9052-f116f524f253" containerName="barbican-api-log" Mar 16 17:40:12 crc kubenswrapper[5120]: I0316 17:40:12.066108 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="db8dee65-16da-4f71-9052-f116f524f253" containerName="barbican-api-log" Mar 16 17:40:12 crc kubenswrapper[5120]: I0316 17:40:12.066136 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="db8dee65-16da-4f71-9052-f116f524f253" containerName="barbican-api" Mar 16 17:40:12 crc kubenswrapper[5120]: I0316 17:40:12.066147 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c3bf94ae-a70e-49a9-8bfd-70c338d7bd87" containerName="oc" Mar 16 17:40:12 crc kubenswrapper[5120]: I0316 17:40:12.079720 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["barbican-kuttl-tests/keystonebc2c-account-delete-qrxr4"] Mar 16 17:40:12 crc kubenswrapper[5120]: I0316 17:40:12.079935 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/keystonebc2c-account-delete-qrxr4" Mar 16 17:40:12 crc kubenswrapper[5120]: I0316 17:40:12.181033 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/cb9e9af1-7275-4426-aa22-16b916aada88-operator-scripts\") pod \"keystonebc2c-account-delete-qrxr4\" (UID: \"cb9e9af1-7275-4426-aa22-16b916aada88\") " pod="barbican-kuttl-tests/keystonebc2c-account-delete-qrxr4" Mar 16 17:40:12 crc kubenswrapper[5120]: I0316 17:40:12.181492 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pq25d\" (UniqueName: \"kubernetes.io/projected/cb9e9af1-7275-4426-aa22-16b916aada88-kube-api-access-pq25d\") pod \"keystonebc2c-account-delete-qrxr4\" (UID: \"cb9e9af1-7275-4426-aa22-16b916aada88\") " pod="barbican-kuttl-tests/keystonebc2c-account-delete-qrxr4" Mar 16 17:40:12 crc kubenswrapper[5120]: I0316 17:40:12.283509 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/cb9e9af1-7275-4426-aa22-16b916aada88-operator-scripts\") pod \"keystonebc2c-account-delete-qrxr4\" (UID: \"cb9e9af1-7275-4426-aa22-16b916aada88\") " pod="barbican-kuttl-tests/keystonebc2c-account-delete-qrxr4" Mar 16 17:40:12 crc kubenswrapper[5120]: I0316 17:40:12.283697 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pq25d\" (UniqueName: \"kubernetes.io/projected/cb9e9af1-7275-4426-aa22-16b916aada88-kube-api-access-pq25d\") pod \"keystonebc2c-account-delete-qrxr4\" (UID: \"cb9e9af1-7275-4426-aa22-16b916aada88\") " pod="barbican-kuttl-tests/keystonebc2c-account-delete-qrxr4" Mar 16 17:40:12 crc kubenswrapper[5120]: I0316 17:40:12.284489 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/cb9e9af1-7275-4426-aa22-16b916aada88-operator-scripts\") pod \"keystonebc2c-account-delete-qrxr4\" (UID: \"cb9e9af1-7275-4426-aa22-16b916aada88\") " pod="barbican-kuttl-tests/keystonebc2c-account-delete-qrxr4" Mar 16 17:40:12 crc kubenswrapper[5120]: I0316 17:40:12.310182 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pq25d\" (UniqueName: \"kubernetes.io/projected/cb9e9af1-7275-4426-aa22-16b916aada88-kube-api-access-pq25d\") pod \"keystonebc2c-account-delete-qrxr4\" (UID: \"cb9e9af1-7275-4426-aa22-16b916aada88\") " pod="barbican-kuttl-tests/keystonebc2c-account-delete-qrxr4" Mar 16 17:40:12 crc kubenswrapper[5120]: I0316 17:40:12.404578 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/keystonebc2c-account-delete-qrxr4" Mar 16 17:40:12 crc kubenswrapper[5120]: I0316 17:40:12.594525 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["barbican-kuttl-tests/root-account-create-update-9lfqj"] Mar 16 17:40:12 crc kubenswrapper[5120]: I0316 17:40:12.607525 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["barbican-kuttl-tests/root-account-create-update-9lfqj"] Mar 16 17:40:12 crc kubenswrapper[5120]: I0316 17:40:12.618691 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["barbican-kuttl-tests/root-account-create-update-dmzgs"] Mar 16 17:40:12 crc kubenswrapper[5120]: I0316 17:40:12.631188 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/root-account-create-update-dmzgs" Mar 16 17:40:12 crc kubenswrapper[5120]: I0316 17:40:12.632893 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"barbican-kuttl-tests\"/\"openstack-mariadb-root-db-secret\"" Mar 16 17:40:12 crc kubenswrapper[5120]: I0316 17:40:12.641861 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["barbican-kuttl-tests/openstack-galera-0"] Mar 16 17:40:12 crc kubenswrapper[5120]: I0316 17:40:12.651642 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["barbican-kuttl-tests/openstack-galera-1"] Mar 16 17:40:12 crc kubenswrapper[5120]: I0316 17:40:12.673227 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="48098691-6364-4c1b-a898-645bce424cb1" path="/var/lib/kubelet/pods/48098691-6364-4c1b-a898-645bce424cb1/volumes" Mar 16 17:40:12 crc kubenswrapper[5120]: I0316 17:40:12.674105 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f852726-0929-487f-98f9-de1ec1032632" path="/var/lib/kubelet/pods/6f852726-0929-487f-98f9-de1ec1032632/volumes" Mar 16 17:40:12 crc kubenswrapper[5120]: I0316 17:40:12.674717 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fea2a8bc-e02b-417c-b271-459320e26809" path="/var/lib/kubelet/pods/fea2a8bc-e02b-417c-b271-459320e26809/volumes" Mar 16 17:40:12 crc kubenswrapper[5120]: I0316 17:40:12.675318 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["barbican-kuttl-tests/openstack-galera-2"] Mar 16 17:40:12 crc kubenswrapper[5120]: I0316 17:40:12.675358 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["barbican-kuttl-tests/root-account-create-update-dmzgs"] Mar 16 17:40:12 crc kubenswrapper[5120]: I0316 17:40:12.687254 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["barbican-kuttl-tests/root-account-create-update-dmzgs"] Mar 16 17:40:12 crc kubenswrapper[5120]: E0316 17:40:12.687776 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-9mcdt operator-scripts], unattached volumes=[], failed to process volumes=[kube-api-access-9mcdt operator-scripts]: context canceled" pod="barbican-kuttl-tests/root-account-create-update-dmzgs" podUID="e41e096c-cffc-44c7-a3e9-251e01ac36c2" Mar 16 17:40:12 crc kubenswrapper[5120]: I0316 17:40:12.794348 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e41e096c-cffc-44c7-a3e9-251e01ac36c2-operator-scripts\") pod \"root-account-create-update-dmzgs\" (UID: \"e41e096c-cffc-44c7-a3e9-251e01ac36c2\") " pod="barbican-kuttl-tests/root-account-create-update-dmzgs" Mar 16 17:40:12 crc kubenswrapper[5120]: I0316 17:40:12.794581 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mcdt\" (UniqueName: \"kubernetes.io/projected/e41e096c-cffc-44c7-a3e9-251e01ac36c2-kube-api-access-9mcdt\") pod \"root-account-create-update-dmzgs\" (UID: \"e41e096c-cffc-44c7-a3e9-251e01ac36c2\") " pod="barbican-kuttl-tests/root-account-create-update-dmzgs" Mar 16 17:40:12 crc kubenswrapper[5120]: I0316 17:40:12.803607 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["barbican-kuttl-tests/keystonebc2c-account-delete-qrxr4"] Mar 16 17:40:12 crc kubenswrapper[5120]: I0316 17:40:12.848566 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="barbican-kuttl-tests/openstack-galera-2" podUID="c2432965-72a9-4f38-a930-85969dfa64d6" containerName="galera" containerID="cri-o://1deaa04f0ba47668cb024c27266a0f617291e4ea399fd904803d2a470feb57ab" gracePeriod=30 Mar 16 17:40:12 crc kubenswrapper[5120]: I0316 17:40:12.897191 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e41e096c-cffc-44c7-a3e9-251e01ac36c2-operator-scripts\") pod \"root-account-create-update-dmzgs\" (UID: \"e41e096c-cffc-44c7-a3e9-251e01ac36c2\") " pod="barbican-kuttl-tests/root-account-create-update-dmzgs" Mar 16 17:40:12 crc kubenswrapper[5120]: E0316 17:40:12.897326 5120 configmap.go:193] Couldn't get configMap barbican-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Mar 16 17:40:12 crc kubenswrapper[5120]: I0316 17:40:12.897385 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9mcdt\" (UniqueName: \"kubernetes.io/projected/e41e096c-cffc-44c7-a3e9-251e01ac36c2-kube-api-access-9mcdt\") pod \"root-account-create-update-dmzgs\" (UID: \"e41e096c-cffc-44c7-a3e9-251e01ac36c2\") " pod="barbican-kuttl-tests/root-account-create-update-dmzgs" Mar 16 17:40:12 crc kubenswrapper[5120]: E0316 17:40:12.897402 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e41e096c-cffc-44c7-a3e9-251e01ac36c2-operator-scripts podName:e41e096c-cffc-44c7-a3e9-251e01ac36c2 nodeName:}" failed. No retries permitted until 2026-03-16 17:40:13.397380972 +0000 UTC m=+7715.551312629 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/e41e096c-cffc-44c7-a3e9-251e01ac36c2-operator-scripts") pod "root-account-create-update-dmzgs" (UID: "e41e096c-cffc-44c7-a3e9-251e01ac36c2") : configmap "openstack-scripts" not found Mar 16 17:40:12 crc kubenswrapper[5120]: E0316 17:40:12.900384 5120 projected.go:194] Error preparing data for projected volume kube-api-access-9mcdt for pod barbican-kuttl-tests/root-account-create-update-dmzgs: failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 17:40:12 crc kubenswrapper[5120]: E0316 17:40:12.900481 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e41e096c-cffc-44c7-a3e9-251e01ac36c2-kube-api-access-9mcdt podName:e41e096c-cffc-44c7-a3e9-251e01ac36c2 nodeName:}" failed. No retries permitted until 2026-03-16 17:40:13.400456136 +0000 UTC m=+7715.554387803 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-9mcdt" (UniqueName: "kubernetes.io/projected/e41e096c-cffc-44c7-a3e9-251e01ac36c2-kube-api-access-9mcdt") pod "root-account-create-update-dmzgs" (UID: "e41e096c-cffc-44c7-a3e9-251e01ac36c2") : failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 17:40:12 crc kubenswrapper[5120]: E0316 17:40:12.912727 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="1deaa04f0ba47668cb024c27266a0f617291e4ea399fd904803d2a470feb57ab" cmd=["/bin/bash","/var/lib/operator-scripts/mysql_probe.sh","readiness"] Mar 16 17:40:12 crc kubenswrapper[5120]: E0316 17:40:12.914213 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="1deaa04f0ba47668cb024c27266a0f617291e4ea399fd904803d2a470feb57ab" cmd=["/bin/bash","/var/lib/operator-scripts/mysql_probe.sh","readiness"] Mar 16 17:40:12 crc kubenswrapper[5120]: E0316 17:40:12.916123 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="1deaa04f0ba47668cb024c27266a0f617291e4ea399fd904803d2a470feb57ab" cmd=["/bin/bash","/var/lib/operator-scripts/mysql_probe.sh","readiness"] Mar 16 17:40:12 crc kubenswrapper[5120]: E0316 17:40:12.916167 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="barbican-kuttl-tests/openstack-galera-2" podUID="c2432965-72a9-4f38-a930-85969dfa64d6" containerName="galera" probeResult="unknown" Mar 16 17:40:13 crc kubenswrapper[5120]: I0316 17:40:13.202391 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/keystonebc2c-account-delete-qrxr4" event={"ID":"cb9e9af1-7275-4426-aa22-16b916aada88","Type":"ContainerStarted","Data":"3124046d368790ee76ca66a09606c2e98edd8cb1ec54da19d4cfa2882737b009"} Mar 16 17:40:13 crc kubenswrapper[5120]: I0316 17:40:13.202724 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/keystonebc2c-account-delete-qrxr4" event={"ID":"cb9e9af1-7275-4426-aa22-16b916aada88","Type":"ContainerStarted","Data":"4c9178f9b51802034227021d2a1db399b99bb01d9411e6ee379e1c9fb66ace2f"} Mar 16 17:40:13 crc kubenswrapper[5120]: I0316 17:40:13.202695 5120 kubelet_pods.go:1019] "Unable to retrieve pull secret, the image pull may not succeed." pod="barbican-kuttl-tests/keystonebc2c-account-delete-qrxr4" secret="" err="secret \"galera-openstack-dockercfg-fkfpr\" not found" Mar 16 17:40:13 crc kubenswrapper[5120]: I0316 17:40:13.202594 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/root-account-create-update-dmzgs" Mar 16 17:40:13 crc kubenswrapper[5120]: I0316 17:40:13.216438 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="barbican-kuttl-tests/keystonebc2c-account-delete-qrxr4" podStartSLOduration=1.216419225 podStartE2EDuration="1.216419225s" podCreationTimestamp="2026-03-16 17:40:12 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:40:13.213708431 +0000 UTC m=+7715.367640088" watchObservedRunningTime="2026-03-16 17:40:13.216419225 +0000 UTC m=+7715.370350882" Mar 16 17:40:13 crc kubenswrapper[5120]: I0316 17:40:13.217478 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/root-account-create-update-dmzgs" Mar 16 17:40:13 crc kubenswrapper[5120]: I0316 17:40:13.288086 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["barbican-kuttl-tests/memcached-0"] Mar 16 17:40:13 crc kubenswrapper[5120]: I0316 17:40:13.288357 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="barbican-kuttl-tests/memcached-0" podUID="9b2e5d7a-5b39-424d-9eaa-dcace83ebf72" containerName="memcached" containerID="cri-o://fe506b38b0a486a1a40d17b9ef257ac599887749a33908cd6653bd7e99071613" gracePeriod=30 Mar 16 17:40:13 crc kubenswrapper[5120]: E0316 17:40:13.306058 5120 configmap.go:193] Couldn't get configMap barbican-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Mar 16 17:40:13 crc kubenswrapper[5120]: E0316 17:40:13.306174 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cb9e9af1-7275-4426-aa22-16b916aada88-operator-scripts podName:cb9e9af1-7275-4426-aa22-16b916aada88 nodeName:}" failed. No retries permitted until 2026-03-16 17:40:13.806150466 +0000 UTC m=+7715.960082123 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/cb9e9af1-7275-4426-aa22-16b916aada88-operator-scripts") pod "keystonebc2c-account-delete-qrxr4" (UID: "cb9e9af1-7275-4426-aa22-16b916aada88") : configmap "openstack-scripts" not found Mar 16 17:40:13 crc kubenswrapper[5120]: I0316 17:40:13.408408 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e41e096c-cffc-44c7-a3e9-251e01ac36c2-operator-scripts\") pod \"root-account-create-update-dmzgs\" (UID: \"e41e096c-cffc-44c7-a3e9-251e01ac36c2\") " pod="barbican-kuttl-tests/root-account-create-update-dmzgs" Mar 16 17:40:13 crc kubenswrapper[5120]: E0316 17:40:13.408488 5120 configmap.go:193] Couldn't get configMap barbican-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Mar 16 17:40:13 crc kubenswrapper[5120]: I0316 17:40:13.408542 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9mcdt\" (UniqueName: \"kubernetes.io/projected/e41e096c-cffc-44c7-a3e9-251e01ac36c2-kube-api-access-9mcdt\") pod \"root-account-create-update-dmzgs\" (UID: \"e41e096c-cffc-44c7-a3e9-251e01ac36c2\") " pod="barbican-kuttl-tests/root-account-create-update-dmzgs" Mar 16 17:40:13 crc kubenswrapper[5120]: E0316 17:40:13.408556 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e41e096c-cffc-44c7-a3e9-251e01ac36c2-operator-scripts podName:e41e096c-cffc-44c7-a3e9-251e01ac36c2 nodeName:}" failed. No retries permitted until 2026-03-16 17:40:14.408539952 +0000 UTC m=+7716.562471609 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/e41e096c-cffc-44c7-a3e9-251e01ac36c2-operator-scripts") pod "root-account-create-update-dmzgs" (UID: "e41e096c-cffc-44c7-a3e9-251e01ac36c2") : configmap "openstack-scripts" not found Mar 16 17:40:13 crc kubenswrapper[5120]: E0316 17:40:13.411492 5120 projected.go:194] Error preparing data for projected volume kube-api-access-9mcdt for pod barbican-kuttl-tests/root-account-create-update-dmzgs: failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 17:40:13 crc kubenswrapper[5120]: E0316 17:40:13.411584 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e41e096c-cffc-44c7-a3e9-251e01ac36c2-kube-api-access-9mcdt podName:e41e096c-cffc-44c7-a3e9-251e01ac36c2 nodeName:}" failed. No retries permitted until 2026-03-16 17:40:14.411564534 +0000 UTC m=+7716.565496191 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-9mcdt" (UniqueName: "kubernetes.io/projected/e41e096c-cffc-44c7-a3e9-251e01ac36c2-kube-api-access-9mcdt") pod "root-account-create-update-dmzgs" (UID: "e41e096c-cffc-44c7-a3e9-251e01ac36c2") : failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 17:40:13 crc kubenswrapper[5120]: I0316 17:40:13.684504 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["barbican-kuttl-tests/rabbitmq-server-0"] Mar 16 17:40:13 crc kubenswrapper[5120]: I0316 17:40:13.776944 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/openstack-galera-2" Mar 16 17:40:13 crc kubenswrapper[5120]: E0316 17:40:13.817938 5120 configmap.go:193] Couldn't get configMap barbican-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Mar 16 17:40:13 crc kubenswrapper[5120]: E0316 17:40:13.818007 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cb9e9af1-7275-4426-aa22-16b916aada88-operator-scripts podName:cb9e9af1-7275-4426-aa22-16b916aada88 nodeName:}" failed. No retries permitted until 2026-03-16 17:40:14.817993033 +0000 UTC m=+7716.971924690 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/cb9e9af1-7275-4426-aa22-16b916aada88-operator-scripts") pod "keystonebc2c-account-delete-qrxr4" (UID: "cb9e9af1-7275-4426-aa22-16b916aada88") : configmap "openstack-scripts" not found Mar 16 17:40:13 crc kubenswrapper[5120]: I0316 17:40:13.920554 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/c2432965-72a9-4f38-a930-85969dfa64d6-config-data-generated\") pod \"c2432965-72a9-4f38-a930-85969dfa64d6\" (UID: \"c2432965-72a9-4f38-a930-85969dfa64d6\") " Mar 16 17:40:13 crc kubenswrapper[5120]: I0316 17:40:13.920744 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v2g98\" (UniqueName: \"kubernetes.io/projected/c2432965-72a9-4f38-a930-85969dfa64d6-kube-api-access-v2g98\") pod \"c2432965-72a9-4f38-a930-85969dfa64d6\" (UID: \"c2432965-72a9-4f38-a930-85969dfa64d6\") " Mar 16 17:40:13 crc kubenswrapper[5120]: I0316 17:40:13.920825 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"mysql-db\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"c2432965-72a9-4f38-a930-85969dfa64d6\" (UID: \"c2432965-72a9-4f38-a930-85969dfa64d6\") " Mar 16 17:40:13 crc kubenswrapper[5120]: I0316 17:40:13.920875 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c2432965-72a9-4f38-a930-85969dfa64d6-operator-scripts\") pod \"c2432965-72a9-4f38-a930-85969dfa64d6\" (UID: \"c2432965-72a9-4f38-a930-85969dfa64d6\") " Mar 16 17:40:13 crc kubenswrapper[5120]: I0316 17:40:13.920990 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2432965-72a9-4f38-a930-85969dfa64d6-config-data-generated" (OuterVolumeSpecName: "config-data-generated") pod "c2432965-72a9-4f38-a930-85969dfa64d6" (UID: "c2432965-72a9-4f38-a930-85969dfa64d6"). InnerVolumeSpecName "config-data-generated". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:40:13 crc kubenswrapper[5120]: I0316 17:40:13.921130 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/c2432965-72a9-4f38-a930-85969dfa64d6-config-data-default\") pod \"c2432965-72a9-4f38-a930-85969dfa64d6\" (UID: \"c2432965-72a9-4f38-a930-85969dfa64d6\") " Mar 16 17:40:13 crc kubenswrapper[5120]: I0316 17:40:13.921242 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/c2432965-72a9-4f38-a930-85969dfa64d6-kolla-config\") pod \"c2432965-72a9-4f38-a930-85969dfa64d6\" (UID: \"c2432965-72a9-4f38-a930-85969dfa64d6\") " Mar 16 17:40:13 crc kubenswrapper[5120]: I0316 17:40:13.921546 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c2432965-72a9-4f38-a930-85969dfa64d6-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "c2432965-72a9-4f38-a930-85969dfa64d6" (UID: "c2432965-72a9-4f38-a930-85969dfa64d6"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:40:13 crc kubenswrapper[5120]: I0316 17:40:13.921912 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c2432965-72a9-4f38-a930-85969dfa64d6-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "c2432965-72a9-4f38-a930-85969dfa64d6" (UID: "c2432965-72a9-4f38-a930-85969dfa64d6"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:40:13 crc kubenswrapper[5120]: I0316 17:40:13.922091 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c2432965-72a9-4f38-a930-85969dfa64d6-config-data-default" (OuterVolumeSpecName: "config-data-default") pod "c2432965-72a9-4f38-a930-85969dfa64d6" (UID: "c2432965-72a9-4f38-a930-85969dfa64d6"). InnerVolumeSpecName "config-data-default". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:40:13 crc kubenswrapper[5120]: I0316 17:40:13.922613 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c2432965-72a9-4f38-a930-85969dfa64d6-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:40:13 crc kubenswrapper[5120]: I0316 17:40:13.922671 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/c2432965-72a9-4f38-a930-85969dfa64d6-config-data-default\") on node \"crc\" DevicePath \"\"" Mar 16 17:40:13 crc kubenswrapper[5120]: I0316 17:40:13.922682 5120 reconciler_common.go:299] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/c2432965-72a9-4f38-a930-85969dfa64d6-kolla-config\") on node \"crc\" DevicePath \"\"" Mar 16 17:40:13 crc kubenswrapper[5120]: I0316 17:40:13.922691 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/c2432965-72a9-4f38-a930-85969dfa64d6-config-data-generated\") on node \"crc\" DevicePath \"\"" Mar 16 17:40:13 crc kubenswrapper[5120]: I0316 17:40:13.927328 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2432965-72a9-4f38-a930-85969dfa64d6-kube-api-access-v2g98" (OuterVolumeSpecName: "kube-api-access-v2g98") pod "c2432965-72a9-4f38-a930-85969dfa64d6" (UID: "c2432965-72a9-4f38-a930-85969dfa64d6"). InnerVolumeSpecName "kube-api-access-v2g98". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:40:13 crc kubenswrapper[5120]: I0316 17:40:13.932596 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage02-crc" (OuterVolumeSpecName: "mysql-db") pod "c2432965-72a9-4f38-a930-85969dfa64d6" (UID: "c2432965-72a9-4f38-a930-85969dfa64d6"). InnerVolumeSpecName "local-storage02-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 17:40:14 crc kubenswrapper[5120]: I0316 17:40:14.025130 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v2g98\" (UniqueName: \"kubernetes.io/projected/c2432965-72a9-4f38-a930-85969dfa64d6-kube-api-access-v2g98\") on node \"crc\" DevicePath \"\"" Mar 16 17:40:14 crc kubenswrapper[5120]: I0316 17:40:14.025201 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") on node \"crc\" " Mar 16 17:40:14 crc kubenswrapper[5120]: I0316 17:40:14.058062 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["barbican-kuttl-tests/rabbitmq-server-0"] Mar 16 17:40:14 crc kubenswrapper[5120]: I0316 17:40:14.060074 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage02-crc" (UniqueName: "kubernetes.io/local-volume/local-storage02-crc") on node "crc" Mar 16 17:40:14 crc kubenswrapper[5120]: I0316 17:40:14.127179 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") on node \"crc\" DevicePath \"\"" Mar 16 17:40:14 crc kubenswrapper[5120]: I0316 17:40:14.212898 5120 generic.go:358] "Generic (PLEG): container finished" podID="cb9e9af1-7275-4426-aa22-16b916aada88" containerID="3124046d368790ee76ca66a09606c2e98edd8cb1ec54da19d4cfa2882737b009" exitCode=1 Mar 16 17:40:14 crc kubenswrapper[5120]: I0316 17:40:14.213019 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/keystonebc2c-account-delete-qrxr4" event={"ID":"cb9e9af1-7275-4426-aa22-16b916aada88","Type":"ContainerDied","Data":"3124046d368790ee76ca66a09606c2e98edd8cb1ec54da19d4cfa2882737b009"} Mar 16 17:40:14 crc kubenswrapper[5120]: I0316 17:40:14.213359 5120 kubelet_pods.go:1019] "Unable to retrieve pull secret, the image pull may not succeed." pod="barbican-kuttl-tests/keystonebc2c-account-delete-qrxr4" secret="" err="secret \"galera-openstack-dockercfg-fkfpr\" not found" Mar 16 17:40:14 crc kubenswrapper[5120]: I0316 17:40:14.213397 5120 scope.go:117] "RemoveContainer" containerID="3124046d368790ee76ca66a09606c2e98edd8cb1ec54da19d4cfa2882737b009" Mar 16 17:40:14 crc kubenswrapper[5120]: I0316 17:40:14.217118 5120 generic.go:358] "Generic (PLEG): container finished" podID="c2432965-72a9-4f38-a930-85969dfa64d6" containerID="1deaa04f0ba47668cb024c27266a0f617291e4ea399fd904803d2a470feb57ab" exitCode=0 Mar 16 17:40:14 crc kubenswrapper[5120]: I0316 17:40:14.217196 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/openstack-galera-2" Mar 16 17:40:14 crc kubenswrapper[5120]: I0316 17:40:14.217260 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/openstack-galera-2" event={"ID":"c2432965-72a9-4f38-a930-85969dfa64d6","Type":"ContainerDied","Data":"1deaa04f0ba47668cb024c27266a0f617291e4ea399fd904803d2a470feb57ab"} Mar 16 17:40:14 crc kubenswrapper[5120]: I0316 17:40:14.217326 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/openstack-galera-2" event={"ID":"c2432965-72a9-4f38-a930-85969dfa64d6","Type":"ContainerDied","Data":"6c8907aefefe446ebb8725abdce8a0b9739fd3b4fcc101ea185c7962945abde5"} Mar 16 17:40:14 crc kubenswrapper[5120]: I0316 17:40:14.217357 5120 scope.go:117] "RemoveContainer" containerID="1deaa04f0ba47668cb024c27266a0f617291e4ea399fd904803d2a470feb57ab" Mar 16 17:40:14 crc kubenswrapper[5120]: I0316 17:40:14.217496 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/root-account-create-update-dmzgs" Mar 16 17:40:14 crc kubenswrapper[5120]: I0316 17:40:14.263840 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="barbican-kuttl-tests/rabbitmq-server-0" podUID="459c983d-9938-4660-a965-31585832f250" containerName="rabbitmq" containerID="cri-o://1b67907377eee71752ebe9934ed076a8ff8f72f6f441c792b8fe77eb0b9cccaa" gracePeriod=604800 Mar 16 17:40:14 crc kubenswrapper[5120]: I0316 17:40:14.266315 5120 scope.go:117] "RemoveContainer" containerID="92ace8bba3c5af5aa6d82a9d1f8721131c908a88141430070c28206a65352c46" Mar 16 17:40:14 crc kubenswrapper[5120]: I0316 17:40:14.281826 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["barbican-kuttl-tests/openstack-galera-2"] Mar 16 17:40:14 crc kubenswrapper[5120]: I0316 17:40:14.292423 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["barbican-kuttl-tests/openstack-galera-2"] Mar 16 17:40:14 crc kubenswrapper[5120]: I0316 17:40:14.305340 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["barbican-kuttl-tests/root-account-create-update-dmzgs"] Mar 16 17:40:14 crc kubenswrapper[5120]: I0316 17:40:14.311703 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["barbican-kuttl-tests/root-account-create-update-dmzgs"] Mar 16 17:40:14 crc kubenswrapper[5120]: I0316 17:40:14.311837 5120 scope.go:117] "RemoveContainer" containerID="1deaa04f0ba47668cb024c27266a0f617291e4ea399fd904803d2a470feb57ab" Mar 16 17:40:14 crc kubenswrapper[5120]: E0316 17:40:14.312474 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1deaa04f0ba47668cb024c27266a0f617291e4ea399fd904803d2a470feb57ab\": container with ID starting with 1deaa04f0ba47668cb024c27266a0f617291e4ea399fd904803d2a470feb57ab not found: ID does not exist" containerID="1deaa04f0ba47668cb024c27266a0f617291e4ea399fd904803d2a470feb57ab" Mar 16 17:40:14 crc kubenswrapper[5120]: I0316 17:40:14.312898 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1deaa04f0ba47668cb024c27266a0f617291e4ea399fd904803d2a470feb57ab"} err="failed to get container status \"1deaa04f0ba47668cb024c27266a0f617291e4ea399fd904803d2a470feb57ab\": rpc error: code = NotFound desc = could not find container \"1deaa04f0ba47668cb024c27266a0f617291e4ea399fd904803d2a470feb57ab\": container with ID starting with 1deaa04f0ba47668cb024c27266a0f617291e4ea399fd904803d2a470feb57ab not found: ID does not exist" Mar 16 17:40:14 crc kubenswrapper[5120]: I0316 17:40:14.312942 5120 scope.go:117] "RemoveContainer" containerID="92ace8bba3c5af5aa6d82a9d1f8721131c908a88141430070c28206a65352c46" Mar 16 17:40:14 crc kubenswrapper[5120]: E0316 17:40:14.313413 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"92ace8bba3c5af5aa6d82a9d1f8721131c908a88141430070c28206a65352c46\": container with ID starting with 92ace8bba3c5af5aa6d82a9d1f8721131c908a88141430070c28206a65352c46 not found: ID does not exist" containerID="92ace8bba3c5af5aa6d82a9d1f8721131c908a88141430070c28206a65352c46" Mar 16 17:40:14 crc kubenswrapper[5120]: I0316 17:40:14.313440 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92ace8bba3c5af5aa6d82a9d1f8721131c908a88141430070c28206a65352c46"} err="failed to get container status \"92ace8bba3c5af5aa6d82a9d1f8721131c908a88141430070c28206a65352c46\": rpc error: code = NotFound desc = could not find container \"92ace8bba3c5af5aa6d82a9d1f8721131c908a88141430070c28206a65352c46\": container with ID starting with 92ace8bba3c5af5aa6d82a9d1f8721131c908a88141430070c28206a65352c46 not found: ID does not exist" Mar 16 17:40:14 crc kubenswrapper[5120]: I0316 17:40:14.336292 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e41e096c-cffc-44c7-a3e9-251e01ac36c2-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:40:14 crc kubenswrapper[5120]: I0316 17:40:14.336329 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9mcdt\" (UniqueName: \"kubernetes.io/projected/e41e096c-cffc-44c7-a3e9-251e01ac36c2-kube-api-access-9mcdt\") on node \"crc\" DevicePath \"\"" Mar 16 17:40:14 crc kubenswrapper[5120]: I0316 17:40:14.678785 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c2432965-72a9-4f38-a930-85969dfa64d6" path="/var/lib/kubelet/pods/c2432965-72a9-4f38-a930-85969dfa64d6/volumes" Mar 16 17:40:14 crc kubenswrapper[5120]: I0316 17:40:14.679951 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e41e096c-cffc-44c7-a3e9-251e01ac36c2" path="/var/lib/kubelet/pods/e41e096c-cffc-44c7-a3e9-251e01ac36c2/volumes" Mar 16 17:40:14 crc kubenswrapper[5120]: I0316 17:40:14.826353 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/barbican-operator-controller-manager-58bf5697d6-vhnpj"] Mar 16 17:40:14 crc kubenswrapper[5120]: I0316 17:40:14.826678 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-operators/barbican-operator-controller-manager-58bf5697d6-vhnpj" podUID="5068ab90-b1e6-427e-9a8b-e77bbc0ffe1f" containerName="manager" containerID="cri-o://933d0eab8fda7bf80fa1bb171e7d2aed8c7939ac0f47a72f7df801eb4b529108" gracePeriod=10 Mar 16 17:40:14 crc kubenswrapper[5120]: E0316 17:40:14.848277 5120 configmap.go:193] Couldn't get configMap barbican-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Mar 16 17:40:14 crc kubenswrapper[5120]: E0316 17:40:14.848346 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cb9e9af1-7275-4426-aa22-16b916aada88-operator-scripts podName:cb9e9af1-7275-4426-aa22-16b916aada88 nodeName:}" failed. No retries permitted until 2026-03-16 17:40:16.848331252 +0000 UTC m=+7719.002262909 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/cb9e9af1-7275-4426-aa22-16b916aada88-operator-scripts") pod "keystonebc2c-account-delete-qrxr4" (UID: "cb9e9af1-7275-4426-aa22-16b916aada88") : configmap "openstack-scripts" not found Mar 16 17:40:14 crc kubenswrapper[5120]: I0316 17:40:14.906965 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="barbican-kuttl-tests/openstack-galera-1" podUID="05269e3d-2dcd-4828-8142-7399752715b3" containerName="galera" containerID="cri-o://a479804a3d0df2071c52b491d2c146037b2340dde34949b3e23c461b0785e14e" gracePeriod=28 Mar 16 17:40:15 crc kubenswrapper[5120]: I0316 17:40:15.046060 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/barbican-operator-index-ck2pw"] Mar 16 17:40:15 crc kubenswrapper[5120]: I0316 17:40:15.046309 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-operators/barbican-operator-index-ck2pw" podUID="a5ccdf19-64ed-4e83-b87f-d8623f7cd27e" containerName="registry-server" containerID="cri-o://245a20fdc8132bd71d3234132847da0827395481054b4a9791fbb7ea50baf3f6" gracePeriod=30 Mar 16 17:40:15 crc kubenswrapper[5120]: I0316 17:40:15.171551 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/43a0c6ba899107f448cc8c26f41e0ea8a8e90cd460116391929dfaf690nlf9w"] Mar 16 17:40:15 crc kubenswrapper[5120]: I0316 17:40:15.240032 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-operators/43a0c6ba899107f448cc8c26f41e0ea8a8e90cd460116391929dfaf690nlf9w"] Mar 16 17:40:15 crc kubenswrapper[5120]: I0316 17:40:15.258562 5120 generic.go:358] "Generic (PLEG): container finished" podID="a5ccdf19-64ed-4e83-b87f-d8623f7cd27e" containerID="245a20fdc8132bd71d3234132847da0827395481054b4a9791fbb7ea50baf3f6" exitCode=0 Mar 16 17:40:15 crc kubenswrapper[5120]: I0316 17:40:15.259129 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/barbican-operator-index-ck2pw" event={"ID":"a5ccdf19-64ed-4e83-b87f-d8623f7cd27e","Type":"ContainerDied","Data":"245a20fdc8132bd71d3234132847da0827395481054b4a9791fbb7ea50baf3f6"} Mar 16 17:40:15 crc kubenswrapper[5120]: I0316 17:40:15.282066 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/keystonebc2c-account-delete-qrxr4" event={"ID":"cb9e9af1-7275-4426-aa22-16b916aada88","Type":"ContainerDied","Data":"66999a73b19486f492f66c0964804b03f94b2f0b7e7d29ea04e4af3ae8496d88"} Mar 16 17:40:15 crc kubenswrapper[5120]: I0316 17:40:15.282215 5120 scope.go:117] "RemoveContainer" containerID="3124046d368790ee76ca66a09606c2e98edd8cb1ec54da19d4cfa2882737b009" Mar 16 17:40:15 crc kubenswrapper[5120]: I0316 17:40:15.282344 5120 kubelet_pods.go:1019] "Unable to retrieve pull secret, the image pull may not succeed." pod="barbican-kuttl-tests/keystonebc2c-account-delete-qrxr4" secret="" err="secret \"galera-openstack-dockercfg-fkfpr\" not found" Mar 16 17:40:15 crc kubenswrapper[5120]: I0316 17:40:15.282390 5120 scope.go:117] "RemoveContainer" containerID="66999a73b19486f492f66c0964804b03f94b2f0b7e7d29ea04e4af3ae8496d88" Mar 16 17:40:15 crc kubenswrapper[5120]: E0316 17:40:15.282874 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"mariadb-account-delete\" with CrashLoopBackOff: \"back-off 10s restarting failed container=mariadb-account-delete pod=keystonebc2c-account-delete-qrxr4_barbican-kuttl-tests(cb9e9af1-7275-4426-aa22-16b916aada88)\"" pod="barbican-kuttl-tests/keystonebc2c-account-delete-qrxr4" podUID="cb9e9af1-7275-4426-aa22-16b916aada88" Mar 16 17:40:15 crc kubenswrapper[5120]: I0316 17:40:15.284629 5120 generic.go:358] "Generic (PLEG): container finished" podID="cb9e9af1-7275-4426-aa22-16b916aada88" containerID="66999a73b19486f492f66c0964804b03f94b2f0b7e7d29ea04e4af3ae8496d88" exitCode=1 Mar 16 17:40:15 crc kubenswrapper[5120]: I0316 17:40:15.300584 5120 generic.go:358] "Generic (PLEG): container finished" podID="9b2e5d7a-5b39-424d-9eaa-dcace83ebf72" containerID="fe506b38b0a486a1a40d17b9ef257ac599887749a33908cd6653bd7e99071613" exitCode=0 Mar 16 17:40:15 crc kubenswrapper[5120]: I0316 17:40:15.300684 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/memcached-0" event={"ID":"9b2e5d7a-5b39-424d-9eaa-dcace83ebf72","Type":"ContainerDied","Data":"fe506b38b0a486a1a40d17b9ef257ac599887749a33908cd6653bd7e99071613"} Mar 16 17:40:15 crc kubenswrapper[5120]: I0316 17:40:15.316686 5120 generic.go:358] "Generic (PLEG): container finished" podID="5068ab90-b1e6-427e-9a8b-e77bbc0ffe1f" containerID="933d0eab8fda7bf80fa1bb171e7d2aed8c7939ac0f47a72f7df801eb4b529108" exitCode=0 Mar 16 17:40:15 crc kubenswrapper[5120]: I0316 17:40:15.316831 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/barbican-operator-controller-manager-58bf5697d6-vhnpj" event={"ID":"5068ab90-b1e6-427e-9a8b-e77bbc0ffe1f","Type":"ContainerDied","Data":"933d0eab8fda7bf80fa1bb171e7d2aed8c7939ac0f47a72f7df801eb4b529108"} Mar 16 17:40:15 crc kubenswrapper[5120]: I0316 17:40:15.522567 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/barbican-operator-controller-manager-58bf5697d6-vhnpj" Mar 16 17:40:15 crc kubenswrapper[5120]: I0316 17:40:15.578588 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5068ab90-b1e6-427e-9a8b-e77bbc0ffe1f-webhook-cert\") pod \"5068ab90-b1e6-427e-9a8b-e77bbc0ffe1f\" (UID: \"5068ab90-b1e6-427e-9a8b-e77bbc0ffe1f\") " Mar 16 17:40:15 crc kubenswrapper[5120]: I0316 17:40:15.578872 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5068ab90-b1e6-427e-9a8b-e77bbc0ffe1f-apiservice-cert\") pod \"5068ab90-b1e6-427e-9a8b-e77bbc0ffe1f\" (UID: \"5068ab90-b1e6-427e-9a8b-e77bbc0ffe1f\") " Mar 16 17:40:15 crc kubenswrapper[5120]: I0316 17:40:15.579061 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dr69f\" (UniqueName: \"kubernetes.io/projected/5068ab90-b1e6-427e-9a8b-e77bbc0ffe1f-kube-api-access-dr69f\") pod \"5068ab90-b1e6-427e-9a8b-e77bbc0ffe1f\" (UID: \"5068ab90-b1e6-427e-9a8b-e77bbc0ffe1f\") " Mar 16 17:40:15 crc kubenswrapper[5120]: I0316 17:40:15.617897 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5068ab90-b1e6-427e-9a8b-e77bbc0ffe1f-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "5068ab90-b1e6-427e-9a8b-e77bbc0ffe1f" (UID: "5068ab90-b1e6-427e-9a8b-e77bbc0ffe1f"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:40:15 crc kubenswrapper[5120]: I0316 17:40:15.623553 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5068ab90-b1e6-427e-9a8b-e77bbc0ffe1f-kube-api-access-dr69f" (OuterVolumeSpecName: "kube-api-access-dr69f") pod "5068ab90-b1e6-427e-9a8b-e77bbc0ffe1f" (UID: "5068ab90-b1e6-427e-9a8b-e77bbc0ffe1f"). InnerVolumeSpecName "kube-api-access-dr69f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:40:15 crc kubenswrapper[5120]: I0316 17:40:15.630457 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5068ab90-b1e6-427e-9a8b-e77bbc0ffe1f-apiservice-cert" (OuterVolumeSpecName: "apiservice-cert") pod "5068ab90-b1e6-427e-9a8b-e77bbc0ffe1f" (UID: "5068ab90-b1e6-427e-9a8b-e77bbc0ffe1f"). InnerVolumeSpecName "apiservice-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:40:15 crc kubenswrapper[5120]: I0316 17:40:15.682281 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dr69f\" (UniqueName: \"kubernetes.io/projected/5068ab90-b1e6-427e-9a8b-e77bbc0ffe1f-kube-api-access-dr69f\") on node \"crc\" DevicePath \"\"" Mar 16 17:40:15 crc kubenswrapper[5120]: I0316 17:40:15.682308 5120 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5068ab90-b1e6-427e-9a8b-e77bbc0ffe1f-webhook-cert\") on node \"crc\" DevicePath \"\"" Mar 16 17:40:15 crc kubenswrapper[5120]: I0316 17:40:15.682318 5120 reconciler_common.go:299] "Volume detached for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5068ab90-b1e6-427e-9a8b-e77bbc0ffe1f-apiservice-cert\") on node \"crc\" DevicePath \"\"" Mar 16 17:40:15 crc kubenswrapper[5120]: I0316 17:40:15.733365 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/barbican-operator-index-ck2pw" Mar 16 17:40:15 crc kubenswrapper[5120]: I0316 17:40:15.793847 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l7kdc\" (UniqueName: \"kubernetes.io/projected/a5ccdf19-64ed-4e83-b87f-d8623f7cd27e-kube-api-access-l7kdc\") pod \"a5ccdf19-64ed-4e83-b87f-d8623f7cd27e\" (UID: \"a5ccdf19-64ed-4e83-b87f-d8623f7cd27e\") " Mar 16 17:40:15 crc kubenswrapper[5120]: I0316 17:40:15.832002 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5ccdf19-64ed-4e83-b87f-d8623f7cd27e-kube-api-access-l7kdc" (OuterVolumeSpecName: "kube-api-access-l7kdc") pod "a5ccdf19-64ed-4e83-b87f-d8623f7cd27e" (UID: "a5ccdf19-64ed-4e83-b87f-d8623f7cd27e"). InnerVolumeSpecName "kube-api-access-l7kdc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:40:15 crc kubenswrapper[5120]: I0316 17:40:15.902241 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l7kdc\" (UniqueName: \"kubernetes.io/projected/a5ccdf19-64ed-4e83-b87f-d8623f7cd27e-kube-api-access-l7kdc\") on node \"crc\" DevicePath \"\"" Mar 16 17:40:15 crc kubenswrapper[5120]: I0316 17:40:15.959235 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/memcached-0" Mar 16 17:40:15 crc kubenswrapper[5120]: I0316 17:40:15.993413 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/keystone-667f6cf997-rrpr2" Mar 16 17:40:16 crc kubenswrapper[5120]: I0316 17:40:16.003597 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s7ffm\" (UniqueName: \"kubernetes.io/projected/9b2e5d7a-5b39-424d-9eaa-dcace83ebf72-kube-api-access-s7ffm\") pod \"9b2e5d7a-5b39-424d-9eaa-dcace83ebf72\" (UID: \"9b2e5d7a-5b39-424d-9eaa-dcace83ebf72\") " Mar 16 17:40:16 crc kubenswrapper[5120]: I0316 17:40:16.003873 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/9b2e5d7a-5b39-424d-9eaa-dcace83ebf72-kolla-config\") pod \"9b2e5d7a-5b39-424d-9eaa-dcace83ebf72\" (UID: \"9b2e5d7a-5b39-424d-9eaa-dcace83ebf72\") " Mar 16 17:40:16 crc kubenswrapper[5120]: I0316 17:40:16.004201 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/9b2e5d7a-5b39-424d-9eaa-dcace83ebf72-config-data\") pod \"9b2e5d7a-5b39-424d-9eaa-dcace83ebf72\" (UID: \"9b2e5d7a-5b39-424d-9eaa-dcace83ebf72\") " Mar 16 17:40:16 crc kubenswrapper[5120]: I0316 17:40:16.007878 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9b2e5d7a-5b39-424d-9eaa-dcace83ebf72-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "9b2e5d7a-5b39-424d-9eaa-dcace83ebf72" (UID: "9b2e5d7a-5b39-424d-9eaa-dcace83ebf72"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:40:16 crc kubenswrapper[5120]: I0316 17:40:16.012048 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9b2e5d7a-5b39-424d-9eaa-dcace83ebf72-config-data" (OuterVolumeSpecName: "config-data") pod "9b2e5d7a-5b39-424d-9eaa-dcace83ebf72" (UID: "9b2e5d7a-5b39-424d-9eaa-dcace83ebf72"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:40:16 crc kubenswrapper[5120]: I0316 17:40:16.014268 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b2e5d7a-5b39-424d-9eaa-dcace83ebf72-kube-api-access-s7ffm" (OuterVolumeSpecName: "kube-api-access-s7ffm") pod "9b2e5d7a-5b39-424d-9eaa-dcace83ebf72" (UID: "9b2e5d7a-5b39-424d-9eaa-dcace83ebf72"). InnerVolumeSpecName "kube-api-access-s7ffm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:40:16 crc kubenswrapper[5120]: I0316 17:40:16.105593 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/bbe1e943-d345-4e78-a91c-de129e2b82ea-scripts\") pod \"bbe1e943-d345-4e78-a91c-de129e2b82ea\" (UID: \"bbe1e943-d345-4e78-a91c-de129e2b82ea\") " Mar 16 17:40:16 crc kubenswrapper[5120]: I0316 17:40:16.105906 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bbe1e943-d345-4e78-a91c-de129e2b82ea-config-data\") pod \"bbe1e943-d345-4e78-a91c-de129e2b82ea\" (UID: \"bbe1e943-d345-4e78-a91c-de129e2b82ea\") " Mar 16 17:40:16 crc kubenswrapper[5120]: I0316 17:40:16.105983 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-klh5p\" (UniqueName: \"kubernetes.io/projected/bbe1e943-d345-4e78-a91c-de129e2b82ea-kube-api-access-klh5p\") pod \"bbe1e943-d345-4e78-a91c-de129e2b82ea\" (UID: \"bbe1e943-d345-4e78-a91c-de129e2b82ea\") " Mar 16 17:40:16 crc kubenswrapper[5120]: I0316 17:40:16.106138 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/bbe1e943-d345-4e78-a91c-de129e2b82ea-fernet-keys\") pod \"bbe1e943-d345-4e78-a91c-de129e2b82ea\" (UID: \"bbe1e943-d345-4e78-a91c-de129e2b82ea\") " Mar 16 17:40:16 crc kubenswrapper[5120]: I0316 17:40:16.106227 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/bbe1e943-d345-4e78-a91c-de129e2b82ea-credential-keys\") pod \"bbe1e943-d345-4e78-a91c-de129e2b82ea\" (UID: \"bbe1e943-d345-4e78-a91c-de129e2b82ea\") " Mar 16 17:40:16 crc kubenswrapper[5120]: I0316 17:40:16.106738 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s7ffm\" (UniqueName: \"kubernetes.io/projected/9b2e5d7a-5b39-424d-9eaa-dcace83ebf72-kube-api-access-s7ffm\") on node \"crc\" DevicePath \"\"" Mar 16 17:40:16 crc kubenswrapper[5120]: I0316 17:40:16.106752 5120 reconciler_common.go:299] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/9b2e5d7a-5b39-424d-9eaa-dcace83ebf72-kolla-config\") on node \"crc\" DevicePath \"\"" Mar 16 17:40:16 crc kubenswrapper[5120]: I0316 17:40:16.106774 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/9b2e5d7a-5b39-424d-9eaa-dcace83ebf72-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:40:16 crc kubenswrapper[5120]: I0316 17:40:16.125745 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bbe1e943-d345-4e78-a91c-de129e2b82ea-kube-api-access-klh5p" (OuterVolumeSpecName: "kube-api-access-klh5p") pod "bbe1e943-d345-4e78-a91c-de129e2b82ea" (UID: "bbe1e943-d345-4e78-a91c-de129e2b82ea"). InnerVolumeSpecName "kube-api-access-klh5p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:40:16 crc kubenswrapper[5120]: I0316 17:40:16.126035 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bbe1e943-d345-4e78-a91c-de129e2b82ea-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "bbe1e943-d345-4e78-a91c-de129e2b82ea" (UID: "bbe1e943-d345-4e78-a91c-de129e2b82ea"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:40:16 crc kubenswrapper[5120]: I0316 17:40:16.126080 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bbe1e943-d345-4e78-a91c-de129e2b82ea-scripts" (OuterVolumeSpecName: "scripts") pod "bbe1e943-d345-4e78-a91c-de129e2b82ea" (UID: "bbe1e943-d345-4e78-a91c-de129e2b82ea"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:40:16 crc kubenswrapper[5120]: I0316 17:40:16.131198 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/keystone-operator-controller-manager-64d54cb9b4-dksf5"] Mar 16 17:40:16 crc kubenswrapper[5120]: I0316 17:40:16.131507 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-operators/keystone-operator-controller-manager-64d54cb9b4-dksf5" podUID="ecba5863-ab91-4517-bc9b-553b7900ffc2" containerName="manager" containerID="cri-o://ac8af4331affd0aaf54eea45b82781a8a53a6a8ec4c5e22e608f6a0bcf6230c7" gracePeriod=10 Mar 16 17:40:16 crc kubenswrapper[5120]: I0316 17:40:16.164157 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bbe1e943-d345-4e78-a91c-de129e2b82ea-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "bbe1e943-d345-4e78-a91c-de129e2b82ea" (UID: "bbe1e943-d345-4e78-a91c-de129e2b82ea"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:40:16 crc kubenswrapper[5120]: I0316 17:40:16.183169 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bbe1e943-d345-4e78-a91c-de129e2b82ea-config-data" (OuterVolumeSpecName: "config-data") pod "bbe1e943-d345-4e78-a91c-de129e2b82ea" (UID: "bbe1e943-d345-4e78-a91c-de129e2b82ea"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:40:16 crc kubenswrapper[5120]: I0316 17:40:16.211418 5120 reconciler_common.go:299] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/bbe1e943-d345-4e78-a91c-de129e2b82ea-fernet-keys\") on node \"crc\" DevicePath \"\"" Mar 16 17:40:16 crc kubenswrapper[5120]: I0316 17:40:16.211459 5120 reconciler_common.go:299] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/bbe1e943-d345-4e78-a91c-de129e2b82ea-credential-keys\") on node \"crc\" DevicePath \"\"" Mar 16 17:40:16 crc kubenswrapper[5120]: I0316 17:40:16.211477 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/bbe1e943-d345-4e78-a91c-de129e2b82ea-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:40:16 crc kubenswrapper[5120]: I0316 17:40:16.211488 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bbe1e943-d345-4e78-a91c-de129e2b82ea-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:40:16 crc kubenswrapper[5120]: I0316 17:40:16.211497 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-klh5p\" (UniqueName: \"kubernetes.io/projected/bbe1e943-d345-4e78-a91c-de129e2b82ea-kube-api-access-klh5p\") on node \"crc\" DevicePath \"\"" Mar 16 17:40:16 crc kubenswrapper[5120]: I0316 17:40:16.263498 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/rabbitmq-server-0" Mar 16 17:40:16 crc kubenswrapper[5120]: I0316 17:40:16.313124 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/459c983d-9938-4660-a965-31585832f250-plugins-conf\") pod \"459c983d-9938-4660-a965-31585832f250\" (UID: \"459c983d-9938-4660-a965-31585832f250\") " Mar 16 17:40:16 crc kubenswrapper[5120]: I0316 17:40:16.313395 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p2smg\" (UniqueName: \"kubernetes.io/projected/459c983d-9938-4660-a965-31585832f250-kube-api-access-p2smg\") pod \"459c983d-9938-4660-a965-31585832f250\" (UID: \"459c983d-9938-4660-a965-31585832f250\") " Mar 16 17:40:16 crc kubenswrapper[5120]: I0316 17:40:16.313462 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/459c983d-9938-4660-a965-31585832f250-rabbitmq-plugins\") pod \"459c983d-9938-4660-a965-31585832f250\" (UID: \"459c983d-9938-4660-a965-31585832f250\") " Mar 16 17:40:16 crc kubenswrapper[5120]: I0316 17:40:16.313560 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/459c983d-9938-4660-a965-31585832f250-pod-info\") pod \"459c983d-9938-4660-a965-31585832f250\" (UID: \"459c983d-9938-4660-a965-31585832f250\") " Mar 16 17:40:16 crc kubenswrapper[5120]: I0316 17:40:16.313790 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/459c983d-9938-4660-a965-31585832f250-rabbitmq-confd\") pod \"459c983d-9938-4660-a965-31585832f250\" (UID: \"459c983d-9938-4660-a965-31585832f250\") " Mar 16 17:40:16 crc kubenswrapper[5120]: I0316 17:40:16.313829 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/459c983d-9938-4660-a965-31585832f250-erlang-cookie-secret\") pod \"459c983d-9938-4660-a965-31585832f250\" (UID: \"459c983d-9938-4660-a965-31585832f250\") " Mar 16 17:40:16 crc kubenswrapper[5120]: I0316 17:40:16.314002 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"persistence\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-add3ef42-eb87-4c34-8765-258ad4d436b4\") pod \"459c983d-9938-4660-a965-31585832f250\" (UID: \"459c983d-9938-4660-a965-31585832f250\") " Mar 16 17:40:16 crc kubenswrapper[5120]: I0316 17:40:16.314112 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/459c983d-9938-4660-a965-31585832f250-rabbitmq-erlang-cookie\") pod \"459c983d-9938-4660-a965-31585832f250\" (UID: \"459c983d-9938-4660-a965-31585832f250\") " Mar 16 17:40:16 crc kubenswrapper[5120]: I0316 17:40:16.314508 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/459c983d-9938-4660-a965-31585832f250-plugins-conf" (OuterVolumeSpecName: "plugins-conf") pod "459c983d-9938-4660-a965-31585832f250" (UID: "459c983d-9938-4660-a965-31585832f250"). InnerVolumeSpecName "plugins-conf". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:40:16 crc kubenswrapper[5120]: I0316 17:40:16.315085 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/459c983d-9938-4660-a965-31585832f250-rabbitmq-erlang-cookie" (OuterVolumeSpecName: "rabbitmq-erlang-cookie") pod "459c983d-9938-4660-a965-31585832f250" (UID: "459c983d-9938-4660-a965-31585832f250"). InnerVolumeSpecName "rabbitmq-erlang-cookie". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:40:16 crc kubenswrapper[5120]: I0316 17:40:16.315374 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/459c983d-9938-4660-a965-31585832f250-rabbitmq-erlang-cookie\") on node \"crc\" DevicePath \"\"" Mar 16 17:40:16 crc kubenswrapper[5120]: I0316 17:40:16.315705 5120 reconciler_common.go:299] "Volume detached for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/459c983d-9938-4660-a965-31585832f250-plugins-conf\") on node \"crc\" DevicePath \"\"" Mar 16 17:40:16 crc kubenswrapper[5120]: I0316 17:40:16.315602 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/459c983d-9938-4660-a965-31585832f250-rabbitmq-plugins" (OuterVolumeSpecName: "rabbitmq-plugins") pod "459c983d-9938-4660-a965-31585832f250" (UID: "459c983d-9938-4660-a965-31585832f250"). InnerVolumeSpecName "rabbitmq-plugins". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:40:16 crc kubenswrapper[5120]: I0316 17:40:16.329267 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/459c983d-9938-4660-a965-31585832f250-pod-info" (OuterVolumeSpecName: "pod-info") pod "459c983d-9938-4660-a965-31585832f250" (UID: "459c983d-9938-4660-a965-31585832f250"). InnerVolumeSpecName "pod-info". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Mar 16 17:40:16 crc kubenswrapper[5120]: I0316 17:40:16.329345 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/459c983d-9938-4660-a965-31585832f250-kube-api-access-p2smg" (OuterVolumeSpecName: "kube-api-access-p2smg") pod "459c983d-9938-4660-a965-31585832f250" (UID: "459c983d-9938-4660-a965-31585832f250"). InnerVolumeSpecName "kube-api-access-p2smg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:40:16 crc kubenswrapper[5120]: I0316 17:40:16.329479 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/459c983d-9938-4660-a965-31585832f250-erlang-cookie-secret" (OuterVolumeSpecName: "erlang-cookie-secret") pod "459c983d-9938-4660-a965-31585832f250" (UID: "459c983d-9938-4660-a965-31585832f250"). InnerVolumeSpecName "erlang-cookie-secret". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:40:16 crc kubenswrapper[5120]: I0316 17:40:16.356735 5120 kubelet_pods.go:1019] "Unable to retrieve pull secret, the image pull may not succeed." pod="barbican-kuttl-tests/keystonebc2c-account-delete-qrxr4" secret="" err="secret \"galera-openstack-dockercfg-fkfpr\" not found" Mar 16 17:40:16 crc kubenswrapper[5120]: I0316 17:40:16.356797 5120 scope.go:117] "RemoveContainer" containerID="66999a73b19486f492f66c0964804b03f94b2f0b7e7d29ea04e4af3ae8496d88" Mar 16 17:40:16 crc kubenswrapper[5120]: E0316 17:40:16.357179 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"mariadb-account-delete\" with CrashLoopBackOff: \"back-off 10s restarting failed container=mariadb-account-delete pod=keystonebc2c-account-delete-qrxr4_barbican-kuttl-tests(cb9e9af1-7275-4426-aa22-16b916aada88)\"" pod="barbican-kuttl-tests/keystonebc2c-account-delete-qrxr4" podUID="cb9e9af1-7275-4426-aa22-16b916aada88" Mar 16 17:40:16 crc kubenswrapper[5120]: I0316 17:40:16.358436 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-add3ef42-eb87-4c34-8765-258ad4d436b4" (OuterVolumeSpecName: "persistence") pod "459c983d-9938-4660-a965-31585832f250" (UID: "459c983d-9938-4660-a965-31585832f250"). InnerVolumeSpecName "pvc-add3ef42-eb87-4c34-8765-258ad4d436b4". PluginName "kubernetes.io/csi", VolumeGIDValue "" Mar 16 17:40:16 crc kubenswrapper[5120]: I0316 17:40:16.360861 5120 generic.go:358] "Generic (PLEG): container finished" podID="bbe1e943-d345-4e78-a91c-de129e2b82ea" containerID="7e17100ea78d21a7a68ede041a39fabe0906dba91e4e2ff5e7638615575510b9" exitCode=0 Mar 16 17:40:16 crc kubenswrapper[5120]: I0316 17:40:16.361014 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/keystone-667f6cf997-rrpr2" event={"ID":"bbe1e943-d345-4e78-a91c-de129e2b82ea","Type":"ContainerDied","Data":"7e17100ea78d21a7a68ede041a39fabe0906dba91e4e2ff5e7638615575510b9"} Mar 16 17:40:16 crc kubenswrapper[5120]: I0316 17:40:16.361048 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/keystone-667f6cf997-rrpr2" event={"ID":"bbe1e943-d345-4e78-a91c-de129e2b82ea","Type":"ContainerDied","Data":"b7bbc246ad24573dd340fd92a8b99bc9649b6f51a012890141b2cb311e9770d1"} Mar 16 17:40:16 crc kubenswrapper[5120]: I0316 17:40:16.361067 5120 scope.go:117] "RemoveContainer" containerID="7e17100ea78d21a7a68ede041a39fabe0906dba91e4e2ff5e7638615575510b9" Mar 16 17:40:16 crc kubenswrapper[5120]: I0316 17:40:16.361250 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/keystone-667f6cf997-rrpr2" Mar 16 17:40:16 crc kubenswrapper[5120]: I0316 17:40:16.367303 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/memcached-0" event={"ID":"9b2e5d7a-5b39-424d-9eaa-dcace83ebf72","Type":"ContainerDied","Data":"46fa5c7731dfe25a5ce88a914e54c1fcebe3d46bfb5a6e3e8e0429e9097b9d17"} Mar 16 17:40:16 crc kubenswrapper[5120]: I0316 17:40:16.367385 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/memcached-0" Mar 16 17:40:16 crc kubenswrapper[5120]: I0316 17:40:16.390632 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/barbican-operator-controller-manager-58bf5697d6-vhnpj" event={"ID":"5068ab90-b1e6-427e-9a8b-e77bbc0ffe1f","Type":"ContainerDied","Data":"1dd63000f7d785931afd44d56cbcb6ef1b3e5af0955dab838a7b093a9897bb51"} Mar 16 17:40:16 crc kubenswrapper[5120]: I0316 17:40:16.390734 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/barbican-operator-controller-manager-58bf5697d6-vhnpj" Mar 16 17:40:16 crc kubenswrapper[5120]: I0316 17:40:16.399743 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/barbican-operator-index-ck2pw" Mar 16 17:40:16 crc kubenswrapper[5120]: I0316 17:40:16.401608 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/barbican-operator-index-ck2pw" event={"ID":"a5ccdf19-64ed-4e83-b87f-d8623f7cd27e","Type":"ContainerDied","Data":"e0fe1aa6466cde958217aa29f887444fb8d39994ce4b547480c498a593b4043f"} Mar 16 17:40:16 crc kubenswrapper[5120]: I0316 17:40:16.411371 5120 generic.go:358] "Generic (PLEG): container finished" podID="ecba5863-ab91-4517-bc9b-553b7900ffc2" containerID="ac8af4331affd0aaf54eea45b82781a8a53a6a8ec4c5e22e608f6a0bcf6230c7" exitCode=0 Mar 16 17:40:16 crc kubenswrapper[5120]: I0316 17:40:16.411469 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/keystone-operator-controller-manager-64d54cb9b4-dksf5" event={"ID":"ecba5863-ab91-4517-bc9b-553b7900ffc2","Type":"ContainerDied","Data":"ac8af4331affd0aaf54eea45b82781a8a53a6a8ec4c5e22e608f6a0bcf6230c7"} Mar 16 17:40:16 crc kubenswrapper[5120]: I0316 17:40:16.418255 5120 reconciler_common.go:299] "Volume detached for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/459c983d-9938-4660-a965-31585832f250-erlang-cookie-secret\") on node \"crc\" DevicePath \"\"" Mar 16 17:40:16 crc kubenswrapper[5120]: I0316 17:40:16.418309 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"pvc-add3ef42-eb87-4c34-8765-258ad4d436b4\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-add3ef42-eb87-4c34-8765-258ad4d436b4\") on node \"crc\" " Mar 16 17:40:16 crc kubenswrapper[5120]: I0316 17:40:16.418324 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p2smg\" (UniqueName: \"kubernetes.io/projected/459c983d-9938-4660-a965-31585832f250-kube-api-access-p2smg\") on node \"crc\" DevicePath \"\"" Mar 16 17:40:16 crc kubenswrapper[5120]: I0316 17:40:16.418335 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/459c983d-9938-4660-a965-31585832f250-rabbitmq-plugins\") on node \"crc\" DevicePath \"\"" Mar 16 17:40:16 crc kubenswrapper[5120]: I0316 17:40:16.418345 5120 reconciler_common.go:299] "Volume detached for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/459c983d-9938-4660-a965-31585832f250-pod-info\") on node \"crc\" DevicePath \"\"" Mar 16 17:40:16 crc kubenswrapper[5120]: I0316 17:40:16.434718 5120 generic.go:358] "Generic (PLEG): container finished" podID="459c983d-9938-4660-a965-31585832f250" containerID="1b67907377eee71752ebe9934ed076a8ff8f72f6f441c792b8fe77eb0b9cccaa" exitCode=0 Mar 16 17:40:16 crc kubenswrapper[5120]: I0316 17:40:16.434816 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/rabbitmq-server-0" event={"ID":"459c983d-9938-4660-a965-31585832f250","Type":"ContainerDied","Data":"1b67907377eee71752ebe9934ed076a8ff8f72f6f441c792b8fe77eb0b9cccaa"} Mar 16 17:40:16 crc kubenswrapper[5120]: I0316 17:40:16.434843 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/rabbitmq-server-0" event={"ID":"459c983d-9938-4660-a965-31585832f250","Type":"ContainerDied","Data":"a351f0e22947cacead58e5f23181e10bb36ef00a7fe6bfa00afab1f91b623e5d"} Mar 16 17:40:16 crc kubenswrapper[5120]: I0316 17:40:16.435057 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/rabbitmq-server-0" Mar 16 17:40:16 crc kubenswrapper[5120]: I0316 17:40:16.446362 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/keystone-operator-index-f85dc"] Mar 16 17:40:16 crc kubenswrapper[5120]: I0316 17:40:16.446574 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-operators/keystone-operator-index-f85dc" podUID="017f781f-d93d-4b6b-9d7e-966c513348bc" containerName="registry-server" containerID="cri-o://8c9697eb83443bf35e9cf1f3170a19f53200a8665f727c4c1c8af15c8db02cfe" gracePeriod=30 Mar 16 17:40:16 crc kubenswrapper[5120]: I0316 17:40:16.447322 5120 scope.go:117] "RemoveContainer" containerID="7e17100ea78d21a7a68ede041a39fabe0906dba91e4e2ff5e7638615575510b9" Mar 16 17:40:16 crc kubenswrapper[5120]: E0316 17:40:16.452812 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e17100ea78d21a7a68ede041a39fabe0906dba91e4e2ff5e7638615575510b9\": container with ID starting with 7e17100ea78d21a7a68ede041a39fabe0906dba91e4e2ff5e7638615575510b9 not found: ID does not exist" containerID="7e17100ea78d21a7a68ede041a39fabe0906dba91e4e2ff5e7638615575510b9" Mar 16 17:40:16 crc kubenswrapper[5120]: I0316 17:40:16.453291 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e17100ea78d21a7a68ede041a39fabe0906dba91e4e2ff5e7638615575510b9"} err="failed to get container status \"7e17100ea78d21a7a68ede041a39fabe0906dba91e4e2ff5e7638615575510b9\": rpc error: code = NotFound desc = could not find container \"7e17100ea78d21a7a68ede041a39fabe0906dba91e4e2ff5e7638615575510b9\": container with ID starting with 7e17100ea78d21a7a68ede041a39fabe0906dba91e4e2ff5e7638615575510b9 not found: ID does not exist" Mar 16 17:40:16 crc kubenswrapper[5120]: I0316 17:40:16.453310 5120 scope.go:117] "RemoveContainer" containerID="fe506b38b0a486a1a40d17b9ef257ac599887749a33908cd6653bd7e99071613" Mar 16 17:40:16 crc kubenswrapper[5120]: I0316 17:40:16.470799 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/057d2ef2813dbca67df99f545f5daea57175a3b6e27320c69396d55997vx8x6"] Mar 16 17:40:16 crc kubenswrapper[5120]: I0316 17:40:16.491937 5120 csi_attacher.go:567] kubernetes.io/csi: attacher.UnmountDevice STAGE_UNSTAGE_VOLUME capability not set. Skipping UnmountDevice... Mar 16 17:40:16 crc kubenswrapper[5120]: I0316 17:40:16.492084 5120 operation_generator.go:895] UnmountDevice succeeded for volume "pvc-add3ef42-eb87-4c34-8765-258ad4d436b4" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-add3ef42-eb87-4c34-8765-258ad4d436b4") on node "crc" Mar 16 17:40:16 crc kubenswrapper[5120]: I0316 17:40:16.496303 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-operators/057d2ef2813dbca67df99f545f5daea57175a3b6e27320c69396d55997vx8x6"] Mar 16 17:40:16 crc kubenswrapper[5120]: I0316 17:40:16.512154 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["barbican-kuttl-tests/memcached-0"] Mar 16 17:40:16 crc kubenswrapper[5120]: I0316 17:40:16.522606 5120 reconciler_common.go:299] "Volume detached for volume \"pvc-add3ef42-eb87-4c34-8765-258ad4d436b4\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-add3ef42-eb87-4c34-8765-258ad4d436b4\") on node \"crc\" DevicePath \"\"" Mar 16 17:40:16 crc kubenswrapper[5120]: I0316 17:40:16.523633 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["barbican-kuttl-tests/memcached-0"] Mar 16 17:40:16 crc kubenswrapper[5120]: I0316 17:40:16.530725 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/barbican-operator-index-ck2pw"] Mar 16 17:40:16 crc kubenswrapper[5120]: E0316 17:40:16.533181 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a479804a3d0df2071c52b491d2c146037b2340dde34949b3e23c461b0785e14e" cmd=["/bin/bash","/var/lib/operator-scripts/mysql_probe.sh","readiness"] Mar 16 17:40:16 crc kubenswrapper[5120]: I0316 17:40:16.536770 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-operators/barbican-operator-index-ck2pw"] Mar 16 17:40:16 crc kubenswrapper[5120]: E0316 17:40:16.543504 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a479804a3d0df2071c52b491d2c146037b2340dde34949b3e23c461b0785e14e" cmd=["/bin/bash","/var/lib/operator-scripts/mysql_probe.sh","readiness"] Mar 16 17:40:16 crc kubenswrapper[5120]: I0316 17:40:16.543716 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/barbican-operator-controller-manager-58bf5697d6-vhnpj"] Mar 16 17:40:16 crc kubenswrapper[5120]: I0316 17:40:16.547365 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-operators/barbican-operator-controller-manager-58bf5697d6-vhnpj"] Mar 16 17:40:16 crc kubenswrapper[5120]: E0316 17:40:16.551005 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a479804a3d0df2071c52b491d2c146037b2340dde34949b3e23c461b0785e14e" cmd=["/bin/bash","/var/lib/operator-scripts/mysql_probe.sh","readiness"] Mar 16 17:40:16 crc kubenswrapper[5120]: E0316 17:40:16.551064 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="barbican-kuttl-tests/openstack-galera-1" podUID="05269e3d-2dcd-4828-8142-7399752715b3" containerName="galera" probeResult="unknown" Mar 16 17:40:16 crc kubenswrapper[5120]: I0316 17:40:16.591020 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/459c983d-9938-4660-a965-31585832f250-rabbitmq-confd" (OuterVolumeSpecName: "rabbitmq-confd") pod "459c983d-9938-4660-a965-31585832f250" (UID: "459c983d-9938-4660-a965-31585832f250"). InnerVolumeSpecName "rabbitmq-confd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:40:16 crc kubenswrapper[5120]: I0316 17:40:16.625946 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/459c983d-9938-4660-a965-31585832f250-rabbitmq-confd\") on node \"crc\" DevicePath \"\"" Mar 16 17:40:16 crc kubenswrapper[5120]: I0316 17:40:16.629087 5120 scope.go:117] "RemoveContainer" containerID="933d0eab8fda7bf80fa1bb171e7d2aed8c7939ac0f47a72f7df801eb4b529108" Mar 16 17:40:16 crc kubenswrapper[5120]: I0316 17:40:16.630864 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["barbican-kuttl-tests/keystone-667f6cf997-rrpr2"] Mar 16 17:40:16 crc kubenswrapper[5120]: I0316 17:40:16.637657 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["barbican-kuttl-tests/keystone-667f6cf997-rrpr2"] Mar 16 17:40:16 crc kubenswrapper[5120]: I0316 17:40:16.671004 5120 scope.go:117] "RemoveContainer" containerID="245a20fdc8132bd71d3234132847da0827395481054b4a9791fbb7ea50baf3f6" Mar 16 17:40:16 crc kubenswrapper[5120]: I0316 17:40:16.677635 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5068ab90-b1e6-427e-9a8b-e77bbc0ffe1f" path="/var/lib/kubelet/pods/5068ab90-b1e6-427e-9a8b-e77bbc0ffe1f/volumes" Mar 16 17:40:16 crc kubenswrapper[5120]: I0316 17:40:16.678319 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="58e44673-0526-46cc-b8c8-aab0861572ed" path="/var/lib/kubelet/pods/58e44673-0526-46cc-b8c8-aab0861572ed/volumes" Mar 16 17:40:16 crc kubenswrapper[5120]: I0316 17:40:16.689305 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b2e5d7a-5b39-424d-9eaa-dcace83ebf72" path="/var/lib/kubelet/pods/9b2e5d7a-5b39-424d-9eaa-dcace83ebf72/volumes" Mar 16 17:40:16 crc kubenswrapper[5120]: I0316 17:40:16.703507 5120 scope.go:117] "RemoveContainer" containerID="1b67907377eee71752ebe9934ed076a8ff8f72f6f441c792b8fe77eb0b9cccaa" Mar 16 17:40:16 crc kubenswrapper[5120]: I0316 17:40:16.706041 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a5ccdf19-64ed-4e83-b87f-d8623f7cd27e" path="/var/lib/kubelet/pods/a5ccdf19-64ed-4e83-b87f-d8623f7cd27e/volumes" Mar 16 17:40:16 crc kubenswrapper[5120]: I0316 17:40:16.706932 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bbe1e943-d345-4e78-a91c-de129e2b82ea" path="/var/lib/kubelet/pods/bbe1e943-d345-4e78-a91c-de129e2b82ea/volumes" Mar 16 17:40:16 crc kubenswrapper[5120]: I0316 17:40:16.707416 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c5662d29-b9ae-46f4-8a19-f0ce811d9661" path="/var/lib/kubelet/pods/c5662d29-b9ae-46f4-8a19-f0ce811d9661/volumes" Mar 16 17:40:16 crc kubenswrapper[5120]: I0316 17:40:16.720695 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/keystone-operator-controller-manager-64d54cb9b4-dksf5" Mar 16 17:40:16 crc kubenswrapper[5120]: I0316 17:40:16.741636 5120 scope.go:117] "RemoveContainer" containerID="8d64debaf4240a984c03535b7a49bb9866a5602d38dee2af65ebdaa1e93e5bfe" Mar 16 17:40:16 crc kubenswrapper[5120]: I0316 17:40:16.767111 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["barbican-kuttl-tests/rabbitmq-server-0"] Mar 16 17:40:16 crc kubenswrapper[5120]: I0316 17:40:16.779861 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["barbican-kuttl-tests/rabbitmq-server-0"] Mar 16 17:40:16 crc kubenswrapper[5120]: I0316 17:40:16.788581 5120 scope.go:117] "RemoveContainer" containerID="1b67907377eee71752ebe9934ed076a8ff8f72f6f441c792b8fe77eb0b9cccaa" Mar 16 17:40:16 crc kubenswrapper[5120]: E0316 17:40:16.803953 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1b67907377eee71752ebe9934ed076a8ff8f72f6f441c792b8fe77eb0b9cccaa\": container with ID starting with 1b67907377eee71752ebe9934ed076a8ff8f72f6f441c792b8fe77eb0b9cccaa not found: ID does not exist" containerID="1b67907377eee71752ebe9934ed076a8ff8f72f6f441c792b8fe77eb0b9cccaa" Mar 16 17:40:16 crc kubenswrapper[5120]: I0316 17:40:16.804019 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b67907377eee71752ebe9934ed076a8ff8f72f6f441c792b8fe77eb0b9cccaa"} err="failed to get container status \"1b67907377eee71752ebe9934ed076a8ff8f72f6f441c792b8fe77eb0b9cccaa\": rpc error: code = NotFound desc = could not find container \"1b67907377eee71752ebe9934ed076a8ff8f72f6f441c792b8fe77eb0b9cccaa\": container with ID starting with 1b67907377eee71752ebe9934ed076a8ff8f72f6f441c792b8fe77eb0b9cccaa not found: ID does not exist" Mar 16 17:40:16 crc kubenswrapper[5120]: I0316 17:40:16.804051 5120 scope.go:117] "RemoveContainer" containerID="8d64debaf4240a984c03535b7a49bb9866a5602d38dee2af65ebdaa1e93e5bfe" Mar 16 17:40:16 crc kubenswrapper[5120]: E0316 17:40:16.810837 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d64debaf4240a984c03535b7a49bb9866a5602d38dee2af65ebdaa1e93e5bfe\": container with ID starting with 8d64debaf4240a984c03535b7a49bb9866a5602d38dee2af65ebdaa1e93e5bfe not found: ID does not exist" containerID="8d64debaf4240a984c03535b7a49bb9866a5602d38dee2af65ebdaa1e93e5bfe" Mar 16 17:40:16 crc kubenswrapper[5120]: I0316 17:40:16.810898 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d64debaf4240a984c03535b7a49bb9866a5602d38dee2af65ebdaa1e93e5bfe"} err="failed to get container status \"8d64debaf4240a984c03535b7a49bb9866a5602d38dee2af65ebdaa1e93e5bfe\": rpc error: code = NotFound desc = could not find container \"8d64debaf4240a984c03535b7a49bb9866a5602d38dee2af65ebdaa1e93e5bfe\": container with ID starting with 8d64debaf4240a984c03535b7a49bb9866a5602d38dee2af65ebdaa1e93e5bfe not found: ID does not exist" Mar 16 17:40:16 crc kubenswrapper[5120]: I0316 17:40:16.834971 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8fmtj\" (UniqueName: \"kubernetes.io/projected/ecba5863-ab91-4517-bc9b-553b7900ffc2-kube-api-access-8fmtj\") pod \"ecba5863-ab91-4517-bc9b-553b7900ffc2\" (UID: \"ecba5863-ab91-4517-bc9b-553b7900ffc2\") " Mar 16 17:40:16 crc kubenswrapper[5120]: I0316 17:40:16.835515 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ecba5863-ab91-4517-bc9b-553b7900ffc2-webhook-cert\") pod \"ecba5863-ab91-4517-bc9b-553b7900ffc2\" (UID: \"ecba5863-ab91-4517-bc9b-553b7900ffc2\") " Mar 16 17:40:16 crc kubenswrapper[5120]: I0316 17:40:16.835561 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ecba5863-ab91-4517-bc9b-553b7900ffc2-apiservice-cert\") pod \"ecba5863-ab91-4517-bc9b-553b7900ffc2\" (UID: \"ecba5863-ab91-4517-bc9b-553b7900ffc2\") " Mar 16 17:40:16 crc kubenswrapper[5120]: I0316 17:40:16.860997 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ecba5863-ab91-4517-bc9b-553b7900ffc2-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "ecba5863-ab91-4517-bc9b-553b7900ffc2" (UID: "ecba5863-ab91-4517-bc9b-553b7900ffc2"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:40:16 crc kubenswrapper[5120]: I0316 17:40:16.861116 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ecba5863-ab91-4517-bc9b-553b7900ffc2-apiservice-cert" (OuterVolumeSpecName: "apiservice-cert") pod "ecba5863-ab91-4517-bc9b-553b7900ffc2" (UID: "ecba5863-ab91-4517-bc9b-553b7900ffc2"). InnerVolumeSpecName "apiservice-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:40:16 crc kubenswrapper[5120]: I0316 17:40:16.861133 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ecba5863-ab91-4517-bc9b-553b7900ffc2-kube-api-access-8fmtj" (OuterVolumeSpecName: "kube-api-access-8fmtj") pod "ecba5863-ab91-4517-bc9b-553b7900ffc2" (UID: "ecba5863-ab91-4517-bc9b-553b7900ffc2"). InnerVolumeSpecName "kube-api-access-8fmtj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:40:16 crc kubenswrapper[5120]: I0316 17:40:16.938790 5120 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ecba5863-ab91-4517-bc9b-553b7900ffc2-webhook-cert\") on node \"crc\" DevicePath \"\"" Mar 16 17:40:16 crc kubenswrapper[5120]: I0316 17:40:16.938836 5120 reconciler_common.go:299] "Volume detached for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ecba5863-ab91-4517-bc9b-553b7900ffc2-apiservice-cert\") on node \"crc\" DevicePath \"\"" Mar 16 17:40:16 crc kubenswrapper[5120]: I0316 17:40:16.938850 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8fmtj\" (UniqueName: \"kubernetes.io/projected/ecba5863-ab91-4517-bc9b-553b7900ffc2-kube-api-access-8fmtj\") on node \"crc\" DevicePath \"\"" Mar 16 17:40:16 crc kubenswrapper[5120]: E0316 17:40:16.938927 5120 configmap.go:193] Couldn't get configMap barbican-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Mar 16 17:40:16 crc kubenswrapper[5120]: E0316 17:40:16.939001 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cb9e9af1-7275-4426-aa22-16b916aada88-operator-scripts podName:cb9e9af1-7275-4426-aa22-16b916aada88 nodeName:}" failed. No retries permitted until 2026-03-16 17:40:20.938979537 +0000 UTC m=+7723.092911194 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/cb9e9af1-7275-4426-aa22-16b916aada88-operator-scripts") pod "keystonebc2c-account-delete-qrxr4" (UID: "cb9e9af1-7275-4426-aa22-16b916aada88") : configmap "openstack-scripts" not found Mar 16 17:40:16 crc kubenswrapper[5120]: I0316 17:40:16.940790 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/rabbitmq-cluster-operator-6bc46f9cd-wtpcn"] Mar 16 17:40:16 crc kubenswrapper[5120]: I0316 17:40:16.941035 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-operators/rabbitmq-cluster-operator-6bc46f9cd-wtpcn" podUID="4a70a89a-dbe2-4a18-9c72-10a183001eb4" containerName="operator" containerID="cri-o://b036b1fecf6fb17a767a090dd0f159bb51fa3960bcb0db24a9e6cd31b0cb2c04" gracePeriod=10 Mar 16 17:40:16 crc kubenswrapper[5120]: I0316 17:40:16.972456 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="barbican-kuttl-tests/openstack-galera-0" podUID="2dfcb27a-8b24-493a-b27f-74436a9105e0" containerName="galera" containerID="cri-o://bd886c662bfb32fade18831a0234c64c44dffce578f9763a885f87560d3a39d3" gracePeriod=26 Mar 16 17:40:17 crc kubenswrapper[5120]: I0316 17:40:17.011208 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/keystone-operator-index-f85dc" Mar 16 17:40:17 crc kubenswrapper[5120]: I0316 17:40:17.108655 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["barbican-kuttl-tests/keystone-db-create-q7sqs"] Mar 16 17:40:17 crc kubenswrapper[5120]: I0316 17:40:17.115955 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["barbican-kuttl-tests/keystone-db-create-q7sqs"] Mar 16 17:40:17 crc kubenswrapper[5120]: I0316 17:40:17.153357 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-49tww\" (UniqueName: \"kubernetes.io/projected/017f781f-d93d-4b6b-9d7e-966c513348bc-kube-api-access-49tww\") pod \"017f781f-d93d-4b6b-9d7e-966c513348bc\" (UID: \"017f781f-d93d-4b6b-9d7e-966c513348bc\") " Mar 16 17:40:17 crc kubenswrapper[5120]: I0316 17:40:17.171795 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/017f781f-d93d-4b6b-9d7e-966c513348bc-kube-api-access-49tww" (OuterVolumeSpecName: "kube-api-access-49tww") pod "017f781f-d93d-4b6b-9d7e-966c513348bc" (UID: "017f781f-d93d-4b6b-9d7e-966c513348bc"). InnerVolumeSpecName "kube-api-access-49tww". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:40:17 crc kubenswrapper[5120]: I0316 17:40:17.184672 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["barbican-kuttl-tests/keystone-bc2c-account-create-update-z77gc"] Mar 16 17:40:17 crc kubenswrapper[5120]: I0316 17:40:17.213021 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["barbican-kuttl-tests/keystonebc2c-account-delete-qrxr4"] Mar 16 17:40:17 crc kubenswrapper[5120]: I0316 17:40:17.225893 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["barbican-kuttl-tests/keystone-bc2c-account-create-update-z77gc"] Mar 16 17:40:17 crc kubenswrapper[5120]: I0316 17:40:17.245150 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/rabbitmq-cluster-operator-index-7c6bb"] Mar 16 17:40:17 crc kubenswrapper[5120]: I0316 17:40:17.245570 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-operators/rabbitmq-cluster-operator-index-7c6bb" podUID="28162b7c-56dd-481a-a0f8-dd4068ec5a59" containerName="registry-server" containerID="cri-o://e81da091a65c4035c53e284e50a1b5614f6138e186cfc49ed156bca3299242da" gracePeriod=30 Mar 16 17:40:17 crc kubenswrapper[5120]: I0316 17:40:17.259222 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-49tww\" (UniqueName: \"kubernetes.io/projected/017f781f-d93d-4b6b-9d7e-966c513348bc-kube-api-access-49tww\") on node \"crc\" DevicePath \"\"" Mar 16 17:40:17 crc kubenswrapper[5120]: I0316 17:40:17.284301 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590msptg"] Mar 16 17:40:17 crc kubenswrapper[5120]: I0316 17:40:17.298210 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590msptg"] Mar 16 17:40:17 crc kubenswrapper[5120]: I0316 17:40:17.336906 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/openstack-galera-1" Mar 16 17:40:17 crc kubenswrapper[5120]: I0316 17:40:17.421354 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/rabbitmq-cluster-operator-6bc46f9cd-wtpcn" Mar 16 17:40:17 crc kubenswrapper[5120]: I0316 17:40:17.452508 5120 generic.go:358] "Generic (PLEG): container finished" podID="05269e3d-2dcd-4828-8142-7399752715b3" containerID="a479804a3d0df2071c52b491d2c146037b2340dde34949b3e23c461b0785e14e" exitCode=0 Mar 16 17:40:17 crc kubenswrapper[5120]: I0316 17:40:17.452592 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/openstack-galera-1" event={"ID":"05269e3d-2dcd-4828-8142-7399752715b3","Type":"ContainerDied","Data":"a479804a3d0df2071c52b491d2c146037b2340dde34949b3e23c461b0785e14e"} Mar 16 17:40:17 crc kubenswrapper[5120]: I0316 17:40:17.452616 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/openstack-galera-1" event={"ID":"05269e3d-2dcd-4828-8142-7399752715b3","Type":"ContainerDied","Data":"95fdb8c3d67e4f45182aa398eb0780e1b7736fce487e28e324cd64cacc729312"} Mar 16 17:40:17 crc kubenswrapper[5120]: I0316 17:40:17.452633 5120 scope.go:117] "RemoveContainer" containerID="a479804a3d0df2071c52b491d2c146037b2340dde34949b3e23c461b0785e14e" Mar 16 17:40:17 crc kubenswrapper[5120]: I0316 17:40:17.452801 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/openstack-galera-1" Mar 16 17:40:17 crc kubenswrapper[5120]: I0316 17:40:17.460963 5120 generic.go:358] "Generic (PLEG): container finished" podID="017f781f-d93d-4b6b-9d7e-966c513348bc" containerID="8c9697eb83443bf35e9cf1f3170a19f53200a8665f727c4c1c8af15c8db02cfe" exitCode=0 Mar 16 17:40:17 crc kubenswrapper[5120]: I0316 17:40:17.461056 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/keystone-operator-index-f85dc" event={"ID":"017f781f-d93d-4b6b-9d7e-966c513348bc","Type":"ContainerDied","Data":"8c9697eb83443bf35e9cf1f3170a19f53200a8665f727c4c1c8af15c8db02cfe"} Mar 16 17:40:17 crc kubenswrapper[5120]: I0316 17:40:17.461079 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/keystone-operator-index-f85dc" event={"ID":"017f781f-d93d-4b6b-9d7e-966c513348bc","Type":"ContainerDied","Data":"e768f011b0ca64b2b088c6a9a6f17ea059d8e644667650aa2c051472eb3f7fb2"} Mar 16 17:40:17 crc kubenswrapper[5120]: I0316 17:40:17.461170 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/keystone-operator-index-f85dc" Mar 16 17:40:17 crc kubenswrapper[5120]: I0316 17:40:17.467699 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wjbzf\" (UniqueName: \"kubernetes.io/projected/05269e3d-2dcd-4828-8142-7399752715b3-kube-api-access-wjbzf\") pod \"05269e3d-2dcd-4828-8142-7399752715b3\" (UID: \"05269e3d-2dcd-4828-8142-7399752715b3\") " Mar 16 17:40:17 crc kubenswrapper[5120]: I0316 17:40:17.467847 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"mysql-db\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"05269e3d-2dcd-4828-8142-7399752715b3\" (UID: \"05269e3d-2dcd-4828-8142-7399752715b3\") " Mar 16 17:40:17 crc kubenswrapper[5120]: I0316 17:40:17.468144 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/05269e3d-2dcd-4828-8142-7399752715b3-config-data-generated\") pod \"05269e3d-2dcd-4828-8142-7399752715b3\" (UID: \"05269e3d-2dcd-4828-8142-7399752715b3\") " Mar 16 17:40:17 crc kubenswrapper[5120]: I0316 17:40:17.468219 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/05269e3d-2dcd-4828-8142-7399752715b3-operator-scripts\") pod \"05269e3d-2dcd-4828-8142-7399752715b3\" (UID: \"05269e3d-2dcd-4828-8142-7399752715b3\") " Mar 16 17:40:17 crc kubenswrapper[5120]: I0316 17:40:17.468240 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/05269e3d-2dcd-4828-8142-7399752715b3-kolla-config\") pod \"05269e3d-2dcd-4828-8142-7399752715b3\" (UID: \"05269e3d-2dcd-4828-8142-7399752715b3\") " Mar 16 17:40:17 crc kubenswrapper[5120]: I0316 17:40:17.468343 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/05269e3d-2dcd-4828-8142-7399752715b3-config-data-default\") pod \"05269e3d-2dcd-4828-8142-7399752715b3\" (UID: \"05269e3d-2dcd-4828-8142-7399752715b3\") " Mar 16 17:40:17 crc kubenswrapper[5120]: I0316 17:40:17.469116 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05269e3d-2dcd-4828-8142-7399752715b3-config-data-generated" (OuterVolumeSpecName: "config-data-generated") pod "05269e3d-2dcd-4828-8142-7399752715b3" (UID: "05269e3d-2dcd-4828-8142-7399752715b3"). InnerVolumeSpecName "config-data-generated". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:40:17 crc kubenswrapper[5120]: I0316 17:40:17.469186 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/05269e3d-2dcd-4828-8142-7399752715b3-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "05269e3d-2dcd-4828-8142-7399752715b3" (UID: "05269e3d-2dcd-4828-8142-7399752715b3"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:40:17 crc kubenswrapper[5120]: I0316 17:40:17.469554 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/05269e3d-2dcd-4828-8142-7399752715b3-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "05269e3d-2dcd-4828-8142-7399752715b3" (UID: "05269e3d-2dcd-4828-8142-7399752715b3"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:40:17 crc kubenswrapper[5120]: I0316 17:40:17.471095 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/05269e3d-2dcd-4828-8142-7399752715b3-config-data-default" (OuterVolumeSpecName: "config-data-default") pod "05269e3d-2dcd-4828-8142-7399752715b3" (UID: "05269e3d-2dcd-4828-8142-7399752715b3"). InnerVolumeSpecName "config-data-default". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:40:17 crc kubenswrapper[5120]: I0316 17:40:17.474045 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05269e3d-2dcd-4828-8142-7399752715b3-kube-api-access-wjbzf" (OuterVolumeSpecName: "kube-api-access-wjbzf") pod "05269e3d-2dcd-4828-8142-7399752715b3" (UID: "05269e3d-2dcd-4828-8142-7399752715b3"). InnerVolumeSpecName "kube-api-access-wjbzf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:40:17 crc kubenswrapper[5120]: I0316 17:40:17.478382 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/keystone-operator-controller-manager-64d54cb9b4-dksf5" event={"ID":"ecba5863-ab91-4517-bc9b-553b7900ffc2","Type":"ContainerDied","Data":"f4938567b35e715f88f519314c2827367462c1b647fc3a1c581d98d77707ef62"} Mar 16 17:40:17 crc kubenswrapper[5120]: I0316 17:40:17.478685 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/keystone-operator-controller-manager-64d54cb9b4-dksf5" Mar 16 17:40:17 crc kubenswrapper[5120]: I0316 17:40:17.481118 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage01-crc" (OuterVolumeSpecName: "mysql-db") pod "05269e3d-2dcd-4828-8142-7399752715b3" (UID: "05269e3d-2dcd-4828-8142-7399752715b3"). InnerVolumeSpecName "local-storage01-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 17:40:17 crc kubenswrapper[5120]: I0316 17:40:17.490835 5120 generic.go:358] "Generic (PLEG): container finished" podID="4a70a89a-dbe2-4a18-9c72-10a183001eb4" containerID="b036b1fecf6fb17a767a090dd0f159bb51fa3960bcb0db24a9e6cd31b0cb2c04" exitCode=0 Mar 16 17:40:17 crc kubenswrapper[5120]: I0316 17:40:17.490925 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/rabbitmq-cluster-operator-6bc46f9cd-wtpcn" event={"ID":"4a70a89a-dbe2-4a18-9c72-10a183001eb4","Type":"ContainerDied","Data":"b036b1fecf6fb17a767a090dd0f159bb51fa3960bcb0db24a9e6cd31b0cb2c04"} Mar 16 17:40:17 crc kubenswrapper[5120]: I0316 17:40:17.490948 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/rabbitmq-cluster-operator-6bc46f9cd-wtpcn" event={"ID":"4a70a89a-dbe2-4a18-9c72-10a183001eb4","Type":"ContainerDied","Data":"6409f751afe9dce41bd9de9f0a65484138d7be6fcc3628e1a7604a1e69dda639"} Mar 16 17:40:17 crc kubenswrapper[5120]: I0316 17:40:17.490953 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/rabbitmq-cluster-operator-6bc46f9cd-wtpcn" Mar 16 17:40:17 crc kubenswrapper[5120]: I0316 17:40:17.494622 5120 generic.go:358] "Generic (PLEG): container finished" podID="28162b7c-56dd-481a-a0f8-dd4068ec5a59" containerID="e81da091a65c4035c53e284e50a1b5614f6138e186cfc49ed156bca3299242da" exitCode=0 Mar 16 17:40:17 crc kubenswrapper[5120]: I0316 17:40:17.494693 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/rabbitmq-cluster-operator-index-7c6bb" event={"ID":"28162b7c-56dd-481a-a0f8-dd4068ec5a59","Type":"ContainerDied","Data":"e81da091a65c4035c53e284e50a1b5614f6138e186cfc49ed156bca3299242da"} Mar 16 17:40:17 crc kubenswrapper[5120]: I0316 17:40:17.570453 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5nv6w\" (UniqueName: \"kubernetes.io/projected/4a70a89a-dbe2-4a18-9c72-10a183001eb4-kube-api-access-5nv6w\") pod \"4a70a89a-dbe2-4a18-9c72-10a183001eb4\" (UID: \"4a70a89a-dbe2-4a18-9c72-10a183001eb4\") " Mar 16 17:40:17 crc kubenswrapper[5120]: I0316 17:40:17.573932 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") on node \"crc\" " Mar 16 17:40:17 crc kubenswrapper[5120]: I0316 17:40:17.573962 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/05269e3d-2dcd-4828-8142-7399752715b3-config-data-generated\") on node \"crc\" DevicePath \"\"" Mar 16 17:40:17 crc kubenswrapper[5120]: I0316 17:40:17.573975 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/05269e3d-2dcd-4828-8142-7399752715b3-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:40:17 crc kubenswrapper[5120]: I0316 17:40:17.573984 5120 reconciler_common.go:299] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/05269e3d-2dcd-4828-8142-7399752715b3-kolla-config\") on node \"crc\" DevicePath \"\"" Mar 16 17:40:17 crc kubenswrapper[5120]: I0316 17:40:17.573991 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/05269e3d-2dcd-4828-8142-7399752715b3-config-data-default\") on node \"crc\" DevicePath \"\"" Mar 16 17:40:17 crc kubenswrapper[5120]: I0316 17:40:17.574000 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wjbzf\" (UniqueName: \"kubernetes.io/projected/05269e3d-2dcd-4828-8142-7399752715b3-kube-api-access-wjbzf\") on node \"crc\" DevicePath \"\"" Mar 16 17:40:17 crc kubenswrapper[5120]: I0316 17:40:17.585654 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a70a89a-dbe2-4a18-9c72-10a183001eb4-kube-api-access-5nv6w" (OuterVolumeSpecName: "kube-api-access-5nv6w") pod "4a70a89a-dbe2-4a18-9c72-10a183001eb4" (UID: "4a70a89a-dbe2-4a18-9c72-10a183001eb4"). InnerVolumeSpecName "kube-api-access-5nv6w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:40:17 crc kubenswrapper[5120]: I0316 17:40:17.587486 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage01-crc" (UniqueName: "kubernetes.io/local-volume/local-storage01-crc") on node "crc" Mar 16 17:40:17 crc kubenswrapper[5120]: I0316 17:40:17.647402 5120 scope.go:117] "RemoveContainer" containerID="538ce3c4956105a437564df6dcc125669c2d5a7191e8b6a1dd8efe13d1b8c74c" Mar 16 17:40:17 crc kubenswrapper[5120]: I0316 17:40:17.660912 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/keystone-operator-index-f85dc"] Mar 16 17:40:17 crc kubenswrapper[5120]: I0316 17:40:17.674527 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-operators/keystone-operator-index-f85dc"] Mar 16 17:40:17 crc kubenswrapper[5120]: I0316 17:40:17.680805 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") on node \"crc\" DevicePath \"\"" Mar 16 17:40:17 crc kubenswrapper[5120]: I0316 17:40:17.681027 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5nv6w\" (UniqueName: \"kubernetes.io/projected/4a70a89a-dbe2-4a18-9c72-10a183001eb4-kube-api-access-5nv6w\") on node \"crc\" DevicePath \"\"" Mar 16 17:40:17 crc kubenswrapper[5120]: I0316 17:40:17.681110 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/keystone-operator-controller-manager-64d54cb9b4-dksf5"] Mar 16 17:40:17 crc kubenswrapper[5120]: I0316 17:40:17.687087 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-operators/keystone-operator-controller-manager-64d54cb9b4-dksf5"] Mar 16 17:40:17 crc kubenswrapper[5120]: I0316 17:40:17.721871 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/rabbitmq-cluster-operator-index-7c6bb" Mar 16 17:40:17 crc kubenswrapper[5120]: I0316 17:40:17.730211 5120 scope.go:117] "RemoveContainer" containerID="a479804a3d0df2071c52b491d2c146037b2340dde34949b3e23c461b0785e14e" Mar 16 17:40:17 crc kubenswrapper[5120]: E0316 17:40:17.730975 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a479804a3d0df2071c52b491d2c146037b2340dde34949b3e23c461b0785e14e\": container with ID starting with a479804a3d0df2071c52b491d2c146037b2340dde34949b3e23c461b0785e14e not found: ID does not exist" containerID="a479804a3d0df2071c52b491d2c146037b2340dde34949b3e23c461b0785e14e" Mar 16 17:40:17 crc kubenswrapper[5120]: I0316 17:40:17.731015 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a479804a3d0df2071c52b491d2c146037b2340dde34949b3e23c461b0785e14e"} err="failed to get container status \"a479804a3d0df2071c52b491d2c146037b2340dde34949b3e23c461b0785e14e\": rpc error: code = NotFound desc = could not find container \"a479804a3d0df2071c52b491d2c146037b2340dde34949b3e23c461b0785e14e\": container with ID starting with a479804a3d0df2071c52b491d2c146037b2340dde34949b3e23c461b0785e14e not found: ID does not exist" Mar 16 17:40:17 crc kubenswrapper[5120]: I0316 17:40:17.731040 5120 scope.go:117] "RemoveContainer" containerID="538ce3c4956105a437564df6dcc125669c2d5a7191e8b6a1dd8efe13d1b8c74c" Mar 16 17:40:17 crc kubenswrapper[5120]: E0316 17:40:17.731857 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"538ce3c4956105a437564df6dcc125669c2d5a7191e8b6a1dd8efe13d1b8c74c\": container with ID starting with 538ce3c4956105a437564df6dcc125669c2d5a7191e8b6a1dd8efe13d1b8c74c not found: ID does not exist" containerID="538ce3c4956105a437564df6dcc125669c2d5a7191e8b6a1dd8efe13d1b8c74c" Mar 16 17:40:17 crc kubenswrapper[5120]: I0316 17:40:17.731880 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"538ce3c4956105a437564df6dcc125669c2d5a7191e8b6a1dd8efe13d1b8c74c"} err="failed to get container status \"538ce3c4956105a437564df6dcc125669c2d5a7191e8b6a1dd8efe13d1b8c74c\": rpc error: code = NotFound desc = could not find container \"538ce3c4956105a437564df6dcc125669c2d5a7191e8b6a1dd8efe13d1b8c74c\": container with ID starting with 538ce3c4956105a437564df6dcc125669c2d5a7191e8b6a1dd8efe13d1b8c74c not found: ID does not exist" Mar 16 17:40:17 crc kubenswrapper[5120]: I0316 17:40:17.731893 5120 scope.go:117] "RemoveContainer" containerID="8c9697eb83443bf35e9cf1f3170a19f53200a8665f727c4c1c8af15c8db02cfe" Mar 16 17:40:17 crc kubenswrapper[5120]: I0316 17:40:17.761001 5120 scope.go:117] "RemoveContainer" containerID="8c9697eb83443bf35e9cf1f3170a19f53200a8665f727c4c1c8af15c8db02cfe" Mar 16 17:40:17 crc kubenswrapper[5120]: I0316 17:40:17.761493 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/keystonebc2c-account-delete-qrxr4" Mar 16 17:40:17 crc kubenswrapper[5120]: E0316 17:40:17.761913 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c9697eb83443bf35e9cf1f3170a19f53200a8665f727c4c1c8af15c8db02cfe\": container with ID starting with 8c9697eb83443bf35e9cf1f3170a19f53200a8665f727c4c1c8af15c8db02cfe not found: ID does not exist" containerID="8c9697eb83443bf35e9cf1f3170a19f53200a8665f727c4c1c8af15c8db02cfe" Mar 16 17:40:17 crc kubenswrapper[5120]: I0316 17:40:17.761941 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c9697eb83443bf35e9cf1f3170a19f53200a8665f727c4c1c8af15c8db02cfe"} err="failed to get container status \"8c9697eb83443bf35e9cf1f3170a19f53200a8665f727c4c1c8af15c8db02cfe\": rpc error: code = NotFound desc = could not find container \"8c9697eb83443bf35e9cf1f3170a19f53200a8665f727c4c1c8af15c8db02cfe\": container with ID starting with 8c9697eb83443bf35e9cf1f3170a19f53200a8665f727c4c1c8af15c8db02cfe not found: ID does not exist" Mar 16 17:40:17 crc kubenswrapper[5120]: I0316 17:40:17.761961 5120 scope.go:117] "RemoveContainer" containerID="ac8af4331affd0aaf54eea45b82781a8a53a6a8ec4c5e22e608f6a0bcf6230c7" Mar 16 17:40:17 crc kubenswrapper[5120]: I0316 17:40:17.782448 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nq5nq\" (UniqueName: \"kubernetes.io/projected/28162b7c-56dd-481a-a0f8-dd4068ec5a59-kube-api-access-nq5nq\") pod \"28162b7c-56dd-481a-a0f8-dd4068ec5a59\" (UID: \"28162b7c-56dd-481a-a0f8-dd4068ec5a59\") " Mar 16 17:40:17 crc kubenswrapper[5120]: I0316 17:40:17.788210 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28162b7c-56dd-481a-a0f8-dd4068ec5a59-kube-api-access-nq5nq" (OuterVolumeSpecName: "kube-api-access-nq5nq") pod "28162b7c-56dd-481a-a0f8-dd4068ec5a59" (UID: "28162b7c-56dd-481a-a0f8-dd4068ec5a59"). InnerVolumeSpecName "kube-api-access-nq5nq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:40:17 crc kubenswrapper[5120]: I0316 17:40:17.796010 5120 scope.go:117] "RemoveContainer" containerID="b036b1fecf6fb17a767a090dd0f159bb51fa3960bcb0db24a9e6cd31b0cb2c04" Mar 16 17:40:17 crc kubenswrapper[5120]: I0316 17:40:17.800648 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["barbican-kuttl-tests/openstack-galera-1"] Mar 16 17:40:17 crc kubenswrapper[5120]: I0316 17:40:17.809328 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["barbican-kuttl-tests/openstack-galera-1"] Mar 16 17:40:17 crc kubenswrapper[5120]: I0316 17:40:17.819291 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/rabbitmq-cluster-operator-6bc46f9cd-wtpcn"] Mar 16 17:40:17 crc kubenswrapper[5120]: I0316 17:40:17.823885 5120 scope.go:117] "RemoveContainer" containerID="b036b1fecf6fb17a767a090dd0f159bb51fa3960bcb0db24a9e6cd31b0cb2c04" Mar 16 17:40:17 crc kubenswrapper[5120]: E0316 17:40:17.824262 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b036b1fecf6fb17a767a090dd0f159bb51fa3960bcb0db24a9e6cd31b0cb2c04\": container with ID starting with b036b1fecf6fb17a767a090dd0f159bb51fa3960bcb0db24a9e6cd31b0cb2c04 not found: ID does not exist" containerID="b036b1fecf6fb17a767a090dd0f159bb51fa3960bcb0db24a9e6cd31b0cb2c04" Mar 16 17:40:17 crc kubenswrapper[5120]: I0316 17:40:17.824314 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b036b1fecf6fb17a767a090dd0f159bb51fa3960bcb0db24a9e6cd31b0cb2c04"} err="failed to get container status \"b036b1fecf6fb17a767a090dd0f159bb51fa3960bcb0db24a9e6cd31b0cb2c04\": rpc error: code = NotFound desc = could not find container \"b036b1fecf6fb17a767a090dd0f159bb51fa3960bcb0db24a9e6cd31b0cb2c04\": container with ID starting with b036b1fecf6fb17a767a090dd0f159bb51fa3960bcb0db24a9e6cd31b0cb2c04 not found: ID does not exist" Mar 16 17:40:17 crc kubenswrapper[5120]: I0316 17:40:17.828773 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-operators/rabbitmq-cluster-operator-6bc46f9cd-wtpcn"] Mar 16 17:40:17 crc kubenswrapper[5120]: I0316 17:40:17.878211 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/openstack-galera-0" Mar 16 17:40:17 crc kubenswrapper[5120]: I0316 17:40:17.889723 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/cb9e9af1-7275-4426-aa22-16b916aada88-operator-scripts\") pod \"cb9e9af1-7275-4426-aa22-16b916aada88\" (UID: \"cb9e9af1-7275-4426-aa22-16b916aada88\") " Mar 16 17:40:17 crc kubenswrapper[5120]: I0316 17:40:17.890505 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pq25d\" (UniqueName: \"kubernetes.io/projected/cb9e9af1-7275-4426-aa22-16b916aada88-kube-api-access-pq25d\") pod \"cb9e9af1-7275-4426-aa22-16b916aada88\" (UID: \"cb9e9af1-7275-4426-aa22-16b916aada88\") " Mar 16 17:40:17 crc kubenswrapper[5120]: I0316 17:40:17.891447 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nq5nq\" (UniqueName: \"kubernetes.io/projected/28162b7c-56dd-481a-a0f8-dd4068ec5a59-kube-api-access-nq5nq\") on node \"crc\" DevicePath \"\"" Mar 16 17:40:17 crc kubenswrapper[5120]: I0316 17:40:17.892288 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cb9e9af1-7275-4426-aa22-16b916aada88-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "cb9e9af1-7275-4426-aa22-16b916aada88" (UID: "cb9e9af1-7275-4426-aa22-16b916aada88"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:40:17 crc kubenswrapper[5120]: I0316 17:40:17.895166 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb9e9af1-7275-4426-aa22-16b916aada88-kube-api-access-pq25d" (OuterVolumeSpecName: "kube-api-access-pq25d") pod "cb9e9af1-7275-4426-aa22-16b916aada88" (UID: "cb9e9af1-7275-4426-aa22-16b916aada88"). InnerVolumeSpecName "kube-api-access-pq25d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:40:17 crc kubenswrapper[5120]: I0316 17:40:17.992367 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"mysql-db\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"2dfcb27a-8b24-493a-b27f-74436a9105e0\" (UID: \"2dfcb27a-8b24-493a-b27f-74436a9105e0\") " Mar 16 17:40:17 crc kubenswrapper[5120]: I0316 17:40:17.992935 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/2dfcb27a-8b24-493a-b27f-74436a9105e0-config-data-default\") pod \"2dfcb27a-8b24-493a-b27f-74436a9105e0\" (UID: \"2dfcb27a-8b24-493a-b27f-74436a9105e0\") " Mar 16 17:40:17 crc kubenswrapper[5120]: I0316 17:40:17.993036 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2dfcb27a-8b24-493a-b27f-74436a9105e0-operator-scripts\") pod \"2dfcb27a-8b24-493a-b27f-74436a9105e0\" (UID: \"2dfcb27a-8b24-493a-b27f-74436a9105e0\") " Mar 16 17:40:17 crc kubenswrapper[5120]: I0316 17:40:17.993156 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/2dfcb27a-8b24-493a-b27f-74436a9105e0-kolla-config\") pod \"2dfcb27a-8b24-493a-b27f-74436a9105e0\" (UID: \"2dfcb27a-8b24-493a-b27f-74436a9105e0\") " Mar 16 17:40:17 crc kubenswrapper[5120]: I0316 17:40:17.993932 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2dfcb27a-8b24-493a-b27f-74436a9105e0-config-data-default" (OuterVolumeSpecName: "config-data-default") pod "2dfcb27a-8b24-493a-b27f-74436a9105e0" (UID: "2dfcb27a-8b24-493a-b27f-74436a9105e0"). InnerVolumeSpecName "config-data-default". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:40:17 crc kubenswrapper[5120]: I0316 17:40:17.994068 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2dfcb27a-8b24-493a-b27f-74436a9105e0-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "2dfcb27a-8b24-493a-b27f-74436a9105e0" (UID: "2dfcb27a-8b24-493a-b27f-74436a9105e0"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:40:17 crc kubenswrapper[5120]: I0316 17:40:17.993531 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/2dfcb27a-8b24-493a-b27f-74436a9105e0-config-data-generated\") pod \"2dfcb27a-8b24-493a-b27f-74436a9105e0\" (UID: \"2dfcb27a-8b24-493a-b27f-74436a9105e0\") " Mar 16 17:40:17 crc kubenswrapper[5120]: I0316 17:40:17.994446 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sc2r5\" (UniqueName: \"kubernetes.io/projected/2dfcb27a-8b24-493a-b27f-74436a9105e0-kube-api-access-sc2r5\") pod \"2dfcb27a-8b24-493a-b27f-74436a9105e0\" (UID: \"2dfcb27a-8b24-493a-b27f-74436a9105e0\") " Mar 16 17:40:17 crc kubenswrapper[5120]: I0316 17:40:17.994464 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2dfcb27a-8b24-493a-b27f-74436a9105e0-config-data-generated" (OuterVolumeSpecName: "config-data-generated") pod "2dfcb27a-8b24-493a-b27f-74436a9105e0" (UID: "2dfcb27a-8b24-493a-b27f-74436a9105e0"). InnerVolumeSpecName "config-data-generated". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:40:17 crc kubenswrapper[5120]: I0316 17:40:17.994493 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2dfcb27a-8b24-493a-b27f-74436a9105e0-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "2dfcb27a-8b24-493a-b27f-74436a9105e0" (UID: "2dfcb27a-8b24-493a-b27f-74436a9105e0"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:40:17 crc kubenswrapper[5120]: I0316 17:40:17.995134 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pq25d\" (UniqueName: \"kubernetes.io/projected/cb9e9af1-7275-4426-aa22-16b916aada88-kube-api-access-pq25d\") on node \"crc\" DevicePath \"\"" Mar 16 17:40:17 crc kubenswrapper[5120]: I0316 17:40:17.995239 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/2dfcb27a-8b24-493a-b27f-74436a9105e0-config-data-generated\") on node \"crc\" DevicePath \"\"" Mar 16 17:40:17 crc kubenswrapper[5120]: I0316 17:40:17.995320 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/cb9e9af1-7275-4426-aa22-16b916aada88-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:40:17 crc kubenswrapper[5120]: I0316 17:40:17.995378 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/2dfcb27a-8b24-493a-b27f-74436a9105e0-config-data-default\") on node \"crc\" DevicePath \"\"" Mar 16 17:40:17 crc kubenswrapper[5120]: I0316 17:40:17.995458 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2dfcb27a-8b24-493a-b27f-74436a9105e0-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:40:17 crc kubenswrapper[5120]: I0316 17:40:17.995562 5120 reconciler_common.go:299] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/2dfcb27a-8b24-493a-b27f-74436a9105e0-kolla-config\") on node \"crc\" DevicePath \"\"" Mar 16 17:40:17 crc kubenswrapper[5120]: I0316 17:40:17.997412 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2dfcb27a-8b24-493a-b27f-74436a9105e0-kube-api-access-sc2r5" (OuterVolumeSpecName: "kube-api-access-sc2r5") pod "2dfcb27a-8b24-493a-b27f-74436a9105e0" (UID: "2dfcb27a-8b24-493a-b27f-74436a9105e0"). InnerVolumeSpecName "kube-api-access-sc2r5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:40:18 crc kubenswrapper[5120]: I0316 17:40:18.002211 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage20-crc" (OuterVolumeSpecName: "mysql-db") pod "2dfcb27a-8b24-493a-b27f-74436a9105e0" (UID: "2dfcb27a-8b24-493a-b27f-74436a9105e0"). InnerVolumeSpecName "local-storage20-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 17:40:18 crc kubenswrapper[5120]: I0316 17:40:18.097422 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sc2r5\" (UniqueName: \"kubernetes.io/projected/2dfcb27a-8b24-493a-b27f-74436a9105e0-kube-api-access-sc2r5\") on node \"crc\" DevicePath \"\"" Mar 16 17:40:18 crc kubenswrapper[5120]: I0316 17:40:18.097781 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") on node \"crc\" " Mar 16 17:40:18 crc kubenswrapper[5120]: I0316 17:40:18.109471 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage20-crc" (UniqueName: "kubernetes.io/local-volume/local-storage20-crc") on node "crc" Mar 16 17:40:18 crc kubenswrapper[5120]: I0316 17:40:18.200274 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") on node \"crc\" DevicePath \"\"" Mar 16 17:40:18 crc kubenswrapper[5120]: I0316 17:40:18.508484 5120 generic.go:358] "Generic (PLEG): container finished" podID="2dfcb27a-8b24-493a-b27f-74436a9105e0" containerID="bd886c662bfb32fade18831a0234c64c44dffce578f9763a885f87560d3a39d3" exitCode=0 Mar 16 17:40:18 crc kubenswrapper[5120]: I0316 17:40:18.508564 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/openstack-galera-0" Mar 16 17:40:18 crc kubenswrapper[5120]: I0316 17:40:18.508568 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/openstack-galera-0" event={"ID":"2dfcb27a-8b24-493a-b27f-74436a9105e0","Type":"ContainerDied","Data":"bd886c662bfb32fade18831a0234c64c44dffce578f9763a885f87560d3a39d3"} Mar 16 17:40:18 crc kubenswrapper[5120]: I0316 17:40:18.509977 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/openstack-galera-0" event={"ID":"2dfcb27a-8b24-493a-b27f-74436a9105e0","Type":"ContainerDied","Data":"a2a25e7350ecc0944499bd23779db5f0964ee9675c624e6d67f629eca92cf198"} Mar 16 17:40:18 crc kubenswrapper[5120]: I0316 17:40:18.510008 5120 scope.go:117] "RemoveContainer" containerID="bd886c662bfb32fade18831a0234c64c44dffce578f9763a885f87560d3a39d3" Mar 16 17:40:18 crc kubenswrapper[5120]: I0316 17:40:18.518291 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/rabbitmq-cluster-operator-index-7c6bb" event={"ID":"28162b7c-56dd-481a-a0f8-dd4068ec5a59","Type":"ContainerDied","Data":"b8a1b93e9a55fe0ac680f0b467608115a26cd03b918c6893ec9d4736d340d210"} Mar 16 17:40:18 crc kubenswrapper[5120]: I0316 17:40:18.518417 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/rabbitmq-cluster-operator-index-7c6bb" Mar 16 17:40:18 crc kubenswrapper[5120]: I0316 17:40:18.526535 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/keystonebc2c-account-delete-qrxr4" event={"ID":"cb9e9af1-7275-4426-aa22-16b916aada88","Type":"ContainerDied","Data":"4c9178f9b51802034227021d2a1db399b99bb01d9411e6ee379e1c9fb66ace2f"} Mar 16 17:40:18 crc kubenswrapper[5120]: I0316 17:40:18.526692 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/keystonebc2c-account-delete-qrxr4" Mar 16 17:40:18 crc kubenswrapper[5120]: I0316 17:40:18.565088 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["barbican-kuttl-tests/openstack-galera-0"] Mar 16 17:40:18 crc kubenswrapper[5120]: I0316 17:40:18.572839 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["barbican-kuttl-tests/openstack-galera-0"] Mar 16 17:40:18 crc kubenswrapper[5120]: I0316 17:40:18.593859 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/rabbitmq-cluster-operator-index-7c6bb"] Mar 16 17:40:18 crc kubenswrapper[5120]: I0316 17:40:18.594966 5120 scope.go:117] "RemoveContainer" containerID="cbc275544c769916eae261440ae4e65beb6bb6dbb3351f1ae47027611bd82335" Mar 16 17:40:18 crc kubenswrapper[5120]: I0316 17:40:18.607479 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-operators/rabbitmq-cluster-operator-index-7c6bb"] Mar 16 17:40:18 crc kubenswrapper[5120]: I0316 17:40:18.617852 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/infra-operator-controller-manager-747c77fd77-qt2c6"] Mar 16 17:40:18 crc kubenswrapper[5120]: I0316 17:40:18.618421 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-operators/infra-operator-controller-manager-747c77fd77-qt2c6" podUID="a2746e35-f4b1-4c30-9288-8e4e9dc669bd" containerName="manager" containerID="cri-o://003da9c3210226d0b187f0d095b7feb9a49c6aa245e6629599fbb138002efec8" gracePeriod=10 Mar 16 17:40:18 crc kubenswrapper[5120]: I0316 17:40:18.628844 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["barbican-kuttl-tests/keystonebc2c-account-delete-qrxr4"] Mar 16 17:40:18 crc kubenswrapper[5120]: I0316 17:40:18.648254 5120 scope.go:117] "RemoveContainer" containerID="bd886c662bfb32fade18831a0234c64c44dffce578f9763a885f87560d3a39d3" Mar 16 17:40:18 crc kubenswrapper[5120]: E0316 17:40:18.659988 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd886c662bfb32fade18831a0234c64c44dffce578f9763a885f87560d3a39d3\": container with ID starting with bd886c662bfb32fade18831a0234c64c44dffce578f9763a885f87560d3a39d3 not found: ID does not exist" containerID="bd886c662bfb32fade18831a0234c64c44dffce578f9763a885f87560d3a39d3" Mar 16 17:40:18 crc kubenswrapper[5120]: I0316 17:40:18.660043 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd886c662bfb32fade18831a0234c64c44dffce578f9763a885f87560d3a39d3"} err="failed to get container status \"bd886c662bfb32fade18831a0234c64c44dffce578f9763a885f87560d3a39d3\": rpc error: code = NotFound desc = could not find container \"bd886c662bfb32fade18831a0234c64c44dffce578f9763a885f87560d3a39d3\": container with ID starting with bd886c662bfb32fade18831a0234c64c44dffce578f9763a885f87560d3a39d3 not found: ID does not exist" Mar 16 17:40:18 crc kubenswrapper[5120]: I0316 17:40:18.660074 5120 scope.go:117] "RemoveContainer" containerID="cbc275544c769916eae261440ae4e65beb6bb6dbb3351f1ae47027611bd82335" Mar 16 17:40:18 crc kubenswrapper[5120]: I0316 17:40:18.661659 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["barbican-kuttl-tests/keystonebc2c-account-delete-qrxr4"] Mar 16 17:40:18 crc kubenswrapper[5120]: E0316 17:40:18.665953 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cbc275544c769916eae261440ae4e65beb6bb6dbb3351f1ae47027611bd82335\": container with ID starting with cbc275544c769916eae261440ae4e65beb6bb6dbb3351f1ae47027611bd82335 not found: ID does not exist" containerID="cbc275544c769916eae261440ae4e65beb6bb6dbb3351f1ae47027611bd82335" Mar 16 17:40:18 crc kubenswrapper[5120]: I0316 17:40:18.666007 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cbc275544c769916eae261440ae4e65beb6bb6dbb3351f1ae47027611bd82335"} err="failed to get container status \"cbc275544c769916eae261440ae4e65beb6bb6dbb3351f1ae47027611bd82335\": rpc error: code = NotFound desc = could not find container \"cbc275544c769916eae261440ae4e65beb6bb6dbb3351f1ae47027611bd82335\": container with ID starting with cbc275544c769916eae261440ae4e65beb6bb6dbb3351f1ae47027611bd82335 not found: ID does not exist" Mar 16 17:40:18 crc kubenswrapper[5120]: I0316 17:40:18.666035 5120 scope.go:117] "RemoveContainer" containerID="e81da091a65c4035c53e284e50a1b5614f6138e186cfc49ed156bca3299242da" Mar 16 17:40:18 crc kubenswrapper[5120]: I0316 17:40:18.690264 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="017f781f-d93d-4b6b-9d7e-966c513348bc" path="/var/lib/kubelet/pods/017f781f-d93d-4b6b-9d7e-966c513348bc/volumes" Mar 16 17:40:18 crc kubenswrapper[5120]: I0316 17:40:18.690951 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="05269e3d-2dcd-4828-8142-7399752715b3" path="/var/lib/kubelet/pods/05269e3d-2dcd-4828-8142-7399752715b3/volumes" Mar 16 17:40:18 crc kubenswrapper[5120]: I0316 17:40:18.691541 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="28162b7c-56dd-481a-a0f8-dd4068ec5a59" path="/var/lib/kubelet/pods/28162b7c-56dd-481a-a0f8-dd4068ec5a59/volumes" Mar 16 17:40:18 crc kubenswrapper[5120]: I0316 17:40:18.694020 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2dfcb27a-8b24-493a-b27f-74436a9105e0" path="/var/lib/kubelet/pods/2dfcb27a-8b24-493a-b27f-74436a9105e0/volumes" Mar 16 17:40:18 crc kubenswrapper[5120]: I0316 17:40:18.695179 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="459c983d-9938-4660-a965-31585832f250" path="/var/lib/kubelet/pods/459c983d-9938-4660-a965-31585832f250/volumes" Mar 16 17:40:18 crc kubenswrapper[5120]: I0316 17:40:18.695860 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4a70a89a-dbe2-4a18-9c72-10a183001eb4" path="/var/lib/kubelet/pods/4a70a89a-dbe2-4a18-9c72-10a183001eb4/volumes" Mar 16 17:40:18 crc kubenswrapper[5120]: I0316 17:40:18.697071 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="993eeb7c-89cd-41ce-8b61-efcff7710f0f" path="/var/lib/kubelet/pods/993eeb7c-89cd-41ce-8b61-efcff7710f0f/volumes" Mar 16 17:40:18 crc kubenswrapper[5120]: I0316 17:40:18.697853 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b60b9e90-4bd4-4678-b8d2-214b5b3ee528" path="/var/lib/kubelet/pods/b60b9e90-4bd4-4678-b8d2-214b5b3ee528/volumes" Mar 16 17:40:18 crc kubenswrapper[5120]: I0316 17:40:18.698431 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb9e9af1-7275-4426-aa22-16b916aada88" path="/var/lib/kubelet/pods/cb9e9af1-7275-4426-aa22-16b916aada88/volumes" Mar 16 17:40:18 crc kubenswrapper[5120]: I0316 17:40:18.700858 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cd2640c0-ff12-49d6-82df-d7bbd8bdf08c" path="/var/lib/kubelet/pods/cd2640c0-ff12-49d6-82df-d7bbd8bdf08c/volumes" Mar 16 17:40:18 crc kubenswrapper[5120]: I0316 17:40:18.701451 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ecba5863-ab91-4517-bc9b-553b7900ffc2" path="/var/lib/kubelet/pods/ecba5863-ab91-4517-bc9b-553b7900ffc2/volumes" Mar 16 17:40:18 crc kubenswrapper[5120]: I0316 17:40:18.717922 5120 scope.go:117] "RemoveContainer" containerID="66999a73b19486f492f66c0964804b03f94b2f0b7e7d29ea04e4af3ae8496d88" Mar 16 17:40:18 crc kubenswrapper[5120]: I0316 17:40:18.946279 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/infra-operator-index-gs4dw"] Mar 16 17:40:18 crc kubenswrapper[5120]: I0316 17:40:18.946519 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-operators/infra-operator-index-gs4dw" podUID="dc18cff5-655d-4b7d-b8e9-473dcf200489" containerName="registry-server" containerID="cri-o://9df493f79ee66a4b81bf9859d01b5a1b08f72c0fc9dcd2ef080e5d83c5a97398" gracePeriod=30 Mar 16 17:40:19 crc kubenswrapper[5120]: I0316 17:40:19.004542 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/0b4c51a436ce56c4393293420dad5bb37f4e2c4f062c7176860d28159525g5w"] Mar 16 17:40:19 crc kubenswrapper[5120]: I0316 17:40:19.014537 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-operators/0b4c51a436ce56c4393293420dad5bb37f4e2c4f062c7176860d28159525g5w"] Mar 16 17:40:19 crc kubenswrapper[5120]: I0316 17:40:19.102535 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/infra-operator-controller-manager-747c77fd77-qt2c6" Mar 16 17:40:19 crc kubenswrapper[5120]: I0316 17:40:19.230078 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a2746e35-f4b1-4c30-9288-8e4e9dc669bd-apiservice-cert\") pod \"a2746e35-f4b1-4c30-9288-8e4e9dc669bd\" (UID: \"a2746e35-f4b1-4c30-9288-8e4e9dc669bd\") " Mar 16 17:40:19 crc kubenswrapper[5120]: I0316 17:40:19.230307 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a2746e35-f4b1-4c30-9288-8e4e9dc669bd-webhook-cert\") pod \"a2746e35-f4b1-4c30-9288-8e4e9dc669bd\" (UID: \"a2746e35-f4b1-4c30-9288-8e4e9dc669bd\") " Mar 16 17:40:19 crc kubenswrapper[5120]: I0316 17:40:19.230493 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vk52k\" (UniqueName: \"kubernetes.io/projected/a2746e35-f4b1-4c30-9288-8e4e9dc669bd-kube-api-access-vk52k\") pod \"a2746e35-f4b1-4c30-9288-8e4e9dc669bd\" (UID: \"a2746e35-f4b1-4c30-9288-8e4e9dc669bd\") " Mar 16 17:40:19 crc kubenswrapper[5120]: I0316 17:40:19.235869 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a2746e35-f4b1-4c30-9288-8e4e9dc669bd-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "a2746e35-f4b1-4c30-9288-8e4e9dc669bd" (UID: "a2746e35-f4b1-4c30-9288-8e4e9dc669bd"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:40:19 crc kubenswrapper[5120]: I0316 17:40:19.236697 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a2746e35-f4b1-4c30-9288-8e4e9dc669bd-kube-api-access-vk52k" (OuterVolumeSpecName: "kube-api-access-vk52k") pod "a2746e35-f4b1-4c30-9288-8e4e9dc669bd" (UID: "a2746e35-f4b1-4c30-9288-8e4e9dc669bd"). InnerVolumeSpecName "kube-api-access-vk52k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:40:19 crc kubenswrapper[5120]: I0316 17:40:19.237430 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a2746e35-f4b1-4c30-9288-8e4e9dc669bd-apiservice-cert" (OuterVolumeSpecName: "apiservice-cert") pod "a2746e35-f4b1-4c30-9288-8e4e9dc669bd" (UID: "a2746e35-f4b1-4c30-9288-8e4e9dc669bd"). InnerVolumeSpecName "apiservice-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:40:19 crc kubenswrapper[5120]: I0316 17:40:19.333589 5120 reconciler_common.go:299] "Volume detached for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a2746e35-f4b1-4c30-9288-8e4e9dc669bd-apiservice-cert\") on node \"crc\" DevicePath \"\"" Mar 16 17:40:19 crc kubenswrapper[5120]: I0316 17:40:19.333635 5120 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a2746e35-f4b1-4c30-9288-8e4e9dc669bd-webhook-cert\") on node \"crc\" DevicePath \"\"" Mar 16 17:40:19 crc kubenswrapper[5120]: I0316 17:40:19.333649 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vk52k\" (UniqueName: \"kubernetes.io/projected/a2746e35-f4b1-4c30-9288-8e4e9dc669bd-kube-api-access-vk52k\") on node \"crc\" DevicePath \"\"" Mar 16 17:40:19 crc kubenswrapper[5120]: I0316 17:40:19.541619 5120 generic.go:358] "Generic (PLEG): container finished" podID="a2746e35-f4b1-4c30-9288-8e4e9dc669bd" containerID="003da9c3210226d0b187f0d095b7feb9a49c6aa245e6629599fbb138002efec8" exitCode=0 Mar 16 17:40:19 crc kubenswrapper[5120]: I0316 17:40:19.541663 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/infra-operator-controller-manager-747c77fd77-qt2c6" Mar 16 17:40:19 crc kubenswrapper[5120]: I0316 17:40:19.541717 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/infra-operator-controller-manager-747c77fd77-qt2c6" event={"ID":"a2746e35-f4b1-4c30-9288-8e4e9dc669bd","Type":"ContainerDied","Data":"003da9c3210226d0b187f0d095b7feb9a49c6aa245e6629599fbb138002efec8"} Mar 16 17:40:19 crc kubenswrapper[5120]: I0316 17:40:19.541747 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/infra-operator-controller-manager-747c77fd77-qt2c6" event={"ID":"a2746e35-f4b1-4c30-9288-8e4e9dc669bd","Type":"ContainerDied","Data":"44db3d7248647d8ddf58a3219f150f3f604c62996f4f469db7b38bca1a8bb9b2"} Mar 16 17:40:19 crc kubenswrapper[5120]: I0316 17:40:19.541788 5120 scope.go:117] "RemoveContainer" containerID="003da9c3210226d0b187f0d095b7feb9a49c6aa245e6629599fbb138002efec8" Mar 16 17:40:19 crc kubenswrapper[5120]: I0316 17:40:19.551887 5120 generic.go:358] "Generic (PLEG): container finished" podID="dc18cff5-655d-4b7d-b8e9-473dcf200489" containerID="9df493f79ee66a4b81bf9859d01b5a1b08f72c0fc9dcd2ef080e5d83c5a97398" exitCode=0 Mar 16 17:40:19 crc kubenswrapper[5120]: I0316 17:40:19.551942 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/infra-operator-index-gs4dw" event={"ID":"dc18cff5-655d-4b7d-b8e9-473dcf200489","Type":"ContainerDied","Data":"9df493f79ee66a4b81bf9859d01b5a1b08f72c0fc9dcd2ef080e5d83c5a97398"} Mar 16 17:40:19 crc kubenswrapper[5120]: I0316 17:40:19.551969 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/infra-operator-index-gs4dw" event={"ID":"dc18cff5-655d-4b7d-b8e9-473dcf200489","Type":"ContainerDied","Data":"7eb2551f71b57bc01951ec9923f166a02d09453c6cd0f1c9740eb62513194d6b"} Mar 16 17:40:19 crc kubenswrapper[5120]: I0316 17:40:19.551984 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7eb2551f71b57bc01951ec9923f166a02d09453c6cd0f1c9740eb62513194d6b" Mar 16 17:40:19 crc kubenswrapper[5120]: I0316 17:40:19.592549 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/infra-operator-index-gs4dw" Mar 16 17:40:19 crc kubenswrapper[5120]: I0316 17:40:19.598742 5120 scope.go:117] "RemoveContainer" containerID="003da9c3210226d0b187f0d095b7feb9a49c6aa245e6629599fbb138002efec8" Mar 16 17:40:19 crc kubenswrapper[5120]: E0316 17:40:19.599344 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"003da9c3210226d0b187f0d095b7feb9a49c6aa245e6629599fbb138002efec8\": container with ID starting with 003da9c3210226d0b187f0d095b7feb9a49c6aa245e6629599fbb138002efec8 not found: ID does not exist" containerID="003da9c3210226d0b187f0d095b7feb9a49c6aa245e6629599fbb138002efec8" Mar 16 17:40:19 crc kubenswrapper[5120]: I0316 17:40:19.599403 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"003da9c3210226d0b187f0d095b7feb9a49c6aa245e6629599fbb138002efec8"} err="failed to get container status \"003da9c3210226d0b187f0d095b7feb9a49c6aa245e6629599fbb138002efec8\": rpc error: code = NotFound desc = could not find container \"003da9c3210226d0b187f0d095b7feb9a49c6aa245e6629599fbb138002efec8\": container with ID starting with 003da9c3210226d0b187f0d095b7feb9a49c6aa245e6629599fbb138002efec8 not found: ID does not exist" Mar 16 17:40:19 crc kubenswrapper[5120]: I0316 17:40:19.624436 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/infra-operator-controller-manager-747c77fd77-qt2c6"] Mar 16 17:40:19 crc kubenswrapper[5120]: I0316 17:40:19.628792 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-operators/infra-operator-controller-manager-747c77fd77-qt2c6"] Mar 16 17:40:19 crc kubenswrapper[5120]: I0316 17:40:19.641023 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t2clg\" (UniqueName: \"kubernetes.io/projected/dc18cff5-655d-4b7d-b8e9-473dcf200489-kube-api-access-t2clg\") pod \"dc18cff5-655d-4b7d-b8e9-473dcf200489\" (UID: \"dc18cff5-655d-4b7d-b8e9-473dcf200489\") " Mar 16 17:40:19 crc kubenswrapper[5120]: I0316 17:40:19.660972 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc18cff5-655d-4b7d-b8e9-473dcf200489-kube-api-access-t2clg" (OuterVolumeSpecName: "kube-api-access-t2clg") pod "dc18cff5-655d-4b7d-b8e9-473dcf200489" (UID: "dc18cff5-655d-4b7d-b8e9-473dcf200489"). InnerVolumeSpecName "kube-api-access-t2clg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:40:19 crc kubenswrapper[5120]: I0316 17:40:19.734234 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/mariadb-operator-controller-manager-8c6b767f7-fp79q"] Mar 16 17:40:19 crc kubenswrapper[5120]: I0316 17:40:19.734631 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-operators/mariadb-operator-controller-manager-8c6b767f7-fp79q" podUID="e1a87a80-0dc7-4b13-938a-9b63c43df433" containerName="manager" containerID="cri-o://c2279a1ac87de5badd54b84d68c5debc2a280f154acbc555c810daa9d034e033" gracePeriod=10 Mar 16 17:40:19 crc kubenswrapper[5120]: I0316 17:40:19.751541 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t2clg\" (UniqueName: \"kubernetes.io/projected/dc18cff5-655d-4b7d-b8e9-473dcf200489-kube-api-access-t2clg\") on node \"crc\" DevicePath \"\"" Mar 16 17:40:19 crc kubenswrapper[5120]: I0316 17:40:19.950940 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/mariadb-operator-index-tj5ss"] Mar 16 17:40:19 crc kubenswrapper[5120]: I0316 17:40:19.951230 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-operators/mariadb-operator-index-tj5ss" podUID="f0ee03d7-2cda-48de-94bd-b0ab8c1794a4" containerName="registry-server" containerID="cri-o://e9b1a5a9c9de1fc800e7c8858e87fb37e271611ceeaae27ffeb96a83dac79fe5" gracePeriod=30 Mar 16 17:40:19 crc kubenswrapper[5120]: I0316 17:40:19.998221 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/1b4ccfde3488142cc254fb313062ed88e2d18a60b7907f7b7c6ca340282x65z"] Mar 16 17:40:20 crc kubenswrapper[5120]: I0316 17:40:20.003216 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-operators/1b4ccfde3488142cc254fb313062ed88e2d18a60b7907f7b7c6ca340282x65z"] Mar 16 17:40:20 crc kubenswrapper[5120]: I0316 17:40:20.186541 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/mariadb-operator-controller-manager-8c6b767f7-fp79q" Mar 16 17:40:20 crc kubenswrapper[5120]: I0316 17:40:20.264574 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d5wln\" (UniqueName: \"kubernetes.io/projected/e1a87a80-0dc7-4b13-938a-9b63c43df433-kube-api-access-d5wln\") pod \"e1a87a80-0dc7-4b13-938a-9b63c43df433\" (UID: \"e1a87a80-0dc7-4b13-938a-9b63c43df433\") " Mar 16 17:40:20 crc kubenswrapper[5120]: I0316 17:40:20.264633 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e1a87a80-0dc7-4b13-938a-9b63c43df433-webhook-cert\") pod \"e1a87a80-0dc7-4b13-938a-9b63c43df433\" (UID: \"e1a87a80-0dc7-4b13-938a-9b63c43df433\") " Mar 16 17:40:20 crc kubenswrapper[5120]: I0316 17:40:20.265559 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e1a87a80-0dc7-4b13-938a-9b63c43df433-apiservice-cert\") pod \"e1a87a80-0dc7-4b13-938a-9b63c43df433\" (UID: \"e1a87a80-0dc7-4b13-938a-9b63c43df433\") " Mar 16 17:40:20 crc kubenswrapper[5120]: I0316 17:40:20.270841 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e1a87a80-0dc7-4b13-938a-9b63c43df433-apiservice-cert" (OuterVolumeSpecName: "apiservice-cert") pod "e1a87a80-0dc7-4b13-938a-9b63c43df433" (UID: "e1a87a80-0dc7-4b13-938a-9b63c43df433"). InnerVolumeSpecName "apiservice-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:40:20 crc kubenswrapper[5120]: I0316 17:40:20.270913 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e1a87a80-0dc7-4b13-938a-9b63c43df433-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "e1a87a80-0dc7-4b13-938a-9b63c43df433" (UID: "e1a87a80-0dc7-4b13-938a-9b63c43df433"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:40:20 crc kubenswrapper[5120]: I0316 17:40:20.270909 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1a87a80-0dc7-4b13-938a-9b63c43df433-kube-api-access-d5wln" (OuterVolumeSpecName: "kube-api-access-d5wln") pod "e1a87a80-0dc7-4b13-938a-9b63c43df433" (UID: "e1a87a80-0dc7-4b13-938a-9b63c43df433"). InnerVolumeSpecName "kube-api-access-d5wln". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:40:20 crc kubenswrapper[5120]: I0316 17:40:20.341465 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/mariadb-operator-index-tj5ss" Mar 16 17:40:20 crc kubenswrapper[5120]: I0316 17:40:20.397509 5120 reconciler_common.go:299] "Volume detached for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e1a87a80-0dc7-4b13-938a-9b63c43df433-apiservice-cert\") on node \"crc\" DevicePath \"\"" Mar 16 17:40:20 crc kubenswrapper[5120]: I0316 17:40:20.397557 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d5wln\" (UniqueName: \"kubernetes.io/projected/e1a87a80-0dc7-4b13-938a-9b63c43df433-kube-api-access-d5wln\") on node \"crc\" DevicePath \"\"" Mar 16 17:40:20 crc kubenswrapper[5120]: I0316 17:40:20.397567 5120 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e1a87a80-0dc7-4b13-938a-9b63c43df433-webhook-cert\") on node \"crc\" DevicePath \"\"" Mar 16 17:40:20 crc kubenswrapper[5120]: I0316 17:40:20.498728 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ksbms\" (UniqueName: \"kubernetes.io/projected/f0ee03d7-2cda-48de-94bd-b0ab8c1794a4-kube-api-access-ksbms\") pod \"f0ee03d7-2cda-48de-94bd-b0ab8c1794a4\" (UID: \"f0ee03d7-2cda-48de-94bd-b0ab8c1794a4\") " Mar 16 17:40:20 crc kubenswrapper[5120]: I0316 17:40:20.502236 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0ee03d7-2cda-48de-94bd-b0ab8c1794a4-kube-api-access-ksbms" (OuterVolumeSpecName: "kube-api-access-ksbms") pod "f0ee03d7-2cda-48de-94bd-b0ab8c1794a4" (UID: "f0ee03d7-2cda-48de-94bd-b0ab8c1794a4"). InnerVolumeSpecName "kube-api-access-ksbms". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:40:20 crc kubenswrapper[5120]: I0316 17:40:20.563013 5120 generic.go:358] "Generic (PLEG): container finished" podID="f0ee03d7-2cda-48de-94bd-b0ab8c1794a4" containerID="e9b1a5a9c9de1fc800e7c8858e87fb37e271611ceeaae27ffeb96a83dac79fe5" exitCode=0 Mar 16 17:40:20 crc kubenswrapper[5120]: I0316 17:40:20.563080 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/mariadb-operator-index-tj5ss" event={"ID":"f0ee03d7-2cda-48de-94bd-b0ab8c1794a4","Type":"ContainerDied","Data":"e9b1a5a9c9de1fc800e7c8858e87fb37e271611ceeaae27ffeb96a83dac79fe5"} Mar 16 17:40:20 crc kubenswrapper[5120]: I0316 17:40:20.563124 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/mariadb-operator-index-tj5ss" Mar 16 17:40:20 crc kubenswrapper[5120]: I0316 17:40:20.563153 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/mariadb-operator-index-tj5ss" event={"ID":"f0ee03d7-2cda-48de-94bd-b0ab8c1794a4","Type":"ContainerDied","Data":"10c70aeb0c5a1aeab0e8b1eef65a8afb88d89e47ddc70e2d8464992d1468fef3"} Mar 16 17:40:20 crc kubenswrapper[5120]: I0316 17:40:20.563176 5120 scope.go:117] "RemoveContainer" containerID="e9b1a5a9c9de1fc800e7c8858e87fb37e271611ceeaae27ffeb96a83dac79fe5" Mar 16 17:40:20 crc kubenswrapper[5120]: I0316 17:40:20.564841 5120 generic.go:358] "Generic (PLEG): container finished" podID="e1a87a80-0dc7-4b13-938a-9b63c43df433" containerID="c2279a1ac87de5badd54b84d68c5debc2a280f154acbc555c810daa9d034e033" exitCode=0 Mar 16 17:40:20 crc kubenswrapper[5120]: I0316 17:40:20.564870 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/mariadb-operator-controller-manager-8c6b767f7-fp79q" event={"ID":"e1a87a80-0dc7-4b13-938a-9b63c43df433","Type":"ContainerDied","Data":"c2279a1ac87de5badd54b84d68c5debc2a280f154acbc555c810daa9d034e033"} Mar 16 17:40:20 crc kubenswrapper[5120]: I0316 17:40:20.564899 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/mariadb-operator-controller-manager-8c6b767f7-fp79q" event={"ID":"e1a87a80-0dc7-4b13-938a-9b63c43df433","Type":"ContainerDied","Data":"9cc2b471263e8a66d467756cfc309b1cf46a1da0644df290a4dc4744bf233ca1"} Mar 16 17:40:20 crc kubenswrapper[5120]: I0316 17:40:20.564900 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/mariadb-operator-controller-manager-8c6b767f7-fp79q" Mar 16 17:40:20 crc kubenswrapper[5120]: I0316 17:40:20.565165 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/infra-operator-index-gs4dw" Mar 16 17:40:20 crc kubenswrapper[5120]: I0316 17:40:20.583637 5120 scope.go:117] "RemoveContainer" containerID="e9b1a5a9c9de1fc800e7c8858e87fb37e271611ceeaae27ffeb96a83dac79fe5" Mar 16 17:40:20 crc kubenswrapper[5120]: E0316 17:40:20.584009 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e9b1a5a9c9de1fc800e7c8858e87fb37e271611ceeaae27ffeb96a83dac79fe5\": container with ID starting with e9b1a5a9c9de1fc800e7c8858e87fb37e271611ceeaae27ffeb96a83dac79fe5 not found: ID does not exist" containerID="e9b1a5a9c9de1fc800e7c8858e87fb37e271611ceeaae27ffeb96a83dac79fe5" Mar 16 17:40:20 crc kubenswrapper[5120]: I0316 17:40:20.584058 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9b1a5a9c9de1fc800e7c8858e87fb37e271611ceeaae27ffeb96a83dac79fe5"} err="failed to get container status \"e9b1a5a9c9de1fc800e7c8858e87fb37e271611ceeaae27ffeb96a83dac79fe5\": rpc error: code = NotFound desc = could not find container \"e9b1a5a9c9de1fc800e7c8858e87fb37e271611ceeaae27ffeb96a83dac79fe5\": container with ID starting with e9b1a5a9c9de1fc800e7c8858e87fb37e271611ceeaae27ffeb96a83dac79fe5 not found: ID does not exist" Mar 16 17:40:20 crc kubenswrapper[5120]: I0316 17:40:20.584082 5120 scope.go:117] "RemoveContainer" containerID="c2279a1ac87de5badd54b84d68c5debc2a280f154acbc555c810daa9d034e033" Mar 16 17:40:20 crc kubenswrapper[5120]: I0316 17:40:20.602121 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ksbms\" (UniqueName: \"kubernetes.io/projected/f0ee03d7-2cda-48de-94bd-b0ab8c1794a4-kube-api-access-ksbms\") on node \"crc\" DevicePath \"\"" Mar 16 17:40:20 crc kubenswrapper[5120]: I0316 17:40:20.602613 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/infra-operator-index-gs4dw"] Mar 16 17:40:20 crc kubenswrapper[5120]: I0316 17:40:20.610271 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-operators/infra-operator-index-gs4dw"] Mar 16 17:40:20 crc kubenswrapper[5120]: I0316 17:40:20.614347 5120 scope.go:117] "RemoveContainer" containerID="c2279a1ac87de5badd54b84d68c5debc2a280f154acbc555c810daa9d034e033" Mar 16 17:40:20 crc kubenswrapper[5120]: E0316 17:40:20.616958 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c2279a1ac87de5badd54b84d68c5debc2a280f154acbc555c810daa9d034e033\": container with ID starting with c2279a1ac87de5badd54b84d68c5debc2a280f154acbc555c810daa9d034e033 not found: ID does not exist" containerID="c2279a1ac87de5badd54b84d68c5debc2a280f154acbc555c810daa9d034e033" Mar 16 17:40:20 crc kubenswrapper[5120]: I0316 17:40:20.617004 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2279a1ac87de5badd54b84d68c5debc2a280f154acbc555c810daa9d034e033"} err="failed to get container status \"c2279a1ac87de5badd54b84d68c5debc2a280f154acbc555c810daa9d034e033\": rpc error: code = NotFound desc = could not find container \"c2279a1ac87de5badd54b84d68c5debc2a280f154acbc555c810daa9d034e033\": container with ID starting with c2279a1ac87de5badd54b84d68c5debc2a280f154acbc555c810daa9d034e033 not found: ID does not exist" Mar 16 17:40:20 crc kubenswrapper[5120]: I0316 17:40:20.620008 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/mariadb-operator-controller-manager-8c6b767f7-fp79q"] Mar 16 17:40:20 crc kubenswrapper[5120]: I0316 17:40:20.626091 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-operators/mariadb-operator-controller-manager-8c6b767f7-fp79q"] Mar 16 17:40:20 crc kubenswrapper[5120]: I0316 17:40:20.630497 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/mariadb-operator-index-tj5ss"] Mar 16 17:40:20 crc kubenswrapper[5120]: I0316 17:40:20.634662 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-operators/mariadb-operator-index-tj5ss"] Mar 16 17:40:20 crc kubenswrapper[5120]: I0316 17:40:20.679159 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b997602-48d7-44cd-b3f0-6e0425c6221c" path="/var/lib/kubelet/pods/0b997602-48d7-44cd-b3f0-6e0425c6221c/volumes" Mar 16 17:40:20 crc kubenswrapper[5120]: I0316 17:40:20.679809 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="25d5385c-eea4-4f6f-91e5-edd0dcbf337e" path="/var/lib/kubelet/pods/25d5385c-eea4-4f6f-91e5-edd0dcbf337e/volumes" Mar 16 17:40:20 crc kubenswrapper[5120]: I0316 17:40:20.680468 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a2746e35-f4b1-4c30-9288-8e4e9dc669bd" path="/var/lib/kubelet/pods/a2746e35-f4b1-4c30-9288-8e4e9dc669bd/volumes" Mar 16 17:40:20 crc kubenswrapper[5120]: I0316 17:40:20.682381 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc18cff5-655d-4b7d-b8e9-473dcf200489" path="/var/lib/kubelet/pods/dc18cff5-655d-4b7d-b8e9-473dcf200489/volumes" Mar 16 17:40:20 crc kubenswrapper[5120]: I0316 17:40:20.682858 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e1a87a80-0dc7-4b13-938a-9b63c43df433" path="/var/lib/kubelet/pods/e1a87a80-0dc7-4b13-938a-9b63c43df433/volumes" Mar 16 17:40:20 crc kubenswrapper[5120]: I0316 17:40:20.683352 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f0ee03d7-2cda-48de-94bd-b0ab8c1794a4" path="/var/lib/kubelet/pods/f0ee03d7-2cda-48de-94bd-b0ab8c1794a4/volumes" Mar 16 17:40:22 crc kubenswrapper[5120]: I0316 17:40:22.007873 5120 patch_prober.go:28] interesting pod/machine-config-daemon-7bf76 container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 17:40:22 crc kubenswrapper[5120]: I0316 17:40:22.008247 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 17:40:22 crc kubenswrapper[5120]: I0316 17:40:22.008296 5120 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" Mar 16 17:40:22 crc kubenswrapper[5120]: I0316 17:40:22.008901 5120 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="machine-config-daemon" containerStatusID={"Type":"cri-o","ID":"7fd764dd19065c7ce437c63b05fda51970409dfa8dfd1c77e2158bb3e05b7723"} pod="openshift-machine-config-operator/machine-config-daemon-7bf76" containerMessage="Container machine-config-daemon failed liveness probe, will be restarted" Mar 16 17:40:22 crc kubenswrapper[5120]: I0316 17:40:22.008965 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" containerID="cri-o://7fd764dd19065c7ce437c63b05fda51970409dfa8dfd1c77e2158bb3e05b7723" gracePeriod=600 Mar 16 17:40:22 crc kubenswrapper[5120]: E0316 17:40:22.131127 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 17:40:22 crc kubenswrapper[5120]: I0316 17:40:22.590789 5120 generic.go:358] "Generic (PLEG): container finished" podID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerID="7fd764dd19065c7ce437c63b05fda51970409dfa8dfd1c77e2158bb3e05b7723" exitCode=0 Mar 16 17:40:22 crc kubenswrapper[5120]: I0316 17:40:22.590930 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" event={"ID":"e2275cb4-4905-4d66-a87e-8010120db2bd","Type":"ContainerDied","Data":"7fd764dd19065c7ce437c63b05fda51970409dfa8dfd1c77e2158bb3e05b7723"} Mar 16 17:40:22 crc kubenswrapper[5120]: I0316 17:40:22.591007 5120 scope.go:117] "RemoveContainer" containerID="7675132b6a0a3435abd421d258a035263883c4eae7ede1a7f47b92d2e04f90b7" Mar 16 17:40:22 crc kubenswrapper[5120]: I0316 17:40:22.591468 5120 scope.go:117] "RemoveContainer" containerID="7fd764dd19065c7ce437c63b05fda51970409dfa8dfd1c77e2158bb3e05b7723" Mar 16 17:40:22 crc kubenswrapper[5120]: E0316 17:40:22.591813 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 17:40:33 crc kubenswrapper[5120]: I0316 17:40:33.328907 5120 scope.go:117] "RemoveContainer" containerID="bbbc61f4cfac21dffa0e396eca660e866247eccac63f4b6bac12d7e504c58eef" Mar 16 17:40:37 crc kubenswrapper[5120]: I0316 17:40:37.663791 5120 scope.go:117] "RemoveContainer" containerID="7fd764dd19065c7ce437c63b05fda51970409dfa8dfd1c77e2158bb3e05b7723" Mar 16 17:40:37 crc kubenswrapper[5120]: E0316 17:40:37.664655 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 17:40:50 crc kubenswrapper[5120]: I0316 17:40:50.671617 5120 scope.go:117] "RemoveContainer" containerID="7fd764dd19065c7ce437c63b05fda51970409dfa8dfd1c77e2158bb3e05b7723" Mar 16 17:40:50 crc kubenswrapper[5120]: E0316 17:40:50.672312 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 17:41:04 crc kubenswrapper[5120]: I0316 17:41:04.664146 5120 scope.go:117] "RemoveContainer" containerID="7fd764dd19065c7ce437c63b05fda51970409dfa8dfd1c77e2158bb3e05b7723" Mar 16 17:41:04 crc kubenswrapper[5120]: E0316 17:41:04.664856 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 17:41:07 crc kubenswrapper[5120]: E0316 17:41:07.352254 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=850106 actualBytes=10240 Mar 16 17:41:14 crc kubenswrapper[5120]: I0316 17:41:14.131971 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-operators/mariadb-operator-index-nt4dd"] Mar 16 17:41:14 crc kubenswrapper[5120]: I0316 17:41:14.133243 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1a87a80-0dc7-4b13-938a-9b63c43df433" containerName="manager" Mar 16 17:41:14 crc kubenswrapper[5120]: I0316 17:41:14.133258 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1a87a80-0dc7-4b13-938a-9b63c43df433" containerName="manager" Mar 16 17:41:14 crc kubenswrapper[5120]: I0316 17:41:14.133273 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5068ab90-b1e6-427e-9a8b-e77bbc0ffe1f" containerName="manager" Mar 16 17:41:14 crc kubenswrapper[5120]: I0316 17:41:14.133278 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="5068ab90-b1e6-427e-9a8b-e77bbc0ffe1f" containerName="manager" Mar 16 17:41:14 crc kubenswrapper[5120]: I0316 17:41:14.133293 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ecba5863-ab91-4517-bc9b-553b7900ffc2" containerName="manager" Mar 16 17:41:14 crc kubenswrapper[5120]: I0316 17:41:14.133299 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ecba5863-ab91-4517-bc9b-553b7900ffc2" containerName="manager" Mar 16 17:41:14 crc kubenswrapper[5120]: I0316 17:41:14.133308 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28162b7c-56dd-481a-a0f8-dd4068ec5a59" containerName="registry-server" Mar 16 17:41:14 crc kubenswrapper[5120]: I0316 17:41:14.133315 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="28162b7c-56dd-481a-a0f8-dd4068ec5a59" containerName="registry-server" Mar 16 17:41:14 crc kubenswrapper[5120]: I0316 17:41:14.133326 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2dfcb27a-8b24-493a-b27f-74436a9105e0" containerName="galera" Mar 16 17:41:14 crc kubenswrapper[5120]: I0316 17:41:14.133331 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="2dfcb27a-8b24-493a-b27f-74436a9105e0" containerName="galera" Mar 16 17:41:14 crc kubenswrapper[5120]: I0316 17:41:14.133341 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="017f781f-d93d-4b6b-9d7e-966c513348bc" containerName="registry-server" Mar 16 17:41:14 crc kubenswrapper[5120]: I0316 17:41:14.133346 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="017f781f-d93d-4b6b-9d7e-966c513348bc" containerName="registry-server" Mar 16 17:41:14 crc kubenswrapper[5120]: I0316 17:41:14.133354 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2432965-72a9-4f38-a930-85969dfa64d6" containerName="mysql-bootstrap" Mar 16 17:41:14 crc kubenswrapper[5120]: I0316 17:41:14.133359 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2432965-72a9-4f38-a930-85969dfa64d6" containerName="mysql-bootstrap" Mar 16 17:41:14 crc kubenswrapper[5120]: I0316 17:41:14.133364 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bbe1e943-d345-4e78-a91c-de129e2b82ea" containerName="keystone-api" Mar 16 17:41:14 crc kubenswrapper[5120]: I0316 17:41:14.133370 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="bbe1e943-d345-4e78-a91c-de129e2b82ea" containerName="keystone-api" Mar 16 17:41:14 crc kubenswrapper[5120]: I0316 17:41:14.133380 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5ccdf19-64ed-4e83-b87f-d8623f7cd27e" containerName="registry-server" Mar 16 17:41:14 crc kubenswrapper[5120]: I0316 17:41:14.133385 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5ccdf19-64ed-4e83-b87f-d8623f7cd27e" containerName="registry-server" Mar 16 17:41:14 crc kubenswrapper[5120]: I0316 17:41:14.133398 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2746e35-f4b1-4c30-9288-8e4e9dc669bd" containerName="manager" Mar 16 17:41:14 crc kubenswrapper[5120]: I0316 17:41:14.133403 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2746e35-f4b1-4c30-9288-8e4e9dc669bd" containerName="manager" Mar 16 17:41:14 crc kubenswrapper[5120]: I0316 17:41:14.133412 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05269e3d-2dcd-4828-8142-7399752715b3" containerName="mysql-bootstrap" Mar 16 17:41:14 crc kubenswrapper[5120]: I0316 17:41:14.133417 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="05269e3d-2dcd-4828-8142-7399752715b3" containerName="mysql-bootstrap" Mar 16 17:41:14 crc kubenswrapper[5120]: I0316 17:41:14.133425 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="459c983d-9938-4660-a965-31585832f250" containerName="setup-container" Mar 16 17:41:14 crc kubenswrapper[5120]: I0316 17:41:14.133431 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="459c983d-9938-4660-a965-31585832f250" containerName="setup-container" Mar 16 17:41:14 crc kubenswrapper[5120]: I0316 17:41:14.133446 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="459c983d-9938-4660-a965-31585832f250" containerName="rabbitmq" Mar 16 17:41:14 crc kubenswrapper[5120]: I0316 17:41:14.133451 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="459c983d-9938-4660-a965-31585832f250" containerName="rabbitmq" Mar 16 17:41:14 crc kubenswrapper[5120]: I0316 17:41:14.133460 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0ee03d7-2cda-48de-94bd-b0ab8c1794a4" containerName="registry-server" Mar 16 17:41:14 crc kubenswrapper[5120]: I0316 17:41:14.133465 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0ee03d7-2cda-48de-94bd-b0ab8c1794a4" containerName="registry-server" Mar 16 17:41:14 crc kubenswrapper[5120]: I0316 17:41:14.133472 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb9e9af1-7275-4426-aa22-16b916aada88" containerName="mariadb-account-delete" Mar 16 17:41:14 crc kubenswrapper[5120]: I0316 17:41:14.133477 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb9e9af1-7275-4426-aa22-16b916aada88" containerName="mariadb-account-delete" Mar 16 17:41:14 crc kubenswrapper[5120]: I0316 17:41:14.133484 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2dfcb27a-8b24-493a-b27f-74436a9105e0" containerName="mysql-bootstrap" Mar 16 17:41:14 crc kubenswrapper[5120]: I0316 17:41:14.133491 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="2dfcb27a-8b24-493a-b27f-74436a9105e0" containerName="mysql-bootstrap" Mar 16 17:41:14 crc kubenswrapper[5120]: I0316 17:41:14.133498 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2432965-72a9-4f38-a930-85969dfa64d6" containerName="galera" Mar 16 17:41:14 crc kubenswrapper[5120]: I0316 17:41:14.133504 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2432965-72a9-4f38-a930-85969dfa64d6" containerName="galera" Mar 16 17:41:14 crc kubenswrapper[5120]: I0316 17:41:14.133510 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05269e3d-2dcd-4828-8142-7399752715b3" containerName="galera" Mar 16 17:41:14 crc kubenswrapper[5120]: I0316 17:41:14.133515 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="05269e3d-2dcd-4828-8142-7399752715b3" containerName="galera" Mar 16 17:41:14 crc kubenswrapper[5120]: I0316 17:41:14.133523 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b2e5d7a-5b39-424d-9eaa-dcace83ebf72" containerName="memcached" Mar 16 17:41:14 crc kubenswrapper[5120]: I0316 17:41:14.133528 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b2e5d7a-5b39-424d-9eaa-dcace83ebf72" containerName="memcached" Mar 16 17:41:14 crc kubenswrapper[5120]: I0316 17:41:14.133535 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc18cff5-655d-4b7d-b8e9-473dcf200489" containerName="registry-server" Mar 16 17:41:14 crc kubenswrapper[5120]: I0316 17:41:14.133539 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc18cff5-655d-4b7d-b8e9-473dcf200489" containerName="registry-server" Mar 16 17:41:14 crc kubenswrapper[5120]: I0316 17:41:14.133549 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb9e9af1-7275-4426-aa22-16b916aada88" containerName="mariadb-account-delete" Mar 16 17:41:14 crc kubenswrapper[5120]: I0316 17:41:14.133556 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb9e9af1-7275-4426-aa22-16b916aada88" containerName="mariadb-account-delete" Mar 16 17:41:14 crc kubenswrapper[5120]: I0316 17:41:14.133562 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a70a89a-dbe2-4a18-9c72-10a183001eb4" containerName="operator" Mar 16 17:41:14 crc kubenswrapper[5120]: I0316 17:41:14.133567 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a70a89a-dbe2-4a18-9c72-10a183001eb4" containerName="operator" Mar 16 17:41:14 crc kubenswrapper[5120]: I0316 17:41:14.133687 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="a5ccdf19-64ed-4e83-b87f-d8623f7cd27e" containerName="registry-server" Mar 16 17:41:14 crc kubenswrapper[5120]: I0316 17:41:14.133695 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c2432965-72a9-4f38-a930-85969dfa64d6" containerName="galera" Mar 16 17:41:14 crc kubenswrapper[5120]: I0316 17:41:14.133706 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="a2746e35-f4b1-4c30-9288-8e4e9dc669bd" containerName="manager" Mar 16 17:41:14 crc kubenswrapper[5120]: I0316 17:41:14.133714 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="cb9e9af1-7275-4426-aa22-16b916aada88" containerName="mariadb-account-delete" Mar 16 17:41:14 crc kubenswrapper[5120]: I0316 17:41:14.133723 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="cb9e9af1-7275-4426-aa22-16b916aada88" containerName="mariadb-account-delete" Mar 16 17:41:14 crc kubenswrapper[5120]: I0316 17:41:14.133733 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="2dfcb27a-8b24-493a-b27f-74436a9105e0" containerName="galera" Mar 16 17:41:14 crc kubenswrapper[5120]: I0316 17:41:14.133741 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="05269e3d-2dcd-4828-8142-7399752715b3" containerName="galera" Mar 16 17:41:14 crc kubenswrapper[5120]: I0316 17:41:14.133748 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ecba5863-ab91-4517-bc9b-553b7900ffc2" containerName="manager" Mar 16 17:41:14 crc kubenswrapper[5120]: I0316 17:41:14.133756 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="bbe1e943-d345-4e78-a91c-de129e2b82ea" containerName="keystone-api" Mar 16 17:41:14 crc kubenswrapper[5120]: I0316 17:41:14.133812 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="28162b7c-56dd-481a-a0f8-dd4068ec5a59" containerName="registry-server" Mar 16 17:41:14 crc kubenswrapper[5120]: I0316 17:41:14.133820 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="017f781f-d93d-4b6b-9d7e-966c513348bc" containerName="registry-server" Mar 16 17:41:14 crc kubenswrapper[5120]: I0316 17:41:14.133831 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f0ee03d7-2cda-48de-94bd-b0ab8c1794a4" containerName="registry-server" Mar 16 17:41:14 crc kubenswrapper[5120]: I0316 17:41:14.133839 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="dc18cff5-655d-4b7d-b8e9-473dcf200489" containerName="registry-server" Mar 16 17:41:14 crc kubenswrapper[5120]: I0316 17:41:14.133849 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="9b2e5d7a-5b39-424d-9eaa-dcace83ebf72" containerName="memcached" Mar 16 17:41:14 crc kubenswrapper[5120]: I0316 17:41:14.133857 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e1a87a80-0dc7-4b13-938a-9b63c43df433" containerName="manager" Mar 16 17:41:14 crc kubenswrapper[5120]: I0316 17:41:14.133868 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="459c983d-9938-4660-a965-31585832f250" containerName="rabbitmq" Mar 16 17:41:14 crc kubenswrapper[5120]: I0316 17:41:14.133881 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="5068ab90-b1e6-427e-9a8b-e77bbc0ffe1f" containerName="manager" Mar 16 17:41:14 crc kubenswrapper[5120]: I0316 17:41:14.133892 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="4a70a89a-dbe2-4a18-9c72-10a183001eb4" containerName="operator" Mar 16 17:41:14 crc kubenswrapper[5120]: I0316 17:41:14.141372 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/mariadb-operator-index-nt4dd" Mar 16 17:41:14 crc kubenswrapper[5120]: I0316 17:41:14.142571 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/mariadb-operator-index-nt4dd"] Mar 16 17:41:14 crc kubenswrapper[5120]: I0316 17:41:14.143668 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-operators\"/\"mariadb-operator-index-dockercfg-c9llp\"" Mar 16 17:41:14 crc kubenswrapper[5120]: I0316 17:41:14.144185 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-operators\"/\"kube-root-ca.crt\"" Mar 16 17:41:14 crc kubenswrapper[5120]: I0316 17:41:14.144887 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-operators\"/\"openshift-service-ca.crt\"" Mar 16 17:41:14 crc kubenswrapper[5120]: I0316 17:41:14.310536 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7g9r5\" (UniqueName: \"kubernetes.io/projected/02d8fd52-9ade-4dcf-ab86-8a365abd1c96-kube-api-access-7g9r5\") pod \"mariadb-operator-index-nt4dd\" (UID: \"02d8fd52-9ade-4dcf-ab86-8a365abd1c96\") " pod="openstack-operators/mariadb-operator-index-nt4dd" Mar 16 17:41:14 crc kubenswrapper[5120]: I0316 17:41:14.413260 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7g9r5\" (UniqueName: \"kubernetes.io/projected/02d8fd52-9ade-4dcf-ab86-8a365abd1c96-kube-api-access-7g9r5\") pod \"mariadb-operator-index-nt4dd\" (UID: \"02d8fd52-9ade-4dcf-ab86-8a365abd1c96\") " pod="openstack-operators/mariadb-operator-index-nt4dd" Mar 16 17:41:14 crc kubenswrapper[5120]: I0316 17:41:14.433334 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7g9r5\" (UniqueName: \"kubernetes.io/projected/02d8fd52-9ade-4dcf-ab86-8a365abd1c96-kube-api-access-7g9r5\") pod \"mariadb-operator-index-nt4dd\" (UID: \"02d8fd52-9ade-4dcf-ab86-8a365abd1c96\") " pod="openstack-operators/mariadb-operator-index-nt4dd" Mar 16 17:41:14 crc kubenswrapper[5120]: I0316 17:41:14.460862 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/mariadb-operator-index-nt4dd" Mar 16 17:41:14 crc kubenswrapper[5120]: I0316 17:41:14.503890 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/mariadb-operator-index-nt4dd"] Mar 16 17:41:14 crc kubenswrapper[5120]: I0316 17:41:14.716123 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-operators/mariadb-operator-index-wfr2p"] Mar 16 17:41:14 crc kubenswrapper[5120]: I0316 17:41:14.724251 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/mariadb-operator-index-wfr2p"] Mar 16 17:41:14 crc kubenswrapper[5120]: I0316 17:41:14.724452 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/mariadb-operator-index-wfr2p" Mar 16 17:41:14 crc kubenswrapper[5120]: I0316 17:41:14.820934 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24pxf\" (UniqueName: \"kubernetes.io/projected/33bebaaa-0edc-42f1-98ff-9a2cc108b7f2-kube-api-access-24pxf\") pod \"mariadb-operator-index-wfr2p\" (UID: \"33bebaaa-0edc-42f1-98ff-9a2cc108b7f2\") " pod="openstack-operators/mariadb-operator-index-wfr2p" Mar 16 17:41:14 crc kubenswrapper[5120]: I0316 17:41:14.903600 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/mariadb-operator-index-nt4dd"] Mar 16 17:41:14 crc kubenswrapper[5120]: I0316 17:41:14.923508 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-24pxf\" (UniqueName: \"kubernetes.io/projected/33bebaaa-0edc-42f1-98ff-9a2cc108b7f2-kube-api-access-24pxf\") pod \"mariadb-operator-index-wfr2p\" (UID: \"33bebaaa-0edc-42f1-98ff-9a2cc108b7f2\") " pod="openstack-operators/mariadb-operator-index-wfr2p" Mar 16 17:41:14 crc kubenswrapper[5120]: I0316 17:41:14.940698 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-24pxf\" (UniqueName: \"kubernetes.io/projected/33bebaaa-0edc-42f1-98ff-9a2cc108b7f2-kube-api-access-24pxf\") pod \"mariadb-operator-index-wfr2p\" (UID: \"33bebaaa-0edc-42f1-98ff-9a2cc108b7f2\") " pod="openstack-operators/mariadb-operator-index-wfr2p" Mar 16 17:41:14 crc kubenswrapper[5120]: I0316 17:41:14.989396 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/mariadb-operator-index-nt4dd" event={"ID":"02d8fd52-9ade-4dcf-ab86-8a365abd1c96","Type":"ContainerStarted","Data":"f87a39421840a96413c7376425e2c1ecd55ca6226ee7cb41cd0d6d4926f30ac6"} Mar 16 17:41:15 crc kubenswrapper[5120]: I0316 17:41:15.045722 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/mariadb-operator-index-wfr2p" Mar 16 17:41:15 crc kubenswrapper[5120]: I0316 17:41:15.268854 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/mariadb-operator-index-wfr2p"] Mar 16 17:41:15 crc kubenswrapper[5120]: W0316 17:41:15.271496 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33bebaaa_0edc_42f1_98ff_9a2cc108b7f2.slice/crio-59078d0dd6b9b43dd9390648cd2b9c973a41e0819819b41bee60f6c9466aa18e WatchSource:0}: Error finding container 59078d0dd6b9b43dd9390648cd2b9c973a41e0819819b41bee60f6c9466aa18e: Status 404 returned error can't find the container with id 59078d0dd6b9b43dd9390648cd2b9c973a41e0819819b41bee60f6c9466aa18e Mar 16 17:41:15 crc kubenswrapper[5120]: I0316 17:41:15.998900 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/mariadb-operator-index-wfr2p" event={"ID":"33bebaaa-0edc-42f1-98ff-9a2cc108b7f2","Type":"ContainerStarted","Data":"1aa92757f9e2609ac96eabfcaac50a13046bee9512f910e9773776e6f265d152"} Mar 16 17:41:15 crc kubenswrapper[5120]: I0316 17:41:15.999284 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/mariadb-operator-index-wfr2p" event={"ID":"33bebaaa-0edc-42f1-98ff-9a2cc108b7f2","Type":"ContainerStarted","Data":"59078d0dd6b9b43dd9390648cd2b9c973a41e0819819b41bee60f6c9466aa18e"} Mar 16 17:41:16 crc kubenswrapper[5120]: I0316 17:41:16.002271 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/mariadb-operator-index-nt4dd" event={"ID":"02d8fd52-9ade-4dcf-ab86-8a365abd1c96","Type":"ContainerStarted","Data":"9f979d375de52be6161db21ba0c5b63683f26c80832ebd0af0d3320a32a88286"} Mar 16 17:41:16 crc kubenswrapper[5120]: I0316 17:41:16.002339 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-operators/mariadb-operator-index-nt4dd" podUID="02d8fd52-9ade-4dcf-ab86-8a365abd1c96" containerName="registry-server" containerID="cri-o://9f979d375de52be6161db21ba0c5b63683f26c80832ebd0af0d3320a32a88286" gracePeriod=2 Mar 16 17:41:16 crc kubenswrapper[5120]: I0316 17:41:16.020622 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/mariadb-operator-index-wfr2p" podStartSLOduration=1.617119398 podStartE2EDuration="2.020601408s" podCreationTimestamp="2026-03-16 17:41:14 +0000 UTC" firstStartedPulling="2026-03-16 17:41:15.273168356 +0000 UTC m=+7777.427100013" lastFinishedPulling="2026-03-16 17:41:15.676650366 +0000 UTC m=+7777.830582023" observedRunningTime="2026-03-16 17:41:16.014108492 +0000 UTC m=+7778.168040149" watchObservedRunningTime="2026-03-16 17:41:16.020601408 +0000 UTC m=+7778.174533065" Mar 16 17:41:16 crc kubenswrapper[5120]: I0316 17:41:16.033361 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/mariadb-operator-index-nt4dd" podStartSLOduration=1.585239488 podStartE2EDuration="2.033344446s" podCreationTimestamp="2026-03-16 17:41:14 +0000 UTC" firstStartedPulling="2026-03-16 17:41:14.910506901 +0000 UTC m=+7777.064438568" lastFinishedPulling="2026-03-16 17:41:15.358611859 +0000 UTC m=+7777.512543526" observedRunningTime="2026-03-16 17:41:16.030289973 +0000 UTC m=+7778.184221630" watchObservedRunningTime="2026-03-16 17:41:16.033344446 +0000 UTC m=+7778.187276103" Mar 16 17:41:16 crc kubenswrapper[5120]: I0316 17:41:16.356669 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/mariadb-operator-index-nt4dd" Mar 16 17:41:16 crc kubenswrapper[5120]: I0316 17:41:16.461275 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7g9r5\" (UniqueName: \"kubernetes.io/projected/02d8fd52-9ade-4dcf-ab86-8a365abd1c96-kube-api-access-7g9r5\") pod \"02d8fd52-9ade-4dcf-ab86-8a365abd1c96\" (UID: \"02d8fd52-9ade-4dcf-ab86-8a365abd1c96\") " Mar 16 17:41:16 crc kubenswrapper[5120]: I0316 17:41:16.467379 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02d8fd52-9ade-4dcf-ab86-8a365abd1c96-kube-api-access-7g9r5" (OuterVolumeSpecName: "kube-api-access-7g9r5") pod "02d8fd52-9ade-4dcf-ab86-8a365abd1c96" (UID: "02d8fd52-9ade-4dcf-ab86-8a365abd1c96"). InnerVolumeSpecName "kube-api-access-7g9r5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:41:16 crc kubenswrapper[5120]: I0316 17:41:16.563362 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7g9r5\" (UniqueName: \"kubernetes.io/projected/02d8fd52-9ade-4dcf-ab86-8a365abd1c96-kube-api-access-7g9r5\") on node \"crc\" DevicePath \"\"" Mar 16 17:41:16 crc kubenswrapper[5120]: I0316 17:41:16.664917 5120 scope.go:117] "RemoveContainer" containerID="7fd764dd19065c7ce437c63b05fda51970409dfa8dfd1c77e2158bb3e05b7723" Mar 16 17:41:16 crc kubenswrapper[5120]: E0316 17:41:16.665276 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 17:41:17 crc kubenswrapper[5120]: I0316 17:41:17.010729 5120 generic.go:358] "Generic (PLEG): container finished" podID="02d8fd52-9ade-4dcf-ab86-8a365abd1c96" containerID="9f979d375de52be6161db21ba0c5b63683f26c80832ebd0af0d3320a32a88286" exitCode=0 Mar 16 17:41:17 crc kubenswrapper[5120]: I0316 17:41:17.010826 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/mariadb-operator-index-nt4dd" event={"ID":"02d8fd52-9ade-4dcf-ab86-8a365abd1c96","Type":"ContainerDied","Data":"9f979d375de52be6161db21ba0c5b63683f26c80832ebd0af0d3320a32a88286"} Mar 16 17:41:17 crc kubenswrapper[5120]: I0316 17:41:17.010877 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/mariadb-operator-index-nt4dd" event={"ID":"02d8fd52-9ade-4dcf-ab86-8a365abd1c96","Type":"ContainerDied","Data":"f87a39421840a96413c7376425e2c1ecd55ca6226ee7cb41cd0d6d4926f30ac6"} Mar 16 17:41:17 crc kubenswrapper[5120]: I0316 17:41:17.010902 5120 scope.go:117] "RemoveContainer" containerID="9f979d375de52be6161db21ba0c5b63683f26c80832ebd0af0d3320a32a88286" Mar 16 17:41:17 crc kubenswrapper[5120]: I0316 17:41:17.010835 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/mariadb-operator-index-nt4dd" Mar 16 17:41:17 crc kubenswrapper[5120]: I0316 17:41:17.031857 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/mariadb-operator-index-nt4dd"] Mar 16 17:41:17 crc kubenswrapper[5120]: I0316 17:41:17.035327 5120 scope.go:117] "RemoveContainer" containerID="9f979d375de52be6161db21ba0c5b63683f26c80832ebd0af0d3320a32a88286" Mar 16 17:41:17 crc kubenswrapper[5120]: E0316 17:41:17.036454 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f979d375de52be6161db21ba0c5b63683f26c80832ebd0af0d3320a32a88286\": container with ID starting with 9f979d375de52be6161db21ba0c5b63683f26c80832ebd0af0d3320a32a88286 not found: ID does not exist" containerID="9f979d375de52be6161db21ba0c5b63683f26c80832ebd0af0d3320a32a88286" Mar 16 17:41:17 crc kubenswrapper[5120]: I0316 17:41:17.036520 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f979d375de52be6161db21ba0c5b63683f26c80832ebd0af0d3320a32a88286"} err="failed to get container status \"9f979d375de52be6161db21ba0c5b63683f26c80832ebd0af0d3320a32a88286\": rpc error: code = NotFound desc = could not find container \"9f979d375de52be6161db21ba0c5b63683f26c80832ebd0af0d3320a32a88286\": container with ID starting with 9f979d375de52be6161db21ba0c5b63683f26c80832ebd0af0d3320a32a88286 not found: ID does not exist" Mar 16 17:41:17 crc kubenswrapper[5120]: I0316 17:41:17.037648 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-operators/mariadb-operator-index-nt4dd"] Mar 16 17:41:18 crc kubenswrapper[5120]: I0316 17:41:18.673344 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="02d8fd52-9ade-4dcf-ab86-8a365abd1c96" path="/var/lib/kubelet/pods/02d8fd52-9ade-4dcf-ab86-8a365abd1c96/volumes" Mar 16 17:41:20 crc kubenswrapper[5120]: I0316 17:41:20.739703 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-operators/1b4ccfde3488142cc254fb313062ed88e2d18a60b7907f7b7c6ca34028xbj2q"] Mar 16 17:41:20 crc kubenswrapper[5120]: I0316 17:41:20.741433 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02d8fd52-9ade-4dcf-ab86-8a365abd1c96" containerName="registry-server" Mar 16 17:41:20 crc kubenswrapper[5120]: I0316 17:41:20.741536 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="02d8fd52-9ade-4dcf-ab86-8a365abd1c96" containerName="registry-server" Mar 16 17:41:20 crc kubenswrapper[5120]: I0316 17:41:20.741708 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="02d8fd52-9ade-4dcf-ab86-8a365abd1c96" containerName="registry-server" Mar 16 17:41:20 crc kubenswrapper[5120]: I0316 17:41:20.748234 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/1b4ccfde3488142cc254fb313062ed88e2d18a60b7907f7b7c6ca34028xbj2q" Mar 16 17:41:20 crc kubenswrapper[5120]: I0316 17:41:20.751314 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/1b4ccfde3488142cc254fb313062ed88e2d18a60b7907f7b7c6ca34028xbj2q"] Mar 16 17:41:20 crc kubenswrapper[5120]: I0316 17:41:20.753821 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-operators\"/\"default-dockercfg-rmzsx\"" Mar 16 17:41:20 crc kubenswrapper[5120]: I0316 17:41:20.847347 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/165d4d35-b678-40d9-b22c-af2816b5a2ec-bundle\") pod \"1b4ccfde3488142cc254fb313062ed88e2d18a60b7907f7b7c6ca34028xbj2q\" (UID: \"165d4d35-b678-40d9-b22c-af2816b5a2ec\") " pod="openstack-operators/1b4ccfde3488142cc254fb313062ed88e2d18a60b7907f7b7c6ca34028xbj2q" Mar 16 17:41:20 crc kubenswrapper[5120]: I0316 17:41:20.847424 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bt4ql\" (UniqueName: \"kubernetes.io/projected/165d4d35-b678-40d9-b22c-af2816b5a2ec-kube-api-access-bt4ql\") pod \"1b4ccfde3488142cc254fb313062ed88e2d18a60b7907f7b7c6ca34028xbj2q\" (UID: \"165d4d35-b678-40d9-b22c-af2816b5a2ec\") " pod="openstack-operators/1b4ccfde3488142cc254fb313062ed88e2d18a60b7907f7b7c6ca34028xbj2q" Mar 16 17:41:20 crc kubenswrapper[5120]: I0316 17:41:20.847630 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/165d4d35-b678-40d9-b22c-af2816b5a2ec-util\") pod \"1b4ccfde3488142cc254fb313062ed88e2d18a60b7907f7b7c6ca34028xbj2q\" (UID: \"165d4d35-b678-40d9-b22c-af2816b5a2ec\") " pod="openstack-operators/1b4ccfde3488142cc254fb313062ed88e2d18a60b7907f7b7c6ca34028xbj2q" Mar 16 17:41:20 crc kubenswrapper[5120]: I0316 17:41:20.949682 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/165d4d35-b678-40d9-b22c-af2816b5a2ec-bundle\") pod \"1b4ccfde3488142cc254fb313062ed88e2d18a60b7907f7b7c6ca34028xbj2q\" (UID: \"165d4d35-b678-40d9-b22c-af2816b5a2ec\") " pod="openstack-operators/1b4ccfde3488142cc254fb313062ed88e2d18a60b7907f7b7c6ca34028xbj2q" Mar 16 17:41:20 crc kubenswrapper[5120]: I0316 17:41:20.950136 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bt4ql\" (UniqueName: \"kubernetes.io/projected/165d4d35-b678-40d9-b22c-af2816b5a2ec-kube-api-access-bt4ql\") pod \"1b4ccfde3488142cc254fb313062ed88e2d18a60b7907f7b7c6ca34028xbj2q\" (UID: \"165d4d35-b678-40d9-b22c-af2816b5a2ec\") " pod="openstack-operators/1b4ccfde3488142cc254fb313062ed88e2d18a60b7907f7b7c6ca34028xbj2q" Mar 16 17:41:20 crc kubenswrapper[5120]: I0316 17:41:20.950209 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/165d4d35-b678-40d9-b22c-af2816b5a2ec-bundle\") pod \"1b4ccfde3488142cc254fb313062ed88e2d18a60b7907f7b7c6ca34028xbj2q\" (UID: \"165d4d35-b678-40d9-b22c-af2816b5a2ec\") " pod="openstack-operators/1b4ccfde3488142cc254fb313062ed88e2d18a60b7907f7b7c6ca34028xbj2q" Mar 16 17:41:20 crc kubenswrapper[5120]: I0316 17:41:20.950542 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/165d4d35-b678-40d9-b22c-af2816b5a2ec-util\") pod \"1b4ccfde3488142cc254fb313062ed88e2d18a60b7907f7b7c6ca34028xbj2q\" (UID: \"165d4d35-b678-40d9-b22c-af2816b5a2ec\") " pod="openstack-operators/1b4ccfde3488142cc254fb313062ed88e2d18a60b7907f7b7c6ca34028xbj2q" Mar 16 17:41:20 crc kubenswrapper[5120]: I0316 17:41:20.951034 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/165d4d35-b678-40d9-b22c-af2816b5a2ec-util\") pod \"1b4ccfde3488142cc254fb313062ed88e2d18a60b7907f7b7c6ca34028xbj2q\" (UID: \"165d4d35-b678-40d9-b22c-af2816b5a2ec\") " pod="openstack-operators/1b4ccfde3488142cc254fb313062ed88e2d18a60b7907f7b7c6ca34028xbj2q" Mar 16 17:41:20 crc kubenswrapper[5120]: I0316 17:41:20.973495 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bt4ql\" (UniqueName: \"kubernetes.io/projected/165d4d35-b678-40d9-b22c-af2816b5a2ec-kube-api-access-bt4ql\") pod \"1b4ccfde3488142cc254fb313062ed88e2d18a60b7907f7b7c6ca34028xbj2q\" (UID: \"165d4d35-b678-40d9-b22c-af2816b5a2ec\") " pod="openstack-operators/1b4ccfde3488142cc254fb313062ed88e2d18a60b7907f7b7c6ca34028xbj2q" Mar 16 17:41:21 crc kubenswrapper[5120]: I0316 17:41:21.066777 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/1b4ccfde3488142cc254fb313062ed88e2d18a60b7907f7b7c6ca34028xbj2q" Mar 16 17:41:21 crc kubenswrapper[5120]: I0316 17:41:21.268186 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/1b4ccfde3488142cc254fb313062ed88e2d18a60b7907f7b7c6ca34028xbj2q"] Mar 16 17:41:22 crc kubenswrapper[5120]: I0316 17:41:22.053462 5120 generic.go:358] "Generic (PLEG): container finished" podID="165d4d35-b678-40d9-b22c-af2816b5a2ec" containerID="301eeb97a6f042288fd7c2640f6907fbe137496777309a8b9b35fce6be05671a" exitCode=0 Mar 16 17:41:22 crc kubenswrapper[5120]: I0316 17:41:22.053593 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/1b4ccfde3488142cc254fb313062ed88e2d18a60b7907f7b7c6ca34028xbj2q" event={"ID":"165d4d35-b678-40d9-b22c-af2816b5a2ec","Type":"ContainerDied","Data":"301eeb97a6f042288fd7c2640f6907fbe137496777309a8b9b35fce6be05671a"} Mar 16 17:41:22 crc kubenswrapper[5120]: I0316 17:41:22.053651 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/1b4ccfde3488142cc254fb313062ed88e2d18a60b7907f7b7c6ca34028xbj2q" event={"ID":"165d4d35-b678-40d9-b22c-af2816b5a2ec","Type":"ContainerStarted","Data":"b97efe399f5bd35b302bc758b9ff3388bf505d4b372c1b4f47954d675c15cddb"} Mar 16 17:41:23 crc kubenswrapper[5120]: I0316 17:41:23.061747 5120 generic.go:358] "Generic (PLEG): container finished" podID="165d4d35-b678-40d9-b22c-af2816b5a2ec" containerID="b66adb9bbd7bcfd140b9766d7e17a0a0b55a050654128ab253318ac29629b538" exitCode=0 Mar 16 17:41:23 crc kubenswrapper[5120]: I0316 17:41:23.061859 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/1b4ccfde3488142cc254fb313062ed88e2d18a60b7907f7b7c6ca34028xbj2q" event={"ID":"165d4d35-b678-40d9-b22c-af2816b5a2ec","Type":"ContainerDied","Data":"b66adb9bbd7bcfd140b9766d7e17a0a0b55a050654128ab253318ac29629b538"} Mar 16 17:41:24 crc kubenswrapper[5120]: I0316 17:41:24.075201 5120 generic.go:358] "Generic (PLEG): container finished" podID="165d4d35-b678-40d9-b22c-af2816b5a2ec" containerID="140c1cf1a906275c981dc5ed36580cd3f64b7fbed2c1c73b83f46bbda6bc11cb" exitCode=0 Mar 16 17:41:24 crc kubenswrapper[5120]: I0316 17:41:24.075326 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/1b4ccfde3488142cc254fb313062ed88e2d18a60b7907f7b7c6ca34028xbj2q" event={"ID":"165d4d35-b678-40d9-b22c-af2816b5a2ec","Type":"ContainerDied","Data":"140c1cf1a906275c981dc5ed36580cd3f64b7fbed2c1c73b83f46bbda6bc11cb"} Mar 16 17:41:25 crc kubenswrapper[5120]: I0316 17:41:25.046901 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-operators/mariadb-operator-index-wfr2p" Mar 16 17:41:25 crc kubenswrapper[5120]: I0316 17:41:25.047471 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-operators/mariadb-operator-index-wfr2p" Mar 16 17:41:25 crc kubenswrapper[5120]: I0316 17:41:25.079684 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-operators/mariadb-operator-index-wfr2p" Mar 16 17:41:25 crc kubenswrapper[5120]: I0316 17:41:25.122378 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/mariadb-operator-index-wfr2p" Mar 16 17:41:25 crc kubenswrapper[5120]: I0316 17:41:25.371055 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/1b4ccfde3488142cc254fb313062ed88e2d18a60b7907f7b7c6ca34028xbj2q" Mar 16 17:41:25 crc kubenswrapper[5120]: I0316 17:41:25.444999 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/165d4d35-b678-40d9-b22c-af2816b5a2ec-bundle\") pod \"165d4d35-b678-40d9-b22c-af2816b5a2ec\" (UID: \"165d4d35-b678-40d9-b22c-af2816b5a2ec\") " Mar 16 17:41:25 crc kubenswrapper[5120]: I0316 17:41:25.445072 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/165d4d35-b678-40d9-b22c-af2816b5a2ec-util\") pod \"165d4d35-b678-40d9-b22c-af2816b5a2ec\" (UID: \"165d4d35-b678-40d9-b22c-af2816b5a2ec\") " Mar 16 17:41:25 crc kubenswrapper[5120]: I0316 17:41:25.445354 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bt4ql\" (UniqueName: \"kubernetes.io/projected/165d4d35-b678-40d9-b22c-af2816b5a2ec-kube-api-access-bt4ql\") pod \"165d4d35-b678-40d9-b22c-af2816b5a2ec\" (UID: \"165d4d35-b678-40d9-b22c-af2816b5a2ec\") " Mar 16 17:41:25 crc kubenswrapper[5120]: I0316 17:41:25.446056 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/165d4d35-b678-40d9-b22c-af2816b5a2ec-bundle" (OuterVolumeSpecName: "bundle") pod "165d4d35-b678-40d9-b22c-af2816b5a2ec" (UID: "165d4d35-b678-40d9-b22c-af2816b5a2ec"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:41:25 crc kubenswrapper[5120]: I0316 17:41:25.446452 5120 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/165d4d35-b678-40d9-b22c-af2816b5a2ec-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:41:25 crc kubenswrapper[5120]: I0316 17:41:25.451346 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/165d4d35-b678-40d9-b22c-af2816b5a2ec-kube-api-access-bt4ql" (OuterVolumeSpecName: "kube-api-access-bt4ql") pod "165d4d35-b678-40d9-b22c-af2816b5a2ec" (UID: "165d4d35-b678-40d9-b22c-af2816b5a2ec"). InnerVolumeSpecName "kube-api-access-bt4ql". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:41:25 crc kubenswrapper[5120]: I0316 17:41:25.487786 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/165d4d35-b678-40d9-b22c-af2816b5a2ec-util" (OuterVolumeSpecName: "util") pod "165d4d35-b678-40d9-b22c-af2816b5a2ec" (UID: "165d4d35-b678-40d9-b22c-af2816b5a2ec"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:41:25 crc kubenswrapper[5120]: I0316 17:41:25.548685 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bt4ql\" (UniqueName: \"kubernetes.io/projected/165d4d35-b678-40d9-b22c-af2816b5a2ec-kube-api-access-bt4ql\") on node \"crc\" DevicePath \"\"" Mar 16 17:41:25 crc kubenswrapper[5120]: I0316 17:41:25.548727 5120 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/165d4d35-b678-40d9-b22c-af2816b5a2ec-util\") on node \"crc\" DevicePath \"\"" Mar 16 17:41:26 crc kubenswrapper[5120]: I0316 17:41:26.093985 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/1b4ccfde3488142cc254fb313062ed88e2d18a60b7907f7b7c6ca34028xbj2q" Mar 16 17:41:26 crc kubenswrapper[5120]: I0316 17:41:26.094020 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/1b4ccfde3488142cc254fb313062ed88e2d18a60b7907f7b7c6ca34028xbj2q" event={"ID":"165d4d35-b678-40d9-b22c-af2816b5a2ec","Type":"ContainerDied","Data":"b97efe399f5bd35b302bc758b9ff3388bf505d4b372c1b4f47954d675c15cddb"} Mar 16 17:41:26 crc kubenswrapper[5120]: I0316 17:41:26.094063 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b97efe399f5bd35b302bc758b9ff3388bf505d4b372c1b4f47954d675c15cddb" Mar 16 17:41:27 crc kubenswrapper[5120]: I0316 17:41:27.663349 5120 scope.go:117] "RemoveContainer" containerID="7fd764dd19065c7ce437c63b05fda51970409dfa8dfd1c77e2158bb3e05b7723" Mar 16 17:41:27 crc kubenswrapper[5120]: E0316 17:41:27.664106 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 17:41:33 crc kubenswrapper[5120]: I0316 17:41:33.660054 5120 scope.go:117] "RemoveContainer" containerID="5aa0254ff32acc87fe8611cb2617571fc3497143a7170e777f3cd9a477f2d80f" Mar 16 17:41:33 crc kubenswrapper[5120]: I0316 17:41:33.682125 5120 scope.go:117] "RemoveContainer" containerID="ebf9cb0783ef13b02118e2895eec10fe0e918f2b11671020a6bb10edfc76ac0d" Mar 16 17:41:33 crc kubenswrapper[5120]: I0316 17:41:33.699169 5120 scope.go:117] "RemoveContainer" containerID="9df493f79ee66a4b81bf9859d01b5a1b08f72c0fc9dcd2ef080e5d83c5a97398" Mar 16 17:41:33 crc kubenswrapper[5120]: I0316 17:41:33.718867 5120 scope.go:117] "RemoveContainer" containerID="c706bf29c3e565b685f84f96ebe42906c655160b36904429dd884e37ce364397" Mar 16 17:41:36 crc kubenswrapper[5120]: I0316 17:41:36.146751 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-operators/mariadb-operator-controller-manager-bf5486b5c-mtrcb"] Mar 16 17:41:36 crc kubenswrapper[5120]: I0316 17:41:36.147731 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="165d4d35-b678-40d9-b22c-af2816b5a2ec" containerName="extract" Mar 16 17:41:36 crc kubenswrapper[5120]: I0316 17:41:36.147746 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="165d4d35-b678-40d9-b22c-af2816b5a2ec" containerName="extract" Mar 16 17:41:36 crc kubenswrapper[5120]: I0316 17:41:36.147754 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="165d4d35-b678-40d9-b22c-af2816b5a2ec" containerName="pull" Mar 16 17:41:36 crc kubenswrapper[5120]: I0316 17:41:36.147775 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="165d4d35-b678-40d9-b22c-af2816b5a2ec" containerName="pull" Mar 16 17:41:36 crc kubenswrapper[5120]: I0316 17:41:36.147793 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="165d4d35-b678-40d9-b22c-af2816b5a2ec" containerName="util" Mar 16 17:41:36 crc kubenswrapper[5120]: I0316 17:41:36.147801 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="165d4d35-b678-40d9-b22c-af2816b5a2ec" containerName="util" Mar 16 17:41:36 crc kubenswrapper[5120]: I0316 17:41:36.147900 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="165d4d35-b678-40d9-b22c-af2816b5a2ec" containerName="extract" Mar 16 17:41:36 crc kubenswrapper[5120]: I0316 17:41:36.157951 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/mariadb-operator-controller-manager-bf5486b5c-mtrcb" Mar 16 17:41:36 crc kubenswrapper[5120]: I0316 17:41:36.162069 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/mariadb-operator-controller-manager-bf5486b5c-mtrcb"] Mar 16 17:41:36 crc kubenswrapper[5120]: I0316 17:41:36.167063 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-operators\"/\"webhook-server-cert\"" Mar 16 17:41:36 crc kubenswrapper[5120]: I0316 17:41:36.167175 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-operators\"/\"mariadb-operator-controller-manager-dockercfg-cl5ql\"" Mar 16 17:41:36 crc kubenswrapper[5120]: I0316 17:41:36.167829 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-operators\"/\"mariadb-operator-controller-manager-service-cert\"" Mar 16 17:41:36 crc kubenswrapper[5120]: I0316 17:41:36.269586 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d20ab5f9-633e-4d27-a872-f7358080d68c-apiservice-cert\") pod \"mariadb-operator-controller-manager-bf5486b5c-mtrcb\" (UID: \"d20ab5f9-633e-4d27-a872-f7358080d68c\") " pod="openstack-operators/mariadb-operator-controller-manager-bf5486b5c-mtrcb" Mar 16 17:41:36 crc kubenswrapper[5120]: I0316 17:41:36.269740 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d20ab5f9-633e-4d27-a872-f7358080d68c-webhook-cert\") pod \"mariadb-operator-controller-manager-bf5486b5c-mtrcb\" (UID: \"d20ab5f9-633e-4d27-a872-f7358080d68c\") " pod="openstack-operators/mariadb-operator-controller-manager-bf5486b5c-mtrcb" Mar 16 17:41:36 crc kubenswrapper[5120]: I0316 17:41:36.269830 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2jm6\" (UniqueName: \"kubernetes.io/projected/d20ab5f9-633e-4d27-a872-f7358080d68c-kube-api-access-p2jm6\") pod \"mariadb-operator-controller-manager-bf5486b5c-mtrcb\" (UID: \"d20ab5f9-633e-4d27-a872-f7358080d68c\") " pod="openstack-operators/mariadb-operator-controller-manager-bf5486b5c-mtrcb" Mar 16 17:41:36 crc kubenswrapper[5120]: I0316 17:41:36.380262 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d20ab5f9-633e-4d27-a872-f7358080d68c-apiservice-cert\") pod \"mariadb-operator-controller-manager-bf5486b5c-mtrcb\" (UID: \"d20ab5f9-633e-4d27-a872-f7358080d68c\") " pod="openstack-operators/mariadb-operator-controller-manager-bf5486b5c-mtrcb" Mar 16 17:41:36 crc kubenswrapper[5120]: I0316 17:41:36.380440 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d20ab5f9-633e-4d27-a872-f7358080d68c-webhook-cert\") pod \"mariadb-operator-controller-manager-bf5486b5c-mtrcb\" (UID: \"d20ab5f9-633e-4d27-a872-f7358080d68c\") " pod="openstack-operators/mariadb-operator-controller-manager-bf5486b5c-mtrcb" Mar 16 17:41:36 crc kubenswrapper[5120]: I0316 17:41:36.380508 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p2jm6\" (UniqueName: \"kubernetes.io/projected/d20ab5f9-633e-4d27-a872-f7358080d68c-kube-api-access-p2jm6\") pod \"mariadb-operator-controller-manager-bf5486b5c-mtrcb\" (UID: \"d20ab5f9-633e-4d27-a872-f7358080d68c\") " pod="openstack-operators/mariadb-operator-controller-manager-bf5486b5c-mtrcb" Mar 16 17:41:36 crc kubenswrapper[5120]: I0316 17:41:36.397899 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d20ab5f9-633e-4d27-a872-f7358080d68c-webhook-cert\") pod \"mariadb-operator-controller-manager-bf5486b5c-mtrcb\" (UID: \"d20ab5f9-633e-4d27-a872-f7358080d68c\") " pod="openstack-operators/mariadb-operator-controller-manager-bf5486b5c-mtrcb" Mar 16 17:41:36 crc kubenswrapper[5120]: I0316 17:41:36.420217 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d20ab5f9-633e-4d27-a872-f7358080d68c-apiservice-cert\") pod \"mariadb-operator-controller-manager-bf5486b5c-mtrcb\" (UID: \"d20ab5f9-633e-4d27-a872-f7358080d68c\") " pod="openstack-operators/mariadb-operator-controller-manager-bf5486b5c-mtrcb" Mar 16 17:41:36 crc kubenswrapper[5120]: I0316 17:41:36.420268 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2jm6\" (UniqueName: \"kubernetes.io/projected/d20ab5f9-633e-4d27-a872-f7358080d68c-kube-api-access-p2jm6\") pod \"mariadb-operator-controller-manager-bf5486b5c-mtrcb\" (UID: \"d20ab5f9-633e-4d27-a872-f7358080d68c\") " pod="openstack-operators/mariadb-operator-controller-manager-bf5486b5c-mtrcb" Mar 16 17:41:36 crc kubenswrapper[5120]: I0316 17:41:36.480595 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/mariadb-operator-controller-manager-bf5486b5c-mtrcb" Mar 16 17:41:36 crc kubenswrapper[5120]: I0316 17:41:36.887220 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/mariadb-operator-controller-manager-bf5486b5c-mtrcb"] Mar 16 17:41:36 crc kubenswrapper[5120]: I0316 17:41:36.893055 5120 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Mar 16 17:41:37 crc kubenswrapper[5120]: I0316 17:41:37.178202 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/mariadb-operator-controller-manager-bf5486b5c-mtrcb" event={"ID":"d20ab5f9-633e-4d27-a872-f7358080d68c","Type":"ContainerStarted","Data":"7d12d0dd482e46788415b7dfe391528678baf2f937d1eb9a4784ef43592d9f4c"} Mar 16 17:41:37 crc kubenswrapper[5120]: I0316 17:41:37.178266 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-operators/mariadb-operator-controller-manager-bf5486b5c-mtrcb" Mar 16 17:41:37 crc kubenswrapper[5120]: I0316 17:41:37.178292 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/mariadb-operator-controller-manager-bf5486b5c-mtrcb" event={"ID":"d20ab5f9-633e-4d27-a872-f7358080d68c","Type":"ContainerStarted","Data":"986c3a21903b62edb417782120593e439fe4433e1dc07b63766a28ab2f7e421f"} Mar 16 17:41:37 crc kubenswrapper[5120]: I0316 17:41:37.193279 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/mariadb-operator-controller-manager-bf5486b5c-mtrcb" podStartSLOduration=1.1932606319999999 podStartE2EDuration="1.193260632s" podCreationTimestamp="2026-03-16 17:41:36 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:41:37.192259695 +0000 UTC m=+7799.346191352" watchObservedRunningTime="2026-03-16 17:41:37.193260632 +0000 UTC m=+7799.347192289" Mar 16 17:41:41 crc kubenswrapper[5120]: I0316 17:41:41.664267 5120 scope.go:117] "RemoveContainer" containerID="7fd764dd19065c7ce437c63b05fda51970409dfa8dfd1c77e2158bb3e05b7723" Mar 16 17:41:41 crc kubenswrapper[5120]: E0316 17:41:41.665061 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 17:41:47 crc kubenswrapper[5120]: I0316 17:41:47.810749 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-v822j_ac55471d-4e42-475f-a082-50f611571482/kube-multus/0.log" Mar 16 17:41:47 crc kubenswrapper[5120]: I0316 17:41:47.817841 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-crc_9f0bc7fcb0822a2c13eb2d22cd8c0641/kube-controller-manager/0.log" Mar 16 17:41:48 crc kubenswrapper[5120]: I0316 17:41:48.097459 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-v822j_ac55471d-4e42-475f-a082-50f611571482/kube-multus/0.log" Mar 16 17:41:48 crc kubenswrapper[5120]: I0316 17:41:48.104644 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-crc_9f0bc7fcb0822a2c13eb2d22cd8c0641/kube-controller-manager/0.log" Mar 16 17:41:48 crc kubenswrapper[5120]: I0316 17:41:48.193942 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/mariadb-operator-controller-manager-bf5486b5c-mtrcb" Mar 16 17:41:52 crc kubenswrapper[5120]: I0316 17:41:52.664521 5120 scope.go:117] "RemoveContainer" containerID="7fd764dd19065c7ce437c63b05fda51970409dfa8dfd1c77e2158bb3e05b7723" Mar 16 17:41:52 crc kubenswrapper[5120]: E0316 17:41:52.665496 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 17:41:57 crc kubenswrapper[5120]: I0316 17:41:57.421396 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-operators/infra-operator-index-4fgv7"] Mar 16 17:41:57 crc kubenswrapper[5120]: I0316 17:41:57.427872 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/infra-operator-index-4fgv7" Mar 16 17:41:57 crc kubenswrapper[5120]: I0316 17:41:57.430611 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-operators\"/\"infra-operator-index-dockercfg-hhqlz\"" Mar 16 17:41:57 crc kubenswrapper[5120]: I0316 17:41:57.436471 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/infra-operator-index-4fgv7"] Mar 16 17:41:57 crc kubenswrapper[5120]: I0316 17:41:57.487782 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keystone-kuttl-tests/openstack-galera-0"] Mar 16 17:41:57 crc kubenswrapper[5120]: I0316 17:41:57.496845 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/openstack-galera-0" Mar 16 17:41:57 crc kubenswrapper[5120]: I0316 17:41:57.500240 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keystone-kuttl-tests\"/\"openshift-service-ca.crt\"" Mar 16 17:41:57 crc kubenswrapper[5120]: I0316 17:41:57.500648 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keystone-kuttl-tests\"/\"galera-openstack-dockercfg-6jgvq\"" Mar 16 17:41:57 crc kubenswrapper[5120]: I0316 17:41:57.505726 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keystone-kuttl-tests\"/\"openstack-config-data\"" Mar 16 17:41:57 crc kubenswrapper[5120]: I0316 17:41:57.508599 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keystone-kuttl-tests\"/\"openstack-scripts\"" Mar 16 17:41:57 crc kubenswrapper[5120]: I0316 17:41:57.508953 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keystone-kuttl-tests\"/\"kube-root-ca.crt\"" Mar 16 17:41:57 crc kubenswrapper[5120]: I0316 17:41:57.515053 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/openstack-galera-0"] Mar 16 17:41:57 crc kubenswrapper[5120]: I0316 17:41:57.525169 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lq5lx\" (UniqueName: \"kubernetes.io/projected/7eb6cd40-6ec1-43fb-bf5d-a37d95741e38-kube-api-access-lq5lx\") pod \"infra-operator-index-4fgv7\" (UID: \"7eb6cd40-6ec1-43fb-bf5d-a37d95741e38\") " pod="openstack-operators/infra-operator-index-4fgv7" Mar 16 17:41:57 crc kubenswrapper[5120]: I0316 17:41:57.551190 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keystone-kuttl-tests/openstack-galera-2"] Mar 16 17:41:57 crc kubenswrapper[5120]: I0316 17:41:57.557980 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keystone-kuttl-tests/openstack-galera-1"] Mar 16 17:41:57 crc kubenswrapper[5120]: I0316 17:41:57.558318 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/openstack-galera-2" Mar 16 17:41:57 crc kubenswrapper[5120]: I0316 17:41:57.564700 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/openstack-galera-1"] Mar 16 17:41:57 crc kubenswrapper[5120]: I0316 17:41:57.564880 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/openstack-galera-1" Mar 16 17:41:57 crc kubenswrapper[5120]: I0316 17:41:57.567943 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/openstack-galera-2"] Mar 16 17:41:57 crc kubenswrapper[5120]: I0316 17:41:57.627120 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lq5lx\" (UniqueName: \"kubernetes.io/projected/7eb6cd40-6ec1-43fb-bf5d-a37d95741e38-kube-api-access-lq5lx\") pod \"infra-operator-index-4fgv7\" (UID: \"7eb6cd40-6ec1-43fb-bf5d-a37d95741e38\") " pod="openstack-operators/infra-operator-index-4fgv7" Mar 16 17:41:57 crc kubenswrapper[5120]: I0316 17:41:57.627231 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"openstack-galera-0\" (UID: \"43151632-8fd6-41c2-abf2-ff0055c1237f\") " pod="keystone-kuttl-tests/openstack-galera-0" Mar 16 17:41:57 crc kubenswrapper[5120]: I0316 17:41:57.627271 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twxnv\" (UniqueName: \"kubernetes.io/projected/43151632-8fd6-41c2-abf2-ff0055c1237f-kube-api-access-twxnv\") pod \"openstack-galera-0\" (UID: \"43151632-8fd6-41c2-abf2-ff0055c1237f\") " pod="keystone-kuttl-tests/openstack-galera-0" Mar 16 17:41:57 crc kubenswrapper[5120]: I0316 17:41:57.627309 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/43151632-8fd6-41c2-abf2-ff0055c1237f-config-data-generated\") pod \"openstack-galera-0\" (UID: \"43151632-8fd6-41c2-abf2-ff0055c1237f\") " pod="keystone-kuttl-tests/openstack-galera-0" Mar 16 17:41:57 crc kubenswrapper[5120]: I0316 17:41:57.627368 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/43151632-8fd6-41c2-abf2-ff0055c1237f-operator-scripts\") pod \"openstack-galera-0\" (UID: \"43151632-8fd6-41c2-abf2-ff0055c1237f\") " pod="keystone-kuttl-tests/openstack-galera-0" Mar 16 17:41:57 crc kubenswrapper[5120]: I0316 17:41:57.627545 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/43151632-8fd6-41c2-abf2-ff0055c1237f-kolla-config\") pod \"openstack-galera-0\" (UID: \"43151632-8fd6-41c2-abf2-ff0055c1237f\") " pod="keystone-kuttl-tests/openstack-galera-0" Mar 16 17:41:57 crc kubenswrapper[5120]: I0316 17:41:57.627615 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/43151632-8fd6-41c2-abf2-ff0055c1237f-config-data-default\") pod \"openstack-galera-0\" (UID: \"43151632-8fd6-41c2-abf2-ff0055c1237f\") " pod="keystone-kuttl-tests/openstack-galera-0" Mar 16 17:41:57 crc kubenswrapper[5120]: I0316 17:41:57.651023 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lq5lx\" (UniqueName: \"kubernetes.io/projected/7eb6cd40-6ec1-43fb-bf5d-a37d95741e38-kube-api-access-lq5lx\") pod \"infra-operator-index-4fgv7\" (UID: \"7eb6cd40-6ec1-43fb-bf5d-a37d95741e38\") " pod="openstack-operators/infra-operator-index-4fgv7" Mar 16 17:41:57 crc kubenswrapper[5120]: I0316 17:41:57.731700 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gr8j\" (UniqueName: \"kubernetes.io/projected/bef338fe-205b-4d75-98b6-5e25cdfd474f-kube-api-access-7gr8j\") pod \"openstack-galera-2\" (UID: \"bef338fe-205b-4d75-98b6-5e25cdfd474f\") " pod="keystone-kuttl-tests/openstack-galera-2" Mar 16 17:41:57 crc kubenswrapper[5120]: I0316 17:41:57.731855 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/bef338fe-205b-4d75-98b6-5e25cdfd474f-kolla-config\") pod \"openstack-galera-2\" (UID: \"bef338fe-205b-4d75-98b6-5e25cdfd474f\") " pod="keystone-kuttl-tests/openstack-galera-2" Mar 16 17:41:57 crc kubenswrapper[5120]: I0316 17:41:57.731925 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"openstack-galera-0\" (UID: \"43151632-8fd6-41c2-abf2-ff0055c1237f\") " pod="keystone-kuttl-tests/openstack-galera-0" Mar 16 17:41:57 crc kubenswrapper[5120]: I0316 17:41:57.731946 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/bef338fe-205b-4d75-98b6-5e25cdfd474f-config-data-generated\") pod \"openstack-galera-2\" (UID: \"bef338fe-205b-4d75-98b6-5e25cdfd474f\") " pod="keystone-kuttl-tests/openstack-galera-2" Mar 16 17:41:57 crc kubenswrapper[5120]: I0316 17:41:57.731965 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-twxnv\" (UniqueName: \"kubernetes.io/projected/43151632-8fd6-41c2-abf2-ff0055c1237f-kube-api-access-twxnv\") pod \"openstack-galera-0\" (UID: \"43151632-8fd6-41c2-abf2-ff0055c1237f\") " pod="keystone-kuttl-tests/openstack-galera-0" Mar 16 17:41:57 crc kubenswrapper[5120]: I0316 17:41:57.731983 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0bb8ef5b-cbc0-4c37-a1fb-a0d15204c5c9-operator-scripts\") pod \"openstack-galera-1\" (UID: \"0bb8ef5b-cbc0-4c37-a1fb-a0d15204c5c9\") " pod="keystone-kuttl-tests/openstack-galera-1" Mar 16 17:41:57 crc kubenswrapper[5120]: I0316 17:41:57.732006 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/43151632-8fd6-41c2-abf2-ff0055c1237f-config-data-generated\") pod \"openstack-galera-0\" (UID: \"43151632-8fd6-41c2-abf2-ff0055c1237f\") " pod="keystone-kuttl-tests/openstack-galera-0" Mar 16 17:41:57 crc kubenswrapper[5120]: I0316 17:41:57.732057 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/0bb8ef5b-cbc0-4c37-a1fb-a0d15204c5c9-kolla-config\") pod \"openstack-galera-1\" (UID: \"0bb8ef5b-cbc0-4c37-a1fb-a0d15204c5c9\") " pod="keystone-kuttl-tests/openstack-galera-1" Mar 16 17:41:57 crc kubenswrapper[5120]: I0316 17:41:57.732082 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/43151632-8fd6-41c2-abf2-ff0055c1237f-operator-scripts\") pod \"openstack-galera-0\" (UID: \"43151632-8fd6-41c2-abf2-ff0055c1237f\") " pod="keystone-kuttl-tests/openstack-galera-0" Mar 16 17:41:57 crc kubenswrapper[5120]: I0316 17:41:57.732122 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/43151632-8fd6-41c2-abf2-ff0055c1237f-kolla-config\") pod \"openstack-galera-0\" (UID: \"43151632-8fd6-41c2-abf2-ff0055c1237f\") " pod="keystone-kuttl-tests/openstack-galera-0" Mar 16 17:41:57 crc kubenswrapper[5120]: I0316 17:41:57.732140 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"openstack-galera-2\" (UID: \"bef338fe-205b-4d75-98b6-5e25cdfd474f\") " pod="keystone-kuttl-tests/openstack-galera-2" Mar 16 17:41:57 crc kubenswrapper[5120]: I0316 17:41:57.732193 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"openstack-galera-0\" (UID: \"43151632-8fd6-41c2-abf2-ff0055c1237f\") device mount path \"/mnt/openstack/pv03\"" pod="keystone-kuttl-tests/openstack-galera-0" Mar 16 17:41:57 crc kubenswrapper[5120]: I0316 17:41:57.732541 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/43151632-8fd6-41c2-abf2-ff0055c1237f-config-data-default\") pod \"openstack-galera-0\" (UID: \"43151632-8fd6-41c2-abf2-ff0055c1237f\") " pod="keystone-kuttl-tests/openstack-galera-0" Mar 16 17:41:57 crc kubenswrapper[5120]: I0316 17:41:57.732685 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/43151632-8fd6-41c2-abf2-ff0055c1237f-config-data-generated\") pod \"openstack-galera-0\" (UID: \"43151632-8fd6-41c2-abf2-ff0055c1237f\") " pod="keystone-kuttl-tests/openstack-galera-0" Mar 16 17:41:57 crc kubenswrapper[5120]: I0316 17:41:57.732684 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7nmqq\" (UniqueName: \"kubernetes.io/projected/0bb8ef5b-cbc0-4c37-a1fb-a0d15204c5c9-kube-api-access-7nmqq\") pod \"openstack-galera-1\" (UID: \"0bb8ef5b-cbc0-4c37-a1fb-a0d15204c5c9\") " pod="keystone-kuttl-tests/openstack-galera-1" Mar 16 17:41:57 crc kubenswrapper[5120]: I0316 17:41:57.732886 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") pod \"openstack-galera-1\" (UID: \"0bb8ef5b-cbc0-4c37-a1fb-a0d15204c5c9\") " pod="keystone-kuttl-tests/openstack-galera-1" Mar 16 17:41:57 crc kubenswrapper[5120]: I0316 17:41:57.732943 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/bef338fe-205b-4d75-98b6-5e25cdfd474f-operator-scripts\") pod \"openstack-galera-2\" (UID: \"bef338fe-205b-4d75-98b6-5e25cdfd474f\") " pod="keystone-kuttl-tests/openstack-galera-2" Mar 16 17:41:57 crc kubenswrapper[5120]: I0316 17:41:57.732981 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/0bb8ef5b-cbc0-4c37-a1fb-a0d15204c5c9-config-data-generated\") pod \"openstack-galera-1\" (UID: \"0bb8ef5b-cbc0-4c37-a1fb-a0d15204c5c9\") " pod="keystone-kuttl-tests/openstack-galera-1" Mar 16 17:41:57 crc kubenswrapper[5120]: I0316 17:41:57.733137 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/43151632-8fd6-41c2-abf2-ff0055c1237f-kolla-config\") pod \"openstack-galera-0\" (UID: \"43151632-8fd6-41c2-abf2-ff0055c1237f\") " pod="keystone-kuttl-tests/openstack-galera-0" Mar 16 17:41:57 crc kubenswrapper[5120]: I0316 17:41:57.733204 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/bef338fe-205b-4d75-98b6-5e25cdfd474f-config-data-default\") pod \"openstack-galera-2\" (UID: \"bef338fe-205b-4d75-98b6-5e25cdfd474f\") " pod="keystone-kuttl-tests/openstack-galera-2" Mar 16 17:41:57 crc kubenswrapper[5120]: I0316 17:41:57.733377 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/0bb8ef5b-cbc0-4c37-a1fb-a0d15204c5c9-config-data-default\") pod \"openstack-galera-1\" (UID: \"0bb8ef5b-cbc0-4c37-a1fb-a0d15204c5c9\") " pod="keystone-kuttl-tests/openstack-galera-1" Mar 16 17:41:57 crc kubenswrapper[5120]: I0316 17:41:57.733687 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/43151632-8fd6-41c2-abf2-ff0055c1237f-operator-scripts\") pod \"openstack-galera-0\" (UID: \"43151632-8fd6-41c2-abf2-ff0055c1237f\") " pod="keystone-kuttl-tests/openstack-galera-0" Mar 16 17:41:57 crc kubenswrapper[5120]: I0316 17:41:57.734920 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/43151632-8fd6-41c2-abf2-ff0055c1237f-config-data-default\") pod \"openstack-galera-0\" (UID: \"43151632-8fd6-41c2-abf2-ff0055c1237f\") " pod="keystone-kuttl-tests/openstack-galera-0" Mar 16 17:41:57 crc kubenswrapper[5120]: I0316 17:41:57.748617 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-twxnv\" (UniqueName: \"kubernetes.io/projected/43151632-8fd6-41c2-abf2-ff0055c1237f-kube-api-access-twxnv\") pod \"openstack-galera-0\" (UID: \"43151632-8fd6-41c2-abf2-ff0055c1237f\") " pod="keystone-kuttl-tests/openstack-galera-0" Mar 16 17:41:57 crc kubenswrapper[5120]: I0316 17:41:57.761962 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/infra-operator-index-4fgv7" Mar 16 17:41:57 crc kubenswrapper[5120]: I0316 17:41:57.765343 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"openstack-galera-0\" (UID: \"43151632-8fd6-41c2-abf2-ff0055c1237f\") " pod="keystone-kuttl-tests/openstack-galera-0" Mar 16 17:41:57 crc kubenswrapper[5120]: I0316 17:41:57.827939 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/openstack-galera-0" Mar 16 17:41:57 crc kubenswrapper[5120]: I0316 17:41:57.835150 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/0bb8ef5b-cbc0-4c37-a1fb-a0d15204c5c9-config-data-default\") pod \"openstack-galera-1\" (UID: \"0bb8ef5b-cbc0-4c37-a1fb-a0d15204c5c9\") " pod="keystone-kuttl-tests/openstack-galera-1" Mar 16 17:41:57 crc kubenswrapper[5120]: I0316 17:41:57.835257 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7gr8j\" (UniqueName: \"kubernetes.io/projected/bef338fe-205b-4d75-98b6-5e25cdfd474f-kube-api-access-7gr8j\") pod \"openstack-galera-2\" (UID: \"bef338fe-205b-4d75-98b6-5e25cdfd474f\") " pod="keystone-kuttl-tests/openstack-galera-2" Mar 16 17:41:57 crc kubenswrapper[5120]: I0316 17:41:57.835296 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/bef338fe-205b-4d75-98b6-5e25cdfd474f-kolla-config\") pod \"openstack-galera-2\" (UID: \"bef338fe-205b-4d75-98b6-5e25cdfd474f\") " pod="keystone-kuttl-tests/openstack-galera-2" Mar 16 17:41:57 crc kubenswrapper[5120]: I0316 17:41:57.835363 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/bef338fe-205b-4d75-98b6-5e25cdfd474f-config-data-generated\") pod \"openstack-galera-2\" (UID: \"bef338fe-205b-4d75-98b6-5e25cdfd474f\") " pod="keystone-kuttl-tests/openstack-galera-2" Mar 16 17:41:57 crc kubenswrapper[5120]: I0316 17:41:57.835385 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0bb8ef5b-cbc0-4c37-a1fb-a0d15204c5c9-operator-scripts\") pod \"openstack-galera-1\" (UID: \"0bb8ef5b-cbc0-4c37-a1fb-a0d15204c5c9\") " pod="keystone-kuttl-tests/openstack-galera-1" Mar 16 17:41:57 crc kubenswrapper[5120]: I0316 17:41:57.835459 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/0bb8ef5b-cbc0-4c37-a1fb-a0d15204c5c9-kolla-config\") pod \"openstack-galera-1\" (UID: \"0bb8ef5b-cbc0-4c37-a1fb-a0d15204c5c9\") " pod="keystone-kuttl-tests/openstack-galera-1" Mar 16 17:41:57 crc kubenswrapper[5120]: I0316 17:41:57.835515 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"openstack-galera-2\" (UID: \"bef338fe-205b-4d75-98b6-5e25cdfd474f\") " pod="keystone-kuttl-tests/openstack-galera-2" Mar 16 17:41:57 crc kubenswrapper[5120]: I0316 17:41:57.835561 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7nmqq\" (UniqueName: \"kubernetes.io/projected/0bb8ef5b-cbc0-4c37-a1fb-a0d15204c5c9-kube-api-access-7nmqq\") pod \"openstack-galera-1\" (UID: \"0bb8ef5b-cbc0-4c37-a1fb-a0d15204c5c9\") " pod="keystone-kuttl-tests/openstack-galera-1" Mar 16 17:41:57 crc kubenswrapper[5120]: I0316 17:41:57.835592 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") pod \"openstack-galera-1\" (UID: \"0bb8ef5b-cbc0-4c37-a1fb-a0d15204c5c9\") " pod="keystone-kuttl-tests/openstack-galera-1" Mar 16 17:41:57 crc kubenswrapper[5120]: I0316 17:41:57.835631 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/bef338fe-205b-4d75-98b6-5e25cdfd474f-operator-scripts\") pod \"openstack-galera-2\" (UID: \"bef338fe-205b-4d75-98b6-5e25cdfd474f\") " pod="keystone-kuttl-tests/openstack-galera-2" Mar 16 17:41:57 crc kubenswrapper[5120]: I0316 17:41:57.835652 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/0bb8ef5b-cbc0-4c37-a1fb-a0d15204c5c9-config-data-generated\") pod \"openstack-galera-1\" (UID: \"0bb8ef5b-cbc0-4c37-a1fb-a0d15204c5c9\") " pod="keystone-kuttl-tests/openstack-galera-1" Mar 16 17:41:57 crc kubenswrapper[5120]: I0316 17:41:57.835734 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/bef338fe-205b-4d75-98b6-5e25cdfd474f-config-data-default\") pod \"openstack-galera-2\" (UID: \"bef338fe-205b-4d75-98b6-5e25cdfd474f\") " pod="keystone-kuttl-tests/openstack-galera-2" Mar 16 17:41:57 crc kubenswrapper[5120]: I0316 17:41:57.836957 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/bef338fe-205b-4d75-98b6-5e25cdfd474f-config-data-default\") pod \"openstack-galera-2\" (UID: \"bef338fe-205b-4d75-98b6-5e25cdfd474f\") " pod="keystone-kuttl-tests/openstack-galera-2" Mar 16 17:41:57 crc kubenswrapper[5120]: I0316 17:41:57.836997 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/0bb8ef5b-cbc0-4c37-a1fb-a0d15204c5c9-config-data-default\") pod \"openstack-galera-1\" (UID: \"0bb8ef5b-cbc0-4c37-a1fb-a0d15204c5c9\") " pod="keystone-kuttl-tests/openstack-galera-1" Mar 16 17:41:57 crc kubenswrapper[5120]: I0316 17:41:57.837158 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") pod \"openstack-galera-1\" (UID: \"0bb8ef5b-cbc0-4c37-a1fb-a0d15204c5c9\") device mount path \"/mnt/openstack/pv17\"" pod="keystone-kuttl-tests/openstack-galera-1" Mar 16 17:41:57 crc kubenswrapper[5120]: I0316 17:41:57.837484 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/0bb8ef5b-cbc0-4c37-a1fb-a0d15204c5c9-kolla-config\") pod \"openstack-galera-1\" (UID: \"0bb8ef5b-cbc0-4c37-a1fb-a0d15204c5c9\") " pod="keystone-kuttl-tests/openstack-galera-1" Mar 16 17:41:57 crc kubenswrapper[5120]: I0316 17:41:57.838307 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/bef338fe-205b-4d75-98b6-5e25cdfd474f-kolla-config\") pod \"openstack-galera-2\" (UID: \"bef338fe-205b-4d75-98b6-5e25cdfd474f\") " pod="keystone-kuttl-tests/openstack-galera-2" Mar 16 17:41:57 crc kubenswrapper[5120]: I0316 17:41:57.839294 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/bef338fe-205b-4d75-98b6-5e25cdfd474f-operator-scripts\") pod \"openstack-galera-2\" (UID: \"bef338fe-205b-4d75-98b6-5e25cdfd474f\") " pod="keystone-kuttl-tests/openstack-galera-2" Mar 16 17:41:57 crc kubenswrapper[5120]: I0316 17:41:57.839588 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/0bb8ef5b-cbc0-4c37-a1fb-a0d15204c5c9-config-data-generated\") pod \"openstack-galera-1\" (UID: \"0bb8ef5b-cbc0-4c37-a1fb-a0d15204c5c9\") " pod="keystone-kuttl-tests/openstack-galera-1" Mar 16 17:41:57 crc kubenswrapper[5120]: I0316 17:41:57.839645 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"openstack-galera-2\" (UID: \"bef338fe-205b-4d75-98b6-5e25cdfd474f\") device mount path \"/mnt/openstack/pv04\"" pod="keystone-kuttl-tests/openstack-galera-2" Mar 16 17:41:57 crc kubenswrapper[5120]: I0316 17:41:57.840125 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/bef338fe-205b-4d75-98b6-5e25cdfd474f-config-data-generated\") pod \"openstack-galera-2\" (UID: \"bef338fe-205b-4d75-98b6-5e25cdfd474f\") " pod="keystone-kuttl-tests/openstack-galera-2" Mar 16 17:41:57 crc kubenswrapper[5120]: I0316 17:41:57.841663 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0bb8ef5b-cbc0-4c37-a1fb-a0d15204c5c9-operator-scripts\") pod \"openstack-galera-1\" (UID: \"0bb8ef5b-cbc0-4c37-a1fb-a0d15204c5c9\") " pod="keystone-kuttl-tests/openstack-galera-1" Mar 16 17:41:57 crc kubenswrapper[5120]: I0316 17:41:57.858120 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gr8j\" (UniqueName: \"kubernetes.io/projected/bef338fe-205b-4d75-98b6-5e25cdfd474f-kube-api-access-7gr8j\") pod \"openstack-galera-2\" (UID: \"bef338fe-205b-4d75-98b6-5e25cdfd474f\") " pod="keystone-kuttl-tests/openstack-galera-2" Mar 16 17:41:57 crc kubenswrapper[5120]: I0316 17:41:57.859834 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") pod \"openstack-galera-1\" (UID: \"0bb8ef5b-cbc0-4c37-a1fb-a0d15204c5c9\") " pod="keystone-kuttl-tests/openstack-galera-1" Mar 16 17:41:57 crc kubenswrapper[5120]: I0316 17:41:57.863285 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7nmqq\" (UniqueName: \"kubernetes.io/projected/0bb8ef5b-cbc0-4c37-a1fb-a0d15204c5c9-kube-api-access-7nmqq\") pod \"openstack-galera-1\" (UID: \"0bb8ef5b-cbc0-4c37-a1fb-a0d15204c5c9\") " pod="keystone-kuttl-tests/openstack-galera-1" Mar 16 17:41:57 crc kubenswrapper[5120]: I0316 17:41:57.892159 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"openstack-galera-2\" (UID: \"bef338fe-205b-4d75-98b6-5e25cdfd474f\") " pod="keystone-kuttl-tests/openstack-galera-2" Mar 16 17:41:57 crc kubenswrapper[5120]: I0316 17:41:57.892753 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/openstack-galera-1" Mar 16 17:41:58 crc kubenswrapper[5120]: I0316 17:41:58.171388 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/infra-operator-index-4fgv7"] Mar 16 17:41:58 crc kubenswrapper[5120]: W0316 17:41:58.176089 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7eb6cd40_6ec1_43fb_bf5d_a37d95741e38.slice/crio-50cf32fd77e9018855edbc28ca9309ce812ba313eeb7d536f0477143e6c873b3 WatchSource:0}: Error finding container 50cf32fd77e9018855edbc28ca9309ce812ba313eeb7d536f0477143e6c873b3: Status 404 returned error can't find the container with id 50cf32fd77e9018855edbc28ca9309ce812ba313eeb7d536f0477143e6c873b3 Mar 16 17:41:58 crc kubenswrapper[5120]: I0316 17:41:58.180365 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/openstack-galera-2" Mar 16 17:41:58 crc kubenswrapper[5120]: I0316 17:41:58.317202 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/openstack-galera-0"] Mar 16 17:41:58 crc kubenswrapper[5120]: I0316 17:41:58.348739 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/openstack-galera-0" event={"ID":"43151632-8fd6-41c2-abf2-ff0055c1237f","Type":"ContainerStarted","Data":"8bf1f81b6360c8a56df18414d06e48739bff0d6a78fd5d7e42f473a82be993a1"} Mar 16 17:41:58 crc kubenswrapper[5120]: I0316 17:41:58.349561 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/openstack-galera-1"] Mar 16 17:41:58 crc kubenswrapper[5120]: I0316 17:41:58.357700 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/infra-operator-index-4fgv7" event={"ID":"7eb6cd40-6ec1-43fb-bf5d-a37d95741e38","Type":"ContainerStarted","Data":"50cf32fd77e9018855edbc28ca9309ce812ba313eeb7d536f0477143e6c873b3"} Mar 16 17:41:58 crc kubenswrapper[5120]: I0316 17:41:58.454371 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/openstack-galera-2"] Mar 16 17:41:58 crc kubenswrapper[5120]: W0316 17:41:58.456684 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbef338fe_205b_4d75_98b6_5e25cdfd474f.slice/crio-2ba028be8504c3556e8b1bbb703939eeadd88abcf3fbec74053d78836980b006 WatchSource:0}: Error finding container 2ba028be8504c3556e8b1bbb703939eeadd88abcf3fbec74053d78836980b006: Status 404 returned error can't find the container with id 2ba028be8504c3556e8b1bbb703939eeadd88abcf3fbec74053d78836980b006 Mar 16 17:41:59 crc kubenswrapper[5120]: I0316 17:41:59.266078 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-operators/0b4c51a436ce56c4393293420dad5bb37f4e2c4f062c7176860d28159542cvm"] Mar 16 17:41:59 crc kubenswrapper[5120]: I0316 17:41:59.273307 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/0b4c51a436ce56c4393293420dad5bb37f4e2c4f062c7176860d28159542cvm" Mar 16 17:41:59 crc kubenswrapper[5120]: I0316 17:41:59.276585 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-operators\"/\"default-dockercfg-rmzsx\"" Mar 16 17:41:59 crc kubenswrapper[5120]: I0316 17:41:59.289166 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/0b4c51a436ce56c4393293420dad5bb37f4e2c4f062c7176860d28159542cvm"] Mar 16 17:41:59 crc kubenswrapper[5120]: I0316 17:41:59.300018 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9p56k\" (UniqueName: \"kubernetes.io/projected/3452762f-2df3-4129-92bc-7c3591f6ad3b-kube-api-access-9p56k\") pod \"0b4c51a436ce56c4393293420dad5bb37f4e2c4f062c7176860d28159542cvm\" (UID: \"3452762f-2df3-4129-92bc-7c3591f6ad3b\") " pod="openstack-operators/0b4c51a436ce56c4393293420dad5bb37f4e2c4f062c7176860d28159542cvm" Mar 16 17:41:59 crc kubenswrapper[5120]: I0316 17:41:59.300262 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3452762f-2df3-4129-92bc-7c3591f6ad3b-bundle\") pod \"0b4c51a436ce56c4393293420dad5bb37f4e2c4f062c7176860d28159542cvm\" (UID: \"3452762f-2df3-4129-92bc-7c3591f6ad3b\") " pod="openstack-operators/0b4c51a436ce56c4393293420dad5bb37f4e2c4f062c7176860d28159542cvm" Mar 16 17:41:59 crc kubenswrapper[5120]: I0316 17:41:59.300500 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3452762f-2df3-4129-92bc-7c3591f6ad3b-util\") pod \"0b4c51a436ce56c4393293420dad5bb37f4e2c4f062c7176860d28159542cvm\" (UID: \"3452762f-2df3-4129-92bc-7c3591f6ad3b\") " pod="openstack-operators/0b4c51a436ce56c4393293420dad5bb37f4e2c4f062c7176860d28159542cvm" Mar 16 17:41:59 crc kubenswrapper[5120]: I0316 17:41:59.367297 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/openstack-galera-0" event={"ID":"43151632-8fd6-41c2-abf2-ff0055c1237f","Type":"ContainerStarted","Data":"32b5054341699003b1e3669a0661e92e1c428ec0f4d03dbb810bc51c2c9ceb9a"} Mar 16 17:41:59 crc kubenswrapper[5120]: I0316 17:41:59.369972 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/openstack-galera-2" event={"ID":"bef338fe-205b-4d75-98b6-5e25cdfd474f","Type":"ContainerStarted","Data":"e0f682b77097f27ecf25cdf1504164983b7415e6f0e21d12660294f4fb176a63"} Mar 16 17:41:59 crc kubenswrapper[5120]: I0316 17:41:59.370021 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/openstack-galera-2" event={"ID":"bef338fe-205b-4d75-98b6-5e25cdfd474f","Type":"ContainerStarted","Data":"2ba028be8504c3556e8b1bbb703939eeadd88abcf3fbec74053d78836980b006"} Mar 16 17:41:59 crc kubenswrapper[5120]: I0316 17:41:59.373153 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/openstack-galera-1" event={"ID":"0bb8ef5b-cbc0-4c37-a1fb-a0d15204c5c9","Type":"ContainerStarted","Data":"e784879447c00bcd36e962b8214c898575129ecb5716f7ccd60936d8419e699d"} Mar 16 17:41:59 crc kubenswrapper[5120]: I0316 17:41:59.373205 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/openstack-galera-1" event={"ID":"0bb8ef5b-cbc0-4c37-a1fb-a0d15204c5c9","Type":"ContainerStarted","Data":"93d2ebb2d3ddde8ac61bc65e1179c53bf96679c51c28537adbefad7dd6c73ca1"} Mar 16 17:41:59 crc kubenswrapper[5120]: I0316 17:41:59.375556 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/infra-operator-index-4fgv7" event={"ID":"7eb6cd40-6ec1-43fb-bf5d-a37d95741e38","Type":"ContainerStarted","Data":"31b2d9fa75a0aa736b77ee5c83ba240f734bd22a004ac8cba019023109b65f2b"} Mar 16 17:41:59 crc kubenswrapper[5120]: I0316 17:41:59.402182 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3452762f-2df3-4129-92bc-7c3591f6ad3b-util\") pod \"0b4c51a436ce56c4393293420dad5bb37f4e2c4f062c7176860d28159542cvm\" (UID: \"3452762f-2df3-4129-92bc-7c3591f6ad3b\") " pod="openstack-operators/0b4c51a436ce56c4393293420dad5bb37f4e2c4f062c7176860d28159542cvm" Mar 16 17:41:59 crc kubenswrapper[5120]: I0316 17:41:59.402447 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9p56k\" (UniqueName: \"kubernetes.io/projected/3452762f-2df3-4129-92bc-7c3591f6ad3b-kube-api-access-9p56k\") pod \"0b4c51a436ce56c4393293420dad5bb37f4e2c4f062c7176860d28159542cvm\" (UID: \"3452762f-2df3-4129-92bc-7c3591f6ad3b\") " pod="openstack-operators/0b4c51a436ce56c4393293420dad5bb37f4e2c4f062c7176860d28159542cvm" Mar 16 17:41:59 crc kubenswrapper[5120]: I0316 17:41:59.402546 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3452762f-2df3-4129-92bc-7c3591f6ad3b-bundle\") pod \"0b4c51a436ce56c4393293420dad5bb37f4e2c4f062c7176860d28159542cvm\" (UID: \"3452762f-2df3-4129-92bc-7c3591f6ad3b\") " pod="openstack-operators/0b4c51a436ce56c4393293420dad5bb37f4e2c4f062c7176860d28159542cvm" Mar 16 17:41:59 crc kubenswrapper[5120]: I0316 17:41:59.402775 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3452762f-2df3-4129-92bc-7c3591f6ad3b-util\") pod \"0b4c51a436ce56c4393293420dad5bb37f4e2c4f062c7176860d28159542cvm\" (UID: \"3452762f-2df3-4129-92bc-7c3591f6ad3b\") " pod="openstack-operators/0b4c51a436ce56c4393293420dad5bb37f4e2c4f062c7176860d28159542cvm" Mar 16 17:41:59 crc kubenswrapper[5120]: I0316 17:41:59.403471 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3452762f-2df3-4129-92bc-7c3591f6ad3b-bundle\") pod \"0b4c51a436ce56c4393293420dad5bb37f4e2c4f062c7176860d28159542cvm\" (UID: \"3452762f-2df3-4129-92bc-7c3591f6ad3b\") " pod="openstack-operators/0b4c51a436ce56c4393293420dad5bb37f4e2c4f062c7176860d28159542cvm" Mar 16 17:41:59 crc kubenswrapper[5120]: I0316 17:41:59.427302 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9p56k\" (UniqueName: \"kubernetes.io/projected/3452762f-2df3-4129-92bc-7c3591f6ad3b-kube-api-access-9p56k\") pod \"0b4c51a436ce56c4393293420dad5bb37f4e2c4f062c7176860d28159542cvm\" (UID: \"3452762f-2df3-4129-92bc-7c3591f6ad3b\") " pod="openstack-operators/0b4c51a436ce56c4393293420dad5bb37f4e2c4f062c7176860d28159542cvm" Mar 16 17:41:59 crc kubenswrapper[5120]: I0316 17:41:59.439096 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/infra-operator-index-4fgv7" podStartSLOduration=1.901412871 podStartE2EDuration="2.439074475s" podCreationTimestamp="2026-03-16 17:41:57 +0000 UTC" firstStartedPulling="2026-03-16 17:41:58.178594071 +0000 UTC m=+7820.332525718" lastFinishedPulling="2026-03-16 17:41:58.716255665 +0000 UTC m=+7820.870187322" observedRunningTime="2026-03-16 17:41:59.437235215 +0000 UTC m=+7821.591166872" watchObservedRunningTime="2026-03-16 17:41:59.439074475 +0000 UTC m=+7821.593006132" Mar 16 17:41:59 crc kubenswrapper[5120]: I0316 17:41:59.608050 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/0b4c51a436ce56c4393293420dad5bb37f4e2c4f062c7176860d28159542cvm" Mar 16 17:42:00 crc kubenswrapper[5120]: I0316 17:42:00.024836 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/0b4c51a436ce56c4393293420dad5bb37f4e2c4f062c7176860d28159542cvm"] Mar 16 17:42:00 crc kubenswrapper[5120]: W0316 17:42:00.029607 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3452762f_2df3_4129_92bc_7c3591f6ad3b.slice/crio-5270e6f8025d8d906e9f84cbca290e7a31ab48256419d6cc05620683b8b255e2 WatchSource:0}: Error finding container 5270e6f8025d8d906e9f84cbca290e7a31ab48256419d6cc05620683b8b255e2: Status 404 returned error can't find the container with id 5270e6f8025d8d906e9f84cbca290e7a31ab48256419d6cc05620683b8b255e2 Mar 16 17:42:00 crc kubenswrapper[5120]: I0316 17:42:00.126469 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-infra/auto-csr-approver-29561382-gr8wj"] Mar 16 17:42:00 crc kubenswrapper[5120]: I0316 17:42:00.133092 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561382-gr8wj"] Mar 16 17:42:00 crc kubenswrapper[5120]: I0316 17:42:00.133165 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561382-gr8wj" Mar 16 17:42:00 crc kubenswrapper[5120]: I0316 17:42:00.135469 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"kube-root-ca.crt\"" Mar 16 17:42:00 crc kubenswrapper[5120]: I0316 17:42:00.137562 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-infra\"/\"csr-approver-sa-dockercfg-x2nsz\"" Mar 16 17:42:00 crc kubenswrapper[5120]: I0316 17:42:00.138251 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"openshift-service-ca.crt\"" Mar 16 17:42:00 crc kubenswrapper[5120]: I0316 17:42:00.222389 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lgtdt\" (UniqueName: \"kubernetes.io/projected/41e1d9f8-34bb-4e85-84ba-b103f93d9c56-kube-api-access-lgtdt\") pod \"auto-csr-approver-29561382-gr8wj\" (UID: \"41e1d9f8-34bb-4e85-84ba-b103f93d9c56\") " pod="openshift-infra/auto-csr-approver-29561382-gr8wj" Mar 16 17:42:00 crc kubenswrapper[5120]: I0316 17:42:00.324592 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lgtdt\" (UniqueName: \"kubernetes.io/projected/41e1d9f8-34bb-4e85-84ba-b103f93d9c56-kube-api-access-lgtdt\") pod \"auto-csr-approver-29561382-gr8wj\" (UID: \"41e1d9f8-34bb-4e85-84ba-b103f93d9c56\") " pod="openshift-infra/auto-csr-approver-29561382-gr8wj" Mar 16 17:42:00 crc kubenswrapper[5120]: I0316 17:42:00.343184 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lgtdt\" (UniqueName: \"kubernetes.io/projected/41e1d9f8-34bb-4e85-84ba-b103f93d9c56-kube-api-access-lgtdt\") pod \"auto-csr-approver-29561382-gr8wj\" (UID: \"41e1d9f8-34bb-4e85-84ba-b103f93d9c56\") " pod="openshift-infra/auto-csr-approver-29561382-gr8wj" Mar 16 17:42:00 crc kubenswrapper[5120]: I0316 17:42:00.385388 5120 generic.go:358] "Generic (PLEG): container finished" podID="3452762f-2df3-4129-92bc-7c3591f6ad3b" containerID="47a9f04bd7f7feb4edf715a90d8cf86acb8411ca8030dc21d9043a0b6765dbed" exitCode=0 Mar 16 17:42:00 crc kubenswrapper[5120]: I0316 17:42:00.385437 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/0b4c51a436ce56c4393293420dad5bb37f4e2c4f062c7176860d28159542cvm" event={"ID":"3452762f-2df3-4129-92bc-7c3591f6ad3b","Type":"ContainerDied","Data":"47a9f04bd7f7feb4edf715a90d8cf86acb8411ca8030dc21d9043a0b6765dbed"} Mar 16 17:42:00 crc kubenswrapper[5120]: I0316 17:42:00.385533 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/0b4c51a436ce56c4393293420dad5bb37f4e2c4f062c7176860d28159542cvm" event={"ID":"3452762f-2df3-4129-92bc-7c3591f6ad3b","Type":"ContainerStarted","Data":"5270e6f8025d8d906e9f84cbca290e7a31ab48256419d6cc05620683b8b255e2"} Mar 16 17:42:00 crc kubenswrapper[5120]: I0316 17:42:00.468852 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561382-gr8wj" Mar 16 17:42:00 crc kubenswrapper[5120]: I0316 17:42:00.875231 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561382-gr8wj"] Mar 16 17:42:00 crc kubenswrapper[5120]: W0316 17:42:00.875616 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod41e1d9f8_34bb_4e85_84ba_b103f93d9c56.slice/crio-8a843c9c8fcf394c8e938368ed997a7aa14072bdacc6348c3a51cf7581943b9b WatchSource:0}: Error finding container 8a843c9c8fcf394c8e938368ed997a7aa14072bdacc6348c3a51cf7581943b9b: Status 404 returned error can't find the container with id 8a843c9c8fcf394c8e938368ed997a7aa14072bdacc6348c3a51cf7581943b9b Mar 16 17:42:01 crc kubenswrapper[5120]: I0316 17:42:01.396581 5120 generic.go:358] "Generic (PLEG): container finished" podID="3452762f-2df3-4129-92bc-7c3591f6ad3b" containerID="1ee747bcfef9f03a39af9624feccc88aacff1c0d753b32e3c15b186d9e0fe38b" exitCode=0 Mar 16 17:42:01 crc kubenswrapper[5120]: I0316 17:42:01.396653 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/0b4c51a436ce56c4393293420dad5bb37f4e2c4f062c7176860d28159542cvm" event={"ID":"3452762f-2df3-4129-92bc-7c3591f6ad3b","Type":"ContainerDied","Data":"1ee747bcfef9f03a39af9624feccc88aacff1c0d753b32e3c15b186d9e0fe38b"} Mar 16 17:42:01 crc kubenswrapper[5120]: I0316 17:42:01.400004 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561382-gr8wj" event={"ID":"41e1d9f8-34bb-4e85-84ba-b103f93d9c56","Type":"ContainerStarted","Data":"8a843c9c8fcf394c8e938368ed997a7aa14072bdacc6348c3a51cf7581943b9b"} Mar 16 17:42:02 crc kubenswrapper[5120]: I0316 17:42:02.411313 5120 generic.go:358] "Generic (PLEG): container finished" podID="bef338fe-205b-4d75-98b6-5e25cdfd474f" containerID="e0f682b77097f27ecf25cdf1504164983b7415e6f0e21d12660294f4fb176a63" exitCode=0 Mar 16 17:42:02 crc kubenswrapper[5120]: I0316 17:42:02.411411 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/openstack-galera-2" event={"ID":"bef338fe-205b-4d75-98b6-5e25cdfd474f","Type":"ContainerDied","Data":"e0f682b77097f27ecf25cdf1504164983b7415e6f0e21d12660294f4fb176a63"} Mar 16 17:42:02 crc kubenswrapper[5120]: I0316 17:42:02.417064 5120 generic.go:358] "Generic (PLEG): container finished" podID="0bb8ef5b-cbc0-4c37-a1fb-a0d15204c5c9" containerID="e784879447c00bcd36e962b8214c898575129ecb5716f7ccd60936d8419e699d" exitCode=0 Mar 16 17:42:02 crc kubenswrapper[5120]: I0316 17:42:02.417406 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/openstack-galera-1" event={"ID":"0bb8ef5b-cbc0-4c37-a1fb-a0d15204c5c9","Type":"ContainerDied","Data":"e784879447c00bcd36e962b8214c898575129ecb5716f7ccd60936d8419e699d"} Mar 16 17:42:02 crc kubenswrapper[5120]: I0316 17:42:02.428527 5120 generic.go:358] "Generic (PLEG): container finished" podID="3452762f-2df3-4129-92bc-7c3591f6ad3b" containerID="ddb1fa34dab500a3241096aeeb2bbf778e68acf5118c476e04987e172ef1bf37" exitCode=0 Mar 16 17:42:02 crc kubenswrapper[5120]: I0316 17:42:02.428593 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/0b4c51a436ce56c4393293420dad5bb37f4e2c4f062c7176860d28159542cvm" event={"ID":"3452762f-2df3-4129-92bc-7c3591f6ad3b","Type":"ContainerDied","Data":"ddb1fa34dab500a3241096aeeb2bbf778e68acf5118c476e04987e172ef1bf37"} Mar 16 17:42:02 crc kubenswrapper[5120]: I0316 17:42:02.432623 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561382-gr8wj" event={"ID":"41e1d9f8-34bb-4e85-84ba-b103f93d9c56","Type":"ContainerStarted","Data":"695b69845da636ec62102d62f6d938ef81cdbb6b2eeddf0918610ef8afe18999"} Mar 16 17:42:02 crc kubenswrapper[5120]: I0316 17:42:02.435497 5120 generic.go:358] "Generic (PLEG): container finished" podID="43151632-8fd6-41c2-abf2-ff0055c1237f" containerID="32b5054341699003b1e3669a0661e92e1c428ec0f4d03dbb810bc51c2c9ceb9a" exitCode=0 Mar 16 17:42:02 crc kubenswrapper[5120]: I0316 17:42:02.435569 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/openstack-galera-0" event={"ID":"43151632-8fd6-41c2-abf2-ff0055c1237f","Type":"ContainerDied","Data":"32b5054341699003b1e3669a0661e92e1c428ec0f4d03dbb810bc51c2c9ceb9a"} Mar 16 17:42:02 crc kubenswrapper[5120]: I0316 17:42:02.456959 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-infra/auto-csr-approver-29561382-gr8wj" podStartSLOduration=1.300682926 podStartE2EDuration="2.456934473s" podCreationTimestamp="2026-03-16 17:42:00 +0000 UTC" firstStartedPulling="2026-03-16 17:42:00.877173109 +0000 UTC m=+7823.031104766" lastFinishedPulling="2026-03-16 17:42:02.033424666 +0000 UTC m=+7824.187356313" observedRunningTime="2026-03-16 17:42:02.453132058 +0000 UTC m=+7824.607063725" watchObservedRunningTime="2026-03-16 17:42:02.456934473 +0000 UTC m=+7824.610866130" Mar 16 17:42:03 crc kubenswrapper[5120]: I0316 17:42:03.449174 5120 generic.go:358] "Generic (PLEG): container finished" podID="41e1d9f8-34bb-4e85-84ba-b103f93d9c56" containerID="695b69845da636ec62102d62f6d938ef81cdbb6b2eeddf0918610ef8afe18999" exitCode=0 Mar 16 17:42:03 crc kubenswrapper[5120]: I0316 17:42:03.449281 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561382-gr8wj" event={"ID":"41e1d9f8-34bb-4e85-84ba-b103f93d9c56","Type":"ContainerDied","Data":"695b69845da636ec62102d62f6d938ef81cdbb6b2eeddf0918610ef8afe18999"} Mar 16 17:42:03 crc kubenswrapper[5120]: I0316 17:42:03.451933 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/openstack-galera-0" event={"ID":"43151632-8fd6-41c2-abf2-ff0055c1237f","Type":"ContainerStarted","Data":"e9110202e26cc38766a3e07aca4ec516198be2c09bf100d75d5ea2b0b0aa6005"} Mar 16 17:42:03 crc kubenswrapper[5120]: I0316 17:42:03.453690 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/openstack-galera-2" event={"ID":"bef338fe-205b-4d75-98b6-5e25cdfd474f","Type":"ContainerStarted","Data":"5e6fd9896d41d1efe4ea3a9c55e5eca5228c55b87c24789d9e3231ffcdcfd278"} Mar 16 17:42:03 crc kubenswrapper[5120]: I0316 17:42:03.460116 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/openstack-galera-1" event={"ID":"0bb8ef5b-cbc0-4c37-a1fb-a0d15204c5c9","Type":"ContainerStarted","Data":"fc7c46634139a414fc6a3261d46acf56c9a76e273d8cbce56d84b94ae33e3121"} Mar 16 17:42:03 crc kubenswrapper[5120]: I0316 17:42:03.491456 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keystone-kuttl-tests/openstack-galera-1" podStartSLOduration=7.491425314 podStartE2EDuration="7.491425314s" podCreationTimestamp="2026-03-16 17:41:56 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:42:03.483339503 +0000 UTC m=+7825.637271160" watchObservedRunningTime="2026-03-16 17:42:03.491425314 +0000 UTC m=+7825.645356971" Mar 16 17:42:03 crc kubenswrapper[5120]: I0316 17:42:03.505254 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keystone-kuttl-tests/openstack-galera-2" podStartSLOduration=7.505236431 podStartE2EDuration="7.505236431s" podCreationTimestamp="2026-03-16 17:41:56 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:42:03.503322309 +0000 UTC m=+7825.657253976" watchObservedRunningTime="2026-03-16 17:42:03.505236431 +0000 UTC m=+7825.659168108" Mar 16 17:42:03 crc kubenswrapper[5120]: I0316 17:42:03.527405 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keystone-kuttl-tests/openstack-galera-0" podStartSLOduration=7.527381546 podStartE2EDuration="7.527381546s" podCreationTimestamp="2026-03-16 17:41:56 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:42:03.521697701 +0000 UTC m=+7825.675629358" watchObservedRunningTime="2026-03-16 17:42:03.527381546 +0000 UTC m=+7825.681313203" Mar 16 17:42:03 crc kubenswrapper[5120]: I0316 17:42:03.663530 5120 scope.go:117] "RemoveContainer" containerID="7fd764dd19065c7ce437c63b05fda51970409dfa8dfd1c77e2158bb3e05b7723" Mar 16 17:42:03 crc kubenswrapper[5120]: E0316 17:42:03.663960 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 17:42:03 crc kubenswrapper[5120]: I0316 17:42:03.742114 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/0b4c51a436ce56c4393293420dad5bb37f4e2c4f062c7176860d28159542cvm" Mar 16 17:42:03 crc kubenswrapper[5120]: I0316 17:42:03.806552 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9p56k\" (UniqueName: \"kubernetes.io/projected/3452762f-2df3-4129-92bc-7c3591f6ad3b-kube-api-access-9p56k\") pod \"3452762f-2df3-4129-92bc-7c3591f6ad3b\" (UID: \"3452762f-2df3-4129-92bc-7c3591f6ad3b\") " Mar 16 17:42:03 crc kubenswrapper[5120]: I0316 17:42:03.806664 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3452762f-2df3-4129-92bc-7c3591f6ad3b-util\") pod \"3452762f-2df3-4129-92bc-7c3591f6ad3b\" (UID: \"3452762f-2df3-4129-92bc-7c3591f6ad3b\") " Mar 16 17:42:03 crc kubenswrapper[5120]: I0316 17:42:03.806701 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3452762f-2df3-4129-92bc-7c3591f6ad3b-bundle\") pod \"3452762f-2df3-4129-92bc-7c3591f6ad3b\" (UID: \"3452762f-2df3-4129-92bc-7c3591f6ad3b\") " Mar 16 17:42:03 crc kubenswrapper[5120]: I0316 17:42:03.810892 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3452762f-2df3-4129-92bc-7c3591f6ad3b-bundle" (OuterVolumeSpecName: "bundle") pod "3452762f-2df3-4129-92bc-7c3591f6ad3b" (UID: "3452762f-2df3-4129-92bc-7c3591f6ad3b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:42:03 crc kubenswrapper[5120]: I0316 17:42:03.813783 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3452762f-2df3-4129-92bc-7c3591f6ad3b-kube-api-access-9p56k" (OuterVolumeSpecName: "kube-api-access-9p56k") pod "3452762f-2df3-4129-92bc-7c3591f6ad3b" (UID: "3452762f-2df3-4129-92bc-7c3591f6ad3b"). InnerVolumeSpecName "kube-api-access-9p56k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:42:03 crc kubenswrapper[5120]: I0316 17:42:03.822270 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3452762f-2df3-4129-92bc-7c3591f6ad3b-util" (OuterVolumeSpecName: "util") pod "3452762f-2df3-4129-92bc-7c3591f6ad3b" (UID: "3452762f-2df3-4129-92bc-7c3591f6ad3b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:42:03 crc kubenswrapper[5120]: I0316 17:42:03.909075 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9p56k\" (UniqueName: \"kubernetes.io/projected/3452762f-2df3-4129-92bc-7c3591f6ad3b-kube-api-access-9p56k\") on node \"crc\" DevicePath \"\"" Mar 16 17:42:03 crc kubenswrapper[5120]: I0316 17:42:03.909113 5120 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3452762f-2df3-4129-92bc-7c3591f6ad3b-util\") on node \"crc\" DevicePath \"\"" Mar 16 17:42:03 crc kubenswrapper[5120]: I0316 17:42:03.909124 5120 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3452762f-2df3-4129-92bc-7c3591f6ad3b-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:42:04 crc kubenswrapper[5120]: I0316 17:42:04.470013 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/0b4c51a436ce56c4393293420dad5bb37f4e2c4f062c7176860d28159542cvm" Mar 16 17:42:04 crc kubenswrapper[5120]: I0316 17:42:04.472207 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/0b4c51a436ce56c4393293420dad5bb37f4e2c4f062c7176860d28159542cvm" event={"ID":"3452762f-2df3-4129-92bc-7c3591f6ad3b","Type":"ContainerDied","Data":"5270e6f8025d8d906e9f84cbca290e7a31ab48256419d6cc05620683b8b255e2"} Mar 16 17:42:04 crc kubenswrapper[5120]: I0316 17:42:04.472252 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5270e6f8025d8d906e9f84cbca290e7a31ab48256419d6cc05620683b8b255e2" Mar 16 17:42:04 crc kubenswrapper[5120]: I0316 17:42:04.746430 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561382-gr8wj" Mar 16 17:42:04 crc kubenswrapper[5120]: I0316 17:42:04.829319 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lgtdt\" (UniqueName: \"kubernetes.io/projected/41e1d9f8-34bb-4e85-84ba-b103f93d9c56-kube-api-access-lgtdt\") pod \"41e1d9f8-34bb-4e85-84ba-b103f93d9c56\" (UID: \"41e1d9f8-34bb-4e85-84ba-b103f93d9c56\") " Mar 16 17:42:04 crc kubenswrapper[5120]: I0316 17:42:04.834015 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41e1d9f8-34bb-4e85-84ba-b103f93d9c56-kube-api-access-lgtdt" (OuterVolumeSpecName: "kube-api-access-lgtdt") pod "41e1d9f8-34bb-4e85-84ba-b103f93d9c56" (UID: "41e1d9f8-34bb-4e85-84ba-b103f93d9c56"). InnerVolumeSpecName "kube-api-access-lgtdt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:42:04 crc kubenswrapper[5120]: I0316 17:42:04.933190 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lgtdt\" (UniqueName: \"kubernetes.io/projected/41e1d9f8-34bb-4e85-84ba-b103f93d9c56-kube-api-access-lgtdt\") on node \"crc\" DevicePath \"\"" Mar 16 17:42:05 crc kubenswrapper[5120]: I0316 17:42:05.478675 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561382-gr8wj" Mar 16 17:42:05 crc kubenswrapper[5120]: I0316 17:42:05.478705 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561382-gr8wj" event={"ID":"41e1d9f8-34bb-4e85-84ba-b103f93d9c56","Type":"ContainerDied","Data":"8a843c9c8fcf394c8e938368ed997a7aa14072bdacc6348c3a51cf7581943b9b"} Mar 16 17:42:05 crc kubenswrapper[5120]: I0316 17:42:05.479112 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8a843c9c8fcf394c8e938368ed997a7aa14072bdacc6348c3a51cf7581943b9b" Mar 16 17:42:05 crc kubenswrapper[5120]: I0316 17:42:05.512435 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-infra/auto-csr-approver-29561376-n8jht"] Mar 16 17:42:05 crc kubenswrapper[5120]: I0316 17:42:05.517514 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-infra/auto-csr-approver-29561376-n8jht"] Mar 16 17:42:06 crc kubenswrapper[5120]: I0316 17:42:06.672624 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="735c0765-482f-45df-a6eb-bcb2dcc38e4f" path="/var/lib/kubelet/pods/735c0765-482f-45df-a6eb-bcb2dcc38e4f/volumes" Mar 16 17:42:07 crc kubenswrapper[5120]: E0316 17:42:07.228334 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=966406 actualBytes=10240 Mar 16 17:42:07 crc kubenswrapper[5120]: I0316 17:42:07.762084 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-operators/infra-operator-index-4fgv7" Mar 16 17:42:07 crc kubenswrapper[5120]: I0316 17:42:07.762467 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-operators/infra-operator-index-4fgv7" Mar 16 17:42:07 crc kubenswrapper[5120]: I0316 17:42:07.802895 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-operators/infra-operator-index-4fgv7" Mar 16 17:42:07 crc kubenswrapper[5120]: I0316 17:42:07.828803 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keystone-kuttl-tests/openstack-galera-0" Mar 16 17:42:07 crc kubenswrapper[5120]: I0316 17:42:07.828881 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keystone-kuttl-tests/openstack-galera-0" Mar 16 17:42:07 crc kubenswrapper[5120]: I0316 17:42:07.893164 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keystone-kuttl-tests/openstack-galera-1" Mar 16 17:42:07 crc kubenswrapper[5120]: I0316 17:42:07.893209 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keystone-kuttl-tests/openstack-galera-1" Mar 16 17:42:08 crc kubenswrapper[5120]: I0316 17:42:08.181730 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keystone-kuttl-tests/openstack-galera-2" Mar 16 17:42:08 crc kubenswrapper[5120]: I0316 17:42:08.181976 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keystone-kuttl-tests/openstack-galera-2" Mar 16 17:42:08 crc kubenswrapper[5120]: I0316 17:42:08.547948 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/infra-operator-index-4fgv7" Mar 16 17:42:09 crc kubenswrapper[5120]: E0316 17:42:09.562023 5120 upgradeaware.go:427] Error proxying data from client to backend: readfrom tcp 38.102.83.119:38014->38.102.83.119:44311: write tcp 38.102.83.119:38014->38.102.83.119:44311: write: broken pipe Mar 16 17:42:12 crc kubenswrapper[5120]: I0316 17:42:12.257142 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="keystone-kuttl-tests/openstack-galera-2" Mar 16 17:42:12 crc kubenswrapper[5120]: I0316 17:42:12.324245 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="keystone-kuttl-tests/openstack-galera-2" Mar 16 17:42:16 crc kubenswrapper[5120]: I0316 17:42:16.547144 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keystone-kuttl-tests/root-account-create-update-69bcb"] Mar 16 17:42:16 crc kubenswrapper[5120]: I0316 17:42:16.548626 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41e1d9f8-34bb-4e85-84ba-b103f93d9c56" containerName="oc" Mar 16 17:42:16 crc kubenswrapper[5120]: I0316 17:42:16.548648 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="41e1d9f8-34bb-4e85-84ba-b103f93d9c56" containerName="oc" Mar 16 17:42:16 crc kubenswrapper[5120]: I0316 17:42:16.548666 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3452762f-2df3-4129-92bc-7c3591f6ad3b" containerName="pull" Mar 16 17:42:16 crc kubenswrapper[5120]: I0316 17:42:16.548673 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="3452762f-2df3-4129-92bc-7c3591f6ad3b" containerName="pull" Mar 16 17:42:16 crc kubenswrapper[5120]: I0316 17:42:16.548692 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3452762f-2df3-4129-92bc-7c3591f6ad3b" containerName="extract" Mar 16 17:42:16 crc kubenswrapper[5120]: I0316 17:42:16.548700 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="3452762f-2df3-4129-92bc-7c3591f6ad3b" containerName="extract" Mar 16 17:42:16 crc kubenswrapper[5120]: I0316 17:42:16.548742 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3452762f-2df3-4129-92bc-7c3591f6ad3b" containerName="util" Mar 16 17:42:16 crc kubenswrapper[5120]: I0316 17:42:16.548749 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="3452762f-2df3-4129-92bc-7c3591f6ad3b" containerName="util" Mar 16 17:42:16 crc kubenswrapper[5120]: I0316 17:42:16.548927 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="41e1d9f8-34bb-4e85-84ba-b103f93d9c56" containerName="oc" Mar 16 17:42:16 crc kubenswrapper[5120]: I0316 17:42:16.548951 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="3452762f-2df3-4129-92bc-7c3591f6ad3b" containerName="extract" Mar 16 17:42:16 crc kubenswrapper[5120]: I0316 17:42:16.552871 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/root-account-create-update-69bcb" Mar 16 17:42:16 crc kubenswrapper[5120]: I0316 17:42:16.555740 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keystone-kuttl-tests\"/\"openstack-mariadb-root-db-secret\"" Mar 16 17:42:16 crc kubenswrapper[5120]: I0316 17:42:16.557317 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/root-account-create-update-69bcb"] Mar 16 17:42:16 crc kubenswrapper[5120]: I0316 17:42:16.576032 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gl7r6\" (UniqueName: \"kubernetes.io/projected/8284125a-efe5-4fa5-856f-8f50818f5e90-kube-api-access-gl7r6\") pod \"root-account-create-update-69bcb\" (UID: \"8284125a-efe5-4fa5-856f-8f50818f5e90\") " pod="keystone-kuttl-tests/root-account-create-update-69bcb" Mar 16 17:42:16 crc kubenswrapper[5120]: I0316 17:42:16.576290 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8284125a-efe5-4fa5-856f-8f50818f5e90-operator-scripts\") pod \"root-account-create-update-69bcb\" (UID: \"8284125a-efe5-4fa5-856f-8f50818f5e90\") " pod="keystone-kuttl-tests/root-account-create-update-69bcb" Mar 16 17:42:16 crc kubenswrapper[5120]: I0316 17:42:16.680217 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8284125a-efe5-4fa5-856f-8f50818f5e90-operator-scripts\") pod \"root-account-create-update-69bcb\" (UID: \"8284125a-efe5-4fa5-856f-8f50818f5e90\") " pod="keystone-kuttl-tests/root-account-create-update-69bcb" Mar 16 17:42:16 crc kubenswrapper[5120]: I0316 17:42:16.680620 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gl7r6\" (UniqueName: \"kubernetes.io/projected/8284125a-efe5-4fa5-856f-8f50818f5e90-kube-api-access-gl7r6\") pod \"root-account-create-update-69bcb\" (UID: \"8284125a-efe5-4fa5-856f-8f50818f5e90\") " pod="keystone-kuttl-tests/root-account-create-update-69bcb" Mar 16 17:42:16 crc kubenswrapper[5120]: I0316 17:42:16.681648 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8284125a-efe5-4fa5-856f-8f50818f5e90-operator-scripts\") pod \"root-account-create-update-69bcb\" (UID: \"8284125a-efe5-4fa5-856f-8f50818f5e90\") " pod="keystone-kuttl-tests/root-account-create-update-69bcb" Mar 16 17:42:16 crc kubenswrapper[5120]: I0316 17:42:16.736702 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gl7r6\" (UniqueName: \"kubernetes.io/projected/8284125a-efe5-4fa5-856f-8f50818f5e90-kube-api-access-gl7r6\") pod \"root-account-create-update-69bcb\" (UID: \"8284125a-efe5-4fa5-856f-8f50818f5e90\") " pod="keystone-kuttl-tests/root-account-create-update-69bcb" Mar 16 17:42:16 crc kubenswrapper[5120]: I0316 17:42:16.881061 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/root-account-create-update-69bcb" Mar 16 17:42:17 crc kubenswrapper[5120]: I0316 17:42:17.345189 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/root-account-create-update-69bcb"] Mar 16 17:42:17 crc kubenswrapper[5120]: W0316 17:42:17.350925 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8284125a_efe5_4fa5_856f_8f50818f5e90.slice/crio-30b5a9c809d9f541bafa065fba38062d36ed81d0312e535d30c8c2c24eceb04e WatchSource:0}: Error finding container 30b5a9c809d9f541bafa065fba38062d36ed81d0312e535d30c8c2c24eceb04e: Status 404 returned error can't find the container with id 30b5a9c809d9f541bafa065fba38062d36ed81d0312e535d30c8c2c24eceb04e Mar 16 17:42:17 crc kubenswrapper[5120]: I0316 17:42:17.566056 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/root-account-create-update-69bcb" event={"ID":"8284125a-efe5-4fa5-856f-8f50818f5e90","Type":"ContainerStarted","Data":"ab5431d6cb42694f8d7b2af4fd3c38488396b6bc9ff998104cd143d794fab5e1"} Mar 16 17:42:17 crc kubenswrapper[5120]: I0316 17:42:17.566115 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/root-account-create-update-69bcb" event={"ID":"8284125a-efe5-4fa5-856f-8f50818f5e90","Type":"ContainerStarted","Data":"30b5a9c809d9f541bafa065fba38062d36ed81d0312e535d30c8c2c24eceb04e"} Mar 16 17:42:17 crc kubenswrapper[5120]: I0316 17:42:17.664005 5120 scope.go:117] "RemoveContainer" containerID="7fd764dd19065c7ce437c63b05fda51970409dfa8dfd1c77e2158bb3e05b7723" Mar 16 17:42:17 crc kubenswrapper[5120]: E0316 17:42:17.664519 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 17:42:18 crc kubenswrapper[5120]: E0316 17:42:18.856626 5120 upgradeaware.go:427] Error proxying data from client to backend: readfrom tcp 38.102.83.119:49892->38.102.83.119:44311: write tcp 38.102.83.119:49892->38.102.83.119:44311: write: connection reset by peer Mar 16 17:42:19 crc kubenswrapper[5120]: I0316 17:42:19.586392 5120 generic.go:358] "Generic (PLEG): container finished" podID="8284125a-efe5-4fa5-856f-8f50818f5e90" containerID="ab5431d6cb42694f8d7b2af4fd3c38488396b6bc9ff998104cd143d794fab5e1" exitCode=0 Mar 16 17:42:19 crc kubenswrapper[5120]: I0316 17:42:19.586495 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/root-account-create-update-69bcb" event={"ID":"8284125a-efe5-4fa5-856f-8f50818f5e90","Type":"ContainerDied","Data":"ab5431d6cb42694f8d7b2af4fd3c38488396b6bc9ff998104cd143d794fab5e1"} Mar 16 17:42:20 crc kubenswrapper[5120]: I0316 17:42:20.898322 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/root-account-create-update-69bcb" Mar 16 17:42:20 crc kubenswrapper[5120]: I0316 17:42:20.978674 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gl7r6\" (UniqueName: \"kubernetes.io/projected/8284125a-efe5-4fa5-856f-8f50818f5e90-kube-api-access-gl7r6\") pod \"8284125a-efe5-4fa5-856f-8f50818f5e90\" (UID: \"8284125a-efe5-4fa5-856f-8f50818f5e90\") " Mar 16 17:42:20 crc kubenswrapper[5120]: I0316 17:42:20.978886 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8284125a-efe5-4fa5-856f-8f50818f5e90-operator-scripts\") pod \"8284125a-efe5-4fa5-856f-8f50818f5e90\" (UID: \"8284125a-efe5-4fa5-856f-8f50818f5e90\") " Mar 16 17:42:20 crc kubenswrapper[5120]: I0316 17:42:20.979403 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8284125a-efe5-4fa5-856f-8f50818f5e90-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "8284125a-efe5-4fa5-856f-8f50818f5e90" (UID: "8284125a-efe5-4fa5-856f-8f50818f5e90"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:42:20 crc kubenswrapper[5120]: I0316 17:42:20.979604 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8284125a-efe5-4fa5-856f-8f50818f5e90-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:42:20 crc kubenswrapper[5120]: I0316 17:42:20.987274 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8284125a-efe5-4fa5-856f-8f50818f5e90-kube-api-access-gl7r6" (OuterVolumeSpecName: "kube-api-access-gl7r6") pod "8284125a-efe5-4fa5-856f-8f50818f5e90" (UID: "8284125a-efe5-4fa5-856f-8f50818f5e90"). InnerVolumeSpecName "kube-api-access-gl7r6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:42:21 crc kubenswrapper[5120]: I0316 17:42:21.082685 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gl7r6\" (UniqueName: \"kubernetes.io/projected/8284125a-efe5-4fa5-856f-8f50818f5e90-kube-api-access-gl7r6\") on node \"crc\" DevicePath \"\"" Mar 16 17:42:21 crc kubenswrapper[5120]: I0316 17:42:21.604951 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/root-account-create-update-69bcb" Mar 16 17:42:21 crc kubenswrapper[5120]: I0316 17:42:21.604948 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/root-account-create-update-69bcb" event={"ID":"8284125a-efe5-4fa5-856f-8f50818f5e90","Type":"ContainerDied","Data":"30b5a9c809d9f541bafa065fba38062d36ed81d0312e535d30c8c2c24eceb04e"} Mar 16 17:42:21 crc kubenswrapper[5120]: I0316 17:42:21.605418 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="30b5a9c809d9f541bafa065fba38062d36ed81d0312e535d30c8c2c24eceb04e" Mar 16 17:42:21 crc kubenswrapper[5120]: E0316 17:42:21.929319 5120 upgradeaware.go:427] Error proxying data from client to backend: readfrom tcp 38.102.83.119:49894->38.102.83.119:44311: write tcp 38.102.83.119:49894->38.102.83.119:44311: write: broken pipe Mar 16 17:42:22 crc kubenswrapper[5120]: I0316 17:42:22.482112 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="keystone-kuttl-tests/openstack-galera-0" Mar 16 17:42:22 crc kubenswrapper[5120]: I0316 17:42:22.562317 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="keystone-kuttl-tests/openstack-galera-0" Mar 16 17:42:25 crc kubenswrapper[5120]: I0316 17:42:25.644681 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="keystone-kuttl-tests/openstack-galera-1" Mar 16 17:42:25 crc kubenswrapper[5120]: I0316 17:42:25.717108 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="keystone-kuttl-tests/openstack-galera-1" Mar 16 17:42:29 crc kubenswrapper[5120]: I0316 17:42:29.663378 5120 scope.go:117] "RemoveContainer" containerID="7fd764dd19065c7ce437c63b05fda51970409dfa8dfd1c77e2158bb3e05b7723" Mar 16 17:42:29 crc kubenswrapper[5120]: E0316 17:42:29.664718 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 17:42:33 crc kubenswrapper[5120]: I0316 17:42:33.781533 5120 scope.go:117] "RemoveContainer" containerID="46f6b95e140ee661fae8132503f4dd8eb835f017d7225c285963a10ca90a4f47" Mar 16 17:42:33 crc kubenswrapper[5120]: I0316 17:42:33.802024 5120 scope.go:117] "RemoveContainer" containerID="8d3fa0260c6f70d1422459cb8cf88c35d320c37e181b97c77dca4c41f6cd83b4" Mar 16 17:42:33 crc kubenswrapper[5120]: I0316 17:42:33.828935 5120 scope.go:117] "RemoveContainer" containerID="da849f57a022768b88910fd6487d2766891ee2f507ac2a628bef5cd0450464f8" Mar 16 17:42:33 crc kubenswrapper[5120]: I0316 17:42:33.854828 5120 scope.go:117] "RemoveContainer" containerID="18b95fd11bd1fe9aba9152f730a9db1c4093aaf9d424fd5a4974869b71b5b07d" Mar 16 17:42:33 crc kubenswrapper[5120]: I0316 17:42:33.888409 5120 scope.go:117] "RemoveContainer" containerID="853a1f4da9c5c60ce2bb4726bbf0f66e26ce2f780eed1db3d1e9ba33f84fc918" Mar 16 17:42:36 crc kubenswrapper[5120]: I0316 17:42:36.087439 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-operators/infra-operator-controller-manager-66bdcc97cd-6qtx8"] Mar 16 17:42:36 crc kubenswrapper[5120]: I0316 17:42:36.088908 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8284125a-efe5-4fa5-856f-8f50818f5e90" containerName="mariadb-account-create-update" Mar 16 17:42:36 crc kubenswrapper[5120]: I0316 17:42:36.088935 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8284125a-efe5-4fa5-856f-8f50818f5e90" containerName="mariadb-account-create-update" Mar 16 17:42:36 crc kubenswrapper[5120]: I0316 17:42:36.089132 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="8284125a-efe5-4fa5-856f-8f50818f5e90" containerName="mariadb-account-create-update" Mar 16 17:42:36 crc kubenswrapper[5120]: I0316 17:42:36.144052 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/infra-operator-controller-manager-66bdcc97cd-6qtx8"] Mar 16 17:42:36 crc kubenswrapper[5120]: I0316 17:42:36.144190 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/infra-operator-controller-manager-66bdcc97cd-6qtx8" Mar 16 17:42:36 crc kubenswrapper[5120]: I0316 17:42:36.146077 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-operators\"/\"infra-operator-controller-manager-service-cert\"" Mar 16 17:42:36 crc kubenswrapper[5120]: I0316 17:42:36.146270 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-operators\"/\"infra-operator-controller-manager-dockercfg-xjczf\"" Mar 16 17:42:36 crc kubenswrapper[5120]: I0316 17:42:36.200542 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5nwk\" (UniqueName: \"kubernetes.io/projected/bc9855c7-3e23-4753-8896-74e15d67f9a5-kube-api-access-x5nwk\") pod \"infra-operator-controller-manager-66bdcc97cd-6qtx8\" (UID: \"bc9855c7-3e23-4753-8896-74e15d67f9a5\") " pod="openstack-operators/infra-operator-controller-manager-66bdcc97cd-6qtx8" Mar 16 17:42:36 crc kubenswrapper[5120]: I0316 17:42:36.200679 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bc9855c7-3e23-4753-8896-74e15d67f9a5-apiservice-cert\") pod \"infra-operator-controller-manager-66bdcc97cd-6qtx8\" (UID: \"bc9855c7-3e23-4753-8896-74e15d67f9a5\") " pod="openstack-operators/infra-operator-controller-manager-66bdcc97cd-6qtx8" Mar 16 17:42:36 crc kubenswrapper[5120]: I0316 17:42:36.200744 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bc9855c7-3e23-4753-8896-74e15d67f9a5-webhook-cert\") pod \"infra-operator-controller-manager-66bdcc97cd-6qtx8\" (UID: \"bc9855c7-3e23-4753-8896-74e15d67f9a5\") " pod="openstack-operators/infra-operator-controller-manager-66bdcc97cd-6qtx8" Mar 16 17:42:36 crc kubenswrapper[5120]: I0316 17:42:36.302964 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x5nwk\" (UniqueName: \"kubernetes.io/projected/bc9855c7-3e23-4753-8896-74e15d67f9a5-kube-api-access-x5nwk\") pod \"infra-operator-controller-manager-66bdcc97cd-6qtx8\" (UID: \"bc9855c7-3e23-4753-8896-74e15d67f9a5\") " pod="openstack-operators/infra-operator-controller-manager-66bdcc97cd-6qtx8" Mar 16 17:42:36 crc kubenswrapper[5120]: I0316 17:42:36.303053 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bc9855c7-3e23-4753-8896-74e15d67f9a5-apiservice-cert\") pod \"infra-operator-controller-manager-66bdcc97cd-6qtx8\" (UID: \"bc9855c7-3e23-4753-8896-74e15d67f9a5\") " pod="openstack-operators/infra-operator-controller-manager-66bdcc97cd-6qtx8" Mar 16 17:42:36 crc kubenswrapper[5120]: I0316 17:42:36.303096 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bc9855c7-3e23-4753-8896-74e15d67f9a5-webhook-cert\") pod \"infra-operator-controller-manager-66bdcc97cd-6qtx8\" (UID: \"bc9855c7-3e23-4753-8896-74e15d67f9a5\") " pod="openstack-operators/infra-operator-controller-manager-66bdcc97cd-6qtx8" Mar 16 17:42:36 crc kubenswrapper[5120]: I0316 17:42:36.315450 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bc9855c7-3e23-4753-8896-74e15d67f9a5-apiservice-cert\") pod \"infra-operator-controller-manager-66bdcc97cd-6qtx8\" (UID: \"bc9855c7-3e23-4753-8896-74e15d67f9a5\") " pod="openstack-operators/infra-operator-controller-manager-66bdcc97cd-6qtx8" Mar 16 17:42:36 crc kubenswrapper[5120]: I0316 17:42:36.319469 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bc9855c7-3e23-4753-8896-74e15d67f9a5-webhook-cert\") pod \"infra-operator-controller-manager-66bdcc97cd-6qtx8\" (UID: \"bc9855c7-3e23-4753-8896-74e15d67f9a5\") " pod="openstack-operators/infra-operator-controller-manager-66bdcc97cd-6qtx8" Mar 16 17:42:36 crc kubenswrapper[5120]: I0316 17:42:36.326423 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5nwk\" (UniqueName: \"kubernetes.io/projected/bc9855c7-3e23-4753-8896-74e15d67f9a5-kube-api-access-x5nwk\") pod \"infra-operator-controller-manager-66bdcc97cd-6qtx8\" (UID: \"bc9855c7-3e23-4753-8896-74e15d67f9a5\") " pod="openstack-operators/infra-operator-controller-manager-66bdcc97cd-6qtx8" Mar 16 17:42:36 crc kubenswrapper[5120]: I0316 17:42:36.462482 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/infra-operator-controller-manager-66bdcc97cd-6qtx8" Mar 16 17:42:36 crc kubenswrapper[5120]: I0316 17:42:36.889739 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/infra-operator-controller-manager-66bdcc97cd-6qtx8"] Mar 16 17:42:37 crc kubenswrapper[5120]: I0316 17:42:37.746069 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/infra-operator-controller-manager-66bdcc97cd-6qtx8" event={"ID":"bc9855c7-3e23-4753-8896-74e15d67f9a5","Type":"ContainerStarted","Data":"4148d78c8a0ff9215869e55b539b5de587176b1ae0649f8141b3f46204be178a"} Mar 16 17:42:37 crc kubenswrapper[5120]: I0316 17:42:37.746841 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-operators/infra-operator-controller-manager-66bdcc97cd-6qtx8" Mar 16 17:42:37 crc kubenswrapper[5120]: I0316 17:42:37.746867 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/infra-operator-controller-manager-66bdcc97cd-6qtx8" event={"ID":"bc9855c7-3e23-4753-8896-74e15d67f9a5","Type":"ContainerStarted","Data":"981bffb15e178726c0d46e84a0faf191b05f9106de16e2ed0e2119045c64bb95"} Mar 16 17:42:37 crc kubenswrapper[5120]: I0316 17:42:37.771133 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/infra-operator-controller-manager-66bdcc97cd-6qtx8" podStartSLOduration=1.771108611 podStartE2EDuration="1.771108611s" podCreationTimestamp="2026-03-16 17:42:36 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:42:37.767677558 +0000 UTC m=+7859.921609225" watchObservedRunningTime="2026-03-16 17:42:37.771108611 +0000 UTC m=+7859.925040278" Mar 16 17:42:43 crc kubenswrapper[5120]: I0316 17:42:43.664125 5120 scope.go:117] "RemoveContainer" containerID="7fd764dd19065c7ce437c63b05fda51970409dfa8dfd1c77e2158bb3e05b7723" Mar 16 17:42:43 crc kubenswrapper[5120]: E0316 17:42:43.664834 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 17:42:48 crc kubenswrapper[5120]: I0316 17:42:48.758636 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/infra-operator-controller-manager-66bdcc97cd-6qtx8" Mar 16 17:42:51 crc kubenswrapper[5120]: I0316 17:42:51.880505 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-operators/rabbitmq-cluster-operator-index-nv8mm"] Mar 16 17:42:51 crc kubenswrapper[5120]: I0316 17:42:51.914326 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/rabbitmq-cluster-operator-index-nv8mm" Mar 16 17:42:51 crc kubenswrapper[5120]: I0316 17:42:51.914391 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/rabbitmq-cluster-operator-index-nv8mm"] Mar 16 17:42:51 crc kubenswrapper[5120]: I0316 17:42:51.918735 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-operators\"/\"rabbitmq-cluster-operator-index-dockercfg-kmhjz\"" Mar 16 17:42:52 crc kubenswrapper[5120]: I0316 17:42:52.041347 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjzwh\" (UniqueName: \"kubernetes.io/projected/5ad14ceb-690d-4da6-8b4a-b026f9e74721-kube-api-access-sjzwh\") pod \"rabbitmq-cluster-operator-index-nv8mm\" (UID: \"5ad14ceb-690d-4da6-8b4a-b026f9e74721\") " pod="openstack-operators/rabbitmq-cluster-operator-index-nv8mm" Mar 16 17:42:52 crc kubenswrapper[5120]: I0316 17:42:52.145220 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sjzwh\" (UniqueName: \"kubernetes.io/projected/5ad14ceb-690d-4da6-8b4a-b026f9e74721-kube-api-access-sjzwh\") pod \"rabbitmq-cluster-operator-index-nv8mm\" (UID: \"5ad14ceb-690d-4da6-8b4a-b026f9e74721\") " pod="openstack-operators/rabbitmq-cluster-operator-index-nv8mm" Mar 16 17:42:52 crc kubenswrapper[5120]: I0316 17:42:52.183435 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjzwh\" (UniqueName: \"kubernetes.io/projected/5ad14ceb-690d-4da6-8b4a-b026f9e74721-kube-api-access-sjzwh\") pod \"rabbitmq-cluster-operator-index-nv8mm\" (UID: \"5ad14ceb-690d-4da6-8b4a-b026f9e74721\") " pod="openstack-operators/rabbitmq-cluster-operator-index-nv8mm" Mar 16 17:42:52 crc kubenswrapper[5120]: I0316 17:42:52.237197 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/rabbitmq-cluster-operator-index-nv8mm" Mar 16 17:42:52 crc kubenswrapper[5120]: I0316 17:42:52.643420 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/rabbitmq-cluster-operator-index-nv8mm"] Mar 16 17:42:52 crc kubenswrapper[5120]: W0316 17:42:52.651928 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ad14ceb_690d_4da6_8b4a_b026f9e74721.slice/crio-f3517938a19a49b366bfafcc79b766fdb855d3355ae1542872e6dca024d97cdf WatchSource:0}: Error finding container f3517938a19a49b366bfafcc79b766fdb855d3355ae1542872e6dca024d97cdf: Status 404 returned error can't find the container with id f3517938a19a49b366bfafcc79b766fdb855d3355ae1542872e6dca024d97cdf Mar 16 17:42:52 crc kubenswrapper[5120]: I0316 17:42:52.867237 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/rabbitmq-cluster-operator-index-nv8mm" event={"ID":"5ad14ceb-690d-4da6-8b4a-b026f9e74721","Type":"ContainerStarted","Data":"f3517938a19a49b366bfafcc79b766fdb855d3355ae1542872e6dca024d97cdf"} Mar 16 17:42:53 crc kubenswrapper[5120]: I0316 17:42:53.875750 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/rabbitmq-cluster-operator-index-nv8mm" event={"ID":"5ad14ceb-690d-4da6-8b4a-b026f9e74721","Type":"ContainerStarted","Data":"554f5a6b0b52ef770fea52543d299709a70c0f70b70eacc42f6d101f55d7f186"} Mar 16 17:42:53 crc kubenswrapper[5120]: I0316 17:42:53.900202 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/rabbitmq-cluster-operator-index-nv8mm" podStartSLOduration=2.298190895 podStartE2EDuration="2.900170555s" podCreationTimestamp="2026-03-16 17:42:51 +0000 UTC" firstStartedPulling="2026-03-16 17:42:52.653333364 +0000 UTC m=+7874.807265021" lastFinishedPulling="2026-03-16 17:42:53.255312984 +0000 UTC m=+7875.409244681" observedRunningTime="2026-03-16 17:42:53.890280775 +0000 UTC m=+7876.044212432" watchObservedRunningTime="2026-03-16 17:42:53.900170555 +0000 UTC m=+7876.054102212" Mar 16 17:42:55 crc kubenswrapper[5120]: I0316 17:42:55.922843 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e5904nsqq"] Mar 16 17:42:55 crc kubenswrapper[5120]: I0316 17:42:55.930659 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e5904nsqq" Mar 16 17:42:55 crc kubenswrapper[5120]: I0316 17:42:55.934051 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-operators\"/\"default-dockercfg-rmzsx\"" Mar 16 17:42:55 crc kubenswrapper[5120]: I0316 17:42:55.934458 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e5904nsqq"] Mar 16 17:42:56 crc kubenswrapper[5120]: I0316 17:42:56.043640 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qj8tq\" (UniqueName: \"kubernetes.io/projected/14fb34f4-64c5-4f35-b738-9f31a7d721ec-kube-api-access-qj8tq\") pod \"9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e5904nsqq\" (UID: \"14fb34f4-64c5-4f35-b738-9f31a7d721ec\") " pod="openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e5904nsqq" Mar 16 17:42:56 crc kubenswrapper[5120]: I0316 17:42:56.043721 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/14fb34f4-64c5-4f35-b738-9f31a7d721ec-util\") pod \"9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e5904nsqq\" (UID: \"14fb34f4-64c5-4f35-b738-9f31a7d721ec\") " pod="openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e5904nsqq" Mar 16 17:42:56 crc kubenswrapper[5120]: I0316 17:42:56.043890 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/14fb34f4-64c5-4f35-b738-9f31a7d721ec-bundle\") pod \"9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e5904nsqq\" (UID: \"14fb34f4-64c5-4f35-b738-9f31a7d721ec\") " pod="openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e5904nsqq" Mar 16 17:42:56 crc kubenswrapper[5120]: I0316 17:42:56.146259 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/14fb34f4-64c5-4f35-b738-9f31a7d721ec-bundle\") pod \"9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e5904nsqq\" (UID: \"14fb34f4-64c5-4f35-b738-9f31a7d721ec\") " pod="openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e5904nsqq" Mar 16 17:42:56 crc kubenswrapper[5120]: I0316 17:42:56.146613 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qj8tq\" (UniqueName: \"kubernetes.io/projected/14fb34f4-64c5-4f35-b738-9f31a7d721ec-kube-api-access-qj8tq\") pod \"9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e5904nsqq\" (UID: \"14fb34f4-64c5-4f35-b738-9f31a7d721ec\") " pod="openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e5904nsqq" Mar 16 17:42:56 crc kubenswrapper[5120]: I0316 17:42:56.146685 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/14fb34f4-64c5-4f35-b738-9f31a7d721ec-util\") pod \"9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e5904nsqq\" (UID: \"14fb34f4-64c5-4f35-b738-9f31a7d721ec\") " pod="openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e5904nsqq" Mar 16 17:42:56 crc kubenswrapper[5120]: I0316 17:42:56.146891 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/14fb34f4-64c5-4f35-b738-9f31a7d721ec-bundle\") pod \"9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e5904nsqq\" (UID: \"14fb34f4-64c5-4f35-b738-9f31a7d721ec\") " pod="openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e5904nsqq" Mar 16 17:42:56 crc kubenswrapper[5120]: I0316 17:42:56.147322 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/14fb34f4-64c5-4f35-b738-9f31a7d721ec-util\") pod \"9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e5904nsqq\" (UID: \"14fb34f4-64c5-4f35-b738-9f31a7d721ec\") " pod="openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e5904nsqq" Mar 16 17:42:56 crc kubenswrapper[5120]: I0316 17:42:56.172120 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qj8tq\" (UniqueName: \"kubernetes.io/projected/14fb34f4-64c5-4f35-b738-9f31a7d721ec-kube-api-access-qj8tq\") pod \"9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e5904nsqq\" (UID: \"14fb34f4-64c5-4f35-b738-9f31a7d721ec\") " pod="openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e5904nsqq" Mar 16 17:42:56 crc kubenswrapper[5120]: I0316 17:42:56.249255 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e5904nsqq" Mar 16 17:42:56 crc kubenswrapper[5120]: I0316 17:42:56.663684 5120 scope.go:117] "RemoveContainer" containerID="7fd764dd19065c7ce437c63b05fda51970409dfa8dfd1c77e2158bb3e05b7723" Mar 16 17:42:56 crc kubenswrapper[5120]: E0316 17:42:56.664257 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 17:42:56 crc kubenswrapper[5120]: W0316 17:42:56.804257 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14fb34f4_64c5_4f35_b738_9f31a7d721ec.slice/crio-dd29c2831cbf40d8da84aa2bfe79244b45dd0e9da4119d7582018ecb67fab57e WatchSource:0}: Error finding container dd29c2831cbf40d8da84aa2bfe79244b45dd0e9da4119d7582018ecb67fab57e: Status 404 returned error can't find the container with id dd29c2831cbf40d8da84aa2bfe79244b45dd0e9da4119d7582018ecb67fab57e Mar 16 17:42:56 crc kubenswrapper[5120]: I0316 17:42:56.805167 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e5904nsqq"] Mar 16 17:42:56 crc kubenswrapper[5120]: I0316 17:42:56.902681 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e5904nsqq" event={"ID":"14fb34f4-64c5-4f35-b738-9f31a7d721ec","Type":"ContainerStarted","Data":"dd29c2831cbf40d8da84aa2bfe79244b45dd0e9da4119d7582018ecb67fab57e"} Mar 16 17:42:57 crc kubenswrapper[5120]: I0316 17:42:57.185570 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keystone-kuttl-tests/memcached-0"] Mar 16 17:42:57 crc kubenswrapper[5120]: I0316 17:42:57.190468 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/memcached-0" Mar 16 17:42:57 crc kubenswrapper[5120]: I0316 17:42:57.192787 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keystone-kuttl-tests\"/\"memcached-config-data\"" Mar 16 17:42:57 crc kubenswrapper[5120]: I0316 17:42:57.193197 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keystone-kuttl-tests\"/\"memcached-memcached-dockercfg-s52pw\"" Mar 16 17:42:57 crc kubenswrapper[5120]: I0316 17:42:57.194515 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/memcached-0"] Mar 16 17:42:57 crc kubenswrapper[5120]: I0316 17:42:57.272950 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xw8x4\" (UniqueName: \"kubernetes.io/projected/49c806d7-6ca0-45e9-91b9-98a510fb2401-kube-api-access-xw8x4\") pod \"memcached-0\" (UID: \"49c806d7-6ca0-45e9-91b9-98a510fb2401\") " pod="keystone-kuttl-tests/memcached-0" Mar 16 17:42:57 crc kubenswrapper[5120]: I0316 17:42:57.273257 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/49c806d7-6ca0-45e9-91b9-98a510fb2401-kolla-config\") pod \"memcached-0\" (UID: \"49c806d7-6ca0-45e9-91b9-98a510fb2401\") " pod="keystone-kuttl-tests/memcached-0" Mar 16 17:42:57 crc kubenswrapper[5120]: I0316 17:42:57.273395 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/49c806d7-6ca0-45e9-91b9-98a510fb2401-config-data\") pod \"memcached-0\" (UID: \"49c806d7-6ca0-45e9-91b9-98a510fb2401\") " pod="keystone-kuttl-tests/memcached-0" Mar 16 17:42:57 crc kubenswrapper[5120]: I0316 17:42:57.375488 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/49c806d7-6ca0-45e9-91b9-98a510fb2401-config-data\") pod \"memcached-0\" (UID: \"49c806d7-6ca0-45e9-91b9-98a510fb2401\") " pod="keystone-kuttl-tests/memcached-0" Mar 16 17:42:57 crc kubenswrapper[5120]: I0316 17:42:57.375662 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xw8x4\" (UniqueName: \"kubernetes.io/projected/49c806d7-6ca0-45e9-91b9-98a510fb2401-kube-api-access-xw8x4\") pod \"memcached-0\" (UID: \"49c806d7-6ca0-45e9-91b9-98a510fb2401\") " pod="keystone-kuttl-tests/memcached-0" Mar 16 17:42:57 crc kubenswrapper[5120]: I0316 17:42:57.375845 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/49c806d7-6ca0-45e9-91b9-98a510fb2401-kolla-config\") pod \"memcached-0\" (UID: \"49c806d7-6ca0-45e9-91b9-98a510fb2401\") " pod="keystone-kuttl-tests/memcached-0" Mar 16 17:42:57 crc kubenswrapper[5120]: I0316 17:42:57.376321 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/49c806d7-6ca0-45e9-91b9-98a510fb2401-config-data\") pod \"memcached-0\" (UID: \"49c806d7-6ca0-45e9-91b9-98a510fb2401\") " pod="keystone-kuttl-tests/memcached-0" Mar 16 17:42:57 crc kubenswrapper[5120]: I0316 17:42:57.376433 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/49c806d7-6ca0-45e9-91b9-98a510fb2401-kolla-config\") pod \"memcached-0\" (UID: \"49c806d7-6ca0-45e9-91b9-98a510fb2401\") " pod="keystone-kuttl-tests/memcached-0" Mar 16 17:42:57 crc kubenswrapper[5120]: I0316 17:42:57.398526 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xw8x4\" (UniqueName: \"kubernetes.io/projected/49c806d7-6ca0-45e9-91b9-98a510fb2401-kube-api-access-xw8x4\") pod \"memcached-0\" (UID: \"49c806d7-6ca0-45e9-91b9-98a510fb2401\") " pod="keystone-kuttl-tests/memcached-0" Mar 16 17:42:57 crc kubenswrapper[5120]: I0316 17:42:57.515893 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/memcached-0" Mar 16 17:42:57 crc kubenswrapper[5120]: I0316 17:42:57.911578 5120 generic.go:358] "Generic (PLEG): container finished" podID="14fb34f4-64c5-4f35-b738-9f31a7d721ec" containerID="09ecca713c9533287fd4f0ccd7b25e943e28230d953dfcb41eba32bbcb32cac0" exitCode=0 Mar 16 17:42:57 crc kubenswrapper[5120]: I0316 17:42:57.911705 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e5904nsqq" event={"ID":"14fb34f4-64c5-4f35-b738-9f31a7d721ec","Type":"ContainerDied","Data":"09ecca713c9533287fd4f0ccd7b25e943e28230d953dfcb41eba32bbcb32cac0"} Mar 16 17:42:57 crc kubenswrapper[5120]: I0316 17:42:57.958816 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/memcached-0"] Mar 16 17:42:58 crc kubenswrapper[5120]: I0316 17:42:58.922431 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/memcached-0" event={"ID":"49c806d7-6ca0-45e9-91b9-98a510fb2401","Type":"ContainerStarted","Data":"bceecb6b6350e37b21d990e1c4af2d3ad5d831111b8d7bdc1431be3370ddb257"} Mar 16 17:42:58 crc kubenswrapper[5120]: I0316 17:42:58.924138 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keystone-kuttl-tests/memcached-0" Mar 16 17:42:58 crc kubenswrapper[5120]: I0316 17:42:58.924161 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/memcached-0" event={"ID":"49c806d7-6ca0-45e9-91b9-98a510fb2401","Type":"ContainerStarted","Data":"cc1bc1962d2139b2bb10a9dad3801d5d2c502ece351fb893ff6aea09ce5ed315"} Mar 16 17:42:58 crc kubenswrapper[5120]: I0316 17:42:58.924436 5120 generic.go:358] "Generic (PLEG): container finished" podID="14fb34f4-64c5-4f35-b738-9f31a7d721ec" containerID="abc8747ef002b703dfdbd80b15177be047bfdfb14288a2d9a52283f0f001fdce" exitCode=0 Mar 16 17:42:58 crc kubenswrapper[5120]: I0316 17:42:58.924507 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e5904nsqq" event={"ID":"14fb34f4-64c5-4f35-b738-9f31a7d721ec","Type":"ContainerDied","Data":"abc8747ef002b703dfdbd80b15177be047bfdfb14288a2d9a52283f0f001fdce"} Mar 16 17:42:58 crc kubenswrapper[5120]: I0316 17:42:58.957933 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keystone-kuttl-tests/memcached-0" podStartSLOduration=1.95782969 podStartE2EDuration="1.95782969s" podCreationTimestamp="2026-03-16 17:42:57 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:42:58.942189253 +0000 UTC m=+7881.096120930" watchObservedRunningTime="2026-03-16 17:42:58.95782969 +0000 UTC m=+7881.111761347" Mar 16 17:42:59 crc kubenswrapper[5120]: I0316 17:42:59.933779 5120 generic.go:358] "Generic (PLEG): container finished" podID="14fb34f4-64c5-4f35-b738-9f31a7d721ec" containerID="940281b42e4f20fad9665786472be4b3d217d5e7d5b120787390acb96e5b8b5e" exitCode=0 Mar 16 17:42:59 crc kubenswrapper[5120]: I0316 17:42:59.933824 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e5904nsqq" event={"ID":"14fb34f4-64c5-4f35-b738-9f31a7d721ec","Type":"ContainerDied","Data":"940281b42e4f20fad9665786472be4b3d217d5e7d5b120787390acb96e5b8b5e"} Mar 16 17:43:01 crc kubenswrapper[5120]: I0316 17:43:01.215285 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e5904nsqq" Mar 16 17:43:01 crc kubenswrapper[5120]: I0316 17:43:01.257779 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/14fb34f4-64c5-4f35-b738-9f31a7d721ec-util\") pod \"14fb34f4-64c5-4f35-b738-9f31a7d721ec\" (UID: \"14fb34f4-64c5-4f35-b738-9f31a7d721ec\") " Mar 16 17:43:01 crc kubenswrapper[5120]: I0316 17:43:01.258113 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/14fb34f4-64c5-4f35-b738-9f31a7d721ec-bundle\") pod \"14fb34f4-64c5-4f35-b738-9f31a7d721ec\" (UID: \"14fb34f4-64c5-4f35-b738-9f31a7d721ec\") " Mar 16 17:43:01 crc kubenswrapper[5120]: I0316 17:43:01.258244 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qj8tq\" (UniqueName: \"kubernetes.io/projected/14fb34f4-64c5-4f35-b738-9f31a7d721ec-kube-api-access-qj8tq\") pod \"14fb34f4-64c5-4f35-b738-9f31a7d721ec\" (UID: \"14fb34f4-64c5-4f35-b738-9f31a7d721ec\") " Mar 16 17:43:01 crc kubenswrapper[5120]: I0316 17:43:01.259045 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14fb34f4-64c5-4f35-b738-9f31a7d721ec-bundle" (OuterVolumeSpecName: "bundle") pod "14fb34f4-64c5-4f35-b738-9f31a7d721ec" (UID: "14fb34f4-64c5-4f35-b738-9f31a7d721ec"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:43:01 crc kubenswrapper[5120]: I0316 17:43:01.272199 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14fb34f4-64c5-4f35-b738-9f31a7d721ec-util" (OuterVolumeSpecName: "util") pod "14fb34f4-64c5-4f35-b738-9f31a7d721ec" (UID: "14fb34f4-64c5-4f35-b738-9f31a7d721ec"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:43:01 crc kubenswrapper[5120]: I0316 17:43:01.275578 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14fb34f4-64c5-4f35-b738-9f31a7d721ec-kube-api-access-qj8tq" (OuterVolumeSpecName: "kube-api-access-qj8tq") pod "14fb34f4-64c5-4f35-b738-9f31a7d721ec" (UID: "14fb34f4-64c5-4f35-b738-9f31a7d721ec"). InnerVolumeSpecName "kube-api-access-qj8tq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:43:01 crc kubenswrapper[5120]: I0316 17:43:01.361316 5120 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/14fb34f4-64c5-4f35-b738-9f31a7d721ec-util\") on node \"crc\" DevicePath \"\"" Mar 16 17:43:01 crc kubenswrapper[5120]: I0316 17:43:01.361361 5120 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/14fb34f4-64c5-4f35-b738-9f31a7d721ec-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:43:01 crc kubenswrapper[5120]: I0316 17:43:01.361377 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qj8tq\" (UniqueName: \"kubernetes.io/projected/14fb34f4-64c5-4f35-b738-9f31a7d721ec-kube-api-access-qj8tq\") on node \"crc\" DevicePath \"\"" Mar 16 17:43:01 crc kubenswrapper[5120]: I0316 17:43:01.950242 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e5904nsqq" Mar 16 17:43:01 crc kubenswrapper[5120]: I0316 17:43:01.950317 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e5904nsqq" event={"ID":"14fb34f4-64c5-4f35-b738-9f31a7d721ec","Type":"ContainerDied","Data":"dd29c2831cbf40d8da84aa2bfe79244b45dd0e9da4119d7582018ecb67fab57e"} Mar 16 17:43:01 crc kubenswrapper[5120]: I0316 17:43:01.950352 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dd29c2831cbf40d8da84aa2bfe79244b45dd0e9da4119d7582018ecb67fab57e" Mar 16 17:43:02 crc kubenswrapper[5120]: I0316 17:43:02.238161 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-operators/rabbitmq-cluster-operator-index-nv8mm" Mar 16 17:43:02 crc kubenswrapper[5120]: I0316 17:43:02.238535 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-operators/rabbitmq-cluster-operator-index-nv8mm" Mar 16 17:43:02 crc kubenswrapper[5120]: I0316 17:43:02.274948 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-operators/rabbitmq-cluster-operator-index-nv8mm" Mar 16 17:43:02 crc kubenswrapper[5120]: I0316 17:43:02.983013 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/rabbitmq-cluster-operator-index-nv8mm" Mar 16 17:43:04 crc kubenswrapper[5120]: I0316 17:43:04.935497 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="keystone-kuttl-tests/memcached-0" Mar 16 17:43:07 crc kubenswrapper[5120]: I0316 17:43:07.040726 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-operators/rabbitmq-cluster-operator-6bc46f9cd-z4slq"] Mar 16 17:43:07 crc kubenswrapper[5120]: I0316 17:43:07.042465 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14fb34f4-64c5-4f35-b738-9f31a7d721ec" containerName="pull" Mar 16 17:43:07 crc kubenswrapper[5120]: I0316 17:43:07.042553 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="14fb34f4-64c5-4f35-b738-9f31a7d721ec" containerName="pull" Mar 16 17:43:07 crc kubenswrapper[5120]: I0316 17:43:07.042636 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14fb34f4-64c5-4f35-b738-9f31a7d721ec" containerName="extract" Mar 16 17:43:07 crc kubenswrapper[5120]: I0316 17:43:07.042695 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="14fb34f4-64c5-4f35-b738-9f31a7d721ec" containerName="extract" Mar 16 17:43:07 crc kubenswrapper[5120]: I0316 17:43:07.042791 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14fb34f4-64c5-4f35-b738-9f31a7d721ec" containerName="util" Mar 16 17:43:07 crc kubenswrapper[5120]: I0316 17:43:07.042855 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="14fb34f4-64c5-4f35-b738-9f31a7d721ec" containerName="util" Mar 16 17:43:07 crc kubenswrapper[5120]: I0316 17:43:07.043068 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="14fb34f4-64c5-4f35-b738-9f31a7d721ec" containerName="extract" Mar 16 17:43:07 crc kubenswrapper[5120]: I0316 17:43:07.083082 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/rabbitmq-cluster-operator-6bc46f9cd-z4slq"] Mar 16 17:43:07 crc kubenswrapper[5120]: I0316 17:43:07.083280 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/rabbitmq-cluster-operator-6bc46f9cd-z4slq" Mar 16 17:43:07 crc kubenswrapper[5120]: I0316 17:43:07.090220 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-operators\"/\"rabbitmq-cluster-operator-dockercfg-b7pns\"" Mar 16 17:43:07 crc kubenswrapper[5120]: I0316 17:43:07.188793 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c796r\" (UniqueName: \"kubernetes.io/projected/a88a83ee-2e20-4e9c-9281-1ff87bd15115-kube-api-access-c796r\") pod \"rabbitmq-cluster-operator-6bc46f9cd-z4slq\" (UID: \"a88a83ee-2e20-4e9c-9281-1ff87bd15115\") " pod="openstack-operators/rabbitmq-cluster-operator-6bc46f9cd-z4slq" Mar 16 17:43:07 crc kubenswrapper[5120]: I0316 17:43:07.291388 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c796r\" (UniqueName: \"kubernetes.io/projected/a88a83ee-2e20-4e9c-9281-1ff87bd15115-kube-api-access-c796r\") pod \"rabbitmq-cluster-operator-6bc46f9cd-z4slq\" (UID: \"a88a83ee-2e20-4e9c-9281-1ff87bd15115\") " pod="openstack-operators/rabbitmq-cluster-operator-6bc46f9cd-z4slq" Mar 16 17:43:07 crc kubenswrapper[5120]: I0316 17:43:07.316057 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c796r\" (UniqueName: \"kubernetes.io/projected/a88a83ee-2e20-4e9c-9281-1ff87bd15115-kube-api-access-c796r\") pod \"rabbitmq-cluster-operator-6bc46f9cd-z4slq\" (UID: \"a88a83ee-2e20-4e9c-9281-1ff87bd15115\") " pod="openstack-operators/rabbitmq-cluster-operator-6bc46f9cd-z4slq" Mar 16 17:43:07 crc kubenswrapper[5120]: I0316 17:43:07.410501 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/rabbitmq-cluster-operator-6bc46f9cd-z4slq" Mar 16 17:43:07 crc kubenswrapper[5120]: E0316 17:43:07.691682 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=990676 actualBytes=10240 Mar 16 17:43:08 crc kubenswrapper[5120]: I0316 17:43:08.299207 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/rabbitmq-cluster-operator-6bc46f9cd-z4slq"] Mar 16 17:43:08 crc kubenswrapper[5120]: I0316 17:43:08.664376 5120 scope.go:117] "RemoveContainer" containerID="7fd764dd19065c7ce437c63b05fda51970409dfa8dfd1c77e2158bb3e05b7723" Mar 16 17:43:08 crc kubenswrapper[5120]: E0316 17:43:08.665057 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 17:43:09 crc kubenswrapper[5120]: I0316 17:43:09.292177 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/rabbitmq-cluster-operator-6bc46f9cd-z4slq" event={"ID":"a88a83ee-2e20-4e9c-9281-1ff87bd15115","Type":"ContainerStarted","Data":"bb476c93a5f611b30a6f11a9df695cd5d1b10d91eb8e12e15aff6165b28ec540"} Mar 16 17:43:09 crc kubenswrapper[5120]: I0316 17:43:09.292249 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/rabbitmq-cluster-operator-6bc46f9cd-z4slq" event={"ID":"a88a83ee-2e20-4e9c-9281-1ff87bd15115","Type":"ContainerStarted","Data":"bf203b0a919ea0176c9366a6e30da99529f464784f0b513858c755b453535fcb"} Mar 16 17:43:09 crc kubenswrapper[5120]: I0316 17:43:09.309064 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/rabbitmq-cluster-operator-6bc46f9cd-z4slq" podStartSLOduration=2.309046861 podStartE2EDuration="2.309046861s" podCreationTimestamp="2026-03-16 17:43:07 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:43:09.305500615 +0000 UTC m=+7891.459432272" watchObservedRunningTime="2026-03-16 17:43:09.309046861 +0000 UTC m=+7891.462978508" Mar 16 17:43:14 crc kubenswrapper[5120]: I0316 17:43:14.317619 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-operators/057d2ef2813dbca67df99f545f5daea57175a3b6e27320c69396d55997228fj"] Mar 16 17:43:14 crc kubenswrapper[5120]: I0316 17:43:14.331676 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/057d2ef2813dbca67df99f545f5daea57175a3b6e27320c69396d55997228fj"] Mar 16 17:43:14 crc kubenswrapper[5120]: I0316 17:43:14.331851 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/057d2ef2813dbca67df99f545f5daea57175a3b6e27320c69396d55997228fj" Mar 16 17:43:14 crc kubenswrapper[5120]: I0316 17:43:14.340380 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-operators\"/\"default-dockercfg-rmzsx\"" Mar 16 17:43:14 crc kubenswrapper[5120]: I0316 17:43:14.510341 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ct6gw\" (UniqueName: \"kubernetes.io/projected/e9e7b3a8-635a-4c6c-a036-2ea36ff33888-kube-api-access-ct6gw\") pod \"057d2ef2813dbca67df99f545f5daea57175a3b6e27320c69396d55997228fj\" (UID: \"e9e7b3a8-635a-4c6c-a036-2ea36ff33888\") " pod="openstack-operators/057d2ef2813dbca67df99f545f5daea57175a3b6e27320c69396d55997228fj" Mar 16 17:43:14 crc kubenswrapper[5120]: I0316 17:43:14.510923 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e9e7b3a8-635a-4c6c-a036-2ea36ff33888-bundle\") pod \"057d2ef2813dbca67df99f545f5daea57175a3b6e27320c69396d55997228fj\" (UID: \"e9e7b3a8-635a-4c6c-a036-2ea36ff33888\") " pod="openstack-operators/057d2ef2813dbca67df99f545f5daea57175a3b6e27320c69396d55997228fj" Mar 16 17:43:14 crc kubenswrapper[5120]: I0316 17:43:14.511284 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e9e7b3a8-635a-4c6c-a036-2ea36ff33888-util\") pod \"057d2ef2813dbca67df99f545f5daea57175a3b6e27320c69396d55997228fj\" (UID: \"e9e7b3a8-635a-4c6c-a036-2ea36ff33888\") " pod="openstack-operators/057d2ef2813dbca67df99f545f5daea57175a3b6e27320c69396d55997228fj" Mar 16 17:43:14 crc kubenswrapper[5120]: I0316 17:43:14.613317 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e9e7b3a8-635a-4c6c-a036-2ea36ff33888-bundle\") pod \"057d2ef2813dbca67df99f545f5daea57175a3b6e27320c69396d55997228fj\" (UID: \"e9e7b3a8-635a-4c6c-a036-2ea36ff33888\") " pod="openstack-operators/057d2ef2813dbca67df99f545f5daea57175a3b6e27320c69396d55997228fj" Mar 16 17:43:14 crc kubenswrapper[5120]: I0316 17:43:14.613437 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e9e7b3a8-635a-4c6c-a036-2ea36ff33888-util\") pod \"057d2ef2813dbca67df99f545f5daea57175a3b6e27320c69396d55997228fj\" (UID: \"e9e7b3a8-635a-4c6c-a036-2ea36ff33888\") " pod="openstack-operators/057d2ef2813dbca67df99f545f5daea57175a3b6e27320c69396d55997228fj" Mar 16 17:43:14 crc kubenswrapper[5120]: I0316 17:43:14.613530 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ct6gw\" (UniqueName: \"kubernetes.io/projected/e9e7b3a8-635a-4c6c-a036-2ea36ff33888-kube-api-access-ct6gw\") pod \"057d2ef2813dbca67df99f545f5daea57175a3b6e27320c69396d55997228fj\" (UID: \"e9e7b3a8-635a-4c6c-a036-2ea36ff33888\") " pod="openstack-operators/057d2ef2813dbca67df99f545f5daea57175a3b6e27320c69396d55997228fj" Mar 16 17:43:14 crc kubenswrapper[5120]: I0316 17:43:14.613960 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e9e7b3a8-635a-4c6c-a036-2ea36ff33888-bundle\") pod \"057d2ef2813dbca67df99f545f5daea57175a3b6e27320c69396d55997228fj\" (UID: \"e9e7b3a8-635a-4c6c-a036-2ea36ff33888\") " pod="openstack-operators/057d2ef2813dbca67df99f545f5daea57175a3b6e27320c69396d55997228fj" Mar 16 17:43:14 crc kubenswrapper[5120]: I0316 17:43:14.614295 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e9e7b3a8-635a-4c6c-a036-2ea36ff33888-util\") pod \"057d2ef2813dbca67df99f545f5daea57175a3b6e27320c69396d55997228fj\" (UID: \"e9e7b3a8-635a-4c6c-a036-2ea36ff33888\") " pod="openstack-operators/057d2ef2813dbca67df99f545f5daea57175a3b6e27320c69396d55997228fj" Mar 16 17:43:14 crc kubenswrapper[5120]: I0316 17:43:14.633874 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ct6gw\" (UniqueName: \"kubernetes.io/projected/e9e7b3a8-635a-4c6c-a036-2ea36ff33888-kube-api-access-ct6gw\") pod \"057d2ef2813dbca67df99f545f5daea57175a3b6e27320c69396d55997228fj\" (UID: \"e9e7b3a8-635a-4c6c-a036-2ea36ff33888\") " pod="openstack-operators/057d2ef2813dbca67df99f545f5daea57175a3b6e27320c69396d55997228fj" Mar 16 17:43:14 crc kubenswrapper[5120]: I0316 17:43:14.650997 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/057d2ef2813dbca67df99f545f5daea57175a3b6e27320c69396d55997228fj" Mar 16 17:43:15 crc kubenswrapper[5120]: I0316 17:43:15.121996 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/057d2ef2813dbca67df99f545f5daea57175a3b6e27320c69396d55997228fj"] Mar 16 17:43:15 crc kubenswrapper[5120]: I0316 17:43:15.337983 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/057d2ef2813dbca67df99f545f5daea57175a3b6e27320c69396d55997228fj" event={"ID":"e9e7b3a8-635a-4c6c-a036-2ea36ff33888","Type":"ContainerStarted","Data":"1872d695e9e16cd7b7541b8b1f106cb631c473c16be63457f5cc7f26eb383f8f"} Mar 16 17:43:15 crc kubenswrapper[5120]: I0316 17:43:15.338294 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/057d2ef2813dbca67df99f545f5daea57175a3b6e27320c69396d55997228fj" event={"ID":"e9e7b3a8-635a-4c6c-a036-2ea36ff33888","Type":"ContainerStarted","Data":"c45a2c8ded51e55c9f546128d8acb303c9f3d7225d59a7f9812143668787c6fc"} Mar 16 17:43:15 crc kubenswrapper[5120]: I0316 17:43:15.880545 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-operators/keystone-operator-index-h27vf"] Mar 16 17:43:15 crc kubenswrapper[5120]: I0316 17:43:15.886720 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/keystone-operator-index-h27vf" Mar 16 17:43:15 crc kubenswrapper[5120]: I0316 17:43:15.886970 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/keystone-operator-index-h27vf"] Mar 16 17:43:15 crc kubenswrapper[5120]: I0316 17:43:15.888829 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-operators\"/\"keystone-operator-index-dockercfg-n5s87\"" Mar 16 17:43:15 crc kubenswrapper[5120]: I0316 17:43:15.945628 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcd6g\" (UniqueName: \"kubernetes.io/projected/60ff01f2-3846-4e45-bb35-e734d2c5804d-kube-api-access-mcd6g\") pod \"keystone-operator-index-h27vf\" (UID: \"60ff01f2-3846-4e45-bb35-e734d2c5804d\") " pod="openstack-operators/keystone-operator-index-h27vf" Mar 16 17:43:16 crc kubenswrapper[5120]: I0316 17:43:16.048329 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mcd6g\" (UniqueName: \"kubernetes.io/projected/60ff01f2-3846-4e45-bb35-e734d2c5804d-kube-api-access-mcd6g\") pod \"keystone-operator-index-h27vf\" (UID: \"60ff01f2-3846-4e45-bb35-e734d2c5804d\") " pod="openstack-operators/keystone-operator-index-h27vf" Mar 16 17:43:16 crc kubenswrapper[5120]: I0316 17:43:16.067729 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcd6g\" (UniqueName: \"kubernetes.io/projected/60ff01f2-3846-4e45-bb35-e734d2c5804d-kube-api-access-mcd6g\") pod \"keystone-operator-index-h27vf\" (UID: \"60ff01f2-3846-4e45-bb35-e734d2c5804d\") " pod="openstack-operators/keystone-operator-index-h27vf" Mar 16 17:43:16 crc kubenswrapper[5120]: I0316 17:43:16.230929 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/keystone-operator-index-h27vf" Mar 16 17:43:16 crc kubenswrapper[5120]: I0316 17:43:16.346363 5120 generic.go:358] "Generic (PLEG): container finished" podID="e9e7b3a8-635a-4c6c-a036-2ea36ff33888" containerID="1872d695e9e16cd7b7541b8b1f106cb631c473c16be63457f5cc7f26eb383f8f" exitCode=0 Mar 16 17:43:16 crc kubenswrapper[5120]: I0316 17:43:16.346464 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/057d2ef2813dbca67df99f545f5daea57175a3b6e27320c69396d55997228fj" event={"ID":"e9e7b3a8-635a-4c6c-a036-2ea36ff33888","Type":"ContainerDied","Data":"1872d695e9e16cd7b7541b8b1f106cb631c473c16be63457f5cc7f26eb383f8f"} Mar 16 17:43:16 crc kubenswrapper[5120]: I0316 17:43:16.648167 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/keystone-operator-index-h27vf"] Mar 16 17:43:17 crc kubenswrapper[5120]: I0316 17:43:17.358337 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/keystone-operator-index-h27vf" event={"ID":"60ff01f2-3846-4e45-bb35-e734d2c5804d","Type":"ContainerStarted","Data":"bf4605e1f9df690049339ca793db88743dea4128de5618f9da1f34e5fad468c4"} Mar 16 17:43:17 crc kubenswrapper[5120]: I0316 17:43:17.360899 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/057d2ef2813dbca67df99f545f5daea57175a3b6e27320c69396d55997228fj" event={"ID":"e9e7b3a8-635a-4c6c-a036-2ea36ff33888","Type":"ContainerStarted","Data":"4d93a08675a328519f918068adf6e02d6ffde7101266977244cec288685e428f"} Mar 16 17:43:18 crc kubenswrapper[5120]: I0316 17:43:18.372237 5120 generic.go:358] "Generic (PLEG): container finished" podID="e9e7b3a8-635a-4c6c-a036-2ea36ff33888" containerID="4d93a08675a328519f918068adf6e02d6ffde7101266977244cec288685e428f" exitCode=0 Mar 16 17:43:18 crc kubenswrapper[5120]: I0316 17:43:18.372596 5120 generic.go:358] "Generic (PLEG): container finished" podID="e9e7b3a8-635a-4c6c-a036-2ea36ff33888" containerID="e609d585317870f82f1016d9f2cc3a63df0aff6290191d03a65d432c265683f3" exitCode=0 Mar 16 17:43:18 crc kubenswrapper[5120]: I0316 17:43:18.372313 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/057d2ef2813dbca67df99f545f5daea57175a3b6e27320c69396d55997228fj" event={"ID":"e9e7b3a8-635a-4c6c-a036-2ea36ff33888","Type":"ContainerDied","Data":"4d93a08675a328519f918068adf6e02d6ffde7101266977244cec288685e428f"} Mar 16 17:43:18 crc kubenswrapper[5120]: I0316 17:43:18.372719 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/057d2ef2813dbca67df99f545f5daea57175a3b6e27320c69396d55997228fj" event={"ID":"e9e7b3a8-635a-4c6c-a036-2ea36ff33888","Type":"ContainerDied","Data":"e609d585317870f82f1016d9f2cc3a63df0aff6290191d03a65d432c265683f3"} Mar 16 17:43:18 crc kubenswrapper[5120]: I0316 17:43:18.375175 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/keystone-operator-index-h27vf" event={"ID":"60ff01f2-3846-4e45-bb35-e734d2c5804d","Type":"ContainerStarted","Data":"d339160330084931a6f81e00cb3f6eb0189e226fbfe0d1af50bfce0d94fae1cc"} Mar 16 17:43:18 crc kubenswrapper[5120]: I0316 17:43:18.407369 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/keystone-operator-index-h27vf" podStartSLOduration=2.82858231 podStartE2EDuration="3.407351545s" podCreationTimestamp="2026-03-16 17:43:15 +0000 UTC" firstStartedPulling="2026-03-16 17:43:16.657537199 +0000 UTC m=+7898.811468856" lastFinishedPulling="2026-03-16 17:43:17.236306434 +0000 UTC m=+7899.390238091" observedRunningTime="2026-03-16 17:43:18.405162396 +0000 UTC m=+7900.559094053" watchObservedRunningTime="2026-03-16 17:43:18.407351545 +0000 UTC m=+7900.561283202" Mar 16 17:43:19 crc kubenswrapper[5120]: I0316 17:43:19.663453 5120 scope.go:117] "RemoveContainer" containerID="7fd764dd19065c7ce437c63b05fda51970409dfa8dfd1c77e2158bb3e05b7723" Mar 16 17:43:19 crc kubenswrapper[5120]: E0316 17:43:19.664146 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 17:43:19 crc kubenswrapper[5120]: I0316 17:43:19.667501 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/057d2ef2813dbca67df99f545f5daea57175a3b6e27320c69396d55997228fj" Mar 16 17:43:19 crc kubenswrapper[5120]: I0316 17:43:19.732598 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ct6gw\" (UniqueName: \"kubernetes.io/projected/e9e7b3a8-635a-4c6c-a036-2ea36ff33888-kube-api-access-ct6gw\") pod \"e9e7b3a8-635a-4c6c-a036-2ea36ff33888\" (UID: \"e9e7b3a8-635a-4c6c-a036-2ea36ff33888\") " Mar 16 17:43:19 crc kubenswrapper[5120]: I0316 17:43:19.732754 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e9e7b3a8-635a-4c6c-a036-2ea36ff33888-util\") pod \"e9e7b3a8-635a-4c6c-a036-2ea36ff33888\" (UID: \"e9e7b3a8-635a-4c6c-a036-2ea36ff33888\") " Mar 16 17:43:19 crc kubenswrapper[5120]: I0316 17:43:19.732791 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e9e7b3a8-635a-4c6c-a036-2ea36ff33888-bundle\") pod \"e9e7b3a8-635a-4c6c-a036-2ea36ff33888\" (UID: \"e9e7b3a8-635a-4c6c-a036-2ea36ff33888\") " Mar 16 17:43:19 crc kubenswrapper[5120]: I0316 17:43:19.735941 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9e7b3a8-635a-4c6c-a036-2ea36ff33888-bundle" (OuterVolumeSpecName: "bundle") pod "e9e7b3a8-635a-4c6c-a036-2ea36ff33888" (UID: "e9e7b3a8-635a-4c6c-a036-2ea36ff33888"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:43:19 crc kubenswrapper[5120]: I0316 17:43:19.738646 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9e7b3a8-635a-4c6c-a036-2ea36ff33888-kube-api-access-ct6gw" (OuterVolumeSpecName: "kube-api-access-ct6gw") pod "e9e7b3a8-635a-4c6c-a036-2ea36ff33888" (UID: "e9e7b3a8-635a-4c6c-a036-2ea36ff33888"). InnerVolumeSpecName "kube-api-access-ct6gw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:43:19 crc kubenswrapper[5120]: I0316 17:43:19.746200 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9e7b3a8-635a-4c6c-a036-2ea36ff33888-util" (OuterVolumeSpecName: "util") pod "e9e7b3a8-635a-4c6c-a036-2ea36ff33888" (UID: "e9e7b3a8-635a-4c6c-a036-2ea36ff33888"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:43:19 crc kubenswrapper[5120]: I0316 17:43:19.838866 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ct6gw\" (UniqueName: \"kubernetes.io/projected/e9e7b3a8-635a-4c6c-a036-2ea36ff33888-kube-api-access-ct6gw\") on node \"crc\" DevicePath \"\"" Mar 16 17:43:19 crc kubenswrapper[5120]: I0316 17:43:19.839283 5120 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e9e7b3a8-635a-4c6c-a036-2ea36ff33888-util\") on node \"crc\" DevicePath \"\"" Mar 16 17:43:19 crc kubenswrapper[5120]: I0316 17:43:19.839430 5120 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e9e7b3a8-635a-4c6c-a036-2ea36ff33888-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:43:20 crc kubenswrapper[5120]: I0316 17:43:20.403745 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/057d2ef2813dbca67df99f545f5daea57175a3b6e27320c69396d55997228fj" event={"ID":"e9e7b3a8-635a-4c6c-a036-2ea36ff33888","Type":"ContainerDied","Data":"c45a2c8ded51e55c9f546128d8acb303c9f3d7225d59a7f9812143668787c6fc"} Mar 16 17:43:20 crc kubenswrapper[5120]: I0316 17:43:20.404014 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c45a2c8ded51e55c9f546128d8acb303c9f3d7225d59a7f9812143668787c6fc" Mar 16 17:43:20 crc kubenswrapper[5120]: I0316 17:43:20.403808 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/057d2ef2813dbca67df99f545f5daea57175a3b6e27320c69396d55997228fj" Mar 16 17:43:21 crc kubenswrapper[5120]: I0316 17:43:21.089258 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-operators-cxnvm"] Mar 16 17:43:21 crc kubenswrapper[5120]: I0316 17:43:21.090003 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9e7b3a8-635a-4c6c-a036-2ea36ff33888" containerName="util" Mar 16 17:43:21 crc kubenswrapper[5120]: I0316 17:43:21.090016 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9e7b3a8-635a-4c6c-a036-2ea36ff33888" containerName="util" Mar 16 17:43:21 crc kubenswrapper[5120]: I0316 17:43:21.090025 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9e7b3a8-635a-4c6c-a036-2ea36ff33888" containerName="extract" Mar 16 17:43:21 crc kubenswrapper[5120]: I0316 17:43:21.090031 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9e7b3a8-635a-4c6c-a036-2ea36ff33888" containerName="extract" Mar 16 17:43:21 crc kubenswrapper[5120]: I0316 17:43:21.090042 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9e7b3a8-635a-4c6c-a036-2ea36ff33888" containerName="pull" Mar 16 17:43:21 crc kubenswrapper[5120]: I0316 17:43:21.090050 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9e7b3a8-635a-4c6c-a036-2ea36ff33888" containerName="pull" Mar 16 17:43:21 crc kubenswrapper[5120]: I0316 17:43:21.090229 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e9e7b3a8-635a-4c6c-a036-2ea36ff33888" containerName="extract" Mar 16 17:43:21 crc kubenswrapper[5120]: I0316 17:43:21.096928 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-cxnvm" Mar 16 17:43:21 crc kubenswrapper[5120]: I0316 17:43:21.102697 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-cxnvm"] Mar 16 17:43:21 crc kubenswrapper[5120]: I0316 17:43:21.273044 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-442df\" (UniqueName: \"kubernetes.io/projected/f5c4787f-e8dd-45ab-9932-3db343fa8673-kube-api-access-442df\") pod \"redhat-operators-cxnvm\" (UID: \"f5c4787f-e8dd-45ab-9932-3db343fa8673\") " pod="openshift-marketplace/redhat-operators-cxnvm" Mar 16 17:43:21 crc kubenswrapper[5120]: I0316 17:43:21.273631 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/f5c4787f-e8dd-45ab-9932-3db343fa8673-utilities\") pod \"redhat-operators-cxnvm\" (UID: \"f5c4787f-e8dd-45ab-9932-3db343fa8673\") " pod="openshift-marketplace/redhat-operators-cxnvm" Mar 16 17:43:21 crc kubenswrapper[5120]: I0316 17:43:21.273750 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/f5c4787f-e8dd-45ab-9932-3db343fa8673-catalog-content\") pod \"redhat-operators-cxnvm\" (UID: \"f5c4787f-e8dd-45ab-9932-3db343fa8673\") " pod="openshift-marketplace/redhat-operators-cxnvm" Mar 16 17:43:21 crc kubenswrapper[5120]: I0316 17:43:21.278092 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/keystone-operator-index-h27vf"] Mar 16 17:43:21 crc kubenswrapper[5120]: I0316 17:43:21.278356 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-operators/keystone-operator-index-h27vf" podUID="60ff01f2-3846-4e45-bb35-e734d2c5804d" containerName="registry-server" containerID="cri-o://d339160330084931a6f81e00cb3f6eb0189e226fbfe0d1af50bfce0d94fae1cc" gracePeriod=2 Mar 16 17:43:21 crc kubenswrapper[5120]: I0316 17:43:21.376096 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/f5c4787f-e8dd-45ab-9932-3db343fa8673-utilities\") pod \"redhat-operators-cxnvm\" (UID: \"f5c4787f-e8dd-45ab-9932-3db343fa8673\") " pod="openshift-marketplace/redhat-operators-cxnvm" Mar 16 17:43:21 crc kubenswrapper[5120]: I0316 17:43:21.376177 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/f5c4787f-e8dd-45ab-9932-3db343fa8673-catalog-content\") pod \"redhat-operators-cxnvm\" (UID: \"f5c4787f-e8dd-45ab-9932-3db343fa8673\") " pod="openshift-marketplace/redhat-operators-cxnvm" Mar 16 17:43:21 crc kubenswrapper[5120]: I0316 17:43:21.376222 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-442df\" (UniqueName: \"kubernetes.io/projected/f5c4787f-e8dd-45ab-9932-3db343fa8673-kube-api-access-442df\") pod \"redhat-operators-cxnvm\" (UID: \"f5c4787f-e8dd-45ab-9932-3db343fa8673\") " pod="openshift-marketplace/redhat-operators-cxnvm" Mar 16 17:43:21 crc kubenswrapper[5120]: I0316 17:43:21.377059 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/f5c4787f-e8dd-45ab-9932-3db343fa8673-utilities\") pod \"redhat-operators-cxnvm\" (UID: \"f5c4787f-e8dd-45ab-9932-3db343fa8673\") " pod="openshift-marketplace/redhat-operators-cxnvm" Mar 16 17:43:21 crc kubenswrapper[5120]: I0316 17:43:21.377187 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/f5c4787f-e8dd-45ab-9932-3db343fa8673-catalog-content\") pod \"redhat-operators-cxnvm\" (UID: \"f5c4787f-e8dd-45ab-9932-3db343fa8673\") " pod="openshift-marketplace/redhat-operators-cxnvm" Mar 16 17:43:21 crc kubenswrapper[5120]: I0316 17:43:21.403540 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-442df\" (UniqueName: \"kubernetes.io/projected/f5c4787f-e8dd-45ab-9932-3db343fa8673-kube-api-access-442df\") pod \"redhat-operators-cxnvm\" (UID: \"f5c4787f-e8dd-45ab-9932-3db343fa8673\") " pod="openshift-marketplace/redhat-operators-cxnvm" Mar 16 17:43:21 crc kubenswrapper[5120]: I0316 17:43:21.415771 5120 generic.go:358] "Generic (PLEG): container finished" podID="60ff01f2-3846-4e45-bb35-e734d2c5804d" containerID="d339160330084931a6f81e00cb3f6eb0189e226fbfe0d1af50bfce0d94fae1cc" exitCode=0 Mar 16 17:43:21 crc kubenswrapper[5120]: I0316 17:43:21.416077 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/keystone-operator-index-h27vf" event={"ID":"60ff01f2-3846-4e45-bb35-e734d2c5804d","Type":"ContainerDied","Data":"d339160330084931a6f81e00cb3f6eb0189e226fbfe0d1af50bfce0d94fae1cc"} Mar 16 17:43:21 crc kubenswrapper[5120]: I0316 17:43:21.418246 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-cxnvm" Mar 16 17:43:21 crc kubenswrapper[5120]: I0316 17:43:21.704409 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/keystone-operator-index-h27vf" Mar 16 17:43:21 crc kubenswrapper[5120]: I0316 17:43:21.885111 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-cxnvm"] Mar 16 17:43:21 crc kubenswrapper[5120]: I0316 17:43:21.886062 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mcd6g\" (UniqueName: \"kubernetes.io/projected/60ff01f2-3846-4e45-bb35-e734d2c5804d-kube-api-access-mcd6g\") pod \"60ff01f2-3846-4e45-bb35-e734d2c5804d\" (UID: \"60ff01f2-3846-4e45-bb35-e734d2c5804d\") " Mar 16 17:43:21 crc kubenswrapper[5120]: W0316 17:43:21.886841 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5c4787f_e8dd_45ab_9932_3db343fa8673.slice/crio-4c8d78305b981d40058e6d8c4c6ff820d35031d1345592592ccab6bbe2f2e66f WatchSource:0}: Error finding container 4c8d78305b981d40058e6d8c4c6ff820d35031d1345592592ccab6bbe2f2e66f: Status 404 returned error can't find the container with id 4c8d78305b981d40058e6d8c4c6ff820d35031d1345592592ccab6bbe2f2e66f Mar 16 17:43:21 crc kubenswrapper[5120]: I0316 17:43:21.892226 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60ff01f2-3846-4e45-bb35-e734d2c5804d-kube-api-access-mcd6g" (OuterVolumeSpecName: "kube-api-access-mcd6g") pod "60ff01f2-3846-4e45-bb35-e734d2c5804d" (UID: "60ff01f2-3846-4e45-bb35-e734d2c5804d"). InnerVolumeSpecName "kube-api-access-mcd6g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:43:21 crc kubenswrapper[5120]: I0316 17:43:21.988338 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mcd6g\" (UniqueName: \"kubernetes.io/projected/60ff01f2-3846-4e45-bb35-e734d2c5804d-kube-api-access-mcd6g\") on node \"crc\" DevicePath \"\"" Mar 16 17:43:22 crc kubenswrapper[5120]: I0316 17:43:22.081825 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-operators/keystone-operator-index-rrq9j"] Mar 16 17:43:22 crc kubenswrapper[5120]: I0316 17:43:22.082548 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60ff01f2-3846-4e45-bb35-e734d2c5804d" containerName="registry-server" Mar 16 17:43:22 crc kubenswrapper[5120]: I0316 17:43:22.082567 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="60ff01f2-3846-4e45-bb35-e734d2c5804d" containerName="registry-server" Mar 16 17:43:22 crc kubenswrapper[5120]: I0316 17:43:22.082702 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="60ff01f2-3846-4e45-bb35-e734d2c5804d" containerName="registry-server" Mar 16 17:43:22 crc kubenswrapper[5120]: I0316 17:43:22.086083 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/keystone-operator-index-rrq9j" Mar 16 17:43:22 crc kubenswrapper[5120]: I0316 17:43:22.094655 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/keystone-operator-index-rrq9j"] Mar 16 17:43:22 crc kubenswrapper[5120]: I0316 17:43:22.193329 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjnrq\" (UniqueName: \"kubernetes.io/projected/9a1292d7-3e03-4267-b305-26808b8fd162-kube-api-access-tjnrq\") pod \"keystone-operator-index-rrq9j\" (UID: \"9a1292d7-3e03-4267-b305-26808b8fd162\") " pod="openstack-operators/keystone-operator-index-rrq9j" Mar 16 17:43:22 crc kubenswrapper[5120]: I0316 17:43:22.305501 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tjnrq\" (UniqueName: \"kubernetes.io/projected/9a1292d7-3e03-4267-b305-26808b8fd162-kube-api-access-tjnrq\") pod \"keystone-operator-index-rrq9j\" (UID: \"9a1292d7-3e03-4267-b305-26808b8fd162\") " pod="openstack-operators/keystone-operator-index-rrq9j" Mar 16 17:43:22 crc kubenswrapper[5120]: I0316 17:43:22.332997 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjnrq\" (UniqueName: \"kubernetes.io/projected/9a1292d7-3e03-4267-b305-26808b8fd162-kube-api-access-tjnrq\") pod \"keystone-operator-index-rrq9j\" (UID: \"9a1292d7-3e03-4267-b305-26808b8fd162\") " pod="openstack-operators/keystone-operator-index-rrq9j" Mar 16 17:43:22 crc kubenswrapper[5120]: I0316 17:43:22.416730 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/keystone-operator-index-rrq9j" Mar 16 17:43:22 crc kubenswrapper[5120]: I0316 17:43:22.426250 5120 generic.go:358] "Generic (PLEG): container finished" podID="f5c4787f-e8dd-45ab-9932-3db343fa8673" containerID="9f93f5efb6c65b86dedcedd0230f5f9c0d9d62f57baa9190fbb1f4363863a8c5" exitCode=0 Mar 16 17:43:22 crc kubenswrapper[5120]: I0316 17:43:22.426345 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-cxnvm" event={"ID":"f5c4787f-e8dd-45ab-9932-3db343fa8673","Type":"ContainerDied","Data":"9f93f5efb6c65b86dedcedd0230f5f9c0d9d62f57baa9190fbb1f4363863a8c5"} Mar 16 17:43:22 crc kubenswrapper[5120]: I0316 17:43:22.426405 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-cxnvm" event={"ID":"f5c4787f-e8dd-45ab-9932-3db343fa8673","Type":"ContainerStarted","Data":"4c8d78305b981d40058e6d8c4c6ff820d35031d1345592592ccab6bbe2f2e66f"} Mar 16 17:43:22 crc kubenswrapper[5120]: I0316 17:43:22.429529 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/keystone-operator-index-h27vf" event={"ID":"60ff01f2-3846-4e45-bb35-e734d2c5804d","Type":"ContainerDied","Data":"bf4605e1f9df690049339ca793db88743dea4128de5618f9da1f34e5fad468c4"} Mar 16 17:43:22 crc kubenswrapper[5120]: I0316 17:43:22.429669 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/keystone-operator-index-h27vf" Mar 16 17:43:22 crc kubenswrapper[5120]: I0316 17:43:22.429967 5120 scope.go:117] "RemoveContainer" containerID="d339160330084931a6f81e00cb3f6eb0189e226fbfe0d1af50bfce0d94fae1cc" Mar 16 17:43:22 crc kubenswrapper[5120]: I0316 17:43:22.497111 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/keystone-operator-index-h27vf"] Mar 16 17:43:22 crc kubenswrapper[5120]: I0316 17:43:22.501676 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-operators/keystone-operator-index-h27vf"] Mar 16 17:43:22 crc kubenswrapper[5120]: I0316 17:43:22.652361 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/keystone-operator-index-rrq9j"] Mar 16 17:43:22 crc kubenswrapper[5120]: I0316 17:43:22.675279 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="60ff01f2-3846-4e45-bb35-e734d2c5804d" path="/var/lib/kubelet/pods/60ff01f2-3846-4e45-bb35-e734d2c5804d/volumes" Mar 16 17:43:23 crc kubenswrapper[5120]: I0316 17:43:23.437692 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/keystone-operator-index-rrq9j" event={"ID":"9a1292d7-3e03-4267-b305-26808b8fd162","Type":"ContainerStarted","Data":"262e38d62fd1776c859463a0eb9e46611c3970663cb3e27fda914e13bb3e1b16"} Mar 16 17:43:23 crc kubenswrapper[5120]: I0316 17:43:23.438058 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/keystone-operator-index-rrq9j" event={"ID":"9a1292d7-3e03-4267-b305-26808b8fd162","Type":"ContainerStarted","Data":"8e9f4aecdf7df359b3afecf93ecd7d2dd93d9da6dc856cb9e0645c01628edda2"} Mar 16 17:43:28 crc kubenswrapper[5120]: I0316 17:43:28.017067 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/keystone-operator-index-rrq9j" podStartSLOduration=5.578699623 podStartE2EDuration="6.017043805s" podCreationTimestamp="2026-03-16 17:43:22 +0000 UTC" firstStartedPulling="2026-03-16 17:43:22.658212585 +0000 UTC m=+7904.812144242" lastFinishedPulling="2026-03-16 17:43:23.096556767 +0000 UTC m=+7905.250488424" observedRunningTime="2026-03-16 17:43:23.450118983 +0000 UTC m=+7905.604050650" watchObservedRunningTime="2026-03-16 17:43:28.017043805 +0000 UTC m=+7910.170975462" Mar 16 17:43:28 crc kubenswrapper[5120]: I0316 17:43:28.021163 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keystone-kuttl-tests/rabbitmq-server-0"] Mar 16 17:43:28 crc kubenswrapper[5120]: I0316 17:43:28.047713 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/rabbitmq-server-0"] Mar 16 17:43:28 crc kubenswrapper[5120]: I0316 17:43:28.048224 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/rabbitmq-server-0" Mar 16 17:43:28 crc kubenswrapper[5120]: I0316 17:43:28.053564 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keystone-kuttl-tests\"/\"rabbitmq-default-user\"" Mar 16 17:43:28 crc kubenswrapper[5120]: I0316 17:43:28.053809 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keystone-kuttl-tests\"/\"rabbitmq-erlang-cookie\"" Mar 16 17:43:28 crc kubenswrapper[5120]: I0316 17:43:28.054384 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keystone-kuttl-tests\"/\"rabbitmq-server-dockercfg-7qs4p\"" Mar 16 17:43:28 crc kubenswrapper[5120]: I0316 17:43:28.057056 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keystone-kuttl-tests\"/\"rabbitmq-plugins-conf\"" Mar 16 17:43:28 crc kubenswrapper[5120]: I0316 17:43:28.057216 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keystone-kuttl-tests\"/\"rabbitmq-server-conf\"" Mar 16 17:43:28 crc kubenswrapper[5120]: I0316 17:43:28.152003 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/69818304-cbec-4828-a572-6bbc566dc6b7-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"69818304-cbec-4828-a572-6bbc566dc6b7\") " pod="keystone-kuttl-tests/rabbitmq-server-0" Mar 16 17:43:28 crc kubenswrapper[5120]: I0316 17:43:28.152077 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/69818304-cbec-4828-a572-6bbc566dc6b7-pod-info\") pod \"rabbitmq-server-0\" (UID: \"69818304-cbec-4828-a572-6bbc566dc6b7\") " pod="keystone-kuttl-tests/rabbitmq-server-0" Mar 16 17:43:28 crc kubenswrapper[5120]: I0316 17:43:28.152191 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-66456a9b-2e8d-4f46-8bb0-3aa71b4bc3b8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-66456a9b-2e8d-4f46-8bb0-3aa71b4bc3b8\") pod \"rabbitmq-server-0\" (UID: \"69818304-cbec-4828-a572-6bbc566dc6b7\") " pod="keystone-kuttl-tests/rabbitmq-server-0" Mar 16 17:43:28 crc kubenswrapper[5120]: I0316 17:43:28.152565 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/69818304-cbec-4828-a572-6bbc566dc6b7-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"69818304-cbec-4828-a572-6bbc566dc6b7\") " pod="keystone-kuttl-tests/rabbitmq-server-0" Mar 16 17:43:28 crc kubenswrapper[5120]: I0316 17:43:28.152595 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/69818304-cbec-4828-a572-6bbc566dc6b7-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"69818304-cbec-4828-a572-6bbc566dc6b7\") " pod="keystone-kuttl-tests/rabbitmq-server-0" Mar 16 17:43:28 crc kubenswrapper[5120]: I0316 17:43:28.152789 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/69818304-cbec-4828-a572-6bbc566dc6b7-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"69818304-cbec-4828-a572-6bbc566dc6b7\") " pod="keystone-kuttl-tests/rabbitmq-server-0" Mar 16 17:43:28 crc kubenswrapper[5120]: I0316 17:43:28.152820 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/69818304-cbec-4828-a572-6bbc566dc6b7-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"69818304-cbec-4828-a572-6bbc566dc6b7\") " pod="keystone-kuttl-tests/rabbitmq-server-0" Mar 16 17:43:28 crc kubenswrapper[5120]: I0316 17:43:28.152861 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5q69\" (UniqueName: \"kubernetes.io/projected/69818304-cbec-4828-a572-6bbc566dc6b7-kube-api-access-w5q69\") pod \"rabbitmq-server-0\" (UID: \"69818304-cbec-4828-a572-6bbc566dc6b7\") " pod="keystone-kuttl-tests/rabbitmq-server-0" Mar 16 17:43:28 crc kubenswrapper[5120]: I0316 17:43:28.255114 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/69818304-cbec-4828-a572-6bbc566dc6b7-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"69818304-cbec-4828-a572-6bbc566dc6b7\") " pod="keystone-kuttl-tests/rabbitmq-server-0" Mar 16 17:43:28 crc kubenswrapper[5120]: I0316 17:43:28.255162 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/69818304-cbec-4828-a572-6bbc566dc6b7-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"69818304-cbec-4828-a572-6bbc566dc6b7\") " pod="keystone-kuttl-tests/rabbitmq-server-0" Mar 16 17:43:28 crc kubenswrapper[5120]: I0316 17:43:28.255187 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w5q69\" (UniqueName: \"kubernetes.io/projected/69818304-cbec-4828-a572-6bbc566dc6b7-kube-api-access-w5q69\") pod \"rabbitmq-server-0\" (UID: \"69818304-cbec-4828-a572-6bbc566dc6b7\") " pod="keystone-kuttl-tests/rabbitmq-server-0" Mar 16 17:43:28 crc kubenswrapper[5120]: I0316 17:43:28.255285 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/69818304-cbec-4828-a572-6bbc566dc6b7-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"69818304-cbec-4828-a572-6bbc566dc6b7\") " pod="keystone-kuttl-tests/rabbitmq-server-0" Mar 16 17:43:28 crc kubenswrapper[5120]: I0316 17:43:28.255338 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/69818304-cbec-4828-a572-6bbc566dc6b7-pod-info\") pod \"rabbitmq-server-0\" (UID: \"69818304-cbec-4828-a572-6bbc566dc6b7\") " pod="keystone-kuttl-tests/rabbitmq-server-0" Mar 16 17:43:28 crc kubenswrapper[5120]: I0316 17:43:28.255365 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pvc-66456a9b-2e8d-4f46-8bb0-3aa71b4bc3b8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-66456a9b-2e8d-4f46-8bb0-3aa71b4bc3b8\") pod \"rabbitmq-server-0\" (UID: \"69818304-cbec-4828-a572-6bbc566dc6b7\") " pod="keystone-kuttl-tests/rabbitmq-server-0" Mar 16 17:43:28 crc kubenswrapper[5120]: I0316 17:43:28.255522 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/69818304-cbec-4828-a572-6bbc566dc6b7-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"69818304-cbec-4828-a572-6bbc566dc6b7\") " pod="keystone-kuttl-tests/rabbitmq-server-0" Mar 16 17:43:28 crc kubenswrapper[5120]: I0316 17:43:28.255542 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/69818304-cbec-4828-a572-6bbc566dc6b7-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"69818304-cbec-4828-a572-6bbc566dc6b7\") " pod="keystone-kuttl-tests/rabbitmq-server-0" Mar 16 17:43:28 crc kubenswrapper[5120]: I0316 17:43:28.256540 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/69818304-cbec-4828-a572-6bbc566dc6b7-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"69818304-cbec-4828-a572-6bbc566dc6b7\") " pod="keystone-kuttl-tests/rabbitmq-server-0" Mar 16 17:43:28 crc kubenswrapper[5120]: I0316 17:43:28.256668 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/69818304-cbec-4828-a572-6bbc566dc6b7-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"69818304-cbec-4828-a572-6bbc566dc6b7\") " pod="keystone-kuttl-tests/rabbitmq-server-0" Mar 16 17:43:28 crc kubenswrapper[5120]: I0316 17:43:28.257803 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/69818304-cbec-4828-a572-6bbc566dc6b7-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"69818304-cbec-4828-a572-6bbc566dc6b7\") " pod="keystone-kuttl-tests/rabbitmq-server-0" Mar 16 17:43:28 crc kubenswrapper[5120]: I0316 17:43:28.263408 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/69818304-cbec-4828-a572-6bbc566dc6b7-pod-info\") pod \"rabbitmq-server-0\" (UID: \"69818304-cbec-4828-a572-6bbc566dc6b7\") " pod="keystone-kuttl-tests/rabbitmq-server-0" Mar 16 17:43:28 crc kubenswrapper[5120]: I0316 17:43:28.263413 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/69818304-cbec-4828-a572-6bbc566dc6b7-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"69818304-cbec-4828-a572-6bbc566dc6b7\") " pod="keystone-kuttl-tests/rabbitmq-server-0" Mar 16 17:43:28 crc kubenswrapper[5120]: I0316 17:43:28.265958 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/69818304-cbec-4828-a572-6bbc566dc6b7-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"69818304-cbec-4828-a572-6bbc566dc6b7\") " pod="keystone-kuttl-tests/rabbitmq-server-0" Mar 16 17:43:28 crc kubenswrapper[5120]: I0316 17:43:28.270069 5120 csi_attacher.go:373] kubernetes.io/csi: attacher.MountDevice STAGE_UNSTAGE_VOLUME capability not set. Skipping MountDevice... Mar 16 17:43:28 crc kubenswrapper[5120]: I0316 17:43:28.270095 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"pvc-66456a9b-2e8d-4f46-8bb0-3aa71b4bc3b8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-66456a9b-2e8d-4f46-8bb0-3aa71b4bc3b8\") pod \"rabbitmq-server-0\" (UID: \"69818304-cbec-4828-a572-6bbc566dc6b7\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/kubevirt.io.hostpath-provisioner/a1a7373cea705e2d5762f6b0ed4c29083b8f8bbbfb6ef630451ebac4fbd22387/globalmount\"" pod="keystone-kuttl-tests/rabbitmq-server-0" Mar 16 17:43:28 crc kubenswrapper[5120]: I0316 17:43:28.277939 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5q69\" (UniqueName: \"kubernetes.io/projected/69818304-cbec-4828-a572-6bbc566dc6b7-kube-api-access-w5q69\") pod \"rabbitmq-server-0\" (UID: \"69818304-cbec-4828-a572-6bbc566dc6b7\") " pod="keystone-kuttl-tests/rabbitmq-server-0" Mar 16 17:43:28 crc kubenswrapper[5120]: I0316 17:43:28.306257 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-66456a9b-2e8d-4f46-8bb0-3aa71b4bc3b8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-66456a9b-2e8d-4f46-8bb0-3aa71b4bc3b8\") pod \"rabbitmq-server-0\" (UID: \"69818304-cbec-4828-a572-6bbc566dc6b7\") " pod="keystone-kuttl-tests/rabbitmq-server-0" Mar 16 17:43:28 crc kubenswrapper[5120]: I0316 17:43:28.387513 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/rabbitmq-server-0" Mar 16 17:43:31 crc kubenswrapper[5120]: I0316 17:43:31.664811 5120 scope.go:117] "RemoveContainer" containerID="7fd764dd19065c7ce437c63b05fda51970409dfa8dfd1c77e2158bb3e05b7723" Mar 16 17:43:31 crc kubenswrapper[5120]: E0316 17:43:31.665315 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 17:43:31 crc kubenswrapper[5120]: I0316 17:43:31.841427 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-operators/keystone-operator-controller-manager-75689cbc47-kqlwb"] Mar 16 17:43:31 crc kubenswrapper[5120]: I0316 17:43:31.854124 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/keystone-operator-controller-manager-75689cbc47-kqlwb" Mar 16 17:43:31 crc kubenswrapper[5120]: I0316 17:43:31.860618 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/keystone-operator-controller-manager-75689cbc47-kqlwb"] Mar 16 17:43:31 crc kubenswrapper[5120]: I0316 17:43:31.869430 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-operators\"/\"keystone-operator-controller-manager-service-cert\"" Mar 16 17:43:31 crc kubenswrapper[5120]: I0316 17:43:31.869866 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-operators\"/\"keystone-operator-controller-manager-dockercfg-cdvnt\"" Mar 16 17:43:31 crc kubenswrapper[5120]: I0316 17:43:31.938939 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7z2t\" (UniqueName: \"kubernetes.io/projected/df2f32a6-2b43-495a-be3d-53a4eb60b528-kube-api-access-t7z2t\") pod \"keystone-operator-controller-manager-75689cbc47-kqlwb\" (UID: \"df2f32a6-2b43-495a-be3d-53a4eb60b528\") " pod="openstack-operators/keystone-operator-controller-manager-75689cbc47-kqlwb" Mar 16 17:43:31 crc kubenswrapper[5120]: I0316 17:43:31.939336 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/df2f32a6-2b43-495a-be3d-53a4eb60b528-webhook-cert\") pod \"keystone-operator-controller-manager-75689cbc47-kqlwb\" (UID: \"df2f32a6-2b43-495a-be3d-53a4eb60b528\") " pod="openstack-operators/keystone-operator-controller-manager-75689cbc47-kqlwb" Mar 16 17:43:31 crc kubenswrapper[5120]: I0316 17:43:31.939686 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/df2f32a6-2b43-495a-be3d-53a4eb60b528-apiservice-cert\") pod \"keystone-operator-controller-manager-75689cbc47-kqlwb\" (UID: \"df2f32a6-2b43-495a-be3d-53a4eb60b528\") " pod="openstack-operators/keystone-operator-controller-manager-75689cbc47-kqlwb" Mar 16 17:43:32 crc kubenswrapper[5120]: I0316 17:43:32.041593 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t7z2t\" (UniqueName: \"kubernetes.io/projected/df2f32a6-2b43-495a-be3d-53a4eb60b528-kube-api-access-t7z2t\") pod \"keystone-operator-controller-manager-75689cbc47-kqlwb\" (UID: \"df2f32a6-2b43-495a-be3d-53a4eb60b528\") " pod="openstack-operators/keystone-operator-controller-manager-75689cbc47-kqlwb" Mar 16 17:43:32 crc kubenswrapper[5120]: I0316 17:43:32.041795 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/df2f32a6-2b43-495a-be3d-53a4eb60b528-webhook-cert\") pod \"keystone-operator-controller-manager-75689cbc47-kqlwb\" (UID: \"df2f32a6-2b43-495a-be3d-53a4eb60b528\") " pod="openstack-operators/keystone-operator-controller-manager-75689cbc47-kqlwb" Mar 16 17:43:32 crc kubenswrapper[5120]: I0316 17:43:32.041947 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/df2f32a6-2b43-495a-be3d-53a4eb60b528-apiservice-cert\") pod \"keystone-operator-controller-manager-75689cbc47-kqlwb\" (UID: \"df2f32a6-2b43-495a-be3d-53a4eb60b528\") " pod="openstack-operators/keystone-operator-controller-manager-75689cbc47-kqlwb" Mar 16 17:43:32 crc kubenswrapper[5120]: I0316 17:43:32.048989 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/df2f32a6-2b43-495a-be3d-53a4eb60b528-apiservice-cert\") pod \"keystone-operator-controller-manager-75689cbc47-kqlwb\" (UID: \"df2f32a6-2b43-495a-be3d-53a4eb60b528\") " pod="openstack-operators/keystone-operator-controller-manager-75689cbc47-kqlwb" Mar 16 17:43:32 crc kubenswrapper[5120]: I0316 17:43:32.049049 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/df2f32a6-2b43-495a-be3d-53a4eb60b528-webhook-cert\") pod \"keystone-operator-controller-manager-75689cbc47-kqlwb\" (UID: \"df2f32a6-2b43-495a-be3d-53a4eb60b528\") " pod="openstack-operators/keystone-operator-controller-manager-75689cbc47-kqlwb" Mar 16 17:43:32 crc kubenswrapper[5120]: I0316 17:43:32.069579 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7z2t\" (UniqueName: \"kubernetes.io/projected/df2f32a6-2b43-495a-be3d-53a4eb60b528-kube-api-access-t7z2t\") pod \"keystone-operator-controller-manager-75689cbc47-kqlwb\" (UID: \"df2f32a6-2b43-495a-be3d-53a4eb60b528\") " pod="openstack-operators/keystone-operator-controller-manager-75689cbc47-kqlwb" Mar 16 17:43:32 crc kubenswrapper[5120]: I0316 17:43:32.174783 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/keystone-operator-controller-manager-75689cbc47-kqlwb" Mar 16 17:43:32 crc kubenswrapper[5120]: I0316 17:43:32.417179 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-operators/keystone-operator-index-rrq9j" Mar 16 17:43:32 crc kubenswrapper[5120]: I0316 17:43:32.417540 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-operators/keystone-operator-index-rrq9j" Mar 16 17:43:32 crc kubenswrapper[5120]: I0316 17:43:32.451056 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-operators/keystone-operator-index-rrq9j" Mar 16 17:43:32 crc kubenswrapper[5120]: I0316 17:43:32.568429 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/keystone-operator-index-rrq9j" Mar 16 17:43:33 crc kubenswrapper[5120]: I0316 17:43:33.736584 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/keystone-operator-controller-manager-75689cbc47-kqlwb"] Mar 16 17:43:33 crc kubenswrapper[5120]: W0316 17:43:33.743718 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf2f32a6_2b43_495a_be3d_53a4eb60b528.slice/crio-f22ee70b3c41dbc51d40a5ca8881b6f466916ed3dedb0253fbcbc38466f89c87 WatchSource:0}: Error finding container f22ee70b3c41dbc51d40a5ca8881b6f466916ed3dedb0253fbcbc38466f89c87: Status 404 returned error can't find the container with id f22ee70b3c41dbc51d40a5ca8881b6f466916ed3dedb0253fbcbc38466f89c87 Mar 16 17:43:33 crc kubenswrapper[5120]: I0316 17:43:33.821294 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/rabbitmq-server-0"] Mar 16 17:43:33 crc kubenswrapper[5120]: W0316 17:43:33.845405 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69818304_cbec_4828_a572_6bbc566dc6b7.slice/crio-f5548292d5baa990bd33fb428ab1573746afa4730f42d37b87e4d6f247262978 WatchSource:0}: Error finding container f5548292d5baa990bd33fb428ab1573746afa4730f42d37b87e4d6f247262978: Status 404 returned error can't find the container with id f5548292d5baa990bd33fb428ab1573746afa4730f42d37b87e4d6f247262978 Mar 16 17:43:34 crc kubenswrapper[5120]: I0316 17:43:34.038673 5120 scope.go:117] "RemoveContainer" containerID="41d36b241d581c6b60fad004f55767dd1e3ff794a98234972bf4a2d7912cfe06" Mar 16 17:43:34 crc kubenswrapper[5120]: I0316 17:43:34.054875 5120 scope.go:117] "RemoveContainer" containerID="a68f9ffb26ad36494ada5eac138a3ac1bb9c6829fc4838a238ef73f774e0b440" Mar 16 17:43:34 crc kubenswrapper[5120]: I0316 17:43:34.078434 5120 scope.go:117] "RemoveContainer" containerID="b2a08abb89feaeb0c7364e50e447764e4b946b218627e5388c06cce8e69ad5e5" Mar 16 17:43:34 crc kubenswrapper[5120]: I0316 17:43:34.141945 5120 scope.go:117] "RemoveContainer" containerID="a2d457f5d3598afe4c85fa6dde8e3c3df8142437007520fccb23270d6c80cec8" Mar 16 17:43:34 crc kubenswrapper[5120]: I0316 17:43:34.175170 5120 scope.go:117] "RemoveContainer" containerID="a3a4c7349f320b7f0eefe940a94be11135cfd9d279d13c560db7da28c7e7200d" Mar 16 17:43:34 crc kubenswrapper[5120]: I0316 17:43:34.291283 5120 scope.go:117] "RemoveContainer" containerID="7f2ea184df671d64fac49ba841d6820f0c6ba8154a4b551f4efe24edea4cedea" Mar 16 17:43:34 crc kubenswrapper[5120]: I0316 17:43:34.551025 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/rabbitmq-server-0" event={"ID":"69818304-cbec-4828-a572-6bbc566dc6b7","Type":"ContainerStarted","Data":"f5548292d5baa990bd33fb428ab1573746afa4730f42d37b87e4d6f247262978"} Mar 16 17:43:34 crc kubenswrapper[5120]: I0316 17:43:34.553878 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/keystone-operator-controller-manager-75689cbc47-kqlwb" event={"ID":"df2f32a6-2b43-495a-be3d-53a4eb60b528","Type":"ContainerStarted","Data":"b9fe07ae635209f612192fd825702cbefd0e6ba46ce5f54233ac8da0f997fbf9"} Mar 16 17:43:34 crc kubenswrapper[5120]: I0316 17:43:34.553920 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/keystone-operator-controller-manager-75689cbc47-kqlwb" event={"ID":"df2f32a6-2b43-495a-be3d-53a4eb60b528","Type":"ContainerStarted","Data":"f22ee70b3c41dbc51d40a5ca8881b6f466916ed3dedb0253fbcbc38466f89c87"} Mar 16 17:43:34 crc kubenswrapper[5120]: I0316 17:43:34.554839 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-operators/keystone-operator-controller-manager-75689cbc47-kqlwb" Mar 16 17:43:34 crc kubenswrapper[5120]: I0316 17:43:34.556872 5120 generic.go:358] "Generic (PLEG): container finished" podID="f5c4787f-e8dd-45ab-9932-3db343fa8673" containerID="fd3e434bce087738f145f2b019ce7cf4eede4d0d607236d26441f9f22adc1131" exitCode=0 Mar 16 17:43:34 crc kubenswrapper[5120]: I0316 17:43:34.556992 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-cxnvm" event={"ID":"f5c4787f-e8dd-45ab-9932-3db343fa8673","Type":"ContainerDied","Data":"fd3e434bce087738f145f2b019ce7cf4eede4d0d607236d26441f9f22adc1131"} Mar 16 17:43:34 crc kubenswrapper[5120]: I0316 17:43:34.585209 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/keystone-operator-controller-manager-75689cbc47-kqlwb" podStartSLOduration=3.585190151 podStartE2EDuration="3.585190151s" podCreationTimestamp="2026-03-16 17:43:31 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:43:34.570847449 +0000 UTC m=+7916.724779136" watchObservedRunningTime="2026-03-16 17:43:34.585190151 +0000 UTC m=+7916.739121808" Mar 16 17:43:35 crc kubenswrapper[5120]: I0316 17:43:35.567802 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/rabbitmq-server-0" event={"ID":"69818304-cbec-4828-a572-6bbc566dc6b7","Type":"ContainerStarted","Data":"4f437f705cee7518af5b9401afb484729c441326c169f297fdb3c8680e2fb728"} Mar 16 17:43:35 crc kubenswrapper[5120]: I0316 17:43:35.574267 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-cxnvm" event={"ID":"f5c4787f-e8dd-45ab-9932-3db343fa8673","Type":"ContainerStarted","Data":"e9bafbefa85954721759a0a70786abc4e5308928f47e9cb80b5b66aa0e1b4e4c"} Mar 16 17:43:35 crc kubenswrapper[5120]: I0316 17:43:35.615635 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/redhat-operators-cxnvm" podStartSLOduration=3.822307827 podStartE2EDuration="14.615598712s" podCreationTimestamp="2026-03-16 17:43:21 +0000 UTC" firstStartedPulling="2026-03-16 17:43:22.427998359 +0000 UTC m=+7904.581930016" lastFinishedPulling="2026-03-16 17:43:33.221289244 +0000 UTC m=+7915.375220901" observedRunningTime="2026-03-16 17:43:35.614395879 +0000 UTC m=+7917.768327556" watchObservedRunningTime="2026-03-16 17:43:35.615598712 +0000 UTC m=+7917.769530369" Mar 16 17:43:41 crc kubenswrapper[5120]: I0316 17:43:41.418965 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-marketplace/redhat-operators-cxnvm" Mar 16 17:43:41 crc kubenswrapper[5120]: I0316 17:43:41.419563 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-operators-cxnvm" Mar 16 17:43:41 crc kubenswrapper[5120]: I0316 17:43:41.457658 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-operators-cxnvm" Mar 16 17:43:41 crc kubenswrapper[5120]: I0316 17:43:41.667466 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-operators-cxnvm" Mar 16 17:43:42 crc kubenswrapper[5120]: I0316 17:43:42.483715 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/community-operators-kc8jx"] Mar 16 17:43:42 crc kubenswrapper[5120]: I0316 17:43:42.527869 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/community-operators-kc8jx"] Mar 16 17:43:42 crc kubenswrapper[5120]: I0316 17:43:42.528021 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-kc8jx" Mar 16 17:43:42 crc kubenswrapper[5120]: I0316 17:43:42.595635 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/69a6fa6f-9f34-444d-9a61-bc5a28c74d09-catalog-content\") pod \"community-operators-kc8jx\" (UID: \"69a6fa6f-9f34-444d-9a61-bc5a28c74d09\") " pod="openshift-marketplace/community-operators-kc8jx" Mar 16 17:43:42 crc kubenswrapper[5120]: I0316 17:43:42.595947 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/69a6fa6f-9f34-444d-9a61-bc5a28c74d09-utilities\") pod \"community-operators-kc8jx\" (UID: \"69a6fa6f-9f34-444d-9a61-bc5a28c74d09\") " pod="openshift-marketplace/community-operators-kc8jx" Mar 16 17:43:42 crc kubenswrapper[5120]: I0316 17:43:42.596124 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7lhr\" (UniqueName: \"kubernetes.io/projected/69a6fa6f-9f34-444d-9a61-bc5a28c74d09-kube-api-access-r7lhr\") pod \"community-operators-kc8jx\" (UID: \"69a6fa6f-9f34-444d-9a61-bc5a28c74d09\") " pod="openshift-marketplace/community-operators-kc8jx" Mar 16 17:43:42 crc kubenswrapper[5120]: I0316 17:43:42.697653 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/69a6fa6f-9f34-444d-9a61-bc5a28c74d09-catalog-content\") pod \"community-operators-kc8jx\" (UID: \"69a6fa6f-9f34-444d-9a61-bc5a28c74d09\") " pod="openshift-marketplace/community-operators-kc8jx" Mar 16 17:43:42 crc kubenswrapper[5120]: I0316 17:43:42.697727 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/69a6fa6f-9f34-444d-9a61-bc5a28c74d09-utilities\") pod \"community-operators-kc8jx\" (UID: \"69a6fa6f-9f34-444d-9a61-bc5a28c74d09\") " pod="openshift-marketplace/community-operators-kc8jx" Mar 16 17:43:42 crc kubenswrapper[5120]: I0316 17:43:42.697838 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r7lhr\" (UniqueName: \"kubernetes.io/projected/69a6fa6f-9f34-444d-9a61-bc5a28c74d09-kube-api-access-r7lhr\") pod \"community-operators-kc8jx\" (UID: \"69a6fa6f-9f34-444d-9a61-bc5a28c74d09\") " pod="openshift-marketplace/community-operators-kc8jx" Mar 16 17:43:42 crc kubenswrapper[5120]: I0316 17:43:42.698550 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/69a6fa6f-9f34-444d-9a61-bc5a28c74d09-catalog-content\") pod \"community-operators-kc8jx\" (UID: \"69a6fa6f-9f34-444d-9a61-bc5a28c74d09\") " pod="openshift-marketplace/community-operators-kc8jx" Mar 16 17:43:42 crc kubenswrapper[5120]: I0316 17:43:42.698755 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/69a6fa6f-9f34-444d-9a61-bc5a28c74d09-utilities\") pod \"community-operators-kc8jx\" (UID: \"69a6fa6f-9f34-444d-9a61-bc5a28c74d09\") " pod="openshift-marketplace/community-operators-kc8jx" Mar 16 17:43:42 crc kubenswrapper[5120]: I0316 17:43:42.720159 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7lhr\" (UniqueName: \"kubernetes.io/projected/69a6fa6f-9f34-444d-9a61-bc5a28c74d09-kube-api-access-r7lhr\") pod \"community-operators-kc8jx\" (UID: \"69a6fa6f-9f34-444d-9a61-bc5a28c74d09\") " pod="openshift-marketplace/community-operators-kc8jx" Mar 16 17:43:42 crc kubenswrapper[5120]: I0316 17:43:42.850800 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-kc8jx" Mar 16 17:43:43 crc kubenswrapper[5120]: I0316 17:43:43.186630 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/community-operators-kc8jx"] Mar 16 17:43:43 crc kubenswrapper[5120]: I0316 17:43:43.637626 5120 generic.go:358] "Generic (PLEG): container finished" podID="69a6fa6f-9f34-444d-9a61-bc5a28c74d09" containerID="be0e15b331ef08c7da3fd399aaa81a8ca97dc7ca2e445559d4f3c6ec06cb543d" exitCode=0 Mar 16 17:43:43 crc kubenswrapper[5120]: I0316 17:43:43.637666 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-kc8jx" event={"ID":"69a6fa6f-9f34-444d-9a61-bc5a28c74d09","Type":"ContainerDied","Data":"be0e15b331ef08c7da3fd399aaa81a8ca97dc7ca2e445559d4f3c6ec06cb543d"} Mar 16 17:43:43 crc kubenswrapper[5120]: I0316 17:43:43.638043 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-kc8jx" event={"ID":"69a6fa6f-9f34-444d-9a61-bc5a28c74d09","Type":"ContainerStarted","Data":"c8d7a7e74f7903cef4587490e0b473be8c5230a10d3a28d17eb4959b23892da4"} Mar 16 17:43:45 crc kubenswrapper[5120]: I0316 17:43:45.330010 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-cxnvm"] Mar 16 17:43:45 crc kubenswrapper[5120]: I0316 17:43:45.664385 5120 scope.go:117] "RemoveContainer" containerID="7fd764dd19065c7ce437c63b05fda51970409dfa8dfd1c77e2158bb3e05b7723" Mar 16 17:43:45 crc kubenswrapper[5120]: E0316 17:43:45.664910 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 17:43:46 crc kubenswrapper[5120]: I0316 17:43:46.077840 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-operators-hsqcg"] Mar 16 17:43:46 crc kubenswrapper[5120]: I0316 17:43:46.078285 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-marketplace/redhat-operators-hsqcg" podUID="af070f63-f3d9-44e0-b864-95e2f297f2e1" containerName="registry-server" containerID="cri-o://108f464545c555f40b9e9f0ca47ba66b1306399a8b4283b3327e52f10bc4683f" gracePeriod=2 Mar 16 17:43:46 crc kubenswrapper[5120]: I0316 17:43:46.586024 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/keystone-operator-controller-manager-75689cbc47-kqlwb" Mar 16 17:43:48 crc kubenswrapper[5120]: I0316 17:43:48.687217 5120 generic.go:358] "Generic (PLEG): container finished" podID="af070f63-f3d9-44e0-b864-95e2f297f2e1" containerID="108f464545c555f40b9e9f0ca47ba66b1306399a8b4283b3327e52f10bc4683f" exitCode=0 Mar 16 17:43:48 crc kubenswrapper[5120]: I0316 17:43:48.687280 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-hsqcg" event={"ID":"af070f63-f3d9-44e0-b864-95e2f297f2e1","Type":"ContainerDied","Data":"108f464545c555f40b9e9f0ca47ba66b1306399a8b4283b3327e52f10bc4683f"} Mar 16 17:43:50 crc kubenswrapper[5120]: I0316 17:43:50.039703 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-hsqcg" Mar 16 17:43:50 crc kubenswrapper[5120]: I0316 17:43:50.095988 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/af070f63-f3d9-44e0-b864-95e2f297f2e1-utilities\") pod \"af070f63-f3d9-44e0-b864-95e2f297f2e1\" (UID: \"af070f63-f3d9-44e0-b864-95e2f297f2e1\") " Mar 16 17:43:50 crc kubenswrapper[5120]: I0316 17:43:50.096329 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/af070f63-f3d9-44e0-b864-95e2f297f2e1-catalog-content\") pod \"af070f63-f3d9-44e0-b864-95e2f297f2e1\" (UID: \"af070f63-f3d9-44e0-b864-95e2f297f2e1\") " Mar 16 17:43:50 crc kubenswrapper[5120]: I0316 17:43:50.096819 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af070f63-f3d9-44e0-b864-95e2f297f2e1-utilities" (OuterVolumeSpecName: "utilities") pod "af070f63-f3d9-44e0-b864-95e2f297f2e1" (UID: "af070f63-f3d9-44e0-b864-95e2f297f2e1"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:43:50 crc kubenswrapper[5120]: I0316 17:43:50.104877 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rwfgp\" (UniqueName: \"kubernetes.io/projected/af070f63-f3d9-44e0-b864-95e2f297f2e1-kube-api-access-rwfgp\") pod \"af070f63-f3d9-44e0-b864-95e2f297f2e1\" (UID: \"af070f63-f3d9-44e0-b864-95e2f297f2e1\") " Mar 16 17:43:50 crc kubenswrapper[5120]: I0316 17:43:50.107559 5120 reconciler_common.go:299] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/af070f63-f3d9-44e0-b864-95e2f297f2e1-utilities\") on node \"crc\" DevicePath \"\"" Mar 16 17:43:50 crc kubenswrapper[5120]: I0316 17:43:50.110688 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af070f63-f3d9-44e0-b864-95e2f297f2e1-kube-api-access-rwfgp" (OuterVolumeSpecName: "kube-api-access-rwfgp") pod "af070f63-f3d9-44e0-b864-95e2f297f2e1" (UID: "af070f63-f3d9-44e0-b864-95e2f297f2e1"). InnerVolumeSpecName "kube-api-access-rwfgp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:43:50 crc kubenswrapper[5120]: I0316 17:43:50.209864 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rwfgp\" (UniqueName: \"kubernetes.io/projected/af070f63-f3d9-44e0-b864-95e2f297f2e1-kube-api-access-rwfgp\") on node \"crc\" DevicePath \"\"" Mar 16 17:43:50 crc kubenswrapper[5120]: I0316 17:43:50.212392 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af070f63-f3d9-44e0-b864-95e2f297f2e1-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "af070f63-f3d9-44e0-b864-95e2f297f2e1" (UID: "af070f63-f3d9-44e0-b864-95e2f297f2e1"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:43:50 crc kubenswrapper[5120]: I0316 17:43:50.312701 5120 reconciler_common.go:299] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/af070f63-f3d9-44e0-b864-95e2f297f2e1-catalog-content\") on node \"crc\" DevicePath \"\"" Mar 16 17:43:50 crc kubenswrapper[5120]: I0316 17:43:50.703391 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-hsqcg" event={"ID":"af070f63-f3d9-44e0-b864-95e2f297f2e1","Type":"ContainerDied","Data":"f627677a0279699cb3f08ef619ebd2c849f608ae0e90d93d7120fbdbf2c16362"} Mar 16 17:43:50 crc kubenswrapper[5120]: I0316 17:43:50.703739 5120 scope.go:117] "RemoveContainer" containerID="108f464545c555f40b9e9f0ca47ba66b1306399a8b4283b3327e52f10bc4683f" Mar 16 17:43:50 crc kubenswrapper[5120]: I0316 17:43:50.703439 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-hsqcg" Mar 16 17:43:50 crc kubenswrapper[5120]: I0316 17:43:50.704883 5120 generic.go:358] "Generic (PLEG): container finished" podID="69a6fa6f-9f34-444d-9a61-bc5a28c74d09" containerID="687331e19e366bf7348a33817dbac1cdc69959db127e788cbfdf767af9622bb0" exitCode=0 Mar 16 17:43:50 crc kubenswrapper[5120]: I0316 17:43:50.704982 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-kc8jx" event={"ID":"69a6fa6f-9f34-444d-9a61-bc5a28c74d09","Type":"ContainerDied","Data":"687331e19e366bf7348a33817dbac1cdc69959db127e788cbfdf767af9622bb0"} Mar 16 17:43:50 crc kubenswrapper[5120]: I0316 17:43:50.746809 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-operators-hsqcg"] Mar 16 17:43:50 crc kubenswrapper[5120]: I0316 17:43:50.752529 5120 scope.go:117] "RemoveContainer" containerID="b0c9836b468fc3d612095cc86b493da62c47d8317532633ef9ee519e0ca2cfba" Mar 16 17:43:50 crc kubenswrapper[5120]: I0316 17:43:50.755440 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/redhat-operators-hsqcg"] Mar 16 17:43:50 crc kubenswrapper[5120]: I0316 17:43:50.794319 5120 scope.go:117] "RemoveContainer" containerID="86fe4dd73610561935351879c90d5c77c9a40a062fcaed8e497d50b49c45e3aa" Mar 16 17:43:50 crc kubenswrapper[5120]: I0316 17:43:50.894651 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/certified-operators-22hmh"] Mar 16 17:43:50 crc kubenswrapper[5120]: I0316 17:43:50.895413 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af070f63-f3d9-44e0-b864-95e2f297f2e1" containerName="registry-server" Mar 16 17:43:50 crc kubenswrapper[5120]: I0316 17:43:50.895434 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="af070f63-f3d9-44e0-b864-95e2f297f2e1" containerName="registry-server" Mar 16 17:43:50 crc kubenswrapper[5120]: I0316 17:43:50.895454 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af070f63-f3d9-44e0-b864-95e2f297f2e1" containerName="extract-utilities" Mar 16 17:43:50 crc kubenswrapper[5120]: I0316 17:43:50.895461 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="af070f63-f3d9-44e0-b864-95e2f297f2e1" containerName="extract-utilities" Mar 16 17:43:50 crc kubenswrapper[5120]: I0316 17:43:50.895486 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af070f63-f3d9-44e0-b864-95e2f297f2e1" containerName="extract-content" Mar 16 17:43:50 crc kubenswrapper[5120]: I0316 17:43:50.895492 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="af070f63-f3d9-44e0-b864-95e2f297f2e1" containerName="extract-content" Mar 16 17:43:50 crc kubenswrapper[5120]: I0316 17:43:50.895636 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="af070f63-f3d9-44e0-b864-95e2f297f2e1" containerName="registry-server" Mar 16 17:43:50 crc kubenswrapper[5120]: I0316 17:43:50.907868 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/certified-operators-22hmh"] Mar 16 17:43:50 crc kubenswrapper[5120]: I0316 17:43:50.908028 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-22hmh" Mar 16 17:43:51 crc kubenswrapper[5120]: I0316 17:43:51.025716 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6zth\" (UniqueName: \"kubernetes.io/projected/a11a4423-5d3f-4457-b0e0-935992f15021-kube-api-access-c6zth\") pod \"certified-operators-22hmh\" (UID: \"a11a4423-5d3f-4457-b0e0-935992f15021\") " pod="openshift-marketplace/certified-operators-22hmh" Mar 16 17:43:51 crc kubenswrapper[5120]: I0316 17:43:51.025890 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/a11a4423-5d3f-4457-b0e0-935992f15021-catalog-content\") pod \"certified-operators-22hmh\" (UID: \"a11a4423-5d3f-4457-b0e0-935992f15021\") " pod="openshift-marketplace/certified-operators-22hmh" Mar 16 17:43:51 crc kubenswrapper[5120]: I0316 17:43:51.026183 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/a11a4423-5d3f-4457-b0e0-935992f15021-utilities\") pod \"certified-operators-22hmh\" (UID: \"a11a4423-5d3f-4457-b0e0-935992f15021\") " pod="openshift-marketplace/certified-operators-22hmh" Mar 16 17:43:51 crc kubenswrapper[5120]: I0316 17:43:51.128924 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c6zth\" (UniqueName: \"kubernetes.io/projected/a11a4423-5d3f-4457-b0e0-935992f15021-kube-api-access-c6zth\") pod \"certified-operators-22hmh\" (UID: \"a11a4423-5d3f-4457-b0e0-935992f15021\") " pod="openshift-marketplace/certified-operators-22hmh" Mar 16 17:43:51 crc kubenswrapper[5120]: I0316 17:43:51.129034 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/a11a4423-5d3f-4457-b0e0-935992f15021-catalog-content\") pod \"certified-operators-22hmh\" (UID: \"a11a4423-5d3f-4457-b0e0-935992f15021\") " pod="openshift-marketplace/certified-operators-22hmh" Mar 16 17:43:51 crc kubenswrapper[5120]: I0316 17:43:51.129181 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/a11a4423-5d3f-4457-b0e0-935992f15021-utilities\") pod \"certified-operators-22hmh\" (UID: \"a11a4423-5d3f-4457-b0e0-935992f15021\") " pod="openshift-marketplace/certified-operators-22hmh" Mar 16 17:43:51 crc kubenswrapper[5120]: I0316 17:43:51.129791 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/a11a4423-5d3f-4457-b0e0-935992f15021-catalog-content\") pod \"certified-operators-22hmh\" (UID: \"a11a4423-5d3f-4457-b0e0-935992f15021\") " pod="openshift-marketplace/certified-operators-22hmh" Mar 16 17:43:51 crc kubenswrapper[5120]: I0316 17:43:51.130001 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/a11a4423-5d3f-4457-b0e0-935992f15021-utilities\") pod \"certified-operators-22hmh\" (UID: \"a11a4423-5d3f-4457-b0e0-935992f15021\") " pod="openshift-marketplace/certified-operators-22hmh" Mar 16 17:43:51 crc kubenswrapper[5120]: I0316 17:43:51.151584 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6zth\" (UniqueName: \"kubernetes.io/projected/a11a4423-5d3f-4457-b0e0-935992f15021-kube-api-access-c6zth\") pod \"certified-operators-22hmh\" (UID: \"a11a4423-5d3f-4457-b0e0-935992f15021\") " pod="openshift-marketplace/certified-operators-22hmh" Mar 16 17:43:51 crc kubenswrapper[5120]: I0316 17:43:51.228702 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-22hmh" Mar 16 17:43:51 crc kubenswrapper[5120]: W0316 17:43:51.699502 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda11a4423_5d3f_4457_b0e0_935992f15021.slice/crio-39e9d9f54437d8928e8c4cbdc6d3103919f25a5455dc970a93678b3df4fdad16 WatchSource:0}: Error finding container 39e9d9f54437d8928e8c4cbdc6d3103919f25a5455dc970a93678b3df4fdad16: Status 404 returned error can't find the container with id 39e9d9f54437d8928e8c4cbdc6d3103919f25a5455dc970a93678b3df4fdad16 Mar 16 17:43:51 crc kubenswrapper[5120]: I0316 17:43:51.701357 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/certified-operators-22hmh"] Mar 16 17:43:51 crc kubenswrapper[5120]: I0316 17:43:51.713560 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-22hmh" event={"ID":"a11a4423-5d3f-4457-b0e0-935992f15021","Type":"ContainerStarted","Data":"39e9d9f54437d8928e8c4cbdc6d3103919f25a5455dc970a93678b3df4fdad16"} Mar 16 17:43:51 crc kubenswrapper[5120]: I0316 17:43:51.717253 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-kc8jx" event={"ID":"69a6fa6f-9f34-444d-9a61-bc5a28c74d09","Type":"ContainerStarted","Data":"fa142b895a63768c13809edb526db98bdc000227ca6af108b7a827b362256a02"} Mar 16 17:43:51 crc kubenswrapper[5120]: I0316 17:43:51.739475 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/community-operators-kc8jx" podStartSLOduration=3.5462299269999997 podStartE2EDuration="9.739455293s" podCreationTimestamp="2026-03-16 17:43:42 +0000 UTC" firstStartedPulling="2026-03-16 17:43:43.639017721 +0000 UTC m=+7925.792949378" lastFinishedPulling="2026-03-16 17:43:49.832243087 +0000 UTC m=+7931.986174744" observedRunningTime="2026-03-16 17:43:51.736403649 +0000 UTC m=+7933.890335316" watchObservedRunningTime="2026-03-16 17:43:51.739455293 +0000 UTC m=+7933.893386950" Mar 16 17:43:52 crc kubenswrapper[5120]: I0316 17:43:52.132981 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keystone-kuttl-tests/keystone-db-create-jf5fb"] Mar 16 17:43:52 crc kubenswrapper[5120]: I0316 17:43:52.143506 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-db-create-jf5fb" Mar 16 17:43:52 crc kubenswrapper[5120]: I0316 17:43:52.145813 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keystone-kuttl-tests/keystone-54db-account-create-update-rcxpx"] Mar 16 17:43:52 crc kubenswrapper[5120]: I0316 17:43:52.152071 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-54db-account-create-update-rcxpx" Mar 16 17:43:52 crc kubenswrapper[5120]: I0316 17:43:52.155134 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keystone-kuttl-tests\"/\"keystone-db-secret\"" Mar 16 17:43:52 crc kubenswrapper[5120]: I0316 17:43:52.161043 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone-db-create-jf5fb"] Mar 16 17:43:52 crc kubenswrapper[5120]: I0316 17:43:52.169043 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone-54db-account-create-update-rcxpx"] Mar 16 17:43:52 crc kubenswrapper[5120]: I0316 17:43:52.251670 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/90d813fe-87eb-4e31-8a2a-40e747ad2865-operator-scripts\") pod \"keystone-db-create-jf5fb\" (UID: \"90d813fe-87eb-4e31-8a2a-40e747ad2865\") " pod="keystone-kuttl-tests/keystone-db-create-jf5fb" Mar 16 17:43:52 crc kubenswrapper[5120]: I0316 17:43:52.252137 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxlcc\" (UniqueName: \"kubernetes.io/projected/3ab3ea89-47e2-419e-a8f3-8c1c62aaebfb-kube-api-access-wxlcc\") pod \"keystone-54db-account-create-update-rcxpx\" (UID: \"3ab3ea89-47e2-419e-a8f3-8c1c62aaebfb\") " pod="keystone-kuttl-tests/keystone-54db-account-create-update-rcxpx" Mar 16 17:43:52 crc kubenswrapper[5120]: I0316 17:43:52.252455 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8zjh\" (UniqueName: \"kubernetes.io/projected/90d813fe-87eb-4e31-8a2a-40e747ad2865-kube-api-access-g8zjh\") pod \"keystone-db-create-jf5fb\" (UID: \"90d813fe-87eb-4e31-8a2a-40e747ad2865\") " pod="keystone-kuttl-tests/keystone-db-create-jf5fb" Mar 16 17:43:52 crc kubenswrapper[5120]: I0316 17:43:52.252614 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3ab3ea89-47e2-419e-a8f3-8c1c62aaebfb-operator-scripts\") pod \"keystone-54db-account-create-update-rcxpx\" (UID: \"3ab3ea89-47e2-419e-a8f3-8c1c62aaebfb\") " pod="keystone-kuttl-tests/keystone-54db-account-create-update-rcxpx" Mar 16 17:43:52 crc kubenswrapper[5120]: I0316 17:43:52.355263 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3ab3ea89-47e2-419e-a8f3-8c1c62aaebfb-operator-scripts\") pod \"keystone-54db-account-create-update-rcxpx\" (UID: \"3ab3ea89-47e2-419e-a8f3-8c1c62aaebfb\") " pod="keystone-kuttl-tests/keystone-54db-account-create-update-rcxpx" Mar 16 17:43:52 crc kubenswrapper[5120]: I0316 17:43:52.355782 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/90d813fe-87eb-4e31-8a2a-40e747ad2865-operator-scripts\") pod \"keystone-db-create-jf5fb\" (UID: \"90d813fe-87eb-4e31-8a2a-40e747ad2865\") " pod="keystone-kuttl-tests/keystone-db-create-jf5fb" Mar 16 17:43:52 crc kubenswrapper[5120]: I0316 17:43:52.355875 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wxlcc\" (UniqueName: \"kubernetes.io/projected/3ab3ea89-47e2-419e-a8f3-8c1c62aaebfb-kube-api-access-wxlcc\") pod \"keystone-54db-account-create-update-rcxpx\" (UID: \"3ab3ea89-47e2-419e-a8f3-8c1c62aaebfb\") " pod="keystone-kuttl-tests/keystone-54db-account-create-update-rcxpx" Mar 16 17:43:52 crc kubenswrapper[5120]: I0316 17:43:52.355942 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g8zjh\" (UniqueName: \"kubernetes.io/projected/90d813fe-87eb-4e31-8a2a-40e747ad2865-kube-api-access-g8zjh\") pod \"keystone-db-create-jf5fb\" (UID: \"90d813fe-87eb-4e31-8a2a-40e747ad2865\") " pod="keystone-kuttl-tests/keystone-db-create-jf5fb" Mar 16 17:43:52 crc kubenswrapper[5120]: I0316 17:43:52.356178 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3ab3ea89-47e2-419e-a8f3-8c1c62aaebfb-operator-scripts\") pod \"keystone-54db-account-create-update-rcxpx\" (UID: \"3ab3ea89-47e2-419e-a8f3-8c1c62aaebfb\") " pod="keystone-kuttl-tests/keystone-54db-account-create-update-rcxpx" Mar 16 17:43:52 crc kubenswrapper[5120]: I0316 17:43:52.357608 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/90d813fe-87eb-4e31-8a2a-40e747ad2865-operator-scripts\") pod \"keystone-db-create-jf5fb\" (UID: \"90d813fe-87eb-4e31-8a2a-40e747ad2865\") " pod="keystone-kuttl-tests/keystone-db-create-jf5fb" Mar 16 17:43:52 crc kubenswrapper[5120]: I0316 17:43:52.377028 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxlcc\" (UniqueName: \"kubernetes.io/projected/3ab3ea89-47e2-419e-a8f3-8c1c62aaebfb-kube-api-access-wxlcc\") pod \"keystone-54db-account-create-update-rcxpx\" (UID: \"3ab3ea89-47e2-419e-a8f3-8c1c62aaebfb\") " pod="keystone-kuttl-tests/keystone-54db-account-create-update-rcxpx" Mar 16 17:43:52 crc kubenswrapper[5120]: I0316 17:43:52.379424 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8zjh\" (UniqueName: \"kubernetes.io/projected/90d813fe-87eb-4e31-8a2a-40e747ad2865-kube-api-access-g8zjh\") pod \"keystone-db-create-jf5fb\" (UID: \"90d813fe-87eb-4e31-8a2a-40e747ad2865\") " pod="keystone-kuttl-tests/keystone-db-create-jf5fb" Mar 16 17:43:52 crc kubenswrapper[5120]: I0316 17:43:52.481449 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-db-create-jf5fb" Mar 16 17:43:52 crc kubenswrapper[5120]: I0316 17:43:52.490872 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-54db-account-create-update-rcxpx" Mar 16 17:43:52 crc kubenswrapper[5120]: I0316 17:43:52.680773 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="af070f63-f3d9-44e0-b864-95e2f297f2e1" path="/var/lib/kubelet/pods/af070f63-f3d9-44e0-b864-95e2f297f2e1/volumes" Mar 16 17:43:52 crc kubenswrapper[5120]: I0316 17:43:52.729978 5120 generic.go:358] "Generic (PLEG): container finished" podID="a11a4423-5d3f-4457-b0e0-935992f15021" containerID="530364c1200d23558c786841f9f640cb7e641acb4405fcf898159954f060d488" exitCode=0 Mar 16 17:43:52 crc kubenswrapper[5120]: I0316 17:43:52.731729 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-22hmh" event={"ID":"a11a4423-5d3f-4457-b0e0-935992f15021","Type":"ContainerDied","Data":"530364c1200d23558c786841f9f640cb7e641acb4405fcf898159954f060d488"} Mar 16 17:43:52 crc kubenswrapper[5120]: I0316 17:43:52.851135 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-marketplace/community-operators-kc8jx" Mar 16 17:43:52 crc kubenswrapper[5120]: I0316 17:43:52.851418 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/community-operators-kc8jx" Mar 16 17:43:52 crc kubenswrapper[5120]: I0316 17:43:52.926784 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone-54db-account-create-update-rcxpx"] Mar 16 17:43:53 crc kubenswrapper[5120]: I0316 17:43:53.001227 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone-db-create-jf5fb"] Mar 16 17:43:53 crc kubenswrapper[5120]: W0316 17:43:53.007834 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod90d813fe_87eb_4e31_8a2a_40e747ad2865.slice/crio-d2e52e325708a45102b89ccf130421159bc52a09ceb71e9e563e376f32919ce6 WatchSource:0}: Error finding container d2e52e325708a45102b89ccf130421159bc52a09ceb71e9e563e376f32919ce6: Status 404 returned error can't find the container with id d2e52e325708a45102b89ccf130421159bc52a09ceb71e9e563e376f32919ce6 Mar 16 17:43:53 crc kubenswrapper[5120]: I0316 17:43:53.740396 5120 generic.go:358] "Generic (PLEG): container finished" podID="90d813fe-87eb-4e31-8a2a-40e747ad2865" containerID="bfb85efcdc589fcd4a3ebeb170d058c374c3ab404fc0e20e3b6b69e13006f8af" exitCode=0 Mar 16 17:43:53 crc kubenswrapper[5120]: I0316 17:43:53.740576 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-db-create-jf5fb" event={"ID":"90d813fe-87eb-4e31-8a2a-40e747ad2865","Type":"ContainerDied","Data":"bfb85efcdc589fcd4a3ebeb170d058c374c3ab404fc0e20e3b6b69e13006f8af"} Mar 16 17:43:53 crc kubenswrapper[5120]: I0316 17:43:53.740609 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-db-create-jf5fb" event={"ID":"90d813fe-87eb-4e31-8a2a-40e747ad2865","Type":"ContainerStarted","Data":"d2e52e325708a45102b89ccf130421159bc52a09ceb71e9e563e376f32919ce6"} Mar 16 17:43:53 crc kubenswrapper[5120]: I0316 17:43:53.743673 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-22hmh" event={"ID":"a11a4423-5d3f-4457-b0e0-935992f15021","Type":"ContainerStarted","Data":"713e91e918673c31dda02645746adc76e0f2ee966623f47746e2abda0c6049dd"} Mar 16 17:43:53 crc kubenswrapper[5120]: I0316 17:43:53.747134 5120 generic.go:358] "Generic (PLEG): container finished" podID="3ab3ea89-47e2-419e-a8f3-8c1c62aaebfb" containerID="106ec4721c8a6a72d48ede5d01e98ddbaed719e9feb64b785448125802d47672" exitCode=0 Mar 16 17:43:53 crc kubenswrapper[5120]: I0316 17:43:53.747647 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-54db-account-create-update-rcxpx" event={"ID":"3ab3ea89-47e2-419e-a8f3-8c1c62aaebfb","Type":"ContainerDied","Data":"106ec4721c8a6a72d48ede5d01e98ddbaed719e9feb64b785448125802d47672"} Mar 16 17:43:53 crc kubenswrapper[5120]: I0316 17:43:53.747689 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-54db-account-create-update-rcxpx" event={"ID":"3ab3ea89-47e2-419e-a8f3-8c1c62aaebfb","Type":"ContainerStarted","Data":"00f3412e09d0335b17998a447362174323f266549d91a1ad926e524e5d0e3deb"} Mar 16 17:43:53 crc kubenswrapper[5120]: I0316 17:43:53.905093 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-marketplace/community-operators-kc8jx" podUID="69a6fa6f-9f34-444d-9a61-bc5a28c74d09" containerName="registry-server" probeResult="failure" output=< Mar 16 17:43:53 crc kubenswrapper[5120]: timeout: failed to connect service ":50051" within 1s Mar 16 17:43:53 crc kubenswrapper[5120]: > Mar 16 17:43:54 crc kubenswrapper[5120]: I0316 17:43:54.757385 5120 generic.go:358] "Generic (PLEG): container finished" podID="a11a4423-5d3f-4457-b0e0-935992f15021" containerID="713e91e918673c31dda02645746adc76e0f2ee966623f47746e2abda0c6049dd" exitCode=0 Mar 16 17:43:54 crc kubenswrapper[5120]: I0316 17:43:54.757427 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-22hmh" event={"ID":"a11a4423-5d3f-4457-b0e0-935992f15021","Type":"ContainerDied","Data":"713e91e918673c31dda02645746adc76e0f2ee966623f47746e2abda0c6049dd"} Mar 16 17:43:55 crc kubenswrapper[5120]: I0316 17:43:55.148236 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-54db-account-create-update-rcxpx" Mar 16 17:43:55 crc kubenswrapper[5120]: I0316 17:43:55.155247 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-db-create-jf5fb" Mar 16 17:43:55 crc kubenswrapper[5120]: I0316 17:43:55.224945 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3ab3ea89-47e2-419e-a8f3-8c1c62aaebfb-operator-scripts\") pod \"3ab3ea89-47e2-419e-a8f3-8c1c62aaebfb\" (UID: \"3ab3ea89-47e2-419e-a8f3-8c1c62aaebfb\") " Mar 16 17:43:55 crc kubenswrapper[5120]: I0316 17:43:55.225527 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g8zjh\" (UniqueName: \"kubernetes.io/projected/90d813fe-87eb-4e31-8a2a-40e747ad2865-kube-api-access-g8zjh\") pod \"90d813fe-87eb-4e31-8a2a-40e747ad2865\" (UID: \"90d813fe-87eb-4e31-8a2a-40e747ad2865\") " Mar 16 17:43:55 crc kubenswrapper[5120]: I0316 17:43:55.225658 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/90d813fe-87eb-4e31-8a2a-40e747ad2865-operator-scripts\") pod \"90d813fe-87eb-4e31-8a2a-40e747ad2865\" (UID: \"90d813fe-87eb-4e31-8a2a-40e747ad2865\") " Mar 16 17:43:55 crc kubenswrapper[5120]: I0316 17:43:55.225740 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wxlcc\" (UniqueName: \"kubernetes.io/projected/3ab3ea89-47e2-419e-a8f3-8c1c62aaebfb-kube-api-access-wxlcc\") pod \"3ab3ea89-47e2-419e-a8f3-8c1c62aaebfb\" (UID: \"3ab3ea89-47e2-419e-a8f3-8c1c62aaebfb\") " Mar 16 17:43:55 crc kubenswrapper[5120]: I0316 17:43:55.227944 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/90d813fe-87eb-4e31-8a2a-40e747ad2865-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "90d813fe-87eb-4e31-8a2a-40e747ad2865" (UID: "90d813fe-87eb-4e31-8a2a-40e747ad2865"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:43:55 crc kubenswrapper[5120]: I0316 17:43:55.228230 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3ab3ea89-47e2-419e-a8f3-8c1c62aaebfb-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "3ab3ea89-47e2-419e-a8f3-8c1c62aaebfb" (UID: "3ab3ea89-47e2-419e-a8f3-8c1c62aaebfb"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:43:55 crc kubenswrapper[5120]: I0316 17:43:55.243013 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ab3ea89-47e2-419e-a8f3-8c1c62aaebfb-kube-api-access-wxlcc" (OuterVolumeSpecName: "kube-api-access-wxlcc") pod "3ab3ea89-47e2-419e-a8f3-8c1c62aaebfb" (UID: "3ab3ea89-47e2-419e-a8f3-8c1c62aaebfb"). InnerVolumeSpecName "kube-api-access-wxlcc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:43:55 crc kubenswrapper[5120]: I0316 17:43:55.243134 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90d813fe-87eb-4e31-8a2a-40e747ad2865-kube-api-access-g8zjh" (OuterVolumeSpecName: "kube-api-access-g8zjh") pod "90d813fe-87eb-4e31-8a2a-40e747ad2865" (UID: "90d813fe-87eb-4e31-8a2a-40e747ad2865"). InnerVolumeSpecName "kube-api-access-g8zjh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:43:55 crc kubenswrapper[5120]: I0316 17:43:55.327828 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3ab3ea89-47e2-419e-a8f3-8c1c62aaebfb-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:43:55 crc kubenswrapper[5120]: I0316 17:43:55.327872 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g8zjh\" (UniqueName: \"kubernetes.io/projected/90d813fe-87eb-4e31-8a2a-40e747ad2865-kube-api-access-g8zjh\") on node \"crc\" DevicePath \"\"" Mar 16 17:43:55 crc kubenswrapper[5120]: I0316 17:43:55.327884 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/90d813fe-87eb-4e31-8a2a-40e747ad2865-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:43:55 crc kubenswrapper[5120]: I0316 17:43:55.327893 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wxlcc\" (UniqueName: \"kubernetes.io/projected/3ab3ea89-47e2-419e-a8f3-8c1c62aaebfb-kube-api-access-wxlcc\") on node \"crc\" DevicePath \"\"" Mar 16 17:43:55 crc kubenswrapper[5120]: I0316 17:43:55.770774 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-db-create-jf5fb" Mar 16 17:43:55 crc kubenswrapper[5120]: I0316 17:43:55.770802 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-db-create-jf5fb" event={"ID":"90d813fe-87eb-4e31-8a2a-40e747ad2865","Type":"ContainerDied","Data":"d2e52e325708a45102b89ccf130421159bc52a09ceb71e9e563e376f32919ce6"} Mar 16 17:43:55 crc kubenswrapper[5120]: I0316 17:43:55.771173 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d2e52e325708a45102b89ccf130421159bc52a09ceb71e9e563e376f32919ce6" Mar 16 17:43:55 crc kubenswrapper[5120]: I0316 17:43:55.776735 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-22hmh" event={"ID":"a11a4423-5d3f-4457-b0e0-935992f15021","Type":"ContainerStarted","Data":"e82dfc36e17473b228cb3b60dd210423957019c26097a662a02f9ac4a25515a8"} Mar 16 17:43:55 crc kubenswrapper[5120]: I0316 17:43:55.779258 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-54db-account-create-update-rcxpx" Mar 16 17:43:55 crc kubenswrapper[5120]: I0316 17:43:55.779260 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-54db-account-create-update-rcxpx" event={"ID":"3ab3ea89-47e2-419e-a8f3-8c1c62aaebfb","Type":"ContainerDied","Data":"00f3412e09d0335b17998a447362174323f266549d91a1ad926e524e5d0e3deb"} Mar 16 17:43:55 crc kubenswrapper[5120]: I0316 17:43:55.779297 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="00f3412e09d0335b17998a447362174323f266549d91a1ad926e524e5d0e3deb" Mar 16 17:43:55 crc kubenswrapper[5120]: I0316 17:43:55.802028 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/certified-operators-22hmh" podStartSLOduration=5.139727895 podStartE2EDuration="5.802007981s" podCreationTimestamp="2026-03-16 17:43:50 +0000 UTC" firstStartedPulling="2026-03-16 17:43:52.731532487 +0000 UTC m=+7934.885464144" lastFinishedPulling="2026-03-16 17:43:53.393812553 +0000 UTC m=+7935.547744230" observedRunningTime="2026-03-16 17:43:55.792730827 +0000 UTC m=+7937.946662514" watchObservedRunningTime="2026-03-16 17:43:55.802007981 +0000 UTC m=+7937.955939638" Mar 16 17:43:58 crc kubenswrapper[5120]: I0316 17:43:58.672286 5120 scope.go:117] "RemoveContainer" containerID="7fd764dd19065c7ce437c63b05fda51970409dfa8dfd1c77e2158bb3e05b7723" Mar 16 17:43:58 crc kubenswrapper[5120]: E0316 17:43:58.673596 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 17:44:00 crc kubenswrapper[5120]: I0316 17:44:00.132477 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-infra/auto-csr-approver-29561384-lwfkn"] Mar 16 17:44:00 crc kubenswrapper[5120]: I0316 17:44:00.133646 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ab3ea89-47e2-419e-a8f3-8c1c62aaebfb" containerName="mariadb-account-create-update" Mar 16 17:44:00 crc kubenswrapper[5120]: I0316 17:44:00.133668 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ab3ea89-47e2-419e-a8f3-8c1c62aaebfb" containerName="mariadb-account-create-update" Mar 16 17:44:00 crc kubenswrapper[5120]: I0316 17:44:00.133677 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90d813fe-87eb-4e31-8a2a-40e747ad2865" containerName="mariadb-database-create" Mar 16 17:44:00 crc kubenswrapper[5120]: I0316 17:44:00.133683 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="90d813fe-87eb-4e31-8a2a-40e747ad2865" containerName="mariadb-database-create" Mar 16 17:44:00 crc kubenswrapper[5120]: I0316 17:44:00.133830 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="3ab3ea89-47e2-419e-a8f3-8c1c62aaebfb" containerName="mariadb-account-create-update" Mar 16 17:44:00 crc kubenswrapper[5120]: I0316 17:44:00.133842 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="90d813fe-87eb-4e31-8a2a-40e747ad2865" containerName="mariadb-database-create" Mar 16 17:44:00 crc kubenswrapper[5120]: I0316 17:44:00.146474 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561384-lwfkn"] Mar 16 17:44:00 crc kubenswrapper[5120]: I0316 17:44:00.146602 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561384-lwfkn" Mar 16 17:44:00 crc kubenswrapper[5120]: I0316 17:44:00.154432 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"openshift-service-ca.crt\"" Mar 16 17:44:00 crc kubenswrapper[5120]: I0316 17:44:00.155165 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-infra\"/\"csr-approver-sa-dockercfg-x2nsz\"" Mar 16 17:44:00 crc kubenswrapper[5120]: I0316 17:44:00.155350 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"kube-root-ca.crt\"" Mar 16 17:44:00 crc kubenswrapper[5120]: I0316 17:44:00.240331 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kb5p\" (UniqueName: \"kubernetes.io/projected/340eebbe-5b02-446c-b75b-4defea482635-kube-api-access-4kb5p\") pod \"auto-csr-approver-29561384-lwfkn\" (UID: \"340eebbe-5b02-446c-b75b-4defea482635\") " pod="openshift-infra/auto-csr-approver-29561384-lwfkn" Mar 16 17:44:00 crc kubenswrapper[5120]: I0316 17:44:00.342897 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4kb5p\" (UniqueName: \"kubernetes.io/projected/340eebbe-5b02-446c-b75b-4defea482635-kube-api-access-4kb5p\") pod \"auto-csr-approver-29561384-lwfkn\" (UID: \"340eebbe-5b02-446c-b75b-4defea482635\") " pod="openshift-infra/auto-csr-approver-29561384-lwfkn" Mar 16 17:44:00 crc kubenswrapper[5120]: I0316 17:44:00.362736 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kb5p\" (UniqueName: \"kubernetes.io/projected/340eebbe-5b02-446c-b75b-4defea482635-kube-api-access-4kb5p\") pod \"auto-csr-approver-29561384-lwfkn\" (UID: \"340eebbe-5b02-446c-b75b-4defea482635\") " pod="openshift-infra/auto-csr-approver-29561384-lwfkn" Mar 16 17:44:00 crc kubenswrapper[5120]: I0316 17:44:00.481005 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561384-lwfkn" Mar 16 17:44:00 crc kubenswrapper[5120]: I0316 17:44:00.885271 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561384-lwfkn"] Mar 16 17:44:01 crc kubenswrapper[5120]: I0316 17:44:01.228997 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/certified-operators-22hmh" Mar 16 17:44:01 crc kubenswrapper[5120]: I0316 17:44:01.229252 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-marketplace/certified-operators-22hmh" Mar 16 17:44:01 crc kubenswrapper[5120]: I0316 17:44:01.265486 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/certified-operators-22hmh" Mar 16 17:44:01 crc kubenswrapper[5120]: I0316 17:44:01.831808 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561384-lwfkn" event={"ID":"340eebbe-5b02-446c-b75b-4defea482635","Type":"ContainerStarted","Data":"43cb85c010d13a78921ea8a4eea97a03d32779d76e1f75456f0843ac5e748fe5"} Mar 16 17:44:01 crc kubenswrapper[5120]: I0316 17:44:01.871023 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/certified-operators-22hmh" Mar 16 17:44:02 crc kubenswrapper[5120]: I0316 17:44:02.843405 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561384-lwfkn" event={"ID":"340eebbe-5b02-446c-b75b-4defea482635","Type":"ContainerStarted","Data":"5d48c3cc83f761c8e25a86e7baa7b3e32e3e87e0cd0b8cbc3ef84655bb768bba"} Mar 16 17:44:02 crc kubenswrapper[5120]: I0316 17:44:02.869550 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-infra/auto-csr-approver-29561384-lwfkn" podStartSLOduration=1.322764602 podStartE2EDuration="2.869528905s" podCreationTimestamp="2026-03-16 17:44:00 +0000 UTC" firstStartedPulling="2026-03-16 17:44:00.889979183 +0000 UTC m=+7943.043910840" lastFinishedPulling="2026-03-16 17:44:02.436743476 +0000 UTC m=+7944.590675143" observedRunningTime="2026-03-16 17:44:02.858303128 +0000 UTC m=+7945.012234785" watchObservedRunningTime="2026-03-16 17:44:02.869528905 +0000 UTC m=+7945.023460562" Mar 16 17:44:02 crc kubenswrapper[5120]: I0316 17:44:02.894681 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/community-operators-kc8jx" Mar 16 17:44:02 crc kubenswrapper[5120]: I0316 17:44:02.943106 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/community-operators-kc8jx" Mar 16 17:44:03 crc kubenswrapper[5120]: I0316 17:44:03.686387 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-marketplace-lbrlc"] Mar 16 17:44:03 crc kubenswrapper[5120]: I0316 17:44:03.691581 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-lbrlc" Mar 16 17:44:03 crc kubenswrapper[5120]: I0316 17:44:03.695910 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-lbrlc"] Mar 16 17:44:03 crc kubenswrapper[5120]: I0316 17:44:03.821631 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/1aa3d999-0b9d-4923-9635-5cd9dc9116ec-utilities\") pod \"redhat-marketplace-lbrlc\" (UID: \"1aa3d999-0b9d-4923-9635-5cd9dc9116ec\") " pod="openshift-marketplace/redhat-marketplace-lbrlc" Mar 16 17:44:03 crc kubenswrapper[5120]: I0316 17:44:03.821752 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdf9r\" (UniqueName: \"kubernetes.io/projected/1aa3d999-0b9d-4923-9635-5cd9dc9116ec-kube-api-access-wdf9r\") pod \"redhat-marketplace-lbrlc\" (UID: \"1aa3d999-0b9d-4923-9635-5cd9dc9116ec\") " pod="openshift-marketplace/redhat-marketplace-lbrlc" Mar 16 17:44:03 crc kubenswrapper[5120]: I0316 17:44:03.822113 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/1aa3d999-0b9d-4923-9635-5cd9dc9116ec-catalog-content\") pod \"redhat-marketplace-lbrlc\" (UID: \"1aa3d999-0b9d-4923-9635-5cd9dc9116ec\") " pod="openshift-marketplace/redhat-marketplace-lbrlc" Mar 16 17:44:03 crc kubenswrapper[5120]: I0316 17:44:03.853444 5120 generic.go:358] "Generic (PLEG): container finished" podID="340eebbe-5b02-446c-b75b-4defea482635" containerID="5d48c3cc83f761c8e25a86e7baa7b3e32e3e87e0cd0b8cbc3ef84655bb768bba" exitCode=0 Mar 16 17:44:03 crc kubenswrapper[5120]: I0316 17:44:03.853587 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561384-lwfkn" event={"ID":"340eebbe-5b02-446c-b75b-4defea482635","Type":"ContainerDied","Data":"5d48c3cc83f761c8e25a86e7baa7b3e32e3e87e0cd0b8cbc3ef84655bb768bba"} Mar 16 17:44:03 crc kubenswrapper[5120]: I0316 17:44:03.924441 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/1aa3d999-0b9d-4923-9635-5cd9dc9116ec-catalog-content\") pod \"redhat-marketplace-lbrlc\" (UID: \"1aa3d999-0b9d-4923-9635-5cd9dc9116ec\") " pod="openshift-marketplace/redhat-marketplace-lbrlc" Mar 16 17:44:03 crc kubenswrapper[5120]: I0316 17:44:03.924708 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/1aa3d999-0b9d-4923-9635-5cd9dc9116ec-utilities\") pod \"redhat-marketplace-lbrlc\" (UID: \"1aa3d999-0b9d-4923-9635-5cd9dc9116ec\") " pod="openshift-marketplace/redhat-marketplace-lbrlc" Mar 16 17:44:03 crc kubenswrapper[5120]: I0316 17:44:03.924815 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wdf9r\" (UniqueName: \"kubernetes.io/projected/1aa3d999-0b9d-4923-9635-5cd9dc9116ec-kube-api-access-wdf9r\") pod \"redhat-marketplace-lbrlc\" (UID: \"1aa3d999-0b9d-4923-9635-5cd9dc9116ec\") " pod="openshift-marketplace/redhat-marketplace-lbrlc" Mar 16 17:44:03 crc kubenswrapper[5120]: I0316 17:44:03.924943 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/1aa3d999-0b9d-4923-9635-5cd9dc9116ec-catalog-content\") pod \"redhat-marketplace-lbrlc\" (UID: \"1aa3d999-0b9d-4923-9635-5cd9dc9116ec\") " pod="openshift-marketplace/redhat-marketplace-lbrlc" Mar 16 17:44:03 crc kubenswrapper[5120]: I0316 17:44:03.925307 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/1aa3d999-0b9d-4923-9635-5cd9dc9116ec-utilities\") pod \"redhat-marketplace-lbrlc\" (UID: \"1aa3d999-0b9d-4923-9635-5cd9dc9116ec\") " pod="openshift-marketplace/redhat-marketplace-lbrlc" Mar 16 17:44:03 crc kubenswrapper[5120]: I0316 17:44:03.945957 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdf9r\" (UniqueName: \"kubernetes.io/projected/1aa3d999-0b9d-4923-9635-5cd9dc9116ec-kube-api-access-wdf9r\") pod \"redhat-marketplace-lbrlc\" (UID: \"1aa3d999-0b9d-4923-9635-5cd9dc9116ec\") " pod="openshift-marketplace/redhat-marketplace-lbrlc" Mar 16 17:44:04 crc kubenswrapper[5120]: I0316 17:44:04.010584 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-lbrlc" Mar 16 17:44:04 crc kubenswrapper[5120]: I0316 17:44:04.427177 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-lbrlc"] Mar 16 17:44:04 crc kubenswrapper[5120]: I0316 17:44:04.875342 5120 generic.go:358] "Generic (PLEG): container finished" podID="1aa3d999-0b9d-4923-9635-5cd9dc9116ec" containerID="cbdfb5a22663d0f51e817fe819f50886ee02b4c7d089ffc1f10fa62c454df2ab" exitCode=0 Mar 16 17:44:04 crc kubenswrapper[5120]: I0316 17:44:04.875411 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-lbrlc" event={"ID":"1aa3d999-0b9d-4923-9635-5cd9dc9116ec","Type":"ContainerDied","Data":"cbdfb5a22663d0f51e817fe819f50886ee02b4c7d089ffc1f10fa62c454df2ab"} Mar 16 17:44:04 crc kubenswrapper[5120]: I0316 17:44:04.875669 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-lbrlc" event={"ID":"1aa3d999-0b9d-4923-9635-5cd9dc9116ec","Type":"ContainerStarted","Data":"0c04f0620a8592598dbe8cfdd19cca924a2f49df89b2a1d9babe19a6fa3fe965"} Mar 16 17:44:05 crc kubenswrapper[5120]: I0316 17:44:05.139112 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561384-lwfkn" Mar 16 17:44:05 crc kubenswrapper[5120]: I0316 17:44:05.250215 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4kb5p\" (UniqueName: \"kubernetes.io/projected/340eebbe-5b02-446c-b75b-4defea482635-kube-api-access-4kb5p\") pod \"340eebbe-5b02-446c-b75b-4defea482635\" (UID: \"340eebbe-5b02-446c-b75b-4defea482635\") " Mar 16 17:44:05 crc kubenswrapper[5120]: I0316 17:44:05.256994 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/340eebbe-5b02-446c-b75b-4defea482635-kube-api-access-4kb5p" (OuterVolumeSpecName: "kube-api-access-4kb5p") pod "340eebbe-5b02-446c-b75b-4defea482635" (UID: "340eebbe-5b02-446c-b75b-4defea482635"). InnerVolumeSpecName "kube-api-access-4kb5p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:44:05 crc kubenswrapper[5120]: I0316 17:44:05.353533 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4kb5p\" (UniqueName: \"kubernetes.io/projected/340eebbe-5b02-446c-b75b-4defea482635-kube-api-access-4kb5p\") on node \"crc\" DevicePath \"\"" Mar 16 17:44:05 crc kubenswrapper[5120]: I0316 17:44:05.889014 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561384-lwfkn" Mar 16 17:44:05 crc kubenswrapper[5120]: I0316 17:44:05.889026 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561384-lwfkn" event={"ID":"340eebbe-5b02-446c-b75b-4defea482635","Type":"ContainerDied","Data":"43cb85c010d13a78921ea8a4eea97a03d32779d76e1f75456f0843ac5e748fe5"} Mar 16 17:44:05 crc kubenswrapper[5120]: I0316 17:44:05.889060 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="43cb85c010d13a78921ea8a4eea97a03d32779d76e1f75456f0843ac5e748fe5" Mar 16 17:44:05 crc kubenswrapper[5120]: I0316 17:44:05.892507 5120 generic.go:358] "Generic (PLEG): container finished" podID="1aa3d999-0b9d-4923-9635-5cd9dc9116ec" containerID="8e956b63f6fda7f82ebd88e9f9f31050ff6ac7f243a166544f5425e3be0f55a3" exitCode=0 Mar 16 17:44:05 crc kubenswrapper[5120]: I0316 17:44:05.892773 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-lbrlc" event={"ID":"1aa3d999-0b9d-4923-9635-5cd9dc9116ec","Type":"ContainerDied","Data":"8e956b63f6fda7f82ebd88e9f9f31050ff6ac7f243a166544f5425e3be0f55a3"} Mar 16 17:44:05 crc kubenswrapper[5120]: I0316 17:44:05.925939 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-infra/auto-csr-approver-29561378-5ghjn"] Mar 16 17:44:05 crc kubenswrapper[5120]: I0316 17:44:05.931246 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-infra/auto-csr-approver-29561378-5ghjn"] Mar 16 17:44:06 crc kubenswrapper[5120]: I0316 17:44:06.676177 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="496a6dae-c160-45fc-8d5e-6fa4e6bf3e04" path="/var/lib/kubelet/pods/496a6dae-c160-45fc-8d5e-6fa4e6bf3e04/volumes" Mar 16 17:44:06 crc kubenswrapper[5120]: I0316 17:44:06.901976 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-lbrlc" event={"ID":"1aa3d999-0b9d-4923-9635-5cd9dc9116ec","Type":"ContainerStarted","Data":"45023ce2880f2f9f293600cead9de016688cd5e4a06a2beb23d5ab6405e07906"} Mar 16 17:44:06 crc kubenswrapper[5120]: I0316 17:44:06.904113 5120 generic.go:358] "Generic (PLEG): container finished" podID="69818304-cbec-4828-a572-6bbc566dc6b7" containerID="4f437f705cee7518af5b9401afb484729c441326c169f297fdb3c8680e2fb728" exitCode=0 Mar 16 17:44:06 crc kubenswrapper[5120]: I0316 17:44:06.904204 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/rabbitmq-server-0" event={"ID":"69818304-cbec-4828-a572-6bbc566dc6b7","Type":"ContainerDied","Data":"4f437f705cee7518af5b9401afb484729c441326c169f297fdb3c8680e2fb728"} Mar 16 17:44:06 crc kubenswrapper[5120]: I0316 17:44:06.929171 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/redhat-marketplace-lbrlc" podStartSLOduration=3.314135916 podStartE2EDuration="3.929152432s" podCreationTimestamp="2026-03-16 17:44:03 +0000 UTC" firstStartedPulling="2026-03-16 17:44:04.876113454 +0000 UTC m=+7947.030045111" lastFinishedPulling="2026-03-16 17:44:05.49112997 +0000 UTC m=+7947.645061627" observedRunningTime="2026-03-16 17:44:06.922925953 +0000 UTC m=+7949.076857630" watchObservedRunningTime="2026-03-16 17:44:06.929152432 +0000 UTC m=+7949.083084079" Mar 16 17:44:07 crc kubenswrapper[5120]: I0316 17:44:07.277197 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/certified-operators-22hmh"] Mar 16 17:44:07 crc kubenswrapper[5120]: I0316 17:44:07.277729 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-marketplace/certified-operators-22hmh" podUID="a11a4423-5d3f-4457-b0e0-935992f15021" containerName="registry-server" containerID="cri-o://e82dfc36e17473b228cb3b60dd210423957019c26097a662a02f9ac4a25515a8" gracePeriod=2 Mar 16 17:44:07 crc kubenswrapper[5120]: I0316 17:44:07.661946 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-22hmh" Mar 16 17:44:07 crc kubenswrapper[5120]: E0316 17:44:07.750844 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1125837 actualBytes=10240 Mar 16 17:44:07 crc kubenswrapper[5120]: I0316 17:44:07.806893 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/a11a4423-5d3f-4457-b0e0-935992f15021-catalog-content\") pod \"a11a4423-5d3f-4457-b0e0-935992f15021\" (UID: \"a11a4423-5d3f-4457-b0e0-935992f15021\") " Mar 16 17:44:07 crc kubenswrapper[5120]: I0316 17:44:07.807051 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c6zth\" (UniqueName: \"kubernetes.io/projected/a11a4423-5d3f-4457-b0e0-935992f15021-kube-api-access-c6zth\") pod \"a11a4423-5d3f-4457-b0e0-935992f15021\" (UID: \"a11a4423-5d3f-4457-b0e0-935992f15021\") " Mar 16 17:44:07 crc kubenswrapper[5120]: I0316 17:44:07.807230 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/a11a4423-5d3f-4457-b0e0-935992f15021-utilities\") pod \"a11a4423-5d3f-4457-b0e0-935992f15021\" (UID: \"a11a4423-5d3f-4457-b0e0-935992f15021\") " Mar 16 17:44:07 crc kubenswrapper[5120]: I0316 17:44:07.808929 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a11a4423-5d3f-4457-b0e0-935992f15021-utilities" (OuterVolumeSpecName: "utilities") pod "a11a4423-5d3f-4457-b0e0-935992f15021" (UID: "a11a4423-5d3f-4457-b0e0-935992f15021"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:44:07 crc kubenswrapper[5120]: I0316 17:44:07.812881 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a11a4423-5d3f-4457-b0e0-935992f15021-kube-api-access-c6zth" (OuterVolumeSpecName: "kube-api-access-c6zth") pod "a11a4423-5d3f-4457-b0e0-935992f15021" (UID: "a11a4423-5d3f-4457-b0e0-935992f15021"). InnerVolumeSpecName "kube-api-access-c6zth". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:44:07 crc kubenswrapper[5120]: I0316 17:44:07.851206 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a11a4423-5d3f-4457-b0e0-935992f15021-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "a11a4423-5d3f-4457-b0e0-935992f15021" (UID: "a11a4423-5d3f-4457-b0e0-935992f15021"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:44:07 crc kubenswrapper[5120]: I0316 17:44:07.910141 5120 reconciler_common.go:299] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/a11a4423-5d3f-4457-b0e0-935992f15021-catalog-content\") on node \"crc\" DevicePath \"\"" Mar 16 17:44:07 crc kubenswrapper[5120]: I0316 17:44:07.910170 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c6zth\" (UniqueName: \"kubernetes.io/projected/a11a4423-5d3f-4457-b0e0-935992f15021-kube-api-access-c6zth\") on node \"crc\" DevicePath \"\"" Mar 16 17:44:07 crc kubenswrapper[5120]: I0316 17:44:07.910179 5120 reconciler_common.go:299] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/a11a4423-5d3f-4457-b0e0-935992f15021-utilities\") on node \"crc\" DevicePath \"\"" Mar 16 17:44:07 crc kubenswrapper[5120]: I0316 17:44:07.917314 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/rabbitmq-server-0" event={"ID":"69818304-cbec-4828-a572-6bbc566dc6b7","Type":"ContainerStarted","Data":"d640d0a123d6c4156f236bf2e2bce34c40bd81ba25310c0e23324ea8f867111d"} Mar 16 17:44:07 crc kubenswrapper[5120]: I0316 17:44:07.917671 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keystone-kuttl-tests/rabbitmq-server-0" Mar 16 17:44:07 crc kubenswrapper[5120]: I0316 17:44:07.919936 5120 generic.go:358] "Generic (PLEG): container finished" podID="a11a4423-5d3f-4457-b0e0-935992f15021" containerID="e82dfc36e17473b228cb3b60dd210423957019c26097a662a02f9ac4a25515a8" exitCode=0 Mar 16 17:44:07 crc kubenswrapper[5120]: I0316 17:44:07.920804 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-22hmh" Mar 16 17:44:07 crc kubenswrapper[5120]: I0316 17:44:07.922891 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-22hmh" event={"ID":"a11a4423-5d3f-4457-b0e0-935992f15021","Type":"ContainerDied","Data":"e82dfc36e17473b228cb3b60dd210423957019c26097a662a02f9ac4a25515a8"} Mar 16 17:44:07 crc kubenswrapper[5120]: I0316 17:44:07.922963 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-22hmh" event={"ID":"a11a4423-5d3f-4457-b0e0-935992f15021","Type":"ContainerDied","Data":"39e9d9f54437d8928e8c4cbdc6d3103919f25a5455dc970a93678b3df4fdad16"} Mar 16 17:44:07 crc kubenswrapper[5120]: I0316 17:44:07.922994 5120 scope.go:117] "RemoveContainer" containerID="e82dfc36e17473b228cb3b60dd210423957019c26097a662a02f9ac4a25515a8" Mar 16 17:44:07 crc kubenswrapper[5120]: I0316 17:44:07.950134 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keystone-kuttl-tests/rabbitmq-server-0" podStartSLOduration=41.950114328 podStartE2EDuration="41.950114328s" podCreationTimestamp="2026-03-16 17:43:26 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:44:07.942364497 +0000 UTC m=+7950.096296174" watchObservedRunningTime="2026-03-16 17:44:07.950114328 +0000 UTC m=+7950.104045985" Mar 16 17:44:07 crc kubenswrapper[5120]: I0316 17:44:07.957466 5120 scope.go:117] "RemoveContainer" containerID="713e91e918673c31dda02645746adc76e0f2ee966623f47746e2abda0c6049dd" Mar 16 17:44:07 crc kubenswrapper[5120]: I0316 17:44:07.966084 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/certified-operators-22hmh"] Mar 16 17:44:07 crc kubenswrapper[5120]: I0316 17:44:07.973417 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/certified-operators-22hmh"] Mar 16 17:44:07 crc kubenswrapper[5120]: I0316 17:44:07.988788 5120 scope.go:117] "RemoveContainer" containerID="530364c1200d23558c786841f9f640cb7e641acb4405fcf898159954f060d488" Mar 16 17:44:08 crc kubenswrapper[5120]: I0316 17:44:08.005315 5120 scope.go:117] "RemoveContainer" containerID="e82dfc36e17473b228cb3b60dd210423957019c26097a662a02f9ac4a25515a8" Mar 16 17:44:08 crc kubenswrapper[5120]: E0316 17:44:08.005661 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e82dfc36e17473b228cb3b60dd210423957019c26097a662a02f9ac4a25515a8\": container with ID starting with e82dfc36e17473b228cb3b60dd210423957019c26097a662a02f9ac4a25515a8 not found: ID does not exist" containerID="e82dfc36e17473b228cb3b60dd210423957019c26097a662a02f9ac4a25515a8" Mar 16 17:44:08 crc kubenswrapper[5120]: I0316 17:44:08.005690 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e82dfc36e17473b228cb3b60dd210423957019c26097a662a02f9ac4a25515a8"} err="failed to get container status \"e82dfc36e17473b228cb3b60dd210423957019c26097a662a02f9ac4a25515a8\": rpc error: code = NotFound desc = could not find container \"e82dfc36e17473b228cb3b60dd210423957019c26097a662a02f9ac4a25515a8\": container with ID starting with e82dfc36e17473b228cb3b60dd210423957019c26097a662a02f9ac4a25515a8 not found: ID does not exist" Mar 16 17:44:08 crc kubenswrapper[5120]: I0316 17:44:08.005711 5120 scope.go:117] "RemoveContainer" containerID="713e91e918673c31dda02645746adc76e0f2ee966623f47746e2abda0c6049dd" Mar 16 17:44:08 crc kubenswrapper[5120]: E0316 17:44:08.006031 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"713e91e918673c31dda02645746adc76e0f2ee966623f47746e2abda0c6049dd\": container with ID starting with 713e91e918673c31dda02645746adc76e0f2ee966623f47746e2abda0c6049dd not found: ID does not exist" containerID="713e91e918673c31dda02645746adc76e0f2ee966623f47746e2abda0c6049dd" Mar 16 17:44:08 crc kubenswrapper[5120]: I0316 17:44:08.006056 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"713e91e918673c31dda02645746adc76e0f2ee966623f47746e2abda0c6049dd"} err="failed to get container status \"713e91e918673c31dda02645746adc76e0f2ee966623f47746e2abda0c6049dd\": rpc error: code = NotFound desc = could not find container \"713e91e918673c31dda02645746adc76e0f2ee966623f47746e2abda0c6049dd\": container with ID starting with 713e91e918673c31dda02645746adc76e0f2ee966623f47746e2abda0c6049dd not found: ID does not exist" Mar 16 17:44:08 crc kubenswrapper[5120]: I0316 17:44:08.006068 5120 scope.go:117] "RemoveContainer" containerID="530364c1200d23558c786841f9f640cb7e641acb4405fcf898159954f060d488" Mar 16 17:44:08 crc kubenswrapper[5120]: E0316 17:44:08.006394 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"530364c1200d23558c786841f9f640cb7e641acb4405fcf898159954f060d488\": container with ID starting with 530364c1200d23558c786841f9f640cb7e641acb4405fcf898159954f060d488 not found: ID does not exist" containerID="530364c1200d23558c786841f9f640cb7e641acb4405fcf898159954f060d488" Mar 16 17:44:08 crc kubenswrapper[5120]: I0316 17:44:08.006421 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"530364c1200d23558c786841f9f640cb7e641acb4405fcf898159954f060d488"} err="failed to get container status \"530364c1200d23558c786841f9f640cb7e641acb4405fcf898159954f060d488\": rpc error: code = NotFound desc = could not find container \"530364c1200d23558c786841f9f640cb7e641acb4405fcf898159954f060d488\": container with ID starting with 530364c1200d23558c786841f9f640cb7e641acb4405fcf898159954f060d488 not found: ID does not exist" Mar 16 17:44:08 crc kubenswrapper[5120]: I0316 17:44:08.291619 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/community-operators-kc8jx"] Mar 16 17:44:08 crc kubenswrapper[5120]: I0316 17:44:08.671929 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a11a4423-5d3f-4457-b0e0-935992f15021" path="/var/lib/kubelet/pods/a11a4423-5d3f-4457-b0e0-935992f15021/volumes" Mar 16 17:44:09 crc kubenswrapper[5120]: I0316 17:44:09.074919 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/community-operators-ljct4"] Mar 16 17:44:09 crc kubenswrapper[5120]: I0316 17:44:09.075188 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-marketplace/community-operators-ljct4" podUID="931f5e13-4fc0-4007-beb8-a617915a97ca" containerName="registry-server" containerID="cri-o://ac30de68f92dd569bb2d25c316213e1cf911869e277f1fb98d930eafecdba86d" gracePeriod=2 Mar 16 17:44:09 crc kubenswrapper[5120]: E0316 17:44:09.143013 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of ac30de68f92dd569bb2d25c316213e1cf911869e277f1fb98d930eafecdba86d is running failed: container process not found" containerID="ac30de68f92dd569bb2d25c316213e1cf911869e277f1fb98d930eafecdba86d" cmd=["grpc_health_probe","-addr=:50051"] Mar 16 17:44:09 crc kubenswrapper[5120]: E0316 17:44:09.143385 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of ac30de68f92dd569bb2d25c316213e1cf911869e277f1fb98d930eafecdba86d is running failed: container process not found" containerID="ac30de68f92dd569bb2d25c316213e1cf911869e277f1fb98d930eafecdba86d" cmd=["grpc_health_probe","-addr=:50051"] Mar 16 17:44:09 crc kubenswrapper[5120]: E0316 17:44:09.143815 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of ac30de68f92dd569bb2d25c316213e1cf911869e277f1fb98d930eafecdba86d is running failed: container process not found" containerID="ac30de68f92dd569bb2d25c316213e1cf911869e277f1fb98d930eafecdba86d" cmd=["grpc_health_probe","-addr=:50051"] Mar 16 17:44:09 crc kubenswrapper[5120]: E0316 17:44:09.143863 5120 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of ac30de68f92dd569bb2d25c316213e1cf911869e277f1fb98d930eafecdba86d is running failed: container process not found" probeType="Readiness" pod="openshift-marketplace/community-operators-ljct4" podUID="931f5e13-4fc0-4007-beb8-a617915a97ca" containerName="registry-server" probeResult="unknown" Mar 16 17:44:09 crc kubenswrapper[5120]: I0316 17:44:09.470918 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-ljct4" Mar 16 17:44:09 crc kubenswrapper[5120]: I0316 17:44:09.541703 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/931f5e13-4fc0-4007-beb8-a617915a97ca-catalog-content\") pod \"931f5e13-4fc0-4007-beb8-a617915a97ca\" (UID: \"931f5e13-4fc0-4007-beb8-a617915a97ca\") " Mar 16 17:44:09 crc kubenswrapper[5120]: I0316 17:44:09.541862 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/931f5e13-4fc0-4007-beb8-a617915a97ca-utilities\") pod \"931f5e13-4fc0-4007-beb8-a617915a97ca\" (UID: \"931f5e13-4fc0-4007-beb8-a617915a97ca\") " Mar 16 17:44:09 crc kubenswrapper[5120]: I0316 17:44:09.542025 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q8rqf\" (UniqueName: \"kubernetes.io/projected/931f5e13-4fc0-4007-beb8-a617915a97ca-kube-api-access-q8rqf\") pod \"931f5e13-4fc0-4007-beb8-a617915a97ca\" (UID: \"931f5e13-4fc0-4007-beb8-a617915a97ca\") " Mar 16 17:44:09 crc kubenswrapper[5120]: I0316 17:44:09.542534 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/931f5e13-4fc0-4007-beb8-a617915a97ca-utilities" (OuterVolumeSpecName: "utilities") pod "931f5e13-4fc0-4007-beb8-a617915a97ca" (UID: "931f5e13-4fc0-4007-beb8-a617915a97ca"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:44:09 crc kubenswrapper[5120]: I0316 17:44:09.543208 5120 reconciler_common.go:299] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/931f5e13-4fc0-4007-beb8-a617915a97ca-utilities\") on node \"crc\" DevicePath \"\"" Mar 16 17:44:09 crc kubenswrapper[5120]: I0316 17:44:09.564053 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/931f5e13-4fc0-4007-beb8-a617915a97ca-kube-api-access-q8rqf" (OuterVolumeSpecName: "kube-api-access-q8rqf") pod "931f5e13-4fc0-4007-beb8-a617915a97ca" (UID: "931f5e13-4fc0-4007-beb8-a617915a97ca"). InnerVolumeSpecName "kube-api-access-q8rqf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:44:09 crc kubenswrapper[5120]: I0316 17:44:09.590554 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/931f5e13-4fc0-4007-beb8-a617915a97ca-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "931f5e13-4fc0-4007-beb8-a617915a97ca" (UID: "931f5e13-4fc0-4007-beb8-a617915a97ca"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:44:09 crc kubenswrapper[5120]: I0316 17:44:09.646539 5120 reconciler_common.go:299] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/931f5e13-4fc0-4007-beb8-a617915a97ca-catalog-content\") on node \"crc\" DevicePath \"\"" Mar 16 17:44:09 crc kubenswrapper[5120]: I0316 17:44:09.646605 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q8rqf\" (UniqueName: \"kubernetes.io/projected/931f5e13-4fc0-4007-beb8-a617915a97ca-kube-api-access-q8rqf\") on node \"crc\" DevicePath \"\"" Mar 16 17:44:09 crc kubenswrapper[5120]: I0316 17:44:09.941652 5120 generic.go:358] "Generic (PLEG): container finished" podID="931f5e13-4fc0-4007-beb8-a617915a97ca" containerID="ac30de68f92dd569bb2d25c316213e1cf911869e277f1fb98d930eafecdba86d" exitCode=0 Mar 16 17:44:09 crc kubenswrapper[5120]: I0316 17:44:09.941790 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-ljct4" Mar 16 17:44:09 crc kubenswrapper[5120]: I0316 17:44:09.941789 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-ljct4" event={"ID":"931f5e13-4fc0-4007-beb8-a617915a97ca","Type":"ContainerDied","Data":"ac30de68f92dd569bb2d25c316213e1cf911869e277f1fb98d930eafecdba86d"} Mar 16 17:44:09 crc kubenswrapper[5120]: I0316 17:44:09.941942 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-ljct4" event={"ID":"931f5e13-4fc0-4007-beb8-a617915a97ca","Type":"ContainerDied","Data":"8c3d817ca5d91c6aa5b84e9ee170de4bf54adf094399d2aabff2406bccc56d24"} Mar 16 17:44:09 crc kubenswrapper[5120]: I0316 17:44:09.941972 5120 scope.go:117] "RemoveContainer" containerID="ac30de68f92dd569bb2d25c316213e1cf911869e277f1fb98d930eafecdba86d" Mar 16 17:44:09 crc kubenswrapper[5120]: I0316 17:44:09.973898 5120 scope.go:117] "RemoveContainer" containerID="6add4d3ba52c8a84338b74597755b0b39724d4d67a8f87712695315ac4ca9789" Mar 16 17:44:09 crc kubenswrapper[5120]: I0316 17:44:09.977479 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/community-operators-ljct4"] Mar 16 17:44:09 crc kubenswrapper[5120]: I0316 17:44:09.987395 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/community-operators-ljct4"] Mar 16 17:44:09 crc kubenswrapper[5120]: I0316 17:44:09.991498 5120 scope.go:117] "RemoveContainer" containerID="e8aabb5c8b97b74d18728637c12890fb39dcaa418852db12f209fb2aa513f458" Mar 16 17:44:10 crc kubenswrapper[5120]: I0316 17:44:10.023452 5120 scope.go:117] "RemoveContainer" containerID="ac30de68f92dd569bb2d25c316213e1cf911869e277f1fb98d930eafecdba86d" Mar 16 17:44:10 crc kubenswrapper[5120]: E0316 17:44:10.027532 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac30de68f92dd569bb2d25c316213e1cf911869e277f1fb98d930eafecdba86d\": container with ID starting with ac30de68f92dd569bb2d25c316213e1cf911869e277f1fb98d930eafecdba86d not found: ID does not exist" containerID="ac30de68f92dd569bb2d25c316213e1cf911869e277f1fb98d930eafecdba86d" Mar 16 17:44:10 crc kubenswrapper[5120]: I0316 17:44:10.027660 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac30de68f92dd569bb2d25c316213e1cf911869e277f1fb98d930eafecdba86d"} err="failed to get container status \"ac30de68f92dd569bb2d25c316213e1cf911869e277f1fb98d930eafecdba86d\": rpc error: code = NotFound desc = could not find container \"ac30de68f92dd569bb2d25c316213e1cf911869e277f1fb98d930eafecdba86d\": container with ID starting with ac30de68f92dd569bb2d25c316213e1cf911869e277f1fb98d930eafecdba86d not found: ID does not exist" Mar 16 17:44:10 crc kubenswrapper[5120]: I0316 17:44:10.027786 5120 scope.go:117] "RemoveContainer" containerID="6add4d3ba52c8a84338b74597755b0b39724d4d67a8f87712695315ac4ca9789" Mar 16 17:44:10 crc kubenswrapper[5120]: E0316 17:44:10.028682 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6add4d3ba52c8a84338b74597755b0b39724d4d67a8f87712695315ac4ca9789\": container with ID starting with 6add4d3ba52c8a84338b74597755b0b39724d4d67a8f87712695315ac4ca9789 not found: ID does not exist" containerID="6add4d3ba52c8a84338b74597755b0b39724d4d67a8f87712695315ac4ca9789" Mar 16 17:44:10 crc kubenswrapper[5120]: I0316 17:44:10.028713 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6add4d3ba52c8a84338b74597755b0b39724d4d67a8f87712695315ac4ca9789"} err="failed to get container status \"6add4d3ba52c8a84338b74597755b0b39724d4d67a8f87712695315ac4ca9789\": rpc error: code = NotFound desc = could not find container \"6add4d3ba52c8a84338b74597755b0b39724d4d67a8f87712695315ac4ca9789\": container with ID starting with 6add4d3ba52c8a84338b74597755b0b39724d4d67a8f87712695315ac4ca9789 not found: ID does not exist" Mar 16 17:44:10 crc kubenswrapper[5120]: I0316 17:44:10.028729 5120 scope.go:117] "RemoveContainer" containerID="e8aabb5c8b97b74d18728637c12890fb39dcaa418852db12f209fb2aa513f458" Mar 16 17:44:10 crc kubenswrapper[5120]: E0316 17:44:10.028986 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e8aabb5c8b97b74d18728637c12890fb39dcaa418852db12f209fb2aa513f458\": container with ID starting with e8aabb5c8b97b74d18728637c12890fb39dcaa418852db12f209fb2aa513f458 not found: ID does not exist" containerID="e8aabb5c8b97b74d18728637c12890fb39dcaa418852db12f209fb2aa513f458" Mar 16 17:44:10 crc kubenswrapper[5120]: I0316 17:44:10.029008 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8aabb5c8b97b74d18728637c12890fb39dcaa418852db12f209fb2aa513f458"} err="failed to get container status \"e8aabb5c8b97b74d18728637c12890fb39dcaa418852db12f209fb2aa513f458\": rpc error: code = NotFound desc = could not find container \"e8aabb5c8b97b74d18728637c12890fb39dcaa418852db12f209fb2aa513f458\": container with ID starting with e8aabb5c8b97b74d18728637c12890fb39dcaa418852db12f209fb2aa513f458 not found: ID does not exist" Mar 16 17:44:10 crc kubenswrapper[5120]: I0316 17:44:10.672896 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="931f5e13-4fc0-4007-beb8-a617915a97ca" path="/var/lib/kubelet/pods/931f5e13-4fc0-4007-beb8-a617915a97ca/volumes" Mar 16 17:44:13 crc kubenswrapper[5120]: I0316 17:44:13.663649 5120 scope.go:117] "RemoveContainer" containerID="7fd764dd19065c7ce437c63b05fda51970409dfa8dfd1c77e2158bb3e05b7723" Mar 16 17:44:13 crc kubenswrapper[5120]: E0316 17:44:13.664357 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 17:44:14 crc kubenswrapper[5120]: I0316 17:44:14.011296 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-marketplace-lbrlc" Mar 16 17:44:14 crc kubenswrapper[5120]: I0316 17:44:14.011363 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-marketplace/redhat-marketplace-lbrlc" Mar 16 17:44:14 crc kubenswrapper[5120]: I0316 17:44:14.068139 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-marketplace-lbrlc" Mar 16 17:44:15 crc kubenswrapper[5120]: I0316 17:44:15.025373 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-marketplace-lbrlc" Mar 16 17:44:18 crc kubenswrapper[5120]: I0316 17:44:18.934812 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="keystone-kuttl-tests/rabbitmq-server-0" Mar 16 17:44:19 crc kubenswrapper[5120]: I0316 17:44:19.477456 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keystone-kuttl-tests/keystone-db-sync-qkjpt"] Mar 16 17:44:19 crc kubenswrapper[5120]: I0316 17:44:19.483662 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a11a4423-5d3f-4457-b0e0-935992f15021" containerName="registry-server" Mar 16 17:44:19 crc kubenswrapper[5120]: I0316 17:44:19.483721 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a11a4423-5d3f-4457-b0e0-935992f15021" containerName="registry-server" Mar 16 17:44:19 crc kubenswrapper[5120]: I0316 17:44:19.483775 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a11a4423-5d3f-4457-b0e0-935992f15021" containerName="extract-content" Mar 16 17:44:19 crc kubenswrapper[5120]: I0316 17:44:19.483784 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a11a4423-5d3f-4457-b0e0-935992f15021" containerName="extract-content" Mar 16 17:44:19 crc kubenswrapper[5120]: I0316 17:44:19.483828 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="931f5e13-4fc0-4007-beb8-a617915a97ca" containerName="extract-content" Mar 16 17:44:19 crc kubenswrapper[5120]: I0316 17:44:19.483836 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="931f5e13-4fc0-4007-beb8-a617915a97ca" containerName="extract-content" Mar 16 17:44:19 crc kubenswrapper[5120]: I0316 17:44:19.483858 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="931f5e13-4fc0-4007-beb8-a617915a97ca" containerName="registry-server" Mar 16 17:44:19 crc kubenswrapper[5120]: I0316 17:44:19.483866 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="931f5e13-4fc0-4007-beb8-a617915a97ca" containerName="registry-server" Mar 16 17:44:19 crc kubenswrapper[5120]: I0316 17:44:19.483932 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="340eebbe-5b02-446c-b75b-4defea482635" containerName="oc" Mar 16 17:44:19 crc kubenswrapper[5120]: I0316 17:44:19.483940 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="340eebbe-5b02-446c-b75b-4defea482635" containerName="oc" Mar 16 17:44:19 crc kubenswrapper[5120]: I0316 17:44:19.483959 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a11a4423-5d3f-4457-b0e0-935992f15021" containerName="extract-utilities" Mar 16 17:44:19 crc kubenswrapper[5120]: I0316 17:44:19.483970 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a11a4423-5d3f-4457-b0e0-935992f15021" containerName="extract-utilities" Mar 16 17:44:19 crc kubenswrapper[5120]: I0316 17:44:19.484004 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="931f5e13-4fc0-4007-beb8-a617915a97ca" containerName="extract-utilities" Mar 16 17:44:19 crc kubenswrapper[5120]: I0316 17:44:19.484013 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="931f5e13-4fc0-4007-beb8-a617915a97ca" containerName="extract-utilities" Mar 16 17:44:19 crc kubenswrapper[5120]: I0316 17:44:19.484601 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="931f5e13-4fc0-4007-beb8-a617915a97ca" containerName="registry-server" Mar 16 17:44:19 crc kubenswrapper[5120]: I0316 17:44:19.484640 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="340eebbe-5b02-446c-b75b-4defea482635" containerName="oc" Mar 16 17:44:19 crc kubenswrapper[5120]: I0316 17:44:19.484676 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="a11a4423-5d3f-4457-b0e0-935992f15021" containerName="registry-server" Mar 16 17:44:19 crc kubenswrapper[5120]: I0316 17:44:19.495257 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-db-sync-qkjpt" Mar 16 17:44:19 crc kubenswrapper[5120]: I0316 17:44:19.498939 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keystone-kuttl-tests\"/\"keystone-scripts\"" Mar 16 17:44:19 crc kubenswrapper[5120]: I0316 17:44:19.499230 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keystone-kuttl-tests\"/\"keystone-config-data\"" Mar 16 17:44:19 crc kubenswrapper[5120]: I0316 17:44:19.499592 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keystone-kuttl-tests\"/\"keystone-keystone-dockercfg-p46q7\"" Mar 16 17:44:19 crc kubenswrapper[5120]: I0316 17:44:19.499681 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keystone-kuttl-tests\"/\"keystone\"" Mar 16 17:44:19 crc kubenswrapper[5120]: I0316 17:44:19.521650 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone-db-sync-qkjpt"] Mar 16 17:44:19 crc kubenswrapper[5120]: I0316 17:44:19.597422 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jm2bz\" (UniqueName: \"kubernetes.io/projected/d93a17d1-0f0a-495e-9394-1907d42b10d4-kube-api-access-jm2bz\") pod \"keystone-db-sync-qkjpt\" (UID: \"d93a17d1-0f0a-495e-9394-1907d42b10d4\") " pod="keystone-kuttl-tests/keystone-db-sync-qkjpt" Mar 16 17:44:19 crc kubenswrapper[5120]: I0316 17:44:19.597865 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d93a17d1-0f0a-495e-9394-1907d42b10d4-config-data\") pod \"keystone-db-sync-qkjpt\" (UID: \"d93a17d1-0f0a-495e-9394-1907d42b10d4\") " pod="keystone-kuttl-tests/keystone-db-sync-qkjpt" Mar 16 17:44:19 crc kubenswrapper[5120]: I0316 17:44:19.699923 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jm2bz\" (UniqueName: \"kubernetes.io/projected/d93a17d1-0f0a-495e-9394-1907d42b10d4-kube-api-access-jm2bz\") pod \"keystone-db-sync-qkjpt\" (UID: \"d93a17d1-0f0a-495e-9394-1907d42b10d4\") " pod="keystone-kuttl-tests/keystone-db-sync-qkjpt" Mar 16 17:44:19 crc kubenswrapper[5120]: I0316 17:44:19.700173 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d93a17d1-0f0a-495e-9394-1907d42b10d4-config-data\") pod \"keystone-db-sync-qkjpt\" (UID: \"d93a17d1-0f0a-495e-9394-1907d42b10d4\") " pod="keystone-kuttl-tests/keystone-db-sync-qkjpt" Mar 16 17:44:19 crc kubenswrapper[5120]: I0316 17:44:19.716643 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d93a17d1-0f0a-495e-9394-1907d42b10d4-config-data\") pod \"keystone-db-sync-qkjpt\" (UID: \"d93a17d1-0f0a-495e-9394-1907d42b10d4\") " pod="keystone-kuttl-tests/keystone-db-sync-qkjpt" Mar 16 17:44:19 crc kubenswrapper[5120]: I0316 17:44:19.736399 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jm2bz\" (UniqueName: \"kubernetes.io/projected/d93a17d1-0f0a-495e-9394-1907d42b10d4-kube-api-access-jm2bz\") pod \"keystone-db-sync-qkjpt\" (UID: \"d93a17d1-0f0a-495e-9394-1907d42b10d4\") " pod="keystone-kuttl-tests/keystone-db-sync-qkjpt" Mar 16 17:44:19 crc kubenswrapper[5120]: I0316 17:44:19.820319 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-db-sync-qkjpt" Mar 16 17:44:20 crc kubenswrapper[5120]: I0316 17:44:20.074376 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-marketplace-lbrlc"] Mar 16 17:44:20 crc kubenswrapper[5120]: I0316 17:44:20.075162 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-marketplace/redhat-marketplace-lbrlc" podUID="1aa3d999-0b9d-4923-9635-5cd9dc9116ec" containerName="registry-server" containerID="cri-o://45023ce2880f2f9f293600cead9de016688cd5e4a06a2beb23d5ab6405e07906" gracePeriod=2 Mar 16 17:44:20 crc kubenswrapper[5120]: I0316 17:44:20.231086 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone-db-sync-qkjpt"] Mar 16 17:44:20 crc kubenswrapper[5120]: W0316 17:44:20.233985 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd93a17d1_0f0a_495e_9394_1907d42b10d4.slice/crio-4a7d09e695a921c34089eb68156b8cac66d647c20430b664f8a67b129e167db3 WatchSource:0}: Error finding container 4a7d09e695a921c34089eb68156b8cac66d647c20430b664f8a67b129e167db3: Status 404 returned error can't find the container with id 4a7d09e695a921c34089eb68156b8cac66d647c20430b664f8a67b129e167db3 Mar 16 17:44:20 crc kubenswrapper[5120]: I0316 17:44:20.385642 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-lbrlc" Mar 16 17:44:20 crc kubenswrapper[5120]: I0316 17:44:20.415543 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/1aa3d999-0b9d-4923-9635-5cd9dc9116ec-utilities\") pod \"1aa3d999-0b9d-4923-9635-5cd9dc9116ec\" (UID: \"1aa3d999-0b9d-4923-9635-5cd9dc9116ec\") " Mar 16 17:44:20 crc kubenswrapper[5120]: I0316 17:44:20.415844 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wdf9r\" (UniqueName: \"kubernetes.io/projected/1aa3d999-0b9d-4923-9635-5cd9dc9116ec-kube-api-access-wdf9r\") pod \"1aa3d999-0b9d-4923-9635-5cd9dc9116ec\" (UID: \"1aa3d999-0b9d-4923-9635-5cd9dc9116ec\") " Mar 16 17:44:20 crc kubenswrapper[5120]: I0316 17:44:20.416030 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/1aa3d999-0b9d-4923-9635-5cd9dc9116ec-catalog-content\") pod \"1aa3d999-0b9d-4923-9635-5cd9dc9116ec\" (UID: \"1aa3d999-0b9d-4923-9635-5cd9dc9116ec\") " Mar 16 17:44:20 crc kubenswrapper[5120]: I0316 17:44:20.424400 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1aa3d999-0b9d-4923-9635-5cd9dc9116ec-utilities" (OuterVolumeSpecName: "utilities") pod "1aa3d999-0b9d-4923-9635-5cd9dc9116ec" (UID: "1aa3d999-0b9d-4923-9635-5cd9dc9116ec"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:44:20 crc kubenswrapper[5120]: I0316 17:44:20.425871 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1aa3d999-0b9d-4923-9635-5cd9dc9116ec-kube-api-access-wdf9r" (OuterVolumeSpecName: "kube-api-access-wdf9r") pod "1aa3d999-0b9d-4923-9635-5cd9dc9116ec" (UID: "1aa3d999-0b9d-4923-9635-5cd9dc9116ec"). InnerVolumeSpecName "kube-api-access-wdf9r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:44:20 crc kubenswrapper[5120]: I0316 17:44:20.434213 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1aa3d999-0b9d-4923-9635-5cd9dc9116ec-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "1aa3d999-0b9d-4923-9635-5cd9dc9116ec" (UID: "1aa3d999-0b9d-4923-9635-5cd9dc9116ec"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:44:20 crc kubenswrapper[5120]: I0316 17:44:20.518719 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wdf9r\" (UniqueName: \"kubernetes.io/projected/1aa3d999-0b9d-4923-9635-5cd9dc9116ec-kube-api-access-wdf9r\") on node \"crc\" DevicePath \"\"" Mar 16 17:44:20 crc kubenswrapper[5120]: I0316 17:44:20.518770 5120 reconciler_common.go:299] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/1aa3d999-0b9d-4923-9635-5cd9dc9116ec-catalog-content\") on node \"crc\" DevicePath \"\"" Mar 16 17:44:20 crc kubenswrapper[5120]: I0316 17:44:20.518780 5120 reconciler_common.go:299] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/1aa3d999-0b9d-4923-9635-5cd9dc9116ec-utilities\") on node \"crc\" DevicePath \"\"" Mar 16 17:44:21 crc kubenswrapper[5120]: I0316 17:44:21.041128 5120 generic.go:358] "Generic (PLEG): container finished" podID="1aa3d999-0b9d-4923-9635-5cd9dc9116ec" containerID="45023ce2880f2f9f293600cead9de016688cd5e4a06a2beb23d5ab6405e07906" exitCode=0 Mar 16 17:44:21 crc kubenswrapper[5120]: I0316 17:44:21.041216 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-lbrlc" event={"ID":"1aa3d999-0b9d-4923-9635-5cd9dc9116ec","Type":"ContainerDied","Data":"45023ce2880f2f9f293600cead9de016688cd5e4a06a2beb23d5ab6405e07906"} Mar 16 17:44:21 crc kubenswrapper[5120]: I0316 17:44:21.041702 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-lbrlc" event={"ID":"1aa3d999-0b9d-4923-9635-5cd9dc9116ec","Type":"ContainerDied","Data":"0c04f0620a8592598dbe8cfdd19cca924a2f49df89b2a1d9babe19a6fa3fe965"} Mar 16 17:44:21 crc kubenswrapper[5120]: I0316 17:44:21.041307 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-lbrlc" Mar 16 17:44:21 crc kubenswrapper[5120]: I0316 17:44:21.041747 5120 scope.go:117] "RemoveContainer" containerID="45023ce2880f2f9f293600cead9de016688cd5e4a06a2beb23d5ab6405e07906" Mar 16 17:44:21 crc kubenswrapper[5120]: I0316 17:44:21.047192 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-db-sync-qkjpt" event={"ID":"d93a17d1-0f0a-495e-9394-1907d42b10d4","Type":"ContainerStarted","Data":"ee00ce99a9c40b2aca7d3a4f65b2ea7e281e49084f65501006952a8f8a4ad2b0"} Mar 16 17:44:21 crc kubenswrapper[5120]: I0316 17:44:21.047277 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-db-sync-qkjpt" event={"ID":"d93a17d1-0f0a-495e-9394-1907d42b10d4","Type":"ContainerStarted","Data":"4a7d09e695a921c34089eb68156b8cac66d647c20430b664f8a67b129e167db3"} Mar 16 17:44:21 crc kubenswrapper[5120]: I0316 17:44:21.066734 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-marketplace-lbrlc"] Mar 16 17:44:21 crc kubenswrapper[5120]: I0316 17:44:21.072028 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/redhat-marketplace-lbrlc"] Mar 16 17:44:21 crc kubenswrapper[5120]: I0316 17:44:21.087108 5120 scope.go:117] "RemoveContainer" containerID="8e956b63f6fda7f82ebd88e9f9f31050ff6ac7f243a166544f5425e3be0f55a3" Mar 16 17:44:21 crc kubenswrapper[5120]: I0316 17:44:21.107641 5120 scope.go:117] "RemoveContainer" containerID="cbdfb5a22663d0f51e817fe819f50886ee02b4c7d089ffc1f10fa62c454df2ab" Mar 16 17:44:21 crc kubenswrapper[5120]: I0316 17:44:21.139516 5120 scope.go:117] "RemoveContainer" containerID="45023ce2880f2f9f293600cead9de016688cd5e4a06a2beb23d5ab6405e07906" Mar 16 17:44:21 crc kubenswrapper[5120]: E0316 17:44:21.139866 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"45023ce2880f2f9f293600cead9de016688cd5e4a06a2beb23d5ab6405e07906\": container with ID starting with 45023ce2880f2f9f293600cead9de016688cd5e4a06a2beb23d5ab6405e07906 not found: ID does not exist" containerID="45023ce2880f2f9f293600cead9de016688cd5e4a06a2beb23d5ab6405e07906" Mar 16 17:44:21 crc kubenswrapper[5120]: I0316 17:44:21.139907 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45023ce2880f2f9f293600cead9de016688cd5e4a06a2beb23d5ab6405e07906"} err="failed to get container status \"45023ce2880f2f9f293600cead9de016688cd5e4a06a2beb23d5ab6405e07906\": rpc error: code = NotFound desc = could not find container \"45023ce2880f2f9f293600cead9de016688cd5e4a06a2beb23d5ab6405e07906\": container with ID starting with 45023ce2880f2f9f293600cead9de016688cd5e4a06a2beb23d5ab6405e07906 not found: ID does not exist" Mar 16 17:44:21 crc kubenswrapper[5120]: I0316 17:44:21.139937 5120 scope.go:117] "RemoveContainer" containerID="8e956b63f6fda7f82ebd88e9f9f31050ff6ac7f243a166544f5425e3be0f55a3" Mar 16 17:44:21 crc kubenswrapper[5120]: E0316 17:44:21.140180 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e956b63f6fda7f82ebd88e9f9f31050ff6ac7f243a166544f5425e3be0f55a3\": container with ID starting with 8e956b63f6fda7f82ebd88e9f9f31050ff6ac7f243a166544f5425e3be0f55a3 not found: ID does not exist" containerID="8e956b63f6fda7f82ebd88e9f9f31050ff6ac7f243a166544f5425e3be0f55a3" Mar 16 17:44:21 crc kubenswrapper[5120]: I0316 17:44:21.140236 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e956b63f6fda7f82ebd88e9f9f31050ff6ac7f243a166544f5425e3be0f55a3"} err="failed to get container status \"8e956b63f6fda7f82ebd88e9f9f31050ff6ac7f243a166544f5425e3be0f55a3\": rpc error: code = NotFound desc = could not find container \"8e956b63f6fda7f82ebd88e9f9f31050ff6ac7f243a166544f5425e3be0f55a3\": container with ID starting with 8e956b63f6fda7f82ebd88e9f9f31050ff6ac7f243a166544f5425e3be0f55a3 not found: ID does not exist" Mar 16 17:44:21 crc kubenswrapper[5120]: I0316 17:44:21.140255 5120 scope.go:117] "RemoveContainer" containerID="cbdfb5a22663d0f51e817fe819f50886ee02b4c7d089ffc1f10fa62c454df2ab" Mar 16 17:44:21 crc kubenswrapper[5120]: E0316 17:44:21.140480 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cbdfb5a22663d0f51e817fe819f50886ee02b4c7d089ffc1f10fa62c454df2ab\": container with ID starting with cbdfb5a22663d0f51e817fe819f50886ee02b4c7d089ffc1f10fa62c454df2ab not found: ID does not exist" containerID="cbdfb5a22663d0f51e817fe819f50886ee02b4c7d089ffc1f10fa62c454df2ab" Mar 16 17:44:21 crc kubenswrapper[5120]: I0316 17:44:21.140508 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cbdfb5a22663d0f51e817fe819f50886ee02b4c7d089ffc1f10fa62c454df2ab"} err="failed to get container status \"cbdfb5a22663d0f51e817fe819f50886ee02b4c7d089ffc1f10fa62c454df2ab\": rpc error: code = NotFound desc = could not find container \"cbdfb5a22663d0f51e817fe819f50886ee02b4c7d089ffc1f10fa62c454df2ab\": container with ID starting with cbdfb5a22663d0f51e817fe819f50886ee02b4c7d089ffc1f10fa62c454df2ab not found: ID does not exist" Mar 16 17:44:22 crc kubenswrapper[5120]: I0316 17:44:22.672297 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1aa3d999-0b9d-4923-9635-5cd9dc9116ec" path="/var/lib/kubelet/pods/1aa3d999-0b9d-4923-9635-5cd9dc9116ec/volumes" Mar 16 17:44:24 crc kubenswrapper[5120]: I0316 17:44:24.073688 5120 generic.go:358] "Generic (PLEG): container finished" podID="d93a17d1-0f0a-495e-9394-1907d42b10d4" containerID="ee00ce99a9c40b2aca7d3a4f65b2ea7e281e49084f65501006952a8f8a4ad2b0" exitCode=0 Mar 16 17:44:24 crc kubenswrapper[5120]: I0316 17:44:24.073776 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-db-sync-qkjpt" event={"ID":"d93a17d1-0f0a-495e-9394-1907d42b10d4","Type":"ContainerDied","Data":"ee00ce99a9c40b2aca7d3a4f65b2ea7e281e49084f65501006952a8f8a4ad2b0"} Mar 16 17:44:24 crc kubenswrapper[5120]: I0316 17:44:24.665405 5120 scope.go:117] "RemoveContainer" containerID="7fd764dd19065c7ce437c63b05fda51970409dfa8dfd1c77e2158bb3e05b7723" Mar 16 17:44:24 crc kubenswrapper[5120]: E0316 17:44:24.666003 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 17:44:25 crc kubenswrapper[5120]: I0316 17:44:25.363411 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-db-sync-qkjpt" Mar 16 17:44:25 crc kubenswrapper[5120]: I0316 17:44:25.534260 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d93a17d1-0f0a-495e-9394-1907d42b10d4-config-data\") pod \"d93a17d1-0f0a-495e-9394-1907d42b10d4\" (UID: \"d93a17d1-0f0a-495e-9394-1907d42b10d4\") " Mar 16 17:44:25 crc kubenswrapper[5120]: I0316 17:44:25.534340 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jm2bz\" (UniqueName: \"kubernetes.io/projected/d93a17d1-0f0a-495e-9394-1907d42b10d4-kube-api-access-jm2bz\") pod \"d93a17d1-0f0a-495e-9394-1907d42b10d4\" (UID: \"d93a17d1-0f0a-495e-9394-1907d42b10d4\") " Mar 16 17:44:25 crc kubenswrapper[5120]: I0316 17:44:25.540158 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d93a17d1-0f0a-495e-9394-1907d42b10d4-kube-api-access-jm2bz" (OuterVolumeSpecName: "kube-api-access-jm2bz") pod "d93a17d1-0f0a-495e-9394-1907d42b10d4" (UID: "d93a17d1-0f0a-495e-9394-1907d42b10d4"). InnerVolumeSpecName "kube-api-access-jm2bz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:44:25 crc kubenswrapper[5120]: I0316 17:44:25.569513 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d93a17d1-0f0a-495e-9394-1907d42b10d4-config-data" (OuterVolumeSpecName: "config-data") pod "d93a17d1-0f0a-495e-9394-1907d42b10d4" (UID: "d93a17d1-0f0a-495e-9394-1907d42b10d4"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:44:25 crc kubenswrapper[5120]: I0316 17:44:25.647069 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d93a17d1-0f0a-495e-9394-1907d42b10d4-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:44:25 crc kubenswrapper[5120]: I0316 17:44:25.647113 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jm2bz\" (UniqueName: \"kubernetes.io/projected/d93a17d1-0f0a-495e-9394-1907d42b10d4-kube-api-access-jm2bz\") on node \"crc\" DevicePath \"\"" Mar 16 17:44:26 crc kubenswrapper[5120]: I0316 17:44:26.094838 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-db-sync-qkjpt" Mar 16 17:44:26 crc kubenswrapper[5120]: I0316 17:44:26.094860 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-db-sync-qkjpt" event={"ID":"d93a17d1-0f0a-495e-9394-1907d42b10d4","Type":"ContainerDied","Data":"4a7d09e695a921c34089eb68156b8cac66d647c20430b664f8a67b129e167db3"} Mar 16 17:44:26 crc kubenswrapper[5120]: I0316 17:44:26.094890 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4a7d09e695a921c34089eb68156b8cac66d647c20430b664f8a67b129e167db3" Mar 16 17:44:26 crc kubenswrapper[5120]: I0316 17:44:26.309470 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keystone-kuttl-tests/keystone-bootstrap-w7vqp"] Mar 16 17:44:26 crc kubenswrapper[5120]: I0316 17:44:26.310902 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1aa3d999-0b9d-4923-9635-5cd9dc9116ec" containerName="extract-content" Mar 16 17:44:26 crc kubenswrapper[5120]: I0316 17:44:26.310926 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1aa3d999-0b9d-4923-9635-5cd9dc9116ec" containerName="extract-content" Mar 16 17:44:26 crc kubenswrapper[5120]: I0316 17:44:26.310977 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1aa3d999-0b9d-4923-9635-5cd9dc9116ec" containerName="registry-server" Mar 16 17:44:26 crc kubenswrapper[5120]: I0316 17:44:26.310986 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1aa3d999-0b9d-4923-9635-5cd9dc9116ec" containerName="registry-server" Mar 16 17:44:26 crc kubenswrapper[5120]: I0316 17:44:26.311001 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1aa3d999-0b9d-4923-9635-5cd9dc9116ec" containerName="extract-utilities" Mar 16 17:44:26 crc kubenswrapper[5120]: I0316 17:44:26.311010 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1aa3d999-0b9d-4923-9635-5cd9dc9116ec" containerName="extract-utilities" Mar 16 17:44:26 crc kubenswrapper[5120]: I0316 17:44:26.311022 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d93a17d1-0f0a-495e-9394-1907d42b10d4" containerName="keystone-db-sync" Mar 16 17:44:26 crc kubenswrapper[5120]: I0316 17:44:26.311029 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="d93a17d1-0f0a-495e-9394-1907d42b10d4" containerName="keystone-db-sync" Mar 16 17:44:26 crc kubenswrapper[5120]: I0316 17:44:26.311226 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="d93a17d1-0f0a-495e-9394-1907d42b10d4" containerName="keystone-db-sync" Mar 16 17:44:26 crc kubenswrapper[5120]: I0316 17:44:26.311243 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1aa3d999-0b9d-4923-9635-5cd9dc9116ec" containerName="registry-server" Mar 16 17:44:26 crc kubenswrapper[5120]: I0316 17:44:26.316363 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone-bootstrap-w7vqp"] Mar 16 17:44:26 crc kubenswrapper[5120]: I0316 17:44:26.316515 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-bootstrap-w7vqp" Mar 16 17:44:26 crc kubenswrapper[5120]: I0316 17:44:26.320652 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keystone-kuttl-tests\"/\"keystone-keystone-dockercfg-p46q7\"" Mar 16 17:44:26 crc kubenswrapper[5120]: I0316 17:44:26.320680 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keystone-kuttl-tests\"/\"keystone-scripts\"" Mar 16 17:44:26 crc kubenswrapper[5120]: I0316 17:44:26.320885 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keystone-kuttl-tests\"/\"osp-secret\"" Mar 16 17:44:26 crc kubenswrapper[5120]: I0316 17:44:26.320931 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keystone-kuttl-tests\"/\"keystone-config-data\"" Mar 16 17:44:26 crc kubenswrapper[5120]: I0316 17:44:26.321140 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keystone-kuttl-tests\"/\"keystone\"" Mar 16 17:44:26 crc kubenswrapper[5120]: I0316 17:44:26.361489 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrq2r\" (UniqueName: \"kubernetes.io/projected/d6127fdf-ad95-4bef-9472-0aeb17e0b057-kube-api-access-vrq2r\") pod \"keystone-bootstrap-w7vqp\" (UID: \"d6127fdf-ad95-4bef-9472-0aeb17e0b057\") " pod="keystone-kuttl-tests/keystone-bootstrap-w7vqp" Mar 16 17:44:26 crc kubenswrapper[5120]: I0316 17:44:26.361617 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/d6127fdf-ad95-4bef-9472-0aeb17e0b057-credential-keys\") pod \"keystone-bootstrap-w7vqp\" (UID: \"d6127fdf-ad95-4bef-9472-0aeb17e0b057\") " pod="keystone-kuttl-tests/keystone-bootstrap-w7vqp" Mar 16 17:44:26 crc kubenswrapper[5120]: I0316 17:44:26.361731 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d6127fdf-ad95-4bef-9472-0aeb17e0b057-config-data\") pod \"keystone-bootstrap-w7vqp\" (UID: \"d6127fdf-ad95-4bef-9472-0aeb17e0b057\") " pod="keystone-kuttl-tests/keystone-bootstrap-w7vqp" Mar 16 17:44:26 crc kubenswrapper[5120]: I0316 17:44:26.361795 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d6127fdf-ad95-4bef-9472-0aeb17e0b057-scripts\") pod \"keystone-bootstrap-w7vqp\" (UID: \"d6127fdf-ad95-4bef-9472-0aeb17e0b057\") " pod="keystone-kuttl-tests/keystone-bootstrap-w7vqp" Mar 16 17:44:26 crc kubenswrapper[5120]: I0316 17:44:26.361869 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/d6127fdf-ad95-4bef-9472-0aeb17e0b057-fernet-keys\") pod \"keystone-bootstrap-w7vqp\" (UID: \"d6127fdf-ad95-4bef-9472-0aeb17e0b057\") " pod="keystone-kuttl-tests/keystone-bootstrap-w7vqp" Mar 16 17:44:26 crc kubenswrapper[5120]: I0316 17:44:26.464086 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d6127fdf-ad95-4bef-9472-0aeb17e0b057-config-data\") pod \"keystone-bootstrap-w7vqp\" (UID: \"d6127fdf-ad95-4bef-9472-0aeb17e0b057\") " pod="keystone-kuttl-tests/keystone-bootstrap-w7vqp" Mar 16 17:44:26 crc kubenswrapper[5120]: I0316 17:44:26.464213 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d6127fdf-ad95-4bef-9472-0aeb17e0b057-scripts\") pod \"keystone-bootstrap-w7vqp\" (UID: \"d6127fdf-ad95-4bef-9472-0aeb17e0b057\") " pod="keystone-kuttl-tests/keystone-bootstrap-w7vqp" Mar 16 17:44:26 crc kubenswrapper[5120]: I0316 17:44:26.464915 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/d6127fdf-ad95-4bef-9472-0aeb17e0b057-fernet-keys\") pod \"keystone-bootstrap-w7vqp\" (UID: \"d6127fdf-ad95-4bef-9472-0aeb17e0b057\") " pod="keystone-kuttl-tests/keystone-bootstrap-w7vqp" Mar 16 17:44:26 crc kubenswrapper[5120]: I0316 17:44:26.465135 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vrq2r\" (UniqueName: \"kubernetes.io/projected/d6127fdf-ad95-4bef-9472-0aeb17e0b057-kube-api-access-vrq2r\") pod \"keystone-bootstrap-w7vqp\" (UID: \"d6127fdf-ad95-4bef-9472-0aeb17e0b057\") " pod="keystone-kuttl-tests/keystone-bootstrap-w7vqp" Mar 16 17:44:26 crc kubenswrapper[5120]: I0316 17:44:26.465320 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/d6127fdf-ad95-4bef-9472-0aeb17e0b057-credential-keys\") pod \"keystone-bootstrap-w7vqp\" (UID: \"d6127fdf-ad95-4bef-9472-0aeb17e0b057\") " pod="keystone-kuttl-tests/keystone-bootstrap-w7vqp" Mar 16 17:44:26 crc kubenswrapper[5120]: I0316 17:44:26.468753 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d6127fdf-ad95-4bef-9472-0aeb17e0b057-scripts\") pod \"keystone-bootstrap-w7vqp\" (UID: \"d6127fdf-ad95-4bef-9472-0aeb17e0b057\") " pod="keystone-kuttl-tests/keystone-bootstrap-w7vqp" Mar 16 17:44:26 crc kubenswrapper[5120]: I0316 17:44:26.469114 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/d6127fdf-ad95-4bef-9472-0aeb17e0b057-fernet-keys\") pod \"keystone-bootstrap-w7vqp\" (UID: \"d6127fdf-ad95-4bef-9472-0aeb17e0b057\") " pod="keystone-kuttl-tests/keystone-bootstrap-w7vqp" Mar 16 17:44:26 crc kubenswrapper[5120]: I0316 17:44:26.469187 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d6127fdf-ad95-4bef-9472-0aeb17e0b057-config-data\") pod \"keystone-bootstrap-w7vqp\" (UID: \"d6127fdf-ad95-4bef-9472-0aeb17e0b057\") " pod="keystone-kuttl-tests/keystone-bootstrap-w7vqp" Mar 16 17:44:26 crc kubenswrapper[5120]: I0316 17:44:26.469926 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/d6127fdf-ad95-4bef-9472-0aeb17e0b057-credential-keys\") pod \"keystone-bootstrap-w7vqp\" (UID: \"d6127fdf-ad95-4bef-9472-0aeb17e0b057\") " pod="keystone-kuttl-tests/keystone-bootstrap-w7vqp" Mar 16 17:44:26 crc kubenswrapper[5120]: I0316 17:44:26.484417 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrq2r\" (UniqueName: \"kubernetes.io/projected/d6127fdf-ad95-4bef-9472-0aeb17e0b057-kube-api-access-vrq2r\") pod \"keystone-bootstrap-w7vqp\" (UID: \"d6127fdf-ad95-4bef-9472-0aeb17e0b057\") " pod="keystone-kuttl-tests/keystone-bootstrap-w7vqp" Mar 16 17:44:26 crc kubenswrapper[5120]: I0316 17:44:26.637035 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-bootstrap-w7vqp" Mar 16 17:44:27 crc kubenswrapper[5120]: I0316 17:44:27.075869 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone-bootstrap-w7vqp"] Mar 16 17:44:27 crc kubenswrapper[5120]: W0316 17:44:27.076486 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd6127fdf_ad95_4bef_9472_0aeb17e0b057.slice/crio-e4d66dce83ab2072b8fb6740c8473f509c8a725728c00f02f4aba047dc43ca5b WatchSource:0}: Error finding container e4d66dce83ab2072b8fb6740c8473f509c8a725728c00f02f4aba047dc43ca5b: Status 404 returned error can't find the container with id e4d66dce83ab2072b8fb6740c8473f509c8a725728c00f02f4aba047dc43ca5b Mar 16 17:44:27 crc kubenswrapper[5120]: I0316 17:44:27.105147 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-bootstrap-w7vqp" event={"ID":"d6127fdf-ad95-4bef-9472-0aeb17e0b057","Type":"ContainerStarted","Data":"e4d66dce83ab2072b8fb6740c8473f509c8a725728c00f02f4aba047dc43ca5b"} Mar 16 17:44:28 crc kubenswrapper[5120]: I0316 17:44:28.116438 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-bootstrap-w7vqp" event={"ID":"d6127fdf-ad95-4bef-9472-0aeb17e0b057","Type":"ContainerStarted","Data":"cff6ecc750eb2b71ccdb2bb2c6dedc48e5b68bc745dcc610d239228647406852"} Mar 16 17:44:28 crc kubenswrapper[5120]: I0316 17:44:28.140251 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keystone-kuttl-tests/keystone-bootstrap-w7vqp" podStartSLOduration=2.140229223 podStartE2EDuration="2.140229223s" podCreationTimestamp="2026-03-16 17:44:26 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:44:28.135067553 +0000 UTC m=+7970.288999220" watchObservedRunningTime="2026-03-16 17:44:28.140229223 +0000 UTC m=+7970.294160890" Mar 16 17:44:30 crc kubenswrapper[5120]: I0316 17:44:30.133952 5120 generic.go:358] "Generic (PLEG): container finished" podID="d6127fdf-ad95-4bef-9472-0aeb17e0b057" containerID="cff6ecc750eb2b71ccdb2bb2c6dedc48e5b68bc745dcc610d239228647406852" exitCode=0 Mar 16 17:44:30 crc kubenswrapper[5120]: I0316 17:44:30.134062 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-bootstrap-w7vqp" event={"ID":"d6127fdf-ad95-4bef-9472-0aeb17e0b057","Type":"ContainerDied","Data":"cff6ecc750eb2b71ccdb2bb2c6dedc48e5b68bc745dcc610d239228647406852"} Mar 16 17:44:31 crc kubenswrapper[5120]: I0316 17:44:31.425907 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-bootstrap-w7vqp" Mar 16 17:44:31 crc kubenswrapper[5120]: I0316 17:44:31.600174 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d6127fdf-ad95-4bef-9472-0aeb17e0b057-scripts\") pod \"d6127fdf-ad95-4bef-9472-0aeb17e0b057\" (UID: \"d6127fdf-ad95-4bef-9472-0aeb17e0b057\") " Mar 16 17:44:31 crc kubenswrapper[5120]: I0316 17:44:31.600294 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/d6127fdf-ad95-4bef-9472-0aeb17e0b057-credential-keys\") pod \"d6127fdf-ad95-4bef-9472-0aeb17e0b057\" (UID: \"d6127fdf-ad95-4bef-9472-0aeb17e0b057\") " Mar 16 17:44:31 crc kubenswrapper[5120]: I0316 17:44:31.600445 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/d6127fdf-ad95-4bef-9472-0aeb17e0b057-fernet-keys\") pod \"d6127fdf-ad95-4bef-9472-0aeb17e0b057\" (UID: \"d6127fdf-ad95-4bef-9472-0aeb17e0b057\") " Mar 16 17:44:31 crc kubenswrapper[5120]: I0316 17:44:31.600844 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vrq2r\" (UniqueName: \"kubernetes.io/projected/d6127fdf-ad95-4bef-9472-0aeb17e0b057-kube-api-access-vrq2r\") pod \"d6127fdf-ad95-4bef-9472-0aeb17e0b057\" (UID: \"d6127fdf-ad95-4bef-9472-0aeb17e0b057\") " Mar 16 17:44:31 crc kubenswrapper[5120]: I0316 17:44:31.601014 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d6127fdf-ad95-4bef-9472-0aeb17e0b057-config-data\") pod \"d6127fdf-ad95-4bef-9472-0aeb17e0b057\" (UID: \"d6127fdf-ad95-4bef-9472-0aeb17e0b057\") " Mar 16 17:44:31 crc kubenswrapper[5120]: I0316 17:44:31.606432 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6127fdf-ad95-4bef-9472-0aeb17e0b057-kube-api-access-vrq2r" (OuterVolumeSpecName: "kube-api-access-vrq2r") pod "d6127fdf-ad95-4bef-9472-0aeb17e0b057" (UID: "d6127fdf-ad95-4bef-9472-0aeb17e0b057"). InnerVolumeSpecName "kube-api-access-vrq2r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:44:31 crc kubenswrapper[5120]: I0316 17:44:31.606647 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6127fdf-ad95-4bef-9472-0aeb17e0b057-scripts" (OuterVolumeSpecName: "scripts") pod "d6127fdf-ad95-4bef-9472-0aeb17e0b057" (UID: "d6127fdf-ad95-4bef-9472-0aeb17e0b057"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:44:31 crc kubenswrapper[5120]: I0316 17:44:31.606721 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6127fdf-ad95-4bef-9472-0aeb17e0b057-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "d6127fdf-ad95-4bef-9472-0aeb17e0b057" (UID: "d6127fdf-ad95-4bef-9472-0aeb17e0b057"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:44:31 crc kubenswrapper[5120]: I0316 17:44:31.607957 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6127fdf-ad95-4bef-9472-0aeb17e0b057-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "d6127fdf-ad95-4bef-9472-0aeb17e0b057" (UID: "d6127fdf-ad95-4bef-9472-0aeb17e0b057"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:44:31 crc kubenswrapper[5120]: I0316 17:44:31.625438 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6127fdf-ad95-4bef-9472-0aeb17e0b057-config-data" (OuterVolumeSpecName: "config-data") pod "d6127fdf-ad95-4bef-9472-0aeb17e0b057" (UID: "d6127fdf-ad95-4bef-9472-0aeb17e0b057"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:44:31 crc kubenswrapper[5120]: I0316 17:44:31.703700 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vrq2r\" (UniqueName: \"kubernetes.io/projected/d6127fdf-ad95-4bef-9472-0aeb17e0b057-kube-api-access-vrq2r\") on node \"crc\" DevicePath \"\"" Mar 16 17:44:31 crc kubenswrapper[5120]: I0316 17:44:31.703747 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d6127fdf-ad95-4bef-9472-0aeb17e0b057-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:44:31 crc kubenswrapper[5120]: I0316 17:44:31.703774 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d6127fdf-ad95-4bef-9472-0aeb17e0b057-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:44:31 crc kubenswrapper[5120]: I0316 17:44:31.703786 5120 reconciler_common.go:299] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/d6127fdf-ad95-4bef-9472-0aeb17e0b057-credential-keys\") on node \"crc\" DevicePath \"\"" Mar 16 17:44:31 crc kubenswrapper[5120]: I0316 17:44:31.703796 5120 reconciler_common.go:299] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/d6127fdf-ad95-4bef-9472-0aeb17e0b057-fernet-keys\") on node \"crc\" DevicePath \"\"" Mar 16 17:44:32 crc kubenswrapper[5120]: I0316 17:44:32.151419 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-bootstrap-w7vqp" Mar 16 17:44:32 crc kubenswrapper[5120]: I0316 17:44:32.151426 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-bootstrap-w7vqp" event={"ID":"d6127fdf-ad95-4bef-9472-0aeb17e0b057","Type":"ContainerDied","Data":"e4d66dce83ab2072b8fb6740c8473f509c8a725728c00f02f4aba047dc43ca5b"} Mar 16 17:44:32 crc kubenswrapper[5120]: I0316 17:44:32.151556 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e4d66dce83ab2072b8fb6740c8473f509c8a725728c00f02f4aba047dc43ca5b" Mar 16 17:44:32 crc kubenswrapper[5120]: I0316 17:44:32.241834 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keystone-kuttl-tests/keystone-57dcdffc79-fqh6r"] Mar 16 17:44:32 crc kubenswrapper[5120]: I0316 17:44:32.242673 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6127fdf-ad95-4bef-9472-0aeb17e0b057" containerName="keystone-bootstrap" Mar 16 17:44:32 crc kubenswrapper[5120]: I0316 17:44:32.242695 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6127fdf-ad95-4bef-9472-0aeb17e0b057" containerName="keystone-bootstrap" Mar 16 17:44:32 crc kubenswrapper[5120]: I0316 17:44:32.242884 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="d6127fdf-ad95-4bef-9472-0aeb17e0b057" containerName="keystone-bootstrap" Mar 16 17:44:32 crc kubenswrapper[5120]: I0316 17:44:32.251116 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-57dcdffc79-fqh6r" Mar 16 17:44:32 crc kubenswrapper[5120]: I0316 17:44:32.254905 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone-57dcdffc79-fqh6r"] Mar 16 17:44:32 crc kubenswrapper[5120]: I0316 17:44:32.257465 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keystone-kuttl-tests\"/\"keystone-scripts\"" Mar 16 17:44:32 crc kubenswrapper[5120]: I0316 17:44:32.258010 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keystone-kuttl-tests\"/\"keystone\"" Mar 16 17:44:32 crc kubenswrapper[5120]: I0316 17:44:32.258194 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keystone-kuttl-tests\"/\"keystone-config-data\"" Mar 16 17:44:32 crc kubenswrapper[5120]: I0316 17:44:32.258364 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keystone-kuttl-tests\"/\"keystone-keystone-dockercfg-p46q7\"" Mar 16 17:44:32 crc kubenswrapper[5120]: I0316 17:44:32.318884 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8a3178db-a9d3-48a0-8913-5beed00d35b6-config-data\") pod \"keystone-57dcdffc79-fqh6r\" (UID: \"8a3178db-a9d3-48a0-8913-5beed00d35b6\") " pod="keystone-kuttl-tests/keystone-57dcdffc79-fqh6r" Mar 16 17:44:32 crc kubenswrapper[5120]: I0316 17:44:32.318960 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4f9vg\" (UniqueName: \"kubernetes.io/projected/8a3178db-a9d3-48a0-8913-5beed00d35b6-kube-api-access-4f9vg\") pod \"keystone-57dcdffc79-fqh6r\" (UID: \"8a3178db-a9d3-48a0-8913-5beed00d35b6\") " pod="keystone-kuttl-tests/keystone-57dcdffc79-fqh6r" Mar 16 17:44:32 crc kubenswrapper[5120]: I0316 17:44:32.319091 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8a3178db-a9d3-48a0-8913-5beed00d35b6-scripts\") pod \"keystone-57dcdffc79-fqh6r\" (UID: \"8a3178db-a9d3-48a0-8913-5beed00d35b6\") " pod="keystone-kuttl-tests/keystone-57dcdffc79-fqh6r" Mar 16 17:44:32 crc kubenswrapper[5120]: I0316 17:44:32.319289 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/8a3178db-a9d3-48a0-8913-5beed00d35b6-credential-keys\") pod \"keystone-57dcdffc79-fqh6r\" (UID: \"8a3178db-a9d3-48a0-8913-5beed00d35b6\") " pod="keystone-kuttl-tests/keystone-57dcdffc79-fqh6r" Mar 16 17:44:32 crc kubenswrapper[5120]: I0316 17:44:32.319609 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/8a3178db-a9d3-48a0-8913-5beed00d35b6-fernet-keys\") pod \"keystone-57dcdffc79-fqh6r\" (UID: \"8a3178db-a9d3-48a0-8913-5beed00d35b6\") " pod="keystone-kuttl-tests/keystone-57dcdffc79-fqh6r" Mar 16 17:44:32 crc kubenswrapper[5120]: I0316 17:44:32.420937 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/8a3178db-a9d3-48a0-8913-5beed00d35b6-fernet-keys\") pod \"keystone-57dcdffc79-fqh6r\" (UID: \"8a3178db-a9d3-48a0-8913-5beed00d35b6\") " pod="keystone-kuttl-tests/keystone-57dcdffc79-fqh6r" Mar 16 17:44:32 crc kubenswrapper[5120]: I0316 17:44:32.421093 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8a3178db-a9d3-48a0-8913-5beed00d35b6-config-data\") pod \"keystone-57dcdffc79-fqh6r\" (UID: \"8a3178db-a9d3-48a0-8913-5beed00d35b6\") " pod="keystone-kuttl-tests/keystone-57dcdffc79-fqh6r" Mar 16 17:44:32 crc kubenswrapper[5120]: I0316 17:44:32.421152 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4f9vg\" (UniqueName: \"kubernetes.io/projected/8a3178db-a9d3-48a0-8913-5beed00d35b6-kube-api-access-4f9vg\") pod \"keystone-57dcdffc79-fqh6r\" (UID: \"8a3178db-a9d3-48a0-8913-5beed00d35b6\") " pod="keystone-kuttl-tests/keystone-57dcdffc79-fqh6r" Mar 16 17:44:32 crc kubenswrapper[5120]: I0316 17:44:32.421190 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8a3178db-a9d3-48a0-8913-5beed00d35b6-scripts\") pod \"keystone-57dcdffc79-fqh6r\" (UID: \"8a3178db-a9d3-48a0-8913-5beed00d35b6\") " pod="keystone-kuttl-tests/keystone-57dcdffc79-fqh6r" Mar 16 17:44:32 crc kubenswrapper[5120]: I0316 17:44:32.421243 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/8a3178db-a9d3-48a0-8913-5beed00d35b6-credential-keys\") pod \"keystone-57dcdffc79-fqh6r\" (UID: \"8a3178db-a9d3-48a0-8913-5beed00d35b6\") " pod="keystone-kuttl-tests/keystone-57dcdffc79-fqh6r" Mar 16 17:44:32 crc kubenswrapper[5120]: I0316 17:44:32.426410 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8a3178db-a9d3-48a0-8913-5beed00d35b6-scripts\") pod \"keystone-57dcdffc79-fqh6r\" (UID: \"8a3178db-a9d3-48a0-8913-5beed00d35b6\") " pod="keystone-kuttl-tests/keystone-57dcdffc79-fqh6r" Mar 16 17:44:32 crc kubenswrapper[5120]: I0316 17:44:32.426510 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/8a3178db-a9d3-48a0-8913-5beed00d35b6-fernet-keys\") pod \"keystone-57dcdffc79-fqh6r\" (UID: \"8a3178db-a9d3-48a0-8913-5beed00d35b6\") " pod="keystone-kuttl-tests/keystone-57dcdffc79-fqh6r" Mar 16 17:44:32 crc kubenswrapper[5120]: I0316 17:44:32.426542 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8a3178db-a9d3-48a0-8913-5beed00d35b6-config-data\") pod \"keystone-57dcdffc79-fqh6r\" (UID: \"8a3178db-a9d3-48a0-8913-5beed00d35b6\") " pod="keystone-kuttl-tests/keystone-57dcdffc79-fqh6r" Mar 16 17:44:32 crc kubenswrapper[5120]: I0316 17:44:32.434229 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/8a3178db-a9d3-48a0-8913-5beed00d35b6-credential-keys\") pod \"keystone-57dcdffc79-fqh6r\" (UID: \"8a3178db-a9d3-48a0-8913-5beed00d35b6\") " pod="keystone-kuttl-tests/keystone-57dcdffc79-fqh6r" Mar 16 17:44:32 crc kubenswrapper[5120]: I0316 17:44:32.438286 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4f9vg\" (UniqueName: \"kubernetes.io/projected/8a3178db-a9d3-48a0-8913-5beed00d35b6-kube-api-access-4f9vg\") pod \"keystone-57dcdffc79-fqh6r\" (UID: \"8a3178db-a9d3-48a0-8913-5beed00d35b6\") " pod="keystone-kuttl-tests/keystone-57dcdffc79-fqh6r" Mar 16 17:44:32 crc kubenswrapper[5120]: I0316 17:44:32.578173 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-57dcdffc79-fqh6r" Mar 16 17:44:32 crc kubenswrapper[5120]: I0316 17:44:32.996239 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone-57dcdffc79-fqh6r"] Mar 16 17:44:33 crc kubenswrapper[5120]: W0316 17:44:33.003483 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a3178db_a9d3_48a0_8913_5beed00d35b6.slice/crio-f89ee41a0674158b62553e4120751b25ce58e20d2f62976edace5f71a53bd915 WatchSource:0}: Error finding container f89ee41a0674158b62553e4120751b25ce58e20d2f62976edace5f71a53bd915: Status 404 returned error can't find the container with id f89ee41a0674158b62553e4120751b25ce58e20d2f62976edace5f71a53bd915 Mar 16 17:44:33 crc kubenswrapper[5120]: I0316 17:44:33.161949 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-57dcdffc79-fqh6r" event={"ID":"8a3178db-a9d3-48a0-8913-5beed00d35b6","Type":"ContainerStarted","Data":"c6306f687193ca22e8804a06146d9e5524ec07c55b271002c119a06cfb168ac1"} Mar 16 17:44:33 crc kubenswrapper[5120]: I0316 17:44:33.161994 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-57dcdffc79-fqh6r" event={"ID":"8a3178db-a9d3-48a0-8913-5beed00d35b6","Type":"ContainerStarted","Data":"f89ee41a0674158b62553e4120751b25ce58e20d2f62976edace5f71a53bd915"} Mar 16 17:44:33 crc kubenswrapper[5120]: I0316 17:44:33.162042 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keystone-kuttl-tests/keystone-57dcdffc79-fqh6r" Mar 16 17:44:33 crc kubenswrapper[5120]: I0316 17:44:33.179749 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keystone-kuttl-tests/keystone-57dcdffc79-fqh6r" podStartSLOduration=1.179731178 podStartE2EDuration="1.179731178s" podCreationTimestamp="2026-03-16 17:44:32 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:44:33.177374413 +0000 UTC m=+7975.331306080" watchObservedRunningTime="2026-03-16 17:44:33.179731178 +0000 UTC m=+7975.333662845" Mar 16 17:44:34 crc kubenswrapper[5120]: I0316 17:44:34.377039 5120 scope.go:117] "RemoveContainer" containerID="9148ca1baa15e660bae995267713eaf07ccc2c4e1fa6119d54edee935208c202" Mar 16 17:44:34 crc kubenswrapper[5120]: I0316 17:44:34.412629 5120 scope.go:117] "RemoveContainer" containerID="57a80fb2a05275b8a881ec7419bb5969095d7ba5e66572e22e40f6857d3a9f1d" Mar 16 17:44:34 crc kubenswrapper[5120]: I0316 17:44:34.454920 5120 scope.go:117] "RemoveContainer" containerID="63d2058748252d3d85e082a70ce854971014cc990bacbc54d10686d0eff6c49b" Mar 16 17:44:34 crc kubenswrapper[5120]: I0316 17:44:34.500981 5120 scope.go:117] "RemoveContainer" containerID="1e88114544c951283e018f47b4cd3488e56d7b8c09c08bdf747ad680dec09503" Mar 16 17:44:34 crc kubenswrapper[5120]: I0316 17:44:34.590243 5120 scope.go:117] "RemoveContainer" containerID="fc497a17ac10e39421c2bc03f7c8ca85fd61b566de9cff4b4d751ddd6e548ea1" Mar 16 17:44:34 crc kubenswrapper[5120]: I0316 17:44:34.622152 5120 scope.go:117] "RemoveContainer" containerID="6b559a8164b92dd062250a013dfaf60deb04ddf8ef92bd45375231da79a4c85d" Mar 16 17:44:34 crc kubenswrapper[5120]: I0316 17:44:34.655824 5120 scope.go:117] "RemoveContainer" containerID="f7d1760a10fd60339cbedbe3b1bf71ec24232b13dbf1d4c8109dd0508c23d506" Mar 16 17:44:34 crc kubenswrapper[5120]: I0316 17:44:34.674733 5120 scope.go:117] "RemoveContainer" containerID="8933f4c1a2a183f2b54d26c651bc7e2667921bf070ffe8d20bcaaf3e01d81aeb" Mar 16 17:44:36 crc kubenswrapper[5120]: I0316 17:44:36.664196 5120 scope.go:117] "RemoveContainer" containerID="7fd764dd19065c7ce437c63b05fda51970409dfa8dfd1c77e2158bb3e05b7723" Mar 16 17:44:36 crc kubenswrapper[5120]: E0316 17:44:36.664657 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 17:44:49 crc kubenswrapper[5120]: I0316 17:44:49.663733 5120 scope.go:117] "RemoveContainer" containerID="7fd764dd19065c7ce437c63b05fda51970409dfa8dfd1c77e2158bb3e05b7723" Mar 16 17:44:49 crc kubenswrapper[5120]: E0316 17:44:49.664475 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 17:45:00 crc kubenswrapper[5120]: I0316 17:45:00.143199 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29561385-cwvnc"] Mar 16 17:45:00 crc kubenswrapper[5120]: I0316 17:45:00.151225 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29561385-cwvnc"] Mar 16 17:45:00 crc kubenswrapper[5120]: I0316 17:45:00.151361 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29561385-cwvnc" Mar 16 17:45:00 crc kubenswrapper[5120]: I0316 17:45:00.154188 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operator-lifecycle-manager\"/\"collect-profiles-config\"" Mar 16 17:45:00 crc kubenswrapper[5120]: I0316 17:45:00.154422 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operator-lifecycle-manager\"/\"collect-profiles-dockercfg-vfqp6\"" Mar 16 17:45:00 crc kubenswrapper[5120]: I0316 17:45:00.271177 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwlw4\" (UniqueName: \"kubernetes.io/projected/465ff327-4915-485a-aa97-ae2f8da4a17b-kube-api-access-jwlw4\") pod \"collect-profiles-29561385-cwvnc\" (UID: \"465ff327-4915-485a-aa97-ae2f8da4a17b\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561385-cwvnc" Mar 16 17:45:00 crc kubenswrapper[5120]: I0316 17:45:00.271269 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/465ff327-4915-485a-aa97-ae2f8da4a17b-secret-volume\") pod \"collect-profiles-29561385-cwvnc\" (UID: \"465ff327-4915-485a-aa97-ae2f8da4a17b\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561385-cwvnc" Mar 16 17:45:00 crc kubenswrapper[5120]: I0316 17:45:00.271386 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/465ff327-4915-485a-aa97-ae2f8da4a17b-config-volume\") pod \"collect-profiles-29561385-cwvnc\" (UID: \"465ff327-4915-485a-aa97-ae2f8da4a17b\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561385-cwvnc" Mar 16 17:45:00 crc kubenswrapper[5120]: I0316 17:45:00.372918 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jwlw4\" (UniqueName: \"kubernetes.io/projected/465ff327-4915-485a-aa97-ae2f8da4a17b-kube-api-access-jwlw4\") pod \"collect-profiles-29561385-cwvnc\" (UID: \"465ff327-4915-485a-aa97-ae2f8da4a17b\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561385-cwvnc" Mar 16 17:45:00 crc kubenswrapper[5120]: I0316 17:45:00.373050 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/465ff327-4915-485a-aa97-ae2f8da4a17b-secret-volume\") pod \"collect-profiles-29561385-cwvnc\" (UID: \"465ff327-4915-485a-aa97-ae2f8da4a17b\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561385-cwvnc" Mar 16 17:45:00 crc kubenswrapper[5120]: I0316 17:45:00.373120 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/465ff327-4915-485a-aa97-ae2f8da4a17b-config-volume\") pod \"collect-profiles-29561385-cwvnc\" (UID: \"465ff327-4915-485a-aa97-ae2f8da4a17b\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561385-cwvnc" Mar 16 17:45:00 crc kubenswrapper[5120]: I0316 17:45:00.374075 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/465ff327-4915-485a-aa97-ae2f8da4a17b-config-volume\") pod \"collect-profiles-29561385-cwvnc\" (UID: \"465ff327-4915-485a-aa97-ae2f8da4a17b\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561385-cwvnc" Mar 16 17:45:00 crc kubenswrapper[5120]: I0316 17:45:00.379614 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/465ff327-4915-485a-aa97-ae2f8da4a17b-secret-volume\") pod \"collect-profiles-29561385-cwvnc\" (UID: \"465ff327-4915-485a-aa97-ae2f8da4a17b\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561385-cwvnc" Mar 16 17:45:00 crc kubenswrapper[5120]: I0316 17:45:00.392628 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwlw4\" (UniqueName: \"kubernetes.io/projected/465ff327-4915-485a-aa97-ae2f8da4a17b-kube-api-access-jwlw4\") pod \"collect-profiles-29561385-cwvnc\" (UID: \"465ff327-4915-485a-aa97-ae2f8da4a17b\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561385-cwvnc" Mar 16 17:45:00 crc kubenswrapper[5120]: I0316 17:45:00.472607 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29561385-cwvnc" Mar 16 17:45:00 crc kubenswrapper[5120]: I0316 17:45:00.908581 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29561385-cwvnc"] Mar 16 17:45:01 crc kubenswrapper[5120]: I0316 17:45:01.415661 5120 generic.go:358] "Generic (PLEG): container finished" podID="465ff327-4915-485a-aa97-ae2f8da4a17b" containerID="6eff8aff7407cde3bdb997699a4a0a33d68fda200a38b2b1925f33848780893b" exitCode=0 Mar 16 17:45:01 crc kubenswrapper[5120]: I0316 17:45:01.415711 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/collect-profiles-29561385-cwvnc" event={"ID":"465ff327-4915-485a-aa97-ae2f8da4a17b","Type":"ContainerDied","Data":"6eff8aff7407cde3bdb997699a4a0a33d68fda200a38b2b1925f33848780893b"} Mar 16 17:45:01 crc kubenswrapper[5120]: I0316 17:45:01.415775 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/collect-profiles-29561385-cwvnc" event={"ID":"465ff327-4915-485a-aa97-ae2f8da4a17b","Type":"ContainerStarted","Data":"59b6ac12e2b70aed0da7d94ecc67815fb16472018cbd0e1b34cdc5216fda5726"} Mar 16 17:45:02 crc kubenswrapper[5120]: I0316 17:45:02.666882 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29561385-cwvnc" Mar 16 17:45:02 crc kubenswrapper[5120]: I0316 17:45:02.828739 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/465ff327-4915-485a-aa97-ae2f8da4a17b-config-volume" (OuterVolumeSpecName: "config-volume") pod "465ff327-4915-485a-aa97-ae2f8da4a17b" (UID: "465ff327-4915-485a-aa97-ae2f8da4a17b"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:45:02 crc kubenswrapper[5120]: I0316 17:45:02.828832 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/465ff327-4915-485a-aa97-ae2f8da4a17b-config-volume\") pod \"465ff327-4915-485a-aa97-ae2f8da4a17b\" (UID: \"465ff327-4915-485a-aa97-ae2f8da4a17b\") " Mar 16 17:45:02 crc kubenswrapper[5120]: I0316 17:45:02.828985 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/465ff327-4915-485a-aa97-ae2f8da4a17b-secret-volume\") pod \"465ff327-4915-485a-aa97-ae2f8da4a17b\" (UID: \"465ff327-4915-485a-aa97-ae2f8da4a17b\") " Mar 16 17:45:02 crc kubenswrapper[5120]: I0316 17:45:02.830330 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jwlw4\" (UniqueName: \"kubernetes.io/projected/465ff327-4915-485a-aa97-ae2f8da4a17b-kube-api-access-jwlw4\") pod \"465ff327-4915-485a-aa97-ae2f8da4a17b\" (UID: \"465ff327-4915-485a-aa97-ae2f8da4a17b\") " Mar 16 17:45:02 crc kubenswrapper[5120]: I0316 17:45:02.831579 5120 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/465ff327-4915-485a-aa97-ae2f8da4a17b-config-volume\") on node \"crc\" DevicePath \"\"" Mar 16 17:45:02 crc kubenswrapper[5120]: I0316 17:45:02.835427 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/465ff327-4915-485a-aa97-ae2f8da4a17b-kube-api-access-jwlw4" (OuterVolumeSpecName: "kube-api-access-jwlw4") pod "465ff327-4915-485a-aa97-ae2f8da4a17b" (UID: "465ff327-4915-485a-aa97-ae2f8da4a17b"). InnerVolumeSpecName "kube-api-access-jwlw4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:45:02 crc kubenswrapper[5120]: I0316 17:45:02.848487 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/465ff327-4915-485a-aa97-ae2f8da4a17b-secret-volume" (OuterVolumeSpecName: "secret-volume") pod "465ff327-4915-485a-aa97-ae2f8da4a17b" (UID: "465ff327-4915-485a-aa97-ae2f8da4a17b"). InnerVolumeSpecName "secret-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:45:02 crc kubenswrapper[5120]: I0316 17:45:02.933508 5120 reconciler_common.go:299] "Volume detached for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/465ff327-4915-485a-aa97-ae2f8da4a17b-secret-volume\") on node \"crc\" DevicePath \"\"" Mar 16 17:45:02 crc kubenswrapper[5120]: I0316 17:45:02.933544 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jwlw4\" (UniqueName: \"kubernetes.io/projected/465ff327-4915-485a-aa97-ae2f8da4a17b-kube-api-access-jwlw4\") on node \"crc\" DevicePath \"\"" Mar 16 17:45:03 crc kubenswrapper[5120]: I0316 17:45:03.433999 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29561385-cwvnc" Mar 16 17:45:03 crc kubenswrapper[5120]: I0316 17:45:03.434006 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/collect-profiles-29561385-cwvnc" event={"ID":"465ff327-4915-485a-aa97-ae2f8da4a17b","Type":"ContainerDied","Data":"59b6ac12e2b70aed0da7d94ecc67815fb16472018cbd0e1b34cdc5216fda5726"} Mar 16 17:45:03 crc kubenswrapper[5120]: I0316 17:45:03.434420 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="59b6ac12e2b70aed0da7d94ecc67815fb16472018cbd0e1b34cdc5216fda5726" Mar 16 17:45:03 crc kubenswrapper[5120]: I0316 17:45:03.664269 5120 scope.go:117] "RemoveContainer" containerID="7fd764dd19065c7ce437c63b05fda51970409dfa8dfd1c77e2158bb3e05b7723" Mar 16 17:45:03 crc kubenswrapper[5120]: E0316 17:45:03.664548 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 17:45:03 crc kubenswrapper[5120]: I0316 17:45:03.732341 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29561340-pfsc2"] Mar 16 17:45:03 crc kubenswrapper[5120]: I0316 17:45:03.738354 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29561340-pfsc2"] Mar 16 17:45:04 crc kubenswrapper[5120]: I0316 17:45:04.691852 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="11e62c55-441b-466b-b13f-dd20b1647590" path="/var/lib/kubelet/pods/11e62c55-441b-466b-b13f-dd20b1647590/volumes" Mar 16 17:45:05 crc kubenswrapper[5120]: I0316 17:45:05.593245 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="keystone-kuttl-tests/keystone-57dcdffc79-fqh6r" Mar 16 17:45:07 crc kubenswrapper[5120]: E0316 17:45:07.111907 5120 log.go:32] "Failed when writing line to log file" err="http2: stream closed" path="/var/log/pods/keystone-kuttl-tests_keystone-57dcdffc79-fqh6r_8a3178db-a9d3-48a0-8913-5beed00d35b6/keystone-api/0.log" line={} Mar 16 17:45:07 crc kubenswrapper[5120]: E0316 17:45:07.423992 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1109859 actualBytes=10240 Mar 16 17:45:07 crc kubenswrapper[5120]: I0316 17:45:07.468948 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keystone-kuttl-tests/keystone-6b5587fc45-xvs8g"] Mar 16 17:45:07 crc kubenswrapper[5120]: I0316 17:45:07.469805 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="465ff327-4915-485a-aa97-ae2f8da4a17b" containerName="collect-profiles" Mar 16 17:45:07 crc kubenswrapper[5120]: I0316 17:45:07.469824 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="465ff327-4915-485a-aa97-ae2f8da4a17b" containerName="collect-profiles" Mar 16 17:45:07 crc kubenswrapper[5120]: I0316 17:45:07.469992 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="465ff327-4915-485a-aa97-ae2f8da4a17b" containerName="collect-profiles" Mar 16 17:45:07 crc kubenswrapper[5120]: I0316 17:45:07.477260 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone-6b5587fc45-xvs8g"] Mar 16 17:45:07 crc kubenswrapper[5120]: I0316 17:45:07.477377 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-6b5587fc45-xvs8g" Mar 16 17:45:07 crc kubenswrapper[5120]: I0316 17:45:07.550920 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/543c3089-391b-47ed-85a6-8a0bdfce3811-config-data\") pod \"keystone-6b5587fc45-xvs8g\" (UID: \"543c3089-391b-47ed-85a6-8a0bdfce3811\") " pod="keystone-kuttl-tests/keystone-6b5587fc45-xvs8g" Mar 16 17:45:07 crc kubenswrapper[5120]: I0316 17:45:07.550985 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/543c3089-391b-47ed-85a6-8a0bdfce3811-fernet-keys\") pod \"keystone-6b5587fc45-xvs8g\" (UID: \"543c3089-391b-47ed-85a6-8a0bdfce3811\") " pod="keystone-kuttl-tests/keystone-6b5587fc45-xvs8g" Mar 16 17:45:07 crc kubenswrapper[5120]: I0316 17:45:07.551279 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/543c3089-391b-47ed-85a6-8a0bdfce3811-credential-keys\") pod \"keystone-6b5587fc45-xvs8g\" (UID: \"543c3089-391b-47ed-85a6-8a0bdfce3811\") " pod="keystone-kuttl-tests/keystone-6b5587fc45-xvs8g" Mar 16 17:45:07 crc kubenswrapper[5120]: I0316 17:45:07.551544 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghq6x\" (UniqueName: \"kubernetes.io/projected/543c3089-391b-47ed-85a6-8a0bdfce3811-kube-api-access-ghq6x\") pod \"keystone-6b5587fc45-xvs8g\" (UID: \"543c3089-391b-47ed-85a6-8a0bdfce3811\") " pod="keystone-kuttl-tests/keystone-6b5587fc45-xvs8g" Mar 16 17:45:07 crc kubenswrapper[5120]: I0316 17:45:07.551872 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/543c3089-391b-47ed-85a6-8a0bdfce3811-scripts\") pod \"keystone-6b5587fc45-xvs8g\" (UID: \"543c3089-391b-47ed-85a6-8a0bdfce3811\") " pod="keystone-kuttl-tests/keystone-6b5587fc45-xvs8g" Mar 16 17:45:07 crc kubenswrapper[5120]: I0316 17:45:07.654268 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/543c3089-391b-47ed-85a6-8a0bdfce3811-scripts\") pod \"keystone-6b5587fc45-xvs8g\" (UID: \"543c3089-391b-47ed-85a6-8a0bdfce3811\") " pod="keystone-kuttl-tests/keystone-6b5587fc45-xvs8g" Mar 16 17:45:07 crc kubenswrapper[5120]: I0316 17:45:07.654417 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/543c3089-391b-47ed-85a6-8a0bdfce3811-config-data\") pod \"keystone-6b5587fc45-xvs8g\" (UID: \"543c3089-391b-47ed-85a6-8a0bdfce3811\") " pod="keystone-kuttl-tests/keystone-6b5587fc45-xvs8g" Mar 16 17:45:07 crc kubenswrapper[5120]: I0316 17:45:07.654463 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/543c3089-391b-47ed-85a6-8a0bdfce3811-fernet-keys\") pod \"keystone-6b5587fc45-xvs8g\" (UID: \"543c3089-391b-47ed-85a6-8a0bdfce3811\") " pod="keystone-kuttl-tests/keystone-6b5587fc45-xvs8g" Mar 16 17:45:07 crc kubenswrapper[5120]: I0316 17:45:07.654600 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/543c3089-391b-47ed-85a6-8a0bdfce3811-credential-keys\") pod \"keystone-6b5587fc45-xvs8g\" (UID: \"543c3089-391b-47ed-85a6-8a0bdfce3811\") " pod="keystone-kuttl-tests/keystone-6b5587fc45-xvs8g" Mar 16 17:45:07 crc kubenswrapper[5120]: I0316 17:45:07.654932 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ghq6x\" (UniqueName: \"kubernetes.io/projected/543c3089-391b-47ed-85a6-8a0bdfce3811-kube-api-access-ghq6x\") pod \"keystone-6b5587fc45-xvs8g\" (UID: \"543c3089-391b-47ed-85a6-8a0bdfce3811\") " pod="keystone-kuttl-tests/keystone-6b5587fc45-xvs8g" Mar 16 17:45:07 crc kubenswrapper[5120]: I0316 17:45:07.661396 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/543c3089-391b-47ed-85a6-8a0bdfce3811-scripts\") pod \"keystone-6b5587fc45-xvs8g\" (UID: \"543c3089-391b-47ed-85a6-8a0bdfce3811\") " pod="keystone-kuttl-tests/keystone-6b5587fc45-xvs8g" Mar 16 17:45:07 crc kubenswrapper[5120]: I0316 17:45:07.662002 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/543c3089-391b-47ed-85a6-8a0bdfce3811-config-data\") pod \"keystone-6b5587fc45-xvs8g\" (UID: \"543c3089-391b-47ed-85a6-8a0bdfce3811\") " pod="keystone-kuttl-tests/keystone-6b5587fc45-xvs8g" Mar 16 17:45:07 crc kubenswrapper[5120]: I0316 17:45:07.662140 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/543c3089-391b-47ed-85a6-8a0bdfce3811-fernet-keys\") pod \"keystone-6b5587fc45-xvs8g\" (UID: \"543c3089-391b-47ed-85a6-8a0bdfce3811\") " pod="keystone-kuttl-tests/keystone-6b5587fc45-xvs8g" Mar 16 17:45:07 crc kubenswrapper[5120]: I0316 17:45:07.663969 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/543c3089-391b-47ed-85a6-8a0bdfce3811-credential-keys\") pod \"keystone-6b5587fc45-xvs8g\" (UID: \"543c3089-391b-47ed-85a6-8a0bdfce3811\") " pod="keystone-kuttl-tests/keystone-6b5587fc45-xvs8g" Mar 16 17:45:07 crc kubenswrapper[5120]: I0316 17:45:07.676589 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghq6x\" (UniqueName: \"kubernetes.io/projected/543c3089-391b-47ed-85a6-8a0bdfce3811-kube-api-access-ghq6x\") pod \"keystone-6b5587fc45-xvs8g\" (UID: \"543c3089-391b-47ed-85a6-8a0bdfce3811\") " pod="keystone-kuttl-tests/keystone-6b5587fc45-xvs8g" Mar 16 17:45:07 crc kubenswrapper[5120]: I0316 17:45:07.734447 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keystone-kuttl-tests/keystone-db-sync-qkjpt"] Mar 16 17:45:07 crc kubenswrapper[5120]: I0316 17:45:07.755393 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["keystone-kuttl-tests/keystone-db-sync-qkjpt"] Mar 16 17:45:07 crc kubenswrapper[5120]: I0316 17:45:07.793252 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keystone-kuttl-tests/keystone-bootstrap-w7vqp"] Mar 16 17:45:07 crc kubenswrapper[5120]: I0316 17:45:07.798656 5120 kubelet_pods.go:1019] "Unable to retrieve pull secret, the image pull may not succeed." pod="keystone-kuttl-tests/keystone-6b5587fc45-xvs8g" secret="" err="secret \"keystone-keystone-dockercfg-p46q7\" not found" Mar 16 17:45:07 crc kubenswrapper[5120]: I0316 17:45:07.798742 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-6b5587fc45-xvs8g" Mar 16 17:45:07 crc kubenswrapper[5120]: I0316 17:45:07.799444 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["keystone-kuttl-tests/keystone-bootstrap-w7vqp"] Mar 16 17:45:07 crc kubenswrapper[5120]: I0316 17:45:07.813313 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keystone-kuttl-tests/keystone-57dcdffc79-fqh6r"] Mar 16 17:45:07 crc kubenswrapper[5120]: I0316 17:45:07.813579 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="keystone-kuttl-tests/keystone-57dcdffc79-fqh6r" podUID="8a3178db-a9d3-48a0-8913-5beed00d35b6" containerName="keystone-api" containerID="cri-o://c6306f687193ca22e8804a06146d9e5524ec07c55b271002c119a06cfb168ac1" gracePeriod=30 Mar 16 17:45:07 crc kubenswrapper[5120]: I0316 17:45:07.831808 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keystone-kuttl-tests/keystone-6b5587fc45-xvs8g"] Mar 16 17:45:07 crc kubenswrapper[5120]: I0316 17:45:07.845598 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keystone-kuttl-tests/keystone54db-account-delete-wzbzd"] Mar 16 17:45:07 crc kubenswrapper[5120]: I0316 17:45:07.861256 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone54db-account-delete-wzbzd"] Mar 16 17:45:07 crc kubenswrapper[5120]: I0316 17:45:07.861385 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone54db-account-delete-wzbzd" Mar 16 17:45:07 crc kubenswrapper[5120]: I0316 17:45:07.963230 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mf6gn\" (UniqueName: \"kubernetes.io/projected/a6b8a939-e423-42d4-b9a4-a37d117deba7-kube-api-access-mf6gn\") pod \"keystone54db-account-delete-wzbzd\" (UID: \"a6b8a939-e423-42d4-b9a4-a37d117deba7\") " pod="keystone-kuttl-tests/keystone54db-account-delete-wzbzd" Mar 16 17:45:07 crc kubenswrapper[5120]: I0316 17:45:07.963962 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a6b8a939-e423-42d4-b9a4-a37d117deba7-operator-scripts\") pod \"keystone54db-account-delete-wzbzd\" (UID: \"a6b8a939-e423-42d4-b9a4-a37d117deba7\") " pod="keystone-kuttl-tests/keystone54db-account-delete-wzbzd" Mar 16 17:45:08 crc kubenswrapper[5120]: I0316 17:45:08.066526 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mf6gn\" (UniqueName: \"kubernetes.io/projected/a6b8a939-e423-42d4-b9a4-a37d117deba7-kube-api-access-mf6gn\") pod \"keystone54db-account-delete-wzbzd\" (UID: \"a6b8a939-e423-42d4-b9a4-a37d117deba7\") " pod="keystone-kuttl-tests/keystone54db-account-delete-wzbzd" Mar 16 17:45:08 crc kubenswrapper[5120]: I0316 17:45:08.066876 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a6b8a939-e423-42d4-b9a4-a37d117deba7-operator-scripts\") pod \"keystone54db-account-delete-wzbzd\" (UID: \"a6b8a939-e423-42d4-b9a4-a37d117deba7\") " pod="keystone-kuttl-tests/keystone54db-account-delete-wzbzd" Mar 16 17:45:08 crc kubenswrapper[5120]: I0316 17:45:08.067810 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a6b8a939-e423-42d4-b9a4-a37d117deba7-operator-scripts\") pod \"keystone54db-account-delete-wzbzd\" (UID: \"a6b8a939-e423-42d4-b9a4-a37d117deba7\") " pod="keystone-kuttl-tests/keystone54db-account-delete-wzbzd" Mar 16 17:45:08 crc kubenswrapper[5120]: I0316 17:45:08.085289 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mf6gn\" (UniqueName: \"kubernetes.io/projected/a6b8a939-e423-42d4-b9a4-a37d117deba7-kube-api-access-mf6gn\") pod \"keystone54db-account-delete-wzbzd\" (UID: \"a6b8a939-e423-42d4-b9a4-a37d117deba7\") " pod="keystone-kuttl-tests/keystone54db-account-delete-wzbzd" Mar 16 17:45:08 crc kubenswrapper[5120]: I0316 17:45:08.197168 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone54db-account-delete-wzbzd" Mar 16 17:45:08 crc kubenswrapper[5120]: I0316 17:45:08.229124 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keystone-kuttl-tests/keystone-6b5587fc45-xvs8g"] Mar 16 17:45:08 crc kubenswrapper[5120]: W0316 17:45:08.237008 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod543c3089_391b_47ed_85a6_8a0bdfce3811.slice/crio-536b5adb473b04eefc1d49fb4d093cea320492e0db3a105a6dac3dc7b97c7334 WatchSource:0}: Error finding container 536b5adb473b04eefc1d49fb4d093cea320492e0db3a105a6dac3dc7b97c7334: Status 404 returned error can't find the container with id 536b5adb473b04eefc1d49fb4d093cea320492e0db3a105a6dac3dc7b97c7334 Mar 16 17:45:08 crc kubenswrapper[5120]: I0316 17:45:08.474980 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-6b5587fc45-xvs8g" event={"ID":"543c3089-391b-47ed-85a6-8a0bdfce3811","Type":"ContainerStarted","Data":"06195c632badfeb6b0ed0c06e9859168b83ec52b21dd261173fe4e7b9057e8b3"} Mar 16 17:45:08 crc kubenswrapper[5120]: I0316 17:45:08.475428 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-6b5587fc45-xvs8g" event={"ID":"543c3089-391b-47ed-85a6-8a0bdfce3811","Type":"ContainerStarted","Data":"536b5adb473b04eefc1d49fb4d093cea320492e0db3a105a6dac3dc7b97c7334"} Mar 16 17:45:08 crc kubenswrapper[5120]: I0316 17:45:08.475449 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keystone-kuttl-tests/keystone-6b5587fc45-xvs8g" Mar 16 17:45:08 crc kubenswrapper[5120]: I0316 17:45:08.475070 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="keystone-kuttl-tests/keystone-6b5587fc45-xvs8g" podUID="543c3089-391b-47ed-85a6-8a0bdfce3811" containerName="keystone-api" containerID="cri-o://06195c632badfeb6b0ed0c06e9859168b83ec52b21dd261173fe4e7b9057e8b3" gracePeriod=30 Mar 16 17:45:08 crc kubenswrapper[5120]: I0316 17:45:08.493779 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keystone-kuttl-tests/keystone-6b5587fc45-xvs8g" podStartSLOduration=1.493741932 podStartE2EDuration="1.493741932s" podCreationTimestamp="2026-03-16 17:45:07 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:45:08.489921069 +0000 UTC m=+8010.643852736" watchObservedRunningTime="2026-03-16 17:45:08.493741932 +0000 UTC m=+8010.647673589" Mar 16 17:45:08 crc kubenswrapper[5120]: I0316 17:45:08.609530 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone54db-account-delete-wzbzd"] Mar 16 17:45:08 crc kubenswrapper[5120]: I0316 17:45:08.684952 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d6127fdf-ad95-4bef-9472-0aeb17e0b057" path="/var/lib/kubelet/pods/d6127fdf-ad95-4bef-9472-0aeb17e0b057/volumes" Mar 16 17:45:08 crc kubenswrapper[5120]: I0316 17:45:08.685867 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d93a17d1-0f0a-495e-9394-1907d42b10d4" path="/var/lib/kubelet/pods/d93a17d1-0f0a-495e-9394-1907d42b10d4/volumes" Mar 16 17:45:09 crc kubenswrapper[5120]: I0316 17:45:09.483456 5120 generic.go:358] "Generic (PLEG): container finished" podID="a6b8a939-e423-42d4-b9a4-a37d117deba7" containerID="949b376e84ad089183427ac67fc34995d4561b9347a25e5c53f31ed82dd46a31" exitCode=0 Mar 16 17:45:09 crc kubenswrapper[5120]: I0316 17:45:09.483616 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone54db-account-delete-wzbzd" event={"ID":"a6b8a939-e423-42d4-b9a4-a37d117deba7","Type":"ContainerDied","Data":"949b376e84ad089183427ac67fc34995d4561b9347a25e5c53f31ed82dd46a31"} Mar 16 17:45:09 crc kubenswrapper[5120]: I0316 17:45:09.483660 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone54db-account-delete-wzbzd" event={"ID":"a6b8a939-e423-42d4-b9a4-a37d117deba7","Type":"ContainerStarted","Data":"4e637456c95343f04e47b8752d7ad20ac5baf9cdf5caeb485d05c23b8afbb817"} Mar 16 17:45:10 crc kubenswrapper[5120]: I0316 17:45:10.770213 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone54db-account-delete-wzbzd" Mar 16 17:45:10 crc kubenswrapper[5120]: I0316 17:45:10.827507 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mf6gn\" (UniqueName: \"kubernetes.io/projected/a6b8a939-e423-42d4-b9a4-a37d117deba7-kube-api-access-mf6gn\") pod \"a6b8a939-e423-42d4-b9a4-a37d117deba7\" (UID: \"a6b8a939-e423-42d4-b9a4-a37d117deba7\") " Mar 16 17:45:10 crc kubenswrapper[5120]: I0316 17:45:10.827730 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a6b8a939-e423-42d4-b9a4-a37d117deba7-operator-scripts\") pod \"a6b8a939-e423-42d4-b9a4-a37d117deba7\" (UID: \"a6b8a939-e423-42d4-b9a4-a37d117deba7\") " Mar 16 17:45:10 crc kubenswrapper[5120]: I0316 17:45:10.828426 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6b8a939-e423-42d4-b9a4-a37d117deba7-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "a6b8a939-e423-42d4-b9a4-a37d117deba7" (UID: "a6b8a939-e423-42d4-b9a4-a37d117deba7"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:45:10 crc kubenswrapper[5120]: I0316 17:45:10.834893 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6b8a939-e423-42d4-b9a4-a37d117deba7-kube-api-access-mf6gn" (OuterVolumeSpecName: "kube-api-access-mf6gn") pod "a6b8a939-e423-42d4-b9a4-a37d117deba7" (UID: "a6b8a939-e423-42d4-b9a4-a37d117deba7"). InnerVolumeSpecName "kube-api-access-mf6gn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:45:10 crc kubenswrapper[5120]: I0316 17:45:10.930675 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mf6gn\" (UniqueName: \"kubernetes.io/projected/a6b8a939-e423-42d4-b9a4-a37d117deba7-kube-api-access-mf6gn\") on node \"crc\" DevicePath \"\"" Mar 16 17:45:10 crc kubenswrapper[5120]: I0316 17:45:10.930709 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a6b8a939-e423-42d4-b9a4-a37d117deba7-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:45:11 crc kubenswrapper[5120]: I0316 17:45:11.325710 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-57dcdffc79-fqh6r" Mar 16 17:45:11 crc kubenswrapper[5120]: I0316 17:45:11.441332 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/8a3178db-a9d3-48a0-8913-5beed00d35b6-credential-keys\") pod \"8a3178db-a9d3-48a0-8913-5beed00d35b6\" (UID: \"8a3178db-a9d3-48a0-8913-5beed00d35b6\") " Mar 16 17:45:11 crc kubenswrapper[5120]: I0316 17:45:11.441471 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4f9vg\" (UniqueName: \"kubernetes.io/projected/8a3178db-a9d3-48a0-8913-5beed00d35b6-kube-api-access-4f9vg\") pod \"8a3178db-a9d3-48a0-8913-5beed00d35b6\" (UID: \"8a3178db-a9d3-48a0-8913-5beed00d35b6\") " Mar 16 17:45:11 crc kubenswrapper[5120]: I0316 17:45:11.441608 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/8a3178db-a9d3-48a0-8913-5beed00d35b6-fernet-keys\") pod \"8a3178db-a9d3-48a0-8913-5beed00d35b6\" (UID: \"8a3178db-a9d3-48a0-8913-5beed00d35b6\") " Mar 16 17:45:11 crc kubenswrapper[5120]: I0316 17:45:11.441683 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8a3178db-a9d3-48a0-8913-5beed00d35b6-scripts\") pod \"8a3178db-a9d3-48a0-8913-5beed00d35b6\" (UID: \"8a3178db-a9d3-48a0-8913-5beed00d35b6\") " Mar 16 17:45:11 crc kubenswrapper[5120]: I0316 17:45:11.442031 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8a3178db-a9d3-48a0-8913-5beed00d35b6-config-data\") pod \"8a3178db-a9d3-48a0-8913-5beed00d35b6\" (UID: \"8a3178db-a9d3-48a0-8913-5beed00d35b6\") " Mar 16 17:45:11 crc kubenswrapper[5120]: I0316 17:45:11.446684 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a3178db-a9d3-48a0-8913-5beed00d35b6-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "8a3178db-a9d3-48a0-8913-5beed00d35b6" (UID: "8a3178db-a9d3-48a0-8913-5beed00d35b6"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:45:11 crc kubenswrapper[5120]: I0316 17:45:11.447084 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a3178db-a9d3-48a0-8913-5beed00d35b6-scripts" (OuterVolumeSpecName: "scripts") pod "8a3178db-a9d3-48a0-8913-5beed00d35b6" (UID: "8a3178db-a9d3-48a0-8913-5beed00d35b6"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:45:11 crc kubenswrapper[5120]: I0316 17:45:11.447102 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a3178db-a9d3-48a0-8913-5beed00d35b6-kube-api-access-4f9vg" (OuterVolumeSpecName: "kube-api-access-4f9vg") pod "8a3178db-a9d3-48a0-8913-5beed00d35b6" (UID: "8a3178db-a9d3-48a0-8913-5beed00d35b6"). InnerVolumeSpecName "kube-api-access-4f9vg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:45:11 crc kubenswrapper[5120]: I0316 17:45:11.447206 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a3178db-a9d3-48a0-8913-5beed00d35b6-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "8a3178db-a9d3-48a0-8913-5beed00d35b6" (UID: "8a3178db-a9d3-48a0-8913-5beed00d35b6"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:45:11 crc kubenswrapper[5120]: I0316 17:45:11.465325 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a3178db-a9d3-48a0-8913-5beed00d35b6-config-data" (OuterVolumeSpecName: "config-data") pod "8a3178db-a9d3-48a0-8913-5beed00d35b6" (UID: "8a3178db-a9d3-48a0-8913-5beed00d35b6"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:45:11 crc kubenswrapper[5120]: I0316 17:45:11.499704 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone54db-account-delete-wzbzd" event={"ID":"a6b8a939-e423-42d4-b9a4-a37d117deba7","Type":"ContainerDied","Data":"4e637456c95343f04e47b8752d7ad20ac5baf9cdf5caeb485d05c23b8afbb817"} Mar 16 17:45:11 crc kubenswrapper[5120]: I0316 17:45:11.499722 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone54db-account-delete-wzbzd" Mar 16 17:45:11 crc kubenswrapper[5120]: I0316 17:45:11.499756 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4e637456c95343f04e47b8752d7ad20ac5baf9cdf5caeb485d05c23b8afbb817" Mar 16 17:45:11 crc kubenswrapper[5120]: I0316 17:45:11.501817 5120 generic.go:358] "Generic (PLEG): container finished" podID="8a3178db-a9d3-48a0-8913-5beed00d35b6" containerID="c6306f687193ca22e8804a06146d9e5524ec07c55b271002c119a06cfb168ac1" exitCode=0 Mar 16 17:45:11 crc kubenswrapper[5120]: I0316 17:45:11.501873 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-57dcdffc79-fqh6r" event={"ID":"8a3178db-a9d3-48a0-8913-5beed00d35b6","Type":"ContainerDied","Data":"c6306f687193ca22e8804a06146d9e5524ec07c55b271002c119a06cfb168ac1"} Mar 16 17:45:11 crc kubenswrapper[5120]: I0316 17:45:11.501895 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-57dcdffc79-fqh6r" Mar 16 17:45:11 crc kubenswrapper[5120]: I0316 17:45:11.502039 5120 scope.go:117] "RemoveContainer" containerID="c6306f687193ca22e8804a06146d9e5524ec07c55b271002c119a06cfb168ac1" Mar 16 17:45:11 crc kubenswrapper[5120]: I0316 17:45:11.502026 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-57dcdffc79-fqh6r" event={"ID":"8a3178db-a9d3-48a0-8913-5beed00d35b6","Type":"ContainerDied","Data":"f89ee41a0674158b62553e4120751b25ce58e20d2f62976edace5f71a53bd915"} Mar 16 17:45:11 crc kubenswrapper[5120]: I0316 17:45:11.522964 5120 scope.go:117] "RemoveContainer" containerID="c6306f687193ca22e8804a06146d9e5524ec07c55b271002c119a06cfb168ac1" Mar 16 17:45:11 crc kubenswrapper[5120]: E0316 17:45:11.523657 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c6306f687193ca22e8804a06146d9e5524ec07c55b271002c119a06cfb168ac1\": container with ID starting with c6306f687193ca22e8804a06146d9e5524ec07c55b271002c119a06cfb168ac1 not found: ID does not exist" containerID="c6306f687193ca22e8804a06146d9e5524ec07c55b271002c119a06cfb168ac1" Mar 16 17:45:11 crc kubenswrapper[5120]: I0316 17:45:11.523696 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6306f687193ca22e8804a06146d9e5524ec07c55b271002c119a06cfb168ac1"} err="failed to get container status \"c6306f687193ca22e8804a06146d9e5524ec07c55b271002c119a06cfb168ac1\": rpc error: code = NotFound desc = could not find container \"c6306f687193ca22e8804a06146d9e5524ec07c55b271002c119a06cfb168ac1\": container with ID starting with c6306f687193ca22e8804a06146d9e5524ec07c55b271002c119a06cfb168ac1 not found: ID does not exist" Mar 16 17:45:11 crc kubenswrapper[5120]: I0316 17:45:11.537692 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keystone-kuttl-tests/keystone-57dcdffc79-fqh6r"] Mar 16 17:45:11 crc kubenswrapper[5120]: I0316 17:45:11.544542 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8a3178db-a9d3-48a0-8913-5beed00d35b6-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:45:11 crc kubenswrapper[5120]: I0316 17:45:11.544580 5120 reconciler_common.go:299] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/8a3178db-a9d3-48a0-8913-5beed00d35b6-credential-keys\") on node \"crc\" DevicePath \"\"" Mar 16 17:45:11 crc kubenswrapper[5120]: I0316 17:45:11.544593 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4f9vg\" (UniqueName: \"kubernetes.io/projected/8a3178db-a9d3-48a0-8913-5beed00d35b6-kube-api-access-4f9vg\") on node \"crc\" DevicePath \"\"" Mar 16 17:45:11 crc kubenswrapper[5120]: I0316 17:45:11.544601 5120 reconciler_common.go:299] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/8a3178db-a9d3-48a0-8913-5beed00d35b6-fernet-keys\") on node \"crc\" DevicePath \"\"" Mar 16 17:45:11 crc kubenswrapper[5120]: I0316 17:45:11.544611 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8a3178db-a9d3-48a0-8913-5beed00d35b6-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:45:11 crc kubenswrapper[5120]: I0316 17:45:11.545963 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["keystone-kuttl-tests/keystone-57dcdffc79-fqh6r"] Mar 16 17:45:12 crc kubenswrapper[5120]: I0316 17:45:12.671374 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a3178db-a9d3-48a0-8913-5beed00d35b6" path="/var/lib/kubelet/pods/8a3178db-a9d3-48a0-8913-5beed00d35b6/volumes" Mar 16 17:45:12 crc kubenswrapper[5120]: I0316 17:45:12.797736 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keystone-kuttl-tests/keystone-db-create-jf5fb"] Mar 16 17:45:12 crc kubenswrapper[5120]: I0316 17:45:12.807920 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["keystone-kuttl-tests/keystone-db-create-jf5fb"] Mar 16 17:45:12 crc kubenswrapper[5120]: I0316 17:45:12.822966 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keystone-kuttl-tests/keystone-54db-account-create-update-rcxpx"] Mar 16 17:45:12 crc kubenswrapper[5120]: I0316 17:45:12.828803 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keystone-kuttl-tests/keystone54db-account-delete-wzbzd"] Mar 16 17:45:12 crc kubenswrapper[5120]: I0316 17:45:12.834028 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["keystone-kuttl-tests/keystone54db-account-delete-wzbzd"] Mar 16 17:45:12 crc kubenswrapper[5120]: I0316 17:45:12.838920 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["keystone-kuttl-tests/keystone-54db-account-create-update-rcxpx"] Mar 16 17:45:14 crc kubenswrapper[5120]: I0316 17:45:14.664108 5120 scope.go:117] "RemoveContainer" containerID="7fd764dd19065c7ce437c63b05fda51970409dfa8dfd1c77e2158bb3e05b7723" Mar 16 17:45:14 crc kubenswrapper[5120]: E0316 17:45:14.664737 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 17:45:14 crc kubenswrapper[5120]: I0316 17:45:14.674808 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3ab3ea89-47e2-419e-a8f3-8c1c62aaebfb" path="/var/lib/kubelet/pods/3ab3ea89-47e2-419e-a8f3-8c1c62aaebfb/volumes" Mar 16 17:45:14 crc kubenswrapper[5120]: I0316 17:45:14.675814 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="90d813fe-87eb-4e31-8a2a-40e747ad2865" path="/var/lib/kubelet/pods/90d813fe-87eb-4e31-8a2a-40e747ad2865/volumes" Mar 16 17:45:14 crc kubenswrapper[5120]: I0316 17:45:14.676810 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a6b8a939-e423-42d4-b9a4-a37d117deba7" path="/var/lib/kubelet/pods/a6b8a939-e423-42d4-b9a4-a37d117deba7/volumes" Mar 16 17:45:25 crc kubenswrapper[5120]: I0316 17:45:25.664683 5120 scope.go:117] "RemoveContainer" containerID="7fd764dd19065c7ce437c63b05fda51970409dfa8dfd1c77e2158bb3e05b7723" Mar 16 17:45:26 crc kubenswrapper[5120]: I0316 17:45:26.639510 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" event={"ID":"e2275cb4-4905-4d66-a87e-8010120db2bd","Type":"ContainerStarted","Data":"09cc7c20368ae6767b406319b2f6a0de85add28a4c1a3f75b70ae511bf5e3d62"} Mar 16 17:45:34 crc kubenswrapper[5120]: I0316 17:45:34.834710 5120 scope.go:117] "RemoveContainer" containerID="070e279de08417c73d03724005b14805ad69bee00fe5b12f75f7847aa14e717a" Mar 16 17:45:34 crc kubenswrapper[5120]: I0316 17:45:34.858960 5120 scope.go:117] "RemoveContainer" containerID="e3664e35bdc3cc3f089bfe8b1a975c0c3c22a7c309397d40090b08c9c037b2eb" Mar 16 17:45:34 crc kubenswrapper[5120]: I0316 17:45:34.904522 5120 scope.go:117] "RemoveContainer" containerID="586b99213b91f16f0c9d1d82594ef6da975b029942a4f213b63c3e462bab1207" Mar 16 17:45:34 crc kubenswrapper[5120]: I0316 17:45:34.928840 5120 scope.go:117] "RemoveContainer" containerID="a0c26ca852d3d5939c82d134ac059f34b6117582f303b5435c5595739c238271" Mar 16 17:45:34 crc kubenswrapper[5120]: I0316 17:45:34.957964 5120 scope.go:117] "RemoveContainer" containerID="1181810fdd099b1dbb67fa2eb917411cd0acb25ec73f9c84025527aa8e97f907" Mar 16 17:45:34 crc kubenswrapper[5120]: I0316 17:45:34.991163 5120 scope.go:117] "RemoveContainer" containerID="1b0bdfdaaa4a9462794155faf62f78f265a50c86922b7d1bd2bea57eb49f0c73" Mar 16 17:45:35 crc kubenswrapper[5120]: I0316 17:45:35.021026 5120 scope.go:117] "RemoveContainer" containerID="c65c9047218036b7dce5dc7676f8777b6685820e33f291a341b7e7d61e520376" Mar 16 17:45:35 crc kubenswrapper[5120]: I0316 17:45:35.041720 5120 scope.go:117] "RemoveContainer" containerID="fb5529b06ccd386956a29b2fa0c0e4ec6e9daa531575fc26907da055afd1d0d8" Mar 16 17:45:35 crc kubenswrapper[5120]: I0316 17:45:35.061034 5120 scope.go:117] "RemoveContainer" containerID="89c043e6be0b62df91ea671488f2df5f47269361918e8970bf2e56ba47345a72" Mar 16 17:45:38 crc kubenswrapper[5120]: I0316 17:45:38.506140 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="keystone-kuttl-tests/keystone-6b5587fc45-xvs8g" podUID="543c3089-391b-47ed-85a6-8a0bdfce3811" containerName="keystone-api" probeResult="failure" output="Get \"http://10.217.1.215:5000/v3\": EOF" Mar 16 17:45:38 crc kubenswrapper[5120]: I0316 17:45:38.750620 5120 generic.go:358] "Generic (PLEG): container finished" podID="543c3089-391b-47ed-85a6-8a0bdfce3811" containerID="06195c632badfeb6b0ed0c06e9859168b83ec52b21dd261173fe4e7b9057e8b3" exitCode=137 Mar 16 17:45:38 crc kubenswrapper[5120]: I0316 17:45:38.750817 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-6b5587fc45-xvs8g" event={"ID":"543c3089-391b-47ed-85a6-8a0bdfce3811","Type":"ContainerDied","Data":"06195c632badfeb6b0ed0c06e9859168b83ec52b21dd261173fe4e7b9057e8b3"} Mar 16 17:45:38 crc kubenswrapper[5120]: I0316 17:45:38.809620 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-6b5587fc45-xvs8g" Mar 16 17:45:38 crc kubenswrapper[5120]: I0316 17:45:38.899289 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/543c3089-391b-47ed-85a6-8a0bdfce3811-scripts\") pod \"543c3089-391b-47ed-85a6-8a0bdfce3811\" (UID: \"543c3089-391b-47ed-85a6-8a0bdfce3811\") " Mar 16 17:45:38 crc kubenswrapper[5120]: I0316 17:45:38.899358 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/543c3089-391b-47ed-85a6-8a0bdfce3811-config-data\") pod \"543c3089-391b-47ed-85a6-8a0bdfce3811\" (UID: \"543c3089-391b-47ed-85a6-8a0bdfce3811\") " Mar 16 17:45:38 crc kubenswrapper[5120]: I0316 17:45:38.899381 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/543c3089-391b-47ed-85a6-8a0bdfce3811-fernet-keys\") pod \"543c3089-391b-47ed-85a6-8a0bdfce3811\" (UID: \"543c3089-391b-47ed-85a6-8a0bdfce3811\") " Mar 16 17:45:38 crc kubenswrapper[5120]: I0316 17:45:38.899440 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ghq6x\" (UniqueName: \"kubernetes.io/projected/543c3089-391b-47ed-85a6-8a0bdfce3811-kube-api-access-ghq6x\") pod \"543c3089-391b-47ed-85a6-8a0bdfce3811\" (UID: \"543c3089-391b-47ed-85a6-8a0bdfce3811\") " Mar 16 17:45:38 crc kubenswrapper[5120]: I0316 17:45:38.899831 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/543c3089-391b-47ed-85a6-8a0bdfce3811-credential-keys\") pod \"543c3089-391b-47ed-85a6-8a0bdfce3811\" (UID: \"543c3089-391b-47ed-85a6-8a0bdfce3811\") " Mar 16 17:45:38 crc kubenswrapper[5120]: I0316 17:45:38.905339 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/543c3089-391b-47ed-85a6-8a0bdfce3811-scripts" (OuterVolumeSpecName: "scripts") pod "543c3089-391b-47ed-85a6-8a0bdfce3811" (UID: "543c3089-391b-47ed-85a6-8a0bdfce3811"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:45:38 crc kubenswrapper[5120]: I0316 17:45:38.905494 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/543c3089-391b-47ed-85a6-8a0bdfce3811-kube-api-access-ghq6x" (OuterVolumeSpecName: "kube-api-access-ghq6x") pod "543c3089-391b-47ed-85a6-8a0bdfce3811" (UID: "543c3089-391b-47ed-85a6-8a0bdfce3811"). InnerVolumeSpecName "kube-api-access-ghq6x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:45:38 crc kubenswrapper[5120]: I0316 17:45:38.906367 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/543c3089-391b-47ed-85a6-8a0bdfce3811-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "543c3089-391b-47ed-85a6-8a0bdfce3811" (UID: "543c3089-391b-47ed-85a6-8a0bdfce3811"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:45:38 crc kubenswrapper[5120]: I0316 17:45:38.906733 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/543c3089-391b-47ed-85a6-8a0bdfce3811-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "543c3089-391b-47ed-85a6-8a0bdfce3811" (UID: "543c3089-391b-47ed-85a6-8a0bdfce3811"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:45:38 crc kubenswrapper[5120]: I0316 17:45:38.922995 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/543c3089-391b-47ed-85a6-8a0bdfce3811-config-data" (OuterVolumeSpecName: "config-data") pod "543c3089-391b-47ed-85a6-8a0bdfce3811" (UID: "543c3089-391b-47ed-85a6-8a0bdfce3811"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:45:39 crc kubenswrapper[5120]: I0316 17:45:39.002417 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/543c3089-391b-47ed-85a6-8a0bdfce3811-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:45:39 crc kubenswrapper[5120]: I0316 17:45:39.002794 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/543c3089-391b-47ed-85a6-8a0bdfce3811-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:45:39 crc kubenswrapper[5120]: I0316 17:45:39.002813 5120 reconciler_common.go:299] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/543c3089-391b-47ed-85a6-8a0bdfce3811-fernet-keys\") on node \"crc\" DevicePath \"\"" Mar 16 17:45:39 crc kubenswrapper[5120]: I0316 17:45:39.002830 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ghq6x\" (UniqueName: \"kubernetes.io/projected/543c3089-391b-47ed-85a6-8a0bdfce3811-kube-api-access-ghq6x\") on node \"crc\" DevicePath \"\"" Mar 16 17:45:39 crc kubenswrapper[5120]: I0316 17:45:39.002847 5120 reconciler_common.go:299] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/543c3089-391b-47ed-85a6-8a0bdfce3811-credential-keys\") on node \"crc\" DevicePath \"\"" Mar 16 17:45:39 crc kubenswrapper[5120]: I0316 17:45:39.760071 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-6b5587fc45-xvs8g" event={"ID":"543c3089-391b-47ed-85a6-8a0bdfce3811","Type":"ContainerDied","Data":"536b5adb473b04eefc1d49fb4d093cea320492e0db3a105a6dac3dc7b97c7334"} Mar 16 17:45:39 crc kubenswrapper[5120]: I0316 17:45:39.760128 5120 scope.go:117] "RemoveContainer" containerID="06195c632badfeb6b0ed0c06e9859168b83ec52b21dd261173fe4e7b9057e8b3" Mar 16 17:45:39 crc kubenswrapper[5120]: I0316 17:45:39.760259 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-6b5587fc45-xvs8g" Mar 16 17:45:39 crc kubenswrapper[5120]: I0316 17:45:39.792018 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keystone-kuttl-tests/keystone-6b5587fc45-xvs8g"] Mar 16 17:45:39 crc kubenswrapper[5120]: I0316 17:45:39.803738 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["keystone-kuttl-tests/keystone-6b5587fc45-xvs8g"] Mar 16 17:45:40 crc kubenswrapper[5120]: I0316 17:45:40.566496 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keystone-kuttl-tests/keystone-db-create-n6p6w"] Mar 16 17:45:40 crc kubenswrapper[5120]: I0316 17:45:40.568257 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="543c3089-391b-47ed-85a6-8a0bdfce3811" containerName="keystone-api" Mar 16 17:45:40 crc kubenswrapper[5120]: I0316 17:45:40.568295 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="543c3089-391b-47ed-85a6-8a0bdfce3811" containerName="keystone-api" Mar 16 17:45:40 crc kubenswrapper[5120]: I0316 17:45:40.568361 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a3178db-a9d3-48a0-8913-5beed00d35b6" containerName="keystone-api" Mar 16 17:45:40 crc kubenswrapper[5120]: I0316 17:45:40.568373 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a3178db-a9d3-48a0-8913-5beed00d35b6" containerName="keystone-api" Mar 16 17:45:40 crc kubenswrapper[5120]: I0316 17:45:40.568406 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6b8a939-e423-42d4-b9a4-a37d117deba7" containerName="mariadb-account-delete" Mar 16 17:45:40 crc kubenswrapper[5120]: I0316 17:45:40.568419 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6b8a939-e423-42d4-b9a4-a37d117deba7" containerName="mariadb-account-delete" Mar 16 17:45:40 crc kubenswrapper[5120]: I0316 17:45:40.568623 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="a6b8a939-e423-42d4-b9a4-a37d117deba7" containerName="mariadb-account-delete" Mar 16 17:45:40 crc kubenswrapper[5120]: I0316 17:45:40.568668 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="8a3178db-a9d3-48a0-8913-5beed00d35b6" containerName="keystone-api" Mar 16 17:45:40 crc kubenswrapper[5120]: I0316 17:45:40.568687 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="543c3089-391b-47ed-85a6-8a0bdfce3811" containerName="keystone-api" Mar 16 17:45:40 crc kubenswrapper[5120]: I0316 17:45:40.577949 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keystone-kuttl-tests/keystone-52c5-account-create-update-kqp9t"] Mar 16 17:45:40 crc kubenswrapper[5120]: I0316 17:45:40.578148 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-db-create-n6p6w" Mar 16 17:45:40 crc kubenswrapper[5120]: I0316 17:45:40.582856 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone-db-create-n6p6w"] Mar 16 17:45:40 crc kubenswrapper[5120]: I0316 17:45:40.582941 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-52c5-account-create-update-kqp9t" Mar 16 17:45:40 crc kubenswrapper[5120]: I0316 17:45:40.588978 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keystone-kuttl-tests\"/\"keystone-db-secret\"" Mar 16 17:45:40 crc kubenswrapper[5120]: I0316 17:45:40.590943 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone-52c5-account-create-update-kqp9t"] Mar 16 17:45:40 crc kubenswrapper[5120]: I0316 17:45:40.649268 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/1d19dbe7-73f4-4077-97ee-309cd5b666af-operator-scripts\") pod \"keystone-52c5-account-create-update-kqp9t\" (UID: \"1d19dbe7-73f4-4077-97ee-309cd5b666af\") " pod="keystone-kuttl-tests/keystone-52c5-account-create-update-kqp9t" Mar 16 17:45:40 crc kubenswrapper[5120]: I0316 17:45:40.649893 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4czp\" (UniqueName: \"kubernetes.io/projected/1d19dbe7-73f4-4077-97ee-309cd5b666af-kube-api-access-l4czp\") pod \"keystone-52c5-account-create-update-kqp9t\" (UID: \"1d19dbe7-73f4-4077-97ee-309cd5b666af\") " pod="keystone-kuttl-tests/keystone-52c5-account-create-update-kqp9t" Mar 16 17:45:40 crc kubenswrapper[5120]: I0316 17:45:40.650018 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzhk5\" (UniqueName: \"kubernetes.io/projected/d73e0ff0-cb3a-4ffa-bb8e-0690287d6575-kube-api-access-jzhk5\") pod \"keystone-db-create-n6p6w\" (UID: \"d73e0ff0-cb3a-4ffa-bb8e-0690287d6575\") " pod="keystone-kuttl-tests/keystone-db-create-n6p6w" Mar 16 17:45:40 crc kubenswrapper[5120]: I0316 17:45:40.650143 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d73e0ff0-cb3a-4ffa-bb8e-0690287d6575-operator-scripts\") pod \"keystone-db-create-n6p6w\" (UID: \"d73e0ff0-cb3a-4ffa-bb8e-0690287d6575\") " pod="keystone-kuttl-tests/keystone-db-create-n6p6w" Mar 16 17:45:40 crc kubenswrapper[5120]: I0316 17:45:40.674455 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="543c3089-391b-47ed-85a6-8a0bdfce3811" path="/var/lib/kubelet/pods/543c3089-391b-47ed-85a6-8a0bdfce3811/volumes" Mar 16 17:45:40 crc kubenswrapper[5120]: I0316 17:45:40.753728 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/1d19dbe7-73f4-4077-97ee-309cd5b666af-operator-scripts\") pod \"keystone-52c5-account-create-update-kqp9t\" (UID: \"1d19dbe7-73f4-4077-97ee-309cd5b666af\") " pod="keystone-kuttl-tests/keystone-52c5-account-create-update-kqp9t" Mar 16 17:45:40 crc kubenswrapper[5120]: I0316 17:45:40.753842 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l4czp\" (UniqueName: \"kubernetes.io/projected/1d19dbe7-73f4-4077-97ee-309cd5b666af-kube-api-access-l4czp\") pod \"keystone-52c5-account-create-update-kqp9t\" (UID: \"1d19dbe7-73f4-4077-97ee-309cd5b666af\") " pod="keystone-kuttl-tests/keystone-52c5-account-create-update-kqp9t" Mar 16 17:45:40 crc kubenswrapper[5120]: I0316 17:45:40.754009 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jzhk5\" (UniqueName: \"kubernetes.io/projected/d73e0ff0-cb3a-4ffa-bb8e-0690287d6575-kube-api-access-jzhk5\") pod \"keystone-db-create-n6p6w\" (UID: \"d73e0ff0-cb3a-4ffa-bb8e-0690287d6575\") " pod="keystone-kuttl-tests/keystone-db-create-n6p6w" Mar 16 17:45:40 crc kubenswrapper[5120]: I0316 17:45:40.754168 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d73e0ff0-cb3a-4ffa-bb8e-0690287d6575-operator-scripts\") pod \"keystone-db-create-n6p6w\" (UID: \"d73e0ff0-cb3a-4ffa-bb8e-0690287d6575\") " pod="keystone-kuttl-tests/keystone-db-create-n6p6w" Mar 16 17:45:40 crc kubenswrapper[5120]: I0316 17:45:40.755040 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/1d19dbe7-73f4-4077-97ee-309cd5b666af-operator-scripts\") pod \"keystone-52c5-account-create-update-kqp9t\" (UID: \"1d19dbe7-73f4-4077-97ee-309cd5b666af\") " pod="keystone-kuttl-tests/keystone-52c5-account-create-update-kqp9t" Mar 16 17:45:40 crc kubenswrapper[5120]: I0316 17:45:40.755168 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d73e0ff0-cb3a-4ffa-bb8e-0690287d6575-operator-scripts\") pod \"keystone-db-create-n6p6w\" (UID: \"d73e0ff0-cb3a-4ffa-bb8e-0690287d6575\") " pod="keystone-kuttl-tests/keystone-db-create-n6p6w" Mar 16 17:45:40 crc kubenswrapper[5120]: I0316 17:45:40.772987 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4czp\" (UniqueName: \"kubernetes.io/projected/1d19dbe7-73f4-4077-97ee-309cd5b666af-kube-api-access-l4czp\") pod \"keystone-52c5-account-create-update-kqp9t\" (UID: \"1d19dbe7-73f4-4077-97ee-309cd5b666af\") " pod="keystone-kuttl-tests/keystone-52c5-account-create-update-kqp9t" Mar 16 17:45:40 crc kubenswrapper[5120]: I0316 17:45:40.774960 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzhk5\" (UniqueName: \"kubernetes.io/projected/d73e0ff0-cb3a-4ffa-bb8e-0690287d6575-kube-api-access-jzhk5\") pod \"keystone-db-create-n6p6w\" (UID: \"d73e0ff0-cb3a-4ffa-bb8e-0690287d6575\") " pod="keystone-kuttl-tests/keystone-db-create-n6p6w" Mar 16 17:45:40 crc kubenswrapper[5120]: I0316 17:45:40.905685 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-db-create-n6p6w" Mar 16 17:45:40 crc kubenswrapper[5120]: I0316 17:45:40.913314 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-52c5-account-create-update-kqp9t" Mar 16 17:45:41 crc kubenswrapper[5120]: I0316 17:45:41.174194 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone-52c5-account-create-update-kqp9t"] Mar 16 17:45:41 crc kubenswrapper[5120]: W0316 17:45:41.178298 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1d19dbe7_73f4_4077_97ee_309cd5b666af.slice/crio-55ab8fbeaffdd11b56de3af335a23edef92bb3676d87be4db381b03a146127f4 WatchSource:0}: Error finding container 55ab8fbeaffdd11b56de3af335a23edef92bb3676d87be4db381b03a146127f4: Status 404 returned error can't find the container with id 55ab8fbeaffdd11b56de3af335a23edef92bb3676d87be4db381b03a146127f4 Mar 16 17:45:41 crc kubenswrapper[5120]: I0316 17:45:41.336433 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone-db-create-n6p6w"] Mar 16 17:45:41 crc kubenswrapper[5120]: W0316 17:45:41.339346 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd73e0ff0_cb3a_4ffa_bb8e_0690287d6575.slice/crio-2ab07da0480322d96548ce10e5ffdb5b196469de494e28429d9c42c7f5d1f385 WatchSource:0}: Error finding container 2ab07da0480322d96548ce10e5ffdb5b196469de494e28429d9c42c7f5d1f385: Status 404 returned error can't find the container with id 2ab07da0480322d96548ce10e5ffdb5b196469de494e28429d9c42c7f5d1f385 Mar 16 17:45:41 crc kubenswrapper[5120]: I0316 17:45:41.786377 5120 generic.go:358] "Generic (PLEG): container finished" podID="1d19dbe7-73f4-4077-97ee-309cd5b666af" containerID="421f53bf69e6869f5525cafefc6bdafdaecd0b5bc19a44aaf9bda8ad970d7144" exitCode=0 Mar 16 17:45:41 crc kubenswrapper[5120]: I0316 17:45:41.786488 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-52c5-account-create-update-kqp9t" event={"ID":"1d19dbe7-73f4-4077-97ee-309cd5b666af","Type":"ContainerDied","Data":"421f53bf69e6869f5525cafefc6bdafdaecd0b5bc19a44aaf9bda8ad970d7144"} Mar 16 17:45:41 crc kubenswrapper[5120]: I0316 17:45:41.786549 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-52c5-account-create-update-kqp9t" event={"ID":"1d19dbe7-73f4-4077-97ee-309cd5b666af","Type":"ContainerStarted","Data":"55ab8fbeaffdd11b56de3af335a23edef92bb3676d87be4db381b03a146127f4"} Mar 16 17:45:41 crc kubenswrapper[5120]: I0316 17:45:41.789015 5120 generic.go:358] "Generic (PLEG): container finished" podID="d73e0ff0-cb3a-4ffa-bb8e-0690287d6575" containerID="25b1db9962092fccc5f145673089d7e1a6cfe9deb3b4a55167a477a42149acbc" exitCode=0 Mar 16 17:45:41 crc kubenswrapper[5120]: I0316 17:45:41.789044 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-db-create-n6p6w" event={"ID":"d73e0ff0-cb3a-4ffa-bb8e-0690287d6575","Type":"ContainerDied","Data":"25b1db9962092fccc5f145673089d7e1a6cfe9deb3b4a55167a477a42149acbc"} Mar 16 17:45:41 crc kubenswrapper[5120]: I0316 17:45:41.789096 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-db-create-n6p6w" event={"ID":"d73e0ff0-cb3a-4ffa-bb8e-0690287d6575","Type":"ContainerStarted","Data":"2ab07da0480322d96548ce10e5ffdb5b196469de494e28429d9c42c7f5d1f385"} Mar 16 17:45:43 crc kubenswrapper[5120]: I0316 17:45:43.092004 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-52c5-account-create-update-kqp9t" Mar 16 17:45:43 crc kubenswrapper[5120]: I0316 17:45:43.097032 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-db-create-n6p6w" Mar 16 17:45:43 crc kubenswrapper[5120]: I0316 17:45:43.210293 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d73e0ff0-cb3a-4ffa-bb8e-0690287d6575-operator-scripts\") pod \"d73e0ff0-cb3a-4ffa-bb8e-0690287d6575\" (UID: \"d73e0ff0-cb3a-4ffa-bb8e-0690287d6575\") " Mar 16 17:45:43 crc kubenswrapper[5120]: I0316 17:45:43.210508 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jzhk5\" (UniqueName: \"kubernetes.io/projected/d73e0ff0-cb3a-4ffa-bb8e-0690287d6575-kube-api-access-jzhk5\") pod \"d73e0ff0-cb3a-4ffa-bb8e-0690287d6575\" (UID: \"d73e0ff0-cb3a-4ffa-bb8e-0690287d6575\") " Mar 16 17:45:43 crc kubenswrapper[5120]: I0316 17:45:43.210625 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l4czp\" (UniqueName: \"kubernetes.io/projected/1d19dbe7-73f4-4077-97ee-309cd5b666af-kube-api-access-l4czp\") pod \"1d19dbe7-73f4-4077-97ee-309cd5b666af\" (UID: \"1d19dbe7-73f4-4077-97ee-309cd5b666af\") " Mar 16 17:45:43 crc kubenswrapper[5120]: I0316 17:45:43.210917 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/1d19dbe7-73f4-4077-97ee-309cd5b666af-operator-scripts\") pod \"1d19dbe7-73f4-4077-97ee-309cd5b666af\" (UID: \"1d19dbe7-73f4-4077-97ee-309cd5b666af\") " Mar 16 17:45:43 crc kubenswrapper[5120]: I0316 17:45:43.211225 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d73e0ff0-cb3a-4ffa-bb8e-0690287d6575-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "d73e0ff0-cb3a-4ffa-bb8e-0690287d6575" (UID: "d73e0ff0-cb3a-4ffa-bb8e-0690287d6575"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:45:43 crc kubenswrapper[5120]: I0316 17:45:43.211309 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1d19dbe7-73f4-4077-97ee-309cd5b666af-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "1d19dbe7-73f4-4077-97ee-309cd5b666af" (UID: "1d19dbe7-73f4-4077-97ee-309cd5b666af"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:45:43 crc kubenswrapper[5120]: I0316 17:45:43.211468 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/1d19dbe7-73f4-4077-97ee-309cd5b666af-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:45:43 crc kubenswrapper[5120]: I0316 17:45:43.211493 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d73e0ff0-cb3a-4ffa-bb8e-0690287d6575-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:45:43 crc kubenswrapper[5120]: I0316 17:45:43.217327 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d19dbe7-73f4-4077-97ee-309cd5b666af-kube-api-access-l4czp" (OuterVolumeSpecName: "kube-api-access-l4czp") pod "1d19dbe7-73f4-4077-97ee-309cd5b666af" (UID: "1d19dbe7-73f4-4077-97ee-309cd5b666af"). InnerVolumeSpecName "kube-api-access-l4czp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:45:43 crc kubenswrapper[5120]: I0316 17:45:43.218403 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d73e0ff0-cb3a-4ffa-bb8e-0690287d6575-kube-api-access-jzhk5" (OuterVolumeSpecName: "kube-api-access-jzhk5") pod "d73e0ff0-cb3a-4ffa-bb8e-0690287d6575" (UID: "d73e0ff0-cb3a-4ffa-bb8e-0690287d6575"). InnerVolumeSpecName "kube-api-access-jzhk5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:45:43 crc kubenswrapper[5120]: I0316 17:45:43.313817 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jzhk5\" (UniqueName: \"kubernetes.io/projected/d73e0ff0-cb3a-4ffa-bb8e-0690287d6575-kube-api-access-jzhk5\") on node \"crc\" DevicePath \"\"" Mar 16 17:45:43 crc kubenswrapper[5120]: I0316 17:45:43.313861 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l4czp\" (UniqueName: \"kubernetes.io/projected/1d19dbe7-73f4-4077-97ee-309cd5b666af-kube-api-access-l4czp\") on node \"crc\" DevicePath \"\"" Mar 16 17:45:43 crc kubenswrapper[5120]: I0316 17:45:43.806705 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-52c5-account-create-update-kqp9t" Mar 16 17:45:43 crc kubenswrapper[5120]: I0316 17:45:43.806712 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-52c5-account-create-update-kqp9t" event={"ID":"1d19dbe7-73f4-4077-97ee-309cd5b666af","Type":"ContainerDied","Data":"55ab8fbeaffdd11b56de3af335a23edef92bb3676d87be4db381b03a146127f4"} Mar 16 17:45:43 crc kubenswrapper[5120]: I0316 17:45:43.807186 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="55ab8fbeaffdd11b56de3af335a23edef92bb3676d87be4db381b03a146127f4" Mar 16 17:45:43 crc kubenswrapper[5120]: I0316 17:45:43.808748 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-db-create-n6p6w" Mar 16 17:45:43 crc kubenswrapper[5120]: I0316 17:45:43.808787 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-db-create-n6p6w" event={"ID":"d73e0ff0-cb3a-4ffa-bb8e-0690287d6575","Type":"ContainerDied","Data":"2ab07da0480322d96548ce10e5ffdb5b196469de494e28429d9c42c7f5d1f385"} Mar 16 17:45:43 crc kubenswrapper[5120]: I0316 17:45:43.808997 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2ab07da0480322d96548ce10e5ffdb5b196469de494e28429d9c42c7f5d1f385" Mar 16 17:45:46 crc kubenswrapper[5120]: I0316 17:45:46.107366 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keystone-kuttl-tests/keystone-db-sync-mttjs"] Mar 16 17:45:46 crc kubenswrapper[5120]: I0316 17:45:46.108520 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d19dbe7-73f4-4077-97ee-309cd5b666af" containerName="mariadb-account-create-update" Mar 16 17:45:46 crc kubenswrapper[5120]: I0316 17:45:46.108534 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d19dbe7-73f4-4077-97ee-309cd5b666af" containerName="mariadb-account-create-update" Mar 16 17:45:46 crc kubenswrapper[5120]: I0316 17:45:46.108574 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d73e0ff0-cb3a-4ffa-bb8e-0690287d6575" containerName="mariadb-database-create" Mar 16 17:45:46 crc kubenswrapper[5120]: I0316 17:45:46.108582 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="d73e0ff0-cb3a-4ffa-bb8e-0690287d6575" containerName="mariadb-database-create" Mar 16 17:45:46 crc kubenswrapper[5120]: I0316 17:45:46.108885 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="d73e0ff0-cb3a-4ffa-bb8e-0690287d6575" containerName="mariadb-database-create" Mar 16 17:45:46 crc kubenswrapper[5120]: I0316 17:45:46.108901 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1d19dbe7-73f4-4077-97ee-309cd5b666af" containerName="mariadb-account-create-update" Mar 16 17:45:46 crc kubenswrapper[5120]: I0316 17:45:46.119656 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-db-sync-mttjs" Mar 16 17:45:46 crc kubenswrapper[5120]: I0316 17:45:46.122142 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keystone-kuttl-tests\"/\"keystone-scripts\"" Mar 16 17:45:46 crc kubenswrapper[5120]: I0316 17:45:46.122565 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone-db-sync-mttjs"] Mar 16 17:45:46 crc kubenswrapper[5120]: I0316 17:45:46.123648 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keystone-kuttl-tests\"/\"keystone\"" Mar 16 17:45:46 crc kubenswrapper[5120]: I0316 17:45:46.124018 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keystone-kuttl-tests\"/\"keystone-config-data\"" Mar 16 17:45:46 crc kubenswrapper[5120]: I0316 17:45:46.124206 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keystone-kuttl-tests\"/\"keystone-keystone-dockercfg-d5wrr\"" Mar 16 17:45:46 crc kubenswrapper[5120]: I0316 17:45:46.198168 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1f514448-0c9d-4ccd-9cf8-b38fc03e4393-config-data\") pod \"keystone-db-sync-mttjs\" (UID: \"1f514448-0c9d-4ccd-9cf8-b38fc03e4393\") " pod="keystone-kuttl-tests/keystone-db-sync-mttjs" Mar 16 17:45:46 crc kubenswrapper[5120]: I0316 17:45:46.198541 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jr95c\" (UniqueName: \"kubernetes.io/projected/1f514448-0c9d-4ccd-9cf8-b38fc03e4393-kube-api-access-jr95c\") pod \"keystone-db-sync-mttjs\" (UID: \"1f514448-0c9d-4ccd-9cf8-b38fc03e4393\") " pod="keystone-kuttl-tests/keystone-db-sync-mttjs" Mar 16 17:45:46 crc kubenswrapper[5120]: I0316 17:45:46.300620 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1f514448-0c9d-4ccd-9cf8-b38fc03e4393-config-data\") pod \"keystone-db-sync-mttjs\" (UID: \"1f514448-0c9d-4ccd-9cf8-b38fc03e4393\") " pod="keystone-kuttl-tests/keystone-db-sync-mttjs" Mar 16 17:45:46 crc kubenswrapper[5120]: I0316 17:45:46.300684 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jr95c\" (UniqueName: \"kubernetes.io/projected/1f514448-0c9d-4ccd-9cf8-b38fc03e4393-kube-api-access-jr95c\") pod \"keystone-db-sync-mttjs\" (UID: \"1f514448-0c9d-4ccd-9cf8-b38fc03e4393\") " pod="keystone-kuttl-tests/keystone-db-sync-mttjs" Mar 16 17:45:46 crc kubenswrapper[5120]: I0316 17:45:46.315918 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1f514448-0c9d-4ccd-9cf8-b38fc03e4393-config-data\") pod \"keystone-db-sync-mttjs\" (UID: \"1f514448-0c9d-4ccd-9cf8-b38fc03e4393\") " pod="keystone-kuttl-tests/keystone-db-sync-mttjs" Mar 16 17:45:46 crc kubenswrapper[5120]: I0316 17:45:46.318850 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jr95c\" (UniqueName: \"kubernetes.io/projected/1f514448-0c9d-4ccd-9cf8-b38fc03e4393-kube-api-access-jr95c\") pod \"keystone-db-sync-mttjs\" (UID: \"1f514448-0c9d-4ccd-9cf8-b38fc03e4393\") " pod="keystone-kuttl-tests/keystone-db-sync-mttjs" Mar 16 17:45:46 crc kubenswrapper[5120]: I0316 17:45:46.439051 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-db-sync-mttjs" Mar 16 17:45:46 crc kubenswrapper[5120]: I0316 17:45:46.657824 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone-db-sync-mttjs"] Mar 16 17:45:46 crc kubenswrapper[5120]: I0316 17:45:46.832510 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-db-sync-mttjs" event={"ID":"1f514448-0c9d-4ccd-9cf8-b38fc03e4393","Type":"ContainerStarted","Data":"22720df151ee3d089933519bf3bfd061feaac1eaae50af8046ff4442af03cd95"} Mar 16 17:45:46 crc kubenswrapper[5120]: I0316 17:45:46.832558 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-db-sync-mttjs" event={"ID":"1f514448-0c9d-4ccd-9cf8-b38fc03e4393","Type":"ContainerStarted","Data":"4f6e0e76386afa54e3aa889419018064a44c6104467cc4f45d8f58c3dd429daf"} Mar 16 17:45:46 crc kubenswrapper[5120]: I0316 17:45:46.850642 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keystone-kuttl-tests/keystone-db-sync-mttjs" podStartSLOduration=0.850596946 podStartE2EDuration="850.596946ms" podCreationTimestamp="2026-03-16 17:45:46 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:45:46.848017516 +0000 UTC m=+8049.001949193" watchObservedRunningTime="2026-03-16 17:45:46.850596946 +0000 UTC m=+8049.004528613" Mar 16 17:45:48 crc kubenswrapper[5120]: I0316 17:45:48.846671 5120 generic.go:358] "Generic (PLEG): container finished" podID="1f514448-0c9d-4ccd-9cf8-b38fc03e4393" containerID="22720df151ee3d089933519bf3bfd061feaac1eaae50af8046ff4442af03cd95" exitCode=0 Mar 16 17:45:48 crc kubenswrapper[5120]: I0316 17:45:48.846799 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-db-sync-mttjs" event={"ID":"1f514448-0c9d-4ccd-9cf8-b38fc03e4393","Type":"ContainerDied","Data":"22720df151ee3d089933519bf3bfd061feaac1eaae50af8046ff4442af03cd95"} Mar 16 17:45:50 crc kubenswrapper[5120]: I0316 17:45:50.151628 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-db-sync-mttjs" Mar 16 17:45:50 crc kubenswrapper[5120]: I0316 17:45:50.288198 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1f514448-0c9d-4ccd-9cf8-b38fc03e4393-config-data\") pod \"1f514448-0c9d-4ccd-9cf8-b38fc03e4393\" (UID: \"1f514448-0c9d-4ccd-9cf8-b38fc03e4393\") " Mar 16 17:45:50 crc kubenswrapper[5120]: I0316 17:45:50.288558 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jr95c\" (UniqueName: \"kubernetes.io/projected/1f514448-0c9d-4ccd-9cf8-b38fc03e4393-kube-api-access-jr95c\") pod \"1f514448-0c9d-4ccd-9cf8-b38fc03e4393\" (UID: \"1f514448-0c9d-4ccd-9cf8-b38fc03e4393\") " Mar 16 17:45:50 crc kubenswrapper[5120]: I0316 17:45:50.293563 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f514448-0c9d-4ccd-9cf8-b38fc03e4393-kube-api-access-jr95c" (OuterVolumeSpecName: "kube-api-access-jr95c") pod "1f514448-0c9d-4ccd-9cf8-b38fc03e4393" (UID: "1f514448-0c9d-4ccd-9cf8-b38fc03e4393"). InnerVolumeSpecName "kube-api-access-jr95c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:45:50 crc kubenswrapper[5120]: I0316 17:45:50.324716 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f514448-0c9d-4ccd-9cf8-b38fc03e4393-config-data" (OuterVolumeSpecName: "config-data") pod "1f514448-0c9d-4ccd-9cf8-b38fc03e4393" (UID: "1f514448-0c9d-4ccd-9cf8-b38fc03e4393"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:45:50 crc kubenswrapper[5120]: I0316 17:45:50.390979 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1f514448-0c9d-4ccd-9cf8-b38fc03e4393-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:45:50 crc kubenswrapper[5120]: I0316 17:45:50.391018 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jr95c\" (UniqueName: \"kubernetes.io/projected/1f514448-0c9d-4ccd-9cf8-b38fc03e4393-kube-api-access-jr95c\") on node \"crc\" DevicePath \"\"" Mar 16 17:45:50 crc kubenswrapper[5120]: I0316 17:45:50.738961 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keystone-kuttl-tests/keystone-bootstrap-52c2z"] Mar 16 17:45:50 crc kubenswrapper[5120]: I0316 17:45:50.739864 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f514448-0c9d-4ccd-9cf8-b38fc03e4393" containerName="keystone-db-sync" Mar 16 17:45:50 crc kubenswrapper[5120]: I0316 17:45:50.739883 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f514448-0c9d-4ccd-9cf8-b38fc03e4393" containerName="keystone-db-sync" Mar 16 17:45:50 crc kubenswrapper[5120]: I0316 17:45:50.740045 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1f514448-0c9d-4ccd-9cf8-b38fc03e4393" containerName="keystone-db-sync" Mar 16 17:45:50 crc kubenswrapper[5120]: I0316 17:45:50.744474 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-bootstrap-52c2z" Mar 16 17:45:50 crc kubenswrapper[5120]: I0316 17:45:50.750753 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keystone-kuttl-tests\"/\"osp-secret\"" Mar 16 17:45:50 crc kubenswrapper[5120]: I0316 17:45:50.750957 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone-bootstrap-52c2z"] Mar 16 17:45:50 crc kubenswrapper[5120]: I0316 17:45:50.889537 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-db-sync-mttjs" event={"ID":"1f514448-0c9d-4ccd-9cf8-b38fc03e4393","Type":"ContainerDied","Data":"4f6e0e76386afa54e3aa889419018064a44c6104467cc4f45d8f58c3dd429daf"} Mar 16 17:45:50 crc kubenswrapper[5120]: I0316 17:45:50.890137 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4f6e0e76386afa54e3aa889419018064a44c6104467cc4f45d8f58c3dd429daf" Mar 16 17:45:50 crc kubenswrapper[5120]: I0316 17:45:50.889562 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-db-sync-mttjs" Mar 16 17:45:50 crc kubenswrapper[5120]: I0316 17:45:50.904984 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/45d4ec4d-1b52-4e7f-8a46-8df18ced4ea8-credential-keys\") pod \"keystone-bootstrap-52c2z\" (UID: \"45d4ec4d-1b52-4e7f-8a46-8df18ced4ea8\") " pod="keystone-kuttl-tests/keystone-bootstrap-52c2z" Mar 16 17:45:50 crc kubenswrapper[5120]: I0316 17:45:50.905313 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/45d4ec4d-1b52-4e7f-8a46-8df18ced4ea8-scripts\") pod \"keystone-bootstrap-52c2z\" (UID: \"45d4ec4d-1b52-4e7f-8a46-8df18ced4ea8\") " pod="keystone-kuttl-tests/keystone-bootstrap-52c2z" Mar 16 17:45:50 crc kubenswrapper[5120]: I0316 17:45:50.905471 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/45d4ec4d-1b52-4e7f-8a46-8df18ced4ea8-config-data\") pod \"keystone-bootstrap-52c2z\" (UID: \"45d4ec4d-1b52-4e7f-8a46-8df18ced4ea8\") " pod="keystone-kuttl-tests/keystone-bootstrap-52c2z" Mar 16 17:45:50 crc kubenswrapper[5120]: I0316 17:45:50.905602 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/45d4ec4d-1b52-4e7f-8a46-8df18ced4ea8-fernet-keys\") pod \"keystone-bootstrap-52c2z\" (UID: \"45d4ec4d-1b52-4e7f-8a46-8df18ced4ea8\") " pod="keystone-kuttl-tests/keystone-bootstrap-52c2z" Mar 16 17:45:50 crc kubenswrapper[5120]: I0316 17:45:50.905713 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6889n\" (UniqueName: \"kubernetes.io/projected/45d4ec4d-1b52-4e7f-8a46-8df18ced4ea8-kube-api-access-6889n\") pod \"keystone-bootstrap-52c2z\" (UID: \"45d4ec4d-1b52-4e7f-8a46-8df18ced4ea8\") " pod="keystone-kuttl-tests/keystone-bootstrap-52c2z" Mar 16 17:45:51 crc kubenswrapper[5120]: I0316 17:45:51.007799 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/45d4ec4d-1b52-4e7f-8a46-8df18ced4ea8-credential-keys\") pod \"keystone-bootstrap-52c2z\" (UID: \"45d4ec4d-1b52-4e7f-8a46-8df18ced4ea8\") " pod="keystone-kuttl-tests/keystone-bootstrap-52c2z" Mar 16 17:45:51 crc kubenswrapper[5120]: I0316 17:45:51.007945 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/45d4ec4d-1b52-4e7f-8a46-8df18ced4ea8-scripts\") pod \"keystone-bootstrap-52c2z\" (UID: \"45d4ec4d-1b52-4e7f-8a46-8df18ced4ea8\") " pod="keystone-kuttl-tests/keystone-bootstrap-52c2z" Mar 16 17:45:51 crc kubenswrapper[5120]: I0316 17:45:51.008072 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/45d4ec4d-1b52-4e7f-8a46-8df18ced4ea8-config-data\") pod \"keystone-bootstrap-52c2z\" (UID: \"45d4ec4d-1b52-4e7f-8a46-8df18ced4ea8\") " pod="keystone-kuttl-tests/keystone-bootstrap-52c2z" Mar 16 17:45:51 crc kubenswrapper[5120]: I0316 17:45:51.008170 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/45d4ec4d-1b52-4e7f-8a46-8df18ced4ea8-fernet-keys\") pod \"keystone-bootstrap-52c2z\" (UID: \"45d4ec4d-1b52-4e7f-8a46-8df18ced4ea8\") " pod="keystone-kuttl-tests/keystone-bootstrap-52c2z" Mar 16 17:45:51 crc kubenswrapper[5120]: I0316 17:45:51.008243 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6889n\" (UniqueName: \"kubernetes.io/projected/45d4ec4d-1b52-4e7f-8a46-8df18ced4ea8-kube-api-access-6889n\") pod \"keystone-bootstrap-52c2z\" (UID: \"45d4ec4d-1b52-4e7f-8a46-8df18ced4ea8\") " pod="keystone-kuttl-tests/keystone-bootstrap-52c2z" Mar 16 17:45:51 crc kubenswrapper[5120]: I0316 17:45:51.012744 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/45d4ec4d-1b52-4e7f-8a46-8df18ced4ea8-credential-keys\") pod \"keystone-bootstrap-52c2z\" (UID: \"45d4ec4d-1b52-4e7f-8a46-8df18ced4ea8\") " pod="keystone-kuttl-tests/keystone-bootstrap-52c2z" Mar 16 17:45:51 crc kubenswrapper[5120]: I0316 17:45:51.012832 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/45d4ec4d-1b52-4e7f-8a46-8df18ced4ea8-fernet-keys\") pod \"keystone-bootstrap-52c2z\" (UID: \"45d4ec4d-1b52-4e7f-8a46-8df18ced4ea8\") " pod="keystone-kuttl-tests/keystone-bootstrap-52c2z" Mar 16 17:45:51 crc kubenswrapper[5120]: I0316 17:45:51.013499 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/45d4ec4d-1b52-4e7f-8a46-8df18ced4ea8-scripts\") pod \"keystone-bootstrap-52c2z\" (UID: \"45d4ec4d-1b52-4e7f-8a46-8df18ced4ea8\") " pod="keystone-kuttl-tests/keystone-bootstrap-52c2z" Mar 16 17:45:51 crc kubenswrapper[5120]: I0316 17:45:51.013706 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/45d4ec4d-1b52-4e7f-8a46-8df18ced4ea8-config-data\") pod \"keystone-bootstrap-52c2z\" (UID: \"45d4ec4d-1b52-4e7f-8a46-8df18ced4ea8\") " pod="keystone-kuttl-tests/keystone-bootstrap-52c2z" Mar 16 17:45:51 crc kubenswrapper[5120]: I0316 17:45:51.026243 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6889n\" (UniqueName: \"kubernetes.io/projected/45d4ec4d-1b52-4e7f-8a46-8df18ced4ea8-kube-api-access-6889n\") pod \"keystone-bootstrap-52c2z\" (UID: \"45d4ec4d-1b52-4e7f-8a46-8df18ced4ea8\") " pod="keystone-kuttl-tests/keystone-bootstrap-52c2z" Mar 16 17:45:51 crc kubenswrapper[5120]: I0316 17:45:51.066837 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-bootstrap-52c2z" Mar 16 17:45:51 crc kubenswrapper[5120]: I0316 17:45:51.551895 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone-bootstrap-52c2z"] Mar 16 17:45:51 crc kubenswrapper[5120]: I0316 17:45:51.898061 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-bootstrap-52c2z" event={"ID":"45d4ec4d-1b52-4e7f-8a46-8df18ced4ea8","Type":"ContainerStarted","Data":"e45d5dfda4fa10b06a418eca4a71acc6a2caad4c7d17b7168d9c525b164df2a5"} Mar 16 17:45:51 crc kubenswrapper[5120]: I0316 17:45:51.900315 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-bootstrap-52c2z" event={"ID":"45d4ec4d-1b52-4e7f-8a46-8df18ced4ea8","Type":"ContainerStarted","Data":"0685fc2b4ccc7a4ace84b2c55d7906af006122b0e2850560b7df867583f305c7"} Mar 16 17:45:51 crc kubenswrapper[5120]: I0316 17:45:51.923665 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keystone-kuttl-tests/keystone-bootstrap-52c2z" podStartSLOduration=1.923630527 podStartE2EDuration="1.923630527s" podCreationTimestamp="2026-03-16 17:45:50 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:45:51.912455822 +0000 UTC m=+8054.066387479" watchObservedRunningTime="2026-03-16 17:45:51.923630527 +0000 UTC m=+8054.077562184" Mar 16 17:45:54 crc kubenswrapper[5120]: I0316 17:45:54.921156 5120 generic.go:358] "Generic (PLEG): container finished" podID="45d4ec4d-1b52-4e7f-8a46-8df18ced4ea8" containerID="e45d5dfda4fa10b06a418eca4a71acc6a2caad4c7d17b7168d9c525b164df2a5" exitCode=0 Mar 16 17:45:54 crc kubenswrapper[5120]: I0316 17:45:54.921276 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-bootstrap-52c2z" event={"ID":"45d4ec4d-1b52-4e7f-8a46-8df18ced4ea8","Type":"ContainerDied","Data":"e45d5dfda4fa10b06a418eca4a71acc6a2caad4c7d17b7168d9c525b164df2a5"} Mar 16 17:45:56 crc kubenswrapper[5120]: I0316 17:45:56.243666 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-bootstrap-52c2z" Mar 16 17:45:56 crc kubenswrapper[5120]: I0316 17:45:56.349454 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/45d4ec4d-1b52-4e7f-8a46-8df18ced4ea8-config-data\") pod \"45d4ec4d-1b52-4e7f-8a46-8df18ced4ea8\" (UID: \"45d4ec4d-1b52-4e7f-8a46-8df18ced4ea8\") " Mar 16 17:45:56 crc kubenswrapper[5120]: I0316 17:45:56.349536 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6889n\" (UniqueName: \"kubernetes.io/projected/45d4ec4d-1b52-4e7f-8a46-8df18ced4ea8-kube-api-access-6889n\") pod \"45d4ec4d-1b52-4e7f-8a46-8df18ced4ea8\" (UID: \"45d4ec4d-1b52-4e7f-8a46-8df18ced4ea8\") " Mar 16 17:45:56 crc kubenswrapper[5120]: I0316 17:45:56.349587 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/45d4ec4d-1b52-4e7f-8a46-8df18ced4ea8-scripts\") pod \"45d4ec4d-1b52-4e7f-8a46-8df18ced4ea8\" (UID: \"45d4ec4d-1b52-4e7f-8a46-8df18ced4ea8\") " Mar 16 17:45:56 crc kubenswrapper[5120]: I0316 17:45:56.349717 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/45d4ec4d-1b52-4e7f-8a46-8df18ced4ea8-fernet-keys\") pod \"45d4ec4d-1b52-4e7f-8a46-8df18ced4ea8\" (UID: \"45d4ec4d-1b52-4e7f-8a46-8df18ced4ea8\") " Mar 16 17:45:56 crc kubenswrapper[5120]: I0316 17:45:56.350027 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/45d4ec4d-1b52-4e7f-8a46-8df18ced4ea8-credential-keys\") pod \"45d4ec4d-1b52-4e7f-8a46-8df18ced4ea8\" (UID: \"45d4ec4d-1b52-4e7f-8a46-8df18ced4ea8\") " Mar 16 17:45:56 crc kubenswrapper[5120]: I0316 17:45:56.355741 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45d4ec4d-1b52-4e7f-8a46-8df18ced4ea8-scripts" (OuterVolumeSpecName: "scripts") pod "45d4ec4d-1b52-4e7f-8a46-8df18ced4ea8" (UID: "45d4ec4d-1b52-4e7f-8a46-8df18ced4ea8"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:45:56 crc kubenswrapper[5120]: I0316 17:45:56.355973 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45d4ec4d-1b52-4e7f-8a46-8df18ced4ea8-kube-api-access-6889n" (OuterVolumeSpecName: "kube-api-access-6889n") pod "45d4ec4d-1b52-4e7f-8a46-8df18ced4ea8" (UID: "45d4ec4d-1b52-4e7f-8a46-8df18ced4ea8"). InnerVolumeSpecName "kube-api-access-6889n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:45:56 crc kubenswrapper[5120]: I0316 17:45:56.356291 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45d4ec4d-1b52-4e7f-8a46-8df18ced4ea8-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "45d4ec4d-1b52-4e7f-8a46-8df18ced4ea8" (UID: "45d4ec4d-1b52-4e7f-8a46-8df18ced4ea8"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:45:56 crc kubenswrapper[5120]: I0316 17:45:56.370712 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45d4ec4d-1b52-4e7f-8a46-8df18ced4ea8-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "45d4ec4d-1b52-4e7f-8a46-8df18ced4ea8" (UID: "45d4ec4d-1b52-4e7f-8a46-8df18ced4ea8"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:45:56 crc kubenswrapper[5120]: I0316 17:45:56.372909 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45d4ec4d-1b52-4e7f-8a46-8df18ced4ea8-config-data" (OuterVolumeSpecName: "config-data") pod "45d4ec4d-1b52-4e7f-8a46-8df18ced4ea8" (UID: "45d4ec4d-1b52-4e7f-8a46-8df18ced4ea8"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:45:56 crc kubenswrapper[5120]: I0316 17:45:56.453232 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/45d4ec4d-1b52-4e7f-8a46-8df18ced4ea8-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:45:56 crc kubenswrapper[5120]: I0316 17:45:56.453286 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6889n\" (UniqueName: \"kubernetes.io/projected/45d4ec4d-1b52-4e7f-8a46-8df18ced4ea8-kube-api-access-6889n\") on node \"crc\" DevicePath \"\"" Mar 16 17:45:56 crc kubenswrapper[5120]: I0316 17:45:56.453298 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/45d4ec4d-1b52-4e7f-8a46-8df18ced4ea8-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:45:56 crc kubenswrapper[5120]: I0316 17:45:56.453310 5120 reconciler_common.go:299] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/45d4ec4d-1b52-4e7f-8a46-8df18ced4ea8-fernet-keys\") on node \"crc\" DevicePath \"\"" Mar 16 17:45:56 crc kubenswrapper[5120]: I0316 17:45:56.453324 5120 reconciler_common.go:299] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/45d4ec4d-1b52-4e7f-8a46-8df18ced4ea8-credential-keys\") on node \"crc\" DevicePath \"\"" Mar 16 17:45:56 crc kubenswrapper[5120]: I0316 17:45:56.940523 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-bootstrap-52c2z" event={"ID":"45d4ec4d-1b52-4e7f-8a46-8df18ced4ea8","Type":"ContainerDied","Data":"0685fc2b4ccc7a4ace84b2c55d7906af006122b0e2850560b7df867583f305c7"} Mar 16 17:45:56 crc kubenswrapper[5120]: I0316 17:45:56.941053 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0685fc2b4ccc7a4ace84b2c55d7906af006122b0e2850560b7df867583f305c7" Mar 16 17:45:56 crc kubenswrapper[5120]: I0316 17:45:56.940644 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-bootstrap-52c2z" Mar 16 17:45:57 crc kubenswrapper[5120]: I0316 17:45:57.117235 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keystone-kuttl-tests/keystone-6b4b68f549-phd7r"] Mar 16 17:45:57 crc kubenswrapper[5120]: I0316 17:45:57.118221 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45d4ec4d-1b52-4e7f-8a46-8df18ced4ea8" containerName="keystone-bootstrap" Mar 16 17:45:57 crc kubenswrapper[5120]: I0316 17:45:57.118247 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="45d4ec4d-1b52-4e7f-8a46-8df18ced4ea8" containerName="keystone-bootstrap" Mar 16 17:45:57 crc kubenswrapper[5120]: I0316 17:45:57.118475 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="45d4ec4d-1b52-4e7f-8a46-8df18ced4ea8" containerName="keystone-bootstrap" Mar 16 17:45:57 crc kubenswrapper[5120]: I0316 17:45:57.122992 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-6b4b68f549-phd7r" Mar 16 17:45:57 crc kubenswrapper[5120]: I0316 17:45:57.125731 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone-6b4b68f549-phd7r"] Mar 16 17:45:57 crc kubenswrapper[5120]: I0316 17:45:57.128723 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keystone-kuttl-tests\"/\"keystone-keystone-dockercfg-d5wrr\"" Mar 16 17:45:57 crc kubenswrapper[5120]: I0316 17:45:57.129008 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keystone-kuttl-tests\"/\"keystone-config-data\"" Mar 16 17:45:57 crc kubenswrapper[5120]: I0316 17:45:57.129169 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keystone-kuttl-tests\"/\"keystone-scripts\"" Mar 16 17:45:57 crc kubenswrapper[5120]: I0316 17:45:57.129336 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keystone-kuttl-tests\"/\"keystone\"" Mar 16 17:45:57 crc kubenswrapper[5120]: I0316 17:45:57.273320 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/94cd7437-3727-4e04-b9a1-12f34e7f9c0f-scripts\") pod \"keystone-6b4b68f549-phd7r\" (UID: \"94cd7437-3727-4e04-b9a1-12f34e7f9c0f\") " pod="keystone-kuttl-tests/keystone-6b4b68f549-phd7r" Mar 16 17:45:57 crc kubenswrapper[5120]: I0316 17:45:57.273720 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/94cd7437-3727-4e04-b9a1-12f34e7f9c0f-config-data\") pod \"keystone-6b4b68f549-phd7r\" (UID: \"94cd7437-3727-4e04-b9a1-12f34e7f9c0f\") " pod="keystone-kuttl-tests/keystone-6b4b68f549-phd7r" Mar 16 17:45:57 crc kubenswrapper[5120]: I0316 17:45:57.273812 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/94cd7437-3727-4e04-b9a1-12f34e7f9c0f-fernet-keys\") pod \"keystone-6b4b68f549-phd7r\" (UID: \"94cd7437-3727-4e04-b9a1-12f34e7f9c0f\") " pod="keystone-kuttl-tests/keystone-6b4b68f549-phd7r" Mar 16 17:45:57 crc kubenswrapper[5120]: I0316 17:45:57.274013 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8htfc\" (UniqueName: \"kubernetes.io/projected/94cd7437-3727-4e04-b9a1-12f34e7f9c0f-kube-api-access-8htfc\") pod \"keystone-6b4b68f549-phd7r\" (UID: \"94cd7437-3727-4e04-b9a1-12f34e7f9c0f\") " pod="keystone-kuttl-tests/keystone-6b4b68f549-phd7r" Mar 16 17:45:57 crc kubenswrapper[5120]: I0316 17:45:57.274118 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/94cd7437-3727-4e04-b9a1-12f34e7f9c0f-credential-keys\") pod \"keystone-6b4b68f549-phd7r\" (UID: \"94cd7437-3727-4e04-b9a1-12f34e7f9c0f\") " pod="keystone-kuttl-tests/keystone-6b4b68f549-phd7r" Mar 16 17:45:57 crc kubenswrapper[5120]: I0316 17:45:57.375991 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/94cd7437-3727-4e04-b9a1-12f34e7f9c0f-scripts\") pod \"keystone-6b4b68f549-phd7r\" (UID: \"94cd7437-3727-4e04-b9a1-12f34e7f9c0f\") " pod="keystone-kuttl-tests/keystone-6b4b68f549-phd7r" Mar 16 17:45:57 crc kubenswrapper[5120]: I0316 17:45:57.376173 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/94cd7437-3727-4e04-b9a1-12f34e7f9c0f-config-data\") pod \"keystone-6b4b68f549-phd7r\" (UID: \"94cd7437-3727-4e04-b9a1-12f34e7f9c0f\") " pod="keystone-kuttl-tests/keystone-6b4b68f549-phd7r" Mar 16 17:45:57 crc kubenswrapper[5120]: I0316 17:45:57.376239 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/94cd7437-3727-4e04-b9a1-12f34e7f9c0f-fernet-keys\") pod \"keystone-6b4b68f549-phd7r\" (UID: \"94cd7437-3727-4e04-b9a1-12f34e7f9c0f\") " pod="keystone-kuttl-tests/keystone-6b4b68f549-phd7r" Mar 16 17:45:57 crc kubenswrapper[5120]: I0316 17:45:57.376302 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8htfc\" (UniqueName: \"kubernetes.io/projected/94cd7437-3727-4e04-b9a1-12f34e7f9c0f-kube-api-access-8htfc\") pod \"keystone-6b4b68f549-phd7r\" (UID: \"94cd7437-3727-4e04-b9a1-12f34e7f9c0f\") " pod="keystone-kuttl-tests/keystone-6b4b68f549-phd7r" Mar 16 17:45:57 crc kubenswrapper[5120]: I0316 17:45:57.376345 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/94cd7437-3727-4e04-b9a1-12f34e7f9c0f-credential-keys\") pod \"keystone-6b4b68f549-phd7r\" (UID: \"94cd7437-3727-4e04-b9a1-12f34e7f9c0f\") " pod="keystone-kuttl-tests/keystone-6b4b68f549-phd7r" Mar 16 17:45:57 crc kubenswrapper[5120]: I0316 17:45:57.380704 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/94cd7437-3727-4e04-b9a1-12f34e7f9c0f-scripts\") pod \"keystone-6b4b68f549-phd7r\" (UID: \"94cd7437-3727-4e04-b9a1-12f34e7f9c0f\") " pod="keystone-kuttl-tests/keystone-6b4b68f549-phd7r" Mar 16 17:45:57 crc kubenswrapper[5120]: I0316 17:45:57.380927 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/94cd7437-3727-4e04-b9a1-12f34e7f9c0f-credential-keys\") pod \"keystone-6b4b68f549-phd7r\" (UID: \"94cd7437-3727-4e04-b9a1-12f34e7f9c0f\") " pod="keystone-kuttl-tests/keystone-6b4b68f549-phd7r" Mar 16 17:45:57 crc kubenswrapper[5120]: I0316 17:45:57.381639 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/94cd7437-3727-4e04-b9a1-12f34e7f9c0f-fernet-keys\") pod \"keystone-6b4b68f549-phd7r\" (UID: \"94cd7437-3727-4e04-b9a1-12f34e7f9c0f\") " pod="keystone-kuttl-tests/keystone-6b4b68f549-phd7r" Mar 16 17:45:57 crc kubenswrapper[5120]: I0316 17:45:57.386610 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/94cd7437-3727-4e04-b9a1-12f34e7f9c0f-config-data\") pod \"keystone-6b4b68f549-phd7r\" (UID: \"94cd7437-3727-4e04-b9a1-12f34e7f9c0f\") " pod="keystone-kuttl-tests/keystone-6b4b68f549-phd7r" Mar 16 17:45:57 crc kubenswrapper[5120]: I0316 17:45:57.398416 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8htfc\" (UniqueName: \"kubernetes.io/projected/94cd7437-3727-4e04-b9a1-12f34e7f9c0f-kube-api-access-8htfc\") pod \"keystone-6b4b68f549-phd7r\" (UID: \"94cd7437-3727-4e04-b9a1-12f34e7f9c0f\") " pod="keystone-kuttl-tests/keystone-6b4b68f549-phd7r" Mar 16 17:45:57 crc kubenswrapper[5120]: I0316 17:45:57.446558 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-6b4b68f549-phd7r" Mar 16 17:45:57 crc kubenswrapper[5120]: I0316 17:45:57.845557 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone-6b4b68f549-phd7r"] Mar 16 17:45:57 crc kubenswrapper[5120]: I0316 17:45:57.962248 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-6b4b68f549-phd7r" event={"ID":"94cd7437-3727-4e04-b9a1-12f34e7f9c0f","Type":"ContainerStarted","Data":"83cbe91f164a208b76874e40f4ceeb185ce75321a6589b5a8d5992b3fd8150ca"} Mar 16 17:45:58 crc kubenswrapper[5120]: I0316 17:45:58.971193 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-6b4b68f549-phd7r" event={"ID":"94cd7437-3727-4e04-b9a1-12f34e7f9c0f","Type":"ContainerStarted","Data":"41aa1e61d02438537a96182eea75c6babeb83c4139e9d06b411699d0b04d5578"} Mar 16 17:45:58 crc kubenswrapper[5120]: I0316 17:45:58.972583 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keystone-kuttl-tests/keystone-6b4b68f549-phd7r" Mar 16 17:45:58 crc kubenswrapper[5120]: I0316 17:45:58.996482 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keystone-kuttl-tests/keystone-6b4b68f549-phd7r" podStartSLOduration=1.996452969 podStartE2EDuration="1.996452969s" podCreationTimestamp="2026-03-16 17:45:57 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:45:58.985564871 +0000 UTC m=+8061.139496548" watchObservedRunningTime="2026-03-16 17:45:58.996452969 +0000 UTC m=+8061.150384656" Mar 16 17:46:00 crc kubenswrapper[5120]: I0316 17:46:00.128837 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-infra/auto-csr-approver-29561386-lgzbr"] Mar 16 17:46:00 crc kubenswrapper[5120]: I0316 17:46:00.133464 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561386-lgzbr" Mar 16 17:46:00 crc kubenswrapper[5120]: I0316 17:46:00.136361 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"kube-root-ca.crt\"" Mar 16 17:46:00 crc kubenswrapper[5120]: I0316 17:46:00.137160 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561386-lgzbr"] Mar 16 17:46:00 crc kubenswrapper[5120]: I0316 17:46:00.137726 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-infra\"/\"csr-approver-sa-dockercfg-x2nsz\"" Mar 16 17:46:00 crc kubenswrapper[5120]: I0316 17:46:00.137867 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"openshift-service-ca.crt\"" Mar 16 17:46:00 crc kubenswrapper[5120]: I0316 17:46:00.246157 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xfwk\" (UniqueName: \"kubernetes.io/projected/3a016656-d56d-4bf2-980e-aee5bbd2018b-kube-api-access-8xfwk\") pod \"auto-csr-approver-29561386-lgzbr\" (UID: \"3a016656-d56d-4bf2-980e-aee5bbd2018b\") " pod="openshift-infra/auto-csr-approver-29561386-lgzbr" Mar 16 17:46:00 crc kubenswrapper[5120]: I0316 17:46:00.348040 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8xfwk\" (UniqueName: \"kubernetes.io/projected/3a016656-d56d-4bf2-980e-aee5bbd2018b-kube-api-access-8xfwk\") pod \"auto-csr-approver-29561386-lgzbr\" (UID: \"3a016656-d56d-4bf2-980e-aee5bbd2018b\") " pod="openshift-infra/auto-csr-approver-29561386-lgzbr" Mar 16 17:46:00 crc kubenswrapper[5120]: I0316 17:46:00.371793 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xfwk\" (UniqueName: \"kubernetes.io/projected/3a016656-d56d-4bf2-980e-aee5bbd2018b-kube-api-access-8xfwk\") pod \"auto-csr-approver-29561386-lgzbr\" (UID: \"3a016656-d56d-4bf2-980e-aee5bbd2018b\") " pod="openshift-infra/auto-csr-approver-29561386-lgzbr" Mar 16 17:46:00 crc kubenswrapper[5120]: I0316 17:46:00.459260 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561386-lgzbr" Mar 16 17:46:00 crc kubenswrapper[5120]: W0316 17:46:00.903861 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3a016656_d56d_4bf2_980e_aee5bbd2018b.slice/crio-f36916b382568af0438d93e214afb11c44dee1840141b2992a60664eb3a229c8 WatchSource:0}: Error finding container f36916b382568af0438d93e214afb11c44dee1840141b2992a60664eb3a229c8: Status 404 returned error can't find the container with id f36916b382568af0438d93e214afb11c44dee1840141b2992a60664eb3a229c8 Mar 16 17:46:00 crc kubenswrapper[5120]: I0316 17:46:00.905074 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561386-lgzbr"] Mar 16 17:46:00 crc kubenswrapper[5120]: I0316 17:46:00.987791 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561386-lgzbr" event={"ID":"3a016656-d56d-4bf2-980e-aee5bbd2018b","Type":"ContainerStarted","Data":"f36916b382568af0438d93e214afb11c44dee1840141b2992a60664eb3a229c8"} Mar 16 17:46:03 crc kubenswrapper[5120]: I0316 17:46:03.008445 5120 generic.go:358] "Generic (PLEG): container finished" podID="3a016656-d56d-4bf2-980e-aee5bbd2018b" containerID="9b3c6b28358c8b7bfe2faf9acbdf6e84c580fe14dd75cd03de45d11c87afb71c" exitCode=0 Mar 16 17:46:03 crc kubenswrapper[5120]: I0316 17:46:03.008539 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561386-lgzbr" event={"ID":"3a016656-d56d-4bf2-980e-aee5bbd2018b","Type":"ContainerDied","Data":"9b3c6b28358c8b7bfe2faf9acbdf6e84c580fe14dd75cd03de45d11c87afb71c"} Mar 16 17:46:04 crc kubenswrapper[5120]: I0316 17:46:04.372719 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561386-lgzbr" Mar 16 17:46:04 crc kubenswrapper[5120]: I0316 17:46:04.444292 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8xfwk\" (UniqueName: \"kubernetes.io/projected/3a016656-d56d-4bf2-980e-aee5bbd2018b-kube-api-access-8xfwk\") pod \"3a016656-d56d-4bf2-980e-aee5bbd2018b\" (UID: \"3a016656-d56d-4bf2-980e-aee5bbd2018b\") " Mar 16 17:46:04 crc kubenswrapper[5120]: I0316 17:46:04.452438 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a016656-d56d-4bf2-980e-aee5bbd2018b-kube-api-access-8xfwk" (OuterVolumeSpecName: "kube-api-access-8xfwk") pod "3a016656-d56d-4bf2-980e-aee5bbd2018b" (UID: "3a016656-d56d-4bf2-980e-aee5bbd2018b"). InnerVolumeSpecName "kube-api-access-8xfwk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:46:04 crc kubenswrapper[5120]: I0316 17:46:04.547029 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8xfwk\" (UniqueName: \"kubernetes.io/projected/3a016656-d56d-4bf2-980e-aee5bbd2018b-kube-api-access-8xfwk\") on node \"crc\" DevicePath \"\"" Mar 16 17:46:05 crc kubenswrapper[5120]: I0316 17:46:05.030406 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561386-lgzbr" Mar 16 17:46:05 crc kubenswrapper[5120]: I0316 17:46:05.030450 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561386-lgzbr" event={"ID":"3a016656-d56d-4bf2-980e-aee5bbd2018b","Type":"ContainerDied","Data":"f36916b382568af0438d93e214afb11c44dee1840141b2992a60664eb3a229c8"} Mar 16 17:46:05 crc kubenswrapper[5120]: I0316 17:46:05.030489 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f36916b382568af0438d93e214afb11c44dee1840141b2992a60664eb3a229c8" Mar 16 17:46:05 crc kubenswrapper[5120]: I0316 17:46:05.434835 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-infra/auto-csr-approver-29561380-d5x9f"] Mar 16 17:46:05 crc kubenswrapper[5120]: I0316 17:46:05.440107 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-infra/auto-csr-approver-29561380-d5x9f"] Mar 16 17:46:06 crc kubenswrapper[5120]: I0316 17:46:06.673430 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c3bf94ae-a70e-49a9-8bfd-70c338d7bd87" path="/var/lib/kubelet/pods/c3bf94ae-a70e-49a9-8bfd-70c338d7bd87/volumes" Mar 16 17:46:07 crc kubenswrapper[5120]: E0316 17:46:07.321130 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1109843 actualBytes=10240 Mar 16 17:46:31 crc kubenswrapper[5120]: I0316 17:46:31.341205 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="keystone-kuttl-tests/keystone-6b4b68f549-phd7r" Mar 16 17:46:32 crc kubenswrapper[5120]: I0316 17:46:32.812092 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keystone-kuttl-tests/keystone-6b4b68f549-zptn8"] Mar 16 17:46:32 crc kubenswrapper[5120]: I0316 17:46:32.813409 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a016656-d56d-4bf2-980e-aee5bbd2018b" containerName="oc" Mar 16 17:46:32 crc kubenswrapper[5120]: I0316 17:46:32.813431 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a016656-d56d-4bf2-980e-aee5bbd2018b" containerName="oc" Mar 16 17:46:32 crc kubenswrapper[5120]: I0316 17:46:32.813582 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="3a016656-d56d-4bf2-980e-aee5bbd2018b" containerName="oc" Mar 16 17:46:32 crc kubenswrapper[5120]: I0316 17:46:32.819388 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-6b4b68f549-zptn8" Mar 16 17:46:32 crc kubenswrapper[5120]: I0316 17:46:32.829162 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keystone-kuttl-tests/keystone-6b4b68f549-s4ws9"] Mar 16 17:46:32 crc kubenswrapper[5120]: I0316 17:46:32.835985 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-6b4b68f549-s4ws9" Mar 16 17:46:32 crc kubenswrapper[5120]: I0316 17:46:32.843927 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone-6b4b68f549-zptn8"] Mar 16 17:46:32 crc kubenswrapper[5120]: I0316 17:46:32.857996 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone-6b4b68f549-s4ws9"] Mar 16 17:46:32 crc kubenswrapper[5120]: I0316 17:46:32.947470 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxvw4\" (UniqueName: \"kubernetes.io/projected/06d409cc-cde1-4f9c-99e4-1d798d7e5790-kube-api-access-cxvw4\") pod \"keystone-6b4b68f549-s4ws9\" (UID: \"06d409cc-cde1-4f9c-99e4-1d798d7e5790\") " pod="keystone-kuttl-tests/keystone-6b4b68f549-s4ws9" Mar 16 17:46:32 crc kubenswrapper[5120]: I0316 17:46:32.947551 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/06d409cc-cde1-4f9c-99e4-1d798d7e5790-credential-keys\") pod \"keystone-6b4b68f549-s4ws9\" (UID: \"06d409cc-cde1-4f9c-99e4-1d798d7e5790\") " pod="keystone-kuttl-tests/keystone-6b4b68f549-s4ws9" Mar 16 17:46:32 crc kubenswrapper[5120]: I0316 17:46:32.947662 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/06d409cc-cde1-4f9c-99e4-1d798d7e5790-config-data\") pod \"keystone-6b4b68f549-s4ws9\" (UID: \"06d409cc-cde1-4f9c-99e4-1d798d7e5790\") " pod="keystone-kuttl-tests/keystone-6b4b68f549-s4ws9" Mar 16 17:46:32 crc kubenswrapper[5120]: I0316 17:46:32.947779 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/83c0c590-4a3d-42d6-ba82-2494c3c817e9-credential-keys\") pod \"keystone-6b4b68f549-zptn8\" (UID: \"83c0c590-4a3d-42d6-ba82-2494c3c817e9\") " pod="keystone-kuttl-tests/keystone-6b4b68f549-zptn8" Mar 16 17:46:32 crc kubenswrapper[5120]: I0316 17:46:32.947839 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxg9k\" (UniqueName: \"kubernetes.io/projected/83c0c590-4a3d-42d6-ba82-2494c3c817e9-kube-api-access-qxg9k\") pod \"keystone-6b4b68f549-zptn8\" (UID: \"83c0c590-4a3d-42d6-ba82-2494c3c817e9\") " pod="keystone-kuttl-tests/keystone-6b4b68f549-zptn8" Mar 16 17:46:32 crc kubenswrapper[5120]: I0316 17:46:32.947870 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/06d409cc-cde1-4f9c-99e4-1d798d7e5790-scripts\") pod \"keystone-6b4b68f549-s4ws9\" (UID: \"06d409cc-cde1-4f9c-99e4-1d798d7e5790\") " pod="keystone-kuttl-tests/keystone-6b4b68f549-s4ws9" Mar 16 17:46:32 crc kubenswrapper[5120]: I0316 17:46:32.947888 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/83c0c590-4a3d-42d6-ba82-2494c3c817e9-fernet-keys\") pod \"keystone-6b4b68f549-zptn8\" (UID: \"83c0c590-4a3d-42d6-ba82-2494c3c817e9\") " pod="keystone-kuttl-tests/keystone-6b4b68f549-zptn8" Mar 16 17:46:32 crc kubenswrapper[5120]: I0316 17:46:32.947911 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/83c0c590-4a3d-42d6-ba82-2494c3c817e9-scripts\") pod \"keystone-6b4b68f549-zptn8\" (UID: \"83c0c590-4a3d-42d6-ba82-2494c3c817e9\") " pod="keystone-kuttl-tests/keystone-6b4b68f549-zptn8" Mar 16 17:46:32 crc kubenswrapper[5120]: I0316 17:46:32.948107 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/06d409cc-cde1-4f9c-99e4-1d798d7e5790-fernet-keys\") pod \"keystone-6b4b68f549-s4ws9\" (UID: \"06d409cc-cde1-4f9c-99e4-1d798d7e5790\") " pod="keystone-kuttl-tests/keystone-6b4b68f549-s4ws9" Mar 16 17:46:32 crc kubenswrapper[5120]: I0316 17:46:32.948301 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/83c0c590-4a3d-42d6-ba82-2494c3c817e9-config-data\") pod \"keystone-6b4b68f549-zptn8\" (UID: \"83c0c590-4a3d-42d6-ba82-2494c3c817e9\") " pod="keystone-kuttl-tests/keystone-6b4b68f549-zptn8" Mar 16 17:46:33 crc kubenswrapper[5120]: I0316 17:46:33.049569 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cxvw4\" (UniqueName: \"kubernetes.io/projected/06d409cc-cde1-4f9c-99e4-1d798d7e5790-kube-api-access-cxvw4\") pod \"keystone-6b4b68f549-s4ws9\" (UID: \"06d409cc-cde1-4f9c-99e4-1d798d7e5790\") " pod="keystone-kuttl-tests/keystone-6b4b68f549-s4ws9" Mar 16 17:46:33 crc kubenswrapper[5120]: I0316 17:46:33.049641 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/06d409cc-cde1-4f9c-99e4-1d798d7e5790-credential-keys\") pod \"keystone-6b4b68f549-s4ws9\" (UID: \"06d409cc-cde1-4f9c-99e4-1d798d7e5790\") " pod="keystone-kuttl-tests/keystone-6b4b68f549-s4ws9" Mar 16 17:46:33 crc kubenswrapper[5120]: I0316 17:46:33.049677 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/06d409cc-cde1-4f9c-99e4-1d798d7e5790-config-data\") pod \"keystone-6b4b68f549-s4ws9\" (UID: \"06d409cc-cde1-4f9c-99e4-1d798d7e5790\") " pod="keystone-kuttl-tests/keystone-6b4b68f549-s4ws9" Mar 16 17:46:33 crc kubenswrapper[5120]: I0316 17:46:33.049717 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/83c0c590-4a3d-42d6-ba82-2494c3c817e9-credential-keys\") pod \"keystone-6b4b68f549-zptn8\" (UID: \"83c0c590-4a3d-42d6-ba82-2494c3c817e9\") " pod="keystone-kuttl-tests/keystone-6b4b68f549-zptn8" Mar 16 17:46:33 crc kubenswrapper[5120]: I0316 17:46:33.049789 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qxg9k\" (UniqueName: \"kubernetes.io/projected/83c0c590-4a3d-42d6-ba82-2494c3c817e9-kube-api-access-qxg9k\") pod \"keystone-6b4b68f549-zptn8\" (UID: \"83c0c590-4a3d-42d6-ba82-2494c3c817e9\") " pod="keystone-kuttl-tests/keystone-6b4b68f549-zptn8" Mar 16 17:46:33 crc kubenswrapper[5120]: I0316 17:46:33.050561 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/06d409cc-cde1-4f9c-99e4-1d798d7e5790-scripts\") pod \"keystone-6b4b68f549-s4ws9\" (UID: \"06d409cc-cde1-4f9c-99e4-1d798d7e5790\") " pod="keystone-kuttl-tests/keystone-6b4b68f549-s4ws9" Mar 16 17:46:33 crc kubenswrapper[5120]: I0316 17:46:33.050595 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/83c0c590-4a3d-42d6-ba82-2494c3c817e9-fernet-keys\") pod \"keystone-6b4b68f549-zptn8\" (UID: \"83c0c590-4a3d-42d6-ba82-2494c3c817e9\") " pod="keystone-kuttl-tests/keystone-6b4b68f549-zptn8" Mar 16 17:46:33 crc kubenswrapper[5120]: I0316 17:46:33.050634 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/83c0c590-4a3d-42d6-ba82-2494c3c817e9-scripts\") pod \"keystone-6b4b68f549-zptn8\" (UID: \"83c0c590-4a3d-42d6-ba82-2494c3c817e9\") " pod="keystone-kuttl-tests/keystone-6b4b68f549-zptn8" Mar 16 17:46:33 crc kubenswrapper[5120]: I0316 17:46:33.050680 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/06d409cc-cde1-4f9c-99e4-1d798d7e5790-fernet-keys\") pod \"keystone-6b4b68f549-s4ws9\" (UID: \"06d409cc-cde1-4f9c-99e4-1d798d7e5790\") " pod="keystone-kuttl-tests/keystone-6b4b68f549-s4ws9" Mar 16 17:46:33 crc kubenswrapper[5120]: I0316 17:46:33.050797 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/83c0c590-4a3d-42d6-ba82-2494c3c817e9-config-data\") pod \"keystone-6b4b68f549-zptn8\" (UID: \"83c0c590-4a3d-42d6-ba82-2494c3c817e9\") " pod="keystone-kuttl-tests/keystone-6b4b68f549-zptn8" Mar 16 17:46:33 crc kubenswrapper[5120]: I0316 17:46:33.056357 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/83c0c590-4a3d-42d6-ba82-2494c3c817e9-credential-keys\") pod \"keystone-6b4b68f549-zptn8\" (UID: \"83c0c590-4a3d-42d6-ba82-2494c3c817e9\") " pod="keystone-kuttl-tests/keystone-6b4b68f549-zptn8" Mar 16 17:46:33 crc kubenswrapper[5120]: I0316 17:46:33.056562 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/06d409cc-cde1-4f9c-99e4-1d798d7e5790-credential-keys\") pod \"keystone-6b4b68f549-s4ws9\" (UID: \"06d409cc-cde1-4f9c-99e4-1d798d7e5790\") " pod="keystone-kuttl-tests/keystone-6b4b68f549-s4ws9" Mar 16 17:46:33 crc kubenswrapper[5120]: I0316 17:46:33.057381 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/83c0c590-4a3d-42d6-ba82-2494c3c817e9-scripts\") pod \"keystone-6b4b68f549-zptn8\" (UID: \"83c0c590-4a3d-42d6-ba82-2494c3c817e9\") " pod="keystone-kuttl-tests/keystone-6b4b68f549-zptn8" Mar 16 17:46:33 crc kubenswrapper[5120]: I0316 17:46:33.058472 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/83c0c590-4a3d-42d6-ba82-2494c3c817e9-config-data\") pod \"keystone-6b4b68f549-zptn8\" (UID: \"83c0c590-4a3d-42d6-ba82-2494c3c817e9\") " pod="keystone-kuttl-tests/keystone-6b4b68f549-zptn8" Mar 16 17:46:33 crc kubenswrapper[5120]: I0316 17:46:33.059589 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/83c0c590-4a3d-42d6-ba82-2494c3c817e9-fernet-keys\") pod \"keystone-6b4b68f549-zptn8\" (UID: \"83c0c590-4a3d-42d6-ba82-2494c3c817e9\") " pod="keystone-kuttl-tests/keystone-6b4b68f549-zptn8" Mar 16 17:46:33 crc kubenswrapper[5120]: I0316 17:46:33.064183 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/06d409cc-cde1-4f9c-99e4-1d798d7e5790-scripts\") pod \"keystone-6b4b68f549-s4ws9\" (UID: \"06d409cc-cde1-4f9c-99e4-1d798d7e5790\") " pod="keystone-kuttl-tests/keystone-6b4b68f549-s4ws9" Mar 16 17:46:33 crc kubenswrapper[5120]: I0316 17:46:33.068308 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/06d409cc-cde1-4f9c-99e4-1d798d7e5790-fernet-keys\") pod \"keystone-6b4b68f549-s4ws9\" (UID: \"06d409cc-cde1-4f9c-99e4-1d798d7e5790\") " pod="keystone-kuttl-tests/keystone-6b4b68f549-s4ws9" Mar 16 17:46:33 crc kubenswrapper[5120]: I0316 17:46:33.068780 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/06d409cc-cde1-4f9c-99e4-1d798d7e5790-config-data\") pod \"keystone-6b4b68f549-s4ws9\" (UID: \"06d409cc-cde1-4f9c-99e4-1d798d7e5790\") " pod="keystone-kuttl-tests/keystone-6b4b68f549-s4ws9" Mar 16 17:46:33 crc kubenswrapper[5120]: I0316 17:46:33.070011 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxg9k\" (UniqueName: \"kubernetes.io/projected/83c0c590-4a3d-42d6-ba82-2494c3c817e9-kube-api-access-qxg9k\") pod \"keystone-6b4b68f549-zptn8\" (UID: \"83c0c590-4a3d-42d6-ba82-2494c3c817e9\") " pod="keystone-kuttl-tests/keystone-6b4b68f549-zptn8" Mar 16 17:46:33 crc kubenswrapper[5120]: I0316 17:46:33.075109 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxvw4\" (UniqueName: \"kubernetes.io/projected/06d409cc-cde1-4f9c-99e4-1d798d7e5790-kube-api-access-cxvw4\") pod \"keystone-6b4b68f549-s4ws9\" (UID: \"06d409cc-cde1-4f9c-99e4-1d798d7e5790\") " pod="keystone-kuttl-tests/keystone-6b4b68f549-s4ws9" Mar 16 17:46:33 crc kubenswrapper[5120]: I0316 17:46:33.146024 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-6b4b68f549-zptn8" Mar 16 17:46:33 crc kubenswrapper[5120]: I0316 17:46:33.165477 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-6b4b68f549-s4ws9" Mar 16 17:46:33 crc kubenswrapper[5120]: I0316 17:46:33.346484 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone-6b4b68f549-zptn8"] Mar 16 17:46:33 crc kubenswrapper[5120]: I0316 17:46:33.410116 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone-6b4b68f549-s4ws9"] Mar 16 17:46:33 crc kubenswrapper[5120]: W0316 17:46:33.411893 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06d409cc_cde1_4f9c_99e4_1d798d7e5790.slice/crio-dc36f9175befe3e8d3f8724928c4ca7ee4aaa7cde210bf4ab472617f5868cef0 WatchSource:0}: Error finding container dc36f9175befe3e8d3f8724928c4ca7ee4aaa7cde210bf4ab472617f5868cef0: Status 404 returned error can't find the container with id dc36f9175befe3e8d3f8724928c4ca7ee4aaa7cde210bf4ab472617f5868cef0 Mar 16 17:46:34 crc kubenswrapper[5120]: I0316 17:46:34.301734 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-6b4b68f549-zptn8" event={"ID":"83c0c590-4a3d-42d6-ba82-2494c3c817e9","Type":"ContainerStarted","Data":"52b5e3bb5441fb2d26b576edd1105850912a664530c0eef15ee1d3f0ea6b83d2"} Mar 16 17:46:34 crc kubenswrapper[5120]: I0316 17:46:34.302167 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keystone-kuttl-tests/keystone-6b4b68f549-zptn8" Mar 16 17:46:34 crc kubenswrapper[5120]: I0316 17:46:34.302189 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-6b4b68f549-zptn8" event={"ID":"83c0c590-4a3d-42d6-ba82-2494c3c817e9","Type":"ContainerStarted","Data":"6862716d0d2af5b078a90278abcc896e7f622203b11343cf8de74b79d2287304"} Mar 16 17:46:34 crc kubenswrapper[5120]: I0316 17:46:34.303660 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-6b4b68f549-s4ws9" event={"ID":"06d409cc-cde1-4f9c-99e4-1d798d7e5790","Type":"ContainerStarted","Data":"f0ec56b0d6245dd0ea928537ff33c984b0e0d8dfa42db671327f018a051c3b04"} Mar 16 17:46:34 crc kubenswrapper[5120]: I0316 17:46:34.303688 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-6b4b68f549-s4ws9" event={"ID":"06d409cc-cde1-4f9c-99e4-1d798d7e5790","Type":"ContainerStarted","Data":"dc36f9175befe3e8d3f8724928c4ca7ee4aaa7cde210bf4ab472617f5868cef0"} Mar 16 17:46:34 crc kubenswrapper[5120]: I0316 17:46:34.303939 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keystone-kuttl-tests/keystone-6b4b68f549-s4ws9" Mar 16 17:46:34 crc kubenswrapper[5120]: I0316 17:46:34.328119 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keystone-kuttl-tests/keystone-6b4b68f549-zptn8" podStartSLOduration=2.328093465 podStartE2EDuration="2.328093465s" podCreationTimestamp="2026-03-16 17:46:32 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:46:34.317248679 +0000 UTC m=+8096.471180336" watchObservedRunningTime="2026-03-16 17:46:34.328093465 +0000 UTC m=+8096.482025122" Mar 16 17:46:34 crc kubenswrapper[5120]: I0316 17:46:34.333494 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keystone-kuttl-tests/keystone-6b4b68f549-s4ws9" podStartSLOduration=2.333476643 podStartE2EDuration="2.333476643s" podCreationTimestamp="2026-03-16 17:46:32 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:46:34.330179653 +0000 UTC m=+8096.484111310" watchObservedRunningTime="2026-03-16 17:46:34.333476643 +0000 UTC m=+8096.487408300" Mar 16 17:46:35 crc kubenswrapper[5120]: I0316 17:46:35.211380 5120 scope.go:117] "RemoveContainer" containerID="73bcce191a179175c4e25a958b01f387549f8aaa1c1e014273e87c25d702b95e" Mar 16 17:46:47 crc kubenswrapper[5120]: I0316 17:46:47.914089 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-v822j_ac55471d-4e42-475f-a082-50f611571482/kube-multus/0.log" Mar 16 17:46:47 crc kubenswrapper[5120]: I0316 17:46:47.920324 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-crc_9f0bc7fcb0822a2c13eb2d22cd8c0641/kube-controller-manager/0.log" Mar 16 17:46:48 crc kubenswrapper[5120]: I0316 17:46:48.220143 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-v822j_ac55471d-4e42-475f-a082-50f611571482/kube-multus/0.log" Mar 16 17:46:48 crc kubenswrapper[5120]: I0316 17:46:48.224540 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-crc_9f0bc7fcb0822a2c13eb2d22cd8c0641/kube-controller-manager/0.log" Mar 16 17:47:06 crc kubenswrapper[5120]: I0316 17:47:06.906831 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="keystone-kuttl-tests/keystone-6b4b68f549-s4ws9" Mar 16 17:47:06 crc kubenswrapper[5120]: I0316 17:47:06.907423 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="keystone-kuttl-tests/keystone-6b4b68f549-zptn8" Mar 16 17:47:07 crc kubenswrapper[5120]: E0316 17:47:07.964999 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1127229 actualBytes=10240 Mar 16 17:47:08 crc kubenswrapper[5120]: I0316 17:47:08.214159 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keystone-kuttl-tests/keystone-6b4b68f549-zptn8"] Mar 16 17:47:08 crc kubenswrapper[5120]: I0316 17:47:08.214431 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="keystone-kuttl-tests/keystone-6b4b68f549-zptn8" podUID="83c0c590-4a3d-42d6-ba82-2494c3c817e9" containerName="keystone-api" containerID="cri-o://52b5e3bb5441fb2d26b576edd1105850912a664530c0eef15ee1d3f0ea6b83d2" gracePeriod=30 Mar 16 17:47:08 crc kubenswrapper[5120]: I0316 17:47:08.240288 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keystone-kuttl-tests/keystone-6b4b68f549-s4ws9"] Mar 16 17:47:08 crc kubenswrapper[5120]: I0316 17:47:08.240564 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="keystone-kuttl-tests/keystone-6b4b68f549-s4ws9" podUID="06d409cc-cde1-4f9c-99e4-1d798d7e5790" containerName="keystone-api" containerID="cri-o://f0ec56b0d6245dd0ea928537ff33c984b0e0d8dfa42db671327f018a051c3b04" gracePeriod=30 Mar 16 17:47:09 crc kubenswrapper[5120]: I0316 17:47:09.408859 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keystone-kuttl-tests/keystone-6b4b68f549-phd7r"] Mar 16 17:47:09 crc kubenswrapper[5120]: I0316 17:47:09.410591 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="keystone-kuttl-tests/keystone-6b4b68f549-phd7r" podUID="94cd7437-3727-4e04-b9a1-12f34e7f9c0f" containerName="keystone-api" containerID="cri-o://41aa1e61d02438537a96182eea75c6babeb83c4139e9d06b411699d0b04d5578" gracePeriod=30 Mar 16 17:47:11 crc kubenswrapper[5120]: I0316 17:47:11.778515 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-6b4b68f549-zptn8" Mar 16 17:47:11 crc kubenswrapper[5120]: I0316 17:47:11.785606 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-6b4b68f549-s4ws9" Mar 16 17:47:11 crc kubenswrapper[5120]: I0316 17:47:11.921915 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qxg9k\" (UniqueName: \"kubernetes.io/projected/83c0c590-4a3d-42d6-ba82-2494c3c817e9-kube-api-access-qxg9k\") pod \"83c0c590-4a3d-42d6-ba82-2494c3c817e9\" (UID: \"83c0c590-4a3d-42d6-ba82-2494c3c817e9\") " Mar 16 17:47:11 crc kubenswrapper[5120]: I0316 17:47:11.922315 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/83c0c590-4a3d-42d6-ba82-2494c3c817e9-fernet-keys\") pod \"83c0c590-4a3d-42d6-ba82-2494c3c817e9\" (UID: \"83c0c590-4a3d-42d6-ba82-2494c3c817e9\") " Mar 16 17:47:11 crc kubenswrapper[5120]: I0316 17:47:11.922479 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/06d409cc-cde1-4f9c-99e4-1d798d7e5790-fernet-keys\") pod \"06d409cc-cde1-4f9c-99e4-1d798d7e5790\" (UID: \"06d409cc-cde1-4f9c-99e4-1d798d7e5790\") " Mar 16 17:47:11 crc kubenswrapper[5120]: I0316 17:47:11.922547 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/06d409cc-cde1-4f9c-99e4-1d798d7e5790-credential-keys\") pod \"06d409cc-cde1-4f9c-99e4-1d798d7e5790\" (UID: \"06d409cc-cde1-4f9c-99e4-1d798d7e5790\") " Mar 16 17:47:11 crc kubenswrapper[5120]: I0316 17:47:11.922567 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/06d409cc-cde1-4f9c-99e4-1d798d7e5790-scripts\") pod \"06d409cc-cde1-4f9c-99e4-1d798d7e5790\" (UID: \"06d409cc-cde1-4f9c-99e4-1d798d7e5790\") " Mar 16 17:47:11 crc kubenswrapper[5120]: I0316 17:47:11.922631 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cxvw4\" (UniqueName: \"kubernetes.io/projected/06d409cc-cde1-4f9c-99e4-1d798d7e5790-kube-api-access-cxvw4\") pod \"06d409cc-cde1-4f9c-99e4-1d798d7e5790\" (UID: \"06d409cc-cde1-4f9c-99e4-1d798d7e5790\") " Mar 16 17:47:11 crc kubenswrapper[5120]: I0316 17:47:11.922721 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/83c0c590-4a3d-42d6-ba82-2494c3c817e9-credential-keys\") pod \"83c0c590-4a3d-42d6-ba82-2494c3c817e9\" (UID: \"83c0c590-4a3d-42d6-ba82-2494c3c817e9\") " Mar 16 17:47:11 crc kubenswrapper[5120]: I0316 17:47:11.922860 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/83c0c590-4a3d-42d6-ba82-2494c3c817e9-scripts\") pod \"83c0c590-4a3d-42d6-ba82-2494c3c817e9\" (UID: \"83c0c590-4a3d-42d6-ba82-2494c3c817e9\") " Mar 16 17:47:11 crc kubenswrapper[5120]: I0316 17:47:11.923026 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/06d409cc-cde1-4f9c-99e4-1d798d7e5790-config-data\") pod \"06d409cc-cde1-4f9c-99e4-1d798d7e5790\" (UID: \"06d409cc-cde1-4f9c-99e4-1d798d7e5790\") " Mar 16 17:47:11 crc kubenswrapper[5120]: I0316 17:47:11.923268 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/83c0c590-4a3d-42d6-ba82-2494c3c817e9-config-data\") pod \"83c0c590-4a3d-42d6-ba82-2494c3c817e9\" (UID: \"83c0c590-4a3d-42d6-ba82-2494c3c817e9\") " Mar 16 17:47:11 crc kubenswrapper[5120]: I0316 17:47:11.929848 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06d409cc-cde1-4f9c-99e4-1d798d7e5790-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "06d409cc-cde1-4f9c-99e4-1d798d7e5790" (UID: "06d409cc-cde1-4f9c-99e4-1d798d7e5790"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:47:11 crc kubenswrapper[5120]: I0316 17:47:11.929844 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/83c0c590-4a3d-42d6-ba82-2494c3c817e9-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "83c0c590-4a3d-42d6-ba82-2494c3c817e9" (UID: "83c0c590-4a3d-42d6-ba82-2494c3c817e9"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:47:11 crc kubenswrapper[5120]: I0316 17:47:11.930052 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06d409cc-cde1-4f9c-99e4-1d798d7e5790-scripts" (OuterVolumeSpecName: "scripts") pod "06d409cc-cde1-4f9c-99e4-1d798d7e5790" (UID: "06d409cc-cde1-4f9c-99e4-1d798d7e5790"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:47:11 crc kubenswrapper[5120]: I0316 17:47:11.930117 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06d409cc-cde1-4f9c-99e4-1d798d7e5790-kube-api-access-cxvw4" (OuterVolumeSpecName: "kube-api-access-cxvw4") pod "06d409cc-cde1-4f9c-99e4-1d798d7e5790" (UID: "06d409cc-cde1-4f9c-99e4-1d798d7e5790"). InnerVolumeSpecName "kube-api-access-cxvw4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:47:11 crc kubenswrapper[5120]: I0316 17:47:11.930319 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/83c0c590-4a3d-42d6-ba82-2494c3c817e9-scripts" (OuterVolumeSpecName: "scripts") pod "83c0c590-4a3d-42d6-ba82-2494c3c817e9" (UID: "83c0c590-4a3d-42d6-ba82-2494c3c817e9"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:47:11 crc kubenswrapper[5120]: I0316 17:47:11.930656 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83c0c590-4a3d-42d6-ba82-2494c3c817e9-kube-api-access-qxg9k" (OuterVolumeSpecName: "kube-api-access-qxg9k") pod "83c0c590-4a3d-42d6-ba82-2494c3c817e9" (UID: "83c0c590-4a3d-42d6-ba82-2494c3c817e9"). InnerVolumeSpecName "kube-api-access-qxg9k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:47:11 crc kubenswrapper[5120]: I0316 17:47:11.930717 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/83c0c590-4a3d-42d6-ba82-2494c3c817e9-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "83c0c590-4a3d-42d6-ba82-2494c3c817e9" (UID: "83c0c590-4a3d-42d6-ba82-2494c3c817e9"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:47:11 crc kubenswrapper[5120]: I0316 17:47:11.931488 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06d409cc-cde1-4f9c-99e4-1d798d7e5790-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "06d409cc-cde1-4f9c-99e4-1d798d7e5790" (UID: "06d409cc-cde1-4f9c-99e4-1d798d7e5790"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:47:11 crc kubenswrapper[5120]: I0316 17:47:11.948972 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/83c0c590-4a3d-42d6-ba82-2494c3c817e9-config-data" (OuterVolumeSpecName: "config-data") pod "83c0c590-4a3d-42d6-ba82-2494c3c817e9" (UID: "83c0c590-4a3d-42d6-ba82-2494c3c817e9"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:47:11 crc kubenswrapper[5120]: I0316 17:47:11.950002 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06d409cc-cde1-4f9c-99e4-1d798d7e5790-config-data" (OuterVolumeSpecName: "config-data") pod "06d409cc-cde1-4f9c-99e4-1d798d7e5790" (UID: "06d409cc-cde1-4f9c-99e4-1d798d7e5790"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:47:11 crc kubenswrapper[5120]: I0316 17:47:11.950212 5120 generic.go:358] "Generic (PLEG): container finished" podID="83c0c590-4a3d-42d6-ba82-2494c3c817e9" containerID="52b5e3bb5441fb2d26b576edd1105850912a664530c0eef15ee1d3f0ea6b83d2" exitCode=0 Mar 16 17:47:11 crc kubenswrapper[5120]: I0316 17:47:11.950310 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-6b4b68f549-zptn8" Mar 16 17:47:11 crc kubenswrapper[5120]: I0316 17:47:11.950332 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-6b4b68f549-zptn8" event={"ID":"83c0c590-4a3d-42d6-ba82-2494c3c817e9","Type":"ContainerDied","Data":"52b5e3bb5441fb2d26b576edd1105850912a664530c0eef15ee1d3f0ea6b83d2"} Mar 16 17:47:11 crc kubenswrapper[5120]: I0316 17:47:11.950403 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-6b4b68f549-zptn8" event={"ID":"83c0c590-4a3d-42d6-ba82-2494c3c817e9","Type":"ContainerDied","Data":"6862716d0d2af5b078a90278abcc896e7f622203b11343cf8de74b79d2287304"} Mar 16 17:47:11 crc kubenswrapper[5120]: I0316 17:47:11.950436 5120 scope.go:117] "RemoveContainer" containerID="52b5e3bb5441fb2d26b576edd1105850912a664530c0eef15ee1d3f0ea6b83d2" Mar 16 17:47:11 crc kubenswrapper[5120]: I0316 17:47:11.952555 5120 generic.go:358] "Generic (PLEG): container finished" podID="06d409cc-cde1-4f9c-99e4-1d798d7e5790" containerID="f0ec56b0d6245dd0ea928537ff33c984b0e0d8dfa42db671327f018a051c3b04" exitCode=0 Mar 16 17:47:11 crc kubenswrapper[5120]: I0316 17:47:11.953129 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-6b4b68f549-s4ws9" event={"ID":"06d409cc-cde1-4f9c-99e4-1d798d7e5790","Type":"ContainerDied","Data":"f0ec56b0d6245dd0ea928537ff33c984b0e0d8dfa42db671327f018a051c3b04"} Mar 16 17:47:11 crc kubenswrapper[5120]: I0316 17:47:11.953178 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-6b4b68f549-s4ws9" event={"ID":"06d409cc-cde1-4f9c-99e4-1d798d7e5790","Type":"ContainerDied","Data":"dc36f9175befe3e8d3f8724928c4ca7ee4aaa7cde210bf4ab472617f5868cef0"} Mar 16 17:47:11 crc kubenswrapper[5120]: I0316 17:47:11.953282 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-6b4b68f549-s4ws9" Mar 16 17:47:11 crc kubenswrapper[5120]: I0316 17:47:11.979629 5120 scope.go:117] "RemoveContainer" containerID="52b5e3bb5441fb2d26b576edd1105850912a664530c0eef15ee1d3f0ea6b83d2" Mar 16 17:47:11 crc kubenswrapper[5120]: E0316 17:47:11.982290 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"52b5e3bb5441fb2d26b576edd1105850912a664530c0eef15ee1d3f0ea6b83d2\": container with ID starting with 52b5e3bb5441fb2d26b576edd1105850912a664530c0eef15ee1d3f0ea6b83d2 not found: ID does not exist" containerID="52b5e3bb5441fb2d26b576edd1105850912a664530c0eef15ee1d3f0ea6b83d2" Mar 16 17:47:11 crc kubenswrapper[5120]: I0316 17:47:11.982359 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52b5e3bb5441fb2d26b576edd1105850912a664530c0eef15ee1d3f0ea6b83d2"} err="failed to get container status \"52b5e3bb5441fb2d26b576edd1105850912a664530c0eef15ee1d3f0ea6b83d2\": rpc error: code = NotFound desc = could not find container \"52b5e3bb5441fb2d26b576edd1105850912a664530c0eef15ee1d3f0ea6b83d2\": container with ID starting with 52b5e3bb5441fb2d26b576edd1105850912a664530c0eef15ee1d3f0ea6b83d2 not found: ID does not exist" Mar 16 17:47:11 crc kubenswrapper[5120]: I0316 17:47:11.982387 5120 scope.go:117] "RemoveContainer" containerID="f0ec56b0d6245dd0ea928537ff33c984b0e0d8dfa42db671327f018a051c3b04" Mar 16 17:47:11 crc kubenswrapper[5120]: I0316 17:47:11.991223 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keystone-kuttl-tests/keystone-6b4b68f549-zptn8"] Mar 16 17:47:11 crc kubenswrapper[5120]: I0316 17:47:11.998456 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["keystone-kuttl-tests/keystone-6b4b68f549-zptn8"] Mar 16 17:47:12 crc kubenswrapper[5120]: I0316 17:47:12.010016 5120 scope.go:117] "RemoveContainer" containerID="f0ec56b0d6245dd0ea928537ff33c984b0e0d8dfa42db671327f018a051c3b04" Mar 16 17:47:12 crc kubenswrapper[5120]: E0316 17:47:12.010530 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f0ec56b0d6245dd0ea928537ff33c984b0e0d8dfa42db671327f018a051c3b04\": container with ID starting with f0ec56b0d6245dd0ea928537ff33c984b0e0d8dfa42db671327f018a051c3b04 not found: ID does not exist" containerID="f0ec56b0d6245dd0ea928537ff33c984b0e0d8dfa42db671327f018a051c3b04" Mar 16 17:47:12 crc kubenswrapper[5120]: I0316 17:47:12.010574 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0ec56b0d6245dd0ea928537ff33c984b0e0d8dfa42db671327f018a051c3b04"} err="failed to get container status \"f0ec56b0d6245dd0ea928537ff33c984b0e0d8dfa42db671327f018a051c3b04\": rpc error: code = NotFound desc = could not find container \"f0ec56b0d6245dd0ea928537ff33c984b0e0d8dfa42db671327f018a051c3b04\": container with ID starting with f0ec56b0d6245dd0ea928537ff33c984b0e0d8dfa42db671327f018a051c3b04 not found: ID does not exist" Mar 16 17:47:12 crc kubenswrapper[5120]: I0316 17:47:12.012426 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keystone-kuttl-tests/keystone-6b4b68f549-s4ws9"] Mar 16 17:47:12 crc kubenswrapper[5120]: I0316 17:47:12.018448 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["keystone-kuttl-tests/keystone-6b4b68f549-s4ws9"] Mar 16 17:47:12 crc kubenswrapper[5120]: I0316 17:47:12.026177 5120 reconciler_common.go:299] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/06d409cc-cde1-4f9c-99e4-1d798d7e5790-fernet-keys\") on node \"crc\" DevicePath \"\"" Mar 16 17:47:12 crc kubenswrapper[5120]: I0316 17:47:12.026210 5120 reconciler_common.go:299] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/06d409cc-cde1-4f9c-99e4-1d798d7e5790-credential-keys\") on node \"crc\" DevicePath \"\"" Mar 16 17:47:12 crc kubenswrapper[5120]: I0316 17:47:12.026219 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/06d409cc-cde1-4f9c-99e4-1d798d7e5790-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:47:12 crc kubenswrapper[5120]: I0316 17:47:12.026230 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cxvw4\" (UniqueName: \"kubernetes.io/projected/06d409cc-cde1-4f9c-99e4-1d798d7e5790-kube-api-access-cxvw4\") on node \"crc\" DevicePath \"\"" Mar 16 17:47:12 crc kubenswrapper[5120]: I0316 17:47:12.026241 5120 reconciler_common.go:299] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/83c0c590-4a3d-42d6-ba82-2494c3c817e9-credential-keys\") on node \"crc\" DevicePath \"\"" Mar 16 17:47:12 crc kubenswrapper[5120]: I0316 17:47:12.026250 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/83c0c590-4a3d-42d6-ba82-2494c3c817e9-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:47:12 crc kubenswrapper[5120]: I0316 17:47:12.026257 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/06d409cc-cde1-4f9c-99e4-1d798d7e5790-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:47:12 crc kubenswrapper[5120]: I0316 17:47:12.026265 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/83c0c590-4a3d-42d6-ba82-2494c3c817e9-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:47:12 crc kubenswrapper[5120]: I0316 17:47:12.026274 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qxg9k\" (UniqueName: \"kubernetes.io/projected/83c0c590-4a3d-42d6-ba82-2494c3c817e9-kube-api-access-qxg9k\") on node \"crc\" DevicePath \"\"" Mar 16 17:47:12 crc kubenswrapper[5120]: I0316 17:47:12.026282 5120 reconciler_common.go:299] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/83c0c590-4a3d-42d6-ba82-2494c3c817e9-fernet-keys\") on node \"crc\" DevicePath \"\"" Mar 16 17:47:12 crc kubenswrapper[5120]: I0316 17:47:12.673995 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="06d409cc-cde1-4f9c-99e4-1d798d7e5790" path="/var/lib/kubelet/pods/06d409cc-cde1-4f9c-99e4-1d798d7e5790/volumes" Mar 16 17:47:12 crc kubenswrapper[5120]: I0316 17:47:12.674832 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="83c0c590-4a3d-42d6-ba82-2494c3c817e9" path="/var/lib/kubelet/pods/83c0c590-4a3d-42d6-ba82-2494c3c817e9/volumes" Mar 16 17:47:12 crc kubenswrapper[5120]: I0316 17:47:12.822170 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-6b4b68f549-phd7r" Mar 16 17:47:12 crc kubenswrapper[5120]: I0316 17:47:12.945364 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/94cd7437-3727-4e04-b9a1-12f34e7f9c0f-scripts\") pod \"94cd7437-3727-4e04-b9a1-12f34e7f9c0f\" (UID: \"94cd7437-3727-4e04-b9a1-12f34e7f9c0f\") " Mar 16 17:47:12 crc kubenswrapper[5120]: I0316 17:47:12.945522 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/94cd7437-3727-4e04-b9a1-12f34e7f9c0f-credential-keys\") pod \"94cd7437-3727-4e04-b9a1-12f34e7f9c0f\" (UID: \"94cd7437-3727-4e04-b9a1-12f34e7f9c0f\") " Mar 16 17:47:12 crc kubenswrapper[5120]: I0316 17:47:12.945570 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/94cd7437-3727-4e04-b9a1-12f34e7f9c0f-config-data\") pod \"94cd7437-3727-4e04-b9a1-12f34e7f9c0f\" (UID: \"94cd7437-3727-4e04-b9a1-12f34e7f9c0f\") " Mar 16 17:47:12 crc kubenswrapper[5120]: I0316 17:47:12.945729 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8htfc\" (UniqueName: \"kubernetes.io/projected/94cd7437-3727-4e04-b9a1-12f34e7f9c0f-kube-api-access-8htfc\") pod \"94cd7437-3727-4e04-b9a1-12f34e7f9c0f\" (UID: \"94cd7437-3727-4e04-b9a1-12f34e7f9c0f\") " Mar 16 17:47:12 crc kubenswrapper[5120]: I0316 17:47:12.945883 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/94cd7437-3727-4e04-b9a1-12f34e7f9c0f-fernet-keys\") pod \"94cd7437-3727-4e04-b9a1-12f34e7f9c0f\" (UID: \"94cd7437-3727-4e04-b9a1-12f34e7f9c0f\") " Mar 16 17:47:12 crc kubenswrapper[5120]: I0316 17:47:12.950729 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/94cd7437-3727-4e04-b9a1-12f34e7f9c0f-scripts" (OuterVolumeSpecName: "scripts") pod "94cd7437-3727-4e04-b9a1-12f34e7f9c0f" (UID: "94cd7437-3727-4e04-b9a1-12f34e7f9c0f"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:47:12 crc kubenswrapper[5120]: I0316 17:47:12.950909 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/94cd7437-3727-4e04-b9a1-12f34e7f9c0f-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "94cd7437-3727-4e04-b9a1-12f34e7f9c0f" (UID: "94cd7437-3727-4e04-b9a1-12f34e7f9c0f"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:47:12 crc kubenswrapper[5120]: I0316 17:47:12.950966 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/94cd7437-3727-4e04-b9a1-12f34e7f9c0f-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "94cd7437-3727-4e04-b9a1-12f34e7f9c0f" (UID: "94cd7437-3727-4e04-b9a1-12f34e7f9c0f"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:47:12 crc kubenswrapper[5120]: I0316 17:47:12.951357 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94cd7437-3727-4e04-b9a1-12f34e7f9c0f-kube-api-access-8htfc" (OuterVolumeSpecName: "kube-api-access-8htfc") pod "94cd7437-3727-4e04-b9a1-12f34e7f9c0f" (UID: "94cd7437-3727-4e04-b9a1-12f34e7f9c0f"). InnerVolumeSpecName "kube-api-access-8htfc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:47:12 crc kubenswrapper[5120]: I0316 17:47:12.965395 5120 generic.go:358] "Generic (PLEG): container finished" podID="94cd7437-3727-4e04-b9a1-12f34e7f9c0f" containerID="41aa1e61d02438537a96182eea75c6babeb83c4139e9d06b411699d0b04d5578" exitCode=0 Mar 16 17:47:12 crc kubenswrapper[5120]: I0316 17:47:12.965475 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-6b4b68f549-phd7r" event={"ID":"94cd7437-3727-4e04-b9a1-12f34e7f9c0f","Type":"ContainerDied","Data":"41aa1e61d02438537a96182eea75c6babeb83c4139e9d06b411699d0b04d5578"} Mar 16 17:47:12 crc kubenswrapper[5120]: I0316 17:47:12.965499 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-6b4b68f549-phd7r" event={"ID":"94cd7437-3727-4e04-b9a1-12f34e7f9c0f","Type":"ContainerDied","Data":"83cbe91f164a208b76874e40f4ceeb185ce75321a6589b5a8d5992b3fd8150ca"} Mar 16 17:47:12 crc kubenswrapper[5120]: I0316 17:47:12.965514 5120 scope.go:117] "RemoveContainer" containerID="41aa1e61d02438537a96182eea75c6babeb83c4139e9d06b411699d0b04d5578" Mar 16 17:47:12 crc kubenswrapper[5120]: I0316 17:47:12.965619 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-6b4b68f549-phd7r" Mar 16 17:47:12 crc kubenswrapper[5120]: I0316 17:47:12.968997 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/94cd7437-3727-4e04-b9a1-12f34e7f9c0f-config-data" (OuterVolumeSpecName: "config-data") pod "94cd7437-3727-4e04-b9a1-12f34e7f9c0f" (UID: "94cd7437-3727-4e04-b9a1-12f34e7f9c0f"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:47:12 crc kubenswrapper[5120]: I0316 17:47:12.993966 5120 scope.go:117] "RemoveContainer" containerID="41aa1e61d02438537a96182eea75c6babeb83c4139e9d06b411699d0b04d5578" Mar 16 17:47:12 crc kubenswrapper[5120]: E0316 17:47:12.994626 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"41aa1e61d02438537a96182eea75c6babeb83c4139e9d06b411699d0b04d5578\": container with ID starting with 41aa1e61d02438537a96182eea75c6babeb83c4139e9d06b411699d0b04d5578 not found: ID does not exist" containerID="41aa1e61d02438537a96182eea75c6babeb83c4139e9d06b411699d0b04d5578" Mar 16 17:47:12 crc kubenswrapper[5120]: I0316 17:47:12.994657 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41aa1e61d02438537a96182eea75c6babeb83c4139e9d06b411699d0b04d5578"} err="failed to get container status \"41aa1e61d02438537a96182eea75c6babeb83c4139e9d06b411699d0b04d5578\": rpc error: code = NotFound desc = could not find container \"41aa1e61d02438537a96182eea75c6babeb83c4139e9d06b411699d0b04d5578\": container with ID starting with 41aa1e61d02438537a96182eea75c6babeb83c4139e9d06b411699d0b04d5578 not found: ID does not exist" Mar 16 17:47:13 crc kubenswrapper[5120]: I0316 17:47:13.048552 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/94cd7437-3727-4e04-b9a1-12f34e7f9c0f-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:47:13 crc kubenswrapper[5120]: I0316 17:47:13.048602 5120 reconciler_common.go:299] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/94cd7437-3727-4e04-b9a1-12f34e7f9c0f-credential-keys\") on node \"crc\" DevicePath \"\"" Mar 16 17:47:13 crc kubenswrapper[5120]: I0316 17:47:13.048618 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/94cd7437-3727-4e04-b9a1-12f34e7f9c0f-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:47:13 crc kubenswrapper[5120]: I0316 17:47:13.048673 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8htfc\" (UniqueName: \"kubernetes.io/projected/94cd7437-3727-4e04-b9a1-12f34e7f9c0f-kube-api-access-8htfc\") on node \"crc\" DevicePath \"\"" Mar 16 17:47:13 crc kubenswrapper[5120]: I0316 17:47:13.048687 5120 reconciler_common.go:299] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/94cd7437-3727-4e04-b9a1-12f34e7f9c0f-fernet-keys\") on node \"crc\" DevicePath \"\"" Mar 16 17:47:13 crc kubenswrapper[5120]: I0316 17:47:13.298435 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keystone-kuttl-tests/keystone-6b4b68f549-phd7r"] Mar 16 17:47:13 crc kubenswrapper[5120]: I0316 17:47:13.304366 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["keystone-kuttl-tests/keystone-6b4b68f549-phd7r"] Mar 16 17:47:13 crc kubenswrapper[5120]: I0316 17:47:13.536256 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keystone-kuttl-tests/keystone-bootstrap-52c2z"] Mar 16 17:47:13 crc kubenswrapper[5120]: I0316 17:47:13.544955 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keystone-kuttl-tests/keystone-db-sync-mttjs"] Mar 16 17:47:13 crc kubenswrapper[5120]: I0316 17:47:13.550423 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["keystone-kuttl-tests/keystone-bootstrap-52c2z"] Mar 16 17:47:13 crc kubenswrapper[5120]: I0316 17:47:13.556451 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["keystone-kuttl-tests/keystone-db-sync-mttjs"] Mar 16 17:47:13 crc kubenswrapper[5120]: I0316 17:47:13.600821 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keystone-kuttl-tests/keystone52c5-account-delete-mhl5q"] Mar 16 17:47:13 crc kubenswrapper[5120]: I0316 17:47:13.601557 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83c0c590-4a3d-42d6-ba82-2494c3c817e9" containerName="keystone-api" Mar 16 17:47:13 crc kubenswrapper[5120]: I0316 17:47:13.601574 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="83c0c590-4a3d-42d6-ba82-2494c3c817e9" containerName="keystone-api" Mar 16 17:47:13 crc kubenswrapper[5120]: I0316 17:47:13.601616 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06d409cc-cde1-4f9c-99e4-1d798d7e5790" containerName="keystone-api" Mar 16 17:47:13 crc kubenswrapper[5120]: I0316 17:47:13.601621 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="06d409cc-cde1-4f9c-99e4-1d798d7e5790" containerName="keystone-api" Mar 16 17:47:13 crc kubenswrapper[5120]: I0316 17:47:13.601636 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94cd7437-3727-4e04-b9a1-12f34e7f9c0f" containerName="keystone-api" Mar 16 17:47:13 crc kubenswrapper[5120]: I0316 17:47:13.601642 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="94cd7437-3727-4e04-b9a1-12f34e7f9c0f" containerName="keystone-api" Mar 16 17:47:13 crc kubenswrapper[5120]: I0316 17:47:13.601919 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="83c0c590-4a3d-42d6-ba82-2494c3c817e9" containerName="keystone-api" Mar 16 17:47:13 crc kubenswrapper[5120]: I0316 17:47:13.601946 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="94cd7437-3727-4e04-b9a1-12f34e7f9c0f" containerName="keystone-api" Mar 16 17:47:13 crc kubenswrapper[5120]: I0316 17:47:13.601964 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="06d409cc-cde1-4f9c-99e4-1d798d7e5790" containerName="keystone-api" Mar 16 17:47:13 crc kubenswrapper[5120]: I0316 17:47:13.607327 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone52c5-account-delete-mhl5q" Mar 16 17:47:13 crc kubenswrapper[5120]: I0316 17:47:13.614681 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone52c5-account-delete-mhl5q"] Mar 16 17:47:13 crc kubenswrapper[5120]: I0316 17:47:13.771866 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w56mc\" (UniqueName: \"kubernetes.io/projected/88264e32-c640-4d6f-aa2a-c826aa2166dd-kube-api-access-w56mc\") pod \"keystone52c5-account-delete-mhl5q\" (UID: \"88264e32-c640-4d6f-aa2a-c826aa2166dd\") " pod="keystone-kuttl-tests/keystone52c5-account-delete-mhl5q" Mar 16 17:47:13 crc kubenswrapper[5120]: I0316 17:47:13.772285 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/88264e32-c640-4d6f-aa2a-c826aa2166dd-operator-scripts\") pod \"keystone52c5-account-delete-mhl5q\" (UID: \"88264e32-c640-4d6f-aa2a-c826aa2166dd\") " pod="keystone-kuttl-tests/keystone52c5-account-delete-mhl5q" Mar 16 17:47:13 crc kubenswrapper[5120]: I0316 17:47:13.874341 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w56mc\" (UniqueName: \"kubernetes.io/projected/88264e32-c640-4d6f-aa2a-c826aa2166dd-kube-api-access-w56mc\") pod \"keystone52c5-account-delete-mhl5q\" (UID: \"88264e32-c640-4d6f-aa2a-c826aa2166dd\") " pod="keystone-kuttl-tests/keystone52c5-account-delete-mhl5q" Mar 16 17:47:13 crc kubenswrapper[5120]: I0316 17:47:13.874447 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/88264e32-c640-4d6f-aa2a-c826aa2166dd-operator-scripts\") pod \"keystone52c5-account-delete-mhl5q\" (UID: \"88264e32-c640-4d6f-aa2a-c826aa2166dd\") " pod="keystone-kuttl-tests/keystone52c5-account-delete-mhl5q" Mar 16 17:47:13 crc kubenswrapper[5120]: I0316 17:47:13.875261 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/88264e32-c640-4d6f-aa2a-c826aa2166dd-operator-scripts\") pod \"keystone52c5-account-delete-mhl5q\" (UID: \"88264e32-c640-4d6f-aa2a-c826aa2166dd\") " pod="keystone-kuttl-tests/keystone52c5-account-delete-mhl5q" Mar 16 17:47:13 crc kubenswrapper[5120]: I0316 17:47:13.893564 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w56mc\" (UniqueName: \"kubernetes.io/projected/88264e32-c640-4d6f-aa2a-c826aa2166dd-kube-api-access-w56mc\") pod \"keystone52c5-account-delete-mhl5q\" (UID: \"88264e32-c640-4d6f-aa2a-c826aa2166dd\") " pod="keystone-kuttl-tests/keystone52c5-account-delete-mhl5q" Mar 16 17:47:13 crc kubenswrapper[5120]: I0316 17:47:13.934705 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone52c5-account-delete-mhl5q" Mar 16 17:47:14 crc kubenswrapper[5120]: I0316 17:47:14.353327 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone52c5-account-delete-mhl5q"] Mar 16 17:47:14 crc kubenswrapper[5120]: I0316 17:47:14.365019 5120 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Mar 16 17:47:14 crc kubenswrapper[5120]: I0316 17:47:14.691323 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f514448-0c9d-4ccd-9cf8-b38fc03e4393" path="/var/lib/kubelet/pods/1f514448-0c9d-4ccd-9cf8-b38fc03e4393/volumes" Mar 16 17:47:14 crc kubenswrapper[5120]: I0316 17:47:14.692790 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="45d4ec4d-1b52-4e7f-8a46-8df18ced4ea8" path="/var/lib/kubelet/pods/45d4ec4d-1b52-4e7f-8a46-8df18ced4ea8/volumes" Mar 16 17:47:14 crc kubenswrapper[5120]: I0316 17:47:14.694070 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94cd7437-3727-4e04-b9a1-12f34e7f9c0f" path="/var/lib/kubelet/pods/94cd7437-3727-4e04-b9a1-12f34e7f9c0f/volumes" Mar 16 17:47:14 crc kubenswrapper[5120]: I0316 17:47:14.985770 5120 generic.go:358] "Generic (PLEG): container finished" podID="88264e32-c640-4d6f-aa2a-c826aa2166dd" containerID="3ef835f876e7b16b650154abfb19abf0ec9442d1b668d4af72e672fa28d316b2" exitCode=0 Mar 16 17:47:14 crc kubenswrapper[5120]: I0316 17:47:14.985897 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone52c5-account-delete-mhl5q" event={"ID":"88264e32-c640-4d6f-aa2a-c826aa2166dd","Type":"ContainerDied","Data":"3ef835f876e7b16b650154abfb19abf0ec9442d1b668d4af72e672fa28d316b2"} Mar 16 17:47:14 crc kubenswrapper[5120]: I0316 17:47:14.985938 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone52c5-account-delete-mhl5q" event={"ID":"88264e32-c640-4d6f-aa2a-c826aa2166dd","Type":"ContainerStarted","Data":"40f2bccf2ceba8a493ac3471cb0c562c7527b7a3d482af6fcab5e511616f3897"} Mar 16 17:47:16 crc kubenswrapper[5120]: I0316 17:47:16.308052 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone52c5-account-delete-mhl5q" Mar 16 17:47:16 crc kubenswrapper[5120]: I0316 17:47:16.339674 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/88264e32-c640-4d6f-aa2a-c826aa2166dd-operator-scripts\") pod \"88264e32-c640-4d6f-aa2a-c826aa2166dd\" (UID: \"88264e32-c640-4d6f-aa2a-c826aa2166dd\") " Mar 16 17:47:16 crc kubenswrapper[5120]: I0316 17:47:16.340067 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w56mc\" (UniqueName: \"kubernetes.io/projected/88264e32-c640-4d6f-aa2a-c826aa2166dd-kube-api-access-w56mc\") pod \"88264e32-c640-4d6f-aa2a-c826aa2166dd\" (UID: \"88264e32-c640-4d6f-aa2a-c826aa2166dd\") " Mar 16 17:47:16 crc kubenswrapper[5120]: I0316 17:47:16.340634 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/88264e32-c640-4d6f-aa2a-c826aa2166dd-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "88264e32-c640-4d6f-aa2a-c826aa2166dd" (UID: "88264e32-c640-4d6f-aa2a-c826aa2166dd"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:47:16 crc kubenswrapper[5120]: I0316 17:47:16.340936 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/88264e32-c640-4d6f-aa2a-c826aa2166dd-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:47:16 crc kubenswrapper[5120]: I0316 17:47:16.346015 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88264e32-c640-4d6f-aa2a-c826aa2166dd-kube-api-access-w56mc" (OuterVolumeSpecName: "kube-api-access-w56mc") pod "88264e32-c640-4d6f-aa2a-c826aa2166dd" (UID: "88264e32-c640-4d6f-aa2a-c826aa2166dd"). InnerVolumeSpecName "kube-api-access-w56mc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:47:16 crc kubenswrapper[5120]: I0316 17:47:16.443916 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w56mc\" (UniqueName: \"kubernetes.io/projected/88264e32-c640-4d6f-aa2a-c826aa2166dd-kube-api-access-w56mc\") on node \"crc\" DevicePath \"\"" Mar 16 17:47:17 crc kubenswrapper[5120]: I0316 17:47:17.002341 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone52c5-account-delete-mhl5q" Mar 16 17:47:17 crc kubenswrapper[5120]: I0316 17:47:17.002376 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone52c5-account-delete-mhl5q" event={"ID":"88264e32-c640-4d6f-aa2a-c826aa2166dd","Type":"ContainerDied","Data":"40f2bccf2ceba8a493ac3471cb0c562c7527b7a3d482af6fcab5e511616f3897"} Mar 16 17:47:17 crc kubenswrapper[5120]: I0316 17:47:17.002434 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="40f2bccf2ceba8a493ac3471cb0c562c7527b7a3d482af6fcab5e511616f3897" Mar 16 17:47:18 crc kubenswrapper[5120]: I0316 17:47:18.623921 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keystone-kuttl-tests/keystone-db-create-n6p6w"] Mar 16 17:47:18 crc kubenswrapper[5120]: I0316 17:47:18.630952 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["keystone-kuttl-tests/keystone-db-create-n6p6w"] Mar 16 17:47:18 crc kubenswrapper[5120]: I0316 17:47:18.639985 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keystone-kuttl-tests/keystone52c5-account-delete-mhl5q"] Mar 16 17:47:18 crc kubenswrapper[5120]: I0316 17:47:18.648460 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["keystone-kuttl-tests/keystone52c5-account-delete-mhl5q"] Mar 16 17:47:18 crc kubenswrapper[5120]: I0316 17:47:18.656141 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keystone-kuttl-tests/keystone-52c5-account-create-update-kqp9t"] Mar 16 17:47:18 crc kubenswrapper[5120]: I0316 17:47:18.662696 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["keystone-kuttl-tests/keystone-52c5-account-create-update-kqp9t"] Mar 16 17:47:18 crc kubenswrapper[5120]: I0316 17:47:18.672199 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1d19dbe7-73f4-4077-97ee-309cd5b666af" path="/var/lib/kubelet/pods/1d19dbe7-73f4-4077-97ee-309cd5b666af/volumes" Mar 16 17:47:18 crc kubenswrapper[5120]: I0316 17:47:18.672715 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="88264e32-c640-4d6f-aa2a-c826aa2166dd" path="/var/lib/kubelet/pods/88264e32-c640-4d6f-aa2a-c826aa2166dd/volumes" Mar 16 17:47:18 crc kubenswrapper[5120]: I0316 17:47:18.673217 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d73e0ff0-cb3a-4ffa-bb8e-0690287d6575" path="/var/lib/kubelet/pods/d73e0ff0-cb3a-4ffa-bb8e-0690287d6575/volumes" Mar 16 17:47:18 crc kubenswrapper[5120]: I0316 17:47:18.719229 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keystone-kuttl-tests/keystone-db-create-bfchl"] Mar 16 17:47:18 crc kubenswrapper[5120]: I0316 17:47:18.720296 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88264e32-c640-4d6f-aa2a-c826aa2166dd" containerName="mariadb-account-delete" Mar 16 17:47:18 crc kubenswrapper[5120]: I0316 17:47:18.720320 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="88264e32-c640-4d6f-aa2a-c826aa2166dd" containerName="mariadb-account-delete" Mar 16 17:47:18 crc kubenswrapper[5120]: I0316 17:47:18.720455 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="88264e32-c640-4d6f-aa2a-c826aa2166dd" containerName="mariadb-account-delete" Mar 16 17:47:18 crc kubenswrapper[5120]: I0316 17:47:18.726515 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-db-create-bfchl" Mar 16 17:47:18 crc kubenswrapper[5120]: I0316 17:47:18.726602 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone-db-create-bfchl"] Mar 16 17:47:18 crc kubenswrapper[5120]: I0316 17:47:18.794583 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2318cdd1-4506-4657-81d0-293f2d9ec62b-operator-scripts\") pod \"keystone-db-create-bfchl\" (UID: \"2318cdd1-4506-4657-81d0-293f2d9ec62b\") " pod="keystone-kuttl-tests/keystone-db-create-bfchl" Mar 16 17:47:18 crc kubenswrapper[5120]: I0316 17:47:18.794667 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjnzp\" (UniqueName: \"kubernetes.io/projected/2318cdd1-4506-4657-81d0-293f2d9ec62b-kube-api-access-kjnzp\") pod \"keystone-db-create-bfchl\" (UID: \"2318cdd1-4506-4657-81d0-293f2d9ec62b\") " pod="keystone-kuttl-tests/keystone-db-create-bfchl" Mar 16 17:47:18 crc kubenswrapper[5120]: I0316 17:47:18.823248 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keystone-kuttl-tests/keystone-1ab5-account-create-update-zfgxh"] Mar 16 17:47:18 crc kubenswrapper[5120]: I0316 17:47:18.828925 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-1ab5-account-create-update-zfgxh" Mar 16 17:47:18 crc kubenswrapper[5120]: I0316 17:47:18.832220 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keystone-kuttl-tests\"/\"keystone-db-secret\"" Mar 16 17:47:18 crc kubenswrapper[5120]: I0316 17:47:18.835431 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone-1ab5-account-create-update-zfgxh"] Mar 16 17:47:18 crc kubenswrapper[5120]: I0316 17:47:18.896543 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2318cdd1-4506-4657-81d0-293f2d9ec62b-operator-scripts\") pod \"keystone-db-create-bfchl\" (UID: \"2318cdd1-4506-4657-81d0-293f2d9ec62b\") " pod="keystone-kuttl-tests/keystone-db-create-bfchl" Mar 16 17:47:18 crc kubenswrapper[5120]: I0316 17:47:18.896614 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kjnzp\" (UniqueName: \"kubernetes.io/projected/2318cdd1-4506-4657-81d0-293f2d9ec62b-kube-api-access-kjnzp\") pod \"keystone-db-create-bfchl\" (UID: \"2318cdd1-4506-4657-81d0-293f2d9ec62b\") " pod="keystone-kuttl-tests/keystone-db-create-bfchl" Mar 16 17:47:18 crc kubenswrapper[5120]: I0316 17:47:18.896693 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpp4h\" (UniqueName: \"kubernetes.io/projected/065a7e21-0a4b-4a9b-80d0-17e1f634c2f7-kube-api-access-hpp4h\") pod \"keystone-1ab5-account-create-update-zfgxh\" (UID: \"065a7e21-0a4b-4a9b-80d0-17e1f634c2f7\") " pod="keystone-kuttl-tests/keystone-1ab5-account-create-update-zfgxh" Mar 16 17:47:18 crc kubenswrapper[5120]: I0316 17:47:18.896719 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/065a7e21-0a4b-4a9b-80d0-17e1f634c2f7-operator-scripts\") pod \"keystone-1ab5-account-create-update-zfgxh\" (UID: \"065a7e21-0a4b-4a9b-80d0-17e1f634c2f7\") " pod="keystone-kuttl-tests/keystone-1ab5-account-create-update-zfgxh" Mar 16 17:47:18 crc kubenswrapper[5120]: I0316 17:47:18.897545 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2318cdd1-4506-4657-81d0-293f2d9ec62b-operator-scripts\") pod \"keystone-db-create-bfchl\" (UID: \"2318cdd1-4506-4657-81d0-293f2d9ec62b\") " pod="keystone-kuttl-tests/keystone-db-create-bfchl" Mar 16 17:47:18 crc kubenswrapper[5120]: I0316 17:47:18.915029 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjnzp\" (UniqueName: \"kubernetes.io/projected/2318cdd1-4506-4657-81d0-293f2d9ec62b-kube-api-access-kjnzp\") pod \"keystone-db-create-bfchl\" (UID: \"2318cdd1-4506-4657-81d0-293f2d9ec62b\") " pod="keystone-kuttl-tests/keystone-db-create-bfchl" Mar 16 17:47:18 crc kubenswrapper[5120]: I0316 17:47:18.998599 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hpp4h\" (UniqueName: \"kubernetes.io/projected/065a7e21-0a4b-4a9b-80d0-17e1f634c2f7-kube-api-access-hpp4h\") pod \"keystone-1ab5-account-create-update-zfgxh\" (UID: \"065a7e21-0a4b-4a9b-80d0-17e1f634c2f7\") " pod="keystone-kuttl-tests/keystone-1ab5-account-create-update-zfgxh" Mar 16 17:47:18 crc kubenswrapper[5120]: I0316 17:47:18.998655 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/065a7e21-0a4b-4a9b-80d0-17e1f634c2f7-operator-scripts\") pod \"keystone-1ab5-account-create-update-zfgxh\" (UID: \"065a7e21-0a4b-4a9b-80d0-17e1f634c2f7\") " pod="keystone-kuttl-tests/keystone-1ab5-account-create-update-zfgxh" Mar 16 17:47:18 crc kubenswrapper[5120]: I0316 17:47:18.999482 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/065a7e21-0a4b-4a9b-80d0-17e1f634c2f7-operator-scripts\") pod \"keystone-1ab5-account-create-update-zfgxh\" (UID: \"065a7e21-0a4b-4a9b-80d0-17e1f634c2f7\") " pod="keystone-kuttl-tests/keystone-1ab5-account-create-update-zfgxh" Mar 16 17:47:19 crc kubenswrapper[5120]: I0316 17:47:19.015612 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpp4h\" (UniqueName: \"kubernetes.io/projected/065a7e21-0a4b-4a9b-80d0-17e1f634c2f7-kube-api-access-hpp4h\") pod \"keystone-1ab5-account-create-update-zfgxh\" (UID: \"065a7e21-0a4b-4a9b-80d0-17e1f634c2f7\") " pod="keystone-kuttl-tests/keystone-1ab5-account-create-update-zfgxh" Mar 16 17:47:19 crc kubenswrapper[5120]: I0316 17:47:19.042036 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-db-create-bfchl" Mar 16 17:47:19 crc kubenswrapper[5120]: I0316 17:47:19.158927 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-1ab5-account-create-update-zfgxh" Mar 16 17:47:19 crc kubenswrapper[5120]: I0316 17:47:19.310575 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone-db-create-bfchl"] Mar 16 17:47:19 crc kubenswrapper[5120]: W0316 17:47:19.328494 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2318cdd1_4506_4657_81d0_293f2d9ec62b.slice/crio-fbe88839e4e7422de92129cf95e98088d095dc07b7590bb6805744083d3e50b3 WatchSource:0}: Error finding container fbe88839e4e7422de92129cf95e98088d095dc07b7590bb6805744083d3e50b3: Status 404 returned error can't find the container with id fbe88839e4e7422de92129cf95e98088d095dc07b7590bb6805744083d3e50b3 Mar 16 17:47:19 crc kubenswrapper[5120]: I0316 17:47:19.593610 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone-1ab5-account-create-update-zfgxh"] Mar 16 17:47:19 crc kubenswrapper[5120]: W0316 17:47:19.596841 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod065a7e21_0a4b_4a9b_80d0_17e1f634c2f7.slice/crio-b038b676a041a3d9025bfef87c5349a07b2af3e62f20bed444bc894125c235a0 WatchSource:0}: Error finding container b038b676a041a3d9025bfef87c5349a07b2af3e62f20bed444bc894125c235a0: Status 404 returned error can't find the container with id b038b676a041a3d9025bfef87c5349a07b2af3e62f20bed444bc894125c235a0 Mar 16 17:47:20 crc kubenswrapper[5120]: I0316 17:47:20.026565 5120 generic.go:358] "Generic (PLEG): container finished" podID="2318cdd1-4506-4657-81d0-293f2d9ec62b" containerID="0862b8fd60f55177643eae39d8542eb9a6b8c1937936924992b87516147ce122" exitCode=0 Mar 16 17:47:20 crc kubenswrapper[5120]: I0316 17:47:20.026619 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-db-create-bfchl" event={"ID":"2318cdd1-4506-4657-81d0-293f2d9ec62b","Type":"ContainerDied","Data":"0862b8fd60f55177643eae39d8542eb9a6b8c1937936924992b87516147ce122"} Mar 16 17:47:20 crc kubenswrapper[5120]: I0316 17:47:20.026929 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-db-create-bfchl" event={"ID":"2318cdd1-4506-4657-81d0-293f2d9ec62b","Type":"ContainerStarted","Data":"fbe88839e4e7422de92129cf95e98088d095dc07b7590bb6805744083d3e50b3"} Mar 16 17:47:20 crc kubenswrapper[5120]: I0316 17:47:20.029039 5120 generic.go:358] "Generic (PLEG): container finished" podID="065a7e21-0a4b-4a9b-80d0-17e1f634c2f7" containerID="15514f787a854cee7803aaf254ddca76436f9e6d41e8dcc6e5a3c306afd25fd5" exitCode=0 Mar 16 17:47:20 crc kubenswrapper[5120]: I0316 17:47:20.029135 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-1ab5-account-create-update-zfgxh" event={"ID":"065a7e21-0a4b-4a9b-80d0-17e1f634c2f7","Type":"ContainerDied","Data":"15514f787a854cee7803aaf254ddca76436f9e6d41e8dcc6e5a3c306afd25fd5"} Mar 16 17:47:20 crc kubenswrapper[5120]: I0316 17:47:20.029156 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-1ab5-account-create-update-zfgxh" event={"ID":"065a7e21-0a4b-4a9b-80d0-17e1f634c2f7","Type":"ContainerStarted","Data":"b038b676a041a3d9025bfef87c5349a07b2af3e62f20bed444bc894125c235a0"} Mar 16 17:47:21 crc kubenswrapper[5120]: I0316 17:47:21.425621 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-db-create-bfchl" Mar 16 17:47:21 crc kubenswrapper[5120]: I0316 17:47:21.431142 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-1ab5-account-create-update-zfgxh" Mar 16 17:47:21 crc kubenswrapper[5120]: I0316 17:47:21.554914 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hpp4h\" (UniqueName: \"kubernetes.io/projected/065a7e21-0a4b-4a9b-80d0-17e1f634c2f7-kube-api-access-hpp4h\") pod \"065a7e21-0a4b-4a9b-80d0-17e1f634c2f7\" (UID: \"065a7e21-0a4b-4a9b-80d0-17e1f634c2f7\") " Mar 16 17:47:21 crc kubenswrapper[5120]: I0316 17:47:21.555105 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kjnzp\" (UniqueName: \"kubernetes.io/projected/2318cdd1-4506-4657-81d0-293f2d9ec62b-kube-api-access-kjnzp\") pod \"2318cdd1-4506-4657-81d0-293f2d9ec62b\" (UID: \"2318cdd1-4506-4657-81d0-293f2d9ec62b\") " Mar 16 17:47:21 crc kubenswrapper[5120]: I0316 17:47:21.555361 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2318cdd1-4506-4657-81d0-293f2d9ec62b-operator-scripts\") pod \"2318cdd1-4506-4657-81d0-293f2d9ec62b\" (UID: \"2318cdd1-4506-4657-81d0-293f2d9ec62b\") " Mar 16 17:47:21 crc kubenswrapper[5120]: I0316 17:47:21.555565 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/065a7e21-0a4b-4a9b-80d0-17e1f634c2f7-operator-scripts\") pod \"065a7e21-0a4b-4a9b-80d0-17e1f634c2f7\" (UID: \"065a7e21-0a4b-4a9b-80d0-17e1f634c2f7\") " Mar 16 17:47:21 crc kubenswrapper[5120]: I0316 17:47:21.556493 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/065a7e21-0a4b-4a9b-80d0-17e1f634c2f7-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "065a7e21-0a4b-4a9b-80d0-17e1f634c2f7" (UID: "065a7e21-0a4b-4a9b-80d0-17e1f634c2f7"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:47:21 crc kubenswrapper[5120]: I0316 17:47:21.556536 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2318cdd1-4506-4657-81d0-293f2d9ec62b-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "2318cdd1-4506-4657-81d0-293f2d9ec62b" (UID: "2318cdd1-4506-4657-81d0-293f2d9ec62b"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:47:21 crc kubenswrapper[5120]: I0316 17:47:21.562313 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/065a7e21-0a4b-4a9b-80d0-17e1f634c2f7-kube-api-access-hpp4h" (OuterVolumeSpecName: "kube-api-access-hpp4h") pod "065a7e21-0a4b-4a9b-80d0-17e1f634c2f7" (UID: "065a7e21-0a4b-4a9b-80d0-17e1f634c2f7"). InnerVolumeSpecName "kube-api-access-hpp4h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:47:21 crc kubenswrapper[5120]: I0316 17:47:21.563205 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2318cdd1-4506-4657-81d0-293f2d9ec62b-kube-api-access-kjnzp" (OuterVolumeSpecName: "kube-api-access-kjnzp") pod "2318cdd1-4506-4657-81d0-293f2d9ec62b" (UID: "2318cdd1-4506-4657-81d0-293f2d9ec62b"). InnerVolumeSpecName "kube-api-access-kjnzp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:47:21 crc kubenswrapper[5120]: I0316 17:47:21.659098 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hpp4h\" (UniqueName: \"kubernetes.io/projected/065a7e21-0a4b-4a9b-80d0-17e1f634c2f7-kube-api-access-hpp4h\") on node \"crc\" DevicePath \"\"" Mar 16 17:47:21 crc kubenswrapper[5120]: I0316 17:47:21.659164 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kjnzp\" (UniqueName: \"kubernetes.io/projected/2318cdd1-4506-4657-81d0-293f2d9ec62b-kube-api-access-kjnzp\") on node \"crc\" DevicePath \"\"" Mar 16 17:47:21 crc kubenswrapper[5120]: I0316 17:47:21.659186 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2318cdd1-4506-4657-81d0-293f2d9ec62b-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:47:21 crc kubenswrapper[5120]: I0316 17:47:21.659207 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/065a7e21-0a4b-4a9b-80d0-17e1f634c2f7-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:47:22 crc kubenswrapper[5120]: I0316 17:47:22.047136 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-1ab5-account-create-update-zfgxh" Mar 16 17:47:22 crc kubenswrapper[5120]: I0316 17:47:22.047193 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-1ab5-account-create-update-zfgxh" event={"ID":"065a7e21-0a4b-4a9b-80d0-17e1f634c2f7","Type":"ContainerDied","Data":"b038b676a041a3d9025bfef87c5349a07b2af3e62f20bed444bc894125c235a0"} Mar 16 17:47:22 crc kubenswrapper[5120]: I0316 17:47:22.047247 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b038b676a041a3d9025bfef87c5349a07b2af3e62f20bed444bc894125c235a0" Mar 16 17:47:22 crc kubenswrapper[5120]: I0316 17:47:22.048943 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-db-create-bfchl" Mar 16 17:47:22 crc kubenswrapper[5120]: I0316 17:47:22.048961 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-db-create-bfchl" event={"ID":"2318cdd1-4506-4657-81d0-293f2d9ec62b","Type":"ContainerDied","Data":"fbe88839e4e7422de92129cf95e98088d095dc07b7590bb6805744083d3e50b3"} Mar 16 17:47:22 crc kubenswrapper[5120]: I0316 17:47:22.048995 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fbe88839e4e7422de92129cf95e98088d095dc07b7590bb6805744083d3e50b3" Mar 16 17:47:24 crc kubenswrapper[5120]: I0316 17:47:24.366376 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keystone-kuttl-tests/keystone-db-sync-rfs8b"] Mar 16 17:47:24 crc kubenswrapper[5120]: I0316 17:47:24.367926 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="065a7e21-0a4b-4a9b-80d0-17e1f634c2f7" containerName="mariadb-account-create-update" Mar 16 17:47:24 crc kubenswrapper[5120]: I0316 17:47:24.367947 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="065a7e21-0a4b-4a9b-80d0-17e1f634c2f7" containerName="mariadb-account-create-update" Mar 16 17:47:24 crc kubenswrapper[5120]: I0316 17:47:24.367998 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2318cdd1-4506-4657-81d0-293f2d9ec62b" containerName="mariadb-database-create" Mar 16 17:47:24 crc kubenswrapper[5120]: I0316 17:47:24.368008 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="2318cdd1-4506-4657-81d0-293f2d9ec62b" containerName="mariadb-database-create" Mar 16 17:47:24 crc kubenswrapper[5120]: I0316 17:47:24.368158 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="065a7e21-0a4b-4a9b-80d0-17e1f634c2f7" containerName="mariadb-account-create-update" Mar 16 17:47:24 crc kubenswrapper[5120]: I0316 17:47:24.368189 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="2318cdd1-4506-4657-81d0-293f2d9ec62b" containerName="mariadb-database-create" Mar 16 17:47:24 crc kubenswrapper[5120]: I0316 17:47:24.390517 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone-db-sync-rfs8b"] Mar 16 17:47:24 crc kubenswrapper[5120]: I0316 17:47:24.390673 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-db-sync-rfs8b" Mar 16 17:47:24 crc kubenswrapper[5120]: I0316 17:47:24.392584 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keystone-kuttl-tests\"/\"keystone-scripts\"" Mar 16 17:47:24 crc kubenswrapper[5120]: I0316 17:47:24.392804 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keystone-kuttl-tests\"/\"keystone-keystone-dockercfg-65n84\"" Mar 16 17:47:24 crc kubenswrapper[5120]: I0316 17:47:24.392678 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keystone-kuttl-tests\"/\"keystone-config-data\"" Mar 16 17:47:24 crc kubenswrapper[5120]: I0316 17:47:24.393789 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keystone-kuttl-tests\"/\"keystone\"" Mar 16 17:47:24 crc kubenswrapper[5120]: I0316 17:47:24.394076 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keystone-kuttl-tests\"/\"combined-ca-bundle\"" Mar 16 17:47:24 crc kubenswrapper[5120]: I0316 17:47:24.416099 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/819df21c-ecb1-4740-a7c6-e58a50fe624b-combined-ca-bundle\") pod \"keystone-db-sync-rfs8b\" (UID: \"819df21c-ecb1-4740-a7c6-e58a50fe624b\") " pod="keystone-kuttl-tests/keystone-db-sync-rfs8b" Mar 16 17:47:24 crc kubenswrapper[5120]: I0316 17:47:24.416354 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dns7q\" (UniqueName: \"kubernetes.io/projected/819df21c-ecb1-4740-a7c6-e58a50fe624b-kube-api-access-dns7q\") pod \"keystone-db-sync-rfs8b\" (UID: \"819df21c-ecb1-4740-a7c6-e58a50fe624b\") " pod="keystone-kuttl-tests/keystone-db-sync-rfs8b" Mar 16 17:47:24 crc kubenswrapper[5120]: I0316 17:47:24.416494 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/819df21c-ecb1-4740-a7c6-e58a50fe624b-config-data\") pod \"keystone-db-sync-rfs8b\" (UID: \"819df21c-ecb1-4740-a7c6-e58a50fe624b\") " pod="keystone-kuttl-tests/keystone-db-sync-rfs8b" Mar 16 17:47:24 crc kubenswrapper[5120]: I0316 17:47:24.518241 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/819df21c-ecb1-4740-a7c6-e58a50fe624b-combined-ca-bundle\") pod \"keystone-db-sync-rfs8b\" (UID: \"819df21c-ecb1-4740-a7c6-e58a50fe624b\") " pod="keystone-kuttl-tests/keystone-db-sync-rfs8b" Mar 16 17:47:24 crc kubenswrapper[5120]: I0316 17:47:24.518327 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dns7q\" (UniqueName: \"kubernetes.io/projected/819df21c-ecb1-4740-a7c6-e58a50fe624b-kube-api-access-dns7q\") pod \"keystone-db-sync-rfs8b\" (UID: \"819df21c-ecb1-4740-a7c6-e58a50fe624b\") " pod="keystone-kuttl-tests/keystone-db-sync-rfs8b" Mar 16 17:47:24 crc kubenswrapper[5120]: I0316 17:47:24.518389 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/819df21c-ecb1-4740-a7c6-e58a50fe624b-config-data\") pod \"keystone-db-sync-rfs8b\" (UID: \"819df21c-ecb1-4740-a7c6-e58a50fe624b\") " pod="keystone-kuttl-tests/keystone-db-sync-rfs8b" Mar 16 17:47:24 crc kubenswrapper[5120]: I0316 17:47:24.524911 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/819df21c-ecb1-4740-a7c6-e58a50fe624b-combined-ca-bundle\") pod \"keystone-db-sync-rfs8b\" (UID: \"819df21c-ecb1-4740-a7c6-e58a50fe624b\") " pod="keystone-kuttl-tests/keystone-db-sync-rfs8b" Mar 16 17:47:24 crc kubenswrapper[5120]: I0316 17:47:24.526005 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/819df21c-ecb1-4740-a7c6-e58a50fe624b-config-data\") pod \"keystone-db-sync-rfs8b\" (UID: \"819df21c-ecb1-4740-a7c6-e58a50fe624b\") " pod="keystone-kuttl-tests/keystone-db-sync-rfs8b" Mar 16 17:47:24 crc kubenswrapper[5120]: I0316 17:47:24.535477 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dns7q\" (UniqueName: \"kubernetes.io/projected/819df21c-ecb1-4740-a7c6-e58a50fe624b-kube-api-access-dns7q\") pod \"keystone-db-sync-rfs8b\" (UID: \"819df21c-ecb1-4740-a7c6-e58a50fe624b\") " pod="keystone-kuttl-tests/keystone-db-sync-rfs8b" Mar 16 17:47:24 crc kubenswrapper[5120]: I0316 17:47:24.710714 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-db-sync-rfs8b" Mar 16 17:47:25 crc kubenswrapper[5120]: I0316 17:47:25.113875 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone-db-sync-rfs8b"] Mar 16 17:47:26 crc kubenswrapper[5120]: I0316 17:47:26.078638 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-db-sync-rfs8b" event={"ID":"819df21c-ecb1-4740-a7c6-e58a50fe624b","Type":"ContainerStarted","Data":"cd9a265973210db6ec85070810ef62cc7a6a2e9007307221c2452d48ee3f8706"} Mar 16 17:47:26 crc kubenswrapper[5120]: I0316 17:47:26.078995 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-db-sync-rfs8b" event={"ID":"819df21c-ecb1-4740-a7c6-e58a50fe624b","Type":"ContainerStarted","Data":"d9550d8899032593d6c254e3f17c9f5c0aad574f6b87d276672114e47f08fa37"} Mar 16 17:47:27 crc kubenswrapper[5120]: I0316 17:47:27.089938 5120 generic.go:358] "Generic (PLEG): container finished" podID="819df21c-ecb1-4740-a7c6-e58a50fe624b" containerID="cd9a265973210db6ec85070810ef62cc7a6a2e9007307221c2452d48ee3f8706" exitCode=0 Mar 16 17:47:27 crc kubenswrapper[5120]: I0316 17:47:27.089985 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-db-sync-rfs8b" event={"ID":"819df21c-ecb1-4740-a7c6-e58a50fe624b","Type":"ContainerDied","Data":"cd9a265973210db6ec85070810ef62cc7a6a2e9007307221c2452d48ee3f8706"} Mar 16 17:47:28 crc kubenswrapper[5120]: I0316 17:47:28.458523 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-db-sync-rfs8b" Mar 16 17:47:28 crc kubenswrapper[5120]: I0316 17:47:28.506125 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/819df21c-ecb1-4740-a7c6-e58a50fe624b-config-data\") pod \"819df21c-ecb1-4740-a7c6-e58a50fe624b\" (UID: \"819df21c-ecb1-4740-a7c6-e58a50fe624b\") " Mar 16 17:47:28 crc kubenswrapper[5120]: I0316 17:47:28.506350 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/819df21c-ecb1-4740-a7c6-e58a50fe624b-combined-ca-bundle\") pod \"819df21c-ecb1-4740-a7c6-e58a50fe624b\" (UID: \"819df21c-ecb1-4740-a7c6-e58a50fe624b\") " Mar 16 17:47:28 crc kubenswrapper[5120]: I0316 17:47:28.508372 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dns7q\" (UniqueName: \"kubernetes.io/projected/819df21c-ecb1-4740-a7c6-e58a50fe624b-kube-api-access-dns7q\") pod \"819df21c-ecb1-4740-a7c6-e58a50fe624b\" (UID: \"819df21c-ecb1-4740-a7c6-e58a50fe624b\") " Mar 16 17:47:28 crc kubenswrapper[5120]: I0316 17:47:28.513169 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/819df21c-ecb1-4740-a7c6-e58a50fe624b-kube-api-access-dns7q" (OuterVolumeSpecName: "kube-api-access-dns7q") pod "819df21c-ecb1-4740-a7c6-e58a50fe624b" (UID: "819df21c-ecb1-4740-a7c6-e58a50fe624b"). InnerVolumeSpecName "kube-api-access-dns7q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:47:28 crc kubenswrapper[5120]: I0316 17:47:28.541202 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/819df21c-ecb1-4740-a7c6-e58a50fe624b-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "819df21c-ecb1-4740-a7c6-e58a50fe624b" (UID: "819df21c-ecb1-4740-a7c6-e58a50fe624b"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:47:28 crc kubenswrapper[5120]: I0316 17:47:28.549426 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/819df21c-ecb1-4740-a7c6-e58a50fe624b-config-data" (OuterVolumeSpecName: "config-data") pod "819df21c-ecb1-4740-a7c6-e58a50fe624b" (UID: "819df21c-ecb1-4740-a7c6-e58a50fe624b"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:47:28 crc kubenswrapper[5120]: I0316 17:47:28.612133 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/819df21c-ecb1-4740-a7c6-e58a50fe624b-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:47:28 crc kubenswrapper[5120]: I0316 17:47:28.612172 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/819df21c-ecb1-4740-a7c6-e58a50fe624b-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:47:28 crc kubenswrapper[5120]: I0316 17:47:28.612189 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dns7q\" (UniqueName: \"kubernetes.io/projected/819df21c-ecb1-4740-a7c6-e58a50fe624b-kube-api-access-dns7q\") on node \"crc\" DevicePath \"\"" Mar 16 17:47:29 crc kubenswrapper[5120]: I0316 17:47:29.111238 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-db-sync-rfs8b" event={"ID":"819df21c-ecb1-4740-a7c6-e58a50fe624b","Type":"ContainerDied","Data":"d9550d8899032593d6c254e3f17c9f5c0aad574f6b87d276672114e47f08fa37"} Mar 16 17:47:29 crc kubenswrapper[5120]: I0316 17:47:29.111305 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d9550d8899032593d6c254e3f17c9f5c0aad574f6b87d276672114e47f08fa37" Mar 16 17:47:29 crc kubenswrapper[5120]: I0316 17:47:29.111397 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-db-sync-rfs8b" Mar 16 17:47:29 crc kubenswrapper[5120]: I0316 17:47:29.349287 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keystone-kuttl-tests/keystone-bootstrap-c574m"] Mar 16 17:47:29 crc kubenswrapper[5120]: I0316 17:47:29.351066 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="819df21c-ecb1-4740-a7c6-e58a50fe624b" containerName="keystone-db-sync" Mar 16 17:47:29 crc kubenswrapper[5120]: I0316 17:47:29.351306 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="819df21c-ecb1-4740-a7c6-e58a50fe624b" containerName="keystone-db-sync" Mar 16 17:47:29 crc kubenswrapper[5120]: I0316 17:47:29.354716 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="819df21c-ecb1-4740-a7c6-e58a50fe624b" containerName="keystone-db-sync" Mar 16 17:47:29 crc kubenswrapper[5120]: I0316 17:47:29.364654 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone-bootstrap-c574m"] Mar 16 17:47:29 crc kubenswrapper[5120]: I0316 17:47:29.364860 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-bootstrap-c574m" Mar 16 17:47:29 crc kubenswrapper[5120]: I0316 17:47:29.366943 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keystone-kuttl-tests\"/\"keystone-keystone-dockercfg-65n84\"" Mar 16 17:47:29 crc kubenswrapper[5120]: I0316 17:47:29.367026 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keystone-kuttl-tests\"/\"keystone\"" Mar 16 17:47:29 crc kubenswrapper[5120]: I0316 17:47:29.366958 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keystone-kuttl-tests\"/\"keystone-scripts\"" Mar 16 17:47:29 crc kubenswrapper[5120]: I0316 17:47:29.367680 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keystone-kuttl-tests\"/\"combined-ca-bundle\"" Mar 16 17:47:29 crc kubenswrapper[5120]: I0316 17:47:29.367923 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keystone-kuttl-tests\"/\"keystone-config-data\"" Mar 16 17:47:29 crc kubenswrapper[5120]: I0316 17:47:29.367951 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keystone-kuttl-tests\"/\"osp-secret\"" Mar 16 17:47:29 crc kubenswrapper[5120]: I0316 17:47:29.434707 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrpcd\" (UniqueName: \"kubernetes.io/projected/83d1328e-f19f-43fb-98a9-a45985907875-kube-api-access-nrpcd\") pod \"keystone-bootstrap-c574m\" (UID: \"83d1328e-f19f-43fb-98a9-a45985907875\") " pod="keystone-kuttl-tests/keystone-bootstrap-c574m" Mar 16 17:47:29 crc kubenswrapper[5120]: I0316 17:47:29.434913 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/83d1328e-f19f-43fb-98a9-a45985907875-fernet-keys\") pod \"keystone-bootstrap-c574m\" (UID: \"83d1328e-f19f-43fb-98a9-a45985907875\") " pod="keystone-kuttl-tests/keystone-bootstrap-c574m" Mar 16 17:47:29 crc kubenswrapper[5120]: I0316 17:47:29.435004 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/83d1328e-f19f-43fb-98a9-a45985907875-credential-keys\") pod \"keystone-bootstrap-c574m\" (UID: \"83d1328e-f19f-43fb-98a9-a45985907875\") " pod="keystone-kuttl-tests/keystone-bootstrap-c574m" Mar 16 17:47:29 crc kubenswrapper[5120]: I0316 17:47:29.435133 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/83d1328e-f19f-43fb-98a9-a45985907875-config-data\") pod \"keystone-bootstrap-c574m\" (UID: \"83d1328e-f19f-43fb-98a9-a45985907875\") " pod="keystone-kuttl-tests/keystone-bootstrap-c574m" Mar 16 17:47:29 crc kubenswrapper[5120]: I0316 17:47:29.435379 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/83d1328e-f19f-43fb-98a9-a45985907875-scripts\") pod \"keystone-bootstrap-c574m\" (UID: \"83d1328e-f19f-43fb-98a9-a45985907875\") " pod="keystone-kuttl-tests/keystone-bootstrap-c574m" Mar 16 17:47:29 crc kubenswrapper[5120]: I0316 17:47:29.435446 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/83d1328e-f19f-43fb-98a9-a45985907875-combined-ca-bundle\") pod \"keystone-bootstrap-c574m\" (UID: \"83d1328e-f19f-43fb-98a9-a45985907875\") " pod="keystone-kuttl-tests/keystone-bootstrap-c574m" Mar 16 17:47:29 crc kubenswrapper[5120]: I0316 17:47:29.536944 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nrpcd\" (UniqueName: \"kubernetes.io/projected/83d1328e-f19f-43fb-98a9-a45985907875-kube-api-access-nrpcd\") pod \"keystone-bootstrap-c574m\" (UID: \"83d1328e-f19f-43fb-98a9-a45985907875\") " pod="keystone-kuttl-tests/keystone-bootstrap-c574m" Mar 16 17:47:29 crc kubenswrapper[5120]: I0316 17:47:29.537437 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/83d1328e-f19f-43fb-98a9-a45985907875-fernet-keys\") pod \"keystone-bootstrap-c574m\" (UID: \"83d1328e-f19f-43fb-98a9-a45985907875\") " pod="keystone-kuttl-tests/keystone-bootstrap-c574m" Mar 16 17:47:29 crc kubenswrapper[5120]: I0316 17:47:29.538110 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/83d1328e-f19f-43fb-98a9-a45985907875-credential-keys\") pod \"keystone-bootstrap-c574m\" (UID: \"83d1328e-f19f-43fb-98a9-a45985907875\") " pod="keystone-kuttl-tests/keystone-bootstrap-c574m" Mar 16 17:47:29 crc kubenswrapper[5120]: I0316 17:47:29.538143 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/83d1328e-f19f-43fb-98a9-a45985907875-config-data\") pod \"keystone-bootstrap-c574m\" (UID: \"83d1328e-f19f-43fb-98a9-a45985907875\") " pod="keystone-kuttl-tests/keystone-bootstrap-c574m" Mar 16 17:47:29 crc kubenswrapper[5120]: I0316 17:47:29.538270 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/83d1328e-f19f-43fb-98a9-a45985907875-scripts\") pod \"keystone-bootstrap-c574m\" (UID: \"83d1328e-f19f-43fb-98a9-a45985907875\") " pod="keystone-kuttl-tests/keystone-bootstrap-c574m" Mar 16 17:47:29 crc kubenswrapper[5120]: I0316 17:47:29.538317 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/83d1328e-f19f-43fb-98a9-a45985907875-combined-ca-bundle\") pod \"keystone-bootstrap-c574m\" (UID: \"83d1328e-f19f-43fb-98a9-a45985907875\") " pod="keystone-kuttl-tests/keystone-bootstrap-c574m" Mar 16 17:47:29 crc kubenswrapper[5120]: I0316 17:47:29.542190 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/83d1328e-f19f-43fb-98a9-a45985907875-scripts\") pod \"keystone-bootstrap-c574m\" (UID: \"83d1328e-f19f-43fb-98a9-a45985907875\") " pod="keystone-kuttl-tests/keystone-bootstrap-c574m" Mar 16 17:47:29 crc kubenswrapper[5120]: I0316 17:47:29.548813 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/83d1328e-f19f-43fb-98a9-a45985907875-credential-keys\") pod \"keystone-bootstrap-c574m\" (UID: \"83d1328e-f19f-43fb-98a9-a45985907875\") " pod="keystone-kuttl-tests/keystone-bootstrap-c574m" Mar 16 17:47:29 crc kubenswrapper[5120]: I0316 17:47:29.548888 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/83d1328e-f19f-43fb-98a9-a45985907875-config-data\") pod \"keystone-bootstrap-c574m\" (UID: \"83d1328e-f19f-43fb-98a9-a45985907875\") " pod="keystone-kuttl-tests/keystone-bootstrap-c574m" Mar 16 17:47:29 crc kubenswrapper[5120]: I0316 17:47:29.548902 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/83d1328e-f19f-43fb-98a9-a45985907875-fernet-keys\") pod \"keystone-bootstrap-c574m\" (UID: \"83d1328e-f19f-43fb-98a9-a45985907875\") " pod="keystone-kuttl-tests/keystone-bootstrap-c574m" Mar 16 17:47:29 crc kubenswrapper[5120]: I0316 17:47:29.549357 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/83d1328e-f19f-43fb-98a9-a45985907875-combined-ca-bundle\") pod \"keystone-bootstrap-c574m\" (UID: \"83d1328e-f19f-43fb-98a9-a45985907875\") " pod="keystone-kuttl-tests/keystone-bootstrap-c574m" Mar 16 17:47:29 crc kubenswrapper[5120]: I0316 17:47:29.553512 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrpcd\" (UniqueName: \"kubernetes.io/projected/83d1328e-f19f-43fb-98a9-a45985907875-kube-api-access-nrpcd\") pod \"keystone-bootstrap-c574m\" (UID: \"83d1328e-f19f-43fb-98a9-a45985907875\") " pod="keystone-kuttl-tests/keystone-bootstrap-c574m" Mar 16 17:47:29 crc kubenswrapper[5120]: I0316 17:47:29.683197 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-bootstrap-c574m" Mar 16 17:47:30 crc kubenswrapper[5120]: I0316 17:47:30.101071 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone-bootstrap-c574m"] Mar 16 17:47:30 crc kubenswrapper[5120]: I0316 17:47:30.125427 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-bootstrap-c574m" event={"ID":"83d1328e-f19f-43fb-98a9-a45985907875","Type":"ContainerStarted","Data":"982e677fc9da44b727808b5af0401d565774967622e15a28c3b20ce7487ff02d"} Mar 16 17:47:31 crc kubenswrapper[5120]: I0316 17:47:31.134877 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-bootstrap-c574m" event={"ID":"83d1328e-f19f-43fb-98a9-a45985907875","Type":"ContainerStarted","Data":"828e613106ceafe20677251328d7b15861e6b5d455fb9a11dc6b169298e7ecd1"} Mar 16 17:47:31 crc kubenswrapper[5120]: I0316 17:47:31.154928 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keystone-kuttl-tests/keystone-bootstrap-c574m" podStartSLOduration=2.1549029490000002 podStartE2EDuration="2.154902949s" podCreationTimestamp="2026-03-16 17:47:29 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:47:31.15057185 +0000 UTC m=+8153.304503507" watchObservedRunningTime="2026-03-16 17:47:31.154902949 +0000 UTC m=+8153.308834616" Mar 16 17:47:33 crc kubenswrapper[5120]: I0316 17:47:33.151460 5120 generic.go:358] "Generic (PLEG): container finished" podID="83d1328e-f19f-43fb-98a9-a45985907875" containerID="828e613106ceafe20677251328d7b15861e6b5d455fb9a11dc6b169298e7ecd1" exitCode=0 Mar 16 17:47:33 crc kubenswrapper[5120]: I0316 17:47:33.151572 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-bootstrap-c574m" event={"ID":"83d1328e-f19f-43fb-98a9-a45985907875","Type":"ContainerDied","Data":"828e613106ceafe20677251328d7b15861e6b5d455fb9a11dc6b169298e7ecd1"} Mar 16 17:47:34 crc kubenswrapper[5120]: I0316 17:47:34.496285 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-bootstrap-c574m" Mar 16 17:47:34 crc kubenswrapper[5120]: I0316 17:47:34.652204 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/83d1328e-f19f-43fb-98a9-a45985907875-scripts\") pod \"83d1328e-f19f-43fb-98a9-a45985907875\" (UID: \"83d1328e-f19f-43fb-98a9-a45985907875\") " Mar 16 17:47:34 crc kubenswrapper[5120]: I0316 17:47:34.652319 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/83d1328e-f19f-43fb-98a9-a45985907875-config-data\") pod \"83d1328e-f19f-43fb-98a9-a45985907875\" (UID: \"83d1328e-f19f-43fb-98a9-a45985907875\") " Mar 16 17:47:34 crc kubenswrapper[5120]: I0316 17:47:34.652474 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/83d1328e-f19f-43fb-98a9-a45985907875-fernet-keys\") pod \"83d1328e-f19f-43fb-98a9-a45985907875\" (UID: \"83d1328e-f19f-43fb-98a9-a45985907875\") " Mar 16 17:47:34 crc kubenswrapper[5120]: I0316 17:47:34.652633 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/83d1328e-f19f-43fb-98a9-a45985907875-combined-ca-bundle\") pod \"83d1328e-f19f-43fb-98a9-a45985907875\" (UID: \"83d1328e-f19f-43fb-98a9-a45985907875\") " Mar 16 17:47:34 crc kubenswrapper[5120]: I0316 17:47:34.652739 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/83d1328e-f19f-43fb-98a9-a45985907875-credential-keys\") pod \"83d1328e-f19f-43fb-98a9-a45985907875\" (UID: \"83d1328e-f19f-43fb-98a9-a45985907875\") " Mar 16 17:47:34 crc kubenswrapper[5120]: I0316 17:47:34.652918 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nrpcd\" (UniqueName: \"kubernetes.io/projected/83d1328e-f19f-43fb-98a9-a45985907875-kube-api-access-nrpcd\") pod \"83d1328e-f19f-43fb-98a9-a45985907875\" (UID: \"83d1328e-f19f-43fb-98a9-a45985907875\") " Mar 16 17:47:34 crc kubenswrapper[5120]: I0316 17:47:34.658233 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/83d1328e-f19f-43fb-98a9-a45985907875-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "83d1328e-f19f-43fb-98a9-a45985907875" (UID: "83d1328e-f19f-43fb-98a9-a45985907875"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:47:34 crc kubenswrapper[5120]: I0316 17:47:34.658324 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/83d1328e-f19f-43fb-98a9-a45985907875-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "83d1328e-f19f-43fb-98a9-a45985907875" (UID: "83d1328e-f19f-43fb-98a9-a45985907875"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:47:34 crc kubenswrapper[5120]: I0316 17:47:34.658631 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83d1328e-f19f-43fb-98a9-a45985907875-kube-api-access-nrpcd" (OuterVolumeSpecName: "kube-api-access-nrpcd") pod "83d1328e-f19f-43fb-98a9-a45985907875" (UID: "83d1328e-f19f-43fb-98a9-a45985907875"). InnerVolumeSpecName "kube-api-access-nrpcd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:47:34 crc kubenswrapper[5120]: I0316 17:47:34.660792 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/83d1328e-f19f-43fb-98a9-a45985907875-scripts" (OuterVolumeSpecName: "scripts") pod "83d1328e-f19f-43fb-98a9-a45985907875" (UID: "83d1328e-f19f-43fb-98a9-a45985907875"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:47:34 crc kubenswrapper[5120]: I0316 17:47:34.676342 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/83d1328e-f19f-43fb-98a9-a45985907875-config-data" (OuterVolumeSpecName: "config-data") pod "83d1328e-f19f-43fb-98a9-a45985907875" (UID: "83d1328e-f19f-43fb-98a9-a45985907875"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:47:34 crc kubenswrapper[5120]: I0316 17:47:34.682937 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/83d1328e-f19f-43fb-98a9-a45985907875-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "83d1328e-f19f-43fb-98a9-a45985907875" (UID: "83d1328e-f19f-43fb-98a9-a45985907875"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:47:34 crc kubenswrapper[5120]: I0316 17:47:34.756363 5120 reconciler_common.go:299] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/83d1328e-f19f-43fb-98a9-a45985907875-fernet-keys\") on node \"crc\" DevicePath \"\"" Mar 16 17:47:34 crc kubenswrapper[5120]: I0316 17:47:34.756748 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/83d1328e-f19f-43fb-98a9-a45985907875-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:47:34 crc kubenswrapper[5120]: I0316 17:47:34.756860 5120 reconciler_common.go:299] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/83d1328e-f19f-43fb-98a9-a45985907875-credential-keys\") on node \"crc\" DevicePath \"\"" Mar 16 17:47:34 crc kubenswrapper[5120]: I0316 17:47:34.756925 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nrpcd\" (UniqueName: \"kubernetes.io/projected/83d1328e-f19f-43fb-98a9-a45985907875-kube-api-access-nrpcd\") on node \"crc\" DevicePath \"\"" Mar 16 17:47:34 crc kubenswrapper[5120]: I0316 17:47:34.756988 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/83d1328e-f19f-43fb-98a9-a45985907875-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:47:34 crc kubenswrapper[5120]: I0316 17:47:34.757043 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/83d1328e-f19f-43fb-98a9-a45985907875-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:47:35 crc kubenswrapper[5120]: I0316 17:47:35.169407 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-bootstrap-c574m" event={"ID":"83d1328e-f19f-43fb-98a9-a45985907875","Type":"ContainerDied","Data":"982e677fc9da44b727808b5af0401d565774967622e15a28c3b20ce7487ff02d"} Mar 16 17:47:35 crc kubenswrapper[5120]: I0316 17:47:35.169733 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="982e677fc9da44b727808b5af0401d565774967622e15a28c3b20ce7487ff02d" Mar 16 17:47:35 crc kubenswrapper[5120]: I0316 17:47:35.169817 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-bootstrap-c574m" Mar 16 17:47:35 crc kubenswrapper[5120]: I0316 17:47:35.251380 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keystone-kuttl-tests/keystone-78bdc58cc4-2tvpf"] Mar 16 17:47:35 crc kubenswrapper[5120]: I0316 17:47:35.252290 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83d1328e-f19f-43fb-98a9-a45985907875" containerName="keystone-bootstrap" Mar 16 17:47:35 crc kubenswrapper[5120]: I0316 17:47:35.252313 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="83d1328e-f19f-43fb-98a9-a45985907875" containerName="keystone-bootstrap" Mar 16 17:47:35 crc kubenswrapper[5120]: I0316 17:47:35.252445 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="83d1328e-f19f-43fb-98a9-a45985907875" containerName="keystone-bootstrap" Mar 16 17:47:35 crc kubenswrapper[5120]: I0316 17:47:35.264686 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-78bdc58cc4-2tvpf" Mar 16 17:47:35 crc kubenswrapper[5120]: I0316 17:47:35.268682 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keystone-kuttl-tests\"/\"keystone-scripts\"" Mar 16 17:47:35 crc kubenswrapper[5120]: I0316 17:47:35.268982 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keystone-kuttl-tests\"/\"combined-ca-bundle\"" Mar 16 17:47:35 crc kubenswrapper[5120]: I0316 17:47:35.269226 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keystone-kuttl-tests\"/\"keystone\"" Mar 16 17:47:35 crc kubenswrapper[5120]: I0316 17:47:35.269392 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keystone-kuttl-tests\"/\"cert-keystone-internal-svc\"" Mar 16 17:47:35 crc kubenswrapper[5120]: I0316 17:47:35.269553 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keystone-kuttl-tests\"/\"keystone-config-data\"" Mar 16 17:47:35 crc kubenswrapper[5120]: I0316 17:47:35.269610 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone-78bdc58cc4-2tvpf"] Mar 16 17:47:35 crc kubenswrapper[5120]: I0316 17:47:35.269909 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keystone-kuttl-tests\"/\"keystone-keystone-dockercfg-65n84\"" Mar 16 17:47:35 crc kubenswrapper[5120]: I0316 17:47:35.270051 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keystone-kuttl-tests\"/\"cert-keystone-public-svc\"" Mar 16 17:47:35 crc kubenswrapper[5120]: I0316 17:47:35.369784 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/6b393cd4-5705-41cc-a3de-d486f054802d-fernet-keys\") pod \"keystone-78bdc58cc4-2tvpf\" (UID: \"6b393cd4-5705-41cc-a3de-d486f054802d\") " pod="keystone-kuttl-tests/keystone-78bdc58cc4-2tvpf" Mar 16 17:47:35 crc kubenswrapper[5120]: I0316 17:47:35.369935 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6b393cd4-5705-41cc-a3de-d486f054802d-public-tls-certs\") pod \"keystone-78bdc58cc4-2tvpf\" (UID: \"6b393cd4-5705-41cc-a3de-d486f054802d\") " pod="keystone-kuttl-tests/keystone-78bdc58cc4-2tvpf" Mar 16 17:47:35 crc kubenswrapper[5120]: I0316 17:47:35.369988 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6b393cd4-5705-41cc-a3de-d486f054802d-combined-ca-bundle\") pod \"keystone-78bdc58cc4-2tvpf\" (UID: \"6b393cd4-5705-41cc-a3de-d486f054802d\") " pod="keystone-kuttl-tests/keystone-78bdc58cc4-2tvpf" Mar 16 17:47:35 crc kubenswrapper[5120]: I0316 17:47:35.370059 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6b393cd4-5705-41cc-a3de-d486f054802d-scripts\") pod \"keystone-78bdc58cc4-2tvpf\" (UID: \"6b393cd4-5705-41cc-a3de-d486f054802d\") " pod="keystone-kuttl-tests/keystone-78bdc58cc4-2tvpf" Mar 16 17:47:35 crc kubenswrapper[5120]: I0316 17:47:35.370082 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6b393cd4-5705-41cc-a3de-d486f054802d-internal-tls-certs\") pod \"keystone-78bdc58cc4-2tvpf\" (UID: \"6b393cd4-5705-41cc-a3de-d486f054802d\") " pod="keystone-kuttl-tests/keystone-78bdc58cc4-2tvpf" Mar 16 17:47:35 crc kubenswrapper[5120]: I0316 17:47:35.370125 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6b393cd4-5705-41cc-a3de-d486f054802d-config-data\") pod \"keystone-78bdc58cc4-2tvpf\" (UID: \"6b393cd4-5705-41cc-a3de-d486f054802d\") " pod="keystone-kuttl-tests/keystone-78bdc58cc4-2tvpf" Mar 16 17:47:35 crc kubenswrapper[5120]: I0316 17:47:35.370159 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/6b393cd4-5705-41cc-a3de-d486f054802d-credential-keys\") pod \"keystone-78bdc58cc4-2tvpf\" (UID: \"6b393cd4-5705-41cc-a3de-d486f054802d\") " pod="keystone-kuttl-tests/keystone-78bdc58cc4-2tvpf" Mar 16 17:47:35 crc kubenswrapper[5120]: I0316 17:47:35.370175 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptzmj\" (UniqueName: \"kubernetes.io/projected/6b393cd4-5705-41cc-a3de-d486f054802d-kube-api-access-ptzmj\") pod \"keystone-78bdc58cc4-2tvpf\" (UID: \"6b393cd4-5705-41cc-a3de-d486f054802d\") " pod="keystone-kuttl-tests/keystone-78bdc58cc4-2tvpf" Mar 16 17:47:35 crc kubenswrapper[5120]: I0316 17:47:35.472030 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6b393cd4-5705-41cc-a3de-d486f054802d-public-tls-certs\") pod \"keystone-78bdc58cc4-2tvpf\" (UID: \"6b393cd4-5705-41cc-a3de-d486f054802d\") " pod="keystone-kuttl-tests/keystone-78bdc58cc4-2tvpf" Mar 16 17:47:35 crc kubenswrapper[5120]: I0316 17:47:35.472128 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6b393cd4-5705-41cc-a3de-d486f054802d-combined-ca-bundle\") pod \"keystone-78bdc58cc4-2tvpf\" (UID: \"6b393cd4-5705-41cc-a3de-d486f054802d\") " pod="keystone-kuttl-tests/keystone-78bdc58cc4-2tvpf" Mar 16 17:47:35 crc kubenswrapper[5120]: I0316 17:47:35.472260 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6b393cd4-5705-41cc-a3de-d486f054802d-scripts\") pod \"keystone-78bdc58cc4-2tvpf\" (UID: \"6b393cd4-5705-41cc-a3de-d486f054802d\") " pod="keystone-kuttl-tests/keystone-78bdc58cc4-2tvpf" Mar 16 17:47:35 crc kubenswrapper[5120]: I0316 17:47:35.472295 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6b393cd4-5705-41cc-a3de-d486f054802d-internal-tls-certs\") pod \"keystone-78bdc58cc4-2tvpf\" (UID: \"6b393cd4-5705-41cc-a3de-d486f054802d\") " pod="keystone-kuttl-tests/keystone-78bdc58cc4-2tvpf" Mar 16 17:47:35 crc kubenswrapper[5120]: I0316 17:47:35.472451 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6b393cd4-5705-41cc-a3de-d486f054802d-config-data\") pod \"keystone-78bdc58cc4-2tvpf\" (UID: \"6b393cd4-5705-41cc-a3de-d486f054802d\") " pod="keystone-kuttl-tests/keystone-78bdc58cc4-2tvpf" Mar 16 17:47:35 crc kubenswrapper[5120]: I0316 17:47:35.472948 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/6b393cd4-5705-41cc-a3de-d486f054802d-credential-keys\") pod \"keystone-78bdc58cc4-2tvpf\" (UID: \"6b393cd4-5705-41cc-a3de-d486f054802d\") " pod="keystone-kuttl-tests/keystone-78bdc58cc4-2tvpf" Mar 16 17:47:35 crc kubenswrapper[5120]: I0316 17:47:35.472981 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ptzmj\" (UniqueName: \"kubernetes.io/projected/6b393cd4-5705-41cc-a3de-d486f054802d-kube-api-access-ptzmj\") pod \"keystone-78bdc58cc4-2tvpf\" (UID: \"6b393cd4-5705-41cc-a3de-d486f054802d\") " pod="keystone-kuttl-tests/keystone-78bdc58cc4-2tvpf" Mar 16 17:47:35 crc kubenswrapper[5120]: I0316 17:47:35.473155 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/6b393cd4-5705-41cc-a3de-d486f054802d-fernet-keys\") pod \"keystone-78bdc58cc4-2tvpf\" (UID: \"6b393cd4-5705-41cc-a3de-d486f054802d\") " pod="keystone-kuttl-tests/keystone-78bdc58cc4-2tvpf" Mar 16 17:47:35 crc kubenswrapper[5120]: I0316 17:47:35.477131 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6b393cd4-5705-41cc-a3de-d486f054802d-public-tls-certs\") pod \"keystone-78bdc58cc4-2tvpf\" (UID: \"6b393cd4-5705-41cc-a3de-d486f054802d\") " pod="keystone-kuttl-tests/keystone-78bdc58cc4-2tvpf" Mar 16 17:47:35 crc kubenswrapper[5120]: I0316 17:47:35.478425 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6b393cd4-5705-41cc-a3de-d486f054802d-scripts\") pod \"keystone-78bdc58cc4-2tvpf\" (UID: \"6b393cd4-5705-41cc-a3de-d486f054802d\") " pod="keystone-kuttl-tests/keystone-78bdc58cc4-2tvpf" Mar 16 17:47:35 crc kubenswrapper[5120]: I0316 17:47:35.478450 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6b393cd4-5705-41cc-a3de-d486f054802d-combined-ca-bundle\") pod \"keystone-78bdc58cc4-2tvpf\" (UID: \"6b393cd4-5705-41cc-a3de-d486f054802d\") " pod="keystone-kuttl-tests/keystone-78bdc58cc4-2tvpf" Mar 16 17:47:35 crc kubenswrapper[5120]: I0316 17:47:35.478749 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6b393cd4-5705-41cc-a3de-d486f054802d-config-data\") pod \"keystone-78bdc58cc4-2tvpf\" (UID: \"6b393cd4-5705-41cc-a3de-d486f054802d\") " pod="keystone-kuttl-tests/keystone-78bdc58cc4-2tvpf" Mar 16 17:47:35 crc kubenswrapper[5120]: I0316 17:47:35.480483 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/6b393cd4-5705-41cc-a3de-d486f054802d-fernet-keys\") pod \"keystone-78bdc58cc4-2tvpf\" (UID: \"6b393cd4-5705-41cc-a3de-d486f054802d\") " pod="keystone-kuttl-tests/keystone-78bdc58cc4-2tvpf" Mar 16 17:47:35 crc kubenswrapper[5120]: I0316 17:47:35.484436 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/6b393cd4-5705-41cc-a3de-d486f054802d-credential-keys\") pod \"keystone-78bdc58cc4-2tvpf\" (UID: \"6b393cd4-5705-41cc-a3de-d486f054802d\") " pod="keystone-kuttl-tests/keystone-78bdc58cc4-2tvpf" Mar 16 17:47:35 crc kubenswrapper[5120]: I0316 17:47:35.486791 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6b393cd4-5705-41cc-a3de-d486f054802d-internal-tls-certs\") pod \"keystone-78bdc58cc4-2tvpf\" (UID: \"6b393cd4-5705-41cc-a3de-d486f054802d\") " pod="keystone-kuttl-tests/keystone-78bdc58cc4-2tvpf" Mar 16 17:47:35 crc kubenswrapper[5120]: I0316 17:47:35.491294 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptzmj\" (UniqueName: \"kubernetes.io/projected/6b393cd4-5705-41cc-a3de-d486f054802d-kube-api-access-ptzmj\") pod \"keystone-78bdc58cc4-2tvpf\" (UID: \"6b393cd4-5705-41cc-a3de-d486f054802d\") " pod="keystone-kuttl-tests/keystone-78bdc58cc4-2tvpf" Mar 16 17:47:35 crc kubenswrapper[5120]: I0316 17:47:35.583518 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-78bdc58cc4-2tvpf" Mar 16 17:47:35 crc kubenswrapper[5120]: I0316 17:47:35.996394 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone-78bdc58cc4-2tvpf"] Mar 16 17:47:36 crc kubenswrapper[5120]: I0316 17:47:36.178034 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-78bdc58cc4-2tvpf" event={"ID":"6b393cd4-5705-41cc-a3de-d486f054802d","Type":"ContainerStarted","Data":"1c7256e09e0b09bb86f620700b68e69c2bdeddedc4d303ae3837f5124968d000"} Mar 16 17:47:36 crc kubenswrapper[5120]: I0316 17:47:36.178482 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-78bdc58cc4-2tvpf" event={"ID":"6b393cd4-5705-41cc-a3de-d486f054802d","Type":"ContainerStarted","Data":"2e39f08985cc5f788011b65dc0da3346a9ce2cab06063b9b4f28cddd6520bc31"} Mar 16 17:47:36 crc kubenswrapper[5120]: I0316 17:47:36.178528 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keystone-kuttl-tests/keystone-78bdc58cc4-2tvpf" Mar 16 17:47:36 crc kubenswrapper[5120]: I0316 17:47:36.201740 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keystone-kuttl-tests/keystone-78bdc58cc4-2tvpf" podStartSLOduration=1.2017135620000001 podStartE2EDuration="1.201713562s" podCreationTimestamp="2026-03-16 17:47:35 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:47:36.197858307 +0000 UTC m=+8158.351789984" watchObservedRunningTime="2026-03-16 17:47:36.201713562 +0000 UTC m=+8158.355645239" Mar 16 17:47:52 crc kubenswrapper[5120]: I0316 17:47:52.008091 5120 patch_prober.go:28] interesting pod/machine-config-daemon-7bf76 container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 17:47:52 crc kubenswrapper[5120]: I0316 17:47:52.008614 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 17:48:00 crc kubenswrapper[5120]: I0316 17:48:00.148723 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-infra/auto-csr-approver-29561388-tlc9w"] Mar 16 17:48:00 crc kubenswrapper[5120]: I0316 17:48:00.154864 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561388-tlc9w" Mar 16 17:48:00 crc kubenswrapper[5120]: I0316 17:48:00.157284 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-infra\"/\"csr-approver-sa-dockercfg-x2nsz\"" Mar 16 17:48:00 crc kubenswrapper[5120]: I0316 17:48:00.159243 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"kube-root-ca.crt\"" Mar 16 17:48:00 crc kubenswrapper[5120]: I0316 17:48:00.159335 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"openshift-service-ca.crt\"" Mar 16 17:48:00 crc kubenswrapper[5120]: I0316 17:48:00.173232 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561388-tlc9w"] Mar 16 17:48:00 crc kubenswrapper[5120]: I0316 17:48:00.272702 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tww65\" (UniqueName: \"kubernetes.io/projected/7f899422-9580-49f9-8de7-74caef90cdf5-kube-api-access-tww65\") pod \"auto-csr-approver-29561388-tlc9w\" (UID: \"7f899422-9580-49f9-8de7-74caef90cdf5\") " pod="openshift-infra/auto-csr-approver-29561388-tlc9w" Mar 16 17:48:00 crc kubenswrapper[5120]: I0316 17:48:00.376466 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tww65\" (UniqueName: \"kubernetes.io/projected/7f899422-9580-49f9-8de7-74caef90cdf5-kube-api-access-tww65\") pod \"auto-csr-approver-29561388-tlc9w\" (UID: \"7f899422-9580-49f9-8de7-74caef90cdf5\") " pod="openshift-infra/auto-csr-approver-29561388-tlc9w" Mar 16 17:48:00 crc kubenswrapper[5120]: I0316 17:48:00.422321 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tww65\" (UniqueName: \"kubernetes.io/projected/7f899422-9580-49f9-8de7-74caef90cdf5-kube-api-access-tww65\") pod \"auto-csr-approver-29561388-tlc9w\" (UID: \"7f899422-9580-49f9-8de7-74caef90cdf5\") " pod="openshift-infra/auto-csr-approver-29561388-tlc9w" Mar 16 17:48:00 crc kubenswrapper[5120]: I0316 17:48:00.492040 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561388-tlc9w" Mar 16 17:48:00 crc kubenswrapper[5120]: I0316 17:48:00.951889 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561388-tlc9w"] Mar 16 17:48:01 crc kubenswrapper[5120]: I0316 17:48:01.400183 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561388-tlc9w" event={"ID":"7f899422-9580-49f9-8de7-74caef90cdf5","Type":"ContainerStarted","Data":"6a9d5f9214e158610dcbd50ad17efde59e42f0984282926e70694bca0e62ab5c"} Mar 16 17:48:02 crc kubenswrapper[5120]: I0316 17:48:02.409969 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561388-tlc9w" event={"ID":"7f899422-9580-49f9-8de7-74caef90cdf5","Type":"ContainerStarted","Data":"11e3b02b70de3faffe8fab87480396fd74646e29175192a26ed6d952ed0dde8f"} Mar 16 17:48:02 crc kubenswrapper[5120]: I0316 17:48:02.425936 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-infra/auto-csr-approver-29561388-tlc9w" podStartSLOduration=1.367939207 podStartE2EDuration="2.425917255s" podCreationTimestamp="2026-03-16 17:48:00 +0000 UTC" firstStartedPulling="2026-03-16 17:48:00.956057995 +0000 UTC m=+8183.109989672" lastFinishedPulling="2026-03-16 17:48:02.014036063 +0000 UTC m=+8184.167967720" observedRunningTime="2026-03-16 17:48:02.42099812 +0000 UTC m=+8184.574929777" watchObservedRunningTime="2026-03-16 17:48:02.425917255 +0000 UTC m=+8184.579848912" Mar 16 17:48:03 crc kubenswrapper[5120]: I0316 17:48:03.421618 5120 generic.go:358] "Generic (PLEG): container finished" podID="7f899422-9580-49f9-8de7-74caef90cdf5" containerID="11e3b02b70de3faffe8fab87480396fd74646e29175192a26ed6d952ed0dde8f" exitCode=0 Mar 16 17:48:03 crc kubenswrapper[5120]: I0316 17:48:03.421682 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561388-tlc9w" event={"ID":"7f899422-9580-49f9-8de7-74caef90cdf5","Type":"ContainerDied","Data":"11e3b02b70de3faffe8fab87480396fd74646e29175192a26ed6d952ed0dde8f"} Mar 16 17:48:04 crc kubenswrapper[5120]: I0316 17:48:04.702411 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561388-tlc9w" Mar 16 17:48:04 crc kubenswrapper[5120]: I0316 17:48:04.896508 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tww65\" (UniqueName: \"kubernetes.io/projected/7f899422-9580-49f9-8de7-74caef90cdf5-kube-api-access-tww65\") pod \"7f899422-9580-49f9-8de7-74caef90cdf5\" (UID: \"7f899422-9580-49f9-8de7-74caef90cdf5\") " Mar 16 17:48:04 crc kubenswrapper[5120]: I0316 17:48:04.902746 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f899422-9580-49f9-8de7-74caef90cdf5-kube-api-access-tww65" (OuterVolumeSpecName: "kube-api-access-tww65") pod "7f899422-9580-49f9-8de7-74caef90cdf5" (UID: "7f899422-9580-49f9-8de7-74caef90cdf5"). InnerVolumeSpecName "kube-api-access-tww65". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:48:04 crc kubenswrapper[5120]: I0316 17:48:04.999706 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tww65\" (UniqueName: \"kubernetes.io/projected/7f899422-9580-49f9-8de7-74caef90cdf5-kube-api-access-tww65\") on node \"crc\" DevicePath \"\"" Mar 16 17:48:05 crc kubenswrapper[5120]: I0316 17:48:05.438414 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561388-tlc9w" Mar 16 17:48:05 crc kubenswrapper[5120]: I0316 17:48:05.438458 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561388-tlc9w" event={"ID":"7f899422-9580-49f9-8de7-74caef90cdf5","Type":"ContainerDied","Data":"6a9d5f9214e158610dcbd50ad17efde59e42f0984282926e70694bca0e62ab5c"} Mar 16 17:48:05 crc kubenswrapper[5120]: I0316 17:48:05.438489 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6a9d5f9214e158610dcbd50ad17efde59e42f0984282926e70694bca0e62ab5c" Mar 16 17:48:05 crc kubenswrapper[5120]: I0316 17:48:05.489933 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-infra/auto-csr-approver-29561382-gr8wj"] Mar 16 17:48:05 crc kubenswrapper[5120]: I0316 17:48:05.495682 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-infra/auto-csr-approver-29561382-gr8wj"] Mar 16 17:48:06 crc kubenswrapper[5120]: I0316 17:48:06.675030 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="41e1d9f8-34bb-4e85-84ba-b103f93d9c56" path="/var/lib/kubelet/pods/41e1d9f8-34bb-4e85-84ba-b103f93d9c56/volumes" Mar 16 17:48:07 crc kubenswrapper[5120]: E0316 17:48:07.527057 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1111169 actualBytes=10240 Mar 16 17:48:08 crc kubenswrapper[5120]: I0316 17:48:08.547196 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="keystone-kuttl-tests/keystone-78bdc58cc4-2tvpf" Mar 16 17:48:10 crc kubenswrapper[5120]: I0316 17:48:10.133802 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keystone-kuttl-tests/keystone-bootstrap-c574m"] Mar 16 17:48:10 crc kubenswrapper[5120]: I0316 17:48:10.146138 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["keystone-kuttl-tests/keystone-bootstrap-c574m"] Mar 16 17:48:10 crc kubenswrapper[5120]: I0316 17:48:10.152487 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keystone-kuttl-tests/keystone-db-sync-rfs8b"] Mar 16 17:48:10 crc kubenswrapper[5120]: I0316 17:48:10.161874 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["keystone-kuttl-tests/keystone-db-sync-rfs8b"] Mar 16 17:48:10 crc kubenswrapper[5120]: I0316 17:48:10.168229 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keystone-kuttl-tests/keystone-78bdc58cc4-2tvpf"] Mar 16 17:48:10 crc kubenswrapper[5120]: I0316 17:48:10.168471 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="keystone-kuttl-tests/keystone-78bdc58cc4-2tvpf" podUID="6b393cd4-5705-41cc-a3de-d486f054802d" containerName="keystone-api" containerID="cri-o://1c7256e09e0b09bb86f620700b68e69c2bdeddedc4d303ae3837f5124968d000" gracePeriod=30 Mar 16 17:48:10 crc kubenswrapper[5120]: I0316 17:48:10.180461 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keystone-kuttl-tests/keystone1ab5-account-delete-fttsk"] Mar 16 17:48:10 crc kubenswrapper[5120]: I0316 17:48:10.181310 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f899422-9580-49f9-8de7-74caef90cdf5" containerName="oc" Mar 16 17:48:10 crc kubenswrapper[5120]: I0316 17:48:10.181326 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f899422-9580-49f9-8de7-74caef90cdf5" containerName="oc" Mar 16 17:48:10 crc kubenswrapper[5120]: I0316 17:48:10.181506 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7f899422-9580-49f9-8de7-74caef90cdf5" containerName="oc" Mar 16 17:48:10 crc kubenswrapper[5120]: I0316 17:48:10.193360 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone1ab5-account-delete-fttsk" Mar 16 17:48:10 crc kubenswrapper[5120]: I0316 17:48:10.198850 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone1ab5-account-delete-fttsk"] Mar 16 17:48:10 crc kubenswrapper[5120]: I0316 17:48:10.330557 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fj5gv\" (UniqueName: \"kubernetes.io/projected/e195f631-96b0-4ceb-a8f9-a5fc7aa013b1-kube-api-access-fj5gv\") pod \"keystone1ab5-account-delete-fttsk\" (UID: \"e195f631-96b0-4ceb-a8f9-a5fc7aa013b1\") " pod="keystone-kuttl-tests/keystone1ab5-account-delete-fttsk" Mar 16 17:48:10 crc kubenswrapper[5120]: I0316 17:48:10.330821 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e195f631-96b0-4ceb-a8f9-a5fc7aa013b1-operator-scripts\") pod \"keystone1ab5-account-delete-fttsk\" (UID: \"e195f631-96b0-4ceb-a8f9-a5fc7aa013b1\") " pod="keystone-kuttl-tests/keystone1ab5-account-delete-fttsk" Mar 16 17:48:10 crc kubenswrapper[5120]: I0316 17:48:10.433612 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fj5gv\" (UniqueName: \"kubernetes.io/projected/e195f631-96b0-4ceb-a8f9-a5fc7aa013b1-kube-api-access-fj5gv\") pod \"keystone1ab5-account-delete-fttsk\" (UID: \"e195f631-96b0-4ceb-a8f9-a5fc7aa013b1\") " pod="keystone-kuttl-tests/keystone1ab5-account-delete-fttsk" Mar 16 17:48:10 crc kubenswrapper[5120]: I0316 17:48:10.433752 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e195f631-96b0-4ceb-a8f9-a5fc7aa013b1-operator-scripts\") pod \"keystone1ab5-account-delete-fttsk\" (UID: \"e195f631-96b0-4ceb-a8f9-a5fc7aa013b1\") " pod="keystone-kuttl-tests/keystone1ab5-account-delete-fttsk" Mar 16 17:48:10 crc kubenswrapper[5120]: I0316 17:48:10.435151 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e195f631-96b0-4ceb-a8f9-a5fc7aa013b1-operator-scripts\") pod \"keystone1ab5-account-delete-fttsk\" (UID: \"e195f631-96b0-4ceb-a8f9-a5fc7aa013b1\") " pod="keystone-kuttl-tests/keystone1ab5-account-delete-fttsk" Mar 16 17:48:10 crc kubenswrapper[5120]: I0316 17:48:10.451875 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fj5gv\" (UniqueName: \"kubernetes.io/projected/e195f631-96b0-4ceb-a8f9-a5fc7aa013b1-kube-api-access-fj5gv\") pod \"keystone1ab5-account-delete-fttsk\" (UID: \"e195f631-96b0-4ceb-a8f9-a5fc7aa013b1\") " pod="keystone-kuttl-tests/keystone1ab5-account-delete-fttsk" Mar 16 17:48:10 crc kubenswrapper[5120]: I0316 17:48:10.511834 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone1ab5-account-delete-fttsk" Mar 16 17:48:10 crc kubenswrapper[5120]: I0316 17:48:10.672803 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="819df21c-ecb1-4740-a7c6-e58a50fe624b" path="/var/lib/kubelet/pods/819df21c-ecb1-4740-a7c6-e58a50fe624b/volumes" Mar 16 17:48:10 crc kubenswrapper[5120]: I0316 17:48:10.673776 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="83d1328e-f19f-43fb-98a9-a45985907875" path="/var/lib/kubelet/pods/83d1328e-f19f-43fb-98a9-a45985907875/volumes" Mar 16 17:48:10 crc kubenswrapper[5120]: I0316 17:48:10.926377 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone1ab5-account-delete-fttsk"] Mar 16 17:48:10 crc kubenswrapper[5120]: W0316 17:48:10.940228 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode195f631_96b0_4ceb_a8f9_a5fc7aa013b1.slice/crio-639255a759a796aacda452289d6102d31080e4e9f018fd58a414d0af3c1f6458 WatchSource:0}: Error finding container 639255a759a796aacda452289d6102d31080e4e9f018fd58a414d0af3c1f6458: Status 404 returned error can't find the container with id 639255a759a796aacda452289d6102d31080e4e9f018fd58a414d0af3c1f6458 Mar 16 17:48:11 crc kubenswrapper[5120]: I0316 17:48:11.487877 5120 generic.go:358] "Generic (PLEG): container finished" podID="e195f631-96b0-4ceb-a8f9-a5fc7aa013b1" containerID="24d322e9f6da173e01b31c1b2942a96118e4a37f99062900cc1abca269966551" exitCode=0 Mar 16 17:48:11 crc kubenswrapper[5120]: I0316 17:48:11.487978 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone1ab5-account-delete-fttsk" event={"ID":"e195f631-96b0-4ceb-a8f9-a5fc7aa013b1","Type":"ContainerDied","Data":"24d322e9f6da173e01b31c1b2942a96118e4a37f99062900cc1abca269966551"} Mar 16 17:48:11 crc kubenswrapper[5120]: I0316 17:48:11.488024 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone1ab5-account-delete-fttsk" event={"ID":"e195f631-96b0-4ceb-a8f9-a5fc7aa013b1","Type":"ContainerStarted","Data":"639255a759a796aacda452289d6102d31080e4e9f018fd58a414d0af3c1f6458"} Mar 16 17:48:12 crc kubenswrapper[5120]: I0316 17:48:12.793379 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone1ab5-account-delete-fttsk" Mar 16 17:48:12 crc kubenswrapper[5120]: I0316 17:48:12.894315 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fj5gv\" (UniqueName: \"kubernetes.io/projected/e195f631-96b0-4ceb-a8f9-a5fc7aa013b1-kube-api-access-fj5gv\") pod \"e195f631-96b0-4ceb-a8f9-a5fc7aa013b1\" (UID: \"e195f631-96b0-4ceb-a8f9-a5fc7aa013b1\") " Mar 16 17:48:12 crc kubenswrapper[5120]: I0316 17:48:12.895391 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e195f631-96b0-4ceb-a8f9-a5fc7aa013b1-operator-scripts\") pod \"e195f631-96b0-4ceb-a8f9-a5fc7aa013b1\" (UID: \"e195f631-96b0-4ceb-a8f9-a5fc7aa013b1\") " Mar 16 17:48:12 crc kubenswrapper[5120]: I0316 17:48:12.896317 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e195f631-96b0-4ceb-a8f9-a5fc7aa013b1-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "e195f631-96b0-4ceb-a8f9-a5fc7aa013b1" (UID: "e195f631-96b0-4ceb-a8f9-a5fc7aa013b1"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:48:12 crc kubenswrapper[5120]: I0316 17:48:12.901403 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e195f631-96b0-4ceb-a8f9-a5fc7aa013b1-kube-api-access-fj5gv" (OuterVolumeSpecName: "kube-api-access-fj5gv") pod "e195f631-96b0-4ceb-a8f9-a5fc7aa013b1" (UID: "e195f631-96b0-4ceb-a8f9-a5fc7aa013b1"). InnerVolumeSpecName "kube-api-access-fj5gv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:48:12 crc kubenswrapper[5120]: I0316 17:48:12.998581 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e195f631-96b0-4ceb-a8f9-a5fc7aa013b1-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:48:12 crc kubenswrapper[5120]: I0316 17:48:12.998616 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fj5gv\" (UniqueName: \"kubernetes.io/projected/e195f631-96b0-4ceb-a8f9-a5fc7aa013b1-kube-api-access-fj5gv\") on node \"crc\" DevicePath \"\"" Mar 16 17:48:13 crc kubenswrapper[5120]: I0316 17:48:13.519156 5120 generic.go:358] "Generic (PLEG): container finished" podID="6b393cd4-5705-41cc-a3de-d486f054802d" containerID="1c7256e09e0b09bb86f620700b68e69c2bdeddedc4d303ae3837f5124968d000" exitCode=0 Mar 16 17:48:13 crc kubenswrapper[5120]: I0316 17:48:13.519297 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-78bdc58cc4-2tvpf" event={"ID":"6b393cd4-5705-41cc-a3de-d486f054802d","Type":"ContainerDied","Data":"1c7256e09e0b09bb86f620700b68e69c2bdeddedc4d303ae3837f5124968d000"} Mar 16 17:48:13 crc kubenswrapper[5120]: I0316 17:48:13.528617 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone1ab5-account-delete-fttsk" event={"ID":"e195f631-96b0-4ceb-a8f9-a5fc7aa013b1","Type":"ContainerDied","Data":"639255a759a796aacda452289d6102d31080e4e9f018fd58a414d0af3c1f6458"} Mar 16 17:48:13 crc kubenswrapper[5120]: I0316 17:48:13.528684 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="639255a759a796aacda452289d6102d31080e4e9f018fd58a414d0af3c1f6458" Mar 16 17:48:13 crc kubenswrapper[5120]: I0316 17:48:13.528686 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone1ab5-account-delete-fttsk" Mar 16 17:48:13 crc kubenswrapper[5120]: I0316 17:48:13.633691 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-78bdc58cc4-2tvpf" Mar 16 17:48:13 crc kubenswrapper[5120]: I0316 17:48:13.722269 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6b393cd4-5705-41cc-a3de-d486f054802d-internal-tls-certs\") pod \"6b393cd4-5705-41cc-a3de-d486f054802d\" (UID: \"6b393cd4-5705-41cc-a3de-d486f054802d\") " Mar 16 17:48:13 crc kubenswrapper[5120]: I0316 17:48:13.723041 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6b393cd4-5705-41cc-a3de-d486f054802d-combined-ca-bundle\") pod \"6b393cd4-5705-41cc-a3de-d486f054802d\" (UID: \"6b393cd4-5705-41cc-a3de-d486f054802d\") " Mar 16 17:48:13 crc kubenswrapper[5120]: I0316 17:48:13.723107 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/6b393cd4-5705-41cc-a3de-d486f054802d-credential-keys\") pod \"6b393cd4-5705-41cc-a3de-d486f054802d\" (UID: \"6b393cd4-5705-41cc-a3de-d486f054802d\") " Mar 16 17:48:13 crc kubenswrapper[5120]: I0316 17:48:13.723490 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6b393cd4-5705-41cc-a3de-d486f054802d-config-data\") pod \"6b393cd4-5705-41cc-a3de-d486f054802d\" (UID: \"6b393cd4-5705-41cc-a3de-d486f054802d\") " Mar 16 17:48:13 crc kubenswrapper[5120]: I0316 17:48:13.723536 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/6b393cd4-5705-41cc-a3de-d486f054802d-fernet-keys\") pod \"6b393cd4-5705-41cc-a3de-d486f054802d\" (UID: \"6b393cd4-5705-41cc-a3de-d486f054802d\") " Mar 16 17:48:13 crc kubenswrapper[5120]: I0316 17:48:13.724007 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6b393cd4-5705-41cc-a3de-d486f054802d-public-tls-certs\") pod \"6b393cd4-5705-41cc-a3de-d486f054802d\" (UID: \"6b393cd4-5705-41cc-a3de-d486f054802d\") " Mar 16 17:48:13 crc kubenswrapper[5120]: I0316 17:48:13.724095 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ptzmj\" (UniqueName: \"kubernetes.io/projected/6b393cd4-5705-41cc-a3de-d486f054802d-kube-api-access-ptzmj\") pod \"6b393cd4-5705-41cc-a3de-d486f054802d\" (UID: \"6b393cd4-5705-41cc-a3de-d486f054802d\") " Mar 16 17:48:13 crc kubenswrapper[5120]: I0316 17:48:13.724125 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6b393cd4-5705-41cc-a3de-d486f054802d-scripts\") pod \"6b393cd4-5705-41cc-a3de-d486f054802d\" (UID: \"6b393cd4-5705-41cc-a3de-d486f054802d\") " Mar 16 17:48:13 crc kubenswrapper[5120]: I0316 17:48:13.728154 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b393cd4-5705-41cc-a3de-d486f054802d-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "6b393cd4-5705-41cc-a3de-d486f054802d" (UID: "6b393cd4-5705-41cc-a3de-d486f054802d"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:48:13 crc kubenswrapper[5120]: I0316 17:48:13.728197 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b393cd4-5705-41cc-a3de-d486f054802d-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "6b393cd4-5705-41cc-a3de-d486f054802d" (UID: "6b393cd4-5705-41cc-a3de-d486f054802d"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:48:13 crc kubenswrapper[5120]: I0316 17:48:13.731574 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b393cd4-5705-41cc-a3de-d486f054802d-scripts" (OuterVolumeSpecName: "scripts") pod "6b393cd4-5705-41cc-a3de-d486f054802d" (UID: "6b393cd4-5705-41cc-a3de-d486f054802d"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:48:13 crc kubenswrapper[5120]: I0316 17:48:13.732774 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b393cd4-5705-41cc-a3de-d486f054802d-kube-api-access-ptzmj" (OuterVolumeSpecName: "kube-api-access-ptzmj") pod "6b393cd4-5705-41cc-a3de-d486f054802d" (UID: "6b393cd4-5705-41cc-a3de-d486f054802d"). InnerVolumeSpecName "kube-api-access-ptzmj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:48:13 crc kubenswrapper[5120]: I0316 17:48:13.746249 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b393cd4-5705-41cc-a3de-d486f054802d-config-data" (OuterVolumeSpecName: "config-data") pod "6b393cd4-5705-41cc-a3de-d486f054802d" (UID: "6b393cd4-5705-41cc-a3de-d486f054802d"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:48:13 crc kubenswrapper[5120]: I0316 17:48:13.751123 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b393cd4-5705-41cc-a3de-d486f054802d-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "6b393cd4-5705-41cc-a3de-d486f054802d" (UID: "6b393cd4-5705-41cc-a3de-d486f054802d"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:48:13 crc kubenswrapper[5120]: I0316 17:48:13.760638 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b393cd4-5705-41cc-a3de-d486f054802d-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "6b393cd4-5705-41cc-a3de-d486f054802d" (UID: "6b393cd4-5705-41cc-a3de-d486f054802d"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:48:13 crc kubenswrapper[5120]: I0316 17:48:13.768368 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b393cd4-5705-41cc-a3de-d486f054802d-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "6b393cd4-5705-41cc-a3de-d486f054802d" (UID: "6b393cd4-5705-41cc-a3de-d486f054802d"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:48:13 crc kubenswrapper[5120]: I0316 17:48:13.828150 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6b393cd4-5705-41cc-a3de-d486f054802d-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 17:48:13 crc kubenswrapper[5120]: I0316 17:48:13.828183 5120 reconciler_common.go:299] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/6b393cd4-5705-41cc-a3de-d486f054802d-credential-keys\") on node \"crc\" DevicePath \"\"" Mar 16 17:48:13 crc kubenswrapper[5120]: I0316 17:48:13.828192 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6b393cd4-5705-41cc-a3de-d486f054802d-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:48:13 crc kubenswrapper[5120]: I0316 17:48:13.828202 5120 reconciler_common.go:299] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/6b393cd4-5705-41cc-a3de-d486f054802d-fernet-keys\") on node \"crc\" DevicePath \"\"" Mar 16 17:48:13 crc kubenswrapper[5120]: I0316 17:48:13.828210 5120 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6b393cd4-5705-41cc-a3de-d486f054802d-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:48:13 crc kubenswrapper[5120]: I0316 17:48:13.828220 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ptzmj\" (UniqueName: \"kubernetes.io/projected/6b393cd4-5705-41cc-a3de-d486f054802d-kube-api-access-ptzmj\") on node \"crc\" DevicePath \"\"" Mar 16 17:48:13 crc kubenswrapper[5120]: I0316 17:48:13.828229 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6b393cd4-5705-41cc-a3de-d486f054802d-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:48:13 crc kubenswrapper[5120]: I0316 17:48:13.828237 5120 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6b393cd4-5705-41cc-a3de-d486f054802d-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 17:48:14 crc kubenswrapper[5120]: I0316 17:48:14.538283 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-78bdc58cc4-2tvpf" event={"ID":"6b393cd4-5705-41cc-a3de-d486f054802d","Type":"ContainerDied","Data":"2e39f08985cc5f788011b65dc0da3346a9ce2cab06063b9b4f28cddd6520bc31"} Mar 16 17:48:14 crc kubenswrapper[5120]: I0316 17:48:14.538348 5120 scope.go:117] "RemoveContainer" containerID="1c7256e09e0b09bb86f620700b68e69c2bdeddedc4d303ae3837f5124968d000" Mar 16 17:48:14 crc kubenswrapper[5120]: I0316 17:48:14.538437 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-78bdc58cc4-2tvpf" Mar 16 17:48:14 crc kubenswrapper[5120]: I0316 17:48:14.593620 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keystone-kuttl-tests/keystone-78bdc58cc4-2tvpf"] Mar 16 17:48:14 crc kubenswrapper[5120]: I0316 17:48:14.602603 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["keystone-kuttl-tests/keystone-78bdc58cc4-2tvpf"] Mar 16 17:48:14 crc kubenswrapper[5120]: I0316 17:48:14.671897 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b393cd4-5705-41cc-a3de-d486f054802d" path="/var/lib/kubelet/pods/6b393cd4-5705-41cc-a3de-d486f054802d/volumes" Mar 16 17:48:15 crc kubenswrapper[5120]: I0316 17:48:15.214580 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keystone-kuttl-tests/keystone-db-create-bfchl"] Mar 16 17:48:15 crc kubenswrapper[5120]: I0316 17:48:15.220560 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["keystone-kuttl-tests/keystone-db-create-bfchl"] Mar 16 17:48:15 crc kubenswrapper[5120]: I0316 17:48:15.231912 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keystone-kuttl-tests/keystone-1ab5-account-create-update-zfgxh"] Mar 16 17:48:15 crc kubenswrapper[5120]: I0316 17:48:15.241033 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["keystone-kuttl-tests/keystone-1ab5-account-create-update-zfgxh"] Mar 16 17:48:15 crc kubenswrapper[5120]: I0316 17:48:15.246636 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keystone-kuttl-tests/keystone1ab5-account-delete-fttsk"] Mar 16 17:48:15 crc kubenswrapper[5120]: I0316 17:48:15.251822 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["keystone-kuttl-tests/keystone1ab5-account-delete-fttsk"] Mar 16 17:48:15 crc kubenswrapper[5120]: I0316 17:48:15.466661 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keystone-kuttl-tests/keystone-a8e6-account-create-update-btqck"] Mar 16 17:48:15 crc kubenswrapper[5120]: I0316 17:48:15.467622 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b393cd4-5705-41cc-a3de-d486f054802d" containerName="keystone-api" Mar 16 17:48:15 crc kubenswrapper[5120]: I0316 17:48:15.467646 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b393cd4-5705-41cc-a3de-d486f054802d" containerName="keystone-api" Mar 16 17:48:15 crc kubenswrapper[5120]: I0316 17:48:15.467698 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e195f631-96b0-4ceb-a8f9-a5fc7aa013b1" containerName="mariadb-account-delete" Mar 16 17:48:15 crc kubenswrapper[5120]: I0316 17:48:15.467706 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e195f631-96b0-4ceb-a8f9-a5fc7aa013b1" containerName="mariadb-account-delete" Mar 16 17:48:15 crc kubenswrapper[5120]: I0316 17:48:15.467875 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="6b393cd4-5705-41cc-a3de-d486f054802d" containerName="keystone-api" Mar 16 17:48:15 crc kubenswrapper[5120]: I0316 17:48:15.467893 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e195f631-96b0-4ceb-a8f9-a5fc7aa013b1" containerName="mariadb-account-delete" Mar 16 17:48:15 crc kubenswrapper[5120]: I0316 17:48:15.479174 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keystone-kuttl-tests/keystone-db-create-jbnfw"] Mar 16 17:48:15 crc kubenswrapper[5120]: I0316 17:48:15.479389 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-a8e6-account-create-update-btqck" Mar 16 17:48:15 crc kubenswrapper[5120]: I0316 17:48:15.481424 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keystone-kuttl-tests\"/\"keystone-db-secret\"" Mar 16 17:48:15 crc kubenswrapper[5120]: I0316 17:48:15.484785 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone-db-create-jbnfw"] Mar 16 17:48:15 crc kubenswrapper[5120]: I0316 17:48:15.484900 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-db-create-jbnfw" Mar 16 17:48:15 crc kubenswrapper[5120]: I0316 17:48:15.501799 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone-a8e6-account-create-update-btqck"] Mar 16 17:48:15 crc kubenswrapper[5120]: I0316 17:48:15.571194 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfd87\" (UniqueName: \"kubernetes.io/projected/1f91e503-76a2-49a5-9102-4980a9e8d7e5-kube-api-access-mfd87\") pod \"keystone-db-create-jbnfw\" (UID: \"1f91e503-76a2-49a5-9102-4980a9e8d7e5\") " pod="keystone-kuttl-tests/keystone-db-create-jbnfw" Mar 16 17:48:15 crc kubenswrapper[5120]: I0316 17:48:15.571381 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/1f91e503-76a2-49a5-9102-4980a9e8d7e5-operator-scripts\") pod \"keystone-db-create-jbnfw\" (UID: \"1f91e503-76a2-49a5-9102-4980a9e8d7e5\") " pod="keystone-kuttl-tests/keystone-db-create-jbnfw" Mar 16 17:48:15 crc kubenswrapper[5120]: I0316 17:48:15.571461 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c38d1e17-ff43-435b-a826-81fd7547f874-operator-scripts\") pod \"keystone-a8e6-account-create-update-btqck\" (UID: \"c38d1e17-ff43-435b-a826-81fd7547f874\") " pod="keystone-kuttl-tests/keystone-a8e6-account-create-update-btqck" Mar 16 17:48:15 crc kubenswrapper[5120]: I0316 17:48:15.571696 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjmfg\" (UniqueName: \"kubernetes.io/projected/c38d1e17-ff43-435b-a826-81fd7547f874-kube-api-access-rjmfg\") pod \"keystone-a8e6-account-create-update-btqck\" (UID: \"c38d1e17-ff43-435b-a826-81fd7547f874\") " pod="keystone-kuttl-tests/keystone-a8e6-account-create-update-btqck" Mar 16 17:48:15 crc kubenswrapper[5120]: I0316 17:48:15.673824 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rjmfg\" (UniqueName: \"kubernetes.io/projected/c38d1e17-ff43-435b-a826-81fd7547f874-kube-api-access-rjmfg\") pod \"keystone-a8e6-account-create-update-btqck\" (UID: \"c38d1e17-ff43-435b-a826-81fd7547f874\") " pod="keystone-kuttl-tests/keystone-a8e6-account-create-update-btqck" Mar 16 17:48:15 crc kubenswrapper[5120]: I0316 17:48:15.673913 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mfd87\" (UniqueName: \"kubernetes.io/projected/1f91e503-76a2-49a5-9102-4980a9e8d7e5-kube-api-access-mfd87\") pod \"keystone-db-create-jbnfw\" (UID: \"1f91e503-76a2-49a5-9102-4980a9e8d7e5\") " pod="keystone-kuttl-tests/keystone-db-create-jbnfw" Mar 16 17:48:15 crc kubenswrapper[5120]: I0316 17:48:15.674061 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/1f91e503-76a2-49a5-9102-4980a9e8d7e5-operator-scripts\") pod \"keystone-db-create-jbnfw\" (UID: \"1f91e503-76a2-49a5-9102-4980a9e8d7e5\") " pod="keystone-kuttl-tests/keystone-db-create-jbnfw" Mar 16 17:48:15 crc kubenswrapper[5120]: I0316 17:48:15.674142 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c38d1e17-ff43-435b-a826-81fd7547f874-operator-scripts\") pod \"keystone-a8e6-account-create-update-btqck\" (UID: \"c38d1e17-ff43-435b-a826-81fd7547f874\") " pod="keystone-kuttl-tests/keystone-a8e6-account-create-update-btqck" Mar 16 17:48:15 crc kubenswrapper[5120]: I0316 17:48:15.674868 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c38d1e17-ff43-435b-a826-81fd7547f874-operator-scripts\") pod \"keystone-a8e6-account-create-update-btqck\" (UID: \"c38d1e17-ff43-435b-a826-81fd7547f874\") " pod="keystone-kuttl-tests/keystone-a8e6-account-create-update-btqck" Mar 16 17:48:15 crc kubenswrapper[5120]: I0316 17:48:15.674908 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/1f91e503-76a2-49a5-9102-4980a9e8d7e5-operator-scripts\") pod \"keystone-db-create-jbnfw\" (UID: \"1f91e503-76a2-49a5-9102-4980a9e8d7e5\") " pod="keystone-kuttl-tests/keystone-db-create-jbnfw" Mar 16 17:48:15 crc kubenswrapper[5120]: I0316 17:48:15.693441 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfd87\" (UniqueName: \"kubernetes.io/projected/1f91e503-76a2-49a5-9102-4980a9e8d7e5-kube-api-access-mfd87\") pod \"keystone-db-create-jbnfw\" (UID: \"1f91e503-76a2-49a5-9102-4980a9e8d7e5\") " pod="keystone-kuttl-tests/keystone-db-create-jbnfw" Mar 16 17:48:15 crc kubenswrapper[5120]: I0316 17:48:15.693854 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjmfg\" (UniqueName: \"kubernetes.io/projected/c38d1e17-ff43-435b-a826-81fd7547f874-kube-api-access-rjmfg\") pod \"keystone-a8e6-account-create-update-btqck\" (UID: \"c38d1e17-ff43-435b-a826-81fd7547f874\") " pod="keystone-kuttl-tests/keystone-a8e6-account-create-update-btqck" Mar 16 17:48:15 crc kubenswrapper[5120]: I0316 17:48:15.803866 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-a8e6-account-create-update-btqck" Mar 16 17:48:15 crc kubenswrapper[5120]: I0316 17:48:15.811577 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-db-create-jbnfw" Mar 16 17:48:16 crc kubenswrapper[5120]: I0316 17:48:16.035390 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone-a8e6-account-create-update-btqck"] Mar 16 17:48:16 crc kubenswrapper[5120]: I0316 17:48:16.304477 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone-db-create-jbnfw"] Mar 16 17:48:16 crc kubenswrapper[5120]: W0316 17:48:16.309302 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1f91e503_76a2_49a5_9102_4980a9e8d7e5.slice/crio-3cfc0f51c1752169f71ba7b0ca05e8c440b4e81bef385ce4bacc474c9357f3b6 WatchSource:0}: Error finding container 3cfc0f51c1752169f71ba7b0ca05e8c440b4e81bef385ce4bacc474c9357f3b6: Status 404 returned error can't find the container with id 3cfc0f51c1752169f71ba7b0ca05e8c440b4e81bef385ce4bacc474c9357f3b6 Mar 16 17:48:16 crc kubenswrapper[5120]: I0316 17:48:16.571308 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-db-create-jbnfw" event={"ID":"1f91e503-76a2-49a5-9102-4980a9e8d7e5","Type":"ContainerStarted","Data":"97dad2744adc3b4dc278bf8f431fbb6995f3ec42c711e2be28caa523bf4e423e"} Mar 16 17:48:16 crc kubenswrapper[5120]: I0316 17:48:16.571378 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-db-create-jbnfw" event={"ID":"1f91e503-76a2-49a5-9102-4980a9e8d7e5","Type":"ContainerStarted","Data":"3cfc0f51c1752169f71ba7b0ca05e8c440b4e81bef385ce4bacc474c9357f3b6"} Mar 16 17:48:16 crc kubenswrapper[5120]: I0316 17:48:16.577164 5120 generic.go:358] "Generic (PLEG): container finished" podID="c38d1e17-ff43-435b-a826-81fd7547f874" containerID="d1afbafdd5b5a199014b36af706a3bc2d4afad961c980dde58f39f3b9b142614" exitCode=0 Mar 16 17:48:16 crc kubenswrapper[5120]: I0316 17:48:16.577329 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-a8e6-account-create-update-btqck" event={"ID":"c38d1e17-ff43-435b-a826-81fd7547f874","Type":"ContainerDied","Data":"d1afbafdd5b5a199014b36af706a3bc2d4afad961c980dde58f39f3b9b142614"} Mar 16 17:48:16 crc kubenswrapper[5120]: I0316 17:48:16.577378 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-a8e6-account-create-update-btqck" event={"ID":"c38d1e17-ff43-435b-a826-81fd7547f874","Type":"ContainerStarted","Data":"d0d7813e619c925c348b5b12e4affb592aec3d3fee1ebb0f98452ee169680495"} Mar 16 17:48:16 crc kubenswrapper[5120]: I0316 17:48:16.598509 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keystone-kuttl-tests/keystone-db-create-jbnfw" podStartSLOduration=1.598485441 podStartE2EDuration="1.598485441s" podCreationTimestamp="2026-03-16 17:48:15 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:48:16.58601689 +0000 UTC m=+8198.739948557" watchObservedRunningTime="2026-03-16 17:48:16.598485441 +0000 UTC m=+8198.752417188" Mar 16 17:48:16 crc kubenswrapper[5120]: I0316 17:48:16.674236 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="065a7e21-0a4b-4a9b-80d0-17e1f634c2f7" path="/var/lib/kubelet/pods/065a7e21-0a4b-4a9b-80d0-17e1f634c2f7/volumes" Mar 16 17:48:16 crc kubenswrapper[5120]: I0316 17:48:16.674704 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2318cdd1-4506-4657-81d0-293f2d9ec62b" path="/var/lib/kubelet/pods/2318cdd1-4506-4657-81d0-293f2d9ec62b/volumes" Mar 16 17:48:16 crc kubenswrapper[5120]: I0316 17:48:16.675157 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e195f631-96b0-4ceb-a8f9-a5fc7aa013b1" path="/var/lib/kubelet/pods/e195f631-96b0-4ceb-a8f9-a5fc7aa013b1/volumes" Mar 16 17:48:17 crc kubenswrapper[5120]: I0316 17:48:17.587037 5120 generic.go:358] "Generic (PLEG): container finished" podID="1f91e503-76a2-49a5-9102-4980a9e8d7e5" containerID="97dad2744adc3b4dc278bf8f431fbb6995f3ec42c711e2be28caa523bf4e423e" exitCode=0 Mar 16 17:48:17 crc kubenswrapper[5120]: I0316 17:48:17.587133 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-db-create-jbnfw" event={"ID":"1f91e503-76a2-49a5-9102-4980a9e8d7e5","Type":"ContainerDied","Data":"97dad2744adc3b4dc278bf8f431fbb6995f3ec42c711e2be28caa523bf4e423e"} Mar 16 17:48:17 crc kubenswrapper[5120]: I0316 17:48:17.859864 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-a8e6-account-create-update-btqck" Mar 16 17:48:18 crc kubenswrapper[5120]: I0316 17:48:18.032168 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c38d1e17-ff43-435b-a826-81fd7547f874-operator-scripts\") pod \"c38d1e17-ff43-435b-a826-81fd7547f874\" (UID: \"c38d1e17-ff43-435b-a826-81fd7547f874\") " Mar 16 17:48:18 crc kubenswrapper[5120]: I0316 17:48:18.032551 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rjmfg\" (UniqueName: \"kubernetes.io/projected/c38d1e17-ff43-435b-a826-81fd7547f874-kube-api-access-rjmfg\") pod \"c38d1e17-ff43-435b-a826-81fd7547f874\" (UID: \"c38d1e17-ff43-435b-a826-81fd7547f874\") " Mar 16 17:48:18 crc kubenswrapper[5120]: I0316 17:48:18.033637 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c38d1e17-ff43-435b-a826-81fd7547f874-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "c38d1e17-ff43-435b-a826-81fd7547f874" (UID: "c38d1e17-ff43-435b-a826-81fd7547f874"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:48:18 crc kubenswrapper[5120]: I0316 17:48:18.040318 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c38d1e17-ff43-435b-a826-81fd7547f874-kube-api-access-rjmfg" (OuterVolumeSpecName: "kube-api-access-rjmfg") pod "c38d1e17-ff43-435b-a826-81fd7547f874" (UID: "c38d1e17-ff43-435b-a826-81fd7547f874"). InnerVolumeSpecName "kube-api-access-rjmfg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:48:18 crc kubenswrapper[5120]: I0316 17:48:18.135979 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rjmfg\" (UniqueName: \"kubernetes.io/projected/c38d1e17-ff43-435b-a826-81fd7547f874-kube-api-access-rjmfg\") on node \"crc\" DevicePath \"\"" Mar 16 17:48:18 crc kubenswrapper[5120]: I0316 17:48:18.136355 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c38d1e17-ff43-435b-a826-81fd7547f874-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:48:18 crc kubenswrapper[5120]: I0316 17:48:18.598503 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-a8e6-account-create-update-btqck" Mar 16 17:48:18 crc kubenswrapper[5120]: I0316 17:48:18.598535 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-a8e6-account-create-update-btqck" event={"ID":"c38d1e17-ff43-435b-a826-81fd7547f874","Type":"ContainerDied","Data":"d0d7813e619c925c348b5b12e4affb592aec3d3fee1ebb0f98452ee169680495"} Mar 16 17:48:18 crc kubenswrapper[5120]: I0316 17:48:18.598578 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d0d7813e619c925c348b5b12e4affb592aec3d3fee1ebb0f98452ee169680495" Mar 16 17:48:18 crc kubenswrapper[5120]: I0316 17:48:18.880582 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-db-create-jbnfw" Mar 16 17:48:18 crc kubenswrapper[5120]: I0316 17:48:18.954272 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/1f91e503-76a2-49a5-9102-4980a9e8d7e5-operator-scripts\") pod \"1f91e503-76a2-49a5-9102-4980a9e8d7e5\" (UID: \"1f91e503-76a2-49a5-9102-4980a9e8d7e5\") " Mar 16 17:48:18 crc kubenswrapper[5120]: I0316 17:48:18.954463 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mfd87\" (UniqueName: \"kubernetes.io/projected/1f91e503-76a2-49a5-9102-4980a9e8d7e5-kube-api-access-mfd87\") pod \"1f91e503-76a2-49a5-9102-4980a9e8d7e5\" (UID: \"1f91e503-76a2-49a5-9102-4980a9e8d7e5\") " Mar 16 17:48:18 crc kubenswrapper[5120]: I0316 17:48:18.954780 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f91e503-76a2-49a5-9102-4980a9e8d7e5-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "1f91e503-76a2-49a5-9102-4980a9e8d7e5" (UID: "1f91e503-76a2-49a5-9102-4980a9e8d7e5"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:48:18 crc kubenswrapper[5120]: I0316 17:48:18.954989 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/1f91e503-76a2-49a5-9102-4980a9e8d7e5-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:48:18 crc kubenswrapper[5120]: I0316 17:48:18.973220 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f91e503-76a2-49a5-9102-4980a9e8d7e5-kube-api-access-mfd87" (OuterVolumeSpecName: "kube-api-access-mfd87") pod "1f91e503-76a2-49a5-9102-4980a9e8d7e5" (UID: "1f91e503-76a2-49a5-9102-4980a9e8d7e5"). InnerVolumeSpecName "kube-api-access-mfd87". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:48:19 crc kubenswrapper[5120]: I0316 17:48:19.056889 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mfd87\" (UniqueName: \"kubernetes.io/projected/1f91e503-76a2-49a5-9102-4980a9e8d7e5-kube-api-access-mfd87\") on node \"crc\" DevicePath \"\"" Mar 16 17:48:19 crc kubenswrapper[5120]: I0316 17:48:19.611168 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-db-create-jbnfw" Mar 16 17:48:19 crc kubenswrapper[5120]: I0316 17:48:19.611250 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-db-create-jbnfw" event={"ID":"1f91e503-76a2-49a5-9102-4980a9e8d7e5","Type":"ContainerDied","Data":"3cfc0f51c1752169f71ba7b0ca05e8c440b4e81bef385ce4bacc474c9357f3b6"} Mar 16 17:48:19 crc kubenswrapper[5120]: I0316 17:48:19.611715 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3cfc0f51c1752169f71ba7b0ca05e8c440b4e81bef385ce4bacc474c9357f3b6" Mar 16 17:48:21 crc kubenswrapper[5120]: I0316 17:48:21.033939 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keystone-kuttl-tests/keystone-db-sync-hvn6f"] Mar 16 17:48:21 crc kubenswrapper[5120]: I0316 17:48:21.034738 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f91e503-76a2-49a5-9102-4980a9e8d7e5" containerName="mariadb-database-create" Mar 16 17:48:21 crc kubenswrapper[5120]: I0316 17:48:21.034773 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f91e503-76a2-49a5-9102-4980a9e8d7e5" containerName="mariadb-database-create" Mar 16 17:48:21 crc kubenswrapper[5120]: I0316 17:48:21.034825 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c38d1e17-ff43-435b-a826-81fd7547f874" containerName="mariadb-account-create-update" Mar 16 17:48:21 crc kubenswrapper[5120]: I0316 17:48:21.034835 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c38d1e17-ff43-435b-a826-81fd7547f874" containerName="mariadb-account-create-update" Mar 16 17:48:21 crc kubenswrapper[5120]: I0316 17:48:21.034965 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c38d1e17-ff43-435b-a826-81fd7547f874" containerName="mariadb-account-create-update" Mar 16 17:48:21 crc kubenswrapper[5120]: I0316 17:48:21.034988 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1f91e503-76a2-49a5-9102-4980a9e8d7e5" containerName="mariadb-database-create" Mar 16 17:48:21 crc kubenswrapper[5120]: I0316 17:48:21.042726 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-db-sync-hvn6f" Mar 16 17:48:21 crc kubenswrapper[5120]: I0316 17:48:21.044699 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone-db-sync-hvn6f"] Mar 16 17:48:21 crc kubenswrapper[5120]: I0316 17:48:21.045218 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keystone-kuttl-tests\"/\"keystone-scripts\"" Mar 16 17:48:21 crc kubenswrapper[5120]: I0316 17:48:21.045780 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keystone-kuttl-tests\"/\"keystone-keystone-dockercfg-kgm6f\"" Mar 16 17:48:21 crc kubenswrapper[5120]: I0316 17:48:21.045816 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keystone-kuttl-tests\"/\"keystone\"" Mar 16 17:48:21 crc kubenswrapper[5120]: I0316 17:48:21.045882 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keystone-kuttl-tests\"/\"keystone-config-data\"" Mar 16 17:48:21 crc kubenswrapper[5120]: I0316 17:48:21.100482 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8fr6\" (UniqueName: \"kubernetes.io/projected/91ef6947-c804-49da-a762-ba6714d5ec55-kube-api-access-p8fr6\") pod \"keystone-db-sync-hvn6f\" (UID: \"91ef6947-c804-49da-a762-ba6714d5ec55\") " pod="keystone-kuttl-tests/keystone-db-sync-hvn6f" Mar 16 17:48:21 crc kubenswrapper[5120]: I0316 17:48:21.100674 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/91ef6947-c804-49da-a762-ba6714d5ec55-config-data\") pod \"keystone-db-sync-hvn6f\" (UID: \"91ef6947-c804-49da-a762-ba6714d5ec55\") " pod="keystone-kuttl-tests/keystone-db-sync-hvn6f" Mar 16 17:48:21 crc kubenswrapper[5120]: I0316 17:48:21.202404 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p8fr6\" (UniqueName: \"kubernetes.io/projected/91ef6947-c804-49da-a762-ba6714d5ec55-kube-api-access-p8fr6\") pod \"keystone-db-sync-hvn6f\" (UID: \"91ef6947-c804-49da-a762-ba6714d5ec55\") " pod="keystone-kuttl-tests/keystone-db-sync-hvn6f" Mar 16 17:48:21 crc kubenswrapper[5120]: I0316 17:48:21.202569 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/91ef6947-c804-49da-a762-ba6714d5ec55-config-data\") pod \"keystone-db-sync-hvn6f\" (UID: \"91ef6947-c804-49da-a762-ba6714d5ec55\") " pod="keystone-kuttl-tests/keystone-db-sync-hvn6f" Mar 16 17:48:21 crc kubenswrapper[5120]: I0316 17:48:21.208604 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/91ef6947-c804-49da-a762-ba6714d5ec55-config-data\") pod \"keystone-db-sync-hvn6f\" (UID: \"91ef6947-c804-49da-a762-ba6714d5ec55\") " pod="keystone-kuttl-tests/keystone-db-sync-hvn6f" Mar 16 17:48:21 crc kubenswrapper[5120]: I0316 17:48:21.222448 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8fr6\" (UniqueName: \"kubernetes.io/projected/91ef6947-c804-49da-a762-ba6714d5ec55-kube-api-access-p8fr6\") pod \"keystone-db-sync-hvn6f\" (UID: \"91ef6947-c804-49da-a762-ba6714d5ec55\") " pod="keystone-kuttl-tests/keystone-db-sync-hvn6f" Mar 16 17:48:21 crc kubenswrapper[5120]: I0316 17:48:21.365243 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-db-sync-hvn6f" Mar 16 17:48:21 crc kubenswrapper[5120]: I0316 17:48:21.796826 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone-db-sync-hvn6f"] Mar 16 17:48:22 crc kubenswrapper[5120]: I0316 17:48:22.007996 5120 patch_prober.go:28] interesting pod/machine-config-daemon-7bf76 container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 17:48:22 crc kubenswrapper[5120]: I0316 17:48:22.008411 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 17:48:22 crc kubenswrapper[5120]: I0316 17:48:22.636677 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-db-sync-hvn6f" event={"ID":"91ef6947-c804-49da-a762-ba6714d5ec55","Type":"ContainerStarted","Data":"b622cd048b65bdaa47f6c74c98b47af3fd029318751832c613405a4f1f4526b7"} Mar 16 17:48:22 crc kubenswrapper[5120]: I0316 17:48:22.636728 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-db-sync-hvn6f" event={"ID":"91ef6947-c804-49da-a762-ba6714d5ec55","Type":"ContainerStarted","Data":"bfc75f80ce0f345cc4a0da043aa35709caf1a89a1a0eef49412e1fa9895b6175"} Mar 16 17:48:23 crc kubenswrapper[5120]: I0316 17:48:23.653437 5120 generic.go:358] "Generic (PLEG): container finished" podID="91ef6947-c804-49da-a762-ba6714d5ec55" containerID="b622cd048b65bdaa47f6c74c98b47af3fd029318751832c613405a4f1f4526b7" exitCode=0 Mar 16 17:48:23 crc kubenswrapper[5120]: I0316 17:48:23.657967 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-db-sync-hvn6f" event={"ID":"91ef6947-c804-49da-a762-ba6714d5ec55","Type":"ContainerDied","Data":"b622cd048b65bdaa47f6c74c98b47af3fd029318751832c613405a4f1f4526b7"} Mar 16 17:48:24 crc kubenswrapper[5120]: I0316 17:48:24.969951 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-db-sync-hvn6f" Mar 16 17:48:25 crc kubenswrapper[5120]: I0316 17:48:25.081518 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p8fr6\" (UniqueName: \"kubernetes.io/projected/91ef6947-c804-49da-a762-ba6714d5ec55-kube-api-access-p8fr6\") pod \"91ef6947-c804-49da-a762-ba6714d5ec55\" (UID: \"91ef6947-c804-49da-a762-ba6714d5ec55\") " Mar 16 17:48:25 crc kubenswrapper[5120]: I0316 17:48:25.081973 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/91ef6947-c804-49da-a762-ba6714d5ec55-config-data\") pod \"91ef6947-c804-49da-a762-ba6714d5ec55\" (UID: \"91ef6947-c804-49da-a762-ba6714d5ec55\") " Mar 16 17:48:25 crc kubenswrapper[5120]: I0316 17:48:25.088154 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91ef6947-c804-49da-a762-ba6714d5ec55-kube-api-access-p8fr6" (OuterVolumeSpecName: "kube-api-access-p8fr6") pod "91ef6947-c804-49da-a762-ba6714d5ec55" (UID: "91ef6947-c804-49da-a762-ba6714d5ec55"). InnerVolumeSpecName "kube-api-access-p8fr6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:48:25 crc kubenswrapper[5120]: I0316 17:48:25.138441 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91ef6947-c804-49da-a762-ba6714d5ec55-config-data" (OuterVolumeSpecName: "config-data") pod "91ef6947-c804-49da-a762-ba6714d5ec55" (UID: "91ef6947-c804-49da-a762-ba6714d5ec55"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:48:25 crc kubenswrapper[5120]: I0316 17:48:25.184199 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/91ef6947-c804-49da-a762-ba6714d5ec55-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:48:25 crc kubenswrapper[5120]: I0316 17:48:25.184254 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p8fr6\" (UniqueName: \"kubernetes.io/projected/91ef6947-c804-49da-a762-ba6714d5ec55-kube-api-access-p8fr6\") on node \"crc\" DevicePath \"\"" Mar 16 17:48:25 crc kubenswrapper[5120]: I0316 17:48:25.688692 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-db-sync-hvn6f" Mar 16 17:48:25 crc kubenswrapper[5120]: I0316 17:48:25.688802 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-db-sync-hvn6f" event={"ID":"91ef6947-c804-49da-a762-ba6714d5ec55","Type":"ContainerDied","Data":"bfc75f80ce0f345cc4a0da043aa35709caf1a89a1a0eef49412e1fa9895b6175"} Mar 16 17:48:25 crc kubenswrapper[5120]: I0316 17:48:25.688879 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bfc75f80ce0f345cc4a0da043aa35709caf1a89a1a0eef49412e1fa9895b6175" Mar 16 17:48:25 crc kubenswrapper[5120]: I0316 17:48:25.863270 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keystone-kuttl-tests/keystone-bootstrap-xmxd2"] Mar 16 17:48:25 crc kubenswrapper[5120]: I0316 17:48:25.864462 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91ef6947-c804-49da-a762-ba6714d5ec55" containerName="keystone-db-sync" Mar 16 17:48:25 crc kubenswrapper[5120]: I0316 17:48:25.864488 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="91ef6947-c804-49da-a762-ba6714d5ec55" containerName="keystone-db-sync" Mar 16 17:48:25 crc kubenswrapper[5120]: I0316 17:48:25.864662 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="91ef6947-c804-49da-a762-ba6714d5ec55" containerName="keystone-db-sync" Mar 16 17:48:25 crc kubenswrapper[5120]: I0316 17:48:25.873114 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-bootstrap-xmxd2" Mar 16 17:48:25 crc kubenswrapper[5120]: I0316 17:48:25.873577 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone-bootstrap-xmxd2"] Mar 16 17:48:25 crc kubenswrapper[5120]: I0316 17:48:25.876277 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keystone-kuttl-tests\"/\"keystone-config-data\"" Mar 16 17:48:25 crc kubenswrapper[5120]: I0316 17:48:25.876514 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keystone-kuttl-tests\"/\"osp-secret\"" Mar 16 17:48:25 crc kubenswrapper[5120]: I0316 17:48:25.877228 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keystone-kuttl-tests\"/\"keystone-scripts\"" Mar 16 17:48:25 crc kubenswrapper[5120]: I0316 17:48:25.877405 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keystone-kuttl-tests\"/\"keystone\"" Mar 16 17:48:25 crc kubenswrapper[5120]: I0316 17:48:25.877554 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keystone-kuttl-tests\"/\"keystone-keystone-dockercfg-kgm6f\"" Mar 16 17:48:26 crc kubenswrapper[5120]: I0316 17:48:26.007122 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/641d54a9-94ed-42f3-b513-c94f05f27311-fernet-keys\") pod \"keystone-bootstrap-xmxd2\" (UID: \"641d54a9-94ed-42f3-b513-c94f05f27311\") " pod="keystone-kuttl-tests/keystone-bootstrap-xmxd2" Mar 16 17:48:26 crc kubenswrapper[5120]: I0316 17:48:26.007477 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zsw4n\" (UniqueName: \"kubernetes.io/projected/641d54a9-94ed-42f3-b513-c94f05f27311-kube-api-access-zsw4n\") pod \"keystone-bootstrap-xmxd2\" (UID: \"641d54a9-94ed-42f3-b513-c94f05f27311\") " pod="keystone-kuttl-tests/keystone-bootstrap-xmxd2" Mar 16 17:48:26 crc kubenswrapper[5120]: I0316 17:48:26.007639 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/641d54a9-94ed-42f3-b513-c94f05f27311-credential-keys\") pod \"keystone-bootstrap-xmxd2\" (UID: \"641d54a9-94ed-42f3-b513-c94f05f27311\") " pod="keystone-kuttl-tests/keystone-bootstrap-xmxd2" Mar 16 17:48:26 crc kubenswrapper[5120]: I0316 17:48:26.007892 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/641d54a9-94ed-42f3-b513-c94f05f27311-scripts\") pod \"keystone-bootstrap-xmxd2\" (UID: \"641d54a9-94ed-42f3-b513-c94f05f27311\") " pod="keystone-kuttl-tests/keystone-bootstrap-xmxd2" Mar 16 17:48:26 crc kubenswrapper[5120]: I0316 17:48:26.008032 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/641d54a9-94ed-42f3-b513-c94f05f27311-config-data\") pod \"keystone-bootstrap-xmxd2\" (UID: \"641d54a9-94ed-42f3-b513-c94f05f27311\") " pod="keystone-kuttl-tests/keystone-bootstrap-xmxd2" Mar 16 17:48:26 crc kubenswrapper[5120]: I0316 17:48:26.109507 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/641d54a9-94ed-42f3-b513-c94f05f27311-scripts\") pod \"keystone-bootstrap-xmxd2\" (UID: \"641d54a9-94ed-42f3-b513-c94f05f27311\") " pod="keystone-kuttl-tests/keystone-bootstrap-xmxd2" Mar 16 17:48:26 crc kubenswrapper[5120]: I0316 17:48:26.109644 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/641d54a9-94ed-42f3-b513-c94f05f27311-config-data\") pod \"keystone-bootstrap-xmxd2\" (UID: \"641d54a9-94ed-42f3-b513-c94f05f27311\") " pod="keystone-kuttl-tests/keystone-bootstrap-xmxd2" Mar 16 17:48:26 crc kubenswrapper[5120]: I0316 17:48:26.109799 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/641d54a9-94ed-42f3-b513-c94f05f27311-fernet-keys\") pod \"keystone-bootstrap-xmxd2\" (UID: \"641d54a9-94ed-42f3-b513-c94f05f27311\") " pod="keystone-kuttl-tests/keystone-bootstrap-xmxd2" Mar 16 17:48:26 crc kubenswrapper[5120]: I0316 17:48:26.109929 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zsw4n\" (UniqueName: \"kubernetes.io/projected/641d54a9-94ed-42f3-b513-c94f05f27311-kube-api-access-zsw4n\") pod \"keystone-bootstrap-xmxd2\" (UID: \"641d54a9-94ed-42f3-b513-c94f05f27311\") " pod="keystone-kuttl-tests/keystone-bootstrap-xmxd2" Mar 16 17:48:26 crc kubenswrapper[5120]: I0316 17:48:26.110029 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/641d54a9-94ed-42f3-b513-c94f05f27311-credential-keys\") pod \"keystone-bootstrap-xmxd2\" (UID: \"641d54a9-94ed-42f3-b513-c94f05f27311\") " pod="keystone-kuttl-tests/keystone-bootstrap-xmxd2" Mar 16 17:48:26 crc kubenswrapper[5120]: I0316 17:48:26.116281 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/641d54a9-94ed-42f3-b513-c94f05f27311-fernet-keys\") pod \"keystone-bootstrap-xmxd2\" (UID: \"641d54a9-94ed-42f3-b513-c94f05f27311\") " pod="keystone-kuttl-tests/keystone-bootstrap-xmxd2" Mar 16 17:48:26 crc kubenswrapper[5120]: I0316 17:48:26.117020 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/641d54a9-94ed-42f3-b513-c94f05f27311-scripts\") pod \"keystone-bootstrap-xmxd2\" (UID: \"641d54a9-94ed-42f3-b513-c94f05f27311\") " pod="keystone-kuttl-tests/keystone-bootstrap-xmxd2" Mar 16 17:48:26 crc kubenswrapper[5120]: I0316 17:48:26.118146 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/641d54a9-94ed-42f3-b513-c94f05f27311-credential-keys\") pod \"keystone-bootstrap-xmxd2\" (UID: \"641d54a9-94ed-42f3-b513-c94f05f27311\") " pod="keystone-kuttl-tests/keystone-bootstrap-xmxd2" Mar 16 17:48:26 crc kubenswrapper[5120]: I0316 17:48:26.124296 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/641d54a9-94ed-42f3-b513-c94f05f27311-config-data\") pod \"keystone-bootstrap-xmxd2\" (UID: \"641d54a9-94ed-42f3-b513-c94f05f27311\") " pod="keystone-kuttl-tests/keystone-bootstrap-xmxd2" Mar 16 17:48:26 crc kubenswrapper[5120]: I0316 17:48:26.131174 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zsw4n\" (UniqueName: \"kubernetes.io/projected/641d54a9-94ed-42f3-b513-c94f05f27311-kube-api-access-zsw4n\") pod \"keystone-bootstrap-xmxd2\" (UID: \"641d54a9-94ed-42f3-b513-c94f05f27311\") " pod="keystone-kuttl-tests/keystone-bootstrap-xmxd2" Mar 16 17:48:26 crc kubenswrapper[5120]: I0316 17:48:26.194508 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-bootstrap-xmxd2" Mar 16 17:48:26 crc kubenswrapper[5120]: I0316 17:48:26.615247 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone-bootstrap-xmxd2"] Mar 16 17:48:26 crc kubenswrapper[5120]: W0316 17:48:26.620894 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod641d54a9_94ed_42f3_b513_c94f05f27311.slice/crio-6af99a7090214832eb59bb6aaff3994fa83d92608f3564d38c493cf7201498b4 WatchSource:0}: Error finding container 6af99a7090214832eb59bb6aaff3994fa83d92608f3564d38c493cf7201498b4: Status 404 returned error can't find the container with id 6af99a7090214832eb59bb6aaff3994fa83d92608f3564d38c493cf7201498b4 Mar 16 17:48:26 crc kubenswrapper[5120]: I0316 17:48:26.703425 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-bootstrap-xmxd2" event={"ID":"641d54a9-94ed-42f3-b513-c94f05f27311","Type":"ContainerStarted","Data":"6af99a7090214832eb59bb6aaff3994fa83d92608f3564d38c493cf7201498b4"} Mar 16 17:48:27 crc kubenswrapper[5120]: I0316 17:48:27.715732 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-bootstrap-xmxd2" event={"ID":"641d54a9-94ed-42f3-b513-c94f05f27311","Type":"ContainerStarted","Data":"ec53c97b49f8d672e29734636ac29e087fea5445a8f9eb55741e34a43646ce11"} Mar 16 17:48:27 crc kubenswrapper[5120]: I0316 17:48:27.743067 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keystone-kuttl-tests/keystone-bootstrap-xmxd2" podStartSLOduration=2.743044463 podStartE2EDuration="2.743044463s" podCreationTimestamp="2026-03-16 17:48:25 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:48:27.736140105 +0000 UTC m=+8209.890071762" watchObservedRunningTime="2026-03-16 17:48:27.743044463 +0000 UTC m=+8209.896976130" Mar 16 17:48:29 crc kubenswrapper[5120]: I0316 17:48:29.740948 5120 generic.go:358] "Generic (PLEG): container finished" podID="641d54a9-94ed-42f3-b513-c94f05f27311" containerID="ec53c97b49f8d672e29734636ac29e087fea5445a8f9eb55741e34a43646ce11" exitCode=0 Mar 16 17:48:29 crc kubenswrapper[5120]: I0316 17:48:29.741025 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-bootstrap-xmxd2" event={"ID":"641d54a9-94ed-42f3-b513-c94f05f27311","Type":"ContainerDied","Data":"ec53c97b49f8d672e29734636ac29e087fea5445a8f9eb55741e34a43646ce11"} Mar 16 17:48:31 crc kubenswrapper[5120]: I0316 17:48:31.069302 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-bootstrap-xmxd2" Mar 16 17:48:31 crc kubenswrapper[5120]: I0316 17:48:31.164740 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/641d54a9-94ed-42f3-b513-c94f05f27311-config-data\") pod \"641d54a9-94ed-42f3-b513-c94f05f27311\" (UID: \"641d54a9-94ed-42f3-b513-c94f05f27311\") " Mar 16 17:48:31 crc kubenswrapper[5120]: I0316 17:48:31.165081 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zsw4n\" (UniqueName: \"kubernetes.io/projected/641d54a9-94ed-42f3-b513-c94f05f27311-kube-api-access-zsw4n\") pod \"641d54a9-94ed-42f3-b513-c94f05f27311\" (UID: \"641d54a9-94ed-42f3-b513-c94f05f27311\") " Mar 16 17:48:31 crc kubenswrapper[5120]: I0316 17:48:31.165163 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/641d54a9-94ed-42f3-b513-c94f05f27311-fernet-keys\") pod \"641d54a9-94ed-42f3-b513-c94f05f27311\" (UID: \"641d54a9-94ed-42f3-b513-c94f05f27311\") " Mar 16 17:48:31 crc kubenswrapper[5120]: I0316 17:48:31.165272 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/641d54a9-94ed-42f3-b513-c94f05f27311-credential-keys\") pod \"641d54a9-94ed-42f3-b513-c94f05f27311\" (UID: \"641d54a9-94ed-42f3-b513-c94f05f27311\") " Mar 16 17:48:31 crc kubenswrapper[5120]: I0316 17:48:31.165303 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/641d54a9-94ed-42f3-b513-c94f05f27311-scripts\") pod \"641d54a9-94ed-42f3-b513-c94f05f27311\" (UID: \"641d54a9-94ed-42f3-b513-c94f05f27311\") " Mar 16 17:48:31 crc kubenswrapper[5120]: I0316 17:48:31.171674 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/641d54a9-94ed-42f3-b513-c94f05f27311-scripts" (OuterVolumeSpecName: "scripts") pod "641d54a9-94ed-42f3-b513-c94f05f27311" (UID: "641d54a9-94ed-42f3-b513-c94f05f27311"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:48:31 crc kubenswrapper[5120]: I0316 17:48:31.171733 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/641d54a9-94ed-42f3-b513-c94f05f27311-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "641d54a9-94ed-42f3-b513-c94f05f27311" (UID: "641d54a9-94ed-42f3-b513-c94f05f27311"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:48:31 crc kubenswrapper[5120]: I0316 17:48:31.171922 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/641d54a9-94ed-42f3-b513-c94f05f27311-kube-api-access-zsw4n" (OuterVolumeSpecName: "kube-api-access-zsw4n") pod "641d54a9-94ed-42f3-b513-c94f05f27311" (UID: "641d54a9-94ed-42f3-b513-c94f05f27311"). InnerVolumeSpecName "kube-api-access-zsw4n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:48:31 crc kubenswrapper[5120]: I0316 17:48:31.173011 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/641d54a9-94ed-42f3-b513-c94f05f27311-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "641d54a9-94ed-42f3-b513-c94f05f27311" (UID: "641d54a9-94ed-42f3-b513-c94f05f27311"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:48:31 crc kubenswrapper[5120]: I0316 17:48:31.190147 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/641d54a9-94ed-42f3-b513-c94f05f27311-config-data" (OuterVolumeSpecName: "config-data") pod "641d54a9-94ed-42f3-b513-c94f05f27311" (UID: "641d54a9-94ed-42f3-b513-c94f05f27311"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:48:31 crc kubenswrapper[5120]: I0316 17:48:31.268056 5120 reconciler_common.go:299] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/641d54a9-94ed-42f3-b513-c94f05f27311-fernet-keys\") on node \"crc\" DevicePath \"\"" Mar 16 17:48:31 crc kubenswrapper[5120]: I0316 17:48:31.268090 5120 reconciler_common.go:299] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/641d54a9-94ed-42f3-b513-c94f05f27311-credential-keys\") on node \"crc\" DevicePath \"\"" Mar 16 17:48:31 crc kubenswrapper[5120]: I0316 17:48:31.268101 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/641d54a9-94ed-42f3-b513-c94f05f27311-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:48:31 crc kubenswrapper[5120]: I0316 17:48:31.268112 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/641d54a9-94ed-42f3-b513-c94f05f27311-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:48:31 crc kubenswrapper[5120]: I0316 17:48:31.268121 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zsw4n\" (UniqueName: \"kubernetes.io/projected/641d54a9-94ed-42f3-b513-c94f05f27311-kube-api-access-zsw4n\") on node \"crc\" DevicePath \"\"" Mar 16 17:48:31 crc kubenswrapper[5120]: I0316 17:48:31.759245 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-bootstrap-xmxd2" Mar 16 17:48:31 crc kubenswrapper[5120]: I0316 17:48:31.759239 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-bootstrap-xmxd2" event={"ID":"641d54a9-94ed-42f3-b513-c94f05f27311","Type":"ContainerDied","Data":"6af99a7090214832eb59bb6aaff3994fa83d92608f3564d38c493cf7201498b4"} Mar 16 17:48:31 crc kubenswrapper[5120]: I0316 17:48:31.759406 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6af99a7090214832eb59bb6aaff3994fa83d92608f3564d38c493cf7201498b4" Mar 16 17:48:31 crc kubenswrapper[5120]: I0316 17:48:31.830089 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keystone-kuttl-tests/keystone-7884c64b68-k6wq5"] Mar 16 17:48:31 crc kubenswrapper[5120]: I0316 17:48:31.830910 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="641d54a9-94ed-42f3-b513-c94f05f27311" containerName="keystone-bootstrap" Mar 16 17:48:31 crc kubenswrapper[5120]: I0316 17:48:31.830928 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="641d54a9-94ed-42f3-b513-c94f05f27311" containerName="keystone-bootstrap" Mar 16 17:48:31 crc kubenswrapper[5120]: I0316 17:48:31.831053 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="641d54a9-94ed-42f3-b513-c94f05f27311" containerName="keystone-bootstrap" Mar 16 17:48:31 crc kubenswrapper[5120]: I0316 17:48:31.835798 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-7884c64b68-k6wq5" Mar 16 17:48:31 crc kubenswrapper[5120]: I0316 17:48:31.837695 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keystone-kuttl-tests\"/\"keystone-scripts\"" Mar 16 17:48:31 crc kubenswrapper[5120]: I0316 17:48:31.837741 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keystone-kuttl-tests\"/\"keystone\"" Mar 16 17:48:31 crc kubenswrapper[5120]: I0316 17:48:31.838424 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keystone-kuttl-tests\"/\"keystone-config-data\"" Mar 16 17:48:31 crc kubenswrapper[5120]: I0316 17:48:31.839844 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keystone-kuttl-tests\"/\"keystone-keystone-dockercfg-kgm6f\"" Mar 16 17:48:31 crc kubenswrapper[5120]: I0316 17:48:31.841818 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone-7884c64b68-k6wq5"] Mar 16 17:48:31 crc kubenswrapper[5120]: I0316 17:48:31.881209 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/583e5a40-e31f-4ebb-9245-ca3a33034e47-scripts\") pod \"keystone-7884c64b68-k6wq5\" (UID: \"583e5a40-e31f-4ebb-9245-ca3a33034e47\") " pod="keystone-kuttl-tests/keystone-7884c64b68-k6wq5" Mar 16 17:48:31 crc kubenswrapper[5120]: I0316 17:48:31.881590 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/583e5a40-e31f-4ebb-9245-ca3a33034e47-config-data\") pod \"keystone-7884c64b68-k6wq5\" (UID: \"583e5a40-e31f-4ebb-9245-ca3a33034e47\") " pod="keystone-kuttl-tests/keystone-7884c64b68-k6wq5" Mar 16 17:48:31 crc kubenswrapper[5120]: I0316 17:48:31.881656 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6n5wb\" (UniqueName: \"kubernetes.io/projected/583e5a40-e31f-4ebb-9245-ca3a33034e47-kube-api-access-6n5wb\") pod \"keystone-7884c64b68-k6wq5\" (UID: \"583e5a40-e31f-4ebb-9245-ca3a33034e47\") " pod="keystone-kuttl-tests/keystone-7884c64b68-k6wq5" Mar 16 17:48:31 crc kubenswrapper[5120]: I0316 17:48:31.881888 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/583e5a40-e31f-4ebb-9245-ca3a33034e47-fernet-keys\") pod \"keystone-7884c64b68-k6wq5\" (UID: \"583e5a40-e31f-4ebb-9245-ca3a33034e47\") " pod="keystone-kuttl-tests/keystone-7884c64b68-k6wq5" Mar 16 17:48:31 crc kubenswrapper[5120]: I0316 17:48:31.882379 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/583e5a40-e31f-4ebb-9245-ca3a33034e47-credential-keys\") pod \"keystone-7884c64b68-k6wq5\" (UID: \"583e5a40-e31f-4ebb-9245-ca3a33034e47\") " pod="keystone-kuttl-tests/keystone-7884c64b68-k6wq5" Mar 16 17:48:31 crc kubenswrapper[5120]: I0316 17:48:31.984275 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/583e5a40-e31f-4ebb-9245-ca3a33034e47-config-data\") pod \"keystone-7884c64b68-k6wq5\" (UID: \"583e5a40-e31f-4ebb-9245-ca3a33034e47\") " pod="keystone-kuttl-tests/keystone-7884c64b68-k6wq5" Mar 16 17:48:31 crc kubenswrapper[5120]: I0316 17:48:31.984327 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6n5wb\" (UniqueName: \"kubernetes.io/projected/583e5a40-e31f-4ebb-9245-ca3a33034e47-kube-api-access-6n5wb\") pod \"keystone-7884c64b68-k6wq5\" (UID: \"583e5a40-e31f-4ebb-9245-ca3a33034e47\") " pod="keystone-kuttl-tests/keystone-7884c64b68-k6wq5" Mar 16 17:48:31 crc kubenswrapper[5120]: I0316 17:48:31.984439 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/583e5a40-e31f-4ebb-9245-ca3a33034e47-fernet-keys\") pod \"keystone-7884c64b68-k6wq5\" (UID: \"583e5a40-e31f-4ebb-9245-ca3a33034e47\") " pod="keystone-kuttl-tests/keystone-7884c64b68-k6wq5" Mar 16 17:48:31 crc kubenswrapper[5120]: I0316 17:48:31.984614 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/583e5a40-e31f-4ebb-9245-ca3a33034e47-credential-keys\") pod \"keystone-7884c64b68-k6wq5\" (UID: \"583e5a40-e31f-4ebb-9245-ca3a33034e47\") " pod="keystone-kuttl-tests/keystone-7884c64b68-k6wq5" Mar 16 17:48:31 crc kubenswrapper[5120]: I0316 17:48:31.984721 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/583e5a40-e31f-4ebb-9245-ca3a33034e47-scripts\") pod \"keystone-7884c64b68-k6wq5\" (UID: \"583e5a40-e31f-4ebb-9245-ca3a33034e47\") " pod="keystone-kuttl-tests/keystone-7884c64b68-k6wq5" Mar 16 17:48:31 crc kubenswrapper[5120]: I0316 17:48:31.988944 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/583e5a40-e31f-4ebb-9245-ca3a33034e47-scripts\") pod \"keystone-7884c64b68-k6wq5\" (UID: \"583e5a40-e31f-4ebb-9245-ca3a33034e47\") " pod="keystone-kuttl-tests/keystone-7884c64b68-k6wq5" Mar 16 17:48:31 crc kubenswrapper[5120]: I0316 17:48:31.989430 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/583e5a40-e31f-4ebb-9245-ca3a33034e47-config-data\") pod \"keystone-7884c64b68-k6wq5\" (UID: \"583e5a40-e31f-4ebb-9245-ca3a33034e47\") " pod="keystone-kuttl-tests/keystone-7884c64b68-k6wq5" Mar 16 17:48:31 crc kubenswrapper[5120]: I0316 17:48:31.989901 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/583e5a40-e31f-4ebb-9245-ca3a33034e47-credential-keys\") pod \"keystone-7884c64b68-k6wq5\" (UID: \"583e5a40-e31f-4ebb-9245-ca3a33034e47\") " pod="keystone-kuttl-tests/keystone-7884c64b68-k6wq5" Mar 16 17:48:31 crc kubenswrapper[5120]: I0316 17:48:31.990420 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/583e5a40-e31f-4ebb-9245-ca3a33034e47-fernet-keys\") pod \"keystone-7884c64b68-k6wq5\" (UID: \"583e5a40-e31f-4ebb-9245-ca3a33034e47\") " pod="keystone-kuttl-tests/keystone-7884c64b68-k6wq5" Mar 16 17:48:32 crc kubenswrapper[5120]: I0316 17:48:32.007471 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6n5wb\" (UniqueName: \"kubernetes.io/projected/583e5a40-e31f-4ebb-9245-ca3a33034e47-kube-api-access-6n5wb\") pod \"keystone-7884c64b68-k6wq5\" (UID: \"583e5a40-e31f-4ebb-9245-ca3a33034e47\") " pod="keystone-kuttl-tests/keystone-7884c64b68-k6wq5" Mar 16 17:48:32 crc kubenswrapper[5120]: I0316 17:48:32.156082 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-7884c64b68-k6wq5" Mar 16 17:48:32 crc kubenswrapper[5120]: I0316 17:48:32.628933 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone-7884c64b68-k6wq5"] Mar 16 17:48:32 crc kubenswrapper[5120]: I0316 17:48:32.778425 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-7884c64b68-k6wq5" event={"ID":"583e5a40-e31f-4ebb-9245-ca3a33034e47","Type":"ContainerStarted","Data":"85b91e18b5792ac7e20ec71cd5d8da605b53b3f33135fa07033b87247cc21d0d"} Mar 16 17:48:33 crc kubenswrapper[5120]: I0316 17:48:33.787919 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-7884c64b68-k6wq5" event={"ID":"583e5a40-e31f-4ebb-9245-ca3a33034e47","Type":"ContainerStarted","Data":"b73d1b80a5693050e56377578fc861ee7045744dc9dc4cce7d12e0a4f0173ef6"} Mar 16 17:48:33 crc kubenswrapper[5120]: I0316 17:48:33.788287 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keystone-kuttl-tests/keystone-7884c64b68-k6wq5" Mar 16 17:48:33 crc kubenswrapper[5120]: I0316 17:48:33.810407 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keystone-kuttl-tests/keystone-7884c64b68-k6wq5" podStartSLOduration=2.810389661 podStartE2EDuration="2.810389661s" podCreationTimestamp="2026-03-16 17:48:31 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:48:33.80781572 +0000 UTC m=+8215.961747407" watchObservedRunningTime="2026-03-16 17:48:33.810389661 +0000 UTC m=+8215.964321328" Mar 16 17:48:35 crc kubenswrapper[5120]: I0316 17:48:35.457733 5120 scope.go:117] "RemoveContainer" containerID="695b69845da636ec62102d62f6d938ef81cdbb6b2eeddf0918610ef8afe18999" Mar 16 17:48:52 crc kubenswrapper[5120]: I0316 17:48:52.008254 5120 patch_prober.go:28] interesting pod/machine-config-daemon-7bf76 container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 17:48:52 crc kubenswrapper[5120]: I0316 17:48:52.008950 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 17:48:52 crc kubenswrapper[5120]: I0316 17:48:52.009035 5120 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" Mar 16 17:48:52 crc kubenswrapper[5120]: I0316 17:48:52.009669 5120 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="machine-config-daemon" containerStatusID={"Type":"cri-o","ID":"09cc7c20368ae6767b406319b2f6a0de85add28a4c1a3f75b70ae511bf5e3d62"} pod="openshift-machine-config-operator/machine-config-daemon-7bf76" containerMessage="Container machine-config-daemon failed liveness probe, will be restarted" Mar 16 17:48:52 crc kubenswrapper[5120]: I0316 17:48:52.009720 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" containerID="cri-o://09cc7c20368ae6767b406319b2f6a0de85add28a4c1a3f75b70ae511bf5e3d62" gracePeriod=600 Mar 16 17:48:52 crc kubenswrapper[5120]: I0316 17:48:52.992390 5120 generic.go:358] "Generic (PLEG): container finished" podID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerID="09cc7c20368ae6767b406319b2f6a0de85add28a4c1a3f75b70ae511bf5e3d62" exitCode=0 Mar 16 17:48:52 crc kubenswrapper[5120]: I0316 17:48:52.992449 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" event={"ID":"e2275cb4-4905-4d66-a87e-8010120db2bd","Type":"ContainerDied","Data":"09cc7c20368ae6767b406319b2f6a0de85add28a4c1a3f75b70ae511bf5e3d62"} Mar 16 17:48:52 crc kubenswrapper[5120]: I0316 17:48:52.992868 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" event={"ID":"e2275cb4-4905-4d66-a87e-8010120db2bd","Type":"ContainerStarted","Data":"3c36926311be0b5863354f251394b54af60074edc1c497847c55048c053dc819"} Mar 16 17:48:52 crc kubenswrapper[5120]: I0316 17:48:52.992891 5120 scope.go:117] "RemoveContainer" containerID="7fd764dd19065c7ce437c63b05fda51970409dfa8dfd1c77e2158bb3e05b7723" Mar 16 17:49:06 crc kubenswrapper[5120]: I0316 17:49:06.156805 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="keystone-kuttl-tests/keystone-7884c64b68-k6wq5" Mar 16 17:49:07 crc kubenswrapper[5120]: E0316 17:49:07.719525 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1111177 actualBytes=10240 Mar 16 17:49:21 crc kubenswrapper[5120]: I0316 17:49:21.995564 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keystone-kuttl-tests/keystone-bootstrap-xmxd2"] Mar 16 17:49:22 crc kubenswrapper[5120]: I0316 17:49:22.003377 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keystone-kuttl-tests/keystone-db-sync-hvn6f"] Mar 16 17:49:22 crc kubenswrapper[5120]: I0316 17:49:22.015639 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["keystone-kuttl-tests/keystone-bootstrap-xmxd2"] Mar 16 17:49:22 crc kubenswrapper[5120]: I0316 17:49:22.024859 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["keystone-kuttl-tests/keystone-db-sync-hvn6f"] Mar 16 17:49:22 crc kubenswrapper[5120]: I0316 17:49:22.031595 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keystone-kuttl-tests/keystone-7884c64b68-k6wq5"] Mar 16 17:49:22 crc kubenswrapper[5120]: I0316 17:49:22.031881 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="keystone-kuttl-tests/keystone-7884c64b68-k6wq5" podUID="583e5a40-e31f-4ebb-9245-ca3a33034e47" containerName="keystone-api" containerID="cri-o://b73d1b80a5693050e56377578fc861ee7045744dc9dc4cce7d12e0a4f0173ef6" gracePeriod=30 Mar 16 17:49:22 crc kubenswrapper[5120]: I0316 17:49:22.113703 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keystone-kuttl-tests/keystonea8e6-account-delete-5svlm"] Mar 16 17:49:22 crc kubenswrapper[5120]: I0316 17:49:22.118925 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystonea8e6-account-delete-5svlm" Mar 16 17:49:22 crc kubenswrapper[5120]: I0316 17:49:22.131165 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystonea8e6-account-delete-5svlm"] Mar 16 17:49:22 crc kubenswrapper[5120]: I0316 17:49:22.204368 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8kvn\" (UniqueName: \"kubernetes.io/projected/89b8a4d9-26ce-4ed2-867d-9e86787a8066-kube-api-access-t8kvn\") pod \"keystonea8e6-account-delete-5svlm\" (UID: \"89b8a4d9-26ce-4ed2-867d-9e86787a8066\") " pod="keystone-kuttl-tests/keystonea8e6-account-delete-5svlm" Mar 16 17:49:22 crc kubenswrapper[5120]: I0316 17:49:22.204808 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/89b8a4d9-26ce-4ed2-867d-9e86787a8066-operator-scripts\") pod \"keystonea8e6-account-delete-5svlm\" (UID: \"89b8a4d9-26ce-4ed2-867d-9e86787a8066\") " pod="keystone-kuttl-tests/keystonea8e6-account-delete-5svlm" Mar 16 17:49:22 crc kubenswrapper[5120]: I0316 17:49:22.306639 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t8kvn\" (UniqueName: \"kubernetes.io/projected/89b8a4d9-26ce-4ed2-867d-9e86787a8066-kube-api-access-t8kvn\") pod \"keystonea8e6-account-delete-5svlm\" (UID: \"89b8a4d9-26ce-4ed2-867d-9e86787a8066\") " pod="keystone-kuttl-tests/keystonea8e6-account-delete-5svlm" Mar 16 17:49:22 crc kubenswrapper[5120]: I0316 17:49:22.307156 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/89b8a4d9-26ce-4ed2-867d-9e86787a8066-operator-scripts\") pod \"keystonea8e6-account-delete-5svlm\" (UID: \"89b8a4d9-26ce-4ed2-867d-9e86787a8066\") " pod="keystone-kuttl-tests/keystonea8e6-account-delete-5svlm" Mar 16 17:49:22 crc kubenswrapper[5120]: I0316 17:49:22.308096 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/89b8a4d9-26ce-4ed2-867d-9e86787a8066-operator-scripts\") pod \"keystonea8e6-account-delete-5svlm\" (UID: \"89b8a4d9-26ce-4ed2-867d-9e86787a8066\") " pod="keystone-kuttl-tests/keystonea8e6-account-delete-5svlm" Mar 16 17:49:22 crc kubenswrapper[5120]: I0316 17:49:22.347045 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8kvn\" (UniqueName: \"kubernetes.io/projected/89b8a4d9-26ce-4ed2-867d-9e86787a8066-kube-api-access-t8kvn\") pod \"keystonea8e6-account-delete-5svlm\" (UID: \"89b8a4d9-26ce-4ed2-867d-9e86787a8066\") " pod="keystone-kuttl-tests/keystonea8e6-account-delete-5svlm" Mar 16 17:49:22 crc kubenswrapper[5120]: I0316 17:49:22.437278 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystonea8e6-account-delete-5svlm" Mar 16 17:49:22 crc kubenswrapper[5120]: I0316 17:49:22.674160 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="641d54a9-94ed-42f3-b513-c94f05f27311" path="/var/lib/kubelet/pods/641d54a9-94ed-42f3-b513-c94f05f27311/volumes" Mar 16 17:49:22 crc kubenswrapper[5120]: I0316 17:49:22.676027 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="91ef6947-c804-49da-a762-ba6714d5ec55" path="/var/lib/kubelet/pods/91ef6947-c804-49da-a762-ba6714d5ec55/volumes" Mar 16 17:49:22 crc kubenswrapper[5120]: I0316 17:49:22.842445 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystonea8e6-account-delete-5svlm"] Mar 16 17:49:23 crc kubenswrapper[5120]: I0316 17:49:23.301063 5120 generic.go:358] "Generic (PLEG): container finished" podID="89b8a4d9-26ce-4ed2-867d-9e86787a8066" containerID="3397fa7056374366985f6b9c2ff62dffac38fb6a459fd5e86e6b72eec919373f" exitCode=0 Mar 16 17:49:23 crc kubenswrapper[5120]: I0316 17:49:23.301132 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystonea8e6-account-delete-5svlm" event={"ID":"89b8a4d9-26ce-4ed2-867d-9e86787a8066","Type":"ContainerDied","Data":"3397fa7056374366985f6b9c2ff62dffac38fb6a459fd5e86e6b72eec919373f"} Mar 16 17:49:23 crc kubenswrapper[5120]: I0316 17:49:23.301606 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystonea8e6-account-delete-5svlm" event={"ID":"89b8a4d9-26ce-4ed2-867d-9e86787a8066","Type":"ContainerStarted","Data":"d852705767b041dd15b56c167aa3670bc2edb9cbe702d18a1dcabda4fd9f4bf5"} Mar 16 17:49:24 crc kubenswrapper[5120]: I0316 17:49:24.564075 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystonea8e6-account-delete-5svlm" Mar 16 17:49:24 crc kubenswrapper[5120]: I0316 17:49:24.663612 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t8kvn\" (UniqueName: \"kubernetes.io/projected/89b8a4d9-26ce-4ed2-867d-9e86787a8066-kube-api-access-t8kvn\") pod \"89b8a4d9-26ce-4ed2-867d-9e86787a8066\" (UID: \"89b8a4d9-26ce-4ed2-867d-9e86787a8066\") " Mar 16 17:49:24 crc kubenswrapper[5120]: I0316 17:49:24.663723 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/89b8a4d9-26ce-4ed2-867d-9e86787a8066-operator-scripts\") pod \"89b8a4d9-26ce-4ed2-867d-9e86787a8066\" (UID: \"89b8a4d9-26ce-4ed2-867d-9e86787a8066\") " Mar 16 17:49:24 crc kubenswrapper[5120]: I0316 17:49:24.664625 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/89b8a4d9-26ce-4ed2-867d-9e86787a8066-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "89b8a4d9-26ce-4ed2-867d-9e86787a8066" (UID: "89b8a4d9-26ce-4ed2-867d-9e86787a8066"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:49:24 crc kubenswrapper[5120]: I0316 17:49:24.676055 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/89b8a4d9-26ce-4ed2-867d-9e86787a8066-kube-api-access-t8kvn" (OuterVolumeSpecName: "kube-api-access-t8kvn") pod "89b8a4d9-26ce-4ed2-867d-9e86787a8066" (UID: "89b8a4d9-26ce-4ed2-867d-9e86787a8066"). InnerVolumeSpecName "kube-api-access-t8kvn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:49:24 crc kubenswrapper[5120]: I0316 17:49:24.767331 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t8kvn\" (UniqueName: \"kubernetes.io/projected/89b8a4d9-26ce-4ed2-867d-9e86787a8066-kube-api-access-t8kvn\") on node \"crc\" DevicePath \"\"" Mar 16 17:49:24 crc kubenswrapper[5120]: I0316 17:49:24.767645 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/89b8a4d9-26ce-4ed2-867d-9e86787a8066-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:49:25 crc kubenswrapper[5120]: I0316 17:49:25.326048 5120 generic.go:358] "Generic (PLEG): container finished" podID="583e5a40-e31f-4ebb-9245-ca3a33034e47" containerID="b73d1b80a5693050e56377578fc861ee7045744dc9dc4cce7d12e0a4f0173ef6" exitCode=0 Mar 16 17:49:25 crc kubenswrapper[5120]: I0316 17:49:25.326116 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-7884c64b68-k6wq5" event={"ID":"583e5a40-e31f-4ebb-9245-ca3a33034e47","Type":"ContainerDied","Data":"b73d1b80a5693050e56377578fc861ee7045744dc9dc4cce7d12e0a4f0173ef6"} Mar 16 17:49:25 crc kubenswrapper[5120]: I0316 17:49:25.329072 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystonea8e6-account-delete-5svlm" Mar 16 17:49:25 crc kubenswrapper[5120]: I0316 17:49:25.329301 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystonea8e6-account-delete-5svlm" event={"ID":"89b8a4d9-26ce-4ed2-867d-9e86787a8066","Type":"ContainerDied","Data":"d852705767b041dd15b56c167aa3670bc2edb9cbe702d18a1dcabda4fd9f4bf5"} Mar 16 17:49:25 crc kubenswrapper[5120]: I0316 17:49:25.329355 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d852705767b041dd15b56c167aa3670bc2edb9cbe702d18a1dcabda4fd9f4bf5" Mar 16 17:49:25 crc kubenswrapper[5120]: I0316 17:49:25.546285 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-7884c64b68-k6wq5" Mar 16 17:49:25 crc kubenswrapper[5120]: I0316 17:49:25.584216 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/583e5a40-e31f-4ebb-9245-ca3a33034e47-config-data\") pod \"583e5a40-e31f-4ebb-9245-ca3a33034e47\" (UID: \"583e5a40-e31f-4ebb-9245-ca3a33034e47\") " Mar 16 17:49:25 crc kubenswrapper[5120]: I0316 17:49:25.584484 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6n5wb\" (UniqueName: \"kubernetes.io/projected/583e5a40-e31f-4ebb-9245-ca3a33034e47-kube-api-access-6n5wb\") pod \"583e5a40-e31f-4ebb-9245-ca3a33034e47\" (UID: \"583e5a40-e31f-4ebb-9245-ca3a33034e47\") " Mar 16 17:49:25 crc kubenswrapper[5120]: I0316 17:49:25.585054 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/583e5a40-e31f-4ebb-9245-ca3a33034e47-fernet-keys\") pod \"583e5a40-e31f-4ebb-9245-ca3a33034e47\" (UID: \"583e5a40-e31f-4ebb-9245-ca3a33034e47\") " Mar 16 17:49:25 crc kubenswrapper[5120]: I0316 17:49:25.585106 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/583e5a40-e31f-4ebb-9245-ca3a33034e47-credential-keys\") pod \"583e5a40-e31f-4ebb-9245-ca3a33034e47\" (UID: \"583e5a40-e31f-4ebb-9245-ca3a33034e47\") " Mar 16 17:49:25 crc kubenswrapper[5120]: I0316 17:49:25.585331 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/583e5a40-e31f-4ebb-9245-ca3a33034e47-scripts\") pod \"583e5a40-e31f-4ebb-9245-ca3a33034e47\" (UID: \"583e5a40-e31f-4ebb-9245-ca3a33034e47\") " Mar 16 17:49:25 crc kubenswrapper[5120]: I0316 17:49:25.590338 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/583e5a40-e31f-4ebb-9245-ca3a33034e47-scripts" (OuterVolumeSpecName: "scripts") pod "583e5a40-e31f-4ebb-9245-ca3a33034e47" (UID: "583e5a40-e31f-4ebb-9245-ca3a33034e47"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:49:25 crc kubenswrapper[5120]: I0316 17:49:25.593325 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/583e5a40-e31f-4ebb-9245-ca3a33034e47-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "583e5a40-e31f-4ebb-9245-ca3a33034e47" (UID: "583e5a40-e31f-4ebb-9245-ca3a33034e47"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:49:25 crc kubenswrapper[5120]: I0316 17:49:25.598202 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/583e5a40-e31f-4ebb-9245-ca3a33034e47-kube-api-access-6n5wb" (OuterVolumeSpecName: "kube-api-access-6n5wb") pod "583e5a40-e31f-4ebb-9245-ca3a33034e47" (UID: "583e5a40-e31f-4ebb-9245-ca3a33034e47"). InnerVolumeSpecName "kube-api-access-6n5wb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:49:25 crc kubenswrapper[5120]: I0316 17:49:25.608308 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/583e5a40-e31f-4ebb-9245-ca3a33034e47-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "583e5a40-e31f-4ebb-9245-ca3a33034e47" (UID: "583e5a40-e31f-4ebb-9245-ca3a33034e47"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:49:25 crc kubenswrapper[5120]: I0316 17:49:25.617136 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/583e5a40-e31f-4ebb-9245-ca3a33034e47-config-data" (OuterVolumeSpecName: "config-data") pod "583e5a40-e31f-4ebb-9245-ca3a33034e47" (UID: "583e5a40-e31f-4ebb-9245-ca3a33034e47"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:49:25 crc kubenswrapper[5120]: I0316 17:49:25.687781 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/583e5a40-e31f-4ebb-9245-ca3a33034e47-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:49:25 crc kubenswrapper[5120]: I0316 17:49:25.688158 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/583e5a40-e31f-4ebb-9245-ca3a33034e47-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:49:25 crc kubenswrapper[5120]: I0316 17:49:25.688173 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6n5wb\" (UniqueName: \"kubernetes.io/projected/583e5a40-e31f-4ebb-9245-ca3a33034e47-kube-api-access-6n5wb\") on node \"crc\" DevicePath \"\"" Mar 16 17:49:25 crc kubenswrapper[5120]: I0316 17:49:25.688185 5120 reconciler_common.go:299] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/583e5a40-e31f-4ebb-9245-ca3a33034e47-fernet-keys\") on node \"crc\" DevicePath \"\"" Mar 16 17:49:25 crc kubenswrapper[5120]: I0316 17:49:25.688197 5120 reconciler_common.go:299] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/583e5a40-e31f-4ebb-9245-ca3a33034e47-credential-keys\") on node \"crc\" DevicePath \"\"" Mar 16 17:49:26 crc kubenswrapper[5120]: I0316 17:49:26.343615 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-7884c64b68-k6wq5" Mar 16 17:49:26 crc kubenswrapper[5120]: I0316 17:49:26.343624 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-7884c64b68-k6wq5" event={"ID":"583e5a40-e31f-4ebb-9245-ca3a33034e47","Type":"ContainerDied","Data":"85b91e18b5792ac7e20ec71cd5d8da605b53b3f33135fa07033b87247cc21d0d"} Mar 16 17:49:26 crc kubenswrapper[5120]: I0316 17:49:26.343863 5120 scope.go:117] "RemoveContainer" containerID="b73d1b80a5693050e56377578fc861ee7045744dc9dc4cce7d12e0a4f0173ef6" Mar 16 17:49:26 crc kubenswrapper[5120]: I0316 17:49:26.408378 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keystone-kuttl-tests/keystone-7884c64b68-k6wq5"] Mar 16 17:49:26 crc kubenswrapper[5120]: I0316 17:49:26.415319 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["keystone-kuttl-tests/keystone-7884c64b68-k6wq5"] Mar 16 17:49:26 crc kubenswrapper[5120]: I0316 17:49:26.677250 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="583e5a40-e31f-4ebb-9245-ca3a33034e47" path="/var/lib/kubelet/pods/583e5a40-e31f-4ebb-9245-ca3a33034e47/volumes" Mar 16 17:49:27 crc kubenswrapper[5120]: I0316 17:49:27.139875 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keystone-kuttl-tests/keystone-db-create-jbnfw"] Mar 16 17:49:27 crc kubenswrapper[5120]: I0316 17:49:27.153185 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["keystone-kuttl-tests/keystone-db-create-jbnfw"] Mar 16 17:49:27 crc kubenswrapper[5120]: I0316 17:49:27.159694 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keystone-kuttl-tests/keystonea8e6-account-delete-5svlm"] Mar 16 17:49:27 crc kubenswrapper[5120]: I0316 17:49:27.165339 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keystone-kuttl-tests/keystone-a8e6-account-create-update-btqck"] Mar 16 17:49:27 crc kubenswrapper[5120]: I0316 17:49:27.173433 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["keystone-kuttl-tests/keystone-a8e6-account-create-update-btqck"] Mar 16 17:49:27 crc kubenswrapper[5120]: I0316 17:49:27.181191 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["keystone-kuttl-tests/keystonea8e6-account-delete-5svlm"] Mar 16 17:49:27 crc kubenswrapper[5120]: I0316 17:49:27.369394 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keystone-kuttl-tests/keystone-db-create-rmq2d"] Mar 16 17:49:27 crc kubenswrapper[5120]: I0316 17:49:27.370393 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="583e5a40-e31f-4ebb-9245-ca3a33034e47" containerName="keystone-api" Mar 16 17:49:27 crc kubenswrapper[5120]: I0316 17:49:27.370413 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="583e5a40-e31f-4ebb-9245-ca3a33034e47" containerName="keystone-api" Mar 16 17:49:27 crc kubenswrapper[5120]: I0316 17:49:27.370428 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89b8a4d9-26ce-4ed2-867d-9e86787a8066" containerName="mariadb-account-delete" Mar 16 17:49:27 crc kubenswrapper[5120]: I0316 17:49:27.370434 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="89b8a4d9-26ce-4ed2-867d-9e86787a8066" containerName="mariadb-account-delete" Mar 16 17:49:27 crc kubenswrapper[5120]: I0316 17:49:27.370602 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="89b8a4d9-26ce-4ed2-867d-9e86787a8066" containerName="mariadb-account-delete" Mar 16 17:49:27 crc kubenswrapper[5120]: I0316 17:49:27.370625 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="583e5a40-e31f-4ebb-9245-ca3a33034e47" containerName="keystone-api" Mar 16 17:49:27 crc kubenswrapper[5120]: I0316 17:49:27.378040 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keystone-kuttl-tests/keystone-89cf-account-create-update-852nf"] Mar 16 17:49:27 crc kubenswrapper[5120]: I0316 17:49:27.378222 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-db-create-rmq2d" Mar 16 17:49:27 crc kubenswrapper[5120]: I0316 17:49:27.382656 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone-db-create-rmq2d"] Mar 16 17:49:27 crc kubenswrapper[5120]: I0316 17:49:27.382782 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-89cf-account-create-update-852nf" Mar 16 17:49:27 crc kubenswrapper[5120]: I0316 17:49:27.385726 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keystone-kuttl-tests\"/\"keystone-db-secret\"" Mar 16 17:49:27 crc kubenswrapper[5120]: I0316 17:49:27.408444 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone-89cf-account-create-update-852nf"] Mar 16 17:49:27 crc kubenswrapper[5120]: I0316 17:49:27.435712 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mnmr\" (UniqueName: \"kubernetes.io/projected/e7fb8066-4dd0-4f27-8d5e-891e01899c93-kube-api-access-9mnmr\") pod \"keystone-db-create-rmq2d\" (UID: \"e7fb8066-4dd0-4f27-8d5e-891e01899c93\") " pod="keystone-kuttl-tests/keystone-db-create-rmq2d" Mar 16 17:49:27 crc kubenswrapper[5120]: I0316 17:49:27.435769 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zscwr\" (UniqueName: \"kubernetes.io/projected/88ad41ed-1892-4bb8-8877-5a42dea57445-kube-api-access-zscwr\") pod \"keystone-89cf-account-create-update-852nf\" (UID: \"88ad41ed-1892-4bb8-8877-5a42dea57445\") " pod="keystone-kuttl-tests/keystone-89cf-account-create-update-852nf" Mar 16 17:49:27 crc kubenswrapper[5120]: I0316 17:49:27.435798 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/88ad41ed-1892-4bb8-8877-5a42dea57445-operator-scripts\") pod \"keystone-89cf-account-create-update-852nf\" (UID: \"88ad41ed-1892-4bb8-8877-5a42dea57445\") " pod="keystone-kuttl-tests/keystone-89cf-account-create-update-852nf" Mar 16 17:49:27 crc kubenswrapper[5120]: I0316 17:49:27.435878 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e7fb8066-4dd0-4f27-8d5e-891e01899c93-operator-scripts\") pod \"keystone-db-create-rmq2d\" (UID: \"e7fb8066-4dd0-4f27-8d5e-891e01899c93\") " pod="keystone-kuttl-tests/keystone-db-create-rmq2d" Mar 16 17:49:27 crc kubenswrapper[5120]: I0316 17:49:27.538737 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9mnmr\" (UniqueName: \"kubernetes.io/projected/e7fb8066-4dd0-4f27-8d5e-891e01899c93-kube-api-access-9mnmr\") pod \"keystone-db-create-rmq2d\" (UID: \"e7fb8066-4dd0-4f27-8d5e-891e01899c93\") " pod="keystone-kuttl-tests/keystone-db-create-rmq2d" Mar 16 17:49:27 crc kubenswrapper[5120]: I0316 17:49:27.538839 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zscwr\" (UniqueName: \"kubernetes.io/projected/88ad41ed-1892-4bb8-8877-5a42dea57445-kube-api-access-zscwr\") pod \"keystone-89cf-account-create-update-852nf\" (UID: \"88ad41ed-1892-4bb8-8877-5a42dea57445\") " pod="keystone-kuttl-tests/keystone-89cf-account-create-update-852nf" Mar 16 17:49:27 crc kubenswrapper[5120]: I0316 17:49:27.538874 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/88ad41ed-1892-4bb8-8877-5a42dea57445-operator-scripts\") pod \"keystone-89cf-account-create-update-852nf\" (UID: \"88ad41ed-1892-4bb8-8877-5a42dea57445\") " pod="keystone-kuttl-tests/keystone-89cf-account-create-update-852nf" Mar 16 17:49:27 crc kubenswrapper[5120]: I0316 17:49:27.538987 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e7fb8066-4dd0-4f27-8d5e-891e01899c93-operator-scripts\") pod \"keystone-db-create-rmq2d\" (UID: \"e7fb8066-4dd0-4f27-8d5e-891e01899c93\") " pod="keystone-kuttl-tests/keystone-db-create-rmq2d" Mar 16 17:49:27 crc kubenswrapper[5120]: I0316 17:49:27.539840 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/88ad41ed-1892-4bb8-8877-5a42dea57445-operator-scripts\") pod \"keystone-89cf-account-create-update-852nf\" (UID: \"88ad41ed-1892-4bb8-8877-5a42dea57445\") " pod="keystone-kuttl-tests/keystone-89cf-account-create-update-852nf" Mar 16 17:49:27 crc kubenswrapper[5120]: I0316 17:49:27.540467 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e7fb8066-4dd0-4f27-8d5e-891e01899c93-operator-scripts\") pod \"keystone-db-create-rmq2d\" (UID: \"e7fb8066-4dd0-4f27-8d5e-891e01899c93\") " pod="keystone-kuttl-tests/keystone-db-create-rmq2d" Mar 16 17:49:27 crc kubenswrapper[5120]: I0316 17:49:27.558342 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zscwr\" (UniqueName: \"kubernetes.io/projected/88ad41ed-1892-4bb8-8877-5a42dea57445-kube-api-access-zscwr\") pod \"keystone-89cf-account-create-update-852nf\" (UID: \"88ad41ed-1892-4bb8-8877-5a42dea57445\") " pod="keystone-kuttl-tests/keystone-89cf-account-create-update-852nf" Mar 16 17:49:27 crc kubenswrapper[5120]: I0316 17:49:27.566306 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mnmr\" (UniqueName: \"kubernetes.io/projected/e7fb8066-4dd0-4f27-8d5e-891e01899c93-kube-api-access-9mnmr\") pod \"keystone-db-create-rmq2d\" (UID: \"e7fb8066-4dd0-4f27-8d5e-891e01899c93\") " pod="keystone-kuttl-tests/keystone-db-create-rmq2d" Mar 16 17:49:27 crc kubenswrapper[5120]: I0316 17:49:27.705379 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-db-create-rmq2d" Mar 16 17:49:27 crc kubenswrapper[5120]: I0316 17:49:27.718789 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-89cf-account-create-update-852nf" Mar 16 17:49:28 crc kubenswrapper[5120]: I0316 17:49:28.210813 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone-db-create-rmq2d"] Mar 16 17:49:28 crc kubenswrapper[5120]: W0316 17:49:28.264574 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode7fb8066_4dd0_4f27_8d5e_891e01899c93.slice/crio-791e42e30616d2752a1318b38120c9e7203030ec3503f7363a159e2262642b3b WatchSource:0}: Error finding container 791e42e30616d2752a1318b38120c9e7203030ec3503f7363a159e2262642b3b: Status 404 returned error can't find the container with id 791e42e30616d2752a1318b38120c9e7203030ec3503f7363a159e2262642b3b Mar 16 17:49:28 crc kubenswrapper[5120]: I0316 17:49:28.303354 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone-89cf-account-create-update-852nf"] Mar 16 17:49:28 crc kubenswrapper[5120]: W0316 17:49:28.313805 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod88ad41ed_1892_4bb8_8877_5a42dea57445.slice/crio-4478b89a18cea29604d0bd83eb58cba0ec055f216078a34d228d26fa80f74be1 WatchSource:0}: Error finding container 4478b89a18cea29604d0bd83eb58cba0ec055f216078a34d228d26fa80f74be1: Status 404 returned error can't find the container with id 4478b89a18cea29604d0bd83eb58cba0ec055f216078a34d228d26fa80f74be1 Mar 16 17:49:28 crc kubenswrapper[5120]: I0316 17:49:28.362959 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-db-create-rmq2d" event={"ID":"e7fb8066-4dd0-4f27-8d5e-891e01899c93","Type":"ContainerStarted","Data":"791e42e30616d2752a1318b38120c9e7203030ec3503f7363a159e2262642b3b"} Mar 16 17:49:28 crc kubenswrapper[5120]: I0316 17:49:28.364257 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-89cf-account-create-update-852nf" event={"ID":"88ad41ed-1892-4bb8-8877-5a42dea57445","Type":"ContainerStarted","Data":"4478b89a18cea29604d0bd83eb58cba0ec055f216078a34d228d26fa80f74be1"} Mar 16 17:49:28 crc kubenswrapper[5120]: I0316 17:49:28.678999 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f91e503-76a2-49a5-9102-4980a9e8d7e5" path="/var/lib/kubelet/pods/1f91e503-76a2-49a5-9102-4980a9e8d7e5/volumes" Mar 16 17:49:28 crc kubenswrapper[5120]: I0316 17:49:28.680198 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="89b8a4d9-26ce-4ed2-867d-9e86787a8066" path="/var/lib/kubelet/pods/89b8a4d9-26ce-4ed2-867d-9e86787a8066/volumes" Mar 16 17:49:28 crc kubenswrapper[5120]: I0316 17:49:28.680794 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c38d1e17-ff43-435b-a826-81fd7547f874" path="/var/lib/kubelet/pods/c38d1e17-ff43-435b-a826-81fd7547f874/volumes" Mar 16 17:49:29 crc kubenswrapper[5120]: I0316 17:49:29.379397 5120 generic.go:358] "Generic (PLEG): container finished" podID="e7fb8066-4dd0-4f27-8d5e-891e01899c93" containerID="d8edd17437990f3c15c31e8e69adc024ccd681c00ab828102cd8f20d5419f467" exitCode=0 Mar 16 17:49:29 crc kubenswrapper[5120]: I0316 17:49:29.379550 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-db-create-rmq2d" event={"ID":"e7fb8066-4dd0-4f27-8d5e-891e01899c93","Type":"ContainerDied","Data":"d8edd17437990f3c15c31e8e69adc024ccd681c00ab828102cd8f20d5419f467"} Mar 16 17:49:29 crc kubenswrapper[5120]: I0316 17:49:29.381704 5120 generic.go:358] "Generic (PLEG): container finished" podID="88ad41ed-1892-4bb8-8877-5a42dea57445" containerID="d331541b1b2f943abfdc4e795363ba91ce57b9f4e091d52376056ba5aa69cbea" exitCode=0 Mar 16 17:49:29 crc kubenswrapper[5120]: I0316 17:49:29.381931 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-89cf-account-create-update-852nf" event={"ID":"88ad41ed-1892-4bb8-8877-5a42dea57445","Type":"ContainerDied","Data":"d331541b1b2f943abfdc4e795363ba91ce57b9f4e091d52376056ba5aa69cbea"} Mar 16 17:49:30 crc kubenswrapper[5120]: I0316 17:49:30.701153 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-db-create-rmq2d" Mar 16 17:49:30 crc kubenswrapper[5120]: I0316 17:49:30.757650 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-89cf-account-create-update-852nf" Mar 16 17:49:30 crc kubenswrapper[5120]: I0316 17:49:30.835381 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9mnmr\" (UniqueName: \"kubernetes.io/projected/e7fb8066-4dd0-4f27-8d5e-891e01899c93-kube-api-access-9mnmr\") pod \"e7fb8066-4dd0-4f27-8d5e-891e01899c93\" (UID: \"e7fb8066-4dd0-4f27-8d5e-891e01899c93\") " Mar 16 17:49:30 crc kubenswrapper[5120]: I0316 17:49:30.835969 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e7fb8066-4dd0-4f27-8d5e-891e01899c93-operator-scripts\") pod \"e7fb8066-4dd0-4f27-8d5e-891e01899c93\" (UID: \"e7fb8066-4dd0-4f27-8d5e-891e01899c93\") " Mar 16 17:49:30 crc kubenswrapper[5120]: I0316 17:49:30.836452 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e7fb8066-4dd0-4f27-8d5e-891e01899c93-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "e7fb8066-4dd0-4f27-8d5e-891e01899c93" (UID: "e7fb8066-4dd0-4f27-8d5e-891e01899c93"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:49:30 crc kubenswrapper[5120]: I0316 17:49:30.836960 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e7fb8066-4dd0-4f27-8d5e-891e01899c93-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:49:30 crc kubenswrapper[5120]: I0316 17:49:30.841005 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7fb8066-4dd0-4f27-8d5e-891e01899c93-kube-api-access-9mnmr" (OuterVolumeSpecName: "kube-api-access-9mnmr") pod "e7fb8066-4dd0-4f27-8d5e-891e01899c93" (UID: "e7fb8066-4dd0-4f27-8d5e-891e01899c93"). InnerVolumeSpecName "kube-api-access-9mnmr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:49:30 crc kubenswrapper[5120]: I0316 17:49:30.937883 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/88ad41ed-1892-4bb8-8877-5a42dea57445-operator-scripts\") pod \"88ad41ed-1892-4bb8-8877-5a42dea57445\" (UID: \"88ad41ed-1892-4bb8-8877-5a42dea57445\") " Mar 16 17:49:30 crc kubenswrapper[5120]: I0316 17:49:30.938304 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zscwr\" (UniqueName: \"kubernetes.io/projected/88ad41ed-1892-4bb8-8877-5a42dea57445-kube-api-access-zscwr\") pod \"88ad41ed-1892-4bb8-8877-5a42dea57445\" (UID: \"88ad41ed-1892-4bb8-8877-5a42dea57445\") " Mar 16 17:49:30 crc kubenswrapper[5120]: I0316 17:49:30.938869 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9mnmr\" (UniqueName: \"kubernetes.io/projected/e7fb8066-4dd0-4f27-8d5e-891e01899c93-kube-api-access-9mnmr\") on node \"crc\" DevicePath \"\"" Mar 16 17:49:30 crc kubenswrapper[5120]: I0316 17:49:30.938950 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/88ad41ed-1892-4bb8-8877-5a42dea57445-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "88ad41ed-1892-4bb8-8877-5a42dea57445" (UID: "88ad41ed-1892-4bb8-8877-5a42dea57445"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 17:49:30 crc kubenswrapper[5120]: I0316 17:49:30.941875 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88ad41ed-1892-4bb8-8877-5a42dea57445-kube-api-access-zscwr" (OuterVolumeSpecName: "kube-api-access-zscwr") pod "88ad41ed-1892-4bb8-8877-5a42dea57445" (UID: "88ad41ed-1892-4bb8-8877-5a42dea57445"). InnerVolumeSpecName "kube-api-access-zscwr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:49:31 crc kubenswrapper[5120]: I0316 17:49:31.040351 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zscwr\" (UniqueName: \"kubernetes.io/projected/88ad41ed-1892-4bb8-8877-5a42dea57445-kube-api-access-zscwr\") on node \"crc\" DevicePath \"\"" Mar 16 17:49:31 crc kubenswrapper[5120]: I0316 17:49:31.040395 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/88ad41ed-1892-4bb8-8877-5a42dea57445-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:49:31 crc kubenswrapper[5120]: I0316 17:49:31.404965 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-db-create-rmq2d" Mar 16 17:49:31 crc kubenswrapper[5120]: I0316 17:49:31.405042 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-db-create-rmq2d" event={"ID":"e7fb8066-4dd0-4f27-8d5e-891e01899c93","Type":"ContainerDied","Data":"791e42e30616d2752a1318b38120c9e7203030ec3503f7363a159e2262642b3b"} Mar 16 17:49:31 crc kubenswrapper[5120]: I0316 17:49:31.405485 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="791e42e30616d2752a1318b38120c9e7203030ec3503f7363a159e2262642b3b" Mar 16 17:49:31 crc kubenswrapper[5120]: I0316 17:49:31.407730 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-89cf-account-create-update-852nf" Mar 16 17:49:31 crc kubenswrapper[5120]: I0316 17:49:31.407793 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-89cf-account-create-update-852nf" event={"ID":"88ad41ed-1892-4bb8-8877-5a42dea57445","Type":"ContainerDied","Data":"4478b89a18cea29604d0bd83eb58cba0ec055f216078a34d228d26fa80f74be1"} Mar 16 17:49:31 crc kubenswrapper[5120]: I0316 17:49:31.407835 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4478b89a18cea29604d0bd83eb58cba0ec055f216078a34d228d26fa80f74be1" Mar 16 17:49:32 crc kubenswrapper[5120]: I0316 17:49:32.955501 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keystone-kuttl-tests/keystone-db-sync-g7676"] Mar 16 17:49:32 crc kubenswrapper[5120]: I0316 17:49:32.956488 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88ad41ed-1892-4bb8-8877-5a42dea57445" containerName="mariadb-account-create-update" Mar 16 17:49:32 crc kubenswrapper[5120]: I0316 17:49:32.956506 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="88ad41ed-1892-4bb8-8877-5a42dea57445" containerName="mariadb-account-create-update" Mar 16 17:49:32 crc kubenswrapper[5120]: I0316 17:49:32.956522 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7fb8066-4dd0-4f27-8d5e-891e01899c93" containerName="mariadb-database-create" Mar 16 17:49:32 crc kubenswrapper[5120]: I0316 17:49:32.956529 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7fb8066-4dd0-4f27-8d5e-891e01899c93" containerName="mariadb-database-create" Mar 16 17:49:32 crc kubenswrapper[5120]: I0316 17:49:32.956674 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e7fb8066-4dd0-4f27-8d5e-891e01899c93" containerName="mariadb-database-create" Mar 16 17:49:32 crc kubenswrapper[5120]: I0316 17:49:32.956697 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="88ad41ed-1892-4bb8-8877-5a42dea57445" containerName="mariadb-account-create-update" Mar 16 17:49:32 crc kubenswrapper[5120]: I0316 17:49:32.961112 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-db-sync-g7676" Mar 16 17:49:32 crc kubenswrapper[5120]: I0316 17:49:32.964719 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keystone-kuttl-tests\"/\"keystone-scripts\"" Mar 16 17:49:32 crc kubenswrapper[5120]: I0316 17:49:32.964841 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keystone-kuttl-tests\"/\"keystone-keystone-dockercfg-ptkb9\"" Mar 16 17:49:32 crc kubenswrapper[5120]: I0316 17:49:32.965111 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keystone-kuttl-tests\"/\"keystone-config-data\"" Mar 16 17:49:32 crc kubenswrapper[5120]: I0316 17:49:32.965362 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keystone-kuttl-tests\"/\"keystone\"" Mar 16 17:49:32 crc kubenswrapper[5120]: I0316 17:49:32.982958 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone-db-sync-g7676"] Mar 16 17:49:33 crc kubenswrapper[5120]: I0316 17:49:33.095794 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-926xc\" (UniqueName: \"kubernetes.io/projected/c6cc45db-b582-4109-8b62-399fddf30c4b-kube-api-access-926xc\") pod \"keystone-db-sync-g7676\" (UID: \"c6cc45db-b582-4109-8b62-399fddf30c4b\") " pod="keystone-kuttl-tests/keystone-db-sync-g7676" Mar 16 17:49:33 crc kubenswrapper[5120]: I0316 17:49:33.096101 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c6cc45db-b582-4109-8b62-399fddf30c4b-config-data\") pod \"keystone-db-sync-g7676\" (UID: \"c6cc45db-b582-4109-8b62-399fddf30c4b\") " pod="keystone-kuttl-tests/keystone-db-sync-g7676" Mar 16 17:49:33 crc kubenswrapper[5120]: I0316 17:49:33.199676 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-926xc\" (UniqueName: \"kubernetes.io/projected/c6cc45db-b582-4109-8b62-399fddf30c4b-kube-api-access-926xc\") pod \"keystone-db-sync-g7676\" (UID: \"c6cc45db-b582-4109-8b62-399fddf30c4b\") " pod="keystone-kuttl-tests/keystone-db-sync-g7676" Mar 16 17:49:33 crc kubenswrapper[5120]: I0316 17:49:33.201366 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c6cc45db-b582-4109-8b62-399fddf30c4b-config-data\") pod \"keystone-db-sync-g7676\" (UID: \"c6cc45db-b582-4109-8b62-399fddf30c4b\") " pod="keystone-kuttl-tests/keystone-db-sync-g7676" Mar 16 17:49:33 crc kubenswrapper[5120]: I0316 17:49:33.208858 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c6cc45db-b582-4109-8b62-399fddf30c4b-config-data\") pod \"keystone-db-sync-g7676\" (UID: \"c6cc45db-b582-4109-8b62-399fddf30c4b\") " pod="keystone-kuttl-tests/keystone-db-sync-g7676" Mar 16 17:49:33 crc kubenswrapper[5120]: I0316 17:49:33.217384 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-926xc\" (UniqueName: \"kubernetes.io/projected/c6cc45db-b582-4109-8b62-399fddf30c4b-kube-api-access-926xc\") pod \"keystone-db-sync-g7676\" (UID: \"c6cc45db-b582-4109-8b62-399fddf30c4b\") " pod="keystone-kuttl-tests/keystone-db-sync-g7676" Mar 16 17:49:33 crc kubenswrapper[5120]: I0316 17:49:33.288358 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-db-sync-g7676" Mar 16 17:49:33 crc kubenswrapper[5120]: I0316 17:49:33.712390 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone-db-sync-g7676"] Mar 16 17:49:34 crc kubenswrapper[5120]: I0316 17:49:34.433901 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-db-sync-g7676" event={"ID":"c6cc45db-b582-4109-8b62-399fddf30c4b","Type":"ContainerStarted","Data":"70366333713b0ab6e2d38e6614593401fdd8a55a0d7f2034760abb2a7c42425a"} Mar 16 17:49:34 crc kubenswrapper[5120]: I0316 17:49:34.434287 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-db-sync-g7676" event={"ID":"c6cc45db-b582-4109-8b62-399fddf30c4b","Type":"ContainerStarted","Data":"8e483e004fb986f91b1c4c384c60855e193f2ef4797bce765d6340fa86e58861"} Mar 16 17:49:34 crc kubenswrapper[5120]: I0316 17:49:34.461943 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keystone-kuttl-tests/keystone-db-sync-g7676" podStartSLOduration=2.461923194 podStartE2EDuration="2.461923194s" podCreationTimestamp="2026-03-16 17:49:32 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:49:34.452885676 +0000 UTC m=+8276.606817383" watchObservedRunningTime="2026-03-16 17:49:34.461923194 +0000 UTC m=+8276.615854861" Mar 16 17:49:35 crc kubenswrapper[5120]: I0316 17:49:35.446688 5120 generic.go:358] "Generic (PLEG): container finished" podID="c6cc45db-b582-4109-8b62-399fddf30c4b" containerID="70366333713b0ab6e2d38e6614593401fdd8a55a0d7f2034760abb2a7c42425a" exitCode=0 Mar 16 17:49:35 crc kubenswrapper[5120]: I0316 17:49:35.446833 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-db-sync-g7676" event={"ID":"c6cc45db-b582-4109-8b62-399fddf30c4b","Type":"ContainerDied","Data":"70366333713b0ab6e2d38e6614593401fdd8a55a0d7f2034760abb2a7c42425a"} Mar 16 17:49:36 crc kubenswrapper[5120]: I0316 17:49:36.756890 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-db-sync-g7676" Mar 16 17:49:36 crc kubenswrapper[5120]: I0316 17:49:36.888168 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-926xc\" (UniqueName: \"kubernetes.io/projected/c6cc45db-b582-4109-8b62-399fddf30c4b-kube-api-access-926xc\") pod \"c6cc45db-b582-4109-8b62-399fddf30c4b\" (UID: \"c6cc45db-b582-4109-8b62-399fddf30c4b\") " Mar 16 17:49:36 crc kubenswrapper[5120]: I0316 17:49:36.888374 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c6cc45db-b582-4109-8b62-399fddf30c4b-config-data\") pod \"c6cc45db-b582-4109-8b62-399fddf30c4b\" (UID: \"c6cc45db-b582-4109-8b62-399fddf30c4b\") " Mar 16 17:49:36 crc kubenswrapper[5120]: I0316 17:49:36.894755 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6cc45db-b582-4109-8b62-399fddf30c4b-kube-api-access-926xc" (OuterVolumeSpecName: "kube-api-access-926xc") pod "c6cc45db-b582-4109-8b62-399fddf30c4b" (UID: "c6cc45db-b582-4109-8b62-399fddf30c4b"). InnerVolumeSpecName "kube-api-access-926xc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:49:36 crc kubenswrapper[5120]: I0316 17:49:36.932322 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c6cc45db-b582-4109-8b62-399fddf30c4b-config-data" (OuterVolumeSpecName: "config-data") pod "c6cc45db-b582-4109-8b62-399fddf30c4b" (UID: "c6cc45db-b582-4109-8b62-399fddf30c4b"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:49:36 crc kubenswrapper[5120]: I0316 17:49:36.991262 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c6cc45db-b582-4109-8b62-399fddf30c4b-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:49:36 crc kubenswrapper[5120]: I0316 17:49:36.991300 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-926xc\" (UniqueName: \"kubernetes.io/projected/c6cc45db-b582-4109-8b62-399fddf30c4b-kube-api-access-926xc\") on node \"crc\" DevicePath \"\"" Mar 16 17:49:37 crc kubenswrapper[5120]: I0316 17:49:37.466032 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-db-sync-g7676" Mar 16 17:49:37 crc kubenswrapper[5120]: I0316 17:49:37.466043 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-db-sync-g7676" event={"ID":"c6cc45db-b582-4109-8b62-399fddf30c4b","Type":"ContainerDied","Data":"8e483e004fb986f91b1c4c384c60855e193f2ef4797bce765d6340fa86e58861"} Mar 16 17:49:37 crc kubenswrapper[5120]: I0316 17:49:37.466167 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8e483e004fb986f91b1c4c384c60855e193f2ef4797bce765d6340fa86e58861" Mar 16 17:49:37 crc kubenswrapper[5120]: I0316 17:49:37.650908 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keystone-kuttl-tests/keystone-bootstrap-kcnfj"] Mar 16 17:49:37 crc kubenswrapper[5120]: I0316 17:49:37.652066 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6cc45db-b582-4109-8b62-399fddf30c4b" containerName="keystone-db-sync" Mar 16 17:49:37 crc kubenswrapper[5120]: I0316 17:49:37.652090 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6cc45db-b582-4109-8b62-399fddf30c4b" containerName="keystone-db-sync" Mar 16 17:49:37 crc kubenswrapper[5120]: I0316 17:49:37.652269 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c6cc45db-b582-4109-8b62-399fddf30c4b" containerName="keystone-db-sync" Mar 16 17:49:37 crc kubenswrapper[5120]: I0316 17:49:37.659745 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-bootstrap-kcnfj" Mar 16 17:49:37 crc kubenswrapper[5120]: I0316 17:49:37.660443 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone-bootstrap-kcnfj"] Mar 16 17:49:37 crc kubenswrapper[5120]: I0316 17:49:37.663101 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keystone-kuttl-tests\"/\"keystone\"" Mar 16 17:49:37 crc kubenswrapper[5120]: I0316 17:49:37.663267 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keystone-kuttl-tests\"/\"keystone-scripts\"" Mar 16 17:49:37 crc kubenswrapper[5120]: I0316 17:49:37.663775 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keystone-kuttl-tests\"/\"keystone-config-data\"" Mar 16 17:49:37 crc kubenswrapper[5120]: I0316 17:49:37.663907 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keystone-kuttl-tests\"/\"osp-secret\"" Mar 16 17:49:37 crc kubenswrapper[5120]: I0316 17:49:37.663939 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keystone-kuttl-tests\"/\"keystone-keystone-dockercfg-ptkb9\"" Mar 16 17:49:37 crc kubenswrapper[5120]: I0316 17:49:37.811949 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b9388809-1afc-49f8-ac55-9aec596779e5-scripts\") pod \"keystone-bootstrap-kcnfj\" (UID: \"b9388809-1afc-49f8-ac55-9aec596779e5\") " pod="keystone-kuttl-tests/keystone-bootstrap-kcnfj" Mar 16 17:49:37 crc kubenswrapper[5120]: I0316 17:49:37.812187 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/b9388809-1afc-49f8-ac55-9aec596779e5-fernet-keys\") pod \"keystone-bootstrap-kcnfj\" (UID: \"b9388809-1afc-49f8-ac55-9aec596779e5\") " pod="keystone-kuttl-tests/keystone-bootstrap-kcnfj" Mar 16 17:49:37 crc kubenswrapper[5120]: I0316 17:49:37.812436 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmn8q\" (UniqueName: \"kubernetes.io/projected/b9388809-1afc-49f8-ac55-9aec596779e5-kube-api-access-xmn8q\") pod \"keystone-bootstrap-kcnfj\" (UID: \"b9388809-1afc-49f8-ac55-9aec596779e5\") " pod="keystone-kuttl-tests/keystone-bootstrap-kcnfj" Mar 16 17:49:37 crc kubenswrapper[5120]: I0316 17:49:37.812480 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/b9388809-1afc-49f8-ac55-9aec596779e5-credential-keys\") pod \"keystone-bootstrap-kcnfj\" (UID: \"b9388809-1afc-49f8-ac55-9aec596779e5\") " pod="keystone-kuttl-tests/keystone-bootstrap-kcnfj" Mar 16 17:49:37 crc kubenswrapper[5120]: I0316 17:49:37.812564 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b9388809-1afc-49f8-ac55-9aec596779e5-config-data\") pod \"keystone-bootstrap-kcnfj\" (UID: \"b9388809-1afc-49f8-ac55-9aec596779e5\") " pod="keystone-kuttl-tests/keystone-bootstrap-kcnfj" Mar 16 17:49:37 crc kubenswrapper[5120]: I0316 17:49:37.914931 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b9388809-1afc-49f8-ac55-9aec596779e5-config-data\") pod \"keystone-bootstrap-kcnfj\" (UID: \"b9388809-1afc-49f8-ac55-9aec596779e5\") " pod="keystone-kuttl-tests/keystone-bootstrap-kcnfj" Mar 16 17:49:37 crc kubenswrapper[5120]: I0316 17:49:37.915116 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b9388809-1afc-49f8-ac55-9aec596779e5-scripts\") pod \"keystone-bootstrap-kcnfj\" (UID: \"b9388809-1afc-49f8-ac55-9aec596779e5\") " pod="keystone-kuttl-tests/keystone-bootstrap-kcnfj" Mar 16 17:49:37 crc kubenswrapper[5120]: I0316 17:49:37.915186 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/b9388809-1afc-49f8-ac55-9aec596779e5-fernet-keys\") pod \"keystone-bootstrap-kcnfj\" (UID: \"b9388809-1afc-49f8-ac55-9aec596779e5\") " pod="keystone-kuttl-tests/keystone-bootstrap-kcnfj" Mar 16 17:49:37 crc kubenswrapper[5120]: I0316 17:49:37.915301 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xmn8q\" (UniqueName: \"kubernetes.io/projected/b9388809-1afc-49f8-ac55-9aec596779e5-kube-api-access-xmn8q\") pod \"keystone-bootstrap-kcnfj\" (UID: \"b9388809-1afc-49f8-ac55-9aec596779e5\") " pod="keystone-kuttl-tests/keystone-bootstrap-kcnfj" Mar 16 17:49:37 crc kubenswrapper[5120]: I0316 17:49:37.915332 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/b9388809-1afc-49f8-ac55-9aec596779e5-credential-keys\") pod \"keystone-bootstrap-kcnfj\" (UID: \"b9388809-1afc-49f8-ac55-9aec596779e5\") " pod="keystone-kuttl-tests/keystone-bootstrap-kcnfj" Mar 16 17:49:37 crc kubenswrapper[5120]: I0316 17:49:37.926428 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/b9388809-1afc-49f8-ac55-9aec596779e5-fernet-keys\") pod \"keystone-bootstrap-kcnfj\" (UID: \"b9388809-1afc-49f8-ac55-9aec596779e5\") " pod="keystone-kuttl-tests/keystone-bootstrap-kcnfj" Mar 16 17:49:37 crc kubenswrapper[5120]: I0316 17:49:37.927087 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/b9388809-1afc-49f8-ac55-9aec596779e5-credential-keys\") pod \"keystone-bootstrap-kcnfj\" (UID: \"b9388809-1afc-49f8-ac55-9aec596779e5\") " pod="keystone-kuttl-tests/keystone-bootstrap-kcnfj" Mar 16 17:49:37 crc kubenswrapper[5120]: I0316 17:49:37.927159 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b9388809-1afc-49f8-ac55-9aec596779e5-config-data\") pod \"keystone-bootstrap-kcnfj\" (UID: \"b9388809-1afc-49f8-ac55-9aec596779e5\") " pod="keystone-kuttl-tests/keystone-bootstrap-kcnfj" Mar 16 17:49:37 crc kubenswrapper[5120]: I0316 17:49:37.927505 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b9388809-1afc-49f8-ac55-9aec596779e5-scripts\") pod \"keystone-bootstrap-kcnfj\" (UID: \"b9388809-1afc-49f8-ac55-9aec596779e5\") " pod="keystone-kuttl-tests/keystone-bootstrap-kcnfj" Mar 16 17:49:37 crc kubenswrapper[5120]: I0316 17:49:37.934277 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmn8q\" (UniqueName: \"kubernetes.io/projected/b9388809-1afc-49f8-ac55-9aec596779e5-kube-api-access-xmn8q\") pod \"keystone-bootstrap-kcnfj\" (UID: \"b9388809-1afc-49f8-ac55-9aec596779e5\") " pod="keystone-kuttl-tests/keystone-bootstrap-kcnfj" Mar 16 17:49:37 crc kubenswrapper[5120]: I0316 17:49:37.989261 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-bootstrap-kcnfj" Mar 16 17:49:38 crc kubenswrapper[5120]: I0316 17:49:38.415427 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone-bootstrap-kcnfj"] Mar 16 17:49:38 crc kubenswrapper[5120]: W0316 17:49:38.420339 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb9388809_1afc_49f8_ac55_9aec596779e5.slice/crio-b68d77b9b09293241c0cb23f6b49ae6fd6ccce7be6ef7f1028000d5816d42e6c WatchSource:0}: Error finding container b68d77b9b09293241c0cb23f6b49ae6fd6ccce7be6ef7f1028000d5816d42e6c: Status 404 returned error can't find the container with id b68d77b9b09293241c0cb23f6b49ae6fd6ccce7be6ef7f1028000d5816d42e6c Mar 16 17:49:38 crc kubenswrapper[5120]: I0316 17:49:38.477539 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-bootstrap-kcnfj" event={"ID":"b9388809-1afc-49f8-ac55-9aec596779e5","Type":"ContainerStarted","Data":"b68d77b9b09293241c0cb23f6b49ae6fd6ccce7be6ef7f1028000d5816d42e6c"} Mar 16 17:49:39 crc kubenswrapper[5120]: I0316 17:49:39.492271 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-bootstrap-kcnfj" event={"ID":"b9388809-1afc-49f8-ac55-9aec596779e5","Type":"ContainerStarted","Data":"a2f064b0b31265d1a74dcd16afbdabbaad132c69e37ae1a1901f4693c513ba4b"} Mar 16 17:49:41 crc kubenswrapper[5120]: I0316 17:49:41.515827 5120 generic.go:358] "Generic (PLEG): container finished" podID="b9388809-1afc-49f8-ac55-9aec596779e5" containerID="a2f064b0b31265d1a74dcd16afbdabbaad132c69e37ae1a1901f4693c513ba4b" exitCode=0 Mar 16 17:49:41 crc kubenswrapper[5120]: I0316 17:49:41.515916 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-bootstrap-kcnfj" event={"ID":"b9388809-1afc-49f8-ac55-9aec596779e5","Type":"ContainerDied","Data":"a2f064b0b31265d1a74dcd16afbdabbaad132c69e37ae1a1901f4693c513ba4b"} Mar 16 17:49:42 crc kubenswrapper[5120]: I0316 17:49:42.969467 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-bootstrap-kcnfj" Mar 16 17:49:43 crc kubenswrapper[5120]: I0316 17:49:43.044283 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/b9388809-1afc-49f8-ac55-9aec596779e5-credential-keys\") pod \"b9388809-1afc-49f8-ac55-9aec596779e5\" (UID: \"b9388809-1afc-49f8-ac55-9aec596779e5\") " Mar 16 17:49:43 crc kubenswrapper[5120]: I0316 17:49:43.045028 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b9388809-1afc-49f8-ac55-9aec596779e5-scripts\") pod \"b9388809-1afc-49f8-ac55-9aec596779e5\" (UID: \"b9388809-1afc-49f8-ac55-9aec596779e5\") " Mar 16 17:49:43 crc kubenswrapper[5120]: I0316 17:49:43.045626 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xmn8q\" (UniqueName: \"kubernetes.io/projected/b9388809-1afc-49f8-ac55-9aec596779e5-kube-api-access-xmn8q\") pod \"b9388809-1afc-49f8-ac55-9aec596779e5\" (UID: \"b9388809-1afc-49f8-ac55-9aec596779e5\") " Mar 16 17:49:43 crc kubenswrapper[5120]: I0316 17:49:43.045931 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/b9388809-1afc-49f8-ac55-9aec596779e5-fernet-keys\") pod \"b9388809-1afc-49f8-ac55-9aec596779e5\" (UID: \"b9388809-1afc-49f8-ac55-9aec596779e5\") " Mar 16 17:49:43 crc kubenswrapper[5120]: I0316 17:49:43.046086 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b9388809-1afc-49f8-ac55-9aec596779e5-config-data\") pod \"b9388809-1afc-49f8-ac55-9aec596779e5\" (UID: \"b9388809-1afc-49f8-ac55-9aec596779e5\") " Mar 16 17:49:43 crc kubenswrapper[5120]: I0316 17:49:43.051516 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9388809-1afc-49f8-ac55-9aec596779e5-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "b9388809-1afc-49f8-ac55-9aec596779e5" (UID: "b9388809-1afc-49f8-ac55-9aec596779e5"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:49:43 crc kubenswrapper[5120]: I0316 17:49:43.051808 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9388809-1afc-49f8-ac55-9aec596779e5-scripts" (OuterVolumeSpecName: "scripts") pod "b9388809-1afc-49f8-ac55-9aec596779e5" (UID: "b9388809-1afc-49f8-ac55-9aec596779e5"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:49:43 crc kubenswrapper[5120]: I0316 17:49:43.052748 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9388809-1afc-49f8-ac55-9aec596779e5-kube-api-access-xmn8q" (OuterVolumeSpecName: "kube-api-access-xmn8q") pod "b9388809-1afc-49f8-ac55-9aec596779e5" (UID: "b9388809-1afc-49f8-ac55-9aec596779e5"). InnerVolumeSpecName "kube-api-access-xmn8q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:49:43 crc kubenswrapper[5120]: I0316 17:49:43.052872 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9388809-1afc-49f8-ac55-9aec596779e5-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "b9388809-1afc-49f8-ac55-9aec596779e5" (UID: "b9388809-1afc-49f8-ac55-9aec596779e5"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:49:43 crc kubenswrapper[5120]: I0316 17:49:43.069578 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9388809-1afc-49f8-ac55-9aec596779e5-config-data" (OuterVolumeSpecName: "config-data") pod "b9388809-1afc-49f8-ac55-9aec596779e5" (UID: "b9388809-1afc-49f8-ac55-9aec596779e5"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 17:49:43 crc kubenswrapper[5120]: I0316 17:49:43.149161 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xmn8q\" (UniqueName: \"kubernetes.io/projected/b9388809-1afc-49f8-ac55-9aec596779e5-kube-api-access-xmn8q\") on node \"crc\" DevicePath \"\"" Mar 16 17:49:43 crc kubenswrapper[5120]: I0316 17:49:43.149206 5120 reconciler_common.go:299] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/b9388809-1afc-49f8-ac55-9aec596779e5-fernet-keys\") on node \"crc\" DevicePath \"\"" Mar 16 17:49:43 crc kubenswrapper[5120]: I0316 17:49:43.149220 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b9388809-1afc-49f8-ac55-9aec596779e5-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 17:49:43 crc kubenswrapper[5120]: I0316 17:49:43.149262 5120 reconciler_common.go:299] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/b9388809-1afc-49f8-ac55-9aec596779e5-credential-keys\") on node \"crc\" DevicePath \"\"" Mar 16 17:49:43 crc kubenswrapper[5120]: I0316 17:49:43.149274 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b9388809-1afc-49f8-ac55-9aec596779e5-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 17:49:43 crc kubenswrapper[5120]: I0316 17:49:43.544777 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-bootstrap-kcnfj" Mar 16 17:49:43 crc kubenswrapper[5120]: I0316 17:49:43.544789 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-bootstrap-kcnfj" event={"ID":"b9388809-1afc-49f8-ac55-9aec596779e5","Type":"ContainerDied","Data":"b68d77b9b09293241c0cb23f6b49ae6fd6ccce7be6ef7f1028000d5816d42e6c"} Mar 16 17:49:43 crc kubenswrapper[5120]: I0316 17:49:43.544924 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b68d77b9b09293241c0cb23f6b49ae6fd6ccce7be6ef7f1028000d5816d42e6c" Mar 16 17:49:43 crc kubenswrapper[5120]: I0316 17:49:43.719989 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keystone-kuttl-tests/keystone-5f497d965-w7bj5"] Mar 16 17:49:43 crc kubenswrapper[5120]: I0316 17:49:43.721398 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9388809-1afc-49f8-ac55-9aec596779e5" containerName="keystone-bootstrap" Mar 16 17:49:43 crc kubenswrapper[5120]: I0316 17:49:43.721430 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9388809-1afc-49f8-ac55-9aec596779e5" containerName="keystone-bootstrap" Mar 16 17:49:43 crc kubenswrapper[5120]: I0316 17:49:43.721809 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="b9388809-1afc-49f8-ac55-9aec596779e5" containerName="keystone-bootstrap" Mar 16 17:49:43 crc kubenswrapper[5120]: I0316 17:49:43.729369 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone-5f497d965-w7bj5"] Mar 16 17:49:43 crc kubenswrapper[5120]: I0316 17:49:43.729593 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-5f497d965-w7bj5" Mar 16 17:49:43 crc kubenswrapper[5120]: I0316 17:49:43.732359 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keystone-kuttl-tests\"/\"keystone\"" Mar 16 17:49:43 crc kubenswrapper[5120]: I0316 17:49:43.732661 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keystone-kuttl-tests\"/\"keystone-config-data\"" Mar 16 17:49:43 crc kubenswrapper[5120]: I0316 17:49:43.732872 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keystone-kuttl-tests\"/\"keystone-keystone-dockercfg-ptkb9\"" Mar 16 17:49:43 crc kubenswrapper[5120]: I0316 17:49:43.734900 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keystone-kuttl-tests\"/\"keystone-scripts\"" Mar 16 17:49:43 crc kubenswrapper[5120]: I0316 17:49:43.865400 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7tjp\" (UniqueName: \"kubernetes.io/projected/4a7dc946-5465-4cb5-b513-dac369fd4656-kube-api-access-n7tjp\") pod \"keystone-5f497d965-w7bj5\" (UID: \"4a7dc946-5465-4cb5-b513-dac369fd4656\") " pod="keystone-kuttl-tests/keystone-5f497d965-w7bj5" Mar 16 17:49:43 crc kubenswrapper[5120]: I0316 17:49:43.865710 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/4a7dc946-5465-4cb5-b513-dac369fd4656-fernet-keys\") pod \"keystone-5f497d965-w7bj5\" (UID: \"4a7dc946-5465-4cb5-b513-dac369fd4656\") " pod="keystone-kuttl-tests/keystone-5f497d965-w7bj5" Mar 16 17:49:43 crc kubenswrapper[5120]: I0316 17:49:43.866155 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4a7dc946-5465-4cb5-b513-dac369fd4656-scripts\") pod \"keystone-5f497d965-w7bj5\" (UID: \"4a7dc946-5465-4cb5-b513-dac369fd4656\") " pod="keystone-kuttl-tests/keystone-5f497d965-w7bj5" Mar 16 17:49:43 crc kubenswrapper[5120]: I0316 17:49:43.866229 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/4a7dc946-5465-4cb5-b513-dac369fd4656-credential-keys\") pod \"keystone-5f497d965-w7bj5\" (UID: \"4a7dc946-5465-4cb5-b513-dac369fd4656\") " pod="keystone-kuttl-tests/keystone-5f497d965-w7bj5" Mar 16 17:49:43 crc kubenswrapper[5120]: I0316 17:49:43.866485 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4a7dc946-5465-4cb5-b513-dac369fd4656-config-data\") pod \"keystone-5f497d965-w7bj5\" (UID: \"4a7dc946-5465-4cb5-b513-dac369fd4656\") " pod="keystone-kuttl-tests/keystone-5f497d965-w7bj5" Mar 16 17:49:43 crc kubenswrapper[5120]: I0316 17:49:43.969221 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n7tjp\" (UniqueName: \"kubernetes.io/projected/4a7dc946-5465-4cb5-b513-dac369fd4656-kube-api-access-n7tjp\") pod \"keystone-5f497d965-w7bj5\" (UID: \"4a7dc946-5465-4cb5-b513-dac369fd4656\") " pod="keystone-kuttl-tests/keystone-5f497d965-w7bj5" Mar 16 17:49:43 crc kubenswrapper[5120]: I0316 17:49:43.969385 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/4a7dc946-5465-4cb5-b513-dac369fd4656-fernet-keys\") pod \"keystone-5f497d965-w7bj5\" (UID: \"4a7dc946-5465-4cb5-b513-dac369fd4656\") " pod="keystone-kuttl-tests/keystone-5f497d965-w7bj5" Mar 16 17:49:43 crc kubenswrapper[5120]: I0316 17:49:43.969644 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4a7dc946-5465-4cb5-b513-dac369fd4656-scripts\") pod \"keystone-5f497d965-w7bj5\" (UID: \"4a7dc946-5465-4cb5-b513-dac369fd4656\") " pod="keystone-kuttl-tests/keystone-5f497d965-w7bj5" Mar 16 17:49:43 crc kubenswrapper[5120]: I0316 17:49:43.969720 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/4a7dc946-5465-4cb5-b513-dac369fd4656-credential-keys\") pod \"keystone-5f497d965-w7bj5\" (UID: \"4a7dc946-5465-4cb5-b513-dac369fd4656\") " pod="keystone-kuttl-tests/keystone-5f497d965-w7bj5" Mar 16 17:49:43 crc kubenswrapper[5120]: I0316 17:49:43.969812 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4a7dc946-5465-4cb5-b513-dac369fd4656-config-data\") pod \"keystone-5f497d965-w7bj5\" (UID: \"4a7dc946-5465-4cb5-b513-dac369fd4656\") " pod="keystone-kuttl-tests/keystone-5f497d965-w7bj5" Mar 16 17:49:43 crc kubenswrapper[5120]: I0316 17:49:43.974038 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4a7dc946-5465-4cb5-b513-dac369fd4656-scripts\") pod \"keystone-5f497d965-w7bj5\" (UID: \"4a7dc946-5465-4cb5-b513-dac369fd4656\") " pod="keystone-kuttl-tests/keystone-5f497d965-w7bj5" Mar 16 17:49:43 crc kubenswrapper[5120]: I0316 17:49:43.974416 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4a7dc946-5465-4cb5-b513-dac369fd4656-config-data\") pod \"keystone-5f497d965-w7bj5\" (UID: \"4a7dc946-5465-4cb5-b513-dac369fd4656\") " pod="keystone-kuttl-tests/keystone-5f497d965-w7bj5" Mar 16 17:49:43 crc kubenswrapper[5120]: I0316 17:49:43.974513 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/4a7dc946-5465-4cb5-b513-dac369fd4656-credential-keys\") pod \"keystone-5f497d965-w7bj5\" (UID: \"4a7dc946-5465-4cb5-b513-dac369fd4656\") " pod="keystone-kuttl-tests/keystone-5f497d965-w7bj5" Mar 16 17:49:43 crc kubenswrapper[5120]: I0316 17:49:43.982265 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/4a7dc946-5465-4cb5-b513-dac369fd4656-fernet-keys\") pod \"keystone-5f497d965-w7bj5\" (UID: \"4a7dc946-5465-4cb5-b513-dac369fd4656\") " pod="keystone-kuttl-tests/keystone-5f497d965-w7bj5" Mar 16 17:49:43 crc kubenswrapper[5120]: I0316 17:49:43.986468 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7tjp\" (UniqueName: \"kubernetes.io/projected/4a7dc946-5465-4cb5-b513-dac369fd4656-kube-api-access-n7tjp\") pod \"keystone-5f497d965-w7bj5\" (UID: \"4a7dc946-5465-4cb5-b513-dac369fd4656\") " pod="keystone-kuttl-tests/keystone-5f497d965-w7bj5" Mar 16 17:49:44 crc kubenswrapper[5120]: I0316 17:49:44.052267 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-5f497d965-w7bj5" Mar 16 17:49:44 crc kubenswrapper[5120]: I0316 17:49:44.494989 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone-5f497d965-w7bj5"] Mar 16 17:49:44 crc kubenswrapper[5120]: I0316 17:49:44.561307 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-5f497d965-w7bj5" event={"ID":"4a7dc946-5465-4cb5-b513-dac369fd4656","Type":"ContainerStarted","Data":"65f8dd8b64b61d2b0cc4065377fbfd96f23b11a77b892f9516ca9377c36712de"} Mar 16 17:49:45 crc kubenswrapper[5120]: I0316 17:49:45.569751 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-5f497d965-w7bj5" event={"ID":"4a7dc946-5465-4cb5-b513-dac369fd4656","Type":"ContainerStarted","Data":"ed85ffc3161793f9246510bc2685445a6a590747aa837a8da849dfbd309911c6"} Mar 16 17:49:45 crc kubenswrapper[5120]: I0316 17:49:45.570140 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keystone-kuttl-tests/keystone-5f497d965-w7bj5" Mar 16 17:49:45 crc kubenswrapper[5120]: I0316 17:49:45.585797 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keystone-kuttl-tests/keystone-5f497d965-w7bj5" podStartSLOduration=2.58576996 podStartE2EDuration="2.58576996s" podCreationTimestamp="2026-03-16 17:49:43 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 17:49:45.582398887 +0000 UTC m=+8287.736330584" watchObservedRunningTime="2026-03-16 17:49:45.58576996 +0000 UTC m=+8287.739701647" Mar 16 17:50:00 crc kubenswrapper[5120]: I0316 17:50:00.138518 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-infra/auto-csr-approver-29561390-zql55"] Mar 16 17:50:00 crc kubenswrapper[5120]: I0316 17:50:00.160502 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561390-zql55"] Mar 16 17:50:00 crc kubenswrapper[5120]: I0316 17:50:00.160691 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561390-zql55" Mar 16 17:50:00 crc kubenswrapper[5120]: I0316 17:50:00.163854 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-infra\"/\"csr-approver-sa-dockercfg-x2nsz\"" Mar 16 17:50:00 crc kubenswrapper[5120]: I0316 17:50:00.163959 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"openshift-service-ca.crt\"" Mar 16 17:50:00 crc kubenswrapper[5120]: I0316 17:50:00.164362 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"kube-root-ca.crt\"" Mar 16 17:50:00 crc kubenswrapper[5120]: I0316 17:50:00.278116 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swpx7\" (UniqueName: \"kubernetes.io/projected/5ea959e8-d3b9-4d8c-915a-c771aea6a07d-kube-api-access-swpx7\") pod \"auto-csr-approver-29561390-zql55\" (UID: \"5ea959e8-d3b9-4d8c-915a-c771aea6a07d\") " pod="openshift-infra/auto-csr-approver-29561390-zql55" Mar 16 17:50:00 crc kubenswrapper[5120]: I0316 17:50:00.380393 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-swpx7\" (UniqueName: \"kubernetes.io/projected/5ea959e8-d3b9-4d8c-915a-c771aea6a07d-kube-api-access-swpx7\") pod \"auto-csr-approver-29561390-zql55\" (UID: \"5ea959e8-d3b9-4d8c-915a-c771aea6a07d\") " pod="openshift-infra/auto-csr-approver-29561390-zql55" Mar 16 17:50:00 crc kubenswrapper[5120]: I0316 17:50:00.399251 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-swpx7\" (UniqueName: \"kubernetes.io/projected/5ea959e8-d3b9-4d8c-915a-c771aea6a07d-kube-api-access-swpx7\") pod \"auto-csr-approver-29561390-zql55\" (UID: \"5ea959e8-d3b9-4d8c-915a-c771aea6a07d\") " pod="openshift-infra/auto-csr-approver-29561390-zql55" Mar 16 17:50:00 crc kubenswrapper[5120]: I0316 17:50:00.486103 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561390-zql55" Mar 16 17:50:00 crc kubenswrapper[5120]: I0316 17:50:00.904181 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561390-zql55"] Mar 16 17:50:00 crc kubenswrapper[5120]: W0316 17:50:00.910374 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5ea959e8_d3b9_4d8c_915a_c771aea6a07d.slice/crio-58a377a4fe510667d53f711300954d35d2fc55c8a0a1fcdc792691b8437f19ec WatchSource:0}: Error finding container 58a377a4fe510667d53f711300954d35d2fc55c8a0a1fcdc792691b8437f19ec: Status 404 returned error can't find the container with id 58a377a4fe510667d53f711300954d35d2fc55c8a0a1fcdc792691b8437f19ec Mar 16 17:50:01 crc kubenswrapper[5120]: I0316 17:50:01.706369 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561390-zql55" event={"ID":"5ea959e8-d3b9-4d8c-915a-c771aea6a07d","Type":"ContainerStarted","Data":"58a377a4fe510667d53f711300954d35d2fc55c8a0a1fcdc792691b8437f19ec"} Mar 16 17:50:03 crc kubenswrapper[5120]: I0316 17:50:03.731088 5120 generic.go:358] "Generic (PLEG): container finished" podID="5ea959e8-d3b9-4d8c-915a-c771aea6a07d" containerID="ebe8d75c9ef433634056a5e2b879abfd9f8442e589e6bb5029eef67e9515be6e" exitCode=0 Mar 16 17:50:03 crc kubenswrapper[5120]: I0316 17:50:03.731165 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561390-zql55" event={"ID":"5ea959e8-d3b9-4d8c-915a-c771aea6a07d","Type":"ContainerDied","Data":"ebe8d75c9ef433634056a5e2b879abfd9f8442e589e6bb5029eef67e9515be6e"} Mar 16 17:50:05 crc kubenswrapper[5120]: I0316 17:50:05.068827 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561390-zql55" Mar 16 17:50:05 crc kubenswrapper[5120]: I0316 17:50:05.208742 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-swpx7\" (UniqueName: \"kubernetes.io/projected/5ea959e8-d3b9-4d8c-915a-c771aea6a07d-kube-api-access-swpx7\") pod \"5ea959e8-d3b9-4d8c-915a-c771aea6a07d\" (UID: \"5ea959e8-d3b9-4d8c-915a-c771aea6a07d\") " Mar 16 17:50:05 crc kubenswrapper[5120]: I0316 17:50:05.214600 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ea959e8-d3b9-4d8c-915a-c771aea6a07d-kube-api-access-swpx7" (OuterVolumeSpecName: "kube-api-access-swpx7") pod "5ea959e8-d3b9-4d8c-915a-c771aea6a07d" (UID: "5ea959e8-d3b9-4d8c-915a-c771aea6a07d"). InnerVolumeSpecName "kube-api-access-swpx7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:50:05 crc kubenswrapper[5120]: I0316 17:50:05.313413 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-swpx7\" (UniqueName: \"kubernetes.io/projected/5ea959e8-d3b9-4d8c-915a-c771aea6a07d-kube-api-access-swpx7\") on node \"crc\" DevicePath \"\"" Mar 16 17:50:05 crc kubenswrapper[5120]: I0316 17:50:05.750787 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561390-zql55" event={"ID":"5ea959e8-d3b9-4d8c-915a-c771aea6a07d","Type":"ContainerDied","Data":"58a377a4fe510667d53f711300954d35d2fc55c8a0a1fcdc792691b8437f19ec"} Mar 16 17:50:05 crc kubenswrapper[5120]: I0316 17:50:05.751108 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="58a377a4fe510667d53f711300954d35d2fc55c8a0a1fcdc792691b8437f19ec" Mar 16 17:50:05 crc kubenswrapper[5120]: I0316 17:50:05.750906 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561390-zql55" Mar 16 17:50:07 crc kubenswrapper[5120]: I0316 17:50:07.310275 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-infra/auto-csr-approver-29561384-lwfkn"] Mar 16 17:50:07 crc kubenswrapper[5120]: I0316 17:50:07.316611 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-infra/auto-csr-approver-29561384-lwfkn"] Mar 16 17:50:08 crc kubenswrapper[5120]: E0316 17:50:08.355700 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1109837 actualBytes=10240 Mar 16 17:50:08 crc kubenswrapper[5120]: I0316 17:50:08.672409 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="340eebbe-5b02-446c-b75b-4defea482635" path="/var/lib/kubelet/pods/340eebbe-5b02-446c-b75b-4defea482635/volumes" Mar 16 17:50:17 crc kubenswrapper[5120]: I0316 17:50:17.932778 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="keystone-kuttl-tests/keystone-5f497d965-w7bj5" Mar 16 17:50:18 crc kubenswrapper[5120]: I0316 17:50:18.369415 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keystone-kuttl-tests/openstackclient"] Mar 16 17:50:18 crc kubenswrapper[5120]: I0316 17:50:18.370683 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ea959e8-d3b9-4d8c-915a-c771aea6a07d" containerName="oc" Mar 16 17:50:18 crc kubenswrapper[5120]: I0316 17:50:18.370859 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ea959e8-d3b9-4d8c-915a-c771aea6a07d" containerName="oc" Mar 16 17:50:18 crc kubenswrapper[5120]: I0316 17:50:18.371074 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="5ea959e8-d3b9-4d8c-915a-c771aea6a07d" containerName="oc" Mar 16 17:50:18 crc kubenswrapper[5120]: I0316 17:50:18.384123 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/openstackclient"] Mar 16 17:50:18 crc kubenswrapper[5120]: I0316 17:50:18.384287 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/openstackclient" Mar 16 17:50:18 crc kubenswrapper[5120]: I0316 17:50:18.386625 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keystone-kuttl-tests\"/\"openstack-config-secret\"" Mar 16 17:50:18 crc kubenswrapper[5120]: I0316 17:50:18.386916 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keystone-kuttl-tests\"/\"openstack-config\"" Mar 16 17:50:18 crc kubenswrapper[5120]: I0316 17:50:18.386639 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keystone-kuttl-tests\"/\"default-dockercfg-x9h4m\"" Mar 16 17:50:18 crc kubenswrapper[5120]: I0316 17:50:18.529246 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6v794\" (UniqueName: \"kubernetes.io/projected/7ac6c65a-664a-4880-a424-d79e050e805b-kube-api-access-6v794\") pod \"openstackclient\" (UID: \"7ac6c65a-664a-4880-a424-d79e050e805b\") " pod="keystone-kuttl-tests/openstackclient" Mar 16 17:50:18 crc kubenswrapper[5120]: I0316 17:50:18.529288 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/7ac6c65a-664a-4880-a424-d79e050e805b-openstack-config\") pod \"openstackclient\" (UID: \"7ac6c65a-664a-4880-a424-d79e050e805b\") " pod="keystone-kuttl-tests/openstackclient" Mar 16 17:50:18 crc kubenswrapper[5120]: I0316 17:50:18.529433 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/7ac6c65a-664a-4880-a424-d79e050e805b-openstack-config-secret\") pod \"openstackclient\" (UID: \"7ac6c65a-664a-4880-a424-d79e050e805b\") " pod="keystone-kuttl-tests/openstackclient" Mar 16 17:50:18 crc kubenswrapper[5120]: I0316 17:50:18.631447 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/7ac6c65a-664a-4880-a424-d79e050e805b-openstack-config-secret\") pod \"openstackclient\" (UID: \"7ac6c65a-664a-4880-a424-d79e050e805b\") " pod="keystone-kuttl-tests/openstackclient" Mar 16 17:50:18 crc kubenswrapper[5120]: I0316 17:50:18.631962 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6v794\" (UniqueName: \"kubernetes.io/projected/7ac6c65a-664a-4880-a424-d79e050e805b-kube-api-access-6v794\") pod \"openstackclient\" (UID: \"7ac6c65a-664a-4880-a424-d79e050e805b\") " pod="keystone-kuttl-tests/openstackclient" Mar 16 17:50:18 crc kubenswrapper[5120]: I0316 17:50:18.632006 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/7ac6c65a-664a-4880-a424-d79e050e805b-openstack-config\") pod \"openstackclient\" (UID: \"7ac6c65a-664a-4880-a424-d79e050e805b\") " pod="keystone-kuttl-tests/openstackclient" Mar 16 17:50:18 crc kubenswrapper[5120]: I0316 17:50:18.632970 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/7ac6c65a-664a-4880-a424-d79e050e805b-openstack-config\") pod \"openstackclient\" (UID: \"7ac6c65a-664a-4880-a424-d79e050e805b\") " pod="keystone-kuttl-tests/openstackclient" Mar 16 17:50:18 crc kubenswrapper[5120]: I0316 17:50:18.643745 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/7ac6c65a-664a-4880-a424-d79e050e805b-openstack-config-secret\") pod \"openstackclient\" (UID: \"7ac6c65a-664a-4880-a424-d79e050e805b\") " pod="keystone-kuttl-tests/openstackclient" Mar 16 17:50:18 crc kubenswrapper[5120]: I0316 17:50:18.653936 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6v794\" (UniqueName: \"kubernetes.io/projected/7ac6c65a-664a-4880-a424-d79e050e805b-kube-api-access-6v794\") pod \"openstackclient\" (UID: \"7ac6c65a-664a-4880-a424-d79e050e805b\") " pod="keystone-kuttl-tests/openstackclient" Mar 16 17:50:18 crc kubenswrapper[5120]: I0316 17:50:18.730391 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/openstackclient" Mar 16 17:50:19 crc kubenswrapper[5120]: I0316 17:50:19.165496 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/openstackclient"] Mar 16 17:50:19 crc kubenswrapper[5120]: I0316 17:50:19.416424 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/openstackclient" event={"ID":"7ac6c65a-664a-4880-a424-d79e050e805b","Type":"ContainerStarted","Data":"f766c42af2d060185340e0210d41946829a6a6b6730f4af7e2d87c63579f1b5f"} Mar 16 17:50:20 crc kubenswrapper[5120]: I0316 17:50:20.427833 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/openstackclient" event={"ID":"7ac6c65a-664a-4880-a424-d79e050e805b","Type":"ContainerStarted","Data":"8567d11c10a82d6eb22de1da752d7bf610fb4bdb2795b0fe847e4e4729f35206"} Mar 16 17:50:20 crc kubenswrapper[5120]: I0316 17:50:20.452803 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keystone-kuttl-tests/openstackclient" podStartSLOduration=1.9781722670000002 podStartE2EDuration="2.452784964s" podCreationTimestamp="2026-03-16 17:50:18 +0000 UTC" firstStartedPulling="2026-03-16 17:50:19.171192372 +0000 UTC m=+8321.325124049" lastFinishedPulling="2026-03-16 17:50:19.645805089 +0000 UTC m=+8321.799736746" observedRunningTime="2026-03-16 17:50:20.445857135 +0000 UTC m=+8322.599788792" watchObservedRunningTime="2026-03-16 17:50:20.452784964 +0000 UTC m=+8322.606716621" Mar 16 17:50:35 crc kubenswrapper[5120]: I0316 17:50:35.636587 5120 scope.go:117] "RemoveContainer" containerID="5d48c3cc83f761c8e25a86e7baa7b3e32e3e87e0cd0b8cbc3ef84655bb768bba" Mar 16 17:50:35 crc kubenswrapper[5120]: I0316 17:50:35.710629 5120 scope.go:117] "RemoveContainer" containerID="cff6ecc750eb2b71ccdb2bb2c6dedc48e5b68bc745dcc610d239228647406852" Mar 16 17:50:35 crc kubenswrapper[5120]: I0316 17:50:35.747716 5120 scope.go:117] "RemoveContainer" containerID="ee00ce99a9c40b2aca7d3a4f65b2ea7e281e49084f65501006952a8f8a4ad2b0" Mar 16 17:50:35 crc kubenswrapper[5120]: I0316 17:50:35.780522 5120 scope.go:117] "RemoveContainer" containerID="bfb85efcdc589fcd4a3ebeb170d058c374c3ab404fc0e20e3b6b69e13006f8af" Mar 16 17:50:35 crc kubenswrapper[5120]: I0316 17:50:35.805299 5120 scope.go:117] "RemoveContainer" containerID="106ec4721c8a6a72d48ede5d01e98ddbaed719e9feb64b785448125802d47672" Mar 16 17:50:52 crc kubenswrapper[5120]: I0316 17:50:52.007762 5120 patch_prober.go:28] interesting pod/machine-config-daemon-7bf76 container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 17:50:52 crc kubenswrapper[5120]: I0316 17:50:52.008287 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 17:51:07 crc kubenswrapper[5120]: E0316 17:51:07.873232 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1117766 actualBytes=10240 Mar 16 17:51:22 crc kubenswrapper[5120]: I0316 17:51:22.007867 5120 patch_prober.go:28] interesting pod/machine-config-daemon-7bf76 container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 17:51:22 crc kubenswrapper[5120]: I0316 17:51:22.008530 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 17:51:35 crc kubenswrapper[5120]: I0316 17:51:35.897379 5120 scope.go:117] "RemoveContainer" containerID="949b376e84ad089183427ac67fc34995d4561b9347a25e5c53f31ed82dd46a31" Mar 16 17:51:48 crc kubenswrapper[5120]: I0316 17:51:48.009044 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-v822j_ac55471d-4e42-475f-a082-50f611571482/kube-multus/0.log" Mar 16 17:51:48 crc kubenswrapper[5120]: I0316 17:51:48.014005 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-crc_9f0bc7fcb0822a2c13eb2d22cd8c0641/kube-controller-manager/0.log" Mar 16 17:51:48 crc kubenswrapper[5120]: I0316 17:51:48.347560 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-v822j_ac55471d-4e42-475f-a082-50f611571482/kube-multus/0.log" Mar 16 17:51:48 crc kubenswrapper[5120]: I0316 17:51:48.353229 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-crc_9f0bc7fcb0822a2c13eb2d22cd8c0641/kube-controller-manager/0.log" Mar 16 17:51:52 crc kubenswrapper[5120]: I0316 17:51:52.007798 5120 patch_prober.go:28] interesting pod/machine-config-daemon-7bf76 container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 17:51:52 crc kubenswrapper[5120]: I0316 17:51:52.008193 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 17:51:52 crc kubenswrapper[5120]: I0316 17:51:52.008247 5120 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" Mar 16 17:51:52 crc kubenswrapper[5120]: I0316 17:51:52.008921 5120 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="machine-config-daemon" containerStatusID={"Type":"cri-o","ID":"3c36926311be0b5863354f251394b54af60074edc1c497847c55048c053dc819"} pod="openshift-machine-config-operator/machine-config-daemon-7bf76" containerMessage="Container machine-config-daemon failed liveness probe, will be restarted" Mar 16 17:51:52 crc kubenswrapper[5120]: I0316 17:51:52.008992 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" containerID="cri-o://3c36926311be0b5863354f251394b54af60074edc1c497847c55048c053dc819" gracePeriod=600 Mar 16 17:51:52 crc kubenswrapper[5120]: E0316 17:51:52.146094 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 17:51:52 crc kubenswrapper[5120]: I0316 17:51:52.303976 5120 generic.go:358] "Generic (PLEG): container finished" podID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerID="3c36926311be0b5863354f251394b54af60074edc1c497847c55048c053dc819" exitCode=0 Mar 16 17:51:52 crc kubenswrapper[5120]: I0316 17:51:52.304139 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" event={"ID":"e2275cb4-4905-4d66-a87e-8010120db2bd","Type":"ContainerDied","Data":"3c36926311be0b5863354f251394b54af60074edc1c497847c55048c053dc819"} Mar 16 17:51:52 crc kubenswrapper[5120]: I0316 17:51:52.304255 5120 scope.go:117] "RemoveContainer" containerID="09cc7c20368ae6767b406319b2f6a0de85add28a4c1a3f75b70ae511bf5e3d62" Mar 16 17:51:52 crc kubenswrapper[5120]: I0316 17:51:52.304783 5120 scope.go:117] "RemoveContainer" containerID="3c36926311be0b5863354f251394b54af60074edc1c497847c55048c053dc819" Mar 16 17:51:52 crc kubenswrapper[5120]: E0316 17:51:52.305117 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 17:52:00 crc kubenswrapper[5120]: I0316 17:52:00.150266 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-infra/auto-csr-approver-29561392-sbnvb"] Mar 16 17:52:00 crc kubenswrapper[5120]: I0316 17:52:00.159977 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561392-sbnvb"] Mar 16 17:52:00 crc kubenswrapper[5120]: I0316 17:52:00.160309 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561392-sbnvb" Mar 16 17:52:00 crc kubenswrapper[5120]: I0316 17:52:00.163027 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"openshift-service-ca.crt\"" Mar 16 17:52:00 crc kubenswrapper[5120]: I0316 17:52:00.163175 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"kube-root-ca.crt\"" Mar 16 17:52:00 crc kubenswrapper[5120]: I0316 17:52:00.163224 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-infra\"/\"csr-approver-sa-dockercfg-x2nsz\"" Mar 16 17:52:00 crc kubenswrapper[5120]: I0316 17:52:00.271149 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hd7p2\" (UniqueName: \"kubernetes.io/projected/96328348-2ca5-4770-bf80-346117cff71e-kube-api-access-hd7p2\") pod \"auto-csr-approver-29561392-sbnvb\" (UID: \"96328348-2ca5-4770-bf80-346117cff71e\") " pod="openshift-infra/auto-csr-approver-29561392-sbnvb" Mar 16 17:52:00 crc kubenswrapper[5120]: I0316 17:52:00.373087 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hd7p2\" (UniqueName: \"kubernetes.io/projected/96328348-2ca5-4770-bf80-346117cff71e-kube-api-access-hd7p2\") pod \"auto-csr-approver-29561392-sbnvb\" (UID: \"96328348-2ca5-4770-bf80-346117cff71e\") " pod="openshift-infra/auto-csr-approver-29561392-sbnvb" Mar 16 17:52:00 crc kubenswrapper[5120]: I0316 17:52:00.392209 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hd7p2\" (UniqueName: \"kubernetes.io/projected/96328348-2ca5-4770-bf80-346117cff71e-kube-api-access-hd7p2\") pod \"auto-csr-approver-29561392-sbnvb\" (UID: \"96328348-2ca5-4770-bf80-346117cff71e\") " pod="openshift-infra/auto-csr-approver-29561392-sbnvb" Mar 16 17:52:00 crc kubenswrapper[5120]: I0316 17:52:00.484453 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561392-sbnvb" Mar 16 17:52:00 crc kubenswrapper[5120]: I0316 17:52:00.903464 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561392-sbnvb"] Mar 16 17:52:01 crc kubenswrapper[5120]: I0316 17:52:01.384470 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561392-sbnvb" event={"ID":"96328348-2ca5-4770-bf80-346117cff71e","Type":"ContainerStarted","Data":"29f350f1e32955efe87f3960c1cb0e6d8d08f6ba5d59292239c1694c16ea287f"} Mar 16 17:52:02 crc kubenswrapper[5120]: I0316 17:52:02.397407 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561392-sbnvb" event={"ID":"96328348-2ca5-4770-bf80-346117cff71e","Type":"ContainerStarted","Data":"058879abeed861c1446b114101c18de7114a0adb68e8ed7696f0c8756202f3c1"} Mar 16 17:52:02 crc kubenswrapper[5120]: I0316 17:52:02.413654 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-infra/auto-csr-approver-29561392-sbnvb" podStartSLOduration=1.274888839 podStartE2EDuration="2.413629345s" podCreationTimestamp="2026-03-16 17:52:00 +0000 UTC" firstStartedPulling="2026-03-16 17:52:00.909959801 +0000 UTC m=+8423.063891458" lastFinishedPulling="2026-03-16 17:52:02.048700307 +0000 UTC m=+8424.202631964" observedRunningTime="2026-03-16 17:52:02.407425035 +0000 UTC m=+8424.561356692" watchObservedRunningTime="2026-03-16 17:52:02.413629345 +0000 UTC m=+8424.567561002" Mar 16 17:52:03 crc kubenswrapper[5120]: I0316 17:52:03.406887 5120 generic.go:358] "Generic (PLEG): container finished" podID="96328348-2ca5-4770-bf80-346117cff71e" containerID="058879abeed861c1446b114101c18de7114a0adb68e8ed7696f0c8756202f3c1" exitCode=0 Mar 16 17:52:03 crc kubenswrapper[5120]: I0316 17:52:03.406983 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561392-sbnvb" event={"ID":"96328348-2ca5-4770-bf80-346117cff71e","Type":"ContainerDied","Data":"058879abeed861c1446b114101c18de7114a0adb68e8ed7696f0c8756202f3c1"} Mar 16 17:52:04 crc kubenswrapper[5120]: I0316 17:52:04.663705 5120 scope.go:117] "RemoveContainer" containerID="3c36926311be0b5863354f251394b54af60074edc1c497847c55048c053dc819" Mar 16 17:52:04 crc kubenswrapper[5120]: E0316 17:52:04.665017 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 17:52:04 crc kubenswrapper[5120]: I0316 17:52:04.683527 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561392-sbnvb" Mar 16 17:52:04 crc kubenswrapper[5120]: I0316 17:52:04.779491 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hd7p2\" (UniqueName: \"kubernetes.io/projected/96328348-2ca5-4770-bf80-346117cff71e-kube-api-access-hd7p2\") pod \"96328348-2ca5-4770-bf80-346117cff71e\" (UID: \"96328348-2ca5-4770-bf80-346117cff71e\") " Mar 16 17:52:04 crc kubenswrapper[5120]: I0316 17:52:04.785369 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96328348-2ca5-4770-bf80-346117cff71e-kube-api-access-hd7p2" (OuterVolumeSpecName: "kube-api-access-hd7p2") pod "96328348-2ca5-4770-bf80-346117cff71e" (UID: "96328348-2ca5-4770-bf80-346117cff71e"). InnerVolumeSpecName "kube-api-access-hd7p2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:52:04 crc kubenswrapper[5120]: I0316 17:52:04.882620 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hd7p2\" (UniqueName: \"kubernetes.io/projected/96328348-2ca5-4770-bf80-346117cff71e-kube-api-access-hd7p2\") on node \"crc\" DevicePath \"\"" Mar 16 17:52:05 crc kubenswrapper[5120]: I0316 17:52:05.432099 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561392-sbnvb" event={"ID":"96328348-2ca5-4770-bf80-346117cff71e","Type":"ContainerDied","Data":"29f350f1e32955efe87f3960c1cb0e6d8d08f6ba5d59292239c1694c16ea287f"} Mar 16 17:52:05 crc kubenswrapper[5120]: I0316 17:52:05.432164 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="29f350f1e32955efe87f3960c1cb0e6d8d08f6ba5d59292239c1694c16ea287f" Mar 16 17:52:05 crc kubenswrapper[5120]: I0316 17:52:05.432257 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561392-sbnvb" Mar 16 17:52:05 crc kubenswrapper[5120]: I0316 17:52:05.472545 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-infra/auto-csr-approver-29561386-lgzbr"] Mar 16 17:52:05 crc kubenswrapper[5120]: I0316 17:52:05.478360 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-infra/auto-csr-approver-29561386-lgzbr"] Mar 16 17:52:06 crc kubenswrapper[5120]: I0316 17:52:06.672142 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3a016656-d56d-4bf2-980e-aee5bbd2018b" path="/var/lib/kubelet/pods/3a016656-d56d-4bf2-980e-aee5bbd2018b/volumes" Mar 16 17:52:07 crc kubenswrapper[5120]: E0316 17:52:07.517966 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1117767 actualBytes=10240 Mar 16 17:52:18 crc kubenswrapper[5120]: I0316 17:52:18.670293 5120 scope.go:117] "RemoveContainer" containerID="3c36926311be0b5863354f251394b54af60074edc1c497847c55048c053dc819" Mar 16 17:52:18 crc kubenswrapper[5120]: E0316 17:52:18.670941 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 17:52:21 crc kubenswrapper[5120]: I0316 17:52:21.060005 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keystone-kuttl-tests/root-account-create-update-69bcb"] Mar 16 17:52:21 crc kubenswrapper[5120]: I0316 17:52:21.067960 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["keystone-kuttl-tests/root-account-create-update-69bcb"] Mar 16 17:52:22 crc kubenswrapper[5120]: I0316 17:52:22.677414 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8284125a-efe5-4fa5-856f-8f50818f5e90" path="/var/lib/kubelet/pods/8284125a-efe5-4fa5-856f-8f50818f5e90/volumes" Mar 16 17:52:32 crc kubenswrapper[5120]: I0316 17:52:32.663629 5120 scope.go:117] "RemoveContainer" containerID="3c36926311be0b5863354f251394b54af60074edc1c497847c55048c053dc819" Mar 16 17:52:32 crc kubenswrapper[5120]: E0316 17:52:32.664329 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 17:52:35 crc kubenswrapper[5120]: I0316 17:52:35.979619 5120 scope.go:117] "RemoveContainer" containerID="421f53bf69e6869f5525cafefc6bdafdaecd0b5bc19a44aaf9bda8ad970d7144" Mar 16 17:52:36 crc kubenswrapper[5120]: I0316 17:52:36.015702 5120 scope.go:117] "RemoveContainer" containerID="ab5431d6cb42694f8d7b2af4fd3c38488396b6bc9ff998104cd143d794fab5e1" Mar 16 17:52:36 crc kubenswrapper[5120]: I0316 17:52:36.062903 5120 scope.go:117] "RemoveContainer" containerID="9b3c6b28358c8b7bfe2faf9acbdf6e84c580fe14dd75cd03de45d11c87afb71c" Mar 16 17:52:36 crc kubenswrapper[5120]: I0316 17:52:36.180958 5120 scope.go:117] "RemoveContainer" containerID="e45d5dfda4fa10b06a418eca4a71acc6a2caad4c7d17b7168d9c525b164df2a5" Mar 16 17:52:36 crc kubenswrapper[5120]: I0316 17:52:36.227450 5120 scope.go:117] "RemoveContainer" containerID="25b1db9962092fccc5f145673089d7e1a6cfe9deb3b4a55167a477a42149acbc" Mar 16 17:52:36 crc kubenswrapper[5120]: I0316 17:52:36.245711 5120 scope.go:117] "RemoveContainer" containerID="22720df151ee3d089933519bf3bfd061feaac1eaae50af8046ff4442af03cd95" Mar 16 17:52:46 crc kubenswrapper[5120]: I0316 17:52:46.663702 5120 scope.go:117] "RemoveContainer" containerID="3c36926311be0b5863354f251394b54af60074edc1c497847c55048c053dc819" Mar 16 17:52:46 crc kubenswrapper[5120]: E0316 17:52:46.664655 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 17:52:57 crc kubenswrapper[5120]: I0316 17:52:57.664333 5120 scope.go:117] "RemoveContainer" containerID="3c36926311be0b5863354f251394b54af60074edc1c497847c55048c053dc819" Mar 16 17:52:57 crc kubenswrapper[5120]: E0316 17:52:57.665197 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 17:53:07 crc kubenswrapper[5120]: E0316 17:53:07.343972 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1117767 actualBytes=10240 Mar 16 17:53:10 crc kubenswrapper[5120]: I0316 17:53:10.664598 5120 scope.go:117] "RemoveContainer" containerID="3c36926311be0b5863354f251394b54af60074edc1c497847c55048c053dc819" Mar 16 17:53:10 crc kubenswrapper[5120]: E0316 17:53:10.665495 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 17:53:22 crc kubenswrapper[5120]: I0316 17:53:22.664345 5120 scope.go:117] "RemoveContainer" containerID="3c36926311be0b5863354f251394b54af60074edc1c497847c55048c053dc819" Mar 16 17:53:22 crc kubenswrapper[5120]: E0316 17:53:22.665276 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 17:53:34 crc kubenswrapper[5120]: I0316 17:53:34.663296 5120 scope.go:117] "RemoveContainer" containerID="3c36926311be0b5863354f251394b54af60074edc1c497847c55048c053dc819" Mar 16 17:53:34 crc kubenswrapper[5120]: E0316 17:53:34.664070 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 17:53:36 crc kubenswrapper[5120]: I0316 17:53:36.370181 5120 scope.go:117] "RemoveContainer" containerID="15514f787a854cee7803aaf254ddca76436f9e6d41e8dcc6e5a3c306afd25fd5" Mar 16 17:53:36 crc kubenswrapper[5120]: I0316 17:53:36.399634 5120 scope.go:117] "RemoveContainer" containerID="cd9a265973210db6ec85070810ef62cc7a6a2e9007307221c2452d48ee3f8706" Mar 16 17:53:36 crc kubenswrapper[5120]: I0316 17:53:36.461012 5120 scope.go:117] "RemoveContainer" containerID="0862b8fd60f55177643eae39d8542eb9a6b8c1937936924992b87516147ce122" Mar 16 17:53:36 crc kubenswrapper[5120]: I0316 17:53:36.494205 5120 scope.go:117] "RemoveContainer" containerID="828e613106ceafe20677251328d7b15861e6b5d455fb9a11dc6b169298e7ecd1" Mar 16 17:53:36 crc kubenswrapper[5120]: I0316 17:53:36.537375 5120 scope.go:117] "RemoveContainer" containerID="3ef835f876e7b16b650154abfb19abf0ec9442d1b668d4af72e672fa28d316b2" Mar 16 17:53:45 crc kubenswrapper[5120]: I0316 17:53:45.664432 5120 scope.go:117] "RemoveContainer" containerID="3c36926311be0b5863354f251394b54af60074edc1c497847c55048c053dc819" Mar 16 17:53:45 crc kubenswrapper[5120]: E0316 17:53:45.665252 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 17:53:59 crc kubenswrapper[5120]: I0316 17:53:59.921166 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-operators-hvchr"] Mar 16 17:53:59 crc kubenswrapper[5120]: I0316 17:53:59.922722 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96328348-2ca5-4770-bf80-346117cff71e" containerName="oc" Mar 16 17:53:59 crc kubenswrapper[5120]: I0316 17:53:59.922744 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="96328348-2ca5-4770-bf80-346117cff71e" containerName="oc" Mar 16 17:53:59 crc kubenswrapper[5120]: I0316 17:53:59.923063 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="96328348-2ca5-4770-bf80-346117cff71e" containerName="oc" Mar 16 17:53:59 crc kubenswrapper[5120]: I0316 17:53:59.936790 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-hvchr" Mar 16 17:53:59 crc kubenswrapper[5120]: I0316 17:53:59.942431 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-hvchr"] Mar 16 17:54:00 crc kubenswrapper[5120]: I0316 17:54:00.054045 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/2d7d7a2e-1269-4bec-985a-029acbb3794d-catalog-content\") pod \"redhat-operators-hvchr\" (UID: \"2d7d7a2e-1269-4bec-985a-029acbb3794d\") " pod="openshift-marketplace/redhat-operators-hvchr" Mar 16 17:54:00 crc kubenswrapper[5120]: I0316 17:54:00.054212 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29gx7\" (UniqueName: \"kubernetes.io/projected/2d7d7a2e-1269-4bec-985a-029acbb3794d-kube-api-access-29gx7\") pod \"redhat-operators-hvchr\" (UID: \"2d7d7a2e-1269-4bec-985a-029acbb3794d\") " pod="openshift-marketplace/redhat-operators-hvchr" Mar 16 17:54:00 crc kubenswrapper[5120]: I0316 17:54:00.054236 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/2d7d7a2e-1269-4bec-985a-029acbb3794d-utilities\") pod \"redhat-operators-hvchr\" (UID: \"2d7d7a2e-1269-4bec-985a-029acbb3794d\") " pod="openshift-marketplace/redhat-operators-hvchr" Mar 16 17:54:00 crc kubenswrapper[5120]: I0316 17:54:00.136974 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-infra/auto-csr-approver-29561394-2cwst"] Mar 16 17:54:00 crc kubenswrapper[5120]: I0316 17:54:00.141900 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561394-2cwst" Mar 16 17:54:00 crc kubenswrapper[5120]: I0316 17:54:00.145051 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561394-2cwst"] Mar 16 17:54:00 crc kubenswrapper[5120]: I0316 17:54:00.145774 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"openshift-service-ca.crt\"" Mar 16 17:54:00 crc kubenswrapper[5120]: I0316 17:54:00.145898 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"kube-root-ca.crt\"" Mar 16 17:54:00 crc kubenswrapper[5120]: I0316 17:54:00.146150 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-infra\"/\"csr-approver-sa-dockercfg-x2nsz\"" Mar 16 17:54:00 crc kubenswrapper[5120]: I0316 17:54:00.156365 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-29gx7\" (UniqueName: \"kubernetes.io/projected/2d7d7a2e-1269-4bec-985a-029acbb3794d-kube-api-access-29gx7\") pod \"redhat-operators-hvchr\" (UID: \"2d7d7a2e-1269-4bec-985a-029acbb3794d\") " pod="openshift-marketplace/redhat-operators-hvchr" Mar 16 17:54:00 crc kubenswrapper[5120]: I0316 17:54:00.156572 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/2d7d7a2e-1269-4bec-985a-029acbb3794d-utilities\") pod \"redhat-operators-hvchr\" (UID: \"2d7d7a2e-1269-4bec-985a-029acbb3794d\") " pod="openshift-marketplace/redhat-operators-hvchr" Mar 16 17:54:00 crc kubenswrapper[5120]: I0316 17:54:00.156906 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/2d7d7a2e-1269-4bec-985a-029acbb3794d-catalog-content\") pod \"redhat-operators-hvchr\" (UID: \"2d7d7a2e-1269-4bec-985a-029acbb3794d\") " pod="openshift-marketplace/redhat-operators-hvchr" Mar 16 17:54:00 crc kubenswrapper[5120]: I0316 17:54:00.157045 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/2d7d7a2e-1269-4bec-985a-029acbb3794d-utilities\") pod \"redhat-operators-hvchr\" (UID: \"2d7d7a2e-1269-4bec-985a-029acbb3794d\") " pod="openshift-marketplace/redhat-operators-hvchr" Mar 16 17:54:00 crc kubenswrapper[5120]: I0316 17:54:00.157341 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/2d7d7a2e-1269-4bec-985a-029acbb3794d-catalog-content\") pod \"redhat-operators-hvchr\" (UID: \"2d7d7a2e-1269-4bec-985a-029acbb3794d\") " pod="openshift-marketplace/redhat-operators-hvchr" Mar 16 17:54:00 crc kubenswrapper[5120]: I0316 17:54:00.189499 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-29gx7\" (UniqueName: \"kubernetes.io/projected/2d7d7a2e-1269-4bec-985a-029acbb3794d-kube-api-access-29gx7\") pod \"redhat-operators-hvchr\" (UID: \"2d7d7a2e-1269-4bec-985a-029acbb3794d\") " pod="openshift-marketplace/redhat-operators-hvchr" Mar 16 17:54:00 crc kubenswrapper[5120]: I0316 17:54:00.259174 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddbdt\" (UniqueName: \"kubernetes.io/projected/e101c71d-e07e-4686-87db-3c80cd56a85f-kube-api-access-ddbdt\") pod \"auto-csr-approver-29561394-2cwst\" (UID: \"e101c71d-e07e-4686-87db-3c80cd56a85f\") " pod="openshift-infra/auto-csr-approver-29561394-2cwst" Mar 16 17:54:00 crc kubenswrapper[5120]: I0316 17:54:00.267465 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-hvchr" Mar 16 17:54:00 crc kubenswrapper[5120]: I0316 17:54:00.362776 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ddbdt\" (UniqueName: \"kubernetes.io/projected/e101c71d-e07e-4686-87db-3c80cd56a85f-kube-api-access-ddbdt\") pod \"auto-csr-approver-29561394-2cwst\" (UID: \"e101c71d-e07e-4686-87db-3c80cd56a85f\") " pod="openshift-infra/auto-csr-approver-29561394-2cwst" Mar 16 17:54:00 crc kubenswrapper[5120]: I0316 17:54:00.384977 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddbdt\" (UniqueName: \"kubernetes.io/projected/e101c71d-e07e-4686-87db-3c80cd56a85f-kube-api-access-ddbdt\") pod \"auto-csr-approver-29561394-2cwst\" (UID: \"e101c71d-e07e-4686-87db-3c80cd56a85f\") " pod="openshift-infra/auto-csr-approver-29561394-2cwst" Mar 16 17:54:00 crc kubenswrapper[5120]: I0316 17:54:00.458523 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561394-2cwst" Mar 16 17:54:00 crc kubenswrapper[5120]: I0316 17:54:00.664376 5120 scope.go:117] "RemoveContainer" containerID="3c36926311be0b5863354f251394b54af60074edc1c497847c55048c053dc819" Mar 16 17:54:00 crc kubenswrapper[5120]: E0316 17:54:00.665108 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 17:54:00 crc kubenswrapper[5120]: I0316 17:54:00.765691 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-hvchr"] Mar 16 17:54:00 crc kubenswrapper[5120]: I0316 17:54:00.769790 5120 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Mar 16 17:54:00 crc kubenswrapper[5120]: I0316 17:54:00.901015 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561394-2cwst"] Mar 16 17:54:00 crc kubenswrapper[5120]: W0316 17:54:00.904182 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode101c71d_e07e_4686_87db_3c80cd56a85f.slice/crio-55e36f3d3a66301be67041c6db2753ff2ba74b0b46ee35e00dd5437f5f4b65f3 WatchSource:0}: Error finding container 55e36f3d3a66301be67041c6db2753ff2ba74b0b46ee35e00dd5437f5f4b65f3: Status 404 returned error can't find the container with id 55e36f3d3a66301be67041c6db2753ff2ba74b0b46ee35e00dd5437f5f4b65f3 Mar 16 17:54:01 crc kubenswrapper[5120]: I0316 17:54:01.470650 5120 generic.go:358] "Generic (PLEG): container finished" podID="2d7d7a2e-1269-4bec-985a-029acbb3794d" containerID="db938078305cc3bb35acf421fbb626be3dc65d879477676cb73965f80c9cbfcb" exitCode=0 Mar 16 17:54:01 crc kubenswrapper[5120]: I0316 17:54:01.470708 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-hvchr" event={"ID":"2d7d7a2e-1269-4bec-985a-029acbb3794d","Type":"ContainerDied","Data":"db938078305cc3bb35acf421fbb626be3dc65d879477676cb73965f80c9cbfcb"} Mar 16 17:54:01 crc kubenswrapper[5120]: I0316 17:54:01.471065 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-hvchr" event={"ID":"2d7d7a2e-1269-4bec-985a-029acbb3794d","Type":"ContainerStarted","Data":"8c4e8713ea936785927ebde99694a0726b3341941b9ead4001498da50ea751ef"} Mar 16 17:54:01 crc kubenswrapper[5120]: I0316 17:54:01.473153 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561394-2cwst" event={"ID":"e101c71d-e07e-4686-87db-3c80cd56a85f","Type":"ContainerStarted","Data":"55e36f3d3a66301be67041c6db2753ff2ba74b0b46ee35e00dd5437f5f4b65f3"} Mar 16 17:54:02 crc kubenswrapper[5120]: I0316 17:54:02.482000 5120 generic.go:358] "Generic (PLEG): container finished" podID="e101c71d-e07e-4686-87db-3c80cd56a85f" containerID="d18d128d10305a7889313c4dea28e0e15063257fee22bf0e5ddd250fdded9fbc" exitCode=0 Mar 16 17:54:02 crc kubenswrapper[5120]: I0316 17:54:02.482061 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561394-2cwst" event={"ID":"e101c71d-e07e-4686-87db-3c80cd56a85f","Type":"ContainerDied","Data":"d18d128d10305a7889313c4dea28e0e15063257fee22bf0e5ddd250fdded9fbc"} Mar 16 17:54:03 crc kubenswrapper[5120]: I0316 17:54:03.495396 5120 generic.go:358] "Generic (PLEG): container finished" podID="2d7d7a2e-1269-4bec-985a-029acbb3794d" containerID="2c8b9d8050aac241dc27ade716115dc42176c09d468551758a622448fcb8b23a" exitCode=0 Mar 16 17:54:03 crc kubenswrapper[5120]: I0316 17:54:03.495462 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-hvchr" event={"ID":"2d7d7a2e-1269-4bec-985a-029acbb3794d","Type":"ContainerDied","Data":"2c8b9d8050aac241dc27ade716115dc42176c09d468551758a622448fcb8b23a"} Mar 16 17:54:03 crc kubenswrapper[5120]: I0316 17:54:03.750420 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561394-2cwst" Mar 16 17:54:03 crc kubenswrapper[5120]: I0316 17:54:03.843616 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ddbdt\" (UniqueName: \"kubernetes.io/projected/e101c71d-e07e-4686-87db-3c80cd56a85f-kube-api-access-ddbdt\") pod \"e101c71d-e07e-4686-87db-3c80cd56a85f\" (UID: \"e101c71d-e07e-4686-87db-3c80cd56a85f\") " Mar 16 17:54:03 crc kubenswrapper[5120]: I0316 17:54:03.851003 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e101c71d-e07e-4686-87db-3c80cd56a85f-kube-api-access-ddbdt" (OuterVolumeSpecName: "kube-api-access-ddbdt") pod "e101c71d-e07e-4686-87db-3c80cd56a85f" (UID: "e101c71d-e07e-4686-87db-3c80cd56a85f"). InnerVolumeSpecName "kube-api-access-ddbdt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:54:03 crc kubenswrapper[5120]: I0316 17:54:03.946499 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ddbdt\" (UniqueName: \"kubernetes.io/projected/e101c71d-e07e-4686-87db-3c80cd56a85f-kube-api-access-ddbdt\") on node \"crc\" DevicePath \"\"" Mar 16 17:54:04 crc kubenswrapper[5120]: I0316 17:54:04.504744 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-hvchr" event={"ID":"2d7d7a2e-1269-4bec-985a-029acbb3794d","Type":"ContainerStarted","Data":"d23cacb21b25bb7829d9c6bb4f38a37d19a900eb354ae06b240c5b6eb3f28cee"} Mar 16 17:54:04 crc kubenswrapper[5120]: I0316 17:54:04.506689 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561394-2cwst" Mar 16 17:54:04 crc kubenswrapper[5120]: I0316 17:54:04.506713 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561394-2cwst" event={"ID":"e101c71d-e07e-4686-87db-3c80cd56a85f","Type":"ContainerDied","Data":"55e36f3d3a66301be67041c6db2753ff2ba74b0b46ee35e00dd5437f5f4b65f3"} Mar 16 17:54:04 crc kubenswrapper[5120]: I0316 17:54:04.506737 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="55e36f3d3a66301be67041c6db2753ff2ba74b0b46ee35e00dd5437f5f4b65f3" Mar 16 17:54:04 crc kubenswrapper[5120]: I0316 17:54:04.527618 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/redhat-operators-hvchr" podStartSLOduration=4.529026455 podStartE2EDuration="5.527598468s" podCreationTimestamp="2026-03-16 17:53:59 +0000 UTC" firstStartedPulling="2026-03-16 17:54:01.47154774 +0000 UTC m=+8543.625479397" lastFinishedPulling="2026-03-16 17:54:02.470119743 +0000 UTC m=+8544.624051410" observedRunningTime="2026-03-16 17:54:04.526805986 +0000 UTC m=+8546.680737653" watchObservedRunningTime="2026-03-16 17:54:04.527598468 +0000 UTC m=+8546.681530125" Mar 16 17:54:04 crc kubenswrapper[5120]: I0316 17:54:04.812477 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-infra/auto-csr-approver-29561388-tlc9w"] Mar 16 17:54:04 crc kubenswrapper[5120]: I0316 17:54:04.820643 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-infra/auto-csr-approver-29561388-tlc9w"] Mar 16 17:54:06 crc kubenswrapper[5120]: I0316 17:54:06.673971 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7f899422-9580-49f9-8de7-74caef90cdf5" path="/var/lib/kubelet/pods/7f899422-9580-49f9-8de7-74caef90cdf5/volumes" Mar 16 17:54:08 crc kubenswrapper[5120]: E0316 17:54:08.054675 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1126017 actualBytes=10240 Mar 16 17:54:10 crc kubenswrapper[5120]: I0316 17:54:10.268072 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-operators-hvchr" Mar 16 17:54:10 crc kubenswrapper[5120]: I0316 17:54:10.268129 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-marketplace/redhat-operators-hvchr" Mar 16 17:54:10 crc kubenswrapper[5120]: I0316 17:54:10.344264 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-operators-hvchr" Mar 16 17:54:10 crc kubenswrapper[5120]: I0316 17:54:10.635563 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-operators-hvchr" Mar 16 17:54:10 crc kubenswrapper[5120]: I0316 17:54:10.715304 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-operators-hvchr"] Mar 16 17:54:12 crc kubenswrapper[5120]: I0316 17:54:12.582485 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-marketplace/redhat-operators-hvchr" podUID="2d7d7a2e-1269-4bec-985a-029acbb3794d" containerName="registry-server" containerID="cri-o://d23cacb21b25bb7829d9c6bb4f38a37d19a900eb354ae06b240c5b6eb3f28cee" gracePeriod=2 Mar 16 17:54:12 crc kubenswrapper[5120]: I0316 17:54:12.999481 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-hvchr" Mar 16 17:54:13 crc kubenswrapper[5120]: I0316 17:54:13.084253 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/2d7d7a2e-1269-4bec-985a-029acbb3794d-utilities\") pod \"2d7d7a2e-1269-4bec-985a-029acbb3794d\" (UID: \"2d7d7a2e-1269-4bec-985a-029acbb3794d\") " Mar 16 17:54:13 crc kubenswrapper[5120]: I0316 17:54:13.084309 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-29gx7\" (UniqueName: \"kubernetes.io/projected/2d7d7a2e-1269-4bec-985a-029acbb3794d-kube-api-access-29gx7\") pod \"2d7d7a2e-1269-4bec-985a-029acbb3794d\" (UID: \"2d7d7a2e-1269-4bec-985a-029acbb3794d\") " Mar 16 17:54:13 crc kubenswrapper[5120]: I0316 17:54:13.085053 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/2d7d7a2e-1269-4bec-985a-029acbb3794d-catalog-content\") pod \"2d7d7a2e-1269-4bec-985a-029acbb3794d\" (UID: \"2d7d7a2e-1269-4bec-985a-029acbb3794d\") " Mar 16 17:54:13 crc kubenswrapper[5120]: I0316 17:54:13.085699 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d7d7a2e-1269-4bec-985a-029acbb3794d-utilities" (OuterVolumeSpecName: "utilities") pod "2d7d7a2e-1269-4bec-985a-029acbb3794d" (UID: "2d7d7a2e-1269-4bec-985a-029acbb3794d"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:54:13 crc kubenswrapper[5120]: I0316 17:54:13.091937 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d7d7a2e-1269-4bec-985a-029acbb3794d-kube-api-access-29gx7" (OuterVolumeSpecName: "kube-api-access-29gx7") pod "2d7d7a2e-1269-4bec-985a-029acbb3794d" (UID: "2d7d7a2e-1269-4bec-985a-029acbb3794d"). InnerVolumeSpecName "kube-api-access-29gx7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:54:13 crc kubenswrapper[5120]: I0316 17:54:13.189624 5120 reconciler_common.go:299] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/2d7d7a2e-1269-4bec-985a-029acbb3794d-utilities\") on node \"crc\" DevicePath \"\"" Mar 16 17:54:13 crc kubenswrapper[5120]: I0316 17:54:13.189682 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-29gx7\" (UniqueName: \"kubernetes.io/projected/2d7d7a2e-1269-4bec-985a-029acbb3794d-kube-api-access-29gx7\") on node \"crc\" DevicePath \"\"" Mar 16 17:54:13 crc kubenswrapper[5120]: I0316 17:54:13.599337 5120 generic.go:358] "Generic (PLEG): container finished" podID="2d7d7a2e-1269-4bec-985a-029acbb3794d" containerID="d23cacb21b25bb7829d9c6bb4f38a37d19a900eb354ae06b240c5b6eb3f28cee" exitCode=0 Mar 16 17:54:13 crc kubenswrapper[5120]: I0316 17:54:13.599437 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-hvchr" event={"ID":"2d7d7a2e-1269-4bec-985a-029acbb3794d","Type":"ContainerDied","Data":"d23cacb21b25bb7829d9c6bb4f38a37d19a900eb354ae06b240c5b6eb3f28cee"} Mar 16 17:54:13 crc kubenswrapper[5120]: I0316 17:54:13.600071 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-hvchr" event={"ID":"2d7d7a2e-1269-4bec-985a-029acbb3794d","Type":"ContainerDied","Data":"8c4e8713ea936785927ebde99694a0726b3341941b9ead4001498da50ea751ef"} Mar 16 17:54:13 crc kubenswrapper[5120]: I0316 17:54:13.599562 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-hvchr" Mar 16 17:54:13 crc kubenswrapper[5120]: I0316 17:54:13.600123 5120 scope.go:117] "RemoveContainer" containerID="d23cacb21b25bb7829d9c6bb4f38a37d19a900eb354ae06b240c5b6eb3f28cee" Mar 16 17:54:13 crc kubenswrapper[5120]: I0316 17:54:13.632552 5120 scope.go:117] "RemoveContainer" containerID="2c8b9d8050aac241dc27ade716115dc42176c09d468551758a622448fcb8b23a" Mar 16 17:54:13 crc kubenswrapper[5120]: I0316 17:54:13.662105 5120 scope.go:117] "RemoveContainer" containerID="db938078305cc3bb35acf421fbb626be3dc65d879477676cb73965f80c9cbfcb" Mar 16 17:54:13 crc kubenswrapper[5120]: I0316 17:54:13.705290 5120 scope.go:117] "RemoveContainer" containerID="d23cacb21b25bb7829d9c6bb4f38a37d19a900eb354ae06b240c5b6eb3f28cee" Mar 16 17:54:13 crc kubenswrapper[5120]: E0316 17:54:13.705779 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d23cacb21b25bb7829d9c6bb4f38a37d19a900eb354ae06b240c5b6eb3f28cee\": container with ID starting with d23cacb21b25bb7829d9c6bb4f38a37d19a900eb354ae06b240c5b6eb3f28cee not found: ID does not exist" containerID="d23cacb21b25bb7829d9c6bb4f38a37d19a900eb354ae06b240c5b6eb3f28cee" Mar 16 17:54:13 crc kubenswrapper[5120]: I0316 17:54:13.705820 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d23cacb21b25bb7829d9c6bb4f38a37d19a900eb354ae06b240c5b6eb3f28cee"} err="failed to get container status \"d23cacb21b25bb7829d9c6bb4f38a37d19a900eb354ae06b240c5b6eb3f28cee\": rpc error: code = NotFound desc = could not find container \"d23cacb21b25bb7829d9c6bb4f38a37d19a900eb354ae06b240c5b6eb3f28cee\": container with ID starting with d23cacb21b25bb7829d9c6bb4f38a37d19a900eb354ae06b240c5b6eb3f28cee not found: ID does not exist" Mar 16 17:54:13 crc kubenswrapper[5120]: I0316 17:54:13.705844 5120 scope.go:117] "RemoveContainer" containerID="2c8b9d8050aac241dc27ade716115dc42176c09d468551758a622448fcb8b23a" Mar 16 17:54:13 crc kubenswrapper[5120]: E0316 17:54:13.706135 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c8b9d8050aac241dc27ade716115dc42176c09d468551758a622448fcb8b23a\": container with ID starting with 2c8b9d8050aac241dc27ade716115dc42176c09d468551758a622448fcb8b23a not found: ID does not exist" containerID="2c8b9d8050aac241dc27ade716115dc42176c09d468551758a622448fcb8b23a" Mar 16 17:54:13 crc kubenswrapper[5120]: I0316 17:54:13.706174 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c8b9d8050aac241dc27ade716115dc42176c09d468551758a622448fcb8b23a"} err="failed to get container status \"2c8b9d8050aac241dc27ade716115dc42176c09d468551758a622448fcb8b23a\": rpc error: code = NotFound desc = could not find container \"2c8b9d8050aac241dc27ade716115dc42176c09d468551758a622448fcb8b23a\": container with ID starting with 2c8b9d8050aac241dc27ade716115dc42176c09d468551758a622448fcb8b23a not found: ID does not exist" Mar 16 17:54:13 crc kubenswrapper[5120]: I0316 17:54:13.706282 5120 scope.go:117] "RemoveContainer" containerID="db938078305cc3bb35acf421fbb626be3dc65d879477676cb73965f80c9cbfcb" Mar 16 17:54:13 crc kubenswrapper[5120]: E0316 17:54:13.706686 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db938078305cc3bb35acf421fbb626be3dc65d879477676cb73965f80c9cbfcb\": container with ID starting with db938078305cc3bb35acf421fbb626be3dc65d879477676cb73965f80c9cbfcb not found: ID does not exist" containerID="db938078305cc3bb35acf421fbb626be3dc65d879477676cb73965f80c9cbfcb" Mar 16 17:54:13 crc kubenswrapper[5120]: I0316 17:54:13.706718 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db938078305cc3bb35acf421fbb626be3dc65d879477676cb73965f80c9cbfcb"} err="failed to get container status \"db938078305cc3bb35acf421fbb626be3dc65d879477676cb73965f80c9cbfcb\": rpc error: code = NotFound desc = could not find container \"db938078305cc3bb35acf421fbb626be3dc65d879477676cb73965f80c9cbfcb\": container with ID starting with db938078305cc3bb35acf421fbb626be3dc65d879477676cb73965f80c9cbfcb not found: ID does not exist" Mar 16 17:54:14 crc kubenswrapper[5120]: I0316 17:54:14.286708 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d7d7a2e-1269-4bec-985a-029acbb3794d-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "2d7d7a2e-1269-4bec-985a-029acbb3794d" (UID: "2d7d7a2e-1269-4bec-985a-029acbb3794d"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:54:14 crc kubenswrapper[5120]: I0316 17:54:14.321370 5120 reconciler_common.go:299] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/2d7d7a2e-1269-4bec-985a-029acbb3794d-catalog-content\") on node \"crc\" DevicePath \"\"" Mar 16 17:54:14 crc kubenswrapper[5120]: I0316 17:54:14.557732 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-operators-hvchr"] Mar 16 17:54:14 crc kubenswrapper[5120]: I0316 17:54:14.568897 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/redhat-operators-hvchr"] Mar 16 17:54:14 crc kubenswrapper[5120]: I0316 17:54:14.664051 5120 scope.go:117] "RemoveContainer" containerID="3c36926311be0b5863354f251394b54af60074edc1c497847c55048c053dc819" Mar 16 17:54:14 crc kubenswrapper[5120]: E0316 17:54:14.665230 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 17:54:14 crc kubenswrapper[5120]: I0316 17:54:14.675193 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2d7d7a2e-1269-4bec-985a-029acbb3794d" path="/var/lib/kubelet/pods/2d7d7a2e-1269-4bec-985a-029acbb3794d/volumes" Mar 16 17:54:26 crc kubenswrapper[5120]: I0316 17:54:26.666115 5120 scope.go:117] "RemoveContainer" containerID="3c36926311be0b5863354f251394b54af60074edc1c497847c55048c053dc819" Mar 16 17:54:26 crc kubenswrapper[5120]: E0316 17:54:26.667339 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 17:54:36 crc kubenswrapper[5120]: I0316 17:54:36.623349 5120 scope.go:117] "RemoveContainer" containerID="24d322e9f6da173e01b31c1b2942a96118e4a37f99062900cc1abca269966551" Mar 16 17:54:36 crc kubenswrapper[5120]: I0316 17:54:36.673632 5120 scope.go:117] "RemoveContainer" containerID="11e3b02b70de3faffe8fab87480396fd74646e29175192a26ed6d952ed0dde8f" Mar 16 17:54:36 crc kubenswrapper[5120]: I0316 17:54:36.773833 5120 scope.go:117] "RemoveContainer" containerID="ec53c97b49f8d672e29734636ac29e087fea5445a8f9eb55741e34a43646ce11" Mar 16 17:54:36 crc kubenswrapper[5120]: I0316 17:54:36.841269 5120 scope.go:117] "RemoveContainer" containerID="97dad2744adc3b4dc278bf8f431fbb6995f3ec42c711e2be28caa523bf4e423e" Mar 16 17:54:36 crc kubenswrapper[5120]: I0316 17:54:36.869953 5120 scope.go:117] "RemoveContainer" containerID="d1afbafdd5b5a199014b36af706a3bc2d4afad961c980dde58f39f3b9b142614" Mar 16 17:54:36 crc kubenswrapper[5120]: I0316 17:54:36.896367 5120 scope.go:117] "RemoveContainer" containerID="b622cd048b65bdaa47f6c74c98b47af3fd029318751832c613405a4f1f4526b7" Mar 16 17:54:38 crc kubenswrapper[5120]: I0316 17:54:38.687696 5120 scope.go:117] "RemoveContainer" containerID="3c36926311be0b5863354f251394b54af60074edc1c497847c55048c053dc819" Mar 16 17:54:38 crc kubenswrapper[5120]: E0316 17:54:38.688842 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 17:54:51 crc kubenswrapper[5120]: I0316 17:54:51.664172 5120 scope.go:117] "RemoveContainer" containerID="3c36926311be0b5863354f251394b54af60074edc1c497847c55048c053dc819" Mar 16 17:54:51 crc kubenswrapper[5120]: E0316 17:54:51.665583 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 17:54:59 crc kubenswrapper[5120]: I0316 17:54:59.725205 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-marketplace-zr945"] Mar 16 17:54:59 crc kubenswrapper[5120]: I0316 17:54:59.727486 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e101c71d-e07e-4686-87db-3c80cd56a85f" containerName="oc" Mar 16 17:54:59 crc kubenswrapper[5120]: I0316 17:54:59.727516 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e101c71d-e07e-4686-87db-3c80cd56a85f" containerName="oc" Mar 16 17:54:59 crc kubenswrapper[5120]: I0316 17:54:59.727544 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d7d7a2e-1269-4bec-985a-029acbb3794d" containerName="extract-utilities" Mar 16 17:54:59 crc kubenswrapper[5120]: I0316 17:54:59.727556 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d7d7a2e-1269-4bec-985a-029acbb3794d" containerName="extract-utilities" Mar 16 17:54:59 crc kubenswrapper[5120]: I0316 17:54:59.727592 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d7d7a2e-1269-4bec-985a-029acbb3794d" containerName="registry-server" Mar 16 17:54:59 crc kubenswrapper[5120]: I0316 17:54:59.727605 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d7d7a2e-1269-4bec-985a-029acbb3794d" containerName="registry-server" Mar 16 17:54:59 crc kubenswrapper[5120]: I0316 17:54:59.727633 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d7d7a2e-1269-4bec-985a-029acbb3794d" containerName="extract-content" Mar 16 17:54:59 crc kubenswrapper[5120]: I0316 17:54:59.727645 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d7d7a2e-1269-4bec-985a-029acbb3794d" containerName="extract-content" Mar 16 17:54:59 crc kubenswrapper[5120]: I0316 17:54:59.727904 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e101c71d-e07e-4686-87db-3c80cd56a85f" containerName="oc" Mar 16 17:54:59 crc kubenswrapper[5120]: I0316 17:54:59.727928 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="2d7d7a2e-1269-4bec-985a-029acbb3794d" containerName="registry-server" Mar 16 17:54:59 crc kubenswrapper[5120]: I0316 17:54:59.758283 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-zr945"] Mar 16 17:54:59 crc kubenswrapper[5120]: I0316 17:54:59.758440 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-zr945" Mar 16 17:54:59 crc kubenswrapper[5120]: I0316 17:54:59.839866 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/901b017e-aaf7-4c6a-9739-d7fa6140064d-utilities\") pod \"redhat-marketplace-zr945\" (UID: \"901b017e-aaf7-4c6a-9739-d7fa6140064d\") " pod="openshift-marketplace/redhat-marketplace-zr945" Mar 16 17:54:59 crc kubenswrapper[5120]: I0316 17:54:59.839971 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/901b017e-aaf7-4c6a-9739-d7fa6140064d-catalog-content\") pod \"redhat-marketplace-zr945\" (UID: \"901b017e-aaf7-4c6a-9739-d7fa6140064d\") " pod="openshift-marketplace/redhat-marketplace-zr945" Mar 16 17:54:59 crc kubenswrapper[5120]: I0316 17:54:59.840127 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49vhl\" (UniqueName: \"kubernetes.io/projected/901b017e-aaf7-4c6a-9739-d7fa6140064d-kube-api-access-49vhl\") pod \"redhat-marketplace-zr945\" (UID: \"901b017e-aaf7-4c6a-9739-d7fa6140064d\") " pod="openshift-marketplace/redhat-marketplace-zr945" Mar 16 17:54:59 crc kubenswrapper[5120]: I0316 17:54:59.944287 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/901b017e-aaf7-4c6a-9739-d7fa6140064d-utilities\") pod \"redhat-marketplace-zr945\" (UID: \"901b017e-aaf7-4c6a-9739-d7fa6140064d\") " pod="openshift-marketplace/redhat-marketplace-zr945" Mar 16 17:54:59 crc kubenswrapper[5120]: I0316 17:54:59.944619 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/901b017e-aaf7-4c6a-9739-d7fa6140064d-catalog-content\") pod \"redhat-marketplace-zr945\" (UID: \"901b017e-aaf7-4c6a-9739-d7fa6140064d\") " pod="openshift-marketplace/redhat-marketplace-zr945" Mar 16 17:54:59 crc kubenswrapper[5120]: I0316 17:54:59.944847 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-49vhl\" (UniqueName: \"kubernetes.io/projected/901b017e-aaf7-4c6a-9739-d7fa6140064d-kube-api-access-49vhl\") pod \"redhat-marketplace-zr945\" (UID: \"901b017e-aaf7-4c6a-9739-d7fa6140064d\") " pod="openshift-marketplace/redhat-marketplace-zr945" Mar 16 17:54:59 crc kubenswrapper[5120]: I0316 17:54:59.945064 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/901b017e-aaf7-4c6a-9739-d7fa6140064d-utilities\") pod \"redhat-marketplace-zr945\" (UID: \"901b017e-aaf7-4c6a-9739-d7fa6140064d\") " pod="openshift-marketplace/redhat-marketplace-zr945" Mar 16 17:54:59 crc kubenswrapper[5120]: I0316 17:54:59.945286 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/901b017e-aaf7-4c6a-9739-d7fa6140064d-catalog-content\") pod \"redhat-marketplace-zr945\" (UID: \"901b017e-aaf7-4c6a-9739-d7fa6140064d\") " pod="openshift-marketplace/redhat-marketplace-zr945" Mar 16 17:54:59 crc kubenswrapper[5120]: I0316 17:54:59.971744 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-49vhl\" (UniqueName: \"kubernetes.io/projected/901b017e-aaf7-4c6a-9739-d7fa6140064d-kube-api-access-49vhl\") pod \"redhat-marketplace-zr945\" (UID: \"901b017e-aaf7-4c6a-9739-d7fa6140064d\") " pod="openshift-marketplace/redhat-marketplace-zr945" Mar 16 17:55:00 crc kubenswrapper[5120]: I0316 17:55:00.086981 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-zr945" Mar 16 17:55:00 crc kubenswrapper[5120]: I0316 17:55:00.315347 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-zr945"] Mar 16 17:55:01 crc kubenswrapper[5120]: I0316 17:55:01.073899 5120 generic.go:358] "Generic (PLEG): container finished" podID="901b017e-aaf7-4c6a-9739-d7fa6140064d" containerID="c46baec919576c84a152b17014526e1b46307eb2490107624dd1d0a5ca71c849" exitCode=0 Mar 16 17:55:01 crc kubenswrapper[5120]: I0316 17:55:01.074037 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-zr945" event={"ID":"901b017e-aaf7-4c6a-9739-d7fa6140064d","Type":"ContainerDied","Data":"c46baec919576c84a152b17014526e1b46307eb2490107624dd1d0a5ca71c849"} Mar 16 17:55:01 crc kubenswrapper[5120]: I0316 17:55:01.074225 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-zr945" event={"ID":"901b017e-aaf7-4c6a-9739-d7fa6140064d","Type":"ContainerStarted","Data":"c8eeb4b2406615f2137b2da50adf51054b84e8c747f1b91885281a54fc95b9cb"} Mar 16 17:55:03 crc kubenswrapper[5120]: I0316 17:55:03.098147 5120 generic.go:358] "Generic (PLEG): container finished" podID="901b017e-aaf7-4c6a-9739-d7fa6140064d" containerID="fcb2aaf7c371507bb9d08b3119f99164e091acba3cb8bc58419428a54a9cdf54" exitCode=0 Mar 16 17:55:03 crc kubenswrapper[5120]: I0316 17:55:03.098215 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-zr945" event={"ID":"901b017e-aaf7-4c6a-9739-d7fa6140064d","Type":"ContainerDied","Data":"fcb2aaf7c371507bb9d08b3119f99164e091acba3cb8bc58419428a54a9cdf54"} Mar 16 17:55:04 crc kubenswrapper[5120]: I0316 17:55:04.111951 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-zr945" event={"ID":"901b017e-aaf7-4c6a-9739-d7fa6140064d","Type":"ContainerStarted","Data":"ee276223ad6bd295316106a86ffbdd7dbcd25c89b584c3268bf4f6f59e508039"} Mar 16 17:55:04 crc kubenswrapper[5120]: I0316 17:55:04.137356 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/redhat-marketplace-zr945" podStartSLOduration=4.070917569 podStartE2EDuration="5.137335007s" podCreationTimestamp="2026-03-16 17:54:59 +0000 UTC" firstStartedPulling="2026-03-16 17:55:01.075376248 +0000 UTC m=+8603.229307905" lastFinishedPulling="2026-03-16 17:55:02.141793636 +0000 UTC m=+8604.295725343" observedRunningTime="2026-03-16 17:55:04.135304491 +0000 UTC m=+8606.289236158" watchObservedRunningTime="2026-03-16 17:55:04.137335007 +0000 UTC m=+8606.291266684" Mar 16 17:55:05 crc kubenswrapper[5120]: I0316 17:55:05.664431 5120 scope.go:117] "RemoveContainer" containerID="3c36926311be0b5863354f251394b54af60074edc1c497847c55048c053dc819" Mar 16 17:55:05 crc kubenswrapper[5120]: E0316 17:55:05.665548 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 17:55:07 crc kubenswrapper[5120]: E0316 17:55:07.958492 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1127110 actualBytes=10240 Mar 16 17:55:10 crc kubenswrapper[5120]: I0316 17:55:10.087603 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-marketplace/redhat-marketplace-zr945" Mar 16 17:55:10 crc kubenswrapper[5120]: I0316 17:55:10.088050 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-marketplace-zr945" Mar 16 17:55:10 crc kubenswrapper[5120]: I0316 17:55:10.137538 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-marketplace-zr945" Mar 16 17:55:10 crc kubenswrapper[5120]: I0316 17:55:10.209054 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-marketplace-zr945" Mar 16 17:55:10 crc kubenswrapper[5120]: I0316 17:55:10.384561 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-marketplace-zr945"] Mar 16 17:55:12 crc kubenswrapper[5120]: I0316 17:55:12.188678 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-marketplace/redhat-marketplace-zr945" podUID="901b017e-aaf7-4c6a-9739-d7fa6140064d" containerName="registry-server" containerID="cri-o://ee276223ad6bd295316106a86ffbdd7dbcd25c89b584c3268bf4f6f59e508039" gracePeriod=2 Mar 16 17:55:12 crc kubenswrapper[5120]: I0316 17:55:12.652779 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-zr945" Mar 16 17:55:12 crc kubenswrapper[5120]: I0316 17:55:12.739328 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-49vhl\" (UniqueName: \"kubernetes.io/projected/901b017e-aaf7-4c6a-9739-d7fa6140064d-kube-api-access-49vhl\") pod \"901b017e-aaf7-4c6a-9739-d7fa6140064d\" (UID: \"901b017e-aaf7-4c6a-9739-d7fa6140064d\") " Mar 16 17:55:12 crc kubenswrapper[5120]: I0316 17:55:12.739891 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/901b017e-aaf7-4c6a-9739-d7fa6140064d-utilities\") pod \"901b017e-aaf7-4c6a-9739-d7fa6140064d\" (UID: \"901b017e-aaf7-4c6a-9739-d7fa6140064d\") " Mar 16 17:55:12 crc kubenswrapper[5120]: I0316 17:55:12.740697 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/901b017e-aaf7-4c6a-9739-d7fa6140064d-catalog-content\") pod \"901b017e-aaf7-4c6a-9739-d7fa6140064d\" (UID: \"901b017e-aaf7-4c6a-9739-d7fa6140064d\") " Mar 16 17:55:12 crc kubenswrapper[5120]: I0316 17:55:12.741018 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/901b017e-aaf7-4c6a-9739-d7fa6140064d-utilities" (OuterVolumeSpecName: "utilities") pod "901b017e-aaf7-4c6a-9739-d7fa6140064d" (UID: "901b017e-aaf7-4c6a-9739-d7fa6140064d"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:55:12 crc kubenswrapper[5120]: I0316 17:55:12.742435 5120 reconciler_common.go:299] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/901b017e-aaf7-4c6a-9739-d7fa6140064d-utilities\") on node \"crc\" DevicePath \"\"" Mar 16 17:55:12 crc kubenswrapper[5120]: I0316 17:55:12.752059 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/901b017e-aaf7-4c6a-9739-d7fa6140064d-kube-api-access-49vhl" (OuterVolumeSpecName: "kube-api-access-49vhl") pod "901b017e-aaf7-4c6a-9739-d7fa6140064d" (UID: "901b017e-aaf7-4c6a-9739-d7fa6140064d"). InnerVolumeSpecName "kube-api-access-49vhl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:55:12 crc kubenswrapper[5120]: I0316 17:55:12.781336 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/901b017e-aaf7-4c6a-9739-d7fa6140064d-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "901b017e-aaf7-4c6a-9739-d7fa6140064d" (UID: "901b017e-aaf7-4c6a-9739-d7fa6140064d"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 17:55:12 crc kubenswrapper[5120]: I0316 17:55:12.847237 5120 reconciler_common.go:299] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/901b017e-aaf7-4c6a-9739-d7fa6140064d-catalog-content\") on node \"crc\" DevicePath \"\"" Mar 16 17:55:12 crc kubenswrapper[5120]: I0316 17:55:12.847287 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-49vhl\" (UniqueName: \"kubernetes.io/projected/901b017e-aaf7-4c6a-9739-d7fa6140064d-kube-api-access-49vhl\") on node \"crc\" DevicePath \"\"" Mar 16 17:55:13 crc kubenswrapper[5120]: I0316 17:55:13.201571 5120 generic.go:358] "Generic (PLEG): container finished" podID="901b017e-aaf7-4c6a-9739-d7fa6140064d" containerID="ee276223ad6bd295316106a86ffbdd7dbcd25c89b584c3268bf4f6f59e508039" exitCode=0 Mar 16 17:55:13 crc kubenswrapper[5120]: I0316 17:55:13.201747 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-zr945" event={"ID":"901b017e-aaf7-4c6a-9739-d7fa6140064d","Type":"ContainerDied","Data":"ee276223ad6bd295316106a86ffbdd7dbcd25c89b584c3268bf4f6f59e508039"} Mar 16 17:55:13 crc kubenswrapper[5120]: I0316 17:55:13.201812 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-zr945" Mar 16 17:55:13 crc kubenswrapper[5120]: I0316 17:55:13.201860 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-zr945" event={"ID":"901b017e-aaf7-4c6a-9739-d7fa6140064d","Type":"ContainerDied","Data":"c8eeb4b2406615f2137b2da50adf51054b84e8c747f1b91885281a54fc95b9cb"} Mar 16 17:55:13 crc kubenswrapper[5120]: I0316 17:55:13.201896 5120 scope.go:117] "RemoveContainer" containerID="ee276223ad6bd295316106a86ffbdd7dbcd25c89b584c3268bf4f6f59e508039" Mar 16 17:55:13 crc kubenswrapper[5120]: I0316 17:55:13.240372 5120 scope.go:117] "RemoveContainer" containerID="fcb2aaf7c371507bb9d08b3119f99164e091acba3cb8bc58419428a54a9cdf54" Mar 16 17:55:13 crc kubenswrapper[5120]: I0316 17:55:13.272903 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-marketplace-zr945"] Mar 16 17:55:13 crc kubenswrapper[5120]: I0316 17:55:13.281334 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/redhat-marketplace-zr945"] Mar 16 17:55:13 crc kubenswrapper[5120]: I0316 17:55:13.282884 5120 scope.go:117] "RemoveContainer" containerID="c46baec919576c84a152b17014526e1b46307eb2490107624dd1d0a5ca71c849" Mar 16 17:55:13 crc kubenswrapper[5120]: I0316 17:55:13.306477 5120 scope.go:117] "RemoveContainer" containerID="ee276223ad6bd295316106a86ffbdd7dbcd25c89b584c3268bf4f6f59e508039" Mar 16 17:55:13 crc kubenswrapper[5120]: E0316 17:55:13.306967 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee276223ad6bd295316106a86ffbdd7dbcd25c89b584c3268bf4f6f59e508039\": container with ID starting with ee276223ad6bd295316106a86ffbdd7dbcd25c89b584c3268bf4f6f59e508039 not found: ID does not exist" containerID="ee276223ad6bd295316106a86ffbdd7dbcd25c89b584c3268bf4f6f59e508039" Mar 16 17:55:13 crc kubenswrapper[5120]: I0316 17:55:13.306997 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee276223ad6bd295316106a86ffbdd7dbcd25c89b584c3268bf4f6f59e508039"} err="failed to get container status \"ee276223ad6bd295316106a86ffbdd7dbcd25c89b584c3268bf4f6f59e508039\": rpc error: code = NotFound desc = could not find container \"ee276223ad6bd295316106a86ffbdd7dbcd25c89b584c3268bf4f6f59e508039\": container with ID starting with ee276223ad6bd295316106a86ffbdd7dbcd25c89b584c3268bf4f6f59e508039 not found: ID does not exist" Mar 16 17:55:13 crc kubenswrapper[5120]: I0316 17:55:13.307016 5120 scope.go:117] "RemoveContainer" containerID="fcb2aaf7c371507bb9d08b3119f99164e091acba3cb8bc58419428a54a9cdf54" Mar 16 17:55:13 crc kubenswrapper[5120]: E0316 17:55:13.307305 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fcb2aaf7c371507bb9d08b3119f99164e091acba3cb8bc58419428a54a9cdf54\": container with ID starting with fcb2aaf7c371507bb9d08b3119f99164e091acba3cb8bc58419428a54a9cdf54 not found: ID does not exist" containerID="fcb2aaf7c371507bb9d08b3119f99164e091acba3cb8bc58419428a54a9cdf54" Mar 16 17:55:13 crc kubenswrapper[5120]: I0316 17:55:13.307356 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fcb2aaf7c371507bb9d08b3119f99164e091acba3cb8bc58419428a54a9cdf54"} err="failed to get container status \"fcb2aaf7c371507bb9d08b3119f99164e091acba3cb8bc58419428a54a9cdf54\": rpc error: code = NotFound desc = could not find container \"fcb2aaf7c371507bb9d08b3119f99164e091acba3cb8bc58419428a54a9cdf54\": container with ID starting with fcb2aaf7c371507bb9d08b3119f99164e091acba3cb8bc58419428a54a9cdf54 not found: ID does not exist" Mar 16 17:55:13 crc kubenswrapper[5120]: I0316 17:55:13.307389 5120 scope.go:117] "RemoveContainer" containerID="c46baec919576c84a152b17014526e1b46307eb2490107624dd1d0a5ca71c849" Mar 16 17:55:13 crc kubenswrapper[5120]: E0316 17:55:13.307733 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c46baec919576c84a152b17014526e1b46307eb2490107624dd1d0a5ca71c849\": container with ID starting with c46baec919576c84a152b17014526e1b46307eb2490107624dd1d0a5ca71c849 not found: ID does not exist" containerID="c46baec919576c84a152b17014526e1b46307eb2490107624dd1d0a5ca71c849" Mar 16 17:55:13 crc kubenswrapper[5120]: I0316 17:55:13.307776 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c46baec919576c84a152b17014526e1b46307eb2490107624dd1d0a5ca71c849"} err="failed to get container status \"c46baec919576c84a152b17014526e1b46307eb2490107624dd1d0a5ca71c849\": rpc error: code = NotFound desc = could not find container \"c46baec919576c84a152b17014526e1b46307eb2490107624dd1d0a5ca71c849\": container with ID starting with c46baec919576c84a152b17014526e1b46307eb2490107624dd1d0a5ca71c849 not found: ID does not exist" Mar 16 17:55:14 crc kubenswrapper[5120]: I0316 17:55:14.676244 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="901b017e-aaf7-4c6a-9739-d7fa6140064d" path="/var/lib/kubelet/pods/901b017e-aaf7-4c6a-9739-d7fa6140064d/volumes" Mar 16 17:55:18 crc kubenswrapper[5120]: I0316 17:55:18.681085 5120 scope.go:117] "RemoveContainer" containerID="3c36926311be0b5863354f251394b54af60074edc1c497847c55048c053dc819" Mar 16 17:55:18 crc kubenswrapper[5120]: E0316 17:55:18.682274 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 17:55:33 crc kubenswrapper[5120]: I0316 17:55:33.664235 5120 scope.go:117] "RemoveContainer" containerID="3c36926311be0b5863354f251394b54af60074edc1c497847c55048c053dc819" Mar 16 17:55:33 crc kubenswrapper[5120]: E0316 17:55:33.665146 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 17:55:37 crc kubenswrapper[5120]: I0316 17:55:37.020188 5120 scope.go:117] "RemoveContainer" containerID="3397fa7056374366985f6b9c2ff62dffac38fb6a459fd5e86e6b72eec919373f" Mar 16 17:55:47 crc kubenswrapper[5120]: I0316 17:55:47.663752 5120 scope.go:117] "RemoveContainer" containerID="3c36926311be0b5863354f251394b54af60074edc1c497847c55048c053dc819" Mar 16 17:55:47 crc kubenswrapper[5120]: E0316 17:55:47.664559 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 17:56:00 crc kubenswrapper[5120]: I0316 17:56:00.149151 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-infra/auto-csr-approver-29561396-h5qx4"] Mar 16 17:56:00 crc kubenswrapper[5120]: I0316 17:56:00.151361 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="901b017e-aaf7-4c6a-9739-d7fa6140064d" containerName="registry-server" Mar 16 17:56:00 crc kubenswrapper[5120]: I0316 17:56:00.151387 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="901b017e-aaf7-4c6a-9739-d7fa6140064d" containerName="registry-server" Mar 16 17:56:00 crc kubenswrapper[5120]: I0316 17:56:00.151461 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="901b017e-aaf7-4c6a-9739-d7fa6140064d" containerName="extract-utilities" Mar 16 17:56:00 crc kubenswrapper[5120]: I0316 17:56:00.151476 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="901b017e-aaf7-4c6a-9739-d7fa6140064d" containerName="extract-utilities" Mar 16 17:56:00 crc kubenswrapper[5120]: I0316 17:56:00.151510 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="901b017e-aaf7-4c6a-9739-d7fa6140064d" containerName="extract-content" Mar 16 17:56:00 crc kubenswrapper[5120]: I0316 17:56:00.151523 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="901b017e-aaf7-4c6a-9739-d7fa6140064d" containerName="extract-content" Mar 16 17:56:00 crc kubenswrapper[5120]: I0316 17:56:00.151820 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="901b017e-aaf7-4c6a-9739-d7fa6140064d" containerName="registry-server" Mar 16 17:56:00 crc kubenswrapper[5120]: I0316 17:56:00.164791 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561396-h5qx4"] Mar 16 17:56:00 crc kubenswrapper[5120]: I0316 17:56:00.164946 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561396-h5qx4" Mar 16 17:56:00 crc kubenswrapper[5120]: I0316 17:56:00.168068 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"openshift-service-ca.crt\"" Mar 16 17:56:00 crc kubenswrapper[5120]: I0316 17:56:00.168136 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-infra\"/\"csr-approver-sa-dockercfg-x2nsz\"" Mar 16 17:56:00 crc kubenswrapper[5120]: I0316 17:56:00.168089 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"kube-root-ca.crt\"" Mar 16 17:56:00 crc kubenswrapper[5120]: I0316 17:56:00.307331 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdq86\" (UniqueName: \"kubernetes.io/projected/4996e4b4-c43e-48e7-8715-e32474943ac9-kube-api-access-rdq86\") pod \"auto-csr-approver-29561396-h5qx4\" (UID: \"4996e4b4-c43e-48e7-8715-e32474943ac9\") " pod="openshift-infra/auto-csr-approver-29561396-h5qx4" Mar 16 17:56:00 crc kubenswrapper[5120]: I0316 17:56:00.410302 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rdq86\" (UniqueName: \"kubernetes.io/projected/4996e4b4-c43e-48e7-8715-e32474943ac9-kube-api-access-rdq86\") pod \"auto-csr-approver-29561396-h5qx4\" (UID: \"4996e4b4-c43e-48e7-8715-e32474943ac9\") " pod="openshift-infra/auto-csr-approver-29561396-h5qx4" Mar 16 17:56:00 crc kubenswrapper[5120]: I0316 17:56:00.429667 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdq86\" (UniqueName: \"kubernetes.io/projected/4996e4b4-c43e-48e7-8715-e32474943ac9-kube-api-access-rdq86\") pod \"auto-csr-approver-29561396-h5qx4\" (UID: \"4996e4b4-c43e-48e7-8715-e32474943ac9\") " pod="openshift-infra/auto-csr-approver-29561396-h5qx4" Mar 16 17:56:00 crc kubenswrapper[5120]: I0316 17:56:00.482028 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561396-h5qx4" Mar 16 17:56:00 crc kubenswrapper[5120]: I0316 17:56:00.971674 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561396-h5qx4"] Mar 16 17:56:01 crc kubenswrapper[5120]: I0316 17:56:01.664308 5120 scope.go:117] "RemoveContainer" containerID="3c36926311be0b5863354f251394b54af60074edc1c497847c55048c053dc819" Mar 16 17:56:01 crc kubenswrapper[5120]: E0316 17:56:01.664889 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 17:56:01 crc kubenswrapper[5120]: I0316 17:56:01.684481 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561396-h5qx4" event={"ID":"4996e4b4-c43e-48e7-8715-e32474943ac9","Type":"ContainerStarted","Data":"083da6f0a784a7ef674151902801c2e31b495b30ba3c03f3778c065196713327"} Mar 16 17:56:02 crc kubenswrapper[5120]: I0316 17:56:02.694080 5120 generic.go:358] "Generic (PLEG): container finished" podID="4996e4b4-c43e-48e7-8715-e32474943ac9" containerID="e0dd0bb9b057d5de7368a68508b238703b075039a34efbaf8d2fede63c22c393" exitCode=0 Mar 16 17:56:02 crc kubenswrapper[5120]: I0316 17:56:02.694133 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561396-h5qx4" event={"ID":"4996e4b4-c43e-48e7-8715-e32474943ac9","Type":"ContainerDied","Data":"e0dd0bb9b057d5de7368a68508b238703b075039a34efbaf8d2fede63c22c393"} Mar 16 17:56:04 crc kubenswrapper[5120]: I0316 17:56:04.031843 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561396-h5qx4" Mar 16 17:56:04 crc kubenswrapper[5120]: I0316 17:56:04.133067 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rdq86\" (UniqueName: \"kubernetes.io/projected/4996e4b4-c43e-48e7-8715-e32474943ac9-kube-api-access-rdq86\") pod \"4996e4b4-c43e-48e7-8715-e32474943ac9\" (UID: \"4996e4b4-c43e-48e7-8715-e32474943ac9\") " Mar 16 17:56:04 crc kubenswrapper[5120]: I0316 17:56:04.141461 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4996e4b4-c43e-48e7-8715-e32474943ac9-kube-api-access-rdq86" (OuterVolumeSpecName: "kube-api-access-rdq86") pod "4996e4b4-c43e-48e7-8715-e32474943ac9" (UID: "4996e4b4-c43e-48e7-8715-e32474943ac9"). InnerVolumeSpecName "kube-api-access-rdq86". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:56:04 crc kubenswrapper[5120]: I0316 17:56:04.235525 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rdq86\" (UniqueName: \"kubernetes.io/projected/4996e4b4-c43e-48e7-8715-e32474943ac9-kube-api-access-rdq86\") on node \"crc\" DevicePath \"\"" Mar 16 17:56:04 crc kubenswrapper[5120]: I0316 17:56:04.716423 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561396-h5qx4" Mar 16 17:56:04 crc kubenswrapper[5120]: I0316 17:56:04.716451 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561396-h5qx4" event={"ID":"4996e4b4-c43e-48e7-8715-e32474943ac9","Type":"ContainerDied","Data":"083da6f0a784a7ef674151902801c2e31b495b30ba3c03f3778c065196713327"} Mar 16 17:56:04 crc kubenswrapper[5120]: I0316 17:56:04.716491 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="083da6f0a784a7ef674151902801c2e31b495b30ba3c03f3778c065196713327" Mar 16 17:56:05 crc kubenswrapper[5120]: I0316 17:56:05.113260 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-infra/auto-csr-approver-29561390-zql55"] Mar 16 17:56:05 crc kubenswrapper[5120]: I0316 17:56:05.119704 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-infra/auto-csr-approver-29561390-zql55"] Mar 16 17:56:06 crc kubenswrapper[5120]: I0316 17:56:06.676126 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ea959e8-d3b9-4d8c-915a-c771aea6a07d" path="/var/lib/kubelet/pods/5ea959e8-d3b9-4d8c-915a-c771aea6a07d/volumes" Mar 16 17:56:07 crc kubenswrapper[5120]: E0316 17:56:07.743532 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1119089 actualBytes=10240 Mar 16 17:56:16 crc kubenswrapper[5120]: I0316 17:56:16.664409 5120 scope.go:117] "RemoveContainer" containerID="3c36926311be0b5863354f251394b54af60074edc1c497847c55048c053dc819" Mar 16 17:56:16 crc kubenswrapper[5120]: E0316 17:56:16.665397 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 17:56:30 crc kubenswrapper[5120]: I0316 17:56:30.664560 5120 scope.go:117] "RemoveContainer" containerID="3c36926311be0b5863354f251394b54af60074edc1c497847c55048c053dc819" Mar 16 17:56:30 crc kubenswrapper[5120]: E0316 17:56:30.666027 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 17:56:37 crc kubenswrapper[5120]: I0316 17:56:37.105704 5120 scope.go:117] "RemoveContainer" containerID="ebe8d75c9ef433634056a5e2b879abfd9f8442e589e6bb5029eef67e9515be6e" Mar 16 17:56:44 crc kubenswrapper[5120]: I0316 17:56:44.663391 5120 scope.go:117] "RemoveContainer" containerID="3c36926311be0b5863354f251394b54af60074edc1c497847c55048c053dc819" Mar 16 17:56:44 crc kubenswrapper[5120]: E0316 17:56:44.665303 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 17:56:48 crc kubenswrapper[5120]: I0316 17:56:48.181664 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-v822j_ac55471d-4e42-475f-a082-50f611571482/kube-multus/0.log" Mar 16 17:56:48 crc kubenswrapper[5120]: I0316 17:56:48.193902 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-crc_9f0bc7fcb0822a2c13eb2d22cd8c0641/kube-controller-manager/0.log" Mar 16 17:56:48 crc kubenswrapper[5120]: I0316 17:56:48.465958 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-v822j_ac55471d-4e42-475f-a082-50f611571482/kube-multus/0.log" Mar 16 17:56:48 crc kubenswrapper[5120]: I0316 17:56:48.470120 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-crc_9f0bc7fcb0822a2c13eb2d22cd8c0641/kube-controller-manager/0.log" Mar 16 17:56:59 crc kubenswrapper[5120]: I0316 17:56:59.664222 5120 scope.go:117] "RemoveContainer" containerID="3c36926311be0b5863354f251394b54af60074edc1c497847c55048c053dc819" Mar 16 17:57:00 crc kubenswrapper[5120]: I0316 17:57:00.214630 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" event={"ID":"e2275cb4-4905-4d66-a87e-8010120db2bd","Type":"ContainerStarted","Data":"0caad9b53f7bfee276eeaee2e5b2b26df47661833c6091b93cdf0d452973d691"} Mar 16 17:57:07 crc kubenswrapper[5120]: E0316 17:57:07.889452 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1118708 actualBytes=10240 Mar 16 17:58:00 crc kubenswrapper[5120]: I0316 17:58:00.147454 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-infra/auto-csr-approver-29561398-986wm"] Mar 16 17:58:00 crc kubenswrapper[5120]: I0316 17:58:00.149812 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4996e4b4-c43e-48e7-8715-e32474943ac9" containerName="oc" Mar 16 17:58:00 crc kubenswrapper[5120]: I0316 17:58:00.149848 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="4996e4b4-c43e-48e7-8715-e32474943ac9" containerName="oc" Mar 16 17:58:00 crc kubenswrapper[5120]: I0316 17:58:00.150395 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="4996e4b4-c43e-48e7-8715-e32474943ac9" containerName="oc" Mar 16 17:58:00 crc kubenswrapper[5120]: I0316 17:58:00.161360 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561398-986wm"] Mar 16 17:58:00 crc kubenswrapper[5120]: I0316 17:58:00.161525 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561398-986wm" Mar 16 17:58:00 crc kubenswrapper[5120]: I0316 17:58:00.166160 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"kube-root-ca.crt\"" Mar 16 17:58:00 crc kubenswrapper[5120]: I0316 17:58:00.166460 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"openshift-service-ca.crt\"" Mar 16 17:58:00 crc kubenswrapper[5120]: I0316 17:58:00.167835 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-infra\"/\"csr-approver-sa-dockercfg-x2nsz\"" Mar 16 17:58:00 crc kubenswrapper[5120]: I0316 17:58:00.308289 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vs7w\" (UniqueName: \"kubernetes.io/projected/1b049008-ff3e-4850-871e-31c2bae44307-kube-api-access-2vs7w\") pod \"auto-csr-approver-29561398-986wm\" (UID: \"1b049008-ff3e-4850-871e-31c2bae44307\") " pod="openshift-infra/auto-csr-approver-29561398-986wm" Mar 16 17:58:00 crc kubenswrapper[5120]: I0316 17:58:00.411040 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2vs7w\" (UniqueName: \"kubernetes.io/projected/1b049008-ff3e-4850-871e-31c2bae44307-kube-api-access-2vs7w\") pod \"auto-csr-approver-29561398-986wm\" (UID: \"1b049008-ff3e-4850-871e-31c2bae44307\") " pod="openshift-infra/auto-csr-approver-29561398-986wm" Mar 16 17:58:00 crc kubenswrapper[5120]: I0316 17:58:00.441519 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vs7w\" (UniqueName: \"kubernetes.io/projected/1b049008-ff3e-4850-871e-31c2bae44307-kube-api-access-2vs7w\") pod \"auto-csr-approver-29561398-986wm\" (UID: \"1b049008-ff3e-4850-871e-31c2bae44307\") " pod="openshift-infra/auto-csr-approver-29561398-986wm" Mar 16 17:58:00 crc kubenswrapper[5120]: I0316 17:58:00.490121 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561398-986wm" Mar 16 17:58:00 crc kubenswrapper[5120]: I0316 17:58:00.917692 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561398-986wm"] Mar 16 17:58:01 crc kubenswrapper[5120]: I0316 17:58:01.818696 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561398-986wm" event={"ID":"1b049008-ff3e-4850-871e-31c2bae44307","Type":"ContainerStarted","Data":"0af94e1037d00181cfe5b1427b7bfa228f248fce348e194559ef1aa0c48006c7"} Mar 16 17:58:02 crc kubenswrapper[5120]: I0316 17:58:02.833357 5120 generic.go:358] "Generic (PLEG): container finished" podID="1b049008-ff3e-4850-871e-31c2bae44307" containerID="14d66d53efe1b85104e886b62aa085212197a0b83ab2c630931881e23f5743a4" exitCode=0 Mar 16 17:58:02 crc kubenswrapper[5120]: I0316 17:58:02.833433 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561398-986wm" event={"ID":"1b049008-ff3e-4850-871e-31c2bae44307","Type":"ContainerDied","Data":"14d66d53efe1b85104e886b62aa085212197a0b83ab2c630931881e23f5743a4"} Mar 16 17:58:04 crc kubenswrapper[5120]: I0316 17:58:04.108782 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561398-986wm" Mar 16 17:58:04 crc kubenswrapper[5120]: I0316 17:58:04.211720 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2vs7w\" (UniqueName: \"kubernetes.io/projected/1b049008-ff3e-4850-871e-31c2bae44307-kube-api-access-2vs7w\") pod \"1b049008-ff3e-4850-871e-31c2bae44307\" (UID: \"1b049008-ff3e-4850-871e-31c2bae44307\") " Mar 16 17:58:04 crc kubenswrapper[5120]: I0316 17:58:04.223289 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b049008-ff3e-4850-871e-31c2bae44307-kube-api-access-2vs7w" (OuterVolumeSpecName: "kube-api-access-2vs7w") pod "1b049008-ff3e-4850-871e-31c2bae44307" (UID: "1b049008-ff3e-4850-871e-31c2bae44307"). InnerVolumeSpecName "kube-api-access-2vs7w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 17:58:04 crc kubenswrapper[5120]: I0316 17:58:04.314497 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2vs7w\" (UniqueName: \"kubernetes.io/projected/1b049008-ff3e-4850-871e-31c2bae44307-kube-api-access-2vs7w\") on node \"crc\" DevicePath \"\"" Mar 16 17:58:04 crc kubenswrapper[5120]: I0316 17:58:04.850858 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561398-986wm" event={"ID":"1b049008-ff3e-4850-871e-31c2bae44307","Type":"ContainerDied","Data":"0af94e1037d00181cfe5b1427b7bfa228f248fce348e194559ef1aa0c48006c7"} Mar 16 17:58:04 crc kubenswrapper[5120]: I0316 17:58:04.850905 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0af94e1037d00181cfe5b1427b7bfa228f248fce348e194559ef1aa0c48006c7" Mar 16 17:58:04 crc kubenswrapper[5120]: I0316 17:58:04.850863 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561398-986wm" Mar 16 17:58:05 crc kubenswrapper[5120]: I0316 17:58:05.181942 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-infra/auto-csr-approver-29561392-sbnvb"] Mar 16 17:58:05 crc kubenswrapper[5120]: I0316 17:58:05.187466 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-infra/auto-csr-approver-29561392-sbnvb"] Mar 16 17:58:06 crc kubenswrapper[5120]: I0316 17:58:06.680156 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="96328348-2ca5-4770-bf80-346117cff71e" path="/var/lib/kubelet/pods/96328348-2ca5-4770-bf80-346117cff71e/volumes" Mar 16 17:58:07 crc kubenswrapper[5120]: E0316 17:58:07.662106 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1117766 actualBytes=10240 Mar 16 17:58:37 crc kubenswrapper[5120]: I0316 17:58:37.267294 5120 scope.go:117] "RemoveContainer" containerID="058879abeed861c1446b114101c18de7114a0adb68e8ed7696f0c8756202f3c1" Mar 16 17:59:07 crc kubenswrapper[5120]: E0316 17:59:07.548137 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1117764 actualBytes=10240 Mar 16 17:59:22 crc kubenswrapper[5120]: I0316 17:59:22.008587 5120 patch_prober.go:28] interesting pod/machine-config-daemon-7bf76 container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 17:59:22 crc kubenswrapper[5120]: I0316 17:59:22.009464 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 17:59:31 crc kubenswrapper[5120]: I0316 17:59:31.037739 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keystone-kuttl-tests/keystone-89cf-account-create-update-852nf"] Mar 16 17:59:31 crc kubenswrapper[5120]: I0316 17:59:31.051721 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keystone-kuttl-tests/keystone-db-create-rmq2d"] Mar 16 17:59:31 crc kubenswrapper[5120]: I0316 17:59:31.058363 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["keystone-kuttl-tests/keystone-89cf-account-create-update-852nf"] Mar 16 17:59:31 crc kubenswrapper[5120]: I0316 17:59:31.064374 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["keystone-kuttl-tests/keystone-db-create-rmq2d"] Mar 16 17:59:32 crc kubenswrapper[5120]: I0316 17:59:32.673520 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="88ad41ed-1892-4bb8-8877-5a42dea57445" path="/var/lib/kubelet/pods/88ad41ed-1892-4bb8-8877-5a42dea57445/volumes" Mar 16 17:59:32 crc kubenswrapper[5120]: I0316 17:59:32.674333 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e7fb8066-4dd0-4f27-8d5e-891e01899c93" path="/var/lib/kubelet/pods/e7fb8066-4dd0-4f27-8d5e-891e01899c93/volumes" Mar 16 17:59:37 crc kubenswrapper[5120]: I0316 17:59:37.031771 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keystone-kuttl-tests/keystone-db-sync-g7676"] Mar 16 17:59:37 crc kubenswrapper[5120]: I0316 17:59:37.059561 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["keystone-kuttl-tests/keystone-db-sync-g7676"] Mar 16 17:59:37 crc kubenswrapper[5120]: I0316 17:59:37.416596 5120 scope.go:117] "RemoveContainer" containerID="d8edd17437990f3c15c31e8e69adc024ccd681c00ab828102cd8f20d5419f467" Mar 16 17:59:37 crc kubenswrapper[5120]: I0316 17:59:37.439502 5120 scope.go:117] "RemoveContainer" containerID="d331541b1b2f943abfdc4e795363ba91ce57b9f4e091d52376056ba5aa69cbea" Mar 16 17:59:38 crc kubenswrapper[5120]: I0316 17:59:38.681126 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c6cc45db-b582-4109-8b62-399fddf30c4b" path="/var/lib/kubelet/pods/c6cc45db-b582-4109-8b62-399fddf30c4b/volumes" Mar 16 17:59:43 crc kubenswrapper[5120]: I0316 17:59:43.032281 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keystone-kuttl-tests/keystone-bootstrap-kcnfj"] Mar 16 17:59:43 crc kubenswrapper[5120]: I0316 17:59:43.039059 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["keystone-kuttl-tests/keystone-bootstrap-kcnfj"] Mar 16 17:59:44 crc kubenswrapper[5120]: I0316 17:59:44.673203 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b9388809-1afc-49f8-ac55-9aec596779e5" path="/var/lib/kubelet/pods/b9388809-1afc-49f8-ac55-9aec596779e5/volumes" Mar 16 17:59:52 crc kubenswrapper[5120]: I0316 17:59:52.008515 5120 patch_prober.go:28] interesting pod/machine-config-daemon-7bf76 container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 17:59:52 crc kubenswrapper[5120]: I0316 17:59:52.009102 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 18:00:00 crc kubenswrapper[5120]: I0316 18:00:00.157860 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-infra/auto-csr-approver-29561400-gmrbx"] Mar 16 18:00:00 crc kubenswrapper[5120]: I0316 18:00:00.165546 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b049008-ff3e-4850-871e-31c2bae44307" containerName="oc" Mar 16 18:00:00 crc kubenswrapper[5120]: I0316 18:00:00.167073 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b049008-ff3e-4850-871e-31c2bae44307" containerName="oc" Mar 16 18:00:00 crc kubenswrapper[5120]: I0316 18:00:00.167377 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1b049008-ff3e-4850-871e-31c2bae44307" containerName="oc" Mar 16 18:00:00 crc kubenswrapper[5120]: I0316 18:00:00.176065 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29561400-w9wk9"] Mar 16 18:00:00 crc kubenswrapper[5120]: I0316 18:00:00.176237 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561400-gmrbx" Mar 16 18:00:00 crc kubenswrapper[5120]: I0316 18:00:00.178268 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-infra\"/\"csr-approver-sa-dockercfg-x2nsz\"" Mar 16 18:00:00 crc kubenswrapper[5120]: I0316 18:00:00.178952 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"kube-root-ca.crt\"" Mar 16 18:00:00 crc kubenswrapper[5120]: I0316 18:00:00.179284 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"openshift-service-ca.crt\"" Mar 16 18:00:00 crc kubenswrapper[5120]: I0316 18:00:00.180670 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561400-gmrbx"] Mar 16 18:00:00 crc kubenswrapper[5120]: I0316 18:00:00.180702 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29561400-w9wk9"] Mar 16 18:00:00 crc kubenswrapper[5120]: I0316 18:00:00.180815 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29561400-w9wk9" Mar 16 18:00:00 crc kubenswrapper[5120]: I0316 18:00:00.182448 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operator-lifecycle-manager\"/\"collect-profiles-dockercfg-vfqp6\"" Mar 16 18:00:00 crc kubenswrapper[5120]: I0316 18:00:00.183270 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operator-lifecycle-manager\"/\"collect-profiles-config\"" Mar 16 18:00:00 crc kubenswrapper[5120]: I0316 18:00:00.240329 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rts9r\" (UniqueName: \"kubernetes.io/projected/302faf28-bbc3-4105-862e-bbbe3a1d159d-kube-api-access-rts9r\") pod \"auto-csr-approver-29561400-gmrbx\" (UID: \"302faf28-bbc3-4105-862e-bbbe3a1d159d\") " pod="openshift-infra/auto-csr-approver-29561400-gmrbx" Mar 16 18:00:00 crc kubenswrapper[5120]: I0316 18:00:00.240420 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e903a6dc-2962-4bd4-b8c3-0b561bff85b8-config-volume\") pod \"collect-profiles-29561400-w9wk9\" (UID: \"e903a6dc-2962-4bd4-b8c3-0b561bff85b8\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561400-w9wk9" Mar 16 18:00:00 crc kubenswrapper[5120]: I0316 18:00:00.240451 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/e903a6dc-2962-4bd4-b8c3-0b561bff85b8-secret-volume\") pod \"collect-profiles-29561400-w9wk9\" (UID: \"e903a6dc-2962-4bd4-b8c3-0b561bff85b8\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561400-w9wk9" Mar 16 18:00:00 crc kubenswrapper[5120]: I0316 18:00:00.241313 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rwdg\" (UniqueName: \"kubernetes.io/projected/e903a6dc-2962-4bd4-b8c3-0b561bff85b8-kube-api-access-9rwdg\") pod \"collect-profiles-29561400-w9wk9\" (UID: \"e903a6dc-2962-4bd4-b8c3-0b561bff85b8\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561400-w9wk9" Mar 16 18:00:00 crc kubenswrapper[5120]: I0316 18:00:00.344295 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9rwdg\" (UniqueName: \"kubernetes.io/projected/e903a6dc-2962-4bd4-b8c3-0b561bff85b8-kube-api-access-9rwdg\") pod \"collect-profiles-29561400-w9wk9\" (UID: \"e903a6dc-2962-4bd4-b8c3-0b561bff85b8\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561400-w9wk9" Mar 16 18:00:00 crc kubenswrapper[5120]: I0316 18:00:00.344581 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rts9r\" (UniqueName: \"kubernetes.io/projected/302faf28-bbc3-4105-862e-bbbe3a1d159d-kube-api-access-rts9r\") pod \"auto-csr-approver-29561400-gmrbx\" (UID: \"302faf28-bbc3-4105-862e-bbbe3a1d159d\") " pod="openshift-infra/auto-csr-approver-29561400-gmrbx" Mar 16 18:00:00 crc kubenswrapper[5120]: I0316 18:00:00.344710 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e903a6dc-2962-4bd4-b8c3-0b561bff85b8-config-volume\") pod \"collect-profiles-29561400-w9wk9\" (UID: \"e903a6dc-2962-4bd4-b8c3-0b561bff85b8\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561400-w9wk9" Mar 16 18:00:00 crc kubenswrapper[5120]: I0316 18:00:00.344796 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/e903a6dc-2962-4bd4-b8c3-0b561bff85b8-secret-volume\") pod \"collect-profiles-29561400-w9wk9\" (UID: \"e903a6dc-2962-4bd4-b8c3-0b561bff85b8\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561400-w9wk9" Mar 16 18:00:00 crc kubenswrapper[5120]: I0316 18:00:00.345934 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e903a6dc-2962-4bd4-b8c3-0b561bff85b8-config-volume\") pod \"collect-profiles-29561400-w9wk9\" (UID: \"e903a6dc-2962-4bd4-b8c3-0b561bff85b8\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561400-w9wk9" Mar 16 18:00:00 crc kubenswrapper[5120]: I0316 18:00:00.354901 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/e903a6dc-2962-4bd4-b8c3-0b561bff85b8-secret-volume\") pod \"collect-profiles-29561400-w9wk9\" (UID: \"e903a6dc-2962-4bd4-b8c3-0b561bff85b8\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561400-w9wk9" Mar 16 18:00:00 crc kubenswrapper[5120]: I0316 18:00:00.361126 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rts9r\" (UniqueName: \"kubernetes.io/projected/302faf28-bbc3-4105-862e-bbbe3a1d159d-kube-api-access-rts9r\") pod \"auto-csr-approver-29561400-gmrbx\" (UID: \"302faf28-bbc3-4105-862e-bbbe3a1d159d\") " pod="openshift-infra/auto-csr-approver-29561400-gmrbx" Mar 16 18:00:00 crc kubenswrapper[5120]: I0316 18:00:00.366536 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rwdg\" (UniqueName: \"kubernetes.io/projected/e903a6dc-2962-4bd4-b8c3-0b561bff85b8-kube-api-access-9rwdg\") pod \"collect-profiles-29561400-w9wk9\" (UID: \"e903a6dc-2962-4bd4-b8c3-0b561bff85b8\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561400-w9wk9" Mar 16 18:00:00 crc kubenswrapper[5120]: I0316 18:00:00.509975 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561400-gmrbx" Mar 16 18:00:00 crc kubenswrapper[5120]: I0316 18:00:00.520549 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29561400-w9wk9" Mar 16 18:00:00 crc kubenswrapper[5120]: I0316 18:00:00.987677 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561400-gmrbx"] Mar 16 18:00:00 crc kubenswrapper[5120]: I0316 18:00:00.996439 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29561400-w9wk9"] Mar 16 18:00:00 crc kubenswrapper[5120]: I0316 18:00:00.999305 5120 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Mar 16 18:00:01 crc kubenswrapper[5120]: W0316 18:00:01.012163 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode903a6dc_2962_4bd4_b8c3_0b561bff85b8.slice/crio-3b00192f88d0d421a053190fd4e6eede2e9eca3a61e0543c7b895ca6cf93c222 WatchSource:0}: Error finding container 3b00192f88d0d421a053190fd4e6eede2e9eca3a61e0543c7b895ca6cf93c222: Status 404 returned error can't find the container with id 3b00192f88d0d421a053190fd4e6eede2e9eca3a61e0543c7b895ca6cf93c222 Mar 16 18:00:01 crc kubenswrapper[5120]: I0316 18:00:01.898334 5120 generic.go:358] "Generic (PLEG): container finished" podID="e903a6dc-2962-4bd4-b8c3-0b561bff85b8" containerID="48b7d53b3c3c960eba8d5e8d6d4022e8ab9643819bbc6888d3b1dbf833415668" exitCode=0 Mar 16 18:00:01 crc kubenswrapper[5120]: I0316 18:00:01.898461 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/collect-profiles-29561400-w9wk9" event={"ID":"e903a6dc-2962-4bd4-b8c3-0b561bff85b8","Type":"ContainerDied","Data":"48b7d53b3c3c960eba8d5e8d6d4022e8ab9643819bbc6888d3b1dbf833415668"} Mar 16 18:00:01 crc kubenswrapper[5120]: I0316 18:00:01.898823 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/collect-profiles-29561400-w9wk9" event={"ID":"e903a6dc-2962-4bd4-b8c3-0b561bff85b8","Type":"ContainerStarted","Data":"3b00192f88d0d421a053190fd4e6eede2e9eca3a61e0543c7b895ca6cf93c222"} Mar 16 18:00:01 crc kubenswrapper[5120]: I0316 18:00:01.901571 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561400-gmrbx" event={"ID":"302faf28-bbc3-4105-862e-bbbe3a1d159d","Type":"ContainerStarted","Data":"0160ab5260c4cfc18a9f08b9729ad5203951961f0a8e254bb6903ea657c46fc6"} Mar 16 18:00:03 crc kubenswrapper[5120]: I0316 18:00:03.162586 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29561400-w9wk9" Mar 16 18:00:03 crc kubenswrapper[5120]: I0316 18:00:03.311168 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/e903a6dc-2962-4bd4-b8c3-0b561bff85b8-secret-volume\") pod \"e903a6dc-2962-4bd4-b8c3-0b561bff85b8\" (UID: \"e903a6dc-2962-4bd4-b8c3-0b561bff85b8\") " Mar 16 18:00:03 crc kubenswrapper[5120]: I0316 18:00:03.311409 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9rwdg\" (UniqueName: \"kubernetes.io/projected/e903a6dc-2962-4bd4-b8c3-0b561bff85b8-kube-api-access-9rwdg\") pod \"e903a6dc-2962-4bd4-b8c3-0b561bff85b8\" (UID: \"e903a6dc-2962-4bd4-b8c3-0b561bff85b8\") " Mar 16 18:00:03 crc kubenswrapper[5120]: I0316 18:00:03.311459 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e903a6dc-2962-4bd4-b8c3-0b561bff85b8-config-volume\") pod \"e903a6dc-2962-4bd4-b8c3-0b561bff85b8\" (UID: \"e903a6dc-2962-4bd4-b8c3-0b561bff85b8\") " Mar 16 18:00:03 crc kubenswrapper[5120]: I0316 18:00:03.312111 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e903a6dc-2962-4bd4-b8c3-0b561bff85b8-config-volume" (OuterVolumeSpecName: "config-volume") pod "e903a6dc-2962-4bd4-b8c3-0b561bff85b8" (UID: "e903a6dc-2962-4bd4-b8c3-0b561bff85b8"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 18:00:03 crc kubenswrapper[5120]: I0316 18:00:03.312652 5120 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e903a6dc-2962-4bd4-b8c3-0b561bff85b8-config-volume\") on node \"crc\" DevicePath \"\"" Mar 16 18:00:03 crc kubenswrapper[5120]: I0316 18:00:03.317072 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e903a6dc-2962-4bd4-b8c3-0b561bff85b8-kube-api-access-9rwdg" (OuterVolumeSpecName: "kube-api-access-9rwdg") pod "e903a6dc-2962-4bd4-b8c3-0b561bff85b8" (UID: "e903a6dc-2962-4bd4-b8c3-0b561bff85b8"). InnerVolumeSpecName "kube-api-access-9rwdg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 18:00:03 crc kubenswrapper[5120]: I0316 18:00:03.318491 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e903a6dc-2962-4bd4-b8c3-0b561bff85b8-secret-volume" (OuterVolumeSpecName: "secret-volume") pod "e903a6dc-2962-4bd4-b8c3-0b561bff85b8" (UID: "e903a6dc-2962-4bd4-b8c3-0b561bff85b8"). InnerVolumeSpecName "secret-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 18:00:03 crc kubenswrapper[5120]: I0316 18:00:03.414336 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9rwdg\" (UniqueName: \"kubernetes.io/projected/e903a6dc-2962-4bd4-b8c3-0b561bff85b8-kube-api-access-9rwdg\") on node \"crc\" DevicePath \"\"" Mar 16 18:00:03 crc kubenswrapper[5120]: I0316 18:00:03.414364 5120 reconciler_common.go:299] "Volume detached for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/e903a6dc-2962-4bd4-b8c3-0b561bff85b8-secret-volume\") on node \"crc\" DevicePath \"\"" Mar 16 18:00:03 crc kubenswrapper[5120]: I0316 18:00:03.925790 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/collect-profiles-29561400-w9wk9" event={"ID":"e903a6dc-2962-4bd4-b8c3-0b561bff85b8","Type":"ContainerDied","Data":"3b00192f88d0d421a053190fd4e6eede2e9eca3a61e0543c7b895ca6cf93c222"} Mar 16 18:00:03 crc kubenswrapper[5120]: I0316 18:00:03.925826 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3b00192f88d0d421a053190fd4e6eede2e9eca3a61e0543c7b895ca6cf93c222" Mar 16 18:00:03 crc kubenswrapper[5120]: I0316 18:00:03.925892 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29561400-w9wk9" Mar 16 18:00:04 crc kubenswrapper[5120]: I0316 18:00:04.235128 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29561355-cp2zm"] Mar 16 18:00:04 crc kubenswrapper[5120]: I0316 18:00:04.243981 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29561355-cp2zm"] Mar 16 18:00:04 crc kubenswrapper[5120]: I0316 18:00:04.672211 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ffa780f-a662-4e17-be7b-8cb2d4e75b29" path="/var/lib/kubelet/pods/6ffa780f-a662-4e17-be7b-8cb2d4e75b29/volumes" Mar 16 18:00:05 crc kubenswrapper[5120]: I0316 18:00:05.943226 5120 generic.go:358] "Generic (PLEG): container finished" podID="302faf28-bbc3-4105-862e-bbbe3a1d159d" containerID="68804700f5423b3d532fa3e76f5a8623424efbbf8c02fb3455b0268ce49b986e" exitCode=0 Mar 16 18:00:05 crc kubenswrapper[5120]: I0316 18:00:05.943304 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561400-gmrbx" event={"ID":"302faf28-bbc3-4105-862e-bbbe3a1d159d","Type":"ContainerDied","Data":"68804700f5423b3d532fa3e76f5a8623424efbbf8c02fb3455b0268ce49b986e"} Mar 16 18:00:07 crc kubenswrapper[5120]: I0316 18:00:07.234213 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561400-gmrbx" Mar 16 18:00:07 crc kubenswrapper[5120]: I0316 18:00:07.314571 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rts9r\" (UniqueName: \"kubernetes.io/projected/302faf28-bbc3-4105-862e-bbbe3a1d159d-kube-api-access-rts9r\") pod \"302faf28-bbc3-4105-862e-bbbe3a1d159d\" (UID: \"302faf28-bbc3-4105-862e-bbbe3a1d159d\") " Mar 16 18:00:07 crc kubenswrapper[5120]: I0316 18:00:07.332136 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/302faf28-bbc3-4105-862e-bbbe3a1d159d-kube-api-access-rts9r" (OuterVolumeSpecName: "kube-api-access-rts9r") pod "302faf28-bbc3-4105-862e-bbbe3a1d159d" (UID: "302faf28-bbc3-4105-862e-bbbe3a1d159d"). InnerVolumeSpecName "kube-api-access-rts9r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 18:00:07 crc kubenswrapper[5120]: I0316 18:00:07.417442 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rts9r\" (UniqueName: \"kubernetes.io/projected/302faf28-bbc3-4105-862e-bbbe3a1d159d-kube-api-access-rts9r\") on node \"crc\" DevicePath \"\"" Mar 16 18:00:07 crc kubenswrapper[5120]: E0316 18:00:07.692344 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1125679 actualBytes=10240 Mar 16 18:00:07 crc kubenswrapper[5120]: I0316 18:00:07.962969 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561400-gmrbx" Mar 16 18:00:07 crc kubenswrapper[5120]: I0316 18:00:07.962978 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561400-gmrbx" event={"ID":"302faf28-bbc3-4105-862e-bbbe3a1d159d","Type":"ContainerDied","Data":"0160ab5260c4cfc18a9f08b9729ad5203951961f0a8e254bb6903ea657c46fc6"} Mar 16 18:00:07 crc kubenswrapper[5120]: I0316 18:00:07.963029 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0160ab5260c4cfc18a9f08b9729ad5203951961f0a8e254bb6903ea657c46fc6" Mar 16 18:00:08 crc kubenswrapper[5120]: I0316 18:00:08.289486 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-infra/auto-csr-approver-29561394-2cwst"] Mar 16 18:00:08 crc kubenswrapper[5120]: I0316 18:00:08.294509 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-infra/auto-csr-approver-29561394-2cwst"] Mar 16 18:00:08 crc kubenswrapper[5120]: I0316 18:00:08.677171 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e101c71d-e07e-4686-87db-3c80cd56a85f" path="/var/lib/kubelet/pods/e101c71d-e07e-4686-87db-3c80cd56a85f/volumes" Mar 16 18:00:22 crc kubenswrapper[5120]: I0316 18:00:22.008519 5120 patch_prober.go:28] interesting pod/machine-config-daemon-7bf76 container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 18:00:22 crc kubenswrapper[5120]: I0316 18:00:22.009184 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 18:00:22 crc kubenswrapper[5120]: I0316 18:00:22.009274 5120 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" Mar 16 18:00:22 crc kubenswrapper[5120]: I0316 18:00:22.010340 5120 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="machine-config-daemon" containerStatusID={"Type":"cri-o","ID":"0caad9b53f7bfee276eeaee2e5b2b26df47661833c6091b93cdf0d452973d691"} pod="openshift-machine-config-operator/machine-config-daemon-7bf76" containerMessage="Container machine-config-daemon failed liveness probe, will be restarted" Mar 16 18:00:22 crc kubenswrapper[5120]: I0316 18:00:22.010451 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" containerID="cri-o://0caad9b53f7bfee276eeaee2e5b2b26df47661833c6091b93cdf0d452973d691" gracePeriod=600 Mar 16 18:00:23 crc kubenswrapper[5120]: I0316 18:00:23.105480 5120 generic.go:358] "Generic (PLEG): container finished" podID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerID="0caad9b53f7bfee276eeaee2e5b2b26df47661833c6091b93cdf0d452973d691" exitCode=0 Mar 16 18:00:23 crc kubenswrapper[5120]: I0316 18:00:23.107485 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" event={"ID":"e2275cb4-4905-4d66-a87e-8010120db2bd","Type":"ContainerDied","Data":"0caad9b53f7bfee276eeaee2e5b2b26df47661833c6091b93cdf0d452973d691"} Mar 16 18:00:23 crc kubenswrapper[5120]: I0316 18:00:23.107618 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" event={"ID":"e2275cb4-4905-4d66-a87e-8010120db2bd","Type":"ContainerStarted","Data":"fa578cadb98a23319854b9fc54966313bbc1cee64f90cc75e1f951be3cb08e36"} Mar 16 18:00:23 crc kubenswrapper[5120]: I0316 18:00:23.107698 5120 scope.go:117] "RemoveContainer" containerID="3c36926311be0b5863354f251394b54af60074edc1c497847c55048c053dc819" Mar 16 18:00:26 crc kubenswrapper[5120]: I0316 18:00:26.509125 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keystone-kuttl-tests/openstackclient"] Mar 16 18:00:26 crc kubenswrapper[5120]: I0316 18:00:26.509872 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="keystone-kuttl-tests/openstackclient" podUID="7ac6c65a-664a-4880-a424-d79e050e805b" containerName="openstackclient" containerID="cri-o://8567d11c10a82d6eb22de1da752d7bf610fb4bdb2795b0fe847e4e4729f35206" gracePeriod=30 Mar 16 18:00:26 crc kubenswrapper[5120]: I0316 18:00:26.953563 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/openstackclient" Mar 16 18:00:27 crc kubenswrapper[5120]: I0316 18:00:27.034938 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/7ac6c65a-664a-4880-a424-d79e050e805b-openstack-config-secret\") pod \"7ac6c65a-664a-4880-a424-d79e050e805b\" (UID: \"7ac6c65a-664a-4880-a424-d79e050e805b\") " Mar 16 18:00:27 crc kubenswrapper[5120]: I0316 18:00:27.035245 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/7ac6c65a-664a-4880-a424-d79e050e805b-openstack-config\") pod \"7ac6c65a-664a-4880-a424-d79e050e805b\" (UID: \"7ac6c65a-664a-4880-a424-d79e050e805b\") " Mar 16 18:00:27 crc kubenswrapper[5120]: I0316 18:00:27.035561 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6v794\" (UniqueName: \"kubernetes.io/projected/7ac6c65a-664a-4880-a424-d79e050e805b-kube-api-access-6v794\") pod \"7ac6c65a-664a-4880-a424-d79e050e805b\" (UID: \"7ac6c65a-664a-4880-a424-d79e050e805b\") " Mar 16 18:00:27 crc kubenswrapper[5120]: I0316 18:00:27.043033 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ac6c65a-664a-4880-a424-d79e050e805b-kube-api-access-6v794" (OuterVolumeSpecName: "kube-api-access-6v794") pod "7ac6c65a-664a-4880-a424-d79e050e805b" (UID: "7ac6c65a-664a-4880-a424-d79e050e805b"). InnerVolumeSpecName "kube-api-access-6v794". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 18:00:27 crc kubenswrapper[5120]: I0316 18:00:27.053456 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7ac6c65a-664a-4880-a424-d79e050e805b-openstack-config" (OuterVolumeSpecName: "openstack-config") pod "7ac6c65a-664a-4880-a424-d79e050e805b" (UID: "7ac6c65a-664a-4880-a424-d79e050e805b"). InnerVolumeSpecName "openstack-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 18:00:27 crc kubenswrapper[5120]: I0316 18:00:27.061681 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7ac6c65a-664a-4880-a424-d79e050e805b-openstack-config-secret" (OuterVolumeSpecName: "openstack-config-secret") pod "7ac6c65a-664a-4880-a424-d79e050e805b" (UID: "7ac6c65a-664a-4880-a424-d79e050e805b"). InnerVolumeSpecName "openstack-config-secret". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 18:00:27 crc kubenswrapper[5120]: I0316 18:00:27.138283 5120 reconciler_common.go:299] "Volume detached for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/7ac6c65a-664a-4880-a424-d79e050e805b-openstack-config\") on node \"crc\" DevicePath \"\"" Mar 16 18:00:27 crc kubenswrapper[5120]: I0316 18:00:27.138317 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6v794\" (UniqueName: \"kubernetes.io/projected/7ac6c65a-664a-4880-a424-d79e050e805b-kube-api-access-6v794\") on node \"crc\" DevicePath \"\"" Mar 16 18:00:27 crc kubenswrapper[5120]: I0316 18:00:27.138328 5120 reconciler_common.go:299] "Volume detached for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/7ac6c65a-664a-4880-a424-d79e050e805b-openstack-config-secret\") on node \"crc\" DevicePath \"\"" Mar 16 18:00:27 crc kubenswrapper[5120]: I0316 18:00:27.147917 5120 generic.go:358] "Generic (PLEG): container finished" podID="7ac6c65a-664a-4880-a424-d79e050e805b" containerID="8567d11c10a82d6eb22de1da752d7bf610fb4bdb2795b0fe847e4e4729f35206" exitCode=143 Mar 16 18:00:27 crc kubenswrapper[5120]: I0316 18:00:27.147965 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/openstackclient" event={"ID":"7ac6c65a-664a-4880-a424-d79e050e805b","Type":"ContainerDied","Data":"8567d11c10a82d6eb22de1da752d7bf610fb4bdb2795b0fe847e4e4729f35206"} Mar 16 18:00:27 crc kubenswrapper[5120]: I0316 18:00:27.147999 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/openstackclient" event={"ID":"7ac6c65a-664a-4880-a424-d79e050e805b","Type":"ContainerDied","Data":"f766c42af2d060185340e0210d41946829a6a6b6730f4af7e2d87c63579f1b5f"} Mar 16 18:00:27 crc kubenswrapper[5120]: I0316 18:00:27.148014 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/openstackclient" Mar 16 18:00:27 crc kubenswrapper[5120]: I0316 18:00:27.148018 5120 scope.go:117] "RemoveContainer" containerID="8567d11c10a82d6eb22de1da752d7bf610fb4bdb2795b0fe847e4e4729f35206" Mar 16 18:00:27 crc kubenswrapper[5120]: I0316 18:00:27.166340 5120 scope.go:117] "RemoveContainer" containerID="8567d11c10a82d6eb22de1da752d7bf610fb4bdb2795b0fe847e4e4729f35206" Mar 16 18:00:27 crc kubenswrapper[5120]: E0316 18:00:27.166898 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8567d11c10a82d6eb22de1da752d7bf610fb4bdb2795b0fe847e4e4729f35206\": container with ID starting with 8567d11c10a82d6eb22de1da752d7bf610fb4bdb2795b0fe847e4e4729f35206 not found: ID does not exist" containerID="8567d11c10a82d6eb22de1da752d7bf610fb4bdb2795b0fe847e4e4729f35206" Mar 16 18:00:27 crc kubenswrapper[5120]: I0316 18:00:27.166944 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8567d11c10a82d6eb22de1da752d7bf610fb4bdb2795b0fe847e4e4729f35206"} err="failed to get container status \"8567d11c10a82d6eb22de1da752d7bf610fb4bdb2795b0fe847e4e4729f35206\": rpc error: code = NotFound desc = could not find container \"8567d11c10a82d6eb22de1da752d7bf610fb4bdb2795b0fe847e4e4729f35206\": container with ID starting with 8567d11c10a82d6eb22de1da752d7bf610fb4bdb2795b0fe847e4e4729f35206 not found: ID does not exist" Mar 16 18:00:27 crc kubenswrapper[5120]: I0316 18:00:27.191875 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keystone-kuttl-tests/openstackclient"] Mar 16 18:00:27 crc kubenswrapper[5120]: I0316 18:00:27.203849 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["keystone-kuttl-tests/openstackclient"] Mar 16 18:00:27 crc kubenswrapper[5120]: I0316 18:00:27.391671 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keystone-kuttl-tests/keystone-5f497d965-w7bj5"] Mar 16 18:00:27 crc kubenswrapper[5120]: I0316 18:00:27.392293 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="keystone-kuttl-tests/keystone-5f497d965-w7bj5" podUID="4a7dc946-5465-4cb5-b513-dac369fd4656" containerName="keystone-api" containerID="cri-o://ed85ffc3161793f9246510bc2685445a6a590747aa837a8da849dfbd309911c6" gracePeriod=30 Mar 16 18:00:27 crc kubenswrapper[5120]: I0316 18:00:27.438249 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keystone-kuttl-tests/keystone89cf-account-delete-fv78v"] Mar 16 18:00:27 crc kubenswrapper[5120]: I0316 18:00:27.439120 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e903a6dc-2962-4bd4-b8c3-0b561bff85b8" containerName="collect-profiles" Mar 16 18:00:27 crc kubenswrapper[5120]: I0316 18:00:27.439139 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e903a6dc-2962-4bd4-b8c3-0b561bff85b8" containerName="collect-profiles" Mar 16 18:00:27 crc kubenswrapper[5120]: I0316 18:00:27.439166 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ac6c65a-664a-4880-a424-d79e050e805b" containerName="openstackclient" Mar 16 18:00:27 crc kubenswrapper[5120]: I0316 18:00:27.439172 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ac6c65a-664a-4880-a424-d79e050e805b" containerName="openstackclient" Mar 16 18:00:27 crc kubenswrapper[5120]: I0316 18:00:27.439200 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="302faf28-bbc3-4105-862e-bbbe3a1d159d" containerName="oc" Mar 16 18:00:27 crc kubenswrapper[5120]: I0316 18:00:27.439206 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="302faf28-bbc3-4105-862e-bbbe3a1d159d" containerName="oc" Mar 16 18:00:27 crc kubenswrapper[5120]: I0316 18:00:27.439320 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7ac6c65a-664a-4880-a424-d79e050e805b" containerName="openstackclient" Mar 16 18:00:27 crc kubenswrapper[5120]: I0316 18:00:27.439333 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e903a6dc-2962-4bd4-b8c3-0b561bff85b8" containerName="collect-profiles" Mar 16 18:00:27 crc kubenswrapper[5120]: I0316 18:00:27.439346 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="302faf28-bbc3-4105-862e-bbbe3a1d159d" containerName="oc" Mar 16 18:00:27 crc kubenswrapper[5120]: I0316 18:00:27.445292 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone89cf-account-delete-fv78v" Mar 16 18:00:27 crc kubenswrapper[5120]: I0316 18:00:27.451143 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone89cf-account-delete-fv78v"] Mar 16 18:00:27 crc kubenswrapper[5120]: I0316 18:00:27.547273 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pr7vb\" (UniqueName: \"kubernetes.io/projected/1aad5871-bfe1-45ff-bf66-9c67af2b8c29-kube-api-access-pr7vb\") pod \"keystone89cf-account-delete-fv78v\" (UID: \"1aad5871-bfe1-45ff-bf66-9c67af2b8c29\") " pod="keystone-kuttl-tests/keystone89cf-account-delete-fv78v" Mar 16 18:00:27 crc kubenswrapper[5120]: I0316 18:00:27.547485 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/1aad5871-bfe1-45ff-bf66-9c67af2b8c29-operator-scripts\") pod \"keystone89cf-account-delete-fv78v\" (UID: \"1aad5871-bfe1-45ff-bf66-9c67af2b8c29\") " pod="keystone-kuttl-tests/keystone89cf-account-delete-fv78v" Mar 16 18:00:27 crc kubenswrapper[5120]: I0316 18:00:27.649294 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/1aad5871-bfe1-45ff-bf66-9c67af2b8c29-operator-scripts\") pod \"keystone89cf-account-delete-fv78v\" (UID: \"1aad5871-bfe1-45ff-bf66-9c67af2b8c29\") " pod="keystone-kuttl-tests/keystone89cf-account-delete-fv78v" Mar 16 18:00:27 crc kubenswrapper[5120]: I0316 18:00:27.649489 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pr7vb\" (UniqueName: \"kubernetes.io/projected/1aad5871-bfe1-45ff-bf66-9c67af2b8c29-kube-api-access-pr7vb\") pod \"keystone89cf-account-delete-fv78v\" (UID: \"1aad5871-bfe1-45ff-bf66-9c67af2b8c29\") " pod="keystone-kuttl-tests/keystone89cf-account-delete-fv78v" Mar 16 18:00:27 crc kubenswrapper[5120]: I0316 18:00:27.650533 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/1aad5871-bfe1-45ff-bf66-9c67af2b8c29-operator-scripts\") pod \"keystone89cf-account-delete-fv78v\" (UID: \"1aad5871-bfe1-45ff-bf66-9c67af2b8c29\") " pod="keystone-kuttl-tests/keystone89cf-account-delete-fv78v" Mar 16 18:00:27 crc kubenswrapper[5120]: I0316 18:00:27.669815 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pr7vb\" (UniqueName: \"kubernetes.io/projected/1aad5871-bfe1-45ff-bf66-9c67af2b8c29-kube-api-access-pr7vb\") pod \"keystone89cf-account-delete-fv78v\" (UID: \"1aad5871-bfe1-45ff-bf66-9c67af2b8c29\") " pod="keystone-kuttl-tests/keystone89cf-account-delete-fv78v" Mar 16 18:00:27 crc kubenswrapper[5120]: I0316 18:00:27.776440 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone89cf-account-delete-fv78v" Mar 16 18:00:28 crc kubenswrapper[5120]: I0316 18:00:28.184579 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone89cf-account-delete-fv78v"] Mar 16 18:00:28 crc kubenswrapper[5120]: I0316 18:00:28.678508 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7ac6c65a-664a-4880-a424-d79e050e805b" path="/var/lib/kubelet/pods/7ac6c65a-664a-4880-a424-d79e050e805b/volumes" Mar 16 18:00:29 crc kubenswrapper[5120]: I0316 18:00:29.172044 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone89cf-account-delete-fv78v" event={"ID":"1aad5871-bfe1-45ff-bf66-9c67af2b8c29","Type":"ContainerStarted","Data":"70a65614275b4e7b2c6260f4d206da8bfefdd8e0df322855a6c11a2e13dce6f7"} Mar 16 18:00:31 crc kubenswrapper[5120]: I0316 18:00:31.101008 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-5f497d965-w7bj5" Mar 16 18:00:31 crc kubenswrapper[5120]: I0316 18:00:31.148962 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4a7dc946-5465-4cb5-b513-dac369fd4656-scripts\") pod \"4a7dc946-5465-4cb5-b513-dac369fd4656\" (UID: \"4a7dc946-5465-4cb5-b513-dac369fd4656\") " Mar 16 18:00:31 crc kubenswrapper[5120]: I0316 18:00:31.149195 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/4a7dc946-5465-4cb5-b513-dac369fd4656-fernet-keys\") pod \"4a7dc946-5465-4cb5-b513-dac369fd4656\" (UID: \"4a7dc946-5465-4cb5-b513-dac369fd4656\") " Mar 16 18:00:31 crc kubenswrapper[5120]: I0316 18:00:31.149294 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n7tjp\" (UniqueName: \"kubernetes.io/projected/4a7dc946-5465-4cb5-b513-dac369fd4656-kube-api-access-n7tjp\") pod \"4a7dc946-5465-4cb5-b513-dac369fd4656\" (UID: \"4a7dc946-5465-4cb5-b513-dac369fd4656\") " Mar 16 18:00:31 crc kubenswrapper[5120]: I0316 18:00:31.149321 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/4a7dc946-5465-4cb5-b513-dac369fd4656-credential-keys\") pod \"4a7dc946-5465-4cb5-b513-dac369fd4656\" (UID: \"4a7dc946-5465-4cb5-b513-dac369fd4656\") " Mar 16 18:00:31 crc kubenswrapper[5120]: I0316 18:00:31.149419 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4a7dc946-5465-4cb5-b513-dac369fd4656-config-data\") pod \"4a7dc946-5465-4cb5-b513-dac369fd4656\" (UID: \"4a7dc946-5465-4cb5-b513-dac369fd4656\") " Mar 16 18:00:31 crc kubenswrapper[5120]: I0316 18:00:31.155954 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4a7dc946-5465-4cb5-b513-dac369fd4656-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "4a7dc946-5465-4cb5-b513-dac369fd4656" (UID: "4a7dc946-5465-4cb5-b513-dac369fd4656"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 18:00:31 crc kubenswrapper[5120]: I0316 18:00:31.156196 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4a7dc946-5465-4cb5-b513-dac369fd4656-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "4a7dc946-5465-4cb5-b513-dac369fd4656" (UID: "4a7dc946-5465-4cb5-b513-dac369fd4656"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 18:00:31 crc kubenswrapper[5120]: I0316 18:00:31.163383 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a7dc946-5465-4cb5-b513-dac369fd4656-kube-api-access-n7tjp" (OuterVolumeSpecName: "kube-api-access-n7tjp") pod "4a7dc946-5465-4cb5-b513-dac369fd4656" (UID: "4a7dc946-5465-4cb5-b513-dac369fd4656"). InnerVolumeSpecName "kube-api-access-n7tjp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 18:00:31 crc kubenswrapper[5120]: I0316 18:00:31.163524 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4a7dc946-5465-4cb5-b513-dac369fd4656-scripts" (OuterVolumeSpecName: "scripts") pod "4a7dc946-5465-4cb5-b513-dac369fd4656" (UID: "4a7dc946-5465-4cb5-b513-dac369fd4656"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 18:00:31 crc kubenswrapper[5120]: I0316 18:00:31.173069 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4a7dc946-5465-4cb5-b513-dac369fd4656-config-data" (OuterVolumeSpecName: "config-data") pod "4a7dc946-5465-4cb5-b513-dac369fd4656" (UID: "4a7dc946-5465-4cb5-b513-dac369fd4656"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 18:00:31 crc kubenswrapper[5120]: I0316 18:00:31.189506 5120 generic.go:358] "Generic (PLEG): container finished" podID="4a7dc946-5465-4cb5-b513-dac369fd4656" containerID="ed85ffc3161793f9246510bc2685445a6a590747aa837a8da849dfbd309911c6" exitCode=0 Mar 16 18:00:31 crc kubenswrapper[5120]: I0316 18:00:31.189612 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-5f497d965-w7bj5" event={"ID":"4a7dc946-5465-4cb5-b513-dac369fd4656","Type":"ContainerDied","Data":"ed85ffc3161793f9246510bc2685445a6a590747aa837a8da849dfbd309911c6"} Mar 16 18:00:31 crc kubenswrapper[5120]: I0316 18:00:31.189639 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-5f497d965-w7bj5" Mar 16 18:00:31 crc kubenswrapper[5120]: I0316 18:00:31.189700 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-5f497d965-w7bj5" event={"ID":"4a7dc946-5465-4cb5-b513-dac369fd4656","Type":"ContainerDied","Data":"65f8dd8b64b61d2b0cc4065377fbfd96f23b11a77b892f9516ca9377c36712de"} Mar 16 18:00:31 crc kubenswrapper[5120]: I0316 18:00:31.189726 5120 scope.go:117] "RemoveContainer" containerID="ed85ffc3161793f9246510bc2685445a6a590747aa837a8da849dfbd309911c6" Mar 16 18:00:31 crc kubenswrapper[5120]: I0316 18:00:31.192233 5120 generic.go:358] "Generic (PLEG): container finished" podID="1aad5871-bfe1-45ff-bf66-9c67af2b8c29" containerID="29d9cedb1159cad8e181e5f9ede8040c92b8ea085abd2f4a91953f1dbb6608d7" exitCode=0 Mar 16 18:00:31 crc kubenswrapper[5120]: I0316 18:00:31.192472 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone89cf-account-delete-fv78v" event={"ID":"1aad5871-bfe1-45ff-bf66-9c67af2b8c29","Type":"ContainerDied","Data":"29d9cedb1159cad8e181e5f9ede8040c92b8ea085abd2f4a91953f1dbb6608d7"} Mar 16 18:00:31 crc kubenswrapper[5120]: I0316 18:00:31.254679 5120 reconciler_common.go:299] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/4a7dc946-5465-4cb5-b513-dac369fd4656-fernet-keys\") on node \"crc\" DevicePath \"\"" Mar 16 18:00:31 crc kubenswrapper[5120]: I0316 18:00:31.254720 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n7tjp\" (UniqueName: \"kubernetes.io/projected/4a7dc946-5465-4cb5-b513-dac369fd4656-kube-api-access-n7tjp\") on node \"crc\" DevicePath \"\"" Mar 16 18:00:31 crc kubenswrapper[5120]: I0316 18:00:31.254733 5120 reconciler_common.go:299] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/4a7dc946-5465-4cb5-b513-dac369fd4656-credential-keys\") on node \"crc\" DevicePath \"\"" Mar 16 18:00:31 crc kubenswrapper[5120]: I0316 18:00:31.254745 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4a7dc946-5465-4cb5-b513-dac369fd4656-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 18:00:31 crc kubenswrapper[5120]: I0316 18:00:31.254756 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4a7dc946-5465-4cb5-b513-dac369fd4656-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 18:00:31 crc kubenswrapper[5120]: I0316 18:00:31.261753 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keystone-kuttl-tests/keystone-5f497d965-w7bj5"] Mar 16 18:00:31 crc kubenswrapper[5120]: I0316 18:00:31.265516 5120 scope.go:117] "RemoveContainer" containerID="ed85ffc3161793f9246510bc2685445a6a590747aa837a8da849dfbd309911c6" Mar 16 18:00:31 crc kubenswrapper[5120]: E0316 18:00:31.266202 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ed85ffc3161793f9246510bc2685445a6a590747aa837a8da849dfbd309911c6\": container with ID starting with ed85ffc3161793f9246510bc2685445a6a590747aa837a8da849dfbd309911c6 not found: ID does not exist" containerID="ed85ffc3161793f9246510bc2685445a6a590747aa837a8da849dfbd309911c6" Mar 16 18:00:31 crc kubenswrapper[5120]: I0316 18:00:31.266275 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed85ffc3161793f9246510bc2685445a6a590747aa837a8da849dfbd309911c6"} err="failed to get container status \"ed85ffc3161793f9246510bc2685445a6a590747aa837a8da849dfbd309911c6\": rpc error: code = NotFound desc = could not find container \"ed85ffc3161793f9246510bc2685445a6a590747aa837a8da849dfbd309911c6\": container with ID starting with ed85ffc3161793f9246510bc2685445a6a590747aa837a8da849dfbd309911c6 not found: ID does not exist" Mar 16 18:00:31 crc kubenswrapper[5120]: I0316 18:00:31.269532 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["keystone-kuttl-tests/keystone-5f497d965-w7bj5"] Mar 16 18:00:32 crc kubenswrapper[5120]: I0316 18:00:32.509398 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone89cf-account-delete-fv78v" Mar 16 18:00:32 crc kubenswrapper[5120]: I0316 18:00:32.582303 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/1aad5871-bfe1-45ff-bf66-9c67af2b8c29-operator-scripts\") pod \"1aad5871-bfe1-45ff-bf66-9c67af2b8c29\" (UID: \"1aad5871-bfe1-45ff-bf66-9c67af2b8c29\") " Mar 16 18:00:32 crc kubenswrapper[5120]: I0316 18:00:32.582473 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pr7vb\" (UniqueName: \"kubernetes.io/projected/1aad5871-bfe1-45ff-bf66-9c67af2b8c29-kube-api-access-pr7vb\") pod \"1aad5871-bfe1-45ff-bf66-9c67af2b8c29\" (UID: \"1aad5871-bfe1-45ff-bf66-9c67af2b8c29\") " Mar 16 18:00:32 crc kubenswrapper[5120]: I0316 18:00:32.582930 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1aad5871-bfe1-45ff-bf66-9c67af2b8c29-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "1aad5871-bfe1-45ff-bf66-9c67af2b8c29" (UID: "1aad5871-bfe1-45ff-bf66-9c67af2b8c29"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 18:00:32 crc kubenswrapper[5120]: I0316 18:00:32.583311 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/1aad5871-bfe1-45ff-bf66-9c67af2b8c29-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 18:00:32 crc kubenswrapper[5120]: I0316 18:00:32.587710 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1aad5871-bfe1-45ff-bf66-9c67af2b8c29-kube-api-access-pr7vb" (OuterVolumeSpecName: "kube-api-access-pr7vb") pod "1aad5871-bfe1-45ff-bf66-9c67af2b8c29" (UID: "1aad5871-bfe1-45ff-bf66-9c67af2b8c29"). InnerVolumeSpecName "kube-api-access-pr7vb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 18:00:32 crc kubenswrapper[5120]: I0316 18:00:32.674990 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4a7dc946-5465-4cb5-b513-dac369fd4656" path="/var/lib/kubelet/pods/4a7dc946-5465-4cb5-b513-dac369fd4656/volumes" Mar 16 18:00:32 crc kubenswrapper[5120]: I0316 18:00:32.685642 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pr7vb\" (UniqueName: \"kubernetes.io/projected/1aad5871-bfe1-45ff-bf66-9c67af2b8c29-kube-api-access-pr7vb\") on node \"crc\" DevicePath \"\"" Mar 16 18:00:33 crc kubenswrapper[5120]: E0316 18:00:33.141741 5120 upgradeaware.go:427] Error proxying data from client to backend: readfrom tcp 38.102.83.119:45494->38.102.83.119:44311: write tcp 38.102.83.119:45494->38.102.83.119:44311: write: broken pipe Mar 16 18:00:33 crc kubenswrapper[5120]: I0316 18:00:33.213318 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone89cf-account-delete-fv78v" event={"ID":"1aad5871-bfe1-45ff-bf66-9c67af2b8c29","Type":"ContainerDied","Data":"70a65614275b4e7b2c6260f4d206da8bfefdd8e0df322855a6c11a2e13dce6f7"} Mar 16 18:00:33 crc kubenswrapper[5120]: I0316 18:00:33.213354 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="70a65614275b4e7b2c6260f4d206da8bfefdd8e0df322855a6c11a2e13dce6f7" Mar 16 18:00:33 crc kubenswrapper[5120]: I0316 18:00:33.213372 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone89cf-account-delete-fv78v" Mar 16 18:00:33 crc kubenswrapper[5120]: E0316 18:00:33.979105 5120 upgradeaware.go:427] Error proxying data from client to backend: readfrom tcp 38.102.83.119:45536->38.102.83.119:44311: write tcp 38.102.83.119:45536->38.102.83.119:44311: write: broken pipe Mar 16 18:00:35 crc kubenswrapper[5120]: E0316 18:00:35.311489 5120 upgradeaware.go:427] Error proxying data from client to backend: readfrom tcp 38.102.83.119:45616->38.102.83.119:44311: write tcp 38.102.83.119:45616->38.102.83.119:44311: write: broken pipe Mar 16 18:00:37 crc kubenswrapper[5120]: I0316 18:00:37.311922 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keystone-kuttl-tests/root-account-create-update-hszf4"] Mar 16 18:00:37 crc kubenswrapper[5120]: I0316 18:00:37.314198 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1aad5871-bfe1-45ff-bf66-9c67af2b8c29" containerName="mariadb-account-delete" Mar 16 18:00:37 crc kubenswrapper[5120]: I0316 18:00:37.314247 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1aad5871-bfe1-45ff-bf66-9c67af2b8c29" containerName="mariadb-account-delete" Mar 16 18:00:37 crc kubenswrapper[5120]: I0316 18:00:37.314325 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a7dc946-5465-4cb5-b513-dac369fd4656" containerName="keystone-api" Mar 16 18:00:37 crc kubenswrapper[5120]: I0316 18:00:37.314340 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a7dc946-5465-4cb5-b513-dac369fd4656" containerName="keystone-api" Mar 16 18:00:37 crc kubenswrapper[5120]: I0316 18:00:37.314638 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="4a7dc946-5465-4cb5-b513-dac369fd4656" containerName="keystone-api" Mar 16 18:00:37 crc kubenswrapper[5120]: I0316 18:00:37.314698 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1aad5871-bfe1-45ff-bf66-9c67af2b8c29" containerName="mariadb-account-delete" Mar 16 18:00:37 crc kubenswrapper[5120]: I0316 18:00:37.326488 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/root-account-create-update-hszf4" Mar 16 18:00:37 crc kubenswrapper[5120]: I0316 18:00:37.338697 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keystone-kuttl-tests\"/\"openstack-mariadb-root-db-secret\"" Mar 16 18:00:37 crc kubenswrapper[5120]: I0316 18:00:37.344897 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/root-account-create-update-hszf4"] Mar 16 18:00:37 crc kubenswrapper[5120]: I0316 18:00:37.367548 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keystone-kuttl-tests/openstack-galera-1"] Mar 16 18:00:37 crc kubenswrapper[5120]: I0316 18:00:37.373850 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keystone-kuttl-tests/openstack-galera-0"] Mar 16 18:00:37 crc kubenswrapper[5120]: I0316 18:00:37.391685 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keystone-kuttl-tests/openstack-galera-2"] Mar 16 18:00:37 crc kubenswrapper[5120]: I0316 18:00:37.398311 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keystone-kuttl-tests/root-account-create-update-hszf4"] Mar 16 18:00:37 crc kubenswrapper[5120]: E0316 18:00:37.399094 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-76kq2 operator-scripts], unattached volumes=[], failed to process volumes=[kube-api-access-76kq2 operator-scripts]: context canceled" pod="keystone-kuttl-tests/root-account-create-update-hszf4" podUID="382ae7db-49c0-4091-85f8-83cc29f1c73e" Mar 16 18:00:37 crc kubenswrapper[5120]: I0316 18:00:37.452112 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keystone-kuttl-tests/keystone89cf-account-delete-fv78v"] Mar 16 18:00:37 crc kubenswrapper[5120]: I0316 18:00:37.459282 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["keystone-kuttl-tests/keystone89cf-account-delete-fv78v"] Mar 16 18:00:37 crc kubenswrapper[5120]: I0316 18:00:37.501222 5120 scope.go:117] "RemoveContainer" containerID="7b04d4caef16772dfbcc026f1ec9eac9ac62d6b4b6ee6f1c75a21027575021b1" Mar 16 18:00:37 crc kubenswrapper[5120]: I0316 18:00:37.511007 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76kq2\" (UniqueName: \"kubernetes.io/projected/382ae7db-49c0-4091-85f8-83cc29f1c73e-kube-api-access-76kq2\") pod \"root-account-create-update-hszf4\" (UID: \"382ae7db-49c0-4091-85f8-83cc29f1c73e\") " pod="keystone-kuttl-tests/root-account-create-update-hszf4" Mar 16 18:00:37 crc kubenswrapper[5120]: I0316 18:00:37.511552 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/382ae7db-49c0-4091-85f8-83cc29f1c73e-operator-scripts\") pod \"root-account-create-update-hszf4\" (UID: \"382ae7db-49c0-4091-85f8-83cc29f1c73e\") " pod="keystone-kuttl-tests/root-account-create-update-hszf4" Mar 16 18:00:37 crc kubenswrapper[5120]: I0316 18:00:37.524391 5120 scope.go:117] "RemoveContainer" containerID="a2f064b0b31265d1a74dcd16afbdabbaad132c69e37ae1a1901f4693c513ba4b" Mar 16 18:00:37 crc kubenswrapper[5120]: I0316 18:00:37.554674 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="keystone-kuttl-tests/openstack-galera-2" podUID="bef338fe-205b-4d75-98b6-5e25cdfd474f" containerName="galera" containerID="cri-o://5e6fd9896d41d1efe4ea3a9c55e5eca5228c55b87c24789d9e3231ffcdcfd278" gracePeriod=30 Mar 16 18:00:37 crc kubenswrapper[5120]: I0316 18:00:37.568431 5120 scope.go:117] "RemoveContainer" containerID="70366333713b0ab6e2d38e6614593401fdd8a55a0d7f2034760abb2a7c42425a" Mar 16 18:00:37 crc kubenswrapper[5120]: I0316 18:00:37.594571 5120 scope.go:117] "RemoveContainer" containerID="d18d128d10305a7889313c4dea28e0e15063257fee22bf0e5ddd250fdded9fbc" Mar 16 18:00:37 crc kubenswrapper[5120]: I0316 18:00:37.613953 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-76kq2\" (UniqueName: \"kubernetes.io/projected/382ae7db-49c0-4091-85f8-83cc29f1c73e-kube-api-access-76kq2\") pod \"root-account-create-update-hszf4\" (UID: \"382ae7db-49c0-4091-85f8-83cc29f1c73e\") " pod="keystone-kuttl-tests/root-account-create-update-hszf4" Mar 16 18:00:37 crc kubenswrapper[5120]: I0316 18:00:37.614168 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/382ae7db-49c0-4091-85f8-83cc29f1c73e-operator-scripts\") pod \"root-account-create-update-hszf4\" (UID: \"382ae7db-49c0-4091-85f8-83cc29f1c73e\") " pod="keystone-kuttl-tests/root-account-create-update-hszf4" Mar 16 18:00:37 crc kubenswrapper[5120]: E0316 18:00:37.614307 5120 configmap.go:193] Couldn't get configMap keystone-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Mar 16 18:00:37 crc kubenswrapper[5120]: E0316 18:00:37.614368 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/382ae7db-49c0-4091-85f8-83cc29f1c73e-operator-scripts podName:382ae7db-49c0-4091-85f8-83cc29f1c73e nodeName:}" failed. No retries permitted until 2026-03-16 18:00:38.114349613 +0000 UTC m=+8940.268281260 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/382ae7db-49c0-4091-85f8-83cc29f1c73e-operator-scripts") pod "root-account-create-update-hszf4" (UID: "382ae7db-49c0-4091-85f8-83cc29f1c73e") : configmap "openstack-scripts" not found Mar 16 18:00:37 crc kubenswrapper[5120]: E0316 18:00:37.618130 5120 projected.go:194] Error preparing data for projected volume kube-api-access-76kq2 for pod keystone-kuttl-tests/root-account-create-update-hszf4: failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 18:00:37 crc kubenswrapper[5120]: E0316 18:00:37.618216 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/382ae7db-49c0-4091-85f8-83cc29f1c73e-kube-api-access-76kq2 podName:382ae7db-49c0-4091-85f8-83cc29f1c73e nodeName:}" failed. No retries permitted until 2026-03-16 18:00:38.118194129 +0000 UTC m=+8940.272125786 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-76kq2" (UniqueName: "kubernetes.io/projected/382ae7db-49c0-4091-85f8-83cc29f1c73e-kube-api-access-76kq2") pod "root-account-create-update-hszf4" (UID: "382ae7db-49c0-4091-85f8-83cc29f1c73e") : failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 18:00:38 crc kubenswrapper[5120]: I0316 18:00:38.000346 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keystone-kuttl-tests/memcached-0"] Mar 16 18:00:38 crc kubenswrapper[5120]: I0316 18:00:38.000594 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="keystone-kuttl-tests/memcached-0" podUID="49c806d7-6ca0-45e9-91b9-98a510fb2401" containerName="memcached" containerID="cri-o://bceecb6b6350e37b21d990e1c4af2d3ad5d831111b8d7bdc1431be3370ddb257" gracePeriod=30 Mar 16 18:00:38 crc kubenswrapper[5120]: I0316 18:00:38.125892 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/382ae7db-49c0-4091-85f8-83cc29f1c73e-operator-scripts\") pod \"root-account-create-update-hszf4\" (UID: \"382ae7db-49c0-4091-85f8-83cc29f1c73e\") " pod="keystone-kuttl-tests/root-account-create-update-hszf4" Mar 16 18:00:38 crc kubenswrapper[5120]: I0316 18:00:38.126489 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-76kq2\" (UniqueName: \"kubernetes.io/projected/382ae7db-49c0-4091-85f8-83cc29f1c73e-kube-api-access-76kq2\") pod \"root-account-create-update-hszf4\" (UID: \"382ae7db-49c0-4091-85f8-83cc29f1c73e\") " pod="keystone-kuttl-tests/root-account-create-update-hszf4" Mar 16 18:00:38 crc kubenswrapper[5120]: E0316 18:00:38.126009 5120 configmap.go:193] Couldn't get configMap keystone-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Mar 16 18:00:38 crc kubenswrapper[5120]: E0316 18:00:38.126638 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/382ae7db-49c0-4091-85f8-83cc29f1c73e-operator-scripts podName:382ae7db-49c0-4091-85f8-83cc29f1c73e nodeName:}" failed. No retries permitted until 2026-03-16 18:00:39.126613 +0000 UTC m=+8941.280544667 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/382ae7db-49c0-4091-85f8-83cc29f1c73e-operator-scripts") pod "root-account-create-update-hszf4" (UID: "382ae7db-49c0-4091-85f8-83cc29f1c73e") : configmap "openstack-scripts" not found Mar 16 18:00:38 crc kubenswrapper[5120]: E0316 18:00:38.131038 5120 projected.go:194] Error preparing data for projected volume kube-api-access-76kq2 for pod keystone-kuttl-tests/root-account-create-update-hszf4: failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 18:00:38 crc kubenswrapper[5120]: E0316 18:00:38.131160 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/382ae7db-49c0-4091-85f8-83cc29f1c73e-kube-api-access-76kq2 podName:382ae7db-49c0-4091-85f8-83cc29f1c73e nodeName:}" failed. No retries permitted until 2026-03-16 18:00:39.131136593 +0000 UTC m=+8941.285068250 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-76kq2" (UniqueName: "kubernetes.io/projected/382ae7db-49c0-4091-85f8-83cc29f1c73e-kube-api-access-76kq2") pod "root-account-create-update-hszf4" (UID: "382ae7db-49c0-4091-85f8-83cc29f1c73e") : failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 18:00:38 crc kubenswrapper[5120]: E0316 18:00:38.165692 5120 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbef338fe_205b_4d75_98b6_5e25cdfd474f.slice/crio-conmon-5e6fd9896d41d1efe4ea3a9c55e5eca5228c55b87c24789d9e3231ffcdcfd278.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbef338fe_205b_4d75_98b6_5e25cdfd474f.slice/crio-5e6fd9896d41d1efe4ea3a9c55e5eca5228c55b87c24789d9e3231ffcdcfd278.scope\": RecentStats: unable to find data in memory cache]" Mar 16 18:00:38 crc kubenswrapper[5120]: I0316 18:00:38.265188 5120 generic.go:358] "Generic (PLEG): container finished" podID="bef338fe-205b-4d75-98b6-5e25cdfd474f" containerID="5e6fd9896d41d1efe4ea3a9c55e5eca5228c55b87c24789d9e3231ffcdcfd278" exitCode=0 Mar 16 18:00:38 crc kubenswrapper[5120]: I0316 18:00:38.265288 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/openstack-galera-2" event={"ID":"bef338fe-205b-4d75-98b6-5e25cdfd474f","Type":"ContainerDied","Data":"5e6fd9896d41d1efe4ea3a9c55e5eca5228c55b87c24789d9e3231ffcdcfd278"} Mar 16 18:00:38 crc kubenswrapper[5120]: I0316 18:00:38.265600 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/root-account-create-update-hszf4" Mar 16 18:00:38 crc kubenswrapper[5120]: I0316 18:00:38.283038 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/root-account-create-update-hszf4" Mar 16 18:00:38 crc kubenswrapper[5120]: I0316 18:00:38.419704 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/openstack-galera-2" Mar 16 18:00:38 crc kubenswrapper[5120]: I0316 18:00:38.442160 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/bef338fe-205b-4d75-98b6-5e25cdfd474f-config-data-default\") pod \"bef338fe-205b-4d75-98b6-5e25cdfd474f\" (UID: \"bef338fe-205b-4d75-98b6-5e25cdfd474f\") " Mar 16 18:00:38 crc kubenswrapper[5120]: I0316 18:00:38.442223 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"mysql-db\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"bef338fe-205b-4d75-98b6-5e25cdfd474f\" (UID: \"bef338fe-205b-4d75-98b6-5e25cdfd474f\") " Mar 16 18:00:38 crc kubenswrapper[5120]: I0316 18:00:38.442246 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/bef338fe-205b-4d75-98b6-5e25cdfd474f-kolla-config\") pod \"bef338fe-205b-4d75-98b6-5e25cdfd474f\" (UID: \"bef338fe-205b-4d75-98b6-5e25cdfd474f\") " Mar 16 18:00:38 crc kubenswrapper[5120]: I0316 18:00:38.442388 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/bef338fe-205b-4d75-98b6-5e25cdfd474f-operator-scripts\") pod \"bef338fe-205b-4d75-98b6-5e25cdfd474f\" (UID: \"bef338fe-205b-4d75-98b6-5e25cdfd474f\") " Mar 16 18:00:38 crc kubenswrapper[5120]: I0316 18:00:38.442823 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7gr8j\" (UniqueName: \"kubernetes.io/projected/bef338fe-205b-4d75-98b6-5e25cdfd474f-kube-api-access-7gr8j\") pod \"bef338fe-205b-4d75-98b6-5e25cdfd474f\" (UID: \"bef338fe-205b-4d75-98b6-5e25cdfd474f\") " Mar 16 18:00:38 crc kubenswrapper[5120]: I0316 18:00:38.442850 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/bef338fe-205b-4d75-98b6-5e25cdfd474f-config-data-generated\") pod \"bef338fe-205b-4d75-98b6-5e25cdfd474f\" (UID: \"bef338fe-205b-4d75-98b6-5e25cdfd474f\") " Mar 16 18:00:38 crc kubenswrapper[5120]: I0316 18:00:38.443995 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bef338fe-205b-4d75-98b6-5e25cdfd474f-config-data-generated" (OuterVolumeSpecName: "config-data-generated") pod "bef338fe-205b-4d75-98b6-5e25cdfd474f" (UID: "bef338fe-205b-4d75-98b6-5e25cdfd474f"). InnerVolumeSpecName "config-data-generated". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 18:00:38 crc kubenswrapper[5120]: I0316 18:00:38.444537 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bef338fe-205b-4d75-98b6-5e25cdfd474f-config-data-default" (OuterVolumeSpecName: "config-data-default") pod "bef338fe-205b-4d75-98b6-5e25cdfd474f" (UID: "bef338fe-205b-4d75-98b6-5e25cdfd474f"). InnerVolumeSpecName "config-data-default". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 18:00:38 crc kubenswrapper[5120]: I0316 18:00:38.445239 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bef338fe-205b-4d75-98b6-5e25cdfd474f-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "bef338fe-205b-4d75-98b6-5e25cdfd474f" (UID: "bef338fe-205b-4d75-98b6-5e25cdfd474f"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 18:00:38 crc kubenswrapper[5120]: I0316 18:00:38.445628 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bef338fe-205b-4d75-98b6-5e25cdfd474f-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "bef338fe-205b-4d75-98b6-5e25cdfd474f" (UID: "bef338fe-205b-4d75-98b6-5e25cdfd474f"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 18:00:38 crc kubenswrapper[5120]: I0316 18:00:38.454204 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bef338fe-205b-4d75-98b6-5e25cdfd474f-kube-api-access-7gr8j" (OuterVolumeSpecName: "kube-api-access-7gr8j") pod "bef338fe-205b-4d75-98b6-5e25cdfd474f" (UID: "bef338fe-205b-4d75-98b6-5e25cdfd474f"). InnerVolumeSpecName "kube-api-access-7gr8j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 18:00:38 crc kubenswrapper[5120]: I0316 18:00:38.464090 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/rabbitmq-server-0"] Mar 16 18:00:38 crc kubenswrapper[5120]: I0316 18:00:38.465149 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage04-crc" (OuterVolumeSpecName: "mysql-db") pod "bef338fe-205b-4d75-98b6-5e25cdfd474f" (UID: "bef338fe-205b-4d75-98b6-5e25cdfd474f"). InnerVolumeSpecName "local-storage04-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 18:00:38 crc kubenswrapper[5120]: I0316 18:00:38.546216 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7gr8j\" (UniqueName: \"kubernetes.io/projected/bef338fe-205b-4d75-98b6-5e25cdfd474f-kube-api-access-7gr8j\") on node \"crc\" DevicePath \"\"" Mar 16 18:00:38 crc kubenswrapper[5120]: I0316 18:00:38.546487 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/bef338fe-205b-4d75-98b6-5e25cdfd474f-config-data-generated\") on node \"crc\" DevicePath \"\"" Mar 16 18:00:38 crc kubenswrapper[5120]: I0316 18:00:38.546564 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/bef338fe-205b-4d75-98b6-5e25cdfd474f-config-data-default\") on node \"crc\" DevicePath \"\"" Mar 16 18:00:38 crc kubenswrapper[5120]: I0316 18:00:38.546643 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") on node \"crc\" " Mar 16 18:00:38 crc kubenswrapper[5120]: I0316 18:00:38.546714 5120 reconciler_common.go:299] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/bef338fe-205b-4d75-98b6-5e25cdfd474f-kolla-config\") on node \"crc\" DevicePath \"\"" Mar 16 18:00:38 crc kubenswrapper[5120]: I0316 18:00:38.546805 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/bef338fe-205b-4d75-98b6-5e25cdfd474f-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 18:00:38 crc kubenswrapper[5120]: I0316 18:00:38.563959 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage04-crc" (UniqueName: "kubernetes.io/local-volume/local-storage04-crc") on node "crc" Mar 16 18:00:38 crc kubenswrapper[5120]: I0316 18:00:38.648611 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") on node \"crc\" DevicePath \"\"" Mar 16 18:00:38 crc kubenswrapper[5120]: I0316 18:00:38.671855 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1aad5871-bfe1-45ff-bf66-9c67af2b8c29" path="/var/lib/kubelet/pods/1aad5871-bfe1-45ff-bf66-9c67af2b8c29/volumes" Mar 16 18:00:38 crc kubenswrapper[5120]: I0316 18:00:38.832945 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keystone-kuttl-tests/rabbitmq-server-0"] Mar 16 18:00:39 crc kubenswrapper[5120]: I0316 18:00:39.161523 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/382ae7db-49c0-4091-85f8-83cc29f1c73e-operator-scripts\") pod \"root-account-create-update-hszf4\" (UID: \"382ae7db-49c0-4091-85f8-83cc29f1c73e\") " pod="keystone-kuttl-tests/root-account-create-update-hszf4" Mar 16 18:00:39 crc kubenswrapper[5120]: E0316 18:00:39.161687 5120 configmap.go:193] Couldn't get configMap keystone-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Mar 16 18:00:39 crc kubenswrapper[5120]: I0316 18:00:39.161718 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-76kq2\" (UniqueName: \"kubernetes.io/projected/382ae7db-49c0-4091-85f8-83cc29f1c73e-kube-api-access-76kq2\") pod \"root-account-create-update-hszf4\" (UID: \"382ae7db-49c0-4091-85f8-83cc29f1c73e\") " pod="keystone-kuttl-tests/root-account-create-update-hszf4" Mar 16 18:00:39 crc kubenswrapper[5120]: E0316 18:00:39.161805 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/382ae7db-49c0-4091-85f8-83cc29f1c73e-operator-scripts podName:382ae7db-49c0-4091-85f8-83cc29f1c73e nodeName:}" failed. No retries permitted until 2026-03-16 18:00:41.161778192 +0000 UTC m=+8943.315709859 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/382ae7db-49c0-4091-85f8-83cc29f1c73e-operator-scripts") pod "root-account-create-update-hszf4" (UID: "382ae7db-49c0-4091-85f8-83cc29f1c73e") : configmap "openstack-scripts" not found Mar 16 18:00:39 crc kubenswrapper[5120]: E0316 18:00:39.165259 5120 projected.go:194] Error preparing data for projected volume kube-api-access-76kq2 for pod keystone-kuttl-tests/root-account-create-update-hszf4: failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 18:00:39 crc kubenswrapper[5120]: E0316 18:00:39.165352 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/382ae7db-49c0-4091-85f8-83cc29f1c73e-kube-api-access-76kq2 podName:382ae7db-49c0-4091-85f8-83cc29f1c73e nodeName:}" failed. No retries permitted until 2026-03-16 18:00:41.16533201 +0000 UTC m=+8943.319263667 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-76kq2" (UniqueName: "kubernetes.io/projected/382ae7db-49c0-4091-85f8-83cc29f1c73e-kube-api-access-76kq2") pod "root-account-create-update-hszf4" (UID: "382ae7db-49c0-4091-85f8-83cc29f1c73e") : failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 18:00:39 crc kubenswrapper[5120]: I0316 18:00:39.274396 5120 generic.go:358] "Generic (PLEG): container finished" podID="49c806d7-6ca0-45e9-91b9-98a510fb2401" containerID="bceecb6b6350e37b21d990e1c4af2d3ad5d831111b8d7bdc1431be3370ddb257" exitCode=0 Mar 16 18:00:39 crc kubenswrapper[5120]: I0316 18:00:39.274478 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/memcached-0" event={"ID":"49c806d7-6ca0-45e9-91b9-98a510fb2401","Type":"ContainerDied","Data":"bceecb6b6350e37b21d990e1c4af2d3ad5d831111b8d7bdc1431be3370ddb257"} Mar 16 18:00:39 crc kubenswrapper[5120]: I0316 18:00:39.274786 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/memcached-0" event={"ID":"49c806d7-6ca0-45e9-91b9-98a510fb2401","Type":"ContainerDied","Data":"cc1bc1962d2139b2bb10a9dad3801d5d2c502ece351fb893ff6aea09ce5ed315"} Mar 16 18:00:39 crc kubenswrapper[5120]: I0316 18:00:39.274801 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cc1bc1962d2139b2bb10a9dad3801d5d2c502ece351fb893ff6aea09ce5ed315" Mar 16 18:00:39 crc kubenswrapper[5120]: I0316 18:00:39.277421 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/openstack-galera-2" Mar 16 18:00:39 crc kubenswrapper[5120]: I0316 18:00:39.277631 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/openstack-galera-2" event={"ID":"bef338fe-205b-4d75-98b6-5e25cdfd474f","Type":"ContainerDied","Data":"2ba028be8504c3556e8b1bbb703939eeadd88abcf3fbec74053d78836980b006"} Mar 16 18:00:39 crc kubenswrapper[5120]: I0316 18:00:39.277791 5120 scope.go:117] "RemoveContainer" containerID="5e6fd9896d41d1efe4ea3a9c55e5eca5228c55b87c24789d9e3231ffcdcfd278" Mar 16 18:00:39 crc kubenswrapper[5120]: I0316 18:00:39.277900 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/memcached-0" Mar 16 18:00:39 crc kubenswrapper[5120]: I0316 18:00:39.278092 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/root-account-create-update-hszf4" Mar 16 18:00:39 crc kubenswrapper[5120]: I0316 18:00:39.296633 5120 scope.go:117] "RemoveContainer" containerID="e0f682b77097f27ecf25cdf1504164983b7415e6f0e21d12660294f4fb176a63" Mar 16 18:00:39 crc kubenswrapper[5120]: I0316 18:00:39.319142 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="keystone-kuttl-tests/rabbitmq-server-0" podUID="69818304-cbec-4828-a572-6bbc566dc6b7" containerName="rabbitmq" containerID="cri-o://d640d0a123d6c4156f236bf2e2bce34c40bd81ba25310c0e23324ea8f867111d" gracePeriod=604800 Mar 16 18:00:39 crc kubenswrapper[5120]: I0316 18:00:39.333594 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keystone-kuttl-tests/openstack-galera-2"] Mar 16 18:00:39 crc kubenswrapper[5120]: I0316 18:00:39.349796 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["keystone-kuttl-tests/openstack-galera-2"] Mar 16 18:00:39 crc kubenswrapper[5120]: I0316 18:00:39.360284 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keystone-kuttl-tests/root-account-create-update-hszf4"] Mar 16 18:00:39 crc kubenswrapper[5120]: I0316 18:00:39.365412 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xw8x4\" (UniqueName: \"kubernetes.io/projected/49c806d7-6ca0-45e9-91b9-98a510fb2401-kube-api-access-xw8x4\") pod \"49c806d7-6ca0-45e9-91b9-98a510fb2401\" (UID: \"49c806d7-6ca0-45e9-91b9-98a510fb2401\") " Mar 16 18:00:39 crc kubenswrapper[5120]: I0316 18:00:39.365469 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["keystone-kuttl-tests/root-account-create-update-hszf4"] Mar 16 18:00:39 crc kubenswrapper[5120]: I0316 18:00:39.366073 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/49c806d7-6ca0-45e9-91b9-98a510fb2401-config-data\") pod \"49c806d7-6ca0-45e9-91b9-98a510fb2401\" (UID: \"49c806d7-6ca0-45e9-91b9-98a510fb2401\") " Mar 16 18:00:39 crc kubenswrapper[5120]: I0316 18:00:39.366524 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/49c806d7-6ca0-45e9-91b9-98a510fb2401-config-data" (OuterVolumeSpecName: "config-data") pod "49c806d7-6ca0-45e9-91b9-98a510fb2401" (UID: "49c806d7-6ca0-45e9-91b9-98a510fb2401"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 18:00:39 crc kubenswrapper[5120]: I0316 18:00:39.366547 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/49c806d7-6ca0-45e9-91b9-98a510fb2401-kolla-config\") pod \"49c806d7-6ca0-45e9-91b9-98a510fb2401\" (UID: \"49c806d7-6ca0-45e9-91b9-98a510fb2401\") " Mar 16 18:00:39 crc kubenswrapper[5120]: I0316 18:00:39.366910 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/49c806d7-6ca0-45e9-91b9-98a510fb2401-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "49c806d7-6ca0-45e9-91b9-98a510fb2401" (UID: "49c806d7-6ca0-45e9-91b9-98a510fb2401"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 18:00:39 crc kubenswrapper[5120]: I0316 18:00:39.367240 5120 reconciler_common.go:299] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/49c806d7-6ca0-45e9-91b9-98a510fb2401-kolla-config\") on node \"crc\" DevicePath \"\"" Mar 16 18:00:39 crc kubenswrapper[5120]: I0316 18:00:39.367253 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/49c806d7-6ca0-45e9-91b9-98a510fb2401-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 18:00:39 crc kubenswrapper[5120]: I0316 18:00:39.371025 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49c806d7-6ca0-45e9-91b9-98a510fb2401-kube-api-access-xw8x4" (OuterVolumeSpecName: "kube-api-access-xw8x4") pod "49c806d7-6ca0-45e9-91b9-98a510fb2401" (UID: "49c806d7-6ca0-45e9-91b9-98a510fb2401"). InnerVolumeSpecName "kube-api-access-xw8x4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 18:00:39 crc kubenswrapper[5120]: I0316 18:00:39.470147 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xw8x4\" (UniqueName: \"kubernetes.io/projected/49c806d7-6ca0-45e9-91b9-98a510fb2401-kube-api-access-xw8x4\") on node \"crc\" DevicePath \"\"" Mar 16 18:00:39 crc kubenswrapper[5120]: I0316 18:00:39.470191 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-76kq2\" (UniqueName: \"kubernetes.io/projected/382ae7db-49c0-4091-85f8-83cc29f1c73e-kube-api-access-76kq2\") on node \"crc\" DevicePath \"\"" Mar 16 18:00:39 crc kubenswrapper[5120]: I0316 18:00:39.470206 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/382ae7db-49c0-4091-85f8-83cc29f1c73e-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 18:00:39 crc kubenswrapper[5120]: I0316 18:00:39.556325 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/keystone-operator-controller-manager-75689cbc47-kqlwb"] Mar 16 18:00:39 crc kubenswrapper[5120]: I0316 18:00:39.556632 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-operators/keystone-operator-controller-manager-75689cbc47-kqlwb" podUID="df2f32a6-2b43-495a-be3d-53a4eb60b528" containerName="manager" containerID="cri-o://b9fe07ae635209f612192fd825702cbefd0e6ba46ce5f54233ac8da0f997fbf9" gracePeriod=10 Mar 16 18:00:39 crc kubenswrapper[5120]: I0316 18:00:39.651460 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="keystone-kuttl-tests/openstack-galera-1" podUID="0bb8ef5b-cbc0-4c37-a1fb-a0d15204c5c9" containerName="galera" containerID="cri-o://fc7c46634139a414fc6a3261d46acf56c9a76e273d8cbce56d84b94ae33e3121" gracePeriod=28 Mar 16 18:00:39 crc kubenswrapper[5120]: I0316 18:00:39.777802 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/keystone-operator-index-rrq9j"] Mar 16 18:00:39 crc kubenswrapper[5120]: I0316 18:00:39.778010 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-operators/keystone-operator-index-rrq9j" podUID="9a1292d7-3e03-4267-b305-26808b8fd162" containerName="registry-server" containerID="cri-o://262e38d62fd1776c859463a0eb9e46611c3970663cb3e27fda914e13bb3e1b16" gracePeriod=30 Mar 16 18:00:39 crc kubenswrapper[5120]: I0316 18:00:39.819889 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/057d2ef2813dbca67df99f545f5daea57175a3b6e27320c69396d55997228fj"] Mar 16 18:00:39 crc kubenswrapper[5120]: I0316 18:00:39.825625 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-operators/057d2ef2813dbca67df99f545f5daea57175a3b6e27320c69396d55997228fj"] Mar 16 18:00:40 crc kubenswrapper[5120]: I0316 18:00:40.097986 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/keystone-operator-controller-manager-75689cbc47-kqlwb" Mar 16 18:00:40 crc kubenswrapper[5120]: I0316 18:00:40.155941 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/keystone-operator-index-rrq9j" Mar 16 18:00:40 crc kubenswrapper[5120]: I0316 18:00:40.182623 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t7z2t\" (UniqueName: \"kubernetes.io/projected/df2f32a6-2b43-495a-be3d-53a4eb60b528-kube-api-access-t7z2t\") pod \"df2f32a6-2b43-495a-be3d-53a4eb60b528\" (UID: \"df2f32a6-2b43-495a-be3d-53a4eb60b528\") " Mar 16 18:00:40 crc kubenswrapper[5120]: I0316 18:00:40.182826 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/df2f32a6-2b43-495a-be3d-53a4eb60b528-apiservice-cert\") pod \"df2f32a6-2b43-495a-be3d-53a4eb60b528\" (UID: \"df2f32a6-2b43-495a-be3d-53a4eb60b528\") " Mar 16 18:00:40 crc kubenswrapper[5120]: I0316 18:00:40.183007 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tjnrq\" (UniqueName: \"kubernetes.io/projected/9a1292d7-3e03-4267-b305-26808b8fd162-kube-api-access-tjnrq\") pod \"9a1292d7-3e03-4267-b305-26808b8fd162\" (UID: \"9a1292d7-3e03-4267-b305-26808b8fd162\") " Mar 16 18:00:40 crc kubenswrapper[5120]: I0316 18:00:40.183268 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/df2f32a6-2b43-495a-be3d-53a4eb60b528-webhook-cert\") pod \"df2f32a6-2b43-495a-be3d-53a4eb60b528\" (UID: \"df2f32a6-2b43-495a-be3d-53a4eb60b528\") " Mar 16 18:00:40 crc kubenswrapper[5120]: I0316 18:00:40.191360 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/df2f32a6-2b43-495a-be3d-53a4eb60b528-apiservice-cert" (OuterVolumeSpecName: "apiservice-cert") pod "df2f32a6-2b43-495a-be3d-53a4eb60b528" (UID: "df2f32a6-2b43-495a-be3d-53a4eb60b528"). InnerVolumeSpecName "apiservice-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 18:00:40 crc kubenswrapper[5120]: I0316 18:00:40.195685 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/df2f32a6-2b43-495a-be3d-53a4eb60b528-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "df2f32a6-2b43-495a-be3d-53a4eb60b528" (UID: "df2f32a6-2b43-495a-be3d-53a4eb60b528"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 18:00:40 crc kubenswrapper[5120]: I0316 18:00:40.195954 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df2f32a6-2b43-495a-be3d-53a4eb60b528-kube-api-access-t7z2t" (OuterVolumeSpecName: "kube-api-access-t7z2t") pod "df2f32a6-2b43-495a-be3d-53a4eb60b528" (UID: "df2f32a6-2b43-495a-be3d-53a4eb60b528"). InnerVolumeSpecName "kube-api-access-t7z2t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 18:00:40 crc kubenswrapper[5120]: I0316 18:00:40.196260 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a1292d7-3e03-4267-b305-26808b8fd162-kube-api-access-tjnrq" (OuterVolumeSpecName: "kube-api-access-tjnrq") pod "9a1292d7-3e03-4267-b305-26808b8fd162" (UID: "9a1292d7-3e03-4267-b305-26808b8fd162"). InnerVolumeSpecName "kube-api-access-tjnrq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 18:00:40 crc kubenswrapper[5120]: I0316 18:00:40.286957 5120 reconciler_common.go:299] "Volume detached for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/df2f32a6-2b43-495a-be3d-53a4eb60b528-apiservice-cert\") on node \"crc\" DevicePath \"\"" Mar 16 18:00:40 crc kubenswrapper[5120]: I0316 18:00:40.287009 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tjnrq\" (UniqueName: \"kubernetes.io/projected/9a1292d7-3e03-4267-b305-26808b8fd162-kube-api-access-tjnrq\") on node \"crc\" DevicePath \"\"" Mar 16 18:00:40 crc kubenswrapper[5120]: I0316 18:00:40.287028 5120 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/df2f32a6-2b43-495a-be3d-53a4eb60b528-webhook-cert\") on node \"crc\" DevicePath \"\"" Mar 16 18:00:40 crc kubenswrapper[5120]: I0316 18:00:40.287047 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t7z2t\" (UniqueName: \"kubernetes.io/projected/df2f32a6-2b43-495a-be3d-53a4eb60b528-kube-api-access-t7z2t\") on node \"crc\" DevicePath \"\"" Mar 16 18:00:40 crc kubenswrapper[5120]: I0316 18:00:40.303615 5120 generic.go:358] "Generic (PLEG): container finished" podID="df2f32a6-2b43-495a-be3d-53a4eb60b528" containerID="b9fe07ae635209f612192fd825702cbefd0e6ba46ce5f54233ac8da0f997fbf9" exitCode=0 Mar 16 18:00:40 crc kubenswrapper[5120]: I0316 18:00:40.303698 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/keystone-operator-controller-manager-75689cbc47-kqlwb" event={"ID":"df2f32a6-2b43-495a-be3d-53a4eb60b528","Type":"ContainerDied","Data":"b9fe07ae635209f612192fd825702cbefd0e6ba46ce5f54233ac8da0f997fbf9"} Mar 16 18:00:40 crc kubenswrapper[5120]: I0316 18:00:40.303800 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/keystone-operator-controller-manager-75689cbc47-kqlwb" event={"ID":"df2f32a6-2b43-495a-be3d-53a4eb60b528","Type":"ContainerDied","Data":"f22ee70b3c41dbc51d40a5ca8881b6f466916ed3dedb0253fbcbc38466f89c87"} Mar 16 18:00:40 crc kubenswrapper[5120]: I0316 18:00:40.303714 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/keystone-operator-controller-manager-75689cbc47-kqlwb" Mar 16 18:00:40 crc kubenswrapper[5120]: I0316 18:00:40.303850 5120 scope.go:117] "RemoveContainer" containerID="b9fe07ae635209f612192fd825702cbefd0e6ba46ce5f54233ac8da0f997fbf9" Mar 16 18:00:40 crc kubenswrapper[5120]: I0316 18:00:40.305333 5120 generic.go:358] "Generic (PLEG): container finished" podID="9a1292d7-3e03-4267-b305-26808b8fd162" containerID="262e38d62fd1776c859463a0eb9e46611c3970663cb3e27fda914e13bb3e1b16" exitCode=0 Mar 16 18:00:40 crc kubenswrapper[5120]: I0316 18:00:40.305479 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/memcached-0" Mar 16 18:00:40 crc kubenswrapper[5120]: I0316 18:00:40.305853 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/keystone-operator-index-rrq9j" Mar 16 18:00:40 crc kubenswrapper[5120]: I0316 18:00:40.306232 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/keystone-operator-index-rrq9j" event={"ID":"9a1292d7-3e03-4267-b305-26808b8fd162","Type":"ContainerDied","Data":"262e38d62fd1776c859463a0eb9e46611c3970663cb3e27fda914e13bb3e1b16"} Mar 16 18:00:40 crc kubenswrapper[5120]: I0316 18:00:40.306277 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/keystone-operator-index-rrq9j" event={"ID":"9a1292d7-3e03-4267-b305-26808b8fd162","Type":"ContainerDied","Data":"8e9f4aecdf7df359b3afecf93ecd7d2dd93d9da6dc856cb9e0645c01628edda2"} Mar 16 18:00:40 crc kubenswrapper[5120]: I0316 18:00:40.329450 5120 scope.go:117] "RemoveContainer" containerID="b9fe07ae635209f612192fd825702cbefd0e6ba46ce5f54233ac8da0f997fbf9" Mar 16 18:00:40 crc kubenswrapper[5120]: E0316 18:00:40.329807 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b9fe07ae635209f612192fd825702cbefd0e6ba46ce5f54233ac8da0f997fbf9\": container with ID starting with b9fe07ae635209f612192fd825702cbefd0e6ba46ce5f54233ac8da0f997fbf9 not found: ID does not exist" containerID="b9fe07ae635209f612192fd825702cbefd0e6ba46ce5f54233ac8da0f997fbf9" Mar 16 18:00:40 crc kubenswrapper[5120]: I0316 18:00:40.329836 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9fe07ae635209f612192fd825702cbefd0e6ba46ce5f54233ac8da0f997fbf9"} err="failed to get container status \"b9fe07ae635209f612192fd825702cbefd0e6ba46ce5f54233ac8da0f997fbf9\": rpc error: code = NotFound desc = could not find container \"b9fe07ae635209f612192fd825702cbefd0e6ba46ce5f54233ac8da0f997fbf9\": container with ID starting with b9fe07ae635209f612192fd825702cbefd0e6ba46ce5f54233ac8da0f997fbf9 not found: ID does not exist" Mar 16 18:00:40 crc kubenswrapper[5120]: I0316 18:00:40.329856 5120 scope.go:117] "RemoveContainer" containerID="262e38d62fd1776c859463a0eb9e46611c3970663cb3e27fda914e13bb3e1b16" Mar 16 18:00:40 crc kubenswrapper[5120]: I0316 18:00:40.349461 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keystone-kuttl-tests/memcached-0"] Mar 16 18:00:40 crc kubenswrapper[5120]: I0316 18:00:40.355065 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["keystone-kuttl-tests/memcached-0"] Mar 16 18:00:40 crc kubenswrapper[5120]: I0316 18:00:40.362122 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/keystone-operator-controller-manager-75689cbc47-kqlwb"] Mar 16 18:00:40 crc kubenswrapper[5120]: I0316 18:00:40.368989 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-operators/keystone-operator-controller-manager-75689cbc47-kqlwb"] Mar 16 18:00:40 crc kubenswrapper[5120]: I0316 18:00:40.369153 5120 scope.go:117] "RemoveContainer" containerID="262e38d62fd1776c859463a0eb9e46611c3970663cb3e27fda914e13bb3e1b16" Mar 16 18:00:40 crc kubenswrapper[5120]: E0316 18:00:40.369632 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"262e38d62fd1776c859463a0eb9e46611c3970663cb3e27fda914e13bb3e1b16\": container with ID starting with 262e38d62fd1776c859463a0eb9e46611c3970663cb3e27fda914e13bb3e1b16 not found: ID does not exist" containerID="262e38d62fd1776c859463a0eb9e46611c3970663cb3e27fda914e13bb3e1b16" Mar 16 18:00:40 crc kubenswrapper[5120]: I0316 18:00:40.369669 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"262e38d62fd1776c859463a0eb9e46611c3970663cb3e27fda914e13bb3e1b16"} err="failed to get container status \"262e38d62fd1776c859463a0eb9e46611c3970663cb3e27fda914e13bb3e1b16\": rpc error: code = NotFound desc = could not find container \"262e38d62fd1776c859463a0eb9e46611c3970663cb3e27fda914e13bb3e1b16\": container with ID starting with 262e38d62fd1776c859463a0eb9e46611c3970663cb3e27fda914e13bb3e1b16 not found: ID does not exist" Mar 16 18:00:40 crc kubenswrapper[5120]: I0316 18:00:40.374293 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/keystone-operator-index-rrq9j"] Mar 16 18:00:40 crc kubenswrapper[5120]: I0316 18:00:40.378920 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-operators/keystone-operator-index-rrq9j"] Mar 16 18:00:40 crc kubenswrapper[5120]: I0316 18:00:40.673791 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="382ae7db-49c0-4091-85f8-83cc29f1c73e" path="/var/lib/kubelet/pods/382ae7db-49c0-4091-85f8-83cc29f1c73e/volumes" Mar 16 18:00:40 crc kubenswrapper[5120]: I0316 18:00:40.675502 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="49c806d7-6ca0-45e9-91b9-98a510fb2401" path="/var/lib/kubelet/pods/49c806d7-6ca0-45e9-91b9-98a510fb2401/volumes" Mar 16 18:00:40 crc kubenswrapper[5120]: I0316 18:00:40.676391 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a1292d7-3e03-4267-b305-26808b8fd162" path="/var/lib/kubelet/pods/9a1292d7-3e03-4267-b305-26808b8fd162/volumes" Mar 16 18:00:40 crc kubenswrapper[5120]: I0316 18:00:40.677067 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bef338fe-205b-4d75-98b6-5e25cdfd474f" path="/var/lib/kubelet/pods/bef338fe-205b-4d75-98b6-5e25cdfd474f/volumes" Mar 16 18:00:40 crc kubenswrapper[5120]: I0316 18:00:40.678338 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="df2f32a6-2b43-495a-be3d-53a4eb60b528" path="/var/lib/kubelet/pods/df2f32a6-2b43-495a-be3d-53a4eb60b528/volumes" Mar 16 18:00:40 crc kubenswrapper[5120]: I0316 18:00:40.679062 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e9e7b3a8-635a-4c6c-a036-2ea36ff33888" path="/var/lib/kubelet/pods/e9e7b3a8-635a-4c6c-a036-2ea36ff33888/volumes" Mar 16 18:00:40 crc kubenswrapper[5120]: I0316 18:00:40.867492 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/rabbitmq-server-0" Mar 16 18:00:41 crc kubenswrapper[5120]: I0316 18:00:41.019455 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/69818304-cbec-4828-a572-6bbc566dc6b7-plugins-conf\") pod \"69818304-cbec-4828-a572-6bbc566dc6b7\" (UID: \"69818304-cbec-4828-a572-6bbc566dc6b7\") " Mar 16 18:00:41 crc kubenswrapper[5120]: I0316 18:00:41.019519 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/69818304-cbec-4828-a572-6bbc566dc6b7-erlang-cookie-secret\") pod \"69818304-cbec-4828-a572-6bbc566dc6b7\" (UID: \"69818304-cbec-4828-a572-6bbc566dc6b7\") " Mar 16 18:00:41 crc kubenswrapper[5120]: I0316 18:00:41.019698 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w5q69\" (UniqueName: \"kubernetes.io/projected/69818304-cbec-4828-a572-6bbc566dc6b7-kube-api-access-w5q69\") pod \"69818304-cbec-4828-a572-6bbc566dc6b7\" (UID: \"69818304-cbec-4828-a572-6bbc566dc6b7\") " Mar 16 18:00:41 crc kubenswrapper[5120]: I0316 18:00:41.019928 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"persistence\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-66456a9b-2e8d-4f46-8bb0-3aa71b4bc3b8\") pod \"69818304-cbec-4828-a572-6bbc566dc6b7\" (UID: \"69818304-cbec-4828-a572-6bbc566dc6b7\") " Mar 16 18:00:41 crc kubenswrapper[5120]: I0316 18:00:41.020106 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/69818304-cbec-4828-a572-6bbc566dc6b7-pod-info\") pod \"69818304-cbec-4828-a572-6bbc566dc6b7\" (UID: \"69818304-cbec-4828-a572-6bbc566dc6b7\") " Mar 16 18:00:41 crc kubenswrapper[5120]: I0316 18:00:41.020178 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/69818304-cbec-4828-a572-6bbc566dc6b7-rabbitmq-confd\") pod \"69818304-cbec-4828-a572-6bbc566dc6b7\" (UID: \"69818304-cbec-4828-a572-6bbc566dc6b7\") " Mar 16 18:00:41 crc kubenswrapper[5120]: I0316 18:00:41.020332 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/69818304-cbec-4828-a572-6bbc566dc6b7-rabbitmq-plugins\") pod \"69818304-cbec-4828-a572-6bbc566dc6b7\" (UID: \"69818304-cbec-4828-a572-6bbc566dc6b7\") " Mar 16 18:00:41 crc kubenswrapper[5120]: I0316 18:00:41.020511 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/69818304-cbec-4828-a572-6bbc566dc6b7-rabbitmq-erlang-cookie\") pod \"69818304-cbec-4828-a572-6bbc566dc6b7\" (UID: \"69818304-cbec-4828-a572-6bbc566dc6b7\") " Mar 16 18:00:41 crc kubenswrapper[5120]: I0316 18:00:41.020896 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69818304-cbec-4828-a572-6bbc566dc6b7-rabbitmq-plugins" (OuterVolumeSpecName: "rabbitmq-plugins") pod "69818304-cbec-4828-a572-6bbc566dc6b7" (UID: "69818304-cbec-4828-a572-6bbc566dc6b7"). InnerVolumeSpecName "rabbitmq-plugins". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 18:00:41 crc kubenswrapper[5120]: I0316 18:00:41.020906 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69818304-cbec-4828-a572-6bbc566dc6b7-rabbitmq-erlang-cookie" (OuterVolumeSpecName: "rabbitmq-erlang-cookie") pod "69818304-cbec-4828-a572-6bbc566dc6b7" (UID: "69818304-cbec-4828-a572-6bbc566dc6b7"). InnerVolumeSpecName "rabbitmq-erlang-cookie". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 18:00:41 crc kubenswrapper[5120]: I0316 18:00:41.021096 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69818304-cbec-4828-a572-6bbc566dc6b7-plugins-conf" (OuterVolumeSpecName: "plugins-conf") pod "69818304-cbec-4828-a572-6bbc566dc6b7" (UID: "69818304-cbec-4828-a572-6bbc566dc6b7"). InnerVolumeSpecName "plugins-conf". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 18:00:41 crc kubenswrapper[5120]: I0316 18:00:41.021711 5120 reconciler_common.go:299] "Volume detached for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/69818304-cbec-4828-a572-6bbc566dc6b7-plugins-conf\") on node \"crc\" DevicePath \"\"" Mar 16 18:00:41 crc kubenswrapper[5120]: I0316 18:00:41.021746 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/69818304-cbec-4828-a572-6bbc566dc6b7-rabbitmq-plugins\") on node \"crc\" DevicePath \"\"" Mar 16 18:00:41 crc kubenswrapper[5120]: I0316 18:00:41.021786 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/69818304-cbec-4828-a572-6bbc566dc6b7-rabbitmq-erlang-cookie\") on node \"crc\" DevicePath \"\"" Mar 16 18:00:41 crc kubenswrapper[5120]: I0316 18:00:41.026043 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69818304-cbec-4828-a572-6bbc566dc6b7-kube-api-access-w5q69" (OuterVolumeSpecName: "kube-api-access-w5q69") pod "69818304-cbec-4828-a572-6bbc566dc6b7" (UID: "69818304-cbec-4828-a572-6bbc566dc6b7"). InnerVolumeSpecName "kube-api-access-w5q69". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 18:00:41 crc kubenswrapper[5120]: I0316 18:00:41.028852 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/69818304-cbec-4828-a572-6bbc566dc6b7-pod-info" (OuterVolumeSpecName: "pod-info") pod "69818304-cbec-4828-a572-6bbc566dc6b7" (UID: "69818304-cbec-4828-a572-6bbc566dc6b7"). InnerVolumeSpecName "pod-info". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Mar 16 18:00:41 crc kubenswrapper[5120]: I0316 18:00:41.028923 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69818304-cbec-4828-a572-6bbc566dc6b7-erlang-cookie-secret" (OuterVolumeSpecName: "erlang-cookie-secret") pod "69818304-cbec-4828-a572-6bbc566dc6b7" (UID: "69818304-cbec-4828-a572-6bbc566dc6b7"). InnerVolumeSpecName "erlang-cookie-secret". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 18:00:41 crc kubenswrapper[5120]: I0316 18:00:41.032456 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-66456a9b-2e8d-4f46-8bb0-3aa71b4bc3b8" (OuterVolumeSpecName: "persistence") pod "69818304-cbec-4828-a572-6bbc566dc6b7" (UID: "69818304-cbec-4828-a572-6bbc566dc6b7"). InnerVolumeSpecName "pvc-66456a9b-2e8d-4f46-8bb0-3aa71b4bc3b8". PluginName "kubernetes.io/csi", VolumeGIDValue "" Mar 16 18:00:41 crc kubenswrapper[5120]: I0316 18:00:41.105559 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69818304-cbec-4828-a572-6bbc566dc6b7-rabbitmq-confd" (OuterVolumeSpecName: "rabbitmq-confd") pod "69818304-cbec-4828-a572-6bbc566dc6b7" (UID: "69818304-cbec-4828-a572-6bbc566dc6b7"). InnerVolumeSpecName "rabbitmq-confd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 18:00:41 crc kubenswrapper[5120]: I0316 18:00:41.124309 5120 reconciler_common.go:299] "Volume detached for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/69818304-cbec-4828-a572-6bbc566dc6b7-erlang-cookie-secret\") on node \"crc\" DevicePath \"\"" Mar 16 18:00:41 crc kubenswrapper[5120]: I0316 18:00:41.124351 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w5q69\" (UniqueName: \"kubernetes.io/projected/69818304-cbec-4828-a572-6bbc566dc6b7-kube-api-access-w5q69\") on node \"crc\" DevicePath \"\"" Mar 16 18:00:41 crc kubenswrapper[5120]: I0316 18:00:41.124395 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"pvc-66456a9b-2e8d-4f46-8bb0-3aa71b4bc3b8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-66456a9b-2e8d-4f46-8bb0-3aa71b4bc3b8\") on node \"crc\" " Mar 16 18:00:41 crc kubenswrapper[5120]: I0316 18:00:41.124413 5120 reconciler_common.go:299] "Volume detached for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/69818304-cbec-4828-a572-6bbc566dc6b7-pod-info\") on node \"crc\" DevicePath \"\"" Mar 16 18:00:41 crc kubenswrapper[5120]: I0316 18:00:41.124427 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/69818304-cbec-4828-a572-6bbc566dc6b7-rabbitmq-confd\") on node \"crc\" DevicePath \"\"" Mar 16 18:00:41 crc kubenswrapper[5120]: I0316 18:00:41.143330 5120 csi_attacher.go:567] kubernetes.io/csi: attacher.UnmountDevice STAGE_UNSTAGE_VOLUME capability not set. Skipping UnmountDevice... Mar 16 18:00:41 crc kubenswrapper[5120]: I0316 18:00:41.144159 5120 operation_generator.go:895] UnmountDevice succeeded for volume "pvc-66456a9b-2e8d-4f46-8bb0-3aa71b4bc3b8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-66456a9b-2e8d-4f46-8bb0-3aa71b4bc3b8") on node "crc" Mar 16 18:00:41 crc kubenswrapper[5120]: I0316 18:00:41.226039 5120 reconciler_common.go:299] "Volume detached for volume \"pvc-66456a9b-2e8d-4f46-8bb0-3aa71b4bc3b8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-66456a9b-2e8d-4f46-8bb0-3aa71b4bc3b8\") on node \"crc\" DevicePath \"\"" Mar 16 18:00:41 crc kubenswrapper[5120]: I0316 18:00:41.318656 5120 generic.go:358] "Generic (PLEG): container finished" podID="69818304-cbec-4828-a572-6bbc566dc6b7" containerID="d640d0a123d6c4156f236bf2e2bce34c40bd81ba25310c0e23324ea8f867111d" exitCode=0 Mar 16 18:00:41 crc kubenswrapper[5120]: I0316 18:00:41.318796 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/rabbitmq-server-0" Mar 16 18:00:41 crc kubenswrapper[5120]: I0316 18:00:41.319091 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/rabbitmq-server-0" event={"ID":"69818304-cbec-4828-a572-6bbc566dc6b7","Type":"ContainerDied","Data":"d640d0a123d6c4156f236bf2e2bce34c40bd81ba25310c0e23324ea8f867111d"} Mar 16 18:00:41 crc kubenswrapper[5120]: I0316 18:00:41.319250 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/rabbitmq-server-0" event={"ID":"69818304-cbec-4828-a572-6bbc566dc6b7","Type":"ContainerDied","Data":"f5548292d5baa990bd33fb428ab1573746afa4730f42d37b87e4d6f247262978"} Mar 16 18:00:41 crc kubenswrapper[5120]: I0316 18:00:41.319295 5120 scope.go:117] "RemoveContainer" containerID="d640d0a123d6c4156f236bf2e2bce34c40bd81ba25310c0e23324ea8f867111d" Mar 16 18:00:41 crc kubenswrapper[5120]: I0316 18:00:41.349368 5120 scope.go:117] "RemoveContainer" containerID="4f437f705cee7518af5b9401afb484729c441326c169f297fdb3c8680e2fb728" Mar 16 18:00:41 crc kubenswrapper[5120]: I0316 18:00:41.361109 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/infra-operator-controller-manager-66bdcc97cd-6qtx8"] Mar 16 18:00:41 crc kubenswrapper[5120]: I0316 18:00:41.361400 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-operators/infra-operator-controller-manager-66bdcc97cd-6qtx8" podUID="bc9855c7-3e23-4753-8896-74e15d67f9a5" containerName="manager" containerID="cri-o://4148d78c8a0ff9215869e55b539b5de587176b1ae0649f8141b3f46204be178a" gracePeriod=10 Mar 16 18:00:41 crc kubenswrapper[5120]: I0316 18:00:41.386830 5120 scope.go:117] "RemoveContainer" containerID="d640d0a123d6c4156f236bf2e2bce34c40bd81ba25310c0e23324ea8f867111d" Mar 16 18:00:41 crc kubenswrapper[5120]: I0316 18:00:41.386952 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keystone-kuttl-tests/rabbitmq-server-0"] Mar 16 18:00:41 crc kubenswrapper[5120]: E0316 18:00:41.389172 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d640d0a123d6c4156f236bf2e2bce34c40bd81ba25310c0e23324ea8f867111d\": container with ID starting with d640d0a123d6c4156f236bf2e2bce34c40bd81ba25310c0e23324ea8f867111d not found: ID does not exist" containerID="d640d0a123d6c4156f236bf2e2bce34c40bd81ba25310c0e23324ea8f867111d" Mar 16 18:00:41 crc kubenswrapper[5120]: I0316 18:00:41.389214 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d640d0a123d6c4156f236bf2e2bce34c40bd81ba25310c0e23324ea8f867111d"} err="failed to get container status \"d640d0a123d6c4156f236bf2e2bce34c40bd81ba25310c0e23324ea8f867111d\": rpc error: code = NotFound desc = could not find container \"d640d0a123d6c4156f236bf2e2bce34c40bd81ba25310c0e23324ea8f867111d\": container with ID starting with d640d0a123d6c4156f236bf2e2bce34c40bd81ba25310c0e23324ea8f867111d not found: ID does not exist" Mar 16 18:00:41 crc kubenswrapper[5120]: I0316 18:00:41.389247 5120 scope.go:117] "RemoveContainer" containerID="4f437f705cee7518af5b9401afb484729c441326c169f297fdb3c8680e2fb728" Mar 16 18:00:41 crc kubenswrapper[5120]: E0316 18:00:41.389466 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f437f705cee7518af5b9401afb484729c441326c169f297fdb3c8680e2fb728\": container with ID starting with 4f437f705cee7518af5b9401afb484729c441326c169f297fdb3c8680e2fb728 not found: ID does not exist" containerID="4f437f705cee7518af5b9401afb484729c441326c169f297fdb3c8680e2fb728" Mar 16 18:00:41 crc kubenswrapper[5120]: I0316 18:00:41.389495 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f437f705cee7518af5b9401afb484729c441326c169f297fdb3c8680e2fb728"} err="failed to get container status \"4f437f705cee7518af5b9401afb484729c441326c169f297fdb3c8680e2fb728\": rpc error: code = NotFound desc = could not find container \"4f437f705cee7518af5b9401afb484729c441326c169f297fdb3c8680e2fb728\": container with ID starting with 4f437f705cee7518af5b9401afb484729c441326c169f297fdb3c8680e2fb728 not found: ID does not exist" Mar 16 18:00:41 crc kubenswrapper[5120]: I0316 18:00:41.395436 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["keystone-kuttl-tests/rabbitmq-server-0"] Mar 16 18:00:41 crc kubenswrapper[5120]: I0316 18:00:41.655299 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/infra-operator-index-4fgv7"] Mar 16 18:00:41 crc kubenswrapper[5120]: I0316 18:00:41.655613 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-operators/infra-operator-index-4fgv7" podUID="7eb6cd40-6ec1-43fb-bf5d-a37d95741e38" containerName="registry-server" containerID="cri-o://31b2d9fa75a0aa736b77ee5c83ba240f734bd22a004ac8cba019023109b65f2b" gracePeriod=30 Mar 16 18:00:41 crc kubenswrapper[5120]: I0316 18:00:41.696550 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/0b4c51a436ce56c4393293420dad5bb37f4e2c4f062c7176860d28159542cvm"] Mar 16 18:00:41 crc kubenswrapper[5120]: I0316 18:00:41.711225 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-operators/0b4c51a436ce56c4393293420dad5bb37f4e2c4f062c7176860d28159542cvm"] Mar 16 18:00:41 crc kubenswrapper[5120]: I0316 18:00:41.806601 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="keystone-kuttl-tests/openstack-galera-0" podUID="43151632-8fd6-41c2-abf2-ff0055c1237f" containerName="galera" containerID="cri-o://e9110202e26cc38766a3e07aca4ec516198be2c09bf100d75d5ea2b0b0aa6005" gracePeriod=26 Mar 16 18:00:41 crc kubenswrapper[5120]: I0316 18:00:41.973567 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/infra-operator-controller-manager-66bdcc97cd-6qtx8" Mar 16 18:00:41 crc kubenswrapper[5120]: I0316 18:00:41.987525 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/openstack-galera-1" Mar 16 18:00:42 crc kubenswrapper[5120]: I0316 18:00:42.051981 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bc9855c7-3e23-4753-8896-74e15d67f9a5-apiservice-cert\") pod \"bc9855c7-3e23-4753-8896-74e15d67f9a5\" (UID: \"bc9855c7-3e23-4753-8896-74e15d67f9a5\") " Mar 16 18:00:42 crc kubenswrapper[5120]: I0316 18:00:42.052125 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x5nwk\" (UniqueName: \"kubernetes.io/projected/bc9855c7-3e23-4753-8896-74e15d67f9a5-kube-api-access-x5nwk\") pod \"bc9855c7-3e23-4753-8896-74e15d67f9a5\" (UID: \"bc9855c7-3e23-4753-8896-74e15d67f9a5\") " Mar 16 18:00:42 crc kubenswrapper[5120]: I0316 18:00:42.052392 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bc9855c7-3e23-4753-8896-74e15d67f9a5-webhook-cert\") pod \"bc9855c7-3e23-4753-8896-74e15d67f9a5\" (UID: \"bc9855c7-3e23-4753-8896-74e15d67f9a5\") " Mar 16 18:00:42 crc kubenswrapper[5120]: I0316 18:00:42.057896 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bc9855c7-3e23-4753-8896-74e15d67f9a5-apiservice-cert" (OuterVolumeSpecName: "apiservice-cert") pod "bc9855c7-3e23-4753-8896-74e15d67f9a5" (UID: "bc9855c7-3e23-4753-8896-74e15d67f9a5"). InnerVolumeSpecName "apiservice-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 18:00:42 crc kubenswrapper[5120]: I0316 18:00:42.065309 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bc9855c7-3e23-4753-8896-74e15d67f9a5-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "bc9855c7-3e23-4753-8896-74e15d67f9a5" (UID: "bc9855c7-3e23-4753-8896-74e15d67f9a5"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 18:00:42 crc kubenswrapper[5120]: I0316 18:00:42.067077 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc9855c7-3e23-4753-8896-74e15d67f9a5-kube-api-access-x5nwk" (OuterVolumeSpecName: "kube-api-access-x5nwk") pod "bc9855c7-3e23-4753-8896-74e15d67f9a5" (UID: "bc9855c7-3e23-4753-8896-74e15d67f9a5"). InnerVolumeSpecName "kube-api-access-x5nwk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 18:00:42 crc kubenswrapper[5120]: I0316 18:00:42.154108 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7nmqq\" (UniqueName: \"kubernetes.io/projected/0bb8ef5b-cbc0-4c37-a1fb-a0d15204c5c9-kube-api-access-7nmqq\") pod \"0bb8ef5b-cbc0-4c37-a1fb-a0d15204c5c9\" (UID: \"0bb8ef5b-cbc0-4c37-a1fb-a0d15204c5c9\") " Mar 16 18:00:42 crc kubenswrapper[5120]: I0316 18:00:42.154265 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/0bb8ef5b-cbc0-4c37-a1fb-a0d15204c5c9-config-data-generated\") pod \"0bb8ef5b-cbc0-4c37-a1fb-a0d15204c5c9\" (UID: \"0bb8ef5b-cbc0-4c37-a1fb-a0d15204c5c9\") " Mar 16 18:00:42 crc kubenswrapper[5120]: I0316 18:00:42.154413 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/0bb8ef5b-cbc0-4c37-a1fb-a0d15204c5c9-kolla-config\") pod \"0bb8ef5b-cbc0-4c37-a1fb-a0d15204c5c9\" (UID: \"0bb8ef5b-cbc0-4c37-a1fb-a0d15204c5c9\") " Mar 16 18:00:42 crc kubenswrapper[5120]: I0316 18:00:42.154458 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"mysql-db\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") pod \"0bb8ef5b-cbc0-4c37-a1fb-a0d15204c5c9\" (UID: \"0bb8ef5b-cbc0-4c37-a1fb-a0d15204c5c9\") " Mar 16 18:00:42 crc kubenswrapper[5120]: I0316 18:00:42.154476 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0bb8ef5b-cbc0-4c37-a1fb-a0d15204c5c9-operator-scripts\") pod \"0bb8ef5b-cbc0-4c37-a1fb-a0d15204c5c9\" (UID: \"0bb8ef5b-cbc0-4c37-a1fb-a0d15204c5c9\") " Mar 16 18:00:42 crc kubenswrapper[5120]: I0316 18:00:42.154572 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/0bb8ef5b-cbc0-4c37-a1fb-a0d15204c5c9-config-data-default\") pod \"0bb8ef5b-cbc0-4c37-a1fb-a0d15204c5c9\" (UID: \"0bb8ef5b-cbc0-4c37-a1fb-a0d15204c5c9\") " Mar 16 18:00:42 crc kubenswrapper[5120]: I0316 18:00:42.155248 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0bb8ef5b-cbc0-4c37-a1fb-a0d15204c5c9-config-data-generated" (OuterVolumeSpecName: "config-data-generated") pod "0bb8ef5b-cbc0-4c37-a1fb-a0d15204c5c9" (UID: "0bb8ef5b-cbc0-4c37-a1fb-a0d15204c5c9"). InnerVolumeSpecName "config-data-generated". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 18:00:42 crc kubenswrapper[5120]: I0316 18:00:42.155278 5120 reconciler_common.go:299] "Volume detached for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bc9855c7-3e23-4753-8896-74e15d67f9a5-apiservice-cert\") on node \"crc\" DevicePath \"\"" Mar 16 18:00:42 crc kubenswrapper[5120]: I0316 18:00:42.155348 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x5nwk\" (UniqueName: \"kubernetes.io/projected/bc9855c7-3e23-4753-8896-74e15d67f9a5-kube-api-access-x5nwk\") on node \"crc\" DevicePath \"\"" Mar 16 18:00:42 crc kubenswrapper[5120]: I0316 18:00:42.155349 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0bb8ef5b-cbc0-4c37-a1fb-a0d15204c5c9-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "0bb8ef5b-cbc0-4c37-a1fb-a0d15204c5c9" (UID: "0bb8ef5b-cbc0-4c37-a1fb-a0d15204c5c9"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 18:00:42 crc kubenswrapper[5120]: I0316 18:00:42.155367 5120 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bc9855c7-3e23-4753-8896-74e15d67f9a5-webhook-cert\") on node \"crc\" DevicePath \"\"" Mar 16 18:00:42 crc kubenswrapper[5120]: I0316 18:00:42.155999 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0bb8ef5b-cbc0-4c37-a1fb-a0d15204c5c9-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "0bb8ef5b-cbc0-4c37-a1fb-a0d15204c5c9" (UID: "0bb8ef5b-cbc0-4c37-a1fb-a0d15204c5c9"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 18:00:42 crc kubenswrapper[5120]: I0316 18:00:42.159223 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0bb8ef5b-cbc0-4c37-a1fb-a0d15204c5c9-config-data-default" (OuterVolumeSpecName: "config-data-default") pod "0bb8ef5b-cbc0-4c37-a1fb-a0d15204c5c9" (UID: "0bb8ef5b-cbc0-4c37-a1fb-a0d15204c5c9"). InnerVolumeSpecName "config-data-default". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 18:00:42 crc kubenswrapper[5120]: I0316 18:00:42.161839 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0bb8ef5b-cbc0-4c37-a1fb-a0d15204c5c9-kube-api-access-7nmqq" (OuterVolumeSpecName: "kube-api-access-7nmqq") pod "0bb8ef5b-cbc0-4c37-a1fb-a0d15204c5c9" (UID: "0bb8ef5b-cbc0-4c37-a1fb-a0d15204c5c9"). InnerVolumeSpecName "kube-api-access-7nmqq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 18:00:42 crc kubenswrapper[5120]: I0316 18:00:42.168989 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage17-crc" (OuterVolumeSpecName: "mysql-db") pod "0bb8ef5b-cbc0-4c37-a1fb-a0d15204c5c9" (UID: "0bb8ef5b-cbc0-4c37-a1fb-a0d15204c5c9"). InnerVolumeSpecName "local-storage17-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 18:00:42 crc kubenswrapper[5120]: I0316 18:00:42.218436 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/infra-operator-index-4fgv7" Mar 16 18:00:42 crc kubenswrapper[5120]: I0316 18:00:42.262100 5120 reconciler_common.go:299] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/0bb8ef5b-cbc0-4c37-a1fb-a0d15204c5c9-kolla-config\") on node \"crc\" DevicePath \"\"" Mar 16 18:00:42 crc kubenswrapper[5120]: I0316 18:00:42.262394 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") on node \"crc\" " Mar 16 18:00:42 crc kubenswrapper[5120]: I0316 18:00:42.262468 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0bb8ef5b-cbc0-4c37-a1fb-a0d15204c5c9-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 18:00:42 crc kubenswrapper[5120]: I0316 18:00:42.262539 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/0bb8ef5b-cbc0-4c37-a1fb-a0d15204c5c9-config-data-default\") on node \"crc\" DevicePath \"\"" Mar 16 18:00:42 crc kubenswrapper[5120]: I0316 18:00:42.262632 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7nmqq\" (UniqueName: \"kubernetes.io/projected/0bb8ef5b-cbc0-4c37-a1fb-a0d15204c5c9-kube-api-access-7nmqq\") on node \"crc\" DevicePath \"\"" Mar 16 18:00:42 crc kubenswrapper[5120]: I0316 18:00:42.262723 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/0bb8ef5b-cbc0-4c37-a1fb-a0d15204c5c9-config-data-generated\") on node \"crc\" DevicePath \"\"" Mar 16 18:00:42 crc kubenswrapper[5120]: I0316 18:00:42.288310 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage17-crc" (UniqueName: "kubernetes.io/local-volume/local-storage17-crc") on node "crc" Mar 16 18:00:42 crc kubenswrapper[5120]: I0316 18:00:42.367639 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lq5lx\" (UniqueName: \"kubernetes.io/projected/7eb6cd40-6ec1-43fb-bf5d-a37d95741e38-kube-api-access-lq5lx\") pod \"7eb6cd40-6ec1-43fb-bf5d-a37d95741e38\" (UID: \"7eb6cd40-6ec1-43fb-bf5d-a37d95741e38\") " Mar 16 18:00:42 crc kubenswrapper[5120]: I0316 18:00:42.369019 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") on node \"crc\" DevicePath \"\"" Mar 16 18:00:42 crc kubenswrapper[5120]: I0316 18:00:42.374986 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7eb6cd40-6ec1-43fb-bf5d-a37d95741e38-kube-api-access-lq5lx" (OuterVolumeSpecName: "kube-api-access-lq5lx") pod "7eb6cd40-6ec1-43fb-bf5d-a37d95741e38" (UID: "7eb6cd40-6ec1-43fb-bf5d-a37d95741e38"). InnerVolumeSpecName "kube-api-access-lq5lx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 18:00:42 crc kubenswrapper[5120]: I0316 18:00:42.403926 5120 generic.go:358] "Generic (PLEG): container finished" podID="43151632-8fd6-41c2-abf2-ff0055c1237f" containerID="e9110202e26cc38766a3e07aca4ec516198be2c09bf100d75d5ea2b0b0aa6005" exitCode=0 Mar 16 18:00:42 crc kubenswrapper[5120]: I0316 18:00:42.404217 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/openstack-galera-0" event={"ID":"43151632-8fd6-41c2-abf2-ff0055c1237f","Type":"ContainerDied","Data":"e9110202e26cc38766a3e07aca4ec516198be2c09bf100d75d5ea2b0b0aa6005"} Mar 16 18:00:42 crc kubenswrapper[5120]: I0316 18:00:42.421693 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/mariadb-operator-controller-manager-bf5486b5c-mtrcb"] Mar 16 18:00:42 crc kubenswrapper[5120]: I0316 18:00:42.429792 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-operators/mariadb-operator-controller-manager-bf5486b5c-mtrcb" podUID="d20ab5f9-633e-4d27-a872-f7358080d68c" containerName="manager" containerID="cri-o://7d12d0dd482e46788415b7dfe391528678baf2f937d1eb9a4784ef43592d9f4c" gracePeriod=10 Mar 16 18:00:42 crc kubenswrapper[5120]: I0316 18:00:42.449551 5120 generic.go:358] "Generic (PLEG): container finished" podID="0bb8ef5b-cbc0-4c37-a1fb-a0d15204c5c9" containerID="fc7c46634139a414fc6a3261d46acf56c9a76e273d8cbce56d84b94ae33e3121" exitCode=0 Mar 16 18:00:42 crc kubenswrapper[5120]: I0316 18:00:42.449695 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/openstack-galera-1" event={"ID":"0bb8ef5b-cbc0-4c37-a1fb-a0d15204c5c9","Type":"ContainerDied","Data":"fc7c46634139a414fc6a3261d46acf56c9a76e273d8cbce56d84b94ae33e3121"} Mar 16 18:00:42 crc kubenswrapper[5120]: I0316 18:00:42.449729 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/openstack-galera-1" event={"ID":"0bb8ef5b-cbc0-4c37-a1fb-a0d15204c5c9","Type":"ContainerDied","Data":"93d2ebb2d3ddde8ac61bc65e1179c53bf96679c51c28537adbefad7dd6c73ca1"} Mar 16 18:00:42 crc kubenswrapper[5120]: I0316 18:00:42.449750 5120 scope.go:117] "RemoveContainer" containerID="fc7c46634139a414fc6a3261d46acf56c9a76e273d8cbce56d84b94ae33e3121" Mar 16 18:00:42 crc kubenswrapper[5120]: I0316 18:00:42.449795 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/openstack-galera-1" Mar 16 18:00:42 crc kubenswrapper[5120]: I0316 18:00:42.474575 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lq5lx\" (UniqueName: \"kubernetes.io/projected/7eb6cd40-6ec1-43fb-bf5d-a37d95741e38-kube-api-access-lq5lx\") on node \"crc\" DevicePath \"\"" Mar 16 18:00:42 crc kubenswrapper[5120]: E0316 18:00:42.489262 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of e9110202e26cc38766a3e07aca4ec516198be2c09bf100d75d5ea2b0b0aa6005 is running failed: container process not found" containerID="e9110202e26cc38766a3e07aca4ec516198be2c09bf100d75d5ea2b0b0aa6005" cmd=["/bin/bash","/var/lib/operator-scripts/mysql_probe.sh","readiness"] Mar 16 18:00:42 crc kubenswrapper[5120]: I0316 18:00:42.498246 5120 generic.go:358] "Generic (PLEG): container finished" podID="bc9855c7-3e23-4753-8896-74e15d67f9a5" containerID="4148d78c8a0ff9215869e55b539b5de587176b1ae0649f8141b3f46204be178a" exitCode=0 Mar 16 18:00:42 crc kubenswrapper[5120]: I0316 18:00:42.498430 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/infra-operator-controller-manager-66bdcc97cd-6qtx8" event={"ID":"bc9855c7-3e23-4753-8896-74e15d67f9a5","Type":"ContainerDied","Data":"4148d78c8a0ff9215869e55b539b5de587176b1ae0649f8141b3f46204be178a"} Mar 16 18:00:42 crc kubenswrapper[5120]: I0316 18:00:42.498471 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/infra-operator-controller-manager-66bdcc97cd-6qtx8" event={"ID":"bc9855c7-3e23-4753-8896-74e15d67f9a5","Type":"ContainerDied","Data":"981bffb15e178726c0d46e84a0faf191b05f9106de16e2ed0e2119045c64bb95"} Mar 16 18:00:42 crc kubenswrapper[5120]: E0316 18:00:42.498518 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of e9110202e26cc38766a3e07aca4ec516198be2c09bf100d75d5ea2b0b0aa6005 is running failed: container process not found" containerID="e9110202e26cc38766a3e07aca4ec516198be2c09bf100d75d5ea2b0b0aa6005" cmd=["/bin/bash","/var/lib/operator-scripts/mysql_probe.sh","readiness"] Mar 16 18:00:42 crc kubenswrapper[5120]: I0316 18:00:42.498742 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/infra-operator-controller-manager-66bdcc97cd-6qtx8" Mar 16 18:00:42 crc kubenswrapper[5120]: E0316 18:00:42.502955 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of e9110202e26cc38766a3e07aca4ec516198be2c09bf100d75d5ea2b0b0aa6005 is running failed: container process not found" containerID="e9110202e26cc38766a3e07aca4ec516198be2c09bf100d75d5ea2b0b0aa6005" cmd=["/bin/bash","/var/lib/operator-scripts/mysql_probe.sh","readiness"] Mar 16 18:00:42 crc kubenswrapper[5120]: E0316 18:00:42.502993 5120 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of e9110202e26cc38766a3e07aca4ec516198be2c09bf100d75d5ea2b0b0aa6005 is running failed: container process not found" probeType="Readiness" pod="keystone-kuttl-tests/openstack-galera-0" podUID="43151632-8fd6-41c2-abf2-ff0055c1237f" containerName="galera" probeResult="unknown" Mar 16 18:00:42 crc kubenswrapper[5120]: I0316 18:00:42.519121 5120 generic.go:358] "Generic (PLEG): container finished" podID="7eb6cd40-6ec1-43fb-bf5d-a37d95741e38" containerID="31b2d9fa75a0aa736b77ee5c83ba240f734bd22a004ac8cba019023109b65f2b" exitCode=0 Mar 16 18:00:42 crc kubenswrapper[5120]: I0316 18:00:42.519375 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/infra-operator-index-4fgv7" event={"ID":"7eb6cd40-6ec1-43fb-bf5d-a37d95741e38","Type":"ContainerDied","Data":"31b2d9fa75a0aa736b77ee5c83ba240f734bd22a004ac8cba019023109b65f2b"} Mar 16 18:00:42 crc kubenswrapper[5120]: I0316 18:00:42.519417 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/infra-operator-index-4fgv7" event={"ID":"7eb6cd40-6ec1-43fb-bf5d-a37d95741e38","Type":"ContainerDied","Data":"50cf32fd77e9018855edbc28ca9309ce812ba313eeb7d536f0477143e6c873b3"} Mar 16 18:00:42 crc kubenswrapper[5120]: I0316 18:00:42.519559 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/infra-operator-index-4fgv7" Mar 16 18:00:42 crc kubenswrapper[5120]: I0316 18:00:42.564064 5120 scope.go:117] "RemoveContainer" containerID="e784879447c00bcd36e962b8214c898575129ecb5716f7ccd60936d8419e699d" Mar 16 18:00:42 crc kubenswrapper[5120]: I0316 18:00:42.630356 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keystone-kuttl-tests/openstack-galera-1"] Mar 16 18:00:42 crc kubenswrapper[5120]: I0316 18:00:42.681537 5120 scope.go:117] "RemoveContainer" containerID="fc7c46634139a414fc6a3261d46acf56c9a76e273d8cbce56d84b94ae33e3121" Mar 16 18:00:42 crc kubenswrapper[5120]: E0316 18:00:42.682376 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc7c46634139a414fc6a3261d46acf56c9a76e273d8cbce56d84b94ae33e3121\": container with ID starting with fc7c46634139a414fc6a3261d46acf56c9a76e273d8cbce56d84b94ae33e3121 not found: ID does not exist" containerID="fc7c46634139a414fc6a3261d46acf56c9a76e273d8cbce56d84b94ae33e3121" Mar 16 18:00:42 crc kubenswrapper[5120]: I0316 18:00:42.682406 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc7c46634139a414fc6a3261d46acf56c9a76e273d8cbce56d84b94ae33e3121"} err="failed to get container status \"fc7c46634139a414fc6a3261d46acf56c9a76e273d8cbce56d84b94ae33e3121\": rpc error: code = NotFound desc = could not find container \"fc7c46634139a414fc6a3261d46acf56c9a76e273d8cbce56d84b94ae33e3121\": container with ID starting with fc7c46634139a414fc6a3261d46acf56c9a76e273d8cbce56d84b94ae33e3121 not found: ID does not exist" Mar 16 18:00:42 crc kubenswrapper[5120]: I0316 18:00:42.682425 5120 scope.go:117] "RemoveContainer" containerID="e784879447c00bcd36e962b8214c898575129ecb5716f7ccd60936d8419e699d" Mar 16 18:00:42 crc kubenswrapper[5120]: E0316 18:00:42.684397 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e784879447c00bcd36e962b8214c898575129ecb5716f7ccd60936d8419e699d\": container with ID starting with e784879447c00bcd36e962b8214c898575129ecb5716f7ccd60936d8419e699d not found: ID does not exist" containerID="e784879447c00bcd36e962b8214c898575129ecb5716f7ccd60936d8419e699d" Mar 16 18:00:42 crc kubenswrapper[5120]: I0316 18:00:42.684435 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e784879447c00bcd36e962b8214c898575129ecb5716f7ccd60936d8419e699d"} err="failed to get container status \"e784879447c00bcd36e962b8214c898575129ecb5716f7ccd60936d8419e699d\": rpc error: code = NotFound desc = could not find container \"e784879447c00bcd36e962b8214c898575129ecb5716f7ccd60936d8419e699d\": container with ID starting with e784879447c00bcd36e962b8214c898575129ecb5716f7ccd60936d8419e699d not found: ID does not exist" Mar 16 18:00:42 crc kubenswrapper[5120]: I0316 18:00:42.684464 5120 scope.go:117] "RemoveContainer" containerID="4148d78c8a0ff9215869e55b539b5de587176b1ae0649f8141b3f46204be178a" Mar 16 18:00:42 crc kubenswrapper[5120]: I0316 18:00:42.684730 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3452762f-2df3-4129-92bc-7c3591f6ad3b" path="/var/lib/kubelet/pods/3452762f-2df3-4129-92bc-7c3591f6ad3b/volumes" Mar 16 18:00:42 crc kubenswrapper[5120]: I0316 18:00:42.685505 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="69818304-cbec-4828-a572-6bbc566dc6b7" path="/var/lib/kubelet/pods/69818304-cbec-4828-a572-6bbc566dc6b7/volumes" Mar 16 18:00:42 crc kubenswrapper[5120]: I0316 18:00:42.686484 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["keystone-kuttl-tests/openstack-galera-1"] Mar 16 18:00:42 crc kubenswrapper[5120]: I0316 18:00:42.694702 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/mariadb-operator-index-wfr2p"] Mar 16 18:00:42 crc kubenswrapper[5120]: I0316 18:00:42.694974 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-operators/mariadb-operator-index-wfr2p" podUID="33bebaaa-0edc-42f1-98ff-9a2cc108b7f2" containerName="registry-server" containerID="cri-o://1aa92757f9e2609ac96eabfcaac50a13046bee9512f910e9773776e6f265d152" gracePeriod=30 Mar 16 18:00:42 crc kubenswrapper[5120]: I0316 18:00:42.713541 5120 scope.go:117] "RemoveContainer" containerID="4148d78c8a0ff9215869e55b539b5de587176b1ae0649f8141b3f46204be178a" Mar 16 18:00:42 crc kubenswrapper[5120]: I0316 18:00:42.716124 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/infra-operator-controller-manager-66bdcc97cd-6qtx8"] Mar 16 18:00:42 crc kubenswrapper[5120]: E0316 18:00:42.725931 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4148d78c8a0ff9215869e55b539b5de587176b1ae0649f8141b3f46204be178a\": container with ID starting with 4148d78c8a0ff9215869e55b539b5de587176b1ae0649f8141b3f46204be178a not found: ID does not exist" containerID="4148d78c8a0ff9215869e55b539b5de587176b1ae0649f8141b3f46204be178a" Mar 16 18:00:42 crc kubenswrapper[5120]: I0316 18:00:42.725980 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4148d78c8a0ff9215869e55b539b5de587176b1ae0649f8141b3f46204be178a"} err="failed to get container status \"4148d78c8a0ff9215869e55b539b5de587176b1ae0649f8141b3f46204be178a\": rpc error: code = NotFound desc = could not find container \"4148d78c8a0ff9215869e55b539b5de587176b1ae0649f8141b3f46204be178a\": container with ID starting with 4148d78c8a0ff9215869e55b539b5de587176b1ae0649f8141b3f46204be178a not found: ID does not exist" Mar 16 18:00:42 crc kubenswrapper[5120]: I0316 18:00:42.726007 5120 scope.go:117] "RemoveContainer" containerID="31b2d9fa75a0aa736b77ee5c83ba240f734bd22a004ac8cba019023109b65f2b" Mar 16 18:00:42 crc kubenswrapper[5120]: I0316 18:00:42.736145 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-operators/infra-operator-controller-manager-66bdcc97cd-6qtx8"] Mar 16 18:00:42 crc kubenswrapper[5120]: I0316 18:00:42.771977 5120 scope.go:117] "RemoveContainer" containerID="31b2d9fa75a0aa736b77ee5c83ba240f734bd22a004ac8cba019023109b65f2b" Mar 16 18:00:42 crc kubenswrapper[5120]: E0316 18:00:42.789182 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"31b2d9fa75a0aa736b77ee5c83ba240f734bd22a004ac8cba019023109b65f2b\": container with ID starting with 31b2d9fa75a0aa736b77ee5c83ba240f734bd22a004ac8cba019023109b65f2b not found: ID does not exist" containerID="31b2d9fa75a0aa736b77ee5c83ba240f734bd22a004ac8cba019023109b65f2b" Mar 16 18:00:42 crc kubenswrapper[5120]: I0316 18:00:42.789240 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31b2d9fa75a0aa736b77ee5c83ba240f734bd22a004ac8cba019023109b65f2b"} err="failed to get container status \"31b2d9fa75a0aa736b77ee5c83ba240f734bd22a004ac8cba019023109b65f2b\": rpc error: code = NotFound desc = could not find container \"31b2d9fa75a0aa736b77ee5c83ba240f734bd22a004ac8cba019023109b65f2b\": container with ID starting with 31b2d9fa75a0aa736b77ee5c83ba240f734bd22a004ac8cba019023109b65f2b not found: ID does not exist" Mar 16 18:00:42 crc kubenswrapper[5120]: I0316 18:00:42.790820 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/infra-operator-index-4fgv7"] Mar 16 18:00:42 crc kubenswrapper[5120]: I0316 18:00:42.817975 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-operators/infra-operator-index-4fgv7"] Mar 16 18:00:42 crc kubenswrapper[5120]: I0316 18:00:42.871431 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/1b4ccfde3488142cc254fb313062ed88e2d18a60b7907f7b7c6ca34028xbj2q"] Mar 16 18:00:42 crc kubenswrapper[5120]: I0316 18:00:42.879305 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-operators/1b4ccfde3488142cc254fb313062ed88e2d18a60b7907f7b7c6ca34028xbj2q"] Mar 16 18:00:42 crc kubenswrapper[5120]: I0316 18:00:42.947496 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/openstack-galera-0" Mar 16 18:00:43 crc kubenswrapper[5120]: I0316 18:00:43.094830 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/43151632-8fd6-41c2-abf2-ff0055c1237f-kolla-config\") pod \"43151632-8fd6-41c2-abf2-ff0055c1237f\" (UID: \"43151632-8fd6-41c2-abf2-ff0055c1237f\") " Mar 16 18:00:43 crc kubenswrapper[5120]: I0316 18:00:43.095109 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"mysql-db\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"43151632-8fd6-41c2-abf2-ff0055c1237f\" (UID: \"43151632-8fd6-41c2-abf2-ff0055c1237f\") " Mar 16 18:00:43 crc kubenswrapper[5120]: I0316 18:00:43.095386 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/43151632-8fd6-41c2-abf2-ff0055c1237f-operator-scripts\") pod \"43151632-8fd6-41c2-abf2-ff0055c1237f\" (UID: \"43151632-8fd6-41c2-abf2-ff0055c1237f\") " Mar 16 18:00:43 crc kubenswrapper[5120]: I0316 18:00:43.095458 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/43151632-8fd6-41c2-abf2-ff0055c1237f-config-data-default\") pod \"43151632-8fd6-41c2-abf2-ff0055c1237f\" (UID: \"43151632-8fd6-41c2-abf2-ff0055c1237f\") " Mar 16 18:00:43 crc kubenswrapper[5120]: I0316 18:00:43.095936 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-twxnv\" (UniqueName: \"kubernetes.io/projected/43151632-8fd6-41c2-abf2-ff0055c1237f-kube-api-access-twxnv\") pod \"43151632-8fd6-41c2-abf2-ff0055c1237f\" (UID: \"43151632-8fd6-41c2-abf2-ff0055c1237f\") " Mar 16 18:00:43 crc kubenswrapper[5120]: I0316 18:00:43.096084 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/43151632-8fd6-41c2-abf2-ff0055c1237f-config-data-generated\") pod \"43151632-8fd6-41c2-abf2-ff0055c1237f\" (UID: \"43151632-8fd6-41c2-abf2-ff0055c1237f\") " Mar 16 18:00:43 crc kubenswrapper[5120]: I0316 18:00:43.098065 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/43151632-8fd6-41c2-abf2-ff0055c1237f-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "43151632-8fd6-41c2-abf2-ff0055c1237f" (UID: "43151632-8fd6-41c2-abf2-ff0055c1237f"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 18:00:43 crc kubenswrapper[5120]: I0316 18:00:43.098121 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/43151632-8fd6-41c2-abf2-ff0055c1237f-config-data-default" (OuterVolumeSpecName: "config-data-default") pod "43151632-8fd6-41c2-abf2-ff0055c1237f" (UID: "43151632-8fd6-41c2-abf2-ff0055c1237f"). InnerVolumeSpecName "config-data-default". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 18:00:43 crc kubenswrapper[5120]: I0316 18:00:43.098717 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43151632-8fd6-41c2-abf2-ff0055c1237f-config-data-generated" (OuterVolumeSpecName: "config-data-generated") pod "43151632-8fd6-41c2-abf2-ff0055c1237f" (UID: "43151632-8fd6-41c2-abf2-ff0055c1237f"). InnerVolumeSpecName "config-data-generated". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 18:00:43 crc kubenswrapper[5120]: I0316 18:00:43.098999 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/43151632-8fd6-41c2-abf2-ff0055c1237f-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "43151632-8fd6-41c2-abf2-ff0055c1237f" (UID: "43151632-8fd6-41c2-abf2-ff0055c1237f"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 18:00:43 crc kubenswrapper[5120]: I0316 18:00:43.109330 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/43151632-8fd6-41c2-abf2-ff0055c1237f-kube-api-access-twxnv" (OuterVolumeSpecName: "kube-api-access-twxnv") pod "43151632-8fd6-41c2-abf2-ff0055c1237f" (UID: "43151632-8fd6-41c2-abf2-ff0055c1237f"). InnerVolumeSpecName "kube-api-access-twxnv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 18:00:43 crc kubenswrapper[5120]: I0316 18:00:43.125087 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage03-crc" (OuterVolumeSpecName: "mysql-db") pod "43151632-8fd6-41c2-abf2-ff0055c1237f" (UID: "43151632-8fd6-41c2-abf2-ff0055c1237f"). InnerVolumeSpecName "local-storage03-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 18:00:43 crc kubenswrapper[5120]: I0316 18:00:43.168298 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/mariadb-operator-index-wfr2p" Mar 16 18:00:43 crc kubenswrapper[5120]: I0316 18:00:43.198601 5120 reconciler_common.go:299] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/43151632-8fd6-41c2-abf2-ff0055c1237f-kolla-config\") on node \"crc\" DevicePath \"\"" Mar 16 18:00:43 crc kubenswrapper[5120]: I0316 18:00:43.198659 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") on node \"crc\" " Mar 16 18:00:43 crc kubenswrapper[5120]: I0316 18:00:43.198673 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/43151632-8fd6-41c2-abf2-ff0055c1237f-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 18:00:43 crc kubenswrapper[5120]: I0316 18:00:43.198683 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/43151632-8fd6-41c2-abf2-ff0055c1237f-config-data-default\") on node \"crc\" DevicePath \"\"" Mar 16 18:00:43 crc kubenswrapper[5120]: I0316 18:00:43.198694 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-twxnv\" (UniqueName: \"kubernetes.io/projected/43151632-8fd6-41c2-abf2-ff0055c1237f-kube-api-access-twxnv\") on node \"crc\" DevicePath \"\"" Mar 16 18:00:43 crc kubenswrapper[5120]: I0316 18:00:43.198704 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/43151632-8fd6-41c2-abf2-ff0055c1237f-config-data-generated\") on node \"crc\" DevicePath \"\"" Mar 16 18:00:43 crc kubenswrapper[5120]: I0316 18:00:43.221039 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage03-crc" (UniqueName: "kubernetes.io/local-volume/local-storage03-crc") on node "crc" Mar 16 18:00:43 crc kubenswrapper[5120]: I0316 18:00:43.300246 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-24pxf\" (UniqueName: \"kubernetes.io/projected/33bebaaa-0edc-42f1-98ff-9a2cc108b7f2-kube-api-access-24pxf\") pod \"33bebaaa-0edc-42f1-98ff-9a2cc108b7f2\" (UID: \"33bebaaa-0edc-42f1-98ff-9a2cc108b7f2\") " Mar 16 18:00:43 crc kubenswrapper[5120]: I0316 18:00:43.300804 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") on node \"crc\" DevicePath \"\"" Mar 16 18:00:43 crc kubenswrapper[5120]: I0316 18:00:43.303854 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33bebaaa-0edc-42f1-98ff-9a2cc108b7f2-kube-api-access-24pxf" (OuterVolumeSpecName: "kube-api-access-24pxf") pod "33bebaaa-0edc-42f1-98ff-9a2cc108b7f2" (UID: "33bebaaa-0edc-42f1-98ff-9a2cc108b7f2"). InnerVolumeSpecName "kube-api-access-24pxf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 18:00:43 crc kubenswrapper[5120]: I0316 18:00:43.337649 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/mariadb-operator-controller-manager-bf5486b5c-mtrcb" Mar 16 18:00:43 crc kubenswrapper[5120]: I0316 18:00:43.403367 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-24pxf\" (UniqueName: \"kubernetes.io/projected/33bebaaa-0edc-42f1-98ff-9a2cc108b7f2-kube-api-access-24pxf\") on node \"crc\" DevicePath \"\"" Mar 16 18:00:43 crc kubenswrapper[5120]: I0316 18:00:43.504225 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p2jm6\" (UniqueName: \"kubernetes.io/projected/d20ab5f9-633e-4d27-a872-f7358080d68c-kube-api-access-p2jm6\") pod \"d20ab5f9-633e-4d27-a872-f7358080d68c\" (UID: \"d20ab5f9-633e-4d27-a872-f7358080d68c\") " Mar 16 18:00:43 crc kubenswrapper[5120]: I0316 18:00:43.504627 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d20ab5f9-633e-4d27-a872-f7358080d68c-webhook-cert\") pod \"d20ab5f9-633e-4d27-a872-f7358080d68c\" (UID: \"d20ab5f9-633e-4d27-a872-f7358080d68c\") " Mar 16 18:00:43 crc kubenswrapper[5120]: I0316 18:00:43.504997 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d20ab5f9-633e-4d27-a872-f7358080d68c-apiservice-cert\") pod \"d20ab5f9-633e-4d27-a872-f7358080d68c\" (UID: \"d20ab5f9-633e-4d27-a872-f7358080d68c\") " Mar 16 18:00:43 crc kubenswrapper[5120]: I0316 18:00:43.508716 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d20ab5f9-633e-4d27-a872-f7358080d68c-apiservice-cert" (OuterVolumeSpecName: "apiservice-cert") pod "d20ab5f9-633e-4d27-a872-f7358080d68c" (UID: "d20ab5f9-633e-4d27-a872-f7358080d68c"). InnerVolumeSpecName "apiservice-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 18:00:43 crc kubenswrapper[5120]: I0316 18:00:43.508781 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d20ab5f9-633e-4d27-a872-f7358080d68c-kube-api-access-p2jm6" (OuterVolumeSpecName: "kube-api-access-p2jm6") pod "d20ab5f9-633e-4d27-a872-f7358080d68c" (UID: "d20ab5f9-633e-4d27-a872-f7358080d68c"). InnerVolumeSpecName "kube-api-access-p2jm6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 18:00:43 crc kubenswrapper[5120]: I0316 18:00:43.508909 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d20ab5f9-633e-4d27-a872-f7358080d68c-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "d20ab5f9-633e-4d27-a872-f7358080d68c" (UID: "d20ab5f9-633e-4d27-a872-f7358080d68c"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 18:00:43 crc kubenswrapper[5120]: I0316 18:00:43.553191 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/openstack-galera-0" Mar 16 18:00:43 crc kubenswrapper[5120]: I0316 18:00:43.553182 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/openstack-galera-0" event={"ID":"43151632-8fd6-41c2-abf2-ff0055c1237f","Type":"ContainerDied","Data":"8bf1f81b6360c8a56df18414d06e48739bff0d6a78fd5d7e42f473a82be993a1"} Mar 16 18:00:43 crc kubenswrapper[5120]: I0316 18:00:43.553386 5120 scope.go:117] "RemoveContainer" containerID="e9110202e26cc38766a3e07aca4ec516198be2c09bf100d75d5ea2b0b0aa6005" Mar 16 18:00:43 crc kubenswrapper[5120]: I0316 18:00:43.556449 5120 generic.go:358] "Generic (PLEG): container finished" podID="d20ab5f9-633e-4d27-a872-f7358080d68c" containerID="7d12d0dd482e46788415b7dfe391528678baf2f937d1eb9a4784ef43592d9f4c" exitCode=0 Mar 16 18:00:43 crc kubenswrapper[5120]: I0316 18:00:43.556534 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/mariadb-operator-controller-manager-bf5486b5c-mtrcb" Mar 16 18:00:43 crc kubenswrapper[5120]: I0316 18:00:43.556561 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/mariadb-operator-controller-manager-bf5486b5c-mtrcb" event={"ID":"d20ab5f9-633e-4d27-a872-f7358080d68c","Type":"ContainerDied","Data":"7d12d0dd482e46788415b7dfe391528678baf2f937d1eb9a4784ef43592d9f4c"} Mar 16 18:00:43 crc kubenswrapper[5120]: I0316 18:00:43.556606 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/mariadb-operator-controller-manager-bf5486b5c-mtrcb" event={"ID":"d20ab5f9-633e-4d27-a872-f7358080d68c","Type":"ContainerDied","Data":"986c3a21903b62edb417782120593e439fe4433e1dc07b63766a28ab2f7e421f"} Mar 16 18:00:43 crc kubenswrapper[5120]: I0316 18:00:43.562711 5120 generic.go:358] "Generic (PLEG): container finished" podID="33bebaaa-0edc-42f1-98ff-9a2cc108b7f2" containerID="1aa92757f9e2609ac96eabfcaac50a13046bee9512f910e9773776e6f265d152" exitCode=0 Mar 16 18:00:43 crc kubenswrapper[5120]: I0316 18:00:43.562817 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/mariadb-operator-index-wfr2p" event={"ID":"33bebaaa-0edc-42f1-98ff-9a2cc108b7f2","Type":"ContainerDied","Data":"1aa92757f9e2609ac96eabfcaac50a13046bee9512f910e9773776e6f265d152"} Mar 16 18:00:43 crc kubenswrapper[5120]: I0316 18:00:43.562837 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/mariadb-operator-index-wfr2p" event={"ID":"33bebaaa-0edc-42f1-98ff-9a2cc108b7f2","Type":"ContainerDied","Data":"59078d0dd6b9b43dd9390648cd2b9c973a41e0819819b41bee60f6c9466aa18e"} Mar 16 18:00:43 crc kubenswrapper[5120]: I0316 18:00:43.562899 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/mariadb-operator-index-wfr2p" Mar 16 18:00:43 crc kubenswrapper[5120]: I0316 18:00:43.590826 5120 scope.go:117] "RemoveContainer" containerID="32b5054341699003b1e3669a0661e92e1c428ec0f4d03dbb810bc51c2c9ceb9a" Mar 16 18:00:43 crc kubenswrapper[5120]: I0316 18:00:43.592975 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keystone-kuttl-tests/openstack-galera-0"] Mar 16 18:00:43 crc kubenswrapper[5120]: I0316 18:00:43.598317 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["keystone-kuttl-tests/openstack-galera-0"] Mar 16 18:00:43 crc kubenswrapper[5120]: I0316 18:00:43.607327 5120 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d20ab5f9-633e-4d27-a872-f7358080d68c-webhook-cert\") on node \"crc\" DevicePath \"\"" Mar 16 18:00:43 crc kubenswrapper[5120]: I0316 18:00:43.607367 5120 reconciler_common.go:299] "Volume detached for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d20ab5f9-633e-4d27-a872-f7358080d68c-apiservice-cert\") on node \"crc\" DevicePath \"\"" Mar 16 18:00:43 crc kubenswrapper[5120]: I0316 18:00:43.607400 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p2jm6\" (UniqueName: \"kubernetes.io/projected/d20ab5f9-633e-4d27-a872-f7358080d68c-kube-api-access-p2jm6\") on node \"crc\" DevicePath \"\"" Mar 16 18:00:43 crc kubenswrapper[5120]: I0316 18:00:43.626605 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/mariadb-operator-controller-manager-bf5486b5c-mtrcb"] Mar 16 18:00:43 crc kubenswrapper[5120]: I0316 18:00:43.640866 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-operators/mariadb-operator-controller-manager-bf5486b5c-mtrcb"] Mar 16 18:00:43 crc kubenswrapper[5120]: I0316 18:00:43.643260 5120 scope.go:117] "RemoveContainer" containerID="7d12d0dd482e46788415b7dfe391528678baf2f937d1eb9a4784ef43592d9f4c" Mar 16 18:00:43 crc kubenswrapper[5120]: I0316 18:00:43.650259 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/mariadb-operator-index-wfr2p"] Mar 16 18:00:43 crc kubenswrapper[5120]: I0316 18:00:43.658109 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-operators/mariadb-operator-index-wfr2p"] Mar 16 18:00:43 crc kubenswrapper[5120]: I0316 18:00:43.667702 5120 scope.go:117] "RemoveContainer" containerID="7d12d0dd482e46788415b7dfe391528678baf2f937d1eb9a4784ef43592d9f4c" Mar 16 18:00:43 crc kubenswrapper[5120]: E0316 18:00:43.668196 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d12d0dd482e46788415b7dfe391528678baf2f937d1eb9a4784ef43592d9f4c\": container with ID starting with 7d12d0dd482e46788415b7dfe391528678baf2f937d1eb9a4784ef43592d9f4c not found: ID does not exist" containerID="7d12d0dd482e46788415b7dfe391528678baf2f937d1eb9a4784ef43592d9f4c" Mar 16 18:00:43 crc kubenswrapper[5120]: I0316 18:00:43.668229 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d12d0dd482e46788415b7dfe391528678baf2f937d1eb9a4784ef43592d9f4c"} err="failed to get container status \"7d12d0dd482e46788415b7dfe391528678baf2f937d1eb9a4784ef43592d9f4c\": rpc error: code = NotFound desc = could not find container \"7d12d0dd482e46788415b7dfe391528678baf2f937d1eb9a4784ef43592d9f4c\": container with ID starting with 7d12d0dd482e46788415b7dfe391528678baf2f937d1eb9a4784ef43592d9f4c not found: ID does not exist" Mar 16 18:00:43 crc kubenswrapper[5120]: I0316 18:00:43.668254 5120 scope.go:117] "RemoveContainer" containerID="1aa92757f9e2609ac96eabfcaac50a13046bee9512f910e9773776e6f265d152" Mar 16 18:00:43 crc kubenswrapper[5120]: I0316 18:00:43.686848 5120 scope.go:117] "RemoveContainer" containerID="1aa92757f9e2609ac96eabfcaac50a13046bee9512f910e9773776e6f265d152" Mar 16 18:00:43 crc kubenswrapper[5120]: E0316 18:00:43.687333 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1aa92757f9e2609ac96eabfcaac50a13046bee9512f910e9773776e6f265d152\": container with ID starting with 1aa92757f9e2609ac96eabfcaac50a13046bee9512f910e9773776e6f265d152 not found: ID does not exist" containerID="1aa92757f9e2609ac96eabfcaac50a13046bee9512f910e9773776e6f265d152" Mar 16 18:00:43 crc kubenswrapper[5120]: I0316 18:00:43.687393 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1aa92757f9e2609ac96eabfcaac50a13046bee9512f910e9773776e6f265d152"} err="failed to get container status \"1aa92757f9e2609ac96eabfcaac50a13046bee9512f910e9773776e6f265d152\": rpc error: code = NotFound desc = could not find container \"1aa92757f9e2609ac96eabfcaac50a13046bee9512f910e9773776e6f265d152\": container with ID starting with 1aa92757f9e2609ac96eabfcaac50a13046bee9512f910e9773776e6f265d152 not found: ID does not exist" Mar 16 18:00:44 crc kubenswrapper[5120]: I0316 18:00:44.673805 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0bb8ef5b-cbc0-4c37-a1fb-a0d15204c5c9" path="/var/lib/kubelet/pods/0bb8ef5b-cbc0-4c37-a1fb-a0d15204c5c9/volumes" Mar 16 18:00:44 crc kubenswrapper[5120]: I0316 18:00:44.675214 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="165d4d35-b678-40d9-b22c-af2816b5a2ec" path="/var/lib/kubelet/pods/165d4d35-b678-40d9-b22c-af2816b5a2ec/volumes" Mar 16 18:00:44 crc kubenswrapper[5120]: I0316 18:00:44.676410 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="33bebaaa-0edc-42f1-98ff-9a2cc108b7f2" path="/var/lib/kubelet/pods/33bebaaa-0edc-42f1-98ff-9a2cc108b7f2/volumes" Mar 16 18:00:44 crc kubenswrapper[5120]: I0316 18:00:44.678373 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="43151632-8fd6-41c2-abf2-ff0055c1237f" path="/var/lib/kubelet/pods/43151632-8fd6-41c2-abf2-ff0055c1237f/volumes" Mar 16 18:00:44 crc kubenswrapper[5120]: I0316 18:00:44.679383 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7eb6cd40-6ec1-43fb-bf5d-a37d95741e38" path="/var/lib/kubelet/pods/7eb6cd40-6ec1-43fb-bf5d-a37d95741e38/volumes" Mar 16 18:00:44 crc kubenswrapper[5120]: I0316 18:00:44.680300 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc9855c7-3e23-4753-8896-74e15d67f9a5" path="/var/lib/kubelet/pods/bc9855c7-3e23-4753-8896-74e15d67f9a5/volumes" Mar 16 18:00:44 crc kubenswrapper[5120]: I0316 18:00:44.682850 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d20ab5f9-633e-4d27-a872-f7358080d68c" path="/var/lib/kubelet/pods/d20ab5f9-633e-4d27-a872-f7358080d68c/volumes" Mar 16 18:00:44 crc kubenswrapper[5120]: I0316 18:00:44.907121 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/rabbitmq-cluster-operator-6bc46f9cd-z4slq"] Mar 16 18:00:44 crc kubenswrapper[5120]: I0316 18:00:44.907708 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-operators/rabbitmq-cluster-operator-6bc46f9cd-z4slq" podUID="a88a83ee-2e20-4e9c-9281-1ff87bd15115" containerName="operator" containerID="cri-o://bb476c93a5f611b30a6f11a9df695cd5d1b10d91eb8e12e15aff6165b28ec540" gracePeriod=10 Mar 16 18:00:45 crc kubenswrapper[5120]: I0316 18:00:45.190731 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/rabbitmq-cluster-operator-index-nv8mm"] Mar 16 18:00:45 crc kubenswrapper[5120]: I0316 18:00:45.190966 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-operators/rabbitmq-cluster-operator-index-nv8mm" podUID="5ad14ceb-690d-4da6-8b4a-b026f9e74721" containerName="registry-server" containerID="cri-o://554f5a6b0b52ef770fea52543d299709a70c0f70b70eacc42f6d101f55d7f186" gracePeriod=30 Mar 16 18:00:45 crc kubenswrapper[5120]: I0316 18:00:45.259266 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e5904nsqq"] Mar 16 18:00:45 crc kubenswrapper[5120]: I0316 18:00:45.275452 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e5904nsqq"] Mar 16 18:00:45 crc kubenswrapper[5120]: I0316 18:00:45.354765 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/rabbitmq-cluster-operator-6bc46f9cd-z4slq" Mar 16 18:00:45 crc kubenswrapper[5120]: I0316 18:00:45.467027 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c796r\" (UniqueName: \"kubernetes.io/projected/a88a83ee-2e20-4e9c-9281-1ff87bd15115-kube-api-access-c796r\") pod \"a88a83ee-2e20-4e9c-9281-1ff87bd15115\" (UID: \"a88a83ee-2e20-4e9c-9281-1ff87bd15115\") " Mar 16 18:00:45 crc kubenswrapper[5120]: I0316 18:00:45.474864 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a88a83ee-2e20-4e9c-9281-1ff87bd15115-kube-api-access-c796r" (OuterVolumeSpecName: "kube-api-access-c796r") pod "a88a83ee-2e20-4e9c-9281-1ff87bd15115" (UID: "a88a83ee-2e20-4e9c-9281-1ff87bd15115"). InnerVolumeSpecName "kube-api-access-c796r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 18:00:45 crc kubenswrapper[5120]: I0316 18:00:45.569232 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c796r\" (UniqueName: \"kubernetes.io/projected/a88a83ee-2e20-4e9c-9281-1ff87bd15115-kube-api-access-c796r\") on node \"crc\" DevicePath \"\"" Mar 16 18:00:45 crc kubenswrapper[5120]: I0316 18:00:45.589523 5120 generic.go:358] "Generic (PLEG): container finished" podID="5ad14ceb-690d-4da6-8b4a-b026f9e74721" containerID="554f5a6b0b52ef770fea52543d299709a70c0f70b70eacc42f6d101f55d7f186" exitCode=0 Mar 16 18:00:45 crc kubenswrapper[5120]: I0316 18:00:45.589628 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/rabbitmq-cluster-operator-index-nv8mm" event={"ID":"5ad14ceb-690d-4da6-8b4a-b026f9e74721","Type":"ContainerDied","Data":"554f5a6b0b52ef770fea52543d299709a70c0f70b70eacc42f6d101f55d7f186"} Mar 16 18:00:45 crc kubenswrapper[5120]: I0316 18:00:45.589656 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/rabbitmq-cluster-operator-index-nv8mm" event={"ID":"5ad14ceb-690d-4da6-8b4a-b026f9e74721","Type":"ContainerDied","Data":"f3517938a19a49b366bfafcc79b766fdb855d3355ae1542872e6dca024d97cdf"} Mar 16 18:00:45 crc kubenswrapper[5120]: I0316 18:00:45.589673 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f3517938a19a49b366bfafcc79b766fdb855d3355ae1542872e6dca024d97cdf" Mar 16 18:00:45 crc kubenswrapper[5120]: I0316 18:00:45.591564 5120 generic.go:358] "Generic (PLEG): container finished" podID="a88a83ee-2e20-4e9c-9281-1ff87bd15115" containerID="bb476c93a5f611b30a6f11a9df695cd5d1b10d91eb8e12e15aff6165b28ec540" exitCode=0 Mar 16 18:00:45 crc kubenswrapper[5120]: I0316 18:00:45.591821 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/rabbitmq-cluster-operator-6bc46f9cd-z4slq" event={"ID":"a88a83ee-2e20-4e9c-9281-1ff87bd15115","Type":"ContainerDied","Data":"bb476c93a5f611b30a6f11a9df695cd5d1b10d91eb8e12e15aff6165b28ec540"} Mar 16 18:00:45 crc kubenswrapper[5120]: I0316 18:00:45.591821 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/rabbitmq-cluster-operator-6bc46f9cd-z4slq" Mar 16 18:00:45 crc kubenswrapper[5120]: I0316 18:00:45.591849 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/rabbitmq-cluster-operator-6bc46f9cd-z4slq" event={"ID":"a88a83ee-2e20-4e9c-9281-1ff87bd15115","Type":"ContainerDied","Data":"bf203b0a919ea0176c9366a6e30da99529f464784f0b513858c755b453535fcb"} Mar 16 18:00:45 crc kubenswrapper[5120]: I0316 18:00:45.591875 5120 scope.go:117] "RemoveContainer" containerID="bb476c93a5f611b30a6f11a9df695cd5d1b10d91eb8e12e15aff6165b28ec540" Mar 16 18:00:45 crc kubenswrapper[5120]: I0316 18:00:45.600954 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/rabbitmq-cluster-operator-index-nv8mm" Mar 16 18:00:45 crc kubenswrapper[5120]: I0316 18:00:45.611815 5120 scope.go:117] "RemoveContainer" containerID="bb476c93a5f611b30a6f11a9df695cd5d1b10d91eb8e12e15aff6165b28ec540" Mar 16 18:00:45 crc kubenswrapper[5120]: E0316 18:00:45.613590 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb476c93a5f611b30a6f11a9df695cd5d1b10d91eb8e12e15aff6165b28ec540\": container with ID starting with bb476c93a5f611b30a6f11a9df695cd5d1b10d91eb8e12e15aff6165b28ec540 not found: ID does not exist" containerID="bb476c93a5f611b30a6f11a9df695cd5d1b10d91eb8e12e15aff6165b28ec540" Mar 16 18:00:45 crc kubenswrapper[5120]: I0316 18:00:45.613626 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb476c93a5f611b30a6f11a9df695cd5d1b10d91eb8e12e15aff6165b28ec540"} err="failed to get container status \"bb476c93a5f611b30a6f11a9df695cd5d1b10d91eb8e12e15aff6165b28ec540\": rpc error: code = NotFound desc = could not find container \"bb476c93a5f611b30a6f11a9df695cd5d1b10d91eb8e12e15aff6165b28ec540\": container with ID starting with bb476c93a5f611b30a6f11a9df695cd5d1b10d91eb8e12e15aff6165b28ec540 not found: ID does not exist" Mar 16 18:00:45 crc kubenswrapper[5120]: I0316 18:00:45.634088 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/rabbitmq-cluster-operator-6bc46f9cd-z4slq"] Mar 16 18:00:45 crc kubenswrapper[5120]: I0316 18:00:45.638592 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-operators/rabbitmq-cluster-operator-6bc46f9cd-z4slq"] Mar 16 18:00:45 crc kubenswrapper[5120]: I0316 18:00:45.671010 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sjzwh\" (UniqueName: \"kubernetes.io/projected/5ad14ceb-690d-4da6-8b4a-b026f9e74721-kube-api-access-sjzwh\") pod \"5ad14ceb-690d-4da6-8b4a-b026f9e74721\" (UID: \"5ad14ceb-690d-4da6-8b4a-b026f9e74721\") " Mar 16 18:00:45 crc kubenswrapper[5120]: I0316 18:00:45.676130 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ad14ceb-690d-4da6-8b4a-b026f9e74721-kube-api-access-sjzwh" (OuterVolumeSpecName: "kube-api-access-sjzwh") pod "5ad14ceb-690d-4da6-8b4a-b026f9e74721" (UID: "5ad14ceb-690d-4da6-8b4a-b026f9e74721"). InnerVolumeSpecName "kube-api-access-sjzwh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 18:00:45 crc kubenswrapper[5120]: I0316 18:00:45.774484 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sjzwh\" (UniqueName: \"kubernetes.io/projected/5ad14ceb-690d-4da6-8b4a-b026f9e74721-kube-api-access-sjzwh\") on node \"crc\" DevicePath \"\"" Mar 16 18:00:46 crc kubenswrapper[5120]: I0316 18:00:46.603025 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/rabbitmq-cluster-operator-index-nv8mm" Mar 16 18:00:46 crc kubenswrapper[5120]: I0316 18:00:46.640929 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/rabbitmq-cluster-operator-index-nv8mm"] Mar 16 18:00:46 crc kubenswrapper[5120]: I0316 18:00:46.647634 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-operators/rabbitmq-cluster-operator-index-nv8mm"] Mar 16 18:00:46 crc kubenswrapper[5120]: I0316 18:00:46.682740 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="14fb34f4-64c5-4f35-b738-9f31a7d721ec" path="/var/lib/kubelet/pods/14fb34f4-64c5-4f35-b738-9f31a7d721ec/volumes" Mar 16 18:00:46 crc kubenswrapper[5120]: I0316 18:00:46.684291 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ad14ceb-690d-4da6-8b4a-b026f9e74721" path="/var/lib/kubelet/pods/5ad14ceb-690d-4da6-8b4a-b026f9e74721/volumes" Mar 16 18:00:46 crc kubenswrapper[5120]: I0316 18:00:46.685200 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a88a83ee-2e20-4e9c-9281-1ff87bd15115" path="/var/lib/kubelet/pods/a88a83ee-2e20-4e9c-9281-1ff87bd15115/volumes" Mar 16 18:01:07 crc kubenswrapper[5120]: E0316 18:01:07.251708 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=848771 actualBytes=10240 Mar 16 18:01:37 crc kubenswrapper[5120]: I0316 18:01:37.784732 5120 scope.go:117] "RemoveContainer" containerID="301eeb97a6f042288fd7c2640f6907fbe137496777309a8b9b35fce6be05671a" Mar 16 18:01:37 crc kubenswrapper[5120]: I0316 18:01:37.818458 5120 scope.go:117] "RemoveContainer" containerID="940281b42e4f20fad9665786472be4b3d217d5e7d5b120787390acb96e5b8b5e" Mar 16 18:01:37 crc kubenswrapper[5120]: I0316 18:01:37.847817 5120 scope.go:117] "RemoveContainer" containerID="bceecb6b6350e37b21d990e1c4af2d3ad5d831111b8d7bdc1431be3370ddb257" Mar 16 18:01:37 crc kubenswrapper[5120]: I0316 18:01:37.873794 5120 scope.go:117] "RemoveContainer" containerID="e609d585317870f82f1016d9f2cc3a63df0aff6290191d03a65d432c265683f3" Mar 16 18:01:37 crc kubenswrapper[5120]: I0316 18:01:37.906950 5120 scope.go:117] "RemoveContainer" containerID="4d93a08675a328519f918068adf6e02d6ffde7101266977244cec288685e428f" Mar 16 18:01:37 crc kubenswrapper[5120]: I0316 18:01:37.931289 5120 scope.go:117] "RemoveContainer" containerID="abc8747ef002b703dfdbd80b15177be047bfdfb14288a2d9a52283f0f001fdce" Mar 16 18:01:37 crc kubenswrapper[5120]: I0316 18:01:37.956038 5120 scope.go:117] "RemoveContainer" containerID="09ecca713c9533287fd4f0ccd7b25e943e28230d953dfcb41eba32bbcb32cac0" Mar 16 18:01:37 crc kubenswrapper[5120]: I0316 18:01:37.985546 5120 scope.go:117] "RemoveContainer" containerID="554f5a6b0b52ef770fea52543d299709a70c0f70b70eacc42f6d101f55d7f186" Mar 16 18:01:38 crc kubenswrapper[5120]: I0316 18:01:38.006157 5120 scope.go:117] "RemoveContainer" containerID="ddb1fa34dab500a3241096aeeb2bbf778e68acf5118c476e04987e172ef1bf37" Mar 16 18:01:38 crc kubenswrapper[5120]: I0316 18:01:38.032926 5120 scope.go:117] "RemoveContainer" containerID="140c1cf1a906275c981dc5ed36580cd3f64b7fbed2c1c73b83f46bbda6bc11cb" Mar 16 18:01:38 crc kubenswrapper[5120]: I0316 18:01:38.050335 5120 scope.go:117] "RemoveContainer" containerID="47a9f04bd7f7feb4edf715a90d8cf86acb8411ca8030dc21d9043a0b6765dbed" Mar 16 18:01:38 crc kubenswrapper[5120]: I0316 18:01:38.067604 5120 scope.go:117] "RemoveContainer" containerID="1ee747bcfef9f03a39af9624feccc88aacff1c0d753b32e3c15b186d9e0fe38b" Mar 16 18:01:38 crc kubenswrapper[5120]: I0316 18:01:38.087456 5120 scope.go:117] "RemoveContainer" containerID="1872d695e9e16cd7b7541b8b1f106cb631c473c16be63457f5cc7f26eb383f8f" Mar 16 18:01:38 crc kubenswrapper[5120]: I0316 18:01:38.111867 5120 scope.go:117] "RemoveContainer" containerID="b66adb9bbd7bcfd140b9766d7e17a0a0b55a050654128ab253318ac29629b538" Mar 16 18:01:39 crc kubenswrapper[5120]: I0316 18:01:39.695314 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-operators/mariadb-operator-index-lt58f"] Mar 16 18:01:39 crc kubenswrapper[5120]: I0316 18:01:39.697163 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0bb8ef5b-cbc0-4c37-a1fb-a0d15204c5c9" containerName="mysql-bootstrap" Mar 16 18:01:39 crc kubenswrapper[5120]: I0316 18:01:39.697205 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="0bb8ef5b-cbc0-4c37-a1fb-a0d15204c5c9" containerName="mysql-bootstrap" Mar 16 18:01:39 crc kubenswrapper[5120]: I0316 18:01:39.697245 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69818304-cbec-4828-a572-6bbc566dc6b7" containerName="setup-container" Mar 16 18:01:39 crc kubenswrapper[5120]: I0316 18:01:39.697263 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="69818304-cbec-4828-a572-6bbc566dc6b7" containerName="setup-container" Mar 16 18:01:39 crc kubenswrapper[5120]: I0316 18:01:39.697298 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d20ab5f9-633e-4d27-a872-f7358080d68c" containerName="manager" Mar 16 18:01:39 crc kubenswrapper[5120]: I0316 18:01:39.697322 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="d20ab5f9-633e-4d27-a872-f7358080d68c" containerName="manager" Mar 16 18:01:39 crc kubenswrapper[5120]: I0316 18:01:39.697351 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43151632-8fd6-41c2-abf2-ff0055c1237f" containerName="galera" Mar 16 18:01:39 crc kubenswrapper[5120]: I0316 18:01:39.697367 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="43151632-8fd6-41c2-abf2-ff0055c1237f" containerName="galera" Mar 16 18:01:39 crc kubenswrapper[5120]: I0316 18:01:39.697397 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a88a83ee-2e20-4e9c-9281-1ff87bd15115" containerName="operator" Mar 16 18:01:39 crc kubenswrapper[5120]: I0316 18:01:39.697413 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a88a83ee-2e20-4e9c-9281-1ff87bd15115" containerName="operator" Mar 16 18:01:39 crc kubenswrapper[5120]: I0316 18:01:39.697453 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43151632-8fd6-41c2-abf2-ff0055c1237f" containerName="mysql-bootstrap" Mar 16 18:01:39 crc kubenswrapper[5120]: I0316 18:01:39.697470 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="43151632-8fd6-41c2-abf2-ff0055c1237f" containerName="mysql-bootstrap" Mar 16 18:01:39 crc kubenswrapper[5120]: I0316 18:01:39.697501 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69818304-cbec-4828-a572-6bbc566dc6b7" containerName="rabbitmq" Mar 16 18:01:39 crc kubenswrapper[5120]: I0316 18:01:39.697513 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="69818304-cbec-4828-a572-6bbc566dc6b7" containerName="rabbitmq" Mar 16 18:01:39 crc kubenswrapper[5120]: I0316 18:01:39.697534 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7eb6cd40-6ec1-43fb-bf5d-a37d95741e38" containerName="registry-server" Mar 16 18:01:39 crc kubenswrapper[5120]: I0316 18:01:39.697547 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7eb6cd40-6ec1-43fb-bf5d-a37d95741e38" containerName="registry-server" Mar 16 18:01:39 crc kubenswrapper[5120]: I0316 18:01:39.697569 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bef338fe-205b-4d75-98b6-5e25cdfd474f" containerName="galera" Mar 16 18:01:39 crc kubenswrapper[5120]: I0316 18:01:39.697580 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="bef338fe-205b-4d75-98b6-5e25cdfd474f" containerName="galera" Mar 16 18:01:39 crc kubenswrapper[5120]: I0316 18:01:39.697597 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49c806d7-6ca0-45e9-91b9-98a510fb2401" containerName="memcached" Mar 16 18:01:39 crc kubenswrapper[5120]: I0316 18:01:39.697608 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="49c806d7-6ca0-45e9-91b9-98a510fb2401" containerName="memcached" Mar 16 18:01:39 crc kubenswrapper[5120]: I0316 18:01:39.697632 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df2f32a6-2b43-495a-be3d-53a4eb60b528" containerName="manager" Mar 16 18:01:39 crc kubenswrapper[5120]: I0316 18:01:39.697647 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="df2f32a6-2b43-495a-be3d-53a4eb60b528" containerName="manager" Mar 16 18:01:39 crc kubenswrapper[5120]: I0316 18:01:39.697668 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33bebaaa-0edc-42f1-98ff-9a2cc108b7f2" containerName="registry-server" Mar 16 18:01:39 crc kubenswrapper[5120]: I0316 18:01:39.697683 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="33bebaaa-0edc-42f1-98ff-9a2cc108b7f2" containerName="registry-server" Mar 16 18:01:39 crc kubenswrapper[5120]: I0316 18:01:39.697709 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc9855c7-3e23-4753-8896-74e15d67f9a5" containerName="manager" Mar 16 18:01:39 crc kubenswrapper[5120]: I0316 18:01:39.697724 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc9855c7-3e23-4753-8896-74e15d67f9a5" containerName="manager" Mar 16 18:01:39 crc kubenswrapper[5120]: I0316 18:01:39.697752 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bef338fe-205b-4d75-98b6-5e25cdfd474f" containerName="mysql-bootstrap" Mar 16 18:01:39 crc kubenswrapper[5120]: I0316 18:01:39.697809 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="bef338fe-205b-4d75-98b6-5e25cdfd474f" containerName="mysql-bootstrap" Mar 16 18:01:39 crc kubenswrapper[5120]: I0316 18:01:39.697829 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a1292d7-3e03-4267-b305-26808b8fd162" containerName="registry-server" Mar 16 18:01:39 crc kubenswrapper[5120]: I0316 18:01:39.697840 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a1292d7-3e03-4267-b305-26808b8fd162" containerName="registry-server" Mar 16 18:01:39 crc kubenswrapper[5120]: I0316 18:01:39.697869 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0bb8ef5b-cbc0-4c37-a1fb-a0d15204c5c9" containerName="galera" Mar 16 18:01:39 crc kubenswrapper[5120]: I0316 18:01:39.697881 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="0bb8ef5b-cbc0-4c37-a1fb-a0d15204c5c9" containerName="galera" Mar 16 18:01:39 crc kubenswrapper[5120]: I0316 18:01:39.697908 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ad14ceb-690d-4da6-8b4a-b026f9e74721" containerName="registry-server" Mar 16 18:01:39 crc kubenswrapper[5120]: I0316 18:01:39.697920 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ad14ceb-690d-4da6-8b4a-b026f9e74721" containerName="registry-server" Mar 16 18:01:39 crc kubenswrapper[5120]: I0316 18:01:39.698141 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="d20ab5f9-633e-4d27-a872-f7358080d68c" containerName="manager" Mar 16 18:01:39 crc kubenswrapper[5120]: I0316 18:01:39.698171 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7eb6cd40-6ec1-43fb-bf5d-a37d95741e38" containerName="registry-server" Mar 16 18:01:39 crc kubenswrapper[5120]: I0316 18:01:39.698191 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="49c806d7-6ca0-45e9-91b9-98a510fb2401" containerName="memcached" Mar 16 18:01:39 crc kubenswrapper[5120]: I0316 18:01:39.698209 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="df2f32a6-2b43-495a-be3d-53a4eb60b528" containerName="manager" Mar 16 18:01:39 crc kubenswrapper[5120]: I0316 18:01:39.698233 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="69818304-cbec-4828-a572-6bbc566dc6b7" containerName="rabbitmq" Mar 16 18:01:39 crc kubenswrapper[5120]: I0316 18:01:39.698251 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="bef338fe-205b-4d75-98b6-5e25cdfd474f" containerName="galera" Mar 16 18:01:39 crc kubenswrapper[5120]: I0316 18:01:39.698276 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="43151632-8fd6-41c2-abf2-ff0055c1237f" containerName="galera" Mar 16 18:01:39 crc kubenswrapper[5120]: I0316 18:01:39.698292 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="9a1292d7-3e03-4267-b305-26808b8fd162" containerName="registry-server" Mar 16 18:01:39 crc kubenswrapper[5120]: I0316 18:01:39.698312 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="0bb8ef5b-cbc0-4c37-a1fb-a0d15204c5c9" containerName="galera" Mar 16 18:01:39 crc kubenswrapper[5120]: I0316 18:01:39.698327 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="a88a83ee-2e20-4e9c-9281-1ff87bd15115" containerName="operator" Mar 16 18:01:39 crc kubenswrapper[5120]: I0316 18:01:39.698341 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="bc9855c7-3e23-4753-8896-74e15d67f9a5" containerName="manager" Mar 16 18:01:39 crc kubenswrapper[5120]: I0316 18:01:39.698356 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="5ad14ceb-690d-4da6-8b4a-b026f9e74721" containerName="registry-server" Mar 16 18:01:39 crc kubenswrapper[5120]: I0316 18:01:39.698376 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="33bebaaa-0edc-42f1-98ff-9a2cc108b7f2" containerName="registry-server" Mar 16 18:01:39 crc kubenswrapper[5120]: I0316 18:01:39.739030 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/mariadb-operator-index-lt58f"] Mar 16 18:01:39 crc kubenswrapper[5120]: I0316 18:01:39.739216 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/mariadb-operator-index-lt58f" Mar 16 18:01:39 crc kubenswrapper[5120]: I0316 18:01:39.743605 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-operators\"/\"mariadb-operator-index-dockercfg-hmjd2\"" Mar 16 18:01:39 crc kubenswrapper[5120]: I0316 18:01:39.744292 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-operators\"/\"kube-root-ca.crt\"" Mar 16 18:01:39 crc kubenswrapper[5120]: I0316 18:01:39.751080 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-operators\"/\"openshift-service-ca.crt\"" Mar 16 18:01:39 crc kubenswrapper[5120]: I0316 18:01:39.860488 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snrgb\" (UniqueName: \"kubernetes.io/projected/1fbe80ab-fc32-4d5a-b1de-7d4504cac675-kube-api-access-snrgb\") pod \"mariadb-operator-index-lt58f\" (UID: \"1fbe80ab-fc32-4d5a-b1de-7d4504cac675\") " pod="openstack-operators/mariadb-operator-index-lt58f" Mar 16 18:01:39 crc kubenswrapper[5120]: I0316 18:01:39.962083 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-snrgb\" (UniqueName: \"kubernetes.io/projected/1fbe80ab-fc32-4d5a-b1de-7d4504cac675-kube-api-access-snrgb\") pod \"mariadb-operator-index-lt58f\" (UID: \"1fbe80ab-fc32-4d5a-b1de-7d4504cac675\") " pod="openstack-operators/mariadb-operator-index-lt58f" Mar 16 18:01:39 crc kubenswrapper[5120]: I0316 18:01:39.981790 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-snrgb\" (UniqueName: \"kubernetes.io/projected/1fbe80ab-fc32-4d5a-b1de-7d4504cac675-kube-api-access-snrgb\") pod \"mariadb-operator-index-lt58f\" (UID: \"1fbe80ab-fc32-4d5a-b1de-7d4504cac675\") " pod="openstack-operators/mariadb-operator-index-lt58f" Mar 16 18:01:40 crc kubenswrapper[5120]: I0316 18:01:40.053127 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/mariadb-operator-index-lt58f"] Mar 16 18:01:40 crc kubenswrapper[5120]: I0316 18:01:40.053934 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/mariadb-operator-index-lt58f" Mar 16 18:01:40 crc kubenswrapper[5120]: I0316 18:01:40.257469 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-operators/mariadb-operator-index-gb4m2"] Mar 16 18:01:40 crc kubenswrapper[5120]: I0316 18:01:40.272449 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/mariadb-operator-index-gb4m2" Mar 16 18:01:40 crc kubenswrapper[5120]: I0316 18:01:40.279030 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/mariadb-operator-index-gb4m2"] Mar 16 18:01:40 crc kubenswrapper[5120]: I0316 18:01:40.372972 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xckz\" (UniqueName: \"kubernetes.io/projected/8c74e2ee-be49-414b-8ff6-903ff67fcbd8-kube-api-access-6xckz\") pod \"mariadb-operator-index-gb4m2\" (UID: \"8c74e2ee-be49-414b-8ff6-903ff67fcbd8\") " pod="openstack-operators/mariadb-operator-index-gb4m2" Mar 16 18:01:40 crc kubenswrapper[5120]: I0316 18:01:40.474638 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6xckz\" (UniqueName: \"kubernetes.io/projected/8c74e2ee-be49-414b-8ff6-903ff67fcbd8-kube-api-access-6xckz\") pod \"mariadb-operator-index-gb4m2\" (UID: \"8c74e2ee-be49-414b-8ff6-903ff67fcbd8\") " pod="openstack-operators/mariadb-operator-index-gb4m2" Mar 16 18:01:40 crc kubenswrapper[5120]: I0316 18:01:40.493579 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xckz\" (UniqueName: \"kubernetes.io/projected/8c74e2ee-be49-414b-8ff6-903ff67fcbd8-kube-api-access-6xckz\") pod \"mariadb-operator-index-gb4m2\" (UID: \"8c74e2ee-be49-414b-8ff6-903ff67fcbd8\") " pod="openstack-operators/mariadb-operator-index-gb4m2" Mar 16 18:01:40 crc kubenswrapper[5120]: I0316 18:01:40.578178 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/mariadb-operator-index-lt58f"] Mar 16 18:01:40 crc kubenswrapper[5120]: I0316 18:01:40.589574 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/mariadb-operator-index-gb4m2" Mar 16 18:01:40 crc kubenswrapper[5120]: W0316 18:01:40.592088 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fbe80ab_fc32_4d5a_b1de_7d4504cac675.slice/crio-1d0fce8207eac2f9ab818359dd519d19cf88618b19b62941fe7436527c1208ef WatchSource:0}: Error finding container 1d0fce8207eac2f9ab818359dd519d19cf88618b19b62941fe7436527c1208ef: Status 404 returned error can't find the container with id 1d0fce8207eac2f9ab818359dd519d19cf88618b19b62941fe7436527c1208ef Mar 16 18:01:40 crc kubenswrapper[5120]: I0316 18:01:40.799153 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/mariadb-operator-index-gb4m2"] Mar 16 18:01:40 crc kubenswrapper[5120]: W0316 18:01:40.800492 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c74e2ee_be49_414b_8ff6_903ff67fcbd8.slice/crio-0b420055857d3d26ae398bdb1723229bdd17605c3a2f7e5cb1de56f2afb6e4e2 WatchSource:0}: Error finding container 0b420055857d3d26ae398bdb1723229bdd17605c3a2f7e5cb1de56f2afb6e4e2: Status 404 returned error can't find the container with id 0b420055857d3d26ae398bdb1723229bdd17605c3a2f7e5cb1de56f2afb6e4e2 Mar 16 18:01:41 crc kubenswrapper[5120]: I0316 18:01:41.108149 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/mariadb-operator-index-lt58f" event={"ID":"1fbe80ab-fc32-4d5a-b1de-7d4504cac675","Type":"ContainerStarted","Data":"1d0fce8207eac2f9ab818359dd519d19cf88618b19b62941fe7436527c1208ef"} Mar 16 18:01:41 crc kubenswrapper[5120]: I0316 18:01:41.110735 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/mariadb-operator-index-gb4m2" event={"ID":"8c74e2ee-be49-414b-8ff6-903ff67fcbd8","Type":"ContainerStarted","Data":"0b420055857d3d26ae398bdb1723229bdd17605c3a2f7e5cb1de56f2afb6e4e2"} Mar 16 18:01:42 crc kubenswrapper[5120]: I0316 18:01:42.122131 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/mariadb-operator-index-lt58f" event={"ID":"1fbe80ab-fc32-4d5a-b1de-7d4504cac675","Type":"ContainerStarted","Data":"82c6cd8f5521b5d44d66ca6866f4adfdcb7e592def2b6d02d490467b6c9bc96d"} Mar 16 18:01:42 crc kubenswrapper[5120]: I0316 18:01:42.122348 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-operators/mariadb-operator-index-lt58f" podUID="1fbe80ab-fc32-4d5a-b1de-7d4504cac675" containerName="registry-server" containerID="cri-o://82c6cd8f5521b5d44d66ca6866f4adfdcb7e592def2b6d02d490467b6c9bc96d" gracePeriod=2 Mar 16 18:01:42 crc kubenswrapper[5120]: I0316 18:01:42.128987 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/mariadb-operator-index-gb4m2" event={"ID":"8c74e2ee-be49-414b-8ff6-903ff67fcbd8","Type":"ContainerStarted","Data":"21b17156abd179ac9cf5433a301aa1c6b2ab7e94023d85a6cb5bea779868356e"} Mar 16 18:01:42 crc kubenswrapper[5120]: I0316 18:01:42.150810 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/mariadb-operator-index-lt58f" podStartSLOduration=2.119492726 podStartE2EDuration="3.150790258s" podCreationTimestamp="2026-03-16 18:01:39 +0000 UTC" firstStartedPulling="2026-03-16 18:01:40.593609276 +0000 UTC m=+9002.747540973" lastFinishedPulling="2026-03-16 18:01:41.624906828 +0000 UTC m=+9003.778838505" observedRunningTime="2026-03-16 18:01:42.140568529 +0000 UTC m=+9004.294500206" watchObservedRunningTime="2026-03-16 18:01:42.150790258 +0000 UTC m=+9004.304721925" Mar 16 18:01:42 crc kubenswrapper[5120]: I0316 18:01:42.169497 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/mariadb-operator-index-gb4m2" podStartSLOduration=1.5746423840000001 podStartE2EDuration="2.169469898s" podCreationTimestamp="2026-03-16 18:01:40 +0000 UTC" firstStartedPulling="2026-03-16 18:01:40.801915248 +0000 UTC m=+9002.955846905" lastFinishedPulling="2026-03-16 18:01:41.396742752 +0000 UTC m=+9003.550674419" observedRunningTime="2026-03-16 18:01:42.161526471 +0000 UTC m=+9004.315458138" watchObservedRunningTime="2026-03-16 18:01:42.169469898 +0000 UTC m=+9004.323401565" Mar 16 18:01:42 crc kubenswrapper[5120]: I0316 18:01:42.551483 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/mariadb-operator-index-lt58f" Mar 16 18:01:42 crc kubenswrapper[5120]: I0316 18:01:42.632057 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-snrgb\" (UniqueName: \"kubernetes.io/projected/1fbe80ab-fc32-4d5a-b1de-7d4504cac675-kube-api-access-snrgb\") pod \"1fbe80ab-fc32-4d5a-b1de-7d4504cac675\" (UID: \"1fbe80ab-fc32-4d5a-b1de-7d4504cac675\") " Mar 16 18:01:42 crc kubenswrapper[5120]: I0316 18:01:42.638789 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1fbe80ab-fc32-4d5a-b1de-7d4504cac675-kube-api-access-snrgb" (OuterVolumeSpecName: "kube-api-access-snrgb") pod "1fbe80ab-fc32-4d5a-b1de-7d4504cac675" (UID: "1fbe80ab-fc32-4d5a-b1de-7d4504cac675"). InnerVolumeSpecName "kube-api-access-snrgb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 18:01:42 crc kubenswrapper[5120]: I0316 18:01:42.735663 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-snrgb\" (UniqueName: \"kubernetes.io/projected/1fbe80ab-fc32-4d5a-b1de-7d4504cac675-kube-api-access-snrgb\") on node \"crc\" DevicePath \"\"" Mar 16 18:01:43 crc kubenswrapper[5120]: I0316 18:01:43.141122 5120 generic.go:358] "Generic (PLEG): container finished" podID="1fbe80ab-fc32-4d5a-b1de-7d4504cac675" containerID="82c6cd8f5521b5d44d66ca6866f4adfdcb7e592def2b6d02d490467b6c9bc96d" exitCode=0 Mar 16 18:01:43 crc kubenswrapper[5120]: I0316 18:01:43.141273 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/mariadb-operator-index-lt58f" event={"ID":"1fbe80ab-fc32-4d5a-b1de-7d4504cac675","Type":"ContainerDied","Data":"82c6cd8f5521b5d44d66ca6866f4adfdcb7e592def2b6d02d490467b6c9bc96d"} Mar 16 18:01:43 crc kubenswrapper[5120]: I0316 18:01:43.141750 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/mariadb-operator-index-lt58f" event={"ID":"1fbe80ab-fc32-4d5a-b1de-7d4504cac675","Type":"ContainerDied","Data":"1d0fce8207eac2f9ab818359dd519d19cf88618b19b62941fe7436527c1208ef"} Mar 16 18:01:43 crc kubenswrapper[5120]: I0316 18:01:43.141319 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/mariadb-operator-index-lt58f" Mar 16 18:01:43 crc kubenswrapper[5120]: I0316 18:01:43.141830 5120 scope.go:117] "RemoveContainer" containerID="82c6cd8f5521b5d44d66ca6866f4adfdcb7e592def2b6d02d490467b6c9bc96d" Mar 16 18:01:43 crc kubenswrapper[5120]: I0316 18:01:43.166442 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/mariadb-operator-index-lt58f"] Mar 16 18:01:43 crc kubenswrapper[5120]: I0316 18:01:43.181124 5120 scope.go:117] "RemoveContainer" containerID="82c6cd8f5521b5d44d66ca6866f4adfdcb7e592def2b6d02d490467b6c9bc96d" Mar 16 18:01:43 crc kubenswrapper[5120]: E0316 18:01:43.181691 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"82c6cd8f5521b5d44d66ca6866f4adfdcb7e592def2b6d02d490467b6c9bc96d\": container with ID starting with 82c6cd8f5521b5d44d66ca6866f4adfdcb7e592def2b6d02d490467b6c9bc96d not found: ID does not exist" containerID="82c6cd8f5521b5d44d66ca6866f4adfdcb7e592def2b6d02d490467b6c9bc96d" Mar 16 18:01:43 crc kubenswrapper[5120]: I0316 18:01:43.181729 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82c6cd8f5521b5d44d66ca6866f4adfdcb7e592def2b6d02d490467b6c9bc96d"} err="failed to get container status \"82c6cd8f5521b5d44d66ca6866f4adfdcb7e592def2b6d02d490467b6c9bc96d\": rpc error: code = NotFound desc = could not find container \"82c6cd8f5521b5d44d66ca6866f4adfdcb7e592def2b6d02d490467b6c9bc96d\": container with ID starting with 82c6cd8f5521b5d44d66ca6866f4adfdcb7e592def2b6d02d490467b6c9bc96d not found: ID does not exist" Mar 16 18:01:43 crc kubenswrapper[5120]: I0316 18:01:43.183450 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-operators/mariadb-operator-index-lt58f"] Mar 16 18:01:44 crc kubenswrapper[5120]: I0316 18:01:44.675254 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1fbe80ab-fc32-4d5a-b1de-7d4504cac675" path="/var/lib/kubelet/pods/1fbe80ab-fc32-4d5a-b1de-7d4504cac675/volumes" Mar 16 18:01:46 crc kubenswrapper[5120]: I0316 18:01:46.712070 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-operators/1b4ccfde3488142cc254fb313062ed88e2d18a60b7907f7b7c6ca340287qg5t"] Mar 16 18:01:46 crc kubenswrapper[5120]: I0316 18:01:46.713613 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1fbe80ab-fc32-4d5a-b1de-7d4504cac675" containerName="registry-server" Mar 16 18:01:46 crc kubenswrapper[5120]: I0316 18:01:46.713642 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1fbe80ab-fc32-4d5a-b1de-7d4504cac675" containerName="registry-server" Mar 16 18:01:46 crc kubenswrapper[5120]: I0316 18:01:46.713922 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1fbe80ab-fc32-4d5a-b1de-7d4504cac675" containerName="registry-server" Mar 16 18:01:46 crc kubenswrapper[5120]: I0316 18:01:46.722128 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/1b4ccfde3488142cc254fb313062ed88e2d18a60b7907f7b7c6ca340287qg5t"] Mar 16 18:01:46 crc kubenswrapper[5120]: I0316 18:01:46.722256 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/1b4ccfde3488142cc254fb313062ed88e2d18a60b7907f7b7c6ca340287qg5t" Mar 16 18:01:46 crc kubenswrapper[5120]: I0316 18:01:46.763760 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-operators\"/\"default-dockercfg-rmzsx\"" Mar 16 18:01:46 crc kubenswrapper[5120]: I0316 18:01:46.835431 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/253dee39-6e00-42a2-9e79-cdaec61a31c8-util\") pod \"1b4ccfde3488142cc254fb313062ed88e2d18a60b7907f7b7c6ca340287qg5t\" (UID: \"253dee39-6e00-42a2-9e79-cdaec61a31c8\") " pod="openstack-operators/1b4ccfde3488142cc254fb313062ed88e2d18a60b7907f7b7c6ca340287qg5t" Mar 16 18:01:46 crc kubenswrapper[5120]: I0316 18:01:46.835635 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/253dee39-6e00-42a2-9e79-cdaec61a31c8-bundle\") pod \"1b4ccfde3488142cc254fb313062ed88e2d18a60b7907f7b7c6ca340287qg5t\" (UID: \"253dee39-6e00-42a2-9e79-cdaec61a31c8\") " pod="openstack-operators/1b4ccfde3488142cc254fb313062ed88e2d18a60b7907f7b7c6ca340287qg5t" Mar 16 18:01:46 crc kubenswrapper[5120]: I0316 18:01:46.836237 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b54wx\" (UniqueName: \"kubernetes.io/projected/253dee39-6e00-42a2-9e79-cdaec61a31c8-kube-api-access-b54wx\") pod \"1b4ccfde3488142cc254fb313062ed88e2d18a60b7907f7b7c6ca340287qg5t\" (UID: \"253dee39-6e00-42a2-9e79-cdaec61a31c8\") " pod="openstack-operators/1b4ccfde3488142cc254fb313062ed88e2d18a60b7907f7b7c6ca340287qg5t" Mar 16 18:01:46 crc kubenswrapper[5120]: I0316 18:01:46.937968 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/253dee39-6e00-42a2-9e79-cdaec61a31c8-util\") pod \"1b4ccfde3488142cc254fb313062ed88e2d18a60b7907f7b7c6ca340287qg5t\" (UID: \"253dee39-6e00-42a2-9e79-cdaec61a31c8\") " pod="openstack-operators/1b4ccfde3488142cc254fb313062ed88e2d18a60b7907f7b7c6ca340287qg5t" Mar 16 18:01:46 crc kubenswrapper[5120]: I0316 18:01:46.938293 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/253dee39-6e00-42a2-9e79-cdaec61a31c8-bundle\") pod \"1b4ccfde3488142cc254fb313062ed88e2d18a60b7907f7b7c6ca340287qg5t\" (UID: \"253dee39-6e00-42a2-9e79-cdaec61a31c8\") " pod="openstack-operators/1b4ccfde3488142cc254fb313062ed88e2d18a60b7907f7b7c6ca340287qg5t" Mar 16 18:01:46 crc kubenswrapper[5120]: I0316 18:01:46.938496 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/253dee39-6e00-42a2-9e79-cdaec61a31c8-util\") pod \"1b4ccfde3488142cc254fb313062ed88e2d18a60b7907f7b7c6ca340287qg5t\" (UID: \"253dee39-6e00-42a2-9e79-cdaec61a31c8\") " pod="openstack-operators/1b4ccfde3488142cc254fb313062ed88e2d18a60b7907f7b7c6ca340287qg5t" Mar 16 18:01:46 crc kubenswrapper[5120]: I0316 18:01:46.938597 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b54wx\" (UniqueName: \"kubernetes.io/projected/253dee39-6e00-42a2-9e79-cdaec61a31c8-kube-api-access-b54wx\") pod \"1b4ccfde3488142cc254fb313062ed88e2d18a60b7907f7b7c6ca340287qg5t\" (UID: \"253dee39-6e00-42a2-9e79-cdaec61a31c8\") " pod="openstack-operators/1b4ccfde3488142cc254fb313062ed88e2d18a60b7907f7b7c6ca340287qg5t" Mar 16 18:01:46 crc kubenswrapper[5120]: I0316 18:01:46.938980 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/253dee39-6e00-42a2-9e79-cdaec61a31c8-bundle\") pod \"1b4ccfde3488142cc254fb313062ed88e2d18a60b7907f7b7c6ca340287qg5t\" (UID: \"253dee39-6e00-42a2-9e79-cdaec61a31c8\") " pod="openstack-operators/1b4ccfde3488142cc254fb313062ed88e2d18a60b7907f7b7c6ca340287qg5t" Mar 16 18:01:46 crc kubenswrapper[5120]: I0316 18:01:46.964296 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b54wx\" (UniqueName: \"kubernetes.io/projected/253dee39-6e00-42a2-9e79-cdaec61a31c8-kube-api-access-b54wx\") pod \"1b4ccfde3488142cc254fb313062ed88e2d18a60b7907f7b7c6ca340287qg5t\" (UID: \"253dee39-6e00-42a2-9e79-cdaec61a31c8\") " pod="openstack-operators/1b4ccfde3488142cc254fb313062ed88e2d18a60b7907f7b7c6ca340287qg5t" Mar 16 18:01:47 crc kubenswrapper[5120]: I0316 18:01:47.081526 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/1b4ccfde3488142cc254fb313062ed88e2d18a60b7907f7b7c6ca340287qg5t" Mar 16 18:01:47 crc kubenswrapper[5120]: I0316 18:01:47.534260 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/1b4ccfde3488142cc254fb313062ed88e2d18a60b7907f7b7c6ca340287qg5t"] Mar 16 18:01:48 crc kubenswrapper[5120]: I0316 18:01:48.187702 5120 generic.go:358] "Generic (PLEG): container finished" podID="253dee39-6e00-42a2-9e79-cdaec61a31c8" containerID="876e71f85eb4257e6e176025a4c42a499e99f8cf72dc3850c27f85fea54a0019" exitCode=0 Mar 16 18:01:48 crc kubenswrapper[5120]: I0316 18:01:48.187797 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/1b4ccfde3488142cc254fb313062ed88e2d18a60b7907f7b7c6ca340287qg5t" event={"ID":"253dee39-6e00-42a2-9e79-cdaec61a31c8","Type":"ContainerDied","Data":"876e71f85eb4257e6e176025a4c42a499e99f8cf72dc3850c27f85fea54a0019"} Mar 16 18:01:48 crc kubenswrapper[5120]: I0316 18:01:48.189671 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/1b4ccfde3488142cc254fb313062ed88e2d18a60b7907f7b7c6ca340287qg5t" event={"ID":"253dee39-6e00-42a2-9e79-cdaec61a31c8","Type":"ContainerStarted","Data":"0367fa3996f661f23af5a62fd1ec00265efb2724a0b53615827233551ba67256"} Mar 16 18:01:48 crc kubenswrapper[5120]: I0316 18:01:48.319251 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-v822j_ac55471d-4e42-475f-a082-50f611571482/kube-multus/0.log" Mar 16 18:01:48 crc kubenswrapper[5120]: I0316 18:01:48.324187 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-crc_9f0bc7fcb0822a2c13eb2d22cd8c0641/kube-controller-manager/0.log" Mar 16 18:01:48 crc kubenswrapper[5120]: I0316 18:01:48.581589 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-v822j_ac55471d-4e42-475f-a082-50f611571482/kube-multus/0.log" Mar 16 18:01:48 crc kubenswrapper[5120]: I0316 18:01:48.587470 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-crc_9f0bc7fcb0822a2c13eb2d22cd8c0641/kube-controller-manager/0.log" Mar 16 18:01:49 crc kubenswrapper[5120]: I0316 18:01:49.203114 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/1b4ccfde3488142cc254fb313062ed88e2d18a60b7907f7b7c6ca340287qg5t" event={"ID":"253dee39-6e00-42a2-9e79-cdaec61a31c8","Type":"ContainerStarted","Data":"2f394bc0d4cd35b0c0b4498267b562b09206aaef6d5c73421fdb40b4b945c6fb"} Mar 16 18:01:50 crc kubenswrapper[5120]: I0316 18:01:50.215179 5120 generic.go:358] "Generic (PLEG): container finished" podID="253dee39-6e00-42a2-9e79-cdaec61a31c8" containerID="2f394bc0d4cd35b0c0b4498267b562b09206aaef6d5c73421fdb40b4b945c6fb" exitCode=0 Mar 16 18:01:50 crc kubenswrapper[5120]: I0316 18:01:50.215247 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/1b4ccfde3488142cc254fb313062ed88e2d18a60b7907f7b7c6ca340287qg5t" event={"ID":"253dee39-6e00-42a2-9e79-cdaec61a31c8","Type":"ContainerDied","Data":"2f394bc0d4cd35b0c0b4498267b562b09206aaef6d5c73421fdb40b4b945c6fb"} Mar 16 18:01:50 crc kubenswrapper[5120]: I0316 18:01:50.589690 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-operators/mariadb-operator-index-gb4m2" Mar 16 18:01:50 crc kubenswrapper[5120]: I0316 18:01:50.589886 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-operators/mariadb-operator-index-gb4m2" Mar 16 18:01:50 crc kubenswrapper[5120]: I0316 18:01:50.635115 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-operators/mariadb-operator-index-gb4m2" Mar 16 18:01:51 crc kubenswrapper[5120]: I0316 18:01:51.233240 5120 generic.go:358] "Generic (PLEG): container finished" podID="253dee39-6e00-42a2-9e79-cdaec61a31c8" containerID="399aceccc6721b6db5076edd42752a6b4daa18392bb3c610947ecb98cfdc3de1" exitCode=0 Mar 16 18:01:51 crc kubenswrapper[5120]: I0316 18:01:51.233301 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/1b4ccfde3488142cc254fb313062ed88e2d18a60b7907f7b7c6ca340287qg5t" event={"ID":"253dee39-6e00-42a2-9e79-cdaec61a31c8","Type":"ContainerDied","Data":"399aceccc6721b6db5076edd42752a6b4daa18392bb3c610947ecb98cfdc3de1"} Mar 16 18:01:51 crc kubenswrapper[5120]: I0316 18:01:51.285346 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/mariadb-operator-index-gb4m2" Mar 16 18:01:52 crc kubenswrapper[5120]: I0316 18:01:52.526834 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/1b4ccfde3488142cc254fb313062ed88e2d18a60b7907f7b7c6ca340287qg5t" Mar 16 18:01:52 crc kubenswrapper[5120]: I0316 18:01:52.587242 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/253dee39-6e00-42a2-9e79-cdaec61a31c8-bundle\") pod \"253dee39-6e00-42a2-9e79-cdaec61a31c8\" (UID: \"253dee39-6e00-42a2-9e79-cdaec61a31c8\") " Mar 16 18:01:52 crc kubenswrapper[5120]: I0316 18:01:52.587428 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/253dee39-6e00-42a2-9e79-cdaec61a31c8-util\") pod \"253dee39-6e00-42a2-9e79-cdaec61a31c8\" (UID: \"253dee39-6e00-42a2-9e79-cdaec61a31c8\") " Mar 16 18:01:52 crc kubenswrapper[5120]: I0316 18:01:52.587496 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b54wx\" (UniqueName: \"kubernetes.io/projected/253dee39-6e00-42a2-9e79-cdaec61a31c8-kube-api-access-b54wx\") pod \"253dee39-6e00-42a2-9e79-cdaec61a31c8\" (UID: \"253dee39-6e00-42a2-9e79-cdaec61a31c8\") " Mar 16 18:01:52 crc kubenswrapper[5120]: I0316 18:01:52.588631 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/253dee39-6e00-42a2-9e79-cdaec61a31c8-bundle" (OuterVolumeSpecName: "bundle") pod "253dee39-6e00-42a2-9e79-cdaec61a31c8" (UID: "253dee39-6e00-42a2-9e79-cdaec61a31c8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 18:01:52 crc kubenswrapper[5120]: I0316 18:01:52.598559 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/253dee39-6e00-42a2-9e79-cdaec61a31c8-kube-api-access-b54wx" (OuterVolumeSpecName: "kube-api-access-b54wx") pod "253dee39-6e00-42a2-9e79-cdaec61a31c8" (UID: "253dee39-6e00-42a2-9e79-cdaec61a31c8"). InnerVolumeSpecName "kube-api-access-b54wx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 18:01:52 crc kubenswrapper[5120]: I0316 18:01:52.603353 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/253dee39-6e00-42a2-9e79-cdaec61a31c8-util" (OuterVolumeSpecName: "util") pod "253dee39-6e00-42a2-9e79-cdaec61a31c8" (UID: "253dee39-6e00-42a2-9e79-cdaec61a31c8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 18:01:52 crc kubenswrapper[5120]: I0316 18:01:52.692986 5120 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/253dee39-6e00-42a2-9e79-cdaec61a31c8-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 18:01:52 crc kubenswrapper[5120]: I0316 18:01:52.693031 5120 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/253dee39-6e00-42a2-9e79-cdaec61a31c8-util\") on node \"crc\" DevicePath \"\"" Mar 16 18:01:52 crc kubenswrapper[5120]: I0316 18:01:52.693052 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b54wx\" (UniqueName: \"kubernetes.io/projected/253dee39-6e00-42a2-9e79-cdaec61a31c8-kube-api-access-b54wx\") on node \"crc\" DevicePath \"\"" Mar 16 18:01:53 crc kubenswrapper[5120]: I0316 18:01:53.257601 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/1b4ccfde3488142cc254fb313062ed88e2d18a60b7907f7b7c6ca340287qg5t" event={"ID":"253dee39-6e00-42a2-9e79-cdaec61a31c8","Type":"ContainerDied","Data":"0367fa3996f661f23af5a62fd1ec00265efb2724a0b53615827233551ba67256"} Mar 16 18:01:53 crc kubenswrapper[5120]: I0316 18:01:53.258028 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0367fa3996f661f23af5a62fd1ec00265efb2724a0b53615827233551ba67256" Mar 16 18:01:53 crc kubenswrapper[5120]: I0316 18:01:53.257625 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/1b4ccfde3488142cc254fb313062ed88e2d18a60b7907f7b7c6ca340287qg5t" Mar 16 18:02:00 crc kubenswrapper[5120]: I0316 18:02:00.133727 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-infra/auto-csr-approver-29561402-c8xjc"] Mar 16 18:02:00 crc kubenswrapper[5120]: I0316 18:02:00.136507 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="253dee39-6e00-42a2-9e79-cdaec61a31c8" containerName="pull" Mar 16 18:02:00 crc kubenswrapper[5120]: I0316 18:02:00.136535 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="253dee39-6e00-42a2-9e79-cdaec61a31c8" containerName="pull" Mar 16 18:02:00 crc kubenswrapper[5120]: I0316 18:02:00.136549 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="253dee39-6e00-42a2-9e79-cdaec61a31c8" containerName="util" Mar 16 18:02:00 crc kubenswrapper[5120]: I0316 18:02:00.136555 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="253dee39-6e00-42a2-9e79-cdaec61a31c8" containerName="util" Mar 16 18:02:00 crc kubenswrapper[5120]: I0316 18:02:00.136589 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="253dee39-6e00-42a2-9e79-cdaec61a31c8" containerName="extract" Mar 16 18:02:00 crc kubenswrapper[5120]: I0316 18:02:00.136594 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="253dee39-6e00-42a2-9e79-cdaec61a31c8" containerName="extract" Mar 16 18:02:00 crc kubenswrapper[5120]: I0316 18:02:00.136736 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="253dee39-6e00-42a2-9e79-cdaec61a31c8" containerName="extract" Mar 16 18:02:00 crc kubenswrapper[5120]: I0316 18:02:00.144748 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561402-c8xjc" Mar 16 18:02:00 crc kubenswrapper[5120]: I0316 18:02:00.148815 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-infra\"/\"csr-approver-sa-dockercfg-x2nsz\"" Mar 16 18:02:00 crc kubenswrapper[5120]: I0316 18:02:00.149146 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"openshift-service-ca.crt\"" Mar 16 18:02:00 crc kubenswrapper[5120]: I0316 18:02:00.150203 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"kube-root-ca.crt\"" Mar 16 18:02:00 crc kubenswrapper[5120]: I0316 18:02:00.154930 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561402-c8xjc"] Mar 16 18:02:00 crc kubenswrapper[5120]: I0316 18:02:00.165494 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dxmn\" (UniqueName: \"kubernetes.io/projected/1722f4f5-e490-446a-a941-986a1ea0d052-kube-api-access-4dxmn\") pod \"auto-csr-approver-29561402-c8xjc\" (UID: \"1722f4f5-e490-446a-a941-986a1ea0d052\") " pod="openshift-infra/auto-csr-approver-29561402-c8xjc" Mar 16 18:02:00 crc kubenswrapper[5120]: I0316 18:02:00.268061 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4dxmn\" (UniqueName: \"kubernetes.io/projected/1722f4f5-e490-446a-a941-986a1ea0d052-kube-api-access-4dxmn\") pod \"auto-csr-approver-29561402-c8xjc\" (UID: \"1722f4f5-e490-446a-a941-986a1ea0d052\") " pod="openshift-infra/auto-csr-approver-29561402-c8xjc" Mar 16 18:02:00 crc kubenswrapper[5120]: I0316 18:02:00.285663 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dxmn\" (UniqueName: \"kubernetes.io/projected/1722f4f5-e490-446a-a941-986a1ea0d052-kube-api-access-4dxmn\") pod \"auto-csr-approver-29561402-c8xjc\" (UID: \"1722f4f5-e490-446a-a941-986a1ea0d052\") " pod="openshift-infra/auto-csr-approver-29561402-c8xjc" Mar 16 18:02:00 crc kubenswrapper[5120]: I0316 18:02:00.464255 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561402-c8xjc" Mar 16 18:02:00 crc kubenswrapper[5120]: I0316 18:02:00.877723 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561402-c8xjc"] Mar 16 18:02:01 crc kubenswrapper[5120]: I0316 18:02:01.314292 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561402-c8xjc" event={"ID":"1722f4f5-e490-446a-a941-986a1ea0d052","Type":"ContainerStarted","Data":"b5b3c121749f91aab2d2584a701f729e470842ed30c1bb82cef214b1fe5fc4fe"} Mar 16 18:02:01 crc kubenswrapper[5120]: I0316 18:02:01.743666 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-operators/mariadb-operator-controller-manager-68d86d8d4b-2mr9j"] Mar 16 18:02:01 crc kubenswrapper[5120]: I0316 18:02:01.749460 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/mariadb-operator-controller-manager-68d86d8d4b-2mr9j" Mar 16 18:02:01 crc kubenswrapper[5120]: I0316 18:02:01.754622 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-operators\"/\"webhook-server-cert\"" Mar 16 18:02:01 crc kubenswrapper[5120]: I0316 18:02:01.754705 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-operators\"/\"mariadb-operator-controller-manager-dockercfg-xzdzl\"" Mar 16 18:02:01 crc kubenswrapper[5120]: I0316 18:02:01.755267 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-operators\"/\"mariadb-operator-controller-manager-service-cert\"" Mar 16 18:02:01 crc kubenswrapper[5120]: I0316 18:02:01.757302 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/mariadb-operator-controller-manager-68d86d8d4b-2mr9j"] Mar 16 18:02:01 crc kubenswrapper[5120]: I0316 18:02:01.799303 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fce08707-0dff-4592-b19e-607aa752b7ca-apiservice-cert\") pod \"mariadb-operator-controller-manager-68d86d8d4b-2mr9j\" (UID: \"fce08707-0dff-4592-b19e-607aa752b7ca\") " pod="openstack-operators/mariadb-operator-controller-manager-68d86d8d4b-2mr9j" Mar 16 18:02:01 crc kubenswrapper[5120]: I0316 18:02:01.799476 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fce08707-0dff-4592-b19e-607aa752b7ca-webhook-cert\") pod \"mariadb-operator-controller-manager-68d86d8d4b-2mr9j\" (UID: \"fce08707-0dff-4592-b19e-607aa752b7ca\") " pod="openstack-operators/mariadb-operator-controller-manager-68d86d8d4b-2mr9j" Mar 16 18:02:01 crc kubenswrapper[5120]: I0316 18:02:01.799513 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hq5w\" (UniqueName: \"kubernetes.io/projected/fce08707-0dff-4592-b19e-607aa752b7ca-kube-api-access-6hq5w\") pod \"mariadb-operator-controller-manager-68d86d8d4b-2mr9j\" (UID: \"fce08707-0dff-4592-b19e-607aa752b7ca\") " pod="openstack-operators/mariadb-operator-controller-manager-68d86d8d4b-2mr9j" Mar 16 18:02:01 crc kubenswrapper[5120]: I0316 18:02:01.900749 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fce08707-0dff-4592-b19e-607aa752b7ca-apiservice-cert\") pod \"mariadb-operator-controller-manager-68d86d8d4b-2mr9j\" (UID: \"fce08707-0dff-4592-b19e-607aa752b7ca\") " pod="openstack-operators/mariadb-operator-controller-manager-68d86d8d4b-2mr9j" Mar 16 18:02:01 crc kubenswrapper[5120]: I0316 18:02:01.901138 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fce08707-0dff-4592-b19e-607aa752b7ca-webhook-cert\") pod \"mariadb-operator-controller-manager-68d86d8d4b-2mr9j\" (UID: \"fce08707-0dff-4592-b19e-607aa752b7ca\") " pod="openstack-operators/mariadb-operator-controller-manager-68d86d8d4b-2mr9j" Mar 16 18:02:01 crc kubenswrapper[5120]: I0316 18:02:01.901179 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6hq5w\" (UniqueName: \"kubernetes.io/projected/fce08707-0dff-4592-b19e-607aa752b7ca-kube-api-access-6hq5w\") pod \"mariadb-operator-controller-manager-68d86d8d4b-2mr9j\" (UID: \"fce08707-0dff-4592-b19e-607aa752b7ca\") " pod="openstack-operators/mariadb-operator-controller-manager-68d86d8d4b-2mr9j" Mar 16 18:02:01 crc kubenswrapper[5120]: I0316 18:02:01.907854 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fce08707-0dff-4592-b19e-607aa752b7ca-apiservice-cert\") pod \"mariadb-operator-controller-manager-68d86d8d4b-2mr9j\" (UID: \"fce08707-0dff-4592-b19e-607aa752b7ca\") " pod="openstack-operators/mariadb-operator-controller-manager-68d86d8d4b-2mr9j" Mar 16 18:02:01 crc kubenswrapper[5120]: I0316 18:02:01.908646 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fce08707-0dff-4592-b19e-607aa752b7ca-webhook-cert\") pod \"mariadb-operator-controller-manager-68d86d8d4b-2mr9j\" (UID: \"fce08707-0dff-4592-b19e-607aa752b7ca\") " pod="openstack-operators/mariadb-operator-controller-manager-68d86d8d4b-2mr9j" Mar 16 18:02:01 crc kubenswrapper[5120]: I0316 18:02:01.918607 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hq5w\" (UniqueName: \"kubernetes.io/projected/fce08707-0dff-4592-b19e-607aa752b7ca-kube-api-access-6hq5w\") pod \"mariadb-operator-controller-manager-68d86d8d4b-2mr9j\" (UID: \"fce08707-0dff-4592-b19e-607aa752b7ca\") " pod="openstack-operators/mariadb-operator-controller-manager-68d86d8d4b-2mr9j" Mar 16 18:02:02 crc kubenswrapper[5120]: I0316 18:02:02.071051 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/mariadb-operator-controller-manager-68d86d8d4b-2mr9j" Mar 16 18:02:02 crc kubenswrapper[5120]: I0316 18:02:02.353367 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/mariadb-operator-controller-manager-68d86d8d4b-2mr9j"] Mar 16 18:02:03 crc kubenswrapper[5120]: I0316 18:02:03.333037 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/mariadb-operator-controller-manager-68d86d8d4b-2mr9j" event={"ID":"fce08707-0dff-4592-b19e-607aa752b7ca","Type":"ContainerStarted","Data":"c7063f00878583780e83fe13b446eebc2364249eb5b0164eadb41ec2889d3ba2"} Mar 16 18:02:03 crc kubenswrapper[5120]: I0316 18:02:03.333429 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-operators/mariadb-operator-controller-manager-68d86d8d4b-2mr9j" Mar 16 18:02:03 crc kubenswrapper[5120]: I0316 18:02:03.333467 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/mariadb-operator-controller-manager-68d86d8d4b-2mr9j" event={"ID":"fce08707-0dff-4592-b19e-607aa752b7ca","Type":"ContainerStarted","Data":"3f8123780d5d201fde118c9edea2db68ba89234e26e369247ebad80352fd0aa2"} Mar 16 18:02:03 crc kubenswrapper[5120]: I0316 18:02:03.335803 5120 generic.go:358] "Generic (PLEG): container finished" podID="1722f4f5-e490-446a-a941-986a1ea0d052" containerID="cf2b114dda245ff770129611742820d3e5937fa8510f57982adc6da900d1ec60" exitCode=0 Mar 16 18:02:03 crc kubenswrapper[5120]: I0316 18:02:03.335947 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561402-c8xjc" event={"ID":"1722f4f5-e490-446a-a941-986a1ea0d052","Type":"ContainerDied","Data":"cf2b114dda245ff770129611742820d3e5937fa8510f57982adc6da900d1ec60"} Mar 16 18:02:03 crc kubenswrapper[5120]: I0316 18:02:03.351300 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/mariadb-operator-controller-manager-68d86d8d4b-2mr9j" podStartSLOduration=2.351283697 podStartE2EDuration="2.351283697s" podCreationTimestamp="2026-03-16 18:02:01 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 18:02:03.349287593 +0000 UTC m=+9025.503219260" watchObservedRunningTime="2026-03-16 18:02:03.351283697 +0000 UTC m=+9025.505215354" Mar 16 18:02:04 crc kubenswrapper[5120]: I0316 18:02:04.613115 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561402-c8xjc" Mar 16 18:02:04 crc kubenswrapper[5120]: I0316 18:02:04.760298 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4dxmn\" (UniqueName: \"kubernetes.io/projected/1722f4f5-e490-446a-a941-986a1ea0d052-kube-api-access-4dxmn\") pod \"1722f4f5-e490-446a-a941-986a1ea0d052\" (UID: \"1722f4f5-e490-446a-a941-986a1ea0d052\") " Mar 16 18:02:04 crc kubenswrapper[5120]: I0316 18:02:04.766131 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1722f4f5-e490-446a-a941-986a1ea0d052-kube-api-access-4dxmn" (OuterVolumeSpecName: "kube-api-access-4dxmn") pod "1722f4f5-e490-446a-a941-986a1ea0d052" (UID: "1722f4f5-e490-446a-a941-986a1ea0d052"). InnerVolumeSpecName "kube-api-access-4dxmn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 18:02:04 crc kubenswrapper[5120]: I0316 18:02:04.863048 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4dxmn\" (UniqueName: \"kubernetes.io/projected/1722f4f5-e490-446a-a941-986a1ea0d052-kube-api-access-4dxmn\") on node \"crc\" DevicePath \"\"" Mar 16 18:02:05 crc kubenswrapper[5120]: I0316 18:02:05.354922 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561402-c8xjc" event={"ID":"1722f4f5-e490-446a-a941-986a1ea0d052","Type":"ContainerDied","Data":"b5b3c121749f91aab2d2584a701f729e470842ed30c1bb82cef214b1fe5fc4fe"} Mar 16 18:02:05 crc kubenswrapper[5120]: I0316 18:02:05.354961 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b5b3c121749f91aab2d2584a701f729e470842ed30c1bb82cef214b1fe5fc4fe" Mar 16 18:02:05 crc kubenswrapper[5120]: I0316 18:02:05.355256 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561402-c8xjc" Mar 16 18:02:05 crc kubenswrapper[5120]: I0316 18:02:05.673783 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-infra/auto-csr-approver-29561396-h5qx4"] Mar 16 18:02:05 crc kubenswrapper[5120]: I0316 18:02:05.679228 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-infra/auto-csr-approver-29561396-h5qx4"] Mar 16 18:02:06 crc kubenswrapper[5120]: I0316 18:02:06.671193 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4996e4b4-c43e-48e7-8715-e32474943ac9" path="/var/lib/kubelet/pods/4996e4b4-c43e-48e7-8715-e32474943ac9/volumes" Mar 16 18:02:07 crc kubenswrapper[5120]: E0316 18:02:07.367840 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=893459 actualBytes=10240 Mar 16 18:02:14 crc kubenswrapper[5120]: I0316 18:02:14.349918 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/mariadb-operator-controller-manager-68d86d8d4b-2mr9j" Mar 16 18:02:18 crc kubenswrapper[5120]: I0316 18:02:18.758919 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-operators/infra-operator-index-54cv6"] Mar 16 18:02:18 crc kubenswrapper[5120]: I0316 18:02:18.760218 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1722f4f5-e490-446a-a941-986a1ea0d052" containerName="oc" Mar 16 18:02:18 crc kubenswrapper[5120]: I0316 18:02:18.760240 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1722f4f5-e490-446a-a941-986a1ea0d052" containerName="oc" Mar 16 18:02:18 crc kubenswrapper[5120]: I0316 18:02:18.760379 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1722f4f5-e490-446a-a941-986a1ea0d052" containerName="oc" Mar 16 18:02:18 crc kubenswrapper[5120]: I0316 18:02:18.775657 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/infra-operator-index-54cv6"] Mar 16 18:02:18 crc kubenswrapper[5120]: I0316 18:02:18.775741 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/infra-operator-index-54cv6" Mar 16 18:02:18 crc kubenswrapper[5120]: I0316 18:02:18.778739 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-operators\"/\"infra-operator-index-dockercfg-jnnv6\"" Mar 16 18:02:18 crc kubenswrapper[5120]: I0316 18:02:18.846843 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9nn4d\" (UniqueName: \"kubernetes.io/projected/0caa24ff-cb6e-42b4-9bf8-4cada33dd11f-kube-api-access-9nn4d\") pod \"infra-operator-index-54cv6\" (UID: \"0caa24ff-cb6e-42b4-9bf8-4cada33dd11f\") " pod="openstack-operators/infra-operator-index-54cv6" Mar 16 18:02:18 crc kubenswrapper[5120]: I0316 18:02:18.951392 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9nn4d\" (UniqueName: \"kubernetes.io/projected/0caa24ff-cb6e-42b4-9bf8-4cada33dd11f-kube-api-access-9nn4d\") pod \"infra-operator-index-54cv6\" (UID: \"0caa24ff-cb6e-42b4-9bf8-4cada33dd11f\") " pod="openstack-operators/infra-operator-index-54cv6" Mar 16 18:02:18 crc kubenswrapper[5120]: I0316 18:02:18.990910 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9nn4d\" (UniqueName: \"kubernetes.io/projected/0caa24ff-cb6e-42b4-9bf8-4cada33dd11f-kube-api-access-9nn4d\") pod \"infra-operator-index-54cv6\" (UID: \"0caa24ff-cb6e-42b4-9bf8-4cada33dd11f\") " pod="openstack-operators/infra-operator-index-54cv6" Mar 16 18:02:19 crc kubenswrapper[5120]: I0316 18:02:19.094461 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/infra-operator-index-54cv6" Mar 16 18:02:19 crc kubenswrapper[5120]: I0316 18:02:19.565239 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/infra-operator-index-54cv6"] Mar 16 18:02:20 crc kubenswrapper[5120]: I0316 18:02:20.454908 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/infra-operator-index-54cv6" event={"ID":"0caa24ff-cb6e-42b4-9bf8-4cada33dd11f","Type":"ContainerStarted","Data":"a2b0c13752c4bb2d78d0b5447e271e5514a4221dd7978e02a87e01f999c3f459"} Mar 16 18:02:21 crc kubenswrapper[5120]: I0316 18:02:21.062580 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["horizon-kuttl-tests/openstack-galera-0"] Mar 16 18:02:21 crc kubenswrapper[5120]: I0316 18:02:21.068174 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="horizon-kuttl-tests/openstack-galera-0" Mar 16 18:02:21 crc kubenswrapper[5120]: I0316 18:02:21.071370 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"horizon-kuttl-tests\"/\"openshift-service-ca.crt\"" Mar 16 18:02:21 crc kubenswrapper[5120]: I0316 18:02:21.072681 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"horizon-kuttl-tests\"/\"openstack-config-data\"" Mar 16 18:02:21 crc kubenswrapper[5120]: I0316 18:02:21.072750 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"horizon-kuttl-tests\"/\"openstack-scripts\"" Mar 16 18:02:21 crc kubenswrapper[5120]: I0316 18:02:21.073024 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"horizon-kuttl-tests\"/\"galera-openstack-dockercfg-4l6cf\"" Mar 16 18:02:21 crc kubenswrapper[5120]: I0316 18:02:21.080023 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"horizon-kuttl-tests\"/\"kube-root-ca.crt\"" Mar 16 18:02:21 crc kubenswrapper[5120]: I0316 18:02:21.086215 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["horizon-kuttl-tests/openstack-galera-0"] Mar 16 18:02:21 crc kubenswrapper[5120]: I0316 18:02:21.099945 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["horizon-kuttl-tests/openstack-galera-1"] Mar 16 18:02:21 crc kubenswrapper[5120]: I0316 18:02:21.115985 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["horizon-kuttl-tests/openstack-galera-2"] Mar 16 18:02:21 crc kubenswrapper[5120]: I0316 18:02:21.116270 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="horizon-kuttl-tests/openstack-galera-1" Mar 16 18:02:21 crc kubenswrapper[5120]: I0316 18:02:21.122323 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="horizon-kuttl-tests/openstack-galera-2" Mar 16 18:02:21 crc kubenswrapper[5120]: I0316 18:02:21.123738 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["horizon-kuttl-tests/openstack-galera-2"] Mar 16 18:02:21 crc kubenswrapper[5120]: I0316 18:02:21.132878 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["horizon-kuttl-tests/openstack-galera-1"] Mar 16 18:02:21 crc kubenswrapper[5120]: I0316 18:02:21.207505 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-operators/0b4c51a436ce56c4393293420dad5bb37f4e2c4f062c7176860d2815958dmj5"] Mar 16 18:02:21 crc kubenswrapper[5120]: I0316 18:02:21.208946 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/1cbada35-20cb-4e85-b586-27ff9941011a-kolla-config\") pod \"openstack-galera-2\" (UID: \"1cbada35-20cb-4e85-b586-27ff9941011a\") " pod="horizon-kuttl-tests/openstack-galera-2" Mar 16 18:02:21 crc kubenswrapper[5120]: I0316 18:02:21.209001 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/1cbada35-20cb-4e85-b586-27ff9941011a-config-data-generated\") pod \"openstack-galera-2\" (UID: \"1cbada35-20cb-4e85-b586-27ff9941011a\") " pod="horizon-kuttl-tests/openstack-galera-2" Mar 16 18:02:21 crc kubenswrapper[5120]: I0316 18:02:21.209115 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") pod \"openstack-galera-1\" (UID: \"a9402e78-0f0a-4bb6-bc56-551b7ccf4bda\") " pod="horizon-kuttl-tests/openstack-galera-1" Mar 16 18:02:21 crc kubenswrapper[5120]: I0316 18:02:21.209256 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/1cbada35-20cb-4e85-b586-27ff9941011a-config-data-default\") pod \"openstack-galera-2\" (UID: \"1cbada35-20cb-4e85-b586-27ff9941011a\") " pod="horizon-kuttl-tests/openstack-galera-2" Mar 16 18:02:21 crc kubenswrapper[5120]: I0316 18:02:21.209348 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/dabfd53a-6aac-4c5d-a3d2-9d38975c0e5a-kolla-config\") pod \"openstack-galera-0\" (UID: \"dabfd53a-6aac-4c5d-a3d2-9d38975c0e5a\") " pod="horizon-kuttl-tests/openstack-galera-0" Mar 16 18:02:21 crc kubenswrapper[5120]: I0316 18:02:21.209400 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a9402e78-0f0a-4bb6-bc56-551b7ccf4bda-operator-scripts\") pod \"openstack-galera-1\" (UID: \"a9402e78-0f0a-4bb6-bc56-551b7ccf4bda\") " pod="horizon-kuttl-tests/openstack-galera-1" Mar 16 18:02:21 crc kubenswrapper[5120]: I0316 18:02:21.209548 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8mc9\" (UniqueName: \"kubernetes.io/projected/dabfd53a-6aac-4c5d-a3d2-9d38975c0e5a-kube-api-access-r8mc9\") pod \"openstack-galera-0\" (UID: \"dabfd53a-6aac-4c5d-a3d2-9d38975c0e5a\") " pod="horizon-kuttl-tests/openstack-galera-0" Mar 16 18:02:21 crc kubenswrapper[5120]: I0316 18:02:21.209679 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/a9402e78-0f0a-4bb6-bc56-551b7ccf4bda-kolla-config\") pod \"openstack-galera-1\" (UID: \"a9402e78-0f0a-4bb6-bc56-551b7ccf4bda\") " pod="horizon-kuttl-tests/openstack-galera-1" Mar 16 18:02:21 crc kubenswrapper[5120]: I0316 18:02:21.209731 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"openstack-galera-2\" (UID: \"1cbada35-20cb-4e85-b586-27ff9941011a\") " pod="horizon-kuttl-tests/openstack-galera-2" Mar 16 18:02:21 crc kubenswrapper[5120]: I0316 18:02:21.209831 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/a9402e78-0f0a-4bb6-bc56-551b7ccf4bda-config-data-default\") pod \"openstack-galera-1\" (UID: \"a9402e78-0f0a-4bb6-bc56-551b7ccf4bda\") " pod="horizon-kuttl-tests/openstack-galera-1" Mar 16 18:02:21 crc kubenswrapper[5120]: I0316 18:02:21.209932 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/dabfd53a-6aac-4c5d-a3d2-9d38975c0e5a-config-data-generated\") pod \"openstack-galera-0\" (UID: \"dabfd53a-6aac-4c5d-a3d2-9d38975c0e5a\") " pod="horizon-kuttl-tests/openstack-galera-0" Mar 16 18:02:21 crc kubenswrapper[5120]: I0316 18:02:21.209966 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/a9402e78-0f0a-4bb6-bc56-551b7ccf4bda-config-data-generated\") pod \"openstack-galera-1\" (UID: \"a9402e78-0f0a-4bb6-bc56-551b7ccf4bda\") " pod="horizon-kuttl-tests/openstack-galera-1" Mar 16 18:02:21 crc kubenswrapper[5120]: I0316 18:02:21.209994 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/dabfd53a-6aac-4c5d-a3d2-9d38975c0e5a-operator-scripts\") pod \"openstack-galera-0\" (UID: \"dabfd53a-6aac-4c5d-a3d2-9d38975c0e5a\") " pod="horizon-kuttl-tests/openstack-galera-0" Mar 16 18:02:21 crc kubenswrapper[5120]: I0316 18:02:21.210080 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"openstack-galera-0\" (UID: \"dabfd53a-6aac-4c5d-a3d2-9d38975c0e5a\") " pod="horizon-kuttl-tests/openstack-galera-0" Mar 16 18:02:21 crc kubenswrapper[5120]: I0316 18:02:21.210120 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gshmb\" (UniqueName: \"kubernetes.io/projected/a9402e78-0f0a-4bb6-bc56-551b7ccf4bda-kube-api-access-gshmb\") pod \"openstack-galera-1\" (UID: \"a9402e78-0f0a-4bb6-bc56-551b7ccf4bda\") " pod="horizon-kuttl-tests/openstack-galera-1" Mar 16 18:02:21 crc kubenswrapper[5120]: I0316 18:02:21.210143 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctk8p\" (UniqueName: \"kubernetes.io/projected/1cbada35-20cb-4e85-b586-27ff9941011a-kube-api-access-ctk8p\") pod \"openstack-galera-2\" (UID: \"1cbada35-20cb-4e85-b586-27ff9941011a\") " pod="horizon-kuttl-tests/openstack-galera-2" Mar 16 18:02:21 crc kubenswrapper[5120]: I0316 18:02:21.210188 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/dabfd53a-6aac-4c5d-a3d2-9d38975c0e5a-config-data-default\") pod \"openstack-galera-0\" (UID: \"dabfd53a-6aac-4c5d-a3d2-9d38975c0e5a\") " pod="horizon-kuttl-tests/openstack-galera-0" Mar 16 18:02:21 crc kubenswrapper[5120]: I0316 18:02:21.210226 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/1cbada35-20cb-4e85-b586-27ff9941011a-operator-scripts\") pod \"openstack-galera-2\" (UID: \"1cbada35-20cb-4e85-b586-27ff9941011a\") " pod="horizon-kuttl-tests/openstack-galera-2" Mar 16 18:02:21 crc kubenswrapper[5120]: I0316 18:02:21.217584 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/0b4c51a436ce56c4393293420dad5bb37f4e2c4f062c7176860d2815958dmj5" Mar 16 18:02:21 crc kubenswrapper[5120]: I0316 18:02:21.220958 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-operators\"/\"default-dockercfg-rmzsx\"" Mar 16 18:02:21 crc kubenswrapper[5120]: I0316 18:02:21.227705 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/0b4c51a436ce56c4393293420dad5bb37f4e2c4f062c7176860d2815958dmj5"] Mar 16 18:02:21 crc kubenswrapper[5120]: I0316 18:02:21.311338 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/dabfd53a-6aac-4c5d-a3d2-9d38975c0e5a-config-data-generated\") pod \"openstack-galera-0\" (UID: \"dabfd53a-6aac-4c5d-a3d2-9d38975c0e5a\") " pod="horizon-kuttl-tests/openstack-galera-0" Mar 16 18:02:21 crc kubenswrapper[5120]: I0316 18:02:21.311380 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/a9402e78-0f0a-4bb6-bc56-551b7ccf4bda-config-data-generated\") pod \"openstack-galera-1\" (UID: \"a9402e78-0f0a-4bb6-bc56-551b7ccf4bda\") " pod="horizon-kuttl-tests/openstack-galera-1" Mar 16 18:02:21 crc kubenswrapper[5120]: I0316 18:02:21.311403 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/dabfd53a-6aac-4c5d-a3d2-9d38975c0e5a-operator-scripts\") pod \"openstack-galera-0\" (UID: \"dabfd53a-6aac-4c5d-a3d2-9d38975c0e5a\") " pod="horizon-kuttl-tests/openstack-galera-0" Mar 16 18:02:21 crc kubenswrapper[5120]: I0316 18:02:21.311429 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rblsc\" (UniqueName: \"kubernetes.io/projected/8b1f7bb3-43d7-4209-b335-a671c96c1e8e-kube-api-access-rblsc\") pod \"0b4c51a436ce56c4393293420dad5bb37f4e2c4f062c7176860d2815958dmj5\" (UID: \"8b1f7bb3-43d7-4209-b335-a671c96c1e8e\") " pod="openstack-operators/0b4c51a436ce56c4393293420dad5bb37f4e2c4f062c7176860d2815958dmj5" Mar 16 18:02:21 crc kubenswrapper[5120]: I0316 18:02:21.311500 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"openstack-galera-0\" (UID: \"dabfd53a-6aac-4c5d-a3d2-9d38975c0e5a\") " pod="horizon-kuttl-tests/openstack-galera-0" Mar 16 18:02:21 crc kubenswrapper[5120]: I0316 18:02:21.311526 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gshmb\" (UniqueName: \"kubernetes.io/projected/a9402e78-0f0a-4bb6-bc56-551b7ccf4bda-kube-api-access-gshmb\") pod \"openstack-galera-1\" (UID: \"a9402e78-0f0a-4bb6-bc56-551b7ccf4bda\") " pod="horizon-kuttl-tests/openstack-galera-1" Mar 16 18:02:21 crc kubenswrapper[5120]: I0316 18:02:21.311547 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ctk8p\" (UniqueName: \"kubernetes.io/projected/1cbada35-20cb-4e85-b586-27ff9941011a-kube-api-access-ctk8p\") pod \"openstack-galera-2\" (UID: \"1cbada35-20cb-4e85-b586-27ff9941011a\") " pod="horizon-kuttl-tests/openstack-galera-2" Mar 16 18:02:21 crc kubenswrapper[5120]: I0316 18:02:21.311563 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8b1f7bb3-43d7-4209-b335-a671c96c1e8e-util\") pod \"0b4c51a436ce56c4393293420dad5bb37f4e2c4f062c7176860d2815958dmj5\" (UID: \"8b1f7bb3-43d7-4209-b335-a671c96c1e8e\") " pod="openstack-operators/0b4c51a436ce56c4393293420dad5bb37f4e2c4f062c7176860d2815958dmj5" Mar 16 18:02:21 crc kubenswrapper[5120]: I0316 18:02:21.311591 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8b1f7bb3-43d7-4209-b335-a671c96c1e8e-bundle\") pod \"0b4c51a436ce56c4393293420dad5bb37f4e2c4f062c7176860d2815958dmj5\" (UID: \"8b1f7bb3-43d7-4209-b335-a671c96c1e8e\") " pod="openstack-operators/0b4c51a436ce56c4393293420dad5bb37f4e2c4f062c7176860d2815958dmj5" Mar 16 18:02:21 crc kubenswrapper[5120]: I0316 18:02:21.311612 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/dabfd53a-6aac-4c5d-a3d2-9d38975c0e5a-config-data-default\") pod \"openstack-galera-0\" (UID: \"dabfd53a-6aac-4c5d-a3d2-9d38975c0e5a\") " pod="horizon-kuttl-tests/openstack-galera-0" Mar 16 18:02:21 crc kubenswrapper[5120]: I0316 18:02:21.311784 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/1cbada35-20cb-4e85-b586-27ff9941011a-operator-scripts\") pod \"openstack-galera-2\" (UID: \"1cbada35-20cb-4e85-b586-27ff9941011a\") " pod="horizon-kuttl-tests/openstack-galera-2" Mar 16 18:02:21 crc kubenswrapper[5120]: I0316 18:02:21.311930 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"openstack-galera-0\" (UID: \"dabfd53a-6aac-4c5d-a3d2-9d38975c0e5a\") device mount path \"/mnt/openstack/pv10\"" pod="horizon-kuttl-tests/openstack-galera-0" Mar 16 18:02:21 crc kubenswrapper[5120]: I0316 18:02:21.312023 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/1cbada35-20cb-4e85-b586-27ff9941011a-kolla-config\") pod \"openstack-galera-2\" (UID: \"1cbada35-20cb-4e85-b586-27ff9941011a\") " pod="horizon-kuttl-tests/openstack-galera-2" Mar 16 18:02:21 crc kubenswrapper[5120]: I0316 18:02:21.312060 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/1cbada35-20cb-4e85-b586-27ff9941011a-config-data-generated\") pod \"openstack-galera-2\" (UID: \"1cbada35-20cb-4e85-b586-27ff9941011a\") " pod="horizon-kuttl-tests/openstack-galera-2" Mar 16 18:02:21 crc kubenswrapper[5120]: I0316 18:02:21.312108 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/a9402e78-0f0a-4bb6-bc56-551b7ccf4bda-config-data-generated\") pod \"openstack-galera-1\" (UID: \"a9402e78-0f0a-4bb6-bc56-551b7ccf4bda\") " pod="horizon-kuttl-tests/openstack-galera-1" Mar 16 18:02:21 crc kubenswrapper[5120]: I0316 18:02:21.312249 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") pod \"openstack-galera-1\" (UID: \"a9402e78-0f0a-4bb6-bc56-551b7ccf4bda\") " pod="horizon-kuttl-tests/openstack-galera-1" Mar 16 18:02:21 crc kubenswrapper[5120]: I0316 18:02:21.312293 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/1cbada35-20cb-4e85-b586-27ff9941011a-config-data-default\") pod \"openstack-galera-2\" (UID: \"1cbada35-20cb-4e85-b586-27ff9941011a\") " pod="horizon-kuttl-tests/openstack-galera-2" Mar 16 18:02:21 crc kubenswrapper[5120]: I0316 18:02:21.312325 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/dabfd53a-6aac-4c5d-a3d2-9d38975c0e5a-kolla-config\") pod \"openstack-galera-0\" (UID: \"dabfd53a-6aac-4c5d-a3d2-9d38975c0e5a\") " pod="horizon-kuttl-tests/openstack-galera-0" Mar 16 18:02:21 crc kubenswrapper[5120]: I0316 18:02:21.312348 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a9402e78-0f0a-4bb6-bc56-551b7ccf4bda-operator-scripts\") pod \"openstack-galera-1\" (UID: \"a9402e78-0f0a-4bb6-bc56-551b7ccf4bda\") " pod="horizon-kuttl-tests/openstack-galera-1" Mar 16 18:02:21 crc kubenswrapper[5120]: I0316 18:02:21.312436 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r8mc9\" (UniqueName: \"kubernetes.io/projected/dabfd53a-6aac-4c5d-a3d2-9d38975c0e5a-kube-api-access-r8mc9\") pod \"openstack-galera-0\" (UID: \"dabfd53a-6aac-4c5d-a3d2-9d38975c0e5a\") " pod="horizon-kuttl-tests/openstack-galera-0" Mar 16 18:02:21 crc kubenswrapper[5120]: I0316 18:02:21.312449 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") pod \"openstack-galera-1\" (UID: \"a9402e78-0f0a-4bb6-bc56-551b7ccf4bda\") device mount path \"/mnt/openstack/pv11\"" pod="horizon-kuttl-tests/openstack-galera-1" Mar 16 18:02:21 crc kubenswrapper[5120]: I0316 18:02:21.312563 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/1cbada35-20cb-4e85-b586-27ff9941011a-config-data-generated\") pod \"openstack-galera-2\" (UID: \"1cbada35-20cb-4e85-b586-27ff9941011a\") " pod="horizon-kuttl-tests/openstack-galera-2" Mar 16 18:02:21 crc kubenswrapper[5120]: I0316 18:02:21.312979 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/1cbada35-20cb-4e85-b586-27ff9941011a-kolla-config\") pod \"openstack-galera-2\" (UID: \"1cbada35-20cb-4e85-b586-27ff9941011a\") " pod="horizon-kuttl-tests/openstack-galera-2" Mar 16 18:02:21 crc kubenswrapper[5120]: I0316 18:02:21.313021 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/dabfd53a-6aac-4c5d-a3d2-9d38975c0e5a-config-data-default\") pod \"openstack-galera-0\" (UID: \"dabfd53a-6aac-4c5d-a3d2-9d38975c0e5a\") " pod="horizon-kuttl-tests/openstack-galera-0" Mar 16 18:02:21 crc kubenswrapper[5120]: I0316 18:02:21.313173 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/a9402e78-0f0a-4bb6-bc56-551b7ccf4bda-kolla-config\") pod \"openstack-galera-1\" (UID: \"a9402e78-0f0a-4bb6-bc56-551b7ccf4bda\") " pod="horizon-kuttl-tests/openstack-galera-1" Mar 16 18:02:21 crc kubenswrapper[5120]: I0316 18:02:21.313220 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/dabfd53a-6aac-4c5d-a3d2-9d38975c0e5a-kolla-config\") pod \"openstack-galera-0\" (UID: \"dabfd53a-6aac-4c5d-a3d2-9d38975c0e5a\") " pod="horizon-kuttl-tests/openstack-galera-0" Mar 16 18:02:21 crc kubenswrapper[5120]: I0316 18:02:21.313222 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"openstack-galera-2\" (UID: \"1cbada35-20cb-4e85-b586-27ff9941011a\") " pod="horizon-kuttl-tests/openstack-galera-2" Mar 16 18:02:21 crc kubenswrapper[5120]: I0316 18:02:21.313317 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"openstack-galera-2\" (UID: \"1cbada35-20cb-4e85-b586-27ff9941011a\") device mount path \"/mnt/openstack/pv05\"" pod="horizon-kuttl-tests/openstack-galera-2" Mar 16 18:02:21 crc kubenswrapper[5120]: I0316 18:02:21.313409 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/1cbada35-20cb-4e85-b586-27ff9941011a-config-data-default\") pod \"openstack-galera-2\" (UID: \"1cbada35-20cb-4e85-b586-27ff9941011a\") " pod="horizon-kuttl-tests/openstack-galera-2" Mar 16 18:02:21 crc kubenswrapper[5120]: I0316 18:02:21.313824 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/1cbada35-20cb-4e85-b586-27ff9941011a-operator-scripts\") pod \"openstack-galera-2\" (UID: \"1cbada35-20cb-4e85-b586-27ff9941011a\") " pod="horizon-kuttl-tests/openstack-galera-2" Mar 16 18:02:21 crc kubenswrapper[5120]: I0316 18:02:21.313321 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/a9402e78-0f0a-4bb6-bc56-551b7ccf4bda-config-data-default\") pod \"openstack-galera-1\" (UID: \"a9402e78-0f0a-4bb6-bc56-551b7ccf4bda\") " pod="horizon-kuttl-tests/openstack-galera-1" Mar 16 18:02:21 crc kubenswrapper[5120]: I0316 18:02:21.314143 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/a9402e78-0f0a-4bb6-bc56-551b7ccf4bda-config-data-default\") pod \"openstack-galera-1\" (UID: \"a9402e78-0f0a-4bb6-bc56-551b7ccf4bda\") " pod="horizon-kuttl-tests/openstack-galera-1" Mar 16 18:02:21 crc kubenswrapper[5120]: I0316 18:02:21.314206 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/dabfd53a-6aac-4c5d-a3d2-9d38975c0e5a-config-data-generated\") pod \"openstack-galera-0\" (UID: \"dabfd53a-6aac-4c5d-a3d2-9d38975c0e5a\") " pod="horizon-kuttl-tests/openstack-galera-0" Mar 16 18:02:21 crc kubenswrapper[5120]: I0316 18:02:21.314880 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/a9402e78-0f0a-4bb6-bc56-551b7ccf4bda-kolla-config\") pod \"openstack-galera-1\" (UID: \"a9402e78-0f0a-4bb6-bc56-551b7ccf4bda\") " pod="horizon-kuttl-tests/openstack-galera-1" Mar 16 18:02:21 crc kubenswrapper[5120]: I0316 18:02:21.315738 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/dabfd53a-6aac-4c5d-a3d2-9d38975c0e5a-operator-scripts\") pod \"openstack-galera-0\" (UID: \"dabfd53a-6aac-4c5d-a3d2-9d38975c0e5a\") " pod="horizon-kuttl-tests/openstack-galera-0" Mar 16 18:02:21 crc kubenswrapper[5120]: I0316 18:02:21.316975 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a9402e78-0f0a-4bb6-bc56-551b7ccf4bda-operator-scripts\") pod \"openstack-galera-1\" (UID: \"a9402e78-0f0a-4bb6-bc56-551b7ccf4bda\") " pod="horizon-kuttl-tests/openstack-galera-1" Mar 16 18:02:21 crc kubenswrapper[5120]: I0316 18:02:21.332864 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8mc9\" (UniqueName: \"kubernetes.io/projected/dabfd53a-6aac-4c5d-a3d2-9d38975c0e5a-kube-api-access-r8mc9\") pod \"openstack-galera-0\" (UID: \"dabfd53a-6aac-4c5d-a3d2-9d38975c0e5a\") " pod="horizon-kuttl-tests/openstack-galera-0" Mar 16 18:02:21 crc kubenswrapper[5120]: I0316 18:02:21.334607 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"openstack-galera-0\" (UID: \"dabfd53a-6aac-4c5d-a3d2-9d38975c0e5a\") " pod="horizon-kuttl-tests/openstack-galera-0" Mar 16 18:02:21 crc kubenswrapper[5120]: I0316 18:02:21.335970 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gshmb\" (UniqueName: \"kubernetes.io/projected/a9402e78-0f0a-4bb6-bc56-551b7ccf4bda-kube-api-access-gshmb\") pod \"openstack-galera-1\" (UID: \"a9402e78-0f0a-4bb6-bc56-551b7ccf4bda\") " pod="horizon-kuttl-tests/openstack-galera-1" Mar 16 18:02:21 crc kubenswrapper[5120]: I0316 18:02:21.342715 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctk8p\" (UniqueName: \"kubernetes.io/projected/1cbada35-20cb-4e85-b586-27ff9941011a-kube-api-access-ctk8p\") pod \"openstack-galera-2\" (UID: \"1cbada35-20cb-4e85-b586-27ff9941011a\") " pod="horizon-kuttl-tests/openstack-galera-2" Mar 16 18:02:21 crc kubenswrapper[5120]: I0316 18:02:21.343975 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"openstack-galera-2\" (UID: \"1cbada35-20cb-4e85-b586-27ff9941011a\") " pod="horizon-kuttl-tests/openstack-galera-2" Mar 16 18:02:21 crc kubenswrapper[5120]: I0316 18:02:21.347388 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") pod \"openstack-galera-1\" (UID: \"a9402e78-0f0a-4bb6-bc56-551b7ccf4bda\") " pod="horizon-kuttl-tests/openstack-galera-1" Mar 16 18:02:21 crc kubenswrapper[5120]: I0316 18:02:21.397021 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="horizon-kuttl-tests/openstack-galera-0" Mar 16 18:02:21 crc kubenswrapper[5120]: I0316 18:02:21.416097 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rblsc\" (UniqueName: \"kubernetes.io/projected/8b1f7bb3-43d7-4209-b335-a671c96c1e8e-kube-api-access-rblsc\") pod \"0b4c51a436ce56c4393293420dad5bb37f4e2c4f062c7176860d2815958dmj5\" (UID: \"8b1f7bb3-43d7-4209-b335-a671c96c1e8e\") " pod="openstack-operators/0b4c51a436ce56c4393293420dad5bb37f4e2c4f062c7176860d2815958dmj5" Mar 16 18:02:21 crc kubenswrapper[5120]: I0316 18:02:21.416214 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8b1f7bb3-43d7-4209-b335-a671c96c1e8e-util\") pod \"0b4c51a436ce56c4393293420dad5bb37f4e2c4f062c7176860d2815958dmj5\" (UID: \"8b1f7bb3-43d7-4209-b335-a671c96c1e8e\") " pod="openstack-operators/0b4c51a436ce56c4393293420dad5bb37f4e2c4f062c7176860d2815958dmj5" Mar 16 18:02:21 crc kubenswrapper[5120]: I0316 18:02:21.416261 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8b1f7bb3-43d7-4209-b335-a671c96c1e8e-bundle\") pod \"0b4c51a436ce56c4393293420dad5bb37f4e2c4f062c7176860d2815958dmj5\" (UID: \"8b1f7bb3-43d7-4209-b335-a671c96c1e8e\") " pod="openstack-operators/0b4c51a436ce56c4393293420dad5bb37f4e2c4f062c7176860d2815958dmj5" Mar 16 18:02:21 crc kubenswrapper[5120]: I0316 18:02:21.416745 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8b1f7bb3-43d7-4209-b335-a671c96c1e8e-util\") pod \"0b4c51a436ce56c4393293420dad5bb37f4e2c4f062c7176860d2815958dmj5\" (UID: \"8b1f7bb3-43d7-4209-b335-a671c96c1e8e\") " pod="openstack-operators/0b4c51a436ce56c4393293420dad5bb37f4e2c4f062c7176860d2815958dmj5" Mar 16 18:02:21 crc kubenswrapper[5120]: I0316 18:02:21.416873 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8b1f7bb3-43d7-4209-b335-a671c96c1e8e-bundle\") pod \"0b4c51a436ce56c4393293420dad5bb37f4e2c4f062c7176860d2815958dmj5\" (UID: \"8b1f7bb3-43d7-4209-b335-a671c96c1e8e\") " pod="openstack-operators/0b4c51a436ce56c4393293420dad5bb37f4e2c4f062c7176860d2815958dmj5" Mar 16 18:02:21 crc kubenswrapper[5120]: I0316 18:02:21.435553 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rblsc\" (UniqueName: \"kubernetes.io/projected/8b1f7bb3-43d7-4209-b335-a671c96c1e8e-kube-api-access-rblsc\") pod \"0b4c51a436ce56c4393293420dad5bb37f4e2c4f062c7176860d2815958dmj5\" (UID: \"8b1f7bb3-43d7-4209-b335-a671c96c1e8e\") " pod="openstack-operators/0b4c51a436ce56c4393293420dad5bb37f4e2c4f062c7176860d2815958dmj5" Mar 16 18:02:21 crc kubenswrapper[5120]: I0316 18:02:21.447049 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="horizon-kuttl-tests/openstack-galera-1" Mar 16 18:02:21 crc kubenswrapper[5120]: I0316 18:02:21.464703 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="horizon-kuttl-tests/openstack-galera-2" Mar 16 18:02:21 crc kubenswrapper[5120]: I0316 18:02:21.469702 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/infra-operator-index-54cv6" event={"ID":"0caa24ff-cb6e-42b4-9bf8-4cada33dd11f","Type":"ContainerStarted","Data":"f66481a23ed835f9d5a9437ba188ccdc343fec31e5187cba1b05491343dfc59f"} Mar 16 18:02:21 crc kubenswrapper[5120]: I0316 18:02:21.523840 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/infra-operator-index-54cv6" podStartSLOduration=2.628337225 podStartE2EDuration="3.523815795s" podCreationTimestamp="2026-03-16 18:02:18 +0000 UTC" firstStartedPulling="2026-03-16 18:02:19.572514184 +0000 UTC m=+9041.726445841" lastFinishedPulling="2026-03-16 18:02:20.467992754 +0000 UTC m=+9042.621924411" observedRunningTime="2026-03-16 18:02:21.484777619 +0000 UTC m=+9043.638709286" watchObservedRunningTime="2026-03-16 18:02:21.523815795 +0000 UTC m=+9043.677747462" Mar 16 18:02:21 crc kubenswrapper[5120]: I0316 18:02:21.540027 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/0b4c51a436ce56c4393293420dad5bb37f4e2c4f062c7176860d2815958dmj5" Mar 16 18:02:21 crc kubenswrapper[5120]: I0316 18:02:21.873659 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["horizon-kuttl-tests/openstack-galera-0"] Mar 16 18:02:21 crc kubenswrapper[5120]: W0316 18:02:21.882910 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddabfd53a_6aac_4c5d_a3d2_9d38975c0e5a.slice/crio-afde40d94aa2d3700808a8cc335d12aea9969db70e94b95e6a1c5d9010ec42ac WatchSource:0}: Error finding container afde40d94aa2d3700808a8cc335d12aea9969db70e94b95e6a1c5d9010ec42ac: Status 404 returned error can't find the container with id afde40d94aa2d3700808a8cc335d12aea9969db70e94b95e6a1c5d9010ec42ac Mar 16 18:02:21 crc kubenswrapper[5120]: I0316 18:02:21.920730 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["horizon-kuttl-tests/openstack-galera-1"] Mar 16 18:02:21 crc kubenswrapper[5120]: I0316 18:02:21.993894 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["horizon-kuttl-tests/openstack-galera-2"] Mar 16 18:02:22 crc kubenswrapper[5120]: I0316 18:02:22.007564 5120 patch_prober.go:28] interesting pod/machine-config-daemon-7bf76 container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 18:02:22 crc kubenswrapper[5120]: I0316 18:02:22.007627 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 18:02:22 crc kubenswrapper[5120]: I0316 18:02:22.051704 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/0b4c51a436ce56c4393293420dad5bb37f4e2c4f062c7176860d2815958dmj5"] Mar 16 18:02:22 crc kubenswrapper[5120]: W0316 18:02:22.078561 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b1f7bb3_43d7_4209_b335_a671c96c1e8e.slice/crio-1e2568090f90a5c21790b9081ab23f371879a78f4106a952bb03969fd1621ca7 WatchSource:0}: Error finding container 1e2568090f90a5c21790b9081ab23f371879a78f4106a952bb03969fd1621ca7: Status 404 returned error can't find the container with id 1e2568090f90a5c21790b9081ab23f371879a78f4106a952bb03969fd1621ca7 Mar 16 18:02:22 crc kubenswrapper[5120]: I0316 18:02:22.478118 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="horizon-kuttl-tests/openstack-galera-0" event={"ID":"dabfd53a-6aac-4c5d-a3d2-9d38975c0e5a","Type":"ContainerStarted","Data":"4994ddc6861011d4002b145ab0f89c907ae9bb79a0ed1cbda4e10d60466feb39"} Mar 16 18:02:22 crc kubenswrapper[5120]: I0316 18:02:22.478388 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="horizon-kuttl-tests/openstack-galera-0" event={"ID":"dabfd53a-6aac-4c5d-a3d2-9d38975c0e5a","Type":"ContainerStarted","Data":"afde40d94aa2d3700808a8cc335d12aea9969db70e94b95e6a1c5d9010ec42ac"} Mar 16 18:02:22 crc kubenswrapper[5120]: I0316 18:02:22.480611 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="horizon-kuttl-tests/openstack-galera-1" event={"ID":"a9402e78-0f0a-4bb6-bc56-551b7ccf4bda","Type":"ContainerStarted","Data":"1c8aea033939b39bb8893d8beb9e8ad9bf565dae7bc5eaff52e38724888fc577"} Mar 16 18:02:22 crc kubenswrapper[5120]: I0316 18:02:22.480702 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="horizon-kuttl-tests/openstack-galera-1" event={"ID":"a9402e78-0f0a-4bb6-bc56-551b7ccf4bda","Type":"ContainerStarted","Data":"23bccce88801c5d413ba39dca9b7a464b7e06b73c84acedd8e5b2887144aad60"} Mar 16 18:02:22 crc kubenswrapper[5120]: I0316 18:02:22.485168 5120 generic.go:358] "Generic (PLEG): container finished" podID="8b1f7bb3-43d7-4209-b335-a671c96c1e8e" containerID="63423c82f0589b77f993812d8edd54179125e659e9221724d4e93d0fa5254c78" exitCode=0 Mar 16 18:02:22 crc kubenswrapper[5120]: I0316 18:02:22.485270 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/0b4c51a436ce56c4393293420dad5bb37f4e2c4f062c7176860d2815958dmj5" event={"ID":"8b1f7bb3-43d7-4209-b335-a671c96c1e8e","Type":"ContainerDied","Data":"63423c82f0589b77f993812d8edd54179125e659e9221724d4e93d0fa5254c78"} Mar 16 18:02:22 crc kubenswrapper[5120]: I0316 18:02:22.485295 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/0b4c51a436ce56c4393293420dad5bb37f4e2c4f062c7176860d2815958dmj5" event={"ID":"8b1f7bb3-43d7-4209-b335-a671c96c1e8e","Type":"ContainerStarted","Data":"1e2568090f90a5c21790b9081ab23f371879a78f4106a952bb03969fd1621ca7"} Mar 16 18:02:22 crc kubenswrapper[5120]: I0316 18:02:22.489794 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="horizon-kuttl-tests/openstack-galera-2" event={"ID":"1cbada35-20cb-4e85-b586-27ff9941011a","Type":"ContainerStarted","Data":"e5f7f7ccac243f0a7dd25ec721d302dbf8dae4a31da60f21f84e2ab2353febde"} Mar 16 18:02:22 crc kubenswrapper[5120]: I0316 18:02:22.489858 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="horizon-kuttl-tests/openstack-galera-2" event={"ID":"1cbada35-20cb-4e85-b586-27ff9941011a","Type":"ContainerStarted","Data":"2cffc3989c91838dfa72c537bfa0db86b23c825e99413238b36cd309910d7a40"} Mar 16 18:02:23 crc kubenswrapper[5120]: I0316 18:02:23.155423 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/infra-operator-index-54cv6"] Mar 16 18:02:23 crc kubenswrapper[5120]: I0316 18:02:23.497893 5120 generic.go:358] "Generic (PLEG): container finished" podID="8b1f7bb3-43d7-4209-b335-a671c96c1e8e" containerID="c876c014c16db4f6b5160dee0adfbda177e62b4c1227bb2c162364fbd7d2b603" exitCode=0 Mar 16 18:02:23 crc kubenswrapper[5120]: I0316 18:02:23.497947 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/0b4c51a436ce56c4393293420dad5bb37f4e2c4f062c7176860d2815958dmj5" event={"ID":"8b1f7bb3-43d7-4209-b335-a671c96c1e8e","Type":"ContainerDied","Data":"c876c014c16db4f6b5160dee0adfbda177e62b4c1227bb2c162364fbd7d2b603"} Mar 16 18:02:23 crc kubenswrapper[5120]: I0316 18:02:23.499060 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-operators/infra-operator-index-54cv6" podUID="0caa24ff-cb6e-42b4-9bf8-4cada33dd11f" containerName="registry-server" containerID="cri-o://f66481a23ed835f9d5a9437ba188ccdc343fec31e5187cba1b05491343dfc59f" gracePeriod=2 Mar 16 18:02:23 crc kubenswrapper[5120]: I0316 18:02:23.804304 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-operators/infra-operator-index-f6t6t"] Mar 16 18:02:23 crc kubenswrapper[5120]: I0316 18:02:23.821055 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/infra-operator-index-f6t6t" Mar 16 18:02:23 crc kubenswrapper[5120]: I0316 18:02:23.823812 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/infra-operator-index-f6t6t"] Mar 16 18:02:23 crc kubenswrapper[5120]: I0316 18:02:23.893400 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8twf\" (UniqueName: \"kubernetes.io/projected/a4d09400-44e7-4493-9e14-f5fc42e13179-kube-api-access-c8twf\") pod \"infra-operator-index-f6t6t\" (UID: \"a4d09400-44e7-4493-9e14-f5fc42e13179\") " pod="openstack-operators/infra-operator-index-f6t6t" Mar 16 18:02:23 crc kubenswrapper[5120]: I0316 18:02:23.949593 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/infra-operator-index-54cv6" Mar 16 18:02:23 crc kubenswrapper[5120]: I0316 18:02:23.995737 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c8twf\" (UniqueName: \"kubernetes.io/projected/a4d09400-44e7-4493-9e14-f5fc42e13179-kube-api-access-c8twf\") pod \"infra-operator-index-f6t6t\" (UID: \"a4d09400-44e7-4493-9e14-f5fc42e13179\") " pod="openstack-operators/infra-operator-index-f6t6t" Mar 16 18:02:24 crc kubenswrapper[5120]: I0316 18:02:24.017054 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8twf\" (UniqueName: \"kubernetes.io/projected/a4d09400-44e7-4493-9e14-f5fc42e13179-kube-api-access-c8twf\") pod \"infra-operator-index-f6t6t\" (UID: \"a4d09400-44e7-4493-9e14-f5fc42e13179\") " pod="openstack-operators/infra-operator-index-f6t6t" Mar 16 18:02:24 crc kubenswrapper[5120]: I0316 18:02:24.097675 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9nn4d\" (UniqueName: \"kubernetes.io/projected/0caa24ff-cb6e-42b4-9bf8-4cada33dd11f-kube-api-access-9nn4d\") pod \"0caa24ff-cb6e-42b4-9bf8-4cada33dd11f\" (UID: \"0caa24ff-cb6e-42b4-9bf8-4cada33dd11f\") " Mar 16 18:02:24 crc kubenswrapper[5120]: I0316 18:02:24.101085 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0caa24ff-cb6e-42b4-9bf8-4cada33dd11f-kube-api-access-9nn4d" (OuterVolumeSpecName: "kube-api-access-9nn4d") pod "0caa24ff-cb6e-42b4-9bf8-4cada33dd11f" (UID: "0caa24ff-cb6e-42b4-9bf8-4cada33dd11f"). InnerVolumeSpecName "kube-api-access-9nn4d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 18:02:24 crc kubenswrapper[5120]: I0316 18:02:24.149562 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/infra-operator-index-f6t6t" Mar 16 18:02:24 crc kubenswrapper[5120]: I0316 18:02:24.200541 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9nn4d\" (UniqueName: \"kubernetes.io/projected/0caa24ff-cb6e-42b4-9bf8-4cada33dd11f-kube-api-access-9nn4d\") on node \"crc\" DevicePath \"\"" Mar 16 18:02:24 crc kubenswrapper[5120]: I0316 18:02:24.357487 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/infra-operator-index-f6t6t"] Mar 16 18:02:24 crc kubenswrapper[5120]: W0316 18:02:24.366299 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4d09400_44e7_4493_9e14_f5fc42e13179.slice/crio-7cdfb480ee25f2064b0e686d570c996dab97770e26c4e70c92527fcdff866332 WatchSource:0}: Error finding container 7cdfb480ee25f2064b0e686d570c996dab97770e26c4e70c92527fcdff866332: Status 404 returned error can't find the container with id 7cdfb480ee25f2064b0e686d570c996dab97770e26c4e70c92527fcdff866332 Mar 16 18:02:24 crc kubenswrapper[5120]: I0316 18:02:24.507018 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/infra-operator-index-f6t6t" event={"ID":"a4d09400-44e7-4493-9e14-f5fc42e13179","Type":"ContainerStarted","Data":"7cdfb480ee25f2064b0e686d570c996dab97770e26c4e70c92527fcdff866332"} Mar 16 18:02:24 crc kubenswrapper[5120]: I0316 18:02:24.508879 5120 generic.go:358] "Generic (PLEG): container finished" podID="0caa24ff-cb6e-42b4-9bf8-4cada33dd11f" containerID="f66481a23ed835f9d5a9437ba188ccdc343fec31e5187cba1b05491343dfc59f" exitCode=0 Mar 16 18:02:24 crc kubenswrapper[5120]: I0316 18:02:24.509048 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/infra-operator-index-54cv6" Mar 16 18:02:24 crc kubenswrapper[5120]: I0316 18:02:24.509197 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/infra-operator-index-54cv6" event={"ID":"0caa24ff-cb6e-42b4-9bf8-4cada33dd11f","Type":"ContainerDied","Data":"f66481a23ed835f9d5a9437ba188ccdc343fec31e5187cba1b05491343dfc59f"} Mar 16 18:02:24 crc kubenswrapper[5120]: I0316 18:02:24.509252 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/infra-operator-index-54cv6" event={"ID":"0caa24ff-cb6e-42b4-9bf8-4cada33dd11f","Type":"ContainerDied","Data":"a2b0c13752c4bb2d78d0b5447e271e5514a4221dd7978e02a87e01f999c3f459"} Mar 16 18:02:24 crc kubenswrapper[5120]: I0316 18:02:24.509292 5120 scope.go:117] "RemoveContainer" containerID="f66481a23ed835f9d5a9437ba188ccdc343fec31e5187cba1b05491343dfc59f" Mar 16 18:02:24 crc kubenswrapper[5120]: I0316 18:02:24.512132 5120 generic.go:358] "Generic (PLEG): container finished" podID="8b1f7bb3-43d7-4209-b335-a671c96c1e8e" containerID="d7261bc3481423adedac4a476ebe8c606cbbb8b61eae7b5e667065870c9ae092" exitCode=0 Mar 16 18:02:24 crc kubenswrapper[5120]: I0316 18:02:24.512165 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/0b4c51a436ce56c4393293420dad5bb37f4e2c4f062c7176860d2815958dmj5" event={"ID":"8b1f7bb3-43d7-4209-b335-a671c96c1e8e","Type":"ContainerDied","Data":"d7261bc3481423adedac4a476ebe8c606cbbb8b61eae7b5e667065870c9ae092"} Mar 16 18:02:24 crc kubenswrapper[5120]: I0316 18:02:24.532601 5120 scope.go:117] "RemoveContainer" containerID="f66481a23ed835f9d5a9437ba188ccdc343fec31e5187cba1b05491343dfc59f" Mar 16 18:02:24 crc kubenswrapper[5120]: E0316 18:02:24.533117 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f66481a23ed835f9d5a9437ba188ccdc343fec31e5187cba1b05491343dfc59f\": container with ID starting with f66481a23ed835f9d5a9437ba188ccdc343fec31e5187cba1b05491343dfc59f not found: ID does not exist" containerID="f66481a23ed835f9d5a9437ba188ccdc343fec31e5187cba1b05491343dfc59f" Mar 16 18:02:24 crc kubenswrapper[5120]: I0316 18:02:24.533178 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f66481a23ed835f9d5a9437ba188ccdc343fec31e5187cba1b05491343dfc59f"} err="failed to get container status \"f66481a23ed835f9d5a9437ba188ccdc343fec31e5187cba1b05491343dfc59f\": rpc error: code = NotFound desc = could not find container \"f66481a23ed835f9d5a9437ba188ccdc343fec31e5187cba1b05491343dfc59f\": container with ID starting with f66481a23ed835f9d5a9437ba188ccdc343fec31e5187cba1b05491343dfc59f not found: ID does not exist" Mar 16 18:02:24 crc kubenswrapper[5120]: I0316 18:02:24.545202 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/infra-operator-index-54cv6"] Mar 16 18:02:24 crc kubenswrapper[5120]: I0316 18:02:24.550327 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-operators/infra-operator-index-54cv6"] Mar 16 18:02:24 crc kubenswrapper[5120]: I0316 18:02:24.672118 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0caa24ff-cb6e-42b4-9bf8-4cada33dd11f" path="/var/lib/kubelet/pods/0caa24ff-cb6e-42b4-9bf8-4cada33dd11f/volumes" Mar 16 18:02:25 crc kubenswrapper[5120]: I0316 18:02:25.526882 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="horizon-kuttl-tests/openstack-galera-2" event={"ID":"1cbada35-20cb-4e85-b586-27ff9941011a","Type":"ContainerDied","Data":"e5f7f7ccac243f0a7dd25ec721d302dbf8dae4a31da60f21f84e2ab2353febde"} Mar 16 18:02:25 crc kubenswrapper[5120]: I0316 18:02:25.526881 5120 generic.go:358] "Generic (PLEG): container finished" podID="1cbada35-20cb-4e85-b586-27ff9941011a" containerID="e5f7f7ccac243f0a7dd25ec721d302dbf8dae4a31da60f21f84e2ab2353febde" exitCode=0 Mar 16 18:02:25 crc kubenswrapper[5120]: I0316 18:02:25.533029 5120 generic.go:358] "Generic (PLEG): container finished" podID="dabfd53a-6aac-4c5d-a3d2-9d38975c0e5a" containerID="4994ddc6861011d4002b145ab0f89c907ae9bb79a0ed1cbda4e10d60466feb39" exitCode=0 Mar 16 18:02:25 crc kubenswrapper[5120]: I0316 18:02:25.533122 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="horizon-kuttl-tests/openstack-galera-0" event={"ID":"dabfd53a-6aac-4c5d-a3d2-9d38975c0e5a","Type":"ContainerDied","Data":"4994ddc6861011d4002b145ab0f89c907ae9bb79a0ed1cbda4e10d60466feb39"} Mar 16 18:02:25 crc kubenswrapper[5120]: I0316 18:02:25.535847 5120 generic.go:358] "Generic (PLEG): container finished" podID="a9402e78-0f0a-4bb6-bc56-551b7ccf4bda" containerID="1c8aea033939b39bb8893d8beb9e8ad9bf565dae7bc5eaff52e38724888fc577" exitCode=0 Mar 16 18:02:25 crc kubenswrapper[5120]: I0316 18:02:25.535944 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="horizon-kuttl-tests/openstack-galera-1" event={"ID":"a9402e78-0f0a-4bb6-bc56-551b7ccf4bda","Type":"ContainerDied","Data":"1c8aea033939b39bb8893d8beb9e8ad9bf565dae7bc5eaff52e38724888fc577"} Mar 16 18:02:25 crc kubenswrapper[5120]: I0316 18:02:25.875841 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/0b4c51a436ce56c4393293420dad5bb37f4e2c4f062c7176860d2815958dmj5" Mar 16 18:02:26 crc kubenswrapper[5120]: I0316 18:02:26.037370 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rblsc\" (UniqueName: \"kubernetes.io/projected/8b1f7bb3-43d7-4209-b335-a671c96c1e8e-kube-api-access-rblsc\") pod \"8b1f7bb3-43d7-4209-b335-a671c96c1e8e\" (UID: \"8b1f7bb3-43d7-4209-b335-a671c96c1e8e\") " Mar 16 18:02:26 crc kubenswrapper[5120]: I0316 18:02:26.038233 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8b1f7bb3-43d7-4209-b335-a671c96c1e8e-bundle\") pod \"8b1f7bb3-43d7-4209-b335-a671c96c1e8e\" (UID: \"8b1f7bb3-43d7-4209-b335-a671c96c1e8e\") " Mar 16 18:02:26 crc kubenswrapper[5120]: I0316 18:02:26.038437 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8b1f7bb3-43d7-4209-b335-a671c96c1e8e-util\") pod \"8b1f7bb3-43d7-4209-b335-a671c96c1e8e\" (UID: \"8b1f7bb3-43d7-4209-b335-a671c96c1e8e\") " Mar 16 18:02:26 crc kubenswrapper[5120]: I0316 18:02:26.040169 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b1f7bb3-43d7-4209-b335-a671c96c1e8e-bundle" (OuterVolumeSpecName: "bundle") pod "8b1f7bb3-43d7-4209-b335-a671c96c1e8e" (UID: "8b1f7bb3-43d7-4209-b335-a671c96c1e8e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 18:02:26 crc kubenswrapper[5120]: I0316 18:02:26.042480 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b1f7bb3-43d7-4209-b335-a671c96c1e8e-kube-api-access-rblsc" (OuterVolumeSpecName: "kube-api-access-rblsc") pod "8b1f7bb3-43d7-4209-b335-a671c96c1e8e" (UID: "8b1f7bb3-43d7-4209-b335-a671c96c1e8e"). InnerVolumeSpecName "kube-api-access-rblsc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 18:02:26 crc kubenswrapper[5120]: I0316 18:02:26.050860 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b1f7bb3-43d7-4209-b335-a671c96c1e8e-util" (OuterVolumeSpecName: "util") pod "8b1f7bb3-43d7-4209-b335-a671c96c1e8e" (UID: "8b1f7bb3-43d7-4209-b335-a671c96c1e8e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 18:02:26 crc kubenswrapper[5120]: I0316 18:02:26.141567 5120 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8b1f7bb3-43d7-4209-b335-a671c96c1e8e-util\") on node \"crc\" DevicePath \"\"" Mar 16 18:02:26 crc kubenswrapper[5120]: I0316 18:02:26.141598 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rblsc\" (UniqueName: \"kubernetes.io/projected/8b1f7bb3-43d7-4209-b335-a671c96c1e8e-kube-api-access-rblsc\") on node \"crc\" DevicePath \"\"" Mar 16 18:02:26 crc kubenswrapper[5120]: I0316 18:02:26.141610 5120 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8b1f7bb3-43d7-4209-b335-a671c96c1e8e-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 18:02:26 crc kubenswrapper[5120]: I0316 18:02:26.549303 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/0b4c51a436ce56c4393293420dad5bb37f4e2c4f062c7176860d2815958dmj5" event={"ID":"8b1f7bb3-43d7-4209-b335-a671c96c1e8e","Type":"ContainerDied","Data":"1e2568090f90a5c21790b9081ab23f371879a78f4106a952bb03969fd1621ca7"} Mar 16 18:02:26 crc kubenswrapper[5120]: I0316 18:02:26.549356 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1e2568090f90a5c21790b9081ab23f371879a78f4106a952bb03969fd1621ca7" Mar 16 18:02:26 crc kubenswrapper[5120]: I0316 18:02:26.549358 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/0b4c51a436ce56c4393293420dad5bb37f4e2c4f062c7176860d2815958dmj5" Mar 16 18:02:26 crc kubenswrapper[5120]: I0316 18:02:26.551846 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="horizon-kuttl-tests/openstack-galera-2" event={"ID":"1cbada35-20cb-4e85-b586-27ff9941011a","Type":"ContainerStarted","Data":"442cbca3e39e97c499ec7f781b97d4f8bbcd5426edb5c1dea0b09bc99ff9d956"} Mar 16 18:02:26 crc kubenswrapper[5120]: I0316 18:02:26.556121 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/infra-operator-index-f6t6t" event={"ID":"a4d09400-44e7-4493-9e14-f5fc42e13179","Type":"ContainerStarted","Data":"919fb0543a401cce6c659bd8cb7ae01d12f355f7d688a24a015f02d0cd0cc644"} Mar 16 18:02:26 crc kubenswrapper[5120]: I0316 18:02:26.561689 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="horizon-kuttl-tests/openstack-galera-0" event={"ID":"dabfd53a-6aac-4c5d-a3d2-9d38975c0e5a","Type":"ContainerStarted","Data":"a816c733aee6eecb0cb95d24f8707290de9aab409ef609b749cabf02695bb76d"} Mar 16 18:02:26 crc kubenswrapper[5120]: I0316 18:02:26.565843 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="horizon-kuttl-tests/openstack-galera-1" event={"ID":"a9402e78-0f0a-4bb6-bc56-551b7ccf4bda","Type":"ContainerStarted","Data":"53b79a0ea3c7b2fcdba6e9ad4be620a49beb151cb99ed18d1cebaa501d3260db"} Mar 16 18:02:26 crc kubenswrapper[5120]: I0316 18:02:26.586977 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="horizon-kuttl-tests/openstack-galera-2" podStartSLOduration=6.58694916 podStartE2EDuration="6.58694916s" podCreationTimestamp="2026-03-16 18:02:20 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 18:02:26.574725405 +0000 UTC m=+9048.728657072" watchObservedRunningTime="2026-03-16 18:02:26.58694916 +0000 UTC m=+9048.740880857" Mar 16 18:02:26 crc kubenswrapper[5120]: I0316 18:02:26.602028 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="horizon-kuttl-tests/openstack-galera-0" podStartSLOduration=6.60199759 podStartE2EDuration="6.60199759s" podCreationTimestamp="2026-03-16 18:02:20 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 18:02:26.594465805 +0000 UTC m=+9048.748397522" watchObservedRunningTime="2026-03-16 18:02:26.60199759 +0000 UTC m=+9048.755929287" Mar 16 18:02:26 crc kubenswrapper[5120]: I0316 18:02:26.628619 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/infra-operator-index-f6t6t" podStartSLOduration=2.116511438 podStartE2EDuration="3.628588507s" podCreationTimestamp="2026-03-16 18:02:23 +0000 UTC" firstStartedPulling="2026-03-16 18:02:24.368312333 +0000 UTC m=+9046.522243990" lastFinishedPulling="2026-03-16 18:02:25.880389402 +0000 UTC m=+9048.034321059" observedRunningTime="2026-03-16 18:02:26.612868707 +0000 UTC m=+9048.766800454" watchObservedRunningTime="2026-03-16 18:02:26.628588507 +0000 UTC m=+9048.782520204" Mar 16 18:02:26 crc kubenswrapper[5120]: I0316 18:02:26.648634 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="horizon-kuttl-tests/openstack-galera-1" podStartSLOduration=6.648606674 podStartE2EDuration="6.648606674s" podCreationTimestamp="2026-03-16 18:02:20 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 18:02:26.639606978 +0000 UTC m=+9048.793538705" watchObservedRunningTime="2026-03-16 18:02:26.648606674 +0000 UTC m=+9048.802538361" Mar 16 18:02:31 crc kubenswrapper[5120]: I0316 18:02:31.397485 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="horizon-kuttl-tests/openstack-galera-0" Mar 16 18:02:31 crc kubenswrapper[5120]: I0316 18:02:31.398293 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="horizon-kuttl-tests/openstack-galera-0" Mar 16 18:02:31 crc kubenswrapper[5120]: I0316 18:02:31.447982 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="horizon-kuttl-tests/openstack-galera-1" Mar 16 18:02:31 crc kubenswrapper[5120]: I0316 18:02:31.448031 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="horizon-kuttl-tests/openstack-galera-1" Mar 16 18:02:31 crc kubenswrapper[5120]: I0316 18:02:31.465742 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="horizon-kuttl-tests/openstack-galera-2" Mar 16 18:02:31 crc kubenswrapper[5120]: I0316 18:02:31.465817 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="horizon-kuttl-tests/openstack-galera-2" Mar 16 18:02:34 crc kubenswrapper[5120]: I0316 18:02:34.149968 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-operators/infra-operator-index-f6t6t" Mar 16 18:02:34 crc kubenswrapper[5120]: I0316 18:02:34.150307 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-operators/infra-operator-index-f6t6t" Mar 16 18:02:34 crc kubenswrapper[5120]: I0316 18:02:34.178095 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-operators/infra-operator-index-f6t6t" Mar 16 18:02:34 crc kubenswrapper[5120]: I0316 18:02:34.652421 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/infra-operator-index-f6t6t" Mar 16 18:02:36 crc kubenswrapper[5120]: I0316 18:02:36.108042 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="horizon-kuttl-tests/openstack-galera-2" Mar 16 18:02:36 crc kubenswrapper[5120]: I0316 18:02:36.171014 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="horizon-kuttl-tests/openstack-galera-2" Mar 16 18:02:38 crc kubenswrapper[5120]: I0316 18:02:38.339416 5120 scope.go:117] "RemoveContainer" containerID="e0dd0bb9b057d5de7368a68508b238703b075039a34efbaf8d2fede63c22c393" Mar 16 18:02:40 crc kubenswrapper[5120]: I0316 18:02:40.143129 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["horizon-kuttl-tests/root-account-create-update-nk9mz"] Mar 16 18:02:40 crc kubenswrapper[5120]: I0316 18:02:40.144360 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b1f7bb3-43d7-4209-b335-a671c96c1e8e" containerName="util" Mar 16 18:02:40 crc kubenswrapper[5120]: I0316 18:02:40.144384 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b1f7bb3-43d7-4209-b335-a671c96c1e8e" containerName="util" Mar 16 18:02:40 crc kubenswrapper[5120]: I0316 18:02:40.144520 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0caa24ff-cb6e-42b4-9bf8-4cada33dd11f" containerName="registry-server" Mar 16 18:02:40 crc kubenswrapper[5120]: I0316 18:02:40.144533 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="0caa24ff-cb6e-42b4-9bf8-4cada33dd11f" containerName="registry-server" Mar 16 18:02:40 crc kubenswrapper[5120]: I0316 18:02:40.144545 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b1f7bb3-43d7-4209-b335-a671c96c1e8e" containerName="extract" Mar 16 18:02:40 crc kubenswrapper[5120]: I0316 18:02:40.144553 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b1f7bb3-43d7-4209-b335-a671c96c1e8e" containerName="extract" Mar 16 18:02:40 crc kubenswrapper[5120]: I0316 18:02:40.144575 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b1f7bb3-43d7-4209-b335-a671c96c1e8e" containerName="pull" Mar 16 18:02:40 crc kubenswrapper[5120]: I0316 18:02:40.144584 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b1f7bb3-43d7-4209-b335-a671c96c1e8e" containerName="pull" Mar 16 18:02:40 crc kubenswrapper[5120]: I0316 18:02:40.144724 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="8b1f7bb3-43d7-4209-b335-a671c96c1e8e" containerName="extract" Mar 16 18:02:40 crc kubenswrapper[5120]: I0316 18:02:40.144739 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="0caa24ff-cb6e-42b4-9bf8-4cada33dd11f" containerName="registry-server" Mar 16 18:02:40 crc kubenswrapper[5120]: I0316 18:02:40.148946 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="horizon-kuttl-tests/root-account-create-update-nk9mz" Mar 16 18:02:40 crc kubenswrapper[5120]: I0316 18:02:40.158426 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["horizon-kuttl-tests/root-account-create-update-nk9mz"] Mar 16 18:02:40 crc kubenswrapper[5120]: I0316 18:02:40.158920 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"horizon-kuttl-tests\"/\"openstack-mariadb-root-db-secret\"" Mar 16 18:02:40 crc kubenswrapper[5120]: I0316 18:02:40.269671 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shjd9\" (UniqueName: \"kubernetes.io/projected/768af0c0-1057-4455-b269-bacabfdf4319-kube-api-access-shjd9\") pod \"root-account-create-update-nk9mz\" (UID: \"768af0c0-1057-4455-b269-bacabfdf4319\") " pod="horizon-kuttl-tests/root-account-create-update-nk9mz" Mar 16 18:02:40 crc kubenswrapper[5120]: I0316 18:02:40.269831 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/768af0c0-1057-4455-b269-bacabfdf4319-operator-scripts\") pod \"root-account-create-update-nk9mz\" (UID: \"768af0c0-1057-4455-b269-bacabfdf4319\") " pod="horizon-kuttl-tests/root-account-create-update-nk9mz" Mar 16 18:02:40 crc kubenswrapper[5120]: I0316 18:02:40.371068 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/768af0c0-1057-4455-b269-bacabfdf4319-operator-scripts\") pod \"root-account-create-update-nk9mz\" (UID: \"768af0c0-1057-4455-b269-bacabfdf4319\") " pod="horizon-kuttl-tests/root-account-create-update-nk9mz" Mar 16 18:02:40 crc kubenswrapper[5120]: I0316 18:02:40.371351 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-shjd9\" (UniqueName: \"kubernetes.io/projected/768af0c0-1057-4455-b269-bacabfdf4319-kube-api-access-shjd9\") pod \"root-account-create-update-nk9mz\" (UID: \"768af0c0-1057-4455-b269-bacabfdf4319\") " pod="horizon-kuttl-tests/root-account-create-update-nk9mz" Mar 16 18:02:40 crc kubenswrapper[5120]: I0316 18:02:40.371790 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/768af0c0-1057-4455-b269-bacabfdf4319-operator-scripts\") pod \"root-account-create-update-nk9mz\" (UID: \"768af0c0-1057-4455-b269-bacabfdf4319\") " pod="horizon-kuttl-tests/root-account-create-update-nk9mz" Mar 16 18:02:40 crc kubenswrapper[5120]: I0316 18:02:40.391359 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-shjd9\" (UniqueName: \"kubernetes.io/projected/768af0c0-1057-4455-b269-bacabfdf4319-kube-api-access-shjd9\") pod \"root-account-create-update-nk9mz\" (UID: \"768af0c0-1057-4455-b269-bacabfdf4319\") " pod="horizon-kuttl-tests/root-account-create-update-nk9mz" Mar 16 18:02:40 crc kubenswrapper[5120]: I0316 18:02:40.472820 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="horizon-kuttl-tests/root-account-create-update-nk9mz" Mar 16 18:02:40 crc kubenswrapper[5120]: I0316 18:02:40.963479 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["horizon-kuttl-tests/root-account-create-update-nk9mz"] Mar 16 18:02:41 crc kubenswrapper[5120]: I0316 18:02:41.684884 5120 generic.go:358] "Generic (PLEG): container finished" podID="768af0c0-1057-4455-b269-bacabfdf4319" containerID="d86ae61d35b6d2ea8b034177183d5d1d3e88ae146794b5e95fc84930daeb70cb" exitCode=0 Mar 16 18:02:41 crc kubenswrapper[5120]: I0316 18:02:41.685364 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="horizon-kuttl-tests/root-account-create-update-nk9mz" event={"ID":"768af0c0-1057-4455-b269-bacabfdf4319","Type":"ContainerDied","Data":"d86ae61d35b6d2ea8b034177183d5d1d3e88ae146794b5e95fc84930daeb70cb"} Mar 16 18:02:41 crc kubenswrapper[5120]: I0316 18:02:41.685409 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="horizon-kuttl-tests/root-account-create-update-nk9mz" event={"ID":"768af0c0-1057-4455-b269-bacabfdf4319","Type":"ContainerStarted","Data":"2cb4cb124aeb6e8fd0f9dc3ce836820ba6156154b3ed0b32539f8c940176c869"} Mar 16 18:02:42 crc kubenswrapper[5120]: E0316 18:02:42.710037 5120 upgradeaware.go:427] Error proxying data from client to backend: readfrom tcp 38.102.83.119:40854->38.102.83.119:44311: write tcp 38.102.83.119:40854->38.102.83.119:44311: write: broken pipe Mar 16 18:02:42 crc kubenswrapper[5120]: I0316 18:02:42.930436 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="horizon-kuttl-tests/openstack-galera-1" Mar 16 18:02:43 crc kubenswrapper[5120]: I0316 18:02:43.023367 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="horizon-kuttl-tests/openstack-galera-1" Mar 16 18:02:43 crc kubenswrapper[5120]: I0316 18:02:43.067078 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="horizon-kuttl-tests/root-account-create-update-nk9mz" Mar 16 18:02:43 crc kubenswrapper[5120]: I0316 18:02:43.153574 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-shjd9\" (UniqueName: \"kubernetes.io/projected/768af0c0-1057-4455-b269-bacabfdf4319-kube-api-access-shjd9\") pod \"768af0c0-1057-4455-b269-bacabfdf4319\" (UID: \"768af0c0-1057-4455-b269-bacabfdf4319\") " Mar 16 18:02:43 crc kubenswrapper[5120]: I0316 18:02:43.153825 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/768af0c0-1057-4455-b269-bacabfdf4319-operator-scripts\") pod \"768af0c0-1057-4455-b269-bacabfdf4319\" (UID: \"768af0c0-1057-4455-b269-bacabfdf4319\") " Mar 16 18:02:43 crc kubenswrapper[5120]: I0316 18:02:43.154730 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/768af0c0-1057-4455-b269-bacabfdf4319-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "768af0c0-1057-4455-b269-bacabfdf4319" (UID: "768af0c0-1057-4455-b269-bacabfdf4319"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 18:02:43 crc kubenswrapper[5120]: I0316 18:02:43.180667 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/768af0c0-1057-4455-b269-bacabfdf4319-kube-api-access-shjd9" (OuterVolumeSpecName: "kube-api-access-shjd9") pod "768af0c0-1057-4455-b269-bacabfdf4319" (UID: "768af0c0-1057-4455-b269-bacabfdf4319"). InnerVolumeSpecName "kube-api-access-shjd9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 18:02:43 crc kubenswrapper[5120]: I0316 18:02:43.257541 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-shjd9\" (UniqueName: \"kubernetes.io/projected/768af0c0-1057-4455-b269-bacabfdf4319-kube-api-access-shjd9\") on node \"crc\" DevicePath \"\"" Mar 16 18:02:43 crc kubenswrapper[5120]: I0316 18:02:43.257585 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/768af0c0-1057-4455-b269-bacabfdf4319-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 18:02:43 crc kubenswrapper[5120]: I0316 18:02:43.706351 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="horizon-kuttl-tests/root-account-create-update-nk9mz" event={"ID":"768af0c0-1057-4455-b269-bacabfdf4319","Type":"ContainerDied","Data":"2cb4cb124aeb6e8fd0f9dc3ce836820ba6156154b3ed0b32539f8c940176c869"} Mar 16 18:02:43 crc kubenswrapper[5120]: I0316 18:02:43.706436 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2cb4cb124aeb6e8fd0f9dc3ce836820ba6156154b3ed0b32539f8c940176c869" Mar 16 18:02:43 crc kubenswrapper[5120]: I0316 18:02:43.706543 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="horizon-kuttl-tests/root-account-create-update-nk9mz" Mar 16 18:02:48 crc kubenswrapper[5120]: I0316 18:02:48.391152 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="horizon-kuttl-tests/openstack-galera-0" Mar 16 18:02:48 crc kubenswrapper[5120]: I0316 18:02:48.488570 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="horizon-kuttl-tests/openstack-galera-0" Mar 16 18:02:52 crc kubenswrapper[5120]: I0316 18:02:52.008076 5120 patch_prober.go:28] interesting pod/machine-config-daemon-7bf76 container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 18:02:52 crc kubenswrapper[5120]: I0316 18:02:52.008981 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 18:02:59 crc kubenswrapper[5120]: I0316 18:02:59.783293 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-operators/infra-operator-controller-manager-78c98446bd-smhdh"] Mar 16 18:02:59 crc kubenswrapper[5120]: I0316 18:02:59.784705 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="768af0c0-1057-4455-b269-bacabfdf4319" containerName="mariadb-account-create-update" Mar 16 18:02:59 crc kubenswrapper[5120]: I0316 18:02:59.784720 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="768af0c0-1057-4455-b269-bacabfdf4319" containerName="mariadb-account-create-update" Mar 16 18:02:59 crc kubenswrapper[5120]: I0316 18:02:59.784856 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="768af0c0-1057-4455-b269-bacabfdf4319" containerName="mariadb-account-create-update" Mar 16 18:02:59 crc kubenswrapper[5120]: I0316 18:02:59.793971 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/infra-operator-controller-manager-78c98446bd-smhdh" Mar 16 18:02:59 crc kubenswrapper[5120]: I0316 18:02:59.795881 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-operators\"/\"infra-operator-controller-manager-dockercfg-c4tpw\"" Mar 16 18:02:59 crc kubenswrapper[5120]: I0316 18:02:59.795909 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-operators\"/\"infra-operator-controller-manager-service-cert\"" Mar 16 18:02:59 crc kubenswrapper[5120]: I0316 18:02:59.802565 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/infra-operator-controller-manager-78c98446bd-smhdh"] Mar 16 18:02:59 crc kubenswrapper[5120]: I0316 18:02:59.912468 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0e32308f-d5af-4f54-8797-ae6a4a9d2cb5-webhook-cert\") pod \"infra-operator-controller-manager-78c98446bd-smhdh\" (UID: \"0e32308f-d5af-4f54-8797-ae6a4a9d2cb5\") " pod="openstack-operators/infra-operator-controller-manager-78c98446bd-smhdh" Mar 16 18:02:59 crc kubenswrapper[5120]: I0316 18:02:59.912803 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cd4kt\" (UniqueName: \"kubernetes.io/projected/0e32308f-d5af-4f54-8797-ae6a4a9d2cb5-kube-api-access-cd4kt\") pod \"infra-operator-controller-manager-78c98446bd-smhdh\" (UID: \"0e32308f-d5af-4f54-8797-ae6a4a9d2cb5\") " pod="openstack-operators/infra-operator-controller-manager-78c98446bd-smhdh" Mar 16 18:02:59 crc kubenswrapper[5120]: I0316 18:02:59.913095 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0e32308f-d5af-4f54-8797-ae6a4a9d2cb5-apiservice-cert\") pod \"infra-operator-controller-manager-78c98446bd-smhdh\" (UID: \"0e32308f-d5af-4f54-8797-ae6a4a9d2cb5\") " pod="openstack-operators/infra-operator-controller-manager-78c98446bd-smhdh" Mar 16 18:03:00 crc kubenswrapper[5120]: I0316 18:03:00.015270 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0e32308f-d5af-4f54-8797-ae6a4a9d2cb5-webhook-cert\") pod \"infra-operator-controller-manager-78c98446bd-smhdh\" (UID: \"0e32308f-d5af-4f54-8797-ae6a4a9d2cb5\") " pod="openstack-operators/infra-operator-controller-manager-78c98446bd-smhdh" Mar 16 18:03:00 crc kubenswrapper[5120]: I0316 18:03:00.015543 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cd4kt\" (UniqueName: \"kubernetes.io/projected/0e32308f-d5af-4f54-8797-ae6a4a9d2cb5-kube-api-access-cd4kt\") pod \"infra-operator-controller-manager-78c98446bd-smhdh\" (UID: \"0e32308f-d5af-4f54-8797-ae6a4a9d2cb5\") " pod="openstack-operators/infra-operator-controller-manager-78c98446bd-smhdh" Mar 16 18:03:00 crc kubenswrapper[5120]: I0316 18:03:00.015736 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0e32308f-d5af-4f54-8797-ae6a4a9d2cb5-apiservice-cert\") pod \"infra-operator-controller-manager-78c98446bd-smhdh\" (UID: \"0e32308f-d5af-4f54-8797-ae6a4a9d2cb5\") " pod="openstack-operators/infra-operator-controller-manager-78c98446bd-smhdh" Mar 16 18:03:00 crc kubenswrapper[5120]: I0316 18:03:00.033818 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0e32308f-d5af-4f54-8797-ae6a4a9d2cb5-webhook-cert\") pod \"infra-operator-controller-manager-78c98446bd-smhdh\" (UID: \"0e32308f-d5af-4f54-8797-ae6a4a9d2cb5\") " pod="openstack-operators/infra-operator-controller-manager-78c98446bd-smhdh" Mar 16 18:03:00 crc kubenswrapper[5120]: I0316 18:03:00.033821 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0e32308f-d5af-4f54-8797-ae6a4a9d2cb5-apiservice-cert\") pod \"infra-operator-controller-manager-78c98446bd-smhdh\" (UID: \"0e32308f-d5af-4f54-8797-ae6a4a9d2cb5\") " pod="openstack-operators/infra-operator-controller-manager-78c98446bd-smhdh" Mar 16 18:03:00 crc kubenswrapper[5120]: I0316 18:03:00.048521 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cd4kt\" (UniqueName: \"kubernetes.io/projected/0e32308f-d5af-4f54-8797-ae6a4a9d2cb5-kube-api-access-cd4kt\") pod \"infra-operator-controller-manager-78c98446bd-smhdh\" (UID: \"0e32308f-d5af-4f54-8797-ae6a4a9d2cb5\") " pod="openstack-operators/infra-operator-controller-manager-78c98446bd-smhdh" Mar 16 18:03:00 crc kubenswrapper[5120]: I0316 18:03:00.113053 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/infra-operator-controller-manager-78c98446bd-smhdh" Mar 16 18:03:00 crc kubenswrapper[5120]: I0316 18:03:00.585241 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/infra-operator-controller-manager-78c98446bd-smhdh"] Mar 16 18:03:00 crc kubenswrapper[5120]: W0316 18:03:00.590003 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e32308f_d5af_4f54_8797_ae6a4a9d2cb5.slice/crio-fda72542fea14c32f61ef5716093aef9ae00300ad350c82ddc850816900ffacc WatchSource:0}: Error finding container fda72542fea14c32f61ef5716093aef9ae00300ad350c82ddc850816900ffacc: Status 404 returned error can't find the container with id fda72542fea14c32f61ef5716093aef9ae00300ad350c82ddc850816900ffacc Mar 16 18:03:00 crc kubenswrapper[5120]: I0316 18:03:00.844451 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/infra-operator-controller-manager-78c98446bd-smhdh" event={"ID":"0e32308f-d5af-4f54-8797-ae6a4a9d2cb5","Type":"ContainerStarted","Data":"fb7c485d9529edda635ae6fa9d663760a654085006439c06e20bacb43bf830c4"} Mar 16 18:03:00 crc kubenswrapper[5120]: I0316 18:03:00.845617 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/infra-operator-controller-manager-78c98446bd-smhdh" event={"ID":"0e32308f-d5af-4f54-8797-ae6a4a9d2cb5","Type":"ContainerStarted","Data":"fda72542fea14c32f61ef5716093aef9ae00300ad350c82ddc850816900ffacc"} Mar 16 18:03:00 crc kubenswrapper[5120]: I0316 18:03:00.845703 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-operators/infra-operator-controller-manager-78c98446bd-smhdh" Mar 16 18:03:00 crc kubenswrapper[5120]: I0316 18:03:00.864351 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/infra-operator-controller-manager-78c98446bd-smhdh" podStartSLOduration=1.8643300520000001 podStartE2EDuration="1.864330052s" podCreationTimestamp="2026-03-16 18:02:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 18:03:00.861051362 +0000 UTC m=+9083.014983039" watchObservedRunningTime="2026-03-16 18:03:00.864330052 +0000 UTC m=+9083.018261709" Mar 16 18:03:08 crc kubenswrapper[5120]: E0316 18:03:08.087908 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=975959 actualBytes=10240 Mar 16 18:03:12 crc kubenswrapper[5120]: I0316 18:03:12.867650 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/infra-operator-controller-manager-78c98446bd-smhdh" Mar 16 18:03:18 crc kubenswrapper[5120]: I0316 18:03:18.688531 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-operators/rabbitmq-cluster-operator-index-9t2s8"] Mar 16 18:03:18 crc kubenswrapper[5120]: I0316 18:03:18.698544 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/rabbitmq-cluster-operator-index-9t2s8"] Mar 16 18:03:18 crc kubenswrapper[5120]: I0316 18:03:18.698725 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/rabbitmq-cluster-operator-index-9t2s8" Mar 16 18:03:18 crc kubenswrapper[5120]: I0316 18:03:18.701392 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-operators\"/\"rabbitmq-cluster-operator-index-dockercfg-mx5b6\"" Mar 16 18:03:18 crc kubenswrapper[5120]: I0316 18:03:18.791258 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stzsn\" (UniqueName: \"kubernetes.io/projected/b40fe47c-32a7-49e9-9285-eb83096a98b6-kube-api-access-stzsn\") pod \"rabbitmq-cluster-operator-index-9t2s8\" (UID: \"b40fe47c-32a7-49e9-9285-eb83096a98b6\") " pod="openstack-operators/rabbitmq-cluster-operator-index-9t2s8" Mar 16 18:03:18 crc kubenswrapper[5120]: I0316 18:03:18.794420 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["horizon-kuttl-tests/memcached-0"] Mar 16 18:03:18 crc kubenswrapper[5120]: I0316 18:03:18.798951 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="horizon-kuttl-tests/memcached-0" Mar 16 18:03:18 crc kubenswrapper[5120]: I0316 18:03:18.801257 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"horizon-kuttl-tests\"/\"memcached-memcached-dockercfg-dxlvw\"" Mar 16 18:03:18 crc kubenswrapper[5120]: I0316 18:03:18.801262 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"horizon-kuttl-tests\"/\"memcached-config-data\"" Mar 16 18:03:18 crc kubenswrapper[5120]: I0316 18:03:18.806580 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["horizon-kuttl-tests/memcached-0"] Mar 16 18:03:18 crc kubenswrapper[5120]: I0316 18:03:18.893358 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/60903bff-9b27-488b-b399-2c87b66a6f35-config-data\") pod \"memcached-0\" (UID: \"60903bff-9b27-488b-b399-2c87b66a6f35\") " pod="horizon-kuttl-tests/memcached-0" Mar 16 18:03:18 crc kubenswrapper[5120]: I0316 18:03:18.893421 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xsn95\" (UniqueName: \"kubernetes.io/projected/60903bff-9b27-488b-b399-2c87b66a6f35-kube-api-access-xsn95\") pod \"memcached-0\" (UID: \"60903bff-9b27-488b-b399-2c87b66a6f35\") " pod="horizon-kuttl-tests/memcached-0" Mar 16 18:03:18 crc kubenswrapper[5120]: I0316 18:03:18.893862 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-stzsn\" (UniqueName: \"kubernetes.io/projected/b40fe47c-32a7-49e9-9285-eb83096a98b6-kube-api-access-stzsn\") pod \"rabbitmq-cluster-operator-index-9t2s8\" (UID: \"b40fe47c-32a7-49e9-9285-eb83096a98b6\") " pod="openstack-operators/rabbitmq-cluster-operator-index-9t2s8" Mar 16 18:03:18 crc kubenswrapper[5120]: I0316 18:03:18.893947 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/60903bff-9b27-488b-b399-2c87b66a6f35-kolla-config\") pod \"memcached-0\" (UID: \"60903bff-9b27-488b-b399-2c87b66a6f35\") " pod="horizon-kuttl-tests/memcached-0" Mar 16 18:03:18 crc kubenswrapper[5120]: I0316 18:03:18.912007 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-stzsn\" (UniqueName: \"kubernetes.io/projected/b40fe47c-32a7-49e9-9285-eb83096a98b6-kube-api-access-stzsn\") pod \"rabbitmq-cluster-operator-index-9t2s8\" (UID: \"b40fe47c-32a7-49e9-9285-eb83096a98b6\") " pod="openstack-operators/rabbitmq-cluster-operator-index-9t2s8" Mar 16 18:03:18 crc kubenswrapper[5120]: I0316 18:03:18.996300 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/60903bff-9b27-488b-b399-2c87b66a6f35-kolla-config\") pod \"memcached-0\" (UID: \"60903bff-9b27-488b-b399-2c87b66a6f35\") " pod="horizon-kuttl-tests/memcached-0" Mar 16 18:03:18 crc kubenswrapper[5120]: I0316 18:03:18.996438 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/60903bff-9b27-488b-b399-2c87b66a6f35-config-data\") pod \"memcached-0\" (UID: \"60903bff-9b27-488b-b399-2c87b66a6f35\") " pod="horizon-kuttl-tests/memcached-0" Mar 16 18:03:18 crc kubenswrapper[5120]: I0316 18:03:18.996464 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xsn95\" (UniqueName: \"kubernetes.io/projected/60903bff-9b27-488b-b399-2c87b66a6f35-kube-api-access-xsn95\") pod \"memcached-0\" (UID: \"60903bff-9b27-488b-b399-2c87b66a6f35\") " pod="horizon-kuttl-tests/memcached-0" Mar 16 18:03:18 crc kubenswrapper[5120]: I0316 18:03:18.997562 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/60903bff-9b27-488b-b399-2c87b66a6f35-config-data\") pod \"memcached-0\" (UID: \"60903bff-9b27-488b-b399-2c87b66a6f35\") " pod="horizon-kuttl-tests/memcached-0" Mar 16 18:03:18 crc kubenswrapper[5120]: I0316 18:03:18.997941 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/60903bff-9b27-488b-b399-2c87b66a6f35-kolla-config\") pod \"memcached-0\" (UID: \"60903bff-9b27-488b-b399-2c87b66a6f35\") " pod="horizon-kuttl-tests/memcached-0" Mar 16 18:03:19 crc kubenswrapper[5120]: I0316 18:03:19.023506 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xsn95\" (UniqueName: \"kubernetes.io/projected/60903bff-9b27-488b-b399-2c87b66a6f35-kube-api-access-xsn95\") pod \"memcached-0\" (UID: \"60903bff-9b27-488b-b399-2c87b66a6f35\") " pod="horizon-kuttl-tests/memcached-0" Mar 16 18:03:19 crc kubenswrapper[5120]: I0316 18:03:19.044784 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/rabbitmq-cluster-operator-index-9t2s8" Mar 16 18:03:19 crc kubenswrapper[5120]: I0316 18:03:19.115908 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="horizon-kuttl-tests/memcached-0" Mar 16 18:03:19 crc kubenswrapper[5120]: I0316 18:03:19.285585 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/rabbitmq-cluster-operator-index-9t2s8"] Mar 16 18:03:19 crc kubenswrapper[5120]: I0316 18:03:19.573938 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["horizon-kuttl-tests/memcached-0"] Mar 16 18:03:19 crc kubenswrapper[5120]: W0316 18:03:19.580782 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod60903bff_9b27_488b_b399_2c87b66a6f35.slice/crio-e7b21207b66eecdc9afaa258b5740f03c7a9dfe5feae1e0504e0c9d0ef5570e0 WatchSource:0}: Error finding container e7b21207b66eecdc9afaa258b5740f03c7a9dfe5feae1e0504e0c9d0ef5570e0: Status 404 returned error can't find the container with id e7b21207b66eecdc9afaa258b5740f03c7a9dfe5feae1e0504e0c9d0ef5570e0 Mar 16 18:03:19 crc kubenswrapper[5120]: I0316 18:03:19.988794 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/rabbitmq-cluster-operator-index-9t2s8" event={"ID":"b40fe47c-32a7-49e9-9285-eb83096a98b6","Type":"ContainerStarted","Data":"5dec9e100f900f18f8eb3dfc5c02ac579c087b263a49f0e6231cab5d2974a2dc"} Mar 16 18:03:19 crc kubenswrapper[5120]: I0316 18:03:19.992071 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="horizon-kuttl-tests/memcached-0" event={"ID":"60903bff-9b27-488b-b399-2c87b66a6f35","Type":"ContainerStarted","Data":"820f3098adfdf7eaa9f705c0627a4651a21a126e5608ae4d7701154ca804855c"} Mar 16 18:03:19 crc kubenswrapper[5120]: I0316 18:03:19.992121 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="horizon-kuttl-tests/memcached-0" event={"ID":"60903bff-9b27-488b-b399-2c87b66a6f35","Type":"ContainerStarted","Data":"e7b21207b66eecdc9afaa258b5740f03c7a9dfe5feae1e0504e0c9d0ef5570e0"} Mar 16 18:03:19 crc kubenswrapper[5120]: I0316 18:03:19.993204 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="horizon-kuttl-tests/memcached-0" Mar 16 18:03:20 crc kubenswrapper[5120]: I0316 18:03:20.019056 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="horizon-kuttl-tests/memcached-0" podStartSLOduration=2.019033186 podStartE2EDuration="2.019033186s" podCreationTimestamp="2026-03-16 18:03:18 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 18:03:20.012800596 +0000 UTC m=+9102.166732273" watchObservedRunningTime="2026-03-16 18:03:20.019033186 +0000 UTC m=+9102.172964843" Mar 16 18:03:21 crc kubenswrapper[5120]: I0316 18:03:21.005279 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/rabbitmq-cluster-operator-index-9t2s8" event={"ID":"b40fe47c-32a7-49e9-9285-eb83096a98b6","Type":"ContainerStarted","Data":"66d4ae0891cf3f350916b8e9c982ae32b7417c8faf5c04f731dd53a07c64ab19"} Mar 16 18:03:21 crc kubenswrapper[5120]: I0316 18:03:21.021924 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/rabbitmq-cluster-operator-index-9t2s8" podStartSLOduration=2.427662651 podStartE2EDuration="3.02189839s" podCreationTimestamp="2026-03-16 18:03:18 +0000 UTC" firstStartedPulling="2026-03-16 18:03:19.300599454 +0000 UTC m=+9101.454531111" lastFinishedPulling="2026-03-16 18:03:19.894835193 +0000 UTC m=+9102.048766850" observedRunningTime="2026-03-16 18:03:21.021628663 +0000 UTC m=+9103.175560330" watchObservedRunningTime="2026-03-16 18:03:21.02189839 +0000 UTC m=+9103.175830047" Mar 16 18:03:22 crc kubenswrapper[5120]: I0316 18:03:22.008018 5120 patch_prober.go:28] interesting pod/machine-config-daemon-7bf76 container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 18:03:22 crc kubenswrapper[5120]: I0316 18:03:22.008394 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 18:03:22 crc kubenswrapper[5120]: I0316 18:03:22.008450 5120 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" Mar 16 18:03:22 crc kubenswrapper[5120]: I0316 18:03:22.009220 5120 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="machine-config-daemon" containerStatusID={"Type":"cri-o","ID":"fa578cadb98a23319854b9fc54966313bbc1cee64f90cc75e1f951be3cb08e36"} pod="openshift-machine-config-operator/machine-config-daemon-7bf76" containerMessage="Container machine-config-daemon failed liveness probe, will be restarted" Mar 16 18:03:22 crc kubenswrapper[5120]: I0316 18:03:22.009308 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" containerID="cri-o://fa578cadb98a23319854b9fc54966313bbc1cee64f90cc75e1f951be3cb08e36" gracePeriod=600 Mar 16 18:03:22 crc kubenswrapper[5120]: E0316 18:03:22.154561 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 18:03:22 crc kubenswrapper[5120]: I0316 18:03:22.739839 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590kzqbx"] Mar 16 18:03:22 crc kubenswrapper[5120]: I0316 18:03:22.746668 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590kzqbx" Mar 16 18:03:22 crc kubenswrapper[5120]: I0316 18:03:22.749627 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-operators\"/\"default-dockercfg-rmzsx\"" Mar 16 18:03:22 crc kubenswrapper[5120]: I0316 18:03:22.757642 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590kzqbx"] Mar 16 18:03:22 crc kubenswrapper[5120]: I0316 18:03:22.785304 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aaaa700b-286f-4526-b61c-0d4cea827638-bundle\") pod \"9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590kzqbx\" (UID: \"aaaa700b-286f-4526-b61c-0d4cea827638\") " pod="openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590kzqbx" Mar 16 18:03:22 crc kubenswrapper[5120]: I0316 18:03:22.785483 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aaaa700b-286f-4526-b61c-0d4cea827638-util\") pod \"9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590kzqbx\" (UID: \"aaaa700b-286f-4526-b61c-0d4cea827638\") " pod="openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590kzqbx" Mar 16 18:03:22 crc kubenswrapper[5120]: I0316 18:03:22.785555 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tnqx9\" (UniqueName: \"kubernetes.io/projected/aaaa700b-286f-4526-b61c-0d4cea827638-kube-api-access-tnqx9\") pod \"9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590kzqbx\" (UID: \"aaaa700b-286f-4526-b61c-0d4cea827638\") " pod="openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590kzqbx" Mar 16 18:03:22 crc kubenswrapper[5120]: I0316 18:03:22.886996 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tnqx9\" (UniqueName: \"kubernetes.io/projected/aaaa700b-286f-4526-b61c-0d4cea827638-kube-api-access-tnqx9\") pod \"9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590kzqbx\" (UID: \"aaaa700b-286f-4526-b61c-0d4cea827638\") " pod="openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590kzqbx" Mar 16 18:03:22 crc kubenswrapper[5120]: I0316 18:03:22.887163 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aaaa700b-286f-4526-b61c-0d4cea827638-bundle\") pod \"9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590kzqbx\" (UID: \"aaaa700b-286f-4526-b61c-0d4cea827638\") " pod="openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590kzqbx" Mar 16 18:03:22 crc kubenswrapper[5120]: I0316 18:03:22.887327 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aaaa700b-286f-4526-b61c-0d4cea827638-util\") pod \"9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590kzqbx\" (UID: \"aaaa700b-286f-4526-b61c-0d4cea827638\") " pod="openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590kzqbx" Mar 16 18:03:22 crc kubenswrapper[5120]: I0316 18:03:22.887656 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aaaa700b-286f-4526-b61c-0d4cea827638-bundle\") pod \"9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590kzqbx\" (UID: \"aaaa700b-286f-4526-b61c-0d4cea827638\") " pod="openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590kzqbx" Mar 16 18:03:22 crc kubenswrapper[5120]: I0316 18:03:22.887746 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aaaa700b-286f-4526-b61c-0d4cea827638-util\") pod \"9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590kzqbx\" (UID: \"aaaa700b-286f-4526-b61c-0d4cea827638\") " pod="openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590kzqbx" Mar 16 18:03:22 crc kubenswrapper[5120]: I0316 18:03:22.918581 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tnqx9\" (UniqueName: \"kubernetes.io/projected/aaaa700b-286f-4526-b61c-0d4cea827638-kube-api-access-tnqx9\") pod \"9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590kzqbx\" (UID: \"aaaa700b-286f-4526-b61c-0d4cea827638\") " pod="openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590kzqbx" Mar 16 18:03:23 crc kubenswrapper[5120]: I0316 18:03:23.019002 5120 generic.go:358] "Generic (PLEG): container finished" podID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerID="fa578cadb98a23319854b9fc54966313bbc1cee64f90cc75e1f951be3cb08e36" exitCode=0 Mar 16 18:03:23 crc kubenswrapper[5120]: I0316 18:03:23.019070 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" event={"ID":"e2275cb4-4905-4d66-a87e-8010120db2bd","Type":"ContainerDied","Data":"fa578cadb98a23319854b9fc54966313bbc1cee64f90cc75e1f951be3cb08e36"} Mar 16 18:03:23 crc kubenswrapper[5120]: I0316 18:03:23.019454 5120 scope.go:117] "RemoveContainer" containerID="0caad9b53f7bfee276eeaee2e5b2b26df47661833c6091b93cdf0d452973d691" Mar 16 18:03:23 crc kubenswrapper[5120]: I0316 18:03:23.020037 5120 scope.go:117] "RemoveContainer" containerID="fa578cadb98a23319854b9fc54966313bbc1cee64f90cc75e1f951be3cb08e36" Mar 16 18:03:23 crc kubenswrapper[5120]: E0316 18:03:23.020460 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 18:03:23 crc kubenswrapper[5120]: I0316 18:03:23.072434 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590kzqbx" Mar 16 18:03:23 crc kubenswrapper[5120]: I0316 18:03:23.274550 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590kzqbx"] Mar 16 18:03:23 crc kubenswrapper[5120]: W0316 18:03:23.278896 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaaaa700b_286f_4526_b61c_0d4cea827638.slice/crio-837a0396082b0acfc85478cf96d8573e96c45b40ee5d5b1d849afa3f8298f5d7 WatchSource:0}: Error finding container 837a0396082b0acfc85478cf96d8573e96c45b40ee5d5b1d849afa3f8298f5d7: Status 404 returned error can't find the container with id 837a0396082b0acfc85478cf96d8573e96c45b40ee5d5b1d849afa3f8298f5d7 Mar 16 18:03:24 crc kubenswrapper[5120]: I0316 18:03:24.028288 5120 generic.go:358] "Generic (PLEG): container finished" podID="aaaa700b-286f-4526-b61c-0d4cea827638" containerID="ef6b58434af366a97ce2c38b55ab0a66204c617f0b65ca13dd5664a03de4500e" exitCode=0 Mar 16 18:03:24 crc kubenswrapper[5120]: I0316 18:03:24.028410 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590kzqbx" event={"ID":"aaaa700b-286f-4526-b61c-0d4cea827638","Type":"ContainerDied","Data":"ef6b58434af366a97ce2c38b55ab0a66204c617f0b65ca13dd5664a03de4500e"} Mar 16 18:03:24 crc kubenswrapper[5120]: I0316 18:03:24.028443 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590kzqbx" event={"ID":"aaaa700b-286f-4526-b61c-0d4cea827638","Type":"ContainerStarted","Data":"837a0396082b0acfc85478cf96d8573e96c45b40ee5d5b1d849afa3f8298f5d7"} Mar 16 18:03:26 crc kubenswrapper[5120]: I0316 18:03:26.052052 5120 generic.go:358] "Generic (PLEG): container finished" podID="aaaa700b-286f-4526-b61c-0d4cea827638" containerID="9a84236ff16d70d0fe8cce589889e1eff6fde516c9875fdcc59d906ab5930fd8" exitCode=0 Mar 16 18:03:26 crc kubenswrapper[5120]: I0316 18:03:26.052194 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590kzqbx" event={"ID":"aaaa700b-286f-4526-b61c-0d4cea827638","Type":"ContainerDied","Data":"9a84236ff16d70d0fe8cce589889e1eff6fde516c9875fdcc59d906ab5930fd8"} Mar 16 18:03:27 crc kubenswrapper[5120]: I0316 18:03:27.011614 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="horizon-kuttl-tests/memcached-0" Mar 16 18:03:27 crc kubenswrapper[5120]: I0316 18:03:27.063093 5120 generic.go:358] "Generic (PLEG): container finished" podID="aaaa700b-286f-4526-b61c-0d4cea827638" containerID="03b88cff1dac1651bf434abeb9e3c6739cbf9416037c444e35baa67c02a822c2" exitCode=0 Mar 16 18:03:27 crc kubenswrapper[5120]: I0316 18:03:27.063177 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590kzqbx" event={"ID":"aaaa700b-286f-4526-b61c-0d4cea827638","Type":"ContainerDied","Data":"03b88cff1dac1651bf434abeb9e3c6739cbf9416037c444e35baa67c02a822c2"} Mar 16 18:03:28 crc kubenswrapper[5120]: I0316 18:03:28.393486 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590kzqbx" Mar 16 18:03:28 crc kubenswrapper[5120]: I0316 18:03:28.533473 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aaaa700b-286f-4526-b61c-0d4cea827638-util\") pod \"aaaa700b-286f-4526-b61c-0d4cea827638\" (UID: \"aaaa700b-286f-4526-b61c-0d4cea827638\") " Mar 16 18:03:28 crc kubenswrapper[5120]: I0316 18:03:28.533637 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tnqx9\" (UniqueName: \"kubernetes.io/projected/aaaa700b-286f-4526-b61c-0d4cea827638-kube-api-access-tnqx9\") pod \"aaaa700b-286f-4526-b61c-0d4cea827638\" (UID: \"aaaa700b-286f-4526-b61c-0d4cea827638\") " Mar 16 18:03:28 crc kubenswrapper[5120]: I0316 18:03:28.533846 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aaaa700b-286f-4526-b61c-0d4cea827638-bundle\") pod \"aaaa700b-286f-4526-b61c-0d4cea827638\" (UID: \"aaaa700b-286f-4526-b61c-0d4cea827638\") " Mar 16 18:03:28 crc kubenswrapper[5120]: I0316 18:03:28.534731 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aaaa700b-286f-4526-b61c-0d4cea827638-bundle" (OuterVolumeSpecName: "bundle") pod "aaaa700b-286f-4526-b61c-0d4cea827638" (UID: "aaaa700b-286f-4526-b61c-0d4cea827638"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 18:03:28 crc kubenswrapper[5120]: I0316 18:03:28.540427 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aaaa700b-286f-4526-b61c-0d4cea827638-kube-api-access-tnqx9" (OuterVolumeSpecName: "kube-api-access-tnqx9") pod "aaaa700b-286f-4526-b61c-0d4cea827638" (UID: "aaaa700b-286f-4526-b61c-0d4cea827638"). InnerVolumeSpecName "kube-api-access-tnqx9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 18:03:28 crc kubenswrapper[5120]: I0316 18:03:28.550408 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aaaa700b-286f-4526-b61c-0d4cea827638-util" (OuterVolumeSpecName: "util") pod "aaaa700b-286f-4526-b61c-0d4cea827638" (UID: "aaaa700b-286f-4526-b61c-0d4cea827638"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 18:03:28 crc kubenswrapper[5120]: I0316 18:03:28.636822 5120 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aaaa700b-286f-4526-b61c-0d4cea827638-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 18:03:28 crc kubenswrapper[5120]: I0316 18:03:28.636860 5120 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aaaa700b-286f-4526-b61c-0d4cea827638-util\") on node \"crc\" DevicePath \"\"" Mar 16 18:03:28 crc kubenswrapper[5120]: I0316 18:03:28.636874 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tnqx9\" (UniqueName: \"kubernetes.io/projected/aaaa700b-286f-4526-b61c-0d4cea827638-kube-api-access-tnqx9\") on node \"crc\" DevicePath \"\"" Mar 16 18:03:29 crc kubenswrapper[5120]: I0316 18:03:29.045053 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-operators/rabbitmq-cluster-operator-index-9t2s8" Mar 16 18:03:29 crc kubenswrapper[5120]: I0316 18:03:29.045147 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-operators/rabbitmq-cluster-operator-index-9t2s8" Mar 16 18:03:29 crc kubenswrapper[5120]: I0316 18:03:29.081223 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-operators/rabbitmq-cluster-operator-index-9t2s8" Mar 16 18:03:29 crc kubenswrapper[5120]: I0316 18:03:29.085249 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590kzqbx" event={"ID":"aaaa700b-286f-4526-b61c-0d4cea827638","Type":"ContainerDied","Data":"837a0396082b0acfc85478cf96d8573e96c45b40ee5d5b1d849afa3f8298f5d7"} Mar 16 18:03:29 crc kubenswrapper[5120]: I0316 18:03:29.085297 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="837a0396082b0acfc85478cf96d8573e96c45b40ee5d5b1d849afa3f8298f5d7" Mar 16 18:03:29 crc kubenswrapper[5120]: I0316 18:03:29.085601 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590kzqbx" Mar 16 18:03:29 crc kubenswrapper[5120]: I0316 18:03:29.118879 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/rabbitmq-cluster-operator-index-9t2s8" Mar 16 18:03:33 crc kubenswrapper[5120]: I0316 18:03:33.159415 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-operators/rabbitmq-cluster-operator-6bc46f9cd-p55x6"] Mar 16 18:03:33 crc kubenswrapper[5120]: I0316 18:03:33.160958 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aaaa700b-286f-4526-b61c-0d4cea827638" containerName="pull" Mar 16 18:03:33 crc kubenswrapper[5120]: I0316 18:03:33.160976 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="aaaa700b-286f-4526-b61c-0d4cea827638" containerName="pull" Mar 16 18:03:33 crc kubenswrapper[5120]: I0316 18:03:33.161008 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aaaa700b-286f-4526-b61c-0d4cea827638" containerName="extract" Mar 16 18:03:33 crc kubenswrapper[5120]: I0316 18:03:33.161016 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="aaaa700b-286f-4526-b61c-0d4cea827638" containerName="extract" Mar 16 18:03:33 crc kubenswrapper[5120]: I0316 18:03:33.161074 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aaaa700b-286f-4526-b61c-0d4cea827638" containerName="util" Mar 16 18:03:33 crc kubenswrapper[5120]: I0316 18:03:33.161082 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="aaaa700b-286f-4526-b61c-0d4cea827638" containerName="util" Mar 16 18:03:33 crc kubenswrapper[5120]: I0316 18:03:33.161236 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="aaaa700b-286f-4526-b61c-0d4cea827638" containerName="extract" Mar 16 18:03:33 crc kubenswrapper[5120]: I0316 18:03:33.169257 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/rabbitmq-cluster-operator-6bc46f9cd-p55x6"] Mar 16 18:03:33 crc kubenswrapper[5120]: I0316 18:03:33.169416 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/rabbitmq-cluster-operator-6bc46f9cd-p55x6" Mar 16 18:03:33 crc kubenswrapper[5120]: I0316 18:03:33.179493 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-operators\"/\"rabbitmq-cluster-operator-dockercfg-c5v6c\"" Mar 16 18:03:33 crc kubenswrapper[5120]: I0316 18:03:33.254631 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czpll\" (UniqueName: \"kubernetes.io/projected/15b7d2ec-af69-4090-a15d-5168cd6fd202-kube-api-access-czpll\") pod \"rabbitmq-cluster-operator-6bc46f9cd-p55x6\" (UID: \"15b7d2ec-af69-4090-a15d-5168cd6fd202\") " pod="openstack-operators/rabbitmq-cluster-operator-6bc46f9cd-p55x6" Mar 16 18:03:33 crc kubenswrapper[5120]: I0316 18:03:33.356541 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-czpll\" (UniqueName: \"kubernetes.io/projected/15b7d2ec-af69-4090-a15d-5168cd6fd202-kube-api-access-czpll\") pod \"rabbitmq-cluster-operator-6bc46f9cd-p55x6\" (UID: \"15b7d2ec-af69-4090-a15d-5168cd6fd202\") " pod="openstack-operators/rabbitmq-cluster-operator-6bc46f9cd-p55x6" Mar 16 18:03:33 crc kubenswrapper[5120]: I0316 18:03:33.380993 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-czpll\" (UniqueName: \"kubernetes.io/projected/15b7d2ec-af69-4090-a15d-5168cd6fd202-kube-api-access-czpll\") pod \"rabbitmq-cluster-operator-6bc46f9cd-p55x6\" (UID: \"15b7d2ec-af69-4090-a15d-5168cd6fd202\") " pod="openstack-operators/rabbitmq-cluster-operator-6bc46f9cd-p55x6" Mar 16 18:03:33 crc kubenswrapper[5120]: I0316 18:03:33.495931 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/rabbitmq-cluster-operator-6bc46f9cd-p55x6" Mar 16 18:03:33 crc kubenswrapper[5120]: I0316 18:03:33.663914 5120 scope.go:117] "RemoveContainer" containerID="fa578cadb98a23319854b9fc54966313bbc1cee64f90cc75e1f951be3cb08e36" Mar 16 18:03:33 crc kubenswrapper[5120]: E0316 18:03:33.664250 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 18:03:33 crc kubenswrapper[5120]: I0316 18:03:33.724731 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/rabbitmq-cluster-operator-6bc46f9cd-p55x6"] Mar 16 18:03:33 crc kubenswrapper[5120]: W0316 18:03:33.732445 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod15b7d2ec_af69_4090_a15d_5168cd6fd202.slice/crio-0c2e99252f77ec00d1e960c41c186ea31abf42e38b231787ef4fa13ee651706d WatchSource:0}: Error finding container 0c2e99252f77ec00d1e960c41c186ea31abf42e38b231787ef4fa13ee651706d: Status 404 returned error can't find the container with id 0c2e99252f77ec00d1e960c41c186ea31abf42e38b231787ef4fa13ee651706d Mar 16 18:03:34 crc kubenswrapper[5120]: I0316 18:03:34.125408 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/rabbitmq-cluster-operator-6bc46f9cd-p55x6" event={"ID":"15b7d2ec-af69-4090-a15d-5168cd6fd202","Type":"ContainerStarted","Data":"bfe6ac0a042d4e3b1a03edfd3cc950ba950b387709726d83609e59892824963e"} Mar 16 18:03:34 crc kubenswrapper[5120]: I0316 18:03:34.125742 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/rabbitmq-cluster-operator-6bc46f9cd-p55x6" event={"ID":"15b7d2ec-af69-4090-a15d-5168cd6fd202","Type":"ContainerStarted","Data":"0c2e99252f77ec00d1e960c41c186ea31abf42e38b231787ef4fa13ee651706d"} Mar 16 18:03:34 crc kubenswrapper[5120]: I0316 18:03:34.163755 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/rabbitmq-cluster-operator-6bc46f9cd-p55x6" podStartSLOduration=1.16373979 podStartE2EDuration="1.16373979s" podCreationTimestamp="2026-03-16 18:03:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 18:03:34.16119115 +0000 UTC m=+9116.315122807" watchObservedRunningTime="2026-03-16 18:03:34.16373979 +0000 UTC m=+9116.317671437" Mar 16 18:03:37 crc kubenswrapper[5120]: I0316 18:03:37.488728 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-operators/keystone-operator-index-jm8f4"] Mar 16 18:03:37 crc kubenswrapper[5120]: I0316 18:03:37.494900 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/keystone-operator-index-jm8f4" Mar 16 18:03:37 crc kubenswrapper[5120]: I0316 18:03:37.497245 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-operators\"/\"keystone-operator-index-dockercfg-5dv2m\"" Mar 16 18:03:37 crc kubenswrapper[5120]: I0316 18:03:37.506195 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/keystone-operator-index-jm8f4"] Mar 16 18:03:37 crc kubenswrapper[5120]: I0316 18:03:37.654327 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvsvm\" (UniqueName: \"kubernetes.io/projected/b7674bce-996b-45ac-99a4-4c728e2472cb-kube-api-access-jvsvm\") pod \"keystone-operator-index-jm8f4\" (UID: \"b7674bce-996b-45ac-99a4-4c728e2472cb\") " pod="openstack-operators/keystone-operator-index-jm8f4" Mar 16 18:03:37 crc kubenswrapper[5120]: I0316 18:03:37.756414 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jvsvm\" (UniqueName: \"kubernetes.io/projected/b7674bce-996b-45ac-99a4-4c728e2472cb-kube-api-access-jvsvm\") pod \"keystone-operator-index-jm8f4\" (UID: \"b7674bce-996b-45ac-99a4-4c728e2472cb\") " pod="openstack-operators/keystone-operator-index-jm8f4" Mar 16 18:03:37 crc kubenswrapper[5120]: I0316 18:03:37.776075 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvsvm\" (UniqueName: \"kubernetes.io/projected/b7674bce-996b-45ac-99a4-4c728e2472cb-kube-api-access-jvsvm\") pod \"keystone-operator-index-jm8f4\" (UID: \"b7674bce-996b-45ac-99a4-4c728e2472cb\") " pod="openstack-operators/keystone-operator-index-jm8f4" Mar 16 18:03:37 crc kubenswrapper[5120]: I0316 18:03:37.815117 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/keystone-operator-index-jm8f4" Mar 16 18:03:38 crc kubenswrapper[5120]: I0316 18:03:38.331985 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/keystone-operator-index-jm8f4"] Mar 16 18:03:39 crc kubenswrapper[5120]: I0316 18:03:39.165310 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/keystone-operator-index-jm8f4" event={"ID":"b7674bce-996b-45ac-99a4-4c728e2472cb","Type":"ContainerStarted","Data":"deb7e4386481c9cae18b7757f51760b984ce97aaf37157551acc023b694014ff"} Mar 16 18:03:40 crc kubenswrapper[5120]: I0316 18:03:40.175995 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/keystone-operator-index-jm8f4" event={"ID":"b7674bce-996b-45ac-99a4-4c728e2472cb","Type":"ContainerStarted","Data":"a282f7bed3eca0c5dca010234b6d940dc311bff702773a8ce1ab01e080fc29ef"} Mar 16 18:03:40 crc kubenswrapper[5120]: I0316 18:03:40.201313 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/keystone-operator-index-jm8f4" podStartSLOduration=2.424475544 podStartE2EDuration="3.20128694s" podCreationTimestamp="2026-03-16 18:03:37 +0000 UTC" firstStartedPulling="2026-03-16 18:03:38.327462147 +0000 UTC m=+9120.481393844" lastFinishedPulling="2026-03-16 18:03:39.104273583 +0000 UTC m=+9121.258205240" observedRunningTime="2026-03-16 18:03:40.193104037 +0000 UTC m=+9122.347035734" watchObservedRunningTime="2026-03-16 18:03:40.20128694 +0000 UTC m=+9122.355218607" Mar 16 18:03:45 crc kubenswrapper[5120]: I0316 18:03:45.950211 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-operators/057d2ef2813dbca67df99f545f5daea57175a3b6e27320c69396d55997pq7ff"] Mar 16 18:03:45 crc kubenswrapper[5120]: I0316 18:03:45.959975 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/057d2ef2813dbca67df99f545f5daea57175a3b6e27320c69396d55997pq7ff" Mar 16 18:03:45 crc kubenswrapper[5120]: I0316 18:03:45.962874 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-operators\"/\"default-dockercfg-rmzsx\"" Mar 16 18:03:45 crc kubenswrapper[5120]: I0316 18:03:45.967369 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/057d2ef2813dbca67df99f545f5daea57175a3b6e27320c69396d55997pq7ff"] Mar 16 18:03:46 crc kubenswrapper[5120]: I0316 18:03:46.020470 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/24851c92-fcc9-4ef2-b9f9-f766d3b08a33-util\") pod \"057d2ef2813dbca67df99f545f5daea57175a3b6e27320c69396d55997pq7ff\" (UID: \"24851c92-fcc9-4ef2-b9f9-f766d3b08a33\") " pod="openstack-operators/057d2ef2813dbca67df99f545f5daea57175a3b6e27320c69396d55997pq7ff" Mar 16 18:03:46 crc kubenswrapper[5120]: I0316 18:03:46.020671 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/24851c92-fcc9-4ef2-b9f9-f766d3b08a33-bundle\") pod \"057d2ef2813dbca67df99f545f5daea57175a3b6e27320c69396d55997pq7ff\" (UID: \"24851c92-fcc9-4ef2-b9f9-f766d3b08a33\") " pod="openstack-operators/057d2ef2813dbca67df99f545f5daea57175a3b6e27320c69396d55997pq7ff" Mar 16 18:03:46 crc kubenswrapper[5120]: I0316 18:03:46.020886 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k22hq\" (UniqueName: \"kubernetes.io/projected/24851c92-fcc9-4ef2-b9f9-f766d3b08a33-kube-api-access-k22hq\") pod \"057d2ef2813dbca67df99f545f5daea57175a3b6e27320c69396d55997pq7ff\" (UID: \"24851c92-fcc9-4ef2-b9f9-f766d3b08a33\") " pod="openstack-operators/057d2ef2813dbca67df99f545f5daea57175a3b6e27320c69396d55997pq7ff" Mar 16 18:03:46 crc kubenswrapper[5120]: I0316 18:03:46.122751 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/24851c92-fcc9-4ef2-b9f9-f766d3b08a33-util\") pod \"057d2ef2813dbca67df99f545f5daea57175a3b6e27320c69396d55997pq7ff\" (UID: \"24851c92-fcc9-4ef2-b9f9-f766d3b08a33\") " pod="openstack-operators/057d2ef2813dbca67df99f545f5daea57175a3b6e27320c69396d55997pq7ff" Mar 16 18:03:46 crc kubenswrapper[5120]: I0316 18:03:46.122961 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/24851c92-fcc9-4ef2-b9f9-f766d3b08a33-bundle\") pod \"057d2ef2813dbca67df99f545f5daea57175a3b6e27320c69396d55997pq7ff\" (UID: \"24851c92-fcc9-4ef2-b9f9-f766d3b08a33\") " pod="openstack-operators/057d2ef2813dbca67df99f545f5daea57175a3b6e27320c69396d55997pq7ff" Mar 16 18:03:46 crc kubenswrapper[5120]: I0316 18:03:46.123132 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k22hq\" (UniqueName: \"kubernetes.io/projected/24851c92-fcc9-4ef2-b9f9-f766d3b08a33-kube-api-access-k22hq\") pod \"057d2ef2813dbca67df99f545f5daea57175a3b6e27320c69396d55997pq7ff\" (UID: \"24851c92-fcc9-4ef2-b9f9-f766d3b08a33\") " pod="openstack-operators/057d2ef2813dbca67df99f545f5daea57175a3b6e27320c69396d55997pq7ff" Mar 16 18:03:46 crc kubenswrapper[5120]: I0316 18:03:46.123723 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/24851c92-fcc9-4ef2-b9f9-f766d3b08a33-bundle\") pod \"057d2ef2813dbca67df99f545f5daea57175a3b6e27320c69396d55997pq7ff\" (UID: \"24851c92-fcc9-4ef2-b9f9-f766d3b08a33\") " pod="openstack-operators/057d2ef2813dbca67df99f545f5daea57175a3b6e27320c69396d55997pq7ff" Mar 16 18:03:46 crc kubenswrapper[5120]: I0316 18:03:46.123875 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/24851c92-fcc9-4ef2-b9f9-f766d3b08a33-util\") pod \"057d2ef2813dbca67df99f545f5daea57175a3b6e27320c69396d55997pq7ff\" (UID: \"24851c92-fcc9-4ef2-b9f9-f766d3b08a33\") " pod="openstack-operators/057d2ef2813dbca67df99f545f5daea57175a3b6e27320c69396d55997pq7ff" Mar 16 18:03:46 crc kubenswrapper[5120]: I0316 18:03:46.149161 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k22hq\" (UniqueName: \"kubernetes.io/projected/24851c92-fcc9-4ef2-b9f9-f766d3b08a33-kube-api-access-k22hq\") pod \"057d2ef2813dbca67df99f545f5daea57175a3b6e27320c69396d55997pq7ff\" (UID: \"24851c92-fcc9-4ef2-b9f9-f766d3b08a33\") " pod="openstack-operators/057d2ef2813dbca67df99f545f5daea57175a3b6e27320c69396d55997pq7ff" Mar 16 18:03:46 crc kubenswrapper[5120]: I0316 18:03:46.286277 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/057d2ef2813dbca67df99f545f5daea57175a3b6e27320c69396d55997pq7ff" Mar 16 18:03:46 crc kubenswrapper[5120]: I0316 18:03:46.733718 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/057d2ef2813dbca67df99f545f5daea57175a3b6e27320c69396d55997pq7ff"] Mar 16 18:03:47 crc kubenswrapper[5120]: I0316 18:03:47.238398 5120 generic.go:358] "Generic (PLEG): container finished" podID="24851c92-fcc9-4ef2-b9f9-f766d3b08a33" containerID="b38ce02584f11c87e8ee20dc6e3414b64e6f4512bf88bc45a5b901f67630016f" exitCode=0 Mar 16 18:03:47 crc kubenswrapper[5120]: I0316 18:03:47.238591 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/057d2ef2813dbca67df99f545f5daea57175a3b6e27320c69396d55997pq7ff" event={"ID":"24851c92-fcc9-4ef2-b9f9-f766d3b08a33","Type":"ContainerDied","Data":"b38ce02584f11c87e8ee20dc6e3414b64e6f4512bf88bc45a5b901f67630016f"} Mar 16 18:03:47 crc kubenswrapper[5120]: I0316 18:03:47.238730 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/057d2ef2813dbca67df99f545f5daea57175a3b6e27320c69396d55997pq7ff" event={"ID":"24851c92-fcc9-4ef2-b9f9-f766d3b08a33","Type":"ContainerStarted","Data":"c3d024595015629282e5a45b4f5975c8c18a5268d7afcba9f6420666cf4f623d"} Mar 16 18:03:47 crc kubenswrapper[5120]: I0316 18:03:47.664235 5120 scope.go:117] "RemoveContainer" containerID="fa578cadb98a23319854b9fc54966313bbc1cee64f90cc75e1f951be3cb08e36" Mar 16 18:03:47 crc kubenswrapper[5120]: E0316 18:03:47.664696 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 18:03:47 crc kubenswrapper[5120]: I0316 18:03:47.816086 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-operators/keystone-operator-index-jm8f4" Mar 16 18:03:47 crc kubenswrapper[5120]: I0316 18:03:47.816595 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-operators/keystone-operator-index-jm8f4" Mar 16 18:03:47 crc kubenswrapper[5120]: I0316 18:03:47.850474 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-operators/keystone-operator-index-jm8f4" Mar 16 18:03:48 crc kubenswrapper[5120]: I0316 18:03:48.257434 5120 generic.go:358] "Generic (PLEG): container finished" podID="24851c92-fcc9-4ef2-b9f9-f766d3b08a33" containerID="516bd0abf13ac9b504f215494f512371bc74833a4ffcb1571ed906d8f2f3f2ea" exitCode=0 Mar 16 18:03:48 crc kubenswrapper[5120]: I0316 18:03:48.257505 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/057d2ef2813dbca67df99f545f5daea57175a3b6e27320c69396d55997pq7ff" event={"ID":"24851c92-fcc9-4ef2-b9f9-f766d3b08a33","Type":"ContainerDied","Data":"516bd0abf13ac9b504f215494f512371bc74833a4ffcb1571ed906d8f2f3f2ea"} Mar 16 18:03:48 crc kubenswrapper[5120]: I0316 18:03:48.328427 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/keystone-operator-index-jm8f4" Mar 16 18:03:49 crc kubenswrapper[5120]: I0316 18:03:49.265981 5120 generic.go:358] "Generic (PLEG): container finished" podID="24851c92-fcc9-4ef2-b9f9-f766d3b08a33" containerID="c55311eea0497ded30bdb099fba4a7607c4b10c27c9a0eb98c271b2cb9b0e32b" exitCode=0 Mar 16 18:03:49 crc kubenswrapper[5120]: I0316 18:03:49.266086 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/057d2ef2813dbca67df99f545f5daea57175a3b6e27320c69396d55997pq7ff" event={"ID":"24851c92-fcc9-4ef2-b9f9-f766d3b08a33","Type":"ContainerDied","Data":"c55311eea0497ded30bdb099fba4a7607c4b10c27c9a0eb98c271b2cb9b0e32b"} Mar 16 18:03:50 crc kubenswrapper[5120]: I0316 18:03:50.564832 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/057d2ef2813dbca67df99f545f5daea57175a3b6e27320c69396d55997pq7ff" Mar 16 18:03:50 crc kubenswrapper[5120]: I0316 18:03:50.626100 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/24851c92-fcc9-4ef2-b9f9-f766d3b08a33-bundle\") pod \"24851c92-fcc9-4ef2-b9f9-f766d3b08a33\" (UID: \"24851c92-fcc9-4ef2-b9f9-f766d3b08a33\") " Mar 16 18:03:50 crc kubenswrapper[5120]: I0316 18:03:50.626457 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k22hq\" (UniqueName: \"kubernetes.io/projected/24851c92-fcc9-4ef2-b9f9-f766d3b08a33-kube-api-access-k22hq\") pod \"24851c92-fcc9-4ef2-b9f9-f766d3b08a33\" (UID: \"24851c92-fcc9-4ef2-b9f9-f766d3b08a33\") " Mar 16 18:03:50 crc kubenswrapper[5120]: I0316 18:03:50.626798 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/24851c92-fcc9-4ef2-b9f9-f766d3b08a33-util\") pod \"24851c92-fcc9-4ef2-b9f9-f766d3b08a33\" (UID: \"24851c92-fcc9-4ef2-b9f9-f766d3b08a33\") " Mar 16 18:03:50 crc kubenswrapper[5120]: I0316 18:03:50.628189 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24851c92-fcc9-4ef2-b9f9-f766d3b08a33-bundle" (OuterVolumeSpecName: "bundle") pod "24851c92-fcc9-4ef2-b9f9-f766d3b08a33" (UID: "24851c92-fcc9-4ef2-b9f9-f766d3b08a33"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 18:03:50 crc kubenswrapper[5120]: I0316 18:03:50.633572 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24851c92-fcc9-4ef2-b9f9-f766d3b08a33-kube-api-access-k22hq" (OuterVolumeSpecName: "kube-api-access-k22hq") pod "24851c92-fcc9-4ef2-b9f9-f766d3b08a33" (UID: "24851c92-fcc9-4ef2-b9f9-f766d3b08a33"). InnerVolumeSpecName "kube-api-access-k22hq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 18:03:50 crc kubenswrapper[5120]: I0316 18:03:50.650590 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24851c92-fcc9-4ef2-b9f9-f766d3b08a33-util" (OuterVolumeSpecName: "util") pod "24851c92-fcc9-4ef2-b9f9-f766d3b08a33" (UID: "24851c92-fcc9-4ef2-b9f9-f766d3b08a33"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 18:03:50 crc kubenswrapper[5120]: I0316 18:03:50.730828 5120 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/24851c92-fcc9-4ef2-b9f9-f766d3b08a33-util\") on node \"crc\" DevicePath \"\"" Mar 16 18:03:50 crc kubenswrapper[5120]: I0316 18:03:50.730861 5120 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/24851c92-fcc9-4ef2-b9f9-f766d3b08a33-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 18:03:50 crc kubenswrapper[5120]: I0316 18:03:50.730873 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k22hq\" (UniqueName: \"kubernetes.io/projected/24851c92-fcc9-4ef2-b9f9-f766d3b08a33-kube-api-access-k22hq\") on node \"crc\" DevicePath \"\"" Mar 16 18:03:51 crc kubenswrapper[5120]: I0316 18:03:51.296073 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/057d2ef2813dbca67df99f545f5daea57175a3b6e27320c69396d55997pq7ff" event={"ID":"24851c92-fcc9-4ef2-b9f9-f766d3b08a33","Type":"ContainerDied","Data":"c3d024595015629282e5a45b4f5975c8c18a5268d7afcba9f6420666cf4f623d"} Mar 16 18:03:51 crc kubenswrapper[5120]: I0316 18:03:51.296153 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c3d024595015629282e5a45b4f5975c8c18a5268d7afcba9f6420666cf4f623d" Mar 16 18:03:51 crc kubenswrapper[5120]: I0316 18:03:51.296328 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/057d2ef2813dbca67df99f545f5daea57175a3b6e27320c69396d55997pq7ff" Mar 16 18:03:51 crc kubenswrapper[5120]: I0316 18:03:51.297827 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/certified-operators-7mjnz"] Mar 16 18:03:51 crc kubenswrapper[5120]: I0316 18:03:51.298601 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24851c92-fcc9-4ef2-b9f9-f766d3b08a33" containerName="pull" Mar 16 18:03:51 crc kubenswrapper[5120]: I0316 18:03:51.298624 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="24851c92-fcc9-4ef2-b9f9-f766d3b08a33" containerName="pull" Mar 16 18:03:51 crc kubenswrapper[5120]: I0316 18:03:51.298640 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24851c92-fcc9-4ef2-b9f9-f766d3b08a33" containerName="util" Mar 16 18:03:51 crc kubenswrapper[5120]: I0316 18:03:51.298648 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="24851c92-fcc9-4ef2-b9f9-f766d3b08a33" containerName="util" Mar 16 18:03:51 crc kubenswrapper[5120]: I0316 18:03:51.298717 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24851c92-fcc9-4ef2-b9f9-f766d3b08a33" containerName="extract" Mar 16 18:03:51 crc kubenswrapper[5120]: I0316 18:03:51.298727 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="24851c92-fcc9-4ef2-b9f9-f766d3b08a33" containerName="extract" Mar 16 18:03:51 crc kubenswrapper[5120]: I0316 18:03:51.298896 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="24851c92-fcc9-4ef2-b9f9-f766d3b08a33" containerName="extract" Mar 16 18:03:51 crc kubenswrapper[5120]: I0316 18:03:51.308117 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-7mjnz" Mar 16 18:03:51 crc kubenswrapper[5120]: I0316 18:03:51.321929 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/certified-operators-7mjnz"] Mar 16 18:03:51 crc kubenswrapper[5120]: I0316 18:03:51.346249 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/938a740f-99fe-4d1d-a3ee-251748a15f89-catalog-content\") pod \"certified-operators-7mjnz\" (UID: \"938a740f-99fe-4d1d-a3ee-251748a15f89\") " pod="openshift-marketplace/certified-operators-7mjnz" Mar 16 18:03:51 crc kubenswrapper[5120]: I0316 18:03:51.346437 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/938a740f-99fe-4d1d-a3ee-251748a15f89-utilities\") pod \"certified-operators-7mjnz\" (UID: \"938a740f-99fe-4d1d-a3ee-251748a15f89\") " pod="openshift-marketplace/certified-operators-7mjnz" Mar 16 18:03:51 crc kubenswrapper[5120]: I0316 18:03:51.346499 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4c952\" (UniqueName: \"kubernetes.io/projected/938a740f-99fe-4d1d-a3ee-251748a15f89-kube-api-access-4c952\") pod \"certified-operators-7mjnz\" (UID: \"938a740f-99fe-4d1d-a3ee-251748a15f89\") " pod="openshift-marketplace/certified-operators-7mjnz" Mar 16 18:03:51 crc kubenswrapper[5120]: I0316 18:03:51.394912 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["horizon-kuttl-tests/rabbitmq-server-0"] Mar 16 18:03:51 crc kubenswrapper[5120]: I0316 18:03:51.402865 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="horizon-kuttl-tests/rabbitmq-server-0" Mar 16 18:03:51 crc kubenswrapper[5120]: I0316 18:03:51.405569 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["horizon-kuttl-tests/rabbitmq-server-0"] Mar 16 18:03:51 crc kubenswrapper[5120]: I0316 18:03:51.408834 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"horizon-kuttl-tests\"/\"rabbitmq-erlang-cookie\"" Mar 16 18:03:51 crc kubenswrapper[5120]: I0316 18:03:51.409066 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"horizon-kuttl-tests\"/\"rabbitmq-plugins-conf\"" Mar 16 18:03:51 crc kubenswrapper[5120]: I0316 18:03:51.409281 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"horizon-kuttl-tests\"/\"rabbitmq-server-conf\"" Mar 16 18:03:51 crc kubenswrapper[5120]: I0316 18:03:51.409458 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"horizon-kuttl-tests\"/\"rabbitmq-default-user\"" Mar 16 18:03:51 crc kubenswrapper[5120]: I0316 18:03:51.409896 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"horizon-kuttl-tests\"/\"rabbitmq-server-dockercfg-qzc88\"" Mar 16 18:03:51 crc kubenswrapper[5120]: I0316 18:03:51.448873 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-58f4a4c2-fde3-4084-9394-a3d96963418a\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-58f4a4c2-fde3-4084-9394-a3d96963418a\") pod \"rabbitmq-server-0\" (UID: \"7decf9bf-957e-4b6b-8864-da4761ca69cb\") " pod="horizon-kuttl-tests/rabbitmq-server-0" Mar 16 18:03:51 crc kubenswrapper[5120]: I0316 18:03:51.448952 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/7decf9bf-957e-4b6b-8864-da4761ca69cb-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"7decf9bf-957e-4b6b-8864-da4761ca69cb\") " pod="horizon-kuttl-tests/rabbitmq-server-0" Mar 16 18:03:51 crc kubenswrapper[5120]: I0316 18:03:51.449077 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/938a740f-99fe-4d1d-a3ee-251748a15f89-catalog-content\") pod \"certified-operators-7mjnz\" (UID: \"938a740f-99fe-4d1d-a3ee-251748a15f89\") " pod="openshift-marketplace/certified-operators-7mjnz" Mar 16 18:03:51 crc kubenswrapper[5120]: I0316 18:03:51.449236 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/7decf9bf-957e-4b6b-8864-da4761ca69cb-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"7decf9bf-957e-4b6b-8864-da4761ca69cb\") " pod="horizon-kuttl-tests/rabbitmq-server-0" Mar 16 18:03:51 crc kubenswrapper[5120]: I0316 18:03:51.449268 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/7decf9bf-957e-4b6b-8864-da4761ca69cb-pod-info\") pod \"rabbitmq-server-0\" (UID: \"7decf9bf-957e-4b6b-8864-da4761ca69cb\") " pod="horizon-kuttl-tests/rabbitmq-server-0" Mar 16 18:03:51 crc kubenswrapper[5120]: I0316 18:03:51.449293 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/938a740f-99fe-4d1d-a3ee-251748a15f89-utilities\") pod \"certified-operators-7mjnz\" (UID: \"938a740f-99fe-4d1d-a3ee-251748a15f89\") " pod="openshift-marketplace/certified-operators-7mjnz" Mar 16 18:03:51 crc kubenswrapper[5120]: I0316 18:03:51.449326 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/7decf9bf-957e-4b6b-8864-da4761ca69cb-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"7decf9bf-957e-4b6b-8864-da4761ca69cb\") " pod="horizon-kuttl-tests/rabbitmq-server-0" Mar 16 18:03:51 crc kubenswrapper[5120]: I0316 18:03:51.449385 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4c952\" (UniqueName: \"kubernetes.io/projected/938a740f-99fe-4d1d-a3ee-251748a15f89-kube-api-access-4c952\") pod \"certified-operators-7mjnz\" (UID: \"938a740f-99fe-4d1d-a3ee-251748a15f89\") " pod="openshift-marketplace/certified-operators-7mjnz" Mar 16 18:03:51 crc kubenswrapper[5120]: I0316 18:03:51.449459 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/7decf9bf-957e-4b6b-8864-da4761ca69cb-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"7decf9bf-957e-4b6b-8864-da4761ca69cb\") " pod="horizon-kuttl-tests/rabbitmq-server-0" Mar 16 18:03:51 crc kubenswrapper[5120]: I0316 18:03:51.449538 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/7decf9bf-957e-4b6b-8864-da4761ca69cb-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"7decf9bf-957e-4b6b-8864-da4761ca69cb\") " pod="horizon-kuttl-tests/rabbitmq-server-0" Mar 16 18:03:51 crc kubenswrapper[5120]: I0316 18:03:51.449565 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbqgg\" (UniqueName: \"kubernetes.io/projected/7decf9bf-957e-4b6b-8864-da4761ca69cb-kube-api-access-dbqgg\") pod \"rabbitmq-server-0\" (UID: \"7decf9bf-957e-4b6b-8864-da4761ca69cb\") " pod="horizon-kuttl-tests/rabbitmq-server-0" Mar 16 18:03:51 crc kubenswrapper[5120]: I0316 18:03:51.450870 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/938a740f-99fe-4d1d-a3ee-251748a15f89-utilities\") pod \"certified-operators-7mjnz\" (UID: \"938a740f-99fe-4d1d-a3ee-251748a15f89\") " pod="openshift-marketplace/certified-operators-7mjnz" Mar 16 18:03:51 crc kubenswrapper[5120]: I0316 18:03:51.451206 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/938a740f-99fe-4d1d-a3ee-251748a15f89-catalog-content\") pod \"certified-operators-7mjnz\" (UID: \"938a740f-99fe-4d1d-a3ee-251748a15f89\") " pod="openshift-marketplace/certified-operators-7mjnz" Mar 16 18:03:51 crc kubenswrapper[5120]: I0316 18:03:51.477635 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4c952\" (UniqueName: \"kubernetes.io/projected/938a740f-99fe-4d1d-a3ee-251748a15f89-kube-api-access-4c952\") pod \"certified-operators-7mjnz\" (UID: \"938a740f-99fe-4d1d-a3ee-251748a15f89\") " pod="openshift-marketplace/certified-operators-7mjnz" Mar 16 18:03:51 crc kubenswrapper[5120]: I0316 18:03:51.551317 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/7decf9bf-957e-4b6b-8864-da4761ca69cb-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"7decf9bf-957e-4b6b-8864-da4761ca69cb\") " pod="horizon-kuttl-tests/rabbitmq-server-0" Mar 16 18:03:51 crc kubenswrapper[5120]: I0316 18:03:51.551365 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/7decf9bf-957e-4b6b-8864-da4761ca69cb-pod-info\") pod \"rabbitmq-server-0\" (UID: \"7decf9bf-957e-4b6b-8864-da4761ca69cb\") " pod="horizon-kuttl-tests/rabbitmq-server-0" Mar 16 18:03:51 crc kubenswrapper[5120]: I0316 18:03:51.551395 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/7decf9bf-957e-4b6b-8864-da4761ca69cb-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"7decf9bf-957e-4b6b-8864-da4761ca69cb\") " pod="horizon-kuttl-tests/rabbitmq-server-0" Mar 16 18:03:51 crc kubenswrapper[5120]: I0316 18:03:51.551462 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/7decf9bf-957e-4b6b-8864-da4761ca69cb-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"7decf9bf-957e-4b6b-8864-da4761ca69cb\") " pod="horizon-kuttl-tests/rabbitmq-server-0" Mar 16 18:03:51 crc kubenswrapper[5120]: I0316 18:03:51.551542 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/7decf9bf-957e-4b6b-8864-da4761ca69cb-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"7decf9bf-957e-4b6b-8864-da4761ca69cb\") " pod="horizon-kuttl-tests/rabbitmq-server-0" Mar 16 18:03:51 crc kubenswrapper[5120]: I0316 18:03:51.552140 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/7decf9bf-957e-4b6b-8864-da4761ca69cb-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"7decf9bf-957e-4b6b-8864-da4761ca69cb\") " pod="horizon-kuttl-tests/rabbitmq-server-0" Mar 16 18:03:51 crc kubenswrapper[5120]: I0316 18:03:51.552195 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dbqgg\" (UniqueName: \"kubernetes.io/projected/7decf9bf-957e-4b6b-8864-da4761ca69cb-kube-api-access-dbqgg\") pod \"rabbitmq-server-0\" (UID: \"7decf9bf-957e-4b6b-8864-da4761ca69cb\") " pod="horizon-kuttl-tests/rabbitmq-server-0" Mar 16 18:03:51 crc kubenswrapper[5120]: I0316 18:03:51.552260 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/7decf9bf-957e-4b6b-8864-da4761ca69cb-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"7decf9bf-957e-4b6b-8864-da4761ca69cb\") " pod="horizon-kuttl-tests/rabbitmq-server-0" Mar 16 18:03:51 crc kubenswrapper[5120]: I0316 18:03:51.552274 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/7decf9bf-957e-4b6b-8864-da4761ca69cb-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"7decf9bf-957e-4b6b-8864-da4761ca69cb\") " pod="horizon-kuttl-tests/rabbitmq-server-0" Mar 16 18:03:51 crc kubenswrapper[5120]: I0316 18:03:51.552384 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pvc-58f4a4c2-fde3-4084-9394-a3d96963418a\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-58f4a4c2-fde3-4084-9394-a3d96963418a\") pod \"rabbitmq-server-0\" (UID: \"7decf9bf-957e-4b6b-8864-da4761ca69cb\") " pod="horizon-kuttl-tests/rabbitmq-server-0" Mar 16 18:03:51 crc kubenswrapper[5120]: I0316 18:03:51.552566 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/7decf9bf-957e-4b6b-8864-da4761ca69cb-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"7decf9bf-957e-4b6b-8864-da4761ca69cb\") " pod="horizon-kuttl-tests/rabbitmq-server-0" Mar 16 18:03:51 crc kubenswrapper[5120]: I0316 18:03:51.555540 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/7decf9bf-957e-4b6b-8864-da4761ca69cb-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"7decf9bf-957e-4b6b-8864-da4761ca69cb\") " pod="horizon-kuttl-tests/rabbitmq-server-0" Mar 16 18:03:51 crc kubenswrapper[5120]: I0316 18:03:51.555970 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/7decf9bf-957e-4b6b-8864-da4761ca69cb-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"7decf9bf-957e-4b6b-8864-da4761ca69cb\") " pod="horizon-kuttl-tests/rabbitmq-server-0" Mar 16 18:03:51 crc kubenswrapper[5120]: I0316 18:03:51.556373 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/7decf9bf-957e-4b6b-8864-da4761ca69cb-pod-info\") pod \"rabbitmq-server-0\" (UID: \"7decf9bf-957e-4b6b-8864-da4761ca69cb\") " pod="horizon-kuttl-tests/rabbitmq-server-0" Mar 16 18:03:51 crc kubenswrapper[5120]: I0316 18:03:51.559101 5120 csi_attacher.go:373] kubernetes.io/csi: attacher.MountDevice STAGE_UNSTAGE_VOLUME capability not set. Skipping MountDevice... Mar 16 18:03:51 crc kubenswrapper[5120]: I0316 18:03:51.559139 5120 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"pvc-58f4a4c2-fde3-4084-9394-a3d96963418a\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-58f4a4c2-fde3-4084-9394-a3d96963418a\") pod \"rabbitmq-server-0\" (UID: \"7decf9bf-957e-4b6b-8864-da4761ca69cb\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/kubevirt.io.hostpath-provisioner/3c9cce3060b12d0a47c82b378f4c60bed620733a4534159da9914c607779b870/globalmount\"" pod="horizon-kuttl-tests/rabbitmq-server-0" Mar 16 18:03:51 crc kubenswrapper[5120]: I0316 18:03:51.573531 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbqgg\" (UniqueName: \"kubernetes.io/projected/7decf9bf-957e-4b6b-8864-da4761ca69cb-kube-api-access-dbqgg\") pod \"rabbitmq-server-0\" (UID: \"7decf9bf-957e-4b6b-8864-da4761ca69cb\") " pod="horizon-kuttl-tests/rabbitmq-server-0" Mar 16 18:03:51 crc kubenswrapper[5120]: I0316 18:03:51.592744 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-58f4a4c2-fde3-4084-9394-a3d96963418a\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-58f4a4c2-fde3-4084-9394-a3d96963418a\") pod \"rabbitmq-server-0\" (UID: \"7decf9bf-957e-4b6b-8864-da4761ca69cb\") " pod="horizon-kuttl-tests/rabbitmq-server-0" Mar 16 18:03:51 crc kubenswrapper[5120]: I0316 18:03:51.641067 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-7mjnz" Mar 16 18:03:51 crc kubenswrapper[5120]: I0316 18:03:51.742231 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="horizon-kuttl-tests/rabbitmq-server-0" Mar 16 18:03:52 crc kubenswrapper[5120]: I0316 18:03:52.138036 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/certified-operators-7mjnz"] Mar 16 18:03:52 crc kubenswrapper[5120]: W0316 18:03:52.140804 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod938a740f_99fe_4d1d_a3ee_251748a15f89.slice/crio-c2a71b6c10c3fd188df6d205f5ad68f445993e009a1f5e55f0b5b96f3ec6d108 WatchSource:0}: Error finding container c2a71b6c10c3fd188df6d205f5ad68f445993e009a1f5e55f0b5b96f3ec6d108: Status 404 returned error can't find the container with id c2a71b6c10c3fd188df6d205f5ad68f445993e009a1f5e55f0b5b96f3ec6d108 Mar 16 18:03:52 crc kubenswrapper[5120]: I0316 18:03:52.211714 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["horizon-kuttl-tests/rabbitmq-server-0"] Mar 16 18:03:52 crc kubenswrapper[5120]: W0316 18:03:52.213519 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7decf9bf_957e_4b6b_8864_da4761ca69cb.slice/crio-ab78dc1cf012e0e119b71da85c2f1c557c9086fb7bfc3aa19bae753d1bdba288 WatchSource:0}: Error finding container ab78dc1cf012e0e119b71da85c2f1c557c9086fb7bfc3aa19bae753d1bdba288: Status 404 returned error can't find the container with id ab78dc1cf012e0e119b71da85c2f1c557c9086fb7bfc3aa19bae753d1bdba288 Mar 16 18:03:52 crc kubenswrapper[5120]: I0316 18:03:52.311276 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="horizon-kuttl-tests/rabbitmq-server-0" event={"ID":"7decf9bf-957e-4b6b-8864-da4761ca69cb","Type":"ContainerStarted","Data":"ab78dc1cf012e0e119b71da85c2f1c557c9086fb7bfc3aa19bae753d1bdba288"} Mar 16 18:03:52 crc kubenswrapper[5120]: I0316 18:03:52.314046 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-7mjnz" event={"ID":"938a740f-99fe-4d1d-a3ee-251748a15f89","Type":"ContainerStarted","Data":"8e7fc030d60ff48b86d4181bb291c7afcc30064460b693ec38f366a9330d4a66"} Mar 16 18:03:52 crc kubenswrapper[5120]: I0316 18:03:52.314110 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-7mjnz" event={"ID":"938a740f-99fe-4d1d-a3ee-251748a15f89","Type":"ContainerStarted","Data":"c2a71b6c10c3fd188df6d205f5ad68f445993e009a1f5e55f0b5b96f3ec6d108"} Mar 16 18:03:53 crc kubenswrapper[5120]: I0316 18:03:53.324419 5120 generic.go:358] "Generic (PLEG): container finished" podID="938a740f-99fe-4d1d-a3ee-251748a15f89" containerID="8e7fc030d60ff48b86d4181bb291c7afcc30064460b693ec38f366a9330d4a66" exitCode=0 Mar 16 18:03:53 crc kubenswrapper[5120]: I0316 18:03:53.324850 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-7mjnz" event={"ID":"938a740f-99fe-4d1d-a3ee-251748a15f89","Type":"ContainerDied","Data":"8e7fc030d60ff48b86d4181bb291c7afcc30064460b693ec38f366a9330d4a66"} Mar 16 18:03:53 crc kubenswrapper[5120]: I0316 18:03:53.324877 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-7mjnz" event={"ID":"938a740f-99fe-4d1d-a3ee-251748a15f89","Type":"ContainerStarted","Data":"62710256fa6a311c7794939a303301ca88561632a2fbb9e9fda16bda0eeb6ed6"} Mar 16 18:03:54 crc kubenswrapper[5120]: I0316 18:03:54.336068 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="horizon-kuttl-tests/rabbitmq-server-0" event={"ID":"7decf9bf-957e-4b6b-8864-da4761ca69cb","Type":"ContainerStarted","Data":"87a20c9b7558d4bbe9dafeaea6a8b020527776c718d80dfa93dab528ddc5880e"} Mar 16 18:03:54 crc kubenswrapper[5120]: I0316 18:03:54.338300 5120 generic.go:358] "Generic (PLEG): container finished" podID="938a740f-99fe-4d1d-a3ee-251748a15f89" containerID="62710256fa6a311c7794939a303301ca88561632a2fbb9e9fda16bda0eeb6ed6" exitCode=0 Mar 16 18:03:54 crc kubenswrapper[5120]: I0316 18:03:54.338345 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-7mjnz" event={"ID":"938a740f-99fe-4d1d-a3ee-251748a15f89","Type":"ContainerDied","Data":"62710256fa6a311c7794939a303301ca88561632a2fbb9e9fda16bda0eeb6ed6"} Mar 16 18:03:55 crc kubenswrapper[5120]: I0316 18:03:55.349819 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-7mjnz" event={"ID":"938a740f-99fe-4d1d-a3ee-251748a15f89","Type":"ContainerStarted","Data":"d5ac279a65be0060510cc0f5b33b3992d1c5f5662a0cfc8f201753f7dcea2850"} Mar 16 18:03:55 crc kubenswrapper[5120]: I0316 18:03:55.369949 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/certified-operators-7mjnz" podStartSLOduration=3.711655586 podStartE2EDuration="4.369934493s" podCreationTimestamp="2026-03-16 18:03:51 +0000 UTC" firstStartedPulling="2026-03-16 18:03:52.315700115 +0000 UTC m=+9134.469631772" lastFinishedPulling="2026-03-16 18:03:52.973979022 +0000 UTC m=+9135.127910679" observedRunningTime="2026-03-16 18:03:55.366162051 +0000 UTC m=+9137.520093708" watchObservedRunningTime="2026-03-16 18:03:55.369934493 +0000 UTC m=+9137.523866150" Mar 16 18:04:00 crc kubenswrapper[5120]: I0316 18:04:00.132548 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-infra/auto-csr-approver-29561404-p9nzn"] Mar 16 18:04:00 crc kubenswrapper[5120]: I0316 18:04:00.151435 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561404-p9nzn" Mar 16 18:04:00 crc kubenswrapper[5120]: I0316 18:04:00.154755 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"openshift-service-ca.crt\"" Mar 16 18:04:00 crc kubenswrapper[5120]: I0316 18:04:00.155091 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"kube-root-ca.crt\"" Mar 16 18:04:00 crc kubenswrapper[5120]: I0316 18:04:00.156144 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-infra\"/\"csr-approver-sa-dockercfg-x2nsz\"" Mar 16 18:04:00 crc kubenswrapper[5120]: I0316 18:04:00.158945 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561404-p9nzn"] Mar 16 18:04:00 crc kubenswrapper[5120]: I0316 18:04:00.171806 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbb95\" (UniqueName: \"kubernetes.io/projected/41c1333f-bd13-4fac-a11f-82e01a9997ce-kube-api-access-vbb95\") pod \"auto-csr-approver-29561404-p9nzn\" (UID: \"41c1333f-bd13-4fac-a11f-82e01a9997ce\") " pod="openshift-infra/auto-csr-approver-29561404-p9nzn" Mar 16 18:04:00 crc kubenswrapper[5120]: I0316 18:04:00.275417 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vbb95\" (UniqueName: \"kubernetes.io/projected/41c1333f-bd13-4fac-a11f-82e01a9997ce-kube-api-access-vbb95\") pod \"auto-csr-approver-29561404-p9nzn\" (UID: \"41c1333f-bd13-4fac-a11f-82e01a9997ce\") " pod="openshift-infra/auto-csr-approver-29561404-p9nzn" Mar 16 18:04:00 crc kubenswrapper[5120]: I0316 18:04:00.301388 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbb95\" (UniqueName: \"kubernetes.io/projected/41c1333f-bd13-4fac-a11f-82e01a9997ce-kube-api-access-vbb95\") pod \"auto-csr-approver-29561404-p9nzn\" (UID: \"41c1333f-bd13-4fac-a11f-82e01a9997ce\") " pod="openshift-infra/auto-csr-approver-29561404-p9nzn" Mar 16 18:04:00 crc kubenswrapper[5120]: I0316 18:04:00.474318 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561404-p9nzn" Mar 16 18:04:00 crc kubenswrapper[5120]: I0316 18:04:00.928491 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561404-p9nzn"] Mar 16 18:04:01 crc kubenswrapper[5120]: I0316 18:04:01.401522 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561404-p9nzn" event={"ID":"41c1333f-bd13-4fac-a11f-82e01a9997ce","Type":"ContainerStarted","Data":"6014c9205d68608a6fe68b6f7cfe507e3f3c8c46423842eea51fcb55ee658d46"} Mar 16 18:04:01 crc kubenswrapper[5120]: I0316 18:04:01.641526 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-marketplace/certified-operators-7mjnz" Mar 16 18:04:01 crc kubenswrapper[5120]: I0316 18:04:01.642179 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/certified-operators-7mjnz" Mar 16 18:04:01 crc kubenswrapper[5120]: I0316 18:04:01.696083 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/certified-operators-7mjnz" Mar 16 18:04:02 crc kubenswrapper[5120]: I0316 18:04:02.212946 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-operators/keystone-operator-controller-manager-5f47546649-l45dt"] Mar 16 18:04:02 crc kubenswrapper[5120]: I0316 18:04:02.219189 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/keystone-operator-controller-manager-5f47546649-l45dt" Mar 16 18:04:02 crc kubenswrapper[5120]: I0316 18:04:02.221579 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-operators\"/\"keystone-operator-controller-manager-service-cert\"" Mar 16 18:04:02 crc kubenswrapper[5120]: I0316 18:04:02.222086 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-operators\"/\"keystone-operator-controller-manager-dockercfg-929bf\"" Mar 16 18:04:02 crc kubenswrapper[5120]: I0316 18:04:02.230742 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/keystone-operator-controller-manager-5f47546649-l45dt"] Mar 16 18:04:02 crc kubenswrapper[5120]: I0316 18:04:02.334039 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4tz2\" (UniqueName: \"kubernetes.io/projected/4012715d-02e3-423b-8e8f-c710881f9988-kube-api-access-g4tz2\") pod \"keystone-operator-controller-manager-5f47546649-l45dt\" (UID: \"4012715d-02e3-423b-8e8f-c710881f9988\") " pod="openstack-operators/keystone-operator-controller-manager-5f47546649-l45dt" Mar 16 18:04:02 crc kubenswrapper[5120]: I0316 18:04:02.334165 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4012715d-02e3-423b-8e8f-c710881f9988-webhook-cert\") pod \"keystone-operator-controller-manager-5f47546649-l45dt\" (UID: \"4012715d-02e3-423b-8e8f-c710881f9988\") " pod="openstack-operators/keystone-operator-controller-manager-5f47546649-l45dt" Mar 16 18:04:02 crc kubenswrapper[5120]: I0316 18:04:02.334240 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4012715d-02e3-423b-8e8f-c710881f9988-apiservice-cert\") pod \"keystone-operator-controller-manager-5f47546649-l45dt\" (UID: \"4012715d-02e3-423b-8e8f-c710881f9988\") " pod="openstack-operators/keystone-operator-controller-manager-5f47546649-l45dt" Mar 16 18:04:02 crc kubenswrapper[5120]: I0316 18:04:02.436039 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4012715d-02e3-423b-8e8f-c710881f9988-webhook-cert\") pod \"keystone-operator-controller-manager-5f47546649-l45dt\" (UID: \"4012715d-02e3-423b-8e8f-c710881f9988\") " pod="openstack-operators/keystone-operator-controller-manager-5f47546649-l45dt" Mar 16 18:04:02 crc kubenswrapper[5120]: I0316 18:04:02.436153 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4012715d-02e3-423b-8e8f-c710881f9988-apiservice-cert\") pod \"keystone-operator-controller-manager-5f47546649-l45dt\" (UID: \"4012715d-02e3-423b-8e8f-c710881f9988\") " pod="openstack-operators/keystone-operator-controller-manager-5f47546649-l45dt" Mar 16 18:04:02 crc kubenswrapper[5120]: I0316 18:04:02.436544 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g4tz2\" (UniqueName: \"kubernetes.io/projected/4012715d-02e3-423b-8e8f-c710881f9988-kube-api-access-g4tz2\") pod \"keystone-operator-controller-manager-5f47546649-l45dt\" (UID: \"4012715d-02e3-423b-8e8f-c710881f9988\") " pod="openstack-operators/keystone-operator-controller-manager-5f47546649-l45dt" Mar 16 18:04:02 crc kubenswrapper[5120]: I0316 18:04:02.443939 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4012715d-02e3-423b-8e8f-c710881f9988-apiservice-cert\") pod \"keystone-operator-controller-manager-5f47546649-l45dt\" (UID: \"4012715d-02e3-423b-8e8f-c710881f9988\") " pod="openstack-operators/keystone-operator-controller-manager-5f47546649-l45dt" Mar 16 18:04:02 crc kubenswrapper[5120]: I0316 18:04:02.447425 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4012715d-02e3-423b-8e8f-c710881f9988-webhook-cert\") pod \"keystone-operator-controller-manager-5f47546649-l45dt\" (UID: \"4012715d-02e3-423b-8e8f-c710881f9988\") " pod="openstack-operators/keystone-operator-controller-manager-5f47546649-l45dt" Mar 16 18:04:02 crc kubenswrapper[5120]: I0316 18:04:02.474972 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4tz2\" (UniqueName: \"kubernetes.io/projected/4012715d-02e3-423b-8e8f-c710881f9988-kube-api-access-g4tz2\") pod \"keystone-operator-controller-manager-5f47546649-l45dt\" (UID: \"4012715d-02e3-423b-8e8f-c710881f9988\") " pod="openstack-operators/keystone-operator-controller-manager-5f47546649-l45dt" Mar 16 18:04:02 crc kubenswrapper[5120]: I0316 18:04:02.480055 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/certified-operators-7mjnz" Mar 16 18:04:02 crc kubenswrapper[5120]: I0316 18:04:02.539079 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/keystone-operator-controller-manager-5f47546649-l45dt" Mar 16 18:04:02 crc kubenswrapper[5120]: I0316 18:04:02.664982 5120 scope.go:117] "RemoveContainer" containerID="fa578cadb98a23319854b9fc54966313bbc1cee64f90cc75e1f951be3cb08e36" Mar 16 18:04:02 crc kubenswrapper[5120]: E0316 18:04:02.665431 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 18:04:03 crc kubenswrapper[5120]: I0316 18:04:03.039528 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/keystone-operator-controller-manager-5f47546649-l45dt"] Mar 16 18:04:03 crc kubenswrapper[5120]: W0316 18:04:03.048033 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4012715d_02e3_423b_8e8f_c710881f9988.slice/crio-1f6e8eb93b4efdfd260c621505b2bd123b8328e1012804da199d43651bd895c7 WatchSource:0}: Error finding container 1f6e8eb93b4efdfd260c621505b2bd123b8328e1012804da199d43651bd895c7: Status 404 returned error can't find the container with id 1f6e8eb93b4efdfd260c621505b2bd123b8328e1012804da199d43651bd895c7 Mar 16 18:04:03 crc kubenswrapper[5120]: I0316 18:04:03.434911 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/keystone-operator-controller-manager-5f47546649-l45dt" event={"ID":"4012715d-02e3-423b-8e8f-c710881f9988","Type":"ContainerStarted","Data":"fa5c0333c28b4d66b998741d28c76b4e443c62215c62e96f9d34f773eb8c0cda"} Mar 16 18:04:03 crc kubenswrapper[5120]: I0316 18:04:03.434961 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/keystone-operator-controller-manager-5f47546649-l45dt" event={"ID":"4012715d-02e3-423b-8e8f-c710881f9988","Type":"ContainerStarted","Data":"1f6e8eb93b4efdfd260c621505b2bd123b8328e1012804da199d43651bd895c7"} Mar 16 18:04:03 crc kubenswrapper[5120]: I0316 18:04:03.435210 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-operators/keystone-operator-controller-manager-5f47546649-l45dt" Mar 16 18:04:03 crc kubenswrapper[5120]: I0316 18:04:03.437001 5120 generic.go:358] "Generic (PLEG): container finished" podID="41c1333f-bd13-4fac-a11f-82e01a9997ce" containerID="2ad4716c90d1a5ccead7b23ca502421ad8f670b8feda902da4fac080bb3c0fa8" exitCode=0 Mar 16 18:04:03 crc kubenswrapper[5120]: I0316 18:04:03.437640 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561404-p9nzn" event={"ID":"41c1333f-bd13-4fac-a11f-82e01a9997ce","Type":"ContainerDied","Data":"2ad4716c90d1a5ccead7b23ca502421ad8f670b8feda902da4fac080bb3c0fa8"} Mar 16 18:04:03 crc kubenswrapper[5120]: I0316 18:04:03.468164 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/keystone-operator-controller-manager-5f47546649-l45dt" podStartSLOduration=1.468152462 podStartE2EDuration="1.468152462s" podCreationTimestamp="2026-03-16 18:04:02 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 18:04:03.464276017 +0000 UTC m=+9145.618207674" watchObservedRunningTime="2026-03-16 18:04:03.468152462 +0000 UTC m=+9145.622084119" Mar 16 18:04:04 crc kubenswrapper[5120]: I0316 18:04:04.740097 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561404-p9nzn" Mar 16 18:04:04 crc kubenswrapper[5120]: I0316 18:04:04.900200 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vbb95\" (UniqueName: \"kubernetes.io/projected/41c1333f-bd13-4fac-a11f-82e01a9997ce-kube-api-access-vbb95\") pod \"41c1333f-bd13-4fac-a11f-82e01a9997ce\" (UID: \"41c1333f-bd13-4fac-a11f-82e01a9997ce\") " Mar 16 18:04:04 crc kubenswrapper[5120]: I0316 18:04:04.906941 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41c1333f-bd13-4fac-a11f-82e01a9997ce-kube-api-access-vbb95" (OuterVolumeSpecName: "kube-api-access-vbb95") pod "41c1333f-bd13-4fac-a11f-82e01a9997ce" (UID: "41c1333f-bd13-4fac-a11f-82e01a9997ce"). InnerVolumeSpecName "kube-api-access-vbb95". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 18:04:05 crc kubenswrapper[5120]: I0316 18:04:05.002676 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vbb95\" (UniqueName: \"kubernetes.io/projected/41c1333f-bd13-4fac-a11f-82e01a9997ce-kube-api-access-vbb95\") on node \"crc\" DevicePath \"\"" Mar 16 18:04:05 crc kubenswrapper[5120]: I0316 18:04:05.454271 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561404-p9nzn" Mar 16 18:04:05 crc kubenswrapper[5120]: I0316 18:04:05.454291 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561404-p9nzn" event={"ID":"41c1333f-bd13-4fac-a11f-82e01a9997ce","Type":"ContainerDied","Data":"6014c9205d68608a6fe68b6f7cfe507e3f3c8c46423842eea51fcb55ee658d46"} Mar 16 18:04:05 crc kubenswrapper[5120]: I0316 18:04:05.454367 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6014c9205d68608a6fe68b6f7cfe507e3f3c8c46423842eea51fcb55ee658d46" Mar 16 18:04:05 crc kubenswrapper[5120]: I0316 18:04:05.818845 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-infra/auto-csr-approver-29561398-986wm"] Mar 16 18:04:05 crc kubenswrapper[5120]: I0316 18:04:05.833135 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-infra/auto-csr-approver-29561398-986wm"] Mar 16 18:04:06 crc kubenswrapper[5120]: I0316 18:04:06.484999 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/certified-operators-7mjnz"] Mar 16 18:04:06 crc kubenswrapper[5120]: I0316 18:04:06.485672 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-marketplace/certified-operators-7mjnz" podUID="938a740f-99fe-4d1d-a3ee-251748a15f89" containerName="registry-server" containerID="cri-o://d5ac279a65be0060510cc0f5b33b3992d1c5f5662a0cfc8f201753f7dcea2850" gracePeriod=2 Mar 16 18:04:06 crc kubenswrapper[5120]: I0316 18:04:06.676899 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1b049008-ff3e-4850-871e-31c2bae44307" path="/var/lib/kubelet/pods/1b049008-ff3e-4850-871e-31c2bae44307/volumes" Mar 16 18:04:06 crc kubenswrapper[5120]: I0316 18:04:06.960584 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-7mjnz" Mar 16 18:04:07 crc kubenswrapper[5120]: I0316 18:04:07.057671 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4c952\" (UniqueName: \"kubernetes.io/projected/938a740f-99fe-4d1d-a3ee-251748a15f89-kube-api-access-4c952\") pod \"938a740f-99fe-4d1d-a3ee-251748a15f89\" (UID: \"938a740f-99fe-4d1d-a3ee-251748a15f89\") " Mar 16 18:04:07 crc kubenswrapper[5120]: I0316 18:04:07.057971 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/938a740f-99fe-4d1d-a3ee-251748a15f89-catalog-content\") pod \"938a740f-99fe-4d1d-a3ee-251748a15f89\" (UID: \"938a740f-99fe-4d1d-a3ee-251748a15f89\") " Mar 16 18:04:07 crc kubenswrapper[5120]: I0316 18:04:07.058437 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/938a740f-99fe-4d1d-a3ee-251748a15f89-utilities\") pod \"938a740f-99fe-4d1d-a3ee-251748a15f89\" (UID: \"938a740f-99fe-4d1d-a3ee-251748a15f89\") " Mar 16 18:04:07 crc kubenswrapper[5120]: I0316 18:04:07.059430 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/938a740f-99fe-4d1d-a3ee-251748a15f89-utilities" (OuterVolumeSpecName: "utilities") pod "938a740f-99fe-4d1d-a3ee-251748a15f89" (UID: "938a740f-99fe-4d1d-a3ee-251748a15f89"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 18:04:07 crc kubenswrapper[5120]: I0316 18:04:07.063522 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/938a740f-99fe-4d1d-a3ee-251748a15f89-kube-api-access-4c952" (OuterVolumeSpecName: "kube-api-access-4c952") pod "938a740f-99fe-4d1d-a3ee-251748a15f89" (UID: "938a740f-99fe-4d1d-a3ee-251748a15f89"). InnerVolumeSpecName "kube-api-access-4c952". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 18:04:07 crc kubenswrapper[5120]: I0316 18:04:07.115018 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/938a740f-99fe-4d1d-a3ee-251748a15f89-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "938a740f-99fe-4d1d-a3ee-251748a15f89" (UID: "938a740f-99fe-4d1d-a3ee-251748a15f89"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 18:04:07 crc kubenswrapper[5120]: I0316 18:04:07.161009 5120 reconciler_common.go:299] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/938a740f-99fe-4d1d-a3ee-251748a15f89-utilities\") on node \"crc\" DevicePath \"\"" Mar 16 18:04:07 crc kubenswrapper[5120]: I0316 18:04:07.161047 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4c952\" (UniqueName: \"kubernetes.io/projected/938a740f-99fe-4d1d-a3ee-251748a15f89-kube-api-access-4c952\") on node \"crc\" DevicePath \"\"" Mar 16 18:04:07 crc kubenswrapper[5120]: I0316 18:04:07.161059 5120 reconciler_common.go:299] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/938a740f-99fe-4d1d-a3ee-251748a15f89-catalog-content\") on node \"crc\" DevicePath \"\"" Mar 16 18:04:07 crc kubenswrapper[5120]: I0316 18:04:07.472036 5120 generic.go:358] "Generic (PLEG): container finished" podID="938a740f-99fe-4d1d-a3ee-251748a15f89" containerID="d5ac279a65be0060510cc0f5b33b3992d1c5f5662a0cfc8f201753f7dcea2850" exitCode=0 Mar 16 18:04:07 crc kubenswrapper[5120]: I0316 18:04:07.472088 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-7mjnz" event={"ID":"938a740f-99fe-4d1d-a3ee-251748a15f89","Type":"ContainerDied","Data":"d5ac279a65be0060510cc0f5b33b3992d1c5f5662a0cfc8f201753f7dcea2850"} Mar 16 18:04:07 crc kubenswrapper[5120]: I0316 18:04:07.472165 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-7mjnz" Mar 16 18:04:07 crc kubenswrapper[5120]: I0316 18:04:07.472453 5120 scope.go:117] "RemoveContainer" containerID="d5ac279a65be0060510cc0f5b33b3992d1c5f5662a0cfc8f201753f7dcea2850" Mar 16 18:04:07 crc kubenswrapper[5120]: I0316 18:04:07.472441 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-7mjnz" event={"ID":"938a740f-99fe-4d1d-a3ee-251748a15f89","Type":"ContainerDied","Data":"c2a71b6c10c3fd188df6d205f5ad68f445993e009a1f5e55f0b5b96f3ec6d108"} Mar 16 18:04:07 crc kubenswrapper[5120]: I0316 18:04:07.499842 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/certified-operators-7mjnz"] Mar 16 18:04:07 crc kubenswrapper[5120]: I0316 18:04:07.502119 5120 scope.go:117] "RemoveContainer" containerID="62710256fa6a311c7794939a303301ca88561632a2fbb9e9fda16bda0eeb6ed6" Mar 16 18:04:07 crc kubenswrapper[5120]: I0316 18:04:07.508259 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/certified-operators-7mjnz"] Mar 16 18:04:07 crc kubenswrapper[5120]: I0316 18:04:07.522145 5120 scope.go:117] "RemoveContainer" containerID="8e7fc030d60ff48b86d4181bb291c7afcc30064460b693ec38f366a9330d4a66" Mar 16 18:04:07 crc kubenswrapper[5120]: I0316 18:04:07.553414 5120 scope.go:117] "RemoveContainer" containerID="d5ac279a65be0060510cc0f5b33b3992d1c5f5662a0cfc8f201753f7dcea2850" Mar 16 18:04:07 crc kubenswrapper[5120]: E0316 18:04:07.553918 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d5ac279a65be0060510cc0f5b33b3992d1c5f5662a0cfc8f201753f7dcea2850\": container with ID starting with d5ac279a65be0060510cc0f5b33b3992d1c5f5662a0cfc8f201753f7dcea2850 not found: ID does not exist" containerID="d5ac279a65be0060510cc0f5b33b3992d1c5f5662a0cfc8f201753f7dcea2850" Mar 16 18:04:07 crc kubenswrapper[5120]: I0316 18:04:07.553957 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5ac279a65be0060510cc0f5b33b3992d1c5f5662a0cfc8f201753f7dcea2850"} err="failed to get container status \"d5ac279a65be0060510cc0f5b33b3992d1c5f5662a0cfc8f201753f7dcea2850\": rpc error: code = NotFound desc = could not find container \"d5ac279a65be0060510cc0f5b33b3992d1c5f5662a0cfc8f201753f7dcea2850\": container with ID starting with d5ac279a65be0060510cc0f5b33b3992d1c5f5662a0cfc8f201753f7dcea2850 not found: ID does not exist" Mar 16 18:04:07 crc kubenswrapper[5120]: I0316 18:04:07.553980 5120 scope.go:117] "RemoveContainer" containerID="62710256fa6a311c7794939a303301ca88561632a2fbb9e9fda16bda0eeb6ed6" Mar 16 18:04:07 crc kubenswrapper[5120]: E0316 18:04:07.554281 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"62710256fa6a311c7794939a303301ca88561632a2fbb9e9fda16bda0eeb6ed6\": container with ID starting with 62710256fa6a311c7794939a303301ca88561632a2fbb9e9fda16bda0eeb6ed6 not found: ID does not exist" containerID="62710256fa6a311c7794939a303301ca88561632a2fbb9e9fda16bda0eeb6ed6" Mar 16 18:04:07 crc kubenswrapper[5120]: I0316 18:04:07.554305 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62710256fa6a311c7794939a303301ca88561632a2fbb9e9fda16bda0eeb6ed6"} err="failed to get container status \"62710256fa6a311c7794939a303301ca88561632a2fbb9e9fda16bda0eeb6ed6\": rpc error: code = NotFound desc = could not find container \"62710256fa6a311c7794939a303301ca88561632a2fbb9e9fda16bda0eeb6ed6\": container with ID starting with 62710256fa6a311c7794939a303301ca88561632a2fbb9e9fda16bda0eeb6ed6 not found: ID does not exist" Mar 16 18:04:07 crc kubenswrapper[5120]: I0316 18:04:07.554319 5120 scope.go:117] "RemoveContainer" containerID="8e7fc030d60ff48b86d4181bb291c7afcc30064460b693ec38f366a9330d4a66" Mar 16 18:04:07 crc kubenswrapper[5120]: E0316 18:04:07.554612 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e7fc030d60ff48b86d4181bb291c7afcc30064460b693ec38f366a9330d4a66\": container with ID starting with 8e7fc030d60ff48b86d4181bb291c7afcc30064460b693ec38f366a9330d4a66 not found: ID does not exist" containerID="8e7fc030d60ff48b86d4181bb291c7afcc30064460b693ec38f366a9330d4a66" Mar 16 18:04:07 crc kubenswrapper[5120]: I0316 18:04:07.554636 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e7fc030d60ff48b86d4181bb291c7afcc30064460b693ec38f366a9330d4a66"} err="failed to get container status \"8e7fc030d60ff48b86d4181bb291c7afcc30064460b693ec38f366a9330d4a66\": rpc error: code = NotFound desc = could not find container \"8e7fc030d60ff48b86d4181bb291c7afcc30064460b693ec38f366a9330d4a66\": container with ID starting with 8e7fc030d60ff48b86d4181bb291c7afcc30064460b693ec38f366a9330d4a66 not found: ID does not exist" Mar 16 18:04:07 crc kubenswrapper[5120]: E0316 18:04:07.736073 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1110275 actualBytes=10240 Mar 16 18:04:08 crc kubenswrapper[5120]: I0316 18:04:08.671893 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="938a740f-99fe-4d1d-a3ee-251748a15f89" path="/var/lib/kubelet/pods/938a740f-99fe-4d1d-a3ee-251748a15f89/volumes" Mar 16 18:04:10 crc kubenswrapper[5120]: I0316 18:04:10.889749 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-operators-dt65j"] Mar 16 18:04:10 crc kubenswrapper[5120]: I0316 18:04:10.890800 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="938a740f-99fe-4d1d-a3ee-251748a15f89" containerName="registry-server" Mar 16 18:04:10 crc kubenswrapper[5120]: I0316 18:04:10.890813 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="938a740f-99fe-4d1d-a3ee-251748a15f89" containerName="registry-server" Mar 16 18:04:10 crc kubenswrapper[5120]: I0316 18:04:10.890830 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="938a740f-99fe-4d1d-a3ee-251748a15f89" containerName="extract-content" Mar 16 18:04:10 crc kubenswrapper[5120]: I0316 18:04:10.890836 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="938a740f-99fe-4d1d-a3ee-251748a15f89" containerName="extract-content" Mar 16 18:04:10 crc kubenswrapper[5120]: I0316 18:04:10.890857 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41c1333f-bd13-4fac-a11f-82e01a9997ce" containerName="oc" Mar 16 18:04:10 crc kubenswrapper[5120]: I0316 18:04:10.890863 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="41c1333f-bd13-4fac-a11f-82e01a9997ce" containerName="oc" Mar 16 18:04:10 crc kubenswrapper[5120]: I0316 18:04:10.890881 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="938a740f-99fe-4d1d-a3ee-251748a15f89" containerName="extract-utilities" Mar 16 18:04:10 crc kubenswrapper[5120]: I0316 18:04:10.890886 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="938a740f-99fe-4d1d-a3ee-251748a15f89" containerName="extract-utilities" Mar 16 18:04:10 crc kubenswrapper[5120]: I0316 18:04:10.891011 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="938a740f-99fe-4d1d-a3ee-251748a15f89" containerName="registry-server" Mar 16 18:04:10 crc kubenswrapper[5120]: I0316 18:04:10.891031 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="41c1333f-bd13-4fac-a11f-82e01a9997ce" containerName="oc" Mar 16 18:04:10 crc kubenswrapper[5120]: I0316 18:04:10.909840 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-dt65j"] Mar 16 18:04:10 crc kubenswrapper[5120]: I0316 18:04:10.910000 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-dt65j" Mar 16 18:04:11 crc kubenswrapper[5120]: I0316 18:04:11.046290 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/ea3b137f-2201-4df8-ae80-e72ebdfc3bc0-utilities\") pod \"redhat-operators-dt65j\" (UID: \"ea3b137f-2201-4df8-ae80-e72ebdfc3bc0\") " pod="openshift-marketplace/redhat-operators-dt65j" Mar 16 18:04:11 crc kubenswrapper[5120]: I0316 18:04:11.046484 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/ea3b137f-2201-4df8-ae80-e72ebdfc3bc0-catalog-content\") pod \"redhat-operators-dt65j\" (UID: \"ea3b137f-2201-4df8-ae80-e72ebdfc3bc0\") " pod="openshift-marketplace/redhat-operators-dt65j" Mar 16 18:04:11 crc kubenswrapper[5120]: I0316 18:04:11.046660 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6v7n\" (UniqueName: \"kubernetes.io/projected/ea3b137f-2201-4df8-ae80-e72ebdfc3bc0-kube-api-access-w6v7n\") pod \"redhat-operators-dt65j\" (UID: \"ea3b137f-2201-4df8-ae80-e72ebdfc3bc0\") " pod="openshift-marketplace/redhat-operators-dt65j" Mar 16 18:04:11 crc kubenswrapper[5120]: I0316 18:04:11.148535 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/ea3b137f-2201-4df8-ae80-e72ebdfc3bc0-catalog-content\") pod \"redhat-operators-dt65j\" (UID: \"ea3b137f-2201-4df8-ae80-e72ebdfc3bc0\") " pod="openshift-marketplace/redhat-operators-dt65j" Mar 16 18:04:11 crc kubenswrapper[5120]: I0316 18:04:11.148658 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w6v7n\" (UniqueName: \"kubernetes.io/projected/ea3b137f-2201-4df8-ae80-e72ebdfc3bc0-kube-api-access-w6v7n\") pod \"redhat-operators-dt65j\" (UID: \"ea3b137f-2201-4df8-ae80-e72ebdfc3bc0\") " pod="openshift-marketplace/redhat-operators-dt65j" Mar 16 18:04:11 crc kubenswrapper[5120]: I0316 18:04:11.148944 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/ea3b137f-2201-4df8-ae80-e72ebdfc3bc0-utilities\") pod \"redhat-operators-dt65j\" (UID: \"ea3b137f-2201-4df8-ae80-e72ebdfc3bc0\") " pod="openshift-marketplace/redhat-operators-dt65j" Mar 16 18:04:11 crc kubenswrapper[5120]: I0316 18:04:11.149491 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/ea3b137f-2201-4df8-ae80-e72ebdfc3bc0-catalog-content\") pod \"redhat-operators-dt65j\" (UID: \"ea3b137f-2201-4df8-ae80-e72ebdfc3bc0\") " pod="openshift-marketplace/redhat-operators-dt65j" Mar 16 18:04:11 crc kubenswrapper[5120]: I0316 18:04:11.149664 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/ea3b137f-2201-4df8-ae80-e72ebdfc3bc0-utilities\") pod \"redhat-operators-dt65j\" (UID: \"ea3b137f-2201-4df8-ae80-e72ebdfc3bc0\") " pod="openshift-marketplace/redhat-operators-dt65j" Mar 16 18:04:11 crc kubenswrapper[5120]: I0316 18:04:11.172441 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6v7n\" (UniqueName: \"kubernetes.io/projected/ea3b137f-2201-4df8-ae80-e72ebdfc3bc0-kube-api-access-w6v7n\") pod \"redhat-operators-dt65j\" (UID: \"ea3b137f-2201-4df8-ae80-e72ebdfc3bc0\") " pod="openshift-marketplace/redhat-operators-dt65j" Mar 16 18:04:11 crc kubenswrapper[5120]: I0316 18:04:11.240633 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-dt65j" Mar 16 18:04:11 crc kubenswrapper[5120]: I0316 18:04:11.724124 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-dt65j"] Mar 16 18:04:12 crc kubenswrapper[5120]: I0316 18:04:12.509788 5120 generic.go:358] "Generic (PLEG): container finished" podID="ea3b137f-2201-4df8-ae80-e72ebdfc3bc0" containerID="ad84140d1a2fea6cce50b5523613ca8890490ffcb224aa97afefe0380a386f81" exitCode=0 Mar 16 18:04:12 crc kubenswrapper[5120]: I0316 18:04:12.509879 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-dt65j" event={"ID":"ea3b137f-2201-4df8-ae80-e72ebdfc3bc0","Type":"ContainerDied","Data":"ad84140d1a2fea6cce50b5523613ca8890490ffcb224aa97afefe0380a386f81"} Mar 16 18:04:12 crc kubenswrapper[5120]: I0316 18:04:12.510320 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-dt65j" event={"ID":"ea3b137f-2201-4df8-ae80-e72ebdfc3bc0","Type":"ContainerStarted","Data":"0c4a7a5fc0ea720553d29ea83d35b2fc1b7abdc7007ef60fbb41f58b140425ad"} Mar 16 18:04:13 crc kubenswrapper[5120]: I0316 18:04:13.664248 5120 scope.go:117] "RemoveContainer" containerID="fa578cadb98a23319854b9fc54966313bbc1cee64f90cc75e1f951be3cb08e36" Mar 16 18:04:13 crc kubenswrapper[5120]: E0316 18:04:13.664532 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 18:04:14 crc kubenswrapper[5120]: I0316 18:04:14.449942 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/keystone-operator-controller-manager-5f47546649-l45dt" Mar 16 18:04:14 crc kubenswrapper[5120]: I0316 18:04:14.536469 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-dt65j" event={"ID":"ea3b137f-2201-4df8-ae80-e72ebdfc3bc0","Type":"ContainerStarted","Data":"74daffeb5306fc53227367fc722c56ae3be4899ba94b22a78635a27f12e1c0a3"} Mar 16 18:04:15 crc kubenswrapper[5120]: I0316 18:04:15.550053 5120 generic.go:358] "Generic (PLEG): container finished" podID="ea3b137f-2201-4df8-ae80-e72ebdfc3bc0" containerID="74daffeb5306fc53227367fc722c56ae3be4899ba94b22a78635a27f12e1c0a3" exitCode=0 Mar 16 18:04:15 crc kubenswrapper[5120]: I0316 18:04:15.550165 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-dt65j" event={"ID":"ea3b137f-2201-4df8-ae80-e72ebdfc3bc0","Type":"ContainerDied","Data":"74daffeb5306fc53227367fc722c56ae3be4899ba94b22a78635a27f12e1c0a3"} Mar 16 18:04:16 crc kubenswrapper[5120]: I0316 18:04:16.563105 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-dt65j" event={"ID":"ea3b137f-2201-4df8-ae80-e72ebdfc3bc0","Type":"ContainerStarted","Data":"ccb8bcefe4511e073660225a70075f769caa37b26014be390ac1e999c73dc5ac"} Mar 16 18:04:16 crc kubenswrapper[5120]: I0316 18:04:16.587643 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/redhat-operators-dt65j" podStartSLOduration=4.956905281 podStartE2EDuration="6.587624851s" podCreationTimestamp="2026-03-16 18:04:10 +0000 UTC" firstStartedPulling="2026-03-16 18:04:12.510978925 +0000 UTC m=+9154.664910592" lastFinishedPulling="2026-03-16 18:04:14.141698505 +0000 UTC m=+9156.295630162" observedRunningTime="2026-03-16 18:04:16.584974659 +0000 UTC m=+9158.738906336" watchObservedRunningTime="2026-03-16 18:04:16.587624851 +0000 UTC m=+9158.741556508" Mar 16 18:04:18 crc kubenswrapper[5120]: I0316 18:04:18.894136 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/community-operators-t6qpc"] Mar 16 18:04:18 crc kubenswrapper[5120]: I0316 18:04:18.925979 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/community-operators-t6qpc"] Mar 16 18:04:18 crc kubenswrapper[5120]: I0316 18:04:18.926166 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-t6qpc" Mar 16 18:04:19 crc kubenswrapper[5120]: I0316 18:04:19.051510 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jcd5\" (UniqueName: \"kubernetes.io/projected/1cf498e9-c3f0-4050-b629-e9310751e9fc-kube-api-access-4jcd5\") pod \"community-operators-t6qpc\" (UID: \"1cf498e9-c3f0-4050-b629-e9310751e9fc\") " pod="openshift-marketplace/community-operators-t6qpc" Mar 16 18:04:19 crc kubenswrapper[5120]: I0316 18:04:19.051882 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/1cf498e9-c3f0-4050-b629-e9310751e9fc-catalog-content\") pod \"community-operators-t6qpc\" (UID: \"1cf498e9-c3f0-4050-b629-e9310751e9fc\") " pod="openshift-marketplace/community-operators-t6qpc" Mar 16 18:04:19 crc kubenswrapper[5120]: I0316 18:04:19.052444 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/1cf498e9-c3f0-4050-b629-e9310751e9fc-utilities\") pod \"community-operators-t6qpc\" (UID: \"1cf498e9-c3f0-4050-b629-e9310751e9fc\") " pod="openshift-marketplace/community-operators-t6qpc" Mar 16 18:04:19 crc kubenswrapper[5120]: I0316 18:04:19.155076 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/1cf498e9-c3f0-4050-b629-e9310751e9fc-utilities\") pod \"community-operators-t6qpc\" (UID: \"1cf498e9-c3f0-4050-b629-e9310751e9fc\") " pod="openshift-marketplace/community-operators-t6qpc" Mar 16 18:04:19 crc kubenswrapper[5120]: I0316 18:04:19.155326 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4jcd5\" (UniqueName: \"kubernetes.io/projected/1cf498e9-c3f0-4050-b629-e9310751e9fc-kube-api-access-4jcd5\") pod \"community-operators-t6qpc\" (UID: \"1cf498e9-c3f0-4050-b629-e9310751e9fc\") " pod="openshift-marketplace/community-operators-t6qpc" Mar 16 18:04:19 crc kubenswrapper[5120]: I0316 18:04:19.155436 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/1cf498e9-c3f0-4050-b629-e9310751e9fc-catalog-content\") pod \"community-operators-t6qpc\" (UID: \"1cf498e9-c3f0-4050-b629-e9310751e9fc\") " pod="openshift-marketplace/community-operators-t6qpc" Mar 16 18:04:19 crc kubenswrapper[5120]: I0316 18:04:19.155488 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/1cf498e9-c3f0-4050-b629-e9310751e9fc-utilities\") pod \"community-operators-t6qpc\" (UID: \"1cf498e9-c3f0-4050-b629-e9310751e9fc\") " pod="openshift-marketplace/community-operators-t6qpc" Mar 16 18:04:19 crc kubenswrapper[5120]: I0316 18:04:19.155955 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/1cf498e9-c3f0-4050-b629-e9310751e9fc-catalog-content\") pod \"community-operators-t6qpc\" (UID: \"1cf498e9-c3f0-4050-b629-e9310751e9fc\") " pod="openshift-marketplace/community-operators-t6qpc" Mar 16 18:04:19 crc kubenswrapper[5120]: I0316 18:04:19.180285 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jcd5\" (UniqueName: \"kubernetes.io/projected/1cf498e9-c3f0-4050-b629-e9310751e9fc-kube-api-access-4jcd5\") pod \"community-operators-t6qpc\" (UID: \"1cf498e9-c3f0-4050-b629-e9310751e9fc\") " pod="openshift-marketplace/community-operators-t6qpc" Mar 16 18:04:19 crc kubenswrapper[5120]: I0316 18:04:19.255922 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-t6qpc" Mar 16 18:04:19 crc kubenswrapper[5120]: I0316 18:04:19.739846 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/community-operators-t6qpc"] Mar 16 18:04:19 crc kubenswrapper[5120]: W0316 18:04:19.742089 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cf498e9_c3f0_4050_b629_e9310751e9fc.slice/crio-af7a625980bf4bb320400b8f028336e29207873150d5228cee9353fec9c16694 WatchSource:0}: Error finding container af7a625980bf4bb320400b8f028336e29207873150d5228cee9353fec9c16694: Status 404 returned error can't find the container with id af7a625980bf4bb320400b8f028336e29207873150d5228cee9353fec9c16694 Mar 16 18:04:20 crc kubenswrapper[5120]: I0316 18:04:20.621383 5120 generic.go:358] "Generic (PLEG): container finished" podID="1cf498e9-c3f0-4050-b629-e9310751e9fc" containerID="86cd862cec44f91451feda58f414d5e51c9ff6840fec8874c599bd11d5f21ce2" exitCode=0 Mar 16 18:04:20 crc kubenswrapper[5120]: I0316 18:04:20.621648 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-t6qpc" event={"ID":"1cf498e9-c3f0-4050-b629-e9310751e9fc","Type":"ContainerDied","Data":"86cd862cec44f91451feda58f414d5e51c9ff6840fec8874c599bd11d5f21ce2"} Mar 16 18:04:20 crc kubenswrapper[5120]: I0316 18:04:20.621686 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-t6qpc" event={"ID":"1cf498e9-c3f0-4050-b629-e9310751e9fc","Type":"ContainerStarted","Data":"af7a625980bf4bb320400b8f028336e29207873150d5228cee9353fec9c16694"} Mar 16 18:04:21 crc kubenswrapper[5120]: I0316 18:04:21.241586 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-operators-dt65j" Mar 16 18:04:21 crc kubenswrapper[5120]: I0316 18:04:21.241633 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-marketplace/redhat-operators-dt65j" Mar 16 18:04:22 crc kubenswrapper[5120]: I0316 18:04:22.282171 5120 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-marketplace/redhat-operators-dt65j" podUID="ea3b137f-2201-4df8-ae80-e72ebdfc3bc0" containerName="registry-server" probeResult="failure" output=< Mar 16 18:04:22 crc kubenswrapper[5120]: timeout: failed to connect service ":50051" within 1s Mar 16 18:04:22 crc kubenswrapper[5120]: > Mar 16 18:04:23 crc kubenswrapper[5120]: I0316 18:04:23.400197 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["horizon-kuttl-tests/keystone-db-create-csjbp"] Mar 16 18:04:23 crc kubenswrapper[5120]: I0316 18:04:23.418024 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["horizon-kuttl-tests/keystone-cd08-account-create-update-5bgpc"] Mar 16 18:04:23 crc kubenswrapper[5120]: I0316 18:04:23.418187 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="horizon-kuttl-tests/keystone-db-create-csjbp" Mar 16 18:04:23 crc kubenswrapper[5120]: I0316 18:04:23.422722 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["horizon-kuttl-tests/keystone-db-create-csjbp"] Mar 16 18:04:23 crc kubenswrapper[5120]: I0316 18:04:23.422843 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="horizon-kuttl-tests/keystone-cd08-account-create-update-5bgpc" Mar 16 18:04:23 crc kubenswrapper[5120]: I0316 18:04:23.450950 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"horizon-kuttl-tests\"/\"keystone-db-secret\"" Mar 16 18:04:23 crc kubenswrapper[5120]: I0316 18:04:23.466461 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-796z2\" (UniqueName: \"kubernetes.io/projected/fecee0a1-f617-4a2c-929f-2d37cd6a48c9-kube-api-access-796z2\") pod \"keystone-cd08-account-create-update-5bgpc\" (UID: \"fecee0a1-f617-4a2c-929f-2d37cd6a48c9\") " pod="horizon-kuttl-tests/keystone-cd08-account-create-update-5bgpc" Mar 16 18:04:23 crc kubenswrapper[5120]: I0316 18:04:23.466512 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/fecee0a1-f617-4a2c-929f-2d37cd6a48c9-operator-scripts\") pod \"keystone-cd08-account-create-update-5bgpc\" (UID: \"fecee0a1-f617-4a2c-929f-2d37cd6a48c9\") " pod="horizon-kuttl-tests/keystone-cd08-account-create-update-5bgpc" Mar 16 18:04:23 crc kubenswrapper[5120]: I0316 18:04:23.466876 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s42mk\" (UniqueName: \"kubernetes.io/projected/65b555f1-cd7d-4ed4-b2a3-190445f5291f-kube-api-access-s42mk\") pod \"keystone-db-create-csjbp\" (UID: \"65b555f1-cd7d-4ed4-b2a3-190445f5291f\") " pod="horizon-kuttl-tests/keystone-db-create-csjbp" Mar 16 18:04:23 crc kubenswrapper[5120]: I0316 18:04:23.466942 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/65b555f1-cd7d-4ed4-b2a3-190445f5291f-operator-scripts\") pod \"keystone-db-create-csjbp\" (UID: \"65b555f1-cd7d-4ed4-b2a3-190445f5291f\") " pod="horizon-kuttl-tests/keystone-db-create-csjbp" Mar 16 18:04:23 crc kubenswrapper[5120]: I0316 18:04:23.482380 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["horizon-kuttl-tests/keystone-cd08-account-create-update-5bgpc"] Mar 16 18:04:23 crc kubenswrapper[5120]: I0316 18:04:23.568982 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-796z2\" (UniqueName: \"kubernetes.io/projected/fecee0a1-f617-4a2c-929f-2d37cd6a48c9-kube-api-access-796z2\") pod \"keystone-cd08-account-create-update-5bgpc\" (UID: \"fecee0a1-f617-4a2c-929f-2d37cd6a48c9\") " pod="horizon-kuttl-tests/keystone-cd08-account-create-update-5bgpc" Mar 16 18:04:23 crc kubenswrapper[5120]: I0316 18:04:23.569045 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/fecee0a1-f617-4a2c-929f-2d37cd6a48c9-operator-scripts\") pod \"keystone-cd08-account-create-update-5bgpc\" (UID: \"fecee0a1-f617-4a2c-929f-2d37cd6a48c9\") " pod="horizon-kuttl-tests/keystone-cd08-account-create-update-5bgpc" Mar 16 18:04:23 crc kubenswrapper[5120]: I0316 18:04:23.569190 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s42mk\" (UniqueName: \"kubernetes.io/projected/65b555f1-cd7d-4ed4-b2a3-190445f5291f-kube-api-access-s42mk\") pod \"keystone-db-create-csjbp\" (UID: \"65b555f1-cd7d-4ed4-b2a3-190445f5291f\") " pod="horizon-kuttl-tests/keystone-db-create-csjbp" Mar 16 18:04:23 crc kubenswrapper[5120]: I0316 18:04:23.569227 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/65b555f1-cd7d-4ed4-b2a3-190445f5291f-operator-scripts\") pod \"keystone-db-create-csjbp\" (UID: \"65b555f1-cd7d-4ed4-b2a3-190445f5291f\") " pod="horizon-kuttl-tests/keystone-db-create-csjbp" Mar 16 18:04:23 crc kubenswrapper[5120]: I0316 18:04:23.570057 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/65b555f1-cd7d-4ed4-b2a3-190445f5291f-operator-scripts\") pod \"keystone-db-create-csjbp\" (UID: \"65b555f1-cd7d-4ed4-b2a3-190445f5291f\") " pod="horizon-kuttl-tests/keystone-db-create-csjbp" Mar 16 18:04:23 crc kubenswrapper[5120]: I0316 18:04:23.570067 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/fecee0a1-f617-4a2c-929f-2d37cd6a48c9-operator-scripts\") pod \"keystone-cd08-account-create-update-5bgpc\" (UID: \"fecee0a1-f617-4a2c-929f-2d37cd6a48c9\") " pod="horizon-kuttl-tests/keystone-cd08-account-create-update-5bgpc" Mar 16 18:04:23 crc kubenswrapper[5120]: I0316 18:04:23.585882 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s42mk\" (UniqueName: \"kubernetes.io/projected/65b555f1-cd7d-4ed4-b2a3-190445f5291f-kube-api-access-s42mk\") pod \"keystone-db-create-csjbp\" (UID: \"65b555f1-cd7d-4ed4-b2a3-190445f5291f\") " pod="horizon-kuttl-tests/keystone-db-create-csjbp" Mar 16 18:04:23 crc kubenswrapper[5120]: I0316 18:04:23.586907 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-796z2\" (UniqueName: \"kubernetes.io/projected/fecee0a1-f617-4a2c-929f-2d37cd6a48c9-kube-api-access-796z2\") pod \"keystone-cd08-account-create-update-5bgpc\" (UID: \"fecee0a1-f617-4a2c-929f-2d37cd6a48c9\") " pod="horizon-kuttl-tests/keystone-cd08-account-create-update-5bgpc" Mar 16 18:04:23 crc kubenswrapper[5120]: I0316 18:04:23.771357 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="horizon-kuttl-tests/keystone-db-create-csjbp" Mar 16 18:04:23 crc kubenswrapper[5120]: I0316 18:04:23.788899 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="horizon-kuttl-tests/keystone-cd08-account-create-update-5bgpc" Mar 16 18:04:24 crc kubenswrapper[5120]: I0316 18:04:24.575543 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["horizon-kuttl-tests/keystone-db-create-csjbp"] Mar 16 18:04:24 crc kubenswrapper[5120]: I0316 18:04:24.649803 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["horizon-kuttl-tests/keystone-cd08-account-create-update-5bgpc"] Mar 16 18:04:24 crc kubenswrapper[5120]: I0316 18:04:24.662057 5120 generic.go:358] "Generic (PLEG): container finished" podID="1cf498e9-c3f0-4050-b629-e9310751e9fc" containerID="753dadc81f9902f9cc490b7c8c88ae8e2ff9f3903fa7b1efbb6ffaab6766a44c" exitCode=0 Mar 16 18:04:24 crc kubenswrapper[5120]: I0316 18:04:24.662279 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-t6qpc" event={"ID":"1cf498e9-c3f0-4050-b629-e9310751e9fc","Type":"ContainerDied","Data":"753dadc81f9902f9cc490b7c8c88ae8e2ff9f3903fa7b1efbb6ffaab6766a44c"} Mar 16 18:04:24 crc kubenswrapper[5120]: I0316 18:04:24.675079 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="horizon-kuttl-tests/keystone-db-create-csjbp" event={"ID":"65b555f1-cd7d-4ed4-b2a3-190445f5291f","Type":"ContainerStarted","Data":"a30615efe9b198a39592b7490ff39bd9f0bad17bd2b0f21d8ea17acee3ff2d17"} Mar 16 18:04:25 crc kubenswrapper[5120]: I0316 18:04:25.685698 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="horizon-kuttl-tests/keystone-db-create-csjbp" event={"ID":"65b555f1-cd7d-4ed4-b2a3-190445f5291f","Type":"ContainerStarted","Data":"818819181fecca0343ed0f17705ac25c034a94121e38e8873886f77a2450f10f"} Mar 16 18:04:25 crc kubenswrapper[5120]: I0316 18:04:25.688245 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="horizon-kuttl-tests/keystone-cd08-account-create-update-5bgpc" event={"ID":"fecee0a1-f617-4a2c-929f-2d37cd6a48c9","Type":"ContainerStarted","Data":"0a2a04f1c8d91d47e9b5a0fb835b74d83bd43e14b1f5f0029bb30aa8c98995fa"} Mar 16 18:04:25 crc kubenswrapper[5120]: I0316 18:04:25.688285 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="horizon-kuttl-tests/keystone-cd08-account-create-update-5bgpc" event={"ID":"fecee0a1-f617-4a2c-929f-2d37cd6a48c9","Type":"ContainerStarted","Data":"3946dcd62c0f445c5c54c0bdbf75e3ef9e91afd0bfa3a6409f084947d839c480"} Mar 16 18:04:25 crc kubenswrapper[5120]: I0316 18:04:25.692333 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-t6qpc" event={"ID":"1cf498e9-c3f0-4050-b629-e9310751e9fc","Type":"ContainerStarted","Data":"04d3b8fbb8e1394f367ecc936c35edeaa77ea21c5d30f6c375010cd90fdafb49"} Mar 16 18:04:25 crc kubenswrapper[5120]: I0316 18:04:25.721578 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="horizon-kuttl-tests/keystone-db-create-csjbp" podStartSLOduration=2.721559602 podStartE2EDuration="2.721559602s" podCreationTimestamp="2026-03-16 18:04:23 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 18:04:25.702947324 +0000 UTC m=+9167.856878981" watchObservedRunningTime="2026-03-16 18:04:25.721559602 +0000 UTC m=+9167.875491269" Mar 16 18:04:25 crc kubenswrapper[5120]: I0316 18:04:25.737785 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="horizon-kuttl-tests/keystone-cd08-account-create-update-5bgpc" podStartSLOduration=2.737749195 podStartE2EDuration="2.737749195s" podCreationTimestamp="2026-03-16 18:04:23 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 18:04:25.718432877 +0000 UTC m=+9167.872364534" watchObservedRunningTime="2026-03-16 18:04:25.737749195 +0000 UTC m=+9167.891680852" Mar 16 18:04:25 crc kubenswrapper[5120]: I0316 18:04:25.740512 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/community-operators-t6qpc" podStartSLOduration=4.174957579 podStartE2EDuration="7.74049837s" podCreationTimestamp="2026-03-16 18:04:18 +0000 UTC" firstStartedPulling="2026-03-16 18:04:20.62262349 +0000 UTC m=+9162.776555187" lastFinishedPulling="2026-03-16 18:04:24.188164321 +0000 UTC m=+9166.342095978" observedRunningTime="2026-03-16 18:04:25.734633379 +0000 UTC m=+9167.888565036" watchObservedRunningTime="2026-03-16 18:04:25.74049837 +0000 UTC m=+9167.894430027" Mar 16 18:04:26 crc kubenswrapper[5120]: I0316 18:04:26.664335 5120 scope.go:117] "RemoveContainer" containerID="fa578cadb98a23319854b9fc54966313bbc1cee64f90cc75e1f951be3cb08e36" Mar 16 18:04:26 crc kubenswrapper[5120]: E0316 18:04:26.664533 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 18:04:26 crc kubenswrapper[5120]: I0316 18:04:26.701661 5120 generic.go:358] "Generic (PLEG): container finished" podID="65b555f1-cd7d-4ed4-b2a3-190445f5291f" containerID="818819181fecca0343ed0f17705ac25c034a94121e38e8873886f77a2450f10f" exitCode=0 Mar 16 18:04:26 crc kubenswrapper[5120]: I0316 18:04:26.701810 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="horizon-kuttl-tests/keystone-db-create-csjbp" event={"ID":"65b555f1-cd7d-4ed4-b2a3-190445f5291f","Type":"ContainerDied","Data":"818819181fecca0343ed0f17705ac25c034a94121e38e8873886f77a2450f10f"} Mar 16 18:04:26 crc kubenswrapper[5120]: I0316 18:04:26.703238 5120 generic.go:358] "Generic (PLEG): container finished" podID="fecee0a1-f617-4a2c-929f-2d37cd6a48c9" containerID="0a2a04f1c8d91d47e9b5a0fb835b74d83bd43e14b1f5f0029bb30aa8c98995fa" exitCode=0 Mar 16 18:04:26 crc kubenswrapper[5120]: I0316 18:04:26.703387 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="horizon-kuttl-tests/keystone-cd08-account-create-update-5bgpc" event={"ID":"fecee0a1-f617-4a2c-929f-2d37cd6a48c9","Type":"ContainerDied","Data":"0a2a04f1c8d91d47e9b5a0fb835b74d83bd43e14b1f5f0029bb30aa8c98995fa"} Mar 16 18:04:26 crc kubenswrapper[5120]: I0316 18:04:26.706169 5120 generic.go:358] "Generic (PLEG): container finished" podID="7decf9bf-957e-4b6b-8864-da4761ca69cb" containerID="87a20c9b7558d4bbe9dafeaea6a8b020527776c718d80dfa93dab528ddc5880e" exitCode=0 Mar 16 18:04:26 crc kubenswrapper[5120]: I0316 18:04:26.706246 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="horizon-kuttl-tests/rabbitmq-server-0" event={"ID":"7decf9bf-957e-4b6b-8864-da4761ca69cb","Type":"ContainerDied","Data":"87a20c9b7558d4bbe9dafeaea6a8b020527776c718d80dfa93dab528ddc5880e"} Mar 16 18:04:27 crc kubenswrapper[5120]: I0316 18:04:27.710494 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-operators/horizon-operator-index-vzqrf"] Mar 16 18:04:27 crc kubenswrapper[5120]: I0316 18:04:27.729395 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="horizon-kuttl-tests/rabbitmq-server-0" event={"ID":"7decf9bf-957e-4b6b-8864-da4761ca69cb","Type":"ContainerStarted","Data":"0e669d433bf25cfe0d9b815afcb0152c9b8b65eb9e466b5f0536bc0b5d2c7699"} Mar 16 18:04:27 crc kubenswrapper[5120]: I0316 18:04:27.731630 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/horizon-operator-index-vzqrf" Mar 16 18:04:27 crc kubenswrapper[5120]: I0316 18:04:27.731781 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="horizon-kuttl-tests/rabbitmq-server-0" Mar 16 18:04:27 crc kubenswrapper[5120]: I0316 18:04:27.734152 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-operators\"/\"horizon-operator-index-dockercfg-qz88c\"" Mar 16 18:04:27 crc kubenswrapper[5120]: I0316 18:04:27.741309 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/horizon-operator-index-vzqrf"] Mar 16 18:04:27 crc kubenswrapper[5120]: I0316 18:04:27.770252 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="horizon-kuttl-tests/rabbitmq-server-0" podStartSLOduration=37.770224533 podStartE2EDuration="37.770224533s" podCreationTimestamp="2026-03-16 18:03:50 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 18:04:27.755775598 +0000 UTC m=+9169.909707255" watchObservedRunningTime="2026-03-16 18:04:27.770224533 +0000 UTC m=+9169.924156230" Mar 16 18:04:27 crc kubenswrapper[5120]: I0316 18:04:27.891115 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dm775\" (UniqueName: \"kubernetes.io/projected/126b9b6c-84df-4505-a5e9-3973b80ebf6c-kube-api-access-dm775\") pod \"horizon-operator-index-vzqrf\" (UID: \"126b9b6c-84df-4505-a5e9-3973b80ebf6c\") " pod="openstack-operators/horizon-operator-index-vzqrf" Mar 16 18:04:27 crc kubenswrapper[5120]: I0316 18:04:27.992925 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dm775\" (UniqueName: \"kubernetes.io/projected/126b9b6c-84df-4505-a5e9-3973b80ebf6c-kube-api-access-dm775\") pod \"horizon-operator-index-vzqrf\" (UID: \"126b9b6c-84df-4505-a5e9-3973b80ebf6c\") " pod="openstack-operators/horizon-operator-index-vzqrf" Mar 16 18:04:28 crc kubenswrapper[5120]: I0316 18:04:28.022630 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dm775\" (UniqueName: \"kubernetes.io/projected/126b9b6c-84df-4505-a5e9-3973b80ebf6c-kube-api-access-dm775\") pod \"horizon-operator-index-vzqrf\" (UID: \"126b9b6c-84df-4505-a5e9-3973b80ebf6c\") " pod="openstack-operators/horizon-operator-index-vzqrf" Mar 16 18:04:28 crc kubenswrapper[5120]: I0316 18:04:28.057097 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/horizon-operator-index-vzqrf" Mar 16 18:04:28 crc kubenswrapper[5120]: I0316 18:04:28.237047 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="horizon-kuttl-tests/keystone-db-create-csjbp" Mar 16 18:04:28 crc kubenswrapper[5120]: I0316 18:04:28.240843 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="horizon-kuttl-tests/keystone-cd08-account-create-update-5bgpc" Mar 16 18:04:28 crc kubenswrapper[5120]: I0316 18:04:28.409181 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/65b555f1-cd7d-4ed4-b2a3-190445f5291f-operator-scripts\") pod \"65b555f1-cd7d-4ed4-b2a3-190445f5291f\" (UID: \"65b555f1-cd7d-4ed4-b2a3-190445f5291f\") " Mar 16 18:04:28 crc kubenswrapper[5120]: I0316 18:04:28.409654 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-796z2\" (UniqueName: \"kubernetes.io/projected/fecee0a1-f617-4a2c-929f-2d37cd6a48c9-kube-api-access-796z2\") pod \"fecee0a1-f617-4a2c-929f-2d37cd6a48c9\" (UID: \"fecee0a1-f617-4a2c-929f-2d37cd6a48c9\") " Mar 16 18:04:28 crc kubenswrapper[5120]: I0316 18:04:28.409894 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/fecee0a1-f617-4a2c-929f-2d37cd6a48c9-operator-scripts\") pod \"fecee0a1-f617-4a2c-929f-2d37cd6a48c9\" (UID: \"fecee0a1-f617-4a2c-929f-2d37cd6a48c9\") " Mar 16 18:04:28 crc kubenswrapper[5120]: I0316 18:04:28.409715 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/65b555f1-cd7d-4ed4-b2a3-190445f5291f-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "65b555f1-cd7d-4ed4-b2a3-190445f5291f" (UID: "65b555f1-cd7d-4ed4-b2a3-190445f5291f"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 18:04:28 crc kubenswrapper[5120]: I0316 18:04:28.410305 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s42mk\" (UniqueName: \"kubernetes.io/projected/65b555f1-cd7d-4ed4-b2a3-190445f5291f-kube-api-access-s42mk\") pod \"65b555f1-cd7d-4ed4-b2a3-190445f5291f\" (UID: \"65b555f1-cd7d-4ed4-b2a3-190445f5291f\") " Mar 16 18:04:28 crc kubenswrapper[5120]: I0316 18:04:28.410552 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fecee0a1-f617-4a2c-929f-2d37cd6a48c9-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "fecee0a1-f617-4a2c-929f-2d37cd6a48c9" (UID: "fecee0a1-f617-4a2c-929f-2d37cd6a48c9"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 18:04:28 crc kubenswrapper[5120]: I0316 18:04:28.411287 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/65b555f1-cd7d-4ed4-b2a3-190445f5291f-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 18:04:28 crc kubenswrapper[5120]: I0316 18:04:28.411391 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/fecee0a1-f617-4a2c-929f-2d37cd6a48c9-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 18:04:28 crc kubenswrapper[5120]: I0316 18:04:28.415821 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fecee0a1-f617-4a2c-929f-2d37cd6a48c9-kube-api-access-796z2" (OuterVolumeSpecName: "kube-api-access-796z2") pod "fecee0a1-f617-4a2c-929f-2d37cd6a48c9" (UID: "fecee0a1-f617-4a2c-929f-2d37cd6a48c9"). InnerVolumeSpecName "kube-api-access-796z2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 18:04:28 crc kubenswrapper[5120]: I0316 18:04:28.416101 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65b555f1-cd7d-4ed4-b2a3-190445f5291f-kube-api-access-s42mk" (OuterVolumeSpecName: "kube-api-access-s42mk") pod "65b555f1-cd7d-4ed4-b2a3-190445f5291f" (UID: "65b555f1-cd7d-4ed4-b2a3-190445f5291f"). InnerVolumeSpecName "kube-api-access-s42mk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 18:04:28 crc kubenswrapper[5120]: I0316 18:04:28.514058 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-796z2\" (UniqueName: \"kubernetes.io/projected/fecee0a1-f617-4a2c-929f-2d37cd6a48c9-kube-api-access-796z2\") on node \"crc\" DevicePath \"\"" Mar 16 18:04:28 crc kubenswrapper[5120]: I0316 18:04:28.515655 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s42mk\" (UniqueName: \"kubernetes.io/projected/65b555f1-cd7d-4ed4-b2a3-190445f5291f-kube-api-access-s42mk\") on node \"crc\" DevicePath \"\"" Mar 16 18:04:28 crc kubenswrapper[5120]: I0316 18:04:28.545210 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/horizon-operator-index-vzqrf"] Mar 16 18:04:28 crc kubenswrapper[5120]: I0316 18:04:28.726486 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/horizon-operator-index-vzqrf" event={"ID":"126b9b6c-84df-4505-a5e9-3973b80ebf6c","Type":"ContainerStarted","Data":"d34d06ad55564a8de966f22264c9dfb15d874e1c53ef377fbaf4059adc52b925"} Mar 16 18:04:28 crc kubenswrapper[5120]: I0316 18:04:28.728391 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="horizon-kuttl-tests/keystone-db-create-csjbp" event={"ID":"65b555f1-cd7d-4ed4-b2a3-190445f5291f","Type":"ContainerDied","Data":"a30615efe9b198a39592b7490ff39bd9f0bad17bd2b0f21d8ea17acee3ff2d17"} Mar 16 18:04:28 crc kubenswrapper[5120]: I0316 18:04:28.728428 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a30615efe9b198a39592b7490ff39bd9f0bad17bd2b0f21d8ea17acee3ff2d17" Mar 16 18:04:28 crc kubenswrapper[5120]: I0316 18:04:28.728540 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="horizon-kuttl-tests/keystone-db-create-csjbp" Mar 16 18:04:28 crc kubenswrapper[5120]: I0316 18:04:28.731385 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="horizon-kuttl-tests/keystone-cd08-account-create-update-5bgpc" Mar 16 18:04:28 crc kubenswrapper[5120]: I0316 18:04:28.731388 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="horizon-kuttl-tests/keystone-cd08-account-create-update-5bgpc" event={"ID":"fecee0a1-f617-4a2c-929f-2d37cd6a48c9","Type":"ContainerDied","Data":"3946dcd62c0f445c5c54c0bdbf75e3ef9e91afd0bfa3a6409f084947d839c480"} Mar 16 18:04:28 crc kubenswrapper[5120]: I0316 18:04:28.731870 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3946dcd62c0f445c5c54c0bdbf75e3ef9e91afd0bfa3a6409f084947d839c480" Mar 16 18:04:29 crc kubenswrapper[5120]: I0316 18:04:29.257670 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-marketplace/community-operators-t6qpc" Mar 16 18:04:29 crc kubenswrapper[5120]: I0316 18:04:29.257796 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/community-operators-t6qpc" Mar 16 18:04:29 crc kubenswrapper[5120]: I0316 18:04:29.298470 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/community-operators-t6qpc" Mar 16 18:04:29 crc kubenswrapper[5120]: I0316 18:04:29.800921 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/community-operators-t6qpc" Mar 16 18:04:31 crc kubenswrapper[5120]: I0316 18:04:31.122719 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/community-operators-t6qpc"] Mar 16 18:04:31 crc kubenswrapper[5120]: I0316 18:04:31.294344 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-operators-dt65j" Mar 16 18:04:31 crc kubenswrapper[5120]: I0316 18:04:31.332114 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-operators-dt65j" Mar 16 18:04:31 crc kubenswrapper[5120]: I0316 18:04:31.761748 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/horizon-operator-index-vzqrf" event={"ID":"126b9b6c-84df-4505-a5e9-3973b80ebf6c","Type":"ContainerStarted","Data":"d0c022d34d218b728e206f487581ce389248dc73a933073fd8eba5ae61c1c3ed"} Mar 16 18:04:31 crc kubenswrapper[5120]: I0316 18:04:31.778021 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/horizon-operator-index-vzqrf" podStartSLOduration=2.415018499 podStartE2EDuration="4.778005809s" podCreationTimestamp="2026-03-16 18:04:27 +0000 UTC" firstStartedPulling="2026-03-16 18:04:28.550874745 +0000 UTC m=+9170.704806402" lastFinishedPulling="2026-03-16 18:04:30.913862055 +0000 UTC m=+9173.067793712" observedRunningTime="2026-03-16 18:04:31.775190672 +0000 UTC m=+9173.929122329" watchObservedRunningTime="2026-03-16 18:04:31.778005809 +0000 UTC m=+9173.931937466" Mar 16 18:04:31 crc kubenswrapper[5120]: I0316 18:04:31.885618 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/community-operators-kc8jx"] Mar 16 18:04:31 crc kubenswrapper[5120]: I0316 18:04:31.885994 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-marketplace/community-operators-kc8jx" podUID="69a6fa6f-9f34-444d-9a61-bc5a28c74d09" containerName="registry-server" containerID="cri-o://fa142b895a63768c13809edb526db98bdc000227ca6af108b7a827b362256a02" gracePeriod=2 Mar 16 18:04:32 crc kubenswrapper[5120]: I0316 18:04:32.411850 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-kc8jx" Mar 16 18:04:32 crc kubenswrapper[5120]: I0316 18:04:32.518770 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/69a6fa6f-9f34-444d-9a61-bc5a28c74d09-utilities\") pod \"69a6fa6f-9f34-444d-9a61-bc5a28c74d09\" (UID: \"69a6fa6f-9f34-444d-9a61-bc5a28c74d09\") " Mar 16 18:04:32 crc kubenswrapper[5120]: I0316 18:04:32.518989 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r7lhr\" (UniqueName: \"kubernetes.io/projected/69a6fa6f-9f34-444d-9a61-bc5a28c74d09-kube-api-access-r7lhr\") pod \"69a6fa6f-9f34-444d-9a61-bc5a28c74d09\" (UID: \"69a6fa6f-9f34-444d-9a61-bc5a28c74d09\") " Mar 16 18:04:32 crc kubenswrapper[5120]: I0316 18:04:32.519083 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/69a6fa6f-9f34-444d-9a61-bc5a28c74d09-catalog-content\") pod \"69a6fa6f-9f34-444d-9a61-bc5a28c74d09\" (UID: \"69a6fa6f-9f34-444d-9a61-bc5a28c74d09\") " Mar 16 18:04:32 crc kubenswrapper[5120]: I0316 18:04:32.520930 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69a6fa6f-9f34-444d-9a61-bc5a28c74d09-utilities" (OuterVolumeSpecName: "utilities") pod "69a6fa6f-9f34-444d-9a61-bc5a28c74d09" (UID: "69a6fa6f-9f34-444d-9a61-bc5a28c74d09"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 18:04:32 crc kubenswrapper[5120]: I0316 18:04:32.527333 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69a6fa6f-9f34-444d-9a61-bc5a28c74d09-kube-api-access-r7lhr" (OuterVolumeSpecName: "kube-api-access-r7lhr") pod "69a6fa6f-9f34-444d-9a61-bc5a28c74d09" (UID: "69a6fa6f-9f34-444d-9a61-bc5a28c74d09"). InnerVolumeSpecName "kube-api-access-r7lhr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 18:04:32 crc kubenswrapper[5120]: I0316 18:04:32.566301 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69a6fa6f-9f34-444d-9a61-bc5a28c74d09-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "69a6fa6f-9f34-444d-9a61-bc5a28c74d09" (UID: "69a6fa6f-9f34-444d-9a61-bc5a28c74d09"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 18:04:32 crc kubenswrapper[5120]: I0316 18:04:32.621363 5120 reconciler_common.go:299] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/69a6fa6f-9f34-444d-9a61-bc5a28c74d09-utilities\") on node \"crc\" DevicePath \"\"" Mar 16 18:04:32 crc kubenswrapper[5120]: I0316 18:04:32.621413 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r7lhr\" (UniqueName: \"kubernetes.io/projected/69a6fa6f-9f34-444d-9a61-bc5a28c74d09-kube-api-access-r7lhr\") on node \"crc\" DevicePath \"\"" Mar 16 18:04:32 crc kubenswrapper[5120]: I0316 18:04:32.621429 5120 reconciler_common.go:299] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/69a6fa6f-9f34-444d-9a61-bc5a28c74d09-catalog-content\") on node \"crc\" DevicePath \"\"" Mar 16 18:04:32 crc kubenswrapper[5120]: I0316 18:04:32.771514 5120 generic.go:358] "Generic (PLEG): container finished" podID="69a6fa6f-9f34-444d-9a61-bc5a28c74d09" containerID="fa142b895a63768c13809edb526db98bdc000227ca6af108b7a827b362256a02" exitCode=0 Mar 16 18:04:32 crc kubenswrapper[5120]: I0316 18:04:32.771563 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-kc8jx" event={"ID":"69a6fa6f-9f34-444d-9a61-bc5a28c74d09","Type":"ContainerDied","Data":"fa142b895a63768c13809edb526db98bdc000227ca6af108b7a827b362256a02"} Mar 16 18:04:32 crc kubenswrapper[5120]: I0316 18:04:32.771595 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-kc8jx" Mar 16 18:04:32 crc kubenswrapper[5120]: I0316 18:04:32.771619 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-kc8jx" event={"ID":"69a6fa6f-9f34-444d-9a61-bc5a28c74d09","Type":"ContainerDied","Data":"c8d7a7e74f7903cef4587490e0b473be8c5230a10d3a28d17eb4959b23892da4"} Mar 16 18:04:32 crc kubenswrapper[5120]: I0316 18:04:32.771638 5120 scope.go:117] "RemoveContainer" containerID="fa142b895a63768c13809edb526db98bdc000227ca6af108b7a827b362256a02" Mar 16 18:04:32 crc kubenswrapper[5120]: I0316 18:04:32.796967 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/community-operators-kc8jx"] Mar 16 18:04:32 crc kubenswrapper[5120]: I0316 18:04:32.805029 5120 scope.go:117] "RemoveContainer" containerID="687331e19e366bf7348a33817dbac1cdc69959db127e788cbfdf767af9622bb0" Mar 16 18:04:32 crc kubenswrapper[5120]: I0316 18:04:32.810109 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/community-operators-kc8jx"] Mar 16 18:04:32 crc kubenswrapper[5120]: I0316 18:04:32.830609 5120 scope.go:117] "RemoveContainer" containerID="be0e15b331ef08c7da3fd399aaa81a8ca97dc7ca2e445559d4f3c6ec06cb543d" Mar 16 18:04:32 crc kubenswrapper[5120]: I0316 18:04:32.856614 5120 scope.go:117] "RemoveContainer" containerID="fa142b895a63768c13809edb526db98bdc000227ca6af108b7a827b362256a02" Mar 16 18:04:32 crc kubenswrapper[5120]: E0316 18:04:32.857090 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa142b895a63768c13809edb526db98bdc000227ca6af108b7a827b362256a02\": container with ID starting with fa142b895a63768c13809edb526db98bdc000227ca6af108b7a827b362256a02 not found: ID does not exist" containerID="fa142b895a63768c13809edb526db98bdc000227ca6af108b7a827b362256a02" Mar 16 18:04:32 crc kubenswrapper[5120]: I0316 18:04:32.857123 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa142b895a63768c13809edb526db98bdc000227ca6af108b7a827b362256a02"} err="failed to get container status \"fa142b895a63768c13809edb526db98bdc000227ca6af108b7a827b362256a02\": rpc error: code = NotFound desc = could not find container \"fa142b895a63768c13809edb526db98bdc000227ca6af108b7a827b362256a02\": container with ID starting with fa142b895a63768c13809edb526db98bdc000227ca6af108b7a827b362256a02 not found: ID does not exist" Mar 16 18:04:32 crc kubenswrapper[5120]: I0316 18:04:32.857141 5120 scope.go:117] "RemoveContainer" containerID="687331e19e366bf7348a33817dbac1cdc69959db127e788cbfdf767af9622bb0" Mar 16 18:04:32 crc kubenswrapper[5120]: E0316 18:04:32.858036 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"687331e19e366bf7348a33817dbac1cdc69959db127e788cbfdf767af9622bb0\": container with ID starting with 687331e19e366bf7348a33817dbac1cdc69959db127e788cbfdf767af9622bb0 not found: ID does not exist" containerID="687331e19e366bf7348a33817dbac1cdc69959db127e788cbfdf767af9622bb0" Mar 16 18:04:32 crc kubenswrapper[5120]: I0316 18:04:32.858065 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"687331e19e366bf7348a33817dbac1cdc69959db127e788cbfdf767af9622bb0"} err="failed to get container status \"687331e19e366bf7348a33817dbac1cdc69959db127e788cbfdf767af9622bb0\": rpc error: code = NotFound desc = could not find container \"687331e19e366bf7348a33817dbac1cdc69959db127e788cbfdf767af9622bb0\": container with ID starting with 687331e19e366bf7348a33817dbac1cdc69959db127e788cbfdf767af9622bb0 not found: ID does not exist" Mar 16 18:04:32 crc kubenswrapper[5120]: I0316 18:04:32.858082 5120 scope.go:117] "RemoveContainer" containerID="be0e15b331ef08c7da3fd399aaa81a8ca97dc7ca2e445559d4f3c6ec06cb543d" Mar 16 18:04:32 crc kubenswrapper[5120]: E0316 18:04:32.858334 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"be0e15b331ef08c7da3fd399aaa81a8ca97dc7ca2e445559d4f3c6ec06cb543d\": container with ID starting with be0e15b331ef08c7da3fd399aaa81a8ca97dc7ca2e445559d4f3c6ec06cb543d not found: ID does not exist" containerID="be0e15b331ef08c7da3fd399aaa81a8ca97dc7ca2e445559d4f3c6ec06cb543d" Mar 16 18:04:32 crc kubenswrapper[5120]: I0316 18:04:32.858368 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be0e15b331ef08c7da3fd399aaa81a8ca97dc7ca2e445559d4f3c6ec06cb543d"} err="failed to get container status \"be0e15b331ef08c7da3fd399aaa81a8ca97dc7ca2e445559d4f3c6ec06cb543d\": rpc error: code = NotFound desc = could not find container \"be0e15b331ef08c7da3fd399aaa81a8ca97dc7ca2e445559d4f3c6ec06cb543d\": container with ID starting with be0e15b331ef08c7da3fd399aaa81a8ca97dc7ca2e445559d4f3c6ec06cb543d not found: ID does not exist" Mar 16 18:04:33 crc kubenswrapper[5120]: I0316 18:04:33.687240 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/horizon-operator-index-vzqrf"] Mar 16 18:04:33 crc kubenswrapper[5120]: I0316 18:04:33.783238 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-operators/horizon-operator-index-vzqrf" podUID="126b9b6c-84df-4505-a5e9-3973b80ebf6c" containerName="registry-server" containerID="cri-o://d0c022d34d218b728e206f487581ce389248dc73a933073fd8eba5ae61c1c3ed" gracePeriod=2 Mar 16 18:04:34 crc kubenswrapper[5120]: I0316 18:04:34.207792 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/horizon-operator-index-vzqrf" Mar 16 18:04:34 crc kubenswrapper[5120]: I0316 18:04:34.359254 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dm775\" (UniqueName: \"kubernetes.io/projected/126b9b6c-84df-4505-a5e9-3973b80ebf6c-kube-api-access-dm775\") pod \"126b9b6c-84df-4505-a5e9-3973b80ebf6c\" (UID: \"126b9b6c-84df-4505-a5e9-3973b80ebf6c\") " Mar 16 18:04:34 crc kubenswrapper[5120]: I0316 18:04:34.365250 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/126b9b6c-84df-4505-a5e9-3973b80ebf6c-kube-api-access-dm775" (OuterVolumeSpecName: "kube-api-access-dm775") pod "126b9b6c-84df-4505-a5e9-3973b80ebf6c" (UID: "126b9b6c-84df-4505-a5e9-3973b80ebf6c"). InnerVolumeSpecName "kube-api-access-dm775". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 18:04:34 crc kubenswrapper[5120]: I0316 18:04:34.463388 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dm775\" (UniqueName: \"kubernetes.io/projected/126b9b6c-84df-4505-a5e9-3973b80ebf6c-kube-api-access-dm775\") on node \"crc\" DevicePath \"\"" Mar 16 18:04:34 crc kubenswrapper[5120]: I0316 18:04:34.498691 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-operators/horizon-operator-index-vvnhz"] Mar 16 18:04:34 crc kubenswrapper[5120]: I0316 18:04:34.500520 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fecee0a1-f617-4a2c-929f-2d37cd6a48c9" containerName="mariadb-account-create-update" Mar 16 18:04:34 crc kubenswrapper[5120]: I0316 18:04:34.500544 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="fecee0a1-f617-4a2c-929f-2d37cd6a48c9" containerName="mariadb-account-create-update" Mar 16 18:04:34 crc kubenswrapper[5120]: I0316 18:04:34.500591 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65b555f1-cd7d-4ed4-b2a3-190445f5291f" containerName="mariadb-database-create" Mar 16 18:04:34 crc kubenswrapper[5120]: I0316 18:04:34.500599 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="65b555f1-cd7d-4ed4-b2a3-190445f5291f" containerName="mariadb-database-create" Mar 16 18:04:34 crc kubenswrapper[5120]: I0316 18:04:34.500621 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="126b9b6c-84df-4505-a5e9-3973b80ebf6c" containerName="registry-server" Mar 16 18:04:34 crc kubenswrapper[5120]: I0316 18:04:34.500628 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="126b9b6c-84df-4505-a5e9-3973b80ebf6c" containerName="registry-server" Mar 16 18:04:34 crc kubenswrapper[5120]: I0316 18:04:34.500689 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69a6fa6f-9f34-444d-9a61-bc5a28c74d09" containerName="extract-content" Mar 16 18:04:34 crc kubenswrapper[5120]: I0316 18:04:34.500698 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="69a6fa6f-9f34-444d-9a61-bc5a28c74d09" containerName="extract-content" Mar 16 18:04:34 crc kubenswrapper[5120]: I0316 18:04:34.500719 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69a6fa6f-9f34-444d-9a61-bc5a28c74d09" containerName="registry-server" Mar 16 18:04:34 crc kubenswrapper[5120]: I0316 18:04:34.500741 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="69a6fa6f-9f34-444d-9a61-bc5a28c74d09" containerName="registry-server" Mar 16 18:04:34 crc kubenswrapper[5120]: I0316 18:04:34.500789 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69a6fa6f-9f34-444d-9a61-bc5a28c74d09" containerName="extract-utilities" Mar 16 18:04:34 crc kubenswrapper[5120]: I0316 18:04:34.500797 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="69a6fa6f-9f34-444d-9a61-bc5a28c74d09" containerName="extract-utilities" Mar 16 18:04:34 crc kubenswrapper[5120]: I0316 18:04:34.501401 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="fecee0a1-f617-4a2c-929f-2d37cd6a48c9" containerName="mariadb-account-create-update" Mar 16 18:04:34 crc kubenswrapper[5120]: I0316 18:04:34.501446 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="65b555f1-cd7d-4ed4-b2a3-190445f5291f" containerName="mariadb-database-create" Mar 16 18:04:34 crc kubenswrapper[5120]: I0316 18:04:34.501460 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="69a6fa6f-9f34-444d-9a61-bc5a28c74d09" containerName="registry-server" Mar 16 18:04:34 crc kubenswrapper[5120]: I0316 18:04:34.501474 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="126b9b6c-84df-4505-a5e9-3973b80ebf6c" containerName="registry-server" Mar 16 18:04:34 crc kubenswrapper[5120]: I0316 18:04:34.515931 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/horizon-operator-index-vvnhz" Mar 16 18:04:34 crc kubenswrapper[5120]: I0316 18:04:34.525324 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/horizon-operator-index-vvnhz"] Mar 16 18:04:34 crc kubenswrapper[5120]: I0316 18:04:34.668655 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gl4gt\" (UniqueName: \"kubernetes.io/projected/53e2dc28-d482-4df0-a8a6-7a95b71fe79d-kube-api-access-gl4gt\") pod \"horizon-operator-index-vvnhz\" (UID: \"53e2dc28-d482-4df0-a8a6-7a95b71fe79d\") " pod="openstack-operators/horizon-operator-index-vvnhz" Mar 16 18:04:34 crc kubenswrapper[5120]: I0316 18:04:34.675113 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="69a6fa6f-9f34-444d-9a61-bc5a28c74d09" path="/var/lib/kubelet/pods/69a6fa6f-9f34-444d-9a61-bc5a28c74d09/volumes" Mar 16 18:04:34 crc kubenswrapper[5120]: I0316 18:04:34.772348 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gl4gt\" (UniqueName: \"kubernetes.io/projected/53e2dc28-d482-4df0-a8a6-7a95b71fe79d-kube-api-access-gl4gt\") pod \"horizon-operator-index-vvnhz\" (UID: \"53e2dc28-d482-4df0-a8a6-7a95b71fe79d\") " pod="openstack-operators/horizon-operator-index-vvnhz" Mar 16 18:04:34 crc kubenswrapper[5120]: I0316 18:04:34.793583 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gl4gt\" (UniqueName: \"kubernetes.io/projected/53e2dc28-d482-4df0-a8a6-7a95b71fe79d-kube-api-access-gl4gt\") pod \"horizon-operator-index-vvnhz\" (UID: \"53e2dc28-d482-4df0-a8a6-7a95b71fe79d\") " pod="openstack-operators/horizon-operator-index-vvnhz" Mar 16 18:04:34 crc kubenswrapper[5120]: I0316 18:04:34.793674 5120 generic.go:358] "Generic (PLEG): container finished" podID="126b9b6c-84df-4505-a5e9-3973b80ebf6c" containerID="d0c022d34d218b728e206f487581ce389248dc73a933073fd8eba5ae61c1c3ed" exitCode=0 Mar 16 18:04:34 crc kubenswrapper[5120]: I0316 18:04:34.793784 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/horizon-operator-index-vzqrf" event={"ID":"126b9b6c-84df-4505-a5e9-3973b80ebf6c","Type":"ContainerDied","Data":"d0c022d34d218b728e206f487581ce389248dc73a933073fd8eba5ae61c1c3ed"} Mar 16 18:04:34 crc kubenswrapper[5120]: I0316 18:04:34.793816 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/horizon-operator-index-vzqrf" Mar 16 18:04:34 crc kubenswrapper[5120]: I0316 18:04:34.793837 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/horizon-operator-index-vzqrf" event={"ID":"126b9b6c-84df-4505-a5e9-3973b80ebf6c","Type":"ContainerDied","Data":"d34d06ad55564a8de966f22264c9dfb15d874e1c53ef377fbaf4059adc52b925"} Mar 16 18:04:34 crc kubenswrapper[5120]: I0316 18:04:34.793861 5120 scope.go:117] "RemoveContainer" containerID="d0c022d34d218b728e206f487581ce389248dc73a933073fd8eba5ae61c1c3ed" Mar 16 18:04:34 crc kubenswrapper[5120]: I0316 18:04:34.832991 5120 scope.go:117] "RemoveContainer" containerID="d0c022d34d218b728e206f487581ce389248dc73a933073fd8eba5ae61c1c3ed" Mar 16 18:04:34 crc kubenswrapper[5120]: E0316 18:04:34.834809 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d0c022d34d218b728e206f487581ce389248dc73a933073fd8eba5ae61c1c3ed\": container with ID starting with d0c022d34d218b728e206f487581ce389248dc73a933073fd8eba5ae61c1c3ed not found: ID does not exist" containerID="d0c022d34d218b728e206f487581ce389248dc73a933073fd8eba5ae61c1c3ed" Mar 16 18:04:34 crc kubenswrapper[5120]: I0316 18:04:34.834868 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0c022d34d218b728e206f487581ce389248dc73a933073fd8eba5ae61c1c3ed"} err="failed to get container status \"d0c022d34d218b728e206f487581ce389248dc73a933073fd8eba5ae61c1c3ed\": rpc error: code = NotFound desc = could not find container \"d0c022d34d218b728e206f487581ce389248dc73a933073fd8eba5ae61c1c3ed\": container with ID starting with d0c022d34d218b728e206f487581ce389248dc73a933073fd8eba5ae61c1c3ed not found: ID does not exist" Mar 16 18:04:34 crc kubenswrapper[5120]: I0316 18:04:34.839163 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/horizon-operator-index-vvnhz" Mar 16 18:04:34 crc kubenswrapper[5120]: I0316 18:04:34.847643 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/horizon-operator-index-vzqrf"] Mar 16 18:04:34 crc kubenswrapper[5120]: I0316 18:04:34.854199 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-operators/horizon-operator-index-vzqrf"] Mar 16 18:04:35 crc kubenswrapper[5120]: I0316 18:04:35.282107 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/horizon-operator-index-vvnhz"] Mar 16 18:04:35 crc kubenswrapper[5120]: I0316 18:04:35.827030 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/horizon-operator-index-vvnhz" event={"ID":"53e2dc28-d482-4df0-a8a6-7a95b71fe79d","Type":"ContainerStarted","Data":"c485e2297e5edecb6fc05e716f1ed24c3fe020a361d3cdf069b29085b536c65d"} Mar 16 18:04:36 crc kubenswrapper[5120]: I0316 18:04:36.680010 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="126b9b6c-84df-4505-a5e9-3973b80ebf6c" path="/var/lib/kubelet/pods/126b9b6c-84df-4505-a5e9-3973b80ebf6c/volumes" Mar 16 18:04:36 crc kubenswrapper[5120]: I0316 18:04:36.685605 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-operators-dt65j"] Mar 16 18:04:36 crc kubenswrapper[5120]: I0316 18:04:36.686185 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-marketplace/redhat-operators-dt65j" podUID="ea3b137f-2201-4df8-ae80-e72ebdfc3bc0" containerName="registry-server" containerID="cri-o://ccb8bcefe4511e073660225a70075f769caa37b26014be390ac1e999c73dc5ac" gracePeriod=2 Mar 16 18:04:36 crc kubenswrapper[5120]: I0316 18:04:36.843519 5120 generic.go:358] "Generic (PLEG): container finished" podID="ea3b137f-2201-4df8-ae80-e72ebdfc3bc0" containerID="ccb8bcefe4511e073660225a70075f769caa37b26014be390ac1e999c73dc5ac" exitCode=0 Mar 16 18:04:36 crc kubenswrapper[5120]: I0316 18:04:36.843619 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-dt65j" event={"ID":"ea3b137f-2201-4df8-ae80-e72ebdfc3bc0","Type":"ContainerDied","Data":"ccb8bcefe4511e073660225a70075f769caa37b26014be390ac1e999c73dc5ac"} Mar 16 18:04:36 crc kubenswrapper[5120]: I0316 18:04:36.846218 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/horizon-operator-index-vvnhz" event={"ID":"53e2dc28-d482-4df0-a8a6-7a95b71fe79d","Type":"ContainerStarted","Data":"653fcd774635bb8e2ce8e097514000ae29670451e2d902c62b9e400566274194"} Mar 16 18:04:36 crc kubenswrapper[5120]: I0316 18:04:36.871556 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/horizon-operator-index-vvnhz" podStartSLOduration=2.446640211 podStartE2EDuration="2.871536892s" podCreationTimestamp="2026-03-16 18:04:34 +0000 UTC" firstStartedPulling="2026-03-16 18:04:35.298822177 +0000 UTC m=+9177.452753844" lastFinishedPulling="2026-03-16 18:04:35.723718808 +0000 UTC m=+9177.877650525" observedRunningTime="2026-03-16 18:04:36.867478992 +0000 UTC m=+9179.021410649" watchObservedRunningTime="2026-03-16 18:04:36.871536892 +0000 UTC m=+9179.025468549" Mar 16 18:04:37 crc kubenswrapper[5120]: I0316 18:04:37.195327 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-dt65j" Mar 16 18:04:37 crc kubenswrapper[5120]: I0316 18:04:37.266620 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w6v7n\" (UniqueName: \"kubernetes.io/projected/ea3b137f-2201-4df8-ae80-e72ebdfc3bc0-kube-api-access-w6v7n\") pod \"ea3b137f-2201-4df8-ae80-e72ebdfc3bc0\" (UID: \"ea3b137f-2201-4df8-ae80-e72ebdfc3bc0\") " Mar 16 18:04:37 crc kubenswrapper[5120]: I0316 18:04:37.267068 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/ea3b137f-2201-4df8-ae80-e72ebdfc3bc0-utilities\") pod \"ea3b137f-2201-4df8-ae80-e72ebdfc3bc0\" (UID: \"ea3b137f-2201-4df8-ae80-e72ebdfc3bc0\") " Mar 16 18:04:37 crc kubenswrapper[5120]: I0316 18:04:37.267109 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/ea3b137f-2201-4df8-ae80-e72ebdfc3bc0-catalog-content\") pod \"ea3b137f-2201-4df8-ae80-e72ebdfc3bc0\" (UID: \"ea3b137f-2201-4df8-ae80-e72ebdfc3bc0\") " Mar 16 18:04:37 crc kubenswrapper[5120]: I0316 18:04:37.268285 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea3b137f-2201-4df8-ae80-e72ebdfc3bc0-utilities" (OuterVolumeSpecName: "utilities") pod "ea3b137f-2201-4df8-ae80-e72ebdfc3bc0" (UID: "ea3b137f-2201-4df8-ae80-e72ebdfc3bc0"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 18:04:37 crc kubenswrapper[5120]: I0316 18:04:37.273033 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea3b137f-2201-4df8-ae80-e72ebdfc3bc0-kube-api-access-w6v7n" (OuterVolumeSpecName: "kube-api-access-w6v7n") pod "ea3b137f-2201-4df8-ae80-e72ebdfc3bc0" (UID: "ea3b137f-2201-4df8-ae80-e72ebdfc3bc0"). InnerVolumeSpecName "kube-api-access-w6v7n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 18:04:37 crc kubenswrapper[5120]: I0316 18:04:37.370326 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w6v7n\" (UniqueName: \"kubernetes.io/projected/ea3b137f-2201-4df8-ae80-e72ebdfc3bc0-kube-api-access-w6v7n\") on node \"crc\" DevicePath \"\"" Mar 16 18:04:37 crc kubenswrapper[5120]: I0316 18:04:37.370633 5120 reconciler_common.go:299] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/ea3b137f-2201-4df8-ae80-e72ebdfc3bc0-utilities\") on node \"crc\" DevicePath \"\"" Mar 16 18:04:37 crc kubenswrapper[5120]: I0316 18:04:37.389326 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea3b137f-2201-4df8-ae80-e72ebdfc3bc0-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "ea3b137f-2201-4df8-ae80-e72ebdfc3bc0" (UID: "ea3b137f-2201-4df8-ae80-e72ebdfc3bc0"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 18:04:37 crc kubenswrapper[5120]: I0316 18:04:37.473179 5120 reconciler_common.go:299] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/ea3b137f-2201-4df8-ae80-e72ebdfc3bc0-catalog-content\") on node \"crc\" DevicePath \"\"" Mar 16 18:04:37 crc kubenswrapper[5120]: I0316 18:04:37.664380 5120 scope.go:117] "RemoveContainer" containerID="fa578cadb98a23319854b9fc54966313bbc1cee64f90cc75e1f951be3cb08e36" Mar 16 18:04:37 crc kubenswrapper[5120]: E0316 18:04:37.664901 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 18:04:37 crc kubenswrapper[5120]: I0316 18:04:37.855395 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-dt65j" Mar 16 18:04:37 crc kubenswrapper[5120]: I0316 18:04:37.855408 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-dt65j" event={"ID":"ea3b137f-2201-4df8-ae80-e72ebdfc3bc0","Type":"ContainerDied","Data":"0c4a7a5fc0ea720553d29ea83d35b2fc1b7abdc7007ef60fbb41f58b140425ad"} Mar 16 18:04:37 crc kubenswrapper[5120]: I0316 18:04:37.855466 5120 scope.go:117] "RemoveContainer" containerID="ccb8bcefe4511e073660225a70075f769caa37b26014be390ac1e999c73dc5ac" Mar 16 18:04:37 crc kubenswrapper[5120]: I0316 18:04:37.885078 5120 scope.go:117] "RemoveContainer" containerID="74daffeb5306fc53227367fc722c56ae3be4899ba94b22a78635a27f12e1c0a3" Mar 16 18:04:37 crc kubenswrapper[5120]: I0316 18:04:37.890359 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-operators-dt65j"] Mar 16 18:04:37 crc kubenswrapper[5120]: I0316 18:04:37.900190 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/redhat-operators-dt65j"] Mar 16 18:04:37 crc kubenswrapper[5120]: I0316 18:04:37.924810 5120 scope.go:117] "RemoveContainer" containerID="ad84140d1a2fea6cce50b5523613ca8890490ffcb224aa97afefe0380a386f81" Mar 16 18:04:38 crc kubenswrapper[5120]: I0316 18:04:38.516306 5120 scope.go:117] "RemoveContainer" containerID="14d66d53efe1b85104e886b62aa085212197a0b83ab2c630931881e23f5743a4" Mar 16 18:04:38 crc kubenswrapper[5120]: I0316 18:04:38.679679 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ea3b137f-2201-4df8-ae80-e72ebdfc3bc0" path="/var/lib/kubelet/pods/ea3b137f-2201-4df8-ae80-e72ebdfc3bc0/volumes" Mar 16 18:04:38 crc kubenswrapper[5120]: I0316 18:04:38.734509 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="horizon-kuttl-tests/rabbitmq-server-0" Mar 16 18:04:39 crc kubenswrapper[5120]: I0316 18:04:39.289203 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["horizon-kuttl-tests/keystone-db-sync-pjx27"] Mar 16 18:04:39 crc kubenswrapper[5120]: I0316 18:04:39.290596 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea3b137f-2201-4df8-ae80-e72ebdfc3bc0" containerName="registry-server" Mar 16 18:04:39 crc kubenswrapper[5120]: I0316 18:04:39.290989 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea3b137f-2201-4df8-ae80-e72ebdfc3bc0" containerName="registry-server" Mar 16 18:04:39 crc kubenswrapper[5120]: I0316 18:04:39.291104 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea3b137f-2201-4df8-ae80-e72ebdfc3bc0" containerName="extract-utilities" Mar 16 18:04:39 crc kubenswrapper[5120]: I0316 18:04:39.291118 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea3b137f-2201-4df8-ae80-e72ebdfc3bc0" containerName="extract-utilities" Mar 16 18:04:39 crc kubenswrapper[5120]: I0316 18:04:39.291141 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea3b137f-2201-4df8-ae80-e72ebdfc3bc0" containerName="extract-content" Mar 16 18:04:39 crc kubenswrapper[5120]: I0316 18:04:39.291151 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea3b137f-2201-4df8-ae80-e72ebdfc3bc0" containerName="extract-content" Mar 16 18:04:39 crc kubenswrapper[5120]: I0316 18:04:39.291355 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ea3b137f-2201-4df8-ae80-e72ebdfc3bc0" containerName="registry-server" Mar 16 18:04:39 crc kubenswrapper[5120]: I0316 18:04:39.339205 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["horizon-kuttl-tests/keystone-db-sync-pjx27"] Mar 16 18:04:39 crc kubenswrapper[5120]: I0316 18:04:39.339357 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="horizon-kuttl-tests/keystone-db-sync-pjx27" Mar 16 18:04:39 crc kubenswrapper[5120]: I0316 18:04:39.342724 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"horizon-kuttl-tests\"/\"keystone\"" Mar 16 18:04:39 crc kubenswrapper[5120]: I0316 18:04:39.343841 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"horizon-kuttl-tests\"/\"keystone-scripts\"" Mar 16 18:04:39 crc kubenswrapper[5120]: I0316 18:04:39.344131 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"horizon-kuttl-tests\"/\"keystone-config-data\"" Mar 16 18:04:39 crc kubenswrapper[5120]: I0316 18:04:39.344397 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"horizon-kuttl-tests\"/\"keystone-keystone-dockercfg-78d2f\"" Mar 16 18:04:39 crc kubenswrapper[5120]: I0316 18:04:39.433020 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/43338e7c-2c70-497b-a3a5-fce5949f4ae2-config-data\") pod \"keystone-db-sync-pjx27\" (UID: \"43338e7c-2c70-497b-a3a5-fce5949f4ae2\") " pod="horizon-kuttl-tests/keystone-db-sync-pjx27" Mar 16 18:04:39 crc kubenswrapper[5120]: I0316 18:04:39.433295 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9sc4q\" (UniqueName: \"kubernetes.io/projected/43338e7c-2c70-497b-a3a5-fce5949f4ae2-kube-api-access-9sc4q\") pod \"keystone-db-sync-pjx27\" (UID: \"43338e7c-2c70-497b-a3a5-fce5949f4ae2\") " pod="horizon-kuttl-tests/keystone-db-sync-pjx27" Mar 16 18:04:39 crc kubenswrapper[5120]: I0316 18:04:39.535622 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/43338e7c-2c70-497b-a3a5-fce5949f4ae2-config-data\") pod \"keystone-db-sync-pjx27\" (UID: \"43338e7c-2c70-497b-a3a5-fce5949f4ae2\") " pod="horizon-kuttl-tests/keystone-db-sync-pjx27" Mar 16 18:04:39 crc kubenswrapper[5120]: I0316 18:04:39.535796 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9sc4q\" (UniqueName: \"kubernetes.io/projected/43338e7c-2c70-497b-a3a5-fce5949f4ae2-kube-api-access-9sc4q\") pod \"keystone-db-sync-pjx27\" (UID: \"43338e7c-2c70-497b-a3a5-fce5949f4ae2\") " pod="horizon-kuttl-tests/keystone-db-sync-pjx27" Mar 16 18:04:39 crc kubenswrapper[5120]: I0316 18:04:39.548823 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/43338e7c-2c70-497b-a3a5-fce5949f4ae2-config-data\") pod \"keystone-db-sync-pjx27\" (UID: \"43338e7c-2c70-497b-a3a5-fce5949f4ae2\") " pod="horizon-kuttl-tests/keystone-db-sync-pjx27" Mar 16 18:04:39 crc kubenswrapper[5120]: I0316 18:04:39.566195 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9sc4q\" (UniqueName: \"kubernetes.io/projected/43338e7c-2c70-497b-a3a5-fce5949f4ae2-kube-api-access-9sc4q\") pod \"keystone-db-sync-pjx27\" (UID: \"43338e7c-2c70-497b-a3a5-fce5949f4ae2\") " pod="horizon-kuttl-tests/keystone-db-sync-pjx27" Mar 16 18:04:39 crc kubenswrapper[5120]: I0316 18:04:39.660051 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="horizon-kuttl-tests/keystone-db-sync-pjx27" Mar 16 18:04:40 crc kubenswrapper[5120]: I0316 18:04:40.078714 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["horizon-kuttl-tests/keystone-db-sync-pjx27"] Mar 16 18:04:40 crc kubenswrapper[5120]: W0316 18:04:40.085130 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod43338e7c_2c70_497b_a3a5_fce5949f4ae2.slice/crio-75cc6bde2c1388f95334f7514ee2f417ecb9897f77900fc3df5c73df3e273476 WatchSource:0}: Error finding container 75cc6bde2c1388f95334f7514ee2f417ecb9897f77900fc3df5c73df3e273476: Status 404 returned error can't find the container with id 75cc6bde2c1388f95334f7514ee2f417ecb9897f77900fc3df5c73df3e273476 Mar 16 18:04:40 crc kubenswrapper[5120]: I0316 18:04:40.893481 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="horizon-kuttl-tests/keystone-db-sync-pjx27" event={"ID":"43338e7c-2c70-497b-a3a5-fce5949f4ae2","Type":"ContainerStarted","Data":"c56e0e13437082379b22b8267c9b17eea2297630cdab3ba67ee494c8fbfc0cf5"} Mar 16 18:04:40 crc kubenswrapper[5120]: I0316 18:04:40.894021 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="horizon-kuttl-tests/keystone-db-sync-pjx27" event={"ID":"43338e7c-2c70-497b-a3a5-fce5949f4ae2","Type":"ContainerStarted","Data":"75cc6bde2c1388f95334f7514ee2f417ecb9897f77900fc3df5c73df3e273476"} Mar 16 18:04:40 crc kubenswrapper[5120]: I0316 18:04:40.915868 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="horizon-kuttl-tests/keystone-db-sync-pjx27" podStartSLOduration=1.915846776 podStartE2EDuration="1.915846776s" podCreationTimestamp="2026-03-16 18:04:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 18:04:40.915452345 +0000 UTC m=+9183.069384042" watchObservedRunningTime="2026-03-16 18:04:40.915846776 +0000 UTC m=+9183.069778443" Mar 16 18:04:43 crc kubenswrapper[5120]: I0316 18:04:43.919338 5120 generic.go:358] "Generic (PLEG): container finished" podID="43338e7c-2c70-497b-a3a5-fce5949f4ae2" containerID="c56e0e13437082379b22b8267c9b17eea2297630cdab3ba67ee494c8fbfc0cf5" exitCode=0 Mar 16 18:04:43 crc kubenswrapper[5120]: I0316 18:04:43.919419 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="horizon-kuttl-tests/keystone-db-sync-pjx27" event={"ID":"43338e7c-2c70-497b-a3a5-fce5949f4ae2","Type":"ContainerDied","Data":"c56e0e13437082379b22b8267c9b17eea2297630cdab3ba67ee494c8fbfc0cf5"} Mar 16 18:04:44 crc kubenswrapper[5120]: I0316 18:04:44.840127 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-operators/horizon-operator-index-vvnhz" Mar 16 18:04:44 crc kubenswrapper[5120]: I0316 18:04:44.841233 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-operators/horizon-operator-index-vvnhz" Mar 16 18:04:44 crc kubenswrapper[5120]: I0316 18:04:44.885447 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-operators/horizon-operator-index-vvnhz" Mar 16 18:04:44 crc kubenswrapper[5120]: I0316 18:04:44.978496 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/horizon-operator-index-vvnhz" Mar 16 18:04:45 crc kubenswrapper[5120]: I0316 18:04:45.293026 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="horizon-kuttl-tests/keystone-db-sync-pjx27" Mar 16 18:04:45 crc kubenswrapper[5120]: I0316 18:04:45.391375 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9sc4q\" (UniqueName: \"kubernetes.io/projected/43338e7c-2c70-497b-a3a5-fce5949f4ae2-kube-api-access-9sc4q\") pod \"43338e7c-2c70-497b-a3a5-fce5949f4ae2\" (UID: \"43338e7c-2c70-497b-a3a5-fce5949f4ae2\") " Mar 16 18:04:45 crc kubenswrapper[5120]: I0316 18:04:45.392459 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/43338e7c-2c70-497b-a3a5-fce5949f4ae2-config-data\") pod \"43338e7c-2c70-497b-a3a5-fce5949f4ae2\" (UID: \"43338e7c-2c70-497b-a3a5-fce5949f4ae2\") " Mar 16 18:04:45 crc kubenswrapper[5120]: I0316 18:04:45.397739 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/43338e7c-2c70-497b-a3a5-fce5949f4ae2-kube-api-access-9sc4q" (OuterVolumeSpecName: "kube-api-access-9sc4q") pod "43338e7c-2c70-497b-a3a5-fce5949f4ae2" (UID: "43338e7c-2c70-497b-a3a5-fce5949f4ae2"). InnerVolumeSpecName "kube-api-access-9sc4q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 18:04:45 crc kubenswrapper[5120]: I0316 18:04:45.426709 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/43338e7c-2c70-497b-a3a5-fce5949f4ae2-config-data" (OuterVolumeSpecName: "config-data") pod "43338e7c-2c70-497b-a3a5-fce5949f4ae2" (UID: "43338e7c-2c70-497b-a3a5-fce5949f4ae2"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 18:04:45 crc kubenswrapper[5120]: I0316 18:04:45.495652 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/43338e7c-2c70-497b-a3a5-fce5949f4ae2-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 18:04:45 crc kubenswrapper[5120]: I0316 18:04:45.495689 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9sc4q\" (UniqueName: \"kubernetes.io/projected/43338e7c-2c70-497b-a3a5-fce5949f4ae2-kube-api-access-9sc4q\") on node \"crc\" DevicePath \"\"" Mar 16 18:04:45 crc kubenswrapper[5120]: I0316 18:04:45.946400 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="horizon-kuttl-tests/keystone-db-sync-pjx27" Mar 16 18:04:45 crc kubenswrapper[5120]: I0316 18:04:45.946448 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="horizon-kuttl-tests/keystone-db-sync-pjx27" event={"ID":"43338e7c-2c70-497b-a3a5-fce5949f4ae2","Type":"ContainerDied","Data":"75cc6bde2c1388f95334f7514ee2f417ecb9897f77900fc3df5c73df3e273476"} Mar 16 18:04:45 crc kubenswrapper[5120]: I0316 18:04:45.946500 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="75cc6bde2c1388f95334f7514ee2f417ecb9897f77900fc3df5c73df3e273476" Mar 16 18:04:46 crc kubenswrapper[5120]: I0316 18:04:46.156861 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["horizon-kuttl-tests/keystone-bootstrap-xxdnj"] Mar 16 18:04:46 crc kubenswrapper[5120]: I0316 18:04:46.157911 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43338e7c-2c70-497b-a3a5-fce5949f4ae2" containerName="keystone-db-sync" Mar 16 18:04:46 crc kubenswrapper[5120]: I0316 18:04:46.157938 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="43338e7c-2c70-497b-a3a5-fce5949f4ae2" containerName="keystone-db-sync" Mar 16 18:04:46 crc kubenswrapper[5120]: I0316 18:04:46.158115 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="43338e7c-2c70-497b-a3a5-fce5949f4ae2" containerName="keystone-db-sync" Mar 16 18:04:46 crc kubenswrapper[5120]: I0316 18:04:46.165289 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="horizon-kuttl-tests/keystone-bootstrap-xxdnj" Mar 16 18:04:46 crc kubenswrapper[5120]: I0316 18:04:46.167275 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"horizon-kuttl-tests\"/\"keystone-config-data\"" Mar 16 18:04:46 crc kubenswrapper[5120]: I0316 18:04:46.167563 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"horizon-kuttl-tests\"/\"keystone-scripts\"" Mar 16 18:04:46 crc kubenswrapper[5120]: I0316 18:04:46.167722 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"horizon-kuttl-tests\"/\"keystone-keystone-dockercfg-78d2f\"" Mar 16 18:04:46 crc kubenswrapper[5120]: I0316 18:04:46.167779 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"horizon-kuttl-tests\"/\"osp-secret\"" Mar 16 18:04:46 crc kubenswrapper[5120]: I0316 18:04:46.168103 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["horizon-kuttl-tests/keystone-bootstrap-xxdnj"] Mar 16 18:04:46 crc kubenswrapper[5120]: I0316 18:04:46.168159 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"horizon-kuttl-tests\"/\"keystone\"" Mar 16 18:04:46 crc kubenswrapper[5120]: I0316 18:04:46.243939 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/25ac69ad-d9e3-4b99-a21d-5cd86c316f40-fernet-keys\") pod \"keystone-bootstrap-xxdnj\" (UID: \"25ac69ad-d9e3-4b99-a21d-5cd86c316f40\") " pod="horizon-kuttl-tests/keystone-bootstrap-xxdnj" Mar 16 18:04:46 crc kubenswrapper[5120]: I0316 18:04:46.243997 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/25ac69ad-d9e3-4b99-a21d-5cd86c316f40-config-data\") pod \"keystone-bootstrap-xxdnj\" (UID: \"25ac69ad-d9e3-4b99-a21d-5cd86c316f40\") " pod="horizon-kuttl-tests/keystone-bootstrap-xxdnj" Mar 16 18:04:46 crc kubenswrapper[5120]: I0316 18:04:46.244020 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/25ac69ad-d9e3-4b99-a21d-5cd86c316f40-credential-keys\") pod \"keystone-bootstrap-xxdnj\" (UID: \"25ac69ad-d9e3-4b99-a21d-5cd86c316f40\") " pod="horizon-kuttl-tests/keystone-bootstrap-xxdnj" Mar 16 18:04:46 crc kubenswrapper[5120]: I0316 18:04:46.244284 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/25ac69ad-d9e3-4b99-a21d-5cd86c316f40-scripts\") pod \"keystone-bootstrap-xxdnj\" (UID: \"25ac69ad-d9e3-4b99-a21d-5cd86c316f40\") " pod="horizon-kuttl-tests/keystone-bootstrap-xxdnj" Mar 16 18:04:46 crc kubenswrapper[5120]: I0316 18:04:46.244332 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z48qh\" (UniqueName: \"kubernetes.io/projected/25ac69ad-d9e3-4b99-a21d-5cd86c316f40-kube-api-access-z48qh\") pod \"keystone-bootstrap-xxdnj\" (UID: \"25ac69ad-d9e3-4b99-a21d-5cd86c316f40\") " pod="horizon-kuttl-tests/keystone-bootstrap-xxdnj" Mar 16 18:04:46 crc kubenswrapper[5120]: I0316 18:04:46.346687 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/25ac69ad-d9e3-4b99-a21d-5cd86c316f40-scripts\") pod \"keystone-bootstrap-xxdnj\" (UID: \"25ac69ad-d9e3-4b99-a21d-5cd86c316f40\") " pod="horizon-kuttl-tests/keystone-bootstrap-xxdnj" Mar 16 18:04:46 crc kubenswrapper[5120]: I0316 18:04:46.346813 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z48qh\" (UniqueName: \"kubernetes.io/projected/25ac69ad-d9e3-4b99-a21d-5cd86c316f40-kube-api-access-z48qh\") pod \"keystone-bootstrap-xxdnj\" (UID: \"25ac69ad-d9e3-4b99-a21d-5cd86c316f40\") " pod="horizon-kuttl-tests/keystone-bootstrap-xxdnj" Mar 16 18:04:46 crc kubenswrapper[5120]: I0316 18:04:46.346936 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/25ac69ad-d9e3-4b99-a21d-5cd86c316f40-fernet-keys\") pod \"keystone-bootstrap-xxdnj\" (UID: \"25ac69ad-d9e3-4b99-a21d-5cd86c316f40\") " pod="horizon-kuttl-tests/keystone-bootstrap-xxdnj" Mar 16 18:04:46 crc kubenswrapper[5120]: I0316 18:04:46.346989 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/25ac69ad-d9e3-4b99-a21d-5cd86c316f40-config-data\") pod \"keystone-bootstrap-xxdnj\" (UID: \"25ac69ad-d9e3-4b99-a21d-5cd86c316f40\") " pod="horizon-kuttl-tests/keystone-bootstrap-xxdnj" Mar 16 18:04:46 crc kubenswrapper[5120]: I0316 18:04:46.347026 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/25ac69ad-d9e3-4b99-a21d-5cd86c316f40-credential-keys\") pod \"keystone-bootstrap-xxdnj\" (UID: \"25ac69ad-d9e3-4b99-a21d-5cd86c316f40\") " pod="horizon-kuttl-tests/keystone-bootstrap-xxdnj" Mar 16 18:04:46 crc kubenswrapper[5120]: I0316 18:04:46.352048 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/25ac69ad-d9e3-4b99-a21d-5cd86c316f40-scripts\") pod \"keystone-bootstrap-xxdnj\" (UID: \"25ac69ad-d9e3-4b99-a21d-5cd86c316f40\") " pod="horizon-kuttl-tests/keystone-bootstrap-xxdnj" Mar 16 18:04:46 crc kubenswrapper[5120]: I0316 18:04:46.352400 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/25ac69ad-d9e3-4b99-a21d-5cd86c316f40-config-data\") pod \"keystone-bootstrap-xxdnj\" (UID: \"25ac69ad-d9e3-4b99-a21d-5cd86c316f40\") " pod="horizon-kuttl-tests/keystone-bootstrap-xxdnj" Mar 16 18:04:46 crc kubenswrapper[5120]: I0316 18:04:46.352668 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/25ac69ad-d9e3-4b99-a21d-5cd86c316f40-fernet-keys\") pod \"keystone-bootstrap-xxdnj\" (UID: \"25ac69ad-d9e3-4b99-a21d-5cd86c316f40\") " pod="horizon-kuttl-tests/keystone-bootstrap-xxdnj" Mar 16 18:04:46 crc kubenswrapper[5120]: I0316 18:04:46.353301 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/25ac69ad-d9e3-4b99-a21d-5cd86c316f40-credential-keys\") pod \"keystone-bootstrap-xxdnj\" (UID: \"25ac69ad-d9e3-4b99-a21d-5cd86c316f40\") " pod="horizon-kuttl-tests/keystone-bootstrap-xxdnj" Mar 16 18:04:46 crc kubenswrapper[5120]: I0316 18:04:46.365561 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z48qh\" (UniqueName: \"kubernetes.io/projected/25ac69ad-d9e3-4b99-a21d-5cd86c316f40-kube-api-access-z48qh\") pod \"keystone-bootstrap-xxdnj\" (UID: \"25ac69ad-d9e3-4b99-a21d-5cd86c316f40\") " pod="horizon-kuttl-tests/keystone-bootstrap-xxdnj" Mar 16 18:04:46 crc kubenswrapper[5120]: I0316 18:04:46.489403 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="horizon-kuttl-tests/keystone-bootstrap-xxdnj" Mar 16 18:04:47 crc kubenswrapper[5120]: W0316 18:04:47.004695 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod25ac69ad_d9e3_4b99_a21d_5cd86c316f40.slice/crio-722c8af1c1f92ba78b3049242d0d28c3ee26ae14654dce7f19762b9371595085 WatchSource:0}: Error finding container 722c8af1c1f92ba78b3049242d0d28c3ee26ae14654dce7f19762b9371595085: Status 404 returned error can't find the container with id 722c8af1c1f92ba78b3049242d0d28c3ee26ae14654dce7f19762b9371595085 Mar 16 18:04:47 crc kubenswrapper[5120]: I0316 18:04:47.005355 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["horizon-kuttl-tests/keystone-bootstrap-xxdnj"] Mar 16 18:04:47 crc kubenswrapper[5120]: I0316 18:04:47.967965 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="horizon-kuttl-tests/keystone-bootstrap-xxdnj" event={"ID":"25ac69ad-d9e3-4b99-a21d-5cd86c316f40","Type":"ContainerStarted","Data":"702f992935968945982b1756f3e397576d39580373384ff3c276f74582809b1e"} Mar 16 18:04:47 crc kubenswrapper[5120]: I0316 18:04:47.968317 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="horizon-kuttl-tests/keystone-bootstrap-xxdnj" event={"ID":"25ac69ad-d9e3-4b99-a21d-5cd86c316f40","Type":"ContainerStarted","Data":"722c8af1c1f92ba78b3049242d0d28c3ee26ae14654dce7f19762b9371595085"} Mar 16 18:04:47 crc kubenswrapper[5120]: I0316 18:04:47.999928 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="horizon-kuttl-tests/keystone-bootstrap-xxdnj" podStartSLOduration=1.999908982 podStartE2EDuration="1.999908982s" podCreationTimestamp="2026-03-16 18:04:46 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 18:04:47.984274565 +0000 UTC m=+9190.138206262" watchObservedRunningTime="2026-03-16 18:04:47.999908982 +0000 UTC m=+9190.153840639" Mar 16 18:04:49 crc kubenswrapper[5120]: I0316 18:04:49.923608 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-operators/d2bff6c6f6a1534d46c2cde063993db014f4253f502be0f62cc0b57f6c778sc"] Mar 16 18:04:49 crc kubenswrapper[5120]: I0316 18:04:49.928909 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/d2bff6c6f6a1534d46c2cde063993db014f4253f502be0f62cc0b57f6c778sc" Mar 16 18:04:49 crc kubenswrapper[5120]: I0316 18:04:49.932023 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-operators\"/\"default-dockercfg-rmzsx\"" Mar 16 18:04:49 crc kubenswrapper[5120]: I0316 18:04:49.935905 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/d2bff6c6f6a1534d46c2cde063993db014f4253f502be0f62cc0b57f6c778sc"] Mar 16 18:04:49 crc kubenswrapper[5120]: I0316 18:04:49.987212 5120 generic.go:358] "Generic (PLEG): container finished" podID="25ac69ad-d9e3-4b99-a21d-5cd86c316f40" containerID="702f992935968945982b1756f3e397576d39580373384ff3c276f74582809b1e" exitCode=0 Mar 16 18:04:49 crc kubenswrapper[5120]: I0316 18:04:49.987268 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="horizon-kuttl-tests/keystone-bootstrap-xxdnj" event={"ID":"25ac69ad-d9e3-4b99-a21d-5cd86c316f40","Type":"ContainerDied","Data":"702f992935968945982b1756f3e397576d39580373384ff3c276f74582809b1e"} Mar 16 18:04:50 crc kubenswrapper[5120]: I0316 18:04:50.042103 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a9c49c2e-669e-4635-bb47-d2320c6aeda3-util\") pod \"d2bff6c6f6a1534d46c2cde063993db014f4253f502be0f62cc0b57f6c778sc\" (UID: \"a9c49c2e-669e-4635-bb47-d2320c6aeda3\") " pod="openstack-operators/d2bff6c6f6a1534d46c2cde063993db014f4253f502be0f62cc0b57f6c778sc" Mar 16 18:04:50 crc kubenswrapper[5120]: I0316 18:04:50.042333 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a9c49c2e-669e-4635-bb47-d2320c6aeda3-bundle\") pod \"d2bff6c6f6a1534d46c2cde063993db014f4253f502be0f62cc0b57f6c778sc\" (UID: \"a9c49c2e-669e-4635-bb47-d2320c6aeda3\") " pod="openstack-operators/d2bff6c6f6a1534d46c2cde063993db014f4253f502be0f62cc0b57f6c778sc" Mar 16 18:04:50 crc kubenswrapper[5120]: I0316 18:04:50.042480 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nxvvj\" (UniqueName: \"kubernetes.io/projected/a9c49c2e-669e-4635-bb47-d2320c6aeda3-kube-api-access-nxvvj\") pod \"d2bff6c6f6a1534d46c2cde063993db014f4253f502be0f62cc0b57f6c778sc\" (UID: \"a9c49c2e-669e-4635-bb47-d2320c6aeda3\") " pod="openstack-operators/d2bff6c6f6a1534d46c2cde063993db014f4253f502be0f62cc0b57f6c778sc" Mar 16 18:04:50 crc kubenswrapper[5120]: I0316 18:04:50.144539 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a9c49c2e-669e-4635-bb47-d2320c6aeda3-bundle\") pod \"d2bff6c6f6a1534d46c2cde063993db014f4253f502be0f62cc0b57f6c778sc\" (UID: \"a9c49c2e-669e-4635-bb47-d2320c6aeda3\") " pod="openstack-operators/d2bff6c6f6a1534d46c2cde063993db014f4253f502be0f62cc0b57f6c778sc" Mar 16 18:04:50 crc kubenswrapper[5120]: I0316 18:04:50.145023 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nxvvj\" (UniqueName: \"kubernetes.io/projected/a9c49c2e-669e-4635-bb47-d2320c6aeda3-kube-api-access-nxvvj\") pod \"d2bff6c6f6a1534d46c2cde063993db014f4253f502be0f62cc0b57f6c778sc\" (UID: \"a9c49c2e-669e-4635-bb47-d2320c6aeda3\") " pod="openstack-operators/d2bff6c6f6a1534d46c2cde063993db014f4253f502be0f62cc0b57f6c778sc" Mar 16 18:04:50 crc kubenswrapper[5120]: I0316 18:04:50.145219 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a9c49c2e-669e-4635-bb47-d2320c6aeda3-bundle\") pod \"d2bff6c6f6a1534d46c2cde063993db014f4253f502be0f62cc0b57f6c778sc\" (UID: \"a9c49c2e-669e-4635-bb47-d2320c6aeda3\") " pod="openstack-operators/d2bff6c6f6a1534d46c2cde063993db014f4253f502be0f62cc0b57f6c778sc" Mar 16 18:04:50 crc kubenswrapper[5120]: I0316 18:04:50.145387 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a9c49c2e-669e-4635-bb47-d2320c6aeda3-util\") pod \"d2bff6c6f6a1534d46c2cde063993db014f4253f502be0f62cc0b57f6c778sc\" (UID: \"a9c49c2e-669e-4635-bb47-d2320c6aeda3\") " pod="openstack-operators/d2bff6c6f6a1534d46c2cde063993db014f4253f502be0f62cc0b57f6c778sc" Mar 16 18:04:50 crc kubenswrapper[5120]: I0316 18:04:50.145848 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a9c49c2e-669e-4635-bb47-d2320c6aeda3-util\") pod \"d2bff6c6f6a1534d46c2cde063993db014f4253f502be0f62cc0b57f6c778sc\" (UID: \"a9c49c2e-669e-4635-bb47-d2320c6aeda3\") " pod="openstack-operators/d2bff6c6f6a1534d46c2cde063993db014f4253f502be0f62cc0b57f6c778sc" Mar 16 18:04:50 crc kubenswrapper[5120]: I0316 18:04:50.167554 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxvvj\" (UniqueName: \"kubernetes.io/projected/a9c49c2e-669e-4635-bb47-d2320c6aeda3-kube-api-access-nxvvj\") pod \"d2bff6c6f6a1534d46c2cde063993db014f4253f502be0f62cc0b57f6c778sc\" (UID: \"a9c49c2e-669e-4635-bb47-d2320c6aeda3\") " pod="openstack-operators/d2bff6c6f6a1534d46c2cde063993db014f4253f502be0f62cc0b57f6c778sc" Mar 16 18:04:50 crc kubenswrapper[5120]: I0316 18:04:50.247790 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/d2bff6c6f6a1534d46c2cde063993db014f4253f502be0f62cc0b57f6c778sc" Mar 16 18:04:50 crc kubenswrapper[5120]: I0316 18:04:50.713557 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/d2bff6c6f6a1534d46c2cde063993db014f4253f502be0f62cc0b57f6c778sc"] Mar 16 18:04:50 crc kubenswrapper[5120]: I0316 18:04:50.999095 5120 generic.go:358] "Generic (PLEG): container finished" podID="a9c49c2e-669e-4635-bb47-d2320c6aeda3" containerID="16e3d16f583b348000651c2f940a1abfa1266d9f4fba84b7b554f6f4ea2a1bcd" exitCode=0 Mar 16 18:04:51 crc kubenswrapper[5120]: I0316 18:04:50.999200 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/d2bff6c6f6a1534d46c2cde063993db014f4253f502be0f62cc0b57f6c778sc" event={"ID":"a9c49c2e-669e-4635-bb47-d2320c6aeda3","Type":"ContainerDied","Data":"16e3d16f583b348000651c2f940a1abfa1266d9f4fba84b7b554f6f4ea2a1bcd"} Mar 16 18:04:51 crc kubenswrapper[5120]: I0316 18:04:50.999492 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/d2bff6c6f6a1534d46c2cde063993db014f4253f502be0f62cc0b57f6c778sc" event={"ID":"a9c49c2e-669e-4635-bb47-d2320c6aeda3","Type":"ContainerStarted","Data":"08cc64f727b9110847c71398244ce8ebf5d8c896b8a7af3c466a2cb9469370dc"} Mar 16 18:04:51 crc kubenswrapper[5120]: I0316 18:04:51.288681 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="horizon-kuttl-tests/keystone-bootstrap-xxdnj" Mar 16 18:04:51 crc kubenswrapper[5120]: I0316 18:04:51.396149 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/25ac69ad-d9e3-4b99-a21d-5cd86c316f40-credential-keys\") pod \"25ac69ad-d9e3-4b99-a21d-5cd86c316f40\" (UID: \"25ac69ad-d9e3-4b99-a21d-5cd86c316f40\") " Mar 16 18:04:51 crc kubenswrapper[5120]: I0316 18:04:51.396252 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z48qh\" (UniqueName: \"kubernetes.io/projected/25ac69ad-d9e3-4b99-a21d-5cd86c316f40-kube-api-access-z48qh\") pod \"25ac69ad-d9e3-4b99-a21d-5cd86c316f40\" (UID: \"25ac69ad-d9e3-4b99-a21d-5cd86c316f40\") " Mar 16 18:04:51 crc kubenswrapper[5120]: I0316 18:04:51.396350 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/25ac69ad-d9e3-4b99-a21d-5cd86c316f40-config-data\") pod \"25ac69ad-d9e3-4b99-a21d-5cd86c316f40\" (UID: \"25ac69ad-d9e3-4b99-a21d-5cd86c316f40\") " Mar 16 18:04:51 crc kubenswrapper[5120]: I0316 18:04:51.396381 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/25ac69ad-d9e3-4b99-a21d-5cd86c316f40-fernet-keys\") pod \"25ac69ad-d9e3-4b99-a21d-5cd86c316f40\" (UID: \"25ac69ad-d9e3-4b99-a21d-5cd86c316f40\") " Mar 16 18:04:51 crc kubenswrapper[5120]: I0316 18:04:51.396474 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/25ac69ad-d9e3-4b99-a21d-5cd86c316f40-scripts\") pod \"25ac69ad-d9e3-4b99-a21d-5cd86c316f40\" (UID: \"25ac69ad-d9e3-4b99-a21d-5cd86c316f40\") " Mar 16 18:04:51 crc kubenswrapper[5120]: I0316 18:04:51.401917 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/25ac69ad-d9e3-4b99-a21d-5cd86c316f40-scripts" (OuterVolumeSpecName: "scripts") pod "25ac69ad-d9e3-4b99-a21d-5cd86c316f40" (UID: "25ac69ad-d9e3-4b99-a21d-5cd86c316f40"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 18:04:51 crc kubenswrapper[5120]: I0316 18:04:51.402270 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/25ac69ad-d9e3-4b99-a21d-5cd86c316f40-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "25ac69ad-d9e3-4b99-a21d-5cd86c316f40" (UID: "25ac69ad-d9e3-4b99-a21d-5cd86c316f40"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 18:04:51 crc kubenswrapper[5120]: I0316 18:04:51.403604 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/25ac69ad-d9e3-4b99-a21d-5cd86c316f40-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "25ac69ad-d9e3-4b99-a21d-5cd86c316f40" (UID: "25ac69ad-d9e3-4b99-a21d-5cd86c316f40"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 18:04:51 crc kubenswrapper[5120]: I0316 18:04:51.405188 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25ac69ad-d9e3-4b99-a21d-5cd86c316f40-kube-api-access-z48qh" (OuterVolumeSpecName: "kube-api-access-z48qh") pod "25ac69ad-d9e3-4b99-a21d-5cd86c316f40" (UID: "25ac69ad-d9e3-4b99-a21d-5cd86c316f40"). InnerVolumeSpecName "kube-api-access-z48qh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 18:04:51 crc kubenswrapper[5120]: I0316 18:04:51.428391 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/25ac69ad-d9e3-4b99-a21d-5cd86c316f40-config-data" (OuterVolumeSpecName: "config-data") pod "25ac69ad-d9e3-4b99-a21d-5cd86c316f40" (UID: "25ac69ad-d9e3-4b99-a21d-5cd86c316f40"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 18:04:51 crc kubenswrapper[5120]: I0316 18:04:51.500329 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/25ac69ad-d9e3-4b99-a21d-5cd86c316f40-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 18:04:51 crc kubenswrapper[5120]: I0316 18:04:51.500597 5120 reconciler_common.go:299] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/25ac69ad-d9e3-4b99-a21d-5cd86c316f40-credential-keys\") on node \"crc\" DevicePath \"\"" Mar 16 18:04:51 crc kubenswrapper[5120]: I0316 18:04:51.500609 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z48qh\" (UniqueName: \"kubernetes.io/projected/25ac69ad-d9e3-4b99-a21d-5cd86c316f40-kube-api-access-z48qh\") on node \"crc\" DevicePath \"\"" Mar 16 18:04:51 crc kubenswrapper[5120]: I0316 18:04:51.500620 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/25ac69ad-d9e3-4b99-a21d-5cd86c316f40-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 18:04:51 crc kubenswrapper[5120]: I0316 18:04:51.500633 5120 reconciler_common.go:299] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/25ac69ad-d9e3-4b99-a21d-5cd86c316f40-fernet-keys\") on node \"crc\" DevicePath \"\"" Mar 16 18:04:51 crc kubenswrapper[5120]: I0316 18:04:51.664155 5120 scope.go:117] "RemoveContainer" containerID="fa578cadb98a23319854b9fc54966313bbc1cee64f90cc75e1f951be3cb08e36" Mar 16 18:04:51 crc kubenswrapper[5120]: E0316 18:04:51.664454 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 18:04:52 crc kubenswrapper[5120]: I0316 18:04:52.015847 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="horizon-kuttl-tests/keystone-bootstrap-xxdnj" Mar 16 18:04:52 crc kubenswrapper[5120]: I0316 18:04:52.015888 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="horizon-kuttl-tests/keystone-bootstrap-xxdnj" event={"ID":"25ac69ad-d9e3-4b99-a21d-5cd86c316f40","Type":"ContainerDied","Data":"722c8af1c1f92ba78b3049242d0d28c3ee26ae14654dce7f19762b9371595085"} Mar 16 18:04:52 crc kubenswrapper[5120]: I0316 18:04:52.015955 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="722c8af1c1f92ba78b3049242d0d28c3ee26ae14654dce7f19762b9371595085" Mar 16 18:04:52 crc kubenswrapper[5120]: I0316 18:04:52.106169 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["horizon-kuttl-tests/keystone-8574f95c55-5vc9m"] Mar 16 18:04:52 crc kubenswrapper[5120]: I0316 18:04:52.107896 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25ac69ad-d9e3-4b99-a21d-5cd86c316f40" containerName="keystone-bootstrap" Mar 16 18:04:52 crc kubenswrapper[5120]: I0316 18:04:52.107933 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="25ac69ad-d9e3-4b99-a21d-5cd86c316f40" containerName="keystone-bootstrap" Mar 16 18:04:52 crc kubenswrapper[5120]: I0316 18:04:52.108238 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="25ac69ad-d9e3-4b99-a21d-5cd86c316f40" containerName="keystone-bootstrap" Mar 16 18:04:52 crc kubenswrapper[5120]: I0316 18:04:52.114308 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="horizon-kuttl-tests/keystone-8574f95c55-5vc9m" Mar 16 18:04:52 crc kubenswrapper[5120]: I0316 18:04:52.117597 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["horizon-kuttl-tests/keystone-8574f95c55-5vc9m"] Mar 16 18:04:52 crc kubenswrapper[5120]: I0316 18:04:52.120249 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"horizon-kuttl-tests\"/\"keystone\"" Mar 16 18:04:52 crc kubenswrapper[5120]: I0316 18:04:52.120405 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"horizon-kuttl-tests\"/\"keystone-config-data\"" Mar 16 18:04:52 crc kubenswrapper[5120]: I0316 18:04:52.120498 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"horizon-kuttl-tests\"/\"keystone-scripts\"" Mar 16 18:04:52 crc kubenswrapper[5120]: I0316 18:04:52.120514 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"horizon-kuttl-tests\"/\"keystone-keystone-dockercfg-78d2f\"" Mar 16 18:04:52 crc kubenswrapper[5120]: I0316 18:04:52.227139 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c963986f-f511-4a4b-a677-58c672447b83-config-data\") pod \"keystone-8574f95c55-5vc9m\" (UID: \"c963986f-f511-4a4b-a677-58c672447b83\") " pod="horizon-kuttl-tests/keystone-8574f95c55-5vc9m" Mar 16 18:04:52 crc kubenswrapper[5120]: I0316 18:04:52.227520 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/c963986f-f511-4a4b-a677-58c672447b83-fernet-keys\") pod \"keystone-8574f95c55-5vc9m\" (UID: \"c963986f-f511-4a4b-a677-58c672447b83\") " pod="horizon-kuttl-tests/keystone-8574f95c55-5vc9m" Mar 16 18:04:52 crc kubenswrapper[5120]: I0316 18:04:52.228076 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c963986f-f511-4a4b-a677-58c672447b83-scripts\") pod \"keystone-8574f95c55-5vc9m\" (UID: \"c963986f-f511-4a4b-a677-58c672447b83\") " pod="horizon-kuttl-tests/keystone-8574f95c55-5vc9m" Mar 16 18:04:52 crc kubenswrapper[5120]: I0316 18:04:52.228127 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vm62w\" (UniqueName: \"kubernetes.io/projected/c963986f-f511-4a4b-a677-58c672447b83-kube-api-access-vm62w\") pod \"keystone-8574f95c55-5vc9m\" (UID: \"c963986f-f511-4a4b-a677-58c672447b83\") " pod="horizon-kuttl-tests/keystone-8574f95c55-5vc9m" Mar 16 18:04:52 crc kubenswrapper[5120]: I0316 18:04:52.228314 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/c963986f-f511-4a4b-a677-58c672447b83-credential-keys\") pod \"keystone-8574f95c55-5vc9m\" (UID: \"c963986f-f511-4a4b-a677-58c672447b83\") " pod="horizon-kuttl-tests/keystone-8574f95c55-5vc9m" Mar 16 18:04:52 crc kubenswrapper[5120]: I0316 18:04:52.330316 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/c963986f-f511-4a4b-a677-58c672447b83-fernet-keys\") pod \"keystone-8574f95c55-5vc9m\" (UID: \"c963986f-f511-4a4b-a677-58c672447b83\") " pod="horizon-kuttl-tests/keystone-8574f95c55-5vc9m" Mar 16 18:04:52 crc kubenswrapper[5120]: I0316 18:04:52.330513 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c963986f-f511-4a4b-a677-58c672447b83-scripts\") pod \"keystone-8574f95c55-5vc9m\" (UID: \"c963986f-f511-4a4b-a677-58c672447b83\") " pod="horizon-kuttl-tests/keystone-8574f95c55-5vc9m" Mar 16 18:04:52 crc kubenswrapper[5120]: I0316 18:04:52.330536 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vm62w\" (UniqueName: \"kubernetes.io/projected/c963986f-f511-4a4b-a677-58c672447b83-kube-api-access-vm62w\") pod \"keystone-8574f95c55-5vc9m\" (UID: \"c963986f-f511-4a4b-a677-58c672447b83\") " pod="horizon-kuttl-tests/keystone-8574f95c55-5vc9m" Mar 16 18:04:52 crc kubenswrapper[5120]: I0316 18:04:52.330629 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/c963986f-f511-4a4b-a677-58c672447b83-credential-keys\") pod \"keystone-8574f95c55-5vc9m\" (UID: \"c963986f-f511-4a4b-a677-58c672447b83\") " pod="horizon-kuttl-tests/keystone-8574f95c55-5vc9m" Mar 16 18:04:52 crc kubenswrapper[5120]: I0316 18:04:52.330670 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c963986f-f511-4a4b-a677-58c672447b83-config-data\") pod \"keystone-8574f95c55-5vc9m\" (UID: \"c963986f-f511-4a4b-a677-58c672447b83\") " pod="horizon-kuttl-tests/keystone-8574f95c55-5vc9m" Mar 16 18:04:52 crc kubenswrapper[5120]: I0316 18:04:52.335428 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c963986f-f511-4a4b-a677-58c672447b83-scripts\") pod \"keystone-8574f95c55-5vc9m\" (UID: \"c963986f-f511-4a4b-a677-58c672447b83\") " pod="horizon-kuttl-tests/keystone-8574f95c55-5vc9m" Mar 16 18:04:52 crc kubenswrapper[5120]: I0316 18:04:52.335444 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/c963986f-f511-4a4b-a677-58c672447b83-fernet-keys\") pod \"keystone-8574f95c55-5vc9m\" (UID: \"c963986f-f511-4a4b-a677-58c672447b83\") " pod="horizon-kuttl-tests/keystone-8574f95c55-5vc9m" Mar 16 18:04:52 crc kubenswrapper[5120]: I0316 18:04:52.335489 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c963986f-f511-4a4b-a677-58c672447b83-config-data\") pod \"keystone-8574f95c55-5vc9m\" (UID: \"c963986f-f511-4a4b-a677-58c672447b83\") " pod="horizon-kuttl-tests/keystone-8574f95c55-5vc9m" Mar 16 18:04:52 crc kubenswrapper[5120]: I0316 18:04:52.335634 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/c963986f-f511-4a4b-a677-58c672447b83-credential-keys\") pod \"keystone-8574f95c55-5vc9m\" (UID: \"c963986f-f511-4a4b-a677-58c672447b83\") " pod="horizon-kuttl-tests/keystone-8574f95c55-5vc9m" Mar 16 18:04:52 crc kubenswrapper[5120]: I0316 18:04:52.351951 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vm62w\" (UniqueName: \"kubernetes.io/projected/c963986f-f511-4a4b-a677-58c672447b83-kube-api-access-vm62w\") pod \"keystone-8574f95c55-5vc9m\" (UID: \"c963986f-f511-4a4b-a677-58c672447b83\") " pod="horizon-kuttl-tests/keystone-8574f95c55-5vc9m" Mar 16 18:04:52 crc kubenswrapper[5120]: I0316 18:04:52.437204 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="horizon-kuttl-tests/keystone-8574f95c55-5vc9m" Mar 16 18:04:52 crc kubenswrapper[5120]: I0316 18:04:52.868481 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["horizon-kuttl-tests/keystone-8574f95c55-5vc9m"] Mar 16 18:04:52 crc kubenswrapper[5120]: W0316 18:04:52.879541 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc963986f_f511_4a4b_a677_58c672447b83.slice/crio-2200ba9e3150ebd47ba2e92510156189c41b5fab89ae2884f1943cc49cbed566 WatchSource:0}: Error finding container 2200ba9e3150ebd47ba2e92510156189c41b5fab89ae2884f1943cc49cbed566: Status 404 returned error can't find the container with id 2200ba9e3150ebd47ba2e92510156189c41b5fab89ae2884f1943cc49cbed566 Mar 16 18:04:53 crc kubenswrapper[5120]: I0316 18:04:53.022881 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="horizon-kuttl-tests/keystone-8574f95c55-5vc9m" event={"ID":"c963986f-f511-4a4b-a677-58c672447b83","Type":"ContainerStarted","Data":"2200ba9e3150ebd47ba2e92510156189c41b5fab89ae2884f1943cc49cbed566"} Mar 16 18:04:53 crc kubenswrapper[5120]: I0316 18:04:53.024954 5120 generic.go:358] "Generic (PLEG): container finished" podID="a9c49c2e-669e-4635-bb47-d2320c6aeda3" containerID="5d7d5be1dc235fb2b04111b81f07cc99aea53466899baa79d9119753911d3bd1" exitCode=0 Mar 16 18:04:53 crc kubenswrapper[5120]: I0316 18:04:53.025046 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/d2bff6c6f6a1534d46c2cde063993db014f4253f502be0f62cc0b57f6c778sc" event={"ID":"a9c49c2e-669e-4635-bb47-d2320c6aeda3","Type":"ContainerDied","Data":"5d7d5be1dc235fb2b04111b81f07cc99aea53466899baa79d9119753911d3bd1"} Mar 16 18:04:54 crc kubenswrapper[5120]: I0316 18:04:54.033476 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="horizon-kuttl-tests/keystone-8574f95c55-5vc9m" event={"ID":"c963986f-f511-4a4b-a677-58c672447b83","Type":"ContainerStarted","Data":"5ee10dfa961ef5fce80b33b1f8ca22b18dd8d655e9124fc30b82e0d7a3858111"} Mar 16 18:04:54 crc kubenswrapper[5120]: I0316 18:04:54.033793 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="horizon-kuttl-tests/keystone-8574f95c55-5vc9m" Mar 16 18:04:54 crc kubenswrapper[5120]: I0316 18:04:54.036041 5120 generic.go:358] "Generic (PLEG): container finished" podID="a9c49c2e-669e-4635-bb47-d2320c6aeda3" containerID="7b9a5982d18e6500023495cce02b0a59a33c642fa8ee1b837ab9b4dde28db618" exitCode=0 Mar 16 18:04:54 crc kubenswrapper[5120]: I0316 18:04:54.036130 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/d2bff6c6f6a1534d46c2cde063993db014f4253f502be0f62cc0b57f6c778sc" event={"ID":"a9c49c2e-669e-4635-bb47-d2320c6aeda3","Type":"ContainerDied","Data":"7b9a5982d18e6500023495cce02b0a59a33c642fa8ee1b837ab9b4dde28db618"} Mar 16 18:04:54 crc kubenswrapper[5120]: I0316 18:04:54.056241 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="horizon-kuttl-tests/keystone-8574f95c55-5vc9m" podStartSLOduration=2.056218275 podStartE2EDuration="2.056218275s" podCreationTimestamp="2026-03-16 18:04:52 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 18:04:54.047464206 +0000 UTC m=+9196.201395893" watchObservedRunningTime="2026-03-16 18:04:54.056218275 +0000 UTC m=+9196.210149942" Mar 16 18:04:55 crc kubenswrapper[5120]: I0316 18:04:55.416378 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/d2bff6c6f6a1534d46c2cde063993db014f4253f502be0f62cc0b57f6c778sc" Mar 16 18:04:55 crc kubenswrapper[5120]: I0316 18:04:55.504432 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a9c49c2e-669e-4635-bb47-d2320c6aeda3-util\") pod \"a9c49c2e-669e-4635-bb47-d2320c6aeda3\" (UID: \"a9c49c2e-669e-4635-bb47-d2320c6aeda3\") " Mar 16 18:04:55 crc kubenswrapper[5120]: I0316 18:04:55.504656 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a9c49c2e-669e-4635-bb47-d2320c6aeda3-bundle\") pod \"a9c49c2e-669e-4635-bb47-d2320c6aeda3\" (UID: \"a9c49c2e-669e-4635-bb47-d2320c6aeda3\") " Mar 16 18:04:55 crc kubenswrapper[5120]: I0316 18:04:55.504690 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nxvvj\" (UniqueName: \"kubernetes.io/projected/a9c49c2e-669e-4635-bb47-d2320c6aeda3-kube-api-access-nxvvj\") pod \"a9c49c2e-669e-4635-bb47-d2320c6aeda3\" (UID: \"a9c49c2e-669e-4635-bb47-d2320c6aeda3\") " Mar 16 18:04:55 crc kubenswrapper[5120]: I0316 18:04:55.505544 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a9c49c2e-669e-4635-bb47-d2320c6aeda3-bundle" (OuterVolumeSpecName: "bundle") pod "a9c49c2e-669e-4635-bb47-d2320c6aeda3" (UID: "a9c49c2e-669e-4635-bb47-d2320c6aeda3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 18:04:55 crc kubenswrapper[5120]: I0316 18:04:55.511601 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a9c49c2e-669e-4635-bb47-d2320c6aeda3-kube-api-access-nxvvj" (OuterVolumeSpecName: "kube-api-access-nxvvj") pod "a9c49c2e-669e-4635-bb47-d2320c6aeda3" (UID: "a9c49c2e-669e-4635-bb47-d2320c6aeda3"). InnerVolumeSpecName "kube-api-access-nxvvj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 18:04:55 crc kubenswrapper[5120]: I0316 18:04:55.516257 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a9c49c2e-669e-4635-bb47-d2320c6aeda3-util" (OuterVolumeSpecName: "util") pod "a9c49c2e-669e-4635-bb47-d2320c6aeda3" (UID: "a9c49c2e-669e-4635-bb47-d2320c6aeda3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 18:04:55 crc kubenswrapper[5120]: I0316 18:04:55.608022 5120 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a9c49c2e-669e-4635-bb47-d2320c6aeda3-util\") on node \"crc\" DevicePath \"\"" Mar 16 18:04:55 crc kubenswrapper[5120]: I0316 18:04:55.608057 5120 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a9c49c2e-669e-4635-bb47-d2320c6aeda3-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 18:04:55 crc kubenswrapper[5120]: I0316 18:04:55.608069 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nxvvj\" (UniqueName: \"kubernetes.io/projected/a9c49c2e-669e-4635-bb47-d2320c6aeda3-kube-api-access-nxvvj\") on node \"crc\" DevicePath \"\"" Mar 16 18:04:56 crc kubenswrapper[5120]: I0316 18:04:56.059353 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/d2bff6c6f6a1534d46c2cde063993db014f4253f502be0f62cc0b57f6c778sc" event={"ID":"a9c49c2e-669e-4635-bb47-d2320c6aeda3","Type":"ContainerDied","Data":"08cc64f727b9110847c71398244ce8ebf5d8c896b8a7af3c466a2cb9469370dc"} Mar 16 18:04:56 crc kubenswrapper[5120]: I0316 18:04:56.059425 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="08cc64f727b9110847c71398244ce8ebf5d8c896b8a7af3c466a2cb9469370dc" Mar 16 18:04:56 crc kubenswrapper[5120]: I0316 18:04:56.059373 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/d2bff6c6f6a1534d46c2cde063993db014f4253f502be0f62cc0b57f6c778sc" Mar 16 18:05:05 crc kubenswrapper[5120]: I0316 18:05:05.663595 5120 scope.go:117] "RemoveContainer" containerID="fa578cadb98a23319854b9fc54966313bbc1cee64f90cc75e1f951be3cb08e36" Mar 16 18:05:05 crc kubenswrapper[5120]: E0316 18:05:05.664362 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 18:05:05 crc kubenswrapper[5120]: I0316 18:05:05.809316 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-operators/horizon-operator-controller-manager-6f896bd9dc-t4ct8"] Mar 16 18:05:05 crc kubenswrapper[5120]: I0316 18:05:05.810356 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9c49c2e-669e-4635-bb47-d2320c6aeda3" containerName="util" Mar 16 18:05:05 crc kubenswrapper[5120]: I0316 18:05:05.810381 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9c49c2e-669e-4635-bb47-d2320c6aeda3" containerName="util" Mar 16 18:05:05 crc kubenswrapper[5120]: I0316 18:05:05.810448 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9c49c2e-669e-4635-bb47-d2320c6aeda3" containerName="pull" Mar 16 18:05:05 crc kubenswrapper[5120]: I0316 18:05:05.810458 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9c49c2e-669e-4635-bb47-d2320c6aeda3" containerName="pull" Mar 16 18:05:05 crc kubenswrapper[5120]: I0316 18:05:05.810482 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9c49c2e-669e-4635-bb47-d2320c6aeda3" containerName="extract" Mar 16 18:05:05 crc kubenswrapper[5120]: I0316 18:05:05.810490 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9c49c2e-669e-4635-bb47-d2320c6aeda3" containerName="extract" Mar 16 18:05:05 crc kubenswrapper[5120]: I0316 18:05:05.810645 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="a9c49c2e-669e-4635-bb47-d2320c6aeda3" containerName="extract" Mar 16 18:05:06 crc kubenswrapper[5120]: I0316 18:05:06.599146 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/horizon-operator-controller-manager-6f896bd9dc-t4ct8"] Mar 16 18:05:06 crc kubenswrapper[5120]: I0316 18:05:06.599323 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/horizon-operator-controller-manager-6f896bd9dc-t4ct8" Mar 16 18:05:06 crc kubenswrapper[5120]: I0316 18:05:06.603902 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-operators\"/\"horizon-operator-controller-manager-service-cert\"" Mar 16 18:05:06 crc kubenswrapper[5120]: I0316 18:05:06.603989 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-operators\"/\"horizon-operator-controller-manager-dockercfg-x92zj\"" Mar 16 18:05:06 crc kubenswrapper[5120]: I0316 18:05:06.696679 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c1b1aabe-0cec-4e02-aa41-cbfbb6eb6d59-apiservice-cert\") pod \"horizon-operator-controller-manager-6f896bd9dc-t4ct8\" (UID: \"c1b1aabe-0cec-4e02-aa41-cbfbb6eb6d59\") " pod="openstack-operators/horizon-operator-controller-manager-6f896bd9dc-t4ct8" Mar 16 18:05:06 crc kubenswrapper[5120]: I0316 18:05:06.696864 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c1b1aabe-0cec-4e02-aa41-cbfbb6eb6d59-webhook-cert\") pod \"horizon-operator-controller-manager-6f896bd9dc-t4ct8\" (UID: \"c1b1aabe-0cec-4e02-aa41-cbfbb6eb6d59\") " pod="openstack-operators/horizon-operator-controller-manager-6f896bd9dc-t4ct8" Mar 16 18:05:06 crc kubenswrapper[5120]: I0316 18:05:06.697076 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pc8kz\" (UniqueName: \"kubernetes.io/projected/c1b1aabe-0cec-4e02-aa41-cbfbb6eb6d59-kube-api-access-pc8kz\") pod \"horizon-operator-controller-manager-6f896bd9dc-t4ct8\" (UID: \"c1b1aabe-0cec-4e02-aa41-cbfbb6eb6d59\") " pod="openstack-operators/horizon-operator-controller-manager-6f896bd9dc-t4ct8" Mar 16 18:05:06 crc kubenswrapper[5120]: I0316 18:05:06.799196 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c1b1aabe-0cec-4e02-aa41-cbfbb6eb6d59-apiservice-cert\") pod \"horizon-operator-controller-manager-6f896bd9dc-t4ct8\" (UID: \"c1b1aabe-0cec-4e02-aa41-cbfbb6eb6d59\") " pod="openstack-operators/horizon-operator-controller-manager-6f896bd9dc-t4ct8" Mar 16 18:05:06 crc kubenswrapper[5120]: I0316 18:05:06.799670 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c1b1aabe-0cec-4e02-aa41-cbfbb6eb6d59-webhook-cert\") pod \"horizon-operator-controller-manager-6f896bd9dc-t4ct8\" (UID: \"c1b1aabe-0cec-4e02-aa41-cbfbb6eb6d59\") " pod="openstack-operators/horizon-operator-controller-manager-6f896bd9dc-t4ct8" Mar 16 18:05:06 crc kubenswrapper[5120]: I0316 18:05:06.799971 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pc8kz\" (UniqueName: \"kubernetes.io/projected/c1b1aabe-0cec-4e02-aa41-cbfbb6eb6d59-kube-api-access-pc8kz\") pod \"horizon-operator-controller-manager-6f896bd9dc-t4ct8\" (UID: \"c1b1aabe-0cec-4e02-aa41-cbfbb6eb6d59\") " pod="openstack-operators/horizon-operator-controller-manager-6f896bd9dc-t4ct8" Mar 16 18:05:06 crc kubenswrapper[5120]: I0316 18:05:06.811949 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c1b1aabe-0cec-4e02-aa41-cbfbb6eb6d59-apiservice-cert\") pod \"horizon-operator-controller-manager-6f896bd9dc-t4ct8\" (UID: \"c1b1aabe-0cec-4e02-aa41-cbfbb6eb6d59\") " pod="openstack-operators/horizon-operator-controller-manager-6f896bd9dc-t4ct8" Mar 16 18:05:06 crc kubenswrapper[5120]: I0316 18:05:06.812003 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c1b1aabe-0cec-4e02-aa41-cbfbb6eb6d59-webhook-cert\") pod \"horizon-operator-controller-manager-6f896bd9dc-t4ct8\" (UID: \"c1b1aabe-0cec-4e02-aa41-cbfbb6eb6d59\") " pod="openstack-operators/horizon-operator-controller-manager-6f896bd9dc-t4ct8" Mar 16 18:05:06 crc kubenswrapper[5120]: I0316 18:05:06.818362 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pc8kz\" (UniqueName: \"kubernetes.io/projected/c1b1aabe-0cec-4e02-aa41-cbfbb6eb6d59-kube-api-access-pc8kz\") pod \"horizon-operator-controller-manager-6f896bd9dc-t4ct8\" (UID: \"c1b1aabe-0cec-4e02-aa41-cbfbb6eb6d59\") " pod="openstack-operators/horizon-operator-controller-manager-6f896bd9dc-t4ct8" Mar 16 18:05:06 crc kubenswrapper[5120]: I0316 18:05:06.937101 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/horizon-operator-controller-manager-6f896bd9dc-t4ct8" Mar 16 18:05:07 crc kubenswrapper[5120]: I0316 18:05:07.548831 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/horizon-operator-controller-manager-6f896bd9dc-t4ct8"] Mar 16 18:05:07 crc kubenswrapper[5120]: I0316 18:05:07.563455 5120 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Mar 16 18:05:07 crc kubenswrapper[5120]: I0316 18:05:07.616704 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/horizon-operator-controller-manager-6f896bd9dc-t4ct8" event={"ID":"c1b1aabe-0cec-4e02-aa41-cbfbb6eb6d59","Type":"ContainerStarted","Data":"e663eceaab366d48792ced6af5a9e3f15795683669bfb1b448ef31b391009be2"} Mar 16 18:05:08 crc kubenswrapper[5120]: E0316 18:05:08.356501 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1119868 actualBytes=10240 Mar 16 18:05:08 crc kubenswrapper[5120]: I0316 18:05:08.629247 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/horizon-operator-controller-manager-6f896bd9dc-t4ct8" event={"ID":"c1b1aabe-0cec-4e02-aa41-cbfbb6eb6d59","Type":"ContainerStarted","Data":"f1e5aac041c4423ed1f0131e5dbd43996af933b52b75e708220c95414090a695"} Mar 16 18:05:08 crc kubenswrapper[5120]: I0316 18:05:08.629598 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-operators/horizon-operator-controller-manager-6f896bd9dc-t4ct8" Mar 16 18:05:08 crc kubenswrapper[5120]: I0316 18:05:08.662379 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/horizon-operator-controller-manager-6f896bd9dc-t4ct8" podStartSLOduration=3.662354848 podStartE2EDuration="3.662354848s" podCreationTimestamp="2026-03-16 18:05:05 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 18:05:08.650448332 +0000 UTC m=+9210.804379999" watchObservedRunningTime="2026-03-16 18:05:08.662354848 +0000 UTC m=+9210.816286515" Mar 16 18:05:19 crc kubenswrapper[5120]: I0316 18:05:19.641853 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/horizon-operator-controller-manager-6f896bd9dc-t4ct8" Mar 16 18:05:19 crc kubenswrapper[5120]: I0316 18:05:19.663462 5120 scope.go:117] "RemoveContainer" containerID="fa578cadb98a23319854b9fc54966313bbc1cee64f90cc75e1f951be3cb08e36" Mar 16 18:05:19 crc kubenswrapper[5120]: E0316 18:05:19.663726 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 18:05:26 crc kubenswrapper[5120]: I0316 18:05:26.500585 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="horizon-kuttl-tests/keystone-8574f95c55-5vc9m" Mar 16 18:05:32 crc kubenswrapper[5120]: I0316 18:05:32.097587 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-marketplace-kwq7m"] Mar 16 18:05:32 crc kubenswrapper[5120]: I0316 18:05:32.112907 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-kwq7m" Mar 16 18:05:32 crc kubenswrapper[5120]: I0316 18:05:32.121324 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-kwq7m"] Mar 16 18:05:32 crc kubenswrapper[5120]: I0316 18:05:32.231942 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwvsr\" (UniqueName: \"kubernetes.io/projected/f456678e-4b8e-41ea-9019-0f6a64369d50-kube-api-access-hwvsr\") pod \"redhat-marketplace-kwq7m\" (UID: \"f456678e-4b8e-41ea-9019-0f6a64369d50\") " pod="openshift-marketplace/redhat-marketplace-kwq7m" Mar 16 18:05:32 crc kubenswrapper[5120]: I0316 18:05:32.232439 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/f456678e-4b8e-41ea-9019-0f6a64369d50-utilities\") pod \"redhat-marketplace-kwq7m\" (UID: \"f456678e-4b8e-41ea-9019-0f6a64369d50\") " pod="openshift-marketplace/redhat-marketplace-kwq7m" Mar 16 18:05:32 crc kubenswrapper[5120]: I0316 18:05:32.232851 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/f456678e-4b8e-41ea-9019-0f6a64369d50-catalog-content\") pod \"redhat-marketplace-kwq7m\" (UID: \"f456678e-4b8e-41ea-9019-0f6a64369d50\") " pod="openshift-marketplace/redhat-marketplace-kwq7m" Mar 16 18:05:32 crc kubenswrapper[5120]: I0316 18:05:32.335213 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/f456678e-4b8e-41ea-9019-0f6a64369d50-catalog-content\") pod \"redhat-marketplace-kwq7m\" (UID: \"f456678e-4b8e-41ea-9019-0f6a64369d50\") " pod="openshift-marketplace/redhat-marketplace-kwq7m" Mar 16 18:05:32 crc kubenswrapper[5120]: I0316 18:05:32.335321 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hwvsr\" (UniqueName: \"kubernetes.io/projected/f456678e-4b8e-41ea-9019-0f6a64369d50-kube-api-access-hwvsr\") pod \"redhat-marketplace-kwq7m\" (UID: \"f456678e-4b8e-41ea-9019-0f6a64369d50\") " pod="openshift-marketplace/redhat-marketplace-kwq7m" Mar 16 18:05:32 crc kubenswrapper[5120]: I0316 18:05:32.335347 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/f456678e-4b8e-41ea-9019-0f6a64369d50-utilities\") pod \"redhat-marketplace-kwq7m\" (UID: \"f456678e-4b8e-41ea-9019-0f6a64369d50\") " pod="openshift-marketplace/redhat-marketplace-kwq7m" Mar 16 18:05:32 crc kubenswrapper[5120]: I0316 18:05:32.336049 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/f456678e-4b8e-41ea-9019-0f6a64369d50-utilities\") pod \"redhat-marketplace-kwq7m\" (UID: \"f456678e-4b8e-41ea-9019-0f6a64369d50\") " pod="openshift-marketplace/redhat-marketplace-kwq7m" Mar 16 18:05:32 crc kubenswrapper[5120]: I0316 18:05:32.336200 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/f456678e-4b8e-41ea-9019-0f6a64369d50-catalog-content\") pod \"redhat-marketplace-kwq7m\" (UID: \"f456678e-4b8e-41ea-9019-0f6a64369d50\") " pod="openshift-marketplace/redhat-marketplace-kwq7m" Mar 16 18:05:32 crc kubenswrapper[5120]: I0316 18:05:32.358748 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwvsr\" (UniqueName: \"kubernetes.io/projected/f456678e-4b8e-41ea-9019-0f6a64369d50-kube-api-access-hwvsr\") pod \"redhat-marketplace-kwq7m\" (UID: \"f456678e-4b8e-41ea-9019-0f6a64369d50\") " pod="openshift-marketplace/redhat-marketplace-kwq7m" Mar 16 18:05:32 crc kubenswrapper[5120]: I0316 18:05:32.469186 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-kwq7m" Mar 16 18:05:32 crc kubenswrapper[5120]: I0316 18:05:32.666200 5120 scope.go:117] "RemoveContainer" containerID="fa578cadb98a23319854b9fc54966313bbc1cee64f90cc75e1f951be3cb08e36" Mar 16 18:05:32 crc kubenswrapper[5120]: E0316 18:05:32.666645 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 18:05:32 crc kubenswrapper[5120]: I0316 18:05:32.927226 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-kwq7m"] Mar 16 18:05:33 crc kubenswrapper[5120]: I0316 18:05:33.845690 5120 generic.go:358] "Generic (PLEG): container finished" podID="f456678e-4b8e-41ea-9019-0f6a64369d50" containerID="0b419e273e910c49a86cfb10ba3fc7560d62438853735baa701b269d20a557bd" exitCode=0 Mar 16 18:05:33 crc kubenswrapper[5120]: I0316 18:05:33.845747 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-kwq7m" event={"ID":"f456678e-4b8e-41ea-9019-0f6a64369d50","Type":"ContainerDied","Data":"0b419e273e910c49a86cfb10ba3fc7560d62438853735baa701b269d20a557bd"} Mar 16 18:05:33 crc kubenswrapper[5120]: I0316 18:05:33.845792 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-kwq7m" event={"ID":"f456678e-4b8e-41ea-9019-0f6a64369d50","Type":"ContainerStarted","Data":"f2140bd223bead4833e08ea32f753ea8dc94f801df6946077526b9fb67c25652"} Mar 16 18:05:34 crc kubenswrapper[5120]: I0316 18:05:34.854948 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-kwq7m" event={"ID":"f456678e-4b8e-41ea-9019-0f6a64369d50","Type":"ContainerStarted","Data":"0fc12f8843e89c3c4e74b089c31d25faf57c7fd3d6d002148ed4da6fc2b257fe"} Mar 16 18:05:35 crc kubenswrapper[5120]: I0316 18:05:35.864777 5120 generic.go:358] "Generic (PLEG): container finished" podID="f456678e-4b8e-41ea-9019-0f6a64369d50" containerID="0fc12f8843e89c3c4e74b089c31d25faf57c7fd3d6d002148ed4da6fc2b257fe" exitCode=0 Mar 16 18:05:35 crc kubenswrapper[5120]: I0316 18:05:35.864848 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-kwq7m" event={"ID":"f456678e-4b8e-41ea-9019-0f6a64369d50","Type":"ContainerDied","Data":"0fc12f8843e89c3c4e74b089c31d25faf57c7fd3d6d002148ed4da6fc2b257fe"} Mar 16 18:05:36 crc kubenswrapper[5120]: I0316 18:05:36.874541 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-kwq7m" event={"ID":"f456678e-4b8e-41ea-9019-0f6a64369d50","Type":"ContainerStarted","Data":"dbe4edf8d3e9231c0c0caeb55f5328412ce53b9fdbe9885eac59a57685b929c6"} Mar 16 18:05:36 crc kubenswrapper[5120]: I0316 18:05:36.894401 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/redhat-marketplace-kwq7m" podStartSLOduration=4.102972164 podStartE2EDuration="4.89438225s" podCreationTimestamp="2026-03-16 18:05:32 +0000 UTC" firstStartedPulling="2026-03-16 18:05:33.847884163 +0000 UTC m=+9236.001815820" lastFinishedPulling="2026-03-16 18:05:34.639294259 +0000 UTC m=+9236.793225906" observedRunningTime="2026-03-16 18:05:36.88850891 +0000 UTC m=+9239.042440567" watchObservedRunningTime="2026-03-16 18:05:36.89438225 +0000 UTC m=+9239.048313907" Mar 16 18:05:41 crc kubenswrapper[5120]: I0316 18:05:41.626507 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["horizon-kuttl-tests/horizon-66454794bf-n2qnn"] Mar 16 18:05:41 crc kubenswrapper[5120]: I0316 18:05:41.637039 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["horizon-kuttl-tests/horizon-66454794bf-n2qnn"] Mar 16 18:05:41 crc kubenswrapper[5120]: I0316 18:05:41.637190 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="horizon-kuttl-tests/horizon-66454794bf-n2qnn" Mar 16 18:05:41 crc kubenswrapper[5120]: I0316 18:05:41.640174 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"horizon-kuttl-tests\"/\"horizon-scripts\"" Mar 16 18:05:41 crc kubenswrapper[5120]: I0316 18:05:41.640514 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"horizon-kuttl-tests\"/\"horizon\"" Mar 16 18:05:41 crc kubenswrapper[5120]: I0316 18:05:41.640653 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"horizon-kuttl-tests\"/\"horizon-horizon-dockercfg-ndqct\"" Mar 16 18:05:41 crc kubenswrapper[5120]: I0316 18:05:41.641989 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"horizon-kuttl-tests\"/\"horizon-config-data\"" Mar 16 18:05:41 crc kubenswrapper[5120]: I0316 18:05:41.699515 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["horizon-kuttl-tests/horizon-574d4f47c7-d4k27"] Mar 16 18:05:41 crc kubenswrapper[5120]: I0316 18:05:41.704355 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="horizon-kuttl-tests/horizon-574d4f47c7-d4k27" Mar 16 18:05:41 crc kubenswrapper[5120]: I0316 18:05:41.708325 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["horizon-kuttl-tests/horizon-574d4f47c7-d4k27"] Mar 16 18:05:41 crc kubenswrapper[5120]: I0316 18:05:41.766627 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdrkt\" (UniqueName: \"kubernetes.io/projected/6cd1355a-61f9-40cd-b2a4-c1bfa045ca24-kube-api-access-mdrkt\") pod \"horizon-66454794bf-n2qnn\" (UID: \"6cd1355a-61f9-40cd-b2a4-c1bfa045ca24\") " pod="horizon-kuttl-tests/horizon-66454794bf-n2qnn" Mar 16 18:05:41 crc kubenswrapper[5120]: I0316 18:05:41.766924 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6cd1355a-61f9-40cd-b2a4-c1bfa045ca24-logs\") pod \"horizon-66454794bf-n2qnn\" (UID: \"6cd1355a-61f9-40cd-b2a4-c1bfa045ca24\") " pod="horizon-kuttl-tests/horizon-66454794bf-n2qnn" Mar 16 18:05:41 crc kubenswrapper[5120]: I0316 18:05:41.767015 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/6cd1355a-61f9-40cd-b2a4-c1bfa045ca24-scripts\") pod \"horizon-66454794bf-n2qnn\" (UID: \"6cd1355a-61f9-40cd-b2a4-c1bfa045ca24\") " pod="horizon-kuttl-tests/horizon-66454794bf-n2qnn" Mar 16 18:05:41 crc kubenswrapper[5120]: I0316 18:05:41.767049 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"horizon-secret-key\" (UniqueName: \"kubernetes.io/secret/6cd1355a-61f9-40cd-b2a4-c1bfa045ca24-horizon-secret-key\") pod \"horizon-66454794bf-n2qnn\" (UID: \"6cd1355a-61f9-40cd-b2a4-c1bfa045ca24\") " pod="horizon-kuttl-tests/horizon-66454794bf-n2qnn" Mar 16 18:05:41 crc kubenswrapper[5120]: I0316 18:05:41.767124 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/6cd1355a-61f9-40cd-b2a4-c1bfa045ca24-config-data\") pod \"horizon-66454794bf-n2qnn\" (UID: \"6cd1355a-61f9-40cd-b2a4-c1bfa045ca24\") " pod="horizon-kuttl-tests/horizon-66454794bf-n2qnn" Mar 16 18:05:41 crc kubenswrapper[5120]: I0316 18:05:41.869088 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"horizon-secret-key\" (UniqueName: \"kubernetes.io/secret/22eaf065-8471-4582-90ad-2c9fe0813038-horizon-secret-key\") pod \"horizon-574d4f47c7-d4k27\" (UID: \"22eaf065-8471-4582-90ad-2c9fe0813038\") " pod="horizon-kuttl-tests/horizon-574d4f47c7-d4k27" Mar 16 18:05:41 crc kubenswrapper[5120]: I0316 18:05:41.869150 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lsfrh\" (UniqueName: \"kubernetes.io/projected/22eaf065-8471-4582-90ad-2c9fe0813038-kube-api-access-lsfrh\") pod \"horizon-574d4f47c7-d4k27\" (UID: \"22eaf065-8471-4582-90ad-2c9fe0813038\") " pod="horizon-kuttl-tests/horizon-574d4f47c7-d4k27" Mar 16 18:05:41 crc kubenswrapper[5120]: I0316 18:05:41.869383 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/22eaf065-8471-4582-90ad-2c9fe0813038-config-data\") pod \"horizon-574d4f47c7-d4k27\" (UID: \"22eaf065-8471-4582-90ad-2c9fe0813038\") " pod="horizon-kuttl-tests/horizon-574d4f47c7-d4k27" Mar 16 18:05:41 crc kubenswrapper[5120]: I0316 18:05:41.869484 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/22eaf065-8471-4582-90ad-2c9fe0813038-logs\") pod \"horizon-574d4f47c7-d4k27\" (UID: \"22eaf065-8471-4582-90ad-2c9fe0813038\") " pod="horizon-kuttl-tests/horizon-574d4f47c7-d4k27" Mar 16 18:05:41 crc kubenswrapper[5120]: I0316 18:05:41.869535 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6cd1355a-61f9-40cd-b2a4-c1bfa045ca24-logs\") pod \"horizon-66454794bf-n2qnn\" (UID: \"6cd1355a-61f9-40cd-b2a4-c1bfa045ca24\") " pod="horizon-kuttl-tests/horizon-66454794bf-n2qnn" Mar 16 18:05:41 crc kubenswrapper[5120]: I0316 18:05:41.869552 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/22eaf065-8471-4582-90ad-2c9fe0813038-scripts\") pod \"horizon-574d4f47c7-d4k27\" (UID: \"22eaf065-8471-4582-90ad-2c9fe0813038\") " pod="horizon-kuttl-tests/horizon-574d4f47c7-d4k27" Mar 16 18:05:41 crc kubenswrapper[5120]: I0316 18:05:41.869699 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/6cd1355a-61f9-40cd-b2a4-c1bfa045ca24-scripts\") pod \"horizon-66454794bf-n2qnn\" (UID: \"6cd1355a-61f9-40cd-b2a4-c1bfa045ca24\") " pod="horizon-kuttl-tests/horizon-66454794bf-n2qnn" Mar 16 18:05:41 crc kubenswrapper[5120]: I0316 18:05:41.869746 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"horizon-secret-key\" (UniqueName: \"kubernetes.io/secret/6cd1355a-61f9-40cd-b2a4-c1bfa045ca24-horizon-secret-key\") pod \"horizon-66454794bf-n2qnn\" (UID: \"6cd1355a-61f9-40cd-b2a4-c1bfa045ca24\") " pod="horizon-kuttl-tests/horizon-66454794bf-n2qnn" Mar 16 18:05:41 crc kubenswrapper[5120]: I0316 18:05:41.869856 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/6cd1355a-61f9-40cd-b2a4-c1bfa045ca24-config-data\") pod \"horizon-66454794bf-n2qnn\" (UID: \"6cd1355a-61f9-40cd-b2a4-c1bfa045ca24\") " pod="horizon-kuttl-tests/horizon-66454794bf-n2qnn" Mar 16 18:05:41 crc kubenswrapper[5120]: I0316 18:05:41.869939 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mdrkt\" (UniqueName: \"kubernetes.io/projected/6cd1355a-61f9-40cd-b2a4-c1bfa045ca24-kube-api-access-mdrkt\") pod \"horizon-66454794bf-n2qnn\" (UID: \"6cd1355a-61f9-40cd-b2a4-c1bfa045ca24\") " pod="horizon-kuttl-tests/horizon-66454794bf-n2qnn" Mar 16 18:05:41 crc kubenswrapper[5120]: I0316 18:05:41.870719 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6cd1355a-61f9-40cd-b2a4-c1bfa045ca24-logs\") pod \"horizon-66454794bf-n2qnn\" (UID: \"6cd1355a-61f9-40cd-b2a4-c1bfa045ca24\") " pod="horizon-kuttl-tests/horizon-66454794bf-n2qnn" Mar 16 18:05:41 crc kubenswrapper[5120]: I0316 18:05:41.871437 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/6cd1355a-61f9-40cd-b2a4-c1bfa045ca24-scripts\") pod \"horizon-66454794bf-n2qnn\" (UID: \"6cd1355a-61f9-40cd-b2a4-c1bfa045ca24\") " pod="horizon-kuttl-tests/horizon-66454794bf-n2qnn" Mar 16 18:05:41 crc kubenswrapper[5120]: I0316 18:05:41.872033 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/6cd1355a-61f9-40cd-b2a4-c1bfa045ca24-config-data\") pod \"horizon-66454794bf-n2qnn\" (UID: \"6cd1355a-61f9-40cd-b2a4-c1bfa045ca24\") " pod="horizon-kuttl-tests/horizon-66454794bf-n2qnn" Mar 16 18:05:41 crc kubenswrapper[5120]: I0316 18:05:41.879436 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"horizon-secret-key\" (UniqueName: \"kubernetes.io/secret/6cd1355a-61f9-40cd-b2a4-c1bfa045ca24-horizon-secret-key\") pod \"horizon-66454794bf-n2qnn\" (UID: \"6cd1355a-61f9-40cd-b2a4-c1bfa045ca24\") " pod="horizon-kuttl-tests/horizon-66454794bf-n2qnn" Mar 16 18:05:41 crc kubenswrapper[5120]: I0316 18:05:41.888293 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdrkt\" (UniqueName: \"kubernetes.io/projected/6cd1355a-61f9-40cd-b2a4-c1bfa045ca24-kube-api-access-mdrkt\") pod \"horizon-66454794bf-n2qnn\" (UID: \"6cd1355a-61f9-40cd-b2a4-c1bfa045ca24\") " pod="horizon-kuttl-tests/horizon-66454794bf-n2qnn" Mar 16 18:05:41 crc kubenswrapper[5120]: I0316 18:05:41.962058 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="horizon-kuttl-tests/horizon-66454794bf-n2qnn" Mar 16 18:05:41 crc kubenswrapper[5120]: I0316 18:05:41.971413 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/22eaf065-8471-4582-90ad-2c9fe0813038-logs\") pod \"horizon-574d4f47c7-d4k27\" (UID: \"22eaf065-8471-4582-90ad-2c9fe0813038\") " pod="horizon-kuttl-tests/horizon-574d4f47c7-d4k27" Mar 16 18:05:41 crc kubenswrapper[5120]: I0316 18:05:41.971471 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/22eaf065-8471-4582-90ad-2c9fe0813038-scripts\") pod \"horizon-574d4f47c7-d4k27\" (UID: \"22eaf065-8471-4582-90ad-2c9fe0813038\") " pod="horizon-kuttl-tests/horizon-574d4f47c7-d4k27" Mar 16 18:05:41 crc kubenswrapper[5120]: I0316 18:05:41.971705 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"horizon-secret-key\" (UniqueName: \"kubernetes.io/secret/22eaf065-8471-4582-90ad-2c9fe0813038-horizon-secret-key\") pod \"horizon-574d4f47c7-d4k27\" (UID: \"22eaf065-8471-4582-90ad-2c9fe0813038\") " pod="horizon-kuttl-tests/horizon-574d4f47c7-d4k27" Mar 16 18:05:41 crc kubenswrapper[5120]: I0316 18:05:41.971746 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lsfrh\" (UniqueName: \"kubernetes.io/projected/22eaf065-8471-4582-90ad-2c9fe0813038-kube-api-access-lsfrh\") pod \"horizon-574d4f47c7-d4k27\" (UID: \"22eaf065-8471-4582-90ad-2c9fe0813038\") " pod="horizon-kuttl-tests/horizon-574d4f47c7-d4k27" Mar 16 18:05:41 crc kubenswrapper[5120]: I0316 18:05:41.971852 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/22eaf065-8471-4582-90ad-2c9fe0813038-config-data\") pod \"horizon-574d4f47c7-d4k27\" (UID: \"22eaf065-8471-4582-90ad-2c9fe0813038\") " pod="horizon-kuttl-tests/horizon-574d4f47c7-d4k27" Mar 16 18:05:41 crc kubenswrapper[5120]: I0316 18:05:41.971872 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/22eaf065-8471-4582-90ad-2c9fe0813038-logs\") pod \"horizon-574d4f47c7-d4k27\" (UID: \"22eaf065-8471-4582-90ad-2c9fe0813038\") " pod="horizon-kuttl-tests/horizon-574d4f47c7-d4k27" Mar 16 18:05:41 crc kubenswrapper[5120]: I0316 18:05:41.972388 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/22eaf065-8471-4582-90ad-2c9fe0813038-scripts\") pod \"horizon-574d4f47c7-d4k27\" (UID: \"22eaf065-8471-4582-90ad-2c9fe0813038\") " pod="horizon-kuttl-tests/horizon-574d4f47c7-d4k27" Mar 16 18:05:41 crc kubenswrapper[5120]: I0316 18:05:41.973917 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/22eaf065-8471-4582-90ad-2c9fe0813038-config-data\") pod \"horizon-574d4f47c7-d4k27\" (UID: \"22eaf065-8471-4582-90ad-2c9fe0813038\") " pod="horizon-kuttl-tests/horizon-574d4f47c7-d4k27" Mar 16 18:05:41 crc kubenswrapper[5120]: I0316 18:05:41.977230 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"horizon-secret-key\" (UniqueName: \"kubernetes.io/secret/22eaf065-8471-4582-90ad-2c9fe0813038-horizon-secret-key\") pod \"horizon-574d4f47c7-d4k27\" (UID: \"22eaf065-8471-4582-90ad-2c9fe0813038\") " pod="horizon-kuttl-tests/horizon-574d4f47c7-d4k27" Mar 16 18:05:41 crc kubenswrapper[5120]: I0316 18:05:41.997810 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lsfrh\" (UniqueName: \"kubernetes.io/projected/22eaf065-8471-4582-90ad-2c9fe0813038-kube-api-access-lsfrh\") pod \"horizon-574d4f47c7-d4k27\" (UID: \"22eaf065-8471-4582-90ad-2c9fe0813038\") " pod="horizon-kuttl-tests/horizon-574d4f47c7-d4k27" Mar 16 18:05:42 crc kubenswrapper[5120]: I0316 18:05:42.020792 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="horizon-kuttl-tests/horizon-574d4f47c7-d4k27" Mar 16 18:05:42 crc kubenswrapper[5120]: I0316 18:05:42.416163 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["horizon-kuttl-tests/horizon-66454794bf-n2qnn"] Mar 16 18:05:42 crc kubenswrapper[5120]: I0316 18:05:42.466335 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["horizon-kuttl-tests/horizon-574d4f47c7-d4k27"] Mar 16 18:05:42 crc kubenswrapper[5120]: W0316 18:05:42.468573 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod22eaf065_8471_4582_90ad_2c9fe0813038.slice/crio-83c55476ffcb1912e1b8b70bcc5f621b37cdea1eab1ec539af4cc24627073d68 WatchSource:0}: Error finding container 83c55476ffcb1912e1b8b70bcc5f621b37cdea1eab1ec539af4cc24627073d68: Status 404 returned error can't find the container with id 83c55476ffcb1912e1b8b70bcc5f621b37cdea1eab1ec539af4cc24627073d68 Mar 16 18:05:42 crc kubenswrapper[5120]: I0316 18:05:42.470196 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-marketplace/redhat-marketplace-kwq7m" Mar 16 18:05:42 crc kubenswrapper[5120]: I0316 18:05:42.470236 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-marketplace-kwq7m" Mar 16 18:05:42 crc kubenswrapper[5120]: I0316 18:05:42.526732 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-marketplace-kwq7m" Mar 16 18:05:42 crc kubenswrapper[5120]: I0316 18:05:42.941593 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="horizon-kuttl-tests/horizon-66454794bf-n2qnn" event={"ID":"6cd1355a-61f9-40cd-b2a4-c1bfa045ca24","Type":"ContainerStarted","Data":"cb6a275a3215a09e33bc58c01ba975f5afeedd94a8176d181084ec57c3f25bc8"} Mar 16 18:05:42 crc kubenswrapper[5120]: I0316 18:05:42.943685 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="horizon-kuttl-tests/horizon-574d4f47c7-d4k27" event={"ID":"22eaf065-8471-4582-90ad-2c9fe0813038","Type":"ContainerStarted","Data":"83c55476ffcb1912e1b8b70bcc5f621b37cdea1eab1ec539af4cc24627073d68"} Mar 16 18:05:43 crc kubenswrapper[5120]: I0316 18:05:43.016245 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-marketplace-kwq7m" Mar 16 18:05:45 crc kubenswrapper[5120]: I0316 18:05:45.664919 5120 scope.go:117] "RemoveContainer" containerID="fa578cadb98a23319854b9fc54966313bbc1cee64f90cc75e1f951be3cb08e36" Mar 16 18:05:45 crc kubenswrapper[5120]: E0316 18:05:45.665813 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 18:05:46 crc kubenswrapper[5120]: I0316 18:05:46.085283 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-marketplace-kwq7m"] Mar 16 18:05:46 crc kubenswrapper[5120]: I0316 18:05:46.085551 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-marketplace/redhat-marketplace-kwq7m" podUID="f456678e-4b8e-41ea-9019-0f6a64369d50" containerName="registry-server" containerID="cri-o://dbe4edf8d3e9231c0c0caeb55f5328412ce53b9fdbe9885eac59a57685b929c6" gracePeriod=2 Mar 16 18:05:46 crc kubenswrapper[5120]: I0316 18:05:46.979079 5120 generic.go:358] "Generic (PLEG): container finished" podID="f456678e-4b8e-41ea-9019-0f6a64369d50" containerID="dbe4edf8d3e9231c0c0caeb55f5328412ce53b9fdbe9885eac59a57685b929c6" exitCode=0 Mar 16 18:05:46 crc kubenswrapper[5120]: I0316 18:05:46.979180 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-kwq7m" event={"ID":"f456678e-4b8e-41ea-9019-0f6a64369d50","Type":"ContainerDied","Data":"dbe4edf8d3e9231c0c0caeb55f5328412ce53b9fdbe9885eac59a57685b929c6"} Mar 16 18:05:49 crc kubenswrapper[5120]: I0316 18:05:49.536298 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-kwq7m" Mar 16 18:05:49 crc kubenswrapper[5120]: I0316 18:05:49.673150 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hwvsr\" (UniqueName: \"kubernetes.io/projected/f456678e-4b8e-41ea-9019-0f6a64369d50-kube-api-access-hwvsr\") pod \"f456678e-4b8e-41ea-9019-0f6a64369d50\" (UID: \"f456678e-4b8e-41ea-9019-0f6a64369d50\") " Mar 16 18:05:49 crc kubenswrapper[5120]: I0316 18:05:49.674264 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/f456678e-4b8e-41ea-9019-0f6a64369d50-utilities\") pod \"f456678e-4b8e-41ea-9019-0f6a64369d50\" (UID: \"f456678e-4b8e-41ea-9019-0f6a64369d50\") " Mar 16 18:05:49 crc kubenswrapper[5120]: I0316 18:05:49.674428 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/f456678e-4b8e-41ea-9019-0f6a64369d50-catalog-content\") pod \"f456678e-4b8e-41ea-9019-0f6a64369d50\" (UID: \"f456678e-4b8e-41ea-9019-0f6a64369d50\") " Mar 16 18:05:49 crc kubenswrapper[5120]: I0316 18:05:49.675489 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f456678e-4b8e-41ea-9019-0f6a64369d50-utilities" (OuterVolumeSpecName: "utilities") pod "f456678e-4b8e-41ea-9019-0f6a64369d50" (UID: "f456678e-4b8e-41ea-9019-0f6a64369d50"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 18:05:49 crc kubenswrapper[5120]: I0316 18:05:49.675954 5120 reconciler_common.go:299] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/f456678e-4b8e-41ea-9019-0f6a64369d50-utilities\") on node \"crc\" DevicePath \"\"" Mar 16 18:05:49 crc kubenswrapper[5120]: I0316 18:05:49.677143 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f456678e-4b8e-41ea-9019-0f6a64369d50-kube-api-access-hwvsr" (OuterVolumeSpecName: "kube-api-access-hwvsr") pod "f456678e-4b8e-41ea-9019-0f6a64369d50" (UID: "f456678e-4b8e-41ea-9019-0f6a64369d50"). InnerVolumeSpecName "kube-api-access-hwvsr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 18:05:49 crc kubenswrapper[5120]: I0316 18:05:49.695668 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f456678e-4b8e-41ea-9019-0f6a64369d50-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "f456678e-4b8e-41ea-9019-0f6a64369d50" (UID: "f456678e-4b8e-41ea-9019-0f6a64369d50"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 18:05:49 crc kubenswrapper[5120]: I0316 18:05:49.779473 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hwvsr\" (UniqueName: \"kubernetes.io/projected/f456678e-4b8e-41ea-9019-0f6a64369d50-kube-api-access-hwvsr\") on node \"crc\" DevicePath \"\"" Mar 16 18:05:49 crc kubenswrapper[5120]: I0316 18:05:49.779529 5120 reconciler_common.go:299] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/f456678e-4b8e-41ea-9019-0f6a64369d50-catalog-content\") on node \"crc\" DevicePath \"\"" Mar 16 18:05:50 crc kubenswrapper[5120]: I0316 18:05:50.009721 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="horizon-kuttl-tests/horizon-66454794bf-n2qnn" event={"ID":"6cd1355a-61f9-40cd-b2a4-c1bfa045ca24","Type":"ContainerStarted","Data":"8638c0e26edfa214e3434614b2f196ce36c8a5881eebbd7b1233dc651386dd8e"} Mar 16 18:05:50 crc kubenswrapper[5120]: I0316 18:05:50.009808 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="horizon-kuttl-tests/horizon-66454794bf-n2qnn" event={"ID":"6cd1355a-61f9-40cd-b2a4-c1bfa045ca24","Type":"ContainerStarted","Data":"5be7a8a4ed83d500955c417591fcdbd9246d5ed2600d0944bae909a5eb05e550"} Mar 16 18:05:50 crc kubenswrapper[5120]: I0316 18:05:50.013391 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="horizon-kuttl-tests/horizon-574d4f47c7-d4k27" event={"ID":"22eaf065-8471-4582-90ad-2c9fe0813038","Type":"ContainerStarted","Data":"d4aa3029028e72ef90454f7a6327b0bd1bb39d131805216a6053dbf8d3484acc"} Mar 16 18:05:50 crc kubenswrapper[5120]: I0316 18:05:50.013504 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="horizon-kuttl-tests/horizon-574d4f47c7-d4k27" event={"ID":"22eaf065-8471-4582-90ad-2c9fe0813038","Type":"ContainerStarted","Data":"acfa9c978bb598d03c98fc4abfeda9683df83e732a05cd8f792aaa43dadba5ac"} Mar 16 18:05:50 crc kubenswrapper[5120]: I0316 18:05:50.016926 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-kwq7m" event={"ID":"f456678e-4b8e-41ea-9019-0f6a64369d50","Type":"ContainerDied","Data":"f2140bd223bead4833e08ea32f753ea8dc94f801df6946077526b9fb67c25652"} Mar 16 18:05:50 crc kubenswrapper[5120]: I0316 18:05:50.016995 5120 scope.go:117] "RemoveContainer" containerID="dbe4edf8d3e9231c0c0caeb55f5328412ce53b9fdbe9885eac59a57685b929c6" Mar 16 18:05:50 crc kubenswrapper[5120]: I0316 18:05:50.017044 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-kwq7m" Mar 16 18:05:50 crc kubenswrapper[5120]: I0316 18:05:50.044391 5120 scope.go:117] "RemoveContainer" containerID="0fc12f8843e89c3c4e74b089c31d25faf57c7fd3d6d002148ed4da6fc2b257fe" Mar 16 18:05:50 crc kubenswrapper[5120]: I0316 18:05:50.062177 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="horizon-kuttl-tests/horizon-574d4f47c7-d4k27" podStartSLOduration=2.2204108160000002 podStartE2EDuration="9.0621609s" podCreationTimestamp="2026-03-16 18:05:41 +0000 UTC" firstStartedPulling="2026-03-16 18:05:42.473383792 +0000 UTC m=+9244.627315439" lastFinishedPulling="2026-03-16 18:05:49.315133866 +0000 UTC m=+9251.469065523" observedRunningTime="2026-03-16 18:05:50.058038167 +0000 UTC m=+9252.211969824" watchObservedRunningTime="2026-03-16 18:05:50.0621609 +0000 UTC m=+9252.216092557" Mar 16 18:05:50 crc kubenswrapper[5120]: I0316 18:05:50.062567 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="horizon-kuttl-tests/horizon-66454794bf-n2qnn" podStartSLOduration=2.162288926 podStartE2EDuration="9.06256308s" podCreationTimestamp="2026-03-16 18:05:41 +0000 UTC" firstStartedPulling="2026-03-16 18:05:42.41441881 +0000 UTC m=+9244.568350477" lastFinishedPulling="2026-03-16 18:05:49.314692964 +0000 UTC m=+9251.468624631" observedRunningTime="2026-03-16 18:05:50.039129031 +0000 UTC m=+9252.193060738" watchObservedRunningTime="2026-03-16 18:05:50.06256308 +0000 UTC m=+9252.216494737" Mar 16 18:05:50 crc kubenswrapper[5120]: I0316 18:05:50.082068 5120 scope.go:117] "RemoveContainer" containerID="0b419e273e910c49a86cfb10ba3fc7560d62438853735baa701b269d20a557bd" Mar 16 18:05:50 crc kubenswrapper[5120]: I0316 18:05:50.088191 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-marketplace-kwq7m"] Mar 16 18:05:50 crc kubenswrapper[5120]: I0316 18:05:50.094778 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/redhat-marketplace-kwq7m"] Mar 16 18:05:50 crc kubenswrapper[5120]: I0316 18:05:50.677450 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f456678e-4b8e-41ea-9019-0f6a64369d50" path="/var/lib/kubelet/pods/f456678e-4b8e-41ea-9019-0f6a64369d50/volumes" Mar 16 18:05:51 crc kubenswrapper[5120]: I0316 18:05:51.963176 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="horizon-kuttl-tests/horizon-66454794bf-n2qnn" Mar 16 18:05:51 crc kubenswrapper[5120]: I0316 18:05:51.963739 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="horizon-kuttl-tests/horizon-66454794bf-n2qnn" Mar 16 18:05:52 crc kubenswrapper[5120]: I0316 18:05:52.021704 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="horizon-kuttl-tests/horizon-574d4f47c7-d4k27" Mar 16 18:05:52 crc kubenswrapper[5120]: I0316 18:05:52.021772 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="horizon-kuttl-tests/horizon-574d4f47c7-d4k27" Mar 16 18:06:00 crc kubenswrapper[5120]: I0316 18:06:00.168269 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-infra/auto-csr-approver-29561406-xmmsl"] Mar 16 18:06:00 crc kubenswrapper[5120]: I0316 18:06:00.169542 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f456678e-4b8e-41ea-9019-0f6a64369d50" containerName="registry-server" Mar 16 18:06:00 crc kubenswrapper[5120]: I0316 18:06:00.169566 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f456678e-4b8e-41ea-9019-0f6a64369d50" containerName="registry-server" Mar 16 18:06:00 crc kubenswrapper[5120]: I0316 18:06:00.169588 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f456678e-4b8e-41ea-9019-0f6a64369d50" containerName="extract-utilities" Mar 16 18:06:00 crc kubenswrapper[5120]: I0316 18:06:00.169596 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f456678e-4b8e-41ea-9019-0f6a64369d50" containerName="extract-utilities" Mar 16 18:06:00 crc kubenswrapper[5120]: I0316 18:06:00.169623 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f456678e-4b8e-41ea-9019-0f6a64369d50" containerName="extract-content" Mar 16 18:06:00 crc kubenswrapper[5120]: I0316 18:06:00.169630 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f456678e-4b8e-41ea-9019-0f6a64369d50" containerName="extract-content" Mar 16 18:06:00 crc kubenswrapper[5120]: I0316 18:06:00.169802 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f456678e-4b8e-41ea-9019-0f6a64369d50" containerName="registry-server" Mar 16 18:06:00 crc kubenswrapper[5120]: I0316 18:06:00.227048 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561406-xmmsl"] Mar 16 18:06:00 crc kubenswrapper[5120]: I0316 18:06:00.227220 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561406-xmmsl" Mar 16 18:06:00 crc kubenswrapper[5120]: I0316 18:06:00.229611 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"openshift-service-ca.crt\"" Mar 16 18:06:00 crc kubenswrapper[5120]: I0316 18:06:00.229648 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-infra\"/\"csr-approver-sa-dockercfg-x2nsz\"" Mar 16 18:06:00 crc kubenswrapper[5120]: I0316 18:06:00.231012 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"kube-root-ca.crt\"" Mar 16 18:06:00 crc kubenswrapper[5120]: I0316 18:06:00.373941 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgchp\" (UniqueName: \"kubernetes.io/projected/521a921f-4ca5-4634-b7a6-030b1e2a0cf1-kube-api-access-xgchp\") pod \"auto-csr-approver-29561406-xmmsl\" (UID: \"521a921f-4ca5-4634-b7a6-030b1e2a0cf1\") " pod="openshift-infra/auto-csr-approver-29561406-xmmsl" Mar 16 18:06:00 crc kubenswrapper[5120]: I0316 18:06:00.476484 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xgchp\" (UniqueName: \"kubernetes.io/projected/521a921f-4ca5-4634-b7a6-030b1e2a0cf1-kube-api-access-xgchp\") pod \"auto-csr-approver-29561406-xmmsl\" (UID: \"521a921f-4ca5-4634-b7a6-030b1e2a0cf1\") " pod="openshift-infra/auto-csr-approver-29561406-xmmsl" Mar 16 18:06:00 crc kubenswrapper[5120]: I0316 18:06:00.498404 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgchp\" (UniqueName: \"kubernetes.io/projected/521a921f-4ca5-4634-b7a6-030b1e2a0cf1-kube-api-access-xgchp\") pod \"auto-csr-approver-29561406-xmmsl\" (UID: \"521a921f-4ca5-4634-b7a6-030b1e2a0cf1\") " pod="openshift-infra/auto-csr-approver-29561406-xmmsl" Mar 16 18:06:00 crc kubenswrapper[5120]: I0316 18:06:00.549129 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561406-xmmsl" Mar 16 18:06:00 crc kubenswrapper[5120]: I0316 18:06:00.665364 5120 scope.go:117] "RemoveContainer" containerID="fa578cadb98a23319854b9fc54966313bbc1cee64f90cc75e1f951be3cb08e36" Mar 16 18:06:00 crc kubenswrapper[5120]: E0316 18:06:00.666143 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 18:06:00 crc kubenswrapper[5120]: I0316 18:06:00.777688 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561406-xmmsl"] Mar 16 18:06:01 crc kubenswrapper[5120]: I0316 18:06:01.128310 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561406-xmmsl" event={"ID":"521a921f-4ca5-4634-b7a6-030b1e2a0cf1","Type":"ContainerStarted","Data":"326e2e3f1751b5f360d27e8a6836bf9e7304d633ddd80644f7614b2d7a6d8bc5"} Mar 16 18:06:01 crc kubenswrapper[5120]: I0316 18:06:01.965131 5120 prober.go:120] "Probe failed" probeType="Startup" pod="horizon-kuttl-tests/horizon-66454794bf-n2qnn" podUID="6cd1355a-61f9-40cd-b2a4-c1bfa045ca24" containerName="horizon" probeResult="failure" output="Get \"http://10.217.0.93:8080/dashboard/auth/login/?next=/dashboard/\": dial tcp 10.217.0.93:8080: connect: connection refused" Mar 16 18:06:02 crc kubenswrapper[5120]: I0316 18:06:02.022965 5120 prober.go:120] "Probe failed" probeType="Startup" pod="horizon-kuttl-tests/horizon-574d4f47c7-d4k27" podUID="22eaf065-8471-4582-90ad-2c9fe0813038" containerName="horizon" probeResult="failure" output="Get \"http://10.217.0.94:8080/dashboard/auth/login/?next=/dashboard/\": dial tcp 10.217.0.94:8080: connect: connection refused" Mar 16 18:06:02 crc kubenswrapper[5120]: I0316 18:06:02.140887 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561406-xmmsl" event={"ID":"521a921f-4ca5-4634-b7a6-030b1e2a0cf1","Type":"ContainerStarted","Data":"3f6b8f1b718200867d048414e097b5b802d2f76893217d5f42f4325e61faed9f"} Mar 16 18:06:02 crc kubenswrapper[5120]: I0316 18:06:02.162954 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-infra/auto-csr-approver-29561406-xmmsl" podStartSLOduration=1.174477091 podStartE2EDuration="2.162927681s" podCreationTimestamp="2026-03-16 18:06:00 +0000 UTC" firstStartedPulling="2026-03-16 18:06:00.794418585 +0000 UTC m=+9262.948350282" lastFinishedPulling="2026-03-16 18:06:01.782869205 +0000 UTC m=+9263.936800872" observedRunningTime="2026-03-16 18:06:02.156864535 +0000 UTC m=+9264.310796202" watchObservedRunningTime="2026-03-16 18:06:02.162927681 +0000 UTC m=+9264.316859358" Mar 16 18:06:03 crc kubenswrapper[5120]: I0316 18:06:03.149611 5120 generic.go:358] "Generic (PLEG): container finished" podID="521a921f-4ca5-4634-b7a6-030b1e2a0cf1" containerID="3f6b8f1b718200867d048414e097b5b802d2f76893217d5f42f4325e61faed9f" exitCode=0 Mar 16 18:06:03 crc kubenswrapper[5120]: I0316 18:06:03.149794 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561406-xmmsl" event={"ID":"521a921f-4ca5-4634-b7a6-030b1e2a0cf1","Type":"ContainerDied","Data":"3f6b8f1b718200867d048414e097b5b802d2f76893217d5f42f4325e61faed9f"} Mar 16 18:06:04 crc kubenswrapper[5120]: I0316 18:06:04.435928 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561406-xmmsl" Mar 16 18:06:04 crc kubenswrapper[5120]: I0316 18:06:04.478583 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xgchp\" (UniqueName: \"kubernetes.io/projected/521a921f-4ca5-4634-b7a6-030b1e2a0cf1-kube-api-access-xgchp\") pod \"521a921f-4ca5-4634-b7a6-030b1e2a0cf1\" (UID: \"521a921f-4ca5-4634-b7a6-030b1e2a0cf1\") " Mar 16 18:06:04 crc kubenswrapper[5120]: I0316 18:06:04.487427 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/521a921f-4ca5-4634-b7a6-030b1e2a0cf1-kube-api-access-xgchp" (OuterVolumeSpecName: "kube-api-access-xgchp") pod "521a921f-4ca5-4634-b7a6-030b1e2a0cf1" (UID: "521a921f-4ca5-4634-b7a6-030b1e2a0cf1"). InnerVolumeSpecName "kube-api-access-xgchp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 18:06:04 crc kubenswrapper[5120]: I0316 18:06:04.581906 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xgchp\" (UniqueName: \"kubernetes.io/projected/521a921f-4ca5-4634-b7a6-030b1e2a0cf1-kube-api-access-xgchp\") on node \"crc\" DevicePath \"\"" Mar 16 18:06:05 crc kubenswrapper[5120]: I0316 18:06:05.167956 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561406-xmmsl" event={"ID":"521a921f-4ca5-4634-b7a6-030b1e2a0cf1","Type":"ContainerDied","Data":"326e2e3f1751b5f360d27e8a6836bf9e7304d633ddd80644f7614b2d7a6d8bc5"} Mar 16 18:06:05 crc kubenswrapper[5120]: I0316 18:06:05.167997 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="326e2e3f1751b5f360d27e8a6836bf9e7304d633ddd80644f7614b2d7a6d8bc5" Mar 16 18:06:05 crc kubenswrapper[5120]: I0316 18:06:05.168027 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561406-xmmsl" Mar 16 18:06:05 crc kubenswrapper[5120]: I0316 18:06:05.218062 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-infra/auto-csr-approver-29561400-gmrbx"] Mar 16 18:06:05 crc kubenswrapper[5120]: I0316 18:06:05.224014 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-infra/auto-csr-approver-29561400-gmrbx"] Mar 16 18:06:06 crc kubenswrapper[5120]: I0316 18:06:06.673096 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="302faf28-bbc3-4105-862e-bbbe3a1d159d" path="/var/lib/kubelet/pods/302faf28-bbc3-4105-862e-bbbe3a1d159d/volumes" Mar 16 18:06:07 crc kubenswrapper[5120]: E0316 18:06:07.622137 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1142108 actualBytes=10240 Mar 16 18:06:11 crc kubenswrapper[5120]: I0316 18:06:11.664128 5120 scope.go:117] "RemoveContainer" containerID="fa578cadb98a23319854b9fc54966313bbc1cee64f90cc75e1f951be3cb08e36" Mar 16 18:06:11 crc kubenswrapper[5120]: E0316 18:06:11.664895 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 18:06:13 crc kubenswrapper[5120]: I0316 18:06:13.706976 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="horizon-kuttl-tests/horizon-66454794bf-n2qnn" Mar 16 18:06:13 crc kubenswrapper[5120]: I0316 18:06:13.723285 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="horizon-kuttl-tests/horizon-574d4f47c7-d4k27" Mar 16 18:06:15 crc kubenswrapper[5120]: I0316 18:06:15.301306 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="horizon-kuttl-tests/horizon-66454794bf-n2qnn" Mar 16 18:06:15 crc kubenswrapper[5120]: I0316 18:06:15.378652 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="horizon-kuttl-tests/horizon-574d4f47c7-d4k27" Mar 16 18:06:15 crc kubenswrapper[5120]: I0316 18:06:15.439353 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["horizon-kuttl-tests/horizon-66454794bf-n2qnn"] Mar 16 18:06:16 crc kubenswrapper[5120]: I0316 18:06:16.272557 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="horizon-kuttl-tests/horizon-66454794bf-n2qnn" podUID="6cd1355a-61f9-40cd-b2a4-c1bfa045ca24" containerName="horizon-log" containerID="cri-o://5be7a8a4ed83d500955c417591fcdbd9246d5ed2600d0944bae909a5eb05e550" gracePeriod=30 Mar 16 18:06:16 crc kubenswrapper[5120]: I0316 18:06:16.273079 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="horizon-kuttl-tests/horizon-66454794bf-n2qnn" podUID="6cd1355a-61f9-40cd-b2a4-c1bfa045ca24" containerName="horizon" containerID="cri-o://8638c0e26edfa214e3434614b2f196ce36c8a5881eebbd7b1233dc651386dd8e" gracePeriod=30 Mar 16 18:06:18 crc kubenswrapper[5120]: I0316 18:06:18.992677 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["horizon-kuttl-tests/horizon-6496488f84-dmrpf"] Mar 16 18:06:18 crc kubenswrapper[5120]: I0316 18:06:18.993751 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="521a921f-4ca5-4634-b7a6-030b1e2a0cf1" containerName="oc" Mar 16 18:06:18 crc kubenswrapper[5120]: I0316 18:06:18.993780 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="521a921f-4ca5-4634-b7a6-030b1e2a0cf1" containerName="oc" Mar 16 18:06:18 crc kubenswrapper[5120]: I0316 18:06:18.993932 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="521a921f-4ca5-4634-b7a6-030b1e2a0cf1" containerName="oc" Mar 16 18:06:19 crc kubenswrapper[5120]: I0316 18:06:19.080894 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["horizon-kuttl-tests/horizon-6496488f84-dmrpf"] Mar 16 18:06:19 crc kubenswrapper[5120]: I0316 18:06:19.081200 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["horizon-kuttl-tests/horizon-574d4f47c7-d4k27"] Mar 16 18:06:19 crc kubenswrapper[5120]: I0316 18:06:19.081464 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="horizon-kuttl-tests/horizon-574d4f47c7-d4k27" podUID="22eaf065-8471-4582-90ad-2c9fe0813038" containerName="horizon-log" containerID="cri-o://acfa9c978bb598d03c98fc4abfeda9683df83e732a05cd8f792aaa43dadba5ac" gracePeriod=30 Mar 16 18:06:19 crc kubenswrapper[5120]: I0316 18:06:19.081650 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="horizon-kuttl-tests/horizon-6496488f84-dmrpf" Mar 16 18:06:19 crc kubenswrapper[5120]: I0316 18:06:19.082738 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="horizon-kuttl-tests/horizon-574d4f47c7-d4k27" podUID="22eaf065-8471-4582-90ad-2c9fe0813038" containerName="horizon" containerID="cri-o://d4aa3029028e72ef90454f7a6327b0bd1bb39d131805216a6053dbf8d3484acc" gracePeriod=30 Mar 16 18:06:19 crc kubenswrapper[5120]: I0316 18:06:19.086952 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"horizon-kuttl-tests\"/\"horizon-policy\"" Mar 16 18:06:19 crc kubenswrapper[5120]: I0316 18:06:19.092396 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["horizon-kuttl-tests/horizon-6496488f84-dmrpf"] Mar 16 18:06:19 crc kubenswrapper[5120]: E0316 18:06:19.109266 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[config-data horizon-secret-key kube-api-access-9twvs logs policy scripts], unattached volumes=[], failed to process volumes=[config-data horizon-secret-key kube-api-access-9twvs logs policy scripts]: context canceled" pod="horizon-kuttl-tests/horizon-6496488f84-dmrpf" podUID="56f9fc1c-0483-46af-8acf-c3ba14758663" Mar 16 18:06:19 crc kubenswrapper[5120]: I0316 18:06:19.217281 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"policy\" (UniqueName: \"kubernetes.io/configmap/56f9fc1c-0483-46af-8acf-c3ba14758663-policy\") pod \"horizon-6496488f84-dmrpf\" (UID: \"56f9fc1c-0483-46af-8acf-c3ba14758663\") " pod="horizon-kuttl-tests/horizon-6496488f84-dmrpf" Mar 16 18:06:19 crc kubenswrapper[5120]: I0316 18:06:19.217619 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9twvs\" (UniqueName: \"kubernetes.io/projected/56f9fc1c-0483-46af-8acf-c3ba14758663-kube-api-access-9twvs\") pod \"horizon-6496488f84-dmrpf\" (UID: \"56f9fc1c-0483-46af-8acf-c3ba14758663\") " pod="horizon-kuttl-tests/horizon-6496488f84-dmrpf" Mar 16 18:06:19 crc kubenswrapper[5120]: I0316 18:06:19.217671 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/56f9fc1c-0483-46af-8acf-c3ba14758663-config-data\") pod \"horizon-6496488f84-dmrpf\" (UID: \"56f9fc1c-0483-46af-8acf-c3ba14758663\") " pod="horizon-kuttl-tests/horizon-6496488f84-dmrpf" Mar 16 18:06:19 crc kubenswrapper[5120]: I0316 18:06:19.217697 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/56f9fc1c-0483-46af-8acf-c3ba14758663-logs\") pod \"horizon-6496488f84-dmrpf\" (UID: \"56f9fc1c-0483-46af-8acf-c3ba14758663\") " pod="horizon-kuttl-tests/horizon-6496488f84-dmrpf" Mar 16 18:06:19 crc kubenswrapper[5120]: I0316 18:06:19.218006 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/56f9fc1c-0483-46af-8acf-c3ba14758663-scripts\") pod \"horizon-6496488f84-dmrpf\" (UID: \"56f9fc1c-0483-46af-8acf-c3ba14758663\") " pod="horizon-kuttl-tests/horizon-6496488f84-dmrpf" Mar 16 18:06:19 crc kubenswrapper[5120]: I0316 18:06:19.218156 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"horizon-secret-key\" (UniqueName: \"kubernetes.io/secret/56f9fc1c-0483-46af-8acf-c3ba14758663-horizon-secret-key\") pod \"horizon-6496488f84-dmrpf\" (UID: \"56f9fc1c-0483-46af-8acf-c3ba14758663\") " pod="horizon-kuttl-tests/horizon-6496488f84-dmrpf" Mar 16 18:06:19 crc kubenswrapper[5120]: I0316 18:06:19.304088 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="horizon-kuttl-tests/horizon-6496488f84-dmrpf" Mar 16 18:06:19 crc kubenswrapper[5120]: I0316 18:06:19.314162 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="horizon-kuttl-tests/horizon-6496488f84-dmrpf" Mar 16 18:06:19 crc kubenswrapper[5120]: I0316 18:06:19.321537 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9twvs\" (UniqueName: \"kubernetes.io/projected/56f9fc1c-0483-46af-8acf-c3ba14758663-kube-api-access-9twvs\") pod \"horizon-6496488f84-dmrpf\" (UID: \"56f9fc1c-0483-46af-8acf-c3ba14758663\") " pod="horizon-kuttl-tests/horizon-6496488f84-dmrpf" Mar 16 18:06:19 crc kubenswrapper[5120]: I0316 18:06:19.321685 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/56f9fc1c-0483-46af-8acf-c3ba14758663-config-data\") pod \"horizon-6496488f84-dmrpf\" (UID: \"56f9fc1c-0483-46af-8acf-c3ba14758663\") " pod="horizon-kuttl-tests/horizon-6496488f84-dmrpf" Mar 16 18:06:19 crc kubenswrapper[5120]: E0316 18:06:19.321836 5120 configmap.go:193] Couldn't get configMap horizon-kuttl-tests/horizon-config-data: configmap "horizon-config-data" not found Mar 16 18:06:19 crc kubenswrapper[5120]: I0316 18:06:19.321869 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/56f9fc1c-0483-46af-8acf-c3ba14758663-logs\") pod \"horizon-6496488f84-dmrpf\" (UID: \"56f9fc1c-0483-46af-8acf-c3ba14758663\") " pod="horizon-kuttl-tests/horizon-6496488f84-dmrpf" Mar 16 18:06:19 crc kubenswrapper[5120]: E0316 18:06:19.321907 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/56f9fc1c-0483-46af-8acf-c3ba14758663-config-data podName:56f9fc1c-0483-46af-8acf-c3ba14758663 nodeName:}" failed. No retries permitted until 2026-03-16 18:06:19.821887571 +0000 UTC m=+9281.975819228 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/56f9fc1c-0483-46af-8acf-c3ba14758663-config-data") pod "horizon-6496488f84-dmrpf" (UID: "56f9fc1c-0483-46af-8acf-c3ba14758663") : configmap "horizon-config-data" not found Mar 16 18:06:19 crc kubenswrapper[5120]: I0316 18:06:19.322058 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/56f9fc1c-0483-46af-8acf-c3ba14758663-scripts\") pod \"horizon-6496488f84-dmrpf\" (UID: \"56f9fc1c-0483-46af-8acf-c3ba14758663\") " pod="horizon-kuttl-tests/horizon-6496488f84-dmrpf" Mar 16 18:06:19 crc kubenswrapper[5120]: I0316 18:06:19.322185 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"horizon-secret-key\" (UniqueName: \"kubernetes.io/secret/56f9fc1c-0483-46af-8acf-c3ba14758663-horizon-secret-key\") pod \"horizon-6496488f84-dmrpf\" (UID: \"56f9fc1c-0483-46af-8acf-c3ba14758663\") " pod="horizon-kuttl-tests/horizon-6496488f84-dmrpf" Mar 16 18:06:19 crc kubenswrapper[5120]: E0316 18:06:19.322345 5120 configmap.go:193] Couldn't get configMap horizon-kuttl-tests/horizon-scripts: configmap "horizon-scripts" not found Mar 16 18:06:19 crc kubenswrapper[5120]: I0316 18:06:19.322399 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"policy\" (UniqueName: \"kubernetes.io/configmap/56f9fc1c-0483-46af-8acf-c3ba14758663-policy\") pod \"horizon-6496488f84-dmrpf\" (UID: \"56f9fc1c-0483-46af-8acf-c3ba14758663\") " pod="horizon-kuttl-tests/horizon-6496488f84-dmrpf" Mar 16 18:06:19 crc kubenswrapper[5120]: E0316 18:06:19.322395 5120 secret.go:189] Couldn't get secret horizon-kuttl-tests/horizon: secret "horizon" not found Mar 16 18:06:19 crc kubenswrapper[5120]: E0316 18:06:19.322581 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/56f9fc1c-0483-46af-8acf-c3ba14758663-scripts podName:56f9fc1c-0483-46af-8acf-c3ba14758663 nodeName:}" failed. No retries permitted until 2026-03-16 18:06:19.822537839 +0000 UTC m=+9281.976469526 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "scripts" (UniqueName: "kubernetes.io/configmap/56f9fc1c-0483-46af-8acf-c3ba14758663-scripts") pod "horizon-6496488f84-dmrpf" (UID: "56f9fc1c-0483-46af-8acf-c3ba14758663") : configmap "horizon-scripts" not found Mar 16 18:06:19 crc kubenswrapper[5120]: E0316 18:06:19.322637 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56f9fc1c-0483-46af-8acf-c3ba14758663-horizon-secret-key podName:56f9fc1c-0483-46af-8acf-c3ba14758663 nodeName:}" failed. No retries permitted until 2026-03-16 18:06:19.822621071 +0000 UTC m=+9281.976552768 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "horizon-secret-key" (UniqueName: "kubernetes.io/secret/56f9fc1c-0483-46af-8acf-c3ba14758663-horizon-secret-key") pod "horizon-6496488f84-dmrpf" (UID: "56f9fc1c-0483-46af-8acf-c3ba14758663") : secret "horizon" not found Mar 16 18:06:19 crc kubenswrapper[5120]: I0316 18:06:19.322914 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/56f9fc1c-0483-46af-8acf-c3ba14758663-logs\") pod \"horizon-6496488f84-dmrpf\" (UID: \"56f9fc1c-0483-46af-8acf-c3ba14758663\") " pod="horizon-kuttl-tests/horizon-6496488f84-dmrpf" Mar 16 18:06:19 crc kubenswrapper[5120]: I0316 18:06:19.323184 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"policy\" (UniqueName: \"kubernetes.io/configmap/56f9fc1c-0483-46af-8acf-c3ba14758663-policy\") pod \"horizon-6496488f84-dmrpf\" (UID: \"56f9fc1c-0483-46af-8acf-c3ba14758663\") " pod="horizon-kuttl-tests/horizon-6496488f84-dmrpf" Mar 16 18:06:19 crc kubenswrapper[5120]: E0316 18:06:19.324450 5120 projected.go:194] Error preparing data for projected volume kube-api-access-9twvs for pod horizon-kuttl-tests/horizon-6496488f84-dmrpf: failed to fetch token: serviceaccounts "horizon-horizon" not found Mar 16 18:06:19 crc kubenswrapper[5120]: E0316 18:06:19.324521 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/56f9fc1c-0483-46af-8acf-c3ba14758663-kube-api-access-9twvs podName:56f9fc1c-0483-46af-8acf-c3ba14758663 nodeName:}" failed. No retries permitted until 2026-03-16 18:06:19.824501203 +0000 UTC m=+9281.978432850 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-9twvs" (UniqueName: "kubernetes.io/projected/56f9fc1c-0483-46af-8acf-c3ba14758663-kube-api-access-9twvs") pod "horizon-6496488f84-dmrpf" (UID: "56f9fc1c-0483-46af-8acf-c3ba14758663") : failed to fetch token: serviceaccounts "horizon-horizon" not found Mar 16 18:06:19 crc kubenswrapper[5120]: I0316 18:06:19.424205 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/56f9fc1c-0483-46af-8acf-c3ba14758663-logs\") pod \"56f9fc1c-0483-46af-8acf-c3ba14758663\" (UID: \"56f9fc1c-0483-46af-8acf-c3ba14758663\") " Mar 16 18:06:19 crc kubenswrapper[5120]: I0316 18:06:19.424882 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"policy\" (UniqueName: \"kubernetes.io/configmap/56f9fc1c-0483-46af-8acf-c3ba14758663-policy\") pod \"56f9fc1c-0483-46af-8acf-c3ba14758663\" (UID: \"56f9fc1c-0483-46af-8acf-c3ba14758663\") " Mar 16 18:06:19 crc kubenswrapper[5120]: I0316 18:06:19.425353 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56f9fc1c-0483-46af-8acf-c3ba14758663-logs" (OuterVolumeSpecName: "logs") pod "56f9fc1c-0483-46af-8acf-c3ba14758663" (UID: "56f9fc1c-0483-46af-8acf-c3ba14758663"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 18:06:19 crc kubenswrapper[5120]: I0316 18:06:19.426018 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/56f9fc1c-0483-46af-8acf-c3ba14758663-policy" (OuterVolumeSpecName: "policy") pod "56f9fc1c-0483-46af-8acf-c3ba14758663" (UID: "56f9fc1c-0483-46af-8acf-c3ba14758663"). InnerVolumeSpecName "policy". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 18:06:19 crc kubenswrapper[5120]: I0316 18:06:19.426755 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/56f9fc1c-0483-46af-8acf-c3ba14758663-logs\") on node \"crc\" DevicePath \"\"" Mar 16 18:06:19 crc kubenswrapper[5120]: I0316 18:06:19.426847 5120 reconciler_common.go:299] "Volume detached for volume \"policy\" (UniqueName: \"kubernetes.io/configmap/56f9fc1c-0483-46af-8acf-c3ba14758663-policy\") on node \"crc\" DevicePath \"\"" Mar 16 18:06:19 crc kubenswrapper[5120]: I0316 18:06:19.838934 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9twvs\" (UniqueName: \"kubernetes.io/projected/56f9fc1c-0483-46af-8acf-c3ba14758663-kube-api-access-9twvs\") pod \"horizon-6496488f84-dmrpf\" (UID: \"56f9fc1c-0483-46af-8acf-c3ba14758663\") " pod="horizon-kuttl-tests/horizon-6496488f84-dmrpf" Mar 16 18:06:19 crc kubenswrapper[5120]: I0316 18:06:19.838994 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/56f9fc1c-0483-46af-8acf-c3ba14758663-config-data\") pod \"horizon-6496488f84-dmrpf\" (UID: \"56f9fc1c-0483-46af-8acf-c3ba14758663\") " pod="horizon-kuttl-tests/horizon-6496488f84-dmrpf" Mar 16 18:06:19 crc kubenswrapper[5120]: I0316 18:06:19.839087 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/56f9fc1c-0483-46af-8acf-c3ba14758663-scripts\") pod \"horizon-6496488f84-dmrpf\" (UID: \"56f9fc1c-0483-46af-8acf-c3ba14758663\") " pod="horizon-kuttl-tests/horizon-6496488f84-dmrpf" Mar 16 18:06:19 crc kubenswrapper[5120]: E0316 18:06:19.839183 5120 configmap.go:193] Couldn't get configMap horizon-kuttl-tests/horizon-config-data: configmap "horizon-config-data" not found Mar 16 18:06:19 crc kubenswrapper[5120]: E0316 18:06:19.839244 5120 secret.go:189] Couldn't get secret horizon-kuttl-tests/horizon: secret "horizon" not found Mar 16 18:06:19 crc kubenswrapper[5120]: I0316 18:06:19.839185 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"horizon-secret-key\" (UniqueName: \"kubernetes.io/secret/56f9fc1c-0483-46af-8acf-c3ba14758663-horizon-secret-key\") pod \"horizon-6496488f84-dmrpf\" (UID: \"56f9fc1c-0483-46af-8acf-c3ba14758663\") " pod="horizon-kuttl-tests/horizon-6496488f84-dmrpf" Mar 16 18:06:19 crc kubenswrapper[5120]: E0316 18:06:19.839251 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/56f9fc1c-0483-46af-8acf-c3ba14758663-config-data podName:56f9fc1c-0483-46af-8acf-c3ba14758663 nodeName:}" failed. No retries permitted until 2026-03-16 18:06:20.839231318 +0000 UTC m=+9282.993162975 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/56f9fc1c-0483-46af-8acf-c3ba14758663-config-data") pod "horizon-6496488f84-dmrpf" (UID: "56f9fc1c-0483-46af-8acf-c3ba14758663") : configmap "horizon-config-data" not found Mar 16 18:06:19 crc kubenswrapper[5120]: E0316 18:06:19.839289 5120 configmap.go:193] Couldn't get configMap horizon-kuttl-tests/horizon-scripts: configmap "horizon-scripts" not found Mar 16 18:06:19 crc kubenswrapper[5120]: E0316 18:06:19.839366 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56f9fc1c-0483-46af-8acf-c3ba14758663-horizon-secret-key podName:56f9fc1c-0483-46af-8acf-c3ba14758663 nodeName:}" failed. No retries permitted until 2026-03-16 18:06:20.83931371 +0000 UTC m=+9282.993245367 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "horizon-secret-key" (UniqueName: "kubernetes.io/secret/56f9fc1c-0483-46af-8acf-c3ba14758663-horizon-secret-key") pod "horizon-6496488f84-dmrpf" (UID: "56f9fc1c-0483-46af-8acf-c3ba14758663") : secret "horizon" not found Mar 16 18:06:19 crc kubenswrapper[5120]: E0316 18:06:19.839396 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/56f9fc1c-0483-46af-8acf-c3ba14758663-scripts podName:56f9fc1c-0483-46af-8acf-c3ba14758663 nodeName:}" failed. No retries permitted until 2026-03-16 18:06:20.839386572 +0000 UTC m=+9282.993318229 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "scripts" (UniqueName: "kubernetes.io/configmap/56f9fc1c-0483-46af-8acf-c3ba14758663-scripts") pod "horizon-6496488f84-dmrpf" (UID: "56f9fc1c-0483-46af-8acf-c3ba14758663") : configmap "horizon-scripts" not found Mar 16 18:06:19 crc kubenswrapper[5120]: E0316 18:06:19.843280 5120 projected.go:194] Error preparing data for projected volume kube-api-access-9twvs for pod horizon-kuttl-tests/horizon-6496488f84-dmrpf: failed to fetch token: serviceaccounts "horizon-horizon" not found Mar 16 18:06:19 crc kubenswrapper[5120]: E0316 18:06:19.843386 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/56f9fc1c-0483-46af-8acf-c3ba14758663-kube-api-access-9twvs podName:56f9fc1c-0483-46af-8acf-c3ba14758663 nodeName:}" failed. No retries permitted until 2026-03-16 18:06:20.843363221 +0000 UTC m=+9282.997294948 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-9twvs" (UniqueName: "kubernetes.io/projected/56f9fc1c-0483-46af-8acf-c3ba14758663-kube-api-access-9twvs") pod "horizon-6496488f84-dmrpf" (UID: "56f9fc1c-0483-46af-8acf-c3ba14758663") : failed to fetch token: serviceaccounts "horizon-horizon" not found Mar 16 18:06:20 crc kubenswrapper[5120]: I0316 18:06:20.321641 5120 generic.go:358] "Generic (PLEG): container finished" podID="6cd1355a-61f9-40cd-b2a4-c1bfa045ca24" containerID="8638c0e26edfa214e3434614b2f196ce36c8a5881eebbd7b1233dc651386dd8e" exitCode=0 Mar 16 18:06:20 crc kubenswrapper[5120]: I0316 18:06:20.321746 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="horizon-kuttl-tests/horizon-66454794bf-n2qnn" event={"ID":"6cd1355a-61f9-40cd-b2a4-c1bfa045ca24","Type":"ContainerDied","Data":"8638c0e26edfa214e3434614b2f196ce36c8a5881eebbd7b1233dc651386dd8e"} Mar 16 18:06:20 crc kubenswrapper[5120]: I0316 18:06:20.321992 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="horizon-kuttl-tests/horizon-6496488f84-dmrpf" Mar 16 18:06:20 crc kubenswrapper[5120]: I0316 18:06:20.391529 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["horizon-kuttl-tests/horizon-6496488f84-dmrpf"] Mar 16 18:06:20 crc kubenswrapper[5120]: I0316 18:06:20.397291 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["horizon-kuttl-tests/horizon-6496488f84-dmrpf"] Mar 16 18:06:20 crc kubenswrapper[5120]: I0316 18:06:20.563398 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/56f9fc1c-0483-46af-8acf-c3ba14758663-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 18:06:20 crc kubenswrapper[5120]: I0316 18:06:20.564166 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/56f9fc1c-0483-46af-8acf-c3ba14758663-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 18:06:20 crc kubenswrapper[5120]: I0316 18:06:20.564206 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9twvs\" (UniqueName: \"kubernetes.io/projected/56f9fc1c-0483-46af-8acf-c3ba14758663-kube-api-access-9twvs\") on node \"crc\" DevicePath \"\"" Mar 16 18:06:20 crc kubenswrapper[5120]: I0316 18:06:20.564234 5120 reconciler_common.go:299] "Volume detached for volume \"horizon-secret-key\" (UniqueName: \"kubernetes.io/secret/56f9fc1c-0483-46af-8acf-c3ba14758663-horizon-secret-key\") on node \"crc\" DevicePath \"\"" Mar 16 18:06:20 crc kubenswrapper[5120]: I0316 18:06:20.675289 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="56f9fc1c-0483-46af-8acf-c3ba14758663" path="/var/lib/kubelet/pods/56f9fc1c-0483-46af-8acf-c3ba14758663/volumes" Mar 16 18:06:22 crc kubenswrapper[5120]: I0316 18:06:22.348895 5120 generic.go:358] "Generic (PLEG): container finished" podID="22eaf065-8471-4582-90ad-2c9fe0813038" containerID="d4aa3029028e72ef90454f7a6327b0bd1bb39d131805216a6053dbf8d3484acc" exitCode=0 Mar 16 18:06:22 crc kubenswrapper[5120]: I0316 18:06:22.348944 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="horizon-kuttl-tests/horizon-574d4f47c7-d4k27" event={"ID":"22eaf065-8471-4582-90ad-2c9fe0813038","Type":"ContainerDied","Data":"d4aa3029028e72ef90454f7a6327b0bd1bb39d131805216a6053dbf8d3484acc"} Mar 16 18:06:22 crc kubenswrapper[5120]: I0316 18:06:22.664138 5120 scope.go:117] "RemoveContainer" containerID="fa578cadb98a23319854b9fc54966313bbc1cee64f90cc75e1f951be3cb08e36" Mar 16 18:06:22 crc kubenswrapper[5120]: E0316 18:06:22.664536 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 18:06:23 crc kubenswrapper[5120]: I0316 18:06:23.709163 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="horizon-kuttl-tests/horizon-66454794bf-n2qnn" podUID="6cd1355a-61f9-40cd-b2a4-c1bfa045ca24" containerName="horizon" probeResult="failure" output="Get \"http://10.217.0.93:8080/dashboard/auth/login/?next=/dashboard/\": dial tcp 10.217.0.93:8080: connect: connection refused" Mar 16 18:06:23 crc kubenswrapper[5120]: I0316 18:06:23.725146 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="horizon-kuttl-tests/horizon-574d4f47c7-d4k27" podUID="22eaf065-8471-4582-90ad-2c9fe0813038" containerName="horizon" probeResult="failure" output="Get \"http://10.217.0.94:8080/dashboard/auth/login/?next=/dashboard/\": dial tcp 10.217.0.94:8080: connect: connection refused" Mar 16 18:06:33 crc kubenswrapper[5120]: I0316 18:06:33.708811 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="horizon-kuttl-tests/horizon-66454794bf-n2qnn" podUID="6cd1355a-61f9-40cd-b2a4-c1bfa045ca24" containerName="horizon" probeResult="failure" output="Get \"http://10.217.0.93:8080/dashboard/auth/login/?next=/dashboard/\": dial tcp 10.217.0.93:8080: connect: connection refused" Mar 16 18:06:33 crc kubenswrapper[5120]: I0316 18:06:33.724155 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="horizon-kuttl-tests/horizon-574d4f47c7-d4k27" podUID="22eaf065-8471-4582-90ad-2c9fe0813038" containerName="horizon" probeResult="failure" output="Get \"http://10.217.0.94:8080/dashboard/auth/login/?next=/dashboard/\": dial tcp 10.217.0.94:8080: connect: connection refused" Mar 16 18:06:34 crc kubenswrapper[5120]: I0316 18:06:34.663979 5120 scope.go:117] "RemoveContainer" containerID="fa578cadb98a23319854b9fc54966313bbc1cee64f90cc75e1f951be3cb08e36" Mar 16 18:06:34 crc kubenswrapper[5120]: E0316 18:06:34.664620 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 18:06:38 crc kubenswrapper[5120]: I0316 18:06:38.714511 5120 scope.go:117] "RemoveContainer" containerID="68804700f5423b3d532fa3e76f5a8623424efbbf8c02fb3455b0268ce49b986e" Mar 16 18:06:38 crc kubenswrapper[5120]: I0316 18:06:38.791534 5120 scope.go:117] "RemoveContainer" containerID="29d9cedb1159cad8e181e5f9ede8040c92b8ea085abd2f4a91953f1dbb6608d7" Mar 16 18:06:43 crc kubenswrapper[5120]: I0316 18:06:43.708894 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="horizon-kuttl-tests/horizon-66454794bf-n2qnn" podUID="6cd1355a-61f9-40cd-b2a4-c1bfa045ca24" containerName="horizon" probeResult="failure" output="Get \"http://10.217.0.93:8080/dashboard/auth/login/?next=/dashboard/\": dial tcp 10.217.0.93:8080: connect: connection refused" Mar 16 18:06:43 crc kubenswrapper[5120]: I0316 18:06:43.709680 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="horizon-kuttl-tests/horizon-66454794bf-n2qnn" Mar 16 18:06:43 crc kubenswrapper[5120]: I0316 18:06:43.725142 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="horizon-kuttl-tests/horizon-574d4f47c7-d4k27" podUID="22eaf065-8471-4582-90ad-2c9fe0813038" containerName="horizon" probeResult="failure" output="Get \"http://10.217.0.94:8080/dashboard/auth/login/?next=/dashboard/\": dial tcp 10.217.0.94:8080: connect: connection refused" Mar 16 18:06:43 crc kubenswrapper[5120]: I0316 18:06:43.725337 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="horizon-kuttl-tests/horizon-574d4f47c7-d4k27" Mar 16 18:06:46 crc kubenswrapper[5120]: I0316 18:06:46.567954 5120 generic.go:358] "Generic (PLEG): container finished" podID="6cd1355a-61f9-40cd-b2a4-c1bfa045ca24" containerID="5be7a8a4ed83d500955c417591fcdbd9246d5ed2600d0944bae909a5eb05e550" exitCode=137 Mar 16 18:06:46 crc kubenswrapper[5120]: I0316 18:06:46.568135 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="horizon-kuttl-tests/horizon-66454794bf-n2qnn" event={"ID":"6cd1355a-61f9-40cd-b2a4-c1bfa045ca24","Type":"ContainerDied","Data":"5be7a8a4ed83d500955c417591fcdbd9246d5ed2600d0944bae909a5eb05e550"} Mar 16 18:06:46 crc kubenswrapper[5120]: I0316 18:06:46.669906 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="horizon-kuttl-tests/horizon-66454794bf-n2qnn" Mar 16 18:06:46 crc kubenswrapper[5120]: I0316 18:06:46.743312 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"horizon-secret-key\" (UniqueName: \"kubernetes.io/secret/6cd1355a-61f9-40cd-b2a4-c1bfa045ca24-horizon-secret-key\") pod \"6cd1355a-61f9-40cd-b2a4-c1bfa045ca24\" (UID: \"6cd1355a-61f9-40cd-b2a4-c1bfa045ca24\") " Mar 16 18:06:46 crc kubenswrapper[5120]: I0316 18:06:46.743464 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6cd1355a-61f9-40cd-b2a4-c1bfa045ca24-logs\") pod \"6cd1355a-61f9-40cd-b2a4-c1bfa045ca24\" (UID: \"6cd1355a-61f9-40cd-b2a4-c1bfa045ca24\") " Mar 16 18:06:46 crc kubenswrapper[5120]: I0316 18:06:46.743850 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/6cd1355a-61f9-40cd-b2a4-c1bfa045ca24-config-data\") pod \"6cd1355a-61f9-40cd-b2a4-c1bfa045ca24\" (UID: \"6cd1355a-61f9-40cd-b2a4-c1bfa045ca24\") " Mar 16 18:06:46 crc kubenswrapper[5120]: I0316 18:06:46.743985 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mdrkt\" (UniqueName: \"kubernetes.io/projected/6cd1355a-61f9-40cd-b2a4-c1bfa045ca24-kube-api-access-mdrkt\") pod \"6cd1355a-61f9-40cd-b2a4-c1bfa045ca24\" (UID: \"6cd1355a-61f9-40cd-b2a4-c1bfa045ca24\") " Mar 16 18:06:46 crc kubenswrapper[5120]: I0316 18:06:46.744110 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/6cd1355a-61f9-40cd-b2a4-c1bfa045ca24-scripts\") pod \"6cd1355a-61f9-40cd-b2a4-c1bfa045ca24\" (UID: \"6cd1355a-61f9-40cd-b2a4-c1bfa045ca24\") " Mar 16 18:06:46 crc kubenswrapper[5120]: I0316 18:06:46.747370 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6cd1355a-61f9-40cd-b2a4-c1bfa045ca24-logs" (OuterVolumeSpecName: "logs") pod "6cd1355a-61f9-40cd-b2a4-c1bfa045ca24" (UID: "6cd1355a-61f9-40cd-b2a4-c1bfa045ca24"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 18:06:46 crc kubenswrapper[5120]: I0316 18:06:46.753147 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6cd1355a-61f9-40cd-b2a4-c1bfa045ca24-horizon-secret-key" (OuterVolumeSpecName: "horizon-secret-key") pod "6cd1355a-61f9-40cd-b2a4-c1bfa045ca24" (UID: "6cd1355a-61f9-40cd-b2a4-c1bfa045ca24"). InnerVolumeSpecName "horizon-secret-key". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 18:06:46 crc kubenswrapper[5120]: I0316 18:06:46.761826 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6cd1355a-61f9-40cd-b2a4-c1bfa045ca24-kube-api-access-mdrkt" (OuterVolumeSpecName: "kube-api-access-mdrkt") pod "6cd1355a-61f9-40cd-b2a4-c1bfa045ca24" (UID: "6cd1355a-61f9-40cd-b2a4-c1bfa045ca24"). InnerVolumeSpecName "kube-api-access-mdrkt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 18:06:46 crc kubenswrapper[5120]: I0316 18:06:46.765291 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6cd1355a-61f9-40cd-b2a4-c1bfa045ca24-config-data" (OuterVolumeSpecName: "config-data") pod "6cd1355a-61f9-40cd-b2a4-c1bfa045ca24" (UID: "6cd1355a-61f9-40cd-b2a4-c1bfa045ca24"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 18:06:46 crc kubenswrapper[5120]: I0316 18:06:46.774530 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6cd1355a-61f9-40cd-b2a4-c1bfa045ca24-scripts" (OuterVolumeSpecName: "scripts") pod "6cd1355a-61f9-40cd-b2a4-c1bfa045ca24" (UID: "6cd1355a-61f9-40cd-b2a4-c1bfa045ca24"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 18:06:46 crc kubenswrapper[5120]: I0316 18:06:46.847620 5120 reconciler_common.go:299] "Volume detached for volume \"horizon-secret-key\" (UniqueName: \"kubernetes.io/secret/6cd1355a-61f9-40cd-b2a4-c1bfa045ca24-horizon-secret-key\") on node \"crc\" DevicePath \"\"" Mar 16 18:06:46 crc kubenswrapper[5120]: I0316 18:06:46.847659 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6cd1355a-61f9-40cd-b2a4-c1bfa045ca24-logs\") on node \"crc\" DevicePath \"\"" Mar 16 18:06:46 crc kubenswrapper[5120]: I0316 18:06:46.847673 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/6cd1355a-61f9-40cd-b2a4-c1bfa045ca24-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 18:06:46 crc kubenswrapper[5120]: I0316 18:06:46.847685 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mdrkt\" (UniqueName: \"kubernetes.io/projected/6cd1355a-61f9-40cd-b2a4-c1bfa045ca24-kube-api-access-mdrkt\") on node \"crc\" DevicePath \"\"" Mar 16 18:06:46 crc kubenswrapper[5120]: I0316 18:06:46.847699 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/6cd1355a-61f9-40cd-b2a4-c1bfa045ca24-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 18:06:47 crc kubenswrapper[5120]: I0316 18:06:47.584109 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="horizon-kuttl-tests/horizon-66454794bf-n2qnn" event={"ID":"6cd1355a-61f9-40cd-b2a4-c1bfa045ca24","Type":"ContainerDied","Data":"cb6a275a3215a09e33bc58c01ba975f5afeedd94a8176d181084ec57c3f25bc8"} Mar 16 18:06:47 crc kubenswrapper[5120]: I0316 18:06:47.584643 5120 scope.go:117] "RemoveContainer" containerID="8638c0e26edfa214e3434614b2f196ce36c8a5881eebbd7b1233dc651386dd8e" Mar 16 18:06:47 crc kubenswrapper[5120]: I0316 18:06:47.584198 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="horizon-kuttl-tests/horizon-66454794bf-n2qnn" Mar 16 18:06:47 crc kubenswrapper[5120]: I0316 18:06:47.653841 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["horizon-kuttl-tests/horizon-66454794bf-n2qnn"] Mar 16 18:06:47 crc kubenswrapper[5120]: I0316 18:06:47.662590 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["horizon-kuttl-tests/horizon-66454794bf-n2qnn"] Mar 16 18:06:47 crc kubenswrapper[5120]: I0316 18:06:47.777706 5120 scope.go:117] "RemoveContainer" containerID="5be7a8a4ed83d500955c417591fcdbd9246d5ed2600d0944bae909a5eb05e550" Mar 16 18:06:48 crc kubenswrapper[5120]: I0316 18:06:48.415846 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-v822j_ac55471d-4e42-475f-a082-50f611571482/kube-multus/0.log" Mar 16 18:06:48 crc kubenswrapper[5120]: I0316 18:06:48.420795 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-crc_9f0bc7fcb0822a2c13eb2d22cd8c0641/kube-controller-manager/0.log" Mar 16 18:06:48 crc kubenswrapper[5120]: I0316 18:06:48.672747 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6cd1355a-61f9-40cd-b2a4-c1bfa045ca24" path="/var/lib/kubelet/pods/6cd1355a-61f9-40cd-b2a4-c1bfa045ca24/volumes" Mar 16 18:06:48 crc kubenswrapper[5120]: I0316 18:06:48.674378 5120 scope.go:117] "RemoveContainer" containerID="fa578cadb98a23319854b9fc54966313bbc1cee64f90cc75e1f951be3cb08e36" Mar 16 18:06:48 crc kubenswrapper[5120]: E0316 18:06:48.674694 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 18:06:48 crc kubenswrapper[5120]: I0316 18:06:48.688731 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-v822j_ac55471d-4e42-475f-a082-50f611571482/kube-multus/0.log" Mar 16 18:06:48 crc kubenswrapper[5120]: I0316 18:06:48.694142 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-crc_9f0bc7fcb0822a2c13eb2d22cd8c0641/kube-controller-manager/0.log" Mar 16 18:06:49 crc kubenswrapper[5120]: I0316 18:06:49.480940 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="horizon-kuttl-tests/horizon-574d4f47c7-d4k27" Mar 16 18:06:49 crc kubenswrapper[5120]: I0316 18:06:49.602700 5120 generic.go:358] "Generic (PLEG): container finished" podID="22eaf065-8471-4582-90ad-2c9fe0813038" containerID="acfa9c978bb598d03c98fc4abfeda9683df83e732a05cd8f792aaa43dadba5ac" exitCode=137 Mar 16 18:06:49 crc kubenswrapper[5120]: I0316 18:06:49.602787 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="horizon-kuttl-tests/horizon-574d4f47c7-d4k27" event={"ID":"22eaf065-8471-4582-90ad-2c9fe0813038","Type":"ContainerDied","Data":"acfa9c978bb598d03c98fc4abfeda9683df83e732a05cd8f792aaa43dadba5ac"} Mar 16 18:06:49 crc kubenswrapper[5120]: I0316 18:06:49.602829 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="horizon-kuttl-tests/horizon-574d4f47c7-d4k27" event={"ID":"22eaf065-8471-4582-90ad-2c9fe0813038","Type":"ContainerDied","Data":"83c55476ffcb1912e1b8b70bcc5f621b37cdea1eab1ec539af4cc24627073d68"} Mar 16 18:06:49 crc kubenswrapper[5120]: I0316 18:06:49.602798 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="horizon-kuttl-tests/horizon-574d4f47c7-d4k27" Mar 16 18:06:49 crc kubenswrapper[5120]: I0316 18:06:49.602843 5120 scope.go:117] "RemoveContainer" containerID="d4aa3029028e72ef90454f7a6327b0bd1bb39d131805216a6053dbf8d3484acc" Mar 16 18:06:49 crc kubenswrapper[5120]: I0316 18:06:49.613579 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/22eaf065-8471-4582-90ad-2c9fe0813038-scripts\") pod \"22eaf065-8471-4582-90ad-2c9fe0813038\" (UID: \"22eaf065-8471-4582-90ad-2c9fe0813038\") " Mar 16 18:06:49 crc kubenswrapper[5120]: I0316 18:06:49.614017 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"horizon-secret-key\" (UniqueName: \"kubernetes.io/secret/22eaf065-8471-4582-90ad-2c9fe0813038-horizon-secret-key\") pod \"22eaf065-8471-4582-90ad-2c9fe0813038\" (UID: \"22eaf065-8471-4582-90ad-2c9fe0813038\") " Mar 16 18:06:49 crc kubenswrapper[5120]: I0316 18:06:49.614244 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/22eaf065-8471-4582-90ad-2c9fe0813038-logs\") pod \"22eaf065-8471-4582-90ad-2c9fe0813038\" (UID: \"22eaf065-8471-4582-90ad-2c9fe0813038\") " Mar 16 18:06:49 crc kubenswrapper[5120]: I0316 18:06:49.614457 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/22eaf065-8471-4582-90ad-2c9fe0813038-config-data\") pod \"22eaf065-8471-4582-90ad-2c9fe0813038\" (UID: \"22eaf065-8471-4582-90ad-2c9fe0813038\") " Mar 16 18:06:49 crc kubenswrapper[5120]: I0316 18:06:49.614594 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lsfrh\" (UniqueName: \"kubernetes.io/projected/22eaf065-8471-4582-90ad-2c9fe0813038-kube-api-access-lsfrh\") pod \"22eaf065-8471-4582-90ad-2c9fe0813038\" (UID: \"22eaf065-8471-4582-90ad-2c9fe0813038\") " Mar 16 18:06:49 crc kubenswrapper[5120]: I0316 18:06:49.616455 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/22eaf065-8471-4582-90ad-2c9fe0813038-logs" (OuterVolumeSpecName: "logs") pod "22eaf065-8471-4582-90ad-2c9fe0813038" (UID: "22eaf065-8471-4582-90ad-2c9fe0813038"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 18:06:49 crc kubenswrapper[5120]: I0316 18:06:49.620726 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/22eaf065-8471-4582-90ad-2c9fe0813038-horizon-secret-key" (OuterVolumeSpecName: "horizon-secret-key") pod "22eaf065-8471-4582-90ad-2c9fe0813038" (UID: "22eaf065-8471-4582-90ad-2c9fe0813038"). InnerVolumeSpecName "horizon-secret-key". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 18:06:49 crc kubenswrapper[5120]: I0316 18:06:49.626672 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22eaf065-8471-4582-90ad-2c9fe0813038-kube-api-access-lsfrh" (OuterVolumeSpecName: "kube-api-access-lsfrh") pod "22eaf065-8471-4582-90ad-2c9fe0813038" (UID: "22eaf065-8471-4582-90ad-2c9fe0813038"). InnerVolumeSpecName "kube-api-access-lsfrh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 18:06:49 crc kubenswrapper[5120]: I0316 18:06:49.633367 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/22eaf065-8471-4582-90ad-2c9fe0813038-config-data" (OuterVolumeSpecName: "config-data") pod "22eaf065-8471-4582-90ad-2c9fe0813038" (UID: "22eaf065-8471-4582-90ad-2c9fe0813038"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 18:06:49 crc kubenswrapper[5120]: I0316 18:06:49.634056 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/22eaf065-8471-4582-90ad-2c9fe0813038-scripts" (OuterVolumeSpecName: "scripts") pod "22eaf065-8471-4582-90ad-2c9fe0813038" (UID: "22eaf065-8471-4582-90ad-2c9fe0813038"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 18:06:49 crc kubenswrapper[5120]: I0316 18:06:49.717094 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/22eaf065-8471-4582-90ad-2c9fe0813038-logs\") on node \"crc\" DevicePath \"\"" Mar 16 18:06:49 crc kubenswrapper[5120]: I0316 18:06:49.717137 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/22eaf065-8471-4582-90ad-2c9fe0813038-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 18:06:49 crc kubenswrapper[5120]: I0316 18:06:49.717149 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lsfrh\" (UniqueName: \"kubernetes.io/projected/22eaf065-8471-4582-90ad-2c9fe0813038-kube-api-access-lsfrh\") on node \"crc\" DevicePath \"\"" Mar 16 18:06:49 crc kubenswrapper[5120]: I0316 18:06:49.717160 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/22eaf065-8471-4582-90ad-2c9fe0813038-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 18:06:49 crc kubenswrapper[5120]: I0316 18:06:49.717170 5120 reconciler_common.go:299] "Volume detached for volume \"horizon-secret-key\" (UniqueName: \"kubernetes.io/secret/22eaf065-8471-4582-90ad-2c9fe0813038-horizon-secret-key\") on node \"crc\" DevicePath \"\"" Mar 16 18:06:49 crc kubenswrapper[5120]: I0316 18:06:49.771992 5120 scope.go:117] "RemoveContainer" containerID="acfa9c978bb598d03c98fc4abfeda9683df83e732a05cd8f792aaa43dadba5ac" Mar 16 18:06:49 crc kubenswrapper[5120]: I0316 18:06:49.795317 5120 scope.go:117] "RemoveContainer" containerID="d4aa3029028e72ef90454f7a6327b0bd1bb39d131805216a6053dbf8d3484acc" Mar 16 18:06:49 crc kubenswrapper[5120]: E0316 18:06:49.797676 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d4aa3029028e72ef90454f7a6327b0bd1bb39d131805216a6053dbf8d3484acc\": container with ID starting with d4aa3029028e72ef90454f7a6327b0bd1bb39d131805216a6053dbf8d3484acc not found: ID does not exist" containerID="d4aa3029028e72ef90454f7a6327b0bd1bb39d131805216a6053dbf8d3484acc" Mar 16 18:06:49 crc kubenswrapper[5120]: I0316 18:06:49.797739 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4aa3029028e72ef90454f7a6327b0bd1bb39d131805216a6053dbf8d3484acc"} err="failed to get container status \"d4aa3029028e72ef90454f7a6327b0bd1bb39d131805216a6053dbf8d3484acc\": rpc error: code = NotFound desc = could not find container \"d4aa3029028e72ef90454f7a6327b0bd1bb39d131805216a6053dbf8d3484acc\": container with ID starting with d4aa3029028e72ef90454f7a6327b0bd1bb39d131805216a6053dbf8d3484acc not found: ID does not exist" Mar 16 18:06:49 crc kubenswrapper[5120]: I0316 18:06:49.797804 5120 scope.go:117] "RemoveContainer" containerID="acfa9c978bb598d03c98fc4abfeda9683df83e732a05cd8f792aaa43dadba5ac" Mar 16 18:06:49 crc kubenswrapper[5120]: E0316 18:06:49.798377 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"acfa9c978bb598d03c98fc4abfeda9683df83e732a05cd8f792aaa43dadba5ac\": container with ID starting with acfa9c978bb598d03c98fc4abfeda9683df83e732a05cd8f792aaa43dadba5ac not found: ID does not exist" containerID="acfa9c978bb598d03c98fc4abfeda9683df83e732a05cd8f792aaa43dadba5ac" Mar 16 18:06:49 crc kubenswrapper[5120]: I0316 18:06:49.798417 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"acfa9c978bb598d03c98fc4abfeda9683df83e732a05cd8f792aaa43dadba5ac"} err="failed to get container status \"acfa9c978bb598d03c98fc4abfeda9683df83e732a05cd8f792aaa43dadba5ac\": rpc error: code = NotFound desc = could not find container \"acfa9c978bb598d03c98fc4abfeda9683df83e732a05cd8f792aaa43dadba5ac\": container with ID starting with acfa9c978bb598d03c98fc4abfeda9683df83e732a05cd8f792aaa43dadba5ac not found: ID does not exist" Mar 16 18:06:49 crc kubenswrapper[5120]: I0316 18:06:49.932182 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["horizon-kuttl-tests/horizon-574d4f47c7-d4k27"] Mar 16 18:06:49 crc kubenswrapper[5120]: I0316 18:06:49.937428 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["horizon-kuttl-tests/horizon-574d4f47c7-d4k27"] Mar 16 18:06:50 crc kubenswrapper[5120]: I0316 18:06:50.672800 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="22eaf065-8471-4582-90ad-2c9fe0813038" path="/var/lib/kubelet/pods/22eaf065-8471-4582-90ad-2c9fe0813038/volumes" Mar 16 18:06:51 crc kubenswrapper[5120]: I0316 18:06:51.144093 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["horizon-kuttl-tests/horizon-d759d5d66-p24qb"] Mar 16 18:06:51 crc kubenswrapper[5120]: I0316 18:06:51.148356 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22eaf065-8471-4582-90ad-2c9fe0813038" containerName="horizon-log" Mar 16 18:06:51 crc kubenswrapper[5120]: I0316 18:06:51.148390 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="22eaf065-8471-4582-90ad-2c9fe0813038" containerName="horizon-log" Mar 16 18:06:51 crc kubenswrapper[5120]: I0316 18:06:51.148405 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22eaf065-8471-4582-90ad-2c9fe0813038" containerName="horizon" Mar 16 18:06:51 crc kubenswrapper[5120]: I0316 18:06:51.148411 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="22eaf065-8471-4582-90ad-2c9fe0813038" containerName="horizon" Mar 16 18:06:51 crc kubenswrapper[5120]: I0316 18:06:51.148424 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6cd1355a-61f9-40cd-b2a4-c1bfa045ca24" containerName="horizon-log" Mar 16 18:06:51 crc kubenswrapper[5120]: I0316 18:06:51.148433 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="6cd1355a-61f9-40cd-b2a4-c1bfa045ca24" containerName="horizon-log" Mar 16 18:06:51 crc kubenswrapper[5120]: I0316 18:06:51.148444 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6cd1355a-61f9-40cd-b2a4-c1bfa045ca24" containerName="horizon" Mar 16 18:06:51 crc kubenswrapper[5120]: I0316 18:06:51.148449 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="6cd1355a-61f9-40cd-b2a4-c1bfa045ca24" containerName="horizon" Mar 16 18:06:51 crc kubenswrapper[5120]: I0316 18:06:51.148572 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="22eaf065-8471-4582-90ad-2c9fe0813038" containerName="horizon" Mar 16 18:06:51 crc kubenswrapper[5120]: I0316 18:06:51.148586 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="22eaf065-8471-4582-90ad-2c9fe0813038" containerName="horizon-log" Mar 16 18:06:51 crc kubenswrapper[5120]: I0316 18:06:51.148606 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="6cd1355a-61f9-40cd-b2a4-c1bfa045ca24" containerName="horizon" Mar 16 18:06:51 crc kubenswrapper[5120]: I0316 18:06:51.148619 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="6cd1355a-61f9-40cd-b2a4-c1bfa045ca24" containerName="horizon-log" Mar 16 18:06:51 crc kubenswrapper[5120]: I0316 18:06:51.158496 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="horizon-kuttl-tests/horizon-d759d5d66-p24qb" Mar 16 18:06:51 crc kubenswrapper[5120]: I0316 18:06:51.164663 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"horizon-kuttl-tests\"/\"horizon\"" Mar 16 18:06:51 crc kubenswrapper[5120]: I0316 18:06:51.165076 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"horizon-kuttl-tests\"/\"horizon-scripts\"" Mar 16 18:06:51 crc kubenswrapper[5120]: I0316 18:06:51.165357 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"horizon-kuttl-tests\"/\"combined-ca-bundle\"" Mar 16 18:06:51 crc kubenswrapper[5120]: I0316 18:06:51.166112 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["horizon-kuttl-tests/horizon-d759d5d66-p24qb"] Mar 16 18:06:51 crc kubenswrapper[5120]: I0316 18:06:51.171080 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"horizon-kuttl-tests\"/\"horizon-config-data\"" Mar 16 18:06:51 crc kubenswrapper[5120]: I0316 18:06:51.171626 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"horizon-kuttl-tests\"/\"cert-horizon-svc\"" Mar 16 18:06:51 crc kubenswrapper[5120]: I0316 18:06:51.172109 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"horizon-kuttl-tests\"/\"horizon-horizon-dockercfg-66wqz\"" Mar 16 18:06:51 crc kubenswrapper[5120]: I0316 18:06:51.254807 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f1b36217-34ad-4d8b-a12a-f410868bf035-combined-ca-bundle\") pod \"horizon-d759d5d66-p24qb\" (UID: \"f1b36217-34ad-4d8b-a12a-f410868bf035\") " pod="horizon-kuttl-tests/horizon-d759d5d66-p24qb" Mar 16 18:06:51 crc kubenswrapper[5120]: I0316 18:06:51.254965 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"horizon-tls-certs\" (UniqueName: \"kubernetes.io/secret/f1b36217-34ad-4d8b-a12a-f410868bf035-horizon-tls-certs\") pod \"horizon-d759d5d66-p24qb\" (UID: \"f1b36217-34ad-4d8b-a12a-f410868bf035\") " pod="horizon-kuttl-tests/horizon-d759d5d66-p24qb" Mar 16 18:06:51 crc kubenswrapper[5120]: I0316 18:06:51.254998 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f1b36217-34ad-4d8b-a12a-f410868bf035-logs\") pod \"horizon-d759d5d66-p24qb\" (UID: \"f1b36217-34ad-4d8b-a12a-f410868bf035\") " pod="horizon-kuttl-tests/horizon-d759d5d66-p24qb" Mar 16 18:06:51 crc kubenswrapper[5120]: I0316 18:06:51.255080 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/f1b36217-34ad-4d8b-a12a-f410868bf035-scripts\") pod \"horizon-d759d5d66-p24qb\" (UID: \"f1b36217-34ad-4d8b-a12a-f410868bf035\") " pod="horizon-kuttl-tests/horizon-d759d5d66-p24qb" Mar 16 18:06:51 crc kubenswrapper[5120]: I0316 18:06:51.255121 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"horizon-secret-key\" (UniqueName: \"kubernetes.io/secret/f1b36217-34ad-4d8b-a12a-f410868bf035-horizon-secret-key\") pod \"horizon-d759d5d66-p24qb\" (UID: \"f1b36217-34ad-4d8b-a12a-f410868bf035\") " pod="horizon-kuttl-tests/horizon-d759d5d66-p24qb" Mar 16 18:06:51 crc kubenswrapper[5120]: I0316 18:06:51.255161 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/f1b36217-34ad-4d8b-a12a-f410868bf035-config-data\") pod \"horizon-d759d5d66-p24qb\" (UID: \"f1b36217-34ad-4d8b-a12a-f410868bf035\") " pod="horizon-kuttl-tests/horizon-d759d5d66-p24qb" Mar 16 18:06:51 crc kubenswrapper[5120]: I0316 18:06:51.255205 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpgcj\" (UniqueName: \"kubernetes.io/projected/f1b36217-34ad-4d8b-a12a-f410868bf035-kube-api-access-cpgcj\") pod \"horizon-d759d5d66-p24qb\" (UID: \"f1b36217-34ad-4d8b-a12a-f410868bf035\") " pod="horizon-kuttl-tests/horizon-d759d5d66-p24qb" Mar 16 18:06:51 crc kubenswrapper[5120]: I0316 18:06:51.264630 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["horizon-kuttl-tests/horizon-599695d8c4-kh6rf"] Mar 16 18:06:51 crc kubenswrapper[5120]: I0316 18:06:51.272514 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="horizon-kuttl-tests/horizon-599695d8c4-kh6rf" Mar 16 18:06:51 crc kubenswrapper[5120]: I0316 18:06:51.280637 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["horizon-kuttl-tests/horizon-599695d8c4-kh6rf"] Mar 16 18:06:51 crc kubenswrapper[5120]: I0316 18:06:51.357313 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8e3543d6-47c6-406b-ada0-840ad8d7ecc0-combined-ca-bundle\") pod \"horizon-599695d8c4-kh6rf\" (UID: \"8e3543d6-47c6-406b-ada0-840ad8d7ecc0\") " pod="horizon-kuttl-tests/horizon-599695d8c4-kh6rf" Mar 16 18:06:51 crc kubenswrapper[5120]: I0316 18:06:51.357384 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"horizon-secret-key\" (UniqueName: \"kubernetes.io/secret/8e3543d6-47c6-406b-ada0-840ad8d7ecc0-horizon-secret-key\") pod \"horizon-599695d8c4-kh6rf\" (UID: \"8e3543d6-47c6-406b-ada0-840ad8d7ecc0\") " pod="horizon-kuttl-tests/horizon-599695d8c4-kh6rf" Mar 16 18:06:51 crc kubenswrapper[5120]: I0316 18:06:51.357437 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/f1b36217-34ad-4d8b-a12a-f410868bf035-scripts\") pod \"horizon-d759d5d66-p24qb\" (UID: \"f1b36217-34ad-4d8b-a12a-f410868bf035\") " pod="horizon-kuttl-tests/horizon-d759d5d66-p24qb" Mar 16 18:06:51 crc kubenswrapper[5120]: I0316 18:06:51.357660 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"horizon-secret-key\" (UniqueName: \"kubernetes.io/secret/f1b36217-34ad-4d8b-a12a-f410868bf035-horizon-secret-key\") pod \"horizon-d759d5d66-p24qb\" (UID: \"f1b36217-34ad-4d8b-a12a-f410868bf035\") " pod="horizon-kuttl-tests/horizon-d759d5d66-p24qb" Mar 16 18:06:51 crc kubenswrapper[5120]: I0316 18:06:51.357886 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/f1b36217-34ad-4d8b-a12a-f410868bf035-config-data\") pod \"horizon-d759d5d66-p24qb\" (UID: \"f1b36217-34ad-4d8b-a12a-f410868bf035\") " pod="horizon-kuttl-tests/horizon-d759d5d66-p24qb" Mar 16 18:06:51 crc kubenswrapper[5120]: I0316 18:06:51.358029 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/8e3543d6-47c6-406b-ada0-840ad8d7ecc0-config-data\") pod \"horizon-599695d8c4-kh6rf\" (UID: \"8e3543d6-47c6-406b-ada0-840ad8d7ecc0\") " pod="horizon-kuttl-tests/horizon-599695d8c4-kh6rf" Mar 16 18:06:51 crc kubenswrapper[5120]: I0316 18:06:51.358097 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cpgcj\" (UniqueName: \"kubernetes.io/projected/f1b36217-34ad-4d8b-a12a-f410868bf035-kube-api-access-cpgcj\") pod \"horizon-d759d5d66-p24qb\" (UID: \"f1b36217-34ad-4d8b-a12a-f410868bf035\") " pod="horizon-kuttl-tests/horizon-d759d5d66-p24qb" Mar 16 18:06:51 crc kubenswrapper[5120]: I0316 18:06:51.358167 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbvqf\" (UniqueName: \"kubernetes.io/projected/8e3543d6-47c6-406b-ada0-840ad8d7ecc0-kube-api-access-zbvqf\") pod \"horizon-599695d8c4-kh6rf\" (UID: \"8e3543d6-47c6-406b-ada0-840ad8d7ecc0\") " pod="horizon-kuttl-tests/horizon-599695d8c4-kh6rf" Mar 16 18:06:51 crc kubenswrapper[5120]: I0316 18:06:51.358230 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/f1b36217-34ad-4d8b-a12a-f410868bf035-scripts\") pod \"horizon-d759d5d66-p24qb\" (UID: \"f1b36217-34ad-4d8b-a12a-f410868bf035\") " pod="horizon-kuttl-tests/horizon-d759d5d66-p24qb" Mar 16 18:06:51 crc kubenswrapper[5120]: I0316 18:06:51.358459 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8e3543d6-47c6-406b-ada0-840ad8d7ecc0-logs\") pod \"horizon-599695d8c4-kh6rf\" (UID: \"8e3543d6-47c6-406b-ada0-840ad8d7ecc0\") " pod="horizon-kuttl-tests/horizon-599695d8c4-kh6rf" Mar 16 18:06:51 crc kubenswrapper[5120]: I0316 18:06:51.358543 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/8e3543d6-47c6-406b-ada0-840ad8d7ecc0-scripts\") pod \"horizon-599695d8c4-kh6rf\" (UID: \"8e3543d6-47c6-406b-ada0-840ad8d7ecc0\") " pod="horizon-kuttl-tests/horizon-599695d8c4-kh6rf" Mar 16 18:06:51 crc kubenswrapper[5120]: I0316 18:06:51.358642 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f1b36217-34ad-4d8b-a12a-f410868bf035-combined-ca-bundle\") pod \"horizon-d759d5d66-p24qb\" (UID: \"f1b36217-34ad-4d8b-a12a-f410868bf035\") " pod="horizon-kuttl-tests/horizon-d759d5d66-p24qb" Mar 16 18:06:51 crc kubenswrapper[5120]: I0316 18:06:51.358970 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"horizon-tls-certs\" (UniqueName: \"kubernetes.io/secret/8e3543d6-47c6-406b-ada0-840ad8d7ecc0-horizon-tls-certs\") pod \"horizon-599695d8c4-kh6rf\" (UID: \"8e3543d6-47c6-406b-ada0-840ad8d7ecc0\") " pod="horizon-kuttl-tests/horizon-599695d8c4-kh6rf" Mar 16 18:06:51 crc kubenswrapper[5120]: I0316 18:06:51.359029 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"horizon-tls-certs\" (UniqueName: \"kubernetes.io/secret/f1b36217-34ad-4d8b-a12a-f410868bf035-horizon-tls-certs\") pod \"horizon-d759d5d66-p24qb\" (UID: \"f1b36217-34ad-4d8b-a12a-f410868bf035\") " pod="horizon-kuttl-tests/horizon-d759d5d66-p24qb" Mar 16 18:06:51 crc kubenswrapper[5120]: I0316 18:06:51.359067 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f1b36217-34ad-4d8b-a12a-f410868bf035-logs\") pod \"horizon-d759d5d66-p24qb\" (UID: \"f1b36217-34ad-4d8b-a12a-f410868bf035\") " pod="horizon-kuttl-tests/horizon-d759d5d66-p24qb" Mar 16 18:06:51 crc kubenswrapper[5120]: I0316 18:06:51.359242 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/f1b36217-34ad-4d8b-a12a-f410868bf035-config-data\") pod \"horizon-d759d5d66-p24qb\" (UID: \"f1b36217-34ad-4d8b-a12a-f410868bf035\") " pod="horizon-kuttl-tests/horizon-d759d5d66-p24qb" Mar 16 18:06:51 crc kubenswrapper[5120]: I0316 18:06:51.359430 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f1b36217-34ad-4d8b-a12a-f410868bf035-logs\") pod \"horizon-d759d5d66-p24qb\" (UID: \"f1b36217-34ad-4d8b-a12a-f410868bf035\") " pod="horizon-kuttl-tests/horizon-d759d5d66-p24qb" Mar 16 18:06:51 crc kubenswrapper[5120]: I0316 18:06:51.364573 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f1b36217-34ad-4d8b-a12a-f410868bf035-combined-ca-bundle\") pod \"horizon-d759d5d66-p24qb\" (UID: \"f1b36217-34ad-4d8b-a12a-f410868bf035\") " pod="horizon-kuttl-tests/horizon-d759d5d66-p24qb" Mar 16 18:06:51 crc kubenswrapper[5120]: I0316 18:06:51.364672 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"horizon-tls-certs\" (UniqueName: \"kubernetes.io/secret/f1b36217-34ad-4d8b-a12a-f410868bf035-horizon-tls-certs\") pod \"horizon-d759d5d66-p24qb\" (UID: \"f1b36217-34ad-4d8b-a12a-f410868bf035\") " pod="horizon-kuttl-tests/horizon-d759d5d66-p24qb" Mar 16 18:06:51 crc kubenswrapper[5120]: I0316 18:06:51.364696 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"horizon-secret-key\" (UniqueName: \"kubernetes.io/secret/f1b36217-34ad-4d8b-a12a-f410868bf035-horizon-secret-key\") pod \"horizon-d759d5d66-p24qb\" (UID: \"f1b36217-34ad-4d8b-a12a-f410868bf035\") " pod="horizon-kuttl-tests/horizon-d759d5d66-p24qb" Mar 16 18:06:51 crc kubenswrapper[5120]: I0316 18:06:51.377602 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpgcj\" (UniqueName: \"kubernetes.io/projected/f1b36217-34ad-4d8b-a12a-f410868bf035-kube-api-access-cpgcj\") pod \"horizon-d759d5d66-p24qb\" (UID: \"f1b36217-34ad-4d8b-a12a-f410868bf035\") " pod="horizon-kuttl-tests/horizon-d759d5d66-p24qb" Mar 16 18:06:51 crc kubenswrapper[5120]: I0316 18:06:51.461340 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8e3543d6-47c6-406b-ada0-840ad8d7ecc0-combined-ca-bundle\") pod \"horizon-599695d8c4-kh6rf\" (UID: \"8e3543d6-47c6-406b-ada0-840ad8d7ecc0\") " pod="horizon-kuttl-tests/horizon-599695d8c4-kh6rf" Mar 16 18:06:51 crc kubenswrapper[5120]: I0316 18:06:51.461388 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"horizon-secret-key\" (UniqueName: \"kubernetes.io/secret/8e3543d6-47c6-406b-ada0-840ad8d7ecc0-horizon-secret-key\") pod \"horizon-599695d8c4-kh6rf\" (UID: \"8e3543d6-47c6-406b-ada0-840ad8d7ecc0\") " pod="horizon-kuttl-tests/horizon-599695d8c4-kh6rf" Mar 16 18:06:51 crc kubenswrapper[5120]: I0316 18:06:51.461480 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/8e3543d6-47c6-406b-ada0-840ad8d7ecc0-config-data\") pod \"horizon-599695d8c4-kh6rf\" (UID: \"8e3543d6-47c6-406b-ada0-840ad8d7ecc0\") " pod="horizon-kuttl-tests/horizon-599695d8c4-kh6rf" Mar 16 18:06:51 crc kubenswrapper[5120]: I0316 18:06:51.461512 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zbvqf\" (UniqueName: \"kubernetes.io/projected/8e3543d6-47c6-406b-ada0-840ad8d7ecc0-kube-api-access-zbvqf\") pod \"horizon-599695d8c4-kh6rf\" (UID: \"8e3543d6-47c6-406b-ada0-840ad8d7ecc0\") " pod="horizon-kuttl-tests/horizon-599695d8c4-kh6rf" Mar 16 18:06:51 crc kubenswrapper[5120]: I0316 18:06:51.461595 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8e3543d6-47c6-406b-ada0-840ad8d7ecc0-logs\") pod \"horizon-599695d8c4-kh6rf\" (UID: \"8e3543d6-47c6-406b-ada0-840ad8d7ecc0\") " pod="horizon-kuttl-tests/horizon-599695d8c4-kh6rf" Mar 16 18:06:51 crc kubenswrapper[5120]: I0316 18:06:51.461620 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/8e3543d6-47c6-406b-ada0-840ad8d7ecc0-scripts\") pod \"horizon-599695d8c4-kh6rf\" (UID: \"8e3543d6-47c6-406b-ada0-840ad8d7ecc0\") " pod="horizon-kuttl-tests/horizon-599695d8c4-kh6rf" Mar 16 18:06:51 crc kubenswrapper[5120]: I0316 18:06:51.461768 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"horizon-tls-certs\" (UniqueName: \"kubernetes.io/secret/8e3543d6-47c6-406b-ada0-840ad8d7ecc0-horizon-tls-certs\") pod \"horizon-599695d8c4-kh6rf\" (UID: \"8e3543d6-47c6-406b-ada0-840ad8d7ecc0\") " pod="horizon-kuttl-tests/horizon-599695d8c4-kh6rf" Mar 16 18:06:51 crc kubenswrapper[5120]: I0316 18:06:51.462586 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8e3543d6-47c6-406b-ada0-840ad8d7ecc0-logs\") pod \"horizon-599695d8c4-kh6rf\" (UID: \"8e3543d6-47c6-406b-ada0-840ad8d7ecc0\") " pod="horizon-kuttl-tests/horizon-599695d8c4-kh6rf" Mar 16 18:06:51 crc kubenswrapper[5120]: I0316 18:06:51.462883 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/8e3543d6-47c6-406b-ada0-840ad8d7ecc0-scripts\") pod \"horizon-599695d8c4-kh6rf\" (UID: \"8e3543d6-47c6-406b-ada0-840ad8d7ecc0\") " pod="horizon-kuttl-tests/horizon-599695d8c4-kh6rf" Mar 16 18:06:51 crc kubenswrapper[5120]: I0316 18:06:51.463428 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/8e3543d6-47c6-406b-ada0-840ad8d7ecc0-config-data\") pod \"horizon-599695d8c4-kh6rf\" (UID: \"8e3543d6-47c6-406b-ada0-840ad8d7ecc0\") " pod="horizon-kuttl-tests/horizon-599695d8c4-kh6rf" Mar 16 18:06:51 crc kubenswrapper[5120]: I0316 18:06:51.465285 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"horizon-secret-key\" (UniqueName: \"kubernetes.io/secret/8e3543d6-47c6-406b-ada0-840ad8d7ecc0-horizon-secret-key\") pod \"horizon-599695d8c4-kh6rf\" (UID: \"8e3543d6-47c6-406b-ada0-840ad8d7ecc0\") " pod="horizon-kuttl-tests/horizon-599695d8c4-kh6rf" Mar 16 18:06:51 crc kubenswrapper[5120]: I0316 18:06:51.466311 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8e3543d6-47c6-406b-ada0-840ad8d7ecc0-combined-ca-bundle\") pod \"horizon-599695d8c4-kh6rf\" (UID: \"8e3543d6-47c6-406b-ada0-840ad8d7ecc0\") " pod="horizon-kuttl-tests/horizon-599695d8c4-kh6rf" Mar 16 18:06:51 crc kubenswrapper[5120]: I0316 18:06:51.472563 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"horizon-tls-certs\" (UniqueName: \"kubernetes.io/secret/8e3543d6-47c6-406b-ada0-840ad8d7ecc0-horizon-tls-certs\") pod \"horizon-599695d8c4-kh6rf\" (UID: \"8e3543d6-47c6-406b-ada0-840ad8d7ecc0\") " pod="horizon-kuttl-tests/horizon-599695d8c4-kh6rf" Mar 16 18:06:51 crc kubenswrapper[5120]: I0316 18:06:51.484227 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbvqf\" (UniqueName: \"kubernetes.io/projected/8e3543d6-47c6-406b-ada0-840ad8d7ecc0-kube-api-access-zbvqf\") pod \"horizon-599695d8c4-kh6rf\" (UID: \"8e3543d6-47c6-406b-ada0-840ad8d7ecc0\") " pod="horizon-kuttl-tests/horizon-599695d8c4-kh6rf" Mar 16 18:06:51 crc kubenswrapper[5120]: I0316 18:06:51.515510 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="horizon-kuttl-tests/horizon-d759d5d66-p24qb" Mar 16 18:06:51 crc kubenswrapper[5120]: I0316 18:06:51.589970 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="horizon-kuttl-tests/horizon-599695d8c4-kh6rf" Mar 16 18:06:51 crc kubenswrapper[5120]: I0316 18:06:51.930988 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["horizon-kuttl-tests/horizon-d759d5d66-p24qb"] Mar 16 18:06:51 crc kubenswrapper[5120]: W0316 18:06:51.948037 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf1b36217_34ad_4d8b_a12a_f410868bf035.slice/crio-ac00a36f6aa80e86f43c375708805911fd941002b87b43e9db9120368893f488 WatchSource:0}: Error finding container ac00a36f6aa80e86f43c375708805911fd941002b87b43e9db9120368893f488: Status 404 returned error can't find the container with id ac00a36f6aa80e86f43c375708805911fd941002b87b43e9db9120368893f488 Mar 16 18:06:52 crc kubenswrapper[5120]: I0316 18:06:52.025217 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["horizon-kuttl-tests/horizon-599695d8c4-kh6rf"] Mar 16 18:06:52 crc kubenswrapper[5120]: W0316 18:06:52.035090 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8e3543d6_47c6_406b_ada0_840ad8d7ecc0.slice/crio-6a2a439bc650b34835f8617075b12c38df16929a330c353e5e8aa13384ac1ade WatchSource:0}: Error finding container 6a2a439bc650b34835f8617075b12c38df16929a330c353e5e8aa13384ac1ade: Status 404 returned error can't find the container with id 6a2a439bc650b34835f8617075b12c38df16929a330c353e5e8aa13384ac1ade Mar 16 18:06:52 crc kubenswrapper[5120]: I0316 18:06:52.633113 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="horizon-kuttl-tests/horizon-599695d8c4-kh6rf" event={"ID":"8e3543d6-47c6-406b-ada0-840ad8d7ecc0","Type":"ContainerStarted","Data":"fb67258f5d3aa802e75604f511db586a72af2b1fe96de038d9996695eaa16054"} Mar 16 18:06:52 crc kubenswrapper[5120]: I0316 18:06:52.633362 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="horizon-kuttl-tests/horizon-599695d8c4-kh6rf" event={"ID":"8e3543d6-47c6-406b-ada0-840ad8d7ecc0","Type":"ContainerStarted","Data":"11b452ead841cfcc5e1c277ff680d32da85e6f77378c6beb65cac0db505e0c60"} Mar 16 18:06:52 crc kubenswrapper[5120]: I0316 18:06:52.633372 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="horizon-kuttl-tests/horizon-599695d8c4-kh6rf" event={"ID":"8e3543d6-47c6-406b-ada0-840ad8d7ecc0","Type":"ContainerStarted","Data":"6a2a439bc650b34835f8617075b12c38df16929a330c353e5e8aa13384ac1ade"} Mar 16 18:06:52 crc kubenswrapper[5120]: I0316 18:06:52.635219 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="horizon-kuttl-tests/horizon-d759d5d66-p24qb" event={"ID":"f1b36217-34ad-4d8b-a12a-f410868bf035","Type":"ContainerStarted","Data":"4121c40fdebf6776ff3ac122118a65e6c7574440ac7ddf068a8b1bf69ef82b95"} Mar 16 18:06:52 crc kubenswrapper[5120]: I0316 18:06:52.635273 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="horizon-kuttl-tests/horizon-d759d5d66-p24qb" event={"ID":"f1b36217-34ad-4d8b-a12a-f410868bf035","Type":"ContainerStarted","Data":"825f5c87b719b27e2a4fceaa6d646c2e83146755b8def2a0dddac0bedf387ac4"} Mar 16 18:06:52 crc kubenswrapper[5120]: I0316 18:06:52.635288 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="horizon-kuttl-tests/horizon-d759d5d66-p24qb" event={"ID":"f1b36217-34ad-4d8b-a12a-f410868bf035","Type":"ContainerStarted","Data":"ac00a36f6aa80e86f43c375708805911fd941002b87b43e9db9120368893f488"} Mar 16 18:06:52 crc kubenswrapper[5120]: I0316 18:06:52.653211 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="horizon-kuttl-tests/horizon-599695d8c4-kh6rf" podStartSLOduration=1.653186454 podStartE2EDuration="1.653186454s" podCreationTimestamp="2026-03-16 18:06:51 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 18:06:52.649373031 +0000 UTC m=+9314.803304688" watchObservedRunningTime="2026-03-16 18:06:52.653186454 +0000 UTC m=+9314.807118111" Mar 16 18:06:52 crc kubenswrapper[5120]: I0316 18:06:52.671698 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="horizon-kuttl-tests/horizon-d759d5d66-p24qb" podStartSLOduration=1.671678199 podStartE2EDuration="1.671678199s" podCreationTimestamp="2026-03-16 18:06:51 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 18:06:52.670318013 +0000 UTC m=+9314.824249680" watchObservedRunningTime="2026-03-16 18:06:52.671678199 +0000 UTC m=+9314.825609866" Mar 16 18:07:01 crc kubenswrapper[5120]: I0316 18:07:01.517145 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="horizon-kuttl-tests/horizon-d759d5d66-p24qb" Mar 16 18:07:01 crc kubenswrapper[5120]: I0316 18:07:01.517731 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="horizon-kuttl-tests/horizon-d759d5d66-p24qb" Mar 16 18:07:01 crc kubenswrapper[5120]: I0316 18:07:01.590282 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="horizon-kuttl-tests/horizon-599695d8c4-kh6rf" Mar 16 18:07:01 crc kubenswrapper[5120]: I0316 18:07:01.590487 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="horizon-kuttl-tests/horizon-599695d8c4-kh6rf" Mar 16 18:07:01 crc kubenswrapper[5120]: I0316 18:07:01.663689 5120 scope.go:117] "RemoveContainer" containerID="fa578cadb98a23319854b9fc54966313bbc1cee64f90cc75e1f951be3cb08e36" Mar 16 18:07:01 crc kubenswrapper[5120]: E0316 18:07:01.664191 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 18:07:07 crc kubenswrapper[5120]: E0316 18:07:07.712728 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1142080 actualBytes=10240 Mar 16 18:07:12 crc kubenswrapper[5120]: I0316 18:07:12.663447 5120 scope.go:117] "RemoveContainer" containerID="fa578cadb98a23319854b9fc54966313bbc1cee64f90cc75e1f951be3cb08e36" Mar 16 18:07:12 crc kubenswrapper[5120]: E0316 18:07:12.664066 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 18:07:13 crc kubenswrapper[5120]: I0316 18:07:13.213551 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="horizon-kuttl-tests/horizon-d759d5d66-p24qb" Mar 16 18:07:13 crc kubenswrapper[5120]: I0316 18:07:13.292269 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="horizon-kuttl-tests/horizon-599695d8c4-kh6rf" Mar 16 18:07:14 crc kubenswrapper[5120]: I0316 18:07:14.689836 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="horizon-kuttl-tests/horizon-d759d5d66-p24qb" Mar 16 18:07:14 crc kubenswrapper[5120]: I0316 18:07:14.774835 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="horizon-kuttl-tests/horizon-599695d8c4-kh6rf" Mar 16 18:07:14 crc kubenswrapper[5120]: I0316 18:07:14.835071 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["horizon-kuttl-tests/horizon-d759d5d66-p24qb"] Mar 16 18:07:14 crc kubenswrapper[5120]: I0316 18:07:14.848787 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="horizon-kuttl-tests/horizon-d759d5d66-p24qb" podUID="f1b36217-34ad-4d8b-a12a-f410868bf035" containerName="horizon-log" containerID="cri-o://825f5c87b719b27e2a4fceaa6d646c2e83146755b8def2a0dddac0bedf387ac4" gracePeriod=30 Mar 16 18:07:14 crc kubenswrapper[5120]: I0316 18:07:14.848978 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="horizon-kuttl-tests/horizon-d759d5d66-p24qb" podUID="f1b36217-34ad-4d8b-a12a-f410868bf035" containerName="horizon" containerID="cri-o://4121c40fdebf6776ff3ac122118a65e6c7574440ac7ddf068a8b1bf69ef82b95" gracePeriod=30 Mar 16 18:07:15 crc kubenswrapper[5120]: I0316 18:07:15.272450 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["horizon-kuttl-tests/horizon-599695d8c4-kh6rf"] Mar 16 18:07:15 crc kubenswrapper[5120]: I0316 18:07:15.272732 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="horizon-kuttl-tests/horizon-599695d8c4-kh6rf" podUID="8e3543d6-47c6-406b-ada0-840ad8d7ecc0" containerName="horizon-log" containerID="cri-o://11b452ead841cfcc5e1c277ff680d32da85e6f77378c6beb65cac0db505e0c60" gracePeriod=30 Mar 16 18:07:15 crc kubenswrapper[5120]: I0316 18:07:15.273227 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="horizon-kuttl-tests/horizon-599695d8c4-kh6rf" podUID="8e3543d6-47c6-406b-ada0-840ad8d7ecc0" containerName="horizon" containerID="cri-o://fb67258f5d3aa802e75604f511db586a72af2b1fe96de038d9996695eaa16054" gracePeriod=30 Mar 16 18:07:18 crc kubenswrapper[5120]: I0316 18:07:18.893399 5120 generic.go:358] "Generic (PLEG): container finished" podID="8e3543d6-47c6-406b-ada0-840ad8d7ecc0" containerID="fb67258f5d3aa802e75604f511db586a72af2b1fe96de038d9996695eaa16054" exitCode=0 Mar 16 18:07:18 crc kubenswrapper[5120]: I0316 18:07:18.893460 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="horizon-kuttl-tests/horizon-599695d8c4-kh6rf" event={"ID":"8e3543d6-47c6-406b-ada0-840ad8d7ecc0","Type":"ContainerDied","Data":"fb67258f5d3aa802e75604f511db586a72af2b1fe96de038d9996695eaa16054"} Mar 16 18:07:18 crc kubenswrapper[5120]: I0316 18:07:18.898942 5120 generic.go:358] "Generic (PLEG): container finished" podID="f1b36217-34ad-4d8b-a12a-f410868bf035" containerID="4121c40fdebf6776ff3ac122118a65e6c7574440ac7ddf068a8b1bf69ef82b95" exitCode=0 Mar 16 18:07:18 crc kubenswrapper[5120]: I0316 18:07:18.899041 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="horizon-kuttl-tests/horizon-d759d5d66-p24qb" event={"ID":"f1b36217-34ad-4d8b-a12a-f410868bf035","Type":"ContainerDied","Data":"4121c40fdebf6776ff3ac122118a65e6c7574440ac7ddf068a8b1bf69ef82b95"} Mar 16 18:07:23 crc kubenswrapper[5120]: I0316 18:07:23.214844 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="horizon-kuttl-tests/horizon-d759d5d66-p24qb" podUID="f1b36217-34ad-4d8b-a12a-f410868bf035" containerName="horizon" probeResult="failure" output="Get \"https://10.217.0.97:8443/dashboard/auth/login/?next=/dashboard/\": dial tcp 10.217.0.97:8443: connect: connection refused" Mar 16 18:07:23 crc kubenswrapper[5120]: I0316 18:07:23.293163 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="horizon-kuttl-tests/horizon-599695d8c4-kh6rf" podUID="8e3543d6-47c6-406b-ada0-840ad8d7ecc0" containerName="horizon" probeResult="failure" output="Get \"https://10.217.0.98:8443/dashboard/auth/login/?next=/dashboard/\": dial tcp 10.217.0.98:8443: connect: connection refused" Mar 16 18:07:26 crc kubenswrapper[5120]: I0316 18:07:26.664516 5120 scope.go:117] "RemoveContainer" containerID="fa578cadb98a23319854b9fc54966313bbc1cee64f90cc75e1f951be3cb08e36" Mar 16 18:07:26 crc kubenswrapper[5120]: E0316 18:07:26.665507 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 18:07:33 crc kubenswrapper[5120]: I0316 18:07:33.215005 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="horizon-kuttl-tests/horizon-d759d5d66-p24qb" podUID="f1b36217-34ad-4d8b-a12a-f410868bf035" containerName="horizon" probeResult="failure" output="Get \"https://10.217.0.97:8443/dashboard/auth/login/?next=/dashboard/\": dial tcp 10.217.0.97:8443: connect: connection refused" Mar 16 18:07:33 crc kubenswrapper[5120]: I0316 18:07:33.293674 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="horizon-kuttl-tests/horizon-599695d8c4-kh6rf" podUID="8e3543d6-47c6-406b-ada0-840ad8d7ecc0" containerName="horizon" probeResult="failure" output="Get \"https://10.217.0.98:8443/dashboard/auth/login/?next=/dashboard/\": dial tcp 10.217.0.98:8443: connect: connection refused" Mar 16 18:07:37 crc kubenswrapper[5120]: I0316 18:07:37.665191 5120 scope.go:117] "RemoveContainer" containerID="fa578cadb98a23319854b9fc54966313bbc1cee64f90cc75e1f951be3cb08e36" Mar 16 18:07:37 crc kubenswrapper[5120]: E0316 18:07:37.666996 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 18:07:43 crc kubenswrapper[5120]: I0316 18:07:43.215607 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="horizon-kuttl-tests/horizon-d759d5d66-p24qb" podUID="f1b36217-34ad-4d8b-a12a-f410868bf035" containerName="horizon" probeResult="failure" output="Get \"https://10.217.0.97:8443/dashboard/auth/login/?next=/dashboard/\": dial tcp 10.217.0.97:8443: connect: connection refused" Mar 16 18:07:43 crc kubenswrapper[5120]: I0316 18:07:43.216943 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="horizon-kuttl-tests/horizon-d759d5d66-p24qb" Mar 16 18:07:43 crc kubenswrapper[5120]: I0316 18:07:43.293886 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="horizon-kuttl-tests/horizon-599695d8c4-kh6rf" podUID="8e3543d6-47c6-406b-ada0-840ad8d7ecc0" containerName="horizon" probeResult="failure" output="Get \"https://10.217.0.98:8443/dashboard/auth/login/?next=/dashboard/\": dial tcp 10.217.0.98:8443: connect: connection refused" Mar 16 18:07:43 crc kubenswrapper[5120]: I0316 18:07:43.294021 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="horizon-kuttl-tests/horizon-599695d8c4-kh6rf" Mar 16 18:07:45 crc kubenswrapper[5120]: I0316 18:07:45.162562 5120 generic.go:358] "Generic (PLEG): container finished" podID="f1b36217-34ad-4d8b-a12a-f410868bf035" containerID="825f5c87b719b27e2a4fceaa6d646c2e83146755b8def2a0dddac0bedf387ac4" exitCode=137 Mar 16 18:07:45 crc kubenswrapper[5120]: I0316 18:07:45.162600 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="horizon-kuttl-tests/horizon-d759d5d66-p24qb" event={"ID":"f1b36217-34ad-4d8b-a12a-f410868bf035","Type":"ContainerDied","Data":"825f5c87b719b27e2a4fceaa6d646c2e83146755b8def2a0dddac0bedf387ac4"} Mar 16 18:07:45 crc kubenswrapper[5120]: I0316 18:07:45.163236 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="horizon-kuttl-tests/horizon-d759d5d66-p24qb" event={"ID":"f1b36217-34ad-4d8b-a12a-f410868bf035","Type":"ContainerDied","Data":"ac00a36f6aa80e86f43c375708805911fd941002b87b43e9db9120368893f488"} Mar 16 18:07:45 crc kubenswrapper[5120]: I0316 18:07:45.163254 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ac00a36f6aa80e86f43c375708805911fd941002b87b43e9db9120368893f488" Mar 16 18:07:45 crc kubenswrapper[5120]: I0316 18:07:45.177375 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="horizon-kuttl-tests/horizon-d759d5d66-p24qb" Mar 16 18:07:45 crc kubenswrapper[5120]: I0316 18:07:45.244323 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"horizon-tls-certs\" (UniqueName: \"kubernetes.io/secret/f1b36217-34ad-4d8b-a12a-f410868bf035-horizon-tls-certs\") pod \"f1b36217-34ad-4d8b-a12a-f410868bf035\" (UID: \"f1b36217-34ad-4d8b-a12a-f410868bf035\") " Mar 16 18:07:45 crc kubenswrapper[5120]: I0316 18:07:45.244722 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"horizon-secret-key\" (UniqueName: \"kubernetes.io/secret/f1b36217-34ad-4d8b-a12a-f410868bf035-horizon-secret-key\") pod \"f1b36217-34ad-4d8b-a12a-f410868bf035\" (UID: \"f1b36217-34ad-4d8b-a12a-f410868bf035\") " Mar 16 18:07:45 crc kubenswrapper[5120]: I0316 18:07:45.245097 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f1b36217-34ad-4d8b-a12a-f410868bf035-combined-ca-bundle\") pod \"f1b36217-34ad-4d8b-a12a-f410868bf035\" (UID: \"f1b36217-34ad-4d8b-a12a-f410868bf035\") " Mar 16 18:07:45 crc kubenswrapper[5120]: I0316 18:07:45.245212 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/f1b36217-34ad-4d8b-a12a-f410868bf035-scripts\") pod \"f1b36217-34ad-4d8b-a12a-f410868bf035\" (UID: \"f1b36217-34ad-4d8b-a12a-f410868bf035\") " Mar 16 18:07:45 crc kubenswrapper[5120]: I0316 18:07:45.245425 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/f1b36217-34ad-4d8b-a12a-f410868bf035-config-data\") pod \"f1b36217-34ad-4d8b-a12a-f410868bf035\" (UID: \"f1b36217-34ad-4d8b-a12a-f410868bf035\") " Mar 16 18:07:45 crc kubenswrapper[5120]: I0316 18:07:45.245506 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cpgcj\" (UniqueName: \"kubernetes.io/projected/f1b36217-34ad-4d8b-a12a-f410868bf035-kube-api-access-cpgcj\") pod \"f1b36217-34ad-4d8b-a12a-f410868bf035\" (UID: \"f1b36217-34ad-4d8b-a12a-f410868bf035\") " Mar 16 18:07:45 crc kubenswrapper[5120]: I0316 18:07:45.245617 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f1b36217-34ad-4d8b-a12a-f410868bf035-logs\") pod \"f1b36217-34ad-4d8b-a12a-f410868bf035\" (UID: \"f1b36217-34ad-4d8b-a12a-f410868bf035\") " Mar 16 18:07:45 crc kubenswrapper[5120]: I0316 18:07:45.246318 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1b36217-34ad-4d8b-a12a-f410868bf035-logs" (OuterVolumeSpecName: "logs") pod "f1b36217-34ad-4d8b-a12a-f410868bf035" (UID: "f1b36217-34ad-4d8b-a12a-f410868bf035"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 18:07:45 crc kubenswrapper[5120]: I0316 18:07:45.246642 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f1b36217-34ad-4d8b-a12a-f410868bf035-logs\") on node \"crc\" DevicePath \"\"" Mar 16 18:07:45 crc kubenswrapper[5120]: I0316 18:07:45.263610 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f1b36217-34ad-4d8b-a12a-f410868bf035-horizon-secret-key" (OuterVolumeSpecName: "horizon-secret-key") pod "f1b36217-34ad-4d8b-a12a-f410868bf035" (UID: "f1b36217-34ad-4d8b-a12a-f410868bf035"). InnerVolumeSpecName "horizon-secret-key". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 18:07:45 crc kubenswrapper[5120]: I0316 18:07:45.264186 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1b36217-34ad-4d8b-a12a-f410868bf035-kube-api-access-cpgcj" (OuterVolumeSpecName: "kube-api-access-cpgcj") pod "f1b36217-34ad-4d8b-a12a-f410868bf035" (UID: "f1b36217-34ad-4d8b-a12a-f410868bf035"). InnerVolumeSpecName "kube-api-access-cpgcj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 18:07:45 crc kubenswrapper[5120]: I0316 18:07:45.267874 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f1b36217-34ad-4d8b-a12a-f410868bf035-scripts" (OuterVolumeSpecName: "scripts") pod "f1b36217-34ad-4d8b-a12a-f410868bf035" (UID: "f1b36217-34ad-4d8b-a12a-f410868bf035"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 18:07:45 crc kubenswrapper[5120]: I0316 18:07:45.276624 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f1b36217-34ad-4d8b-a12a-f410868bf035-config-data" (OuterVolumeSpecName: "config-data") pod "f1b36217-34ad-4d8b-a12a-f410868bf035" (UID: "f1b36217-34ad-4d8b-a12a-f410868bf035"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 18:07:45 crc kubenswrapper[5120]: I0316 18:07:45.282025 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f1b36217-34ad-4d8b-a12a-f410868bf035-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f1b36217-34ad-4d8b-a12a-f410868bf035" (UID: "f1b36217-34ad-4d8b-a12a-f410868bf035"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 18:07:45 crc kubenswrapper[5120]: I0316 18:07:45.288926 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f1b36217-34ad-4d8b-a12a-f410868bf035-horizon-tls-certs" (OuterVolumeSpecName: "horizon-tls-certs") pod "f1b36217-34ad-4d8b-a12a-f410868bf035" (UID: "f1b36217-34ad-4d8b-a12a-f410868bf035"). InnerVolumeSpecName "horizon-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 18:07:45 crc kubenswrapper[5120]: I0316 18:07:45.348814 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/f1b36217-34ad-4d8b-a12a-f410868bf035-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 18:07:45 crc kubenswrapper[5120]: I0316 18:07:45.349237 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cpgcj\" (UniqueName: \"kubernetes.io/projected/f1b36217-34ad-4d8b-a12a-f410868bf035-kube-api-access-cpgcj\") on node \"crc\" DevicePath \"\"" Mar 16 18:07:45 crc kubenswrapper[5120]: I0316 18:07:45.349415 5120 reconciler_common.go:299] "Volume detached for volume \"horizon-tls-certs\" (UniqueName: \"kubernetes.io/secret/f1b36217-34ad-4d8b-a12a-f410868bf035-horizon-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 18:07:45 crc kubenswrapper[5120]: I0316 18:07:45.349594 5120 reconciler_common.go:299] "Volume detached for volume \"horizon-secret-key\" (UniqueName: \"kubernetes.io/secret/f1b36217-34ad-4d8b-a12a-f410868bf035-horizon-secret-key\") on node \"crc\" DevicePath \"\"" Mar 16 18:07:45 crc kubenswrapper[5120]: I0316 18:07:45.349793 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f1b36217-34ad-4d8b-a12a-f410868bf035-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 18:07:45 crc kubenswrapper[5120]: I0316 18:07:45.349916 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/f1b36217-34ad-4d8b-a12a-f410868bf035-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 18:07:45 crc kubenswrapper[5120]: I0316 18:07:45.571475 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="horizon-kuttl-tests/horizon-599695d8c4-kh6rf" Mar 16 18:07:45 crc kubenswrapper[5120]: I0316 18:07:45.657857 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"horizon-secret-key\" (UniqueName: \"kubernetes.io/secret/8e3543d6-47c6-406b-ada0-840ad8d7ecc0-horizon-secret-key\") pod \"8e3543d6-47c6-406b-ada0-840ad8d7ecc0\" (UID: \"8e3543d6-47c6-406b-ada0-840ad8d7ecc0\") " Mar 16 18:07:45 crc kubenswrapper[5120]: I0316 18:07:45.658326 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zbvqf\" (UniqueName: \"kubernetes.io/projected/8e3543d6-47c6-406b-ada0-840ad8d7ecc0-kube-api-access-zbvqf\") pod \"8e3543d6-47c6-406b-ada0-840ad8d7ecc0\" (UID: \"8e3543d6-47c6-406b-ada0-840ad8d7ecc0\") " Mar 16 18:07:45 crc kubenswrapper[5120]: I0316 18:07:45.658402 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8e3543d6-47c6-406b-ada0-840ad8d7ecc0-logs\") pod \"8e3543d6-47c6-406b-ada0-840ad8d7ecc0\" (UID: \"8e3543d6-47c6-406b-ada0-840ad8d7ecc0\") " Mar 16 18:07:45 crc kubenswrapper[5120]: I0316 18:07:45.658516 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/8e3543d6-47c6-406b-ada0-840ad8d7ecc0-scripts\") pod \"8e3543d6-47c6-406b-ada0-840ad8d7ecc0\" (UID: \"8e3543d6-47c6-406b-ada0-840ad8d7ecc0\") " Mar 16 18:07:45 crc kubenswrapper[5120]: I0316 18:07:45.658611 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/8e3543d6-47c6-406b-ada0-840ad8d7ecc0-config-data\") pod \"8e3543d6-47c6-406b-ada0-840ad8d7ecc0\" (UID: \"8e3543d6-47c6-406b-ada0-840ad8d7ecc0\") " Mar 16 18:07:45 crc kubenswrapper[5120]: I0316 18:07:45.658689 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"horizon-tls-certs\" (UniqueName: \"kubernetes.io/secret/8e3543d6-47c6-406b-ada0-840ad8d7ecc0-horizon-tls-certs\") pod \"8e3543d6-47c6-406b-ada0-840ad8d7ecc0\" (UID: \"8e3543d6-47c6-406b-ada0-840ad8d7ecc0\") " Mar 16 18:07:45 crc kubenswrapper[5120]: I0316 18:07:45.658715 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8e3543d6-47c6-406b-ada0-840ad8d7ecc0-combined-ca-bundle\") pod \"8e3543d6-47c6-406b-ada0-840ad8d7ecc0\" (UID: \"8e3543d6-47c6-406b-ada0-840ad8d7ecc0\") " Mar 16 18:07:45 crc kubenswrapper[5120]: I0316 18:07:45.659885 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e3543d6-47c6-406b-ada0-840ad8d7ecc0-logs" (OuterVolumeSpecName: "logs") pod "8e3543d6-47c6-406b-ada0-840ad8d7ecc0" (UID: "8e3543d6-47c6-406b-ada0-840ad8d7ecc0"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 18:07:45 crc kubenswrapper[5120]: I0316 18:07:45.662739 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e3543d6-47c6-406b-ada0-840ad8d7ecc0-kube-api-access-zbvqf" (OuterVolumeSpecName: "kube-api-access-zbvqf") pod "8e3543d6-47c6-406b-ada0-840ad8d7ecc0" (UID: "8e3543d6-47c6-406b-ada0-840ad8d7ecc0"). InnerVolumeSpecName "kube-api-access-zbvqf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 18:07:45 crc kubenswrapper[5120]: I0316 18:07:45.662889 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e3543d6-47c6-406b-ada0-840ad8d7ecc0-horizon-secret-key" (OuterVolumeSpecName: "horizon-secret-key") pod "8e3543d6-47c6-406b-ada0-840ad8d7ecc0" (UID: "8e3543d6-47c6-406b-ada0-840ad8d7ecc0"). InnerVolumeSpecName "horizon-secret-key". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 18:07:45 crc kubenswrapper[5120]: I0316 18:07:45.675051 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8e3543d6-47c6-406b-ada0-840ad8d7ecc0-config-data" (OuterVolumeSpecName: "config-data") pod "8e3543d6-47c6-406b-ada0-840ad8d7ecc0" (UID: "8e3543d6-47c6-406b-ada0-840ad8d7ecc0"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 18:07:45 crc kubenswrapper[5120]: I0316 18:07:45.677354 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e3543d6-47c6-406b-ada0-840ad8d7ecc0-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "8e3543d6-47c6-406b-ada0-840ad8d7ecc0" (UID: "8e3543d6-47c6-406b-ada0-840ad8d7ecc0"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 18:07:45 crc kubenswrapper[5120]: I0316 18:07:45.683104 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8e3543d6-47c6-406b-ada0-840ad8d7ecc0-scripts" (OuterVolumeSpecName: "scripts") pod "8e3543d6-47c6-406b-ada0-840ad8d7ecc0" (UID: "8e3543d6-47c6-406b-ada0-840ad8d7ecc0"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 18:07:45 crc kubenswrapper[5120]: I0316 18:07:45.696052 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e3543d6-47c6-406b-ada0-840ad8d7ecc0-horizon-tls-certs" (OuterVolumeSpecName: "horizon-tls-certs") pod "8e3543d6-47c6-406b-ada0-840ad8d7ecc0" (UID: "8e3543d6-47c6-406b-ada0-840ad8d7ecc0"). InnerVolumeSpecName "horizon-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 18:07:45 crc kubenswrapper[5120]: I0316 18:07:45.764025 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zbvqf\" (UniqueName: \"kubernetes.io/projected/8e3543d6-47c6-406b-ada0-840ad8d7ecc0-kube-api-access-zbvqf\") on node \"crc\" DevicePath \"\"" Mar 16 18:07:45 crc kubenswrapper[5120]: I0316 18:07:45.764695 5120 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8e3543d6-47c6-406b-ada0-840ad8d7ecc0-logs\") on node \"crc\" DevicePath \"\"" Mar 16 18:07:45 crc kubenswrapper[5120]: I0316 18:07:45.764912 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/8e3543d6-47c6-406b-ada0-840ad8d7ecc0-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 18:07:45 crc kubenswrapper[5120]: I0316 18:07:45.764948 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/8e3543d6-47c6-406b-ada0-840ad8d7ecc0-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 18:07:45 crc kubenswrapper[5120]: I0316 18:07:45.764959 5120 reconciler_common.go:299] "Volume detached for volume \"horizon-tls-certs\" (UniqueName: \"kubernetes.io/secret/8e3543d6-47c6-406b-ada0-840ad8d7ecc0-horizon-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 18:07:45 crc kubenswrapper[5120]: I0316 18:07:45.764970 5120 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8e3543d6-47c6-406b-ada0-840ad8d7ecc0-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 18:07:45 crc kubenswrapper[5120]: I0316 18:07:45.764982 5120 reconciler_common.go:299] "Volume detached for volume \"horizon-secret-key\" (UniqueName: \"kubernetes.io/secret/8e3543d6-47c6-406b-ada0-840ad8d7ecc0-horizon-secret-key\") on node \"crc\" DevicePath \"\"" Mar 16 18:07:46 crc kubenswrapper[5120]: I0316 18:07:46.171843 5120 generic.go:358] "Generic (PLEG): container finished" podID="8e3543d6-47c6-406b-ada0-840ad8d7ecc0" containerID="11b452ead841cfcc5e1c277ff680d32da85e6f77378c6beb65cac0db505e0c60" exitCode=137 Mar 16 18:07:46 crc kubenswrapper[5120]: I0316 18:07:46.171915 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="horizon-kuttl-tests/horizon-599695d8c4-kh6rf" Mar 16 18:07:46 crc kubenswrapper[5120]: I0316 18:07:46.171942 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="horizon-kuttl-tests/horizon-599695d8c4-kh6rf" event={"ID":"8e3543d6-47c6-406b-ada0-840ad8d7ecc0","Type":"ContainerDied","Data":"11b452ead841cfcc5e1c277ff680d32da85e6f77378c6beb65cac0db505e0c60"} Mar 16 18:07:46 crc kubenswrapper[5120]: I0316 18:07:46.172410 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="horizon-kuttl-tests/horizon-599695d8c4-kh6rf" event={"ID":"8e3543d6-47c6-406b-ada0-840ad8d7ecc0","Type":"ContainerDied","Data":"6a2a439bc650b34835f8617075b12c38df16929a330c353e5e8aa13384ac1ade"} Mar 16 18:07:46 crc kubenswrapper[5120]: I0316 18:07:46.172438 5120 scope.go:117] "RemoveContainer" containerID="fb67258f5d3aa802e75604f511db586a72af2b1fe96de038d9996695eaa16054" Mar 16 18:07:46 crc kubenswrapper[5120]: I0316 18:07:46.172671 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="horizon-kuttl-tests/horizon-d759d5d66-p24qb" Mar 16 18:07:46 crc kubenswrapper[5120]: I0316 18:07:46.213960 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["horizon-kuttl-tests/horizon-d759d5d66-p24qb"] Mar 16 18:07:46 crc kubenswrapper[5120]: I0316 18:07:46.229338 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["horizon-kuttl-tests/horizon-d759d5d66-p24qb"] Mar 16 18:07:46 crc kubenswrapper[5120]: I0316 18:07:46.235414 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["horizon-kuttl-tests/horizon-599695d8c4-kh6rf"] Mar 16 18:07:46 crc kubenswrapper[5120]: I0316 18:07:46.244021 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["horizon-kuttl-tests/horizon-599695d8c4-kh6rf"] Mar 16 18:07:46 crc kubenswrapper[5120]: I0316 18:07:46.347878 5120 scope.go:117] "RemoveContainer" containerID="11b452ead841cfcc5e1c277ff680d32da85e6f77378c6beb65cac0db505e0c60" Mar 16 18:07:46 crc kubenswrapper[5120]: I0316 18:07:46.367657 5120 scope.go:117] "RemoveContainer" containerID="fb67258f5d3aa802e75604f511db586a72af2b1fe96de038d9996695eaa16054" Mar 16 18:07:46 crc kubenswrapper[5120]: E0316 18:07:46.368491 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb67258f5d3aa802e75604f511db586a72af2b1fe96de038d9996695eaa16054\": container with ID starting with fb67258f5d3aa802e75604f511db586a72af2b1fe96de038d9996695eaa16054 not found: ID does not exist" containerID="fb67258f5d3aa802e75604f511db586a72af2b1fe96de038d9996695eaa16054" Mar 16 18:07:46 crc kubenswrapper[5120]: I0316 18:07:46.368615 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb67258f5d3aa802e75604f511db586a72af2b1fe96de038d9996695eaa16054"} err="failed to get container status \"fb67258f5d3aa802e75604f511db586a72af2b1fe96de038d9996695eaa16054\": rpc error: code = NotFound desc = could not find container \"fb67258f5d3aa802e75604f511db586a72af2b1fe96de038d9996695eaa16054\": container with ID starting with fb67258f5d3aa802e75604f511db586a72af2b1fe96de038d9996695eaa16054 not found: ID does not exist" Mar 16 18:07:46 crc kubenswrapper[5120]: I0316 18:07:46.368642 5120 scope.go:117] "RemoveContainer" containerID="11b452ead841cfcc5e1c277ff680d32da85e6f77378c6beb65cac0db505e0c60" Mar 16 18:07:46 crc kubenswrapper[5120]: E0316 18:07:46.369085 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"11b452ead841cfcc5e1c277ff680d32da85e6f77378c6beb65cac0db505e0c60\": container with ID starting with 11b452ead841cfcc5e1c277ff680d32da85e6f77378c6beb65cac0db505e0c60 not found: ID does not exist" containerID="11b452ead841cfcc5e1c277ff680d32da85e6f77378c6beb65cac0db505e0c60" Mar 16 18:07:46 crc kubenswrapper[5120]: I0316 18:07:46.369105 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11b452ead841cfcc5e1c277ff680d32da85e6f77378c6beb65cac0db505e0c60"} err="failed to get container status \"11b452ead841cfcc5e1c277ff680d32da85e6f77378c6beb65cac0db505e0c60\": rpc error: code = NotFound desc = could not find container \"11b452ead841cfcc5e1c277ff680d32da85e6f77378c6beb65cac0db505e0c60\": container with ID starting with 11b452ead841cfcc5e1c277ff680d32da85e6f77378c6beb65cac0db505e0c60 not found: ID does not exist" Mar 16 18:07:46 crc kubenswrapper[5120]: I0316 18:07:46.680984 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8e3543d6-47c6-406b-ada0-840ad8d7ecc0" path="/var/lib/kubelet/pods/8e3543d6-47c6-406b-ada0-840ad8d7ecc0/volumes" Mar 16 18:07:46 crc kubenswrapper[5120]: I0316 18:07:46.681618 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f1b36217-34ad-4d8b-a12a-f410868bf035" path="/var/lib/kubelet/pods/f1b36217-34ad-4d8b-a12a-f410868bf035/volumes" Mar 16 18:07:50 crc kubenswrapper[5120]: I0316 18:07:50.677955 5120 scope.go:117] "RemoveContainer" containerID="fa578cadb98a23319854b9fc54966313bbc1cee64f90cc75e1f951be3cb08e36" Mar 16 18:07:50 crc kubenswrapper[5120]: E0316 18:07:50.679355 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 18:07:50 crc kubenswrapper[5120]: E0316 18:07:50.798225 5120 upgradeaware.go:427] Error proxying data from client to backend: readfrom tcp 38.102.83.119:57400->38.102.83.119:44311: write tcp 38.102.83.119:57400->38.102.83.119:44311: write: broken pipe Mar 16 18:07:52 crc kubenswrapper[5120]: I0316 18:07:52.756365 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["horizon-kuttl-tests/keystone-bootstrap-xxdnj"] Mar 16 18:07:52 crc kubenswrapper[5120]: I0316 18:07:52.768550 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["horizon-kuttl-tests/keystone-db-sync-pjx27"] Mar 16 18:07:52 crc kubenswrapper[5120]: I0316 18:07:52.775854 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["horizon-kuttl-tests/keystone-bootstrap-xxdnj"] Mar 16 18:07:52 crc kubenswrapper[5120]: I0316 18:07:52.781742 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["horizon-kuttl-tests/keystone-db-sync-pjx27"] Mar 16 18:07:52 crc kubenswrapper[5120]: I0316 18:07:52.788743 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["horizon-kuttl-tests/keystone-8574f95c55-5vc9m"] Mar 16 18:07:52 crc kubenswrapper[5120]: I0316 18:07:52.788997 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="horizon-kuttl-tests/keystone-8574f95c55-5vc9m" podUID="c963986f-f511-4a4b-a677-58c672447b83" containerName="keystone-api" containerID="cri-o://5ee10dfa961ef5fce80b33b1f8ca22b18dd8d655e9124fc30b82e0d7a3858111" gracePeriod=30 Mar 16 18:07:52 crc kubenswrapper[5120]: I0316 18:07:52.823004 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["horizon-kuttl-tests/keystonecd08-account-delete-5p5vv"] Mar 16 18:07:52 crc kubenswrapper[5120]: I0316 18:07:52.825780 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1b36217-34ad-4d8b-a12a-f410868bf035" containerName="horizon" Mar 16 18:07:52 crc kubenswrapper[5120]: I0316 18:07:52.826168 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1b36217-34ad-4d8b-a12a-f410868bf035" containerName="horizon" Mar 16 18:07:52 crc kubenswrapper[5120]: I0316 18:07:52.826268 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1b36217-34ad-4d8b-a12a-f410868bf035" containerName="horizon-log" Mar 16 18:07:52 crc kubenswrapper[5120]: I0316 18:07:52.826352 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1b36217-34ad-4d8b-a12a-f410868bf035" containerName="horizon-log" Mar 16 18:07:52 crc kubenswrapper[5120]: I0316 18:07:52.826442 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e3543d6-47c6-406b-ada0-840ad8d7ecc0" containerName="horizon-log" Mar 16 18:07:52 crc kubenswrapper[5120]: I0316 18:07:52.826519 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e3543d6-47c6-406b-ada0-840ad8d7ecc0" containerName="horizon-log" Mar 16 18:07:52 crc kubenswrapper[5120]: I0316 18:07:52.826605 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e3543d6-47c6-406b-ada0-840ad8d7ecc0" containerName="horizon" Mar 16 18:07:52 crc kubenswrapper[5120]: I0316 18:07:52.826702 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e3543d6-47c6-406b-ada0-840ad8d7ecc0" containerName="horizon" Mar 16 18:07:52 crc kubenswrapper[5120]: I0316 18:07:52.827306 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="8e3543d6-47c6-406b-ada0-840ad8d7ecc0" containerName="horizon-log" Mar 16 18:07:52 crc kubenswrapper[5120]: I0316 18:07:52.827400 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f1b36217-34ad-4d8b-a12a-f410868bf035" containerName="horizon-log" Mar 16 18:07:52 crc kubenswrapper[5120]: I0316 18:07:52.827475 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="8e3543d6-47c6-406b-ada0-840ad8d7ecc0" containerName="horizon" Mar 16 18:07:52 crc kubenswrapper[5120]: I0316 18:07:52.827558 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="f1b36217-34ad-4d8b-a12a-f410868bf035" containerName="horizon" Mar 16 18:07:52 crc kubenswrapper[5120]: I0316 18:07:52.832220 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="horizon-kuttl-tests/keystonecd08-account-delete-5p5vv" Mar 16 18:07:52 crc kubenswrapper[5120]: I0316 18:07:52.832875 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["horizon-kuttl-tests/keystonecd08-account-delete-5p5vv"] Mar 16 18:07:52 crc kubenswrapper[5120]: I0316 18:07:52.978645 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/be179d3f-0e28-4c2b-bc0a-aec68b9e3e98-operator-scripts\") pod \"keystonecd08-account-delete-5p5vv\" (UID: \"be179d3f-0e28-4c2b-bc0a-aec68b9e3e98\") " pod="horizon-kuttl-tests/keystonecd08-account-delete-5p5vv" Mar 16 18:07:52 crc kubenswrapper[5120]: I0316 18:07:52.978929 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rz2gx\" (UniqueName: \"kubernetes.io/projected/be179d3f-0e28-4c2b-bc0a-aec68b9e3e98-kube-api-access-rz2gx\") pod \"keystonecd08-account-delete-5p5vv\" (UID: \"be179d3f-0e28-4c2b-bc0a-aec68b9e3e98\") " pod="horizon-kuttl-tests/keystonecd08-account-delete-5p5vv" Mar 16 18:07:53 crc kubenswrapper[5120]: I0316 18:07:53.082574 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/be179d3f-0e28-4c2b-bc0a-aec68b9e3e98-operator-scripts\") pod \"keystonecd08-account-delete-5p5vv\" (UID: \"be179d3f-0e28-4c2b-bc0a-aec68b9e3e98\") " pod="horizon-kuttl-tests/keystonecd08-account-delete-5p5vv" Mar 16 18:07:53 crc kubenswrapper[5120]: I0316 18:07:53.082921 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rz2gx\" (UniqueName: \"kubernetes.io/projected/be179d3f-0e28-4c2b-bc0a-aec68b9e3e98-kube-api-access-rz2gx\") pod \"keystonecd08-account-delete-5p5vv\" (UID: \"be179d3f-0e28-4c2b-bc0a-aec68b9e3e98\") " pod="horizon-kuttl-tests/keystonecd08-account-delete-5p5vv" Mar 16 18:07:53 crc kubenswrapper[5120]: I0316 18:07:53.083677 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/be179d3f-0e28-4c2b-bc0a-aec68b9e3e98-operator-scripts\") pod \"keystonecd08-account-delete-5p5vv\" (UID: \"be179d3f-0e28-4c2b-bc0a-aec68b9e3e98\") " pod="horizon-kuttl-tests/keystonecd08-account-delete-5p5vv" Mar 16 18:07:53 crc kubenswrapper[5120]: I0316 18:07:53.109222 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rz2gx\" (UniqueName: \"kubernetes.io/projected/be179d3f-0e28-4c2b-bc0a-aec68b9e3e98-kube-api-access-rz2gx\") pod \"keystonecd08-account-delete-5p5vv\" (UID: \"be179d3f-0e28-4c2b-bc0a-aec68b9e3e98\") " pod="horizon-kuttl-tests/keystonecd08-account-delete-5p5vv" Mar 16 18:07:53 crc kubenswrapper[5120]: I0316 18:07:53.154614 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="horizon-kuttl-tests/keystonecd08-account-delete-5p5vv" Mar 16 18:07:53 crc kubenswrapper[5120]: I0316 18:07:53.501133 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["horizon-kuttl-tests/root-account-create-update-nk9mz"] Mar 16 18:07:53 crc kubenswrapper[5120]: I0316 18:07:53.519787 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["horizon-kuttl-tests/root-account-create-update-nk9mz"] Mar 16 18:07:53 crc kubenswrapper[5120]: I0316 18:07:53.528605 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["horizon-kuttl-tests/keystonecd08-account-delete-5p5vv"] Mar 16 18:07:53 crc kubenswrapper[5120]: I0316 18:07:53.568920 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["horizon-kuttl-tests/openstack-galera-0"] Mar 16 18:07:53 crc kubenswrapper[5120]: I0316 18:07:53.580563 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["horizon-kuttl-tests/openstack-galera-2"] Mar 16 18:07:53 crc kubenswrapper[5120]: I0316 18:07:53.587071 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["horizon-kuttl-tests/openstack-galera-1"] Mar 16 18:07:53 crc kubenswrapper[5120]: I0316 18:07:53.717241 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="horizon-kuttl-tests/openstack-galera-2" podUID="1cbada35-20cb-4e85-b586-27ff9941011a" containerName="galera" containerID="cri-o://442cbca3e39e97c499ec7f781b97d4f8bbcd5426edb5c1dea0b09bc99ff9d956" gracePeriod=30 Mar 16 18:07:54 crc kubenswrapper[5120]: I0316 18:07:54.153451 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["horizon-kuttl-tests/memcached-0"] Mar 16 18:07:54 crc kubenswrapper[5120]: I0316 18:07:54.153755 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="horizon-kuttl-tests/memcached-0" podUID="60903bff-9b27-488b-b399-2c87b66a6f35" containerName="memcached" containerID="cri-o://820f3098adfdf7eaa9f705c0627a4651a21a126e5608ae4d7701154ca804855c" gracePeriod=30 Mar 16 18:07:54 crc kubenswrapper[5120]: I0316 18:07:54.252088 5120 generic.go:358] "Generic (PLEG): container finished" podID="1cbada35-20cb-4e85-b586-27ff9941011a" containerID="442cbca3e39e97c499ec7f781b97d4f8bbcd5426edb5c1dea0b09bc99ff9d956" exitCode=0 Mar 16 18:07:54 crc kubenswrapper[5120]: I0316 18:07:54.252190 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="horizon-kuttl-tests/openstack-galera-2" event={"ID":"1cbada35-20cb-4e85-b586-27ff9941011a","Type":"ContainerDied","Data":"442cbca3e39e97c499ec7f781b97d4f8bbcd5426edb5c1dea0b09bc99ff9d956"} Mar 16 18:07:54 crc kubenswrapper[5120]: I0316 18:07:54.253869 5120 generic.go:358] "Generic (PLEG): container finished" podID="be179d3f-0e28-4c2b-bc0a-aec68b9e3e98" containerID="4311edb2f5f7639da20a5addc08e117062b4ad1a18c7928d8c4e332b45809ad4" exitCode=1 Mar 16 18:07:54 crc kubenswrapper[5120]: I0316 18:07:54.254056 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="horizon-kuttl-tests/keystonecd08-account-delete-5p5vv" event={"ID":"be179d3f-0e28-4c2b-bc0a-aec68b9e3e98","Type":"ContainerDied","Data":"4311edb2f5f7639da20a5addc08e117062b4ad1a18c7928d8c4e332b45809ad4"} Mar 16 18:07:54 crc kubenswrapper[5120]: I0316 18:07:54.254157 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="horizon-kuttl-tests/keystonecd08-account-delete-5p5vv" event={"ID":"be179d3f-0e28-4c2b-bc0a-aec68b9e3e98","Type":"ContainerStarted","Data":"57936c0619d39ebc7d1d46e0bc0f486159147635e7c57d9cdba1daa337591041"} Mar 16 18:07:54 crc kubenswrapper[5120]: I0316 18:07:54.254633 5120 kubelet_pods.go:1019] "Unable to retrieve pull secret, the image pull may not succeed." pod="horizon-kuttl-tests/keystonecd08-account-delete-5p5vv" secret="" err="secret \"galera-openstack-dockercfg-4l6cf\" not found" Mar 16 18:07:54 crc kubenswrapper[5120]: I0316 18:07:54.254715 5120 scope.go:117] "RemoveContainer" containerID="4311edb2f5f7639da20a5addc08e117062b4ad1a18c7928d8c4e332b45809ad4" Mar 16 18:07:54 crc kubenswrapper[5120]: E0316 18:07:54.315463 5120 configmap.go:193] Couldn't get configMap horizon-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Mar 16 18:07:54 crc kubenswrapper[5120]: E0316 18:07:54.315573 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/be179d3f-0e28-4c2b-bc0a-aec68b9e3e98-operator-scripts podName:be179d3f-0e28-4c2b-bc0a-aec68b9e3e98 nodeName:}" failed. No retries permitted until 2026-03-16 18:07:54.815538183 +0000 UTC m=+9376.969469850 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/be179d3f-0e28-4c2b-bc0a-aec68b9e3e98-operator-scripts") pod "keystonecd08-account-delete-5p5vv" (UID: "be179d3f-0e28-4c2b-bc0a-aec68b9e3e98") : configmap "openstack-scripts" not found Mar 16 18:07:54 crc kubenswrapper[5120]: I0316 18:07:54.554607 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["horizon-kuttl-tests/rabbitmq-server-0"] Mar 16 18:07:54 crc kubenswrapper[5120]: I0316 18:07:54.556843 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="horizon-kuttl-tests/openstack-galera-2" Mar 16 18:07:54 crc kubenswrapper[5120]: I0316 18:07:54.623097 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/1cbada35-20cb-4e85-b586-27ff9941011a-config-data-default\") pod \"1cbada35-20cb-4e85-b586-27ff9941011a\" (UID: \"1cbada35-20cb-4e85-b586-27ff9941011a\") " Mar 16 18:07:54 crc kubenswrapper[5120]: I0316 18:07:54.623484 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/1cbada35-20cb-4e85-b586-27ff9941011a-config-data-generated\") pod \"1cbada35-20cb-4e85-b586-27ff9941011a\" (UID: \"1cbada35-20cb-4e85-b586-27ff9941011a\") " Mar 16 18:07:54 crc kubenswrapper[5120]: I0316 18:07:54.623575 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ctk8p\" (UniqueName: \"kubernetes.io/projected/1cbada35-20cb-4e85-b586-27ff9941011a-kube-api-access-ctk8p\") pod \"1cbada35-20cb-4e85-b586-27ff9941011a\" (UID: \"1cbada35-20cb-4e85-b586-27ff9941011a\") " Mar 16 18:07:54 crc kubenswrapper[5120]: I0316 18:07:54.623678 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"mysql-db\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"1cbada35-20cb-4e85-b586-27ff9941011a\" (UID: \"1cbada35-20cb-4e85-b586-27ff9941011a\") " Mar 16 18:07:54 crc kubenswrapper[5120]: I0316 18:07:54.623972 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/1cbada35-20cb-4e85-b586-27ff9941011a-kolla-config\") pod \"1cbada35-20cb-4e85-b586-27ff9941011a\" (UID: \"1cbada35-20cb-4e85-b586-27ff9941011a\") " Mar 16 18:07:54 crc kubenswrapper[5120]: I0316 18:07:54.624096 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/1cbada35-20cb-4e85-b586-27ff9941011a-operator-scripts\") pod \"1cbada35-20cb-4e85-b586-27ff9941011a\" (UID: \"1cbada35-20cb-4e85-b586-27ff9941011a\") " Mar 16 18:07:54 crc kubenswrapper[5120]: I0316 18:07:54.626325 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1cbada35-20cb-4e85-b586-27ff9941011a-config-data-default" (OuterVolumeSpecName: "config-data-default") pod "1cbada35-20cb-4e85-b586-27ff9941011a" (UID: "1cbada35-20cb-4e85-b586-27ff9941011a"). InnerVolumeSpecName "config-data-default". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 18:07:54 crc kubenswrapper[5120]: I0316 18:07:54.628289 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1cbada35-20cb-4e85-b586-27ff9941011a-config-data-generated" (OuterVolumeSpecName: "config-data-generated") pod "1cbada35-20cb-4e85-b586-27ff9941011a" (UID: "1cbada35-20cb-4e85-b586-27ff9941011a"). InnerVolumeSpecName "config-data-generated". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 18:07:54 crc kubenswrapper[5120]: I0316 18:07:54.630554 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1cbada35-20cb-4e85-b586-27ff9941011a-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "1cbada35-20cb-4e85-b586-27ff9941011a" (UID: "1cbada35-20cb-4e85-b586-27ff9941011a"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 18:07:54 crc kubenswrapper[5120]: I0316 18:07:54.632039 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1cbada35-20cb-4e85-b586-27ff9941011a-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "1cbada35-20cb-4e85-b586-27ff9941011a" (UID: "1cbada35-20cb-4e85-b586-27ff9941011a"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 18:07:54 crc kubenswrapper[5120]: I0316 18:07:54.634438 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1cbada35-20cb-4e85-b586-27ff9941011a-kube-api-access-ctk8p" (OuterVolumeSpecName: "kube-api-access-ctk8p") pod "1cbada35-20cb-4e85-b586-27ff9941011a" (UID: "1cbada35-20cb-4e85-b586-27ff9941011a"). InnerVolumeSpecName "kube-api-access-ctk8p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 18:07:54 crc kubenswrapper[5120]: I0316 18:07:54.638354 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage05-crc" (OuterVolumeSpecName: "mysql-db") pod "1cbada35-20cb-4e85-b586-27ff9941011a" (UID: "1cbada35-20cb-4e85-b586-27ff9941011a"). InnerVolumeSpecName "local-storage05-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 18:07:54 crc kubenswrapper[5120]: I0316 18:07:54.672755 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="25ac69ad-d9e3-4b99-a21d-5cd86c316f40" path="/var/lib/kubelet/pods/25ac69ad-d9e3-4b99-a21d-5cd86c316f40/volumes" Mar 16 18:07:54 crc kubenswrapper[5120]: I0316 18:07:54.673292 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="43338e7c-2c70-497b-a3a5-fce5949f4ae2" path="/var/lib/kubelet/pods/43338e7c-2c70-497b-a3a5-fce5949f4ae2/volumes" Mar 16 18:07:54 crc kubenswrapper[5120]: I0316 18:07:54.673880 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="768af0c0-1057-4455-b269-bacabfdf4319" path="/var/lib/kubelet/pods/768af0c0-1057-4455-b269-bacabfdf4319/volumes" Mar 16 18:07:54 crc kubenswrapper[5120]: I0316 18:07:54.726917 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/1cbada35-20cb-4e85-b586-27ff9941011a-config-data-default\") on node \"crc\" DevicePath \"\"" Mar 16 18:07:54 crc kubenswrapper[5120]: I0316 18:07:54.726959 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/1cbada35-20cb-4e85-b586-27ff9941011a-config-data-generated\") on node \"crc\" DevicePath \"\"" Mar 16 18:07:54 crc kubenswrapper[5120]: I0316 18:07:54.727031 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ctk8p\" (UniqueName: \"kubernetes.io/projected/1cbada35-20cb-4e85-b586-27ff9941011a-kube-api-access-ctk8p\") on node \"crc\" DevicePath \"\"" Mar 16 18:07:54 crc kubenswrapper[5120]: I0316 18:07:54.727065 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") on node \"crc\" " Mar 16 18:07:54 crc kubenswrapper[5120]: I0316 18:07:54.727079 5120 reconciler_common.go:299] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/1cbada35-20cb-4e85-b586-27ff9941011a-kolla-config\") on node \"crc\" DevicePath \"\"" Mar 16 18:07:54 crc kubenswrapper[5120]: I0316 18:07:54.727092 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/1cbada35-20cb-4e85-b586-27ff9941011a-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 18:07:54 crc kubenswrapper[5120]: I0316 18:07:54.740059 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage05-crc" (UniqueName: "kubernetes.io/local-volume/local-storage05-crc") on node "crc" Mar 16 18:07:54 crc kubenswrapper[5120]: E0316 18:07:54.828673 5120 configmap.go:193] Couldn't get configMap horizon-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Mar 16 18:07:54 crc kubenswrapper[5120]: I0316 18:07:54.828685 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") on node \"crc\" DevicePath \"\"" Mar 16 18:07:54 crc kubenswrapper[5120]: E0316 18:07:54.829529 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/be179d3f-0e28-4c2b-bc0a-aec68b9e3e98-operator-scripts podName:be179d3f-0e28-4c2b-bc0a-aec68b9e3e98 nodeName:}" failed. No retries permitted until 2026-03-16 18:07:55.829500607 +0000 UTC m=+9377.983432274 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/be179d3f-0e28-4c2b-bc0a-aec68b9e3e98-operator-scripts") pod "keystonecd08-account-delete-5p5vv" (UID: "be179d3f-0e28-4c2b-bc0a-aec68b9e3e98") : configmap "openstack-scripts" not found Mar 16 18:07:54 crc kubenswrapper[5120]: I0316 18:07:54.932079 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["horizon-kuttl-tests/rabbitmq-server-0"] Mar 16 18:07:55 crc kubenswrapper[5120]: I0316 18:07:55.262967 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="horizon-kuttl-tests/openstack-galera-2" event={"ID":"1cbada35-20cb-4e85-b586-27ff9941011a","Type":"ContainerDied","Data":"2cffc3989c91838dfa72c537bfa0db86b23c825e99413238b36cd309910d7a40"} Mar 16 18:07:55 crc kubenswrapper[5120]: I0316 18:07:55.262978 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="horizon-kuttl-tests/openstack-galera-2" Mar 16 18:07:55 crc kubenswrapper[5120]: I0316 18:07:55.263050 5120 scope.go:117] "RemoveContainer" containerID="442cbca3e39e97c499ec7f781b97d4f8bbcd5426edb5c1dea0b09bc99ff9d956" Mar 16 18:07:55 crc kubenswrapper[5120]: I0316 18:07:55.266578 5120 generic.go:358] "Generic (PLEG): container finished" podID="be179d3f-0e28-4c2b-bc0a-aec68b9e3e98" containerID="76e9dbf228892c0b5c19e9338a3e25dce76ac6f3b4a57fdea8b79fabe9ea6751" exitCode=1 Mar 16 18:07:55 crc kubenswrapper[5120]: I0316 18:07:55.266709 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="horizon-kuttl-tests/keystonecd08-account-delete-5p5vv" event={"ID":"be179d3f-0e28-4c2b-bc0a-aec68b9e3e98","Type":"ContainerDied","Data":"76e9dbf228892c0b5c19e9338a3e25dce76ac6f3b4a57fdea8b79fabe9ea6751"} Mar 16 18:07:55 crc kubenswrapper[5120]: I0316 18:07:55.267732 5120 kubelet_pods.go:1019] "Unable to retrieve pull secret, the image pull may not succeed." pod="horizon-kuttl-tests/keystonecd08-account-delete-5p5vv" secret="" err="secret \"galera-openstack-dockercfg-4l6cf\" not found" Mar 16 18:07:55 crc kubenswrapper[5120]: I0316 18:07:55.267827 5120 scope.go:117] "RemoveContainer" containerID="76e9dbf228892c0b5c19e9338a3e25dce76ac6f3b4a57fdea8b79fabe9ea6751" Mar 16 18:07:55 crc kubenswrapper[5120]: E0316 18:07:55.268156 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"mariadb-account-delete\" with CrashLoopBackOff: \"back-off 10s restarting failed container=mariadb-account-delete pod=keystonecd08-account-delete-5p5vv_horizon-kuttl-tests(be179d3f-0e28-4c2b-bc0a-aec68b9e3e98)\"" pod="horizon-kuttl-tests/keystonecd08-account-delete-5p5vv" podUID="be179d3f-0e28-4c2b-bc0a-aec68b9e3e98" Mar 16 18:07:55 crc kubenswrapper[5120]: I0316 18:07:55.310334 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["horizon-kuttl-tests/openstack-galera-2"] Mar 16 18:07:55 crc kubenswrapper[5120]: I0316 18:07:55.312915 5120 scope.go:117] "RemoveContainer" containerID="e5f7f7ccac243f0a7dd25ec721d302dbf8dae4a31da60f21f84e2ab2353febde" Mar 16 18:07:55 crc kubenswrapper[5120]: I0316 18:07:55.317126 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["horizon-kuttl-tests/openstack-galera-2"] Mar 16 18:07:55 crc kubenswrapper[5120]: I0316 18:07:55.321722 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="horizon-kuttl-tests/rabbitmq-server-0" podUID="7decf9bf-957e-4b6b-8864-da4761ca69cb" containerName="rabbitmq" containerID="cri-o://0e669d433bf25cfe0d9b815afcb0152c9b8b65eb9e466b5f0536bc0b5d2c7699" gracePeriod=604800 Mar 16 18:07:55 crc kubenswrapper[5120]: I0316 18:07:55.337505 5120 scope.go:117] "RemoveContainer" containerID="4311edb2f5f7639da20a5addc08e117062b4ad1a18c7928d8c4e332b45809ad4" Mar 16 18:07:55 crc kubenswrapper[5120]: I0316 18:07:55.763939 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/horizon-operator-controller-manager-6f896bd9dc-t4ct8"] Mar 16 18:07:55 crc kubenswrapper[5120]: I0316 18:07:55.764541 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-operators/horizon-operator-controller-manager-6f896bd9dc-t4ct8" podUID="c1b1aabe-0cec-4e02-aa41-cbfbb6eb6d59" containerName="manager" containerID="cri-o://f1e5aac041c4423ed1f0131e5dbd43996af933b52b75e708220c95414090a695" gracePeriod=10 Mar 16 18:07:55 crc kubenswrapper[5120]: E0316 18:07:55.860379 5120 configmap.go:193] Couldn't get configMap horizon-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Mar 16 18:07:55 crc kubenswrapper[5120]: E0316 18:07:55.860737 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/be179d3f-0e28-4c2b-bc0a-aec68b9e3e98-operator-scripts podName:be179d3f-0e28-4c2b-bc0a-aec68b9e3e98 nodeName:}" failed. No retries permitted until 2026-03-16 18:07:57.860719757 +0000 UTC m=+9380.014651414 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/be179d3f-0e28-4c2b-bc0a-aec68b9e3e98-operator-scripts") pod "keystonecd08-account-delete-5p5vv" (UID: "be179d3f-0e28-4c2b-bc0a-aec68b9e3e98") : configmap "openstack-scripts" not found Mar 16 18:07:55 crc kubenswrapper[5120]: I0316 18:07:55.863419 5120 prober.go:120] "Probe failed" probeType="Readiness" pod="horizon-kuttl-tests/keystone-8574f95c55-5vc9m" podUID="c963986f-f511-4a4b-a677-58c672447b83" containerName="keystone-api" probeResult="failure" output="Get \"http://10.217.0.90:5000/v3\": read tcp 10.217.0.2:47034->10.217.0.90:5000: read: connection reset by peer" Mar 16 18:07:55 crc kubenswrapper[5120]: I0316 18:07:55.933298 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="horizon-kuttl-tests/openstack-galera-1" podUID="a9402e78-0f0a-4bb6-bc56-551b7ccf4bda" containerName="galera" containerID="cri-o://53b79a0ea3c7b2fcdba6e9ad4be620a49beb151cb99ed18d1cebaa501d3260db" gracePeriod=28 Mar 16 18:07:56 crc kubenswrapper[5120]: I0316 18:07:56.057596 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/horizon-operator-index-vvnhz"] Mar 16 18:07:56 crc kubenswrapper[5120]: I0316 18:07:56.057919 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-operators/horizon-operator-index-vvnhz" podUID="53e2dc28-d482-4df0-a8a6-7a95b71fe79d" containerName="registry-server" containerID="cri-o://653fcd774635bb8e2ce8e097514000ae29670451e2d902c62b9e400566274194" gracePeriod=30 Mar 16 18:07:56 crc kubenswrapper[5120]: I0316 18:07:56.105791 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/d2bff6c6f6a1534d46c2cde063993db014f4253f502be0f62cc0b57f6c778sc"] Mar 16 18:07:56 crc kubenswrapper[5120]: I0316 18:07:56.124571 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-operators/d2bff6c6f6a1534d46c2cde063993db014f4253f502be0f62cc0b57f6c778sc"] Mar 16 18:07:56 crc kubenswrapper[5120]: I0316 18:07:56.275984 5120 kubelet_pods.go:1019] "Unable to retrieve pull secret, the image pull may not succeed." pod="horizon-kuttl-tests/keystonecd08-account-delete-5p5vv" secret="" err="secret \"galera-openstack-dockercfg-4l6cf\" not found" Mar 16 18:07:56 crc kubenswrapper[5120]: I0316 18:07:56.276040 5120 scope.go:117] "RemoveContainer" containerID="76e9dbf228892c0b5c19e9338a3e25dce76ac6f3b4a57fdea8b79fabe9ea6751" Mar 16 18:07:56 crc kubenswrapper[5120]: E0316 18:07:56.276442 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"mariadb-account-delete\" with CrashLoopBackOff: \"back-off 10s restarting failed container=mariadb-account-delete pod=keystonecd08-account-delete-5p5vv_horizon-kuttl-tests(be179d3f-0e28-4c2b-bc0a-aec68b9e3e98)\"" pod="horizon-kuttl-tests/keystonecd08-account-delete-5p5vv" podUID="be179d3f-0e28-4c2b-bc0a-aec68b9e3e98" Mar 16 18:07:56 crc kubenswrapper[5120]: I0316 18:07:56.278924 5120 generic.go:358] "Generic (PLEG): container finished" podID="c963986f-f511-4a4b-a677-58c672447b83" containerID="5ee10dfa961ef5fce80b33b1f8ca22b18dd8d655e9124fc30b82e0d7a3858111" exitCode=0 Mar 16 18:07:56 crc kubenswrapper[5120]: I0316 18:07:56.279117 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="horizon-kuttl-tests/keystone-8574f95c55-5vc9m" event={"ID":"c963986f-f511-4a4b-a677-58c672447b83","Type":"ContainerDied","Data":"5ee10dfa961ef5fce80b33b1f8ca22b18dd8d655e9124fc30b82e0d7a3858111"} Mar 16 18:07:56 crc kubenswrapper[5120]: I0316 18:07:56.287480 5120 generic.go:358] "Generic (PLEG): container finished" podID="53e2dc28-d482-4df0-a8a6-7a95b71fe79d" containerID="653fcd774635bb8e2ce8e097514000ae29670451e2d902c62b9e400566274194" exitCode=0 Mar 16 18:07:56 crc kubenswrapper[5120]: I0316 18:07:56.287626 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/horizon-operator-index-vvnhz" event={"ID":"53e2dc28-d482-4df0-a8a6-7a95b71fe79d","Type":"ContainerDied","Data":"653fcd774635bb8e2ce8e097514000ae29670451e2d902c62b9e400566274194"} Mar 16 18:07:56 crc kubenswrapper[5120]: I0316 18:07:56.305884 5120 generic.go:358] "Generic (PLEG): container finished" podID="c1b1aabe-0cec-4e02-aa41-cbfbb6eb6d59" containerID="f1e5aac041c4423ed1f0131e5dbd43996af933b52b75e708220c95414090a695" exitCode=0 Mar 16 18:07:56 crc kubenswrapper[5120]: I0316 18:07:56.305942 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/horizon-operator-controller-manager-6f896bd9dc-t4ct8" event={"ID":"c1b1aabe-0cec-4e02-aa41-cbfbb6eb6d59","Type":"ContainerDied","Data":"f1e5aac041c4423ed1f0131e5dbd43996af933b52b75e708220c95414090a695"} Mar 16 18:07:56 crc kubenswrapper[5120]: I0316 18:07:56.305992 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/horizon-operator-controller-manager-6f896bd9dc-t4ct8" event={"ID":"c1b1aabe-0cec-4e02-aa41-cbfbb6eb6d59","Type":"ContainerDied","Data":"e663eceaab366d48792ced6af5a9e3f15795683669bfb1b448ef31b391009be2"} Mar 16 18:07:56 crc kubenswrapper[5120]: I0316 18:07:56.306008 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e663eceaab366d48792ced6af5a9e3f15795683669bfb1b448ef31b391009be2" Mar 16 18:07:56 crc kubenswrapper[5120]: I0316 18:07:56.518980 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/horizon-operator-controller-manager-6f896bd9dc-t4ct8" Mar 16 18:07:56 crc kubenswrapper[5120]: I0316 18:07:56.521140 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="horizon-kuttl-tests/keystone-8574f95c55-5vc9m" Mar 16 18:07:56 crc kubenswrapper[5120]: I0316 18:07:56.540394 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/horizon-operator-index-vvnhz" Mar 16 18:07:56 crc kubenswrapper[5120]: I0316 18:07:56.578033 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vm62w\" (UniqueName: \"kubernetes.io/projected/c963986f-f511-4a4b-a677-58c672447b83-kube-api-access-vm62w\") pod \"c963986f-f511-4a4b-a677-58c672447b83\" (UID: \"c963986f-f511-4a4b-a677-58c672447b83\") " Mar 16 18:07:56 crc kubenswrapper[5120]: I0316 18:07:56.578151 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c963986f-f511-4a4b-a677-58c672447b83-scripts\") pod \"c963986f-f511-4a4b-a677-58c672447b83\" (UID: \"c963986f-f511-4a4b-a677-58c672447b83\") " Mar 16 18:07:56 crc kubenswrapper[5120]: I0316 18:07:56.578222 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c1b1aabe-0cec-4e02-aa41-cbfbb6eb6d59-apiservice-cert\") pod \"c1b1aabe-0cec-4e02-aa41-cbfbb6eb6d59\" (UID: \"c1b1aabe-0cec-4e02-aa41-cbfbb6eb6d59\") " Mar 16 18:07:56 crc kubenswrapper[5120]: I0316 18:07:56.578402 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pc8kz\" (UniqueName: \"kubernetes.io/projected/c1b1aabe-0cec-4e02-aa41-cbfbb6eb6d59-kube-api-access-pc8kz\") pod \"c1b1aabe-0cec-4e02-aa41-cbfbb6eb6d59\" (UID: \"c1b1aabe-0cec-4e02-aa41-cbfbb6eb6d59\") " Mar 16 18:07:56 crc kubenswrapper[5120]: I0316 18:07:56.578541 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/c963986f-f511-4a4b-a677-58c672447b83-fernet-keys\") pod \"c963986f-f511-4a4b-a677-58c672447b83\" (UID: \"c963986f-f511-4a4b-a677-58c672447b83\") " Mar 16 18:07:56 crc kubenswrapper[5120]: I0316 18:07:56.578801 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c963986f-f511-4a4b-a677-58c672447b83-config-data\") pod \"c963986f-f511-4a4b-a677-58c672447b83\" (UID: \"c963986f-f511-4a4b-a677-58c672447b83\") " Mar 16 18:07:56 crc kubenswrapper[5120]: I0316 18:07:56.578917 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c1b1aabe-0cec-4e02-aa41-cbfbb6eb6d59-webhook-cert\") pod \"c1b1aabe-0cec-4e02-aa41-cbfbb6eb6d59\" (UID: \"c1b1aabe-0cec-4e02-aa41-cbfbb6eb6d59\") " Mar 16 18:07:56 crc kubenswrapper[5120]: I0316 18:07:56.578957 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/c963986f-f511-4a4b-a677-58c672447b83-credential-keys\") pod \"c963986f-f511-4a4b-a677-58c672447b83\" (UID: \"c963986f-f511-4a4b-a677-58c672447b83\") " Mar 16 18:07:56 crc kubenswrapper[5120]: I0316 18:07:56.579112 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gl4gt\" (UniqueName: \"kubernetes.io/projected/53e2dc28-d482-4df0-a8a6-7a95b71fe79d-kube-api-access-gl4gt\") pod \"53e2dc28-d482-4df0-a8a6-7a95b71fe79d\" (UID: \"53e2dc28-d482-4df0-a8a6-7a95b71fe79d\") " Mar 16 18:07:56 crc kubenswrapper[5120]: I0316 18:07:56.585236 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c1b1aabe-0cec-4e02-aa41-cbfbb6eb6d59-apiservice-cert" (OuterVolumeSpecName: "apiservice-cert") pod "c1b1aabe-0cec-4e02-aa41-cbfbb6eb6d59" (UID: "c1b1aabe-0cec-4e02-aa41-cbfbb6eb6d59"). InnerVolumeSpecName "apiservice-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 18:07:56 crc kubenswrapper[5120]: I0316 18:07:56.589008 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c963986f-f511-4a4b-a677-58c672447b83-scripts" (OuterVolumeSpecName: "scripts") pod "c963986f-f511-4a4b-a677-58c672447b83" (UID: "c963986f-f511-4a4b-a677-58c672447b83"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 18:07:56 crc kubenswrapper[5120]: I0316 18:07:56.589152 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53e2dc28-d482-4df0-a8a6-7a95b71fe79d-kube-api-access-gl4gt" (OuterVolumeSpecName: "kube-api-access-gl4gt") pod "53e2dc28-d482-4df0-a8a6-7a95b71fe79d" (UID: "53e2dc28-d482-4df0-a8a6-7a95b71fe79d"). InnerVolumeSpecName "kube-api-access-gl4gt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 18:07:56 crc kubenswrapper[5120]: I0316 18:07:56.590041 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c963986f-f511-4a4b-a677-58c672447b83-kube-api-access-vm62w" (OuterVolumeSpecName: "kube-api-access-vm62w") pod "c963986f-f511-4a4b-a677-58c672447b83" (UID: "c963986f-f511-4a4b-a677-58c672447b83"). InnerVolumeSpecName "kube-api-access-vm62w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 18:07:56 crc kubenswrapper[5120]: I0316 18:07:56.591899 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c963986f-f511-4a4b-a677-58c672447b83-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "c963986f-f511-4a4b-a677-58c672447b83" (UID: "c963986f-f511-4a4b-a677-58c672447b83"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 18:07:56 crc kubenswrapper[5120]: I0316 18:07:56.591948 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c963986f-f511-4a4b-a677-58c672447b83-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "c963986f-f511-4a4b-a677-58c672447b83" (UID: "c963986f-f511-4a4b-a677-58c672447b83"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 18:07:56 crc kubenswrapper[5120]: I0316 18:07:56.591986 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1b1aabe-0cec-4e02-aa41-cbfbb6eb6d59-kube-api-access-pc8kz" (OuterVolumeSpecName: "kube-api-access-pc8kz") pod "c1b1aabe-0cec-4e02-aa41-cbfbb6eb6d59" (UID: "c1b1aabe-0cec-4e02-aa41-cbfbb6eb6d59"). InnerVolumeSpecName "kube-api-access-pc8kz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 18:07:56 crc kubenswrapper[5120]: I0316 18:07:56.592010 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c1b1aabe-0cec-4e02-aa41-cbfbb6eb6d59-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "c1b1aabe-0cec-4e02-aa41-cbfbb6eb6d59" (UID: "c1b1aabe-0cec-4e02-aa41-cbfbb6eb6d59"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 18:07:56 crc kubenswrapper[5120]: I0316 18:07:56.610709 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c963986f-f511-4a4b-a677-58c672447b83-config-data" (OuterVolumeSpecName: "config-data") pod "c963986f-f511-4a4b-a677-58c672447b83" (UID: "c963986f-f511-4a4b-a677-58c672447b83"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 18:07:56 crc kubenswrapper[5120]: I0316 18:07:56.673018 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1cbada35-20cb-4e85-b586-27ff9941011a" path="/var/lib/kubelet/pods/1cbada35-20cb-4e85-b586-27ff9941011a/volumes" Mar 16 18:07:56 crc kubenswrapper[5120]: I0316 18:07:56.673635 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a9c49c2e-669e-4635-bb47-d2320c6aeda3" path="/var/lib/kubelet/pods/a9c49c2e-669e-4635-bb47-d2320c6aeda3/volumes" Mar 16 18:07:56 crc kubenswrapper[5120]: I0316 18:07:56.711727 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gl4gt\" (UniqueName: \"kubernetes.io/projected/53e2dc28-d482-4df0-a8a6-7a95b71fe79d-kube-api-access-gl4gt\") on node \"crc\" DevicePath \"\"" Mar 16 18:07:56 crc kubenswrapper[5120]: I0316 18:07:56.711808 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vm62w\" (UniqueName: \"kubernetes.io/projected/c963986f-f511-4a4b-a677-58c672447b83-kube-api-access-vm62w\") on node \"crc\" DevicePath \"\"" Mar 16 18:07:56 crc kubenswrapper[5120]: I0316 18:07:56.711822 5120 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c963986f-f511-4a4b-a677-58c672447b83-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 18:07:56 crc kubenswrapper[5120]: I0316 18:07:56.711838 5120 reconciler_common.go:299] "Volume detached for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c1b1aabe-0cec-4e02-aa41-cbfbb6eb6d59-apiservice-cert\") on node \"crc\" DevicePath \"\"" Mar 16 18:07:56 crc kubenswrapper[5120]: I0316 18:07:56.711858 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pc8kz\" (UniqueName: \"kubernetes.io/projected/c1b1aabe-0cec-4e02-aa41-cbfbb6eb6d59-kube-api-access-pc8kz\") on node \"crc\" DevicePath \"\"" Mar 16 18:07:56 crc kubenswrapper[5120]: I0316 18:07:56.711867 5120 reconciler_common.go:299] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/c963986f-f511-4a4b-a677-58c672447b83-fernet-keys\") on node \"crc\" DevicePath \"\"" Mar 16 18:07:56 crc kubenswrapper[5120]: I0316 18:07:56.711877 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c963986f-f511-4a4b-a677-58c672447b83-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 18:07:56 crc kubenswrapper[5120]: I0316 18:07:56.711885 5120 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c1b1aabe-0cec-4e02-aa41-cbfbb6eb6d59-webhook-cert\") on node \"crc\" DevicePath \"\"" Mar 16 18:07:56 crc kubenswrapper[5120]: I0316 18:07:56.711896 5120 reconciler_common.go:299] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/c963986f-f511-4a4b-a677-58c672447b83-credential-keys\") on node \"crc\" DevicePath \"\"" Mar 16 18:07:56 crc kubenswrapper[5120]: I0316 18:07:56.718337 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="horizon-kuttl-tests/memcached-0" Mar 16 18:07:56 crc kubenswrapper[5120]: I0316 18:07:56.819458 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xsn95\" (UniqueName: \"kubernetes.io/projected/60903bff-9b27-488b-b399-2c87b66a6f35-kube-api-access-xsn95\") pod \"60903bff-9b27-488b-b399-2c87b66a6f35\" (UID: \"60903bff-9b27-488b-b399-2c87b66a6f35\") " Mar 16 18:07:56 crc kubenswrapper[5120]: I0316 18:07:56.819533 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/60903bff-9b27-488b-b399-2c87b66a6f35-kolla-config\") pod \"60903bff-9b27-488b-b399-2c87b66a6f35\" (UID: \"60903bff-9b27-488b-b399-2c87b66a6f35\") " Mar 16 18:07:56 crc kubenswrapper[5120]: I0316 18:07:56.820000 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/60903bff-9b27-488b-b399-2c87b66a6f35-config-data\") pod \"60903bff-9b27-488b-b399-2c87b66a6f35\" (UID: \"60903bff-9b27-488b-b399-2c87b66a6f35\") " Mar 16 18:07:56 crc kubenswrapper[5120]: I0316 18:07:56.821991 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/60903bff-9b27-488b-b399-2c87b66a6f35-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "60903bff-9b27-488b-b399-2c87b66a6f35" (UID: "60903bff-9b27-488b-b399-2c87b66a6f35"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 18:07:56 crc kubenswrapper[5120]: I0316 18:07:56.822471 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/60903bff-9b27-488b-b399-2c87b66a6f35-config-data" (OuterVolumeSpecName: "config-data") pod "60903bff-9b27-488b-b399-2c87b66a6f35" (UID: "60903bff-9b27-488b-b399-2c87b66a6f35"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 18:07:56 crc kubenswrapper[5120]: I0316 18:07:56.831107 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60903bff-9b27-488b-b399-2c87b66a6f35-kube-api-access-xsn95" (OuterVolumeSpecName: "kube-api-access-xsn95") pod "60903bff-9b27-488b-b399-2c87b66a6f35" (UID: "60903bff-9b27-488b-b399-2c87b66a6f35"). InnerVolumeSpecName "kube-api-access-xsn95". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 18:07:56 crc kubenswrapper[5120]: I0316 18:07:56.922899 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xsn95\" (UniqueName: \"kubernetes.io/projected/60903bff-9b27-488b-b399-2c87b66a6f35-kube-api-access-xsn95\") on node \"crc\" DevicePath \"\"" Mar 16 18:07:56 crc kubenswrapper[5120]: I0316 18:07:56.922944 5120 reconciler_common.go:299] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/60903bff-9b27-488b-b399-2c87b66a6f35-kolla-config\") on node \"crc\" DevicePath \"\"" Mar 16 18:07:56 crc kubenswrapper[5120]: I0316 18:07:56.922957 5120 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/60903bff-9b27-488b-b399-2c87b66a6f35-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 18:07:56 crc kubenswrapper[5120]: I0316 18:07:56.971701 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/keystone-operator-controller-manager-5f47546649-l45dt"] Mar 16 18:07:56 crc kubenswrapper[5120]: I0316 18:07:56.972017 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-operators/keystone-operator-controller-manager-5f47546649-l45dt" podUID="4012715d-02e3-423b-8e8f-c710881f9988" containerName="manager" containerID="cri-o://fa5c0333c28b4d66b998741d28c76b4e443c62215c62e96f9d34f773eb8c0cda" gracePeriod=10 Mar 16 18:07:57 crc kubenswrapper[5120]: I0316 18:07:57.073289 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="horizon-kuttl-tests/rabbitmq-server-0" Mar 16 18:07:57 crc kubenswrapper[5120]: I0316 18:07:57.211820 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/keystone-operator-index-jm8f4"] Mar 16 18:07:57 crc kubenswrapper[5120]: I0316 18:07:57.212073 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-operators/keystone-operator-index-jm8f4" podUID="b7674bce-996b-45ac-99a4-4c728e2472cb" containerName="registry-server" containerID="cri-o://a282f7bed3eca0c5dca010234b6d940dc311bff702773a8ce1ab01e080fc29ef" gracePeriod=30 Mar 16 18:07:57 crc kubenswrapper[5120]: I0316 18:07:57.230444 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/7decf9bf-957e-4b6b-8864-da4761ca69cb-rabbitmq-plugins\") pod \"7decf9bf-957e-4b6b-8864-da4761ca69cb\" (UID: \"7decf9bf-957e-4b6b-8864-da4761ca69cb\") " Mar 16 18:07:57 crc kubenswrapper[5120]: I0316 18:07:57.230556 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dbqgg\" (UniqueName: \"kubernetes.io/projected/7decf9bf-957e-4b6b-8864-da4761ca69cb-kube-api-access-dbqgg\") pod \"7decf9bf-957e-4b6b-8864-da4761ca69cb\" (UID: \"7decf9bf-957e-4b6b-8864-da4761ca69cb\") " Mar 16 18:07:57 crc kubenswrapper[5120]: I0316 18:07:57.230781 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"persistence\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-58f4a4c2-fde3-4084-9394-a3d96963418a\") pod \"7decf9bf-957e-4b6b-8864-da4761ca69cb\" (UID: \"7decf9bf-957e-4b6b-8864-da4761ca69cb\") " Mar 16 18:07:57 crc kubenswrapper[5120]: I0316 18:07:57.231040 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/7decf9bf-957e-4b6b-8864-da4761ca69cb-rabbitmq-erlang-cookie\") pod \"7decf9bf-957e-4b6b-8864-da4761ca69cb\" (UID: \"7decf9bf-957e-4b6b-8864-da4761ca69cb\") " Mar 16 18:07:57 crc kubenswrapper[5120]: I0316 18:07:57.231097 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/7decf9bf-957e-4b6b-8864-da4761ca69cb-erlang-cookie-secret\") pod \"7decf9bf-957e-4b6b-8864-da4761ca69cb\" (UID: \"7decf9bf-957e-4b6b-8864-da4761ca69cb\") " Mar 16 18:07:57 crc kubenswrapper[5120]: I0316 18:07:57.231184 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/7decf9bf-957e-4b6b-8864-da4761ca69cb-plugins-conf\") pod \"7decf9bf-957e-4b6b-8864-da4761ca69cb\" (UID: \"7decf9bf-957e-4b6b-8864-da4761ca69cb\") " Mar 16 18:07:57 crc kubenswrapper[5120]: I0316 18:07:57.231330 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/7decf9bf-957e-4b6b-8864-da4761ca69cb-rabbitmq-confd\") pod \"7decf9bf-957e-4b6b-8864-da4761ca69cb\" (UID: \"7decf9bf-957e-4b6b-8864-da4761ca69cb\") " Mar 16 18:07:57 crc kubenswrapper[5120]: I0316 18:07:57.231398 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7decf9bf-957e-4b6b-8864-da4761ca69cb-rabbitmq-plugins" (OuterVolumeSpecName: "rabbitmq-plugins") pod "7decf9bf-957e-4b6b-8864-da4761ca69cb" (UID: "7decf9bf-957e-4b6b-8864-da4761ca69cb"). InnerVolumeSpecName "rabbitmq-plugins". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 18:07:57 crc kubenswrapper[5120]: I0316 18:07:57.231518 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/7decf9bf-957e-4b6b-8864-da4761ca69cb-pod-info\") pod \"7decf9bf-957e-4b6b-8864-da4761ca69cb\" (UID: \"7decf9bf-957e-4b6b-8864-da4761ca69cb\") " Mar 16 18:07:57 crc kubenswrapper[5120]: I0316 18:07:57.231704 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7decf9bf-957e-4b6b-8864-da4761ca69cb-rabbitmq-erlang-cookie" (OuterVolumeSpecName: "rabbitmq-erlang-cookie") pod "7decf9bf-957e-4b6b-8864-da4761ca69cb" (UID: "7decf9bf-957e-4b6b-8864-da4761ca69cb"). InnerVolumeSpecName "rabbitmq-erlang-cookie". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 18:07:57 crc kubenswrapper[5120]: I0316 18:07:57.232559 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/7decf9bf-957e-4b6b-8864-da4761ca69cb-rabbitmq-plugins\") on node \"crc\" DevicePath \"\"" Mar 16 18:07:57 crc kubenswrapper[5120]: I0316 18:07:57.232593 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/7decf9bf-957e-4b6b-8864-da4761ca69cb-rabbitmq-erlang-cookie\") on node \"crc\" DevicePath \"\"" Mar 16 18:07:57 crc kubenswrapper[5120]: I0316 18:07:57.235050 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7decf9bf-957e-4b6b-8864-da4761ca69cb-kube-api-access-dbqgg" (OuterVolumeSpecName: "kube-api-access-dbqgg") pod "7decf9bf-957e-4b6b-8864-da4761ca69cb" (UID: "7decf9bf-957e-4b6b-8864-da4761ca69cb"). InnerVolumeSpecName "kube-api-access-dbqgg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 18:07:57 crc kubenswrapper[5120]: I0316 18:07:57.235402 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7decf9bf-957e-4b6b-8864-da4761ca69cb-plugins-conf" (OuterVolumeSpecName: "plugins-conf") pod "7decf9bf-957e-4b6b-8864-da4761ca69cb" (UID: "7decf9bf-957e-4b6b-8864-da4761ca69cb"). InnerVolumeSpecName "plugins-conf". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 18:07:57 crc kubenswrapper[5120]: I0316 18:07:57.236976 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7decf9bf-957e-4b6b-8864-da4761ca69cb-pod-info" (OuterVolumeSpecName: "pod-info") pod "7decf9bf-957e-4b6b-8864-da4761ca69cb" (UID: "7decf9bf-957e-4b6b-8864-da4761ca69cb"). InnerVolumeSpecName "pod-info". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Mar 16 18:07:57 crc kubenswrapper[5120]: I0316 18:07:57.240685 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7decf9bf-957e-4b6b-8864-da4761ca69cb-erlang-cookie-secret" (OuterVolumeSpecName: "erlang-cookie-secret") pod "7decf9bf-957e-4b6b-8864-da4761ca69cb" (UID: "7decf9bf-957e-4b6b-8864-da4761ca69cb"). InnerVolumeSpecName "erlang-cookie-secret". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 18:07:57 crc kubenswrapper[5120]: I0316 18:07:57.293304 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-58f4a4c2-fde3-4084-9394-a3d96963418a" (OuterVolumeSpecName: "persistence") pod "7decf9bf-957e-4b6b-8864-da4761ca69cb" (UID: "7decf9bf-957e-4b6b-8864-da4761ca69cb"). InnerVolumeSpecName "pvc-58f4a4c2-fde3-4084-9394-a3d96963418a". PluginName "kubernetes.io/csi", VolumeGIDValue "" Mar 16 18:07:57 crc kubenswrapper[5120]: I0316 18:07:57.293782 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/057d2ef2813dbca67df99f545f5daea57175a3b6e27320c69396d55997pq7ff"] Mar 16 18:07:57 crc kubenswrapper[5120]: I0316 18:07:57.318786 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-operators/057d2ef2813dbca67df99f545f5daea57175a3b6e27320c69396d55997pq7ff"] Mar 16 18:07:57 crc kubenswrapper[5120]: I0316 18:07:57.328723 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="horizon-kuttl-tests/keystone-8574f95c55-5vc9m" Mar 16 18:07:57 crc kubenswrapper[5120]: I0316 18:07:57.330564 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="horizon-kuttl-tests/keystone-8574f95c55-5vc9m" event={"ID":"c963986f-f511-4a4b-a677-58c672447b83","Type":"ContainerDied","Data":"2200ba9e3150ebd47ba2e92510156189c41b5fab89ae2884f1943cc49cbed566"} Mar 16 18:07:57 crc kubenswrapper[5120]: I0316 18:07:57.330632 5120 scope.go:117] "RemoveContainer" containerID="5ee10dfa961ef5fce80b33b1f8ca22b18dd8d655e9124fc30b82e0d7a3858111" Mar 16 18:07:57 crc kubenswrapper[5120]: I0316 18:07:57.338921 5120 generic.go:358] "Generic (PLEG): container finished" podID="60903bff-9b27-488b-b399-2c87b66a6f35" containerID="820f3098adfdf7eaa9f705c0627a4651a21a126e5608ae4d7701154ca804855c" exitCode=0 Mar 16 18:07:57 crc kubenswrapper[5120]: I0316 18:07:57.338983 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="horizon-kuttl-tests/memcached-0" event={"ID":"60903bff-9b27-488b-b399-2c87b66a6f35","Type":"ContainerDied","Data":"820f3098adfdf7eaa9f705c0627a4651a21a126e5608ae4d7701154ca804855c"} Mar 16 18:07:57 crc kubenswrapper[5120]: I0316 18:07:57.339009 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="horizon-kuttl-tests/memcached-0" event={"ID":"60903bff-9b27-488b-b399-2c87b66a6f35","Type":"ContainerDied","Data":"e7b21207b66eecdc9afaa258b5740f03c7a9dfe5feae1e0504e0c9d0ef5570e0"} Mar 16 18:07:57 crc kubenswrapper[5120]: I0316 18:07:57.339070 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="horizon-kuttl-tests/memcached-0" Mar 16 18:07:57 crc kubenswrapper[5120]: I0316 18:07:57.340467 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dbqgg\" (UniqueName: \"kubernetes.io/projected/7decf9bf-957e-4b6b-8864-da4761ca69cb-kube-api-access-dbqgg\") on node \"crc\" DevicePath \"\"" Mar 16 18:07:57 crc kubenswrapper[5120]: I0316 18:07:57.340531 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"pvc-58f4a4c2-fde3-4084-9394-a3d96963418a\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-58f4a4c2-fde3-4084-9394-a3d96963418a\") on node \"crc\" " Mar 16 18:07:57 crc kubenswrapper[5120]: I0316 18:07:57.340550 5120 reconciler_common.go:299] "Volume detached for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/7decf9bf-957e-4b6b-8864-da4761ca69cb-erlang-cookie-secret\") on node \"crc\" DevicePath \"\"" Mar 16 18:07:57 crc kubenswrapper[5120]: I0316 18:07:57.340566 5120 reconciler_common.go:299] "Volume detached for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/7decf9bf-957e-4b6b-8864-da4761ca69cb-plugins-conf\") on node \"crc\" DevicePath \"\"" Mar 16 18:07:57 crc kubenswrapper[5120]: I0316 18:07:57.340578 5120 reconciler_common.go:299] "Volume detached for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/7decf9bf-957e-4b6b-8864-da4761ca69cb-pod-info\") on node \"crc\" DevicePath \"\"" Mar 16 18:07:57 crc kubenswrapper[5120]: I0316 18:07:57.353027 5120 generic.go:358] "Generic (PLEG): container finished" podID="7decf9bf-957e-4b6b-8864-da4761ca69cb" containerID="0e669d433bf25cfe0d9b815afcb0152c9b8b65eb9e466b5f0536bc0b5d2c7699" exitCode=0 Mar 16 18:07:57 crc kubenswrapper[5120]: I0316 18:07:57.353113 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="horizon-kuttl-tests/rabbitmq-server-0" event={"ID":"7decf9bf-957e-4b6b-8864-da4761ca69cb","Type":"ContainerDied","Data":"0e669d433bf25cfe0d9b815afcb0152c9b8b65eb9e466b5f0536bc0b5d2c7699"} Mar 16 18:07:57 crc kubenswrapper[5120]: I0316 18:07:57.353146 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="horizon-kuttl-tests/rabbitmq-server-0" event={"ID":"7decf9bf-957e-4b6b-8864-da4761ca69cb","Type":"ContainerDied","Data":"ab78dc1cf012e0e119b71da85c2f1c557c9086fb7bfc3aa19bae753d1bdba288"} Mar 16 18:07:57 crc kubenswrapper[5120]: I0316 18:07:57.353316 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="horizon-kuttl-tests/rabbitmq-server-0" Mar 16 18:07:57 crc kubenswrapper[5120]: I0316 18:07:57.358884 5120 generic.go:358] "Generic (PLEG): container finished" podID="4012715d-02e3-423b-8e8f-c710881f9988" containerID="fa5c0333c28b4d66b998741d28c76b4e443c62215c62e96f9d34f773eb8c0cda" exitCode=0 Mar 16 18:07:57 crc kubenswrapper[5120]: I0316 18:07:57.359266 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/keystone-operator-controller-manager-5f47546649-l45dt" event={"ID":"4012715d-02e3-423b-8e8f-c710881f9988","Type":"ContainerDied","Data":"fa5c0333c28b4d66b998741d28c76b4e443c62215c62e96f9d34f773eb8c0cda"} Mar 16 18:07:57 crc kubenswrapper[5120]: I0316 18:07:57.368862 5120 csi_attacher.go:567] kubernetes.io/csi: attacher.UnmountDevice STAGE_UNSTAGE_VOLUME capability not set. Skipping UnmountDevice... Mar 16 18:07:57 crc kubenswrapper[5120]: I0316 18:07:57.369039 5120 operation_generator.go:895] UnmountDevice succeeded for volume "pvc-58f4a4c2-fde3-4084-9394-a3d96963418a" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-58f4a4c2-fde3-4084-9394-a3d96963418a") on node "crc" Mar 16 18:07:57 crc kubenswrapper[5120]: I0316 18:07:57.401262 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/horizon-operator-controller-manager-6f896bd9dc-t4ct8" Mar 16 18:07:57 crc kubenswrapper[5120]: I0316 18:07:57.401752 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/horizon-operator-index-vvnhz" Mar 16 18:07:57 crc kubenswrapper[5120]: I0316 18:07:57.401863 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/horizon-operator-index-vvnhz" event={"ID":"53e2dc28-d482-4df0-a8a6-7a95b71fe79d","Type":"ContainerDied","Data":"c485e2297e5edecb6fc05e716f1ed24c3fe020a361d3cdf069b29085b536c65d"} Mar 16 18:07:57 crc kubenswrapper[5120]: I0316 18:07:57.413245 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7decf9bf-957e-4b6b-8864-da4761ca69cb-rabbitmq-confd" (OuterVolumeSpecName: "rabbitmq-confd") pod "7decf9bf-957e-4b6b-8864-da4761ca69cb" (UID: "7decf9bf-957e-4b6b-8864-da4761ca69cb"). InnerVolumeSpecName "rabbitmq-confd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 18:07:57 crc kubenswrapper[5120]: I0316 18:07:57.443019 5120 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/7decf9bf-957e-4b6b-8864-da4761ca69cb-rabbitmq-confd\") on node \"crc\" DevicePath \"\"" Mar 16 18:07:57 crc kubenswrapper[5120]: I0316 18:07:57.443057 5120 reconciler_common.go:299] "Volume detached for volume \"pvc-58f4a4c2-fde3-4084-9394-a3d96963418a\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-58f4a4c2-fde3-4084-9394-a3d96963418a\") on node \"crc\" DevicePath \"\"" Mar 16 18:07:57 crc kubenswrapper[5120]: I0316 18:07:57.472727 5120 scope.go:117] "RemoveContainer" containerID="820f3098adfdf7eaa9f705c0627a4651a21a126e5608ae4d7701154ca804855c" Mar 16 18:07:57 crc kubenswrapper[5120]: I0316 18:07:57.509225 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/horizon-operator-controller-manager-6f896bd9dc-t4ct8"] Mar 16 18:07:57 crc kubenswrapper[5120]: I0316 18:07:57.517722 5120 scope.go:117] "RemoveContainer" containerID="820f3098adfdf7eaa9f705c0627a4651a21a126e5608ae4d7701154ca804855c" Mar 16 18:07:57 crc kubenswrapper[5120]: E0316 18:07:57.519684 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"820f3098adfdf7eaa9f705c0627a4651a21a126e5608ae4d7701154ca804855c\": container with ID starting with 820f3098adfdf7eaa9f705c0627a4651a21a126e5608ae4d7701154ca804855c not found: ID does not exist" containerID="820f3098adfdf7eaa9f705c0627a4651a21a126e5608ae4d7701154ca804855c" Mar 16 18:07:57 crc kubenswrapper[5120]: I0316 18:07:57.519729 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"820f3098adfdf7eaa9f705c0627a4651a21a126e5608ae4d7701154ca804855c"} err="failed to get container status \"820f3098adfdf7eaa9f705c0627a4651a21a126e5608ae4d7701154ca804855c\": rpc error: code = NotFound desc = could not find container \"820f3098adfdf7eaa9f705c0627a4651a21a126e5608ae4d7701154ca804855c\": container with ID starting with 820f3098adfdf7eaa9f705c0627a4651a21a126e5608ae4d7701154ca804855c not found: ID does not exist" Mar 16 18:07:57 crc kubenswrapper[5120]: I0316 18:07:57.519830 5120 scope.go:117] "RemoveContainer" containerID="0e669d433bf25cfe0d9b815afcb0152c9b8b65eb9e466b5f0536bc0b5d2c7699" Mar 16 18:07:57 crc kubenswrapper[5120]: I0316 18:07:57.521299 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-operators/horizon-operator-controller-manager-6f896bd9dc-t4ct8"] Mar 16 18:07:57 crc kubenswrapper[5120]: I0316 18:07:57.530789 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["horizon-kuttl-tests/keystone-8574f95c55-5vc9m"] Mar 16 18:07:57 crc kubenswrapper[5120]: I0316 18:07:57.540851 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["horizon-kuttl-tests/keystone-8574f95c55-5vc9m"] Mar 16 18:07:57 crc kubenswrapper[5120]: I0316 18:07:57.546436 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["horizon-kuttl-tests/memcached-0"] Mar 16 18:07:57 crc kubenswrapper[5120]: I0316 18:07:57.552255 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["horizon-kuttl-tests/memcached-0"] Mar 16 18:07:57 crc kubenswrapper[5120]: I0316 18:07:57.559243 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/horizon-operator-index-vvnhz"] Mar 16 18:07:57 crc kubenswrapper[5120]: I0316 18:07:57.561497 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/keystone-operator-controller-manager-5f47546649-l45dt" Mar 16 18:07:57 crc kubenswrapper[5120]: I0316 18:07:57.566178 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-operators/horizon-operator-index-vvnhz"] Mar 16 18:07:57 crc kubenswrapper[5120]: I0316 18:07:57.579573 5120 scope.go:117] "RemoveContainer" containerID="87a20c9b7558d4bbe9dafeaea6a8b020527776c718d80dfa93dab528ddc5880e" Mar 16 18:07:57 crc kubenswrapper[5120]: I0316 18:07:57.620109 5120 scope.go:117] "RemoveContainer" containerID="0e669d433bf25cfe0d9b815afcb0152c9b8b65eb9e466b5f0536bc0b5d2c7699" Mar 16 18:07:57 crc kubenswrapper[5120]: E0316 18:07:57.625070 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0e669d433bf25cfe0d9b815afcb0152c9b8b65eb9e466b5f0536bc0b5d2c7699\": container with ID starting with 0e669d433bf25cfe0d9b815afcb0152c9b8b65eb9e466b5f0536bc0b5d2c7699 not found: ID does not exist" containerID="0e669d433bf25cfe0d9b815afcb0152c9b8b65eb9e466b5f0536bc0b5d2c7699" Mar 16 18:07:57 crc kubenswrapper[5120]: I0316 18:07:57.625120 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e669d433bf25cfe0d9b815afcb0152c9b8b65eb9e466b5f0536bc0b5d2c7699"} err="failed to get container status \"0e669d433bf25cfe0d9b815afcb0152c9b8b65eb9e466b5f0536bc0b5d2c7699\": rpc error: code = NotFound desc = could not find container \"0e669d433bf25cfe0d9b815afcb0152c9b8b65eb9e466b5f0536bc0b5d2c7699\": container with ID starting with 0e669d433bf25cfe0d9b815afcb0152c9b8b65eb9e466b5f0536bc0b5d2c7699 not found: ID does not exist" Mar 16 18:07:57 crc kubenswrapper[5120]: I0316 18:07:57.625144 5120 scope.go:117] "RemoveContainer" containerID="87a20c9b7558d4bbe9dafeaea6a8b020527776c718d80dfa93dab528ddc5880e" Mar 16 18:07:57 crc kubenswrapper[5120]: E0316 18:07:57.625672 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"87a20c9b7558d4bbe9dafeaea6a8b020527776c718d80dfa93dab528ddc5880e\": container with ID starting with 87a20c9b7558d4bbe9dafeaea6a8b020527776c718d80dfa93dab528ddc5880e not found: ID does not exist" containerID="87a20c9b7558d4bbe9dafeaea6a8b020527776c718d80dfa93dab528ddc5880e" Mar 16 18:07:57 crc kubenswrapper[5120]: I0316 18:07:57.625713 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87a20c9b7558d4bbe9dafeaea6a8b020527776c718d80dfa93dab528ddc5880e"} err="failed to get container status \"87a20c9b7558d4bbe9dafeaea6a8b020527776c718d80dfa93dab528ddc5880e\": rpc error: code = NotFound desc = could not find container \"87a20c9b7558d4bbe9dafeaea6a8b020527776c718d80dfa93dab528ddc5880e\": container with ID starting with 87a20c9b7558d4bbe9dafeaea6a8b020527776c718d80dfa93dab528ddc5880e not found: ID does not exist" Mar 16 18:07:57 crc kubenswrapper[5120]: I0316 18:07:57.625738 5120 scope.go:117] "RemoveContainer" containerID="653fcd774635bb8e2ce8e097514000ae29670451e2d902c62b9e400566274194" Mar 16 18:07:57 crc kubenswrapper[5120]: I0316 18:07:57.653100 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g4tz2\" (UniqueName: \"kubernetes.io/projected/4012715d-02e3-423b-8e8f-c710881f9988-kube-api-access-g4tz2\") pod \"4012715d-02e3-423b-8e8f-c710881f9988\" (UID: \"4012715d-02e3-423b-8e8f-c710881f9988\") " Mar 16 18:07:57 crc kubenswrapper[5120]: I0316 18:07:57.653557 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4012715d-02e3-423b-8e8f-c710881f9988-webhook-cert\") pod \"4012715d-02e3-423b-8e8f-c710881f9988\" (UID: \"4012715d-02e3-423b-8e8f-c710881f9988\") " Mar 16 18:07:57 crc kubenswrapper[5120]: I0316 18:07:57.653875 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4012715d-02e3-423b-8e8f-c710881f9988-apiservice-cert\") pod \"4012715d-02e3-423b-8e8f-c710881f9988\" (UID: \"4012715d-02e3-423b-8e8f-c710881f9988\") " Mar 16 18:07:57 crc kubenswrapper[5120]: I0316 18:07:57.659926 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4012715d-02e3-423b-8e8f-c710881f9988-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "4012715d-02e3-423b-8e8f-c710881f9988" (UID: "4012715d-02e3-423b-8e8f-c710881f9988"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 18:07:57 crc kubenswrapper[5120]: I0316 18:07:57.660313 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4012715d-02e3-423b-8e8f-c710881f9988-kube-api-access-g4tz2" (OuterVolumeSpecName: "kube-api-access-g4tz2") pod "4012715d-02e3-423b-8e8f-c710881f9988" (UID: "4012715d-02e3-423b-8e8f-c710881f9988"). InnerVolumeSpecName "kube-api-access-g4tz2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 18:07:57 crc kubenswrapper[5120]: I0316 18:07:57.660467 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4012715d-02e3-423b-8e8f-c710881f9988-apiservice-cert" (OuterVolumeSpecName: "apiservice-cert") pod "4012715d-02e3-423b-8e8f-c710881f9988" (UID: "4012715d-02e3-423b-8e8f-c710881f9988"). InnerVolumeSpecName "apiservice-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 18:07:57 crc kubenswrapper[5120]: I0316 18:07:57.718805 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["horizon-kuttl-tests/rabbitmq-server-0"] Mar 16 18:07:57 crc kubenswrapper[5120]: I0316 18:07:57.721348 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["horizon-kuttl-tests/rabbitmq-server-0"] Mar 16 18:07:57 crc kubenswrapper[5120]: I0316 18:07:57.744078 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/keystone-operator-index-jm8f4" Mar 16 18:07:57 crc kubenswrapper[5120]: I0316 18:07:57.756552 5120 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4012715d-02e3-423b-8e8f-c710881f9988-webhook-cert\") on node \"crc\" DevicePath \"\"" Mar 16 18:07:57 crc kubenswrapper[5120]: I0316 18:07:57.758310 5120 reconciler_common.go:299] "Volume detached for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4012715d-02e3-423b-8e8f-c710881f9988-apiservice-cert\") on node \"crc\" DevicePath \"\"" Mar 16 18:07:57 crc kubenswrapper[5120]: I0316 18:07:57.758438 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g4tz2\" (UniqueName: \"kubernetes.io/projected/4012715d-02e3-423b-8e8f-c710881f9988-kube-api-access-g4tz2\") on node \"crc\" DevicePath \"\"" Mar 16 18:07:57 crc kubenswrapper[5120]: I0316 18:07:57.865039 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jvsvm\" (UniqueName: \"kubernetes.io/projected/b7674bce-996b-45ac-99a4-4c728e2472cb-kube-api-access-jvsvm\") pod \"b7674bce-996b-45ac-99a4-4c728e2472cb\" (UID: \"b7674bce-996b-45ac-99a4-4c728e2472cb\") " Mar 16 18:07:57 crc kubenswrapper[5120]: I0316 18:07:57.872308 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7674bce-996b-45ac-99a4-4c728e2472cb-kube-api-access-jvsvm" (OuterVolumeSpecName: "kube-api-access-jvsvm") pod "b7674bce-996b-45ac-99a4-4c728e2472cb" (UID: "b7674bce-996b-45ac-99a4-4c728e2472cb"). InnerVolumeSpecName "kube-api-access-jvsvm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 18:07:57 crc kubenswrapper[5120]: E0316 18:07:57.872583 5120 configmap.go:193] Couldn't get configMap horizon-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Mar 16 18:07:57 crc kubenswrapper[5120]: E0316 18:07:57.872744 5120 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/be179d3f-0e28-4c2b-bc0a-aec68b9e3e98-operator-scripts podName:be179d3f-0e28-4c2b-bc0a-aec68b9e3e98 nodeName:}" failed. No retries permitted until 2026-03-16 18:08:01.872712307 +0000 UTC m=+9384.026643964 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/be179d3f-0e28-4c2b-bc0a-aec68b9e3e98-operator-scripts") pod "keystonecd08-account-delete-5p5vv" (UID: "be179d3f-0e28-4c2b-bc0a-aec68b9e3e98") : configmap "openstack-scripts" not found Mar 16 18:07:57 crc kubenswrapper[5120]: I0316 18:07:57.874934 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["horizon-kuttl-tests/keystone-db-create-csjbp"] Mar 16 18:07:57 crc kubenswrapper[5120]: I0316 18:07:57.880501 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["horizon-kuttl-tests/keystone-db-create-csjbp"] Mar 16 18:07:57 crc kubenswrapper[5120]: I0316 18:07:57.908009 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["horizon-kuttl-tests/keystonecd08-account-delete-5p5vv"] Mar 16 18:07:57 crc kubenswrapper[5120]: I0316 18:07:57.918021 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/rabbitmq-cluster-operator-6bc46f9cd-p55x6"] Mar 16 18:07:57 crc kubenswrapper[5120]: I0316 18:07:57.918320 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-operators/rabbitmq-cluster-operator-6bc46f9cd-p55x6" podUID="15b7d2ec-af69-4090-a15d-5168cd6fd202" containerName="operator" containerID="cri-o://bfe6ac0a042d4e3b1a03edfd3cc950ba950b387709726d83609e59892824963e" gracePeriod=10 Mar 16 18:07:57 crc kubenswrapper[5120]: I0316 18:07:57.928837 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["horizon-kuttl-tests/keystone-cd08-account-create-update-5bgpc"] Mar 16 18:07:57 crc kubenswrapper[5120]: I0316 18:07:57.940739 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["horizon-kuttl-tests/keystone-cd08-account-create-update-5bgpc"] Mar 16 18:07:57 crc kubenswrapper[5120]: I0316 18:07:57.973947 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jvsvm\" (UniqueName: \"kubernetes.io/projected/b7674bce-996b-45ac-99a4-4c728e2472cb-kube-api-access-jvsvm\") on node \"crc\" DevicePath \"\"" Mar 16 18:07:58 crc kubenswrapper[5120]: I0316 18:07:58.132061 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="horizon-kuttl-tests/openstack-galera-0" podUID="dabfd53a-6aac-4c5d-a3d2-9d38975c0e5a" containerName="galera" containerID="cri-o://a816c733aee6eecb0cb95d24f8707290de9aab409ef609b749cabf02695bb76d" gracePeriod=26 Mar 16 18:07:58 crc kubenswrapper[5120]: I0316 18:07:58.176959 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/rabbitmq-cluster-operator-index-9t2s8"] Mar 16 18:07:58 crc kubenswrapper[5120]: I0316 18:07:58.182571 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-operators/rabbitmq-cluster-operator-index-9t2s8" podUID="b40fe47c-32a7-49e9-9285-eb83096a98b6" containerName="registry-server" containerID="cri-o://66d4ae0891cf3f350916b8e9c982ae32b7417c8faf5c04f731dd53a07c64ab19" gracePeriod=30 Mar 16 18:07:58 crc kubenswrapper[5120]: I0316 18:07:58.203262 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590kzqbx"] Mar 16 18:07:58 crc kubenswrapper[5120]: I0316 18:07:58.229661 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590kzqbx"] Mar 16 18:07:58 crc kubenswrapper[5120]: I0316 18:07:58.305745 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="horizon-kuttl-tests/keystonecd08-account-delete-5p5vv" Mar 16 18:07:58 crc kubenswrapper[5120]: I0316 18:07:58.385489 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rz2gx\" (UniqueName: \"kubernetes.io/projected/be179d3f-0e28-4c2b-bc0a-aec68b9e3e98-kube-api-access-rz2gx\") pod \"be179d3f-0e28-4c2b-bc0a-aec68b9e3e98\" (UID: \"be179d3f-0e28-4c2b-bc0a-aec68b9e3e98\") " Mar 16 18:07:58 crc kubenswrapper[5120]: I0316 18:07:58.385566 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/be179d3f-0e28-4c2b-bc0a-aec68b9e3e98-operator-scripts\") pod \"be179d3f-0e28-4c2b-bc0a-aec68b9e3e98\" (UID: \"be179d3f-0e28-4c2b-bc0a-aec68b9e3e98\") " Mar 16 18:07:58 crc kubenswrapper[5120]: I0316 18:07:58.386857 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be179d3f-0e28-4c2b-bc0a-aec68b9e3e98-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "be179d3f-0e28-4c2b-bc0a-aec68b9e3e98" (UID: "be179d3f-0e28-4c2b-bc0a-aec68b9e3e98"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 18:07:58 crc kubenswrapper[5120]: I0316 18:07:58.406285 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be179d3f-0e28-4c2b-bc0a-aec68b9e3e98-kube-api-access-rz2gx" (OuterVolumeSpecName: "kube-api-access-rz2gx") pod "be179d3f-0e28-4c2b-bc0a-aec68b9e3e98" (UID: "be179d3f-0e28-4c2b-bc0a-aec68b9e3e98"). InnerVolumeSpecName "kube-api-access-rz2gx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 18:07:58 crc kubenswrapper[5120]: E0316 18:07:58.409370 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a816c733aee6eecb0cb95d24f8707290de9aab409ef609b749cabf02695bb76d" cmd=["/bin/bash","/var/lib/operator-scripts/mysql_probe.sh","readiness"] Mar 16 18:07:58 crc kubenswrapper[5120]: E0316 18:07:58.413634 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a816c733aee6eecb0cb95d24f8707290de9aab409ef609b749cabf02695bb76d" cmd=["/bin/bash","/var/lib/operator-scripts/mysql_probe.sh","readiness"] Mar 16 18:07:58 crc kubenswrapper[5120]: E0316 18:07:58.415049 5120 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a816c733aee6eecb0cb95d24f8707290de9aab409ef609b749cabf02695bb76d" cmd=["/bin/bash","/var/lib/operator-scripts/mysql_probe.sh","readiness"] Mar 16 18:07:58 crc kubenswrapper[5120]: E0316 18:07:58.415106 5120 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="horizon-kuttl-tests/openstack-galera-0" podUID="dabfd53a-6aac-4c5d-a3d2-9d38975c0e5a" containerName="galera" probeResult="unknown" Mar 16 18:07:58 crc kubenswrapper[5120]: I0316 18:07:58.418058 5120 generic.go:358] "Generic (PLEG): container finished" podID="15b7d2ec-af69-4090-a15d-5168cd6fd202" containerID="bfe6ac0a042d4e3b1a03edfd3cc950ba950b387709726d83609e59892824963e" exitCode=0 Mar 16 18:07:58 crc kubenswrapper[5120]: I0316 18:07:58.418230 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/rabbitmq-cluster-operator-6bc46f9cd-p55x6" event={"ID":"15b7d2ec-af69-4090-a15d-5168cd6fd202","Type":"ContainerDied","Data":"bfe6ac0a042d4e3b1a03edfd3cc950ba950b387709726d83609e59892824963e"} Mar 16 18:07:58 crc kubenswrapper[5120]: I0316 18:07:58.421579 5120 generic.go:358] "Generic (PLEG): container finished" podID="b7674bce-996b-45ac-99a4-4c728e2472cb" containerID="a282f7bed3eca0c5dca010234b6d940dc311bff702773a8ce1ab01e080fc29ef" exitCode=0 Mar 16 18:07:58 crc kubenswrapper[5120]: I0316 18:07:58.421733 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/keystone-operator-index-jm8f4" event={"ID":"b7674bce-996b-45ac-99a4-4c728e2472cb","Type":"ContainerDied","Data":"a282f7bed3eca0c5dca010234b6d940dc311bff702773a8ce1ab01e080fc29ef"} Mar 16 18:07:58 crc kubenswrapper[5120]: I0316 18:07:58.421783 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/keystone-operator-index-jm8f4" event={"ID":"b7674bce-996b-45ac-99a4-4c728e2472cb","Type":"ContainerDied","Data":"deb7e4386481c9cae18b7757f51760b984ce97aaf37157551acc023b694014ff"} Mar 16 18:07:58 crc kubenswrapper[5120]: I0316 18:07:58.421811 5120 scope.go:117] "RemoveContainer" containerID="a282f7bed3eca0c5dca010234b6d940dc311bff702773a8ce1ab01e080fc29ef" Mar 16 18:07:58 crc kubenswrapper[5120]: I0316 18:07:58.421966 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/keystone-operator-index-jm8f4" Mar 16 18:07:58 crc kubenswrapper[5120]: I0316 18:07:58.438799 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="horizon-kuttl-tests/keystonecd08-account-delete-5p5vv" event={"ID":"be179d3f-0e28-4c2b-bc0a-aec68b9e3e98","Type":"ContainerDied","Data":"57936c0619d39ebc7d1d46e0bc0f486159147635e7c57d9cdba1daa337591041"} Mar 16 18:07:58 crc kubenswrapper[5120]: I0316 18:07:58.438878 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="horizon-kuttl-tests/keystonecd08-account-delete-5p5vv" Mar 16 18:07:58 crc kubenswrapper[5120]: I0316 18:07:58.442591 5120 generic.go:358] "Generic (PLEG): container finished" podID="b40fe47c-32a7-49e9-9285-eb83096a98b6" containerID="66d4ae0891cf3f350916b8e9c982ae32b7417c8faf5c04f731dd53a07c64ab19" exitCode=0 Mar 16 18:07:58 crc kubenswrapper[5120]: I0316 18:07:58.442731 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/rabbitmq-cluster-operator-index-9t2s8" event={"ID":"b40fe47c-32a7-49e9-9285-eb83096a98b6","Type":"ContainerDied","Data":"66d4ae0891cf3f350916b8e9c982ae32b7417c8faf5c04f731dd53a07c64ab19"} Mar 16 18:07:58 crc kubenswrapper[5120]: I0316 18:07:58.445905 5120 generic.go:358] "Generic (PLEG): container finished" podID="a9402e78-0f0a-4bb6-bc56-551b7ccf4bda" containerID="53b79a0ea3c7b2fcdba6e9ad4be620a49beb151cb99ed18d1cebaa501d3260db" exitCode=0 Mar 16 18:07:58 crc kubenswrapper[5120]: I0316 18:07:58.446219 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="horizon-kuttl-tests/openstack-galera-1" event={"ID":"a9402e78-0f0a-4bb6-bc56-551b7ccf4bda","Type":"ContainerDied","Data":"53b79a0ea3c7b2fcdba6e9ad4be620a49beb151cb99ed18d1cebaa501d3260db"} Mar 16 18:07:58 crc kubenswrapper[5120]: I0316 18:07:58.452931 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/keystone-operator-controller-manager-5f47546649-l45dt" event={"ID":"4012715d-02e3-423b-8e8f-c710881f9988","Type":"ContainerDied","Data":"1f6e8eb93b4efdfd260c621505b2bd123b8328e1012804da199d43651bd895c7"} Mar 16 18:07:58 crc kubenswrapper[5120]: I0316 18:07:58.453011 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/keystone-operator-controller-manager-5f47546649-l45dt" Mar 16 18:07:58 crc kubenswrapper[5120]: I0316 18:07:58.494832 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/be179d3f-0e28-4c2b-bc0a-aec68b9e3e98-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 18:07:58 crc kubenswrapper[5120]: I0316 18:07:58.494865 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rz2gx\" (UniqueName: \"kubernetes.io/projected/be179d3f-0e28-4c2b-bc0a-aec68b9e3e98-kube-api-access-rz2gx\") on node \"crc\" DevicePath \"\"" Mar 16 18:07:58 crc kubenswrapper[5120]: I0316 18:07:58.498181 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/rabbitmq-cluster-operator-6bc46f9cd-p55x6" Mar 16 18:07:58 crc kubenswrapper[5120]: I0316 18:07:58.499924 5120 scope.go:117] "RemoveContainer" containerID="a282f7bed3eca0c5dca010234b6d940dc311bff702773a8ce1ab01e080fc29ef" Mar 16 18:07:58 crc kubenswrapper[5120]: E0316 18:07:58.500465 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a282f7bed3eca0c5dca010234b6d940dc311bff702773a8ce1ab01e080fc29ef\": container with ID starting with a282f7bed3eca0c5dca010234b6d940dc311bff702773a8ce1ab01e080fc29ef not found: ID does not exist" containerID="a282f7bed3eca0c5dca010234b6d940dc311bff702773a8ce1ab01e080fc29ef" Mar 16 18:07:58 crc kubenswrapper[5120]: I0316 18:07:58.500516 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a282f7bed3eca0c5dca010234b6d940dc311bff702773a8ce1ab01e080fc29ef"} err="failed to get container status \"a282f7bed3eca0c5dca010234b6d940dc311bff702773a8ce1ab01e080fc29ef\": rpc error: code = NotFound desc = could not find container \"a282f7bed3eca0c5dca010234b6d940dc311bff702773a8ce1ab01e080fc29ef\": container with ID starting with a282f7bed3eca0c5dca010234b6d940dc311bff702773a8ce1ab01e080fc29ef not found: ID does not exist" Mar 16 18:07:58 crc kubenswrapper[5120]: I0316 18:07:58.500977 5120 scope.go:117] "RemoveContainer" containerID="76e9dbf228892c0b5c19e9338a3e25dce76ac6f3b4a57fdea8b79fabe9ea6751" Mar 16 18:07:58 crc kubenswrapper[5120]: I0316 18:07:58.513090 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["horizon-kuttl-tests/keystonecd08-account-delete-5p5vv"] Mar 16 18:07:58 crc kubenswrapper[5120]: I0316 18:07:58.519877 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["horizon-kuttl-tests/keystonecd08-account-delete-5p5vv"] Mar 16 18:07:58 crc kubenswrapper[5120]: I0316 18:07:58.543826 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/keystone-operator-index-jm8f4"] Mar 16 18:07:58 crc kubenswrapper[5120]: I0316 18:07:58.554076 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-operators/keystone-operator-index-jm8f4"] Mar 16 18:07:58 crc kubenswrapper[5120]: I0316 18:07:58.570864 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="horizon-kuttl-tests/openstack-galera-1" Mar 16 18:07:58 crc kubenswrapper[5120]: I0316 18:07:58.578413 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/keystone-operator-controller-manager-5f47546649-l45dt"] Mar 16 18:07:58 crc kubenswrapper[5120]: I0316 18:07:58.584917 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-operators/keystone-operator-controller-manager-5f47546649-l45dt"] Mar 16 18:07:58 crc kubenswrapper[5120]: I0316 18:07:58.597544 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gshmb\" (UniqueName: \"kubernetes.io/projected/a9402e78-0f0a-4bb6-bc56-551b7ccf4bda-kube-api-access-gshmb\") pod \"a9402e78-0f0a-4bb6-bc56-551b7ccf4bda\" (UID: \"a9402e78-0f0a-4bb6-bc56-551b7ccf4bda\") " Mar 16 18:07:58 crc kubenswrapper[5120]: I0316 18:07:58.597639 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/a9402e78-0f0a-4bb6-bc56-551b7ccf4bda-config-data-default\") pod \"a9402e78-0f0a-4bb6-bc56-551b7ccf4bda\" (UID: \"a9402e78-0f0a-4bb6-bc56-551b7ccf4bda\") " Mar 16 18:07:58 crc kubenswrapper[5120]: I0316 18:07:58.597708 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/a9402e78-0f0a-4bb6-bc56-551b7ccf4bda-kolla-config\") pod \"a9402e78-0f0a-4bb6-bc56-551b7ccf4bda\" (UID: \"a9402e78-0f0a-4bb6-bc56-551b7ccf4bda\") " Mar 16 18:07:58 crc kubenswrapper[5120]: I0316 18:07:58.597872 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-czpll\" (UniqueName: \"kubernetes.io/projected/15b7d2ec-af69-4090-a15d-5168cd6fd202-kube-api-access-czpll\") pod \"15b7d2ec-af69-4090-a15d-5168cd6fd202\" (UID: \"15b7d2ec-af69-4090-a15d-5168cd6fd202\") " Mar 16 18:07:58 crc kubenswrapper[5120]: I0316 18:07:58.598017 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/a9402e78-0f0a-4bb6-bc56-551b7ccf4bda-config-data-generated\") pod \"a9402e78-0f0a-4bb6-bc56-551b7ccf4bda\" (UID: \"a9402e78-0f0a-4bb6-bc56-551b7ccf4bda\") " Mar 16 18:07:58 crc kubenswrapper[5120]: I0316 18:07:58.598140 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a9402e78-0f0a-4bb6-bc56-551b7ccf4bda-operator-scripts\") pod \"a9402e78-0f0a-4bb6-bc56-551b7ccf4bda\" (UID: \"a9402e78-0f0a-4bb6-bc56-551b7ccf4bda\") " Mar 16 18:07:58 crc kubenswrapper[5120]: I0316 18:07:58.598189 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"mysql-db\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") pod \"a9402e78-0f0a-4bb6-bc56-551b7ccf4bda\" (UID: \"a9402e78-0f0a-4bb6-bc56-551b7ccf4bda\") " Mar 16 18:07:58 crc kubenswrapper[5120]: I0316 18:07:58.599314 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a9402e78-0f0a-4bb6-bc56-551b7ccf4bda-config-data-generated" (OuterVolumeSpecName: "config-data-generated") pod "a9402e78-0f0a-4bb6-bc56-551b7ccf4bda" (UID: "a9402e78-0f0a-4bb6-bc56-551b7ccf4bda"). InnerVolumeSpecName "config-data-generated". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 18:07:58 crc kubenswrapper[5120]: I0316 18:07:58.600017 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a9402e78-0f0a-4bb6-bc56-551b7ccf4bda-config-data-default" (OuterVolumeSpecName: "config-data-default") pod "a9402e78-0f0a-4bb6-bc56-551b7ccf4bda" (UID: "a9402e78-0f0a-4bb6-bc56-551b7ccf4bda"). InnerVolumeSpecName "config-data-default". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 18:07:58 crc kubenswrapper[5120]: I0316 18:07:58.600473 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a9402e78-0f0a-4bb6-bc56-551b7ccf4bda-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "a9402e78-0f0a-4bb6-bc56-551b7ccf4bda" (UID: "a9402e78-0f0a-4bb6-bc56-551b7ccf4bda"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 18:07:58 crc kubenswrapper[5120]: I0316 18:07:58.600685 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a9402e78-0f0a-4bb6-bc56-551b7ccf4bda-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "a9402e78-0f0a-4bb6-bc56-551b7ccf4bda" (UID: "a9402e78-0f0a-4bb6-bc56-551b7ccf4bda"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 18:07:58 crc kubenswrapper[5120]: I0316 18:07:58.605611 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15b7d2ec-af69-4090-a15d-5168cd6fd202-kube-api-access-czpll" (OuterVolumeSpecName: "kube-api-access-czpll") pod "15b7d2ec-af69-4090-a15d-5168cd6fd202" (UID: "15b7d2ec-af69-4090-a15d-5168cd6fd202"). InnerVolumeSpecName "kube-api-access-czpll". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 18:07:58 crc kubenswrapper[5120]: I0316 18:07:58.608341 5120 scope.go:117] "RemoveContainer" containerID="fa5c0333c28b4d66b998741d28c76b4e443c62215c62e96f9d34f773eb8c0cda" Mar 16 18:07:58 crc kubenswrapper[5120]: I0316 18:07:58.608683 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a9402e78-0f0a-4bb6-bc56-551b7ccf4bda-kube-api-access-gshmb" (OuterVolumeSpecName: "kube-api-access-gshmb") pod "a9402e78-0f0a-4bb6-bc56-551b7ccf4bda" (UID: "a9402e78-0f0a-4bb6-bc56-551b7ccf4bda"). InnerVolumeSpecName "kube-api-access-gshmb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 18:07:58 crc kubenswrapper[5120]: I0316 18:07:58.615525 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage11-crc" (OuterVolumeSpecName: "mysql-db") pod "a9402e78-0f0a-4bb6-bc56-551b7ccf4bda" (UID: "a9402e78-0f0a-4bb6-bc56-551b7ccf4bda"). InnerVolumeSpecName "local-storage11-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 18:07:58 crc kubenswrapper[5120]: I0316 18:07:58.648977 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/rabbitmq-cluster-operator-index-9t2s8" Mar 16 18:07:58 crc kubenswrapper[5120]: I0316 18:07:58.700289 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-stzsn\" (UniqueName: \"kubernetes.io/projected/b40fe47c-32a7-49e9-9285-eb83096a98b6-kube-api-access-stzsn\") pod \"b40fe47c-32a7-49e9-9285-eb83096a98b6\" (UID: \"b40fe47c-32a7-49e9-9285-eb83096a98b6\") " Mar 16 18:07:58 crc kubenswrapper[5120]: I0316 18:07:58.706895 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b40fe47c-32a7-49e9-9285-eb83096a98b6-kube-api-access-stzsn" (OuterVolumeSpecName: "kube-api-access-stzsn") pod "b40fe47c-32a7-49e9-9285-eb83096a98b6" (UID: "b40fe47c-32a7-49e9-9285-eb83096a98b6"). InnerVolumeSpecName "kube-api-access-stzsn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 18:07:58 crc kubenswrapper[5120]: I0316 18:07:58.708170 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/a9402e78-0f0a-4bb6-bc56-551b7ccf4bda-config-data-generated\") on node \"crc\" DevicePath \"\"" Mar 16 18:07:58 crc kubenswrapper[5120]: I0316 18:07:58.708462 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="24851c92-fcc9-4ef2-b9f9-f766d3b08a33" path="/var/lib/kubelet/pods/24851c92-fcc9-4ef2-b9f9-f766d3b08a33/volumes" Mar 16 18:07:58 crc kubenswrapper[5120]: I0316 18:07:58.708883 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a9402e78-0f0a-4bb6-bc56-551b7ccf4bda-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 18:07:58 crc kubenswrapper[5120]: I0316 18:07:58.708949 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") on node \"crc\" " Mar 16 18:07:58 crc kubenswrapper[5120]: I0316 18:07:58.709449 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4012715d-02e3-423b-8e8f-c710881f9988" path="/var/lib/kubelet/pods/4012715d-02e3-423b-8e8f-c710881f9988/volumes" Mar 16 18:07:58 crc kubenswrapper[5120]: I0316 18:07:58.709834 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gshmb\" (UniqueName: \"kubernetes.io/projected/a9402e78-0f0a-4bb6-bc56-551b7ccf4bda-kube-api-access-gshmb\") on node \"crc\" DevicePath \"\"" Mar 16 18:07:58 crc kubenswrapper[5120]: I0316 18:07:58.710265 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="53e2dc28-d482-4df0-a8a6-7a95b71fe79d" path="/var/lib/kubelet/pods/53e2dc28-d482-4df0-a8a6-7a95b71fe79d/volumes" Mar 16 18:07:58 crc kubenswrapper[5120]: I0316 18:07:58.710589 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/a9402e78-0f0a-4bb6-bc56-551b7ccf4bda-config-data-default\") on node \"crc\" DevicePath \"\"" Mar 16 18:07:58 crc kubenswrapper[5120]: I0316 18:07:58.710615 5120 reconciler_common.go:299] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/a9402e78-0f0a-4bb6-bc56-551b7ccf4bda-kolla-config\") on node \"crc\" DevicePath \"\"" Mar 16 18:07:58 crc kubenswrapper[5120]: I0316 18:07:58.710640 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-czpll\" (UniqueName: \"kubernetes.io/projected/15b7d2ec-af69-4090-a15d-5168cd6fd202-kube-api-access-czpll\") on node \"crc\" DevicePath \"\"" Mar 16 18:07:58 crc kubenswrapper[5120]: I0316 18:07:58.711646 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="60903bff-9b27-488b-b399-2c87b66a6f35" path="/var/lib/kubelet/pods/60903bff-9b27-488b-b399-2c87b66a6f35/volumes" Mar 16 18:07:58 crc kubenswrapper[5120]: I0316 18:07:58.712390 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="65b555f1-cd7d-4ed4-b2a3-190445f5291f" path="/var/lib/kubelet/pods/65b555f1-cd7d-4ed4-b2a3-190445f5291f/volumes" Mar 16 18:07:58 crc kubenswrapper[5120]: I0316 18:07:58.713866 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7decf9bf-957e-4b6b-8864-da4761ca69cb" path="/var/lib/kubelet/pods/7decf9bf-957e-4b6b-8864-da4761ca69cb/volumes" Mar 16 18:07:58 crc kubenswrapper[5120]: I0316 18:07:58.715567 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aaaa700b-286f-4526-b61c-0d4cea827638" path="/var/lib/kubelet/pods/aaaa700b-286f-4526-b61c-0d4cea827638/volumes" Mar 16 18:07:58 crc kubenswrapper[5120]: I0316 18:07:58.716375 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b7674bce-996b-45ac-99a4-4c728e2472cb" path="/var/lib/kubelet/pods/b7674bce-996b-45ac-99a4-4c728e2472cb/volumes" Mar 16 18:07:58 crc kubenswrapper[5120]: I0316 18:07:58.717032 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="be179d3f-0e28-4c2b-bc0a-aec68b9e3e98" path="/var/lib/kubelet/pods/be179d3f-0e28-4c2b-bc0a-aec68b9e3e98/volumes" Mar 16 18:07:58 crc kubenswrapper[5120]: I0316 18:07:58.720901 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage11-crc" (UniqueName: "kubernetes.io/local-volume/local-storage11-crc") on node "crc" Mar 16 18:07:58 crc kubenswrapper[5120]: I0316 18:07:58.722890 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c1b1aabe-0cec-4e02-aa41-cbfbb6eb6d59" path="/var/lib/kubelet/pods/c1b1aabe-0cec-4e02-aa41-cbfbb6eb6d59/volumes" Mar 16 18:07:58 crc kubenswrapper[5120]: I0316 18:07:58.723549 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c963986f-f511-4a4b-a677-58c672447b83" path="/var/lib/kubelet/pods/c963986f-f511-4a4b-a677-58c672447b83/volumes" Mar 16 18:07:58 crc kubenswrapper[5120]: I0316 18:07:58.724182 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fecee0a1-f617-4a2c-929f-2d37cd6a48c9" path="/var/lib/kubelet/pods/fecee0a1-f617-4a2c-929f-2d37cd6a48c9/volumes" Mar 16 18:07:58 crc kubenswrapper[5120]: I0316 18:07:58.815116 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") on node \"crc\" DevicePath \"\"" Mar 16 18:07:58 crc kubenswrapper[5120]: I0316 18:07:58.815171 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-stzsn\" (UniqueName: \"kubernetes.io/projected/b40fe47c-32a7-49e9-9285-eb83096a98b6-kube-api-access-stzsn\") on node \"crc\" DevicePath \"\"" Mar 16 18:07:58 crc kubenswrapper[5120]: I0316 18:07:58.948255 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="horizon-kuttl-tests/openstack-galera-0" Mar 16 18:07:59 crc kubenswrapper[5120]: I0316 18:07:59.018913 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/dabfd53a-6aac-4c5d-a3d2-9d38975c0e5a-config-data-generated\") pod \"dabfd53a-6aac-4c5d-a3d2-9d38975c0e5a\" (UID: \"dabfd53a-6aac-4c5d-a3d2-9d38975c0e5a\") " Mar 16 18:07:59 crc kubenswrapper[5120]: I0316 18:07:59.019003 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"mysql-db\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"dabfd53a-6aac-4c5d-a3d2-9d38975c0e5a\" (UID: \"dabfd53a-6aac-4c5d-a3d2-9d38975c0e5a\") " Mar 16 18:07:59 crc kubenswrapper[5120]: I0316 18:07:59.019184 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/dabfd53a-6aac-4c5d-a3d2-9d38975c0e5a-kolla-config\") pod \"dabfd53a-6aac-4c5d-a3d2-9d38975c0e5a\" (UID: \"dabfd53a-6aac-4c5d-a3d2-9d38975c0e5a\") " Mar 16 18:07:59 crc kubenswrapper[5120]: I0316 18:07:59.019216 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/dabfd53a-6aac-4c5d-a3d2-9d38975c0e5a-operator-scripts\") pod \"dabfd53a-6aac-4c5d-a3d2-9d38975c0e5a\" (UID: \"dabfd53a-6aac-4c5d-a3d2-9d38975c0e5a\") " Mar 16 18:07:59 crc kubenswrapper[5120]: I0316 18:07:59.019527 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r8mc9\" (UniqueName: \"kubernetes.io/projected/dabfd53a-6aac-4c5d-a3d2-9d38975c0e5a-kube-api-access-r8mc9\") pod \"dabfd53a-6aac-4c5d-a3d2-9d38975c0e5a\" (UID: \"dabfd53a-6aac-4c5d-a3d2-9d38975c0e5a\") " Mar 16 18:07:59 crc kubenswrapper[5120]: I0316 18:07:59.019554 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dabfd53a-6aac-4c5d-a3d2-9d38975c0e5a-config-data-generated" (OuterVolumeSpecName: "config-data-generated") pod "dabfd53a-6aac-4c5d-a3d2-9d38975c0e5a" (UID: "dabfd53a-6aac-4c5d-a3d2-9d38975c0e5a"). InnerVolumeSpecName "config-data-generated". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 18:07:59 crc kubenswrapper[5120]: I0316 18:07:59.019891 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/dabfd53a-6aac-4c5d-a3d2-9d38975c0e5a-config-data-default\") pod \"dabfd53a-6aac-4c5d-a3d2-9d38975c0e5a\" (UID: \"dabfd53a-6aac-4c5d-a3d2-9d38975c0e5a\") " Mar 16 18:07:59 crc kubenswrapper[5120]: I0316 18:07:59.020239 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dabfd53a-6aac-4c5d-a3d2-9d38975c0e5a-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "dabfd53a-6aac-4c5d-a3d2-9d38975c0e5a" (UID: "dabfd53a-6aac-4c5d-a3d2-9d38975c0e5a"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 18:07:59 crc kubenswrapper[5120]: I0316 18:07:59.020340 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dabfd53a-6aac-4c5d-a3d2-9d38975c0e5a-config-data-default" (OuterVolumeSpecName: "config-data-default") pod "dabfd53a-6aac-4c5d-a3d2-9d38975c0e5a" (UID: "dabfd53a-6aac-4c5d-a3d2-9d38975c0e5a"). InnerVolumeSpecName "config-data-default". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 18:07:59 crc kubenswrapper[5120]: I0316 18:07:59.020493 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dabfd53a-6aac-4c5d-a3d2-9d38975c0e5a-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "dabfd53a-6aac-4c5d-a3d2-9d38975c0e5a" (UID: "dabfd53a-6aac-4c5d-a3d2-9d38975c0e5a"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 18:07:59 crc kubenswrapper[5120]: I0316 18:07:59.020986 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/dabfd53a-6aac-4c5d-a3d2-9d38975c0e5a-config-data-generated\") on node \"crc\" DevicePath \"\"" Mar 16 18:07:59 crc kubenswrapper[5120]: I0316 18:07:59.021012 5120 reconciler_common.go:299] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/dabfd53a-6aac-4c5d-a3d2-9d38975c0e5a-kolla-config\") on node \"crc\" DevicePath \"\"" Mar 16 18:07:59 crc kubenswrapper[5120]: I0316 18:07:59.021025 5120 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/dabfd53a-6aac-4c5d-a3d2-9d38975c0e5a-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 18:07:59 crc kubenswrapper[5120]: I0316 18:07:59.021036 5120 reconciler_common.go:299] "Volume detached for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/dabfd53a-6aac-4c5d-a3d2-9d38975c0e5a-config-data-default\") on node \"crc\" DevicePath \"\"" Mar 16 18:07:59 crc kubenswrapper[5120]: I0316 18:07:59.023555 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dabfd53a-6aac-4c5d-a3d2-9d38975c0e5a-kube-api-access-r8mc9" (OuterVolumeSpecName: "kube-api-access-r8mc9") pod "dabfd53a-6aac-4c5d-a3d2-9d38975c0e5a" (UID: "dabfd53a-6aac-4c5d-a3d2-9d38975c0e5a"). InnerVolumeSpecName "kube-api-access-r8mc9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 18:07:59 crc kubenswrapper[5120]: I0316 18:07:59.028204 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage10-crc" (OuterVolumeSpecName: "mysql-db") pod "dabfd53a-6aac-4c5d-a3d2-9d38975c0e5a" (UID: "dabfd53a-6aac-4c5d-a3d2-9d38975c0e5a"). InnerVolumeSpecName "local-storage10-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 18:07:59 crc kubenswrapper[5120]: I0316 18:07:59.124454 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r8mc9\" (UniqueName: \"kubernetes.io/projected/dabfd53a-6aac-4c5d-a3d2-9d38975c0e5a-kube-api-access-r8mc9\") on node \"crc\" DevicePath \"\"" Mar 16 18:07:59 crc kubenswrapper[5120]: I0316 18:07:59.124772 5120 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") on node \"crc\" " Mar 16 18:07:59 crc kubenswrapper[5120]: I0316 18:07:59.139083 5120 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage10-crc" (UniqueName: "kubernetes.io/local-volume/local-storage10-crc") on node "crc" Mar 16 18:07:59 crc kubenswrapper[5120]: I0316 18:07:59.226945 5120 reconciler_common.go:299] "Volume detached for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") on node \"crc\" DevicePath \"\"" Mar 16 18:07:59 crc kubenswrapper[5120]: I0316 18:07:59.272406 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/infra-operator-controller-manager-78c98446bd-smhdh"] Mar 16 18:07:59 crc kubenswrapper[5120]: I0316 18:07:59.272684 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-operators/infra-operator-controller-manager-78c98446bd-smhdh" podUID="0e32308f-d5af-4f54-8797-ae6a4a9d2cb5" containerName="manager" containerID="cri-o://fb7c485d9529edda635ae6fa9d663760a654085006439c06e20bacb43bf830c4" gracePeriod=10 Mar 16 18:07:59 crc kubenswrapper[5120]: I0316 18:07:59.474886 5120 generic.go:358] "Generic (PLEG): container finished" podID="0e32308f-d5af-4f54-8797-ae6a4a9d2cb5" containerID="fb7c485d9529edda635ae6fa9d663760a654085006439c06e20bacb43bf830c4" exitCode=0 Mar 16 18:07:59 crc kubenswrapper[5120]: I0316 18:07:59.474971 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/infra-operator-controller-manager-78c98446bd-smhdh" event={"ID":"0e32308f-d5af-4f54-8797-ae6a4a9d2cb5","Type":"ContainerDied","Data":"fb7c485d9529edda635ae6fa9d663760a654085006439c06e20bacb43bf830c4"} Mar 16 18:07:59 crc kubenswrapper[5120]: I0316 18:07:59.477769 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/rabbitmq-cluster-operator-index-9t2s8" event={"ID":"b40fe47c-32a7-49e9-9285-eb83096a98b6","Type":"ContainerDied","Data":"5dec9e100f900f18f8eb3dfc5c02ac579c087b263a49f0e6231cab5d2974a2dc"} Mar 16 18:07:59 crc kubenswrapper[5120]: I0316 18:07:59.477826 5120 scope.go:117] "RemoveContainer" containerID="66d4ae0891cf3f350916b8e9c982ae32b7417c8faf5c04f731dd53a07c64ab19" Mar 16 18:07:59 crc kubenswrapper[5120]: I0316 18:07:59.477849 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/rabbitmq-cluster-operator-index-9t2s8" Mar 16 18:07:59 crc kubenswrapper[5120]: I0316 18:07:59.486277 5120 generic.go:358] "Generic (PLEG): container finished" podID="dabfd53a-6aac-4c5d-a3d2-9d38975c0e5a" containerID="a816c733aee6eecb0cb95d24f8707290de9aab409ef609b749cabf02695bb76d" exitCode=0 Mar 16 18:07:59 crc kubenswrapper[5120]: I0316 18:07:59.486364 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="horizon-kuttl-tests/openstack-galera-0" Mar 16 18:07:59 crc kubenswrapper[5120]: I0316 18:07:59.486429 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="horizon-kuttl-tests/openstack-galera-0" event={"ID":"dabfd53a-6aac-4c5d-a3d2-9d38975c0e5a","Type":"ContainerDied","Data":"a816c733aee6eecb0cb95d24f8707290de9aab409ef609b749cabf02695bb76d"} Mar 16 18:07:59 crc kubenswrapper[5120]: I0316 18:07:59.486472 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="horizon-kuttl-tests/openstack-galera-0" event={"ID":"dabfd53a-6aac-4c5d-a3d2-9d38975c0e5a","Type":"ContainerDied","Data":"afde40d94aa2d3700808a8cc335d12aea9969db70e94b95e6a1c5d9010ec42ac"} Mar 16 18:07:59 crc kubenswrapper[5120]: I0316 18:07:59.492551 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/infra-operator-index-f6t6t"] Mar 16 18:07:59 crc kubenswrapper[5120]: I0316 18:07:59.493330 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-operators/infra-operator-index-f6t6t" podUID="a4d09400-44e7-4493-9e14-f5fc42e13179" containerName="registry-server" containerID="cri-o://919fb0543a401cce6c659bd8cb7ae01d12f355f7d688a24a015f02d0cd0cc644" gracePeriod=30 Mar 16 18:07:59 crc kubenswrapper[5120]: I0316 18:07:59.504008 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="horizon-kuttl-tests/openstack-galera-1" event={"ID":"a9402e78-0f0a-4bb6-bc56-551b7ccf4bda","Type":"ContainerDied","Data":"23bccce88801c5d413ba39dca9b7a464b7e06b73c84acedd8e5b2887144aad60"} Mar 16 18:07:59 crc kubenswrapper[5120]: I0316 18:07:59.504345 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="horizon-kuttl-tests/openstack-galera-1" Mar 16 18:07:59 crc kubenswrapper[5120]: I0316 18:07:59.514206 5120 scope.go:117] "RemoveContainer" containerID="a816c733aee6eecb0cb95d24f8707290de9aab409ef609b749cabf02695bb76d" Mar 16 18:07:59 crc kubenswrapper[5120]: I0316 18:07:59.519609 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/rabbitmq-cluster-operator-index-9t2s8"] Mar 16 18:07:59 crc kubenswrapper[5120]: I0316 18:07:59.526577 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-operators/rabbitmq-cluster-operator-index-9t2s8"] Mar 16 18:07:59 crc kubenswrapper[5120]: I0316 18:07:59.533945 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/rabbitmq-cluster-operator-6bc46f9cd-p55x6" Mar 16 18:07:59 crc kubenswrapper[5120]: I0316 18:07:59.534498 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/rabbitmq-cluster-operator-6bc46f9cd-p55x6" event={"ID":"15b7d2ec-af69-4090-a15d-5168cd6fd202","Type":"ContainerDied","Data":"0c2e99252f77ec00d1e960c41c186ea31abf42e38b231787ef4fa13ee651706d"} Mar 16 18:07:59 crc kubenswrapper[5120]: I0316 18:07:59.551836 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/0b4c51a436ce56c4393293420dad5bb37f4e2c4f062c7176860d2815958dmj5"] Mar 16 18:07:59 crc kubenswrapper[5120]: I0316 18:07:59.552488 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-operators/0b4c51a436ce56c4393293420dad5bb37f4e2c4f062c7176860d2815958dmj5"] Mar 16 18:07:59 crc kubenswrapper[5120]: I0316 18:07:59.591451 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["horizon-kuttl-tests/openstack-galera-0"] Mar 16 18:07:59 crc kubenswrapper[5120]: I0316 18:07:59.599300 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["horizon-kuttl-tests/openstack-galera-0"] Mar 16 18:07:59 crc kubenswrapper[5120]: I0316 18:07:59.607859 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["horizon-kuttl-tests/openstack-galera-1"] Mar 16 18:07:59 crc kubenswrapper[5120]: I0316 18:07:59.620370 5120 scope.go:117] "RemoveContainer" containerID="4994ddc6861011d4002b145ab0f89c907ae9bb79a0ed1cbda4e10d60466feb39" Mar 16 18:07:59 crc kubenswrapper[5120]: I0316 18:07:59.620509 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["horizon-kuttl-tests/openstack-galera-1"] Mar 16 18:07:59 crc kubenswrapper[5120]: I0316 18:07:59.632559 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/rabbitmq-cluster-operator-6bc46f9cd-p55x6"] Mar 16 18:07:59 crc kubenswrapper[5120]: I0316 18:07:59.638625 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-operators/rabbitmq-cluster-operator-6bc46f9cd-p55x6"] Mar 16 18:07:59 crc kubenswrapper[5120]: I0316 18:07:59.716007 5120 scope.go:117] "RemoveContainer" containerID="a816c733aee6eecb0cb95d24f8707290de9aab409ef609b749cabf02695bb76d" Mar 16 18:07:59 crc kubenswrapper[5120]: E0316 18:07:59.716851 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a816c733aee6eecb0cb95d24f8707290de9aab409ef609b749cabf02695bb76d\": container with ID starting with a816c733aee6eecb0cb95d24f8707290de9aab409ef609b749cabf02695bb76d not found: ID does not exist" containerID="a816c733aee6eecb0cb95d24f8707290de9aab409ef609b749cabf02695bb76d" Mar 16 18:07:59 crc kubenswrapper[5120]: I0316 18:07:59.716912 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a816c733aee6eecb0cb95d24f8707290de9aab409ef609b749cabf02695bb76d"} err="failed to get container status \"a816c733aee6eecb0cb95d24f8707290de9aab409ef609b749cabf02695bb76d\": rpc error: code = NotFound desc = could not find container \"a816c733aee6eecb0cb95d24f8707290de9aab409ef609b749cabf02695bb76d\": container with ID starting with a816c733aee6eecb0cb95d24f8707290de9aab409ef609b749cabf02695bb76d not found: ID does not exist" Mar 16 18:07:59 crc kubenswrapper[5120]: I0316 18:07:59.716944 5120 scope.go:117] "RemoveContainer" containerID="4994ddc6861011d4002b145ab0f89c907ae9bb79a0ed1cbda4e10d60466feb39" Mar 16 18:07:59 crc kubenswrapper[5120]: E0316 18:07:59.717288 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4994ddc6861011d4002b145ab0f89c907ae9bb79a0ed1cbda4e10d60466feb39\": container with ID starting with 4994ddc6861011d4002b145ab0f89c907ae9bb79a0ed1cbda4e10d60466feb39 not found: ID does not exist" containerID="4994ddc6861011d4002b145ab0f89c907ae9bb79a0ed1cbda4e10d60466feb39" Mar 16 18:07:59 crc kubenswrapper[5120]: I0316 18:07:59.717322 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4994ddc6861011d4002b145ab0f89c907ae9bb79a0ed1cbda4e10d60466feb39"} err="failed to get container status \"4994ddc6861011d4002b145ab0f89c907ae9bb79a0ed1cbda4e10d60466feb39\": rpc error: code = NotFound desc = could not find container \"4994ddc6861011d4002b145ab0f89c907ae9bb79a0ed1cbda4e10d60466feb39\": container with ID starting with 4994ddc6861011d4002b145ab0f89c907ae9bb79a0ed1cbda4e10d60466feb39 not found: ID does not exist" Mar 16 18:07:59 crc kubenswrapper[5120]: I0316 18:07:59.717344 5120 scope.go:117] "RemoveContainer" containerID="53b79a0ea3c7b2fcdba6e9ad4be620a49beb151cb99ed18d1cebaa501d3260db" Mar 16 18:07:59 crc kubenswrapper[5120]: I0316 18:07:59.772962 5120 scope.go:117] "RemoveContainer" containerID="1c8aea033939b39bb8893d8beb9e8ad9bf565dae7bc5eaff52e38724888fc577" Mar 16 18:07:59 crc kubenswrapper[5120]: I0316 18:07:59.830439 5120 scope.go:117] "RemoveContainer" containerID="bfe6ac0a042d4e3b1a03edfd3cc950ba950b387709726d83609e59892824963e" Mar 16 18:07:59 crc kubenswrapper[5120]: I0316 18:07:59.858567 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/infra-operator-controller-manager-78c98446bd-smhdh" Mar 16 18:07:59 crc kubenswrapper[5120]: I0316 18:07:59.953268 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cd4kt\" (UniqueName: \"kubernetes.io/projected/0e32308f-d5af-4f54-8797-ae6a4a9d2cb5-kube-api-access-cd4kt\") pod \"0e32308f-d5af-4f54-8797-ae6a4a9d2cb5\" (UID: \"0e32308f-d5af-4f54-8797-ae6a4a9d2cb5\") " Mar 16 18:07:59 crc kubenswrapper[5120]: I0316 18:07:59.953598 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0e32308f-d5af-4f54-8797-ae6a4a9d2cb5-apiservice-cert\") pod \"0e32308f-d5af-4f54-8797-ae6a4a9d2cb5\" (UID: \"0e32308f-d5af-4f54-8797-ae6a4a9d2cb5\") " Mar 16 18:07:59 crc kubenswrapper[5120]: I0316 18:07:59.954698 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0e32308f-d5af-4f54-8797-ae6a4a9d2cb5-webhook-cert\") pod \"0e32308f-d5af-4f54-8797-ae6a4a9d2cb5\" (UID: \"0e32308f-d5af-4f54-8797-ae6a4a9d2cb5\") " Mar 16 18:07:59 crc kubenswrapper[5120]: I0316 18:07:59.958976 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e32308f-d5af-4f54-8797-ae6a4a9d2cb5-kube-api-access-cd4kt" (OuterVolumeSpecName: "kube-api-access-cd4kt") pod "0e32308f-d5af-4f54-8797-ae6a4a9d2cb5" (UID: "0e32308f-d5af-4f54-8797-ae6a4a9d2cb5"). InnerVolumeSpecName "kube-api-access-cd4kt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 18:07:59 crc kubenswrapper[5120]: I0316 18:07:59.969153 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e32308f-d5af-4f54-8797-ae6a4a9d2cb5-apiservice-cert" (OuterVolumeSpecName: "apiservice-cert") pod "0e32308f-d5af-4f54-8797-ae6a4a9d2cb5" (UID: "0e32308f-d5af-4f54-8797-ae6a4a9d2cb5"). InnerVolumeSpecName "apiservice-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 18:07:59 crc kubenswrapper[5120]: I0316 18:07:59.969346 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e32308f-d5af-4f54-8797-ae6a4a9d2cb5-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "0e32308f-d5af-4f54-8797-ae6a4a9d2cb5" (UID: "0e32308f-d5af-4f54-8797-ae6a4a9d2cb5"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 18:08:00 crc kubenswrapper[5120]: I0316 18:08:00.009507 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/infra-operator-index-f6t6t" Mar 16 18:08:00 crc kubenswrapper[5120]: I0316 18:08:00.057298 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c8twf\" (UniqueName: \"kubernetes.io/projected/a4d09400-44e7-4493-9e14-f5fc42e13179-kube-api-access-c8twf\") pod \"a4d09400-44e7-4493-9e14-f5fc42e13179\" (UID: \"a4d09400-44e7-4493-9e14-f5fc42e13179\") " Mar 16 18:08:00 crc kubenswrapper[5120]: I0316 18:08:00.058010 5120 reconciler_common.go:299] "Volume detached for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0e32308f-d5af-4f54-8797-ae6a4a9d2cb5-apiservice-cert\") on node \"crc\" DevicePath \"\"" Mar 16 18:08:00 crc kubenswrapper[5120]: I0316 18:08:00.058035 5120 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0e32308f-d5af-4f54-8797-ae6a4a9d2cb5-webhook-cert\") on node \"crc\" DevicePath \"\"" Mar 16 18:08:00 crc kubenswrapper[5120]: I0316 18:08:00.058050 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cd4kt\" (UniqueName: \"kubernetes.io/projected/0e32308f-d5af-4f54-8797-ae6a4a9d2cb5-kube-api-access-cd4kt\") on node \"crc\" DevicePath \"\"" Mar 16 18:08:00 crc kubenswrapper[5120]: I0316 18:08:00.062953 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a4d09400-44e7-4493-9e14-f5fc42e13179-kube-api-access-c8twf" (OuterVolumeSpecName: "kube-api-access-c8twf") pod "a4d09400-44e7-4493-9e14-f5fc42e13179" (UID: "a4d09400-44e7-4493-9e14-f5fc42e13179"). InnerVolumeSpecName "kube-api-access-c8twf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 18:08:00 crc kubenswrapper[5120]: I0316 18:08:00.159536 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/mariadb-operator-controller-manager-68d86d8d4b-2mr9j"] Mar 16 18:08:00 crc kubenswrapper[5120]: I0316 18:08:00.160102 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-operators/mariadb-operator-controller-manager-68d86d8d4b-2mr9j" podUID="fce08707-0dff-4592-b19e-607aa752b7ca" containerName="manager" containerID="cri-o://c7063f00878583780e83fe13b446eebc2364249eb5b0164eadb41ec2889d3ba2" gracePeriod=10 Mar 16 18:08:00 crc kubenswrapper[5120]: I0316 18:08:00.160247 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c8twf\" (UniqueName: \"kubernetes.io/projected/a4d09400-44e7-4493-9e14-f5fc42e13179-kube-api-access-c8twf\") on node \"crc\" DevicePath \"\"" Mar 16 18:08:00 crc kubenswrapper[5120]: I0316 18:08:00.175218 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-infra/auto-csr-approver-29561408-vrdqs"] Mar 16 18:08:00 crc kubenswrapper[5120]: I0316 18:08:00.176438 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be179d3f-0e28-4c2b-bc0a-aec68b9e3e98" containerName="mariadb-account-delete" Mar 16 18:08:00 crc kubenswrapper[5120]: I0316 18:08:00.176460 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="be179d3f-0e28-4c2b-bc0a-aec68b9e3e98" containerName="mariadb-account-delete" Mar 16 18:08:00 crc kubenswrapper[5120]: I0316 18:08:00.176477 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c963986f-f511-4a4b-a677-58c672447b83" containerName="keystone-api" Mar 16 18:08:00 crc kubenswrapper[5120]: I0316 18:08:00.176674 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c963986f-f511-4a4b-a677-58c672447b83" containerName="keystone-api" Mar 16 18:08:00 crc kubenswrapper[5120]: I0316 18:08:00.176696 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7decf9bf-957e-4b6b-8864-da4761ca69cb" containerName="setup-container" Mar 16 18:08:00 crc kubenswrapper[5120]: I0316 18:08:00.176705 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7decf9bf-957e-4b6b-8864-da4761ca69cb" containerName="setup-container" Mar 16 18:08:00 crc kubenswrapper[5120]: I0316 18:08:00.176720 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1cbada35-20cb-4e85-b586-27ff9941011a" containerName="galera" Mar 16 18:08:00 crc kubenswrapper[5120]: I0316 18:08:00.176728 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1cbada35-20cb-4e85-b586-27ff9941011a" containerName="galera" Mar 16 18:08:00 crc kubenswrapper[5120]: I0316 18:08:00.176738 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15b7d2ec-af69-4090-a15d-5168cd6fd202" containerName="operator" Mar 16 18:08:00 crc kubenswrapper[5120]: I0316 18:08:00.176746 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="15b7d2ec-af69-4090-a15d-5168cd6fd202" containerName="operator" Mar 16 18:08:00 crc kubenswrapper[5120]: I0316 18:08:00.176779 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60903bff-9b27-488b-b399-2c87b66a6f35" containerName="memcached" Mar 16 18:08:00 crc kubenswrapper[5120]: I0316 18:08:00.176788 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="60903bff-9b27-488b-b399-2c87b66a6f35" containerName="memcached" Mar 16 18:08:00 crc kubenswrapper[5120]: I0316 18:08:00.176802 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1cbada35-20cb-4e85-b586-27ff9941011a" containerName="mysql-bootstrap" Mar 16 18:08:00 crc kubenswrapper[5120]: I0316 18:08:00.176810 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="1cbada35-20cb-4e85-b586-27ff9941011a" containerName="mysql-bootstrap" Mar 16 18:08:00 crc kubenswrapper[5120]: I0316 18:08:00.176832 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4d09400-44e7-4493-9e14-f5fc42e13179" containerName="registry-server" Mar 16 18:08:00 crc kubenswrapper[5120]: I0316 18:08:00.176839 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4d09400-44e7-4493-9e14-f5fc42e13179" containerName="registry-server" Mar 16 18:08:00 crc kubenswrapper[5120]: I0316 18:08:00.176852 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dabfd53a-6aac-4c5d-a3d2-9d38975c0e5a" containerName="galera" Mar 16 18:08:00 crc kubenswrapper[5120]: I0316 18:08:00.176860 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="dabfd53a-6aac-4c5d-a3d2-9d38975c0e5a" containerName="galera" Mar 16 18:08:00 crc kubenswrapper[5120]: I0316 18:08:00.176871 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b40fe47c-32a7-49e9-9285-eb83096a98b6" containerName="registry-server" Mar 16 18:08:00 crc kubenswrapper[5120]: I0316 18:08:00.176879 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="b40fe47c-32a7-49e9-9285-eb83096a98b6" containerName="registry-server" Mar 16 18:08:00 crc kubenswrapper[5120]: I0316 18:08:00.176894 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4012715d-02e3-423b-8e8f-c710881f9988" containerName="manager" Mar 16 18:08:00 crc kubenswrapper[5120]: I0316 18:08:00.176902 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="4012715d-02e3-423b-8e8f-c710881f9988" containerName="manager" Mar 16 18:08:00 crc kubenswrapper[5120]: I0316 18:08:00.176917 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9402e78-0f0a-4bb6-bc56-551b7ccf4bda" containerName="galera" Mar 16 18:08:00 crc kubenswrapper[5120]: I0316 18:08:00.176925 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9402e78-0f0a-4bb6-bc56-551b7ccf4bda" containerName="galera" Mar 16 18:08:00 crc kubenswrapper[5120]: I0316 18:08:00.176941 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7674bce-996b-45ac-99a4-4c728e2472cb" containerName="registry-server" Mar 16 18:08:00 crc kubenswrapper[5120]: I0316 18:08:00.176948 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7674bce-996b-45ac-99a4-4c728e2472cb" containerName="registry-server" Mar 16 18:08:00 crc kubenswrapper[5120]: I0316 18:08:00.176964 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1b1aabe-0cec-4e02-aa41-cbfbb6eb6d59" containerName="manager" Mar 16 18:08:00 crc kubenswrapper[5120]: I0316 18:08:00.176972 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1b1aabe-0cec-4e02-aa41-cbfbb6eb6d59" containerName="manager" Mar 16 18:08:00 crc kubenswrapper[5120]: I0316 18:08:00.176983 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e32308f-d5af-4f54-8797-ae6a4a9d2cb5" containerName="manager" Mar 16 18:08:00 crc kubenswrapper[5120]: I0316 18:08:00.176991 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e32308f-d5af-4f54-8797-ae6a4a9d2cb5" containerName="manager" Mar 16 18:08:00 crc kubenswrapper[5120]: I0316 18:08:00.177004 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7decf9bf-957e-4b6b-8864-da4761ca69cb" containerName="rabbitmq" Mar 16 18:08:00 crc kubenswrapper[5120]: I0316 18:08:00.177011 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7decf9bf-957e-4b6b-8864-da4761ca69cb" containerName="rabbitmq" Mar 16 18:08:00 crc kubenswrapper[5120]: I0316 18:08:00.177023 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9402e78-0f0a-4bb6-bc56-551b7ccf4bda" containerName="mysql-bootstrap" Mar 16 18:08:00 crc kubenswrapper[5120]: I0316 18:08:00.177032 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9402e78-0f0a-4bb6-bc56-551b7ccf4bda" containerName="mysql-bootstrap" Mar 16 18:08:00 crc kubenswrapper[5120]: I0316 18:08:00.177042 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dabfd53a-6aac-4c5d-a3d2-9d38975c0e5a" containerName="mysql-bootstrap" Mar 16 18:08:00 crc kubenswrapper[5120]: I0316 18:08:00.177049 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="dabfd53a-6aac-4c5d-a3d2-9d38975c0e5a" containerName="mysql-bootstrap" Mar 16 18:08:00 crc kubenswrapper[5120]: I0316 18:08:00.177067 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53e2dc28-d482-4df0-a8a6-7a95b71fe79d" containerName="registry-server" Mar 16 18:08:00 crc kubenswrapper[5120]: I0316 18:08:00.177075 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="53e2dc28-d482-4df0-a8a6-7a95b71fe79d" containerName="registry-server" Mar 16 18:08:00 crc kubenswrapper[5120]: I0316 18:08:00.177221 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7decf9bf-957e-4b6b-8864-da4761ca69cb" containerName="rabbitmq" Mar 16 18:08:00 crc kubenswrapper[5120]: I0316 18:08:00.177234 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="0e32308f-d5af-4f54-8797-ae6a4a9d2cb5" containerName="manager" Mar 16 18:08:00 crc kubenswrapper[5120]: I0316 18:08:00.177247 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="be179d3f-0e28-4c2b-bc0a-aec68b9e3e98" containerName="mariadb-account-delete" Mar 16 18:08:00 crc kubenswrapper[5120]: I0316 18:08:00.177272 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="1cbada35-20cb-4e85-b586-27ff9941011a" containerName="galera" Mar 16 18:08:00 crc kubenswrapper[5120]: I0316 18:08:00.177285 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="15b7d2ec-af69-4090-a15d-5168cd6fd202" containerName="operator" Mar 16 18:08:00 crc kubenswrapper[5120]: I0316 18:08:00.177295 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="60903bff-9b27-488b-b399-2c87b66a6f35" containerName="memcached" Mar 16 18:08:00 crc kubenswrapper[5120]: I0316 18:08:00.177307 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="53e2dc28-d482-4df0-a8a6-7a95b71fe79d" containerName="registry-server" Mar 16 18:08:00 crc kubenswrapper[5120]: I0316 18:08:00.177317 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="4012715d-02e3-423b-8e8f-c710881f9988" containerName="manager" Mar 16 18:08:00 crc kubenswrapper[5120]: I0316 18:08:00.177329 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="b40fe47c-32a7-49e9-9285-eb83096a98b6" containerName="registry-server" Mar 16 18:08:00 crc kubenswrapper[5120]: I0316 18:08:00.177339 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c963986f-f511-4a4b-a677-58c672447b83" containerName="keystone-api" Mar 16 18:08:00 crc kubenswrapper[5120]: I0316 18:08:00.177351 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="dabfd53a-6aac-4c5d-a3d2-9d38975c0e5a" containerName="galera" Mar 16 18:08:00 crc kubenswrapper[5120]: I0316 18:08:00.177362 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="b7674bce-996b-45ac-99a4-4c728e2472cb" containerName="registry-server" Mar 16 18:08:00 crc kubenswrapper[5120]: I0316 18:08:00.177373 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c1b1aabe-0cec-4e02-aa41-cbfbb6eb6d59" containerName="manager" Mar 16 18:08:00 crc kubenswrapper[5120]: I0316 18:08:00.177385 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="a4d09400-44e7-4493-9e14-f5fc42e13179" containerName="registry-server" Mar 16 18:08:00 crc kubenswrapper[5120]: I0316 18:08:00.177400 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="a9402e78-0f0a-4bb6-bc56-551b7ccf4bda" containerName="galera" Mar 16 18:08:00 crc kubenswrapper[5120]: I0316 18:08:00.186471 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561408-vrdqs"] Mar 16 18:08:00 crc kubenswrapper[5120]: I0316 18:08:00.186622 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561408-vrdqs" Mar 16 18:08:00 crc kubenswrapper[5120]: I0316 18:08:00.191535 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"openshift-service-ca.crt\"" Mar 16 18:08:00 crc kubenswrapper[5120]: I0316 18:08:00.191651 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-infra\"/\"csr-approver-sa-dockercfg-x2nsz\"" Mar 16 18:08:00 crc kubenswrapper[5120]: I0316 18:08:00.191744 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"kube-root-ca.crt\"" Mar 16 18:08:00 crc kubenswrapper[5120]: I0316 18:08:00.265381 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxm5l\" (UniqueName: \"kubernetes.io/projected/5874c8fe-7ba8-4ef0-8791-a3bc34fd1167-kube-api-access-jxm5l\") pod \"auto-csr-approver-29561408-vrdqs\" (UID: \"5874c8fe-7ba8-4ef0-8791-a3bc34fd1167\") " pod="openshift-infra/auto-csr-approver-29561408-vrdqs" Mar 16 18:08:00 crc kubenswrapper[5120]: I0316 18:08:00.366916 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jxm5l\" (UniqueName: \"kubernetes.io/projected/5874c8fe-7ba8-4ef0-8791-a3bc34fd1167-kube-api-access-jxm5l\") pod \"auto-csr-approver-29561408-vrdqs\" (UID: \"5874c8fe-7ba8-4ef0-8791-a3bc34fd1167\") " pod="openshift-infra/auto-csr-approver-29561408-vrdqs" Mar 16 18:08:00 crc kubenswrapper[5120]: I0316 18:08:00.409618 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxm5l\" (UniqueName: \"kubernetes.io/projected/5874c8fe-7ba8-4ef0-8791-a3bc34fd1167-kube-api-access-jxm5l\") pod \"auto-csr-approver-29561408-vrdqs\" (UID: \"5874c8fe-7ba8-4ef0-8791-a3bc34fd1167\") " pod="openshift-infra/auto-csr-approver-29561408-vrdqs" Mar 16 18:08:00 crc kubenswrapper[5120]: I0316 18:08:00.477281 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/mariadb-operator-index-gb4m2"] Mar 16 18:08:00 crc kubenswrapper[5120]: I0316 18:08:00.477517 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-operators/mariadb-operator-index-gb4m2" podUID="8c74e2ee-be49-414b-8ff6-903ff67fcbd8" containerName="registry-server" containerID="cri-o://21b17156abd179ac9cf5433a301aa1c6b2ab7e94023d85a6cb5bea779868356e" gracePeriod=30 Mar 16 18:08:00 crc kubenswrapper[5120]: I0316 18:08:00.498916 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/1b4ccfde3488142cc254fb313062ed88e2d18a60b7907f7b7c6ca340287qg5t"] Mar 16 18:08:00 crc kubenswrapper[5120]: I0316 18:08:00.510209 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-operators/1b4ccfde3488142cc254fb313062ed88e2d18a60b7907f7b7c6ca340287qg5t"] Mar 16 18:08:00 crc kubenswrapper[5120]: I0316 18:08:00.515348 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561408-vrdqs" Mar 16 18:08:00 crc kubenswrapper[5120]: I0316 18:08:00.556239 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/infra-operator-controller-manager-78c98446bd-smhdh" event={"ID":"0e32308f-d5af-4f54-8797-ae6a4a9d2cb5","Type":"ContainerDied","Data":"fda72542fea14c32f61ef5716093aef9ae00300ad350c82ddc850816900ffacc"} Mar 16 18:08:00 crc kubenswrapper[5120]: I0316 18:08:00.556288 5120 scope.go:117] "RemoveContainer" containerID="fb7c485d9529edda635ae6fa9d663760a654085006439c06e20bacb43bf830c4" Mar 16 18:08:00 crc kubenswrapper[5120]: I0316 18:08:00.556410 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/infra-operator-controller-manager-78c98446bd-smhdh" Mar 16 18:08:00 crc kubenswrapper[5120]: I0316 18:08:00.563855 5120 generic.go:358] "Generic (PLEG): container finished" podID="a4d09400-44e7-4493-9e14-f5fc42e13179" containerID="919fb0543a401cce6c659bd8cb7ae01d12f355f7d688a24a015f02d0cd0cc644" exitCode=0 Mar 16 18:08:00 crc kubenswrapper[5120]: I0316 18:08:00.563941 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/infra-operator-index-f6t6t" event={"ID":"a4d09400-44e7-4493-9e14-f5fc42e13179","Type":"ContainerDied","Data":"919fb0543a401cce6c659bd8cb7ae01d12f355f7d688a24a015f02d0cd0cc644"} Mar 16 18:08:00 crc kubenswrapper[5120]: I0316 18:08:00.563971 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/infra-operator-index-f6t6t" event={"ID":"a4d09400-44e7-4493-9e14-f5fc42e13179","Type":"ContainerDied","Data":"7cdfb480ee25f2064b0e686d570c996dab97770e26c4e70c92527fcdff866332"} Mar 16 18:08:00 crc kubenswrapper[5120]: I0316 18:08:00.564052 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/infra-operator-index-f6t6t" Mar 16 18:08:00 crc kubenswrapper[5120]: I0316 18:08:00.576037 5120 generic.go:358] "Generic (PLEG): container finished" podID="fce08707-0dff-4592-b19e-607aa752b7ca" containerID="c7063f00878583780e83fe13b446eebc2364249eb5b0164eadb41ec2889d3ba2" exitCode=0 Mar 16 18:08:00 crc kubenswrapper[5120]: I0316 18:08:00.576179 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/mariadb-operator-controller-manager-68d86d8d4b-2mr9j" event={"ID":"fce08707-0dff-4592-b19e-607aa752b7ca","Type":"ContainerDied","Data":"c7063f00878583780e83fe13b446eebc2364249eb5b0164eadb41ec2889d3ba2"} Mar 16 18:08:00 crc kubenswrapper[5120]: I0316 18:08:00.647937 5120 scope.go:117] "RemoveContainer" containerID="919fb0543a401cce6c659bd8cb7ae01d12f355f7d688a24a015f02d0cd0cc644" Mar 16 18:08:00 crc kubenswrapper[5120]: I0316 18:08:00.661641 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/mariadb-operator-controller-manager-68d86d8d4b-2mr9j" Mar 16 18:08:00 crc kubenswrapper[5120]: I0316 18:08:00.663373 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/infra-operator-index-f6t6t"] Mar 16 18:08:00 crc kubenswrapper[5120]: I0316 18:08:00.725012 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="15b7d2ec-af69-4090-a15d-5168cd6fd202" path="/var/lib/kubelet/pods/15b7d2ec-af69-4090-a15d-5168cd6fd202/volumes" Mar 16 18:08:00 crc kubenswrapper[5120]: I0316 18:08:00.725636 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="253dee39-6e00-42a2-9e79-cdaec61a31c8" path="/var/lib/kubelet/pods/253dee39-6e00-42a2-9e79-cdaec61a31c8/volumes" Mar 16 18:08:00 crc kubenswrapper[5120]: I0316 18:08:00.726550 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8b1f7bb3-43d7-4209-b335-a671c96c1e8e" path="/var/lib/kubelet/pods/8b1f7bb3-43d7-4209-b335-a671c96c1e8e/volumes" Mar 16 18:08:00 crc kubenswrapper[5120]: I0316 18:08:00.728054 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a9402e78-0f0a-4bb6-bc56-551b7ccf4bda" path="/var/lib/kubelet/pods/a9402e78-0f0a-4bb6-bc56-551b7ccf4bda/volumes" Mar 16 18:08:00 crc kubenswrapper[5120]: I0316 18:08:00.728835 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b40fe47c-32a7-49e9-9285-eb83096a98b6" path="/var/lib/kubelet/pods/b40fe47c-32a7-49e9-9285-eb83096a98b6/volumes" Mar 16 18:08:00 crc kubenswrapper[5120]: I0316 18:08:00.729433 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dabfd53a-6aac-4c5d-a3d2-9d38975c0e5a" path="/var/lib/kubelet/pods/dabfd53a-6aac-4c5d-a3d2-9d38975c0e5a/volumes" Mar 16 18:08:00 crc kubenswrapper[5120]: I0316 18:08:00.737098 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-operators/infra-operator-index-f6t6t"] Mar 16 18:08:00 crc kubenswrapper[5120]: I0316 18:08:00.737143 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/infra-operator-controller-manager-78c98446bd-smhdh"] Mar 16 18:08:00 crc kubenswrapper[5120]: I0316 18:08:00.737155 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-operators/infra-operator-controller-manager-78c98446bd-smhdh"] Mar 16 18:08:00 crc kubenswrapper[5120]: I0316 18:08:00.750387 5120 scope.go:117] "RemoveContainer" containerID="919fb0543a401cce6c659bd8cb7ae01d12f355f7d688a24a015f02d0cd0cc644" Mar 16 18:08:00 crc kubenswrapper[5120]: E0316 18:08:00.755940 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"919fb0543a401cce6c659bd8cb7ae01d12f355f7d688a24a015f02d0cd0cc644\": container with ID starting with 919fb0543a401cce6c659bd8cb7ae01d12f355f7d688a24a015f02d0cd0cc644 not found: ID does not exist" containerID="919fb0543a401cce6c659bd8cb7ae01d12f355f7d688a24a015f02d0cd0cc644" Mar 16 18:08:00 crc kubenswrapper[5120]: I0316 18:08:00.755996 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"919fb0543a401cce6c659bd8cb7ae01d12f355f7d688a24a015f02d0cd0cc644"} err="failed to get container status \"919fb0543a401cce6c659bd8cb7ae01d12f355f7d688a24a015f02d0cd0cc644\": rpc error: code = NotFound desc = could not find container \"919fb0543a401cce6c659bd8cb7ae01d12f355f7d688a24a015f02d0cd0cc644\": container with ID starting with 919fb0543a401cce6c659bd8cb7ae01d12f355f7d688a24a015f02d0cd0cc644 not found: ID does not exist" Mar 16 18:08:00 crc kubenswrapper[5120]: I0316 18:08:00.787459 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fce08707-0dff-4592-b19e-607aa752b7ca-apiservice-cert\") pod \"fce08707-0dff-4592-b19e-607aa752b7ca\" (UID: \"fce08707-0dff-4592-b19e-607aa752b7ca\") " Mar 16 18:08:00 crc kubenswrapper[5120]: I0316 18:08:00.787737 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6hq5w\" (UniqueName: \"kubernetes.io/projected/fce08707-0dff-4592-b19e-607aa752b7ca-kube-api-access-6hq5w\") pod \"fce08707-0dff-4592-b19e-607aa752b7ca\" (UID: \"fce08707-0dff-4592-b19e-607aa752b7ca\") " Mar 16 18:08:00 crc kubenswrapper[5120]: I0316 18:08:00.787846 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fce08707-0dff-4592-b19e-607aa752b7ca-webhook-cert\") pod \"fce08707-0dff-4592-b19e-607aa752b7ca\" (UID: \"fce08707-0dff-4592-b19e-607aa752b7ca\") " Mar 16 18:08:00 crc kubenswrapper[5120]: I0316 18:08:00.804348 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fce08707-0dff-4592-b19e-607aa752b7ca-kube-api-access-6hq5w" (OuterVolumeSpecName: "kube-api-access-6hq5w") pod "fce08707-0dff-4592-b19e-607aa752b7ca" (UID: "fce08707-0dff-4592-b19e-607aa752b7ca"). InnerVolumeSpecName "kube-api-access-6hq5w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 18:08:00 crc kubenswrapper[5120]: I0316 18:08:00.804450 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fce08707-0dff-4592-b19e-607aa752b7ca-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "fce08707-0dff-4592-b19e-607aa752b7ca" (UID: "fce08707-0dff-4592-b19e-607aa752b7ca"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 18:08:00 crc kubenswrapper[5120]: I0316 18:08:00.811994 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fce08707-0dff-4592-b19e-607aa752b7ca-apiservice-cert" (OuterVolumeSpecName: "apiservice-cert") pod "fce08707-0dff-4592-b19e-607aa752b7ca" (UID: "fce08707-0dff-4592-b19e-607aa752b7ca"). InnerVolumeSpecName "apiservice-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 18:08:00 crc kubenswrapper[5120]: I0316 18:08:00.892353 5120 reconciler_common.go:299] "Volume detached for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fce08707-0dff-4592-b19e-607aa752b7ca-apiservice-cert\") on node \"crc\" DevicePath \"\"" Mar 16 18:08:00 crc kubenswrapper[5120]: I0316 18:08:00.892395 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6hq5w\" (UniqueName: \"kubernetes.io/projected/fce08707-0dff-4592-b19e-607aa752b7ca-kube-api-access-6hq5w\") on node \"crc\" DevicePath \"\"" Mar 16 18:08:00 crc kubenswrapper[5120]: I0316 18:08:00.892408 5120 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fce08707-0dff-4592-b19e-607aa752b7ca-webhook-cert\") on node \"crc\" DevicePath \"\"" Mar 16 18:08:01 crc kubenswrapper[5120]: I0316 18:08:01.079130 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/mariadb-operator-index-gb4m2" Mar 16 18:08:01 crc kubenswrapper[5120]: I0316 18:08:01.159593 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561408-vrdqs"] Mar 16 18:08:01 crc kubenswrapper[5120]: I0316 18:08:01.205842 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6xckz\" (UniqueName: \"kubernetes.io/projected/8c74e2ee-be49-414b-8ff6-903ff67fcbd8-kube-api-access-6xckz\") pod \"8c74e2ee-be49-414b-8ff6-903ff67fcbd8\" (UID: \"8c74e2ee-be49-414b-8ff6-903ff67fcbd8\") " Mar 16 18:08:01 crc kubenswrapper[5120]: I0316 18:08:01.211592 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c74e2ee-be49-414b-8ff6-903ff67fcbd8-kube-api-access-6xckz" (OuterVolumeSpecName: "kube-api-access-6xckz") pod "8c74e2ee-be49-414b-8ff6-903ff67fcbd8" (UID: "8c74e2ee-be49-414b-8ff6-903ff67fcbd8"). InnerVolumeSpecName "kube-api-access-6xckz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 18:08:01 crc kubenswrapper[5120]: I0316 18:08:01.309798 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6xckz\" (UniqueName: \"kubernetes.io/projected/8c74e2ee-be49-414b-8ff6-903ff67fcbd8-kube-api-access-6xckz\") on node \"crc\" DevicePath \"\"" Mar 16 18:08:01 crc kubenswrapper[5120]: I0316 18:08:01.587567 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/mariadb-operator-controller-manager-68d86d8d4b-2mr9j" event={"ID":"fce08707-0dff-4592-b19e-607aa752b7ca","Type":"ContainerDied","Data":"3f8123780d5d201fde118c9edea2db68ba89234e26e369247ebad80352fd0aa2"} Mar 16 18:08:01 crc kubenswrapper[5120]: I0316 18:08:01.587633 5120 scope.go:117] "RemoveContainer" containerID="c7063f00878583780e83fe13b446eebc2364249eb5b0164eadb41ec2889d3ba2" Mar 16 18:08:01 crc kubenswrapper[5120]: I0316 18:08:01.587867 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/mariadb-operator-controller-manager-68d86d8d4b-2mr9j" Mar 16 18:08:01 crc kubenswrapper[5120]: I0316 18:08:01.591256 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/mariadb-operator-index-gb4m2" Mar 16 18:08:01 crc kubenswrapper[5120]: I0316 18:08:01.591252 5120 generic.go:358] "Generic (PLEG): container finished" podID="8c74e2ee-be49-414b-8ff6-903ff67fcbd8" containerID="21b17156abd179ac9cf5433a301aa1c6b2ab7e94023d85a6cb5bea779868356e" exitCode=0 Mar 16 18:08:01 crc kubenswrapper[5120]: I0316 18:08:01.591349 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/mariadb-operator-index-gb4m2" event={"ID":"8c74e2ee-be49-414b-8ff6-903ff67fcbd8","Type":"ContainerDied","Data":"21b17156abd179ac9cf5433a301aa1c6b2ab7e94023d85a6cb5bea779868356e"} Mar 16 18:08:01 crc kubenswrapper[5120]: I0316 18:08:01.591407 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/mariadb-operator-index-gb4m2" event={"ID":"8c74e2ee-be49-414b-8ff6-903ff67fcbd8","Type":"ContainerDied","Data":"0b420055857d3d26ae398bdb1723229bdd17605c3a2f7e5cb1de56f2afb6e4e2"} Mar 16 18:08:01 crc kubenswrapper[5120]: I0316 18:08:01.596009 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561408-vrdqs" event={"ID":"5874c8fe-7ba8-4ef0-8791-a3bc34fd1167","Type":"ContainerStarted","Data":"c02f1ac53719010f10e61ff5cdc9b51ca4224de4f8c7dab3e7e6be593bb49c81"} Mar 16 18:08:01 crc kubenswrapper[5120]: I0316 18:08:01.617271 5120 scope.go:117] "RemoveContainer" containerID="21b17156abd179ac9cf5433a301aa1c6b2ab7e94023d85a6cb5bea779868356e" Mar 16 18:08:01 crc kubenswrapper[5120]: I0316 18:08:01.628695 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/mariadb-operator-controller-manager-68d86d8d4b-2mr9j"] Mar 16 18:08:01 crc kubenswrapper[5120]: I0316 18:08:01.637363 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-operators/mariadb-operator-controller-manager-68d86d8d4b-2mr9j"] Mar 16 18:08:01 crc kubenswrapper[5120]: I0316 18:08:01.642306 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/mariadb-operator-index-gb4m2"] Mar 16 18:08:01 crc kubenswrapper[5120]: I0316 18:08:01.644621 5120 scope.go:117] "RemoveContainer" containerID="21b17156abd179ac9cf5433a301aa1c6b2ab7e94023d85a6cb5bea779868356e" Mar 16 18:08:01 crc kubenswrapper[5120]: E0316 18:08:01.645137 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"21b17156abd179ac9cf5433a301aa1c6b2ab7e94023d85a6cb5bea779868356e\": container with ID starting with 21b17156abd179ac9cf5433a301aa1c6b2ab7e94023d85a6cb5bea779868356e not found: ID does not exist" containerID="21b17156abd179ac9cf5433a301aa1c6b2ab7e94023d85a6cb5bea779868356e" Mar 16 18:08:01 crc kubenswrapper[5120]: I0316 18:08:01.645184 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21b17156abd179ac9cf5433a301aa1c6b2ab7e94023d85a6cb5bea779868356e"} err="failed to get container status \"21b17156abd179ac9cf5433a301aa1c6b2ab7e94023d85a6cb5bea779868356e\": rpc error: code = NotFound desc = could not find container \"21b17156abd179ac9cf5433a301aa1c6b2ab7e94023d85a6cb5bea779868356e\": container with ID starting with 21b17156abd179ac9cf5433a301aa1c6b2ab7e94023d85a6cb5bea779868356e not found: ID does not exist" Mar 16 18:08:01 crc kubenswrapper[5120]: I0316 18:08:01.648013 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-operators/mariadb-operator-index-gb4m2"] Mar 16 18:08:02 crc kubenswrapper[5120]: I0316 18:08:02.676026 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0e32308f-d5af-4f54-8797-ae6a4a9d2cb5" path="/var/lib/kubelet/pods/0e32308f-d5af-4f54-8797-ae6a4a9d2cb5/volumes" Mar 16 18:08:02 crc kubenswrapper[5120]: I0316 18:08:02.676765 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8c74e2ee-be49-414b-8ff6-903ff67fcbd8" path="/var/lib/kubelet/pods/8c74e2ee-be49-414b-8ff6-903ff67fcbd8/volumes" Mar 16 18:08:02 crc kubenswrapper[5120]: I0316 18:08:02.677222 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a4d09400-44e7-4493-9e14-f5fc42e13179" path="/var/lib/kubelet/pods/a4d09400-44e7-4493-9e14-f5fc42e13179/volumes" Mar 16 18:08:02 crc kubenswrapper[5120]: I0316 18:08:02.677885 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fce08707-0dff-4592-b19e-607aa752b7ca" path="/var/lib/kubelet/pods/fce08707-0dff-4592-b19e-607aa752b7ca/volumes" Mar 16 18:08:03 crc kubenswrapper[5120]: I0316 18:08:03.623858 5120 generic.go:358] "Generic (PLEG): container finished" podID="5874c8fe-7ba8-4ef0-8791-a3bc34fd1167" containerID="4d966703f084786b6ee40fabd58b591bc3644c214d07606c0f5b5dbb8c3053e9" exitCode=0 Mar 16 18:08:03 crc kubenswrapper[5120]: I0316 18:08:03.624260 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561408-vrdqs" event={"ID":"5874c8fe-7ba8-4ef0-8791-a3bc34fd1167","Type":"ContainerDied","Data":"4d966703f084786b6ee40fabd58b591bc3644c214d07606c0f5b5dbb8c3053e9"} Mar 16 18:08:03 crc kubenswrapper[5120]: I0316 18:08:03.664595 5120 scope.go:117] "RemoveContainer" containerID="fa578cadb98a23319854b9fc54966313bbc1cee64f90cc75e1f951be3cb08e36" Mar 16 18:08:03 crc kubenswrapper[5120]: E0316 18:08:03.665097 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 18:08:04 crc kubenswrapper[5120]: I0316 18:08:04.897526 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561408-vrdqs" Mar 16 18:08:05 crc kubenswrapper[5120]: I0316 18:08:05.002200 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jxm5l\" (UniqueName: \"kubernetes.io/projected/5874c8fe-7ba8-4ef0-8791-a3bc34fd1167-kube-api-access-jxm5l\") pod \"5874c8fe-7ba8-4ef0-8791-a3bc34fd1167\" (UID: \"5874c8fe-7ba8-4ef0-8791-a3bc34fd1167\") " Mar 16 18:08:05 crc kubenswrapper[5120]: I0316 18:08:05.011212 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5874c8fe-7ba8-4ef0-8791-a3bc34fd1167-kube-api-access-jxm5l" (OuterVolumeSpecName: "kube-api-access-jxm5l") pod "5874c8fe-7ba8-4ef0-8791-a3bc34fd1167" (UID: "5874c8fe-7ba8-4ef0-8791-a3bc34fd1167"). InnerVolumeSpecName "kube-api-access-jxm5l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 18:08:05 crc kubenswrapper[5120]: I0316 18:08:05.104871 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jxm5l\" (UniqueName: \"kubernetes.io/projected/5874c8fe-7ba8-4ef0-8791-a3bc34fd1167-kube-api-access-jxm5l\") on node \"crc\" DevicePath \"\"" Mar 16 18:08:05 crc kubenswrapper[5120]: I0316 18:08:05.649208 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561408-vrdqs" Mar 16 18:08:05 crc kubenswrapper[5120]: I0316 18:08:05.649235 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561408-vrdqs" event={"ID":"5874c8fe-7ba8-4ef0-8791-a3bc34fd1167","Type":"ContainerDied","Data":"c02f1ac53719010f10e61ff5cdc9b51ca4224de4f8c7dab3e7e6be593bb49c81"} Mar 16 18:08:05 crc kubenswrapper[5120]: I0316 18:08:05.649309 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c02f1ac53719010f10e61ff5cdc9b51ca4224de4f8c7dab3e7e6be593bb49c81" Mar 16 18:08:05 crc kubenswrapper[5120]: I0316 18:08:05.949370 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-infra/auto-csr-approver-29561402-c8xjc"] Mar 16 18:08:05 crc kubenswrapper[5120]: I0316 18:08:05.952808 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-infra/auto-csr-approver-29561402-c8xjc"] Mar 16 18:08:06 crc kubenswrapper[5120]: I0316 18:08:06.674493 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1722f4f5-e490-446a-a941-986a1ea0d052" path="/var/lib/kubelet/pods/1722f4f5-e490-446a-a941-986a1ea0d052/volumes" Mar 16 18:08:08 crc kubenswrapper[5120]: E0316 18:08:08.012511 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=848759 actualBytes=10240 Mar 16 18:08:15 crc kubenswrapper[5120]: I0316 18:08:15.663556 5120 scope.go:117] "RemoveContainer" containerID="fa578cadb98a23319854b9fc54966313bbc1cee64f90cc75e1f951be3cb08e36" Mar 16 18:08:15 crc kubenswrapper[5120]: E0316 18:08:15.664319 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 18:08:17 crc kubenswrapper[5120]: I0316 18:08:17.294330 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-qkltq/must-gather-qb88w"] Mar 16 18:08:17 crc kubenswrapper[5120]: I0316 18:08:17.295842 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c74e2ee-be49-414b-8ff6-903ff67fcbd8" containerName="registry-server" Mar 16 18:08:17 crc kubenswrapper[5120]: I0316 18:08:17.295870 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c74e2ee-be49-414b-8ff6-903ff67fcbd8" containerName="registry-server" Mar 16 18:08:17 crc kubenswrapper[5120]: I0316 18:08:17.295885 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5874c8fe-7ba8-4ef0-8791-a3bc34fd1167" containerName="oc" Mar 16 18:08:17 crc kubenswrapper[5120]: I0316 18:08:17.295894 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="5874c8fe-7ba8-4ef0-8791-a3bc34fd1167" containerName="oc" Mar 16 18:08:17 crc kubenswrapper[5120]: I0316 18:08:17.295916 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be179d3f-0e28-4c2b-bc0a-aec68b9e3e98" containerName="mariadb-account-delete" Mar 16 18:08:17 crc kubenswrapper[5120]: I0316 18:08:17.295924 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="be179d3f-0e28-4c2b-bc0a-aec68b9e3e98" containerName="mariadb-account-delete" Mar 16 18:08:17 crc kubenswrapper[5120]: I0316 18:08:17.295958 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fce08707-0dff-4592-b19e-607aa752b7ca" containerName="manager" Mar 16 18:08:17 crc kubenswrapper[5120]: I0316 18:08:17.295965 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="fce08707-0dff-4592-b19e-607aa752b7ca" containerName="manager" Mar 16 18:08:17 crc kubenswrapper[5120]: I0316 18:08:17.296111 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="5874c8fe-7ba8-4ef0-8791-a3bc34fd1167" containerName="oc" Mar 16 18:08:17 crc kubenswrapper[5120]: I0316 18:08:17.296126 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="fce08707-0dff-4592-b19e-607aa752b7ca" containerName="manager" Mar 16 18:08:17 crc kubenswrapper[5120]: I0316 18:08:17.296143 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="be179d3f-0e28-4c2b-bc0a-aec68b9e3e98" containerName="mariadb-account-delete" Mar 16 18:08:17 crc kubenswrapper[5120]: I0316 18:08:17.296164 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="8c74e2ee-be49-414b-8ff6-903ff67fcbd8" containerName="registry-server" Mar 16 18:08:17 crc kubenswrapper[5120]: I0316 18:08:17.308682 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qkltq/must-gather-qb88w"] Mar 16 18:08:17 crc kubenswrapper[5120]: I0316 18:08:17.308892 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qkltq/must-gather-qb88w" Mar 16 18:08:17 crc kubenswrapper[5120]: I0316 18:08:17.312551 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-qkltq\"/\"default-dockercfg-m9zqx\"" Mar 16 18:08:17 crc kubenswrapper[5120]: I0316 18:08:17.312743 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qkltq\"/\"kube-root-ca.crt\"" Mar 16 18:08:17 crc kubenswrapper[5120]: I0316 18:08:17.313292 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qkltq\"/\"openshift-service-ca.crt\"" Mar 16 18:08:17 crc kubenswrapper[5120]: I0316 18:08:17.337220 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/414efc23-a216-483c-8b87-bcad5ca5820c-must-gather-output\") pod \"must-gather-qb88w\" (UID: \"414efc23-a216-483c-8b87-bcad5ca5820c\") " pod="openshift-must-gather-qkltq/must-gather-qb88w" Mar 16 18:08:17 crc kubenswrapper[5120]: I0316 18:08:17.337501 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvlkv\" (UniqueName: \"kubernetes.io/projected/414efc23-a216-483c-8b87-bcad5ca5820c-kube-api-access-jvlkv\") pod \"must-gather-qb88w\" (UID: \"414efc23-a216-483c-8b87-bcad5ca5820c\") " pod="openshift-must-gather-qkltq/must-gather-qb88w" Mar 16 18:08:17 crc kubenswrapper[5120]: I0316 18:08:17.439510 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/414efc23-a216-483c-8b87-bcad5ca5820c-must-gather-output\") pod \"must-gather-qb88w\" (UID: \"414efc23-a216-483c-8b87-bcad5ca5820c\") " pod="openshift-must-gather-qkltq/must-gather-qb88w" Mar 16 18:08:17 crc kubenswrapper[5120]: I0316 18:08:17.439717 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jvlkv\" (UniqueName: \"kubernetes.io/projected/414efc23-a216-483c-8b87-bcad5ca5820c-kube-api-access-jvlkv\") pod \"must-gather-qb88w\" (UID: \"414efc23-a216-483c-8b87-bcad5ca5820c\") " pod="openshift-must-gather-qkltq/must-gather-qb88w" Mar 16 18:08:17 crc kubenswrapper[5120]: I0316 18:08:17.440053 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/414efc23-a216-483c-8b87-bcad5ca5820c-must-gather-output\") pod \"must-gather-qb88w\" (UID: \"414efc23-a216-483c-8b87-bcad5ca5820c\") " pod="openshift-must-gather-qkltq/must-gather-qb88w" Mar 16 18:08:17 crc kubenswrapper[5120]: I0316 18:08:17.457894 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvlkv\" (UniqueName: \"kubernetes.io/projected/414efc23-a216-483c-8b87-bcad5ca5820c-kube-api-access-jvlkv\") pod \"must-gather-qb88w\" (UID: \"414efc23-a216-483c-8b87-bcad5ca5820c\") " pod="openshift-must-gather-qkltq/must-gather-qb88w" Mar 16 18:08:17 crc kubenswrapper[5120]: I0316 18:08:17.641983 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qkltq/must-gather-qb88w" Mar 16 18:08:18 crc kubenswrapper[5120]: I0316 18:08:18.038514 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qkltq/must-gather-qb88w"] Mar 16 18:08:18 crc kubenswrapper[5120]: I0316 18:08:18.776053 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qkltq/must-gather-qb88w" event={"ID":"414efc23-a216-483c-8b87-bcad5ca5820c","Type":"ContainerStarted","Data":"92182e9df2153e0fbc7a82f5c83a215f6c8e822781673db8e915b877c81c4573"} Mar 16 18:08:23 crc kubenswrapper[5120]: I0316 18:08:23.823076 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qkltq/must-gather-qb88w" event={"ID":"414efc23-a216-483c-8b87-bcad5ca5820c","Type":"ContainerStarted","Data":"413e9950397c3ae5988698891dbabe8bfa3b3a91801f536d0fe5fa7c7ad6e0b9"} Mar 16 18:08:23 crc kubenswrapper[5120]: I0316 18:08:23.823670 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qkltq/must-gather-qb88w" event={"ID":"414efc23-a216-483c-8b87-bcad5ca5820c","Type":"ContainerStarted","Data":"c223d1a9366c13a8ae4bf389abb0d2066486d64cd7055ab78ae50c31e1d7e6b5"} Mar 16 18:08:23 crc kubenswrapper[5120]: I0316 18:08:23.845403 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-qkltq/must-gather-qb88w" podStartSLOduration=1.895407289 podStartE2EDuration="6.84538199s" podCreationTimestamp="2026-03-16 18:08:17 +0000 UTC" firstStartedPulling="2026-03-16 18:08:18.061737938 +0000 UTC m=+9400.215669595" lastFinishedPulling="2026-03-16 18:08:23.011712639 +0000 UTC m=+9405.165644296" observedRunningTime="2026-03-16 18:08:23.841967136 +0000 UTC m=+9405.995898793" watchObservedRunningTime="2026-03-16 18:08:23.84538199 +0000 UTC m=+9405.999313647" Mar 16 18:08:26 crc kubenswrapper[5120]: I0316 18:08:26.664542 5120 scope.go:117] "RemoveContainer" containerID="fa578cadb98a23319854b9fc54966313bbc1cee64f90cc75e1f951be3cb08e36" Mar 16 18:08:26 crc kubenswrapper[5120]: I0316 18:08:26.847514 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" event={"ID":"e2275cb4-4905-4d66-a87e-8010120db2bd","Type":"ContainerStarted","Data":"0bc706326dac8b83055559df8e8f05a839bf45e2e38c5788a669089c8a5708f7"} Mar 16 18:08:38 crc kubenswrapper[5120]: I0316 18:08:38.940227 5120 scope.go:117] "RemoveContainer" containerID="c876c014c16db4f6b5160dee0adfbda177e62b4c1227bb2c162364fbd7d2b603" Mar 16 18:08:38 crc kubenswrapper[5120]: I0316 18:08:38.975945 5120 scope.go:117] "RemoveContainer" containerID="876e71f85eb4257e6e176025a4c42a499e99f8cf72dc3850c27f85fea54a0019" Mar 16 18:08:39 crc kubenswrapper[5120]: I0316 18:08:39.008241 5120 scope.go:117] "RemoveContainer" containerID="63423c82f0589b77f993812d8edd54179125e659e9221724d4e93d0fa5254c78" Mar 16 18:08:39 crc kubenswrapper[5120]: I0316 18:08:39.039247 5120 scope.go:117] "RemoveContainer" containerID="399aceccc6721b6db5076edd42752a6b4daa18392bb3c610947ecb98cfdc3de1" Mar 16 18:08:39 crc kubenswrapper[5120]: I0316 18:08:39.061178 5120 scope.go:117] "RemoveContainer" containerID="d7261bc3481423adedac4a476ebe8c606cbbb8b61eae7b5e667065870c9ae092" Mar 16 18:08:39 crc kubenswrapper[5120]: I0316 18:08:39.081602 5120 scope.go:117] "RemoveContainer" containerID="cf2b114dda245ff770129611742820d3e5937fa8510f57982adc6da900d1ec60" Mar 16 18:08:39 crc kubenswrapper[5120]: I0316 18:08:39.175593 5120 scope.go:117] "RemoveContainer" containerID="2f394bc0d4cd35b0c0b4498267b562b09206aaef6d5c73421fdb40b4b945c6fb" Mar 16 18:09:07 crc kubenswrapper[5120]: E0316 18:09:07.371191 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=885111 actualBytes=10240 Mar 16 18:09:36 crc kubenswrapper[5120]: I0316 18:09:36.903884 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-api_control-plane-machine-set-operator-75ffdb6fcd-htqkp_3b41e06b-0932-41d2-947a-e38b1ff52ec3/control-plane-machine-set-operator/0.log" Mar 16 18:09:37 crc kubenswrapper[5120]: I0316 18:09:37.049010 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-api_machine-api-operator-755bb95488-5t49b_c86a3068-6ba1-40ef-9774-6a9efa5e0db6/kube-rbac-proxy/0.log" Mar 16 18:09:37 crc kubenswrapper[5120]: I0316 18:09:37.083894 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-api_machine-api-operator-755bb95488-5t49b_c86a3068-6ba1-40ef-9774-6a9efa5e0db6/machine-api-operator/0.log" Mar 16 18:09:39 crc kubenswrapper[5120]: I0316 18:09:39.432798 5120 scope.go:117] "RemoveContainer" containerID="9a84236ff16d70d0fe8cce589889e1eff6fde516c9875fdcc59d906ab5930fd8" Mar 16 18:09:39 crc kubenswrapper[5120]: I0316 18:09:39.456567 5120 scope.go:117] "RemoveContainer" containerID="d86ae61d35b6d2ea8b034177183d5d1d3e88ae146794b5e95fc84930daeb70cb" Mar 16 18:09:39 crc kubenswrapper[5120]: I0316 18:09:39.506231 5120 scope.go:117] "RemoveContainer" containerID="03b88cff1dac1651bf434abeb9e3c6739cbf9416037c444e35baa67c02a822c2" Mar 16 18:09:39 crc kubenswrapper[5120]: I0316 18:09:39.529060 5120 scope.go:117] "RemoveContainer" containerID="ef6b58434af366a97ce2c38b55ab0a66204c617f0b65ca13dd5664a03de4500e" Mar 16 18:09:49 crc kubenswrapper[5120]: I0316 18:09:49.382600 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/cert-manager_cert-manager-cainjector-8966b78d4-gv9vk_2e8a8519-57b7-4e2b-a654-54129ca2213b/cert-manager-cainjector/0.log" Mar 16 18:09:49 crc kubenswrapper[5120]: I0316 18:09:49.402964 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/cert-manager_cert-manager-webhook-597b96b99b-8mqkn_3371b452-79cc-4573-a16f-fb885f37946a/cert-manager-webhook/0.log" Mar 16 18:09:49 crc kubenswrapper[5120]: I0316 18:09:49.525053 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/cert-manager_cert-manager-759f64656b-r4522_2bc8ef1b-920f-4da9-b11d-182fa58ffc20/cert-manager-controller/0.log" Mar 16 18:10:00 crc kubenswrapper[5120]: I0316 18:10:00.136794 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-infra/auto-csr-approver-29561410-5zftd"] Mar 16 18:10:00 crc kubenswrapper[5120]: I0316 18:10:00.156328 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561410-5zftd"] Mar 16 18:10:00 crc kubenswrapper[5120]: I0316 18:10:00.156499 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561410-5zftd" Mar 16 18:10:00 crc kubenswrapper[5120]: I0316 18:10:00.159783 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"openshift-service-ca.crt\"" Mar 16 18:10:00 crc kubenswrapper[5120]: I0316 18:10:00.160044 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-infra\"/\"csr-approver-sa-dockercfg-x2nsz\"" Mar 16 18:10:00 crc kubenswrapper[5120]: I0316 18:10:00.160094 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"kube-root-ca.crt\"" Mar 16 18:10:00 crc kubenswrapper[5120]: I0316 18:10:00.249260 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwq8r\" (UniqueName: \"kubernetes.io/projected/c2aa59e9-8b03-4903-9990-c7e6b111acfb-kube-api-access-rwq8r\") pod \"auto-csr-approver-29561410-5zftd\" (UID: \"c2aa59e9-8b03-4903-9990-c7e6b111acfb\") " pod="openshift-infra/auto-csr-approver-29561410-5zftd" Mar 16 18:10:00 crc kubenswrapper[5120]: I0316 18:10:00.351352 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rwq8r\" (UniqueName: \"kubernetes.io/projected/c2aa59e9-8b03-4903-9990-c7e6b111acfb-kube-api-access-rwq8r\") pod \"auto-csr-approver-29561410-5zftd\" (UID: \"c2aa59e9-8b03-4903-9990-c7e6b111acfb\") " pod="openshift-infra/auto-csr-approver-29561410-5zftd" Mar 16 18:10:00 crc kubenswrapper[5120]: I0316 18:10:00.377425 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwq8r\" (UniqueName: \"kubernetes.io/projected/c2aa59e9-8b03-4903-9990-c7e6b111acfb-kube-api-access-rwq8r\") pod \"auto-csr-approver-29561410-5zftd\" (UID: \"c2aa59e9-8b03-4903-9990-c7e6b111acfb\") " pod="openshift-infra/auto-csr-approver-29561410-5zftd" Mar 16 18:10:00 crc kubenswrapper[5120]: I0316 18:10:00.477850 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561410-5zftd" Mar 16 18:10:00 crc kubenswrapper[5120]: I0316 18:10:00.765036 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561410-5zftd"] Mar 16 18:10:01 crc kubenswrapper[5120]: I0316 18:10:01.245613 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-nmstate_nmstate-console-plugin-74686bb6b4-dcsrq_5b76933b-fb29-4e6c-ae26-c15b23d8aa69/nmstate-console-plugin/0.log" Mar 16 18:10:01 crc kubenswrapper[5120]: I0316 18:10:01.373446 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-nmstate_nmstate-handler-fbxhr_1b84482c-adc3-4ce0-9551-deb315607bae/nmstate-handler/0.log" Mar 16 18:10:01 crc kubenswrapper[5120]: I0316 18:10:01.448332 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-nmstate_nmstate-metrics-7f888697b-h5l4s_f79d1780-bb33-4b14-8358-9b0ab3bb485a/nmstate-metrics/0.log" Mar 16 18:10:01 crc kubenswrapper[5120]: I0316 18:10:01.504723 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-nmstate_nmstate-metrics-7f888697b-h5l4s_f79d1780-bb33-4b14-8358-9b0ab3bb485a/kube-rbac-proxy/0.log" Mar 16 18:10:01 crc kubenswrapper[5120]: I0316 18:10:01.581695 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-nmstate_nmstate-operator-54b58fcbc5-4tsgg_39ff1970-5f12-4437-ade6-0a03e211bae8/nmstate-operator/0.log" Mar 16 18:10:01 crc kubenswrapper[5120]: I0316 18:10:01.693111 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-nmstate_nmstate-webhook-78fdd78d8b-dtt5m_c0128410-82f7-48a8-80f6-a04f53ef87d0/nmstate-webhook/0.log" Mar 16 18:10:01 crc kubenswrapper[5120]: I0316 18:10:01.752244 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561410-5zftd" event={"ID":"c2aa59e9-8b03-4903-9990-c7e6b111acfb","Type":"ContainerStarted","Data":"507cd5ba94b547552734aff86e39deb8109cd0e352d148988a24d2bd5f591d8f"} Mar 16 18:10:02 crc kubenswrapper[5120]: I0316 18:10:02.761034 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561410-5zftd" event={"ID":"c2aa59e9-8b03-4903-9990-c7e6b111acfb","Type":"ContainerStarted","Data":"78ffa240f855966cb8d48a05113db961fa800c58da16db29a16c672be711839f"} Mar 16 18:10:03 crc kubenswrapper[5120]: I0316 18:10:03.770355 5120 generic.go:358] "Generic (PLEG): container finished" podID="c2aa59e9-8b03-4903-9990-c7e6b111acfb" containerID="78ffa240f855966cb8d48a05113db961fa800c58da16db29a16c672be711839f" exitCode=0 Mar 16 18:10:03 crc kubenswrapper[5120]: I0316 18:10:03.770829 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561410-5zftd" event={"ID":"c2aa59e9-8b03-4903-9990-c7e6b111acfb","Type":"ContainerDied","Data":"78ffa240f855966cb8d48a05113db961fa800c58da16db29a16c672be711839f"} Mar 16 18:10:05 crc kubenswrapper[5120]: I0316 18:10:05.041890 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561410-5zftd" Mar 16 18:10:05 crc kubenswrapper[5120]: I0316 18:10:05.147344 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rwq8r\" (UniqueName: \"kubernetes.io/projected/c2aa59e9-8b03-4903-9990-c7e6b111acfb-kube-api-access-rwq8r\") pod \"c2aa59e9-8b03-4903-9990-c7e6b111acfb\" (UID: \"c2aa59e9-8b03-4903-9990-c7e6b111acfb\") " Mar 16 18:10:05 crc kubenswrapper[5120]: I0316 18:10:05.158009 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2aa59e9-8b03-4903-9990-c7e6b111acfb-kube-api-access-rwq8r" (OuterVolumeSpecName: "kube-api-access-rwq8r") pod "c2aa59e9-8b03-4903-9990-c7e6b111acfb" (UID: "c2aa59e9-8b03-4903-9990-c7e6b111acfb"). InnerVolumeSpecName "kube-api-access-rwq8r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 18:10:05 crc kubenswrapper[5120]: I0316 18:10:05.249802 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rwq8r\" (UniqueName: \"kubernetes.io/projected/c2aa59e9-8b03-4903-9990-c7e6b111acfb-kube-api-access-rwq8r\") on node \"crc\" DevicePath \"\"" Mar 16 18:10:05 crc kubenswrapper[5120]: I0316 18:10:05.810685 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561410-5zftd" Mar 16 18:10:05 crc kubenswrapper[5120]: I0316 18:10:05.810677 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561410-5zftd" event={"ID":"c2aa59e9-8b03-4903-9990-c7e6b111acfb","Type":"ContainerDied","Data":"507cd5ba94b547552734aff86e39deb8109cd0e352d148988a24d2bd5f591d8f"} Mar 16 18:10:05 crc kubenswrapper[5120]: I0316 18:10:05.810883 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="507cd5ba94b547552734aff86e39deb8109cd0e352d148988a24d2bd5f591d8f" Mar 16 18:10:05 crc kubenswrapper[5120]: I0316 18:10:05.840811 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-infra/auto-csr-approver-29561404-p9nzn"] Mar 16 18:10:05 crc kubenswrapper[5120]: I0316 18:10:05.846840 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-infra/auto-csr-approver-29561404-p9nzn"] Mar 16 18:10:06 crc kubenswrapper[5120]: I0316 18:10:06.673812 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="41c1333f-bd13-4fac-a11f-82e01a9997ce" path="/var/lib/kubelet/pods/41c1333f-bd13-4fac-a11f-82e01a9997ce/volumes" Mar 16 18:10:07 crc kubenswrapper[5120]: E0316 18:10:07.218623 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=885110 actualBytes=10240 Mar 16 18:10:14 crc kubenswrapper[5120]: I0316 18:10:14.386138 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_obo-prometheus-operator-9bc85b4bf-7p4jt_18c84489-f690-4ef3-b74c-90c206024afd/prometheus-operator/0.log" Mar 16 18:10:14 crc kubenswrapper[5120]: I0316 18:10:14.556633 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_obo-prometheus-operator-admission-webhook-669bcd8dd-zfrnj_71f02692-3bf5-4e19-97a5-e7f79f2c52af/prometheus-operator-admission-webhook/0.log" Mar 16 18:10:14 crc kubenswrapper[5120]: I0316 18:10:14.563099 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_obo-prometheus-operator-admission-webhook-669bcd8dd-pzkpw_13869ea5-bd74-407b-a6ce-c20c6214d66a/prometheus-operator-admission-webhook/0.log" Mar 16 18:10:14 crc kubenswrapper[5120]: I0316 18:10:14.743514 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_observability-operator-85c68dddb-zj2rl_4df87e18-229a-409c-8e61-36fc094b6de9/operator/0.log" Mar 16 18:10:14 crc kubenswrapper[5120]: I0316 18:10:14.748927 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_perses-operator-669c9f96b5-m4vlq_395765ab-8a57-4a9d-a0b5-f113e4914594/perses-operator/0.log" Mar 16 18:10:27 crc kubenswrapper[5120]: I0316 18:10:27.993367 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/metallb-system_controller-774d88f846-jzlz8_62b0a03e-1f8d-4040-a322-38ea66f4b6d8/kube-rbac-proxy/0.log" Mar 16 18:10:28 crc kubenswrapper[5120]: I0316 18:10:28.179239 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/metallb-system_metallb-operator-controller-manager-646b4d4dc-sshj9_bdee5404-16e7-4f56-9dd8-c894470335f0/manager/0.log" Mar 16 18:10:28 crc kubenswrapper[5120]: I0316 18:10:28.341165 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/metallb-system_controller-774d88f846-jzlz8_62b0a03e-1f8d-4040-a322-38ea66f4b6d8/controller/0.log" Mar 16 18:10:28 crc kubenswrapper[5120]: I0316 18:10:28.361712 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/metallb-system_metallb-operator-webhook-server-5cc9c9d8fc-q6ts6_b78f2b18-8b3b-4ee9-be57-670a88f38fc0/webhook-server/0.log" Mar 16 18:10:28 crc kubenswrapper[5120]: I0316 18:10:28.454889 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/metallb-system_speaker-xfrqk_797c0fde-13ff-46ed-9e0e-1520d90c8e8e/kube-rbac-proxy/0.log" Mar 16 18:10:29 crc kubenswrapper[5120]: I0316 18:10:29.736735 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/metallb-system_speaker-xfrqk_797c0fde-13ff-46ed-9e0e-1520d90c8e8e/speaker/0.log" Mar 16 18:10:39 crc kubenswrapper[5120]: I0316 18:10:39.597881 5120 scope.go:117] "RemoveContainer" containerID="b38ce02584f11c87e8ee20dc6e3414b64e6f4512bf88bc45a5b901f67630016f" Mar 16 18:10:39 crc kubenswrapper[5120]: I0316 18:10:39.626892 5120 scope.go:117] "RemoveContainer" containerID="2ad4716c90d1a5ccead7b23ca502421ad8f670b8feda902da4fac080bb3c0fa8" Mar 16 18:10:39 crc kubenswrapper[5120]: I0316 18:10:39.742051 5120 scope.go:117] "RemoveContainer" containerID="c55311eea0497ded30bdb099fba4a7607c4b10c27c9a0eb98c271b2cb9b0e32b" Mar 16 18:10:39 crc kubenswrapper[5120]: I0316 18:10:39.777668 5120 scope.go:117] "RemoveContainer" containerID="0a2a04f1c8d91d47e9b5a0fb835b74d83bd43e14b1f5f0029bb30aa8c98995fa" Mar 16 18:10:39 crc kubenswrapper[5120]: I0316 18:10:39.804641 5120 scope.go:117] "RemoveContainer" containerID="516bd0abf13ac9b504f215494f512371bc74833a4ffcb1571ed906d8f2f3f2ea" Mar 16 18:10:39 crc kubenswrapper[5120]: I0316 18:10:39.841273 5120 scope.go:117] "RemoveContainer" containerID="818819181fecca0343ed0f17705ac25c034a94121e38e8873886f77a2450f10f" Mar 16 18:10:52 crc kubenswrapper[5120]: I0316 18:10:52.008697 5120 patch_prober.go:28] interesting pod/machine-config-daemon-7bf76 container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 18:10:52 crc kubenswrapper[5120]: I0316 18:10:52.009295 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 18:11:07 crc kubenswrapper[5120]: E0316 18:11:07.180330 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=886426 actualBytes=10240 Mar 16 18:11:16 crc kubenswrapper[5120]: I0316 18:11:16.963382 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_dnsmasq-dnsmasq-79dcd846c5-5dr8d_798363c6-1234-40e2-a0a7-85e1180310c4/init/0.log" Mar 16 18:11:17 crc kubenswrapper[5120]: I0316 18:11:17.440750 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_dnsmasq-dnsmasq-79dcd846c5-5dr8d_798363c6-1234-40e2-a0a7-85e1180310c4/init/0.log" Mar 16 18:11:17 crc kubenswrapper[5120]: I0316 18:11:17.460033 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_dnsmasq-dnsmasq-79dcd846c5-5dr8d_798363c6-1234-40e2-a0a7-85e1180310c4/dnsmasq-dns/0.log" Mar 16 18:11:22 crc kubenswrapper[5120]: I0316 18:11:22.007902 5120 patch_prober.go:28] interesting pod/machine-config-daemon-7bf76 container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 18:11:22 crc kubenswrapper[5120]: I0316 18:11:22.008251 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 18:11:30 crc kubenswrapper[5120]: I0316 18:11:30.167909 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_5f0d783fea323979717ec4113d968dc42dcfaeaad7ccdc94e6a93c9e91jzl5h_9cdb212f-7fb8-44ae-95d1-b2ea8dc09448/util/0.log" Mar 16 18:11:30 crc kubenswrapper[5120]: I0316 18:11:30.358867 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_5f0d783fea323979717ec4113d968dc42dcfaeaad7ccdc94e6a93c9e91jzl5h_9cdb212f-7fb8-44ae-95d1-b2ea8dc09448/util/0.log" Mar 16 18:11:30 crc kubenswrapper[5120]: I0316 18:11:30.366363 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_5f0d783fea323979717ec4113d968dc42dcfaeaad7ccdc94e6a93c9e91jzl5h_9cdb212f-7fb8-44ae-95d1-b2ea8dc09448/pull/0.log" Mar 16 18:11:30 crc kubenswrapper[5120]: I0316 18:11:30.411361 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_5f0d783fea323979717ec4113d968dc42dcfaeaad7ccdc94e6a93c9e91jzl5h_9cdb212f-7fb8-44ae-95d1-b2ea8dc09448/pull/0.log" Mar 16 18:11:30 crc kubenswrapper[5120]: I0316 18:11:30.571486 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_5f0d783fea323979717ec4113d968dc42dcfaeaad7ccdc94e6a93c9e91jzl5h_9cdb212f-7fb8-44ae-95d1-b2ea8dc09448/pull/0.log" Mar 16 18:11:30 crc kubenswrapper[5120]: I0316 18:11:30.588842 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_5f0d783fea323979717ec4113d968dc42dcfaeaad7ccdc94e6a93c9e91jzl5h_9cdb212f-7fb8-44ae-95d1-b2ea8dc09448/util/0.log" Mar 16 18:11:30 crc kubenswrapper[5120]: I0316 18:11:30.590253 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_5f0d783fea323979717ec4113d968dc42dcfaeaad7ccdc94e6a93c9e91jzl5h_9cdb212f-7fb8-44ae-95d1-b2ea8dc09448/extract/0.log" Mar 16 18:11:30 crc kubenswrapper[5120]: I0316 18:11:30.728909 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_925ad1f05bf386dc21bdfe2f8249c1fbfd04a404dec7a7fb6362d758e5ndmlk_13031077-4428-4288-80ef-4098c9c4e353/util/0.log" Mar 16 18:11:30 crc kubenswrapper[5120]: I0316 18:11:30.910028 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_925ad1f05bf386dc21bdfe2f8249c1fbfd04a404dec7a7fb6362d758e5ndmlk_13031077-4428-4288-80ef-4098c9c4e353/pull/0.log" Mar 16 18:11:30 crc kubenswrapper[5120]: I0316 18:11:30.928903 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_925ad1f05bf386dc21bdfe2f8249c1fbfd04a404dec7a7fb6362d758e5ndmlk_13031077-4428-4288-80ef-4098c9c4e353/util/0.log" Mar 16 18:11:30 crc kubenswrapper[5120]: I0316 18:11:30.952082 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_925ad1f05bf386dc21bdfe2f8249c1fbfd04a404dec7a7fb6362d758e5ndmlk_13031077-4428-4288-80ef-4098c9c4e353/pull/0.log" Mar 16 18:11:31 crc kubenswrapper[5120]: I0316 18:11:31.105970 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_925ad1f05bf386dc21bdfe2f8249c1fbfd04a404dec7a7fb6362d758e5ndmlk_13031077-4428-4288-80ef-4098c9c4e353/util/0.log" Mar 16 18:11:31 crc kubenswrapper[5120]: I0316 18:11:31.109975 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_925ad1f05bf386dc21bdfe2f8249c1fbfd04a404dec7a7fb6362d758e5ndmlk_13031077-4428-4288-80ef-4098c9c4e353/extract/0.log" Mar 16 18:11:31 crc kubenswrapper[5120]: I0316 18:11:31.128927 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_925ad1f05bf386dc21bdfe2f8249c1fbfd04a404dec7a7fb6362d758e5ndmlk_13031077-4428-4288-80ef-4098c9c4e353/pull/0.log" Mar 16 18:11:31 crc kubenswrapper[5120]: I0316 18:11:31.263714 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_98629960b44b381d1a86cff1d1439a8df43509c9ad24579158c59d0f08lwstg_04363a62-e592-457c-ac4a-48bb6c942c9a/util/0.log" Mar 16 18:11:31 crc kubenswrapper[5120]: I0316 18:11:31.448051 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_98629960b44b381d1a86cff1d1439a8df43509c9ad24579158c59d0f08lwstg_04363a62-e592-457c-ac4a-48bb6c942c9a/pull/0.log" Mar 16 18:11:31 crc kubenswrapper[5120]: I0316 18:11:31.450265 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_98629960b44b381d1a86cff1d1439a8df43509c9ad24579158c59d0f08lwstg_04363a62-e592-457c-ac4a-48bb6c942c9a/util/0.log" Mar 16 18:11:31 crc kubenswrapper[5120]: I0316 18:11:31.466275 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_98629960b44b381d1a86cff1d1439a8df43509c9ad24579158c59d0f08lwstg_04363a62-e592-457c-ac4a-48bb6c942c9a/pull/0.log" Mar 16 18:11:31 crc kubenswrapper[5120]: I0316 18:11:31.625234 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_98629960b44b381d1a86cff1d1439a8df43509c9ad24579158c59d0f08lwstg_04363a62-e592-457c-ac4a-48bb6c942c9a/pull/0.log" Mar 16 18:11:31 crc kubenswrapper[5120]: I0316 18:11:31.642198 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_98629960b44b381d1a86cff1d1439a8df43509c9ad24579158c59d0f08lwstg_04363a62-e592-457c-ac4a-48bb6c942c9a/util/0.log" Mar 16 18:11:31 crc kubenswrapper[5120]: I0316 18:11:31.652975 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_98629960b44b381d1a86cff1d1439a8df43509c9ad24579158c59d0f08lwstg_04363a62-e592-457c-ac4a-48bb6c942c9a/extract/0.log" Mar 16 18:11:31 crc kubenswrapper[5120]: I0316 18:11:31.800139 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_certified-operators-klcgv_cb61d003-089b-4f3a-b84e-03d45c451335/extract-utilities/0.log" Mar 16 18:11:31 crc kubenswrapper[5120]: I0316 18:11:31.978425 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_certified-operators-klcgv_cb61d003-089b-4f3a-b84e-03d45c451335/extract-utilities/0.log" Mar 16 18:11:31 crc kubenswrapper[5120]: I0316 18:11:31.981239 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_certified-operators-klcgv_cb61d003-089b-4f3a-b84e-03d45c451335/extract-content/0.log" Mar 16 18:11:32 crc kubenswrapper[5120]: I0316 18:11:32.000023 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_certified-operators-klcgv_cb61d003-089b-4f3a-b84e-03d45c451335/extract-content/0.log" Mar 16 18:11:32 crc kubenswrapper[5120]: I0316 18:11:32.114903 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_certified-operators-klcgv_cb61d003-089b-4f3a-b84e-03d45c451335/extract-utilities/0.log" Mar 16 18:11:32 crc kubenswrapper[5120]: I0316 18:11:32.171146 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_certified-operators-klcgv_cb61d003-089b-4f3a-b84e-03d45c451335/extract-content/0.log" Mar 16 18:11:32 crc kubenswrapper[5120]: I0316 18:11:32.320959 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_community-operators-t6qpc_1cf498e9-c3f0-4050-b629-e9310751e9fc/extract-utilities/0.log" Mar 16 18:11:32 crc kubenswrapper[5120]: I0316 18:11:32.501484 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_community-operators-t6qpc_1cf498e9-c3f0-4050-b629-e9310751e9fc/extract-utilities/0.log" Mar 16 18:11:32 crc kubenswrapper[5120]: I0316 18:11:32.535326 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_community-operators-t6qpc_1cf498e9-c3f0-4050-b629-e9310751e9fc/extract-content/0.log" Mar 16 18:11:32 crc kubenswrapper[5120]: I0316 18:11:32.549816 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_community-operators-t6qpc_1cf498e9-c3f0-4050-b629-e9310751e9fc/extract-content/0.log" Mar 16 18:11:32 crc kubenswrapper[5120]: I0316 18:11:32.726459 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_community-operators-t6qpc_1cf498e9-c3f0-4050-b629-e9310751e9fc/extract-content/0.log" Mar 16 18:11:32 crc kubenswrapper[5120]: I0316 18:11:32.728642 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_community-operators-t6qpc_1cf498e9-c3f0-4050-b629-e9310751e9fc/extract-utilities/0.log" Mar 16 18:11:33 crc kubenswrapper[5120]: I0316 18:11:33.014227 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_d1f2cf7c6f4ecb15e69cc0ed07a53b6f169b7a9d46d563b1a9827dff83d68kn_02456ec5-b7f9-495a-90b7-990ca519212f/util/0.log" Mar 16 18:11:33 crc kubenswrapper[5120]: I0316 18:11:33.024715 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_community-operators-t6qpc_1cf498e9-c3f0-4050-b629-e9310751e9fc/registry-server/0.log" Mar 16 18:11:33 crc kubenswrapper[5120]: I0316 18:11:33.167790 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_d1f2cf7c6f4ecb15e69cc0ed07a53b6f169b7a9d46d563b1a9827dff83d68kn_02456ec5-b7f9-495a-90b7-990ca519212f/util/0.log" Mar 16 18:11:33 crc kubenswrapper[5120]: I0316 18:11:33.226720 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_d1f2cf7c6f4ecb15e69cc0ed07a53b6f169b7a9d46d563b1a9827dff83d68kn_02456ec5-b7f9-495a-90b7-990ca519212f/pull/0.log" Mar 16 18:11:33 crc kubenswrapper[5120]: I0316 18:11:33.235590 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_d1f2cf7c6f4ecb15e69cc0ed07a53b6f169b7a9d46d563b1a9827dff83d68kn_02456ec5-b7f9-495a-90b7-990ca519212f/pull/0.log" Mar 16 18:11:33 crc kubenswrapper[5120]: I0316 18:11:33.368058 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_d1f2cf7c6f4ecb15e69cc0ed07a53b6f169b7a9d46d563b1a9827dff83d68kn_02456ec5-b7f9-495a-90b7-990ca519212f/util/0.log" Mar 16 18:11:33 crc kubenswrapper[5120]: I0316 18:11:33.403342 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_certified-operators-klcgv_cb61d003-089b-4f3a-b84e-03d45c451335/registry-server/0.log" Mar 16 18:11:33 crc kubenswrapper[5120]: I0316 18:11:33.410801 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_d1f2cf7c6f4ecb15e69cc0ed07a53b6f169b7a9d46d563b1a9827dff83d68kn_02456ec5-b7f9-495a-90b7-990ca519212f/pull/0.log" Mar 16 18:11:33 crc kubenswrapper[5120]: I0316 18:11:33.426097 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_d1f2cf7c6f4ecb15e69cc0ed07a53b6f169b7a9d46d563b1a9827dff83d68kn_02456ec5-b7f9-495a-90b7-990ca519212f/extract/0.log" Mar 16 18:11:33 crc kubenswrapper[5120]: I0316 18:11:33.556739 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_redhat-marketplace-6xr7p_d233c35e-a24a-4f65-9bea-f280bc1e51a7/extract-utilities/0.log" Mar 16 18:11:33 crc kubenswrapper[5120]: I0316 18:11:33.567489 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_marketplace-operator-547dbd544d-rt66v_970f8645-801d-4b4b-8571-a39bde23f382/marketplace-operator/0.log" Mar 16 18:11:33 crc kubenswrapper[5120]: I0316 18:11:33.740982 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_redhat-marketplace-6xr7p_d233c35e-a24a-4f65-9bea-f280bc1e51a7/extract-utilities/0.log" Mar 16 18:11:33 crc kubenswrapper[5120]: I0316 18:11:33.763956 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_redhat-marketplace-6xr7p_d233c35e-a24a-4f65-9bea-f280bc1e51a7/extract-content/0.log" Mar 16 18:11:33 crc kubenswrapper[5120]: I0316 18:11:33.802976 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_redhat-marketplace-6xr7p_d233c35e-a24a-4f65-9bea-f280bc1e51a7/extract-content/0.log" Mar 16 18:11:33 crc kubenswrapper[5120]: I0316 18:11:33.979898 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_redhat-marketplace-6xr7p_d233c35e-a24a-4f65-9bea-f280bc1e51a7/extract-content/0.log" Mar 16 18:11:33 crc kubenswrapper[5120]: I0316 18:11:33.983879 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_redhat-marketplace-6xr7p_d233c35e-a24a-4f65-9bea-f280bc1e51a7/extract-utilities/0.log" Mar 16 18:11:34 crc kubenswrapper[5120]: I0316 18:11:34.005610 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_redhat-operators-cxnvm_f5c4787f-e8dd-45ab-9932-3db343fa8673/extract-utilities/0.log" Mar 16 18:11:34 crc kubenswrapper[5120]: I0316 18:11:34.186291 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_redhat-operators-cxnvm_f5c4787f-e8dd-45ab-9932-3db343fa8673/extract-utilities/0.log" Mar 16 18:11:34 crc kubenswrapper[5120]: I0316 18:11:34.249569 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_redhat-operators-cxnvm_f5c4787f-e8dd-45ab-9932-3db343fa8673/extract-content/0.log" Mar 16 18:11:34 crc kubenswrapper[5120]: I0316 18:11:34.249867 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_redhat-operators-cxnvm_f5c4787f-e8dd-45ab-9932-3db343fa8673/extract-content/0.log" Mar 16 18:11:34 crc kubenswrapper[5120]: I0316 18:11:34.309163 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_redhat-marketplace-6xr7p_d233c35e-a24a-4f65-9bea-f280bc1e51a7/registry-server/0.log" Mar 16 18:11:34 crc kubenswrapper[5120]: I0316 18:11:34.470904 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_redhat-operators-cxnvm_f5c4787f-e8dd-45ab-9932-3db343fa8673/extract-utilities/0.log" Mar 16 18:11:34 crc kubenswrapper[5120]: I0316 18:11:34.516847 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_redhat-operators-cxnvm_f5c4787f-e8dd-45ab-9932-3db343fa8673/extract-content/0.log" Mar 16 18:11:34 crc kubenswrapper[5120]: I0316 18:11:34.909537 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_redhat-operators-cxnvm_f5c4787f-e8dd-45ab-9932-3db343fa8673/registry-server/0.log" Mar 16 18:11:39 crc kubenswrapper[5120]: I0316 18:11:39.905168 5120 scope.go:117] "RemoveContainer" containerID="702f992935968945982b1756f3e397576d39580373384ff3c276f74582809b1e" Mar 16 18:11:39 crc kubenswrapper[5120]: I0316 18:11:39.938543 5120 scope.go:117] "RemoveContainer" containerID="c56e0e13437082379b22b8267c9b17eea2297630cdab3ba67ee494c8fbfc0cf5" Mar 16 18:11:39 crc kubenswrapper[5120]: I0316 18:11:39.961500 5120 scope.go:117] "RemoveContainer" containerID="5d7d5be1dc235fb2b04111b81f07cc99aea53466899baa79d9119753911d3bd1" Mar 16 18:11:39 crc kubenswrapper[5120]: I0316 18:11:39.981937 5120 scope.go:117] "RemoveContainer" containerID="7b9a5982d18e6500023495cce02b0a59a33c642fa8ee1b837ab9b4dde28db618" Mar 16 18:11:40 crc kubenswrapper[5120]: I0316 18:11:40.000490 5120 scope.go:117] "RemoveContainer" containerID="16e3d16f583b348000651c2f940a1abfa1266d9f4fba84b7b554f6f4ea2a1bcd" Mar 16 18:11:40 crc kubenswrapper[5120]: I0316 18:11:40.044417 5120 scope.go:117] "RemoveContainer" containerID="f1e5aac041c4423ed1f0131e5dbd43996af933b52b75e708220c95414090a695" Mar 16 18:11:47 crc kubenswrapper[5120]: I0316 18:11:47.159262 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_obo-prometheus-operator-9bc85b4bf-7p4jt_18c84489-f690-4ef3-b74c-90c206024afd/prometheus-operator/0.log" Mar 16 18:11:47 crc kubenswrapper[5120]: I0316 18:11:47.175802 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_obo-prometheus-operator-admission-webhook-669bcd8dd-pzkpw_13869ea5-bd74-407b-a6ce-c20c6214d66a/prometheus-operator-admission-webhook/0.log" Mar 16 18:11:47 crc kubenswrapper[5120]: I0316 18:11:47.215277 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_obo-prometheus-operator-admission-webhook-669bcd8dd-zfrnj_71f02692-3bf5-4e19-97a5-e7f79f2c52af/prometheus-operator-admission-webhook/0.log" Mar 16 18:11:47 crc kubenswrapper[5120]: I0316 18:11:47.348491 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_perses-operator-669c9f96b5-m4vlq_395765ab-8a57-4a9d-a0b5-f113e4914594/perses-operator/0.log" Mar 16 18:11:47 crc kubenswrapper[5120]: I0316 18:11:47.361829 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_observability-operator-85c68dddb-zj2rl_4df87e18-229a-409c-8e61-36fc094b6de9/operator/0.log" Mar 16 18:11:48 crc kubenswrapper[5120]: I0316 18:11:48.519292 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-v822j_ac55471d-4e42-475f-a082-50f611571482/kube-multus/0.log" Mar 16 18:11:48 crc kubenswrapper[5120]: I0316 18:11:48.527065 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-crc_9f0bc7fcb0822a2c13eb2d22cd8c0641/kube-controller-manager/0.log" Mar 16 18:11:48 crc kubenswrapper[5120]: I0316 18:11:48.803790 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-v822j_ac55471d-4e42-475f-a082-50f611571482/kube-multus/0.log" Mar 16 18:11:48 crc kubenswrapper[5120]: I0316 18:11:48.809313 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-crc_9f0bc7fcb0822a2c13eb2d22cd8c0641/kube-controller-manager/0.log" Mar 16 18:11:52 crc kubenswrapper[5120]: I0316 18:11:52.008483 5120 patch_prober.go:28] interesting pod/machine-config-daemon-7bf76 container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 18:11:52 crc kubenswrapper[5120]: I0316 18:11:52.008914 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 18:11:52 crc kubenswrapper[5120]: I0316 18:11:52.008969 5120 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" Mar 16 18:11:52 crc kubenswrapper[5120]: I0316 18:11:52.009692 5120 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="machine-config-daemon" containerStatusID={"Type":"cri-o","ID":"0bc706326dac8b83055559df8e8f05a839bf45e2e38c5788a669089c8a5708f7"} pod="openshift-machine-config-operator/machine-config-daemon-7bf76" containerMessage="Container machine-config-daemon failed liveness probe, will be restarted" Mar 16 18:11:52 crc kubenswrapper[5120]: I0316 18:11:52.009750 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" containerID="cri-o://0bc706326dac8b83055559df8e8f05a839bf45e2e38c5788a669089c8a5708f7" gracePeriod=600 Mar 16 18:11:52 crc kubenswrapper[5120]: I0316 18:11:52.153560 5120 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Mar 16 18:11:52 crc kubenswrapper[5120]: I0316 18:11:52.934970 5120 generic.go:358] "Generic (PLEG): container finished" podID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerID="0bc706326dac8b83055559df8e8f05a839bf45e2e38c5788a669089c8a5708f7" exitCode=0 Mar 16 18:11:52 crc kubenswrapper[5120]: I0316 18:11:52.935108 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" event={"ID":"e2275cb4-4905-4d66-a87e-8010120db2bd","Type":"ContainerDied","Data":"0bc706326dac8b83055559df8e8f05a839bf45e2e38c5788a669089c8a5708f7"} Mar 16 18:11:52 crc kubenswrapper[5120]: I0316 18:11:52.935895 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" event={"ID":"e2275cb4-4905-4d66-a87e-8010120db2bd","Type":"ContainerStarted","Data":"f46f7389db7e312fd9565c65ada72cf5a849906f210a5db0befeb36862170522"} Mar 16 18:11:52 crc kubenswrapper[5120]: I0316 18:11:52.935941 5120 scope.go:117] "RemoveContainer" containerID="fa578cadb98a23319854b9fc54966313bbc1cee64f90cc75e1f951be3cb08e36" Mar 16 18:12:00 crc kubenswrapper[5120]: I0316 18:12:00.145172 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-infra/auto-csr-approver-29561412-72t8b"] Mar 16 18:12:00 crc kubenswrapper[5120]: I0316 18:12:00.147133 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2aa59e9-8b03-4903-9990-c7e6b111acfb" containerName="oc" Mar 16 18:12:00 crc kubenswrapper[5120]: I0316 18:12:00.147156 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2aa59e9-8b03-4903-9990-c7e6b111acfb" containerName="oc" Mar 16 18:12:00 crc kubenswrapper[5120]: I0316 18:12:00.147353 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="c2aa59e9-8b03-4903-9990-c7e6b111acfb" containerName="oc" Mar 16 18:12:00 crc kubenswrapper[5120]: I0316 18:12:00.154820 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561412-72t8b"] Mar 16 18:12:00 crc kubenswrapper[5120]: I0316 18:12:00.154966 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561412-72t8b" Mar 16 18:12:00 crc kubenswrapper[5120]: I0316 18:12:00.166345 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-infra\"/\"csr-approver-sa-dockercfg-x2nsz\"" Mar 16 18:12:00 crc kubenswrapper[5120]: I0316 18:12:00.166644 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"kube-root-ca.crt\"" Mar 16 18:12:00 crc kubenswrapper[5120]: I0316 18:12:00.166977 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"openshift-service-ca.crt\"" Mar 16 18:12:00 crc kubenswrapper[5120]: I0316 18:12:00.331684 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tk5h6\" (UniqueName: \"kubernetes.io/projected/7c86d669-c515-4e95-bf8a-7bc437fc7619-kube-api-access-tk5h6\") pod \"auto-csr-approver-29561412-72t8b\" (UID: \"7c86d669-c515-4e95-bf8a-7bc437fc7619\") " pod="openshift-infra/auto-csr-approver-29561412-72t8b" Mar 16 18:12:00 crc kubenswrapper[5120]: I0316 18:12:00.433926 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tk5h6\" (UniqueName: \"kubernetes.io/projected/7c86d669-c515-4e95-bf8a-7bc437fc7619-kube-api-access-tk5h6\") pod \"auto-csr-approver-29561412-72t8b\" (UID: \"7c86d669-c515-4e95-bf8a-7bc437fc7619\") " pod="openshift-infra/auto-csr-approver-29561412-72t8b" Mar 16 18:12:00 crc kubenswrapper[5120]: I0316 18:12:00.465890 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tk5h6\" (UniqueName: \"kubernetes.io/projected/7c86d669-c515-4e95-bf8a-7bc437fc7619-kube-api-access-tk5h6\") pod \"auto-csr-approver-29561412-72t8b\" (UID: \"7c86d669-c515-4e95-bf8a-7bc437fc7619\") " pod="openshift-infra/auto-csr-approver-29561412-72t8b" Mar 16 18:12:00 crc kubenswrapper[5120]: I0316 18:12:00.484029 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561412-72t8b" Mar 16 18:12:00 crc kubenswrapper[5120]: I0316 18:12:00.712835 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561412-72t8b"] Mar 16 18:12:01 crc kubenswrapper[5120]: I0316 18:12:01.001910 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561412-72t8b" event={"ID":"7c86d669-c515-4e95-bf8a-7bc437fc7619","Type":"ContainerStarted","Data":"5c17fbaca9bdeac9b9e0f9be8148b654b2e3683d5a4eed69ffd51573123b74b2"} Mar 16 18:12:02 crc kubenswrapper[5120]: I0316 18:12:02.010671 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561412-72t8b" event={"ID":"7c86d669-c515-4e95-bf8a-7bc437fc7619","Type":"ContainerStarted","Data":"5fda2bd36d8e8b7e7e9576c832ece842c214efa336e6b9c1443454ed27496708"} Mar 16 18:12:02 crc kubenswrapper[5120]: I0316 18:12:02.022794 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-infra/auto-csr-approver-29561412-72t8b" podStartSLOduration=1.215572348 podStartE2EDuration="2.022753257s" podCreationTimestamp="2026-03-16 18:12:00 +0000 UTC" firstStartedPulling="2026-03-16 18:12:00.718137812 +0000 UTC m=+9622.872069469" lastFinishedPulling="2026-03-16 18:12:01.525318711 +0000 UTC m=+9623.679250378" observedRunningTime="2026-03-16 18:12:02.021289797 +0000 UTC m=+9624.175221454" watchObservedRunningTime="2026-03-16 18:12:02.022753257 +0000 UTC m=+9624.176684914" Mar 16 18:12:03 crc kubenswrapper[5120]: I0316 18:12:03.026519 5120 generic.go:358] "Generic (PLEG): container finished" podID="7c86d669-c515-4e95-bf8a-7bc437fc7619" containerID="5fda2bd36d8e8b7e7e9576c832ece842c214efa336e6b9c1443454ed27496708" exitCode=0 Mar 16 18:12:03 crc kubenswrapper[5120]: I0316 18:12:03.026609 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561412-72t8b" event={"ID":"7c86d669-c515-4e95-bf8a-7bc437fc7619","Type":"ContainerDied","Data":"5fda2bd36d8e8b7e7e9576c832ece842c214efa336e6b9c1443454ed27496708"} Mar 16 18:12:04 crc kubenswrapper[5120]: I0316 18:12:04.332752 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561412-72t8b" Mar 16 18:12:04 crc kubenswrapper[5120]: I0316 18:12:04.460918 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tk5h6\" (UniqueName: \"kubernetes.io/projected/7c86d669-c515-4e95-bf8a-7bc437fc7619-kube-api-access-tk5h6\") pod \"7c86d669-c515-4e95-bf8a-7bc437fc7619\" (UID: \"7c86d669-c515-4e95-bf8a-7bc437fc7619\") " Mar 16 18:12:04 crc kubenswrapper[5120]: I0316 18:12:04.470512 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c86d669-c515-4e95-bf8a-7bc437fc7619-kube-api-access-tk5h6" (OuterVolumeSpecName: "kube-api-access-tk5h6") pod "7c86d669-c515-4e95-bf8a-7bc437fc7619" (UID: "7c86d669-c515-4e95-bf8a-7bc437fc7619"). InnerVolumeSpecName "kube-api-access-tk5h6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 18:12:04 crc kubenswrapper[5120]: I0316 18:12:04.565229 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tk5h6\" (UniqueName: \"kubernetes.io/projected/7c86d669-c515-4e95-bf8a-7bc437fc7619-kube-api-access-tk5h6\") on node \"crc\" DevicePath \"\"" Mar 16 18:12:05 crc kubenswrapper[5120]: I0316 18:12:05.096407 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561412-72t8b" event={"ID":"7c86d669-c515-4e95-bf8a-7bc437fc7619","Type":"ContainerDied","Data":"5c17fbaca9bdeac9b9e0f9be8148b654b2e3683d5a4eed69ffd51573123b74b2"} Mar 16 18:12:05 crc kubenswrapper[5120]: I0316 18:12:05.096731 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5c17fbaca9bdeac9b9e0f9be8148b654b2e3683d5a4eed69ffd51573123b74b2" Mar 16 18:12:05 crc kubenswrapper[5120]: I0316 18:12:05.096434 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561412-72t8b" Mar 16 18:12:05 crc kubenswrapper[5120]: I0316 18:12:05.117543 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-infra/auto-csr-approver-29561406-xmmsl"] Mar 16 18:12:05 crc kubenswrapper[5120]: I0316 18:12:05.124404 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-infra/auto-csr-approver-29561406-xmmsl"] Mar 16 18:12:06 crc kubenswrapper[5120]: I0316 18:12:06.677675 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="521a921f-4ca5-4634-b7a6-030b1e2a0cf1" path="/var/lib/kubelet/pods/521a921f-4ca5-4634-b7a6-030b1e2a0cf1/volumes" Mar 16 18:12:07 crc kubenswrapper[5120]: E0316 18:12:07.488655 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=886425 actualBytes=10240 Mar 16 18:12:40 crc kubenswrapper[5120]: I0316 18:12:40.118690 5120 scope.go:117] "RemoveContainer" containerID="3f6b8f1b718200867d048414e097b5b802d2f76893217d5f42f4325e61faed9f" Mar 16 18:12:52 crc kubenswrapper[5120]: I0316 18:12:52.499291 5120 generic.go:358] "Generic (PLEG): container finished" podID="414efc23-a216-483c-8b87-bcad5ca5820c" containerID="c223d1a9366c13a8ae4bf389abb0d2066486d64cd7055ab78ae50c31e1d7e6b5" exitCode=0 Mar 16 18:12:52 crc kubenswrapper[5120]: I0316 18:12:52.499422 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qkltq/must-gather-qb88w" event={"ID":"414efc23-a216-483c-8b87-bcad5ca5820c","Type":"ContainerDied","Data":"c223d1a9366c13a8ae4bf389abb0d2066486d64cd7055ab78ae50c31e1d7e6b5"} Mar 16 18:12:52 crc kubenswrapper[5120]: I0316 18:12:52.500335 5120 scope.go:117] "RemoveContainer" containerID="c223d1a9366c13a8ae4bf389abb0d2066486d64cd7055ab78ae50c31e1d7e6b5" Mar 16 18:12:53 crc kubenswrapper[5120]: I0316 18:12:53.410905 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-qkltq_must-gather-qb88w_414efc23-a216-483c-8b87-bcad5ca5820c/gather/0.log" Mar 16 18:13:00 crc kubenswrapper[5120]: I0316 18:13:00.292534 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-qkltq/must-gather-qb88w"] Mar 16 18:13:00 crc kubenswrapper[5120]: I0316 18:13:00.293708 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-must-gather-qkltq/must-gather-qb88w" podUID="414efc23-a216-483c-8b87-bcad5ca5820c" containerName="copy" containerID="cri-o://413e9950397c3ae5988698891dbabe8bfa3b3a91801f536d0fe5fa7c7ad6e0b9" gracePeriod=2 Mar 16 18:13:00 crc kubenswrapper[5120]: I0316 18:13:00.297051 5120 status_manager.go:895] "Failed to get status for pod" podUID="414efc23-a216-483c-8b87-bcad5ca5820c" pod="openshift-must-gather-qkltq/must-gather-qb88w" err="pods \"must-gather-qb88w\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-qkltq\": no relationship found between node 'crc' and this object" Mar 16 18:13:00 crc kubenswrapper[5120]: I0316 18:13:00.301481 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-qkltq/must-gather-qb88w"] Mar 16 18:13:00 crc kubenswrapper[5120]: E0316 18:13:00.455215 5120 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod414efc23_a216_483c_8b87_bcad5ca5820c.slice/crio-413e9950397c3ae5988698891dbabe8bfa3b3a91801f536d0fe5fa7c7ad6e0b9.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod414efc23_a216_483c_8b87_bcad5ca5820c.slice/crio-conmon-413e9950397c3ae5988698891dbabe8bfa3b3a91801f536d0fe5fa7c7ad6e0b9.scope\": RecentStats: unable to find data in memory cache]" Mar 16 18:13:00 crc kubenswrapper[5120]: I0316 18:13:00.573925 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-qkltq_must-gather-qb88w_414efc23-a216-483c-8b87-bcad5ca5820c/copy/0.log" Mar 16 18:13:00 crc kubenswrapper[5120]: I0316 18:13:00.575368 5120 generic.go:358] "Generic (PLEG): container finished" podID="414efc23-a216-483c-8b87-bcad5ca5820c" containerID="413e9950397c3ae5988698891dbabe8bfa3b3a91801f536d0fe5fa7c7ad6e0b9" exitCode=143 Mar 16 18:13:00 crc kubenswrapper[5120]: I0316 18:13:00.723837 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-qkltq_must-gather-qb88w_414efc23-a216-483c-8b87-bcad5ca5820c/copy/0.log" Mar 16 18:13:00 crc kubenswrapper[5120]: I0316 18:13:00.724533 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qkltq/must-gather-qb88w" Mar 16 18:13:00 crc kubenswrapper[5120]: I0316 18:13:00.824647 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jvlkv\" (UniqueName: \"kubernetes.io/projected/414efc23-a216-483c-8b87-bcad5ca5820c-kube-api-access-jvlkv\") pod \"414efc23-a216-483c-8b87-bcad5ca5820c\" (UID: \"414efc23-a216-483c-8b87-bcad5ca5820c\") " Mar 16 18:13:00 crc kubenswrapper[5120]: I0316 18:13:00.825183 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/414efc23-a216-483c-8b87-bcad5ca5820c-must-gather-output\") pod \"414efc23-a216-483c-8b87-bcad5ca5820c\" (UID: \"414efc23-a216-483c-8b87-bcad5ca5820c\") " Mar 16 18:13:00 crc kubenswrapper[5120]: I0316 18:13:00.831471 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/414efc23-a216-483c-8b87-bcad5ca5820c-kube-api-access-jvlkv" (OuterVolumeSpecName: "kube-api-access-jvlkv") pod "414efc23-a216-483c-8b87-bcad5ca5820c" (UID: "414efc23-a216-483c-8b87-bcad5ca5820c"). InnerVolumeSpecName "kube-api-access-jvlkv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 18:13:00 crc kubenswrapper[5120]: I0316 18:13:00.925403 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/414efc23-a216-483c-8b87-bcad5ca5820c-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "414efc23-a216-483c-8b87-bcad5ca5820c" (UID: "414efc23-a216-483c-8b87-bcad5ca5820c"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 18:13:00 crc kubenswrapper[5120]: I0316 18:13:00.927550 5120 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/414efc23-a216-483c-8b87-bcad5ca5820c-must-gather-output\") on node \"crc\" DevicePath \"\"" Mar 16 18:13:00 crc kubenswrapper[5120]: I0316 18:13:00.927671 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jvlkv\" (UniqueName: \"kubernetes.io/projected/414efc23-a216-483c-8b87-bcad5ca5820c-kube-api-access-jvlkv\") on node \"crc\" DevicePath \"\"" Mar 16 18:13:01 crc kubenswrapper[5120]: I0316 18:13:01.583921 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-qkltq_must-gather-qb88w_414efc23-a216-483c-8b87-bcad5ca5820c/copy/0.log" Mar 16 18:13:01 crc kubenswrapper[5120]: I0316 18:13:01.584874 5120 scope.go:117] "RemoveContainer" containerID="413e9950397c3ae5988698891dbabe8bfa3b3a91801f536d0fe5fa7c7ad6e0b9" Mar 16 18:13:01 crc kubenswrapper[5120]: I0316 18:13:01.585006 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qkltq/must-gather-qb88w" Mar 16 18:13:01 crc kubenswrapper[5120]: I0316 18:13:01.604504 5120 scope.go:117] "RemoveContainer" containerID="c223d1a9366c13a8ae4bf389abb0d2066486d64cd7055ab78ae50c31e1d7e6b5" Mar 16 18:13:02 crc kubenswrapper[5120]: I0316 18:13:02.671178 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="414efc23-a216-483c-8b87-bcad5ca5820c" path="/var/lib/kubelet/pods/414efc23-a216-483c-8b87-bcad5ca5820c/volumes" Mar 16 18:13:07 crc kubenswrapper[5120]: E0316 18:13:07.740648 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=849699 actualBytes=10240 Mar 16 18:13:40 crc kubenswrapper[5120]: I0316 18:13:40.242825 5120 scope.go:117] "RemoveContainer" containerID="4121c40fdebf6776ff3ac122118a65e6c7574440ac7ddf068a8b1bf69ef82b95" Mar 16 18:13:40 crc kubenswrapper[5120]: I0316 18:13:40.444818 5120 scope.go:117] "RemoveContainer" containerID="825f5c87b719b27e2a4fceaa6d646c2e83146755b8def2a0dddac0bedf387ac4" Mar 16 18:13:52 crc kubenswrapper[5120]: I0316 18:13:52.008626 5120 patch_prober.go:28] interesting pod/machine-config-daemon-7bf76 container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 18:13:52 crc kubenswrapper[5120]: I0316 18:13:52.010149 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 18:14:00 crc kubenswrapper[5120]: I0316 18:14:00.139675 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-infra/auto-csr-approver-29561414-jzjft"] Mar 16 18:14:00 crc kubenswrapper[5120]: I0316 18:14:00.141067 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="414efc23-a216-483c-8b87-bcad5ca5820c" containerName="gather" Mar 16 18:14:00 crc kubenswrapper[5120]: I0316 18:14:00.141085 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="414efc23-a216-483c-8b87-bcad5ca5820c" containerName="gather" Mar 16 18:14:00 crc kubenswrapper[5120]: I0316 18:14:00.141102 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="414efc23-a216-483c-8b87-bcad5ca5820c" containerName="copy" Mar 16 18:14:00 crc kubenswrapper[5120]: I0316 18:14:00.141109 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="414efc23-a216-483c-8b87-bcad5ca5820c" containerName="copy" Mar 16 18:14:00 crc kubenswrapper[5120]: I0316 18:14:00.141115 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c86d669-c515-4e95-bf8a-7bc437fc7619" containerName="oc" Mar 16 18:14:00 crc kubenswrapper[5120]: I0316 18:14:00.141122 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c86d669-c515-4e95-bf8a-7bc437fc7619" containerName="oc" Mar 16 18:14:00 crc kubenswrapper[5120]: I0316 18:14:00.141240 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="414efc23-a216-483c-8b87-bcad5ca5820c" containerName="gather" Mar 16 18:14:00 crc kubenswrapper[5120]: I0316 18:14:00.141254 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="7c86d669-c515-4e95-bf8a-7bc437fc7619" containerName="oc" Mar 16 18:14:00 crc kubenswrapper[5120]: I0316 18:14:00.141265 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="414efc23-a216-483c-8b87-bcad5ca5820c" containerName="copy" Mar 16 18:14:00 crc kubenswrapper[5120]: I0316 18:14:00.146329 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561414-jzjft" Mar 16 18:14:00 crc kubenswrapper[5120]: I0316 18:14:00.149440 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"openshift-service-ca.crt\"" Mar 16 18:14:00 crc kubenswrapper[5120]: I0316 18:14:00.149498 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-infra\"/\"csr-approver-sa-dockercfg-x2nsz\"" Mar 16 18:14:00 crc kubenswrapper[5120]: I0316 18:14:00.149590 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"kube-root-ca.crt\"" Mar 16 18:14:00 crc kubenswrapper[5120]: I0316 18:14:00.160156 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561414-jzjft"] Mar 16 18:14:00 crc kubenswrapper[5120]: I0316 18:14:00.208320 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8vns\" (UniqueName: \"kubernetes.io/projected/94384423-f84d-4ea8-9b68-7d8655d164bc-kube-api-access-d8vns\") pod \"auto-csr-approver-29561414-jzjft\" (UID: \"94384423-f84d-4ea8-9b68-7d8655d164bc\") " pod="openshift-infra/auto-csr-approver-29561414-jzjft" Mar 16 18:14:00 crc kubenswrapper[5120]: I0316 18:14:00.310399 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d8vns\" (UniqueName: \"kubernetes.io/projected/94384423-f84d-4ea8-9b68-7d8655d164bc-kube-api-access-d8vns\") pod \"auto-csr-approver-29561414-jzjft\" (UID: \"94384423-f84d-4ea8-9b68-7d8655d164bc\") " pod="openshift-infra/auto-csr-approver-29561414-jzjft" Mar 16 18:14:00 crc kubenswrapper[5120]: I0316 18:14:00.329555 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8vns\" (UniqueName: \"kubernetes.io/projected/94384423-f84d-4ea8-9b68-7d8655d164bc-kube-api-access-d8vns\") pod \"auto-csr-approver-29561414-jzjft\" (UID: \"94384423-f84d-4ea8-9b68-7d8655d164bc\") " pod="openshift-infra/auto-csr-approver-29561414-jzjft" Mar 16 18:14:00 crc kubenswrapper[5120]: I0316 18:14:00.474580 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561414-jzjft" Mar 16 18:14:00 crc kubenswrapper[5120]: I0316 18:14:00.901997 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561414-jzjft"] Mar 16 18:14:01 crc kubenswrapper[5120]: I0316 18:14:01.110045 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561414-jzjft" event={"ID":"94384423-f84d-4ea8-9b68-7d8655d164bc","Type":"ContainerStarted","Data":"2bac685bd0fff6a95a0166a3dc21ea9a898902a3220c48184a7c8483bbfaf23d"} Mar 16 18:14:03 crc kubenswrapper[5120]: I0316 18:14:03.128154 5120 generic.go:358] "Generic (PLEG): container finished" podID="94384423-f84d-4ea8-9b68-7d8655d164bc" containerID="280335e4086ffa3b9721c844ba616a66f1261b7bca0b7cd65e60c1bb17c6527a" exitCode=0 Mar 16 18:14:03 crc kubenswrapper[5120]: I0316 18:14:03.128245 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561414-jzjft" event={"ID":"94384423-f84d-4ea8-9b68-7d8655d164bc","Type":"ContainerDied","Data":"280335e4086ffa3b9721c844ba616a66f1261b7bca0b7cd65e60c1bb17c6527a"} Mar 16 18:14:03 crc kubenswrapper[5120]: I0316 18:14:03.739646 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/certified-operators-wfnkr"] Mar 16 18:14:03 crc kubenswrapper[5120]: I0316 18:14:03.746212 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-wfnkr" Mar 16 18:14:03 crc kubenswrapper[5120]: I0316 18:14:03.747561 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/certified-operators-wfnkr"] Mar 16 18:14:03 crc kubenswrapper[5120]: I0316 18:14:03.893834 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9fsmw\" (UniqueName: \"kubernetes.io/projected/78493587-677f-4f79-95fe-26de6febb8d7-kube-api-access-9fsmw\") pod \"certified-operators-wfnkr\" (UID: \"78493587-677f-4f79-95fe-26de6febb8d7\") " pod="openshift-marketplace/certified-operators-wfnkr" Mar 16 18:14:03 crc kubenswrapper[5120]: I0316 18:14:03.893998 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/78493587-677f-4f79-95fe-26de6febb8d7-catalog-content\") pod \"certified-operators-wfnkr\" (UID: \"78493587-677f-4f79-95fe-26de6febb8d7\") " pod="openshift-marketplace/certified-operators-wfnkr" Mar 16 18:14:03 crc kubenswrapper[5120]: I0316 18:14:03.894140 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/78493587-677f-4f79-95fe-26de6febb8d7-utilities\") pod \"certified-operators-wfnkr\" (UID: \"78493587-677f-4f79-95fe-26de6febb8d7\") " pod="openshift-marketplace/certified-operators-wfnkr" Mar 16 18:14:03 crc kubenswrapper[5120]: I0316 18:14:03.996272 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/78493587-677f-4f79-95fe-26de6febb8d7-catalog-content\") pod \"certified-operators-wfnkr\" (UID: \"78493587-677f-4f79-95fe-26de6febb8d7\") " pod="openshift-marketplace/certified-operators-wfnkr" Mar 16 18:14:03 crc kubenswrapper[5120]: I0316 18:14:03.996856 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/78493587-677f-4f79-95fe-26de6febb8d7-utilities\") pod \"certified-operators-wfnkr\" (UID: \"78493587-677f-4f79-95fe-26de6febb8d7\") " pod="openshift-marketplace/certified-operators-wfnkr" Mar 16 18:14:03 crc kubenswrapper[5120]: I0316 18:14:03.997141 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9fsmw\" (UniqueName: \"kubernetes.io/projected/78493587-677f-4f79-95fe-26de6febb8d7-kube-api-access-9fsmw\") pod \"certified-operators-wfnkr\" (UID: \"78493587-677f-4f79-95fe-26de6febb8d7\") " pod="openshift-marketplace/certified-operators-wfnkr" Mar 16 18:14:03 crc kubenswrapper[5120]: I0316 18:14:03.997279 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/78493587-677f-4f79-95fe-26de6febb8d7-utilities\") pod \"certified-operators-wfnkr\" (UID: \"78493587-677f-4f79-95fe-26de6febb8d7\") " pod="openshift-marketplace/certified-operators-wfnkr" Mar 16 18:14:03 crc kubenswrapper[5120]: I0316 18:14:03.997640 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/78493587-677f-4f79-95fe-26de6febb8d7-catalog-content\") pod \"certified-operators-wfnkr\" (UID: \"78493587-677f-4f79-95fe-26de6febb8d7\") " pod="openshift-marketplace/certified-operators-wfnkr" Mar 16 18:14:04 crc kubenswrapper[5120]: I0316 18:14:04.021740 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9fsmw\" (UniqueName: \"kubernetes.io/projected/78493587-677f-4f79-95fe-26de6febb8d7-kube-api-access-9fsmw\") pod \"certified-operators-wfnkr\" (UID: \"78493587-677f-4f79-95fe-26de6febb8d7\") " pod="openshift-marketplace/certified-operators-wfnkr" Mar 16 18:14:04 crc kubenswrapper[5120]: I0316 18:14:04.074234 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-wfnkr" Mar 16 18:14:04 crc kubenswrapper[5120]: I0316 18:14:04.403629 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561414-jzjft" Mar 16 18:14:04 crc kubenswrapper[5120]: I0316 18:14:04.508347 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d8vns\" (UniqueName: \"kubernetes.io/projected/94384423-f84d-4ea8-9b68-7d8655d164bc-kube-api-access-d8vns\") pod \"94384423-f84d-4ea8-9b68-7d8655d164bc\" (UID: \"94384423-f84d-4ea8-9b68-7d8655d164bc\") " Mar 16 18:14:04 crc kubenswrapper[5120]: I0316 18:14:04.514000 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94384423-f84d-4ea8-9b68-7d8655d164bc-kube-api-access-d8vns" (OuterVolumeSpecName: "kube-api-access-d8vns") pod "94384423-f84d-4ea8-9b68-7d8655d164bc" (UID: "94384423-f84d-4ea8-9b68-7d8655d164bc"). InnerVolumeSpecName "kube-api-access-d8vns". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 18:14:04 crc kubenswrapper[5120]: I0316 18:14:04.562668 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/certified-operators-wfnkr"] Mar 16 18:14:04 crc kubenswrapper[5120]: W0316 18:14:04.569043 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78493587_677f_4f79_95fe_26de6febb8d7.slice/crio-d7d8bed3b2ee568033fb032a10ce8045db4d090e4d0fd46f0d9e0f6412505ee6 WatchSource:0}: Error finding container d7d8bed3b2ee568033fb032a10ce8045db4d090e4d0fd46f0d9e0f6412505ee6: Status 404 returned error can't find the container with id d7d8bed3b2ee568033fb032a10ce8045db4d090e4d0fd46f0d9e0f6412505ee6 Mar 16 18:14:04 crc kubenswrapper[5120]: I0316 18:14:04.610784 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d8vns\" (UniqueName: \"kubernetes.io/projected/94384423-f84d-4ea8-9b68-7d8655d164bc-kube-api-access-d8vns\") on node \"crc\" DevicePath \"\"" Mar 16 18:14:05 crc kubenswrapper[5120]: I0316 18:14:05.145621 5120 generic.go:358] "Generic (PLEG): container finished" podID="78493587-677f-4f79-95fe-26de6febb8d7" containerID="f0b042735cb3ee413213d1c75e3ca9845498f61d4a3b18e1220d0eefecbfee35" exitCode=0 Mar 16 18:14:05 crc kubenswrapper[5120]: I0316 18:14:05.145680 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-wfnkr" event={"ID":"78493587-677f-4f79-95fe-26de6febb8d7","Type":"ContainerDied","Data":"f0b042735cb3ee413213d1c75e3ca9845498f61d4a3b18e1220d0eefecbfee35"} Mar 16 18:14:05 crc kubenswrapper[5120]: I0316 18:14:05.146222 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-wfnkr" event={"ID":"78493587-677f-4f79-95fe-26de6febb8d7","Type":"ContainerStarted","Data":"d7d8bed3b2ee568033fb032a10ce8045db4d090e4d0fd46f0d9e0f6412505ee6"} Mar 16 18:14:05 crc kubenswrapper[5120]: I0316 18:14:05.151914 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561414-jzjft" Mar 16 18:14:05 crc kubenswrapper[5120]: I0316 18:14:05.151933 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561414-jzjft" event={"ID":"94384423-f84d-4ea8-9b68-7d8655d164bc","Type":"ContainerDied","Data":"2bac685bd0fff6a95a0166a3dc21ea9a898902a3220c48184a7c8483bbfaf23d"} Mar 16 18:14:05 crc kubenswrapper[5120]: I0316 18:14:05.151986 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2bac685bd0fff6a95a0166a3dc21ea9a898902a3220c48184a7c8483bbfaf23d" Mar 16 18:14:05 crc kubenswrapper[5120]: I0316 18:14:05.465022 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-infra/auto-csr-approver-29561408-vrdqs"] Mar 16 18:14:05 crc kubenswrapper[5120]: I0316 18:14:05.469665 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-infra/auto-csr-approver-29561408-vrdqs"] Mar 16 18:14:06 crc kubenswrapper[5120]: I0316 18:14:06.674597 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5874c8fe-7ba8-4ef0-8791-a3bc34fd1167" path="/var/lib/kubelet/pods/5874c8fe-7ba8-4ef0-8791-a3bc34fd1167/volumes" Mar 16 18:14:07 crc kubenswrapper[5120]: E0316 18:14:07.154002 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=885168 actualBytes=10240 Mar 16 18:14:07 crc kubenswrapper[5120]: I0316 18:14:07.166708 5120 generic.go:358] "Generic (PLEG): container finished" podID="78493587-677f-4f79-95fe-26de6febb8d7" containerID="9320518270e05c6869a73164e74d33502176830596d93724ff7dc226b13a9a94" exitCode=0 Mar 16 18:14:07 crc kubenswrapper[5120]: I0316 18:14:07.166819 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-wfnkr" event={"ID":"78493587-677f-4f79-95fe-26de6febb8d7","Type":"ContainerDied","Data":"9320518270e05c6869a73164e74d33502176830596d93724ff7dc226b13a9a94"} Mar 16 18:14:08 crc kubenswrapper[5120]: I0316 18:14:08.177622 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-wfnkr" event={"ID":"78493587-677f-4f79-95fe-26de6febb8d7","Type":"ContainerStarted","Data":"5771f6a6c404280efb670eecf494fcf687543037e99388dc27fe23244e7e6b6f"} Mar 16 18:14:08 crc kubenswrapper[5120]: I0316 18:14:08.201541 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/certified-operators-wfnkr" podStartSLOduration=4.215390096 podStartE2EDuration="5.201517539s" podCreationTimestamp="2026-03-16 18:14:03 +0000 UTC" firstStartedPulling="2026-03-16 18:14:05.147334306 +0000 UTC m=+9747.301266003" lastFinishedPulling="2026-03-16 18:14:06.133461779 +0000 UTC m=+9748.287393446" observedRunningTime="2026-03-16 18:14:08.198576129 +0000 UTC m=+9750.352507796" watchObservedRunningTime="2026-03-16 18:14:08.201517539 +0000 UTC m=+9750.355449196" Mar 16 18:14:14 crc kubenswrapper[5120]: I0316 18:14:14.075927 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-marketplace/certified-operators-wfnkr" Mar 16 18:14:14 crc kubenswrapper[5120]: I0316 18:14:14.076552 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/certified-operators-wfnkr" Mar 16 18:14:14 crc kubenswrapper[5120]: I0316 18:14:14.122611 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/certified-operators-wfnkr" Mar 16 18:14:14 crc kubenswrapper[5120]: I0316 18:14:14.272718 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/certified-operators-wfnkr" Mar 16 18:14:14 crc kubenswrapper[5120]: I0316 18:14:14.349872 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/certified-operators-wfnkr"] Mar 16 18:14:16 crc kubenswrapper[5120]: I0316 18:14:16.266553 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-marketplace/certified-operators-wfnkr" podUID="78493587-677f-4f79-95fe-26de6febb8d7" containerName="registry-server" containerID="cri-o://5771f6a6c404280efb670eecf494fcf687543037e99388dc27fe23244e7e6b6f" gracePeriod=2 Mar 16 18:14:16 crc kubenswrapper[5120]: I0316 18:14:16.660641 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-wfnkr" Mar 16 18:14:16 crc kubenswrapper[5120]: I0316 18:14:16.709340 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/78493587-677f-4f79-95fe-26de6febb8d7-utilities\") pod \"78493587-677f-4f79-95fe-26de6febb8d7\" (UID: \"78493587-677f-4f79-95fe-26de6febb8d7\") " Mar 16 18:14:16 crc kubenswrapper[5120]: I0316 18:14:16.709903 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/78493587-677f-4f79-95fe-26de6febb8d7-catalog-content\") pod \"78493587-677f-4f79-95fe-26de6febb8d7\" (UID: \"78493587-677f-4f79-95fe-26de6febb8d7\") " Mar 16 18:14:16 crc kubenswrapper[5120]: I0316 18:14:16.710003 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9fsmw\" (UniqueName: \"kubernetes.io/projected/78493587-677f-4f79-95fe-26de6febb8d7-kube-api-access-9fsmw\") pod \"78493587-677f-4f79-95fe-26de6febb8d7\" (UID: \"78493587-677f-4f79-95fe-26de6febb8d7\") " Mar 16 18:14:16 crc kubenswrapper[5120]: I0316 18:14:16.710748 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/78493587-677f-4f79-95fe-26de6febb8d7-utilities" (OuterVolumeSpecName: "utilities") pod "78493587-677f-4f79-95fe-26de6febb8d7" (UID: "78493587-677f-4f79-95fe-26de6febb8d7"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 18:14:16 crc kubenswrapper[5120]: I0316 18:14:16.716541 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/78493587-677f-4f79-95fe-26de6febb8d7-kube-api-access-9fsmw" (OuterVolumeSpecName: "kube-api-access-9fsmw") pod "78493587-677f-4f79-95fe-26de6febb8d7" (UID: "78493587-677f-4f79-95fe-26de6febb8d7"). InnerVolumeSpecName "kube-api-access-9fsmw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 18:14:16 crc kubenswrapper[5120]: I0316 18:14:16.742460 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/78493587-677f-4f79-95fe-26de6febb8d7-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "78493587-677f-4f79-95fe-26de6febb8d7" (UID: "78493587-677f-4f79-95fe-26de6febb8d7"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 18:14:16 crc kubenswrapper[5120]: I0316 18:14:16.812546 5120 reconciler_common.go:299] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/78493587-677f-4f79-95fe-26de6febb8d7-catalog-content\") on node \"crc\" DevicePath \"\"" Mar 16 18:14:16 crc kubenswrapper[5120]: I0316 18:14:16.812596 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9fsmw\" (UniqueName: \"kubernetes.io/projected/78493587-677f-4f79-95fe-26de6febb8d7-kube-api-access-9fsmw\") on node \"crc\" DevicePath \"\"" Mar 16 18:14:16 crc kubenswrapper[5120]: I0316 18:14:16.812609 5120 reconciler_common.go:299] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/78493587-677f-4f79-95fe-26de6febb8d7-utilities\") on node \"crc\" DevicePath \"\"" Mar 16 18:14:17 crc kubenswrapper[5120]: I0316 18:14:17.275154 5120 generic.go:358] "Generic (PLEG): container finished" podID="78493587-677f-4f79-95fe-26de6febb8d7" containerID="5771f6a6c404280efb670eecf494fcf687543037e99388dc27fe23244e7e6b6f" exitCode=0 Mar 16 18:14:17 crc kubenswrapper[5120]: I0316 18:14:17.275344 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-wfnkr" Mar 16 18:14:17 crc kubenswrapper[5120]: I0316 18:14:17.275375 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-wfnkr" event={"ID":"78493587-677f-4f79-95fe-26de6febb8d7","Type":"ContainerDied","Data":"5771f6a6c404280efb670eecf494fcf687543037e99388dc27fe23244e7e6b6f"} Mar 16 18:14:17 crc kubenswrapper[5120]: I0316 18:14:17.275733 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-wfnkr" event={"ID":"78493587-677f-4f79-95fe-26de6febb8d7","Type":"ContainerDied","Data":"d7d8bed3b2ee568033fb032a10ce8045db4d090e4d0fd46f0d9e0f6412505ee6"} Mar 16 18:14:17 crc kubenswrapper[5120]: I0316 18:14:17.275804 5120 scope.go:117] "RemoveContainer" containerID="5771f6a6c404280efb670eecf494fcf687543037e99388dc27fe23244e7e6b6f" Mar 16 18:14:17 crc kubenswrapper[5120]: I0316 18:14:17.307678 5120 scope.go:117] "RemoveContainer" containerID="9320518270e05c6869a73164e74d33502176830596d93724ff7dc226b13a9a94" Mar 16 18:14:17 crc kubenswrapper[5120]: I0316 18:14:17.316168 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/certified-operators-wfnkr"] Mar 16 18:14:17 crc kubenswrapper[5120]: I0316 18:14:17.320794 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/certified-operators-wfnkr"] Mar 16 18:14:17 crc kubenswrapper[5120]: I0316 18:14:17.336359 5120 scope.go:117] "RemoveContainer" containerID="f0b042735cb3ee413213d1c75e3ca9845498f61d4a3b18e1220d0eefecbfee35" Mar 16 18:14:17 crc kubenswrapper[5120]: I0316 18:14:17.360458 5120 scope.go:117] "RemoveContainer" containerID="5771f6a6c404280efb670eecf494fcf687543037e99388dc27fe23244e7e6b6f" Mar 16 18:14:17 crc kubenswrapper[5120]: E0316 18:14:17.361208 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5771f6a6c404280efb670eecf494fcf687543037e99388dc27fe23244e7e6b6f\": container with ID starting with 5771f6a6c404280efb670eecf494fcf687543037e99388dc27fe23244e7e6b6f not found: ID does not exist" containerID="5771f6a6c404280efb670eecf494fcf687543037e99388dc27fe23244e7e6b6f" Mar 16 18:14:17 crc kubenswrapper[5120]: I0316 18:14:17.361242 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5771f6a6c404280efb670eecf494fcf687543037e99388dc27fe23244e7e6b6f"} err="failed to get container status \"5771f6a6c404280efb670eecf494fcf687543037e99388dc27fe23244e7e6b6f\": rpc error: code = NotFound desc = could not find container \"5771f6a6c404280efb670eecf494fcf687543037e99388dc27fe23244e7e6b6f\": container with ID starting with 5771f6a6c404280efb670eecf494fcf687543037e99388dc27fe23244e7e6b6f not found: ID does not exist" Mar 16 18:14:17 crc kubenswrapper[5120]: I0316 18:14:17.361261 5120 scope.go:117] "RemoveContainer" containerID="9320518270e05c6869a73164e74d33502176830596d93724ff7dc226b13a9a94" Mar 16 18:14:17 crc kubenswrapper[5120]: E0316 18:14:17.361855 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9320518270e05c6869a73164e74d33502176830596d93724ff7dc226b13a9a94\": container with ID starting with 9320518270e05c6869a73164e74d33502176830596d93724ff7dc226b13a9a94 not found: ID does not exist" containerID="9320518270e05c6869a73164e74d33502176830596d93724ff7dc226b13a9a94" Mar 16 18:14:17 crc kubenswrapper[5120]: I0316 18:14:17.361924 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9320518270e05c6869a73164e74d33502176830596d93724ff7dc226b13a9a94"} err="failed to get container status \"9320518270e05c6869a73164e74d33502176830596d93724ff7dc226b13a9a94\": rpc error: code = NotFound desc = could not find container \"9320518270e05c6869a73164e74d33502176830596d93724ff7dc226b13a9a94\": container with ID starting with 9320518270e05c6869a73164e74d33502176830596d93724ff7dc226b13a9a94 not found: ID does not exist" Mar 16 18:14:17 crc kubenswrapper[5120]: I0316 18:14:17.361978 5120 scope.go:117] "RemoveContainer" containerID="f0b042735cb3ee413213d1c75e3ca9845498f61d4a3b18e1220d0eefecbfee35" Mar 16 18:14:17 crc kubenswrapper[5120]: E0316 18:14:17.362395 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f0b042735cb3ee413213d1c75e3ca9845498f61d4a3b18e1220d0eefecbfee35\": container with ID starting with f0b042735cb3ee413213d1c75e3ca9845498f61d4a3b18e1220d0eefecbfee35 not found: ID does not exist" containerID="f0b042735cb3ee413213d1c75e3ca9845498f61d4a3b18e1220d0eefecbfee35" Mar 16 18:14:17 crc kubenswrapper[5120]: I0316 18:14:17.362424 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0b042735cb3ee413213d1c75e3ca9845498f61d4a3b18e1220d0eefecbfee35"} err="failed to get container status \"f0b042735cb3ee413213d1c75e3ca9845498f61d4a3b18e1220d0eefecbfee35\": rpc error: code = NotFound desc = could not find container \"f0b042735cb3ee413213d1c75e3ca9845498f61d4a3b18e1220d0eefecbfee35\": container with ID starting with f0b042735cb3ee413213d1c75e3ca9845498f61d4a3b18e1220d0eefecbfee35 not found: ID does not exist" Mar 16 18:14:18 crc kubenswrapper[5120]: I0316 18:14:18.675168 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="78493587-677f-4f79-95fe-26de6febb8d7" path="/var/lib/kubelet/pods/78493587-677f-4f79-95fe-26de6febb8d7/volumes" Mar 16 18:14:22 crc kubenswrapper[5120]: I0316 18:14:22.008289 5120 patch_prober.go:28] interesting pod/machine-config-daemon-7bf76 container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 18:14:22 crc kubenswrapper[5120]: I0316 18:14:22.008688 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 18:14:40 crc kubenswrapper[5120]: I0316 18:14:40.495078 5120 scope.go:117] "RemoveContainer" containerID="4d966703f084786b6ee40fabd58b591bc3644c214d07606c0f5b5dbb8c3053e9" Mar 16 18:14:52 crc kubenswrapper[5120]: I0316 18:14:52.008466 5120 patch_prober.go:28] interesting pod/machine-config-daemon-7bf76 container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 18:14:52 crc kubenswrapper[5120]: I0316 18:14:52.009940 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 18:14:52 crc kubenswrapper[5120]: I0316 18:14:52.010013 5120 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" Mar 16 18:14:52 crc kubenswrapper[5120]: I0316 18:14:52.010702 5120 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="machine-config-daemon" containerStatusID={"Type":"cri-o","ID":"f46f7389db7e312fd9565c65ada72cf5a849906f210a5db0befeb36862170522"} pod="openshift-machine-config-operator/machine-config-daemon-7bf76" containerMessage="Container machine-config-daemon failed liveness probe, will be restarted" Mar 16 18:14:52 crc kubenswrapper[5120]: I0316 18:14:52.010808 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" containerID="cri-o://f46f7389db7e312fd9565c65ada72cf5a849906f210a5db0befeb36862170522" gracePeriod=600 Mar 16 18:14:52 crc kubenswrapper[5120]: E0316 18:14:52.157420 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 18:14:52 crc kubenswrapper[5120]: I0316 18:14:52.569068 5120 generic.go:358] "Generic (PLEG): container finished" podID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerID="f46f7389db7e312fd9565c65ada72cf5a849906f210a5db0befeb36862170522" exitCode=0 Mar 16 18:14:52 crc kubenswrapper[5120]: I0316 18:14:52.569150 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" event={"ID":"e2275cb4-4905-4d66-a87e-8010120db2bd","Type":"ContainerDied","Data":"f46f7389db7e312fd9565c65ada72cf5a849906f210a5db0befeb36862170522"} Mar 16 18:14:52 crc kubenswrapper[5120]: I0316 18:14:52.569599 5120 scope.go:117] "RemoveContainer" containerID="0bc706326dac8b83055559df8e8f05a839bf45e2e38c5788a669089c8a5708f7" Mar 16 18:14:52 crc kubenswrapper[5120]: I0316 18:14:52.570216 5120 scope.go:117] "RemoveContainer" containerID="f46f7389db7e312fd9565c65ada72cf5a849906f210a5db0befeb36862170522" Mar 16 18:14:52 crc kubenswrapper[5120]: E0316 18:14:52.570674 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 18:14:55 crc kubenswrapper[5120]: I0316 18:14:55.766654 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-operators-tmb2h"] Mar 16 18:14:55 crc kubenswrapper[5120]: I0316 18:14:55.768011 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94384423-f84d-4ea8-9b68-7d8655d164bc" containerName="oc" Mar 16 18:14:55 crc kubenswrapper[5120]: I0316 18:14:55.768031 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="94384423-f84d-4ea8-9b68-7d8655d164bc" containerName="oc" Mar 16 18:14:55 crc kubenswrapper[5120]: I0316 18:14:55.768118 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78493587-677f-4f79-95fe-26de6febb8d7" containerName="registry-server" Mar 16 18:14:55 crc kubenswrapper[5120]: I0316 18:14:55.768127 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="78493587-677f-4f79-95fe-26de6febb8d7" containerName="registry-server" Mar 16 18:14:55 crc kubenswrapper[5120]: I0316 18:14:55.768167 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78493587-677f-4f79-95fe-26de6febb8d7" containerName="extract-utilities" Mar 16 18:14:55 crc kubenswrapper[5120]: I0316 18:14:55.768176 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="78493587-677f-4f79-95fe-26de6febb8d7" containerName="extract-utilities" Mar 16 18:14:55 crc kubenswrapper[5120]: I0316 18:14:55.768197 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78493587-677f-4f79-95fe-26de6febb8d7" containerName="extract-content" Mar 16 18:14:55 crc kubenswrapper[5120]: I0316 18:14:55.768203 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="78493587-677f-4f79-95fe-26de6febb8d7" containerName="extract-content" Mar 16 18:14:55 crc kubenswrapper[5120]: I0316 18:14:55.768355 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="94384423-f84d-4ea8-9b68-7d8655d164bc" containerName="oc" Mar 16 18:14:55 crc kubenswrapper[5120]: I0316 18:14:55.768375 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="78493587-677f-4f79-95fe-26de6febb8d7" containerName="registry-server" Mar 16 18:14:55 crc kubenswrapper[5120]: I0316 18:14:55.792039 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-tmb2h"] Mar 16 18:14:55 crc kubenswrapper[5120]: I0316 18:14:55.792275 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-tmb2h" Mar 16 18:14:55 crc kubenswrapper[5120]: I0316 18:14:55.878882 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/889f50a1-49a0-44d7-ba24-3e88935be215-catalog-content\") pod \"redhat-operators-tmb2h\" (UID: \"889f50a1-49a0-44d7-ba24-3e88935be215\") " pod="openshift-marketplace/redhat-operators-tmb2h" Mar 16 18:14:55 crc kubenswrapper[5120]: I0316 18:14:55.878977 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/889f50a1-49a0-44d7-ba24-3e88935be215-utilities\") pod \"redhat-operators-tmb2h\" (UID: \"889f50a1-49a0-44d7-ba24-3e88935be215\") " pod="openshift-marketplace/redhat-operators-tmb2h" Mar 16 18:14:55 crc kubenswrapper[5120]: I0316 18:14:55.879167 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wfmt\" (UniqueName: \"kubernetes.io/projected/889f50a1-49a0-44d7-ba24-3e88935be215-kube-api-access-2wfmt\") pod \"redhat-operators-tmb2h\" (UID: \"889f50a1-49a0-44d7-ba24-3e88935be215\") " pod="openshift-marketplace/redhat-operators-tmb2h" Mar 16 18:14:55 crc kubenswrapper[5120]: I0316 18:14:55.980560 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/889f50a1-49a0-44d7-ba24-3e88935be215-catalog-content\") pod \"redhat-operators-tmb2h\" (UID: \"889f50a1-49a0-44d7-ba24-3e88935be215\") " pod="openshift-marketplace/redhat-operators-tmb2h" Mar 16 18:14:55 crc kubenswrapper[5120]: I0316 18:14:55.980628 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/889f50a1-49a0-44d7-ba24-3e88935be215-utilities\") pod \"redhat-operators-tmb2h\" (UID: \"889f50a1-49a0-44d7-ba24-3e88935be215\") " pod="openshift-marketplace/redhat-operators-tmb2h" Mar 16 18:14:55 crc kubenswrapper[5120]: I0316 18:14:55.980774 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2wfmt\" (UniqueName: \"kubernetes.io/projected/889f50a1-49a0-44d7-ba24-3e88935be215-kube-api-access-2wfmt\") pod \"redhat-operators-tmb2h\" (UID: \"889f50a1-49a0-44d7-ba24-3e88935be215\") " pod="openshift-marketplace/redhat-operators-tmb2h" Mar 16 18:14:55 crc kubenswrapper[5120]: I0316 18:14:55.981146 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/889f50a1-49a0-44d7-ba24-3e88935be215-utilities\") pod \"redhat-operators-tmb2h\" (UID: \"889f50a1-49a0-44d7-ba24-3e88935be215\") " pod="openshift-marketplace/redhat-operators-tmb2h" Mar 16 18:14:55 crc kubenswrapper[5120]: I0316 18:14:55.981377 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/889f50a1-49a0-44d7-ba24-3e88935be215-catalog-content\") pod \"redhat-operators-tmb2h\" (UID: \"889f50a1-49a0-44d7-ba24-3e88935be215\") " pod="openshift-marketplace/redhat-operators-tmb2h" Mar 16 18:14:56 crc kubenswrapper[5120]: I0316 18:14:56.000625 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wfmt\" (UniqueName: \"kubernetes.io/projected/889f50a1-49a0-44d7-ba24-3e88935be215-kube-api-access-2wfmt\") pod \"redhat-operators-tmb2h\" (UID: \"889f50a1-49a0-44d7-ba24-3e88935be215\") " pod="openshift-marketplace/redhat-operators-tmb2h" Mar 16 18:14:56 crc kubenswrapper[5120]: I0316 18:14:56.126868 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-tmb2h" Mar 16 18:14:56 crc kubenswrapper[5120]: W0316 18:14:56.543156 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod889f50a1_49a0_44d7_ba24_3e88935be215.slice/crio-f4ec28714602f6233213b5b00e38a5c186499377bf1c4326e7444eabac4924fd WatchSource:0}: Error finding container f4ec28714602f6233213b5b00e38a5c186499377bf1c4326e7444eabac4924fd: Status 404 returned error can't find the container with id f4ec28714602f6233213b5b00e38a5c186499377bf1c4326e7444eabac4924fd Mar 16 18:14:56 crc kubenswrapper[5120]: I0316 18:14:56.546867 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-tmb2h"] Mar 16 18:14:56 crc kubenswrapper[5120]: I0316 18:14:56.599172 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-tmb2h" event={"ID":"889f50a1-49a0-44d7-ba24-3e88935be215","Type":"ContainerStarted","Data":"f4ec28714602f6233213b5b00e38a5c186499377bf1c4326e7444eabac4924fd"} Mar 16 18:14:57 crc kubenswrapper[5120]: I0316 18:14:57.611605 5120 generic.go:358] "Generic (PLEG): container finished" podID="889f50a1-49a0-44d7-ba24-3e88935be215" containerID="8d7529518c79c621399d3338c38f18a77e9b8ce6eeaf52a47cfdb299317300ee" exitCode=0 Mar 16 18:14:57 crc kubenswrapper[5120]: I0316 18:14:57.611657 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-tmb2h" event={"ID":"889f50a1-49a0-44d7-ba24-3e88935be215","Type":"ContainerDied","Data":"8d7529518c79c621399d3338c38f18a77e9b8ce6eeaf52a47cfdb299317300ee"} Mar 16 18:14:59 crc kubenswrapper[5120]: I0316 18:14:59.631233 5120 generic.go:358] "Generic (PLEG): container finished" podID="889f50a1-49a0-44d7-ba24-3e88935be215" containerID="e2557da170ebcb5b18b80929c306911d50932537c9a87558ae455017793934f0" exitCode=0 Mar 16 18:14:59 crc kubenswrapper[5120]: I0316 18:14:59.631307 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-tmb2h" event={"ID":"889f50a1-49a0-44d7-ba24-3e88935be215","Type":"ContainerDied","Data":"e2557da170ebcb5b18b80929c306911d50932537c9a87558ae455017793934f0"} Mar 16 18:15:00 crc kubenswrapper[5120]: I0316 18:15:00.135609 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29561415-8bvz7"] Mar 16 18:15:00 crc kubenswrapper[5120]: I0316 18:15:00.142091 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29561415-8bvz7" Mar 16 18:15:00 crc kubenswrapper[5120]: I0316 18:15:00.144813 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operator-lifecycle-manager\"/\"collect-profiles-dockercfg-vfqp6\"" Mar 16 18:15:00 crc kubenswrapper[5120]: I0316 18:15:00.145585 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operator-lifecycle-manager\"/\"collect-profiles-config\"" Mar 16 18:15:00 crc kubenswrapper[5120]: I0316 18:15:00.148790 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29561415-8bvz7"] Mar 16 18:15:00 crc kubenswrapper[5120]: I0316 18:15:00.284212 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/4c2fdb34-31da-42c6-8f28-fd0cc9deb4df-secret-volume\") pod \"collect-profiles-29561415-8bvz7\" (UID: \"4c2fdb34-31da-42c6-8f28-fd0cc9deb4df\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561415-8bvz7" Mar 16 18:15:00 crc kubenswrapper[5120]: I0316 18:15:00.284535 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4c2fdb34-31da-42c6-8f28-fd0cc9deb4df-config-volume\") pod \"collect-profiles-29561415-8bvz7\" (UID: \"4c2fdb34-31da-42c6-8f28-fd0cc9deb4df\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561415-8bvz7" Mar 16 18:15:00 crc kubenswrapper[5120]: I0316 18:15:00.284870 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqvht\" (UniqueName: \"kubernetes.io/projected/4c2fdb34-31da-42c6-8f28-fd0cc9deb4df-kube-api-access-hqvht\") pod \"collect-profiles-29561415-8bvz7\" (UID: \"4c2fdb34-31da-42c6-8f28-fd0cc9deb4df\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561415-8bvz7" Mar 16 18:15:00 crc kubenswrapper[5120]: I0316 18:15:00.387338 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/4c2fdb34-31da-42c6-8f28-fd0cc9deb4df-secret-volume\") pod \"collect-profiles-29561415-8bvz7\" (UID: \"4c2fdb34-31da-42c6-8f28-fd0cc9deb4df\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561415-8bvz7" Mar 16 18:15:00 crc kubenswrapper[5120]: I0316 18:15:00.387546 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4c2fdb34-31da-42c6-8f28-fd0cc9deb4df-config-volume\") pod \"collect-profiles-29561415-8bvz7\" (UID: \"4c2fdb34-31da-42c6-8f28-fd0cc9deb4df\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561415-8bvz7" Mar 16 18:15:00 crc kubenswrapper[5120]: I0316 18:15:00.387662 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hqvht\" (UniqueName: \"kubernetes.io/projected/4c2fdb34-31da-42c6-8f28-fd0cc9deb4df-kube-api-access-hqvht\") pod \"collect-profiles-29561415-8bvz7\" (UID: \"4c2fdb34-31da-42c6-8f28-fd0cc9deb4df\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561415-8bvz7" Mar 16 18:15:00 crc kubenswrapper[5120]: I0316 18:15:00.388540 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4c2fdb34-31da-42c6-8f28-fd0cc9deb4df-config-volume\") pod \"collect-profiles-29561415-8bvz7\" (UID: \"4c2fdb34-31da-42c6-8f28-fd0cc9deb4df\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561415-8bvz7" Mar 16 18:15:00 crc kubenswrapper[5120]: I0316 18:15:00.394131 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/4c2fdb34-31da-42c6-8f28-fd0cc9deb4df-secret-volume\") pod \"collect-profiles-29561415-8bvz7\" (UID: \"4c2fdb34-31da-42c6-8f28-fd0cc9deb4df\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561415-8bvz7" Mar 16 18:15:00 crc kubenswrapper[5120]: I0316 18:15:00.405360 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqvht\" (UniqueName: \"kubernetes.io/projected/4c2fdb34-31da-42c6-8f28-fd0cc9deb4df-kube-api-access-hqvht\") pod \"collect-profiles-29561415-8bvz7\" (UID: \"4c2fdb34-31da-42c6-8f28-fd0cc9deb4df\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561415-8bvz7" Mar 16 18:15:00 crc kubenswrapper[5120]: I0316 18:15:00.464276 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29561415-8bvz7" Mar 16 18:15:00 crc kubenswrapper[5120]: I0316 18:15:00.661281 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-tmb2h" event={"ID":"889f50a1-49a0-44d7-ba24-3e88935be215","Type":"ContainerStarted","Data":"9ff91a3d1d2cb4b3ec34ab2479373ec6c193bdb24361805c3355ff19ecfa29ef"} Mar 16 18:15:00 crc kubenswrapper[5120]: I0316 18:15:00.670544 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29561415-8bvz7"] Mar 16 18:15:00 crc kubenswrapper[5120]: I0316 18:15:00.687940 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/redhat-operators-tmb2h" podStartSLOduration=4.849857488 podStartE2EDuration="5.68791445s" podCreationTimestamp="2026-03-16 18:14:55 +0000 UTC" firstStartedPulling="2026-03-16 18:14:57.613092154 +0000 UTC m=+9799.767023851" lastFinishedPulling="2026-03-16 18:14:58.451149156 +0000 UTC m=+9800.605080813" observedRunningTime="2026-03-16 18:15:00.679058138 +0000 UTC m=+9802.832989795" watchObservedRunningTime="2026-03-16 18:15:00.68791445 +0000 UTC m=+9802.841846107" Mar 16 18:15:01 crc kubenswrapper[5120]: I0316 18:15:01.667730 5120 generic.go:358] "Generic (PLEG): container finished" podID="4c2fdb34-31da-42c6-8f28-fd0cc9deb4df" containerID="19c08c79ed015586273b61c5ca48c4761746c9058b760a9085917354cbf8acbd" exitCode=0 Mar 16 18:15:01 crc kubenswrapper[5120]: I0316 18:15:01.667784 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/collect-profiles-29561415-8bvz7" event={"ID":"4c2fdb34-31da-42c6-8f28-fd0cc9deb4df","Type":"ContainerDied","Data":"19c08c79ed015586273b61c5ca48c4761746c9058b760a9085917354cbf8acbd"} Mar 16 18:15:01 crc kubenswrapper[5120]: I0316 18:15:01.668328 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/collect-profiles-29561415-8bvz7" event={"ID":"4c2fdb34-31da-42c6-8f28-fd0cc9deb4df","Type":"ContainerStarted","Data":"0ef926c726a7bfda9c0a84b03e22c616c096e98e42f21017284ad64a477cd888"} Mar 16 18:15:02 crc kubenswrapper[5120]: I0316 18:15:02.959198 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29561415-8bvz7" Mar 16 18:15:03 crc kubenswrapper[5120]: I0316 18:15:03.046876 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hqvht\" (UniqueName: \"kubernetes.io/projected/4c2fdb34-31da-42c6-8f28-fd0cc9deb4df-kube-api-access-hqvht\") pod \"4c2fdb34-31da-42c6-8f28-fd0cc9deb4df\" (UID: \"4c2fdb34-31da-42c6-8f28-fd0cc9deb4df\") " Mar 16 18:15:03 crc kubenswrapper[5120]: I0316 18:15:03.047100 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4c2fdb34-31da-42c6-8f28-fd0cc9deb4df-config-volume\") pod \"4c2fdb34-31da-42c6-8f28-fd0cc9deb4df\" (UID: \"4c2fdb34-31da-42c6-8f28-fd0cc9deb4df\") " Mar 16 18:15:03 crc kubenswrapper[5120]: I0316 18:15:03.047171 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/4c2fdb34-31da-42c6-8f28-fd0cc9deb4df-secret-volume\") pod \"4c2fdb34-31da-42c6-8f28-fd0cc9deb4df\" (UID: \"4c2fdb34-31da-42c6-8f28-fd0cc9deb4df\") " Mar 16 18:15:03 crc kubenswrapper[5120]: I0316 18:15:03.047743 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c2fdb34-31da-42c6-8f28-fd0cc9deb4df-config-volume" (OuterVolumeSpecName: "config-volume") pod "4c2fdb34-31da-42c6-8f28-fd0cc9deb4df" (UID: "4c2fdb34-31da-42c6-8f28-fd0cc9deb4df"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 18:15:03 crc kubenswrapper[5120]: I0316 18:15:03.048148 5120 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4c2fdb34-31da-42c6-8f28-fd0cc9deb4df-config-volume\") on node \"crc\" DevicePath \"\"" Mar 16 18:15:03 crc kubenswrapper[5120]: I0316 18:15:03.052352 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c2fdb34-31da-42c6-8f28-fd0cc9deb4df-kube-api-access-hqvht" (OuterVolumeSpecName: "kube-api-access-hqvht") pod "4c2fdb34-31da-42c6-8f28-fd0cc9deb4df" (UID: "4c2fdb34-31da-42c6-8f28-fd0cc9deb4df"). InnerVolumeSpecName "kube-api-access-hqvht". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 18:15:03 crc kubenswrapper[5120]: I0316 18:15:03.052940 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c2fdb34-31da-42c6-8f28-fd0cc9deb4df-secret-volume" (OuterVolumeSpecName: "secret-volume") pod "4c2fdb34-31da-42c6-8f28-fd0cc9deb4df" (UID: "4c2fdb34-31da-42c6-8f28-fd0cc9deb4df"). InnerVolumeSpecName "secret-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 18:15:03 crc kubenswrapper[5120]: I0316 18:15:03.150652 5120 reconciler_common.go:299] "Volume detached for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/4c2fdb34-31da-42c6-8f28-fd0cc9deb4df-secret-volume\") on node \"crc\" DevicePath \"\"" Mar 16 18:15:03 crc kubenswrapper[5120]: I0316 18:15:03.150963 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hqvht\" (UniqueName: \"kubernetes.io/projected/4c2fdb34-31da-42c6-8f28-fd0cc9deb4df-kube-api-access-hqvht\") on node \"crc\" DevicePath \"\"" Mar 16 18:15:03 crc kubenswrapper[5120]: I0316 18:15:03.687471 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29561415-8bvz7" Mar 16 18:15:03 crc kubenswrapper[5120]: I0316 18:15:03.687722 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/collect-profiles-29561415-8bvz7" event={"ID":"4c2fdb34-31da-42c6-8f28-fd0cc9deb4df","Type":"ContainerDied","Data":"0ef926c726a7bfda9c0a84b03e22c616c096e98e42f21017284ad64a477cd888"} Mar 16 18:15:03 crc kubenswrapper[5120]: I0316 18:15:03.687966 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0ef926c726a7bfda9c0a84b03e22c616c096e98e42f21017284ad64a477cd888" Mar 16 18:15:04 crc kubenswrapper[5120]: I0316 18:15:04.031849 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29561370-bs8d6"] Mar 16 18:15:04 crc kubenswrapper[5120]: I0316 18:15:04.037530 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29561370-bs8d6"] Mar 16 18:15:04 crc kubenswrapper[5120]: I0316 18:15:04.621991 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/community-operators-2k4nd"] Mar 16 18:15:04 crc kubenswrapper[5120]: I0316 18:15:04.622908 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c2fdb34-31da-42c6-8f28-fd0cc9deb4df" containerName="collect-profiles" Mar 16 18:15:04 crc kubenswrapper[5120]: I0316 18:15:04.622933 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c2fdb34-31da-42c6-8f28-fd0cc9deb4df" containerName="collect-profiles" Mar 16 18:15:04 crc kubenswrapper[5120]: I0316 18:15:04.623063 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="4c2fdb34-31da-42c6-8f28-fd0cc9deb4df" containerName="collect-profiles" Mar 16 18:15:04 crc kubenswrapper[5120]: I0316 18:15:04.665500 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/community-operators-2k4nd"] Mar 16 18:15:04 crc kubenswrapper[5120]: I0316 18:15:04.666131 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-2k4nd" Mar 16 18:15:04 crc kubenswrapper[5120]: I0316 18:15:04.666520 5120 scope.go:117] "RemoveContainer" containerID="f46f7389db7e312fd9565c65ada72cf5a849906f210a5db0befeb36862170522" Mar 16 18:15:04 crc kubenswrapper[5120]: E0316 18:15:04.667143 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 18:15:04 crc kubenswrapper[5120]: I0316 18:15:04.674383 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c86e884-f840-490e-a1bc-d348dbbcbf55" path="/var/lib/kubelet/pods/5c86e884-f840-490e-a1bc-d348dbbcbf55/volumes" Mar 16 18:15:04 crc kubenswrapper[5120]: I0316 18:15:04.782986 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/0188516e-f8ae-4b00-9f66-7b1fef1de9f6-utilities\") pod \"community-operators-2k4nd\" (UID: \"0188516e-f8ae-4b00-9f66-7b1fef1de9f6\") " pod="openshift-marketplace/community-operators-2k4nd" Mar 16 18:15:04 crc kubenswrapper[5120]: I0316 18:15:04.783930 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24md7\" (UniqueName: \"kubernetes.io/projected/0188516e-f8ae-4b00-9f66-7b1fef1de9f6-kube-api-access-24md7\") pod \"community-operators-2k4nd\" (UID: \"0188516e-f8ae-4b00-9f66-7b1fef1de9f6\") " pod="openshift-marketplace/community-operators-2k4nd" Mar 16 18:15:04 crc kubenswrapper[5120]: I0316 18:15:04.786241 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/0188516e-f8ae-4b00-9f66-7b1fef1de9f6-catalog-content\") pod \"community-operators-2k4nd\" (UID: \"0188516e-f8ae-4b00-9f66-7b1fef1de9f6\") " pod="openshift-marketplace/community-operators-2k4nd" Mar 16 18:15:04 crc kubenswrapper[5120]: I0316 18:15:04.889245 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/0188516e-f8ae-4b00-9f66-7b1fef1de9f6-catalog-content\") pod \"community-operators-2k4nd\" (UID: \"0188516e-f8ae-4b00-9f66-7b1fef1de9f6\") " pod="openshift-marketplace/community-operators-2k4nd" Mar 16 18:15:04 crc kubenswrapper[5120]: I0316 18:15:04.889752 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/0188516e-f8ae-4b00-9f66-7b1fef1de9f6-utilities\") pod \"community-operators-2k4nd\" (UID: \"0188516e-f8ae-4b00-9f66-7b1fef1de9f6\") " pod="openshift-marketplace/community-operators-2k4nd" Mar 16 18:15:04 crc kubenswrapper[5120]: I0316 18:15:04.889816 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/0188516e-f8ae-4b00-9f66-7b1fef1de9f6-catalog-content\") pod \"community-operators-2k4nd\" (UID: \"0188516e-f8ae-4b00-9f66-7b1fef1de9f6\") " pod="openshift-marketplace/community-operators-2k4nd" Mar 16 18:15:04 crc kubenswrapper[5120]: I0316 18:15:04.889943 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-24md7\" (UniqueName: \"kubernetes.io/projected/0188516e-f8ae-4b00-9f66-7b1fef1de9f6-kube-api-access-24md7\") pod \"community-operators-2k4nd\" (UID: \"0188516e-f8ae-4b00-9f66-7b1fef1de9f6\") " pod="openshift-marketplace/community-operators-2k4nd" Mar 16 18:15:04 crc kubenswrapper[5120]: I0316 18:15:04.890060 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/0188516e-f8ae-4b00-9f66-7b1fef1de9f6-utilities\") pod \"community-operators-2k4nd\" (UID: \"0188516e-f8ae-4b00-9f66-7b1fef1de9f6\") " pod="openshift-marketplace/community-operators-2k4nd" Mar 16 18:15:04 crc kubenswrapper[5120]: I0316 18:15:04.908623 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-24md7\" (UniqueName: \"kubernetes.io/projected/0188516e-f8ae-4b00-9f66-7b1fef1de9f6-kube-api-access-24md7\") pod \"community-operators-2k4nd\" (UID: \"0188516e-f8ae-4b00-9f66-7b1fef1de9f6\") " pod="openshift-marketplace/community-operators-2k4nd" Mar 16 18:15:04 crc kubenswrapper[5120]: I0316 18:15:04.984405 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-2k4nd" Mar 16 18:15:05 crc kubenswrapper[5120]: I0316 18:15:05.247568 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/community-operators-2k4nd"] Mar 16 18:15:05 crc kubenswrapper[5120]: I0316 18:15:05.703531 5120 generic.go:358] "Generic (PLEG): container finished" podID="0188516e-f8ae-4b00-9f66-7b1fef1de9f6" containerID="766365d5959a95d40d992808285707ba33839d02d8b4f1909d04fcec999d18e8" exitCode=0 Mar 16 18:15:05 crc kubenswrapper[5120]: I0316 18:15:05.703653 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-2k4nd" event={"ID":"0188516e-f8ae-4b00-9f66-7b1fef1de9f6","Type":"ContainerDied","Data":"766365d5959a95d40d992808285707ba33839d02d8b4f1909d04fcec999d18e8"} Mar 16 18:15:05 crc kubenswrapper[5120]: I0316 18:15:05.704049 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-2k4nd" event={"ID":"0188516e-f8ae-4b00-9f66-7b1fef1de9f6","Type":"ContainerStarted","Data":"ccae180016f90d79fcfa5e0b5be6b6401199210a6195eb62f5ea2e6d5ea3393c"} Mar 16 18:15:06 crc kubenswrapper[5120]: I0316 18:15:06.126945 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-marketplace/redhat-operators-tmb2h" Mar 16 18:15:06 crc kubenswrapper[5120]: I0316 18:15:06.126997 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-operators-tmb2h" Mar 16 18:15:06 crc kubenswrapper[5120]: I0316 18:15:06.163620 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-operators-tmb2h" Mar 16 18:15:06 crc kubenswrapper[5120]: I0316 18:15:06.712303 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-2k4nd" event={"ID":"0188516e-f8ae-4b00-9f66-7b1fef1de9f6","Type":"ContainerStarted","Data":"a10426722991d9bb94fac9cf020b077512587a7445d421badab202477ea56758"} Mar 16 18:15:06 crc kubenswrapper[5120]: I0316 18:15:06.774915 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-operators-tmb2h" Mar 16 18:15:07 crc kubenswrapper[5120]: E0316 18:15:07.320748 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=893152 actualBytes=10240 Mar 16 18:15:07 crc kubenswrapper[5120]: I0316 18:15:07.723508 5120 generic.go:358] "Generic (PLEG): container finished" podID="0188516e-f8ae-4b00-9f66-7b1fef1de9f6" containerID="a10426722991d9bb94fac9cf020b077512587a7445d421badab202477ea56758" exitCode=0 Mar 16 18:15:07 crc kubenswrapper[5120]: I0316 18:15:07.723551 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-2k4nd" event={"ID":"0188516e-f8ae-4b00-9f66-7b1fef1de9f6","Type":"ContainerDied","Data":"a10426722991d9bb94fac9cf020b077512587a7445d421badab202477ea56758"} Mar 16 18:15:08 crc kubenswrapper[5120]: I0316 18:15:08.400075 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-operators-tmb2h"] Mar 16 18:15:08 crc kubenswrapper[5120]: I0316 18:15:08.734147 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-2k4nd" event={"ID":"0188516e-f8ae-4b00-9f66-7b1fef1de9f6","Type":"ContainerStarted","Data":"4379de3bedbbd24dbb15983210f171e9f15e0abcf2d996d1bc4d274dd146870b"} Mar 16 18:15:08 crc kubenswrapper[5120]: I0316 18:15:08.734296 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-marketplace/redhat-operators-tmb2h" podUID="889f50a1-49a0-44d7-ba24-3e88935be215" containerName="registry-server" containerID="cri-o://9ff91a3d1d2cb4b3ec34ab2479373ec6c193bdb24361805c3355ff19ecfa29ef" gracePeriod=2 Mar 16 18:15:08 crc kubenswrapper[5120]: I0316 18:15:08.754158 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/community-operators-2k4nd" podStartSLOduration=3.936659669 podStartE2EDuration="4.754142079s" podCreationTimestamp="2026-03-16 18:15:04 +0000 UTC" firstStartedPulling="2026-03-16 18:15:05.704887901 +0000 UTC m=+9807.858819598" lastFinishedPulling="2026-03-16 18:15:06.522370351 +0000 UTC m=+9808.676302008" observedRunningTime="2026-03-16 18:15:08.750314635 +0000 UTC m=+9810.904246292" watchObservedRunningTime="2026-03-16 18:15:08.754142079 +0000 UTC m=+9810.908073736" Mar 16 18:15:09 crc kubenswrapper[5120]: I0316 18:15:09.099749 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-tmb2h" Mar 16 18:15:09 crc kubenswrapper[5120]: I0316 18:15:09.295523 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/889f50a1-49a0-44d7-ba24-3e88935be215-utilities\") pod \"889f50a1-49a0-44d7-ba24-3e88935be215\" (UID: \"889f50a1-49a0-44d7-ba24-3e88935be215\") " Mar 16 18:15:09 crc kubenswrapper[5120]: I0316 18:15:09.295748 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2wfmt\" (UniqueName: \"kubernetes.io/projected/889f50a1-49a0-44d7-ba24-3e88935be215-kube-api-access-2wfmt\") pod \"889f50a1-49a0-44d7-ba24-3e88935be215\" (UID: \"889f50a1-49a0-44d7-ba24-3e88935be215\") " Mar 16 18:15:09 crc kubenswrapper[5120]: I0316 18:15:09.295899 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/889f50a1-49a0-44d7-ba24-3e88935be215-catalog-content\") pod \"889f50a1-49a0-44d7-ba24-3e88935be215\" (UID: \"889f50a1-49a0-44d7-ba24-3e88935be215\") " Mar 16 18:15:09 crc kubenswrapper[5120]: I0316 18:15:09.296698 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/889f50a1-49a0-44d7-ba24-3e88935be215-utilities" (OuterVolumeSpecName: "utilities") pod "889f50a1-49a0-44d7-ba24-3e88935be215" (UID: "889f50a1-49a0-44d7-ba24-3e88935be215"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 18:15:09 crc kubenswrapper[5120]: I0316 18:15:09.296816 5120 reconciler_common.go:299] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/889f50a1-49a0-44d7-ba24-3e88935be215-utilities\") on node \"crc\" DevicePath \"\"" Mar 16 18:15:09 crc kubenswrapper[5120]: I0316 18:15:09.303162 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/889f50a1-49a0-44d7-ba24-3e88935be215-kube-api-access-2wfmt" (OuterVolumeSpecName: "kube-api-access-2wfmt") pod "889f50a1-49a0-44d7-ba24-3e88935be215" (UID: "889f50a1-49a0-44d7-ba24-3e88935be215"). InnerVolumeSpecName "kube-api-access-2wfmt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 18:15:09 crc kubenswrapper[5120]: I0316 18:15:09.398501 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2wfmt\" (UniqueName: \"kubernetes.io/projected/889f50a1-49a0-44d7-ba24-3e88935be215-kube-api-access-2wfmt\") on node \"crc\" DevicePath \"\"" Mar 16 18:15:09 crc kubenswrapper[5120]: I0316 18:15:09.742749 5120 generic.go:358] "Generic (PLEG): container finished" podID="889f50a1-49a0-44d7-ba24-3e88935be215" containerID="9ff91a3d1d2cb4b3ec34ab2479373ec6c193bdb24361805c3355ff19ecfa29ef" exitCode=0 Mar 16 18:15:09 crc kubenswrapper[5120]: I0316 18:15:09.744119 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-tmb2h" Mar 16 18:15:09 crc kubenswrapper[5120]: I0316 18:15:09.744619 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-tmb2h" event={"ID":"889f50a1-49a0-44d7-ba24-3e88935be215","Type":"ContainerDied","Data":"9ff91a3d1d2cb4b3ec34ab2479373ec6c193bdb24361805c3355ff19ecfa29ef"} Mar 16 18:15:09 crc kubenswrapper[5120]: I0316 18:15:09.744664 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-tmb2h" event={"ID":"889f50a1-49a0-44d7-ba24-3e88935be215","Type":"ContainerDied","Data":"f4ec28714602f6233213b5b00e38a5c186499377bf1c4326e7444eabac4924fd"} Mar 16 18:15:09 crc kubenswrapper[5120]: I0316 18:15:09.744688 5120 scope.go:117] "RemoveContainer" containerID="9ff91a3d1d2cb4b3ec34ab2479373ec6c193bdb24361805c3355ff19ecfa29ef" Mar 16 18:15:09 crc kubenswrapper[5120]: I0316 18:15:09.760485 5120 scope.go:117] "RemoveContainer" containerID="e2557da170ebcb5b18b80929c306911d50932537c9a87558ae455017793934f0" Mar 16 18:15:10 crc kubenswrapper[5120]: I0316 18:15:10.462710 5120 scope.go:117] "RemoveContainer" containerID="8d7529518c79c621399d3338c38f18a77e9b8ce6eeaf52a47cfdb299317300ee" Mar 16 18:15:10 crc kubenswrapper[5120]: I0316 18:15:10.492582 5120 scope.go:117] "RemoveContainer" containerID="9ff91a3d1d2cb4b3ec34ab2479373ec6c193bdb24361805c3355ff19ecfa29ef" Mar 16 18:15:10 crc kubenswrapper[5120]: E0316 18:15:10.493075 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9ff91a3d1d2cb4b3ec34ab2479373ec6c193bdb24361805c3355ff19ecfa29ef\": container with ID starting with 9ff91a3d1d2cb4b3ec34ab2479373ec6c193bdb24361805c3355ff19ecfa29ef not found: ID does not exist" containerID="9ff91a3d1d2cb4b3ec34ab2479373ec6c193bdb24361805c3355ff19ecfa29ef" Mar 16 18:15:10 crc kubenswrapper[5120]: I0316 18:15:10.493130 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ff91a3d1d2cb4b3ec34ab2479373ec6c193bdb24361805c3355ff19ecfa29ef"} err="failed to get container status \"9ff91a3d1d2cb4b3ec34ab2479373ec6c193bdb24361805c3355ff19ecfa29ef\": rpc error: code = NotFound desc = could not find container \"9ff91a3d1d2cb4b3ec34ab2479373ec6c193bdb24361805c3355ff19ecfa29ef\": container with ID starting with 9ff91a3d1d2cb4b3ec34ab2479373ec6c193bdb24361805c3355ff19ecfa29ef not found: ID does not exist" Mar 16 18:15:10 crc kubenswrapper[5120]: I0316 18:15:10.493192 5120 scope.go:117] "RemoveContainer" containerID="e2557da170ebcb5b18b80929c306911d50932537c9a87558ae455017793934f0" Mar 16 18:15:10 crc kubenswrapper[5120]: E0316 18:15:10.493595 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e2557da170ebcb5b18b80929c306911d50932537c9a87558ae455017793934f0\": container with ID starting with e2557da170ebcb5b18b80929c306911d50932537c9a87558ae455017793934f0 not found: ID does not exist" containerID="e2557da170ebcb5b18b80929c306911d50932537c9a87558ae455017793934f0" Mar 16 18:15:10 crc kubenswrapper[5120]: I0316 18:15:10.493624 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e2557da170ebcb5b18b80929c306911d50932537c9a87558ae455017793934f0"} err="failed to get container status \"e2557da170ebcb5b18b80929c306911d50932537c9a87558ae455017793934f0\": rpc error: code = NotFound desc = could not find container \"e2557da170ebcb5b18b80929c306911d50932537c9a87558ae455017793934f0\": container with ID starting with e2557da170ebcb5b18b80929c306911d50932537c9a87558ae455017793934f0 not found: ID does not exist" Mar 16 18:15:10 crc kubenswrapper[5120]: I0316 18:15:10.493641 5120 scope.go:117] "RemoveContainer" containerID="8d7529518c79c621399d3338c38f18a77e9b8ce6eeaf52a47cfdb299317300ee" Mar 16 18:15:10 crc kubenswrapper[5120]: E0316 18:15:10.494005 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d7529518c79c621399d3338c38f18a77e9b8ce6eeaf52a47cfdb299317300ee\": container with ID starting with 8d7529518c79c621399d3338c38f18a77e9b8ce6eeaf52a47cfdb299317300ee not found: ID does not exist" containerID="8d7529518c79c621399d3338c38f18a77e9b8ce6eeaf52a47cfdb299317300ee" Mar 16 18:15:10 crc kubenswrapper[5120]: I0316 18:15:10.494044 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d7529518c79c621399d3338c38f18a77e9b8ce6eeaf52a47cfdb299317300ee"} err="failed to get container status \"8d7529518c79c621399d3338c38f18a77e9b8ce6eeaf52a47cfdb299317300ee\": rpc error: code = NotFound desc = could not find container \"8d7529518c79c621399d3338c38f18a77e9b8ce6eeaf52a47cfdb299317300ee\": container with ID starting with 8d7529518c79c621399d3338c38f18a77e9b8ce6eeaf52a47cfdb299317300ee not found: ID does not exist" Mar 16 18:15:11 crc kubenswrapper[5120]: I0316 18:15:11.486169 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/889f50a1-49a0-44d7-ba24-3e88935be215-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "889f50a1-49a0-44d7-ba24-3e88935be215" (UID: "889f50a1-49a0-44d7-ba24-3e88935be215"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 18:15:11 crc kubenswrapper[5120]: I0316 18:15:11.542125 5120 reconciler_common.go:299] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/889f50a1-49a0-44d7-ba24-3e88935be215-catalog-content\") on node \"crc\" DevicePath \"\"" Mar 16 18:15:11 crc kubenswrapper[5120]: I0316 18:15:11.577289 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-operators-tmb2h"] Mar 16 18:15:11 crc kubenswrapper[5120]: I0316 18:15:11.581470 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/redhat-operators-tmb2h"] Mar 16 18:15:12 crc kubenswrapper[5120]: I0316 18:15:12.673608 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="889f50a1-49a0-44d7-ba24-3e88935be215" path="/var/lib/kubelet/pods/889f50a1-49a0-44d7-ba24-3e88935be215/volumes" Mar 16 18:15:14 crc kubenswrapper[5120]: I0316 18:15:14.986240 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/community-operators-2k4nd" Mar 16 18:15:14 crc kubenswrapper[5120]: I0316 18:15:14.986315 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-marketplace/community-operators-2k4nd" Mar 16 18:15:15 crc kubenswrapper[5120]: I0316 18:15:15.038011 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/community-operators-2k4nd" Mar 16 18:15:15 crc kubenswrapper[5120]: I0316 18:15:15.838935 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/community-operators-2k4nd" Mar 16 18:15:15 crc kubenswrapper[5120]: I0316 18:15:15.893180 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/community-operators-2k4nd"] Mar 16 18:15:17 crc kubenswrapper[5120]: I0316 18:15:17.805479 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-marketplace/community-operators-2k4nd" podUID="0188516e-f8ae-4b00-9f66-7b1fef1de9f6" containerName="registry-server" containerID="cri-o://4379de3bedbbd24dbb15983210f171e9f15e0abcf2d996d1bc4d274dd146870b" gracePeriod=2 Mar 16 18:15:18 crc kubenswrapper[5120]: I0316 18:15:18.216526 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-2k4nd" Mar 16 18:15:18 crc kubenswrapper[5120]: I0316 18:15:18.412067 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/0188516e-f8ae-4b00-9f66-7b1fef1de9f6-utilities\") pod \"0188516e-f8ae-4b00-9f66-7b1fef1de9f6\" (UID: \"0188516e-f8ae-4b00-9f66-7b1fef1de9f6\") " Mar 16 18:15:18 crc kubenswrapper[5120]: I0316 18:15:18.412423 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/0188516e-f8ae-4b00-9f66-7b1fef1de9f6-catalog-content\") pod \"0188516e-f8ae-4b00-9f66-7b1fef1de9f6\" (UID: \"0188516e-f8ae-4b00-9f66-7b1fef1de9f6\") " Mar 16 18:15:18 crc kubenswrapper[5120]: I0316 18:15:18.412659 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-24md7\" (UniqueName: \"kubernetes.io/projected/0188516e-f8ae-4b00-9f66-7b1fef1de9f6-kube-api-access-24md7\") pod \"0188516e-f8ae-4b00-9f66-7b1fef1de9f6\" (UID: \"0188516e-f8ae-4b00-9f66-7b1fef1de9f6\") " Mar 16 18:15:18 crc kubenswrapper[5120]: I0316 18:15:18.414143 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0188516e-f8ae-4b00-9f66-7b1fef1de9f6-utilities" (OuterVolumeSpecName: "utilities") pod "0188516e-f8ae-4b00-9f66-7b1fef1de9f6" (UID: "0188516e-f8ae-4b00-9f66-7b1fef1de9f6"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 18:15:18 crc kubenswrapper[5120]: I0316 18:15:18.419859 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0188516e-f8ae-4b00-9f66-7b1fef1de9f6-kube-api-access-24md7" (OuterVolumeSpecName: "kube-api-access-24md7") pod "0188516e-f8ae-4b00-9f66-7b1fef1de9f6" (UID: "0188516e-f8ae-4b00-9f66-7b1fef1de9f6"). InnerVolumeSpecName "kube-api-access-24md7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 18:15:18 crc kubenswrapper[5120]: I0316 18:15:18.463622 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0188516e-f8ae-4b00-9f66-7b1fef1de9f6-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "0188516e-f8ae-4b00-9f66-7b1fef1de9f6" (UID: "0188516e-f8ae-4b00-9f66-7b1fef1de9f6"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 18:15:18 crc kubenswrapper[5120]: I0316 18:15:18.516545 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-24md7\" (UniqueName: \"kubernetes.io/projected/0188516e-f8ae-4b00-9f66-7b1fef1de9f6-kube-api-access-24md7\") on node \"crc\" DevicePath \"\"" Mar 16 18:15:18 crc kubenswrapper[5120]: I0316 18:15:18.516583 5120 reconciler_common.go:299] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/0188516e-f8ae-4b00-9f66-7b1fef1de9f6-utilities\") on node \"crc\" DevicePath \"\"" Mar 16 18:15:18 crc kubenswrapper[5120]: I0316 18:15:18.516612 5120 reconciler_common.go:299] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/0188516e-f8ae-4b00-9f66-7b1fef1de9f6-catalog-content\") on node \"crc\" DevicePath \"\"" Mar 16 18:15:18 crc kubenswrapper[5120]: I0316 18:15:18.824021 5120 generic.go:358] "Generic (PLEG): container finished" podID="0188516e-f8ae-4b00-9f66-7b1fef1de9f6" containerID="4379de3bedbbd24dbb15983210f171e9f15e0abcf2d996d1bc4d274dd146870b" exitCode=0 Mar 16 18:15:18 crc kubenswrapper[5120]: I0316 18:15:18.824063 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-2k4nd" event={"ID":"0188516e-f8ae-4b00-9f66-7b1fef1de9f6","Type":"ContainerDied","Data":"4379de3bedbbd24dbb15983210f171e9f15e0abcf2d996d1bc4d274dd146870b"} Mar 16 18:15:18 crc kubenswrapper[5120]: I0316 18:15:18.824127 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-2k4nd" event={"ID":"0188516e-f8ae-4b00-9f66-7b1fef1de9f6","Type":"ContainerDied","Data":"ccae180016f90d79fcfa5e0b5be6b6401199210a6195eb62f5ea2e6d5ea3393c"} Mar 16 18:15:18 crc kubenswrapper[5120]: I0316 18:15:18.824125 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-2k4nd" Mar 16 18:15:18 crc kubenswrapper[5120]: I0316 18:15:18.824148 5120 scope.go:117] "RemoveContainer" containerID="4379de3bedbbd24dbb15983210f171e9f15e0abcf2d996d1bc4d274dd146870b" Mar 16 18:15:18 crc kubenswrapper[5120]: I0316 18:15:18.842943 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/community-operators-2k4nd"] Mar 16 18:15:18 crc kubenswrapper[5120]: I0316 18:15:18.848101 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/community-operators-2k4nd"] Mar 16 18:15:18 crc kubenswrapper[5120]: I0316 18:15:18.849870 5120 scope.go:117] "RemoveContainer" containerID="a10426722991d9bb94fac9cf020b077512587a7445d421badab202477ea56758" Mar 16 18:15:18 crc kubenswrapper[5120]: I0316 18:15:18.870482 5120 scope.go:117] "RemoveContainer" containerID="766365d5959a95d40d992808285707ba33839d02d8b4f1909d04fcec999d18e8" Mar 16 18:15:18 crc kubenswrapper[5120]: I0316 18:15:18.888658 5120 scope.go:117] "RemoveContainer" containerID="4379de3bedbbd24dbb15983210f171e9f15e0abcf2d996d1bc4d274dd146870b" Mar 16 18:15:18 crc kubenswrapper[5120]: E0316 18:15:18.889147 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4379de3bedbbd24dbb15983210f171e9f15e0abcf2d996d1bc4d274dd146870b\": container with ID starting with 4379de3bedbbd24dbb15983210f171e9f15e0abcf2d996d1bc4d274dd146870b not found: ID does not exist" containerID="4379de3bedbbd24dbb15983210f171e9f15e0abcf2d996d1bc4d274dd146870b" Mar 16 18:15:18 crc kubenswrapper[5120]: I0316 18:15:18.889288 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4379de3bedbbd24dbb15983210f171e9f15e0abcf2d996d1bc4d274dd146870b"} err="failed to get container status \"4379de3bedbbd24dbb15983210f171e9f15e0abcf2d996d1bc4d274dd146870b\": rpc error: code = NotFound desc = could not find container \"4379de3bedbbd24dbb15983210f171e9f15e0abcf2d996d1bc4d274dd146870b\": container with ID starting with 4379de3bedbbd24dbb15983210f171e9f15e0abcf2d996d1bc4d274dd146870b not found: ID does not exist" Mar 16 18:15:18 crc kubenswrapper[5120]: I0316 18:15:18.889395 5120 scope.go:117] "RemoveContainer" containerID="a10426722991d9bb94fac9cf020b077512587a7445d421badab202477ea56758" Mar 16 18:15:18 crc kubenswrapper[5120]: E0316 18:15:18.889793 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a10426722991d9bb94fac9cf020b077512587a7445d421badab202477ea56758\": container with ID starting with a10426722991d9bb94fac9cf020b077512587a7445d421badab202477ea56758 not found: ID does not exist" containerID="a10426722991d9bb94fac9cf020b077512587a7445d421badab202477ea56758" Mar 16 18:15:18 crc kubenswrapper[5120]: I0316 18:15:18.889824 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a10426722991d9bb94fac9cf020b077512587a7445d421badab202477ea56758"} err="failed to get container status \"a10426722991d9bb94fac9cf020b077512587a7445d421badab202477ea56758\": rpc error: code = NotFound desc = could not find container \"a10426722991d9bb94fac9cf020b077512587a7445d421badab202477ea56758\": container with ID starting with a10426722991d9bb94fac9cf020b077512587a7445d421badab202477ea56758 not found: ID does not exist" Mar 16 18:15:18 crc kubenswrapper[5120]: I0316 18:15:18.889842 5120 scope.go:117] "RemoveContainer" containerID="766365d5959a95d40d992808285707ba33839d02d8b4f1909d04fcec999d18e8" Mar 16 18:15:18 crc kubenswrapper[5120]: E0316 18:15:18.890116 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"766365d5959a95d40d992808285707ba33839d02d8b4f1909d04fcec999d18e8\": container with ID starting with 766365d5959a95d40d992808285707ba33839d02d8b4f1909d04fcec999d18e8 not found: ID does not exist" containerID="766365d5959a95d40d992808285707ba33839d02d8b4f1909d04fcec999d18e8" Mar 16 18:15:18 crc kubenswrapper[5120]: I0316 18:15:18.890153 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"766365d5959a95d40d992808285707ba33839d02d8b4f1909d04fcec999d18e8"} err="failed to get container status \"766365d5959a95d40d992808285707ba33839d02d8b4f1909d04fcec999d18e8\": rpc error: code = NotFound desc = could not find container \"766365d5959a95d40d992808285707ba33839d02d8b4f1909d04fcec999d18e8\": container with ID starting with 766365d5959a95d40d992808285707ba33839d02d8b4f1909d04fcec999d18e8 not found: ID does not exist" Mar 16 18:15:19 crc kubenswrapper[5120]: I0316 18:15:19.663800 5120 scope.go:117] "RemoveContainer" containerID="f46f7389db7e312fd9565c65ada72cf5a849906f210a5db0befeb36862170522" Mar 16 18:15:19 crc kubenswrapper[5120]: E0316 18:15:19.664468 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 18:15:20 crc kubenswrapper[5120]: I0316 18:15:20.671842 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0188516e-f8ae-4b00-9f66-7b1fef1de9f6" path="/var/lib/kubelet/pods/0188516e-f8ae-4b00-9f66-7b1fef1de9f6/volumes" Mar 16 18:15:32 crc kubenswrapper[5120]: I0316 18:15:32.663823 5120 scope.go:117] "RemoveContainer" containerID="f46f7389db7e312fd9565c65ada72cf5a849906f210a5db0befeb36862170522" Mar 16 18:15:32 crc kubenswrapper[5120]: E0316 18:15:32.665511 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 18:15:40 crc kubenswrapper[5120]: I0316 18:15:40.622499 5120 scope.go:117] "RemoveContainer" containerID="1f9fe8dc0a2128a2648e1c5d77f328409f7f02cfd9417a6f0afced687561a086" Mar 16 18:15:47 crc kubenswrapper[5120]: I0316 18:15:47.288336 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-marketplace-6dfh6"] Mar 16 18:15:47 crc kubenswrapper[5120]: I0316 18:15:47.290335 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0188516e-f8ae-4b00-9f66-7b1fef1de9f6" containerName="extract-content" Mar 16 18:15:47 crc kubenswrapper[5120]: I0316 18:15:47.293161 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="0188516e-f8ae-4b00-9f66-7b1fef1de9f6" containerName="extract-content" Mar 16 18:15:47 crc kubenswrapper[5120]: I0316 18:15:47.293269 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="889f50a1-49a0-44d7-ba24-3e88935be215" containerName="extract-content" Mar 16 18:15:47 crc kubenswrapper[5120]: I0316 18:15:47.293290 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="889f50a1-49a0-44d7-ba24-3e88935be215" containerName="extract-content" Mar 16 18:15:47 crc kubenswrapper[5120]: I0316 18:15:47.293409 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0188516e-f8ae-4b00-9f66-7b1fef1de9f6" containerName="registry-server" Mar 16 18:15:47 crc kubenswrapper[5120]: I0316 18:15:47.293429 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="0188516e-f8ae-4b00-9f66-7b1fef1de9f6" containerName="registry-server" Mar 16 18:15:47 crc kubenswrapper[5120]: I0316 18:15:47.293461 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0188516e-f8ae-4b00-9f66-7b1fef1de9f6" containerName="extract-utilities" Mar 16 18:15:47 crc kubenswrapper[5120]: I0316 18:15:47.293480 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="0188516e-f8ae-4b00-9f66-7b1fef1de9f6" containerName="extract-utilities" Mar 16 18:15:47 crc kubenswrapper[5120]: I0316 18:15:47.293508 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="889f50a1-49a0-44d7-ba24-3e88935be215" containerName="extract-utilities" Mar 16 18:15:47 crc kubenswrapper[5120]: I0316 18:15:47.293524 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="889f50a1-49a0-44d7-ba24-3e88935be215" containerName="extract-utilities" Mar 16 18:15:47 crc kubenswrapper[5120]: I0316 18:15:47.293549 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="889f50a1-49a0-44d7-ba24-3e88935be215" containerName="registry-server" Mar 16 18:15:47 crc kubenswrapper[5120]: I0316 18:15:47.293566 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="889f50a1-49a0-44d7-ba24-3e88935be215" containerName="registry-server" Mar 16 18:15:47 crc kubenswrapper[5120]: I0316 18:15:47.294004 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="0188516e-f8ae-4b00-9f66-7b1fef1de9f6" containerName="registry-server" Mar 16 18:15:47 crc kubenswrapper[5120]: I0316 18:15:47.294047 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="889f50a1-49a0-44d7-ba24-3e88935be215" containerName="registry-server" Mar 16 18:15:47 crc kubenswrapper[5120]: I0316 18:15:47.314834 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-6dfh6"] Mar 16 18:15:47 crc kubenswrapper[5120]: I0316 18:15:47.315024 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-6dfh6" Mar 16 18:15:47 crc kubenswrapper[5120]: I0316 18:15:47.373317 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbhhj\" (UniqueName: \"kubernetes.io/projected/fc870ee6-d129-43f2-aba0-5813a350169e-kube-api-access-mbhhj\") pod \"redhat-marketplace-6dfh6\" (UID: \"fc870ee6-d129-43f2-aba0-5813a350169e\") " pod="openshift-marketplace/redhat-marketplace-6dfh6" Mar 16 18:15:47 crc kubenswrapper[5120]: I0316 18:15:47.373444 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/fc870ee6-d129-43f2-aba0-5813a350169e-utilities\") pod \"redhat-marketplace-6dfh6\" (UID: \"fc870ee6-d129-43f2-aba0-5813a350169e\") " pod="openshift-marketplace/redhat-marketplace-6dfh6" Mar 16 18:15:47 crc kubenswrapper[5120]: I0316 18:15:47.373512 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/fc870ee6-d129-43f2-aba0-5813a350169e-catalog-content\") pod \"redhat-marketplace-6dfh6\" (UID: \"fc870ee6-d129-43f2-aba0-5813a350169e\") " pod="openshift-marketplace/redhat-marketplace-6dfh6" Mar 16 18:15:47 crc kubenswrapper[5120]: I0316 18:15:47.475797 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mbhhj\" (UniqueName: \"kubernetes.io/projected/fc870ee6-d129-43f2-aba0-5813a350169e-kube-api-access-mbhhj\") pod \"redhat-marketplace-6dfh6\" (UID: \"fc870ee6-d129-43f2-aba0-5813a350169e\") " pod="openshift-marketplace/redhat-marketplace-6dfh6" Mar 16 18:15:47 crc kubenswrapper[5120]: I0316 18:15:47.475922 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/fc870ee6-d129-43f2-aba0-5813a350169e-utilities\") pod \"redhat-marketplace-6dfh6\" (UID: \"fc870ee6-d129-43f2-aba0-5813a350169e\") " pod="openshift-marketplace/redhat-marketplace-6dfh6" Mar 16 18:15:47 crc kubenswrapper[5120]: I0316 18:15:47.475954 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/fc870ee6-d129-43f2-aba0-5813a350169e-catalog-content\") pod \"redhat-marketplace-6dfh6\" (UID: \"fc870ee6-d129-43f2-aba0-5813a350169e\") " pod="openshift-marketplace/redhat-marketplace-6dfh6" Mar 16 18:15:47 crc kubenswrapper[5120]: I0316 18:15:47.476637 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/fc870ee6-d129-43f2-aba0-5813a350169e-catalog-content\") pod \"redhat-marketplace-6dfh6\" (UID: \"fc870ee6-d129-43f2-aba0-5813a350169e\") " pod="openshift-marketplace/redhat-marketplace-6dfh6" Mar 16 18:15:47 crc kubenswrapper[5120]: I0316 18:15:47.476634 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/fc870ee6-d129-43f2-aba0-5813a350169e-utilities\") pod \"redhat-marketplace-6dfh6\" (UID: \"fc870ee6-d129-43f2-aba0-5813a350169e\") " pod="openshift-marketplace/redhat-marketplace-6dfh6" Mar 16 18:15:47 crc kubenswrapper[5120]: I0316 18:15:47.509028 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbhhj\" (UniqueName: \"kubernetes.io/projected/fc870ee6-d129-43f2-aba0-5813a350169e-kube-api-access-mbhhj\") pod \"redhat-marketplace-6dfh6\" (UID: \"fc870ee6-d129-43f2-aba0-5813a350169e\") " pod="openshift-marketplace/redhat-marketplace-6dfh6" Mar 16 18:15:47 crc kubenswrapper[5120]: I0316 18:15:47.646513 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-6dfh6" Mar 16 18:15:47 crc kubenswrapper[5120]: I0316 18:15:47.663974 5120 scope.go:117] "RemoveContainer" containerID="f46f7389db7e312fd9565c65ada72cf5a849906f210a5db0befeb36862170522" Mar 16 18:15:47 crc kubenswrapper[5120]: E0316 18:15:47.664268 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 18:15:48 crc kubenswrapper[5120]: I0316 18:15:48.081425 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-6dfh6"] Mar 16 18:15:48 crc kubenswrapper[5120]: W0316 18:15:48.091940 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc870ee6_d129_43f2_aba0_5813a350169e.slice/crio-7bbe47a1d2e62853c74d84fad539406d725db65e55f870bb7d16c68a58ea919a WatchSource:0}: Error finding container 7bbe47a1d2e62853c74d84fad539406d725db65e55f870bb7d16c68a58ea919a: Status 404 returned error can't find the container with id 7bbe47a1d2e62853c74d84fad539406d725db65e55f870bb7d16c68a58ea919a Mar 16 18:15:49 crc kubenswrapper[5120]: I0316 18:15:49.066094 5120 generic.go:358] "Generic (PLEG): container finished" podID="fc870ee6-d129-43f2-aba0-5813a350169e" containerID="504d22ae43f074cafe166338cd6d0503b3404a50c86a0d939d582e8cca37bef7" exitCode=0 Mar 16 18:15:49 crc kubenswrapper[5120]: I0316 18:15:49.066172 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-6dfh6" event={"ID":"fc870ee6-d129-43f2-aba0-5813a350169e","Type":"ContainerDied","Data":"504d22ae43f074cafe166338cd6d0503b3404a50c86a0d939d582e8cca37bef7"} Mar 16 18:15:49 crc kubenswrapper[5120]: I0316 18:15:49.067326 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-6dfh6" event={"ID":"fc870ee6-d129-43f2-aba0-5813a350169e","Type":"ContainerStarted","Data":"7bbe47a1d2e62853c74d84fad539406d725db65e55f870bb7d16c68a58ea919a"} Mar 16 18:15:52 crc kubenswrapper[5120]: I0316 18:15:52.095600 5120 generic.go:358] "Generic (PLEG): container finished" podID="fc870ee6-d129-43f2-aba0-5813a350169e" containerID="09774f161e1cfffd4087dd3f35c8b5f39af700ce833f10550b17ebbc148bcd07" exitCode=0 Mar 16 18:15:52 crc kubenswrapper[5120]: I0316 18:15:52.095683 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-6dfh6" event={"ID":"fc870ee6-d129-43f2-aba0-5813a350169e","Type":"ContainerDied","Data":"09774f161e1cfffd4087dd3f35c8b5f39af700ce833f10550b17ebbc148bcd07"} Mar 16 18:15:53 crc kubenswrapper[5120]: I0316 18:15:53.107206 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-6dfh6" event={"ID":"fc870ee6-d129-43f2-aba0-5813a350169e","Type":"ContainerStarted","Data":"86ca3e3edff0db71bf19f54b99ef4f4a8c2b8b26a18be0cb54a0c88f86a1eb69"} Mar 16 18:15:53 crc kubenswrapper[5120]: I0316 18:15:53.138577 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/redhat-marketplace-6dfh6" podStartSLOduration=3.741185776 podStartE2EDuration="6.138541935s" podCreationTimestamp="2026-03-16 18:15:47 +0000 UTC" firstStartedPulling="2026-03-16 18:15:49.067011406 +0000 UTC m=+9851.220943063" lastFinishedPulling="2026-03-16 18:15:51.464367565 +0000 UTC m=+9853.618299222" observedRunningTime="2026-03-16 18:15:53.133391635 +0000 UTC m=+9855.287323332" watchObservedRunningTime="2026-03-16 18:15:53.138541935 +0000 UTC m=+9855.292473642" Mar 16 18:15:57 crc kubenswrapper[5120]: I0316 18:15:57.646741 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-marketplace-6dfh6" Mar 16 18:15:57 crc kubenswrapper[5120]: I0316 18:15:57.647144 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-marketplace/redhat-marketplace-6dfh6" Mar 16 18:15:57 crc kubenswrapper[5120]: I0316 18:15:57.707966 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-marketplace-6dfh6" Mar 16 18:15:58 crc kubenswrapper[5120]: I0316 18:15:58.218352 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-marketplace-6dfh6" Mar 16 18:15:58 crc kubenswrapper[5120]: I0316 18:15:58.285529 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-marketplace-6dfh6"] Mar 16 18:16:00 crc kubenswrapper[5120]: I0316 18:16:00.138023 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-infra/auto-csr-approver-29561416-brblg"] Mar 16 18:16:00 crc kubenswrapper[5120]: I0316 18:16:00.156320 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561416-brblg"] Mar 16 18:16:00 crc kubenswrapper[5120]: I0316 18:16:00.156516 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561416-brblg" Mar 16 18:16:00 crc kubenswrapper[5120]: I0316 18:16:00.161190 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"kube-root-ca.crt\"" Mar 16 18:16:00 crc kubenswrapper[5120]: I0316 18:16:00.161295 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-infra\"/\"csr-approver-sa-dockercfg-x2nsz\"" Mar 16 18:16:00 crc kubenswrapper[5120]: I0316 18:16:00.163145 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"openshift-service-ca.crt\"" Mar 16 18:16:00 crc kubenswrapper[5120]: I0316 18:16:00.174799 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-marketplace/redhat-marketplace-6dfh6" podUID="fc870ee6-d129-43f2-aba0-5813a350169e" containerName="registry-server" containerID="cri-o://86ca3e3edff0db71bf19f54b99ef4f4a8c2b8b26a18be0cb54a0c88f86a1eb69" gracePeriod=2 Mar 16 18:16:00 crc kubenswrapper[5120]: I0316 18:16:00.318023 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clvhk\" (UniqueName: \"kubernetes.io/projected/48aace43-50f9-4103-8425-168de74dde68-kube-api-access-clvhk\") pod \"auto-csr-approver-29561416-brblg\" (UID: \"48aace43-50f9-4103-8425-168de74dde68\") " pod="openshift-infra/auto-csr-approver-29561416-brblg" Mar 16 18:16:00 crc kubenswrapper[5120]: I0316 18:16:00.420841 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-clvhk\" (UniqueName: \"kubernetes.io/projected/48aace43-50f9-4103-8425-168de74dde68-kube-api-access-clvhk\") pod \"auto-csr-approver-29561416-brblg\" (UID: \"48aace43-50f9-4103-8425-168de74dde68\") " pod="openshift-infra/auto-csr-approver-29561416-brblg" Mar 16 18:16:00 crc kubenswrapper[5120]: I0316 18:16:00.449640 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-clvhk\" (UniqueName: \"kubernetes.io/projected/48aace43-50f9-4103-8425-168de74dde68-kube-api-access-clvhk\") pod \"auto-csr-approver-29561416-brblg\" (UID: \"48aace43-50f9-4103-8425-168de74dde68\") " pod="openshift-infra/auto-csr-approver-29561416-brblg" Mar 16 18:16:00 crc kubenswrapper[5120]: I0316 18:16:00.495599 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561416-brblg" Mar 16 18:16:00 crc kubenswrapper[5120]: I0316 18:16:00.580429 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-6dfh6" Mar 16 18:16:00 crc kubenswrapper[5120]: I0316 18:16:00.737548 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mbhhj\" (UniqueName: \"kubernetes.io/projected/fc870ee6-d129-43f2-aba0-5813a350169e-kube-api-access-mbhhj\") pod \"fc870ee6-d129-43f2-aba0-5813a350169e\" (UID: \"fc870ee6-d129-43f2-aba0-5813a350169e\") " Mar 16 18:16:00 crc kubenswrapper[5120]: I0316 18:16:00.737964 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/fc870ee6-d129-43f2-aba0-5813a350169e-utilities\") pod \"fc870ee6-d129-43f2-aba0-5813a350169e\" (UID: \"fc870ee6-d129-43f2-aba0-5813a350169e\") " Mar 16 18:16:00 crc kubenswrapper[5120]: I0316 18:16:00.738127 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/fc870ee6-d129-43f2-aba0-5813a350169e-catalog-content\") pod \"fc870ee6-d129-43f2-aba0-5813a350169e\" (UID: \"fc870ee6-d129-43f2-aba0-5813a350169e\") " Mar 16 18:16:00 crc kubenswrapper[5120]: I0316 18:16:00.738847 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc870ee6-d129-43f2-aba0-5813a350169e-utilities" (OuterVolumeSpecName: "utilities") pod "fc870ee6-d129-43f2-aba0-5813a350169e" (UID: "fc870ee6-d129-43f2-aba0-5813a350169e"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 18:16:00 crc kubenswrapper[5120]: I0316 18:16:00.739300 5120 reconciler_common.go:299] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/fc870ee6-d129-43f2-aba0-5813a350169e-utilities\") on node \"crc\" DevicePath \"\"" Mar 16 18:16:00 crc kubenswrapper[5120]: I0316 18:16:00.742390 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc870ee6-d129-43f2-aba0-5813a350169e-kube-api-access-mbhhj" (OuterVolumeSpecName: "kube-api-access-mbhhj") pod "fc870ee6-d129-43f2-aba0-5813a350169e" (UID: "fc870ee6-d129-43f2-aba0-5813a350169e"). InnerVolumeSpecName "kube-api-access-mbhhj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 18:16:00 crc kubenswrapper[5120]: I0316 18:16:00.763227 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc870ee6-d129-43f2-aba0-5813a350169e-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "fc870ee6-d129-43f2-aba0-5813a350169e" (UID: "fc870ee6-d129-43f2-aba0-5813a350169e"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 18:16:00 crc kubenswrapper[5120]: I0316 18:16:00.842069 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mbhhj\" (UniqueName: \"kubernetes.io/projected/fc870ee6-d129-43f2-aba0-5813a350169e-kube-api-access-mbhhj\") on node \"crc\" DevicePath \"\"" Mar 16 18:16:00 crc kubenswrapper[5120]: I0316 18:16:00.842115 5120 reconciler_common.go:299] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/fc870ee6-d129-43f2-aba0-5813a350169e-catalog-content\") on node \"crc\" DevicePath \"\"" Mar 16 18:16:00 crc kubenswrapper[5120]: I0316 18:16:00.960681 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561416-brblg"] Mar 16 18:16:01 crc kubenswrapper[5120]: I0316 18:16:01.188157 5120 generic.go:358] "Generic (PLEG): container finished" podID="fc870ee6-d129-43f2-aba0-5813a350169e" containerID="86ca3e3edff0db71bf19f54b99ef4f4a8c2b8b26a18be0cb54a0c88f86a1eb69" exitCode=0 Mar 16 18:16:01 crc kubenswrapper[5120]: I0316 18:16:01.188401 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-6dfh6" event={"ID":"fc870ee6-d129-43f2-aba0-5813a350169e","Type":"ContainerDied","Data":"86ca3e3edff0db71bf19f54b99ef4f4a8c2b8b26a18be0cb54a0c88f86a1eb69"} Mar 16 18:16:01 crc kubenswrapper[5120]: I0316 18:16:01.188444 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-6dfh6" event={"ID":"fc870ee6-d129-43f2-aba0-5813a350169e","Type":"ContainerDied","Data":"7bbe47a1d2e62853c74d84fad539406d725db65e55f870bb7d16c68a58ea919a"} Mar 16 18:16:01 crc kubenswrapper[5120]: I0316 18:16:01.188450 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-6dfh6" Mar 16 18:16:01 crc kubenswrapper[5120]: I0316 18:16:01.188462 5120 scope.go:117] "RemoveContainer" containerID="86ca3e3edff0db71bf19f54b99ef4f4a8c2b8b26a18be0cb54a0c88f86a1eb69" Mar 16 18:16:01 crc kubenswrapper[5120]: I0316 18:16:01.191490 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561416-brblg" event={"ID":"48aace43-50f9-4103-8425-168de74dde68","Type":"ContainerStarted","Data":"867d12b8edb725ab202664599b85eb42a567989a3a27125ef45c7e38c09cfd8a"} Mar 16 18:16:01 crc kubenswrapper[5120]: I0316 18:16:01.215147 5120 scope.go:117] "RemoveContainer" containerID="09774f161e1cfffd4087dd3f35c8b5f39af700ce833f10550b17ebbc148bcd07" Mar 16 18:16:01 crc kubenswrapper[5120]: I0316 18:16:01.240456 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-marketplace-6dfh6"] Mar 16 18:16:01 crc kubenswrapper[5120]: I0316 18:16:01.240944 5120 scope.go:117] "RemoveContainer" containerID="504d22ae43f074cafe166338cd6d0503b3404a50c86a0d939d582e8cca37bef7" Mar 16 18:16:01 crc kubenswrapper[5120]: I0316 18:16:01.249110 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/redhat-marketplace-6dfh6"] Mar 16 18:16:01 crc kubenswrapper[5120]: I0316 18:16:01.263878 5120 scope.go:117] "RemoveContainer" containerID="86ca3e3edff0db71bf19f54b99ef4f4a8c2b8b26a18be0cb54a0c88f86a1eb69" Mar 16 18:16:01 crc kubenswrapper[5120]: E0316 18:16:01.264261 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"86ca3e3edff0db71bf19f54b99ef4f4a8c2b8b26a18be0cb54a0c88f86a1eb69\": container with ID starting with 86ca3e3edff0db71bf19f54b99ef4f4a8c2b8b26a18be0cb54a0c88f86a1eb69 not found: ID does not exist" containerID="86ca3e3edff0db71bf19f54b99ef4f4a8c2b8b26a18be0cb54a0c88f86a1eb69" Mar 16 18:16:01 crc kubenswrapper[5120]: I0316 18:16:01.264288 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86ca3e3edff0db71bf19f54b99ef4f4a8c2b8b26a18be0cb54a0c88f86a1eb69"} err="failed to get container status \"86ca3e3edff0db71bf19f54b99ef4f4a8c2b8b26a18be0cb54a0c88f86a1eb69\": rpc error: code = NotFound desc = could not find container \"86ca3e3edff0db71bf19f54b99ef4f4a8c2b8b26a18be0cb54a0c88f86a1eb69\": container with ID starting with 86ca3e3edff0db71bf19f54b99ef4f4a8c2b8b26a18be0cb54a0c88f86a1eb69 not found: ID does not exist" Mar 16 18:16:01 crc kubenswrapper[5120]: I0316 18:16:01.264306 5120 scope.go:117] "RemoveContainer" containerID="09774f161e1cfffd4087dd3f35c8b5f39af700ce833f10550b17ebbc148bcd07" Mar 16 18:16:01 crc kubenswrapper[5120]: E0316 18:16:01.264604 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"09774f161e1cfffd4087dd3f35c8b5f39af700ce833f10550b17ebbc148bcd07\": container with ID starting with 09774f161e1cfffd4087dd3f35c8b5f39af700ce833f10550b17ebbc148bcd07 not found: ID does not exist" containerID="09774f161e1cfffd4087dd3f35c8b5f39af700ce833f10550b17ebbc148bcd07" Mar 16 18:16:01 crc kubenswrapper[5120]: I0316 18:16:01.264627 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09774f161e1cfffd4087dd3f35c8b5f39af700ce833f10550b17ebbc148bcd07"} err="failed to get container status \"09774f161e1cfffd4087dd3f35c8b5f39af700ce833f10550b17ebbc148bcd07\": rpc error: code = NotFound desc = could not find container \"09774f161e1cfffd4087dd3f35c8b5f39af700ce833f10550b17ebbc148bcd07\": container with ID starting with 09774f161e1cfffd4087dd3f35c8b5f39af700ce833f10550b17ebbc148bcd07 not found: ID does not exist" Mar 16 18:16:01 crc kubenswrapper[5120]: I0316 18:16:01.264642 5120 scope.go:117] "RemoveContainer" containerID="504d22ae43f074cafe166338cd6d0503b3404a50c86a0d939d582e8cca37bef7" Mar 16 18:16:01 crc kubenswrapper[5120]: E0316 18:16:01.264998 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"504d22ae43f074cafe166338cd6d0503b3404a50c86a0d939d582e8cca37bef7\": container with ID starting with 504d22ae43f074cafe166338cd6d0503b3404a50c86a0d939d582e8cca37bef7 not found: ID does not exist" containerID="504d22ae43f074cafe166338cd6d0503b3404a50c86a0d939d582e8cca37bef7" Mar 16 18:16:01 crc kubenswrapper[5120]: I0316 18:16:01.265075 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"504d22ae43f074cafe166338cd6d0503b3404a50c86a0d939d582e8cca37bef7"} err="failed to get container status \"504d22ae43f074cafe166338cd6d0503b3404a50c86a0d939d582e8cca37bef7\": rpc error: code = NotFound desc = could not find container \"504d22ae43f074cafe166338cd6d0503b3404a50c86a0d939d582e8cca37bef7\": container with ID starting with 504d22ae43f074cafe166338cd6d0503b3404a50c86a0d939d582e8cca37bef7 not found: ID does not exist" Mar 16 18:16:01 crc kubenswrapper[5120]: I0316 18:16:01.663372 5120 scope.go:117] "RemoveContainer" containerID="f46f7389db7e312fd9565c65ada72cf5a849906f210a5db0befeb36862170522" Mar 16 18:16:01 crc kubenswrapper[5120]: E0316 18:16:01.663924 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 18:16:02 crc kubenswrapper[5120]: I0316 18:16:02.673901 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc870ee6-d129-43f2-aba0-5813a350169e" path="/var/lib/kubelet/pods/fc870ee6-d129-43f2-aba0-5813a350169e/volumes" Mar 16 18:16:03 crc kubenswrapper[5120]: I0316 18:16:03.209392 5120 generic.go:358] "Generic (PLEG): container finished" podID="48aace43-50f9-4103-8425-168de74dde68" containerID="103006db7ea5d57b6c22e2afaf14dcb7a8f5c4d683b30c9b37898bcd1e97645c" exitCode=0 Mar 16 18:16:03 crc kubenswrapper[5120]: I0316 18:16:03.209453 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561416-brblg" event={"ID":"48aace43-50f9-4103-8425-168de74dde68","Type":"ContainerDied","Data":"103006db7ea5d57b6c22e2afaf14dcb7a8f5c4d683b30c9b37898bcd1e97645c"} Mar 16 18:16:04 crc kubenswrapper[5120]: I0316 18:16:04.575009 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561416-brblg" Mar 16 18:16:04 crc kubenswrapper[5120]: I0316 18:16:04.639991 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-clvhk\" (UniqueName: \"kubernetes.io/projected/48aace43-50f9-4103-8425-168de74dde68-kube-api-access-clvhk\") pod \"48aace43-50f9-4103-8425-168de74dde68\" (UID: \"48aace43-50f9-4103-8425-168de74dde68\") " Mar 16 18:16:04 crc kubenswrapper[5120]: I0316 18:16:04.650438 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48aace43-50f9-4103-8425-168de74dde68-kube-api-access-clvhk" (OuterVolumeSpecName: "kube-api-access-clvhk") pod "48aace43-50f9-4103-8425-168de74dde68" (UID: "48aace43-50f9-4103-8425-168de74dde68"). InnerVolumeSpecName "kube-api-access-clvhk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 18:16:04 crc kubenswrapper[5120]: I0316 18:16:04.744961 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-clvhk\" (UniqueName: \"kubernetes.io/projected/48aace43-50f9-4103-8425-168de74dde68-kube-api-access-clvhk\") on node \"crc\" DevicePath \"\"" Mar 16 18:16:05 crc kubenswrapper[5120]: I0316 18:16:05.233256 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561416-brblg" Mar 16 18:16:05 crc kubenswrapper[5120]: I0316 18:16:05.233313 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561416-brblg" event={"ID":"48aace43-50f9-4103-8425-168de74dde68","Type":"ContainerDied","Data":"867d12b8edb725ab202664599b85eb42a567989a3a27125ef45c7e38c09cfd8a"} Mar 16 18:16:05 crc kubenswrapper[5120]: I0316 18:16:05.233375 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="867d12b8edb725ab202664599b85eb42a567989a3a27125ef45c7e38c09cfd8a" Mar 16 18:16:05 crc kubenswrapper[5120]: I0316 18:16:05.644008 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-infra/auto-csr-approver-29561410-5zftd"] Mar 16 18:16:05 crc kubenswrapper[5120]: I0316 18:16:05.653420 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-infra/auto-csr-approver-29561410-5zftd"] Mar 16 18:16:06 crc kubenswrapper[5120]: I0316 18:16:06.672162 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c2aa59e9-8b03-4903-9990-c7e6b111acfb" path="/var/lib/kubelet/pods/c2aa59e9-8b03-4903-9990-c7e6b111acfb/volumes" Mar 16 18:16:07 crc kubenswrapper[5120]: E0316 18:16:07.288372 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=848757 actualBytes=10240 Mar 16 18:16:15 crc kubenswrapper[5120]: I0316 18:16:15.664941 5120 scope.go:117] "RemoveContainer" containerID="f46f7389db7e312fd9565c65ada72cf5a849906f210a5db0befeb36862170522" Mar 16 18:16:15 crc kubenswrapper[5120]: E0316 18:16:15.666294 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 18:16:27 crc kubenswrapper[5120]: I0316 18:16:27.663824 5120 scope.go:117] "RemoveContainer" containerID="f46f7389db7e312fd9565c65ada72cf5a849906f210a5db0befeb36862170522" Mar 16 18:16:27 crc kubenswrapper[5120]: E0316 18:16:27.665161 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 18:16:39 crc kubenswrapper[5120]: I0316 18:16:39.507047 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-x94n6/must-gather-8fg6g"] Mar 16 18:16:39 crc kubenswrapper[5120]: I0316 18:16:39.508246 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48aace43-50f9-4103-8425-168de74dde68" containerName="oc" Mar 16 18:16:39 crc kubenswrapper[5120]: I0316 18:16:39.508259 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="48aace43-50f9-4103-8425-168de74dde68" containerName="oc" Mar 16 18:16:39 crc kubenswrapper[5120]: I0316 18:16:39.508290 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc870ee6-d129-43f2-aba0-5813a350169e" containerName="registry-server" Mar 16 18:16:39 crc kubenswrapper[5120]: I0316 18:16:39.508296 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc870ee6-d129-43f2-aba0-5813a350169e" containerName="registry-server" Mar 16 18:16:39 crc kubenswrapper[5120]: I0316 18:16:39.508305 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc870ee6-d129-43f2-aba0-5813a350169e" containerName="extract-content" Mar 16 18:16:39 crc kubenswrapper[5120]: I0316 18:16:39.508311 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc870ee6-d129-43f2-aba0-5813a350169e" containerName="extract-content" Mar 16 18:16:39 crc kubenswrapper[5120]: I0316 18:16:39.508319 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc870ee6-d129-43f2-aba0-5813a350169e" containerName="extract-utilities" Mar 16 18:16:39 crc kubenswrapper[5120]: I0316 18:16:39.508328 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc870ee6-d129-43f2-aba0-5813a350169e" containerName="extract-utilities" Mar 16 18:16:39 crc kubenswrapper[5120]: I0316 18:16:39.508441 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="fc870ee6-d129-43f2-aba0-5813a350169e" containerName="registry-server" Mar 16 18:16:39 crc kubenswrapper[5120]: I0316 18:16:39.508462 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="48aace43-50f9-4103-8425-168de74dde68" containerName="oc" Mar 16 18:16:39 crc kubenswrapper[5120]: I0316 18:16:39.512476 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-x94n6/must-gather-8fg6g" Mar 16 18:16:39 crc kubenswrapper[5120]: I0316 18:16:39.515523 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-x94n6\"/\"kube-root-ca.crt\"" Mar 16 18:16:39 crc kubenswrapper[5120]: I0316 18:16:39.515741 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-x94n6\"/\"openshift-service-ca.crt\"" Mar 16 18:16:39 crc kubenswrapper[5120]: I0316 18:16:39.525552 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-x94n6/must-gather-8fg6g"] Mar 16 18:16:39 crc kubenswrapper[5120]: I0316 18:16:39.664999 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/79239ef7-5426-4073-a771-86e043c73768-must-gather-output\") pod \"must-gather-8fg6g\" (UID: \"79239ef7-5426-4073-a771-86e043c73768\") " pod="openshift-must-gather-x94n6/must-gather-8fg6g" Mar 16 18:16:39 crc kubenswrapper[5120]: I0316 18:16:39.665140 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wl6b\" (UniqueName: \"kubernetes.io/projected/79239ef7-5426-4073-a771-86e043c73768-kube-api-access-5wl6b\") pod \"must-gather-8fg6g\" (UID: \"79239ef7-5426-4073-a771-86e043c73768\") " pod="openshift-must-gather-x94n6/must-gather-8fg6g" Mar 16 18:16:39 crc kubenswrapper[5120]: I0316 18:16:39.766489 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/79239ef7-5426-4073-a771-86e043c73768-must-gather-output\") pod \"must-gather-8fg6g\" (UID: \"79239ef7-5426-4073-a771-86e043c73768\") " pod="openshift-must-gather-x94n6/must-gather-8fg6g" Mar 16 18:16:39 crc kubenswrapper[5120]: I0316 18:16:39.766685 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5wl6b\" (UniqueName: \"kubernetes.io/projected/79239ef7-5426-4073-a771-86e043c73768-kube-api-access-5wl6b\") pod \"must-gather-8fg6g\" (UID: \"79239ef7-5426-4073-a771-86e043c73768\") " pod="openshift-must-gather-x94n6/must-gather-8fg6g" Mar 16 18:16:39 crc kubenswrapper[5120]: I0316 18:16:39.767072 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/79239ef7-5426-4073-a771-86e043c73768-must-gather-output\") pod \"must-gather-8fg6g\" (UID: \"79239ef7-5426-4073-a771-86e043c73768\") " pod="openshift-must-gather-x94n6/must-gather-8fg6g" Mar 16 18:16:39 crc kubenswrapper[5120]: I0316 18:16:39.787728 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wl6b\" (UniqueName: \"kubernetes.io/projected/79239ef7-5426-4073-a771-86e043c73768-kube-api-access-5wl6b\") pod \"must-gather-8fg6g\" (UID: \"79239ef7-5426-4073-a771-86e043c73768\") " pod="openshift-must-gather-x94n6/must-gather-8fg6g" Mar 16 18:16:39 crc kubenswrapper[5120]: I0316 18:16:39.832060 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-x94n6/must-gather-8fg6g" Mar 16 18:16:40 crc kubenswrapper[5120]: I0316 18:16:40.224630 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-x94n6/must-gather-8fg6g"] Mar 16 18:16:40 crc kubenswrapper[5120]: W0316 18:16:40.229145 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod79239ef7_5426_4073_a771_86e043c73768.slice/crio-a370413d6bcc7d7faf65ae4fba38aa0d3823a1641bac8dce3dd0c10e1089e001 WatchSource:0}: Error finding container a370413d6bcc7d7faf65ae4fba38aa0d3823a1641bac8dce3dd0c10e1089e001: Status 404 returned error can't find the container with id a370413d6bcc7d7faf65ae4fba38aa0d3823a1641bac8dce3dd0c10e1089e001 Mar 16 18:16:40 crc kubenswrapper[5120]: I0316 18:16:40.550652 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-x94n6/must-gather-8fg6g" event={"ID":"79239ef7-5426-4073-a771-86e043c73768","Type":"ContainerStarted","Data":"9a192c0cc210757c626e0dbd3034bdc942da2f881639dea1a81e61f6e8c997ad"} Mar 16 18:16:40 crc kubenswrapper[5120]: I0316 18:16:40.550728 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-x94n6/must-gather-8fg6g" event={"ID":"79239ef7-5426-4073-a771-86e043c73768","Type":"ContainerStarted","Data":"a370413d6bcc7d7faf65ae4fba38aa0d3823a1641bac8dce3dd0c10e1089e001"} Mar 16 18:16:40 crc kubenswrapper[5120]: I0316 18:16:40.743713 5120 scope.go:117] "RemoveContainer" containerID="78ffa240f855966cb8d48a05113db961fa800c58da16db29a16c672be711839f" Mar 16 18:16:41 crc kubenswrapper[5120]: I0316 18:16:41.557183 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-x94n6/must-gather-8fg6g" event={"ID":"79239ef7-5426-4073-a771-86e043c73768","Type":"ContainerStarted","Data":"f2f1672448895941ab31acfe592030c59c0dc3cb21849f5d8a56fc4ace927711"} Mar 16 18:16:41 crc kubenswrapper[5120]: I0316 18:16:41.572914 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-x94n6/must-gather-8fg6g" podStartSLOduration=2.572898398 podStartE2EDuration="2.572898398s" podCreationTimestamp="2026-03-16 18:16:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 18:16:41.571822209 +0000 UTC m=+9903.725753906" watchObservedRunningTime="2026-03-16 18:16:41.572898398 +0000 UTC m=+9903.726830055" Mar 16 18:16:41 crc kubenswrapper[5120]: I0316 18:16:41.664311 5120 scope.go:117] "RemoveContainer" containerID="f46f7389db7e312fd9565c65ada72cf5a849906f210a5db0befeb36862170522" Mar 16 18:16:41 crc kubenswrapper[5120]: E0316 18:16:41.664567 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 18:16:48 crc kubenswrapper[5120]: I0316 18:16:48.605126 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-v822j_ac55471d-4e42-475f-a082-50f611571482/kube-multus/0.log" Mar 16 18:16:48 crc kubenswrapper[5120]: I0316 18:16:48.611474 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-crc_9f0bc7fcb0822a2c13eb2d22cd8c0641/kube-controller-manager/0.log" Mar 16 18:16:48 crc kubenswrapper[5120]: I0316 18:16:48.884380 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-v822j_ac55471d-4e42-475f-a082-50f611571482/kube-multus/0.log" Mar 16 18:16:48 crc kubenswrapper[5120]: I0316 18:16:48.887994 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-crc_9f0bc7fcb0822a2c13eb2d22cd8c0641/kube-controller-manager/0.log" Mar 16 18:16:54 crc kubenswrapper[5120]: I0316 18:16:54.663881 5120 scope.go:117] "RemoveContainer" containerID="f46f7389db7e312fd9565c65ada72cf5a849906f210a5db0befeb36862170522" Mar 16 18:16:54 crc kubenswrapper[5120]: E0316 18:16:54.664642 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 18:17:07 crc kubenswrapper[5120]: E0316 18:17:07.379916 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=885111 actualBytes=10240 Mar 16 18:17:09 crc kubenswrapper[5120]: I0316 18:17:09.663946 5120 scope.go:117] "RemoveContainer" containerID="f46f7389db7e312fd9565c65ada72cf5a849906f210a5db0befeb36862170522" Mar 16 18:17:09 crc kubenswrapper[5120]: E0316 18:17:09.664231 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 18:17:23 crc kubenswrapper[5120]: I0316 18:17:23.665324 5120 scope.go:117] "RemoveContainer" containerID="f46f7389db7e312fd9565c65ada72cf5a849906f210a5db0befeb36862170522" Mar 16 18:17:23 crc kubenswrapper[5120]: E0316 18:17:23.666477 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 18:17:35 crc kubenswrapper[5120]: I0316 18:17:35.663806 5120 scope.go:117] "RemoveContainer" containerID="f46f7389db7e312fd9565c65ada72cf5a849906f210a5db0befeb36862170522" Mar 16 18:17:35 crc kubenswrapper[5120]: E0316 18:17:35.664568 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 18:17:46 crc kubenswrapper[5120]: I0316 18:17:46.663484 5120 scope.go:117] "RemoveContainer" containerID="f46f7389db7e312fd9565c65ada72cf5a849906f210a5db0befeb36862170522" Mar 16 18:17:46 crc kubenswrapper[5120]: E0316 18:17:46.664593 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 18:17:54 crc kubenswrapper[5120]: I0316 18:17:54.595305 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-api_control-plane-machine-set-operator-75ffdb6fcd-htqkp_3b41e06b-0932-41d2-947a-e38b1ff52ec3/control-plane-machine-set-operator/0.log" Mar 16 18:17:54 crc kubenswrapper[5120]: I0316 18:17:54.784436 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-api_machine-api-operator-755bb95488-5t49b_c86a3068-6ba1-40ef-9774-6a9efa5e0db6/kube-rbac-proxy/0.log" Mar 16 18:17:54 crc kubenswrapper[5120]: I0316 18:17:54.792322 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-api_machine-api-operator-755bb95488-5t49b_c86a3068-6ba1-40ef-9774-6a9efa5e0db6/machine-api-operator/0.log" Mar 16 18:17:57 crc kubenswrapper[5120]: I0316 18:17:57.663709 5120 scope.go:117] "RemoveContainer" containerID="f46f7389db7e312fd9565c65ada72cf5a849906f210a5db0befeb36862170522" Mar 16 18:17:57 crc kubenswrapper[5120]: E0316 18:17:57.664258 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 18:18:00 crc kubenswrapper[5120]: I0316 18:18:00.154554 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-infra/auto-csr-approver-29561418-tz622"] Mar 16 18:18:00 crc kubenswrapper[5120]: I0316 18:18:00.186998 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561418-tz622"] Mar 16 18:18:00 crc kubenswrapper[5120]: I0316 18:18:00.187133 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561418-tz622" Mar 16 18:18:00 crc kubenswrapper[5120]: I0316 18:18:00.189414 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-infra\"/\"csr-approver-sa-dockercfg-x2nsz\"" Mar 16 18:18:00 crc kubenswrapper[5120]: I0316 18:18:00.189957 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"openshift-service-ca.crt\"" Mar 16 18:18:00 crc kubenswrapper[5120]: I0316 18:18:00.190412 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"kube-root-ca.crt\"" Mar 16 18:18:00 crc kubenswrapper[5120]: I0316 18:18:00.217303 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pslw2\" (UniqueName: \"kubernetes.io/projected/6bb1f1d3-b165-49a5-adcb-09bf50d83fbf-kube-api-access-pslw2\") pod \"auto-csr-approver-29561418-tz622\" (UID: \"6bb1f1d3-b165-49a5-adcb-09bf50d83fbf\") " pod="openshift-infra/auto-csr-approver-29561418-tz622" Mar 16 18:18:00 crc kubenswrapper[5120]: I0316 18:18:00.321565 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pslw2\" (UniqueName: \"kubernetes.io/projected/6bb1f1d3-b165-49a5-adcb-09bf50d83fbf-kube-api-access-pslw2\") pod \"auto-csr-approver-29561418-tz622\" (UID: \"6bb1f1d3-b165-49a5-adcb-09bf50d83fbf\") " pod="openshift-infra/auto-csr-approver-29561418-tz622" Mar 16 18:18:00 crc kubenswrapper[5120]: I0316 18:18:00.341138 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pslw2\" (UniqueName: \"kubernetes.io/projected/6bb1f1d3-b165-49a5-adcb-09bf50d83fbf-kube-api-access-pslw2\") pod \"auto-csr-approver-29561418-tz622\" (UID: \"6bb1f1d3-b165-49a5-adcb-09bf50d83fbf\") " pod="openshift-infra/auto-csr-approver-29561418-tz622" Mar 16 18:18:00 crc kubenswrapper[5120]: I0316 18:18:00.516858 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561418-tz622" Mar 16 18:18:00 crc kubenswrapper[5120]: I0316 18:18:00.961463 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561418-tz622"] Mar 16 18:18:00 crc kubenswrapper[5120]: W0316 18:18:00.968793 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6bb1f1d3_b165_49a5_adcb_09bf50d83fbf.slice/crio-c41f45295cc845114b5e71fd8d027298d6c5ef89896bb9ff0b5c17b23af17572 WatchSource:0}: Error finding container c41f45295cc845114b5e71fd8d027298d6c5ef89896bb9ff0b5c17b23af17572: Status 404 returned error can't find the container with id c41f45295cc845114b5e71fd8d027298d6c5ef89896bb9ff0b5c17b23af17572 Mar 16 18:18:00 crc kubenswrapper[5120]: I0316 18:18:00.970739 5120 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Mar 16 18:18:01 crc kubenswrapper[5120]: I0316 18:18:01.107220 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561418-tz622" event={"ID":"6bb1f1d3-b165-49a5-adcb-09bf50d83fbf","Type":"ContainerStarted","Data":"c41f45295cc845114b5e71fd8d027298d6c5ef89896bb9ff0b5c17b23af17572"} Mar 16 18:18:04 crc kubenswrapper[5120]: I0316 18:18:04.132905 5120 generic.go:358] "Generic (PLEG): container finished" podID="6bb1f1d3-b165-49a5-adcb-09bf50d83fbf" containerID="e5912d264b28dd86760ee643ceb1d86c432e5b9fd8d38efa0ef72f087c223283" exitCode=0 Mar 16 18:18:04 crc kubenswrapper[5120]: I0316 18:18:04.133017 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561418-tz622" event={"ID":"6bb1f1d3-b165-49a5-adcb-09bf50d83fbf","Type":"ContainerDied","Data":"e5912d264b28dd86760ee643ceb1d86c432e5b9fd8d38efa0ef72f087c223283"} Mar 16 18:18:05 crc kubenswrapper[5120]: I0316 18:18:05.462636 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561418-tz622" Mar 16 18:18:05 crc kubenswrapper[5120]: I0316 18:18:05.648643 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pslw2\" (UniqueName: \"kubernetes.io/projected/6bb1f1d3-b165-49a5-adcb-09bf50d83fbf-kube-api-access-pslw2\") pod \"6bb1f1d3-b165-49a5-adcb-09bf50d83fbf\" (UID: \"6bb1f1d3-b165-49a5-adcb-09bf50d83fbf\") " Mar 16 18:18:05 crc kubenswrapper[5120]: I0316 18:18:05.654615 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6bb1f1d3-b165-49a5-adcb-09bf50d83fbf-kube-api-access-pslw2" (OuterVolumeSpecName: "kube-api-access-pslw2") pod "6bb1f1d3-b165-49a5-adcb-09bf50d83fbf" (UID: "6bb1f1d3-b165-49a5-adcb-09bf50d83fbf"). InnerVolumeSpecName "kube-api-access-pslw2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 18:18:05 crc kubenswrapper[5120]: I0316 18:18:05.751504 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pslw2\" (UniqueName: \"kubernetes.io/projected/6bb1f1d3-b165-49a5-adcb-09bf50d83fbf-kube-api-access-pslw2\") on node \"crc\" DevicePath \"\"" Mar 16 18:18:06 crc kubenswrapper[5120]: I0316 18:18:06.151211 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561418-tz622" event={"ID":"6bb1f1d3-b165-49a5-adcb-09bf50d83fbf","Type":"ContainerDied","Data":"c41f45295cc845114b5e71fd8d027298d6c5ef89896bb9ff0b5c17b23af17572"} Mar 16 18:18:06 crc kubenswrapper[5120]: I0316 18:18:06.151276 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c41f45295cc845114b5e71fd8d027298d6c5ef89896bb9ff0b5c17b23af17572" Mar 16 18:18:06 crc kubenswrapper[5120]: I0316 18:18:06.151238 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561418-tz622" Mar 16 18:18:06 crc kubenswrapper[5120]: I0316 18:18:06.530197 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-infra/auto-csr-approver-29561412-72t8b"] Mar 16 18:18:06 crc kubenswrapper[5120]: I0316 18:18:06.535399 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-infra/auto-csr-approver-29561412-72t8b"] Mar 16 18:18:06 crc kubenswrapper[5120]: I0316 18:18:06.675943 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c86d669-c515-4e95-bf8a-7bc437fc7619" path="/var/lib/kubelet/pods/7c86d669-c515-4e95-bf8a-7bc437fc7619/volumes" Mar 16 18:18:07 crc kubenswrapper[5120]: E0316 18:18:07.335004 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=885112 actualBytes=10240 Mar 16 18:18:08 crc kubenswrapper[5120]: I0316 18:18:08.782370 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/cert-manager_cert-manager-webhook-597b96b99b-8mqkn_3371b452-79cc-4573-a16f-fb885f37946a/cert-manager-webhook/0.log" Mar 16 18:18:08 crc kubenswrapper[5120]: I0316 18:18:08.945627 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/cert-manager_cert-manager-cainjector-8966b78d4-gv9vk_2e8a8519-57b7-4e2b-a654-54129ca2213b/cert-manager-cainjector/0.log" Mar 16 18:18:09 crc kubenswrapper[5120]: I0316 18:18:09.051881 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/cert-manager_cert-manager-759f64656b-r4522_2bc8ef1b-920f-4da9-b11d-182fa58ffc20/cert-manager-controller/0.log" Mar 16 18:18:12 crc kubenswrapper[5120]: I0316 18:18:12.663849 5120 scope.go:117] "RemoveContainer" containerID="f46f7389db7e312fd9565c65ada72cf5a849906f210a5db0befeb36862170522" Mar 16 18:18:12 crc kubenswrapper[5120]: E0316 18:18:12.664436 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 18:18:21 crc kubenswrapper[5120]: I0316 18:18:21.122564 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-nmstate_nmstate-console-plugin-74686bb6b4-dcsrq_5b76933b-fb29-4e6c-ae26-c15b23d8aa69/nmstate-console-plugin/0.log" Mar 16 18:18:21 crc kubenswrapper[5120]: I0316 18:18:21.310517 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-nmstate_nmstate-handler-fbxhr_1b84482c-adc3-4ce0-9551-deb315607bae/nmstate-handler/0.log" Mar 16 18:18:21 crc kubenswrapper[5120]: I0316 18:18:21.421670 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-nmstate_nmstate-metrics-7f888697b-h5l4s_f79d1780-bb33-4b14-8358-9b0ab3bb485a/kube-rbac-proxy/0.log" Mar 16 18:18:21 crc kubenswrapper[5120]: I0316 18:18:21.471124 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-nmstate_nmstate-metrics-7f888697b-h5l4s_f79d1780-bb33-4b14-8358-9b0ab3bb485a/nmstate-metrics/0.log" Mar 16 18:18:21 crc kubenswrapper[5120]: I0316 18:18:21.506940 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-nmstate_nmstate-operator-54b58fcbc5-4tsgg_39ff1970-5f12-4437-ade6-0a03e211bae8/nmstate-operator/0.log" Mar 16 18:18:21 crc kubenswrapper[5120]: I0316 18:18:21.666330 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-nmstate_nmstate-webhook-78fdd78d8b-dtt5m_c0128410-82f7-48a8-80f6-a04f53ef87d0/nmstate-webhook/0.log" Mar 16 18:18:26 crc kubenswrapper[5120]: I0316 18:18:26.663635 5120 scope.go:117] "RemoveContainer" containerID="f46f7389db7e312fd9565c65ada72cf5a849906f210a5db0befeb36862170522" Mar 16 18:18:26 crc kubenswrapper[5120]: E0316 18:18:26.664271 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 18:18:34 crc kubenswrapper[5120]: I0316 18:18:34.299206 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_obo-prometheus-operator-9bc85b4bf-7p4jt_18c84489-f690-4ef3-b74c-90c206024afd/prometheus-operator/0.log" Mar 16 18:18:34 crc kubenswrapper[5120]: I0316 18:18:34.466312 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_obo-prometheus-operator-admission-webhook-669bcd8dd-pzkpw_13869ea5-bd74-407b-a6ce-c20c6214d66a/prometheus-operator-admission-webhook/0.log" Mar 16 18:18:34 crc kubenswrapper[5120]: I0316 18:18:34.505622 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_obo-prometheus-operator-admission-webhook-669bcd8dd-zfrnj_71f02692-3bf5-4e19-97a5-e7f79f2c52af/prometheus-operator-admission-webhook/0.log" Mar 16 18:18:34 crc kubenswrapper[5120]: I0316 18:18:34.676933 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_observability-operator-85c68dddb-zj2rl_4df87e18-229a-409c-8e61-36fc094b6de9/operator/0.log" Mar 16 18:18:34 crc kubenswrapper[5120]: I0316 18:18:34.680179 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_perses-operator-669c9f96b5-m4vlq_395765ab-8a57-4a9d-a0b5-f113e4914594/perses-operator/0.log" Mar 16 18:18:40 crc kubenswrapper[5120]: I0316 18:18:40.901359 5120 scope.go:117] "RemoveContainer" containerID="5fda2bd36d8e8b7e7e9576c832ece842c214efa336e6b9c1443454ed27496708" Mar 16 18:18:41 crc kubenswrapper[5120]: I0316 18:18:41.663797 5120 scope.go:117] "RemoveContainer" containerID="f46f7389db7e312fd9565c65ada72cf5a849906f210a5db0befeb36862170522" Mar 16 18:18:41 crc kubenswrapper[5120]: E0316 18:18:41.664701 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 18:18:47 crc kubenswrapper[5120]: I0316 18:18:47.466053 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/metallb-system_controller-774d88f846-jzlz8_62b0a03e-1f8d-4040-a322-38ea66f4b6d8/kube-rbac-proxy/0.log" Mar 16 18:18:47 crc kubenswrapper[5120]: I0316 18:18:47.743611 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/metallb-system_metallb-operator-controller-manager-646b4d4dc-sshj9_bdee5404-16e7-4f56-9dd8-c894470335f0/manager/0.log" Mar 16 18:18:47 crc kubenswrapper[5120]: I0316 18:18:47.811509 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/metallb-system_controller-774d88f846-jzlz8_62b0a03e-1f8d-4040-a322-38ea66f4b6d8/controller/0.log" Mar 16 18:18:47 crc kubenswrapper[5120]: I0316 18:18:47.880508 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/metallb-system_metallb-operator-webhook-server-5cc9c9d8fc-q6ts6_b78f2b18-8b3b-4ee9-be57-670a88f38fc0/webhook-server/0.log" Mar 16 18:18:47 crc kubenswrapper[5120]: I0316 18:18:47.931572 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/metallb-system_speaker-xfrqk_797c0fde-13ff-46ed-9e0e-1520d90c8e8e/kube-rbac-proxy/0.log" Mar 16 18:18:49 crc kubenswrapper[5120]: I0316 18:18:49.341834 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/metallb-system_speaker-xfrqk_797c0fde-13ff-46ed-9e0e-1520d90c8e8e/speaker/0.log" Mar 16 18:18:53 crc kubenswrapper[5120]: I0316 18:18:53.663868 5120 scope.go:117] "RemoveContainer" containerID="f46f7389db7e312fd9565c65ada72cf5a849906f210a5db0befeb36862170522" Mar 16 18:18:53 crc kubenswrapper[5120]: E0316 18:18:53.665564 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 18:19:06 crc kubenswrapper[5120]: I0316 18:19:06.666048 5120 scope.go:117] "RemoveContainer" containerID="f46f7389db7e312fd9565c65ada72cf5a849906f210a5db0befeb36862170522" Mar 16 18:19:06 crc kubenswrapper[5120]: E0316 18:19:06.671467 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 18:19:07 crc kubenswrapper[5120]: E0316 18:19:07.303134 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=886435 actualBytes=10240 Mar 16 18:19:21 crc kubenswrapper[5120]: I0316 18:19:21.664694 5120 scope.go:117] "RemoveContainer" containerID="f46f7389db7e312fd9565c65ada72cf5a849906f210a5db0befeb36862170522" Mar 16 18:19:21 crc kubenswrapper[5120]: E0316 18:19:21.665562 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 18:19:33 crc kubenswrapper[5120]: I0316 18:19:33.663975 5120 scope.go:117] "RemoveContainer" containerID="f46f7389db7e312fd9565c65ada72cf5a849906f210a5db0befeb36862170522" Mar 16 18:19:33 crc kubenswrapper[5120]: E0316 18:19:33.665121 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 18:19:37 crc kubenswrapper[5120]: I0316 18:19:37.893650 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_dnsmasq-dnsmasq-79dcd846c5-5dr8d_798363c6-1234-40e2-a0a7-85e1180310c4/init/0.log" Mar 16 18:19:38 crc kubenswrapper[5120]: I0316 18:19:38.111485 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_dnsmasq-dnsmasq-79dcd846c5-5dr8d_798363c6-1234-40e2-a0a7-85e1180310c4/init/0.log" Mar 16 18:19:38 crc kubenswrapper[5120]: I0316 18:19:38.231187 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_dnsmasq-dnsmasq-79dcd846c5-5dr8d_798363c6-1234-40e2-a0a7-85e1180310c4/dnsmasq-dns/0.log" Mar 16 18:19:47 crc kubenswrapper[5120]: I0316 18:19:47.663991 5120 scope.go:117] "RemoveContainer" containerID="f46f7389db7e312fd9565c65ada72cf5a849906f210a5db0befeb36862170522" Mar 16 18:19:47 crc kubenswrapper[5120]: E0316 18:19:47.664822 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 18:19:51 crc kubenswrapper[5120]: I0316 18:19:51.215948 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_5f0d783fea323979717ec4113d968dc42dcfaeaad7ccdc94e6a93c9e91jzl5h_9cdb212f-7fb8-44ae-95d1-b2ea8dc09448/util/0.log" Mar 16 18:19:51 crc kubenswrapper[5120]: I0316 18:19:51.405185 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_5f0d783fea323979717ec4113d968dc42dcfaeaad7ccdc94e6a93c9e91jzl5h_9cdb212f-7fb8-44ae-95d1-b2ea8dc09448/pull/0.log" Mar 16 18:19:51 crc kubenswrapper[5120]: I0316 18:19:51.424771 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_5f0d783fea323979717ec4113d968dc42dcfaeaad7ccdc94e6a93c9e91jzl5h_9cdb212f-7fb8-44ae-95d1-b2ea8dc09448/pull/0.log" Mar 16 18:19:51 crc kubenswrapper[5120]: I0316 18:19:51.428607 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_5f0d783fea323979717ec4113d968dc42dcfaeaad7ccdc94e6a93c9e91jzl5h_9cdb212f-7fb8-44ae-95d1-b2ea8dc09448/util/0.log" Mar 16 18:19:51 crc kubenswrapper[5120]: I0316 18:19:51.609417 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_5f0d783fea323979717ec4113d968dc42dcfaeaad7ccdc94e6a93c9e91jzl5h_9cdb212f-7fb8-44ae-95d1-b2ea8dc09448/pull/0.log" Mar 16 18:19:51 crc kubenswrapper[5120]: I0316 18:19:51.614417 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_5f0d783fea323979717ec4113d968dc42dcfaeaad7ccdc94e6a93c9e91jzl5h_9cdb212f-7fb8-44ae-95d1-b2ea8dc09448/util/0.log" Mar 16 18:19:51 crc kubenswrapper[5120]: I0316 18:19:51.626312 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_5f0d783fea323979717ec4113d968dc42dcfaeaad7ccdc94e6a93c9e91jzl5h_9cdb212f-7fb8-44ae-95d1-b2ea8dc09448/extract/0.log" Mar 16 18:19:51 crc kubenswrapper[5120]: I0316 18:19:51.789953 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_925ad1f05bf386dc21bdfe2f8249c1fbfd04a404dec7a7fb6362d758e5ndmlk_13031077-4428-4288-80ef-4098c9c4e353/util/0.log" Mar 16 18:19:51 crc kubenswrapper[5120]: I0316 18:19:51.925488 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_925ad1f05bf386dc21bdfe2f8249c1fbfd04a404dec7a7fb6362d758e5ndmlk_13031077-4428-4288-80ef-4098c9c4e353/util/0.log" Mar 16 18:19:51 crc kubenswrapper[5120]: I0316 18:19:51.989968 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_925ad1f05bf386dc21bdfe2f8249c1fbfd04a404dec7a7fb6362d758e5ndmlk_13031077-4428-4288-80ef-4098c9c4e353/pull/0.log" Mar 16 18:19:51 crc kubenswrapper[5120]: I0316 18:19:51.992841 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_925ad1f05bf386dc21bdfe2f8249c1fbfd04a404dec7a7fb6362d758e5ndmlk_13031077-4428-4288-80ef-4098c9c4e353/pull/0.log" Mar 16 18:19:52 crc kubenswrapper[5120]: I0316 18:19:52.147976 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_925ad1f05bf386dc21bdfe2f8249c1fbfd04a404dec7a7fb6362d758e5ndmlk_13031077-4428-4288-80ef-4098c9c4e353/util/0.log" Mar 16 18:19:52 crc kubenswrapper[5120]: I0316 18:19:52.153443 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_925ad1f05bf386dc21bdfe2f8249c1fbfd04a404dec7a7fb6362d758e5ndmlk_13031077-4428-4288-80ef-4098c9c4e353/extract/0.log" Mar 16 18:19:52 crc kubenswrapper[5120]: I0316 18:19:52.163815 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_925ad1f05bf386dc21bdfe2f8249c1fbfd04a404dec7a7fb6362d758e5ndmlk_13031077-4428-4288-80ef-4098c9c4e353/pull/0.log" Mar 16 18:19:52 crc kubenswrapper[5120]: I0316 18:19:52.312610 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_98629960b44b381d1a86cff1d1439a8df43509c9ad24579158c59d0f08lwstg_04363a62-e592-457c-ac4a-48bb6c942c9a/util/0.log" Mar 16 18:19:52 crc kubenswrapper[5120]: I0316 18:19:52.470190 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_98629960b44b381d1a86cff1d1439a8df43509c9ad24579158c59d0f08lwstg_04363a62-e592-457c-ac4a-48bb6c942c9a/pull/0.log" Mar 16 18:19:52 crc kubenswrapper[5120]: I0316 18:19:52.484671 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_98629960b44b381d1a86cff1d1439a8df43509c9ad24579158c59d0f08lwstg_04363a62-e592-457c-ac4a-48bb6c942c9a/util/0.log" Mar 16 18:19:52 crc kubenswrapper[5120]: I0316 18:19:52.520918 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_98629960b44b381d1a86cff1d1439a8df43509c9ad24579158c59d0f08lwstg_04363a62-e592-457c-ac4a-48bb6c942c9a/pull/0.log" Mar 16 18:19:52 crc kubenswrapper[5120]: I0316 18:19:52.637450 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_98629960b44b381d1a86cff1d1439a8df43509c9ad24579158c59d0f08lwstg_04363a62-e592-457c-ac4a-48bb6c942c9a/util/0.log" Mar 16 18:19:52 crc kubenswrapper[5120]: I0316 18:19:52.723003 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_98629960b44b381d1a86cff1d1439a8df43509c9ad24579158c59d0f08lwstg_04363a62-e592-457c-ac4a-48bb6c942c9a/pull/0.log" Mar 16 18:19:52 crc kubenswrapper[5120]: I0316 18:19:52.723201 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_98629960b44b381d1a86cff1d1439a8df43509c9ad24579158c59d0f08lwstg_04363a62-e592-457c-ac4a-48bb6c942c9a/extract/0.log" Mar 16 18:19:52 crc kubenswrapper[5120]: I0316 18:19:52.846078 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_certified-operators-klcgv_cb61d003-089b-4f3a-b84e-03d45c451335/extract-utilities/0.log" Mar 16 18:19:52 crc kubenswrapper[5120]: I0316 18:19:52.978464 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_certified-operators-klcgv_cb61d003-089b-4f3a-b84e-03d45c451335/extract-content/0.log" Mar 16 18:19:52 crc kubenswrapper[5120]: I0316 18:19:52.990153 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_certified-operators-klcgv_cb61d003-089b-4f3a-b84e-03d45c451335/extract-utilities/0.log" Mar 16 18:19:53 crc kubenswrapper[5120]: I0316 18:19:53.008974 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_certified-operators-klcgv_cb61d003-089b-4f3a-b84e-03d45c451335/extract-content/0.log" Mar 16 18:19:53 crc kubenswrapper[5120]: I0316 18:19:53.177338 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_certified-operators-klcgv_cb61d003-089b-4f3a-b84e-03d45c451335/extract-utilities/0.log" Mar 16 18:19:53 crc kubenswrapper[5120]: I0316 18:19:53.186781 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_certified-operators-klcgv_cb61d003-089b-4f3a-b84e-03d45c451335/extract-content/0.log" Mar 16 18:19:53 crc kubenswrapper[5120]: I0316 18:19:53.409296 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_community-operators-t6qpc_1cf498e9-c3f0-4050-b629-e9310751e9fc/extract-utilities/0.log" Mar 16 18:19:53 crc kubenswrapper[5120]: I0316 18:19:53.556106 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_community-operators-t6qpc_1cf498e9-c3f0-4050-b629-e9310751e9fc/extract-utilities/0.log" Mar 16 18:19:53 crc kubenswrapper[5120]: I0316 18:19:53.604876 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_community-operators-t6qpc_1cf498e9-c3f0-4050-b629-e9310751e9fc/extract-content/0.log" Mar 16 18:19:53 crc kubenswrapper[5120]: I0316 18:19:53.631205 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_community-operators-t6qpc_1cf498e9-c3f0-4050-b629-e9310751e9fc/extract-content/0.log" Mar 16 18:19:53 crc kubenswrapper[5120]: I0316 18:19:53.896357 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_community-operators-t6qpc_1cf498e9-c3f0-4050-b629-e9310751e9fc/extract-utilities/0.log" Mar 16 18:19:53 crc kubenswrapper[5120]: I0316 18:19:53.912710 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_community-operators-t6qpc_1cf498e9-c3f0-4050-b629-e9310751e9fc/extract-content/0.log" Mar 16 18:19:54 crc kubenswrapper[5120]: I0316 18:19:54.119901 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_d1f2cf7c6f4ecb15e69cc0ed07a53b6f169b7a9d46d563b1a9827dff83d68kn_02456ec5-b7f9-495a-90b7-990ca519212f/util/0.log" Mar 16 18:19:54 crc kubenswrapper[5120]: I0316 18:19:54.196223 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_community-operators-t6qpc_1cf498e9-c3f0-4050-b629-e9310751e9fc/registry-server/0.log" Mar 16 18:19:54 crc kubenswrapper[5120]: I0316 18:19:54.304528 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_d1f2cf7c6f4ecb15e69cc0ed07a53b6f169b7a9d46d563b1a9827dff83d68kn_02456ec5-b7f9-495a-90b7-990ca519212f/util/0.log" Mar 16 18:19:54 crc kubenswrapper[5120]: I0316 18:19:54.382738 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_d1f2cf7c6f4ecb15e69cc0ed07a53b6f169b7a9d46d563b1a9827dff83d68kn_02456ec5-b7f9-495a-90b7-990ca519212f/pull/0.log" Mar 16 18:19:54 crc kubenswrapper[5120]: I0316 18:19:54.420513 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_d1f2cf7c6f4ecb15e69cc0ed07a53b6f169b7a9d46d563b1a9827dff83d68kn_02456ec5-b7f9-495a-90b7-990ca519212f/pull/0.log" Mar 16 18:19:54 crc kubenswrapper[5120]: I0316 18:19:54.514023 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_certified-operators-klcgv_cb61d003-089b-4f3a-b84e-03d45c451335/registry-server/0.log" Mar 16 18:19:54 crc kubenswrapper[5120]: I0316 18:19:54.586966 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_d1f2cf7c6f4ecb15e69cc0ed07a53b6f169b7a9d46d563b1a9827dff83d68kn_02456ec5-b7f9-495a-90b7-990ca519212f/util/0.log" Mar 16 18:19:54 crc kubenswrapper[5120]: I0316 18:19:54.613615 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_d1f2cf7c6f4ecb15e69cc0ed07a53b6f169b7a9d46d563b1a9827dff83d68kn_02456ec5-b7f9-495a-90b7-990ca519212f/extract/0.log" Mar 16 18:19:54 crc kubenswrapper[5120]: I0316 18:19:54.655424 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_d1f2cf7c6f4ecb15e69cc0ed07a53b6f169b7a9d46d563b1a9827dff83d68kn_02456ec5-b7f9-495a-90b7-990ca519212f/pull/0.log" Mar 16 18:19:54 crc kubenswrapper[5120]: I0316 18:19:54.677864 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_marketplace-operator-547dbd544d-rt66v_970f8645-801d-4b4b-8571-a39bde23f382/marketplace-operator/0.log" Mar 16 18:19:54 crc kubenswrapper[5120]: I0316 18:19:54.806359 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_redhat-marketplace-6xr7p_d233c35e-a24a-4f65-9bea-f280bc1e51a7/extract-utilities/0.log" Mar 16 18:19:54 crc kubenswrapper[5120]: I0316 18:19:54.965506 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_redhat-marketplace-6xr7p_d233c35e-a24a-4f65-9bea-f280bc1e51a7/extract-content/0.log" Mar 16 18:19:54 crc kubenswrapper[5120]: I0316 18:19:54.966490 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_redhat-marketplace-6xr7p_d233c35e-a24a-4f65-9bea-f280bc1e51a7/extract-content/0.log" Mar 16 18:19:54 crc kubenswrapper[5120]: I0316 18:19:54.982352 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_redhat-marketplace-6xr7p_d233c35e-a24a-4f65-9bea-f280bc1e51a7/extract-utilities/0.log" Mar 16 18:19:55 crc kubenswrapper[5120]: I0316 18:19:55.152771 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_redhat-marketplace-6xr7p_d233c35e-a24a-4f65-9bea-f280bc1e51a7/extract-content/0.log" Mar 16 18:19:55 crc kubenswrapper[5120]: I0316 18:19:55.171485 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_redhat-marketplace-6xr7p_d233c35e-a24a-4f65-9bea-f280bc1e51a7/extract-utilities/0.log" Mar 16 18:19:55 crc kubenswrapper[5120]: I0316 18:19:55.232358 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_redhat-operators-cxnvm_f5c4787f-e8dd-45ab-9932-3db343fa8673/extract-utilities/0.log" Mar 16 18:19:55 crc kubenswrapper[5120]: I0316 18:19:55.390866 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_redhat-operators-cxnvm_f5c4787f-e8dd-45ab-9932-3db343fa8673/extract-utilities/0.log" Mar 16 18:19:55 crc kubenswrapper[5120]: I0316 18:19:55.402101 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_redhat-operators-cxnvm_f5c4787f-e8dd-45ab-9932-3db343fa8673/extract-content/0.log" Mar 16 18:19:55 crc kubenswrapper[5120]: I0316 18:19:55.440441 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_redhat-operators-cxnvm_f5c4787f-e8dd-45ab-9932-3db343fa8673/extract-content/0.log" Mar 16 18:19:55 crc kubenswrapper[5120]: I0316 18:19:55.580086 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_redhat-marketplace-6xr7p_d233c35e-a24a-4f65-9bea-f280bc1e51a7/registry-server/0.log" Mar 16 18:19:55 crc kubenswrapper[5120]: I0316 18:19:55.621986 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_redhat-operators-cxnvm_f5c4787f-e8dd-45ab-9932-3db343fa8673/extract-utilities/0.log" Mar 16 18:19:55 crc kubenswrapper[5120]: I0316 18:19:55.636549 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_redhat-operators-cxnvm_f5c4787f-e8dd-45ab-9932-3db343fa8673/extract-content/0.log" Mar 16 18:19:56 crc kubenswrapper[5120]: I0316 18:19:56.158090 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_redhat-operators-cxnvm_f5c4787f-e8dd-45ab-9932-3db343fa8673/registry-server/0.log" Mar 16 18:20:00 crc kubenswrapper[5120]: I0316 18:20:00.156166 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-infra/auto-csr-approver-29561420-c2lrm"] Mar 16 18:20:00 crc kubenswrapper[5120]: I0316 18:20:00.157547 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6bb1f1d3-b165-49a5-adcb-09bf50d83fbf" containerName="oc" Mar 16 18:20:00 crc kubenswrapper[5120]: I0316 18:20:00.157563 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="6bb1f1d3-b165-49a5-adcb-09bf50d83fbf" containerName="oc" Mar 16 18:20:00 crc kubenswrapper[5120]: I0316 18:20:00.157692 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="6bb1f1d3-b165-49a5-adcb-09bf50d83fbf" containerName="oc" Mar 16 18:20:00 crc kubenswrapper[5120]: I0316 18:20:00.174623 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561420-c2lrm"] Mar 16 18:20:00 crc kubenswrapper[5120]: I0316 18:20:00.175144 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561420-c2lrm" Mar 16 18:20:00 crc kubenswrapper[5120]: I0316 18:20:00.178633 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-infra\"/\"csr-approver-sa-dockercfg-x2nsz\"" Mar 16 18:20:00 crc kubenswrapper[5120]: I0316 18:20:00.179153 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"kube-root-ca.crt\"" Mar 16 18:20:00 crc kubenswrapper[5120]: I0316 18:20:00.179403 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"openshift-service-ca.crt\"" Mar 16 18:20:00 crc kubenswrapper[5120]: I0316 18:20:00.220388 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xktsq\" (UniqueName: \"kubernetes.io/projected/9af846bc-4ebc-4602-8225-55fb6fa2b310-kube-api-access-xktsq\") pod \"auto-csr-approver-29561420-c2lrm\" (UID: \"9af846bc-4ebc-4602-8225-55fb6fa2b310\") " pod="openshift-infra/auto-csr-approver-29561420-c2lrm" Mar 16 18:20:00 crc kubenswrapper[5120]: I0316 18:20:00.322517 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xktsq\" (UniqueName: \"kubernetes.io/projected/9af846bc-4ebc-4602-8225-55fb6fa2b310-kube-api-access-xktsq\") pod \"auto-csr-approver-29561420-c2lrm\" (UID: \"9af846bc-4ebc-4602-8225-55fb6fa2b310\") " pod="openshift-infra/auto-csr-approver-29561420-c2lrm" Mar 16 18:20:00 crc kubenswrapper[5120]: I0316 18:20:00.353313 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xktsq\" (UniqueName: \"kubernetes.io/projected/9af846bc-4ebc-4602-8225-55fb6fa2b310-kube-api-access-xktsq\") pod \"auto-csr-approver-29561420-c2lrm\" (UID: \"9af846bc-4ebc-4602-8225-55fb6fa2b310\") " pod="openshift-infra/auto-csr-approver-29561420-c2lrm" Mar 16 18:20:00 crc kubenswrapper[5120]: I0316 18:20:00.493607 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561420-c2lrm" Mar 16 18:20:00 crc kubenswrapper[5120]: I0316 18:20:00.706706 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561420-c2lrm"] Mar 16 18:20:01 crc kubenswrapper[5120]: I0316 18:20:01.681658 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561420-c2lrm" event={"ID":"9af846bc-4ebc-4602-8225-55fb6fa2b310","Type":"ContainerStarted","Data":"19484b05604184edad390ac8b2be2cc1fe88c064b7114f546842bc933cd290ce"} Mar 16 18:20:02 crc kubenswrapper[5120]: I0316 18:20:02.664419 5120 scope.go:117] "RemoveContainer" containerID="f46f7389db7e312fd9565c65ada72cf5a849906f210a5db0befeb36862170522" Mar 16 18:20:02 crc kubenswrapper[5120]: I0316 18:20:02.690153 5120 generic.go:358] "Generic (PLEG): container finished" podID="9af846bc-4ebc-4602-8225-55fb6fa2b310" containerID="fe40361329305dc4b3eb07be87e7e7a06b5b8ac69b273b9eef6aca3fdf2adf47" exitCode=0 Mar 16 18:20:02 crc kubenswrapper[5120]: I0316 18:20:02.690247 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561420-c2lrm" event={"ID":"9af846bc-4ebc-4602-8225-55fb6fa2b310","Type":"ContainerDied","Data":"fe40361329305dc4b3eb07be87e7e7a06b5b8ac69b273b9eef6aca3fdf2adf47"} Mar 16 18:20:03 crc kubenswrapper[5120]: I0316 18:20:03.710332 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" event={"ID":"e2275cb4-4905-4d66-a87e-8010120db2bd","Type":"ContainerStarted","Data":"3d15b6e9605fcdee6974a8b8a0e3331e02f35b8864853b8905538f9ef03d86f3"} Mar 16 18:20:03 crc kubenswrapper[5120]: I0316 18:20:03.960653 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561420-c2lrm" Mar 16 18:20:04 crc kubenswrapper[5120]: I0316 18:20:04.111663 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xktsq\" (UniqueName: \"kubernetes.io/projected/9af846bc-4ebc-4602-8225-55fb6fa2b310-kube-api-access-xktsq\") pod \"9af846bc-4ebc-4602-8225-55fb6fa2b310\" (UID: \"9af846bc-4ebc-4602-8225-55fb6fa2b310\") " Mar 16 18:20:04 crc kubenswrapper[5120]: I0316 18:20:04.121003 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9af846bc-4ebc-4602-8225-55fb6fa2b310-kube-api-access-xktsq" (OuterVolumeSpecName: "kube-api-access-xktsq") pod "9af846bc-4ebc-4602-8225-55fb6fa2b310" (UID: "9af846bc-4ebc-4602-8225-55fb6fa2b310"). InnerVolumeSpecName "kube-api-access-xktsq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 18:20:04 crc kubenswrapper[5120]: I0316 18:20:04.214080 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xktsq\" (UniqueName: \"kubernetes.io/projected/9af846bc-4ebc-4602-8225-55fb6fa2b310-kube-api-access-xktsq\") on node \"crc\" DevicePath \"\"" Mar 16 18:20:04 crc kubenswrapper[5120]: I0316 18:20:04.718357 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561420-c2lrm" event={"ID":"9af846bc-4ebc-4602-8225-55fb6fa2b310","Type":"ContainerDied","Data":"19484b05604184edad390ac8b2be2cc1fe88c064b7114f546842bc933cd290ce"} Mar 16 18:20:04 crc kubenswrapper[5120]: I0316 18:20:04.718397 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="19484b05604184edad390ac8b2be2cc1fe88c064b7114f546842bc933cd290ce" Mar 16 18:20:04 crc kubenswrapper[5120]: I0316 18:20:04.718455 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561420-c2lrm" Mar 16 18:20:05 crc kubenswrapper[5120]: I0316 18:20:05.020331 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-infra/auto-csr-approver-29561414-jzjft"] Mar 16 18:20:05 crc kubenswrapper[5120]: I0316 18:20:05.025571 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-infra/auto-csr-approver-29561414-jzjft"] Mar 16 18:20:06 crc kubenswrapper[5120]: I0316 18:20:06.670688 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94384423-f84d-4ea8-9b68-7d8655d164bc" path="/var/lib/kubelet/pods/94384423-f84d-4ea8-9b68-7d8655d164bc/volumes" Mar 16 18:20:07 crc kubenswrapper[5120]: E0316 18:20:07.413036 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=886434 actualBytes=10240 Mar 16 18:20:07 crc kubenswrapper[5120]: I0316 18:20:07.810007 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_obo-prometheus-operator-9bc85b4bf-7p4jt_18c84489-f690-4ef3-b74c-90c206024afd/prometheus-operator/0.log" Mar 16 18:20:07 crc kubenswrapper[5120]: I0316 18:20:07.867445 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_obo-prometheus-operator-admission-webhook-669bcd8dd-pzkpw_13869ea5-bd74-407b-a6ce-c20c6214d66a/prometheus-operator-admission-webhook/0.log" Mar 16 18:20:07 crc kubenswrapper[5120]: I0316 18:20:07.873524 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_obo-prometheus-operator-admission-webhook-669bcd8dd-zfrnj_71f02692-3bf5-4e19-97a5-e7f79f2c52af/prometheus-operator-admission-webhook/0.log" Mar 16 18:20:07 crc kubenswrapper[5120]: I0316 18:20:07.996645 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_observability-operator-85c68dddb-zj2rl_4df87e18-229a-409c-8e61-36fc094b6de9/operator/0.log" Mar 16 18:20:08 crc kubenswrapper[5120]: I0316 18:20:08.055529 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_perses-operator-669c9f96b5-m4vlq_395765ab-8a57-4a9d-a0b5-f113e4914594/perses-operator/0.log" Mar 16 18:20:41 crc kubenswrapper[5120]: I0316 18:20:41.031873 5120 scope.go:117] "RemoveContainer" containerID="280335e4086ffa3b9721c844ba616a66f1261b7bca0b7cd65e60c1bb17c6527a" Mar 16 18:21:07 crc kubenswrapper[5120]: E0316 18:21:07.373299 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=886329 actualBytes=10240 Mar 16 18:21:15 crc kubenswrapper[5120]: I0316 18:21:15.298699 5120 generic.go:358] "Generic (PLEG): container finished" podID="79239ef7-5426-4073-a771-86e043c73768" containerID="9a192c0cc210757c626e0dbd3034bdc942da2f881639dea1a81e61f6e8c997ad" exitCode=0 Mar 16 18:21:15 crc kubenswrapper[5120]: I0316 18:21:15.298787 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-x94n6/must-gather-8fg6g" event={"ID":"79239ef7-5426-4073-a771-86e043c73768","Type":"ContainerDied","Data":"9a192c0cc210757c626e0dbd3034bdc942da2f881639dea1a81e61f6e8c997ad"} Mar 16 18:21:15 crc kubenswrapper[5120]: I0316 18:21:15.299575 5120 scope.go:117] "RemoveContainer" containerID="9a192c0cc210757c626e0dbd3034bdc942da2f881639dea1a81e61f6e8c997ad" Mar 16 18:21:15 crc kubenswrapper[5120]: I0316 18:21:15.447216 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-x94n6_must-gather-8fg6g_79239ef7-5426-4073-a771-86e043c73768/gather/0.log" Mar 16 18:21:25 crc kubenswrapper[5120]: I0316 18:21:25.642627 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-x94n6/must-gather-8fg6g"] Mar 16 18:21:25 crc kubenswrapper[5120]: I0316 18:21:25.643659 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-must-gather-x94n6/must-gather-8fg6g" podUID="79239ef7-5426-4073-a771-86e043c73768" containerName="copy" containerID="cri-o://f2f1672448895941ab31acfe592030c59c0dc3cb21849f5d8a56fc4ace927711" gracePeriod=2 Mar 16 18:21:25 crc kubenswrapper[5120]: I0316 18:21:25.650100 5120 status_manager.go:895] "Failed to get status for pod" podUID="79239ef7-5426-4073-a771-86e043c73768" pod="openshift-must-gather-x94n6/must-gather-8fg6g" err="pods \"must-gather-8fg6g\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-x94n6\": no relationship found between node 'crc' and this object" Mar 16 18:21:25 crc kubenswrapper[5120]: I0316 18:21:25.653561 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-x94n6/must-gather-8fg6g"] Mar 16 18:21:26 crc kubenswrapper[5120]: I0316 18:21:26.027913 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-x94n6_must-gather-8fg6g_79239ef7-5426-4073-a771-86e043c73768/copy/0.log" Mar 16 18:21:26 crc kubenswrapper[5120]: I0316 18:21:26.028628 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-x94n6/must-gather-8fg6g" Mar 16 18:21:26 crc kubenswrapper[5120]: I0316 18:21:26.030074 5120 status_manager.go:895] "Failed to get status for pod" podUID="79239ef7-5426-4073-a771-86e043c73768" pod="openshift-must-gather-x94n6/must-gather-8fg6g" err="pods \"must-gather-8fg6g\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-x94n6\": no relationship found between node 'crc' and this object" Mar 16 18:21:26 crc kubenswrapper[5120]: I0316 18:21:26.111273 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5wl6b\" (UniqueName: \"kubernetes.io/projected/79239ef7-5426-4073-a771-86e043c73768-kube-api-access-5wl6b\") pod \"79239ef7-5426-4073-a771-86e043c73768\" (UID: \"79239ef7-5426-4073-a771-86e043c73768\") " Mar 16 18:21:26 crc kubenswrapper[5120]: I0316 18:21:26.111903 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/79239ef7-5426-4073-a771-86e043c73768-must-gather-output\") pod \"79239ef7-5426-4073-a771-86e043c73768\" (UID: \"79239ef7-5426-4073-a771-86e043c73768\") " Mar 16 18:21:26 crc kubenswrapper[5120]: I0316 18:21:26.116979 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79239ef7-5426-4073-a771-86e043c73768-kube-api-access-5wl6b" (OuterVolumeSpecName: "kube-api-access-5wl6b") pod "79239ef7-5426-4073-a771-86e043c73768" (UID: "79239ef7-5426-4073-a771-86e043c73768"). InnerVolumeSpecName "kube-api-access-5wl6b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 18:21:26 crc kubenswrapper[5120]: I0316 18:21:26.214013 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5wl6b\" (UniqueName: \"kubernetes.io/projected/79239ef7-5426-4073-a771-86e043c73768-kube-api-access-5wl6b\") on node \"crc\" DevicePath \"\"" Mar 16 18:21:26 crc kubenswrapper[5120]: I0316 18:21:26.221378 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79239ef7-5426-4073-a771-86e043c73768-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "79239ef7-5426-4073-a771-86e043c73768" (UID: "79239ef7-5426-4073-a771-86e043c73768"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 18:21:26 crc kubenswrapper[5120]: I0316 18:21:26.316746 5120 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/79239ef7-5426-4073-a771-86e043c73768-must-gather-output\") on node \"crc\" DevicePath \"\"" Mar 16 18:21:26 crc kubenswrapper[5120]: I0316 18:21:26.396424 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-x94n6_must-gather-8fg6g_79239ef7-5426-4073-a771-86e043c73768/copy/0.log" Mar 16 18:21:26 crc kubenswrapper[5120]: I0316 18:21:26.396789 5120 generic.go:358] "Generic (PLEG): container finished" podID="79239ef7-5426-4073-a771-86e043c73768" containerID="f2f1672448895941ab31acfe592030c59c0dc3cb21849f5d8a56fc4ace927711" exitCode=143 Mar 16 18:21:26 crc kubenswrapper[5120]: I0316 18:21:26.396903 5120 scope.go:117] "RemoveContainer" containerID="f2f1672448895941ab31acfe592030c59c0dc3cb21849f5d8a56fc4ace927711" Mar 16 18:21:26 crc kubenswrapper[5120]: I0316 18:21:26.396896 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-x94n6/must-gather-8fg6g" Mar 16 18:21:26 crc kubenswrapper[5120]: I0316 18:21:26.398982 5120 status_manager.go:895] "Failed to get status for pod" podUID="79239ef7-5426-4073-a771-86e043c73768" pod="openshift-must-gather-x94n6/must-gather-8fg6g" err="pods \"must-gather-8fg6g\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-x94n6\": no relationship found between node 'crc' and this object" Mar 16 18:21:26 crc kubenswrapper[5120]: I0316 18:21:26.412787 5120 status_manager.go:895] "Failed to get status for pod" podUID="79239ef7-5426-4073-a771-86e043c73768" pod="openshift-must-gather-x94n6/must-gather-8fg6g" err="pods \"must-gather-8fg6g\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-x94n6\": no relationship found between node 'crc' and this object" Mar 16 18:21:26 crc kubenswrapper[5120]: I0316 18:21:26.426229 5120 scope.go:117] "RemoveContainer" containerID="9a192c0cc210757c626e0dbd3034bdc942da2f881639dea1a81e61f6e8c997ad" Mar 16 18:21:26 crc kubenswrapper[5120]: I0316 18:21:26.505804 5120 scope.go:117] "RemoveContainer" containerID="f2f1672448895941ab31acfe592030c59c0dc3cb21849f5d8a56fc4ace927711" Mar 16 18:21:26 crc kubenswrapper[5120]: E0316 18:21:26.506221 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f2f1672448895941ab31acfe592030c59c0dc3cb21849f5d8a56fc4ace927711\": container with ID starting with f2f1672448895941ab31acfe592030c59c0dc3cb21849f5d8a56fc4ace927711 not found: ID does not exist" containerID="f2f1672448895941ab31acfe592030c59c0dc3cb21849f5d8a56fc4ace927711" Mar 16 18:21:26 crc kubenswrapper[5120]: I0316 18:21:26.506278 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2f1672448895941ab31acfe592030c59c0dc3cb21849f5d8a56fc4ace927711"} err="failed to get container status \"f2f1672448895941ab31acfe592030c59c0dc3cb21849f5d8a56fc4ace927711\": rpc error: code = NotFound desc = could not find container \"f2f1672448895941ab31acfe592030c59c0dc3cb21849f5d8a56fc4ace927711\": container with ID starting with f2f1672448895941ab31acfe592030c59c0dc3cb21849f5d8a56fc4ace927711 not found: ID does not exist" Mar 16 18:21:26 crc kubenswrapper[5120]: I0316 18:21:26.506299 5120 scope.go:117] "RemoveContainer" containerID="9a192c0cc210757c626e0dbd3034bdc942da2f881639dea1a81e61f6e8c997ad" Mar 16 18:21:26 crc kubenswrapper[5120]: E0316 18:21:26.506870 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a192c0cc210757c626e0dbd3034bdc942da2f881639dea1a81e61f6e8c997ad\": container with ID starting with 9a192c0cc210757c626e0dbd3034bdc942da2f881639dea1a81e61f6e8c997ad not found: ID does not exist" containerID="9a192c0cc210757c626e0dbd3034bdc942da2f881639dea1a81e61f6e8c997ad" Mar 16 18:21:26 crc kubenswrapper[5120]: I0316 18:21:26.507007 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a192c0cc210757c626e0dbd3034bdc942da2f881639dea1a81e61f6e8c997ad"} err="failed to get container status \"9a192c0cc210757c626e0dbd3034bdc942da2f881639dea1a81e61f6e8c997ad\": rpc error: code = NotFound desc = could not find container \"9a192c0cc210757c626e0dbd3034bdc942da2f881639dea1a81e61f6e8c997ad\": container with ID starting with 9a192c0cc210757c626e0dbd3034bdc942da2f881639dea1a81e61f6e8c997ad not found: ID does not exist" Mar 16 18:21:26 crc kubenswrapper[5120]: I0316 18:21:26.673150 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="79239ef7-5426-4073-a771-86e043c73768" path="/var/lib/kubelet/pods/79239ef7-5426-4073-a771-86e043c73768/volumes" Mar 16 18:21:48 crc kubenswrapper[5120]: I0316 18:21:48.717228 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-v822j_ac55471d-4e42-475f-a082-50f611571482/kube-multus/0.log" Mar 16 18:21:48 crc kubenswrapper[5120]: I0316 18:21:48.727155 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-crc_9f0bc7fcb0822a2c13eb2d22cd8c0641/kube-controller-manager/0.log" Mar 16 18:21:48 crc kubenswrapper[5120]: I0316 18:21:48.985210 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-v822j_ac55471d-4e42-475f-a082-50f611571482/kube-multus/0.log" Mar 16 18:21:48 crc kubenswrapper[5120]: I0316 18:21:48.997528 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-crc_9f0bc7fcb0822a2c13eb2d22cd8c0641/kube-controller-manager/0.log" Mar 16 18:22:00 crc kubenswrapper[5120]: I0316 18:22:00.138265 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-infra/auto-csr-approver-29561422-mcmpn"] Mar 16 18:22:00 crc kubenswrapper[5120]: I0316 18:22:00.139427 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9af846bc-4ebc-4602-8225-55fb6fa2b310" containerName="oc" Mar 16 18:22:00 crc kubenswrapper[5120]: I0316 18:22:00.139441 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="9af846bc-4ebc-4602-8225-55fb6fa2b310" containerName="oc" Mar 16 18:22:00 crc kubenswrapper[5120]: I0316 18:22:00.139478 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79239ef7-5426-4073-a771-86e043c73768" containerName="copy" Mar 16 18:22:00 crc kubenswrapper[5120]: I0316 18:22:00.139483 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="79239ef7-5426-4073-a771-86e043c73768" containerName="copy" Mar 16 18:22:00 crc kubenswrapper[5120]: I0316 18:22:00.139497 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79239ef7-5426-4073-a771-86e043c73768" containerName="gather" Mar 16 18:22:00 crc kubenswrapper[5120]: I0316 18:22:00.139502 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="79239ef7-5426-4073-a771-86e043c73768" containerName="gather" Mar 16 18:22:00 crc kubenswrapper[5120]: I0316 18:22:00.139613 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="79239ef7-5426-4073-a771-86e043c73768" containerName="gather" Mar 16 18:22:00 crc kubenswrapper[5120]: I0316 18:22:00.139625 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="79239ef7-5426-4073-a771-86e043c73768" containerName="copy" Mar 16 18:22:00 crc kubenswrapper[5120]: I0316 18:22:00.139633 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="9af846bc-4ebc-4602-8225-55fb6fa2b310" containerName="oc" Mar 16 18:22:00 crc kubenswrapper[5120]: I0316 18:22:00.146225 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561422-mcmpn" Mar 16 18:22:00 crc kubenswrapper[5120]: I0316 18:22:00.147327 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561422-mcmpn"] Mar 16 18:22:00 crc kubenswrapper[5120]: I0316 18:22:00.148611 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-infra\"/\"csr-approver-sa-dockercfg-x2nsz\"" Mar 16 18:22:00 crc kubenswrapper[5120]: I0316 18:22:00.148641 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"openshift-service-ca.crt\"" Mar 16 18:22:00 crc kubenswrapper[5120]: I0316 18:22:00.149267 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"kube-root-ca.crt\"" Mar 16 18:22:00 crc kubenswrapper[5120]: I0316 18:22:00.229220 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pfqcc\" (UniqueName: \"kubernetes.io/projected/ae3fcab8-c0f9-4bbf-bdcd-66ce4f955b5c-kube-api-access-pfqcc\") pod \"auto-csr-approver-29561422-mcmpn\" (UID: \"ae3fcab8-c0f9-4bbf-bdcd-66ce4f955b5c\") " pod="openshift-infra/auto-csr-approver-29561422-mcmpn" Mar 16 18:22:00 crc kubenswrapper[5120]: I0316 18:22:00.333323 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pfqcc\" (UniqueName: \"kubernetes.io/projected/ae3fcab8-c0f9-4bbf-bdcd-66ce4f955b5c-kube-api-access-pfqcc\") pod \"auto-csr-approver-29561422-mcmpn\" (UID: \"ae3fcab8-c0f9-4bbf-bdcd-66ce4f955b5c\") " pod="openshift-infra/auto-csr-approver-29561422-mcmpn" Mar 16 18:22:00 crc kubenswrapper[5120]: I0316 18:22:00.353930 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pfqcc\" (UniqueName: \"kubernetes.io/projected/ae3fcab8-c0f9-4bbf-bdcd-66ce4f955b5c-kube-api-access-pfqcc\") pod \"auto-csr-approver-29561422-mcmpn\" (UID: \"ae3fcab8-c0f9-4bbf-bdcd-66ce4f955b5c\") " pod="openshift-infra/auto-csr-approver-29561422-mcmpn" Mar 16 18:22:00 crc kubenswrapper[5120]: I0316 18:22:00.464790 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561422-mcmpn" Mar 16 18:22:00 crc kubenswrapper[5120]: I0316 18:22:00.717582 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561422-mcmpn"] Mar 16 18:22:01 crc kubenswrapper[5120]: I0316 18:22:01.703439 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561422-mcmpn" event={"ID":"ae3fcab8-c0f9-4bbf-bdcd-66ce4f955b5c","Type":"ContainerStarted","Data":"c647f629a517788f071071b2c13fbd1d7754e905a25fa2a1f9f3a8256e141452"} Mar 16 18:22:02 crc kubenswrapper[5120]: I0316 18:22:02.711174 5120 generic.go:358] "Generic (PLEG): container finished" podID="ae3fcab8-c0f9-4bbf-bdcd-66ce4f955b5c" containerID="5d3108b7e39f8bb99b41f9dbea33568bfb673fa9fce21db2e7c25f1d92c85ba3" exitCode=0 Mar 16 18:22:02 crc kubenswrapper[5120]: I0316 18:22:02.711263 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561422-mcmpn" event={"ID":"ae3fcab8-c0f9-4bbf-bdcd-66ce4f955b5c","Type":"ContainerDied","Data":"5d3108b7e39f8bb99b41f9dbea33568bfb673fa9fce21db2e7c25f1d92c85ba3"} Mar 16 18:22:04 crc kubenswrapper[5120]: I0316 18:22:04.004462 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561422-mcmpn" Mar 16 18:22:04 crc kubenswrapper[5120]: I0316 18:22:04.143843 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pfqcc\" (UniqueName: \"kubernetes.io/projected/ae3fcab8-c0f9-4bbf-bdcd-66ce4f955b5c-kube-api-access-pfqcc\") pod \"ae3fcab8-c0f9-4bbf-bdcd-66ce4f955b5c\" (UID: \"ae3fcab8-c0f9-4bbf-bdcd-66ce4f955b5c\") " Mar 16 18:22:04 crc kubenswrapper[5120]: I0316 18:22:04.152637 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae3fcab8-c0f9-4bbf-bdcd-66ce4f955b5c-kube-api-access-pfqcc" (OuterVolumeSpecName: "kube-api-access-pfqcc") pod "ae3fcab8-c0f9-4bbf-bdcd-66ce4f955b5c" (UID: "ae3fcab8-c0f9-4bbf-bdcd-66ce4f955b5c"). InnerVolumeSpecName "kube-api-access-pfqcc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 18:22:04 crc kubenswrapper[5120]: I0316 18:22:04.247351 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pfqcc\" (UniqueName: \"kubernetes.io/projected/ae3fcab8-c0f9-4bbf-bdcd-66ce4f955b5c-kube-api-access-pfqcc\") on node \"crc\" DevicePath \"\"" Mar 16 18:22:04 crc kubenswrapper[5120]: I0316 18:22:04.775572 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561422-mcmpn" Mar 16 18:22:04 crc kubenswrapper[5120]: I0316 18:22:04.775607 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561422-mcmpn" event={"ID":"ae3fcab8-c0f9-4bbf-bdcd-66ce4f955b5c","Type":"ContainerDied","Data":"c647f629a517788f071071b2c13fbd1d7754e905a25fa2a1f9f3a8256e141452"} Mar 16 18:22:04 crc kubenswrapper[5120]: I0316 18:22:04.775643 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c647f629a517788f071071b2c13fbd1d7754e905a25fa2a1f9f3a8256e141452" Mar 16 18:22:05 crc kubenswrapper[5120]: I0316 18:22:05.071359 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-infra/auto-csr-approver-29561416-brblg"] Mar 16 18:22:05 crc kubenswrapper[5120]: I0316 18:22:05.075219 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-infra/auto-csr-approver-29561416-brblg"] Mar 16 18:22:06 crc kubenswrapper[5120]: I0316 18:22:06.671534 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="48aace43-50f9-4103-8425-168de74dde68" path="/var/lib/kubelet/pods/48aace43-50f9-4103-8425-168de74dde68/volumes" Mar 16 18:22:07 crc kubenswrapper[5120]: E0316 18:22:07.190506 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=848755 actualBytes=10240 Mar 16 18:22:22 crc kubenswrapper[5120]: I0316 18:22:22.008520 5120 patch_prober.go:28] interesting pod/machine-config-daemon-7bf76 container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 18:22:22 crc kubenswrapper[5120]: I0316 18:22:22.010184 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 18:22:41 crc kubenswrapper[5120]: I0316 18:22:41.164465 5120 scope.go:117] "RemoveContainer" containerID="103006db7ea5d57b6c22e2afaf14dcb7a8f5c4d683b30c9b37898bcd1e97645c" Mar 16 18:22:52 crc kubenswrapper[5120]: I0316 18:22:52.008735 5120 patch_prober.go:28] interesting pod/machine-config-daemon-7bf76 container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 18:22:52 crc kubenswrapper[5120]: I0316 18:22:52.009416 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 18:23:07 crc kubenswrapper[5120]: E0316 18:23:07.274216 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=848758 actualBytes=10240 Mar 16 18:23:22 crc kubenswrapper[5120]: I0316 18:23:22.007726 5120 patch_prober.go:28] interesting pod/machine-config-daemon-7bf76 container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 18:23:22 crc kubenswrapper[5120]: I0316 18:23:22.008291 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 18:23:22 crc kubenswrapper[5120]: I0316 18:23:22.008336 5120 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" Mar 16 18:23:22 crc kubenswrapper[5120]: I0316 18:23:22.008871 5120 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="machine-config-daemon" containerStatusID={"Type":"cri-o","ID":"3d15b6e9605fcdee6974a8b8a0e3331e02f35b8864853b8905538f9ef03d86f3"} pod="openshift-machine-config-operator/machine-config-daemon-7bf76" containerMessage="Container machine-config-daemon failed liveness probe, will be restarted" Mar 16 18:23:22 crc kubenswrapper[5120]: I0316 18:23:22.008935 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" containerID="cri-o://3d15b6e9605fcdee6974a8b8a0e3331e02f35b8864853b8905538f9ef03d86f3" gracePeriod=600 Mar 16 18:23:22 crc kubenswrapper[5120]: I0316 18:23:22.144748 5120 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Mar 16 18:23:22 crc kubenswrapper[5120]: I0316 18:23:22.540962 5120 generic.go:358] "Generic (PLEG): container finished" podID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerID="3d15b6e9605fcdee6974a8b8a0e3331e02f35b8864853b8905538f9ef03d86f3" exitCode=0 Mar 16 18:23:22 crc kubenswrapper[5120]: I0316 18:23:22.541089 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" event={"ID":"e2275cb4-4905-4d66-a87e-8010120db2bd","Type":"ContainerDied","Data":"3d15b6e9605fcdee6974a8b8a0e3331e02f35b8864853b8905538f9ef03d86f3"} Mar 16 18:23:22 crc kubenswrapper[5120]: I0316 18:23:22.541710 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" event={"ID":"e2275cb4-4905-4d66-a87e-8010120db2bd","Type":"ContainerStarted","Data":"6aabe98083c5ab9b467fe00d2ebd9988de5342987777bf9f393b07f2a98973bc"} Mar 16 18:23:22 crc kubenswrapper[5120]: I0316 18:23:22.541747 5120 scope.go:117] "RemoveContainer" containerID="f46f7389db7e312fd9565c65ada72cf5a849906f210a5db0befeb36862170522" Mar 16 18:24:00 crc kubenswrapper[5120]: I0316 18:24:00.137189 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-infra/auto-csr-approver-29561424-cbjjm"] Mar 16 18:24:00 crc kubenswrapper[5120]: I0316 18:24:00.138473 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae3fcab8-c0f9-4bbf-bdcd-66ce4f955b5c" containerName="oc" Mar 16 18:24:00 crc kubenswrapper[5120]: I0316 18:24:00.138491 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae3fcab8-c0f9-4bbf-bdcd-66ce4f955b5c" containerName="oc" Mar 16 18:24:00 crc kubenswrapper[5120]: I0316 18:24:00.138615 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ae3fcab8-c0f9-4bbf-bdcd-66ce4f955b5c" containerName="oc" Mar 16 18:24:00 crc kubenswrapper[5120]: I0316 18:24:00.144612 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561424-cbjjm" Mar 16 18:24:00 crc kubenswrapper[5120]: I0316 18:24:00.146587 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561424-cbjjm"] Mar 16 18:24:00 crc kubenswrapper[5120]: I0316 18:24:00.147809 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-infra\"/\"csr-approver-sa-dockercfg-x2nsz\"" Mar 16 18:24:00 crc kubenswrapper[5120]: I0316 18:24:00.148028 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"kube-root-ca.crt\"" Mar 16 18:24:00 crc kubenswrapper[5120]: I0316 18:24:00.150327 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"openshift-service-ca.crt\"" Mar 16 18:24:00 crc kubenswrapper[5120]: I0316 18:24:00.257732 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28glk\" (UniqueName: \"kubernetes.io/projected/e3f6080f-c45c-40a7-8296-d74ea7f5097e-kube-api-access-28glk\") pod \"auto-csr-approver-29561424-cbjjm\" (UID: \"e3f6080f-c45c-40a7-8296-d74ea7f5097e\") " pod="openshift-infra/auto-csr-approver-29561424-cbjjm" Mar 16 18:24:00 crc kubenswrapper[5120]: I0316 18:24:00.360691 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-28glk\" (UniqueName: \"kubernetes.io/projected/e3f6080f-c45c-40a7-8296-d74ea7f5097e-kube-api-access-28glk\") pod \"auto-csr-approver-29561424-cbjjm\" (UID: \"e3f6080f-c45c-40a7-8296-d74ea7f5097e\") " pod="openshift-infra/auto-csr-approver-29561424-cbjjm" Mar 16 18:24:00 crc kubenswrapper[5120]: I0316 18:24:00.380642 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-28glk\" (UniqueName: \"kubernetes.io/projected/e3f6080f-c45c-40a7-8296-d74ea7f5097e-kube-api-access-28glk\") pod \"auto-csr-approver-29561424-cbjjm\" (UID: \"e3f6080f-c45c-40a7-8296-d74ea7f5097e\") " pod="openshift-infra/auto-csr-approver-29561424-cbjjm" Mar 16 18:24:00 crc kubenswrapper[5120]: I0316 18:24:00.465317 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561424-cbjjm" Mar 16 18:24:00 crc kubenswrapper[5120]: I0316 18:24:00.675851 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561424-cbjjm"] Mar 16 18:24:00 crc kubenswrapper[5120]: I0316 18:24:00.830353 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561424-cbjjm" event={"ID":"e3f6080f-c45c-40a7-8296-d74ea7f5097e","Type":"ContainerStarted","Data":"a3581a16aea1da37e9053041ecc116eba545cbb44055b74d76eb9caf4c7c3a15"} Mar 16 18:24:02 crc kubenswrapper[5120]: I0316 18:24:02.853543 5120 generic.go:358] "Generic (PLEG): container finished" podID="e3f6080f-c45c-40a7-8296-d74ea7f5097e" containerID="440fa03c5eba13306a5502234a82254e00e0a87202f0ce5c3e87717e3eb4b96b" exitCode=0 Mar 16 18:24:02 crc kubenswrapper[5120]: I0316 18:24:02.853633 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561424-cbjjm" event={"ID":"e3f6080f-c45c-40a7-8296-d74ea7f5097e","Type":"ContainerDied","Data":"440fa03c5eba13306a5502234a82254e00e0a87202f0ce5c3e87717e3eb4b96b"} Mar 16 18:24:04 crc kubenswrapper[5120]: I0316 18:24:04.187084 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561424-cbjjm" Mar 16 18:24:04 crc kubenswrapper[5120]: I0316 18:24:04.361609 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-28glk\" (UniqueName: \"kubernetes.io/projected/e3f6080f-c45c-40a7-8296-d74ea7f5097e-kube-api-access-28glk\") pod \"e3f6080f-c45c-40a7-8296-d74ea7f5097e\" (UID: \"e3f6080f-c45c-40a7-8296-d74ea7f5097e\") " Mar 16 18:24:04 crc kubenswrapper[5120]: I0316 18:24:04.368366 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3f6080f-c45c-40a7-8296-d74ea7f5097e-kube-api-access-28glk" (OuterVolumeSpecName: "kube-api-access-28glk") pod "e3f6080f-c45c-40a7-8296-d74ea7f5097e" (UID: "e3f6080f-c45c-40a7-8296-d74ea7f5097e"). InnerVolumeSpecName "kube-api-access-28glk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 18:24:04 crc kubenswrapper[5120]: I0316 18:24:04.464033 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-28glk\" (UniqueName: \"kubernetes.io/projected/e3f6080f-c45c-40a7-8296-d74ea7f5097e-kube-api-access-28glk\") on node \"crc\" DevicePath \"\"" Mar 16 18:24:04 crc kubenswrapper[5120]: I0316 18:24:04.871343 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561424-cbjjm" Mar 16 18:24:04 crc kubenswrapper[5120]: I0316 18:24:04.871375 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561424-cbjjm" event={"ID":"e3f6080f-c45c-40a7-8296-d74ea7f5097e","Type":"ContainerDied","Data":"a3581a16aea1da37e9053041ecc116eba545cbb44055b74d76eb9caf4c7c3a15"} Mar 16 18:24:04 crc kubenswrapper[5120]: I0316 18:24:04.871813 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a3581a16aea1da37e9053041ecc116eba545cbb44055b74d76eb9caf4c7c3a15" Mar 16 18:24:05 crc kubenswrapper[5120]: I0316 18:24:05.260739 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-infra/auto-csr-approver-29561418-tz622"] Mar 16 18:24:05 crc kubenswrapper[5120]: I0316 18:24:05.270308 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-infra/auto-csr-approver-29561418-tz622"] Mar 16 18:24:06 crc kubenswrapper[5120]: I0316 18:24:06.673522 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6bb1f1d3-b165-49a5-adcb-09bf50d83fbf" path="/var/lib/kubelet/pods/6bb1f1d3-b165-49a5-adcb-09bf50d83fbf/volumes" Mar 16 18:24:07 crc kubenswrapper[5120]: E0316 18:24:07.215786 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=848758 actualBytes=10240 Mar 16 18:24:41 crc kubenswrapper[5120]: I0316 18:24:41.287705 5120 scope.go:117] "RemoveContainer" containerID="e5912d264b28dd86760ee643ceb1d86c432e5b9fd8d38efa0ef72f087c223283" Mar 16 18:24:55 crc kubenswrapper[5120]: I0316 18:24:55.926216 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-operators-nnkdg"] Mar 16 18:24:55 crc kubenswrapper[5120]: I0316 18:24:55.927667 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3f6080f-c45c-40a7-8296-d74ea7f5097e" containerName="oc" Mar 16 18:24:55 crc kubenswrapper[5120]: I0316 18:24:55.927682 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3f6080f-c45c-40a7-8296-d74ea7f5097e" containerName="oc" Mar 16 18:24:55 crc kubenswrapper[5120]: I0316 18:24:55.927854 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="e3f6080f-c45c-40a7-8296-d74ea7f5097e" containerName="oc" Mar 16 18:24:55 crc kubenswrapper[5120]: I0316 18:24:55.933969 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-nnkdg" Mar 16 18:24:55 crc kubenswrapper[5120]: I0316 18:24:55.939131 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-nnkdg"] Mar 16 18:24:56 crc kubenswrapper[5120]: I0316 18:24:56.092199 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/fbb41ab9-ddd0-41e5-86a2-d3d2de6465f2-utilities\") pod \"redhat-operators-nnkdg\" (UID: \"fbb41ab9-ddd0-41e5-86a2-d3d2de6465f2\") " pod="openshift-marketplace/redhat-operators-nnkdg" Mar 16 18:24:56 crc kubenswrapper[5120]: I0316 18:24:56.092653 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-scrdw\" (UniqueName: \"kubernetes.io/projected/fbb41ab9-ddd0-41e5-86a2-d3d2de6465f2-kube-api-access-scrdw\") pod \"redhat-operators-nnkdg\" (UID: \"fbb41ab9-ddd0-41e5-86a2-d3d2de6465f2\") " pod="openshift-marketplace/redhat-operators-nnkdg" Mar 16 18:24:56 crc kubenswrapper[5120]: I0316 18:24:56.092869 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/fbb41ab9-ddd0-41e5-86a2-d3d2de6465f2-catalog-content\") pod \"redhat-operators-nnkdg\" (UID: \"fbb41ab9-ddd0-41e5-86a2-d3d2de6465f2\") " pod="openshift-marketplace/redhat-operators-nnkdg" Mar 16 18:24:56 crc kubenswrapper[5120]: I0316 18:24:56.194819 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/fbb41ab9-ddd0-41e5-86a2-d3d2de6465f2-catalog-content\") pod \"redhat-operators-nnkdg\" (UID: \"fbb41ab9-ddd0-41e5-86a2-d3d2de6465f2\") " pod="openshift-marketplace/redhat-operators-nnkdg" Mar 16 18:24:56 crc kubenswrapper[5120]: I0316 18:24:56.195027 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/fbb41ab9-ddd0-41e5-86a2-d3d2de6465f2-utilities\") pod \"redhat-operators-nnkdg\" (UID: \"fbb41ab9-ddd0-41e5-86a2-d3d2de6465f2\") " pod="openshift-marketplace/redhat-operators-nnkdg" Mar 16 18:24:56 crc kubenswrapper[5120]: I0316 18:24:56.195236 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/fbb41ab9-ddd0-41e5-86a2-d3d2de6465f2-catalog-content\") pod \"redhat-operators-nnkdg\" (UID: \"fbb41ab9-ddd0-41e5-86a2-d3d2de6465f2\") " pod="openshift-marketplace/redhat-operators-nnkdg" Mar 16 18:24:56 crc kubenswrapper[5120]: I0316 18:24:56.195330 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-scrdw\" (UniqueName: \"kubernetes.io/projected/fbb41ab9-ddd0-41e5-86a2-d3d2de6465f2-kube-api-access-scrdw\") pod \"redhat-operators-nnkdg\" (UID: \"fbb41ab9-ddd0-41e5-86a2-d3d2de6465f2\") " pod="openshift-marketplace/redhat-operators-nnkdg" Mar 16 18:24:56 crc kubenswrapper[5120]: I0316 18:24:56.195500 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/fbb41ab9-ddd0-41e5-86a2-d3d2de6465f2-utilities\") pod \"redhat-operators-nnkdg\" (UID: \"fbb41ab9-ddd0-41e5-86a2-d3d2de6465f2\") " pod="openshift-marketplace/redhat-operators-nnkdg" Mar 16 18:24:56 crc kubenswrapper[5120]: I0316 18:24:56.221880 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-scrdw\" (UniqueName: \"kubernetes.io/projected/fbb41ab9-ddd0-41e5-86a2-d3d2de6465f2-kube-api-access-scrdw\") pod \"redhat-operators-nnkdg\" (UID: \"fbb41ab9-ddd0-41e5-86a2-d3d2de6465f2\") " pod="openshift-marketplace/redhat-operators-nnkdg" Mar 16 18:24:56 crc kubenswrapper[5120]: I0316 18:24:56.262667 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-nnkdg" Mar 16 18:24:56 crc kubenswrapper[5120]: I0316 18:24:56.682699 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-nnkdg"] Mar 16 18:24:57 crc kubenswrapper[5120]: I0316 18:24:57.546076 5120 generic.go:358] "Generic (PLEG): container finished" podID="fbb41ab9-ddd0-41e5-86a2-d3d2de6465f2" containerID="f562848a8d1eeacef3e6bd9dc00ac563ad7120ccc7f094cefdddf3b0cbd39221" exitCode=0 Mar 16 18:24:57 crc kubenswrapper[5120]: I0316 18:24:57.546142 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-nnkdg" event={"ID":"fbb41ab9-ddd0-41e5-86a2-d3d2de6465f2","Type":"ContainerDied","Data":"f562848a8d1eeacef3e6bd9dc00ac563ad7120ccc7f094cefdddf3b0cbd39221"} Mar 16 18:24:57 crc kubenswrapper[5120]: I0316 18:24:57.546607 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-nnkdg" event={"ID":"fbb41ab9-ddd0-41e5-86a2-d3d2de6465f2","Type":"ContainerStarted","Data":"e236b737a15ecd807787a475e8619413357758d0956ec127e0a25c13bef167db"} Mar 16 18:24:59 crc kubenswrapper[5120]: I0316 18:24:59.569989 5120 generic.go:358] "Generic (PLEG): container finished" podID="fbb41ab9-ddd0-41e5-86a2-d3d2de6465f2" containerID="51465c4a58103c1683f2c694cd5a3581f5c772d663fbb966eb7332daa22af80a" exitCode=0 Mar 16 18:24:59 crc kubenswrapper[5120]: I0316 18:24:59.570079 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-nnkdg" event={"ID":"fbb41ab9-ddd0-41e5-86a2-d3d2de6465f2","Type":"ContainerDied","Data":"51465c4a58103c1683f2c694cd5a3581f5c772d663fbb966eb7332daa22af80a"} Mar 16 18:25:00 crc kubenswrapper[5120]: I0316 18:25:00.579925 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-nnkdg" event={"ID":"fbb41ab9-ddd0-41e5-86a2-d3d2de6465f2","Type":"ContainerStarted","Data":"8e412e1c053b87f995dc844f9cb92a6505621445c78c58c855b4b681b9a5b2ef"} Mar 16 18:25:00 crc kubenswrapper[5120]: I0316 18:25:00.601949 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/redhat-operators-nnkdg" podStartSLOduration=4.54952782 podStartE2EDuration="5.601930538s" podCreationTimestamp="2026-03-16 18:24:55 +0000 UTC" firstStartedPulling="2026-03-16 18:24:57.547396357 +0000 UTC m=+10399.701328054" lastFinishedPulling="2026-03-16 18:24:58.599799115 +0000 UTC m=+10400.753730772" observedRunningTime="2026-03-16 18:25:00.601267771 +0000 UTC m=+10402.755199448" watchObservedRunningTime="2026-03-16 18:25:00.601930538 +0000 UTC m=+10402.755862195" Mar 16 18:25:06 crc kubenswrapper[5120]: I0316 18:25:06.263856 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-marketplace/redhat-operators-nnkdg" Mar 16 18:25:06 crc kubenswrapper[5120]: I0316 18:25:06.264334 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-operators-nnkdg" Mar 16 18:25:06 crc kubenswrapper[5120]: I0316 18:25:06.302639 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-operators-nnkdg" Mar 16 18:25:06 crc kubenswrapper[5120]: I0316 18:25:06.679602 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-operators-nnkdg" Mar 16 18:25:06 crc kubenswrapper[5120]: I0316 18:25:06.736749 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-operators-nnkdg"] Mar 16 18:25:07 crc kubenswrapper[5120]: E0316 18:25:07.370080 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=885108 actualBytes=10240 Mar 16 18:25:08 crc kubenswrapper[5120]: I0316 18:25:08.743343 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-marketplace/redhat-operators-nnkdg" podUID="fbb41ab9-ddd0-41e5-86a2-d3d2de6465f2" containerName="registry-server" containerID="cri-o://8e412e1c053b87f995dc844f9cb92a6505621445c78c58c855b4b681b9a5b2ef" gracePeriod=2 Mar 16 18:25:09 crc kubenswrapper[5120]: I0316 18:25:09.119194 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-nnkdg" Mar 16 18:25:09 crc kubenswrapper[5120]: I0316 18:25:09.225002 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-scrdw\" (UniqueName: \"kubernetes.io/projected/fbb41ab9-ddd0-41e5-86a2-d3d2de6465f2-kube-api-access-scrdw\") pod \"fbb41ab9-ddd0-41e5-86a2-d3d2de6465f2\" (UID: \"fbb41ab9-ddd0-41e5-86a2-d3d2de6465f2\") " Mar 16 18:25:09 crc kubenswrapper[5120]: I0316 18:25:09.225303 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/fbb41ab9-ddd0-41e5-86a2-d3d2de6465f2-utilities\") pod \"fbb41ab9-ddd0-41e5-86a2-d3d2de6465f2\" (UID: \"fbb41ab9-ddd0-41e5-86a2-d3d2de6465f2\") " Mar 16 18:25:09 crc kubenswrapper[5120]: I0316 18:25:09.225391 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/fbb41ab9-ddd0-41e5-86a2-d3d2de6465f2-catalog-content\") pod \"fbb41ab9-ddd0-41e5-86a2-d3d2de6465f2\" (UID: \"fbb41ab9-ddd0-41e5-86a2-d3d2de6465f2\") " Mar 16 18:25:09 crc kubenswrapper[5120]: I0316 18:25:09.226483 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbb41ab9-ddd0-41e5-86a2-d3d2de6465f2-utilities" (OuterVolumeSpecName: "utilities") pod "fbb41ab9-ddd0-41e5-86a2-d3d2de6465f2" (UID: "fbb41ab9-ddd0-41e5-86a2-d3d2de6465f2"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 18:25:09 crc kubenswrapper[5120]: I0316 18:25:09.226926 5120 reconciler_common.go:299] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/fbb41ab9-ddd0-41e5-86a2-d3d2de6465f2-utilities\") on node \"crc\" DevicePath \"\"" Mar 16 18:25:09 crc kubenswrapper[5120]: I0316 18:25:09.235143 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fbb41ab9-ddd0-41e5-86a2-d3d2de6465f2-kube-api-access-scrdw" (OuterVolumeSpecName: "kube-api-access-scrdw") pod "fbb41ab9-ddd0-41e5-86a2-d3d2de6465f2" (UID: "fbb41ab9-ddd0-41e5-86a2-d3d2de6465f2"). InnerVolumeSpecName "kube-api-access-scrdw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 18:25:09 crc kubenswrapper[5120]: I0316 18:25:09.328830 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-scrdw\" (UniqueName: \"kubernetes.io/projected/fbb41ab9-ddd0-41e5-86a2-d3d2de6465f2-kube-api-access-scrdw\") on node \"crc\" DevicePath \"\"" Mar 16 18:25:09 crc kubenswrapper[5120]: I0316 18:25:09.704237 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbb41ab9-ddd0-41e5-86a2-d3d2de6465f2-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "fbb41ab9-ddd0-41e5-86a2-d3d2de6465f2" (UID: "fbb41ab9-ddd0-41e5-86a2-d3d2de6465f2"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 18:25:09 crc kubenswrapper[5120]: I0316 18:25:09.739908 5120 reconciler_common.go:299] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/fbb41ab9-ddd0-41e5-86a2-d3d2de6465f2-catalog-content\") on node \"crc\" DevicePath \"\"" Mar 16 18:25:09 crc kubenswrapper[5120]: I0316 18:25:09.753879 5120 generic.go:358] "Generic (PLEG): container finished" podID="fbb41ab9-ddd0-41e5-86a2-d3d2de6465f2" containerID="8e412e1c053b87f995dc844f9cb92a6505621445c78c58c855b4b681b9a5b2ef" exitCode=0 Mar 16 18:25:09 crc kubenswrapper[5120]: I0316 18:25:09.754118 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-nnkdg" event={"ID":"fbb41ab9-ddd0-41e5-86a2-d3d2de6465f2","Type":"ContainerDied","Data":"8e412e1c053b87f995dc844f9cb92a6505621445c78c58c855b4b681b9a5b2ef"} Mar 16 18:25:09 crc kubenswrapper[5120]: I0316 18:25:09.754157 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-nnkdg" event={"ID":"fbb41ab9-ddd0-41e5-86a2-d3d2de6465f2","Type":"ContainerDied","Data":"e236b737a15ecd807787a475e8619413357758d0956ec127e0a25c13bef167db"} Mar 16 18:25:09 crc kubenswrapper[5120]: I0316 18:25:09.754188 5120 scope.go:117] "RemoveContainer" containerID="8e412e1c053b87f995dc844f9cb92a6505621445c78c58c855b4b681b9a5b2ef" Mar 16 18:25:09 crc kubenswrapper[5120]: I0316 18:25:09.754390 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-nnkdg" Mar 16 18:25:09 crc kubenswrapper[5120]: I0316 18:25:09.807380 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-operators-nnkdg"] Mar 16 18:25:09 crc kubenswrapper[5120]: I0316 18:25:09.815574 5120 scope.go:117] "RemoveContainer" containerID="51465c4a58103c1683f2c694cd5a3581f5c772d663fbb966eb7332daa22af80a" Mar 16 18:25:09 crc kubenswrapper[5120]: I0316 18:25:09.820213 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/redhat-operators-nnkdg"] Mar 16 18:25:09 crc kubenswrapper[5120]: I0316 18:25:09.836113 5120 scope.go:117] "RemoveContainer" containerID="f562848a8d1eeacef3e6bd9dc00ac563ad7120ccc7f094cefdddf3b0cbd39221" Mar 16 18:25:09 crc kubenswrapper[5120]: I0316 18:25:09.878630 5120 scope.go:117] "RemoveContainer" containerID="8e412e1c053b87f995dc844f9cb92a6505621445c78c58c855b4b681b9a5b2ef" Mar 16 18:25:09 crc kubenswrapper[5120]: E0316 18:25:09.879167 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e412e1c053b87f995dc844f9cb92a6505621445c78c58c855b4b681b9a5b2ef\": container with ID starting with 8e412e1c053b87f995dc844f9cb92a6505621445c78c58c855b4b681b9a5b2ef not found: ID does not exist" containerID="8e412e1c053b87f995dc844f9cb92a6505621445c78c58c855b4b681b9a5b2ef" Mar 16 18:25:09 crc kubenswrapper[5120]: I0316 18:25:09.879201 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e412e1c053b87f995dc844f9cb92a6505621445c78c58c855b4b681b9a5b2ef"} err="failed to get container status \"8e412e1c053b87f995dc844f9cb92a6505621445c78c58c855b4b681b9a5b2ef\": rpc error: code = NotFound desc = could not find container \"8e412e1c053b87f995dc844f9cb92a6505621445c78c58c855b4b681b9a5b2ef\": container with ID starting with 8e412e1c053b87f995dc844f9cb92a6505621445c78c58c855b4b681b9a5b2ef not found: ID does not exist" Mar 16 18:25:09 crc kubenswrapper[5120]: I0316 18:25:09.879234 5120 scope.go:117] "RemoveContainer" containerID="51465c4a58103c1683f2c694cd5a3581f5c772d663fbb966eb7332daa22af80a" Mar 16 18:25:09 crc kubenswrapper[5120]: E0316 18:25:09.879870 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"51465c4a58103c1683f2c694cd5a3581f5c772d663fbb966eb7332daa22af80a\": container with ID starting with 51465c4a58103c1683f2c694cd5a3581f5c772d663fbb966eb7332daa22af80a not found: ID does not exist" containerID="51465c4a58103c1683f2c694cd5a3581f5c772d663fbb966eb7332daa22af80a" Mar 16 18:25:09 crc kubenswrapper[5120]: I0316 18:25:09.879925 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51465c4a58103c1683f2c694cd5a3581f5c772d663fbb966eb7332daa22af80a"} err="failed to get container status \"51465c4a58103c1683f2c694cd5a3581f5c772d663fbb966eb7332daa22af80a\": rpc error: code = NotFound desc = could not find container \"51465c4a58103c1683f2c694cd5a3581f5c772d663fbb966eb7332daa22af80a\": container with ID starting with 51465c4a58103c1683f2c694cd5a3581f5c772d663fbb966eb7332daa22af80a not found: ID does not exist" Mar 16 18:25:09 crc kubenswrapper[5120]: I0316 18:25:09.879960 5120 scope.go:117] "RemoveContainer" containerID="f562848a8d1eeacef3e6bd9dc00ac563ad7120ccc7f094cefdddf3b0cbd39221" Mar 16 18:25:09 crc kubenswrapper[5120]: E0316 18:25:09.880349 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f562848a8d1eeacef3e6bd9dc00ac563ad7120ccc7f094cefdddf3b0cbd39221\": container with ID starting with f562848a8d1eeacef3e6bd9dc00ac563ad7120ccc7f094cefdddf3b0cbd39221 not found: ID does not exist" containerID="f562848a8d1eeacef3e6bd9dc00ac563ad7120ccc7f094cefdddf3b0cbd39221" Mar 16 18:25:09 crc kubenswrapper[5120]: I0316 18:25:09.880398 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f562848a8d1eeacef3e6bd9dc00ac563ad7120ccc7f094cefdddf3b0cbd39221"} err="failed to get container status \"f562848a8d1eeacef3e6bd9dc00ac563ad7120ccc7f094cefdddf3b0cbd39221\": rpc error: code = NotFound desc = could not find container \"f562848a8d1eeacef3e6bd9dc00ac563ad7120ccc7f094cefdddf3b0cbd39221\": container with ID starting with f562848a8d1eeacef3e6bd9dc00ac563ad7120ccc7f094cefdddf3b0cbd39221 not found: ID does not exist" Mar 16 18:25:10 crc kubenswrapper[5120]: I0316 18:25:10.679834 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fbb41ab9-ddd0-41e5-86a2-d3d2de6465f2" path="/var/lib/kubelet/pods/fbb41ab9-ddd0-41e5-86a2-d3d2de6465f2/volumes" Mar 16 18:25:22 crc kubenswrapper[5120]: I0316 18:25:22.008346 5120 patch_prober.go:28] interesting pod/machine-config-daemon-7bf76 container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 18:25:22 crc kubenswrapper[5120]: I0316 18:25:22.008735 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 18:25:30 crc kubenswrapper[5120]: I0316 18:25:30.789133 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/certified-operators-2p4v9"] Mar 16 18:25:30 crc kubenswrapper[5120]: I0316 18:25:30.790274 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fbb41ab9-ddd0-41e5-86a2-d3d2de6465f2" containerName="registry-server" Mar 16 18:25:30 crc kubenswrapper[5120]: I0316 18:25:30.790286 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="fbb41ab9-ddd0-41e5-86a2-d3d2de6465f2" containerName="registry-server" Mar 16 18:25:30 crc kubenswrapper[5120]: I0316 18:25:30.790300 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fbb41ab9-ddd0-41e5-86a2-d3d2de6465f2" containerName="extract-utilities" Mar 16 18:25:30 crc kubenswrapper[5120]: I0316 18:25:30.790308 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="fbb41ab9-ddd0-41e5-86a2-d3d2de6465f2" containerName="extract-utilities" Mar 16 18:25:30 crc kubenswrapper[5120]: I0316 18:25:30.790327 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fbb41ab9-ddd0-41e5-86a2-d3d2de6465f2" containerName="extract-content" Mar 16 18:25:30 crc kubenswrapper[5120]: I0316 18:25:30.790333 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="fbb41ab9-ddd0-41e5-86a2-d3d2de6465f2" containerName="extract-content" Mar 16 18:25:30 crc kubenswrapper[5120]: I0316 18:25:30.790454 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="fbb41ab9-ddd0-41e5-86a2-d3d2de6465f2" containerName="registry-server" Mar 16 18:25:30 crc kubenswrapper[5120]: I0316 18:25:30.794817 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-2p4v9" Mar 16 18:25:30 crc kubenswrapper[5120]: I0316 18:25:30.807342 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/certified-operators-2p4v9"] Mar 16 18:25:30 crc kubenswrapper[5120]: I0316 18:25:30.856220 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhsqk\" (UniqueName: \"kubernetes.io/projected/ca34c9ae-2826-4812-878d-a232a30eea9b-kube-api-access-hhsqk\") pod \"certified-operators-2p4v9\" (UID: \"ca34c9ae-2826-4812-878d-a232a30eea9b\") " pod="openshift-marketplace/certified-operators-2p4v9" Mar 16 18:25:30 crc kubenswrapper[5120]: I0316 18:25:30.856462 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/ca34c9ae-2826-4812-878d-a232a30eea9b-utilities\") pod \"certified-operators-2p4v9\" (UID: \"ca34c9ae-2826-4812-878d-a232a30eea9b\") " pod="openshift-marketplace/certified-operators-2p4v9" Mar 16 18:25:30 crc kubenswrapper[5120]: I0316 18:25:30.856513 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/ca34c9ae-2826-4812-878d-a232a30eea9b-catalog-content\") pod \"certified-operators-2p4v9\" (UID: \"ca34c9ae-2826-4812-878d-a232a30eea9b\") " pod="openshift-marketplace/certified-operators-2p4v9" Mar 16 18:25:30 crc kubenswrapper[5120]: I0316 18:25:30.959482 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hhsqk\" (UniqueName: \"kubernetes.io/projected/ca34c9ae-2826-4812-878d-a232a30eea9b-kube-api-access-hhsqk\") pod \"certified-operators-2p4v9\" (UID: \"ca34c9ae-2826-4812-878d-a232a30eea9b\") " pod="openshift-marketplace/certified-operators-2p4v9" Mar 16 18:25:30 crc kubenswrapper[5120]: I0316 18:25:30.959713 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/ca34c9ae-2826-4812-878d-a232a30eea9b-utilities\") pod \"certified-operators-2p4v9\" (UID: \"ca34c9ae-2826-4812-878d-a232a30eea9b\") " pod="openshift-marketplace/certified-operators-2p4v9" Mar 16 18:25:30 crc kubenswrapper[5120]: I0316 18:25:30.959833 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/ca34c9ae-2826-4812-878d-a232a30eea9b-catalog-content\") pod \"certified-operators-2p4v9\" (UID: \"ca34c9ae-2826-4812-878d-a232a30eea9b\") " pod="openshift-marketplace/certified-operators-2p4v9" Mar 16 18:25:30 crc kubenswrapper[5120]: I0316 18:25:30.960169 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/ca34c9ae-2826-4812-878d-a232a30eea9b-utilities\") pod \"certified-operators-2p4v9\" (UID: \"ca34c9ae-2826-4812-878d-a232a30eea9b\") " pod="openshift-marketplace/certified-operators-2p4v9" Mar 16 18:25:30 crc kubenswrapper[5120]: I0316 18:25:30.960677 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/ca34c9ae-2826-4812-878d-a232a30eea9b-catalog-content\") pod \"certified-operators-2p4v9\" (UID: \"ca34c9ae-2826-4812-878d-a232a30eea9b\") " pod="openshift-marketplace/certified-operators-2p4v9" Mar 16 18:25:30 crc kubenswrapper[5120]: I0316 18:25:30.992141 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhsqk\" (UniqueName: \"kubernetes.io/projected/ca34c9ae-2826-4812-878d-a232a30eea9b-kube-api-access-hhsqk\") pod \"certified-operators-2p4v9\" (UID: \"ca34c9ae-2826-4812-878d-a232a30eea9b\") " pod="openshift-marketplace/certified-operators-2p4v9" Mar 16 18:25:31 crc kubenswrapper[5120]: I0316 18:25:31.116293 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-2p4v9" Mar 16 18:25:31 crc kubenswrapper[5120]: I0316 18:25:31.186520 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/community-operators-k8gk8"] Mar 16 18:25:31 crc kubenswrapper[5120]: I0316 18:25:31.195887 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/community-operators-k8gk8"] Mar 16 18:25:31 crc kubenswrapper[5120]: I0316 18:25:31.196030 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-k8gk8" Mar 16 18:25:31 crc kubenswrapper[5120]: I0316 18:25:31.269318 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/620719d1-fe82-4641-9d69-6eb01e0259cd-utilities\") pod \"community-operators-k8gk8\" (UID: \"620719d1-fe82-4641-9d69-6eb01e0259cd\") " pod="openshift-marketplace/community-operators-k8gk8" Mar 16 18:25:31 crc kubenswrapper[5120]: I0316 18:25:31.269393 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/620719d1-fe82-4641-9d69-6eb01e0259cd-catalog-content\") pod \"community-operators-k8gk8\" (UID: \"620719d1-fe82-4641-9d69-6eb01e0259cd\") " pod="openshift-marketplace/community-operators-k8gk8" Mar 16 18:25:31 crc kubenswrapper[5120]: I0316 18:25:31.269546 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nnzrr\" (UniqueName: \"kubernetes.io/projected/620719d1-fe82-4641-9d69-6eb01e0259cd-kube-api-access-nnzrr\") pod \"community-operators-k8gk8\" (UID: \"620719d1-fe82-4641-9d69-6eb01e0259cd\") " pod="openshift-marketplace/community-operators-k8gk8" Mar 16 18:25:31 crc kubenswrapper[5120]: I0316 18:25:31.373940 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nnzrr\" (UniqueName: \"kubernetes.io/projected/620719d1-fe82-4641-9d69-6eb01e0259cd-kube-api-access-nnzrr\") pod \"community-operators-k8gk8\" (UID: \"620719d1-fe82-4641-9d69-6eb01e0259cd\") " pod="openshift-marketplace/community-operators-k8gk8" Mar 16 18:25:31 crc kubenswrapper[5120]: I0316 18:25:31.374272 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/620719d1-fe82-4641-9d69-6eb01e0259cd-utilities\") pod \"community-operators-k8gk8\" (UID: \"620719d1-fe82-4641-9d69-6eb01e0259cd\") " pod="openshift-marketplace/community-operators-k8gk8" Mar 16 18:25:31 crc kubenswrapper[5120]: I0316 18:25:31.374300 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/620719d1-fe82-4641-9d69-6eb01e0259cd-catalog-content\") pod \"community-operators-k8gk8\" (UID: \"620719d1-fe82-4641-9d69-6eb01e0259cd\") " pod="openshift-marketplace/community-operators-k8gk8" Mar 16 18:25:31 crc kubenswrapper[5120]: I0316 18:25:31.375118 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/620719d1-fe82-4641-9d69-6eb01e0259cd-catalog-content\") pod \"community-operators-k8gk8\" (UID: \"620719d1-fe82-4641-9d69-6eb01e0259cd\") " pod="openshift-marketplace/community-operators-k8gk8" Mar 16 18:25:31 crc kubenswrapper[5120]: I0316 18:25:31.375610 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/620719d1-fe82-4641-9d69-6eb01e0259cd-utilities\") pod \"community-operators-k8gk8\" (UID: \"620719d1-fe82-4641-9d69-6eb01e0259cd\") " pod="openshift-marketplace/community-operators-k8gk8" Mar 16 18:25:31 crc kubenswrapper[5120]: I0316 18:25:31.377019 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/certified-operators-2p4v9"] Mar 16 18:25:31 crc kubenswrapper[5120]: W0316 18:25:31.390941 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca34c9ae_2826_4812_878d_a232a30eea9b.slice/crio-c1273043e23bbb0348d62bf3880aad5001b78b6b90122fc0fd499594a19b5b23 WatchSource:0}: Error finding container c1273043e23bbb0348d62bf3880aad5001b78b6b90122fc0fd499594a19b5b23: Status 404 returned error can't find the container with id c1273043e23bbb0348d62bf3880aad5001b78b6b90122fc0fd499594a19b5b23 Mar 16 18:25:31 crc kubenswrapper[5120]: I0316 18:25:31.407175 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nnzrr\" (UniqueName: \"kubernetes.io/projected/620719d1-fe82-4641-9d69-6eb01e0259cd-kube-api-access-nnzrr\") pod \"community-operators-k8gk8\" (UID: \"620719d1-fe82-4641-9d69-6eb01e0259cd\") " pod="openshift-marketplace/community-operators-k8gk8" Mar 16 18:25:31 crc kubenswrapper[5120]: I0316 18:25:31.550414 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-k8gk8" Mar 16 18:25:31 crc kubenswrapper[5120]: I0316 18:25:31.929593 5120 generic.go:358] "Generic (PLEG): container finished" podID="ca34c9ae-2826-4812-878d-a232a30eea9b" containerID="6dcb5aa1d3f56aa637391d2a3de9192b3240a8e0a7108d3dac52bb5aaf162b04" exitCode=0 Mar 16 18:25:31 crc kubenswrapper[5120]: I0316 18:25:31.929644 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-2p4v9" event={"ID":"ca34c9ae-2826-4812-878d-a232a30eea9b","Type":"ContainerDied","Data":"6dcb5aa1d3f56aa637391d2a3de9192b3240a8e0a7108d3dac52bb5aaf162b04"} Mar 16 18:25:31 crc kubenswrapper[5120]: I0316 18:25:31.929936 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-2p4v9" event={"ID":"ca34c9ae-2826-4812-878d-a232a30eea9b","Type":"ContainerStarted","Data":"c1273043e23bbb0348d62bf3880aad5001b78b6b90122fc0fd499594a19b5b23"} Mar 16 18:25:32 crc kubenswrapper[5120]: I0316 18:25:32.038907 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/community-operators-k8gk8"] Mar 16 18:25:32 crc kubenswrapper[5120]: W0316 18:25:32.041377 5120 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod620719d1_fe82_4641_9d69_6eb01e0259cd.slice/crio-88ab451cccbbe430639f5f61472bffc3f855bf3a104d615b04c3b941e16937b3 WatchSource:0}: Error finding container 88ab451cccbbe430639f5f61472bffc3f855bf3a104d615b04c3b941e16937b3: Status 404 returned error can't find the container with id 88ab451cccbbe430639f5f61472bffc3f855bf3a104d615b04c3b941e16937b3 Mar 16 18:25:32 crc kubenswrapper[5120]: I0316 18:25:32.941484 5120 generic.go:358] "Generic (PLEG): container finished" podID="620719d1-fe82-4641-9d69-6eb01e0259cd" containerID="f54abd5ca0aa6987c985dc50d3fc55884adb0cd04c49a5c29c894ac0dc467b7d" exitCode=0 Mar 16 18:25:32 crc kubenswrapper[5120]: I0316 18:25:32.941605 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-k8gk8" event={"ID":"620719d1-fe82-4641-9d69-6eb01e0259cd","Type":"ContainerDied","Data":"f54abd5ca0aa6987c985dc50d3fc55884adb0cd04c49a5c29c894ac0dc467b7d"} Mar 16 18:25:32 crc kubenswrapper[5120]: I0316 18:25:32.941987 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-k8gk8" event={"ID":"620719d1-fe82-4641-9d69-6eb01e0259cd","Type":"ContainerStarted","Data":"88ab451cccbbe430639f5f61472bffc3f855bf3a104d615b04c3b941e16937b3"} Mar 16 18:25:33 crc kubenswrapper[5120]: I0316 18:25:33.950253 5120 generic.go:358] "Generic (PLEG): container finished" podID="620719d1-fe82-4641-9d69-6eb01e0259cd" containerID="2433a1c6e6b2d56f186ef60f1f57d1240fa83833d7eab47620a2a1acd623b99e" exitCode=0 Mar 16 18:25:33 crc kubenswrapper[5120]: I0316 18:25:33.950352 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-k8gk8" event={"ID":"620719d1-fe82-4641-9d69-6eb01e0259cd","Type":"ContainerDied","Data":"2433a1c6e6b2d56f186ef60f1f57d1240fa83833d7eab47620a2a1acd623b99e"} Mar 16 18:25:33 crc kubenswrapper[5120]: I0316 18:25:33.953727 5120 generic.go:358] "Generic (PLEG): container finished" podID="ca34c9ae-2826-4812-878d-a232a30eea9b" containerID="fa8d2c64db3e48cce9f60f4463bc00114f4824327ac9c78df1ea605f22bc4a91" exitCode=0 Mar 16 18:25:33 crc kubenswrapper[5120]: I0316 18:25:33.953902 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-2p4v9" event={"ID":"ca34c9ae-2826-4812-878d-a232a30eea9b","Type":"ContainerDied","Data":"fa8d2c64db3e48cce9f60f4463bc00114f4824327ac9c78df1ea605f22bc4a91"} Mar 16 18:25:34 crc kubenswrapper[5120]: I0316 18:25:34.964154 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-k8gk8" event={"ID":"620719d1-fe82-4641-9d69-6eb01e0259cd","Type":"ContainerStarted","Data":"5dc2f79cdfa90f6d79a134d2dc07bcf0bc238c0441cb774132a923c4fcea2863"} Mar 16 18:25:34 crc kubenswrapper[5120]: I0316 18:25:34.966560 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-2p4v9" event={"ID":"ca34c9ae-2826-4812-878d-a232a30eea9b","Type":"ContainerStarted","Data":"f556254c4f0250e45d70f69a46a6b72d17980515d7277e7f54aa21b6371ad499"} Mar 16 18:25:34 crc kubenswrapper[5120]: I0316 18:25:34.993962 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/community-operators-k8gk8" podStartSLOduration=3.424229756 podStartE2EDuration="3.993941793s" podCreationTimestamp="2026-03-16 18:25:31 +0000 UTC" firstStartedPulling="2026-03-16 18:25:32.942418461 +0000 UTC m=+10435.096350118" lastFinishedPulling="2026-03-16 18:25:33.512130488 +0000 UTC m=+10435.666062155" observedRunningTime="2026-03-16 18:25:34.991640951 +0000 UTC m=+10437.145572628" watchObservedRunningTime="2026-03-16 18:25:34.993941793 +0000 UTC m=+10437.147873460" Mar 16 18:25:35 crc kubenswrapper[5120]: I0316 18:25:35.014273 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/certified-operators-2p4v9" podStartSLOduration=3.86517225 podStartE2EDuration="5.014251268s" podCreationTimestamp="2026-03-16 18:25:30 +0000 UTC" firstStartedPulling="2026-03-16 18:25:31.930616121 +0000 UTC m=+10434.084547778" lastFinishedPulling="2026-03-16 18:25:33.079695139 +0000 UTC m=+10435.233626796" observedRunningTime="2026-03-16 18:25:35.010215968 +0000 UTC m=+10437.164147625" watchObservedRunningTime="2026-03-16 18:25:35.014251268 +0000 UTC m=+10437.168182925" Mar 16 18:25:41 crc kubenswrapper[5120]: I0316 18:25:41.116949 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-marketplace/certified-operators-2p4v9" Mar 16 18:25:41 crc kubenswrapper[5120]: I0316 18:25:41.117853 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/certified-operators-2p4v9" Mar 16 18:25:41 crc kubenswrapper[5120]: I0316 18:25:41.167900 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/certified-operators-2p4v9" Mar 16 18:25:41 crc kubenswrapper[5120]: I0316 18:25:41.551592 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-marketplace/community-operators-k8gk8" Mar 16 18:25:41 crc kubenswrapper[5120]: I0316 18:25:41.551652 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/community-operators-k8gk8" Mar 16 18:25:41 crc kubenswrapper[5120]: I0316 18:25:41.609808 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/community-operators-k8gk8" Mar 16 18:25:42 crc kubenswrapper[5120]: I0316 18:25:42.082044 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/certified-operators-2p4v9" Mar 16 18:25:42 crc kubenswrapper[5120]: I0316 18:25:42.083493 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/community-operators-k8gk8" Mar 16 18:25:42 crc kubenswrapper[5120]: I0316 18:25:42.986963 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/certified-operators-2p4v9"] Mar 16 18:25:44 crc kubenswrapper[5120]: I0316 18:25:44.035495 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-marketplace/certified-operators-2p4v9" podUID="ca34c9ae-2826-4812-878d-a232a30eea9b" containerName="registry-server" containerID="cri-o://f556254c4f0250e45d70f69a46a6b72d17980515d7277e7f54aa21b6371ad499" gracePeriod=2 Mar 16 18:25:44 crc kubenswrapper[5120]: I0316 18:25:44.443926 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-2p4v9" Mar 16 18:25:44 crc kubenswrapper[5120]: I0316 18:25:44.547528 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/ca34c9ae-2826-4812-878d-a232a30eea9b-catalog-content\") pod \"ca34c9ae-2826-4812-878d-a232a30eea9b\" (UID: \"ca34c9ae-2826-4812-878d-a232a30eea9b\") " Mar 16 18:25:44 crc kubenswrapper[5120]: I0316 18:25:44.547853 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hhsqk\" (UniqueName: \"kubernetes.io/projected/ca34c9ae-2826-4812-878d-a232a30eea9b-kube-api-access-hhsqk\") pod \"ca34c9ae-2826-4812-878d-a232a30eea9b\" (UID: \"ca34c9ae-2826-4812-878d-a232a30eea9b\") " Mar 16 18:25:44 crc kubenswrapper[5120]: I0316 18:25:44.547885 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/ca34c9ae-2826-4812-878d-a232a30eea9b-utilities\") pod \"ca34c9ae-2826-4812-878d-a232a30eea9b\" (UID: \"ca34c9ae-2826-4812-878d-a232a30eea9b\") " Mar 16 18:25:44 crc kubenswrapper[5120]: I0316 18:25:44.549528 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca34c9ae-2826-4812-878d-a232a30eea9b-utilities" (OuterVolumeSpecName: "utilities") pod "ca34c9ae-2826-4812-878d-a232a30eea9b" (UID: "ca34c9ae-2826-4812-878d-a232a30eea9b"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 18:25:44 crc kubenswrapper[5120]: I0316 18:25:44.554478 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca34c9ae-2826-4812-878d-a232a30eea9b-kube-api-access-hhsqk" (OuterVolumeSpecName: "kube-api-access-hhsqk") pod "ca34c9ae-2826-4812-878d-a232a30eea9b" (UID: "ca34c9ae-2826-4812-878d-a232a30eea9b"). InnerVolumeSpecName "kube-api-access-hhsqk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 18:25:44 crc kubenswrapper[5120]: I0316 18:25:44.610423 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca34c9ae-2826-4812-878d-a232a30eea9b-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "ca34c9ae-2826-4812-878d-a232a30eea9b" (UID: "ca34c9ae-2826-4812-878d-a232a30eea9b"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 18:25:44 crc kubenswrapper[5120]: I0316 18:25:44.650658 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hhsqk\" (UniqueName: \"kubernetes.io/projected/ca34c9ae-2826-4812-878d-a232a30eea9b-kube-api-access-hhsqk\") on node \"crc\" DevicePath \"\"" Mar 16 18:25:44 crc kubenswrapper[5120]: I0316 18:25:44.650714 5120 reconciler_common.go:299] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/ca34c9ae-2826-4812-878d-a232a30eea9b-utilities\") on node \"crc\" DevicePath \"\"" Mar 16 18:25:44 crc kubenswrapper[5120]: I0316 18:25:44.650732 5120 reconciler_common.go:299] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/ca34c9ae-2826-4812-878d-a232a30eea9b-catalog-content\") on node \"crc\" DevicePath \"\"" Mar 16 18:25:45 crc kubenswrapper[5120]: I0316 18:25:45.045023 5120 generic.go:358] "Generic (PLEG): container finished" podID="ca34c9ae-2826-4812-878d-a232a30eea9b" containerID="f556254c4f0250e45d70f69a46a6b72d17980515d7277e7f54aa21b6371ad499" exitCode=0 Mar 16 18:25:45 crc kubenswrapper[5120]: I0316 18:25:45.045162 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-2p4v9" Mar 16 18:25:45 crc kubenswrapper[5120]: I0316 18:25:45.045172 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-2p4v9" event={"ID":"ca34c9ae-2826-4812-878d-a232a30eea9b","Type":"ContainerDied","Data":"f556254c4f0250e45d70f69a46a6b72d17980515d7277e7f54aa21b6371ad499"} Mar 16 18:25:45 crc kubenswrapper[5120]: I0316 18:25:45.045236 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-2p4v9" event={"ID":"ca34c9ae-2826-4812-878d-a232a30eea9b","Type":"ContainerDied","Data":"c1273043e23bbb0348d62bf3880aad5001b78b6b90122fc0fd499594a19b5b23"} Mar 16 18:25:45 crc kubenswrapper[5120]: I0316 18:25:45.045271 5120 scope.go:117] "RemoveContainer" containerID="f556254c4f0250e45d70f69a46a6b72d17980515d7277e7f54aa21b6371ad499" Mar 16 18:25:45 crc kubenswrapper[5120]: I0316 18:25:45.073410 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/certified-operators-2p4v9"] Mar 16 18:25:45 crc kubenswrapper[5120]: I0316 18:25:45.074590 5120 scope.go:117] "RemoveContainer" containerID="fa8d2c64db3e48cce9f60f4463bc00114f4824327ac9c78df1ea605f22bc4a91" Mar 16 18:25:45 crc kubenswrapper[5120]: I0316 18:25:45.077566 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/certified-operators-2p4v9"] Mar 16 18:25:45 crc kubenswrapper[5120]: I0316 18:25:45.101411 5120 scope.go:117] "RemoveContainer" containerID="6dcb5aa1d3f56aa637391d2a3de9192b3240a8e0a7108d3dac52bb5aaf162b04" Mar 16 18:25:45 crc kubenswrapper[5120]: I0316 18:25:45.152559 5120 scope.go:117] "RemoveContainer" containerID="f556254c4f0250e45d70f69a46a6b72d17980515d7277e7f54aa21b6371ad499" Mar 16 18:25:45 crc kubenswrapper[5120]: E0316 18:25:45.153388 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f556254c4f0250e45d70f69a46a6b72d17980515d7277e7f54aa21b6371ad499\": container with ID starting with f556254c4f0250e45d70f69a46a6b72d17980515d7277e7f54aa21b6371ad499 not found: ID does not exist" containerID="f556254c4f0250e45d70f69a46a6b72d17980515d7277e7f54aa21b6371ad499" Mar 16 18:25:45 crc kubenswrapper[5120]: I0316 18:25:45.153427 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f556254c4f0250e45d70f69a46a6b72d17980515d7277e7f54aa21b6371ad499"} err="failed to get container status \"f556254c4f0250e45d70f69a46a6b72d17980515d7277e7f54aa21b6371ad499\": rpc error: code = NotFound desc = could not find container \"f556254c4f0250e45d70f69a46a6b72d17980515d7277e7f54aa21b6371ad499\": container with ID starting with f556254c4f0250e45d70f69a46a6b72d17980515d7277e7f54aa21b6371ad499 not found: ID does not exist" Mar 16 18:25:45 crc kubenswrapper[5120]: I0316 18:25:45.153452 5120 scope.go:117] "RemoveContainer" containerID="fa8d2c64db3e48cce9f60f4463bc00114f4824327ac9c78df1ea605f22bc4a91" Mar 16 18:25:45 crc kubenswrapper[5120]: E0316 18:25:45.153830 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa8d2c64db3e48cce9f60f4463bc00114f4824327ac9c78df1ea605f22bc4a91\": container with ID starting with fa8d2c64db3e48cce9f60f4463bc00114f4824327ac9c78df1ea605f22bc4a91 not found: ID does not exist" containerID="fa8d2c64db3e48cce9f60f4463bc00114f4824327ac9c78df1ea605f22bc4a91" Mar 16 18:25:45 crc kubenswrapper[5120]: I0316 18:25:45.153863 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa8d2c64db3e48cce9f60f4463bc00114f4824327ac9c78df1ea605f22bc4a91"} err="failed to get container status \"fa8d2c64db3e48cce9f60f4463bc00114f4824327ac9c78df1ea605f22bc4a91\": rpc error: code = NotFound desc = could not find container \"fa8d2c64db3e48cce9f60f4463bc00114f4824327ac9c78df1ea605f22bc4a91\": container with ID starting with fa8d2c64db3e48cce9f60f4463bc00114f4824327ac9c78df1ea605f22bc4a91 not found: ID does not exist" Mar 16 18:25:45 crc kubenswrapper[5120]: I0316 18:25:45.153883 5120 scope.go:117] "RemoveContainer" containerID="6dcb5aa1d3f56aa637391d2a3de9192b3240a8e0a7108d3dac52bb5aaf162b04" Mar 16 18:25:45 crc kubenswrapper[5120]: E0316 18:25:45.154227 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6dcb5aa1d3f56aa637391d2a3de9192b3240a8e0a7108d3dac52bb5aaf162b04\": container with ID starting with 6dcb5aa1d3f56aa637391d2a3de9192b3240a8e0a7108d3dac52bb5aaf162b04 not found: ID does not exist" containerID="6dcb5aa1d3f56aa637391d2a3de9192b3240a8e0a7108d3dac52bb5aaf162b04" Mar 16 18:25:45 crc kubenswrapper[5120]: I0316 18:25:45.154277 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6dcb5aa1d3f56aa637391d2a3de9192b3240a8e0a7108d3dac52bb5aaf162b04"} err="failed to get container status \"6dcb5aa1d3f56aa637391d2a3de9192b3240a8e0a7108d3dac52bb5aaf162b04\": rpc error: code = NotFound desc = could not find container \"6dcb5aa1d3f56aa637391d2a3de9192b3240a8e0a7108d3dac52bb5aaf162b04\": container with ID starting with 6dcb5aa1d3f56aa637391d2a3de9192b3240a8e0a7108d3dac52bb5aaf162b04 not found: ID does not exist" Mar 16 18:25:45 crc kubenswrapper[5120]: I0316 18:25:45.579635 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/community-operators-k8gk8"] Mar 16 18:25:45 crc kubenswrapper[5120]: I0316 18:25:45.580492 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-marketplace/community-operators-k8gk8" podUID="620719d1-fe82-4641-9d69-6eb01e0259cd" containerName="registry-server" containerID="cri-o://5dc2f79cdfa90f6d79a134d2dc07bcf0bc238c0441cb774132a923c4fcea2863" gracePeriod=2 Mar 16 18:25:46 crc kubenswrapper[5120]: I0316 18:25:46.012936 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-k8gk8" Mar 16 18:25:46 crc kubenswrapper[5120]: I0316 18:25:46.062979 5120 generic.go:358] "Generic (PLEG): container finished" podID="620719d1-fe82-4641-9d69-6eb01e0259cd" containerID="5dc2f79cdfa90f6d79a134d2dc07bcf0bc238c0441cb774132a923c4fcea2863" exitCode=0 Mar 16 18:25:46 crc kubenswrapper[5120]: I0316 18:25:46.063267 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-k8gk8" event={"ID":"620719d1-fe82-4641-9d69-6eb01e0259cd","Type":"ContainerDied","Data":"5dc2f79cdfa90f6d79a134d2dc07bcf0bc238c0441cb774132a923c4fcea2863"} Mar 16 18:25:46 crc kubenswrapper[5120]: I0316 18:25:46.063303 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-k8gk8" event={"ID":"620719d1-fe82-4641-9d69-6eb01e0259cd","Type":"ContainerDied","Data":"88ab451cccbbe430639f5f61472bffc3f855bf3a104d615b04c3b941e16937b3"} Mar 16 18:25:46 crc kubenswrapper[5120]: I0316 18:25:46.063342 5120 scope.go:117] "RemoveContainer" containerID="5dc2f79cdfa90f6d79a134d2dc07bcf0bc238c0441cb774132a923c4fcea2863" Mar 16 18:25:46 crc kubenswrapper[5120]: I0316 18:25:46.067537 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-k8gk8" Mar 16 18:25:46 crc kubenswrapper[5120]: I0316 18:25:46.082987 5120 scope.go:117] "RemoveContainer" containerID="2433a1c6e6b2d56f186ef60f1f57d1240fa83833d7eab47620a2a1acd623b99e" Mar 16 18:25:46 crc kubenswrapper[5120]: I0316 18:25:46.110826 5120 scope.go:117] "RemoveContainer" containerID="f54abd5ca0aa6987c985dc50d3fc55884adb0cd04c49a5c29c894ac0dc467b7d" Mar 16 18:25:46 crc kubenswrapper[5120]: I0316 18:25:46.133029 5120 scope.go:117] "RemoveContainer" containerID="5dc2f79cdfa90f6d79a134d2dc07bcf0bc238c0441cb774132a923c4fcea2863" Mar 16 18:25:46 crc kubenswrapper[5120]: E0316 18:25:46.133501 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5dc2f79cdfa90f6d79a134d2dc07bcf0bc238c0441cb774132a923c4fcea2863\": container with ID starting with 5dc2f79cdfa90f6d79a134d2dc07bcf0bc238c0441cb774132a923c4fcea2863 not found: ID does not exist" containerID="5dc2f79cdfa90f6d79a134d2dc07bcf0bc238c0441cb774132a923c4fcea2863" Mar 16 18:25:46 crc kubenswrapper[5120]: I0316 18:25:46.133535 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5dc2f79cdfa90f6d79a134d2dc07bcf0bc238c0441cb774132a923c4fcea2863"} err="failed to get container status \"5dc2f79cdfa90f6d79a134d2dc07bcf0bc238c0441cb774132a923c4fcea2863\": rpc error: code = NotFound desc = could not find container \"5dc2f79cdfa90f6d79a134d2dc07bcf0bc238c0441cb774132a923c4fcea2863\": container with ID starting with 5dc2f79cdfa90f6d79a134d2dc07bcf0bc238c0441cb774132a923c4fcea2863 not found: ID does not exist" Mar 16 18:25:46 crc kubenswrapper[5120]: I0316 18:25:46.133555 5120 scope.go:117] "RemoveContainer" containerID="2433a1c6e6b2d56f186ef60f1f57d1240fa83833d7eab47620a2a1acd623b99e" Mar 16 18:25:46 crc kubenswrapper[5120]: E0316 18:25:46.133939 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2433a1c6e6b2d56f186ef60f1f57d1240fa83833d7eab47620a2a1acd623b99e\": container with ID starting with 2433a1c6e6b2d56f186ef60f1f57d1240fa83833d7eab47620a2a1acd623b99e not found: ID does not exist" containerID="2433a1c6e6b2d56f186ef60f1f57d1240fa83833d7eab47620a2a1acd623b99e" Mar 16 18:25:46 crc kubenswrapper[5120]: I0316 18:25:46.133990 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2433a1c6e6b2d56f186ef60f1f57d1240fa83833d7eab47620a2a1acd623b99e"} err="failed to get container status \"2433a1c6e6b2d56f186ef60f1f57d1240fa83833d7eab47620a2a1acd623b99e\": rpc error: code = NotFound desc = could not find container \"2433a1c6e6b2d56f186ef60f1f57d1240fa83833d7eab47620a2a1acd623b99e\": container with ID starting with 2433a1c6e6b2d56f186ef60f1f57d1240fa83833d7eab47620a2a1acd623b99e not found: ID does not exist" Mar 16 18:25:46 crc kubenswrapper[5120]: I0316 18:25:46.134016 5120 scope.go:117] "RemoveContainer" containerID="f54abd5ca0aa6987c985dc50d3fc55884adb0cd04c49a5c29c894ac0dc467b7d" Mar 16 18:25:46 crc kubenswrapper[5120]: E0316 18:25:46.134491 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f54abd5ca0aa6987c985dc50d3fc55884adb0cd04c49a5c29c894ac0dc467b7d\": container with ID starting with f54abd5ca0aa6987c985dc50d3fc55884adb0cd04c49a5c29c894ac0dc467b7d not found: ID does not exist" containerID="f54abd5ca0aa6987c985dc50d3fc55884adb0cd04c49a5c29c894ac0dc467b7d" Mar 16 18:25:46 crc kubenswrapper[5120]: I0316 18:25:46.134559 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f54abd5ca0aa6987c985dc50d3fc55884adb0cd04c49a5c29c894ac0dc467b7d"} err="failed to get container status \"f54abd5ca0aa6987c985dc50d3fc55884adb0cd04c49a5c29c894ac0dc467b7d\": rpc error: code = NotFound desc = could not find container \"f54abd5ca0aa6987c985dc50d3fc55884adb0cd04c49a5c29c894ac0dc467b7d\": container with ID starting with f54abd5ca0aa6987c985dc50d3fc55884adb0cd04c49a5c29c894ac0dc467b7d not found: ID does not exist" Mar 16 18:25:46 crc kubenswrapper[5120]: I0316 18:25:46.188193 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/620719d1-fe82-4641-9d69-6eb01e0259cd-catalog-content\") pod \"620719d1-fe82-4641-9d69-6eb01e0259cd\" (UID: \"620719d1-fe82-4641-9d69-6eb01e0259cd\") " Mar 16 18:25:46 crc kubenswrapper[5120]: I0316 18:25:46.188485 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nnzrr\" (UniqueName: \"kubernetes.io/projected/620719d1-fe82-4641-9d69-6eb01e0259cd-kube-api-access-nnzrr\") pod \"620719d1-fe82-4641-9d69-6eb01e0259cd\" (UID: \"620719d1-fe82-4641-9d69-6eb01e0259cd\") " Mar 16 18:25:46 crc kubenswrapper[5120]: I0316 18:25:46.188702 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/620719d1-fe82-4641-9d69-6eb01e0259cd-utilities\") pod \"620719d1-fe82-4641-9d69-6eb01e0259cd\" (UID: \"620719d1-fe82-4641-9d69-6eb01e0259cd\") " Mar 16 18:25:46 crc kubenswrapper[5120]: I0316 18:25:46.190027 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/620719d1-fe82-4641-9d69-6eb01e0259cd-utilities" (OuterVolumeSpecName: "utilities") pod "620719d1-fe82-4641-9d69-6eb01e0259cd" (UID: "620719d1-fe82-4641-9d69-6eb01e0259cd"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 18:25:46 crc kubenswrapper[5120]: I0316 18:25:46.198816 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/620719d1-fe82-4641-9d69-6eb01e0259cd-kube-api-access-nnzrr" (OuterVolumeSpecName: "kube-api-access-nnzrr") pod "620719d1-fe82-4641-9d69-6eb01e0259cd" (UID: "620719d1-fe82-4641-9d69-6eb01e0259cd"). InnerVolumeSpecName "kube-api-access-nnzrr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 18:25:46 crc kubenswrapper[5120]: I0316 18:25:46.246434 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/620719d1-fe82-4641-9d69-6eb01e0259cd-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "620719d1-fe82-4641-9d69-6eb01e0259cd" (UID: "620719d1-fe82-4641-9d69-6eb01e0259cd"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 18:25:46 crc kubenswrapper[5120]: I0316 18:25:46.292316 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nnzrr\" (UniqueName: \"kubernetes.io/projected/620719d1-fe82-4641-9d69-6eb01e0259cd-kube-api-access-nnzrr\") on node \"crc\" DevicePath \"\"" Mar 16 18:25:46 crc kubenswrapper[5120]: I0316 18:25:46.292355 5120 reconciler_common.go:299] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/620719d1-fe82-4641-9d69-6eb01e0259cd-utilities\") on node \"crc\" DevicePath \"\"" Mar 16 18:25:46 crc kubenswrapper[5120]: I0316 18:25:46.292369 5120 reconciler_common.go:299] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/620719d1-fe82-4641-9d69-6eb01e0259cd-catalog-content\") on node \"crc\" DevicePath \"\"" Mar 16 18:25:46 crc kubenswrapper[5120]: I0316 18:25:46.427834 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/community-operators-k8gk8"] Mar 16 18:25:46 crc kubenswrapper[5120]: I0316 18:25:46.433785 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/community-operators-k8gk8"] Mar 16 18:25:46 crc kubenswrapper[5120]: I0316 18:25:46.675397 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="620719d1-fe82-4641-9d69-6eb01e0259cd" path="/var/lib/kubelet/pods/620719d1-fe82-4641-9d69-6eb01e0259cd/volumes" Mar 16 18:25:46 crc kubenswrapper[5120]: I0316 18:25:46.676622 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca34c9ae-2826-4812-878d-a232a30eea9b" path="/var/lib/kubelet/pods/ca34c9ae-2826-4812-878d-a232a30eea9b/volumes" Mar 16 18:25:52 crc kubenswrapper[5120]: I0316 18:25:52.008116 5120 patch_prober.go:28] interesting pod/machine-config-daemon-7bf76 container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 18:25:52 crc kubenswrapper[5120]: I0316 18:25:52.008556 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 18:26:00 crc kubenswrapper[5120]: I0316 18:26:00.161393 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-infra/auto-csr-approver-29561426-ccjgw"] Mar 16 18:26:00 crc kubenswrapper[5120]: I0316 18:26:00.163235 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="620719d1-fe82-4641-9d69-6eb01e0259cd" containerName="extract-utilities" Mar 16 18:26:00 crc kubenswrapper[5120]: I0316 18:26:00.163259 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="620719d1-fe82-4641-9d69-6eb01e0259cd" containerName="extract-utilities" Mar 16 18:26:00 crc kubenswrapper[5120]: I0316 18:26:00.163281 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca34c9ae-2826-4812-878d-a232a30eea9b" containerName="registry-server" Mar 16 18:26:00 crc kubenswrapper[5120]: I0316 18:26:00.163291 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca34c9ae-2826-4812-878d-a232a30eea9b" containerName="registry-server" Mar 16 18:26:00 crc kubenswrapper[5120]: I0316 18:26:00.163329 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="620719d1-fe82-4641-9d69-6eb01e0259cd" containerName="extract-content" Mar 16 18:26:00 crc kubenswrapper[5120]: I0316 18:26:00.163340 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="620719d1-fe82-4641-9d69-6eb01e0259cd" containerName="extract-content" Mar 16 18:26:00 crc kubenswrapper[5120]: I0316 18:26:00.163358 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca34c9ae-2826-4812-878d-a232a30eea9b" containerName="extract-utilities" Mar 16 18:26:00 crc kubenswrapper[5120]: I0316 18:26:00.163368 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca34c9ae-2826-4812-878d-a232a30eea9b" containerName="extract-utilities" Mar 16 18:26:00 crc kubenswrapper[5120]: I0316 18:26:00.163379 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="620719d1-fe82-4641-9d69-6eb01e0259cd" containerName="registry-server" Mar 16 18:26:00 crc kubenswrapper[5120]: I0316 18:26:00.163389 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="620719d1-fe82-4641-9d69-6eb01e0259cd" containerName="registry-server" Mar 16 18:26:00 crc kubenswrapper[5120]: I0316 18:26:00.163411 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca34c9ae-2826-4812-878d-a232a30eea9b" containerName="extract-content" Mar 16 18:26:00 crc kubenswrapper[5120]: I0316 18:26:00.163420 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca34c9ae-2826-4812-878d-a232a30eea9b" containerName="extract-content" Mar 16 18:26:00 crc kubenswrapper[5120]: I0316 18:26:00.163645 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="620719d1-fe82-4641-9d69-6eb01e0259cd" containerName="registry-server" Mar 16 18:26:00 crc kubenswrapper[5120]: I0316 18:26:00.163677 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="ca34c9ae-2826-4812-878d-a232a30eea9b" containerName="registry-server" Mar 16 18:26:00 crc kubenswrapper[5120]: I0316 18:26:00.169704 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561426-ccjgw"] Mar 16 18:26:00 crc kubenswrapper[5120]: I0316 18:26:00.169875 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561426-ccjgw" Mar 16 18:26:00 crc kubenswrapper[5120]: I0316 18:26:00.172110 5120 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-infra\"/\"csr-approver-sa-dockercfg-x2nsz\"" Mar 16 18:26:00 crc kubenswrapper[5120]: I0316 18:26:00.172503 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"kube-root-ca.crt\"" Mar 16 18:26:00 crc kubenswrapper[5120]: I0316 18:26:00.174255 5120 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"openshift-service-ca.crt\"" Mar 16 18:26:00 crc kubenswrapper[5120]: I0316 18:26:00.275809 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfnfj\" (UniqueName: \"kubernetes.io/projected/dd044487-ffac-4152-89f7-e7c4c19198e6-kube-api-access-mfnfj\") pod \"auto-csr-approver-29561426-ccjgw\" (UID: \"dd044487-ffac-4152-89f7-e7c4c19198e6\") " pod="openshift-infra/auto-csr-approver-29561426-ccjgw" Mar 16 18:26:00 crc kubenswrapper[5120]: I0316 18:26:00.378229 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mfnfj\" (UniqueName: \"kubernetes.io/projected/dd044487-ffac-4152-89f7-e7c4c19198e6-kube-api-access-mfnfj\") pod \"auto-csr-approver-29561426-ccjgw\" (UID: \"dd044487-ffac-4152-89f7-e7c4c19198e6\") " pod="openshift-infra/auto-csr-approver-29561426-ccjgw" Mar 16 18:26:00 crc kubenswrapper[5120]: I0316 18:26:00.406914 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfnfj\" (UniqueName: \"kubernetes.io/projected/dd044487-ffac-4152-89f7-e7c4c19198e6-kube-api-access-mfnfj\") pod \"auto-csr-approver-29561426-ccjgw\" (UID: \"dd044487-ffac-4152-89f7-e7c4c19198e6\") " pod="openshift-infra/auto-csr-approver-29561426-ccjgw" Mar 16 18:26:00 crc kubenswrapper[5120]: I0316 18:26:00.500869 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561426-ccjgw" Mar 16 18:26:00 crc kubenswrapper[5120]: I0316 18:26:00.922678 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561426-ccjgw"] Mar 16 18:26:01 crc kubenswrapper[5120]: I0316 18:26:01.200270 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561426-ccjgw" event={"ID":"dd044487-ffac-4152-89f7-e7c4c19198e6","Type":"ContainerStarted","Data":"1a958ec5ddf6ee9fb54a74be9bbb7d10507d2b1172bae07b25405bcc06766cfe"} Mar 16 18:26:03 crc kubenswrapper[5120]: I0316 18:26:03.216597 5120 generic.go:358] "Generic (PLEG): container finished" podID="dd044487-ffac-4152-89f7-e7c4c19198e6" containerID="07efe948a5577704ca802fa04148c6fbe0f0a44415aeb985ab464615afa7236c" exitCode=0 Mar 16 18:26:03 crc kubenswrapper[5120]: I0316 18:26:03.216791 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561426-ccjgw" event={"ID":"dd044487-ffac-4152-89f7-e7c4c19198e6","Type":"ContainerDied","Data":"07efe948a5577704ca802fa04148c6fbe0f0a44415aeb985ab464615afa7236c"} Mar 16 18:26:04 crc kubenswrapper[5120]: I0316 18:26:04.523307 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561426-ccjgw" Mar 16 18:26:04 crc kubenswrapper[5120]: I0316 18:26:04.703178 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mfnfj\" (UniqueName: \"kubernetes.io/projected/dd044487-ffac-4152-89f7-e7c4c19198e6-kube-api-access-mfnfj\") pod \"dd044487-ffac-4152-89f7-e7c4c19198e6\" (UID: \"dd044487-ffac-4152-89f7-e7c4c19198e6\") " Mar 16 18:26:04 crc kubenswrapper[5120]: I0316 18:26:04.713326 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd044487-ffac-4152-89f7-e7c4c19198e6-kube-api-access-mfnfj" (OuterVolumeSpecName: "kube-api-access-mfnfj") pod "dd044487-ffac-4152-89f7-e7c4c19198e6" (UID: "dd044487-ffac-4152-89f7-e7c4c19198e6"). InnerVolumeSpecName "kube-api-access-mfnfj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 18:26:04 crc kubenswrapper[5120]: I0316 18:26:04.806599 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mfnfj\" (UniqueName: \"kubernetes.io/projected/dd044487-ffac-4152-89f7-e7c4c19198e6-kube-api-access-mfnfj\") on node \"crc\" DevicePath \"\"" Mar 16 18:26:05 crc kubenswrapper[5120]: I0316 18:26:05.237975 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561426-ccjgw" Mar 16 18:26:05 crc kubenswrapper[5120]: I0316 18:26:05.238028 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561426-ccjgw" event={"ID":"dd044487-ffac-4152-89f7-e7c4c19198e6","Type":"ContainerDied","Data":"1a958ec5ddf6ee9fb54a74be9bbb7d10507d2b1172bae07b25405bcc06766cfe"} Mar 16 18:26:05 crc kubenswrapper[5120]: I0316 18:26:05.238371 5120 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1a958ec5ddf6ee9fb54a74be9bbb7d10507d2b1172bae07b25405bcc06766cfe" Mar 16 18:26:05 crc kubenswrapper[5120]: I0316 18:26:05.591118 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-infra/auto-csr-approver-29561420-c2lrm"] Mar 16 18:26:05 crc kubenswrapper[5120]: I0316 18:26:05.597892 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-infra/auto-csr-approver-29561420-c2lrm"] Mar 16 18:26:06 crc kubenswrapper[5120]: I0316 18:26:06.681466 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9af846bc-4ebc-4602-8225-55fb6fa2b310" path="/var/lib/kubelet/pods/9af846bc-4ebc-4602-8225-55fb6fa2b310/volumes" Mar 16 18:26:07 crc kubenswrapper[5120]: E0316 18:26:07.435899 5120 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=849183 actualBytes=10240 Mar 16 18:26:22 crc kubenswrapper[5120]: I0316 18:26:22.007719 5120 patch_prober.go:28] interesting pod/machine-config-daemon-7bf76 container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 18:26:22 crc kubenswrapper[5120]: I0316 18:26:22.008260 5120 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 18:26:22 crc kubenswrapper[5120]: I0316 18:26:22.008309 5120 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" Mar 16 18:26:22 crc kubenswrapper[5120]: I0316 18:26:22.008910 5120 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="machine-config-daemon" containerStatusID={"Type":"cri-o","ID":"6aabe98083c5ab9b467fe00d2ebd9988de5342987777bf9f393b07f2a98973bc"} pod="openshift-machine-config-operator/machine-config-daemon-7bf76" containerMessage="Container machine-config-daemon failed liveness probe, will be restarted" Mar 16 18:26:22 crc kubenswrapper[5120]: I0316 18:26:22.008977 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerName="machine-config-daemon" containerID="cri-o://6aabe98083c5ab9b467fe00d2ebd9988de5342987777bf9f393b07f2a98973bc" gracePeriod=600 Mar 16 18:26:22 crc kubenswrapper[5120]: E0316 18:26:22.150395 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 18:26:22 crc kubenswrapper[5120]: I0316 18:26:22.369226 5120 generic.go:358] "Generic (PLEG): container finished" podID="e2275cb4-4905-4d66-a87e-8010120db2bd" containerID="6aabe98083c5ab9b467fe00d2ebd9988de5342987777bf9f393b07f2a98973bc" exitCode=0 Mar 16 18:26:22 crc kubenswrapper[5120]: I0316 18:26:22.369319 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" event={"ID":"e2275cb4-4905-4d66-a87e-8010120db2bd","Type":"ContainerDied","Data":"6aabe98083c5ab9b467fe00d2ebd9988de5342987777bf9f393b07f2a98973bc"} Mar 16 18:26:22 crc kubenswrapper[5120]: I0316 18:26:22.369814 5120 scope.go:117] "RemoveContainer" containerID="3d15b6e9605fcdee6974a8b8a0e3331e02f35b8864853b8905538f9ef03d86f3" Mar 16 18:26:22 crc kubenswrapper[5120]: I0316 18:26:22.370661 5120 scope.go:117] "RemoveContainer" containerID="6aabe98083c5ab9b467fe00d2ebd9988de5342987777bf9f393b07f2a98973bc" Mar 16 18:26:22 crc kubenswrapper[5120]: E0316 18:26:22.371145 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 18:26:23 crc kubenswrapper[5120]: I0316 18:26:23.145008 5120 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-marketplace-q2w4v"] Mar 16 18:26:23 crc kubenswrapper[5120]: I0316 18:26:23.146173 5120 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd044487-ffac-4152-89f7-e7c4c19198e6" containerName="oc" Mar 16 18:26:23 crc kubenswrapper[5120]: I0316 18:26:23.146210 5120 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd044487-ffac-4152-89f7-e7c4c19198e6" containerName="oc" Mar 16 18:26:23 crc kubenswrapper[5120]: I0316 18:26:23.146446 5120 memory_manager.go:356] "RemoveStaleState removing state" podUID="dd044487-ffac-4152-89f7-e7c4c19198e6" containerName="oc" Mar 16 18:26:23 crc kubenswrapper[5120]: I0316 18:26:23.152890 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-q2w4v" Mar 16 18:26:23 crc kubenswrapper[5120]: I0316 18:26:23.158049 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-q2w4v"] Mar 16 18:26:23 crc kubenswrapper[5120]: I0316 18:26:23.289460 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/7c1e049a-566b-4875-818a-22ff522101d7-utilities\") pod \"redhat-marketplace-q2w4v\" (UID: \"7c1e049a-566b-4875-818a-22ff522101d7\") " pod="openshift-marketplace/redhat-marketplace-q2w4v" Mar 16 18:26:23 crc kubenswrapper[5120]: I0316 18:26:23.289718 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/7c1e049a-566b-4875-818a-22ff522101d7-catalog-content\") pod \"redhat-marketplace-q2w4v\" (UID: \"7c1e049a-566b-4875-818a-22ff522101d7\") " pod="openshift-marketplace/redhat-marketplace-q2w4v" Mar 16 18:26:23 crc kubenswrapper[5120]: I0316 18:26:23.289795 5120 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twst9\" (UniqueName: \"kubernetes.io/projected/7c1e049a-566b-4875-818a-22ff522101d7-kube-api-access-twst9\") pod \"redhat-marketplace-q2w4v\" (UID: \"7c1e049a-566b-4875-818a-22ff522101d7\") " pod="openshift-marketplace/redhat-marketplace-q2w4v" Mar 16 18:26:23 crc kubenswrapper[5120]: I0316 18:26:23.391322 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/7c1e049a-566b-4875-818a-22ff522101d7-catalog-content\") pod \"redhat-marketplace-q2w4v\" (UID: \"7c1e049a-566b-4875-818a-22ff522101d7\") " pod="openshift-marketplace/redhat-marketplace-q2w4v" Mar 16 18:26:23 crc kubenswrapper[5120]: I0316 18:26:23.391375 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-twst9\" (UniqueName: \"kubernetes.io/projected/7c1e049a-566b-4875-818a-22ff522101d7-kube-api-access-twst9\") pod \"redhat-marketplace-q2w4v\" (UID: \"7c1e049a-566b-4875-818a-22ff522101d7\") " pod="openshift-marketplace/redhat-marketplace-q2w4v" Mar 16 18:26:23 crc kubenswrapper[5120]: I0316 18:26:23.391737 5120 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/7c1e049a-566b-4875-818a-22ff522101d7-utilities\") pod \"redhat-marketplace-q2w4v\" (UID: \"7c1e049a-566b-4875-818a-22ff522101d7\") " pod="openshift-marketplace/redhat-marketplace-q2w4v" Mar 16 18:26:23 crc kubenswrapper[5120]: I0316 18:26:23.392110 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/7c1e049a-566b-4875-818a-22ff522101d7-catalog-content\") pod \"redhat-marketplace-q2w4v\" (UID: \"7c1e049a-566b-4875-818a-22ff522101d7\") " pod="openshift-marketplace/redhat-marketplace-q2w4v" Mar 16 18:26:23 crc kubenswrapper[5120]: I0316 18:26:23.392218 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/7c1e049a-566b-4875-818a-22ff522101d7-utilities\") pod \"redhat-marketplace-q2w4v\" (UID: \"7c1e049a-566b-4875-818a-22ff522101d7\") " pod="openshift-marketplace/redhat-marketplace-q2w4v" Mar 16 18:26:23 crc kubenswrapper[5120]: I0316 18:26:23.420007 5120 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-twst9\" (UniqueName: \"kubernetes.io/projected/7c1e049a-566b-4875-818a-22ff522101d7-kube-api-access-twst9\") pod \"redhat-marketplace-q2w4v\" (UID: \"7c1e049a-566b-4875-818a-22ff522101d7\") " pod="openshift-marketplace/redhat-marketplace-q2w4v" Mar 16 18:26:23 crc kubenswrapper[5120]: I0316 18:26:23.473326 5120 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-q2w4v" Mar 16 18:26:23 crc kubenswrapper[5120]: I0316 18:26:23.706607 5120 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-q2w4v"] Mar 16 18:26:24 crc kubenswrapper[5120]: I0316 18:26:24.397362 5120 generic.go:358] "Generic (PLEG): container finished" podID="7c1e049a-566b-4875-818a-22ff522101d7" containerID="f5f752e7b760bf67068ebe37b0dbcb5f7dde18541848c2ad12123701248d6709" exitCode=0 Mar 16 18:26:24 crc kubenswrapper[5120]: I0316 18:26:24.397445 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-q2w4v" event={"ID":"7c1e049a-566b-4875-818a-22ff522101d7","Type":"ContainerDied","Data":"f5f752e7b760bf67068ebe37b0dbcb5f7dde18541848c2ad12123701248d6709"} Mar 16 18:26:24 crc kubenswrapper[5120]: I0316 18:26:24.397487 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-q2w4v" event={"ID":"7c1e049a-566b-4875-818a-22ff522101d7","Type":"ContainerStarted","Data":"6207462bd015ba41839e9cec57751119d183f0f898fd0f8f6a5fe80d23985ac6"} Mar 16 18:26:25 crc kubenswrapper[5120]: I0316 18:26:25.410059 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-q2w4v" event={"ID":"7c1e049a-566b-4875-818a-22ff522101d7","Type":"ContainerStarted","Data":"c8379e6be14d2b12c6543d158805053b553aee6bf7ea5a338c8c4c7edc87d9cf"} Mar 16 18:26:26 crc kubenswrapper[5120]: I0316 18:26:26.419736 5120 generic.go:358] "Generic (PLEG): container finished" podID="7c1e049a-566b-4875-818a-22ff522101d7" containerID="c8379e6be14d2b12c6543d158805053b553aee6bf7ea5a338c8c4c7edc87d9cf" exitCode=0 Mar 16 18:26:26 crc kubenswrapper[5120]: I0316 18:26:26.419848 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-q2w4v" event={"ID":"7c1e049a-566b-4875-818a-22ff522101d7","Type":"ContainerDied","Data":"c8379e6be14d2b12c6543d158805053b553aee6bf7ea5a338c8c4c7edc87d9cf"} Mar 16 18:26:27 crc kubenswrapper[5120]: I0316 18:26:27.428337 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-q2w4v" event={"ID":"7c1e049a-566b-4875-818a-22ff522101d7","Type":"ContainerStarted","Data":"d45165fdd5cf8013ed505f5f16aee18ad1e10312cfec0f5163eed66ea3448017"} Mar 16 18:26:27 crc kubenswrapper[5120]: I0316 18:26:27.458088 5120 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/redhat-marketplace-q2w4v" podStartSLOduration=3.719439635 podStartE2EDuration="4.458069424s" podCreationTimestamp="2026-03-16 18:26:23 +0000 UTC" firstStartedPulling="2026-03-16 18:26:24.398962257 +0000 UTC m=+10486.552893954" lastFinishedPulling="2026-03-16 18:26:25.137592086 +0000 UTC m=+10487.291523743" observedRunningTime="2026-03-16 18:26:27.452301256 +0000 UTC m=+10489.606232953" watchObservedRunningTime="2026-03-16 18:26:27.458069424 +0000 UTC m=+10489.612001081" Mar 16 18:26:33 crc kubenswrapper[5120]: I0316 18:26:33.473658 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-marketplace-q2w4v" Mar 16 18:26:33 crc kubenswrapper[5120]: I0316 18:26:33.474211 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-marketplace/redhat-marketplace-q2w4v" Mar 16 18:26:33 crc kubenswrapper[5120]: I0316 18:26:33.517602 5120 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-marketplace-q2w4v" Mar 16 18:26:34 crc kubenswrapper[5120]: I0316 18:26:34.540103 5120 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-marketplace-q2w4v" Mar 16 18:26:34 crc kubenswrapper[5120]: I0316 18:26:34.586381 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-marketplace-q2w4v"] Mar 16 18:26:36 crc kubenswrapper[5120]: I0316 18:26:36.506254 5120 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-marketplace/redhat-marketplace-q2w4v" podUID="7c1e049a-566b-4875-818a-22ff522101d7" containerName="registry-server" containerID="cri-o://d45165fdd5cf8013ed505f5f16aee18ad1e10312cfec0f5163eed66ea3448017" gracePeriod=2 Mar 16 18:26:36 crc kubenswrapper[5120]: I0316 18:26:36.913463 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-q2w4v" Mar 16 18:26:37 crc kubenswrapper[5120]: I0316 18:26:37.039073 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/7c1e049a-566b-4875-818a-22ff522101d7-catalog-content\") pod \"7c1e049a-566b-4875-818a-22ff522101d7\" (UID: \"7c1e049a-566b-4875-818a-22ff522101d7\") " Mar 16 18:26:37 crc kubenswrapper[5120]: I0316 18:26:37.039353 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-twst9\" (UniqueName: \"kubernetes.io/projected/7c1e049a-566b-4875-818a-22ff522101d7-kube-api-access-twst9\") pod \"7c1e049a-566b-4875-818a-22ff522101d7\" (UID: \"7c1e049a-566b-4875-818a-22ff522101d7\") " Mar 16 18:26:37 crc kubenswrapper[5120]: I0316 18:26:37.039467 5120 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/7c1e049a-566b-4875-818a-22ff522101d7-utilities\") pod \"7c1e049a-566b-4875-818a-22ff522101d7\" (UID: \"7c1e049a-566b-4875-818a-22ff522101d7\") " Mar 16 18:26:37 crc kubenswrapper[5120]: I0316 18:26:37.040576 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c1e049a-566b-4875-818a-22ff522101d7-utilities" (OuterVolumeSpecName: "utilities") pod "7c1e049a-566b-4875-818a-22ff522101d7" (UID: "7c1e049a-566b-4875-818a-22ff522101d7"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 18:26:37 crc kubenswrapper[5120]: I0316 18:26:37.046699 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c1e049a-566b-4875-818a-22ff522101d7-kube-api-access-twst9" (OuterVolumeSpecName: "kube-api-access-twst9") pod "7c1e049a-566b-4875-818a-22ff522101d7" (UID: "7c1e049a-566b-4875-818a-22ff522101d7"). InnerVolumeSpecName "kube-api-access-twst9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 18:26:37 crc kubenswrapper[5120]: I0316 18:26:37.060172 5120 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c1e049a-566b-4875-818a-22ff522101d7-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "7c1e049a-566b-4875-818a-22ff522101d7" (UID: "7c1e049a-566b-4875-818a-22ff522101d7"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 18:26:37 crc kubenswrapper[5120]: I0316 18:26:37.141993 5120 reconciler_common.go:299] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/7c1e049a-566b-4875-818a-22ff522101d7-utilities\") on node \"crc\" DevicePath \"\"" Mar 16 18:26:37 crc kubenswrapper[5120]: I0316 18:26:37.142446 5120 reconciler_common.go:299] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/7c1e049a-566b-4875-818a-22ff522101d7-catalog-content\") on node \"crc\" DevicePath \"\"" Mar 16 18:26:37 crc kubenswrapper[5120]: I0316 18:26:37.142539 5120 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-twst9\" (UniqueName: \"kubernetes.io/projected/7c1e049a-566b-4875-818a-22ff522101d7-kube-api-access-twst9\") on node \"crc\" DevicePath \"\"" Mar 16 18:26:37 crc kubenswrapper[5120]: I0316 18:26:37.517532 5120 generic.go:358] "Generic (PLEG): container finished" podID="7c1e049a-566b-4875-818a-22ff522101d7" containerID="d45165fdd5cf8013ed505f5f16aee18ad1e10312cfec0f5163eed66ea3448017" exitCode=0 Mar 16 18:26:37 crc kubenswrapper[5120]: I0316 18:26:37.517780 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-q2w4v" event={"ID":"7c1e049a-566b-4875-818a-22ff522101d7","Type":"ContainerDied","Data":"d45165fdd5cf8013ed505f5f16aee18ad1e10312cfec0f5163eed66ea3448017"} Mar 16 18:26:37 crc kubenswrapper[5120]: I0316 18:26:37.517814 5120 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-q2w4v" event={"ID":"7c1e049a-566b-4875-818a-22ff522101d7","Type":"ContainerDied","Data":"6207462bd015ba41839e9cec57751119d183f0f898fd0f8f6a5fe80d23985ac6"} Mar 16 18:26:37 crc kubenswrapper[5120]: I0316 18:26:37.517864 5120 scope.go:117] "RemoveContainer" containerID="d45165fdd5cf8013ed505f5f16aee18ad1e10312cfec0f5163eed66ea3448017" Mar 16 18:26:37 crc kubenswrapper[5120]: I0316 18:26:37.518010 5120 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-q2w4v" Mar 16 18:26:37 crc kubenswrapper[5120]: I0316 18:26:37.549287 5120 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-marketplace-q2w4v"] Mar 16 18:26:37 crc kubenswrapper[5120]: I0316 18:26:37.553411 5120 scope.go:117] "RemoveContainer" containerID="c8379e6be14d2b12c6543d158805053b553aee6bf7ea5a338c8c4c7edc87d9cf" Mar 16 18:26:37 crc kubenswrapper[5120]: I0316 18:26:37.554314 5120 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/redhat-marketplace-q2w4v"] Mar 16 18:26:37 crc kubenswrapper[5120]: I0316 18:26:37.576056 5120 scope.go:117] "RemoveContainer" containerID="f5f752e7b760bf67068ebe37b0dbcb5f7dde18541848c2ad12123701248d6709" Mar 16 18:26:37 crc kubenswrapper[5120]: I0316 18:26:37.603245 5120 scope.go:117] "RemoveContainer" containerID="d45165fdd5cf8013ed505f5f16aee18ad1e10312cfec0f5163eed66ea3448017" Mar 16 18:26:37 crc kubenswrapper[5120]: E0316 18:26:37.603691 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d45165fdd5cf8013ed505f5f16aee18ad1e10312cfec0f5163eed66ea3448017\": container with ID starting with d45165fdd5cf8013ed505f5f16aee18ad1e10312cfec0f5163eed66ea3448017 not found: ID does not exist" containerID="d45165fdd5cf8013ed505f5f16aee18ad1e10312cfec0f5163eed66ea3448017" Mar 16 18:26:37 crc kubenswrapper[5120]: I0316 18:26:37.603728 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d45165fdd5cf8013ed505f5f16aee18ad1e10312cfec0f5163eed66ea3448017"} err="failed to get container status \"d45165fdd5cf8013ed505f5f16aee18ad1e10312cfec0f5163eed66ea3448017\": rpc error: code = NotFound desc = could not find container \"d45165fdd5cf8013ed505f5f16aee18ad1e10312cfec0f5163eed66ea3448017\": container with ID starting with d45165fdd5cf8013ed505f5f16aee18ad1e10312cfec0f5163eed66ea3448017 not found: ID does not exist" Mar 16 18:26:37 crc kubenswrapper[5120]: I0316 18:26:37.603747 5120 scope.go:117] "RemoveContainer" containerID="c8379e6be14d2b12c6543d158805053b553aee6bf7ea5a338c8c4c7edc87d9cf" Mar 16 18:26:37 crc kubenswrapper[5120]: E0316 18:26:37.604310 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c8379e6be14d2b12c6543d158805053b553aee6bf7ea5a338c8c4c7edc87d9cf\": container with ID starting with c8379e6be14d2b12c6543d158805053b553aee6bf7ea5a338c8c4c7edc87d9cf not found: ID does not exist" containerID="c8379e6be14d2b12c6543d158805053b553aee6bf7ea5a338c8c4c7edc87d9cf" Mar 16 18:26:37 crc kubenswrapper[5120]: I0316 18:26:37.604381 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8379e6be14d2b12c6543d158805053b553aee6bf7ea5a338c8c4c7edc87d9cf"} err="failed to get container status \"c8379e6be14d2b12c6543d158805053b553aee6bf7ea5a338c8c4c7edc87d9cf\": rpc error: code = NotFound desc = could not find container \"c8379e6be14d2b12c6543d158805053b553aee6bf7ea5a338c8c4c7edc87d9cf\": container with ID starting with c8379e6be14d2b12c6543d158805053b553aee6bf7ea5a338c8c4c7edc87d9cf not found: ID does not exist" Mar 16 18:26:37 crc kubenswrapper[5120]: I0316 18:26:37.604433 5120 scope.go:117] "RemoveContainer" containerID="f5f752e7b760bf67068ebe37b0dbcb5f7dde18541848c2ad12123701248d6709" Mar 16 18:26:37 crc kubenswrapper[5120]: E0316 18:26:37.604790 5120 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f5f752e7b760bf67068ebe37b0dbcb5f7dde18541848c2ad12123701248d6709\": container with ID starting with f5f752e7b760bf67068ebe37b0dbcb5f7dde18541848c2ad12123701248d6709 not found: ID does not exist" containerID="f5f752e7b760bf67068ebe37b0dbcb5f7dde18541848c2ad12123701248d6709" Mar 16 18:26:37 crc kubenswrapper[5120]: I0316 18:26:37.604814 5120 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5f752e7b760bf67068ebe37b0dbcb5f7dde18541848c2ad12123701248d6709"} err="failed to get container status \"f5f752e7b760bf67068ebe37b0dbcb5f7dde18541848c2ad12123701248d6709\": rpc error: code = NotFound desc = could not find container \"f5f752e7b760bf67068ebe37b0dbcb5f7dde18541848c2ad12123701248d6709\": container with ID starting with f5f752e7b760bf67068ebe37b0dbcb5f7dde18541848c2ad12123701248d6709 not found: ID does not exist" Mar 16 18:26:37 crc kubenswrapper[5120]: I0316 18:26:37.663584 5120 scope.go:117] "RemoveContainer" containerID="6aabe98083c5ab9b467fe00d2ebd9988de5342987777bf9f393b07f2a98973bc" Mar 16 18:26:37 crc kubenswrapper[5120]: E0316 18:26:37.663973 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd" Mar 16 18:26:38 crc kubenswrapper[5120]: I0316 18:26:38.673483 5120 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c1e049a-566b-4875-818a-22ff522101d7" path="/var/lib/kubelet/pods/7c1e049a-566b-4875-818a-22ff522101d7/volumes" Mar 16 18:26:41 crc kubenswrapper[5120]: I0316 18:26:41.490285 5120 scope.go:117] "RemoveContainer" containerID="fe40361329305dc4b3eb07be87e7e7a06b5b8ac69b273b9eef6aca3fdf2adf47" Mar 16 18:26:48 crc kubenswrapper[5120]: I0316 18:26:48.878957 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-v822j_ac55471d-4e42-475f-a082-50f611571482/kube-multus/0.log" Mar 16 18:26:48 crc kubenswrapper[5120]: I0316 18:26:48.884490 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-crc_9f0bc7fcb0822a2c13eb2d22cd8c0641/kube-controller-manager/0.log" Mar 16 18:26:49 crc kubenswrapper[5120]: I0316 18:26:49.109347 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-v822j_ac55471d-4e42-475f-a082-50f611571482/kube-multus/0.log" Mar 16 18:26:49 crc kubenswrapper[5120]: I0316 18:26:49.114521 5120 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-crc_9f0bc7fcb0822a2c13eb2d22cd8c0641/kube-controller-manager/0.log" Mar 16 18:26:51 crc kubenswrapper[5120]: I0316 18:26:51.663603 5120 scope.go:117] "RemoveContainer" containerID="6aabe98083c5ab9b467fe00d2ebd9988de5342987777bf9f393b07f2a98973bc" Mar 16 18:26:51 crc kubenswrapper[5120]: E0316 18:26:51.663939 5120 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-7bf76_openshift-machine-config-operator(e2275cb4-4905-4d66-a87e-8010120db2bd)\"" pod="openshift-machine-config-operator/machine-config-daemon-7bf76" podUID="e2275cb4-4905-4d66-a87e-8010120db2bd"